[2023-12-27 19:13:45,394][105115] Saving configuration to ./train_mujoco/mujoco_reacher_APPO/config.json... [2023-12-27 19:13:46,397][105115] Rollout worker 0 uses device cpu [2023-12-27 19:13:46,398][105115] Rollout worker 1 uses device cpu [2023-12-27 19:13:46,398][105115] Rollout worker 2 uses device cpu [2023-12-27 19:13:46,399][105115] Rollout worker 3 uses device cpu [2023-12-27 19:13:46,400][105115] Rollout worker 4 uses device cpu [2023-12-27 19:13:46,400][105115] Rollout worker 5 uses device cpu [2023-12-27 19:13:46,401][105115] Rollout worker 6 uses device cpu [2023-12-27 19:13:46,401][105115] Rollout worker 7 uses device cpu [2023-12-27 19:13:46,402][105115] Rollout worker 8 uses device cpu [2023-12-27 19:13:46,403][105115] Rollout worker 9 uses device cpu [2023-12-27 19:13:46,403][105115] Rollout worker 10 uses device cpu [2023-12-27 19:13:46,404][105115] Rollout worker 11 uses device cpu [2023-12-27 19:13:46,404][105115] Rollout worker 12 uses device cpu [2023-12-27 19:13:46,405][105115] Rollout worker 13 uses device cpu [2023-12-27 19:13:46,406][105115] Rollout worker 14 uses device cpu [2023-12-27 19:13:46,406][105115] Rollout worker 15 uses device cpu [2023-12-27 19:13:46,437][105115] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-27 19:13:46,437][105115] InferenceWorker_p0-w0: min num requests: 2 [2023-12-27 19:13:46,441][105115] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-27 19:13:46,441][105115] InferenceWorker_p1-w0: min num requests: 2 [2023-12-27 19:13:46,488][105115] Starting all processes... [2023-12-27 19:13:46,488][105115] Starting process learner_proc0 [2023-12-27 19:13:46,491][105115] Starting process learner_proc1 [2023-12-27 19:13:46,538][105115] Starting all processes... [2023-12-27 19:13:46,547][105115] Starting process inference_proc0-0 [2023-12-27 19:13:46,547][105115] Starting process inference_proc1-0 [2023-12-27 19:13:46,547][105115] Starting process rollout_proc0 [2023-12-27 19:13:46,548][105115] Starting process rollout_proc1 [2023-12-27 19:13:46,548][105115] Starting process rollout_proc2 [2023-12-27 19:13:46,548][105115] Starting process rollout_proc3 [2023-12-27 19:13:46,552][105115] Starting process rollout_proc4 [2023-12-27 19:13:46,554][105115] Starting process rollout_proc5 [2023-12-27 19:13:46,556][105115] Starting process rollout_proc6 [2023-12-27 19:13:46,556][105115] Starting process rollout_proc7 [2023-12-27 19:13:46,559][105115] Starting process rollout_proc8 [2023-12-27 19:13:46,565][105115] Starting process rollout_proc9 [2023-12-27 19:13:46,565][105115] Starting process rollout_proc10 [2023-12-27 19:13:46,576][105115] Starting process rollout_proc11 [2023-12-27 19:13:46,578][105115] Starting process rollout_proc12 [2023-12-27 19:13:46,578][105115] Starting process rollout_proc13 [2023-12-27 19:13:46,579][105115] Starting process rollout_proc14 [2023-12-27 19:13:46,579][105115] Starting process rollout_proc15 [2023-12-27 19:13:49,059][106244] Worker 13 uses CPU cores [26, 27] [2023-12-27 19:13:49,134][106141] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-27 19:13:49,135][106141] Set environment var CUDA_VISIBLE_DEVICES to '1' (GPU indices [1]) for learning process 1 [2023-12-27 19:13:49,161][106230] Worker 4 uses CPU cores [8, 9] [2023-12-27 19:13:49,183][106141] Num visible devices: 1 [2023-12-27 19:13:49,250][106225] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-27 19:13:49,251][106225] Set environment var CUDA_VISIBLE_DEVICES to '1' (GPU indices [1]) for inference process 1 [2023-12-27 19:13:49,258][106141] Setting fixed seed 1234 [2023-12-27 19:13:49,260][106141] Using GPUs [0] for process 1 (actually maps to GPUs [1]) [2023-12-27 19:13:49,261][106141] Initializing actor-critic model on device cuda:0 [2023-12-27 19:13:49,261][106141] RunningMeanStd input shape: (11,) [2023-12-27 19:13:49,262][106141] RunningMeanStd input shape: (1,) [2023-12-27 19:13:49,302][106225] Num visible devices: 1 [2023-12-27 19:13:49,307][106141] Created Actor Critic model with architecture: [2023-12-27 19:13:49,307][106141] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=2, bias=True) ) ) [2023-12-27 19:13:49,321][106240] Worker 8 uses CPU cores [16, 17] [2023-12-27 19:13:49,418][106233] Worker 5 uses CPU cores [10, 11] [2023-12-27 19:13:49,438][106245] Worker 14 uses CPU cores [28, 29] [2023-12-27 19:13:49,557][106243] Worker 12 uses CPU cores [24, 25] [2023-12-27 19:13:49,607][106229] Worker 2 uses CPU cores [4, 5] [2023-12-27 19:13:49,617][106242] Worker 10 uses CPU cores [20, 21] [2023-12-27 19:13:49,645][106239] Worker 9 uses CPU cores [18, 19] [2023-12-27 19:13:49,661][106140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-27 19:13:49,661][106140] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2023-12-27 19:13:49,703][106140] Num visible devices: 1 [2023-12-27 19:13:49,710][106238] Worker 7 uses CPU cores [14, 15] [2023-12-27 19:13:49,735][106140] Setting fixed seed 1234 [2023-12-27 19:13:49,736][106140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-27 19:13:49,737][106140] Initializing actor-critic model on device cuda:0 [2023-12-27 19:13:49,737][106140] RunningMeanStd input shape: (11,) [2023-12-27 19:13:49,738][106140] RunningMeanStd input shape: (1,) [2023-12-27 19:13:49,753][106226] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-27 19:13:49,753][106226] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2023-12-27 19:13:49,757][106227] Worker 0 uses CPU cores [0, 1] [2023-12-27 19:13:49,761][106228] Worker 1 uses CPU cores [2, 3] [2023-12-27 19:13:49,781][106140] Created Actor Critic model with architecture: [2023-12-27 19:13:49,781][106140] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=2, bias=True) ) ) [2023-12-27 19:13:49,809][106246] Worker 15 uses CPU cores [30, 31] [2023-12-27 19:13:49,834][106226] Num visible devices: 1 [2023-12-27 19:13:49,920][106241] Worker 11 uses CPU cores [22, 23] [2023-12-27 19:13:49,921][106237] Worker 6 uses CPU cores [12, 13] [2023-12-27 19:13:49,950][106232] Worker 3 uses CPU cores [6, 7] [2023-12-27 19:13:50,069][106141] Using optimizer [2023-12-27 19:13:50,070][106141] No checkpoints found [2023-12-27 19:13:50,070][106141] Did not load from checkpoint, starting from scratch! [2023-12-27 19:13:50,071][106141] Initialized policy 1 weights for model version 0 [2023-12-27 19:13:50,072][106141] LearnerWorker_p1 finished initialization! [2023-12-27 19:13:50,072][106141] Using GPUs [0] for process 1 (actually maps to GPUs [1]) [2023-12-27 19:13:50,423][106140] Using optimizer [2023-12-27 19:13:50,423][106140] No checkpoints found [2023-12-27 19:13:50,424][106140] Did not load from checkpoint, starting from scratch! [2023-12-27 19:13:50,424][106140] Initialized policy 0 weights for model version 0 [2023-12-27 19:13:50,425][106140] LearnerWorker_p0 finished initialization! [2023-12-27 19:13:50,426][106140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-27 19:13:50,665][106225] RunningMeanStd input shape: (11,) [2023-12-27 19:13:50,666][106225] RunningMeanStd input shape: (1,) [2023-12-27 19:13:50,701][105115] Inference worker 1-0 is ready! [2023-12-27 19:13:51,011][106226] RunningMeanStd input shape: (11,) [2023-12-27 19:13:51,011][106226] RunningMeanStd input shape: (1,) [2023-12-27 19:13:51,046][105115] Inference worker 0-0 is ready! [2023-12-27 19:13:51,046][105115] All inference workers are ready! Signal rollout workers to start! [2023-12-27 19:13:51,047][106237] EnvRunner 6-0 uses policy 0 [2023-12-27 19:13:51,047][106233] EnvRunner 5-0 uses policy 1 [2023-12-27 19:13:51,047][106242] EnvRunner 10-0 uses policy 0 [2023-12-27 19:13:51,047][106245] EnvRunner 14-0 uses policy 0 [2023-12-27 19:13:51,047][106229] EnvRunner 2-0 uses policy 0 [2023-12-27 19:13:51,047][106227] EnvRunner 0-0 uses policy 0 [2023-12-27 19:13:51,047][106228] EnvRunner 1-0 uses policy 1 [2023-12-27 19:13:51,047][106239] EnvRunner 9-0 uses policy 1 [2023-12-27 19:13:51,047][106246] EnvRunner 15-0 uses policy 1 [2023-12-27 19:13:51,047][106243] EnvRunner 12-0 uses policy 0 [2023-12-27 19:13:51,047][106238] EnvRunner 7-0 uses policy 1 [2023-12-27 19:13:51,047][106244] EnvRunner 13-0 uses policy 1 [2023-12-27 19:13:51,047][106241] EnvRunner 11-0 uses policy 1 [2023-12-27 19:13:51,050][106240] EnvRunner 8-0 uses policy 0 [2023-12-27 19:13:51,050][106232] EnvRunner 3-0 uses policy 1 [2023-12-27 19:13:51,051][106230] EnvRunner 4-0 uses policy 0 [2023-12-27 19:13:51,175][105115] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan, 1: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-12-27 19:13:51,202][106229] EnvRunner 2-1 uses policy 0 [2023-12-27 19:13:51,203][106237] EnvRunner 6-1 uses policy 0 [2023-12-27 19:13:51,204][106245] EnvRunner 14-1 uses policy 0 [2023-12-27 19:13:51,206][106232] EnvRunner 3-1 uses policy 1 [2023-12-27 19:13:51,208][106228] EnvRunner 1-1 uses policy 1 [2023-12-27 19:13:51,208][106239] EnvRunner 9-1 uses policy 1 [2023-12-27 19:13:51,210][106227] EnvRunner 0-1 uses policy 0 [2023-12-27 19:13:51,210][106242] EnvRunner 10-1 uses policy 0 [2023-12-27 19:13:51,213][106241] EnvRunner 11-1 uses policy 1 [2023-12-27 19:13:51,215][106243] EnvRunner 12-1 uses policy 0 [2023-12-27 19:13:51,215][106230] EnvRunner 4-1 uses policy 0 [2023-12-27 19:13:51,216][106246] EnvRunner 15-1 uses policy 1 [2023-12-27 19:13:51,216][106238] EnvRunner 7-1 uses policy 1 [2023-12-27 19:13:51,216][106240] EnvRunner 8-1 uses policy 0 [2023-12-27 19:13:51,218][106233] EnvRunner 5-1 uses policy 1 [2023-12-27 19:13:51,218][106244] EnvRunner 13-1 uses policy 1 [2023-12-27 19:13:53,418][106141] Signal inference workers to stop experience collection... [2023-12-27 19:13:53,424][106225] InferenceWorker_p1-w0: stopping experience collection [2023-12-27 19:13:53,426][106226] InferenceWorker_p0-w0: stopping experience collection [2023-12-27 19:13:54,007][106141] Signal inference workers to resume experience collection... [2023-12-27 19:13:54,008][106226] InferenceWorker_p0-w0: resuming experience collection [2023-12-27 19:13:54,008][106225] InferenceWorker_p1-w0: resuming experience collection [2023-12-27 19:13:54,066][106226] Updated weights for policy 0, policy_version 31 (0.0007) [2023-12-27 19:13:54,821][106140] Signal inference workers to stop experience collection... [2023-12-27 19:13:55,238][106140] Signal inference workers to resume experience collection... [2023-12-27 19:13:55,738][106226] Updated weights for policy 0, policy_version 72 (0.0009) [2023-12-27 19:13:55,787][106226] Updated weights for policy 0, policy_version 82 (0.0008) [2023-12-27 19:13:55,833][106226] Updated weights for policy 0, policy_version 92 (0.0008) [2023-12-27 19:13:56,113][106226] Updated weights for policy 0, policy_version 102 (0.0009) [2023-12-27 19:13:56,123][106225] Updated weights for policy 1, policy_version 72 (0.0373) [2023-12-27 19:13:56,174][106226] Updated weights for policy 0, policy_version 112 (0.0010) [2023-12-27 19:13:56,175][105115] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8192.0). Total num frames: 40960. Throughput: 0: 2968.0, 1: 3328.0. Samples: 31480. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 19:13:56,175][105115] Avg episode reward: [(0, '-108.655'), (1, '-107.990')] [2023-12-27 19:13:56,178][106225] Updated weights for policy 1, policy_version 82 (0.0009) [2023-12-27 19:13:56,224][106225] Updated weights for policy 1, policy_version 92 (0.0010) [2023-12-27 19:13:56,236][106226] Updated weights for policy 0, policy_version 122 (0.0010) [2023-12-27 19:13:56,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000000096_24576.pth... [2023-12-27 19:13:56,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000000128_32768.pth... [2023-12-27 19:13:56,423][105115] Heartbeat connected on Batcher_0 [2023-12-27 19:13:56,426][105115] Heartbeat connected on LearnerWorker_p0 [2023-12-27 19:13:56,429][105115] Heartbeat connected on Batcher_1 [2023-12-27 19:13:56,440][105115] Heartbeat connected on InferenceWorker_p0-w0 [2023-12-27 19:13:56,443][106225] Updated weights for policy 1, policy_version 102 (0.0007) [2023-12-27 19:13:56,444][105115] Heartbeat connected on RolloutWorker_w0 [2023-12-27 19:13:56,446][105115] Heartbeat connected on InferenceWorker_p1-w0 [2023-12-27 19:13:56,447][105115] Heartbeat connected on RolloutWorker_w1 [2023-12-27 19:13:56,450][105115] Heartbeat connected on RolloutWorker_w2 [2023-12-27 19:13:56,454][105115] Heartbeat connected on RolloutWorker_w3 [2023-12-27 19:13:56,455][105115] Heartbeat connected on RolloutWorker_w4 [2023-12-27 19:13:56,460][105115] Heartbeat connected on RolloutWorker_w5 [2023-12-27 19:13:56,461][105115] Heartbeat connected on RolloutWorker_w6 [2023-12-27 19:13:56,464][105115] Heartbeat connected on RolloutWorker_w7 [2023-12-27 19:13:56,467][105115] Heartbeat connected on RolloutWorker_w8 [2023-12-27 19:13:56,469][105115] Heartbeat connected on RolloutWorker_w9 [2023-12-27 19:13:56,472][105115] Heartbeat connected on RolloutWorker_w10 [2023-12-27 19:13:56,475][105115] Heartbeat connected on RolloutWorker_w11 [2023-12-27 19:13:56,477][105115] Heartbeat connected on RolloutWorker_w12 [2023-12-27 19:13:56,480][105115] Heartbeat connected on RolloutWorker_w13 [2023-12-27 19:13:56,484][105115] Heartbeat connected on RolloutWorker_w14 [2023-12-27 19:13:56,486][105115] Heartbeat connected on RolloutWorker_w15 [2023-12-27 19:13:56,505][106225] Updated weights for policy 1, policy_version 112 (0.0005) [2023-12-27 19:13:56,574][106225] Updated weights for policy 1, policy_version 122 (0.0005) [2023-12-27 19:13:56,612][105115] Heartbeat connected on LearnerWorker_p1 [2023-12-27 19:13:56,836][106226] Updated weights for policy 0, policy_version 132 (0.0008) [2023-12-27 19:13:56,898][106226] Updated weights for policy 0, policy_version 142 (0.0006) [2023-12-27 19:13:56,955][106226] Updated weights for policy 0, policy_version 152 (0.0006) [2023-12-27 19:13:57,071][106225] Updated weights for policy 1, policy_version 132 (0.0005) [2023-12-27 19:13:57,125][106225] Updated weights for policy 1, policy_version 142 (0.0005) [2023-12-27 19:13:57,192][106225] Updated weights for policy 1, policy_version 152 (0.0008) [2023-12-27 19:13:57,483][106226] Updated weights for policy 0, policy_version 162 (0.0005) [2023-12-27 19:13:57,542][106226] Updated weights for policy 0, policy_version 172 (0.0010) [2023-12-27 19:13:57,591][106226] Updated weights for policy 0, policy_version 182 (0.0009) [2023-12-27 19:13:57,641][106226] Updated weights for policy 0, policy_version 192 (0.0005) [2023-12-27 19:13:57,735][106225] Updated weights for policy 1, policy_version 162 (0.0010) [2023-12-27 19:13:57,779][106225] Updated weights for policy 1, policy_version 172 (0.0010) [2023-12-27 19:13:57,830][106225] Updated weights for policy 1, policy_version 182 (0.0010) [2023-12-27 19:13:57,874][106225] Updated weights for policy 1, policy_version 192 (0.0010) [2023-12-27 19:13:58,201][106226] Updated weights for policy 0, policy_version 202 (0.0007) [2023-12-27 19:13:58,264][106226] Updated weights for policy 0, policy_version 212 (0.0011) [2023-12-27 19:13:58,329][106226] Updated weights for policy 0, policy_version 222 (0.0010) [2023-12-27 19:13:58,670][106225] Updated weights for policy 1, policy_version 202 (0.0009) [2023-12-27 19:13:58,730][106225] Updated weights for policy 1, policy_version 212 (0.0010) [2023-12-27 19:13:58,795][106225] Updated weights for policy 1, policy_version 222 (0.0009) [2023-12-27 19:13:59,170][106226] Updated weights for policy 0, policy_version 232 (0.0006) [2023-12-27 19:13:59,248][106226] Updated weights for policy 0, policy_version 242 (0.0007) [2023-12-27 19:13:59,316][106226] Updated weights for policy 0, policy_version 252 (0.0009) [2023-12-27 19:13:59,645][106225] Updated weights for policy 1, policy_version 232 (0.0007) [2023-12-27 19:13:59,700][106225] Updated weights for policy 1, policy_version 242 (0.0009) [2023-12-27 19:13:59,762][106225] Updated weights for policy 1, policy_version 252 (0.0008) [2023-12-27 19:13:59,982][106226] Updated weights for policy 0, policy_version 262 (0.0008) [2023-12-27 19:14:00,050][106226] Updated weights for policy 0, policy_version 272 (0.0010) [2023-12-27 19:14:00,105][106226] Updated weights for policy 0, policy_version 282 (0.0010) [2023-12-27 19:14:00,396][106225] Updated weights for policy 1, policy_version 262 (0.0007) [2023-12-27 19:14:00,455][106225] Updated weights for policy 1, policy_version 272 (0.0007) [2023-12-27 19:14:00,505][106225] Updated weights for policy 1, policy_version 282 (0.0007) [2023-12-27 19:14:00,760][106226] Updated weights for policy 0, policy_version 292 (0.0010) [2023-12-27 19:14:00,814][106226] Updated weights for policy 0, policy_version 302 (0.0009) [2023-12-27 19:14:00,858][106226] Updated weights for policy 0, policy_version 312 (0.0006) [2023-12-27 19:14:01,174][105115] Fps is (10 sec: 15565.0, 60 sec: 15565.0, 300 sec: 15565.0). Total num frames: 155648. Throughput: 0: 7556.5, 1: 6742.1. Samples: 142984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-27 19:14:01,175][105115] Avg episode reward: [(0, '-89.812'), (1, '-90.833')] [2023-12-27 19:14:01,264][106225] Updated weights for policy 1, policy_version 292 (0.0008) [2023-12-27 19:14:01,326][106225] Updated weights for policy 1, policy_version 302 (0.0009) [2023-12-27 19:14:01,399][106225] Updated weights for policy 1, policy_version 312 (0.0008) [2023-12-27 19:14:01,578][106226] Updated weights for policy 0, policy_version 322 (0.0005) [2023-12-27 19:14:01,646][106226] Updated weights for policy 0, policy_version 332 (0.0008) [2023-12-27 19:14:01,700][106226] Updated weights for policy 0, policy_version 342 (0.0008) [2023-12-27 19:14:01,768][106226] Updated weights for policy 0, policy_version 352 (0.0009) [2023-12-27 19:14:02,182][106225] Updated weights for policy 1, policy_version 322 (0.0008) [2023-12-27 19:14:02,239][106225] Updated weights for policy 1, policy_version 332 (0.0009) [2023-12-27 19:14:02,297][106225] Updated weights for policy 1, policy_version 342 (0.0008) [2023-12-27 19:14:02,359][106225] Updated weights for policy 1, policy_version 352 (0.0007) [2023-12-27 19:14:02,421][106226] Updated weights for policy 0, policy_version 362 (0.0007) [2023-12-27 19:14:02,482][106226] Updated weights for policy 0, policy_version 372 (0.0008) [2023-12-27 19:14:02,546][106226] Updated weights for policy 0, policy_version 382 (0.0009) [2023-12-27 19:14:02,981][106225] Updated weights for policy 1, policy_version 362 (0.0005) [2023-12-27 19:14:03,032][106225] Updated weights for policy 1, policy_version 372 (0.0006) [2023-12-27 19:14:03,085][106225] Updated weights for policy 1, policy_version 382 (0.0008) [2023-12-27 19:14:03,290][106226] Updated weights for policy 0, policy_version 392 (0.0006) [2023-12-27 19:14:03,355][106226] Updated weights for policy 0, policy_version 402 (0.0005) [2023-12-27 19:14:03,416][106226] Updated weights for policy 0, policy_version 412 (0.0010) [2023-12-27 19:14:03,717][106225] Updated weights for policy 1, policy_version 392 (0.0008) [2023-12-27 19:14:03,769][106225] Updated weights for policy 1, policy_version 402 (0.0008) [2023-12-27 19:14:03,827][106225] Updated weights for policy 1, policy_version 412 (0.0007) [2023-12-27 19:14:03,942][106226] Updated weights for policy 0, policy_version 422 (0.0008) [2023-12-27 19:14:04,007][106226] Updated weights for policy 0, policy_version 432 (0.0006) [2023-12-27 19:14:04,071][106226] Updated weights for policy 0, policy_version 442 (0.0011) [2023-12-27 19:14:04,603][106225] Updated weights for policy 1, policy_version 422 (0.0008) [2023-12-27 19:14:04,652][106225] Updated weights for policy 1, policy_version 432 (0.0008) [2023-12-27 19:14:04,707][106225] Updated weights for policy 1, policy_version 442 (0.0008) [2023-12-27 19:14:04,755][106226] Updated weights for policy 0, policy_version 452 (0.0011) [2023-12-27 19:14:04,809][106226] Updated weights for policy 0, policy_version 462 (0.0011) [2023-12-27 19:14:04,865][106226] Updated weights for policy 0, policy_version 472 (0.0010) [2023-12-27 19:14:05,438][106225] Updated weights for policy 1, policy_version 452 (0.0007) [2023-12-27 19:14:05,501][106225] Updated weights for policy 1, policy_version 462 (0.0007) [2023-12-27 19:14:05,558][106225] Updated weights for policy 1, policy_version 472 (0.0008) [2023-12-27 19:14:05,577][106226] Updated weights for policy 0, policy_version 482 (0.0010) [2023-12-27 19:14:05,626][106226] Updated weights for policy 0, policy_version 492 (0.0010) [2023-12-27 19:14:05,676][106226] Updated weights for policy 0, policy_version 502 (0.0010) [2023-12-27 19:14:05,726][106226] Updated weights for policy 0, policy_version 512 (0.0010) [2023-12-27 19:14:06,175][105115] Fps is (10 sec: 21299.2, 60 sec: 16930.1, 300 sec: 16930.1). Total num frames: 253952. Throughput: 0: 9101.9, 1: 8449.3. Samples: 263268. Policy #0 lag: (min: 1.0, avg: 17.2, max: 33.0) [2023-12-27 19:14:06,175][105115] Avg episode reward: [(0, '-79.832'), (1, '-83.382')] [2023-12-27 19:14:06,176][106140] Saving new best policy, reward=-79.832! [2023-12-27 19:14:06,176][106141] Saving new best policy, reward=-83.382! [2023-12-27 19:14:06,299][106225] Updated weights for policy 1, policy_version 482 (0.0007) [2023-12-27 19:14:06,362][106225] Updated weights for policy 1, policy_version 492 (0.0009) [2023-12-27 19:14:06,427][106225] Updated weights for policy 1, policy_version 502 (0.0009) [2023-12-27 19:14:06,495][106225] Updated weights for policy 1, policy_version 512 (0.0007) [2023-12-27 19:14:06,501][106226] Updated weights for policy 0, policy_version 522 (0.0007) [2023-12-27 19:14:06,567][106226] Updated weights for policy 0, policy_version 532 (0.0009) [2023-12-27 19:14:06,633][106226] Updated weights for policy 0, policy_version 542 (0.0008) [2023-12-27 19:14:07,198][106225] Updated weights for policy 1, policy_version 522 (0.0008) [2023-12-27 19:14:07,260][106225] Updated weights for policy 1, policy_version 532 (0.0008) [2023-12-27 19:14:07,317][106225] Updated weights for policy 1, policy_version 542 (0.0009) [2023-12-27 19:14:07,319][106226] Updated weights for policy 0, policy_version 552 (0.0009) [2023-12-27 19:14:07,370][106226] Updated weights for policy 0, policy_version 562 (0.0008) [2023-12-27 19:14:07,423][106226] Updated weights for policy 0, policy_version 572 (0.0009) [2023-12-27 19:14:08,024][106225] Updated weights for policy 1, policy_version 552 (0.0009) [2023-12-27 19:14:08,077][106225] Updated weights for policy 1, policy_version 562 (0.0009) [2023-12-27 19:14:08,131][106225] Updated weights for policy 1, policy_version 572 (0.0009) [2023-12-27 19:14:08,152][106226] Updated weights for policy 0, policy_version 582 (0.0007) [2023-12-27 19:14:08,217][106226] Updated weights for policy 0, policy_version 592 (0.0008) [2023-12-27 19:14:08,266][106226] Updated weights for policy 0, policy_version 602 (0.0009) [2023-12-27 19:14:08,894][106225] Updated weights for policy 1, policy_version 582 (0.0009) [2023-12-27 19:14:08,913][106226] Updated weights for policy 0, policy_version 612 (0.0008) [2023-12-27 19:14:08,946][106225] Updated weights for policy 1, policy_version 592 (0.0007) [2023-12-27 19:14:08,971][106226] Updated weights for policy 0, policy_version 622 (0.0007) [2023-12-27 19:14:09,007][106225] Updated weights for policy 1, policy_version 602 (0.0007) [2023-12-27 19:14:09,028][106226] Updated weights for policy 0, policy_version 632 (0.0005) [2023-12-27 19:14:09,696][106225] Updated weights for policy 1, policy_version 612 (0.0006) [2023-12-27 19:14:09,759][106225] Updated weights for policy 1, policy_version 622 (0.0006) [2023-12-27 19:14:09,819][106225] Updated weights for policy 1, policy_version 632 (0.0008) [2023-12-27 19:14:09,833][106226] Updated weights for policy 0, policy_version 642 (0.0006) [2023-12-27 19:14:09,898][106226] Updated weights for policy 0, policy_version 652 (0.0008) [2023-12-27 19:14:09,967][106226] Updated weights for policy 0, policy_version 662 (0.0007) [2023-12-27 19:14:10,037][106226] Updated weights for policy 0, policy_version 672 (0.0008) [2023-12-27 19:14:10,506][106225] Updated weights for policy 1, policy_version 642 (0.0006) [2023-12-27 19:14:10,566][106225] Updated weights for policy 1, policy_version 652 (0.0006) [2023-12-27 19:14:10,623][106225] Updated weights for policy 1, policy_version 662 (0.0005) [2023-12-27 19:14:10,677][106225] Updated weights for policy 1, policy_version 672 (0.0005) [2023-12-27 19:14:10,763][106226] Updated weights for policy 0, policy_version 682 (0.0009) [2023-12-27 19:14:10,817][106226] Updated weights for policy 0, policy_version 692 (0.0010) [2023-12-27 19:14:10,874][106226] Updated weights for policy 0, policy_version 702 (0.0007) [2023-12-27 19:14:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 17612.8, 300 sec: 17612.8). Total num frames: 352256. Throughput: 0: 8315.6, 1: 7762.0. Samples: 321552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:14:11,175][105115] Avg episode reward: [(0, '-73.673'), (1, '-72.554')] [2023-12-27 19:14:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000000704_180224.pth... [2023-12-27 19:14:11,187][106140] Saving new best policy, reward=-73.673! [2023-12-27 19:14:11,240][106225] Updated weights for policy 1, policy_version 682 (0.0009) [2023-12-27 19:14:11,301][106225] Updated weights for policy 1, policy_version 692 (0.0010) [2023-12-27 19:14:11,367][106225] Updated weights for policy 1, policy_version 702 (0.0011) [2023-12-27 19:14:11,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000000704_180224.pth... [2023-12-27 19:14:11,383][106141] Saving new best policy, reward=-72.554! [2023-12-27 19:14:11,711][106226] Updated weights for policy 0, policy_version 712 (0.0007) [2023-12-27 19:14:11,780][106226] Updated weights for policy 0, policy_version 722 (0.0009) [2023-12-27 19:14:11,840][106226] Updated weights for policy 0, policy_version 732 (0.0008) [2023-12-27 19:14:12,149][106225] Updated weights for policy 1, policy_version 712 (0.0009) [2023-12-27 19:14:12,202][106225] Updated weights for policy 1, policy_version 722 (0.0008) [2023-12-27 19:14:12,256][106225] Updated weights for policy 1, policy_version 732 (0.0009) [2023-12-27 19:14:12,567][106226] Updated weights for policy 0, policy_version 742 (0.0010) [2023-12-27 19:14:12,624][106226] Updated weights for policy 0, policy_version 752 (0.0010) [2023-12-27 19:14:12,684][106226] Updated weights for policy 0, policy_version 762 (0.0011) [2023-12-27 19:14:13,045][106225] Updated weights for policy 1, policy_version 742 (0.0009) [2023-12-27 19:14:13,102][106225] Updated weights for policy 1, policy_version 752 (0.0008) [2023-12-27 19:14:13,165][106225] Updated weights for policy 1, policy_version 762 (0.0008) [2023-12-27 19:14:13,341][106226] Updated weights for policy 0, policy_version 772 (0.0010) [2023-12-27 19:14:13,397][106226] Updated weights for policy 0, policy_version 782 (0.0010) [2023-12-27 19:14:13,443][106226] Updated weights for policy 0, policy_version 792 (0.0010) [2023-12-27 19:14:13,856][106225] Updated weights for policy 1, policy_version 772 (0.0007) [2023-12-27 19:14:13,923][106225] Updated weights for policy 1, policy_version 782 (0.0005) [2023-12-27 19:14:13,988][106225] Updated weights for policy 1, policy_version 792 (0.0005) [2023-12-27 19:14:14,211][106226] Updated weights for policy 0, policy_version 802 (0.0010) [2023-12-27 19:14:14,259][106226] Updated weights for policy 0, policy_version 812 (0.0010) [2023-12-27 19:14:14,317][106226] Updated weights for policy 0, policy_version 822 (0.0008) [2023-12-27 19:14:14,387][106226] Updated weights for policy 0, policy_version 832 (0.0008) [2023-12-27 19:14:14,557][106225] Updated weights for policy 1, policy_version 802 (0.0006) [2023-12-27 19:14:14,616][106225] Updated weights for policy 1, policy_version 812 (0.0009) [2023-12-27 19:14:14,668][106225] Updated weights for policy 1, policy_version 822 (0.0008) [2023-12-27 19:14:14,721][106225] Updated weights for policy 1, policy_version 832 (0.0008) [2023-12-27 19:14:15,029][106226] Updated weights for policy 0, policy_version 842 (0.0009) [2023-12-27 19:14:15,094][106226] Updated weights for policy 0, policy_version 852 (0.0009) [2023-12-27 19:14:15,164][106226] Updated weights for policy 0, policy_version 862 (0.0009) [2023-12-27 19:14:15,462][106225] Updated weights for policy 1, policy_version 842 (0.0009) [2023-12-27 19:14:15,513][106225] Updated weights for policy 1, policy_version 852 (0.0007) [2023-12-27 19:14:15,577][106225] Updated weights for policy 1, policy_version 862 (0.0006) [2023-12-27 19:14:15,865][106226] Updated weights for policy 0, policy_version 872 (0.0006) [2023-12-27 19:14:15,922][106226] Updated weights for policy 0, policy_version 882 (0.0005) [2023-12-27 19:14:15,980][106226] Updated weights for policy 0, policy_version 892 (0.0005) [2023-12-27 19:14:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 18022.4). Total num frames: 450560. Throughput: 0: 8902.4, 1: 8631.7. Samples: 438352. Policy #0 lag: (min: 16.0, avg: 29.7, max: 48.0) [2023-12-27 19:14:16,175][105115] Avg episode reward: [(0, '-62.690'), (1, '-66.099')] [2023-12-27 19:14:16,176][106140] Saving new best policy, reward=-62.690! [2023-12-27 19:14:16,176][106141] Saving new best policy, reward=-66.099! [2023-12-27 19:14:16,336][106225] Updated weights for policy 1, policy_version 872 (0.0009) [2023-12-27 19:14:16,394][106225] Updated weights for policy 1, policy_version 882 (0.0008) [2023-12-27 19:14:16,462][106225] Updated weights for policy 1, policy_version 892 (0.0007) [2023-12-27 19:14:16,508][106226] Updated weights for policy 0, policy_version 902 (0.0008) [2023-12-27 19:14:16,559][106226] Updated weights for policy 0, policy_version 912 (0.0010) [2023-12-27 19:14:16,609][106226] Updated weights for policy 0, policy_version 922 (0.0010) [2023-12-27 19:14:17,201][106225] Updated weights for policy 1, policy_version 902 (0.0008) [2023-12-27 19:14:17,264][106225] Updated weights for policy 1, policy_version 912 (0.0008) [2023-12-27 19:14:17,273][106226] Updated weights for policy 0, policy_version 932 (0.0009) [2023-12-27 19:14:17,321][106225] Updated weights for policy 1, policy_version 922 (0.0008) [2023-12-27 19:14:17,334][106226] Updated weights for policy 0, policy_version 942 (0.0009) [2023-12-27 19:14:17,388][106226] Updated weights for policy 0, policy_version 952 (0.0007) [2023-12-27 19:14:18,052][106225] Updated weights for policy 1, policy_version 932 (0.0006) [2023-12-27 19:14:18,116][106225] Updated weights for policy 1, policy_version 942 (0.0008) [2023-12-27 19:14:18,148][106226] Updated weights for policy 0, policy_version 962 (0.0008) [2023-12-27 19:14:18,166][106225] Updated weights for policy 1, policy_version 952 (0.0007) [2023-12-27 19:14:18,210][106226] Updated weights for policy 0, policy_version 972 (0.0008) [2023-12-27 19:14:18,268][106226] Updated weights for policy 0, policy_version 982 (0.0009) [2023-12-27 19:14:18,328][106226] Updated weights for policy 0, policy_version 992 (0.0009) [2023-12-27 19:14:18,803][106225] Updated weights for policy 1, policy_version 962 (0.0009) [2023-12-27 19:14:18,865][106225] Updated weights for policy 1, policy_version 972 (0.0008) [2023-12-27 19:14:18,929][106225] Updated weights for policy 1, policy_version 982 (0.0005) [2023-12-27 19:14:18,995][106225] Updated weights for policy 1, policy_version 992 (0.0006) [2023-12-27 19:14:19,122][106226] Updated weights for policy 0, policy_version 1002 (0.0010) [2023-12-27 19:14:19,179][106226] Updated weights for policy 0, policy_version 1012 (0.0005) [2023-12-27 19:14:19,239][106226] Updated weights for policy 0, policy_version 1022 (0.0009) [2023-12-27 19:14:19,624][106225] Updated weights for policy 1, policy_version 1002 (0.0005) [2023-12-27 19:14:19,693][106225] Updated weights for policy 1, policy_version 1012 (0.0008) [2023-12-27 19:14:19,760][106225] Updated weights for policy 1, policy_version 1022 (0.0008) [2023-12-27 19:14:20,015][106226] Updated weights for policy 0, policy_version 1033 (0.0007) [2023-12-27 19:14:20,081][106226] Updated weights for policy 0, policy_version 1043 (0.0009) [2023-12-27 19:14:20,144][106226] Updated weights for policy 0, policy_version 1053 (0.0008) [2023-12-27 19:14:20,501][106225] Updated weights for policy 1, policy_version 1032 (0.0008) [2023-12-27 19:14:20,554][106225] Updated weights for policy 1, policy_version 1042 (0.0008) [2023-12-27 19:14:20,617][106225] Updated weights for policy 1, policy_version 1052 (0.0008) [2023-12-27 19:14:20,809][106226] Updated weights for policy 0, policy_version 1063 (0.0007) [2023-12-27 19:14:20,869][106226] Updated weights for policy 0, policy_version 1073 (0.0008) [2023-12-27 19:14:20,927][106226] Updated weights for policy 0, policy_version 1083 (0.0007) [2023-12-27 19:14:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 18295.6, 300 sec: 18295.6). Total num frames: 548864. Throughput: 0: 9411.1, 1: 9134.5. Samples: 556364. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-27 19:14:21,175][105115] Avg episode reward: [(0, '-56.892'), (1, '-58.853')] [2023-12-27 19:14:21,176][106140] Saving new best policy, reward=-56.892! [2023-12-27 19:14:21,176][106141] Saving new best policy, reward=-58.853! [2023-12-27 19:14:21,419][106225] Updated weights for policy 1, policy_version 1062 (0.0008) [2023-12-27 19:14:21,480][106225] Updated weights for policy 1, policy_version 1072 (0.0006) [2023-12-27 19:14:21,535][106225] Updated weights for policy 1, policy_version 1082 (0.0007) [2023-12-27 19:14:21,763][106226] Updated weights for policy 0, policy_version 1093 (0.0008) [2023-12-27 19:14:21,830][106226] Updated weights for policy 0, policy_version 1103 (0.0008) [2023-12-27 19:14:21,895][106226] Updated weights for policy 0, policy_version 1113 (0.0011) [2023-12-27 19:14:22,211][106225] Updated weights for policy 1, policy_version 1092 (0.0007) [2023-12-27 19:14:22,272][106225] Updated weights for policy 1, policy_version 1102 (0.0007) [2023-12-27 19:14:22,343][106225] Updated weights for policy 1, policy_version 1112 (0.0008) [2023-12-27 19:14:22,530][106226] Updated weights for policy 0, policy_version 1123 (0.0010) [2023-12-27 19:14:22,587][106226] Updated weights for policy 0, policy_version 1133 (0.0010) [2023-12-27 19:14:22,648][106226] Updated weights for policy 0, policy_version 1143 (0.0010) [2023-12-27 19:14:23,080][106225] Updated weights for policy 1, policy_version 1122 (0.0008) [2023-12-27 19:14:23,135][106225] Updated weights for policy 1, policy_version 1132 (0.0010) [2023-12-27 19:14:23,197][106225] Updated weights for policy 1, policy_version 1142 (0.0010) [2023-12-27 19:14:23,262][106225] Updated weights for policy 1, policy_version 1152 (0.0010) [2023-12-27 19:14:23,283][106226] Updated weights for policy 0, policy_version 1153 (0.0010) [2023-12-27 19:14:23,344][106226] Updated weights for policy 0, policy_version 1163 (0.0006) [2023-12-27 19:14:23,405][106226] Updated weights for policy 0, policy_version 1173 (0.0006) [2023-12-27 19:14:23,471][106226] Updated weights for policy 0, policy_version 1183 (0.0007) [2023-12-27 19:14:23,951][106225] Updated weights for policy 1, policy_version 1162 (0.0005) [2023-12-27 19:14:23,997][106225] Updated weights for policy 1, policy_version 1172 (0.0005) [2023-12-27 19:14:24,047][106225] Updated weights for policy 1, policy_version 1182 (0.0005) [2023-12-27 19:14:24,133][106226] Updated weights for policy 0, policy_version 1193 (0.0010) [2023-12-27 19:14:24,203][106226] Updated weights for policy 0, policy_version 1203 (0.0010) [2023-12-27 19:14:24,256][106226] Updated weights for policy 0, policy_version 1213 (0.0010) [2023-12-27 19:14:24,603][106225] Updated weights for policy 1, policy_version 1192 (0.0007) [2023-12-27 19:14:24,650][106225] Updated weights for policy 1, policy_version 1202 (0.0006) [2023-12-27 19:14:24,695][106225] Updated weights for policy 1, policy_version 1212 (0.0005) [2023-12-27 19:14:24,928][106226] Updated weights for policy 0, policy_version 1223 (0.0010) [2023-12-27 19:14:24,994][106226] Updated weights for policy 0, policy_version 1233 (0.0010) [2023-12-27 19:14:25,050][106226] Updated weights for policy 0, policy_version 1243 (0.0007) [2023-12-27 19:14:25,301][106225] Updated weights for policy 1, policy_version 1222 (0.0005) [2023-12-27 19:14:25,349][106225] Updated weights for policy 1, policy_version 1232 (0.0005) [2023-12-27 19:14:25,395][106225] Updated weights for policy 1, policy_version 1242 (0.0005) [2023-12-27 19:14:25,585][106226] Updated weights for policy 0, policy_version 1253 (0.0006) [2023-12-27 19:14:25,642][106226] Updated weights for policy 0, policy_version 1263 (0.0010) [2023-12-27 19:14:25,702][106226] Updated weights for policy 0, policy_version 1273 (0.0010) [2023-12-27 19:14:25,999][106225] Updated weights for policy 1, policy_version 1252 (0.0005) [2023-12-27 19:14:26,055][106225] Updated weights for policy 1, policy_version 1262 (0.0006) [2023-12-27 19:14:26,111][106225] Updated weights for policy 1, policy_version 1272 (0.0007) [2023-12-27 19:14:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 18724.6, 300 sec: 18724.6). Total num frames: 655360. Throughput: 0: 8922.4, 1: 8639.2. Samples: 614656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:14:26,175][105115] Avg episode reward: [(0, '-50.659'), (1, '-52.421')] [2023-12-27 19:14:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000001280_327680.pth... [2023-12-27 19:14:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000001280_327680.pth... [2023-12-27 19:14:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000000128_32768.pth [2023-12-27 19:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000000096_24576.pth [2023-12-27 19:14:26,186][106140] Saving new best policy, reward=-50.659! [2023-12-27 19:14:26,187][106141] Saving new best policy, reward=-52.421! [2023-12-27 19:14:26,290][106226] Updated weights for policy 0, policy_version 1283 (0.0008) [2023-12-27 19:14:26,357][106226] Updated weights for policy 0, policy_version 1293 (0.0008) [2023-12-27 19:14:26,416][106226] Updated weights for policy 0, policy_version 1303 (0.0008) [2023-12-27 19:14:26,855][106225] Updated weights for policy 1, policy_version 1282 (0.0008) [2023-12-27 19:14:26,903][106225] Updated weights for policy 1, policy_version 1292 (0.0008) [2023-12-27 19:14:26,948][106226] Updated weights for policy 0, policy_version 1313 (0.0006) [2023-12-27 19:14:26,963][106225] Updated weights for policy 1, policy_version 1302 (0.0008) [2023-12-27 19:14:27,005][106226] Updated weights for policy 0, policy_version 1323 (0.0010) [2023-12-27 19:14:27,015][106225] Updated weights for policy 1, policy_version 1312 (0.0008) [2023-12-27 19:14:27,059][106226] Updated weights for policy 0, policy_version 1333 (0.0010) [2023-12-27 19:14:27,109][106226] Updated weights for policy 0, policy_version 1343 (0.0010) [2023-12-27 19:14:27,749][106226] Updated weights for policy 0, policy_version 1353 (0.0006) [2023-12-27 19:14:27,749][106225] Updated weights for policy 1, policy_version 1322 (0.0009) [2023-12-27 19:14:27,797][106225] Updated weights for policy 1, policy_version 1332 (0.0007) [2023-12-27 19:14:27,798][106226] Updated weights for policy 0, policy_version 1363 (0.0005) [2023-12-27 19:14:27,853][106225] Updated weights for policy 1, policy_version 1342 (0.0007) [2023-12-27 19:14:27,858][106226] Updated weights for policy 0, policy_version 1373 (0.0011) [2023-12-27 19:14:28,461][106226] Updated weights for policy 0, policy_version 1383 (0.0010) [2023-12-27 19:14:28,526][106226] Updated weights for policy 0, policy_version 1393 (0.0008) [2023-12-27 19:14:28,583][106226] Updated weights for policy 0, policy_version 1403 (0.0008) [2023-12-27 19:14:28,608][106225] Updated weights for policy 1, policy_version 1352 (0.0006) [2023-12-27 19:14:28,659][106225] Updated weights for policy 1, policy_version 1362 (0.0008) [2023-12-27 19:14:28,702][106225] Updated weights for policy 1, policy_version 1372 (0.0008) [2023-12-27 19:14:29,264][106226] Updated weights for policy 0, policy_version 1413 (0.0006) [2023-12-27 19:14:29,317][106226] Updated weights for policy 0, policy_version 1423 (0.0007) [2023-12-27 19:14:29,381][106226] Updated weights for policy 0, policy_version 1433 (0.0009) [2023-12-27 19:14:29,469][106225] Updated weights for policy 1, policy_version 1382 (0.0009) [2023-12-27 19:14:29,529][106225] Updated weights for policy 1, policy_version 1392 (0.0009) [2023-12-27 19:14:29,580][106225] Updated weights for policy 1, policy_version 1402 (0.0008) [2023-12-27 19:14:30,111][106226] Updated weights for policy 0, policy_version 1443 (0.0008) [2023-12-27 19:14:30,159][106226] Updated weights for policy 0, policy_version 1453 (0.0007) [2023-12-27 19:14:30,209][106225] Updated weights for policy 1, policy_version 1412 (0.0009) [2023-12-27 19:14:30,210][106226] Updated weights for policy 0, policy_version 1463 (0.0009) [2023-12-27 19:14:30,259][106225] Updated weights for policy 1, policy_version 1422 (0.0005) [2023-12-27 19:14:30,306][106225] Updated weights for policy 1, policy_version 1432 (0.0008) [2023-12-27 19:14:30,825][106226] Updated weights for policy 0, policy_version 1473 (0.0007) [2023-12-27 19:14:30,879][106226] Updated weights for policy 0, policy_version 1483 (0.0008) [2023-12-27 19:14:30,926][106226] Updated weights for policy 0, policy_version 1493 (0.0008) [2023-12-27 19:14:30,983][106226] Updated weights for policy 0, policy_version 1503 (0.0008) [2023-12-27 19:14:30,996][106225] Updated weights for policy 1, policy_version 1442 (0.0009) [2023-12-27 19:14:31,066][106225] Updated weights for policy 1, policy_version 1452 (0.0009) [2023-12-27 19:14:31,128][106225] Updated weights for policy 1, policy_version 1462 (0.0010) [2023-12-27 19:14:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 18841.6, 300 sec: 18841.6). Total num frames: 753664. Throughput: 0: 9439.2, 1: 9117.0. Samples: 742248. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-27 19:14:31,175][105115] Avg episode reward: [(0, '-49.228'), (1, '-52.683')] [2023-12-27 19:14:31,176][106140] Saving new best policy, reward=-49.228! [2023-12-27 19:14:31,197][106225] Updated weights for policy 1, policy_version 1472 (0.0010) [2023-12-27 19:14:31,676][106226] Updated weights for policy 0, policy_version 1513 (0.0008) [2023-12-27 19:14:31,744][106226] Updated weights for policy 0, policy_version 1523 (0.0008) [2023-12-27 19:14:31,803][106226] Updated weights for policy 0, policy_version 1533 (0.0006) [2023-12-27 19:14:31,952][106225] Updated weights for policy 1, policy_version 1482 (0.0010) [2023-12-27 19:14:32,008][106225] Updated weights for policy 1, policy_version 1492 (0.0010) [2023-12-27 19:14:32,062][106225] Updated weights for policy 1, policy_version 1502 (0.0010) [2023-12-27 19:14:32,438][106226] Updated weights for policy 0, policy_version 1543 (0.0009) [2023-12-27 19:14:32,492][106226] Updated weights for policy 0, policy_version 1553 (0.0010) [2023-12-27 19:14:32,549][106226] Updated weights for policy 0, policy_version 1563 (0.0010) [2023-12-27 19:14:32,785][106225] Updated weights for policy 1, policy_version 1512 (0.0008) [2023-12-27 19:14:32,839][106225] Updated weights for policy 1, policy_version 1522 (0.0008) [2023-12-27 19:14:32,897][106225] Updated weights for policy 1, policy_version 1532 (0.0008) [2023-12-27 19:14:33,242][106226] Updated weights for policy 0, policy_version 1573 (0.0008) [2023-12-27 19:14:33,294][106226] Updated weights for policy 0, policy_version 1583 (0.0006) [2023-12-27 19:14:33,353][106226] Updated weights for policy 0, policy_version 1593 (0.0008) [2023-12-27 19:14:33,545][106225] Updated weights for policy 1, policy_version 1542 (0.0010) [2023-12-27 19:14:33,600][106225] Updated weights for policy 1, policy_version 1552 (0.0010) [2023-12-27 19:14:33,653][106225] Updated weights for policy 1, policy_version 1562 (0.0010) [2023-12-27 19:14:34,013][106226] Updated weights for policy 0, policy_version 1603 (0.0007) [2023-12-27 19:14:34,061][106226] Updated weights for policy 0, policy_version 1613 (0.0010) [2023-12-27 19:14:34,120][106226] Updated weights for policy 0, policy_version 1623 (0.0010) [2023-12-27 19:14:34,248][106225] Updated weights for policy 1, policy_version 1572 (0.0009) [2023-12-27 19:14:34,312][106225] Updated weights for policy 1, policy_version 1582 (0.0008) [2023-12-27 19:14:34,365][106225] Updated weights for policy 1, policy_version 1592 (0.0008) [2023-12-27 19:14:34,875][106226] Updated weights for policy 0, policy_version 1633 (0.0009) [2023-12-27 19:14:34,926][106226] Updated weights for policy 0, policy_version 1643 (0.0008) [2023-12-27 19:14:34,972][106226] Updated weights for policy 0, policy_version 1653 (0.0008) [2023-12-27 19:14:35,029][106226] Updated weights for policy 0, policy_version 1663 (0.0006) [2023-12-27 19:14:35,126][106225] Updated weights for policy 1, policy_version 1602 (0.0009) [2023-12-27 19:14:35,183][106225] Updated weights for policy 1, policy_version 1612 (0.0008) [2023-12-27 19:14:35,234][106225] Updated weights for policy 1, policy_version 1622 (0.0008) [2023-12-27 19:14:35,283][106225] Updated weights for policy 1, policy_version 1632 (0.0009) [2023-12-27 19:14:35,566][106226] Updated weights for policy 0, policy_version 1673 (0.0005) [2023-12-27 19:14:35,633][106226] Updated weights for policy 0, policy_version 1683 (0.0010) [2023-12-27 19:14:35,692][106226] Updated weights for policy 0, policy_version 1693 (0.0010) [2023-12-27 19:14:35,994][106225] Updated weights for policy 1, policy_version 1642 (0.0005) [2023-12-27 19:14:36,053][106225] Updated weights for policy 1, policy_version 1652 (0.0005) [2023-12-27 19:14:36,122][106225] Updated weights for policy 1, policy_version 1662 (0.0006) [2023-12-27 19:14:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19114.7, 300 sec: 19114.7). Total num frames: 860160. Throughput: 0: 9814.0, 1: 9427.0. Samples: 865844. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 19:14:36,175][105115] Avg episode reward: [(0, '-45.849'), (1, '-51.514')] [2023-12-27 19:14:36,176][106140] Saving new best policy, reward=-45.849! [2023-12-27 19:14:36,176][106141] Saving new best policy, reward=-51.514! [2023-12-27 19:14:36,311][106226] Updated weights for policy 0, policy_version 1703 (0.0011) [2023-12-27 19:14:36,375][106226] Updated weights for policy 0, policy_version 1713 (0.0010) [2023-12-27 19:14:36,441][106226] Updated weights for policy 0, policy_version 1723 (0.0011) [2023-12-27 19:14:36,827][106225] Updated weights for policy 1, policy_version 1672 (0.0007) [2023-12-27 19:14:36,895][106225] Updated weights for policy 1, policy_version 1682 (0.0009) [2023-12-27 19:14:36,956][106225] Updated weights for policy 1, policy_version 1692 (0.0008) [2023-12-27 19:14:37,182][106226] Updated weights for policy 0, policy_version 1733 (0.0008) [2023-12-27 19:14:37,253][106226] Updated weights for policy 0, policy_version 1743 (0.0006) [2023-12-27 19:14:37,313][106226] Updated weights for policy 0, policy_version 1753 (0.0010) [2023-12-27 19:14:37,712][106225] Updated weights for policy 1, policy_version 1702 (0.0008) [2023-12-27 19:14:37,773][106225] Updated weights for policy 1, policy_version 1712 (0.0007) [2023-12-27 19:14:37,830][106225] Updated weights for policy 1, policy_version 1722 (0.0007) [2023-12-27 19:14:37,924][106226] Updated weights for policy 0, policy_version 1763 (0.0010) [2023-12-27 19:14:37,993][106226] Updated weights for policy 0, policy_version 1773 (0.0010) [2023-12-27 19:14:38,058][106226] Updated weights for policy 0, policy_version 1783 (0.0010) [2023-12-27 19:14:38,484][106225] Updated weights for policy 1, policy_version 1732 (0.0007) [2023-12-27 19:14:38,550][106225] Updated weights for policy 1, policy_version 1742 (0.0009) [2023-12-27 19:14:38,614][106225] Updated weights for policy 1, policy_version 1752 (0.0009) [2023-12-27 19:14:38,773][106226] Updated weights for policy 0, policy_version 1793 (0.0010) [2023-12-27 19:14:38,834][106226] Updated weights for policy 0, policy_version 1803 (0.0010) [2023-12-27 19:14:38,895][106226] Updated weights for policy 0, policy_version 1813 (0.0010) [2023-12-27 19:14:38,946][106226] Updated weights for policy 0, policy_version 1823 (0.0010) [2023-12-27 19:14:39,341][106225] Updated weights for policy 1, policy_version 1762 (0.0008) [2023-12-27 19:14:39,422][106225] Updated weights for policy 1, policy_version 1772 (0.0008) [2023-12-27 19:14:39,473][106225] Updated weights for policy 1, policy_version 1782 (0.0008) [2023-12-27 19:14:39,521][106225] Updated weights for policy 1, policy_version 1792 (0.0008) [2023-12-27 19:14:39,690][106226] Updated weights for policy 0, policy_version 1833 (0.0011) [2023-12-27 19:14:39,752][106226] Updated weights for policy 0, policy_version 1843 (0.0011) [2023-12-27 19:14:39,813][106226] Updated weights for policy 0, policy_version 1853 (0.0011) [2023-12-27 19:14:40,294][106225] Updated weights for policy 1, policy_version 1802 (0.0007) [2023-12-27 19:14:40,352][106225] Updated weights for policy 1, policy_version 1812 (0.0008) [2023-12-27 19:14:40,414][106225] Updated weights for policy 1, policy_version 1822 (0.0008) [2023-12-27 19:14:40,583][106226] Updated weights for policy 0, policy_version 1863 (0.0010) [2023-12-27 19:14:40,643][106226] Updated weights for policy 0, policy_version 1873 (0.0010) [2023-12-27 19:14:40,693][106226] Updated weights for policy 0, policy_version 1883 (0.0010) [2023-12-27 19:14:41,157][106225] Updated weights for policy 1, policy_version 1832 (0.0008) [2023-12-27 19:14:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19005.5, 300 sec: 19005.5). Total num frames: 950272. Throughput: 0: 10140.5, 1: 9722.0. Samples: 925292. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-27 19:14:41,175][105115] Avg episode reward: [(0, '-42.209'), (1, '-47.864')] [2023-12-27 19:14:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000001888_483328.pth... [2023-12-27 19:14:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000000704_180224.pth [2023-12-27 19:14:41,185][106140] Saving new best policy, reward=-42.209! [2023-12-27 19:14:41,219][106225] Updated weights for policy 1, policy_version 1842 (0.0008) [2023-12-27 19:14:41,286][106225] Updated weights for policy 1, policy_version 1852 (0.0008) [2023-12-27 19:14:41,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000001856_475136.pth... [2023-12-27 19:14:41,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000000704_180224.pth [2023-12-27 19:14:41,319][106141] Saving new best policy, reward=-47.864! [2023-12-27 19:14:41,432][106226] Updated weights for policy 0, policy_version 1893 (0.0008) [2023-12-27 19:14:41,491][106226] Updated weights for policy 0, policy_version 1903 (0.0008) [2023-12-27 19:14:41,545][106226] Updated weights for policy 0, policy_version 1913 (0.0008) [2023-12-27 19:14:42,066][106225] Updated weights for policy 1, policy_version 1862 (0.0006) [2023-12-27 19:14:42,133][106225] Updated weights for policy 1, policy_version 1872 (0.0005) [2023-12-27 19:14:42,196][106225] Updated weights for policy 1, policy_version 1882 (0.0005) [2023-12-27 19:14:42,314][106226] Updated weights for policy 0, policy_version 1923 (0.0008) [2023-12-27 19:14:42,385][106226] Updated weights for policy 0, policy_version 1933 (0.0008) [2023-12-27 19:14:42,438][106226] Updated weights for policy 0, policy_version 1943 (0.0008) [2023-12-27 19:14:42,864][106225] Updated weights for policy 1, policy_version 1892 (0.0006) [2023-12-27 19:14:42,923][106225] Updated weights for policy 1, policy_version 1902 (0.0006) [2023-12-27 19:14:42,983][106225] Updated weights for policy 1, policy_version 1912 (0.0008) [2023-12-27 19:14:43,204][106226] Updated weights for policy 0, policy_version 1953 (0.0008) [2023-12-27 19:14:43,255][106226] Updated weights for policy 0, policy_version 1963 (0.0008) [2023-12-27 19:14:43,303][106226] Updated weights for policy 0, policy_version 1973 (0.0007) [2023-12-27 19:14:43,355][106226] Updated weights for policy 0, policy_version 1983 (0.0005) [2023-12-27 19:14:43,617][106225] Updated weights for policy 1, policy_version 1922 (0.0007) [2023-12-27 19:14:43,675][106225] Updated weights for policy 1, policy_version 1932 (0.0008) [2023-12-27 19:14:43,735][106225] Updated weights for policy 1, policy_version 1942 (0.0008) [2023-12-27 19:14:43,789][106225] Updated weights for policy 1, policy_version 1952 (0.0005) [2023-12-27 19:14:43,930][106226] Updated weights for policy 0, policy_version 1993 (0.0008) [2023-12-27 19:14:43,993][106226] Updated weights for policy 0, policy_version 2003 (0.0008) [2023-12-27 19:14:44,056][106226] Updated weights for policy 0, policy_version 2013 (0.0008) [2023-12-27 19:14:44,421][106225] Updated weights for policy 1, policy_version 1962 (0.0005) [2023-12-27 19:14:44,476][106225] Updated weights for policy 1, policy_version 1972 (0.0005) [2023-12-27 19:14:44,530][106225] Updated weights for policy 1, policy_version 1982 (0.0005) [2023-12-27 19:14:44,830][106226] Updated weights for policy 0, policy_version 2023 (0.0008) [2023-12-27 19:14:44,896][106226] Updated weights for policy 0, policy_version 2033 (0.0009) [2023-12-27 19:14:44,960][106226] Updated weights for policy 0, policy_version 2043 (0.0008) [2023-12-27 19:14:45,177][106225] Updated weights for policy 1, policy_version 1992 (0.0008) [2023-12-27 19:14:45,244][106225] Updated weights for policy 1, policy_version 2002 (0.0009) [2023-12-27 19:14:45,312][106225] Updated weights for policy 1, policy_version 2012 (0.0009) [2023-12-27 19:14:45,685][106226] Updated weights for policy 0, policy_version 2053 (0.0007) [2023-12-27 19:14:45,745][106226] Updated weights for policy 0, policy_version 2063 (0.0005) [2023-12-27 19:14:45,803][106226] Updated weights for policy 0, policy_version 2073 (0.0005) [2023-12-27 19:14:46,008][106225] Updated weights for policy 1, policy_version 2022 (0.0006) [2023-12-27 19:14:46,054][106225] Updated weights for policy 1, policy_version 2032 (0.0005) [2023-12-27 19:14:46,108][106225] Updated weights for policy 1, policy_version 2042 (0.0005) [2023-12-27 19:14:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19214.0, 300 sec: 19214.0). Total num frames: 1056768. Throughput: 0: 10049.5, 1: 9911.6. Samples: 1041232. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:14:46,175][105115] Avg episode reward: [(0, '-37.739'), (1, '-43.003')] [2023-12-27 19:14:46,176][106140] Saving new best policy, reward=-37.739! [2023-12-27 19:14:46,176][106141] Saving new best policy, reward=-43.003! [2023-12-27 19:14:46,410][106226] Updated weights for policy 0, policy_version 2083 (0.0005) [2023-12-27 19:14:46,479][106226] Updated weights for policy 0, policy_version 2093 (0.0005) [2023-12-27 19:14:46,537][106226] Updated weights for policy 0, policy_version 2103 (0.0005) [2023-12-27 19:14:46,681][106225] Updated weights for policy 1, policy_version 2052 (0.0005) [2023-12-27 19:14:46,745][106225] Updated weights for policy 1, policy_version 2062 (0.0007) [2023-12-27 19:14:46,803][106225] Updated weights for policy 1, policy_version 2072 (0.0008) [2023-12-27 19:14:47,052][106226] Updated weights for policy 0, policy_version 2113 (0.0006) [2023-12-27 19:14:47,109][106226] Updated weights for policy 0, policy_version 2123 (0.0010) [2023-12-27 19:14:47,159][106226] Updated weights for policy 0, policy_version 2133 (0.0010) [2023-12-27 19:14:47,209][106226] Updated weights for policy 0, policy_version 2143 (0.0010) [2023-12-27 19:14:47,452][106225] Updated weights for policy 1, policy_version 2082 (0.0009) [2023-12-27 19:14:47,512][106225] Updated weights for policy 1, policy_version 2092 (0.0010) [2023-12-27 19:14:47,569][106225] Updated weights for policy 1, policy_version 2102 (0.0009) [2023-12-27 19:14:47,621][106225] Updated weights for policy 1, policy_version 2112 (0.0005) [2023-12-27 19:14:47,821][106226] Updated weights for policy 0, policy_version 2153 (0.0006) [2023-12-27 19:14:47,891][106226] Updated weights for policy 0, policy_version 2163 (0.0009) [2023-12-27 19:14:47,955][106226] Updated weights for policy 0, policy_version 2173 (0.0007) [2023-12-27 19:14:48,192][106225] Updated weights for policy 1, policy_version 2122 (0.0007) [2023-12-27 19:14:48,240][106225] Updated weights for policy 1, policy_version 2132 (0.0008) [2023-12-27 19:14:48,285][106225] Updated weights for policy 1, policy_version 2142 (0.0008) [2023-12-27 19:14:48,677][106226] Updated weights for policy 0, policy_version 2183 (0.0008) [2023-12-27 19:14:48,737][106226] Updated weights for policy 0, policy_version 2193 (0.0007) [2023-12-27 19:14:48,802][106226] Updated weights for policy 0, policy_version 2203 (0.0010) [2023-12-27 19:14:48,983][106225] Updated weights for policy 1, policy_version 2152 (0.0008) [2023-12-27 19:14:49,031][106225] Updated weights for policy 1, policy_version 2162 (0.0008) [2023-12-27 19:14:49,085][106225] Updated weights for policy 1, policy_version 2172 (0.0007) [2023-12-27 19:14:49,554][106226] Updated weights for policy 0, policy_version 2214 (0.0010) [2023-12-27 19:14:49,604][106226] Updated weights for policy 0, policy_version 2224 (0.0008) [2023-12-27 19:14:49,660][106226] Updated weights for policy 0, policy_version 2234 (0.0009) [2023-12-27 19:14:49,897][106225] Updated weights for policy 1, policy_version 2182 (0.0008) [2023-12-27 19:14:49,970][106225] Updated weights for policy 1, policy_version 2192 (0.0009) [2023-12-27 19:14:50,036][106225] Updated weights for policy 1, policy_version 2202 (0.0009) [2023-12-27 19:14:50,392][106226] Updated weights for policy 0, policy_version 2244 (0.0008) [2023-12-27 19:14:50,451][106226] Updated weights for policy 0, policy_version 2254 (0.0011) [2023-12-27 19:14:50,533][106226] Updated weights for policy 0, policy_version 2264 (0.0011) [2023-12-27 19:14:50,812][106225] Updated weights for policy 1, policy_version 2212 (0.0009) [2023-12-27 19:14:50,874][106225] Updated weights for policy 1, policy_version 2222 (0.0008) [2023-12-27 19:14:50,932][106225] Updated weights for policy 1, policy_version 2232 (0.0010) [2023-12-27 19:14:51,163][106226] Updated weights for policy 0, policy_version 2274 (0.0011) [2023-12-27 19:14:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19251.2, 300 sec: 19251.2). Total num frames: 1155072. Throughput: 0: 10075.7, 1: 9953.5. Samples: 1164580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:14:51,175][105115] Avg episode reward: [(0, '-34.215'), (1, '-38.818')] [2023-12-27 19:14:51,176][106141] Saving new best policy, reward=-38.818! [2023-12-27 19:14:51,225][106226] Updated weights for policy 0, policy_version 2284 (0.0007) [2023-12-27 19:14:51,287][106226] Updated weights for policy 0, policy_version 2294 (0.0008) [2023-12-27 19:14:51,346][106140] Saving new best policy, reward=-34.215! [2023-12-27 19:14:51,348][106226] Updated weights for policy 0, policy_version 2304 (0.0006) [2023-12-27 19:14:51,811][106225] Updated weights for policy 1, policy_version 2242 (0.0008) [2023-12-27 19:14:51,871][106225] Updated weights for policy 1, policy_version 2252 (0.0007) [2023-12-27 19:14:51,925][106225] Updated weights for policy 1, policy_version 2262 (0.0008) [2023-12-27 19:14:51,973][106225] Updated weights for policy 1, policy_version 2272 (0.0008) [2023-12-27 19:14:52,128][106226] Updated weights for policy 0, policy_version 2314 (0.0011) [2023-12-27 19:14:52,188][106226] Updated weights for policy 0, policy_version 2324 (0.0010) [2023-12-27 19:14:52,250][106226] Updated weights for policy 0, policy_version 2334 (0.0011) [2023-12-27 19:14:52,735][106225] Updated weights for policy 1, policy_version 2282 (0.0008) [2023-12-27 19:14:52,796][106225] Updated weights for policy 1, policy_version 2292 (0.0007) [2023-12-27 19:14:52,862][106225] Updated weights for policy 1, policy_version 2302 (0.0007) [2023-12-27 19:14:52,970][106226] Updated weights for policy 0, policy_version 2344 (0.0010) [2023-12-27 19:14:53,020][106226] Updated weights for policy 0, policy_version 2354 (0.0010) [2023-12-27 19:14:53,082][106226] Updated weights for policy 0, policy_version 2364 (0.0011) [2023-12-27 19:14:53,612][106225] Updated weights for policy 1, policy_version 2312 (0.0009) [2023-12-27 19:14:53,661][106225] Updated weights for policy 1, policy_version 2322 (0.0008) [2023-12-27 19:14:53,709][106225] Updated weights for policy 1, policy_version 2332 (0.0009) [2023-12-27 19:14:53,768][106226] Updated weights for policy 0, policy_version 2374 (0.0009) [2023-12-27 19:14:53,823][106226] Updated weights for policy 0, policy_version 2384 (0.0009) [2023-12-27 19:14:53,871][106226] Updated weights for policy 0, policy_version 2394 (0.0008) [2023-12-27 19:14:54,395][106225] Updated weights for policy 1, policy_version 2342 (0.0009) [2023-12-27 19:14:54,454][106225] Updated weights for policy 1, policy_version 2352 (0.0010) [2023-12-27 19:14:54,511][106225] Updated weights for policy 1, policy_version 2362 (0.0010) [2023-12-27 19:14:54,579][106226] Updated weights for policy 0, policy_version 2404 (0.0008) [2023-12-27 19:14:54,640][106226] Updated weights for policy 0, policy_version 2414 (0.0009) [2023-12-27 19:14:54,690][106226] Updated weights for policy 0, policy_version 2424 (0.0009) [2023-12-27 19:14:55,073][106225] Updated weights for policy 1, policy_version 2372 (0.0008) [2023-12-27 19:14:55,131][106225] Updated weights for policy 1, policy_version 2382 (0.0008) [2023-12-27 19:14:55,187][106225] Updated weights for policy 1, policy_version 2392 (0.0005) [2023-12-27 19:14:55,486][106226] Updated weights for policy 0, policy_version 2434 (0.0009) [2023-12-27 19:14:55,542][106226] Updated weights for policy 0, policy_version 2444 (0.0008) [2023-12-27 19:14:55,604][106226] Updated weights for policy 0, policy_version 2454 (0.0009) [2023-12-27 19:14:55,659][106226] Updated weights for policy 0, policy_version 2464 (0.0009) [2023-12-27 19:14:55,794][106225] Updated weights for policy 1, policy_version 2402 (0.0008) [2023-12-27 19:14:55,847][106225] Updated weights for policy 1, policy_version 2412 (0.0008) [2023-12-27 19:14:55,899][106225] Updated weights for policy 1, policy_version 2422 (0.0009) [2023-12-27 19:14:55,955][106225] Updated weights for policy 1, policy_version 2432 (0.0008) [2023-12-27 19:14:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20206.9, 300 sec: 19282.6). Total num frames: 1253376. Throughput: 0: 10055.8, 1: 9914.0. Samples: 1220196. Policy #0 lag: (min: 4.0, avg: 5.8, max: 36.0) [2023-12-27 19:14:56,176][105115] Avg episode reward: [(0, '-31.009'), (1, '-36.226')] [2023-12-27 19:14:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000002432_622592.pth... [2023-12-27 19:14:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000002464_630784.pth... [2023-12-27 19:14:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000001280_327680.pth [2023-12-27 19:14:56,188][106141] Saving new best policy, reward=-36.226! [2023-12-27 19:14:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000001280_327680.pth [2023-12-27 19:14:56,194][106140] Saving new best policy, reward=-31.009! [2023-12-27 19:14:56,426][106226] Updated weights for policy 0, policy_version 2474 (0.0009) [2023-12-27 19:14:56,493][106226] Updated weights for policy 0, policy_version 2484 (0.0006) [2023-12-27 19:14:56,558][106226] Updated weights for policy 0, policy_version 2494 (0.0005) [2023-12-27 19:14:56,656][106225] Updated weights for policy 1, policy_version 2442 (0.0005) [2023-12-27 19:14:56,719][106225] Updated weights for policy 1, policy_version 2452 (0.0009) [2023-12-27 19:14:56,780][106225] Updated weights for policy 1, policy_version 2462 (0.0007) [2023-12-27 19:14:57,183][106226] Updated weights for policy 0, policy_version 2504 (0.0009) [2023-12-27 19:14:57,251][106226] Updated weights for policy 0, policy_version 2514 (0.0010) [2023-12-27 19:14:57,320][106226] Updated weights for policy 0, policy_version 2524 (0.0011) [2023-12-27 19:14:57,365][106225] Updated weights for policy 1, policy_version 2472 (0.0008) [2023-12-27 19:14:57,419][106225] Updated weights for policy 1, policy_version 2482 (0.0008) [2023-12-27 19:14:57,478][106225] Updated weights for policy 1, policy_version 2493 (0.0008) [2023-12-27 19:14:57,874][106226] Updated weights for policy 0, policy_version 2534 (0.0010) [2023-12-27 19:14:57,936][106226] Updated weights for policy 0, policy_version 2544 (0.0009) [2023-12-27 19:14:58,002][106226] Updated weights for policy 0, policy_version 2554 (0.0006) [2023-12-27 19:14:58,029][106225] Updated weights for policy 1, policy_version 2503 (0.0005) [2023-12-27 19:14:58,080][106225] Updated weights for policy 1, policy_version 2513 (0.0005) [2023-12-27 19:14:58,139][106225] Updated weights for policy 1, policy_version 2523 (0.0005) [2023-12-27 19:14:58,642][106226] Updated weights for policy 0, policy_version 2564 (0.0010) [2023-12-27 19:14:58,708][106226] Updated weights for policy 0, policy_version 2574 (0.0008) [2023-12-27 19:14:58,773][106226] Updated weights for policy 0, policy_version 2584 (0.0008) [2023-12-27 19:14:58,795][106225] Updated weights for policy 1, policy_version 2533 (0.0007) [2023-12-27 19:14:58,863][106225] Updated weights for policy 1, policy_version 2543 (0.0007) [2023-12-27 19:14:58,932][106225] Updated weights for policy 1, policy_version 2553 (0.0007) [2023-12-27 19:14:59,585][106226] Updated weights for policy 0, policy_version 2595 (0.0008) [2023-12-27 19:14:59,650][106226] Updated weights for policy 0, policy_version 2605 (0.0006) [2023-12-27 19:14:59,684][106225] Updated weights for policy 1, policy_version 2563 (0.0008) [2023-12-27 19:14:59,709][106226] Updated weights for policy 0, policy_version 2615 (0.0006) [2023-12-27 19:14:59,729][106225] Updated weights for policy 1, policy_version 2573 (0.0006) [2023-12-27 19:14:59,788][106225] Updated weights for policy 1, policy_version 2583 (0.0008) [2023-12-27 19:15:00,386][106226] Updated weights for policy 0, policy_version 2625 (0.0008) [2023-12-27 19:15:00,444][106226] Updated weights for policy 0, policy_version 2635 (0.0009) [2023-12-27 19:15:00,496][106226] Updated weights for policy 0, policy_version 2645 (0.0008) [2023-12-27 19:15:00,502][106225] Updated weights for policy 1, policy_version 2593 (0.0008) [2023-12-27 19:15:00,545][106226] Updated weights for policy 0, policy_version 2655 (0.0006) [2023-12-27 19:15:00,567][106225] Updated weights for policy 1, policy_version 2603 (0.0007) [2023-12-27 19:15:00,634][106225] Updated weights for policy 1, policy_version 2613 (0.0008) [2023-12-27 19:15:00,703][106225] Updated weights for policy 1, policy_version 2623 (0.0008) [2023-12-27 19:15:01,143][106226] Updated weights for policy 0, policy_version 2665 (0.0007) [2023-12-27 19:15:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19309.7). Total num frames: 1351680. Throughput: 0: 10132.6, 1: 10004.5. Samples: 1344516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:15:01,175][105115] Avg episode reward: [(0, '-28.516'), (1, '-31.820')] [2023-12-27 19:15:01,176][106141] Saving new best policy, reward=-31.820! [2023-12-27 19:15:01,206][106226] Updated weights for policy 0, policy_version 2675 (0.0007) [2023-12-27 19:15:01,263][106226] Updated weights for policy 0, policy_version 2685 (0.0009) [2023-12-27 19:15:01,280][106140] Saving new best policy, reward=-28.516! [2023-12-27 19:15:01,513][106225] Updated weights for policy 1, policy_version 2633 (0.0008) [2023-12-27 19:15:01,578][106225] Updated weights for policy 1, policy_version 2643 (0.0010) [2023-12-27 19:15:01,645][106225] Updated weights for policy 1, policy_version 2653 (0.0009) [2023-12-27 19:15:01,950][106226] Updated weights for policy 0, policy_version 2695 (0.0008) [2023-12-27 19:15:02,002][106226] Updated weights for policy 0, policy_version 2705 (0.0007) [2023-12-27 19:15:02,056][106226] Updated weights for policy 0, policy_version 2715 (0.0006) [2023-12-27 19:15:02,425][106225] Updated weights for policy 1, policy_version 2663 (0.0010) [2023-12-27 19:15:02,479][106225] Updated weights for policy 1, policy_version 2673 (0.0010) [2023-12-27 19:15:02,542][106225] Updated weights for policy 1, policy_version 2683 (0.0010) [2023-12-27 19:15:02,758][106226] Updated weights for policy 0, policy_version 2725 (0.0008) [2023-12-27 19:15:02,807][106226] Updated weights for policy 0, policy_version 2735 (0.0008) [2023-12-27 19:15:02,863][106226] Updated weights for policy 0, policy_version 2745 (0.0007) [2023-12-27 19:15:03,252][106225] Updated weights for policy 1, policy_version 2693 (0.0010) [2023-12-27 19:15:03,308][106225] Updated weights for policy 1, policy_version 2703 (0.0010) [2023-12-27 19:15:03,361][106225] Updated weights for policy 1, policy_version 2713 (0.0010) [2023-12-27 19:15:03,601][106226] Updated weights for policy 0, policy_version 2755 (0.0007) [2023-12-27 19:15:03,659][106226] Updated weights for policy 0, policy_version 2765 (0.0005) [2023-12-27 19:15:03,705][106226] Updated weights for policy 0, policy_version 2775 (0.0007) [2023-12-27 19:15:04,069][106225] Updated weights for policy 1, policy_version 2723 (0.0009) [2023-12-27 19:15:04,129][106225] Updated weights for policy 1, policy_version 2733 (0.0005) [2023-12-27 19:15:04,186][106225] Updated weights for policy 1, policy_version 2743 (0.0005) [2023-12-27 19:15:04,445][106226] Updated weights for policy 0, policy_version 2785 (0.0010) [2023-12-27 19:15:04,509][106226] Updated weights for policy 0, policy_version 2795 (0.0010) [2023-12-27 19:15:04,571][106226] Updated weights for policy 0, policy_version 2805 (0.0009) [2023-12-27 19:15:04,635][106226] Updated weights for policy 0, policy_version 2815 (0.0008) [2023-12-27 19:15:04,870][106225] Updated weights for policy 1, policy_version 2753 (0.0007) [2023-12-27 19:15:04,929][106225] Updated weights for policy 1, policy_version 2763 (0.0007) [2023-12-27 19:15:04,985][106225] Updated weights for policy 1, policy_version 2773 (0.0008) [2023-12-27 19:15:05,048][106225] Updated weights for policy 1, policy_version 2783 (0.0010) [2023-12-27 19:15:05,236][106226] Updated weights for policy 0, policy_version 2825 (0.0010) [2023-12-27 19:15:05,296][106226] Updated weights for policy 0, policy_version 2835 (0.0010) [2023-12-27 19:15:05,346][106226] Updated weights for policy 0, policy_version 2845 (0.0010) [2023-12-27 19:15:05,727][106225] Updated weights for policy 1, policy_version 2793 (0.0010) [2023-12-27 19:15:05,777][106225] Updated weights for policy 1, policy_version 2803 (0.0010) [2023-12-27 19:15:05,823][106225] Updated weights for policy 1, policy_version 2813 (0.0010) [2023-12-27 19:15:05,951][106226] Updated weights for policy 0, policy_version 2855 (0.0010) [2023-12-27 19:15:06,016][106226] Updated weights for policy 0, policy_version 2865 (0.0009) [2023-12-27 19:15:06,067][106226] Updated weights for policy 0, policy_version 2875 (0.0010) [2023-12-27 19:15:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19442.4). Total num frames: 1458176. Throughput: 0: 10171.6, 1: 9991.0. Samples: 1463684. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-27 19:15:06,175][105115] Avg episode reward: [(0, '-26.603'), (1, '-29.314')] [2023-12-27 19:15:06,176][106140] Saving new best policy, reward=-26.603! [2023-12-27 19:15:06,176][106141] Saving new best policy, reward=-29.314! [2023-12-27 19:15:06,582][106225] Updated weights for policy 1, policy_version 2823 (0.0010) [2023-12-27 19:15:06,647][106225] Updated weights for policy 1, policy_version 2833 (0.0010) [2023-12-27 19:15:06,714][106225] Updated weights for policy 1, policy_version 2843 (0.0010) [2023-12-27 19:15:06,767][106226] Updated weights for policy 0, policy_version 2885 (0.0010) [2023-12-27 19:15:06,824][106226] Updated weights for policy 0, policy_version 2895 (0.0010) [2023-12-27 19:15:06,887][106226] Updated weights for policy 0, policy_version 2905 (0.0008) [2023-12-27 19:15:07,441][106225] Updated weights for policy 1, policy_version 2853 (0.0011) [2023-12-27 19:15:07,496][106225] Updated weights for policy 1, policy_version 2863 (0.0010) [2023-12-27 19:15:07,516][106226] Updated weights for policy 0, policy_version 2915 (0.0008) [2023-12-27 19:15:07,549][106225] Updated weights for policy 1, policy_version 2873 (0.0009) [2023-12-27 19:15:07,574][106226] Updated weights for policy 0, policy_version 2925 (0.0009) [2023-12-27 19:15:07,626][106226] Updated weights for policy 0, policy_version 2935 (0.0005) [2023-12-27 19:15:08,128][106225] Updated weights for policy 1, policy_version 2883 (0.0006) [2023-12-27 19:15:08,187][106225] Updated weights for policy 1, policy_version 2893 (0.0007) [2023-12-27 19:15:08,209][106226] Updated weights for policy 0, policy_version 2945 (0.0006) [2023-12-27 19:15:08,243][106225] Updated weights for policy 1, policy_version 2903 (0.0007) [2023-12-27 19:15:08,269][106226] Updated weights for policy 0, policy_version 2955 (0.0011) [2023-12-27 19:15:08,329][106226] Updated weights for policy 0, policy_version 2965 (0.0008) [2023-12-27 19:15:08,402][106226] Updated weights for policy 0, policy_version 2975 (0.0010) [2023-12-27 19:15:08,858][106225] Updated weights for policy 1, policy_version 2913 (0.0006) [2023-12-27 19:15:08,924][106225] Updated weights for policy 1, policy_version 2923 (0.0009) [2023-12-27 19:15:08,977][106225] Updated weights for policy 1, policy_version 2933 (0.0007) [2023-12-27 19:15:09,032][106225] Updated weights for policy 1, policy_version 2943 (0.0007) [2023-12-27 19:15:09,064][106226] Updated weights for policy 0, policy_version 2985 (0.0011) [2023-12-27 19:15:09,124][106226] Updated weights for policy 0, policy_version 2995 (0.0011) [2023-12-27 19:15:09,170][106226] Updated weights for policy 0, policy_version 3005 (0.0010) [2023-12-27 19:15:09,781][106225] Updated weights for policy 1, policy_version 2953 (0.0006) [2023-12-27 19:15:09,871][106225] Updated weights for policy 1, policy_version 2963 (0.0008) [2023-12-27 19:15:09,943][106225] Updated weights for policy 1, policy_version 2973 (0.0008) [2023-12-27 19:15:09,960][106226] Updated weights for policy 0, policy_version 3015 (0.0009) [2023-12-27 19:15:10,022][106226] Updated weights for policy 0, policy_version 3025 (0.0009) [2023-12-27 19:15:10,078][106226] Updated weights for policy 0, policy_version 3035 (0.0008) [2023-12-27 19:15:10,572][106225] Updated weights for policy 1, policy_version 2983 (0.0007) [2023-12-27 19:15:10,635][106225] Updated weights for policy 1, policy_version 2993 (0.0008) [2023-12-27 19:15:10,699][106225] Updated weights for policy 1, policy_version 3003 (0.0009) [2023-12-27 19:15:10,801][106226] Updated weights for policy 0, policy_version 3045 (0.0010) [2023-12-27 19:15:10,861][106226] Updated weights for policy 0, policy_version 3055 (0.0008) [2023-12-27 19:15:10,927][106226] Updated weights for policy 0, policy_version 3065 (0.0009) [2023-12-27 19:15:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19456.0). Total num frames: 1556480. Throughput: 0: 10217.3, 1: 10053.5. Samples: 1526844. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-27 19:15:11,175][105115] Avg episode reward: [(0, '-23.903'), (1, '-27.044')] [2023-12-27 19:15:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000003008_770048.pth... [2023-12-27 19:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000003072_786432.pth... [2023-12-27 19:15:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000001856_475136.pth [2023-12-27 19:15:11,185][106141] Saving new best policy, reward=-27.044! [2023-12-27 19:15:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000001888_483328.pth [2023-12-27 19:15:11,186][106140] Saving new best policy, reward=-23.903! [2023-12-27 19:15:11,410][106225] Updated weights for policy 1, policy_version 3013 (0.0008) [2023-12-27 19:15:11,478][106225] Updated weights for policy 1, policy_version 3023 (0.0008) [2023-12-27 19:15:11,531][106225] Updated weights for policy 1, policy_version 3033 (0.0009) [2023-12-27 19:15:11,725][106226] Updated weights for policy 0, policy_version 3075 (0.0009) [2023-12-27 19:15:11,793][106226] Updated weights for policy 0, policy_version 3085 (0.0009) [2023-12-27 19:15:11,854][106226] Updated weights for policy 0, policy_version 3095 (0.0009) [2023-12-27 19:15:12,273][106225] Updated weights for policy 1, policy_version 3043 (0.0007) [2023-12-27 19:15:12,339][106225] Updated weights for policy 1, policy_version 3053 (0.0009) [2023-12-27 19:15:12,401][106225] Updated weights for policy 1, policy_version 3063 (0.0008) [2023-12-27 19:15:12,647][106226] Updated weights for policy 0, policy_version 3105 (0.0009) [2023-12-27 19:15:12,716][106226] Updated weights for policy 0, policy_version 3115 (0.0010) [2023-12-27 19:15:12,773][106226] Updated weights for policy 0, policy_version 3125 (0.0011) [2023-12-27 19:15:12,824][106226] Updated weights for policy 0, policy_version 3135 (0.0010) [2023-12-27 19:15:13,131][106225] Updated weights for policy 1, policy_version 3073 (0.0007) [2023-12-27 19:15:13,198][106225] Updated weights for policy 1, policy_version 3083 (0.0008) [2023-12-27 19:15:13,252][106225] Updated weights for policy 1, policy_version 3093 (0.0008) [2023-12-27 19:15:13,304][106225] Updated weights for policy 1, policy_version 3103 (0.0007) [2023-12-27 19:15:13,545][106226] Updated weights for policy 0, policy_version 3145 (0.0010) [2023-12-27 19:15:13,601][106226] Updated weights for policy 0, policy_version 3155 (0.0010) [2023-12-27 19:15:13,657][106226] Updated weights for policy 0, policy_version 3165 (0.0010) [2023-12-27 19:15:14,021][106225] Updated weights for policy 1, policy_version 3113 (0.0008) [2023-12-27 19:15:14,069][106225] Updated weights for policy 1, policy_version 3123 (0.0007) [2023-12-27 19:15:14,119][106225] Updated weights for policy 1, policy_version 3133 (0.0008) [2023-12-27 19:15:14,367][106226] Updated weights for policy 0, policy_version 3175 (0.0009) [2023-12-27 19:15:14,426][106226] Updated weights for policy 0, policy_version 3185 (0.0010) [2023-12-27 19:15:14,490][106226] Updated weights for policy 0, policy_version 3195 (0.0005) [2023-12-27 19:15:14,722][106225] Updated weights for policy 1, policy_version 3143 (0.0006) [2023-12-27 19:15:14,787][106225] Updated weights for policy 1, policy_version 3153 (0.0007) [2023-12-27 19:15:14,851][106225] Updated weights for policy 1, policy_version 3163 (0.0006) [2023-12-27 19:15:15,239][106226] Updated weights for policy 0, policy_version 3205 (0.0008) [2023-12-27 19:15:15,299][106226] Updated weights for policy 0, policy_version 3215 (0.0008) [2023-12-27 19:15:15,349][106226] Updated weights for policy 0, policy_version 3225 (0.0007) [2023-12-27 19:15:15,475][106225] Updated weights for policy 1, policy_version 3173 (0.0008) [2023-12-27 19:15:15,531][106225] Updated weights for policy 1, policy_version 3183 (0.0010) [2023-12-27 19:15:15,584][106225] Updated weights for policy 1, policy_version 3193 (0.0010) [2023-12-27 19:15:16,011][106226] Updated weights for policy 0, policy_version 3235 (0.0009) [2023-12-27 19:15:16,059][106226] Updated weights for policy 0, policy_version 3245 (0.0008) [2023-12-27 19:15:16,107][106226] Updated weights for policy 0, policy_version 3255 (0.0007) [2023-12-27 19:15:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19468.1). Total num frames: 1654784. Throughput: 0: 9987.1, 1: 9988.1. Samples: 1641132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 35.0) [2023-12-27 19:15:16,175][105115] Avg episode reward: [(0, '-21.768'), (1, '-24.669')] [2023-12-27 19:15:16,176][106140] Saving new best policy, reward=-21.768! [2023-12-27 19:15:16,176][106141] Saving new best policy, reward=-24.669! [2023-12-27 19:15:16,237][106225] Updated weights for policy 1, policy_version 3203 (0.0009) [2023-12-27 19:15:16,295][106225] Updated weights for policy 1, policy_version 3213 (0.0009) [2023-12-27 19:15:16,354][106225] Updated weights for policy 1, policy_version 3223 (0.0008) [2023-12-27 19:15:16,742][106226] Updated weights for policy 0, policy_version 3265 (0.0006) [2023-12-27 19:15:16,798][106226] Updated weights for policy 0, policy_version 3275 (0.0008) [2023-12-27 19:15:16,860][106226] Updated weights for policy 0, policy_version 3285 (0.0009) [2023-12-27 19:15:16,912][106226] Updated weights for policy 0, policy_version 3295 (0.0008) [2023-12-27 19:15:17,084][106225] Updated weights for policy 1, policy_version 3233 (0.0007) [2023-12-27 19:15:17,137][106225] Updated weights for policy 1, policy_version 3243 (0.0007) [2023-12-27 19:15:17,190][106225] Updated weights for policy 1, policy_version 3253 (0.0008) [2023-12-27 19:15:17,245][106225] Updated weights for policy 1, policy_version 3263 (0.0006) [2023-12-27 19:15:17,606][106226] Updated weights for policy 0, policy_version 3305 (0.0009) [2023-12-27 19:15:17,657][106226] Updated weights for policy 0, policy_version 3315 (0.0008) [2023-12-27 19:15:17,712][106226] Updated weights for policy 0, policy_version 3325 (0.0005) [2023-12-27 19:15:17,937][106225] Updated weights for policy 1, policy_version 3273 (0.0008) [2023-12-27 19:15:17,998][106225] Updated weights for policy 1, policy_version 3283 (0.0008) [2023-12-27 19:15:18,061][106225] Updated weights for policy 1, policy_version 3293 (0.0008) [2023-12-27 19:15:18,377][106226] Updated weights for policy 0, policy_version 3335 (0.0007) [2023-12-27 19:15:18,446][106226] Updated weights for policy 0, policy_version 3345 (0.0011) [2023-12-27 19:15:18,503][106226] Updated weights for policy 0, policy_version 3355 (0.0010) [2023-12-27 19:15:18,814][106225] Updated weights for policy 1, policy_version 3303 (0.0008) [2023-12-27 19:15:18,875][106225] Updated weights for policy 1, policy_version 3313 (0.0008) [2023-12-27 19:15:18,929][106225] Updated weights for policy 1, policy_version 3323 (0.0007) [2023-12-27 19:15:19,243][106226] Updated weights for policy 0, policy_version 3365 (0.0011) [2023-12-27 19:15:19,303][106226] Updated weights for policy 0, policy_version 3375 (0.0010) [2023-12-27 19:15:19,370][106226] Updated weights for policy 0, policy_version 3385 (0.0008) [2023-12-27 19:15:19,697][106225] Updated weights for policy 1, policy_version 3333 (0.0007) [2023-12-27 19:15:19,748][106225] Updated weights for policy 1, policy_version 3343 (0.0008) [2023-12-27 19:15:19,811][106225] Updated weights for policy 1, policy_version 3353 (0.0008) [2023-12-27 19:15:20,165][106226] Updated weights for policy 0, policy_version 3395 (0.0010) [2023-12-27 19:15:20,231][106226] Updated weights for policy 0, policy_version 3405 (0.0008) [2023-12-27 19:15:20,277][106226] Updated weights for policy 0, policy_version 3415 (0.0007) [2023-12-27 19:15:20,595][106225] Updated weights for policy 1, policy_version 3363 (0.0008) [2023-12-27 19:15:20,649][106225] Updated weights for policy 1, policy_version 3373 (0.0008) [2023-12-27 19:15:20,713][106225] Updated weights for policy 1, policy_version 3383 (0.0006) [2023-12-27 19:15:21,108][106226] Updated weights for policy 0, policy_version 3425 (0.0008) [2023-12-27 19:15:21,174][106226] Updated weights for policy 0, policy_version 3435 (0.0007) [2023-12-27 19:15:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19387.8). Total num frames: 1744896. Throughput: 0: 9870.8, 1: 9952.7. Samples: 1757900. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 19:15:21,175][105115] Avg episode reward: [(0, '-20.838'), (1, '-22.914')] [2023-12-27 19:15:21,176][106141] Saving new best policy, reward=-22.914! [2023-12-27 19:15:21,240][106226] Updated weights for policy 0, policy_version 3445 (0.0007) [2023-12-27 19:15:21,311][106226] Updated weights for policy 0, policy_version 3455 (0.0008) [2023-12-27 19:15:21,317][106140] Saving new best policy, reward=-20.838! [2023-12-27 19:15:21,448][106225] Updated weights for policy 1, policy_version 3393 (0.0005) [2023-12-27 19:15:21,508][106225] Updated weights for policy 1, policy_version 3403 (0.0008) [2023-12-27 19:15:21,573][106225] Updated weights for policy 1, policy_version 3413 (0.0008) [2023-12-27 19:15:21,641][106225] Updated weights for policy 1, policy_version 3423 (0.0009) [2023-12-27 19:15:22,101][106226] Updated weights for policy 0, policy_version 3465 (0.0009) [2023-12-27 19:15:22,162][106226] Updated weights for policy 0, policy_version 3475 (0.0009) [2023-12-27 19:15:22,225][106226] Updated weights for policy 0, policy_version 3485 (0.0008) [2023-12-27 19:15:22,391][106225] Updated weights for policy 1, policy_version 3433 (0.0009) [2023-12-27 19:15:22,457][106225] Updated weights for policy 1, policy_version 3443 (0.0009) [2023-12-27 19:15:22,517][106225] Updated weights for policy 1, policy_version 3453 (0.0009) [2023-12-27 19:15:22,930][106226] Updated weights for policy 0, policy_version 3495 (0.0010) [2023-12-27 19:15:22,989][106226] Updated weights for policy 0, policy_version 3505 (0.0011) [2023-12-27 19:15:23,052][106226] Updated weights for policy 0, policy_version 3515 (0.0009) [2023-12-27 19:15:23,217][106225] Updated weights for policy 1, policy_version 3463 (0.0009) [2023-12-27 19:15:23,272][106225] Updated weights for policy 1, policy_version 3473 (0.0011) [2023-12-27 19:15:23,331][106225] Updated weights for policy 1, policy_version 3483 (0.0011) [2023-12-27 19:15:23,682][106226] Updated weights for policy 0, policy_version 3525 (0.0008) [2023-12-27 19:15:23,747][106226] Updated weights for policy 0, policy_version 3535 (0.0006) [2023-12-27 19:15:23,804][106226] Updated weights for policy 0, policy_version 3545 (0.0005) [2023-12-27 19:15:24,059][106225] Updated weights for policy 1, policy_version 3493 (0.0008) [2023-12-27 19:15:24,122][106225] Updated weights for policy 1, policy_version 3503 (0.0007) [2023-12-27 19:15:24,179][106225] Updated weights for policy 1, policy_version 3513 (0.0010) [2023-12-27 19:15:24,362][106226] Updated weights for policy 0, policy_version 3555 (0.0007) [2023-12-27 19:15:24,423][106226] Updated weights for policy 0, policy_version 3565 (0.0010) [2023-12-27 19:15:24,483][106226] Updated weights for policy 0, policy_version 3575 (0.0011) [2023-12-27 19:15:24,868][106225] Updated weights for policy 1, policy_version 3523 (0.0010) [2023-12-27 19:15:24,931][106225] Updated weights for policy 1, policy_version 3533 (0.0010) [2023-12-27 19:15:24,977][106225] Updated weights for policy 1, policy_version 3543 (0.0010) [2023-12-27 19:15:25,070][106226] Updated weights for policy 0, policy_version 3585 (0.0009) [2023-12-27 19:15:25,124][106226] Updated weights for policy 0, policy_version 3595 (0.0006) [2023-12-27 19:15:25,182][106226] Updated weights for policy 0, policy_version 3605 (0.0005) [2023-12-27 19:15:25,237][106226] Updated weights for policy 0, policy_version 3615 (0.0005) [2023-12-27 19:15:25,575][106225] Updated weights for policy 1, policy_version 3553 (0.0010) [2023-12-27 19:15:25,624][106225] Updated weights for policy 1, policy_version 3563 (0.0005) [2023-12-27 19:15:25,684][106225] Updated weights for policy 1, policy_version 3573 (0.0008) [2023-12-27 19:15:25,730][106225] Updated weights for policy 1, policy_version 3583 (0.0008) [2023-12-27 19:15:25,828][106226] Updated weights for policy 0, policy_version 3625 (0.0007) [2023-12-27 19:15:25,893][106226] Updated weights for policy 0, policy_version 3635 (0.0010) [2023-12-27 19:15:25,948][106226] Updated weights for policy 0, policy_version 3645 (0.0008) [2023-12-27 19:15:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19488.3). Total num frames: 1851392. Throughput: 0: 9883.6, 1: 9921.3. Samples: 1816516. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:15:26,175][105115] Avg episode reward: [(0, '-18.852'), (1, '-22.141')] [2023-12-27 19:15:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000003584_917504.pth... [2023-12-27 19:15:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000003648_933888.pth... [2023-12-27 19:15:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000002464_630784.pth [2023-12-27 19:15:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000002432_622592.pth [2023-12-27 19:15:26,185][106140] Saving new best policy, reward=-18.852! [2023-12-27 19:15:26,186][106141] Saving new best policy, reward=-22.141! [2023-12-27 19:15:26,357][106225] Updated weights for policy 1, policy_version 3593 (0.0008) [2023-12-27 19:15:26,410][106225] Updated weights for policy 1, policy_version 3603 (0.0006) [2023-12-27 19:15:26,472][106225] Updated weights for policy 1, policy_version 3613 (0.0007) [2023-12-27 19:15:26,629][106226] Updated weights for policy 0, policy_version 3655 (0.0008) [2023-12-27 19:15:26,696][106226] Updated weights for policy 0, policy_version 3665 (0.0009) [2023-12-27 19:15:26,755][106226] Updated weights for policy 0, policy_version 3675 (0.0005) [2023-12-27 19:15:27,117][106225] Updated weights for policy 1, policy_version 3623 (0.0006) [2023-12-27 19:15:27,172][106225] Updated weights for policy 1, policy_version 3633 (0.0005) [2023-12-27 19:15:27,232][106225] Updated weights for policy 1, policy_version 3643 (0.0007) [2023-12-27 19:15:27,304][106226] Updated weights for policy 0, policy_version 3685 (0.0006) [2023-12-27 19:15:27,360][106226] Updated weights for policy 0, policy_version 3695 (0.0006) [2023-12-27 19:15:27,409][106226] Updated weights for policy 0, policy_version 3705 (0.0007) [2023-12-27 19:15:27,853][106225] Updated weights for policy 1, policy_version 3653 (0.0008) [2023-12-27 19:15:27,901][106225] Updated weights for policy 1, policy_version 3663 (0.0008) [2023-12-27 19:15:27,953][106225] Updated weights for policy 1, policy_version 3673 (0.0009) [2023-12-27 19:15:28,005][106226] Updated weights for policy 0, policy_version 3715 (0.0006) [2023-12-27 19:15:28,061][106226] Updated weights for policy 0, policy_version 3725 (0.0007) [2023-12-27 19:15:28,120][106226] Updated weights for policy 0, policy_version 3735 (0.0009) [2023-12-27 19:15:28,633][106225] Updated weights for policy 1, policy_version 3683 (0.0007) [2023-12-27 19:15:28,686][106225] Updated weights for policy 1, policy_version 3693 (0.0006) [2023-12-27 19:15:28,742][106225] Updated weights for policy 1, policy_version 3703 (0.0008) [2023-12-27 19:15:28,884][106226] Updated weights for policy 0, policy_version 3745 (0.0008) [2023-12-27 19:15:28,939][106226] Updated weights for policy 0, policy_version 3755 (0.0005) [2023-12-27 19:15:28,997][106226] Updated weights for policy 0, policy_version 3765 (0.0005) [2023-12-27 19:15:29,066][106226] Updated weights for policy 0, policy_version 3775 (0.0005) [2023-12-27 19:15:29,315][106225] Updated weights for policy 1, policy_version 3713 (0.0006) [2023-12-27 19:15:29,382][106225] Updated weights for policy 1, policy_version 3723 (0.0008) [2023-12-27 19:15:29,449][106225] Updated weights for policy 1, policy_version 3733 (0.0006) [2023-12-27 19:15:29,512][106225] Updated weights for policy 1, policy_version 3743 (0.0006) [2023-12-27 19:15:29,709][106226] Updated weights for policy 0, policy_version 3785 (0.0008) [2023-12-27 19:15:29,770][106226] Updated weights for policy 0, policy_version 3795 (0.0009) [2023-12-27 19:15:29,833][106226] Updated weights for policy 0, policy_version 3805 (0.0009) [2023-12-27 19:15:30,197][106225] Updated weights for policy 1, policy_version 3753 (0.0009) [2023-12-27 19:15:30,261][106225] Updated weights for policy 1, policy_version 3763 (0.0008) [2023-12-27 19:15:30,326][106225] Updated weights for policy 1, policy_version 3773 (0.0007) [2023-12-27 19:15:30,614][106226] Updated weights for policy 0, policy_version 3815 (0.0008) [2023-12-27 19:15:30,675][106226] Updated weights for policy 0, policy_version 3825 (0.0008) [2023-12-27 19:15:30,741][106226] Updated weights for policy 0, policy_version 3835 (0.0008) [2023-12-27 19:15:30,916][106225] Updated weights for policy 1, policy_version 3783 (0.0009) [2023-12-27 19:15:30,967][106225] Updated weights for policy 1, policy_version 3793 (0.0008) [2023-12-27 19:15:31,022][106225] Updated weights for policy 1, policy_version 3803 (0.0008) [2023-12-27 19:15:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19578.9). Total num frames: 1957888. Throughput: 0: 10048.3, 1: 10038.0. Samples: 1945112. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:15:31,175][105115] Avg episode reward: [(0, '-17.858'), (1, '-20.294')] [2023-12-27 19:15:31,176][106140] Saving new best policy, reward=-17.858! [2023-12-27 19:15:31,176][106141] Saving new best policy, reward=-20.294! [2023-12-27 19:15:31,535][106226] Updated weights for policy 0, policy_version 3845 (0.0010) [2023-12-27 19:15:31,593][106226] Updated weights for policy 0, policy_version 3855 (0.0010) [2023-12-27 19:15:31,656][106226] Updated weights for policy 0, policy_version 3865 (0.0010) [2023-12-27 19:15:31,778][106225] Updated weights for policy 1, policy_version 3813 (0.0008) [2023-12-27 19:15:31,829][106225] Updated weights for policy 1, policy_version 3823 (0.0008) [2023-12-27 19:15:31,886][106225] Updated weights for policy 1, policy_version 3833 (0.0008) [2023-12-27 19:15:32,365][106226] Updated weights for policy 0, policy_version 3875 (0.0010) [2023-12-27 19:15:32,427][106226] Updated weights for policy 0, policy_version 3885 (0.0008) [2023-12-27 19:15:32,486][106226] Updated weights for policy 0, policy_version 3895 (0.0008) [2023-12-27 19:15:32,592][106225] Updated weights for policy 1, policy_version 3843 (0.0007) [2023-12-27 19:15:32,663][106225] Updated weights for policy 1, policy_version 3853 (0.0008) [2023-12-27 19:15:32,725][106225] Updated weights for policy 1, policy_version 3863 (0.0008) [2023-12-27 19:15:33,118][106226] Updated weights for policy 0, policy_version 3905 (0.0006) [2023-12-27 19:15:33,171][106226] Updated weights for policy 0, policy_version 3915 (0.0009) [2023-12-27 19:15:33,222][106226] Updated weights for policy 0, policy_version 3925 (0.0008) [2023-12-27 19:15:33,266][106226] Updated weights for policy 0, policy_version 3935 (0.0008) [2023-12-27 19:15:33,316][106225] Updated weights for policy 1, policy_version 3873 (0.0008) [2023-12-27 19:15:33,378][106225] Updated weights for policy 1, policy_version 3883 (0.0008) [2023-12-27 19:15:33,435][106225] Updated weights for policy 1, policy_version 3893 (0.0007) [2023-12-27 19:15:33,497][106225] Updated weights for policy 1, policy_version 3903 (0.0008) [2023-12-27 19:15:33,989][106226] Updated weights for policy 0, policy_version 3945 (0.0007) [2023-12-27 19:15:34,048][106226] Updated weights for policy 0, policy_version 3955 (0.0009) [2023-12-27 19:15:34,103][106226] Updated weights for policy 0, policy_version 3965 (0.0008) [2023-12-27 19:15:34,218][106225] Updated weights for policy 1, policy_version 3913 (0.0009) [2023-12-27 19:15:34,276][106225] Updated weights for policy 1, policy_version 3923 (0.0008) [2023-12-27 19:15:34,342][106225] Updated weights for policy 1, policy_version 3933 (0.0010) [2023-12-27 19:15:34,804][106226] Updated weights for policy 0, policy_version 3975 (0.0008) [2023-12-27 19:15:34,862][106226] Updated weights for policy 0, policy_version 3985 (0.0008) [2023-12-27 19:15:34,920][106226] Updated weights for policy 0, policy_version 3995 (0.0008) [2023-12-27 19:15:35,062][106225] Updated weights for policy 1, policy_version 3943 (0.0008) [2023-12-27 19:15:35,113][106225] Updated weights for policy 1, policy_version 3953 (0.0008) [2023-12-27 19:15:35,164][106225] Updated weights for policy 1, policy_version 3963 (0.0008) [2023-12-27 19:15:35,637][106226] Updated weights for policy 0, policy_version 4005 (0.0008) [2023-12-27 19:15:35,698][106226] Updated weights for policy 0, policy_version 4015 (0.0008) [2023-12-27 19:15:35,762][106226] Updated weights for policy 0, policy_version 4025 (0.0009) [2023-12-27 19:15:35,915][106225] Updated weights for policy 1, policy_version 3973 (0.0008) [2023-12-27 19:15:35,973][106225] Updated weights for policy 1, policy_version 3983 (0.0008) [2023-12-27 19:15:36,027][106225] Updated weights for policy 1, policy_version 3993 (0.0010) [2023-12-27 19:15:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19582.8). Total num frames: 2056192. Throughput: 0: 9962.8, 1: 10000.4. Samples: 2062924. Policy #0 lag: (min: 21.0, avg: 29.2, max: 53.0) [2023-12-27 19:15:36,175][105115] Avg episode reward: [(0, '-16.508'), (1, '-18.852')] [2023-12-27 19:15:36,176][106140] Saving new best policy, reward=-16.508! [2023-12-27 19:15:36,176][106141] Saving new best policy, reward=-18.852! [2023-12-27 19:15:36,474][106226] Updated weights for policy 0, policy_version 4036 (0.0009) [2023-12-27 19:15:36,535][106226] Updated weights for policy 0, policy_version 4046 (0.0009) [2023-12-27 19:15:36,598][106226] Updated weights for policy 0, policy_version 4056 (0.0008) [2023-12-27 19:15:36,843][106225] Updated weights for policy 1, policy_version 4003 (0.0009) [2023-12-27 19:15:36,898][106225] Updated weights for policy 1, policy_version 4013 (0.0008) [2023-12-27 19:15:36,961][106225] Updated weights for policy 1, policy_version 4023 (0.0010) [2023-12-27 19:15:37,376][106226] Updated weights for policy 0, policy_version 4066 (0.0009) [2023-12-27 19:15:37,445][106226] Updated weights for policy 0, policy_version 4076 (0.0008) [2023-12-27 19:15:37,506][106226] Updated weights for policy 0, policy_version 4086 (0.0008) [2023-12-27 19:15:37,563][106226] Updated weights for policy 0, policy_version 4096 (0.0008) [2023-12-27 19:15:37,698][106225] Updated weights for policy 1, policy_version 4033 (0.0010) [2023-12-27 19:15:37,760][106225] Updated weights for policy 1, policy_version 4043 (0.0010) [2023-12-27 19:15:37,825][106225] Updated weights for policy 1, policy_version 4053 (0.0011) [2023-12-27 19:15:37,882][106225] Updated weights for policy 1, policy_version 4063 (0.0010) [2023-12-27 19:15:38,288][106226] Updated weights for policy 0, policy_version 4106 (0.0007) [2023-12-27 19:15:38,339][106226] Updated weights for policy 0, policy_version 4116 (0.0008) [2023-12-27 19:15:38,401][106226] Updated weights for policy 0, policy_version 4126 (0.0007) [2023-12-27 19:15:38,584][106225] Updated weights for policy 1, policy_version 4073 (0.0010) [2023-12-27 19:15:38,636][106225] Updated weights for policy 1, policy_version 4083 (0.0009) [2023-12-27 19:15:38,695][106225] Updated weights for policy 1, policy_version 4093 (0.0009) [2023-12-27 19:15:39,150][106226] Updated weights for policy 0, policy_version 4136 (0.0008) [2023-12-27 19:15:39,196][106226] Updated weights for policy 0, policy_version 4146 (0.0008) [2023-12-27 19:15:39,263][106226] Updated weights for policy 0, policy_version 4156 (0.0009) [2023-12-27 19:15:39,449][106225] Updated weights for policy 1, policy_version 4103 (0.0008) [2023-12-27 19:15:39,515][106225] Updated weights for policy 1, policy_version 4113 (0.0008) [2023-12-27 19:15:39,575][106225] Updated weights for policy 1, policy_version 4123 (0.0008) [2023-12-27 19:15:40,104][106226] Updated weights for policy 0, policy_version 4166 (0.0008) [2023-12-27 19:15:40,170][106226] Updated weights for policy 0, policy_version 4176 (0.0007) [2023-12-27 19:15:40,238][106226] Updated weights for policy 0, policy_version 4186 (0.0008) [2023-12-27 19:15:40,356][106225] Updated weights for policy 1, policy_version 4133 (0.0009) [2023-12-27 19:15:40,424][106225] Updated weights for policy 1, policy_version 4143 (0.0011) [2023-12-27 19:15:40,484][106225] Updated weights for policy 1, policy_version 4153 (0.0010) [2023-12-27 19:15:40,950][106226] Updated weights for policy 0, policy_version 4196 (0.0008) [2023-12-27 19:15:41,014][106226] Updated weights for policy 0, policy_version 4206 (0.0011) [2023-12-27 19:15:41,094][106226] Updated weights for policy 0, policy_version 4216 (0.0009) [2023-12-27 19:15:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.8, 300 sec: 19511.8). Total num frames: 2146304. Throughput: 0: 9946.4, 1: 10023.1. Samples: 2118824. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 19:15:41,175][105115] Avg episode reward: [(0, '-16.283'), (1, '-18.352')] [2023-12-27 19:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000004224_1081344.pth... [2023-12-27 19:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000004160_1064960.pth... [2023-12-27 19:15:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000003072_786432.pth [2023-12-27 19:15:41,185][106140] Saving new best policy, reward=-16.283! [2023-12-27 19:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000003008_770048.pth [2023-12-27 19:15:41,186][106141] Saving new best policy, reward=-18.352! [2023-12-27 19:15:41,252][106225] Updated weights for policy 1, policy_version 4163 (0.0010) [2023-12-27 19:15:41,319][106225] Updated weights for policy 1, policy_version 4173 (0.0008) [2023-12-27 19:15:41,389][106225] Updated weights for policy 1, policy_version 4183 (0.0009) [2023-12-27 19:15:41,888][106226] Updated weights for policy 0, policy_version 4226 (0.0008) [2023-12-27 19:15:41,947][106226] Updated weights for policy 0, policy_version 4236 (0.0008) [2023-12-27 19:15:42,016][106226] Updated weights for policy 0, policy_version 4246 (0.0009) [2023-12-27 19:15:42,085][106226] Updated weights for policy 0, policy_version 4256 (0.0009) [2023-12-27 19:15:42,105][106225] Updated weights for policy 1, policy_version 4193 (0.0008) [2023-12-27 19:15:42,167][106225] Updated weights for policy 1, policy_version 4203 (0.0009) [2023-12-27 19:15:42,234][106225] Updated weights for policy 1, policy_version 4213 (0.0010) [2023-12-27 19:15:42,301][106225] Updated weights for policy 1, policy_version 4223 (0.0009) [2023-12-27 19:15:42,805][106226] Updated weights for policy 0, policy_version 4266 (0.0005) [2023-12-27 19:15:42,866][106226] Updated weights for policy 0, policy_version 4276 (0.0006) [2023-12-27 19:15:42,922][106226] Updated weights for policy 0, policy_version 4286 (0.0008) [2023-12-27 19:15:43,062][106225] Updated weights for policy 1, policy_version 4233 (0.0008) [2023-12-27 19:15:43,114][106225] Updated weights for policy 1, policy_version 4243 (0.0008) [2023-12-27 19:15:43,167][106225] Updated weights for policy 1, policy_version 4253 (0.0009) [2023-12-27 19:15:43,605][106226] Updated weights for policy 0, policy_version 4296 (0.0008) [2023-12-27 19:15:43,675][106226] Updated weights for policy 0, policy_version 4306 (0.0005) [2023-12-27 19:15:43,745][106226] Updated weights for policy 0, policy_version 4316 (0.0005) [2023-12-27 19:15:43,957][106225] Updated weights for policy 1, policy_version 4263 (0.0009) [2023-12-27 19:15:44,007][106225] Updated weights for policy 1, policy_version 4273 (0.0008) [2023-12-27 19:15:44,053][106225] Updated weights for policy 1, policy_version 4283 (0.0008) [2023-12-27 19:15:44,330][106226] Updated weights for policy 0, policy_version 4326 (0.0008) [2023-12-27 19:15:44,385][106226] Updated weights for policy 0, policy_version 4336 (0.0010) [2023-12-27 19:15:44,444][106226] Updated weights for policy 0, policy_version 4346 (0.0007) [2023-12-27 19:15:44,841][106225] Updated weights for policy 1, policy_version 4293 (0.0009) [2023-12-27 19:15:44,897][106225] Updated weights for policy 1, policy_version 4303 (0.0010) [2023-12-27 19:15:44,962][106225] Updated weights for policy 1, policy_version 4313 (0.0010) [2023-12-27 19:15:45,090][106226] Updated weights for policy 0, policy_version 4356 (0.0006) [2023-12-27 19:15:45,152][106226] Updated weights for policy 0, policy_version 4366 (0.0010) [2023-12-27 19:15:45,218][106226] Updated weights for policy 0, policy_version 4376 (0.0010) [2023-12-27 19:15:45,727][106225] Updated weights for policy 1, policy_version 4323 (0.0010) [2023-12-27 19:15:45,794][106225] Updated weights for policy 1, policy_version 4333 (0.0010) [2023-12-27 19:15:45,858][106225] Updated weights for policy 1, policy_version 4343 (0.0010) [2023-12-27 19:15:45,921][106226] Updated weights for policy 0, policy_version 4386 (0.0007) [2023-12-27 19:15:45,987][106226] Updated weights for policy 0, policy_version 4396 (0.0007) [2023-12-27 19:15:46,051][106226] Updated weights for policy 0, policy_version 4406 (0.0007) [2023-12-27 19:15:46,122][106226] Updated weights for policy 0, policy_version 4416 (0.0006) [2023-12-27 19:15:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19518.4). Total num frames: 2244608. Throughput: 0: 9898.0, 1: 9797.2. Samples: 2230796. Policy #0 lag: (min: 31.0, avg: 43.1, max: 63.0) [2023-12-27 19:15:46,175][105115] Avg episode reward: [(0, '-15.643'), (1, '-17.301')] [2023-12-27 19:15:46,176][106140] Saving new best policy, reward=-15.643! [2023-12-27 19:15:46,176][106141] Saving new best policy, reward=-17.301! [2023-12-27 19:15:46,506][106225] Updated weights for policy 1, policy_version 4353 (0.0010) [2023-12-27 19:15:46,566][106225] Updated weights for policy 1, policy_version 4363 (0.0009) [2023-12-27 19:15:46,621][106225] Updated weights for policy 1, policy_version 4373 (0.0008) [2023-12-27 19:15:46,679][106225] Updated weights for policy 1, policy_version 4383 (0.0010) [2023-12-27 19:15:46,781][106226] Updated weights for policy 0, policy_version 4426 (0.0009) [2023-12-27 19:15:46,844][106226] Updated weights for policy 0, policy_version 4436 (0.0009) [2023-12-27 19:15:46,894][106226] Updated weights for policy 0, policy_version 4446 (0.0008) [2023-12-27 19:15:47,326][106225] Updated weights for policy 1, policy_version 4393 (0.0010) [2023-12-27 19:15:47,393][106225] Updated weights for policy 1, policy_version 4403 (0.0010) [2023-12-27 19:15:47,460][106225] Updated weights for policy 1, policy_version 4413 (0.0009) [2023-12-27 19:15:47,608][106226] Updated weights for policy 0, policy_version 4456 (0.0006) [2023-12-27 19:15:47,668][106226] Updated weights for policy 0, policy_version 4466 (0.0008) [2023-12-27 19:15:47,721][106226] Updated weights for policy 0, policy_version 4476 (0.0009) [2023-12-27 19:15:48,141][106225] Updated weights for policy 1, policy_version 4423 (0.0009) [2023-12-27 19:15:48,203][106225] Updated weights for policy 1, policy_version 4433 (0.0009) [2023-12-27 19:15:48,257][106225] Updated weights for policy 1, policy_version 4443 (0.0009) [2023-12-27 19:15:48,339][106226] Updated weights for policy 0, policy_version 4486 (0.0008) [2023-12-27 19:15:48,402][106226] Updated weights for policy 0, policy_version 4496 (0.0008) [2023-12-27 19:15:48,451][106226] Updated weights for policy 0, policy_version 4506 (0.0009) [2023-12-27 19:15:48,908][106225] Updated weights for policy 1, policy_version 4453 (0.0007) [2023-12-27 19:15:48,965][106225] Updated weights for policy 1, policy_version 4463 (0.0006) [2023-12-27 19:15:49,029][106225] Updated weights for policy 1, policy_version 4473 (0.0008) [2023-12-27 19:15:49,310][106226] Updated weights for policy 0, policy_version 4516 (0.0009) [2023-12-27 19:15:49,389][106226] Updated weights for policy 0, policy_version 4526 (0.0009) [2023-12-27 19:15:49,441][106226] Updated weights for policy 0, policy_version 4536 (0.0008) [2023-12-27 19:15:49,754][106225] Updated weights for policy 1, policy_version 4483 (0.0008) [2023-12-27 19:15:49,815][106225] Updated weights for policy 1, policy_version 4493 (0.0006) [2023-12-27 19:15:49,881][106225] Updated weights for policy 1, policy_version 4503 (0.0008) [2023-12-27 19:15:50,208][106226] Updated weights for policy 0, policy_version 4546 (0.0009) [2023-12-27 19:15:50,268][106226] Updated weights for policy 0, policy_version 4556 (0.0008) [2023-12-27 19:15:50,324][106226] Updated weights for policy 0, policy_version 4566 (0.0009) [2023-12-27 19:15:50,390][106226] Updated weights for policy 0, policy_version 4576 (0.0009) [2023-12-27 19:15:50,637][106225] Updated weights for policy 1, policy_version 4513 (0.0008) [2023-12-27 19:15:50,709][106225] Updated weights for policy 1, policy_version 4523 (0.0008) [2023-12-27 19:15:50,772][106225] Updated weights for policy 1, policy_version 4533 (0.0008) [2023-12-27 19:15:50,834][106225] Updated weights for policy 1, policy_version 4543 (0.0008) [2023-12-27 19:15:51,167][106226] Updated weights for policy 0, policy_version 4586 (0.0009) [2023-12-27 19:15:51,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19456.0). Total num frames: 2334720. Throughput: 0: 9798.3, 1: 9836.2. Samples: 2347236. Policy #0 lag: (min: 20.0, avg: 25.6, max: 52.0) [2023-12-27 19:15:51,175][105115] Avg episode reward: [(0, '-14.785'), (1, '-16.169')] [2023-12-27 19:15:51,176][106141] Saving new best policy, reward=-16.169! [2023-12-27 19:15:51,227][106226] Updated weights for policy 0, policy_version 4596 (0.0010) [2023-12-27 19:15:51,289][106226] Updated weights for policy 0, policy_version 4606 (0.0011) [2023-12-27 19:15:51,298][106140] Saving new best policy, reward=-14.785! [2023-12-27 19:15:51,543][106225] Updated weights for policy 1, policy_version 4553 (0.0009) [2023-12-27 19:15:51,601][106225] Updated weights for policy 1, policy_version 4563 (0.0008) [2023-12-27 19:15:51,674][106225] Updated weights for policy 1, policy_version 4573 (0.0009) [2023-12-27 19:15:52,026][106226] Updated weights for policy 0, policy_version 4616 (0.0009) [2023-12-27 19:15:52,083][106226] Updated weights for policy 0, policy_version 4626 (0.0009) [2023-12-27 19:15:52,136][106226] Updated weights for policy 0, policy_version 4636 (0.0006) [2023-12-27 19:15:52,452][106225] Updated weights for policy 1, policy_version 4583 (0.0010) [2023-12-27 19:15:52,508][106225] Updated weights for policy 1, policy_version 4593 (0.0008) [2023-12-27 19:15:52,561][106225] Updated weights for policy 1, policy_version 4603 (0.0010) [2023-12-27 19:15:52,835][106226] Updated weights for policy 0, policy_version 4646 (0.0008) [2023-12-27 19:15:52,903][106226] Updated weights for policy 0, policy_version 4656 (0.0007) [2023-12-27 19:15:52,967][106226] Updated weights for policy 0, policy_version 4666 (0.0005) [2023-12-27 19:15:53,212][106225] Updated weights for policy 1, policy_version 4613 (0.0009) [2023-12-27 19:15:53,267][106225] Updated weights for policy 1, policy_version 4623 (0.0009) [2023-12-27 19:15:53,322][106225] Updated weights for policy 1, policy_version 4633 (0.0008) [2023-12-27 19:15:53,638][106226] Updated weights for policy 0, policy_version 4676 (0.0008) [2023-12-27 19:15:53,692][106226] Updated weights for policy 0, policy_version 4686 (0.0010) [2023-12-27 19:15:53,752][106226] Updated weights for policy 0, policy_version 4696 (0.0011) [2023-12-27 19:15:53,974][106225] Updated weights for policy 1, policy_version 4643 (0.0007) [2023-12-27 19:15:54,042][106225] Updated weights for policy 1, policy_version 4653 (0.0009) [2023-12-27 19:15:54,106][106225] Updated weights for policy 1, policy_version 4663 (0.0009) [2023-12-27 19:15:54,325][106226] Updated weights for policy 0, policy_version 4706 (0.0009) [2023-12-27 19:15:54,391][106226] Updated weights for policy 0, policy_version 4716 (0.0007) [2023-12-27 19:15:54,452][106226] Updated weights for policy 0, policy_version 4726 (0.0005) [2023-12-27 19:15:54,505][106226] Updated weights for policy 0, policy_version 4736 (0.0006) [2023-12-27 19:15:54,909][106225] Updated weights for policy 1, policy_version 4673 (0.0009) [2023-12-27 19:15:54,978][106225] Updated weights for policy 1, policy_version 4683 (0.0009) [2023-12-27 19:15:55,042][106225] Updated weights for policy 1, policy_version 4693 (0.0007) [2023-12-27 19:15:55,090][106226] Updated weights for policy 0, policy_version 4746 (0.0011) [2023-12-27 19:15:55,100][106225] Updated weights for policy 1, policy_version 4703 (0.0006) [2023-12-27 19:15:55,142][106226] Updated weights for policy 0, policy_version 4756 (0.0010) [2023-12-27 19:15:55,196][106226] Updated weights for policy 0, policy_version 4766 (0.0010) [2023-12-27 19:15:55,791][106225] Updated weights for policy 1, policy_version 4713 (0.0010) [2023-12-27 19:15:55,839][106225] Updated weights for policy 1, policy_version 4723 (0.0009) [2023-12-27 19:15:55,864][106226] Updated weights for policy 0, policy_version 4776 (0.0006) [2023-12-27 19:15:55,899][106225] Updated weights for policy 1, policy_version 4733 (0.0010) [2023-12-27 19:15:55,921][106226] Updated weights for policy 0, policy_version 4786 (0.0008) [2023-12-27 19:15:55,987][106226] Updated weights for policy 0, policy_version 4796 (0.0008) [2023-12-27 19:15:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19529.7). Total num frames: 2441216. Throughput: 0: 9756.6, 1: 9804.4. Samples: 2407092. Policy #0 lag: (min: 7.0, avg: 10.1, max: 39.0) [2023-12-27 19:15:56,175][105115] Avg episode reward: [(0, '-13.499'), (1, '-14.762')] [2023-12-27 19:15:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000004736_1212416.pth... [2023-12-27 19:15:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000004800_1228800.pth... [2023-12-27 19:15:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000003584_917504.pth [2023-12-27 19:15:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000003648_933888.pth [2023-12-27 19:15:56,184][106141] Saving new best policy, reward=-14.762! [2023-12-27 19:15:56,184][106140] Saving new best policy, reward=-13.499! [2023-12-27 19:15:56,555][106225] Updated weights for policy 1, policy_version 4743 (0.0007) [2023-12-27 19:15:56,612][106225] Updated weights for policy 1, policy_version 4753 (0.0005) [2023-12-27 19:15:56,669][106225] Updated weights for policy 1, policy_version 4763 (0.0005) [2023-12-27 19:15:56,747][106226] Updated weights for policy 0, policy_version 4806 (0.0007) [2023-12-27 19:15:56,811][106226] Updated weights for policy 0, policy_version 4816 (0.0005) [2023-12-27 19:15:56,861][106226] Updated weights for policy 0, policy_version 4826 (0.0008) [2023-12-27 19:15:57,280][106225] Updated weights for policy 1, policy_version 4773 (0.0009) [2023-12-27 19:15:57,328][106225] Updated weights for policy 1, policy_version 4783 (0.0005) [2023-12-27 19:15:57,377][106225] Updated weights for policy 1, policy_version 4793 (0.0008) [2023-12-27 19:15:57,432][106226] Updated weights for policy 0, policy_version 4836 (0.0007) [2023-12-27 19:15:57,495][106226] Updated weights for policy 0, policy_version 4846 (0.0005) [2023-12-27 19:15:57,550][106226] Updated weights for policy 0, policy_version 4856 (0.0005) [2023-12-27 19:15:58,084][106226] Updated weights for policy 0, policy_version 4866 (0.0005) [2023-12-27 19:15:58,145][106226] Updated weights for policy 0, policy_version 4876 (0.0005) [2023-12-27 19:15:58,183][106225] Updated weights for policy 1, policy_version 4803 (0.0008) [2023-12-27 19:15:58,200][106226] Updated weights for policy 0, policy_version 4886 (0.0007) [2023-12-27 19:15:58,248][106225] Updated weights for policy 1, policy_version 4813 (0.0007) [2023-12-27 19:15:58,261][106226] Updated weights for policy 0, policy_version 4896 (0.0008) [2023-12-27 19:15:58,312][106225] Updated weights for policy 1, policy_version 4823 (0.0007) [2023-12-27 19:15:59,086][106226] Updated weights for policy 0, policy_version 4906 (0.0007) [2023-12-27 19:15:59,145][106225] Updated weights for policy 1, policy_version 4833 (0.0008) [2023-12-27 19:15:59,151][106226] Updated weights for policy 0, policy_version 4916 (0.0009) [2023-12-27 19:15:59,201][106225] Updated weights for policy 1, policy_version 4843 (0.0007) [2023-12-27 19:15:59,216][106226] Updated weights for policy 0, policy_version 4926 (0.0008) [2023-12-27 19:15:59,270][106225] Updated weights for policy 1, policy_version 4853 (0.0008) [2023-12-27 19:15:59,332][106225] Updated weights for policy 1, policy_version 4863 (0.0008) [2023-12-27 19:15:59,995][106226] Updated weights for policy 0, policy_version 4936 (0.0007) [2023-12-27 19:16:00,024][106225] Updated weights for policy 1, policy_version 4873 (0.0008) [2023-12-27 19:16:00,058][106226] Updated weights for policy 0, policy_version 4946 (0.0007) [2023-12-27 19:16:00,072][106225] Updated weights for policy 1, policy_version 4883 (0.0006) [2023-12-27 19:16:00,116][106226] Updated weights for policy 0, policy_version 4956 (0.0007) [2023-12-27 19:16:00,126][106225] Updated weights for policy 1, policy_version 4893 (0.0006) [2023-12-27 19:16:00,784][106225] Updated weights for policy 1, policy_version 4903 (0.0008) [2023-12-27 19:16:00,834][106226] Updated weights for policy 0, policy_version 4966 (0.0005) [2023-12-27 19:16:00,839][106225] Updated weights for policy 1, policy_version 4913 (0.0007) [2023-12-27 19:16:00,884][106225] Updated weights for policy 1, policy_version 4923 (0.0008) [2023-12-27 19:16:00,885][106226] Updated weights for policy 0, policy_version 4976 (0.0006) [2023-12-27 19:16:00,931][106226] Updated weights for policy 0, policy_version 4986 (0.0005) [2023-12-27 19:16:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19534.8). Total num frames: 2539520. Throughput: 0: 9906.4, 1: 9754.6. Samples: 2525880. Policy #0 lag: (min: 25.0, avg: 38.8, max: 40.0) [2023-12-27 19:16:01,175][105115] Avg episode reward: [(0, '-12.898'), (1, '-14.406')] [2023-12-27 19:16:01,176][106140] Saving new best policy, reward=-12.898! [2023-12-27 19:16:01,176][106141] Saving new best policy, reward=-14.406! [2023-12-27 19:16:01,628][106225] Updated weights for policy 1, policy_version 4933 (0.0008) [2023-12-27 19:16:01,665][106226] Updated weights for policy 0, policy_version 4996 (0.0007) [2023-12-27 19:16:01,698][106225] Updated weights for policy 1, policy_version 4943 (0.0007) [2023-12-27 19:16:01,722][106226] Updated weights for policy 0, policy_version 5006 (0.0010) [2023-12-27 19:16:01,760][106225] Updated weights for policy 1, policy_version 4953 (0.0007) [2023-12-27 19:16:01,786][106226] Updated weights for policy 0, policy_version 5016 (0.0010) [2023-12-27 19:16:02,458][106225] Updated weights for policy 1, policy_version 4963 (0.0009) [2023-12-27 19:16:02,508][106225] Updated weights for policy 1, policy_version 4973 (0.0008) [2023-12-27 19:16:02,516][106226] Updated weights for policy 0, policy_version 5026 (0.0010) [2023-12-27 19:16:02,571][106225] Updated weights for policy 1, policy_version 4983 (0.0007) [2023-12-27 19:16:02,580][106226] Updated weights for policy 0, policy_version 5036 (0.0007) [2023-12-27 19:16:02,639][106226] Updated weights for policy 0, policy_version 5046 (0.0008) [2023-12-27 19:16:02,700][106226] Updated weights for policy 0, policy_version 5056 (0.0008) [2023-12-27 19:16:03,276][106226] Updated weights for policy 0, policy_version 5066 (0.0006) [2023-12-27 19:16:03,338][106226] Updated weights for policy 0, policy_version 5076 (0.0007) [2023-12-27 19:16:03,350][106225] Updated weights for policy 1, policy_version 4993 (0.0005) [2023-12-27 19:16:03,399][106226] Updated weights for policy 0, policy_version 5086 (0.0006) [2023-12-27 19:16:03,405][106225] Updated weights for policy 1, policy_version 5003 (0.0006) [2023-12-27 19:16:03,458][106225] Updated weights for policy 1, policy_version 5013 (0.0010) [2023-12-27 19:16:03,513][106225] Updated weights for policy 1, policy_version 5023 (0.0009) [2023-12-27 19:16:04,012][106226] Updated weights for policy 0, policy_version 5096 (0.0008) [2023-12-27 19:16:04,074][106226] Updated weights for policy 0, policy_version 5106 (0.0008) [2023-12-27 19:16:04,124][106226] Updated weights for policy 0, policy_version 5116 (0.0009) [2023-12-27 19:16:04,273][106225] Updated weights for policy 1, policy_version 5033 (0.0009) [2023-12-27 19:16:04,330][106225] Updated weights for policy 1, policy_version 5043 (0.0009) [2023-12-27 19:16:04,384][106225] Updated weights for policy 1, policy_version 5053 (0.0009) [2023-12-27 19:16:04,804][106226] Updated weights for policy 0, policy_version 5126 (0.0008) [2023-12-27 19:16:04,863][106226] Updated weights for policy 0, policy_version 5136 (0.0009) [2023-12-27 19:16:04,924][106226] Updated weights for policy 0, policy_version 5146 (0.0009) [2023-12-27 19:16:05,155][106225] Updated weights for policy 1, policy_version 5063 (0.0009) [2023-12-27 19:16:05,213][106225] Updated weights for policy 1, policy_version 5073 (0.0008) [2023-12-27 19:16:05,258][106225] Updated weights for policy 1, policy_version 5083 (0.0008) [2023-12-27 19:16:05,623][106226] Updated weights for policy 0, policy_version 5156 (0.0007) [2023-12-27 19:16:05,679][106226] Updated weights for policy 0, policy_version 5166 (0.0005) [2023-12-27 19:16:05,743][106226] Updated weights for policy 0, policy_version 5176 (0.0005) [2023-12-27 19:16:05,972][106225] Updated weights for policy 1, policy_version 5093 (0.0009) [2023-12-27 19:16:06,017][106225] Updated weights for policy 1, policy_version 5103 (0.0008) [2023-12-27 19:16:06,069][106225] Updated weights for policy 1, policy_version 5113 (0.0008) [2023-12-27 19:16:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19539.4). Total num frames: 2637824. Throughput: 0: 9992.0, 1: 9732.7. Samples: 2645512. Policy #0 lag: (min: 25.0, avg: 38.8, max: 40.0) [2023-12-27 19:16:06,175][105115] Avg episode reward: [(0, '-12.227'), (1, '-13.568')] [2023-12-27 19:16:06,176][106140] Saving new best policy, reward=-12.227! [2023-12-27 19:16:06,176][106141] Saving new best policy, reward=-13.568! [2023-12-27 19:16:06,314][106226] Updated weights for policy 0, policy_version 5186 (0.0006) [2023-12-27 19:16:06,376][106226] Updated weights for policy 0, policy_version 5196 (0.0008) [2023-12-27 19:16:06,437][106226] Updated weights for policy 0, policy_version 5206 (0.0009) [2023-12-27 19:16:06,497][106226] Updated weights for policy 0, policy_version 5216 (0.0008) [2023-12-27 19:16:06,849][106225] Updated weights for policy 1, policy_version 5123 (0.0009) [2023-12-27 19:16:06,904][106225] Updated weights for policy 1, policy_version 5133 (0.0008) [2023-12-27 19:16:06,957][106225] Updated weights for policy 1, policy_version 5143 (0.0009) [2023-12-27 19:16:07,226][106226] Updated weights for policy 0, policy_version 5226 (0.0009) [2023-12-27 19:16:07,287][106226] Updated weights for policy 0, policy_version 5236 (0.0009) [2023-12-27 19:16:07,350][106226] Updated weights for policy 0, policy_version 5246 (0.0006) [2023-12-27 19:16:07,777][106225] Updated weights for policy 1, policy_version 5153 (0.0009) [2023-12-27 19:16:07,834][106225] Updated weights for policy 1, policy_version 5163 (0.0009) [2023-12-27 19:16:07,897][106225] Updated weights for policy 1, policy_version 5173 (0.0007) [2023-12-27 19:16:07,962][106225] Updated weights for policy 1, policy_version 5183 (0.0006) [2023-12-27 19:16:08,108][106226] Updated weights for policy 0, policy_version 5256 (0.0007) [2023-12-27 19:16:08,166][106226] Updated weights for policy 0, policy_version 5266 (0.0009) [2023-12-27 19:16:08,227][106226] Updated weights for policy 0, policy_version 5276 (0.0009) [2023-12-27 19:16:08,587][106225] Updated weights for policy 1, policy_version 5193 (0.0008) [2023-12-27 19:16:08,646][106225] Updated weights for policy 1, policy_version 5203 (0.0006) [2023-12-27 19:16:08,708][106225] Updated weights for policy 1, policy_version 5213 (0.0008) [2023-12-27 19:16:08,948][106226] Updated weights for policy 0, policy_version 5286 (0.0008) [2023-12-27 19:16:09,011][106226] Updated weights for policy 0, policy_version 5296 (0.0008) [2023-12-27 19:16:09,070][106226] Updated weights for policy 0, policy_version 5306 (0.0009) [2023-12-27 19:16:09,337][106225] Updated weights for policy 1, policy_version 5223 (0.0007) [2023-12-27 19:16:09,405][106225] Updated weights for policy 1, policy_version 5233 (0.0008) [2023-12-27 19:16:09,462][106225] Updated weights for policy 1, policy_version 5243 (0.0009) [2023-12-27 19:16:09,813][106226] Updated weights for policy 0, policy_version 5316 (0.0008) [2023-12-27 19:16:09,883][106226] Updated weights for policy 0, policy_version 5326 (0.0008) [2023-12-27 19:16:09,953][106226] Updated weights for policy 0, policy_version 5336 (0.0008) [2023-12-27 19:16:10,083][106225] Updated weights for policy 1, policy_version 5253 (0.0008) [2023-12-27 19:16:10,140][106225] Updated weights for policy 1, policy_version 5263 (0.0010) [2023-12-27 19:16:10,205][106225] Updated weights for policy 1, policy_version 5273 (0.0010) [2023-12-27 19:16:10,628][106226] Updated weights for policy 0, policy_version 5346 (0.0010) [2023-12-27 19:16:10,691][106226] Updated weights for policy 0, policy_version 5356 (0.0010) [2023-12-27 19:16:10,758][106226] Updated weights for policy 0, policy_version 5366 (0.0011) [2023-12-27 19:16:10,811][106226] Updated weights for policy 0, policy_version 5376 (0.0009) [2023-12-27 19:16:10,896][106225] Updated weights for policy 1, policy_version 5283 (0.0010) [2023-12-27 19:16:10,950][106225] Updated weights for policy 1, policy_version 5293 (0.0010) [2023-12-27 19:16:11,000][106225] Updated weights for policy 1, policy_version 5303 (0.0010) [2023-12-27 19:16:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19543.8). Total num frames: 2736128. Throughput: 0: 9950.8, 1: 9745.7. Samples: 2702860. Policy #0 lag: (min: 31.0, avg: 39.1, max: 63.0) [2023-12-27 19:16:11,175][105115] Avg episode reward: [(0, '-11.751'), (1, '-13.127')] [2023-12-27 19:16:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000005312_1359872.pth... [2023-12-27 19:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000005376_1376256.pth... [2023-12-27 19:16:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000004160_1064960.pth [2023-12-27 19:16:11,185][106141] Saving new best policy, reward=-13.127! [2023-12-27 19:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000004224_1081344.pth [2023-12-27 19:16:11,186][106140] Saving new best policy, reward=-11.751! [2023-12-27 19:16:11,524][106226] Updated weights for policy 0, policy_version 5386 (0.0008) [2023-12-27 19:16:11,576][106226] Updated weights for policy 0, policy_version 5396 (0.0008) [2023-12-27 19:16:11,631][106226] Updated weights for policy 0, policy_version 5406 (0.0008) [2023-12-27 19:16:11,791][106225] Updated weights for policy 1, policy_version 5313 (0.0010) [2023-12-27 19:16:11,851][106225] Updated weights for policy 1, policy_version 5323 (0.0008) [2023-12-27 19:16:11,907][106225] Updated weights for policy 1, policy_version 5333 (0.0008) [2023-12-27 19:16:11,970][106225] Updated weights for policy 1, policy_version 5343 (0.0008) [2023-12-27 19:16:12,446][106226] Updated weights for policy 0, policy_version 5416 (0.0010) [2023-12-27 19:16:12,500][106226] Updated weights for policy 0, policy_version 5426 (0.0010) [2023-12-27 19:16:12,554][106226] Updated weights for policy 0, policy_version 5436 (0.0010) [2023-12-27 19:16:12,751][106225] Updated weights for policy 1, policy_version 5353 (0.0008) [2023-12-27 19:16:12,809][106225] Updated weights for policy 1, policy_version 5363 (0.0008) [2023-12-27 19:16:12,867][106225] Updated weights for policy 1, policy_version 5373 (0.0007) [2023-12-27 19:16:13,297][106226] Updated weights for policy 0, policy_version 5446 (0.0011) [2023-12-27 19:16:13,354][106226] Updated weights for policy 0, policy_version 5456 (0.0010) [2023-12-27 19:16:13,414][106226] Updated weights for policy 0, policy_version 5466 (0.0010) [2023-12-27 19:16:13,442][106225] Updated weights for policy 1, policy_version 5383 (0.0006) [2023-12-27 19:16:13,504][106225] Updated weights for policy 1, policy_version 5393 (0.0007) [2023-12-27 19:16:13,567][106225] Updated weights for policy 1, policy_version 5403 (0.0007) [2023-12-27 19:16:14,124][106226] Updated weights for policy 0, policy_version 5476 (0.0010) [2023-12-27 19:16:14,186][106225] Updated weights for policy 1, policy_version 5413 (0.0006) [2023-12-27 19:16:14,194][106226] Updated weights for policy 0, policy_version 5486 (0.0010) [2023-12-27 19:16:14,248][106225] Updated weights for policy 1, policy_version 5423 (0.0006) [2023-12-27 19:16:14,254][106226] Updated weights for policy 0, policy_version 5496 (0.0010) [2023-12-27 19:16:14,300][106225] Updated weights for policy 1, policy_version 5433 (0.0007) [2023-12-27 19:16:14,822][106226] Updated weights for policy 0, policy_version 5506 (0.0010) [2023-12-27 19:16:14,881][106226] Updated weights for policy 0, policy_version 5516 (0.0008) [2023-12-27 19:16:14,946][106226] Updated weights for policy 0, policy_version 5526 (0.0008) [2023-12-27 19:16:15,014][106226] Updated weights for policy 0, policy_version 5536 (0.0008) [2023-12-27 19:16:15,025][106225] Updated weights for policy 1, policy_version 5443 (0.0008) [2023-12-27 19:16:15,088][106225] Updated weights for policy 1, policy_version 5453 (0.0011) [2023-12-27 19:16:15,154][106225] Updated weights for policy 1, policy_version 5463 (0.0007) [2023-12-27 19:16:15,734][106225] Updated weights for policy 1, policy_version 5473 (0.0008) [2023-12-27 19:16:15,748][106226] Updated weights for policy 0, policy_version 5546 (0.0007) [2023-12-27 19:16:15,792][106225] Updated weights for policy 1, policy_version 5483 (0.0007) [2023-12-27 19:16:15,816][106226] Updated weights for policy 0, policy_version 5556 (0.0006) [2023-12-27 19:16:15,858][106225] Updated weights for policy 1, policy_version 5493 (0.0008) [2023-12-27 19:16:15,879][106226] Updated weights for policy 0, policy_version 5566 (0.0006) [2023-12-27 19:16:15,909][106225] Updated weights for policy 1, policy_version 5503 (0.0007) [2023-12-27 19:16:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19547.8). Total num frames: 2834432. Throughput: 0: 9801.1, 1: 9659.4. Samples: 2820832. Policy #0 lag: (min: 2.0, avg: 9.3, max: 34.0) [2023-12-27 19:16:16,175][105115] Avg episode reward: [(0, '-11.166'), (1, '-12.369')] [2023-12-27 19:16:16,176][106140] Saving new best policy, reward=-11.166! [2023-12-27 19:16:16,176][106141] Saving new best policy, reward=-12.369! [2023-12-27 19:16:16,502][106226] Updated weights for policy 0, policy_version 5576 (0.0009) [2023-12-27 19:16:16,565][106226] Updated weights for policy 0, policy_version 5586 (0.0009) [2023-12-27 19:16:16,605][106225] Updated weights for policy 1, policy_version 5513 (0.0008) [2023-12-27 19:16:16,623][106226] Updated weights for policy 0, policy_version 5596 (0.0006) [2023-12-27 19:16:16,662][106225] Updated weights for policy 1, policy_version 5523 (0.0010) [2023-12-27 19:16:16,708][106225] Updated weights for policy 1, policy_version 5533 (0.0010) [2023-12-27 19:16:17,263][106226] Updated weights for policy 0, policy_version 5606 (0.0007) [2023-12-27 19:16:17,316][106226] Updated weights for policy 0, policy_version 5616 (0.0007) [2023-12-27 19:16:17,378][106226] Updated weights for policy 0, policy_version 5626 (0.0007) [2023-12-27 19:16:17,402][106225] Updated weights for policy 1, policy_version 5543 (0.0010) [2023-12-27 19:16:17,455][106225] Updated weights for policy 1, policy_version 5553 (0.0006) [2023-12-27 19:16:17,511][106225] Updated weights for policy 1, policy_version 5563 (0.0005) [2023-12-27 19:16:18,076][106226] Updated weights for policy 0, policy_version 5636 (0.0007) [2023-12-27 19:16:18,133][106226] Updated weights for policy 0, policy_version 5646 (0.0009) [2023-12-27 19:16:18,166][106225] Updated weights for policy 1, policy_version 5573 (0.0006) [2023-12-27 19:16:18,193][106226] Updated weights for policy 0, policy_version 5656 (0.0011) [2023-12-27 19:16:18,227][106225] Updated weights for policy 1, policy_version 5583 (0.0006) [2023-12-27 19:16:18,290][106225] Updated weights for policy 1, policy_version 5593 (0.0006) [2023-12-27 19:16:18,777][106226] Updated weights for policy 0, policy_version 5666 (0.0008) [2023-12-27 19:16:18,832][106226] Updated weights for policy 0, policy_version 5676 (0.0006) [2023-12-27 19:16:18,888][106226] Updated weights for policy 0, policy_version 5686 (0.0005) [2023-12-27 19:16:18,959][106226] Updated weights for policy 0, policy_version 5696 (0.0005) [2023-12-27 19:16:19,049][106225] Updated weights for policy 1, policy_version 5603 (0.0009) [2023-12-27 19:16:19,105][106225] Updated weights for policy 1, policy_version 5613 (0.0008) [2023-12-27 19:16:19,161][106225] Updated weights for policy 1, policy_version 5623 (0.0008) [2023-12-27 19:16:19,606][106226] Updated weights for policy 0, policy_version 5706 (0.0005) [2023-12-27 19:16:19,676][106226] Updated weights for policy 0, policy_version 5716 (0.0006) [2023-12-27 19:16:19,745][106226] Updated weights for policy 0, policy_version 5726 (0.0009) [2023-12-27 19:16:19,924][106225] Updated weights for policy 1, policy_version 5633 (0.0006) [2023-12-27 19:16:19,991][106225] Updated weights for policy 1, policy_version 5643 (0.0007) [2023-12-27 19:16:20,053][106225] Updated weights for policy 1, policy_version 5653 (0.0008) [2023-12-27 19:16:20,114][106225] Updated weights for policy 1, policy_version 5663 (0.0008) [2023-12-27 19:16:20,424][106226] Updated weights for policy 0, policy_version 5736 (0.0010) [2023-12-27 19:16:20,487][106226] Updated weights for policy 0, policy_version 5746 (0.0011) [2023-12-27 19:16:20,546][106226] Updated weights for policy 0, policy_version 5756 (0.0011) [2023-12-27 19:16:20,843][106225] Updated weights for policy 1, policy_version 5673 (0.0006) [2023-12-27 19:16:20,902][106225] Updated weights for policy 1, policy_version 5683 (0.0007) [2023-12-27 19:16:20,966][106225] Updated weights for policy 1, policy_version 5693 (0.0007) [2023-12-27 19:16:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19551.6). Total num frames: 2932736. Throughput: 0: 9878.5, 1: 9652.7. Samples: 2941828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:16:21,175][105115] Avg episode reward: [(0, '-10.463'), (1, '-12.043')] [2023-12-27 19:16:21,176][106141] Saving new best policy, reward=-12.043! [2023-12-27 19:16:21,176][106140] Saving new best policy, reward=-10.463! [2023-12-27 19:16:21,255][106226] Updated weights for policy 0, policy_version 5766 (0.0007) [2023-12-27 19:16:21,319][106226] Updated weights for policy 0, policy_version 5776 (0.0006) [2023-12-27 19:16:21,394][106226] Updated weights for policy 0, policy_version 5786 (0.0008) [2023-12-27 19:16:21,706][106225] Updated weights for policy 1, policy_version 5703 (0.0008) [2023-12-27 19:16:21,792][106225] Updated weights for policy 1, policy_version 5713 (0.0008) [2023-12-27 19:16:21,847][106225] Updated weights for policy 1, policy_version 5723 (0.0008) [2023-12-27 19:16:22,098][106226] Updated weights for policy 0, policy_version 5796 (0.0009) [2023-12-27 19:16:22,163][106226] Updated weights for policy 0, policy_version 5806 (0.0011) [2023-12-27 19:16:22,228][106226] Updated weights for policy 0, policy_version 5816 (0.0011) [2023-12-27 19:16:22,636][106225] Updated weights for policy 1, policy_version 5733 (0.0008) [2023-12-27 19:16:22,701][106225] Updated weights for policy 1, policy_version 5743 (0.0006) [2023-12-27 19:16:22,764][106225] Updated weights for policy 1, policy_version 5753 (0.0005) [2023-12-27 19:16:22,968][106226] Updated weights for policy 0, policy_version 5826 (0.0011) [2023-12-27 19:16:23,029][106226] Updated weights for policy 0, policy_version 5836 (0.0011) [2023-12-27 19:16:23,084][106226] Updated weights for policy 0, policy_version 5846 (0.0011) [2023-12-27 19:16:23,142][106226] Updated weights for policy 0, policy_version 5856 (0.0010) [2023-12-27 19:16:23,470][106225] Updated weights for policy 1, policy_version 5763 (0.0008) [2023-12-27 19:16:23,516][106225] Updated weights for policy 1, policy_version 5773 (0.0007) [2023-12-27 19:16:23,566][106225] Updated weights for policy 1, policy_version 5783 (0.0008) [2023-12-27 19:16:23,872][106226] Updated weights for policy 0, policy_version 5866 (0.0011) [2023-12-27 19:16:23,941][106226] Updated weights for policy 0, policy_version 5876 (0.0010) [2023-12-27 19:16:23,994][106226] Updated weights for policy 0, policy_version 5886 (0.0010) [2023-12-27 19:16:24,195][106225] Updated weights for policy 1, policy_version 5793 (0.0007) [2023-12-27 19:16:24,251][106225] Updated weights for policy 1, policy_version 5803 (0.0005) [2023-12-27 19:16:24,312][106225] Updated weights for policy 1, policy_version 5813 (0.0005) [2023-12-27 19:16:24,371][106225] Updated weights for policy 1, policy_version 5823 (0.0005) [2023-12-27 19:16:24,654][106226] Updated weights for policy 0, policy_version 5896 (0.0008) [2023-12-27 19:16:24,711][106226] Updated weights for policy 0, policy_version 5906 (0.0010) [2023-12-27 19:16:24,764][106226] Updated weights for policy 0, policy_version 5916 (0.0006) [2023-12-27 19:16:25,016][106225] Updated weights for policy 1, policy_version 5833 (0.0010) [2023-12-27 19:16:25,075][106225] Updated weights for policy 1, policy_version 5843 (0.0010) [2023-12-27 19:16:25,141][106225] Updated weights for policy 1, policy_version 5853 (0.0010) [2023-12-27 19:16:25,314][106226] Updated weights for policy 0, policy_version 5926 (0.0005) [2023-12-27 19:16:25,383][106226] Updated weights for policy 0, policy_version 5936 (0.0006) [2023-12-27 19:16:25,443][106226] Updated weights for policy 0, policy_version 5946 (0.0005) [2023-12-27 19:16:25,780][106225] Updated weights for policy 1, policy_version 5863 (0.0007) [2023-12-27 19:16:25,834][106225] Updated weights for policy 1, policy_version 5873 (0.0005) [2023-12-27 19:16:25,883][106225] Updated weights for policy 1, policy_version 5883 (0.0005) [2023-12-27 19:16:26,083][106226] Updated weights for policy 0, policy_version 5956 (0.0010) [2023-12-27 19:16:26,136][106226] Updated weights for policy 0, policy_version 5966 (0.0010) [2023-12-27 19:16:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19555.1). Total num frames: 3031040. Throughput: 0: 9883.7, 1: 9650.9. Samples: 2997876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:16:26,175][105115] Avg episode reward: [(0, '-10.556'), (1, '-11.131')] [2023-12-27 19:16:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000005888_1507328.pth... [2023-12-27 19:16:26,186][106226] Updated weights for policy 0, policy_version 5976 (0.0010) [2023-12-27 19:16:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000004736_1212416.pth [2023-12-27 19:16:26,189][106141] Saving new best policy, reward=-11.131! [2023-12-27 19:16:26,234][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000005984_1531904.pth... [2023-12-27 19:16:26,237][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000004800_1228800.pth [2023-12-27 19:16:26,474][106225] Updated weights for policy 1, policy_version 5893 (0.0008) [2023-12-27 19:16:26,532][106225] Updated weights for policy 1, policy_version 5903 (0.0010) [2023-12-27 19:16:26,591][106225] Updated weights for policy 1, policy_version 5913 (0.0006) [2023-12-27 19:16:26,931][106226] Updated weights for policy 0, policy_version 5986 (0.0011) [2023-12-27 19:16:26,992][106226] Updated weights for policy 0, policy_version 5996 (0.0009) [2023-12-27 19:16:27,039][106226] Updated weights for policy 0, policy_version 6006 (0.0007) [2023-12-27 19:16:27,103][106226] Updated weights for policy 0, policy_version 6016 (0.0006) [2023-12-27 19:16:27,169][106225] Updated weights for policy 1, policy_version 5923 (0.0007) [2023-12-27 19:16:27,229][106225] Updated weights for policy 1, policy_version 5933 (0.0006) [2023-12-27 19:16:27,289][106225] Updated weights for policy 1, policy_version 5943 (0.0006) [2023-12-27 19:16:27,759][106226] Updated weights for policy 0, policy_version 6026 (0.0009) [2023-12-27 19:16:27,808][106226] Updated weights for policy 0, policy_version 6036 (0.0010) [2023-12-27 19:16:27,829][106225] Updated weights for policy 1, policy_version 5953 (0.0007) [2023-12-27 19:16:27,854][106226] Updated weights for policy 0, policy_version 6046 (0.0010) [2023-12-27 19:16:27,886][106225] Updated weights for policy 1, policy_version 5963 (0.0006) [2023-12-27 19:16:27,939][106225] Updated weights for policy 1, policy_version 5973 (0.0007) [2023-12-27 19:16:27,984][106225] Updated weights for policy 1, policy_version 5983 (0.0007) [2023-12-27 19:16:28,577][106226] Updated weights for policy 0, policy_version 6056 (0.0011) [2023-12-27 19:16:28,630][106225] Updated weights for policy 1, policy_version 5993 (0.0007) [2023-12-27 19:16:28,639][106226] Updated weights for policy 0, policy_version 6066 (0.0008) [2023-12-27 19:16:28,691][106225] Updated weights for policy 1, policy_version 6003 (0.0005) [2023-12-27 19:16:28,701][106226] Updated weights for policy 0, policy_version 6076 (0.0007) [2023-12-27 19:16:28,769][106225] Updated weights for policy 1, policy_version 6013 (0.0008) [2023-12-27 19:16:29,399][106226] Updated weights for policy 0, policy_version 6086 (0.0007) [2023-12-27 19:16:29,460][106226] Updated weights for policy 0, policy_version 6096 (0.0006) [2023-12-27 19:16:29,476][106225] Updated weights for policy 1, policy_version 6023 (0.0008) [2023-12-27 19:16:29,528][106226] Updated weights for policy 0, policy_version 6106 (0.0006) [2023-12-27 19:16:29,540][106225] Updated weights for policy 1, policy_version 6033 (0.0008) [2023-12-27 19:16:29,605][106225] Updated weights for policy 1, policy_version 6043 (0.0005) [2023-12-27 19:16:30,215][106226] Updated weights for policy 0, policy_version 6116 (0.0008) [2023-12-27 19:16:30,240][106225] Updated weights for policy 1, policy_version 6053 (0.0006) [2023-12-27 19:16:30,271][106226] Updated weights for policy 0, policy_version 6126 (0.0007) [2023-12-27 19:16:30,297][106225] Updated weights for policy 1, policy_version 6063 (0.0007) [2023-12-27 19:16:30,335][106226] Updated weights for policy 0, policy_version 6136 (0.0008) [2023-12-27 19:16:30,355][106225] Updated weights for policy 1, policy_version 6073 (0.0005) [2023-12-27 19:16:30,933][106226] Updated weights for policy 0, policy_version 6146 (0.0008) [2023-12-27 19:16:30,962][106225] Updated weights for policy 1, policy_version 6083 (0.0008) [2023-12-27 19:16:30,983][106226] Updated weights for policy 0, policy_version 6156 (0.0007) [2023-12-27 19:16:31,013][106225] Updated weights for policy 1, policy_version 6093 (0.0006) [2023-12-27 19:16:31,041][106226] Updated weights for policy 0, policy_version 6166 (0.0007) [2023-12-27 19:16:31,080][106225] Updated weights for policy 1, policy_version 6103 (0.0007) [2023-12-27 19:16:31,094][106226] Updated weights for policy 0, policy_version 6176 (0.0008) [2023-12-27 19:16:31,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 3145728. Throughput: 0: 9975.1, 1: 9911.2. Samples: 3125680. Policy #0 lag: (min: 10.0, avg: 21.8, max: 42.0) [2023-12-27 19:16:31,175][105115] Avg episode reward: [(0, '-9.713'), (1, '-10.848')] [2023-12-27 19:16:31,176][106140] Saving new best policy, reward=-9.713! [2023-12-27 19:16:31,176][106141] Saving new best policy, reward=-10.848! [2023-12-27 19:16:31,797][106226] Updated weights for policy 0, policy_version 6186 (0.0007) [2023-12-27 19:16:31,857][106226] Updated weights for policy 0, policy_version 6196 (0.0009) [2023-12-27 19:16:31,879][106225] Updated weights for policy 1, policy_version 6113 (0.0008) [2023-12-27 19:16:31,922][106226] Updated weights for policy 0, policy_version 6206 (0.0009) [2023-12-27 19:16:31,936][106225] Updated weights for policy 1, policy_version 6123 (0.0008) [2023-12-27 19:16:31,994][106225] Updated weights for policy 1, policy_version 6133 (0.0008) [2023-12-27 19:16:32,049][106225] Updated weights for policy 1, policy_version 6143 (0.0008) [2023-12-27 19:16:32,620][106226] Updated weights for policy 0, policy_version 6216 (0.0008) [2023-12-27 19:16:32,678][106226] Updated weights for policy 0, policy_version 6226 (0.0006) [2023-12-27 19:16:32,728][106226] Updated weights for policy 0, policy_version 6236 (0.0005) [2023-12-27 19:16:32,803][106225] Updated weights for policy 1, policy_version 6153 (0.0008) [2023-12-27 19:16:32,861][106225] Updated weights for policy 1, policy_version 6163 (0.0008) [2023-12-27 19:16:32,916][106225] Updated weights for policy 1, policy_version 6173 (0.0008) [2023-12-27 19:16:33,390][106226] Updated weights for policy 0, policy_version 6246 (0.0008) [2023-12-27 19:16:33,437][106226] Updated weights for policy 0, policy_version 6256 (0.0008) [2023-12-27 19:16:33,480][106226] Updated weights for policy 0, policy_version 6266 (0.0007) [2023-12-27 19:16:33,652][106225] Updated weights for policy 1, policy_version 6183 (0.0008) [2023-12-27 19:16:33,714][106225] Updated weights for policy 1, policy_version 6193 (0.0009) [2023-12-27 19:16:33,772][106225] Updated weights for policy 1, policy_version 6203 (0.0008) [2023-12-27 19:16:34,248][106226] Updated weights for policy 0, policy_version 6276 (0.0008) [2023-12-27 19:16:34,311][106226] Updated weights for policy 0, policy_version 6286 (0.0008) [2023-12-27 19:16:34,372][106226] Updated weights for policy 0, policy_version 6296 (0.0009) [2023-12-27 19:16:34,444][106225] Updated weights for policy 1, policy_version 6213 (0.0007) [2023-12-27 19:16:34,516][106225] Updated weights for policy 1, policy_version 6223 (0.0006) [2023-12-27 19:16:34,576][106225] Updated weights for policy 1, policy_version 6233 (0.0006) [2023-12-27 19:16:35,133][106226] Updated weights for policy 0, policy_version 6306 (0.0010) [2023-12-27 19:16:35,187][106226] Updated weights for policy 0, policy_version 6316 (0.0008) [2023-12-27 19:16:35,193][106225] Updated weights for policy 1, policy_version 6243 (0.0006) [2023-12-27 19:16:35,237][106226] Updated weights for policy 0, policy_version 6326 (0.0007) [2023-12-27 19:16:35,243][106225] Updated weights for policy 1, policy_version 6253 (0.0006) [2023-12-27 19:16:35,291][106225] Updated weights for policy 1, policy_version 6263 (0.0007) [2023-12-27 19:16:35,297][106226] Updated weights for policy 0, policy_version 6336 (0.0007) [2023-12-27 19:16:35,978][106226] Updated weights for policy 0, policy_version 6346 (0.0009) [2023-12-27 19:16:36,034][106225] Updated weights for policy 1, policy_version 6273 (0.0007) [2023-12-27 19:16:36,041][106226] Updated weights for policy 0, policy_version 6356 (0.0009) [2023-12-27 19:16:36,091][106225] Updated weights for policy 1, policy_version 6283 (0.0008) [2023-12-27 19:16:36,099][106226] Updated weights for policy 0, policy_version 6366 (0.0008) [2023-12-27 19:16:36,161][106225] Updated weights for policy 1, policy_version 6293 (0.0009) [2023-12-27 19:16:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19611.2). Total num frames: 3235840. Throughput: 0: 10048.5, 1: 9919.0. Samples: 3245776. Policy #0 lag: (min: 10.0, avg: 21.8, max: 42.0) [2023-12-27 19:16:36,175][105115] Avg episode reward: [(0, '-10.060'), (1, '-10.749')] [2023-12-27 19:16:36,228][106225] Updated weights for policy 1, policy_version 6303 (0.0008) [2023-12-27 19:16:36,231][106141] Saving new best policy, reward=-10.749! [2023-12-27 19:16:36,834][106226] Updated weights for policy 0, policy_version 6376 (0.0008) [2023-12-27 19:16:36,888][106226] Updated weights for policy 0, policy_version 6386 (0.0008) [2023-12-27 19:16:36,943][106226] Updated weights for policy 0, policy_version 6396 (0.0008) [2023-12-27 19:16:36,987][106225] Updated weights for policy 1, policy_version 6313 (0.0010) [2023-12-27 19:16:37,047][106225] Updated weights for policy 1, policy_version 6323 (0.0010) [2023-12-27 19:16:37,109][106225] Updated weights for policy 1, policy_version 6333 (0.0010) [2023-12-27 19:16:37,694][106226] Updated weights for policy 0, policy_version 6406 (0.0007) [2023-12-27 19:16:37,763][106226] Updated weights for policy 0, policy_version 6416 (0.0006) [2023-12-27 19:16:37,824][106226] Updated weights for policy 0, policy_version 6426 (0.0008) [2023-12-27 19:16:37,834][106225] Updated weights for policy 1, policy_version 6343 (0.0010) [2023-12-27 19:16:37,888][106225] Updated weights for policy 1, policy_version 6353 (0.0010) [2023-12-27 19:16:37,946][106225] Updated weights for policy 1, policy_version 6363 (0.0010) [2023-12-27 19:16:38,451][106226] Updated weights for policy 0, policy_version 6436 (0.0006) [2023-12-27 19:16:38,518][106226] Updated weights for policy 0, policy_version 6446 (0.0007) [2023-12-27 19:16:38,583][106226] Updated weights for policy 0, policy_version 6456 (0.0009) [2023-12-27 19:16:38,687][106225] Updated weights for policy 1, policy_version 6373 (0.0010) [2023-12-27 19:16:38,747][106225] Updated weights for policy 1, policy_version 6383 (0.0007) [2023-12-27 19:16:38,816][106225] Updated weights for policy 1, policy_version 6393 (0.0006) [2023-12-27 19:16:39,239][106226] Updated weights for policy 0, policy_version 6466 (0.0008) [2023-12-27 19:16:39,298][106226] Updated weights for policy 0, policy_version 6476 (0.0008) [2023-12-27 19:16:39,362][106226] Updated weights for policy 0, policy_version 6486 (0.0008) [2023-12-27 19:16:39,432][106226] Updated weights for policy 0, policy_version 6496 (0.0008) [2023-12-27 19:16:39,582][106225] Updated weights for policy 1, policy_version 6403 (0.0008) [2023-12-27 19:16:39,637][106225] Updated weights for policy 1, policy_version 6413 (0.0009) [2023-12-27 19:16:39,695][106225] Updated weights for policy 1, policy_version 6423 (0.0009) [2023-12-27 19:16:40,117][106226] Updated weights for policy 0, policy_version 6506 (0.0008) [2023-12-27 19:16:40,182][106226] Updated weights for policy 0, policy_version 6516 (0.0008) [2023-12-27 19:16:40,257][106226] Updated weights for policy 0, policy_version 6526 (0.0009) [2023-12-27 19:16:40,471][106225] Updated weights for policy 1, policy_version 6433 (0.0009) [2023-12-27 19:16:40,538][106225] Updated weights for policy 1, policy_version 6443 (0.0009) [2023-12-27 19:16:40,598][106225] Updated weights for policy 1, policy_version 6453 (0.0010) [2023-12-27 19:16:40,659][106225] Updated weights for policy 1, policy_version 6463 (0.0010) [2023-12-27 19:16:40,922][106226] Updated weights for policy 0, policy_version 6536 (0.0010) [2023-12-27 19:16:40,972][106226] Updated weights for policy 0, policy_version 6546 (0.0010) [2023-12-27 19:16:41,033][106226] Updated weights for policy 0, policy_version 6556 (0.0010) [2023-12-27 19:16:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19612.6). Total num frames: 3334144. Throughput: 0: 10038.8, 1: 9893.6. Samples: 3304048. Policy #0 lag: (min: 31.0, avg: 31.4, max: 47.0) [2023-12-27 19:16:41,175][105115] Avg episode reward: [(0, '-9.180'), (1, '-10.544')] [2023-12-27 19:16:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000006560_1679360.pth... [2023-12-27 19:16:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000006464_1654784.pth... [2023-12-27 19:16:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000005376_1376256.pth [2023-12-27 19:16:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000005312_1359872.pth [2023-12-27 19:16:41,186][106140] Saving new best policy, reward=-9.180! [2023-12-27 19:16:41,186][106141] Saving new best policy, reward=-10.544! [2023-12-27 19:16:41,370][106225] Updated weights for policy 1, policy_version 6473 (0.0008) [2023-12-27 19:16:41,437][106225] Updated weights for policy 1, policy_version 6483 (0.0009) [2023-12-27 19:16:41,501][106225] Updated weights for policy 1, policy_version 6493 (0.0007) [2023-12-27 19:16:41,905][106226] Updated weights for policy 0, policy_version 6566 (0.0010) [2023-12-27 19:16:41,975][106226] Updated weights for policy 0, policy_version 6576 (0.0010) [2023-12-27 19:16:42,047][106226] Updated weights for policy 0, policy_version 6586 (0.0011) [2023-12-27 19:16:42,263][106225] Updated weights for policy 1, policy_version 6503 (0.0008) [2023-12-27 19:16:42,334][106225] Updated weights for policy 1, policy_version 6513 (0.0009) [2023-12-27 19:16:42,411][106225] Updated weights for policy 1, policy_version 6523 (0.0008) [2023-12-27 19:16:42,779][106226] Updated weights for policy 0, policy_version 6596 (0.0009) [2023-12-27 19:16:42,842][106226] Updated weights for policy 0, policy_version 6606 (0.0009) [2023-12-27 19:16:42,901][106226] Updated weights for policy 0, policy_version 6616 (0.0009) [2023-12-27 19:16:43,063][106225] Updated weights for policy 1, policy_version 6533 (0.0007) [2023-12-27 19:16:43,121][106225] Updated weights for policy 1, policy_version 6543 (0.0008) [2023-12-27 19:16:43,178][106225] Updated weights for policy 1, policy_version 6553 (0.0008) [2023-12-27 19:16:43,691][106226] Updated weights for policy 0, policy_version 6626 (0.0009) [2023-12-27 19:16:43,747][106226] Updated weights for policy 0, policy_version 6636 (0.0007) [2023-12-27 19:16:43,790][106225] Updated weights for policy 1, policy_version 6563 (0.0009) [2023-12-27 19:16:43,804][106226] Updated weights for policy 0, policy_version 6646 (0.0009) [2023-12-27 19:16:43,837][106225] Updated weights for policy 1, policy_version 6573 (0.0010) [2023-12-27 19:16:43,865][106226] Updated weights for policy 0, policy_version 6656 (0.0005) [2023-12-27 19:16:43,899][106225] Updated weights for policy 1, policy_version 6583 (0.0010) [2023-12-27 19:16:44,592][106225] Updated weights for policy 1, policy_version 6593 (0.0007) [2023-12-27 19:16:44,613][106226] Updated weights for policy 0, policy_version 6666 (0.0007) [2023-12-27 19:16:44,656][106225] Updated weights for policy 1, policy_version 6603 (0.0007) [2023-12-27 19:16:44,676][106226] Updated weights for policy 0, policy_version 6676 (0.0007) [2023-12-27 19:16:44,716][106225] Updated weights for policy 1, policy_version 6613 (0.0008) [2023-12-27 19:16:44,736][106226] Updated weights for policy 0, policy_version 6686 (0.0007) [2023-12-27 19:16:44,778][106225] Updated weights for policy 1, policy_version 6623 (0.0007) [2023-12-27 19:16:45,413][106225] Updated weights for policy 1, policy_version 6633 (0.0008) [2023-12-27 19:16:45,458][106225] Updated weights for policy 1, policy_version 6643 (0.0009) [2023-12-27 19:16:45,506][106225] Updated weights for policy 1, policy_version 6653 (0.0006) [2023-12-27 19:16:45,508][106226] Updated weights for policy 0, policy_version 6696 (0.0008) [2023-12-27 19:16:45,565][106226] Updated weights for policy 0, policy_version 6706 (0.0008) [2023-12-27 19:16:45,627][106226] Updated weights for policy 0, policy_version 6716 (0.0007) [2023-12-27 19:16:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19567.2). Total num frames: 3424256. Throughput: 0: 9903.6, 1: 9916.5. Samples: 3417788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:16:46,176][105115] Avg episode reward: [(0, '-9.093'), (1, '-9.896')] [2023-12-27 19:16:46,178][106140] Saving new best policy, reward=-9.093! [2023-12-27 19:16:46,183][106225] Updated weights for policy 1, policy_version 6663 (0.0008) [2023-12-27 19:16:46,236][106226] Updated weights for policy 0, policy_version 6726 (0.0006) [2023-12-27 19:16:46,246][106225] Updated weights for policy 1, policy_version 6673 (0.0008) [2023-12-27 19:16:46,292][106226] Updated weights for policy 0, policy_version 6736 (0.0008) [2023-12-27 19:16:46,297][106225] Updated weights for policy 1, policy_version 6683 (0.0009) [2023-12-27 19:16:46,325][106141] Saving new best policy, reward=-9.896! [2023-12-27 19:16:46,351][106226] Updated weights for policy 0, policy_version 6746 (0.0007) [2023-12-27 19:16:47,039][106225] Updated weights for policy 1, policy_version 6693 (0.0008) [2023-12-27 19:16:47,066][106226] Updated weights for policy 0, policy_version 6756 (0.0007) [2023-12-27 19:16:47,100][106225] Updated weights for policy 1, policy_version 6703 (0.0006) [2023-12-27 19:16:47,118][106226] Updated weights for policy 0, policy_version 6766 (0.0007) [2023-12-27 19:16:47,163][106225] Updated weights for policy 1, policy_version 6713 (0.0005) [2023-12-27 19:16:47,179][106226] Updated weights for policy 0, policy_version 6776 (0.0008) [2023-12-27 19:16:47,795][106225] Updated weights for policy 1, policy_version 6723 (0.0006) [2023-12-27 19:16:47,855][106225] Updated weights for policy 1, policy_version 6733 (0.0008) [2023-12-27 19:16:47,907][106225] Updated weights for policy 1, policy_version 6743 (0.0008) [2023-12-27 19:16:47,932][106226] Updated weights for policy 0, policy_version 6786 (0.0009) [2023-12-27 19:16:47,993][106226] Updated weights for policy 0, policy_version 6796 (0.0007) [2023-12-27 19:16:48,051][106226] Updated weights for policy 0, policy_version 6806 (0.0005) [2023-12-27 19:16:48,112][106226] Updated weights for policy 0, policy_version 6816 (0.0005) [2023-12-27 19:16:48,516][106225] Updated weights for policy 1, policy_version 6753 (0.0008) [2023-12-27 19:16:48,570][106225] Updated weights for policy 1, policy_version 6763 (0.0007) [2023-12-27 19:16:48,618][106225] Updated weights for policy 1, policy_version 6773 (0.0005) [2023-12-27 19:16:48,676][106225] Updated weights for policy 1, policy_version 6783 (0.0010) [2023-12-27 19:16:48,788][106226] Updated weights for policy 0, policy_version 6826 (0.0008) [2023-12-27 19:16:48,845][106226] Updated weights for policy 0, policy_version 6836 (0.0008) [2023-12-27 19:16:48,896][106226] Updated weights for policy 0, policy_version 6846 (0.0008) [2023-12-27 19:16:49,420][106225] Updated weights for policy 1, policy_version 6793 (0.0009) [2023-12-27 19:16:49,483][106225] Updated weights for policy 1, policy_version 6803 (0.0007) [2023-12-27 19:16:49,545][106225] Updated weights for policy 1, policy_version 6813 (0.0007) [2023-12-27 19:16:49,659][106226] Updated weights for policy 0, policy_version 6856 (0.0008) [2023-12-27 19:16:49,717][106226] Updated weights for policy 0, policy_version 6866 (0.0011) [2023-12-27 19:16:49,785][106226] Updated weights for policy 0, policy_version 6876 (0.0010) [2023-12-27 19:16:50,305][106225] Updated weights for policy 1, policy_version 6823 (0.0010) [2023-12-27 19:16:50,360][106225] Updated weights for policy 1, policy_version 6833 (0.0010) [2023-12-27 19:16:50,426][106225] Updated weights for policy 1, policy_version 6843 (0.0010) [2023-12-27 19:16:50,514][106226] Updated weights for policy 0, policy_version 6886 (0.0011) [2023-12-27 19:16:50,576][106226] Updated weights for policy 0, policy_version 6896 (0.0011) [2023-12-27 19:16:50,647][106226] Updated weights for policy 0, policy_version 6906 (0.0010) [2023-12-27 19:16:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19569.8). Total num frames: 3522560. Throughput: 0: 9806.7, 1: 9984.8. Samples: 3536128. Policy #0 lag: (min: 24.0, avg: 53.4, max: 56.0) [2023-12-27 19:16:51,175][105115] Avg episode reward: [(0, '-8.327'), (1, '-9.744')] [2023-12-27 19:16:51,176][106140] Saving new best policy, reward=-8.327! [2023-12-27 19:16:51,186][106225] Updated weights for policy 1, policy_version 6853 (0.0010) [2023-12-27 19:16:51,255][106225] Updated weights for policy 1, policy_version 6863 (0.0011) [2023-12-27 19:16:51,317][106225] Updated weights for policy 1, policy_version 6873 (0.0007) [2023-12-27 19:16:51,357][106141] Saving new best policy, reward=-9.744! [2023-12-27 19:16:51,406][106226] Updated weights for policy 0, policy_version 6916 (0.0010) [2023-12-27 19:16:51,465][106226] Updated weights for policy 0, policy_version 6926 (0.0009) [2023-12-27 19:16:51,531][106226] Updated weights for policy 0, policy_version 6936 (0.0009) [2023-12-27 19:16:52,083][106225] Updated weights for policy 1, policy_version 6883 (0.0007) [2023-12-27 19:16:52,136][106225] Updated weights for policy 1, policy_version 6893 (0.0008) [2023-12-27 19:16:52,200][106225] Updated weights for policy 1, policy_version 6903 (0.0008) [2023-12-27 19:16:52,216][106226] Updated weights for policy 0, policy_version 6946 (0.0009) [2023-12-27 19:16:52,273][106226] Updated weights for policy 0, policy_version 6956 (0.0010) [2023-12-27 19:16:52,342][106226] Updated weights for policy 0, policy_version 6966 (0.0008) [2023-12-27 19:16:52,407][106226] Updated weights for policy 0, policy_version 6976 (0.0011) [2023-12-27 19:16:52,940][106225] Updated weights for policy 1, policy_version 6913 (0.0007) [2023-12-27 19:16:52,988][106225] Updated weights for policy 1, policy_version 6923 (0.0008) [2023-12-27 19:16:53,043][106225] Updated weights for policy 1, policy_version 6933 (0.0008) [2023-12-27 19:16:53,096][106225] Updated weights for policy 1, policy_version 6943 (0.0008) [2023-12-27 19:16:53,157][106226] Updated weights for policy 0, policy_version 6986 (0.0010) [2023-12-27 19:16:53,221][106226] Updated weights for policy 0, policy_version 6996 (0.0010) [2023-12-27 19:16:53,276][106226] Updated weights for policy 0, policy_version 7006 (0.0010) [2023-12-27 19:16:53,754][106225] Updated weights for policy 1, policy_version 6953 (0.0010) [2023-12-27 19:16:53,811][106225] Updated weights for policy 1, policy_version 6963 (0.0010) [2023-12-27 19:16:53,867][106225] Updated weights for policy 1, policy_version 6973 (0.0009) [2023-12-27 19:16:53,920][106226] Updated weights for policy 0, policy_version 7016 (0.0010) [2023-12-27 19:16:53,970][106226] Updated weights for policy 0, policy_version 7026 (0.0010) [2023-12-27 19:16:54,027][106226] Updated weights for policy 0, policy_version 7036 (0.0010) [2023-12-27 19:16:54,546][106225] Updated weights for policy 1, policy_version 6983 (0.0009) [2023-12-27 19:16:54,609][106225] Updated weights for policy 1, policy_version 6993 (0.0010) [2023-12-27 19:16:54,671][106225] Updated weights for policy 1, policy_version 7003 (0.0005) [2023-12-27 19:16:54,761][106226] Updated weights for policy 0, policy_version 7046 (0.0011) [2023-12-27 19:16:54,825][106226] Updated weights for policy 0, policy_version 7056 (0.0011) [2023-12-27 19:16:54,888][106226] Updated weights for policy 0, policy_version 7066 (0.0011) [2023-12-27 19:16:55,279][106225] Updated weights for policy 1, policy_version 7013 (0.0007) [2023-12-27 19:16:55,335][106225] Updated weights for policy 1, policy_version 7023 (0.0010) [2023-12-27 19:16:55,391][106225] Updated weights for policy 1, policy_version 7033 (0.0010) [2023-12-27 19:16:55,605][106226] Updated weights for policy 0, policy_version 7076 (0.0011) [2023-12-27 19:16:55,668][106226] Updated weights for policy 0, policy_version 7086 (0.0010) [2023-12-27 19:16:55,724][106226] Updated weights for policy 0, policy_version 7096 (0.0006) [2023-12-27 19:16:56,063][106225] Updated weights for policy 1, policy_version 7043 (0.0010) [2023-12-27 19:16:56,119][106225] Updated weights for policy 1, policy_version 7053 (0.0010) [2023-12-27 19:16:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19572.2). Total num frames: 3620864. Throughput: 0: 9817.6, 1: 9980.4. Samples: 3593772. Policy #0 lag: (min: 24.0, avg: 53.4, max: 56.0) [2023-12-27 19:16:56,175][105115] Avg episode reward: [(0, '-9.015'), (1, '-9.665')] [2023-12-27 19:16:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000007104_1818624.pth... [2023-12-27 19:16:56,184][106225] Updated weights for policy 1, policy_version 7063 (0.0010) [2023-12-27 19:16:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000005984_1531904.pth [2023-12-27 19:16:56,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000007072_1810432.pth... [2023-12-27 19:16:56,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000005888_1507328.pth [2023-12-27 19:16:56,243][106141] Saving new best policy, reward=-9.665! [2023-12-27 19:16:56,363][106226] Updated weights for policy 0, policy_version 7106 (0.0006) [2023-12-27 19:16:56,423][106226] Updated weights for policy 0, policy_version 7116 (0.0010) [2023-12-27 19:16:56,476][106226] Updated weights for policy 0, policy_version 7126 (0.0010) [2023-12-27 19:16:56,529][106226] Updated weights for policy 0, policy_version 7136 (0.0010) [2023-12-27 19:16:56,798][106225] Updated weights for policy 1, policy_version 7073 (0.0009) [2023-12-27 19:16:56,849][106225] Updated weights for policy 1, policy_version 7083 (0.0005) [2023-12-27 19:16:56,906][106225] Updated weights for policy 1, policy_version 7093 (0.0005) [2023-12-27 19:16:56,959][106225] Updated weights for policy 1, policy_version 7103 (0.0005) [2023-12-27 19:16:57,160][106226] Updated weights for policy 0, policy_version 7146 (0.0005) [2023-12-27 19:16:57,223][106226] Updated weights for policy 0, policy_version 7156 (0.0006) [2023-12-27 19:16:57,290][106226] Updated weights for policy 0, policy_version 7166 (0.0006) [2023-12-27 19:16:57,529][106225] Updated weights for policy 1, policy_version 7113 (0.0005) [2023-12-27 19:16:57,575][106225] Updated weights for policy 1, policy_version 7123 (0.0005) [2023-12-27 19:16:57,627][106225] Updated weights for policy 1, policy_version 7133 (0.0006) [2023-12-27 19:16:57,974][106226] Updated weights for policy 0, policy_version 7176 (0.0008) [2023-12-27 19:16:58,035][106226] Updated weights for policy 0, policy_version 7186 (0.0008) [2023-12-27 19:16:58,095][106226] Updated weights for policy 0, policy_version 7196 (0.0007) [2023-12-27 19:16:58,321][106225] Updated weights for policy 1, policy_version 7143 (0.0010) [2023-12-27 19:16:58,387][106225] Updated weights for policy 1, policy_version 7153 (0.0009) [2023-12-27 19:16:58,448][106225] Updated weights for policy 1, policy_version 7163 (0.0009) [2023-12-27 19:16:58,919][106226] Updated weights for policy 0, policy_version 7206 (0.0007) [2023-12-27 19:16:58,981][106226] Updated weights for policy 0, policy_version 7216 (0.0006) [2023-12-27 19:16:59,044][106226] Updated weights for policy 0, policy_version 7226 (0.0007) [2023-12-27 19:16:59,200][106225] Updated weights for policy 1, policy_version 7173 (0.0009) [2023-12-27 19:16:59,269][106225] Updated weights for policy 1, policy_version 7183 (0.0008) [2023-12-27 19:16:59,334][106225] Updated weights for policy 1, policy_version 7193 (0.0008) [2023-12-27 19:16:59,731][106226] Updated weights for policy 0, policy_version 7236 (0.0008) [2023-12-27 19:16:59,779][106226] Updated weights for policy 0, policy_version 7246 (0.0005) [2023-12-27 19:16:59,831][106226] Updated weights for policy 0, policy_version 7256 (0.0007) [2023-12-27 19:17:00,042][106225] Updated weights for policy 1, policy_version 7203 (0.0009) [2023-12-27 19:17:00,101][106225] Updated weights for policy 1, policy_version 7213 (0.0011) [2023-12-27 19:17:00,162][106225] Updated weights for policy 1, policy_version 7223 (0.0010) [2023-12-27 19:17:00,523][106226] Updated weights for policy 0, policy_version 7266 (0.0008) [2023-12-27 19:17:00,582][106226] Updated weights for policy 0, policy_version 7276 (0.0009) [2023-12-27 19:17:00,633][106226] Updated weights for policy 0, policy_version 7286 (0.0009) [2023-12-27 19:17:00,686][106226] Updated weights for policy 0, policy_version 7296 (0.0009) [2023-12-27 19:17:00,779][106225] Updated weights for policy 1, policy_version 7233 (0.0008) [2023-12-27 19:17:00,827][106225] Updated weights for policy 1, policy_version 7243 (0.0006) [2023-12-27 19:17:00,873][106225] Updated weights for policy 1, policy_version 7253 (0.0005) [2023-12-27 19:17:00,918][106225] Updated weights for policy 1, policy_version 7263 (0.0005) [2023-12-27 19:17:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19617.7). Total num frames: 3727360. Throughput: 0: 9853.0, 1: 10010.2. Samples: 3714676. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:17:01,175][105115] Avg episode reward: [(0, '-8.593'), (1, '-9.246')] [2023-12-27 19:17:01,176][106141] Saving new best policy, reward=-9.246! [2023-12-27 19:17:01,555][106225] Updated weights for policy 1, policy_version 7273 (0.0007) [2023-12-27 19:17:01,575][106226] Updated weights for policy 0, policy_version 7306 (0.0006) [2023-12-27 19:17:01,622][106225] Updated weights for policy 1, policy_version 7283 (0.0008) [2023-12-27 19:17:01,634][106226] Updated weights for policy 0, policy_version 7316 (0.0008) [2023-12-27 19:17:01,684][106225] Updated weights for policy 1, policy_version 7293 (0.0007) [2023-12-27 19:17:01,696][106226] Updated weights for policy 0, policy_version 7326 (0.0008) [2023-12-27 19:17:02,370][106226] Updated weights for policy 0, policy_version 7336 (0.0010) [2023-12-27 19:17:02,387][106225] Updated weights for policy 1, policy_version 7303 (0.0008) [2023-12-27 19:17:02,430][106226] Updated weights for policy 0, policy_version 7346 (0.0011) [2023-12-27 19:17:02,447][106225] Updated weights for policy 1, policy_version 7313 (0.0010) [2023-12-27 19:17:02,493][106226] Updated weights for policy 0, policy_version 7356 (0.0010) [2023-12-27 19:17:02,500][106225] Updated weights for policy 1, policy_version 7323 (0.0010) [2023-12-27 19:17:03,180][106226] Updated weights for policy 0, policy_version 7366 (0.0010) [2023-12-27 19:17:03,199][106225] Updated weights for policy 1, policy_version 7333 (0.0010) [2023-12-27 19:17:03,239][106226] Updated weights for policy 0, policy_version 7376 (0.0010) [2023-12-27 19:17:03,248][106225] Updated weights for policy 1, policy_version 7343 (0.0010) [2023-12-27 19:17:03,288][106226] Updated weights for policy 0, policy_version 7386 (0.0010) [2023-12-27 19:17:03,298][106225] Updated weights for policy 1, policy_version 7353 (0.0010) [2023-12-27 19:17:03,921][106226] Updated weights for policy 0, policy_version 7396 (0.0010) [2023-12-27 19:17:03,927][106225] Updated weights for policy 1, policy_version 7363 (0.0010) [2023-12-27 19:17:03,982][106226] Updated weights for policy 0, policy_version 7406 (0.0011) [2023-12-27 19:17:03,990][106225] Updated weights for policy 1, policy_version 7373 (0.0009) [2023-12-27 19:17:04,043][106226] Updated weights for policy 0, policy_version 7416 (0.0010) [2023-12-27 19:17:04,049][106225] Updated weights for policy 1, policy_version 7383 (0.0010) [2023-12-27 19:17:04,632][106226] Updated weights for policy 0, policy_version 7426 (0.0009) [2023-12-27 19:17:04,701][106226] Updated weights for policy 0, policy_version 7436 (0.0011) [2023-12-27 19:17:04,759][106225] Updated weights for policy 1, policy_version 7393 (0.0008) [2023-12-27 19:17:04,763][106226] Updated weights for policy 0, policy_version 7446 (0.0010) [2023-12-27 19:17:04,806][106225] Updated weights for policy 1, policy_version 7403 (0.0010) [2023-12-27 19:17:04,813][106226] Updated weights for policy 0, policy_version 7456 (0.0011) [2023-12-27 19:17:04,855][106225] Updated weights for policy 1, policy_version 7413 (0.0010) [2023-12-27 19:17:04,908][106225] Updated weights for policy 1, policy_version 7423 (0.0010) [2023-12-27 19:17:05,490][106226] Updated weights for policy 0, policy_version 7466 (0.0010) [2023-12-27 19:17:05,544][106226] Updated weights for policy 0, policy_version 7476 (0.0010) [2023-12-27 19:17:05,608][106226] Updated weights for policy 0, policy_version 7486 (0.0010) [2023-12-27 19:17:05,634][106225] Updated weights for policy 1, policy_version 7433 (0.0006) [2023-12-27 19:17:05,685][106225] Updated weights for policy 1, policy_version 7443 (0.0006) [2023-12-27 19:17:05,744][106225] Updated weights for policy 1, policy_version 7453 (0.0007) [2023-12-27 19:17:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19618.8). Total num frames: 3825664. Throughput: 0: 9816.3, 1: 10066.6. Samples: 3836556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:17:06,175][105115] Avg episode reward: [(0, '-7.983'), (1, '-8.993')] [2023-12-27 19:17:06,176][106141] Saving new best policy, reward=-8.993! [2023-12-27 19:17:06,176][106140] Saving new best policy, reward=-7.983! [2023-12-27 19:17:06,325][106226] Updated weights for policy 0, policy_version 7496 (0.0009) [2023-12-27 19:17:06,384][106226] Updated weights for policy 0, policy_version 7506 (0.0008) [2023-12-27 19:17:06,415][106225] Updated weights for policy 1, policy_version 7463 (0.0007) [2023-12-27 19:17:06,444][106226] Updated weights for policy 0, policy_version 7516 (0.0008) [2023-12-27 19:17:06,471][106225] Updated weights for policy 1, policy_version 7473 (0.0007) [2023-12-27 19:17:06,530][106225] Updated weights for policy 1, policy_version 7483 (0.0007) [2023-12-27 19:17:07,183][106226] Updated weights for policy 0, policy_version 7526 (0.0008) [2023-12-27 19:17:07,193][106225] Updated weights for policy 1, policy_version 7493 (0.0007) [2023-12-27 19:17:07,242][106226] Updated weights for policy 0, policy_version 7536 (0.0006) [2023-12-27 19:17:07,249][106225] Updated weights for policy 1, policy_version 7503 (0.0007) [2023-12-27 19:17:07,296][106225] Updated weights for policy 1, policy_version 7513 (0.0008) [2023-12-27 19:17:07,298][106226] Updated weights for policy 0, policy_version 7546 (0.0006) [2023-12-27 19:17:07,944][106226] Updated weights for policy 0, policy_version 7556 (0.0006) [2023-12-27 19:17:08,009][106226] Updated weights for policy 0, policy_version 7566 (0.0008) [2023-12-27 19:17:08,078][106225] Updated weights for policy 1, policy_version 7523 (0.0006) [2023-12-27 19:17:08,078][106226] Updated weights for policy 0, policy_version 7576 (0.0009) [2023-12-27 19:17:08,136][106225] Updated weights for policy 1, policy_version 7533 (0.0006) [2023-12-27 19:17:08,200][106225] Updated weights for policy 1, policy_version 7543 (0.0009) [2023-12-27 19:17:08,736][106226] Updated weights for policy 0, policy_version 7586 (0.0007) [2023-12-27 19:17:08,793][106226] Updated weights for policy 0, policy_version 7596 (0.0009) [2023-12-27 19:17:08,842][106226] Updated weights for policy 0, policy_version 7606 (0.0008) [2023-12-27 19:17:08,894][106226] Updated weights for policy 0, policy_version 7616 (0.0007) [2023-12-27 19:17:08,976][106225] Updated weights for policy 1, policy_version 7553 (0.0009) [2023-12-27 19:17:09,032][106225] Updated weights for policy 1, policy_version 7563 (0.0008) [2023-12-27 19:17:09,080][106225] Updated weights for policy 1, policy_version 7573 (0.0008) [2023-12-27 19:17:09,129][106225] Updated weights for policy 1, policy_version 7583 (0.0008) [2023-12-27 19:17:09,669][106226] Updated weights for policy 0, policy_version 7626 (0.0011) [2023-12-27 19:17:09,729][106226] Updated weights for policy 0, policy_version 7636 (0.0009) [2023-12-27 19:17:09,796][106226] Updated weights for policy 0, policy_version 7646 (0.0009) [2023-12-27 19:17:09,863][106225] Updated weights for policy 1, policy_version 7593 (0.0008) [2023-12-27 19:17:09,942][106225] Updated weights for policy 1, policy_version 7603 (0.0009) [2023-12-27 19:17:10,007][106225] Updated weights for policy 1, policy_version 7613 (0.0006) [2023-12-27 19:17:10,549][106226] Updated weights for policy 0, policy_version 7656 (0.0009) [2023-12-27 19:17:10,611][106226] Updated weights for policy 0, policy_version 7666 (0.0009) [2023-12-27 19:17:10,675][106226] Updated weights for policy 0, policy_version 7676 (0.0007) [2023-12-27 19:17:10,700][106225] Updated weights for policy 1, policy_version 7623 (0.0006) [2023-12-27 19:17:10,769][106225] Updated weights for policy 1, policy_version 7633 (0.0005) [2023-12-27 19:17:10,836][106225] Updated weights for policy 1, policy_version 7643 (0.0010) [2023-12-27 19:17:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19619.8). Total num frames: 3923968. Throughput: 0: 9854.7, 1: 10086.5. Samples: 3895236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:17:11,175][105115] Avg episode reward: [(0, '-8.014'), (1, '-8.652')] [2023-12-27 19:17:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000007648_1957888.pth... [2023-12-27 19:17:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000007680_1966080.pth... [2023-12-27 19:17:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000006464_1654784.pth [2023-12-27 19:17:11,185][106141] Saving new best policy, reward=-8.652! [2023-12-27 19:17:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000006560_1679360.pth [2023-12-27 19:17:11,303][106226] Updated weights for policy 0, policy_version 7686 (0.0009) [2023-12-27 19:17:11,378][106226] Updated weights for policy 0, policy_version 7696 (0.0010) [2023-12-27 19:17:11,437][106226] Updated weights for policy 0, policy_version 7706 (0.0008) [2023-12-27 19:17:11,575][106225] Updated weights for policy 1, policy_version 7653 (0.0009) [2023-12-27 19:17:11,644][106225] Updated weights for policy 1, policy_version 7663 (0.0008) [2023-12-27 19:17:11,718][106225] Updated weights for policy 1, policy_version 7673 (0.0010) [2023-12-27 19:17:12,077][106226] Updated weights for policy 0, policy_version 7716 (0.0007) [2023-12-27 19:17:12,138][106226] Updated weights for policy 0, policy_version 7726 (0.0008) [2023-12-27 19:17:12,203][106226] Updated weights for policy 0, policy_version 7736 (0.0008) [2023-12-27 19:17:12,475][106225] Updated weights for policy 1, policy_version 7683 (0.0010) [2023-12-27 19:17:12,538][106225] Updated weights for policy 1, policy_version 7693 (0.0010) [2023-12-27 19:17:12,600][106225] Updated weights for policy 1, policy_version 7703 (0.0010) [2023-12-27 19:17:12,975][106226] Updated weights for policy 0, policy_version 7746 (0.0009) [2023-12-27 19:17:13,032][106226] Updated weights for policy 0, policy_version 7756 (0.0010) [2023-12-27 19:17:13,081][106226] Updated weights for policy 0, policy_version 7766 (0.0008) [2023-12-27 19:17:13,143][106226] Updated weights for policy 0, policy_version 7776 (0.0006) [2023-12-27 19:17:13,272][106225] Updated weights for policy 1, policy_version 7713 (0.0010) [2023-12-27 19:17:13,327][106225] Updated weights for policy 1, policy_version 7723 (0.0010) [2023-12-27 19:17:13,387][106225] Updated weights for policy 1, policy_version 7733 (0.0010) [2023-12-27 19:17:13,438][106225] Updated weights for policy 1, policy_version 7743 (0.0005) [2023-12-27 19:17:13,935][106226] Updated weights for policy 0, policy_version 7786 (0.0007) [2023-12-27 19:17:13,971][106225] Updated weights for policy 1, policy_version 7753 (0.0005) [2023-12-27 19:17:13,989][106226] Updated weights for policy 0, policy_version 7796 (0.0008) [2023-12-27 19:17:14,025][106225] Updated weights for policy 1, policy_version 7763 (0.0005) [2023-12-27 19:17:14,044][106226] Updated weights for policy 0, policy_version 7806 (0.0008) [2023-12-27 19:17:14,082][106225] Updated weights for policy 1, policy_version 7773 (0.0007) [2023-12-27 19:17:14,733][106226] Updated weights for policy 0, policy_version 7816 (0.0007) [2023-12-27 19:17:14,761][106225] Updated weights for policy 1, policy_version 7783 (0.0011) [2023-12-27 19:17:14,802][106226] Updated weights for policy 0, policy_version 7826 (0.0008) [2023-12-27 19:17:14,825][106225] Updated weights for policy 1, policy_version 7793 (0.0009) [2023-12-27 19:17:14,865][106226] Updated weights for policy 0, policy_version 7836 (0.0009) [2023-12-27 19:17:14,887][106225] Updated weights for policy 1, policy_version 7803 (0.0010) [2023-12-27 19:17:15,494][106226] Updated weights for policy 0, policy_version 7846 (0.0006) [2023-12-27 19:17:15,553][106226] Updated weights for policy 0, policy_version 7856 (0.0008) [2023-12-27 19:17:15,607][106226] Updated weights for policy 0, policy_version 7866 (0.0007) [2023-12-27 19:17:15,624][106225] Updated weights for policy 1, policy_version 7813 (0.0010) [2023-12-27 19:17:15,680][106225] Updated weights for policy 1, policy_version 7823 (0.0010) [2023-12-27 19:17:15,749][106225] Updated weights for policy 1, policy_version 7833 (0.0009) [2023-12-27 19:17:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19620.8). Total num frames: 4022272. Throughput: 0: 9763.3, 1: 9951.7. Samples: 4012856. Policy #0 lag: (min: 14.0, avg: 23.3, max: 46.0) [2023-12-27 19:17:16,175][105115] Avg episode reward: [(0, '-7.863'), (1, '-8.762')] [2023-12-27 19:17:16,176][106140] Saving new best policy, reward=-7.863! [2023-12-27 19:17:16,229][106226] Updated weights for policy 0, policy_version 7876 (0.0006) [2023-12-27 19:17:16,282][106226] Updated weights for policy 0, policy_version 7886 (0.0005) [2023-12-27 19:17:16,333][106226] Updated weights for policy 0, policy_version 7896 (0.0006) [2023-12-27 19:17:16,400][106225] Updated weights for policy 1, policy_version 7843 (0.0010) [2023-12-27 19:17:16,454][106225] Updated weights for policy 1, policy_version 7853 (0.0010) [2023-12-27 19:17:16,513][106225] Updated weights for policy 1, policy_version 7863 (0.0010) [2023-12-27 19:17:17,027][106226] Updated weights for policy 0, policy_version 7906 (0.0006) [2023-12-27 19:17:17,088][106226] Updated weights for policy 0, policy_version 7916 (0.0008) [2023-12-27 19:17:17,148][106226] Updated weights for policy 0, policy_version 7926 (0.0008) [2023-12-27 19:17:17,188][106225] Updated weights for policy 1, policy_version 7873 (0.0010) [2023-12-27 19:17:17,202][106226] Updated weights for policy 0, policy_version 7936 (0.0007) [2023-12-27 19:17:17,238][106225] Updated weights for policy 1, policy_version 7883 (0.0010) [2023-12-27 19:17:17,290][106225] Updated weights for policy 1, policy_version 7893 (0.0010) [2023-12-27 19:17:17,343][106225] Updated weights for policy 1, policy_version 7903 (0.0010) [2023-12-27 19:17:17,937][106226] Updated weights for policy 0, policy_version 7946 (0.0007) [2023-12-27 19:17:17,985][106226] Updated weights for policy 0, policy_version 7956 (0.0007) [2023-12-27 19:17:18,035][106226] Updated weights for policy 0, policy_version 7966 (0.0008) [2023-12-27 19:17:18,046][106225] Updated weights for policy 1, policy_version 7913 (0.0006) [2023-12-27 19:17:18,097][106225] Updated weights for policy 1, policy_version 7923 (0.0006) [2023-12-27 19:17:18,148][106225] Updated weights for policy 1, policy_version 7933 (0.0006) [2023-12-27 19:17:18,787][106225] Updated weights for policy 1, policy_version 7943 (0.0008) [2023-12-27 19:17:18,850][106225] Updated weights for policy 1, policy_version 7953 (0.0008) [2023-12-27 19:17:18,853][106226] Updated weights for policy 0, policy_version 7976 (0.0007) [2023-12-27 19:17:18,908][106225] Updated weights for policy 1, policy_version 7963 (0.0006) [2023-12-27 19:17:18,920][106226] Updated weights for policy 0, policy_version 7986 (0.0008) [2023-12-27 19:17:18,992][106226] Updated weights for policy 0, policy_version 7996 (0.0009) [2023-12-27 19:17:19,667][106226] Updated weights for policy 0, policy_version 8006 (0.0006) [2023-12-27 19:17:19,715][106225] Updated weights for policy 1, policy_version 7973 (0.0008) [2023-12-27 19:17:19,733][106226] Updated weights for policy 0, policy_version 8016 (0.0006) [2023-12-27 19:17:19,771][106225] Updated weights for policy 1, policy_version 7983 (0.0006) [2023-12-27 19:17:19,797][106226] Updated weights for policy 0, policy_version 8026 (0.0006) [2023-12-27 19:17:19,831][106225] Updated weights for policy 1, policy_version 7993 (0.0007) [2023-12-27 19:17:20,500][106226] Updated weights for policy 0, policy_version 8036 (0.0008) [2023-12-27 19:17:20,556][106226] Updated weights for policy 0, policy_version 8046 (0.0009) [2023-12-27 19:17:20,598][106225] Updated weights for policy 1, policy_version 8003 (0.0009) [2023-12-27 19:17:20,619][106226] Updated weights for policy 0, policy_version 8056 (0.0008) [2023-12-27 19:17:20,657][106225] Updated weights for policy 1, policy_version 8013 (0.0008) [2023-12-27 19:17:20,721][106225] Updated weights for policy 1, policy_version 8023 (0.0008) [2023-12-27 19:17:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19621.8). Total num frames: 4120576. Throughput: 0: 9734.4, 1: 9922.4. Samples: 4130332. Policy #0 lag: (min: 1.0, avg: 18.5, max: 33.0) [2023-12-27 19:17:21,175][105115] Avg episode reward: [(0, '-7.435'), (1, '-8.472')] [2023-12-27 19:17:21,176][106140] Saving new best policy, reward=-7.435! [2023-12-27 19:17:21,176][106141] Saving new best policy, reward=-8.472! [2023-12-27 19:17:21,427][106226] Updated weights for policy 0, policy_version 8066 (0.0008) [2023-12-27 19:17:21,488][106226] Updated weights for policy 0, policy_version 8076 (0.0009) [2023-12-27 19:17:21,527][106225] Updated weights for policy 1, policy_version 8033 (0.0008) [2023-12-27 19:17:21,552][106226] Updated weights for policy 0, policy_version 8086 (0.0007) [2023-12-27 19:17:21,596][106225] Updated weights for policy 1, policy_version 8043 (0.0010) [2023-12-27 19:17:21,620][106226] Updated weights for policy 0, policy_version 8096 (0.0007) [2023-12-27 19:17:21,669][106225] Updated weights for policy 1, policy_version 8053 (0.0009) [2023-12-27 19:17:21,739][106225] Updated weights for policy 1, policy_version 8063 (0.0012) [2023-12-27 19:17:22,295][106226] Updated weights for policy 0, policy_version 8106 (0.0009) [2023-12-27 19:17:22,347][106226] Updated weights for policy 0, policy_version 8116 (0.0008) [2023-12-27 19:17:22,412][106226] Updated weights for policy 0, policy_version 8126 (0.0008) [2023-12-27 19:17:22,522][106225] Updated weights for policy 1, policy_version 8073 (0.0009) [2023-12-27 19:17:22,586][106225] Updated weights for policy 1, policy_version 8083 (0.0008) [2023-12-27 19:17:22,643][106225] Updated weights for policy 1, policy_version 8093 (0.0009) [2023-12-27 19:17:23,151][106226] Updated weights for policy 0, policy_version 8136 (0.0011) [2023-12-27 19:17:23,217][106226] Updated weights for policy 0, policy_version 8146 (0.0008) [2023-12-27 19:17:23,273][106226] Updated weights for policy 0, policy_version 8156 (0.0008) [2023-12-27 19:17:23,384][106225] Updated weights for policy 1, policy_version 8103 (0.0009) [2023-12-27 19:17:23,440][106225] Updated weights for policy 1, policy_version 8113 (0.0006) [2023-12-27 19:17:23,503][106225] Updated weights for policy 1, policy_version 8123 (0.0006) [2023-12-27 19:17:24,005][106226] Updated weights for policy 0, policy_version 8166 (0.0007) [2023-12-27 19:17:24,059][106226] Updated weights for policy 0, policy_version 8176 (0.0006) [2023-12-27 19:17:24,110][106226] Updated weights for policy 0, policy_version 8186 (0.0010) [2023-12-27 19:17:24,178][106225] Updated weights for policy 1, policy_version 8133 (0.0008) [2023-12-27 19:17:24,232][106225] Updated weights for policy 1, policy_version 8143 (0.0010) [2023-12-27 19:17:24,285][106225] Updated weights for policy 1, policy_version 8153 (0.0010) [2023-12-27 19:17:24,705][106226] Updated weights for policy 0, policy_version 8196 (0.0008) [2023-12-27 19:17:24,753][106226] Updated weights for policy 0, policy_version 8206 (0.0005) [2023-12-27 19:17:24,802][106226] Updated weights for policy 0, policy_version 8216 (0.0008) [2023-12-27 19:17:25,010][106225] Updated weights for policy 1, policy_version 8163 (0.0010) [2023-12-27 19:17:25,074][106225] Updated weights for policy 1, policy_version 8173 (0.0010) [2023-12-27 19:17:25,139][106225] Updated weights for policy 1, policy_version 8183 (0.0009) [2023-12-27 19:17:25,407][106226] Updated weights for policy 0, policy_version 8226 (0.0009) [2023-12-27 19:17:25,469][106226] Updated weights for policy 0, policy_version 8236 (0.0010) [2023-12-27 19:17:25,523][106226] Updated weights for policy 0, policy_version 8246 (0.0010) [2023-12-27 19:17:25,582][106226] Updated weights for policy 0, policy_version 8256 (0.0010) [2023-12-27 19:17:25,741][106225] Updated weights for policy 1, policy_version 8193 (0.0006) [2023-12-27 19:17:25,801][106225] Updated weights for policy 1, policy_version 8203 (0.0010) [2023-12-27 19:17:25,849][106225] Updated weights for policy 1, policy_version 8213 (0.0007) [2023-12-27 19:17:25,904][106225] Updated weights for policy 1, policy_version 8223 (0.0006) [2023-12-27 19:17:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19622.7). Total num frames: 4218880. Throughput: 0: 9712.7, 1: 9897.8. Samples: 4186520. Policy #0 lag: (min: 1.0, avg: 18.5, max: 33.0) [2023-12-27 19:17:26,175][105115] Avg episode reward: [(0, '-7.239'), (1, '-8.327')] [2023-12-27 19:17:26,178][106226] Updated weights for policy 0, policy_version 8266 (0.0010) [2023-12-27 19:17:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000008224_2105344.pth... [2023-12-27 19:17:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000007072_1810432.pth [2023-12-27 19:17:26,185][106141] Saving new best policy, reward=-8.327! [2023-12-27 19:17:26,224][106226] Updated weights for policy 0, policy_version 8276 (0.0009) [2023-12-27 19:17:26,273][106226] Updated weights for policy 0, policy_version 8286 (0.0005) [2023-12-27 19:17:26,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000008288_2121728.pth... [2023-12-27 19:17:26,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000007104_1818624.pth [2023-12-27 19:17:26,285][106140] Saving new best policy, reward=-7.239! [2023-12-27 19:17:26,545][106225] Updated weights for policy 1, policy_version 8233 (0.0010) [2023-12-27 19:17:26,603][106225] Updated weights for policy 1, policy_version 8243 (0.0010) [2023-12-27 19:17:26,659][106225] Updated weights for policy 1, policy_version 8253 (0.0010) [2023-12-27 19:17:26,887][106226] Updated weights for policy 0, policy_version 8296 (0.0005) [2023-12-27 19:17:26,939][106226] Updated weights for policy 0, policy_version 8306 (0.0005) [2023-12-27 19:17:26,998][106226] Updated weights for policy 0, policy_version 8316 (0.0007) [2023-12-27 19:17:27,380][106225] Updated weights for policy 1, policy_version 8263 (0.0007) [2023-12-27 19:17:27,437][106225] Updated weights for policy 1, policy_version 8273 (0.0005) [2023-12-27 19:17:27,495][106225] Updated weights for policy 1, policy_version 8283 (0.0005) [2023-12-27 19:17:27,522][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000005 [2023-12-27 19:17:27,686][106226] Updated weights for policy 0, policy_version 8326 (0.0009) [2023-12-27 19:17:27,741][106226] Updated weights for policy 0, policy_version 8336 (0.0005) [2023-12-27 19:17:27,794][106226] Updated weights for policy 0, policy_version 8346 (0.0005) [2023-12-27 19:17:28,077][106225] Updated weights for policy 1, policy_version 8293 (0.0008) [2023-12-27 19:17:28,123][106225] Updated weights for policy 1, policy_version 8303 (0.0010) [2023-12-27 19:17:28,176][106225] Updated weights for policy 1, policy_version 8313 (0.0010) [2023-12-27 19:17:28,394][106226] Updated weights for policy 0, policy_version 8356 (0.0009) [2023-12-27 19:17:28,459][106226] Updated weights for policy 0, policy_version 8366 (0.0011) [2023-12-27 19:17:28,519][106226] Updated weights for policy 0, policy_version 8376 (0.0010) [2023-12-27 19:17:28,933][106225] Updated weights for policy 1, policy_version 8323 (0.0010) [2023-12-27 19:17:28,982][106225] Updated weights for policy 1, policy_version 8333 (0.0010) [2023-12-27 19:17:29,034][106225] Updated weights for policy 1, policy_version 8343 (0.0010) [2023-12-27 19:17:29,208][106226] Updated weights for policy 0, policy_version 8386 (0.0011) [2023-12-27 19:17:29,278][106226] Updated weights for policy 0, policy_version 8396 (0.0008) [2023-12-27 19:17:29,346][106226] Updated weights for policy 0, policy_version 8406 (0.0009) [2023-12-27 19:17:29,411][106226] Updated weights for policy 0, policy_version 8416 (0.0009) [2023-12-27 19:17:29,693][106225] Updated weights for policy 1, policy_version 8353 (0.0010) [2023-12-27 19:17:29,757][106225] Updated weights for policy 1, policy_version 8363 (0.0009) [2023-12-27 19:17:29,819][106225] Updated weights for policy 1, policy_version 8373 (0.0007) [2023-12-27 19:17:29,884][106225] Updated weights for policy 1, policy_version 8383 (0.0007) [2023-12-27 19:17:30,125][106226] Updated weights for policy 0, policy_version 8426 (0.0008) [2023-12-27 19:17:30,183][106226] Updated weights for policy 0, policy_version 8436 (0.0008) [2023-12-27 19:17:30,233][106226] Updated weights for policy 0, policy_version 8446 (0.0008) [2023-12-27 19:17:30,609][106225] Updated weights for policy 1, policy_version 8393 (0.0005) [2023-12-27 19:17:30,675][106225] Updated weights for policy 1, policy_version 8403 (0.0007) [2023-12-27 19:17:30,733][106225] Updated weights for policy 1, policy_version 8413 (0.0007) [2023-12-27 19:17:30,907][106226] Updated weights for policy 0, policy_version 8456 (0.0010) [2023-12-27 19:17:30,963][106226] Updated weights for policy 0, policy_version 8466 (0.0010) [2023-12-27 19:17:31,019][106226] Updated weights for policy 0, policy_version 8476 (0.0010) [2023-12-27 19:17:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 4325376. Throughput: 0: 9906.7, 1: 9982.9. Samples: 4312812. Policy #0 lag: (min: 18.0, avg: 38.3, max: 40.0) [2023-12-27 19:17:31,175][105115] Avg episode reward: [(0, '-7.169'), (1, '-8.592')] [2023-12-27 19:17:31,176][106140] Saving new best policy, reward=-7.169! [2023-12-27 19:17:31,366][106225] Updated weights for policy 1, policy_version 8423 (0.0007) [2023-12-27 19:17:31,428][106225] Updated weights for policy 1, policy_version 8433 (0.0008) [2023-12-27 19:17:31,479][106225] Updated weights for policy 1, policy_version 8443 (0.0008) [2023-12-27 19:17:31,758][106226] Updated weights for policy 0, policy_version 8486 (0.0009) [2023-12-27 19:17:31,814][106226] Updated weights for policy 0, policy_version 8496 (0.0011) [2023-12-27 19:17:31,869][106226] Updated weights for policy 0, policy_version 8506 (0.0011) [2023-12-27 19:17:32,281][106225] Updated weights for policy 1, policy_version 8453 (0.0008) [2023-12-27 19:17:32,342][106225] Updated weights for policy 1, policy_version 8463 (0.0008) [2023-12-27 19:17:32,403][106225] Updated weights for policy 1, policy_version 8473 (0.0007) [2023-12-27 19:17:32,583][106226] Updated weights for policy 0, policy_version 8516 (0.0008) [2023-12-27 19:17:32,634][106226] Updated weights for policy 0, policy_version 8526 (0.0007) [2023-12-27 19:17:32,688][106226] Updated weights for policy 0, policy_version 8536 (0.0009) [2023-12-27 19:17:33,076][106225] Updated weights for policy 1, policy_version 8483 (0.0008) [2023-12-27 19:17:33,134][106225] Updated weights for policy 1, policy_version 8493 (0.0010) [2023-12-27 19:17:33,190][106225] Updated weights for policy 1, policy_version 8503 (0.0010) [2023-12-27 19:17:33,390][106226] Updated weights for policy 0, policy_version 8546 (0.0007) [2023-12-27 19:17:33,437][106226] Updated weights for policy 0, policy_version 8556 (0.0008) [2023-12-27 19:17:33,480][106226] Updated weights for policy 0, policy_version 8566 (0.0008) [2023-12-27 19:17:33,531][106226] Updated weights for policy 0, policy_version 8576 (0.0007) [2023-12-27 19:17:33,848][106225] Updated weights for policy 1, policy_version 8513 (0.0010) [2023-12-27 19:17:33,898][106225] Updated weights for policy 1, policy_version 8523 (0.0005) [2023-12-27 19:17:33,949][106225] Updated weights for policy 1, policy_version 8533 (0.0005) [2023-12-27 19:17:33,999][106225] Updated weights for policy 1, policy_version 8543 (0.0005) [2023-12-27 19:17:34,319][106226] Updated weights for policy 0, policy_version 8586 (0.0008) [2023-12-27 19:17:34,385][106226] Updated weights for policy 0, policy_version 8596 (0.0008) [2023-12-27 19:17:34,440][106226] Updated weights for policy 0, policy_version 8606 (0.0007) [2023-12-27 19:17:34,666][106225] Updated weights for policy 1, policy_version 8553 (0.0005) [2023-12-27 19:17:34,728][106225] Updated weights for policy 1, policy_version 8563 (0.0005) [2023-12-27 19:17:34,788][106225] Updated weights for policy 1, policy_version 8573 (0.0005) [2023-12-27 19:17:35,225][106226] Updated weights for policy 0, policy_version 8616 (0.0008) [2023-12-27 19:17:35,271][106226] Updated weights for policy 0, policy_version 8626 (0.0008) [2023-12-27 19:17:35,322][106226] Updated weights for policy 0, policy_version 8636 (0.0008) [2023-12-27 19:17:35,409][106225] Updated weights for policy 1, policy_version 8583 (0.0009) [2023-12-27 19:17:35,456][106225] Updated weights for policy 1, policy_version 8593 (0.0009) [2023-12-27 19:17:35,509][106225] Updated weights for policy 1, policy_version 8603 (0.0006) [2023-12-27 19:17:36,020][106226] Updated weights for policy 0, policy_version 8646 (0.0006) [2023-12-27 19:17:36,081][106226] Updated weights for policy 0, policy_version 8656 (0.0007) [2023-12-27 19:17:36,148][106226] Updated weights for policy 0, policy_version 8666 (0.0009) [2023-12-27 19:17:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19624.4). Total num frames: 4415488. Throughput: 0: 9897.9, 1: 9990.6. Samples: 4431108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:17:36,175][105115] Avg episode reward: [(0, '-7.200'), (1, '-7.840')] [2023-12-27 19:17:36,176][106141] Saving new best policy, reward=-7.840! [2023-12-27 19:17:36,259][106225] Updated weights for policy 1, policy_version 8613 (0.0007) [2023-12-27 19:17:36,326][106225] Updated weights for policy 1, policy_version 8623 (0.0009) [2023-12-27 19:17:36,390][106225] Updated weights for policy 1, policy_version 8633 (0.0008) [2023-12-27 19:17:36,825][106226] Updated weights for policy 0, policy_version 8676 (0.0009) [2023-12-27 19:17:36,881][106226] Updated weights for policy 0, policy_version 8686 (0.0008) [2023-12-27 19:17:36,944][106226] Updated weights for policy 0, policy_version 8696 (0.0009) [2023-12-27 19:17:37,145][106225] Updated weights for policy 1, policy_version 8643 (0.0009) [2023-12-27 19:17:37,210][106225] Updated weights for policy 1, policy_version 8653 (0.0009) [2023-12-27 19:17:37,272][106225] Updated weights for policy 1, policy_version 8663 (0.0008) [2023-12-27 19:17:37,579][106226] Updated weights for policy 0, policy_version 8706 (0.0008) [2023-12-27 19:17:37,634][106226] Updated weights for policy 0, policy_version 8716 (0.0008) [2023-12-27 19:17:37,696][106226] Updated weights for policy 0, policy_version 8726 (0.0008) [2023-12-27 19:17:37,759][106226] Updated weights for policy 0, policy_version 8736 (0.0008) [2023-12-27 19:17:38,031][106225] Updated weights for policy 1, policy_version 8673 (0.0008) [2023-12-27 19:17:38,092][106225] Updated weights for policy 1, policy_version 8683 (0.0007) [2023-12-27 19:17:38,149][106225] Updated weights for policy 1, policy_version 8693 (0.0007) [2023-12-27 19:17:38,202][106225] Updated weights for policy 1, policy_version 8703 (0.0008) [2023-12-27 19:17:38,416][106226] Updated weights for policy 0, policy_version 8746 (0.0009) [2023-12-27 19:17:38,465][106226] Updated weights for policy 0, policy_version 8756 (0.0007) [2023-12-27 19:17:38,525][106226] Updated weights for policy 0, policy_version 8766 (0.0008) [2023-12-27 19:17:38,856][106225] Updated weights for policy 1, policy_version 8713 (0.0008) [2023-12-27 19:17:38,907][106225] Updated weights for policy 1, policy_version 8723 (0.0009) [2023-12-27 19:17:38,960][106225] Updated weights for policy 1, policy_version 8733 (0.0008) [2023-12-27 19:17:39,269][106226] Updated weights for policy 0, policy_version 8776 (0.0010) [2023-12-27 19:17:39,331][106226] Updated weights for policy 0, policy_version 8786 (0.0010) [2023-12-27 19:17:39,397][106226] Updated weights for policy 0, policy_version 8796 (0.0011) [2023-12-27 19:17:39,721][106225] Updated weights for policy 1, policy_version 8743 (0.0007) [2023-12-27 19:17:39,777][106225] Updated weights for policy 1, policy_version 8753 (0.0010) [2023-12-27 19:17:39,830][106225] Updated weights for policy 1, policy_version 8763 (0.0008) [2023-12-27 19:17:40,140][106226] Updated weights for policy 0, policy_version 8806 (0.0008) [2023-12-27 19:17:40,197][106226] Updated weights for policy 0, policy_version 8816 (0.0009) [2023-12-27 19:17:40,256][106226] Updated weights for policy 0, policy_version 8826 (0.0008) [2023-12-27 19:17:40,558][106225] Updated weights for policy 1, policy_version 8773 (0.0008) [2023-12-27 19:17:40,611][106225] Updated weights for policy 1, policy_version 8783 (0.0008) [2023-12-27 19:17:40,667][106225] Updated weights for policy 1, policy_version 8793 (0.0007) [2023-12-27 19:17:41,054][106226] Updated weights for policy 0, policy_version 8836 (0.0008) [2023-12-27 19:17:41,120][106226] Updated weights for policy 0, policy_version 8846 (0.0006) [2023-12-27 19:17:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19625.2). Total num frames: 4513792. Throughput: 0: 9926.3, 1: 9972.0. Samples: 4489196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:17:41,175][105115] Avg episode reward: [(0, '-7.415'), (1, '-8.124')] [2023-12-27 19:17:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000008800_2252800.pth... [2023-12-27 19:17:41,188][106226] Updated weights for policy 0, policy_version 8856 (0.0007) [2023-12-27 19:17:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000007648_1957888.pth [2023-12-27 19:17:41,244][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000008864_2269184.pth... [2023-12-27 19:17:41,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000007680_1966080.pth [2023-12-27 19:17:41,433][106225] Updated weights for policy 1, policy_version 8803 (0.0008) [2023-12-27 19:17:41,498][106225] Updated weights for policy 1, policy_version 8813 (0.0008) [2023-12-27 19:17:41,561][106225] Updated weights for policy 1, policy_version 8823 (0.0007) [2023-12-27 19:17:41,961][106226] Updated weights for policy 0, policy_version 8866 (0.0010) [2023-12-27 19:17:42,020][106226] Updated weights for policy 0, policy_version 8876 (0.0009) [2023-12-27 19:17:42,086][106226] Updated weights for policy 0, policy_version 8886 (0.0008) [2023-12-27 19:17:42,154][106226] Updated weights for policy 0, policy_version 8896 (0.0010) [2023-12-27 19:17:42,277][106225] Updated weights for policy 1, policy_version 8833 (0.0009) [2023-12-27 19:17:42,346][106225] Updated weights for policy 1, policy_version 8843 (0.0007) [2023-12-27 19:17:42,418][106225] Updated weights for policy 1, policy_version 8853 (0.0008) [2023-12-27 19:17:42,481][106225] Updated weights for policy 1, policy_version 8863 (0.0008) [2023-12-27 19:17:42,880][106226] Updated weights for policy 0, policy_version 8906 (0.0011) [2023-12-27 19:17:42,937][106226] Updated weights for policy 0, policy_version 8916 (0.0008) [2023-12-27 19:17:42,992][106226] Updated weights for policy 0, policy_version 8926 (0.0009) [2023-12-27 19:17:43,261][106225] Updated weights for policy 1, policy_version 8873 (0.0009) [2023-12-27 19:17:43,328][106225] Updated weights for policy 1, policy_version 8883 (0.0008) [2023-12-27 19:17:43,380][106225] Updated weights for policy 1, policy_version 8893 (0.0008) [2023-12-27 19:17:43,658][106226] Updated weights for policy 0, policy_version 8936 (0.0006) [2023-12-27 19:17:43,714][106226] Updated weights for policy 0, policy_version 8946 (0.0005) [2023-12-27 19:17:43,768][106226] Updated weights for policy 0, policy_version 8956 (0.0005) [2023-12-27 19:17:44,048][106225] Updated weights for policy 1, policy_version 8903 (0.0006) [2023-12-27 19:17:44,112][106225] Updated weights for policy 1, policy_version 8913 (0.0005) [2023-12-27 19:17:44,169][106225] Updated weights for policy 1, policy_version 8923 (0.0008) [2023-12-27 19:17:44,444][106226] Updated weights for policy 0, policy_version 8966 (0.0008) [2023-12-27 19:17:44,505][106226] Updated weights for policy 0, policy_version 8976 (0.0007) [2023-12-27 19:17:44,567][106226] Updated weights for policy 0, policy_version 8986 (0.0009) [2023-12-27 19:17:44,826][106225] Updated weights for policy 1, policy_version 8933 (0.0008) [2023-12-27 19:17:44,882][106225] Updated weights for policy 1, policy_version 8943 (0.0008) [2023-12-27 19:17:44,940][106225] Updated weights for policy 1, policy_version 8953 (0.0008) [2023-12-27 19:17:45,231][106226] Updated weights for policy 0, policy_version 8996 (0.0011) [2023-12-27 19:17:45,303][106226] Updated weights for policy 0, policy_version 9006 (0.0006) [2023-12-27 19:17:45,365][106226] Updated weights for policy 0, policy_version 9016 (0.0006) [2023-12-27 19:17:45,739][106225] Updated weights for policy 1, policy_version 8963 (0.0009) [2023-12-27 19:17:45,792][106225] Updated weights for policy 1, policy_version 8973 (0.0008) [2023-12-27 19:17:45,845][106225] Updated weights for policy 1, policy_version 8983 (0.0008) [2023-12-27 19:17:45,972][106226] Updated weights for policy 0, policy_version 9026 (0.0008) [2023-12-27 19:17:46,040][106226] Updated weights for policy 0, policy_version 9036 (0.0006) [2023-12-27 19:17:46,101][106226] Updated weights for policy 0, policy_version 9046 (0.0005) [2023-12-27 19:17:46,165][106226] Updated weights for policy 0, policy_version 9056 (0.0005) [2023-12-27 19:17:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 4620288. Throughput: 0: 9903.6, 1: 9879.9. Samples: 4604936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:17:46,176][105115] Avg episode reward: [(0, '-6.887'), (1, '-7.538')] [2023-12-27 19:17:46,177][106140] Saving new best policy, reward=-6.887! [2023-12-27 19:17:46,177][106141] Saving new best policy, reward=-7.538! [2023-12-27 19:17:46,637][106225] Updated weights for policy 1, policy_version 8993 (0.0008) [2023-12-27 19:17:46,691][106225] Updated weights for policy 1, policy_version 9003 (0.0009) [2023-12-27 19:17:46,731][106226] Updated weights for policy 0, policy_version 9066 (0.0005) [2023-12-27 19:17:46,740][106225] Updated weights for policy 1, policy_version 9013 (0.0008) [2023-12-27 19:17:46,775][106226] Updated weights for policy 0, policy_version 9076 (0.0006) [2023-12-27 19:17:46,789][106225] Updated weights for policy 1, policy_version 9023 (0.0006) [2023-12-27 19:17:46,829][106226] Updated weights for policy 0, policy_version 9086 (0.0008) [2023-12-27 19:17:47,440][106226] Updated weights for policy 0, policy_version 9096 (0.0006) [2023-12-27 19:17:47,511][106226] Updated weights for policy 0, policy_version 9106 (0.0005) [2023-12-27 19:17:47,568][106226] Updated weights for policy 0, policy_version 9116 (0.0008) [2023-12-27 19:17:47,579][106225] Updated weights for policy 1, policy_version 9033 (0.0007) [2023-12-27 19:17:47,637][106225] Updated weights for policy 1, policy_version 9043 (0.0008) [2023-12-27 19:17:47,688][106225] Updated weights for policy 1, policy_version 9053 (0.0005) [2023-12-27 19:17:48,260][106226] Updated weights for policy 0, policy_version 9126 (0.0009) [2023-12-27 19:17:48,308][106226] Updated weights for policy 0, policy_version 9136 (0.0008) [2023-12-27 19:17:48,356][106225] Updated weights for policy 1, policy_version 9063 (0.0008) [2023-12-27 19:17:48,371][106226] Updated weights for policy 0, policy_version 9146 (0.0008) [2023-12-27 19:17:48,412][106225] Updated weights for policy 1, policy_version 9073 (0.0008) [2023-12-27 19:17:48,467][106225] Updated weights for policy 1, policy_version 9083 (0.0008) [2023-12-27 19:17:48,974][106226] Updated weights for policy 0, policy_version 9156 (0.0006) [2023-12-27 19:17:49,048][106226] Updated weights for policy 0, policy_version 9166 (0.0005) [2023-12-27 19:17:49,123][106226] Updated weights for policy 0, policy_version 9176 (0.0005) [2023-12-27 19:17:49,195][106225] Updated weights for policy 1, policy_version 9093 (0.0008) [2023-12-27 19:17:49,258][106225] Updated weights for policy 1, policy_version 9103 (0.0010) [2023-12-27 19:17:49,318][106225] Updated weights for policy 1, policy_version 9113 (0.0010) [2023-12-27 19:17:49,694][106226] Updated weights for policy 0, policy_version 9186 (0.0006) [2023-12-27 19:17:49,761][106226] Updated weights for policy 0, policy_version 9196 (0.0008) [2023-12-27 19:17:49,843][106226] Updated weights for policy 0, policy_version 9206 (0.0010) [2023-12-27 19:17:49,909][106226] Updated weights for policy 0, policy_version 9216 (0.0009) [2023-12-27 19:17:49,996][106225] Updated weights for policy 1, policy_version 9123 (0.0008) [2023-12-27 19:17:50,057][106225] Updated weights for policy 1, policy_version 9133 (0.0006) [2023-12-27 19:17:50,117][106225] Updated weights for policy 1, policy_version 9143 (0.0006) [2023-12-27 19:17:50,669][106226] Updated weights for policy 0, policy_version 9226 (0.0006) [2023-12-27 19:17:50,735][106226] Updated weights for policy 0, policy_version 9236 (0.0006) [2023-12-27 19:17:50,747][106225] Updated weights for policy 1, policy_version 9153 (0.0006) [2023-12-27 19:17:50,800][106226] Updated weights for policy 0, policy_version 9246 (0.0006) [2023-12-27 19:17:50,807][106225] Updated weights for policy 1, policy_version 9163 (0.0008) [2023-12-27 19:17:50,866][106225] Updated weights for policy 1, policy_version 9173 (0.0008) [2023-12-27 19:17:50,933][106225] Updated weights for policy 1, policy_version 9183 (0.0008) [2023-12-27 19:17:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 4718592. Throughput: 0: 9987.6, 1: 9799.7. Samples: 4726984. Policy #0 lag: (min: 17.0, avg: 32.0, max: 49.0) [2023-12-27 19:17:51,175][105115] Avg episode reward: [(0, '-6.994'), (1, '-7.381')] [2023-12-27 19:17:51,176][106141] Saving new best policy, reward=-7.381! [2023-12-27 19:17:51,429][106226] Updated weights for policy 0, policy_version 9256 (0.0007) [2023-12-27 19:17:51,486][106226] Updated weights for policy 0, policy_version 9266 (0.0008) [2023-12-27 19:17:51,541][106226] Updated weights for policy 0, policy_version 9276 (0.0008) [2023-12-27 19:17:51,698][106225] Updated weights for policy 1, policy_version 9193 (0.0011) [2023-12-27 19:17:51,771][106225] Updated weights for policy 1, policy_version 9203 (0.0009) [2023-12-27 19:17:51,816][106225] Updated weights for policy 1, policy_version 9213 (0.0008) [2023-12-27 19:17:52,289][106226] Updated weights for policy 0, policy_version 9286 (0.0009) [2023-12-27 19:17:52,353][106226] Updated weights for policy 0, policy_version 9296 (0.0011) [2023-12-27 19:17:52,423][106226] Updated weights for policy 0, policy_version 9306 (0.0007) [2023-12-27 19:17:52,574][106225] Updated weights for policy 1, policy_version 9223 (0.0010) [2023-12-27 19:17:52,639][106225] Updated weights for policy 1, policy_version 9233 (0.0010) [2023-12-27 19:17:52,704][106225] Updated weights for policy 1, policy_version 9243 (0.0010) [2023-12-27 19:17:53,087][106226] Updated weights for policy 0, policy_version 9316 (0.0008) [2023-12-27 19:17:53,141][106226] Updated weights for policy 0, policy_version 9326 (0.0010) [2023-12-27 19:17:53,189][106226] Updated weights for policy 0, policy_version 9336 (0.0009) [2023-12-27 19:17:53,432][106225] Updated weights for policy 1, policy_version 9253 (0.0010) [2023-12-27 19:17:53,497][106225] Updated weights for policy 1, policy_version 9263 (0.0010) [2023-12-27 19:17:53,566][106225] Updated weights for policy 1, policy_version 9273 (0.0011) [2023-12-27 19:17:53,914][106226] Updated weights for policy 0, policy_version 9346 (0.0008) [2023-12-27 19:17:53,972][106226] Updated weights for policy 0, policy_version 9356 (0.0010) [2023-12-27 19:17:54,029][106226] Updated weights for policy 0, policy_version 9366 (0.0011) [2023-12-27 19:17:54,088][106226] Updated weights for policy 0, policy_version 9376 (0.0010) [2023-12-27 19:17:54,307][106225] Updated weights for policy 1, policy_version 9283 (0.0010) [2023-12-27 19:17:54,359][106225] Updated weights for policy 1, policy_version 9293 (0.0007) [2023-12-27 19:17:54,416][106225] Updated weights for policy 1, policy_version 9303 (0.0008) [2023-12-27 19:17:54,803][106226] Updated weights for policy 0, policy_version 9386 (0.0010) [2023-12-27 19:17:54,850][106226] Updated weights for policy 0, policy_version 9396 (0.0010) [2023-12-27 19:17:54,897][106226] Updated weights for policy 0, policy_version 9406 (0.0010) [2023-12-27 19:17:55,098][106225] Updated weights for policy 1, policy_version 9313 (0.0008) [2023-12-27 19:17:55,151][106225] Updated weights for policy 1, policy_version 9323 (0.0005) [2023-12-27 19:17:55,207][106225] Updated weights for policy 1, policy_version 9333 (0.0006) [2023-12-27 19:17:55,260][106225] Updated weights for policy 1, policy_version 9343 (0.0010) [2023-12-27 19:17:55,570][106226] Updated weights for policy 0, policy_version 9416 (0.0010) [2023-12-27 19:17:55,621][106226] Updated weights for policy 0, policy_version 9426 (0.0010) [2023-12-27 19:17:55,670][106226] Updated weights for policy 0, policy_version 9436 (0.0010) [2023-12-27 19:17:55,940][106225] Updated weights for policy 1, policy_version 9353 (0.0008) [2023-12-27 19:17:56,000][106225] Updated weights for policy 1, policy_version 9363 (0.0010) [2023-12-27 19:17:56,068][106225] Updated weights for policy 1, policy_version 9373 (0.0006) [2023-12-27 19:17:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 4816896. Throughput: 0: 9958.7, 1: 9769.8. Samples: 4783016. Policy #0 lag: (min: 17.0, avg: 32.0, max: 49.0) [2023-12-27 19:17:56,176][105115] Avg episode reward: [(0, '-6.769'), (1, '-7.696')] [2023-12-27 19:17:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000009440_2416640.pth... [2023-12-27 19:17:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000009376_2400256.pth... [2023-12-27 19:17:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000008288_2121728.pth [2023-12-27 19:17:56,188][106140] Saving new best policy, reward=-6.769! [2023-12-27 19:17:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000008224_2105344.pth [2023-12-27 19:17:56,414][106226] Updated weights for policy 0, policy_version 9446 (0.0010) [2023-12-27 19:17:56,461][106226] Updated weights for policy 0, policy_version 9456 (0.0010) [2023-12-27 19:17:56,511][106226] Updated weights for policy 0, policy_version 9466 (0.0010) [2023-12-27 19:17:56,649][106225] Updated weights for policy 1, policy_version 9383 (0.0005) [2023-12-27 19:17:56,710][106225] Updated weights for policy 1, policy_version 9393 (0.0005) [2023-12-27 19:17:56,772][106225] Updated weights for policy 1, policy_version 9403 (0.0005) [2023-12-27 19:17:57,214][106226] Updated weights for policy 0, policy_version 9476 (0.0006) [2023-12-27 19:17:57,276][106226] Updated weights for policy 0, policy_version 9486 (0.0005) [2023-12-27 19:17:57,329][106225] Updated weights for policy 1, policy_version 9413 (0.0005) [2023-12-27 19:17:57,338][106226] Updated weights for policy 0, policy_version 9496 (0.0009) [2023-12-27 19:17:57,382][106225] Updated weights for policy 1, policy_version 9423 (0.0005) [2023-12-27 19:17:57,434][106225] Updated weights for policy 1, policy_version 9433 (0.0008) [2023-12-27 19:17:58,012][106226] Updated weights for policy 0, policy_version 9506 (0.0010) [2023-12-27 19:17:58,061][106226] Updated weights for policy 0, policy_version 9516 (0.0010) [2023-12-27 19:17:58,115][106226] Updated weights for policy 0, policy_version 9526 (0.0010) [2023-12-27 19:17:58,119][106225] Updated weights for policy 1, policy_version 9443 (0.0007) [2023-12-27 19:17:58,165][106226] Updated weights for policy 0, policy_version 9536 (0.0010) [2023-12-27 19:17:58,179][106225] Updated weights for policy 1, policy_version 9453 (0.0006) [2023-12-27 19:17:58,246][106225] Updated weights for policy 1, policy_version 9463 (0.0007) [2023-12-27 19:17:58,938][106226] Updated weights for policy 0, policy_version 9546 (0.0008) [2023-12-27 19:17:59,007][106226] Updated weights for policy 0, policy_version 9556 (0.0008) [2023-12-27 19:17:59,067][106226] Updated weights for policy 0, policy_version 9566 (0.0006) [2023-12-27 19:17:59,085][106225] Updated weights for policy 1, policy_version 9473 (0.0008) [2023-12-27 19:17:59,145][106225] Updated weights for policy 1, policy_version 9483 (0.0007) [2023-12-27 19:17:59,204][106225] Updated weights for policy 1, policy_version 9493 (0.0007) [2023-12-27 19:17:59,273][106225] Updated weights for policy 1, policy_version 9503 (0.0008) [2023-12-27 19:17:59,845][106226] Updated weights for policy 0, policy_version 9576 (0.0009) [2023-12-27 19:17:59,906][106226] Updated weights for policy 0, policy_version 9586 (0.0010) [2023-12-27 19:17:59,972][106226] Updated weights for policy 0, policy_version 9596 (0.0009) [2023-12-27 19:18:00,081][106225] Updated weights for policy 1, policy_version 9513 (0.0006) [2023-12-27 19:18:00,129][106225] Updated weights for policy 1, policy_version 9523 (0.0005) [2023-12-27 19:18:00,174][106225] Updated weights for policy 1, policy_version 9533 (0.0005) [2023-12-27 19:18:00,688][106226] Updated weights for policy 0, policy_version 9606 (0.0011) [2023-12-27 19:18:00,752][106226] Updated weights for policy 0, policy_version 9616 (0.0010) [2023-12-27 19:18:00,765][106225] Updated weights for policy 1, policy_version 9543 (0.0005) [2023-12-27 19:18:00,813][106226] Updated weights for policy 0, policy_version 9626 (0.0008) [2023-12-27 19:18:00,829][106225] Updated weights for policy 1, policy_version 9553 (0.0009) [2023-12-27 19:18:00,878][106225] Updated weights for policy 1, policy_version 9563 (0.0009) [2023-12-27 19:18:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 4915200. Throughput: 0: 9983.4, 1: 9782.0. Samples: 4902300. Policy #0 lag: (min: 21.0, avg: 22.8, max: 53.0) [2023-12-27 19:18:01,175][105115] Avg episode reward: [(0, '-6.723'), (1, '-6.985')] [2023-12-27 19:18:01,176][106141] Saving new best policy, reward=-6.985! [2023-12-27 19:18:01,176][106140] Saving new best policy, reward=-6.723! [2023-12-27 19:18:01,489][106226] Updated weights for policy 0, policy_version 9636 (0.0007) [2023-12-27 19:18:01,546][106226] Updated weights for policy 0, policy_version 9646 (0.0010) [2023-12-27 19:18:01,581][106225] Updated weights for policy 1, policy_version 9573 (0.0005) [2023-12-27 19:18:01,603][106226] Updated weights for policy 0, policy_version 9656 (0.0010) [2023-12-27 19:18:01,645][106225] Updated weights for policy 1, policy_version 9583 (0.0010) [2023-12-27 19:18:01,713][106225] Updated weights for policy 1, policy_version 9594 (0.0012) [2023-12-27 19:18:02,297][106226] Updated weights for policy 0, policy_version 9666 (0.0009) [2023-12-27 19:18:02,369][106226] Updated weights for policy 0, policy_version 9676 (0.0009) [2023-12-27 19:18:02,427][106226] Updated weights for policy 0, policy_version 9686 (0.0008) [2023-12-27 19:18:02,468][106225] Updated weights for policy 1, policy_version 9604 (0.0009) [2023-12-27 19:18:02,481][106226] Updated weights for policy 0, policy_version 9696 (0.0008) [2023-12-27 19:18:02,519][106225] Updated weights for policy 1, policy_version 9614 (0.0009) [2023-12-27 19:18:02,567][106225] Updated weights for policy 1, policy_version 9624 (0.0008) [2023-12-27 19:18:03,081][106226] Updated weights for policy 0, policy_version 9706 (0.0010) [2023-12-27 19:18:03,133][106226] Updated weights for policy 0, policy_version 9716 (0.0010) [2023-12-27 19:18:03,186][106226] Updated weights for policy 0, policy_version 9726 (0.0010) [2023-12-27 19:18:03,358][106225] Updated weights for policy 1, policy_version 9634 (0.0007) [2023-12-27 19:18:03,404][106225] Updated weights for policy 1, policy_version 9644 (0.0005) [2023-12-27 19:18:03,456][106225] Updated weights for policy 1, policy_version 9654 (0.0005) [2023-12-27 19:18:03,510][106225] Updated weights for policy 1, policy_version 9664 (0.0005) [2023-12-27 19:18:03,881][106226] Updated weights for policy 0, policy_version 9736 (0.0011) [2023-12-27 19:18:03,943][106226] Updated weights for policy 0, policy_version 9746 (0.0011) [2023-12-27 19:18:04,000][106226] Updated weights for policy 0, policy_version 9756 (0.0011) [2023-12-27 19:18:04,203][106225] Updated weights for policy 1, policy_version 9674 (0.0010) [2023-12-27 19:18:04,264][106225] Updated weights for policy 1, policy_version 9684 (0.0010) [2023-12-27 19:18:04,328][106225] Updated weights for policy 1, policy_version 9694 (0.0010) [2023-12-27 19:18:04,716][106226] Updated weights for policy 0, policy_version 9766 (0.0010) [2023-12-27 19:18:04,770][106226] Updated weights for policy 0, policy_version 9776 (0.0010) [2023-12-27 19:18:04,820][106226] Updated weights for policy 0, policy_version 9786 (0.0010) [2023-12-27 19:18:04,953][106225] Updated weights for policy 1, policy_version 9704 (0.0005) [2023-12-27 19:18:05,009][106225] Updated weights for policy 1, policy_version 9714 (0.0005) [2023-12-27 19:18:05,055][106225] Updated weights for policy 1, policy_version 9724 (0.0005) [2023-12-27 19:18:05,497][106226] Updated weights for policy 0, policy_version 9796 (0.0010) [2023-12-27 19:18:05,553][106226] Updated weights for policy 0, policy_version 9806 (0.0010) [2023-12-27 19:18:05,593][106225] Updated weights for policy 1, policy_version 9734 (0.0008) [2023-12-27 19:18:05,610][106226] Updated weights for policy 0, policy_version 9816 (0.0010) [2023-12-27 19:18:05,642][106225] Updated weights for policy 1, policy_version 9744 (0.0010) [2023-12-27 19:18:05,692][106225] Updated weights for policy 1, policy_version 9754 (0.0010) [2023-12-27 19:18:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 5013504. Throughput: 0: 10024.8, 1: 9855.5. Samples: 5024944. Policy #0 lag: (min: 27.0, avg: 29.0, max: 59.0) [2023-12-27 19:18:06,175][105115] Avg episode reward: [(0, '-6.950'), (1, '-7.716')] [2023-12-27 19:18:06,313][106226] Updated weights for policy 0, policy_version 9826 (0.0009) [2023-12-27 19:18:06,371][106226] Updated weights for policy 0, policy_version 9836 (0.0006) [2023-12-27 19:18:06,412][106225] Updated weights for policy 1, policy_version 9764 (0.0010) [2023-12-27 19:18:06,429][106226] Updated weights for policy 0, policy_version 9846 (0.0006) [2023-12-27 19:18:06,471][106225] Updated weights for policy 1, policy_version 9774 (0.0010) [2023-12-27 19:18:06,488][106226] Updated weights for policy 0, policy_version 9856 (0.0007) [2023-12-27 19:18:06,518][106225] Updated weights for policy 1, policy_version 9784 (0.0010) [2023-12-27 19:18:07,078][106226] Updated weights for policy 0, policy_version 9866 (0.0009) [2023-12-27 19:18:07,169][106226] Updated weights for policy 0, policy_version 9876 (0.0008) [2023-12-27 19:18:07,184][106225] Updated weights for policy 1, policy_version 9794 (0.0009) [2023-12-27 19:18:07,233][106226] Updated weights for policy 0, policy_version 9886 (0.0007) [2023-12-27 19:18:07,243][106225] Updated weights for policy 1, policy_version 9804 (0.0008) [2023-12-27 19:18:07,301][106225] Updated weights for policy 1, policy_version 9814 (0.0005) [2023-12-27 19:18:07,355][106225] Updated weights for policy 1, policy_version 9824 (0.0005) [2023-12-27 19:18:07,922][106226] Updated weights for policy 0, policy_version 9896 (0.0006) [2023-12-27 19:18:07,979][106226] Updated weights for policy 0, policy_version 9906 (0.0005) [2023-12-27 19:18:08,008][106225] Updated weights for policy 1, policy_version 9834 (0.0008) [2023-12-27 19:18:08,035][106226] Updated weights for policy 0, policy_version 9916 (0.0009) [2023-12-27 19:18:08,062][106225] Updated weights for policy 1, policy_version 9844 (0.0008) [2023-12-27 19:18:08,119][106225] Updated weights for policy 1, policy_version 9854 (0.0008) [2023-12-27 19:18:08,637][106226] Updated weights for policy 0, policy_version 9926 (0.0011) [2023-12-27 19:18:08,700][106226] Updated weights for policy 0, policy_version 9936 (0.0011) [2023-12-27 19:18:08,759][106226] Updated weights for policy 0, policy_version 9946 (0.0011) [2023-12-27 19:18:08,850][106225] Updated weights for policy 1, policy_version 9864 (0.0010) [2023-12-27 19:18:08,916][106225] Updated weights for policy 1, policy_version 9874 (0.0011) [2023-12-27 19:18:08,978][106225] Updated weights for policy 1, policy_version 9884 (0.0010) [2023-12-27 19:18:09,537][106226] Updated weights for policy 0, policy_version 9956 (0.0011) [2023-12-27 19:18:09,599][106226] Updated weights for policy 0, policy_version 9966 (0.0008) [2023-12-27 19:18:09,666][106226] Updated weights for policy 0, policy_version 9976 (0.0009) [2023-12-27 19:18:09,719][106225] Updated weights for policy 1, policy_version 9894 (0.0010) [2023-12-27 19:18:09,789][106225] Updated weights for policy 1, policy_version 9904 (0.0010) [2023-12-27 19:18:09,857][106225] Updated weights for policy 1, policy_version 9914 (0.0010) [2023-12-27 19:18:10,327][106226] Updated weights for policy 0, policy_version 9986 (0.0008) [2023-12-27 19:18:10,393][106226] Updated weights for policy 0, policy_version 9996 (0.0011) [2023-12-27 19:18:10,447][106226] Updated weights for policy 0, policy_version 10006 (0.0010) [2023-12-27 19:18:10,508][106226] Updated weights for policy 0, policy_version 10016 (0.0009) [2023-12-27 19:18:10,634][106225] Updated weights for policy 1, policy_version 9924 (0.0014) [2023-12-27 19:18:10,685][106225] Updated weights for policy 1, policy_version 9934 (0.0010) [2023-12-27 19:18:10,740][106225] Updated weights for policy 1, policy_version 9944 (0.0010) [2023-12-27 19:18:11,144][106226] Updated weights for policy 0, policy_version 10026 (0.0008) [2023-12-27 19:18:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 5111808. Throughput: 0: 10080.1, 1: 9918.5. Samples: 5086464. Policy #0 lag: (min: 27.0, avg: 29.0, max: 59.0) [2023-12-27 19:18:11,175][105115] Avg episode reward: [(0, '-6.341'), (1, '-7.569')] [2023-12-27 19:18:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000009952_2547712.pth... [2023-12-27 19:18:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000008800_2252800.pth [2023-12-27 19:18:11,208][106226] Updated weights for policy 0, policy_version 10036 (0.0009) [2023-12-27 19:18:11,268][106226] Updated weights for policy 0, policy_version 10046 (0.0008) [2023-12-27 19:18:11,282][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000010048_2572288.pth... [2023-12-27 19:18:11,287][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000008864_2269184.pth [2023-12-27 19:18:11,287][106140] Saving new best policy, reward=-6.341! [2023-12-27 19:18:11,492][106225] Updated weights for policy 1, policy_version 9954 (0.0009) [2023-12-27 19:18:11,552][106225] Updated weights for policy 1, policy_version 9964 (0.0007) [2023-12-27 19:18:11,622][106225] Updated weights for policy 1, policy_version 9974 (0.0007) [2023-12-27 19:18:11,694][106225] Updated weights for policy 1, policy_version 9984 (0.0008) [2023-12-27 19:18:12,004][106226] Updated weights for policy 0, policy_version 10056 (0.0007) [2023-12-27 19:18:12,058][106226] Updated weights for policy 0, policy_version 10066 (0.0009) [2023-12-27 19:18:12,109][106226] Updated weights for policy 0, policy_version 10076 (0.0009) [2023-12-27 19:18:12,400][106225] Updated weights for policy 1, policy_version 9994 (0.0008) [2023-12-27 19:18:12,461][106225] Updated weights for policy 1, policy_version 10004 (0.0008) [2023-12-27 19:18:12,522][106225] Updated weights for policy 1, policy_version 10014 (0.0009) [2023-12-27 19:18:12,869][106226] Updated weights for policy 0, policy_version 10086 (0.0008) [2023-12-27 19:18:12,916][106226] Updated weights for policy 0, policy_version 10096 (0.0009) [2023-12-27 19:18:12,965][106226] Updated weights for policy 0, policy_version 10106 (0.0008) [2023-12-27 19:18:13,203][106225] Updated weights for policy 1, policy_version 10024 (0.0006) [2023-12-27 19:18:13,269][106225] Updated weights for policy 1, policy_version 10034 (0.0005) [2023-12-27 19:18:13,325][106225] Updated weights for policy 1, policy_version 10044 (0.0005) [2023-12-27 19:18:13,745][106226] Updated weights for policy 0, policy_version 10116 (0.0007) [2023-12-27 19:18:13,798][106226] Updated weights for policy 0, policy_version 10126 (0.0005) [2023-12-27 19:18:13,841][106225] Updated weights for policy 1, policy_version 10054 (0.0005) [2023-12-27 19:18:13,847][106226] Updated weights for policy 0, policy_version 10136 (0.0008) [2023-12-27 19:18:13,892][106225] Updated weights for policy 1, policy_version 10064 (0.0006) [2023-12-27 19:18:13,959][106225] Updated weights for policy 1, policy_version 10074 (0.0010) [2023-12-27 19:18:14,487][106226] Updated weights for policy 0, policy_version 10146 (0.0008) [2023-12-27 19:18:14,545][106226] Updated weights for policy 0, policy_version 10156 (0.0008) [2023-12-27 19:18:14,607][106226] Updated weights for policy 0, policy_version 10166 (0.0009) [2023-12-27 19:18:14,628][106225] Updated weights for policy 1, policy_version 10084 (0.0008) [2023-12-27 19:18:14,669][106226] Updated weights for policy 0, policy_version 10176 (0.0006) [2023-12-27 19:18:14,682][106225] Updated weights for policy 1, policy_version 10094 (0.0010) [2023-12-27 19:18:14,742][106225] Updated weights for policy 1, policy_version 10104 (0.0010) [2023-12-27 19:18:15,441][106225] Updated weights for policy 1, policy_version 10114 (0.0010) [2023-12-27 19:18:15,456][106226] Updated weights for policy 0, policy_version 10186 (0.0009) [2023-12-27 19:18:15,499][106225] Updated weights for policy 1, policy_version 10124 (0.0010) [2023-12-27 19:18:15,512][106226] Updated weights for policy 0, policy_version 10196 (0.0009) [2023-12-27 19:18:15,558][106225] Updated weights for policy 1, policy_version 10134 (0.0010) [2023-12-27 19:18:15,568][106226] Updated weights for policy 0, policy_version 10206 (0.0007) [2023-12-27 19:18:15,613][106225] Updated weights for policy 1, policy_version 10144 (0.0010) [2023-12-27 19:18:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 5210112. Throughput: 0: 9945.4, 1: 9847.0. Samples: 5203472. Policy #0 lag: (min: 9.0, avg: 28.8, max: 41.0) [2023-12-27 19:18:16,175][105115] Avg episode reward: [(0, '-6.687'), (1, '-7.151')] [2023-12-27 19:18:16,261][106226] Updated weights for policy 0, policy_version 10216 (0.0006) [2023-12-27 19:18:16,265][106225] Updated weights for policy 1, policy_version 10154 (0.0010) [2023-12-27 19:18:16,316][106226] Updated weights for policy 0, policy_version 10226 (0.0007) [2023-12-27 19:18:16,318][106225] Updated weights for policy 1, policy_version 10164 (0.0010) [2023-12-27 19:18:16,370][106226] Updated weights for policy 0, policy_version 10236 (0.0008) [2023-12-27 19:18:16,374][106225] Updated weights for policy 1, policy_version 10174 (0.0010) [2023-12-27 19:18:17,011][106226] Updated weights for policy 0, policy_version 10246 (0.0007) [2023-12-27 19:18:17,011][106225] Updated weights for policy 1, policy_version 10184 (0.0009) [2023-12-27 19:18:17,067][106225] Updated weights for policy 1, policy_version 10194 (0.0007) [2023-12-27 19:18:17,077][106226] Updated weights for policy 0, policy_version 10256 (0.0006) [2023-12-27 19:18:17,121][106225] Updated weights for policy 1, policy_version 10204 (0.0007) [2023-12-27 19:18:17,131][106226] Updated weights for policy 0, policy_version 10266 (0.0006) [2023-12-27 19:18:17,733][106226] Updated weights for policy 0, policy_version 10276 (0.0005) [2023-12-27 19:18:17,755][106225] Updated weights for policy 1, policy_version 10214 (0.0006) [2023-12-27 19:18:17,792][106226] Updated weights for policy 0, policy_version 10286 (0.0006) [2023-12-27 19:18:17,809][106225] Updated weights for policy 1, policy_version 10224 (0.0005) [2023-12-27 19:18:17,846][106226] Updated weights for policy 0, policy_version 10296 (0.0008) [2023-12-27 19:18:17,863][106225] Updated weights for policy 1, policy_version 10234 (0.0005) [2023-12-27 19:18:18,450][106225] Updated weights for policy 1, policy_version 10244 (0.0007) [2023-12-27 19:18:18,507][106225] Updated weights for policy 1, policy_version 10254 (0.0010) [2023-12-27 19:18:18,540][106226] Updated weights for policy 0, policy_version 10306 (0.0008) [2023-12-27 19:18:18,569][106225] Updated weights for policy 1, policy_version 10264 (0.0010) [2023-12-27 19:18:18,607][106226] Updated weights for policy 0, policy_version 10316 (0.0006) [2023-12-27 19:18:18,661][106226] Updated weights for policy 0, policy_version 10326 (0.0011) [2023-12-27 19:18:18,711][106226] Updated weights for policy 0, policy_version 10336 (0.0010) [2023-12-27 19:18:19,287][106225] Updated weights for policy 1, policy_version 10274 (0.0010) [2023-12-27 19:18:19,346][106225] Updated weights for policy 1, policy_version 10284 (0.0011) [2023-12-27 19:18:19,387][106226] Updated weights for policy 0, policy_version 10346 (0.0010) [2023-12-27 19:18:19,418][106225] Updated weights for policy 1, policy_version 10294 (0.0011) [2023-12-27 19:18:19,452][106226] Updated weights for policy 0, policy_version 10356 (0.0009) [2023-12-27 19:18:19,481][106225] Updated weights for policy 1, policy_version 10304 (0.0009) [2023-12-27 19:18:19,522][106226] Updated weights for policy 0, policy_version 10366 (0.0009) [2023-12-27 19:18:20,178][106225] Updated weights for policy 1, policy_version 10314 (0.0009) [2023-12-27 19:18:20,235][106225] Updated weights for policy 1, policy_version 10324 (0.0007) [2023-12-27 19:18:20,241][106226] Updated weights for policy 0, policy_version 10376 (0.0008) [2023-12-27 19:18:20,298][106225] Updated weights for policy 1, policy_version 10334 (0.0008) [2023-12-27 19:18:20,300][106226] Updated weights for policy 0, policy_version 10386 (0.0006) [2023-12-27 19:18:20,356][106226] Updated weights for policy 0, policy_version 10396 (0.0008) [2023-12-27 19:18:20,960][106225] Updated weights for policy 1, policy_version 10344 (0.0006) [2023-12-27 19:18:21,028][106225] Updated weights for policy 1, policy_version 10354 (0.0006) [2023-12-27 19:18:21,093][106225] Updated weights for policy 1, policy_version 10364 (0.0009) [2023-12-27 19:18:21,118][106226] Updated weights for policy 0, policy_version 10406 (0.0011) [2023-12-27 19:18:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19691.1). Total num frames: 5316608. Throughput: 0: 9995.7, 1: 9889.8. Samples: 5325956. Policy #0 lag: (min: 9.0, avg: 28.8, max: 41.0) [2023-12-27 19:18:21,175][105115] Avg episode reward: [(0, '-6.408'), (1, '-7.412')] [2023-12-27 19:18:21,184][106226] Updated weights for policy 0, policy_version 10416 (0.0011) [2023-12-27 19:18:21,233][106226] Updated weights for policy 0, policy_version 10426 (0.0010) [2023-12-27 19:18:21,834][106225] Updated weights for policy 1, policy_version 10374 (0.0010) [2023-12-27 19:18:21,895][106225] Updated weights for policy 1, policy_version 10384 (0.0009) [2023-12-27 19:18:21,955][106225] Updated weights for policy 1, policy_version 10394 (0.0009) [2023-12-27 19:18:22,055][106226] Updated weights for policy 0, policy_version 10436 (0.0011) [2023-12-27 19:18:22,123][106226] Updated weights for policy 0, policy_version 10446 (0.0011) [2023-12-27 19:18:22,185][106226] Updated weights for policy 0, policy_version 10456 (0.0011) [2023-12-27 19:18:22,677][106225] Updated weights for policy 1, policy_version 10404 (0.0010) [2023-12-27 19:18:22,741][106225] Updated weights for policy 1, policy_version 10414 (0.0008) [2023-12-27 19:18:22,802][106225] Updated weights for policy 1, policy_version 10424 (0.0009) [2023-12-27 19:18:22,937][106226] Updated weights for policy 0, policy_version 10466 (0.0011) [2023-12-27 19:18:22,991][106226] Updated weights for policy 0, policy_version 10476 (0.0011) [2023-12-27 19:18:23,055][106226] Updated weights for policy 0, policy_version 10486 (0.0011) [2023-12-27 19:18:23,117][106226] Updated weights for policy 0, policy_version 10496 (0.0011) [2023-12-27 19:18:23,515][106225] Updated weights for policy 1, policy_version 10434 (0.0010) [2023-12-27 19:18:23,564][106225] Updated weights for policy 1, policy_version 10444 (0.0010) [2023-12-27 19:18:23,617][106225] Updated weights for policy 1, policy_version 10454 (0.0010) [2023-12-27 19:18:23,664][106225] Updated weights for policy 1, policy_version 10464 (0.0010) [2023-12-27 19:18:23,748][106226] Updated weights for policy 0, policy_version 10506 (0.0008) [2023-12-27 19:18:23,809][106226] Updated weights for policy 0, policy_version 10516 (0.0011) [2023-12-27 19:18:23,870][106226] Updated weights for policy 0, policy_version 10526 (0.0011) [2023-12-27 19:18:24,419][106225] Updated weights for policy 1, policy_version 10474 (0.0010) [2023-12-27 19:18:24,488][106225] Updated weights for policy 1, policy_version 10484 (0.0010) [2023-12-27 19:18:24,543][106225] Updated weights for policy 1, policy_version 10494 (0.0010) [2023-12-27 19:18:24,582][106226] Updated weights for policy 0, policy_version 10536 (0.0007) [2023-12-27 19:18:24,648][106226] Updated weights for policy 0, policy_version 10546 (0.0006) [2023-12-27 19:18:24,716][106226] Updated weights for policy 0, policy_version 10556 (0.0006) [2023-12-27 19:18:25,264][106225] Updated weights for policy 1, policy_version 10504 (0.0010) [2023-12-27 19:18:25,274][106226] Updated weights for policy 0, policy_version 10566 (0.0006) [2023-12-27 19:18:25,327][106225] Updated weights for policy 1, policy_version 10514 (0.0010) [2023-12-27 19:18:25,328][106226] Updated weights for policy 0, policy_version 10576 (0.0008) [2023-12-27 19:18:25,378][106226] Updated weights for policy 0, policy_version 10586 (0.0006) [2023-12-27 19:18:25,383][106225] Updated weights for policy 1, policy_version 10524 (0.0010) [2023-12-27 19:18:25,963][106226] Updated weights for policy 0, policy_version 10596 (0.0009) [2023-12-27 19:18:26,025][106226] Updated weights for policy 0, policy_version 10606 (0.0010) [2023-12-27 19:18:26,083][106226] Updated weights for policy 0, policy_version 10616 (0.0011) [2023-12-27 19:18:26,085][106225] Updated weights for policy 1, policy_version 10534 (0.0009) [2023-12-27 19:18:26,148][106225] Updated weights for policy 1, policy_version 10544 (0.0008) [2023-12-27 19:18:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19690.6). Total num frames: 5414912. Throughput: 0: 9971.3, 1: 9899.7. Samples: 5383392. Policy #0 lag: (min: 20.0, avg: 20.3, max: 34.0) [2023-12-27 19:18:26,175][105115] Avg episode reward: [(0, '-6.477'), (1, '-7.688')] [2023-12-27 19:18:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000010624_2719744.pth... [2023-12-27 19:18:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000009440_2416640.pth [2023-12-27 19:18:26,218][106225] Updated weights for policy 1, policy_version 10554 (0.0008) [2023-12-27 19:18:26,258][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000010560_2703360.pth... [2023-12-27 19:18:26,263][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000009376_2400256.pth [2023-12-27 19:18:26,636][106226] Updated weights for policy 0, policy_version 10626 (0.0010) [2023-12-27 19:18:26,688][106226] Updated weights for policy 0, policy_version 10636 (0.0009) [2023-12-27 19:18:26,738][106226] Updated weights for policy 0, policy_version 10646 (0.0005) [2023-12-27 19:18:26,762][106225] Updated weights for policy 1, policy_version 10564 (0.0007) [2023-12-27 19:18:26,786][106226] Updated weights for policy 0, policy_version 10656 (0.0005) [2023-12-27 19:18:26,808][106225] Updated weights for policy 1, policy_version 10574 (0.0005) [2023-12-27 19:18:26,869][106225] Updated weights for policy 1, policy_version 10584 (0.0005) [2023-12-27 19:18:27,370][106226] Updated weights for policy 0, policy_version 10666 (0.0010) [2023-12-27 19:18:27,421][106226] Updated weights for policy 0, policy_version 10676 (0.0005) [2023-12-27 19:18:27,474][106226] Updated weights for policy 0, policy_version 10686 (0.0005) [2023-12-27 19:18:27,504][106225] Updated weights for policy 1, policy_version 10594 (0.0007) [2023-12-27 19:18:27,554][106225] Updated weights for policy 1, policy_version 10604 (0.0008) [2023-12-27 19:18:27,597][106225] Updated weights for policy 1, policy_version 10614 (0.0007) [2023-12-27 19:18:27,644][106225] Updated weights for policy 1, policy_version 10624 (0.0007) [2023-12-27 19:18:28,110][106226] Updated weights for policy 0, policy_version 10696 (0.0005) [2023-12-27 19:18:28,170][106226] Updated weights for policy 0, policy_version 10706 (0.0010) [2023-12-27 19:18:28,231][106226] Updated weights for policy 0, policy_version 10716 (0.0008) [2023-12-27 19:18:28,355][106225] Updated weights for policy 1, policy_version 10634 (0.0007) [2023-12-27 19:18:28,413][106225] Updated weights for policy 1, policy_version 10644 (0.0006) [2023-12-27 19:18:28,475][106225] Updated weights for policy 1, policy_version 10654 (0.0006) [2023-12-27 19:18:28,892][106226] Updated weights for policy 0, policy_version 10726 (0.0007) [2023-12-27 19:18:28,958][106226] Updated weights for policy 0, policy_version 10736 (0.0005) [2023-12-27 19:18:29,020][106226] Updated weights for policy 0, policy_version 10746 (0.0006) [2023-12-27 19:18:29,070][106225] Updated weights for policy 1, policy_version 10664 (0.0005) [2023-12-27 19:18:29,121][106225] Updated weights for policy 1, policy_version 10674 (0.0005) [2023-12-27 19:18:29,173][106225] Updated weights for policy 1, policy_version 10684 (0.0005) [2023-12-27 19:18:29,673][106226] Updated weights for policy 0, policy_version 10756 (0.0009) [2023-12-27 19:18:29,735][106226] Updated weights for policy 0, policy_version 10766 (0.0007) [2023-12-27 19:18:29,802][106226] Updated weights for policy 0, policy_version 10776 (0.0009) [2023-12-27 19:18:29,861][106225] Updated weights for policy 1, policy_version 10694 (0.0006) [2023-12-27 19:18:29,917][106225] Updated weights for policy 1, policy_version 10704 (0.0006) [2023-12-27 19:18:29,982][106225] Updated weights for policy 1, policy_version 10714 (0.0008) [2023-12-27 19:18:30,536][106226] Updated weights for policy 0, policy_version 10786 (0.0009) [2023-12-27 19:18:30,585][106226] Updated weights for policy 0, policy_version 10796 (0.0006) [2023-12-27 19:18:30,636][106226] Updated weights for policy 0, policy_version 10806 (0.0005) [2023-12-27 19:18:30,706][106226] Updated weights for policy 0, policy_version 10816 (0.0008) [2023-12-27 19:18:30,735][106225] Updated weights for policy 1, policy_version 10724 (0.0007) [2023-12-27 19:18:30,783][106225] Updated weights for policy 1, policy_version 10734 (0.0009) [2023-12-27 19:18:30,828][106225] Updated weights for policy 1, policy_version 10744 (0.0008) [2023-12-27 19:18:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19719.3). Total num frames: 5521408. Throughput: 0: 10140.6, 1: 10003.6. Samples: 5511420. Policy #0 lag: (min: 29.0, avg: 37.1, max: 61.0) [2023-12-27 19:18:31,175][105115] Avg episode reward: [(0, '-6.095'), (1, '-7.591')] [2023-12-27 19:18:31,176][106140] Saving new best policy, reward=-6.095! [2023-12-27 19:18:31,386][106226] Updated weights for policy 0, policy_version 10826 (0.0010) [2023-12-27 19:18:31,444][106226] Updated weights for policy 0, policy_version 10836 (0.0010) [2023-12-27 19:18:31,501][106226] Updated weights for policy 0, policy_version 10846 (0.0011) [2023-12-27 19:18:31,563][106225] Updated weights for policy 1, policy_version 10754 (0.0008) [2023-12-27 19:18:31,621][106225] Updated weights for policy 1, policy_version 10764 (0.0008) [2023-12-27 19:18:31,691][106225] Updated weights for policy 1, policy_version 10774 (0.0010) [2023-12-27 19:18:31,763][106225] Updated weights for policy 1, policy_version 10784 (0.0012) [2023-12-27 19:18:32,133][106226] Updated weights for policy 0, policy_version 10856 (0.0006) [2023-12-27 19:18:32,196][106226] Updated weights for policy 0, policy_version 10866 (0.0010) [2023-12-27 19:18:32,263][106226] Updated weights for policy 0, policy_version 10876 (0.0011) [2023-12-27 19:18:32,459][106225] Updated weights for policy 1, policy_version 10794 (0.0008) [2023-12-27 19:18:32,520][106225] Updated weights for policy 1, policy_version 10804 (0.0008) [2023-12-27 19:18:32,578][106225] Updated weights for policy 1, policy_version 10814 (0.0008) [2023-12-27 19:18:32,935][106226] Updated weights for policy 0, policy_version 10886 (0.0010) [2023-12-27 19:18:32,994][106226] Updated weights for policy 0, policy_version 10896 (0.0010) [2023-12-27 19:18:33,060][106226] Updated weights for policy 0, policy_version 10906 (0.0010) [2023-12-27 19:18:33,210][106225] Updated weights for policy 1, policy_version 10824 (0.0010) [2023-12-27 19:18:33,265][106225] Updated weights for policy 1, policy_version 10834 (0.0010) [2023-12-27 19:18:33,327][106225] Updated weights for policy 1, policy_version 10844 (0.0010) [2023-12-27 19:18:33,654][106226] Updated weights for policy 0, policy_version 10916 (0.0010) [2023-12-27 19:18:33,715][106226] Updated weights for policy 0, policy_version 10926 (0.0010) [2023-12-27 19:18:33,774][106226] Updated weights for policy 0, policy_version 10936 (0.0010) [2023-12-27 19:18:33,915][106225] Updated weights for policy 1, policy_version 10854 (0.0009) [2023-12-27 19:18:33,961][106225] Updated weights for policy 1, policy_version 10864 (0.0006) [2023-12-27 19:18:34,014][106225] Updated weights for policy 1, policy_version 10874 (0.0010) [2023-12-27 19:18:34,436][106226] Updated weights for policy 0, policy_version 10946 (0.0010) [2023-12-27 19:18:34,509][106226] Updated weights for policy 0, policy_version 10956 (0.0008) [2023-12-27 19:18:34,569][106226] Updated weights for policy 0, policy_version 10966 (0.0007) [2023-12-27 19:18:34,629][106226] Updated weights for policy 0, policy_version 10976 (0.0009) [2023-12-27 19:18:34,732][106225] Updated weights for policy 1, policy_version 10884 (0.0009) [2023-12-27 19:18:34,795][106225] Updated weights for policy 1, policy_version 10894 (0.0008) [2023-12-27 19:18:34,861][106225] Updated weights for policy 1, policy_version 10904 (0.0008) [2023-12-27 19:18:35,235][106226] Updated weights for policy 0, policy_version 10986 (0.0005) [2023-12-27 19:18:35,295][106226] Updated weights for policy 0, policy_version 10996 (0.0006) [2023-12-27 19:18:35,365][106226] Updated weights for policy 0, policy_version 11006 (0.0005) [2023-12-27 19:18:35,498][106225] Updated weights for policy 1, policy_version 10914 (0.0008) [2023-12-27 19:18:35,547][106225] Updated weights for policy 1, policy_version 10924 (0.0005) [2023-12-27 19:18:35,599][106225] Updated weights for policy 1, policy_version 10934 (0.0007) [2023-12-27 19:18:35,651][106225] Updated weights for policy 1, policy_version 10944 (0.0007) [2023-12-27 19:18:35,887][106226] Updated weights for policy 0, policy_version 11016 (0.0009) [2023-12-27 19:18:35,939][106226] Updated weights for policy 0, policy_version 11026 (0.0010) [2023-12-27 19:18:36,010][106226] Updated weights for policy 0, policy_version 11036 (0.0005) [2023-12-27 19:18:36,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20206.9, 300 sec: 19747.0). Total num frames: 5627904. Throughput: 0: 10139.6, 1: 10060.4. Samples: 5635980. Policy #0 lag: (min: 29.0, avg: 37.1, max: 61.0) [2023-12-27 19:18:36,175][105115] Avg episode reward: [(0, '-6.587'), (1, '-7.566')] [2023-12-27 19:18:36,314][106225] Updated weights for policy 1, policy_version 10954 (0.0008) [2023-12-27 19:18:36,378][106225] Updated weights for policy 1, policy_version 10964 (0.0008) [2023-12-27 19:18:36,444][106225] Updated weights for policy 1, policy_version 10974 (0.0008) [2023-12-27 19:18:36,705][106226] Updated weights for policy 0, policy_version 11046 (0.0009) [2023-12-27 19:18:36,762][106226] Updated weights for policy 0, policy_version 11056 (0.0011) [2023-12-27 19:18:36,823][106226] Updated weights for policy 0, policy_version 11066 (0.0010) [2023-12-27 19:18:37,166][106225] Updated weights for policy 1, policy_version 10984 (0.0008) [2023-12-27 19:18:37,226][106225] Updated weights for policy 1, policy_version 10994 (0.0007) [2023-12-27 19:18:37,276][106225] Updated weights for policy 1, policy_version 11004 (0.0008) [2023-12-27 19:18:37,539][106226] Updated weights for policy 0, policy_version 11076 (0.0011) [2023-12-27 19:18:37,586][106226] Updated weights for policy 0, policy_version 11086 (0.0010) [2023-12-27 19:18:37,640][106226] Updated weights for policy 0, policy_version 11096 (0.0010) [2023-12-27 19:18:38,029][106225] Updated weights for policy 1, policy_version 11014 (0.0006) [2023-12-27 19:18:38,089][106225] Updated weights for policy 1, policy_version 11024 (0.0005) [2023-12-27 19:18:38,150][106225] Updated weights for policy 1, policy_version 11034 (0.0007) [2023-12-27 19:18:38,379][106226] Updated weights for policy 0, policy_version 11106 (0.0011) [2023-12-27 19:18:38,434][106226] Updated weights for policy 0, policy_version 11116 (0.0010) [2023-12-27 19:18:38,490][106226] Updated weights for policy 0, policy_version 11126 (0.0010) [2023-12-27 19:18:38,559][106226] Updated weights for policy 0, policy_version 11136 (0.0011) [2023-12-27 19:18:38,911][106225] Updated weights for policy 1, policy_version 11044 (0.0007) [2023-12-27 19:18:38,969][106225] Updated weights for policy 1, policy_version 11054 (0.0008) [2023-12-27 19:18:39,028][106225] Updated weights for policy 1, policy_version 11064 (0.0008) [2023-12-27 19:18:39,317][106226] Updated weights for policy 0, policy_version 11146 (0.0010) [2023-12-27 19:18:39,387][106226] Updated weights for policy 0, policy_version 11156 (0.0009) [2023-12-27 19:18:39,455][106226] Updated weights for policy 0, policy_version 11166 (0.0009) [2023-12-27 19:18:39,772][106225] Updated weights for policy 1, policy_version 11074 (0.0008) [2023-12-27 19:18:39,834][106225] Updated weights for policy 1, policy_version 11084 (0.0007) [2023-12-27 19:18:39,902][106225] Updated weights for policy 1, policy_version 11094 (0.0006) [2023-12-27 19:18:39,968][106225] Updated weights for policy 1, policy_version 11104 (0.0007) [2023-12-27 19:18:40,276][106226] Updated weights for policy 0, policy_version 11176 (0.0009) [2023-12-27 19:18:40,342][106226] Updated weights for policy 0, policy_version 11186 (0.0010) [2023-12-27 19:18:40,411][106226] Updated weights for policy 0, policy_version 11196 (0.0009) [2023-12-27 19:18:40,696][106225] Updated weights for policy 1, policy_version 11114 (0.0009) [2023-12-27 19:18:40,758][106225] Updated weights for policy 1, policy_version 11124 (0.0009) [2023-12-27 19:18:40,814][106225] Updated weights for policy 1, policy_version 11134 (0.0008) [2023-12-27 19:18:41,026][106226] Updated weights for policy 0, policy_version 11206 (0.0011) [2023-12-27 19:18:41,092][106226] Updated weights for policy 0, policy_version 11216 (0.0010) [2023-12-27 19:18:41,161][106226] Updated weights for policy 0, policy_version 11226 (0.0008) [2023-12-27 19:18:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19717.3). Total num frames: 5718016. Throughput: 0: 10145.5, 1: 10110.4. Samples: 5694532. Policy #0 lag: (min: 29.0, avg: 30.8, max: 61.0) [2023-12-27 19:18:41,175][105115] Avg episode reward: [(0, '-6.162'), (1, '-7.542')] [2023-12-27 19:18:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000011136_2850816.pth... [2023-12-27 19:18:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000009952_2547712.pth [2023-12-27 19:18:41,203][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000011232_2875392.pth... [2023-12-27 19:18:41,207][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000010048_2572288.pth [2023-12-27 19:18:41,662][106225] Updated weights for policy 1, policy_version 11144 (0.0009) [2023-12-27 19:18:41,729][106225] Updated weights for policy 1, policy_version 11154 (0.0010) [2023-12-27 19:18:41,791][106225] Updated weights for policy 1, policy_version 11164 (0.0007) [2023-12-27 19:18:41,872][106226] Updated weights for policy 0, policy_version 11236 (0.0009) [2023-12-27 19:18:41,938][106226] Updated weights for policy 0, policy_version 11246 (0.0011) [2023-12-27 19:18:42,005][106226] Updated weights for policy 0, policy_version 11256 (0.0010) [2023-12-27 19:18:42,583][106225] Updated weights for policy 1, policy_version 11174 (0.0007) [2023-12-27 19:18:42,651][106225] Updated weights for policy 1, policy_version 11184 (0.0010) [2023-12-27 19:18:42,677][106226] Updated weights for policy 0, policy_version 11266 (0.0007) [2023-12-27 19:18:42,708][106225] Updated weights for policy 1, policy_version 11194 (0.0008) [2023-12-27 19:18:42,745][106226] Updated weights for policy 0, policy_version 11276 (0.0008) [2023-12-27 19:18:42,816][106226] Updated weights for policy 0, policy_version 11286 (0.0006) [2023-12-27 19:18:42,886][106226] Updated weights for policy 0, policy_version 11296 (0.0006) [2023-12-27 19:18:43,456][106226] Updated weights for policy 0, policy_version 11306 (0.0006) [2023-12-27 19:18:43,477][106225] Updated weights for policy 1, policy_version 11204 (0.0006) [2023-12-27 19:18:43,505][106226] Updated weights for policy 0, policy_version 11316 (0.0007) [2023-12-27 19:18:43,535][106225] Updated weights for policy 1, policy_version 11214 (0.0006) [2023-12-27 19:18:43,560][106226] Updated weights for policy 0, policy_version 11326 (0.0007) [2023-12-27 19:18:43,593][106225] Updated weights for policy 1, policy_version 11224 (0.0007) [2023-12-27 19:18:44,173][106226] Updated weights for policy 0, policy_version 11336 (0.0007) [2023-12-27 19:18:44,225][106226] Updated weights for policy 0, policy_version 11346 (0.0005) [2023-12-27 19:18:44,289][106226] Updated weights for policy 0, policy_version 11356 (0.0009) [2023-12-27 19:18:44,322][106225] Updated weights for policy 1, policy_version 11234 (0.0008) [2023-12-27 19:18:44,388][106225] Updated weights for policy 1, policy_version 11244 (0.0008) [2023-12-27 19:18:44,449][106225] Updated weights for policy 1, policy_version 11254 (0.0008) [2023-12-27 19:18:44,497][106225] Updated weights for policy 1, policy_version 11264 (0.0008) [2023-12-27 19:18:44,857][106226] Updated weights for policy 0, policy_version 11366 (0.0008) [2023-12-27 19:18:44,915][106226] Updated weights for policy 0, policy_version 11376 (0.0008) [2023-12-27 19:18:44,980][106226] Updated weights for policy 0, policy_version 11386 (0.0008) [2023-12-27 19:18:45,289][106225] Updated weights for policy 1, policy_version 11274 (0.0008) [2023-12-27 19:18:45,348][106225] Updated weights for policy 1, policy_version 11284 (0.0008) [2023-12-27 19:18:45,400][106225] Updated weights for policy 1, policy_version 11294 (0.0009) [2023-12-27 19:18:45,678][106226] Updated weights for policy 0, policy_version 11396 (0.0011) [2023-12-27 19:18:45,737][106226] Updated weights for policy 0, policy_version 11406 (0.0009) [2023-12-27 19:18:45,791][106226] Updated weights for policy 0, policy_version 11416 (0.0011) [2023-12-27 19:18:46,172][106225] Updated weights for policy 1, policy_version 11304 (0.0008) [2023-12-27 19:18:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 5816320. Throughput: 0: 10195.1, 1: 9964.8. Samples: 5809496. Policy #0 lag: (min: 29.0, avg: 30.8, max: 61.0) [2023-12-27 19:18:46,175][105115] Avg episode reward: [(0, '-6.235'), (1, '-6.872')] [2023-12-27 19:18:46,224][106225] Updated weights for policy 1, policy_version 11314 (0.0008) [2023-12-27 19:18:46,277][106225] Updated weights for policy 1, policy_version 11324 (0.0008) [2023-12-27 19:18:46,303][106141] Saving new best policy, reward=-6.872! [2023-12-27 19:18:46,424][106226] Updated weights for policy 0, policy_version 11426 (0.0009) [2023-12-27 19:18:46,484][106226] Updated weights for policy 0, policy_version 11436 (0.0009) [2023-12-27 19:18:46,536][106226] Updated weights for policy 0, policy_version 11446 (0.0010) [2023-12-27 19:18:46,585][106226] Updated weights for policy 0, policy_version 11456 (0.0010) [2023-12-27 19:18:47,047][106225] Updated weights for policy 1, policy_version 11334 (0.0008) [2023-12-27 19:18:47,091][106225] Updated weights for policy 1, policy_version 11344 (0.0008) [2023-12-27 19:18:47,136][106225] Updated weights for policy 1, policy_version 11354 (0.0007) [2023-12-27 19:18:47,288][106226] Updated weights for policy 0, policy_version 11466 (0.0011) [2023-12-27 19:18:47,347][106226] Updated weights for policy 0, policy_version 11476 (0.0010) [2023-12-27 19:18:47,400][106226] Updated weights for policy 0, policy_version 11486 (0.0010) [2023-12-27 19:18:47,831][106225] Updated weights for policy 1, policy_version 11364 (0.0008) [2023-12-27 19:18:47,893][106225] Updated weights for policy 1, policy_version 11374 (0.0008) [2023-12-27 19:18:47,960][106225] Updated weights for policy 1, policy_version 11384 (0.0008) [2023-12-27 19:18:48,083][106226] Updated weights for policy 0, policy_version 11496 (0.0008) [2023-12-27 19:18:48,132][106226] Updated weights for policy 0, policy_version 11506 (0.0009) [2023-12-27 19:18:48,191][106226] Updated weights for policy 0, policy_version 11516 (0.0009) [2023-12-27 19:18:48,666][106225] Updated weights for policy 1, policy_version 11394 (0.0007) [2023-12-27 19:18:48,730][106225] Updated weights for policy 1, policy_version 11404 (0.0009) [2023-12-27 19:18:48,793][106225] Updated weights for policy 1, policy_version 11414 (0.0006) [2023-12-27 19:18:48,863][106225] Updated weights for policy 1, policy_version 11424 (0.0006) [2023-12-27 19:18:48,941][106226] Updated weights for policy 0, policy_version 11526 (0.0008) [2023-12-27 19:18:48,998][106226] Updated weights for policy 0, policy_version 11536 (0.0008) [2023-12-27 19:18:49,055][106226] Updated weights for policy 0, policy_version 11546 (0.0008) [2023-12-27 19:18:49,409][106225] Updated weights for policy 1, policy_version 11434 (0.0010) [2023-12-27 19:18:49,470][106225] Updated weights for policy 1, policy_version 11444 (0.0010) [2023-12-27 19:18:49,533][106225] Updated weights for policy 1, policy_version 11454 (0.0010) [2023-12-27 19:18:49,812][106226] Updated weights for policy 0, policy_version 11556 (0.0008) [2023-12-27 19:18:49,883][106226] Updated weights for policy 0, policy_version 11566 (0.0008) [2023-12-27 19:18:49,952][106226] Updated weights for policy 0, policy_version 11576 (0.0008) [2023-12-27 19:18:50,271][106225] Updated weights for policy 1, policy_version 11464 (0.0006) [2023-12-27 19:18:50,330][106225] Updated weights for policy 1, policy_version 11474 (0.0007) [2023-12-27 19:18:50,387][106225] Updated weights for policy 1, policy_version 11484 (0.0010) [2023-12-27 19:18:50,695][106226] Updated weights for policy 0, policy_version 11586 (0.0007) [2023-12-27 19:18:50,754][106226] Updated weights for policy 0, policy_version 11596 (0.0008) [2023-12-27 19:18:50,821][106226] Updated weights for policy 0, policy_version 11606 (0.0008) [2023-12-27 19:18:50,875][106226] Updated weights for policy 0, policy_version 11616 (0.0007) [2023-12-27 19:18:51,074][106225] Updated weights for policy 1, policy_version 11494 (0.0009) [2023-12-27 19:18:51,140][106225] Updated weights for policy 1, policy_version 11504 (0.0008) [2023-12-27 19:18:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 5914624. Throughput: 0: 10144.2, 1: 9898.8. Samples: 5926876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:18:51,175][105115] Avg episode reward: [(0, '-6.874'), (1, '-7.243')] [2023-12-27 19:18:51,210][106225] Updated weights for policy 1, policy_version 11514 (0.0008) [2023-12-27 19:18:51,691][106226] Updated weights for policy 0, policy_version 11626 (0.0008) [2023-12-27 19:18:51,759][106226] Updated weights for policy 0, policy_version 11636 (0.0007) [2023-12-27 19:18:51,805][106226] Updated weights for policy 0, policy_version 11646 (0.0009) [2023-12-27 19:18:51,937][106225] Updated weights for policy 1, policy_version 11524 (0.0008) [2023-12-27 19:18:51,995][106225] Updated weights for policy 1, policy_version 11534 (0.0007) [2023-12-27 19:18:52,059][106225] Updated weights for policy 1, policy_version 11544 (0.0009) [2023-12-27 19:18:52,446][106226] Updated weights for policy 0, policy_version 11656 (0.0008) [2023-12-27 19:18:52,506][106226] Updated weights for policy 0, policy_version 11666 (0.0007) [2023-12-27 19:18:52,571][106226] Updated weights for policy 0, policy_version 11676 (0.0007) [2023-12-27 19:18:52,848][106225] Updated weights for policy 1, policy_version 11554 (0.0009) [2023-12-27 19:18:52,913][106225] Updated weights for policy 1, policy_version 11564 (0.0006) [2023-12-27 19:18:52,975][106225] Updated weights for policy 1, policy_version 11574 (0.0005) [2023-12-27 19:18:53,028][106225] Updated weights for policy 1, policy_version 11584 (0.0007) [2023-12-27 19:18:53,201][106226] Updated weights for policy 0, policy_version 11686 (0.0009) [2023-12-27 19:18:53,257][106226] Updated weights for policy 0, policy_version 11696 (0.0007) [2023-12-27 19:18:53,307][106226] Updated weights for policy 0, policy_version 11706 (0.0005) [2023-12-27 19:18:53,729][106225] Updated weights for policy 1, policy_version 11594 (0.0006) [2023-12-27 19:18:53,775][106225] Updated weights for policy 1, policy_version 11604 (0.0007) [2023-12-27 19:18:53,821][106225] Updated weights for policy 1, policy_version 11614 (0.0008) [2023-12-27 19:18:53,919][106226] Updated weights for policy 0, policy_version 11716 (0.0007) [2023-12-27 19:18:53,983][106226] Updated weights for policy 0, policy_version 11726 (0.0009) [2023-12-27 19:18:54,045][106226] Updated weights for policy 0, policy_version 11736 (0.0009) [2023-12-27 19:18:54,589][106225] Updated weights for policy 1, policy_version 11624 (0.0009) [2023-12-27 19:18:54,633][106225] Updated weights for policy 1, policy_version 11634 (0.0008) [2023-12-27 19:18:54,684][106225] Updated weights for policy 1, policy_version 11644 (0.0008) [2023-12-27 19:18:54,738][106226] Updated weights for policy 0, policy_version 11746 (0.0008) [2023-12-27 19:18:54,803][106226] Updated weights for policy 0, policy_version 11756 (0.0009) [2023-12-27 19:18:54,855][106226] Updated weights for policy 0, policy_version 11766 (0.0009) [2023-12-27 19:18:54,908][106226] Updated weights for policy 0, policy_version 11776 (0.0009) [2023-12-27 19:18:55,420][106225] Updated weights for policy 1, policy_version 11654 (0.0008) [2023-12-27 19:18:55,474][106225] Updated weights for policy 1, policy_version 11664 (0.0008) [2023-12-27 19:18:55,523][106225] Updated weights for policy 1, policy_version 11674 (0.0009) [2023-12-27 19:18:55,642][106226] Updated weights for policy 0, policy_version 11786 (0.0008) [2023-12-27 19:18:55,702][106226] Updated weights for policy 0, policy_version 11796 (0.0008) [2023-12-27 19:18:55,762][106226] Updated weights for policy 0, policy_version 11806 (0.0009) [2023-12-27 19:18:56,158][106225] Updated weights for policy 1, policy_version 11684 (0.0008) [2023-12-27 19:18:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 6012928. Throughput: 0: 10134.5, 1: 9861.3. Samples: 5986272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:18:56,175][105115] Avg episode reward: [(0, '-6.361'), (1, '-7.314')] [2023-12-27 19:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000011808_3022848.pth... [2023-12-27 19:18:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000010624_2719744.pth [2023-12-27 19:18:56,221][106225] Updated weights for policy 1, policy_version 11694 (0.0009) [2023-12-27 19:18:56,275][106225] Updated weights for policy 1, policy_version 11704 (0.0009) [2023-12-27 19:18:56,325][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000011712_2998272.pth... [2023-12-27 19:18:56,329][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000010560_2703360.pth [2023-12-27 19:18:56,524][106226] Updated weights for policy 0, policy_version 11816 (0.0008) [2023-12-27 19:18:56,569][106226] Updated weights for policy 0, policy_version 11826 (0.0008) [2023-12-27 19:18:56,621][106226] Updated weights for policy 0, policy_version 11836 (0.0009) [2023-12-27 19:18:57,007][106225] Updated weights for policy 1, policy_version 11714 (0.0009) [2023-12-27 19:18:57,055][106225] Updated weights for policy 1, policy_version 11724 (0.0005) [2023-12-27 19:18:57,109][106225] Updated weights for policy 1, policy_version 11734 (0.0005) [2023-12-27 19:18:57,169][106225] Updated weights for policy 1, policy_version 11744 (0.0007) [2023-12-27 19:18:57,381][106226] Updated weights for policy 0, policy_version 11846 (0.0007) [2023-12-27 19:18:57,445][106226] Updated weights for policy 0, policy_version 11856 (0.0007) [2023-12-27 19:18:57,517][106226] Updated weights for policy 0, policy_version 11866 (0.0006) [2023-12-27 19:18:57,768][106225] Updated weights for policy 1, policy_version 11754 (0.0005) [2023-12-27 19:18:57,825][106225] Updated weights for policy 1, policy_version 11764 (0.0006) [2023-12-27 19:18:57,884][106225] Updated weights for policy 1, policy_version 11774 (0.0006) [2023-12-27 19:18:58,293][106226] Updated weights for policy 0, policy_version 11876 (0.0008) [2023-12-27 19:18:58,363][106226] Updated weights for policy 0, policy_version 11886 (0.0008) [2023-12-27 19:18:58,432][106226] Updated weights for policy 0, policy_version 11896 (0.0007) [2023-12-27 19:18:58,465][106225] Updated weights for policy 1, policy_version 11784 (0.0008) [2023-12-27 19:18:58,534][106225] Updated weights for policy 1, policy_version 11794 (0.0008) [2023-12-27 19:18:58,608][106225] Updated weights for policy 1, policy_version 11804 (0.0008) [2023-12-27 19:18:59,185][106226] Updated weights for policy 0, policy_version 11906 (0.0008) [2023-12-27 19:18:59,254][106226] Updated weights for policy 0, policy_version 11916 (0.0008) [2023-12-27 19:18:59,314][106226] Updated weights for policy 0, policy_version 11926 (0.0008) [2023-12-27 19:18:59,388][106226] Updated weights for policy 0, policy_version 11936 (0.0008) [2023-12-27 19:18:59,405][106225] Updated weights for policy 1, policy_version 11814 (0.0008) [2023-12-27 19:18:59,462][106225] Updated weights for policy 1, policy_version 11824 (0.0008) [2023-12-27 19:18:59,520][106225] Updated weights for policy 1, policy_version 11834 (0.0009) [2023-12-27 19:19:00,019][106226] Updated weights for policy 0, policy_version 11946 (0.0008) [2023-12-27 19:19:00,076][106226] Updated weights for policy 0, policy_version 11956 (0.0008) [2023-12-27 19:19:00,139][106226] Updated weights for policy 0, policy_version 11966 (0.0008) [2023-12-27 19:19:00,276][106225] Updated weights for policy 1, policy_version 11844 (0.0007) [2023-12-27 19:19:00,323][106225] Updated weights for policy 1, policy_version 11854 (0.0008) [2023-12-27 19:19:00,374][106225] Updated weights for policy 1, policy_version 11864 (0.0009) [2023-12-27 19:19:00,811][106226] Updated weights for policy 0, policy_version 11976 (0.0007) [2023-12-27 19:19:00,868][106226] Updated weights for policy 0, policy_version 11986 (0.0008) [2023-12-27 19:19:00,916][106226] Updated weights for policy 0, policy_version 11996 (0.0008) [2023-12-27 19:19:01,100][106225] Updated weights for policy 1, policy_version 11874 (0.0008) [2023-12-27 19:19:01,162][106225] Updated weights for policy 1, policy_version 11884 (0.0007) [2023-12-27 19:19:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 6111232. Throughput: 0: 10097.0, 1: 9877.8. Samples: 6102344. Policy #0 lag: (min: 18.0, avg: 22.8, max: 50.0) [2023-12-27 19:19:01,175][105115] Avg episode reward: [(0, '-6.231'), (1, '-6.707')] [2023-12-27 19:19:01,229][106225] Updated weights for policy 1, policy_version 11894 (0.0007) [2023-12-27 19:19:01,294][106141] Saving new best policy, reward=-6.707! [2023-12-27 19:19:01,295][106225] Updated weights for policy 1, policy_version 11904 (0.0009) [2023-12-27 19:19:01,706][106226] Updated weights for policy 0, policy_version 12006 (0.0007) [2023-12-27 19:19:01,776][106226] Updated weights for policy 0, policy_version 12016 (0.0006) [2023-12-27 19:19:01,836][106226] Updated weights for policy 0, policy_version 12026 (0.0009) [2023-12-27 19:19:01,971][106225] Updated weights for policy 1, policy_version 11914 (0.0006) [2023-12-27 19:19:02,036][106225] Updated weights for policy 1, policy_version 11924 (0.0006) [2023-12-27 19:19:02,097][106225] Updated weights for policy 1, policy_version 11934 (0.0007) [2023-12-27 19:19:02,521][106226] Updated weights for policy 0, policy_version 12036 (0.0009) [2023-12-27 19:19:02,578][106226] Updated weights for policy 0, policy_version 12046 (0.0009) [2023-12-27 19:19:02,635][106226] Updated weights for policy 0, policy_version 12056 (0.0009) [2023-12-27 19:19:02,730][106225] Updated weights for policy 1, policy_version 11944 (0.0006) [2023-12-27 19:19:02,783][106225] Updated weights for policy 1, policy_version 11954 (0.0006) [2023-12-27 19:19:02,843][106225] Updated weights for policy 1, policy_version 11964 (0.0005) [2023-12-27 19:19:03,268][106226] Updated weights for policy 0, policy_version 12066 (0.0006) [2023-12-27 19:19:03,319][106226] Updated weights for policy 0, policy_version 12076 (0.0005) [2023-12-27 19:19:03,372][106226] Updated weights for policy 0, policy_version 12086 (0.0005) [2023-12-27 19:19:03,413][106225] Updated weights for policy 1, policy_version 11974 (0.0006) [2023-12-27 19:19:03,424][106226] Updated weights for policy 0, policy_version 12096 (0.0006) [2023-12-27 19:19:03,505][106225] Updated weights for policy 1, policy_version 11984 (0.0007) [2023-12-27 19:19:03,560][106225] Updated weights for policy 1, policy_version 11994 (0.0006) [2023-12-27 19:19:04,064][106226] Updated weights for policy 0, policy_version 12106 (0.0007) [2023-12-27 19:19:04,123][106226] Updated weights for policy 0, policy_version 12116 (0.0007) [2023-12-27 19:19:04,153][106225] Updated weights for policy 1, policy_version 12004 (0.0007) [2023-12-27 19:19:04,179][106226] Updated weights for policy 0, policy_version 12126 (0.0007) [2023-12-27 19:19:04,215][106225] Updated weights for policy 1, policy_version 12014 (0.0010) [2023-12-27 19:19:04,277][106225] Updated weights for policy 1, policy_version 12024 (0.0010) [2023-12-27 19:19:04,908][106226] Updated weights for policy 0, policy_version 12136 (0.0007) [2023-12-27 19:19:04,932][106225] Updated weights for policy 1, policy_version 12034 (0.0010) [2023-12-27 19:19:04,957][106226] Updated weights for policy 0, policy_version 12146 (0.0007) [2023-12-27 19:19:04,985][106225] Updated weights for policy 1, policy_version 12044 (0.0007) [2023-12-27 19:19:05,005][106226] Updated weights for policy 0, policy_version 12156 (0.0006) [2023-12-27 19:19:05,039][106225] Updated weights for policy 1, policy_version 12054 (0.0009) [2023-12-27 19:19:05,086][106225] Updated weights for policy 1, policy_version 12064 (0.0010) [2023-12-27 19:19:05,576][106226] Updated weights for policy 0, policy_version 12166 (0.0005) [2023-12-27 19:19:05,626][106226] Updated weights for policy 0, policy_version 12176 (0.0007) [2023-12-27 19:19:05,688][106226] Updated weights for policy 0, policy_version 12186 (0.0006) [2023-12-27 19:19:05,705][106225] Updated weights for policy 1, policy_version 12074 (0.0010) [2023-12-27 19:19:05,751][106225] Updated weights for policy 1, policy_version 12084 (0.0008) [2023-12-27 19:19:05,799][106225] Updated weights for policy 1, policy_version 12094 (0.0005) [2023-12-27 19:19:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 6217728. Throughput: 0: 10136.6, 1: 9896.1. Samples: 6227428. Policy #0 lag: (min: 18.0, avg: 22.8, max: 50.0) [2023-12-27 19:19:06,175][105115] Avg episode reward: [(0, '-6.064'), (1, '-6.793')] [2023-12-27 19:19:06,176][106140] Saving new best policy, reward=-6.064! [2023-12-27 19:19:06,437][106226] Updated weights for policy 0, policy_version 12196 (0.0006) [2023-12-27 19:19:06,443][106225] Updated weights for policy 1, policy_version 12104 (0.0010) [2023-12-27 19:19:06,495][106226] Updated weights for policy 0, policy_version 12206 (0.0006) [2023-12-27 19:19:06,508][106225] Updated weights for policy 1, policy_version 12114 (0.0011) [2023-12-27 19:19:06,560][106226] Updated weights for policy 0, policy_version 12216 (0.0006) [2023-12-27 19:19:06,569][106225] Updated weights for policy 1, policy_version 12124 (0.0011) [2023-12-27 19:19:07,238][106225] Updated weights for policy 1, policy_version 12134 (0.0010) [2023-12-27 19:19:07,295][106225] Updated weights for policy 1, policy_version 12144 (0.0010) [2023-12-27 19:19:07,320][106226] Updated weights for policy 0, policy_version 12226 (0.0007) [2023-12-27 19:19:07,353][106225] Updated weights for policy 1, policy_version 12154 (0.0010) [2023-12-27 19:19:07,374][106226] Updated weights for policy 0, policy_version 12236 (0.0005) [2023-12-27 19:19:07,434][106226] Updated weights for policy 0, policy_version 12246 (0.0007) [2023-12-27 19:19:07,484][106226] Updated weights for policy 0, policy_version 12256 (0.0007) [2023-12-27 19:19:08,075][106225] Updated weights for policy 1, policy_version 12164 (0.0010) [2023-12-27 19:19:08,135][106225] Updated weights for policy 1, policy_version 12174 (0.0010) [2023-12-27 19:19:08,195][106225] Updated weights for policy 1, policy_version 12184 (0.0010) [2023-12-27 19:19:08,221][106226] Updated weights for policy 0, policy_version 12266 (0.0006) [2023-12-27 19:19:08,282][106226] Updated weights for policy 0, policy_version 12276 (0.0006) [2023-12-27 19:19:08,352][106226] Updated weights for policy 0, policy_version 12286 (0.0008) [2023-12-27 19:19:08,873][106225] Updated weights for policy 1, policy_version 12194 (0.0010) [2023-12-27 19:19:08,941][106225] Updated weights for policy 1, policy_version 12204 (0.0010) [2023-12-27 19:19:08,991][106226] Updated weights for policy 0, policy_version 12296 (0.0006) [2023-12-27 19:19:08,993][106225] Updated weights for policy 1, policy_version 12214 (0.0010) [2023-12-27 19:19:09,054][106226] Updated weights for policy 0, policy_version 12306 (0.0006) [2023-12-27 19:19:09,054][106225] Updated weights for policy 1, policy_version 12224 (0.0010) [2023-12-27 19:19:09,117][106226] Updated weights for policy 0, policy_version 12316 (0.0009) [2023-12-27 19:19:09,744][106225] Updated weights for policy 1, policy_version 12234 (0.0011) [2023-12-27 19:19:09,805][106225] Updated weights for policy 1, policy_version 12244 (0.0010) [2023-12-27 19:19:09,848][106226] Updated weights for policy 0, policy_version 12326 (0.0009) [2023-12-27 19:19:09,869][106225] Updated weights for policy 1, policy_version 12254 (0.0010) [2023-12-27 19:19:09,913][106226] Updated weights for policy 0, policy_version 12336 (0.0010) [2023-12-27 19:19:09,969][106226] Updated weights for policy 0, policy_version 12346 (0.0009) [2023-12-27 19:19:10,607][106225] Updated weights for policy 1, policy_version 12264 (0.0010) [2023-12-27 19:19:10,657][106225] Updated weights for policy 1, policy_version 12274 (0.0010) [2023-12-27 19:19:10,690][106226] Updated weights for policy 0, policy_version 12356 (0.0007) [2023-12-27 19:19:10,710][106225] Updated weights for policy 1, policy_version 12284 (0.0010) [2023-12-27 19:19:10,752][106226] Updated weights for policy 0, policy_version 12366 (0.0006) [2023-12-27 19:19:10,800][106226] Updated weights for policy 0, policy_version 12376 (0.0007) [2023-12-27 19:19:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.5, 300 sec: 19883.0). Total num frames: 6316032. Throughput: 0: 10132.4, 1: 9937.4. Samples: 6286532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:19:11,175][105115] Avg episode reward: [(0, '-6.091'), (1, '-6.959')] [2023-12-27 19:19:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000012288_3145728.pth... [2023-12-27 19:19:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000012384_3170304.pth... [2023-12-27 19:19:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000011232_2875392.pth [2023-12-27 19:19:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000011136_2850816.pth [2023-12-27 19:19:11,487][106225] Updated weights for policy 1, policy_version 12294 (0.0007) [2023-12-27 19:19:11,515][106226] Updated weights for policy 0, policy_version 12386 (0.0007) [2023-12-27 19:19:11,546][106225] Updated weights for policy 1, policy_version 12304 (0.0011) [2023-12-27 19:19:11,575][106226] Updated weights for policy 0, policy_version 12396 (0.0008) [2023-12-27 19:19:11,586][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000001 [2023-12-27 19:19:11,641][106226] Updated weights for policy 0, policy_version 12406 (0.0008) [2023-12-27 19:19:11,714][106226] Updated weights for policy 0, policy_version 12416 (0.0008) [2023-12-27 19:19:12,234][106225] Updated weights for policy 1, policy_version 12314 (0.0009) [2023-12-27 19:19:12,301][106225] Updated weights for policy 1, policy_version 12324 (0.0008) [2023-12-27 19:19:12,369][106225] Updated weights for policy 1, policy_version 12334 (0.0008) [2023-12-27 19:19:12,432][106225] Updated weights for policy 1, policy_version 12344 (0.0009) [2023-12-27 19:19:12,566][106226] Updated weights for policy 0, policy_version 12426 (0.0008) [2023-12-27 19:19:12,629][106226] Updated weights for policy 0, policy_version 12436 (0.0008) [2023-12-27 19:19:12,695][106226] Updated weights for policy 0, policy_version 12446 (0.0008) [2023-12-27 19:19:13,131][106225] Updated weights for policy 1, policy_version 12354 (0.0008) [2023-12-27 19:19:13,187][106225] Updated weights for policy 1, policy_version 12364 (0.0008) [2023-12-27 19:19:13,235][106225] Updated weights for policy 1, policy_version 12374 (0.0008) [2023-12-27 19:19:13,381][106226] Updated weights for policy 0, policy_version 12456 (0.0005) [2023-12-27 19:19:13,433][106226] Updated weights for policy 0, policy_version 12466 (0.0005) [2023-12-27 19:19:13,488][106226] Updated weights for policy 0, policy_version 12476 (0.0007) [2023-12-27 19:19:13,995][106225] Updated weights for policy 1, policy_version 12384 (0.0009) [2023-12-27 19:19:14,054][106225] Updated weights for policy 1, policy_version 12394 (0.0009) [2023-12-27 19:19:14,113][106225] Updated weights for policy 1, policy_version 12404 (0.0008) [2023-12-27 19:19:14,153][106226] Updated weights for policy 0, policy_version 12486 (0.0008) [2023-12-27 19:19:14,218][106226] Updated weights for policy 0, policy_version 12496 (0.0008) [2023-12-27 19:19:14,273][106226] Updated weights for policy 0, policy_version 12506 (0.0008) [2023-12-27 19:19:14,848][106225] Updated weights for policy 1, policy_version 12414 (0.0007) [2023-12-27 19:19:14,909][106225] Updated weights for policy 1, policy_version 12424 (0.0008) [2023-12-27 19:19:14,972][106225] Updated weights for policy 1, policy_version 12434 (0.0007) [2023-12-27 19:19:15,014][106226] Updated weights for policy 0, policy_version 12516 (0.0008) [2023-12-27 19:19:15,075][106226] Updated weights for policy 0, policy_version 12526 (0.0009) [2023-12-27 19:19:15,145][106226] Updated weights for policy 0, policy_version 12536 (0.0006) [2023-12-27 19:19:15,684][106225] Updated weights for policy 1, policy_version 12444 (0.0008) [2023-12-27 19:19:15,747][106225] Updated weights for policy 1, policy_version 12454 (0.0006) [2023-12-27 19:19:15,765][106226] Updated weights for policy 0, policy_version 12546 (0.0006) [2023-12-27 19:19:15,801][106225] Updated weights for policy 1, policy_version 12464 (0.0006) [2023-12-27 19:19:15,817][106226] Updated weights for policy 0, policy_version 12556 (0.0008) [2023-12-27 19:19:15,872][106226] Updated weights for policy 0, policy_version 12566 (0.0009) [2023-12-27 19:19:15,938][106226] Updated weights for policy 0, policy_version 12576 (0.0008) [2023-12-27 19:19:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 6414336. Throughput: 0: 9941.6, 1: 9843.9. Samples: 6401768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:19:16,175][105115] Avg episode reward: [(0, '-6.373'), (1, '-6.516')] [2023-12-27 19:19:16,176][106141] Saving new best policy, reward=-6.516! [2023-12-27 19:19:16,450][106225] Updated weights for policy 1, policy_version 12474 (0.0007) [2023-12-27 19:19:16,496][106225] Updated weights for policy 1, policy_version 12484 (0.0007) [2023-12-27 19:19:16,540][106225] Updated weights for policy 1, policy_version 12494 (0.0008) [2023-12-27 19:19:16,601][106225] Updated weights for policy 1, policy_version 12504 (0.0008) [2023-12-27 19:19:16,703][106226] Updated weights for policy 0, policy_version 12586 (0.0007) [2023-12-27 19:19:16,757][106226] Updated weights for policy 0, policy_version 12596 (0.0005) [2023-12-27 19:19:16,812][106226] Updated weights for policy 0, policy_version 12606 (0.0005) [2023-12-27 19:19:17,277][106225] Updated weights for policy 1, policy_version 12514 (0.0009) [2023-12-27 19:19:17,333][106225] Updated weights for policy 1, policy_version 12524 (0.0009) [2023-12-27 19:19:17,358][106226] Updated weights for policy 0, policy_version 12616 (0.0006) [2023-12-27 19:19:17,386][106225] Updated weights for policy 1, policy_version 12534 (0.0008) [2023-12-27 19:19:17,412][106226] Updated weights for policy 0, policy_version 12626 (0.0006) [2023-12-27 19:19:17,466][106226] Updated weights for policy 0, policy_version 12636 (0.0005) [2023-12-27 19:19:18,021][106226] Updated weights for policy 0, policy_version 12646 (0.0005) [2023-12-27 19:19:18,043][106225] Updated weights for policy 1, policy_version 12544 (0.0008) [2023-12-27 19:19:18,072][106226] Updated weights for policy 0, policy_version 12656 (0.0006) [2023-12-27 19:19:18,086][106225] Updated weights for policy 1, policy_version 12554 (0.0007) [2023-12-27 19:19:18,124][106226] Updated weights for policy 0, policy_version 12666 (0.0007) [2023-12-27 19:19:18,137][106225] Updated weights for policy 1, policy_version 12564 (0.0007) [2023-12-27 19:19:18,817][106226] Updated weights for policy 0, policy_version 12676 (0.0007) [2023-12-27 19:19:18,882][106226] Updated weights for policy 0, policy_version 12686 (0.0009) [2023-12-27 19:19:18,888][106225] Updated weights for policy 1, policy_version 12574 (0.0008) [2023-12-27 19:19:18,943][106225] Updated weights for policy 1, policy_version 12584 (0.0005) [2023-12-27 19:19:18,946][106226] Updated weights for policy 0, policy_version 12696 (0.0008) [2023-12-27 19:19:19,001][106225] Updated weights for policy 1, policy_version 12594 (0.0007) [2023-12-27 19:19:19,641][106225] Updated weights for policy 1, policy_version 12604 (0.0007) [2023-12-27 19:19:19,703][106225] Updated weights for policy 1, policy_version 12614 (0.0008) [2023-12-27 19:19:19,716][106226] Updated weights for policy 0, policy_version 12706 (0.0007) [2023-12-27 19:19:19,751][106225] Updated weights for policy 1, policy_version 12624 (0.0007) [2023-12-27 19:19:19,786][106226] Updated weights for policy 0, policy_version 12716 (0.0007) [2023-12-27 19:19:19,854][106226] Updated weights for policy 0, policy_version 12726 (0.0009) [2023-12-27 19:19:20,450][106225] Updated weights for policy 1, policy_version 12634 (0.0007) [2023-12-27 19:19:20,462][106226] Updated weights for policy 0, policy_version 12737 (0.0007) [2023-12-27 19:19:20,512][106225] Updated weights for policy 1, policy_version 12644 (0.0007) [2023-12-27 19:19:20,528][106226] Updated weights for policy 0, policy_version 12747 (0.0005) [2023-12-27 19:19:20,573][106225] Updated weights for policy 1, policy_version 12654 (0.0007) [2023-12-27 19:19:20,595][106226] Updated weights for policy 0, policy_version 12757 (0.0007) [2023-12-27 19:19:20,646][106225] Updated weights for policy 1, policy_version 12664 (0.0008) [2023-12-27 19:19:20,658][106226] Updated weights for policy 0, policy_version 12767 (0.0008) [2023-12-27 19:19:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 6512640. Throughput: 0: 9905.0, 1: 9840.0. Samples: 6524504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:19:21,175][105115] Avg episode reward: [(0, '-6.544'), (1, '-7.049')] [2023-12-27 19:19:21,336][106225] Updated weights for policy 1, policy_version 12674 (0.0008) [2023-12-27 19:19:21,364][106226] Updated weights for policy 0, policy_version 12777 (0.0007) [2023-12-27 19:19:21,410][106225] Updated weights for policy 1, policy_version 12684 (0.0008) [2023-12-27 19:19:21,437][106226] Updated weights for policy 0, policy_version 12787 (0.0009) [2023-12-27 19:19:21,470][106225] Updated weights for policy 1, policy_version 12694 (0.0008) [2023-12-27 19:19:21,498][106226] Updated weights for policy 0, policy_version 12797 (0.0011) [2023-12-27 19:19:22,211][106226] Updated weights for policy 0, policy_version 12807 (0.0007) [2023-12-27 19:19:22,256][106225] Updated weights for policy 1, policy_version 12704 (0.0009) [2023-12-27 19:19:22,276][106226] Updated weights for policy 0, policy_version 12817 (0.0008) [2023-12-27 19:19:22,320][106225] Updated weights for policy 1, policy_version 12714 (0.0007) [2023-12-27 19:19:22,339][106226] Updated weights for policy 0, policy_version 12827 (0.0008) [2023-12-27 19:19:22,389][106225] Updated weights for policy 1, policy_version 12724 (0.0009) [2023-12-27 19:19:23,072][106225] Updated weights for policy 1, policy_version 12734 (0.0006) [2023-12-27 19:19:23,109][106226] Updated weights for policy 0, policy_version 12837 (0.0008) [2023-12-27 19:19:23,126][106225] Updated weights for policy 1, policy_version 12744 (0.0005) [2023-12-27 19:19:23,165][106226] Updated weights for policy 0, policy_version 12847 (0.0008) [2023-12-27 19:19:23,189][106225] Updated weights for policy 1, policy_version 12754 (0.0006) [2023-12-27 19:19:23,234][106226] Updated weights for policy 0, policy_version 12857 (0.0006) [2023-12-27 19:19:23,751][106225] Updated weights for policy 1, policy_version 12764 (0.0005) [2023-12-27 19:19:23,806][106225] Updated weights for policy 1, policy_version 12774 (0.0007) [2023-12-27 19:19:23,859][106225] Updated weights for policy 1, policy_version 12784 (0.0010) [2023-12-27 19:19:23,987][106226] Updated weights for policy 0, policy_version 12867 (0.0009) [2023-12-27 19:19:24,047][106226] Updated weights for policy 0, policy_version 12877 (0.0008) [2023-12-27 19:19:24,097][106226] Updated weights for policy 0, policy_version 12887 (0.0009) [2023-12-27 19:19:24,595][106225] Updated weights for policy 1, policy_version 12794 (0.0009) [2023-12-27 19:19:24,651][106225] Updated weights for policy 1, policy_version 12804 (0.0006) [2023-12-27 19:19:24,703][106225] Updated weights for policy 1, policy_version 12814 (0.0007) [2023-12-27 19:19:24,763][106225] Updated weights for policy 1, policy_version 12824 (0.0005) [2023-12-27 19:19:24,825][106226] Updated weights for policy 0, policy_version 12897 (0.0008) [2023-12-27 19:19:24,892][106226] Updated weights for policy 0, policy_version 12907 (0.0006) [2023-12-27 19:19:24,957][106226] Updated weights for policy 0, policy_version 12917 (0.0005) [2023-12-27 19:19:25,021][106226] Updated weights for policy 0, policy_version 12927 (0.0006) [2023-12-27 19:19:25,452][106225] Updated weights for policy 1, policy_version 12834 (0.0007) [2023-12-27 19:19:25,501][106225] Updated weights for policy 1, policy_version 12844 (0.0009) [2023-12-27 19:19:25,550][106225] Updated weights for policy 1, policy_version 12854 (0.0008) [2023-12-27 19:19:25,577][106226] Updated weights for policy 0, policy_version 12937 (0.0006) [2023-12-27 19:19:25,639][106226] Updated weights for policy 0, policy_version 12947 (0.0006) [2023-12-27 19:19:25,685][106226] Updated weights for policy 0, policy_version 12957 (0.0010) [2023-12-27 19:19:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 6610944. Throughput: 0: 9877.9, 1: 9864.6. Samples: 6582940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:19:26,175][105115] Avg episode reward: [(0, '-5.731'), (1, '-6.865')] [2023-12-27 19:19:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000012960_3317760.pth... [2023-12-27 19:19:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000012856_3293184.pth... [2023-12-27 19:19:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000011808_3022848.pth [2023-12-27 19:19:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000011712_2998272.pth [2023-12-27 19:19:26,186][106140] Saving new best policy, reward=-5.731! [2023-12-27 19:19:26,254][106226] Updated weights for policy 0, policy_version 12967 (0.0007) [2023-12-27 19:19:26,322][106226] Updated weights for policy 0, policy_version 12977 (0.0006) [2023-12-27 19:19:26,354][106225] Updated weights for policy 1, policy_version 12864 (0.0008) [2023-12-27 19:19:26,389][106226] Updated weights for policy 0, policy_version 12987 (0.0006) [2023-12-27 19:19:26,411][106225] Updated weights for policy 1, policy_version 12874 (0.0005) [2023-12-27 19:19:26,464][106225] Updated weights for policy 1, policy_version 12884 (0.0005) [2023-12-27 19:19:26,926][106226] Updated weights for policy 0, policy_version 12997 (0.0007) [2023-12-27 19:19:26,969][106226] Updated weights for policy 0, policy_version 13007 (0.0007) [2023-12-27 19:19:27,023][106226] Updated weights for policy 0, policy_version 13017 (0.0005) [2023-12-27 19:19:27,205][106225] Updated weights for policy 1, policy_version 12894 (0.0007) [2023-12-27 19:19:27,257][106225] Updated weights for policy 1, policy_version 12904 (0.0008) [2023-12-27 19:19:27,311][106225] Updated weights for policy 1, policy_version 12914 (0.0009) [2023-12-27 19:19:27,642][106226] Updated weights for policy 0, policy_version 13027 (0.0005) [2023-12-27 19:19:27,690][106226] Updated weights for policy 0, policy_version 13037 (0.0005) [2023-12-27 19:19:27,743][106226] Updated weights for policy 0, policy_version 13047 (0.0005) [2023-12-27 19:19:28,110][106225] Updated weights for policy 1, policy_version 12924 (0.0010) [2023-12-27 19:19:28,169][106225] Updated weights for policy 1, policy_version 12934 (0.0009) [2023-12-27 19:19:28,228][106225] Updated weights for policy 1, policy_version 12944 (0.0009) [2023-12-27 19:19:28,306][106226] Updated weights for policy 0, policy_version 13057 (0.0005) [2023-12-27 19:19:28,372][106226] Updated weights for policy 0, policy_version 13067 (0.0009) [2023-12-27 19:19:28,427][106226] Updated weights for policy 0, policy_version 13077 (0.0008) [2023-12-27 19:19:28,488][106226] Updated weights for policy 0, policy_version 13087 (0.0008) [2023-12-27 19:19:28,926][106225] Updated weights for policy 1, policy_version 12954 (0.0009) [2023-12-27 19:19:28,978][106225] Updated weights for policy 1, policy_version 12964 (0.0009) [2023-12-27 19:19:29,026][106225] Updated weights for policy 1, policy_version 12974 (0.0005) [2023-12-27 19:19:29,091][106225] Updated weights for policy 1, policy_version 12984 (0.0005) [2023-12-27 19:19:29,233][106226] Updated weights for policy 0, policy_version 13097 (0.0007) [2023-12-27 19:19:29,299][106226] Updated weights for policy 0, policy_version 13107 (0.0008) [2023-12-27 19:19:29,369][106226] Updated weights for policy 0, policy_version 13117 (0.0008) [2023-12-27 19:19:29,841][106225] Updated weights for policy 1, policy_version 12994 (0.0006) [2023-12-27 19:19:29,902][106225] Updated weights for policy 1, policy_version 13004 (0.0006) [2023-12-27 19:19:29,969][106225] Updated weights for policy 1, policy_version 13014 (0.0007) [2023-12-27 19:19:30,021][106226] Updated weights for policy 0, policy_version 13127 (0.0008) [2023-12-27 19:19:30,078][106226] Updated weights for policy 0, policy_version 13137 (0.0006) [2023-12-27 19:19:30,142][106226] Updated weights for policy 0, policy_version 13147 (0.0006) [2023-12-27 19:19:30,664][106225] Updated weights for policy 1, policy_version 13024 (0.0008) [2023-12-27 19:19:30,714][106225] Updated weights for policy 1, policy_version 13034 (0.0008) [2023-12-27 19:19:30,754][106226] Updated weights for policy 0, policy_version 13157 (0.0007) [2023-12-27 19:19:30,761][106225] Updated weights for policy 1, policy_version 13044 (0.0008) [2023-12-27 19:19:30,801][106226] Updated weights for policy 0, policy_version 13167 (0.0005) [2023-12-27 19:19:30,848][106226] Updated weights for policy 0, policy_version 13177 (0.0007) [2023-12-27 19:19:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 6717440. Throughput: 0: 9967.4, 1: 9924.6. Samples: 6704636. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-27 19:19:31,175][105115] Avg episode reward: [(0, '-6.618'), (1, '-6.508')] [2023-12-27 19:19:31,176][106141] Saving new best policy, reward=-6.508! [2023-12-27 19:19:31,544][106225] Updated weights for policy 1, policy_version 13054 (0.0006) [2023-12-27 19:19:31,594][106225] Updated weights for policy 1, policy_version 13064 (0.0007) [2023-12-27 19:19:31,598][106226] Updated weights for policy 0, policy_version 13187 (0.0009) [2023-12-27 19:19:31,657][106225] Updated weights for policy 1, policy_version 13074 (0.0007) [2023-12-27 19:19:31,662][106226] Updated weights for policy 0, policy_version 13197 (0.0010) [2023-12-27 19:19:31,725][106226] Updated weights for policy 0, policy_version 13207 (0.0007) [2023-12-27 19:19:32,369][106225] Updated weights for policy 1, policy_version 13084 (0.0006) [2023-12-27 19:19:32,431][106225] Updated weights for policy 1, policy_version 13094 (0.0008) [2023-12-27 19:19:32,465][106226] Updated weights for policy 0, policy_version 13217 (0.0008) [2023-12-27 19:19:32,491][106225] Updated weights for policy 1, policy_version 13104 (0.0006) [2023-12-27 19:19:32,526][106226] Updated weights for policy 0, policy_version 13227 (0.0006) [2023-12-27 19:19:32,595][106226] Updated weights for policy 0, policy_version 13237 (0.0008) [2023-12-27 19:19:32,659][106226] Updated weights for policy 0, policy_version 13247 (0.0008) [2023-12-27 19:19:33,139][106225] Updated weights for policy 1, policy_version 13114 (0.0007) [2023-12-27 19:19:33,192][106225] Updated weights for policy 1, policy_version 13124 (0.0007) [2023-12-27 19:19:33,248][106225] Updated weights for policy 1, policy_version 13134 (0.0008) [2023-12-27 19:19:33,296][106225] Updated weights for policy 1, policy_version 13144 (0.0008) [2023-12-27 19:19:33,357][106226] Updated weights for policy 0, policy_version 13257 (0.0010) [2023-12-27 19:19:33,414][106226] Updated weights for policy 0, policy_version 13267 (0.0010) [2023-12-27 19:19:33,468][106226] Updated weights for policy 0, policy_version 13277 (0.0007) [2023-12-27 19:19:33,943][106225] Updated weights for policy 1, policy_version 13154 (0.0005) [2023-12-27 19:19:33,995][106225] Updated weights for policy 1, policy_version 13164 (0.0005) [2023-12-27 19:19:34,045][106225] Updated weights for policy 1, policy_version 13174 (0.0005) [2023-12-27 19:19:34,146][106226] Updated weights for policy 0, policy_version 13287 (0.0008) [2023-12-27 19:19:34,203][106226] Updated weights for policy 0, policy_version 13297 (0.0009) [2023-12-27 19:19:34,264][106226] Updated weights for policy 0, policy_version 13307 (0.0010) [2023-12-27 19:19:34,757][106225] Updated weights for policy 1, policy_version 13184 (0.0008) [2023-12-27 19:19:34,823][106225] Updated weights for policy 1, policy_version 13194 (0.0008) [2023-12-27 19:19:34,879][106226] Updated weights for policy 0, policy_version 13317 (0.0009) [2023-12-27 19:19:34,881][106225] Updated weights for policy 1, policy_version 13204 (0.0007) [2023-12-27 19:19:34,933][106226] Updated weights for policy 0, policy_version 13327 (0.0010) [2023-12-27 19:19:34,979][106226] Updated weights for policy 0, policy_version 13337 (0.0010) [2023-12-27 19:19:35,588][106225] Updated weights for policy 1, policy_version 13214 (0.0005) [2023-12-27 19:19:35,651][106225] Updated weights for policy 1, policy_version 13224 (0.0005) [2023-12-27 19:19:35,704][106226] Updated weights for policy 0, policy_version 13347 (0.0010) [2023-12-27 19:19:35,714][106225] Updated weights for policy 1, policy_version 13234 (0.0009) [2023-12-27 19:19:35,761][106226] Updated weights for policy 0, policy_version 13357 (0.0009) [2023-12-27 19:19:35,816][106226] Updated weights for policy 0, policy_version 13367 (0.0008) [2023-12-27 19:19:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 6815744. Throughput: 0: 10006.7, 1: 9950.6. Samples: 6824952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-27 19:19:36,175][105115] Avg episode reward: [(0, '-6.156'), (1, '-6.664')] [2023-12-27 19:19:36,276][106225] Updated weights for policy 1, policy_version 13244 (0.0008) [2023-12-27 19:19:36,333][106225] Updated weights for policy 1, policy_version 13254 (0.0006) [2023-12-27 19:19:36,389][106225] Updated weights for policy 1, policy_version 13264 (0.0006) [2023-12-27 19:19:36,563][106226] Updated weights for policy 0, policy_version 13377 (0.0007) [2023-12-27 19:19:36,629][106226] Updated weights for policy 0, policy_version 13387 (0.0010) [2023-12-27 19:19:36,692][106226] Updated weights for policy 0, policy_version 13397 (0.0008) [2023-12-27 19:19:36,752][106226] Updated weights for policy 0, policy_version 13407 (0.0008) [2023-12-27 19:19:37,017][106225] Updated weights for policy 1, policy_version 13274 (0.0011) [2023-12-27 19:19:37,066][106225] Updated weights for policy 1, policy_version 13284 (0.0010) [2023-12-27 19:19:37,113][106225] Updated weights for policy 1, policy_version 13294 (0.0010) [2023-12-27 19:19:37,168][106225] Updated weights for policy 1, policy_version 13304 (0.0006) [2023-12-27 19:19:37,441][106226] Updated weights for policy 0, policy_version 13417 (0.0006) [2023-12-27 19:19:37,509][106226] Updated weights for policy 0, policy_version 13427 (0.0008) [2023-12-27 19:19:37,559][106226] Updated weights for policy 0, policy_version 13437 (0.0010) [2023-12-27 19:19:37,842][106225] Updated weights for policy 1, policy_version 13314 (0.0007) [2023-12-27 19:19:37,906][106225] Updated weights for policy 1, policy_version 13324 (0.0008) [2023-12-27 19:19:37,970][106225] Updated weights for policy 1, policy_version 13334 (0.0008) [2023-12-27 19:19:38,236][106226] Updated weights for policy 0, policy_version 13447 (0.0010) [2023-12-27 19:19:38,296][106226] Updated weights for policy 0, policy_version 13457 (0.0010) [2023-12-27 19:19:38,361][106226] Updated weights for policy 0, policy_version 13467 (0.0011) [2023-12-27 19:19:38,643][106225] Updated weights for policy 1, policy_version 13344 (0.0007) [2023-12-27 19:19:38,708][106225] Updated weights for policy 1, policy_version 13354 (0.0006) [2023-12-27 19:19:38,773][106225] Updated weights for policy 1, policy_version 13364 (0.0009) [2023-12-27 19:19:39,081][106226] Updated weights for policy 0, policy_version 13477 (0.0010) [2023-12-27 19:19:39,138][106226] Updated weights for policy 0, policy_version 13487 (0.0009) [2023-12-27 19:19:39,203][106226] Updated weights for policy 0, policy_version 13497 (0.0009) [2023-12-27 19:19:39,497][106225] Updated weights for policy 1, policy_version 13374 (0.0007) [2023-12-27 19:19:39,557][106225] Updated weights for policy 1, policy_version 13384 (0.0006) [2023-12-27 19:19:39,614][106225] Updated weights for policy 1, policy_version 13394 (0.0009) [2023-12-27 19:19:40,028][106226] Updated weights for policy 0, policy_version 13507 (0.0009) [2023-12-27 19:19:40,087][106226] Updated weights for policy 0, policy_version 13517 (0.0008) [2023-12-27 19:19:40,140][106226] Updated weights for policy 0, policy_version 13527 (0.0006) [2023-12-27 19:19:40,371][106225] Updated weights for policy 1, policy_version 13404 (0.0008) [2023-12-27 19:19:40,438][106225] Updated weights for policy 1, policy_version 13414 (0.0006) [2023-12-27 19:19:40,500][106225] Updated weights for policy 1, policy_version 13424 (0.0008) [2023-12-27 19:19:40,784][106226] Updated weights for policy 0, policy_version 13537 (0.0006) [2023-12-27 19:19:40,841][106226] Updated weights for policy 0, policy_version 13547 (0.0005) [2023-12-27 19:19:40,900][106226] Updated weights for policy 0, policy_version 13557 (0.0006) [2023-12-27 19:19:40,964][106226] Updated weights for policy 0, policy_version 13567 (0.0007) [2023-12-27 19:19:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 6914048. Throughput: 0: 9970.4, 1: 10015.3. Samples: 6885636. Policy #0 lag: (min: 2.0, avg: 13.3, max: 34.0) [2023-12-27 19:19:41,175][105115] Avg episode reward: [(0, '-5.989'), (1, '-6.879')] [2023-12-27 19:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000013432_3440640.pth... [2023-12-27 19:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000013568_3473408.pth... [2023-12-27 19:19:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000012288_3145728.pth [2023-12-27 19:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000012384_3170304.pth [2023-12-27 19:19:41,273][106225] Updated weights for policy 1, policy_version 13434 (0.0008) [2023-12-27 19:19:41,327][106225] Updated weights for policy 1, policy_version 13444 (0.0008) [2023-12-27 19:19:41,399][106225] Updated weights for policy 1, policy_version 13454 (0.0007) [2023-12-27 19:19:41,451][106225] Updated weights for policy 1, policy_version 13464 (0.0006) [2023-12-27 19:19:41,744][106226] Updated weights for policy 0, policy_version 13577 (0.0009) [2023-12-27 19:19:41,805][106226] Updated weights for policy 0, policy_version 13587 (0.0008) [2023-12-27 19:19:41,862][106226] Updated weights for policy 0, policy_version 13597 (0.0009) [2023-12-27 19:19:42,177][106225] Updated weights for policy 1, policy_version 13474 (0.0009) [2023-12-27 19:19:42,236][106225] Updated weights for policy 1, policy_version 13484 (0.0009) [2023-12-27 19:19:42,302][106225] Updated weights for policy 1, policy_version 13494 (0.0008) [2023-12-27 19:19:42,639][106226] Updated weights for policy 0, policy_version 13607 (0.0006) [2023-12-27 19:19:42,703][106226] Updated weights for policy 0, policy_version 13617 (0.0006) [2023-12-27 19:19:42,756][106226] Updated weights for policy 0, policy_version 13627 (0.0006) [2023-12-27 19:19:43,018][106225] Updated weights for policy 1, policy_version 13504 (0.0008) [2023-12-27 19:19:43,069][106225] Updated weights for policy 1, policy_version 13514 (0.0008) [2023-12-27 19:19:43,118][106225] Updated weights for policy 1, policy_version 13524 (0.0009) [2023-12-27 19:19:43,407][106226] Updated weights for policy 0, policy_version 13637 (0.0007) [2023-12-27 19:19:43,466][106226] Updated weights for policy 0, policy_version 13647 (0.0005) [2023-12-27 19:19:43,525][106226] Updated weights for policy 0, policy_version 13657 (0.0005) [2023-12-27 19:19:43,964][106225] Updated weights for policy 1, policy_version 13534 (0.0009) [2023-12-27 19:19:44,032][106225] Updated weights for policy 1, policy_version 13544 (0.0008) [2023-12-27 19:19:44,052][106226] Updated weights for policy 0, policy_version 13667 (0.0006) [2023-12-27 19:19:44,086][106225] Updated weights for policy 1, policy_version 13554 (0.0009) [2023-12-27 19:19:44,105][106226] Updated weights for policy 0, policy_version 13677 (0.0006) [2023-12-27 19:19:44,163][106226] Updated weights for policy 0, policy_version 13687 (0.0009) [2023-12-27 19:19:44,782][106225] Updated weights for policy 1, policy_version 13564 (0.0009) [2023-12-27 19:19:44,840][106225] Updated weights for policy 1, policy_version 13574 (0.0007) [2023-12-27 19:19:44,863][106226] Updated weights for policy 0, policy_version 13697 (0.0008) [2023-12-27 19:19:44,901][106225] Updated weights for policy 1, policy_version 13584 (0.0006) [2023-12-27 19:19:44,918][106226] Updated weights for policy 0, policy_version 13707 (0.0008) [2023-12-27 19:19:44,977][106226] Updated weights for policy 0, policy_version 13717 (0.0006) [2023-12-27 19:19:45,046][106226] Updated weights for policy 0, policy_version 13727 (0.0008) [2023-12-27 19:19:45,557][106225] Updated weights for policy 1, policy_version 13594 (0.0007) [2023-12-27 19:19:45,611][106225] Updated weights for policy 1, policy_version 13604 (0.0010) [2023-12-27 19:19:45,647][106226] Updated weights for policy 0, policy_version 13737 (0.0006) [2023-12-27 19:19:45,665][106225] Updated weights for policy 1, policy_version 13614 (0.0010) [2023-12-27 19:19:45,694][106226] Updated weights for policy 0, policy_version 13747 (0.0005) [2023-12-27 19:19:45,715][106225] Updated weights for policy 1, policy_version 13624 (0.0010) [2023-12-27 19:19:45,749][106226] Updated weights for policy 0, policy_version 13757 (0.0008) [2023-12-27 19:19:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 7012352. Throughput: 0: 10035.3, 1: 9938.9. Samples: 7001180. Policy #0 lag: (min: 2.0, avg: 13.3, max: 34.0) [2023-12-27 19:19:46,175][105115] Avg episode reward: [(0, '-5.812'), (1, '-6.977')] [2023-12-27 19:19:46,381][106225] Updated weights for policy 1, policy_version 13634 (0.0005) [2023-12-27 19:19:46,434][106226] Updated weights for policy 0, policy_version 13767 (0.0009) [2023-12-27 19:19:46,441][106225] Updated weights for policy 1, policy_version 13644 (0.0005) [2023-12-27 19:19:46,498][106226] Updated weights for policy 0, policy_version 13777 (0.0009) [2023-12-27 19:19:46,504][106225] Updated weights for policy 1, policy_version 13654 (0.0006) [2023-12-27 19:19:46,553][106226] Updated weights for policy 0, policy_version 13787 (0.0007) [2023-12-27 19:19:47,102][106225] Updated weights for policy 1, policy_version 13664 (0.0007) [2023-12-27 19:19:47,157][106225] Updated weights for policy 1, policy_version 13674 (0.0006) [2023-12-27 19:19:47,202][106225] Updated weights for policy 1, policy_version 13684 (0.0008) [2023-12-27 19:19:47,246][106226] Updated weights for policy 0, policy_version 13797 (0.0006) [2023-12-27 19:19:47,297][106226] Updated weights for policy 0, policy_version 13807 (0.0009) [2023-12-27 19:19:47,346][106226] Updated weights for policy 0, policy_version 13817 (0.0009) [2023-12-27 19:19:47,939][106225] Updated weights for policy 1, policy_version 13694 (0.0006) [2023-12-27 19:19:47,998][106225] Updated weights for policy 1, policy_version 13704 (0.0005) [2023-12-27 19:19:48,000][106226] Updated weights for policy 0, policy_version 13827 (0.0008) [2023-12-27 19:19:48,052][106226] Updated weights for policy 0, policy_version 13837 (0.0005) [2023-12-27 19:19:48,058][106225] Updated weights for policy 1, policy_version 13714 (0.0006) [2023-12-27 19:19:48,108][106226] Updated weights for policy 0, policy_version 13847 (0.0007) [2023-12-27 19:19:48,640][106225] Updated weights for policy 1, policy_version 13724 (0.0006) [2023-12-27 19:19:48,699][106225] Updated weights for policy 1, policy_version 13734 (0.0006) [2023-12-27 19:19:48,714][106226] Updated weights for policy 0, policy_version 13857 (0.0009) [2023-12-27 19:19:48,755][106225] Updated weights for policy 1, policy_version 13744 (0.0005) [2023-12-27 19:19:48,778][106226] Updated weights for policy 0, policy_version 13867 (0.0006) [2023-12-27 19:19:48,842][106226] Updated weights for policy 0, policy_version 13877 (0.0009) [2023-12-27 19:19:48,896][106226] Updated weights for policy 0, policy_version 13887 (0.0009) [2023-12-27 19:19:49,336][106225] Updated weights for policy 1, policy_version 13754 (0.0007) [2023-12-27 19:19:49,408][106225] Updated weights for policy 1, policy_version 13764 (0.0010) [2023-12-27 19:19:49,465][106225] Updated weights for policy 1, policy_version 13774 (0.0010) [2023-12-27 19:19:49,522][106225] Updated weights for policy 1, policy_version 13784 (0.0010) [2023-12-27 19:19:49,635][106226] Updated weights for policy 0, policy_version 13897 (0.0010) [2023-12-27 19:19:49,687][106226] Updated weights for policy 0, policy_version 13907 (0.0008) [2023-12-27 19:19:49,748][106226] Updated weights for policy 0, policy_version 13917 (0.0008) [2023-12-27 19:19:50,212][106225] Updated weights for policy 1, policy_version 13794 (0.0009) [2023-12-27 19:19:50,269][106225] Updated weights for policy 1, policy_version 13804 (0.0008) [2023-12-27 19:19:50,323][106225] Updated weights for policy 1, policy_version 13814 (0.0010) [2023-12-27 19:19:50,555][106226] Updated weights for policy 0, policy_version 13927 (0.0009) [2023-12-27 19:19:50,626][106226] Updated weights for policy 0, policy_version 13937 (0.0009) [2023-12-27 19:19:50,682][106226] Updated weights for policy 0, policy_version 13947 (0.0008) [2023-12-27 19:19:51,048][106225] Updated weights for policy 1, policy_version 13824 (0.0011) [2023-12-27 19:19:51,109][106225] Updated weights for policy 1, policy_version 13834 (0.0011) [2023-12-27 19:19:51,174][106225] Updated weights for policy 1, policy_version 13844 (0.0009) [2023-12-27 19:19:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 7110656. Throughput: 0: 10000.5, 1: 9927.7. Samples: 7124200. Policy #0 lag: (min: 18.0, avg: 31.2, max: 50.0) [2023-12-27 19:19:51,175][105115] Avg episode reward: [(0, '-6.125'), (1, '-7.111')] [2023-12-27 19:19:51,436][106226] Updated weights for policy 0, policy_version 13957 (0.0009) [2023-12-27 19:19:51,498][106226] Updated weights for policy 0, policy_version 13967 (0.0009) [2023-12-27 19:19:51,557][106226] Updated weights for policy 0, policy_version 13977 (0.0008) [2023-12-27 19:19:51,889][106225] Updated weights for policy 1, policy_version 13854 (0.0007) [2023-12-27 19:19:51,950][106225] Updated weights for policy 1, policy_version 13864 (0.0006) [2023-12-27 19:19:52,007][106225] Updated weights for policy 1, policy_version 13874 (0.0005) [2023-12-27 19:19:52,338][106226] Updated weights for policy 0, policy_version 13987 (0.0009) [2023-12-27 19:19:52,409][106226] Updated weights for policy 0, policy_version 13997 (0.0009) [2023-12-27 19:19:52,470][106226] Updated weights for policy 0, policy_version 14007 (0.0009) [2023-12-27 19:19:52,619][106225] Updated weights for policy 1, policy_version 13884 (0.0006) [2023-12-27 19:19:52,685][106225] Updated weights for policy 1, policy_version 13894 (0.0008) [2023-12-27 19:19:52,744][106225] Updated weights for policy 1, policy_version 13904 (0.0008) [2023-12-27 19:19:53,257][106226] Updated weights for policy 0, policy_version 14017 (0.0009) [2023-12-27 19:19:53,316][106226] Updated weights for policy 0, policy_version 14027 (0.0009) [2023-12-27 19:19:53,365][106225] Updated weights for policy 1, policy_version 13914 (0.0009) [2023-12-27 19:19:53,376][106226] Updated weights for policy 0, policy_version 14037 (0.0008) [2023-12-27 19:19:53,420][106225] Updated weights for policy 1, policy_version 13924 (0.0009) [2023-12-27 19:19:53,434][106226] Updated weights for policy 0, policy_version 14047 (0.0006) [2023-12-27 19:19:53,484][106225] Updated weights for policy 1, policy_version 13934 (0.0007) [2023-12-27 19:19:53,546][106225] Updated weights for policy 1, policy_version 13944 (0.0006) [2023-12-27 19:19:54,149][106225] Updated weights for policy 1, policy_version 13954 (0.0010) [2023-12-27 19:19:54,162][106226] Updated weights for policy 0, policy_version 14057 (0.0008) [2023-12-27 19:19:54,205][106225] Updated weights for policy 1, policy_version 13964 (0.0010) [2023-12-27 19:19:54,212][106226] Updated weights for policy 0, policy_version 14067 (0.0007) [2023-12-27 19:19:54,251][106225] Updated weights for policy 1, policy_version 13974 (0.0010) [2023-12-27 19:19:54,261][106226] Updated weights for policy 0, policy_version 14077 (0.0006) [2023-12-27 19:19:55,011][106225] Updated weights for policy 1, policy_version 13984 (0.0008) [2023-12-27 19:19:55,038][106226] Updated weights for policy 0, policy_version 14087 (0.0007) [2023-12-27 19:19:55,067][106225] Updated weights for policy 1, policy_version 13994 (0.0007) [2023-12-27 19:19:55,094][106226] Updated weights for policy 0, policy_version 14097 (0.0006) [2023-12-27 19:19:55,120][106225] Updated weights for policy 1, policy_version 14004 (0.0007) [2023-12-27 19:19:55,156][106226] Updated weights for policy 0, policy_version 14107 (0.0008) [2023-12-27 19:19:55,798][106225] Updated weights for policy 1, policy_version 14014 (0.0007) [2023-12-27 19:19:55,850][106225] Updated weights for policy 1, policy_version 14024 (0.0006) [2023-12-27 19:19:55,904][106226] Updated weights for policy 0, policy_version 14117 (0.0008) [2023-12-27 19:19:55,905][106225] Updated weights for policy 1, policy_version 14034 (0.0006) [2023-12-27 19:19:55,960][106226] Updated weights for policy 0, policy_version 14127 (0.0008) [2023-12-27 19:19:56,008][106226] Updated weights for policy 0, policy_version 14137 (0.0008) [2023-12-27 19:19:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 7217152. Throughput: 0: 9974.9, 1: 9947.6. Samples: 7183048. Policy #0 lag: (min: 18.0, avg: 31.2, max: 50.0) [2023-12-27 19:19:56,175][105115] Avg episode reward: [(0, '-6.225'), (1, '-7.029')] [2023-12-27 19:19:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000014040_3596288.pth... [2023-12-27 19:19:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000014144_3620864.pth... [2023-12-27 19:19:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000012856_3293184.pth [2023-12-27 19:19:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000012960_3317760.pth [2023-12-27 19:19:56,475][106225] Updated weights for policy 1, policy_version 14044 (0.0006) [2023-12-27 19:19:56,535][106225] Updated weights for policy 1, policy_version 14054 (0.0006) [2023-12-27 19:19:56,581][106225] Updated weights for policy 1, policy_version 14064 (0.0010) [2023-12-27 19:19:56,811][106226] Updated weights for policy 0, policy_version 14147 (0.0008) [2023-12-27 19:19:56,859][106226] Updated weights for policy 0, policy_version 14157 (0.0008) [2023-12-27 19:19:56,915][106226] Updated weights for policy 0, policy_version 14167 (0.0009) [2023-12-27 19:19:57,265][106225] Updated weights for policy 1, policy_version 14074 (0.0009) [2023-12-27 19:19:57,321][106225] Updated weights for policy 1, policy_version 14084 (0.0008) [2023-12-27 19:19:57,380][106225] Updated weights for policy 1, policy_version 14094 (0.0009) [2023-12-27 19:19:57,432][106225] Updated weights for policy 1, policy_version 14104 (0.0008) [2023-12-27 19:19:57,657][106226] Updated weights for policy 0, policy_version 14177 (0.0008) [2023-12-27 19:19:57,720][106226] Updated weights for policy 0, policy_version 14187 (0.0008) [2023-12-27 19:19:57,777][106226] Updated weights for policy 0, policy_version 14197 (0.0008) [2023-12-27 19:19:57,835][106226] Updated weights for policy 0, policy_version 14207 (0.0008) [2023-12-27 19:19:58,102][106225] Updated weights for policy 1, policy_version 14114 (0.0009) [2023-12-27 19:19:58,160][106225] Updated weights for policy 1, policy_version 14124 (0.0009) [2023-12-27 19:19:58,225][106225] Updated weights for policy 1, policy_version 14134 (0.0009) [2023-12-27 19:19:58,623][106226] Updated weights for policy 0, policy_version 14217 (0.0010) [2023-12-27 19:19:58,697][106226] Updated weights for policy 0, policy_version 14227 (0.0010) [2023-12-27 19:19:58,759][106226] Updated weights for policy 0, policy_version 14237 (0.0010) [2023-12-27 19:19:59,039][106225] Updated weights for policy 1, policy_version 14144 (0.0006) [2023-12-27 19:19:59,089][106225] Updated weights for policy 1, policy_version 14154 (0.0005) [2023-12-27 19:19:59,152][106225] Updated weights for policy 1, policy_version 14164 (0.0006) [2023-12-27 19:19:59,570][106226] Updated weights for policy 0, policy_version 14247 (0.0009) [2023-12-27 19:19:59,634][106226] Updated weights for policy 0, policy_version 14257 (0.0005) [2023-12-27 19:19:59,692][106226] Updated weights for policy 0, policy_version 14267 (0.0005) [2023-12-27 19:19:59,842][106225] Updated weights for policy 1, policy_version 14174 (0.0008) [2023-12-27 19:19:59,909][106225] Updated weights for policy 1, policy_version 14184 (0.0008) [2023-12-27 19:19:59,974][106225] Updated weights for policy 1, policy_version 14194 (0.0008) [2023-12-27 19:20:00,434][106226] Updated weights for policy 0, policy_version 14277 (0.0008) [2023-12-27 19:20:00,489][106226] Updated weights for policy 0, policy_version 14287 (0.0008) [2023-12-27 19:20:00,552][106226] Updated weights for policy 0, policy_version 14297 (0.0007) [2023-12-27 19:20:00,654][106225] Updated weights for policy 1, policy_version 14204 (0.0008) [2023-12-27 19:20:00,711][106225] Updated weights for policy 1, policy_version 14214 (0.0008) [2023-12-27 19:20:00,773][106225] Updated weights for policy 1, policy_version 14224 (0.0010) [2023-12-27 19:20:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 7307264. Throughput: 0: 9931.9, 1: 9982.5. Samples: 7297916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:20:01,175][105115] Avg episode reward: [(0, '-5.837'), (1, '-6.831')] [2023-12-27 19:20:01,179][106226] Updated weights for policy 0, policy_version 14307 (0.0008) [2023-12-27 19:20:01,241][106226] Updated weights for policy 0, policy_version 14317 (0.0009) [2023-12-27 19:20:01,304][106226] Updated weights for policy 0, policy_version 14327 (0.0008) [2023-12-27 19:20:01,524][106225] Updated weights for policy 1, policy_version 14234 (0.0007) [2023-12-27 19:20:01,586][106225] Updated weights for policy 1, policy_version 14244 (0.0009) [2023-12-27 19:20:01,645][106225] Updated weights for policy 1, policy_version 14254 (0.0008) [2023-12-27 19:20:01,702][106225] Updated weights for policy 1, policy_version 14264 (0.0007) [2023-12-27 19:20:02,074][106226] Updated weights for policy 0, policy_version 14337 (0.0009) [2023-12-27 19:20:02,123][106226] Updated weights for policy 0, policy_version 14347 (0.0008) [2023-12-27 19:20:02,189][106226] Updated weights for policy 0, policy_version 14357 (0.0010) [2023-12-27 19:20:02,246][106226] Updated weights for policy 0, policy_version 14367 (0.0008) [2023-12-27 19:20:02,408][106225] Updated weights for policy 1, policy_version 14274 (0.0008) [2023-12-27 19:20:02,462][106225] Updated weights for policy 1, policy_version 14284 (0.0008) [2023-12-27 19:20:02,526][106225] Updated weights for policy 1, policy_version 14294 (0.0008) [2023-12-27 19:20:02,915][106226] Updated weights for policy 0, policy_version 14377 (0.0006) [2023-12-27 19:20:02,970][106226] Updated weights for policy 0, policy_version 14387 (0.0008) [2023-12-27 19:20:03,022][106226] Updated weights for policy 0, policy_version 14397 (0.0008) [2023-12-27 19:20:03,269][106225] Updated weights for policy 1, policy_version 14304 (0.0010) [2023-12-27 19:20:03,335][106225] Updated weights for policy 1, policy_version 14314 (0.0010) [2023-12-27 19:20:03,394][106225] Updated weights for policy 1, policy_version 14324 (0.0010) [2023-12-27 19:20:03,644][106226] Updated weights for policy 0, policy_version 14407 (0.0007) [2023-12-27 19:20:03,690][106226] Updated weights for policy 0, policy_version 14417 (0.0008) [2023-12-27 19:20:03,732][106226] Updated weights for policy 0, policy_version 14427 (0.0007) [2023-12-27 19:20:04,107][106225] Updated weights for policy 1, policy_version 14334 (0.0010) [2023-12-27 19:20:04,176][106225] Updated weights for policy 1, policy_version 14344 (0.0011) [2023-12-27 19:20:04,240][106225] Updated weights for policy 1, policy_version 14354 (0.0008) [2023-12-27 19:20:04,449][106226] Updated weights for policy 0, policy_version 14437 (0.0007) [2023-12-27 19:20:04,507][106226] Updated weights for policy 0, policy_version 14447 (0.0008) [2023-12-27 19:20:04,576][106226] Updated weights for policy 0, policy_version 14457 (0.0009) [2023-12-27 19:20:04,901][106225] Updated weights for policy 1, policy_version 14364 (0.0009) [2023-12-27 19:20:04,963][106225] Updated weights for policy 1, policy_version 14374 (0.0010) [2023-12-27 19:20:05,027][106225] Updated weights for policy 1, policy_version 14384 (0.0010) [2023-12-27 19:20:05,246][106226] Updated weights for policy 0, policy_version 14467 (0.0007) [2023-12-27 19:20:05,301][106226] Updated weights for policy 0, policy_version 14477 (0.0007) [2023-12-27 19:20:05,358][106226] Updated weights for policy 0, policy_version 14487 (0.0008) [2023-12-27 19:20:05,649][106225] Updated weights for policy 1, policy_version 14394 (0.0010) [2023-12-27 19:20:05,699][106225] Updated weights for policy 1, policy_version 14404 (0.0010) [2023-12-27 19:20:05,743][106225] Updated weights for policy 1, policy_version 14414 (0.0010) [2023-12-27 19:20:05,792][106225] Updated weights for policy 1, policy_version 14424 (0.0010) [2023-12-27 19:20:05,999][106226] Updated weights for policy 0, policy_version 14497 (0.0007) [2023-12-27 19:20:06,057][106226] Updated weights for policy 0, policy_version 14507 (0.0007) [2023-12-27 19:20:06,115][106226] Updated weights for policy 0, policy_version 14517 (0.0008) [2023-12-27 19:20:06,174][106226] Updated weights for policy 0, policy_version 14527 (0.0008) [2023-12-27 19:20:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 7405568. Throughput: 0: 9909.5, 1: 9954.0. Samples: 7418364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:20:06,175][105115] Avg episode reward: [(0, '-5.755'), (1, '-7.326')] [2023-12-27 19:20:06,530][106225] Updated weights for policy 1, policy_version 14434 (0.0010) [2023-12-27 19:20:06,589][106225] Updated weights for policy 1, policy_version 14444 (0.0008) [2023-12-27 19:20:06,653][106225] Updated weights for policy 1, policy_version 14454 (0.0009) [2023-12-27 19:20:06,836][106226] Updated weights for policy 0, policy_version 14537 (0.0007) [2023-12-27 19:20:06,893][106226] Updated weights for policy 0, policy_version 14547 (0.0007) [2023-12-27 19:20:06,950][106226] Updated weights for policy 0, policy_version 14557 (0.0007) [2023-12-27 19:20:07,403][106225] Updated weights for policy 1, policy_version 14464 (0.0006) [2023-12-27 19:20:07,466][106225] Updated weights for policy 1, policy_version 14474 (0.0006) [2023-12-27 19:20:07,520][106225] Updated weights for policy 1, policy_version 14484 (0.0010) [2023-12-27 19:20:07,548][106226] Updated weights for policy 0, policy_version 14567 (0.0007) [2023-12-27 19:20:07,613][106226] Updated weights for policy 0, policy_version 14577 (0.0008) [2023-12-27 19:20:07,662][106226] Updated weights for policy 0, policy_version 14587 (0.0007) [2023-12-27 19:20:08,192][106225] Updated weights for policy 1, policy_version 14494 (0.0010) [2023-12-27 19:20:08,243][106225] Updated weights for policy 1, policy_version 14504 (0.0010) [2023-12-27 19:20:08,252][106226] Updated weights for policy 0, policy_version 14597 (0.0007) [2023-12-27 19:20:08,292][106225] Updated weights for policy 1, policy_version 14514 (0.0010) [2023-12-27 19:20:08,311][106226] Updated weights for policy 0, policy_version 14607 (0.0006) [2023-12-27 19:20:08,374][106226] Updated weights for policy 0, policy_version 14617 (0.0014) [2023-12-27 19:20:08,971][106225] Updated weights for policy 1, policy_version 14524 (0.0007) [2023-12-27 19:20:09,033][106225] Updated weights for policy 1, policy_version 14534 (0.0008) [2023-12-27 19:20:09,092][106225] Updated weights for policy 1, policy_version 14544 (0.0008) [2023-12-27 19:20:09,142][106226] Updated weights for policy 0, policy_version 14627 (0.0008) [2023-12-27 19:20:09,198][106226] Updated weights for policy 0, policy_version 14637 (0.0009) [2023-12-27 19:20:09,269][106226] Updated weights for policy 0, policy_version 14647 (0.0010) [2023-12-27 19:20:09,828][106225] Updated weights for policy 1, policy_version 14554 (0.0008) [2023-12-27 19:20:09,894][106225] Updated weights for policy 1, policy_version 14564 (0.0007) [2023-12-27 19:20:09,965][106225] Updated weights for policy 1, policy_version 14574 (0.0008) [2023-12-27 19:20:10,026][106225] Updated weights for policy 1, policy_version 14584 (0.0008) [2023-12-27 19:20:10,081][106226] Updated weights for policy 0, policy_version 14657 (0.0009) [2023-12-27 19:20:10,147][106226] Updated weights for policy 0, policy_version 14667 (0.0006) [2023-12-27 19:20:10,217][106226] Updated weights for policy 0, policy_version 14677 (0.0006) [2023-12-27 19:20:10,282][106226] Updated weights for policy 0, policy_version 14687 (0.0006) [2023-12-27 19:20:10,795][106225] Updated weights for policy 1, policy_version 14594 (0.0005) [2023-12-27 19:20:10,856][106225] Updated weights for policy 1, policy_version 14604 (0.0006) [2023-12-27 19:20:10,921][106225] Updated weights for policy 1, policy_version 14614 (0.0007) [2023-12-27 19:20:10,939][106226] Updated weights for policy 0, policy_version 14697 (0.0006) [2023-12-27 19:20:11,007][106226] Updated weights for policy 0, policy_version 14707 (0.0005) [2023-12-27 19:20:11,082][106226] Updated weights for policy 0, policy_version 14717 (0.0008) [2023-12-27 19:20:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 7512064. Throughput: 0: 9985.4, 1: 9939.6. Samples: 7479568. Policy #0 lag: (min: 2.0, avg: 19.2, max: 34.0) [2023-12-27 19:20:11,175][105115] Avg episode reward: [(0, '-5.918'), (1, '-7.001')] [2023-12-27 19:20:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000014616_3743744.pth... [2023-12-27 19:20:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000014720_3768320.pth... [2023-12-27 19:20:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000013432_3440640.pth [2023-12-27 19:20:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000013568_3473408.pth [2023-12-27 19:20:11,579][106225] Updated weights for policy 1, policy_version 14624 (0.0007) [2023-12-27 19:20:11,649][106225] Updated weights for policy 1, policy_version 14634 (0.0008) [2023-12-27 19:20:11,713][106225] Updated weights for policy 1, policy_version 14644 (0.0009) [2023-12-27 19:20:11,858][106226] Updated weights for policy 0, policy_version 14727 (0.0010) [2023-12-27 19:20:11,923][106226] Updated weights for policy 0, policy_version 14737 (0.0011) [2023-12-27 19:20:11,998][106226] Updated weights for policy 0, policy_version 14747 (0.0009) [2023-12-27 19:20:12,295][106225] Updated weights for policy 1, policy_version 14654 (0.0008) [2023-12-27 19:20:12,361][106225] Updated weights for policy 1, policy_version 14664 (0.0007) [2023-12-27 19:20:12,427][106225] Updated weights for policy 1, policy_version 14674 (0.0008) [2023-12-27 19:20:12,796][106226] Updated weights for policy 0, policy_version 14757 (0.0010) [2023-12-27 19:20:12,864][106226] Updated weights for policy 0, policy_version 14767 (0.0011) [2023-12-27 19:20:12,931][106226] Updated weights for policy 0, policy_version 14777 (0.0008) [2023-12-27 19:20:13,021][106225] Updated weights for policy 1, policy_version 14684 (0.0008) [2023-12-27 19:20:13,071][106225] Updated weights for policy 1, policy_version 14694 (0.0008) [2023-12-27 19:20:13,117][106225] Updated weights for policy 1, policy_version 14704 (0.0009) [2023-12-27 19:20:13,647][106226] Updated weights for policy 0, policy_version 14787 (0.0009) [2023-12-27 19:20:13,714][106226] Updated weights for policy 0, policy_version 14797 (0.0011) [2023-12-27 19:20:13,760][106226] Updated weights for policy 0, policy_version 14807 (0.0010) [2023-12-27 19:20:13,826][106225] Updated weights for policy 1, policy_version 14714 (0.0008) [2023-12-27 19:20:13,886][106225] Updated weights for policy 1, policy_version 14724 (0.0007) [2023-12-27 19:20:13,941][106225] Updated weights for policy 1, policy_version 14734 (0.0007) [2023-12-27 19:20:13,993][106225] Updated weights for policy 1, policy_version 14744 (0.0007) [2023-12-27 19:20:14,429][106226] Updated weights for policy 0, policy_version 14817 (0.0010) [2023-12-27 19:20:14,495][106226] Updated weights for policy 0, policy_version 14827 (0.0005) [2023-12-27 19:20:14,562][106226] Updated weights for policy 0, policy_version 14837 (0.0009) [2023-12-27 19:20:14,620][106226] Updated weights for policy 0, policy_version 14847 (0.0007) [2023-12-27 19:20:14,658][106225] Updated weights for policy 1, policy_version 14754 (0.0005) [2023-12-27 19:20:14,719][106225] Updated weights for policy 1, policy_version 14764 (0.0005) [2023-12-27 19:20:14,776][106225] Updated weights for policy 1, policy_version 14774 (0.0007) [2023-12-27 19:20:15,237][106226] Updated weights for policy 0, policy_version 14857 (0.0009) [2023-12-27 19:20:15,292][106226] Updated weights for policy 0, policy_version 14867 (0.0011) [2023-12-27 19:20:15,350][106226] Updated weights for policy 0, policy_version 14877 (0.0011) [2023-12-27 19:20:15,429][106225] Updated weights for policy 1, policy_version 14784 (0.0007) [2023-12-27 19:20:15,485][106225] Updated weights for policy 1, policy_version 14794 (0.0009) [2023-12-27 19:20:15,543][106225] Updated weights for policy 1, policy_version 14804 (0.0009) [2023-12-27 19:20:16,009][106226] Updated weights for policy 0, policy_version 14887 (0.0011) [2023-12-27 19:20:16,066][106226] Updated weights for policy 0, policy_version 14897 (0.0011) [2023-12-27 19:20:16,123][106226] Updated weights for policy 0, policy_version 14907 (0.0010) [2023-12-27 19:20:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 7610368. Throughput: 0: 9804.5, 1: 10032.3. Samples: 7597296. Policy #0 lag: (min: 2.0, avg: 19.2, max: 34.0) [2023-12-27 19:20:16,176][105115] Avg episode reward: [(0, '-5.505'), (1, '-7.122')] [2023-12-27 19:20:16,177][106140] Saving new best policy, reward=-5.505! [2023-12-27 19:20:16,304][106225] Updated weights for policy 1, policy_version 14814 (0.0007) [2023-12-27 19:20:16,363][106225] Updated weights for policy 1, policy_version 14824 (0.0007) [2023-12-27 19:20:16,424][106225] Updated weights for policy 1, policy_version 14834 (0.0006) [2023-12-27 19:20:16,846][106226] Updated weights for policy 0, policy_version 14917 (0.0011) [2023-12-27 19:20:16,903][106226] Updated weights for policy 0, policy_version 14927 (0.0010) [2023-12-27 19:20:16,965][106226] Updated weights for policy 0, policy_version 14937 (0.0010) [2023-12-27 19:20:17,038][106225] Updated weights for policy 1, policy_version 14844 (0.0006) [2023-12-27 19:20:17,085][106225] Updated weights for policy 1, policy_version 14854 (0.0008) [2023-12-27 19:20:17,132][106225] Updated weights for policy 1, policy_version 14864 (0.0008) [2023-12-27 19:20:17,647][106226] Updated weights for policy 0, policy_version 14947 (0.0011) [2023-12-27 19:20:17,702][106226] Updated weights for policy 0, policy_version 14957 (0.0010) [2023-12-27 19:20:17,761][106226] Updated weights for policy 0, policy_version 14967 (0.0010) [2023-12-27 19:20:17,854][106225] Updated weights for policy 1, policy_version 14874 (0.0007) [2023-12-27 19:20:17,908][106225] Updated weights for policy 1, policy_version 14884 (0.0005) [2023-12-27 19:20:17,956][106225] Updated weights for policy 1, policy_version 14894 (0.0008) [2023-12-27 19:20:18,006][106225] Updated weights for policy 1, policy_version 14904 (0.0008) [2023-12-27 19:20:18,497][106226] Updated weights for policy 0, policy_version 14977 (0.0010) [2023-12-27 19:20:18,561][106226] Updated weights for policy 0, policy_version 14987 (0.0005) [2023-12-27 19:20:18,624][106226] Updated weights for policy 0, policy_version 14997 (0.0007) [2023-12-27 19:20:18,642][106225] Updated weights for policy 1, policy_version 14914 (0.0010) [2023-12-27 19:20:18,684][106226] Updated weights for policy 0, policy_version 15007 (0.0010) [2023-12-27 19:20:18,700][106225] Updated weights for policy 1, policy_version 14924 (0.0010) [2023-12-27 19:20:18,764][106225] Updated weights for policy 1, policy_version 14934 (0.0010) [2023-12-27 19:20:19,366][106225] Updated weights for policy 1, policy_version 14944 (0.0008) [2023-12-27 19:20:19,368][106226] Updated weights for policy 0, policy_version 15017 (0.0010) [2023-12-27 19:20:19,435][106225] Updated weights for policy 1, policy_version 14954 (0.0006) [2023-12-27 19:20:19,436][106226] Updated weights for policy 0, policy_version 15027 (0.0008) [2023-12-27 19:20:19,495][106225] Updated weights for policy 1, policy_version 14964 (0.0008) [2023-12-27 19:20:19,499][106226] Updated weights for policy 0, policy_version 15037 (0.0010) [2023-12-27 19:20:20,156][106225] Updated weights for policy 1, policy_version 14974 (0.0008) [2023-12-27 19:20:20,211][106225] Updated weights for policy 1, policy_version 14984 (0.0008) [2023-12-27 19:20:20,269][106226] Updated weights for policy 0, policy_version 15047 (0.0008) [2023-12-27 19:20:20,270][106225] Updated weights for policy 1, policy_version 14994 (0.0007) [2023-12-27 19:20:20,329][106226] Updated weights for policy 0, policy_version 15057 (0.0008) [2023-12-27 19:20:20,387][106226] Updated weights for policy 0, policy_version 15067 (0.0008) [2023-12-27 19:20:21,051][106226] Updated weights for policy 0, policy_version 15077 (0.0008) [2023-12-27 19:20:21,092][106225] Updated weights for policy 1, policy_version 15004 (0.0007) [2023-12-27 19:20:21,115][106226] Updated weights for policy 0, policy_version 15087 (0.0008) [2023-12-27 19:20:21,157][106225] Updated weights for policy 1, policy_version 15014 (0.0009) [2023-12-27 19:20:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 7700480. Throughput: 0: 9771.2, 1: 10057.4. Samples: 7717240. Policy #0 lag: (min: 2.0, avg: 19.2, max: 34.0) [2023-12-27 19:20:21,175][105115] Avg episode reward: [(0, '-5.605'), (1, '-7.109')] [2023-12-27 19:20:21,182][106226] Updated weights for policy 0, policy_version 15097 (0.0008) [2023-12-27 19:20:21,216][106225] Updated weights for policy 1, policy_version 15024 (0.0006) [2023-12-27 19:20:21,955][106226] Updated weights for policy 0, policy_version 15107 (0.0010) [2023-12-27 19:20:22,003][106226] Updated weights for policy 0, policy_version 15117 (0.0008) [2023-12-27 19:20:22,050][106225] Updated weights for policy 1, policy_version 15034 (0.0007) [2023-12-27 19:20:22,062][106226] Updated weights for policy 0, policy_version 15127 (0.0008) [2023-12-27 19:20:22,110][106225] Updated weights for policy 1, policy_version 15044 (0.0007) [2023-12-27 19:20:22,169][106225] Updated weights for policy 1, policy_version 15054 (0.0007) [2023-12-27 19:20:22,220][106225] Updated weights for policy 1, policy_version 15064 (0.0008) [2023-12-27 19:20:22,788][106226] Updated weights for policy 0, policy_version 15137 (0.0008) [2023-12-27 19:20:22,855][106226] Updated weights for policy 0, policy_version 15147 (0.0006) [2023-12-27 19:20:22,915][106226] Updated weights for policy 0, policy_version 15157 (0.0006) [2023-12-27 19:20:22,933][106225] Updated weights for policy 1, policy_version 15074 (0.0010) [2023-12-27 19:20:22,969][106226] Updated weights for policy 0, policy_version 15167 (0.0007) [2023-12-27 19:20:22,990][106225] Updated weights for policy 1, policy_version 15084 (0.0010) [2023-12-27 19:20:23,060][106225] Updated weights for policy 1, policy_version 15094 (0.0010) [2023-12-27 19:20:23,634][106226] Updated weights for policy 0, policy_version 15177 (0.0007) [2023-12-27 19:20:23,683][106226] Updated weights for policy 0, policy_version 15187 (0.0009) [2023-12-27 19:20:23,733][106226] Updated weights for policy 0, policy_version 15197 (0.0010) [2023-12-27 19:20:23,761][106225] Updated weights for policy 1, policy_version 15104 (0.0010) [2023-12-27 19:20:23,817][106225] Updated weights for policy 1, policy_version 15114 (0.0010) [2023-12-27 19:20:23,873][106225] Updated weights for policy 1, policy_version 15124 (0.0010) [2023-12-27 19:20:24,477][106226] Updated weights for policy 0, policy_version 15207 (0.0010) [2023-12-27 19:20:24,536][106226] Updated weights for policy 0, policy_version 15217 (0.0010) [2023-12-27 19:20:24,584][106225] Updated weights for policy 1, policy_version 15134 (0.0007) [2023-12-27 19:20:24,588][106226] Updated weights for policy 0, policy_version 15227 (0.0010) [2023-12-27 19:20:24,642][106225] Updated weights for policy 1, policy_version 15144 (0.0005) [2023-12-27 19:20:24,704][106225] Updated weights for policy 1, policy_version 15154 (0.0007) [2023-12-27 19:20:25,298][106226] Updated weights for policy 0, policy_version 15237 (0.0008) [2023-12-27 19:20:25,298][106225] Updated weights for policy 1, policy_version 15164 (0.0008) [2023-12-27 19:20:25,349][106226] Updated weights for policy 0, policy_version 15247 (0.0006) [2023-12-27 19:20:25,350][106225] Updated weights for policy 1, policy_version 15174 (0.0009) [2023-12-27 19:20:25,397][106225] Updated weights for policy 1, policy_version 15184 (0.0010) [2023-12-27 19:20:25,403][106226] Updated weights for policy 0, policy_version 15257 (0.0006) [2023-12-27 19:20:26,064][106225] Updated weights for policy 1, policy_version 15194 (0.0010) [2023-12-27 19:20:26,118][106225] Updated weights for policy 1, policy_version 15204 (0.0010) [2023-12-27 19:20:26,171][106226] Updated weights for policy 0, policy_version 15267 (0.0005) [2023-12-27 19:20:26,173][106225] Updated weights for policy 1, policy_version 15214 (0.0010) [2023-12-27 19:20:26,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 7798784. Throughput: 0: 9762.1, 1: 9976.6. Samples: 7773872. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-27 19:20:26,175][105115] Avg episode reward: [(0, '-5.776'), (1, '-7.074')] [2023-12-27 19:20:26,224][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000015224_3899392.pth... [2023-12-27 19:20:26,227][106225] Updated weights for policy 1, policy_version 15224 (0.0010) [2023-12-27 19:20:26,228][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000014040_3596288.pth [2023-12-27 19:20:26,229][106226] Updated weights for policy 0, policy_version 15277 (0.0005) [2023-12-27 19:20:26,280][106226] Updated weights for policy 0, policy_version 15287 (0.0008) [2023-12-27 19:20:26,326][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000015296_3915776.pth... [2023-12-27 19:20:26,330][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000014144_3620864.pth [2023-12-27 19:20:26,959][106225] Updated weights for policy 1, policy_version 15234 (0.0010) [2023-12-27 19:20:27,009][106226] Updated weights for policy 0, policy_version 15297 (0.0007) [2023-12-27 19:20:27,014][106225] Updated weights for policy 1, policy_version 15244 (0.0010) [2023-12-27 19:20:27,062][106226] Updated weights for policy 0, policy_version 15307 (0.0005) [2023-12-27 19:20:27,070][106225] Updated weights for policy 1, policy_version 15254 (0.0010) [2023-12-27 19:20:27,116][106226] Updated weights for policy 0, policy_version 15317 (0.0007) [2023-12-27 19:20:27,169][106226] Updated weights for policy 0, policy_version 15327 (0.0007) [2023-12-27 19:20:27,774][106225] Updated weights for policy 1, policy_version 15264 (0.0010) [2023-12-27 19:20:27,830][106225] Updated weights for policy 1, policy_version 15274 (0.0010) [2023-12-27 19:20:27,884][106225] Updated weights for policy 1, policy_version 15284 (0.0010) [2023-12-27 19:20:27,893][106226] Updated weights for policy 0, policy_version 15337 (0.0006) [2023-12-27 19:20:27,942][106226] Updated weights for policy 0, policy_version 15347 (0.0007) [2023-12-27 19:20:27,994][106226] Updated weights for policy 0, policy_version 15357 (0.0008) [2023-12-27 19:20:28,597][106225] Updated weights for policy 1, policy_version 15294 (0.0010) [2023-12-27 19:20:28,654][106225] Updated weights for policy 1, policy_version 15304 (0.0010) [2023-12-27 19:20:28,709][106225] Updated weights for policy 1, policy_version 15314 (0.0010) [2023-12-27 19:20:28,734][106226] Updated weights for policy 0, policy_version 15367 (0.0006) [2023-12-27 19:20:28,784][106226] Updated weights for policy 0, policy_version 15377 (0.0007) [2023-12-27 19:20:28,845][106226] Updated weights for policy 0, policy_version 15387 (0.0007) [2023-12-27 19:20:29,459][106225] Updated weights for policy 1, policy_version 15324 (0.0009) [2023-12-27 19:20:29,516][106225] Updated weights for policy 1, policy_version 15334 (0.0010) [2023-12-27 19:20:29,563][106226] Updated weights for policy 0, policy_version 15397 (0.0008) [2023-12-27 19:20:29,569][106225] Updated weights for policy 1, policy_version 15344 (0.0010) [2023-12-27 19:20:29,628][106226] Updated weights for policy 0, policy_version 15407 (0.0006) [2023-12-27 19:20:29,686][106226] Updated weights for policy 0, policy_version 15417 (0.0007) [2023-12-27 19:20:30,344][106225] Updated weights for policy 1, policy_version 15354 (0.0010) [2023-12-27 19:20:30,406][106225] Updated weights for policy 1, policy_version 15364 (0.0010) [2023-12-27 19:20:30,431][106226] Updated weights for policy 0, policy_version 15427 (0.0007) [2023-12-27 19:20:30,463][106225] Updated weights for policy 1, policy_version 15374 (0.0010) [2023-12-27 19:20:30,485][106226] Updated weights for policy 0, policy_version 15437 (0.0006) [2023-12-27 19:20:30,509][106225] Updated weights for policy 1, policy_version 15384 (0.0010) [2023-12-27 19:20:30,539][106226] Updated weights for policy 0, policy_version 15447 (0.0007) [2023-12-27 19:20:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 7897088. Throughput: 0: 9713.9, 1: 10052.3. Samples: 7890664. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-27 19:20:31,175][105115] Avg episode reward: [(0, '-5.491'), (1, '-6.974')] [2023-12-27 19:20:31,176][106140] Saving new best policy, reward=-5.491! [2023-12-27 19:20:31,204][106226] Updated weights for policy 0, policy_version 15457 (0.0008) [2023-12-27 19:20:31,255][106225] Updated weights for policy 1, policy_version 15394 (0.0009) [2023-12-27 19:20:31,270][106226] Updated weights for policy 0, policy_version 15467 (0.0010) [2023-12-27 19:20:31,315][106225] Updated weights for policy 1, policy_version 15404 (0.0007) [2023-12-27 19:20:31,338][106226] Updated weights for policy 0, policy_version 15477 (0.0009) [2023-12-27 19:20:31,385][106225] Updated weights for policy 1, policy_version 15414 (0.0009) [2023-12-27 19:20:31,408][106226] Updated weights for policy 0, policy_version 15487 (0.0010) [2023-12-27 19:20:32,123][106226] Updated weights for policy 0, policy_version 15497 (0.0006) [2023-12-27 19:20:32,157][106225] Updated weights for policy 1, policy_version 15424 (0.0008) [2023-12-27 19:20:32,174][106226] Updated weights for policy 0, policy_version 15507 (0.0007) [2023-12-27 19:20:32,219][106225] Updated weights for policy 1, policy_version 15434 (0.0008) [2023-12-27 19:20:32,231][106226] Updated weights for policy 0, policy_version 15517 (0.0007) [2023-12-27 19:20:32,279][106225] Updated weights for policy 1, policy_version 15444 (0.0008) [2023-12-27 19:20:32,936][106225] Updated weights for policy 1, policy_version 15454 (0.0009) [2023-12-27 19:20:32,982][106226] Updated weights for policy 0, policy_version 15527 (0.0006) [2023-12-27 19:20:32,992][106225] Updated weights for policy 1, policy_version 15464 (0.0010) [2023-12-27 19:20:33,043][106226] Updated weights for policy 0, policy_version 15537 (0.0005) [2023-12-27 19:20:33,049][106225] Updated weights for policy 1, policy_version 15474 (0.0010) [2023-12-27 19:20:33,096][106226] Updated weights for policy 0, policy_version 15547 (0.0008) [2023-12-27 19:20:33,742][106225] Updated weights for policy 1, policy_version 15484 (0.0008) [2023-12-27 19:20:33,793][106225] Updated weights for policy 1, policy_version 15494 (0.0005) [2023-12-27 19:20:33,815][106226] Updated weights for policy 0, policy_version 15557 (0.0008) [2023-12-27 19:20:33,856][106225] Updated weights for policy 1, policy_version 15504 (0.0008) [2023-12-27 19:20:33,873][106226] Updated weights for policy 0, policy_version 15567 (0.0006) [2023-12-27 19:20:33,933][106226] Updated weights for policy 0, policy_version 15577 (0.0006) [2023-12-27 19:20:34,532][106225] Updated weights for policy 1, policy_version 15514 (0.0010) [2023-12-27 19:20:34,596][106225] Updated weights for policy 1, policy_version 15524 (0.0011) [2023-12-27 19:20:34,655][106225] Updated weights for policy 1, policy_version 15534 (0.0011) [2023-12-27 19:20:34,673][106226] Updated weights for policy 0, policy_version 15587 (0.0009) [2023-12-27 19:20:34,720][106225] Updated weights for policy 1, policy_version 15544 (0.0011) [2023-12-27 19:20:34,730][106226] Updated weights for policy 0, policy_version 15597 (0.0006) [2023-12-27 19:20:34,788][106226] Updated weights for policy 0, policy_version 15607 (0.0007) [2023-12-27 19:20:35,390][106225] Updated weights for policy 1, policy_version 15554 (0.0010) [2023-12-27 19:20:35,447][106225] Updated weights for policy 1, policy_version 15564 (0.0010) [2023-12-27 19:20:35,448][106226] Updated weights for policy 0, policy_version 15617 (0.0007) [2023-12-27 19:20:35,507][106225] Updated weights for policy 1, policy_version 15574 (0.0010) [2023-12-27 19:20:35,509][106226] Updated weights for policy 0, policy_version 15627 (0.0005) [2023-12-27 19:20:35,558][106226] Updated weights for policy 0, policy_version 15637 (0.0007) [2023-12-27 19:20:35,619][106226] Updated weights for policy 0, policy_version 15647 (0.0008) [2023-12-27 19:20:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 7995392. Throughput: 0: 9662.2, 1: 9973.4. Samples: 8007804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:20:36,175][105115] Avg episode reward: [(0, '-5.498'), (1, '-6.715')] [2023-12-27 19:20:36,221][106225] Updated weights for policy 1, policy_version 15584 (0.0011) [2023-12-27 19:20:36,279][106225] Updated weights for policy 1, policy_version 15594 (0.0010) [2023-12-27 19:20:36,341][106225] Updated weights for policy 1, policy_version 15604 (0.0010) [2023-12-27 19:20:36,411][106226] Updated weights for policy 0, policy_version 15657 (0.0007) [2023-12-27 19:20:36,475][106226] Updated weights for policy 0, policy_version 15667 (0.0007) [2023-12-27 19:20:36,541][106226] Updated weights for policy 0, policy_version 15677 (0.0008) [2023-12-27 19:20:37,065][106225] Updated weights for policy 1, policy_version 15614 (0.0010) [2023-12-27 19:20:37,122][106225] Updated weights for policy 1, policy_version 15624 (0.0010) [2023-12-27 19:20:37,189][106225] Updated weights for policy 1, policy_version 15634 (0.0010) [2023-12-27 19:20:37,266][106226] Updated weights for policy 0, policy_version 15687 (0.0008) [2023-12-27 19:20:37,323][106226] Updated weights for policy 0, policy_version 15697 (0.0008) [2023-12-27 19:20:37,384][106226] Updated weights for policy 0, policy_version 15707 (0.0008) [2023-12-27 19:20:37,914][106225] Updated weights for policy 1, policy_version 15644 (0.0010) [2023-12-27 19:20:37,967][106225] Updated weights for policy 1, policy_version 15654 (0.0010) [2023-12-27 19:20:38,017][106225] Updated weights for policy 1, policy_version 15664 (0.0010) [2023-12-27 19:20:38,111][106226] Updated weights for policy 0, policy_version 15717 (0.0009) [2023-12-27 19:20:38,166][106226] Updated weights for policy 0, policy_version 15727 (0.0008) [2023-12-27 19:20:38,211][106226] Updated weights for policy 0, policy_version 15737 (0.0007) [2023-12-27 19:20:38,746][106225] Updated weights for policy 1, policy_version 15674 (0.0010) [2023-12-27 19:20:38,803][106225] Updated weights for policy 1, policy_version 15684 (0.0010) [2023-12-27 19:20:38,857][106225] Updated weights for policy 1, policy_version 15694 (0.0010) [2023-12-27 19:20:38,914][106225] Updated weights for policy 1, policy_version 15704 (0.0010) [2023-12-27 19:20:38,962][106226] Updated weights for policy 0, policy_version 15747 (0.0009) [2023-12-27 19:20:39,008][106226] Updated weights for policy 0, policy_version 15757 (0.0010) [2023-12-27 19:20:39,060][106226] Updated weights for policy 0, policy_version 15767 (0.0007) [2023-12-27 19:20:39,641][106225] Updated weights for policy 1, policy_version 15714 (0.0010) [2023-12-27 19:20:39,702][106225] Updated weights for policy 1, policy_version 15724 (0.0010) [2023-12-27 19:20:39,760][106225] Updated weights for policy 1, policy_version 15734 (0.0010) [2023-12-27 19:20:39,813][106226] Updated weights for policy 0, policy_version 15777 (0.0009) [2023-12-27 19:20:39,880][106226] Updated weights for policy 0, policy_version 15787 (0.0011) [2023-12-27 19:20:39,954][106226] Updated weights for policy 0, policy_version 15797 (0.0011) [2023-12-27 19:20:40,024][106226] Updated weights for policy 0, policy_version 15807 (0.0011) [2023-12-27 19:20:40,497][106225] Updated weights for policy 1, policy_version 15744 (0.0010) [2023-12-27 19:20:40,557][106225] Updated weights for policy 1, policy_version 15754 (0.0010) [2023-12-27 19:20:40,614][106225] Updated weights for policy 1, policy_version 15764 (0.0010) [2023-12-27 19:20:40,726][106226] Updated weights for policy 0, policy_version 15817 (0.0010) [2023-12-27 19:20:40,772][106226] Updated weights for policy 0, policy_version 15827 (0.0010) [2023-12-27 19:20:40,818][106226] Updated weights for policy 0, policy_version 15837 (0.0010) [2023-12-27 19:20:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 8093696. Throughput: 0: 9678.5, 1: 9930.0. Samples: 8065432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:20:41,175][105115] Avg episode reward: [(0, '-5.498'), (1, '-7.028')] [2023-12-27 19:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000015768_4038656.pth... [2023-12-27 19:20:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000015840_4055040.pth... [2023-12-27 19:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000014616_3743744.pth [2023-12-27 19:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000014720_3768320.pth [2023-12-27 19:20:41,345][106225] Updated weights for policy 1, policy_version 15774 (0.0010) [2023-12-27 19:20:41,430][106225] Updated weights for policy 1, policy_version 15784 (0.0010) [2023-12-27 19:20:41,499][106225] Updated weights for policy 1, policy_version 15794 (0.0010) [2023-12-27 19:20:41,572][106226] Updated weights for policy 0, policy_version 15847 (0.0010) [2023-12-27 19:20:41,640][106226] Updated weights for policy 0, policy_version 15857 (0.0009) [2023-12-27 19:20:41,698][106226] Updated weights for policy 0, policy_version 15867 (0.0008) [2023-12-27 19:20:42,262][106225] Updated weights for policy 1, policy_version 15804 (0.0011) [2023-12-27 19:20:42,321][106225] Updated weights for policy 1, policy_version 15814 (0.0010) [2023-12-27 19:20:42,394][106225] Updated weights for policy 1, policy_version 15824 (0.0009) [2023-12-27 19:20:42,488][106226] Updated weights for policy 0, policy_version 15877 (0.0008) [2023-12-27 19:20:42,538][106226] Updated weights for policy 0, policy_version 15887 (0.0007) [2023-12-27 19:20:42,597][106226] Updated weights for policy 0, policy_version 15897 (0.0008) [2023-12-27 19:20:43,110][106225] Updated weights for policy 1, policy_version 15834 (0.0010) [2023-12-27 19:20:43,170][106225] Updated weights for policy 1, policy_version 15844 (0.0010) [2023-12-27 19:20:43,230][106225] Updated weights for policy 1, policy_version 15854 (0.0010) [2023-12-27 19:20:43,285][106226] Updated weights for policy 0, policy_version 15907 (0.0009) [2023-12-27 19:20:43,295][106225] Updated weights for policy 1, policy_version 15864 (0.0010) [2023-12-27 19:20:43,335][106226] Updated weights for policy 0, policy_version 15917 (0.0010) [2023-12-27 19:20:43,388][106226] Updated weights for policy 0, policy_version 15927 (0.0010) [2023-12-27 19:20:43,942][106225] Updated weights for policy 1, policy_version 15874 (0.0010) [2023-12-27 19:20:43,992][106225] Updated weights for policy 1, policy_version 15884 (0.0010) [2023-12-27 19:20:44,038][106225] Updated weights for policy 1, policy_version 15894 (0.0010) [2023-12-27 19:20:44,111][106226] Updated weights for policy 0, policy_version 15937 (0.0010) [2023-12-27 19:20:44,174][106226] Updated weights for policy 0, policy_version 15947 (0.0010) [2023-12-27 19:20:44,226][106226] Updated weights for policy 0, policy_version 15957 (0.0005) [2023-12-27 19:20:44,282][106226] Updated weights for policy 0, policy_version 15967 (0.0006) [2023-12-27 19:20:44,786][106225] Updated weights for policy 1, policy_version 15904 (0.0009) [2023-12-27 19:20:44,813][106226] Updated weights for policy 0, policy_version 15977 (0.0008) [2023-12-27 19:20:44,841][106225] Updated weights for policy 1, policy_version 15914 (0.0006) [2023-12-27 19:20:44,871][106226] Updated weights for policy 0, policy_version 15987 (0.0009) [2023-12-27 19:20:44,901][106225] Updated weights for policy 1, policy_version 15924 (0.0006) [2023-12-27 19:20:44,926][106226] Updated weights for policy 0, policy_version 15997 (0.0008) [2023-12-27 19:20:45,548][106225] Updated weights for policy 1, policy_version 15934 (0.0008) [2023-12-27 19:20:45,589][106226] Updated weights for policy 0, policy_version 16007 (0.0007) [2023-12-27 19:20:45,602][106225] Updated weights for policy 1, policy_version 15944 (0.0007) [2023-12-27 19:20:45,643][106226] Updated weights for policy 0, policy_version 16017 (0.0008) [2023-12-27 19:20:45,651][106225] Updated weights for policy 1, policy_version 15954 (0.0005) [2023-12-27 19:20:45,701][106226] Updated weights for policy 0, policy_version 16027 (0.0007) [2023-12-27 19:20:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 8192000. Throughput: 0: 9774.3, 1: 9862.6. Samples: 8181580. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 19:20:46,176][105115] Avg episode reward: [(0, '-5.947'), (1, '-6.574')] [2023-12-27 19:20:46,296][106225] Updated weights for policy 1, policy_version 15964 (0.0006) [2023-12-27 19:20:46,362][106225] Updated weights for policy 1, policy_version 15974 (0.0007) [2023-12-27 19:20:46,399][106226] Updated weights for policy 0, policy_version 16037 (0.0005) [2023-12-27 19:20:46,411][106225] Updated weights for policy 1, policy_version 15984 (0.0008) [2023-12-27 19:20:46,447][106226] Updated weights for policy 0, policy_version 16047 (0.0005) [2023-12-27 19:20:46,502][106226] Updated weights for policy 0, policy_version 16057 (0.0005) [2023-12-27 19:20:47,097][106225] Updated weights for policy 1, policy_version 15994 (0.0008) [2023-12-27 19:20:47,123][106226] Updated weights for policy 0, policy_version 16067 (0.0007) [2023-12-27 19:20:47,160][106225] Updated weights for policy 1, policy_version 16004 (0.0010) [2023-12-27 19:20:47,182][106226] Updated weights for policy 0, policy_version 16077 (0.0005) [2023-12-27 19:20:47,215][106225] Updated weights for policy 1, policy_version 16014 (0.0010) [2023-12-27 19:20:47,233][106226] Updated weights for policy 0, policy_version 16087 (0.0006) [2023-12-27 19:20:47,284][106225] Updated weights for policy 1, policy_version 16024 (0.0010) [2023-12-27 19:20:47,854][106226] Updated weights for policy 0, policy_version 16097 (0.0007) [2023-12-27 19:20:47,909][106226] Updated weights for policy 0, policy_version 16107 (0.0007) [2023-12-27 19:20:47,953][106225] Updated weights for policy 1, policy_version 16034 (0.0009) [2023-12-27 19:20:47,967][106226] Updated weights for policy 0, policy_version 16117 (0.0008) [2023-12-27 19:20:48,016][106225] Updated weights for policy 1, policy_version 16044 (0.0011) [2023-12-27 19:20:48,030][106226] Updated weights for policy 0, policy_version 16127 (0.0006) [2023-12-27 19:20:48,074][106225] Updated weights for policy 1, policy_version 16054 (0.0010) [2023-12-27 19:20:48,757][106226] Updated weights for policy 0, policy_version 16137 (0.0006) [2023-12-27 19:20:48,778][106225] Updated weights for policy 1, policy_version 16064 (0.0008) [2023-12-27 19:20:48,808][106226] Updated weights for policy 0, policy_version 16147 (0.0005) [2023-12-27 19:20:48,836][106225] Updated weights for policy 1, policy_version 16074 (0.0010) [2023-12-27 19:20:48,870][106226] Updated weights for policy 0, policy_version 16157 (0.0006) [2023-12-27 19:20:48,893][106225] Updated weights for policy 1, policy_version 16084 (0.0006) [2023-12-27 19:20:49,562][106225] Updated weights for policy 1, policy_version 16094 (0.0007) [2023-12-27 19:20:49,569][106226] Updated weights for policy 0, policy_version 16167 (0.0007) [2023-12-27 19:20:49,619][106225] Updated weights for policy 1, policy_version 16104 (0.0008) [2023-12-27 19:20:49,631][106226] Updated weights for policy 0, policy_version 16177 (0.0005) [2023-12-27 19:20:49,679][106225] Updated weights for policy 1, policy_version 16114 (0.0008) [2023-12-27 19:20:49,685][106226] Updated weights for policy 0, policy_version 16187 (0.0006) [2023-12-27 19:20:50,387][106226] Updated weights for policy 0, policy_version 16197 (0.0007) [2023-12-27 19:20:50,421][106225] Updated weights for policy 1, policy_version 16124 (0.0007) [2023-12-27 19:20:50,455][106226] Updated weights for policy 0, policy_version 16207 (0.0007) [2023-12-27 19:20:50,480][106225] Updated weights for policy 1, policy_version 16134 (0.0006) [2023-12-27 19:20:50,516][106226] Updated weights for policy 0, policy_version 16217 (0.0009) [2023-12-27 19:20:50,541][106225] Updated weights for policy 1, policy_version 16144 (0.0006) [2023-12-27 19:20:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 8290304. Throughput: 0: 9765.3, 1: 9894.6. Samples: 8303056. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 19:20:51,175][105115] Avg episode reward: [(0, '-6.158'), (1, '-6.875')] [2023-12-27 19:20:51,251][106225] Updated weights for policy 1, policy_version 16154 (0.0006) [2023-12-27 19:20:51,286][106226] Updated weights for policy 0, policy_version 16227 (0.0007) [2023-12-27 19:20:51,317][106225] Updated weights for policy 1, policy_version 16164 (0.0010) [2023-12-27 19:20:51,351][106226] Updated weights for policy 0, policy_version 16237 (0.0008) [2023-12-27 19:20:51,382][106225] Updated weights for policy 1, policy_version 16174 (0.0008) [2023-12-27 19:20:51,418][106226] Updated weights for policy 0, policy_version 16247 (0.0008) [2023-12-27 19:20:51,448][106225] Updated weights for policy 1, policy_version 16184 (0.0008) [2023-12-27 19:20:52,081][106226] Updated weights for policy 0, policy_version 16257 (0.0007) [2023-12-27 19:20:52,122][106225] Updated weights for policy 1, policy_version 16194 (0.0008) [2023-12-27 19:20:52,141][106226] Updated weights for policy 0, policy_version 16267 (0.0009) [2023-12-27 19:20:52,175][106225] Updated weights for policy 1, policy_version 16204 (0.0007) [2023-12-27 19:20:52,207][106226] Updated weights for policy 0, policy_version 16277 (0.0008) [2023-12-27 19:20:52,233][106225] Updated weights for policy 1, policy_version 16214 (0.0006) [2023-12-27 19:20:52,264][106226] Updated weights for policy 0, policy_version 16287 (0.0006) [2023-12-27 19:20:52,979][106225] Updated weights for policy 1, policy_version 16224 (0.0006) [2023-12-27 19:20:52,988][106226] Updated weights for policy 0, policy_version 16297 (0.0007) [2023-12-27 19:20:53,037][106225] Updated weights for policy 1, policy_version 16234 (0.0006) [2023-12-27 19:20:53,042][106226] Updated weights for policy 0, policy_version 16307 (0.0006) [2023-12-27 19:20:53,083][106225] Updated weights for policy 1, policy_version 16244 (0.0009) [2023-12-27 19:20:53,100][106226] Updated weights for policy 0, policy_version 16317 (0.0008) [2023-12-27 19:20:53,728][106225] Updated weights for policy 1, policy_version 16254 (0.0007) [2023-12-27 19:20:53,785][106225] Updated weights for policy 1, policy_version 16264 (0.0008) [2023-12-27 19:20:53,835][106225] Updated weights for policy 1, policy_version 16274 (0.0007) [2023-12-27 19:20:53,841][106226] Updated weights for policy 0, policy_version 16327 (0.0007) [2023-12-27 19:20:53,899][106226] Updated weights for policy 0, policy_version 16337 (0.0008) [2023-12-27 19:20:53,950][106226] Updated weights for policy 0, policy_version 16347 (0.0008) [2023-12-27 19:20:54,448][106225] Updated weights for policy 1, policy_version 16284 (0.0006) [2023-12-27 19:20:54,500][106225] Updated weights for policy 1, policy_version 16294 (0.0006) [2023-12-27 19:20:54,551][106225] Updated weights for policy 1, policy_version 16304 (0.0008) [2023-12-27 19:20:54,687][106226] Updated weights for policy 0, policy_version 16357 (0.0009) [2023-12-27 19:20:54,738][106226] Updated weights for policy 0, policy_version 16367 (0.0008) [2023-12-27 19:20:54,784][106226] Updated weights for policy 0, policy_version 16377 (0.0006) [2023-12-27 19:20:55,315][106225] Updated weights for policy 1, policy_version 16314 (0.0008) [2023-12-27 19:20:55,381][106225] Updated weights for policy 1, policy_version 16324 (0.0008) [2023-12-27 19:20:55,427][106225] Updated weights for policy 1, policy_version 16334 (0.0005) [2023-12-27 19:20:55,443][106226] Updated weights for policy 0, policy_version 16387 (0.0006) [2023-12-27 19:20:55,491][106225] Updated weights for policy 1, policy_version 16344 (0.0007) [2023-12-27 19:20:55,497][106226] Updated weights for policy 0, policy_version 16397 (0.0008) [2023-12-27 19:20:55,552][106226] Updated weights for policy 0, policy_version 16407 (0.0008) [2023-12-27 19:20:56,131][106225] Updated weights for policy 1, policy_version 16354 (0.0005) [2023-12-27 19:20:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 8388608. Throughput: 0: 9704.5, 1: 9890.1. Samples: 8361328. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 19:20:56,175][105115] Avg episode reward: [(0, '-5.670'), (1, '-6.525')] [2023-12-27 19:20:56,186][106226] Updated weights for policy 0, policy_version 16417 (0.0009) [2023-12-27 19:20:56,187][106225] Updated weights for policy 1, policy_version 16364 (0.0006) [2023-12-27 19:20:56,236][106225] Updated weights for policy 1, policy_version 16374 (0.0008) [2023-12-27 19:20:56,243][106226] Updated weights for policy 0, policy_version 16427 (0.0005) [2023-12-27 19:20:56,245][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000016376_4194304.pth... [2023-12-27 19:20:56,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000015224_3899392.pth [2023-12-27 19:20:56,305][106226] Updated weights for policy 0, policy_version 16437 (0.0005) [2023-12-27 19:20:56,372][106226] Updated weights for policy 0, policy_version 16447 (0.0007) [2023-12-27 19:20:56,376][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000016448_4210688.pth... [2023-12-27 19:20:56,380][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000015296_3915776.pth [2023-12-27 19:20:56,889][106225] Updated weights for policy 1, policy_version 16384 (0.0007) [2023-12-27 19:20:56,929][106226] Updated weights for policy 0, policy_version 16457 (0.0006) [2023-12-27 19:20:56,948][106225] Updated weights for policy 1, policy_version 16394 (0.0010) [2023-12-27 19:20:56,990][106226] Updated weights for policy 0, policy_version 16467 (0.0005) [2023-12-27 19:20:57,007][106225] Updated weights for policy 1, policy_version 16404 (0.0007) [2023-12-27 19:20:57,050][106226] Updated weights for policy 0, policy_version 16477 (0.0008) [2023-12-27 19:20:57,595][106225] Updated weights for policy 1, policy_version 16414 (0.0005) [2023-12-27 19:20:57,648][106225] Updated weights for policy 1, policy_version 16424 (0.0005) [2023-12-27 19:20:57,705][106225] Updated weights for policy 1, policy_version 16434 (0.0006) [2023-12-27 19:20:57,718][106226] Updated weights for policy 0, policy_version 16487 (0.0010) [2023-12-27 19:20:57,769][106226] Updated weights for policy 0, policy_version 16497 (0.0010) [2023-12-27 19:20:57,815][106226] Updated weights for policy 0, policy_version 16507 (0.0010) [2023-12-27 19:20:58,361][106225] Updated weights for policy 1, policy_version 16444 (0.0008) [2023-12-27 19:20:58,435][106225] Updated weights for policy 1, policy_version 16454 (0.0009) [2023-12-27 19:20:58,494][106225] Updated weights for policy 1, policy_version 16464 (0.0008) [2023-12-27 19:20:58,613][106226] Updated weights for policy 0, policy_version 16517 (0.0009) [2023-12-27 19:20:58,677][106226] Updated weights for policy 0, policy_version 16527 (0.0009) [2023-12-27 19:20:58,747][106226] Updated weights for policy 0, policy_version 16537 (0.0009) [2023-12-27 19:20:59,419][106225] Updated weights for policy 1, policy_version 16474 (0.0008) [2023-12-27 19:20:59,483][106225] Updated weights for policy 1, policy_version 16484 (0.0009) [2023-12-27 19:20:59,538][106226] Updated weights for policy 0, policy_version 16547 (0.0008) [2023-12-27 19:20:59,551][106225] Updated weights for policy 1, policy_version 16494 (0.0009) [2023-12-27 19:20:59,604][106226] Updated weights for policy 0, policy_version 16557 (0.0006) [2023-12-27 19:20:59,618][106225] Updated weights for policy 1, policy_version 16504 (0.0009) [2023-12-27 19:20:59,664][106226] Updated weights for policy 0, policy_version 16567 (0.0008) [2023-12-27 19:21:00,340][106226] Updated weights for policy 0, policy_version 16577 (0.0008) [2023-12-27 19:21:00,384][106225] Updated weights for policy 1, policy_version 16514 (0.0010) [2023-12-27 19:21:00,406][106226] Updated weights for policy 0, policy_version 16587 (0.0007) [2023-12-27 19:21:00,448][106225] Updated weights for policy 1, policy_version 16524 (0.0010) [2023-12-27 19:21:00,474][106226] Updated weights for policy 0, policy_version 16597 (0.0008) [2023-12-27 19:21:00,509][106225] Updated weights for policy 1, policy_version 16534 (0.0010) [2023-12-27 19:21:00,530][106226] Updated weights for policy 0, policy_version 16607 (0.0008) [2023-12-27 19:21:01,127][106225] Updated weights for policy 1, policy_version 16544 (0.0010) [2023-12-27 19:21:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 8486912. Throughput: 0: 9782.9, 1: 9875.7. Samples: 8481928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:21:01,175][105115] Avg episode reward: [(0, '-6.005'), (1, '-7.000')] [2023-12-27 19:21:01,195][106225] Updated weights for policy 1, policy_version 16554 (0.0010) [2023-12-27 19:21:01,263][106225] Updated weights for policy 1, policy_version 16564 (0.0011) [2023-12-27 19:21:01,328][106226] Updated weights for policy 0, policy_version 16617 (0.0008) [2023-12-27 19:21:01,395][106226] Updated weights for policy 0, policy_version 16627 (0.0009) [2023-12-27 19:21:01,464][106226] Updated weights for policy 0, policy_version 16637 (0.0008) [2023-12-27 19:21:01,963][106225] Updated weights for policy 1, policy_version 16574 (0.0009) [2023-12-27 19:21:02,028][106225] Updated weights for policy 1, policy_version 16584 (0.0010) [2023-12-27 19:21:02,091][106225] Updated weights for policy 1, policy_version 16594 (0.0009) [2023-12-27 19:21:02,171][106226] Updated weights for policy 0, policy_version 16647 (0.0008) [2023-12-27 19:21:02,236][106226] Updated weights for policy 0, policy_version 16657 (0.0007) [2023-12-27 19:21:02,297][106226] Updated weights for policy 0, policy_version 16667 (0.0008) [2023-12-27 19:21:02,795][106225] Updated weights for policy 1, policy_version 16604 (0.0009) [2023-12-27 19:21:02,862][106225] Updated weights for policy 1, policy_version 16614 (0.0009) [2023-12-27 19:21:02,919][106225] Updated weights for policy 1, policy_version 16624 (0.0007) [2023-12-27 19:21:02,954][106226] Updated weights for policy 0, policy_version 16677 (0.0009) [2023-12-27 19:21:03,018][106226] Updated weights for policy 0, policy_version 16687 (0.0009) [2023-12-27 19:21:03,089][106226] Updated weights for policy 0, policy_version 16697 (0.0007) [2023-12-27 19:21:03,608][106226] Updated weights for policy 0, policy_version 16707 (0.0005) [2023-12-27 19:21:03,648][106225] Updated weights for policy 1, policy_version 16634 (0.0009) [2023-12-27 19:21:03,655][106226] Updated weights for policy 0, policy_version 16717 (0.0006) [2023-12-27 19:21:03,705][106225] Updated weights for policy 1, policy_version 16644 (0.0010) [2023-12-27 19:21:03,707][106226] Updated weights for policy 0, policy_version 16727 (0.0006) [2023-12-27 19:21:03,755][106225] Updated weights for policy 1, policy_version 16654 (0.0010) [2023-12-27 19:21:03,820][106225] Updated weights for policy 1, policy_version 16664 (0.0010) [2023-12-27 19:21:04,381][106226] Updated weights for policy 0, policy_version 16737 (0.0005) [2023-12-27 19:21:04,445][106226] Updated weights for policy 0, policy_version 16747 (0.0006) [2023-12-27 19:21:04,511][106226] Updated weights for policy 0, policy_version 16757 (0.0008) [2023-12-27 19:21:04,573][106226] Updated weights for policy 0, policy_version 16767 (0.0010) [2023-12-27 19:21:04,590][106225] Updated weights for policy 1, policy_version 16674 (0.0006) [2023-12-27 19:21:04,647][106225] Updated weights for policy 1, policy_version 16684 (0.0005) [2023-12-27 19:21:04,706][106225] Updated weights for policy 1, policy_version 16694 (0.0006) [2023-12-27 19:21:05,229][106226] Updated weights for policy 0, policy_version 16777 (0.0011) [2023-12-27 19:21:05,284][106226] Updated weights for policy 0, policy_version 16787 (0.0010) [2023-12-27 19:21:05,340][106226] Updated weights for policy 0, policy_version 16797 (0.0010) [2023-12-27 19:21:05,353][106225] Updated weights for policy 1, policy_version 16704 (0.0010) [2023-12-27 19:21:05,405][106225] Updated weights for policy 1, policy_version 16714 (0.0010) [2023-12-27 19:21:05,462][106225] Updated weights for policy 1, policy_version 16724 (0.0010) [2023-12-27 19:21:06,018][106226] Updated weights for policy 0, policy_version 16807 (0.0011) [2023-12-27 19:21:06,073][106226] Updated weights for policy 0, policy_version 16817 (0.0010) [2023-12-27 19:21:06,124][106225] Updated weights for policy 1, policy_version 16734 (0.0007) [2023-12-27 19:21:06,137][106226] Updated weights for policy 0, policy_version 16827 (0.0009) [2023-12-27 19:21:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 8593408. Throughput: 0: 9833.4, 1: 9840.3. Samples: 8602560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:21:06,175][105115] Avg episode reward: [(0, '-6.115'), (1, '-6.668')] [2023-12-27 19:21:06,183][106225] Updated weights for policy 1, policy_version 16744 (0.0006) [2023-12-27 19:21:06,242][106225] Updated weights for policy 1, policy_version 16754 (0.0008) [2023-12-27 19:21:06,828][106226] Updated weights for policy 0, policy_version 16837 (0.0010) [2023-12-27 19:21:06,886][106226] Updated weights for policy 0, policy_version 16847 (0.0011) [2023-12-27 19:21:06,947][106226] Updated weights for policy 0, policy_version 16857 (0.0011) [2023-12-27 19:21:06,991][106225] Updated weights for policy 1, policy_version 16764 (0.0007) [2023-12-27 19:21:07,047][106225] Updated weights for policy 1, policy_version 16774 (0.0008) [2023-12-27 19:21:07,095][106225] Updated weights for policy 1, policy_version 16784 (0.0006) [2023-12-27 19:21:07,618][106226] Updated weights for policy 0, policy_version 16867 (0.0010) [2023-12-27 19:21:07,672][106226] Updated weights for policy 0, policy_version 16877 (0.0010) [2023-12-27 19:21:07,713][106225] Updated weights for policy 1, policy_version 16794 (0.0006) [2023-12-27 19:21:07,726][106226] Updated weights for policy 0, policy_version 16887 (0.0010) [2023-12-27 19:21:07,730][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000003 [2023-12-27 19:21:07,770][106225] Updated weights for policy 1, policy_version 16804 (0.0010) [2023-12-27 19:21:07,827][106225] Updated weights for policy 1, policy_version 16814 (0.0010) [2023-12-27 19:21:07,883][106225] Updated weights for policy 1, policy_version 16824 (0.0010) [2023-12-27 19:21:08,374][106226] Updated weights for policy 0, policy_version 16897 (0.0009) [2023-12-27 19:21:08,429][106226] Updated weights for policy 0, policy_version 16907 (0.0006) [2023-12-27 19:21:08,497][106226] Updated weights for policy 0, policy_version 16917 (0.0006) [2023-12-27 19:21:08,616][106225] Updated weights for policy 1, policy_version 16834 (0.0006) [2023-12-27 19:21:08,670][106225] Updated weights for policy 1, policy_version 16844 (0.0009) [2023-12-27 19:21:08,731][106225] Updated weights for policy 1, policy_version 16854 (0.0010) [2023-12-27 19:21:09,177][106226] Updated weights for policy 0, policy_version 16927 (0.0006) [2023-12-27 19:21:09,247][106226] Updated weights for policy 0, policy_version 16937 (0.0007) [2023-12-27 19:21:09,301][106226] Updated weights for policy 0, policy_version 16947 (0.0011) [2023-12-27 19:21:09,450][106225] Updated weights for policy 1, policy_version 16864 (0.0008) [2023-12-27 19:21:09,505][106225] Updated weights for policy 1, policy_version 16874 (0.0008) [2023-12-27 19:21:09,564][106225] Updated weights for policy 1, policy_version 16884 (0.0008) [2023-12-27 19:21:10,036][106226] Updated weights for policy 0, policy_version 16957 (0.0010) [2023-12-27 19:21:10,101][106226] Updated weights for policy 0, policy_version 16967 (0.0011) [2023-12-27 19:21:10,174][106226] Updated weights for policy 0, policy_version 16977 (0.0009) [2023-12-27 19:21:10,334][106225] Updated weights for policy 1, policy_version 16894 (0.0007) [2023-12-27 19:21:10,394][106225] Updated weights for policy 1, policy_version 16904 (0.0007) [2023-12-27 19:21:10,460][106225] Updated weights for policy 1, policy_version 16914 (0.0008) [2023-12-27 19:21:10,875][106226] Updated weights for policy 0, policy_version 16987 (0.0011) [2023-12-27 19:21:10,939][106226] Updated weights for policy 0, policy_version 16997 (0.0011) [2023-12-27 19:21:11,008][106226] Updated weights for policy 0, policy_version 17007 (0.0011) [2023-12-27 19:21:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 8691712. Throughput: 0: 9889.2, 1: 9881.6. Samples: 8663560. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 19:21:11,175][105115] Avg episode reward: [(0, '-5.899'), (1, '-6.795')] [2023-12-27 19:21:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000017016_4358144.pth... [2023-12-27 19:21:11,185][106225] Updated weights for policy 1, policy_version 16924 (0.0008) [2023-12-27 19:21:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000015840_4055040.pth [2023-12-27 19:21:11,246][106225] Updated weights for policy 1, policy_version 16934 (0.0007) [2023-12-27 19:21:11,305][106225] Updated weights for policy 1, policy_version 16944 (0.0008) [2023-12-27 19:21:11,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000016952_4341760.pth... [2023-12-27 19:21:11,365][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000015768_4038656.pth [2023-12-27 19:21:11,779][106226] Updated weights for policy 0, policy_version 17017 (0.0009) [2023-12-27 19:21:11,846][106226] Updated weights for policy 0, policy_version 17027 (0.0009) [2023-12-27 19:21:11,911][106226] Updated weights for policy 0, policy_version 17037 (0.0007) [2023-12-27 19:21:11,980][106226] Updated weights for policy 0, policy_version 17047 (0.0006) [2023-12-27 19:21:12,100][106225] Updated weights for policy 1, policy_version 16954 (0.0008) [2023-12-27 19:21:12,163][106225] Updated weights for policy 1, policy_version 16964 (0.0008) [2023-12-27 19:21:12,215][106225] Updated weights for policy 1, policy_version 16974 (0.0008) [2023-12-27 19:21:12,279][106225] Updated weights for policy 1, policy_version 16984 (0.0009) [2023-12-27 19:21:12,650][106226] Updated weights for policy 0, policy_version 17057 (0.0008) [2023-12-27 19:21:12,700][106226] Updated weights for policy 0, policy_version 17067 (0.0008) [2023-12-27 19:21:12,753][106226] Updated weights for policy 0, policy_version 17077 (0.0008) [2023-12-27 19:21:13,104][106225] Updated weights for policy 1, policy_version 16994 (0.0008) [2023-12-27 19:21:13,172][106225] Updated weights for policy 1, policy_version 17004 (0.0008) [2023-12-27 19:21:13,225][106225] Updated weights for policy 1, policy_version 17014 (0.0009) [2023-12-27 19:21:13,411][106226] Updated weights for policy 0, policy_version 17087 (0.0007) [2023-12-27 19:21:13,479][106226] Updated weights for policy 0, policy_version 17097 (0.0005) [2023-12-27 19:21:13,541][106226] Updated weights for policy 0, policy_version 17107 (0.0006) [2023-12-27 19:21:13,936][106225] Updated weights for policy 1, policy_version 17024 (0.0010) [2023-12-27 19:21:13,986][106225] Updated weights for policy 1, policy_version 17034 (0.0010) [2023-12-27 19:21:14,041][106225] Updated weights for policy 1, policy_version 17044 (0.0009) [2023-12-27 19:21:14,119][106226] Updated weights for policy 0, policy_version 17117 (0.0006) [2023-12-27 19:21:14,173][106226] Updated weights for policy 0, policy_version 17127 (0.0008) [2023-12-27 19:21:14,225][106226] Updated weights for policy 0, policy_version 17137 (0.0007) [2023-12-27 19:21:14,642][106225] Updated weights for policy 1, policy_version 17054 (0.0008) [2023-12-27 19:21:14,695][106225] Updated weights for policy 1, policy_version 17064 (0.0010) [2023-12-27 19:21:14,739][106225] Updated weights for policy 1, policy_version 17074 (0.0010) [2023-12-27 19:21:14,998][106226] Updated weights for policy 0, policy_version 17147 (0.0007) [2023-12-27 19:21:15,064][106226] Updated weights for policy 0, policy_version 17157 (0.0008) [2023-12-27 19:21:15,140][106226] Updated weights for policy 0, policy_version 17167 (0.0008) [2023-12-27 19:21:15,428][106225] Updated weights for policy 1, policy_version 17084 (0.0007) [2023-12-27 19:21:15,481][106225] Updated weights for policy 1, policy_version 17094 (0.0005) [2023-12-27 19:21:15,528][106225] Updated weights for policy 1, policy_version 17104 (0.0005) [2023-12-27 19:21:15,771][106226] Updated weights for policy 0, policy_version 17177 (0.0008) [2023-12-27 19:21:15,818][106226] Updated weights for policy 0, policy_version 17187 (0.0010) [2023-12-27 19:21:15,868][106226] Updated weights for policy 0, policy_version 17197 (0.0010) [2023-12-27 19:21:15,928][106226] Updated weights for policy 0, policy_version 17207 (0.0010) [2023-12-27 19:21:16,077][106225] Updated weights for policy 1, policy_version 17114 (0.0010) [2023-12-27 19:21:16,140][106225] Updated weights for policy 1, policy_version 17124 (0.0010) [2023-12-27 19:21:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 8790016. Throughput: 0: 9914.7, 1: 9823.2. Samples: 8778872. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 19:21:16,175][105115] Avg episode reward: [(0, '-5.795'), (1, '-7.006')] [2023-12-27 19:21:16,199][106225] Updated weights for policy 1, policy_version 17134 (0.0006) [2023-12-27 19:21:16,262][106225] Updated weights for policy 1, policy_version 17144 (0.0009) [2023-12-27 19:21:16,643][106226] Updated weights for policy 0, policy_version 17217 (0.0010) [2023-12-27 19:21:16,710][106226] Updated weights for policy 0, policy_version 17227 (0.0010) [2023-12-27 19:21:16,782][106226] Updated weights for policy 0, policy_version 17237 (0.0010) [2023-12-27 19:21:16,851][106225] Updated weights for policy 1, policy_version 17154 (0.0005) [2023-12-27 19:21:16,910][106225] Updated weights for policy 1, policy_version 17164 (0.0005) [2023-12-27 19:21:16,977][106225] Updated weights for policy 1, policy_version 17174 (0.0006) [2023-12-27 19:21:17,450][106226] Updated weights for policy 0, policy_version 17247 (0.0009) [2023-12-27 19:21:17,499][106226] Updated weights for policy 0, policy_version 17257 (0.0006) [2023-12-27 19:21:17,553][106226] Updated weights for policy 0, policy_version 17267 (0.0005) [2023-12-27 19:21:17,602][106225] Updated weights for policy 1, policy_version 17184 (0.0005) [2023-12-27 19:21:17,661][106225] Updated weights for policy 1, policy_version 17194 (0.0007) [2023-12-27 19:21:17,720][106225] Updated weights for policy 1, policy_version 17204 (0.0008) [2023-12-27 19:21:18,253][106226] Updated weights for policy 0, policy_version 17277 (0.0007) [2023-12-27 19:21:18,309][106226] Updated weights for policy 0, policy_version 17287 (0.0008) [2023-12-27 19:21:18,382][106226] Updated weights for policy 0, policy_version 17297 (0.0008) [2023-12-27 19:21:18,398][106225] Updated weights for policy 1, policy_version 17214 (0.0007) [2023-12-27 19:21:18,462][106225] Updated weights for policy 1, policy_version 17224 (0.0008) [2023-12-27 19:21:18,518][106225] Updated weights for policy 1, policy_version 17234 (0.0008) [2023-12-27 19:21:19,096][106226] Updated weights for policy 0, policy_version 17307 (0.0007) [2023-12-27 19:21:19,148][106226] Updated weights for policy 0, policy_version 17317 (0.0007) [2023-12-27 19:21:19,211][106226] Updated weights for policy 0, policy_version 17327 (0.0008) [2023-12-27 19:21:19,285][106225] Updated weights for policy 1, policy_version 17244 (0.0008) [2023-12-27 19:21:19,349][106225] Updated weights for policy 1, policy_version 17254 (0.0009) [2023-12-27 19:21:19,414][106225] Updated weights for policy 1, policy_version 17264 (0.0008) [2023-12-27 19:21:20,001][106226] Updated weights for policy 0, policy_version 17337 (0.0008) [2023-12-27 19:21:20,065][106226] Updated weights for policy 0, policy_version 17347 (0.0009) [2023-12-27 19:21:20,123][106225] Updated weights for policy 1, policy_version 17274 (0.0007) [2023-12-27 19:21:20,133][106226] Updated weights for policy 0, policy_version 17357 (0.0007) [2023-12-27 19:21:20,182][106225] Updated weights for policy 1, policy_version 17284 (0.0007) [2023-12-27 19:21:20,201][106226] Updated weights for policy 0, policy_version 17367 (0.0007) [2023-12-27 19:21:20,244][106225] Updated weights for policy 1, policy_version 17294 (0.0008) [2023-12-27 19:21:20,304][106225] Updated weights for policy 1, policy_version 17304 (0.0009) [2023-12-27 19:21:20,924][106226] Updated weights for policy 0, policy_version 17377 (0.0008) [2023-12-27 19:21:20,984][106226] Updated weights for policy 0, policy_version 17387 (0.0008) [2023-12-27 19:21:21,053][106226] Updated weights for policy 0, policy_version 17397 (0.0008) [2023-12-27 19:21:21,057][106225] Updated weights for policy 1, policy_version 17314 (0.0007) [2023-12-27 19:21:21,115][106225] Updated weights for policy 1, policy_version 17324 (0.0007) [2023-12-27 19:21:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 8888320. Throughput: 0: 9912.7, 1: 9882.1. Samples: 8898564. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 19:21:21,175][105115] Avg episode reward: [(0, '-5.531'), (1, '-7.008')] [2023-12-27 19:21:21,186][106225] Updated weights for policy 1, policy_version 17334 (0.0007) [2023-12-27 19:21:21,833][106226] Updated weights for policy 0, policy_version 17407 (0.0010) [2023-12-27 19:21:21,889][106226] Updated weights for policy 0, policy_version 17417 (0.0011) [2023-12-27 19:21:21,941][106225] Updated weights for policy 1, policy_version 17344 (0.0007) [2023-12-27 19:21:21,954][106226] Updated weights for policy 0, policy_version 17427 (0.0011) [2023-12-27 19:21:22,004][106225] Updated weights for policy 1, policy_version 17354 (0.0007) [2023-12-27 19:21:22,070][106225] Updated weights for policy 1, policy_version 17364 (0.0008) [2023-12-27 19:21:22,723][106226] Updated weights for policy 0, policy_version 17437 (0.0011) [2023-12-27 19:21:22,785][106226] Updated weights for policy 0, policy_version 17447 (0.0010) [2023-12-27 19:21:22,795][106225] Updated weights for policy 1, policy_version 17374 (0.0010) [2023-12-27 19:21:22,854][106226] Updated weights for policy 0, policy_version 17457 (0.0006) [2023-12-27 19:21:22,857][106225] Updated weights for policy 1, policy_version 17384 (0.0010) [2023-12-27 19:21:22,916][106225] Updated weights for policy 1, policy_version 17394 (0.0010) [2023-12-27 19:21:23,372][106226] Updated weights for policy 0, policy_version 17467 (0.0006) [2023-12-27 19:21:23,429][106226] Updated weights for policy 0, policy_version 17477 (0.0005) [2023-12-27 19:21:23,482][106226] Updated weights for policy 0, policy_version 17487 (0.0005) [2023-12-27 19:21:23,547][106225] Updated weights for policy 1, policy_version 17404 (0.0008) [2023-12-27 19:21:23,591][106225] Updated weights for policy 1, policy_version 17414 (0.0005) [2023-12-27 19:21:23,642][106225] Updated weights for policy 1, policy_version 17424 (0.0005) [2023-12-27 19:21:24,145][106226] Updated weights for policy 0, policy_version 17497 (0.0006) [2023-12-27 19:21:24,201][106226] Updated weights for policy 0, policy_version 17507 (0.0008) [2023-12-27 19:21:24,246][106225] Updated weights for policy 1, policy_version 17434 (0.0006) [2023-12-27 19:21:24,262][106226] Updated weights for policy 0, policy_version 17517 (0.0008) [2023-12-27 19:21:24,296][106225] Updated weights for policy 1, policy_version 17444 (0.0007) [2023-12-27 19:21:24,323][106226] Updated weights for policy 0, policy_version 17527 (0.0005) [2023-12-27 19:21:24,356][106225] Updated weights for policy 1, policy_version 17454 (0.0005) [2023-12-27 19:21:24,405][106225] Updated weights for policy 1, policy_version 17464 (0.0005) [2023-12-27 19:21:24,977][106225] Updated weights for policy 1, policy_version 17474 (0.0006) [2023-12-27 19:21:24,987][106226] Updated weights for policy 0, policy_version 17537 (0.0005) [2023-12-27 19:21:25,030][106225] Updated weights for policy 1, policy_version 17484 (0.0010) [2023-12-27 19:21:25,035][106226] Updated weights for policy 0, policy_version 17547 (0.0005) [2023-12-27 19:21:25,086][106226] Updated weights for policy 0, policy_version 17557 (0.0005) [2023-12-27 19:21:25,087][106225] Updated weights for policy 1, policy_version 17494 (0.0010) [2023-12-27 19:21:25,699][106226] Updated weights for policy 0, policy_version 17567 (0.0005) [2023-12-27 19:21:25,762][106226] Updated weights for policy 0, policy_version 17577 (0.0008) [2023-12-27 19:21:25,785][106225] Updated weights for policy 1, policy_version 17504 (0.0010) [2023-12-27 19:21:25,817][106226] Updated weights for policy 0, policy_version 17587 (0.0011) [2023-12-27 19:21:25,845][106225] Updated weights for policy 1, policy_version 17514 (0.0010) [2023-12-27 19:21:25,905][106225] Updated weights for policy 1, policy_version 17524 (0.0007) [2023-12-27 19:21:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 8994816. Throughput: 0: 9964.8, 1: 9891.1. Samples: 8958948. Policy #0 lag: (min: 3.0, avg: 8.0, max: 35.0) [2023-12-27 19:21:26,176][105115] Avg episode reward: [(0, '-5.239'), (1, '-6.918')] [2023-12-27 19:21:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000017592_4505600.pth... [2023-12-27 19:21:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000017528_4489216.pth... [2023-12-27 19:21:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000016448_4210688.pth [2023-12-27 19:21:26,192][106140] Saving new best policy, reward=-5.239! [2023-12-27 19:21:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000016376_4194304.pth [2023-12-27 19:21:26,402][106226] Updated weights for policy 0, policy_version 17597 (0.0008) [2023-12-27 19:21:26,448][106226] Updated weights for policy 0, policy_version 17607 (0.0005) [2023-12-27 19:21:26,496][106226] Updated weights for policy 0, policy_version 17617 (0.0005) [2023-12-27 19:21:26,506][106225] Updated weights for policy 1, policy_version 17534 (0.0008) [2023-12-27 19:21:26,557][106225] Updated weights for policy 1, policy_version 17544 (0.0009) [2023-12-27 19:21:26,612][106225] Updated weights for policy 1, policy_version 17554 (0.0007) [2023-12-27 19:21:27,011][106226] Updated weights for policy 0, policy_version 17627 (0.0005) [2023-12-27 19:21:27,073][106226] Updated weights for policy 0, policy_version 17637 (0.0010) [2023-12-27 19:21:27,135][106226] Updated weights for policy 0, policy_version 17647 (0.0011) [2023-12-27 19:21:27,353][106225] Updated weights for policy 1, policy_version 17564 (0.0007) [2023-12-27 19:21:27,409][106225] Updated weights for policy 1, policy_version 17574 (0.0010) [2023-12-27 19:21:27,456][106225] Updated weights for policy 1, policy_version 17584 (0.0010) [2023-12-27 19:21:27,836][106226] Updated weights for policy 0, policy_version 17657 (0.0010) [2023-12-27 19:21:27,902][106226] Updated weights for policy 0, policy_version 17667 (0.0010) [2023-12-27 19:21:27,946][106226] Updated weights for policy 0, policy_version 17677 (0.0011) [2023-12-27 19:21:27,998][106226] Updated weights for policy 0, policy_version 17688 (0.0007) [2023-12-27 19:21:28,057][106225] Updated weights for policy 1, policy_version 17594 (0.0009) [2023-12-27 19:21:28,106][106225] Updated weights for policy 1, policy_version 17604 (0.0005) [2023-12-27 19:21:28,153][106225] Updated weights for policy 1, policy_version 17614 (0.0005) [2023-12-27 19:21:28,215][106225] Updated weights for policy 1, policy_version 17624 (0.0005) [2023-12-27 19:21:28,708][106226] Updated weights for policy 0, policy_version 17698 (0.0009) [2023-12-27 19:21:28,769][106226] Updated weights for policy 0, policy_version 17708 (0.0008) [2023-12-27 19:21:28,781][106225] Updated weights for policy 1, policy_version 17634 (0.0007) [2023-12-27 19:21:28,820][106226] Updated weights for policy 0, policy_version 17718 (0.0009) [2023-12-27 19:21:28,843][106225] Updated weights for policy 1, policy_version 17644 (0.0008) [2023-12-27 19:21:28,900][106225] Updated weights for policy 1, policy_version 17654 (0.0009) [2023-12-27 19:21:29,509][106226] Updated weights for policy 0, policy_version 17728 (0.0009) [2023-12-27 19:21:29,576][106226] Updated weights for policy 0, policy_version 17738 (0.0008) [2023-12-27 19:21:29,580][106225] Updated weights for policy 1, policy_version 17664 (0.0006) [2023-12-27 19:21:29,631][106225] Updated weights for policy 1, policy_version 17674 (0.0007) [2023-12-27 19:21:29,631][106226] Updated weights for policy 0, policy_version 17748 (0.0007) [2023-12-27 19:21:29,678][106225] Updated weights for policy 1, policy_version 17684 (0.0006) [2023-12-27 19:21:30,357][106225] Updated weights for policy 1, policy_version 17694 (0.0007) [2023-12-27 19:21:30,383][106226] Updated weights for policy 0, policy_version 17758 (0.0008) [2023-12-27 19:21:30,415][106225] Updated weights for policy 1, policy_version 17704 (0.0007) [2023-12-27 19:21:30,442][106226] Updated weights for policy 0, policy_version 17768 (0.0007) [2023-12-27 19:21:30,467][106225] Updated weights for policy 1, policy_version 17714 (0.0005) [2023-12-27 19:21:30,500][106226] Updated weights for policy 0, policy_version 17778 (0.0008) [2023-12-27 19:21:31,145][106225] Updated weights for policy 1, policy_version 17724 (0.0007) [2023-12-27 19:21:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 9093120. Throughput: 0: 10056.0, 1: 10064.1. Samples: 9086980. Policy #0 lag: (min: 3.0, avg: 8.0, max: 35.0) [2023-12-27 19:21:31,175][105115] Avg episode reward: [(0, '-5.488'), (1, '-6.698')] [2023-12-27 19:21:31,198][106226] Updated weights for policy 0, policy_version 17788 (0.0008) [2023-12-27 19:21:31,205][106225] Updated weights for policy 1, policy_version 17734 (0.0007) [2023-12-27 19:21:31,253][106226] Updated weights for policy 0, policy_version 17798 (0.0007) [2023-12-27 19:21:31,264][106225] Updated weights for policy 1, policy_version 17744 (0.0008) [2023-12-27 19:21:31,316][106226] Updated weights for policy 0, policy_version 17808 (0.0007) [2023-12-27 19:21:31,921][106225] Updated weights for policy 1, policy_version 17754 (0.0006) [2023-12-27 19:21:31,981][106225] Updated weights for policy 1, policy_version 17764 (0.0006) [2023-12-27 19:21:32,032][106225] Updated weights for policy 1, policy_version 17774 (0.0005) [2023-12-27 19:21:32,083][106225] Updated weights for policy 1, policy_version 17784 (0.0006) [2023-12-27 19:21:32,157][106226] Updated weights for policy 0, policy_version 17818 (0.0008) [2023-12-27 19:21:32,215][106226] Updated weights for policy 0, policy_version 17828 (0.0008) [2023-12-27 19:21:32,280][106226] Updated weights for policy 0, policy_version 17838 (0.0008) [2023-12-27 19:21:32,340][106226] Updated weights for policy 0, policy_version 17848 (0.0008) [2023-12-27 19:21:32,778][106225] Updated weights for policy 1, policy_version 17794 (0.0008) [2023-12-27 19:21:32,838][106225] Updated weights for policy 1, policy_version 17804 (0.0008) [2023-12-27 19:21:32,896][106225] Updated weights for policy 1, policy_version 17814 (0.0008) [2023-12-27 19:21:33,045][106226] Updated weights for policy 0, policy_version 17858 (0.0008) [2023-12-27 19:21:33,102][106226] Updated weights for policy 0, policy_version 17868 (0.0008) [2023-12-27 19:21:33,158][106226] Updated weights for policy 0, policy_version 17878 (0.0007) [2023-12-27 19:21:33,535][106225] Updated weights for policy 1, policy_version 17824 (0.0007) [2023-12-27 19:21:33,598][106225] Updated weights for policy 1, policy_version 17834 (0.0005) [2023-12-27 19:21:33,662][106225] Updated weights for policy 1, policy_version 17844 (0.0005) [2023-12-27 19:21:33,895][106226] Updated weights for policy 0, policy_version 17888 (0.0005) [2023-12-27 19:21:33,960][106226] Updated weights for policy 0, policy_version 17898 (0.0006) [2023-12-27 19:21:34,017][106226] Updated weights for policy 0, policy_version 17908 (0.0007) [2023-12-27 19:21:34,190][106225] Updated weights for policy 1, policy_version 17854 (0.0006) [2023-12-27 19:21:34,260][106225] Updated weights for policy 1, policy_version 17864 (0.0009) [2023-12-27 19:21:34,330][106225] Updated weights for policy 1, policy_version 17874 (0.0010) [2023-12-27 19:21:34,644][106226] Updated weights for policy 0, policy_version 17918 (0.0008) [2023-12-27 19:21:34,699][106226] Updated weights for policy 0, policy_version 17928 (0.0008) [2023-12-27 19:21:34,751][106226] Updated weights for policy 0, policy_version 17938 (0.0007) [2023-12-27 19:21:35,064][106225] Updated weights for policy 1, policy_version 17884 (0.0007) [2023-12-27 19:21:35,112][106225] Updated weights for policy 1, policy_version 17894 (0.0010) [2023-12-27 19:21:35,167][106225] Updated weights for policy 1, policy_version 17904 (0.0010) [2023-12-27 19:21:35,430][106226] Updated weights for policy 0, policy_version 17948 (0.0007) [2023-12-27 19:21:35,498][106226] Updated weights for policy 0, policy_version 17958 (0.0005) [2023-12-27 19:21:35,561][106226] Updated weights for policy 0, policy_version 17968 (0.0005) [2023-12-27 19:21:35,875][106225] Updated weights for policy 1, policy_version 17914 (0.0010) [2023-12-27 19:21:35,936][106225] Updated weights for policy 1, policy_version 17924 (0.0011) [2023-12-27 19:21:35,985][106225] Updated weights for policy 1, policy_version 17934 (0.0010) [2023-12-27 19:21:36,041][106225] Updated weights for policy 1, policy_version 17944 (0.0010) [2023-12-27 19:21:36,139][106226] Updated weights for policy 0, policy_version 17978 (0.0006) [2023-12-27 19:21:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 9199616. Throughput: 0: 10035.4, 1: 10091.4. Samples: 9208764. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-27 19:21:36,176][105115] Avg episode reward: [(0, '-4.990'), (1, '-6.926')] [2023-12-27 19:21:36,197][106226] Updated weights for policy 0, policy_version 17988 (0.0011) [2023-12-27 19:21:36,256][106226] Updated weights for policy 0, policy_version 17998 (0.0010) [2023-12-27 19:21:36,320][106140] Saving new best policy, reward=-4.990! [2023-12-27 19:21:36,322][106226] Updated weights for policy 0, policy_version 18008 (0.0009) [2023-12-27 19:21:36,798][106225] Updated weights for policy 1, policy_version 17954 (0.0010) [2023-12-27 19:21:36,884][106225] Updated weights for policy 1, policy_version 17964 (0.0010) [2023-12-27 19:21:36,945][106225] Updated weights for policy 1, policy_version 17974 (0.0011) [2023-12-27 19:21:37,066][106226] Updated weights for policy 0, policy_version 18018 (0.0011) [2023-12-27 19:21:37,124][106226] Updated weights for policy 0, policy_version 18028 (0.0011) [2023-12-27 19:21:37,190][106226] Updated weights for policy 0, policy_version 18038 (0.0011) [2023-12-27 19:21:37,639][106225] Updated weights for policy 1, policy_version 17984 (0.0010) [2023-12-27 19:21:37,704][106225] Updated weights for policy 1, policy_version 17994 (0.0010) [2023-12-27 19:21:37,770][106225] Updated weights for policy 1, policy_version 18004 (0.0010) [2023-12-27 19:21:37,909][106226] Updated weights for policy 0, policy_version 18048 (0.0011) [2023-12-27 19:21:37,959][106226] Updated weights for policy 0, policy_version 18058 (0.0010) [2023-12-27 19:21:38,019][106226] Updated weights for policy 0, policy_version 18068 (0.0010) [2023-12-27 19:21:38,467][106225] Updated weights for policy 1, policy_version 18014 (0.0010) [2023-12-27 19:21:38,528][106225] Updated weights for policy 1, policy_version 18024 (0.0010) [2023-12-27 19:21:38,588][106225] Updated weights for policy 1, policy_version 18034 (0.0010) [2023-12-27 19:21:38,722][106226] Updated weights for policy 0, policy_version 18078 (0.0009) [2023-12-27 19:21:38,781][106226] Updated weights for policy 0, policy_version 18088 (0.0007) [2023-12-27 19:21:38,841][106226] Updated weights for policy 0, policy_version 18098 (0.0006) [2023-12-27 19:21:39,311][106225] Updated weights for policy 1, policy_version 18044 (0.0010) [2023-12-27 19:21:39,380][106225] Updated weights for policy 1, policy_version 18054 (0.0009) [2023-12-27 19:21:39,443][106225] Updated weights for policy 1, policy_version 18064 (0.0008) [2023-12-27 19:21:39,611][106226] Updated weights for policy 0, policy_version 18108 (0.0009) [2023-12-27 19:21:39,672][106226] Updated weights for policy 0, policy_version 18118 (0.0011) [2023-12-27 19:21:39,730][106226] Updated weights for policy 0, policy_version 18128 (0.0010) [2023-12-27 19:21:40,228][106225] Updated weights for policy 1, policy_version 18074 (0.0008) [2023-12-27 19:21:40,277][106225] Updated weights for policy 1, policy_version 18084 (0.0009) [2023-12-27 19:21:40,335][106225] Updated weights for policy 1, policy_version 18094 (0.0009) [2023-12-27 19:21:40,368][106226] Updated weights for policy 0, policy_version 18138 (0.0010) [2023-12-27 19:21:40,391][106225] Updated weights for policy 1, policy_version 18104 (0.0008) [2023-12-27 19:21:40,438][106226] Updated weights for policy 0, policy_version 18148 (0.0007) [2023-12-27 19:21:40,498][106226] Updated weights for policy 0, policy_version 18158 (0.0009) [2023-12-27 19:21:40,556][106226] Updated weights for policy 0, policy_version 18168 (0.0009) [2023-12-27 19:21:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 9289728. Throughput: 0: 10039.7, 1: 10072.4. Samples: 9266372. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-27 19:21:41,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-6.946')] [2023-12-27 19:21:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000018104_4636672.pth... [2023-12-27 19:21:41,183][106226] Updated weights for policy 0, policy_version 18178 (0.0007) [2023-12-27 19:21:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000016952_4341760.pth [2023-12-27 19:21:41,249][106226] Updated weights for policy 0, policy_version 18188 (0.0008) [2023-12-27 19:21:41,294][106225] Updated weights for policy 1, policy_version 18114 (0.0007) [2023-12-27 19:21:41,308][106226] Updated weights for policy 0, policy_version 18198 (0.0007) [2023-12-27 19:21:41,322][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000018200_4661248.pth... [2023-12-27 19:21:41,330][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000017016_4358144.pth [2023-12-27 19:21:41,331][106140] Saving new best policy, reward=-4.987! [2023-12-27 19:21:41,362][106225] Updated weights for policy 1, policy_version 18124 (0.0008) [2023-12-27 19:21:41,426][106225] Updated weights for policy 1, policy_version 18134 (0.0008) [2023-12-27 19:21:42,079][106226] Updated weights for policy 0, policy_version 18208 (0.0007) [2023-12-27 19:21:42,135][106226] Updated weights for policy 0, policy_version 18218 (0.0005) [2023-12-27 19:21:42,199][106226] Updated weights for policy 0, policy_version 18228 (0.0007) [2023-12-27 19:21:42,202][106225] Updated weights for policy 1, policy_version 18144 (0.0006) [2023-12-27 19:21:42,264][106225] Updated weights for policy 1, policy_version 18154 (0.0006) [2023-12-27 19:21:42,328][106225] Updated weights for policy 1, policy_version 18164 (0.0006) [2023-12-27 19:21:42,830][106226] Updated weights for policy 0, policy_version 18238 (0.0006) [2023-12-27 19:21:42,889][106226] Updated weights for policy 0, policy_version 18248 (0.0008) [2023-12-27 19:21:42,897][106225] Updated weights for policy 1, policy_version 18174 (0.0010) [2023-12-27 19:21:42,939][106226] Updated weights for policy 0, policy_version 18258 (0.0010) [2023-12-27 19:21:42,956][106225] Updated weights for policy 1, policy_version 18184 (0.0008) [2023-12-27 19:21:43,012][106225] Updated weights for policy 1, policy_version 18194 (0.0005) [2023-12-27 19:21:43,595][106226] Updated weights for policy 0, policy_version 18268 (0.0010) [2023-12-27 19:21:43,622][106225] Updated weights for policy 1, policy_version 18204 (0.0005) [2023-12-27 19:21:43,651][106226] Updated weights for policy 0, policy_version 18278 (0.0010) [2023-12-27 19:21:43,690][106225] Updated weights for policy 1, policy_version 18214 (0.0007) [2023-12-27 19:21:43,698][106226] Updated weights for policy 0, policy_version 18288 (0.0005) [2023-12-27 19:21:43,758][106225] Updated weights for policy 1, policy_version 18224 (0.0011) [2023-12-27 19:21:44,356][106226] Updated weights for policy 0, policy_version 18298 (0.0010) [2023-12-27 19:21:44,385][106225] Updated weights for policy 1, policy_version 18234 (0.0009) [2023-12-27 19:21:44,419][106226] Updated weights for policy 0, policy_version 18308 (0.0010) [2023-12-27 19:21:44,448][106225] Updated weights for policy 1, policy_version 18244 (0.0006) [2023-12-27 19:21:44,476][106226] Updated weights for policy 0, policy_version 18318 (0.0009) [2023-12-27 19:21:44,508][106225] Updated weights for policy 1, policy_version 18254 (0.0005) [2023-12-27 19:21:44,541][106226] Updated weights for policy 0, policy_version 18328 (0.0010) [2023-12-27 19:21:44,569][106225] Updated weights for policy 1, policy_version 18264 (0.0005) [2023-12-27 19:21:45,137][106225] Updated weights for policy 1, policy_version 18274 (0.0007) [2023-12-27 19:21:45,205][106225] Updated weights for policy 1, policy_version 18284 (0.0011) [2023-12-27 19:21:45,259][106226] Updated weights for policy 0, policy_version 18338 (0.0011) [2023-12-27 19:21:45,272][106225] Updated weights for policy 1, policy_version 18294 (0.0011) [2023-12-27 19:21:45,321][106226] Updated weights for policy 0, policy_version 18348 (0.0011) [2023-12-27 19:21:45,379][106226] Updated weights for policy 0, policy_version 18358 (0.0011) [2023-12-27 19:21:45,958][106225] Updated weights for policy 1, policy_version 18304 (0.0010) [2023-12-27 19:21:46,015][106225] Updated weights for policy 1, policy_version 18314 (0.0010) [2023-12-27 19:21:46,066][106226] Updated weights for policy 0, policy_version 18368 (0.0006) [2023-12-27 19:21:46,076][106225] Updated weights for policy 1, policy_version 18324 (0.0009) [2023-12-27 19:21:46,126][106226] Updated weights for policy 0, policy_version 18378 (0.0007) [2023-12-27 19:21:46,174][106226] Updated weights for policy 0, policy_version 18388 (0.0010) [2023-12-27 19:21:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 9396224. Throughput: 0: 10051.4, 1: 10052.4. Samples: 9386596. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-27 19:21:46,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-6.432')] [2023-12-27 19:21:46,176][106141] Saving new best policy, reward=-6.432! [2023-12-27 19:21:46,818][106225] Updated weights for policy 1, policy_version 18334 (0.0008) [2023-12-27 19:21:46,847][106226] Updated weights for policy 0, policy_version 18398 (0.0010) [2023-12-27 19:21:46,875][106225] Updated weights for policy 1, policy_version 18344 (0.0006) [2023-12-27 19:21:46,906][106226] Updated weights for policy 0, policy_version 18408 (0.0010) [2023-12-27 19:21:46,935][106225] Updated weights for policy 1, policy_version 18354 (0.0007) [2023-12-27 19:21:46,959][106226] Updated weights for policy 0, policy_version 18418 (0.0010) [2023-12-27 19:21:47,580][106225] Updated weights for policy 1, policy_version 18364 (0.0009) [2023-12-27 19:21:47,640][106225] Updated weights for policy 1, policy_version 18374 (0.0008) [2023-12-27 19:21:47,662][106226] Updated weights for policy 0, policy_version 18428 (0.0010) [2023-12-27 19:21:47,693][106225] Updated weights for policy 1, policy_version 18384 (0.0007) [2023-12-27 19:21:47,723][106226] Updated weights for policy 0, policy_version 18438 (0.0009) [2023-12-27 19:21:47,782][106226] Updated weights for policy 0, policy_version 18448 (0.0010) [2023-12-27 19:21:48,454][106225] Updated weights for policy 1, policy_version 18394 (0.0007) [2023-12-27 19:21:48,490][106226] Updated weights for policy 0, policy_version 18458 (0.0011) [2023-12-27 19:21:48,511][106225] Updated weights for policy 1, policy_version 18404 (0.0007) [2023-12-27 19:21:48,552][106226] Updated weights for policy 0, policy_version 18468 (0.0011) [2023-12-27 19:21:48,571][106225] Updated weights for policy 1, policy_version 18414 (0.0007) [2023-12-27 19:21:48,609][106226] Updated weights for policy 0, policy_version 18478 (0.0011) [2023-12-27 19:21:48,619][106225] Updated weights for policy 1, policy_version 18424 (0.0007) [2023-12-27 19:21:48,678][106226] Updated weights for policy 0, policy_version 18488 (0.0010) [2023-12-27 19:21:49,398][106226] Updated weights for policy 0, policy_version 18498 (0.0010) [2023-12-27 19:21:49,434][106225] Updated weights for policy 1, policy_version 18434 (0.0008) [2023-12-27 19:21:49,470][106226] Updated weights for policy 0, policy_version 18508 (0.0010) [2023-12-27 19:21:49,495][106225] Updated weights for policy 1, policy_version 18444 (0.0005) [2023-12-27 19:21:49,534][106226] Updated weights for policy 0, policy_version 18518 (0.0010) [2023-12-27 19:21:49,557][106225] Updated weights for policy 1, policy_version 18454 (0.0006) [2023-12-27 19:21:50,210][106225] Updated weights for policy 1, policy_version 18464 (0.0010) [2023-12-27 19:21:50,217][106226] Updated weights for policy 0, policy_version 18528 (0.0011) [2023-12-27 19:21:50,270][106225] Updated weights for policy 1, policy_version 18474 (0.0010) [2023-12-27 19:21:50,274][106226] Updated weights for policy 0, policy_version 18538 (0.0010) [2023-12-27 19:21:50,332][106225] Updated weights for policy 1, policy_version 18484 (0.0011) [2023-12-27 19:21:50,338][106226] Updated weights for policy 0, policy_version 18548 (0.0011) [2023-12-27 19:21:50,962][106226] Updated weights for policy 0, policy_version 18558 (0.0010) [2023-12-27 19:21:50,979][106225] Updated weights for policy 1, policy_version 18494 (0.0010) [2023-12-27 19:21:51,016][106226] Updated weights for policy 0, policy_version 18568 (0.0010) [2023-12-27 19:21:51,039][106225] Updated weights for policy 1, policy_version 18504 (0.0012) [2023-12-27 19:21:51,086][106226] Updated weights for policy 0, policy_version 18578 (0.0007) [2023-12-27 19:21:51,103][106225] Updated weights for policy 1, policy_version 18514 (0.0010) [2023-12-27 19:21:51,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 9502720. Throughput: 0: 10011.1, 1: 10036.0. Samples: 9504680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:21:51,175][105115] Avg episode reward: [(0, '-5.524'), (1, '-6.837')] [2023-12-27 19:21:51,810][106226] Updated weights for policy 0, policy_version 18588 (0.0008) [2023-12-27 19:21:51,849][106225] Updated weights for policy 1, policy_version 18524 (0.0010) [2023-12-27 19:21:51,875][106226] Updated weights for policy 0, policy_version 18598 (0.0006) [2023-12-27 19:21:51,906][106225] Updated weights for policy 1, policy_version 18534 (0.0010) [2023-12-27 19:21:51,938][106226] Updated weights for policy 0, policy_version 18608 (0.0006) [2023-12-27 19:21:51,966][106225] Updated weights for policy 1, policy_version 18544 (0.0009) [2023-12-27 19:21:52,546][106226] Updated weights for policy 0, policy_version 18618 (0.0006) [2023-12-27 19:21:52,607][106226] Updated weights for policy 0, policy_version 18628 (0.0008) [2023-12-27 19:21:52,620][106225] Updated weights for policy 1, policy_version 18554 (0.0008) [2023-12-27 19:21:52,662][106226] Updated weights for policy 0, policy_version 18638 (0.0006) [2023-12-27 19:21:52,681][106225] Updated weights for policy 1, policy_version 18564 (0.0010) [2023-12-27 19:21:52,721][106226] Updated weights for policy 0, policy_version 18648 (0.0007) [2023-12-27 19:21:52,748][106225] Updated weights for policy 1, policy_version 18574 (0.0007) [2023-12-27 19:21:52,805][106225] Updated weights for policy 1, policy_version 18584 (0.0010) [2023-12-27 19:21:53,469][106226] Updated weights for policy 0, policy_version 18658 (0.0009) [2023-12-27 19:21:53,497][106225] Updated weights for policy 1, policy_version 18594 (0.0010) [2023-12-27 19:21:53,523][106226] Updated weights for policy 0, policy_version 18668 (0.0007) [2023-12-27 19:21:53,555][106225] Updated weights for policy 1, policy_version 18604 (0.0010) [2023-12-27 19:21:53,573][106226] Updated weights for policy 0, policy_version 18678 (0.0006) [2023-12-27 19:21:53,608][106225] Updated weights for policy 1, policy_version 18614 (0.0010) [2023-12-27 19:21:54,317][106225] Updated weights for policy 1, policy_version 18624 (0.0010) [2023-12-27 19:21:54,319][106226] Updated weights for policy 0, policy_version 18688 (0.0006) [2023-12-27 19:21:54,370][106225] Updated weights for policy 1, policy_version 18634 (0.0010) [2023-12-27 19:21:54,372][106226] Updated weights for policy 0, policy_version 18698 (0.0006) [2023-12-27 19:21:54,423][106226] Updated weights for policy 0, policy_version 18708 (0.0008) [2023-12-27 19:21:54,430][106225] Updated weights for policy 1, policy_version 18644 (0.0010) [2023-12-27 19:21:55,143][106225] Updated weights for policy 1, policy_version 18654 (0.0010) [2023-12-27 19:21:55,171][106226] Updated weights for policy 0, policy_version 18718 (0.0006) [2023-12-27 19:21:55,204][106225] Updated weights for policy 1, policy_version 18664 (0.0010) [2023-12-27 19:21:55,233][106226] Updated weights for policy 0, policy_version 18728 (0.0006) [2023-12-27 19:21:55,259][106225] Updated weights for policy 1, policy_version 18674 (0.0010) [2023-12-27 19:21:55,288][106226] Updated weights for policy 0, policy_version 18738 (0.0006) [2023-12-27 19:21:55,830][106225] Updated weights for policy 1, policy_version 18684 (0.0010) [2023-12-27 19:21:55,884][106225] Updated weights for policy 1, policy_version 18694 (0.0010) [2023-12-27 19:21:55,952][106225] Updated weights for policy 1, policy_version 18704 (0.0010) [2023-12-27 19:21:56,009][106226] Updated weights for policy 0, policy_version 18748 (0.0007) [2023-12-27 19:21:56,065][106226] Updated weights for policy 0, policy_version 18758 (0.0006) [2023-12-27 19:21:56,129][106226] Updated weights for policy 0, policy_version 18768 (0.0006) [2023-12-27 19:21:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 9592832. Throughput: 0: 9974.4, 1: 10029.0. Samples: 9563712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:21:56,175][105115] Avg episode reward: [(0, '-5.552'), (1, '-7.022')] [2023-12-27 19:21:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000018712_4792320.pth... [2023-12-27 19:21:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000018776_4808704.pth... [2023-12-27 19:21:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000017528_4489216.pth [2023-12-27 19:21:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000017592_4505600.pth [2023-12-27 19:21:56,608][106225] Updated weights for policy 1, policy_version 18714 (0.0009) [2023-12-27 19:21:56,652][106225] Updated weights for policy 1, policy_version 18724 (0.0005) [2023-12-27 19:21:56,706][106225] Updated weights for policy 1, policy_version 18734 (0.0005) [2023-12-27 19:21:56,768][106225] Updated weights for policy 1, policy_version 18744 (0.0005) [2023-12-27 19:21:56,847][106226] Updated weights for policy 0, policy_version 18778 (0.0008) [2023-12-27 19:21:56,919][106226] Updated weights for policy 0, policy_version 18788 (0.0006) [2023-12-27 19:21:56,970][106226] Updated weights for policy 0, policy_version 18798 (0.0006) [2023-12-27 19:21:57,023][106226] Updated weights for policy 0, policy_version 18808 (0.0005) [2023-12-27 19:21:57,372][106225] Updated weights for policy 1, policy_version 18754 (0.0007) [2023-12-27 19:21:57,426][106225] Updated weights for policy 1, policy_version 18764 (0.0010) [2023-12-27 19:21:57,477][106225] Updated weights for policy 1, policy_version 18774 (0.0010) [2023-12-27 19:21:57,538][106226] Updated weights for policy 0, policy_version 18818 (0.0007) [2023-12-27 19:21:57,586][106226] Updated weights for policy 0, policy_version 18828 (0.0010) [2023-12-27 19:21:57,632][106226] Updated weights for policy 0, policy_version 18838 (0.0005) [2023-12-27 19:21:58,062][106225] Updated weights for policy 1, policy_version 18784 (0.0010) [2023-12-27 19:21:58,111][106225] Updated weights for policy 1, policy_version 18794 (0.0010) [2023-12-27 19:21:58,163][106225] Updated weights for policy 1, policy_version 18804 (0.0010) [2023-12-27 19:21:58,218][106226] Updated weights for policy 0, policy_version 18848 (0.0009) [2023-12-27 19:21:58,285][106226] Updated weights for policy 0, policy_version 18858 (0.0009) [2023-12-27 19:21:58,352][106226] Updated weights for policy 0, policy_version 18868 (0.0009) [2023-12-27 19:21:58,993][106225] Updated weights for policy 1, policy_version 18814 (0.0009) [2023-12-27 19:21:59,060][106225] Updated weights for policy 1, policy_version 18824 (0.0010) [2023-12-27 19:21:59,119][106225] Updated weights for policy 1, policy_version 18834 (0.0009) [2023-12-27 19:21:59,148][106226] Updated weights for policy 0, policy_version 18878 (0.0009) [2023-12-27 19:21:59,205][106226] Updated weights for policy 0, policy_version 18888 (0.0008) [2023-12-27 19:21:59,274][106226] Updated weights for policy 0, policy_version 18898 (0.0009) [2023-12-27 19:21:59,825][106225] Updated weights for policy 1, policy_version 18844 (0.0007) [2023-12-27 19:21:59,888][106225] Updated weights for policy 1, policy_version 18854 (0.0009) [2023-12-27 19:21:59,940][106225] Updated weights for policy 1, policy_version 18864 (0.0008) [2023-12-27 19:21:59,983][106226] Updated weights for policy 0, policy_version 18908 (0.0006) [2023-12-27 19:22:00,041][106226] Updated weights for policy 0, policy_version 18918 (0.0010) [2023-12-27 19:22:00,094][106226] Updated weights for policy 0, policy_version 18928 (0.0009) [2023-12-27 19:22:00,603][106225] Updated weights for policy 1, policy_version 18874 (0.0008) [2023-12-27 19:22:00,663][106225] Updated weights for policy 1, policy_version 18884 (0.0007) [2023-12-27 19:22:00,725][106225] Updated weights for policy 1, policy_version 18894 (0.0007) [2023-12-27 19:22:00,787][106225] Updated weights for policy 1, policy_version 18904 (0.0007) [2023-12-27 19:22:00,789][106226] Updated weights for policy 0, policy_version 18938 (0.0009) [2023-12-27 19:22:00,833][106226] Updated weights for policy 0, policy_version 18948 (0.0007) [2023-12-27 19:22:00,887][106226] Updated weights for policy 0, policy_version 18958 (0.0005) [2023-12-27 19:22:00,941][106226] Updated weights for policy 0, policy_version 18968 (0.0005) [2023-12-27 19:22:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20207.0, 300 sec: 19910.7). Total num frames: 9699328. Throughput: 0: 10024.2, 1: 10139.1. Samples: 9686220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:22:01,175][105115] Avg episode reward: [(0, '-5.442'), (1, '-6.859')] [2023-12-27 19:22:01,517][106225] Updated weights for policy 1, policy_version 18914 (0.0008) [2023-12-27 19:22:01,579][106225] Updated weights for policy 1, policy_version 18924 (0.0006) [2023-12-27 19:22:01,623][106226] Updated weights for policy 0, policy_version 18978 (0.0007) [2023-12-27 19:22:01,644][106225] Updated weights for policy 1, policy_version 18934 (0.0007) [2023-12-27 19:22:01,684][106226] Updated weights for policy 0, policy_version 18988 (0.0010) [2023-12-27 19:22:01,747][106226] Updated weights for policy 0, policy_version 18998 (0.0009) [2023-12-27 19:22:02,333][106225] Updated weights for policy 1, policy_version 18944 (0.0008) [2023-12-27 19:22:02,400][106225] Updated weights for policy 1, policy_version 18954 (0.0008) [2023-12-27 19:22:02,453][106225] Updated weights for policy 1, policy_version 18964 (0.0007) [2023-12-27 19:22:02,496][106226] Updated weights for policy 0, policy_version 19008 (0.0008) [2023-12-27 19:22:02,555][106226] Updated weights for policy 0, policy_version 19018 (0.0008) [2023-12-27 19:22:02,613][106226] Updated weights for policy 0, policy_version 19028 (0.0008) [2023-12-27 19:22:03,191][106226] Updated weights for policy 0, policy_version 19038 (0.0006) [2023-12-27 19:22:03,212][106225] Updated weights for policy 1, policy_version 18974 (0.0005) [2023-12-27 19:22:03,241][106226] Updated weights for policy 0, policy_version 19048 (0.0005) [2023-12-27 19:22:03,266][106225] Updated weights for policy 1, policy_version 18984 (0.0006) [2023-12-27 19:22:03,304][106226] Updated weights for policy 0, policy_version 19058 (0.0007) [2023-12-27 19:22:03,317][106225] Updated weights for policy 1, policy_version 18994 (0.0007) [2023-12-27 19:22:03,933][106226] Updated weights for policy 0, policy_version 19068 (0.0006) [2023-12-27 19:22:04,003][106226] Updated weights for policy 0, policy_version 19078 (0.0007) [2023-12-27 19:22:04,022][106225] Updated weights for policy 1, policy_version 19004 (0.0008) [2023-12-27 19:22:04,062][106226] Updated weights for policy 0, policy_version 19088 (0.0006) [2023-12-27 19:22:04,086][106225] Updated weights for policy 1, policy_version 19014 (0.0010) [2023-12-27 19:22:04,150][106225] Updated weights for policy 1, policy_version 19024 (0.0010) [2023-12-27 19:22:04,798][106226] Updated weights for policy 0, policy_version 19098 (0.0006) [2023-12-27 19:22:04,824][106225] Updated weights for policy 1, policy_version 19034 (0.0010) [2023-12-27 19:22:04,846][106226] Updated weights for policy 0, policy_version 19108 (0.0006) [2023-12-27 19:22:04,879][106225] Updated weights for policy 1, policy_version 19044 (0.0010) [2023-12-27 19:22:04,892][106226] Updated weights for policy 0, policy_version 19118 (0.0006) [2023-12-27 19:22:04,939][106226] Updated weights for policy 0, policy_version 19128 (0.0006) [2023-12-27 19:22:04,939][106225] Updated weights for policy 1, policy_version 19054 (0.0010) [2023-12-27 19:22:04,992][106225] Updated weights for policy 1, policy_version 19064 (0.0010) [2023-12-27 19:22:05,676][106226] Updated weights for policy 0, policy_version 19138 (0.0005) [2023-12-27 19:22:05,710][106225] Updated weights for policy 1, policy_version 19074 (0.0010) [2023-12-27 19:22:05,721][106226] Updated weights for policy 0, policy_version 19148 (0.0005) [2023-12-27 19:22:05,763][106225] Updated weights for policy 1, policy_version 19084 (0.0010) [2023-12-27 19:22:05,781][106226] Updated weights for policy 0, policy_version 19158 (0.0005) [2023-12-27 19:22:05,813][106225] Updated weights for policy 1, policy_version 19094 (0.0010) [2023-12-27 19:22:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 9797632. Throughput: 0: 10084.5, 1: 10079.4. Samples: 9805944. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 19:22:06,175][105115] Avg episode reward: [(0, '-5.597'), (1, '-6.257')] [2023-12-27 19:22:06,176][106141] Saving new best policy, reward=-6.257! [2023-12-27 19:22:06,494][106225] Updated weights for policy 1, policy_version 19104 (0.0008) [2023-12-27 19:22:06,511][106226] Updated weights for policy 0, policy_version 19168 (0.0009) [2023-12-27 19:22:06,555][106225] Updated weights for policy 1, policy_version 19114 (0.0006) [2023-12-27 19:22:06,576][106226] Updated weights for policy 0, policy_version 19178 (0.0011) [2023-12-27 19:22:06,612][106225] Updated weights for policy 1, policy_version 19124 (0.0007) [2023-12-27 19:22:06,637][106226] Updated weights for policy 0, policy_version 19188 (0.0011) [2023-12-27 19:22:07,249][106226] Updated weights for policy 0, policy_version 19198 (0.0008) [2023-12-27 19:22:07,286][106225] Updated weights for policy 1, policy_version 19134 (0.0007) [2023-12-27 19:22:07,315][106226] Updated weights for policy 0, policy_version 19208 (0.0005) [2023-12-27 19:22:07,334][106225] Updated weights for policy 1, policy_version 19144 (0.0009) [2023-12-27 19:22:07,379][106226] Updated weights for policy 0, policy_version 19218 (0.0007) [2023-12-27 19:22:07,394][106225] Updated weights for policy 1, policy_version 19154 (0.0007) [2023-12-27 19:22:08,022][106226] Updated weights for policy 0, policy_version 19228 (0.0007) [2023-12-27 19:22:08,057][106225] Updated weights for policy 1, policy_version 19164 (0.0006) [2023-12-27 19:22:08,078][106226] Updated weights for policy 0, policy_version 19238 (0.0005) [2023-12-27 19:22:08,115][106225] Updated weights for policy 1, policy_version 19174 (0.0008) [2023-12-27 19:22:08,144][106226] Updated weights for policy 0, policy_version 19248 (0.0006) [2023-12-27 19:22:08,173][106225] Updated weights for policy 1, policy_version 19184 (0.0008) [2023-12-27 19:22:08,869][106226] Updated weights for policy 0, policy_version 19258 (0.0005) [2023-12-27 19:22:08,873][106225] Updated weights for policy 1, policy_version 19194 (0.0010) [2023-12-27 19:22:08,926][106226] Updated weights for policy 0, policy_version 19268 (0.0007) [2023-12-27 19:22:08,928][106225] Updated weights for policy 1, policy_version 19204 (0.0008) [2023-12-27 19:22:08,989][106226] Updated weights for policy 0, policy_version 19278 (0.0008) [2023-12-27 19:22:08,991][106225] Updated weights for policy 1, policy_version 19214 (0.0007) [2023-12-27 19:22:09,046][106225] Updated weights for policy 1, policy_version 19224 (0.0005) [2023-12-27 19:22:09,046][106226] Updated weights for policy 0, policy_version 19288 (0.0008) [2023-12-27 19:22:09,716][106225] Updated weights for policy 1, policy_version 19234 (0.0010) [2023-12-27 19:22:09,781][106225] Updated weights for policy 1, policy_version 19244 (0.0010) [2023-12-27 19:22:09,849][106225] Updated weights for policy 1, policy_version 19254 (0.0010) [2023-12-27 19:22:09,880][106226] Updated weights for policy 0, policy_version 19298 (0.0008) [2023-12-27 19:22:09,941][106226] Updated weights for policy 0, policy_version 19308 (0.0007) [2023-12-27 19:22:10,009][106226] Updated weights for policy 0, policy_version 19318 (0.0007) [2023-12-27 19:22:10,617][106225] Updated weights for policy 1, policy_version 19264 (0.0010) [2023-12-27 19:22:10,631][106226] Updated weights for policy 0, policy_version 19328 (0.0007) [2023-12-27 19:22:10,682][106225] Updated weights for policy 1, policy_version 19274 (0.0011) [2023-12-27 19:22:10,691][106226] Updated weights for policy 0, policy_version 19338 (0.0006) [2023-12-27 19:22:10,752][106225] Updated weights for policy 1, policy_version 19284 (0.0010) [2023-12-27 19:22:10,762][106226] Updated weights for policy 0, policy_version 19348 (0.0011) [2023-12-27 19:22:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 9895936. Throughput: 0: 10077.7, 1: 10101.2. Samples: 9866996. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 19:22:11,175][105115] Avg episode reward: [(0, '-5.984'), (1, '-7.081')] [2023-12-27 19:22:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000019288_4939776.pth... [2023-12-27 19:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000019352_4956160.pth... [2023-12-27 19:22:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000018104_4636672.pth [2023-12-27 19:22:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000018200_4661248.pth [2023-12-27 19:22:11,466][106225] Updated weights for policy 1, policy_version 19294 (0.0008) [2023-12-27 19:22:11,526][106225] Updated weights for policy 1, policy_version 19304 (0.0007) [2023-12-27 19:22:11,527][106226] Updated weights for policy 0, policy_version 19358 (0.0007) [2023-12-27 19:22:11,589][106226] Updated weights for policy 0, policy_version 19368 (0.0007) [2023-12-27 19:22:11,591][106225] Updated weights for policy 1, policy_version 19314 (0.0006) [2023-12-27 19:22:11,660][106226] Updated weights for policy 0, policy_version 19378 (0.0008) [2023-12-27 19:22:12,412][106225] Updated weights for policy 1, policy_version 19324 (0.0008) [2023-12-27 19:22:12,438][106226] Updated weights for policy 0, policy_version 19388 (0.0007) [2023-12-27 19:22:12,467][106225] Updated weights for policy 1, policy_version 19334 (0.0008) [2023-12-27 19:22:12,500][106226] Updated weights for policy 0, policy_version 19398 (0.0007) [2023-12-27 19:22:12,519][106225] Updated weights for policy 1, policy_version 19344 (0.0007) [2023-12-27 19:22:12,571][106226] Updated weights for policy 0, policy_version 19408 (0.0006) [2023-12-27 19:22:13,219][106225] Updated weights for policy 1, policy_version 19354 (0.0007) [2023-12-27 19:22:13,271][106226] Updated weights for policy 0, policy_version 19418 (0.0007) [2023-12-27 19:22:13,273][106225] Updated weights for policy 1, policy_version 19364 (0.0008) [2023-12-27 19:22:13,319][106226] Updated weights for policy 0, policy_version 19428 (0.0006) [2023-12-27 19:22:13,321][106225] Updated weights for policy 1, policy_version 19374 (0.0006) [2023-12-27 19:22:13,371][106225] Updated weights for policy 1, policy_version 19384 (0.0006) [2023-12-27 19:22:13,373][106226] Updated weights for policy 0, policy_version 19438 (0.0006) [2023-12-27 19:22:13,421][106226] Updated weights for policy 0, policy_version 19448 (0.0008) [2023-12-27 19:22:14,052][106226] Updated weights for policy 0, policy_version 19458 (0.0005) [2023-12-27 19:22:14,114][106226] Updated weights for policy 0, policy_version 19468 (0.0005) [2023-12-27 19:22:14,170][106226] Updated weights for policy 0, policy_version 19478 (0.0005) [2023-12-27 19:22:14,182][106225] Updated weights for policy 1, policy_version 19394 (0.0008) [2023-12-27 19:22:14,257][106225] Updated weights for policy 1, policy_version 19404 (0.0010) [2023-12-27 19:22:14,310][106225] Updated weights for policy 1, policy_version 19414 (0.0008) [2023-12-27 19:22:14,708][106226] Updated weights for policy 0, policy_version 19488 (0.0008) [2023-12-27 19:22:14,759][106226] Updated weights for policy 0, policy_version 19498 (0.0009) [2023-12-27 19:22:14,821][106226] Updated weights for policy 0, policy_version 19508 (0.0007) [2023-12-27 19:22:14,976][106225] Updated weights for policy 1, policy_version 19424 (0.0008) [2023-12-27 19:22:15,041][106225] Updated weights for policy 1, policy_version 19434 (0.0009) [2023-12-27 19:22:15,101][106225] Updated weights for policy 1, policy_version 19444 (0.0009) [2023-12-27 19:22:15,601][106226] Updated weights for policy 0, policy_version 19518 (0.0009) [2023-12-27 19:22:15,661][106226] Updated weights for policy 0, policy_version 19528 (0.0008) [2023-12-27 19:22:15,725][106226] Updated weights for policy 0, policy_version 19538 (0.0008) [2023-12-27 19:22:15,842][106225] Updated weights for policy 1, policy_version 19454 (0.0008) [2023-12-27 19:22:15,906][106225] Updated weights for policy 1, policy_version 19464 (0.0008) [2023-12-27 19:22:15,967][106225] Updated weights for policy 1, policy_version 19474 (0.0008) [2023-12-27 19:22:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 9994240. Throughput: 0: 9988.0, 1: 9914.0. Samples: 9982572. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 19:22:16,175][105115] Avg episode reward: [(0, '-5.297'), (1, '-7.214')] [2023-12-27 19:22:16,401][106226] Updated weights for policy 0, policy_version 19548 (0.0008) [2023-12-27 19:22:16,452][106226] Updated weights for policy 0, policy_version 19558 (0.0008) [2023-12-27 19:22:16,512][106226] Updated weights for policy 0, policy_version 19568 (0.0010) [2023-12-27 19:22:16,694][106225] Updated weights for policy 1, policy_version 19484 (0.0007) [2023-12-27 19:22:16,751][106225] Updated weights for policy 1, policy_version 19494 (0.0010) [2023-12-27 19:22:16,815][106225] Updated weights for policy 1, policy_version 19504 (0.0008) [2023-12-27 19:22:17,147][106226] Updated weights for policy 0, policy_version 19578 (0.0009) [2023-12-27 19:22:17,195][106226] Updated weights for policy 0, policy_version 19588 (0.0005) [2023-12-27 19:22:17,249][106226] Updated weights for policy 0, policy_version 19598 (0.0005) [2023-12-27 19:22:17,304][106226] Updated weights for policy 0, policy_version 19608 (0.0005) [2023-12-27 19:22:17,596][106225] Updated weights for policy 1, policy_version 19514 (0.0008) [2023-12-27 19:22:17,658][106225] Updated weights for policy 1, policy_version 19524 (0.0009) [2023-12-27 19:22:17,711][106225] Updated weights for policy 1, policy_version 19534 (0.0008) [2023-12-27 19:22:17,882][106226] Updated weights for policy 0, policy_version 19618 (0.0005) [2023-12-27 19:22:17,946][106226] Updated weights for policy 0, policy_version 19628 (0.0005) [2023-12-27 19:22:18,011][106226] Updated weights for policy 0, policy_version 19638 (0.0006) [2023-12-27 19:22:18,499][106225] Updated weights for policy 1, policy_version 19545 (0.0009) [2023-12-27 19:22:18,551][106225] Updated weights for policy 1, policy_version 19555 (0.0008) [2023-12-27 19:22:18,617][106225] Updated weights for policy 1, policy_version 19565 (0.0007) [2023-12-27 19:22:18,646][106226] Updated weights for policy 0, policy_version 19648 (0.0008) [2023-12-27 19:22:18,673][106225] Updated weights for policy 1, policy_version 19575 (0.0006) [2023-12-27 19:22:18,703][106226] Updated weights for policy 0, policy_version 19658 (0.0007) [2023-12-27 19:22:18,766][106226] Updated weights for policy 0, policy_version 19668 (0.0009) [2023-12-27 19:22:19,291][106225] Updated weights for policy 1, policy_version 19585 (0.0008) [2023-12-27 19:22:19,350][106225] Updated weights for policy 1, policy_version 19595 (0.0008) [2023-12-27 19:22:19,420][106225] Updated weights for policy 1, policy_version 19605 (0.0009) [2023-12-27 19:22:19,554][106226] Updated weights for policy 0, policy_version 19678 (0.0009) [2023-12-27 19:22:19,624][106226] Updated weights for policy 0, policy_version 19688 (0.0009) [2023-12-27 19:22:19,683][106226] Updated weights for policy 0, policy_version 19698 (0.0009) [2023-12-27 19:22:20,224][106225] Updated weights for policy 1, policy_version 19615 (0.0008) [2023-12-27 19:22:20,284][106225] Updated weights for policy 1, policy_version 19625 (0.0008) [2023-12-27 19:22:20,341][106225] Updated weights for policy 1, policy_version 19635 (0.0009) [2023-12-27 19:22:20,454][106226] Updated weights for policy 0, policy_version 19708 (0.0009) [2023-12-27 19:22:20,519][106226] Updated weights for policy 0, policy_version 19718 (0.0007) [2023-12-27 19:22:20,584][106226] Updated weights for policy 0, policy_version 19728 (0.0006) [2023-12-27 19:22:21,054][106225] Updated weights for policy 1, policy_version 19645 (0.0007) [2023-12-27 19:22:21,117][106225] Updated weights for policy 1, policy_version 19655 (0.0009) [2023-12-27 19:22:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 10084352. Throughput: 0: 9982.9, 1: 9800.9. Samples: 10099032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:22:21,175][105115] Avg episode reward: [(0, '-5.674'), (1, '-6.869')] [2023-12-27 19:22:21,181][106225] Updated weights for policy 1, policy_version 19665 (0.0008) [2023-12-27 19:22:21,330][106226] Updated weights for policy 0, policy_version 19738 (0.0008) [2023-12-27 19:22:21,403][106226] Updated weights for policy 0, policy_version 19748 (0.0009) [2023-12-27 19:22:21,467][106226] Updated weights for policy 0, policy_version 19758 (0.0009) [2023-12-27 19:22:21,523][106226] Updated weights for policy 0, policy_version 19768 (0.0009) [2023-12-27 19:22:21,910][106225] Updated weights for policy 1, policy_version 19675 (0.0008) [2023-12-27 19:22:21,968][106225] Updated weights for policy 1, policy_version 19685 (0.0008) [2023-12-27 19:22:22,034][106225] Updated weights for policy 1, policy_version 19695 (0.0006) [2023-12-27 19:22:22,259][106226] Updated weights for policy 0, policy_version 19778 (0.0008) [2023-12-27 19:22:22,328][106226] Updated weights for policy 0, policy_version 19788 (0.0009) [2023-12-27 19:22:22,398][106226] Updated weights for policy 0, policy_version 19798 (0.0008) [2023-12-27 19:22:22,715][106225] Updated weights for policy 1, policy_version 19705 (0.0006) [2023-12-27 19:22:22,788][106225] Updated weights for policy 1, policy_version 19715 (0.0005) [2023-12-27 19:22:22,854][106225] Updated weights for policy 1, policy_version 19725 (0.0006) [2023-12-27 19:22:22,922][106225] Updated weights for policy 1, policy_version 19735 (0.0006) [2023-12-27 19:22:23,019][106226] Updated weights for policy 0, policy_version 19808 (0.0006) [2023-12-27 19:22:23,089][106226] Updated weights for policy 0, policy_version 19818 (0.0006) [2023-12-27 19:22:23,158][106226] Updated weights for policy 0, policy_version 19828 (0.0008) [2023-12-27 19:22:23,474][106225] Updated weights for policy 1, policy_version 19745 (0.0009) [2023-12-27 19:22:23,525][106225] Updated weights for policy 1, policy_version 19755 (0.0009) [2023-12-27 19:22:23,574][106225] Updated weights for policy 1, policy_version 19765 (0.0006) [2023-12-27 19:22:23,725][106226] Updated weights for policy 0, policy_version 19838 (0.0011) [2023-12-27 19:22:23,782][106226] Updated weights for policy 0, policy_version 19848 (0.0010) [2023-12-27 19:22:23,832][106226] Updated weights for policy 0, policy_version 19858 (0.0010) [2023-12-27 19:22:24,243][106225] Updated weights for policy 1, policy_version 19775 (0.0008) [2023-12-27 19:22:24,293][106225] Updated weights for policy 1, policy_version 19785 (0.0005) [2023-12-27 19:22:24,348][106225] Updated weights for policy 1, policy_version 19795 (0.0005) [2023-12-27 19:22:24,511][106226] Updated weights for policy 0, policy_version 19868 (0.0010) [2023-12-27 19:22:24,565][106226] Updated weights for policy 0, policy_version 19878 (0.0010) [2023-12-27 19:22:24,619][106226] Updated weights for policy 0, policy_version 19888 (0.0011) [2023-12-27 19:22:24,995][106225] Updated weights for policy 1, policy_version 19805 (0.0005) [2023-12-27 19:22:25,058][106225] Updated weights for policy 1, policy_version 19815 (0.0005) [2023-12-27 19:22:25,118][106225] Updated weights for policy 1, policy_version 19825 (0.0007) [2023-12-27 19:22:25,198][106226] Updated weights for policy 0, policy_version 19898 (0.0010) [2023-12-27 19:22:25,254][106226] Updated weights for policy 0, policy_version 19908 (0.0010) [2023-12-27 19:22:25,303][106226] Updated weights for policy 0, policy_version 19918 (0.0010) [2023-12-27 19:22:25,353][106226] Updated weights for policy 0, policy_version 19928 (0.0011) [2023-12-27 19:22:25,773][106225] Updated weights for policy 1, policy_version 19835 (0.0008) [2023-12-27 19:22:25,826][106225] Updated weights for policy 1, policy_version 19845 (0.0007) [2023-12-27 19:22:25,891][106225] Updated weights for policy 1, policy_version 19855 (0.0008) [2023-12-27 19:22:26,076][106226] Updated weights for policy 0, policy_version 19938 (0.0011) [2023-12-27 19:22:26,137][106226] Updated weights for policy 0, policy_version 19948 (0.0011) [2023-12-27 19:22:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 10190848. Throughput: 0: 10027.8, 1: 9811.2. Samples: 10159124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:22:26,175][105115] Avg episode reward: [(0, '-5.644'), (1, '-7.071')] [2023-12-27 19:22:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000019864_5087232.pth... [2023-12-27 19:22:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000018712_4792320.pth [2023-12-27 19:22:26,204][106226] Updated weights for policy 0, policy_version 19958 (0.0006) [2023-12-27 19:22:26,214][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000019960_5111808.pth... [2023-12-27 19:22:26,218][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000018776_4808704.pth [2023-12-27 19:22:26,600][106225] Updated weights for policy 1, policy_version 19865 (0.0009) [2023-12-27 19:22:26,655][106225] Updated weights for policy 1, policy_version 19875 (0.0007) [2023-12-27 19:22:26,697][106225] Updated weights for policy 1, policy_version 19885 (0.0008) [2023-12-27 19:22:26,748][106225] Updated weights for policy 1, policy_version 19895 (0.0009) [2023-12-27 19:22:26,858][106226] Updated weights for policy 0, policy_version 19968 (0.0007) [2023-12-27 19:22:26,917][106226] Updated weights for policy 0, policy_version 19978 (0.0005) [2023-12-27 19:22:26,977][106226] Updated weights for policy 0, policy_version 19988 (0.0005) [2023-12-27 19:22:27,357][106225] Updated weights for policy 1, policy_version 19905 (0.0010) [2023-12-27 19:22:27,416][106225] Updated weights for policy 1, policy_version 19915 (0.0008) [2023-12-27 19:22:27,464][106225] Updated weights for policy 1, policy_version 19925 (0.0008) [2023-12-27 19:22:27,550][106226] Updated weights for policy 0, policy_version 19998 (0.0008) [2023-12-27 19:22:27,615][106226] Updated weights for policy 0, policy_version 20008 (0.0008) [2023-12-27 19:22:27,676][106226] Updated weights for policy 0, policy_version 20018 (0.0008) [2023-12-27 19:22:28,091][106225] Updated weights for policy 1, policy_version 19935 (0.0008) [2023-12-27 19:22:28,140][106225] Updated weights for policy 1, policy_version 19945 (0.0007) [2023-12-27 19:22:28,192][106225] Updated weights for policy 1, policy_version 19955 (0.0008) [2023-12-27 19:22:28,390][106226] Updated weights for policy 0, policy_version 20028 (0.0008) [2023-12-27 19:22:28,452][106226] Updated weights for policy 0, policy_version 20038 (0.0008) [2023-12-27 19:22:28,512][106226] Updated weights for policy 0, policy_version 20048 (0.0009) [2023-12-27 19:22:28,856][106225] Updated weights for policy 1, policy_version 19965 (0.0008) [2023-12-27 19:22:28,913][106225] Updated weights for policy 1, policy_version 19975 (0.0009) [2023-12-27 19:22:28,963][106225] Updated weights for policy 1, policy_version 19985 (0.0009) [2023-12-27 19:22:29,147][106226] Updated weights for policy 0, policy_version 20058 (0.0009) [2023-12-27 19:22:29,212][106226] Updated weights for policy 0, policy_version 20068 (0.0009) [2023-12-27 19:22:29,301][106226] Updated weights for policy 0, policy_version 20078 (0.0008) [2023-12-27 19:22:29,363][106226] Updated weights for policy 0, policy_version 20088 (0.0008) [2023-12-27 19:22:29,687][106225] Updated weights for policy 1, policy_version 19995 (0.0008) [2023-12-27 19:22:29,755][106225] Updated weights for policy 1, policy_version 20005 (0.0007) [2023-12-27 19:22:29,818][106225] Updated weights for policy 1, policy_version 20015 (0.0007) [2023-12-27 19:22:30,031][106226] Updated weights for policy 0, policy_version 20098 (0.0008) [2023-12-27 19:22:30,089][106226] Updated weights for policy 0, policy_version 20108 (0.0008) [2023-12-27 19:22:30,150][106226] Updated weights for policy 0, policy_version 20118 (0.0008) [2023-12-27 19:22:30,518][106225] Updated weights for policy 1, policy_version 20025 (0.0008) [2023-12-27 19:22:30,564][106225] Updated weights for policy 1, policy_version 20035 (0.0010) [2023-12-27 19:22:30,619][106225] Updated weights for policy 1, policy_version 20045 (0.0006) [2023-12-27 19:22:30,675][106225] Updated weights for policy 1, policy_version 20055 (0.0005) [2023-12-27 19:22:30,934][106226] Updated weights for policy 0, policy_version 20128 (0.0009) [2023-12-27 19:22:30,983][106226] Updated weights for policy 0, policy_version 20138 (0.0008) [2023-12-27 19:22:31,044][106226] Updated weights for policy 0, policy_version 20148 (0.0009) [2023-12-27 19:22:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 10297344. Throughput: 0: 10061.0, 1: 9901.5. Samples: 10284908. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 19:22:31,175][105115] Avg episode reward: [(0, '-5.927'), (1, '-6.674')] [2023-12-27 19:22:31,297][106225] Updated weights for policy 1, policy_version 20065 (0.0006) [2023-12-27 19:22:31,365][106225] Updated weights for policy 1, policy_version 20075 (0.0008) [2023-12-27 19:22:31,429][106225] Updated weights for policy 1, policy_version 20085 (0.0011) [2023-12-27 19:22:31,876][106226] Updated weights for policy 0, policy_version 20158 (0.0008) [2023-12-27 19:22:31,923][106226] Updated weights for policy 0, policy_version 20168 (0.0008) [2023-12-27 19:22:31,973][106226] Updated weights for policy 0, policy_version 20178 (0.0008) [2023-12-27 19:22:32,140][106225] Updated weights for policy 1, policy_version 20095 (0.0010) [2023-12-27 19:22:32,187][106225] Updated weights for policy 1, policy_version 20105 (0.0010) [2023-12-27 19:22:32,238][106225] Updated weights for policy 1, policy_version 20115 (0.0010) [2023-12-27 19:22:32,683][106226] Updated weights for policy 0, policy_version 20188 (0.0008) [2023-12-27 19:22:32,749][106226] Updated weights for policy 0, policy_version 20198 (0.0009) [2023-12-27 19:22:32,814][106226] Updated weights for policy 0, policy_version 20208 (0.0008) [2023-12-27 19:22:32,930][106225] Updated weights for policy 1, policy_version 20125 (0.0010) [2023-12-27 19:22:32,988][106225] Updated weights for policy 1, policy_version 20135 (0.0008) [2023-12-27 19:22:33,047][106225] Updated weights for policy 1, policy_version 20145 (0.0009) [2023-12-27 19:22:33,488][106226] Updated weights for policy 0, policy_version 20218 (0.0009) [2023-12-27 19:22:33,537][106226] Updated weights for policy 0, policy_version 20228 (0.0008) [2023-12-27 19:22:33,597][106226] Updated weights for policy 0, policy_version 20238 (0.0009) [2023-12-27 19:22:33,654][106226] Updated weights for policy 0, policy_version 20248 (0.0008) [2023-12-27 19:22:33,743][106225] Updated weights for policy 1, policy_version 20155 (0.0008) [2023-12-27 19:22:33,800][106225] Updated weights for policy 1, policy_version 20165 (0.0008) [2023-12-27 19:22:33,855][106225] Updated weights for policy 1, policy_version 20175 (0.0009) [2023-12-27 19:22:34,390][106226] Updated weights for policy 0, policy_version 20258 (0.0009) [2023-12-27 19:22:34,452][106226] Updated weights for policy 0, policy_version 20268 (0.0007) [2023-12-27 19:22:34,518][106226] Updated weights for policy 0, policy_version 20278 (0.0006) [2023-12-27 19:22:34,604][106225] Updated weights for policy 1, policy_version 20185 (0.0007) [2023-12-27 19:22:34,666][106225] Updated weights for policy 1, policy_version 20195 (0.0008) [2023-12-27 19:22:34,721][106225] Updated weights for policy 1, policy_version 20205 (0.0005) [2023-12-27 19:22:34,783][106225] Updated weights for policy 1, policy_version 20215 (0.0008) [2023-12-27 19:22:35,191][106226] Updated weights for policy 0, policy_version 20288 (0.0008) [2023-12-27 19:22:35,236][106226] Updated weights for policy 0, policy_version 20298 (0.0008) [2023-12-27 19:22:35,285][106226] Updated weights for policy 0, policy_version 20308 (0.0008) [2023-12-27 19:22:35,444][106225] Updated weights for policy 1, policy_version 20225 (0.0010) [2023-12-27 19:22:35,498][106225] Updated weights for policy 1, policy_version 20235 (0.0010) [2023-12-27 19:22:35,555][106225] Updated weights for policy 1, policy_version 20245 (0.0009) [2023-12-27 19:22:35,968][106226] Updated weights for policy 0, policy_version 20318 (0.0006) [2023-12-27 19:22:36,022][106226] Updated weights for policy 0, policy_version 20328 (0.0006) [2023-12-27 19:22:36,072][106226] Updated weights for policy 0, policy_version 20339 (0.0008) [2023-12-27 19:22:36,140][106225] Updated weights for policy 1, policy_version 20255 (0.0007) [2023-12-27 19:22:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 10395648. Throughput: 0: 10036.0, 1: 9938.5. Samples: 10403532. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 19:22:36,175][105115] Avg episode reward: [(0, '-5.594'), (1, '-6.624')] [2023-12-27 19:22:36,193][106225] Updated weights for policy 1, policy_version 20265 (0.0006) [2023-12-27 19:22:36,251][106225] Updated weights for policy 1, policy_version 20275 (0.0010) [2023-12-27 19:22:36,845][106226] Updated weights for policy 0, policy_version 20349 (0.0008) [2023-12-27 19:22:36,885][106225] Updated weights for policy 1, policy_version 20285 (0.0009) [2023-12-27 19:22:36,905][106226] Updated weights for policy 0, policy_version 20359 (0.0006) [2023-12-27 19:22:36,940][106225] Updated weights for policy 1, policy_version 20295 (0.0008) [2023-12-27 19:22:36,963][106226] Updated weights for policy 0, policy_version 20369 (0.0007) [2023-12-27 19:22:36,996][106225] Updated weights for policy 1, policy_version 20305 (0.0009) [2023-12-27 19:22:37,522][106226] Updated weights for policy 0, policy_version 20379 (0.0006) [2023-12-27 19:22:37,571][106226] Updated weights for policy 0, policy_version 20389 (0.0007) [2023-12-27 19:22:37,632][106225] Updated weights for policy 1, policy_version 20315 (0.0010) [2023-12-27 19:22:37,633][106226] Updated weights for policy 0, policy_version 20399 (0.0009) [2023-12-27 19:22:37,691][106225] Updated weights for policy 1, policy_version 20325 (0.0010) [2023-12-27 19:22:37,754][106225] Updated weights for policy 1, policy_version 20335 (0.0011) [2023-12-27 19:22:38,398][106226] Updated weights for policy 0, policy_version 20409 (0.0007) [2023-12-27 19:22:38,410][106225] Updated weights for policy 1, policy_version 20345 (0.0010) [2023-12-27 19:22:38,451][106226] Updated weights for policy 0, policy_version 20419 (0.0006) [2023-12-27 19:22:38,467][106225] Updated weights for policy 1, policy_version 20355 (0.0010) [2023-12-27 19:22:38,507][106226] Updated weights for policy 0, policy_version 20429 (0.0007) [2023-12-27 19:22:38,524][106225] Updated weights for policy 1, policy_version 20365 (0.0010) [2023-12-27 19:22:38,565][106226] Updated weights for policy 0, policy_version 20439 (0.0005) [2023-12-27 19:22:38,574][106225] Updated weights for policy 1, policy_version 20375 (0.0010) [2023-12-27 19:22:39,259][106225] Updated weights for policy 1, policy_version 20385 (0.0009) [2023-12-27 19:22:39,319][106225] Updated weights for policy 1, policy_version 20395 (0.0005) [2023-12-27 19:22:39,362][106226] Updated weights for policy 0, policy_version 20449 (0.0008) [2023-12-27 19:22:39,390][106225] Updated weights for policy 1, policy_version 20405 (0.0009) [2023-12-27 19:22:39,436][106226] Updated weights for policy 0, policy_version 20459 (0.0009) [2023-12-27 19:22:39,499][106226] Updated weights for policy 0, policy_version 20469 (0.0009) [2023-12-27 19:22:40,131][106225] Updated weights for policy 1, policy_version 20415 (0.0010) [2023-12-27 19:22:40,197][106225] Updated weights for policy 1, policy_version 20425 (0.0011) [2023-12-27 19:22:40,261][106225] Updated weights for policy 1, policy_version 20435 (0.0010) [2023-12-27 19:22:40,282][106226] Updated weights for policy 0, policy_version 20479 (0.0006) [2023-12-27 19:22:40,342][106226] Updated weights for policy 0, policy_version 20489 (0.0009) [2023-12-27 19:22:40,415][106226] Updated weights for policy 0, policy_version 20499 (0.0009) [2023-12-27 19:22:40,946][106225] Updated weights for policy 1, policy_version 20445 (0.0008) [2023-12-27 19:22:41,012][106225] Updated weights for policy 1, policy_version 20455 (0.0009) [2023-12-27 19:22:41,080][106225] Updated weights for policy 1, policy_version 20465 (0.0010) [2023-12-27 19:22:41,164][106226] Updated weights for policy 0, policy_version 20509 (0.0008) [2023-12-27 19:22:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 10493952. Throughput: 0: 10025.2, 1: 10002.1. Samples: 10464940. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 19:22:41,175][105115] Avg episode reward: [(0, '-5.512'), (1, '-6.745')] [2023-12-27 19:22:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000020472_5242880.pth... [2023-12-27 19:22:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000019288_4939776.pth [2023-12-27 19:22:41,219][106226] Updated weights for policy 0, policy_version 20519 (0.0008) [2023-12-27 19:22:41,274][106226] Updated weights for policy 0, policy_version 20529 (0.0008) [2023-12-27 19:22:41,316][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000020536_5259264.pth... [2023-12-27 19:22:41,321][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000019352_4956160.pth [2023-12-27 19:22:41,863][106225] Updated weights for policy 1, policy_version 20475 (0.0010) [2023-12-27 19:22:41,920][106225] Updated weights for policy 1, policy_version 20485 (0.0009) [2023-12-27 19:22:41,980][106225] Updated weights for policy 1, policy_version 20495 (0.0009) [2023-12-27 19:22:42,045][106226] Updated weights for policy 0, policy_version 20539 (0.0008) [2023-12-27 19:22:42,118][106226] Updated weights for policy 0, policy_version 20549 (0.0006) [2023-12-27 19:22:42,172][106226] Updated weights for policy 0, policy_version 20559 (0.0008) [2023-12-27 19:22:42,699][106225] Updated weights for policy 1, policy_version 20505 (0.0009) [2023-12-27 19:22:42,764][106225] Updated weights for policy 1, policy_version 20515 (0.0008) [2023-12-27 19:22:42,829][106225] Updated weights for policy 1, policy_version 20525 (0.0008) [2023-12-27 19:22:42,898][106225] Updated weights for policy 1, policy_version 20535 (0.0008) [2023-12-27 19:22:42,907][106226] Updated weights for policy 0, policy_version 20569 (0.0008) [2023-12-27 19:22:42,979][106226] Updated weights for policy 0, policy_version 20579 (0.0009) [2023-12-27 19:22:43,055][106226] Updated weights for policy 0, policy_version 20589 (0.0011) [2023-12-27 19:22:43,128][106226] Updated weights for policy 0, policy_version 20599 (0.0009) [2023-12-27 19:22:43,624][106225] Updated weights for policy 1, policy_version 20545 (0.0010) [2023-12-27 19:22:43,676][106225] Updated weights for policy 1, policy_version 20555 (0.0009) [2023-12-27 19:22:43,679][106226] Updated weights for policy 0, policy_version 20609 (0.0006) [2023-12-27 19:22:43,729][106225] Updated weights for policy 1, policy_version 20565 (0.0008) [2023-12-27 19:22:43,730][106226] Updated weights for policy 0, policy_version 20619 (0.0005) [2023-12-27 19:22:43,782][106226] Updated weights for policy 0, policy_version 20629 (0.0005) [2023-12-27 19:22:44,291][106226] Updated weights for policy 0, policy_version 20639 (0.0009) [2023-12-27 19:22:44,346][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000001 [2023-12-27 19:22:44,559][106225] Updated weights for policy 1, policy_version 20575 (0.0008) [2023-12-27 19:22:44,609][106225] Updated weights for policy 1, policy_version 20585 (0.0008) [2023-12-27 19:22:44,679][106225] Updated weights for policy 1, policy_version 20595 (0.0009) [2023-12-27 19:22:45,001][106226] Updated weights for policy 0, policy_version 20649 (0.0010) [2023-12-27 19:22:45,050][106226] Updated weights for policy 0, policy_version 20659 (0.0008) [2023-12-27 19:22:45,111][106226] Updated weights for policy 0, policy_version 20669 (0.0008) [2023-12-27 19:22:45,178][106226] Updated weights for policy 0, policy_version 20679 (0.0009) [2023-12-27 19:22:45,493][106225] Updated weights for policy 1, policy_version 20605 (0.0009) [2023-12-27 19:22:45,555][106225] Updated weights for policy 1, policy_version 20615 (0.0008) [2023-12-27 19:22:45,617][106225] Updated weights for policy 1, policy_version 20625 (0.0008) [2023-12-27 19:22:45,817][106226] Updated weights for policy 0, policy_version 20689 (0.0008) [2023-12-27 19:22:45,869][106226] Updated weights for policy 0, policy_version 20699 (0.0010) [2023-12-27 19:22:45,928][106226] Updated weights for policy 0, policy_version 20709 (0.0008) [2023-12-27 19:22:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 10592256. Throughput: 0: 10015.0, 1: 9872.0. Samples: 10581140. Policy #0 lag: (min: 16.0, avg: 30.8, max: 32.0) [2023-12-27 19:22:46,176][105115] Avg episode reward: [(0, '-5.790'), (1, '-6.874')] [2023-12-27 19:22:46,379][106225] Updated weights for policy 1, policy_version 20635 (0.0009) [2023-12-27 19:22:46,435][106225] Updated weights for policy 1, policy_version 20645 (0.0008) [2023-12-27 19:22:46,494][106225] Updated weights for policy 1, policy_version 20655 (0.0006) [2023-12-27 19:22:46,614][106226] Updated weights for policy 0, policy_version 20719 (0.0007) [2023-12-27 19:22:46,677][106226] Updated weights for policy 0, policy_version 20729 (0.0006) [2023-12-27 19:22:46,725][106226] Updated weights for policy 0, policy_version 20739 (0.0005) [2023-12-27 19:22:47,212][106225] Updated weights for policy 1, policy_version 20665 (0.0008) [2023-12-27 19:22:47,271][106225] Updated weights for policy 1, policy_version 20675 (0.0009) [2023-12-27 19:22:47,334][106225] Updated weights for policy 1, policy_version 20685 (0.0009) [2023-12-27 19:22:47,368][106226] Updated weights for policy 0, policy_version 20749 (0.0007) [2023-12-27 19:22:47,399][106225] Updated weights for policy 1, policy_version 20695 (0.0008) [2023-12-27 19:22:47,431][106226] Updated weights for policy 0, policy_version 20759 (0.0007) [2023-12-27 19:22:47,479][106226] Updated weights for policy 0, policy_version 20769 (0.0005) [2023-12-27 19:22:48,064][106226] Updated weights for policy 0, policy_version 20779 (0.0006) [2023-12-27 19:22:48,115][106226] Updated weights for policy 0, policy_version 20789 (0.0008) [2023-12-27 19:22:48,151][106225] Updated weights for policy 1, policy_version 20705 (0.0008) [2023-12-27 19:22:48,162][106226] Updated weights for policy 0, policy_version 20799 (0.0006) [2023-12-27 19:22:48,206][106225] Updated weights for policy 1, policy_version 20715 (0.0007) [2023-12-27 19:22:48,268][106225] Updated weights for policy 1, policy_version 20725 (0.0008) [2023-12-27 19:22:48,953][106226] Updated weights for policy 0, policy_version 20809 (0.0007) [2023-12-27 19:22:48,995][106225] Updated weights for policy 1, policy_version 20735 (0.0007) [2023-12-27 19:22:49,005][106226] Updated weights for policy 0, policy_version 20819 (0.0006) [2023-12-27 19:22:49,051][106225] Updated weights for policy 1, policy_version 20745 (0.0006) [2023-12-27 19:22:49,054][106226] Updated weights for policy 0, policy_version 20829 (0.0007) [2023-12-27 19:22:49,106][106226] Updated weights for policy 0, policy_version 20839 (0.0007) [2023-12-27 19:22:49,111][106225] Updated weights for policy 1, policy_version 20755 (0.0007) [2023-12-27 19:22:49,796][106226] Updated weights for policy 0, policy_version 20849 (0.0006) [2023-12-27 19:22:49,868][106226] Updated weights for policy 0, policy_version 20859 (0.0008) [2023-12-27 19:22:49,898][106225] Updated weights for policy 1, policy_version 20765 (0.0008) [2023-12-27 19:22:49,931][106226] Updated weights for policy 0, policy_version 20869 (0.0007) [2023-12-27 19:22:49,967][106225] Updated weights for policy 1, policy_version 20775 (0.0008) [2023-12-27 19:22:50,024][106225] Updated weights for policy 1, policy_version 20785 (0.0007) [2023-12-27 19:22:50,638][106226] Updated weights for policy 0, policy_version 20879 (0.0007) [2023-12-27 19:22:50,699][106226] Updated weights for policy 0, policy_version 20889 (0.0005) [2023-12-27 19:22:50,728][106225] Updated weights for policy 1, policy_version 20795 (0.0007) [2023-12-27 19:22:50,759][106226] Updated weights for policy 0, policy_version 20899 (0.0006) [2023-12-27 19:22:50,790][106225] Updated weights for policy 1, policy_version 20805 (0.0006) [2023-12-27 19:22:50,853][106225] Updated weights for policy 1, policy_version 20815 (0.0007) [2023-12-27 19:22:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 10690560. Throughput: 0: 10030.7, 1: 9810.0. Samples: 10698776. Policy #0 lag: (min: 16.0, avg: 30.8, max: 32.0) [2023-12-27 19:22:51,175][105115] Avg episode reward: [(0, '-5.697'), (1, '-6.713')] [2023-12-27 19:22:51,456][106225] Updated weights for policy 1, policy_version 20825 (0.0006) [2023-12-27 19:22:51,515][106225] Updated weights for policy 1, policy_version 20835 (0.0008) [2023-12-27 19:22:51,526][106226] Updated weights for policy 0, policy_version 20909 (0.0006) [2023-12-27 19:22:51,571][106225] Updated weights for policy 1, policy_version 20845 (0.0005) [2023-12-27 19:22:51,586][106226] Updated weights for policy 0, policy_version 20919 (0.0007) [2023-12-27 19:22:51,634][106225] Updated weights for policy 1, policy_version 20855 (0.0007) [2023-12-27 19:22:51,656][106226] Updated weights for policy 0, policy_version 20929 (0.0007) [2023-12-27 19:22:52,300][106225] Updated weights for policy 1, policy_version 20865 (0.0007) [2023-12-27 19:22:52,372][106225] Updated weights for policy 1, policy_version 20875 (0.0007) [2023-12-27 19:22:52,408][106226] Updated weights for policy 0, policy_version 20939 (0.0006) [2023-12-27 19:22:52,436][106225] Updated weights for policy 1, policy_version 20885 (0.0008) [2023-12-27 19:22:52,464][106226] Updated weights for policy 0, policy_version 20949 (0.0006) [2023-12-27 19:22:52,516][106226] Updated weights for policy 0, policy_version 20959 (0.0006) [2023-12-27 19:22:53,078][106225] Updated weights for policy 1, policy_version 20895 (0.0007) [2023-12-27 19:22:53,128][106226] Updated weights for policy 0, policy_version 20969 (0.0007) [2023-12-27 19:22:53,135][106225] Updated weights for policy 1, policy_version 20905 (0.0007) [2023-12-27 19:22:53,186][106226] Updated weights for policy 0, policy_version 20979 (0.0011) [2023-12-27 19:22:53,188][106225] Updated weights for policy 1, policy_version 20915 (0.0005) [2023-12-27 19:22:53,255][106226] Updated weights for policy 0, policy_version 20989 (0.0010) [2023-12-27 19:22:53,321][106226] Updated weights for policy 0, policy_version 20999 (0.0011) [2023-12-27 19:22:53,788][106225] Updated weights for policy 1, policy_version 20925 (0.0006) [2023-12-27 19:22:53,845][106225] Updated weights for policy 1, policy_version 20935 (0.0008) [2023-12-27 19:22:53,906][106225] Updated weights for policy 1, policy_version 20945 (0.0008) [2023-12-27 19:22:54,006][106226] Updated weights for policy 0, policy_version 21009 (0.0008) [2023-12-27 19:22:54,059][106226] Updated weights for policy 0, policy_version 21019 (0.0008) [2023-12-27 19:22:54,106][106226] Updated weights for policy 0, policy_version 21029 (0.0008) [2023-12-27 19:22:54,628][106225] Updated weights for policy 1, policy_version 20955 (0.0007) [2023-12-27 19:22:54,688][106225] Updated weights for policy 1, policy_version 20965 (0.0008) [2023-12-27 19:22:54,737][106225] Updated weights for policy 1, policy_version 20975 (0.0009) [2023-12-27 19:22:54,801][106226] Updated weights for policy 0, policy_version 21039 (0.0006) [2023-12-27 19:22:54,859][106226] Updated weights for policy 0, policy_version 21049 (0.0006) [2023-12-27 19:22:54,911][106226] Updated weights for policy 0, policy_version 21059 (0.0008) [2023-12-27 19:22:55,525][106225] Updated weights for policy 1, policy_version 20986 (0.0008) [2023-12-27 19:22:55,531][106226] Updated weights for policy 0, policy_version 21069 (0.0007) [2023-12-27 19:22:55,577][106225] Updated weights for policy 1, policy_version 20996 (0.0006) [2023-12-27 19:22:55,582][106226] Updated weights for policy 0, policy_version 21079 (0.0008) [2023-12-27 19:22:55,629][106225] Updated weights for policy 1, policy_version 21006 (0.0005) [2023-12-27 19:22:55,635][106226] Updated weights for policy 0, policy_version 21089 (0.0008) [2023-12-27 19:22:55,678][106225] Updated weights for policy 1, policy_version 21016 (0.0007) [2023-12-27 19:22:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 10788864. Throughput: 0: 9998.6, 1: 9847.4. Samples: 10760064. Policy #0 lag: (min: 16.0, avg: 30.8, max: 32.0) [2023-12-27 19:22:56,175][105115] Avg episode reward: [(0, '-6.101'), (1, '-6.852')] [2023-12-27 19:22:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000021096_5406720.pth... [2023-12-27 19:22:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000021016_5382144.pth... [2023-12-27 19:22:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000019960_5111808.pth [2023-12-27 19:22:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000019864_5087232.pth [2023-12-27 19:22:56,344][106225] Updated weights for policy 1, policy_version 21026 (0.0008) [2023-12-27 19:22:56,404][106225] Updated weights for policy 1, policy_version 21036 (0.0008) [2023-12-27 19:22:56,440][106226] Updated weights for policy 0, policy_version 21099 (0.0009) [2023-12-27 19:22:56,461][106225] Updated weights for policy 1, policy_version 21046 (0.0006) [2023-12-27 19:22:56,495][106226] Updated weights for policy 0, policy_version 21109 (0.0011) [2023-12-27 19:22:56,552][106226] Updated weights for policy 0, policy_version 21119 (0.0011) [2023-12-27 19:22:57,186][106225] Updated weights for policy 1, policy_version 21056 (0.0007) [2023-12-27 19:22:57,235][106225] Updated weights for policy 1, policy_version 21066 (0.0008) [2023-12-27 19:22:57,270][106226] Updated weights for policy 0, policy_version 21129 (0.0010) [2023-12-27 19:22:57,279][106225] Updated weights for policy 1, policy_version 21076 (0.0007) [2023-12-27 19:22:57,320][106226] Updated weights for policy 0, policy_version 21139 (0.0010) [2023-12-27 19:22:57,369][106226] Updated weights for policy 0, policy_version 21149 (0.0010) [2023-12-27 19:22:57,415][106226] Updated weights for policy 0, policy_version 21159 (0.0010) [2023-12-27 19:22:58,024][106225] Updated weights for policy 1, policy_version 21086 (0.0006) [2023-12-27 19:22:58,073][106225] Updated weights for policy 1, policy_version 21096 (0.0008) [2023-12-27 19:22:58,131][106225] Updated weights for policy 1, policy_version 21106 (0.0006) [2023-12-27 19:22:58,136][106226] Updated weights for policy 0, policy_version 21169 (0.0010) [2023-12-27 19:22:58,194][106226] Updated weights for policy 0, policy_version 21179 (0.0010) [2023-12-27 19:22:58,253][106226] Updated weights for policy 0, policy_version 21189 (0.0010) [2023-12-27 19:22:59,015][106225] Updated weights for policy 1, policy_version 21116 (0.0008) [2023-12-27 19:22:59,075][106226] Updated weights for policy 0, policy_version 21199 (0.0009) [2023-12-27 19:22:59,082][106225] Updated weights for policy 1, policy_version 21126 (0.0008) [2023-12-27 19:22:59,140][106226] Updated weights for policy 0, policy_version 21209 (0.0007) [2023-12-27 19:22:59,141][106225] Updated weights for policy 1, policy_version 21136 (0.0008) [2023-12-27 19:22:59,198][106226] Updated weights for policy 0, policy_version 21219 (0.0008) [2023-12-27 19:22:59,899][106225] Updated weights for policy 1, policy_version 21146 (0.0006) [2023-12-27 19:22:59,945][106226] Updated weights for policy 0, policy_version 21229 (0.0009) [2023-12-27 19:22:59,964][106225] Updated weights for policy 1, policy_version 21156 (0.0008) [2023-12-27 19:23:00,007][106226] Updated weights for policy 0, policy_version 21239 (0.0007) [2023-12-27 19:23:00,024][106225] Updated weights for policy 1, policy_version 21166 (0.0007) [2023-12-27 19:23:00,074][106226] Updated weights for policy 0, policy_version 21249 (0.0005) [2023-12-27 19:23:00,082][106225] Updated weights for policy 1, policy_version 21176 (0.0008) [2023-12-27 19:23:00,605][106226] Updated weights for policy 0, policy_version 21259 (0.0005) [2023-12-27 19:23:00,664][106226] Updated weights for policy 0, policy_version 21269 (0.0005) [2023-12-27 19:23:00,719][106226] Updated weights for policy 0, policy_version 21279 (0.0005) [2023-12-27 19:23:00,844][106225] Updated weights for policy 1, policy_version 21186 (0.0008) [2023-12-27 19:23:00,897][106225] Updated weights for policy 1, policy_version 21196 (0.0009) [2023-12-27 19:23:00,949][106225] Updated weights for policy 1, policy_version 21206 (0.0009) [2023-12-27 19:23:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 10887168. Throughput: 0: 9968.2, 1: 9859.4. Samples: 10874812. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-27 19:23:01,175][105115] Avg episode reward: [(0, '-5.864'), (1, '-6.910')] [2023-12-27 19:23:01,371][106226] Updated weights for policy 0, policy_version 21289 (0.0005) [2023-12-27 19:23:01,435][106226] Updated weights for policy 0, policy_version 21299 (0.0009) [2023-12-27 19:23:01,504][106226] Updated weights for policy 0, policy_version 21309 (0.0009) [2023-12-27 19:23:01,555][106226] Updated weights for policy 0, policy_version 21319 (0.0008) [2023-12-27 19:23:01,677][106225] Updated weights for policy 1, policy_version 21216 (0.0008) [2023-12-27 19:23:01,739][106225] Updated weights for policy 1, policy_version 21226 (0.0008) [2023-12-27 19:23:01,800][106225] Updated weights for policy 1, policy_version 21236 (0.0008) [2023-12-27 19:23:02,285][106226] Updated weights for policy 0, policy_version 21329 (0.0008) [2023-12-27 19:23:02,361][106226] Updated weights for policy 0, policy_version 21339 (0.0008) [2023-12-27 19:23:02,425][106226] Updated weights for policy 0, policy_version 21349 (0.0008) [2023-12-27 19:23:02,555][106225] Updated weights for policy 1, policy_version 21246 (0.0007) [2023-12-27 19:23:02,601][106225] Updated weights for policy 1, policy_version 21256 (0.0007) [2023-12-27 19:23:02,674][106225] Updated weights for policy 1, policy_version 21266 (0.0009) [2023-12-27 19:23:03,130][106226] Updated weights for policy 0, policy_version 21359 (0.0006) [2023-12-27 19:23:03,190][106226] Updated weights for policy 0, policy_version 21369 (0.0005) [2023-12-27 19:23:03,260][106226] Updated weights for policy 0, policy_version 21379 (0.0005) [2023-12-27 19:23:03,297][106225] Updated weights for policy 1, policy_version 21276 (0.0007) [2023-12-27 19:23:03,349][106225] Updated weights for policy 1, policy_version 21286 (0.0005) [2023-12-27 19:23:03,398][106225] Updated weights for policy 1, policy_version 21296 (0.0005) [2023-12-27 19:23:03,757][106226] Updated weights for policy 0, policy_version 21389 (0.0005) [2023-12-27 19:23:03,810][106226] Updated weights for policy 0, policy_version 21399 (0.0005) [2023-12-27 19:23:03,875][106226] Updated weights for policy 0, policy_version 21409 (0.0009) [2023-12-27 19:23:03,958][106225] Updated weights for policy 1, policy_version 21306 (0.0007) [2023-12-27 19:23:04,018][106225] Updated weights for policy 1, policy_version 21316 (0.0010) [2023-12-27 19:23:04,075][106225] Updated weights for policy 1, policy_version 21326 (0.0010) [2023-12-27 19:23:04,135][106225] Updated weights for policy 1, policy_version 21336 (0.0010) [2023-12-27 19:23:04,501][106226] Updated weights for policy 0, policy_version 21419 (0.0008) [2023-12-27 19:23:04,555][106226] Updated weights for policy 0, policy_version 21429 (0.0010) [2023-12-27 19:23:04,619][106226] Updated weights for policy 0, policy_version 21439 (0.0010) [2023-12-27 19:23:04,838][106225] Updated weights for policy 1, policy_version 21346 (0.0010) [2023-12-27 19:23:04,907][106225] Updated weights for policy 1, policy_version 21356 (0.0010) [2023-12-27 19:23:04,971][106225] Updated weights for policy 1, policy_version 21366 (0.0010) [2023-12-27 19:23:05,255][106226] Updated weights for policy 0, policy_version 21449 (0.0010) [2023-12-27 19:23:05,313][106226] Updated weights for policy 0, policy_version 21459 (0.0010) [2023-12-27 19:23:05,369][106226] Updated weights for policy 0, policy_version 21469 (0.0010) [2023-12-27 19:23:05,430][106226] Updated weights for policy 0, policy_version 21479 (0.0008) [2023-12-27 19:23:05,483][106225] Updated weights for policy 1, policy_version 21376 (0.0005) [2023-12-27 19:23:05,528][106225] Updated weights for policy 1, policy_version 21386 (0.0005) [2023-12-27 19:23:05,577][106225] Updated weights for policy 1, policy_version 21396 (0.0005) [2023-12-27 19:23:06,118][106226] Updated weights for policy 0, policy_version 21489 (0.0009) [2023-12-27 19:23:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 10985472. Throughput: 0: 10074.0, 1: 9975.6. Samples: 11001260. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-27 19:23:06,175][105115] Avg episode reward: [(0, '-5.623'), (1, '-6.951')] [2023-12-27 19:23:06,181][106226] Updated weights for policy 0, policy_version 21499 (0.0011) [2023-12-27 19:23:06,233][106225] Updated weights for policy 1, policy_version 21406 (0.0006) [2023-12-27 19:23:06,249][106226] Updated weights for policy 0, policy_version 21509 (0.0009) [2023-12-27 19:23:06,294][106225] Updated weights for policy 1, policy_version 21416 (0.0010) [2023-12-27 19:23:06,366][106225] Updated weights for policy 1, policy_version 21426 (0.0011) [2023-12-27 19:23:06,945][106226] Updated weights for policy 0, policy_version 21519 (0.0008) [2023-12-27 19:23:07,000][106226] Updated weights for policy 0, policy_version 21529 (0.0008) [2023-12-27 19:23:07,057][106226] Updated weights for policy 0, policy_version 21539 (0.0007) [2023-12-27 19:23:07,065][106225] Updated weights for policy 1, policy_version 21436 (0.0010) [2023-12-27 19:23:07,125][106225] Updated weights for policy 1, policy_version 21446 (0.0010) [2023-12-27 19:23:07,185][106225] Updated weights for policy 1, policy_version 21456 (0.0010) [2023-12-27 19:23:07,812][106226] Updated weights for policy 0, policy_version 21549 (0.0009) [2023-12-27 19:23:07,871][106226] Updated weights for policy 0, policy_version 21559 (0.0008) [2023-12-27 19:23:07,891][106225] Updated weights for policy 1, policy_version 21466 (0.0010) [2023-12-27 19:23:07,924][106226] Updated weights for policy 0, policy_version 21569 (0.0007) [2023-12-27 19:23:07,950][106225] Updated weights for policy 1, policy_version 21476 (0.0010) [2023-12-27 19:23:08,003][106225] Updated weights for policy 1, policy_version 21486 (0.0010) [2023-12-27 19:23:08,064][106225] Updated weights for policy 1, policy_version 21496 (0.0010) [2023-12-27 19:23:08,616][106226] Updated weights for policy 0, policy_version 21579 (0.0008) [2023-12-27 19:23:08,675][106226] Updated weights for policy 0, policy_version 21589 (0.0005) [2023-12-27 19:23:08,737][106226] Updated weights for policy 0, policy_version 21599 (0.0007) [2023-12-27 19:23:08,781][106225] Updated weights for policy 1, policy_version 21506 (0.0010) [2023-12-27 19:23:08,845][106225] Updated weights for policy 1, policy_version 21516 (0.0010) [2023-12-27 19:23:08,905][106225] Updated weights for policy 1, policy_version 21526 (0.0010) [2023-12-27 19:23:09,385][106226] Updated weights for policy 0, policy_version 21609 (0.0007) [2023-12-27 19:23:09,452][106226] Updated weights for policy 0, policy_version 21619 (0.0007) [2023-12-27 19:23:09,516][106226] Updated weights for policy 0, policy_version 21629 (0.0009) [2023-12-27 19:23:09,581][106226] Updated weights for policy 0, policy_version 21639 (0.0008) [2023-12-27 19:23:09,716][106225] Updated weights for policy 1, policy_version 21536 (0.0009) [2023-12-27 19:23:09,787][106225] Updated weights for policy 1, policy_version 21546 (0.0008) [2023-12-27 19:23:09,858][106225] Updated weights for policy 1, policy_version 21556 (0.0008) [2023-12-27 19:23:10,276][106226] Updated weights for policy 0, policy_version 21649 (0.0007) [2023-12-27 19:23:10,341][106226] Updated weights for policy 0, policy_version 21659 (0.0008) [2023-12-27 19:23:10,410][106226] Updated weights for policy 0, policy_version 21669 (0.0008) [2023-12-27 19:23:10,624][106225] Updated weights for policy 1, policy_version 21566 (0.0008) [2023-12-27 19:23:10,683][106225] Updated weights for policy 1, policy_version 21576 (0.0006) [2023-12-27 19:23:10,744][106225] Updated weights for policy 1, policy_version 21586 (0.0005) [2023-12-27 19:23:11,115][106226] Updated weights for policy 0, policy_version 21679 (0.0006) [2023-12-27 19:23:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 11083776. Throughput: 0: 10037.6, 1: 9972.0. Samples: 11059556. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-27 19:23:11,175][105115] Avg episode reward: [(0, '-5.711'), (1, '-6.910')] [2023-12-27 19:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000021592_5529600.pth... [2023-12-27 19:23:11,184][106226] Updated weights for policy 0, policy_version 21689 (0.0009) [2023-12-27 19:23:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000020472_5242880.pth [2023-12-27 19:23:11,252][106226] Updated weights for policy 0, policy_version 21699 (0.0008) [2023-12-27 19:23:11,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000021704_5562368.pth... [2023-12-27 19:23:11,289][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000020536_5259264.pth [2023-12-27 19:23:11,356][106225] Updated weights for policy 1, policy_version 21596 (0.0007) [2023-12-27 19:23:11,425][106225] Updated weights for policy 1, policy_version 21606 (0.0009) [2023-12-27 19:23:11,493][106225] Updated weights for policy 1, policy_version 21616 (0.0008) [2023-12-27 19:23:11,958][106226] Updated weights for policy 0, policy_version 21709 (0.0009) [2023-12-27 19:23:12,015][106226] Updated weights for policy 0, policy_version 21719 (0.0007) [2023-12-27 19:23:12,076][106226] Updated weights for policy 0, policy_version 21729 (0.0009) [2023-12-27 19:23:12,232][106225] Updated weights for policy 1, policy_version 21626 (0.0009) [2023-12-27 19:23:12,290][106225] Updated weights for policy 1, policy_version 21636 (0.0009) [2023-12-27 19:23:12,353][106225] Updated weights for policy 1, policy_version 21646 (0.0008) [2023-12-27 19:23:12,420][106225] Updated weights for policy 1, policy_version 21656 (0.0008) [2023-12-27 19:23:12,699][106226] Updated weights for policy 0, policy_version 21739 (0.0006) [2023-12-27 19:23:12,767][106226] Updated weights for policy 0, policy_version 21749 (0.0005) [2023-12-27 19:23:12,833][106226] Updated weights for policy 0, policy_version 21759 (0.0006) [2023-12-27 19:23:13,163][106225] Updated weights for policy 1, policy_version 21666 (0.0005) [2023-12-27 19:23:13,211][106225] Updated weights for policy 1, policy_version 21676 (0.0006) [2023-12-27 19:23:13,267][106225] Updated weights for policy 1, policy_version 21686 (0.0008) [2023-12-27 19:23:13,530][106226] Updated weights for policy 0, policy_version 21769 (0.0006) [2023-12-27 19:23:13,583][106226] Updated weights for policy 0, policy_version 21779 (0.0008) [2023-12-27 19:23:13,631][106226] Updated weights for policy 0, policy_version 21789 (0.0008) [2023-12-27 19:23:13,686][106226] Updated weights for policy 0, policy_version 21799 (0.0009) [2023-12-27 19:23:13,888][106225] Updated weights for policy 1, policy_version 21696 (0.0008) [2023-12-27 19:23:13,938][106225] Updated weights for policy 1, policy_version 21706 (0.0009) [2023-12-27 19:23:13,987][106225] Updated weights for policy 1, policy_version 21716 (0.0008) [2023-12-27 19:23:14,366][106226] Updated weights for policy 0, policy_version 21809 (0.0008) [2023-12-27 19:23:14,424][106226] Updated weights for policy 0, policy_version 21819 (0.0008) [2023-12-27 19:23:14,490][106226] Updated weights for policy 0, policy_version 21829 (0.0008) [2023-12-27 19:23:14,732][106225] Updated weights for policy 1, policy_version 21726 (0.0006) [2023-12-27 19:23:14,799][106225] Updated weights for policy 1, policy_version 21736 (0.0008) [2023-12-27 19:23:14,866][106225] Updated weights for policy 1, policy_version 21746 (0.0008) [2023-12-27 19:23:15,221][106226] Updated weights for policy 0, policy_version 21839 (0.0008) [2023-12-27 19:23:15,288][106226] Updated weights for policy 0, policy_version 21849 (0.0008) [2023-12-27 19:23:15,349][106226] Updated weights for policy 0, policy_version 21859 (0.0008) [2023-12-27 19:23:15,534][106225] Updated weights for policy 1, policy_version 21756 (0.0008) [2023-12-27 19:23:15,598][106225] Updated weights for policy 1, policy_version 21766 (0.0007) [2023-12-27 19:23:15,659][106225] Updated weights for policy 1, policy_version 21776 (0.0008) [2023-12-27 19:23:16,076][106226] Updated weights for policy 0, policy_version 21869 (0.0008) [2023-12-27 19:23:16,128][106226] Updated weights for policy 0, policy_version 21879 (0.0009) [2023-12-27 19:23:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 11182080. Throughput: 0: 9981.6, 1: 9851.0. Samples: 11177372. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-27 19:23:16,175][105115] Avg episode reward: [(0, '-5.369'), (1, '-6.281')] [2023-12-27 19:23:16,179][106226] Updated weights for policy 0, policy_version 21889 (0.0008) [2023-12-27 19:23:16,251][106225] Updated weights for policy 1, policy_version 21786 (0.0007) [2023-12-27 19:23:16,315][106225] Updated weights for policy 1, policy_version 21796 (0.0009) [2023-12-27 19:23:16,368][106225] Updated weights for policy 1, policy_version 21806 (0.0006) [2023-12-27 19:23:16,422][106225] Updated weights for policy 1, policy_version 21816 (0.0006) [2023-12-27 19:23:16,789][106226] Updated weights for policy 0, policy_version 21899 (0.0008) [2023-12-27 19:23:16,834][106226] Updated weights for policy 0, policy_version 21909 (0.0008) [2023-12-27 19:23:16,895][106226] Updated weights for policy 0, policy_version 21919 (0.0009) [2023-12-27 19:23:17,120][106225] Updated weights for policy 1, policy_version 21826 (0.0008) [2023-12-27 19:23:17,169][106225] Updated weights for policy 1, policy_version 21836 (0.0009) [2023-12-27 19:23:17,216][106225] Updated weights for policy 1, policy_version 21846 (0.0009) [2023-12-27 19:23:17,599][106226] Updated weights for policy 0, policy_version 21929 (0.0008) [2023-12-27 19:23:17,650][106226] Updated weights for policy 0, policy_version 21939 (0.0006) [2023-12-27 19:23:17,707][106226] Updated weights for policy 0, policy_version 21949 (0.0009) [2023-12-27 19:23:17,758][106226] Updated weights for policy 0, policy_version 21959 (0.0008) [2023-12-27 19:23:17,892][106225] Updated weights for policy 1, policy_version 21856 (0.0008) [2023-12-27 19:23:17,945][106225] Updated weights for policy 1, policy_version 21866 (0.0009) [2023-12-27 19:23:18,003][106225] Updated weights for policy 1, policy_version 21876 (0.0008) [2023-12-27 19:23:18,449][106226] Updated weights for policy 0, policy_version 21969 (0.0006) [2023-12-27 19:23:18,523][106226] Updated weights for policy 0, policy_version 21979 (0.0006) [2023-12-27 19:23:18,585][106226] Updated weights for policy 0, policy_version 21989 (0.0008) [2023-12-27 19:23:18,733][106225] Updated weights for policy 1, policy_version 21886 (0.0009) [2023-12-27 19:23:18,786][106225] Updated weights for policy 1, policy_version 21896 (0.0008) [2023-12-27 19:23:18,847][106225] Updated weights for policy 1, policy_version 21906 (0.0005) [2023-12-27 19:23:19,294][106226] Updated weights for policy 0, policy_version 21999 (0.0009) [2023-12-27 19:23:19,358][106226] Updated weights for policy 0, policy_version 22009 (0.0008) [2023-12-27 19:23:19,432][106226] Updated weights for policy 0, policy_version 22019 (0.0008) [2023-12-27 19:23:19,437][106225] Updated weights for policy 1, policy_version 21916 (0.0008) [2023-12-27 19:23:19,509][106225] Updated weights for policy 1, policy_version 21926 (0.0007) [2023-12-27 19:23:19,569][106225] Updated weights for policy 1, policy_version 21936 (0.0006) [2023-12-27 19:23:20,223][106225] Updated weights for policy 1, policy_version 21946 (0.0007) [2023-12-27 19:23:20,280][106226] Updated weights for policy 0, policy_version 22029 (0.0007) [2023-12-27 19:23:20,283][106225] Updated weights for policy 1, policy_version 21956 (0.0011) [2023-12-27 19:23:20,337][106225] Updated weights for policy 1, policy_version 21966 (0.0011) [2023-12-27 19:23:20,339][106226] Updated weights for policy 0, policy_version 22039 (0.0006) [2023-12-27 19:23:20,406][106226] Updated weights for policy 0, policy_version 22049 (0.0008) [2023-12-27 19:23:20,406][106225] Updated weights for policy 1, policy_version 21976 (0.0011) [2023-12-27 19:23:21,150][106226] Updated weights for policy 0, policy_version 22059 (0.0008) [2023-12-27 19:23:21,163][106225] Updated weights for policy 1, policy_version 21986 (0.0011) [2023-12-27 19:23:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 11280384. Throughput: 0: 9967.9, 1: 9880.2. Samples: 11296700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 19:23:21,175][105115] Avg episode reward: [(0, '-5.244'), (1, '-7.245')] [2023-12-27 19:23:21,215][106226] Updated weights for policy 0, policy_version 22069 (0.0006) [2023-12-27 19:23:21,225][106225] Updated weights for policy 1, policy_version 21996 (0.0011) [2023-12-27 19:23:21,284][106226] Updated weights for policy 0, policy_version 22079 (0.0008) [2023-12-27 19:23:21,301][106225] Updated weights for policy 1, policy_version 22006 (0.0010) [2023-12-27 19:23:22,006][106226] Updated weights for policy 0, policy_version 22089 (0.0006) [2023-12-27 19:23:22,054][106225] Updated weights for policy 1, policy_version 22016 (0.0007) [2023-12-27 19:23:22,062][106226] Updated weights for policy 0, policy_version 22099 (0.0011) [2023-12-27 19:23:22,112][106225] Updated weights for policy 1, policy_version 22026 (0.0006) [2023-12-27 19:23:22,115][106226] Updated weights for policy 0, policy_version 22109 (0.0011) [2023-12-27 19:23:22,161][106225] Updated weights for policy 1, policy_version 22036 (0.0005) [2023-12-27 19:23:22,163][106226] Updated weights for policy 0, policy_version 22119 (0.0011) [2023-12-27 19:23:22,878][106225] Updated weights for policy 1, policy_version 22046 (0.0006) [2023-12-27 19:23:22,939][106225] Updated weights for policy 1, policy_version 22056 (0.0005) [2023-12-27 19:23:22,944][106226] Updated weights for policy 0, policy_version 22129 (0.0009) [2023-12-27 19:23:22,994][106226] Updated weights for policy 0, policy_version 22139 (0.0007) [2023-12-27 19:23:22,999][106225] Updated weights for policy 1, policy_version 22066 (0.0007) [2023-12-27 19:23:23,043][106226] Updated weights for policy 0, policy_version 22149 (0.0006) [2023-12-27 19:23:23,716][106226] Updated weights for policy 0, policy_version 22159 (0.0008) [2023-12-27 19:23:23,722][106225] Updated weights for policy 1, policy_version 22076 (0.0007) [2023-12-27 19:23:23,777][106226] Updated weights for policy 0, policy_version 22169 (0.0007) [2023-12-27 19:23:23,783][106225] Updated weights for policy 1, policy_version 22086 (0.0007) [2023-12-27 19:23:23,835][106226] Updated weights for policy 0, policy_version 22179 (0.0007) [2023-12-27 19:23:23,846][106225] Updated weights for policy 1, policy_version 22096 (0.0007) [2023-12-27 19:23:24,533][106226] Updated weights for policy 0, policy_version 22189 (0.0008) [2023-12-27 19:23:24,564][106225] Updated weights for policy 1, policy_version 22106 (0.0007) [2023-12-27 19:23:24,586][106226] Updated weights for policy 0, policy_version 22199 (0.0007) [2023-12-27 19:23:24,626][106225] Updated weights for policy 1, policy_version 22116 (0.0009) [2023-12-27 19:23:24,643][106226] Updated weights for policy 0, policy_version 22209 (0.0006) [2023-12-27 19:23:24,690][106225] Updated weights for policy 1, policy_version 22126 (0.0008) [2023-12-27 19:23:24,741][106225] Updated weights for policy 1, policy_version 22136 (0.0008) [2023-12-27 19:23:25,353][106226] Updated weights for policy 0, policy_version 22219 (0.0007) [2023-12-27 19:23:25,410][106226] Updated weights for policy 0, policy_version 22229 (0.0008) [2023-12-27 19:23:25,462][106225] Updated weights for policy 1, policy_version 22146 (0.0007) [2023-12-27 19:23:25,472][106226] Updated weights for policy 0, policy_version 22239 (0.0007) [2023-12-27 19:23:25,517][106225] Updated weights for policy 1, policy_version 22156 (0.0006) [2023-12-27 19:23:25,579][106225] Updated weights for policy 1, policy_version 22166 (0.0009) [2023-12-27 19:23:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 11378688. Throughput: 0: 9965.7, 1: 9797.9. Samples: 11354300. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 19:23:26,175][105115] Avg episode reward: [(0, '-5.685'), (1, '-7.072')] [2023-12-27 19:23:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000022248_5701632.pth... [2023-12-27 19:23:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000021096_5406720.pth [2023-12-27 19:23:26,231][106225] Updated weights for policy 1, policy_version 22176 (0.0009) [2023-12-27 19:23:26,233][106226] Updated weights for policy 0, policy_version 22249 (0.0007) [2023-12-27 19:23:26,282][106225] Updated weights for policy 1, policy_version 22186 (0.0007) [2023-12-27 19:23:26,292][106226] Updated weights for policy 0, policy_version 22259 (0.0008) [2023-12-27 19:23:26,333][106225] Updated weights for policy 1, policy_version 22196 (0.0006) [2023-12-27 19:23:26,351][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000022200_5685248.pth... [2023-12-27 19:23:26,354][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000021016_5382144.pth [2023-12-27 19:23:26,354][106226] Updated weights for policy 0, policy_version 22269 (0.0008) [2023-12-27 19:23:26,416][106226] Updated weights for policy 0, policy_version 22279 (0.0009) [2023-12-27 19:23:27,041][106226] Updated weights for policy 0, policy_version 22289 (0.0008) [2023-12-27 19:23:27,094][106225] Updated weights for policy 1, policy_version 22206 (0.0006) [2023-12-27 19:23:27,100][106226] Updated weights for policy 0, policy_version 22299 (0.0007) [2023-12-27 19:23:27,151][106225] Updated weights for policy 1, policy_version 22216 (0.0008) [2023-12-27 19:23:27,160][106226] Updated weights for policy 0, policy_version 22309 (0.0006) [2023-12-27 19:23:27,212][106225] Updated weights for policy 1, policy_version 22226 (0.0007) [2023-12-27 19:23:27,747][106226] Updated weights for policy 0, policy_version 22319 (0.0005) [2023-12-27 19:23:27,809][106226] Updated weights for policy 0, policy_version 22329 (0.0005) [2023-12-27 19:23:27,872][106226] Updated weights for policy 0, policy_version 22339 (0.0007) [2023-12-27 19:23:27,903][106225] Updated weights for policy 1, policy_version 22236 (0.0008) [2023-12-27 19:23:27,957][106225] Updated weights for policy 1, policy_version 22246 (0.0008) [2023-12-27 19:23:28,004][106225] Updated weights for policy 1, policy_version 22256 (0.0008) [2023-12-27 19:23:28,535][106226] Updated weights for policy 0, policy_version 22349 (0.0006) [2023-12-27 19:23:28,593][106226] Updated weights for policy 0, policy_version 22359 (0.0007) [2023-12-27 19:23:28,660][106226] Updated weights for policy 0, policy_version 22369 (0.0008) [2023-12-27 19:23:28,685][106225] Updated weights for policy 1, policy_version 22266 (0.0008) [2023-12-27 19:23:28,734][106225] Updated weights for policy 1, policy_version 22276 (0.0009) [2023-12-27 19:23:28,785][106225] Updated weights for policy 1, policy_version 22286 (0.0005) [2023-12-27 19:23:28,836][106225] Updated weights for policy 1, policy_version 22296 (0.0005) [2023-12-27 19:23:29,336][106226] Updated weights for policy 0, policy_version 22379 (0.0007) [2023-12-27 19:23:29,403][106226] Updated weights for policy 0, policy_version 22389 (0.0007) [2023-12-27 19:23:29,455][106226] Updated weights for policy 0, policy_version 22399 (0.0008) [2023-12-27 19:23:29,555][106225] Updated weights for policy 1, policy_version 22306 (0.0008) [2023-12-27 19:23:29,610][106225] Updated weights for policy 1, policy_version 22316 (0.0009) [2023-12-27 19:23:29,664][106225] Updated weights for policy 1, policy_version 22326 (0.0008) [2023-12-27 19:23:30,221][106226] Updated weights for policy 0, policy_version 22409 (0.0009) [2023-12-27 19:23:30,271][106226] Updated weights for policy 0, policy_version 22419 (0.0008) [2023-12-27 19:23:30,322][106226] Updated weights for policy 0, policy_version 22429 (0.0008) [2023-12-27 19:23:30,342][106225] Updated weights for policy 1, policy_version 22336 (0.0009) [2023-12-27 19:23:30,382][106226] Updated weights for policy 0, policy_version 22439 (0.0007) [2023-12-27 19:23:30,400][106225] Updated weights for policy 1, policy_version 22346 (0.0006) [2023-12-27 19:23:30,463][106225] Updated weights for policy 1, policy_version 22356 (0.0008) [2023-12-27 19:23:31,100][106225] Updated weights for policy 1, policy_version 22366 (0.0009) [2023-12-27 19:23:31,136][106226] Updated weights for policy 0, policy_version 22449 (0.0007) [2023-12-27 19:23:31,165][106225] Updated weights for policy 1, policy_version 22376 (0.0008) [2023-12-27 19:23:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 11476992. Throughput: 0: 9970.5, 1: 9864.3. Samples: 11473704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 19:23:31,175][105115] Avg episode reward: [(0, '-5.195'), (1, '-6.620')] [2023-12-27 19:23:31,200][106226] Updated weights for policy 0, policy_version 22459 (0.0009) [2023-12-27 19:23:31,222][106225] Updated weights for policy 1, policy_version 22386 (0.0007) [2023-12-27 19:23:31,259][106226] Updated weights for policy 0, policy_version 22469 (0.0009) [2023-12-27 19:23:31,903][106226] Updated weights for policy 0, policy_version 22479 (0.0007) [2023-12-27 19:23:31,961][106226] Updated weights for policy 0, policy_version 22489 (0.0006) [2023-12-27 19:23:32,022][106225] Updated weights for policy 1, policy_version 22396 (0.0007) [2023-12-27 19:23:32,025][106226] Updated weights for policy 0, policy_version 22499 (0.0007) [2023-12-27 19:23:32,086][106225] Updated weights for policy 1, policy_version 22406 (0.0008) [2023-12-27 19:23:32,136][106225] Updated weights for policy 1, policy_version 22416 (0.0009) [2023-12-27 19:23:32,662][106226] Updated weights for policy 0, policy_version 22509 (0.0006) [2023-12-27 19:23:32,723][106226] Updated weights for policy 0, policy_version 22519 (0.0005) [2023-12-27 19:23:32,794][106226] Updated weights for policy 0, policy_version 22529 (0.0005) [2023-12-27 19:23:32,852][106225] Updated weights for policy 1, policy_version 22426 (0.0009) [2023-12-27 19:23:32,905][106225] Updated weights for policy 1, policy_version 22436 (0.0010) [2023-12-27 19:23:32,964][106225] Updated weights for policy 1, policy_version 22446 (0.0010) [2023-12-27 19:23:33,020][106225] Updated weights for policy 1, policy_version 22456 (0.0010) [2023-12-27 19:23:33,450][106226] Updated weights for policy 0, policy_version 22539 (0.0006) [2023-12-27 19:23:33,504][106226] Updated weights for policy 0, policy_version 22549 (0.0009) [2023-12-27 19:23:33,564][106226] Updated weights for policy 0, policy_version 22559 (0.0009) [2023-12-27 19:23:33,617][106225] Updated weights for policy 1, policy_version 22466 (0.0006) [2023-12-27 19:23:33,672][106225] Updated weights for policy 1, policy_version 22476 (0.0010) [2023-12-27 19:23:33,729][106225] Updated weights for policy 1, policy_version 22486 (0.0010) [2023-12-27 19:23:34,260][106226] Updated weights for policy 0, policy_version 22569 (0.0008) [2023-12-27 19:23:34,311][106226] Updated weights for policy 0, policy_version 22579 (0.0008) [2023-12-27 19:23:34,366][106226] Updated weights for policy 0, policy_version 22589 (0.0005) [2023-12-27 19:23:34,416][106226] Updated weights for policy 0, policy_version 22599 (0.0005) [2023-12-27 19:23:34,432][106225] Updated weights for policy 1, policy_version 22496 (0.0009) [2023-12-27 19:23:34,486][106225] Updated weights for policy 1, policy_version 22506 (0.0008) [2023-12-27 19:23:34,541][106225] Updated weights for policy 1, policy_version 22516 (0.0007) [2023-12-27 19:23:35,078][106226] Updated weights for policy 0, policy_version 22609 (0.0005) [2023-12-27 19:23:35,131][106226] Updated weights for policy 0, policy_version 22619 (0.0005) [2023-12-27 19:23:35,179][106225] Updated weights for policy 1, policy_version 22526 (0.0007) [2023-12-27 19:23:35,183][106226] Updated weights for policy 0, policy_version 22629 (0.0006) [2023-12-27 19:23:35,244][106225] Updated weights for policy 1, policy_version 22536 (0.0005) [2023-12-27 19:23:35,306][106225] Updated weights for policy 1, policy_version 22546 (0.0007) [2023-12-27 19:23:35,777][106226] Updated weights for policy 0, policy_version 22639 (0.0006) [2023-12-27 19:23:35,832][106226] Updated weights for policy 0, policy_version 22649 (0.0005) [2023-12-27 19:23:35,892][106226] Updated weights for policy 0, policy_version 22659 (0.0006) [2023-12-27 19:23:35,926][106225] Updated weights for policy 1, policy_version 22556 (0.0008) [2023-12-27 19:23:35,993][106225] Updated weights for policy 1, policy_version 22566 (0.0008) [2023-12-27 19:23:36,061][106225] Updated weights for policy 1, policy_version 22576 (0.0010) [2023-12-27 19:23:36,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 11591680. Throughput: 0: 9989.4, 1: 9983.2. Samples: 11597544. Policy #0 lag: (min: 9.0, avg: 35.8, max: 41.0) [2023-12-27 19:23:36,175][105115] Avg episode reward: [(0, '-5.912'), (1, '-6.893')] [2023-12-27 19:23:36,563][106226] Updated weights for policy 0, policy_version 22669 (0.0008) [2023-12-27 19:23:36,622][106226] Updated weights for policy 0, policy_version 22679 (0.0008) [2023-12-27 19:23:36,676][106226] Updated weights for policy 0, policy_version 22689 (0.0008) [2023-12-27 19:23:36,750][106225] Updated weights for policy 1, policy_version 22586 (0.0010) [2023-12-27 19:23:36,798][106225] Updated weights for policy 1, policy_version 22596 (0.0007) [2023-12-27 19:23:36,861][106225] Updated weights for policy 1, policy_version 22606 (0.0005) [2023-12-27 19:23:36,910][106225] Updated weights for policy 1, policy_version 22616 (0.0005) [2023-12-27 19:23:37,450][106226] Updated weights for policy 0, policy_version 22699 (0.0008) [2023-12-27 19:23:37,511][106226] Updated weights for policy 0, policy_version 22709 (0.0006) [2023-12-27 19:23:37,570][106226] Updated weights for policy 0, policy_version 22719 (0.0006) [2023-12-27 19:23:37,576][106225] Updated weights for policy 1, policy_version 22626 (0.0008) [2023-12-27 19:23:37,635][106225] Updated weights for policy 1, policy_version 22636 (0.0007) [2023-12-27 19:23:37,695][106225] Updated weights for policy 1, policy_version 22646 (0.0008) [2023-12-27 19:23:38,249][106226] Updated weights for policy 0, policy_version 22729 (0.0008) [2023-12-27 19:23:38,309][106226] Updated weights for policy 0, policy_version 22739 (0.0010) [2023-12-27 19:23:38,378][106226] Updated weights for policy 0, policy_version 22749 (0.0008) [2023-12-27 19:23:38,408][106225] Updated weights for policy 1, policy_version 22656 (0.0007) [2023-12-27 19:23:38,440][106226] Updated weights for policy 0, policy_version 22759 (0.0008) [2023-12-27 19:23:38,467][106225] Updated weights for policy 1, policy_version 22666 (0.0007) [2023-12-27 19:23:38,524][106225] Updated weights for policy 1, policy_version 22676 (0.0005) [2023-12-27 19:23:39,124][106225] Updated weights for policy 1, policy_version 22686 (0.0007) [2023-12-27 19:23:39,179][106225] Updated weights for policy 1, policy_version 22696 (0.0006) [2023-12-27 19:23:39,209][106226] Updated weights for policy 0, policy_version 22769 (0.0010) [2023-12-27 19:23:39,241][106225] Updated weights for policy 1, policy_version 22706 (0.0006) [2023-12-27 19:23:39,279][106226] Updated weights for policy 0, policy_version 22779 (0.0009) [2023-12-27 19:23:39,346][106226] Updated weights for policy 0, policy_version 22789 (0.0009) [2023-12-27 19:23:39,939][106225] Updated weights for policy 1, policy_version 22716 (0.0007) [2023-12-27 19:23:39,999][106225] Updated weights for policy 1, policy_version 22726 (0.0009) [2023-12-27 19:23:40,059][106225] Updated weights for policy 1, policy_version 22736 (0.0009) [2023-12-27 19:23:40,160][106226] Updated weights for policy 0, policy_version 22799 (0.0007) [2023-12-27 19:23:40,222][106226] Updated weights for policy 0, policy_version 22809 (0.0008) [2023-12-27 19:23:40,296][106226] Updated weights for policy 0, policy_version 22819 (0.0008) [2023-12-27 19:23:40,854][106225] Updated weights for policy 1, policy_version 22746 (0.0009) [2023-12-27 19:23:40,915][106225] Updated weights for policy 1, policy_version 22756 (0.0008) [2023-12-27 19:23:40,939][106226] Updated weights for policy 0, policy_version 22829 (0.0009) [2023-12-27 19:23:40,965][106225] Updated weights for policy 1, policy_version 22766 (0.0008) [2023-12-27 19:23:40,992][106226] Updated weights for policy 0, policy_version 22839 (0.0009) [2023-12-27 19:23:41,019][106225] Updated weights for policy 1, policy_version 22776 (0.0007) [2023-12-27 19:23:41,055][106226] Updated weights for policy 0, policy_version 22849 (0.0008) [2023-12-27 19:23:41,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 11689984. Throughput: 0: 9975.8, 1: 9936.4. Samples: 11656112. Policy #0 lag: (min: 9.0, avg: 35.8, max: 41.0) [2023-12-27 19:23:41,175][105115] Avg episode reward: [(0, '-4.824'), (1, '-6.896')] [2023-12-27 19:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000022856_5857280.pth... [2023-12-27 19:23:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000022776_5832704.pth... [2023-12-27 19:23:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000021704_5562368.pth [2023-12-27 19:23:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000021592_5529600.pth [2023-12-27 19:23:41,188][106140] Saving new best policy, reward=-4.824! [2023-12-27 19:23:41,879][106225] Updated weights for policy 1, policy_version 22786 (0.0008) [2023-12-27 19:23:41,893][106226] Updated weights for policy 0, policy_version 22859 (0.0009) [2023-12-27 19:23:41,937][106225] Updated weights for policy 1, policy_version 22796 (0.0006) [2023-12-27 19:23:41,954][106226] Updated weights for policy 0, policy_version 22869 (0.0011) [2023-12-27 19:23:41,997][106225] Updated weights for policy 1, policy_version 22806 (0.0009) [2023-12-27 19:23:42,016][106226] Updated weights for policy 0, policy_version 22879 (0.0011) [2023-12-27 19:23:42,722][106226] Updated weights for policy 0, policy_version 22889 (0.0010) [2023-12-27 19:23:42,743][106225] Updated weights for policy 1, policy_version 22816 (0.0008) [2023-12-27 19:23:42,786][106226] Updated weights for policy 0, policy_version 22899 (0.0007) [2023-12-27 19:23:42,800][106225] Updated weights for policy 1, policy_version 22826 (0.0007) [2023-12-27 19:23:42,842][106226] Updated weights for policy 0, policy_version 22909 (0.0006) [2023-12-27 19:23:42,861][106225] Updated weights for policy 1, policy_version 22836 (0.0006) [2023-12-27 19:23:42,909][106226] Updated weights for policy 0, policy_version 22919 (0.0008) [2023-12-27 19:23:43,454][106226] Updated weights for policy 0, policy_version 22929 (0.0005) [2023-12-27 19:23:43,512][106226] Updated weights for policy 0, policy_version 22939 (0.0005) [2023-12-27 19:23:43,570][106226] Updated weights for policy 0, policy_version 22949 (0.0006) [2023-12-27 19:23:43,686][106225] Updated weights for policy 1, policy_version 22846 (0.0010) [2023-12-27 19:23:43,746][106225] Updated weights for policy 1, policy_version 22856 (0.0009) [2023-12-27 19:23:43,794][106225] Updated weights for policy 1, policy_version 22866 (0.0008) [2023-12-27 19:23:44,141][106226] Updated weights for policy 0, policy_version 22959 (0.0008) [2023-12-27 19:23:44,200][106226] Updated weights for policy 0, policy_version 22969 (0.0009) [2023-12-27 19:23:44,261][106226] Updated weights for policy 0, policy_version 22979 (0.0008) [2023-12-27 19:23:44,554][106225] Updated weights for policy 1, policy_version 22876 (0.0008) [2023-12-27 19:23:44,607][106225] Updated weights for policy 1, policy_version 22886 (0.0009) [2023-12-27 19:23:44,656][106225] Updated weights for policy 1, policy_version 22896 (0.0008) [2023-12-27 19:23:44,993][106226] Updated weights for policy 0, policy_version 22989 (0.0009) [2023-12-27 19:23:45,055][106226] Updated weights for policy 0, policy_version 22999 (0.0009) [2023-12-27 19:23:45,119][106226] Updated weights for policy 0, policy_version 23009 (0.0008) [2023-12-27 19:23:45,433][106225] Updated weights for policy 1, policy_version 22906 (0.0009) [2023-12-27 19:23:45,493][106225] Updated weights for policy 1, policy_version 22916 (0.0010) [2023-12-27 19:23:45,557][106225] Updated weights for policy 1, policy_version 22926 (0.0010) [2023-12-27 19:23:45,620][106225] Updated weights for policy 1, policy_version 22936 (0.0010) [2023-12-27 19:23:45,773][106226] Updated weights for policy 0, policy_version 23019 (0.0007) [2023-12-27 19:23:45,835][106226] Updated weights for policy 0, policy_version 23029 (0.0006) [2023-12-27 19:23:45,885][106226] Updated weights for policy 0, policy_version 23039 (0.0008) [2023-12-27 19:23:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 11780096. Throughput: 0: 10010.1, 1: 9897.0. Samples: 11770636. Policy #0 lag: (min: 9.0, avg: 35.8, max: 41.0) [2023-12-27 19:23:46,176][105115] Avg episode reward: [(0, '-5.658'), (1, '-6.331')] [2023-12-27 19:23:46,341][106225] Updated weights for policy 1, policy_version 22946 (0.0010) [2023-12-27 19:23:46,404][106225] Updated weights for policy 1, policy_version 22956 (0.0010) [2023-12-27 19:23:46,455][106226] Updated weights for policy 0, policy_version 23049 (0.0007) [2023-12-27 19:23:46,472][106225] Updated weights for policy 1, policy_version 22966 (0.0011) [2023-12-27 19:23:46,515][106226] Updated weights for policy 0, policy_version 23059 (0.0007) [2023-12-27 19:23:46,573][106226] Updated weights for policy 0, policy_version 23069 (0.0008) [2023-12-27 19:23:46,627][106226] Updated weights for policy 0, policy_version 23079 (0.0008) [2023-12-27 19:23:47,067][106225] Updated weights for policy 1, policy_version 22976 (0.0010) [2023-12-27 19:23:47,123][106225] Updated weights for policy 1, policy_version 22986 (0.0010) [2023-12-27 19:23:47,176][106225] Updated weights for policy 1, policy_version 22996 (0.0010) [2023-12-27 19:23:47,408][106226] Updated weights for policy 0, policy_version 23089 (0.0008) [2023-12-27 19:23:47,472][106226] Updated weights for policy 0, policy_version 23099 (0.0007) [2023-12-27 19:23:47,536][106226] Updated weights for policy 0, policy_version 23109 (0.0005) [2023-12-27 19:23:47,863][106225] Updated weights for policy 1, policy_version 23006 (0.0009) [2023-12-27 19:23:47,922][106225] Updated weights for policy 1, policy_version 23016 (0.0007) [2023-12-27 19:23:47,979][106225] Updated weights for policy 1, policy_version 23026 (0.0008) [2023-12-27 19:23:48,158][106226] Updated weights for policy 0, policy_version 23119 (0.0008) [2023-12-27 19:23:48,207][106226] Updated weights for policy 0, policy_version 23129 (0.0008) [2023-12-27 19:23:48,267][106226] Updated weights for policy 0, policy_version 23139 (0.0009) [2023-12-27 19:23:48,656][106225] Updated weights for policy 1, policy_version 23036 (0.0007) [2023-12-27 19:23:48,716][106225] Updated weights for policy 1, policy_version 23046 (0.0006) [2023-12-27 19:23:48,768][106225] Updated weights for policy 1, policy_version 23056 (0.0006) [2023-12-27 19:23:49,066][106226] Updated weights for policy 0, policy_version 23149 (0.0008) [2023-12-27 19:23:49,124][106226] Updated weights for policy 0, policy_version 23159 (0.0008) [2023-12-27 19:23:49,180][106226] Updated weights for policy 0, policy_version 23169 (0.0009) [2023-12-27 19:23:49,370][106225] Updated weights for policy 1, policy_version 23066 (0.0008) [2023-12-27 19:23:49,426][106225] Updated weights for policy 1, policy_version 23076 (0.0008) [2023-12-27 19:23:49,476][106225] Updated weights for policy 1, policy_version 23086 (0.0008) [2023-12-27 19:23:49,532][106225] Updated weights for policy 1, policy_version 23096 (0.0008) [2023-12-27 19:23:49,959][106226] Updated weights for policy 0, policy_version 23179 (0.0008) [2023-12-27 19:23:50,031][106226] Updated weights for policy 0, policy_version 23189 (0.0007) [2023-12-27 19:23:50,100][106226] Updated weights for policy 0, policy_version 23199 (0.0009) [2023-12-27 19:23:50,282][106225] Updated weights for policy 1, policy_version 23106 (0.0006) [2023-12-27 19:23:50,340][106225] Updated weights for policy 1, policy_version 23116 (0.0006) [2023-12-27 19:23:50,401][106225] Updated weights for policy 1, policy_version 23126 (0.0007) [2023-12-27 19:23:50,782][106226] Updated weights for policy 0, policy_version 23209 (0.0009) [2023-12-27 19:23:50,849][106226] Updated weights for policy 0, policy_version 23219 (0.0009) [2023-12-27 19:23:50,901][106226] Updated weights for policy 0, policy_version 23229 (0.0008) [2023-12-27 19:23:50,961][106226] Updated weights for policy 0, policy_version 23239 (0.0009) [2023-12-27 19:23:51,001][106225] Updated weights for policy 1, policy_version 23136 (0.0007) [2023-12-27 19:23:51,067][106225] Updated weights for policy 1, policy_version 23146 (0.0008) [2023-12-27 19:23:51,124][106225] Updated weights for policy 1, policy_version 23156 (0.0008) [2023-12-27 19:23:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 11886592. Throughput: 0: 9882.8, 1: 9880.7. Samples: 11890616. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-27 19:23:51,175][105115] Avg episode reward: [(0, '-5.564'), (1, '-6.661')] [2023-12-27 19:23:51,819][106226] Updated weights for policy 0, policy_version 23249 (0.0006) [2023-12-27 19:23:51,846][106225] Updated weights for policy 1, policy_version 23166 (0.0008) [2023-12-27 19:23:51,875][106226] Updated weights for policy 0, policy_version 23259 (0.0007) [2023-12-27 19:23:51,909][106225] Updated weights for policy 1, policy_version 23176 (0.0006) [2023-12-27 19:23:51,945][106226] Updated weights for policy 0, policy_version 23269 (0.0009) [2023-12-27 19:23:51,972][106225] Updated weights for policy 1, policy_version 23186 (0.0006) [2023-12-27 19:23:52,582][106226] Updated weights for policy 0, policy_version 23279 (0.0007) [2023-12-27 19:23:52,642][106226] Updated weights for policy 0, policy_version 23289 (0.0006) [2023-12-27 19:23:52,711][106226] Updated weights for policy 0, policy_version 23299 (0.0007) [2023-12-27 19:23:52,764][106225] Updated weights for policy 1, policy_version 23196 (0.0008) [2023-12-27 19:23:52,812][106225] Updated weights for policy 1, policy_version 23206 (0.0008) [2023-12-27 19:23:52,859][106225] Updated weights for policy 1, policy_version 23216 (0.0007) [2023-12-27 19:23:53,261][106226] Updated weights for policy 0, policy_version 23309 (0.0007) [2023-12-27 19:23:53,331][106226] Updated weights for policy 0, policy_version 23319 (0.0009) [2023-12-27 19:23:53,394][106226] Updated weights for policy 0, policy_version 23329 (0.0010) [2023-12-27 19:23:53,482][106225] Updated weights for policy 1, policy_version 23226 (0.0007) [2023-12-27 19:23:53,535][106225] Updated weights for policy 1, policy_version 23236 (0.0005) [2023-12-27 19:23:53,597][106225] Updated weights for policy 1, policy_version 23246 (0.0005) [2023-12-27 19:23:53,652][106225] Updated weights for policy 1, policy_version 23256 (0.0007) [2023-12-27 19:23:54,039][106226] Updated weights for policy 0, policy_version 23340 (0.0008) [2023-12-27 19:23:54,088][106226] Updated weights for policy 0, policy_version 23350 (0.0005) [2023-12-27 19:23:54,137][106226] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-12-27 19:23:54,366][106225] Updated weights for policy 1, policy_version 23266 (0.0008) [2023-12-27 19:23:54,429][106225] Updated weights for policy 1, policy_version 23276 (0.0009) [2023-12-27 19:23:54,487][106225] Updated weights for policy 1, policy_version 23286 (0.0007) [2023-12-27 19:23:54,843][106226] Updated weights for policy 0, policy_version 23370 (0.0007) [2023-12-27 19:23:54,893][106226] Updated weights for policy 0, policy_version 23380 (0.0009) [2023-12-27 19:23:54,942][106226] Updated weights for policy 0, policy_version 23390 (0.0008) [2023-12-27 19:23:54,996][106226] Updated weights for policy 0, policy_version 23400 (0.0007) [2023-12-27 19:23:55,082][106225] Updated weights for policy 1, policy_version 23296 (0.0009) [2023-12-27 19:23:55,131][106225] Updated weights for policy 1, policy_version 23306 (0.0008) [2023-12-27 19:23:55,181][106225] Updated weights for policy 1, policy_version 23316 (0.0009) [2023-12-27 19:23:55,653][106226] Updated weights for policy 0, policy_version 23410 (0.0009) [2023-12-27 19:23:55,709][106226] Updated weights for policy 0, policy_version 23420 (0.0008) [2023-12-27 19:23:55,760][106226] Updated weights for policy 0, policy_version 23430 (0.0008) [2023-12-27 19:23:55,930][106225] Updated weights for policy 1, policy_version 23326 (0.0009) [2023-12-27 19:23:55,986][106225] Updated weights for policy 1, policy_version 23336 (0.0007) [2023-12-27 19:23:56,038][106225] Updated weights for policy 1, policy_version 23346 (0.0007) [2023-12-27 19:23:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 11984896. Throughput: 0: 9928.2, 1: 9893.9. Samples: 11951548. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-27 19:23:56,175][105115] Avg episode reward: [(0, '-5.564'), (1, '-6.566')] [2023-12-27 19:23:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000023352_5980160.pth... [2023-12-27 19:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000023432_6004736.pth... [2023-12-27 19:23:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000022200_5685248.pth [2023-12-27 19:23:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000022248_5701632.pth [2023-12-27 19:23:56,482][106226] Updated weights for policy 0, policy_version 23440 (0.0006) [2023-12-27 19:23:56,532][106226] Updated weights for policy 0, policy_version 23450 (0.0005) [2023-12-27 19:23:56,594][106226] Updated weights for policy 0, policy_version 23460 (0.0009) [2023-12-27 19:23:56,777][106225] Updated weights for policy 1, policy_version 23356 (0.0007) [2023-12-27 19:23:56,835][106225] Updated weights for policy 1, policy_version 23366 (0.0005) [2023-12-27 19:23:56,883][106225] Updated weights for policy 1, policy_version 23376 (0.0006) [2023-12-27 19:23:57,316][106226] Updated weights for policy 0, policy_version 23470 (0.0009) [2023-12-27 19:23:57,370][106226] Updated weights for policy 0, policy_version 23480 (0.0010) [2023-12-27 19:23:57,428][106226] Updated weights for policy 0, policy_version 23490 (0.0007) [2023-12-27 19:23:57,476][106225] Updated weights for policy 1, policy_version 23386 (0.0005) [2023-12-27 19:23:57,523][106225] Updated weights for policy 1, policy_version 23396 (0.0008) [2023-12-27 19:23:57,573][106225] Updated weights for policy 1, policy_version 23407 (0.0008) [2023-12-27 19:23:58,151][106226] Updated weights for policy 0, policy_version 23500 (0.0008) [2023-12-27 19:23:58,215][106226] Updated weights for policy 0, policy_version 23510 (0.0008) [2023-12-27 19:23:58,279][106226] Updated weights for policy 0, policy_version 23520 (0.0008) [2023-12-27 19:23:58,309][106225] Updated weights for policy 1, policy_version 23418 (0.0010) [2023-12-27 19:23:58,384][106225] Updated weights for policy 1, policy_version 23428 (0.0008) [2023-12-27 19:23:58,446][106225] Updated weights for policy 1, policy_version 23438 (0.0008) [2023-12-27 19:23:58,514][106225] Updated weights for policy 1, policy_version 23448 (0.0007) [2023-12-27 19:23:59,049][106226] Updated weights for policy 0, policy_version 23530 (0.0008) [2023-12-27 19:23:59,113][106226] Updated weights for policy 0, policy_version 23540 (0.0008) [2023-12-27 19:23:59,158][106226] Updated weights for policy 0, policy_version 23550 (0.0008) [2023-12-27 19:23:59,219][106226] Updated weights for policy 0, policy_version 23560 (0.0009) [2023-12-27 19:23:59,317][106225] Updated weights for policy 1, policy_version 23458 (0.0007) [2023-12-27 19:23:59,383][106225] Updated weights for policy 1, policy_version 23468 (0.0008) [2023-12-27 19:23:59,444][106225] Updated weights for policy 1, policy_version 23478 (0.0009) [2023-12-27 19:24:00,003][106226] Updated weights for policy 0, policy_version 23570 (0.0010) [2023-12-27 19:24:00,071][106226] Updated weights for policy 0, policy_version 23580 (0.0007) [2023-12-27 19:24:00,136][106226] Updated weights for policy 0, policy_version 23590 (0.0008) [2023-12-27 19:24:00,144][106225] Updated weights for policy 1, policy_version 23488 (0.0006) [2023-12-27 19:24:00,199][106225] Updated weights for policy 1, policy_version 23498 (0.0005) [2023-12-27 19:24:00,253][106225] Updated weights for policy 1, policy_version 23508 (0.0006) [2023-12-27 19:24:00,854][106225] Updated weights for policy 1, policy_version 23518 (0.0008) [2023-12-27 19:24:00,907][106226] Updated weights for policy 0, policy_version 23600 (0.0008) [2023-12-27 19:24:00,910][106225] Updated weights for policy 1, policy_version 23528 (0.0007) [2023-12-27 19:24:00,966][106226] Updated weights for policy 0, policy_version 23610 (0.0010) [2023-12-27 19:24:00,973][106225] Updated weights for policy 1, policy_version 23538 (0.0005) [2023-12-27 19:24:01,022][106226] Updated weights for policy 0, policy_version 23620 (0.0010) [2023-12-27 19:24:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 12083200. Throughput: 0: 9871.5, 1: 9908.7. Samples: 12067480. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-27 19:24:01,175][105115] Avg episode reward: [(0, '-5.763'), (1, '-6.626')] [2023-12-27 19:24:01,561][106225] Updated weights for policy 1, policy_version 23548 (0.0008) [2023-12-27 19:24:01,629][106225] Updated weights for policy 1, policy_version 23558 (0.0014) [2023-12-27 19:24:01,693][106225] Updated weights for policy 1, policy_version 23568 (0.0009) [2023-12-27 19:24:01,753][106226] Updated weights for policy 0, policy_version 23630 (0.0009) [2023-12-27 19:24:01,816][106226] Updated weights for policy 0, policy_version 23640 (0.0010) [2023-12-27 19:24:01,878][106226] Updated weights for policy 0, policy_version 23650 (0.0010) [2023-12-27 19:24:02,419][106225] Updated weights for policy 1, policy_version 23578 (0.0010) [2023-12-27 19:24:02,471][106225] Updated weights for policy 1, policy_version 23588 (0.0006) [2023-12-27 19:24:02,533][106225] Updated weights for policy 1, policy_version 23598 (0.0008) [2023-12-27 19:24:02,597][106225] Updated weights for policy 1, policy_version 23608 (0.0009) [2023-12-27 19:24:02,604][106226] Updated weights for policy 0, policy_version 23660 (0.0010) [2023-12-27 19:24:02,666][106226] Updated weights for policy 0, policy_version 23670 (0.0010) [2023-12-27 19:24:02,723][106226] Updated weights for policy 0, policy_version 23680 (0.0010) [2023-12-27 19:24:03,272][106225] Updated weights for policy 1, policy_version 23618 (0.0005) [2023-12-27 19:24:03,345][106225] Updated weights for policy 1, policy_version 23628 (0.0010) [2023-12-27 19:24:03,346][106226] Updated weights for policy 0, policy_version 23690 (0.0010) [2023-12-27 19:24:03,398][106226] Updated weights for policy 0, policy_version 23700 (0.0006) [2023-12-27 19:24:03,404][106225] Updated weights for policy 1, policy_version 23638 (0.0010) [2023-12-27 19:24:03,454][106226] Updated weights for policy 0, policy_version 23710 (0.0005) [2023-12-27 19:24:03,506][106226] Updated weights for policy 0, policy_version 23720 (0.0005) [2023-12-27 19:24:04,085][106225] Updated weights for policy 1, policy_version 23648 (0.0008) [2023-12-27 19:24:04,126][106226] Updated weights for policy 0, policy_version 23730 (0.0006) [2023-12-27 19:24:04,145][106225] Updated weights for policy 1, policy_version 23658 (0.0008) [2023-12-27 19:24:04,192][106226] Updated weights for policy 0, policy_version 23740 (0.0008) [2023-12-27 19:24:04,204][106225] Updated weights for policy 1, policy_version 23668 (0.0008) [2023-12-27 19:24:04,265][106226] Updated weights for policy 0, policy_version 23750 (0.0006) [2023-12-27 19:24:04,786][106226] Updated weights for policy 0, policy_version 23760 (0.0006) [2023-12-27 19:24:04,847][106226] Updated weights for policy 0, policy_version 23770 (0.0010) [2023-12-27 19:24:04,903][106226] Updated weights for policy 0, policy_version 23780 (0.0010) [2023-12-27 19:24:04,966][106225] Updated weights for policy 1, policy_version 23678 (0.0007) [2023-12-27 19:24:05,019][106225] Updated weights for policy 1, policy_version 23688 (0.0006) [2023-12-27 19:24:05,073][106225] Updated weights for policy 1, policy_version 23698 (0.0008) [2023-12-27 19:24:05,497][106226] Updated weights for policy 0, policy_version 23790 (0.0007) [2023-12-27 19:24:05,549][106226] Updated weights for policy 0, policy_version 23800 (0.0006) [2023-12-27 19:24:05,606][106226] Updated weights for policy 0, policy_version 23810 (0.0005) [2023-12-27 19:24:05,766][106225] Updated weights for policy 1, policy_version 23708 (0.0009) [2023-12-27 19:24:05,822][106225] Updated weights for policy 1, policy_version 23718 (0.0010) [2023-12-27 19:24:05,872][106225] Updated weights for policy 1, policy_version 23728 (0.0010) [2023-12-27 19:24:06,131][106226] Updated weights for policy 0, policy_version 23820 (0.0006) [2023-12-27 19:24:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 12181504. Throughput: 0: 10026.3, 1: 9898.0. Samples: 12193288. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 19:24:06,175][105115] Avg episode reward: [(0, '-5.410'), (1, '-6.934')] [2023-12-27 19:24:06,192][106226] Updated weights for policy 0, policy_version 23830 (0.0008) [2023-12-27 19:24:06,255][106226] Updated weights for policy 0, policy_version 23840 (0.0009) [2023-12-27 19:24:06,560][106225] Updated weights for policy 1, policy_version 23738 (0.0006) [2023-12-27 19:24:06,631][106225] Updated weights for policy 1, policy_version 23748 (0.0010) [2023-12-27 19:24:06,682][106225] Updated weights for policy 1, policy_version 23758 (0.0009) [2023-12-27 19:24:06,735][106225] Updated weights for policy 1, policy_version 23768 (0.0009) [2023-12-27 19:24:07,060][106226] Updated weights for policy 0, policy_version 23850 (0.0008) [2023-12-27 19:24:07,120][106226] Updated weights for policy 0, policy_version 23860 (0.0009) [2023-12-27 19:24:07,176][106226] Updated weights for policy 0, policy_version 23870 (0.0009) [2023-12-27 19:24:07,227][106226] Updated weights for policy 0, policy_version 23880 (0.0009) [2023-12-27 19:24:07,335][106225] Updated weights for policy 1, policy_version 23778 (0.0005) [2023-12-27 19:24:07,389][106225] Updated weights for policy 1, policy_version 23788 (0.0005) [2023-12-27 19:24:07,444][106225] Updated weights for policy 1, policy_version 23798 (0.0005) [2023-12-27 19:24:08,043][106225] Updated weights for policy 1, policy_version 23808 (0.0007) [2023-12-27 19:24:08,079][106226] Updated weights for policy 0, policy_version 23890 (0.0007) [2023-12-27 19:24:08,101][106225] Updated weights for policy 1, policy_version 23818 (0.0007) [2023-12-27 19:24:08,141][106226] Updated weights for policy 0, policy_version 23900 (0.0008) [2023-12-27 19:24:08,147][106225] Updated weights for policy 1, policy_version 23828 (0.0005) [2023-12-27 19:24:08,205][106226] Updated weights for policy 0, policy_version 23910 (0.0008) [2023-12-27 19:24:08,866][106225] Updated weights for policy 1, policy_version 23838 (0.0008) [2023-12-27 19:24:08,896][106226] Updated weights for policy 0, policy_version 23920 (0.0010) [2023-12-27 19:24:08,932][106225] Updated weights for policy 1, policy_version 23848 (0.0006) [2023-12-27 19:24:08,964][106226] Updated weights for policy 0, policy_version 23930 (0.0008) [2023-12-27 19:24:08,987][106225] Updated weights for policy 1, policy_version 23858 (0.0006) [2023-12-27 19:24:09,027][106226] Updated weights for policy 0, policy_version 23940 (0.0010) [2023-12-27 19:24:09,725][106225] Updated weights for policy 1, policy_version 23868 (0.0008) [2023-12-27 19:24:09,763][106226] Updated weights for policy 0, policy_version 23950 (0.0008) [2023-12-27 19:24:09,785][106225] Updated weights for policy 1, policy_version 23878 (0.0005) [2023-12-27 19:24:09,838][106226] Updated weights for policy 0, policy_version 23960 (0.0008) [2023-12-27 19:24:09,855][106225] Updated weights for policy 1, policy_version 23888 (0.0008) [2023-12-27 19:24:09,912][106226] Updated weights for policy 0, policy_version 23970 (0.0008) [2023-12-27 19:24:10,572][106225] Updated weights for policy 1, policy_version 23898 (0.0009) [2023-12-27 19:24:10,627][106225] Updated weights for policy 1, policy_version 23908 (0.0010) [2023-12-27 19:24:10,684][106225] Updated weights for policy 1, policy_version 23918 (0.0010) [2023-12-27 19:24:10,690][106226] Updated weights for policy 0, policy_version 23982 (0.0008) [2023-12-27 19:24:10,735][106225] Updated weights for policy 1, policy_version 23928 (0.0010) [2023-12-27 19:24:10,745][106226] Updated weights for policy 0, policy_version 23992 (0.0006) [2023-12-27 19:24:10,796][106226] Updated weights for policy 0, policy_version 24002 (0.0008) [2023-12-27 19:24:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 12279808. Throughput: 0: 9978.0, 1: 9961.4. Samples: 12251572. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 19:24:11,175][105115] Avg episode reward: [(0, '-5.641'), (1, '-6.391')] [2023-12-27 19:24:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000023928_6127616.pth... [2023-12-27 19:24:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000024008_6152192.pth... [2023-12-27 19:24:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000022856_5857280.pth [2023-12-27 19:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000022776_5832704.pth [2023-12-27 19:24:11,528][106226] Updated weights for policy 0, policy_version 24012 (0.0007) [2023-12-27 19:24:11,574][106225] Updated weights for policy 1, policy_version 23938 (0.0009) [2023-12-27 19:24:11,594][106226] Updated weights for policy 0, policy_version 24022 (0.0007) [2023-12-27 19:24:11,641][106225] Updated weights for policy 1, policy_version 23948 (0.0008) [2023-12-27 19:24:11,660][106226] Updated weights for policy 0, policy_version 24032 (0.0009) [2023-12-27 19:24:11,708][106225] Updated weights for policy 1, policy_version 23958 (0.0009) [2023-12-27 19:24:12,369][106225] Updated weights for policy 1, policy_version 23968 (0.0010) [2023-12-27 19:24:12,428][106225] Updated weights for policy 1, policy_version 23978 (0.0007) [2023-12-27 19:24:12,490][106225] Updated weights for policy 1, policy_version 23988 (0.0007) [2023-12-27 19:24:12,492][106226] Updated weights for policy 0, policy_version 24042 (0.0007) [2023-12-27 19:24:12,539][106226] Updated weights for policy 0, policy_version 24052 (0.0007) [2023-12-27 19:24:12,587][106226] Updated weights for policy 0, policy_version 24062 (0.0008) [2023-12-27 19:24:12,643][106226] Updated weights for policy 0, policy_version 24072 (0.0009) [2023-12-27 19:24:13,164][106225] Updated weights for policy 1, policy_version 23998 (0.0006) [2023-12-27 19:24:13,223][106225] Updated weights for policy 1, policy_version 24008 (0.0006) [2023-12-27 19:24:13,271][106225] Updated weights for policy 1, policy_version 24018 (0.0007) [2023-12-27 19:24:13,412][106226] Updated weights for policy 0, policy_version 24082 (0.0005) [2023-12-27 19:24:13,474][106226] Updated weights for policy 0, policy_version 24092 (0.0005) [2023-12-27 19:24:13,539][106226] Updated weights for policy 0, policy_version 24102 (0.0005) [2023-12-27 19:24:13,966][106225] Updated weights for policy 1, policy_version 24028 (0.0009) [2023-12-27 19:24:14,018][106225] Updated weights for policy 1, policy_version 24038 (0.0008) [2023-12-27 19:24:14,078][106225] Updated weights for policy 1, policy_version 24048 (0.0007) [2023-12-27 19:24:14,110][106226] Updated weights for policy 0, policy_version 24112 (0.0009) [2023-12-27 19:24:14,164][106226] Updated weights for policy 0, policy_version 24122 (0.0010) [2023-12-27 19:24:14,223][106226] Updated weights for policy 0, policy_version 24132 (0.0010) [2023-12-27 19:24:14,822][106225] Updated weights for policy 1, policy_version 24058 (0.0006) [2023-12-27 19:24:14,888][106225] Updated weights for policy 1, policy_version 24068 (0.0008) [2023-12-27 19:24:14,937][106226] Updated weights for policy 0, policy_version 24142 (0.0010) [2023-12-27 19:24:14,951][106225] Updated weights for policy 1, policy_version 24078 (0.0007) [2023-12-27 19:24:15,010][106226] Updated weights for policy 0, policy_version 24152 (0.0011) [2023-12-27 19:24:15,021][106225] Updated weights for policy 1, policy_version 24088 (0.0007) [2023-12-27 19:24:15,079][106226] Updated weights for policy 0, policy_version 24162 (0.0010) [2023-12-27 19:24:15,688][106225] Updated weights for policy 1, policy_version 24098 (0.0008) [2023-12-27 19:24:15,734][106226] Updated weights for policy 0, policy_version 24172 (0.0009) [2023-12-27 19:24:15,736][106225] Updated weights for policy 1, policy_version 24108 (0.0008) [2023-12-27 19:24:15,780][106226] Updated weights for policy 0, policy_version 24182 (0.0005) [2023-12-27 19:24:15,781][106225] Updated weights for policy 1, policy_version 24118 (0.0007) [2023-12-27 19:24:15,826][106226] Updated weights for policy 0, policy_version 24192 (0.0005) [2023-12-27 19:24:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 12378112. Throughput: 0: 9889.6, 1: 9943.8. Samples: 12366212. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 19:24:16,176][105115] Avg episode reward: [(0, '-5.565'), (1, '-6.940')] [2023-12-27 19:24:16,397][106226] Updated weights for policy 0, policy_version 24202 (0.0007) [2023-12-27 19:24:16,447][106226] Updated weights for policy 0, policy_version 24212 (0.0006) [2023-12-27 19:24:16,483][106225] Updated weights for policy 1, policy_version 24128 (0.0008) [2023-12-27 19:24:16,502][106226] Updated weights for policy 0, policy_version 24222 (0.0005) [2023-12-27 19:24:16,529][106225] Updated weights for policy 1, policy_version 24138 (0.0008) [2023-12-27 19:24:16,555][106226] Updated weights for policy 0, policy_version 24232 (0.0005) [2023-12-27 19:24:16,585][106225] Updated weights for policy 1, policy_version 24148 (0.0009) [2023-12-27 19:24:17,208][106226] Updated weights for policy 0, policy_version 24242 (0.0007) [2023-12-27 19:24:17,274][106226] Updated weights for policy 0, policy_version 24252 (0.0008) [2023-12-27 19:24:17,333][106226] Updated weights for policy 0, policy_version 24262 (0.0010) [2023-12-27 19:24:17,356][106225] Updated weights for policy 1, policy_version 24158 (0.0009) [2023-12-27 19:24:17,399][106225] Updated weights for policy 1, policy_version 24168 (0.0007) [2023-12-27 19:24:17,452][106225] Updated weights for policy 1, policy_version 24178 (0.0008) [2023-12-27 19:24:17,939][106226] Updated weights for policy 0, policy_version 24272 (0.0007) [2023-12-27 19:24:18,003][106226] Updated weights for policy 0, policy_version 24282 (0.0007) [2023-12-27 19:24:18,071][106226] Updated weights for policy 0, policy_version 24292 (0.0005) [2023-12-27 19:24:18,248][106225] Updated weights for policy 1, policy_version 24188 (0.0008) [2023-12-27 19:24:18,298][106225] Updated weights for policy 1, policy_version 24198 (0.0008) [2023-12-27 19:24:18,391][106225] Updated weights for policy 1, policy_version 24208 (0.0009) [2023-12-27 19:24:18,699][106226] Updated weights for policy 0, policy_version 24302 (0.0007) [2023-12-27 19:24:18,770][106226] Updated weights for policy 0, policy_version 24312 (0.0009) [2023-12-27 19:24:18,829][106226] Updated weights for policy 0, policy_version 24322 (0.0009) [2023-12-27 19:24:19,149][106225] Updated weights for policy 1, policy_version 24218 (0.0009) [2023-12-27 19:24:19,206][106225] Updated weights for policy 1, policy_version 24228 (0.0009) [2023-12-27 19:24:19,276][106225] Updated weights for policy 1, policy_version 24238 (0.0008) [2023-12-27 19:24:19,348][106225] Updated weights for policy 1, policy_version 24248 (0.0008) [2023-12-27 19:24:19,576][106226] Updated weights for policy 0, policy_version 24332 (0.0008) [2023-12-27 19:24:19,642][106226] Updated weights for policy 0, policy_version 24342 (0.0009) [2023-12-27 19:24:19,709][106226] Updated weights for policy 0, policy_version 24352 (0.0008) [2023-12-27 19:24:19,992][106225] Updated weights for policy 1, policy_version 24258 (0.0008) [2023-12-27 19:24:20,048][106225] Updated weights for policy 1, policy_version 24268 (0.0008) [2023-12-27 19:24:20,108][106225] Updated weights for policy 1, policy_version 24278 (0.0008) [2023-12-27 19:24:20,460][106226] Updated weights for policy 0, policy_version 24362 (0.0010) [2023-12-27 19:24:20,514][106226] Updated weights for policy 0, policy_version 24372 (0.0010) [2023-12-27 19:24:20,576][106226] Updated weights for policy 0, policy_version 24382 (0.0007) [2023-12-27 19:24:20,637][106226] Updated weights for policy 0, policy_version 24392 (0.0008) [2023-12-27 19:24:20,821][106225] Updated weights for policy 1, policy_version 24288 (0.0007) [2023-12-27 19:24:20,874][106225] Updated weights for policy 1, policy_version 24298 (0.0008) [2023-12-27 19:24:20,927][106225] Updated weights for policy 1, policy_version 24308 (0.0008) [2023-12-27 19:24:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 12476416. Throughput: 0: 9860.1, 1: 9851.9. Samples: 12484584. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-27 19:24:21,175][105115] Avg episode reward: [(0, '-5.504'), (1, '-6.782')] [2023-12-27 19:24:21,437][106226] Updated weights for policy 0, policy_version 24402 (0.0008) [2023-12-27 19:24:21,497][106226] Updated weights for policy 0, policy_version 24412 (0.0007) [2023-12-27 19:24:21,548][106226] Updated weights for policy 0, policy_version 24422 (0.0005) [2023-12-27 19:24:21,654][106225] Updated weights for policy 1, policy_version 24318 (0.0010) [2023-12-27 19:24:21,723][106225] Updated weights for policy 1, policy_version 24328 (0.0009) [2023-12-27 19:24:21,789][106225] Updated weights for policy 1, policy_version 24338 (0.0008) [2023-12-27 19:24:22,219][106226] Updated weights for policy 0, policy_version 24432 (0.0007) [2023-12-27 19:24:22,280][106226] Updated weights for policy 0, policy_version 24442 (0.0008) [2023-12-27 19:24:22,348][106226] Updated weights for policy 0, policy_version 24452 (0.0008) [2023-12-27 19:24:22,552][106225] Updated weights for policy 1, policy_version 24348 (0.0010) [2023-12-27 19:24:22,604][106225] Updated weights for policy 1, policy_version 24358 (0.0010) [2023-12-27 19:24:22,665][106225] Updated weights for policy 1, policy_version 24368 (0.0011) [2023-12-27 19:24:23,027][106226] Updated weights for policy 0, policy_version 24462 (0.0007) [2023-12-27 19:24:23,080][106226] Updated weights for policy 0, policy_version 24472 (0.0005) [2023-12-27 19:24:23,129][106226] Updated weights for policy 0, policy_version 24482 (0.0005) [2023-12-27 19:24:23,424][106225] Updated weights for policy 1, policy_version 24378 (0.0010) [2023-12-27 19:24:23,486][106225] Updated weights for policy 1, policy_version 24388 (0.0010) [2023-12-27 19:24:23,547][106225] Updated weights for policy 1, policy_version 24398 (0.0010) [2023-12-27 19:24:23,612][106225] Updated weights for policy 1, policy_version 24408 (0.0006) [2023-12-27 19:24:23,669][106226] Updated weights for policy 0, policy_version 24492 (0.0006) [2023-12-27 19:24:23,727][106226] Updated weights for policy 0, policy_version 24502 (0.0007) [2023-12-27 19:24:23,784][106226] Updated weights for policy 0, policy_version 24512 (0.0005) [2023-12-27 19:24:24,255][106225] Updated weights for policy 1, policy_version 24418 (0.0005) [2023-12-27 19:24:24,311][106225] Updated weights for policy 1, policy_version 24428 (0.0007) [2023-12-27 19:24:24,322][106226] Updated weights for policy 0, policy_version 24522 (0.0005) [2023-12-27 19:24:24,370][106225] Updated weights for policy 1, policy_version 24438 (0.0009) [2023-12-27 19:24:24,382][106226] Updated weights for policy 0, policy_version 24532 (0.0007) [2023-12-27 19:24:24,442][106226] Updated weights for policy 0, policy_version 24542 (0.0010) [2023-12-27 19:24:24,500][106226] Updated weights for policy 0, policy_version 24552 (0.0010) [2023-12-27 19:24:25,081][106225] Updated weights for policy 1, policy_version 24448 (0.0010) [2023-12-27 19:24:25,126][106225] Updated weights for policy 1, policy_version 24458 (0.0010) [2023-12-27 19:24:25,180][106226] Updated weights for policy 0, policy_version 24562 (0.0008) [2023-12-27 19:24:25,186][106225] Updated weights for policy 1, policy_version 24468 (0.0010) [2023-12-27 19:24:25,239][106226] Updated weights for policy 0, policy_version 24572 (0.0009) [2023-12-27 19:24:25,301][106226] Updated weights for policy 0, policy_version 24582 (0.0010) [2023-12-27 19:24:25,905][106225] Updated weights for policy 1, policy_version 24478 (0.0010) [2023-12-27 19:24:25,960][106226] Updated weights for policy 0, policy_version 24592 (0.0010) [2023-12-27 19:24:25,964][106225] Updated weights for policy 1, policy_version 24488 (0.0010) [2023-12-27 19:24:26,013][106226] Updated weights for policy 0, policy_version 24602 (0.0006) [2023-12-27 19:24:26,021][106225] Updated weights for policy 1, policy_version 24498 (0.0010) [2023-12-27 19:24:26,070][106226] Updated weights for policy 0, policy_version 24612 (0.0008) [2023-12-27 19:24:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 12582912. Throughput: 0: 9953.3, 1: 9796.3. Samples: 12544848. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-27 19:24:26,175][105115] Avg episode reward: [(0, '-5.514'), (1, '-6.265')] [2023-12-27 19:24:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000024504_6275072.pth... [2023-12-27 19:24:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000024616_6307840.pth... [2023-12-27 19:24:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000023352_5980160.pth [2023-12-27 19:24:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000023432_6004736.pth [2023-12-27 19:24:26,695][106226] Updated weights for policy 0, policy_version 24622 (0.0007) [2023-12-27 19:24:26,745][106225] Updated weights for policy 1, policy_version 24508 (0.0009) [2023-12-27 19:24:26,746][106226] Updated weights for policy 0, policy_version 24632 (0.0005) [2023-12-27 19:24:26,791][106225] Updated weights for policy 1, policy_version 24518 (0.0010) [2023-12-27 19:24:26,808][106226] Updated weights for policy 0, policy_version 24642 (0.0005) [2023-12-27 19:24:26,840][106225] Updated weights for policy 1, policy_version 24528 (0.0010) [2023-12-27 19:24:27,533][106225] Updated weights for policy 1, policy_version 24538 (0.0010) [2023-12-27 19:24:27,537][106226] Updated weights for policy 0, policy_version 24652 (0.0007) [2023-12-27 19:24:27,594][106225] Updated weights for policy 1, policy_version 24548 (0.0010) [2023-12-27 19:24:27,595][106226] Updated weights for policy 0, policy_version 24662 (0.0006) [2023-12-27 19:24:27,653][106225] Updated weights for policy 1, policy_version 24558 (0.0010) [2023-12-27 19:24:27,656][106226] Updated weights for policy 0, policy_version 24672 (0.0006) [2023-12-27 19:24:27,703][106225] Updated weights for policy 1, policy_version 24568 (0.0010) [2023-12-27 19:24:28,369][106225] Updated weights for policy 1, policy_version 24578 (0.0011) [2023-12-27 19:24:28,382][106226] Updated weights for policy 0, policy_version 24682 (0.0006) [2023-12-27 19:24:28,429][106225] Updated weights for policy 1, policy_version 24588 (0.0010) [2023-12-27 19:24:28,440][106226] Updated weights for policy 0, policy_version 24692 (0.0008) [2023-12-27 19:24:28,486][106225] Updated weights for policy 1, policy_version 24598 (0.0010) [2023-12-27 19:24:28,496][106226] Updated weights for policy 0, policy_version 24702 (0.0007) [2023-12-27 19:24:28,553][106226] Updated weights for policy 0, policy_version 24712 (0.0008) [2023-12-27 19:24:29,188][106225] Updated weights for policy 1, policy_version 24608 (0.0010) [2023-12-27 19:24:29,253][106225] Updated weights for policy 1, policy_version 24618 (0.0008) [2023-12-27 19:24:29,310][106225] Updated weights for policy 1, policy_version 24628 (0.0006) [2023-12-27 19:24:29,312][106226] Updated weights for policy 0, policy_version 24722 (0.0008) [2023-12-27 19:24:29,391][106226] Updated weights for policy 0, policy_version 24732 (0.0008) [2023-12-27 19:24:29,440][106226] Updated weights for policy 0, policy_version 24742 (0.0007) [2023-12-27 19:24:30,061][106225] Updated weights for policy 1, policy_version 24638 (0.0008) [2023-12-27 19:24:30,128][106225] Updated weights for policy 1, policy_version 24648 (0.0008) [2023-12-27 19:24:30,178][106226] Updated weights for policy 0, policy_version 24752 (0.0006) [2023-12-27 19:24:30,179][106225] Updated weights for policy 1, policy_version 24658 (0.0007) [2023-12-27 19:24:30,235][106226] Updated weights for policy 0, policy_version 24762 (0.0008) [2023-12-27 19:24:30,299][106226] Updated weights for policy 0, policy_version 24772 (0.0009) [2023-12-27 19:24:30,917][106226] Updated weights for policy 0, policy_version 24782 (0.0006) [2023-12-27 19:24:30,956][106225] Updated weights for policy 1, policy_version 24668 (0.0006) [2023-12-27 19:24:30,983][106226] Updated weights for policy 0, policy_version 24792 (0.0005) [2023-12-27 19:24:31,008][106225] Updated weights for policy 1, policy_version 24678 (0.0008) [2023-12-27 19:24:31,047][106226] Updated weights for policy 0, policy_version 24802 (0.0006) [2023-12-27 19:24:31,073][106225] Updated weights for policy 1, policy_version 24688 (0.0008) [2023-12-27 19:24:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 12681216. Throughput: 0: 9949.9, 1: 9900.9. Samples: 12663916. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-27 19:24:31,175][105115] Avg episode reward: [(0, '-5.965'), (1, '-6.739')] [2023-12-27 19:24:31,768][106225] Updated weights for policy 1, policy_version 24698 (0.0006) [2023-12-27 19:24:31,788][106226] Updated weights for policy 0, policy_version 24812 (0.0008) [2023-12-27 19:24:31,827][106225] Updated weights for policy 1, policy_version 24708 (0.0010) [2023-12-27 19:24:31,848][106226] Updated weights for policy 0, policy_version 24822 (0.0008) [2023-12-27 19:24:31,885][106225] Updated weights for policy 1, policy_version 24718 (0.0005) [2023-12-27 19:24:31,906][106226] Updated weights for policy 0, policy_version 24832 (0.0007) [2023-12-27 19:24:31,945][106225] Updated weights for policy 1, policy_version 24728 (0.0006) [2023-12-27 19:24:32,544][106226] Updated weights for policy 0, policy_version 24842 (0.0008) [2023-12-27 19:24:32,603][106226] Updated weights for policy 0, policy_version 24852 (0.0007) [2023-12-27 19:24:32,668][106226] Updated weights for policy 0, policy_version 24862 (0.0006) [2023-12-27 19:24:32,725][106226] Updated weights for policy 0, policy_version 24872 (0.0006) [2023-12-27 19:24:32,731][106225] Updated weights for policy 1, policy_version 24738 (0.0008) [2023-12-27 19:24:32,792][106225] Updated weights for policy 1, policy_version 24748 (0.0008) [2023-12-27 19:24:32,849][106225] Updated weights for policy 1, policy_version 24758 (0.0007) [2023-12-27 19:24:33,302][106226] Updated weights for policy 0, policy_version 24882 (0.0009) [2023-12-27 19:24:33,354][106226] Updated weights for policy 0, policy_version 24892 (0.0007) [2023-12-27 19:24:33,411][106226] Updated weights for policy 0, policy_version 24902 (0.0008) [2023-12-27 19:24:33,500][106225] Updated weights for policy 1, policy_version 24768 (0.0010) [2023-12-27 19:24:33,552][106225] Updated weights for policy 1, policy_version 24778 (0.0010) [2023-12-27 19:24:33,607][106225] Updated weights for policy 1, policy_version 24788 (0.0010) [2023-12-27 19:24:34,219][106226] Updated weights for policy 0, policy_version 24912 (0.0007) [2023-12-27 19:24:34,224][106225] Updated weights for policy 1, policy_version 24798 (0.0009) [2023-12-27 19:24:34,280][106226] Updated weights for policy 0, policy_version 24922 (0.0007) [2023-12-27 19:24:34,287][106225] Updated weights for policy 1, policy_version 24808 (0.0009) [2023-12-27 19:24:34,344][106226] Updated weights for policy 0, policy_version 24932 (0.0006) [2023-12-27 19:24:34,349][106225] Updated weights for policy 1, policy_version 24818 (0.0010) [2023-12-27 19:24:34,986][106225] Updated weights for policy 1, policy_version 24828 (0.0010) [2023-12-27 19:24:35,044][106225] Updated weights for policy 1, policy_version 24838 (0.0010) [2023-12-27 19:24:35,057][106226] Updated weights for policy 0, policy_version 24942 (0.0008) [2023-12-27 19:24:35,091][106225] Updated weights for policy 1, policy_version 24848 (0.0010) [2023-12-27 19:24:35,104][106226] Updated weights for policy 0, policy_version 24952 (0.0005) [2023-12-27 19:24:35,160][106226] Updated weights for policy 0, policy_version 24962 (0.0006) [2023-12-27 19:24:35,803][106225] Updated weights for policy 1, policy_version 24858 (0.0010) [2023-12-27 19:24:35,833][106226] Updated weights for policy 0, policy_version 24972 (0.0009) [2023-12-27 19:24:35,863][106225] Updated weights for policy 1, policy_version 24868 (0.0010) [2023-12-27 19:24:35,893][106226] Updated weights for policy 0, policy_version 24982 (0.0010) [2023-12-27 19:24:35,924][106225] Updated weights for policy 1, policy_version 24878 (0.0010) [2023-12-27 19:24:35,950][106226] Updated weights for policy 0, policy_version 24992 (0.0009) [2023-12-27 19:24:35,973][106225] Updated weights for policy 1, policy_version 24888 (0.0010) [2023-12-27 19:24:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 12779520. Throughput: 0: 9986.0, 1: 9868.4. Samples: 12784068. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-27 19:24:36,175][105115] Avg episode reward: [(0, '-5.273'), (1, '-6.794')] [2023-12-27 19:24:36,640][106225] Updated weights for policy 1, policy_version 24898 (0.0008) [2023-12-27 19:24:36,688][106226] Updated weights for policy 0, policy_version 25002 (0.0011) [2023-12-27 19:24:36,702][106225] Updated weights for policy 1, policy_version 24908 (0.0006) [2023-12-27 19:24:36,747][106226] Updated weights for policy 0, policy_version 25012 (0.0010) [2023-12-27 19:24:36,762][106225] Updated weights for policy 1, policy_version 24918 (0.0007) [2023-12-27 19:24:36,808][106226] Updated weights for policy 0, policy_version 25022 (0.0011) [2023-12-27 19:24:36,877][106226] Updated weights for policy 0, policy_version 25032 (0.0011) [2023-12-27 19:24:37,388][106225] Updated weights for policy 1, policy_version 24928 (0.0006) [2023-12-27 19:24:37,441][106225] Updated weights for policy 1, policy_version 24938 (0.0005) [2023-12-27 19:24:37,495][106225] Updated weights for policy 1, policy_version 24948 (0.0005) [2023-12-27 19:24:37,584][106226] Updated weights for policy 0, policy_version 25042 (0.0011) [2023-12-27 19:24:37,648][106226] Updated weights for policy 0, policy_version 25052 (0.0011) [2023-12-27 19:24:37,713][106226] Updated weights for policy 0, policy_version 25062 (0.0011) [2023-12-27 19:24:38,207][106225] Updated weights for policy 1, policy_version 24958 (0.0006) [2023-12-27 19:24:38,270][106225] Updated weights for policy 1, policy_version 24968 (0.0008) [2023-12-27 19:24:38,315][106226] Updated weights for policy 0, policy_version 25072 (0.0009) [2023-12-27 19:24:38,327][106225] Updated weights for policy 1, policy_version 24978 (0.0008) [2023-12-27 19:24:38,384][106226] Updated weights for policy 0, policy_version 25082 (0.0010) [2023-12-27 19:24:38,450][106226] Updated weights for policy 0, policy_version 25092 (0.0007) [2023-12-27 19:24:38,971][106225] Updated weights for policy 1, policy_version 24988 (0.0007) [2023-12-27 19:24:39,026][106225] Updated weights for policy 1, policy_version 24998 (0.0009) [2023-12-27 19:24:39,083][106225] Updated weights for policy 1, policy_version 25008 (0.0009) [2023-12-27 19:24:39,175][106226] Updated weights for policy 0, policy_version 25102 (0.0008) [2023-12-27 19:24:39,244][106226] Updated weights for policy 0, policy_version 25112 (0.0008) [2023-12-27 19:24:39,312][106226] Updated weights for policy 0, policy_version 25122 (0.0010) [2023-12-27 19:24:39,884][106225] Updated weights for policy 1, policy_version 25018 (0.0008) [2023-12-27 19:24:39,955][106225] Updated weights for policy 1, policy_version 25028 (0.0008) [2023-12-27 19:24:40,020][106225] Updated weights for policy 1, policy_version 25038 (0.0008) [2023-12-27 19:24:40,067][106226] Updated weights for policy 0, policy_version 25132 (0.0009) [2023-12-27 19:24:40,088][106225] Updated weights for policy 1, policy_version 25048 (0.0008) [2023-12-27 19:24:40,137][106226] Updated weights for policy 0, policy_version 25142 (0.0006) [2023-12-27 19:24:40,204][106226] Updated weights for policy 0, policy_version 25152 (0.0008) [2023-12-27 19:24:40,808][106225] Updated weights for policy 1, policy_version 25058 (0.0005) [2023-12-27 19:24:40,874][106225] Updated weights for policy 1, policy_version 25068 (0.0006) [2023-12-27 19:24:40,915][106226] Updated weights for policy 0, policy_version 25162 (0.0011) [2023-12-27 19:24:40,920][106225] Updated weights for policy 1, policy_version 25078 (0.0006) [2023-12-27 19:24:40,969][106226] Updated weights for policy 0, policy_version 25172 (0.0010) [2023-12-27 19:24:41,029][106226] Updated weights for policy 0, policy_version 25182 (0.0011) [2023-12-27 19:24:41,093][106226] Updated weights for policy 0, policy_version 25192 (0.0011) [2023-12-27 19:24:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 12877824. Throughput: 0: 9964.0, 1: 9897.5. Samples: 12845316. Policy #0 lag: (min: 1.0, avg: 11.7, max: 33.0) [2023-12-27 19:24:41,175][105115] Avg episode reward: [(0, '-5.804'), (1, '-6.723')] [2023-12-27 19:24:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000025192_6455296.pth... [2023-12-27 19:24:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000025080_6422528.pth... [2023-12-27 19:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000024008_6152192.pth [2023-12-27 19:24:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000023928_6127616.pth [2023-12-27 19:24:41,663][106225] Updated weights for policy 1, policy_version 25088 (0.0009) [2023-12-27 19:24:41,731][106225] Updated weights for policy 1, policy_version 25098 (0.0008) [2023-12-27 19:24:41,799][106225] Updated weights for policy 1, policy_version 25108 (0.0008) [2023-12-27 19:24:41,873][106226] Updated weights for policy 0, policy_version 25202 (0.0006) [2023-12-27 19:24:41,935][106226] Updated weights for policy 0, policy_version 25212 (0.0006) [2023-12-27 19:24:41,995][106226] Updated weights for policy 0, policy_version 25222 (0.0006) [2023-12-27 19:24:42,595][106225] Updated weights for policy 1, policy_version 25118 (0.0008) [2023-12-27 19:24:42,648][106225] Updated weights for policy 1, policy_version 25128 (0.0009) [2023-12-27 19:24:42,703][106225] Updated weights for policy 1, policy_version 25138 (0.0007) [2023-12-27 19:24:42,718][106226] Updated weights for policy 0, policy_version 25232 (0.0006) [2023-12-27 19:24:42,768][106226] Updated weights for policy 0, policy_version 25242 (0.0005) [2023-12-27 19:24:42,835][106226] Updated weights for policy 0, policy_version 25252 (0.0007) [2023-12-27 19:24:43,342][106225] Updated weights for policy 1, policy_version 25148 (0.0008) [2023-12-27 19:24:43,395][106225] Updated weights for policy 1, policy_version 25158 (0.0009) [2023-12-27 19:24:43,444][106225] Updated weights for policy 1, policy_version 25168 (0.0009) [2023-12-27 19:24:43,572][106226] Updated weights for policy 0, policy_version 25262 (0.0009) [2023-12-27 19:24:43,624][106226] Updated weights for policy 0, policy_version 25272 (0.0009) [2023-12-27 19:24:43,686][106226] Updated weights for policy 0, policy_version 25282 (0.0008) [2023-12-27 19:24:44,085][106225] Updated weights for policy 1, policy_version 25178 (0.0008) [2023-12-27 19:24:44,130][106225] Updated weights for policy 1, policy_version 25188 (0.0009) [2023-12-27 19:24:44,190][106225] Updated weights for policy 1, policy_version 25198 (0.0009) [2023-12-27 19:24:44,241][106225] Updated weights for policy 1, policy_version 25208 (0.0007) [2023-12-27 19:24:44,334][106226] Updated weights for policy 0, policy_version 25292 (0.0008) [2023-12-27 19:24:44,387][106226] Updated weights for policy 0, policy_version 25302 (0.0007) [2023-12-27 19:24:44,441][106226] Updated weights for policy 0, policy_version 25312 (0.0009) [2023-12-27 19:24:44,875][106225] Updated weights for policy 1, policy_version 25218 (0.0008) [2023-12-27 19:24:44,936][106225] Updated weights for policy 1, policy_version 25228 (0.0008) [2023-12-27 19:24:44,996][106225] Updated weights for policy 1, policy_version 25238 (0.0008) [2023-12-27 19:24:45,201][106226] Updated weights for policy 0, policy_version 25322 (0.0008) [2023-12-27 19:24:45,266][106226] Updated weights for policy 0, policy_version 25332 (0.0006) [2023-12-27 19:24:45,338][106226] Updated weights for policy 0, policy_version 25342 (0.0006) [2023-12-27 19:24:45,399][106226] Updated weights for policy 0, policy_version 25352 (0.0008) [2023-12-27 19:24:45,790][106225] Updated weights for policy 1, policy_version 25248 (0.0007) [2023-12-27 19:24:45,845][106225] Updated weights for policy 1, policy_version 25258 (0.0009) [2023-12-27 19:24:45,900][106225] Updated weights for policy 1, policy_version 25268 (0.0010) [2023-12-27 19:24:45,984][106226] Updated weights for policy 0, policy_version 25362 (0.0008) [2023-12-27 19:24:46,044][106226] Updated weights for policy 0, policy_version 25372 (0.0009) [2023-12-27 19:24:46,108][106226] Updated weights for policy 0, policy_version 25382 (0.0006) [2023-12-27 19:24:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 12976128. Throughput: 0: 9951.3, 1: 9901.8. Samples: 12960872. Policy #0 lag: (min: 1.0, avg: 11.7, max: 33.0) [2023-12-27 19:24:46,175][105115] Avg episode reward: [(0, '-5.410'), (1, '-6.448')] [2023-12-27 19:24:46,624][106225] Updated weights for policy 1, policy_version 25278 (0.0009) [2023-12-27 19:24:46,674][106225] Updated weights for policy 1, policy_version 25288 (0.0008) [2023-12-27 19:24:46,728][106225] Updated weights for policy 1, policy_version 25298 (0.0008) [2023-12-27 19:24:46,782][106226] Updated weights for policy 0, policy_version 25392 (0.0005) [2023-12-27 19:24:46,843][106226] Updated weights for policy 0, policy_version 25402 (0.0005) [2023-12-27 19:24:46,891][106226] Updated weights for policy 0, policy_version 25412 (0.0005) [2023-12-27 19:24:47,474][106225] Updated weights for policy 1, policy_version 25308 (0.0008) [2023-12-27 19:24:47,519][106225] Updated weights for policy 1, policy_version 25318 (0.0008) [2023-12-27 19:24:47,558][106226] Updated weights for policy 0, policy_version 25422 (0.0006) [2023-12-27 19:24:47,568][106225] Updated weights for policy 1, policy_version 25328 (0.0007) [2023-12-27 19:24:47,605][106226] Updated weights for policy 0, policy_version 25432 (0.0006) [2023-12-27 19:24:47,654][106226] Updated weights for policy 0, policy_version 25442 (0.0007) [2023-12-27 19:24:48,325][106225] Updated weights for policy 1, policy_version 25338 (0.0006) [2023-12-27 19:24:48,385][106225] Updated weights for policy 1, policy_version 25348 (0.0009) [2023-12-27 19:24:48,389][106226] Updated weights for policy 0, policy_version 25452 (0.0007) [2023-12-27 19:24:48,444][106226] Updated weights for policy 0, policy_version 25462 (0.0008) [2023-12-27 19:24:48,447][106225] Updated weights for policy 1, policy_version 25358 (0.0010) [2023-12-27 19:24:48,499][106226] Updated weights for policy 0, policy_version 25472 (0.0011) [2023-12-27 19:24:48,505][106225] Updated weights for policy 1, policy_version 25368 (0.0010) [2023-12-27 19:24:49,195][106225] Updated weights for policy 1, policy_version 25378 (0.0010) [2023-12-27 19:24:49,202][106226] Updated weights for policy 0, policy_version 25482 (0.0010) [2023-12-27 19:24:49,267][106225] Updated weights for policy 1, policy_version 25388 (0.0010) [2023-12-27 19:24:49,269][106226] Updated weights for policy 0, policy_version 25492 (0.0008) [2023-12-27 19:24:49,324][106225] Updated weights for policy 1, policy_version 25398 (0.0010) [2023-12-27 19:24:49,326][106226] Updated weights for policy 0, policy_version 25502 (0.0010) [2023-12-27 19:24:49,398][106226] Updated weights for policy 0, policy_version 25512 (0.0010) [2023-12-27 19:24:50,090][106225] Updated weights for policy 1, policy_version 25408 (0.0011) [2023-12-27 19:24:50,149][106225] Updated weights for policy 1, policy_version 25418 (0.0011) [2023-12-27 19:24:50,151][106226] Updated weights for policy 0, policy_version 25522 (0.0005) [2023-12-27 19:24:50,205][106226] Updated weights for policy 0, policy_version 25532 (0.0007) [2023-12-27 19:24:50,208][106225] Updated weights for policy 1, policy_version 25428 (0.0009) [2023-12-27 19:24:50,260][106226] Updated weights for policy 0, policy_version 25542 (0.0007) [2023-12-27 19:24:50,895][106225] Updated weights for policy 1, policy_version 25438 (0.0006) [2023-12-27 19:24:50,962][106225] Updated weights for policy 1, policy_version 25448 (0.0006) [2023-12-27 19:24:51,030][106225] Updated weights for policy 1, policy_version 25458 (0.0009) [2023-12-27 19:24:51,055][106226] Updated weights for policy 0, policy_version 25552 (0.0008) [2023-12-27 19:24:51,109][106226] Updated weights for policy 0, policy_version 25562 (0.0008) [2023-12-27 19:24:51,174][106226] Updated weights for policy 0, policy_version 25572 (0.0008) [2023-12-27 19:24:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 13066240. Throughput: 0: 9828.8, 1: 9805.8. Samples: 13076844. Policy #0 lag: (min: 1.0, avg: 11.7, max: 33.0) [2023-12-27 19:24:51,175][105115] Avg episode reward: [(0, '-5.604'), (1, '-6.836')] [2023-12-27 19:24:51,742][106225] Updated weights for policy 1, policy_version 25468 (0.0009) [2023-12-27 19:24:51,806][106225] Updated weights for policy 1, policy_version 25478 (0.0006) [2023-12-27 19:24:51,868][106225] Updated weights for policy 1, policy_version 25488 (0.0005) [2023-12-27 19:24:51,964][106226] Updated weights for policy 0, policy_version 25582 (0.0010) [2023-12-27 19:24:52,025][106226] Updated weights for policy 0, policy_version 25592 (0.0011) [2023-12-27 19:24:52,081][106226] Updated weights for policy 0, policy_version 25602 (0.0009) [2023-12-27 19:24:52,453][106225] Updated weights for policy 1, policy_version 25498 (0.0006) [2023-12-27 19:24:52,508][106225] Updated weights for policy 1, policy_version 25508 (0.0008) [2023-12-27 19:24:52,559][106225] Updated weights for policy 1, policy_version 25518 (0.0007) [2023-12-27 19:24:52,615][106225] Updated weights for policy 1, policy_version 25528 (0.0005) [2023-12-27 19:24:52,865][106226] Updated weights for policy 0, policy_version 25612 (0.0009) [2023-12-27 19:24:52,921][106226] Updated weights for policy 0, policy_version 25622 (0.0010) [2023-12-27 19:24:52,968][106226] Updated weights for policy 0, policy_version 25632 (0.0010) [2023-12-27 19:24:53,175][106225] Updated weights for policy 1, policy_version 25538 (0.0005) [2023-12-27 19:24:53,229][106225] Updated weights for policy 1, policy_version 25548 (0.0005) [2023-12-27 19:24:53,295][106225] Updated weights for policy 1, policy_version 25558 (0.0005) [2023-12-27 19:24:53,675][106226] Updated weights for policy 0, policy_version 25642 (0.0009) [2023-12-27 19:24:53,743][106226] Updated weights for policy 0, policy_version 25652 (0.0005) [2023-12-27 19:24:53,805][106226] Updated weights for policy 0, policy_version 25662 (0.0006) [2023-12-27 19:24:53,840][106225] Updated weights for policy 1, policy_version 25568 (0.0007) [2023-12-27 19:24:53,871][106226] Updated weights for policy 0, policy_version 25672 (0.0006) [2023-12-27 19:24:53,896][106225] Updated weights for policy 1, policy_version 25578 (0.0008) [2023-12-27 19:24:53,954][106225] Updated weights for policy 1, policy_version 25588 (0.0009) [2023-12-27 19:24:54,406][106226] Updated weights for policy 0, policy_version 25682 (0.0007) [2023-12-27 19:24:54,459][106226] Updated weights for policy 0, policy_version 25692 (0.0005) [2023-12-27 19:24:54,520][106226] Updated weights for policy 0, policy_version 25702 (0.0006) [2023-12-27 19:24:54,680][106225] Updated weights for policy 1, policy_version 25598 (0.0010) [2023-12-27 19:24:54,742][106225] Updated weights for policy 1, policy_version 25608 (0.0009) [2023-12-27 19:24:54,803][106225] Updated weights for policy 1, policy_version 25618 (0.0008) [2023-12-27 19:24:55,105][106226] Updated weights for policy 0, policy_version 25712 (0.0009) [2023-12-27 19:24:55,168][106226] Updated weights for policy 0, policy_version 25722 (0.0009) [2023-12-27 19:24:55,223][106226] Updated weights for policy 0, policy_version 25732 (0.0008) [2023-12-27 19:24:55,478][106225] Updated weights for policy 1, policy_version 25628 (0.0009) [2023-12-27 19:24:55,529][106225] Updated weights for policy 1, policy_version 25638 (0.0010) [2023-12-27 19:24:55,580][106225] Updated weights for policy 1, policy_version 25648 (0.0010) [2023-12-27 19:24:55,934][106226] Updated weights for policy 0, policy_version 25742 (0.0007) [2023-12-27 19:24:55,998][106226] Updated weights for policy 0, policy_version 25752 (0.0006) [2023-12-27 19:24:56,048][106226] Updated weights for policy 0, policy_version 25762 (0.0006) [2023-12-27 19:24:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 13172736. Throughput: 0: 9878.8, 1: 9849.6. Samples: 13139348. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-27 19:24:56,175][105115] Avg episode reward: [(0, '-5.910'), (1, '-7.033')] [2023-12-27 19:24:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000025656_6569984.pth... [2023-12-27 19:24:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000025768_6602752.pth... [2023-12-27 19:24:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000024504_6275072.pth [2023-12-27 19:24:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000024616_6307840.pth [2023-12-27 19:24:56,280][106225] Updated weights for policy 1, policy_version 25658 (0.0010) [2023-12-27 19:24:56,325][106225] Updated weights for policy 1, policy_version 25668 (0.0010) [2023-12-27 19:24:56,369][106225] Updated weights for policy 1, policy_version 25678 (0.0010) [2023-12-27 19:24:56,415][106225] Updated weights for policy 1, policy_version 25688 (0.0010) [2023-12-27 19:24:56,671][106226] Updated weights for policy 0, policy_version 25772 (0.0008) [2023-12-27 19:24:56,732][106226] Updated weights for policy 0, policy_version 25782 (0.0009) [2023-12-27 19:24:56,790][106226] Updated weights for policy 0, policy_version 25792 (0.0009) [2023-12-27 19:24:57,020][106225] Updated weights for policy 1, policy_version 25698 (0.0008) [2023-12-27 19:24:57,072][106225] Updated weights for policy 1, policy_version 25708 (0.0008) [2023-12-27 19:24:57,121][106225] Updated weights for policy 1, policy_version 25718 (0.0008) [2023-12-27 19:24:57,456][106226] Updated weights for policy 0, policy_version 25802 (0.0008) [2023-12-27 19:24:57,520][106226] Updated weights for policy 0, policy_version 25812 (0.0006) [2023-12-27 19:24:57,580][106226] Updated weights for policy 0, policy_version 25822 (0.0006) [2023-12-27 19:24:57,643][106226] Updated weights for policy 0, policy_version 25832 (0.0006) [2023-12-27 19:24:57,750][106225] Updated weights for policy 1, policy_version 25728 (0.0006) [2023-12-27 19:24:57,814][106225] Updated weights for policy 1, policy_version 25738 (0.0006) [2023-12-27 19:24:57,875][106225] Updated weights for policy 1, policy_version 25748 (0.0006) [2023-12-27 19:24:58,189][106226] Updated weights for policy 0, policy_version 25842 (0.0006) [2023-12-27 19:24:58,257][106226] Updated weights for policy 0, policy_version 25852 (0.0008) [2023-12-27 19:24:58,318][106226] Updated weights for policy 0, policy_version 25862 (0.0007) [2023-12-27 19:24:58,485][106225] Updated weights for policy 1, policy_version 25758 (0.0007) [2023-12-27 19:24:58,551][106225] Updated weights for policy 1, policy_version 25768 (0.0008) [2023-12-27 19:24:58,613][106225] Updated weights for policy 1, policy_version 25778 (0.0008) [2023-12-27 19:24:59,135][106226] Updated weights for policy 0, policy_version 25872 (0.0007) [2023-12-27 19:24:59,197][106226] Updated weights for policy 0, policy_version 25882 (0.0007) [2023-12-27 19:24:59,268][106226] Updated weights for policy 0, policy_version 25892 (0.0008) [2023-12-27 19:24:59,434][106225] Updated weights for policy 1, policy_version 25788 (0.0008) [2023-12-27 19:24:59,491][106225] Updated weights for policy 1, policy_version 25798 (0.0008) [2023-12-27 19:24:59,553][106225] Updated weights for policy 1, policy_version 25808 (0.0008) [2023-12-27 19:25:00,030][106226] Updated weights for policy 0, policy_version 25902 (0.0008) [2023-12-27 19:25:00,083][106226] Updated weights for policy 0, policy_version 25912 (0.0009) [2023-12-27 19:25:00,144][106226] Updated weights for policy 0, policy_version 25922 (0.0009) [2023-12-27 19:25:00,229][106225] Updated weights for policy 1, policy_version 25818 (0.0008) [2023-12-27 19:25:00,293][106225] Updated weights for policy 1, policy_version 25828 (0.0007) [2023-12-27 19:25:00,357][106225] Updated weights for policy 1, policy_version 25838 (0.0009) [2023-12-27 19:25:00,419][106225] Updated weights for policy 1, policy_version 25848 (0.0006) [2023-12-27 19:25:00,855][106226] Updated weights for policy 0, policy_version 25932 (0.0009) [2023-12-27 19:25:00,915][106226] Updated weights for policy 0, policy_version 25942 (0.0008) [2023-12-27 19:25:00,964][106226] Updated weights for policy 0, policy_version 25952 (0.0007) [2023-12-27 19:25:01,088][106225] Updated weights for policy 1, policy_version 25858 (0.0010) [2023-12-27 19:25:01,151][106225] Updated weights for policy 1, policy_version 25868 (0.0010) [2023-12-27 19:25:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 13271040. Throughput: 0: 9981.3, 1: 9916.0. Samples: 13261588. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-27 19:25:01,175][105115] Avg episode reward: [(0, '-5.649'), (1, '-6.835')] [2023-12-27 19:25:01,212][106225] Updated weights for policy 1, policy_version 25878 (0.0010) [2023-12-27 19:25:01,764][106226] Updated weights for policy 0, policy_version 25962 (0.0007) [2023-12-27 19:25:01,826][106226] Updated weights for policy 0, policy_version 25972 (0.0008) [2023-12-27 19:25:01,888][106226] Updated weights for policy 0, policy_version 25982 (0.0008) [2023-12-27 19:25:01,950][106226] Updated weights for policy 0, policy_version 25992 (0.0008) [2023-12-27 19:25:01,985][106225] Updated weights for policy 1, policy_version 25888 (0.0009) [2023-12-27 19:25:02,047][106225] Updated weights for policy 1, policy_version 25898 (0.0008) [2023-12-27 19:25:02,113][106225] Updated weights for policy 1, policy_version 25908 (0.0008) [2023-12-27 19:25:02,640][106226] Updated weights for policy 0, policy_version 26002 (0.0005) [2023-12-27 19:25:02,700][106226] Updated weights for policy 0, policy_version 26012 (0.0007) [2023-12-27 19:25:02,760][106226] Updated weights for policy 0, policy_version 26022 (0.0005) [2023-12-27 19:25:02,834][106225] Updated weights for policy 1, policy_version 25918 (0.0006) [2023-12-27 19:25:02,893][106225] Updated weights for policy 1, policy_version 25928 (0.0005) [2023-12-27 19:25:02,939][106225] Updated weights for policy 1, policy_version 25938 (0.0005) [2023-12-27 19:25:03,359][106226] Updated weights for policy 0, policy_version 26032 (0.0008) [2023-12-27 19:25:03,418][106226] Updated weights for policy 0, policy_version 26042 (0.0009) [2023-12-27 19:25:03,472][106226] Updated weights for policy 0, policy_version 26052 (0.0008) [2023-12-27 19:25:03,600][106225] Updated weights for policy 1, policy_version 25948 (0.0009) [2023-12-27 19:25:03,649][106225] Updated weights for policy 1, policy_version 25958 (0.0008) [2023-12-27 19:25:03,716][106225] Updated weights for policy 1, policy_version 25968 (0.0006) [2023-12-27 19:25:04,167][106226] Updated weights for policy 0, policy_version 26062 (0.0010) [2023-12-27 19:25:04,232][106226] Updated weights for policy 0, policy_version 26072 (0.0011) [2023-12-27 19:25:04,293][106226] Updated weights for policy 0, policy_version 26082 (0.0011) [2023-12-27 19:25:04,412][106225] Updated weights for policy 1, policy_version 25978 (0.0006) [2023-12-27 19:25:04,474][106225] Updated weights for policy 1, policy_version 25988 (0.0008) [2023-12-27 19:25:04,536][106225] Updated weights for policy 1, policy_version 25998 (0.0005) [2023-12-27 19:25:04,594][106225] Updated weights for policy 1, policy_version 26008 (0.0007) [2023-12-27 19:25:05,003][106226] Updated weights for policy 0, policy_version 26092 (0.0008) [2023-12-27 19:25:05,065][106226] Updated weights for policy 0, policy_version 26102 (0.0008) [2023-12-27 19:25:05,123][106226] Updated weights for policy 0, policy_version 26112 (0.0006) [2023-12-27 19:25:05,207][106225] Updated weights for policy 1, policy_version 26018 (0.0009) [2023-12-27 19:25:05,273][106225] Updated weights for policy 1, policy_version 26028 (0.0010) [2023-12-27 19:25:05,331][106225] Updated weights for policy 1, policy_version 26038 (0.0010) [2023-12-27 19:25:05,649][106226] Updated weights for policy 0, policy_version 26122 (0.0006) [2023-12-27 19:25:05,713][106226] Updated weights for policy 0, policy_version 26132 (0.0006) [2023-12-27 19:25:05,764][106226] Updated weights for policy 0, policy_version 26142 (0.0008) [2023-12-27 19:25:05,821][106226] Updated weights for policy 0, policy_version 26152 (0.0007) [2023-12-27 19:25:06,054][106225] Updated weights for policy 1, policy_version 26048 (0.0010) [2023-12-27 19:25:06,116][106225] Updated weights for policy 1, policy_version 26058 (0.0010) [2023-12-27 19:25:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 13369344. Throughput: 0: 10004.1, 1: 9971.4. Samples: 13383480. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-27 19:25:06,175][105115] Avg episode reward: [(0, '-5.692'), (1, '-6.939')] [2023-12-27 19:25:06,176][106225] Updated weights for policy 1, policy_version 26068 (0.0010) [2023-12-27 19:25:06,472][106226] Updated weights for policy 0, policy_version 26162 (0.0008) [2023-12-27 19:25:06,540][106226] Updated weights for policy 0, policy_version 26172 (0.0009) [2023-12-27 19:25:06,600][106226] Updated weights for policy 0, policy_version 26182 (0.0007) [2023-12-27 19:25:06,887][106225] Updated weights for policy 1, policy_version 26078 (0.0010) [2023-12-27 19:25:06,946][106225] Updated weights for policy 1, policy_version 26088 (0.0009) [2023-12-27 19:25:06,996][106225] Updated weights for policy 1, policy_version 26098 (0.0010) [2023-12-27 19:25:07,298][106226] Updated weights for policy 0, policy_version 26192 (0.0010) [2023-12-27 19:25:07,355][106226] Updated weights for policy 0, policy_version 26202 (0.0010) [2023-12-27 19:25:07,405][106226] Updated weights for policy 0, policy_version 26212 (0.0010) [2023-12-27 19:25:07,719][106225] Updated weights for policy 1, policy_version 26108 (0.0010) [2023-12-27 19:25:07,786][106225] Updated weights for policy 1, policy_version 26118 (0.0010) [2023-12-27 19:25:07,839][106225] Updated weights for policy 1, policy_version 26128 (0.0010) [2023-12-27 19:25:07,996][106226] Updated weights for policy 0, policy_version 26222 (0.0009) [2023-12-27 19:25:08,053][106226] Updated weights for policy 0, policy_version 26232 (0.0006) [2023-12-27 19:25:08,103][106226] Updated weights for policy 0, policy_version 26242 (0.0007) [2023-12-27 19:25:08,480][106225] Updated weights for policy 1, policy_version 26138 (0.0010) [2023-12-27 19:25:08,544][106225] Updated weights for policy 1, policy_version 26148 (0.0010) [2023-12-27 19:25:08,605][106225] Updated weights for policy 1, policy_version 26158 (0.0010) [2023-12-27 19:25:08,671][106225] Updated weights for policy 1, policy_version 26168 (0.0010) [2023-12-27 19:25:08,815][106226] Updated weights for policy 0, policy_version 26252 (0.0009) [2023-12-27 19:25:08,880][106226] Updated weights for policy 0, policy_version 26262 (0.0008) [2023-12-27 19:25:08,940][106226] Updated weights for policy 0, policy_version 26272 (0.0008) [2023-12-27 19:25:09,419][106225] Updated weights for policy 1, policy_version 26178 (0.0008) [2023-12-27 19:25:09,481][106225] Updated weights for policy 1, policy_version 26188 (0.0008) [2023-12-27 19:25:09,536][106225] Updated weights for policy 1, policy_version 26198 (0.0007) [2023-12-27 19:25:09,687][106226] Updated weights for policy 0, policy_version 26282 (0.0009) [2023-12-27 19:25:09,742][106226] Updated weights for policy 0, policy_version 26292 (0.0010) [2023-12-27 19:25:09,805][106226] Updated weights for policy 0, policy_version 26302 (0.0011) [2023-12-27 19:25:09,876][106226] Updated weights for policy 0, policy_version 26312 (0.0011) [2023-12-27 19:25:10,274][106225] Updated weights for policy 1, policy_version 26208 (0.0009) [2023-12-27 19:25:10,326][106225] Updated weights for policy 1, policy_version 26218 (0.0008) [2023-12-27 19:25:10,393][106225] Updated weights for policy 1, policy_version 26228 (0.0008) [2023-12-27 19:25:10,554][106226] Updated weights for policy 0, policy_version 26322 (0.0005) [2023-12-27 19:25:10,609][106226] Updated weights for policy 0, policy_version 26332 (0.0007) [2023-12-27 19:25:10,671][106226] Updated weights for policy 0, policy_version 26342 (0.0009) [2023-12-27 19:25:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 13467648. Throughput: 0: 9966.3, 1: 10010.4. Samples: 13443800. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-27 19:25:11,176][105115] Avg episode reward: [(0, '-5.209'), (1, '-6.730')] [2023-12-27 19:25:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000026232_6717440.pth... [2023-12-27 19:25:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000026344_6750208.pth... [2023-12-27 19:25:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000025192_6455296.pth [2023-12-27 19:25:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000025080_6422528.pth [2023-12-27 19:25:11,294][106226] Updated weights for policy 0, policy_version 26352 (0.0011) [2023-12-27 19:25:11,297][106225] Updated weights for policy 1, policy_version 26238 (0.0008) [2023-12-27 19:25:11,353][106226] Updated weights for policy 0, policy_version 26362 (0.0009) [2023-12-27 19:25:11,358][106225] Updated weights for policy 1, policy_version 26248 (0.0006) [2023-12-27 19:25:11,424][106226] Updated weights for policy 0, policy_version 26372 (0.0009) [2023-12-27 19:25:11,435][106225] Updated weights for policy 1, policy_version 26258 (0.0008) [2023-12-27 19:25:12,163][106226] Updated weights for policy 0, policy_version 26382 (0.0007) [2023-12-27 19:25:12,175][106225] Updated weights for policy 1, policy_version 26268 (0.0007) [2023-12-27 19:25:12,229][106226] Updated weights for policy 0, policy_version 26392 (0.0010) [2023-12-27 19:25:12,241][106225] Updated weights for policy 1, policy_version 26278 (0.0011) [2023-12-27 19:25:12,294][106226] Updated weights for policy 0, policy_version 26402 (0.0008) [2023-12-27 19:25:12,305][106225] Updated weights for policy 1, policy_version 26288 (0.0010) [2023-12-27 19:25:12,981][106226] Updated weights for policy 0, policy_version 26412 (0.0009) [2023-12-27 19:25:13,010][106225] Updated weights for policy 1, policy_version 26298 (0.0008) [2023-12-27 19:25:13,031][106226] Updated weights for policy 0, policy_version 26422 (0.0010) [2023-12-27 19:25:13,061][106225] Updated weights for policy 1, policy_version 26308 (0.0006) [2023-12-27 19:25:13,108][106226] Updated weights for policy 0, policy_version 26432 (0.0011) [2023-12-27 19:25:13,111][106225] Updated weights for policy 1, policy_version 26318 (0.0005) [2023-12-27 19:25:13,158][106225] Updated weights for policy 1, policy_version 26328 (0.0005) [2023-12-27 19:25:13,720][106226] Updated weights for policy 0, policy_version 26442 (0.0009) [2023-12-27 19:25:13,720][106225] Updated weights for policy 1, policy_version 26338 (0.0006) [2023-12-27 19:25:13,771][106226] Updated weights for policy 0, policy_version 26452 (0.0005) [2023-12-27 19:25:13,775][106225] Updated weights for policy 1, policy_version 26348 (0.0005) [2023-12-27 19:25:13,832][106226] Updated weights for policy 0, policy_version 26462 (0.0006) [2023-12-27 19:25:13,839][106225] Updated weights for policy 1, policy_version 26358 (0.0005) [2023-12-27 19:25:13,897][106226] Updated weights for policy 0, policy_version 26472 (0.0006) [2023-12-27 19:25:14,360][106225] Updated weights for policy 1, policy_version 26368 (0.0005) [2023-12-27 19:25:14,427][106225] Updated weights for policy 1, policy_version 26378 (0.0005) [2023-12-27 19:25:14,482][106225] Updated weights for policy 1, policy_version 26388 (0.0006) [2023-12-27 19:25:14,557][106226] Updated weights for policy 0, policy_version 26482 (0.0008) [2023-12-27 19:25:14,619][106226] Updated weights for policy 0, policy_version 26492 (0.0008) [2023-12-27 19:25:14,667][106226] Updated weights for policy 0, policy_version 26502 (0.0008) [2023-12-27 19:25:15,231][106225] Updated weights for policy 1, policy_version 26398 (0.0009) [2023-12-27 19:25:15,278][106226] Updated weights for policy 0, policy_version 26512 (0.0006) [2023-12-27 19:25:15,294][106225] Updated weights for policy 1, policy_version 26408 (0.0007) [2023-12-27 19:25:15,337][106226] Updated weights for policy 0, policy_version 26522 (0.0010) [2023-12-27 19:25:15,348][106225] Updated weights for policy 1, policy_version 26418 (0.0008) [2023-12-27 19:25:15,398][106226] Updated weights for policy 0, policy_version 26532 (0.0007) [2023-12-27 19:25:15,952][106225] Updated weights for policy 1, policy_version 26428 (0.0010) [2023-12-27 19:25:16,003][106225] Updated weights for policy 1, policy_version 26438 (0.0009) [2023-12-27 19:25:16,018][106226] Updated weights for policy 0, policy_version 26542 (0.0005) [2023-12-27 19:25:16,057][106225] Updated weights for policy 1, policy_version 26448 (0.0005) [2023-12-27 19:25:16,084][106226] Updated weights for policy 0, policy_version 26552 (0.0005) [2023-12-27 19:25:16,146][106226] Updated weights for policy 0, policy_version 26562 (0.0005) [2023-12-27 19:25:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 13574144. Throughput: 0: 10002.9, 1: 10008.3. Samples: 13564424. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 19:25:16,175][105115] Avg episode reward: [(0, '-5.343'), (1, '-6.923')] [2023-12-27 19:25:16,612][106225] Updated weights for policy 1, policy_version 26458 (0.0005) [2023-12-27 19:25:16,678][106225] Updated weights for policy 1, policy_version 26468 (0.0007) [2023-12-27 19:25:16,685][106226] Updated weights for policy 0, policy_version 26572 (0.0010) [2023-12-27 19:25:16,740][106225] Updated weights for policy 1, policy_version 26478 (0.0006) [2023-12-27 19:25:16,749][106226] Updated weights for policy 0, policy_version 26582 (0.0010) [2023-12-27 19:25:16,796][106225] Updated weights for policy 1, policy_version 26488 (0.0006) [2023-12-27 19:25:16,813][106226] Updated weights for policy 0, policy_version 26592 (0.0010) [2023-12-27 19:25:17,479][106225] Updated weights for policy 1, policy_version 26498 (0.0008) [2023-12-27 19:25:17,517][106226] Updated weights for policy 0, policy_version 26602 (0.0010) [2023-12-27 19:25:17,538][106225] Updated weights for policy 1, policy_version 26508 (0.0007) [2023-12-27 19:25:17,576][106226] Updated weights for policy 0, policy_version 26612 (0.0010) [2023-12-27 19:25:17,590][106225] Updated weights for policy 1, policy_version 26518 (0.0006) [2023-12-27 19:25:17,633][106226] Updated weights for policy 0, policy_version 26622 (0.0010) [2023-12-27 19:25:17,690][106226] Updated weights for policy 0, policy_version 26632 (0.0010) [2023-12-27 19:25:18,269][106226] Updated weights for policy 0, policy_version 26642 (0.0005) [2023-12-27 19:25:18,328][106226] Updated weights for policy 0, policy_version 26652 (0.0006) [2023-12-27 19:25:18,399][106225] Updated weights for policy 1, policy_version 26528 (0.0008) [2023-12-27 19:25:18,402][106226] Updated weights for policy 0, policy_version 26662 (0.0009) [2023-12-27 19:25:18,458][106225] Updated weights for policy 1, policy_version 26538 (0.0010) [2023-12-27 19:25:18,524][106225] Updated weights for policy 1, policy_version 26548 (0.0008) [2023-12-27 19:25:18,993][106226] Updated weights for policy 0, policy_version 26672 (0.0009) [2023-12-27 19:25:19,047][106226] Updated weights for policy 0, policy_version 26682 (0.0005) [2023-12-27 19:25:19,109][106226] Updated weights for policy 0, policy_version 26692 (0.0006) [2023-12-27 19:25:19,312][106225] Updated weights for policy 1, policy_version 26558 (0.0009) [2023-12-27 19:25:19,380][106225] Updated weights for policy 1, policy_version 26568 (0.0008) [2023-12-27 19:25:19,443][106225] Updated weights for policy 1, policy_version 26578 (0.0008) [2023-12-27 19:25:19,773][106226] Updated weights for policy 0, policy_version 26702 (0.0006) [2023-12-27 19:25:19,841][106226] Updated weights for policy 0, policy_version 26712 (0.0007) [2023-12-27 19:25:19,904][106226] Updated weights for policy 0, policy_version 26722 (0.0009) [2023-12-27 19:25:20,239][106225] Updated weights for policy 1, policy_version 26588 (0.0008) [2023-12-27 19:25:20,290][106225] Updated weights for policy 1, policy_version 26598 (0.0009) [2023-12-27 19:25:20,344][106225] Updated weights for policy 1, policy_version 26608 (0.0008) [2023-12-27 19:25:20,587][106226] Updated weights for policy 0, policy_version 26732 (0.0009) [2023-12-27 19:25:20,650][106226] Updated weights for policy 0, policy_version 26742 (0.0006) [2023-12-27 19:25:20,705][106226] Updated weights for policy 0, policy_version 26752 (0.0007) [2023-12-27 19:25:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 13672448. Throughput: 0: 10099.6, 1: 9947.0. Samples: 13686164. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 19:25:21,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-7.465')] [2023-12-27 19:25:21,185][106225] Updated weights for policy 1, policy_version 26618 (0.0008) [2023-12-27 19:25:21,256][106225] Updated weights for policy 1, policy_version 26628 (0.0009) [2023-12-27 19:25:21,324][106225] Updated weights for policy 1, policy_version 26638 (0.0006) [2023-12-27 19:25:21,354][106226] Updated weights for policy 0, policy_version 26762 (0.0007) [2023-12-27 19:25:21,403][106225] Updated weights for policy 1, policy_version 26648 (0.0008) [2023-12-27 19:25:21,427][106226] Updated weights for policy 0, policy_version 26772 (0.0008) [2023-12-27 19:25:21,488][106226] Updated weights for policy 0, policy_version 26782 (0.0009) [2023-12-27 19:25:21,554][106226] Updated weights for policy 0, policy_version 26792 (0.0008) [2023-12-27 19:25:22,131][106225] Updated weights for policy 1, policy_version 26658 (0.0006) [2023-12-27 19:25:22,203][106225] Updated weights for policy 1, policy_version 26668 (0.0006) [2023-12-27 19:25:22,259][106225] Updated weights for policy 1, policy_version 26678 (0.0008) [2023-12-27 19:25:22,272][106226] Updated weights for policy 0, policy_version 26802 (0.0007) [2023-12-27 19:25:22,337][106226] Updated weights for policy 0, policy_version 26812 (0.0008) [2023-12-27 19:25:22,409][106226] Updated weights for policy 0, policy_version 26822 (0.0008) [2023-12-27 19:25:22,899][106225] Updated weights for policy 1, policy_version 26688 (0.0007) [2023-12-27 19:25:22,950][106225] Updated weights for policy 1, policy_version 26698 (0.0008) [2023-12-27 19:25:23,000][106225] Updated weights for policy 1, policy_version 26708 (0.0005) [2023-12-27 19:25:23,149][106226] Updated weights for policy 0, policy_version 26832 (0.0008) [2023-12-27 19:25:23,205][106226] Updated weights for policy 0, policy_version 26842 (0.0008) [2023-12-27 19:25:23,277][106226] Updated weights for policy 0, policy_version 26852 (0.0008) [2023-12-27 19:25:23,706][106225] Updated weights for policy 1, policy_version 26718 (0.0007) [2023-12-27 19:25:23,766][106225] Updated weights for policy 1, policy_version 26728 (0.0010) [2023-12-27 19:25:23,818][106225] Updated weights for policy 1, policy_version 26738 (0.0010) [2023-12-27 19:25:23,869][106226] Updated weights for policy 0, policy_version 26862 (0.0007) [2023-12-27 19:25:23,933][106226] Updated weights for policy 0, policy_version 26872 (0.0005) [2023-12-27 19:25:23,999][106226] Updated weights for policy 0, policy_version 26882 (0.0005) [2023-12-27 19:25:24,408][106225] Updated weights for policy 1, policy_version 26748 (0.0009) [2023-12-27 19:25:24,466][106225] Updated weights for policy 1, policy_version 26758 (0.0005) [2023-12-27 19:25:24,523][106225] Updated weights for policy 1, policy_version 26768 (0.0005) [2023-12-27 19:25:24,606][106226] Updated weights for policy 0, policy_version 26892 (0.0006) [2023-12-27 19:25:24,664][106226] Updated weights for policy 0, policy_version 26902 (0.0009) [2023-12-27 19:25:24,730][106226] Updated weights for policy 0, policy_version 26912 (0.0010) [2023-12-27 19:25:25,100][106225] Updated weights for policy 1, policy_version 26778 (0.0005) [2023-12-27 19:25:25,145][106225] Updated weights for policy 1, policy_version 26788 (0.0005) [2023-12-27 19:25:25,196][106225] Updated weights for policy 1, policy_version 26798 (0.0008) [2023-12-27 19:25:25,252][106225] Updated weights for policy 1, policy_version 26808 (0.0010) [2023-12-27 19:25:25,361][106226] Updated weights for policy 0, policy_version 26922 (0.0007) [2023-12-27 19:25:25,408][106226] Updated weights for policy 0, policy_version 26932 (0.0008) [2023-12-27 19:25:25,461][106226] Updated weights for policy 0, policy_version 26942 (0.0007) [2023-12-27 19:25:25,521][106226] Updated weights for policy 0, policy_version 26952 (0.0008) [2023-12-27 19:25:25,958][106225] Updated weights for policy 1, policy_version 26818 (0.0010) [2023-12-27 19:25:26,018][106225] Updated weights for policy 1, policy_version 26828 (0.0010) [2023-12-27 19:25:26,067][106225] Updated weights for policy 1, policy_version 26838 (0.0010) [2023-12-27 19:25:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 13778944. Throughput: 0: 10090.0, 1: 9910.2. Samples: 13745324. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 19:25:26,175][105115] Avg episode reward: [(0, '-5.413'), (1, '-6.967')] [2023-12-27 19:25:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000026840_6873088.pth... [2023-12-27 19:25:26,186][106226] Updated weights for policy 0, policy_version 26962 (0.0005) [2023-12-27 19:25:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000025656_6569984.pth [2023-12-27 19:25:26,244][106226] Updated weights for policy 0, policy_version 26972 (0.0008) [2023-12-27 19:25:26,307][106226] Updated weights for policy 0, policy_version 26982 (0.0009) [2023-12-27 19:25:26,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000026984_6914048.pth... [2023-12-27 19:25:26,318][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000025768_6602752.pth [2023-12-27 19:25:26,800][106225] Updated weights for policy 1, policy_version 26848 (0.0010) [2023-12-27 19:25:26,833][106226] Updated weights for policy 0, policy_version 26992 (0.0006) [2023-12-27 19:25:26,854][106225] Updated weights for policy 1, policy_version 26858 (0.0010) [2023-12-27 19:25:26,891][106226] Updated weights for policy 0, policy_version 27002 (0.0005) [2023-12-27 19:25:26,904][106225] Updated weights for policy 1, policy_version 26868 (0.0010) [2023-12-27 19:25:26,946][106226] Updated weights for policy 0, policy_version 27012 (0.0006) [2023-12-27 19:25:27,583][106225] Updated weights for policy 1, policy_version 26878 (0.0007) [2023-12-27 19:25:27,643][106225] Updated weights for policy 1, policy_version 26888 (0.0006) [2023-12-27 19:25:27,693][106226] Updated weights for policy 0, policy_version 27022 (0.0008) [2023-12-27 19:25:27,700][106225] Updated weights for policy 1, policy_version 26898 (0.0006) [2023-12-27 19:25:27,750][106226] Updated weights for policy 0, policy_version 27032 (0.0007) [2023-12-27 19:25:27,797][106226] Updated weights for policy 0, policy_version 27042 (0.0009) [2023-12-27 19:25:28,255][106225] Updated weights for policy 1, policy_version 26908 (0.0007) [2023-12-27 19:25:28,311][106225] Updated weights for policy 1, policy_version 26918 (0.0008) [2023-12-27 19:25:28,380][106225] Updated weights for policy 1, policy_version 26928 (0.0008) [2023-12-27 19:25:28,640][106226] Updated weights for policy 0, policy_version 27052 (0.0010) [2023-12-27 19:25:28,693][106226] Updated weights for policy 0, policy_version 27062 (0.0009) [2023-12-27 19:25:28,754][106226] Updated weights for policy 0, policy_version 27072 (0.0008) [2023-12-27 19:25:28,940][106225] Updated weights for policy 1, policy_version 26938 (0.0006) [2023-12-27 19:25:28,994][106225] Updated weights for policy 1, policy_version 26948 (0.0008) [2023-12-27 19:25:29,055][106225] Updated weights for policy 1, policy_version 26958 (0.0008) [2023-12-27 19:25:29,106][106225] Updated weights for policy 1, policy_version 26968 (0.0005) [2023-12-27 19:25:29,524][106226] Updated weights for policy 0, policy_version 27082 (0.0010) [2023-12-27 19:25:29,579][106226] Updated weights for policy 0, policy_version 27092 (0.0009) [2023-12-27 19:25:29,640][106226] Updated weights for policy 0, policy_version 27102 (0.0009) [2023-12-27 19:25:29,707][106226] Updated weights for policy 0, policy_version 27112 (0.0009) [2023-12-27 19:25:29,723][106225] Updated weights for policy 1, policy_version 26978 (0.0006) [2023-12-27 19:25:29,776][106225] Updated weights for policy 1, policy_version 26988 (0.0008) [2023-12-27 19:25:29,831][106225] Updated weights for policy 1, policy_version 26998 (0.0008) [2023-12-27 19:25:30,421][106226] Updated weights for policy 0, policy_version 27122 (0.0005) [2023-12-27 19:25:30,475][106226] Updated weights for policy 0, policy_version 27132 (0.0008) [2023-12-27 19:25:30,533][106226] Updated weights for policy 0, policy_version 27142 (0.0006) [2023-12-27 19:25:30,571][106225] Updated weights for policy 1, policy_version 27008 (0.0008) [2023-12-27 19:25:30,618][106225] Updated weights for policy 1, policy_version 27018 (0.0010) [2023-12-27 19:25:30,668][106225] Updated weights for policy 1, policy_version 27028 (0.0010) [2023-12-27 19:25:31,173][106226] Updated weights for policy 0, policy_version 27152 (0.0007) [2023-12-27 19:25:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 13877248. Throughput: 0: 10164.6, 1: 10056.4. Samples: 13870816. Policy #0 lag: (min: 18.0, avg: 37.8, max: 50.0) [2023-12-27 19:25:31,175][105115] Avg episode reward: [(0, '-5.398'), (1, '-6.932')] [2023-12-27 19:25:31,236][106226] Updated weights for policy 0, policy_version 27162 (0.0010) [2023-12-27 19:25:31,301][106226] Updated weights for policy 0, policy_version 27172 (0.0009) [2023-12-27 19:25:31,385][106225] Updated weights for policy 1, policy_version 27038 (0.0009) [2023-12-27 19:25:31,448][106225] Updated weights for policy 1, policy_version 27048 (0.0008) [2023-12-27 19:25:31,495][106225] Updated weights for policy 1, policy_version 27058 (0.0008) [2023-12-27 19:25:32,037][106226] Updated weights for policy 0, policy_version 27182 (0.0008) [2023-12-27 19:25:32,102][106226] Updated weights for policy 0, policy_version 27192 (0.0010) [2023-12-27 19:25:32,140][106225] Updated weights for policy 1, policy_version 27068 (0.0008) [2023-12-27 19:25:32,164][106226] Updated weights for policy 0, policy_version 27202 (0.0006) [2023-12-27 19:25:32,198][106225] Updated weights for policy 1, policy_version 27078 (0.0007) [2023-12-27 19:25:32,251][106225] Updated weights for policy 1, policy_version 27088 (0.0006) [2023-12-27 19:25:32,850][106226] Updated weights for policy 0, policy_version 27212 (0.0008) [2023-12-27 19:25:32,902][106225] Updated weights for policy 1, policy_version 27098 (0.0007) [2023-12-27 19:25:32,914][106226] Updated weights for policy 0, policy_version 27222 (0.0011) [2023-12-27 19:25:32,953][106225] Updated weights for policy 1, policy_version 27108 (0.0008) [2023-12-27 19:25:32,972][106226] Updated weights for policy 0, policy_version 27232 (0.0008) [2023-12-27 19:25:33,007][106225] Updated weights for policy 1, policy_version 27118 (0.0005) [2023-12-27 19:25:33,062][106225] Updated weights for policy 1, policy_version 27128 (0.0007) [2023-12-27 19:25:33,621][106226] Updated weights for policy 0, policy_version 27242 (0.0009) [2023-12-27 19:25:33,680][106226] Updated weights for policy 0, policy_version 27252 (0.0005) [2023-12-27 19:25:33,695][106225] Updated weights for policy 1, policy_version 27138 (0.0008) [2023-12-27 19:25:33,737][106226] Updated weights for policy 0, policy_version 27262 (0.0005) [2023-12-27 19:25:33,749][106225] Updated weights for policy 1, policy_version 27148 (0.0010) [2023-12-27 19:25:33,795][106226] Updated weights for policy 0, policy_version 27272 (0.0005) [2023-12-27 19:25:33,803][106225] Updated weights for policy 1, policy_version 27158 (0.0009) [2023-12-27 19:25:34,359][106226] Updated weights for policy 0, policy_version 27282 (0.0011) [2023-12-27 19:25:34,420][106226] Updated weights for policy 0, policy_version 27292 (0.0011) [2023-12-27 19:25:34,435][106225] Updated weights for policy 1, policy_version 27168 (0.0010) [2023-12-27 19:25:34,482][106226] Updated weights for policy 0, policy_version 27302 (0.0011) [2023-12-27 19:25:34,490][106225] Updated weights for policy 1, policy_version 27178 (0.0010) [2023-12-27 19:25:34,550][106225] Updated weights for policy 1, policy_version 27188 (0.0010) [2023-12-27 19:25:35,205][106226] Updated weights for policy 0, policy_version 27312 (0.0010) [2023-12-27 19:25:35,212][106225] Updated weights for policy 1, policy_version 27198 (0.0007) [2023-12-27 19:25:35,262][106226] Updated weights for policy 0, policy_version 27322 (0.0010) [2023-12-27 19:25:35,264][106225] Updated weights for policy 1, policy_version 27208 (0.0006) [2023-12-27 19:25:35,312][106225] Updated weights for policy 1, policy_version 27218 (0.0007) [2023-12-27 19:25:35,322][106226] Updated weights for policy 0, policy_version 27332 (0.0009) [2023-12-27 19:25:35,906][106226] Updated weights for policy 0, policy_version 27342 (0.0008) [2023-12-27 19:25:35,965][106226] Updated weights for policy 0, policy_version 27352 (0.0010) [2023-12-27 19:25:36,014][106226] Updated weights for policy 0, policy_version 27362 (0.0010) [2023-12-27 19:25:36,063][106225] Updated weights for policy 1, policy_version 27228 (0.0007) [2023-12-27 19:25:36,126][106225] Updated weights for policy 1, policy_version 27238 (0.0008) [2023-12-27 19:25:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 13983744. Throughput: 0: 10244.3, 1: 10149.1. Samples: 13994544. Policy #0 lag: (min: 18.0, avg: 37.8, max: 50.0) [2023-12-27 19:25:36,175][105115] Avg episode reward: [(0, '-5.202'), (1, '-7.442')] [2023-12-27 19:25:36,188][106225] Updated weights for policy 1, policy_version 27248 (0.0006) [2023-12-27 19:25:36,684][106226] Updated weights for policy 0, policy_version 27372 (0.0009) [2023-12-27 19:25:36,746][106226] Updated weights for policy 0, policy_version 27382 (0.0006) [2023-12-27 19:25:36,805][106226] Updated weights for policy 0, policy_version 27392 (0.0007) [2023-12-27 19:25:36,974][106225] Updated weights for policy 1, policy_version 27258 (0.0007) [2023-12-27 19:25:37,033][106225] Updated weights for policy 1, policy_version 27268 (0.0008) [2023-12-27 19:25:37,081][106225] Updated weights for policy 1, policy_version 27278 (0.0008) [2023-12-27 19:25:37,146][106225] Updated weights for policy 1, policy_version 27288 (0.0008) [2023-12-27 19:25:37,432][106226] Updated weights for policy 0, policy_version 27402 (0.0006) [2023-12-27 19:25:37,490][106226] Updated weights for policy 0, policy_version 27412 (0.0007) [2023-12-27 19:25:37,552][106226] Updated weights for policy 0, policy_version 27422 (0.0005) [2023-12-27 19:25:37,610][106226] Updated weights for policy 0, policy_version 27432 (0.0007) [2023-12-27 19:25:37,860][106225] Updated weights for policy 1, policy_version 27298 (0.0010) [2023-12-27 19:25:37,910][106225] Updated weights for policy 1, policy_version 27308 (0.0010) [2023-12-27 19:25:37,964][106225] Updated weights for policy 1, policy_version 27318 (0.0010) [2023-12-27 19:25:38,306][106226] Updated weights for policy 0, policy_version 27442 (0.0008) [2023-12-27 19:25:38,372][106226] Updated weights for policy 0, policy_version 27452 (0.0009) [2023-12-27 19:25:38,431][106226] Updated weights for policy 0, policy_version 27462 (0.0009) [2023-12-27 19:25:38,729][106225] Updated weights for policy 1, policy_version 27328 (0.0010) [2023-12-27 19:25:38,787][106225] Updated weights for policy 1, policy_version 27338 (0.0008) [2023-12-27 19:25:38,842][106225] Updated weights for policy 1, policy_version 27348 (0.0007) [2023-12-27 19:25:39,150][106226] Updated weights for policy 0, policy_version 27472 (0.0006) [2023-12-27 19:25:39,218][106226] Updated weights for policy 0, policy_version 27482 (0.0006) [2023-12-27 19:25:39,288][106226] Updated weights for policy 0, policy_version 27492 (0.0007) [2023-12-27 19:25:39,623][106225] Updated weights for policy 1, policy_version 27358 (0.0009) [2023-12-27 19:25:39,683][106225] Updated weights for policy 1, policy_version 27368 (0.0008) [2023-12-27 19:25:39,748][106225] Updated weights for policy 1, policy_version 27378 (0.0009) [2023-12-27 19:25:39,949][106226] Updated weights for policy 0, policy_version 27502 (0.0008) [2023-12-27 19:25:40,007][106226] Updated weights for policy 0, policy_version 27512 (0.0009) [2023-12-27 19:25:40,069][106226] Updated weights for policy 0, policy_version 27522 (0.0008) [2023-12-27 19:25:40,531][106225] Updated weights for policy 1, policy_version 27388 (0.0009) [2023-12-27 19:25:40,582][106225] Updated weights for policy 1, policy_version 27398 (0.0010) [2023-12-27 19:25:40,642][106225] Updated weights for policy 1, policy_version 27408 (0.0010) [2023-12-27 19:25:40,734][106226] Updated weights for policy 0, policy_version 27532 (0.0008) [2023-12-27 19:25:40,780][106226] Updated weights for policy 0, policy_version 27542 (0.0006) [2023-12-27 19:25:40,831][106226] Updated weights for policy 0, policy_version 27552 (0.0008) [2023-12-27 19:25:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 14082048. Throughput: 0: 10280.9, 1: 10038.8. Samples: 14053732. Policy #0 lag: (min: 18.0, avg: 37.8, max: 50.0) [2023-12-27 19:25:41,175][105115] Avg episode reward: [(0, '-5.383'), (1, '-6.943')] [2023-12-27 19:25:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000027416_7020544.pth... [2023-12-27 19:25:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000027560_7061504.pth... [2023-12-27 19:25:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000026344_6750208.pth [2023-12-27 19:25:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000026232_6717440.pth [2023-12-27 19:25:41,406][106225] Updated weights for policy 1, policy_version 27418 (0.0010) [2023-12-27 19:25:41,476][106225] Updated weights for policy 1, policy_version 27428 (0.0009) [2023-12-27 19:25:41,528][106225] Updated weights for policy 1, policy_version 27438 (0.0008) [2023-12-27 19:25:41,591][106225] Updated weights for policy 1, policy_version 27448 (0.0007) [2023-12-27 19:25:41,630][106226] Updated weights for policy 0, policy_version 27562 (0.0008) [2023-12-27 19:25:41,703][106226] Updated weights for policy 0, policy_version 27572 (0.0007) [2023-12-27 19:25:41,779][106226] Updated weights for policy 0, policy_version 27582 (0.0008) [2023-12-27 19:25:41,838][106226] Updated weights for policy 0, policy_version 27592 (0.0007) [2023-12-27 19:25:42,318][106225] Updated weights for policy 1, policy_version 27458 (0.0009) [2023-12-27 19:25:42,389][106225] Updated weights for policy 1, policy_version 27468 (0.0009) [2023-12-27 19:25:42,449][106225] Updated weights for policy 1, policy_version 27478 (0.0009) [2023-12-27 19:25:42,591][106226] Updated weights for policy 0, policy_version 27602 (0.0008) [2023-12-27 19:25:42,653][106226] Updated weights for policy 0, policy_version 27612 (0.0009) [2023-12-27 19:25:42,712][106226] Updated weights for policy 0, policy_version 27622 (0.0009) [2023-12-27 19:25:43,133][106225] Updated weights for policy 1, policy_version 27488 (0.0008) [2023-12-27 19:25:43,188][106225] Updated weights for policy 1, policy_version 27498 (0.0009) [2023-12-27 19:25:43,233][106225] Updated weights for policy 1, policy_version 27508 (0.0008) [2023-12-27 19:25:43,499][106226] Updated weights for policy 0, policy_version 27632 (0.0009) [2023-12-27 19:25:43,556][106226] Updated weights for policy 0, policy_version 27642 (0.0008) [2023-12-27 19:25:43,602][106226] Updated weights for policy 0, policy_version 27652 (0.0005) [2023-12-27 19:25:43,814][106225] Updated weights for policy 1, policy_version 27518 (0.0006) [2023-12-27 19:25:43,878][106225] Updated weights for policy 1, policy_version 27528 (0.0006) [2023-12-27 19:25:43,932][106225] Updated weights for policy 1, policy_version 27538 (0.0006) [2023-12-27 19:25:44,159][106226] Updated weights for policy 0, policy_version 27662 (0.0005) [2023-12-27 19:25:44,215][106226] Updated weights for policy 0, policy_version 27672 (0.0005) [2023-12-27 19:25:44,272][106226] Updated weights for policy 0, policy_version 27682 (0.0005) [2023-12-27 19:25:44,473][106225] Updated weights for policy 1, policy_version 27548 (0.0007) [2023-12-27 19:25:44,540][106225] Updated weights for policy 1, policy_version 27558 (0.0005) [2023-12-27 19:25:44,607][106225] Updated weights for policy 1, policy_version 27568 (0.0007) [2023-12-27 19:25:44,888][106226] Updated weights for policy 0, policy_version 27692 (0.0007) [2023-12-27 19:25:44,949][106226] Updated weights for policy 0, policy_version 27702 (0.0008) [2023-12-27 19:25:45,000][106226] Updated weights for policy 0, policy_version 27712 (0.0009) [2023-12-27 19:25:45,156][106225] Updated weights for policy 1, policy_version 27578 (0.0006) [2023-12-27 19:25:45,217][106225] Updated weights for policy 1, policy_version 27588 (0.0006) [2023-12-27 19:25:45,284][106225] Updated weights for policy 1, policy_version 27598 (0.0010) [2023-12-27 19:25:45,351][106225] Updated weights for policy 1, policy_version 27608 (0.0009) [2023-12-27 19:25:45,657][106226] Updated weights for policy 0, policy_version 27722 (0.0009) [2023-12-27 19:25:45,717][106226] Updated weights for policy 0, policy_version 27732 (0.0005) [2023-12-27 19:25:45,776][106226] Updated weights for policy 0, policy_version 27742 (0.0005) [2023-12-27 19:25:45,847][106226] Updated weights for policy 0, policy_version 27752 (0.0006) [2023-12-27 19:25:46,150][106225] Updated weights for policy 1, policy_version 27618 (0.0009) [2023-12-27 19:25:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.5, 300 sec: 19966.3). Total num frames: 14180352. Throughput: 0: 10242.2, 1: 10011.3. Samples: 14172996. Policy #0 lag: (min: 18.0, avg: 37.8, max: 50.0) [2023-12-27 19:25:46,175][105115] Avg episode reward: [(0, '-5.473'), (1, '-6.871')] [2023-12-27 19:25:46,209][106225] Updated weights for policy 1, policy_version 27628 (0.0006) [2023-12-27 19:25:46,260][106225] Updated weights for policy 1, policy_version 27638 (0.0005) [2023-12-27 19:25:46,330][106226] Updated weights for policy 0, policy_version 27762 (0.0009) [2023-12-27 19:25:46,379][106226] Updated weights for policy 0, policy_version 27772 (0.0008) [2023-12-27 19:25:46,437][106226] Updated weights for policy 0, policy_version 27782 (0.0008) [2023-12-27 19:25:46,912][106225] Updated weights for policy 1, policy_version 27648 (0.0005) [2023-12-27 19:25:46,962][106225] Updated weights for policy 1, policy_version 27658 (0.0007) [2023-12-27 19:25:47,008][106225] Updated weights for policy 1, policy_version 27668 (0.0007) [2023-12-27 19:25:47,195][106226] Updated weights for policy 0, policy_version 27792 (0.0010) [2023-12-27 19:25:47,244][106226] Updated weights for policy 0, policy_version 27802 (0.0010) [2023-12-27 19:25:47,299][106226] Updated weights for policy 0, policy_version 27812 (0.0010) [2023-12-27 19:25:47,735][106225] Updated weights for policy 1, policy_version 27678 (0.0009) [2023-12-27 19:25:47,789][106225] Updated weights for policy 1, policy_version 27688 (0.0010) [2023-12-27 19:25:47,853][106225] Updated weights for policy 1, policy_version 27698 (0.0007) [2023-12-27 19:25:47,995][106226] Updated weights for policy 0, policy_version 27822 (0.0011) [2023-12-27 19:25:48,055][106226] Updated weights for policy 0, policy_version 27832 (0.0010) [2023-12-27 19:25:48,117][106226] Updated weights for policy 0, policy_version 27842 (0.0011) [2023-12-27 19:25:48,520][106225] Updated weights for policy 1, policy_version 27708 (0.0009) [2023-12-27 19:25:48,580][106225] Updated weights for policy 1, policy_version 27718 (0.0010) [2023-12-27 19:25:48,644][106225] Updated weights for policy 1, policy_version 27728 (0.0009) [2023-12-27 19:25:48,799][106226] Updated weights for policy 0, policy_version 27852 (0.0010) [2023-12-27 19:25:48,865][106226] Updated weights for policy 0, policy_version 27862 (0.0010) [2023-12-27 19:25:48,929][106226] Updated weights for policy 0, policy_version 27872 (0.0010) [2023-12-27 19:25:49,272][106225] Updated weights for policy 1, policy_version 27738 (0.0010) [2023-12-27 19:25:49,329][106225] Updated weights for policy 1, policy_version 27748 (0.0010) [2023-12-27 19:25:49,396][106225] Updated weights for policy 1, policy_version 27759 (0.0009) [2023-12-27 19:25:49,614][106226] Updated weights for policy 0, policy_version 27882 (0.0010) [2023-12-27 19:25:49,682][106226] Updated weights for policy 0, policy_version 27892 (0.0007) [2023-12-27 19:25:49,744][106226] Updated weights for policy 0, policy_version 27902 (0.0008) [2023-12-27 19:25:49,802][106226] Updated weights for policy 0, policy_version 27912 (0.0008) [2023-12-27 19:25:50,147][106225] Updated weights for policy 1, policy_version 27769 (0.0007) [2023-12-27 19:25:50,204][106225] Updated weights for policy 1, policy_version 27779 (0.0010) [2023-12-27 19:25:50,272][106225] Updated weights for policy 1, policy_version 27789 (0.0011) [2023-12-27 19:25:50,334][106225] Updated weights for policy 1, policy_version 27799 (0.0011) [2023-12-27 19:25:50,556][106226] Updated weights for policy 0, policy_version 27922 (0.0008) [2023-12-27 19:25:50,624][106226] Updated weights for policy 0, policy_version 27932 (0.0009) [2023-12-27 19:25:50,689][106226] Updated weights for policy 0, policy_version 27942 (0.0010) [2023-12-27 19:25:51,019][106225] Updated weights for policy 1, policy_version 27809 (0.0008) [2023-12-27 19:25:51,084][106225] Updated weights for policy 1, policy_version 27819 (0.0006) [2023-12-27 19:25:51,150][106225] Updated weights for policy 1, policy_version 27829 (0.0006) [2023-12-27 19:25:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20343.5, 300 sec: 19994.0). Total num frames: 14286848. Throughput: 0: 10215.5, 1: 10002.2. Samples: 14293276. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:25:51,175][105115] Avg episode reward: [(0, '-5.600'), (1, '-6.997')] [2023-12-27 19:25:51,403][106226] Updated weights for policy 0, policy_version 27952 (0.0008) [2023-12-27 19:25:51,464][106226] Updated weights for policy 0, policy_version 27962 (0.0006) [2023-12-27 19:25:51,524][106226] Updated weights for policy 0, policy_version 27972 (0.0008) [2023-12-27 19:25:51,945][106225] Updated weights for policy 1, policy_version 27839 (0.0008) [2023-12-27 19:25:52,000][106225] Updated weights for policy 1, policy_version 27849 (0.0008) [2023-12-27 19:25:52,060][106225] Updated weights for policy 1, policy_version 27859 (0.0009) [2023-12-27 19:25:52,345][106226] Updated weights for policy 0, policy_version 27982 (0.0008) [2023-12-27 19:25:52,413][106226] Updated weights for policy 0, policy_version 27992 (0.0007) [2023-12-27 19:25:52,480][106226] Updated weights for policy 0, policy_version 28002 (0.0006) [2023-12-27 19:25:52,742][106225] Updated weights for policy 1, policy_version 27869 (0.0008) [2023-12-27 19:25:52,806][106225] Updated weights for policy 1, policy_version 27879 (0.0006) [2023-12-27 19:25:52,856][106225] Updated weights for policy 1, policy_version 27889 (0.0005) [2023-12-27 19:25:53,216][106226] Updated weights for policy 0, policy_version 28012 (0.0008) [2023-12-27 19:25:53,276][106226] Updated weights for policy 0, policy_version 28022 (0.0007) [2023-12-27 19:25:53,333][106226] Updated weights for policy 0, policy_version 28032 (0.0007) [2023-12-27 19:25:53,454][106225] Updated weights for policy 1, policy_version 27899 (0.0007) [2023-12-27 19:25:53,505][106225] Updated weights for policy 1, policy_version 27909 (0.0010) [2023-12-27 19:25:53,549][106225] Updated weights for policy 1, policy_version 27919 (0.0010) [2023-12-27 19:25:54,001][106226] Updated weights for policy 0, policy_version 28042 (0.0008) [2023-12-27 19:25:54,053][106226] Updated weights for policy 0, policy_version 28052 (0.0006) [2023-12-27 19:25:54,100][106226] Updated weights for policy 0, policy_version 28062 (0.0008) [2023-12-27 19:25:54,152][106226] Updated weights for policy 0, policy_version 28072 (0.0008) [2023-12-27 19:25:54,280][106225] Updated weights for policy 1, policy_version 27929 (0.0009) [2023-12-27 19:25:54,333][106225] Updated weights for policy 1, policy_version 27939 (0.0007) [2023-12-27 19:25:54,387][106225] Updated weights for policy 1, policy_version 27949 (0.0005) [2023-12-27 19:25:54,448][106225] Updated weights for policy 1, policy_version 27959 (0.0005) [2023-12-27 19:25:54,943][106226] Updated weights for policy 0, policy_version 28082 (0.0008) [2023-12-27 19:25:54,993][106226] Updated weights for policy 0, policy_version 28092 (0.0007) [2023-12-27 19:25:55,032][106225] Updated weights for policy 1, policy_version 27969 (0.0009) [2023-12-27 19:25:55,051][106226] Updated weights for policy 0, policy_version 28102 (0.0007) [2023-12-27 19:25:55,093][106225] Updated weights for policy 1, policy_version 27979 (0.0006) [2023-12-27 19:25:55,151][106225] Updated weights for policy 1, policy_version 27989 (0.0006) [2023-12-27 19:25:55,716][106225] Updated weights for policy 1, policy_version 27999 (0.0009) [2023-12-27 19:25:55,772][106225] Updated weights for policy 1, policy_version 28009 (0.0010) [2023-12-27 19:25:55,828][106225] Updated weights for policy 1, policy_version 28019 (0.0010) [2023-12-27 19:25:55,834][106226] Updated weights for policy 0, policy_version 28112 (0.0008) [2023-12-27 19:25:55,892][106226] Updated weights for policy 0, policy_version 28122 (0.0007) [2023-12-27 19:25:55,952][106226] Updated weights for policy 0, policy_version 28132 (0.0006) [2023-12-27 19:25:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20206.9, 300 sec: 19994.0). Total num frames: 14385152. Throughput: 0: 10167.1, 1: 10005.2. Samples: 14351552. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:25:56,175][105115] Avg episode reward: [(0, '-5.815'), (1, '-6.715')] [2023-12-27 19:25:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000028024_7176192.pth... [2023-12-27 19:25:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000028136_7208960.pth... [2023-12-27 19:25:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000026840_6873088.pth [2023-12-27 19:25:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000026984_6914048.pth [2023-12-27 19:25:56,401][106225] Updated weights for policy 1, policy_version 28029 (0.0008) [2023-12-27 19:25:56,454][106225] Updated weights for policy 1, policy_version 28039 (0.0005) [2023-12-27 19:25:56,515][106225] Updated weights for policy 1, policy_version 28049 (0.0005) [2023-12-27 19:25:56,709][106226] Updated weights for policy 0, policy_version 28142 (0.0006) [2023-12-27 19:25:56,753][106226] Updated weights for policy 0, policy_version 28152 (0.0007) [2023-12-27 19:25:56,812][106226] Updated weights for policy 0, policy_version 28162 (0.0008) [2023-12-27 19:25:57,162][106225] Updated weights for policy 1, policy_version 28059 (0.0007) [2023-12-27 19:25:57,214][106225] Updated weights for policy 1, policy_version 28069 (0.0010) [2023-12-27 19:25:57,259][106225] Updated weights for policy 1, policy_version 28079 (0.0009) [2023-12-27 19:25:57,549][106226] Updated weights for policy 0, policy_version 28172 (0.0008) [2023-12-27 19:25:57,597][106226] Updated weights for policy 0, policy_version 28182 (0.0009) [2023-12-27 19:25:57,643][106226] Updated weights for policy 0, policy_version 28192 (0.0010) [2023-12-27 19:25:57,986][106225] Updated weights for policy 1, policy_version 28089 (0.0006) [2023-12-27 19:25:58,048][106225] Updated weights for policy 1, policy_version 28099 (0.0008) [2023-12-27 19:25:58,108][106225] Updated weights for policy 1, policy_version 28109 (0.0008) [2023-12-27 19:25:58,156][106225] Updated weights for policy 1, policy_version 28119 (0.0008) [2023-12-27 19:25:58,329][106226] Updated weights for policy 0, policy_version 28202 (0.0010) [2023-12-27 19:25:58,399][106226] Updated weights for policy 0, policy_version 28212 (0.0007) [2023-12-27 19:25:58,463][106226] Updated weights for policy 0, policy_version 28222 (0.0009) [2023-12-27 19:25:58,534][106226] Updated weights for policy 0, policy_version 28232 (0.0011) [2023-12-27 19:25:59,119][106225] Updated weights for policy 1, policy_version 28129 (0.0007) [2023-12-27 19:25:59,174][106225] Updated weights for policy 1, policy_version 28139 (0.0008) [2023-12-27 19:25:59,230][106225] Updated weights for policy 1, policy_version 28149 (0.0008) [2023-12-27 19:25:59,399][106226] Updated weights for policy 0, policy_version 28242 (0.0010) [2023-12-27 19:25:59,457][106226] Updated weights for policy 0, policy_version 28252 (0.0009) [2023-12-27 19:25:59,513][106226] Updated weights for policy 0, policy_version 28262 (0.0008) [2023-12-27 19:25:59,977][106225] Updated weights for policy 1, policy_version 28159 (0.0008) [2023-12-27 19:26:00,040][106225] Updated weights for policy 1, policy_version 28169 (0.0007) [2023-12-27 19:26:00,093][106225] Updated weights for policy 1, policy_version 28179 (0.0009) [2023-12-27 19:26:00,195][106226] Updated weights for policy 0, policy_version 28272 (0.0008) [2023-12-27 19:26:00,263][106226] Updated weights for policy 0, policy_version 28282 (0.0008) [2023-12-27 19:26:00,326][106226] Updated weights for policy 0, policy_version 28292 (0.0009) [2023-12-27 19:26:00,720][106225] Updated weights for policy 1, policy_version 28189 (0.0008) [2023-12-27 19:26:00,778][106225] Updated weights for policy 1, policy_version 28199 (0.0009) [2023-12-27 19:26:00,831][106225] Updated weights for policy 1, policy_version 28209 (0.0009) [2023-12-27 19:26:01,049][106226] Updated weights for policy 0, policy_version 28302 (0.0009) [2023-12-27 19:26:01,117][106226] Updated weights for policy 0, policy_version 28312 (0.0006) [2023-12-27 19:26:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 14475264. Throughput: 0: 10041.4, 1: 10050.0. Samples: 14468540. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:26:01,175][105115] Avg episode reward: [(0, '-5.445'), (1, '-6.943')] [2023-12-27 19:26:01,187][106226] Updated weights for policy 0, policy_version 28322 (0.0007) [2023-12-27 19:26:01,559][106225] Updated weights for policy 1, policy_version 28219 (0.0008) [2023-12-27 19:26:01,623][106225] Updated weights for policy 1, policy_version 28229 (0.0006) [2023-12-27 19:26:01,684][106225] Updated weights for policy 1, policy_version 28239 (0.0009) [2023-12-27 19:26:01,912][106226] Updated weights for policy 0, policy_version 28332 (0.0007) [2023-12-27 19:26:01,982][106226] Updated weights for policy 0, policy_version 28342 (0.0007) [2023-12-27 19:26:02,044][106226] Updated weights for policy 0, policy_version 28352 (0.0006) [2023-12-27 19:26:02,339][106225] Updated weights for policy 1, policy_version 28249 (0.0008) [2023-12-27 19:26:02,399][106225] Updated weights for policy 1, policy_version 28259 (0.0008) [2023-12-27 19:26:02,447][106225] Updated weights for policy 1, policy_version 28269 (0.0008) [2023-12-27 19:26:02,505][106225] Updated weights for policy 1, policy_version 28279 (0.0007) [2023-12-27 19:26:02,724][106226] Updated weights for policy 0, policy_version 28362 (0.0008) [2023-12-27 19:26:02,783][106226] Updated weights for policy 0, policy_version 28372 (0.0006) [2023-12-27 19:26:02,844][106226] Updated weights for policy 0, policy_version 28382 (0.0008) [2023-12-27 19:26:02,908][106226] Updated weights for policy 0, policy_version 28392 (0.0009) [2023-12-27 19:26:03,151][106225] Updated weights for policy 1, policy_version 28289 (0.0008) [2023-12-27 19:26:03,197][106225] Updated weights for policy 1, policy_version 28299 (0.0006) [2023-12-27 19:26:03,258][106225] Updated weights for policy 1, policy_version 28309 (0.0006) [2023-12-27 19:26:03,605][106226] Updated weights for policy 0, policy_version 28402 (0.0005) [2023-12-27 19:26:03,670][106226] Updated weights for policy 0, policy_version 28412 (0.0008) [2023-12-27 19:26:03,735][106226] Updated weights for policy 0, policy_version 28422 (0.0010) [2023-12-27 19:26:03,812][106225] Updated weights for policy 1, policy_version 28319 (0.0008) [2023-12-27 19:26:03,879][106225] Updated weights for policy 1, policy_version 28329 (0.0008) [2023-12-27 19:26:03,939][106225] Updated weights for policy 1, policy_version 28339 (0.0008) [2023-12-27 19:26:04,429][106226] Updated weights for policy 0, policy_version 28432 (0.0009) [2023-12-27 19:26:04,489][106226] Updated weights for policy 0, policy_version 28442 (0.0008) [2023-12-27 19:26:04,547][106226] Updated weights for policy 0, policy_version 28452 (0.0008) [2023-12-27 19:26:04,604][106225] Updated weights for policy 1, policy_version 28349 (0.0008) [2023-12-27 19:26:04,663][106225] Updated weights for policy 1, policy_version 28359 (0.0009) [2023-12-27 19:26:04,713][106225] Updated weights for policy 1, policy_version 28369 (0.0009) [2023-12-27 19:26:05,239][106226] Updated weights for policy 0, policy_version 28462 (0.0009) [2023-12-27 19:26:05,296][106226] Updated weights for policy 0, policy_version 28472 (0.0008) [2023-12-27 19:26:05,305][106225] Updated weights for policy 1, policy_version 28379 (0.0006) [2023-12-27 19:26:05,349][106226] Updated weights for policy 0, policy_version 28482 (0.0009) [2023-12-27 19:26:05,359][106225] Updated weights for policy 1, policy_version 28389 (0.0005) [2023-12-27 19:26:05,410][106225] Updated weights for policy 1, policy_version 28399 (0.0006) [2023-12-27 19:26:06,082][106226] Updated weights for policy 0, policy_version 28492 (0.0009) [2023-12-27 19:26:06,105][106225] Updated weights for policy 1, policy_version 28409 (0.0008) [2023-12-27 19:26:06,148][106226] Updated weights for policy 0, policy_version 28502 (0.0007) [2023-12-27 19:26:06,165][106225] Updated weights for policy 1, policy_version 28419 (0.0007) [2023-12-27 19:26:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 14573568. Throughput: 0: 9903.8, 1: 10189.0. Samples: 14590340. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:26:06,175][105115] Avg episode reward: [(0, '-5.119'), (1, '-6.938')] [2023-12-27 19:26:06,213][106226] Updated weights for policy 0, policy_version 28512 (0.0007) [2023-12-27 19:26:06,227][106225] Updated weights for policy 1, policy_version 28429 (0.0008) [2023-12-27 19:26:06,294][106225] Updated weights for policy 1, policy_version 28439 (0.0008) [2023-12-27 19:26:06,820][106226] Updated weights for policy 0, policy_version 28522 (0.0006) [2023-12-27 19:26:06,870][106226] Updated weights for policy 0, policy_version 28532 (0.0008) [2023-12-27 19:26:06,922][106226] Updated weights for policy 0, policy_version 28542 (0.0008) [2023-12-27 19:26:06,983][106226] Updated weights for policy 0, policy_version 28552 (0.0008) [2023-12-27 19:26:07,031][106225] Updated weights for policy 1, policy_version 28449 (0.0010) [2023-12-27 19:26:07,089][106225] Updated weights for policy 1, policy_version 28459 (0.0010) [2023-12-27 19:26:07,142][106225] Updated weights for policy 1, policy_version 28469 (0.0010) [2023-12-27 19:26:07,733][106226] Updated weights for policy 0, policy_version 28562 (0.0009) [2023-12-27 19:26:07,792][106226] Updated weights for policy 0, policy_version 28572 (0.0009) [2023-12-27 19:26:07,854][106225] Updated weights for policy 1, policy_version 28479 (0.0007) [2023-12-27 19:26:07,857][106226] Updated weights for policy 0, policy_version 28582 (0.0008) [2023-12-27 19:26:07,904][106225] Updated weights for policy 1, policy_version 28489 (0.0005) [2023-12-27 19:26:07,955][106225] Updated weights for policy 1, policy_version 28499 (0.0005) [2023-12-27 19:26:08,552][106225] Updated weights for policy 1, policy_version 28509 (0.0007) [2023-12-27 19:26:08,555][106226] Updated weights for policy 0, policy_version 28592 (0.0006) [2023-12-27 19:26:08,610][106226] Updated weights for policy 0, policy_version 28602 (0.0006) [2023-12-27 19:26:08,616][106225] Updated weights for policy 1, policy_version 28519 (0.0007) [2023-12-27 19:26:08,670][106226] Updated weights for policy 0, policy_version 28612 (0.0007) [2023-12-27 19:26:08,676][106225] Updated weights for policy 1, policy_version 28529 (0.0008) [2023-12-27 19:26:09,349][106225] Updated weights for policy 1, policy_version 28539 (0.0007) [2023-12-27 19:26:09,418][106225] Updated weights for policy 1, policy_version 28549 (0.0007) [2023-12-27 19:26:09,467][106226] Updated weights for policy 0, policy_version 28622 (0.0009) [2023-12-27 19:26:09,473][106225] Updated weights for policy 1, policy_version 28559 (0.0007) [2023-12-27 19:26:09,529][106226] Updated weights for policy 0, policy_version 28632 (0.0011) [2023-12-27 19:26:09,590][106226] Updated weights for policy 0, policy_version 28642 (0.0010) [2023-12-27 19:26:10,285][106225] Updated weights for policy 1, policy_version 28569 (0.0006) [2023-12-27 19:26:10,340][106225] Updated weights for policy 1, policy_version 28579 (0.0008) [2023-12-27 19:26:10,367][106226] Updated weights for policy 0, policy_version 28652 (0.0011) [2023-12-27 19:26:10,400][106225] Updated weights for policy 1, policy_version 28589 (0.0008) [2023-12-27 19:26:10,418][106226] Updated weights for policy 0, policy_version 28662 (0.0010) [2023-12-27 19:26:10,463][106225] Updated weights for policy 1, policy_version 28599 (0.0006) [2023-12-27 19:26:10,473][106226] Updated weights for policy 0, policy_version 28672 (0.0011) [2023-12-27 19:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 14671872. Throughput: 0: 9889.9, 1: 10204.4. Samples: 14649572. Policy #0 lag: (min: 1.0, avg: 20.3, max: 33.0) [2023-12-27 19:26:11,175][105115] Avg episode reward: [(0, '-5.228'), (1, '-6.891')] [2023-12-27 19:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000028680_7348224.pth... [2023-12-27 19:26:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000027560_7061504.pth [2023-12-27 19:26:11,216][106225] Updated weights for policy 1, policy_version 28609 (0.0008) [2023-12-27 19:26:11,219][106226] Updated weights for policy 0, policy_version 28682 (0.0010) [2023-12-27 19:26:11,279][106225] Updated weights for policy 1, policy_version 28619 (0.0006) [2023-12-27 19:26:11,284][106226] Updated weights for policy 0, policy_version 28692 (0.0011) [2023-12-27 19:26:11,340][106225] Updated weights for policy 1, policy_version 28629 (0.0007) [2023-12-27 19:26:11,350][106226] Updated weights for policy 0, policy_version 28702 (0.0010) [2023-12-27 19:26:11,357][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000028632_7331840.pth... [2023-12-27 19:26:11,361][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000027416_7020544.pth [2023-12-27 19:26:11,418][106226] Updated weights for policy 0, policy_version 28712 (0.0009) [2023-12-27 19:26:12,129][106225] Updated weights for policy 1, policy_version 28639 (0.0008) [2023-12-27 19:26:12,188][106226] Updated weights for policy 0, policy_version 28722 (0.0010) [2023-12-27 19:26:12,193][106225] Updated weights for policy 1, policy_version 28649 (0.0006) [2023-12-27 19:26:12,235][106226] Updated weights for policy 0, policy_version 28732 (0.0010) [2023-12-27 19:26:12,260][106225] Updated weights for policy 1, policy_version 28659 (0.0007) [2023-12-27 19:26:12,299][106226] Updated weights for policy 0, policy_version 28742 (0.0010) [2023-12-27 19:26:13,011][106225] Updated weights for policy 1, policy_version 28669 (0.0008) [2023-12-27 19:26:13,074][106225] Updated weights for policy 1, policy_version 28679 (0.0008) [2023-12-27 19:26:13,087][106226] Updated weights for policy 0, policy_version 28752 (0.0008) [2023-12-27 19:26:13,135][106225] Updated weights for policy 1, policy_version 28689 (0.0006) [2023-12-27 19:26:13,151][106226] Updated weights for policy 0, policy_version 28762 (0.0009) [2023-12-27 19:26:13,211][106226] Updated weights for policy 0, policy_version 28772 (0.0009) [2023-12-27 19:26:13,829][106226] Updated weights for policy 0, policy_version 28782 (0.0007) [2023-12-27 19:26:13,850][106225] Updated weights for policy 1, policy_version 28699 (0.0009) [2023-12-27 19:26:13,883][106226] Updated weights for policy 0, policy_version 28792 (0.0006) [2023-12-27 19:26:13,908][106225] Updated weights for policy 1, policy_version 28709 (0.0010) [2023-12-27 19:26:13,945][106226] Updated weights for policy 0, policy_version 28802 (0.0006) [2023-12-27 19:26:13,969][106225] Updated weights for policy 1, policy_version 28719 (0.0010) [2023-12-27 19:26:14,613][106226] Updated weights for policy 0, policy_version 28812 (0.0005) [2023-12-27 19:26:14,667][106226] Updated weights for policy 0, policy_version 28822 (0.0005) [2023-12-27 19:26:14,672][106225] Updated weights for policy 1, policy_version 28729 (0.0010) [2023-12-27 19:26:14,726][106226] Updated weights for policy 0, policy_version 28832 (0.0005) [2023-12-27 19:26:14,733][106225] Updated weights for policy 1, policy_version 28739 (0.0010) [2023-12-27 19:26:14,798][106225] Updated weights for policy 1, policy_version 28749 (0.0010) [2023-12-27 19:26:14,872][106225] Updated weights for policy 1, policy_version 28759 (0.0011) [2023-12-27 19:26:15,396][106226] Updated weights for policy 0, policy_version 28842 (0.0006) [2023-12-27 19:26:15,454][106226] Updated weights for policy 0, policy_version 28852 (0.0008) [2023-12-27 19:26:15,518][106226] Updated weights for policy 0, policy_version 28862 (0.0008) [2023-12-27 19:26:15,579][106226] Updated weights for policy 0, policy_version 28872 (0.0006) [2023-12-27 19:26:15,580][106225] Updated weights for policy 1, policy_version 28769 (0.0010) [2023-12-27 19:26:15,640][106225] Updated weights for policy 1, policy_version 28779 (0.0010) [2023-12-27 19:26:15,696][106225] Updated weights for policy 1, policy_version 28789 (0.0010) [2023-12-27 19:26:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 14770176. Throughput: 0: 9850.6, 1: 10002.9. Samples: 14764224. Policy #0 lag: (min: 1.0, avg: 20.3, max: 33.0) [2023-12-27 19:26:16,176][105115] Avg episode reward: [(0, '-5.123'), (1, '-6.841')] [2023-12-27 19:26:16,304][106226] Updated weights for policy 0, policy_version 28882 (0.0008) [2023-12-27 19:26:16,364][106226] Updated weights for policy 0, policy_version 28892 (0.0007) [2023-12-27 19:26:16,403][106225] Updated weights for policy 1, policy_version 28799 (0.0010) [2023-12-27 19:26:16,425][106226] Updated weights for policy 0, policy_version 28902 (0.0009) [2023-12-27 19:26:16,457][106225] Updated weights for policy 1, policy_version 28809 (0.0010) [2023-12-27 19:26:16,517][106225] Updated weights for policy 1, policy_version 28819 (0.0010) [2023-12-27 19:26:17,143][106226] Updated weights for policy 0, policy_version 28912 (0.0008) [2023-12-27 19:26:17,197][106226] Updated weights for policy 0, policy_version 28922 (0.0008) [2023-12-27 19:26:17,232][106225] Updated weights for policy 1, policy_version 28829 (0.0010) [2023-12-27 19:26:17,254][106226] Updated weights for policy 0, policy_version 28932 (0.0010) [2023-12-27 19:26:17,294][106225] Updated weights for policy 1, policy_version 28839 (0.0010) [2023-12-27 19:26:17,350][106225] Updated weights for policy 1, policy_version 28849 (0.0010) [2023-12-27 19:26:17,989][106226] Updated weights for policy 0, policy_version 28942 (0.0009) [2023-12-27 19:26:18,047][106226] Updated weights for policy 0, policy_version 28952 (0.0008) [2023-12-27 19:26:18,053][106225] Updated weights for policy 1, policy_version 28859 (0.0010) [2023-12-27 19:26:18,103][106225] Updated weights for policy 1, policy_version 28869 (0.0010) [2023-12-27 19:26:18,105][106226] Updated weights for policy 0, policy_version 28962 (0.0005) [2023-12-27 19:26:18,166][106225] Updated weights for policy 1, policy_version 28879 (0.0010) [2023-12-27 19:26:18,890][106226] Updated weights for policy 0, policy_version 28972 (0.0007) [2023-12-27 19:26:18,908][106225] Updated weights for policy 1, policy_version 28889 (0.0010) [2023-12-27 19:26:18,950][106226] Updated weights for policy 0, policy_version 28982 (0.0006) [2023-12-27 19:26:18,966][106225] Updated weights for policy 1, policy_version 28899 (0.0011) [2023-12-27 19:26:19,014][106226] Updated weights for policy 0, policy_version 28992 (0.0005) [2023-12-27 19:26:19,020][106225] Updated weights for policy 1, policy_version 28909 (0.0010) [2023-12-27 19:26:19,086][106225] Updated weights for policy 1, policy_version 28919 (0.0010) [2023-12-27 19:26:19,732][106226] Updated weights for policy 0, policy_version 29002 (0.0007) [2023-12-27 19:26:19,791][106225] Updated weights for policy 1, policy_version 28929 (0.0006) [2023-12-27 19:26:19,799][106226] Updated weights for policy 0, policy_version 29012 (0.0008) [2023-12-27 19:26:19,860][106225] Updated weights for policy 1, policy_version 28939 (0.0009) [2023-12-27 19:26:19,869][106226] Updated weights for policy 0, policy_version 29022 (0.0008) [2023-12-27 19:26:19,924][106225] Updated weights for policy 1, policy_version 28949 (0.0006) [2023-12-27 19:26:19,938][106226] Updated weights for policy 0, policy_version 29032 (0.0007) [2023-12-27 19:26:20,606][106225] Updated weights for policy 1, policy_version 28959 (0.0013) [2023-12-27 19:26:20,672][106225] Updated weights for policy 1, policy_version 28969 (0.0010) [2023-12-27 19:26:20,679][106226] Updated weights for policy 0, policy_version 29042 (0.0007) [2023-12-27 19:26:20,735][106225] Updated weights for policy 1, policy_version 28979 (0.0010) [2023-12-27 19:26:20,742][106226] Updated weights for policy 0, policy_version 29052 (0.0009) [2023-12-27 19:26:20,804][106226] Updated weights for policy 0, policy_version 29062 (0.0007) [2023-12-27 19:26:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 14868480. Throughput: 0: 9714.7, 1: 9933.3. Samples: 14878704. Policy #0 lag: (min: 1.0, avg: 20.3, max: 33.0) [2023-12-27 19:26:21,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-6.868')] [2023-12-27 19:26:21,470][106225] Updated weights for policy 1, policy_version 28989 (0.0008) [2023-12-27 19:26:21,535][106225] Updated weights for policy 1, policy_version 28999 (0.0005) [2023-12-27 19:26:21,571][106226] Updated weights for policy 0, policy_version 29072 (0.0007) [2023-12-27 19:26:21,591][106225] Updated weights for policy 1, policy_version 29009 (0.0007) [2023-12-27 19:26:21,640][106226] Updated weights for policy 0, policy_version 29082 (0.0008) [2023-12-27 19:26:21,698][106226] Updated weights for policy 0, policy_version 29092 (0.0009) [2023-12-27 19:26:22,309][106225] Updated weights for policy 1, policy_version 29019 (0.0009) [2023-12-27 19:26:22,378][106225] Updated weights for policy 1, policy_version 29029 (0.0008) [2023-12-27 19:26:22,445][106225] Updated weights for policy 1, policy_version 29039 (0.0008) [2023-12-27 19:26:22,473][106226] Updated weights for policy 0, policy_version 29102 (0.0007) [2023-12-27 19:26:22,537][106226] Updated weights for policy 0, policy_version 29112 (0.0008) [2023-12-27 19:26:22,605][106226] Updated weights for policy 0, policy_version 29122 (0.0006) [2023-12-27 19:26:23,059][106225] Updated weights for policy 1, policy_version 29049 (0.0008) [2023-12-27 19:26:23,121][106225] Updated weights for policy 1, policy_version 29059 (0.0005) [2023-12-27 19:26:23,187][106225] Updated weights for policy 1, policy_version 29069 (0.0005) [2023-12-27 19:26:23,236][106225] Updated weights for policy 1, policy_version 29079 (0.0005) [2023-12-27 19:26:23,300][106226] Updated weights for policy 0, policy_version 29132 (0.0009) [2023-12-27 19:26:23,348][106226] Updated weights for policy 0, policy_version 29142 (0.0010) [2023-12-27 19:26:23,394][106226] Updated weights for policy 0, policy_version 29152 (0.0010) [2023-12-27 19:26:23,949][106225] Updated weights for policy 1, policy_version 29089 (0.0008) [2023-12-27 19:26:23,996][106225] Updated weights for policy 1, policy_version 29099 (0.0009) [2023-12-27 19:26:23,998][106226] Updated weights for policy 0, policy_version 29163 (0.0008) [2023-12-27 19:26:24,048][106226] Updated weights for policy 0, policy_version 29173 (0.0005) [2023-12-27 19:26:24,057][106225] Updated weights for policy 1, policy_version 29109 (0.0008) [2023-12-27 19:26:24,100][106226] Updated weights for policy 0, policy_version 29183 (0.0007) [2023-12-27 19:26:24,677][106226] Updated weights for policy 0, policy_version 29193 (0.0005) [2023-12-27 19:26:24,737][106226] Updated weights for policy 0, policy_version 29203 (0.0005) [2023-12-27 19:26:24,752][106225] Updated weights for policy 1, policy_version 29119 (0.0007) [2023-12-27 19:26:24,791][106226] Updated weights for policy 0, policy_version 29213 (0.0007) [2023-12-27 19:26:24,817][106225] Updated weights for policy 1, policy_version 29129 (0.0005) [2023-12-27 19:26:24,837][106226] Updated weights for policy 0, policy_version 29223 (0.0010) [2023-12-27 19:26:24,874][106225] Updated weights for policy 1, policy_version 29139 (0.0006) [2023-12-27 19:26:25,463][106225] Updated weights for policy 1, policy_version 29149 (0.0006) [2023-12-27 19:26:25,523][106226] Updated weights for policy 0, policy_version 29233 (0.0011) [2023-12-27 19:26:25,527][106225] Updated weights for policy 1, policy_version 29159 (0.0006) [2023-12-27 19:26:25,581][106226] Updated weights for policy 0, policy_version 29243 (0.0010) [2023-12-27 19:26:25,590][106225] Updated weights for policy 1, policy_version 29169 (0.0006) [2023-12-27 19:26:25,628][106226] Updated weights for policy 0, policy_version 29253 (0.0010) [2023-12-27 19:26:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 14966784. Throughput: 0: 9689.1, 1: 9966.9. Samples: 14938252. Policy #0 lag: (min: 1.0, avg: 20.3, max: 33.0) [2023-12-27 19:26:26,175][105115] Avg episode reward: [(0, '-5.509'), (1, '-6.937')] [2023-12-27 19:26:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000029256_7495680.pth... [2023-12-27 19:26:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000029176_7471104.pth... [2023-12-27 19:26:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000028024_7176192.pth [2023-12-27 19:26:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000028136_7208960.pth [2023-12-27 19:26:26,267][106225] Updated weights for policy 1, policy_version 29179 (0.0006) [2023-12-27 19:26:26,283][106226] Updated weights for policy 0, policy_version 29263 (0.0010) [2023-12-27 19:26:26,331][106225] Updated weights for policy 1, policy_version 29189 (0.0006) [2023-12-27 19:26:26,336][106226] Updated weights for policy 0, policy_version 29273 (0.0007) [2023-12-27 19:26:26,381][106226] Updated weights for policy 0, policy_version 29283 (0.0007) [2023-12-27 19:26:26,388][106225] Updated weights for policy 1, policy_version 29199 (0.0006) [2023-12-27 19:26:26,932][106226] Updated weights for policy 0, policy_version 29293 (0.0007) [2023-12-27 19:26:26,980][106226] Updated weights for policy 0, policy_version 29303 (0.0008) [2023-12-27 19:26:26,998][106225] Updated weights for policy 1, policy_version 29209 (0.0006) [2023-12-27 19:26:27,031][106226] Updated weights for policy 0, policy_version 29313 (0.0007) [2023-12-27 19:26:27,048][106225] Updated weights for policy 1, policy_version 29219 (0.0007) [2023-12-27 19:26:27,098][106225] Updated weights for policy 1, policy_version 29229 (0.0007) [2023-12-27 19:26:27,153][106225] Updated weights for policy 1, policy_version 29239 (0.0008) [2023-12-27 19:26:27,705][106226] Updated weights for policy 0, policy_version 29323 (0.0005) [2023-12-27 19:26:27,768][106226] Updated weights for policy 0, policy_version 29333 (0.0006) [2023-12-27 19:26:27,826][106226] Updated weights for policy 0, policy_version 29343 (0.0007) [2023-12-27 19:26:27,842][106225] Updated weights for policy 1, policy_version 29249 (0.0008) [2023-12-27 19:26:27,894][106225] Updated weights for policy 1, policy_version 29259 (0.0010) [2023-12-27 19:26:27,953][106225] Updated weights for policy 1, policy_version 29269 (0.0010) [2023-12-27 19:26:28,459][106226] Updated weights for policy 0, policy_version 29353 (0.0010) [2023-12-27 19:26:28,517][106226] Updated weights for policy 0, policy_version 29363 (0.0011) [2023-12-27 19:26:28,574][106225] Updated weights for policy 1, policy_version 29279 (0.0008) [2023-12-27 19:26:28,579][106226] Updated weights for policy 0, policy_version 29373 (0.0011) [2023-12-27 19:26:28,631][106225] Updated weights for policy 1, policy_version 29289 (0.0010) [2023-12-27 19:26:28,634][106226] Updated weights for policy 0, policy_version 29383 (0.0010) [2023-12-27 19:26:28,689][106225] Updated weights for policy 1, policy_version 29299 (0.0010) [2023-12-27 19:26:29,320][106226] Updated weights for policy 0, policy_version 29393 (0.0011) [2023-12-27 19:26:29,371][106225] Updated weights for policy 1, policy_version 29309 (0.0010) [2023-12-27 19:26:29,384][106226] Updated weights for policy 0, policy_version 29403 (0.0010) [2023-12-27 19:26:29,434][106225] Updated weights for policy 1, policy_version 29319 (0.0006) [2023-12-27 19:26:29,450][106226] Updated weights for policy 0, policy_version 29413 (0.0007) [2023-12-27 19:26:29,495][106225] Updated weights for policy 1, policy_version 29329 (0.0009) [2023-12-27 19:26:30,144][106225] Updated weights for policy 1, policy_version 29339 (0.0006) [2023-12-27 19:26:30,161][106226] Updated weights for policy 0, policy_version 29423 (0.0007) [2023-12-27 19:26:30,194][106225] Updated weights for policy 1, policy_version 29349 (0.0008) [2023-12-27 19:26:30,221][106226] Updated weights for policy 0, policy_version 29433 (0.0009) [2023-12-27 19:26:30,259][106225] Updated weights for policy 1, policy_version 29359 (0.0008) [2023-12-27 19:26:30,281][106226] Updated weights for policy 0, policy_version 29443 (0.0007) [2023-12-27 19:26:30,960][106225] Updated weights for policy 1, policy_version 29369 (0.0006) [2023-12-27 19:26:31,014][106226] Updated weights for policy 0, policy_version 29453 (0.0007) [2023-12-27 19:26:31,020][106225] Updated weights for policy 1, policy_version 29379 (0.0005) [2023-12-27 19:26:31,081][106226] Updated weights for policy 0, policy_version 29463 (0.0007) [2023-12-27 19:26:31,086][106225] Updated weights for policy 1, policy_version 29389 (0.0007) [2023-12-27 19:26:31,142][106226] Updated weights for policy 0, policy_version 29473 (0.0007) [2023-12-27 19:26:31,149][106225] Updated weights for policy 1, policy_version 29399 (0.0007) [2023-12-27 19:26:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 15073280. Throughput: 0: 9788.3, 1: 10027.3. Samples: 15064696. Policy #0 lag: (min: 31.0, avg: 47.8, max: 63.0) [2023-12-27 19:26:31,175][105115] Avg episode reward: [(0, '-5.596'), (1, '-6.883')] [2023-12-27 19:26:31,858][106225] Updated weights for policy 1, policy_version 29409 (0.0007) [2023-12-27 19:26:31,883][106226] Updated weights for policy 0, policy_version 29483 (0.0010) [2023-12-27 19:26:31,925][106225] Updated weights for policy 1, policy_version 29419 (0.0008) [2023-12-27 19:26:31,944][106226] Updated weights for policy 0, policy_version 29493 (0.0008) [2023-12-27 19:26:31,984][106225] Updated weights for policy 1, policy_version 29429 (0.0007) [2023-12-27 19:26:32,005][106226] Updated weights for policy 0, policy_version 29503 (0.0011) [2023-12-27 19:26:32,687][106226] Updated weights for policy 0, policy_version 29513 (0.0010) [2023-12-27 19:26:32,705][106225] Updated weights for policy 1, policy_version 29439 (0.0006) [2023-12-27 19:26:32,740][106226] Updated weights for policy 0, policy_version 29523 (0.0010) [2023-12-27 19:26:32,754][106225] Updated weights for policy 1, policy_version 29449 (0.0006) [2023-12-27 19:26:32,800][106226] Updated weights for policy 0, policy_version 29533 (0.0011) [2023-12-27 19:26:32,818][106225] Updated weights for policy 1, policy_version 29459 (0.0005) [2023-12-27 19:26:32,851][106226] Updated weights for policy 0, policy_version 29543 (0.0010) [2023-12-27 19:26:33,524][106226] Updated weights for policy 0, policy_version 29553 (0.0008) [2023-12-27 19:26:33,531][106225] Updated weights for policy 1, policy_version 29469 (0.0007) [2023-12-27 19:26:33,579][106225] Updated weights for policy 1, policy_version 29479 (0.0008) [2023-12-27 19:26:33,580][106226] Updated weights for policy 0, policy_version 29563 (0.0005) [2023-12-27 19:26:33,634][106225] Updated weights for policy 1, policy_version 29489 (0.0006) [2023-12-27 19:26:33,638][106226] Updated weights for policy 0, policy_version 29573 (0.0007) [2023-12-27 19:26:34,295][106226] Updated weights for policy 0, policy_version 29583 (0.0007) [2023-12-27 19:26:34,319][106225] Updated weights for policy 1, policy_version 29499 (0.0009) [2023-12-27 19:26:34,363][106226] Updated weights for policy 0, policy_version 29593 (0.0007) [2023-12-27 19:26:34,388][106225] Updated weights for policy 1, policy_version 29509 (0.0005) [2023-12-27 19:26:34,427][106226] Updated weights for policy 0, policy_version 29603 (0.0008) [2023-12-27 19:26:34,453][106225] Updated weights for policy 1, policy_version 29519 (0.0008) [2023-12-27 19:26:35,081][106226] Updated weights for policy 0, policy_version 29613 (0.0006) [2023-12-27 19:26:35,119][106225] Updated weights for policy 1, policy_version 29529 (0.0010) [2023-12-27 19:26:35,128][106226] Updated weights for policy 0, policy_version 29623 (0.0006) [2023-12-27 19:26:35,169][106225] Updated weights for policy 1, policy_version 29539 (0.0010) [2023-12-27 19:26:35,176][106226] Updated weights for policy 0, policy_version 29633 (0.0005) [2023-12-27 19:26:35,218][106225] Updated weights for policy 1, policy_version 29549 (0.0010) [2023-12-27 19:26:35,272][106225] Updated weights for policy 1, policy_version 29559 (0.0010) [2023-12-27 19:26:35,696][106226] Updated weights for policy 0, policy_version 29643 (0.0006) [2023-12-27 19:26:35,756][106226] Updated weights for policy 0, policy_version 29653 (0.0008) [2023-12-27 19:26:35,811][106226] Updated weights for policy 0, policy_version 29663 (0.0007) [2023-12-27 19:26:36,018][106225] Updated weights for policy 1, policy_version 29569 (0.0010) [2023-12-27 19:26:36,072][106225] Updated weights for policy 1, policy_version 29579 (0.0010) [2023-12-27 19:26:36,136][106225] Updated weights for policy 1, policy_version 29589 (0.0010) [2023-12-27 19:26:36,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 15179776. Throughput: 0: 9809.9, 1: 10025.1. Samples: 15185856. Policy #0 lag: (min: 31.0, avg: 47.8, max: 63.0) [2023-12-27 19:26:36,175][105115] Avg episode reward: [(0, '-5.746'), (1, '-7.007')] [2023-12-27 19:26:36,457][106226] Updated weights for policy 0, policy_version 29673 (0.0008) [2023-12-27 19:26:36,518][106226] Updated weights for policy 0, policy_version 29683 (0.0010) [2023-12-27 19:26:36,578][106226] Updated weights for policy 0, policy_version 29693 (0.0009) [2023-12-27 19:26:36,641][106226] Updated weights for policy 0, policy_version 29703 (0.0008) [2023-12-27 19:26:36,806][106225] Updated weights for policy 1, policy_version 29599 (0.0009) [2023-12-27 19:26:36,865][106225] Updated weights for policy 1, policy_version 29609 (0.0009) [2023-12-27 19:26:36,926][106225] Updated weights for policy 1, policy_version 29619 (0.0008) [2023-12-27 19:26:37,397][106226] Updated weights for policy 0, policy_version 29713 (0.0008) [2023-12-27 19:26:37,449][106226] Updated weights for policy 0, policy_version 29723 (0.0008) [2023-12-27 19:26:37,501][106226] Updated weights for policy 0, policy_version 29733 (0.0008) [2023-12-27 19:26:37,594][106225] Updated weights for policy 1, policy_version 29629 (0.0010) [2023-12-27 19:26:37,653][106225] Updated weights for policy 1, policy_version 29639 (0.0010) [2023-12-27 19:26:37,710][106225] Updated weights for policy 1, policy_version 29649 (0.0010) [2023-12-27 19:26:38,244][106226] Updated weights for policy 0, policy_version 29743 (0.0008) [2023-12-27 19:26:38,302][106226] Updated weights for policy 0, policy_version 29753 (0.0006) [2023-12-27 19:26:38,372][106226] Updated weights for policy 0, policy_version 29763 (0.0008) [2023-12-27 19:26:38,429][106225] Updated weights for policy 1, policy_version 29659 (0.0011) [2023-12-27 19:26:38,489][106225] Updated weights for policy 1, policy_version 29669 (0.0010) [2023-12-27 19:26:38,540][106225] Updated weights for policy 1, policy_version 29679 (0.0010) [2023-12-27 19:26:39,068][106226] Updated weights for policy 0, policy_version 29773 (0.0007) [2023-12-27 19:26:39,131][106226] Updated weights for policy 0, policy_version 29783 (0.0008) [2023-12-27 19:26:39,184][106226] Updated weights for policy 0, policy_version 29793 (0.0009) [2023-12-27 19:26:39,235][106225] Updated weights for policy 1, policy_version 29689 (0.0010) [2023-12-27 19:26:39,287][106225] Updated weights for policy 1, policy_version 29699 (0.0008) [2023-12-27 19:26:39,357][106225] Updated weights for policy 1, policy_version 29709 (0.0009) [2023-12-27 19:26:39,420][106225] Updated weights for policy 1, policy_version 29719 (0.0009) [2023-12-27 19:26:39,929][106226] Updated weights for policy 0, policy_version 29803 (0.0009) [2023-12-27 19:26:39,998][106226] Updated weights for policy 0, policy_version 29813 (0.0009) [2023-12-27 19:26:40,057][106226] Updated weights for policy 0, policy_version 29823 (0.0008) [2023-12-27 19:26:40,234][106225] Updated weights for policy 1, policy_version 29729 (0.0010) [2023-12-27 19:26:40,284][106225] Updated weights for policy 1, policy_version 29739 (0.0009) [2023-12-27 19:26:40,337][106225] Updated weights for policy 1, policy_version 29749 (0.0008) [2023-12-27 19:26:40,808][106226] Updated weights for policy 0, policy_version 29833 (0.0008) [2023-12-27 19:26:40,862][106226] Updated weights for policy 0, policy_version 29843 (0.0009) [2023-12-27 19:26:40,924][106226] Updated weights for policy 0, policy_version 29853 (0.0009) [2023-12-27 19:26:40,976][106226] Updated weights for policy 0, policy_version 29863 (0.0008) [2023-12-27 19:26:41,098][106225] Updated weights for policy 1, policy_version 29759 (0.0008) [2023-12-27 19:26:41,168][106225] Updated weights for policy 1, policy_version 29769 (0.0008) [2023-12-27 19:26:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 15269888. Throughput: 0: 9810.7, 1: 10028.0. Samples: 15244292. Policy #0 lag: (min: 31.0, avg: 47.8, max: 63.0) [2023-12-27 19:26:41,175][105115] Avg episode reward: [(0, '-5.327'), (1, '-7.047')] [2023-12-27 19:26:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000029864_7651328.pth... [2023-12-27 19:26:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000028680_7348224.pth [2023-12-27 19:26:41,233][106225] Updated weights for policy 1, policy_version 29779 (0.0008) [2023-12-27 19:26:41,275][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000029784_7626752.pth... [2023-12-27 19:26:41,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000028632_7331840.pth [2023-12-27 19:26:41,720][106226] Updated weights for policy 0, policy_version 29873 (0.0007) [2023-12-27 19:26:41,789][106226] Updated weights for policy 0, policy_version 29883 (0.0009) [2023-12-27 19:26:41,852][106226] Updated weights for policy 0, policy_version 29893 (0.0009) [2023-12-27 19:26:42,033][106225] Updated weights for policy 1, policy_version 29789 (0.0008) [2023-12-27 19:26:42,098][106225] Updated weights for policy 1, policy_version 29799 (0.0008) [2023-12-27 19:26:42,159][106225] Updated weights for policy 1, policy_version 29809 (0.0008) [2023-12-27 19:26:42,610][106226] Updated weights for policy 0, policy_version 29903 (0.0010) [2023-12-27 19:26:42,664][106226] Updated weights for policy 0, policy_version 29913 (0.0009) [2023-12-27 19:26:42,729][106226] Updated weights for policy 0, policy_version 29923 (0.0009) [2023-12-27 19:26:42,857][106225] Updated weights for policy 1, policy_version 29819 (0.0008) [2023-12-27 19:26:42,916][106225] Updated weights for policy 1, policy_version 29829 (0.0008) [2023-12-27 19:26:42,979][106225] Updated weights for policy 1, policy_version 29839 (0.0006) [2023-12-27 19:26:43,468][106226] Updated weights for policy 0, policy_version 29933 (0.0009) [2023-12-27 19:26:43,516][106226] Updated weights for policy 0, policy_version 29943 (0.0008) [2023-12-27 19:26:43,574][106226] Updated weights for policy 0, policy_version 29953 (0.0009) [2023-12-27 19:26:43,650][106225] Updated weights for policy 1, policy_version 29849 (0.0007) [2023-12-27 19:26:43,700][106225] Updated weights for policy 1, policy_version 29859 (0.0005) [2023-12-27 19:26:43,749][106225] Updated weights for policy 1, policy_version 29869 (0.0006) [2023-12-27 19:26:43,801][106225] Updated weights for policy 1, policy_version 29879 (0.0009) [2023-12-27 19:26:44,388][106225] Updated weights for policy 1, policy_version 29889 (0.0009) [2023-12-27 19:26:44,408][106226] Updated weights for policy 0, policy_version 29963 (0.0008) [2023-12-27 19:26:44,442][106225] Updated weights for policy 1, policy_version 29899 (0.0007) [2023-12-27 19:26:44,465][106226] Updated weights for policy 0, policy_version 29973 (0.0007) [2023-12-27 19:26:44,494][106225] Updated weights for policy 1, policy_version 29909 (0.0008) [2023-12-27 19:26:44,523][106226] Updated weights for policy 0, policy_version 29983 (0.0007) [2023-12-27 19:26:45,208][106225] Updated weights for policy 1, policy_version 29919 (0.0008) [2023-12-27 19:26:45,272][106225] Updated weights for policy 1, policy_version 29929 (0.0008) [2023-12-27 19:26:45,275][106226] Updated weights for policy 0, policy_version 29993 (0.0009) [2023-12-27 19:26:45,332][106225] Updated weights for policy 1, policy_version 29939 (0.0008) [2023-12-27 19:26:45,338][106226] Updated weights for policy 0, policy_version 30003 (0.0011) [2023-12-27 19:26:45,401][106226] Updated weights for policy 0, policy_version 30013 (0.0011) [2023-12-27 19:26:45,462][106226] Updated weights for policy 0, policy_version 30023 (0.0011) [2023-12-27 19:26:45,997][106225] Updated weights for policy 1, policy_version 29949 (0.0006) [2023-12-27 19:26:46,051][106225] Updated weights for policy 1, policy_version 29959 (0.0005) [2023-12-27 19:26:46,100][106225] Updated weights for policy 1, policy_version 29969 (0.0005) [2023-12-27 19:26:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 15368192. Throughput: 0: 9802.1, 1: 9956.3. Samples: 15357668. Policy #0 lag: (min: 31.0, avg: 47.8, max: 63.0) [2023-12-27 19:26:46,175][105115] Avg episode reward: [(0, '-5.280'), (1, '-6.434')] [2023-12-27 19:26:46,184][106226] Updated weights for policy 0, policy_version 30033 (0.0006) [2023-12-27 19:26:46,236][106226] Updated weights for policy 0, policy_version 30043 (0.0005) [2023-12-27 19:26:46,292][106226] Updated weights for policy 0, policy_version 30053 (0.0008) [2023-12-27 19:26:46,639][106225] Updated weights for policy 1, policy_version 29979 (0.0005) [2023-12-27 19:26:46,696][106225] Updated weights for policy 1, policy_version 29989 (0.0006) [2023-12-27 19:26:46,753][106225] Updated weights for policy 1, policy_version 29999 (0.0007) [2023-12-27 19:26:46,966][106226] Updated weights for policy 0, policy_version 30063 (0.0010) [2023-12-27 19:26:47,025][106226] Updated weights for policy 0, policy_version 30073 (0.0010) [2023-12-27 19:26:47,084][106226] Updated weights for policy 0, policy_version 30083 (0.0010) [2023-12-27 19:26:47,486][106225] Updated weights for policy 1, policy_version 30009 (0.0008) [2023-12-27 19:26:47,537][106225] Updated weights for policy 1, policy_version 30019 (0.0009) [2023-12-27 19:26:47,588][106225] Updated weights for policy 1, policy_version 30029 (0.0009) [2023-12-27 19:26:47,638][106225] Updated weights for policy 1, policy_version 30039 (0.0009) [2023-12-27 19:26:47,670][106226] Updated weights for policy 0, policy_version 30093 (0.0008) [2023-12-27 19:26:47,721][106226] Updated weights for policy 0, policy_version 30103 (0.0005) [2023-12-27 19:26:47,779][106226] Updated weights for policy 0, policy_version 30113 (0.0005) [2023-12-27 19:26:48,342][106225] Updated weights for policy 1, policy_version 30049 (0.0007) [2023-12-27 19:26:48,346][106226] Updated weights for policy 0, policy_version 30123 (0.0006) [2023-12-27 19:26:48,403][106225] Updated weights for policy 1, policy_version 30059 (0.0009) [2023-12-27 19:26:48,415][106226] Updated weights for policy 0, policy_version 30133 (0.0008) [2023-12-27 19:26:48,464][106225] Updated weights for policy 1, policy_version 30069 (0.0009) [2023-12-27 19:26:48,476][106226] Updated weights for policy 0, policy_version 30143 (0.0010) [2023-12-27 19:26:49,068][106226] Updated weights for policy 0, policy_version 30153 (0.0010) [2023-12-27 19:26:49,120][106226] Updated weights for policy 0, policy_version 30163 (0.0008) [2023-12-27 19:26:49,176][106225] Updated weights for policy 1, policy_version 30079 (0.0005) [2023-12-27 19:26:49,181][106226] Updated weights for policy 0, policy_version 30173 (0.0011) [2023-12-27 19:26:49,244][106225] Updated weights for policy 1, policy_version 30089 (0.0007) [2023-12-27 19:26:49,247][106226] Updated weights for policy 0, policy_version 30183 (0.0010) [2023-12-27 19:26:49,312][106225] Updated weights for policy 1, policy_version 30099 (0.0009) [2023-12-27 19:26:49,976][106226] Updated weights for policy 0, policy_version 30193 (0.0008) [2023-12-27 19:26:50,020][106225] Updated weights for policy 1, policy_version 30109 (0.0008) [2023-12-27 19:26:50,040][106226] Updated weights for policy 0, policy_version 30203 (0.0006) [2023-12-27 19:26:50,077][106225] Updated weights for policy 1, policy_version 30119 (0.0007) [2023-12-27 19:26:50,093][106226] Updated weights for policy 0, policy_version 30213 (0.0007) [2023-12-27 19:26:50,140][106225] Updated weights for policy 1, policy_version 30129 (0.0007) [2023-12-27 19:26:50,720][106226] Updated weights for policy 0, policy_version 30223 (0.0007) [2023-12-27 19:26:50,783][106226] Updated weights for policy 0, policy_version 30233 (0.0005) [2023-12-27 19:26:50,853][106226] Updated weights for policy 0, policy_version 30243 (0.0010) [2023-12-27 19:26:50,873][106225] Updated weights for policy 1, policy_version 30139 (0.0008) [2023-12-27 19:26:50,936][106225] Updated weights for policy 1, policy_version 30149 (0.0007) [2023-12-27 19:26:50,989][106225] Updated weights for policy 1, policy_version 30159 (0.0008) [2023-12-27 19:26:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 15474688. Throughput: 0: 9913.7, 1: 9885.2. Samples: 15481292. Policy #0 lag: (min: 30.0, avg: 44.1, max: 62.0) [2023-12-27 19:26:51,175][105115] Avg episode reward: [(0, '-4.992'), (1, '-7.000')] [2023-12-27 19:26:51,544][106226] Updated weights for policy 0, policy_version 30253 (0.0008) [2023-12-27 19:26:51,613][106226] Updated weights for policy 0, policy_version 30263 (0.0006) [2023-12-27 19:26:51,682][106226] Updated weights for policy 0, policy_version 30273 (0.0007) [2023-12-27 19:26:51,748][106225] Updated weights for policy 1, policy_version 30169 (0.0007) [2023-12-27 19:26:51,815][106225] Updated weights for policy 1, policy_version 30179 (0.0008) [2023-12-27 19:26:51,877][106225] Updated weights for policy 1, policy_version 30189 (0.0009) [2023-12-27 19:26:51,935][106225] Updated weights for policy 1, policy_version 30199 (0.0008) [2023-12-27 19:26:52,433][106226] Updated weights for policy 0, policy_version 30283 (0.0009) [2023-12-27 19:26:52,500][106226] Updated weights for policy 0, policy_version 30293 (0.0008) [2023-12-27 19:26:52,550][106225] Updated weights for policy 1, policy_version 30209 (0.0009) [2023-12-27 19:26:52,569][106226] Updated weights for policy 0, policy_version 30303 (0.0008) [2023-12-27 19:26:52,609][106225] Updated weights for policy 1, policy_version 30219 (0.0007) [2023-12-27 19:26:52,674][106225] Updated weights for policy 1, policy_version 30229 (0.0008) [2023-12-27 19:26:53,164][106226] Updated weights for policy 0, policy_version 30313 (0.0008) [2023-12-27 19:26:53,226][106226] Updated weights for policy 0, policy_version 30323 (0.0006) [2023-12-27 19:26:53,279][106226] Updated weights for policy 0, policy_version 30333 (0.0005) [2023-12-27 19:26:53,334][106226] Updated weights for policy 0, policy_version 30343 (0.0005) [2023-12-27 19:26:53,477][106225] Updated weights for policy 1, policy_version 30239 (0.0009) [2023-12-27 19:26:53,539][106225] Updated weights for policy 1, policy_version 30249 (0.0010) [2023-12-27 19:26:53,596][106225] Updated weights for policy 1, policy_version 30259 (0.0009) [2023-12-27 19:26:53,869][106226] Updated weights for policy 0, policy_version 30353 (0.0005) [2023-12-27 19:26:53,930][106226] Updated weights for policy 0, policy_version 30363 (0.0007) [2023-12-27 19:26:53,983][106226] Updated weights for policy 0, policy_version 30373 (0.0005) [2023-12-27 19:26:54,389][106225] Updated weights for policy 1, policy_version 30269 (0.0008) [2023-12-27 19:26:54,442][106225] Updated weights for policy 1, policy_version 30279 (0.0007) [2023-12-27 19:26:54,502][106225] Updated weights for policy 1, policy_version 30289 (0.0008) [2023-12-27 19:26:54,614][106226] Updated weights for policy 0, policy_version 30383 (0.0005) [2023-12-27 19:26:54,676][106226] Updated weights for policy 0, policy_version 30393 (0.0006) [2023-12-27 19:26:54,744][106226] Updated weights for policy 0, policy_version 30403 (0.0005) [2023-12-27 19:26:55,263][106225] Updated weights for policy 1, policy_version 30299 (0.0007) [2023-12-27 19:26:55,317][106225] Updated weights for policy 1, policy_version 30309 (0.0005) [2023-12-27 19:26:55,352][106226] Updated weights for policy 0, policy_version 30413 (0.0007) [2023-12-27 19:26:55,369][106225] Updated weights for policy 1, policy_version 30319 (0.0005) [2023-12-27 19:26:55,410][106226] Updated weights for policy 0, policy_version 30423 (0.0008) [2023-12-27 19:26:55,463][106226] Updated weights for policy 0, policy_version 30433 (0.0010) [2023-12-27 19:26:55,984][106225] Updated weights for policy 1, policy_version 30329 (0.0005) [2023-12-27 19:26:56,040][106225] Updated weights for policy 1, policy_version 30339 (0.0005) [2023-12-27 19:26:56,098][106225] Updated weights for policy 1, policy_version 30349 (0.0005) [2023-12-27 19:26:56,163][106225] Updated weights for policy 1, policy_version 30359 (0.0005) [2023-12-27 19:26:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 15572992. Throughput: 0: 9975.4, 1: 9845.9. Samples: 15541528. Policy #0 lag: (min: 30.0, avg: 44.1, max: 62.0) [2023-12-27 19:26:56,175][105115] Avg episode reward: [(0, '-5.175'), (1, '-6.867')] [2023-12-27 19:26:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000030360_7774208.pth... [2023-12-27 19:26:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000030440_7798784.pth... [2023-12-27 19:26:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000029176_7471104.pth [2023-12-27 19:26:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000029256_7495680.pth [2023-12-27 19:26:56,241][106226] Updated weights for policy 0, policy_version 30443 (0.0008) [2023-12-27 19:26:56,306][106226] Updated weights for policy 0, policy_version 30453 (0.0005) [2023-12-27 19:26:56,365][106226] Updated weights for policy 0, policy_version 30463 (0.0008) [2023-12-27 19:26:56,738][106225] Updated weights for policy 1, policy_version 30369 (0.0008) [2023-12-27 19:26:56,792][106225] Updated weights for policy 1, policy_version 30379 (0.0008) [2023-12-27 19:26:56,841][106225] Updated weights for policy 1, policy_version 30389 (0.0008) [2023-12-27 19:26:57,003][106226] Updated weights for policy 0, policy_version 30473 (0.0006) [2023-12-27 19:26:57,061][106226] Updated weights for policy 0, policy_version 30483 (0.0008) [2023-12-27 19:26:57,111][106226] Updated weights for policy 0, policy_version 30493 (0.0009) [2023-12-27 19:26:57,170][106226] Updated weights for policy 0, policy_version 30503 (0.0007) [2023-12-27 19:26:57,521][106225] Updated weights for policy 1, policy_version 30399 (0.0008) [2023-12-27 19:26:57,574][106225] Updated weights for policy 1, policy_version 30409 (0.0009) [2023-12-27 19:26:57,631][106225] Updated weights for policy 1, policy_version 30419 (0.0008) [2023-12-27 19:26:57,812][106226] Updated weights for policy 0, policy_version 30513 (0.0006) [2023-12-27 19:26:57,865][106226] Updated weights for policy 0, policy_version 30523 (0.0005) [2023-12-27 19:26:57,915][106226] Updated weights for policy 0, policy_version 30533 (0.0005) [2023-12-27 19:26:58,208][106225] Updated weights for policy 1, policy_version 30429 (0.0008) [2023-12-27 19:26:58,279][106225] Updated weights for policy 1, policy_version 30439 (0.0008) [2023-12-27 19:26:58,351][106225] Updated weights for policy 1, policy_version 30449 (0.0009) [2023-12-27 19:26:58,667][106226] Updated weights for policy 0, policy_version 30543 (0.0007) [2023-12-27 19:26:58,723][106226] Updated weights for policy 0, policy_version 30553 (0.0008) [2023-12-27 19:26:58,787][106226] Updated weights for policy 0, policy_version 30563 (0.0008) [2023-12-27 19:26:59,157][106225] Updated weights for policy 1, policy_version 30459 (0.0009) [2023-12-27 19:26:59,223][106225] Updated weights for policy 1, policy_version 30469 (0.0007) [2023-12-27 19:26:59,288][106225] Updated weights for policy 1, policy_version 30479 (0.0008) [2023-12-27 19:26:59,570][106226] Updated weights for policy 0, policy_version 30573 (0.0009) [2023-12-27 19:26:59,626][106226] Updated weights for policy 0, policy_version 30583 (0.0011) [2023-12-27 19:26:59,690][106226] Updated weights for policy 0, policy_version 30593 (0.0011) [2023-12-27 19:26:59,978][106225] Updated weights for policy 1, policy_version 30489 (0.0012) [2023-12-27 19:27:00,033][106225] Updated weights for policy 1, policy_version 30499 (0.0007) [2023-12-27 19:27:00,081][106225] Updated weights for policy 1, policy_version 30509 (0.0008) [2023-12-27 19:27:00,135][106225] Updated weights for policy 1, policy_version 30519 (0.0009) [2023-12-27 19:27:00,384][106226] Updated weights for policy 0, policy_version 30603 (0.0011) [2023-12-27 19:27:00,449][106226] Updated weights for policy 0, policy_version 30613 (0.0011) [2023-12-27 19:27:00,505][106226] Updated weights for policy 0, policy_version 30623 (0.0010) [2023-12-27 19:27:00,961][106225] Updated weights for policy 1, policy_version 30529 (0.0006) [2023-12-27 19:27:01,017][106225] Updated weights for policy 1, policy_version 30539 (0.0007) [2023-12-27 19:27:01,090][106225] Updated weights for policy 1, policy_version 30549 (0.0009) [2023-12-27 19:27:01,103][106226] Updated weights for policy 0, policy_version 30633 (0.0010) [2023-12-27 19:27:01,170][106226] Updated weights for policy 0, policy_version 30643 (0.0008) [2023-12-27 19:27:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 15671296. Throughput: 0: 10002.6, 1: 9941.2. Samples: 15661692. Policy #0 lag: (min: 30.0, avg: 44.1, max: 62.0) [2023-12-27 19:27:01,175][105115] Avg episode reward: [(0, '-5.382'), (1, '-6.895')] [2023-12-27 19:27:01,231][106226] Updated weights for policy 0, policy_version 30653 (0.0008) [2023-12-27 19:27:01,295][106226] Updated weights for policy 0, policy_version 30663 (0.0009) [2023-12-27 19:27:01,763][106225] Updated weights for policy 1, policy_version 30559 (0.0009) [2023-12-27 19:27:01,823][106225] Updated weights for policy 1, policy_version 30569 (0.0009) [2023-12-27 19:27:01,880][106225] Updated weights for policy 1, policy_version 30579 (0.0009) [2023-12-27 19:27:01,984][106226] Updated weights for policy 0, policy_version 30673 (0.0009) [2023-12-27 19:27:02,048][106226] Updated weights for policy 0, policy_version 30683 (0.0007) [2023-12-27 19:27:02,110][106226] Updated weights for policy 0, policy_version 30693 (0.0008) [2023-12-27 19:27:02,603][106225] Updated weights for policy 1, policy_version 30589 (0.0007) [2023-12-27 19:27:02,659][106225] Updated weights for policy 1, policy_version 30599 (0.0006) [2023-12-27 19:27:02,718][106225] Updated weights for policy 1, policy_version 30609 (0.0009) [2023-12-27 19:27:02,795][106226] Updated weights for policy 0, policy_version 30703 (0.0007) [2023-12-27 19:27:02,856][106226] Updated weights for policy 0, policy_version 30713 (0.0006) [2023-12-27 19:27:02,924][106226] Updated weights for policy 0, policy_version 30723 (0.0006) [2023-12-27 19:27:03,459][106225] Updated weights for policy 1, policy_version 30619 (0.0007) [2023-12-27 19:27:03,514][106225] Updated weights for policy 1, policy_version 30629 (0.0005) [2023-12-27 19:27:03,531][106226] Updated weights for policy 0, policy_version 30733 (0.0006) [2023-12-27 19:27:03,572][106225] Updated weights for policy 1, policy_version 30639 (0.0005) [2023-12-27 19:27:03,578][106226] Updated weights for policy 0, policy_version 30743 (0.0008) [2023-12-27 19:27:03,628][106226] Updated weights for policy 0, policy_version 30753 (0.0008) [2023-12-27 19:27:04,236][106225] Updated weights for policy 1, policy_version 30649 (0.0005) [2023-12-27 19:27:04,295][106225] Updated weights for policy 1, policy_version 30659 (0.0008) [2023-12-27 19:27:04,354][106225] Updated weights for policy 1, policy_version 30669 (0.0008) [2023-12-27 19:27:04,418][106226] Updated weights for policy 0, policy_version 30763 (0.0006) [2023-12-27 19:27:04,420][106225] Updated weights for policy 1, policy_version 30679 (0.0009) [2023-12-27 19:27:04,477][106226] Updated weights for policy 0, policy_version 30773 (0.0008) [2023-12-27 19:27:04,537][106226] Updated weights for policy 0, policy_version 30783 (0.0008) [2023-12-27 19:27:05,145][106225] Updated weights for policy 1, policy_version 30689 (0.0010) [2023-12-27 19:27:05,199][106225] Updated weights for policy 1, policy_version 30699 (0.0005) [2023-12-27 19:27:05,224][106226] Updated weights for policy 0, policy_version 30793 (0.0008) [2023-12-27 19:27:05,251][106225] Updated weights for policy 1, policy_version 30709 (0.0005) [2023-12-27 19:27:05,280][106226] Updated weights for policy 0, policy_version 30803 (0.0011) [2023-12-27 19:27:05,327][106226] Updated weights for policy 0, policy_version 30813 (0.0010) [2023-12-27 19:27:05,380][106226] Updated weights for policy 0, policy_version 30823 (0.0010) [2023-12-27 19:27:05,893][106225] Updated weights for policy 1, policy_version 30719 (0.0009) [2023-12-27 19:27:05,940][106225] Updated weights for policy 1, policy_version 30729 (0.0010) [2023-12-27 19:27:05,988][106226] Updated weights for policy 0, policy_version 30833 (0.0009) [2023-12-27 19:27:05,992][106225] Updated weights for policy 1, policy_version 30739 (0.0010) [2023-12-27 19:27:06,048][106226] Updated weights for policy 0, policy_version 30843 (0.0010) [2023-12-27 19:27:06,096][106226] Updated weights for policy 0, policy_version 30853 (0.0010) [2023-12-27 19:27:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 15777792. Throughput: 0: 10121.6, 1: 9943.9. Samples: 15781652. Policy #0 lag: (min: 30.0, avg: 44.1, max: 62.0) [2023-12-27 19:27:06,175][105115] Avg episode reward: [(0, '-5.490'), (1, '-7.062')] [2023-12-27 19:27:06,734][106225] Updated weights for policy 1, policy_version 30749 (0.0009) [2023-12-27 19:27:06,784][106225] Updated weights for policy 1, policy_version 30759 (0.0008) [2023-12-27 19:27:06,821][106226] Updated weights for policy 0, policy_version 30863 (0.0010) [2023-12-27 19:27:06,836][106225] Updated weights for policy 1, policy_version 30769 (0.0006) [2023-12-27 19:27:06,872][106226] Updated weights for policy 0, policy_version 30873 (0.0010) [2023-12-27 19:27:06,925][106226] Updated weights for policy 0, policy_version 30883 (0.0010) [2023-12-27 19:27:07,470][106225] Updated weights for policy 1, policy_version 30779 (0.0006) [2023-12-27 19:27:07,533][106225] Updated weights for policy 1, policy_version 30789 (0.0006) [2023-12-27 19:27:07,600][106225] Updated weights for policy 1, policy_version 30799 (0.0005) [2023-12-27 19:27:07,664][106226] Updated weights for policy 0, policy_version 30893 (0.0011) [2023-12-27 19:27:07,731][106226] Updated weights for policy 0, policy_version 30903 (0.0011) [2023-12-27 19:27:07,787][106226] Updated weights for policy 0, policy_version 30913 (0.0010) [2023-12-27 19:27:08,178][106225] Updated weights for policy 1, policy_version 30809 (0.0005) [2023-12-27 19:27:08,228][106225] Updated weights for policy 1, policy_version 30819 (0.0007) [2023-12-27 19:27:08,281][106225] Updated weights for policy 1, policy_version 30829 (0.0005) [2023-12-27 19:27:08,340][106225] Updated weights for policy 1, policy_version 30839 (0.0006) [2023-12-27 19:27:08,594][106226] Updated weights for policy 0, policy_version 30923 (0.0009) [2023-12-27 19:27:08,661][106226] Updated weights for policy 0, policy_version 30933 (0.0009) [2023-12-27 19:27:08,729][106226] Updated weights for policy 0, policy_version 30943 (0.0008) [2023-12-27 19:27:08,989][106225] Updated weights for policy 1, policy_version 30849 (0.0010) [2023-12-27 19:27:09,050][106225] Updated weights for policy 1, policy_version 30859 (0.0010) [2023-12-27 19:27:09,109][106225] Updated weights for policy 1, policy_version 30869 (0.0007) [2023-12-27 19:27:09,525][106226] Updated weights for policy 0, policy_version 30953 (0.0009) [2023-12-27 19:27:09,583][106226] Updated weights for policy 0, policy_version 30963 (0.0008) [2023-12-27 19:27:09,638][106226] Updated weights for policy 0, policy_version 30973 (0.0005) [2023-12-27 19:27:09,701][106226] Updated weights for policy 0, policy_version 30983 (0.0005) [2023-12-27 19:27:09,785][106225] Updated weights for policy 1, policy_version 30879 (0.0009) [2023-12-27 19:27:09,849][106225] Updated weights for policy 1, policy_version 30889 (0.0011) [2023-12-27 19:27:09,918][106225] Updated weights for policy 1, policy_version 30899 (0.0011) [2023-12-27 19:27:10,386][106226] Updated weights for policy 0, policy_version 30993 (0.0009) [2023-12-27 19:27:10,450][106226] Updated weights for policy 0, policy_version 31003 (0.0007) [2023-12-27 19:27:10,508][106226] Updated weights for policy 0, policy_version 31013 (0.0007) [2023-12-27 19:27:10,613][106225] Updated weights for policy 1, policy_version 30909 (0.0008) [2023-12-27 19:27:10,667][106225] Updated weights for policy 1, policy_version 30919 (0.0005) [2023-12-27 19:27:10,719][106225] Updated weights for policy 1, policy_version 30929 (0.0005) [2023-12-27 19:27:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 15867904. Throughput: 0: 10078.3, 1: 9992.5. Samples: 15841440. Policy #0 lag: (min: 26.0, avg: 40.1, max: 58.0) [2023-12-27 19:27:11,176][105115] Avg episode reward: [(0, '-5.314'), (1, '-7.382')] [2023-12-27 19:27:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000030936_7921664.pth... [2023-12-27 19:27:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000031016_7946240.pth... [2023-12-27 19:27:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000029784_7626752.pth [2023-12-27 19:27:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000029864_7651328.pth [2023-12-27 19:27:11,317][106226] Updated weights for policy 0, policy_version 31023 (0.0009) [2023-12-27 19:27:11,351][106225] Updated weights for policy 1, policy_version 30939 (0.0006) [2023-12-27 19:27:11,391][106226] Updated weights for policy 0, policy_version 31033 (0.0009) [2023-12-27 19:27:11,422][106225] Updated weights for policy 1, policy_version 30949 (0.0008) [2023-12-27 19:27:11,456][106226] Updated weights for policy 0, policy_version 31043 (0.0009) [2023-12-27 19:27:11,483][106225] Updated weights for policy 1, policy_version 30959 (0.0007) [2023-12-27 19:27:12,198][106226] Updated weights for policy 0, policy_version 31053 (0.0008) [2023-12-27 19:27:12,198][106225] Updated weights for policy 1, policy_version 30969 (0.0008) [2023-12-27 19:27:12,257][106225] Updated weights for policy 1, policy_version 30979 (0.0008) [2023-12-27 19:27:12,260][106226] Updated weights for policy 0, policy_version 31063 (0.0007) [2023-12-27 19:27:12,320][106226] Updated weights for policy 0, policy_version 31073 (0.0008) [2023-12-27 19:27:12,323][106225] Updated weights for policy 1, policy_version 30989 (0.0008) [2023-12-27 19:27:12,389][106225] Updated weights for policy 1, policy_version 30999 (0.0010) [2023-12-27 19:27:13,074][106226] Updated weights for policy 0, policy_version 31083 (0.0008) [2023-12-27 19:27:13,089][106225] Updated weights for policy 1, policy_version 31009 (0.0006) [2023-12-27 19:27:13,120][106226] Updated weights for policy 0, policy_version 31093 (0.0008) [2023-12-27 19:27:13,146][106225] Updated weights for policy 1, policy_version 31019 (0.0005) [2023-12-27 19:27:13,173][106226] Updated weights for policy 0, policy_version 31103 (0.0008) [2023-12-27 19:27:13,207][106225] Updated weights for policy 1, policy_version 31029 (0.0005) [2023-12-27 19:27:13,841][106225] Updated weights for policy 1, policy_version 31039 (0.0006) [2023-12-27 19:27:13,872][106226] Updated weights for policy 0, policy_version 31113 (0.0006) [2023-12-27 19:27:13,900][106225] Updated weights for policy 1, policy_version 31049 (0.0006) [2023-12-27 19:27:13,931][106226] Updated weights for policy 0, policy_version 31123 (0.0008) [2023-12-27 19:27:13,955][106225] Updated weights for policy 1, policy_version 31059 (0.0006) [2023-12-27 19:27:13,985][106226] Updated weights for policy 0, policy_version 31133 (0.0007) [2023-12-27 19:27:14,043][106226] Updated weights for policy 0, policy_version 31143 (0.0008) [2023-12-27 19:27:14,586][106225] Updated weights for policy 1, policy_version 31069 (0.0007) [2023-12-27 19:27:14,634][106225] Updated weights for policy 1, policy_version 31079 (0.0009) [2023-12-27 19:27:14,687][106225] Updated weights for policy 1, policy_version 31089 (0.0006) [2023-12-27 19:27:14,773][106226] Updated weights for policy 0, policy_version 31153 (0.0009) [2023-12-27 19:27:14,844][106226] Updated weights for policy 0, policy_version 31163 (0.0007) [2023-12-27 19:27:14,902][106226] Updated weights for policy 0, policy_version 31173 (0.0007) [2023-12-27 19:27:15,319][106225] Updated weights for policy 1, policy_version 31099 (0.0005) [2023-12-27 19:27:15,387][106225] Updated weights for policy 1, policy_version 31109 (0.0008) [2023-12-27 19:27:15,443][106225] Updated weights for policy 1, policy_version 31119 (0.0005) [2023-12-27 19:27:15,707][106226] Updated weights for policy 0, policy_version 31183 (0.0009) [2023-12-27 19:27:15,759][106226] Updated weights for policy 0, policy_version 31193 (0.0009) [2023-12-27 19:27:15,829][106226] Updated weights for policy 0, policy_version 31203 (0.0009) [2023-12-27 19:27:16,009][106225] Updated weights for policy 1, policy_version 31129 (0.0006) [2023-12-27 19:27:16,055][106225] Updated weights for policy 1, policy_version 31139 (0.0008) [2023-12-27 19:27:16,106][106225] Updated weights for policy 1, policy_version 31149 (0.0008) [2023-12-27 19:27:16,155][106225] Updated weights for policy 1, policy_version 31159 (0.0008) [2023-12-27 19:27:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.3, 300 sec: 19966.2). Total num frames: 15974400. Throughput: 0: 9905.0, 1: 9950.8. Samples: 15958216. Policy #0 lag: (min: 26.0, avg: 40.1, max: 58.0) [2023-12-27 19:27:16,176][105115] Avg episode reward: [(0, '-5.756'), (1, '-7.192')] [2023-12-27 19:27:16,548][106226] Updated weights for policy 0, policy_version 31213 (0.0008) [2023-12-27 19:27:16,605][106226] Updated weights for policy 0, policy_version 31223 (0.0009) [2023-12-27 19:27:16,674][106226] Updated weights for policy 0, policy_version 31233 (0.0005) [2023-12-27 19:27:16,921][106225] Updated weights for policy 1, policy_version 31169 (0.0008) [2023-12-27 19:27:16,973][106225] Updated weights for policy 1, policy_version 31179 (0.0008) [2023-12-27 19:27:17,022][106225] Updated weights for policy 1, policy_version 31189 (0.0008) [2023-12-27 19:27:17,402][106226] Updated weights for policy 0, policy_version 31243 (0.0008) [2023-12-27 19:27:17,452][106226] Updated weights for policy 0, policy_version 31253 (0.0009) [2023-12-27 19:27:17,504][106226] Updated weights for policy 0, policy_version 31263 (0.0009) [2023-12-27 19:27:17,630][106225] Updated weights for policy 1, policy_version 31199 (0.0007) [2023-12-27 19:27:17,684][106225] Updated weights for policy 1, policy_version 31209 (0.0008) [2023-12-27 19:27:17,746][106225] Updated weights for policy 1, policy_version 31219 (0.0009) [2023-12-27 19:27:18,288][106226] Updated weights for policy 0, policy_version 31273 (0.0010) [2023-12-27 19:27:18,351][106226] Updated weights for policy 0, policy_version 31283 (0.0009) [2023-12-27 19:27:18,410][106225] Updated weights for policy 1, policy_version 31229 (0.0007) [2023-12-27 19:27:18,415][106226] Updated weights for policy 0, policy_version 31293 (0.0008) [2023-12-27 19:27:18,471][106225] Updated weights for policy 1, policy_version 31239 (0.0007) [2023-12-27 19:27:18,477][106226] Updated weights for policy 0, policy_version 31303 (0.0008) [2023-12-27 19:27:18,533][106225] Updated weights for policy 1, policy_version 31249 (0.0008) [2023-12-27 19:27:19,203][106226] Updated weights for policy 0, policy_version 31313 (0.0008) [2023-12-27 19:27:19,261][106225] Updated weights for policy 1, policy_version 31259 (0.0009) [2023-12-27 19:27:19,271][106226] Updated weights for policy 0, policy_version 31323 (0.0007) [2023-12-27 19:27:19,321][106225] Updated weights for policy 1, policy_version 31269 (0.0007) [2023-12-27 19:27:19,339][106226] Updated weights for policy 0, policy_version 31333 (0.0008) [2023-12-27 19:27:19,387][106225] Updated weights for policy 1, policy_version 31279 (0.0007) [2023-12-27 19:27:20,080][106226] Updated weights for policy 0, policy_version 31343 (0.0008) [2023-12-27 19:27:20,142][106226] Updated weights for policy 0, policy_version 31353 (0.0008) [2023-12-27 19:27:20,215][106226] Updated weights for policy 0, policy_version 31363 (0.0006) [2023-12-27 19:27:20,245][106225] Updated weights for policy 1, policy_version 31289 (0.0008) [2023-12-27 19:27:20,311][106225] Updated weights for policy 1, policy_version 31299 (0.0008) [2023-12-27 19:27:20,379][106225] Updated weights for policy 1, policy_version 31309 (0.0008) [2023-12-27 19:27:20,445][106225] Updated weights for policy 1, policy_version 31319 (0.0009) [2023-12-27 19:27:20,947][106226] Updated weights for policy 0, policy_version 31373 (0.0008) [2023-12-27 19:27:21,010][106226] Updated weights for policy 0, policy_version 31383 (0.0008) [2023-12-27 19:27:21,080][106226] Updated weights for policy 0, policy_version 31393 (0.0008) [2023-12-27 19:27:21,128][106225] Updated weights for policy 1, policy_version 31329 (0.0006) [2023-12-27 19:27:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 16064512. Throughput: 0: 9766.5, 1: 9987.2. Samples: 16074772. Policy #0 lag: (min: 26.0, avg: 40.1, max: 58.0) [2023-12-27 19:27:21,177][105115] Avg episode reward: [(0, '-5.606'), (1, '-6.674')] [2023-12-27 19:27:21,192][106225] Updated weights for policy 1, policy_version 31339 (0.0008) [2023-12-27 19:27:21,254][106225] Updated weights for policy 1, policy_version 31349 (0.0006) [2023-12-27 19:27:21,812][106226] Updated weights for policy 0, policy_version 31403 (0.0007) [2023-12-27 19:27:21,877][106226] Updated weights for policy 0, policy_version 31413 (0.0007) [2023-12-27 19:27:21,922][106225] Updated weights for policy 1, policy_version 31359 (0.0006) [2023-12-27 19:27:21,941][106226] Updated weights for policy 0, policy_version 31423 (0.0007) [2023-12-27 19:27:21,985][106225] Updated weights for policy 1, policy_version 31369 (0.0007) [2023-12-27 19:27:22,046][106225] Updated weights for policy 1, policy_version 31379 (0.0008) [2023-12-27 19:27:22,622][106226] Updated weights for policy 0, policy_version 31433 (0.0007) [2023-12-27 19:27:22,686][106226] Updated weights for policy 0, policy_version 31443 (0.0009) [2023-12-27 19:27:22,730][106225] Updated weights for policy 1, policy_version 31389 (0.0008) [2023-12-27 19:27:22,749][106226] Updated weights for policy 0, policy_version 31453 (0.0009) [2023-12-27 19:27:22,794][106225] Updated weights for policy 1, policy_version 31399 (0.0008) [2023-12-27 19:27:22,813][106226] Updated weights for policy 0, policy_version 31463 (0.0009) [2023-12-27 19:27:22,861][106225] Updated weights for policy 1, policy_version 31409 (0.0009) [2023-12-27 19:27:23,483][106226] Updated weights for policy 0, policy_version 31473 (0.0005) [2023-12-27 19:27:23,524][106225] Updated weights for policy 1, policy_version 31419 (0.0008) [2023-12-27 19:27:23,541][106226] Updated weights for policy 0, policy_version 31483 (0.0006) [2023-12-27 19:27:23,581][106225] Updated weights for policy 1, policy_version 31429 (0.0007) [2023-12-27 19:27:23,596][106226] Updated weights for policy 0, policy_version 31493 (0.0009) [2023-12-27 19:27:23,631][106225] Updated weights for policy 1, policy_version 31439 (0.0005) [2023-12-27 19:27:24,187][106225] Updated weights for policy 1, policy_version 31449 (0.0006) [2023-12-27 19:27:24,227][106226] Updated weights for policy 0, policy_version 31503 (0.0007) [2023-12-27 19:27:24,241][106225] Updated weights for policy 1, policy_version 31459 (0.0010) [2023-12-27 19:27:24,287][106226] Updated weights for policy 0, policy_version 31513 (0.0005) [2023-12-27 19:27:24,290][106225] Updated weights for policy 1, policy_version 31469 (0.0009) [2023-12-27 19:27:24,347][106225] Updated weights for policy 1, policy_version 31479 (0.0010) [2023-12-27 19:27:24,349][106226] Updated weights for policy 0, policy_version 31523 (0.0006) [2023-12-27 19:27:24,882][106226] Updated weights for policy 0, policy_version 31533 (0.0006) [2023-12-27 19:27:24,939][106226] Updated weights for policy 0, policy_version 31543 (0.0005) [2023-12-27 19:27:24,967][106225] Updated weights for policy 1, policy_version 31489 (0.0010) [2023-12-27 19:27:24,992][106226] Updated weights for policy 0, policy_version 31553 (0.0005) [2023-12-27 19:27:25,026][106225] Updated weights for policy 1, policy_version 31499 (0.0010) [2023-12-27 19:27:25,096][106225] Updated weights for policy 1, policy_version 31509 (0.0009) [2023-12-27 19:27:25,573][106226] Updated weights for policy 0, policy_version 31563 (0.0008) [2023-12-27 19:27:25,629][106226] Updated weights for policy 0, policy_version 31573 (0.0010) [2023-12-27 19:27:25,671][106225] Updated weights for policy 1, policy_version 31519 (0.0010) [2023-12-27 19:27:25,682][106226] Updated weights for policy 0, policy_version 31583 (0.0010) [2023-12-27 19:27:25,721][106225] Updated weights for policy 1, policy_version 31529 (0.0010) [2023-12-27 19:27:25,773][106225] Updated weights for policy 1, policy_version 31539 (0.0010) [2023-12-27 19:27:26,174][105115] Fps is (10 sec: 19661.5, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 16171008. Throughput: 0: 9796.3, 1: 9998.1. Samples: 16135036. Policy #0 lag: (min: 26.0, avg: 40.1, max: 58.0) [2023-12-27 19:27:26,175][105115] Avg episode reward: [(0, '-5.629'), (1, '-6.868')] [2023-12-27 19:27:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000031544_8077312.pth... [2023-12-27 19:27:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000031592_8093696.pth... [2023-12-27 19:27:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000030440_7798784.pth [2023-12-27 19:27:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000030360_7774208.pth [2023-12-27 19:27:26,272][106226] Updated weights for policy 0, policy_version 31593 (0.0010) [2023-12-27 19:27:26,330][106226] Updated weights for policy 0, policy_version 31603 (0.0006) [2023-12-27 19:27:26,394][106226] Updated weights for policy 0, policy_version 31613 (0.0006) [2023-12-27 19:27:26,454][106226] Updated weights for policy 0, policy_version 31623 (0.0010) [2023-12-27 19:27:26,497][106225] Updated weights for policy 1, policy_version 31549 (0.0010) [2023-12-27 19:27:26,555][106225] Updated weights for policy 1, policy_version 31559 (0.0009) [2023-12-27 19:27:26,610][106225] Updated weights for policy 1, policy_version 31569 (0.0005) [2023-12-27 19:27:27,040][106226] Updated weights for policy 0, policy_version 31633 (0.0010) [2023-12-27 19:27:27,083][106226] Updated weights for policy 0, policy_version 31643 (0.0010) [2023-12-27 19:27:27,130][106226] Updated weights for policy 0, policy_version 31653 (0.0009) [2023-12-27 19:27:27,202][106225] Updated weights for policy 1, policy_version 31579 (0.0007) [2023-12-27 19:27:27,255][106225] Updated weights for policy 1, policy_version 31589 (0.0010) [2023-12-27 19:27:27,304][106225] Updated weights for policy 1, policy_version 31599 (0.0010) [2023-12-27 19:27:27,753][106226] Updated weights for policy 0, policy_version 31663 (0.0008) [2023-12-27 19:27:27,804][106226] Updated weights for policy 0, policy_version 31673 (0.0008) [2023-12-27 19:27:27,853][106226] Updated weights for policy 0, policy_version 31683 (0.0008) [2023-12-27 19:27:27,997][106225] Updated weights for policy 1, policy_version 31609 (0.0010) [2023-12-27 19:27:28,050][106225] Updated weights for policy 1, policy_version 31619 (0.0010) [2023-12-27 19:27:28,096][106225] Updated weights for policy 1, policy_version 31629 (0.0010) [2023-12-27 19:27:28,148][106225] Updated weights for policy 1, policy_version 31639 (0.0010) [2023-12-27 19:27:28,544][106226] Updated weights for policy 0, policy_version 31693 (0.0006) [2023-12-27 19:27:28,621][106226] Updated weights for policy 0, policy_version 31703 (0.0009) [2023-12-27 19:27:28,692][106226] Updated weights for policy 0, policy_version 31713 (0.0009) [2023-12-27 19:27:28,846][106225] Updated weights for policy 1, policy_version 31649 (0.0006) [2023-12-27 19:27:28,898][106225] Updated weights for policy 1, policy_version 31659 (0.0009) [2023-12-27 19:27:28,950][106225] Updated weights for policy 1, policy_version 31669 (0.0006) [2023-12-27 19:27:29,454][106226] Updated weights for policy 0, policy_version 31723 (0.0007) [2023-12-27 19:27:29,515][106226] Updated weights for policy 0, policy_version 31733 (0.0005) [2023-12-27 19:27:29,565][106225] Updated weights for policy 1, policy_version 31679 (0.0009) [2023-12-27 19:27:29,567][106226] Updated weights for policy 0, policy_version 31743 (0.0006) [2023-12-27 19:27:29,625][106225] Updated weights for policy 1, policy_version 31689 (0.0010) [2023-12-27 19:27:29,682][106225] Updated weights for policy 1, policy_version 31699 (0.0010) [2023-12-27 19:27:30,217][106226] Updated weights for policy 0, policy_version 31753 (0.0007) [2023-12-27 19:27:30,288][106226] Updated weights for policy 0, policy_version 31763 (0.0008) [2023-12-27 19:27:30,353][106226] Updated weights for policy 0, policy_version 31773 (0.0007) [2023-12-27 19:27:30,367][106225] Updated weights for policy 1, policy_version 31709 (0.0009) [2023-12-27 19:27:30,413][106226] Updated weights for policy 0, policy_version 31783 (0.0008) [2023-12-27 19:27:30,424][106225] Updated weights for policy 1, policy_version 31719 (0.0006) [2023-12-27 19:27:30,471][106225] Updated weights for policy 1, policy_version 31729 (0.0006) [2023-12-27 19:27:31,102][106225] Updated weights for policy 1, policy_version 31739 (0.0007) [2023-12-27 19:27:31,134][106226] Updated weights for policy 0, policy_version 31793 (0.0007) [2023-12-27 19:27:31,170][106225] Updated weights for policy 1, policy_version 31749 (0.0007) [2023-12-27 19:27:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 16269312. Throughput: 0: 10008.6, 1: 10141.0. Samples: 16264404. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-27 19:27:31,175][105115] Avg episode reward: [(0, '-5.079'), (1, '-7.021')] [2023-12-27 19:27:31,192][106226] Updated weights for policy 0, policy_version 31803 (0.0006) [2023-12-27 19:27:31,232][106225] Updated weights for policy 1, policy_version 31759 (0.0009) [2023-12-27 19:27:31,239][106226] Updated weights for policy 0, policy_version 31813 (0.0005) [2023-12-27 19:27:31,918][106225] Updated weights for policy 1, policy_version 31769 (0.0008) [2023-12-27 19:27:31,979][106225] Updated weights for policy 1, policy_version 31779 (0.0007) [2023-12-27 19:27:31,993][106226] Updated weights for policy 0, policy_version 31823 (0.0006) [2023-12-27 19:27:32,038][106225] Updated weights for policy 1, policy_version 31789 (0.0008) [2023-12-27 19:27:32,043][106226] Updated weights for policy 0, policy_version 31833 (0.0006) [2023-12-27 19:27:32,094][106226] Updated weights for policy 0, policy_version 31843 (0.0008) [2023-12-27 19:27:32,097][106225] Updated weights for policy 1, policy_version 31799 (0.0005) [2023-12-27 19:27:32,725][106225] Updated weights for policy 1, policy_version 31809 (0.0008) [2023-12-27 19:27:32,775][106225] Updated weights for policy 1, policy_version 31819 (0.0008) [2023-12-27 19:27:32,789][106226] Updated weights for policy 0, policy_version 31853 (0.0006) [2023-12-27 19:27:32,823][106225] Updated weights for policy 1, policy_version 31829 (0.0007) [2023-12-27 19:27:32,845][106226] Updated weights for policy 0, policy_version 31863 (0.0007) [2023-12-27 19:27:32,889][106226] Updated weights for policy 0, policy_version 31873 (0.0008) [2023-12-27 19:27:33,518][106225] Updated weights for policy 1, policy_version 31839 (0.0006) [2023-12-27 19:27:33,575][106225] Updated weights for policy 1, policy_version 31849 (0.0006) [2023-12-27 19:27:33,613][106226] Updated weights for policy 0, policy_version 31883 (0.0008) [2023-12-27 19:27:33,627][106225] Updated weights for policy 1, policy_version 31859 (0.0006) [2023-12-27 19:27:33,668][106226] Updated weights for policy 0, policy_version 31893 (0.0007) [2023-12-27 19:27:33,716][106226] Updated weights for policy 0, policy_version 31903 (0.0008) [2023-12-27 19:27:34,310][106225] Updated weights for policy 1, policy_version 31869 (0.0008) [2023-12-27 19:27:34,364][106225] Updated weights for policy 1, policy_version 31879 (0.0007) [2023-12-27 19:27:34,424][106225] Updated weights for policy 1, policy_version 31889 (0.0007) [2023-12-27 19:27:34,432][106226] Updated weights for policy 0, policy_version 31913 (0.0007) [2023-12-27 19:27:34,487][106226] Updated weights for policy 0, policy_version 31923 (0.0010) [2023-12-27 19:27:34,535][106226] Updated weights for policy 0, policy_version 31933 (0.0011) [2023-12-27 19:27:34,587][106226] Updated weights for policy 0, policy_version 31943 (0.0011) [2023-12-27 19:27:35,167][106225] Updated weights for policy 1, policy_version 31899 (0.0008) [2023-12-27 19:27:35,226][106225] Updated weights for policy 1, policy_version 31909 (0.0006) [2023-12-27 19:27:35,262][106226] Updated weights for policy 0, policy_version 31953 (0.0006) [2023-12-27 19:27:35,282][106225] Updated weights for policy 1, policy_version 31919 (0.0007) [2023-12-27 19:27:35,321][106226] Updated weights for policy 0, policy_version 31963 (0.0005) [2023-12-27 19:27:35,390][106226] Updated weights for policy 0, policy_version 31973 (0.0005) [2023-12-27 19:27:35,936][106225] Updated weights for policy 1, policy_version 31929 (0.0006) [2023-12-27 19:27:35,977][106226] Updated weights for policy 0, policy_version 31983 (0.0005) [2023-12-27 19:27:35,992][106225] Updated weights for policy 1, policy_version 31939 (0.0010) [2023-12-27 19:27:36,025][106226] Updated weights for policy 0, policy_version 31993 (0.0005) [2023-12-27 19:27:36,043][106225] Updated weights for policy 1, policy_version 31949 (0.0010) [2023-12-27 19:27:36,079][106226] Updated weights for policy 0, policy_version 32003 (0.0005) [2023-12-27 19:27:36,100][106225] Updated weights for policy 1, policy_version 31959 (0.0010) [2023-12-27 19:27:36,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 16384000. Throughput: 0: 9955.8, 1: 10173.9. Samples: 16387128. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-27 19:27:36,175][105115] Avg episode reward: [(0, '-5.061'), (1, '-7.436')] [2023-12-27 19:27:36,787][106226] Updated weights for policy 0, policy_version 32013 (0.0010) [2023-12-27 19:27:36,831][106225] Updated weights for policy 1, policy_version 31969 (0.0006) [2023-12-27 19:27:36,848][106226] Updated weights for policy 0, policy_version 32023 (0.0011) [2023-12-27 19:27:36,889][106225] Updated weights for policy 1, policy_version 31979 (0.0010) [2023-12-27 19:27:36,906][106226] Updated weights for policy 0, policy_version 32033 (0.0010) [2023-12-27 19:27:36,947][106225] Updated weights for policy 1, policy_version 31989 (0.0010) [2023-12-27 19:27:37,526][106225] Updated weights for policy 1, policy_version 31999 (0.0007) [2023-12-27 19:27:37,588][106225] Updated weights for policy 1, policy_version 32009 (0.0005) [2023-12-27 19:27:37,617][106226] Updated weights for policy 0, policy_version 32043 (0.0010) [2023-12-27 19:27:37,654][106225] Updated weights for policy 1, policy_version 32019 (0.0008) [2023-12-27 19:27:37,677][106226] Updated weights for policy 0, policy_version 32053 (0.0006) [2023-12-27 19:27:37,735][106226] Updated weights for policy 0, policy_version 32063 (0.0006) [2023-12-27 19:27:38,355][106225] Updated weights for policy 1, policy_version 32029 (0.0008) [2023-12-27 19:27:38,367][106226] Updated weights for policy 0, policy_version 32073 (0.0010) [2023-12-27 19:27:38,420][106225] Updated weights for policy 1, policy_version 32039 (0.0006) [2023-12-27 19:27:38,422][106226] Updated weights for policy 0, policy_version 32083 (0.0011) [2023-12-27 19:27:38,482][106225] Updated weights for policy 1, policy_version 32049 (0.0005) [2023-12-27 19:27:38,483][106226] Updated weights for policy 0, policy_version 32093 (0.0011) [2023-12-27 19:27:38,548][106226] Updated weights for policy 0, policy_version 32103 (0.0011) [2023-12-27 19:27:39,169][106225] Updated weights for policy 1, policy_version 32059 (0.0007) [2023-12-27 19:27:39,220][106225] Updated weights for policy 1, policy_version 32069 (0.0010) [2023-12-27 19:27:39,282][106225] Updated weights for policy 1, policy_version 32079 (0.0007) [2023-12-27 19:27:39,305][106226] Updated weights for policy 0, policy_version 32113 (0.0008) [2023-12-27 19:27:39,364][106226] Updated weights for policy 0, policy_version 32123 (0.0008) [2023-12-27 19:27:39,441][106226] Updated weights for policy 0, policy_version 32133 (0.0008) [2023-12-27 19:27:40,070][106225] Updated weights for policy 1, policy_version 32089 (0.0006) [2023-12-27 19:27:40,128][106225] Updated weights for policy 1, policy_version 32099 (0.0010) [2023-12-27 19:27:40,179][106225] Updated weights for policy 1, policy_version 32109 (0.0010) [2023-12-27 19:27:40,195][106226] Updated weights for policy 0, policy_version 32143 (0.0007) [2023-12-27 19:27:40,242][106225] Updated weights for policy 1, policy_version 32119 (0.0010) [2023-12-27 19:27:40,260][106226] Updated weights for policy 0, policy_version 32153 (0.0006) [2023-12-27 19:27:40,315][106226] Updated weights for policy 0, policy_version 32163 (0.0005) [2023-12-27 19:27:40,933][106226] Updated weights for policy 0, policy_version 32173 (0.0006) [2023-12-27 19:27:40,963][106225] Updated weights for policy 1, policy_version 32129 (0.0010) [2023-12-27 19:27:40,981][106226] Updated weights for policy 0, policy_version 32183 (0.0007) [2023-12-27 19:27:41,027][106225] Updated weights for policy 1, policy_version 32139 (0.0010) [2023-12-27 19:27:41,043][106226] Updated weights for policy 0, policy_version 32193 (0.0008) [2023-12-27 19:27:41,131][106225] Updated weights for policy 1, policy_version 32149 (0.0008) [2023-12-27 19:27:41,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 16482304. Throughput: 0: 9895.5, 1: 10219.0. Samples: 16446684. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-27 19:27:41,175][105115] Avg episode reward: [(0, '-5.688'), (1, '-6.810')] [2023-12-27 19:27:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000032152_8232960.pth... [2023-12-27 19:27:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000032200_8249344.pth... [2023-12-27 19:27:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000031016_7946240.pth [2023-12-27 19:27:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000030936_7921664.pth [2023-12-27 19:27:41,823][106225] Updated weights for policy 1, policy_version 32159 (0.0009) [2023-12-27 19:27:41,855][106226] Updated weights for policy 0, policy_version 32203 (0.0008) [2023-12-27 19:27:41,881][106225] Updated weights for policy 1, policy_version 32169 (0.0007) [2023-12-27 19:27:41,915][106226] Updated weights for policy 0, policy_version 32213 (0.0006) [2023-12-27 19:27:41,944][106225] Updated weights for policy 1, policy_version 32179 (0.0006) [2023-12-27 19:27:41,976][106226] Updated weights for policy 0, policy_version 32223 (0.0007) [2023-12-27 19:27:42,597][106225] Updated weights for policy 1, policy_version 32189 (0.0005) [2023-12-27 19:27:42,656][106225] Updated weights for policy 1, policy_version 32199 (0.0006) [2023-12-27 19:27:42,718][106225] Updated weights for policy 1, policy_version 32209 (0.0008) [2023-12-27 19:27:42,731][106226] Updated weights for policy 0, policy_version 32233 (0.0009) [2023-12-27 19:27:42,791][106226] Updated weights for policy 0, policy_version 32243 (0.0010) [2023-12-27 19:27:42,855][106226] Updated weights for policy 0, policy_version 32253 (0.0010) [2023-12-27 19:27:42,918][106226] Updated weights for policy 0, policy_version 32263 (0.0010) [2023-12-27 19:27:43,443][106225] Updated weights for policy 1, policy_version 32219 (0.0008) [2023-12-27 19:27:43,494][106225] Updated weights for policy 1, policy_version 32229 (0.0008) [2023-12-27 19:27:43,542][106225] Updated weights for policy 1, policy_version 32239 (0.0008) [2023-12-27 19:27:43,562][106226] Updated weights for policy 0, policy_version 32273 (0.0010) [2023-12-27 19:27:43,628][106226] Updated weights for policy 0, policy_version 32283 (0.0010) [2023-12-27 19:27:43,703][106226] Updated weights for policy 0, policy_version 32293 (0.0010) [2023-12-27 19:27:44,303][106225] Updated weights for policy 1, policy_version 32249 (0.0006) [2023-12-27 19:27:44,360][106225] Updated weights for policy 1, policy_version 32259 (0.0006) [2023-12-27 19:27:44,408][106226] Updated weights for policy 0, policy_version 32303 (0.0008) [2023-12-27 19:27:44,412][106225] Updated weights for policy 1, policy_version 32269 (0.0006) [2023-12-27 19:27:44,455][106225] Updated weights for policy 1, policy_version 32279 (0.0006) [2023-12-27 19:27:44,468][106226] Updated weights for policy 0, policy_version 32313 (0.0007) [2023-12-27 19:27:44,522][106226] Updated weights for policy 0, policy_version 32323 (0.0008) [2023-12-27 19:27:45,171][106225] Updated weights for policy 1, policy_version 32289 (0.0006) [2023-12-27 19:27:45,239][106225] Updated weights for policy 1, policy_version 32299 (0.0008) [2023-12-27 19:27:45,283][106226] Updated weights for policy 0, policy_version 32333 (0.0007) [2023-12-27 19:27:45,304][106225] Updated weights for policy 1, policy_version 32309 (0.0008) [2023-12-27 19:27:45,347][106226] Updated weights for policy 0, policy_version 32343 (0.0007) [2023-12-27 19:27:45,406][106226] Updated weights for policy 0, policy_version 32353 (0.0008) [2023-12-27 19:27:45,975][106225] Updated weights for policy 1, policy_version 32319 (0.0008) [2023-12-27 19:27:46,035][106225] Updated weights for policy 1, policy_version 32329 (0.0008) [2023-12-27 19:27:46,096][106225] Updated weights for policy 1, policy_version 32339 (0.0007) [2023-12-27 19:27:46,115][106226] Updated weights for policy 0, policy_version 32363 (0.0007) [2023-12-27 19:27:46,171][106226] Updated weights for policy 0, policy_version 32373 (0.0007) [2023-12-27 19:27:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 20070.3, 300 sec: 19938.5). Total num frames: 16572416. Throughput: 0: 9864.8, 1: 10159.6. Samples: 16562792. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-27 19:27:46,176][105115] Avg episode reward: [(0, '-5.416'), (1, '-7.033')] [2023-12-27 19:27:46,233][106226] Updated weights for policy 0, policy_version 32383 (0.0008) [2023-12-27 19:27:46,830][106225] Updated weights for policy 1, policy_version 32349 (0.0007) [2023-12-27 19:27:46,886][106225] Updated weights for policy 1, policy_version 32359 (0.0007) [2023-12-27 19:27:46,934][106226] Updated weights for policy 0, policy_version 32393 (0.0008) [2023-12-27 19:27:46,937][106225] Updated weights for policy 1, policy_version 32369 (0.0009) [2023-12-27 19:27:46,985][106226] Updated weights for policy 0, policy_version 32403 (0.0005) [2023-12-27 19:27:47,040][106226] Updated weights for policy 0, policy_version 32413 (0.0005) [2023-12-27 19:27:47,090][106226] Updated weights for policy 0, policy_version 32423 (0.0005) [2023-12-27 19:27:47,602][106226] Updated weights for policy 0, policy_version 32433 (0.0009) [2023-12-27 19:27:47,652][106226] Updated weights for policy 0, policy_version 32443 (0.0010) [2023-12-27 19:27:47,703][106226] Updated weights for policy 0, policy_version 32453 (0.0010) [2023-12-27 19:27:47,760][106225] Updated weights for policy 1, policy_version 32379 (0.0007) [2023-12-27 19:27:47,806][106225] Updated weights for policy 1, policy_version 32389 (0.0008) [2023-12-27 19:27:47,853][106225] Updated weights for policy 1, policy_version 32399 (0.0007) [2023-12-27 19:27:48,442][106226] Updated weights for policy 0, policy_version 32463 (0.0011) [2023-12-27 19:27:48,509][106226] Updated weights for policy 0, policy_version 32473 (0.0011) [2023-12-27 19:27:48,574][106226] Updated weights for policy 0, policy_version 32483 (0.0011) [2023-12-27 19:27:48,640][106225] Updated weights for policy 1, policy_version 32409 (0.0008) [2023-12-27 19:27:48,705][106225] Updated weights for policy 1, policy_version 32419 (0.0008) [2023-12-27 19:27:48,770][106225] Updated weights for policy 1, policy_version 32429 (0.0008) [2023-12-27 19:27:48,833][106225] Updated weights for policy 1, policy_version 32439 (0.0006) [2023-12-27 19:27:49,234][106226] Updated weights for policy 0, policy_version 32493 (0.0011) [2023-12-27 19:27:49,303][106226] Updated weights for policy 0, policy_version 32503 (0.0010) [2023-12-27 19:27:49,373][106226] Updated weights for policy 0, policy_version 32513 (0.0009) [2023-12-27 19:27:49,618][106225] Updated weights for policy 1, policy_version 32449 (0.0009) [2023-12-27 19:27:49,675][106225] Updated weights for policy 1, policy_version 32459 (0.0009) [2023-12-27 19:27:49,732][106225] Updated weights for policy 1, policy_version 32469 (0.0009) [2023-12-27 19:27:50,258][106226] Updated weights for policy 0, policy_version 32523 (0.0010) [2023-12-27 19:27:50,313][106226] Updated weights for policy 0, policy_version 32533 (0.0011) [2023-12-27 19:27:50,374][106226] Updated weights for policy 0, policy_version 32543 (0.0011) [2023-12-27 19:27:50,608][106225] Updated weights for policy 1, policy_version 32479 (0.0009) [2023-12-27 19:27:50,661][106225] Updated weights for policy 1, policy_version 32489 (0.0008) [2023-12-27 19:27:50,722][106225] Updated weights for policy 1, policy_version 32499 (0.0008) [2023-12-27 19:27:51,111][106226] Updated weights for policy 0, policy_version 32553 (0.0011) [2023-12-27 19:27:51,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 16662528. Throughput: 0: 9799.9, 1: 10084.9. Samples: 16676468. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 19:27:51,175][105115] Avg episode reward: [(0, '-5.479'), (1, '-6.963')] [2023-12-27 19:27:51,179][106226] Updated weights for policy 0, policy_version 32563 (0.0012) [2023-12-27 19:27:51,240][106226] Updated weights for policy 0, policy_version 32573 (0.0009) [2023-12-27 19:27:51,312][106226] Updated weights for policy 0, policy_version 32583 (0.0008) [2023-12-27 19:27:51,445][106225] Updated weights for policy 1, policy_version 32509 (0.0008) [2023-12-27 19:27:51,513][106225] Updated weights for policy 1, policy_version 32519 (0.0007) [2023-12-27 19:27:51,575][106225] Updated weights for policy 1, policy_version 32529 (0.0007) [2023-12-27 19:27:51,994][106226] Updated weights for policy 0, policy_version 32593 (0.0009) [2023-12-27 19:27:52,047][106226] Updated weights for policy 0, policy_version 32603 (0.0008) [2023-12-27 19:27:52,099][106226] Updated weights for policy 0, policy_version 32613 (0.0008) [2023-12-27 19:27:52,324][106225] Updated weights for policy 1, policy_version 32539 (0.0008) [2023-12-27 19:27:52,389][106225] Updated weights for policy 1, policy_version 32549 (0.0008) [2023-12-27 19:27:52,452][106225] Updated weights for policy 1, policy_version 32559 (0.0010) [2023-12-27 19:27:52,862][106226] Updated weights for policy 0, policy_version 32623 (0.0009) [2023-12-27 19:27:52,923][106226] Updated weights for policy 0, policy_version 32633 (0.0008) [2023-12-27 19:27:52,979][106226] Updated weights for policy 0, policy_version 32643 (0.0008) [2023-12-27 19:27:53,117][106225] Updated weights for policy 1, policy_version 32569 (0.0010) [2023-12-27 19:27:53,166][106225] Updated weights for policy 1, policy_version 32579 (0.0010) [2023-12-27 19:27:53,221][106225] Updated weights for policy 1, policy_version 32589 (0.0010) [2023-12-27 19:27:53,270][106225] Updated weights for policy 1, policy_version 32599 (0.0010) [2023-12-27 19:27:53,668][106226] Updated weights for policy 0, policy_version 32653 (0.0008) [2023-12-27 19:27:53,714][106226] Updated weights for policy 0, policy_version 32663 (0.0010) [2023-12-27 19:27:53,764][106226] Updated weights for policy 0, policy_version 32673 (0.0010) [2023-12-27 19:27:53,965][106225] Updated weights for policy 1, policy_version 32609 (0.0010) [2023-12-27 19:27:54,015][106225] Updated weights for policy 1, policy_version 32619 (0.0010) [2023-12-27 19:27:54,072][106225] Updated weights for policy 1, policy_version 32629 (0.0010) [2023-12-27 19:27:54,484][106226] Updated weights for policy 0, policy_version 32683 (0.0009) [2023-12-27 19:27:54,548][106226] Updated weights for policy 0, policy_version 32693 (0.0009) [2023-12-27 19:27:54,608][106226] Updated weights for policy 0, policy_version 32703 (0.0011) [2023-12-27 19:27:54,808][106225] Updated weights for policy 1, policy_version 32639 (0.0007) [2023-12-27 19:27:54,861][106225] Updated weights for policy 1, policy_version 32649 (0.0010) [2023-12-27 19:27:54,915][106225] Updated weights for policy 1, policy_version 32659 (0.0010) [2023-12-27 19:27:55,185][106226] Updated weights for policy 0, policy_version 32713 (0.0010) [2023-12-27 19:27:55,242][106226] Updated weights for policy 0, policy_version 32723 (0.0008) [2023-12-27 19:27:55,297][106226] Updated weights for policy 0, policy_version 32733 (0.0007) [2023-12-27 19:27:55,351][106226] Updated weights for policy 0, policy_version 32743 (0.0007) [2023-12-27 19:27:55,624][106225] Updated weights for policy 1, policy_version 32669 (0.0010) [2023-12-27 19:27:55,674][106225] Updated weights for policy 1, policy_version 32679 (0.0010) [2023-12-27 19:27:55,724][106225] Updated weights for policy 1, policy_version 32689 (0.0010) [2023-12-27 19:27:55,925][106226] Updated weights for policy 0, policy_version 32753 (0.0008) [2023-12-27 19:27:55,980][106226] Updated weights for policy 0, policy_version 32763 (0.0007) [2023-12-27 19:27:56,036][106226] Updated weights for policy 0, policy_version 32773 (0.0005) [2023-12-27 19:27:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 16769024. Throughput: 0: 9833.3, 1: 10005.0. Samples: 16734160. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 19:27:56,175][105115] Avg episode reward: [(0, '-5.032'), (1, '-6.988')] [2023-12-27 19:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000032696_8372224.pth... [2023-12-27 19:27:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000032776_8396800.pth... [2023-12-27 19:27:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000031592_8093696.pth [2023-12-27 19:27:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000031544_8077312.pth [2023-12-27 19:27:56,449][106225] Updated weights for policy 1, policy_version 32699 (0.0010) [2023-12-27 19:27:56,512][106225] Updated weights for policy 1, policy_version 32709 (0.0010) [2023-12-27 19:27:56,571][106225] Updated weights for policy 1, policy_version 32719 (0.0010) [2023-12-27 19:27:56,574][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000007 [2023-12-27 19:27:56,682][106226] Updated weights for policy 0, policy_version 32783 (0.0008) [2023-12-27 19:27:56,746][106226] Updated weights for policy 0, policy_version 32793 (0.0007) [2023-12-27 19:27:56,808][106226] Updated weights for policy 0, policy_version 32803 (0.0005) [2023-12-27 19:27:57,345][106225] Updated weights for policy 1, policy_version 32729 (0.0008) [2023-12-27 19:27:57,404][106225] Updated weights for policy 1, policy_version 32739 (0.0010) [2023-12-27 19:27:57,429][106226] Updated weights for policy 0, policy_version 32813 (0.0005) [2023-12-27 19:27:57,463][106225] Updated weights for policy 1, policy_version 32749 (0.0009) [2023-12-27 19:27:57,479][106226] Updated weights for policy 0, policy_version 32823 (0.0005) [2023-12-27 19:27:57,530][106226] Updated weights for policy 0, policy_version 32833 (0.0005) [2023-12-27 19:27:58,046][106225] Updated weights for policy 1, policy_version 32759 (0.0005) [2023-12-27 19:27:58,057][106226] Updated weights for policy 0, policy_version 32843 (0.0005) [2023-12-27 19:27:58,095][106225] Updated weights for policy 1, policy_version 32769 (0.0005) [2023-12-27 19:27:58,108][106226] Updated weights for policy 0, policy_version 32853 (0.0006) [2023-12-27 19:27:58,144][106225] Updated weights for policy 1, policy_version 32779 (0.0005) [2023-12-27 19:27:58,179][106226] Updated weights for policy 0, policy_version 32863 (0.0008) [2023-12-27 19:27:58,919][106226] Updated weights for policy 0, policy_version 32873 (0.0008) [2023-12-27 19:27:58,920][106225] Updated weights for policy 1, policy_version 32789 (0.0007) [2023-12-27 19:27:58,976][106225] Updated weights for policy 1, policy_version 32799 (0.0010) [2023-12-27 19:27:58,981][106226] Updated weights for policy 0, policy_version 32883 (0.0006) [2023-12-27 19:27:59,035][106225] Updated weights for policy 1, policy_version 32809 (0.0010) [2023-12-27 19:27:59,041][106226] Updated weights for policy 0, policy_version 32893 (0.0008) [2023-12-27 19:27:59,114][106226] Updated weights for policy 0, policy_version 32903 (0.0009) [2023-12-27 19:27:59,800][106225] Updated weights for policy 1, policy_version 32819 (0.0011) [2023-12-27 19:27:59,863][106225] Updated weights for policy 1, policy_version 32829 (0.0010) [2023-12-27 19:27:59,880][106226] Updated weights for policy 0, policy_version 32913 (0.0010) [2023-12-27 19:27:59,938][106225] Updated weights for policy 1, policy_version 32839 (0.0007) [2023-12-27 19:27:59,950][106226] Updated weights for policy 0, policy_version 32923 (0.0009) [2023-12-27 19:28:00,011][106226] Updated weights for policy 0, policy_version 32933 (0.0007) [2023-12-27 19:28:00,629][106225] Updated weights for policy 1, policy_version 32849 (0.0008) [2023-12-27 19:28:00,658][106226] Updated weights for policy 0, policy_version 32943 (0.0006) [2023-12-27 19:28:00,687][106225] Updated weights for policy 1, policy_version 32859 (0.0006) [2023-12-27 19:28:00,711][106226] Updated weights for policy 0, policy_version 32953 (0.0006) [2023-12-27 19:28:00,743][106225] Updated weights for policy 1, policy_version 32869 (0.0007) [2023-12-27 19:28:00,754][106226] Updated weights for policy 0, policy_version 32963 (0.0007) [2023-12-27 19:28:00,795][106225] Updated weights for policy 1, policy_version 32879 (0.0007) [2023-12-27 19:28:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 16867328. Throughput: 0: 9986.0, 1: 9968.3. Samples: 16856148. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 19:28:01,175][105115] Avg episode reward: [(0, '-5.462'), (1, '-6.617')] [2023-12-27 19:28:01,447][106225] Updated weights for policy 1, policy_version 32889 (0.0009) [2023-12-27 19:28:01,454][106226] Updated weights for policy 0, policy_version 32973 (0.0008) [2023-12-27 19:28:01,502][106225] Updated weights for policy 1, policy_version 32899 (0.0007) [2023-12-27 19:28:01,522][106226] Updated weights for policy 0, policy_version 32983 (0.0008) [2023-12-27 19:28:01,555][106225] Updated weights for policy 1, policy_version 32909 (0.0006) [2023-12-27 19:28:01,589][106226] Updated weights for policy 0, policy_version 32993 (0.0008) [2023-12-27 19:28:02,230][106226] Updated weights for policy 0, policy_version 33003 (0.0008) [2023-12-27 19:28:02,299][106226] Updated weights for policy 0, policy_version 33013 (0.0008) [2023-12-27 19:28:02,355][106225] Updated weights for policy 1, policy_version 32919 (0.0009) [2023-12-27 19:28:02,356][106226] Updated weights for policy 0, policy_version 33023 (0.0008) [2023-12-27 19:28:02,420][106225] Updated weights for policy 1, policy_version 32929 (0.0009) [2023-12-27 19:28:02,480][106225] Updated weights for policy 1, policy_version 32939 (0.0009) [2023-12-27 19:28:02,984][106226] Updated weights for policy 0, policy_version 33033 (0.0008) [2023-12-27 19:28:03,034][106226] Updated weights for policy 0, policy_version 33043 (0.0005) [2023-12-27 19:28:03,087][106226] Updated weights for policy 0, policy_version 33053 (0.0006) [2023-12-27 19:28:03,141][106226] Updated weights for policy 0, policy_version 33063 (0.0009) [2023-12-27 19:28:03,262][106225] Updated weights for policy 1, policy_version 32949 (0.0007) [2023-12-27 19:28:03,317][106225] Updated weights for policy 1, policy_version 32959 (0.0005) [2023-12-27 19:28:03,376][106225] Updated weights for policy 1, policy_version 32969 (0.0005) [2023-12-27 19:28:03,770][106226] Updated weights for policy 0, policy_version 33073 (0.0008) [2023-12-27 19:28:03,822][106226] Updated weights for policy 0, policy_version 33083 (0.0007) [2023-12-27 19:28:03,893][106226] Updated weights for policy 0, policy_version 33093 (0.0007) [2023-12-27 19:28:04,008][106225] Updated weights for policy 1, policy_version 32979 (0.0006) [2023-12-27 19:28:04,072][106225] Updated weights for policy 1, policy_version 32989 (0.0008) [2023-12-27 19:28:04,135][106225] Updated weights for policy 1, policy_version 32999 (0.0006) [2023-12-27 19:28:04,543][106226] Updated weights for policy 0, policy_version 33103 (0.0005) [2023-12-27 19:28:04,611][106226] Updated weights for policy 0, policy_version 33113 (0.0006) [2023-12-27 19:28:04,677][106226] Updated weights for policy 0, policy_version 33123 (0.0005) [2023-12-27 19:28:04,856][106225] Updated weights for policy 1, policy_version 33009 (0.0006) [2023-12-27 19:28:04,911][106225] Updated weights for policy 1, policy_version 33019 (0.0005) [2023-12-27 19:28:04,967][106225] Updated weights for policy 1, policy_version 33029 (0.0005) [2023-12-27 19:28:05,032][106225] Updated weights for policy 1, policy_version 33039 (0.0007) [2023-12-27 19:28:05,301][106226] Updated weights for policy 0, policy_version 33133 (0.0007) [2023-12-27 19:28:05,359][106226] Updated weights for policy 0, policy_version 33143 (0.0006) [2023-12-27 19:28:05,429][106226] Updated weights for policy 0, policy_version 33153 (0.0011) [2023-12-27 19:28:05,646][106225] Updated weights for policy 1, policy_version 33049 (0.0007) [2023-12-27 19:28:05,706][106225] Updated weights for policy 1, policy_version 33059 (0.0007) [2023-12-27 19:28:05,765][106225] Updated weights for policy 1, policy_version 33069 (0.0006) [2023-12-27 19:28:06,123][106226] Updated weights for policy 0, policy_version 33163 (0.0011) [2023-12-27 19:28:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 16965632. Throughput: 0: 10160.2, 1: 9929.2. Samples: 16978796. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 19:28:06,175][105115] Avg episode reward: [(0, '-5.164'), (1, '-7.124')] [2023-12-27 19:28:06,187][106226] Updated weights for policy 0, policy_version 33173 (0.0011) [2023-12-27 19:28:06,248][106226] Updated weights for policy 0, policy_version 33183 (0.0010) [2023-12-27 19:28:06,396][106225] Updated weights for policy 1, policy_version 33079 (0.0005) [2023-12-27 19:28:06,457][106225] Updated weights for policy 1, policy_version 33089 (0.0005) [2023-12-27 19:28:06,520][106225] Updated weights for policy 1, policy_version 33099 (0.0006) [2023-12-27 19:28:06,992][106226] Updated weights for policy 0, policy_version 33193 (0.0008) [2023-12-27 19:28:07,059][106226] Updated weights for policy 0, policy_version 33203 (0.0008) [2023-12-27 19:28:07,119][106226] Updated weights for policy 0, policy_version 33213 (0.0009) [2023-12-27 19:28:07,153][106225] Updated weights for policy 1, policy_version 33109 (0.0006) [2023-12-27 19:28:07,170][106226] Updated weights for policy 0, policy_version 33223 (0.0008) [2023-12-27 19:28:07,212][106225] Updated weights for policy 1, policy_version 33119 (0.0008) [2023-12-27 19:28:07,264][106225] Updated weights for policy 1, policy_version 33129 (0.0008) [2023-12-27 19:28:07,893][106226] Updated weights for policy 0, policy_version 33233 (0.0007) [2023-12-27 19:28:07,948][106226] Updated weights for policy 0, policy_version 33243 (0.0008) [2023-12-27 19:28:07,995][106225] Updated weights for policy 1, policy_version 33139 (0.0008) [2023-12-27 19:28:08,001][106226] Updated weights for policy 0, policy_version 33253 (0.0007) [2023-12-27 19:28:08,053][106225] Updated weights for policy 1, policy_version 33149 (0.0008) [2023-12-27 19:28:08,112][106225] Updated weights for policy 1, policy_version 33159 (0.0008) [2023-12-27 19:28:08,682][106226] Updated weights for policy 0, policy_version 33263 (0.0005) [2023-12-27 19:28:08,742][106226] Updated weights for policy 0, policy_version 33273 (0.0011) [2023-12-27 19:28:08,799][106226] Updated weights for policy 0, policy_version 33283 (0.0010) [2023-12-27 19:28:08,845][106225] Updated weights for policy 1, policy_version 33169 (0.0008) [2023-12-27 19:28:08,914][106225] Updated weights for policy 1, policy_version 33179 (0.0008) [2023-12-27 19:28:08,968][106225] Updated weights for policy 1, policy_version 33189 (0.0006) [2023-12-27 19:28:09,027][106225] Updated weights for policy 1, policy_version 33199 (0.0007) [2023-12-27 19:28:09,482][106226] Updated weights for policy 0, policy_version 33293 (0.0011) [2023-12-27 19:28:09,543][106226] Updated weights for policy 0, policy_version 33303 (0.0010) [2023-12-27 19:28:09,607][106226] Updated weights for policy 0, policy_version 33313 (0.0011) [2023-12-27 19:28:09,777][106225] Updated weights for policy 1, policy_version 33209 (0.0008) [2023-12-27 19:28:09,843][106225] Updated weights for policy 1, policy_version 33219 (0.0008) [2023-12-27 19:28:09,906][106225] Updated weights for policy 1, policy_version 33229 (0.0008) [2023-12-27 19:28:10,276][106226] Updated weights for policy 0, policy_version 33323 (0.0009) [2023-12-27 19:28:10,324][106226] Updated weights for policy 0, policy_version 33333 (0.0005) [2023-12-27 19:28:10,390][106226] Updated weights for policy 0, policy_version 33343 (0.0009) [2023-12-27 19:28:10,643][106225] Updated weights for policy 1, policy_version 33239 (0.0006) [2023-12-27 19:28:10,703][106225] Updated weights for policy 1, policy_version 33249 (0.0005) [2023-12-27 19:28:10,762][106225] Updated weights for policy 1, policy_version 33259 (0.0005) [2023-12-27 19:28:11,006][106226] Updated weights for policy 0, policy_version 33353 (0.0006) [2023-12-27 19:28:11,077][106226] Updated weights for policy 0, policy_version 33363 (0.0010) [2023-12-27 19:28:11,149][106226] Updated weights for policy 0, policy_version 33373 (0.0009) [2023-12-27 19:28:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 17063936. Throughput: 0: 10144.8, 1: 9929.8. Samples: 17038392. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 19:28:11,175][105115] Avg episode reward: [(0, '-5.545'), (1, '-6.840')] [2023-12-27 19:28:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000033264_8519680.pth... [2023-12-27 19:28:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000032152_8232960.pth [2023-12-27 19:28:11,203][106226] Updated weights for policy 0, policy_version 33383 (0.0009) [2023-12-27 19:28:11,212][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000033384_8552448.pth... [2023-12-27 19:28:11,217][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000032200_8249344.pth [2023-12-27 19:28:11,536][106225] Updated weights for policy 1, policy_version 33269 (0.0008) [2023-12-27 19:28:11,596][106225] Updated weights for policy 1, policy_version 33279 (0.0007) [2023-12-27 19:28:11,661][106225] Updated weights for policy 1, policy_version 33289 (0.0008) [2023-12-27 19:28:11,957][106226] Updated weights for policy 0, policy_version 33393 (0.0010) [2023-12-27 19:28:12,008][106226] Updated weights for policy 0, policy_version 33403 (0.0010) [2023-12-27 19:28:12,060][106226] Updated weights for policy 0, policy_version 33413 (0.0010) [2023-12-27 19:28:12,440][106225] Updated weights for policy 1, policy_version 33299 (0.0008) [2023-12-27 19:28:12,501][106225] Updated weights for policy 1, policy_version 33309 (0.0008) [2023-12-27 19:28:12,564][106225] Updated weights for policy 1, policy_version 33319 (0.0008) [2023-12-27 19:28:12,793][106226] Updated weights for policy 0, policy_version 33423 (0.0011) [2023-12-27 19:28:12,852][106226] Updated weights for policy 0, policy_version 33433 (0.0010) [2023-12-27 19:28:12,915][106226] Updated weights for policy 0, policy_version 33443 (0.0010) [2023-12-27 19:28:13,201][106225] Updated weights for policy 1, policy_version 33329 (0.0008) [2023-12-27 19:28:13,253][106225] Updated weights for policy 1, policy_version 33339 (0.0007) [2023-12-27 19:28:13,310][106225] Updated weights for policy 1, policy_version 33349 (0.0008) [2023-12-27 19:28:13,356][106225] Updated weights for policy 1, policy_version 33359 (0.0007) [2023-12-27 19:28:13,624][106226] Updated weights for policy 0, policy_version 33453 (0.0008) [2023-12-27 19:28:13,678][106226] Updated weights for policy 0, policy_version 33463 (0.0006) [2023-12-27 19:28:13,733][106226] Updated weights for policy 0, policy_version 33473 (0.0006) [2023-12-27 19:28:14,131][106225] Updated weights for policy 1, policy_version 33369 (0.0009) [2023-12-27 19:28:14,196][106225] Updated weights for policy 1, policy_version 33379 (0.0008) [2023-12-27 19:28:14,257][106225] Updated weights for policy 1, policy_version 33389 (0.0008) [2023-12-27 19:28:14,396][106226] Updated weights for policy 0, policy_version 33483 (0.0006) [2023-12-27 19:28:14,460][106226] Updated weights for policy 0, policy_version 33493 (0.0008) [2023-12-27 19:28:14,523][106226] Updated weights for policy 0, policy_version 33503 (0.0009) [2023-12-27 19:28:14,986][106225] Updated weights for policy 1, policy_version 33399 (0.0007) [2023-12-27 19:28:15,054][106225] Updated weights for policy 1, policy_version 33409 (0.0005) [2023-12-27 19:28:15,111][106226] Updated weights for policy 0, policy_version 33513 (0.0008) [2023-12-27 19:28:15,123][106225] Updated weights for policy 1, policy_version 33419 (0.0006) [2023-12-27 19:28:15,180][106226] Updated weights for policy 0, policy_version 33523 (0.0008) [2023-12-27 19:28:15,247][106226] Updated weights for policy 0, policy_version 33533 (0.0008) [2023-12-27 19:28:15,307][106226] Updated weights for policy 0, policy_version 33543 (0.0008) [2023-12-27 19:28:15,742][106225] Updated weights for policy 1, policy_version 33429 (0.0008) [2023-12-27 19:28:15,793][106225] Updated weights for policy 1, policy_version 33439 (0.0008) [2023-12-27 19:28:15,842][106225] Updated weights for policy 1, policy_version 33449 (0.0008) [2023-12-27 19:28:16,061][106226] Updated weights for policy 0, policy_version 33553 (0.0006) [2023-12-27 19:28:16,122][106226] Updated weights for policy 0, policy_version 33563 (0.0005) [2023-12-27 19:28:16,169][106226] Updated weights for policy 0, policy_version 33573 (0.0005) [2023-12-27 19:28:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.5, 300 sec: 19938.5). Total num frames: 17162240. Throughput: 0: 10059.1, 1: 9749.5. Samples: 17155788. Policy #0 lag: (min: 31.0, avg: 32.5, max: 60.0) [2023-12-27 19:28:16,175][105115] Avg episode reward: [(0, '-5.507'), (1, '-7.136')] [2023-12-27 19:28:16,544][106225] Updated weights for policy 1, policy_version 33459 (0.0007) [2023-12-27 19:28:16,591][106225] Updated weights for policy 1, policy_version 33469 (0.0008) [2023-12-27 19:28:16,643][106225] Updated weights for policy 1, policy_version 33479 (0.0007) [2023-12-27 19:28:16,757][106226] Updated weights for policy 0, policy_version 33583 (0.0006) [2023-12-27 19:28:16,812][106226] Updated weights for policy 0, policy_version 33593 (0.0005) [2023-12-27 19:28:16,858][106226] Updated weights for policy 0, policy_version 33603 (0.0005) [2023-12-27 19:28:17,245][106225] Updated weights for policy 1, policy_version 33489 (0.0006) [2023-12-27 19:28:17,299][106225] Updated weights for policy 1, policy_version 33499 (0.0008) [2023-12-27 19:28:17,357][106225] Updated weights for policy 1, policy_version 33509 (0.0007) [2023-12-27 19:28:17,403][106225] Updated weights for policy 1, policy_version 33519 (0.0008) [2023-12-27 19:28:17,507][106226] Updated weights for policy 0, policy_version 33613 (0.0009) [2023-12-27 19:28:17,561][106226] Updated weights for policy 0, policy_version 33623 (0.0009) [2023-12-27 19:28:17,622][106226] Updated weights for policy 0, policy_version 33633 (0.0009) [2023-12-27 19:28:18,119][106225] Updated weights for policy 1, policy_version 33529 (0.0008) [2023-12-27 19:28:18,173][106225] Updated weights for policy 1, policy_version 33539 (0.0007) [2023-12-27 19:28:18,219][106226] Updated weights for policy 0, policy_version 33643 (0.0009) [2023-12-27 19:28:18,225][106225] Updated weights for policy 1, policy_version 33549 (0.0006) [2023-12-27 19:28:18,275][106226] Updated weights for policy 0, policy_version 33653 (0.0011) [2023-12-27 19:28:18,335][106226] Updated weights for policy 0, policy_version 33663 (0.0010) [2023-12-27 19:28:18,971][106226] Updated weights for policy 0, policy_version 33673 (0.0008) [2023-12-27 19:28:19,041][106226] Updated weights for policy 0, policy_version 33683 (0.0007) [2023-12-27 19:28:19,048][106225] Updated weights for policy 1, policy_version 33559 (0.0006) [2023-12-27 19:28:19,098][106226] Updated weights for policy 0, policy_version 33693 (0.0007) [2023-12-27 19:28:19,108][106225] Updated weights for policy 1, policy_version 33569 (0.0007) [2023-12-27 19:28:19,160][106226] Updated weights for policy 0, policy_version 33703 (0.0011) [2023-12-27 19:28:19,167][106225] Updated weights for policy 1, policy_version 33579 (0.0005) [2023-12-27 19:28:19,870][106226] Updated weights for policy 0, policy_version 33713 (0.0008) [2023-12-27 19:28:19,941][106226] Updated weights for policy 0, policy_version 33723 (0.0009) [2023-12-27 19:28:19,980][106225] Updated weights for policy 1, policy_version 33589 (0.0010) [2023-12-27 19:28:20,007][106226] Updated weights for policy 0, policy_version 33733 (0.0011) [2023-12-27 19:28:20,043][106225] Updated weights for policy 1, policy_version 33599 (0.0010) [2023-12-27 19:28:20,107][106225] Updated weights for policy 1, policy_version 33609 (0.0011) [2023-12-27 19:28:20,688][106226] Updated weights for policy 0, policy_version 33743 (0.0009) [2023-12-27 19:28:20,760][106226] Updated weights for policy 0, policy_version 33753 (0.0011) [2023-12-27 19:28:20,788][106225] Updated weights for policy 1, policy_version 33619 (0.0010) [2023-12-27 19:28:20,829][106226] Updated weights for policy 0, policy_version 33763 (0.0008) [2023-12-27 19:28:20,847][106225] Updated weights for policy 1, policy_version 33629 (0.0010) [2023-12-27 19:28:20,912][106225] Updated weights for policy 1, policy_version 33639 (0.0011) [2023-12-27 19:28:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 17268736. Throughput: 0: 10064.7, 1: 9686.7. Samples: 17275944. Policy #0 lag: (min: 31.0, avg: 32.5, max: 60.0) [2023-12-27 19:28:21,175][105115] Avg episode reward: [(0, '-5.572'), (1, '-6.693')] [2023-12-27 19:28:21,611][106226] Updated weights for policy 0, policy_version 33773 (0.0007) [2023-12-27 19:28:21,680][106226] Updated weights for policy 0, policy_version 33783 (0.0009) [2023-12-27 19:28:21,728][106225] Updated weights for policy 1, policy_version 33649 (0.0010) [2023-12-27 19:28:21,754][106226] Updated weights for policy 0, policy_version 33793 (0.0009) [2023-12-27 19:28:21,799][106225] Updated weights for policy 1, policy_version 33659 (0.0008) [2023-12-27 19:28:21,863][106225] Updated weights for policy 1, policy_version 33669 (0.0008) [2023-12-27 19:28:21,932][106225] Updated weights for policy 1, policy_version 33679 (0.0007) [2023-12-27 19:28:22,414][106226] Updated weights for policy 0, policy_version 33803 (0.0008) [2023-12-27 19:28:22,471][106226] Updated weights for policy 0, policy_version 33813 (0.0009) [2023-12-27 19:28:22,531][106226] Updated weights for policy 0, policy_version 33823 (0.0007) [2023-12-27 19:28:22,730][106225] Updated weights for policy 1, policy_version 33689 (0.0009) [2023-12-27 19:28:22,793][106225] Updated weights for policy 1, policy_version 33699 (0.0008) [2023-12-27 19:28:22,854][106225] Updated weights for policy 1, policy_version 33709 (0.0009) [2023-12-27 19:28:23,146][106226] Updated weights for policy 0, policy_version 33833 (0.0006) [2023-12-27 19:28:23,207][106226] Updated weights for policy 0, policy_version 33843 (0.0007) [2023-12-27 19:28:23,274][106226] Updated weights for policy 0, policy_version 33853 (0.0005) [2023-12-27 19:28:23,324][106226] Updated weights for policy 0, policy_version 33863 (0.0007) [2023-12-27 19:28:23,593][106225] Updated weights for policy 1, policy_version 33719 (0.0009) [2023-12-27 19:28:23,647][106225] Updated weights for policy 1, policy_version 33729 (0.0009) [2023-12-27 19:28:23,704][106225] Updated weights for policy 1, policy_version 33740 (0.0008) [2023-12-27 19:28:23,905][106226] Updated weights for policy 0, policy_version 33873 (0.0008) [2023-12-27 19:28:23,963][106226] Updated weights for policy 0, policy_version 33883 (0.0008) [2023-12-27 19:28:24,012][106226] Updated weights for policy 0, policy_version 33893 (0.0008) [2023-12-27 19:28:24,433][106225] Updated weights for policy 1, policy_version 33750 (0.0008) [2023-12-27 19:28:24,497][106225] Updated weights for policy 1, policy_version 33760 (0.0008) [2023-12-27 19:28:24,550][106225] Updated weights for policy 1, policy_version 33770 (0.0008) [2023-12-27 19:28:24,714][106226] Updated weights for policy 0, policy_version 33903 (0.0010) [2023-12-27 19:28:24,777][106226] Updated weights for policy 0, policy_version 33913 (0.0008) [2023-12-27 19:28:24,839][106226] Updated weights for policy 0, policy_version 33923 (0.0008) [2023-12-27 19:28:25,186][106225] Updated weights for policy 1, policy_version 33780 (0.0007) [2023-12-27 19:28:25,237][106225] Updated weights for policy 1, policy_version 33790 (0.0005) [2023-12-27 19:28:25,286][106225] Updated weights for policy 1, policy_version 33800 (0.0005) [2023-12-27 19:28:25,402][106226] Updated weights for policy 0, policy_version 33933 (0.0005) [2023-12-27 19:28:25,456][106226] Updated weights for policy 0, policy_version 33943 (0.0005) [2023-12-27 19:28:25,503][106226] Updated weights for policy 0, policy_version 33953 (0.0006) [2023-12-27 19:28:25,886][106225] Updated weights for policy 1, policy_version 33810 (0.0006) [2023-12-27 19:28:25,955][106225] Updated weights for policy 1, policy_version 33820 (0.0009) [2023-12-27 19:28:26,017][106225] Updated weights for policy 1, policy_version 33830 (0.0009) [2023-12-27 19:28:26,081][106225] Updated weights for policy 1, policy_version 33840 (0.0008) [2023-12-27 19:28:26,086][106226] Updated weights for policy 0, policy_version 33963 (0.0005) [2023-12-27 19:28:26,144][106226] Updated weights for policy 0, policy_version 33973 (0.0005) [2023-12-27 19:28:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 17367040. Throughput: 0: 10104.6, 1: 9601.1. Samples: 17333440. Policy #0 lag: (min: 31.0, avg: 32.5, max: 60.0) [2023-12-27 19:28:26,175][105115] Avg episode reward: [(0, '-5.685'), (1, '-7.043')] [2023-12-27 19:28:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000033840_8667136.pth... [2023-12-27 19:28:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000032696_8372224.pth [2023-12-27 19:28:26,201][106226] Updated weights for policy 0, policy_version 33983 (0.0005) [2023-12-27 19:28:26,253][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000033992_8708096.pth... [2023-12-27 19:28:26,257][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000032776_8396800.pth [2023-12-27 19:28:26,798][106225] Updated weights for policy 1, policy_version 33850 (0.0005) [2023-12-27 19:28:26,824][106226] Updated weights for policy 0, policy_version 33993 (0.0006) [2023-12-27 19:28:26,853][106225] Updated weights for policy 1, policy_version 33860 (0.0005) [2023-12-27 19:28:26,885][106226] Updated weights for policy 0, policy_version 34003 (0.0006) [2023-12-27 19:28:26,906][106225] Updated weights for policy 1, policy_version 33870 (0.0005) [2023-12-27 19:28:26,945][106226] Updated weights for policy 0, policy_version 34013 (0.0005) [2023-12-27 19:28:27,002][106226] Updated weights for policy 0, policy_version 34023 (0.0005) [2023-12-27 19:28:27,430][106225] Updated weights for policy 1, policy_version 33880 (0.0008) [2023-12-27 19:28:27,501][106225] Updated weights for policy 1, policy_version 33890 (0.0009) [2023-12-27 19:28:27,560][106225] Updated weights for policy 1, policy_version 33900 (0.0009) [2023-12-27 19:28:27,590][106226] Updated weights for policy 0, policy_version 34033 (0.0006) [2023-12-27 19:28:27,639][106226] Updated weights for policy 0, policy_version 34043 (0.0005) [2023-12-27 19:28:27,697][106226] Updated weights for policy 0, policy_version 34053 (0.0005) [2023-12-27 19:28:28,271][106225] Updated weights for policy 1, policy_version 33910 (0.0006) [2023-12-27 19:28:28,334][106225] Updated weights for policy 1, policy_version 33920 (0.0007) [2023-12-27 19:28:28,359][106226] Updated weights for policy 0, policy_version 34063 (0.0008) [2023-12-27 19:28:28,389][106225] Updated weights for policy 1, policy_version 33930 (0.0009) [2023-12-27 19:28:28,421][106226] Updated weights for policy 0, policy_version 34073 (0.0008) [2023-12-27 19:28:28,483][106226] Updated weights for policy 0, policy_version 34083 (0.0008) [2023-12-27 19:28:29,111][106225] Updated weights for policy 1, policy_version 33940 (0.0006) [2023-12-27 19:28:29,134][106226] Updated weights for policy 0, policy_version 34093 (0.0007) [2023-12-27 19:28:29,178][106225] Updated weights for policy 1, policy_version 33950 (0.0008) [2023-12-27 19:28:29,197][106226] Updated weights for policy 0, policy_version 34103 (0.0007) [2023-12-27 19:28:29,240][106225] Updated weights for policy 1, policy_version 33960 (0.0007) [2023-12-27 19:28:29,263][106226] Updated weights for policy 0, policy_version 34113 (0.0008) [2023-12-27 19:28:29,967][106225] Updated weights for policy 1, policy_version 33970 (0.0008) [2023-12-27 19:28:29,997][106226] Updated weights for policy 0, policy_version 34123 (0.0009) [2023-12-27 19:28:30,027][106225] Updated weights for policy 1, policy_version 33980 (0.0007) [2023-12-27 19:28:30,059][106226] Updated weights for policy 0, policy_version 34133 (0.0007) [2023-12-27 19:28:30,087][106225] Updated weights for policy 1, policy_version 33990 (0.0008) [2023-12-27 19:28:30,124][106226] Updated weights for policy 0, policy_version 34143 (0.0008) [2023-12-27 19:28:30,146][106225] Updated weights for policy 1, policy_version 34000 (0.0006) [2023-12-27 19:28:30,764][106225] Updated weights for policy 1, policy_version 34010 (0.0006) [2023-12-27 19:28:30,816][106225] Updated weights for policy 1, policy_version 34020 (0.0005) [2023-12-27 19:28:30,874][106225] Updated weights for policy 1, policy_version 34030 (0.0005) [2023-12-27 19:28:30,892][106226] Updated weights for policy 0, policy_version 34153 (0.0006) [2023-12-27 19:28:30,945][106226] Updated weights for policy 0, policy_version 34163 (0.0005) [2023-12-27 19:28:31,004][106226] Updated weights for policy 0, policy_version 34173 (0.0005) [2023-12-27 19:28:31,070][106226] Updated weights for policy 0, policy_version 34183 (0.0007) [2023-12-27 19:28:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 17473536. Throughput: 0: 10249.4, 1: 9691.5. Samples: 17460132. Policy #0 lag: (min: 31.0, avg: 32.5, max: 60.0) [2023-12-27 19:28:31,175][105115] Avg episode reward: [(0, '-5.414'), (1, '-6.867')] [2023-12-27 19:28:31,571][106225] Updated weights for policy 1, policy_version 34040 (0.0008) [2023-12-27 19:28:31,630][106225] Updated weights for policy 1, policy_version 34050 (0.0008) [2023-12-27 19:28:31,698][106225] Updated weights for policy 1, policy_version 34060 (0.0007) [2023-12-27 19:28:31,762][106226] Updated weights for policy 0, policy_version 34193 (0.0009) [2023-12-27 19:28:31,821][106226] Updated weights for policy 0, policy_version 34203 (0.0009) [2023-12-27 19:28:31,880][106226] Updated weights for policy 0, policy_version 34213 (0.0009) [2023-12-27 19:28:32,400][106225] Updated weights for policy 1, policy_version 34070 (0.0008) [2023-12-27 19:28:32,460][106225] Updated weights for policy 1, policy_version 34080 (0.0007) [2023-12-27 19:28:32,516][106225] Updated weights for policy 1, policy_version 34090 (0.0008) [2023-12-27 19:28:32,597][106226] Updated weights for policy 0, policy_version 34223 (0.0008) [2023-12-27 19:28:32,659][106226] Updated weights for policy 0, policy_version 34233 (0.0008) [2023-12-27 19:28:32,720][106226] Updated weights for policy 0, policy_version 34243 (0.0008) [2023-12-27 19:28:33,225][106225] Updated weights for policy 1, policy_version 34100 (0.0008) [2023-12-27 19:28:33,276][106225] Updated weights for policy 1, policy_version 34110 (0.0008) [2023-12-27 19:28:33,337][106225] Updated weights for policy 1, policy_version 34120 (0.0008) [2023-12-27 19:28:33,438][106226] Updated weights for policy 0, policy_version 34253 (0.0008) [2023-12-27 19:28:33,492][106226] Updated weights for policy 0, policy_version 34263 (0.0009) [2023-12-27 19:28:33,545][106226] Updated weights for policy 0, policy_version 34273 (0.0009) [2023-12-27 19:28:34,015][106225] Updated weights for policy 1, policy_version 34130 (0.0008) [2023-12-27 19:28:34,072][106225] Updated weights for policy 1, policy_version 34140 (0.0005) [2023-12-27 19:28:34,128][106225] Updated weights for policy 1, policy_version 34150 (0.0006) [2023-12-27 19:28:34,195][106225] Updated weights for policy 1, policy_version 34160 (0.0009) [2023-12-27 19:28:34,357][106226] Updated weights for policy 0, policy_version 34283 (0.0008) [2023-12-27 19:28:34,416][106226] Updated weights for policy 0, policy_version 34293 (0.0008) [2023-12-27 19:28:34,480][106226] Updated weights for policy 0, policy_version 34303 (0.0009) [2023-12-27 19:28:34,858][106225] Updated weights for policy 1, policy_version 34170 (0.0007) [2023-12-27 19:28:34,905][106225] Updated weights for policy 1, policy_version 34180 (0.0008) [2023-12-27 19:28:34,959][106225] Updated weights for policy 1, policy_version 34190 (0.0008) [2023-12-27 19:28:35,150][106226] Updated weights for policy 0, policy_version 34313 (0.0008) [2023-12-27 19:28:35,216][106226] Updated weights for policy 0, policy_version 34323 (0.0005) [2023-12-27 19:28:35,283][106226] Updated weights for policy 0, policy_version 34333 (0.0005) [2023-12-27 19:28:35,350][106226] Updated weights for policy 0, policy_version 34343 (0.0005) [2023-12-27 19:28:35,743][106225] Updated weights for policy 1, policy_version 34200 (0.0008) [2023-12-27 19:28:35,798][106225] Updated weights for policy 1, policy_version 34210 (0.0010) [2023-12-27 19:28:35,851][106225] Updated weights for policy 1, policy_version 34220 (0.0009) [2023-12-27 19:28:35,941][106226] Updated weights for policy 0, policy_version 34353 (0.0006) [2023-12-27 19:28:35,997][106226] Updated weights for policy 0, policy_version 34363 (0.0005) [2023-12-27 19:28:36,059][106226] Updated weights for policy 0, policy_version 34373 (0.0006) [2023-12-27 19:28:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 17571840. Throughput: 0: 10238.5, 1: 9806.8. Samples: 17578504. Policy #0 lag: (min: 23.0, avg: 26.4, max: 55.0) [2023-12-27 19:28:36,175][105115] Avg episode reward: [(0, '-5.058'), (1, '-6.593')] [2023-12-27 19:28:36,597][106225] Updated weights for policy 1, policy_version 34230 (0.0009) [2023-12-27 19:28:36,665][106225] Updated weights for policy 1, policy_version 34240 (0.0008) [2023-12-27 19:28:36,729][106225] Updated weights for policy 1, policy_version 34250 (0.0007) [2023-12-27 19:28:36,754][106226] Updated weights for policy 0, policy_version 34383 (0.0009) [2023-12-27 19:28:36,807][106226] Updated weights for policy 0, policy_version 34393 (0.0009) [2023-12-27 19:28:36,857][106226] Updated weights for policy 0, policy_version 34403 (0.0010) [2023-12-27 19:28:37,394][106225] Updated weights for policy 1, policy_version 34260 (0.0007) [2023-12-27 19:28:37,454][106225] Updated weights for policy 1, policy_version 34270 (0.0009) [2023-12-27 19:28:37,518][106225] Updated weights for policy 1, policy_version 34280 (0.0009) [2023-12-27 19:28:37,543][106226] Updated weights for policy 0, policy_version 34413 (0.0010) [2023-12-27 19:28:37,605][106226] Updated weights for policy 0, policy_version 34423 (0.0008) [2023-12-27 19:28:37,660][106226] Updated weights for policy 0, policy_version 34433 (0.0008) [2023-12-27 19:28:38,228][106225] Updated weights for policy 1, policy_version 34290 (0.0008) [2023-12-27 19:28:38,288][106225] Updated weights for policy 1, policy_version 34300 (0.0007) [2023-12-27 19:28:38,361][106225] Updated weights for policy 1, policy_version 34310 (0.0009) [2023-12-27 19:28:38,424][106225] Updated weights for policy 1, policy_version 34320 (0.0006) [2023-12-27 19:28:38,432][106226] Updated weights for policy 0, policy_version 34443 (0.0009) [2023-12-27 19:28:38,500][106226] Updated weights for policy 0, policy_version 34453 (0.0009) [2023-12-27 19:28:38,565][106226] Updated weights for policy 0, policy_version 34463 (0.0009) [2023-12-27 19:28:39,053][106225] Updated weights for policy 1, policy_version 34330 (0.0005) [2023-12-27 19:28:39,105][106225] Updated weights for policy 1, policy_version 34341 (0.0009) [2023-12-27 19:28:39,154][106225] Updated weights for policy 1, policy_version 34351 (0.0006) [2023-12-27 19:28:39,329][106226] Updated weights for policy 0, policy_version 34473 (0.0009) [2023-12-27 19:28:39,410][106226] Updated weights for policy 0, policy_version 34483 (0.0008) [2023-12-27 19:28:39,471][106226] Updated weights for policy 0, policy_version 34493 (0.0008) [2023-12-27 19:28:39,534][106226] Updated weights for policy 0, policy_version 34503 (0.0008) [2023-12-27 19:28:39,881][106225] Updated weights for policy 1, policy_version 34361 (0.0008) [2023-12-27 19:28:39,946][106225] Updated weights for policy 1, policy_version 34371 (0.0008) [2023-12-27 19:28:40,006][106225] Updated weights for policy 1, policy_version 34381 (0.0007) [2023-12-27 19:28:40,300][106226] Updated weights for policy 0, policy_version 34513 (0.0008) [2023-12-27 19:28:40,368][106226] Updated weights for policy 0, policy_version 34523 (0.0009) [2023-12-27 19:28:40,436][106226] Updated weights for policy 0, policy_version 34533 (0.0009) [2023-12-27 19:28:40,739][106225] Updated weights for policy 1, policy_version 34391 (0.0008) [2023-12-27 19:28:40,795][106225] Updated weights for policy 1, policy_version 34401 (0.0008) [2023-12-27 19:28:40,851][106225] Updated weights for policy 1, policy_version 34411 (0.0008) [2023-12-27 19:28:41,153][106226] Updated weights for policy 0, policy_version 34543 (0.0009) [2023-12-27 19:28:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 17661952. Throughput: 0: 10223.5, 1: 9827.4. Samples: 17636448. Policy #0 lag: (min: 23.0, avg: 26.4, max: 55.0) [2023-12-27 19:28:41,175][105115] Avg episode reward: [(0, '-5.323'), (1, '-6.751')] [2023-12-27 19:28:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000034416_8814592.pth... [2023-12-27 19:28:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000033264_8519680.pth [2023-12-27 19:28:41,217][106226] Updated weights for policy 0, policy_version 34553 (0.0008) [2023-12-27 19:28:41,288][106226] Updated weights for policy 0, policy_version 34563 (0.0007) [2023-12-27 19:28:41,321][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000034568_8855552.pth... [2023-12-27 19:28:41,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000033384_8552448.pth [2023-12-27 19:28:41,634][106225] Updated weights for policy 1, policy_version 34421 (0.0009) [2023-12-27 19:28:41,703][106225] Updated weights for policy 1, policy_version 34431 (0.0009) [2023-12-27 19:28:41,770][106225] Updated weights for policy 1, policy_version 34441 (0.0009) [2023-12-27 19:28:42,033][106226] Updated weights for policy 0, policy_version 34573 (0.0008) [2023-12-27 19:28:42,095][106226] Updated weights for policy 0, policy_version 34583 (0.0009) [2023-12-27 19:28:42,158][106226] Updated weights for policy 0, policy_version 34593 (0.0009) [2023-12-27 19:28:42,507][106225] Updated weights for policy 1, policy_version 34451 (0.0008) [2023-12-27 19:28:42,575][106225] Updated weights for policy 1, policy_version 34461 (0.0005) [2023-12-27 19:28:42,629][106225] Updated weights for policy 1, policy_version 34471 (0.0010) [2023-12-27 19:28:42,935][106226] Updated weights for policy 0, policy_version 34603 (0.0007) [2023-12-27 19:28:43,003][106226] Updated weights for policy 0, policy_version 34613 (0.0005) [2023-12-27 19:28:43,068][106226] Updated weights for policy 0, policy_version 34623 (0.0005) [2023-12-27 19:28:43,332][106225] Updated weights for policy 1, policy_version 34481 (0.0010) [2023-12-27 19:28:43,390][106225] Updated weights for policy 1, policy_version 34491 (0.0006) [2023-12-27 19:28:43,450][106225] Updated weights for policy 1, policy_version 34501 (0.0006) [2023-12-27 19:28:43,514][106225] Updated weights for policy 1, policy_version 34511 (0.0006) [2023-12-27 19:28:43,606][106226] Updated weights for policy 0, policy_version 34633 (0.0006) [2023-12-27 19:28:43,665][106226] Updated weights for policy 0, policy_version 34643 (0.0008) [2023-12-27 19:28:43,725][106226] Updated weights for policy 0, policy_version 34653 (0.0008) [2023-12-27 19:28:43,781][106226] Updated weights for policy 0, policy_version 34663 (0.0008) [2023-12-27 19:28:44,158][106225] Updated weights for policy 1, policy_version 34521 (0.0010) [2023-12-27 19:28:44,220][106225] Updated weights for policy 1, policy_version 34531 (0.0010) [2023-12-27 19:28:44,284][106225] Updated weights for policy 1, policy_version 34541 (0.0008) [2023-12-27 19:28:44,500][106226] Updated weights for policy 0, policy_version 34673 (0.0008) [2023-12-27 19:28:44,552][106226] Updated weights for policy 0, policy_version 34683 (0.0009) [2023-12-27 19:28:44,619][106226] Updated weights for policy 0, policy_version 34693 (0.0009) [2023-12-27 19:28:45,036][106225] Updated weights for policy 1, policy_version 34551 (0.0008) [2023-12-27 19:28:45,098][106225] Updated weights for policy 1, policy_version 34561 (0.0008) [2023-12-27 19:28:45,157][106225] Updated weights for policy 1, policy_version 34571 (0.0008) [2023-12-27 19:28:45,267][106226] Updated weights for policy 0, policy_version 34703 (0.0007) [2023-12-27 19:28:45,326][106226] Updated weights for policy 0, policy_version 34713 (0.0005) [2023-12-27 19:28:45,382][106226] Updated weights for policy 0, policy_version 34723 (0.0005) [2023-12-27 19:28:45,863][106225] Updated weights for policy 1, policy_version 34581 (0.0008) [2023-12-27 19:28:45,921][106225] Updated weights for policy 1, policy_version 34591 (0.0009) [2023-12-27 19:28:45,983][106225] Updated weights for policy 1, policy_version 34601 (0.0006) [2023-12-27 19:28:46,011][106226] Updated weights for policy 0, policy_version 34733 (0.0005) [2023-12-27 19:28:46,070][106226] Updated weights for policy 0, policy_version 34743 (0.0005) [2023-12-27 19:28:46,130][106226] Updated weights for policy 0, policy_version 34753 (0.0009) [2023-12-27 19:28:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 17768448. Throughput: 0: 10108.5, 1: 9794.2. Samples: 17751772. Policy #0 lag: (min: 23.0, avg: 26.4, max: 55.0) [2023-12-27 19:28:46,175][105115] Avg episode reward: [(0, '-5.287'), (1, '-6.816')] [2023-12-27 19:28:46,647][106226] Updated weights for policy 0, policy_version 34763 (0.0009) [2023-12-27 19:28:46,686][106225] Updated weights for policy 1, policy_version 34611 (0.0005) [2023-12-27 19:28:46,696][106226] Updated weights for policy 0, policy_version 34773 (0.0005) [2023-12-27 19:28:46,732][106225] Updated weights for policy 1, policy_version 34621 (0.0005) [2023-12-27 19:28:46,753][106226] Updated weights for policy 0, policy_version 34783 (0.0005) [2023-12-27 19:28:46,788][106225] Updated weights for policy 1, policy_version 34631 (0.0005) [2023-12-27 19:28:47,399][106226] Updated weights for policy 0, policy_version 34793 (0.0008) [2023-12-27 19:28:47,463][106226] Updated weights for policy 0, policy_version 34803 (0.0008) [2023-12-27 19:28:47,469][106225] Updated weights for policy 1, policy_version 34641 (0.0007) [2023-12-27 19:28:47,522][106226] Updated weights for policy 0, policy_version 34813 (0.0006) [2023-12-27 19:28:47,523][106225] Updated weights for policy 1, policy_version 34651 (0.0008) [2023-12-27 19:28:47,584][106226] Updated weights for policy 0, policy_version 34823 (0.0009) [2023-12-27 19:28:47,584][106225] Updated weights for policy 1, policy_version 34661 (0.0008) [2023-12-27 19:28:47,644][106225] Updated weights for policy 1, policy_version 34671 (0.0009) [2023-12-27 19:28:48,176][106226] Updated weights for policy 0, policy_version 34833 (0.0005) [2023-12-27 19:28:48,229][106226] Updated weights for policy 0, policy_version 34843 (0.0006) [2023-12-27 19:28:48,282][106226] Updated weights for policy 0, policy_version 34853 (0.0010) [2023-12-27 19:28:48,388][106225] Updated weights for policy 1, policy_version 34681 (0.0008) [2023-12-27 19:28:48,443][106225] Updated weights for policy 1, policy_version 34691 (0.0008) [2023-12-27 19:28:48,506][106225] Updated weights for policy 1, policy_version 34701 (0.0007) [2023-12-27 19:28:49,001][106226] Updated weights for policy 0, policy_version 34863 (0.0011) [2023-12-27 19:28:49,064][106226] Updated weights for policy 0, policy_version 34873 (0.0010) [2023-12-27 19:28:49,120][106226] Updated weights for policy 0, policy_version 34883 (0.0010) [2023-12-27 19:28:49,203][106225] Updated weights for policy 1, policy_version 34711 (0.0009) [2023-12-27 19:28:49,276][106225] Updated weights for policy 1, policy_version 34721 (0.0010) [2023-12-27 19:28:49,331][106225] Updated weights for policy 1, policy_version 34731 (0.0010) [2023-12-27 19:28:49,873][106226] Updated weights for policy 0, policy_version 34893 (0.0011) [2023-12-27 19:28:49,930][106226] Updated weights for policy 0, policy_version 34903 (0.0010) [2023-12-27 19:28:49,998][106226] Updated weights for policy 0, policy_version 34913 (0.0007) [2023-12-27 19:28:50,056][106225] Updated weights for policy 1, policy_version 34741 (0.0008) [2023-12-27 19:28:50,116][106225] Updated weights for policy 1, policy_version 34751 (0.0008) [2023-12-27 19:28:50,180][106225] Updated weights for policy 1, policy_version 34761 (0.0009) [2023-12-27 19:28:50,712][106226] Updated weights for policy 0, policy_version 34923 (0.0008) [2023-12-27 19:28:50,777][106226] Updated weights for policy 0, policy_version 34933 (0.0008) [2023-12-27 19:28:50,842][106226] Updated weights for policy 0, policy_version 34943 (0.0008) [2023-12-27 19:28:50,949][106225] Updated weights for policy 1, policy_version 34771 (0.0009) [2023-12-27 19:28:51,013][106225] Updated weights for policy 1, policy_version 34781 (0.0009) [2023-12-27 19:28:51,081][106225] Updated weights for policy 1, policy_version 34791 (0.0010) [2023-12-27 19:28:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 17866752. Throughput: 0: 10090.5, 1: 9758.6. Samples: 17872012. Policy #0 lag: (min: 23.0, avg: 26.4, max: 55.0) [2023-12-27 19:28:51,176][105115] Avg episode reward: [(0, '-5.434'), (1, '-6.500')] [2023-12-27 19:28:51,623][106226] Updated weights for policy 0, policy_version 34953 (0.0008) [2023-12-27 19:28:51,695][106226] Updated weights for policy 0, policy_version 34963 (0.0008) [2023-12-27 19:28:51,764][106226] Updated weights for policy 0, policy_version 34973 (0.0009) [2023-12-27 19:28:51,822][106226] Updated weights for policy 0, policy_version 34983 (0.0006) [2023-12-27 19:28:51,837][106225] Updated weights for policy 1, policy_version 34801 (0.0010) [2023-12-27 19:28:51,907][106225] Updated weights for policy 1, policy_version 34811 (0.0008) [2023-12-27 19:28:51,976][106225] Updated weights for policy 1, policy_version 34821 (0.0007) [2023-12-27 19:28:52,044][106225] Updated weights for policy 1, policy_version 34831 (0.0009) [2023-12-27 19:28:52,516][106226] Updated weights for policy 0, policy_version 34993 (0.0008) [2023-12-27 19:28:52,583][106226] Updated weights for policy 0, policy_version 35003 (0.0008) [2023-12-27 19:28:52,653][106226] Updated weights for policy 0, policy_version 35013 (0.0010) [2023-12-27 19:28:52,727][106225] Updated weights for policy 1, policy_version 34841 (0.0009) [2023-12-27 19:28:52,789][106225] Updated weights for policy 1, policy_version 34851 (0.0007) [2023-12-27 19:28:52,858][106225] Updated weights for policy 1, policy_version 34861 (0.0006) [2023-12-27 19:28:53,320][106226] Updated weights for policy 0, policy_version 35023 (0.0008) [2023-12-27 19:28:53,370][106226] Updated weights for policy 0, policy_version 35033 (0.0009) [2023-12-27 19:28:53,436][106226] Updated weights for policy 0, policy_version 35043 (0.0009) [2023-12-27 19:28:53,477][106225] Updated weights for policy 1, policy_version 34871 (0.0006) [2023-12-27 19:28:53,536][106225] Updated weights for policy 1, policy_version 34881 (0.0008) [2023-12-27 19:28:53,600][106225] Updated weights for policy 1, policy_version 34892 (0.0010) [2023-12-27 19:28:54,115][106226] Updated weights for policy 0, policy_version 35053 (0.0007) [2023-12-27 19:28:54,169][106226] Updated weights for policy 0, policy_version 35063 (0.0005) [2023-12-27 19:28:54,230][106226] Updated weights for policy 0, policy_version 35073 (0.0007) [2023-12-27 19:28:54,344][106225] Updated weights for policy 1, policy_version 34902 (0.0009) [2023-12-27 19:28:54,400][106225] Updated weights for policy 1, policy_version 34912 (0.0009) [2023-12-27 19:28:54,446][106225] Updated weights for policy 1, policy_version 34922 (0.0009) [2023-12-27 19:28:54,903][106226] Updated weights for policy 0, policy_version 35083 (0.0008) [2023-12-27 19:28:54,959][106226] Updated weights for policy 0, policy_version 35093 (0.0009) [2023-12-27 19:28:55,024][106226] Updated weights for policy 0, policy_version 35103 (0.0009) [2023-12-27 19:28:55,187][106225] Updated weights for policy 1, policy_version 34932 (0.0008) [2023-12-27 19:28:55,242][106225] Updated weights for policy 1, policy_version 34942 (0.0008) [2023-12-27 19:28:55,301][106225] Updated weights for policy 1, policy_version 34952 (0.0008) [2023-12-27 19:28:55,742][106226] Updated weights for policy 0, policy_version 35113 (0.0007) [2023-12-27 19:28:55,802][106226] Updated weights for policy 0, policy_version 35123 (0.0009) [2023-12-27 19:28:55,860][106226] Updated weights for policy 0, policy_version 35133 (0.0008) [2023-12-27 19:28:55,919][106226] Updated weights for policy 0, policy_version 35143 (0.0009) [2023-12-27 19:28:55,925][106225] Updated weights for policy 1, policy_version 34962 (0.0006) [2023-12-27 19:28:55,975][106225] Updated weights for policy 1, policy_version 34972 (0.0006) [2023-12-27 19:28:56,031][106225] Updated weights for policy 1, policy_version 34982 (0.0008) [2023-12-27 19:28:56,093][106225] Updated weights for policy 1, policy_version 34992 (0.0008) [2023-12-27 19:28:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 17965056. Throughput: 0: 10091.6, 1: 9732.8. Samples: 17930488. Policy #0 lag: (min: 23.0, avg: 26.4, max: 55.0) [2023-12-27 19:28:56,175][105115] Avg episode reward: [(0, '-5.129'), (1, '-6.475')] [2023-12-27 19:28:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000034992_8962048.pth... [2023-12-27 19:28:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000035144_9003008.pth... [2023-12-27 19:28:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000033840_8667136.pth [2023-12-27 19:28:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000033992_8708096.pth [2023-12-27 19:28:56,557][106226] Updated weights for policy 0, policy_version 35153 (0.0007) [2023-12-27 19:28:56,610][106226] Updated weights for policy 0, policy_version 35163 (0.0009) [2023-12-27 19:28:56,664][106226] Updated weights for policy 0, policy_version 35173 (0.0007) [2023-12-27 19:28:56,869][106225] Updated weights for policy 1, policy_version 35002 (0.0009) [2023-12-27 19:28:56,924][106225] Updated weights for policy 1, policy_version 35012 (0.0008) [2023-12-27 19:28:56,984][106225] Updated weights for policy 1, policy_version 35022 (0.0009) [2023-12-27 19:28:57,274][106226] Updated weights for policy 0, policy_version 35183 (0.0006) [2023-12-27 19:28:57,331][106226] Updated weights for policy 0, policy_version 35193 (0.0008) [2023-12-27 19:28:57,390][106226] Updated weights for policy 0, policy_version 35203 (0.0009) [2023-12-27 19:28:57,697][106225] Updated weights for policy 1, policy_version 35032 (0.0010) [2023-12-27 19:28:57,753][106225] Updated weights for policy 1, policy_version 35042 (0.0009) [2023-12-27 19:28:57,804][106225] Updated weights for policy 1, policy_version 35052 (0.0006) [2023-12-27 19:28:57,946][106226] Updated weights for policy 0, policy_version 35213 (0.0007) [2023-12-27 19:28:58,002][106226] Updated weights for policy 0, policy_version 35223 (0.0009) [2023-12-27 19:28:58,052][106226] Updated weights for policy 0, policy_version 35233 (0.0009) [2023-12-27 19:28:58,468][106225] Updated weights for policy 1, policy_version 35062 (0.0007) [2023-12-27 19:28:58,531][106225] Updated weights for policy 1, policy_version 35072 (0.0008) [2023-12-27 19:28:58,597][106225] Updated weights for policy 1, policy_version 35082 (0.0008) [2023-12-27 19:28:58,886][106226] Updated weights for policy 0, policy_version 35243 (0.0009) [2023-12-27 19:28:58,951][106226] Updated weights for policy 0, policy_version 35253 (0.0008) [2023-12-27 19:28:59,005][106226] Updated weights for policy 0, policy_version 35263 (0.0008) [2023-12-27 19:28:59,475][106225] Updated weights for policy 1, policy_version 35092 (0.0008) [2023-12-27 19:28:59,528][106225] Updated weights for policy 1, policy_version 35102 (0.0008) [2023-12-27 19:28:59,589][106225] Updated weights for policy 1, policy_version 35112 (0.0008) [2023-12-27 19:28:59,746][106226] Updated weights for policy 0, policy_version 35273 (0.0008) [2023-12-27 19:28:59,803][106226] Updated weights for policy 0, policy_version 35283 (0.0009) [2023-12-27 19:28:59,873][106226] Updated weights for policy 0, policy_version 35293 (0.0008) [2023-12-27 19:28:59,944][106226] Updated weights for policy 0, policy_version 35303 (0.0010) [2023-12-27 19:29:00,340][106225] Updated weights for policy 1, policy_version 35122 (0.0009) [2023-12-27 19:29:00,396][106225] Updated weights for policy 1, policy_version 35132 (0.0008) [2023-12-27 19:29:00,455][106225] Updated weights for policy 1, policy_version 35142 (0.0008) [2023-12-27 19:29:00,509][106225] Updated weights for policy 1, policy_version 35152 (0.0008) [2023-12-27 19:29:00,610][106226] Updated weights for policy 0, policy_version 35313 (0.0009) [2023-12-27 19:29:00,664][106226] Updated weights for policy 0, policy_version 35323 (0.0008) [2023-12-27 19:29:00,713][106226] Updated weights for policy 0, policy_version 35333 (0.0008) [2023-12-27 19:29:01,153][106225] Updated weights for policy 1, policy_version 35162 (0.0007) [2023-12-27 19:29:01,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 18055168. Throughput: 0: 10079.9, 1: 9748.9. Samples: 18048084. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-27 19:29:01,175][105115] Avg episode reward: [(0, '-5.275'), (1, '-6.548')] [2023-12-27 19:29:01,211][106225] Updated weights for policy 1, policy_version 35172 (0.0006) [2023-12-27 19:29:01,273][106225] Updated weights for policy 1, policy_version 35182 (0.0007) [2023-12-27 19:29:01,520][106226] Updated weights for policy 0, policy_version 35343 (0.0006) [2023-12-27 19:29:01,576][106226] Updated weights for policy 0, policy_version 35353 (0.0005) [2023-12-27 19:29:01,641][106226] Updated weights for policy 0, policy_version 35363 (0.0007) [2023-12-27 19:29:01,973][106225] Updated weights for policy 1, policy_version 35192 (0.0006) [2023-12-27 19:29:02,037][106225] Updated weights for policy 1, policy_version 35202 (0.0006) [2023-12-27 19:29:02,095][106225] Updated weights for policy 1, policy_version 35212 (0.0005) [2023-12-27 19:29:02,385][106226] Updated weights for policy 0, policy_version 35373 (0.0010) [2023-12-27 19:29:02,450][106226] Updated weights for policy 0, policy_version 35383 (0.0009) [2023-12-27 19:29:02,525][106226] Updated weights for policy 0, policy_version 35393 (0.0007) [2023-12-27 19:29:02,724][106225] Updated weights for policy 1, policy_version 35222 (0.0007) [2023-12-27 19:29:02,772][106225] Updated weights for policy 1, policy_version 35232 (0.0008) [2023-12-27 19:29:02,821][106225] Updated weights for policy 1, policy_version 35242 (0.0009) [2023-12-27 19:29:03,219][106226] Updated weights for policy 0, policy_version 35403 (0.0009) [2023-12-27 19:29:03,270][106226] Updated weights for policy 0, policy_version 35413 (0.0008) [2023-12-27 19:29:03,329][106226] Updated weights for policy 0, policy_version 35423 (0.0009) [2023-12-27 19:29:03,563][106225] Updated weights for policy 1, policy_version 35252 (0.0008) [2023-12-27 19:29:03,626][106225] Updated weights for policy 1, policy_version 35262 (0.0008) [2023-12-27 19:29:03,686][106225] Updated weights for policy 1, policy_version 35272 (0.0009) [2023-12-27 19:29:04,078][106226] Updated weights for policy 0, policy_version 35433 (0.0008) [2023-12-27 19:29:04,138][106226] Updated weights for policy 0, policy_version 35443 (0.0009) [2023-12-27 19:29:04,196][106226] Updated weights for policy 0, policy_version 35453 (0.0009) [2023-12-27 19:29:04,259][106226] Updated weights for policy 0, policy_version 35463 (0.0008) [2023-12-27 19:29:04,413][106225] Updated weights for policy 1, policy_version 35282 (0.0008) [2023-12-27 19:29:04,476][106225] Updated weights for policy 1, policy_version 35292 (0.0008) [2023-12-27 19:29:04,532][106225] Updated weights for policy 1, policy_version 35302 (0.0008) [2023-12-27 19:29:04,599][106225] Updated weights for policy 1, policy_version 35312 (0.0008) [2023-12-27 19:29:04,924][106226] Updated weights for policy 0, policy_version 35473 (0.0006) [2023-12-27 19:29:04,990][106226] Updated weights for policy 0, policy_version 35483 (0.0006) [2023-12-27 19:29:05,049][106226] Updated weights for policy 0, policy_version 35493 (0.0008) [2023-12-27 19:29:05,296][106225] Updated weights for policy 1, policy_version 35322 (0.0005) [2023-12-27 19:29:05,349][106225] Updated weights for policy 1, policy_version 35332 (0.0005) [2023-12-27 19:29:05,412][106225] Updated weights for policy 1, policy_version 35342 (0.0007) [2023-12-27 19:29:05,671][106226] Updated weights for policy 0, policy_version 35503 (0.0009) [2023-12-27 19:29:05,724][106226] Updated weights for policy 0, policy_version 35513 (0.0009) [2023-12-27 19:29:05,775][106226] Updated weights for policy 0, policy_version 35523 (0.0009) [2023-12-27 19:29:05,929][106225] Updated weights for policy 1, policy_version 35352 (0.0006) [2023-12-27 19:29:05,977][106225] Updated weights for policy 1, policy_version 35362 (0.0005) [2023-12-27 19:29:06,034][106225] Updated weights for policy 1, policy_version 35372 (0.0005) [2023-12-27 19:29:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 18161664. Throughput: 0: 10009.4, 1: 9804.6. Samples: 18167576. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-27 19:29:06,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-6.504')] [2023-12-27 19:29:06,176][106140] Saving new best policy, reward=-4.754! [2023-12-27 19:29:06,554][106226] Updated weights for policy 0, policy_version 35533 (0.0009) [2023-12-27 19:29:06,621][106226] Updated weights for policy 0, policy_version 35543 (0.0008) [2023-12-27 19:29:06,680][106226] Updated weights for policy 0, policy_version 35553 (0.0010) [2023-12-27 19:29:06,717][106225] Updated weights for policy 1, policy_version 35382 (0.0005) [2023-12-27 19:29:06,766][106225] Updated weights for policy 1, policy_version 35392 (0.0007) [2023-12-27 19:29:06,818][106225] Updated weights for policy 1, policy_version 35402 (0.0007) [2023-12-27 19:29:07,390][106226] Updated weights for policy 0, policy_version 35563 (0.0010) [2023-12-27 19:29:07,450][106226] Updated weights for policy 0, policy_version 35573 (0.0008) [2023-12-27 19:29:07,501][106226] Updated weights for policy 0, policy_version 35583 (0.0008) [2023-12-27 19:29:07,564][106225] Updated weights for policy 1, policy_version 35412 (0.0008) [2023-12-27 19:29:07,626][106225] Updated weights for policy 1, policy_version 35422 (0.0008) [2023-12-27 19:29:07,685][106225] Updated weights for policy 1, policy_version 35432 (0.0008) [2023-12-27 19:29:08,217][106226] Updated weights for policy 0, policy_version 35593 (0.0007) [2023-12-27 19:29:08,276][106226] Updated weights for policy 0, policy_version 35603 (0.0009) [2023-12-27 19:29:08,340][106226] Updated weights for policy 0, policy_version 35613 (0.0008) [2023-12-27 19:29:08,383][106225] Updated weights for policy 1, policy_version 35442 (0.0008) [2023-12-27 19:29:08,409][106226] Updated weights for policy 0, policy_version 35623 (0.0008) [2023-12-27 19:29:08,450][106225] Updated weights for policy 1, policy_version 35452 (0.0007) [2023-12-27 19:29:08,507][106225] Updated weights for policy 1, policy_version 35462 (0.0009) [2023-12-27 19:29:08,576][106225] Updated weights for policy 1, policy_version 35472 (0.0008) [2023-12-27 19:29:09,140][106226] Updated weights for policy 0, policy_version 35633 (0.0008) [2023-12-27 19:29:09,191][106226] Updated weights for policy 0, policy_version 35643 (0.0008) [2023-12-27 19:29:09,255][106226] Updated weights for policy 0, policy_version 35653 (0.0008) [2023-12-27 19:29:09,268][106225] Updated weights for policy 1, policy_version 35482 (0.0008) [2023-12-27 19:29:09,332][106225] Updated weights for policy 1, policy_version 35492 (0.0008) [2023-12-27 19:29:09,399][106225] Updated weights for policy 1, policy_version 35502 (0.0009) [2023-12-27 19:29:10,049][106226] Updated weights for policy 0, policy_version 35663 (0.0009) [2023-12-27 19:29:10,117][106226] Updated weights for policy 0, policy_version 35673 (0.0011) [2023-12-27 19:29:10,160][106225] Updated weights for policy 1, policy_version 35512 (0.0008) [2023-12-27 19:29:10,175][106226] Updated weights for policy 0, policy_version 35683 (0.0011) [2023-12-27 19:29:10,220][106225] Updated weights for policy 1, policy_version 35522 (0.0007) [2023-12-27 19:29:10,270][106225] Updated weights for policy 1, policy_version 35532 (0.0006) [2023-12-27 19:29:10,849][106226] Updated weights for policy 0, policy_version 35693 (0.0008) [2023-12-27 19:29:10,906][106226] Updated weights for policy 0, policy_version 35703 (0.0007) [2023-12-27 19:29:10,968][106226] Updated weights for policy 0, policy_version 35713 (0.0009) [2023-12-27 19:29:11,006][106225] Updated weights for policy 1, policy_version 35542 (0.0006) [2023-12-27 19:29:11,072][106225] Updated weights for policy 1, policy_version 35552 (0.0007) [2023-12-27 19:29:11,139][106225] Updated weights for policy 1, policy_version 35562 (0.0007) [2023-12-27 19:29:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 18251776. Throughput: 0: 9960.7, 1: 9886.2. Samples: 18226552. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-27 19:29:11,175][105115] Avg episode reward: [(0, '-5.124'), (1, '-6.849')] [2023-12-27 19:29:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000035568_9109504.pth... [2023-12-27 19:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000035720_9150464.pth... [2023-12-27 19:29:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000034416_8814592.pth [2023-12-27 19:29:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000034568_8855552.pth [2023-12-27 19:29:11,683][106226] Updated weights for policy 0, policy_version 35723 (0.0009) [2023-12-27 19:29:11,762][106226] Updated weights for policy 0, policy_version 35733 (0.0007) [2023-12-27 19:29:11,824][106226] Updated weights for policy 0, policy_version 35743 (0.0010) [2023-12-27 19:29:11,916][106225] Updated weights for policy 1, policy_version 35572 (0.0008) [2023-12-27 19:29:11,973][106225] Updated weights for policy 1, policy_version 35582 (0.0006) [2023-12-27 19:29:12,031][106225] Updated weights for policy 1, policy_version 35592 (0.0005) [2023-12-27 19:29:12,598][106226] Updated weights for policy 0, policy_version 35753 (0.0009) [2023-12-27 19:29:12,659][106226] Updated weights for policy 0, policy_version 35763 (0.0011) [2023-12-27 19:29:12,680][106225] Updated weights for policy 1, policy_version 35602 (0.0005) [2023-12-27 19:29:12,723][106226] Updated weights for policy 0, policy_version 35773 (0.0010) [2023-12-27 19:29:12,735][106225] Updated weights for policy 1, policy_version 35612 (0.0006) [2023-12-27 19:29:12,773][106226] Updated weights for policy 0, policy_version 35783 (0.0010) [2023-12-27 19:29:12,792][106225] Updated weights for policy 1, policy_version 35622 (0.0010) [2023-12-27 19:29:12,852][106225] Updated weights for policy 1, policy_version 35632 (0.0010) [2023-12-27 19:29:13,495][106226] Updated weights for policy 0, policy_version 35793 (0.0007) [2023-12-27 19:29:13,541][106225] Updated weights for policy 1, policy_version 35642 (0.0010) [2023-12-27 19:29:13,547][106226] Updated weights for policy 0, policy_version 35803 (0.0007) [2023-12-27 19:29:13,599][106225] Updated weights for policy 1, policy_version 35652 (0.0008) [2023-12-27 19:29:13,606][106226] Updated weights for policy 0, policy_version 35813 (0.0008) [2023-12-27 19:29:13,651][106225] Updated weights for policy 1, policy_version 35662 (0.0005) [2023-12-27 19:29:14,219][106226] Updated weights for policy 0, policy_version 35823 (0.0009) [2023-12-27 19:29:14,273][106225] Updated weights for policy 1, policy_version 35672 (0.0007) [2023-12-27 19:29:14,283][106226] Updated weights for policy 0, policy_version 35833 (0.0011) [2023-12-27 19:29:14,320][106225] Updated weights for policy 1, policy_version 35682 (0.0006) [2023-12-27 19:29:14,344][106226] Updated weights for policy 0, policy_version 35843 (0.0010) [2023-12-27 19:29:14,377][106225] Updated weights for policy 1, policy_version 35692 (0.0008) [2023-12-27 19:29:15,034][106226] Updated weights for policy 0, policy_version 35853 (0.0009) [2023-12-27 19:29:15,093][106226] Updated weights for policy 0, policy_version 35863 (0.0007) [2023-12-27 19:29:15,144][106225] Updated weights for policy 1, policy_version 35702 (0.0007) [2023-12-27 19:29:15,162][106226] Updated weights for policy 0, policy_version 35873 (0.0006) [2023-12-27 19:29:15,213][106225] Updated weights for policy 1, policy_version 35712 (0.0007) [2023-12-27 19:29:15,273][106225] Updated weights for policy 1, policy_version 35722 (0.0005) [2023-12-27 19:29:15,817][106225] Updated weights for policy 1, policy_version 35732 (0.0006) [2023-12-27 19:29:15,850][106226] Updated weights for policy 0, policy_version 35883 (0.0008) [2023-12-27 19:29:15,876][106225] Updated weights for policy 1, policy_version 35742 (0.0007) [2023-12-27 19:29:15,911][106226] Updated weights for policy 0, policy_version 35893 (0.0011) [2023-12-27 19:29:15,935][106225] Updated weights for policy 1, policy_version 35752 (0.0006) [2023-12-27 19:29:15,973][106226] Updated weights for policy 0, policy_version 35903 (0.0009) [2023-12-27 19:29:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 18358272. Throughput: 0: 9826.3, 1: 9802.9. Samples: 18343448. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-27 19:29:16,175][105115] Avg episode reward: [(0, '-5.134'), (1, '-6.746')] [2023-12-27 19:29:16,589][106226] Updated weights for policy 0, policy_version 35913 (0.0005) [2023-12-27 19:29:16,627][106225] Updated weights for policy 1, policy_version 35762 (0.0007) [2023-12-27 19:29:16,647][106226] Updated weights for policy 0, policy_version 35923 (0.0005) [2023-12-27 19:29:16,680][106225] Updated weights for policy 1, policy_version 35772 (0.0005) [2023-12-27 19:29:16,694][106226] Updated weights for policy 0, policy_version 35933 (0.0008) [2023-12-27 19:29:16,737][106225] Updated weights for policy 1, policy_version 35782 (0.0006) [2023-12-27 19:29:16,746][106226] Updated weights for policy 0, policy_version 35943 (0.0009) [2023-12-27 19:29:16,790][106225] Updated weights for policy 1, policy_version 35792 (0.0007) [2023-12-27 19:29:17,424][106226] Updated weights for policy 0, policy_version 35953 (0.0008) [2023-12-27 19:29:17,486][106226] Updated weights for policy 0, policy_version 35963 (0.0007) [2023-12-27 19:29:17,488][106225] Updated weights for policy 1, policy_version 35802 (0.0006) [2023-12-27 19:29:17,539][106225] Updated weights for policy 1, policy_version 35812 (0.0006) [2023-12-27 19:29:17,549][106226] Updated weights for policy 0, policy_version 35973 (0.0007) [2023-12-27 19:29:17,593][106225] Updated weights for policy 1, policy_version 35822 (0.0007) [2023-12-27 19:29:18,197][106226] Updated weights for policy 0, policy_version 35983 (0.0008) [2023-12-27 19:29:18,259][106226] Updated weights for policy 0, policy_version 35993 (0.0010) [2023-12-27 19:29:18,303][106225] Updated weights for policy 1, policy_version 35832 (0.0006) [2023-12-27 19:29:18,310][106226] Updated weights for policy 0, policy_version 36003 (0.0010) [2023-12-27 19:29:18,359][106225] Updated weights for policy 1, policy_version 35842 (0.0006) [2023-12-27 19:29:18,423][106225] Updated weights for policy 1, policy_version 35852 (0.0005) [2023-12-27 19:29:18,984][106225] Updated weights for policy 1, policy_version 35862 (0.0007) [2023-12-27 19:29:19,034][106225] Updated weights for policy 1, policy_version 35872 (0.0009) [2023-12-27 19:29:19,045][106226] Updated weights for policy 0, policy_version 36013 (0.0011) [2023-12-27 19:29:19,093][106225] Updated weights for policy 1, policy_version 35882 (0.0005) [2023-12-27 19:29:19,110][106226] Updated weights for policy 0, policy_version 36023 (0.0011) [2023-12-27 19:29:19,171][106226] Updated weights for policy 0, policy_version 36033 (0.0011) [2023-12-27 19:29:19,925][106226] Updated weights for policy 0, policy_version 36043 (0.0011) [2023-12-27 19:29:19,953][106225] Updated weights for policy 1, policy_version 35892 (0.0006) [2023-12-27 19:29:19,989][106226] Updated weights for policy 0, policy_version 36053 (0.0011) [2023-12-27 19:29:20,011][106225] Updated weights for policy 1, policy_version 35902 (0.0006) [2023-12-27 19:29:20,054][106226] Updated weights for policy 0, policy_version 36063 (0.0010) [2023-12-27 19:29:20,075][106225] Updated weights for policy 1, policy_version 35912 (0.0006) [2023-12-27 19:29:20,815][106226] Updated weights for policy 0, policy_version 36073 (0.0007) [2023-12-27 19:29:20,836][106225] Updated weights for policy 1, policy_version 35922 (0.0007) [2023-12-27 19:29:20,877][106226] Updated weights for policy 0, policy_version 36083 (0.0011) [2023-12-27 19:29:20,896][106225] Updated weights for policy 1, policy_version 35932 (0.0008) [2023-12-27 19:29:20,943][106226] Updated weights for policy 0, policy_version 36093 (0.0011) [2023-12-27 19:29:20,954][106225] Updated weights for policy 1, policy_version 35942 (0.0007) [2023-12-27 19:29:20,998][106226] Updated weights for policy 0, policy_version 36103 (0.0010) [2023-12-27 19:29:21,009][106225] Updated weights for policy 1, policy_version 35952 (0.0006) [2023-12-27 19:29:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 18456576. Throughput: 0: 9835.0, 1: 9806.0. Samples: 18462348. Policy #0 lag: (min: 43.0, avg: 48.8, max: 49.0) [2023-12-27 19:29:21,175][105115] Avg episode reward: [(0, '-5.203'), (1, '-7.240')] [2023-12-27 19:29:21,672][106226] Updated weights for policy 0, policy_version 36113 (0.0009) [2023-12-27 19:29:21,751][106226] Updated weights for policy 0, policy_version 36123 (0.0012) [2023-12-27 19:29:21,820][106226] Updated weights for policy 0, policy_version 36133 (0.0009) [2023-12-27 19:29:21,826][106225] Updated weights for policy 1, policy_version 35962 (0.0009) [2023-12-27 19:29:21,892][106225] Updated weights for policy 1, policy_version 35972 (0.0009) [2023-12-27 19:29:21,953][106225] Updated weights for policy 1, policy_version 35982 (0.0009) [2023-12-27 19:29:22,551][106226] Updated weights for policy 0, policy_version 36143 (0.0006) [2023-12-27 19:29:22,616][106226] Updated weights for policy 0, policy_version 36153 (0.0006) [2023-12-27 19:29:22,680][106226] Updated weights for policy 0, policy_version 36163 (0.0006) [2023-12-27 19:29:22,732][106225] Updated weights for policy 1, policy_version 35992 (0.0007) [2023-12-27 19:29:22,799][106225] Updated weights for policy 1, policy_version 36002 (0.0010) [2023-12-27 19:29:22,863][106225] Updated weights for policy 1, policy_version 36012 (0.0008) [2023-12-27 19:29:23,323][106226] Updated weights for policy 0, policy_version 36173 (0.0008) [2023-12-27 19:29:23,373][106226] Updated weights for policy 0, policy_version 36183 (0.0007) [2023-12-27 19:29:23,422][106226] Updated weights for policy 0, policy_version 36193 (0.0008) [2023-12-27 19:29:23,595][106225] Updated weights for policy 1, policy_version 36022 (0.0008) [2023-12-27 19:29:23,644][106225] Updated weights for policy 1, policy_version 36032 (0.0007) [2023-12-27 19:29:23,693][106225] Updated weights for policy 1, policy_version 36042 (0.0007) [2023-12-27 19:29:24,148][106226] Updated weights for policy 0, policy_version 36203 (0.0008) [2023-12-27 19:29:24,210][106226] Updated weights for policy 0, policy_version 36213 (0.0011) [2023-12-27 19:29:24,264][106226] Updated weights for policy 0, policy_version 36223 (0.0010) [2023-12-27 19:29:24,440][106225] Updated weights for policy 1, policy_version 36052 (0.0009) [2023-12-27 19:29:24,493][106225] Updated weights for policy 1, policy_version 36062 (0.0008) [2023-12-27 19:29:24,543][106225] Updated weights for policy 1, policy_version 36072 (0.0008) [2023-12-27 19:29:24,950][106226] Updated weights for policy 0, policy_version 36233 (0.0009) [2023-12-27 19:29:24,998][106226] Updated weights for policy 0, policy_version 36243 (0.0009) [2023-12-27 19:29:25,046][106226] Updated weights for policy 0, policy_version 36253 (0.0007) [2023-12-27 19:29:25,101][106226] Updated weights for policy 0, policy_version 36263 (0.0006) [2023-12-27 19:29:25,217][106225] Updated weights for policy 1, policy_version 36082 (0.0008) [2023-12-27 19:29:25,285][106225] Updated weights for policy 1, policy_version 36092 (0.0005) [2023-12-27 19:29:25,344][106225] Updated weights for policy 1, policy_version 36102 (0.0006) [2023-12-27 19:29:25,391][106225] Updated weights for policy 1, policy_version 36112 (0.0005) [2023-12-27 19:29:25,654][106226] Updated weights for policy 0, policy_version 36273 (0.0005) [2023-12-27 19:29:25,715][106226] Updated weights for policy 0, policy_version 36283 (0.0005) [2023-12-27 19:29:25,773][106226] Updated weights for policy 0, policy_version 36293 (0.0005) [2023-12-27 19:29:25,985][106225] Updated weights for policy 1, policy_version 36122 (0.0005) [2023-12-27 19:29:26,035][106225] Updated weights for policy 1, policy_version 36132 (0.0005) [2023-12-27 19:29:26,084][106225] Updated weights for policy 1, policy_version 36142 (0.0005) [2023-12-27 19:29:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19910.7). Total num frames: 18554880. Throughput: 0: 9862.8, 1: 9743.9. Samples: 18518756. Policy #0 lag: (min: 43.0, avg: 48.8, max: 49.0) [2023-12-27 19:29:26,176][105115] Avg episode reward: [(0, '-5.160'), (1, '-6.181')] [2023-12-27 19:29:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000036144_9256960.pth... [2023-12-27 19:29:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000036296_9297920.pth... [2023-12-27 19:29:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000035144_9003008.pth [2023-12-27 19:29:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000034992_8962048.pth [2023-12-27 19:29:26,192][106141] Saving new best policy, reward=-6.181! [2023-12-27 19:29:26,359][106226] Updated weights for policy 0, policy_version 36303 (0.0008) [2023-12-27 19:29:26,418][106226] Updated weights for policy 0, policy_version 36313 (0.0008) [2023-12-27 19:29:26,465][106226] Updated weights for policy 0, policy_version 36323 (0.0009) [2023-12-27 19:29:26,669][106225] Updated weights for policy 1, policy_version 36152 (0.0005) [2023-12-27 19:29:26,722][106225] Updated weights for policy 1, policy_version 36162 (0.0005) [2023-12-27 19:29:26,793][106225] Updated weights for policy 1, policy_version 36172 (0.0005) [2023-12-27 19:29:27,172][106226] Updated weights for policy 0, policy_version 36333 (0.0008) [2023-12-27 19:29:27,226][106226] Updated weights for policy 0, policy_version 36343 (0.0008) [2023-12-27 19:29:27,271][106226] Updated weights for policy 0, policy_version 36353 (0.0008) [2023-12-27 19:29:27,415][106225] Updated weights for policy 1, policy_version 36182 (0.0007) [2023-12-27 19:29:27,470][106225] Updated weights for policy 1, policy_version 36192 (0.0007) [2023-12-27 19:29:27,526][106225] Updated weights for policy 1, policy_version 36202 (0.0005) [2023-12-27 19:29:28,033][106226] Updated weights for policy 0, policy_version 36363 (0.0007) [2023-12-27 19:29:28,050][106225] Updated weights for policy 1, policy_version 36212 (0.0005) [2023-12-27 19:29:28,084][106226] Updated weights for policy 0, policy_version 36373 (0.0009) [2023-12-27 19:29:28,105][106225] Updated weights for policy 1, policy_version 36222 (0.0005) [2023-12-27 19:29:28,132][106226] Updated weights for policy 0, policy_version 36383 (0.0005) [2023-12-27 19:29:28,157][106225] Updated weights for policy 1, policy_version 36232 (0.0005) [2023-12-27 19:29:28,777][106226] Updated weights for policy 0, policy_version 36393 (0.0005) [2023-12-27 19:29:28,823][106225] Updated weights for policy 1, policy_version 36242 (0.0006) [2023-12-27 19:29:28,834][106226] Updated weights for policy 0, policy_version 36403 (0.0005) [2023-12-27 19:29:28,879][106225] Updated weights for policy 1, policy_version 36252 (0.0010) [2023-12-27 19:29:28,885][106226] Updated weights for policy 0, policy_version 36413 (0.0008) [2023-12-27 19:29:28,932][106226] Updated weights for policy 0, policy_version 36423 (0.0006) [2023-12-27 19:29:28,937][106225] Updated weights for policy 1, policy_version 36262 (0.0010) [2023-12-27 19:29:28,993][106225] Updated weights for policy 1, policy_version 36272 (0.0010) [2023-12-27 19:29:29,669][106226] Updated weights for policy 0, policy_version 36433 (0.0007) [2023-12-27 19:29:29,708][106225] Updated weights for policy 1, policy_version 36282 (0.0010) [2023-12-27 19:29:29,733][106226] Updated weights for policy 0, policy_version 36443 (0.0006) [2023-12-27 19:29:29,761][106225] Updated weights for policy 1, policy_version 36292 (0.0010) [2023-12-27 19:29:29,794][106226] Updated weights for policy 0, policy_version 36453 (0.0005) [2023-12-27 19:29:29,818][106225] Updated weights for policy 1, policy_version 36302 (0.0010) [2023-12-27 19:29:30,410][106226] Updated weights for policy 0, policy_version 36463 (0.0008) [2023-12-27 19:29:30,464][106226] Updated weights for policy 0, policy_version 36473 (0.0006) [2023-12-27 19:29:30,519][106226] Updated weights for policy 0, policy_version 36483 (0.0006) [2023-12-27 19:29:30,554][106225] Updated weights for policy 1, policy_version 36312 (0.0007) [2023-12-27 19:29:30,601][106225] Updated weights for policy 1, policy_version 36322 (0.0008) [2023-12-27 19:29:30,652][106225] Updated weights for policy 1, policy_version 36332 (0.0008) [2023-12-27 19:29:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 18653184. Throughput: 0: 9960.0, 1: 9911.5. Samples: 18645988. Policy #0 lag: (min: 43.0, avg: 48.8, max: 49.0) [2023-12-27 19:29:31,175][105115] Avg episode reward: [(0, '-5.016'), (1, '-6.455')] [2023-12-27 19:29:31,221][106226] Updated weights for policy 0, policy_version 36493 (0.0008) [2023-12-27 19:29:31,283][106226] Updated weights for policy 0, policy_version 36503 (0.0008) [2023-12-27 19:29:31,345][106226] Updated weights for policy 0, policy_version 36513 (0.0006) [2023-12-27 19:29:31,411][106225] Updated weights for policy 1, policy_version 36342 (0.0009) [2023-12-27 19:29:31,464][106225] Updated weights for policy 1, policy_version 36352 (0.0009) [2023-12-27 19:29:31,527][106225] Updated weights for policy 1, policy_version 36362 (0.0008) [2023-12-27 19:29:32,064][106226] Updated weights for policy 0, policy_version 36523 (0.0007) [2023-12-27 19:29:32,123][106226] Updated weights for policy 0, policy_version 36533 (0.0008) [2023-12-27 19:29:32,186][106226] Updated weights for policy 0, policy_version 36543 (0.0008) [2023-12-27 19:29:32,260][106225] Updated weights for policy 1, policy_version 36372 (0.0007) [2023-12-27 19:29:32,329][106225] Updated weights for policy 1, policy_version 36382 (0.0010) [2023-12-27 19:29:32,404][106225] Updated weights for policy 1, policy_version 36392 (0.0009) [2023-12-27 19:29:32,903][106226] Updated weights for policy 0, policy_version 36553 (0.0008) [2023-12-27 19:29:32,958][106226] Updated weights for policy 0, policy_version 36563 (0.0007) [2023-12-27 19:29:33,003][106226] Updated weights for policy 0, policy_version 36573 (0.0006) [2023-12-27 19:29:33,048][106226] Updated weights for policy 0, policy_version 36583 (0.0005) [2023-12-27 19:29:33,092][106225] Updated weights for policy 1, policy_version 36402 (0.0009) [2023-12-27 19:29:33,144][106225] Updated weights for policy 1, policy_version 36412 (0.0010) [2023-12-27 19:29:33,189][106225] Updated weights for policy 1, policy_version 36422 (0.0010) [2023-12-27 19:29:33,245][106225] Updated weights for policy 1, policy_version 36432 (0.0010) [2023-12-27 19:29:33,813][106226] Updated weights for policy 0, policy_version 36593 (0.0007) [2023-12-27 19:29:33,834][106225] Updated weights for policy 1, policy_version 36442 (0.0006) [2023-12-27 19:29:33,875][106226] Updated weights for policy 0, policy_version 36603 (0.0006) [2023-12-27 19:29:33,878][106225] Updated weights for policy 1, policy_version 36452 (0.0007) [2023-12-27 19:29:33,933][106225] Updated weights for policy 1, policy_version 36462 (0.0006) [2023-12-27 19:29:33,936][106226] Updated weights for policy 0, policy_version 36613 (0.0008) [2023-12-27 19:29:34,601][106225] Updated weights for policy 1, policy_version 36472 (0.0009) [2023-12-27 19:29:34,660][106225] Updated weights for policy 1, policy_version 36482 (0.0008) [2023-12-27 19:29:34,710][106226] Updated weights for policy 0, policy_version 36623 (0.0008) [2023-12-27 19:29:34,721][106225] Updated weights for policy 1, policy_version 36492 (0.0008) [2023-12-27 19:29:34,762][106226] Updated weights for policy 0, policy_version 36633 (0.0007) [2023-12-27 19:29:34,809][106226] Updated weights for policy 0, policy_version 36643 (0.0009) [2023-12-27 19:29:35,424][106225] Updated weights for policy 1, policy_version 36502 (0.0007) [2023-12-27 19:29:35,483][106225] Updated weights for policy 1, policy_version 36512 (0.0008) [2023-12-27 19:29:35,524][106226] Updated weights for policy 0, policy_version 36653 (0.0010) [2023-12-27 19:29:35,546][106225] Updated weights for policy 1, policy_version 36522 (0.0006) [2023-12-27 19:29:35,584][106226] Updated weights for policy 0, policy_version 36663 (0.0011) [2023-12-27 19:29:35,646][106226] Updated weights for policy 0, policy_version 36673 (0.0011) [2023-12-27 19:29:36,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.9, 300 sec: 19910.7). Total num frames: 18751488. Throughput: 0: 9878.5, 1: 9943.4. Samples: 18763992. Policy #0 lag: (min: 43.0, avg: 48.8, max: 49.0) [2023-12-27 19:29:36,175][105115] Avg episode reward: [(0, '-5.332'), (1, '-6.861')] [2023-12-27 19:29:36,303][106225] Updated weights for policy 1, policy_version 36532 (0.0009) [2023-12-27 19:29:36,308][106226] Updated weights for policy 0, policy_version 36683 (0.0009) [2023-12-27 19:29:36,362][106226] Updated weights for policy 0, policy_version 36693 (0.0006) [2023-12-27 19:29:36,369][106225] Updated weights for policy 1, policy_version 36542 (0.0008) [2023-12-27 19:29:36,413][106226] Updated weights for policy 0, policy_version 36703 (0.0005) [2023-12-27 19:29:36,434][106225] Updated weights for policy 1, policy_version 36552 (0.0007) [2023-12-27 19:29:37,110][106226] Updated weights for policy 0, policy_version 36713 (0.0010) [2023-12-27 19:29:37,170][106226] Updated weights for policy 0, policy_version 36723 (0.0011) [2023-12-27 19:29:37,186][106225] Updated weights for policy 1, policy_version 36562 (0.0007) [2023-12-27 19:29:37,227][106226] Updated weights for policy 0, policy_version 36733 (0.0011) [2023-12-27 19:29:37,233][106225] Updated weights for policy 1, policy_version 36572 (0.0006) [2023-12-27 19:29:37,282][106225] Updated weights for policy 1, policy_version 36582 (0.0008) [2023-12-27 19:29:37,285][106226] Updated weights for policy 0, policy_version 36743 (0.0011) [2023-12-27 19:29:37,329][106225] Updated weights for policy 1, policy_version 36592 (0.0007) [2023-12-27 19:29:37,921][106226] Updated weights for policy 0, policy_version 36753 (0.0011) [2023-12-27 19:29:37,984][106226] Updated weights for policy 0, policy_version 36763 (0.0011) [2023-12-27 19:29:38,024][106225] Updated weights for policy 1, policy_version 36602 (0.0005) [2023-12-27 19:29:38,052][106226] Updated weights for policy 0, policy_version 36773 (0.0011) [2023-12-27 19:29:38,084][106225] Updated weights for policy 1, policy_version 36612 (0.0005) [2023-12-27 19:29:38,135][106225] Updated weights for policy 1, policy_version 36622 (0.0005) [2023-12-27 19:29:38,701][106226] Updated weights for policy 0, policy_version 36783 (0.0010) [2023-12-27 19:29:38,767][106226] Updated weights for policy 0, policy_version 36793 (0.0008) [2023-12-27 19:29:38,772][106225] Updated weights for policy 1, policy_version 36632 (0.0009) [2023-12-27 19:29:38,837][106225] Updated weights for policy 1, policy_version 36642 (0.0010) [2023-12-27 19:29:38,838][106226] Updated weights for policy 0, policy_version 36803 (0.0008) [2023-12-27 19:29:38,901][106225] Updated weights for policy 1, policy_version 36652 (0.0010) [2023-12-27 19:29:39,577][106226] Updated weights for policy 0, policy_version 36813 (0.0007) [2023-12-27 19:29:39,641][106226] Updated weights for policy 0, policy_version 36823 (0.0006) [2023-12-27 19:29:39,643][106225] Updated weights for policy 1, policy_version 36662 (0.0010) [2023-12-27 19:29:39,702][106225] Updated weights for policy 1, policy_version 36672 (0.0010) [2023-12-27 19:29:39,704][106226] Updated weights for policy 0, policy_version 36833 (0.0010) [2023-12-27 19:29:39,762][106225] Updated weights for policy 1, policy_version 36682 (0.0008) [2023-12-27 19:29:40,389][106226] Updated weights for policy 0, policy_version 36843 (0.0009) [2023-12-27 19:29:40,452][106226] Updated weights for policy 0, policy_version 36853 (0.0006) [2023-12-27 19:29:40,498][106225] Updated weights for policy 1, policy_version 36692 (0.0007) [2023-12-27 19:29:40,507][106226] Updated weights for policy 0, policy_version 36863 (0.0007) [2023-12-27 19:29:40,542][106225] Updated weights for policy 1, policy_version 36702 (0.0008) [2023-12-27 19:29:40,588][106225] Updated weights for policy 1, policy_version 36712 (0.0008) [2023-12-27 19:29:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 18849792. Throughput: 0: 9904.4, 1: 9957.5. Samples: 18824276. Policy #0 lag: (min: 43.0, avg: 48.8, max: 49.0) [2023-12-27 19:29:41,175][105115] Avg episode reward: [(0, '-5.067'), (1, '-6.822')] [2023-12-27 19:29:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000036720_9404416.pth... [2023-12-27 19:29:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000036872_9445376.pth... [2023-12-27 19:29:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000035568_9109504.pth [2023-12-27 19:29:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000035720_9150464.pth [2023-12-27 19:29:41,229][106226] Updated weights for policy 0, policy_version 36873 (0.0007) [2023-12-27 19:29:41,291][106226] Updated weights for policy 0, policy_version 36883 (0.0008) [2023-12-27 19:29:41,327][106225] Updated weights for policy 1, policy_version 36722 (0.0007) [2023-12-27 19:29:41,353][106226] Updated weights for policy 0, policy_version 36893 (0.0009) [2023-12-27 19:29:41,396][106225] Updated weights for policy 1, policy_version 36732 (0.0007) [2023-12-27 19:29:41,418][106226] Updated weights for policy 0, policy_version 36903 (0.0009) [2023-12-27 19:29:41,453][106225] Updated weights for policy 1, policy_version 36742 (0.0007) [2023-12-27 19:29:41,514][106225] Updated weights for policy 1, policy_version 36752 (0.0008) [2023-12-27 19:29:42,202][106226] Updated weights for policy 0, policy_version 36913 (0.0008) [2023-12-27 19:29:42,245][106225] Updated weights for policy 1, policy_version 36762 (0.0006) [2023-12-27 19:29:42,267][106226] Updated weights for policy 0, policy_version 36923 (0.0008) [2023-12-27 19:29:42,312][106225] Updated weights for policy 1, policy_version 36772 (0.0009) [2023-12-27 19:29:42,327][106226] Updated weights for policy 0, policy_version 36933 (0.0007) [2023-12-27 19:29:42,379][106225] Updated weights for policy 1, policy_version 36782 (0.0007) [2023-12-27 19:29:42,973][106225] Updated weights for policy 1, policy_version 36792 (0.0008) [2023-12-27 19:29:43,028][106225] Updated weights for policy 1, policy_version 36802 (0.0008) [2023-12-27 19:29:43,079][106225] Updated weights for policy 1, policy_version 36812 (0.0007) [2023-12-27 19:29:43,088][106226] Updated weights for policy 0, policy_version 36943 (0.0007) [2023-12-27 19:29:43,140][106226] Updated weights for policy 0, policy_version 36953 (0.0008) [2023-12-27 19:29:43,195][106226] Updated weights for policy 0, policy_version 36963 (0.0008) [2023-12-27 19:29:43,795][106225] Updated weights for policy 1, policy_version 36822 (0.0009) [2023-12-27 19:29:43,853][106225] Updated weights for policy 1, policy_version 36832 (0.0008) [2023-12-27 19:29:43,902][106225] Updated weights for policy 1, policy_version 36842 (0.0009) [2023-12-27 19:29:43,929][106226] Updated weights for policy 0, policy_version 36973 (0.0007) [2023-12-27 19:29:43,990][106226] Updated weights for policy 0, policy_version 36983 (0.0005) [2023-12-27 19:29:44,035][106226] Updated weights for policy 0, policy_version 36993 (0.0005) [2023-12-27 19:29:44,601][106225] Updated weights for policy 1, policy_version 36852 (0.0008) [2023-12-27 19:29:44,642][106226] Updated weights for policy 0, policy_version 37003 (0.0005) [2023-12-27 19:29:44,648][106225] Updated weights for policy 1, policy_version 36862 (0.0010) [2023-12-27 19:29:44,689][106226] Updated weights for policy 0, policy_version 37013 (0.0006) [2023-12-27 19:29:44,698][106225] Updated weights for policy 1, policy_version 36872 (0.0010) [2023-12-27 19:29:44,759][106226] Updated weights for policy 0, policy_version 37023 (0.0008) [2023-12-27 19:29:45,476][106225] Updated weights for policy 1, policy_version 36882 (0.0008) [2023-12-27 19:29:45,515][106226] Updated weights for policy 0, policy_version 37033 (0.0007) [2023-12-27 19:29:45,539][106225] Updated weights for policy 1, policy_version 36892 (0.0010) [2023-12-27 19:29:45,570][106226] Updated weights for policy 0, policy_version 37043 (0.0005) [2023-12-27 19:29:45,596][106225] Updated weights for policy 1, policy_version 36902 (0.0010) [2023-12-27 19:29:45,626][106226] Updated weights for policy 0, policy_version 37053 (0.0005) [2023-12-27 19:29:45,652][106225] Updated weights for policy 1, policy_version 36912 (0.0010) [2023-12-27 19:29:45,678][106226] Updated weights for policy 0, policy_version 37063 (0.0005) [2023-12-27 19:29:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 18948096. Throughput: 0: 9852.4, 1: 9978.3. Samples: 18940468. Policy #0 lag: (min: 2.0, avg: 15.4, max: 34.0) [2023-12-27 19:29:46,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-6.578')] [2023-12-27 19:29:46,215][106226] Updated weights for policy 0, policy_version 37073 (0.0007) [2023-12-27 19:29:46,272][106226] Updated weights for policy 0, policy_version 37083 (0.0006) [2023-12-27 19:29:46,315][106225] Updated weights for policy 1, policy_version 36922 (0.0010) [2023-12-27 19:29:46,326][106226] Updated weights for policy 0, policy_version 37093 (0.0005) [2023-12-27 19:29:46,368][106225] Updated weights for policy 1, policy_version 36932 (0.0010) [2023-12-27 19:29:46,422][106225] Updated weights for policy 1, policy_version 36942 (0.0010) [2023-12-27 19:29:46,913][106226] Updated weights for policy 0, policy_version 37103 (0.0006) [2023-12-27 19:29:46,959][106226] Updated weights for policy 0, policy_version 37113 (0.0007) [2023-12-27 19:29:47,013][106226] Updated weights for policy 0, policy_version 37123 (0.0007) [2023-12-27 19:29:47,127][106225] Updated weights for policy 1, policy_version 36952 (0.0010) [2023-12-27 19:29:47,173][106225] Updated weights for policy 1, policy_version 36962 (0.0010) [2023-12-27 19:29:47,220][106225] Updated weights for policy 1, policy_version 36972 (0.0010) [2023-12-27 19:29:47,756][106226] Updated weights for policy 0, policy_version 37133 (0.0008) [2023-12-27 19:29:47,822][106226] Updated weights for policy 0, policy_version 37143 (0.0008) [2023-12-27 19:29:47,882][106226] Updated weights for policy 0, policy_version 37153 (0.0009) [2023-12-27 19:29:47,921][106225] Updated weights for policy 1, policy_version 36982 (0.0007) [2023-12-27 19:29:47,981][106225] Updated weights for policy 1, policy_version 36992 (0.0006) [2023-12-27 19:29:48,048][106225] Updated weights for policy 1, policy_version 37002 (0.0006) [2023-12-27 19:29:48,651][106226] Updated weights for policy 0, policy_version 37163 (0.0008) [2023-12-27 19:29:48,652][106225] Updated weights for policy 1, policy_version 37012 (0.0005) [2023-12-27 19:29:48,712][106226] Updated weights for policy 0, policy_version 37173 (0.0009) [2023-12-27 19:29:48,714][106225] Updated weights for policy 1, policy_version 37022 (0.0007) [2023-12-27 19:29:48,768][106226] Updated weights for policy 0, policy_version 37183 (0.0008) [2023-12-27 19:29:48,774][106225] Updated weights for policy 1, policy_version 37032 (0.0007) [2023-12-27 19:29:49,370][106225] Updated weights for policy 1, policy_version 37042 (0.0007) [2023-12-27 19:29:49,431][106225] Updated weights for policy 1, policy_version 37052 (0.0006) [2023-12-27 19:29:49,488][106225] Updated weights for policy 1, policy_version 37062 (0.0009) [2023-12-27 19:29:49,552][106225] Updated weights for policy 1, policy_version 37072 (0.0007) [2023-12-27 19:29:49,604][106226] Updated weights for policy 0, policy_version 37193 (0.0008) [2023-12-27 19:29:49,665][106226] Updated weights for policy 0, policy_version 37203 (0.0007) [2023-12-27 19:29:49,720][106226] Updated weights for policy 0, policy_version 37213 (0.0008) [2023-12-27 19:29:49,777][106226] Updated weights for policy 0, policy_version 37223 (0.0008) [2023-12-27 19:29:50,269][106225] Updated weights for policy 1, policy_version 37082 (0.0008) [2023-12-27 19:29:50,326][106225] Updated weights for policy 1, policy_version 37092 (0.0007) [2023-12-27 19:29:50,384][106225] Updated weights for policy 1, policy_version 37102 (0.0007) [2023-12-27 19:29:50,544][106226] Updated weights for policy 0, policy_version 37233 (0.0007) [2023-12-27 19:29:50,609][106226] Updated weights for policy 0, policy_version 37243 (0.0007) [2023-12-27 19:29:50,670][106226] Updated weights for policy 0, policy_version 37253 (0.0009) [2023-12-27 19:29:51,116][106225] Updated weights for policy 1, policy_version 37112 (0.0008) [2023-12-27 19:29:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 19046400. Throughput: 0: 9861.3, 1: 9964.5. Samples: 19059732. Policy #0 lag: (min: 2.0, avg: 15.4, max: 34.0) [2023-12-27 19:29:51,175][105115] Avg episode reward: [(0, '-5.468'), (1, '-6.861')] [2023-12-27 19:29:51,176][106225] Updated weights for policy 1, policy_version 37122 (0.0006) [2023-12-27 19:29:51,236][106225] Updated weights for policy 1, policy_version 37132 (0.0007) [2023-12-27 19:29:51,417][106226] Updated weights for policy 0, policy_version 37263 (0.0009) [2023-12-27 19:29:51,477][106226] Updated weights for policy 0, policy_version 37273 (0.0007) [2023-12-27 19:29:51,539][106226] Updated weights for policy 0, policy_version 37283 (0.0006) [2023-12-27 19:29:51,982][106225] Updated weights for policy 1, policy_version 37142 (0.0007) [2023-12-27 19:29:52,052][106225] Updated weights for policy 1, policy_version 37152 (0.0005) [2023-12-27 19:29:52,111][106225] Updated weights for policy 1, policy_version 37162 (0.0005) [2023-12-27 19:29:52,283][106226] Updated weights for policy 0, policy_version 37293 (0.0008) [2023-12-27 19:29:52,340][106226] Updated weights for policy 0, policy_version 37303 (0.0009) [2023-12-27 19:29:52,407][106226] Updated weights for policy 0, policy_version 37313 (0.0009) [2023-12-27 19:29:52,682][106225] Updated weights for policy 1, policy_version 37172 (0.0005) [2023-12-27 19:29:52,743][106225] Updated weights for policy 1, policy_version 37182 (0.0009) [2023-12-27 19:29:52,799][106225] Updated weights for policy 1, policy_version 37192 (0.0008) [2023-12-27 19:29:53,189][106226] Updated weights for policy 0, policy_version 37323 (0.0009) [2023-12-27 19:29:53,240][106226] Updated weights for policy 0, policy_version 37333 (0.0008) [2023-12-27 19:29:53,295][106226] Updated weights for policy 0, policy_version 37343 (0.0008) [2023-12-27 19:29:53,524][106225] Updated weights for policy 1, policy_version 37202 (0.0008) [2023-12-27 19:29:53,580][106225] Updated weights for policy 1, policy_version 37212 (0.0009) [2023-12-27 19:29:53,642][106225] Updated weights for policy 1, policy_version 37222 (0.0011) [2023-12-27 19:29:53,699][106225] Updated weights for policy 1, policy_version 37232 (0.0010) [2023-12-27 19:29:53,988][106226] Updated weights for policy 0, policy_version 37353 (0.0009) [2023-12-27 19:29:54,047][106226] Updated weights for policy 0, policy_version 37363 (0.0011) [2023-12-27 19:29:54,102][106226] Updated weights for policy 0, policy_version 37373 (0.0010) [2023-12-27 19:29:54,154][106226] Updated weights for policy 0, policy_version 37383 (0.0010) [2023-12-27 19:29:54,388][106225] Updated weights for policy 1, policy_version 37242 (0.0010) [2023-12-27 19:29:54,453][106225] Updated weights for policy 1, policy_version 37252 (0.0011) [2023-12-27 19:29:54,512][106225] Updated weights for policy 1, policy_version 37262 (0.0010) [2023-12-27 19:29:54,886][106226] Updated weights for policy 0, policy_version 37393 (0.0008) [2023-12-27 19:29:54,938][106226] Updated weights for policy 0, policy_version 37403 (0.0010) [2023-12-27 19:29:54,998][106226] Updated weights for policy 0, policy_version 37413 (0.0008) [2023-12-27 19:29:55,220][106225] Updated weights for policy 1, policy_version 37272 (0.0010) [2023-12-27 19:29:55,266][106225] Updated weights for policy 1, policy_version 37282 (0.0010) [2023-12-27 19:29:55,319][106225] Updated weights for policy 1, policy_version 37292 (0.0010) [2023-12-27 19:29:55,681][106226] Updated weights for policy 0, policy_version 37423 (0.0006) [2023-12-27 19:29:55,735][106226] Updated weights for policy 0, policy_version 37433 (0.0005) [2023-12-27 19:29:55,788][106226] Updated weights for policy 0, policy_version 37443 (0.0005) [2023-12-27 19:29:56,045][106225] Updated weights for policy 1, policy_version 37302 (0.0010) [2023-12-27 19:29:56,110][106225] Updated weights for policy 1, policy_version 37312 (0.0010) [2023-12-27 19:29:56,173][106225] Updated weights for policy 1, policy_version 37322 (0.0010) [2023-12-27 19:29:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 19144704. Throughput: 0: 9852.0, 1: 9957.8. Samples: 19117992. Policy #0 lag: (min: 2.0, avg: 15.4, max: 34.0) [2023-12-27 19:29:56,175][105115] Avg episode reward: [(0, '-5.267'), (1, '-6.477')] [2023-12-27 19:29:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000037448_9592832.pth... [2023-12-27 19:29:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000036296_9297920.pth [2023-12-27 19:29:56,206][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000037328_9560064.pth... [2023-12-27 19:29:56,210][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000036144_9256960.pth [2023-12-27 19:29:56,436][106226] Updated weights for policy 0, policy_version 37453 (0.0007) [2023-12-27 19:29:56,493][106226] Updated weights for policy 0, policy_version 37463 (0.0007) [2023-12-27 19:29:56,557][106226] Updated weights for policy 0, policy_version 37473 (0.0011) [2023-12-27 19:29:56,794][106225] Updated weights for policy 1, policy_version 37332 (0.0008) [2023-12-27 19:29:56,843][106225] Updated weights for policy 1, policy_version 37342 (0.0006) [2023-12-27 19:29:56,896][106225] Updated weights for policy 1, policy_version 37352 (0.0010) [2023-12-27 19:29:57,165][106226] Updated weights for policy 0, policy_version 37483 (0.0009) [2023-12-27 19:29:57,211][106226] Updated weights for policy 0, policy_version 37493 (0.0007) [2023-12-27 19:29:57,257][106226] Updated weights for policy 0, policy_version 37503 (0.0007) [2023-12-27 19:29:57,485][106225] Updated weights for policy 1, policy_version 37362 (0.0009) [2023-12-27 19:29:57,543][106225] Updated weights for policy 1, policy_version 37372 (0.0005) [2023-12-27 19:29:57,592][106225] Updated weights for policy 1, policy_version 37382 (0.0005) [2023-12-27 19:29:57,654][106225] Updated weights for policy 1, policy_version 37392 (0.0005) [2023-12-27 19:29:57,937][106226] Updated weights for policy 0, policy_version 37513 (0.0008) [2023-12-27 19:29:57,990][106226] Updated weights for policy 0, policy_version 37523 (0.0008) [2023-12-27 19:29:58,044][106226] Updated weights for policy 0, policy_version 37533 (0.0009) [2023-12-27 19:29:58,101][106226] Updated weights for policy 0, policy_version 37543 (0.0009) [2023-12-27 19:29:58,197][106225] Updated weights for policy 1, policy_version 37402 (0.0006) [2023-12-27 19:29:58,256][106225] Updated weights for policy 1, policy_version 37412 (0.0007) [2023-12-27 19:29:58,311][106225] Updated weights for policy 1, policy_version 37422 (0.0008) [2023-12-27 19:29:58,961][106226] Updated weights for policy 0, policy_version 37553 (0.0009) [2023-12-27 19:29:59,035][106226] Updated weights for policy 0, policy_version 37563 (0.0008) [2023-12-27 19:29:59,093][106225] Updated weights for policy 1, policy_version 37432 (0.0008) [2023-12-27 19:29:59,095][106226] Updated weights for policy 0, policy_version 37573 (0.0008) [2023-12-27 19:29:59,163][106225] Updated weights for policy 1, policy_version 37442 (0.0008) [2023-12-27 19:29:59,235][106225] Updated weights for policy 1, policy_version 37452 (0.0008) [2023-12-27 19:29:59,841][106226] Updated weights for policy 0, policy_version 37583 (0.0007) [2023-12-27 19:29:59,903][106226] Updated weights for policy 0, policy_version 37593 (0.0008) [2023-12-27 19:29:59,966][106226] Updated weights for policy 0, policy_version 37603 (0.0008) [2023-12-27 19:30:00,006][106225] Updated weights for policy 1, policy_version 37462 (0.0008) [2023-12-27 19:30:00,052][106225] Updated weights for policy 1, policy_version 37472 (0.0007) [2023-12-27 19:30:00,100][106225] Updated weights for policy 1, policy_version 37482 (0.0007) [2023-12-27 19:30:00,720][106226] Updated weights for policy 0, policy_version 37613 (0.0008) [2023-12-27 19:30:00,773][106226] Updated weights for policy 0, policy_version 37623 (0.0009) [2023-12-27 19:30:00,811][106225] Updated weights for policy 1, policy_version 37492 (0.0010) [2023-12-27 19:30:00,821][106226] Updated weights for policy 0, policy_version 37633 (0.0007) [2023-12-27 19:30:00,868][106225] Updated weights for policy 1, policy_version 37502 (0.0009) [2023-12-27 19:30:00,923][106225] Updated weights for policy 1, policy_version 37512 (0.0008) [2023-12-27 19:30:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 19251200. Throughput: 0: 9858.3, 1: 10029.8. Samples: 19238412. Policy #0 lag: (min: 2.0, avg: 15.4, max: 34.0) [2023-12-27 19:30:01,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-6.733')] [2023-12-27 19:30:01,614][106226] Updated weights for policy 0, policy_version 37643 (0.0007) [2023-12-27 19:30:01,656][106225] Updated weights for policy 1, policy_version 37522 (0.0008) [2023-12-27 19:30:01,679][106226] Updated weights for policy 0, policy_version 37653 (0.0011) [2023-12-27 19:30:01,713][106225] Updated weights for policy 1, policy_version 37532 (0.0007) [2023-12-27 19:30:01,750][106226] Updated weights for policy 0, policy_version 37663 (0.0010) [2023-12-27 19:30:01,782][106225] Updated weights for policy 1, policy_version 37542 (0.0007) [2023-12-27 19:30:01,848][106225] Updated weights for policy 1, policy_version 37552 (0.0007) [2023-12-27 19:30:02,468][106226] Updated weights for policy 0, policy_version 37673 (0.0010) [2023-12-27 19:30:02,532][106226] Updated weights for policy 0, policy_version 37683 (0.0008) [2023-12-27 19:30:02,594][106226] Updated weights for policy 0, policy_version 37693 (0.0006) [2023-12-27 19:30:02,615][106225] Updated weights for policy 1, policy_version 37562 (0.0008) [2023-12-27 19:30:02,653][106226] Updated weights for policy 0, policy_version 37703 (0.0007) [2023-12-27 19:30:02,666][106225] Updated weights for policy 1, policy_version 37572 (0.0006) [2023-12-27 19:30:02,726][106225] Updated weights for policy 1, policy_version 37582 (0.0008) [2023-12-27 19:30:03,333][106226] Updated weights for policy 0, policy_version 37713 (0.0005) [2023-12-27 19:30:03,345][106225] Updated weights for policy 1, policy_version 37592 (0.0008) [2023-12-27 19:30:03,385][106226] Updated weights for policy 0, policy_version 37723 (0.0005) [2023-12-27 19:30:03,392][106225] Updated weights for policy 1, policy_version 37602 (0.0005) [2023-12-27 19:30:03,430][106226] Updated weights for policy 0, policy_version 37733 (0.0005) [2023-12-27 19:30:03,449][106225] Updated weights for policy 1, policy_version 37612 (0.0007) [2023-12-27 19:30:04,087][106225] Updated weights for policy 1, policy_version 37622 (0.0008) [2023-12-27 19:30:04,092][106226] Updated weights for policy 0, policy_version 37743 (0.0006) [2023-12-27 19:30:04,146][106225] Updated weights for policy 1, policy_version 37632 (0.0010) [2023-12-27 19:30:04,155][106226] Updated weights for policy 0, policy_version 37753 (0.0007) [2023-12-27 19:30:04,203][106226] Updated weights for policy 0, policy_version 37763 (0.0007) [2023-12-27 19:30:04,203][106225] Updated weights for policy 1, policy_version 37642 (0.0010) [2023-12-27 19:30:04,786][106225] Updated weights for policy 1, policy_version 37652 (0.0007) [2023-12-27 19:30:04,852][106225] Updated weights for policy 1, policy_version 37662 (0.0006) [2023-12-27 19:30:04,859][106226] Updated weights for policy 0, policy_version 37773 (0.0006) [2023-12-27 19:30:04,911][106225] Updated weights for policy 1, policy_version 37672 (0.0009) [2023-12-27 19:30:04,913][106226] Updated weights for policy 0, policy_version 37783 (0.0008) [2023-12-27 19:30:04,970][106226] Updated weights for policy 0, policy_version 37793 (0.0006) [2023-12-27 19:30:05,523][106225] Updated weights for policy 1, policy_version 37682 (0.0009) [2023-12-27 19:30:05,591][106225] Updated weights for policy 1, policy_version 37692 (0.0005) [2023-12-27 19:30:05,650][106225] Updated weights for policy 1, policy_version 37702 (0.0005) [2023-12-27 19:30:05,697][106226] Updated weights for policy 0, policy_version 37803 (0.0008) [2023-12-27 19:30:05,710][106225] Updated weights for policy 1, policy_version 37712 (0.0006) [2023-12-27 19:30:05,762][106226] Updated weights for policy 0, policy_version 37813 (0.0009) [2023-12-27 19:30:05,815][106226] Updated weights for policy 0, policy_version 37823 (0.0009) [2023-12-27 19:30:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 19349504. Throughput: 0: 9843.8, 1: 10074.4. Samples: 19358668. Policy #0 lag: (min: 2.0, avg: 15.4, max: 34.0) [2023-12-27 19:30:06,175][105115] Avg episode reward: [(0, '-5.289'), (1, '-6.886')] [2023-12-27 19:30:06,351][106225] Updated weights for policy 1, policy_version 37722 (0.0011) [2023-12-27 19:30:06,413][106225] Updated weights for policy 1, policy_version 37732 (0.0010) [2023-12-27 19:30:06,482][106225] Updated weights for policy 1, policy_version 37742 (0.0010) [2023-12-27 19:30:06,532][106226] Updated weights for policy 0, policy_version 37833 (0.0008) [2023-12-27 19:30:06,606][106226] Updated weights for policy 0, policy_version 37843 (0.0008) [2023-12-27 19:30:06,673][106226] Updated weights for policy 0, policy_version 37853 (0.0008) [2023-12-27 19:30:06,725][106226] Updated weights for policy 0, policy_version 37863 (0.0007) [2023-12-27 19:30:07,179][106225] Updated weights for policy 1, policy_version 37752 (0.0011) [2023-12-27 19:30:07,240][106225] Updated weights for policy 1, policy_version 37762 (0.0010) [2023-12-27 19:30:07,297][106225] Updated weights for policy 1, policy_version 37772 (0.0010) [2023-12-27 19:30:07,406][106226] Updated weights for policy 0, policy_version 37873 (0.0005) [2023-12-27 19:30:07,457][106226] Updated weights for policy 0, policy_version 37883 (0.0005) [2023-12-27 19:30:07,509][106226] Updated weights for policy 0, policy_version 37893 (0.0005) [2023-12-27 19:30:07,984][106225] Updated weights for policy 1, policy_version 37782 (0.0007) [2023-12-27 19:30:08,044][106225] Updated weights for policy 1, policy_version 37792 (0.0009) [2023-12-27 19:30:08,098][106225] Updated weights for policy 1, policy_version 37802 (0.0007) [2023-12-27 19:30:08,116][106226] Updated weights for policy 0, policy_version 37903 (0.0007) [2023-12-27 19:30:08,177][106226] Updated weights for policy 0, policy_version 37913 (0.0007) [2023-12-27 19:30:08,226][106226] Updated weights for policy 0, policy_version 37923 (0.0009) [2023-12-27 19:30:08,750][106225] Updated weights for policy 1, policy_version 37812 (0.0009) [2023-12-27 19:30:08,808][106225] Updated weights for policy 1, policy_version 37822 (0.0008) [2023-12-27 19:30:08,870][106225] Updated weights for policy 1, policy_version 37832 (0.0009) [2023-12-27 19:30:08,981][106226] Updated weights for policy 0, policy_version 37933 (0.0009) [2023-12-27 19:30:09,044][106226] Updated weights for policy 0, policy_version 37943 (0.0008) [2023-12-27 19:30:09,107][106226] Updated weights for policy 0, policy_version 37953 (0.0008) [2023-12-27 19:30:09,737][106225] Updated weights for policy 1, policy_version 37842 (0.0010) [2023-12-27 19:30:09,797][106225] Updated weights for policy 1, policy_version 37852 (0.0008) [2023-12-27 19:30:09,866][106225] Updated weights for policy 1, policy_version 37862 (0.0008) [2023-12-27 19:30:09,914][106226] Updated weights for policy 0, policy_version 37963 (0.0006) [2023-12-27 19:30:09,935][106225] Updated weights for policy 1, policy_version 37872 (0.0008) [2023-12-27 19:30:09,980][106226] Updated weights for policy 0, policy_version 37973 (0.0008) [2023-12-27 19:30:10,036][106226] Updated weights for policy 0, policy_version 37983 (0.0008) [2023-12-27 19:30:10,664][106225] Updated weights for policy 1, policy_version 37882 (0.0008) [2023-12-27 19:30:10,724][106225] Updated weights for policy 1, policy_version 37892 (0.0005) [2023-12-27 19:30:10,793][106225] Updated weights for policy 1, policy_version 37902 (0.0007) [2023-12-27 19:30:10,794][106226] Updated weights for policy 0, policy_version 37993 (0.0008) [2023-12-27 19:30:10,857][106226] Updated weights for policy 0, policy_version 38003 (0.0006) [2023-12-27 19:30:10,917][106226] Updated weights for policy 0, policy_version 38013 (0.0006) [2023-12-27 19:30:10,984][106226] Updated weights for policy 0, policy_version 38023 (0.0005) [2023-12-27 19:30:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 19447808. Throughput: 0: 9862.2, 1: 10156.6. Samples: 19419596. Policy #0 lag: (min: 28.0, avg: 35.9, max: 60.0) [2023-12-27 19:30:11,175][105115] Avg episode reward: [(0, '-4.907'), (1, '-6.645')] [2023-12-27 19:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000037904_9707520.pth... [2023-12-27 19:30:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000038024_9740288.pth... [2023-12-27 19:30:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000036720_9404416.pth [2023-12-27 19:30:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000036872_9445376.pth [2023-12-27 19:30:11,500][106225] Updated weights for policy 1, policy_version 37912 (0.0008) [2023-12-27 19:30:11,554][106225] Updated weights for policy 1, policy_version 37922 (0.0008) [2023-12-27 19:30:11,614][106225] Updated weights for policy 1, policy_version 37932 (0.0008) [2023-12-27 19:30:11,638][106226] Updated weights for policy 0, policy_version 38033 (0.0008) [2023-12-27 19:30:11,704][106226] Updated weights for policy 0, policy_version 38043 (0.0008) [2023-12-27 19:30:11,775][106226] Updated weights for policy 0, policy_version 38053 (0.0008) [2023-12-27 19:30:12,416][106225] Updated weights for policy 1, policy_version 37942 (0.0009) [2023-12-27 19:30:12,469][106225] Updated weights for policy 1, policy_version 37952 (0.0009) [2023-12-27 19:30:12,535][106225] Updated weights for policy 1, policy_version 37962 (0.0008) [2023-12-27 19:30:12,537][106226] Updated weights for policy 0, policy_version 38063 (0.0007) [2023-12-27 19:30:12,587][106226] Updated weights for policy 0, policy_version 38073 (0.0007) [2023-12-27 19:30:12,645][106226] Updated weights for policy 0, policy_version 38083 (0.0006) [2023-12-27 19:30:13,301][106225] Updated weights for policy 1, policy_version 37972 (0.0007) [2023-12-27 19:30:13,322][106226] Updated weights for policy 0, policy_version 38093 (0.0007) [2023-12-27 19:30:13,353][106225] Updated weights for policy 1, policy_version 37982 (0.0006) [2023-12-27 19:30:13,383][106226] Updated weights for policy 0, policy_version 38103 (0.0008) [2023-12-27 19:30:13,403][106225] Updated weights for policy 1, policy_version 37992 (0.0005) [2023-12-27 19:30:13,436][106226] Updated weights for policy 0, policy_version 38113 (0.0005) [2023-12-27 19:30:13,976][106225] Updated weights for policy 1, policy_version 38002 (0.0006) [2023-12-27 19:30:14,023][106225] Updated weights for policy 1, policy_version 38012 (0.0007) [2023-12-27 19:30:14,079][106225] Updated weights for policy 1, policy_version 38022 (0.0007) [2023-12-27 19:30:14,111][106226] Updated weights for policy 0, policy_version 38123 (0.0005) [2023-12-27 19:30:14,128][106225] Updated weights for policy 1, policy_version 38032 (0.0008) [2023-12-27 19:30:14,161][106226] Updated weights for policy 0, policy_version 38133 (0.0007) [2023-12-27 19:30:14,213][106226] Updated weights for policy 0, policy_version 38143 (0.0009) [2023-12-27 19:30:14,778][106225] Updated weights for policy 1, policy_version 38042 (0.0006) [2023-12-27 19:30:14,844][106225] Updated weights for policy 1, policy_version 38052 (0.0007) [2023-12-27 19:30:14,919][106225] Updated weights for policy 1, policy_version 38062 (0.0006) [2023-12-27 19:30:14,971][106226] Updated weights for policy 0, policy_version 38153 (0.0008) [2023-12-27 19:30:15,038][106226] Updated weights for policy 0, policy_version 38163 (0.0008) [2023-12-27 19:30:15,104][106226] Updated weights for policy 0, policy_version 38173 (0.0008) [2023-12-27 19:30:15,165][106226] Updated weights for policy 0, policy_version 38183 (0.0009) [2023-12-27 19:30:15,500][106225] Updated weights for policy 1, policy_version 38072 (0.0006) [2023-12-27 19:30:15,562][106225] Updated weights for policy 1, policy_version 38082 (0.0005) [2023-12-27 19:30:15,633][106225] Updated weights for policy 1, policy_version 38092 (0.0005) [2023-12-27 19:30:15,937][106226] Updated weights for policy 0, policy_version 38193 (0.0009) [2023-12-27 19:30:15,990][106226] Updated weights for policy 0, policy_version 38203 (0.0009) [2023-12-27 19:30:16,049][106226] Updated weights for policy 0, policy_version 38213 (0.0009) [2023-12-27 19:30:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 19546112. Throughput: 0: 9759.2, 1: 10002.3. Samples: 19535256. Policy #0 lag: (min: 28.0, avg: 35.9, max: 60.0) [2023-12-27 19:30:16,175][105115] Avg episode reward: [(0, '-5.284'), (1, '-6.551')] [2023-12-27 19:30:16,262][106225] Updated weights for policy 1, policy_version 38102 (0.0008) [2023-12-27 19:30:16,321][106225] Updated weights for policy 1, policy_version 38112 (0.0007) [2023-12-27 19:30:16,413][106225] Updated weights for policy 1, policy_version 38122 (0.0009) [2023-12-27 19:30:16,739][106226] Updated weights for policy 0, policy_version 38223 (0.0006) [2023-12-27 19:30:16,787][106226] Updated weights for policy 0, policy_version 38233 (0.0005) [2023-12-27 19:30:16,840][106226] Updated weights for policy 0, policy_version 38243 (0.0008) [2023-12-27 19:30:17,044][106225] Updated weights for policy 1, policy_version 38132 (0.0008) [2023-12-27 19:30:17,102][106225] Updated weights for policy 1, policy_version 38142 (0.0010) [2023-12-27 19:30:17,153][106225] Updated weights for policy 1, policy_version 38152 (0.0010) [2023-12-27 19:30:17,446][106226] Updated weights for policy 0, policy_version 38253 (0.0008) [2023-12-27 19:30:17,500][106226] Updated weights for policy 0, policy_version 38263 (0.0007) [2023-12-27 19:30:17,553][106226] Updated weights for policy 0, policy_version 38273 (0.0008) [2023-12-27 19:30:17,880][106225] Updated weights for policy 1, policy_version 38162 (0.0010) [2023-12-27 19:30:17,929][106225] Updated weights for policy 1, policy_version 38172 (0.0010) [2023-12-27 19:30:17,982][106225] Updated weights for policy 1, policy_version 38182 (0.0010) [2023-12-27 19:30:18,030][106225] Updated weights for policy 1, policy_version 38192 (0.0010) [2023-12-27 19:30:18,196][106226] Updated weights for policy 0, policy_version 38283 (0.0007) [2023-12-27 19:30:18,249][106226] Updated weights for policy 0, policy_version 38293 (0.0006) [2023-12-27 19:30:18,302][106226] Updated weights for policy 0, policy_version 38303 (0.0005) [2023-12-27 19:30:18,737][106225] Updated weights for policy 1, policy_version 38202 (0.0010) [2023-12-27 19:30:18,797][106225] Updated weights for policy 1, policy_version 38212 (0.0007) [2023-12-27 19:30:18,863][106225] Updated weights for policy 1, policy_version 38222 (0.0010) [2023-12-27 19:30:19,022][106226] Updated weights for policy 0, policy_version 38313 (0.0009) [2023-12-27 19:30:19,077][106226] Updated weights for policy 0, policy_version 38323 (0.0008) [2023-12-27 19:30:19,140][106226] Updated weights for policy 0, policy_version 38333 (0.0009) [2023-12-27 19:30:19,199][106226] Updated weights for policy 0, policy_version 38343 (0.0008) [2023-12-27 19:30:19,581][106225] Updated weights for policy 1, policy_version 38232 (0.0009) [2023-12-27 19:30:19,646][106225] Updated weights for policy 1, policy_version 38242 (0.0008) [2023-12-27 19:30:19,700][106225] Updated weights for policy 1, policy_version 38252 (0.0009) [2023-12-27 19:30:19,969][106226] Updated weights for policy 0, policy_version 38353 (0.0007) [2023-12-27 19:30:20,036][106226] Updated weights for policy 0, policy_version 38363 (0.0006) [2023-12-27 19:30:20,096][106226] Updated weights for policy 0, policy_version 38373 (0.0006) [2023-12-27 19:30:20,492][106225] Updated weights for policy 1, policy_version 38262 (0.0007) [2023-12-27 19:30:20,545][106225] Updated weights for policy 1, policy_version 38272 (0.0006) [2023-12-27 19:30:20,609][106225] Updated weights for policy 1, policy_version 38282 (0.0007) [2023-12-27 19:30:20,760][106226] Updated weights for policy 0, policy_version 38383 (0.0007) [2023-12-27 19:30:20,827][106226] Updated weights for policy 0, policy_version 38393 (0.0009) [2023-12-27 19:30:20,892][106226] Updated weights for policy 0, policy_version 38403 (0.0010) [2023-12-27 19:30:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 19644416. Throughput: 0: 9765.6, 1: 10011.6. Samples: 19653968. Policy #0 lag: (min: 28.0, avg: 35.9, max: 60.0) [2023-12-27 19:30:21,175][105115] Avg episode reward: [(0, '-5.557'), (1, '-6.703')] [2023-12-27 19:30:21,374][106225] Updated weights for policy 1, policy_version 38293 (0.0008) [2023-12-27 19:30:21,435][106225] Updated weights for policy 1, policy_version 38303 (0.0009) [2023-12-27 19:30:21,488][106225] Updated weights for policy 1, policy_version 38313 (0.0009) [2023-12-27 19:30:21,585][106226] Updated weights for policy 0, policy_version 38413 (0.0006) [2023-12-27 19:30:21,660][106226] Updated weights for policy 0, policy_version 38423 (0.0009) [2023-12-27 19:30:21,732][106226] Updated weights for policy 0, policy_version 38433 (0.0009) [2023-12-27 19:30:22,186][106225] Updated weights for policy 1, policy_version 38323 (0.0009) [2023-12-27 19:30:22,241][106225] Updated weights for policy 1, policy_version 38333 (0.0008) [2023-12-27 19:30:22,307][106225] Updated weights for policy 1, policy_version 38343 (0.0008) [2023-12-27 19:30:22,523][106226] Updated weights for policy 0, policy_version 38443 (0.0009) [2023-12-27 19:30:22,588][106226] Updated weights for policy 0, policy_version 38453 (0.0009) [2023-12-27 19:30:22,650][106226] Updated weights for policy 0, policy_version 38463 (0.0006) [2023-12-27 19:30:23,058][106225] Updated weights for policy 1, policy_version 38353 (0.0009) [2023-12-27 19:30:23,118][106225] Updated weights for policy 1, policy_version 38363 (0.0008) [2023-12-27 19:30:23,171][106225] Updated weights for policy 1, policy_version 38373 (0.0008) [2023-12-27 19:30:23,228][106225] Updated weights for policy 1, policy_version 38383 (0.0008) [2023-12-27 19:30:23,311][106226] Updated weights for policy 0, policy_version 38473 (0.0008) [2023-12-27 19:30:23,363][106226] Updated weights for policy 0, policy_version 38483 (0.0010) [2023-12-27 19:30:23,422][106226] Updated weights for policy 0, policy_version 38493 (0.0007) [2023-12-27 19:30:23,484][106226] Updated weights for policy 0, policy_version 38503 (0.0005) [2023-12-27 19:30:23,956][106225] Updated weights for policy 1, policy_version 38393 (0.0006) [2023-12-27 19:30:24,015][106225] Updated weights for policy 1, policy_version 38403 (0.0007) [2023-12-27 19:30:24,076][106225] Updated weights for policy 1, policy_version 38413 (0.0005) [2023-12-27 19:30:24,148][106226] Updated weights for policy 0, policy_version 38513 (0.0009) [2023-12-27 19:30:24,205][106226] Updated weights for policy 0, policy_version 38523 (0.0009) [2023-12-27 19:30:24,254][106226] Updated weights for policy 0, policy_version 38533 (0.0008) [2023-12-27 19:30:24,710][106225] Updated weights for policy 1, policy_version 38423 (0.0008) [2023-12-27 19:30:24,766][106225] Updated weights for policy 1, policy_version 38433 (0.0008) [2023-12-27 19:30:24,825][106225] Updated weights for policy 1, policy_version 38443 (0.0008) [2023-12-27 19:30:24,890][106226] Updated weights for policy 0, policy_version 38543 (0.0008) [2023-12-27 19:30:24,952][106226] Updated weights for policy 0, policy_version 38553 (0.0008) [2023-12-27 19:30:25,011][106226] Updated weights for policy 0, policy_version 38563 (0.0009) [2023-12-27 19:30:25,575][106225] Updated weights for policy 1, policy_version 38453 (0.0006) [2023-12-27 19:30:25,623][106225] Updated weights for policy 1, policy_version 38463 (0.0009) [2023-12-27 19:30:25,668][106226] Updated weights for policy 0, policy_version 38573 (0.0006) [2023-12-27 19:30:25,674][106225] Updated weights for policy 1, policy_version 38473 (0.0007) [2023-12-27 19:30:25,723][106226] Updated weights for policy 0, policy_version 38583 (0.0005) [2023-12-27 19:30:25,787][106226] Updated weights for policy 0, policy_version 38593 (0.0006) [2023-12-27 19:30:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 19742720. Throughput: 0: 9745.4, 1: 9977.9. Samples: 19711820. Policy #0 lag: (min: 28.0, avg: 35.9, max: 60.0) [2023-12-27 19:30:26,175][105115] Avg episode reward: [(0, '-5.230'), (1, '-6.899')] [2023-12-27 19:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000038480_9854976.pth... [2023-12-27 19:30:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000038600_9887744.pth... [2023-12-27 19:30:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000037328_9560064.pth [2023-12-27 19:30:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000037448_9592832.pth [2023-12-27 19:30:26,416][106225] Updated weights for policy 1, policy_version 38483 (0.0007) [2023-12-27 19:30:26,434][106226] Updated weights for policy 0, policy_version 38603 (0.0008) [2023-12-27 19:30:26,469][106225] Updated weights for policy 1, policy_version 38493 (0.0005) [2023-12-27 19:30:26,498][106226] Updated weights for policy 0, policy_version 38613 (0.0008) [2023-12-27 19:30:26,524][106225] Updated weights for policy 1, policy_version 38503 (0.0006) [2023-12-27 19:30:26,557][106226] Updated weights for policy 0, policy_version 38623 (0.0007) [2023-12-27 19:30:27,150][106225] Updated weights for policy 1, policy_version 38513 (0.0006) [2023-12-27 19:30:27,199][106225] Updated weights for policy 1, policy_version 38523 (0.0007) [2023-12-27 19:30:27,249][106225] Updated weights for policy 1, policy_version 38533 (0.0007) [2023-12-27 19:30:27,276][106226] Updated weights for policy 0, policy_version 38633 (0.0009) [2023-12-27 19:30:27,308][106225] Updated weights for policy 1, policy_version 38543 (0.0007) [2023-12-27 19:30:27,331][106226] Updated weights for policy 0, policy_version 38643 (0.0010) [2023-12-27 19:30:27,386][106226] Updated weights for policy 0, policy_version 38653 (0.0009) [2023-12-27 19:30:27,446][106226] Updated weights for policy 0, policy_version 38663 (0.0008) [2023-12-27 19:30:28,042][106226] Updated weights for policy 0, policy_version 38673 (0.0005) [2023-12-27 19:30:28,102][106226] Updated weights for policy 0, policy_version 38683 (0.0005) [2023-12-27 19:30:28,107][106225] Updated weights for policy 1, policy_version 38553 (0.0008) [2023-12-27 19:30:28,150][106226] Updated weights for policy 0, policy_version 38693 (0.0005) [2023-12-27 19:30:28,169][106225] Updated weights for policy 1, policy_version 38563 (0.0008) [2023-12-27 19:30:28,236][106225] Updated weights for policy 1, policy_version 38573 (0.0005) [2023-12-27 19:30:28,686][106226] Updated weights for policy 0, policy_version 38703 (0.0007) [2023-12-27 19:30:28,747][106226] Updated weights for policy 0, policy_version 38713 (0.0008) [2023-12-27 19:30:28,807][106226] Updated weights for policy 0, policy_version 38723 (0.0008) [2023-12-27 19:30:29,020][106225] Updated weights for policy 1, policy_version 38583 (0.0008) [2023-12-27 19:30:29,077][106225] Updated weights for policy 1, policy_version 38593 (0.0008) [2023-12-27 19:30:29,132][106225] Updated weights for policy 1, policy_version 38603 (0.0009) [2023-12-27 19:30:29,477][106226] Updated weights for policy 0, policy_version 38733 (0.0009) [2023-12-27 19:30:29,542][106226] Updated weights for policy 0, policy_version 38743 (0.0008) [2023-12-27 19:30:29,601][106226] Updated weights for policy 0, policy_version 38753 (0.0007) [2023-12-27 19:30:29,848][106225] Updated weights for policy 1, policy_version 38613 (0.0008) [2023-12-27 19:30:29,911][106225] Updated weights for policy 1, policy_version 38623 (0.0009) [2023-12-27 19:30:29,972][106225] Updated weights for policy 1, policy_version 38633 (0.0010) [2023-12-27 19:30:30,337][106226] Updated weights for policy 0, policy_version 38763 (0.0008) [2023-12-27 19:30:30,405][106226] Updated weights for policy 0, policy_version 38773 (0.0008) [2023-12-27 19:30:30,467][106226] Updated weights for policy 0, policy_version 38783 (0.0008) [2023-12-27 19:30:30,690][106225] Updated weights for policy 1, policy_version 38643 (0.0009) [2023-12-27 19:30:30,743][106225] Updated weights for policy 1, policy_version 38653 (0.0009) [2023-12-27 19:30:30,792][106225] Updated weights for policy 1, policy_version 38664 (0.0008) [2023-12-27 19:30:31,169][106226] Updated weights for policy 0, policy_version 38793 (0.0007) [2023-12-27 19:30:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 19841024. Throughput: 0: 9869.6, 1: 9979.4. Samples: 19833672. Policy #0 lag: (min: 28.0, avg: 35.9, max: 60.0) [2023-12-27 19:30:31,175][105115] Avg episode reward: [(0, '-5.315'), (1, '-6.791')] [2023-12-27 19:30:31,232][106226] Updated weights for policy 0, policy_version 38803 (0.0009) [2023-12-27 19:30:31,295][106226] Updated weights for policy 0, policy_version 38813 (0.0007) [2023-12-27 19:30:31,379][106226] Updated weights for policy 0, policy_version 38823 (0.0007) [2023-12-27 19:30:31,385][106225] Updated weights for policy 1, policy_version 38674 (0.0006) [2023-12-27 19:30:31,447][106225] Updated weights for policy 1, policy_version 38684 (0.0008) [2023-12-27 19:30:31,512][106225] Updated weights for policy 1, policy_version 38694 (0.0006) [2023-12-27 19:30:31,575][106225] Updated weights for policy 1, policy_version 38704 (0.0006) [2023-12-27 19:30:32,073][106226] Updated weights for policy 0, policy_version 38833 (0.0008) [2023-12-27 19:30:32,131][106226] Updated weights for policy 0, policy_version 38843 (0.0009) [2023-12-27 19:30:32,195][106226] Updated weights for policy 0, policy_version 38853 (0.0009) [2023-12-27 19:30:32,229][106225] Updated weights for policy 1, policy_version 38714 (0.0006) [2023-12-27 19:30:32,293][106225] Updated weights for policy 1, policy_version 38724 (0.0008) [2023-12-27 19:30:32,364][106225] Updated weights for policy 1, policy_version 38734 (0.0007) [2023-12-27 19:30:32,982][106226] Updated weights for policy 0, policy_version 38863 (0.0008) [2023-12-27 19:30:32,983][106225] Updated weights for policy 1, policy_version 38744 (0.0007) [2023-12-27 19:30:33,036][106225] Updated weights for policy 1, policy_version 38754 (0.0008) [2023-12-27 19:30:33,041][106226] Updated weights for policy 0, policy_version 38873 (0.0005) [2023-12-27 19:30:33,090][106225] Updated weights for policy 1, policy_version 38764 (0.0008) [2023-12-27 19:30:33,096][106226] Updated weights for policy 0, policy_version 38883 (0.0006) [2023-12-27 19:30:33,748][106226] Updated weights for policy 0, policy_version 38893 (0.0007) [2023-12-27 19:30:33,799][106226] Updated weights for policy 0, policy_version 38903 (0.0005) [2023-12-27 19:30:33,801][106225] Updated weights for policy 1, policy_version 38774 (0.0009) [2023-12-27 19:30:33,847][106225] Updated weights for policy 1, policy_version 38784 (0.0010) [2023-12-27 19:30:33,859][106226] Updated weights for policy 0, policy_version 38913 (0.0005) [2023-12-27 19:30:33,901][106225] Updated weights for policy 1, policy_version 38794 (0.0010) [2023-12-27 19:30:34,491][106226] Updated weights for policy 0, policy_version 38923 (0.0006) [2023-12-27 19:30:34,554][106226] Updated weights for policy 0, policy_version 38933 (0.0008) [2023-12-27 19:30:34,579][106225] Updated weights for policy 1, policy_version 38804 (0.0008) [2023-12-27 19:30:34,616][106226] Updated weights for policy 0, policy_version 38943 (0.0008) [2023-12-27 19:30:34,630][106225] Updated weights for policy 1, policy_version 38814 (0.0006) [2023-12-27 19:30:34,687][106225] Updated weights for policy 1, policy_version 38824 (0.0009) [2023-12-27 19:30:35,250][106226] Updated weights for policy 0, policy_version 38953 (0.0007) [2023-12-27 19:30:35,301][106226] Updated weights for policy 0, policy_version 38963 (0.0005) [2023-12-27 19:30:35,348][106226] Updated weights for policy 0, policy_version 38973 (0.0007) [2023-12-27 19:30:35,393][106226] Updated weights for policy 0, policy_version 38983 (0.0005) [2023-12-27 19:30:35,412][106225] Updated weights for policy 1, policy_version 38834 (0.0010) [2023-12-27 19:30:35,470][106225] Updated weights for policy 1, policy_version 38844 (0.0007) [2023-12-27 19:30:35,518][106225] Updated weights for policy 1, policy_version 38854 (0.0005) [2023-12-27 19:30:35,565][106225] Updated weights for policy 1, policy_version 38864 (0.0005) [2023-12-27 19:30:36,047][106226] Updated weights for policy 0, policy_version 38993 (0.0006) [2023-12-27 19:30:36,093][106226] Updated weights for policy 0, policy_version 39003 (0.0006) [2023-12-27 19:30:36,154][106225] Updated weights for policy 1, policy_version 38874 (0.0008) [2023-12-27 19:30:36,159][106226] Updated weights for policy 0, policy_version 39013 (0.0007) [2023-12-27 19:30:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 19939328. Throughput: 0: 9911.6, 1: 10002.5. Samples: 19955864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:30:36,175][105115] Avg episode reward: [(0, '-4.985'), (1, '-6.381')] [2023-12-27 19:30:36,212][106225] Updated weights for policy 1, policy_version 38884 (0.0007) [2023-12-27 19:30:36,273][106225] Updated weights for policy 1, policy_version 38894 (0.0009) [2023-12-27 19:30:36,801][106226] Updated weights for policy 0, policy_version 39023 (0.0008) [2023-12-27 19:30:36,857][106226] Updated weights for policy 0, policy_version 39033 (0.0008) [2023-12-27 19:30:36,919][106226] Updated weights for policy 0, policy_version 39043 (0.0008) [2023-12-27 19:30:37,036][106225] Updated weights for policy 1, policy_version 38904 (0.0009) [2023-12-27 19:30:37,092][106225] Updated weights for policy 1, policy_version 38914 (0.0009) [2023-12-27 19:30:37,144][106225] Updated weights for policy 1, policy_version 38924 (0.0009) [2023-12-27 19:30:37,636][106226] Updated weights for policy 0, policy_version 39053 (0.0008) [2023-12-27 19:30:37,692][106226] Updated weights for policy 0, policy_version 39063 (0.0008) [2023-12-27 19:30:37,754][106226] Updated weights for policy 0, policy_version 39073 (0.0008) [2023-12-27 19:30:37,875][106225] Updated weights for policy 1, policy_version 38934 (0.0009) [2023-12-27 19:30:37,937][106225] Updated weights for policy 1, policy_version 38944 (0.0008) [2023-12-27 19:30:37,994][106225] Updated weights for policy 1, policy_version 38954 (0.0008) [2023-12-27 19:30:38,532][106226] Updated weights for policy 0, policy_version 39083 (0.0009) [2023-12-27 19:30:38,590][106226] Updated weights for policy 0, policy_version 39093 (0.0008) [2023-12-27 19:30:38,645][106226] Updated weights for policy 0, policy_version 39103 (0.0008) [2023-12-27 19:30:38,663][106225] Updated weights for policy 1, policy_version 38964 (0.0008) [2023-12-27 19:30:38,720][106225] Updated weights for policy 1, policy_version 38974 (0.0007) [2023-12-27 19:30:38,782][106225] Updated weights for policy 1, policy_version 38984 (0.0008) [2023-12-27 19:30:39,415][106226] Updated weights for policy 0, policy_version 39113 (0.0006) [2023-12-27 19:30:39,473][106226] Updated weights for policy 0, policy_version 39123 (0.0011) [2023-12-27 19:30:39,524][106225] Updated weights for policy 1, policy_version 38994 (0.0008) [2023-12-27 19:30:39,530][106226] Updated weights for policy 0, policy_version 39133 (0.0010) [2023-12-27 19:30:39,595][106225] Updated weights for policy 1, policy_version 39004 (0.0006) [2023-12-27 19:30:39,602][106226] Updated weights for policy 0, policy_version 39143 (0.0009) [2023-12-27 19:30:39,658][106225] Updated weights for policy 1, policy_version 39014 (0.0008) [2023-12-27 19:30:39,725][106225] Updated weights for policy 1, policy_version 39024 (0.0007) [2023-12-27 19:30:40,358][106226] Updated weights for policy 0, policy_version 39153 (0.0008) [2023-12-27 19:30:40,421][106225] Updated weights for policy 1, policy_version 39034 (0.0008) [2023-12-27 19:30:40,427][106226] Updated weights for policy 0, policy_version 39163 (0.0007) [2023-12-27 19:30:40,488][106225] Updated weights for policy 1, policy_version 39044 (0.0007) [2023-12-27 19:30:40,495][106226] Updated weights for policy 0, policy_version 39173 (0.0010) [2023-12-27 19:30:40,558][106225] Updated weights for policy 1, policy_version 39054 (0.0008) [2023-12-27 19:30:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 20037632. Throughput: 0: 9926.6, 1: 9997.5. Samples: 20014576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:30:41,175][105115] Avg episode reward: [(0, '-5.535'), (1, '-6.578')] [2023-12-27 19:30:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000039056_10002432.pth... [2023-12-27 19:30:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000037904_9707520.pth [2023-12-27 19:30:41,230][106226] Updated weights for policy 0, policy_version 39183 (0.0009) [2023-12-27 19:30:41,298][106226] Updated weights for policy 0, policy_version 39193 (0.0008) [2023-12-27 19:30:41,370][106226] Updated weights for policy 0, policy_version 39203 (0.0008) [2023-12-27 19:30:41,371][106225] Updated weights for policy 1, policy_version 39064 (0.0008) [2023-12-27 19:30:41,407][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000039208_10043392.pth... [2023-12-27 19:30:41,411][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000038024_9740288.pth [2023-12-27 19:30:41,437][106225] Updated weights for policy 1, policy_version 39074 (0.0008) [2023-12-27 19:30:41,492][106225] Updated weights for policy 1, policy_version 39084 (0.0008) [2023-12-27 19:30:42,135][106226] Updated weights for policy 0, policy_version 39213 (0.0009) [2023-12-27 19:30:42,194][106226] Updated weights for policy 0, policy_version 39223 (0.0009) [2023-12-27 19:30:42,257][106226] Updated weights for policy 0, policy_version 39233 (0.0009) [2023-12-27 19:30:42,276][106225] Updated weights for policy 1, policy_version 39094 (0.0008) [2023-12-27 19:30:42,343][106225] Updated weights for policy 1, policy_version 39104 (0.0006) [2023-12-27 19:30:42,434][106225] Updated weights for policy 1, policy_version 39114 (0.0008) [2023-12-27 19:30:43,016][106226] Updated weights for policy 0, policy_version 39243 (0.0008) [2023-12-27 19:30:43,076][106226] Updated weights for policy 0, policy_version 39253 (0.0005) [2023-12-27 19:30:43,120][106225] Updated weights for policy 1, policy_version 39124 (0.0008) [2023-12-27 19:30:43,138][106226] Updated weights for policy 0, policy_version 39263 (0.0006) [2023-12-27 19:30:43,169][106225] Updated weights for policy 1, policy_version 39134 (0.0008) [2023-12-27 19:30:43,215][106225] Updated weights for policy 1, policy_version 39144 (0.0008) [2023-12-27 19:30:43,772][106226] Updated weights for policy 0, policy_version 39273 (0.0006) [2023-12-27 19:30:43,831][106226] Updated weights for policy 0, policy_version 39283 (0.0009) [2023-12-27 19:30:43,887][106226] Updated weights for policy 0, policy_version 39293 (0.0007) [2023-12-27 19:30:43,888][106225] Updated weights for policy 1, policy_version 39154 (0.0008) [2023-12-27 19:30:43,943][106226] Updated weights for policy 0, policy_version 39303 (0.0005) [2023-12-27 19:30:43,945][106225] Updated weights for policy 1, policy_version 39164 (0.0008) [2023-12-27 19:30:44,002][106225] Updated weights for policy 1, policy_version 39174 (0.0009) [2023-12-27 19:30:44,627][106226] Updated weights for policy 0, policy_version 39313 (0.0008) [2023-12-27 19:30:44,674][106226] Updated weights for policy 0, policy_version 39323 (0.0007) [2023-12-27 19:30:44,726][106226] Updated weights for policy 0, policy_version 39333 (0.0008) [2023-12-27 19:30:44,752][106225] Updated weights for policy 1, policy_version 39185 (0.0011) [2023-12-27 19:30:44,818][106225] Updated weights for policy 1, policy_version 39195 (0.0008) [2023-12-27 19:30:44,881][106225] Updated weights for policy 1, policy_version 39205 (0.0007) [2023-12-27 19:30:44,951][106225] Updated weights for policy 1, policy_version 39215 (0.0007) [2023-12-27 19:30:45,524][106226] Updated weights for policy 0, policy_version 39343 (0.0008) [2023-12-27 19:30:45,587][106226] Updated weights for policy 0, policy_version 39353 (0.0006) [2023-12-27 19:30:45,648][106226] Updated weights for policy 0, policy_version 39363 (0.0006) [2023-12-27 19:30:45,657][106225] Updated weights for policy 1, policy_version 39225 (0.0009) [2023-12-27 19:30:45,718][106225] Updated weights for policy 1, policy_version 39235 (0.0007) [2023-12-27 19:30:45,779][106225] Updated weights for policy 1, policy_version 39245 (0.0008) [2023-12-27 19:30:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 20135936. Throughput: 0: 9884.0, 1: 9885.6. Samples: 20128044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:30:46,175][105115] Avg episode reward: [(0, '-5.521'), (1, '-6.114')] [2023-12-27 19:30:46,176][106141] Saving new best policy, reward=-6.114! [2023-12-27 19:30:46,384][106226] Updated weights for policy 0, policy_version 39373 (0.0008) [2023-12-27 19:30:46,444][106225] Updated weights for policy 1, policy_version 39255 (0.0007) [2023-12-27 19:30:46,447][106226] Updated weights for policy 0, policy_version 39383 (0.0008) [2023-12-27 19:30:46,497][106225] Updated weights for policy 1, policy_version 39265 (0.0006) [2023-12-27 19:30:46,504][106226] Updated weights for policy 0, policy_version 39393 (0.0007) [2023-12-27 19:30:46,560][106225] Updated weights for policy 1, policy_version 39275 (0.0008) [2023-12-27 19:30:47,210][106226] Updated weights for policy 0, policy_version 39403 (0.0007) [2023-12-27 19:30:47,265][106226] Updated weights for policy 0, policy_version 39413 (0.0006) [2023-12-27 19:30:47,306][106225] Updated weights for policy 1, policy_version 39285 (0.0008) [2023-12-27 19:30:47,329][106226] Updated weights for policy 0, policy_version 39423 (0.0006) [2023-12-27 19:30:47,359][106225] Updated weights for policy 1, policy_version 39295 (0.0007) [2023-12-27 19:30:47,417][106225] Updated weights for policy 1, policy_version 39305 (0.0005) [2023-12-27 19:30:48,034][106226] Updated weights for policy 0, policy_version 39433 (0.0009) [2023-12-27 19:30:48,092][106226] Updated weights for policy 0, policy_version 39443 (0.0006) [2023-12-27 19:30:48,097][106225] Updated weights for policy 1, policy_version 39315 (0.0006) [2023-12-27 19:30:48,145][106226] Updated weights for policy 0, policy_version 39453 (0.0005) [2023-12-27 19:30:48,150][106225] Updated weights for policy 1, policy_version 39325 (0.0008) [2023-12-27 19:30:48,210][106226] Updated weights for policy 0, policy_version 39463 (0.0006) [2023-12-27 19:30:48,211][106225] Updated weights for policy 1, policy_version 39335 (0.0008) [2023-12-27 19:30:48,913][106226] Updated weights for policy 0, policy_version 39473 (0.0009) [2023-12-27 19:30:48,977][106226] Updated weights for policy 0, policy_version 39483 (0.0011) [2023-12-27 19:30:49,039][106226] Updated weights for policy 0, policy_version 39493 (0.0011) [2023-12-27 19:30:49,046][106225] Updated weights for policy 1, policy_version 39345 (0.0009) [2023-12-27 19:30:49,094][106225] Updated weights for policy 1, policy_version 39355 (0.0010) [2023-12-27 19:30:49,149][106225] Updated weights for policy 1, policy_version 39365 (0.0010) [2023-12-27 19:30:49,221][106225] Updated weights for policy 1, policy_version 39375 (0.0010) [2023-12-27 19:30:49,874][106226] Updated weights for policy 0, policy_version 39503 (0.0009) [2023-12-27 19:30:49,941][106226] Updated weights for policy 0, policy_version 39513 (0.0009) [2023-12-27 19:30:50,004][106226] Updated weights for policy 0, policy_version 39523 (0.0009) [2023-12-27 19:30:50,012][106225] Updated weights for policy 1, policy_version 39385 (0.0009) [2023-12-27 19:30:50,068][106225] Updated weights for policy 1, policy_version 39395 (0.0008) [2023-12-27 19:30:50,123][106225] Updated weights for policy 1, policy_version 39405 (0.0007) [2023-12-27 19:30:50,684][106226] Updated weights for policy 0, policy_version 39533 (0.0008) [2023-12-27 19:30:50,732][106226] Updated weights for policy 0, policy_version 39543 (0.0010) [2023-12-27 19:30:50,785][106226] Updated weights for policy 0, policy_version 39553 (0.0011) [2023-12-27 19:30:50,822][106225] Updated weights for policy 1, policy_version 39415 (0.0006) [2023-12-27 19:30:50,886][106225] Updated weights for policy 1, policy_version 39425 (0.0007) [2023-12-27 19:30:50,947][106225] Updated weights for policy 1, policy_version 39435 (0.0009) [2023-12-27 19:30:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 20234240. Throughput: 0: 9846.4, 1: 9775.1. Samples: 20241636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:30:51,175][105115] Avg episode reward: [(0, '-5.366'), (1, '-6.202')] [2023-12-27 19:30:51,530][106226] Updated weights for policy 0, policy_version 39563 (0.0011) [2023-12-27 19:30:51,591][106226] Updated weights for policy 0, policy_version 39573 (0.0011) [2023-12-27 19:30:51,663][106225] Updated weights for policy 1, policy_version 39445 (0.0008) [2023-12-27 19:30:51,666][106226] Updated weights for policy 0, policy_version 39583 (0.0011) [2023-12-27 19:30:51,726][106225] Updated weights for policy 1, policy_version 39455 (0.0010) [2023-12-27 19:30:51,795][106225] Updated weights for policy 1, policy_version 39465 (0.0007) [2023-12-27 19:30:52,357][106226] Updated weights for policy 0, policy_version 39593 (0.0009) [2023-12-27 19:30:52,421][106226] Updated weights for policy 0, policy_version 39603 (0.0008) [2023-12-27 19:30:52,489][106226] Updated weights for policy 0, policy_version 39613 (0.0009) [2023-12-27 19:30:52,529][106225] Updated weights for policy 1, policy_version 39475 (0.0007) [2023-12-27 19:30:52,543][106226] Updated weights for policy 0, policy_version 39623 (0.0008) [2023-12-27 19:30:52,592][106225] Updated weights for policy 1, policy_version 39485 (0.0007) [2023-12-27 19:30:52,659][106225] Updated weights for policy 1, policy_version 39495 (0.0008) [2023-12-27 19:30:53,246][106225] Updated weights for policy 1, policy_version 39505 (0.0008) [2023-12-27 19:30:53,253][106226] Updated weights for policy 0, policy_version 39633 (0.0008) [2023-12-27 19:30:53,310][106226] Updated weights for policy 0, policy_version 39643 (0.0008) [2023-12-27 19:30:53,312][106225] Updated weights for policy 1, policy_version 39515 (0.0006) [2023-12-27 19:30:53,366][106225] Updated weights for policy 1, policy_version 39525 (0.0005) [2023-12-27 19:30:53,370][106226] Updated weights for policy 0, policy_version 39653 (0.0007) [2023-12-27 19:30:53,427][106225] Updated weights for policy 1, policy_version 39535 (0.0008) [2023-12-27 19:30:54,093][106226] Updated weights for policy 0, policy_version 39663 (0.0007) [2023-12-27 19:30:54,118][106225] Updated weights for policy 1, policy_version 39545 (0.0007) [2023-12-27 19:30:54,150][106226] Updated weights for policy 0, policy_version 39673 (0.0007) [2023-12-27 19:30:54,177][106225] Updated weights for policy 1, policy_version 39555 (0.0007) [2023-12-27 19:30:54,204][106226] Updated weights for policy 0, policy_version 39683 (0.0006) [2023-12-27 19:30:54,228][106225] Updated weights for policy 1, policy_version 39565 (0.0005) [2023-12-27 19:30:54,788][106225] Updated weights for policy 1, policy_version 39575 (0.0008) [2023-12-27 19:30:54,836][106225] Updated weights for policy 1, policy_version 39585 (0.0008) [2023-12-27 19:30:54,880][106225] Updated weights for policy 1, policy_version 39595 (0.0008) [2023-12-27 19:30:54,935][106226] Updated weights for policy 0, policy_version 39693 (0.0009) [2023-12-27 19:30:54,990][106226] Updated weights for policy 0, policy_version 39703 (0.0011) [2023-12-27 19:30:55,055][106226] Updated weights for policy 0, policy_version 39713 (0.0011) [2023-12-27 19:30:55,502][106225] Updated weights for policy 1, policy_version 39605 (0.0007) [2023-12-27 19:30:55,556][106225] Updated weights for policy 1, policy_version 39615 (0.0007) [2023-12-27 19:30:55,618][106225] Updated weights for policy 1, policy_version 39625 (0.0008) [2023-12-27 19:30:55,765][106226] Updated weights for policy 0, policy_version 39723 (0.0011) [2023-12-27 19:30:55,825][106226] Updated weights for policy 0, policy_version 39733 (0.0010) [2023-12-27 19:30:55,886][106226] Updated weights for policy 0, policy_version 39743 (0.0006) [2023-12-27 19:30:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 20332544. Throughput: 0: 9811.4, 1: 9761.2. Samples: 20300360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:30:56,175][105115] Avg episode reward: [(0, '-5.541'), (1, '-7.045')] [2023-12-27 19:30:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000039632_10149888.pth... [2023-12-27 19:30:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000039752_10182656.pth... [2023-12-27 19:30:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000038480_9854976.pth [2023-12-27 19:30:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000038600_9887744.pth [2023-12-27 19:30:56,370][106225] Updated weights for policy 1, policy_version 39635 (0.0007) [2023-12-27 19:30:56,423][106225] Updated weights for policy 1, policy_version 39645 (0.0008) [2023-12-27 19:30:56,478][106225] Updated weights for policy 1, policy_version 39655 (0.0007) [2023-12-27 19:30:56,538][106226] Updated weights for policy 0, policy_version 39753 (0.0006) [2023-12-27 19:30:56,600][106226] Updated weights for policy 0, policy_version 39763 (0.0010) [2023-12-27 19:30:56,654][106226] Updated weights for policy 0, policy_version 39773 (0.0010) [2023-12-27 19:30:56,703][106226] Updated weights for policy 0, policy_version 39783 (0.0010) [2023-12-27 19:30:57,216][106225] Updated weights for policy 1, policy_version 39665 (0.0008) [2023-12-27 19:30:57,268][106225] Updated weights for policy 1, policy_version 39675 (0.0008) [2023-12-27 19:30:57,320][106225] Updated weights for policy 1, policy_version 39685 (0.0007) [2023-12-27 19:30:57,368][106225] Updated weights for policy 1, policy_version 39695 (0.0007) [2023-12-27 19:30:57,389][106226] Updated weights for policy 0, policy_version 39793 (0.0010) [2023-12-27 19:30:57,445][106226] Updated weights for policy 0, policy_version 39803 (0.0010) [2023-12-27 19:30:57,504][106226] Updated weights for policy 0, policy_version 39813 (0.0011) [2023-12-27 19:30:57,972][106225] Updated weights for policy 1, policy_version 39705 (0.0007) [2023-12-27 19:30:58,017][106225] Updated weights for policy 1, policy_version 39715 (0.0007) [2023-12-27 19:30:58,069][106225] Updated weights for policy 1, policy_version 39726 (0.0010) [2023-12-27 19:30:58,181][106226] Updated weights for policy 0, policy_version 39823 (0.0007) [2023-12-27 19:30:58,252][106226] Updated weights for policy 0, policy_version 39833 (0.0007) [2023-12-27 19:30:58,315][106226] Updated weights for policy 0, policy_version 39843 (0.0008) [2023-12-27 19:30:58,888][106225] Updated weights for policy 1, policy_version 39736 (0.0008) [2023-12-27 19:30:58,954][106225] Updated weights for policy 1, policy_version 39746 (0.0008) [2023-12-27 19:30:59,016][106225] Updated weights for policy 1, policy_version 39756 (0.0007) [2023-12-27 19:30:59,104][106226] Updated weights for policy 0, policy_version 39853 (0.0009) [2023-12-27 19:30:59,171][106226] Updated weights for policy 0, policy_version 39863 (0.0010) [2023-12-27 19:30:59,240][106226] Updated weights for policy 0, policy_version 39873 (0.0008) [2023-12-27 19:30:59,783][106225] Updated weights for policy 1, policy_version 39766 (0.0008) [2023-12-27 19:30:59,852][106225] Updated weights for policy 1, policy_version 39776 (0.0008) [2023-12-27 19:30:59,878][106226] Updated weights for policy 0, policy_version 39883 (0.0008) [2023-12-27 19:30:59,908][106225] Updated weights for policy 1, policy_version 39786 (0.0006) [2023-12-27 19:30:59,946][106226] Updated weights for policy 0, policy_version 39893 (0.0007) [2023-12-27 19:31:00,007][106226] Updated weights for policy 0, policy_version 39903 (0.0007) [2023-12-27 19:31:00,682][106225] Updated weights for policy 1, policy_version 39796 (0.0008) [2023-12-27 19:31:00,709][106226] Updated weights for policy 0, policy_version 39913 (0.0006) [2023-12-27 19:31:00,742][106225] Updated weights for policy 1, policy_version 39806 (0.0007) [2023-12-27 19:31:00,770][106226] Updated weights for policy 0, policy_version 39923 (0.0007) [2023-12-27 19:31:00,789][106225] Updated weights for policy 1, policy_version 39816 (0.0008) [2023-12-27 19:31:00,828][106226] Updated weights for policy 0, policy_version 39933 (0.0008) [2023-12-27 19:31:00,888][106226] Updated weights for policy 0, policy_version 39943 (0.0009) [2023-12-27 19:31:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 20430848. Throughput: 0: 9841.2, 1: 9804.9. Samples: 20419332. Policy #0 lag: (min: 3.0, avg: 11.1, max: 35.0) [2023-12-27 19:31:01,175][105115] Avg episode reward: [(0, '-5.329'), (1, '-6.394')] [2023-12-27 19:31:01,507][106225] Updated weights for policy 1, policy_version 39826 (0.0006) [2023-12-27 19:31:01,562][106225] Updated weights for policy 1, policy_version 39836 (0.0008) [2023-12-27 19:31:01,614][106225] Updated weights for policy 1, policy_version 39846 (0.0007) [2023-12-27 19:31:01,621][106226] Updated weights for policy 0, policy_version 39953 (0.0007) [2023-12-27 19:31:01,678][106225] Updated weights for policy 1, policy_version 39856 (0.0008) [2023-12-27 19:31:01,683][106226] Updated weights for policy 0, policy_version 39963 (0.0008) [2023-12-27 19:31:01,745][106226] Updated weights for policy 0, policy_version 39973 (0.0009) [2023-12-27 19:31:02,383][106225] Updated weights for policy 1, policy_version 39866 (0.0009) [2023-12-27 19:31:02,435][106225] Updated weights for policy 1, policy_version 39876 (0.0007) [2023-12-27 19:31:02,496][106225] Updated weights for policy 1, policy_version 39886 (0.0005) [2023-12-27 19:31:02,544][106226] Updated weights for policy 0, policy_version 39983 (0.0009) [2023-12-27 19:31:02,609][106226] Updated weights for policy 0, policy_version 39993 (0.0010) [2023-12-27 19:31:02,668][106226] Updated weights for policy 0, policy_version 40003 (0.0008) [2023-12-27 19:31:03,156][106225] Updated weights for policy 1, policy_version 39896 (0.0006) [2023-12-27 19:31:03,211][106225] Updated weights for policy 1, policy_version 39906 (0.0007) [2023-12-27 19:31:03,269][106225] Updated weights for policy 1, policy_version 39916 (0.0009) [2023-12-27 19:31:03,350][106226] Updated weights for policy 0, policy_version 40013 (0.0007) [2023-12-27 19:31:03,401][106226] Updated weights for policy 0, policy_version 40023 (0.0008) [2023-12-27 19:31:03,455][106226] Updated weights for policy 0, policy_version 40033 (0.0008) [2023-12-27 19:31:04,016][106225] Updated weights for policy 1, policy_version 39926 (0.0009) [2023-12-27 19:31:04,073][106225] Updated weights for policy 1, policy_version 39936 (0.0009) [2023-12-27 19:31:04,136][106225] Updated weights for policy 1, policy_version 39946 (0.0008) [2023-12-27 19:31:04,178][106226] Updated weights for policy 0, policy_version 40043 (0.0008) [2023-12-27 19:31:04,240][106226] Updated weights for policy 0, policy_version 40053 (0.0009) [2023-12-27 19:31:04,303][106226] Updated weights for policy 0, policy_version 40063 (0.0009) [2023-12-27 19:31:04,894][106225] Updated weights for policy 1, policy_version 39956 (0.0009) [2023-12-27 19:31:04,960][106225] Updated weights for policy 1, policy_version 39966 (0.0009) [2023-12-27 19:31:05,019][106226] Updated weights for policy 0, policy_version 40073 (0.0008) [2023-12-27 19:31:05,022][106225] Updated weights for policy 1, policy_version 39976 (0.0008) [2023-12-27 19:31:05,079][106226] Updated weights for policy 0, policy_version 40083 (0.0008) [2023-12-27 19:31:05,134][106226] Updated weights for policy 0, policy_version 40093 (0.0008) [2023-12-27 19:31:05,184][106226] Updated weights for policy 0, policy_version 40103 (0.0007) [2023-12-27 19:31:05,746][106225] Updated weights for policy 1, policy_version 39986 (0.0008) [2023-12-27 19:31:05,796][106225] Updated weights for policy 1, policy_version 39996 (0.0008) [2023-12-27 19:31:05,844][106225] Updated weights for policy 1, policy_version 40006 (0.0008) [2023-12-27 19:31:05,890][106226] Updated weights for policy 0, policy_version 40113 (0.0008) [2023-12-27 19:31:05,898][106225] Updated weights for policy 1, policy_version 40016 (0.0009) [2023-12-27 19:31:05,936][106226] Updated weights for policy 0, policy_version 40123 (0.0008) [2023-12-27 19:31:05,985][106226] Updated weights for policy 0, policy_version 40133 (0.0008) [2023-12-27 19:31:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 20529152. Throughput: 0: 9817.4, 1: 9770.4. Samples: 20535420. Policy #0 lag: (min: 3.0, avg: 11.1, max: 35.0) [2023-12-27 19:31:06,175][105115] Avg episode reward: [(0, '-5.102'), (1, '-6.827')] [2023-12-27 19:31:06,645][106225] Updated weights for policy 1, policy_version 40026 (0.0006) [2023-12-27 19:31:06,699][106225] Updated weights for policy 1, policy_version 40036 (0.0007) [2023-12-27 19:31:06,735][106226] Updated weights for policy 0, policy_version 40143 (0.0007) [2023-12-27 19:31:06,748][106225] Updated weights for policy 1, policy_version 40046 (0.0007) [2023-12-27 19:31:06,798][106226] Updated weights for policy 0, policy_version 40153 (0.0008) [2023-12-27 19:31:06,849][106226] Updated weights for policy 0, policy_version 40163 (0.0009) [2023-12-27 19:31:07,324][106225] Updated weights for policy 1, policy_version 40056 (0.0006) [2023-12-27 19:31:07,390][106225] Updated weights for policy 1, policy_version 40066 (0.0005) [2023-12-27 19:31:07,456][106225] Updated weights for policy 1, policy_version 40076 (0.0006) [2023-12-27 19:31:07,632][106226] Updated weights for policy 0, policy_version 40173 (0.0008) [2023-12-27 19:31:07,676][106226] Updated weights for policy 0, policy_version 40183 (0.0007) [2023-12-27 19:31:07,741][106226] Updated weights for policy 0, policy_version 40193 (0.0010) [2023-12-27 19:31:07,978][106225] Updated weights for policy 1, policy_version 40086 (0.0005) [2023-12-27 19:31:08,029][106225] Updated weights for policy 1, policy_version 40096 (0.0009) [2023-12-27 19:31:08,079][106225] Updated weights for policy 1, policy_version 40106 (0.0010) [2023-12-27 19:31:08,323][106226] Updated weights for policy 0, policy_version 40203 (0.0009) [2023-12-27 19:31:08,389][106226] Updated weights for policy 0, policy_version 40213 (0.0008) [2023-12-27 19:31:08,450][106226] Updated weights for policy 0, policy_version 40223 (0.0008) [2023-12-27 19:31:08,795][106225] Updated weights for policy 1, policy_version 40116 (0.0009) [2023-12-27 19:31:08,848][106225] Updated weights for policy 1, policy_version 40126 (0.0009) [2023-12-27 19:31:08,902][106225] Updated weights for policy 1, policy_version 40136 (0.0009) [2023-12-27 19:31:09,094][106226] Updated weights for policy 0, policy_version 40233 (0.0008) [2023-12-27 19:31:09,143][106226] Updated weights for policy 0, policy_version 40243 (0.0005) [2023-12-27 19:31:09,207][106226] Updated weights for policy 0, policy_version 40253 (0.0005) [2023-12-27 19:31:09,282][106226] Updated weights for policy 0, policy_version 40263 (0.0008) [2023-12-27 19:31:09,597][106225] Updated weights for policy 1, policy_version 40146 (0.0008) [2023-12-27 19:31:09,665][106225] Updated weights for policy 1, policy_version 40156 (0.0005) [2023-12-27 19:31:09,732][106225] Updated weights for policy 1, policy_version 40166 (0.0006) [2023-12-27 19:31:09,801][106225] Updated weights for policy 1, policy_version 40176 (0.0007) [2023-12-27 19:31:10,035][106226] Updated weights for policy 0, policy_version 40273 (0.0008) [2023-12-27 19:31:10,084][106226] Updated weights for policy 0, policy_version 40283 (0.0008) [2023-12-27 19:31:10,146][106226] Updated weights for policy 0, policy_version 40293 (0.0008) [2023-12-27 19:31:10,500][106225] Updated weights for policy 1, policy_version 40186 (0.0007) [2023-12-27 19:31:10,562][106225] Updated weights for policy 1, policy_version 40196 (0.0008) [2023-12-27 19:31:10,626][106225] Updated weights for policy 1, policy_version 40206 (0.0010) [2023-12-27 19:31:10,769][106226] Updated weights for policy 0, policy_version 40303 (0.0007) [2023-12-27 19:31:10,831][106226] Updated weights for policy 0, policy_version 40313 (0.0009) [2023-12-27 19:31:10,889][106226] Updated weights for policy 0, policy_version 40323 (0.0009) [2023-12-27 19:31:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 20627456. Throughput: 0: 9836.2, 1: 9857.9. Samples: 20598052. Policy #0 lag: (min: 3.0, avg: 11.1, max: 35.0) [2023-12-27 19:31:11,175][105115] Avg episode reward: [(0, '-5.402'), (1, '-6.386')] [2023-12-27 19:31:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000040208_10297344.pth... [2023-12-27 19:31:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000040328_10330112.pth... [2023-12-27 19:31:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000039056_10002432.pth [2023-12-27 19:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000039208_10043392.pth [2023-12-27 19:31:11,375][106225] Updated weights for policy 1, policy_version 40216 (0.0008) [2023-12-27 19:31:11,440][106225] Updated weights for policy 1, policy_version 40226 (0.0008) [2023-12-27 19:31:11,508][106225] Updated weights for policy 1, policy_version 40236 (0.0009) [2023-12-27 19:31:11,643][106226] Updated weights for policy 0, policy_version 40333 (0.0009) [2023-12-27 19:31:11,710][106226] Updated weights for policy 0, policy_version 40343 (0.0007) [2023-12-27 19:31:11,788][106226] Updated weights for policy 0, policy_version 40353 (0.0008) [2023-12-27 19:31:12,223][106225] Updated weights for policy 1, policy_version 40246 (0.0008) [2023-12-27 19:31:12,286][106225] Updated weights for policy 1, policy_version 40256 (0.0009) [2023-12-27 19:31:12,348][106225] Updated weights for policy 1, policy_version 40266 (0.0008) [2023-12-27 19:31:12,543][106226] Updated weights for policy 0, policy_version 40363 (0.0009) [2023-12-27 19:31:12,609][106226] Updated weights for policy 0, policy_version 40373 (0.0010) [2023-12-27 19:31:12,668][106226] Updated weights for policy 0, policy_version 40383 (0.0009) [2023-12-27 19:31:13,028][106225] Updated weights for policy 1, policy_version 40276 (0.0008) [2023-12-27 19:31:13,091][106225] Updated weights for policy 1, policy_version 40286 (0.0007) [2023-12-27 19:31:13,161][106225] Updated weights for policy 1, policy_version 40296 (0.0005) [2023-12-27 19:31:13,397][106226] Updated weights for policy 0, policy_version 40393 (0.0009) [2023-12-27 19:31:13,451][106226] Updated weights for policy 0, policy_version 40403 (0.0008) [2023-12-27 19:31:13,510][106226] Updated weights for policy 0, policy_version 40413 (0.0008) [2023-12-27 19:31:13,563][106226] Updated weights for policy 0, policy_version 40423 (0.0007) [2023-12-27 19:31:13,832][106225] Updated weights for policy 1, policy_version 40306 (0.0007) [2023-12-27 19:31:13,878][106225] Updated weights for policy 1, policy_version 40316 (0.0010) [2023-12-27 19:31:13,931][106225] Updated weights for policy 1, policy_version 40326 (0.0010) [2023-12-27 19:31:13,981][106225] Updated weights for policy 1, policy_version 40336 (0.0010) [2023-12-27 19:31:14,232][106226] Updated weights for policy 0, policy_version 40433 (0.0006) [2023-12-27 19:31:14,295][106226] Updated weights for policy 0, policy_version 40443 (0.0006) [2023-12-27 19:31:14,351][106226] Updated weights for policy 0, policy_version 40453 (0.0008) [2023-12-27 19:31:14,726][106225] Updated weights for policy 1, policy_version 40346 (0.0010) [2023-12-27 19:31:14,783][106225] Updated weights for policy 1, policy_version 40356 (0.0009) [2023-12-27 19:31:14,848][106225] Updated weights for policy 1, policy_version 40366 (0.0009) [2023-12-27 19:31:15,012][106226] Updated weights for policy 0, policy_version 40463 (0.0008) [2023-12-27 19:31:15,080][106226] Updated weights for policy 0, policy_version 40473 (0.0008) [2023-12-27 19:31:15,145][106226] Updated weights for policy 0, policy_version 40483 (0.0008) [2023-12-27 19:31:15,614][106225] Updated weights for policy 1, policy_version 40376 (0.0011) [2023-12-27 19:31:15,684][106225] Updated weights for policy 1, policy_version 40386 (0.0010) [2023-12-27 19:31:15,745][106225] Updated weights for policy 1, policy_version 40396 (0.0006) [2023-12-27 19:31:15,909][106226] Updated weights for policy 0, policy_version 40493 (0.0009) [2023-12-27 19:31:15,979][106226] Updated weights for policy 0, policy_version 40503 (0.0010) [2023-12-27 19:31:16,039][106226] Updated weights for policy 0, policy_version 40513 (0.0009) [2023-12-27 19:31:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 20725760. Throughput: 0: 9726.2, 1: 9865.8. Samples: 20715312. Policy #0 lag: (min: 3.0, avg: 11.1, max: 35.0) [2023-12-27 19:31:16,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-6.399')] [2023-12-27 19:31:16,301][106225] Updated weights for policy 1, policy_version 40406 (0.0009) [2023-12-27 19:31:16,348][106225] Updated weights for policy 1, policy_version 40416 (0.0010) [2023-12-27 19:31:16,395][106225] Updated weights for policy 1, policy_version 40426 (0.0010) [2023-12-27 19:31:16,803][106226] Updated weights for policy 0, policy_version 40523 (0.0009) [2023-12-27 19:31:16,853][106226] Updated weights for policy 0, policy_version 40533 (0.0009) [2023-12-27 19:31:16,903][106226] Updated weights for policy 0, policy_version 40543 (0.0009) [2023-12-27 19:31:17,031][106225] Updated weights for policy 1, policy_version 40436 (0.0008) [2023-12-27 19:31:17,082][106225] Updated weights for policy 1, policy_version 40446 (0.0005) [2023-12-27 19:31:17,134][106225] Updated weights for policy 1, policy_version 40456 (0.0008) [2023-12-27 19:31:17,627][106226] Updated weights for policy 0, policy_version 40553 (0.0009) [2023-12-27 19:31:17,667][106225] Updated weights for policy 1, policy_version 40466 (0.0009) [2023-12-27 19:31:17,693][106226] Updated weights for policy 0, policy_version 40563 (0.0005) [2023-12-27 19:31:17,718][106225] Updated weights for policy 1, policy_version 40476 (0.0006) [2023-12-27 19:31:17,754][106226] Updated weights for policy 0, policy_version 40573 (0.0007) [2023-12-27 19:31:17,767][106225] Updated weights for policy 1, policy_version 40486 (0.0005) [2023-12-27 19:31:17,812][106226] Updated weights for policy 0, policy_version 40583 (0.0008) [2023-12-27 19:31:17,820][106225] Updated weights for policy 1, policy_version 40496 (0.0008) [2023-12-27 19:31:18,334][106226] Updated weights for policy 0, policy_version 40593 (0.0007) [2023-12-27 19:31:18,396][106226] Updated weights for policy 0, policy_version 40603 (0.0007) [2023-12-27 19:31:18,465][106226] Updated weights for policy 0, policy_version 40613 (0.0008) [2023-12-27 19:31:18,508][106225] Updated weights for policy 1, policy_version 40506 (0.0010) [2023-12-27 19:31:18,555][106225] Updated weights for policy 1, policy_version 40516 (0.0010) [2023-12-27 19:31:18,606][106225] Updated weights for policy 1, policy_version 40526 (0.0010) [2023-12-27 19:31:19,095][106226] Updated weights for policy 0, policy_version 40623 (0.0011) [2023-12-27 19:31:19,142][106226] Updated weights for policy 0, policy_version 40633 (0.0010) [2023-12-27 19:31:19,188][106226] Updated weights for policy 0, policy_version 40643 (0.0010) [2023-12-27 19:31:19,300][106225] Updated weights for policy 1, policy_version 40536 (0.0008) [2023-12-27 19:31:19,366][106225] Updated weights for policy 1, policy_version 40546 (0.0009) [2023-12-27 19:31:19,435][106225] Updated weights for policy 1, policy_version 40556 (0.0008) [2023-12-27 19:31:20,022][106226] Updated weights for policy 0, policy_version 40653 (0.0009) [2023-12-27 19:31:20,082][106226] Updated weights for policy 0, policy_version 40663 (0.0009) [2023-12-27 19:31:20,116][106225] Updated weights for policy 1, policy_version 40566 (0.0006) [2023-12-27 19:31:20,145][106226] Updated weights for policy 0, policy_version 40673 (0.0007) [2023-12-27 19:31:20,168][106225] Updated weights for policy 1, policy_version 40576 (0.0008) [2023-12-27 19:31:20,227][106225] Updated weights for policy 1, policy_version 40586 (0.0008) [2023-12-27 19:31:20,902][106226] Updated weights for policy 0, policy_version 40683 (0.0008) [2023-12-27 19:31:20,970][106226] Updated weights for policy 0, policy_version 40693 (0.0006) [2023-12-27 19:31:20,970][106225] Updated weights for policy 1, policy_version 40596 (0.0009) [2023-12-27 19:31:21,036][106226] Updated weights for policy 0, policy_version 40703 (0.0007) [2023-12-27 19:31:21,038][106225] Updated weights for policy 1, policy_version 40606 (0.0009) [2023-12-27 19:31:21,105][106225] Updated weights for policy 1, policy_version 40616 (0.0008) [2023-12-27 19:31:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 20832256. Throughput: 0: 9676.5, 1: 9894.1. Samples: 20836544. Policy #0 lag: (min: 3.0, avg: 11.1, max: 35.0) [2023-12-27 19:31:21,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-6.537')] [2023-12-27 19:31:21,654][106226] Updated weights for policy 0, policy_version 40713 (0.0007) [2023-12-27 19:31:21,724][106226] Updated weights for policy 0, policy_version 40723 (0.0009) [2023-12-27 19:31:21,791][106226] Updated weights for policy 0, policy_version 40733 (0.0007) [2023-12-27 19:31:21,853][106226] Updated weights for policy 0, policy_version 40743 (0.0007) [2023-12-27 19:31:21,891][106225] Updated weights for policy 1, policy_version 40626 (0.0008) [2023-12-27 19:31:21,957][106225] Updated weights for policy 1, policy_version 40636 (0.0008) [2023-12-27 19:31:22,009][106225] Updated weights for policy 1, policy_version 40646 (0.0008) [2023-12-27 19:31:22,065][106225] Updated weights for policy 1, policy_version 40656 (0.0008) [2023-12-27 19:31:22,589][106226] Updated weights for policy 0, policy_version 40753 (0.0009) [2023-12-27 19:31:22,653][106226] Updated weights for policy 0, policy_version 40763 (0.0008) [2023-12-27 19:31:22,718][106226] Updated weights for policy 0, policy_version 40773 (0.0007) [2023-12-27 19:31:22,827][106225] Updated weights for policy 1, policy_version 40666 (0.0007) [2023-12-27 19:31:22,893][106225] Updated weights for policy 1, policy_version 40676 (0.0009) [2023-12-27 19:31:22,962][106225] Updated weights for policy 1, policy_version 40686 (0.0007) [2023-12-27 19:31:23,336][106226] Updated weights for policy 0, policy_version 40783 (0.0006) [2023-12-27 19:31:23,393][106226] Updated weights for policy 0, policy_version 40793 (0.0005) [2023-12-27 19:31:23,443][106226] Updated weights for policy 0, policy_version 40803 (0.0006) [2023-12-27 19:31:23,636][106225] Updated weights for policy 1, policy_version 40696 (0.0007) [2023-12-27 19:31:23,692][106225] Updated weights for policy 1, policy_version 40706 (0.0008) [2023-12-27 19:31:23,750][106225] Updated weights for policy 1, policy_version 40716 (0.0007) [2023-12-27 19:31:24,091][106226] Updated weights for policy 0, policy_version 40813 (0.0005) [2023-12-27 19:31:24,139][106226] Updated weights for policy 0, policy_version 40823 (0.0005) [2023-12-27 19:31:24,185][106226] Updated weights for policy 0, policy_version 40833 (0.0007) [2023-12-27 19:31:24,493][106225] Updated weights for policy 1, policy_version 40726 (0.0008) [2023-12-27 19:31:24,558][106225] Updated weights for policy 1, policy_version 40736 (0.0008) [2023-12-27 19:31:24,612][106225] Updated weights for policy 1, policy_version 40746 (0.0009) [2023-12-27 19:31:24,816][106226] Updated weights for policy 0, policy_version 40843 (0.0008) [2023-12-27 19:31:24,866][106226] Updated weights for policy 0, policy_version 40853 (0.0008) [2023-12-27 19:31:24,912][106226] Updated weights for policy 0, policy_version 40863 (0.0008) [2023-12-27 19:31:25,368][106225] Updated weights for policy 1, policy_version 40756 (0.0008) [2023-12-27 19:31:25,417][106225] Updated weights for policy 1, policy_version 40766 (0.0007) [2023-12-27 19:31:25,468][106225] Updated weights for policy 1, policy_version 40776 (0.0008) [2023-12-27 19:31:25,620][106226] Updated weights for policy 0, policy_version 40873 (0.0010) [2023-12-27 19:31:25,686][106226] Updated weights for policy 0, policy_version 40883 (0.0010) [2023-12-27 19:31:25,750][106226] Updated weights for policy 0, policy_version 40893 (0.0009) [2023-12-27 19:31:25,801][106226] Updated weights for policy 0, policy_version 40903 (0.0011) [2023-12-27 19:31:26,149][106225] Updated weights for policy 1, policy_version 40786 (0.0007) [2023-12-27 19:31:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 20922368. Throughput: 0: 9719.1, 1: 9840.0. Samples: 20894740. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:26,176][105115] Avg episode reward: [(0, '-5.246'), (1, '-6.845')] [2023-12-27 19:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000040904_10477568.pth... [2023-12-27 19:31:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000039752_10182656.pth [2023-12-27 19:31:26,212][106225] Updated weights for policy 1, policy_version 40796 (0.0006) [2023-12-27 19:31:26,271][106225] Updated weights for policy 1, policy_version 40806 (0.0008) [2023-12-27 19:31:26,330][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000040816_10452992.pth... [2023-12-27 19:31:26,332][106225] Updated weights for policy 1, policy_version 40816 (0.0009) [2023-12-27 19:31:26,335][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000039632_10149888.pth [2023-12-27 19:31:26,476][106226] Updated weights for policy 0, policy_version 40913 (0.0011) [2023-12-27 19:31:26,533][106226] Updated weights for policy 0, policy_version 40923 (0.0010) [2023-12-27 19:31:26,592][106226] Updated weights for policy 0, policy_version 40933 (0.0010) [2023-12-27 19:31:26,966][106225] Updated weights for policy 1, policy_version 40826 (0.0007) [2023-12-27 19:31:27,025][106225] Updated weights for policy 1, policy_version 40836 (0.0008) [2023-12-27 19:31:27,089][106225] Updated weights for policy 1, policy_version 40846 (0.0007) [2023-12-27 19:31:27,269][106226] Updated weights for policy 0, policy_version 40943 (0.0009) [2023-12-27 19:31:27,335][106226] Updated weights for policy 0, policy_version 40953 (0.0008) [2023-12-27 19:31:27,397][106226] Updated weights for policy 0, policy_version 40963 (0.0008) [2023-12-27 19:31:27,748][106225] Updated weights for policy 1, policy_version 40856 (0.0008) [2023-12-27 19:31:27,802][106225] Updated weights for policy 1, policy_version 40866 (0.0008) [2023-12-27 19:31:27,847][106225] Updated weights for policy 1, policy_version 40876 (0.0008) [2023-12-27 19:31:28,016][106226] Updated weights for policy 0, policy_version 40973 (0.0006) [2023-12-27 19:31:28,075][106226] Updated weights for policy 0, policy_version 40983 (0.0008) [2023-12-27 19:31:28,138][106226] Updated weights for policy 0, policy_version 40993 (0.0008) [2023-12-27 19:31:28,621][106225] Updated weights for policy 1, policy_version 40886 (0.0010) [2023-12-27 19:31:28,678][106225] Updated weights for policy 1, policy_version 40896 (0.0010) [2023-12-27 19:31:28,737][106225] Updated weights for policy 1, policy_version 40906 (0.0010) [2023-12-27 19:31:28,846][106226] Updated weights for policy 0, policy_version 41003 (0.0010) [2023-12-27 19:31:28,905][106226] Updated weights for policy 0, policy_version 41013 (0.0008) [2023-12-27 19:31:28,972][106226] Updated weights for policy 0, policy_version 41023 (0.0008) [2023-12-27 19:31:29,439][106225] Updated weights for policy 1, policy_version 40916 (0.0010) [2023-12-27 19:31:29,504][106225] Updated weights for policy 1, policy_version 40926 (0.0010) [2023-12-27 19:31:29,564][106225] Updated weights for policy 1, policy_version 40936 (0.0011) [2023-12-27 19:31:29,644][106226] Updated weights for policy 0, policy_version 41033 (0.0007) [2023-12-27 19:31:29,693][106226] Updated weights for policy 0, policy_version 41043 (0.0008) [2023-12-27 19:31:29,752][106226] Updated weights for policy 0, policy_version 41053 (0.0008) [2023-12-27 19:31:29,807][106226] Updated weights for policy 0, policy_version 41063 (0.0008) [2023-12-27 19:31:30,306][106225] Updated weights for policy 1, policy_version 40946 (0.0009) [2023-12-27 19:31:30,374][106225] Updated weights for policy 1, policy_version 40956 (0.0007) [2023-12-27 19:31:30,436][106225] Updated weights for policy 1, policy_version 40966 (0.0008) [2023-12-27 19:31:30,504][106225] Updated weights for policy 1, policy_version 40976 (0.0007) [2023-12-27 19:31:30,568][106226] Updated weights for policy 0, policy_version 41073 (0.0008) [2023-12-27 19:31:30,634][106226] Updated weights for policy 0, policy_version 41083 (0.0008) [2023-12-27 19:31:30,702][106226] Updated weights for policy 0, policy_version 41093 (0.0008) [2023-12-27 19:31:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 21020672. Throughput: 0: 9804.7, 1: 9897.1. Samples: 21014624. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:31,175][105115] Avg episode reward: [(0, '-5.450'), (1, '-6.216')] [2023-12-27 19:31:31,284][106225] Updated weights for policy 1, policy_version 40986 (0.0008) [2023-12-27 19:31:31,356][106225] Updated weights for policy 1, policy_version 40996 (0.0009) [2023-12-27 19:31:31,419][106225] Updated weights for policy 1, policy_version 41006 (0.0009) [2023-12-27 19:31:31,451][106226] Updated weights for policy 0, policy_version 41103 (0.0008) [2023-12-27 19:31:31,509][106226] Updated weights for policy 0, policy_version 41113 (0.0009) [2023-12-27 19:31:31,561][106226] Updated weights for policy 0, policy_version 41123 (0.0008) [2023-12-27 19:31:32,115][106225] Updated weights for policy 1, policy_version 41016 (0.0008) [2023-12-27 19:31:32,180][106225] Updated weights for policy 1, policy_version 41026 (0.0009) [2023-12-27 19:31:32,244][106225] Updated weights for policy 1, policy_version 41036 (0.0008) [2023-12-27 19:31:32,369][106226] Updated weights for policy 0, policy_version 41133 (0.0008) [2023-12-27 19:31:32,431][106226] Updated weights for policy 0, policy_version 41143 (0.0009) [2023-12-27 19:31:32,485][106226] Updated weights for policy 0, policy_version 41153 (0.0008) [2023-12-27 19:31:32,863][106225] Updated weights for policy 1, policy_version 41046 (0.0008) [2023-12-27 19:31:32,925][106225] Updated weights for policy 1, policy_version 41056 (0.0008) [2023-12-27 19:31:32,987][106225] Updated weights for policy 1, policy_version 41066 (0.0010) [2023-12-27 19:31:33,243][106226] Updated weights for policy 0, policy_version 41163 (0.0008) [2023-12-27 19:31:33,309][106226] Updated weights for policy 0, policy_version 41173 (0.0007) [2023-12-27 19:31:33,362][106226] Updated weights for policy 0, policy_version 41183 (0.0008) [2023-12-27 19:31:33,651][106225] Updated weights for policy 1, policy_version 41076 (0.0008) [2023-12-27 19:31:33,704][106225] Updated weights for policy 1, policy_version 41086 (0.0008) [2023-12-27 19:31:33,757][106225] Updated weights for policy 1, policy_version 41096 (0.0009) [2023-12-27 19:31:33,948][106226] Updated weights for policy 0, policy_version 41193 (0.0007) [2023-12-27 19:31:33,998][106226] Updated weights for policy 0, policy_version 41203 (0.0005) [2023-12-27 19:31:34,051][106226] Updated weights for policy 0, policy_version 41213 (0.0005) [2023-12-27 19:31:34,109][106226] Updated weights for policy 0, policy_version 41223 (0.0006) [2023-12-27 19:31:34,437][106225] Updated weights for policy 1, policy_version 41106 (0.0007) [2023-12-27 19:31:34,497][106225] Updated weights for policy 1, policy_version 41116 (0.0008) [2023-12-27 19:31:34,558][106225] Updated weights for policy 1, policy_version 41126 (0.0009) [2023-12-27 19:31:34,617][106225] Updated weights for policy 1, policy_version 41136 (0.0008) [2023-12-27 19:31:34,810][106226] Updated weights for policy 0, policy_version 41233 (0.0010) [2023-12-27 19:31:34,870][106226] Updated weights for policy 0, policy_version 41243 (0.0008) [2023-12-27 19:31:34,939][106226] Updated weights for policy 0, policy_version 41253 (0.0010) [2023-12-27 19:31:35,269][106225] Updated weights for policy 1, policy_version 41146 (0.0009) [2023-12-27 19:31:35,327][106225] Updated weights for policy 1, policy_version 41156 (0.0008) [2023-12-27 19:31:35,373][106225] Updated weights for policy 1, policy_version 41166 (0.0008) [2023-12-27 19:31:35,710][106226] Updated weights for policy 0, policy_version 41263 (0.0009) [2023-12-27 19:31:35,772][106226] Updated weights for policy 0, policy_version 41273 (0.0009) [2023-12-27 19:31:35,838][106226] Updated weights for policy 0, policy_version 41283 (0.0009) [2023-12-27 19:31:36,062][106225] Updated weights for policy 1, policy_version 41176 (0.0006) [2023-12-27 19:31:36,119][106225] Updated weights for policy 1, policy_version 41186 (0.0006) [2023-12-27 19:31:36,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 21118976. Throughput: 0: 9829.3, 1: 9955.3. Samples: 21131940. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:36,175][105115] Avg episode reward: [(0, '-5.349'), (1, '-6.085')] [2023-12-27 19:31:36,178][106225] Updated weights for policy 1, policy_version 41196 (0.0008) [2023-12-27 19:31:36,198][106141] Saving new best policy, reward=-6.085! [2023-12-27 19:31:36,612][106226] Updated weights for policy 0, policy_version 41293 (0.0008) [2023-12-27 19:31:36,671][106226] Updated weights for policy 0, policy_version 41303 (0.0007) [2023-12-27 19:31:36,734][106226] Updated weights for policy 0, policy_version 41313 (0.0007) [2023-12-27 19:31:36,940][106225] Updated weights for policy 1, policy_version 41206 (0.0008) [2023-12-27 19:31:37,000][106225] Updated weights for policy 1, policy_version 41216 (0.0008) [2023-12-27 19:31:37,059][106225] Updated weights for policy 1, policy_version 41226 (0.0008) [2023-12-27 19:31:37,369][106226] Updated weights for policy 0, policy_version 41323 (0.0011) [2023-12-27 19:31:37,428][106226] Updated weights for policy 0, policy_version 41333 (0.0011) [2023-12-27 19:31:37,482][106226] Updated weights for policy 0, policy_version 41343 (0.0008) [2023-12-27 19:31:37,763][106225] Updated weights for policy 1, policy_version 41236 (0.0008) [2023-12-27 19:31:37,827][106225] Updated weights for policy 1, policy_version 41246 (0.0008) [2023-12-27 19:31:37,892][106225] Updated weights for policy 1, policy_version 41256 (0.0007) [2023-12-27 19:31:38,142][106226] Updated weights for policy 0, policy_version 41353 (0.0009) [2023-12-27 19:31:38,205][106226] Updated weights for policy 0, policy_version 41363 (0.0007) [2023-12-27 19:31:38,261][106226] Updated weights for policy 0, policy_version 41373 (0.0011) [2023-12-27 19:31:38,313][106226] Updated weights for policy 0, policy_version 41383 (0.0008) [2023-12-27 19:31:38,535][106225] Updated weights for policy 1, policy_version 41266 (0.0010) [2023-12-27 19:31:38,597][106225] Updated weights for policy 1, policy_version 41276 (0.0007) [2023-12-27 19:31:38,661][106225] Updated weights for policy 1, policy_version 41286 (0.0008) [2023-12-27 19:31:38,720][106225] Updated weights for policy 1, policy_version 41296 (0.0007) [2023-12-27 19:31:38,915][106226] Updated weights for policy 0, policy_version 41393 (0.0006) [2023-12-27 19:31:38,969][106226] Updated weights for policy 0, policy_version 41403 (0.0010) [2023-12-27 19:31:39,025][106226] Updated weights for policy 0, policy_version 41413 (0.0010) [2023-12-27 19:31:39,360][106225] Updated weights for policy 1, policy_version 41306 (0.0009) [2023-12-27 19:31:39,435][106225] Updated weights for policy 1, policy_version 41316 (0.0008) [2023-12-27 19:31:39,498][106225] Updated weights for policy 1, policy_version 41326 (0.0011) [2023-12-27 19:31:39,785][106226] Updated weights for policy 0, policy_version 41423 (0.0009) [2023-12-27 19:31:39,858][106226] Updated weights for policy 0, policy_version 41433 (0.0010) [2023-12-27 19:31:39,924][106226] Updated weights for policy 0, policy_version 41443 (0.0010) [2023-12-27 19:31:40,243][106225] Updated weights for policy 1, policy_version 41336 (0.0011) [2023-12-27 19:31:40,307][106225] Updated weights for policy 1, policy_version 41346 (0.0010) [2023-12-27 19:31:40,375][106225] Updated weights for policy 1, policy_version 41356 (0.0009) [2023-12-27 19:31:40,670][106226] Updated weights for policy 0, policy_version 41453 (0.0009) [2023-12-27 19:31:40,733][106226] Updated weights for policy 0, policy_version 41463 (0.0011) [2023-12-27 19:31:40,792][106226] Updated weights for policy 0, policy_version 41473 (0.0009) [2023-12-27 19:31:41,038][106225] Updated weights for policy 1, policy_version 41366 (0.0009) [2023-12-27 19:31:41,105][106225] Updated weights for policy 1, policy_version 41376 (0.0007) [2023-12-27 19:31:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 21217280. Throughput: 0: 9872.5, 1: 9954.2. Samples: 21192564. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:41,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-6.368')] [2023-12-27 19:31:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000041480_10625024.pth... [2023-12-27 19:31:41,183][106225] Updated weights for policy 1, policy_version 41386 (0.0012) [2023-12-27 19:31:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000040328_10330112.pth [2023-12-27 19:31:41,220][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000041392_10600448.pth... [2023-12-27 19:31:41,223][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000040208_10297344.pth [2023-12-27 19:31:41,595][106226] Updated weights for policy 0, policy_version 41483 (0.0008) [2023-12-27 19:31:41,662][106226] Updated weights for policy 0, policy_version 41493 (0.0008) [2023-12-27 19:31:41,722][106226] Updated weights for policy 0, policy_version 41503 (0.0009) [2023-12-27 19:31:41,991][106225] Updated weights for policy 1, policy_version 41396 (0.0009) [2023-12-27 19:31:42,047][106225] Updated weights for policy 1, policy_version 41406 (0.0006) [2023-12-27 19:31:42,100][106225] Updated weights for policy 1, policy_version 41416 (0.0008) [2023-12-27 19:31:42,516][106226] Updated weights for policy 0, policy_version 41513 (0.0008) [2023-12-27 19:31:42,581][106226] Updated weights for policy 0, policy_version 41523 (0.0011) [2023-12-27 19:31:42,652][106226] Updated weights for policy 0, policy_version 41533 (0.0008) [2023-12-27 19:31:42,719][106226] Updated weights for policy 0, policy_version 41543 (0.0010) [2023-12-27 19:31:42,890][106225] Updated weights for policy 1, policy_version 41426 (0.0007) [2023-12-27 19:31:42,950][106225] Updated weights for policy 1, policy_version 41436 (0.0010) [2023-12-27 19:31:43,003][106225] Updated weights for policy 1, policy_version 41446 (0.0010) [2023-12-27 19:31:43,053][106225] Updated weights for policy 1, policy_version 41456 (0.0010) [2023-12-27 19:31:43,355][106226] Updated weights for policy 0, policy_version 41553 (0.0008) [2023-12-27 19:31:43,419][106226] Updated weights for policy 0, policy_version 41563 (0.0008) [2023-12-27 19:31:43,474][106226] Updated weights for policy 0, policy_version 41573 (0.0005) [2023-12-27 19:31:43,775][106225] Updated weights for policy 1, policy_version 41466 (0.0010) [2023-12-27 19:31:43,821][106225] Updated weights for policy 1, policy_version 41476 (0.0010) [2023-12-27 19:31:43,880][106225] Updated weights for policy 1, policy_version 41486 (0.0010) [2023-12-27 19:31:44,131][106226] Updated weights for policy 0, policy_version 41583 (0.0008) [2023-12-27 19:31:44,186][106226] Updated weights for policy 0, policy_version 41593 (0.0010) [2023-12-27 19:31:44,246][106226] Updated weights for policy 0, policy_version 41603 (0.0011) [2023-12-27 19:31:44,542][106225] Updated weights for policy 1, policy_version 41496 (0.0006) [2023-12-27 19:31:44,612][106225] Updated weights for policy 1, policy_version 41506 (0.0005) [2023-12-27 19:31:44,678][106225] Updated weights for policy 1, policy_version 41516 (0.0007) [2023-12-27 19:31:44,854][106226] Updated weights for policy 0, policy_version 41613 (0.0007) [2023-12-27 19:31:44,916][106226] Updated weights for policy 0, policy_version 41623 (0.0008) [2023-12-27 19:31:44,991][106226] Updated weights for policy 0, policy_version 41633 (0.0008) [2023-12-27 19:31:45,337][106225] Updated weights for policy 1, policy_version 41526 (0.0010) [2023-12-27 19:31:45,395][106225] Updated weights for policy 1, policy_version 41536 (0.0010) [2023-12-27 19:31:45,450][106225] Updated weights for policy 1, policy_version 41546 (0.0010) [2023-12-27 19:31:45,681][106226] Updated weights for policy 0, policy_version 41643 (0.0009) [2023-12-27 19:31:45,747][106226] Updated weights for policy 0, policy_version 41653 (0.0008) [2023-12-27 19:31:45,810][106226] Updated weights for policy 0, policy_version 41663 (0.0011) [2023-12-27 19:31:46,154][106225] Updated weights for policy 1, policy_version 41556 (0.0010) [2023-12-27 19:31:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 21315584. Throughput: 0: 9838.9, 1: 9906.7. Samples: 21307884. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:46,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-6.456')] [2023-12-27 19:31:46,222][106225] Updated weights for policy 1, policy_version 41566 (0.0010) [2023-12-27 19:31:46,292][106225] Updated weights for policy 1, policy_version 41576 (0.0011) [2023-12-27 19:31:46,441][106226] Updated weights for policy 0, policy_version 41673 (0.0010) [2023-12-27 19:31:46,499][106226] Updated weights for policy 0, policy_version 41683 (0.0007) [2023-12-27 19:31:46,554][106226] Updated weights for policy 0, policy_version 41693 (0.0008) [2023-12-27 19:31:46,618][106226] Updated weights for policy 0, policy_version 41703 (0.0006) [2023-12-27 19:31:47,007][106225] Updated weights for policy 1, policy_version 41586 (0.0010) [2023-12-27 19:31:47,057][106225] Updated weights for policy 1, policy_version 41596 (0.0010) [2023-12-27 19:31:47,109][106225] Updated weights for policy 1, policy_version 41606 (0.0009) [2023-12-27 19:31:47,165][106225] Updated weights for policy 1, policy_version 41616 (0.0009) [2023-12-27 19:31:47,318][106226] Updated weights for policy 0, policy_version 41713 (0.0009) [2023-12-27 19:31:47,366][106226] Updated weights for policy 0, policy_version 41723 (0.0008) [2023-12-27 19:31:47,418][106226] Updated weights for policy 0, policy_version 41733 (0.0009) [2023-12-27 19:31:47,835][106225] Updated weights for policy 1, policy_version 41626 (0.0005) [2023-12-27 19:31:47,878][106225] Updated weights for policy 1, policy_version 41636 (0.0005) [2023-12-27 19:31:47,927][106225] Updated weights for policy 1, policy_version 41646 (0.0006) [2023-12-27 19:31:48,167][106226] Updated weights for policy 0, policy_version 41743 (0.0007) [2023-12-27 19:31:48,218][106226] Updated weights for policy 0, policy_version 41753 (0.0010) [2023-12-27 19:31:48,282][106226] Updated weights for policy 0, policy_version 41763 (0.0008) [2023-12-27 19:31:48,574][106225] Updated weights for policy 1, policy_version 41656 (0.0008) [2023-12-27 19:31:48,631][106225] Updated weights for policy 1, policy_version 41666 (0.0007) [2023-12-27 19:31:48,695][106225] Updated weights for policy 1, policy_version 41676 (0.0006) [2023-12-27 19:31:48,988][106226] Updated weights for policy 0, policy_version 41773 (0.0007) [2023-12-27 19:31:49,059][106226] Updated weights for policy 0, policy_version 41783 (0.0009) [2023-12-27 19:31:49,118][106226] Updated weights for policy 0, policy_version 41793 (0.0010) [2023-12-27 19:31:49,266][106225] Updated weights for policy 1, policy_version 41686 (0.0007) [2023-12-27 19:31:49,332][106225] Updated weights for policy 1, policy_version 41696 (0.0008) [2023-12-27 19:31:49,401][106225] Updated weights for policy 1, policy_version 41706 (0.0008) [2023-12-27 19:31:49,866][106226] Updated weights for policy 0, policy_version 41803 (0.0010) [2023-12-27 19:31:49,934][106226] Updated weights for policy 0, policy_version 41813 (0.0010) [2023-12-27 19:31:49,994][106226] Updated weights for policy 0, policy_version 41823 (0.0011) [2023-12-27 19:31:50,090][106225] Updated weights for policy 1, policy_version 41716 (0.0008) [2023-12-27 19:31:50,155][106225] Updated weights for policy 1, policy_version 41726 (0.0009) [2023-12-27 19:31:50,216][106225] Updated weights for policy 1, policy_version 41736 (0.0009) [2023-12-27 19:31:50,782][106226] Updated weights for policy 0, policy_version 41833 (0.0009) [2023-12-27 19:31:50,839][106226] Updated weights for policy 0, policy_version 41843 (0.0010) [2023-12-27 19:31:50,896][106226] Updated weights for policy 0, policy_version 41853 (0.0011) [2023-12-27 19:31:50,915][106225] Updated weights for policy 1, policy_version 41746 (0.0007) [2023-12-27 19:31:50,951][106226] Updated weights for policy 0, policy_version 41863 (0.0007) [2023-12-27 19:31:50,976][106225] Updated weights for policy 1, policy_version 41756 (0.0009) [2023-12-27 19:31:51,049][106225] Updated weights for policy 1, policy_version 41766 (0.0009) [2023-12-27 19:31:51,103][106225] Updated weights for policy 1, policy_version 41776 (0.0008) [2023-12-27 19:31:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 21422080. Throughput: 0: 9844.8, 1: 9975.5. Samples: 21427332. Policy #0 lag: (min: 1.0, avg: 31.1, max: 33.0) [2023-12-27 19:31:51,175][105115] Avg episode reward: [(0, '-5.494'), (1, '-6.590')] [2023-12-27 19:31:51,601][106226] Updated weights for policy 0, policy_version 41873 (0.0005) [2023-12-27 19:31:51,670][106226] Updated weights for policy 0, policy_version 41883 (0.0010) [2023-12-27 19:31:51,727][106226] Updated weights for policy 0, policy_version 41893 (0.0010) [2023-12-27 19:31:51,924][106225] Updated weights for policy 1, policy_version 41786 (0.0007) [2023-12-27 19:31:51,981][106225] Updated weights for policy 1, policy_version 41796 (0.0010) [2023-12-27 19:31:52,049][106225] Updated weights for policy 1, policy_version 41806 (0.0010) [2023-12-27 19:31:52,431][106226] Updated weights for policy 0, policy_version 41903 (0.0008) [2023-12-27 19:31:52,492][106226] Updated weights for policy 0, policy_version 41913 (0.0009) [2023-12-27 19:31:52,559][106226] Updated weights for policy 0, policy_version 41923 (0.0009) [2023-12-27 19:31:52,715][106225] Updated weights for policy 1, policy_version 41816 (0.0009) [2023-12-27 19:31:52,781][106225] Updated weights for policy 1, policy_version 41826 (0.0008) [2023-12-27 19:31:52,840][106225] Updated weights for policy 1, policy_version 41836 (0.0008) [2023-12-27 19:31:53,306][106226] Updated weights for policy 0, policy_version 41933 (0.0008) [2023-12-27 19:31:53,364][106226] Updated weights for policy 0, policy_version 41943 (0.0009) [2023-12-27 19:31:53,419][106226] Updated weights for policy 0, policy_version 41953 (0.0008) [2023-12-27 19:31:53,484][106225] Updated weights for policy 1, policy_version 41846 (0.0008) [2023-12-27 19:31:53,545][106225] Updated weights for policy 1, policy_version 41856 (0.0008) [2023-12-27 19:31:53,602][106225] Updated weights for policy 1, policy_version 41866 (0.0008) [2023-12-27 19:31:54,157][106226] Updated weights for policy 0, policy_version 41963 (0.0008) [2023-12-27 19:31:54,221][106226] Updated weights for policy 0, policy_version 41973 (0.0008) [2023-12-27 19:31:54,241][106225] Updated weights for policy 1, policy_version 41876 (0.0009) [2023-12-27 19:31:54,281][106226] Updated weights for policy 0, policy_version 41983 (0.0008) [2023-12-27 19:31:54,295][106225] Updated weights for policy 1, policy_version 41886 (0.0006) [2023-12-27 19:31:54,347][106225] Updated weights for policy 1, policy_version 41896 (0.0006) [2023-12-27 19:31:55,035][106225] Updated weights for policy 1, policy_version 41906 (0.0008) [2023-12-27 19:31:55,036][106226] Updated weights for policy 0, policy_version 41993 (0.0008) [2023-12-27 19:31:55,083][106225] Updated weights for policy 1, policy_version 41916 (0.0006) [2023-12-27 19:31:55,092][106226] Updated weights for policy 0, policy_version 42003 (0.0009) [2023-12-27 19:31:55,131][106225] Updated weights for policy 1, policy_version 41926 (0.0005) [2023-12-27 19:31:55,140][106226] Updated weights for policy 0, policy_version 42013 (0.0008) [2023-12-27 19:31:55,182][106225] Updated weights for policy 1, policy_version 41936 (0.0005) [2023-12-27 19:31:55,190][106226] Updated weights for policy 0, policy_version 42023 (0.0009) [2023-12-27 19:31:55,727][106225] Updated weights for policy 1, policy_version 41946 (0.0008) [2023-12-27 19:31:55,775][106225] Updated weights for policy 1, policy_version 41956 (0.0007) [2023-12-27 19:31:55,822][106225] Updated weights for policy 1, policy_version 41966 (0.0008) [2023-12-27 19:31:55,913][106226] Updated weights for policy 0, policy_version 42033 (0.0011) [2023-12-27 19:31:55,972][106226] Updated weights for policy 0, policy_version 42043 (0.0010) [2023-12-27 19:31:56,028][106226] Updated weights for policy 0, policy_version 42053 (0.0010) [2023-12-27 19:31:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 21520384. Throughput: 0: 9818.9, 1: 9900.8. Samples: 21485440. Policy #0 lag: (min: 6.0, avg: 13.5, max: 38.0) [2023-12-27 19:31:56,175][105115] Avg episode reward: [(0, '-5.320'), (1, '-6.607')] [2023-12-27 19:31:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000041968_10747904.pth... [2023-12-27 19:31:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000042056_10772480.pth... [2023-12-27 19:31:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000040816_10452992.pth [2023-12-27 19:31:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000040904_10477568.pth [2023-12-27 19:31:56,560][106225] Updated weights for policy 1, policy_version 41976 (0.0008) [2023-12-27 19:31:56,629][106225] Updated weights for policy 1, policy_version 41986 (0.0008) [2023-12-27 19:31:56,656][106226] Updated weights for policy 0, policy_version 42063 (0.0007) [2023-12-27 19:31:56,699][106225] Updated weights for policy 1, policy_version 41996 (0.0009) [2023-12-27 19:31:56,717][106226] Updated weights for policy 0, policy_version 42073 (0.0006) [2023-12-27 19:31:56,768][106226] Updated weights for policy 0, policy_version 42083 (0.0005) [2023-12-27 19:31:57,286][106226] Updated weights for policy 0, policy_version 42093 (0.0007) [2023-12-27 19:31:57,340][106226] Updated weights for policy 0, policy_version 42103 (0.0009) [2023-12-27 19:31:57,373][106225] Updated weights for policy 1, policy_version 42006 (0.0007) [2023-12-27 19:31:57,393][106226] Updated weights for policy 0, policy_version 42113 (0.0007) [2023-12-27 19:31:57,427][106225] Updated weights for policy 1, policy_version 42016 (0.0005) [2023-12-27 19:31:57,480][106225] Updated weights for policy 1, policy_version 42026 (0.0007) [2023-12-27 19:31:58,151][106226] Updated weights for policy 0, policy_version 42123 (0.0008) [2023-12-27 19:31:58,169][106225] Updated weights for policy 1, policy_version 42036 (0.0008) [2023-12-27 19:31:58,220][106226] Updated weights for policy 0, policy_version 42133 (0.0008) [2023-12-27 19:31:58,230][106225] Updated weights for policy 1, policy_version 42046 (0.0008) [2023-12-27 19:31:58,282][106226] Updated weights for policy 0, policy_version 42143 (0.0010) [2023-12-27 19:31:58,289][106225] Updated weights for policy 1, policy_version 42056 (0.0008) [2023-12-27 19:31:59,101][106226] Updated weights for policy 0, policy_version 42153 (0.0009) [2023-12-27 19:31:59,164][106226] Updated weights for policy 0, policy_version 42163 (0.0006) [2023-12-27 19:31:59,172][106225] Updated weights for policy 1, policy_version 42066 (0.0007) [2023-12-27 19:31:59,226][106226] Updated weights for policy 0, policy_version 42173 (0.0008) [2023-12-27 19:31:59,240][106225] Updated weights for policy 1, policy_version 42077 (0.0008) [2023-12-27 19:31:59,294][106226] Updated weights for policy 0, policy_version 42183 (0.0011) [2023-12-27 19:31:59,301][106225] Updated weights for policy 1, policy_version 42087 (0.0008) [2023-12-27 19:31:59,999][106226] Updated weights for policy 0, policy_version 42193 (0.0009) [2023-12-27 19:32:00,068][106226] Updated weights for policy 0, policy_version 42203 (0.0008) [2023-12-27 19:32:00,076][106225] Updated weights for policy 1, policy_version 42097 (0.0008) [2023-12-27 19:32:00,129][106226] Updated weights for policy 0, policy_version 42213 (0.0007) [2023-12-27 19:32:00,135][106225] Updated weights for policy 1, policy_version 42107 (0.0006) [2023-12-27 19:32:00,196][106225] Updated weights for policy 1, policy_version 42117 (0.0006) [2023-12-27 19:32:00,266][106225] Updated weights for policy 1, policy_version 42127 (0.0005) [2023-12-27 19:32:00,748][106226] Updated weights for policy 0, policy_version 42223 (0.0006) [2023-12-27 19:32:00,805][106226] Updated weights for policy 0, policy_version 42233 (0.0006) [2023-12-27 19:32:00,849][106226] Updated weights for policy 0, policy_version 42243 (0.0008) [2023-12-27 19:32:00,934][106225] Updated weights for policy 1, policy_version 42137 (0.0008) [2023-12-27 19:32:00,991][106225] Updated weights for policy 1, policy_version 42147 (0.0009) [2023-12-27 19:32:01,062][106225] Updated weights for policy 1, policy_version 42158 (0.0008) [2023-12-27 19:32:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 21618688. Throughput: 0: 9833.2, 1: 9924.4. Samples: 21604408. Policy #0 lag: (min: 6.0, avg: 13.5, max: 38.0) [2023-12-27 19:32:01,175][105115] Avg episode reward: [(0, '-5.469'), (1, '-6.393')] [2023-12-27 19:32:01,619][106226] Updated weights for policy 0, policy_version 42253 (0.0008) [2023-12-27 19:32:01,688][106226] Updated weights for policy 0, policy_version 42263 (0.0007) [2023-12-27 19:32:01,725][106225] Updated weights for policy 1, policy_version 42168 (0.0007) [2023-12-27 19:32:01,757][106226] Updated weights for policy 0, policy_version 42273 (0.0007) [2023-12-27 19:32:01,790][106225] Updated weights for policy 1, policy_version 42178 (0.0008) [2023-12-27 19:32:01,850][106225] Updated weights for policy 1, policy_version 42188 (0.0010) [2023-12-27 19:32:02,351][106226] Updated weights for policy 0, policy_version 42283 (0.0006) [2023-12-27 19:32:02,409][106226] Updated weights for policy 0, policy_version 42293 (0.0006) [2023-12-27 19:32:02,473][106226] Updated weights for policy 0, policy_version 42303 (0.0007) [2023-12-27 19:32:02,636][106225] Updated weights for policy 1, policy_version 42198 (0.0008) [2023-12-27 19:32:02,699][106225] Updated weights for policy 1, policy_version 42208 (0.0008) [2023-12-27 19:32:02,762][106225] Updated weights for policy 1, policy_version 42218 (0.0008) [2023-12-27 19:32:03,138][106226] Updated weights for policy 0, policy_version 42313 (0.0008) [2023-12-27 19:32:03,203][106226] Updated weights for policy 0, policy_version 42323 (0.0010) [2023-12-27 19:32:03,278][106226] Updated weights for policy 0, policy_version 42333 (0.0005) [2023-12-27 19:32:03,297][106225] Updated weights for policy 1, policy_version 42228 (0.0007) [2023-12-27 19:32:03,336][106226] Updated weights for policy 0, policy_version 42343 (0.0005) [2023-12-27 19:32:03,345][106225] Updated weights for policy 1, policy_version 42238 (0.0005) [2023-12-27 19:32:03,402][106225] Updated weights for policy 1, policy_version 42248 (0.0005) [2023-12-27 19:32:03,890][106226] Updated weights for policy 0, policy_version 42353 (0.0008) [2023-12-27 19:32:03,945][106226] Updated weights for policy 0, policy_version 42363 (0.0007) [2023-12-27 19:32:03,968][106225] Updated weights for policy 1, policy_version 42258 (0.0006) [2023-12-27 19:32:04,003][106226] Updated weights for policy 0, policy_version 42373 (0.0008) [2023-12-27 19:32:04,023][106225] Updated weights for policy 1, policy_version 42268 (0.0008) [2023-12-27 19:32:04,074][106225] Updated weights for policy 1, policy_version 42278 (0.0008) [2023-12-27 19:32:04,135][106225] Updated weights for policy 1, policy_version 42288 (0.0010) [2023-12-27 19:32:04,734][106226] Updated weights for policy 0, policy_version 42383 (0.0010) [2023-12-27 19:32:04,794][106226] Updated weights for policy 0, policy_version 42393 (0.0011) [2023-12-27 19:32:04,838][106225] Updated weights for policy 1, policy_version 42298 (0.0005) [2023-12-27 19:32:04,856][106226] Updated weights for policy 0, policy_version 42403 (0.0011) [2023-12-27 19:32:04,904][106225] Updated weights for policy 1, policy_version 42308 (0.0005) [2023-12-27 19:32:04,968][106225] Updated weights for policy 1, policy_version 42318 (0.0005) [2023-12-27 19:32:05,490][106225] Updated weights for policy 1, policy_version 42328 (0.0005) [2023-12-27 19:32:05,554][106226] Updated weights for policy 0, policy_version 42413 (0.0011) [2023-12-27 19:32:05,560][106225] Updated weights for policy 1, policy_version 42338 (0.0005) [2023-12-27 19:32:05,608][106226] Updated weights for policy 0, policy_version 42423 (0.0010) [2023-12-27 19:32:05,621][106225] Updated weights for policy 1, policy_version 42348 (0.0006) [2023-12-27 19:32:05,655][106226] Updated weights for policy 0, policy_version 42433 (0.0010) [2023-12-27 19:32:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 21716992. Throughput: 0: 9908.5, 1: 9936.2. Samples: 21729560. Policy #0 lag: (min: 6.0, avg: 13.5, max: 38.0) [2023-12-27 19:32:06,175][105115] Avg episode reward: [(0, '-5.504'), (1, '-6.496')] [2023-12-27 19:32:06,232][106225] Updated weights for policy 1, policy_version 42358 (0.0007) [2023-12-27 19:32:06,291][106225] Updated weights for policy 1, policy_version 42368 (0.0008) [2023-12-27 19:32:06,341][106225] Updated weights for policy 1, policy_version 42378 (0.0008) [2023-12-27 19:32:06,404][106226] Updated weights for policy 0, policy_version 42443 (0.0011) [2023-12-27 19:32:06,462][106226] Updated weights for policy 0, policy_version 42453 (0.0011) [2023-12-27 19:32:06,516][106226] Updated weights for policy 0, policy_version 42463 (0.0011) [2023-12-27 19:32:07,040][106225] Updated weights for policy 1, policy_version 42388 (0.0007) [2023-12-27 19:32:07,093][106225] Updated weights for policy 1, policy_version 42398 (0.0005) [2023-12-27 19:32:07,149][106225] Updated weights for policy 1, policy_version 42408 (0.0005) [2023-12-27 19:32:07,156][106226] Updated weights for policy 0, policy_version 42473 (0.0010) [2023-12-27 19:32:07,208][106226] Updated weights for policy 0, policy_version 42483 (0.0010) [2023-12-27 19:32:07,258][106226] Updated weights for policy 0, policy_version 42493 (0.0010) [2023-12-27 19:32:07,315][106226] Updated weights for policy 0, policy_version 42503 (0.0011) [2023-12-27 19:32:07,666][106225] Updated weights for policy 1, policy_version 42418 (0.0006) [2023-12-27 19:32:07,726][106225] Updated weights for policy 1, policy_version 42428 (0.0006) [2023-12-27 19:32:07,778][106225] Updated weights for policy 1, policy_version 42438 (0.0007) [2023-12-27 19:32:07,834][106225] Updated weights for policy 1, policy_version 42448 (0.0010) [2023-12-27 19:32:07,966][106226] Updated weights for policy 0, policy_version 42513 (0.0010) [2023-12-27 19:32:08,030][106226] Updated weights for policy 0, policy_version 42523 (0.0010) [2023-12-27 19:32:08,091][106226] Updated weights for policy 0, policy_version 42533 (0.0010) [2023-12-27 19:32:08,424][106225] Updated weights for policy 1, policy_version 42458 (0.0011) [2023-12-27 19:32:08,477][106225] Updated weights for policy 1, policy_version 42468 (0.0010) [2023-12-27 19:32:08,542][106225] Updated weights for policy 1, policy_version 42478 (0.0011) [2023-12-27 19:32:08,735][106226] Updated weights for policy 0, policy_version 42543 (0.0011) [2023-12-27 19:32:08,806][106226] Updated weights for policy 0, policy_version 42553 (0.0009) [2023-12-27 19:32:08,864][106226] Updated weights for policy 0, policy_version 42563 (0.0010) [2023-12-27 19:32:09,250][106225] Updated weights for policy 1, policy_version 42488 (0.0010) [2023-12-27 19:32:09,314][106225] Updated weights for policy 1, policy_version 42498 (0.0010) [2023-12-27 19:32:09,384][106225] Updated weights for policy 1, policy_version 42508 (0.0008) [2023-12-27 19:32:09,522][106226] Updated weights for policy 0, policy_version 42573 (0.0011) [2023-12-27 19:32:09,593][106226] Updated weights for policy 0, policy_version 42583 (0.0011) [2023-12-27 19:32:09,654][106226] Updated weights for policy 0, policy_version 42593 (0.0011) [2023-12-27 19:32:10,146][106225] Updated weights for policy 1, policy_version 42518 (0.0010) [2023-12-27 19:32:10,201][106225] Updated weights for policy 1, policy_version 42528 (0.0008) [2023-12-27 19:32:10,260][106225] Updated weights for policy 1, policy_version 42538 (0.0006) [2023-12-27 19:32:10,377][106226] Updated weights for policy 0, policy_version 42603 (0.0010) [2023-12-27 19:32:10,432][106226] Updated weights for policy 0, policy_version 42613 (0.0010) [2023-12-27 19:32:10,483][106226] Updated weights for policy 0, policy_version 42623 (0.0010) [2023-12-27 19:32:10,886][106225] Updated weights for policy 1, policy_version 42548 (0.0006) [2023-12-27 19:32:10,936][106225] Updated weights for policy 1, policy_version 42558 (0.0005) [2023-12-27 19:32:10,992][106225] Updated weights for policy 1, policy_version 42568 (0.0005) [2023-12-27 19:32:11,177][105115] Fps is (10 sec: 20475.9, 60 sec: 19933.2, 300 sec: 19827.3). Total num frames: 21823488. Throughput: 0: 9916.2, 1: 10059.6. Samples: 21793688. Policy #0 lag: (min: 6.0, avg: 13.5, max: 38.0) [2023-12-27 19:32:11,177][105115] Avg episode reward: [(0, '-5.871'), (1, '-6.703')] [2023-12-27 19:32:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000042576_10903552.pth... [2023-12-27 19:32:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000042632_10919936.pth... [2023-12-27 19:32:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000041392_10600448.pth [2023-12-27 19:32:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000041480_10625024.pth [2023-12-27 19:32:11,218][106226] Updated weights for policy 0, policy_version 42633 (0.0010) [2023-12-27 19:32:11,286][106226] Updated weights for policy 0, policy_version 42643 (0.0007) [2023-12-27 19:32:11,355][106226] Updated weights for policy 0, policy_version 42653 (0.0006) [2023-12-27 19:32:11,431][106226] Updated weights for policy 0, policy_version 42663 (0.0008) [2023-12-27 19:32:11,823][106225] Updated weights for policy 1, policy_version 42578 (0.0007) [2023-12-27 19:32:11,882][106225] Updated weights for policy 1, policy_version 42588 (0.0008) [2023-12-27 19:32:11,949][106225] Updated weights for policy 1, policy_version 42598 (0.0008) [2023-12-27 19:32:12,013][106225] Updated weights for policy 1, policy_version 42608 (0.0008) [2023-12-27 19:32:12,129][106226] Updated weights for policy 0, policy_version 42673 (0.0009) [2023-12-27 19:32:12,192][106226] Updated weights for policy 0, policy_version 42683 (0.0008) [2023-12-27 19:32:12,253][106226] Updated weights for policy 0, policy_version 42693 (0.0008) [2023-12-27 19:32:12,710][106225] Updated weights for policy 1, policy_version 42618 (0.0008) [2023-12-27 19:32:12,760][106225] Updated weights for policy 1, policy_version 42628 (0.0008) [2023-12-27 19:32:12,817][106225] Updated weights for policy 1, policy_version 42638 (0.0009) [2023-12-27 19:32:12,991][106226] Updated weights for policy 0, policy_version 42703 (0.0009) [2023-12-27 19:32:13,042][106226] Updated weights for policy 0, policy_version 42713 (0.0009) [2023-12-27 19:32:13,100][106226] Updated weights for policy 0, policy_version 42723 (0.0008) [2023-12-27 19:32:13,528][106225] Updated weights for policy 1, policy_version 42648 (0.0007) [2023-12-27 19:32:13,596][106225] Updated weights for policy 1, policy_version 42658 (0.0005) [2023-12-27 19:32:13,652][106225] Updated weights for policy 1, policy_version 42668 (0.0008) [2023-12-27 19:32:13,796][106226] Updated weights for policy 0, policy_version 42733 (0.0007) [2023-12-27 19:32:13,842][106226] Updated weights for policy 0, policy_version 42743 (0.0005) [2023-12-27 19:32:13,900][106226] Updated weights for policy 0, policy_version 42753 (0.0005) [2023-12-27 19:32:14,363][106225] Updated weights for policy 1, policy_version 42678 (0.0007) [2023-12-27 19:32:14,415][106225] Updated weights for policy 1, policy_version 42688 (0.0005) [2023-12-27 19:32:14,472][106225] Updated weights for policy 1, policy_version 42698 (0.0006) [2023-12-27 19:32:14,504][106226] Updated weights for policy 0, policy_version 42763 (0.0005) [2023-12-27 19:32:14,573][106226] Updated weights for policy 0, policy_version 42773 (0.0007) [2023-12-27 19:32:14,636][106226] Updated weights for policy 0, policy_version 42783 (0.0008) [2023-12-27 19:32:15,077][106225] Updated weights for policy 1, policy_version 42708 (0.0007) [2023-12-27 19:32:15,143][106225] Updated weights for policy 1, policy_version 42718 (0.0009) [2023-12-27 19:32:15,210][106225] Updated weights for policy 1, policy_version 42728 (0.0006) [2023-12-27 19:32:15,358][106226] Updated weights for policy 0, policy_version 42793 (0.0009) [2023-12-27 19:32:15,412][106226] Updated weights for policy 0, policy_version 42803 (0.0005) [2023-12-27 19:32:15,457][106226] Updated weights for policy 0, policy_version 42813 (0.0005) [2023-12-27 19:32:15,507][106226] Updated weights for policy 0, policy_version 42823 (0.0007) [2023-12-27 19:32:15,961][106225] Updated weights for policy 1, policy_version 42738 (0.0008) [2023-12-27 19:32:16,019][106225] Updated weights for policy 1, policy_version 42748 (0.0008) [2023-12-27 19:32:16,082][106225] Updated weights for policy 1, policy_version 42758 (0.0008) [2023-12-27 19:32:16,108][106226] Updated weights for policy 0, policy_version 42833 (0.0006) [2023-12-27 19:32:16,144][106225] Updated weights for policy 1, policy_version 42768 (0.0008) [2023-12-27 19:32:16,167][106226] Updated weights for policy 0, policy_version 42843 (0.0007) [2023-12-27 19:32:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 21921792. Throughput: 0: 9873.7, 1: 10068.6. Samples: 21912028. Policy #0 lag: (min: 6.0, avg: 13.5, max: 38.0) [2023-12-27 19:32:16,175][105115] Avg episode reward: [(0, '-5.446'), (1, '-6.533')] [2023-12-27 19:32:16,225][106226] Updated weights for policy 0, policy_version 42853 (0.0010) [2023-12-27 19:32:16,776][106225] Updated weights for policy 1, policy_version 42778 (0.0009) [2023-12-27 19:32:16,838][106225] Updated weights for policy 1, policy_version 42788 (0.0008) [2023-12-27 19:32:16,889][106225] Updated weights for policy 1, policy_version 42798 (0.0008) [2023-12-27 19:32:16,971][106226] Updated weights for policy 0, policy_version 42863 (0.0008) [2023-12-27 19:32:17,024][106226] Updated weights for policy 0, policy_version 42873 (0.0005) [2023-12-27 19:32:17,072][106226] Updated weights for policy 0, policy_version 42883 (0.0006) [2023-12-27 19:32:17,545][106225] Updated weights for policy 1, policy_version 42808 (0.0008) [2023-12-27 19:32:17,596][106225] Updated weights for policy 1, policy_version 42818 (0.0008) [2023-12-27 19:32:17,655][106225] Updated weights for policy 1, policy_version 42828 (0.0008) [2023-12-27 19:32:17,775][106226] Updated weights for policy 0, policy_version 42893 (0.0009) [2023-12-27 19:32:17,819][106226] Updated weights for policy 0, policy_version 42903 (0.0008) [2023-12-27 19:32:17,877][106226] Updated weights for policy 0, policy_version 42913 (0.0008) [2023-12-27 19:32:18,389][106225] Updated weights for policy 1, policy_version 42838 (0.0009) [2023-12-27 19:32:18,449][106225] Updated weights for policy 1, policy_version 42848 (0.0009) [2023-12-27 19:32:18,515][106225] Updated weights for policy 1, policy_version 42858 (0.0008) [2023-12-27 19:32:18,606][106226] Updated weights for policy 0, policy_version 42923 (0.0008) [2023-12-27 19:32:18,667][106226] Updated weights for policy 0, policy_version 42933 (0.0009) [2023-12-27 19:32:18,729][106226] Updated weights for policy 0, policy_version 42943 (0.0008) [2023-12-27 19:32:19,245][106225] Updated weights for policy 1, policy_version 42868 (0.0009) [2023-12-27 19:32:19,296][106225] Updated weights for policy 1, policy_version 42878 (0.0008) [2023-12-27 19:32:19,348][106225] Updated weights for policy 1, policy_version 42888 (0.0008) [2023-12-27 19:32:19,457][106226] Updated weights for policy 0, policy_version 42953 (0.0009) [2023-12-27 19:32:19,537][106226] Updated weights for policy 0, policy_version 42963 (0.0007) [2023-12-27 19:32:19,597][106226] Updated weights for policy 0, policy_version 42973 (0.0006) [2023-12-27 19:32:19,656][106226] Updated weights for policy 0, policy_version 42983 (0.0007) [2023-12-27 19:32:20,138][106225] Updated weights for policy 1, policy_version 42898 (0.0007) [2023-12-27 19:32:20,195][106225] Updated weights for policy 1, policy_version 42908 (0.0009) [2023-12-27 19:32:20,249][106225] Updated weights for policy 1, policy_version 42918 (0.0009) [2023-12-27 19:32:20,306][106225] Updated weights for policy 1, policy_version 42928 (0.0009) [2023-12-27 19:32:20,346][106226] Updated weights for policy 0, policy_version 42993 (0.0009) [2023-12-27 19:32:20,406][106226] Updated weights for policy 0, policy_version 43003 (0.0009) [2023-12-27 19:32:20,463][106226] Updated weights for policy 0, policy_version 43013 (0.0009) [2023-12-27 19:32:21,069][106225] Updated weights for policy 1, policy_version 42938 (0.0010) [2023-12-27 19:32:21,135][106225] Updated weights for policy 1, policy_version 42948 (0.0010) [2023-12-27 19:32:21,175][105115] Fps is (10 sec: 18845.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 22011904. Throughput: 0: 9883.7, 1: 10013.6. Samples: 22027320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:21,175][105115] Avg episode reward: [(0, '-5.151'), (1, '-6.560')] [2023-12-27 19:32:21,202][106225] Updated weights for policy 1, policy_version 42958 (0.0010) [2023-12-27 19:32:21,237][106226] Updated weights for policy 0, policy_version 43023 (0.0009) [2023-12-27 19:32:21,292][106226] Updated weights for policy 0, policy_version 43033 (0.0008) [2023-12-27 19:32:21,361][106226] Updated weights for policy 0, policy_version 43043 (0.0008) [2023-12-27 19:32:21,953][106225] Updated weights for policy 1, policy_version 42968 (0.0009) [2023-12-27 19:32:22,017][106225] Updated weights for policy 1, policy_version 42978 (0.0006) [2023-12-27 19:32:22,079][106226] Updated weights for policy 0, policy_version 43053 (0.0007) [2023-12-27 19:32:22,081][106225] Updated weights for policy 1, policy_version 42988 (0.0010) [2023-12-27 19:32:22,135][106226] Updated weights for policy 0, policy_version 43063 (0.0007) [2023-12-27 19:32:22,202][106226] Updated weights for policy 0, policy_version 43073 (0.0006) [2023-12-27 19:32:22,693][106225] Updated weights for policy 1, policy_version 42998 (0.0009) [2023-12-27 19:32:22,757][106225] Updated weights for policy 1, policy_version 43008 (0.0007) [2023-12-27 19:32:22,819][106225] Updated weights for policy 1, policy_version 43018 (0.0008) [2023-12-27 19:32:22,959][106226] Updated weights for policy 0, policy_version 43083 (0.0010) [2023-12-27 19:32:23,025][106226] Updated weights for policy 0, policy_version 43093 (0.0006) [2023-12-27 19:32:23,084][106226] Updated weights for policy 0, policy_version 43103 (0.0008) [2023-12-27 19:32:23,505][106225] Updated weights for policy 1, policy_version 43028 (0.0008) [2023-12-27 19:32:23,560][106225] Updated weights for policy 1, policy_version 43038 (0.0007) [2023-12-27 19:32:23,621][106225] Updated weights for policy 1, policy_version 43048 (0.0009) [2023-12-27 19:32:23,716][106226] Updated weights for policy 0, policy_version 43113 (0.0008) [2023-12-27 19:32:23,777][106226] Updated weights for policy 0, policy_version 43123 (0.0011) [2023-12-27 19:32:23,839][106226] Updated weights for policy 0, policy_version 43133 (0.0011) [2023-12-27 19:32:23,902][106226] Updated weights for policy 0, policy_version 43143 (0.0010) [2023-12-27 19:32:24,283][106225] Updated weights for policy 1, policy_version 43058 (0.0008) [2023-12-27 19:32:24,342][106225] Updated weights for policy 1, policy_version 43068 (0.0009) [2023-12-27 19:32:24,405][106225] Updated weights for policy 1, policy_version 43078 (0.0008) [2023-12-27 19:32:24,461][106225] Updated weights for policy 1, policy_version 43088 (0.0010) [2023-12-27 19:32:24,600][106226] Updated weights for policy 0, policy_version 43153 (0.0008) [2023-12-27 19:32:24,653][106226] Updated weights for policy 0, policy_version 43163 (0.0009) [2023-12-27 19:32:24,703][106226] Updated weights for policy 0, policy_version 43173 (0.0008) [2023-12-27 19:32:25,030][106225] Updated weights for policy 1, policy_version 43098 (0.0007) [2023-12-27 19:32:25,090][106225] Updated weights for policy 1, policy_version 43108 (0.0008) [2023-12-27 19:32:25,145][106225] Updated weights for policy 1, policy_version 43118 (0.0008) [2023-12-27 19:32:25,409][106226] Updated weights for policy 0, policy_version 43184 (0.0007) [2023-12-27 19:32:25,470][106226] Updated weights for policy 0, policy_version 43194 (0.0006) [2023-12-27 19:32:25,532][106226] Updated weights for policy 0, policy_version 43204 (0.0005) [2023-12-27 19:32:25,880][106225] Updated weights for policy 1, policy_version 43128 (0.0009) [2023-12-27 19:32:25,927][106225] Updated weights for policy 1, policy_version 43138 (0.0008) [2023-12-27 19:32:25,975][106225] Updated weights for policy 1, policy_version 43148 (0.0008) [2023-12-27 19:32:26,135][106226] Updated weights for policy 0, policy_version 43214 (0.0007) [2023-12-27 19:32:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 22118400. Throughput: 0: 9851.1, 1: 10003.2. Samples: 22086008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:26,176][105115] Avg episode reward: [(0, '-5.359'), (1, '-6.368')] [2023-12-27 19:32:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000043152_11051008.pth... [2023-12-27 19:32:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000041968_10747904.pth [2023-12-27 19:32:26,196][106226] Updated weights for policy 0, policy_version 43224 (0.0008) [2023-12-27 19:32:26,251][106226] Updated weights for policy 0, policy_version 43234 (0.0008) [2023-12-27 19:32:26,279][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000043240_11075584.pth... [2023-12-27 19:32:26,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000042056_10772480.pth [2023-12-27 19:32:26,619][106225] Updated weights for policy 1, policy_version 43158 (0.0007) [2023-12-27 19:32:26,674][106225] Updated weights for policy 1, policy_version 43168 (0.0006) [2023-12-27 19:32:26,723][106225] Updated weights for policy 1, policy_version 43178 (0.0005) [2023-12-27 19:32:27,012][106226] Updated weights for policy 0, policy_version 43244 (0.0008) [2023-12-27 19:32:27,069][106226] Updated weights for policy 0, policy_version 43254 (0.0008) [2023-12-27 19:32:27,120][106226] Updated weights for policy 0, policy_version 43264 (0.0007) [2023-12-27 19:32:27,298][106225] Updated weights for policy 1, policy_version 43188 (0.0005) [2023-12-27 19:32:27,363][106225] Updated weights for policy 1, policy_version 43198 (0.0005) [2023-12-27 19:32:27,420][106225] Updated weights for policy 1, policy_version 43208 (0.0005) [2023-12-27 19:32:27,713][106226] Updated weights for policy 0, policy_version 43274 (0.0007) [2023-12-27 19:32:27,764][106226] Updated weights for policy 0, policy_version 43284 (0.0005) [2023-12-27 19:32:27,813][106226] Updated weights for policy 0, policy_version 43294 (0.0005) [2023-12-27 19:32:27,861][106226] Updated weights for policy 0, policy_version 43304 (0.0005) [2023-12-27 19:32:27,930][106225] Updated weights for policy 1, policy_version 43218 (0.0005) [2023-12-27 19:32:27,985][106225] Updated weights for policy 1, policy_version 43228 (0.0006) [2023-12-27 19:32:28,042][106225] Updated weights for policy 1, policy_version 43238 (0.0006) [2023-12-27 19:32:28,098][106225] Updated weights for policy 1, policy_version 43248 (0.0006) [2023-12-27 19:32:28,395][106226] Updated weights for policy 0, policy_version 43314 (0.0007) [2023-12-27 19:32:28,455][106226] Updated weights for policy 0, policy_version 43324 (0.0008) [2023-12-27 19:32:28,528][106226] Updated weights for policy 0, policy_version 43334 (0.0008) [2023-12-27 19:32:28,684][106225] Updated weights for policy 1, policy_version 43258 (0.0006) [2023-12-27 19:32:28,738][106225] Updated weights for policy 1, policy_version 43268 (0.0005) [2023-12-27 19:32:28,794][106225] Updated weights for policy 1, policy_version 43278 (0.0006) [2023-12-27 19:32:29,249][106226] Updated weights for policy 0, policy_version 43344 (0.0010) [2023-12-27 19:32:29,315][106226] Updated weights for policy 0, policy_version 43354 (0.0011) [2023-12-27 19:32:29,384][106226] Updated weights for policy 0, policy_version 43364 (0.0010) [2023-12-27 19:32:29,502][106225] Updated weights for policy 1, policy_version 43288 (0.0008) [2023-12-27 19:32:29,566][106225] Updated weights for policy 1, policy_version 43298 (0.0008) [2023-12-27 19:32:29,626][106225] Updated weights for policy 1, policy_version 43308 (0.0008) [2023-12-27 19:32:30,065][106226] Updated weights for policy 0, policy_version 43374 (0.0011) [2023-12-27 19:32:30,125][106226] Updated weights for policy 0, policy_version 43385 (0.0008) [2023-12-27 19:32:30,187][106226] Updated weights for policy 0, policy_version 43395 (0.0009) [2023-12-27 19:32:30,337][106225] Updated weights for policy 1, policy_version 43318 (0.0009) [2023-12-27 19:32:30,396][106225] Updated weights for policy 1, policy_version 43328 (0.0008) [2023-12-27 19:32:30,455][106225] Updated weights for policy 1, policy_version 43338 (0.0007) [2023-12-27 19:32:30,922][106226] Updated weights for policy 0, policy_version 43405 (0.0008) [2023-12-27 19:32:30,981][106226] Updated weights for policy 0, policy_version 43415 (0.0006) [2023-12-27 19:32:31,042][106226] Updated weights for policy 0, policy_version 43425 (0.0006) [2023-12-27 19:32:31,067][106225] Updated weights for policy 1, policy_version 43348 (0.0006) [2023-12-27 19:32:31,127][106225] Updated weights for policy 1, policy_version 43358 (0.0008) [2023-12-27 19:32:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 22224896. Throughput: 0: 9961.5, 1: 10184.4. Samples: 22214452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:31,175][105115] Avg episode reward: [(0, '-5.572'), (1, '-6.598')] [2023-12-27 19:32:31,199][106225] Updated weights for policy 1, policy_version 43368 (0.0009) [2023-12-27 19:32:31,763][106226] Updated weights for policy 0, policy_version 43435 (0.0008) [2023-12-27 19:32:31,831][106226] Updated weights for policy 0, policy_version 43445 (0.0009) [2023-12-27 19:32:31,893][106226] Updated weights for policy 0, policy_version 43455 (0.0008) [2023-12-27 19:32:31,971][106225] Updated weights for policy 1, policy_version 43378 (0.0008) [2023-12-27 19:32:32,035][106225] Updated weights for policy 1, policy_version 43388 (0.0008) [2023-12-27 19:32:32,099][106225] Updated weights for policy 1, policy_version 43398 (0.0008) [2023-12-27 19:32:32,159][106225] Updated weights for policy 1, policy_version 43408 (0.0009) [2023-12-27 19:32:32,692][106226] Updated weights for policy 0, policy_version 43465 (0.0009) [2023-12-27 19:32:32,747][106226] Updated weights for policy 0, policy_version 43475 (0.0008) [2023-12-27 19:32:32,800][106226] Updated weights for policy 0, policy_version 43485 (0.0006) [2023-12-27 19:32:32,802][106225] Updated weights for policy 1, policy_version 43418 (0.0007) [2023-12-27 19:32:32,854][106226] Updated weights for policy 0, policy_version 43495 (0.0005) [2023-12-27 19:32:32,867][106225] Updated weights for policy 1, policy_version 43428 (0.0007) [2023-12-27 19:32:32,927][106225] Updated weights for policy 1, policy_version 43438 (0.0009) [2023-12-27 19:32:33,596][106226] Updated weights for policy 0, policy_version 43505 (0.0006) [2023-12-27 19:32:33,605][106225] Updated weights for policy 1, policy_version 43448 (0.0007) [2023-12-27 19:32:33,653][106226] Updated weights for policy 0, policy_version 43515 (0.0006) [2023-12-27 19:32:33,667][106225] Updated weights for policy 1, policy_version 43458 (0.0009) [2023-12-27 19:32:33,709][106226] Updated weights for policy 0, policy_version 43525 (0.0006) [2023-12-27 19:32:33,727][106225] Updated weights for policy 1, policy_version 43468 (0.0007) [2023-12-27 19:32:34,319][106226] Updated weights for policy 0, policy_version 43535 (0.0009) [2023-12-27 19:32:34,387][106226] Updated weights for policy 0, policy_version 43545 (0.0008) [2023-12-27 19:32:34,451][106226] Updated weights for policy 0, policy_version 43555 (0.0008) [2023-12-27 19:32:34,488][106225] Updated weights for policy 1, policy_version 43478 (0.0007) [2023-12-27 19:32:34,555][106225] Updated weights for policy 1, policy_version 43488 (0.0008) [2023-12-27 19:32:34,619][106225] Updated weights for policy 1, policy_version 43498 (0.0009) [2023-12-27 19:32:35,136][106226] Updated weights for policy 0, policy_version 43565 (0.0009) [2023-12-27 19:32:35,201][106226] Updated weights for policy 0, policy_version 43575 (0.0008) [2023-12-27 19:32:35,258][106226] Updated weights for policy 0, policy_version 43585 (0.0007) [2023-12-27 19:32:35,260][106225] Updated weights for policy 1, policy_version 43508 (0.0007) [2023-12-27 19:32:35,307][106225] Updated weights for policy 1, policy_version 43518 (0.0006) [2023-12-27 19:32:35,355][106225] Updated weights for policy 1, policy_version 43528 (0.0009) [2023-12-27 19:32:35,910][106226] Updated weights for policy 0, policy_version 43595 (0.0006) [2023-12-27 19:32:35,953][106225] Updated weights for policy 1, policy_version 43538 (0.0007) [2023-12-27 19:32:35,962][106226] Updated weights for policy 0, policy_version 43605 (0.0005) [2023-12-27 19:32:35,998][106225] Updated weights for policy 1, policy_version 43548 (0.0008) [2023-12-27 19:32:36,011][106226] Updated weights for policy 0, policy_version 43615 (0.0006) [2023-12-27 19:32:36,056][106225] Updated weights for policy 1, policy_version 43558 (0.0006) [2023-12-27 19:32:36,111][106225] Updated weights for policy 1, policy_version 43568 (0.0007) [2023-12-27 19:32:36,175][105115] Fps is (10 sec: 21299.8, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 22331392. Throughput: 0: 9969.6, 1: 10175.4. Samples: 22333856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:36,175][105115] Avg episode reward: [(0, '-5.413'), (1, '-6.390')] [2023-12-27 19:32:36,649][106226] Updated weights for policy 0, policy_version 43625 (0.0007) [2023-12-27 19:32:36,706][106226] Updated weights for policy 0, policy_version 43635 (0.0011) [2023-12-27 19:32:36,767][106226] Updated weights for policy 0, policy_version 43645 (0.0011) [2023-12-27 19:32:36,827][106226] Updated weights for policy 0, policy_version 43655 (0.0010) [2023-12-27 19:32:36,930][106225] Updated weights for policy 1, policy_version 43578 (0.0008) [2023-12-27 19:32:36,993][106225] Updated weights for policy 1, policy_version 43588 (0.0009) [2023-12-27 19:32:37,060][106225] Updated weights for policy 1, policy_version 43598 (0.0010) [2023-12-27 19:32:37,487][106226] Updated weights for policy 0, policy_version 43665 (0.0011) [2023-12-27 19:32:37,545][106226] Updated weights for policy 0, policy_version 43675 (0.0011) [2023-12-27 19:32:37,599][106226] Updated weights for policy 0, policy_version 43685 (0.0010) [2023-12-27 19:32:37,791][106225] Updated weights for policy 1, policy_version 43608 (0.0006) [2023-12-27 19:32:37,852][106225] Updated weights for policy 1, policy_version 43618 (0.0005) [2023-12-27 19:32:37,909][106225] Updated weights for policy 1, policy_version 43628 (0.0005) [2023-12-27 19:32:38,312][106226] Updated weights for policy 0, policy_version 43695 (0.0011) [2023-12-27 19:32:38,377][106226] Updated weights for policy 0, policy_version 43705 (0.0008) [2023-12-27 19:32:38,418][106225] Updated weights for policy 1, policy_version 43638 (0.0007) [2023-12-27 19:32:38,436][106226] Updated weights for policy 0, policy_version 43715 (0.0006) [2023-12-27 19:32:38,486][106225] Updated weights for policy 1, policy_version 43648 (0.0008) [2023-12-27 19:32:38,555][106225] Updated weights for policy 1, policy_version 43658 (0.0009) [2023-12-27 19:32:39,064][106226] Updated weights for policy 0, policy_version 43725 (0.0008) [2023-12-27 19:32:39,121][106226] Updated weights for policy 0, policy_version 43735 (0.0011) [2023-12-27 19:32:39,186][106226] Updated weights for policy 0, policy_version 43745 (0.0011) [2023-12-27 19:32:39,243][106225] Updated weights for policy 1, policy_version 43668 (0.0009) [2023-12-27 19:32:39,305][106225] Updated weights for policy 1, policy_version 43678 (0.0007) [2023-12-27 19:32:39,367][106225] Updated weights for policy 1, policy_version 43688 (0.0008) [2023-12-27 19:32:39,953][106226] Updated weights for policy 0, policy_version 43755 (0.0010) [2023-12-27 19:32:40,012][106226] Updated weights for policy 0, policy_version 43765 (0.0008) [2023-12-27 19:32:40,071][106226] Updated weights for policy 0, policy_version 43775 (0.0008) [2023-12-27 19:32:40,148][106225] Updated weights for policy 1, policy_version 43698 (0.0007) [2023-12-27 19:32:40,220][106225] Updated weights for policy 1, policy_version 43708 (0.0006) [2023-12-27 19:32:40,281][106225] Updated weights for policy 1, policy_version 43718 (0.0006) [2023-12-27 19:32:40,345][106225] Updated weights for policy 1, policy_version 43728 (0.0006) [2023-12-27 19:32:40,826][106226] Updated weights for policy 0, policy_version 43785 (0.0009) [2023-12-27 19:32:40,889][106226] Updated weights for policy 0, policy_version 43795 (0.0006) [2023-12-27 19:32:40,949][106226] Updated weights for policy 0, policy_version 43805 (0.0010) [2023-12-27 19:32:40,963][106225] Updated weights for policy 1, policy_version 43738 (0.0006) [2023-12-27 19:32:41,007][106226] Updated weights for policy 0, policy_version 43815 (0.0010) [2023-12-27 19:32:41,021][106225] Updated weights for policy 1, policy_version 43748 (0.0006) [2023-12-27 19:32:41,092][106225] Updated weights for policy 1, policy_version 43758 (0.0008) [2023-12-27 19:32:41,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 22429696. Throughput: 0: 10011.4, 1: 10195.8. Samples: 22394760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:41,175][105115] Avg episode reward: [(0, '-5.614'), (1, '-6.598')] [2023-12-27 19:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000043760_11206656.pth... [2023-12-27 19:32:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000043816_11223040.pth... [2023-12-27 19:32:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000042632_10919936.pth [2023-12-27 19:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000042576_10903552.pth [2023-12-27 19:32:41,754][106226] Updated weights for policy 0, policy_version 43825 (0.0009) [2023-12-27 19:32:41,820][106226] Updated weights for policy 0, policy_version 43835 (0.0011) [2023-12-27 19:32:41,864][106225] Updated weights for policy 1, policy_version 43768 (0.0008) [2023-12-27 19:32:41,881][106226] Updated weights for policy 0, policy_version 43845 (0.0008) [2023-12-27 19:32:41,923][106225] Updated weights for policy 1, policy_version 43778 (0.0008) [2023-12-27 19:32:41,983][106225] Updated weights for policy 1, policy_version 43788 (0.0008) [2023-12-27 19:32:42,584][106226] Updated weights for policy 0, policy_version 43855 (0.0009) [2023-12-27 19:32:42,650][106226] Updated weights for policy 0, policy_version 43865 (0.0007) [2023-12-27 19:32:42,694][106225] Updated weights for policy 1, policy_version 43798 (0.0007) [2023-12-27 19:32:42,711][106226] Updated weights for policy 0, policy_version 43875 (0.0007) [2023-12-27 19:32:42,752][106225] Updated weights for policy 1, policy_version 43808 (0.0010) [2023-12-27 19:32:42,809][106225] Updated weights for policy 1, policy_version 43818 (0.0010) [2023-12-27 19:32:43,375][106225] Updated weights for policy 1, policy_version 43828 (0.0009) [2023-12-27 19:32:43,425][106225] Updated weights for policy 1, policy_version 43838 (0.0010) [2023-12-27 19:32:43,474][106225] Updated weights for policy 1, policy_version 43848 (0.0010) [2023-12-27 19:32:43,499][106226] Updated weights for policy 0, policy_version 43885 (0.0005) [2023-12-27 19:32:43,558][106226] Updated weights for policy 0, policy_version 43895 (0.0005) [2023-12-27 19:32:43,613][106226] Updated weights for policy 0, policy_version 43905 (0.0005) [2023-12-27 19:32:44,125][106225] Updated weights for policy 1, policy_version 43858 (0.0010) [2023-12-27 19:32:44,177][106225] Updated weights for policy 1, policy_version 43868 (0.0007) [2023-12-27 19:32:44,244][106225] Updated weights for policy 1, policy_version 43878 (0.0006) [2023-12-27 19:32:44,260][106226] Updated weights for policy 0, policy_version 43915 (0.0006) [2023-12-27 19:32:44,307][106226] Updated weights for policy 0, policy_version 43925 (0.0007) [2023-12-27 19:32:44,310][106225] Updated weights for policy 1, policy_version 43888 (0.0009) [2023-12-27 19:32:44,358][106226] Updated weights for policy 0, policy_version 43935 (0.0005) [2023-12-27 19:32:44,990][106225] Updated weights for policy 1, policy_version 43898 (0.0010) [2023-12-27 19:32:45,013][106226] Updated weights for policy 0, policy_version 43945 (0.0006) [2023-12-27 19:32:45,051][106225] Updated weights for policy 1, policy_version 43908 (0.0007) [2023-12-27 19:32:45,068][106226] Updated weights for policy 0, policy_version 43955 (0.0010) [2023-12-27 19:32:45,115][106225] Updated weights for policy 1, policy_version 43918 (0.0007) [2023-12-27 19:32:45,127][106226] Updated weights for policy 0, policy_version 43965 (0.0011) [2023-12-27 19:32:45,186][106226] Updated weights for policy 0, policy_version 43975 (0.0010) [2023-12-27 19:32:45,821][106225] Updated weights for policy 1, policy_version 43928 (0.0009) [2023-12-27 19:32:45,879][106225] Updated weights for policy 1, policy_version 43938 (0.0010) [2023-12-27 19:32:45,901][106226] Updated weights for policy 0, policy_version 43985 (0.0006) [2023-12-27 19:32:45,928][106225] Updated weights for policy 1, policy_version 43948 (0.0010) [2023-12-27 19:32:45,952][106226] Updated weights for policy 0, policy_version 43995 (0.0005) [2023-12-27 19:32:46,013][106226] Updated weights for policy 0, policy_version 44005 (0.0009) [2023-12-27 19:32:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 22528000. Throughput: 0: 9974.0, 1: 10216.8. Samples: 22512992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:32:46,175][105115] Avg episode reward: [(0, '-5.270'), (1, '-6.540')] [2023-12-27 19:32:46,587][106225] Updated weights for policy 1, policy_version 43958 (0.0010) [2023-12-27 19:32:46,649][106225] Updated weights for policy 1, policy_version 43968 (0.0010) [2023-12-27 19:32:46,693][106226] Updated weights for policy 0, policy_version 44015 (0.0008) [2023-12-27 19:32:46,710][106225] Updated weights for policy 1, policy_version 43978 (0.0010) [2023-12-27 19:32:46,751][106226] Updated weights for policy 0, policy_version 44025 (0.0011) [2023-12-27 19:32:46,806][106226] Updated weights for policy 0, policy_version 44035 (0.0011) [2023-12-27 19:32:47,342][106225] Updated weights for policy 1, policy_version 43988 (0.0009) [2023-12-27 19:32:47,398][106225] Updated weights for policy 1, policy_version 43998 (0.0007) [2023-12-27 19:32:47,450][106225] Updated weights for policy 1, policy_version 44008 (0.0007) [2023-12-27 19:32:47,511][106226] Updated weights for policy 0, policy_version 44045 (0.0011) [2023-12-27 19:32:47,573][106226] Updated weights for policy 0, policy_version 44055 (0.0010) [2023-12-27 19:32:47,632][106226] Updated weights for policy 0, policy_version 44065 (0.0010) [2023-12-27 19:32:48,109][106225] Updated weights for policy 1, policy_version 44018 (0.0007) [2023-12-27 19:32:48,161][106225] Updated weights for policy 1, policy_version 44028 (0.0005) [2023-12-27 19:32:48,205][106225] Updated weights for policy 1, policy_version 44038 (0.0008) [2023-12-27 19:32:48,266][106225] Updated weights for policy 1, policy_version 44048 (0.0010) [2023-12-27 19:32:48,289][106226] Updated weights for policy 0, policy_version 44076 (0.0010) [2023-12-27 19:32:48,349][106226] Updated weights for policy 0, policy_version 44086 (0.0007) [2023-12-27 19:32:48,405][106226] Updated weights for policy 0, policy_version 44096 (0.0008) [2023-12-27 19:32:48,984][106225] Updated weights for policy 1, policy_version 44058 (0.0010) [2023-12-27 19:32:49,033][106225] Updated weights for policy 1, policy_version 44068 (0.0010) [2023-12-27 19:32:49,083][106225] Updated weights for policy 1, policy_version 44078 (0.0010) [2023-12-27 19:32:49,142][106226] Updated weights for policy 0, policy_version 44106 (0.0009) [2023-12-27 19:32:49,201][106226] Updated weights for policy 0, policy_version 44116 (0.0010) [2023-12-27 19:32:49,269][106226] Updated weights for policy 0, policy_version 44126 (0.0011) [2023-12-27 19:32:49,324][106226] Updated weights for policy 0, policy_version 44136 (0.0011) [2023-12-27 19:32:49,883][106225] Updated weights for policy 1, policy_version 44088 (0.0009) [2023-12-27 19:32:49,965][106225] Updated weights for policy 1, policy_version 44098 (0.0008) [2023-12-27 19:32:50,023][106225] Updated weights for policy 1, policy_version 44108 (0.0007) [2023-12-27 19:32:50,048][106226] Updated weights for policy 0, policy_version 44146 (0.0006) [2023-12-27 19:32:50,117][106226] Updated weights for policy 0, policy_version 44156 (0.0007) [2023-12-27 19:32:50,179][106226] Updated weights for policy 0, policy_version 44166 (0.0008) [2023-12-27 19:32:50,708][106225] Updated weights for policy 1, policy_version 44118 (0.0007) [2023-12-27 19:32:50,761][106225] Updated weights for policy 1, policy_version 44128 (0.0009) [2023-12-27 19:32:50,815][106225] Updated weights for policy 1, policy_version 44138 (0.0009) [2023-12-27 19:32:50,919][106226] Updated weights for policy 0, policy_version 44176 (0.0008) [2023-12-27 19:32:50,976][106226] Updated weights for policy 0, policy_version 44186 (0.0009) [2023-12-27 19:32:51,043][106226] Updated weights for policy 0, policy_version 44196 (0.0008) [2023-12-27 19:32:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 22626304. Throughput: 0: 9900.0, 1: 10139.4. Samples: 22631332. Policy #0 lag: (min: 4.0, avg: 8.5, max: 36.0) [2023-12-27 19:32:51,175][105115] Avg episode reward: [(0, '-5.566'), (1, '-6.759')] [2023-12-27 19:32:51,584][106225] Updated weights for policy 1, policy_version 44148 (0.0008) [2023-12-27 19:32:51,644][106225] Updated weights for policy 1, policy_version 44158 (0.0009) [2023-12-27 19:32:51,700][106225] Updated weights for policy 1, policy_version 44168 (0.0006) [2023-12-27 19:32:51,821][106226] Updated weights for policy 0, policy_version 44206 (0.0009) [2023-12-27 19:32:51,903][106226] Updated weights for policy 0, policy_version 44216 (0.0010) [2023-12-27 19:32:51,966][106226] Updated weights for policy 0, policy_version 44226 (0.0008) [2023-12-27 19:32:52,457][106225] Updated weights for policy 1, policy_version 44178 (0.0009) [2023-12-27 19:32:52,518][106225] Updated weights for policy 1, policy_version 44188 (0.0010) [2023-12-27 19:32:52,575][106225] Updated weights for policy 1, policy_version 44198 (0.0010) [2023-12-27 19:32:52,640][106225] Updated weights for policy 1, policy_version 44208 (0.0010) [2023-12-27 19:32:52,660][106226] Updated weights for policy 0, policy_version 44236 (0.0009) [2023-12-27 19:32:52,717][106226] Updated weights for policy 0, policy_version 44246 (0.0008) [2023-12-27 19:32:52,775][106226] Updated weights for policy 0, policy_version 44256 (0.0008) [2023-12-27 19:32:53,330][106225] Updated weights for policy 1, policy_version 44218 (0.0010) [2023-12-27 19:32:53,389][106225] Updated weights for policy 1, policy_version 44228 (0.0010) [2023-12-27 19:32:53,452][106225] Updated weights for policy 1, policy_version 44238 (0.0010) [2023-12-27 19:32:53,482][106226] Updated weights for policy 0, policy_version 44266 (0.0007) [2023-12-27 19:32:53,535][106226] Updated weights for policy 0, policy_version 44276 (0.0005) [2023-12-27 19:32:53,597][106226] Updated weights for policy 0, policy_version 44286 (0.0007) [2023-12-27 19:32:53,665][106226] Updated weights for policy 0, policy_version 44296 (0.0008) [2023-12-27 19:32:54,074][106225] Updated weights for policy 1, policy_version 44248 (0.0007) [2023-12-27 19:32:54,140][106225] Updated weights for policy 1, policy_version 44258 (0.0005) [2023-12-27 19:32:54,194][106225] Updated weights for policy 1, policy_version 44268 (0.0005) [2023-12-27 19:32:54,430][106226] Updated weights for policy 0, policy_version 44306 (0.0009) [2023-12-27 19:32:54,480][106226] Updated weights for policy 0, policy_version 44316 (0.0008) [2023-12-27 19:32:54,526][106226] Updated weights for policy 0, policy_version 44326 (0.0007) [2023-12-27 19:32:54,843][106225] Updated weights for policy 1, policy_version 44278 (0.0009) [2023-12-27 19:32:54,896][106225] Updated weights for policy 1, policy_version 44288 (0.0010) [2023-12-27 19:32:54,943][106225] Updated weights for policy 1, policy_version 44298 (0.0010) [2023-12-27 19:32:55,263][106226] Updated weights for policy 0, policy_version 44336 (0.0008) [2023-12-27 19:32:55,312][106226] Updated weights for policy 0, policy_version 44346 (0.0008) [2023-12-27 19:32:55,361][106226] Updated weights for policy 0, policy_version 44356 (0.0009) [2023-12-27 19:32:55,575][106225] Updated weights for policy 1, policy_version 44308 (0.0010) [2023-12-27 19:32:55,624][106225] Updated weights for policy 1, policy_version 44318 (0.0010) [2023-12-27 19:32:55,673][106225] Updated weights for policy 1, policy_version 44328 (0.0010) [2023-12-27 19:32:56,138][106226] Updated weights for policy 0, policy_version 44366 (0.0009) [2023-12-27 19:32:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 22716416. Throughput: 0: 9835.4, 1: 10040.9. Samples: 22688084. Policy #0 lag: (min: 4.0, avg: 8.5, max: 36.0) [2023-12-27 19:32:56,175][105115] Avg episode reward: [(0, '-5.527'), (1, '-6.553')] [2023-12-27 19:32:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000044336_11354112.pth... [2023-12-27 19:32:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000043152_11051008.pth [2023-12-27 19:32:56,192][106226] Updated weights for policy 0, policy_version 44376 (0.0007) [2023-12-27 19:32:56,241][106226] Updated weights for policy 0, policy_version 44386 (0.0009) [2023-12-27 19:32:56,269][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000044392_11370496.pth... [2023-12-27 19:32:56,274][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000043240_11075584.pth [2023-12-27 19:32:56,394][106225] Updated weights for policy 1, policy_version 44338 (0.0009) [2023-12-27 19:32:56,465][106225] Updated weights for policy 1, policy_version 44348 (0.0005) [2023-12-27 19:32:56,527][106225] Updated weights for policy 1, policy_version 44358 (0.0008) [2023-12-27 19:32:56,585][106225] Updated weights for policy 1, policy_version 44368 (0.0009) [2023-12-27 19:32:56,901][106226] Updated weights for policy 0, policy_version 44396 (0.0007) [2023-12-27 19:32:56,962][106226] Updated weights for policy 0, policy_version 44406 (0.0005) [2023-12-27 19:32:57,009][106226] Updated weights for policy 0, policy_version 44416 (0.0005) [2023-12-27 19:32:57,217][106225] Updated weights for policy 1, policy_version 44378 (0.0005) [2023-12-27 19:32:57,282][106225] Updated weights for policy 1, policy_version 44388 (0.0007) [2023-12-27 19:32:57,345][106225] Updated weights for policy 1, policy_version 44398 (0.0005) [2023-12-27 19:32:57,745][106226] Updated weights for policy 0, policy_version 44426 (0.0006) [2023-12-27 19:32:57,803][106226] Updated weights for policy 0, policy_version 44436 (0.0009) [2023-12-27 19:32:57,842][106225] Updated weights for policy 1, policy_version 44408 (0.0005) [2023-12-27 19:32:57,868][106226] Updated weights for policy 0, policy_version 44446 (0.0008) [2023-12-27 19:32:57,902][106225] Updated weights for policy 1, policy_version 44418 (0.0006) [2023-12-27 19:32:57,927][106226] Updated weights for policy 0, policy_version 44456 (0.0006) [2023-12-27 19:32:57,962][106225] Updated weights for policy 1, policy_version 44428 (0.0010) [2023-12-27 19:32:58,634][106225] Updated weights for policy 1, policy_version 44438 (0.0010) [2023-12-27 19:32:58,674][106226] Updated weights for policy 0, policy_version 44466 (0.0008) [2023-12-27 19:32:58,701][106225] Updated weights for policy 1, policy_version 44448 (0.0008) [2023-12-27 19:32:58,741][106226] Updated weights for policy 0, policy_version 44476 (0.0008) [2023-12-27 19:32:58,763][106225] Updated weights for policy 1, policy_version 44458 (0.0010) [2023-12-27 19:32:58,802][106226] Updated weights for policy 0, policy_version 44486 (0.0007) [2023-12-27 19:32:59,562][106225] Updated weights for policy 1, policy_version 44468 (0.0009) [2023-12-27 19:32:59,568][106226] Updated weights for policy 0, policy_version 44496 (0.0007) [2023-12-27 19:32:59,623][106225] Updated weights for policy 1, policy_version 44478 (0.0010) [2023-12-27 19:32:59,623][106226] Updated weights for policy 0, policy_version 44506 (0.0005) [2023-12-27 19:32:59,675][106226] Updated weights for policy 0, policy_version 44516 (0.0005) [2023-12-27 19:32:59,686][106225] Updated weights for policy 1, policy_version 44488 (0.0010) [2023-12-27 19:33:00,353][106226] Updated weights for policy 0, policy_version 44526 (0.0007) [2023-12-27 19:33:00,414][106226] Updated weights for policy 0, policy_version 44536 (0.0008) [2023-12-27 19:33:00,415][106225] Updated weights for policy 1, policy_version 44498 (0.0010) [2023-12-27 19:33:00,472][106225] Updated weights for policy 1, policy_version 44508 (0.0010) [2023-12-27 19:33:00,475][106226] Updated weights for policy 0, policy_version 44546 (0.0007) [2023-12-27 19:33:00,526][106225] Updated weights for policy 1, policy_version 44518 (0.0010) [2023-12-27 19:33:00,586][106225] Updated weights for policy 1, policy_version 44528 (0.0010) [2023-12-27 19:33:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 22814720. Throughput: 0: 9820.6, 1: 10113.0. Samples: 22809040. Policy #0 lag: (min: 4.0, avg: 8.5, max: 36.0) [2023-12-27 19:33:01,175][105115] Avg episode reward: [(0, '-5.752'), (1, '-6.497')] [2023-12-27 19:33:01,257][106226] Updated weights for policy 0, policy_version 44556 (0.0006) [2023-12-27 19:33:01,289][106225] Updated weights for policy 1, policy_version 44538 (0.0009) [2023-12-27 19:33:01,322][106226] Updated weights for policy 0, policy_version 44566 (0.0007) [2023-12-27 19:33:01,354][106225] Updated weights for policy 1, policy_version 44548 (0.0007) [2023-12-27 19:33:01,387][106226] Updated weights for policy 0, policy_version 44576 (0.0008) [2023-12-27 19:33:01,432][106225] Updated weights for policy 1, policy_version 44558 (0.0008) [2023-12-27 19:33:02,095][106226] Updated weights for policy 0, policy_version 44586 (0.0008) [2023-12-27 19:33:02,147][106226] Updated weights for policy 0, policy_version 44596 (0.0007) [2023-12-27 19:33:02,189][106225] Updated weights for policy 1, policy_version 44568 (0.0007) [2023-12-27 19:33:02,211][106226] Updated weights for policy 0, policy_version 44606 (0.0009) [2023-12-27 19:33:02,245][106225] Updated weights for policy 1, policy_version 44578 (0.0005) [2023-12-27 19:33:02,273][106226] Updated weights for policy 0, policy_version 44616 (0.0008) [2023-12-27 19:33:02,308][106225] Updated weights for policy 1, policy_version 44588 (0.0008) [2023-12-27 19:33:02,933][106226] Updated weights for policy 0, policy_version 44626 (0.0008) [2023-12-27 19:33:02,994][106226] Updated weights for policy 0, policy_version 44636 (0.0007) [2023-12-27 19:33:03,058][106226] Updated weights for policy 0, policy_version 44646 (0.0007) [2023-12-27 19:33:03,070][106225] Updated weights for policy 1, policy_version 44598 (0.0007) [2023-12-27 19:33:03,124][106225] Updated weights for policy 1, policy_version 44608 (0.0007) [2023-12-27 19:33:03,173][106225] Updated weights for policy 1, policy_version 44618 (0.0010) [2023-12-27 19:33:03,741][106226] Updated weights for policy 0, policy_version 44656 (0.0007) [2023-12-27 19:33:03,786][106226] Updated weights for policy 0, policy_version 44666 (0.0007) [2023-12-27 19:33:03,834][106225] Updated weights for policy 1, policy_version 44628 (0.0010) [2023-12-27 19:33:03,835][106226] Updated weights for policy 0, policy_version 44676 (0.0008) [2023-12-27 19:33:03,893][106225] Updated weights for policy 1, policy_version 44638 (0.0010) [2023-12-27 19:33:03,951][106225] Updated weights for policy 1, policy_version 44648 (0.0010) [2023-12-27 19:33:04,597][106226] Updated weights for policy 0, policy_version 44686 (0.0008) [2023-12-27 19:33:04,632][106225] Updated weights for policy 1, policy_version 44658 (0.0008) [2023-12-27 19:33:04,656][106226] Updated weights for policy 0, policy_version 44696 (0.0007) [2023-12-27 19:33:04,691][106225] Updated weights for policy 1, policy_version 44668 (0.0010) [2023-12-27 19:33:04,708][106226] Updated weights for policy 0, policy_version 44706 (0.0005) [2023-12-27 19:33:04,754][106225] Updated weights for policy 1, policy_version 44678 (0.0010) [2023-12-27 19:33:04,809][106225] Updated weights for policy 1, policy_version 44688 (0.0010) [2023-12-27 19:33:05,409][106226] Updated weights for policy 0, policy_version 44716 (0.0008) [2023-12-27 19:33:05,467][106226] Updated weights for policy 0, policy_version 44726 (0.0007) [2023-12-27 19:33:05,491][106225] Updated weights for policy 1, policy_version 44698 (0.0010) [2023-12-27 19:33:05,528][106226] Updated weights for policy 0, policy_version 44736 (0.0006) [2023-12-27 19:33:05,541][106225] Updated weights for policy 1, policy_version 44708 (0.0007) [2023-12-27 19:33:05,598][106225] Updated weights for policy 1, policy_version 44718 (0.0007) [2023-12-27 19:33:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 22913024. Throughput: 0: 9812.8, 1: 10143.9. Samples: 22925372. Policy #0 lag: (min: 4.0, avg: 8.5, max: 36.0) [2023-12-27 19:33:06,175][105115] Avg episode reward: [(0, '-5.946'), (1, '-6.289')] [2023-12-27 19:33:06,208][106225] Updated weights for policy 1, policy_version 44728 (0.0009) [2023-12-27 19:33:06,267][106225] Updated weights for policy 1, policy_version 44738 (0.0009) [2023-12-27 19:33:06,322][106226] Updated weights for policy 0, policy_version 44746 (0.0006) [2023-12-27 19:33:06,335][106225] Updated weights for policy 1, policy_version 44748 (0.0010) [2023-12-27 19:33:06,384][106226] Updated weights for policy 0, policy_version 44756 (0.0008) [2023-12-27 19:33:06,449][106226] Updated weights for policy 0, policy_version 44766 (0.0008) [2023-12-27 19:33:06,511][106226] Updated weights for policy 0, policy_version 44776 (0.0008) [2023-12-27 19:33:07,041][106225] Updated weights for policy 1, policy_version 44758 (0.0010) [2023-12-27 19:33:07,092][106225] Updated weights for policy 1, policy_version 44768 (0.0010) [2023-12-27 19:33:07,152][106225] Updated weights for policy 1, policy_version 44778 (0.0010) [2023-12-27 19:33:07,233][106226] Updated weights for policy 0, policy_version 44786 (0.0007) [2023-12-27 19:33:07,287][106226] Updated weights for policy 0, policy_version 44796 (0.0005) [2023-12-27 19:33:07,334][106226] Updated weights for policy 0, policy_version 44806 (0.0005) [2023-12-27 19:33:07,834][106225] Updated weights for policy 1, policy_version 44788 (0.0008) [2023-12-27 19:33:07,892][106225] Updated weights for policy 1, policy_version 44798 (0.0005) [2023-12-27 19:33:07,953][106225] Updated weights for policy 1, policy_version 44808 (0.0005) [2023-12-27 19:33:08,089][106226] Updated weights for policy 0, policy_version 44816 (0.0009) [2023-12-27 19:33:08,139][106226] Updated weights for policy 0, policy_version 44826 (0.0009) [2023-12-27 19:33:08,187][106226] Updated weights for policy 0, policy_version 44836 (0.0008) [2023-12-27 19:33:08,503][106225] Updated weights for policy 1, policy_version 44818 (0.0006) [2023-12-27 19:33:08,561][106225] Updated weights for policy 1, policy_version 44828 (0.0011) [2023-12-27 19:33:08,609][106225] Updated weights for policy 1, policy_version 44838 (0.0010) [2023-12-27 19:33:08,660][106225] Updated weights for policy 1, policy_version 44848 (0.0010) [2023-12-27 19:33:08,967][106226] Updated weights for policy 0, policy_version 44846 (0.0008) [2023-12-27 19:33:09,018][106226] Updated weights for policy 0, policy_version 44856 (0.0008) [2023-12-27 19:33:09,072][106226] Updated weights for policy 0, policy_version 44866 (0.0008) [2023-12-27 19:33:09,416][106225] Updated weights for policy 1, policy_version 44858 (0.0009) [2023-12-27 19:33:09,478][106225] Updated weights for policy 1, policy_version 44868 (0.0010) [2023-12-27 19:33:09,543][106225] Updated weights for policy 1, policy_version 44878 (0.0010) [2023-12-27 19:33:09,878][106226] Updated weights for policy 0, policy_version 44876 (0.0008) [2023-12-27 19:33:09,951][106226] Updated weights for policy 0, policy_version 44886 (0.0008) [2023-12-27 19:33:10,014][106226] Updated weights for policy 0, policy_version 44896 (0.0008) [2023-12-27 19:33:10,277][106225] Updated weights for policy 1, policy_version 44888 (0.0011) [2023-12-27 19:33:10,340][106225] Updated weights for policy 1, policy_version 44898 (0.0011) [2023-12-27 19:33:10,398][106225] Updated weights for policy 1, policy_version 44908 (0.0011) [2023-12-27 19:33:10,773][106226] Updated weights for policy 0, policy_version 44906 (0.0008) [2023-12-27 19:33:10,829][106226] Updated weights for policy 0, policy_version 44916 (0.0008) [2023-12-27 19:33:10,890][106226] Updated weights for policy 0, policy_version 44926 (0.0008) [2023-12-27 19:33:10,950][106226] Updated weights for policy 0, policy_version 44936 (0.0007) [2023-12-27 19:33:11,148][106225] Updated weights for policy 1, policy_version 44918 (0.0008) [2023-12-27 19:33:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19798.0, 300 sec: 19827.4). Total num frames: 23011328. Throughput: 0: 9781.7, 1: 10204.7. Samples: 22985388. Policy #0 lag: (min: 4.0, avg: 8.5, max: 36.0) [2023-12-27 19:33:11,175][105115] Avg episode reward: [(0, '-5.877'), (1, '-6.484')] [2023-12-27 19:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000044936_11509760.pth... [2023-12-27 19:33:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000043816_11223040.pth [2023-12-27 19:33:11,214][106225] Updated weights for policy 1, policy_version 44928 (0.0007) [2023-12-27 19:33:11,280][106225] Updated weights for policy 1, policy_version 44938 (0.0007) [2023-12-27 19:33:11,319][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000044944_11509760.pth... [2023-12-27 19:33:11,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000043760_11206656.pth [2023-12-27 19:33:11,766][106226] Updated weights for policy 0, policy_version 44946 (0.0007) [2023-12-27 19:33:11,819][106226] Updated weights for policy 0, policy_version 44956 (0.0007) [2023-12-27 19:33:11,876][106226] Updated weights for policy 0, policy_version 44966 (0.0009) [2023-12-27 19:33:12,025][106225] Updated weights for policy 1, policy_version 44948 (0.0006) [2023-12-27 19:33:12,082][106225] Updated weights for policy 1, policy_version 44958 (0.0006) [2023-12-27 19:33:12,138][106225] Updated weights for policy 1, policy_version 44968 (0.0007) [2023-12-27 19:33:12,700][106226] Updated weights for policy 0, policy_version 44976 (0.0007) [2023-12-27 19:33:12,766][106226] Updated weights for policy 0, policy_version 44986 (0.0008) [2023-12-27 19:33:12,823][106226] Updated weights for policy 0, policy_version 44996 (0.0009) [2023-12-27 19:33:12,854][106225] Updated weights for policy 1, policy_version 44978 (0.0005) [2023-12-27 19:33:12,916][106225] Updated weights for policy 1, policy_version 44988 (0.0009) [2023-12-27 19:33:12,978][106225] Updated weights for policy 1, policy_version 44998 (0.0009) [2023-12-27 19:33:13,028][106225] Updated weights for policy 1, policy_version 45008 (0.0008) [2023-12-27 19:33:13,577][106226] Updated weights for policy 0, policy_version 45006 (0.0009) [2023-12-27 19:33:13,636][106226] Updated weights for policy 0, policy_version 45016 (0.0008) [2023-12-27 19:33:13,665][106225] Updated weights for policy 1, policy_version 45018 (0.0006) [2023-12-27 19:33:13,693][106226] Updated weights for policy 0, policy_version 45026 (0.0009) [2023-12-27 19:33:13,719][106225] Updated weights for policy 1, policy_version 45028 (0.0006) [2023-12-27 19:33:13,779][106225] Updated weights for policy 1, policy_version 45038 (0.0007) [2023-12-27 19:33:14,359][106225] Updated weights for policy 1, policy_version 45048 (0.0008) [2023-12-27 19:33:14,360][106226] Updated weights for policy 0, policy_version 45036 (0.0008) [2023-12-27 19:33:14,416][106226] Updated weights for policy 0, policy_version 45046 (0.0007) [2023-12-27 19:33:14,420][106225] Updated weights for policy 1, policy_version 45058 (0.0008) [2023-12-27 19:33:14,468][106225] Updated weights for policy 1, policy_version 45068 (0.0008) [2023-12-27 19:33:14,472][106226] Updated weights for policy 0, policy_version 45056 (0.0005) [2023-12-27 19:33:15,158][106226] Updated weights for policy 0, policy_version 45066 (0.0008) [2023-12-27 19:33:15,219][106226] Updated weights for policy 0, policy_version 45076 (0.0008) [2023-12-27 19:33:15,229][106225] Updated weights for policy 1, policy_version 45078 (0.0007) [2023-12-27 19:33:15,286][106226] Updated weights for policy 0, policy_version 45086 (0.0011) [2023-12-27 19:33:15,292][106225] Updated weights for policy 1, policy_version 45088 (0.0008) [2023-12-27 19:33:15,352][106225] Updated weights for policy 1, policy_version 45098 (0.0006) [2023-12-27 19:33:15,352][106226] Updated weights for policy 0, policy_version 45096 (0.0010) [2023-12-27 19:33:15,917][106225] Updated weights for policy 1, policy_version 45108 (0.0008) [2023-12-27 19:33:15,974][106225] Updated weights for policy 1, policy_version 45118 (0.0008) [2023-12-27 19:33:16,027][106226] Updated weights for policy 0, policy_version 45106 (0.0006) [2023-12-27 19:33:16,039][106225] Updated weights for policy 1, policy_version 45128 (0.0007) [2023-12-27 19:33:16,080][106226] Updated weights for policy 0, policy_version 45116 (0.0006) [2023-12-27 19:33:16,135][106226] Updated weights for policy 0, policy_version 45126 (0.0006) [2023-12-27 19:33:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 23117824. Throughput: 0: 9632.8, 1: 10047.3. Samples: 23100060. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:16,176][105115] Avg episode reward: [(0, '-6.010'), (1, '-6.714')] [2023-12-27 19:33:16,712][106225] Updated weights for policy 1, policy_version 45138 (0.0007) [2023-12-27 19:33:16,726][106226] Updated weights for policy 0, policy_version 45136 (0.0007) [2023-12-27 19:33:16,772][106225] Updated weights for policy 1, policy_version 45148 (0.0006) [2023-12-27 19:33:16,790][106226] Updated weights for policy 0, policy_version 45146 (0.0008) [2023-12-27 19:33:16,823][106225] Updated weights for policy 1, policy_version 45158 (0.0006) [2023-12-27 19:33:16,854][106226] Updated weights for policy 0, policy_version 45156 (0.0008) [2023-12-27 19:33:16,879][106225] Updated weights for policy 1, policy_version 45168 (0.0007) [2023-12-27 19:33:17,567][106226] Updated weights for policy 0, policy_version 45166 (0.0008) [2023-12-27 19:33:17,569][106225] Updated weights for policy 1, policy_version 45178 (0.0007) [2023-12-27 19:33:17,616][106226] Updated weights for policy 0, policy_version 45176 (0.0008) [2023-12-27 19:33:17,629][106225] Updated weights for policy 1, policy_version 45188 (0.0008) [2023-12-27 19:33:17,670][106226] Updated weights for policy 0, policy_version 45186 (0.0007) [2023-12-27 19:33:17,686][106225] Updated weights for policy 1, policy_version 45198 (0.0007) [2023-12-27 19:33:18,306][106225] Updated weights for policy 1, policy_version 45208 (0.0006) [2023-12-27 19:33:18,374][106225] Updated weights for policy 1, policy_version 45218 (0.0009) [2023-12-27 19:33:18,431][106225] Updated weights for policy 1, policy_version 45228 (0.0009) [2023-12-27 19:33:18,457][106226] Updated weights for policy 0, policy_version 45196 (0.0005) [2023-12-27 19:33:18,523][106226] Updated weights for policy 0, policy_version 45206 (0.0008) [2023-12-27 19:33:18,585][106226] Updated weights for policy 0, policy_version 45216 (0.0009) [2023-12-27 19:33:19,143][106225] Updated weights for policy 1, policy_version 45238 (0.0007) [2023-12-27 19:33:19,190][106225] Updated weights for policy 1, policy_version 45248 (0.0008) [2023-12-27 19:33:19,256][106225] Updated weights for policy 1, policy_version 45258 (0.0008) [2023-12-27 19:33:19,328][106226] Updated weights for policy 0, policy_version 45226 (0.0009) [2023-12-27 19:33:19,393][106226] Updated weights for policy 0, policy_version 45236 (0.0009) [2023-12-27 19:33:19,446][106226] Updated weights for policy 0, policy_version 45246 (0.0008) [2023-12-27 19:33:19,512][106226] Updated weights for policy 0, policy_version 45256 (0.0008) [2023-12-27 19:33:20,067][106225] Updated weights for policy 1, policy_version 45268 (0.0009) [2023-12-27 19:33:20,123][106225] Updated weights for policy 1, policy_version 45278 (0.0009) [2023-12-27 19:33:20,174][106225] Updated weights for policy 1, policy_version 45288 (0.0009) [2023-12-27 19:33:20,230][106226] Updated weights for policy 0, policy_version 45266 (0.0007) [2023-12-27 19:33:20,292][106226] Updated weights for policy 0, policy_version 45276 (0.0008) [2023-12-27 19:33:20,359][106226] Updated weights for policy 0, policy_version 45286 (0.0008) [2023-12-27 19:33:20,838][106225] Updated weights for policy 1, policy_version 45298 (0.0007) [2023-12-27 19:33:20,904][106225] Updated weights for policy 1, policy_version 45308 (0.0009) [2023-12-27 19:33:20,965][106225] Updated weights for policy 1, policy_version 45318 (0.0008) [2023-12-27 19:33:21,027][106225] Updated weights for policy 1, policy_version 45328 (0.0006) [2023-12-27 19:33:21,050][106226] Updated weights for policy 0, policy_version 45296 (0.0008) [2023-12-27 19:33:21,114][106226] Updated weights for policy 0, policy_version 45306 (0.0008) [2023-12-27 19:33:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 23207936. Throughput: 0: 9648.5, 1: 10043.8. Samples: 23220004. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:21,175][105115] Avg episode reward: [(0, '-6.131'), (1, '-6.110')] [2023-12-27 19:33:21,180][106226] Updated weights for policy 0, policy_version 45316 (0.0008) [2023-12-27 19:33:21,811][106225] Updated weights for policy 1, policy_version 45338 (0.0010) [2023-12-27 19:33:21,876][106225] Updated weights for policy 1, policy_version 45348 (0.0011) [2023-12-27 19:33:21,926][106226] Updated weights for policy 0, policy_version 45326 (0.0009) [2023-12-27 19:33:21,943][106225] Updated weights for policy 1, policy_version 45358 (0.0009) [2023-12-27 19:33:21,994][106226] Updated weights for policy 0, policy_version 45336 (0.0007) [2023-12-27 19:33:22,053][106226] Updated weights for policy 0, policy_version 45346 (0.0007) [2023-12-27 19:33:22,648][106225] Updated weights for policy 1, policy_version 45368 (0.0008) [2023-12-27 19:33:22,710][106225] Updated weights for policy 1, policy_version 45378 (0.0007) [2023-12-27 19:33:22,768][106225] Updated weights for policy 1, policy_version 45388 (0.0005) [2023-12-27 19:33:22,826][106226] Updated weights for policy 0, policy_version 45356 (0.0008) [2023-12-27 19:33:22,893][106226] Updated weights for policy 0, policy_version 45366 (0.0008) [2023-12-27 19:33:22,957][106226] Updated weights for policy 0, policy_version 45376 (0.0009) [2023-12-27 19:33:23,365][106225] Updated weights for policy 1, policy_version 45398 (0.0007) [2023-12-27 19:33:23,417][106225] Updated weights for policy 1, policy_version 45408 (0.0010) [2023-12-27 19:33:23,466][106225] Updated weights for policy 1, policy_version 45418 (0.0006) [2023-12-27 19:33:23,746][106226] Updated weights for policy 0, policy_version 45386 (0.0010) [2023-12-27 19:33:23,800][106226] Updated weights for policy 0, policy_version 45396 (0.0009) [2023-12-27 19:33:23,852][106226] Updated weights for policy 0, policy_version 45406 (0.0008) [2023-12-27 19:33:23,914][106226] Updated weights for policy 0, policy_version 45416 (0.0007) [2023-12-27 19:33:24,058][106225] Updated weights for policy 1, policy_version 45428 (0.0008) [2023-12-27 19:33:24,118][106225] Updated weights for policy 1, policy_version 45438 (0.0008) [2023-12-27 19:33:24,182][106225] Updated weights for policy 1, policy_version 45448 (0.0010) [2023-12-27 19:33:24,740][106225] Updated weights for policy 1, policy_version 45458 (0.0009) [2023-12-27 19:33:24,746][106226] Updated weights for policy 0, policy_version 45426 (0.0010) [2023-12-27 19:33:24,800][106225] Updated weights for policy 1, policy_version 45468 (0.0005) [2023-12-27 19:33:24,811][106226] Updated weights for policy 0, policy_version 45436 (0.0008) [2023-12-27 19:33:24,853][106225] Updated weights for policy 1, policy_version 45478 (0.0005) [2023-12-27 19:33:24,870][106226] Updated weights for policy 0, policy_version 45446 (0.0008) [2023-12-27 19:33:24,910][106225] Updated weights for policy 1, policy_version 45488 (0.0005) [2023-12-27 19:33:25,483][106225] Updated weights for policy 1, policy_version 45498 (0.0010) [2023-12-27 19:33:25,538][106225] Updated weights for policy 1, policy_version 45508 (0.0005) [2023-12-27 19:33:25,592][106225] Updated weights for policy 1, policy_version 45518 (0.0005) [2023-12-27 19:33:25,644][106226] Updated weights for policy 0, policy_version 45456 (0.0008) [2023-12-27 19:33:25,697][106226] Updated weights for policy 0, policy_version 45466 (0.0007) [2023-12-27 19:33:25,749][106226] Updated weights for policy 0, policy_version 45476 (0.0009) [2023-12-27 19:33:26,119][106225] Updated weights for policy 1, policy_version 45528 (0.0005) [2023-12-27 19:33:26,174][106225] Updated weights for policy 1, policy_version 45538 (0.0005) [2023-12-27 19:33:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 23306240. Throughput: 0: 9544.8, 1: 10057.8. Samples: 23276884. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:26,175][105115] Avg episode reward: [(0, '-6.251'), (1, '-6.570')] [2023-12-27 19:33:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000045480_11649024.pth... [2023-12-27 19:33:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000044392_11370496.pth [2023-12-27 19:33:26,226][106225] Updated weights for policy 1, policy_version 45548 (0.0005) [2023-12-27 19:33:26,247][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000045552_11665408.pth... [2023-12-27 19:33:26,249][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000044336_11354112.pth [2023-12-27 19:33:26,604][106226] Updated weights for policy 0, policy_version 45486 (0.0009) [2023-12-27 19:33:26,651][106226] Updated weights for policy 0, policy_version 45496 (0.0007) [2023-12-27 19:33:26,703][106226] Updated weights for policy 0, policy_version 45506 (0.0008) [2023-12-27 19:33:26,738][106225] Updated weights for policy 1, policy_version 45558 (0.0007) [2023-12-27 19:33:26,790][106225] Updated weights for policy 1, policy_version 45568 (0.0010) [2023-12-27 19:33:26,838][106225] Updated weights for policy 1, policy_version 45578 (0.0009) [2023-12-27 19:33:27,466][106225] Updated weights for policy 1, policy_version 45588 (0.0006) [2023-12-27 19:33:27,479][106226] Updated weights for policy 0, policy_version 45516 (0.0007) [2023-12-27 19:33:27,509][106225] Updated weights for policy 1, policy_version 45598 (0.0005) [2023-12-27 19:33:27,537][106226] Updated weights for policy 0, policy_version 45526 (0.0008) [2023-12-27 19:33:27,563][106225] Updated weights for policy 1, policy_version 45608 (0.0005) [2023-12-27 19:33:27,589][106226] Updated weights for policy 0, policy_version 45536 (0.0009) [2023-12-27 19:33:28,104][106225] Updated weights for policy 1, policy_version 45618 (0.0007) [2023-12-27 19:33:28,152][106225] Updated weights for policy 1, policy_version 45628 (0.0006) [2023-12-27 19:33:28,201][106225] Updated weights for policy 1, policy_version 45638 (0.0010) [2023-12-27 19:33:28,245][106225] Updated weights for policy 1, policy_version 45648 (0.0010) [2023-12-27 19:33:28,399][106226] Updated weights for policy 0, policy_version 45546 (0.0008) [2023-12-27 19:33:28,459][106226] Updated weights for policy 0, policy_version 45556 (0.0009) [2023-12-27 19:33:28,524][106226] Updated weights for policy 0, policy_version 45566 (0.0009) [2023-12-27 19:33:28,583][106226] Updated weights for policy 0, policy_version 45576 (0.0009) [2023-12-27 19:33:29,022][106225] Updated weights for policy 1, policy_version 45658 (0.0008) [2023-12-27 19:33:29,086][106225] Updated weights for policy 1, policy_version 45668 (0.0009) [2023-12-27 19:33:29,143][106225] Updated weights for policy 1, policy_version 45678 (0.0009) [2023-12-27 19:33:29,210][106226] Updated weights for policy 0, policy_version 45586 (0.0008) [2023-12-27 19:33:29,279][106226] Updated weights for policy 0, policy_version 45596 (0.0010) [2023-12-27 19:33:29,348][106226] Updated weights for policy 0, policy_version 45606 (0.0010) [2023-12-27 19:33:29,829][106225] Updated weights for policy 1, policy_version 45688 (0.0008) [2023-12-27 19:33:29,893][106225] Updated weights for policy 1, policy_version 45698 (0.0007) [2023-12-27 19:33:29,962][106225] Updated weights for policy 1, policy_version 45708 (0.0009) [2023-12-27 19:33:30,017][106226] Updated weights for policy 0, policy_version 45616 (0.0008) [2023-12-27 19:33:30,079][106226] Updated weights for policy 0, policy_version 45626 (0.0008) [2023-12-27 19:33:30,141][106226] Updated weights for policy 0, policy_version 45636 (0.0008) [2023-12-27 19:33:30,626][106225] Updated weights for policy 1, policy_version 45718 (0.0009) [2023-12-27 19:33:30,677][106225] Updated weights for policy 1, policy_version 45728 (0.0008) [2023-12-27 19:33:30,727][106225] Updated weights for policy 1, policy_version 45738 (0.0008) [2023-12-27 19:33:30,814][106226] Updated weights for policy 0, policy_version 45646 (0.0006) [2023-12-27 19:33:30,865][106226] Updated weights for policy 0, policy_version 45656 (0.0007) [2023-12-27 19:33:30,917][106226] Updated weights for policy 0, policy_version 45666 (0.0009) [2023-12-27 19:33:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 23412736. Throughput: 0: 9499.1, 1: 10235.3. Samples: 23401040. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:31,175][105115] Avg episode reward: [(0, '-5.946'), (1, '-6.519')] [2023-12-27 19:33:31,507][106225] Updated weights for policy 1, policy_version 45748 (0.0008) [2023-12-27 19:33:31,567][106225] Updated weights for policy 1, policy_version 45758 (0.0005) [2023-12-27 19:33:31,635][106225] Updated weights for policy 1, policy_version 45768 (0.0007) [2023-12-27 19:33:31,681][106226] Updated weights for policy 0, policy_version 45676 (0.0008) [2023-12-27 19:33:31,749][106226] Updated weights for policy 0, policy_version 45686 (0.0008) [2023-12-27 19:33:31,813][106226] Updated weights for policy 0, policy_version 45696 (0.0008) [2023-12-27 19:33:32,321][106225] Updated weights for policy 1, policy_version 45778 (0.0009) [2023-12-27 19:33:32,394][106225] Updated weights for policy 1, policy_version 45788 (0.0009) [2023-12-27 19:33:32,457][106225] Updated weights for policy 1, policy_version 45798 (0.0008) [2023-12-27 19:33:32,508][106226] Updated weights for policy 0, policy_version 45706 (0.0008) [2023-12-27 19:33:32,522][106225] Updated weights for policy 1, policy_version 45808 (0.0007) [2023-12-27 19:33:32,568][106226] Updated weights for policy 0, policy_version 45716 (0.0005) [2023-12-27 19:33:32,628][106226] Updated weights for policy 0, policy_version 45726 (0.0007) [2023-12-27 19:33:32,688][106226] Updated weights for policy 0, policy_version 45736 (0.0009) [2023-12-27 19:33:33,255][106225] Updated weights for policy 1, policy_version 45818 (0.0008) [2023-12-27 19:33:33,317][106225] Updated weights for policy 1, policy_version 45828 (0.0009) [2023-12-27 19:33:33,379][106225] Updated weights for policy 1, policy_version 45838 (0.0007) [2023-12-27 19:33:33,380][106226] Updated weights for policy 0, policy_version 45746 (0.0006) [2023-12-27 19:33:33,445][106226] Updated weights for policy 0, policy_version 45756 (0.0006) [2023-12-27 19:33:33,493][106226] Updated weights for policy 0, policy_version 45766 (0.0008) [2023-12-27 19:33:34,042][106225] Updated weights for policy 1, policy_version 45848 (0.0006) [2023-12-27 19:33:34,095][106225] Updated weights for policy 1, policy_version 45858 (0.0005) [2023-12-27 19:33:34,151][106225] Updated weights for policy 1, policy_version 45868 (0.0008) [2023-12-27 19:33:34,237][106226] Updated weights for policy 0, policy_version 45776 (0.0006) [2023-12-27 19:33:34,300][106226] Updated weights for policy 0, policy_version 45786 (0.0007) [2023-12-27 19:33:34,354][106226] Updated weights for policy 0, policy_version 45796 (0.0007) [2023-12-27 19:33:34,851][106225] Updated weights for policy 1, policy_version 45878 (0.0008) [2023-12-27 19:33:34,906][106225] Updated weights for policy 1, policy_version 45888 (0.0008) [2023-12-27 19:33:34,969][106225] Updated weights for policy 1, policy_version 45898 (0.0005) [2023-12-27 19:33:35,078][106226] Updated weights for policy 0, policy_version 45806 (0.0008) [2023-12-27 19:33:35,137][106226] Updated weights for policy 0, policy_version 45816 (0.0008) [2023-12-27 19:33:35,181][106226] Updated weights for policy 0, policy_version 45826 (0.0008) [2023-12-27 19:33:35,623][106225] Updated weights for policy 1, policy_version 45908 (0.0007) [2023-12-27 19:33:35,681][106225] Updated weights for policy 1, policy_version 45918 (0.0009) [2023-12-27 19:33:35,745][106225] Updated weights for policy 1, policy_version 45928 (0.0009) [2023-12-27 19:33:35,930][106226] Updated weights for policy 0, policy_version 45836 (0.0008) [2023-12-27 19:33:35,975][106226] Updated weights for policy 0, policy_version 45846 (0.0007) [2023-12-27 19:33:36,022][106226] Updated weights for policy 0, policy_version 45856 (0.0008) [2023-12-27 19:33:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 23511040. Throughput: 0: 9481.4, 1: 10216.8. Samples: 23517752. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:36,175][105115] Avg episode reward: [(0, '-5.430'), (1, '-6.537')] [2023-12-27 19:33:36,434][106225] Updated weights for policy 1, policy_version 45938 (0.0007) [2023-12-27 19:33:36,502][106225] Updated weights for policy 1, policy_version 45948 (0.0009) [2023-12-27 19:33:36,561][106225] Updated weights for policy 1, policy_version 45958 (0.0009) [2023-12-27 19:33:36,618][106225] Updated weights for policy 1, policy_version 45968 (0.0008) [2023-12-27 19:33:36,774][106226] Updated weights for policy 0, policy_version 45866 (0.0009) [2023-12-27 19:33:36,829][106226] Updated weights for policy 0, policy_version 45876 (0.0008) [2023-12-27 19:33:36,893][106226] Updated weights for policy 0, policy_version 45886 (0.0009) [2023-12-27 19:33:36,951][106226] Updated weights for policy 0, policy_version 45896 (0.0008) [2023-12-27 19:33:37,245][106225] Updated weights for policy 1, policy_version 45978 (0.0008) [2023-12-27 19:33:37,298][106225] Updated weights for policy 1, policy_version 45988 (0.0007) [2023-12-27 19:33:37,360][106225] Updated weights for policy 1, policy_version 45998 (0.0006) [2023-12-27 19:33:37,729][106226] Updated weights for policy 0, policy_version 45906 (0.0009) [2023-12-27 19:33:37,795][106226] Updated weights for policy 0, policy_version 45916 (0.0008) [2023-12-27 19:33:37,855][106226] Updated weights for policy 0, policy_version 45926 (0.0008) [2023-12-27 19:33:38,038][106225] Updated weights for policy 1, policy_version 46008 (0.0006) [2023-12-27 19:33:38,094][106225] Updated weights for policy 1, policy_version 46018 (0.0007) [2023-12-27 19:33:38,154][106225] Updated weights for policy 1, policy_version 46028 (0.0007) [2023-12-27 19:33:38,664][106226] Updated weights for policy 0, policy_version 45936 (0.0008) [2023-12-27 19:33:38,724][106226] Updated weights for policy 0, policy_version 45946 (0.0008) [2023-12-27 19:33:38,785][106226] Updated weights for policy 0, policy_version 45956 (0.0009) [2023-12-27 19:33:38,797][106225] Updated weights for policy 1, policy_version 46038 (0.0008) [2023-12-27 19:33:38,860][106225] Updated weights for policy 1, policy_version 46048 (0.0010) [2023-12-27 19:33:38,924][106225] Updated weights for policy 1, policy_version 46058 (0.0010) [2023-12-27 19:33:39,577][106226] Updated weights for policy 0, policy_version 45966 (0.0009) [2023-12-27 19:33:39,627][106226] Updated weights for policy 0, policy_version 45976 (0.0009) [2023-12-27 19:33:39,675][106226] Updated weights for policy 0, policy_version 45986 (0.0007) [2023-12-27 19:33:39,695][106225] Updated weights for policy 1, policy_version 46068 (0.0009) [2023-12-27 19:33:39,757][106225] Updated weights for policy 1, policy_version 46078 (0.0007) [2023-12-27 19:33:39,819][106225] Updated weights for policy 1, policy_version 46088 (0.0006) [2023-12-27 19:33:40,471][106226] Updated weights for policy 0, policy_version 45996 (0.0006) [2023-12-27 19:33:40,485][106225] Updated weights for policy 1, policy_version 46098 (0.0008) [2023-12-27 19:33:40,531][106226] Updated weights for policy 0, policy_version 46006 (0.0007) [2023-12-27 19:33:40,533][106225] Updated weights for policy 1, policy_version 46108 (0.0005) [2023-12-27 19:33:40,581][106225] Updated weights for policy 1, policy_version 46118 (0.0005) [2023-12-27 19:33:40,589][106226] Updated weights for policy 0, policy_version 46016 (0.0009) [2023-12-27 19:33:40,635][106225] Updated weights for policy 1, policy_version 46128 (0.0006) [2023-12-27 19:33:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 23601152. Throughput: 0: 9463.5, 1: 10279.4. Samples: 23576516. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 19:33:41,175][105115] Avg episode reward: [(0, '-6.299'), (1, '-6.550')] [2023-12-27 19:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000046128_11812864.pth... [2023-12-27 19:33:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000046024_11788288.pth... [2023-12-27 19:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000044944_11509760.pth [2023-12-27 19:33:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000044936_11509760.pth [2023-12-27 19:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000046128_11812864.pth [2023-12-27 19:33:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000046024_11788288.pth [2023-12-27 19:33:41,271][106226] Updated weights for policy 0, policy_version 46026 (0.0007) [2023-12-27 19:33:41,337][106226] Updated weights for policy 0, policy_version 46036 (0.0009) [2023-12-27 19:33:41,407][106225] Updated weights for policy 1, policy_version 46138 (0.0009) [2023-12-27 19:33:41,408][106226] Updated weights for policy 0, policy_version 46046 (0.0008) [2023-12-27 19:33:41,466][106226] Updated weights for policy 0, policy_version 46056 (0.0006) [2023-12-27 19:33:41,471][106225] Updated weights for policy 1, policy_version 46148 (0.0008) [2023-12-27 19:33:41,527][106225] Updated weights for policy 1, policy_version 46158 (0.0008) [2023-12-27 19:33:42,156][106226] Updated weights for policy 0, policy_version 46066 (0.0009) [2023-12-27 19:33:42,217][106226] Updated weights for policy 0, policy_version 46076 (0.0009) [2023-12-27 19:33:42,273][106226] Updated weights for policy 0, policy_version 46086 (0.0009) [2023-12-27 19:33:42,330][106225] Updated weights for policy 1, policy_version 46168 (0.0008) [2023-12-27 19:33:42,394][106225] Updated weights for policy 1, policy_version 46178 (0.0009) [2023-12-27 19:33:42,442][106225] Updated weights for policy 1, policy_version 46188 (0.0008) [2023-12-27 19:33:42,948][106226] Updated weights for policy 0, policy_version 46096 (0.0008) [2023-12-27 19:33:43,011][106226] Updated weights for policy 0, policy_version 46106 (0.0007) [2023-12-27 19:33:43,064][106226] Updated weights for policy 0, policy_version 46116 (0.0009) [2023-12-27 19:33:43,170][106225] Updated weights for policy 1, policy_version 46198 (0.0008) [2023-12-27 19:33:43,215][106225] Updated weights for policy 1, policy_version 46208 (0.0006) [2023-12-27 19:33:43,274][106225] Updated weights for policy 1, policy_version 46218 (0.0006) [2023-12-27 19:33:43,777][106226] Updated weights for policy 0, policy_version 46126 (0.0007) [2023-12-27 19:33:43,836][106226] Updated weights for policy 0, policy_version 46136 (0.0005) [2023-12-27 19:33:43,884][106226] Updated weights for policy 0, policy_version 46146 (0.0005) [2023-12-27 19:33:43,955][106225] Updated weights for policy 1, policy_version 46228 (0.0008) [2023-12-27 19:33:44,015][106225] Updated weights for policy 1, policy_version 46238 (0.0009) [2023-12-27 19:33:44,072][106225] Updated weights for policy 1, policy_version 46248 (0.0009) [2023-12-27 19:33:44,453][106226] Updated weights for policy 0, policy_version 46156 (0.0007) [2023-12-27 19:33:44,514][106226] Updated weights for policy 0, policy_version 46166 (0.0008) [2023-12-27 19:33:44,571][106226] Updated weights for policy 0, policy_version 46176 (0.0008) [2023-12-27 19:33:44,843][106225] Updated weights for policy 1, policy_version 46258 (0.0008) [2023-12-27 19:33:44,914][106225] Updated weights for policy 1, policy_version 46268 (0.0008) [2023-12-27 19:33:44,965][106225] Updated weights for policy 1, policy_version 46278 (0.0010) [2023-12-27 19:33:45,016][106225] Updated weights for policy 1, policy_version 46288 (0.0010) [2023-12-27 19:33:45,277][106226] Updated weights for policy 0, policy_version 46186 (0.0008) [2023-12-27 19:33:45,335][106226] Updated weights for policy 0, policy_version 46196 (0.0008) [2023-12-27 19:33:45,384][106226] Updated weights for policy 0, policy_version 46206 (0.0007) [2023-12-27 19:33:45,434][106226] Updated weights for policy 0, policy_version 46216 (0.0005) [2023-12-27 19:33:45,733][106225] Updated weights for policy 1, policy_version 46298 (0.0010) [2023-12-27 19:33:45,792][106225] Updated weights for policy 1, policy_version 46308 (0.0010) [2023-12-27 19:33:45,848][106225] Updated weights for policy 1, policy_version 46318 (0.0010) [2023-12-27 19:33:46,098][106226] Updated weights for policy 0, policy_version 46226 (0.0007) [2023-12-27 19:33:46,157][106226] Updated weights for policy 0, policy_version 46236 (0.0008) [2023-12-27 19:33:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 23699456. Throughput: 0: 9477.2, 1: 10132.5. Samples: 23691480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:33:46,175][105115] Avg episode reward: [(0, '-6.031'), (1, '-6.776')] [2023-12-27 19:33:46,219][106226] Updated weights for policy 0, policy_version 46246 (0.0008) [2023-12-27 19:33:46,543][106225] Updated weights for policy 1, policy_version 46328 (0.0009) [2023-12-27 19:33:46,601][106225] Updated weights for policy 1, policy_version 46338 (0.0008) [2023-12-27 19:33:46,669][106225] Updated weights for policy 1, policy_version 46348 (0.0005) [2023-12-27 19:33:46,936][106226] Updated weights for policy 0, policy_version 46256 (0.0008) [2023-12-27 19:33:46,997][106226] Updated weights for policy 0, policy_version 46266 (0.0007) [2023-12-27 19:33:47,064][106226] Updated weights for policy 0, policy_version 46276 (0.0005) [2023-12-27 19:33:47,338][106225] Updated weights for policy 1, policy_version 46358 (0.0006) [2023-12-27 19:33:47,400][106225] Updated weights for policy 1, policy_version 46368 (0.0005) [2023-12-27 19:33:47,456][106225] Updated weights for policy 1, policy_version 46379 (0.0007) [2023-12-27 19:33:47,671][106226] Updated weights for policy 0, policy_version 46286 (0.0006) [2023-12-27 19:33:47,734][106226] Updated weights for policy 0, policy_version 46296 (0.0006) [2023-12-27 19:33:47,792][106226] Updated weights for policy 0, policy_version 46306 (0.0005) [2023-12-27 19:33:48,150][106225] Updated weights for policy 1, policy_version 46389 (0.0008) [2023-12-27 19:33:48,198][106225] Updated weights for policy 1, policy_version 46399 (0.0009) [2023-12-27 19:33:48,249][106225] Updated weights for policy 1, policy_version 46409 (0.0008) [2023-12-27 19:33:48,434][106226] Updated weights for policy 0, policy_version 46316 (0.0007) [2023-12-27 19:33:48,484][106226] Updated weights for policy 0, policy_version 46326 (0.0007) [2023-12-27 19:33:48,547][106226] Updated weights for policy 0, policy_version 46336 (0.0005) [2023-12-27 19:33:49,011][106225] Updated weights for policy 1, policy_version 46419 (0.0007) [2023-12-27 19:33:49,066][106225] Updated weights for policy 1, policy_version 46429 (0.0006) [2023-12-27 19:33:49,114][106225] Updated weights for policy 1, policy_version 46439 (0.0005) [2023-12-27 19:33:49,223][106226] Updated weights for policy 0, policy_version 46346 (0.0007) [2023-12-27 19:33:49,283][106226] Updated weights for policy 0, policy_version 46356 (0.0008) [2023-12-27 19:33:49,341][106226] Updated weights for policy 0, policy_version 46366 (0.0008) [2023-12-27 19:33:49,401][106226] Updated weights for policy 0, policy_version 46376 (0.0008) [2023-12-27 19:33:49,819][106225] Updated weights for policy 1, policy_version 46449 (0.0006) [2023-12-27 19:33:49,888][106225] Updated weights for policy 1, policy_version 46459 (0.0008) [2023-12-27 19:33:49,955][106225] Updated weights for policy 1, policy_version 46469 (0.0007) [2023-12-27 19:33:50,021][106225] Updated weights for policy 1, policy_version 46479 (0.0006) [2023-12-27 19:33:50,140][106226] Updated weights for policy 0, policy_version 46386 (0.0008) [2023-12-27 19:33:50,200][106226] Updated weights for policy 0, policy_version 46396 (0.0009) [2023-12-27 19:33:50,262][106226] Updated weights for policy 0, policy_version 46406 (0.0005) [2023-12-27 19:33:50,761][106225] Updated weights for policy 1, policy_version 46489 (0.0007) [2023-12-27 19:33:50,817][106225] Updated weights for policy 1, policy_version 46499 (0.0007) [2023-12-27 19:33:50,866][106226] Updated weights for policy 0, policy_version 46416 (0.0008) [2023-12-27 19:33:50,877][106225] Updated weights for policy 1, policy_version 46509 (0.0007) [2023-12-27 19:33:50,925][106226] Updated weights for policy 0, policy_version 46426 (0.0008) [2023-12-27 19:33:50,990][106226] Updated weights for policy 0, policy_version 46436 (0.0008) [2023-12-27 19:33:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 23805952. Throughput: 0: 9565.8, 1: 10114.7. Samples: 23810992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:33:51,175][105115] Avg episode reward: [(0, '-5.791'), (1, '-6.716')] [2023-12-27 19:33:51,672][106225] Updated weights for policy 1, policy_version 46519 (0.0008) [2023-12-27 19:33:51,731][106225] Updated weights for policy 1, policy_version 46529 (0.0008) [2023-12-27 19:33:51,743][106226] Updated weights for policy 0, policy_version 46446 (0.0008) [2023-12-27 19:33:51,791][106225] Updated weights for policy 1, policy_version 46539 (0.0007) [2023-12-27 19:33:51,812][106226] Updated weights for policy 0, policy_version 46456 (0.0008) [2023-12-27 19:33:51,876][106226] Updated weights for policy 0, policy_version 46466 (0.0008) [2023-12-27 19:33:52,535][106226] Updated weights for policy 0, policy_version 46476 (0.0008) [2023-12-27 19:33:52,542][106225] Updated weights for policy 1, policy_version 46549 (0.0005) [2023-12-27 19:33:52,589][106226] Updated weights for policy 0, policy_version 46486 (0.0009) [2023-12-27 19:33:52,603][106225] Updated weights for policy 1, policy_version 46559 (0.0006) [2023-12-27 19:33:52,648][106226] Updated weights for policy 0, policy_version 46496 (0.0008) [2023-12-27 19:33:52,654][106225] Updated weights for policy 1, policy_version 46569 (0.0005) [2023-12-27 19:33:53,341][106225] Updated weights for policy 1, policy_version 46579 (0.0007) [2023-12-27 19:33:53,381][106226] Updated weights for policy 0, policy_version 46506 (0.0007) [2023-12-27 19:33:53,390][106225] Updated weights for policy 1, policy_version 46589 (0.0009) [2023-12-27 19:33:53,437][106226] Updated weights for policy 0, policy_version 46516 (0.0009) [2023-12-27 19:33:53,445][106225] Updated weights for policy 1, policy_version 46599 (0.0006) [2023-12-27 19:33:53,493][106226] Updated weights for policy 0, policy_version 46526 (0.0008) [2023-12-27 19:33:53,548][106226] Updated weights for policy 0, policy_version 46536 (0.0009) [2023-12-27 19:33:53,994][106225] Updated weights for policy 1, policy_version 46609 (0.0007) [2023-12-27 19:33:54,040][106225] Updated weights for policy 1, policy_version 46619 (0.0005) [2023-12-27 19:33:54,094][106225] Updated weights for policy 1, policy_version 46629 (0.0006) [2023-12-27 19:33:54,150][106225] Updated weights for policy 1, policy_version 46639 (0.0008) [2023-12-27 19:33:54,226][106226] Updated weights for policy 0, policy_version 46546 (0.0010) [2023-12-27 19:33:54,282][106226] Updated weights for policy 0, policy_version 46556 (0.0008) [2023-12-27 19:33:54,344][106226] Updated weights for policy 0, policy_version 46566 (0.0011) [2023-12-27 19:33:54,789][106225] Updated weights for policy 1, policy_version 46649 (0.0010) [2023-12-27 19:33:54,842][106225] Updated weights for policy 1, policy_version 46659 (0.0010) [2023-12-27 19:33:54,905][106225] Updated weights for policy 1, policy_version 46669 (0.0010) [2023-12-27 19:33:54,914][106226] Updated weights for policy 0, policy_version 46576 (0.0008) [2023-12-27 19:33:54,964][106226] Updated weights for policy 0, policy_version 46586 (0.0005) [2023-12-27 19:33:55,025][106226] Updated weights for policy 0, policy_version 46596 (0.0006) [2023-12-27 19:33:55,534][106225] Updated weights for policy 1, policy_version 46679 (0.0007) [2023-12-27 19:33:55,595][106225] Updated weights for policy 1, policy_version 46689 (0.0008) [2023-12-27 19:33:55,645][106226] Updated weights for policy 0, policy_version 46606 (0.0008) [2023-12-27 19:33:55,653][106225] Updated weights for policy 1, policy_version 46699 (0.0007) [2023-12-27 19:33:55,691][106226] Updated weights for policy 0, policy_version 46616 (0.0010) [2023-12-27 19:33:55,742][106226] Updated weights for policy 0, policy_version 46626 (0.0011) [2023-12-27 19:33:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 23904256. Throughput: 0: 9593.1, 1: 10050.4. Samples: 23869344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:33:56,175][105115] Avg episode reward: [(0, '-6.026'), (1, '-6.354')] [2023-12-27 19:33:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000046632_11943936.pth... [2023-12-27 19:33:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000045480_11649024.pth [2023-12-27 19:33:56,225][106225] Updated weights for policy 1, policy_version 46709 (0.0007) [2023-12-27 19:33:56,296][106225] Updated weights for policy 1, policy_version 46720 (0.0006) [2023-12-27 19:33:56,358][106225] Updated weights for policy 1, policy_version 46730 (0.0005) [2023-12-27 19:33:56,390][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000046736_11968512.pth... [2023-12-27 19:33:56,393][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000045552_11665408.pth [2023-12-27 19:33:56,400][106226] Updated weights for policy 0, policy_version 46636 (0.0011) [2023-12-27 19:33:56,455][106226] Updated weights for policy 0, policy_version 46646 (0.0011) [2023-12-27 19:33:56,505][106226] Updated weights for policy 0, policy_version 46656 (0.0011) [2023-12-27 19:33:56,887][106225] Updated weights for policy 1, policy_version 46740 (0.0006) [2023-12-27 19:33:56,940][106225] Updated weights for policy 1, policy_version 46750 (0.0006) [2023-12-27 19:33:57,002][106225] Updated weights for policy 1, policy_version 46760 (0.0005) [2023-12-27 19:33:57,250][106226] Updated weights for policy 0, policy_version 46666 (0.0010) [2023-12-27 19:33:57,304][106226] Updated weights for policy 0, policy_version 46676 (0.0008) [2023-12-27 19:33:57,380][106226] Updated weights for policy 0, policy_version 46686 (0.0009) [2023-12-27 19:33:57,432][106226] Updated weights for policy 0, policy_version 46696 (0.0008) [2023-12-27 19:33:57,575][106225] Updated weights for policy 1, policy_version 46770 (0.0006) [2023-12-27 19:33:57,632][106225] Updated weights for policy 1, policy_version 46780 (0.0006) [2023-12-27 19:33:57,687][106225] Updated weights for policy 1, policy_version 46790 (0.0005) [2023-12-27 19:33:57,747][106225] Updated weights for policy 1, policy_version 46800 (0.0005) [2023-12-27 19:33:58,145][106226] Updated weights for policy 0, policy_version 46706 (0.0005) [2023-12-27 19:33:58,216][106226] Updated weights for policy 0, policy_version 46716 (0.0007) [2023-12-27 19:33:58,279][106226] Updated weights for policy 0, policy_version 46726 (0.0011) [2023-12-27 19:33:58,342][106225] Updated weights for policy 1, policy_version 46810 (0.0007) [2023-12-27 19:33:58,415][106225] Updated weights for policy 1, policy_version 46821 (0.0008) [2023-12-27 19:33:58,481][106225] Updated weights for policy 1, policy_version 46831 (0.0008) [2023-12-27 19:33:59,046][106226] Updated weights for policy 0, policy_version 46736 (0.0011) [2023-12-27 19:33:59,111][106226] Updated weights for policy 0, policy_version 46746 (0.0008) [2023-12-27 19:33:59,180][106226] Updated weights for policy 0, policy_version 46757 (0.0008) [2023-12-27 19:33:59,341][106225] Updated weights for policy 1, policy_version 46841 (0.0007) [2023-12-27 19:33:59,405][106225] Updated weights for policy 1, policy_version 46851 (0.0008) [2023-12-27 19:33:59,458][106225] Updated weights for policy 1, policy_version 46861 (0.0009) [2023-12-27 19:34:00,017][106226] Updated weights for policy 0, policy_version 46767 (0.0009) [2023-12-27 19:34:00,087][106226] Updated weights for policy 0, policy_version 46777 (0.0011) [2023-12-27 19:34:00,164][106226] Updated weights for policy 0, policy_version 46787 (0.0011) [2023-12-27 19:34:00,221][106225] Updated weights for policy 1, policy_version 46871 (0.0007) [2023-12-27 19:34:00,275][106225] Updated weights for policy 1, policy_version 46881 (0.0007) [2023-12-27 19:34:00,326][106225] Updated weights for policy 1, policy_version 46891 (0.0008) [2023-12-27 19:34:00,776][106226] Updated weights for policy 0, policy_version 46797 (0.0010) [2023-12-27 19:34:00,823][106226] Updated weights for policy 0, policy_version 46807 (0.0008) [2023-12-27 19:34:00,883][106226] Updated weights for policy 0, policy_version 46817 (0.0008) [2023-12-27 19:34:01,063][106225] Updated weights for policy 1, policy_version 46901 (0.0009) [2023-12-27 19:34:01,121][106225] Updated weights for policy 1, policy_version 46911 (0.0008) [2023-12-27 19:34:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 24002560. Throughput: 0: 9685.6, 1: 10175.0. Samples: 23993788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:01,175][105115] Avg episode reward: [(0, '-6.075'), (1, '-6.470')] [2023-12-27 19:34:01,187][106225] Updated weights for policy 1, policy_version 46921 (0.0008) [2023-12-27 19:34:01,579][106226] Updated weights for policy 0, policy_version 46827 (0.0006) [2023-12-27 19:34:01,646][106226] Updated weights for policy 0, policy_version 46837 (0.0006) [2023-12-27 19:34:01,703][106226] Updated weights for policy 0, policy_version 46847 (0.0006) [2023-12-27 19:34:01,953][106225] Updated weights for policy 1, policy_version 46931 (0.0008) [2023-12-27 19:34:02,014][106225] Updated weights for policy 1, policy_version 46941 (0.0008) [2023-12-27 19:34:02,074][106225] Updated weights for policy 1, policy_version 46951 (0.0008) [2023-12-27 19:34:02,436][106226] Updated weights for policy 0, policy_version 46857 (0.0008) [2023-12-27 19:34:02,487][106226] Updated weights for policy 0, policy_version 46867 (0.0008) [2023-12-27 19:34:02,535][106226] Updated weights for policy 0, policy_version 46877 (0.0008) [2023-12-27 19:34:02,593][106226] Updated weights for policy 0, policy_version 46887 (0.0007) [2023-12-27 19:34:02,827][106225] Updated weights for policy 1, policy_version 46961 (0.0007) [2023-12-27 19:34:02,875][106225] Updated weights for policy 1, policy_version 46971 (0.0008) [2023-12-27 19:34:02,927][106225] Updated weights for policy 1, policy_version 46981 (0.0007) [2023-12-27 19:34:02,992][106225] Updated weights for policy 1, policy_version 46991 (0.0005) [2023-12-27 19:34:03,273][106226] Updated weights for policy 0, policy_version 46897 (0.0006) [2023-12-27 19:34:03,331][106226] Updated weights for policy 0, policy_version 46907 (0.0005) [2023-12-27 19:34:03,386][106226] Updated weights for policy 0, policy_version 46917 (0.0005) [2023-12-27 19:34:03,674][106225] Updated weights for policy 1, policy_version 47001 (0.0006) [2023-12-27 19:34:03,731][106225] Updated weights for policy 1, policy_version 47011 (0.0005) [2023-12-27 19:34:03,790][106225] Updated weights for policy 1, policy_version 47021 (0.0005) [2023-12-27 19:34:04,134][106226] Updated weights for policy 0, policy_version 46927 (0.0007) [2023-12-27 19:34:04,202][106226] Updated weights for policy 0, policy_version 46937 (0.0009) [2023-12-27 19:34:04,269][106226] Updated weights for policy 0, policy_version 46947 (0.0008) [2023-12-27 19:34:04,452][106225] Updated weights for policy 1, policy_version 47031 (0.0009) [2023-12-27 19:34:04,515][106225] Updated weights for policy 1, policy_version 47041 (0.0010) [2023-12-27 19:34:04,580][106225] Updated weights for policy 1, policy_version 47051 (0.0010) [2023-12-27 19:34:05,011][106226] Updated weights for policy 0, policy_version 46957 (0.0008) [2023-12-27 19:34:05,056][106226] Updated weights for policy 0, policy_version 46967 (0.0008) [2023-12-27 19:34:05,103][106226] Updated weights for policy 0, policy_version 46977 (0.0008) [2023-12-27 19:34:05,294][106225] Updated weights for policy 1, policy_version 47061 (0.0009) [2023-12-27 19:34:05,344][106225] Updated weights for policy 1, policy_version 47071 (0.0007) [2023-12-27 19:34:05,390][106225] Updated weights for policy 1, policy_version 47081 (0.0008) [2023-12-27 19:34:05,894][106226] Updated weights for policy 0, policy_version 46987 (0.0007) [2023-12-27 19:34:05,952][106226] Updated weights for policy 0, policy_version 46997 (0.0005) [2023-12-27 19:34:06,012][106226] Updated weights for policy 0, policy_version 47007 (0.0005) [2023-12-27 19:34:06,039][106225] Updated weights for policy 1, policy_version 47091 (0.0007) [2023-12-27 19:34:06,101][106225] Updated weights for policy 1, policy_version 47101 (0.0009) [2023-12-27 19:34:06,167][106225] Updated weights for policy 1, policy_version 47112 (0.0006) [2023-12-27 19:34:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 24100864. Throughput: 0: 9669.4, 1: 10145.9. Samples: 24111692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:06,175][105115] Avg episode reward: [(0, '-6.642'), (1, '-6.688')] [2023-12-27 19:34:06,729][106226] Updated weights for policy 0, policy_version 47017 (0.0007) [2023-12-27 19:34:06,784][106226] Updated weights for policy 0, policy_version 47027 (0.0009) [2023-12-27 19:34:06,838][106225] Updated weights for policy 1, policy_version 47122 (0.0007) [2023-12-27 19:34:06,849][106226] Updated weights for policy 0, policy_version 47037 (0.0007) [2023-12-27 19:34:06,897][106225] Updated weights for policy 1, policy_version 47132 (0.0007) [2023-12-27 19:34:06,907][106226] Updated weights for policy 0, policy_version 47047 (0.0006) [2023-12-27 19:34:06,957][106225] Updated weights for policy 1, policy_version 47142 (0.0007) [2023-12-27 19:34:07,015][106225] Updated weights for policy 1, policy_version 47152 (0.0009) [2023-12-27 19:34:07,636][106226] Updated weights for policy 0, policy_version 47057 (0.0005) [2023-12-27 19:34:07,692][106226] Updated weights for policy 0, policy_version 47067 (0.0008) [2023-12-27 19:34:07,706][106225] Updated weights for policy 1, policy_version 47162 (0.0006) [2023-12-27 19:34:07,747][106226] Updated weights for policy 0, policy_version 47077 (0.0006) [2023-12-27 19:34:07,760][106225] Updated weights for policy 1, policy_version 47172 (0.0008) [2023-12-27 19:34:07,812][106225] Updated weights for policy 1, policy_version 47182 (0.0008) [2023-12-27 19:34:08,333][106226] Updated weights for policy 0, policy_version 47087 (0.0007) [2023-12-27 19:34:08,399][106226] Updated weights for policy 0, policy_version 47097 (0.0009) [2023-12-27 19:34:08,461][106225] Updated weights for policy 1, policy_version 47192 (0.0007) [2023-12-27 19:34:08,462][106226] Updated weights for policy 0, policy_version 47107 (0.0009) [2023-12-27 19:34:08,522][106225] Updated weights for policy 1, policy_version 47202 (0.0007) [2023-12-27 19:34:08,584][106225] Updated weights for policy 1, policy_version 47212 (0.0008) [2023-12-27 19:34:09,176][106225] Updated weights for policy 1, policy_version 47222 (0.0008) [2023-12-27 19:34:09,236][106225] Updated weights for policy 1, policy_version 47232 (0.0008) [2023-12-27 19:34:09,249][106226] Updated weights for policy 0, policy_version 47117 (0.0007) [2023-12-27 19:34:09,305][106225] Updated weights for policy 1, policy_version 47242 (0.0009) [2023-12-27 19:34:09,308][106226] Updated weights for policy 0, policy_version 47127 (0.0006) [2023-12-27 19:34:09,372][106226] Updated weights for policy 0, policy_version 47137 (0.0007) [2023-12-27 19:34:10,035][106226] Updated weights for policy 0, policy_version 47147 (0.0008) [2023-12-27 19:34:10,095][106226] Updated weights for policy 0, policy_version 47157 (0.0009) [2023-12-27 19:34:10,136][106225] Updated weights for policy 1, policy_version 47252 (0.0009) [2023-12-27 19:34:10,161][106226] Updated weights for policy 0, policy_version 47167 (0.0006) [2023-12-27 19:34:10,196][106225] Updated weights for policy 1, policy_version 47262 (0.0008) [2023-12-27 19:34:10,254][106225] Updated weights for policy 1, policy_version 47272 (0.0009) [2023-12-27 19:34:10,850][106226] Updated weights for policy 0, policy_version 47177 (0.0006) [2023-12-27 19:34:10,908][106226] Updated weights for policy 0, policy_version 47187 (0.0011) [2023-12-27 19:34:10,968][106226] Updated weights for policy 0, policy_version 47197 (0.0011) [2023-12-27 19:34:11,016][106225] Updated weights for policy 1, policy_version 47282 (0.0008) [2023-12-27 19:34:11,029][106226] Updated weights for policy 0, policy_version 47207 (0.0011) [2023-12-27 19:34:11,080][106225] Updated weights for policy 1, policy_version 47292 (0.0007) [2023-12-27 19:34:11,152][106225] Updated weights for policy 1, policy_version 47302 (0.0007) [2023-12-27 19:34:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 24199168. Throughput: 0: 9725.0, 1: 10149.8. Samples: 24171248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:11,175][105115] Avg episode reward: [(0, '-5.843'), (1, '-6.445')] [2023-12-27 19:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000047208_12091392.pth... [2023-12-27 19:34:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000046024_11788288.pth [2023-12-27 19:34:11,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000047312_12115968.pth... [2023-12-27 19:34:11,221][106225] Updated weights for policy 1, policy_version 47312 (0.0008) [2023-12-27 19:34:11,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000046128_11812864.pth [2023-12-27 19:34:11,805][106226] Updated weights for policy 0, policy_version 47217 (0.0007) [2023-12-27 19:34:11,870][106226] Updated weights for policy 0, policy_version 47227 (0.0008) [2023-12-27 19:34:11,923][106226] Updated weights for policy 0, policy_version 47237 (0.0007) [2023-12-27 19:34:12,023][106225] Updated weights for policy 1, policy_version 47322 (0.0008) [2023-12-27 19:34:12,085][106225] Updated weights for policy 1, policy_version 47332 (0.0008) [2023-12-27 19:34:12,136][106225] Updated weights for policy 1, policy_version 47342 (0.0008) [2023-12-27 19:34:12,722][106226] Updated weights for policy 0, policy_version 47247 (0.0009) [2023-12-27 19:34:12,783][106226] Updated weights for policy 0, policy_version 47257 (0.0007) [2023-12-27 19:34:12,806][106225] Updated weights for policy 1, policy_version 47352 (0.0008) [2023-12-27 19:34:12,843][106226] Updated weights for policy 0, policy_version 47267 (0.0007) [2023-12-27 19:34:12,865][106225] Updated weights for policy 1, policy_version 47362 (0.0007) [2023-12-27 19:34:12,915][106225] Updated weights for policy 1, policy_version 47372 (0.0008) [2023-12-27 19:34:13,431][106226] Updated weights for policy 0, policy_version 47277 (0.0006) [2023-12-27 19:34:13,500][106226] Updated weights for policy 0, policy_version 47287 (0.0005) [2023-12-27 19:34:13,561][106226] Updated weights for policy 0, policy_version 47297 (0.0005) [2023-12-27 19:34:13,710][106225] Updated weights for policy 1, policy_version 47382 (0.0007) [2023-12-27 19:34:13,760][106225] Updated weights for policy 1, policy_version 47392 (0.0009) [2023-12-27 19:34:13,811][106225] Updated weights for policy 1, policy_version 47402 (0.0008) [2023-12-27 19:34:14,071][106226] Updated weights for policy 0, policy_version 47307 (0.0005) [2023-12-27 19:34:14,134][106226] Updated weights for policy 0, policy_version 47317 (0.0007) [2023-12-27 19:34:14,193][106226] Updated weights for policy 0, policy_version 47327 (0.0006) [2023-12-27 19:34:14,651][106225] Updated weights for policy 1, policy_version 47412 (0.0008) [2023-12-27 19:34:14,711][106225] Updated weights for policy 1, policy_version 47422 (0.0007) [2023-12-27 19:34:14,780][106225] Updated weights for policy 1, policy_version 47432 (0.0007) [2023-12-27 19:34:14,793][106226] Updated weights for policy 0, policy_version 47337 (0.0006) [2023-12-27 19:34:14,863][106226] Updated weights for policy 0, policy_version 47347 (0.0008) [2023-12-27 19:34:14,926][106226] Updated weights for policy 0, policy_version 47357 (0.0006) [2023-12-27 19:34:14,987][106226] Updated weights for policy 0, policy_version 47367 (0.0008) [2023-12-27 19:34:15,542][106225] Updated weights for policy 1, policy_version 47442 (0.0007) [2023-12-27 19:34:15,600][106225] Updated weights for policy 1, policy_version 47452 (0.0009) [2023-12-27 19:34:15,649][106225] Updated weights for policy 1, policy_version 47462 (0.0009) [2023-12-27 19:34:15,705][106225] Updated weights for policy 1, policy_version 47472 (0.0006) [2023-12-27 19:34:15,721][106226] Updated weights for policy 0, policy_version 47377 (0.0009) [2023-12-27 19:34:15,775][106226] Updated weights for policy 0, policy_version 47387 (0.0008) [2023-12-27 19:34:15,826][106226] Updated weights for policy 0, policy_version 47397 (0.0008) [2023-12-27 19:34:16,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 24297472. Throughput: 0: 9870.5, 1: 9841.0. Samples: 24288064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:16,176][105115] Avg episode reward: [(0, '-6.112'), (1, '-6.569')] [2023-12-27 19:34:16,438][106225] Updated weights for policy 1, policy_version 47482 (0.0009) [2023-12-27 19:34:16,496][106225] Updated weights for policy 1, policy_version 47492 (0.0008) [2023-12-27 19:34:16,545][106225] Updated weights for policy 1, policy_version 47502 (0.0007) [2023-12-27 19:34:16,552][106226] Updated weights for policy 0, policy_version 47407 (0.0008) [2023-12-27 19:34:16,610][106226] Updated weights for policy 0, policy_version 47417 (0.0008) [2023-12-27 19:34:16,671][106226] Updated weights for policy 0, policy_version 47427 (0.0009) [2023-12-27 19:34:17,214][106225] Updated weights for policy 1, policy_version 47512 (0.0009) [2023-12-27 19:34:17,274][106225] Updated weights for policy 1, policy_version 47522 (0.0009) [2023-12-27 19:34:17,323][106225] Updated weights for policy 1, policy_version 47532 (0.0009) [2023-12-27 19:34:17,389][106226] Updated weights for policy 0, policy_version 47437 (0.0007) [2023-12-27 19:34:17,449][106226] Updated weights for policy 0, policy_version 47447 (0.0006) [2023-12-27 19:34:17,515][106226] Updated weights for policy 0, policy_version 47457 (0.0007) [2023-12-27 19:34:18,142][106225] Updated weights for policy 1, policy_version 47542 (0.0007) [2023-12-27 19:34:18,143][106226] Updated weights for policy 0, policy_version 47467 (0.0008) [2023-12-27 19:34:18,194][106225] Updated weights for policy 1, policy_version 47552 (0.0006) [2023-12-27 19:34:18,203][106226] Updated weights for policy 0, policy_version 47477 (0.0007) [2023-12-27 19:34:18,248][106225] Updated weights for policy 1, policy_version 47562 (0.0005) [2023-12-27 19:34:18,265][106226] Updated weights for policy 0, policy_version 47487 (0.0009) [2023-12-27 19:34:18,960][106226] Updated weights for policy 0, policy_version 47497 (0.0010) [2023-12-27 19:34:19,028][106226] Updated weights for policy 0, policy_version 47508 (0.0009) [2023-12-27 19:34:19,029][106225] Updated weights for policy 1, policy_version 47572 (0.0008) [2023-12-27 19:34:19,079][106225] Updated weights for policy 1, policy_version 47582 (0.0008) [2023-12-27 19:34:19,083][106226] Updated weights for policy 0, policy_version 47518 (0.0006) [2023-12-27 19:34:19,125][106225] Updated weights for policy 1, policy_version 47592 (0.0008) [2023-12-27 19:34:19,141][106226] Updated weights for policy 0, policy_version 47528 (0.0006) [2023-12-27 19:34:19,856][106226] Updated weights for policy 0, policy_version 47538 (0.0007) [2023-12-27 19:34:19,911][106225] Updated weights for policy 1, policy_version 47602 (0.0008) [2023-12-27 19:34:19,919][106226] Updated weights for policy 0, policy_version 47548 (0.0008) [2023-12-27 19:34:19,980][106225] Updated weights for policy 1, policy_version 47612 (0.0008) [2023-12-27 19:34:19,989][106226] Updated weights for policy 0, policy_version 47558 (0.0007) [2023-12-27 19:34:20,040][106225] Updated weights for policy 1, policy_version 47622 (0.0008) [2023-12-27 19:34:20,100][106225] Updated weights for policy 1, policy_version 47632 (0.0008) [2023-12-27 19:34:20,741][106226] Updated weights for policy 0, policy_version 47568 (0.0009) [2023-12-27 19:34:20,801][106226] Updated weights for policy 0, policy_version 47578 (0.0009) [2023-12-27 19:34:20,865][106226] Updated weights for policy 0, policy_version 47588 (0.0009) [2023-12-27 19:34:20,871][106225] Updated weights for policy 1, policy_version 47642 (0.0006) [2023-12-27 19:34:20,934][106225] Updated weights for policy 1, policy_version 47652 (0.0008) [2023-12-27 19:34:20,992][106225] Updated weights for policy 1, policy_version 47662 (0.0009) [2023-12-27 19:34:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 24395776. Throughput: 0: 9878.3, 1: 9774.4. Samples: 24402124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:21,175][105115] Avg episode reward: [(0, '-5.737'), (1, '-7.045')] [2023-12-27 19:34:21,567][106226] Updated weights for policy 0, policy_version 47598 (0.0008) [2023-12-27 19:34:21,632][106226] Updated weights for policy 0, policy_version 47608 (0.0007) [2023-12-27 19:34:21,701][106226] Updated weights for policy 0, policy_version 47618 (0.0008) [2023-12-27 19:34:21,831][106225] Updated weights for policy 1, policy_version 47672 (0.0009) [2023-12-27 19:34:21,889][106225] Updated weights for policy 1, policy_version 47682 (0.0009) [2023-12-27 19:34:21,942][106225] Updated weights for policy 1, policy_version 47692 (0.0008) [2023-12-27 19:34:22,415][106226] Updated weights for policy 0, policy_version 47628 (0.0009) [2023-12-27 19:34:22,464][106226] Updated weights for policy 0, policy_version 47638 (0.0009) [2023-12-27 19:34:22,524][106226] Updated weights for policy 0, policy_version 47648 (0.0008) [2023-12-27 19:34:22,715][106225] Updated weights for policy 1, policy_version 47702 (0.0008) [2023-12-27 19:34:22,772][106225] Updated weights for policy 1, policy_version 47712 (0.0009) [2023-12-27 19:34:22,836][106225] Updated weights for policy 1, policy_version 47722 (0.0008) [2023-12-27 19:34:23,254][106226] Updated weights for policy 0, policy_version 47658 (0.0008) [2023-12-27 19:34:23,313][106226] Updated weights for policy 0, policy_version 47668 (0.0008) [2023-12-27 19:34:23,364][106226] Updated weights for policy 0, policy_version 47678 (0.0008) [2023-12-27 19:34:23,429][106226] Updated weights for policy 0, policy_version 47688 (0.0009) [2023-12-27 19:34:23,534][106225] Updated weights for policy 1, policy_version 47732 (0.0007) [2023-12-27 19:34:23,585][106225] Updated weights for policy 1, policy_version 47742 (0.0005) [2023-12-27 19:34:23,633][106225] Updated weights for policy 1, policy_version 47752 (0.0005) [2023-12-27 19:34:24,180][106225] Updated weights for policy 1, policy_version 47762 (0.0006) [2023-12-27 19:34:24,239][106225] Updated weights for policy 1, policy_version 47772 (0.0007) [2023-12-27 19:34:24,255][106226] Updated weights for policy 0, policy_version 47698 (0.0007) [2023-12-27 19:34:24,294][106225] Updated weights for policy 1, policy_version 47782 (0.0007) [2023-12-27 19:34:24,317][106226] Updated weights for policy 0, policy_version 47708 (0.0008) [2023-12-27 19:34:24,349][106225] Updated weights for policy 1, policy_version 47792 (0.0007) [2023-12-27 19:34:24,377][106226] Updated weights for policy 0, policy_version 47718 (0.0007) [2023-12-27 19:34:24,908][106225] Updated weights for policy 1, policy_version 47802 (0.0007) [2023-12-27 19:34:24,964][106225] Updated weights for policy 1, policy_version 47812 (0.0009) [2023-12-27 19:34:25,022][106225] Updated weights for policy 1, policy_version 47822 (0.0008) [2023-12-27 19:34:25,173][106226] Updated weights for policy 0, policy_version 47728 (0.0009) [2023-12-27 19:34:25,235][106226] Updated weights for policy 0, policy_version 47738 (0.0008) [2023-12-27 19:34:25,292][106226] Updated weights for policy 0, policy_version 47748 (0.0009) [2023-12-27 19:34:25,709][106225] Updated weights for policy 1, policy_version 47832 (0.0009) [2023-12-27 19:34:25,768][106225] Updated weights for policy 1, policy_version 47842 (0.0008) [2023-12-27 19:34:25,830][106225] Updated weights for policy 1, policy_version 47852 (0.0008) [2023-12-27 19:34:26,006][106226] Updated weights for policy 0, policy_version 47758 (0.0009) [2023-12-27 19:34:26,058][106226] Updated weights for policy 0, policy_version 47768 (0.0008) [2023-12-27 19:34:26,113][106226] Updated weights for policy 0, policy_version 47778 (0.0008) [2023-12-27 19:34:26,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 24494080. Throughput: 0: 9884.9, 1: 9707.6. Samples: 24458176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:26,175][105115] Avg episode reward: [(0, '-6.309'), (1, '-6.875')] [2023-12-27 19:34:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000047784_12238848.pth... [2023-12-27 19:34:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000047856_12255232.pth... [2023-12-27 19:34:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000046632_11943936.pth [2023-12-27 19:34:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000046736_11968512.pth [2023-12-27 19:34:26,544][106225] Updated weights for policy 1, policy_version 47862 (0.0009) [2023-12-27 19:34:26,597][106225] Updated weights for policy 1, policy_version 47872 (0.0008) [2023-12-27 19:34:26,646][106225] Updated weights for policy 1, policy_version 47882 (0.0006) [2023-12-27 19:34:26,834][106226] Updated weights for policy 0, policy_version 47788 (0.0008) [2023-12-27 19:34:26,893][106226] Updated weights for policy 0, policy_version 47798 (0.0007) [2023-12-27 19:34:26,944][106226] Updated weights for policy 0, policy_version 47808 (0.0008) [2023-12-27 19:34:27,289][106225] Updated weights for policy 1, policy_version 47892 (0.0006) [2023-12-27 19:34:27,344][106225] Updated weights for policy 1, policy_version 47902 (0.0005) [2023-12-27 19:34:27,409][106225] Updated weights for policy 1, policy_version 47912 (0.0006) [2023-12-27 19:34:27,729][106226] Updated weights for policy 0, policy_version 47818 (0.0008) [2023-12-27 19:34:27,783][106226] Updated weights for policy 0, policy_version 47828 (0.0008) [2023-12-27 19:34:27,849][106226] Updated weights for policy 0, policy_version 47838 (0.0008) [2023-12-27 19:34:27,894][106226] Updated weights for policy 0, policy_version 47848 (0.0008) [2023-12-27 19:34:28,017][106225] Updated weights for policy 1, policy_version 47922 (0.0005) [2023-12-27 19:34:28,076][106225] Updated weights for policy 1, policy_version 47932 (0.0008) [2023-12-27 19:34:28,137][106225] Updated weights for policy 1, policy_version 47942 (0.0006) [2023-12-27 19:34:28,199][106225] Updated weights for policy 1, policy_version 47952 (0.0006) [2023-12-27 19:34:28,622][106226] Updated weights for policy 0, policy_version 47858 (0.0008) [2023-12-27 19:34:28,670][106226] Updated weights for policy 0, policy_version 47868 (0.0008) [2023-12-27 19:34:28,714][106226] Updated weights for policy 0, policy_version 47878 (0.0008) [2023-12-27 19:34:28,890][106225] Updated weights for policy 1, policy_version 47962 (0.0008) [2023-12-27 19:34:28,949][106225] Updated weights for policy 1, policy_version 47972 (0.0010) [2023-12-27 19:34:29,011][106225] Updated weights for policy 1, policy_version 47982 (0.0010) [2023-12-27 19:34:29,463][106226] Updated weights for policy 0, policy_version 47888 (0.0009) [2023-12-27 19:34:29,518][106226] Updated weights for policy 0, policy_version 47898 (0.0008) [2023-12-27 19:34:29,568][106226] Updated weights for policy 0, policy_version 47908 (0.0009) [2023-12-27 19:34:29,642][106225] Updated weights for policy 1, policy_version 47992 (0.0007) [2023-12-27 19:34:29,703][106225] Updated weights for policy 1, policy_version 48002 (0.0007) [2023-12-27 19:34:29,767][106225] Updated weights for policy 1, policy_version 48012 (0.0007) [2023-12-27 19:34:30,431][106226] Updated weights for policy 0, policy_version 47918 (0.0009) [2023-12-27 19:34:30,459][106225] Updated weights for policy 1, policy_version 48022 (0.0007) [2023-12-27 19:34:30,491][106226] Updated weights for policy 0, policy_version 47928 (0.0007) [2023-12-27 19:34:30,514][106225] Updated weights for policy 1, policy_version 48032 (0.0005) [2023-12-27 19:34:30,554][106226] Updated weights for policy 0, policy_version 47938 (0.0006) [2023-12-27 19:34:30,569][106225] Updated weights for policy 1, policy_version 48042 (0.0009) [2023-12-27 19:34:31,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 24584192. Throughput: 0: 9821.3, 1: 9888.3. Samples: 24578412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:31,175][105115] Avg episode reward: [(0, '-5.561'), (1, '-6.850')] [2023-12-27 19:34:31,185][106226] Updated weights for policy 0, policy_version 47948 (0.0009) [2023-12-27 19:34:31,248][106226] Updated weights for policy 0, policy_version 47958 (0.0006) [2023-12-27 19:34:31,299][106225] Updated weights for policy 1, policy_version 48052 (0.0009) [2023-12-27 19:34:31,312][106226] Updated weights for policy 0, policy_version 47968 (0.0007) [2023-12-27 19:34:31,369][106225] Updated weights for policy 1, policy_version 48062 (0.0008) [2023-12-27 19:34:31,432][106225] Updated weights for policy 1, policy_version 48072 (0.0007) [2023-12-27 19:34:32,007][106226] Updated weights for policy 0, policy_version 47978 (0.0007) [2023-12-27 19:34:32,030][106225] Updated weights for policy 1, policy_version 48082 (0.0006) [2023-12-27 19:34:32,075][106226] Updated weights for policy 0, policy_version 47988 (0.0006) [2023-12-27 19:34:32,085][106225] Updated weights for policy 1, policy_version 48092 (0.0007) [2023-12-27 19:34:32,139][106225] Updated weights for policy 1, policy_version 48102 (0.0005) [2023-12-27 19:34:32,145][106226] Updated weights for policy 0, policy_version 47998 (0.0008) [2023-12-27 19:34:32,194][106225] Updated weights for policy 1, policy_version 48112 (0.0006) [2023-12-27 19:34:32,205][106226] Updated weights for policy 0, policy_version 48008 (0.0007) [2023-12-27 19:34:32,778][106226] Updated weights for policy 0, policy_version 48018 (0.0005) [2023-12-27 19:34:32,829][106226] Updated weights for policy 0, policy_version 48028 (0.0005) [2023-12-27 19:34:32,883][106226] Updated weights for policy 0, policy_version 48038 (0.0005) [2023-12-27 19:34:32,925][106225] Updated weights for policy 1, policy_version 48122 (0.0010) [2023-12-27 19:34:32,980][106225] Updated weights for policy 1, policy_version 48132 (0.0010) [2023-12-27 19:34:33,036][106225] Updated weights for policy 1, policy_version 48142 (0.0010) [2023-12-27 19:34:33,472][106226] Updated weights for policy 0, policy_version 48048 (0.0009) [2023-12-27 19:34:33,532][106226] Updated weights for policy 0, policy_version 48058 (0.0010) [2023-12-27 19:34:33,589][106226] Updated weights for policy 0, policy_version 48068 (0.0010) [2023-12-27 19:34:33,679][106225] Updated weights for policy 1, policy_version 48152 (0.0010) [2023-12-27 19:34:33,739][106225] Updated weights for policy 1, policy_version 48162 (0.0010) [2023-12-27 19:34:33,794][106225] Updated weights for policy 1, policy_version 48172 (0.0010) [2023-12-27 19:34:34,277][106226] Updated weights for policy 0, policy_version 48078 (0.0010) [2023-12-27 19:34:34,343][106226] Updated weights for policy 0, policy_version 48088 (0.0011) [2023-12-27 19:34:34,407][106226] Updated weights for policy 0, policy_version 48098 (0.0011) [2023-12-27 19:34:34,465][106225] Updated weights for policy 1, policy_version 48182 (0.0010) [2023-12-27 19:34:34,527][106225] Updated weights for policy 1, policy_version 48192 (0.0010) [2023-12-27 19:34:34,587][106225] Updated weights for policy 1, policy_version 48202 (0.0010) [2023-12-27 19:34:35,136][106226] Updated weights for policy 0, policy_version 48108 (0.0011) [2023-12-27 19:34:35,189][106226] Updated weights for policy 0, policy_version 48118 (0.0010) [2023-12-27 19:34:35,252][106226] Updated weights for policy 0, policy_version 48128 (0.0009) [2023-12-27 19:34:35,318][106225] Updated weights for policy 1, policy_version 48212 (0.0010) [2023-12-27 19:34:35,381][106225] Updated weights for policy 1, policy_version 48222 (0.0010) [2023-12-27 19:34:35,443][106225] Updated weights for policy 1, policy_version 48232 (0.0010) [2023-12-27 19:34:35,793][106226] Updated weights for policy 0, policy_version 48138 (0.0008) [2023-12-27 19:34:35,847][106226] Updated weights for policy 0, policy_version 48148 (0.0005) [2023-12-27 19:34:35,904][106226] Updated weights for policy 0, policy_version 48158 (0.0007) [2023-12-27 19:34:35,964][106226] Updated weights for policy 0, policy_version 48168 (0.0011) [2023-12-27 19:34:36,153][106225] Updated weights for policy 1, policy_version 48242 (0.0010) [2023-12-27 19:34:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 24690688. Throughput: 0: 9855.7, 1: 9933.4. Samples: 24701500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:36,175][105115] Avg episode reward: [(0, '-5.906'), (1, '-6.415')] [2023-12-27 19:34:36,207][106225] Updated weights for policy 1, policy_version 48252 (0.0007) [2023-12-27 19:34:36,266][106225] Updated weights for policy 1, policy_version 48262 (0.0008) [2023-12-27 19:34:36,326][106225] Updated weights for policy 1, policy_version 48272 (0.0010) [2023-12-27 19:34:36,674][106226] Updated weights for policy 0, policy_version 48178 (0.0007) [2023-12-27 19:34:36,733][106226] Updated weights for policy 0, policy_version 48188 (0.0005) [2023-12-27 19:34:36,788][106226] Updated weights for policy 0, policy_version 48198 (0.0005) [2023-12-27 19:34:37,046][106225] Updated weights for policy 1, policy_version 48282 (0.0010) [2023-12-27 19:34:37,105][106225] Updated weights for policy 1, policy_version 48292 (0.0010) [2023-12-27 19:34:37,168][106225] Updated weights for policy 1, policy_version 48302 (0.0010) [2023-12-27 19:34:37,460][106226] Updated weights for policy 0, policy_version 48208 (0.0010) [2023-12-27 19:34:37,520][106226] Updated weights for policy 0, policy_version 48218 (0.0010) [2023-12-27 19:34:37,578][106226] Updated weights for policy 0, policy_version 48228 (0.0011) [2023-12-27 19:34:37,824][106225] Updated weights for policy 1, policy_version 48312 (0.0010) [2023-12-27 19:34:37,874][106225] Updated weights for policy 1, policy_version 48322 (0.0010) [2023-12-27 19:34:37,925][106225] Updated weights for policy 1, policy_version 48332 (0.0010) [2023-12-27 19:34:38,301][106226] Updated weights for policy 0, policy_version 48238 (0.0011) [2023-12-27 19:34:38,364][106226] Updated weights for policy 0, policy_version 48248 (0.0011) [2023-12-27 19:34:38,427][106226] Updated weights for policy 0, policy_version 48258 (0.0010) [2023-12-27 19:34:38,624][106225] Updated weights for policy 1, policy_version 48342 (0.0010) [2023-12-27 19:34:38,671][106225] Updated weights for policy 1, policy_version 48352 (0.0010) [2023-12-27 19:34:38,728][106225] Updated weights for policy 1, policy_version 48362 (0.0010) [2023-12-27 19:34:39,148][106226] Updated weights for policy 0, policy_version 48268 (0.0008) [2023-12-27 19:34:39,207][106226] Updated weights for policy 0, policy_version 48278 (0.0009) [2023-12-27 19:34:39,272][106226] Updated weights for policy 0, policy_version 48288 (0.0008) [2023-12-27 19:34:39,506][106225] Updated weights for policy 1, policy_version 48372 (0.0008) [2023-12-27 19:34:39,570][106225] Updated weights for policy 1, policy_version 48382 (0.0008) [2023-12-27 19:34:39,630][106225] Updated weights for policy 1, policy_version 48392 (0.0007) [2023-12-27 19:34:40,051][106226] Updated weights for policy 0, policy_version 48298 (0.0008) [2023-12-27 19:34:40,119][106226] Updated weights for policy 0, policy_version 48308 (0.0009) [2023-12-27 19:34:40,181][106226] Updated weights for policy 0, policy_version 48318 (0.0008) [2023-12-27 19:34:40,238][106226] Updated weights for policy 0, policy_version 48328 (0.0008) [2023-12-27 19:34:40,370][106225] Updated weights for policy 1, policy_version 48402 (0.0006) [2023-12-27 19:34:40,436][106225] Updated weights for policy 1, policy_version 48412 (0.0008) [2023-12-27 19:34:40,499][106225] Updated weights for policy 1, policy_version 48422 (0.0009) [2023-12-27 19:34:40,558][106225] Updated weights for policy 1, policy_version 48432 (0.0007) [2023-12-27 19:34:40,965][106226] Updated weights for policy 0, policy_version 48338 (0.0009) [2023-12-27 19:34:41,030][106226] Updated weights for policy 0, policy_version 48348 (0.0009) [2023-12-27 19:34:41,088][106226] Updated weights for policy 0, policy_version 48358 (0.0009) [2023-12-27 19:34:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 24788992. Throughput: 0: 9856.5, 1: 9950.7. Samples: 24760672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:34:41,175][105115] Avg episode reward: [(0, '-6.006'), (1, '-6.482')] [2023-12-27 19:34:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000048432_12402688.pth... [2023-12-27 19:34:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000048360_12386304.pth... [2023-12-27 19:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000047208_12091392.pth [2023-12-27 19:34:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000047312_12115968.pth [2023-12-27 19:34:41,323][106225] Updated weights for policy 1, policy_version 48442 (0.0009) [2023-12-27 19:34:41,396][106225] Updated weights for policy 1, policy_version 48452 (0.0009) [2023-12-27 19:34:41,458][106225] Updated weights for policy 1, policy_version 48462 (0.0007) [2023-12-27 19:34:41,901][106226] Updated weights for policy 0, policy_version 48368 (0.0009) [2023-12-27 19:34:41,965][106226] Updated weights for policy 0, policy_version 48378 (0.0009) [2023-12-27 19:34:42,027][106226] Updated weights for policy 0, policy_version 48388 (0.0009) [2023-12-27 19:34:42,119][106225] Updated weights for policy 1, policy_version 48472 (0.0006) [2023-12-27 19:34:42,182][106225] Updated weights for policy 1, policy_version 48482 (0.0007) [2023-12-27 19:34:42,242][106225] Updated weights for policy 1, policy_version 48492 (0.0008) [2023-12-27 19:34:42,832][106226] Updated weights for policy 0, policy_version 48398 (0.0010) [2023-12-27 19:34:42,898][106226] Updated weights for policy 0, policy_version 48408 (0.0008) [2023-12-27 19:34:42,912][106225] Updated weights for policy 1, policy_version 48502 (0.0008) [2023-12-27 19:34:42,960][106226] Updated weights for policy 0, policy_version 48418 (0.0008) [2023-12-27 19:34:42,963][106225] Updated weights for policy 1, policy_version 48512 (0.0007) [2023-12-27 19:34:43,017][106225] Updated weights for policy 1, policy_version 48522 (0.0008) [2023-12-27 19:34:43,667][106226] Updated weights for policy 0, policy_version 48428 (0.0007) [2023-12-27 19:34:43,715][106226] Updated weights for policy 0, policy_version 48438 (0.0008) [2023-12-27 19:34:43,754][106225] Updated weights for policy 1, policy_version 48532 (0.0009) [2023-12-27 19:34:43,770][106226] Updated weights for policy 0, policy_version 48448 (0.0009) [2023-12-27 19:34:43,812][106225] Updated weights for policy 1, policy_version 48542 (0.0006) [2023-12-27 19:34:43,870][106225] Updated weights for policy 1, policy_version 48552 (0.0008) [2023-12-27 19:34:44,527][106225] Updated weights for policy 1, policy_version 48562 (0.0008) [2023-12-27 19:34:44,533][106226] Updated weights for policy 0, policy_version 48458 (0.0006) [2023-12-27 19:34:44,586][106226] Updated weights for policy 0, policy_version 48468 (0.0007) [2023-12-27 19:34:44,590][106225] Updated weights for policy 1, policy_version 48572 (0.0006) [2023-12-27 19:34:44,638][106225] Updated weights for policy 1, policy_version 48582 (0.0005) [2023-12-27 19:34:44,639][106226] Updated weights for policy 0, policy_version 48478 (0.0008) [2023-12-27 19:34:44,691][106225] Updated weights for policy 1, policy_version 48592 (0.0007) [2023-12-27 19:34:44,698][106226] Updated weights for policy 0, policy_version 48488 (0.0007) [2023-12-27 19:34:45,324][106225] Updated weights for policy 1, policy_version 48602 (0.0011) [2023-12-27 19:34:45,382][106225] Updated weights for policy 1, policy_version 48612 (0.0010) [2023-12-27 19:34:45,442][106225] Updated weights for policy 1, policy_version 48622 (0.0010) [2023-12-27 19:34:45,537][106226] Updated weights for policy 0, policy_version 48498 (0.0009) [2023-12-27 19:34:45,598][106226] Updated weights for policy 0, policy_version 48508 (0.0008) [2023-12-27 19:34:45,659][106226] Updated weights for policy 0, policy_version 48518 (0.0008) [2023-12-27 19:34:46,115][106225] Updated weights for policy 1, policy_version 48632 (0.0010) [2023-12-27 19:34:46,171][106225] Updated weights for policy 1, policy_version 48642 (0.0010) [2023-12-27 19:34:46,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 24879104. Throughput: 0: 9732.0, 1: 9812.6. Samples: 24873292. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:34:46,175][105115] Avg episode reward: [(0, '-6.244'), (1, '-6.235')] [2023-12-27 19:34:46,218][106225] Updated weights for policy 1, policy_version 48652 (0.0006) [2023-12-27 19:34:46,328][106226] Updated weights for policy 0, policy_version 48528 (0.0008) [2023-12-27 19:34:46,379][106226] Updated weights for policy 0, policy_version 48538 (0.0008) [2023-12-27 19:34:46,428][106226] Updated weights for policy 0, policy_version 48548 (0.0009) [2023-12-27 19:34:46,909][106225] Updated weights for policy 1, policy_version 48662 (0.0009) [2023-12-27 19:34:46,972][106225] Updated weights for policy 1, policy_version 48672 (0.0010) [2023-12-27 19:34:47,034][106225] Updated weights for policy 1, policy_version 48682 (0.0010) [2023-12-27 19:34:47,184][106226] Updated weights for policy 0, policy_version 48558 (0.0008) [2023-12-27 19:34:47,230][106226] Updated weights for policy 0, policy_version 48568 (0.0007) [2023-12-27 19:34:47,274][106226] Updated weights for policy 0, policy_version 48578 (0.0008) [2023-12-27 19:34:47,748][106225] Updated weights for policy 1, policy_version 48692 (0.0010) [2023-12-27 19:34:47,802][106225] Updated weights for policy 1, policy_version 48702 (0.0007) [2023-12-27 19:34:47,862][106225] Updated weights for policy 1, policy_version 48712 (0.0007) [2023-12-27 19:34:47,979][106226] Updated weights for policy 0, policy_version 48588 (0.0007) [2023-12-27 19:34:48,034][106226] Updated weights for policy 0, policy_version 48598 (0.0006) [2023-12-27 19:34:48,081][106226] Updated weights for policy 0, policy_version 48608 (0.0005) [2023-12-27 19:34:48,574][106225] Updated weights for policy 1, policy_version 48722 (0.0010) [2023-12-27 19:34:48,630][106225] Updated weights for policy 1, policy_version 48732 (0.0010) [2023-12-27 19:34:48,690][106225] Updated weights for policy 1, policy_version 48742 (0.0010) [2023-12-27 19:34:48,731][106226] Updated weights for policy 0, policy_version 48618 (0.0007) [2023-12-27 19:34:48,748][106225] Updated weights for policy 1, policy_version 48752 (0.0010) [2023-12-27 19:34:48,795][106226] Updated weights for policy 0, policy_version 48628 (0.0011) [2023-12-27 19:34:48,850][106226] Updated weights for policy 0, policy_version 48638 (0.0011) [2023-12-27 19:34:48,911][106226] Updated weights for policy 0, policy_version 48648 (0.0011) [2023-12-27 19:34:49,482][106225] Updated weights for policy 1, policy_version 48762 (0.0008) [2023-12-27 19:34:49,530][106225] Updated weights for policy 1, policy_version 48772 (0.0008) [2023-12-27 19:34:49,575][106226] Updated weights for policy 0, policy_version 48658 (0.0007) [2023-12-27 19:34:49,581][106225] Updated weights for policy 1, policy_version 48782 (0.0008) [2023-12-27 19:34:49,637][106226] Updated weights for policy 0, policy_version 48668 (0.0007) [2023-12-27 19:34:49,693][106226] Updated weights for policy 0, policy_version 48678 (0.0008) [2023-12-27 19:34:50,351][106225] Updated weights for policy 1, policy_version 48792 (0.0009) [2023-12-27 19:34:50,390][106226] Updated weights for policy 0, policy_version 48688 (0.0007) [2023-12-27 19:34:50,415][106225] Updated weights for policy 1, policy_version 48802 (0.0010) [2023-12-27 19:34:50,458][106226] Updated weights for policy 0, policy_version 48698 (0.0006) [2023-12-27 19:34:50,475][106225] Updated weights for policy 1, policy_version 48812 (0.0010) [2023-12-27 19:34:50,525][106226] Updated weights for policy 0, policy_version 48708 (0.0006) [2023-12-27 19:34:51,140][106226] Updated weights for policy 0, policy_version 48718 (0.0008) [2023-12-27 19:34:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 24977408. Throughput: 0: 9769.3, 1: 9823.7. Samples: 24993380. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:34:51,175][105115] Avg episode reward: [(0, '-5.816'), (1, '-6.125')] [2023-12-27 19:34:51,192][106225] Updated weights for policy 1, policy_version 48822 (0.0009) [2023-12-27 19:34:51,198][106226] Updated weights for policy 0, policy_version 48728 (0.0010) [2023-12-27 19:34:51,251][106225] Updated weights for policy 1, policy_version 48832 (0.0010) [2023-12-27 19:34:51,257][106226] Updated weights for policy 0, policy_version 48738 (0.0011) [2023-12-27 19:34:51,307][106225] Updated weights for policy 1, policy_version 48842 (0.0009) [2023-12-27 19:34:51,977][106226] Updated weights for policy 0, policy_version 48748 (0.0010) [2023-12-27 19:34:52,033][106226] Updated weights for policy 0, policy_version 48758 (0.0010) [2023-12-27 19:34:52,035][106225] Updated weights for policy 1, policy_version 48852 (0.0009) [2023-12-27 19:34:52,082][106226] Updated weights for policy 0, policy_version 48768 (0.0010) [2023-12-27 19:34:52,087][106225] Updated weights for policy 1, policy_version 48862 (0.0006) [2023-12-27 19:34:52,148][106225] Updated weights for policy 1, policy_version 48872 (0.0007) [2023-12-27 19:34:52,807][106226] Updated weights for policy 0, policy_version 48778 (0.0011) [2023-12-27 19:34:52,847][106225] Updated weights for policy 1, policy_version 48882 (0.0007) [2023-12-27 19:34:52,870][106226] Updated weights for policy 0, policy_version 48788 (0.0011) [2023-12-27 19:34:52,910][106225] Updated weights for policy 1, policy_version 48892 (0.0005) [2023-12-27 19:34:52,934][106226] Updated weights for policy 0, policy_version 48798 (0.0010) [2023-12-27 19:34:52,961][106225] Updated weights for policy 1, policy_version 48902 (0.0005) [2023-12-27 19:34:53,001][106226] Updated weights for policy 0, policy_version 48808 (0.0010) [2023-12-27 19:34:53,019][106225] Updated weights for policy 1, policy_version 48912 (0.0006) [2023-12-27 19:34:53,675][106225] Updated weights for policy 1, policy_version 48922 (0.0007) [2023-12-27 19:34:53,699][106226] Updated weights for policy 0, policy_version 48819 (0.0007) [2023-12-27 19:34:53,733][106225] Updated weights for policy 1, policy_version 48932 (0.0008) [2023-12-27 19:34:53,762][106226] Updated weights for policy 0, policy_version 48829 (0.0006) [2023-12-27 19:34:53,801][106225] Updated weights for policy 1, policy_version 48942 (0.0008) [2023-12-27 19:34:53,827][106226] Updated weights for policy 0, policy_version 48839 (0.0007) [2023-12-27 19:34:54,480][106225] Updated weights for policy 1, policy_version 48952 (0.0009) [2023-12-27 19:34:54,527][106226] Updated weights for policy 0, policy_version 48849 (0.0006) [2023-12-27 19:34:54,537][106225] Updated weights for policy 1, policy_version 48962 (0.0010) [2023-12-27 19:34:54,575][106226] Updated weights for policy 0, policy_version 48859 (0.0010) [2023-12-27 19:34:54,590][106225] Updated weights for policy 1, policy_version 48972 (0.0010) [2023-12-27 19:34:54,626][106226] Updated weights for policy 0, policy_version 48869 (0.0011) [2023-12-27 19:34:55,314][106225] Updated weights for policy 1, policy_version 48982 (0.0010) [2023-12-27 19:34:55,335][106226] Updated weights for policy 0, policy_version 48879 (0.0010) [2023-12-27 19:34:55,371][106225] Updated weights for policy 1, policy_version 48992 (0.0010) [2023-12-27 19:34:55,392][106226] Updated weights for policy 0, policy_version 48889 (0.0010) [2023-12-27 19:34:55,424][106225] Updated weights for policy 1, policy_version 49002 (0.0010) [2023-12-27 19:34:55,452][106226] Updated weights for policy 0, policy_version 48899 (0.0010) [2023-12-27 19:34:56,104][106225] Updated weights for policy 1, policy_version 49012 (0.0008) [2023-12-27 19:34:56,135][106226] Updated weights for policy 0, policy_version 48909 (0.0010) [2023-12-27 19:34:56,165][106225] Updated weights for policy 1, policy_version 49022 (0.0005) [2023-12-27 19:34:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 25075712. Throughput: 0: 9766.6, 1: 9799.3. Samples: 25051712. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:34:56,175][105115] Avg episode reward: [(0, '-5.867'), (1, '-7.071')] [2023-12-27 19:34:56,196][106226] Updated weights for policy 0, policy_version 48919 (0.0010) [2023-12-27 19:34:56,221][106225] Updated weights for policy 1, policy_version 49032 (0.0005) [2023-12-27 19:34:56,257][106226] Updated weights for policy 0, policy_version 48929 (0.0011) [2023-12-27 19:34:56,264][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000049040_12558336.pth... [2023-12-27 19:34:56,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000047856_12255232.pth [2023-12-27 19:34:56,296][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000048936_12533760.pth... [2023-12-27 19:34:56,300][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000047784_12238848.pth [2023-12-27 19:34:56,774][106225] Updated weights for policy 1, policy_version 49042 (0.0006) [2023-12-27 19:34:56,824][106225] Updated weights for policy 1, policy_version 49052 (0.0010) [2023-12-27 19:34:56,861][106226] Updated weights for policy 0, policy_version 48939 (0.0009) [2023-12-27 19:34:56,880][106225] Updated weights for policy 1, policy_version 49062 (0.0010) [2023-12-27 19:34:56,928][106225] Updated weights for policy 1, policy_version 49072 (0.0010) [2023-12-27 19:34:56,929][106226] Updated weights for policy 0, policy_version 48949 (0.0005) [2023-12-27 19:34:56,995][106226] Updated weights for policy 0, policy_version 48959 (0.0005) [2023-12-27 19:34:57,532][106226] Updated weights for policy 0, policy_version 48969 (0.0005) [2023-12-27 19:34:57,580][106225] Updated weights for policy 1, policy_version 49082 (0.0005) [2023-12-27 19:34:57,585][106226] Updated weights for policy 0, policy_version 48979 (0.0005) [2023-12-27 19:34:57,636][106225] Updated weights for policy 1, policy_version 49092 (0.0005) [2023-12-27 19:34:57,639][106226] Updated weights for policy 0, policy_version 48989 (0.0005) [2023-12-27 19:34:57,694][106225] Updated weights for policy 1, policy_version 49102 (0.0005) [2023-12-27 19:34:57,698][106226] Updated weights for policy 0, policy_version 48999 (0.0007) [2023-12-27 19:34:58,271][106225] Updated weights for policy 1, policy_version 49112 (0.0010) [2023-12-27 19:34:58,330][106226] Updated weights for policy 0, policy_version 49009 (0.0008) [2023-12-27 19:34:58,332][106225] Updated weights for policy 1, policy_version 49122 (0.0010) [2023-12-27 19:34:58,400][106225] Updated weights for policy 1, policy_version 49132 (0.0007) [2023-12-27 19:34:58,404][106226] Updated weights for policy 0, policy_version 49019 (0.0010) [2023-12-27 19:34:58,464][106226] Updated weights for policy 0, policy_version 49029 (0.0008) [2023-12-27 19:34:59,196][106226] Updated weights for policy 0, policy_version 49039 (0.0008) [2023-12-27 19:34:59,246][106225] Updated weights for policy 1, policy_version 49142 (0.0009) [2023-12-27 19:34:59,275][106226] Updated weights for policy 0, policy_version 49049 (0.0008) [2023-12-27 19:34:59,311][106225] Updated weights for policy 1, policy_version 49152 (0.0010) [2023-12-27 19:34:59,347][106226] Updated weights for policy 0, policy_version 49059 (0.0008) [2023-12-27 19:34:59,371][106225] Updated weights for policy 1, policy_version 49162 (0.0010) [2023-12-27 19:35:00,035][106225] Updated weights for policy 1, policy_version 49172 (0.0008) [2023-12-27 19:35:00,047][106226] Updated weights for policy 0, policy_version 49069 (0.0008) [2023-12-27 19:35:00,101][106225] Updated weights for policy 1, policy_version 49182 (0.0007) [2023-12-27 19:35:00,104][106226] Updated weights for policy 0, policy_version 49079 (0.0006) [2023-12-27 19:35:00,161][106225] Updated weights for policy 1, policy_version 49192 (0.0007) [2023-12-27 19:35:00,170][106226] Updated weights for policy 0, policy_version 49089 (0.0008) [2023-12-27 19:35:00,861][106226] Updated weights for policy 0, policy_version 49099 (0.0007) [2023-12-27 19:35:00,900][106225] Updated weights for policy 1, policy_version 49202 (0.0007) [2023-12-27 19:35:00,918][106226] Updated weights for policy 0, policy_version 49109 (0.0007) [2023-12-27 19:35:00,960][106225] Updated weights for policy 1, policy_version 49212 (0.0010) [2023-12-27 19:35:00,978][106226] Updated weights for policy 0, policy_version 49119 (0.0006) [2023-12-27 19:35:01,018][106225] Updated weights for policy 1, policy_version 49222 (0.0010) [2023-12-27 19:35:01,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 25190400. Throughput: 0: 9756.3, 1: 9948.3. Samples: 25174760. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:35:01,175][105115] Avg episode reward: [(0, '-5.976'), (1, '-6.349')] [2023-12-27 19:35:01,794][106225] Updated weights for policy 1, policy_version 49233 (0.0009) [2023-12-27 19:35:01,796][106226] Updated weights for policy 0, policy_version 49129 (0.0006) [2023-12-27 19:35:01,847][106225] Updated weights for policy 1, policy_version 49243 (0.0010) [2023-12-27 19:35:01,860][106226] Updated weights for policy 0, policy_version 49139 (0.0006) [2023-12-27 19:35:01,907][106225] Updated weights for policy 1, policy_version 49253 (0.0010) [2023-12-27 19:35:01,917][106226] Updated weights for policy 0, policy_version 49149 (0.0006) [2023-12-27 19:35:01,960][106225] Updated weights for policy 1, policy_version 49263 (0.0010) [2023-12-27 19:35:01,978][106226] Updated weights for policy 0, policy_version 49159 (0.0006) [2023-12-27 19:35:02,697][106225] Updated weights for policy 1, policy_version 49273 (0.0010) [2023-12-27 19:35:02,726][106226] Updated weights for policy 0, policy_version 49169 (0.0006) [2023-12-27 19:35:02,755][106225] Updated weights for policy 1, policy_version 49283 (0.0010) [2023-12-27 19:35:02,791][106226] Updated weights for policy 0, policy_version 49179 (0.0007) [2023-12-27 19:35:02,808][106225] Updated weights for policy 1, policy_version 49293 (0.0008) [2023-12-27 19:35:02,850][106226] Updated weights for policy 0, policy_version 49189 (0.0009) [2023-12-27 19:35:03,470][106225] Updated weights for policy 1, policy_version 49303 (0.0006) [2023-12-27 19:35:03,526][106225] Updated weights for policy 1, policy_version 49313 (0.0005) [2023-12-27 19:35:03,557][106226] Updated weights for policy 0, policy_version 49199 (0.0011) [2023-12-27 19:35:03,581][106225] Updated weights for policy 1, policy_version 49323 (0.0005) [2023-12-27 19:35:03,606][106226] Updated weights for policy 0, policy_version 49209 (0.0010) [2023-12-27 19:35:03,658][106226] Updated weights for policy 0, policy_version 49219 (0.0010) [2023-12-27 19:35:04,191][106225] Updated weights for policy 1, policy_version 49333 (0.0008) [2023-12-27 19:35:04,243][106225] Updated weights for policy 1, policy_version 49343 (0.0010) [2023-12-27 19:35:04,308][106225] Updated weights for policy 1, policy_version 49353 (0.0010) [2023-12-27 19:35:04,400][106226] Updated weights for policy 0, policy_version 49229 (0.0011) [2023-12-27 19:35:04,461][106226] Updated weights for policy 0, policy_version 49239 (0.0010) [2023-12-27 19:35:04,518][106226] Updated weights for policy 0, policy_version 49249 (0.0010) [2023-12-27 19:35:05,045][106225] Updated weights for policy 1, policy_version 49363 (0.0009) [2023-12-27 19:35:05,106][106225] Updated weights for policy 1, policy_version 49373 (0.0005) [2023-12-27 19:35:05,156][106226] Updated weights for policy 0, policy_version 49259 (0.0009) [2023-12-27 19:35:05,165][106225] Updated weights for policy 1, policy_version 49383 (0.0006) [2023-12-27 19:35:05,222][106226] Updated weights for policy 0, policy_version 49269 (0.0006) [2023-12-27 19:35:05,289][106226] Updated weights for policy 0, policy_version 49279 (0.0005) [2023-12-27 19:35:05,846][106225] Updated weights for policy 1, policy_version 49393 (0.0008) [2023-12-27 19:35:05,907][106225] Updated weights for policy 1, policy_version 49403 (0.0010) [2023-12-27 19:35:05,911][106226] Updated weights for policy 0, policy_version 49289 (0.0009) [2023-12-27 19:35:05,965][106226] Updated weights for policy 0, policy_version 49299 (0.0008) [2023-12-27 19:35:05,967][106225] Updated weights for policy 1, policy_version 49413 (0.0010) [2023-12-27 19:35:06,018][106225] Updated weights for policy 1, policy_version 49423 (0.0010) [2023-12-27 19:35:06,020][106226] Updated weights for policy 0, policy_version 49309 (0.0010) [2023-12-27 19:35:06,067][106226] Updated weights for policy 0, policy_version 49319 (0.0010) [2023-12-27 19:35:06,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 25288704. Throughput: 0: 9766.3, 1: 9996.2. Samples: 25291436. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:35:06,175][105115] Avg episode reward: [(0, '-6.067'), (1, '-6.634')] [2023-12-27 19:35:06,739][106225] Updated weights for policy 1, policy_version 49433 (0.0006) [2023-12-27 19:35:06,801][106225] Updated weights for policy 1, policy_version 49443 (0.0006) [2023-12-27 19:35:06,837][106226] Updated weights for policy 0, policy_version 49329 (0.0011) [2023-12-27 19:35:06,865][106225] Updated weights for policy 1, policy_version 49453 (0.0006) [2023-12-27 19:35:06,895][106226] Updated weights for policy 0, policy_version 49339 (0.0010) [2023-12-27 19:35:06,960][106226] Updated weights for policy 0, policy_version 49349 (0.0011) [2023-12-27 19:35:07,483][106225] Updated weights for policy 1, policy_version 49463 (0.0006) [2023-12-27 19:35:07,535][106225] Updated weights for policy 1, policy_version 49473 (0.0007) [2023-12-27 19:35:07,582][106225] Updated weights for policy 1, policy_version 49483 (0.0008) [2023-12-27 19:35:07,629][106226] Updated weights for policy 0, policy_version 49359 (0.0011) [2023-12-27 19:35:07,682][106226] Updated weights for policy 0, policy_version 49369 (0.0010) [2023-12-27 19:35:07,739][106226] Updated weights for policy 0, policy_version 49379 (0.0010) [2023-12-27 19:35:08,304][106225] Updated weights for policy 1, policy_version 49493 (0.0009) [2023-12-27 19:35:08,365][106225] Updated weights for policy 1, policy_version 49503 (0.0008) [2023-12-27 19:35:08,417][106225] Updated weights for policy 1, policy_version 49513 (0.0006) [2023-12-27 19:35:08,483][106226] Updated weights for policy 0, policy_version 49389 (0.0009) [2023-12-27 19:35:08,542][106226] Updated weights for policy 0, policy_version 49399 (0.0009) [2023-12-27 19:35:08,600][106226] Updated weights for policy 0, policy_version 49409 (0.0009) [2023-12-27 19:35:09,181][106225] Updated weights for policy 1, policy_version 49523 (0.0008) [2023-12-27 19:35:09,258][106226] Updated weights for policy 0, policy_version 49419 (0.0007) [2023-12-27 19:35:09,260][106225] Updated weights for policy 1, policy_version 49533 (0.0007) [2023-12-27 19:35:09,317][106226] Updated weights for policy 0, policy_version 49429 (0.0007) [2023-12-27 19:35:09,319][106225] Updated weights for policy 1, policy_version 49543 (0.0007) [2023-12-27 19:35:09,394][106226] Updated weights for policy 0, policy_version 49439 (0.0009) [2023-12-27 19:35:10,033][106226] Updated weights for policy 0, policy_version 49449 (0.0009) [2023-12-27 19:35:10,083][106225] Updated weights for policy 1, policy_version 49553 (0.0008) [2023-12-27 19:35:10,089][106226] Updated weights for policy 0, policy_version 49459 (0.0008) [2023-12-27 19:35:10,151][106226] Updated weights for policy 0, policy_version 49469 (0.0008) [2023-12-27 19:35:10,152][106225] Updated weights for policy 1, policy_version 49563 (0.0010) [2023-12-27 19:35:10,210][106226] Updated weights for policy 0, policy_version 49479 (0.0007) [2023-12-27 19:35:10,217][106225] Updated weights for policy 1, policy_version 49573 (0.0007) [2023-12-27 19:35:10,280][106225] Updated weights for policy 1, policy_version 49583 (0.0008) [2023-12-27 19:35:10,923][106226] Updated weights for policy 0, policy_version 49489 (0.0009) [2023-12-27 19:35:10,974][106226] Updated weights for policy 0, policy_version 49499 (0.0008) [2023-12-27 19:35:11,003][106225] Updated weights for policy 1, policy_version 49593 (0.0008) [2023-12-27 19:35:11,034][106226] Updated weights for policy 0, policy_version 49509 (0.0007) [2023-12-27 19:35:11,070][106225] Updated weights for policy 1, policy_version 49603 (0.0008) [2023-12-27 19:35:11,130][106225] Updated weights for policy 1, policy_version 49613 (0.0010) [2023-12-27 19:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 25387008. Throughput: 0: 9802.5, 1: 10035.4. Samples: 25350884. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:35:11,175][105115] Avg episode reward: [(0, '-6.151'), (1, '-6.415')] [2023-12-27 19:35:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000049616_12705792.pth... [2023-12-27 19:35:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000049512_12681216.pth... [2023-12-27 19:35:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000048360_12386304.pth [2023-12-27 19:35:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000048432_12402688.pth [2023-12-27 19:35:11,852][106226] Updated weights for policy 0, policy_version 49519 (0.0009) [2023-12-27 19:35:11,879][106225] Updated weights for policy 1, policy_version 49623 (0.0006) [2023-12-27 19:35:11,907][106226] Updated weights for policy 0, policy_version 49529 (0.0009) [2023-12-27 19:35:11,943][106225] Updated weights for policy 1, policy_version 49633 (0.0007) [2023-12-27 19:35:11,960][106226] Updated weights for policy 0, policy_version 49539 (0.0009) [2023-12-27 19:35:12,011][106225] Updated weights for policy 1, policy_version 49643 (0.0009) [2023-12-27 19:35:12,722][106225] Updated weights for policy 1, policy_version 49653 (0.0010) [2023-12-27 19:35:12,723][106226] Updated weights for policy 0, policy_version 49549 (0.0007) [2023-12-27 19:35:12,777][106225] Updated weights for policy 1, policy_version 49663 (0.0010) [2023-12-27 19:35:12,788][106226] Updated weights for policy 0, policy_version 49559 (0.0008) [2023-12-27 19:35:12,837][106225] Updated weights for policy 1, policy_version 49673 (0.0009) [2023-12-27 19:35:12,847][106226] Updated weights for policy 0, policy_version 49569 (0.0006) [2023-12-27 19:35:13,491][106225] Updated weights for policy 1, policy_version 49683 (0.0007) [2023-12-27 19:35:13,542][106225] Updated weights for policy 1, policy_version 49693 (0.0008) [2023-12-27 19:35:13,565][106226] Updated weights for policy 0, policy_version 49579 (0.0007) [2023-12-27 19:35:13,590][106225] Updated weights for policy 1, policy_version 49703 (0.0007) [2023-12-27 19:35:13,612][106226] Updated weights for policy 0, policy_version 49589 (0.0005) [2023-12-27 19:35:13,668][106226] Updated weights for policy 0, policy_version 49599 (0.0008) [2023-12-27 19:35:14,289][106225] Updated weights for policy 1, policy_version 49713 (0.0008) [2023-12-27 19:35:14,343][106225] Updated weights for policy 1, policy_version 49723 (0.0010) [2023-12-27 19:35:14,393][106225] Updated weights for policy 1, policy_version 49733 (0.0010) [2023-12-27 19:35:14,419][106226] Updated weights for policy 0, policy_version 49609 (0.0009) [2023-12-27 19:35:14,453][106225] Updated weights for policy 1, policy_version 49743 (0.0010) [2023-12-27 19:35:14,464][106226] Updated weights for policy 0, policy_version 49619 (0.0008) [2023-12-27 19:35:14,511][106226] Updated weights for policy 0, policy_version 49629 (0.0007) [2023-12-27 19:35:14,565][106226] Updated weights for policy 0, policy_version 49639 (0.0008) [2023-12-27 19:35:15,206][106225] Updated weights for policy 1, policy_version 49753 (0.0009) [2023-12-27 19:35:15,260][106225] Updated weights for policy 1, policy_version 49763 (0.0009) [2023-12-27 19:35:15,313][106226] Updated weights for policy 0, policy_version 49649 (0.0008) [2023-12-27 19:35:15,315][106225] Updated weights for policy 1, policy_version 49773 (0.0007) [2023-12-27 19:35:15,376][106226] Updated weights for policy 0, policy_version 49659 (0.0007) [2023-12-27 19:35:15,435][106226] Updated weights for policy 0, policy_version 49669 (0.0008) [2023-12-27 19:35:16,058][106225] Updated weights for policy 1, policy_version 49783 (0.0006) [2023-12-27 19:35:16,126][106225] Updated weights for policy 1, policy_version 49793 (0.0007) [2023-12-27 19:35:16,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 25468928. Throughput: 0: 9827.5, 1: 9879.2. Samples: 25465216. Policy #0 lag: (min: 21.0, avg: 22.9, max: 53.0) [2023-12-27 19:35:16,175][105115] Avg episode reward: [(0, '-5.624'), (1, '-6.766')] [2023-12-27 19:35:16,178][106226] Updated weights for policy 0, policy_version 49679 (0.0007) [2023-12-27 19:35:16,185][106225] Updated weights for policy 1, policy_version 49803 (0.0006) [2023-12-27 19:35:16,230][106226] Updated weights for policy 0, policy_version 49689 (0.0007) [2023-12-27 19:35:16,285][106226] Updated weights for policy 0, policy_version 49699 (0.0008) [2023-12-27 19:35:16,775][106225] Updated weights for policy 1, policy_version 49813 (0.0007) [2023-12-27 19:35:16,821][106225] Updated weights for policy 1, policy_version 49823 (0.0007) [2023-12-27 19:35:16,874][106225] Updated weights for policy 1, policy_version 49833 (0.0006) [2023-12-27 19:35:17,069][106226] Updated weights for policy 0, policy_version 49709 (0.0008) [2023-12-27 19:35:17,129][106226] Updated weights for policy 0, policy_version 49719 (0.0009) [2023-12-27 19:35:17,194][106226] Updated weights for policy 0, policy_version 49729 (0.0009) [2023-12-27 19:35:17,494][106225] Updated weights for policy 1, policy_version 49843 (0.0007) [2023-12-27 19:35:17,545][106225] Updated weights for policy 1, policy_version 49853 (0.0007) [2023-12-27 19:35:17,596][106225] Updated weights for policy 1, policy_version 49863 (0.0006) [2023-12-27 19:35:17,929][106226] Updated weights for policy 0, policy_version 49739 (0.0010) [2023-12-27 19:35:17,983][106226] Updated weights for policy 0, policy_version 49749 (0.0009) [2023-12-27 19:35:18,052][106226] Updated weights for policy 0, policy_version 49759 (0.0010) [2023-12-27 19:35:18,333][106225] Updated weights for policy 1, policy_version 49873 (0.0008) [2023-12-27 19:35:18,393][106225] Updated weights for policy 1, policy_version 49883 (0.0008) [2023-12-27 19:35:18,448][106225] Updated weights for policy 1, policy_version 49893 (0.0008) [2023-12-27 19:35:18,499][106225] Updated weights for policy 1, policy_version 49903 (0.0008) [2023-12-27 19:35:18,775][106226] Updated weights for policy 0, policy_version 49769 (0.0011) [2023-12-27 19:35:18,835][106226] Updated weights for policy 0, policy_version 49779 (0.0007) [2023-12-27 19:35:18,905][106226] Updated weights for policy 0, policy_version 49789 (0.0008) [2023-12-27 19:35:18,974][106226] Updated weights for policy 0, policy_version 49799 (0.0007) [2023-12-27 19:35:19,195][106225] Updated weights for policy 1, policy_version 49913 (0.0010) [2023-12-27 19:35:19,258][106225] Updated weights for policy 1, policy_version 49923 (0.0009) [2023-12-27 19:35:19,314][106225] Updated weights for policy 1, policy_version 49933 (0.0008) [2023-12-27 19:35:19,653][106226] Updated weights for policy 0, policy_version 49809 (0.0008) [2023-12-27 19:35:19,717][106226] Updated weights for policy 0, policy_version 49819 (0.0008) [2023-12-27 19:35:19,776][106226] Updated weights for policy 0, policy_version 49829 (0.0008) [2023-12-27 19:35:20,061][106225] Updated weights for policy 1, policy_version 49943 (0.0006) [2023-12-27 19:35:20,132][106225] Updated weights for policy 1, policy_version 49953 (0.0009) [2023-12-27 19:35:20,197][106225] Updated weights for policy 1, policy_version 49963 (0.0011) [2023-12-27 19:35:20,535][106226] Updated weights for policy 0, policy_version 49839 (0.0007) [2023-12-27 19:35:20,594][106226] Updated weights for policy 0, policy_version 49849 (0.0007) [2023-12-27 19:35:20,657][106226] Updated weights for policy 0, policy_version 49859 (0.0006) [2023-12-27 19:35:20,926][106225] Updated weights for policy 1, policy_version 49973 (0.0008) [2023-12-27 19:35:20,996][106225] Updated weights for policy 1, policy_version 49983 (0.0008) [2023-12-27 19:35:21,061][106225] Updated weights for policy 1, policy_version 49993 (0.0008) [2023-12-27 19:35:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 25575424. Throughput: 0: 9687.1, 1: 9881.9. Samples: 25582108. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:21,175][105115] Avg episode reward: [(0, '-6.348'), (1, '-6.187')] [2023-12-27 19:35:21,351][106226] Updated weights for policy 0, policy_version 49869 (0.0006) [2023-12-27 19:35:21,430][106226] Updated weights for policy 0, policy_version 49879 (0.0008) [2023-12-27 19:35:21,488][106226] Updated weights for policy 0, policy_version 49889 (0.0009) [2023-12-27 19:35:21,905][106225] Updated weights for policy 1, policy_version 50003 (0.0009) [2023-12-27 19:35:21,963][106225] Updated weights for policy 1, policy_version 50013 (0.0009) [2023-12-27 19:35:22,021][106225] Updated weights for policy 1, policy_version 50023 (0.0009) [2023-12-27 19:35:22,195][106226] Updated weights for policy 0, policy_version 49899 (0.0008) [2023-12-27 19:35:22,255][106226] Updated weights for policy 0, policy_version 49909 (0.0009) [2023-12-27 19:35:22,315][106226] Updated weights for policy 0, policy_version 49919 (0.0009) [2023-12-27 19:35:22,810][106225] Updated weights for policy 1, policy_version 50033 (0.0009) [2023-12-27 19:35:22,869][106225] Updated weights for policy 1, policy_version 50043 (0.0008) [2023-12-27 19:35:22,925][106225] Updated weights for policy 1, policy_version 50053 (0.0010) [2023-12-27 19:35:22,981][106225] Updated weights for policy 1, policy_version 50064 (0.0008) [2023-12-27 19:35:23,078][106226] Updated weights for policy 0, policy_version 49929 (0.0010) [2023-12-27 19:35:23,144][106226] Updated weights for policy 0, policy_version 49939 (0.0008) [2023-12-27 19:35:23,202][106226] Updated weights for policy 0, policy_version 49949 (0.0007) [2023-12-27 19:35:23,265][106226] Updated weights for policy 0, policy_version 49959 (0.0005) [2023-12-27 19:35:23,693][106225] Updated weights for policy 1, policy_version 50074 (0.0010) [2023-12-27 19:35:23,761][106225] Updated weights for policy 1, policy_version 50084 (0.0010) [2023-12-27 19:35:23,814][106226] Updated weights for policy 0, policy_version 49969 (0.0005) [2023-12-27 19:35:23,846][106225] Updated weights for policy 1, policy_version 50094 (0.0010) [2023-12-27 19:35:23,872][106226] Updated weights for policy 0, policy_version 49979 (0.0006) [2023-12-27 19:35:23,933][106226] Updated weights for policy 0, policy_version 49989 (0.0009) [2023-12-27 19:35:24,466][106225] Updated weights for policy 1, policy_version 50104 (0.0008) [2023-12-27 19:35:24,513][106225] Updated weights for policy 1, policy_version 50114 (0.0008) [2023-12-27 19:35:24,568][106225] Updated weights for policy 1, policy_version 50124 (0.0008) [2023-12-27 19:35:24,607][106226] Updated weights for policy 0, policy_version 49999 (0.0010) [2023-12-27 19:35:24,667][106226] Updated weights for policy 0, policy_version 50009 (0.0010) [2023-12-27 19:35:24,733][106226] Updated weights for policy 0, policy_version 50019 (0.0010) [2023-12-27 19:35:25,238][106225] Updated weights for policy 1, policy_version 50134 (0.0007) [2023-12-27 19:35:25,297][106225] Updated weights for policy 1, policy_version 50144 (0.0008) [2023-12-27 19:35:25,346][106225] Updated weights for policy 1, policy_version 50154 (0.0007) [2023-12-27 19:35:25,436][106226] Updated weights for policy 0, policy_version 50029 (0.0010) [2023-12-27 19:35:25,495][106226] Updated weights for policy 0, policy_version 50039 (0.0010) [2023-12-27 19:35:25,554][106226] Updated weights for policy 0, policy_version 50049 (0.0010) [2023-12-27 19:35:26,090][106225] Updated weights for policy 1, policy_version 50164 (0.0007) [2023-12-27 19:35:26,157][106225] Updated weights for policy 1, policy_version 50174 (0.0005) [2023-12-27 19:35:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 25665536. Throughput: 0: 9704.7, 1: 9822.5. Samples: 25639404. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:26,176][105115] Avg episode reward: [(0, '-5.883'), (1, '-6.575')] [2023-12-27 19:35:26,194][106226] Updated weights for policy 0, policy_version 50059 (0.0010) [2023-12-27 19:35:26,220][106225] Updated weights for policy 1, policy_version 50184 (0.0005) [2023-12-27 19:35:26,258][106226] Updated weights for policy 0, policy_version 50069 (0.0011) [2023-12-27 19:35:26,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000050192_12853248.pth... [2023-12-27 19:35:26,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000049040_12558336.pth [2023-12-27 19:35:26,311][106226] Updated weights for policy 0, policy_version 50079 (0.0010) [2023-12-27 19:35:26,360][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000050088_12828672.pth... [2023-12-27 19:35:26,364][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000048936_12533760.pth [2023-12-27 19:35:26,885][106225] Updated weights for policy 1, policy_version 50194 (0.0006) [2023-12-27 19:35:26,947][106225] Updated weights for policy 1, policy_version 50204 (0.0008) [2023-12-27 19:35:26,975][106226] Updated weights for policy 0, policy_version 50089 (0.0010) [2023-12-27 19:35:26,997][106225] Updated weights for policy 1, policy_version 50214 (0.0009) [2023-12-27 19:35:27,033][106226] Updated weights for policy 0, policy_version 50099 (0.0005) [2023-12-27 19:35:27,049][106225] Updated weights for policy 1, policy_version 50224 (0.0008) [2023-12-27 19:35:27,094][106226] Updated weights for policy 0, policy_version 50109 (0.0005) [2023-12-27 19:35:27,142][106226] Updated weights for policy 0, policy_version 50119 (0.0005) [2023-12-27 19:35:27,724][106225] Updated weights for policy 1, policy_version 50234 (0.0008) [2023-12-27 19:35:27,749][106226] Updated weights for policy 0, policy_version 50129 (0.0010) [2023-12-27 19:35:27,770][106225] Updated weights for policy 1, policy_version 50244 (0.0010) [2023-12-27 19:35:27,808][106226] Updated weights for policy 0, policy_version 50139 (0.0010) [2023-12-27 19:35:27,816][106225] Updated weights for policy 1, policy_version 50254 (0.0010) [2023-12-27 19:35:27,864][106226] Updated weights for policy 0, policy_version 50149 (0.0010) [2023-12-27 19:35:28,454][106225] Updated weights for policy 1, policy_version 50264 (0.0009) [2023-12-27 19:35:28,511][106225] Updated weights for policy 1, policy_version 50274 (0.0010) [2023-12-27 19:35:28,561][106226] Updated weights for policy 0, policy_version 50159 (0.0007) [2023-12-27 19:35:28,573][106225] Updated weights for policy 1, policy_version 50284 (0.0010) [2023-12-27 19:35:28,624][106226] Updated weights for policy 0, policy_version 50169 (0.0006) [2023-12-27 19:35:28,691][106226] Updated weights for policy 0, policy_version 50179 (0.0005) [2023-12-27 19:35:29,295][106225] Updated weights for policy 1, policy_version 50294 (0.0009) [2023-12-27 19:35:29,336][106226] Updated weights for policy 0, policy_version 50189 (0.0008) [2023-12-27 19:35:29,369][106225] Updated weights for policy 1, policy_version 50304 (0.0007) [2023-12-27 19:35:29,399][106226] Updated weights for policy 0, policy_version 50199 (0.0008) [2023-12-27 19:35:29,423][106225] Updated weights for policy 1, policy_version 50314 (0.0007) [2023-12-27 19:35:29,457][106226] Updated weights for policy 0, policy_version 50209 (0.0008) [2023-12-27 19:35:30,151][106225] Updated weights for policy 1, policy_version 50324 (0.0007) [2023-12-27 19:35:30,183][106226] Updated weights for policy 0, policy_version 50219 (0.0008) [2023-12-27 19:35:30,207][106225] Updated weights for policy 1, policy_version 50334 (0.0009) [2023-12-27 19:35:30,232][106226] Updated weights for policy 0, policy_version 50229 (0.0009) [2023-12-27 19:35:30,256][106225] Updated weights for policy 1, policy_version 50344 (0.0009) [2023-12-27 19:35:30,285][106226] Updated weights for policy 0, policy_version 50239 (0.0009) [2023-12-27 19:35:30,944][106225] Updated weights for policy 1, policy_version 50354 (0.0009) [2023-12-27 19:35:30,953][106226] Updated weights for policy 0, policy_version 50249 (0.0009) [2023-12-27 19:35:31,000][106225] Updated weights for policy 1, policy_version 50364 (0.0006) [2023-12-27 19:35:31,006][106226] Updated weights for policy 0, policy_version 50259 (0.0008) [2023-12-27 19:35:31,062][106225] Updated weights for policy 1, policy_version 50374 (0.0010) [2023-12-27 19:35:31,074][106226] Updated weights for policy 0, policy_version 50270 (0.0007) [2023-12-27 19:35:31,116][106225] Updated weights for policy 1, policy_version 50384 (0.0010) [2023-12-27 19:35:31,133][106226] Updated weights for policy 0, policy_version 50280 (0.0007) [2023-12-27 19:35:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 25780224. Throughput: 0: 9869.2, 1: 9876.6. Samples: 25761856. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:31,175][105115] Avg episode reward: [(0, '-6.032'), (1, '-6.636')] [2023-12-27 19:35:31,914][106226] Updated weights for policy 0, policy_version 50290 (0.0006) [2023-12-27 19:35:31,927][106225] Updated weights for policy 1, policy_version 50394 (0.0009) [2023-12-27 19:35:31,973][106226] Updated weights for policy 0, policy_version 50300 (0.0006) [2023-12-27 19:35:31,990][106225] Updated weights for policy 1, policy_version 50404 (0.0009) [2023-12-27 19:35:32,035][106226] Updated weights for policy 0, policy_version 50310 (0.0008) [2023-12-27 19:35:32,054][106225] Updated weights for policy 1, policy_version 50414 (0.0007) [2023-12-27 19:35:32,778][106225] Updated weights for policy 1, policy_version 50424 (0.0008) [2023-12-27 19:35:32,782][106226] Updated weights for policy 0, policy_version 50320 (0.0008) [2023-12-27 19:35:32,844][106225] Updated weights for policy 1, policy_version 50434 (0.0006) [2023-12-27 19:35:32,846][106226] Updated weights for policy 0, policy_version 50330 (0.0006) [2023-12-27 19:35:32,907][106226] Updated weights for policy 0, policy_version 50340 (0.0006) [2023-12-27 19:35:32,908][106225] Updated weights for policy 1, policy_version 50444 (0.0009) [2023-12-27 19:35:33,510][106225] Updated weights for policy 1, policy_version 50454 (0.0007) [2023-12-27 19:35:33,555][106225] Updated weights for policy 1, policy_version 50464 (0.0005) [2023-12-27 19:35:33,600][106225] Updated weights for policy 1, policy_version 50474 (0.0006) [2023-12-27 19:35:33,626][106226] Updated weights for policy 0, policy_version 50350 (0.0009) [2023-12-27 19:35:33,689][106226] Updated weights for policy 0, policy_version 50360 (0.0010) [2023-12-27 19:35:33,757][106226] Updated weights for policy 0, policy_version 50370 (0.0009) [2023-12-27 19:35:34,180][106225] Updated weights for policy 1, policy_version 50484 (0.0006) [2023-12-27 19:35:34,248][106225] Updated weights for policy 1, policy_version 50494 (0.0010) [2023-12-27 19:35:34,299][106225] Updated weights for policy 1, policy_version 50504 (0.0010) [2023-12-27 19:35:34,503][106226] Updated weights for policy 0, policy_version 50380 (0.0008) [2023-12-27 19:35:34,561][106226] Updated weights for policy 0, policy_version 50390 (0.0009) [2023-12-27 19:35:34,625][106226] Updated weights for policy 0, policy_version 50400 (0.0007) [2023-12-27 19:35:34,965][106225] Updated weights for policy 1, policy_version 50514 (0.0009) [2023-12-27 19:35:35,021][106225] Updated weights for policy 1, policy_version 50524 (0.0006) [2023-12-27 19:35:35,066][106225] Updated weights for policy 1, policy_version 50534 (0.0008) [2023-12-27 19:35:35,125][106225] Updated weights for policy 1, policy_version 50544 (0.0010) [2023-12-27 19:35:35,389][106226] Updated weights for policy 0, policy_version 50410 (0.0008) [2023-12-27 19:35:35,446][106226] Updated weights for policy 0, policy_version 50420 (0.0009) [2023-12-27 19:35:35,509][106226] Updated weights for policy 0, policy_version 50430 (0.0008) [2023-12-27 19:35:35,570][106226] Updated weights for policy 0, policy_version 50440 (0.0009) [2023-12-27 19:35:35,701][106225] Updated weights for policy 1, policy_version 50554 (0.0011) [2023-12-27 19:35:35,766][106225] Updated weights for policy 1, policy_version 50564 (0.0010) [2023-12-27 19:35:35,826][106225] Updated weights for policy 1, policy_version 50574 (0.0010) [2023-12-27 19:35:36,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 25870336. Throughput: 0: 9780.8, 1: 9926.3. Samples: 25880200. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:36,175][105115] Avg episode reward: [(0, '-5.783'), (1, '-6.611')] [2023-12-27 19:35:36,344][106226] Updated weights for policy 0, policy_version 50450 (0.0008) [2023-12-27 19:35:36,415][106226] Updated weights for policy 0, policy_version 50460 (0.0008) [2023-12-27 19:35:36,479][106226] Updated weights for policy 0, policy_version 50470 (0.0009) [2023-12-27 19:35:36,567][106225] Updated weights for policy 1, policy_version 50584 (0.0009) [2023-12-27 19:35:36,628][106225] Updated weights for policy 1, policy_version 50594 (0.0009) [2023-12-27 19:35:36,693][106225] Updated weights for policy 1, policy_version 50604 (0.0009) [2023-12-27 19:35:37,154][106226] Updated weights for policy 0, policy_version 50480 (0.0009) [2023-12-27 19:35:37,212][106226] Updated weights for policy 0, policy_version 50490 (0.0010) [2023-12-27 19:35:37,276][106226] Updated weights for policy 0, policy_version 50500 (0.0008) [2023-12-27 19:35:37,417][106225] Updated weights for policy 1, policy_version 50614 (0.0007) [2023-12-27 19:35:37,474][106225] Updated weights for policy 1, policy_version 50624 (0.0005) [2023-12-27 19:35:37,531][106225] Updated weights for policy 1, policy_version 50634 (0.0005) [2023-12-27 19:35:38,055][106226] Updated weights for policy 0, policy_version 50510 (0.0006) [2023-12-27 19:35:38,106][106226] Updated weights for policy 0, policy_version 50520 (0.0005) [2023-12-27 19:35:38,170][106225] Updated weights for policy 1, policy_version 50644 (0.0006) [2023-12-27 19:35:38,173][106226] Updated weights for policy 0, policy_version 50530 (0.0006) [2023-12-27 19:35:38,217][106225] Updated weights for policy 1, policy_version 50654 (0.0005) [2023-12-27 19:35:38,271][106225] Updated weights for policy 1, policy_version 50664 (0.0008) [2023-12-27 19:35:38,861][106226] Updated weights for policy 0, policy_version 50540 (0.0008) [2023-12-27 19:35:38,920][106226] Updated weights for policy 0, policy_version 50550 (0.0009) [2023-12-27 19:35:38,987][106226] Updated weights for policy 0, policy_version 50560 (0.0009) [2023-12-27 19:35:38,990][106225] Updated weights for policy 1, policy_version 50674 (0.0008) [2023-12-27 19:35:39,048][106225] Updated weights for policy 1, policy_version 50684 (0.0006) [2023-12-27 19:35:39,106][106225] Updated weights for policy 1, policy_version 50694 (0.0008) [2023-12-27 19:35:39,153][106225] Updated weights for policy 1, policy_version 50704 (0.0006) [2023-12-27 19:35:39,816][106226] Updated weights for policy 0, policy_version 50570 (0.0007) [2023-12-27 19:35:39,871][106225] Updated weights for policy 1, policy_version 50714 (0.0008) [2023-12-27 19:35:39,883][106226] Updated weights for policy 0, policy_version 50580 (0.0007) [2023-12-27 19:35:39,929][106225] Updated weights for policy 1, policy_version 50724 (0.0007) [2023-12-27 19:35:39,947][106226] Updated weights for policy 0, policy_version 50590 (0.0007) [2023-12-27 19:35:39,993][106225] Updated weights for policy 1, policy_version 50734 (0.0006) [2023-12-27 19:35:40,010][106226] Updated weights for policy 0, policy_version 50600 (0.0007) [2023-12-27 19:35:40,644][106226] Updated weights for policy 0, policy_version 50610 (0.0008) [2023-12-27 19:35:40,705][106226] Updated weights for policy 0, policy_version 50620 (0.0007) [2023-12-27 19:35:40,762][106226] Updated weights for policy 0, policy_version 50630 (0.0009) [2023-12-27 19:35:40,763][106225] Updated weights for policy 1, policy_version 50744 (0.0005) [2023-12-27 19:35:40,810][106225] Updated weights for policy 1, policy_version 50754 (0.0008) [2023-12-27 19:35:40,864][106225] Updated weights for policy 1, policy_version 50764 (0.0007) [2023-12-27 19:35:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 25968640. Throughput: 0: 9767.6, 1: 9924.1. Samples: 25937840. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:41,175][105115] Avg episode reward: [(0, '-5.840'), (1, '-6.350')] [2023-12-27 19:35:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000050768_13000704.pth... [2023-12-27 19:35:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000050632_12967936.pth... [2023-12-27 19:35:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000049616_12705792.pth [2023-12-27 19:35:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000049512_12681216.pth [2023-12-27 19:35:41,543][106226] Updated weights for policy 0, policy_version 50640 (0.0009) [2023-12-27 19:35:41,608][106226] Updated weights for policy 0, policy_version 50650 (0.0009) [2023-12-27 19:35:41,621][106225] Updated weights for policy 1, policy_version 50774 (0.0008) [2023-12-27 19:35:41,671][106226] Updated weights for policy 0, policy_version 50660 (0.0009) [2023-12-27 19:35:41,681][106225] Updated weights for policy 1, policy_version 50784 (0.0007) [2023-12-27 19:35:41,751][106225] Updated weights for policy 1, policy_version 50794 (0.0007) [2023-12-27 19:35:42,349][106226] Updated weights for policy 0, policy_version 50670 (0.0009) [2023-12-27 19:35:42,412][106226] Updated weights for policy 0, policy_version 50680 (0.0008) [2023-12-27 19:35:42,468][106226] Updated weights for policy 0, policy_version 50690 (0.0008) [2023-12-27 19:35:42,472][106225] Updated weights for policy 1, policy_version 50804 (0.0010) [2023-12-27 19:35:42,533][106225] Updated weights for policy 1, policy_version 50814 (0.0007) [2023-12-27 19:35:42,583][106225] Updated weights for policy 1, policy_version 50824 (0.0010) [2023-12-27 19:35:43,152][106226] Updated weights for policy 0, policy_version 50700 (0.0007) [2023-12-27 19:35:43,219][106226] Updated weights for policy 0, policy_version 50710 (0.0006) [2023-12-27 19:35:43,284][106226] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-12-27 19:35:43,313][106225] Updated weights for policy 1, policy_version 50834 (0.0010) [2023-12-27 19:35:43,371][106225] Updated weights for policy 1, policy_version 50844 (0.0008) [2023-12-27 19:35:43,440][106225] Updated weights for policy 1, policy_version 50854 (0.0005) [2023-12-27 19:35:43,501][106225] Updated weights for policy 1, policy_version 50864 (0.0005) [2023-12-27 19:35:43,894][106226] Updated weights for policy 0, policy_version 50730 (0.0005) [2023-12-27 19:35:43,945][106226] Updated weights for policy 0, policy_version 50740 (0.0005) [2023-12-27 19:35:43,999][106226] Updated weights for policy 0, policy_version 50750 (0.0005) [2023-12-27 19:35:44,047][106226] Updated weights for policy 0, policy_version 50760 (0.0005) [2023-12-27 19:35:44,115][106225] Updated weights for policy 1, policy_version 50874 (0.0010) [2023-12-27 19:35:44,163][106225] Updated weights for policy 1, policy_version 50885 (0.0007) [2023-12-27 19:35:44,219][106225] Updated weights for policy 1, policy_version 50895 (0.0005) [2023-12-27 19:35:44,648][106226] Updated weights for policy 0, policy_version 50770 (0.0008) [2023-12-27 19:35:44,708][106226] Updated weights for policy 0, policy_version 50780 (0.0009) [2023-12-27 19:35:44,787][106226] Updated weights for policy 0, policy_version 50790 (0.0009) [2023-12-27 19:35:44,939][106225] Updated weights for policy 1, policy_version 50905 (0.0008) [2023-12-27 19:35:44,995][106225] Updated weights for policy 1, policy_version 50915 (0.0008) [2023-12-27 19:35:45,048][106225] Updated weights for policy 1, policy_version 50925 (0.0008) [2023-12-27 19:35:45,521][106226] Updated weights for policy 0, policy_version 50800 (0.0008) [2023-12-27 19:35:45,576][106226] Updated weights for policy 0, policy_version 50810 (0.0007) [2023-12-27 19:35:45,640][106226] Updated weights for policy 0, policy_version 50820 (0.0005) [2023-12-27 19:35:45,795][106225] Updated weights for policy 1, policy_version 50935 (0.0009) [2023-12-27 19:35:45,853][106225] Updated weights for policy 1, policy_version 50945 (0.0008) [2023-12-27 19:35:45,904][106225] Updated weights for policy 1, policy_version 50955 (0.0008) [2023-12-27 19:35:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 26066944. Throughput: 0: 9732.5, 1: 9845.4. Samples: 26055768. Policy #0 lag: (min: 14.0, avg: 17.4, max: 46.0) [2023-12-27 19:35:46,175][105115] Avg episode reward: [(0, '-5.751'), (1, '-6.365')] [2023-12-27 19:35:46,312][106226] Updated weights for policy 0, policy_version 50830 (0.0007) [2023-12-27 19:35:46,361][106226] Updated weights for policy 0, policy_version 50840 (0.0009) [2023-12-27 19:35:46,413][106226] Updated weights for policy 0, policy_version 50850 (0.0007) [2023-12-27 19:35:46,606][106225] Updated weights for policy 1, policy_version 50965 (0.0007) [2023-12-27 19:35:46,666][106225] Updated weights for policy 1, policy_version 50975 (0.0008) [2023-12-27 19:35:46,725][106225] Updated weights for policy 1, policy_version 50985 (0.0008) [2023-12-27 19:35:47,129][106226] Updated weights for policy 0, policy_version 50860 (0.0008) [2023-12-27 19:35:47,184][106226] Updated weights for policy 0, policy_version 50870 (0.0005) [2023-12-27 19:35:47,240][106226] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-12-27 19:35:47,469][106225] Updated weights for policy 1, policy_version 50995 (0.0008) [2023-12-27 19:35:47,535][106225] Updated weights for policy 1, policy_version 51005 (0.0010) [2023-12-27 19:35:47,592][106225] Updated weights for policy 1, policy_version 51015 (0.0007) [2023-12-27 19:35:47,821][106226] Updated weights for policy 0, policy_version 50890 (0.0006) [2023-12-27 19:35:47,877][106226] Updated weights for policy 0, policy_version 50900 (0.0007) [2023-12-27 19:35:47,937][106226] Updated weights for policy 0, policy_version 50910 (0.0009) [2023-12-27 19:35:48,000][106226] Updated weights for policy 0, policy_version 50920 (0.0010) [2023-12-27 19:35:48,376][106225] Updated weights for policy 1, policy_version 51025 (0.0007) [2023-12-27 19:35:48,439][106225] Updated weights for policy 1, policy_version 51035 (0.0008) [2023-12-27 19:35:48,501][106225] Updated weights for policy 1, policy_version 51045 (0.0008) [2023-12-27 19:35:48,569][106225] Updated weights for policy 1, policy_version 51055 (0.0008) [2023-12-27 19:35:48,742][106226] Updated weights for policy 0, policy_version 50930 (0.0011) [2023-12-27 19:35:48,808][106226] Updated weights for policy 0, policy_version 50940 (0.0011) [2023-12-27 19:35:48,876][106226] Updated weights for policy 0, policy_version 50950 (0.0005) [2023-12-27 19:35:49,375][106225] Updated weights for policy 1, policy_version 51065 (0.0008) [2023-12-27 19:35:49,428][106226] Updated weights for policy 0, policy_version 50960 (0.0011) [2023-12-27 19:35:49,431][106225] Updated weights for policy 1, policy_version 51075 (0.0008) [2023-12-27 19:35:49,488][106225] Updated weights for policy 1, policy_version 51085 (0.0008) [2023-12-27 19:35:49,488][106226] Updated weights for policy 0, policy_version 50970 (0.0011) [2023-12-27 19:35:49,546][106226] Updated weights for policy 0, policy_version 50980 (0.0011) [2023-12-27 19:35:50,209][106226] Updated weights for policy 0, policy_version 50990 (0.0009) [2023-12-27 19:35:50,239][106225] Updated weights for policy 1, policy_version 51095 (0.0010) [2023-12-27 19:35:50,274][106226] Updated weights for policy 0, policy_version 51000 (0.0010) [2023-12-27 19:35:50,296][106225] Updated weights for policy 1, policy_version 51105 (0.0010) [2023-12-27 19:35:50,329][106226] Updated weights for policy 0, policy_version 51010 (0.0011) [2023-12-27 19:35:50,349][106225] Updated weights for policy 1, policy_version 51115 (0.0010) [2023-12-27 19:35:51,078][106225] Updated weights for policy 1, policy_version 51125 (0.0008) [2023-12-27 19:35:51,094][106226] Updated weights for policy 0, policy_version 51020 (0.0009) [2023-12-27 19:35:51,159][106225] Updated weights for policy 1, policy_version 51135 (0.0007) [2023-12-27 19:35:51,161][106226] Updated weights for policy 0, policy_version 51030 (0.0008) [2023-12-27 19:35:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 26157056. Throughput: 0: 9805.3, 1: 9787.9. Samples: 26173132. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:35:51,175][105115] Avg episode reward: [(0, '-6.196'), (1, '-6.730')] [2023-12-27 19:35:51,219][106225] Updated weights for policy 1, policy_version 51145 (0.0007) [2023-12-27 19:35:51,226][106226] Updated weights for policy 0, policy_version 51040 (0.0008) [2023-12-27 19:35:51,936][106225] Updated weights for policy 1, policy_version 51155 (0.0007) [2023-12-27 19:35:51,954][106226] Updated weights for policy 0, policy_version 51050 (0.0007) [2023-12-27 19:35:52,000][106225] Updated weights for policy 1, policy_version 51165 (0.0006) [2023-12-27 19:35:52,017][106226] Updated weights for policy 0, policy_version 51060 (0.0008) [2023-12-27 19:35:52,064][106225] Updated weights for policy 1, policy_version 51175 (0.0006) [2023-12-27 19:35:52,073][106226] Updated weights for policy 0, policy_version 51070 (0.0008) [2023-12-27 19:35:52,129][106226] Updated weights for policy 0, policy_version 51080 (0.0006) [2023-12-27 19:35:52,743][106225] Updated weights for policy 1, policy_version 51185 (0.0008) [2023-12-27 19:35:52,811][106225] Updated weights for policy 1, policy_version 51195 (0.0010) [2023-12-27 19:35:52,856][106226] Updated weights for policy 0, policy_version 51090 (0.0005) [2023-12-27 19:35:52,876][106225] Updated weights for policy 1, policy_version 51205 (0.0010) [2023-12-27 19:35:52,910][106226] Updated weights for policy 0, policy_version 51100 (0.0005) [2023-12-27 19:35:52,939][106225] Updated weights for policy 1, policy_version 51215 (0.0007) [2023-12-27 19:35:52,968][106226] Updated weights for policy 0, policy_version 51110 (0.0006) [2023-12-27 19:35:53,455][106225] Updated weights for policy 1, policy_version 51225 (0.0005) [2023-12-27 19:35:53,506][106225] Updated weights for policy 1, policy_version 51235 (0.0005) [2023-12-27 19:35:53,562][106225] Updated weights for policy 1, policy_version 51245 (0.0009) [2023-12-27 19:35:53,735][106226] Updated weights for policy 0, policy_version 51120 (0.0009) [2023-12-27 19:35:53,795][106226] Updated weights for policy 0, policy_version 51130 (0.0008) [2023-12-27 19:35:53,861][106226] Updated weights for policy 0, policy_version 51140 (0.0005) [2023-12-27 19:35:54,212][106225] Updated weights for policy 1, policy_version 51255 (0.0009) [2023-12-27 19:35:54,273][106225] Updated weights for policy 1, policy_version 51265 (0.0010) [2023-12-27 19:35:54,337][106225] Updated weights for policy 1, policy_version 51275 (0.0010) [2023-12-27 19:35:54,402][106226] Updated weights for policy 0, policy_version 51150 (0.0007) [2023-12-27 19:35:54,463][106226] Updated weights for policy 0, policy_version 51160 (0.0008) [2023-12-27 19:35:54,518][106226] Updated weights for policy 0, policy_version 51170 (0.0008) [2023-12-27 19:35:55,034][106225] Updated weights for policy 1, policy_version 51285 (0.0010) [2023-12-27 19:35:55,084][106225] Updated weights for policy 1, policy_version 51295 (0.0010) [2023-12-27 19:35:55,136][106225] Updated weights for policy 1, policy_version 51305 (0.0010) [2023-12-27 19:35:55,260][106226] Updated weights for policy 0, policy_version 51180 (0.0008) [2023-12-27 19:35:55,311][106226] Updated weights for policy 0, policy_version 51190 (0.0009) [2023-12-27 19:35:55,362][106226] Updated weights for policy 0, policy_version 51200 (0.0007) [2023-12-27 19:35:55,731][106225] Updated weights for policy 1, policy_version 51315 (0.0008) [2023-12-27 19:35:55,795][106225] Updated weights for policy 1, policy_version 51325 (0.0005) [2023-12-27 19:35:55,864][106225] Updated weights for policy 1, policy_version 51335 (0.0005) [2023-12-27 19:35:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 26263552. Throughput: 0: 9785.1, 1: 9808.4. Samples: 26232588. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:35:56,175][105115] Avg episode reward: [(0, '-5.786'), (1, '-6.386')] [2023-12-27 19:35:56,178][106226] Updated weights for policy 0, policy_version 51210 (0.0009) [2023-12-27 19:35:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000051344_13148160.pth... [2023-12-27 19:35:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000050192_12853248.pth [2023-12-27 19:35:56,229][106226] Updated weights for policy 0, policy_version 51220 (0.0008) [2023-12-27 19:35:56,283][106226] Updated weights for policy 0, policy_version 51230 (0.0008) [2023-12-27 19:35:56,343][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000051240_13123584.pth... [2023-12-27 19:35:56,344][106226] Updated weights for policy 0, policy_version 51240 (0.0007) [2023-12-27 19:35:56,347][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000050088_12828672.pth [2023-12-27 19:35:56,477][106225] Updated weights for policy 1, policy_version 51345 (0.0006) [2023-12-27 19:35:56,532][106225] Updated weights for policy 1, policy_version 51355 (0.0010) [2023-12-27 19:35:56,593][106225] Updated weights for policy 1, policy_version 51365 (0.0010) [2023-12-27 19:35:56,655][106225] Updated weights for policy 1, policy_version 51375 (0.0010) [2023-12-27 19:35:57,106][106226] Updated weights for policy 0, policy_version 51250 (0.0008) [2023-12-27 19:35:57,152][106226] Updated weights for policy 0, policy_version 51260 (0.0007) [2023-12-27 19:35:57,200][106226] Updated weights for policy 0, policy_version 51270 (0.0008) [2023-12-27 19:35:57,344][106225] Updated weights for policy 1, policy_version 51385 (0.0009) [2023-12-27 19:35:57,393][106225] Updated weights for policy 1, policy_version 51395 (0.0005) [2023-12-27 19:35:57,440][106225] Updated weights for policy 1, policy_version 51405 (0.0009) [2023-12-27 19:35:57,997][106225] Updated weights for policy 1, policy_version 51415 (0.0007) [2023-12-27 19:35:58,016][106226] Updated weights for policy 0, policy_version 51280 (0.0007) [2023-12-27 19:35:58,062][106225] Updated weights for policy 1, policy_version 51425 (0.0010) [2023-12-27 19:35:58,067][106226] Updated weights for policy 0, policy_version 51290 (0.0006) [2023-12-27 19:35:58,122][106225] Updated weights for policy 1, policy_version 51435 (0.0007) [2023-12-27 19:35:58,123][106226] Updated weights for policy 0, policy_version 51300 (0.0006) [2023-12-27 19:35:58,826][106226] Updated weights for policy 0, policy_version 51310 (0.0009) [2023-12-27 19:35:58,893][106226] Updated weights for policy 0, policy_version 51320 (0.0008) [2023-12-27 19:35:58,907][106225] Updated weights for policy 1, policy_version 51445 (0.0006) [2023-12-27 19:35:58,964][106226] Updated weights for policy 0, policy_version 51330 (0.0009) [2023-12-27 19:35:58,977][106225] Updated weights for policy 1, policy_version 51455 (0.0007) [2023-12-27 19:35:59,041][106225] Updated weights for policy 1, policy_version 51465 (0.0007) [2023-12-27 19:35:59,725][106226] Updated weights for policy 0, policy_version 51340 (0.0007) [2023-12-27 19:35:59,783][106226] Updated weights for policy 0, policy_version 51350 (0.0005) [2023-12-27 19:35:59,836][106225] Updated weights for policy 1, policy_version 51475 (0.0008) [2023-12-27 19:35:59,843][106226] Updated weights for policy 0, policy_version 51360 (0.0007) [2023-12-27 19:35:59,898][106225] Updated weights for policy 1, policy_version 51485 (0.0007) [2023-12-27 19:35:59,968][106225] Updated weights for policy 1, policy_version 51495 (0.0008) [2023-12-27 19:36:00,566][106226] Updated weights for policy 0, policy_version 51370 (0.0007) [2023-12-27 19:36:00,579][106225] Updated weights for policy 1, policy_version 51505 (0.0008) [2023-12-27 19:36:00,630][106226] Updated weights for policy 0, policy_version 51380 (0.0008) [2023-12-27 19:36:00,636][106225] Updated weights for policy 1, policy_version 51515 (0.0008) [2023-12-27 19:36:00,683][106226] Updated weights for policy 0, policy_version 51390 (0.0005) [2023-12-27 19:36:00,695][106225] Updated weights for policy 1, policy_version 51525 (0.0010) [2023-12-27 19:36:00,743][106226] Updated weights for policy 0, policy_version 51400 (0.0008) [2023-12-27 19:36:00,751][106225] Updated weights for policy 1, policy_version 51535 (0.0010) [2023-12-27 19:36:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 26361856. Throughput: 0: 9769.1, 1: 9915.0. Samples: 26350996. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:36:01,175][105115] Avg episode reward: [(0, '-6.174'), (1, '-6.927')] [2023-12-27 19:36:01,502][106225] Updated weights for policy 1, policy_version 51545 (0.0010) [2023-12-27 19:36:01,505][106226] Updated weights for policy 0, policy_version 51410 (0.0007) [2023-12-27 19:36:01,559][106226] Updated weights for policy 0, policy_version 51420 (0.0009) [2023-12-27 19:36:01,562][106225] Updated weights for policy 1, policy_version 51555 (0.0010) [2023-12-27 19:36:01,625][106225] Updated weights for policy 1, policy_version 51565 (0.0010) [2023-12-27 19:36:01,629][106226] Updated weights for policy 0, policy_version 51430 (0.0007) [2023-12-27 19:36:02,215][106226] Updated weights for policy 0, policy_version 51440 (0.0008) [2023-12-27 19:36:02,269][106226] Updated weights for policy 0, policy_version 51450 (0.0007) [2023-12-27 19:36:02,329][106226] Updated weights for policy 0, policy_version 51460 (0.0006) [2023-12-27 19:36:02,398][106225] Updated weights for policy 1, policy_version 51575 (0.0009) [2023-12-27 19:36:02,460][106225] Updated weights for policy 1, policy_version 51585 (0.0008) [2023-12-27 19:36:02,522][106225] Updated weights for policy 1, policy_version 51595 (0.0008) [2023-12-27 19:36:02,972][106226] Updated weights for policy 0, policy_version 51470 (0.0010) [2023-12-27 19:36:03,034][106226] Updated weights for policy 0, policy_version 51480 (0.0011) [2023-12-27 19:36:03,107][106226] Updated weights for policy 0, policy_version 51490 (0.0009) [2023-12-27 19:36:03,215][106225] Updated weights for policy 1, policy_version 51605 (0.0008) [2023-12-27 19:36:03,273][106225] Updated weights for policy 1, policy_version 51615 (0.0009) [2023-12-27 19:36:03,336][106225] Updated weights for policy 1, policy_version 51625 (0.0009) [2023-12-27 19:36:03,844][106226] Updated weights for policy 0, policy_version 51500 (0.0010) [2023-12-27 19:36:03,910][106226] Updated weights for policy 0, policy_version 51510 (0.0008) [2023-12-27 19:36:03,968][106226] Updated weights for policy 0, policy_version 51520 (0.0011) [2023-12-27 19:36:04,141][106225] Updated weights for policy 1, policy_version 51635 (0.0008) [2023-12-27 19:36:04,190][106225] Updated weights for policy 1, policy_version 51645 (0.0006) [2023-12-27 19:36:04,244][106225] Updated weights for policy 1, policy_version 51655 (0.0007) [2023-12-27 19:36:04,690][106226] Updated weights for policy 0, policy_version 51530 (0.0008) [2023-12-27 19:36:04,748][106226] Updated weights for policy 0, policy_version 51540 (0.0011) [2023-12-27 19:36:04,804][106226] Updated weights for policy 0, policy_version 51550 (0.0010) [2023-12-27 19:36:04,864][106226] Updated weights for policy 0, policy_version 51560 (0.0011) [2023-12-27 19:36:04,918][106225] Updated weights for policy 1, policy_version 51665 (0.0006) [2023-12-27 19:36:04,977][106225] Updated weights for policy 1, policy_version 51675 (0.0010) [2023-12-27 19:36:05,033][106225] Updated weights for policy 1, policy_version 51685 (0.0010) [2023-12-27 19:36:05,096][106225] Updated weights for policy 1, policy_version 51695 (0.0010) [2023-12-27 19:36:05,585][106226] Updated weights for policy 0, policy_version 51570 (0.0011) [2023-12-27 19:36:05,645][106226] Updated weights for policy 0, policy_version 51580 (0.0010) [2023-12-27 19:36:05,692][106226] Updated weights for policy 0, policy_version 51590 (0.0010) [2023-12-27 19:36:05,809][106225] Updated weights for policy 1, policy_version 51705 (0.0010) [2023-12-27 19:36:05,870][106225] Updated weights for policy 1, policy_version 51715 (0.0010) [2023-12-27 19:36:05,930][106225] Updated weights for policy 1, policy_version 51725 (0.0010) [2023-12-27 19:36:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 26460160. Throughput: 0: 9820.8, 1: 9859.2. Samples: 26467708. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:36:06,175][105115] Avg episode reward: [(0, '-6.345'), (1, '-6.362')] [2023-12-27 19:36:06,420][106226] Updated weights for policy 0, policy_version 51600 (0.0011) [2023-12-27 19:36:06,486][106226] Updated weights for policy 0, policy_version 51610 (0.0011) [2023-12-27 19:36:06,558][106226] Updated weights for policy 0, policy_version 51620 (0.0011) [2023-12-27 19:36:06,582][106225] Updated weights for policy 1, policy_version 51735 (0.0011) [2023-12-27 19:36:06,652][106225] Updated weights for policy 1, policy_version 51745 (0.0009) [2023-12-27 19:36:06,723][106225] Updated weights for policy 1, policy_version 51755 (0.0011) [2023-12-27 19:36:07,255][106226] Updated weights for policy 0, policy_version 51630 (0.0009) [2023-12-27 19:36:07,309][106226] Updated weights for policy 0, policy_version 51640 (0.0008) [2023-12-27 19:36:07,357][106226] Updated weights for policy 0, policy_version 51650 (0.0007) [2023-12-27 19:36:07,382][106225] Updated weights for policy 1, policy_version 51765 (0.0011) [2023-12-27 19:36:07,439][106225] Updated weights for policy 1, policy_version 51775 (0.0010) [2023-12-27 19:36:07,509][106225] Updated weights for policy 1, policy_version 51785 (0.0009) [2023-12-27 19:36:08,073][106226] Updated weights for policy 0, policy_version 51660 (0.0006) [2023-12-27 19:36:08,132][106225] Updated weights for policy 1, policy_version 51795 (0.0009) [2023-12-27 19:36:08,133][106226] Updated weights for policy 0, policy_version 51670 (0.0006) [2023-12-27 19:36:08,183][106226] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-12-27 19:36:08,193][106225] Updated weights for policy 1, policy_version 51805 (0.0010) [2023-12-27 19:36:08,250][106225] Updated weights for policy 1, policy_version 51815 (0.0010) [2023-12-27 19:36:08,772][106226] Updated weights for policy 0, policy_version 51690 (0.0007) [2023-12-27 19:36:08,838][106226] Updated weights for policy 0, policy_version 51700 (0.0011) [2023-12-27 19:36:08,900][106226] Updated weights for policy 0, policy_version 51710 (0.0011) [2023-12-27 19:36:08,967][106226] Updated weights for policy 0, policy_version 51720 (0.0011) [2023-12-27 19:36:09,020][106225] Updated weights for policy 1, policy_version 51825 (0.0010) [2023-12-27 19:36:09,079][106225] Updated weights for policy 1, policy_version 51835 (0.0010) [2023-12-27 19:36:09,129][106225] Updated weights for policy 1, policy_version 51845 (0.0010) [2023-12-27 19:36:09,175][106225] Updated weights for policy 1, policy_version 51855 (0.0010) [2023-12-27 19:36:09,700][106226] Updated weights for policy 0, policy_version 51730 (0.0011) [2023-12-27 19:36:09,764][106226] Updated weights for policy 0, policy_version 51740 (0.0010) [2023-12-27 19:36:09,818][106226] Updated weights for policy 0, policy_version 51750 (0.0011) [2023-12-27 19:36:09,907][106225] Updated weights for policy 1, policy_version 51865 (0.0010) [2023-12-27 19:36:09,973][106225] Updated weights for policy 1, policy_version 51875 (0.0008) [2023-12-27 19:36:10,031][106225] Updated weights for policy 1, policy_version 51885 (0.0010) [2023-12-27 19:36:10,547][106226] Updated weights for policy 0, policy_version 51760 (0.0007) [2023-12-27 19:36:10,602][106226] Updated weights for policy 0, policy_version 51770 (0.0008) [2023-12-27 19:36:10,663][106226] Updated weights for policy 0, policy_version 51780 (0.0011) [2023-12-27 19:36:10,763][106225] Updated weights for policy 1, policy_version 51895 (0.0010) [2023-12-27 19:36:10,816][106225] Updated weights for policy 1, policy_version 51905 (0.0010) [2023-12-27 19:36:10,877][106225] Updated weights for policy 1, policy_version 51915 (0.0010) [2023-12-27 19:36:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 26558464. Throughput: 0: 9825.8, 1: 9926.1. Samples: 26528236. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:36:11,175][105115] Avg episode reward: [(0, '-5.637'), (1, '-6.827')] [2023-12-27 19:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000051920_13295616.pth... [2023-12-27 19:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000051784_13262848.pth... [2023-12-27 19:36:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000050768_13000704.pth [2023-12-27 19:36:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000050632_12967936.pth [2023-12-27 19:36:11,462][106226] Updated weights for policy 0, policy_version 51790 (0.0009) [2023-12-27 19:36:11,519][106226] Updated weights for policy 0, policy_version 51800 (0.0008) [2023-12-27 19:36:11,588][106226] Updated weights for policy 0, policy_version 51810 (0.0008) [2023-12-27 19:36:11,728][106225] Updated weights for policy 1, policy_version 51925 (0.0011) [2023-12-27 19:36:11,791][106225] Updated weights for policy 1, policy_version 51935 (0.0010) [2023-12-27 19:36:11,851][106225] Updated weights for policy 1, policy_version 51945 (0.0010) [2023-12-27 19:36:12,347][106226] Updated weights for policy 0, policy_version 51820 (0.0008) [2023-12-27 19:36:12,413][106226] Updated weights for policy 0, policy_version 51830 (0.0008) [2023-12-27 19:36:12,467][106226] Updated weights for policy 0, policy_version 51840 (0.0008) [2023-12-27 19:36:12,598][106225] Updated weights for policy 1, policy_version 51955 (0.0010) [2023-12-27 19:36:12,655][106225] Updated weights for policy 1, policy_version 51965 (0.0008) [2023-12-27 19:36:12,720][106225] Updated weights for policy 1, policy_version 51975 (0.0008) [2023-12-27 19:36:13,183][106226] Updated weights for policy 0, policy_version 51850 (0.0008) [2023-12-27 19:36:13,233][106226] Updated weights for policy 0, policy_version 51860 (0.0009) [2023-12-27 19:36:13,287][106226] Updated weights for policy 0, policy_version 51870 (0.0009) [2023-12-27 19:36:13,321][106225] Updated weights for policy 1, policy_version 51985 (0.0006) [2023-12-27 19:36:13,378][106225] Updated weights for policy 1, policy_version 51995 (0.0005) [2023-12-27 19:36:13,433][106225] Updated weights for policy 1, policy_version 52005 (0.0006) [2023-12-27 19:36:13,488][106225] Updated weights for policy 1, policy_version 52015 (0.0005) [2023-12-27 19:36:14,073][106226] Updated weights for policy 0, policy_version 51881 (0.0010) [2023-12-27 19:36:14,103][106225] Updated weights for policy 1, policy_version 52025 (0.0007) [2023-12-27 19:36:14,137][106226] Updated weights for policy 0, policy_version 51891 (0.0009) [2023-12-27 19:36:14,158][106225] Updated weights for policy 1, policy_version 52035 (0.0006) [2023-12-27 19:36:14,191][106226] Updated weights for policy 0, policy_version 51901 (0.0009) [2023-12-27 19:36:14,218][106225] Updated weights for policy 1, policy_version 52045 (0.0006) [2023-12-27 19:36:14,253][106226] Updated weights for policy 0, policy_version 51911 (0.0009) [2023-12-27 19:36:14,913][106225] Updated weights for policy 1, policy_version 52055 (0.0009) [2023-12-27 19:36:14,936][106226] Updated weights for policy 0, policy_version 51921 (0.0008) [2023-12-27 19:36:14,971][106225] Updated weights for policy 1, policy_version 52065 (0.0010) [2023-12-27 19:36:14,989][106226] Updated weights for policy 0, policy_version 51931 (0.0007) [2023-12-27 19:36:15,034][106225] Updated weights for policy 1, policy_version 52075 (0.0010) [2023-12-27 19:36:15,044][106226] Updated weights for policy 0, policy_version 51941 (0.0006) [2023-12-27 19:36:15,698][106225] Updated weights for policy 1, policy_version 52085 (0.0008) [2023-12-27 19:36:15,712][106226] Updated weights for policy 0, policy_version 51951 (0.0007) [2023-12-27 19:36:15,749][106225] Updated weights for policy 1, policy_version 52095 (0.0005) [2023-12-27 19:36:15,762][106226] Updated weights for policy 0, policy_version 51961 (0.0009) [2023-12-27 19:36:15,804][106225] Updated weights for policy 1, policy_version 52105 (0.0005) [2023-12-27 19:36:15,808][106226] Updated weights for policy 0, policy_version 51971 (0.0008) [2023-12-27 19:36:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 26656768. Throughput: 0: 9710.1, 1: 9888.2. Samples: 26643780. Policy #0 lag: (min: 3.0, avg: 13.6, max: 35.0) [2023-12-27 19:36:16,175][105115] Avg episode reward: [(0, '-5.842'), (1, '-6.292')] [2023-12-27 19:36:16,424][106225] Updated weights for policy 1, policy_version 52115 (0.0006) [2023-12-27 19:36:16,476][106225] Updated weights for policy 1, policy_version 52125 (0.0009) [2023-12-27 19:36:16,525][106225] Updated weights for policy 1, policy_version 52135 (0.0008) [2023-12-27 19:36:16,591][106226] Updated weights for policy 0, policy_version 51981 (0.0008) [2023-12-27 19:36:16,643][106226] Updated weights for policy 0, policy_version 51991 (0.0008) [2023-12-27 19:36:16,691][106226] Updated weights for policy 0, policy_version 52001 (0.0008) [2023-12-27 19:36:17,291][106226] Updated weights for policy 0, policy_version 52011 (0.0008) [2023-12-27 19:36:17,297][106225] Updated weights for policy 1, policy_version 52145 (0.0008) [2023-12-27 19:36:17,354][106225] Updated weights for policy 1, policy_version 52155 (0.0009) [2023-12-27 19:36:17,354][106226] Updated weights for policy 0, policy_version 52021 (0.0006) [2023-12-27 19:36:17,416][106225] Updated weights for policy 1, policy_version 52165 (0.0009) [2023-12-27 19:36:17,419][106226] Updated weights for policy 0, policy_version 52031 (0.0011) [2023-12-27 19:36:17,477][106225] Updated weights for policy 1, policy_version 52175 (0.0008) [2023-12-27 19:36:18,075][106226] Updated weights for policy 0, policy_version 52041 (0.0011) [2023-12-27 19:36:18,101][106225] Updated weights for policy 1, policy_version 52185 (0.0006) [2023-12-27 19:36:18,132][106226] Updated weights for policy 0, policy_version 52051 (0.0006) [2023-12-27 19:36:18,155][106225] Updated weights for policy 1, policy_version 52195 (0.0009) [2023-12-27 19:36:18,191][106226] Updated weights for policy 0, policy_version 52061 (0.0005) [2023-12-27 19:36:18,203][106225] Updated weights for policy 1, policy_version 52205 (0.0008) [2023-12-27 19:36:18,259][106226] Updated weights for policy 0, policy_version 52071 (0.0007) [2023-12-27 19:36:18,918][106226] Updated weights for policy 0, policy_version 52081 (0.0008) [2023-12-27 19:36:18,974][106226] Updated weights for policy 0, policy_version 52091 (0.0007) [2023-12-27 19:36:18,997][106225] Updated weights for policy 1, policy_version 52215 (0.0008) [2023-12-27 19:36:19,046][106226] Updated weights for policy 0, policy_version 52101 (0.0006) [2023-12-27 19:36:19,054][106225] Updated weights for policy 1, policy_version 52225 (0.0009) [2023-12-27 19:36:19,110][106225] Updated weights for policy 1, policy_version 52235 (0.0008) [2023-12-27 19:36:19,712][106226] Updated weights for policy 0, policy_version 52111 (0.0008) [2023-12-27 19:36:19,763][106226] Updated weights for policy 0, policy_version 52121 (0.0006) [2023-12-27 19:36:19,817][106226] Updated weights for policy 0, policy_version 52131 (0.0006) [2023-12-27 19:36:19,885][106225] Updated weights for policy 1, policy_version 52245 (0.0010) [2023-12-27 19:36:19,951][106225] Updated weights for policy 1, policy_version 52255 (0.0008) [2023-12-27 19:36:20,017][106225] Updated weights for policy 1, policy_version 52265 (0.0008) [2023-12-27 19:36:20,516][106226] Updated weights for policy 0, policy_version 52141 (0.0008) [2023-12-27 19:36:20,576][106226] Updated weights for policy 0, policy_version 52151 (0.0009) [2023-12-27 19:36:20,636][106226] Updated weights for policy 0, policy_version 52161 (0.0009) [2023-12-27 19:36:20,692][106225] Updated weights for policy 1, policy_version 52275 (0.0006) [2023-12-27 19:36:20,751][106225] Updated weights for policy 1, policy_version 52285 (0.0009) [2023-12-27 19:36:20,811][106225] Updated weights for policy 1, policy_version 52295 (0.0009) [2023-12-27 19:36:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 26755072. Throughput: 0: 9806.4, 1: 9810.0. Samples: 26762940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:21,175][105115] Avg episode reward: [(0, '-5.904'), (1, '-6.944')] [2023-12-27 19:36:21,481][106226] Updated weights for policy 0, policy_version 52171 (0.0008) [2023-12-27 19:36:21,543][106226] Updated weights for policy 0, policy_version 52181 (0.0008) [2023-12-27 19:36:21,609][106226] Updated weights for policy 0, policy_version 52191 (0.0008) [2023-12-27 19:36:21,611][106225] Updated weights for policy 1, policy_version 52305 (0.0008) [2023-12-27 19:36:21,676][106225] Updated weights for policy 1, policy_version 52315 (0.0010) [2023-12-27 19:36:21,751][106225] Updated weights for policy 1, policy_version 52325 (0.0010) [2023-12-27 19:36:21,814][106225] Updated weights for policy 1, policy_version 52335 (0.0008) [2023-12-27 19:36:22,361][106226] Updated weights for policy 0, policy_version 52201 (0.0006) [2023-12-27 19:36:22,445][106226] Updated weights for policy 0, policy_version 52211 (0.0008) [2023-12-27 19:36:22,514][106226] Updated weights for policy 0, policy_version 52221 (0.0006) [2023-12-27 19:36:22,571][106226] Updated weights for policy 0, policy_version 52231 (0.0007) [2023-12-27 19:36:22,605][106225] Updated weights for policy 1, policy_version 52345 (0.0007) [2023-12-27 19:36:22,662][106225] Updated weights for policy 1, policy_version 52355 (0.0007) [2023-12-27 19:36:22,718][106225] Updated weights for policy 1, policy_version 52365 (0.0008) [2023-12-27 19:36:23,235][106226] Updated weights for policy 0, policy_version 52241 (0.0010) [2023-12-27 19:36:23,282][106226] Updated weights for policy 0, policy_version 52251 (0.0010) [2023-12-27 19:36:23,325][106226] Updated weights for policy 0, policy_version 52261 (0.0010) [2023-12-27 19:36:23,397][106225] Updated weights for policy 1, policy_version 52375 (0.0008) [2023-12-27 19:36:23,445][106225] Updated weights for policy 1, policy_version 52385 (0.0007) [2023-12-27 19:36:23,490][106225] Updated weights for policy 1, policy_version 52395 (0.0007) [2023-12-27 19:36:24,052][106226] Updated weights for policy 0, policy_version 52271 (0.0007) [2023-12-27 19:36:24,101][106226] Updated weights for policy 0, policy_version 52281 (0.0005) [2023-12-27 19:36:24,162][106226] Updated weights for policy 0, policy_version 52291 (0.0005) [2023-12-27 19:36:24,232][106225] Updated weights for policy 1, policy_version 52405 (0.0005) [2023-12-27 19:36:24,290][106225] Updated weights for policy 1, policy_version 52415 (0.0005) [2023-12-27 19:36:24,351][106225] Updated weights for policy 1, policy_version 52425 (0.0005) [2023-12-27 19:36:24,791][106226] Updated weights for policy 0, policy_version 52301 (0.0005) [2023-12-27 19:36:24,847][106226] Updated weights for policy 0, policy_version 52311 (0.0010) [2023-12-27 19:36:24,904][106226] Updated weights for policy 0, policy_version 52321 (0.0010) [2023-12-27 19:36:24,984][106225] Updated weights for policy 1, policy_version 52435 (0.0007) [2023-12-27 19:36:25,047][106225] Updated weights for policy 1, policy_version 52445 (0.0010) [2023-12-27 19:36:25,100][106225] Updated weights for policy 1, policy_version 52455 (0.0010) [2023-12-27 19:36:25,528][106226] Updated weights for policy 0, policy_version 52331 (0.0009) [2023-12-27 19:36:25,585][106226] Updated weights for policy 0, policy_version 52341 (0.0009) [2023-12-27 19:36:25,652][106226] Updated weights for policy 0, policy_version 52351 (0.0009) [2023-12-27 19:36:25,719][106225] Updated weights for policy 1, policy_version 52465 (0.0010) [2023-12-27 19:36:25,786][106225] Updated weights for policy 1, policy_version 52475 (0.0005) [2023-12-27 19:36:25,841][106225] Updated weights for policy 1, policy_version 52485 (0.0005) [2023-12-27 19:36:25,909][106225] Updated weights for policy 1, policy_version 52495 (0.0005) [2023-12-27 19:36:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 26853376. Throughput: 0: 9813.0, 1: 9774.0. Samples: 26819256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:26,176][105115] Avg episode reward: [(0, '-5.867'), (1, '-6.609')] [2023-12-27 19:36:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000052496_13443072.pth... [2023-12-27 19:36:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000052360_13410304.pth... [2023-12-27 19:36:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000051344_13148160.pth [2023-12-27 19:36:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000051240_13123584.pth [2023-12-27 19:36:26,402][106225] Updated weights for policy 1, policy_version 52505 (0.0007) [2023-12-27 19:36:26,440][106226] Updated weights for policy 0, policy_version 52361 (0.0009) [2023-12-27 19:36:26,450][106225] Updated weights for policy 1, policy_version 52515 (0.0007) [2023-12-27 19:36:26,495][106226] Updated weights for policy 0, policy_version 52371 (0.0007) [2023-12-27 19:36:26,501][106225] Updated weights for policy 1, policy_version 52525 (0.0005) [2023-12-27 19:36:26,545][106226] Updated weights for policy 0, policy_version 52381 (0.0008) [2023-12-27 19:36:26,593][106226] Updated weights for policy 0, policy_version 52391 (0.0008) [2023-12-27 19:36:27,021][106225] Updated weights for policy 1, policy_version 52535 (0.0005) [2023-12-27 19:36:27,070][106225] Updated weights for policy 1, policy_version 52545 (0.0005) [2023-12-27 19:36:27,132][106225] Updated weights for policy 1, policy_version 52555 (0.0005) [2023-12-27 19:36:27,209][106226] Updated weights for policy 0, policy_version 52401 (0.0005) [2023-12-27 19:36:27,260][106226] Updated weights for policy 0, policy_version 52411 (0.0005) [2023-12-27 19:36:27,327][106226] Updated weights for policy 0, policy_version 52421 (0.0006) [2023-12-27 19:36:27,688][106225] Updated weights for policy 1, policy_version 52565 (0.0008) [2023-12-27 19:36:27,744][106225] Updated weights for policy 1, policy_version 52575 (0.0010) [2023-12-27 19:36:27,805][106225] Updated weights for policy 1, policy_version 52585 (0.0007) [2023-12-27 19:36:27,979][106226] Updated weights for policy 0, policy_version 52431 (0.0007) [2023-12-27 19:36:28,026][106226] Updated weights for policy 0, policy_version 52441 (0.0008) [2023-12-27 19:36:28,080][106226] Updated weights for policy 0, policy_version 52451 (0.0013) [2023-12-27 19:36:28,409][106225] Updated weights for policy 1, policy_version 52595 (0.0007) [2023-12-27 19:36:28,462][106225] Updated weights for policy 1, policy_version 52605 (0.0010) [2023-12-27 19:36:28,520][106225] Updated weights for policy 1, policy_version 52615 (0.0010) [2023-12-27 19:36:28,868][106226] Updated weights for policy 0, policy_version 52461 (0.0010) [2023-12-27 19:36:28,926][106226] Updated weights for policy 0, policy_version 52471 (0.0008) [2023-12-27 19:36:28,983][106226] Updated weights for policy 0, policy_version 52481 (0.0007) [2023-12-27 19:36:29,216][106225] Updated weights for policy 1, policy_version 52625 (0.0010) [2023-12-27 19:36:29,282][106225] Updated weights for policy 1, policy_version 52635 (0.0011) [2023-12-27 19:36:29,351][106225] Updated weights for policy 1, policy_version 52645 (0.0007) [2023-12-27 19:36:29,417][106225] Updated weights for policy 1, policy_version 52655 (0.0007) [2023-12-27 19:36:29,811][106226] Updated weights for policy 0, policy_version 52491 (0.0008) [2023-12-27 19:36:29,879][106226] Updated weights for policy 0, policy_version 52501 (0.0009) [2023-12-27 19:36:29,953][106226] Updated weights for policy 0, policy_version 52511 (0.0009) [2023-12-27 19:36:29,992][106225] Updated weights for policy 1, policy_version 52665 (0.0006) [2023-12-27 19:36:30,046][106225] Updated weights for policy 1, policy_version 52675 (0.0009) [2023-12-27 19:36:30,107][106225] Updated weights for policy 1, policy_version 52685 (0.0009) [2023-12-27 19:36:30,696][106226] Updated weights for policy 0, policy_version 52521 (0.0008) [2023-12-27 19:36:30,761][106226] Updated weights for policy 0, policy_version 52531 (0.0005) [2023-12-27 19:36:30,802][106225] Updated weights for policy 1, policy_version 52695 (0.0008) [2023-12-27 19:36:30,816][106226] Updated weights for policy 0, policy_version 52541 (0.0005) [2023-12-27 19:36:30,855][106225] Updated weights for policy 1, policy_version 52705 (0.0008) [2023-12-27 19:36:30,878][106226] Updated weights for policy 0, policy_version 52551 (0.0006) [2023-12-27 19:36:30,917][106225] Updated weights for policy 1, policy_version 52715 (0.0009) [2023-12-27 19:36:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 26959872. Throughput: 0: 9783.0, 1: 9984.8. Samples: 26945320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:31,175][105115] Avg episode reward: [(0, '-6.107'), (1, '-6.400')] [2023-12-27 19:36:31,448][106226] Updated weights for policy 0, policy_version 52561 (0.0006) [2023-12-27 19:36:31,518][106226] Updated weights for policy 0, policy_version 52571 (0.0005) [2023-12-27 19:36:31,580][106226] Updated weights for policy 0, policy_version 52581 (0.0007) [2023-12-27 19:36:31,774][106225] Updated weights for policy 1, policy_version 52725 (0.0008) [2023-12-27 19:36:31,833][106225] Updated weights for policy 1, policy_version 52735 (0.0009) [2023-12-27 19:36:31,882][106225] Updated weights for policy 1, policy_version 52745 (0.0008) [2023-12-27 19:36:32,275][106226] Updated weights for policy 0, policy_version 52591 (0.0010) [2023-12-27 19:36:32,344][106226] Updated weights for policy 0, policy_version 52601 (0.0010) [2023-12-27 19:36:32,407][106226] Updated weights for policy 0, policy_version 52611 (0.0008) [2023-12-27 19:36:32,585][106225] Updated weights for policy 1, policy_version 52755 (0.0009) [2023-12-27 19:36:32,639][106225] Updated weights for policy 1, policy_version 52765 (0.0010) [2023-12-27 19:36:32,699][106225] Updated weights for policy 1, policy_version 52775 (0.0008) [2023-12-27 19:36:33,083][106226] Updated weights for policy 0, policy_version 52621 (0.0009) [2023-12-27 19:36:33,133][106226] Updated weights for policy 0, policy_version 52631 (0.0005) [2023-12-27 19:36:33,189][106226] Updated weights for policy 0, policy_version 52641 (0.0005) [2023-12-27 19:36:33,301][106225] Updated weights for policy 1, policy_version 52785 (0.0007) [2023-12-27 19:36:33,372][106225] Updated weights for policy 1, policy_version 52795 (0.0007) [2023-12-27 19:36:33,422][106225] Updated weights for policy 1, policy_version 52805 (0.0008) [2023-12-27 19:36:33,479][106225] Updated weights for policy 1, policy_version 52815 (0.0008) [2023-12-27 19:36:33,833][106226] Updated weights for policy 0, policy_version 52651 (0.0008) [2023-12-27 19:36:33,889][106226] Updated weights for policy 0, policy_version 52661 (0.0008) [2023-12-27 19:36:33,945][106226] Updated weights for policy 0, policy_version 52671 (0.0009) [2023-12-27 19:36:34,236][106225] Updated weights for policy 1, policy_version 52825 (0.0007) [2023-12-27 19:36:34,290][106225] Updated weights for policy 1, policy_version 52835 (0.0006) [2023-12-27 19:36:34,359][106225] Updated weights for policy 1, policy_version 52845 (0.0007) [2023-12-27 19:36:34,745][106226] Updated weights for policy 0, policy_version 52681 (0.0009) [2023-12-27 19:36:34,799][106226] Updated weights for policy 0, policy_version 52691 (0.0010) [2023-12-27 19:36:34,854][106226] Updated weights for policy 0, policy_version 52701 (0.0009) [2023-12-27 19:36:34,913][106226] Updated weights for policy 0, policy_version 52711 (0.0005) [2023-12-27 19:36:34,966][106225] Updated weights for policy 1, policy_version 52855 (0.0006) [2023-12-27 19:36:35,018][106225] Updated weights for policy 1, policy_version 52865 (0.0005) [2023-12-27 19:36:35,080][106225] Updated weights for policy 1, policy_version 52875 (0.0008) [2023-12-27 19:36:35,586][106226] Updated weights for policy 0, policy_version 52721 (0.0005) [2023-12-27 19:36:35,640][106226] Updated weights for policy 0, policy_version 52731 (0.0005) [2023-12-27 19:36:35,700][106226] Updated weights for policy 0, policy_version 52741 (0.0008) [2023-12-27 19:36:35,749][106225] Updated weights for policy 1, policy_version 52885 (0.0007) [2023-12-27 19:36:35,793][106225] Updated weights for policy 1, policy_version 52895 (0.0008) [2023-12-27 19:36:35,850][106225] Updated weights for policy 1, policy_version 52905 (0.0009) [2023-12-27 19:36:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 27058176. Throughput: 0: 9776.3, 1: 10082.0. Samples: 27066760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:36,175][105115] Avg episode reward: [(0, '-6.712'), (1, '-6.222')] [2023-12-27 19:36:36,390][106226] Updated weights for policy 0, policy_version 52751 (0.0008) [2023-12-27 19:36:36,461][106226] Updated weights for policy 0, policy_version 52761 (0.0008) [2023-12-27 19:36:36,520][106226] Updated weights for policy 0, policy_version 52771 (0.0008) [2023-12-27 19:36:36,538][106225] Updated weights for policy 1, policy_version 52915 (0.0008) [2023-12-27 19:36:36,599][106225] Updated weights for policy 1, policy_version 52925 (0.0007) [2023-12-27 19:36:36,661][106225] Updated weights for policy 1, policy_version 52935 (0.0006) [2023-12-27 19:36:37,264][106225] Updated weights for policy 1, policy_version 52945 (0.0006) [2023-12-27 19:36:37,286][106226] Updated weights for policy 0, policy_version 52781 (0.0006) [2023-12-27 19:36:37,330][106225] Updated weights for policy 1, policy_version 52955 (0.0006) [2023-12-27 19:36:37,346][106226] Updated weights for policy 0, policy_version 52791 (0.0008) [2023-12-27 19:36:37,394][106225] Updated weights for policy 1, policy_version 52965 (0.0006) [2023-12-27 19:36:37,403][106226] Updated weights for policy 0, policy_version 52801 (0.0008) [2023-12-27 19:36:37,450][106225] Updated weights for policy 1, policy_version 52975 (0.0006) [2023-12-27 19:36:37,996][106226] Updated weights for policy 0, policy_version 52811 (0.0007) [2023-12-27 19:36:38,053][106226] Updated weights for policy 0, policy_version 52821 (0.0005) [2023-12-27 19:36:38,100][106226] Updated weights for policy 0, policy_version 52831 (0.0008) [2023-12-27 19:36:38,177][106225] Updated weights for policy 1, policy_version 52985 (0.0007) [2023-12-27 19:36:38,238][106225] Updated weights for policy 1, policy_version 52995 (0.0010) [2023-12-27 19:36:38,295][106225] Updated weights for policy 1, policy_version 53005 (0.0008) [2023-12-27 19:36:38,797][106226] Updated weights for policy 0, policy_version 52841 (0.0007) [2023-12-27 19:36:38,844][106226] Updated weights for policy 0, policy_version 52851 (0.0008) [2023-12-27 19:36:38,906][106226] Updated weights for policy 0, policy_version 52861 (0.0007) [2023-12-27 19:36:38,966][106226] Updated weights for policy 0, policy_version 52871 (0.0009) [2023-12-27 19:36:39,043][106225] Updated weights for policy 1, policy_version 53015 (0.0009) [2023-12-27 19:36:39,094][106225] Updated weights for policy 1, policy_version 53025 (0.0008) [2023-12-27 19:36:39,140][106225] Updated weights for policy 1, policy_version 53035 (0.0008) [2023-12-27 19:36:39,832][106226] Updated weights for policy 0, policy_version 52881 (0.0008) [2023-12-27 19:36:39,897][106226] Updated weights for policy 0, policy_version 52891 (0.0008) [2023-12-27 19:36:39,970][106226] Updated weights for policy 0, policy_version 52901 (0.0008) [2023-12-27 19:36:40,024][106225] Updated weights for policy 1, policy_version 53045 (0.0009) [2023-12-27 19:36:40,090][106225] Updated weights for policy 1, policy_version 53055 (0.0008) [2023-12-27 19:36:40,157][106225] Updated weights for policy 1, policy_version 53065 (0.0008) [2023-12-27 19:36:40,689][106226] Updated weights for policy 0, policy_version 52911 (0.0008) [2023-12-27 19:36:40,752][106226] Updated weights for policy 0, policy_version 52921 (0.0007) [2023-12-27 19:36:40,816][106226] Updated weights for policy 0, policy_version 52931 (0.0009) [2023-12-27 19:36:40,892][106225] Updated weights for policy 1, policy_version 53075 (0.0008) [2023-12-27 19:36:40,956][106225] Updated weights for policy 1, policy_version 53085 (0.0008) [2023-12-27 19:36:41,019][106225] Updated weights for policy 1, policy_version 53095 (0.0008) [2023-12-27 19:36:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 27156480. Throughput: 0: 9789.8, 1: 10058.8. Samples: 27125780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:41,175][105115] Avg episode reward: [(0, '-6.262'), (1, '-6.329')] [2023-12-27 19:36:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000052936_13557760.pth... [2023-12-27 19:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000053104_13598720.pth... [2023-12-27 19:36:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000051784_13262848.pth [2023-12-27 19:36:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000051920_13295616.pth [2023-12-27 19:36:41,525][106226] Updated weights for policy 0, policy_version 52941 (0.0007) [2023-12-27 19:36:41,590][106226] Updated weights for policy 0, policy_version 52951 (0.0006) [2023-12-27 19:36:41,666][106226] Updated weights for policy 0, policy_version 52961 (0.0008) [2023-12-27 19:36:41,882][106225] Updated weights for policy 1, policy_version 53105 (0.0008) [2023-12-27 19:36:41,949][106225] Updated weights for policy 1, policy_version 53115 (0.0008) [2023-12-27 19:36:42,002][106225] Updated weights for policy 1, policy_version 53125 (0.0008) [2023-12-27 19:36:42,065][106225] Updated weights for policy 1, policy_version 53135 (0.0008) [2023-12-27 19:36:42,365][106226] Updated weights for policy 0, policy_version 52971 (0.0007) [2023-12-27 19:36:42,423][106226] Updated weights for policy 0, policy_version 52981 (0.0008) [2023-12-27 19:36:42,477][106226] Updated weights for policy 0, policy_version 52991 (0.0008) [2023-12-27 19:36:42,737][106225] Updated weights for policy 1, policy_version 53145 (0.0008) [2023-12-27 19:36:42,798][106225] Updated weights for policy 1, policy_version 53155 (0.0009) [2023-12-27 19:36:42,853][106225] Updated weights for policy 1, policy_version 53165 (0.0009) [2023-12-27 19:36:43,287][106226] Updated weights for policy 0, policy_version 53001 (0.0009) [2023-12-27 19:36:43,343][106226] Updated weights for policy 0, policy_version 53011 (0.0009) [2023-12-27 19:36:43,396][106226] Updated weights for policy 0, policy_version 53021 (0.0010) [2023-12-27 19:36:43,448][106226] Updated weights for policy 0, policy_version 53031 (0.0008) [2023-12-27 19:36:43,485][106225] Updated weights for policy 1, policy_version 53175 (0.0008) [2023-12-27 19:36:43,528][106225] Updated weights for policy 1, policy_version 53185 (0.0008) [2023-12-27 19:36:43,578][106225] Updated weights for policy 1, policy_version 53195 (0.0006) [2023-12-27 19:36:44,126][106226] Updated weights for policy 0, policy_version 53041 (0.0005) [2023-12-27 19:36:44,188][106226] Updated weights for policy 0, policy_version 53051 (0.0005) [2023-12-27 19:36:44,251][106226] Updated weights for policy 0, policy_version 53061 (0.0009) [2023-12-27 19:36:44,310][106225] Updated weights for policy 1, policy_version 53205 (0.0009) [2023-12-27 19:36:44,363][106225] Updated weights for policy 1, policy_version 53215 (0.0010) [2023-12-27 19:36:44,408][106225] Updated weights for policy 1, policy_version 53225 (0.0010) [2023-12-27 19:36:44,861][106226] Updated weights for policy 0, policy_version 53071 (0.0009) [2023-12-27 19:36:44,924][106226] Updated weights for policy 0, policy_version 53081 (0.0008) [2023-12-27 19:36:44,987][106226] Updated weights for policy 0, policy_version 53091 (0.0007) [2023-12-27 19:36:45,062][106225] Updated weights for policy 1, policy_version 53235 (0.0008) [2023-12-27 19:36:45,129][106225] Updated weights for policy 1, policy_version 53245 (0.0008) [2023-12-27 19:36:45,194][106225] Updated weights for policy 1, policy_version 53255 (0.0009) [2023-12-27 19:36:45,627][106226] Updated weights for policy 0, policy_version 53101 (0.0008) [2023-12-27 19:36:45,675][106226] Updated weights for policy 0, policy_version 53111 (0.0008) [2023-12-27 19:36:45,743][106226] Updated weights for policy 0, policy_version 53121 (0.0008) [2023-12-27 19:36:45,997][106225] Updated weights for policy 1, policy_version 53265 (0.0008) [2023-12-27 19:36:46,043][106225] Updated weights for policy 1, policy_version 53275 (0.0007) [2023-12-27 19:36:46,092][106225] Updated weights for policy 1, policy_version 53285 (0.0008) [2023-12-27 19:36:46,153][106225] Updated weights for policy 1, policy_version 53295 (0.0007) [2023-12-27 19:36:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 27254784. Throughput: 0: 9811.4, 1: 9955.9. Samples: 27240528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:46,176][105115] Avg episode reward: [(0, '-6.237'), (1, '-6.231')] [2023-12-27 19:36:46,412][106226] Updated weights for policy 0, policy_version 53131 (0.0009) [2023-12-27 19:36:46,472][106226] Updated weights for policy 0, policy_version 53141 (0.0011) [2023-12-27 19:36:46,531][106226] Updated weights for policy 0, policy_version 53151 (0.0011) [2023-12-27 19:36:46,888][106225] Updated weights for policy 1, policy_version 53305 (0.0005) [2023-12-27 19:36:46,938][106225] Updated weights for policy 1, policy_version 53315 (0.0007) [2023-12-27 19:36:46,992][106225] Updated weights for policy 1, policy_version 53326 (0.0009) [2023-12-27 19:36:47,133][106226] Updated weights for policy 0, policy_version 53161 (0.0009) [2023-12-27 19:36:47,192][106226] Updated weights for policy 0, policy_version 53171 (0.0011) [2023-12-27 19:36:47,245][106226] Updated weights for policy 0, policy_version 53181 (0.0010) [2023-12-27 19:36:47,301][106226] Updated weights for policy 0, policy_version 53191 (0.0010) [2023-12-27 19:36:47,723][106225] Updated weights for policy 1, policy_version 53336 (0.0008) [2023-12-27 19:36:47,779][106225] Updated weights for policy 1, policy_version 53346 (0.0007) [2023-12-27 19:36:47,834][106225] Updated weights for policy 1, policy_version 53356 (0.0005) [2023-12-27 19:36:47,968][106226] Updated weights for policy 0, policy_version 53201 (0.0010) [2023-12-27 19:36:48,029][106226] Updated weights for policy 0, policy_version 53211 (0.0007) [2023-12-27 19:36:48,092][106226] Updated weights for policy 0, policy_version 53221 (0.0010) [2023-12-27 19:36:48,489][106225] Updated weights for policy 1, policy_version 53366 (0.0007) [2023-12-27 19:36:48,549][106225] Updated weights for policy 1, policy_version 53376 (0.0007) [2023-12-27 19:36:48,600][106225] Updated weights for policy 1, policy_version 53386 (0.0008) [2023-12-27 19:36:48,797][106226] Updated weights for policy 0, policy_version 53231 (0.0011) [2023-12-27 19:36:48,857][106226] Updated weights for policy 0, policy_version 53241 (0.0010) [2023-12-27 19:36:48,915][106226] Updated weights for policy 0, policy_version 53251 (0.0010) [2023-12-27 19:36:49,362][106225] Updated weights for policy 1, policy_version 53396 (0.0007) [2023-12-27 19:36:49,420][106225] Updated weights for policy 1, policy_version 53406 (0.0007) [2023-12-27 19:36:49,480][106225] Updated weights for policy 1, policy_version 53416 (0.0007) [2023-12-27 19:36:49,559][106226] Updated weights for policy 0, policy_version 53261 (0.0011) [2023-12-27 19:36:49,619][106226] Updated weights for policy 0, policy_version 53271 (0.0011) [2023-12-27 19:36:49,677][106226] Updated weights for policy 0, policy_version 53281 (0.0010) [2023-12-27 19:36:50,229][106225] Updated weights for policy 1, policy_version 53426 (0.0008) [2023-12-27 19:36:50,281][106225] Updated weights for policy 1, policy_version 53436 (0.0007) [2023-12-27 19:36:50,332][106225] Updated weights for policy 1, policy_version 53446 (0.0007) [2023-12-27 19:36:50,393][106225] Updated weights for policy 1, policy_version 53456 (0.0008) [2023-12-27 19:36:50,462][106226] Updated weights for policy 0, policy_version 53291 (0.0011) [2023-12-27 19:36:50,522][106226] Updated weights for policy 0, policy_version 53301 (0.0011) [2023-12-27 19:36:50,583][106226] Updated weights for policy 0, policy_version 53311 (0.0010) [2023-12-27 19:36:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 27344896. Throughput: 0: 9857.9, 1: 9943.5. Samples: 27358768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:36:51,175][105115] Avg episode reward: [(0, '-6.151'), (1, '-5.802')] [2023-12-27 19:36:51,187][106225] Updated weights for policy 1, policy_version 53466 (0.0009) [2023-12-27 19:36:51,250][106225] Updated weights for policy 1, policy_version 53476 (0.0008) [2023-12-27 19:36:51,286][106226] Updated weights for policy 0, policy_version 53321 (0.0008) [2023-12-27 19:36:51,306][106225] Updated weights for policy 1, policy_version 53486 (0.0007) [2023-12-27 19:36:51,317][106141] Saving new best policy, reward=-5.802! [2023-12-27 19:36:51,352][106226] Updated weights for policy 0, policy_version 53331 (0.0008) [2023-12-27 19:36:51,412][106226] Updated weights for policy 0, policy_version 53341 (0.0008) [2023-12-27 19:36:51,470][106226] Updated weights for policy 0, policy_version 53351 (0.0008) [2023-12-27 19:36:52,067][106225] Updated weights for policy 1, policy_version 53496 (0.0007) [2023-12-27 19:36:52,123][106225] Updated weights for policy 1, policy_version 53506 (0.0007) [2023-12-27 19:36:52,181][106225] Updated weights for policy 1, policy_version 53516 (0.0005) [2023-12-27 19:36:52,221][106226] Updated weights for policy 0, policy_version 53361 (0.0010) [2023-12-27 19:36:52,282][106226] Updated weights for policy 0, policy_version 53371 (0.0011) [2023-12-27 19:36:52,343][106226] Updated weights for policy 0, policy_version 53381 (0.0011) [2023-12-27 19:36:52,901][106225] Updated weights for policy 1, policy_version 53526 (0.0008) [2023-12-27 19:36:52,965][106225] Updated weights for policy 1, policy_version 53536 (0.0006) [2023-12-27 19:36:53,033][106225] Updated weights for policy 1, policy_version 53546 (0.0005) [2023-12-27 19:36:53,061][106226] Updated weights for policy 0, policy_version 53391 (0.0008) [2023-12-27 19:36:53,120][106226] Updated weights for policy 0, policy_version 53401 (0.0007) [2023-12-27 19:36:53,190][106226] Updated weights for policy 0, policy_version 53411 (0.0008) [2023-12-27 19:36:53,583][106225] Updated weights for policy 1, policy_version 53556 (0.0006) [2023-12-27 19:36:53,636][106225] Updated weights for policy 1, policy_version 53566 (0.0005) [2023-12-27 19:36:53,685][106225] Updated weights for policy 1, policy_version 53576 (0.0005) [2023-12-27 19:36:53,940][106226] Updated weights for policy 0, policy_version 53421 (0.0008) [2023-12-27 19:36:53,989][106226] Updated weights for policy 0, policy_version 53431 (0.0005) [2023-12-27 19:36:54,041][106226] Updated weights for policy 0, policy_version 53441 (0.0005) [2023-12-27 19:36:54,235][106225] Updated weights for policy 1, policy_version 53586 (0.0006) [2023-12-27 19:36:54,292][106225] Updated weights for policy 1, policy_version 53596 (0.0009) [2023-12-27 19:36:54,347][106225] Updated weights for policy 1, policy_version 53606 (0.0006) [2023-12-27 19:36:54,408][106225] Updated weights for policy 1, policy_version 53616 (0.0005) [2023-12-27 19:36:54,678][106226] Updated weights for policy 0, policy_version 53451 (0.0007) [2023-12-27 19:36:54,736][106226] Updated weights for policy 0, policy_version 53461 (0.0008) [2023-12-27 19:36:54,796][106226] Updated weights for policy 0, policy_version 53471 (0.0009) [2023-12-27 19:36:54,995][106225] Updated weights for policy 1, policy_version 53626 (0.0005) [2023-12-27 19:36:55,052][106225] Updated weights for policy 1, policy_version 53636 (0.0005) [2023-12-27 19:36:55,101][106225] Updated weights for policy 1, policy_version 53646 (0.0006) [2023-12-27 19:36:55,522][106226] Updated weights for policy 0, policy_version 53481 (0.0009) [2023-12-27 19:36:55,584][106226] Updated weights for policy 0, policy_version 53491 (0.0008) [2023-12-27 19:36:55,642][106226] Updated weights for policy 0, policy_version 53501 (0.0008) [2023-12-27 19:36:55,700][106226] Updated weights for policy 0, policy_version 53511 (0.0008) [2023-12-27 19:36:55,739][106225] Updated weights for policy 1, policy_version 53656 (0.0008) [2023-12-27 19:36:55,797][106225] Updated weights for policy 1, policy_version 53666 (0.0009) [2023-12-27 19:36:55,858][106225] Updated weights for policy 1, policy_version 53676 (0.0009) [2023-12-27 19:36:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 27451392. Throughput: 0: 9810.7, 1: 9945.1. Samples: 27417252. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:36:56,176][105115] Avg episode reward: [(0, '-6.524'), (1, '-6.459')] [2023-12-27 19:36:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000053680_13746176.pth... [2023-12-27 19:36:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000053512_13705216.pth... [2023-12-27 19:36:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000052496_13443072.pth [2023-12-27 19:36:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000052360_13410304.pth [2023-12-27 19:36:56,388][106226] Updated weights for policy 0, policy_version 53521 (0.0008) [2023-12-27 19:36:56,446][106226] Updated weights for policy 0, policy_version 53531 (0.0008) [2023-12-27 19:36:56,505][106226] Updated weights for policy 0, policy_version 53541 (0.0009) [2023-12-27 19:36:56,565][106225] Updated weights for policy 1, policy_version 53686 (0.0008) [2023-12-27 19:36:56,614][106225] Updated weights for policy 1, policy_version 53696 (0.0008) [2023-12-27 19:36:56,668][106225] Updated weights for policy 1, policy_version 53706 (0.0008) [2023-12-27 19:36:57,198][106226] Updated weights for policy 0, policy_version 53551 (0.0008) [2023-12-27 19:36:57,258][106226] Updated weights for policy 0, policy_version 53561 (0.0010) [2023-12-27 19:36:57,278][106225] Updated weights for policy 1, policy_version 53716 (0.0007) [2023-12-27 19:36:57,311][106226] Updated weights for policy 0, policy_version 53571 (0.0010) [2023-12-27 19:36:57,334][106225] Updated weights for policy 1, policy_version 53726 (0.0007) [2023-12-27 19:36:57,390][106225] Updated weights for policy 1, policy_version 53736 (0.0005) [2023-12-27 19:36:57,963][106226] Updated weights for policy 0, policy_version 53581 (0.0010) [2023-12-27 19:36:58,015][106226] Updated weights for policy 0, policy_version 53591 (0.0010) [2023-12-27 19:36:58,018][106225] Updated weights for policy 1, policy_version 53746 (0.0006) [2023-12-27 19:36:58,064][106226] Updated weights for policy 0, policy_version 53601 (0.0010) [2023-12-27 19:36:58,075][106225] Updated weights for policy 1, policy_version 53756 (0.0007) [2023-12-27 19:36:58,132][106225] Updated weights for policy 1, policy_version 53766 (0.0005) [2023-12-27 19:36:58,191][106225] Updated weights for policy 1, policy_version 53776 (0.0010) [2023-12-27 19:36:58,855][106226] Updated weights for policy 0, policy_version 53611 (0.0010) [2023-12-27 19:36:58,910][106225] Updated weights for policy 1, policy_version 53786 (0.0007) [2023-12-27 19:36:58,920][106226] Updated weights for policy 0, policy_version 53621 (0.0008) [2023-12-27 19:36:58,976][106225] Updated weights for policy 1, policy_version 53796 (0.0007) [2023-12-27 19:36:58,996][106226] Updated weights for policy 0, policy_version 53631 (0.0009) [2023-12-27 19:36:59,035][106225] Updated weights for policy 1, policy_version 53806 (0.0006) [2023-12-27 19:36:59,717][106226] Updated weights for policy 0, policy_version 53641 (0.0009) [2023-12-27 19:36:59,722][106225] Updated weights for policy 1, policy_version 53816 (0.0006) [2023-12-27 19:36:59,779][106226] Updated weights for policy 0, policy_version 53651 (0.0007) [2023-12-27 19:36:59,784][106225] Updated weights for policy 1, policy_version 53826 (0.0006) [2023-12-27 19:36:59,844][106226] Updated weights for policy 0, policy_version 53661 (0.0008) [2023-12-27 19:36:59,851][106225] Updated weights for policy 1, policy_version 53836 (0.0008) [2023-12-27 19:36:59,907][106226] Updated weights for policy 0, policy_version 53671 (0.0011) [2023-12-27 19:37:00,420][106225] Updated weights for policy 1, policy_version 53846 (0.0006) [2023-12-27 19:37:00,475][106225] Updated weights for policy 1, policy_version 53856 (0.0005) [2023-12-27 19:37:00,536][106225] Updated weights for policy 1, policy_version 53866 (0.0005) [2023-12-27 19:37:00,568][106226] Updated weights for policy 0, policy_version 53681 (0.0006) [2023-12-27 19:37:00,621][106226] Updated weights for policy 0, policy_version 53691 (0.0005) [2023-12-27 19:37:00,672][106226] Updated weights for policy 0, policy_version 53701 (0.0005) [2023-12-27 19:37:01,155][106225] Updated weights for policy 1, policy_version 53876 (0.0007) [2023-12-27 19:37:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 27549696. Throughput: 0: 9864.9, 1: 10038.9. Samples: 27539452. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:01,175][105115] Avg episode reward: [(0, '-6.047'), (1, '-6.349')] [2023-12-27 19:37:01,214][106225] Updated weights for policy 1, policy_version 53886 (0.0007) [2023-12-27 19:37:01,282][106225] Updated weights for policy 1, policy_version 53896 (0.0008) [2023-12-27 19:37:01,335][106226] Updated weights for policy 0, policy_version 53711 (0.0006) [2023-12-27 19:37:01,404][106226] Updated weights for policy 0, policy_version 53721 (0.0008) [2023-12-27 19:37:01,459][106226] Updated weights for policy 0, policy_version 53731 (0.0008) [2023-12-27 19:37:01,934][106225] Updated weights for policy 1, policy_version 53906 (0.0006) [2023-12-27 19:37:01,995][106225] Updated weights for policy 1, policy_version 53916 (0.0005) [2023-12-27 19:37:02,041][106225] Updated weights for policy 1, policy_version 53926 (0.0009) [2023-12-27 19:37:02,091][106225] Updated weights for policy 1, policy_version 53936 (0.0010) [2023-12-27 19:37:02,124][106226] Updated weights for policy 0, policy_version 53741 (0.0007) [2023-12-27 19:37:02,180][106226] Updated weights for policy 0, policy_version 53751 (0.0005) [2023-12-27 19:37:02,238][106226] Updated weights for policy 0, policy_version 53761 (0.0006) [2023-12-27 19:37:02,826][106226] Updated weights for policy 0, policy_version 53771 (0.0007) [2023-12-27 19:37:02,874][106225] Updated weights for policy 1, policy_version 53946 (0.0007) [2023-12-27 19:37:02,877][106226] Updated weights for policy 0, policy_version 53781 (0.0005) [2023-12-27 19:37:02,925][106226] Updated weights for policy 0, policy_version 53791 (0.0006) [2023-12-27 19:37:02,926][106225] Updated weights for policy 1, policy_version 53956 (0.0008) [2023-12-27 19:37:02,973][106225] Updated weights for policy 1, policy_version 53966 (0.0006) [2023-12-27 19:37:03,643][106226] Updated weights for policy 0, policy_version 53801 (0.0008) [2023-12-27 19:37:03,688][106225] Updated weights for policy 1, policy_version 53976 (0.0006) [2023-12-27 19:37:03,698][106226] Updated weights for policy 0, policy_version 53811 (0.0008) [2023-12-27 19:37:03,746][106225] Updated weights for policy 1, policy_version 53986 (0.0007) [2023-12-27 19:37:03,751][106226] Updated weights for policy 0, policy_version 53821 (0.0007) [2023-12-27 19:37:03,809][106225] Updated weights for policy 1, policy_version 53996 (0.0008) [2023-12-27 19:37:03,810][106226] Updated weights for policy 0, policy_version 53831 (0.0008) [2023-12-27 19:37:04,432][106225] Updated weights for policy 1, policy_version 54006 (0.0009) [2023-12-27 19:37:04,490][106225] Updated weights for policy 1, policy_version 54016 (0.0009) [2023-12-27 19:37:04,541][106225] Updated weights for policy 1, policy_version 54026 (0.0010) [2023-12-27 19:37:04,621][106226] Updated weights for policy 0, policy_version 53841 (0.0009) [2023-12-27 19:37:04,670][106226] Updated weights for policy 0, policy_version 53851 (0.0009) [2023-12-27 19:37:04,728][106226] Updated weights for policy 0, policy_version 53861 (0.0008) [2023-12-27 19:37:05,217][106225] Updated weights for policy 1, policy_version 54036 (0.0008) [2023-12-27 19:37:05,283][106225] Updated weights for policy 1, policy_version 54046 (0.0005) [2023-12-27 19:37:05,353][106225] Updated weights for policy 1, policy_version 54056 (0.0005) [2023-12-27 19:37:05,499][106226] Updated weights for policy 0, policy_version 53871 (0.0008) [2023-12-27 19:37:05,550][106226] Updated weights for policy 0, policy_version 53881 (0.0008) [2023-12-27 19:37:05,603][106226] Updated weights for policy 0, policy_version 53891 (0.0008) [2023-12-27 19:37:05,951][106225] Updated weights for policy 1, policy_version 54066 (0.0009) [2023-12-27 19:37:05,998][106225] Updated weights for policy 1, policy_version 54076 (0.0008) [2023-12-27 19:37:06,054][106225] Updated weights for policy 1, policy_version 54086 (0.0008) [2023-12-27 19:37:06,111][106225] Updated weights for policy 1, policy_version 54096 (0.0009) [2023-12-27 19:37:06,174][105115] Fps is (10 sec: 20480.8, 60 sec: 19934.0, 300 sec: 19772.0). Total num frames: 27656192. Throughput: 0: 9844.8, 1: 10129.9. Samples: 27661800. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:06,175][105115] Avg episode reward: [(0, '-7.049'), (1, '-6.360')] [2023-12-27 19:37:06,380][106226] Updated weights for policy 0, policy_version 53901 (0.0006) [2023-12-27 19:37:06,448][106226] Updated weights for policy 0, policy_version 53911 (0.0006) [2023-12-27 19:37:06,508][106226] Updated weights for policy 0, policy_version 53921 (0.0009) [2023-12-27 19:37:06,778][106225] Updated weights for policy 1, policy_version 54106 (0.0005) [2023-12-27 19:37:06,822][106225] Updated weights for policy 1, policy_version 54116 (0.0006) [2023-12-27 19:37:06,879][106225] Updated weights for policy 1, policy_version 54126 (0.0008) [2023-12-27 19:37:07,223][106226] Updated weights for policy 0, policy_version 53931 (0.0009) [2023-12-27 19:37:07,287][106226] Updated weights for policy 0, policy_version 53941 (0.0005) [2023-12-27 19:37:07,346][106226] Updated weights for policy 0, policy_version 53951 (0.0005) [2023-12-27 19:37:07,487][106225] Updated weights for policy 1, policy_version 54136 (0.0006) [2023-12-27 19:37:07,547][106225] Updated weights for policy 1, policy_version 54146 (0.0007) [2023-12-27 19:37:07,614][106225] Updated weights for policy 1, policy_version 54156 (0.0007) [2023-12-27 19:37:07,940][106226] Updated weights for policy 0, policy_version 53961 (0.0007) [2023-12-27 19:37:07,997][106226] Updated weights for policy 0, policy_version 53971 (0.0006) [2023-12-27 19:37:08,057][106226] Updated weights for policy 0, policy_version 53981 (0.0006) [2023-12-27 19:37:08,120][106226] Updated weights for policy 0, policy_version 53991 (0.0006) [2023-12-27 19:37:08,178][106225] Updated weights for policy 1, policy_version 54166 (0.0007) [2023-12-27 19:37:08,230][106225] Updated weights for policy 1, policy_version 54176 (0.0008) [2023-12-27 19:37:08,282][106225] Updated weights for policy 1, policy_version 54186 (0.0008) [2023-12-27 19:37:08,811][106226] Updated weights for policy 0, policy_version 54001 (0.0007) [2023-12-27 19:37:08,873][106226] Updated weights for policy 0, policy_version 54011 (0.0008) [2023-12-27 19:37:08,939][106226] Updated weights for policy 0, policy_version 54021 (0.0008) [2023-12-27 19:37:09,010][106225] Updated weights for policy 1, policy_version 54196 (0.0009) [2023-12-27 19:37:09,067][106225] Updated weights for policy 1, policy_version 54206 (0.0010) [2023-12-27 19:37:09,131][106225] Updated weights for policy 1, policy_version 54216 (0.0011) [2023-12-27 19:37:09,704][106226] Updated weights for policy 0, policy_version 54031 (0.0008) [2023-12-27 19:37:09,764][106226] Updated weights for policy 0, policy_version 54041 (0.0008) [2023-12-27 19:37:09,823][106226] Updated weights for policy 0, policy_version 54051 (0.0008) [2023-12-27 19:37:09,987][106225] Updated weights for policy 1, policy_version 54226 (0.0010) [2023-12-27 19:37:10,044][106225] Updated weights for policy 1, policy_version 54236 (0.0008) [2023-12-27 19:37:10,106][106225] Updated weights for policy 1, policy_version 54246 (0.0007) [2023-12-27 19:37:10,167][106225] Updated weights for policy 1, policy_version 54256 (0.0009) [2023-12-27 19:37:10,557][106226] Updated weights for policy 0, policy_version 54061 (0.0009) [2023-12-27 19:37:10,619][106226] Updated weights for policy 0, policy_version 54071 (0.0007) [2023-12-27 19:37:10,677][106226] Updated weights for policy 0, policy_version 54081 (0.0008) [2023-12-27 19:37:10,826][106225] Updated weights for policy 1, policy_version 54266 (0.0008) [2023-12-27 19:37:10,881][106225] Updated weights for policy 1, policy_version 54276 (0.0008) [2023-12-27 19:37:10,937][106225] Updated weights for policy 1, policy_version 54286 (0.0007) [2023-12-27 19:37:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 27754496. Throughput: 0: 9879.9, 1: 10228.5. Samples: 27724128. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:11,175][105115] Avg episode reward: [(0, '-6.831'), (1, '-6.327')] [2023-12-27 19:37:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000054288_13901824.pth... [2023-12-27 19:37:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000054088_13852672.pth... [2023-12-27 19:37:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000053104_13598720.pth [2023-12-27 19:37:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000052936_13557760.pth [2023-12-27 19:37:11,510][106226] Updated weights for policy 0, policy_version 54091 (0.0008) [2023-12-27 19:37:11,566][106226] Updated weights for policy 0, policy_version 54101 (0.0008) [2023-12-27 19:37:11,636][106226] Updated weights for policy 0, policy_version 54111 (0.0008) [2023-12-27 19:37:11,653][106225] Updated weights for policy 1, policy_version 54296 (0.0007) [2023-12-27 19:37:11,728][106225] Updated weights for policy 1, policy_version 54306 (0.0009) [2023-12-27 19:37:11,799][106225] Updated weights for policy 1, policy_version 54316 (0.0008) [2023-12-27 19:37:12,398][106226] Updated weights for policy 0, policy_version 54121 (0.0008) [2023-12-27 19:37:12,460][106226] Updated weights for policy 0, policy_version 54131 (0.0008) [2023-12-27 19:37:12,526][106226] Updated weights for policy 0, policy_version 54141 (0.0008) [2023-12-27 19:37:12,540][106225] Updated weights for policy 1, policy_version 54326 (0.0008) [2023-12-27 19:37:12,589][106226] Updated weights for policy 0, policy_version 54151 (0.0008) [2023-12-27 19:37:12,603][106225] Updated weights for policy 1, policy_version 54336 (0.0006) [2023-12-27 19:37:12,668][106225] Updated weights for policy 1, policy_version 54346 (0.0008) [2023-12-27 19:37:13,267][106226] Updated weights for policy 0, policy_version 54161 (0.0005) [2023-12-27 19:37:13,327][106226] Updated weights for policy 0, policy_version 54171 (0.0007) [2023-12-27 19:37:13,378][106225] Updated weights for policy 1, policy_version 54356 (0.0009) [2023-12-27 19:37:13,384][106226] Updated weights for policy 0, policy_version 54181 (0.0008) [2023-12-27 19:37:13,439][106225] Updated weights for policy 1, policy_version 54366 (0.0008) [2023-12-27 19:37:13,504][106225] Updated weights for policy 1, policy_version 54376 (0.0009) [2023-12-27 19:37:14,076][106226] Updated weights for policy 0, policy_version 54191 (0.0008) [2023-12-27 19:37:14,124][106226] Updated weights for policy 0, policy_version 54201 (0.0008) [2023-12-27 19:37:14,187][106226] Updated weights for policy 0, policy_version 54211 (0.0008) [2023-12-27 19:37:14,228][106225] Updated weights for policy 1, policy_version 54386 (0.0009) [2023-12-27 19:37:14,276][106225] Updated weights for policy 1, policy_version 54396 (0.0008) [2023-12-27 19:37:14,337][106225] Updated weights for policy 1, policy_version 54406 (0.0008) [2023-12-27 19:37:14,388][106225] Updated weights for policy 1, policy_version 54416 (0.0008) [2023-12-27 19:37:14,949][106226] Updated weights for policy 0, policy_version 54221 (0.0009) [2023-12-27 19:37:15,013][106226] Updated weights for policy 0, policy_version 54231 (0.0009) [2023-12-27 19:37:15,078][106226] Updated weights for policy 0, policy_version 54241 (0.0008) [2023-12-27 19:37:15,122][106225] Updated weights for policy 1, policy_version 54426 (0.0008) [2023-12-27 19:37:15,179][106225] Updated weights for policy 1, policy_version 54436 (0.0009) [2023-12-27 19:37:15,244][106225] Updated weights for policy 1, policy_version 54446 (0.0008) [2023-12-27 19:37:15,663][106226] Updated weights for policy 0, policy_version 54251 (0.0007) [2023-12-27 19:37:15,725][106226] Updated weights for policy 0, policy_version 54261 (0.0009) [2023-12-27 19:37:15,774][106226] Updated weights for policy 0, policy_version 54271 (0.0007) [2023-12-27 19:37:15,868][106225] Updated weights for policy 1, policy_version 54456 (0.0008) [2023-12-27 19:37:15,917][106225] Updated weights for policy 1, policy_version 54466 (0.0008) [2023-12-27 19:37:15,965][106225] Updated weights for policy 1, policy_version 54476 (0.0008) [2023-12-27 19:37:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 27852800. Throughput: 0: 9825.4, 1: 10002.2. Samples: 27837564. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:16,175][105115] Avg episode reward: [(0, '-6.566'), (1, '-6.410')] [2023-12-27 19:37:16,403][106226] Updated weights for policy 0, policy_version 54281 (0.0009) [2023-12-27 19:37:16,454][106226] Updated weights for policy 0, policy_version 54291 (0.0005) [2023-12-27 19:37:16,510][106226] Updated weights for policy 0, policy_version 54301 (0.0009) [2023-12-27 19:37:16,538][106225] Updated weights for policy 1, policy_version 54486 (0.0006) [2023-12-27 19:37:16,564][106226] Updated weights for policy 0, policy_version 54311 (0.0010) [2023-12-27 19:37:16,590][106225] Updated weights for policy 1, policy_version 54496 (0.0006) [2023-12-27 19:37:16,642][106225] Updated weights for policy 1, policy_version 54506 (0.0007) [2023-12-27 19:37:17,191][106226] Updated weights for policy 0, policy_version 54321 (0.0007) [2023-12-27 19:37:17,250][106226] Updated weights for policy 0, policy_version 54331 (0.0010) [2023-12-27 19:37:17,309][106226] Updated weights for policy 0, policy_version 54341 (0.0010) [2023-12-27 19:37:17,383][106225] Updated weights for policy 1, policy_version 54516 (0.0007) [2023-12-27 19:37:17,447][106225] Updated weights for policy 1, policy_version 54526 (0.0007) [2023-12-27 19:37:17,497][106225] Updated weights for policy 1, policy_version 54536 (0.0007) [2023-12-27 19:37:17,944][106226] Updated weights for policy 0, policy_version 54351 (0.0007) [2023-12-27 19:37:18,007][106226] Updated weights for policy 0, policy_version 54361 (0.0010) [2023-12-27 19:37:18,064][106226] Updated weights for policy 0, policy_version 54371 (0.0010) [2023-12-27 19:37:18,123][106225] Updated weights for policy 1, policy_version 54546 (0.0008) [2023-12-27 19:37:18,193][106225] Updated weights for policy 1, policy_version 54556 (0.0009) [2023-12-27 19:37:18,246][106225] Updated weights for policy 1, policy_version 54566 (0.0010) [2023-12-27 19:37:18,307][106225] Updated weights for policy 1, policy_version 54576 (0.0009) [2023-12-27 19:37:18,744][106226] Updated weights for policy 0, policy_version 54381 (0.0009) [2023-12-27 19:37:18,809][106226] Updated weights for policy 0, policy_version 54391 (0.0006) [2023-12-27 19:37:18,878][106226] Updated weights for policy 0, policy_version 54401 (0.0006) [2023-12-27 19:37:19,012][106225] Updated weights for policy 1, policy_version 54586 (0.0010) [2023-12-27 19:37:19,080][106225] Updated weights for policy 1, policy_version 54596 (0.0010) [2023-12-27 19:37:19,147][106225] Updated weights for policy 1, policy_version 54606 (0.0011) [2023-12-27 19:37:19,480][106226] Updated weights for policy 0, policy_version 54411 (0.0006) [2023-12-27 19:37:19,546][106226] Updated weights for policy 0, policy_version 54421 (0.0009) [2023-12-27 19:37:19,611][106226] Updated weights for policy 0, policy_version 54431 (0.0007) [2023-12-27 19:37:19,895][106225] Updated weights for policy 1, policy_version 54617 (0.0011) [2023-12-27 19:37:19,961][106225] Updated weights for policy 1, policy_version 54627 (0.0010) [2023-12-27 19:37:20,021][106225] Updated weights for policy 1, policy_version 54637 (0.0008) [2023-12-27 19:37:20,350][106226] Updated weights for policy 0, policy_version 54441 (0.0007) [2023-12-27 19:37:20,403][106226] Updated weights for policy 0, policy_version 54451 (0.0009) [2023-12-27 19:37:20,463][106226] Updated weights for policy 0, policy_version 54461 (0.0008) [2023-12-27 19:37:20,553][106226] Updated weights for policy 0, policy_version 54471 (0.0009) [2023-12-27 19:37:20,771][106225] Updated weights for policy 1, policy_version 54647 (0.0008) [2023-12-27 19:37:20,835][106225] Updated weights for policy 1, policy_version 54657 (0.0008) [2023-12-27 19:37:20,902][106225] Updated weights for policy 1, policy_version 54667 (0.0009) [2023-12-27 19:37:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 27951104. Throughput: 0: 9858.2, 1: 10009.3. Samples: 27960796. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:21,175][105115] Avg episode reward: [(0, '-6.478'), (1, '-6.074')] [2023-12-27 19:37:21,281][106226] Updated weights for policy 0, policy_version 54481 (0.0008) [2023-12-27 19:37:21,353][106226] Updated weights for policy 0, policy_version 54491 (0.0009) [2023-12-27 19:37:21,414][106226] Updated weights for policy 0, policy_version 54501 (0.0006) [2023-12-27 19:37:21,728][106225] Updated weights for policy 1, policy_version 54677 (0.0007) [2023-12-27 19:37:21,790][106225] Updated weights for policy 1, policy_version 54687 (0.0009) [2023-12-27 19:37:21,855][106225] Updated weights for policy 1, policy_version 54697 (0.0009) [2023-12-27 19:37:22,097][106226] Updated weights for policy 0, policy_version 54511 (0.0008) [2023-12-27 19:37:22,150][106226] Updated weights for policy 0, policy_version 54521 (0.0007) [2023-12-27 19:37:22,206][106226] Updated weights for policy 0, policy_version 54531 (0.0009) [2023-12-27 19:37:22,601][106225] Updated weights for policy 1, policy_version 54707 (0.0009) [2023-12-27 19:37:22,659][106225] Updated weights for policy 1, policy_version 54718 (0.0008) [2023-12-27 19:37:22,721][106225] Updated weights for policy 1, policy_version 54728 (0.0010) [2023-12-27 19:37:22,906][106226] Updated weights for policy 0, policy_version 54541 (0.0010) [2023-12-27 19:37:22,955][106226] Updated weights for policy 0, policy_version 54551 (0.0009) [2023-12-27 19:37:23,013][106226] Updated weights for policy 0, policy_version 54561 (0.0009) [2023-12-27 19:37:23,416][106225] Updated weights for policy 1, policy_version 54738 (0.0009) [2023-12-27 19:37:23,465][106225] Updated weights for policy 1, policy_version 54748 (0.0005) [2023-12-27 19:37:23,514][106225] Updated weights for policy 1, policy_version 54758 (0.0005) [2023-12-27 19:37:23,577][106225] Updated weights for policy 1, policy_version 54768 (0.0006) [2023-12-27 19:37:23,623][106226] Updated weights for policy 0, policy_version 54571 (0.0009) [2023-12-27 19:37:23,669][106226] Updated weights for policy 0, policy_version 54581 (0.0005) [2023-12-27 19:37:23,719][106226] Updated weights for policy 0, policy_version 54591 (0.0005) [2023-12-27 19:37:24,090][106225] Updated weights for policy 1, policy_version 54778 (0.0007) [2023-12-27 19:37:24,150][106225] Updated weights for policy 1, policy_version 54788 (0.0010) [2023-12-27 19:37:24,220][106225] Updated weights for policy 1, policy_version 54798 (0.0011) [2023-12-27 19:37:24,330][106226] Updated weights for policy 0, policy_version 54601 (0.0010) [2023-12-27 19:37:24,387][106226] Updated weights for policy 0, policy_version 54611 (0.0011) [2023-12-27 19:37:24,444][106226] Updated weights for policy 0, policy_version 54621 (0.0011) [2023-12-27 19:37:24,501][106226] Updated weights for policy 0, policy_version 54631 (0.0010) [2023-12-27 19:37:24,908][106225] Updated weights for policy 1, policy_version 54808 (0.0010) [2023-12-27 19:37:24,961][106225] Updated weights for policy 1, policy_version 54818 (0.0010) [2023-12-27 19:37:25,022][106225] Updated weights for policy 1, policy_version 54828 (0.0010) [2023-12-27 19:37:25,232][106226] Updated weights for policy 0, policy_version 54641 (0.0011) [2023-12-27 19:37:25,292][106226] Updated weights for policy 0, policy_version 54651 (0.0006) [2023-12-27 19:37:25,345][106226] Updated weights for policy 0, policy_version 54661 (0.0005) [2023-12-27 19:37:25,640][106225] Updated weights for policy 1, policy_version 54838 (0.0007) [2023-12-27 19:37:25,686][106225] Updated weights for policy 1, policy_version 54848 (0.0005) [2023-12-27 19:37:25,730][106225] Updated weights for policy 1, policy_version 54858 (0.0008) [2023-12-27 19:37:26,002][106226] Updated weights for policy 0, policy_version 54671 (0.0009) [2023-12-27 19:37:26,068][106226] Updated weights for policy 0, policy_version 54681 (0.0011) [2023-12-27 19:37:26,125][106226] Updated weights for policy 0, policy_version 54691 (0.0010) [2023-12-27 19:37:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 28057600. Throughput: 0: 9906.3, 1: 9987.2. Samples: 28020988. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 19:37:26,175][105115] Avg episode reward: [(0, '-6.839'), (1, '-6.497')] [2023-12-27 19:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000054696_14008320.pth... [2023-12-27 19:37:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000054864_14049280.pth... [2023-12-27 19:37:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000053512_13705216.pth [2023-12-27 19:37:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000053680_13746176.pth [2023-12-27 19:37:26,374][106225] Updated weights for policy 1, policy_version 54868 (0.0010) [2023-12-27 19:37:26,420][106225] Updated weights for policy 1, policy_version 54878 (0.0010) [2023-12-27 19:37:26,487][106225] Updated weights for policy 1, policy_version 54888 (0.0010) [2023-12-27 19:37:26,743][106226] Updated weights for policy 0, policy_version 54701 (0.0010) [2023-12-27 19:37:26,788][106226] Updated weights for policy 0, policy_version 54711 (0.0010) [2023-12-27 19:37:26,836][106226] Updated weights for policy 0, policy_version 54721 (0.0010) [2023-12-27 19:37:27,184][106225] Updated weights for policy 1, policy_version 54898 (0.0010) [2023-12-27 19:37:27,227][106225] Updated weights for policy 1, policy_version 54908 (0.0007) [2023-12-27 19:37:27,270][106225] Updated weights for policy 1, policy_version 54918 (0.0005) [2023-12-27 19:37:27,333][106225] Updated weights for policy 1, policy_version 54928 (0.0008) [2023-12-27 19:37:27,560][106226] Updated weights for policy 0, policy_version 54731 (0.0006) [2023-12-27 19:37:27,609][106226] Updated weights for policy 0, policy_version 54741 (0.0008) [2023-12-27 19:37:27,658][106226] Updated weights for policy 0, policy_version 54751 (0.0009) [2023-12-27 19:37:27,910][106225] Updated weights for policy 1, policy_version 54938 (0.0008) [2023-12-27 19:37:27,960][106225] Updated weights for policy 1, policy_version 54948 (0.0008) [2023-12-27 19:37:28,017][106225] Updated weights for policy 1, policy_version 54958 (0.0006) [2023-12-27 19:37:28,422][106226] Updated weights for policy 0, policy_version 54761 (0.0009) [2023-12-27 19:37:28,479][106226] Updated weights for policy 0, policy_version 54771 (0.0008) [2023-12-27 19:37:28,535][106226] Updated weights for policy 0, policy_version 54781 (0.0008) [2023-12-27 19:37:28,597][106226] Updated weights for policy 0, policy_version 54791 (0.0008) [2023-12-27 19:37:28,658][106225] Updated weights for policy 1, policy_version 54968 (0.0009) [2023-12-27 19:37:28,715][106225] Updated weights for policy 1, policy_version 54978 (0.0010) [2023-12-27 19:37:28,762][106225] Updated weights for policy 1, policy_version 54988 (0.0010) [2023-12-27 19:37:29,290][106226] Updated weights for policy 0, policy_version 54801 (0.0008) [2023-12-27 19:37:29,352][106226] Updated weights for policy 0, policy_version 54811 (0.0008) [2023-12-27 19:37:29,419][106226] Updated weights for policy 0, policy_version 54821 (0.0008) [2023-12-27 19:37:29,457][106225] Updated weights for policy 1, policy_version 54998 (0.0009) [2023-12-27 19:37:29,507][106225] Updated weights for policy 1, policy_version 55008 (0.0008) [2023-12-27 19:37:29,560][106225] Updated weights for policy 1, policy_version 55018 (0.0008) [2023-12-27 19:37:30,076][106226] Updated weights for policy 0, policy_version 54831 (0.0006) [2023-12-27 19:37:30,130][106226] Updated weights for policy 0, policy_version 54841 (0.0005) [2023-12-27 19:37:30,179][106226] Updated weights for policy 0, policy_version 54851 (0.0005) [2023-12-27 19:37:30,422][106225] Updated weights for policy 1, policy_version 55028 (0.0008) [2023-12-27 19:37:30,488][106225] Updated weights for policy 1, policy_version 55038 (0.0008) [2023-12-27 19:37:30,551][106225] Updated weights for policy 1, policy_version 55048 (0.0007) [2023-12-27 19:37:30,774][106226] Updated weights for policy 0, policy_version 54861 (0.0007) [2023-12-27 19:37:30,832][106226] Updated weights for policy 0, policy_version 54871 (0.0005) [2023-12-27 19:37:30,894][106226] Updated weights for policy 0, policy_version 54881 (0.0008) [2023-12-27 19:37:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 28155904. Throughput: 0: 9974.6, 1: 10139.1. Samples: 28145644. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:31,175][105115] Avg episode reward: [(0, '-6.372'), (1, '-6.659')] [2023-12-27 19:37:31,227][106225] Updated weights for policy 1, policy_version 55058 (0.0008) [2023-12-27 19:37:31,292][106225] Updated weights for policy 1, policy_version 55068 (0.0007) [2023-12-27 19:37:31,358][106225] Updated weights for policy 1, policy_version 55078 (0.0007) [2023-12-27 19:37:31,421][106225] Updated weights for policy 1, policy_version 55088 (0.0012) [2023-12-27 19:37:31,569][106226] Updated weights for policy 0, policy_version 54891 (0.0010) [2023-12-27 19:37:31,632][106226] Updated weights for policy 0, policy_version 54901 (0.0009) [2023-12-27 19:37:31,699][106226] Updated weights for policy 0, policy_version 54911 (0.0008) [2023-12-27 19:37:32,102][106225] Updated weights for policy 1, policy_version 55098 (0.0010) [2023-12-27 19:37:32,155][106225] Updated weights for policy 1, policy_version 55108 (0.0010) [2023-12-27 19:37:32,209][106225] Updated weights for policy 1, policy_version 55118 (0.0010) [2023-12-27 19:37:32,367][106226] Updated weights for policy 0, policy_version 54921 (0.0010) [2023-12-27 19:37:32,431][106226] Updated weights for policy 0, policy_version 54931 (0.0008) [2023-12-27 19:37:32,482][106226] Updated weights for policy 0, policy_version 54941 (0.0008) [2023-12-27 19:37:32,529][106226] Updated weights for policy 0, policy_version 54951 (0.0008) [2023-12-27 19:37:32,926][106225] Updated weights for policy 1, policy_version 55128 (0.0010) [2023-12-27 19:37:32,987][106225] Updated weights for policy 1, policy_version 55138 (0.0010) [2023-12-27 19:37:33,045][106225] Updated weights for policy 1, policy_version 55148 (0.0010) [2023-12-27 19:37:33,231][106226] Updated weights for policy 0, policy_version 54961 (0.0008) [2023-12-27 19:37:33,287][106226] Updated weights for policy 0, policy_version 54971 (0.0008) [2023-12-27 19:37:33,344][106226] Updated weights for policy 0, policy_version 54981 (0.0007) [2023-12-27 19:37:33,738][106225] Updated weights for policy 1, policy_version 55158 (0.0010) [2023-12-27 19:37:33,795][106225] Updated weights for policy 1, policy_version 55168 (0.0010) [2023-12-27 19:37:33,853][106225] Updated weights for policy 1, policy_version 55178 (0.0006) [2023-12-27 19:37:34,058][106226] Updated weights for policy 0, policy_version 54991 (0.0008) [2023-12-27 19:37:34,123][106226] Updated weights for policy 0, policy_version 55001 (0.0005) [2023-12-27 19:37:34,191][106226] Updated weights for policy 0, policy_version 55011 (0.0008) [2023-12-27 19:37:34,519][106225] Updated weights for policy 1, policy_version 55188 (0.0009) [2023-12-27 19:37:34,584][106225] Updated weights for policy 1, policy_version 55198 (0.0010) [2023-12-27 19:37:34,647][106225] Updated weights for policy 1, policy_version 55208 (0.0007) [2023-12-27 19:37:34,949][106226] Updated weights for policy 0, policy_version 55021 (0.0008) [2023-12-27 19:37:35,003][106226] Updated weights for policy 0, policy_version 55031 (0.0007) [2023-12-27 19:37:35,055][106226] Updated weights for policy 0, policy_version 55041 (0.0005) [2023-12-27 19:37:35,255][106225] Updated weights for policy 1, policy_version 55218 (0.0007) [2023-12-27 19:37:35,313][106225] Updated weights for policy 1, policy_version 55228 (0.0010) [2023-12-27 19:37:35,370][106225] Updated weights for policy 1, policy_version 55238 (0.0010) [2023-12-27 19:37:35,424][106225] Updated weights for policy 1, policy_version 55248 (0.0008) [2023-12-27 19:37:35,748][106226] Updated weights for policy 0, policy_version 55051 (0.0006) [2023-12-27 19:37:35,799][106226] Updated weights for policy 0, policy_version 55061 (0.0006) [2023-12-27 19:37:35,853][106226] Updated weights for policy 0, policy_version 55071 (0.0008) [2023-12-27 19:37:36,090][106225] Updated weights for policy 1, policy_version 55258 (0.0010) [2023-12-27 19:37:36,150][106225] Updated weights for policy 1, policy_version 55268 (0.0011) [2023-12-27 19:37:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 28254208. Throughput: 0: 9957.7, 1: 10197.2. Samples: 28265740. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:36,175][105115] Avg episode reward: [(0, '-6.125'), (1, '-6.958')] [2023-12-27 19:37:36,212][106225] Updated weights for policy 1, policy_version 55278 (0.0010) [2023-12-27 19:37:36,549][106226] Updated weights for policy 0, policy_version 55081 (0.0007) [2023-12-27 19:37:36,616][106226] Updated weights for policy 0, policy_version 55091 (0.0007) [2023-12-27 19:37:36,684][106226] Updated weights for policy 0, policy_version 55101 (0.0006) [2023-12-27 19:37:36,739][106226] Updated weights for policy 0, policy_version 55111 (0.0006) [2023-12-27 19:37:36,947][106225] Updated weights for policy 1, policy_version 55288 (0.0006) [2023-12-27 19:37:37,005][106225] Updated weights for policy 1, policy_version 55298 (0.0009) [2023-12-27 19:37:37,067][106225] Updated weights for policy 1, policy_version 55308 (0.0011) [2023-12-27 19:37:37,397][106226] Updated weights for policy 0, policy_version 55121 (0.0009) [2023-12-27 19:37:37,461][106226] Updated weights for policy 0, policy_version 55131 (0.0011) [2023-12-27 19:37:37,522][106226] Updated weights for policy 0, policy_version 55141 (0.0011) [2023-12-27 19:37:37,752][106225] Updated weights for policy 1, policy_version 55318 (0.0010) [2023-12-27 19:37:37,806][106225] Updated weights for policy 1, policy_version 55328 (0.0008) [2023-12-27 19:37:37,865][106225] Updated weights for policy 1, policy_version 55338 (0.0005) [2023-12-27 19:37:38,222][106226] Updated weights for policy 0, policy_version 55151 (0.0010) [2023-12-27 19:37:38,275][106226] Updated weights for policy 0, policy_version 55161 (0.0010) [2023-12-27 19:37:38,329][106226] Updated weights for policy 0, policy_version 55171 (0.0009) [2023-12-27 19:37:38,542][106225] Updated weights for policy 1, policy_version 55348 (0.0007) [2023-12-27 19:37:38,602][106225] Updated weights for policy 1, policy_version 55358 (0.0008) [2023-12-27 19:37:38,659][106225] Updated weights for policy 1, policy_version 55368 (0.0009) [2023-12-27 19:37:39,076][106226] Updated weights for policy 0, policy_version 55181 (0.0009) [2023-12-27 19:37:39,137][106226] Updated weights for policy 0, policy_version 55191 (0.0009) [2023-12-27 19:37:39,193][106226] Updated weights for policy 0, policy_version 55201 (0.0008) [2023-12-27 19:37:39,419][106225] Updated weights for policy 1, policy_version 55378 (0.0008) [2023-12-27 19:37:39,479][106225] Updated weights for policy 1, policy_version 55388 (0.0008) [2023-12-27 19:37:39,546][106225] Updated weights for policy 1, policy_version 55398 (0.0008) [2023-12-27 19:37:39,613][106225] Updated weights for policy 1, policy_version 55408 (0.0008) [2023-12-27 19:37:39,960][106226] Updated weights for policy 0, policy_version 55211 (0.0008) [2023-12-27 19:37:40,023][106226] Updated weights for policy 0, policy_version 55221 (0.0008) [2023-12-27 19:37:40,091][106226] Updated weights for policy 0, policy_version 55231 (0.0009) [2023-12-27 19:37:40,352][106225] Updated weights for policy 1, policy_version 55418 (0.0008) [2023-12-27 19:37:40,411][106225] Updated weights for policy 1, policy_version 55428 (0.0008) [2023-12-27 19:37:40,464][106225] Updated weights for policy 1, policy_version 55438 (0.0008) [2023-12-27 19:37:40,842][106226] Updated weights for policy 0, policy_version 55241 (0.0009) [2023-12-27 19:37:40,892][106226] Updated weights for policy 0, policy_version 55251 (0.0008) [2023-12-27 19:37:40,938][106226] Updated weights for policy 0, policy_version 55261 (0.0008) [2023-12-27 19:37:40,984][106226] Updated weights for policy 0, policy_version 55271 (0.0006) [2023-12-27 19:37:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 28352512. Throughput: 0: 9982.3, 1: 10179.1. Samples: 28324516. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:41,175][105115] Avg episode reward: [(0, '-5.731'), (1, '-6.334')] [2023-12-27 19:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000055272_14155776.pth... [2023-12-27 19:37:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000054088_13852672.pth [2023-12-27 19:37:41,195][106225] Updated weights for policy 1, policy_version 55448 (0.0010) [2023-12-27 19:37:41,257][106225] Updated weights for policy 1, policy_version 55458 (0.0010) [2023-12-27 19:37:41,323][106225] Updated weights for policy 1, policy_version 55468 (0.0011) [2023-12-27 19:37:41,344][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000055472_14204928.pth... [2023-12-27 19:37:41,348][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000054288_13901824.pth [2023-12-27 19:37:41,815][106226] Updated weights for policy 0, policy_version 55281 (0.0006) [2023-12-27 19:37:41,865][106226] Updated weights for policy 0, policy_version 55291 (0.0005) [2023-12-27 19:37:41,913][106226] Updated weights for policy 0, policy_version 55301 (0.0006) [2023-12-27 19:37:42,192][106225] Updated weights for policy 1, policy_version 55478 (0.0009) [2023-12-27 19:37:42,260][106225] Updated weights for policy 1, policy_version 55488 (0.0008) [2023-12-27 19:37:42,327][106225] Updated weights for policy 1, policy_version 55498 (0.0008) [2023-12-27 19:37:42,607][106226] Updated weights for policy 0, policy_version 55311 (0.0007) [2023-12-27 19:37:42,668][106226] Updated weights for policy 0, policy_version 55321 (0.0006) [2023-12-27 19:37:42,731][106226] Updated weights for policy 0, policy_version 55331 (0.0006) [2023-12-27 19:37:43,076][106225] Updated weights for policy 1, policy_version 55508 (0.0008) [2023-12-27 19:37:43,129][106225] Updated weights for policy 1, policy_version 55518 (0.0009) [2023-12-27 19:37:43,185][106225] Updated weights for policy 1, policy_version 55528 (0.0008) [2023-12-27 19:37:43,352][106226] Updated weights for policy 0, policy_version 55341 (0.0008) [2023-12-27 19:37:43,400][106226] Updated weights for policy 0, policy_version 55351 (0.0008) [2023-12-27 19:37:43,452][106226] Updated weights for policy 0, policy_version 55361 (0.0007) [2023-12-27 19:37:43,867][106225] Updated weights for policy 1, policy_version 55538 (0.0010) [2023-12-27 19:37:43,917][106225] Updated weights for policy 1, policy_version 55548 (0.0010) [2023-12-27 19:37:43,959][106225] Updated weights for policy 1, policy_version 55558 (0.0010) [2023-12-27 19:37:44,005][106225] Updated weights for policy 1, policy_version 55568 (0.0010) [2023-12-27 19:37:44,164][106226] Updated weights for policy 0, policy_version 55371 (0.0007) [2023-12-27 19:37:44,218][106226] Updated weights for policy 0, policy_version 55381 (0.0007) [2023-12-27 19:37:44,274][106226] Updated weights for policy 0, policy_version 55391 (0.0007) [2023-12-27 19:37:44,701][106225] Updated weights for policy 1, policy_version 55578 (0.0005) [2023-12-27 19:37:44,758][106225] Updated weights for policy 1, policy_version 55588 (0.0006) [2023-12-27 19:37:44,818][106225] Updated weights for policy 1, policy_version 55598 (0.0009) [2023-12-27 19:37:44,955][106226] Updated weights for policy 0, policy_version 55401 (0.0010) [2023-12-27 19:37:45,015][106226] Updated weights for policy 0, policy_version 55411 (0.0009) [2023-12-27 19:37:45,085][106226] Updated weights for policy 0, policy_version 55421 (0.0005) [2023-12-27 19:37:45,155][106226] Updated weights for policy 0, policy_version 55431 (0.0005) [2023-12-27 19:37:45,453][106225] Updated weights for policy 1, policy_version 55608 (0.0010) [2023-12-27 19:37:45,503][106225] Updated weights for policy 1, policy_version 55618 (0.0010) [2023-12-27 19:37:45,567][106225] Updated weights for policy 1, policy_version 55628 (0.0010) [2023-12-27 19:37:45,712][106226] Updated weights for policy 0, policy_version 55441 (0.0008) [2023-12-27 19:37:45,772][106226] Updated weights for policy 0, policy_version 55451 (0.0010) [2023-12-27 19:37:45,828][106226] Updated weights for policy 0, policy_version 55461 (0.0010) [2023-12-27 19:37:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 28450816. Throughput: 0: 9978.2, 1: 10032.9. Samples: 28439952. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:46,175][105115] Avg episode reward: [(0, '-6.592'), (1, '-6.881')] [2023-12-27 19:37:46,214][106225] Updated weights for policy 1, policy_version 55638 (0.0008) [2023-12-27 19:37:46,277][106225] Updated weights for policy 1, policy_version 55648 (0.0006) [2023-12-27 19:37:46,345][106225] Updated weights for policy 1, policy_version 55658 (0.0006) [2023-12-27 19:37:46,553][106226] Updated weights for policy 0, policy_version 55471 (0.0010) [2023-12-27 19:37:46,616][106226] Updated weights for policy 0, policy_version 55481 (0.0010) [2023-12-27 19:37:46,687][106226] Updated weights for policy 0, policy_version 55491 (0.0010) [2023-12-27 19:37:46,933][106225] Updated weights for policy 1, policy_version 55668 (0.0006) [2023-12-27 19:37:46,978][106225] Updated weights for policy 1, policy_version 55678 (0.0005) [2023-12-27 19:37:47,024][106225] Updated weights for policy 1, policy_version 55688 (0.0005) [2023-12-27 19:37:47,376][106226] Updated weights for policy 0, policy_version 55501 (0.0011) [2023-12-27 19:37:47,428][106226] Updated weights for policy 0, policy_version 55511 (0.0010) [2023-12-27 19:37:47,481][106226] Updated weights for policy 0, policy_version 55521 (0.0010) [2023-12-27 19:37:47,596][106225] Updated weights for policy 1, policy_version 55698 (0.0006) [2023-12-27 19:37:47,646][106225] Updated weights for policy 1, policy_version 55708 (0.0008) [2023-12-27 19:37:47,701][106225] Updated weights for policy 1, policy_version 55718 (0.0008) [2023-12-27 19:37:47,765][106225] Updated weights for policy 1, policy_version 55728 (0.0009) [2023-12-27 19:37:48,119][106226] Updated weights for policy 0, policy_version 55531 (0.0010) [2023-12-27 19:37:48,169][106226] Updated weights for policy 0, policy_version 55541 (0.0010) [2023-12-27 19:37:48,223][106226] Updated weights for policy 0, policy_version 55551 (0.0010) [2023-12-27 19:37:48,436][106225] Updated weights for policy 1, policy_version 55738 (0.0007) [2023-12-27 19:37:48,493][106225] Updated weights for policy 1, policy_version 55748 (0.0007) [2023-12-27 19:37:48,550][106225] Updated weights for policy 1, policy_version 55758 (0.0008) [2023-12-27 19:37:48,956][106226] Updated weights for policy 0, policy_version 55561 (0.0010) [2023-12-27 19:37:49,024][106226] Updated weights for policy 0, policy_version 55571 (0.0007) [2023-12-27 19:37:49,082][106226] Updated weights for policy 0, policy_version 55581 (0.0011) [2023-12-27 19:37:49,133][106226] Updated weights for policy 0, policy_version 55591 (0.0010) [2023-12-27 19:37:49,246][106225] Updated weights for policy 1, policy_version 55768 (0.0007) [2023-12-27 19:37:49,301][106225] Updated weights for policy 1, policy_version 55778 (0.0008) [2023-12-27 19:37:49,372][106225] Updated weights for policy 1, policy_version 55788 (0.0008) [2023-12-27 19:37:49,847][106226] Updated weights for policy 0, policy_version 55601 (0.0011) [2023-12-27 19:37:49,914][106226] Updated weights for policy 0, policy_version 55611 (0.0008) [2023-12-27 19:37:49,984][106226] Updated weights for policy 0, policy_version 55622 (0.0010) [2023-12-27 19:37:50,081][106225] Updated weights for policy 1, policy_version 55798 (0.0008) [2023-12-27 19:37:50,135][106225] Updated weights for policy 1, policy_version 55808 (0.0008) [2023-12-27 19:37:50,196][106225] Updated weights for policy 1, policy_version 55818 (0.0005) [2023-12-27 19:37:50,662][106226] Updated weights for policy 0, policy_version 55632 (0.0010) [2023-12-27 19:37:50,713][106226] Updated weights for policy 0, policy_version 55642 (0.0010) [2023-12-27 19:37:50,775][106226] Updated weights for policy 0, policy_version 55652 (0.0011) [2023-12-27 19:37:50,894][106225] Updated weights for policy 1, policy_version 55828 (0.0007) [2023-12-27 19:37:50,949][106225] Updated weights for policy 1, policy_version 55838 (0.0007) [2023-12-27 19:37:51,013][106225] Updated weights for policy 1, policy_version 55848 (0.0006) [2023-12-27 19:37:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19799.6). Total num frames: 28557312. Throughput: 0: 9992.3, 1: 10047.7. Samples: 28563604. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:51,176][105115] Avg episode reward: [(0, '-6.122'), (1, '-7.164')] [2023-12-27 19:37:51,551][106226] Updated weights for policy 0, policy_version 55662 (0.0010) [2023-12-27 19:37:51,609][106226] Updated weights for policy 0, policy_version 55672 (0.0009) [2023-12-27 19:37:51,681][106226] Updated weights for policy 0, policy_version 55682 (0.0009) [2023-12-27 19:37:51,804][106225] Updated weights for policy 1, policy_version 55858 (0.0009) [2023-12-27 19:37:51,875][106225] Updated weights for policy 1, policy_version 55868 (0.0010) [2023-12-27 19:37:51,937][106225] Updated weights for policy 1, policy_version 55878 (0.0010) [2023-12-27 19:37:52,000][106225] Updated weights for policy 1, policy_version 55888 (0.0010) [2023-12-27 19:37:52,405][106226] Updated weights for policy 0, policy_version 55692 (0.0008) [2023-12-27 19:37:52,470][106226] Updated weights for policy 0, policy_version 55702 (0.0008) [2023-12-27 19:37:52,537][106226] Updated weights for policy 0, policy_version 55712 (0.0008) [2023-12-27 19:37:52,676][106225] Updated weights for policy 1, policy_version 55898 (0.0009) [2023-12-27 19:37:52,734][106225] Updated weights for policy 1, policy_version 55908 (0.0010) [2023-12-27 19:37:52,782][106225] Updated weights for policy 1, policy_version 55918 (0.0010) [2023-12-27 19:37:53,248][106226] Updated weights for policy 0, policy_version 55722 (0.0008) [2023-12-27 19:37:53,304][106226] Updated weights for policy 0, policy_version 55732 (0.0010) [2023-12-27 19:37:53,354][106226] Updated weights for policy 0, policy_version 55742 (0.0010) [2023-12-27 19:37:53,410][106226] Updated weights for policy 0, policy_version 55752 (0.0010) [2023-12-27 19:37:53,440][106225] Updated weights for policy 1, policy_version 55928 (0.0010) [2023-12-27 19:37:53,506][106225] Updated weights for policy 1, policy_version 55938 (0.0010) [2023-12-27 19:37:53,568][106225] Updated weights for policy 1, policy_version 55948 (0.0010) [2023-12-27 19:37:54,149][106226] Updated weights for policy 0, policy_version 55762 (0.0010) [2023-12-27 19:37:54,213][106226] Updated weights for policy 0, policy_version 55772 (0.0011) [2023-12-27 19:37:54,221][106225] Updated weights for policy 1, policy_version 55958 (0.0008) [2023-12-27 19:37:54,273][106226] Updated weights for policy 0, policy_version 55782 (0.0010) [2023-12-27 19:37:54,279][106225] Updated weights for policy 1, policy_version 55968 (0.0006) [2023-12-27 19:37:54,341][106225] Updated weights for policy 1, policy_version 55978 (0.0006) [2023-12-27 19:37:54,875][106225] Updated weights for policy 1, policy_version 55988 (0.0006) [2023-12-27 19:37:54,932][106225] Updated weights for policy 1, policy_version 55998 (0.0005) [2023-12-27 19:37:54,998][106225] Updated weights for policy 1, policy_version 56008 (0.0005) [2023-12-27 19:37:55,016][106226] Updated weights for policy 0, policy_version 55792 (0.0007) [2023-12-27 19:37:55,075][106226] Updated weights for policy 0, policy_version 55802 (0.0009) [2023-12-27 19:37:55,123][106226] Updated weights for policy 0, policy_version 55812 (0.0007) [2023-12-27 19:37:55,499][106225] Updated weights for policy 1, policy_version 56018 (0.0006) [2023-12-27 19:37:55,564][106225] Updated weights for policy 1, policy_version 56028 (0.0009) [2023-12-27 19:37:55,617][106225] Updated weights for policy 1, policy_version 56038 (0.0010) [2023-12-27 19:37:55,671][106225] Updated weights for policy 1, policy_version 56048 (0.0010) [2023-12-27 19:37:55,897][106226] Updated weights for policy 0, policy_version 55822 (0.0008) [2023-12-27 19:37:55,953][106226] Updated weights for policy 0, policy_version 55832 (0.0005) [2023-12-27 19:37:56,011][106226] Updated weights for policy 0, policy_version 55842 (0.0005) [2023-12-27 19:37:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 28655616. Throughput: 0: 9948.8, 1: 9976.7. Samples: 28620776. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:37:56,175][105115] Avg episode reward: [(0, '-5.923'), (1, '-6.749')] [2023-12-27 19:37:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000056048_14352384.pth... [2023-12-27 19:37:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000055848_14303232.pth... [2023-12-27 19:37:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000054864_14049280.pth [2023-12-27 19:37:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000054696_14008320.pth [2023-12-27 19:37:56,309][106225] Updated weights for policy 1, policy_version 56058 (0.0005) [2023-12-27 19:37:56,379][106225] Updated weights for policy 1, policy_version 56068 (0.0005) [2023-12-27 19:37:56,442][106225] Updated weights for policy 1, policy_version 56078 (0.0005) [2023-12-27 19:37:56,612][106226] Updated weights for policy 0, policy_version 55852 (0.0007) [2023-12-27 19:37:56,666][106226] Updated weights for policy 0, policy_version 55862 (0.0005) [2023-12-27 19:37:56,715][106226] Updated weights for policy 0, policy_version 55872 (0.0009) [2023-12-27 19:37:57,080][106225] Updated weights for policy 1, policy_version 56088 (0.0007) [2023-12-27 19:37:57,137][106225] Updated weights for policy 1, policy_version 56098 (0.0008) [2023-12-27 19:37:57,201][106225] Updated weights for policy 1, policy_version 56108 (0.0009) [2023-12-27 19:37:57,297][106226] Updated weights for policy 0, policy_version 55882 (0.0010) [2023-12-27 19:37:57,358][106226] Updated weights for policy 0, policy_version 55892 (0.0006) [2023-12-27 19:37:57,413][106226] Updated weights for policy 0, policy_version 55902 (0.0006) [2023-12-27 19:37:57,465][106226] Updated weights for policy 0, policy_version 55912 (0.0005) [2023-12-27 19:37:57,912][106225] Updated weights for policy 1, policy_version 56118 (0.0009) [2023-12-27 19:37:57,961][106225] Updated weights for policy 1, policy_version 56128 (0.0008) [2023-12-27 19:37:58,023][106225] Updated weights for policy 1, policy_version 56138 (0.0008) [2023-12-27 19:37:58,052][106226] Updated weights for policy 0, policy_version 55922 (0.0005) [2023-12-27 19:37:58,105][106226] Updated weights for policy 0, policy_version 55932 (0.0005) [2023-12-27 19:37:58,159][106226] Updated weights for policy 0, policy_version 55942 (0.0006) [2023-12-27 19:37:58,830][106226] Updated weights for policy 0, policy_version 55952 (0.0008) [2023-12-27 19:37:58,898][106226] Updated weights for policy 0, policy_version 55962 (0.0007) [2023-12-27 19:37:58,930][106225] Updated weights for policy 1, policy_version 56148 (0.0008) [2023-12-27 19:37:58,970][106226] Updated weights for policy 0, policy_version 55972 (0.0007) [2023-12-27 19:37:58,994][106225] Updated weights for policy 1, policy_version 56158 (0.0011) [2023-12-27 19:37:59,063][106225] Updated weights for policy 1, policy_version 56168 (0.0011) [2023-12-27 19:37:59,698][106226] Updated weights for policy 0, policy_version 55982 (0.0007) [2023-12-27 19:37:59,748][106225] Updated weights for policy 1, policy_version 56178 (0.0009) [2023-12-27 19:37:59,760][106226] Updated weights for policy 0, policy_version 55992 (0.0008) [2023-12-27 19:37:59,799][106225] Updated weights for policy 1, policy_version 56188 (0.0005) [2023-12-27 19:37:59,821][106226] Updated weights for policy 0, policy_version 56002 (0.0009) [2023-12-27 19:37:59,867][106225] Updated weights for policy 1, policy_version 56198 (0.0007) [2023-12-27 19:37:59,925][106225] Updated weights for policy 1, policy_version 56208 (0.0007) [2023-12-27 19:38:00,519][106225] Updated weights for policy 1, policy_version 56218 (0.0009) [2023-12-27 19:38:00,572][106225] Updated weights for policy 1, policy_version 56228 (0.0007) [2023-12-27 19:38:00,581][106226] Updated weights for policy 0, policy_version 56012 (0.0008) [2023-12-27 19:38:00,622][106225] Updated weights for policy 1, policy_version 56238 (0.0006) [2023-12-27 19:38:00,638][106226] Updated weights for policy 0, policy_version 56022 (0.0010) [2023-12-27 19:38:00,688][106226] Updated weights for policy 0, policy_version 56032 (0.0010) [2023-12-27 19:38:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 28753920. Throughput: 0: 10059.0, 1: 10092.9. Samples: 28744396. Policy #0 lag: (min: 29.0, avg: 35.1, max: 61.0) [2023-12-27 19:38:01,175][105115] Avg episode reward: [(0, '-6.529'), (1, '-6.332')] [2023-12-27 19:38:01,312][106225] Updated weights for policy 1, policy_version 56248 (0.0008) [2023-12-27 19:38:01,374][106225] Updated weights for policy 1, policy_version 56258 (0.0008) [2023-12-27 19:38:01,431][106226] Updated weights for policy 0, policy_version 56042 (0.0010) [2023-12-27 19:38:01,438][106225] Updated weights for policy 1, policy_version 56268 (0.0007) [2023-12-27 19:38:01,490][106226] Updated weights for policy 0, policy_version 56052 (0.0010) [2023-12-27 19:38:01,554][106226] Updated weights for policy 0, policy_version 56062 (0.0011) [2023-12-27 19:38:01,609][106226] Updated weights for policy 0, policy_version 56072 (0.0011) [2023-12-27 19:38:02,122][106225] Updated weights for policy 1, policy_version 56278 (0.0009) [2023-12-27 19:38:02,176][106225] Updated weights for policy 1, policy_version 56288 (0.0008) [2023-12-27 19:38:02,228][106225] Updated weights for policy 1, policy_version 56298 (0.0006) [2023-12-27 19:38:02,372][106226] Updated weights for policy 0, policy_version 56082 (0.0009) [2023-12-27 19:38:02,432][106226] Updated weights for policy 0, policy_version 56092 (0.0006) [2023-12-27 19:38:02,494][106226] Updated weights for policy 0, policy_version 56102 (0.0008) [2023-12-27 19:38:02,978][106225] Updated weights for policy 1, policy_version 56308 (0.0008) [2023-12-27 19:38:03,022][106225] Updated weights for policy 1, policy_version 56318 (0.0008) [2023-12-27 19:38:03,074][106225] Updated weights for policy 1, policy_version 56328 (0.0009) [2023-12-27 19:38:03,142][106226] Updated weights for policy 0, policy_version 56112 (0.0009) [2023-12-27 19:38:03,204][106226] Updated weights for policy 0, policy_version 56122 (0.0009) [2023-12-27 19:38:03,259][106226] Updated weights for policy 0, policy_version 56132 (0.0008) [2023-12-27 19:38:03,788][106225] Updated weights for policy 1, policy_version 56338 (0.0009) [2023-12-27 19:38:03,850][106225] Updated weights for policy 1, policy_version 56348 (0.0009) [2023-12-27 19:38:03,876][106226] Updated weights for policy 0, policy_version 56142 (0.0007) [2023-12-27 19:38:03,915][106225] Updated weights for policy 1, policy_version 56358 (0.0011) [2023-12-27 19:38:03,942][106226] Updated weights for policy 0, policy_version 56152 (0.0006) [2023-12-27 19:38:03,982][106225] Updated weights for policy 1, policy_version 56368 (0.0005) [2023-12-27 19:38:04,006][106226] Updated weights for policy 0, policy_version 56162 (0.0005) [2023-12-27 19:38:04,631][106225] Updated weights for policy 1, policy_version 56378 (0.0010) [2023-12-27 19:38:04,685][106225] Updated weights for policy 1, policy_version 56388 (0.0010) [2023-12-27 19:38:04,698][106226] Updated weights for policy 0, policy_version 56172 (0.0006) [2023-12-27 19:38:04,735][106225] Updated weights for policy 1, policy_version 56398 (0.0010) [2023-12-27 19:38:04,758][106226] Updated weights for policy 0, policy_version 56182 (0.0007) [2023-12-27 19:38:04,808][106226] Updated weights for policy 0, policy_version 56192 (0.0008) [2023-12-27 19:38:05,390][106225] Updated weights for policy 1, policy_version 56408 (0.0010) [2023-12-27 19:38:05,452][106225] Updated weights for policy 1, policy_version 56418 (0.0010) [2023-12-27 19:38:05,473][106226] Updated weights for policy 0, policy_version 56202 (0.0008) [2023-12-27 19:38:05,516][106225] Updated weights for policy 1, policy_version 56428 (0.0010) [2023-12-27 19:38:05,533][106226] Updated weights for policy 0, policy_version 56212 (0.0006) [2023-12-27 19:38:05,594][106226] Updated weights for policy 0, policy_version 56222 (0.0008) [2023-12-27 19:38:05,652][106226] Updated weights for policy 0, policy_version 56232 (0.0007) [2023-12-27 19:38:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 28852224. Throughput: 0: 10016.8, 1: 10098.0. Samples: 28865964. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:06,176][105115] Avg episode reward: [(0, '-6.482'), (1, '-6.519')] [2023-12-27 19:38:06,256][106225] Updated weights for policy 1, policy_version 56438 (0.0008) [2023-12-27 19:38:06,282][106226] Updated weights for policy 0, policy_version 56242 (0.0008) [2023-12-27 19:38:06,313][106225] Updated weights for policy 1, policy_version 56448 (0.0009) [2023-12-27 19:38:06,345][106226] Updated weights for policy 0, policy_version 56252 (0.0008) [2023-12-27 19:38:06,372][106225] Updated weights for policy 1, policy_version 56458 (0.0006) [2023-12-27 19:38:06,408][106226] Updated weights for policy 0, policy_version 56262 (0.0009) [2023-12-27 19:38:07,104][106225] Updated weights for policy 1, policy_version 56468 (0.0010) [2023-12-27 19:38:07,154][106226] Updated weights for policy 0, policy_version 56272 (0.0008) [2023-12-27 19:38:07,167][106225] Updated weights for policy 1, policy_version 56478 (0.0010) [2023-12-27 19:38:07,213][106226] Updated weights for policy 0, policy_version 56282 (0.0006) [2023-12-27 19:38:07,233][106225] Updated weights for policy 1, policy_version 56488 (0.0011) [2023-12-27 19:38:07,271][106226] Updated weights for policy 0, policy_version 56292 (0.0007) [2023-12-27 19:38:07,877][106225] Updated weights for policy 1, policy_version 56498 (0.0008) [2023-12-27 19:38:07,934][106226] Updated weights for policy 0, policy_version 56302 (0.0006) [2023-12-27 19:38:07,944][106225] Updated weights for policy 1, policy_version 56508 (0.0006) [2023-12-27 19:38:07,994][106226] Updated weights for policy 0, policy_version 56312 (0.0006) [2023-12-27 19:38:07,999][106225] Updated weights for policy 1, policy_version 56518 (0.0006) [2023-12-27 19:38:08,051][106226] Updated weights for policy 0, policy_version 56322 (0.0008) [2023-12-27 19:38:08,060][106225] Updated weights for policy 1, policy_version 56528 (0.0005) [2023-12-27 19:38:08,621][106225] Updated weights for policy 1, policy_version 56538 (0.0007) [2023-12-27 19:38:08,662][106226] Updated weights for policy 0, policy_version 56332 (0.0009) [2023-12-27 19:38:08,672][106225] Updated weights for policy 1, policy_version 56548 (0.0006) [2023-12-27 19:38:08,720][106226] Updated weights for policy 0, policy_version 56342 (0.0008) [2023-12-27 19:38:08,732][106225] Updated weights for policy 1, policy_version 56558 (0.0006) [2023-12-27 19:38:08,778][106226] Updated weights for policy 0, policy_version 56352 (0.0009) [2023-12-27 19:38:09,424][106225] Updated weights for policy 1, policy_version 56568 (0.0008) [2023-12-27 19:38:09,488][106225] Updated weights for policy 1, policy_version 56578 (0.0009) [2023-12-27 19:38:09,537][106226] Updated weights for policy 0, policy_version 56362 (0.0008) [2023-12-27 19:38:09,540][106225] Updated weights for policy 1, policy_version 56588 (0.0008) [2023-12-27 19:38:09,596][106226] Updated weights for policy 0, policy_version 56372 (0.0008) [2023-12-27 19:38:09,655][106226] Updated weights for policy 0, policy_version 56382 (0.0008) [2023-12-27 19:38:09,717][106226] Updated weights for policy 0, policy_version 56392 (0.0008) [2023-12-27 19:38:10,403][106225] Updated weights for policy 1, policy_version 56598 (0.0010) [2023-12-27 19:38:10,463][106225] Updated weights for policy 1, policy_version 56608 (0.0010) [2023-12-27 19:38:10,485][106226] Updated weights for policy 0, policy_version 56402 (0.0011) [2023-12-27 19:38:10,522][106225] Updated weights for policy 1, policy_version 56618 (0.0010) [2023-12-27 19:38:10,541][106226] Updated weights for policy 0, policy_version 56412 (0.0006) [2023-12-27 19:38:10,603][106226] Updated weights for policy 0, policy_version 56422 (0.0007) [2023-12-27 19:38:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 28950528. Throughput: 0: 9977.7, 1: 10154.3. Samples: 28926924. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:11,175][105115] Avg episode reward: [(0, '-6.256'), (1, '-6.682')] [2023-12-27 19:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000056624_14499840.pth... [2023-12-27 19:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000056424_14450688.pth... [2023-12-27 19:38:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000055272_14155776.pth [2023-12-27 19:38:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000055472_14204928.pth [2023-12-27 19:38:11,254][106225] Updated weights for policy 1, policy_version 56628 (0.0010) [2023-12-27 19:38:11,321][106225] Updated weights for policy 1, policy_version 56638 (0.0009) [2023-12-27 19:38:11,356][106226] Updated weights for policy 0, policy_version 56432 (0.0007) [2023-12-27 19:38:11,403][106225] Updated weights for policy 1, policy_version 56648 (0.0008) [2023-12-27 19:38:11,426][106226] Updated weights for policy 0, policy_version 56442 (0.0008) [2023-12-27 19:38:11,489][106226] Updated weights for policy 0, policy_version 56452 (0.0007) [2023-12-27 19:38:12,081][106225] Updated weights for policy 1, policy_version 56658 (0.0008) [2023-12-27 19:38:12,138][106225] Updated weights for policy 1, policy_version 56668 (0.0006) [2023-12-27 19:38:12,200][106225] Updated weights for policy 1, policy_version 56678 (0.0005) [2023-12-27 19:38:12,258][106225] Updated weights for policy 1, policy_version 56688 (0.0007) [2023-12-27 19:38:12,277][106226] Updated weights for policy 0, policy_version 56462 (0.0009) [2023-12-27 19:38:12,341][106226] Updated weights for policy 0, policy_version 56472 (0.0008) [2023-12-27 19:38:12,415][106226] Updated weights for policy 0, policy_version 56482 (0.0009) [2023-12-27 19:38:12,964][106225] Updated weights for policy 1, policy_version 56698 (0.0008) [2023-12-27 19:38:13,026][106225] Updated weights for policy 1, policy_version 56709 (0.0009) [2023-12-27 19:38:13,083][106225] Updated weights for policy 1, policy_version 56719 (0.0006) [2023-12-27 19:38:13,139][106226] Updated weights for policy 0, policy_version 56492 (0.0008) [2023-12-27 19:38:13,200][106226] Updated weights for policy 0, policy_version 56502 (0.0008) [2023-12-27 19:38:13,265][106226] Updated weights for policy 0, policy_version 56512 (0.0008) [2023-12-27 19:38:13,679][106225] Updated weights for policy 1, policy_version 56729 (0.0007) [2023-12-27 19:38:13,729][106225] Updated weights for policy 1, policy_version 56739 (0.0007) [2023-12-27 19:38:13,782][106225] Updated weights for policy 1, policy_version 56749 (0.0006) [2023-12-27 19:38:14,044][106226] Updated weights for policy 0, policy_version 56522 (0.0008) [2023-12-27 19:38:14,098][106226] Updated weights for policy 0, policy_version 56532 (0.0011) [2023-12-27 19:38:14,161][106226] Updated weights for policy 0, policy_version 56542 (0.0011) [2023-12-27 19:38:14,215][106226] Updated weights for policy 0, policy_version 56552 (0.0010) [2023-12-27 19:38:14,472][106225] Updated weights for policy 1, policy_version 56759 (0.0008) [2023-12-27 19:38:14,516][106225] Updated weights for policy 1, policy_version 56769 (0.0008) [2023-12-27 19:38:14,569][106225] Updated weights for policy 1, policy_version 56779 (0.0007) [2023-12-27 19:38:14,938][106226] Updated weights for policy 0, policy_version 56562 (0.0010) [2023-12-27 19:38:14,995][106226] Updated weights for policy 0, policy_version 56572 (0.0009) [2023-12-27 19:38:15,057][106226] Updated weights for policy 0, policy_version 56582 (0.0009) [2023-12-27 19:38:15,266][106225] Updated weights for policy 1, policy_version 56789 (0.0008) [2023-12-27 19:38:15,328][106225] Updated weights for policy 1, policy_version 56799 (0.0008) [2023-12-27 19:38:15,392][106225] Updated weights for policy 1, policy_version 56809 (0.0006) [2023-12-27 19:38:15,793][106226] Updated weights for policy 0, policy_version 56592 (0.0006) [2023-12-27 19:38:15,868][106226] Updated weights for policy 0, policy_version 56602 (0.0006) [2023-12-27 19:38:15,916][106226] Updated weights for policy 0, policy_version 56612 (0.0008) [2023-12-27 19:38:16,136][106225] Updated weights for policy 1, policy_version 56819 (0.0008) [2023-12-27 19:38:16,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 29048832. Throughput: 0: 9858.1, 1: 10025.2. Samples: 29040388. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:16,175][105115] Avg episode reward: [(0, '-6.140'), (1, '-6.893')] [2023-12-27 19:38:16,185][106225] Updated weights for policy 1, policy_version 56829 (0.0008) [2023-12-27 19:38:16,236][106225] Updated weights for policy 1, policy_version 56839 (0.0008) [2023-12-27 19:38:16,479][106226] Updated weights for policy 0, policy_version 56622 (0.0006) [2023-12-27 19:38:16,527][106226] Updated weights for policy 0, policy_version 56632 (0.0005) [2023-12-27 19:38:16,576][106226] Updated weights for policy 0, policy_version 56642 (0.0007) [2023-12-27 19:38:16,954][106225] Updated weights for policy 1, policy_version 56849 (0.0009) [2023-12-27 19:38:17,004][106225] Updated weights for policy 1, policy_version 56859 (0.0007) [2023-12-27 19:38:17,058][106225] Updated weights for policy 1, policy_version 56869 (0.0008) [2023-12-27 19:38:17,110][106225] Updated weights for policy 1, policy_version 56879 (0.0008) [2023-12-27 19:38:17,269][106226] Updated weights for policy 0, policy_version 56652 (0.0010) [2023-12-27 19:38:17,325][106226] Updated weights for policy 0, policy_version 56662 (0.0011) [2023-12-27 19:38:17,370][106226] Updated weights for policy 0, policy_version 56672 (0.0010) [2023-12-27 19:38:17,868][106225] Updated weights for policy 1, policy_version 56889 (0.0008) [2023-12-27 19:38:17,932][106225] Updated weights for policy 1, policy_version 56899 (0.0008) [2023-12-27 19:38:17,995][106225] Updated weights for policy 1, policy_version 56909 (0.0008) [2023-12-27 19:38:18,103][106226] Updated weights for policy 0, policy_version 56682 (0.0010) [2023-12-27 19:38:18,166][106226] Updated weights for policy 0, policy_version 56692 (0.0011) [2023-12-27 19:38:18,229][106226] Updated weights for policy 0, policy_version 56702 (0.0010) [2023-12-27 19:38:18,296][106226] Updated weights for policy 0, policy_version 56712 (0.0010) [2023-12-27 19:38:18,651][106225] Updated weights for policy 1, policy_version 56919 (0.0008) [2023-12-27 19:38:18,715][106225] Updated weights for policy 1, policy_version 56929 (0.0008) [2023-12-27 19:38:18,779][106225] Updated weights for policy 1, policy_version 56939 (0.0007) [2023-12-27 19:38:19,003][106226] Updated weights for policy 0, policy_version 56722 (0.0008) [2023-12-27 19:38:19,062][106226] Updated weights for policy 0, policy_version 56732 (0.0009) [2023-12-27 19:38:19,118][106226] Updated weights for policy 0, policy_version 56742 (0.0008) [2023-12-27 19:38:19,506][106225] Updated weights for policy 1, policy_version 56949 (0.0008) [2023-12-27 19:38:19,571][106225] Updated weights for policy 1, policy_version 56959 (0.0006) [2023-12-27 19:38:19,633][106225] Updated weights for policy 1, policy_version 56969 (0.0008) [2023-12-27 19:38:19,887][106226] Updated weights for policy 0, policy_version 56753 (0.0009) [2023-12-27 19:38:19,950][106226] Updated weights for policy 0, policy_version 56763 (0.0009) [2023-12-27 19:38:20,007][106226] Updated weights for policy 0, policy_version 56773 (0.0009) [2023-12-27 19:38:20,324][106225] Updated weights for policy 1, policy_version 56979 (0.0008) [2023-12-27 19:38:20,395][106225] Updated weights for policy 1, policy_version 56989 (0.0011) [2023-12-27 19:38:20,457][106225] Updated weights for policy 1, policy_version 56999 (0.0011) [2023-12-27 19:38:20,784][106226] Updated weights for policy 0, policy_version 56783 (0.0008) [2023-12-27 19:38:20,853][106226] Updated weights for policy 0, policy_version 56793 (0.0008) [2023-12-27 19:38:20,914][106226] Updated weights for policy 0, policy_version 56803 (0.0008) [2023-12-27 19:38:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 29147136. Throughput: 0: 9810.1, 1: 10001.8. Samples: 29157272. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:21,175][105115] Avg episode reward: [(0, '-6.362'), (1, '-6.344')] [2023-12-27 19:38:21,197][106225] Updated weights for policy 1, policy_version 57009 (0.0010) [2023-12-27 19:38:21,259][106225] Updated weights for policy 1, policy_version 57019 (0.0011) [2023-12-27 19:38:21,321][106225] Updated weights for policy 1, policy_version 57029 (0.0011) [2023-12-27 19:38:21,387][106225] Updated weights for policy 1, policy_version 57039 (0.0010) [2023-12-27 19:38:21,714][106226] Updated weights for policy 0, policy_version 56813 (0.0007) [2023-12-27 19:38:21,785][106226] Updated weights for policy 0, policy_version 56823 (0.0009) [2023-12-27 19:38:21,852][106226] Updated weights for policy 0, policy_version 56833 (0.0007) [2023-12-27 19:38:22,147][106225] Updated weights for policy 1, policy_version 57049 (0.0010) [2023-12-27 19:38:22,206][106225] Updated weights for policy 1, policy_version 57059 (0.0010) [2023-12-27 19:38:22,267][106225] Updated weights for policy 1, policy_version 57069 (0.0010) [2023-12-27 19:38:22,576][106226] Updated weights for policy 0, policy_version 56843 (0.0007) [2023-12-27 19:38:22,642][106226] Updated weights for policy 0, policy_version 56853 (0.0009) [2023-12-27 19:38:22,706][106226] Updated weights for policy 0, policy_version 56863 (0.0008) [2023-12-27 19:38:22,993][106225] Updated weights for policy 1, policy_version 57079 (0.0009) [2023-12-27 19:38:23,056][106225] Updated weights for policy 1, policy_version 57089 (0.0008) [2023-12-27 19:38:23,118][106225] Updated weights for policy 1, policy_version 57099 (0.0008) [2023-12-27 19:38:23,440][106226] Updated weights for policy 0, policy_version 56873 (0.0008) [2023-12-27 19:38:23,496][106226] Updated weights for policy 0, policy_version 56883 (0.0008) [2023-12-27 19:38:23,553][106226] Updated weights for policy 0, policy_version 56893 (0.0008) [2023-12-27 19:38:23,599][106226] Updated weights for policy 0, policy_version 56903 (0.0009) [2023-12-27 19:38:23,832][106225] Updated weights for policy 1, policy_version 57109 (0.0009) [2023-12-27 19:38:23,883][106225] Updated weights for policy 1, policy_version 57119 (0.0006) [2023-12-27 19:38:23,932][106225] Updated weights for policy 1, policy_version 57129 (0.0006) [2023-12-27 19:38:24,239][106226] Updated weights for policy 0, policy_version 56913 (0.0008) [2023-12-27 19:38:24,288][106226] Updated weights for policy 0, policy_version 56923 (0.0008) [2023-12-27 19:38:24,337][106226] Updated weights for policy 0, policy_version 56933 (0.0007) [2023-12-27 19:38:24,600][106225] Updated weights for policy 1, policy_version 57139 (0.0009) [2023-12-27 19:38:24,664][106225] Updated weights for policy 1, policy_version 57149 (0.0010) [2023-12-27 19:38:24,723][106225] Updated weights for policy 1, policy_version 57159 (0.0010) [2023-12-27 19:38:25,066][106226] Updated weights for policy 0, policy_version 56943 (0.0009) [2023-12-27 19:38:25,115][106226] Updated weights for policy 0, policy_version 56953 (0.0010) [2023-12-27 19:38:25,160][106226] Updated weights for policy 0, policy_version 56963 (0.0010) [2023-12-27 19:38:25,416][106225] Updated weights for policy 1, policy_version 57169 (0.0010) [2023-12-27 19:38:25,466][106225] Updated weights for policy 1, policy_version 57179 (0.0010) [2023-12-27 19:38:25,515][106225] Updated weights for policy 1, policy_version 57189 (0.0010) [2023-12-27 19:38:25,570][106225] Updated weights for policy 1, policy_version 57199 (0.0010) [2023-12-27 19:38:25,893][106226] Updated weights for policy 0, policy_version 56973 (0.0010) [2023-12-27 19:38:25,943][106226] Updated weights for policy 0, policy_version 56983 (0.0008) [2023-12-27 19:38:25,994][106226] Updated weights for policy 0, policy_version 56993 (0.0005) [2023-12-27 19:38:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 29245440. Throughput: 0: 9804.9, 1: 9975.1. Samples: 29214616. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:26,176][105115] Avg episode reward: [(0, '-6.514'), (1, '-7.102')] [2023-12-27 19:38:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000057000_14598144.pth... [2023-12-27 19:38:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000057200_14647296.pth... [2023-12-27 19:38:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000055848_14303232.pth [2023-12-27 19:38:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000056048_14352384.pth [2023-12-27 19:38:26,282][106225] Updated weights for policy 1, policy_version 57209 (0.0010) [2023-12-27 19:38:26,339][106225] Updated weights for policy 1, policy_version 57219 (0.0010) [2023-12-27 19:38:26,396][106225] Updated weights for policy 1, policy_version 57229 (0.0010) [2023-12-27 19:38:26,704][106226] Updated weights for policy 0, policy_version 57003 (0.0010) [2023-12-27 19:38:26,757][106226] Updated weights for policy 0, policy_version 57013 (0.0010) [2023-12-27 19:38:26,809][106226] Updated weights for policy 0, policy_version 57023 (0.0011) [2023-12-27 19:38:27,019][106225] Updated weights for policy 1, policy_version 57239 (0.0010) [2023-12-27 19:38:27,068][106225] Updated weights for policy 1, policy_version 57249 (0.0009) [2023-12-27 19:38:27,115][106225] Updated weights for policy 1, policy_version 57259 (0.0008) [2023-12-27 19:38:27,505][106226] Updated weights for policy 0, policy_version 57033 (0.0008) [2023-12-27 19:38:27,556][106226] Updated weights for policy 0, policy_version 57043 (0.0008) [2023-12-27 19:38:27,599][106226] Updated weights for policy 0, policy_version 57053 (0.0008) [2023-12-27 19:38:27,650][106226] Updated weights for policy 0, policy_version 57063 (0.0008) [2023-12-27 19:38:27,810][106225] Updated weights for policy 1, policy_version 57269 (0.0008) [2023-12-27 19:38:27,868][106225] Updated weights for policy 1, policy_version 57279 (0.0008) [2023-12-27 19:38:27,919][106225] Updated weights for policy 1, policy_version 57289 (0.0008) [2023-12-27 19:38:28,373][106226] Updated weights for policy 0, policy_version 57073 (0.0008) [2023-12-27 19:38:28,429][106226] Updated weights for policy 0, policy_version 57083 (0.0009) [2023-12-27 19:38:28,490][106226] Updated weights for policy 0, policy_version 57093 (0.0009) [2023-12-27 19:38:28,653][106225] Updated weights for policy 1, policy_version 57299 (0.0008) [2023-12-27 19:38:28,715][106225] Updated weights for policy 1, policy_version 57309 (0.0009) [2023-12-27 19:38:28,771][106225] Updated weights for policy 1, policy_version 57319 (0.0008) [2023-12-27 19:38:29,209][106226] Updated weights for policy 0, policy_version 57103 (0.0008) [2023-12-27 19:38:29,270][106226] Updated weights for policy 0, policy_version 57113 (0.0009) [2023-12-27 19:38:29,324][106226] Updated weights for policy 0, policy_version 57123 (0.0007) [2023-12-27 19:38:29,539][106225] Updated weights for policy 1, policy_version 57329 (0.0009) [2023-12-27 19:38:29,604][106225] Updated weights for policy 1, policy_version 57339 (0.0010) [2023-12-27 19:38:29,674][106225] Updated weights for policy 1, policy_version 57349 (0.0009) [2023-12-27 19:38:29,733][106225] Updated weights for policy 1, policy_version 57359 (0.0009) [2023-12-27 19:38:29,946][106226] Updated weights for policy 0, policy_version 57133 (0.0008) [2023-12-27 19:38:30,005][106226] Updated weights for policy 0, policy_version 57143 (0.0009) [2023-12-27 19:38:30,056][106226] Updated weights for policy 0, policy_version 57153 (0.0009) [2023-12-27 19:38:30,453][106225] Updated weights for policy 1, policy_version 57369 (0.0006) [2023-12-27 19:38:30,506][106225] Updated weights for policy 1, policy_version 57379 (0.0005) [2023-12-27 19:38:30,563][106225] Updated weights for policy 1, policy_version 57389 (0.0005) [2023-12-27 19:38:30,819][106226] Updated weights for policy 0, policy_version 57163 (0.0008) [2023-12-27 19:38:30,879][106226] Updated weights for policy 0, policy_version 57173 (0.0005) [2023-12-27 19:38:30,936][106226] Updated weights for policy 0, policy_version 57183 (0.0007) [2023-12-27 19:38:31,164][106225] Updated weights for policy 1, policy_version 57399 (0.0007) [2023-12-27 19:38:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 29343744. Throughput: 0: 9834.5, 1: 10030.1. Samples: 29333856. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:31,175][105115] Avg episode reward: [(0, '-6.570'), (1, '-6.603')] [2023-12-27 19:38:31,228][106225] Updated weights for policy 1, policy_version 57409 (0.0008) [2023-12-27 19:38:31,288][106225] Updated weights for policy 1, policy_version 57419 (0.0007) [2023-12-27 19:38:31,656][106226] Updated weights for policy 0, policy_version 57193 (0.0008) [2023-12-27 19:38:31,727][106226] Updated weights for policy 0, policy_version 57203 (0.0010) [2023-12-27 19:38:31,795][106226] Updated weights for policy 0, policy_version 57213 (0.0011) [2023-12-27 19:38:31,848][106226] Updated weights for policy 0, policy_version 57223 (0.0010) [2023-12-27 19:38:31,948][106225] Updated weights for policy 1, policy_version 57429 (0.0007) [2023-12-27 19:38:32,007][106225] Updated weights for policy 1, policy_version 57439 (0.0005) [2023-12-27 19:38:32,074][106225] Updated weights for policy 1, policy_version 57449 (0.0009) [2023-12-27 19:38:32,587][106226] Updated weights for policy 0, policy_version 57233 (0.0008) [2023-12-27 19:38:32,650][106226] Updated weights for policy 0, policy_version 57243 (0.0010) [2023-12-27 19:38:32,716][106226] Updated weights for policy 0, policy_version 57253 (0.0008) [2023-12-27 19:38:32,728][106225] Updated weights for policy 1, policy_version 57459 (0.0010) [2023-12-27 19:38:32,779][106225] Updated weights for policy 1, policy_version 57469 (0.0010) [2023-12-27 19:38:32,846][106225] Updated weights for policy 1, policy_version 57479 (0.0010) [2023-12-27 19:38:33,265][106226] Updated weights for policy 0, policy_version 57263 (0.0005) [2023-12-27 19:38:33,322][106226] Updated weights for policy 0, policy_version 57273 (0.0005) [2023-12-27 19:38:33,385][106226] Updated weights for policy 0, policy_version 57283 (0.0005) [2023-12-27 19:38:33,545][106225] Updated weights for policy 1, policy_version 57489 (0.0010) [2023-12-27 19:38:33,595][106225] Updated weights for policy 1, policy_version 57499 (0.0010) [2023-12-27 19:38:33,642][106225] Updated weights for policy 1, policy_version 57509 (0.0010) [2023-12-27 19:38:33,689][106225] Updated weights for policy 1, policy_version 57519 (0.0010) [2023-12-27 19:38:33,874][106226] Updated weights for policy 0, policy_version 57293 (0.0005) [2023-12-27 19:38:33,921][106226] Updated weights for policy 0, policy_version 57303 (0.0005) [2023-12-27 19:38:33,966][106226] Updated weights for policy 0, policy_version 57313 (0.0005) [2023-12-27 19:38:34,502][106225] Updated weights for policy 1, policy_version 57529 (0.0009) [2023-12-27 19:38:34,562][106225] Updated weights for policy 1, policy_version 57539 (0.0009) [2023-12-27 19:38:34,627][106225] Updated weights for policy 1, policy_version 57549 (0.0008) [2023-12-27 19:38:34,702][106226] Updated weights for policy 0, policy_version 57323 (0.0006) [2023-12-27 19:38:34,765][106226] Updated weights for policy 0, policy_version 57333 (0.0009) [2023-12-27 19:38:34,830][106226] Updated weights for policy 0, policy_version 57343 (0.0007) [2023-12-27 19:38:35,338][106225] Updated weights for policy 1, policy_version 57559 (0.0008) [2023-12-27 19:38:35,394][106225] Updated weights for policy 1, policy_version 57569 (0.0008) [2023-12-27 19:38:35,452][106225] Updated weights for policy 1, policy_version 57579 (0.0007) [2023-12-27 19:38:35,530][106226] Updated weights for policy 0, policy_version 57353 (0.0010) [2023-12-27 19:38:35,599][106226] Updated weights for policy 0, policy_version 57363 (0.0011) [2023-12-27 19:38:35,651][106226] Updated weights for policy 0, policy_version 57373 (0.0010) [2023-12-27 19:38:35,708][106226] Updated weights for policy 0, policy_version 57383 (0.0010) [2023-12-27 19:38:36,139][106225] Updated weights for policy 1, policy_version 57589 (0.0007) [2023-12-27 19:38:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 29442048. Throughput: 0: 9858.5, 1: 9961.7. Samples: 29455512. Policy #0 lag: (min: 6.0, avg: 14.1, max: 38.0) [2023-12-27 19:38:36,175][105115] Avg episode reward: [(0, '-6.650'), (1, '-6.448')] [2023-12-27 19:38:36,206][106225] Updated weights for policy 1, policy_version 57599 (0.0007) [2023-12-27 19:38:36,272][106225] Updated weights for policy 1, policy_version 57609 (0.0005) [2023-12-27 19:38:36,426][106226] Updated weights for policy 0, policy_version 57393 (0.0010) [2023-12-27 19:38:36,490][106226] Updated weights for policy 0, policy_version 57403 (0.0009) [2023-12-27 19:38:36,556][106226] Updated weights for policy 0, policy_version 57413 (0.0007) [2023-12-27 19:38:37,000][106225] Updated weights for policy 1, policy_version 57619 (0.0007) [2023-12-27 19:38:37,054][106225] Updated weights for policy 1, policy_version 57629 (0.0007) [2023-12-27 19:38:37,118][106225] Updated weights for policy 1, policy_version 57639 (0.0008) [2023-12-27 19:38:37,194][106226] Updated weights for policy 0, policy_version 57423 (0.0011) [2023-12-27 19:38:37,244][106226] Updated weights for policy 0, policy_version 57433 (0.0010) [2023-12-27 19:38:37,299][106226] Updated weights for policy 0, policy_version 57443 (0.0009) [2023-12-27 19:38:37,897][106225] Updated weights for policy 1, policy_version 57649 (0.0007) [2023-12-27 19:38:37,926][106226] Updated weights for policy 0, policy_version 57453 (0.0011) [2023-12-27 19:38:37,947][106225] Updated weights for policy 1, policy_version 57659 (0.0006) [2023-12-27 19:38:37,986][106226] Updated weights for policy 0, policy_version 57463 (0.0010) [2023-12-27 19:38:38,011][106225] Updated weights for policy 1, policy_version 57669 (0.0005) [2023-12-27 19:38:38,043][106226] Updated weights for policy 0, policy_version 57473 (0.0010) [2023-12-27 19:38:38,068][106225] Updated weights for policy 1, policy_version 57679 (0.0005) [2023-12-27 19:38:38,762][106226] Updated weights for policy 0, policy_version 57483 (0.0009) [2023-12-27 19:38:38,821][106226] Updated weights for policy 0, policy_version 57493 (0.0006) [2023-12-27 19:38:38,835][106225] Updated weights for policy 1, policy_version 57689 (0.0009) [2023-12-27 19:38:38,886][106226] Updated weights for policy 0, policy_version 57503 (0.0008) [2023-12-27 19:38:38,899][106225] Updated weights for policy 1, policy_version 57699 (0.0008) [2023-12-27 19:38:38,961][106225] Updated weights for policy 1, policy_version 57709 (0.0008) [2023-12-27 19:38:39,610][106226] Updated weights for policy 0, policy_version 57513 (0.0006) [2023-12-27 19:38:39,665][106226] Updated weights for policy 0, policy_version 57523 (0.0005) [2023-12-27 19:38:39,723][106226] Updated weights for policy 0, policy_version 57533 (0.0006) [2023-12-27 19:38:39,729][106225] Updated weights for policy 1, policy_version 57719 (0.0008) [2023-12-27 19:38:39,782][106226] Updated weights for policy 0, policy_version 57543 (0.0006) [2023-12-27 19:38:39,785][106225] Updated weights for policy 1, policy_version 57729 (0.0007) [2023-12-27 19:38:39,844][106225] Updated weights for policy 1, policy_version 57739 (0.0008) [2023-12-27 19:38:40,395][106226] Updated weights for policy 0, policy_version 57553 (0.0008) [2023-12-27 19:38:40,448][106226] Updated weights for policy 0, policy_version 57563 (0.0009) [2023-12-27 19:38:40,504][106226] Updated weights for policy 0, policy_version 57573 (0.0008) [2023-12-27 19:38:40,645][106225] Updated weights for policy 1, policy_version 57749 (0.0009) [2023-12-27 19:38:40,698][106225] Updated weights for policy 1, policy_version 57759 (0.0009) [2023-12-27 19:38:40,750][106225] Updated weights for policy 1, policy_version 57769 (0.0008) [2023-12-27 19:38:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 29540352. Throughput: 0: 9902.6, 1: 9941.8. Samples: 29513772. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:38:41,175][105115] Avg episode reward: [(0, '-6.744'), (1, '-6.325')] [2023-12-27 19:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000057776_14794752.pth... [2023-12-27 19:38:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000056624_14499840.pth [2023-12-27 19:38:41,238][106226] Updated weights for policy 0, policy_version 57583 (0.0008) [2023-12-27 19:38:41,302][106226] Updated weights for policy 0, policy_version 57593 (0.0008) [2023-12-27 19:38:41,363][106226] Updated weights for policy 0, policy_version 57603 (0.0009) [2023-12-27 19:38:41,404][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000057608_14753792.pth... [2023-12-27 19:38:41,409][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000056424_14450688.pth [2023-12-27 19:38:41,577][106225] Updated weights for policy 1, policy_version 57779 (0.0008) [2023-12-27 19:38:41,632][106225] Updated weights for policy 1, policy_version 57789 (0.0008) [2023-12-27 19:38:41,695][106225] Updated weights for policy 1, policy_version 57799 (0.0010) [2023-12-27 19:38:42,093][106226] Updated weights for policy 0, policy_version 57613 (0.0009) [2023-12-27 19:38:42,147][106226] Updated weights for policy 0, policy_version 57623 (0.0008) [2023-12-27 19:38:42,210][106226] Updated weights for policy 0, policy_version 57633 (0.0006) [2023-12-27 19:38:42,506][106225] Updated weights for policy 1, policy_version 57809 (0.0009) [2023-12-27 19:38:42,573][106225] Updated weights for policy 1, policy_version 57819 (0.0009) [2023-12-27 19:38:42,629][106225] Updated weights for policy 1, policy_version 57829 (0.0009) [2023-12-27 19:38:42,688][106225] Updated weights for policy 1, policy_version 57839 (0.0008) [2023-12-27 19:38:42,909][106226] Updated weights for policy 0, policy_version 57643 (0.0009) [2023-12-27 19:38:42,968][106226] Updated weights for policy 0, policy_version 57653 (0.0008) [2023-12-27 19:38:43,022][106226] Updated weights for policy 0, policy_version 57663 (0.0008) [2023-12-27 19:38:43,343][106225] Updated weights for policy 1, policy_version 57849 (0.0008) [2023-12-27 19:38:43,401][106225] Updated weights for policy 1, policy_version 57859 (0.0008) [2023-12-27 19:38:43,459][106225] Updated weights for policy 1, policy_version 57869 (0.0006) [2023-12-27 19:38:43,742][106226] Updated weights for policy 0, policy_version 57673 (0.0008) [2023-12-27 19:38:43,797][106226] Updated weights for policy 0, policy_version 57683 (0.0005) [2023-12-27 19:38:43,856][106226] Updated weights for policy 0, policy_version 57693 (0.0005) [2023-12-27 19:38:43,905][106226] Updated weights for policy 0, policy_version 57703 (0.0005) [2023-12-27 19:38:44,072][106225] Updated weights for policy 1, policy_version 57879 (0.0007) [2023-12-27 19:38:44,133][106225] Updated weights for policy 1, policy_version 57889 (0.0008) [2023-12-27 19:38:44,198][106225] Updated weights for policy 1, policy_version 57899 (0.0007) [2023-12-27 19:38:44,494][106226] Updated weights for policy 0, policy_version 57713 (0.0007) [2023-12-27 19:38:44,547][106226] Updated weights for policy 0, policy_version 57723 (0.0007) [2023-12-27 19:38:44,616][106226] Updated weights for policy 0, policy_version 57733 (0.0008) [2023-12-27 19:38:44,858][106225] Updated weights for policy 1, policy_version 57909 (0.0008) [2023-12-27 19:38:44,922][106225] Updated weights for policy 1, policy_version 57919 (0.0006) [2023-12-27 19:38:44,985][106225] Updated weights for policy 1, policy_version 57929 (0.0007) [2023-12-27 19:38:45,349][106226] Updated weights for policy 0, policy_version 57743 (0.0008) [2023-12-27 19:38:45,412][106226] Updated weights for policy 0, policy_version 57753 (0.0009) [2023-12-27 19:38:45,466][106226] Updated weights for policy 0, policy_version 57763 (0.0009) [2023-12-27 19:38:45,633][106225] Updated weights for policy 1, policy_version 57939 (0.0008) [2023-12-27 19:38:45,689][106225] Updated weights for policy 1, policy_version 57949 (0.0007) [2023-12-27 19:38:45,741][106225] Updated weights for policy 1, policy_version 57959 (0.0006) [2023-12-27 19:38:46,074][106226] Updated weights for policy 0, policy_version 57773 (0.0007) [2023-12-27 19:38:46,126][106226] Updated weights for policy 0, policy_version 57783 (0.0005) [2023-12-27 19:38:46,171][106226] Updated weights for policy 0, policy_version 57793 (0.0006) [2023-12-27 19:38:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 29638656. Throughput: 0: 9894.1, 1: 9802.0. Samples: 29630720. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:38:46,175][105115] Avg episode reward: [(0, '-6.705'), (1, '-6.566')] [2023-12-27 19:38:46,523][106225] Updated weights for policy 1, policy_version 57969 (0.0008) [2023-12-27 19:38:46,575][106225] Updated weights for policy 1, policy_version 57979 (0.0008) [2023-12-27 19:38:46,624][106225] Updated weights for policy 1, policy_version 57989 (0.0010) [2023-12-27 19:38:46,672][106225] Updated weights for policy 1, policy_version 57999 (0.0006) [2023-12-27 19:38:46,793][106226] Updated weights for policy 0, policy_version 57803 (0.0006) [2023-12-27 19:38:46,858][106226] Updated weights for policy 0, policy_version 57813 (0.0010) [2023-12-27 19:38:46,911][106226] Updated weights for policy 0, policy_version 57823 (0.0008) [2023-12-27 19:38:47,310][106225] Updated weights for policy 1, policy_version 58009 (0.0008) [2023-12-27 19:38:47,371][106225] Updated weights for policy 1, policy_version 58019 (0.0007) [2023-12-27 19:38:47,429][106225] Updated weights for policy 1, policy_version 58029 (0.0005) [2023-12-27 19:38:47,664][106226] Updated weights for policy 0, policy_version 57833 (0.0009) [2023-12-27 19:38:47,722][106226] Updated weights for policy 0, policy_version 57843 (0.0010) [2023-12-27 19:38:47,770][106226] Updated weights for policy 0, policy_version 57853 (0.0008) [2023-12-27 19:38:47,820][106226] Updated weights for policy 0, policy_version 57863 (0.0008) [2023-12-27 19:38:47,989][106225] Updated weights for policy 1, policy_version 58039 (0.0007) [2023-12-27 19:38:48,040][106225] Updated weights for policy 1, policy_version 58049 (0.0010) [2023-12-27 19:38:48,086][106225] Updated weights for policy 1, policy_version 58059 (0.0009) [2023-12-27 19:38:48,525][106226] Updated weights for policy 0, policy_version 57873 (0.0006) [2023-12-27 19:38:48,582][106226] Updated weights for policy 0, policy_version 57883 (0.0006) [2023-12-27 19:38:48,640][106226] Updated weights for policy 0, policy_version 57893 (0.0005) [2023-12-27 19:38:48,819][106225] Updated weights for policy 1, policy_version 58069 (0.0010) [2023-12-27 19:38:48,875][106225] Updated weights for policy 1, policy_version 58079 (0.0009) [2023-12-27 19:38:48,931][106225] Updated weights for policy 1, policy_version 58089 (0.0005) [2023-12-27 19:38:49,254][106226] Updated weights for policy 0, policy_version 57903 (0.0008) [2023-12-27 19:38:49,311][106226] Updated weights for policy 0, policy_version 57913 (0.0008) [2023-12-27 19:38:49,385][106226] Updated weights for policy 0, policy_version 57923 (0.0008) [2023-12-27 19:38:49,655][106225] Updated weights for policy 1, policy_version 58099 (0.0006) [2023-12-27 19:38:49,706][106225] Updated weights for policy 1, policy_version 58109 (0.0007) [2023-12-27 19:38:49,763][106225] Updated weights for policy 1, policy_version 58119 (0.0008) [2023-12-27 19:38:50,178][106226] Updated weights for policy 0, policy_version 57933 (0.0009) [2023-12-27 19:38:50,242][106226] Updated weights for policy 0, policy_version 57943 (0.0009) [2023-12-27 19:38:50,299][106226] Updated weights for policy 0, policy_version 57953 (0.0009) [2023-12-27 19:38:50,374][106225] Updated weights for policy 1, policy_version 58129 (0.0007) [2023-12-27 19:38:50,424][106225] Updated weights for policy 1, policy_version 58139 (0.0008) [2023-12-27 19:38:50,485][106225] Updated weights for policy 1, policy_version 58149 (0.0008) [2023-12-27 19:38:50,541][106225] Updated weights for policy 1, policy_version 58159 (0.0009) [2023-12-27 19:38:51,063][106226] Updated weights for policy 0, policy_version 57963 (0.0009) [2023-12-27 19:38:51,123][106226] Updated weights for policy 0, policy_version 57973 (0.0006) [2023-12-27 19:38:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 29736960. Throughput: 0: 9865.4, 1: 9814.3. Samples: 29751548. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:38:51,175][105115] Avg episode reward: [(0, '-6.439'), (1, '-6.408')] [2023-12-27 19:38:51,193][106226] Updated weights for policy 0, policy_version 57983 (0.0010) [2023-12-27 19:38:51,287][106225] Updated weights for policy 1, policy_version 58169 (0.0007) [2023-12-27 19:38:51,345][106225] Updated weights for policy 1, policy_version 58179 (0.0009) [2023-12-27 19:38:51,422][106225] Updated weights for policy 1, policy_version 58189 (0.0009) [2023-12-27 19:38:51,957][106226] Updated weights for policy 0, policy_version 57993 (0.0009) [2023-12-27 19:38:52,017][106226] Updated weights for policy 0, policy_version 58003 (0.0009) [2023-12-27 19:38:52,082][106226] Updated weights for policy 0, policy_version 58013 (0.0009) [2023-12-27 19:38:52,137][106226] Updated weights for policy 0, policy_version 58023 (0.0008) [2023-12-27 19:38:52,181][106225] Updated weights for policy 1, policy_version 58199 (0.0008) [2023-12-27 19:38:52,247][106225] Updated weights for policy 1, policy_version 58209 (0.0008) [2023-12-27 19:38:52,309][106225] Updated weights for policy 1, policy_version 58219 (0.0008) [2023-12-27 19:38:52,901][106225] Updated weights for policy 1, policy_version 58229 (0.0006) [2023-12-27 19:38:52,913][106226] Updated weights for policy 0, policy_version 58033 (0.0008) [2023-12-27 19:38:52,962][106225] Updated weights for policy 1, policy_version 58239 (0.0005) [2023-12-27 19:38:52,973][106226] Updated weights for policy 0, policy_version 58043 (0.0006) [2023-12-27 19:38:53,010][106225] Updated weights for policy 1, policy_version 58249 (0.0007) [2023-12-27 19:38:53,028][106226] Updated weights for policy 0, policy_version 58053 (0.0007) [2023-12-27 19:38:53,596][106225] Updated weights for policy 1, policy_version 58259 (0.0007) [2023-12-27 19:38:53,644][106225] Updated weights for policy 1, policy_version 58269 (0.0008) [2023-12-27 19:38:53,698][106225] Updated weights for policy 1, policy_version 58279 (0.0005) [2023-12-27 19:38:53,791][106226] Updated weights for policy 0, policy_version 58063 (0.0008) [2023-12-27 19:38:53,862][106226] Updated weights for policy 0, policy_version 58073 (0.0008) [2023-12-27 19:38:53,927][106226] Updated weights for policy 0, policy_version 58083 (0.0009) [2023-12-27 19:38:54,290][106225] Updated weights for policy 1, policy_version 58289 (0.0005) [2023-12-27 19:38:54,344][106225] Updated weights for policy 1, policy_version 58299 (0.0005) [2023-12-27 19:38:54,406][106225] Updated weights for policy 1, policy_version 58309 (0.0006) [2023-12-27 19:38:54,460][106225] Updated weights for policy 1, policy_version 58319 (0.0008) [2023-12-27 19:38:54,702][106226] Updated weights for policy 0, policy_version 58093 (0.0008) [2023-12-27 19:38:54,765][106226] Updated weights for policy 0, policy_version 58103 (0.0009) [2023-12-27 19:38:54,818][106226] Updated weights for policy 0, policy_version 58113 (0.0009) [2023-12-27 19:38:55,105][106225] Updated weights for policy 1, policy_version 58329 (0.0009) [2023-12-27 19:38:55,160][106225] Updated weights for policy 1, policy_version 58339 (0.0008) [2023-12-27 19:38:55,218][106225] Updated weights for policy 1, policy_version 58349 (0.0008) [2023-12-27 19:38:55,541][106226] Updated weights for policy 0, policy_version 58123 (0.0010) [2023-12-27 19:38:55,593][106226] Updated weights for policy 0, policy_version 58133 (0.0008) [2023-12-27 19:38:55,642][106226] Updated weights for policy 0, policy_version 58143 (0.0009) [2023-12-27 19:38:55,871][106225] Updated weights for policy 1, policy_version 58359 (0.0006) [2023-12-27 19:38:55,926][106225] Updated weights for policy 1, policy_version 58369 (0.0005) [2023-12-27 19:38:55,981][106225] Updated weights for policy 1, policy_version 58379 (0.0006) [2023-12-27 19:38:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 29843456. Throughput: 0: 9813.7, 1: 9820.5. Samples: 29810468. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:38:56,175][105115] Avg episode reward: [(0, '-6.162'), (1, '-6.329')] [2023-12-27 19:38:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000058152_14893056.pth... [2023-12-27 19:38:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000058384_14950400.pth... [2023-12-27 19:38:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000057000_14598144.pth [2023-12-27 19:38:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000057200_14647296.pth [2023-12-27 19:38:56,338][106226] Updated weights for policy 0, policy_version 58153 (0.0006) [2023-12-27 19:38:56,382][106226] Updated weights for policy 0, policy_version 58163 (0.0008) [2023-12-27 19:38:56,437][106226] Updated weights for policy 0, policy_version 58173 (0.0007) [2023-12-27 19:38:56,490][106226] Updated weights for policy 0, policy_version 58183 (0.0005) [2023-12-27 19:38:56,663][106225] Updated weights for policy 1, policy_version 58389 (0.0009) [2023-12-27 19:38:56,724][106225] Updated weights for policy 1, policy_version 58399 (0.0008) [2023-12-27 19:38:56,783][106225] Updated weights for policy 1, policy_version 58410 (0.0007) [2023-12-27 19:38:57,174][106226] Updated weights for policy 0, policy_version 58193 (0.0008) [2023-12-27 19:38:57,236][106226] Updated weights for policy 0, policy_version 58203 (0.0008) [2023-12-27 19:38:57,291][106226] Updated weights for policy 0, policy_version 58213 (0.0007) [2023-12-27 19:38:57,405][106225] Updated weights for policy 1, policy_version 58420 (0.0007) [2023-12-27 19:38:57,461][106225] Updated weights for policy 1, policy_version 58430 (0.0010) [2023-12-27 19:38:57,520][106225] Updated weights for policy 1, policy_version 58440 (0.0010) [2023-12-27 19:38:57,944][106226] Updated weights for policy 0, policy_version 58223 (0.0009) [2023-12-27 19:38:58,004][106226] Updated weights for policy 0, policy_version 58233 (0.0007) [2023-12-27 19:38:58,072][106226] Updated weights for policy 0, policy_version 58243 (0.0007) [2023-12-27 19:38:58,152][106225] Updated weights for policy 1, policy_version 58450 (0.0009) [2023-12-27 19:38:58,223][106225] Updated weights for policy 1, policy_version 58460 (0.0006) [2023-12-27 19:38:58,291][106225] Updated weights for policy 1, policy_version 58470 (0.0010) [2023-12-27 19:38:58,365][106225] Updated weights for policy 1, policy_version 58480 (0.0009) [2023-12-27 19:38:58,751][106226] Updated weights for policy 0, policy_version 58253 (0.0010) [2023-12-27 19:38:58,815][106226] Updated weights for policy 0, policy_version 58263 (0.0009) [2023-12-27 19:38:58,892][106226] Updated weights for policy 0, policy_version 58273 (0.0009) [2023-12-27 19:38:59,078][106225] Updated weights for policy 1, policy_version 58490 (0.0007) [2023-12-27 19:38:59,134][106225] Updated weights for policy 1, policy_version 58500 (0.0007) [2023-12-27 19:38:59,193][106225] Updated weights for policy 1, policy_version 58510 (0.0008) [2023-12-27 19:38:59,646][106226] Updated weights for policy 0, policy_version 58283 (0.0010) [2023-12-27 19:38:59,706][106226] Updated weights for policy 0, policy_version 58293 (0.0010) [2023-12-27 19:38:59,770][106226] Updated weights for policy 0, policy_version 58303 (0.0011) [2023-12-27 19:38:59,923][106225] Updated weights for policy 1, policy_version 58520 (0.0009) [2023-12-27 19:38:59,990][106225] Updated weights for policy 1, policy_version 58530 (0.0008) [2023-12-27 19:39:00,046][106225] Updated weights for policy 1, policy_version 58540 (0.0008) [2023-12-27 19:39:00,369][106226] Updated weights for policy 0, policy_version 58313 (0.0009) [2023-12-27 19:39:00,418][106226] Updated weights for policy 0, policy_version 58323 (0.0005) [2023-12-27 19:39:00,472][106226] Updated weights for policy 0, policy_version 58333 (0.0005) [2023-12-27 19:39:00,526][106226] Updated weights for policy 0, policy_version 58343 (0.0005) [2023-12-27 19:39:00,741][106225] Updated weights for policy 1, policy_version 58550 (0.0009) [2023-12-27 19:39:00,785][106225] Updated weights for policy 1, policy_version 58560 (0.0008) [2023-12-27 19:39:00,830][106225] Updated weights for policy 1, policy_version 58570 (0.0005) [2023-12-27 19:39:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 29941760. Throughput: 0: 9897.9, 1: 9910.7. Samples: 29931780. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:39:01,176][105115] Avg episode reward: [(0, '-6.778'), (1, '-6.573')] [2023-12-27 19:39:01,178][106226] Updated weights for policy 0, policy_version 58353 (0.0009) [2023-12-27 19:39:01,246][106226] Updated weights for policy 0, policy_version 58363 (0.0008) [2023-12-27 19:39:01,307][106226] Updated weights for policy 0, policy_version 58373 (0.0010) [2023-12-27 19:39:01,535][106225] Updated weights for policy 1, policy_version 58580 (0.0005) [2023-12-27 19:39:01,581][106225] Updated weights for policy 1, policy_version 58590 (0.0005) [2023-12-27 19:39:01,636][106225] Updated weights for policy 1, policy_version 58600 (0.0007) [2023-12-27 19:39:02,030][106226] Updated weights for policy 0, policy_version 58383 (0.0007) [2023-12-27 19:39:02,099][106226] Updated weights for policy 0, policy_version 58393 (0.0006) [2023-12-27 19:39:02,167][106226] Updated weights for policy 0, policy_version 58403 (0.0005) [2023-12-27 19:39:02,326][106225] Updated weights for policy 1, policy_version 58610 (0.0007) [2023-12-27 19:39:02,394][106225] Updated weights for policy 1, policy_version 58620 (0.0008) [2023-12-27 19:39:02,454][106225] Updated weights for policy 1, policy_version 58630 (0.0008) [2023-12-27 19:39:02,510][106225] Updated weights for policy 1, policy_version 58640 (0.0009) [2023-12-27 19:39:02,771][106226] Updated weights for policy 0, policy_version 58413 (0.0007) [2023-12-27 19:39:02,823][106226] Updated weights for policy 0, policy_version 58423 (0.0008) [2023-12-27 19:39:02,886][106226] Updated weights for policy 0, policy_version 58433 (0.0008) [2023-12-27 19:39:03,162][106225] Updated weights for policy 1, policy_version 58650 (0.0005) [2023-12-27 19:39:03,210][106225] Updated weights for policy 1, policy_version 58660 (0.0005) [2023-12-27 19:39:03,271][106225] Updated weights for policy 1, policy_version 58670 (0.0008) [2023-12-27 19:39:03,588][106226] Updated weights for policy 0, policy_version 58443 (0.0008) [2023-12-27 19:39:03,653][106226] Updated weights for policy 0, policy_version 58453 (0.0005) [2023-12-27 19:39:03,706][106226] Updated weights for policy 0, policy_version 58463 (0.0005) [2023-12-27 19:39:03,878][106225] Updated weights for policy 1, policy_version 58680 (0.0007) [2023-12-27 19:39:03,942][106225] Updated weights for policy 1, policy_version 58690 (0.0008) [2023-12-27 19:39:04,006][106225] Updated weights for policy 1, policy_version 58700 (0.0006) [2023-12-27 19:39:04,426][106226] Updated weights for policy 0, policy_version 58473 (0.0007) [2023-12-27 19:39:04,483][106226] Updated weights for policy 0, policy_version 58483 (0.0010) [2023-12-27 19:39:04,535][106226] Updated weights for policy 0, policy_version 58493 (0.0009) [2023-12-27 19:39:04,582][106226] Updated weights for policy 0, policy_version 58503 (0.0009) [2023-12-27 19:39:04,593][106225] Updated weights for policy 1, policy_version 58710 (0.0006) [2023-12-27 19:39:04,655][106225] Updated weights for policy 1, policy_version 58720 (0.0009) [2023-12-27 19:39:04,718][106225] Updated weights for policy 1, policy_version 58730 (0.0007) [2023-12-27 19:39:05,380][106226] Updated weights for policy 0, policy_version 58513 (0.0006) [2023-12-27 19:39:05,446][106226] Updated weights for policy 0, policy_version 58523 (0.0005) [2023-12-27 19:39:05,470][106225] Updated weights for policy 1, policy_version 58740 (0.0006) [2023-12-27 19:39:05,508][106226] Updated weights for policy 0, policy_version 58533 (0.0006) [2023-12-27 19:39:05,525][106225] Updated weights for policy 1, policy_version 58750 (0.0005) [2023-12-27 19:39:05,576][106225] Updated weights for policy 1, policy_version 58760 (0.0009) [2023-12-27 19:39:06,160][106226] Updated weights for policy 0, policy_version 58543 (0.0008) [2023-12-27 19:39:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 30040064. Throughput: 0: 9957.2, 1: 9965.5. Samples: 30053796. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:39:06,175][105115] Avg episode reward: [(0, '-6.372'), (1, '-6.427')] [2023-12-27 19:39:06,217][106226] Updated weights for policy 0, policy_version 58553 (0.0009) [2023-12-27 19:39:06,270][106226] Updated weights for policy 0, policy_version 58563 (0.0009) [2023-12-27 19:39:06,298][106225] Updated weights for policy 1, policy_version 58770 (0.0008) [2023-12-27 19:39:06,355][106225] Updated weights for policy 1, policy_version 58780 (0.0008) [2023-12-27 19:39:06,407][106225] Updated weights for policy 1, policy_version 58790 (0.0008) [2023-12-27 19:39:06,468][106225] Updated weights for policy 1, policy_version 58800 (0.0008) [2023-12-27 19:39:06,959][106226] Updated weights for policy 0, policy_version 58573 (0.0007) [2023-12-27 19:39:07,024][106226] Updated weights for policy 0, policy_version 58583 (0.0005) [2023-12-27 19:39:07,089][106226] Updated weights for policy 0, policy_version 58593 (0.0011) [2023-12-27 19:39:07,277][106225] Updated weights for policy 1, policy_version 58810 (0.0008) [2023-12-27 19:39:07,333][106225] Updated weights for policy 1, policy_version 58820 (0.0008) [2023-12-27 19:39:07,390][106225] Updated weights for policy 1, policy_version 58830 (0.0005) [2023-12-27 19:39:07,777][106226] Updated weights for policy 0, policy_version 58603 (0.0009) [2023-12-27 19:39:07,839][106226] Updated weights for policy 0, policy_version 58613 (0.0005) [2023-12-27 19:39:07,903][106226] Updated weights for policy 0, policy_version 58623 (0.0010) [2023-12-27 19:39:08,116][106225] Updated weights for policy 1, policy_version 58840 (0.0007) [2023-12-27 19:39:08,170][106225] Updated weights for policy 1, policy_version 58850 (0.0009) [2023-12-27 19:39:08,219][106225] Updated weights for policy 1, policy_version 58860 (0.0008) [2023-12-27 19:39:08,436][106226] Updated weights for policy 0, policy_version 58633 (0.0010) [2023-12-27 19:39:08,501][106226] Updated weights for policy 0, policy_version 58643 (0.0010) [2023-12-27 19:39:08,562][106226] Updated weights for policy 0, policy_version 58653 (0.0011) [2023-12-27 19:39:08,629][106226] Updated weights for policy 0, policy_version 58663 (0.0011) [2023-12-27 19:39:08,991][106225] Updated weights for policy 1, policy_version 58870 (0.0008) [2023-12-27 19:39:09,056][106225] Updated weights for policy 1, policy_version 58880 (0.0008) [2023-12-27 19:39:09,112][106225] Updated weights for policy 1, policy_version 58890 (0.0009) [2023-12-27 19:39:09,275][106226] Updated weights for policy 0, policy_version 58673 (0.0008) [2023-12-27 19:39:09,344][106226] Updated weights for policy 0, policy_version 58683 (0.0009) [2023-12-27 19:39:09,418][106226] Updated weights for policy 0, policy_version 58693 (0.0010) [2023-12-27 19:39:09,923][106225] Updated weights for policy 1, policy_version 58900 (0.0009) [2023-12-27 19:39:09,987][106225] Updated weights for policy 1, policy_version 58910 (0.0008) [2023-12-27 19:39:10,049][106225] Updated weights for policy 1, policy_version 58920 (0.0011) [2023-12-27 19:39:10,189][106226] Updated weights for policy 0, policy_version 58703 (0.0007) [2023-12-27 19:39:10,258][106226] Updated weights for policy 0, policy_version 58713 (0.0010) [2023-12-27 19:39:10,327][106226] Updated weights for policy 0, policy_version 58723 (0.0009) [2023-12-27 19:39:10,756][106225] Updated weights for policy 1, policy_version 58930 (0.0010) [2023-12-27 19:39:10,823][106225] Updated weights for policy 1, policy_version 58940 (0.0010) [2023-12-27 19:39:10,890][106225] Updated weights for policy 1, policy_version 58950 (0.0011) [2023-12-27 19:39:10,952][106225] Updated weights for policy 1, policy_version 58960 (0.0010) [2023-12-27 19:39:11,094][106226] Updated weights for policy 0, policy_version 58733 (0.0009) [2023-12-27 19:39:11,163][106226] Updated weights for policy 0, policy_version 58743 (0.0008) [2023-12-27 19:39:11,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 30138368. Throughput: 0: 10018.9, 1: 9965.0. Samples: 30113884. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:39:11,175][105115] Avg episode reward: [(0, '-6.878'), (1, '-5.930')] [2023-12-27 19:39:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000058960_15097856.pth... [2023-12-27 19:39:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000057776_14794752.pth [2023-12-27 19:39:11,223][106226] Updated weights for policy 0, policy_version 58753 (0.0008) [2023-12-27 19:39:11,269][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000058760_15048704.pth... [2023-12-27 19:39:11,275][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000057608_14753792.pth [2023-12-27 19:39:11,697][106225] Updated weights for policy 1, policy_version 58970 (0.0007) [2023-12-27 19:39:11,768][106225] Updated weights for policy 1, policy_version 58980 (0.0007) [2023-12-27 19:39:11,823][106225] Updated weights for policy 1, policy_version 58990 (0.0006) [2023-12-27 19:39:12,062][106226] Updated weights for policy 0, policy_version 58763 (0.0009) [2023-12-27 19:39:12,125][106226] Updated weights for policy 0, policy_version 58773 (0.0011) [2023-12-27 19:39:12,191][106226] Updated weights for policy 0, policy_version 58783 (0.0011) [2023-12-27 19:39:12,529][106225] Updated weights for policy 1, policy_version 59000 (0.0008) [2023-12-27 19:39:12,592][106225] Updated weights for policy 1, policy_version 59010 (0.0007) [2023-12-27 19:39:12,648][106225] Updated weights for policy 1, policy_version 59020 (0.0009) [2023-12-27 19:39:12,929][106226] Updated weights for policy 0, policy_version 58793 (0.0010) [2023-12-27 19:39:12,981][106226] Updated weights for policy 0, policy_version 58803 (0.0006) [2023-12-27 19:39:13,040][106226] Updated weights for policy 0, policy_version 58813 (0.0009) [2023-12-27 19:39:13,096][106226] Updated weights for policy 0, policy_version 58823 (0.0008) [2023-12-27 19:39:13,421][106225] Updated weights for policy 1, policy_version 59030 (0.0009) [2023-12-27 19:39:13,471][106225] Updated weights for policy 1, policy_version 59040 (0.0008) [2023-12-27 19:39:13,532][106225] Updated weights for policy 1, policy_version 59050 (0.0009) [2023-12-27 19:39:13,648][106226] Updated weights for policy 0, policy_version 58833 (0.0005) [2023-12-27 19:39:13,699][106226] Updated weights for policy 0, policy_version 58843 (0.0005) [2023-12-27 19:39:13,767][106226] Updated weights for policy 0, policy_version 58853 (0.0005) [2023-12-27 19:39:14,337][106225] Updated weights for policy 1, policy_version 59060 (0.0009) [2023-12-27 19:39:14,381][106226] Updated weights for policy 0, policy_version 58863 (0.0009) [2023-12-27 19:39:14,395][106225] Updated weights for policy 1, policy_version 59070 (0.0008) [2023-12-27 19:39:14,441][106226] Updated weights for policy 0, policy_version 58873 (0.0006) [2023-12-27 19:39:14,455][106225] Updated weights for policy 1, policy_version 59080 (0.0008) [2023-12-27 19:39:14,509][106226] Updated weights for policy 0, policy_version 58883 (0.0006) [2023-12-27 19:39:15,136][106226] Updated weights for policy 0, policy_version 58893 (0.0008) [2023-12-27 19:39:15,192][106225] Updated weights for policy 1, policy_version 59090 (0.0008) [2023-12-27 19:39:15,198][106226] Updated weights for policy 0, policy_version 58903 (0.0011) [2023-12-27 19:39:15,253][106225] Updated weights for policy 1, policy_version 59100 (0.0005) [2023-12-27 19:39:15,265][106226] Updated weights for policy 0, policy_version 58913 (0.0010) [2023-12-27 19:39:15,319][106225] Updated weights for policy 1, policy_version 59110 (0.0008) [2023-12-27 19:39:15,376][106225] Updated weights for policy 1, policy_version 59120 (0.0007) [2023-12-27 19:39:15,962][106226] Updated weights for policy 0, policy_version 58923 (0.0008) [2023-12-27 19:39:16,029][106226] Updated weights for policy 0, policy_version 58933 (0.0011) [2023-12-27 19:39:16,086][106226] Updated weights for policy 0, policy_version 58943 (0.0010) [2023-12-27 19:39:16,096][106225] Updated weights for policy 1, policy_version 59130 (0.0005) [2023-12-27 19:39:16,153][106225] Updated weights for policy 1, policy_version 59140 (0.0007) [2023-12-27 19:39:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 30236672. Throughput: 0: 9980.9, 1: 9873.6. Samples: 30227308. Policy #0 lag: (min: 31.0, avg: 31.4, max: 46.0) [2023-12-27 19:39:16,175][105115] Avg episode reward: [(0, '-6.262'), (1, '-6.527')] [2023-12-27 19:39:16,210][106225] Updated weights for policy 1, policy_version 59150 (0.0007) [2023-12-27 19:39:16,738][106226] Updated weights for policy 0, policy_version 58953 (0.0011) [2023-12-27 19:39:16,788][106226] Updated weights for policy 0, policy_version 58963 (0.0010) [2023-12-27 19:39:16,838][106226] Updated weights for policy 0, policy_version 58973 (0.0010) [2023-12-27 19:39:16,884][106226] Updated weights for policy 0, policy_version 58983 (0.0010) [2023-12-27 19:39:16,948][106225] Updated weights for policy 1, policy_version 59160 (0.0007) [2023-12-27 19:39:16,997][106225] Updated weights for policy 1, policy_version 59170 (0.0007) [2023-12-27 19:39:17,052][106225] Updated weights for policy 1, policy_version 59180 (0.0005) [2023-12-27 19:39:17,626][106226] Updated weights for policy 0, policy_version 58993 (0.0010) [2023-12-27 19:39:17,682][106226] Updated weights for policy 0, policy_version 59003 (0.0010) [2023-12-27 19:39:17,737][106225] Updated weights for policy 1, policy_version 59190 (0.0006) [2023-12-27 19:39:17,739][106226] Updated weights for policy 0, policy_version 59013 (0.0010) [2023-12-27 19:39:17,793][106225] Updated weights for policy 1, policy_version 59200 (0.0006) [2023-12-27 19:39:17,849][106225] Updated weights for policy 1, policy_version 59210 (0.0005) [2023-12-27 19:39:18,367][106226] Updated weights for policy 0, policy_version 59023 (0.0009) [2023-12-27 19:39:18,391][106225] Updated weights for policy 1, policy_version 59220 (0.0005) [2023-12-27 19:39:18,428][106226] Updated weights for policy 0, policy_version 59033 (0.0008) [2023-12-27 19:39:18,451][106225] Updated weights for policy 1, policy_version 59230 (0.0006) [2023-12-27 19:39:18,493][106226] Updated weights for policy 0, policy_version 59043 (0.0008) [2023-12-27 19:39:18,506][106225] Updated weights for policy 1, policy_version 59240 (0.0006) [2023-12-27 19:39:19,140][106225] Updated weights for policy 1, policy_version 59250 (0.0005) [2023-12-27 19:39:19,161][106226] Updated weights for policy 0, policy_version 59053 (0.0008) [2023-12-27 19:39:19,196][106225] Updated weights for policy 1, policy_version 59260 (0.0005) [2023-12-27 19:39:19,221][106226] Updated weights for policy 0, policy_version 59063 (0.0008) [2023-12-27 19:39:19,259][106225] Updated weights for policy 1, policy_version 59270 (0.0007) [2023-12-27 19:39:19,282][106226] Updated weights for policy 0, policy_version 59073 (0.0007) [2023-12-27 19:39:19,310][106225] Updated weights for policy 1, policy_version 59280 (0.0008) [2023-12-27 19:39:20,016][106225] Updated weights for policy 1, policy_version 59290 (0.0008) [2023-12-27 19:39:20,078][106225] Updated weights for policy 1, policy_version 59300 (0.0008) [2023-12-27 19:39:20,084][106226] Updated weights for policy 0, policy_version 59083 (0.0007) [2023-12-27 19:39:20,142][106225] Updated weights for policy 1, policy_version 59310 (0.0007) [2023-12-27 19:39:20,151][106226] Updated weights for policy 0, policy_version 59093 (0.0007) [2023-12-27 19:39:20,220][106226] Updated weights for policy 0, policy_version 59103 (0.0009) [2023-12-27 19:39:20,847][106225] Updated weights for policy 1, policy_version 59320 (0.0007) [2023-12-27 19:39:20,914][106225] Updated weights for policy 1, policy_version 59330 (0.0008) [2023-12-27 19:39:20,947][106226] Updated weights for policy 0, policy_version 59113 (0.0008) [2023-12-27 19:39:20,981][106225] Updated weights for policy 1, policy_version 59340 (0.0009) [2023-12-27 19:39:21,015][106226] Updated weights for policy 0, policy_version 59123 (0.0006) [2023-12-27 19:39:21,096][106226] Updated weights for policy 0, policy_version 59133 (0.0009) [2023-12-27 19:39:21,167][106226] Updated weights for policy 0, policy_version 59143 (0.0009) [2023-12-27 19:39:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 30343168. Throughput: 0: 9911.1, 1: 9905.4. Samples: 30347252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:21,175][105115] Avg episode reward: [(0, '-6.544'), (1, '-6.624')] [2023-12-27 19:39:21,758][106225] Updated weights for policy 1, policy_version 59350 (0.0007) [2023-12-27 19:39:21,809][106225] Updated weights for policy 1, policy_version 59360 (0.0006) [2023-12-27 19:39:21,864][106225] Updated weights for policy 1, policy_version 59370 (0.0009) [2023-12-27 19:39:21,922][106226] Updated weights for policy 0, policy_version 59153 (0.0008) [2023-12-27 19:39:21,972][106226] Updated weights for policy 0, policy_version 59163 (0.0007) [2023-12-27 19:39:22,024][106226] Updated weights for policy 0, policy_version 59173 (0.0009) [2023-12-27 19:39:22,509][106225] Updated weights for policy 1, policy_version 59380 (0.0010) [2023-12-27 19:39:22,574][106225] Updated weights for policy 1, policy_version 59390 (0.0010) [2023-12-27 19:39:22,645][106225] Updated weights for policy 1, policy_version 59400 (0.0008) [2023-12-27 19:39:22,815][106226] Updated weights for policy 0, policy_version 59183 (0.0008) [2023-12-27 19:39:22,877][106226] Updated weights for policy 0, policy_version 59193 (0.0008) [2023-12-27 19:39:22,939][106226] Updated weights for policy 0, policy_version 59203 (0.0009) [2023-12-27 19:39:23,343][106225] Updated weights for policy 1, policy_version 59410 (0.0008) [2023-12-27 19:39:23,396][106225] Updated weights for policy 1, policy_version 59420 (0.0010) [2023-12-27 19:39:23,443][106225] Updated weights for policy 1, policy_version 59430 (0.0010) [2023-12-27 19:39:23,493][106225] Updated weights for policy 1, policy_version 59440 (0.0010) [2023-12-27 19:39:23,581][106226] Updated weights for policy 0, policy_version 59213 (0.0008) [2023-12-27 19:39:23,644][106226] Updated weights for policy 0, policy_version 59223 (0.0005) [2023-12-27 19:39:23,697][106226] Updated weights for policy 0, policy_version 59233 (0.0005) [2023-12-27 19:39:24,226][106225] Updated weights for policy 1, policy_version 59450 (0.0010) [2023-12-27 19:39:24,278][106226] Updated weights for policy 0, policy_version 59243 (0.0005) [2023-12-27 19:39:24,287][106225] Updated weights for policy 1, policy_version 59460 (0.0010) [2023-12-27 19:39:24,335][106226] Updated weights for policy 0, policy_version 59253 (0.0006) [2023-12-27 19:39:24,347][106225] Updated weights for policy 1, policy_version 59470 (0.0010) [2023-12-27 19:39:24,383][106226] Updated weights for policy 0, policy_version 59263 (0.0008) [2023-12-27 19:39:25,026][106225] Updated weights for policy 1, policy_version 59480 (0.0011) [2023-12-27 19:39:25,073][106225] Updated weights for policy 1, policy_version 59490 (0.0011) [2023-12-27 19:39:25,120][106225] Updated weights for policy 1, policy_version 59500 (0.0010) [2023-12-27 19:39:25,129][106226] Updated weights for policy 0, policy_version 59273 (0.0008) [2023-12-27 19:39:25,197][106226] Updated weights for policy 0, policy_version 59283 (0.0008) [2023-12-27 19:39:25,266][106226] Updated weights for policy 0, policy_version 59293 (0.0008) [2023-12-27 19:39:25,329][106226] Updated weights for policy 0, policy_version 59303 (0.0008) [2023-12-27 19:39:25,804][106225] Updated weights for policy 1, policy_version 59510 (0.0007) [2023-12-27 19:39:25,850][106225] Updated weights for policy 1, policy_version 59520 (0.0006) [2023-12-27 19:39:25,896][106225] Updated weights for policy 1, policy_version 59530 (0.0010) [2023-12-27 19:39:25,925][106226] Updated weights for policy 0, policy_version 59313 (0.0010) [2023-12-27 19:39:25,984][106226] Updated weights for policy 0, policy_version 59323 (0.0010) [2023-12-27 19:39:26,047][106226] Updated weights for policy 0, policy_version 59333 (0.0010) [2023-12-27 19:39:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 30441472. Throughput: 0: 9895.9, 1: 9921.9. Samples: 30405568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:26,175][105115] Avg episode reward: [(0, '-6.341'), (1, '-6.080')] [2023-12-27 19:39:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000059536_15245312.pth... [2023-12-27 19:39:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000059336_15196160.pth... [2023-12-27 19:39:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000058384_14950400.pth [2023-12-27 19:39:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000058152_14893056.pth [2023-12-27 19:39:26,574][106225] Updated weights for policy 1, policy_version 59540 (0.0008) [2023-12-27 19:39:26,629][106225] Updated weights for policy 1, policy_version 59550 (0.0007) [2023-12-27 19:39:26,667][106226] Updated weights for policy 0, policy_version 59343 (0.0007) [2023-12-27 19:39:26,686][106225] Updated weights for policy 1, policy_version 59560 (0.0006) [2023-12-27 19:39:26,713][106226] Updated weights for policy 0, policy_version 59353 (0.0006) [2023-12-27 19:39:26,762][106226] Updated weights for policy 0, policy_version 59363 (0.0005) [2023-12-27 19:39:27,264][106225] Updated weights for policy 1, policy_version 59570 (0.0010) [2023-12-27 19:39:27,321][106225] Updated weights for policy 1, policy_version 59580 (0.0009) [2023-12-27 19:39:27,378][106225] Updated weights for policy 1, policy_version 59590 (0.0009) [2023-12-27 19:39:27,427][106226] Updated weights for policy 0, policy_version 59373 (0.0007) [2023-12-27 19:39:27,439][106225] Updated weights for policy 1, policy_version 59600 (0.0010) [2023-12-27 19:39:27,480][106226] Updated weights for policy 0, policy_version 59383 (0.0010) [2023-12-27 19:39:27,538][106226] Updated weights for policy 0, policy_version 59393 (0.0010) [2023-12-27 19:39:28,096][106225] Updated weights for policy 1, policy_version 59610 (0.0009) [2023-12-27 19:39:28,146][106225] Updated weights for policy 1, policy_version 59620 (0.0009) [2023-12-27 19:39:28,193][106225] Updated weights for policy 1, policy_version 59630 (0.0008) [2023-12-27 19:39:28,195][106226] Updated weights for policy 0, policy_version 59403 (0.0008) [2023-12-27 19:39:28,265][106226] Updated weights for policy 0, policy_version 59413 (0.0009) [2023-12-27 19:39:28,320][106226] Updated weights for policy 0, policy_version 59423 (0.0010) [2023-12-27 19:39:28,869][106225] Updated weights for policy 1, policy_version 59640 (0.0005) [2023-12-27 19:39:28,940][106225] Updated weights for policy 1, policy_version 59650 (0.0005) [2023-12-27 19:39:28,993][106226] Updated weights for policy 0, policy_version 59433 (0.0010) [2023-12-27 19:39:29,006][106225] Updated weights for policy 1, policy_version 59660 (0.0005) [2023-12-27 19:39:29,050][106226] Updated weights for policy 0, policy_version 59443 (0.0007) [2023-12-27 19:39:29,115][106226] Updated weights for policy 0, policy_version 59453 (0.0010) [2023-12-27 19:39:29,171][106226] Updated weights for policy 0, policy_version 59463 (0.0010) [2023-12-27 19:39:29,529][106225] Updated weights for policy 1, policy_version 59670 (0.0005) [2023-12-27 19:39:29,581][106225] Updated weights for policy 1, policy_version 59680 (0.0005) [2023-12-27 19:39:29,635][106225] Updated weights for policy 1, policy_version 59690 (0.0006) [2023-12-27 19:39:29,895][106226] Updated weights for policy 0, policy_version 59473 (0.0008) [2023-12-27 19:39:29,963][106226] Updated weights for policy 0, policy_version 59483 (0.0008) [2023-12-27 19:39:30,016][106226] Updated weights for policy 0, policy_version 59493 (0.0009) [2023-12-27 19:39:30,298][106225] Updated weights for policy 1, policy_version 59700 (0.0007) [2023-12-27 19:39:30,363][106225] Updated weights for policy 1, policy_version 59710 (0.0008) [2023-12-27 19:39:30,421][106225] Updated weights for policy 1, policy_version 59720 (0.0010) [2023-12-27 19:39:30,782][106226] Updated weights for policy 0, policy_version 59503 (0.0009) [2023-12-27 19:39:30,838][106226] Updated weights for policy 0, policy_version 59513 (0.0008) [2023-12-27 19:39:30,904][106226] Updated weights for policy 0, policy_version 59523 (0.0006) [2023-12-27 19:39:31,119][106225] Updated weights for policy 1, policy_version 59730 (0.0010) [2023-12-27 19:39:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 30539776. Throughput: 0: 9905.7, 1: 10094.7. Samples: 30530736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:31,175][105115] Avg episode reward: [(0, '-7.409'), (1, '-6.001')] [2023-12-27 19:39:31,185][106225] Updated weights for policy 1, policy_version 59740 (0.0010) [2023-12-27 19:39:31,239][106225] Updated weights for policy 1, policy_version 59750 (0.0010) [2023-12-27 19:39:31,294][106225] Updated weights for policy 1, policy_version 59760 (0.0008) [2023-12-27 19:39:31,601][106226] Updated weights for policy 0, policy_version 59533 (0.0007) [2023-12-27 19:39:31,660][106226] Updated weights for policy 0, policy_version 59543 (0.0009) [2023-12-27 19:39:31,717][106226] Updated weights for policy 0, policy_version 59553 (0.0009) [2023-12-27 19:39:32,116][106225] Updated weights for policy 1, policy_version 59770 (0.0006) [2023-12-27 19:39:32,179][106225] Updated weights for policy 1, policy_version 59780 (0.0009) [2023-12-27 19:39:32,243][106225] Updated weights for policy 1, policy_version 59790 (0.0006) [2023-12-27 19:39:32,518][106226] Updated weights for policy 0, policy_version 59563 (0.0009) [2023-12-27 19:39:32,570][106226] Updated weights for policy 0, policy_version 59573 (0.0010) [2023-12-27 19:39:32,627][106226] Updated weights for policy 0, policy_version 59583 (0.0007) [2023-12-27 19:39:32,819][106225] Updated weights for policy 1, policy_version 59800 (0.0007) [2023-12-27 19:39:32,870][106225] Updated weights for policy 1, policy_version 59810 (0.0005) [2023-12-27 19:39:32,921][106225] Updated weights for policy 1, policy_version 59820 (0.0005) [2023-12-27 19:39:33,278][106226] Updated weights for policy 0, policy_version 59593 (0.0006) [2023-12-27 19:39:33,324][106226] Updated weights for policy 0, policy_version 59603 (0.0010) [2023-12-27 19:39:33,370][106226] Updated weights for policy 0, policy_version 59613 (0.0010) [2023-12-27 19:39:33,420][106226] Updated weights for policy 0, policy_version 59623 (0.0006) [2023-12-27 19:39:33,539][106225] Updated weights for policy 1, policy_version 59830 (0.0006) [2023-12-27 19:39:33,586][106225] Updated weights for policy 1, policy_version 59840 (0.0005) [2023-12-27 19:39:33,633][106225] Updated weights for policy 1, policy_version 59850 (0.0005) [2023-12-27 19:39:34,084][106226] Updated weights for policy 0, policy_version 59633 (0.0005) [2023-12-27 19:39:34,132][106226] Updated weights for policy 0, policy_version 59643 (0.0006) [2023-12-27 19:39:34,193][106226] Updated weights for policy 0, policy_version 59653 (0.0008) [2023-12-27 19:39:34,227][106225] Updated weights for policy 1, policy_version 59860 (0.0006) [2023-12-27 19:39:34,290][106225] Updated weights for policy 1, policy_version 59870 (0.0006) [2023-12-27 19:39:34,352][106225] Updated weights for policy 1, policy_version 59880 (0.0006) [2023-12-27 19:39:34,881][106226] Updated weights for policy 0, policy_version 59663 (0.0007) [2023-12-27 19:39:34,919][106225] Updated weights for policy 1, policy_version 59890 (0.0006) [2023-12-27 19:39:34,944][106226] Updated weights for policy 0, policy_version 59673 (0.0006) [2023-12-27 19:39:34,988][106225] Updated weights for policy 1, policy_version 59900 (0.0007) [2023-12-27 19:39:35,012][106226] Updated weights for policy 0, policy_version 59683 (0.0008) [2023-12-27 19:39:35,046][106225] Updated weights for policy 1, policy_version 59910 (0.0006) [2023-12-27 19:39:35,110][106225] Updated weights for policy 1, policy_version 59920 (0.0007) [2023-12-27 19:39:35,640][106226] Updated weights for policy 0, policy_version 59693 (0.0006) [2023-12-27 19:39:35,699][106226] Updated weights for policy 0, policy_version 59703 (0.0006) [2023-12-27 19:39:35,757][106226] Updated weights for policy 0, policy_version 59713 (0.0008) [2023-12-27 19:39:35,766][106225] Updated weights for policy 1, policy_version 59930 (0.0006) [2023-12-27 19:39:35,822][106225] Updated weights for policy 1, policy_version 59940 (0.0005) [2023-12-27 19:39:35,879][106225] Updated weights for policy 1, policy_version 59950 (0.0006) [2023-12-27 19:39:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 30646272. Throughput: 0: 9939.5, 1: 10148.6. Samples: 30655512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:36,175][105115] Avg episode reward: [(0, '-6.602'), (1, '-6.378')] [2023-12-27 19:39:36,382][106226] Updated weights for policy 0, policy_version 59723 (0.0008) [2023-12-27 19:39:36,444][106226] Updated weights for policy 0, policy_version 59733 (0.0011) [2023-12-27 19:39:36,512][106226] Updated weights for policy 0, policy_version 59743 (0.0011) [2023-12-27 19:39:36,556][106225] Updated weights for policy 1, policy_version 59960 (0.0007) [2023-12-27 19:39:36,612][106225] Updated weights for policy 1, policy_version 59970 (0.0007) [2023-12-27 19:39:36,673][106225] Updated weights for policy 1, policy_version 59980 (0.0007) [2023-12-27 19:39:37,198][106226] Updated weights for policy 0, policy_version 59753 (0.0011) [2023-12-27 19:39:37,262][106226] Updated weights for policy 0, policy_version 59763 (0.0011) [2023-12-27 19:39:37,296][106225] Updated weights for policy 1, policy_version 59990 (0.0008) [2023-12-27 19:39:37,316][106226] Updated weights for policy 0, policy_version 59773 (0.0010) [2023-12-27 19:39:37,351][106225] Updated weights for policy 1, policy_version 60000 (0.0008) [2023-12-27 19:39:37,373][106226] Updated weights for policy 0, policy_version 59783 (0.0010) [2023-12-27 19:39:37,411][106225] Updated weights for policy 1, policy_version 60010 (0.0007) [2023-12-27 19:39:38,071][106225] Updated weights for policy 1, policy_version 60020 (0.0008) [2023-12-27 19:39:38,100][106226] Updated weights for policy 0, policy_version 59793 (0.0010) [2023-12-27 19:39:38,120][106225] Updated weights for policy 1, policy_version 60030 (0.0005) [2023-12-27 19:39:38,147][106226] Updated weights for policy 0, policy_version 59803 (0.0005) [2023-12-27 19:39:38,169][106225] Updated weights for policy 1, policy_version 60040 (0.0005) [2023-12-27 19:39:38,197][106226] Updated weights for policy 0, policy_version 59813 (0.0010) [2023-12-27 19:39:38,784][106225] Updated weights for policy 1, policy_version 60050 (0.0006) [2023-12-27 19:39:38,842][106225] Updated weights for policy 1, policy_version 60060 (0.0006) [2023-12-27 19:39:38,908][106225] Updated weights for policy 1, policy_version 60070 (0.0007) [2023-12-27 19:39:38,919][106226] Updated weights for policy 0, policy_version 59823 (0.0009) [2023-12-27 19:39:38,965][106225] Updated weights for policy 1, policy_version 60080 (0.0008) [2023-12-27 19:39:38,979][106226] Updated weights for policy 0, policy_version 59833 (0.0009) [2023-12-27 19:39:39,032][106226] Updated weights for policy 0, policy_version 59843 (0.0008) [2023-12-27 19:39:39,665][106225] Updated weights for policy 1, policy_version 60090 (0.0008) [2023-12-27 19:39:39,715][106225] Updated weights for policy 1, policy_version 60100 (0.0008) [2023-12-27 19:39:39,768][106226] Updated weights for policy 0, policy_version 59853 (0.0008) [2023-12-27 19:39:39,772][106225] Updated weights for policy 1, policy_version 60110 (0.0009) [2023-12-27 19:39:39,838][106226] Updated weights for policy 0, policy_version 59863 (0.0008) [2023-12-27 19:39:39,900][106226] Updated weights for policy 0, policy_version 59873 (0.0008) [2023-12-27 19:39:40,537][106225] Updated weights for policy 1, policy_version 60120 (0.0010) [2023-12-27 19:39:40,595][106225] Updated weights for policy 1, policy_version 60130 (0.0010) [2023-12-27 19:39:40,604][106226] Updated weights for policy 0, policy_version 59883 (0.0008) [2023-12-27 19:39:40,648][106225] Updated weights for policy 1, policy_version 60140 (0.0010) [2023-12-27 19:39:40,665][106226] Updated weights for policy 0, policy_version 59893 (0.0011) [2023-12-27 19:39:40,724][106226] Updated weights for policy 0, policy_version 59903 (0.0010) [2023-12-27 19:39:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 30744576. Throughput: 0: 9981.1, 1: 10154.7. Samples: 30716584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:41,175][105115] Avg episode reward: [(0, '-6.760'), (1, '-6.226')] [2023-12-27 19:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000060144_15400960.pth... [2023-12-27 19:39:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000059912_15343616.pth... [2023-12-27 19:39:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000058960_15097856.pth [2023-12-27 19:39:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000058760_15048704.pth [2023-12-27 19:39:41,464][106226] Updated weights for policy 0, policy_version 59913 (0.0008) [2023-12-27 19:39:41,465][106225] Updated weights for policy 1, policy_version 60150 (0.0009) [2023-12-27 19:39:41,521][106225] Updated weights for policy 1, policy_version 60160 (0.0006) [2023-12-27 19:39:41,526][106226] Updated weights for policy 0, policy_version 59923 (0.0011) [2023-12-27 19:39:41,584][106225] Updated weights for policy 1, policy_version 60170 (0.0006) [2023-12-27 19:39:41,584][106226] Updated weights for policy 0, policy_version 59933 (0.0011) [2023-12-27 19:39:41,646][106226] Updated weights for policy 0, policy_version 59943 (0.0009) [2023-12-27 19:39:42,316][106226] Updated weights for policy 0, policy_version 59953 (0.0010) [2023-12-27 19:39:42,391][106225] Updated weights for policy 1, policy_version 60180 (0.0007) [2023-12-27 19:39:42,392][106226] Updated weights for policy 0, policy_version 59963 (0.0010) [2023-12-27 19:39:42,454][106225] Updated weights for policy 1, policy_version 60190 (0.0008) [2023-12-27 19:39:42,458][106226] Updated weights for policy 0, policy_version 59973 (0.0009) [2023-12-27 19:39:42,512][106225] Updated weights for policy 1, policy_version 60200 (0.0008) [2023-12-27 19:39:43,175][106226] Updated weights for policy 0, policy_version 59983 (0.0009) [2023-12-27 19:39:43,236][106226] Updated weights for policy 0, policy_version 59993 (0.0006) [2023-12-27 19:39:43,265][106225] Updated weights for policy 1, policy_version 60210 (0.0008) [2023-12-27 19:39:43,302][106226] Updated weights for policy 0, policy_version 60003 (0.0005) [2023-12-27 19:39:43,318][106225] Updated weights for policy 1, policy_version 60220 (0.0008) [2023-12-27 19:39:43,374][106225] Updated weights for policy 1, policy_version 60230 (0.0007) [2023-12-27 19:39:43,424][106225] Updated weights for policy 1, policy_version 60240 (0.0009) [2023-12-27 19:39:43,830][106226] Updated weights for policy 0, policy_version 60013 (0.0005) [2023-12-27 19:39:43,884][106226] Updated weights for policy 0, policy_version 60023 (0.0006) [2023-12-27 19:39:43,942][106226] Updated weights for policy 0, policy_version 60033 (0.0005) [2023-12-27 19:39:44,207][106225] Updated weights for policy 1, policy_version 60250 (0.0008) [2023-12-27 19:39:44,264][106225] Updated weights for policy 1, policy_version 60260 (0.0008) [2023-12-27 19:39:44,318][106225] Updated weights for policy 1, policy_version 60270 (0.0008) [2023-12-27 19:39:44,512][106226] Updated weights for policy 0, policy_version 60043 (0.0005) [2023-12-27 19:39:44,567][106226] Updated weights for policy 0, policy_version 60053 (0.0007) [2023-12-27 19:39:44,620][106226] Updated weights for policy 0, policy_version 60063 (0.0008) [2023-12-27 19:39:45,066][106225] Updated weights for policy 1, policy_version 60280 (0.0007) [2023-12-27 19:39:45,128][106225] Updated weights for policy 1, policy_version 60290 (0.0009) [2023-12-27 19:39:45,194][106225] Updated weights for policy 1, policy_version 60300 (0.0008) [2023-12-27 19:39:45,323][106226] Updated weights for policy 0, policy_version 60073 (0.0007) [2023-12-27 19:39:45,384][106226] Updated weights for policy 0, policy_version 60083 (0.0008) [2023-12-27 19:39:45,453][106226] Updated weights for policy 0, policy_version 60093 (0.0008) [2023-12-27 19:39:45,512][106226] Updated weights for policy 0, policy_version 60103 (0.0009) [2023-12-27 19:39:45,894][106225] Updated weights for policy 1, policy_version 60310 (0.0008) [2023-12-27 19:39:45,955][106225] Updated weights for policy 1, policy_version 60320 (0.0008) [2023-12-27 19:39:46,010][106225] Updated weights for policy 1, policy_version 60330 (0.0009) [2023-12-27 19:39:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 30842880. Throughput: 0: 10029.5, 1: 9980.3. Samples: 30832220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:46,175][105115] Avg episode reward: [(0, '-6.594'), (1, '-6.222')] [2023-12-27 19:39:46,208][106226] Updated weights for policy 0, policy_version 60113 (0.0009) [2023-12-27 19:39:46,258][106226] Updated weights for policy 0, policy_version 60123 (0.0009) [2023-12-27 19:39:46,307][106226] Updated weights for policy 0, policy_version 60133 (0.0009) [2023-12-27 19:39:46,641][106225] Updated weights for policy 1, policy_version 60340 (0.0007) [2023-12-27 19:39:46,695][106225] Updated weights for policy 1, policy_version 60350 (0.0009) [2023-12-27 19:39:46,746][106225] Updated weights for policy 1, policy_version 60360 (0.0006) [2023-12-27 19:39:47,017][106226] Updated weights for policy 0, policy_version 60143 (0.0009) [2023-12-27 19:39:47,071][106226] Updated weights for policy 0, policy_version 60153 (0.0011) [2023-12-27 19:39:47,128][106226] Updated weights for policy 0, policy_version 60163 (0.0010) [2023-12-27 19:39:47,422][106225] Updated weights for policy 1, policy_version 60370 (0.0006) [2023-12-27 19:39:47,485][106225] Updated weights for policy 1, policy_version 60380 (0.0008) [2023-12-27 19:39:47,540][106225] Updated weights for policy 1, policy_version 60390 (0.0008) [2023-12-27 19:39:47,590][106225] Updated weights for policy 1, policy_version 60400 (0.0008) [2023-12-27 19:39:47,832][106226] Updated weights for policy 0, policy_version 60173 (0.0010) [2023-12-27 19:39:47,892][106226] Updated weights for policy 0, policy_version 60183 (0.0010) [2023-12-27 19:39:47,953][106226] Updated weights for policy 0, policy_version 60193 (0.0011) [2023-12-27 19:39:48,279][106225] Updated weights for policy 1, policy_version 60410 (0.0006) [2023-12-27 19:39:48,346][106225] Updated weights for policy 1, policy_version 60420 (0.0008) [2023-12-27 19:39:48,406][106225] Updated weights for policy 1, policy_version 60430 (0.0007) [2023-12-27 19:39:48,669][106226] Updated weights for policy 0, policy_version 60203 (0.0009) [2023-12-27 19:39:48,731][106226] Updated weights for policy 0, policy_version 60213 (0.0009) [2023-12-27 19:39:48,797][106226] Updated weights for policy 0, policy_version 60223 (0.0006) [2023-12-27 19:39:49,038][106225] Updated weights for policy 1, policy_version 60440 (0.0009) [2023-12-27 19:39:49,094][106225] Updated weights for policy 1, policy_version 60450 (0.0010) [2023-12-27 19:39:49,153][106225] Updated weights for policy 1, policy_version 60460 (0.0010) [2023-12-27 19:39:49,426][106226] Updated weights for policy 0, policy_version 60233 (0.0007) [2023-12-27 19:39:49,481][106226] Updated weights for policy 0, policy_version 60243 (0.0009) [2023-12-27 19:39:49,540][106226] Updated weights for policy 0, policy_version 60253 (0.0010) [2023-12-27 19:39:49,594][106226] Updated weights for policy 0, policy_version 60263 (0.0010) [2023-12-27 19:39:49,890][106225] Updated weights for policy 1, policy_version 60470 (0.0008) [2023-12-27 19:39:49,956][106225] Updated weights for policy 1, policy_version 60480 (0.0008) [2023-12-27 19:39:50,007][106225] Updated weights for policy 1, policy_version 60490 (0.0007) [2023-12-27 19:39:50,345][106226] Updated weights for policy 0, policy_version 60273 (0.0007) [2023-12-27 19:39:50,411][106226] Updated weights for policy 0, policy_version 60283 (0.0008) [2023-12-27 19:39:50,477][106226] Updated weights for policy 0, policy_version 60293 (0.0008) [2023-12-27 19:39:50,729][106225] Updated weights for policy 1, policy_version 60500 (0.0007) [2023-12-27 19:39:50,794][106225] Updated weights for policy 1, policy_version 60510 (0.0008) [2023-12-27 19:39:50,855][106225] Updated weights for policy 1, policy_version 60520 (0.0008) [2023-12-27 19:39:51,142][106226] Updated weights for policy 0, policy_version 60303 (0.0010) [2023-12-27 19:39:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 30941184. Throughput: 0: 9989.9, 1: 9979.6. Samples: 30952424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:39:51,175][105115] Avg episode reward: [(0, '-7.313'), (1, '-6.547')] [2023-12-27 19:39:51,204][106226] Updated weights for policy 0, policy_version 60313 (0.0008) [2023-12-27 19:39:51,268][106226] Updated weights for policy 0, policy_version 60323 (0.0008) [2023-12-27 19:39:51,575][106225] Updated weights for policy 1, policy_version 60530 (0.0006) [2023-12-27 19:39:51,639][106225] Updated weights for policy 1, policy_version 60540 (0.0007) [2023-12-27 19:39:51,703][106225] Updated weights for policy 1, policy_version 60550 (0.0008) [2023-12-27 19:39:51,776][106225] Updated weights for policy 1, policy_version 60560 (0.0008) [2023-12-27 19:39:52,083][106226] Updated weights for policy 0, policy_version 60333 (0.0008) [2023-12-27 19:39:52,143][106226] Updated weights for policy 0, policy_version 60343 (0.0007) [2023-12-27 19:39:52,205][106226] Updated weights for policy 0, policy_version 60353 (0.0007) [2023-12-27 19:39:52,430][106225] Updated weights for policy 1, policy_version 60570 (0.0007) [2023-12-27 19:39:52,491][106225] Updated weights for policy 1, policy_version 60580 (0.0006) [2023-12-27 19:39:52,547][106225] Updated weights for policy 1, policy_version 60590 (0.0008) [2023-12-27 19:39:52,966][106226] Updated weights for policy 0, policy_version 60363 (0.0009) [2023-12-27 19:39:53,028][106226] Updated weights for policy 0, policy_version 60373 (0.0010) [2023-12-27 19:39:53,083][106226] Updated weights for policy 0, policy_version 60383 (0.0010) [2023-12-27 19:39:53,260][106225] Updated weights for policy 1, policy_version 60600 (0.0008) [2023-12-27 19:39:53,313][106225] Updated weights for policy 1, policy_version 60610 (0.0008) [2023-12-27 19:39:53,362][106225] Updated weights for policy 1, policy_version 60620 (0.0007) [2023-12-27 19:39:53,713][106226] Updated weights for policy 0, policy_version 60393 (0.0010) [2023-12-27 19:39:53,766][106226] Updated weights for policy 0, policy_version 60403 (0.0005) [2023-12-27 19:39:53,814][106226] Updated weights for policy 0, policy_version 60413 (0.0005) [2023-12-27 19:39:53,870][106226] Updated weights for policy 0, policy_version 60423 (0.0006) [2023-12-27 19:39:54,177][106225] Updated weights for policy 1, policy_version 60630 (0.0009) [2023-12-27 19:39:54,228][106225] Updated weights for policy 1, policy_version 60640 (0.0008) [2023-12-27 19:39:54,283][106225] Updated weights for policy 1, policy_version 60650 (0.0008) [2023-12-27 19:39:54,540][106226] Updated weights for policy 0, policy_version 60433 (0.0008) [2023-12-27 19:39:54,599][106226] Updated weights for policy 0, policy_version 60443 (0.0009) [2023-12-27 19:39:54,678][106226] Updated weights for policy 0, policy_version 60453 (0.0008) [2023-12-27 19:39:55,008][106225] Updated weights for policy 1, policy_version 60660 (0.0007) [2023-12-27 19:39:55,065][106225] Updated weights for policy 1, policy_version 60670 (0.0007) [2023-12-27 19:39:55,115][106225] Updated weights for policy 1, policy_version 60680 (0.0008) [2023-12-27 19:39:55,341][106226] Updated weights for policy 0, policy_version 60463 (0.0005) [2023-12-27 19:39:55,393][106226] Updated weights for policy 0, policy_version 60473 (0.0006) [2023-12-27 19:39:55,444][106226] Updated weights for policy 0, policy_version 60483 (0.0005) [2023-12-27 19:39:55,764][106225] Updated weights for policy 1, policy_version 60690 (0.0007) [2023-12-27 19:39:55,815][106225] Updated weights for policy 1, policy_version 60700 (0.0005) [2023-12-27 19:39:55,863][106225] Updated weights for policy 1, policy_version 60710 (0.0005) [2023-12-27 19:39:55,916][106225] Updated weights for policy 1, policy_version 60720 (0.0005) [2023-12-27 19:39:56,027][106226] Updated weights for policy 0, policy_version 60493 (0.0005) [2023-12-27 19:39:56,081][106226] Updated weights for policy 0, policy_version 60503 (0.0007) [2023-12-27 19:39:56,136][106226] Updated weights for policy 0, policy_version 60513 (0.0009) [2023-12-27 19:39:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 31047680. Throughput: 0: 9928.7, 1: 9988.1. Samples: 31010140. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:39:56,175][105115] Avg episode reward: [(0, '-6.691'), (1, '-6.163')] [2023-12-27 19:39:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000060720_15548416.pth... [2023-12-27 19:39:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000060520_15499264.pth... [2023-12-27 19:39:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000059536_15245312.pth [2023-12-27 19:39:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000059336_15196160.pth [2023-12-27 19:39:56,529][106225] Updated weights for policy 1, policy_version 60730 (0.0005) [2023-12-27 19:39:56,588][106225] Updated weights for policy 1, policy_version 60740 (0.0007) [2023-12-27 19:39:56,636][106225] Updated weights for policy 1, policy_version 60750 (0.0006) [2023-12-27 19:39:56,924][106226] Updated weights for policy 0, policy_version 60523 (0.0008) [2023-12-27 19:39:56,971][106226] Updated weights for policy 0, policy_version 60533 (0.0008) [2023-12-27 19:39:57,021][106226] Updated weights for policy 0, policy_version 60543 (0.0007) [2023-12-27 19:39:57,210][106225] Updated weights for policy 1, policy_version 60760 (0.0005) [2023-12-27 19:39:57,262][106225] Updated weights for policy 1, policy_version 60770 (0.0005) [2023-12-27 19:39:57,311][106225] Updated weights for policy 1, policy_version 60780 (0.0005) [2023-12-27 19:39:57,794][106226] Updated weights for policy 0, policy_version 60553 (0.0009) [2023-12-27 19:39:57,874][106226] Updated weights for policy 0, policy_version 60563 (0.0007) [2023-12-27 19:39:57,930][106226] Updated weights for policy 0, policy_version 60573 (0.0008) [2023-12-27 19:39:57,941][106225] Updated weights for policy 1, policy_version 60790 (0.0010) [2023-12-27 19:39:57,984][106226] Updated weights for policy 0, policy_version 60583 (0.0007) [2023-12-27 19:39:57,993][106225] Updated weights for policy 1, policy_version 60800 (0.0010) [2023-12-27 19:39:58,048][106225] Updated weights for policy 1, policy_version 60810 (0.0009) [2023-12-27 19:39:58,752][106225] Updated weights for policy 1, policy_version 60820 (0.0007) [2023-12-27 19:39:58,762][106226] Updated weights for policy 0, policy_version 60593 (0.0010) [2023-12-27 19:39:58,820][106225] Updated weights for policy 1, policy_version 60830 (0.0007) [2023-12-27 19:39:58,828][106226] Updated weights for policy 0, policy_version 60603 (0.0009) [2023-12-27 19:39:58,884][106225] Updated weights for policy 1, policy_version 60840 (0.0009) [2023-12-27 19:39:58,901][106226] Updated weights for policy 0, policy_version 60613 (0.0007) [2023-12-27 19:39:59,658][106226] Updated weights for policy 0, policy_version 60623 (0.0006) [2023-12-27 19:39:59,659][106225] Updated weights for policy 1, policy_version 60850 (0.0008) [2023-12-27 19:39:59,720][106225] Updated weights for policy 1, policy_version 60860 (0.0007) [2023-12-27 19:39:59,721][106226] Updated weights for policy 0, policy_version 60633 (0.0009) [2023-12-27 19:39:59,775][106225] Updated weights for policy 1, policy_version 60870 (0.0008) [2023-12-27 19:39:59,779][106226] Updated weights for policy 0, policy_version 60643 (0.0007) [2023-12-27 19:39:59,831][106225] Updated weights for policy 1, policy_version 60880 (0.0007) [2023-12-27 19:40:00,367][106226] Updated weights for policy 0, policy_version 60653 (0.0007) [2023-12-27 19:40:00,426][106226] Updated weights for policy 0, policy_version 60663 (0.0011) [2023-12-27 19:40:00,486][106226] Updated weights for policy 0, policy_version 60673 (0.0010) [2023-12-27 19:40:00,609][106225] Updated weights for policy 1, policy_version 60890 (0.0008) [2023-12-27 19:40:00,658][106225] Updated weights for policy 1, policy_version 60900 (0.0007) [2023-12-27 19:40:00,710][106225] Updated weights for policy 1, policy_version 60910 (0.0008) [2023-12-27 19:40:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 31137792. Throughput: 0: 9924.9, 1: 10117.0. Samples: 31129192. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:01,175][105115] Avg episode reward: [(0, '-6.944'), (1, '-6.132')] [2023-12-27 19:40:01,202][106226] Updated weights for policy 0, policy_version 60683 (0.0011) [2023-12-27 19:40:01,259][106226] Updated weights for policy 0, policy_version 60693 (0.0009) [2023-12-27 19:40:01,323][106226] Updated weights for policy 0, policy_version 60703 (0.0009) [2023-12-27 19:40:01,477][106225] Updated weights for policy 1, policy_version 60920 (0.0008) [2023-12-27 19:40:01,540][106225] Updated weights for policy 1, policy_version 60930 (0.0009) [2023-12-27 19:40:01,604][106225] Updated weights for policy 1, policy_version 60940 (0.0008) [2023-12-27 19:40:02,105][106226] Updated weights for policy 0, policy_version 60713 (0.0009) [2023-12-27 19:40:02,171][106226] Updated weights for policy 0, policy_version 60723 (0.0009) [2023-12-27 19:40:02,240][106226] Updated weights for policy 0, policy_version 60733 (0.0009) [2023-12-27 19:40:02,296][106225] Updated weights for policy 1, policy_version 60950 (0.0008) [2023-12-27 19:40:02,308][106226] Updated weights for policy 0, policy_version 60743 (0.0008) [2023-12-27 19:40:02,367][106225] Updated weights for policy 1, policy_version 60960 (0.0008) [2023-12-27 19:40:02,435][106225] Updated weights for policy 1, policy_version 60970 (0.0008) [2023-12-27 19:40:03,000][106226] Updated weights for policy 0, policy_version 60753 (0.0005) [2023-12-27 19:40:03,059][106226] Updated weights for policy 0, policy_version 60763 (0.0005) [2023-12-27 19:40:03,077][106225] Updated weights for policy 1, policy_version 60980 (0.0008) [2023-12-27 19:40:03,122][106226] Updated weights for policy 0, policy_version 60773 (0.0005) [2023-12-27 19:40:03,136][106225] Updated weights for policy 1, policy_version 60990 (0.0008) [2023-12-27 19:40:03,188][106225] Updated weights for policy 1, policy_version 61000 (0.0008) [2023-12-27 19:40:03,642][106226] Updated weights for policy 0, policy_version 60783 (0.0007) [2023-12-27 19:40:03,689][106226] Updated weights for policy 0, policy_version 60793 (0.0009) [2023-12-27 19:40:03,739][106226] Updated weights for policy 0, policy_version 60803 (0.0008) [2023-12-27 19:40:03,851][106225] Updated weights for policy 1, policy_version 61010 (0.0008) [2023-12-27 19:40:03,916][106225] Updated weights for policy 1, policy_version 61020 (0.0006) [2023-12-27 19:40:03,978][106225] Updated weights for policy 1, policy_version 61030 (0.0005) [2023-12-27 19:40:04,035][106225] Updated weights for policy 1, policy_version 61040 (0.0005) [2023-12-27 19:40:04,422][106226] Updated weights for policy 0, policy_version 60813 (0.0010) [2023-12-27 19:40:04,484][106226] Updated weights for policy 0, policy_version 60823 (0.0010) [2023-12-27 19:40:04,541][106226] Updated weights for policy 0, policy_version 60833 (0.0010) [2023-12-27 19:40:04,623][106225] Updated weights for policy 1, policy_version 61050 (0.0008) [2023-12-27 19:40:04,671][106225] Updated weights for policy 1, policy_version 61060 (0.0008) [2023-12-27 19:40:04,730][106225] Updated weights for policy 1, policy_version 61070 (0.0008) [2023-12-27 19:40:05,227][106226] Updated weights for policy 0, policy_version 60843 (0.0010) [2023-12-27 19:40:05,290][106226] Updated weights for policy 0, policy_version 60853 (0.0010) [2023-12-27 19:40:05,347][106226] Updated weights for policy 0, policy_version 60863 (0.0010) [2023-12-27 19:40:05,489][106225] Updated weights for policy 1, policy_version 61080 (0.0007) [2023-12-27 19:40:05,551][106225] Updated weights for policy 1, policy_version 61090 (0.0008) [2023-12-27 19:40:05,612][106225] Updated weights for policy 1, policy_version 61100 (0.0008) [2023-12-27 19:40:06,099][106226] Updated weights for policy 0, policy_version 60873 (0.0010) [2023-12-27 19:40:06,166][106226] Updated weights for policy 0, policy_version 60883 (0.0010) [2023-12-27 19:40:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 31236096. Throughput: 0: 9980.8, 1: 10077.7. Samples: 31249884. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:06,175][105115] Avg episode reward: [(0, '-6.773'), (1, '-6.035')] [2023-12-27 19:40:06,238][106226] Updated weights for policy 0, policy_version 60893 (0.0011) [2023-12-27 19:40:06,296][106226] Updated weights for policy 0, policy_version 60903 (0.0011) [2023-12-27 19:40:06,365][106225] Updated weights for policy 1, policy_version 61110 (0.0008) [2023-12-27 19:40:06,428][106225] Updated weights for policy 1, policy_version 61120 (0.0010) [2023-12-27 19:40:06,487][106225] Updated weights for policy 1, policy_version 61130 (0.0010) [2023-12-27 19:40:06,964][106226] Updated weights for policy 0, policy_version 60913 (0.0006) [2023-12-27 19:40:07,023][106226] Updated weights for policy 0, policy_version 60923 (0.0006) [2023-12-27 19:40:07,077][106226] Updated weights for policy 0, policy_version 60933 (0.0005) [2023-12-27 19:40:07,124][106225] Updated weights for policy 1, policy_version 61140 (0.0010) [2023-12-27 19:40:07,178][106225] Updated weights for policy 1, policy_version 61150 (0.0010) [2023-12-27 19:40:07,228][106225] Updated weights for policy 1, policy_version 61160 (0.0010) [2023-12-27 19:40:07,681][106226] Updated weights for policy 0, policy_version 60943 (0.0007) [2023-12-27 19:40:07,739][106226] Updated weights for policy 0, policy_version 60953 (0.0010) [2023-12-27 19:40:07,791][106226] Updated weights for policy 0, policy_version 60963 (0.0008) [2023-12-27 19:40:07,896][106225] Updated weights for policy 1, policy_version 61170 (0.0009) [2023-12-27 19:40:07,950][106225] Updated weights for policy 1, policy_version 61180 (0.0009) [2023-12-27 19:40:08,005][106225] Updated weights for policy 1, policy_version 61190 (0.0006) [2023-12-27 19:40:08,058][106225] Updated weights for policy 1, policy_version 61200 (0.0009) [2023-12-27 19:40:08,342][106226] Updated weights for policy 0, policy_version 60973 (0.0007) [2023-12-27 19:40:08,412][106226] Updated weights for policy 0, policy_version 60983 (0.0011) [2023-12-27 19:40:08,470][106226] Updated weights for policy 0, policy_version 60993 (0.0011) [2023-12-27 19:40:08,784][106225] Updated weights for policy 1, policy_version 61210 (0.0010) [2023-12-27 19:40:08,843][106225] Updated weights for policy 1, policy_version 61220 (0.0010) [2023-12-27 19:40:08,905][106225] Updated weights for policy 1, policy_version 61230 (0.0010) [2023-12-27 19:40:09,162][106226] Updated weights for policy 0, policy_version 61003 (0.0009) [2023-12-27 19:40:09,223][106226] Updated weights for policy 0, policy_version 61013 (0.0006) [2023-12-27 19:40:09,290][106226] Updated weights for policy 0, policy_version 61023 (0.0009) [2023-12-27 19:40:09,612][106225] Updated weights for policy 1, policy_version 61240 (0.0010) [2023-12-27 19:40:09,676][106225] Updated weights for policy 1, policy_version 61250 (0.0010) [2023-12-27 19:40:09,744][106225] Updated weights for policy 1, policy_version 61260 (0.0011) [2023-12-27 19:40:10,011][106226] Updated weights for policy 0, policy_version 61033 (0.0009) [2023-12-27 19:40:10,072][106226] Updated weights for policy 0, policy_version 61043 (0.0010) [2023-12-27 19:40:10,133][106226] Updated weights for policy 0, policy_version 61053 (0.0011) [2023-12-27 19:40:10,191][106226] Updated weights for policy 0, policy_version 61063 (0.0010) [2023-12-27 19:40:10,445][106225] Updated weights for policy 1, policy_version 61270 (0.0011) [2023-12-27 19:40:10,500][106225] Updated weights for policy 1, policy_version 61280 (0.0010) [2023-12-27 19:40:10,552][106225] Updated weights for policy 1, policy_version 61290 (0.0005) [2023-12-27 19:40:10,930][106226] Updated weights for policy 0, policy_version 61073 (0.0008) [2023-12-27 19:40:10,988][106226] Updated weights for policy 0, policy_version 61083 (0.0006) [2023-12-27 19:40:11,050][106226] Updated weights for policy 0, policy_version 61093 (0.0007) [2023-12-27 19:40:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 31342592. Throughput: 0: 10042.2, 1: 10114.4. Samples: 31312616. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:11,175][105115] Avg episode reward: [(0, '-6.694'), (1, '-6.207')] [2023-12-27 19:40:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000061296_15695872.pth... [2023-12-27 19:40:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000061096_15646720.pth... [2023-12-27 19:40:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000060144_15400960.pth [2023-12-27 19:40:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000059912_15343616.pth [2023-12-27 19:40:11,267][106225] Updated weights for policy 1, policy_version 61300 (0.0006) [2023-12-27 19:40:11,331][106225] Updated weights for policy 1, policy_version 61310 (0.0009) [2023-12-27 19:40:11,401][106225] Updated weights for policy 1, policy_version 61320 (0.0009) [2023-12-27 19:40:11,783][106226] Updated weights for policy 0, policy_version 61103 (0.0006) [2023-12-27 19:40:11,845][106226] Updated weights for policy 0, policy_version 61113 (0.0009) [2023-12-27 19:40:11,906][106226] Updated weights for policy 0, policy_version 61123 (0.0009) [2023-12-27 19:40:12,233][106225] Updated weights for policy 1, policy_version 61330 (0.0009) [2023-12-27 19:40:12,303][106225] Updated weights for policy 1, policy_version 61340 (0.0008) [2023-12-27 19:40:12,378][106225] Updated weights for policy 1, policy_version 61350 (0.0007) [2023-12-27 19:40:12,443][106225] Updated weights for policy 1, policy_version 61360 (0.0008) [2023-12-27 19:40:12,619][106226] Updated weights for policy 0, policy_version 61133 (0.0007) [2023-12-27 19:40:12,679][106226] Updated weights for policy 0, policy_version 61143 (0.0009) [2023-12-27 19:40:12,738][106226] Updated weights for policy 0, policy_version 61153 (0.0008) [2023-12-27 19:40:13,196][106225] Updated weights for policy 1, policy_version 61370 (0.0008) [2023-12-27 19:40:13,244][106225] Updated weights for policy 1, policy_version 61380 (0.0008) [2023-12-27 19:40:13,296][106225] Updated weights for policy 1, policy_version 61390 (0.0007) [2023-12-27 19:40:13,383][106226] Updated weights for policy 0, policy_version 61163 (0.0009) [2023-12-27 19:40:13,434][106226] Updated weights for policy 0, policy_version 61173 (0.0006) [2023-12-27 19:40:13,487][106226] Updated weights for policy 0, policy_version 61183 (0.0005) [2023-12-27 19:40:14,032][106225] Updated weights for policy 1, policy_version 61400 (0.0008) [2023-12-27 19:40:14,095][106225] Updated weights for policy 1, policy_version 61410 (0.0008) [2023-12-27 19:40:14,122][106226] Updated weights for policy 0, policy_version 61193 (0.0006) [2023-12-27 19:40:14,160][106225] Updated weights for policy 1, policy_version 61420 (0.0007) [2023-12-27 19:40:14,184][106226] Updated weights for policy 0, policy_version 61203 (0.0010) [2023-12-27 19:40:14,244][106226] Updated weights for policy 0, policy_version 61213 (0.0007) [2023-12-27 19:40:14,305][106226] Updated weights for policy 0, policy_version 61223 (0.0005) [2023-12-27 19:40:14,803][106225] Updated weights for policy 1, policy_version 61430 (0.0009) [2023-12-27 19:40:14,872][106225] Updated weights for policy 1, policy_version 61440 (0.0008) [2023-12-27 19:40:14,878][106226] Updated weights for policy 0, policy_version 61233 (0.0006) [2023-12-27 19:40:14,936][106225] Updated weights for policy 1, policy_version 61450 (0.0007) [2023-12-27 19:40:14,942][106226] Updated weights for policy 0, policy_version 61243 (0.0006) [2023-12-27 19:40:15,003][106226] Updated weights for policy 0, policy_version 61253 (0.0008) [2023-12-27 19:40:15,614][106226] Updated weights for policy 0, policy_version 61263 (0.0006) [2023-12-27 19:40:15,669][106226] Updated weights for policy 0, policy_version 61273 (0.0006) [2023-12-27 19:40:15,719][106226] Updated weights for policy 0, policy_version 61283 (0.0007) [2023-12-27 19:40:15,725][106225] Updated weights for policy 1, policy_version 61460 (0.0006) [2023-12-27 19:40:15,782][106225] Updated weights for policy 1, policy_version 61470 (0.0008) [2023-12-27 19:40:15,838][106225] Updated weights for policy 1, policy_version 61480 (0.0009) [2023-12-27 19:40:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.3, 300 sec: 19882.9). Total num frames: 31440896. Throughput: 0: 10018.4, 1: 9949.8. Samples: 31429308. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:16,176][105115] Avg episode reward: [(0, '-6.581'), (1, '-6.272')] [2023-12-27 19:40:16,360][106226] Updated weights for policy 0, policy_version 61293 (0.0007) [2023-12-27 19:40:16,416][106226] Updated weights for policy 0, policy_version 61303 (0.0008) [2023-12-27 19:40:16,475][106226] Updated weights for policy 0, policy_version 61313 (0.0009) [2023-12-27 19:40:16,593][106225] Updated weights for policy 1, policy_version 61490 (0.0008) [2023-12-27 19:40:16,641][106225] Updated weights for policy 1, policy_version 61500 (0.0007) [2023-12-27 19:40:16,693][106225] Updated weights for policy 1, policy_version 61510 (0.0008) [2023-12-27 19:40:16,747][106225] Updated weights for policy 1, policy_version 61520 (0.0008) [2023-12-27 19:40:17,227][106226] Updated weights for policy 0, policy_version 61323 (0.0008) [2023-12-27 19:40:17,283][106226] Updated weights for policy 0, policy_version 61333 (0.0009) [2023-12-27 19:40:17,342][106226] Updated weights for policy 0, policy_version 61343 (0.0009) [2023-12-27 19:40:17,409][106225] Updated weights for policy 1, policy_version 61530 (0.0008) [2023-12-27 19:40:17,467][106225] Updated weights for policy 1, policy_version 61540 (0.0008) [2023-12-27 19:40:17,521][106225] Updated weights for policy 1, policy_version 61550 (0.0008) [2023-12-27 19:40:17,993][106226] Updated weights for policy 0, policy_version 61353 (0.0006) [2023-12-27 19:40:18,059][106226] Updated weights for policy 0, policy_version 61363 (0.0006) [2023-12-27 19:40:18,116][106226] Updated weights for policy 0, policy_version 61373 (0.0005) [2023-12-27 19:40:18,147][106225] Updated weights for policy 1, policy_version 61560 (0.0008) [2023-12-27 19:40:18,176][106226] Updated weights for policy 0, policy_version 61383 (0.0007) [2023-12-27 19:40:18,199][106225] Updated weights for policy 1, policy_version 61570 (0.0007) [2023-12-27 19:40:18,248][106225] Updated weights for policy 1, policy_version 61580 (0.0009) [2023-12-27 19:40:18,833][106226] Updated weights for policy 0, policy_version 61393 (0.0009) [2023-12-27 19:40:18,895][106226] Updated weights for policy 0, policy_version 61403 (0.0011) [2023-12-27 19:40:18,952][106226] Updated weights for policy 0, policy_version 61413 (0.0010) [2023-12-27 19:40:19,021][106225] Updated weights for policy 1, policy_version 61590 (0.0007) [2023-12-27 19:40:19,078][106225] Updated weights for policy 1, policy_version 61600 (0.0008) [2023-12-27 19:40:19,137][106225] Updated weights for policy 1, policy_version 61610 (0.0007) [2023-12-27 19:40:19,735][106226] Updated weights for policy 0, policy_version 61423 (0.0009) [2023-12-27 19:40:19,800][106226] Updated weights for policy 0, policy_version 61433 (0.0008) [2023-12-27 19:40:19,866][106226] Updated weights for policy 0, policy_version 61443 (0.0008) [2023-12-27 19:40:19,950][106225] Updated weights for policy 1, policy_version 61620 (0.0008) [2023-12-27 19:40:20,012][106225] Updated weights for policy 1, policy_version 61630 (0.0006) [2023-12-27 19:40:20,068][106225] Updated weights for policy 1, policy_version 61640 (0.0006) [2023-12-27 19:40:20,540][106226] Updated weights for policy 0, policy_version 61453 (0.0008) [2023-12-27 19:40:20,612][106226] Updated weights for policy 0, policy_version 61463 (0.0008) [2023-12-27 19:40:20,675][106226] Updated weights for policy 0, policy_version 61473 (0.0009) [2023-12-27 19:40:20,745][106225] Updated weights for policy 1, policy_version 61650 (0.0007) [2023-12-27 19:40:20,809][106225] Updated weights for policy 1, policy_version 61660 (0.0008) [2023-12-27 19:40:20,869][106225] Updated weights for policy 1, policy_version 61670 (0.0008) [2023-12-27 19:40:20,933][106225] Updated weights for policy 1, policy_version 61680 (0.0008) [2023-12-27 19:40:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 31539200. Throughput: 0: 10004.8, 1: 9814.6. Samples: 31547388. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:21,175][105115] Avg episode reward: [(0, '-6.816'), (1, '-6.362')] [2023-12-27 19:40:21,466][106226] Updated weights for policy 0, policy_version 61483 (0.0007) [2023-12-27 19:40:21,525][106226] Updated weights for policy 0, policy_version 61493 (0.0008) [2023-12-27 19:40:21,583][106226] Updated weights for policy 0, policy_version 61503 (0.0007) [2023-12-27 19:40:21,703][106225] Updated weights for policy 1, policy_version 61690 (0.0008) [2023-12-27 19:40:21,768][106225] Updated weights for policy 1, policy_version 61700 (0.0009) [2023-12-27 19:40:21,820][106225] Updated weights for policy 1, policy_version 61710 (0.0008) [2023-12-27 19:40:22,315][106226] Updated weights for policy 0, policy_version 61513 (0.0007) [2023-12-27 19:40:22,388][106226] Updated weights for policy 0, policy_version 61523 (0.0008) [2023-12-27 19:40:22,452][106226] Updated weights for policy 0, policy_version 61533 (0.0009) [2023-12-27 19:40:22,519][106226] Updated weights for policy 0, policy_version 61543 (0.0009) [2023-12-27 19:40:22,581][106225] Updated weights for policy 1, policy_version 61720 (0.0009) [2023-12-27 19:40:22,645][106225] Updated weights for policy 1, policy_version 61730 (0.0008) [2023-12-27 19:40:22,701][106225] Updated weights for policy 1, policy_version 61740 (0.0009) [2023-12-27 19:40:23,203][106226] Updated weights for policy 0, policy_version 61553 (0.0005) [2023-12-27 19:40:23,257][106226] Updated weights for policy 0, policy_version 61563 (0.0005) [2023-12-27 19:40:23,304][106226] Updated weights for policy 0, policy_version 61573 (0.0005) [2023-12-27 19:40:23,482][106225] Updated weights for policy 1, policy_version 61750 (0.0008) [2023-12-27 19:40:23,542][106225] Updated weights for policy 1, policy_version 61760 (0.0009) [2023-12-27 19:40:23,602][106225] Updated weights for policy 1, policy_version 61770 (0.0008) [2023-12-27 19:40:23,864][106226] Updated weights for policy 0, policy_version 61583 (0.0005) [2023-12-27 19:40:23,915][106226] Updated weights for policy 0, policy_version 61593 (0.0005) [2023-12-27 19:40:23,965][106226] Updated weights for policy 0, policy_version 61603 (0.0005) [2023-12-27 19:40:24,362][106225] Updated weights for policy 1, policy_version 61780 (0.0008) [2023-12-27 19:40:24,423][106225] Updated weights for policy 1, policy_version 61790 (0.0006) [2023-12-27 19:40:24,479][106225] Updated weights for policy 1, policy_version 61800 (0.0005) [2023-12-27 19:40:24,510][106226] Updated weights for policy 0, policy_version 61613 (0.0008) [2023-12-27 19:40:24,575][106226] Updated weights for policy 0, policy_version 61623 (0.0009) [2023-12-27 19:40:24,634][106226] Updated weights for policy 0, policy_version 61633 (0.0008) [2023-12-27 19:40:25,176][106225] Updated weights for policy 1, policy_version 61810 (0.0006) [2023-12-27 19:40:25,227][106225] Updated weights for policy 1, policy_version 61820 (0.0009) [2023-12-27 19:40:25,281][106225] Updated weights for policy 1, policy_version 61830 (0.0008) [2023-12-27 19:40:25,288][106226] Updated weights for policy 0, policy_version 61643 (0.0008) [2023-12-27 19:40:25,325][106225] Updated weights for policy 1, policy_version 61840 (0.0006) [2023-12-27 19:40:25,349][106226] Updated weights for policy 0, policy_version 61653 (0.0007) [2023-12-27 19:40:25,415][106226] Updated weights for policy 0, policy_version 61663 (0.0008) [2023-12-27 19:40:26,074][106225] Updated weights for policy 1, policy_version 61850 (0.0009) [2023-12-27 19:40:26,103][106226] Updated weights for policy 0, policy_version 61673 (0.0009) [2023-12-27 19:40:26,129][106225] Updated weights for policy 1, policy_version 61860 (0.0007) [2023-12-27 19:40:26,155][106226] Updated weights for policy 0, policy_version 61683 (0.0008) [2023-12-27 19:40:26,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 31629312. Throughput: 0: 10039.6, 1: 9700.0. Samples: 31604860. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:26,175][105115] Avg episode reward: [(0, '-6.354'), (1, '-6.148')] [2023-12-27 19:40:26,181][106225] Updated weights for policy 1, policy_version 61870 (0.0008) [2023-12-27 19:40:26,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000061872_15843328.pth... [2023-12-27 19:40:26,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000060720_15548416.pth [2023-12-27 19:40:26,204][106226] Updated weights for policy 0, policy_version 61693 (0.0007) [2023-12-27 19:40:26,270][106226] Updated weights for policy 0, policy_version 61703 (0.0009) [2023-12-27 19:40:26,272][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000061704_15802368.pth... [2023-12-27 19:40:26,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000060520_15499264.pth [2023-12-27 19:40:26,905][106225] Updated weights for policy 1, policy_version 61880 (0.0008) [2023-12-27 19:40:26,969][106225] Updated weights for policy 1, policy_version 61890 (0.0008) [2023-12-27 19:40:26,979][106226] Updated weights for policy 0, policy_version 61713 (0.0006) [2023-12-27 19:40:27,034][106225] Updated weights for policy 1, policy_version 61900 (0.0008) [2023-12-27 19:40:27,041][106226] Updated weights for policy 0, policy_version 61723 (0.0006) [2023-12-27 19:40:27,095][106226] Updated weights for policy 0, policy_version 61733 (0.0007) [2023-12-27 19:40:27,687][106225] Updated weights for policy 1, policy_version 61910 (0.0007) [2023-12-27 19:40:27,742][106225] Updated weights for policy 1, policy_version 61920 (0.0008) [2023-12-27 19:40:27,789][106225] Updated weights for policy 1, policy_version 61930 (0.0007) [2023-12-27 19:40:27,799][106226] Updated weights for policy 0, policy_version 61743 (0.0008) [2023-12-27 19:40:27,844][106226] Updated weights for policy 0, policy_version 61753 (0.0006) [2023-12-27 19:40:27,889][106226] Updated weights for policy 0, policy_version 61763 (0.0009) [2023-12-27 19:40:28,393][106225] Updated weights for policy 1, policy_version 61940 (0.0006) [2023-12-27 19:40:28,449][106225] Updated weights for policy 1, policy_version 61950 (0.0006) [2023-12-27 19:40:28,501][106225] Updated weights for policy 1, policy_version 61960 (0.0005) [2023-12-27 19:40:28,683][106226] Updated weights for policy 0, policy_version 61773 (0.0010) [2023-12-27 19:40:28,747][106226] Updated weights for policy 0, policy_version 61783 (0.0010) [2023-12-27 19:40:28,808][106226] Updated weights for policy 0, policy_version 61793 (0.0010) [2023-12-27 19:40:29,094][106225] Updated weights for policy 1, policy_version 61970 (0.0007) [2023-12-27 19:40:29,144][106225] Updated weights for policy 1, policy_version 61980 (0.0010) [2023-12-27 19:40:29,194][106225] Updated weights for policy 1, policy_version 61990 (0.0009) [2023-12-27 19:40:29,261][106225] Updated weights for policy 1, policy_version 62000 (0.0008) [2023-12-27 19:40:29,474][106226] Updated weights for policy 0, policy_version 61803 (0.0010) [2023-12-27 19:40:29,533][106226] Updated weights for policy 0, policy_version 61813 (0.0010) [2023-12-27 19:40:29,590][106226] Updated weights for policy 0, policy_version 61823 (0.0010) [2023-12-27 19:40:30,008][106225] Updated weights for policy 1, policy_version 62010 (0.0008) [2023-12-27 19:40:30,064][106225] Updated weights for policy 1, policy_version 62020 (0.0007) [2023-12-27 19:40:30,123][106225] Updated weights for policy 1, policy_version 62030 (0.0007) [2023-12-27 19:40:30,313][106226] Updated weights for policy 0, policy_version 61833 (0.0010) [2023-12-27 19:40:30,382][106226] Updated weights for policy 0, policy_version 61843 (0.0008) [2023-12-27 19:40:30,446][106226] Updated weights for policy 0, policy_version 61853 (0.0008) [2023-12-27 19:40:30,507][106226] Updated weights for policy 0, policy_version 61863 (0.0007) [2023-12-27 19:40:30,764][106225] Updated weights for policy 1, policy_version 62040 (0.0007) [2023-12-27 19:40:30,857][106225] Updated weights for policy 1, policy_version 62050 (0.0005) [2023-12-27 19:40:30,916][106225] Updated weights for policy 1, policy_version 62060 (0.0009) [2023-12-27 19:40:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 31735808. Throughput: 0: 10026.9, 1: 9840.3. Samples: 31726248. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-27 19:40:31,175][105115] Avg episode reward: [(0, '-6.573'), (1, '-6.104')] [2023-12-27 19:40:31,218][106226] Updated weights for policy 0, policy_version 61873 (0.0006) [2023-12-27 19:40:31,287][106226] Updated weights for policy 0, policy_version 61883 (0.0006) [2023-12-27 19:40:31,352][106226] Updated weights for policy 0, policy_version 61893 (0.0009) [2023-12-27 19:40:31,553][106225] Updated weights for policy 1, policy_version 62070 (0.0006) [2023-12-27 19:40:31,618][106225] Updated weights for policy 1, policy_version 62080 (0.0006) [2023-12-27 19:40:31,686][106225] Updated weights for policy 1, policy_version 62090 (0.0007) [2023-12-27 19:40:32,100][106226] Updated weights for policy 0, policy_version 61903 (0.0009) [2023-12-27 19:40:32,155][106226] Updated weights for policy 0, policy_version 61913 (0.0008) [2023-12-27 19:40:32,221][106226] Updated weights for policy 0, policy_version 61923 (0.0006) [2023-12-27 19:40:32,367][106225] Updated weights for policy 1, policy_version 62100 (0.0008) [2023-12-27 19:40:32,415][106225] Updated weights for policy 1, policy_version 62110 (0.0008) [2023-12-27 19:40:32,461][106225] Updated weights for policy 1, policy_version 62120 (0.0008) [2023-12-27 19:40:32,931][106226] Updated weights for policy 0, policy_version 61933 (0.0008) [2023-12-27 19:40:32,991][106226] Updated weights for policy 0, policy_version 61943 (0.0007) [2023-12-27 19:40:33,040][106226] Updated weights for policy 0, policy_version 61953 (0.0007) [2023-12-27 19:40:33,187][106225] Updated weights for policy 1, policy_version 62130 (0.0008) [2023-12-27 19:40:33,252][106225] Updated weights for policy 1, policy_version 62140 (0.0006) [2023-12-27 19:40:33,315][106225] Updated weights for policy 1, policy_version 62150 (0.0005) [2023-12-27 19:40:33,375][106225] Updated weights for policy 1, policy_version 62160 (0.0005) [2023-12-27 19:40:33,690][106226] Updated weights for policy 0, policy_version 61963 (0.0008) [2023-12-27 19:40:33,754][106226] Updated weights for policy 0, policy_version 61973 (0.0008) [2023-12-27 19:40:33,806][106226] Updated weights for policy 0, policy_version 61983 (0.0009) [2023-12-27 19:40:33,881][106225] Updated weights for policy 1, policy_version 62170 (0.0005) [2023-12-27 19:40:33,937][106225] Updated weights for policy 1, policy_version 62180 (0.0005) [2023-12-27 19:40:33,998][106225] Updated weights for policy 1, policy_version 62190 (0.0008) [2023-12-27 19:40:34,562][106226] Updated weights for policy 0, policy_version 61993 (0.0009) [2023-12-27 19:40:34,625][106226] Updated weights for policy 0, policy_version 62003 (0.0009) [2023-12-27 19:40:34,688][106226] Updated weights for policy 0, policy_version 62013 (0.0007) [2023-12-27 19:40:34,694][106225] Updated weights for policy 1, policy_version 62200 (0.0009) [2023-12-27 19:40:34,739][106226] Updated weights for policy 0, policy_version 62023 (0.0006) [2023-12-27 19:40:34,752][106225] Updated weights for policy 1, policy_version 62210 (0.0010) [2023-12-27 19:40:34,804][106225] Updated weights for policy 1, policy_version 62220 (0.0009) [2023-12-27 19:40:35,387][106225] Updated weights for policy 1, policy_version 62230 (0.0005) [2023-12-27 19:40:35,442][106225] Updated weights for policy 1, policy_version 62240 (0.0008) [2023-12-27 19:40:35,529][106225] Updated weights for policy 1, policy_version 62250 (0.0009) [2023-12-27 19:40:35,546][106226] Updated weights for policy 0, policy_version 62033 (0.0006) [2023-12-27 19:40:35,595][106226] Updated weights for policy 0, policy_version 62043 (0.0008) [2023-12-27 19:40:35,649][106226] Updated weights for policy 0, policy_version 62053 (0.0009) [2023-12-27 19:40:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 31834112. Throughput: 0: 9974.6, 1: 9898.7. Samples: 31846724. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:40:36,175][105115] Avg episode reward: [(0, '-6.302'), (1, '-6.198')] [2023-12-27 19:40:36,220][106225] Updated weights for policy 1, policy_version 62260 (0.0008) [2023-12-27 19:40:36,285][106225] Updated weights for policy 1, policy_version 62270 (0.0008) [2023-12-27 19:40:36,342][106225] Updated weights for policy 1, policy_version 62280 (0.0008) [2023-12-27 19:40:36,375][106226] Updated weights for policy 0, policy_version 62063 (0.0007) [2023-12-27 19:40:36,438][106226] Updated weights for policy 0, policy_version 62073 (0.0008) [2023-12-27 19:40:36,503][106226] Updated weights for policy 0, policy_version 62083 (0.0009) [2023-12-27 19:40:37,051][106225] Updated weights for policy 1, policy_version 62290 (0.0007) [2023-12-27 19:40:37,104][106225] Updated weights for policy 1, policy_version 62300 (0.0008) [2023-12-27 19:40:37,152][106225] Updated weights for policy 1, policy_version 62310 (0.0008) [2023-12-27 19:40:37,219][106225] Updated weights for policy 1, policy_version 62320 (0.0008) [2023-12-27 19:40:37,221][106226] Updated weights for policy 0, policy_version 62093 (0.0007) [2023-12-27 19:40:37,284][106226] Updated weights for policy 0, policy_version 62103 (0.0007) [2023-12-27 19:40:37,342][106226] Updated weights for policy 0, policy_version 62113 (0.0008) [2023-12-27 19:40:37,881][106225] Updated weights for policy 1, policy_version 62330 (0.0009) [2023-12-27 19:40:37,931][106225] Updated weights for policy 1, policy_version 62340 (0.0008) [2023-12-27 19:40:37,981][106225] Updated weights for policy 1, policy_version 62350 (0.0008) [2023-12-27 19:40:38,075][106226] Updated weights for policy 0, policy_version 62123 (0.0007) [2023-12-27 19:40:38,136][106226] Updated weights for policy 0, policy_version 62133 (0.0008) [2023-12-27 19:40:38,189][106226] Updated weights for policy 0, policy_version 62143 (0.0008) [2023-12-27 19:40:38,729][106225] Updated weights for policy 1, policy_version 62360 (0.0010) [2023-12-27 19:40:38,797][106225] Updated weights for policy 1, policy_version 62370 (0.0011) [2023-12-27 19:40:38,862][106225] Updated weights for policy 1, policy_version 62380 (0.0010) [2023-12-27 19:40:38,955][106226] Updated weights for policy 0, policy_version 62153 (0.0008) [2023-12-27 19:40:39,021][106226] Updated weights for policy 0, policy_version 62163 (0.0008) [2023-12-27 19:40:39,087][106226] Updated weights for policy 0, policy_version 62173 (0.0008) [2023-12-27 19:40:39,151][106226] Updated weights for policy 0, policy_version 62183 (0.0008) [2023-12-27 19:40:39,659][106225] Updated weights for policy 1, policy_version 62390 (0.0008) [2023-12-27 19:40:39,721][106225] Updated weights for policy 1, policy_version 62400 (0.0008) [2023-12-27 19:40:39,783][106225] Updated weights for policy 1, policy_version 62410 (0.0008) [2023-12-27 19:40:39,930][106226] Updated weights for policy 0, policy_version 62193 (0.0008) [2023-12-27 19:40:40,000][106226] Updated weights for policy 0, policy_version 62203 (0.0009) [2023-12-27 19:40:40,060][106226] Updated weights for policy 0, policy_version 62213 (0.0009) [2023-12-27 19:40:40,481][106225] Updated weights for policy 1, policy_version 62420 (0.0008) [2023-12-27 19:40:40,545][106225] Updated weights for policy 1, policy_version 62430 (0.0007) [2023-12-27 19:40:40,610][106225] Updated weights for policy 1, policy_version 62440 (0.0006) [2023-12-27 19:40:40,856][106226] Updated weights for policy 0, policy_version 62223 (0.0009) [2023-12-27 19:40:40,926][106226] Updated weights for policy 0, policy_version 62233 (0.0009) [2023-12-27 19:40:40,985][106226] Updated weights for policy 0, policy_version 62243 (0.0006) [2023-12-27 19:40:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 31932416. Throughput: 0: 9950.0, 1: 9918.8. Samples: 31904236. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:40:41,175][105115] Avg episode reward: [(0, '-6.506'), (1, '-6.543')] [2023-12-27 19:40:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000062248_15941632.pth... [2023-12-27 19:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000062448_15990784.pth... [2023-12-27 19:40:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000061096_15646720.pth [2023-12-27 19:40:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000061296_15695872.pth [2023-12-27 19:40:41,214][106225] Updated weights for policy 1, policy_version 62450 (0.0006) [2023-12-27 19:40:41,282][106225] Updated weights for policy 1, policy_version 62460 (0.0009) [2023-12-27 19:40:41,351][106225] Updated weights for policy 1, policy_version 62471 (0.0008) [2023-12-27 19:40:41,750][106226] Updated weights for policy 0, policy_version 62253 (0.0008) [2023-12-27 19:40:41,819][106226] Updated weights for policy 0, policy_version 62263 (0.0008) [2023-12-27 19:40:41,882][106226] Updated weights for policy 0, policy_version 62273 (0.0009) [2023-12-27 19:40:42,090][106225] Updated weights for policy 1, policy_version 62481 (0.0007) [2023-12-27 19:40:42,154][106225] Updated weights for policy 1, policy_version 62491 (0.0009) [2023-12-27 19:40:42,215][106225] Updated weights for policy 1, policy_version 62501 (0.0009) [2023-12-27 19:40:42,284][106225] Updated weights for policy 1, policy_version 62511 (0.0007) [2023-12-27 19:40:42,648][106226] Updated weights for policy 0, policy_version 62283 (0.0008) [2023-12-27 19:40:42,702][106226] Updated weights for policy 0, policy_version 62293 (0.0008) [2023-12-27 19:40:42,767][106226] Updated weights for policy 0, policy_version 62303 (0.0009) [2023-12-27 19:40:43,059][106225] Updated weights for policy 1, policy_version 62521 (0.0009) [2023-12-27 19:40:43,127][106225] Updated weights for policy 1, policy_version 62531 (0.0009) [2023-12-27 19:40:43,178][106225] Updated weights for policy 1, policy_version 62541 (0.0008) [2023-12-27 19:40:43,396][106226] Updated weights for policy 0, policy_version 62313 (0.0008) [2023-12-27 19:40:43,458][106226] Updated weights for policy 0, policy_version 62323 (0.0005) [2023-12-27 19:40:43,519][106226] Updated weights for policy 0, policy_version 62333 (0.0007) [2023-12-27 19:40:43,569][106226] Updated weights for policy 0, policy_version 62343 (0.0008) [2023-12-27 19:40:43,946][106225] Updated weights for policy 1, policy_version 62551 (0.0009) [2023-12-27 19:40:43,990][106225] Updated weights for policy 1, policy_version 62561 (0.0008) [2023-12-27 19:40:44,041][106225] Updated weights for policy 1, policy_version 62571 (0.0008) [2023-12-27 19:40:44,215][106226] Updated weights for policy 0, policy_version 62353 (0.0008) [2023-12-27 19:40:44,281][106226] Updated weights for policy 0, policy_version 62363 (0.0008) [2023-12-27 19:40:44,342][106226] Updated weights for policy 0, policy_version 62373 (0.0009) [2023-12-27 19:40:44,810][106225] Updated weights for policy 1, policy_version 62581 (0.0008) [2023-12-27 19:40:44,872][106225] Updated weights for policy 1, policy_version 62591 (0.0006) [2023-12-27 19:40:44,940][106225] Updated weights for policy 1, policy_version 62601 (0.0006) [2023-12-27 19:40:45,063][106226] Updated weights for policy 0, policy_version 62383 (0.0008) [2023-12-27 19:40:45,128][106226] Updated weights for policy 0, policy_version 62393 (0.0007) [2023-12-27 19:40:45,193][106226] Updated weights for policy 0, policy_version 62403 (0.0010) [2023-12-27 19:40:45,519][106225] Updated weights for policy 1, policy_version 62611 (0.0007) [2023-12-27 19:40:45,577][106225] Updated weights for policy 1, policy_version 62621 (0.0008) [2023-12-27 19:40:45,635][106225] Updated weights for policy 1, policy_version 62631 (0.0010) [2023-12-27 19:40:45,962][106226] Updated weights for policy 0, policy_version 62413 (0.0010) [2023-12-27 19:40:46,019][106226] Updated weights for policy 0, policy_version 62423 (0.0009) [2023-12-27 19:40:46,082][106226] Updated weights for policy 0, policy_version 62433 (0.0010) [2023-12-27 19:40:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 32030720. Throughput: 0: 9926.2, 1: 9817.1. Samples: 32017640. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:40:46,175][105115] Avg episode reward: [(0, '-6.403'), (1, '-6.489')] [2023-12-27 19:40:46,234][106225] Updated weights for policy 1, policy_version 62641 (0.0010) [2023-12-27 19:40:46,287][106225] Updated weights for policy 1, policy_version 62651 (0.0009) [2023-12-27 19:40:46,353][106225] Updated weights for policy 1, policy_version 62661 (0.0006) [2023-12-27 19:40:46,418][106225] Updated weights for policy 1, policy_version 62671 (0.0007) [2023-12-27 19:40:46,718][106226] Updated weights for policy 0, policy_version 62443 (0.0011) [2023-12-27 19:40:46,771][106226] Updated weights for policy 0, policy_version 62453 (0.0010) [2023-12-27 19:40:46,821][106226] Updated weights for policy 0, policy_version 62463 (0.0010) [2023-12-27 19:40:47,087][106225] Updated weights for policy 1, policy_version 62681 (0.0010) [2023-12-27 19:40:47,130][106225] Updated weights for policy 1, policy_version 62691 (0.0010) [2023-12-27 19:40:47,184][106225] Updated weights for policy 1, policy_version 62701 (0.0010) [2023-12-27 19:40:47,452][106226] Updated weights for policy 0, policy_version 62473 (0.0010) [2023-12-27 19:40:47,506][106226] Updated weights for policy 0, policy_version 62483 (0.0010) [2023-12-27 19:40:47,553][106226] Updated weights for policy 0, policy_version 62493 (0.0010) [2023-12-27 19:40:47,603][106226] Updated weights for policy 0, policy_version 62503 (0.0010) [2023-12-27 19:40:47,905][106225] Updated weights for policy 1, policy_version 62711 (0.0010) [2023-12-27 19:40:47,955][106225] Updated weights for policy 1, policy_version 62721 (0.0010) [2023-12-27 19:40:48,004][106225] Updated weights for policy 1, policy_version 62731 (0.0010) [2023-12-27 19:40:48,333][106226] Updated weights for policy 0, policy_version 62513 (0.0010) [2023-12-27 19:40:48,399][106226] Updated weights for policy 0, policy_version 62523 (0.0008) [2023-12-27 19:40:48,464][106226] Updated weights for policy 0, policy_version 62533 (0.0008) [2023-12-27 19:40:48,749][106225] Updated weights for policy 1, policy_version 62741 (0.0010) [2023-12-27 19:40:48,814][106225] Updated weights for policy 1, policy_version 62751 (0.0010) [2023-12-27 19:40:48,878][106225] Updated weights for policy 1, policy_version 62761 (0.0011) [2023-12-27 19:40:49,065][106226] Updated weights for policy 0, policy_version 62543 (0.0008) [2023-12-27 19:40:49,132][106226] Updated weights for policy 0, policy_version 62553 (0.0011) [2023-12-27 19:40:49,197][106226] Updated weights for policy 0, policy_version 62563 (0.0008) [2023-12-27 19:40:49,617][106225] Updated weights for policy 1, policy_version 62771 (0.0010) [2023-12-27 19:40:49,674][106225] Updated weights for policy 1, policy_version 62781 (0.0010) [2023-12-27 19:40:49,738][106225] Updated weights for policy 1, policy_version 62791 (0.0010) [2023-12-27 19:40:49,824][106226] Updated weights for policy 0, policy_version 62573 (0.0007) [2023-12-27 19:40:49,884][106226] Updated weights for policy 0, policy_version 62583 (0.0008) [2023-12-27 19:40:49,946][106226] Updated weights for policy 0, policy_version 62593 (0.0009) [2023-12-27 19:40:50,526][106225] Updated weights for policy 1, policy_version 62801 (0.0010) [2023-12-27 19:40:50,587][106226] Updated weights for policy 0, policy_version 62603 (0.0008) [2023-12-27 19:40:50,594][106225] Updated weights for policy 1, policy_version 62811 (0.0007) [2023-12-27 19:40:50,646][106226] Updated weights for policy 0, policy_version 62613 (0.0008) [2023-12-27 19:40:50,660][106225] Updated weights for policy 1, policy_version 62821 (0.0006) [2023-12-27 19:40:50,714][106226] Updated weights for policy 0, policy_version 62623 (0.0007) [2023-12-27 19:40:50,723][106225] Updated weights for policy 1, policy_version 62831 (0.0009) [2023-12-27 19:40:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 32129024. Throughput: 0: 9949.3, 1: 9815.7. Samples: 32139304. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:40:51,175][105115] Avg episode reward: [(0, '-6.250'), (1, '-6.309')] [2023-12-27 19:40:51,421][106226] Updated weights for policy 0, policy_version 62633 (0.0006) [2023-12-27 19:40:51,450][106225] Updated weights for policy 1, policy_version 62841 (0.0007) [2023-12-27 19:40:51,481][106226] Updated weights for policy 0, policy_version 62643 (0.0008) [2023-12-27 19:40:51,506][106225] Updated weights for policy 1, policy_version 62851 (0.0007) [2023-12-27 19:40:51,536][106226] Updated weights for policy 0, policy_version 62653 (0.0006) [2023-12-27 19:40:51,567][106225] Updated weights for policy 1, policy_version 62861 (0.0006) [2023-12-27 19:40:51,595][106226] Updated weights for policy 0, policy_version 62663 (0.0009) [2023-12-27 19:40:52,282][106225] Updated weights for policy 1, policy_version 62871 (0.0009) [2023-12-27 19:40:52,337][106225] Updated weights for policy 1, policy_version 62881 (0.0010) [2023-12-27 19:40:52,372][106226] Updated weights for policy 0, policy_version 62673 (0.0009) [2023-12-27 19:40:52,411][106225] Updated weights for policy 1, policy_version 62891 (0.0011) [2023-12-27 19:40:52,437][106226] Updated weights for policy 0, policy_version 62683 (0.0008) [2023-12-27 19:40:52,505][106226] Updated weights for policy 0, policy_version 62693 (0.0007) [2023-12-27 19:40:53,115][106225] Updated weights for policy 1, policy_version 62901 (0.0008) [2023-12-27 19:40:53,166][106225] Updated weights for policy 1, policy_version 62911 (0.0006) [2023-12-27 19:40:53,168][106226] Updated weights for policy 0, policy_version 62703 (0.0006) [2023-12-27 19:40:53,216][106226] Updated weights for policy 0, policy_version 62713 (0.0009) [2023-12-27 19:40:53,220][106225] Updated weights for policy 1, policy_version 62921 (0.0005) [2023-12-27 19:40:53,279][106226] Updated weights for policy 0, policy_version 62723 (0.0006) [2023-12-27 19:40:53,909][106226] Updated weights for policy 0, policy_version 62733 (0.0008) [2023-12-27 19:40:53,919][106225] Updated weights for policy 1, policy_version 62931 (0.0006) [2023-12-27 19:40:53,963][106226] Updated weights for policy 0, policy_version 62743 (0.0005) [2023-12-27 19:40:53,976][106225] Updated weights for policy 1, policy_version 62941 (0.0007) [2023-12-27 19:40:54,013][106226] Updated weights for policy 0, policy_version 62753 (0.0007) [2023-12-27 19:40:54,031][106225] Updated weights for policy 1, policy_version 62951 (0.0008) [2023-12-27 19:40:54,732][106225] Updated weights for policy 1, policy_version 62961 (0.0008) [2023-12-27 19:40:54,768][106226] Updated weights for policy 0, policy_version 62763 (0.0006) [2023-12-27 19:40:54,784][106225] Updated weights for policy 1, policy_version 62971 (0.0006) [2023-12-27 19:40:54,817][106226] Updated weights for policy 0, policy_version 62773 (0.0008) [2023-12-27 19:40:54,836][106225] Updated weights for policy 1, policy_version 62981 (0.0006) [2023-12-27 19:40:54,871][106226] Updated weights for policy 0, policy_version 62783 (0.0007) [2023-12-27 19:40:54,895][106225] Updated weights for policy 1, policy_version 62991 (0.0006) [2023-12-27 19:40:55,566][106225] Updated weights for policy 1, policy_version 63001 (0.0005) [2023-12-27 19:40:55,631][106225] Updated weights for policy 1, policy_version 63011 (0.0007) [2023-12-27 19:40:55,641][106226] Updated weights for policy 0, policy_version 62793 (0.0007) [2023-12-27 19:40:55,679][106225] Updated weights for policy 1, policy_version 63021 (0.0007) [2023-12-27 19:40:55,689][106226] Updated weights for policy 0, policy_version 62803 (0.0006) [2023-12-27 19:40:55,743][106226] Updated weights for policy 0, policy_version 62813 (0.0009) [2023-12-27 19:40:55,793][106226] Updated weights for policy 0, policy_version 62823 (0.0009) [2023-12-27 19:40:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 32227328. Throughput: 0: 9881.9, 1: 9787.8. Samples: 32197752. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:40:56,175][105115] Avg episode reward: [(0, '-6.071'), (1, '-6.590')] [2023-12-27 19:40:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000063024_16138240.pth... [2023-12-27 19:40:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000062824_16089088.pth... [2023-12-27 19:40:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000061872_15843328.pth [2023-12-27 19:40:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000061704_15802368.pth [2023-12-27 19:40:56,283][106225] Updated weights for policy 1, policy_version 63031 (0.0007) [2023-12-27 19:40:56,334][106225] Updated weights for policy 1, policy_version 63041 (0.0008) [2023-12-27 19:40:56,393][106225] Updated weights for policy 1, policy_version 63051 (0.0008) [2023-12-27 19:40:56,485][106226] Updated weights for policy 0, policy_version 62833 (0.0008) [2023-12-27 19:40:56,531][106226] Updated weights for policy 0, policy_version 62843 (0.0005) [2023-12-27 19:40:56,582][106226] Updated weights for policy 0, policy_version 62853 (0.0005) [2023-12-27 19:40:57,116][106225] Updated weights for policy 1, policy_version 63061 (0.0007) [2023-12-27 19:40:57,172][106225] Updated weights for policy 1, policy_version 63071 (0.0007) [2023-12-27 19:40:57,220][106225] Updated weights for policy 1, policy_version 63081 (0.0008) [2023-12-27 19:40:57,304][106226] Updated weights for policy 0, policy_version 62863 (0.0009) [2023-12-27 19:40:57,370][106226] Updated weights for policy 0, policy_version 62873 (0.0008) [2023-12-27 19:40:57,424][106226] Updated weights for policy 0, policy_version 62883 (0.0006) [2023-12-27 19:40:57,794][106225] Updated weights for policy 1, policy_version 63091 (0.0008) [2023-12-27 19:40:57,854][106225] Updated weights for policy 1, policy_version 63101 (0.0007) [2023-12-27 19:40:57,906][106225] Updated weights for policy 1, policy_version 63111 (0.0009) [2023-12-27 19:40:58,042][106226] Updated weights for policy 0, policy_version 62893 (0.0007) [2023-12-27 19:40:58,099][106226] Updated weights for policy 0, policy_version 62903 (0.0008) [2023-12-27 19:40:58,153][106226] Updated weights for policy 0, policy_version 62913 (0.0009) [2023-12-27 19:40:58,667][106225] Updated weights for policy 1, policy_version 63121 (0.0009) [2023-12-27 19:40:58,730][106225] Updated weights for policy 1, policy_version 63131 (0.0008) [2023-12-27 19:40:58,794][106225] Updated weights for policy 1, policy_version 63141 (0.0007) [2023-12-27 19:40:58,860][106225] Updated weights for policy 1, policy_version 63151 (0.0007) [2023-12-27 19:40:58,923][106226] Updated weights for policy 0, policy_version 62923 (0.0008) [2023-12-27 19:40:59,000][106226] Updated weights for policy 0, policy_version 62933 (0.0007) [2023-12-27 19:40:59,067][106226] Updated weights for policy 0, policy_version 62943 (0.0009) [2023-12-27 19:40:59,593][106225] Updated weights for policy 1, policy_version 63161 (0.0006) [2023-12-27 19:40:59,659][106225] Updated weights for policy 1, policy_version 63171 (0.0010) [2023-12-27 19:40:59,720][106225] Updated weights for policy 1, policy_version 63181 (0.0010) [2023-12-27 19:40:59,786][106226] Updated weights for policy 0, policy_version 62953 (0.0008) [2023-12-27 19:40:59,853][106226] Updated weights for policy 0, policy_version 62963 (0.0009) [2023-12-27 19:40:59,907][106226] Updated weights for policy 0, policy_version 62973 (0.0007) [2023-12-27 19:40:59,974][106226] Updated weights for policy 0, policy_version 62983 (0.0008) [2023-12-27 19:41:00,420][106225] Updated weights for policy 1, policy_version 63191 (0.0010) [2023-12-27 19:41:00,476][106225] Updated weights for policy 1, policy_version 63201 (0.0010) [2023-12-27 19:41:00,523][106225] Updated weights for policy 1, policy_version 63211 (0.0010) [2023-12-27 19:41:00,702][106226] Updated weights for policy 0, policy_version 62993 (0.0008) [2023-12-27 19:41:00,759][106226] Updated weights for policy 0, policy_version 63003 (0.0009) [2023-12-27 19:41:00,825][106226] Updated weights for policy 0, policy_version 63013 (0.0006) [2023-12-27 19:41:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 32325632. Throughput: 0: 9836.2, 1: 9873.5. Samples: 32316240. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:41:01,175][105115] Avg episode reward: [(0, '-6.651'), (1, '-5.882')] [2023-12-27 19:41:01,206][106225] Updated weights for policy 1, policy_version 63221 (0.0010) [2023-12-27 19:41:01,265][106225] Updated weights for policy 1, policy_version 63231 (0.0010) [2023-12-27 19:41:01,316][106225] Updated weights for policy 1, policy_version 63241 (0.0010) [2023-12-27 19:41:01,536][106226] Updated weights for policy 0, policy_version 63023 (0.0011) [2023-12-27 19:41:01,595][106226] Updated weights for policy 0, policy_version 63033 (0.0011) [2023-12-27 19:41:01,665][106226] Updated weights for policy 0, policy_version 63043 (0.0011) [2023-12-27 19:41:02,132][106225] Updated weights for policy 1, policy_version 63251 (0.0008) [2023-12-27 19:41:02,186][106225] Updated weights for policy 1, policy_version 63261 (0.0007) [2023-12-27 19:41:02,242][106225] Updated weights for policy 1, policy_version 63271 (0.0007) [2023-12-27 19:41:02,342][106226] Updated weights for policy 0, policy_version 63053 (0.0010) [2023-12-27 19:41:02,410][106226] Updated weights for policy 0, policy_version 63063 (0.0009) [2023-12-27 19:41:02,480][106226] Updated weights for policy 0, policy_version 63073 (0.0011) [2023-12-27 19:41:02,904][106225] Updated weights for policy 1, policy_version 63281 (0.0006) [2023-12-27 19:41:02,953][106225] Updated weights for policy 1, policy_version 63291 (0.0005) [2023-12-27 19:41:03,010][106225] Updated weights for policy 1, policy_version 63301 (0.0006) [2023-12-27 19:41:03,064][106225] Updated weights for policy 1, policy_version 63311 (0.0008) [2023-12-27 19:41:03,203][106226] Updated weights for policy 0, policy_version 63083 (0.0010) [2023-12-27 19:41:03,260][106226] Updated weights for policy 0, policy_version 63093 (0.0006) [2023-12-27 19:41:03,326][106226] Updated weights for policy 0, policy_version 63103 (0.0005) [2023-12-27 19:41:03,747][106225] Updated weights for policy 1, policy_version 63321 (0.0005) [2023-12-27 19:41:03,799][106225] Updated weights for policy 1, policy_version 63331 (0.0005) [2023-12-27 19:41:03,859][106225] Updated weights for policy 1, policy_version 63341 (0.0007) [2023-12-27 19:41:04,039][106226] Updated weights for policy 0, policy_version 63113 (0.0010) [2023-12-27 19:41:04,108][106226] Updated weights for policy 0, policy_version 63123 (0.0011) [2023-12-27 19:41:04,170][106226] Updated weights for policy 0, policy_version 63133 (0.0011) [2023-12-27 19:41:04,234][106226] Updated weights for policy 0, policy_version 63143 (0.0011) [2023-12-27 19:41:04,477][106225] Updated weights for policy 1, policy_version 63351 (0.0007) [2023-12-27 19:41:04,532][106225] Updated weights for policy 1, policy_version 63361 (0.0008) [2023-12-27 19:41:04,589][106225] Updated weights for policy 1, policy_version 63371 (0.0008) [2023-12-27 19:41:04,948][106226] Updated weights for policy 0, policy_version 63153 (0.0010) [2023-12-27 19:41:05,005][106226] Updated weights for policy 0, policy_version 63163 (0.0010) [2023-12-27 19:41:05,058][106226] Updated weights for policy 0, policy_version 63173 (0.0010) [2023-12-27 19:41:05,188][106225] Updated weights for policy 1, policy_version 63381 (0.0009) [2023-12-27 19:41:05,251][106225] Updated weights for policy 1, policy_version 63391 (0.0010) [2023-12-27 19:41:05,300][106225] Updated weights for policy 1, policy_version 63401 (0.0010) [2023-12-27 19:41:05,785][106226] Updated weights for policy 0, policy_version 63183 (0.0011) [2023-12-27 19:41:05,844][106226] Updated weights for policy 0, policy_version 63193 (0.0010) [2023-12-27 19:41:05,906][106226] Updated weights for policy 0, policy_version 63203 (0.0011) [2023-12-27 19:41:06,051][106225] Updated weights for policy 1, policy_version 63411 (0.0010) [2023-12-27 19:41:06,120][106225] Updated weights for policy 1, policy_version 63421 (0.0010) [2023-12-27 19:41:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 32423936. Throughput: 0: 9786.5, 1: 9952.9. Samples: 32435660. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:41:06,175][105115] Avg episode reward: [(0, '-6.123'), (1, '-6.278')] [2023-12-27 19:41:06,184][106225] Updated weights for policy 1, policy_version 63431 (0.0007) [2023-12-27 19:41:06,650][106226] Updated weights for policy 0, policy_version 63213 (0.0011) [2023-12-27 19:41:06,713][106226] Updated weights for policy 0, policy_version 63223 (0.0010) [2023-12-27 19:41:06,779][106226] Updated weights for policy 0, policy_version 63233 (0.0011) [2023-12-27 19:41:06,873][106225] Updated weights for policy 1, policy_version 63441 (0.0011) [2023-12-27 19:41:06,930][106225] Updated weights for policy 1, policy_version 63451 (0.0010) [2023-12-27 19:41:06,991][106225] Updated weights for policy 1, policy_version 63461 (0.0010) [2023-12-27 19:41:07,050][106225] Updated weights for policy 1, policy_version 63471 (0.0010) [2023-12-27 19:41:07,451][106226] Updated weights for policy 0, policy_version 63243 (0.0009) [2023-12-27 19:41:07,500][106226] Updated weights for policy 0, policy_version 63253 (0.0005) [2023-12-27 19:41:07,548][106226] Updated weights for policy 0, policy_version 63263 (0.0005) [2023-12-27 19:41:07,771][106225] Updated weights for policy 1, policy_version 63481 (0.0007) [2023-12-27 19:41:07,834][106225] Updated weights for policy 1, policy_version 63491 (0.0008) [2023-12-27 19:41:07,887][106225] Updated weights for policy 1, policy_version 63501 (0.0010) [2023-12-27 19:41:08,239][106226] Updated weights for policy 0, policy_version 63273 (0.0009) [2023-12-27 19:41:08,296][106226] Updated weights for policy 0, policy_version 63283 (0.0010) [2023-12-27 19:41:08,361][106226] Updated weights for policy 0, policy_version 63293 (0.0011) [2023-12-27 19:41:08,424][106226] Updated weights for policy 0, policy_version 63303 (0.0011) [2023-12-27 19:41:08,548][106225] Updated weights for policy 1, policy_version 63511 (0.0010) [2023-12-27 19:41:08,612][106225] Updated weights for policy 1, policy_version 63521 (0.0010) [2023-12-27 19:41:08,667][106225] Updated weights for policy 1, policy_version 63531 (0.0010) [2023-12-27 19:41:08,997][106226] Updated weights for policy 0, policy_version 63313 (0.0006) [2023-12-27 19:41:09,046][106226] Updated weights for policy 0, policy_version 63323 (0.0005) [2023-12-27 19:41:09,108][106226] Updated weights for policy 0, policy_version 63333 (0.0009) [2023-12-27 19:41:09,341][106225] Updated weights for policy 1, policy_version 63541 (0.0009) [2023-12-27 19:41:09,418][106225] Updated weights for policy 1, policy_version 63551 (0.0009) [2023-12-27 19:41:09,489][106225] Updated weights for policy 1, policy_version 63561 (0.0009) [2023-12-27 19:41:09,870][106226] Updated weights for policy 0, policy_version 63343 (0.0010) [2023-12-27 19:41:09,940][106226] Updated weights for policy 0, policy_version 63353 (0.0008) [2023-12-27 19:41:10,003][106226] Updated weights for policy 0, policy_version 63363 (0.0007) [2023-12-27 19:41:10,255][106225] Updated weights for policy 1, policy_version 63571 (0.0008) [2023-12-27 19:41:10,321][106225] Updated weights for policy 1, policy_version 63581 (0.0008) [2023-12-27 19:41:10,389][106225] Updated weights for policy 1, policy_version 63591 (0.0008) [2023-12-27 19:41:10,733][106226] Updated weights for policy 0, policy_version 63373 (0.0012) [2023-12-27 19:41:10,789][106226] Updated weights for policy 0, policy_version 63383 (0.0011) [2023-12-27 19:41:10,845][106226] Updated weights for policy 0, policy_version 63393 (0.0010) [2023-12-27 19:41:11,095][106225] Updated weights for policy 1, policy_version 63601 (0.0007) [2023-12-27 19:41:11,167][106225] Updated weights for policy 1, policy_version 63611 (0.0010) [2023-12-27 19:41:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 32522240. Throughput: 0: 9794.0, 1: 10010.6. Samples: 32496072. Policy #0 lag: (min: 7.0, avg: 11.6, max: 39.0) [2023-12-27 19:41:11,175][105115] Avg episode reward: [(0, '-6.715'), (1, '-6.336')] [2023-12-27 19:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000063400_16236544.pth... [2023-12-27 19:41:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000062248_15941632.pth [2023-12-27 19:41:11,224][106225] Updated weights for policy 1, policy_version 63621 (0.0009) [2023-12-27 19:41:11,280][106225] Updated weights for policy 1, policy_version 63631 (0.0009) [2023-12-27 19:41:11,285][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000063632_16293888.pth... [2023-12-27 19:41:11,289][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000062448_15990784.pth [2023-12-27 19:41:11,635][106226] Updated weights for policy 0, policy_version 63403 (0.0010) [2023-12-27 19:41:11,701][106226] Updated weights for policy 0, policy_version 63413 (0.0008) [2023-12-27 19:41:11,766][106226] Updated weights for policy 0, policy_version 63423 (0.0009) [2023-12-27 19:41:12,086][106225] Updated weights for policy 1, policy_version 63641 (0.0009) [2023-12-27 19:41:12,137][106225] Updated weights for policy 1, policy_version 63651 (0.0008) [2023-12-27 19:41:12,192][106225] Updated weights for policy 1, policy_version 63661 (0.0010) [2023-12-27 19:41:12,453][106226] Updated weights for policy 0, policy_version 63433 (0.0009) [2023-12-27 19:41:12,505][106226] Updated weights for policy 0, policy_version 63443 (0.0008) [2023-12-27 19:41:12,579][106226] Updated weights for policy 0, policy_version 63454 (0.0006) [2023-12-27 19:41:12,634][106226] Updated weights for policy 0, policy_version 63464 (0.0006) [2023-12-27 19:41:13,030][106225] Updated weights for policy 1, policy_version 63671 (0.0009) [2023-12-27 19:41:13,081][106225] Updated weights for policy 1, policy_version 63681 (0.0010) [2023-12-27 19:41:13,133][106225] Updated weights for policy 1, policy_version 63691 (0.0010) [2023-12-27 19:41:13,351][106226] Updated weights for policy 0, policy_version 63474 (0.0010) [2023-12-27 19:41:13,404][106226] Updated weights for policy 0, policy_version 63484 (0.0010) [2023-12-27 19:41:13,457][106226] Updated weights for policy 0, policy_version 63494 (0.0007) [2023-12-27 19:41:13,816][106225] Updated weights for policy 1, policy_version 63701 (0.0008) [2023-12-27 19:41:13,866][106225] Updated weights for policy 1, policy_version 63711 (0.0006) [2023-12-27 19:41:13,924][106225] Updated weights for policy 1, policy_version 63721 (0.0010) [2023-12-27 19:41:14,069][106226] Updated weights for policy 0, policy_version 63504 (0.0010) [2023-12-27 19:41:14,132][106226] Updated weights for policy 0, policy_version 63514 (0.0011) [2023-12-27 19:41:14,190][106226] Updated weights for policy 0, policy_version 63524 (0.0009) [2023-12-27 19:41:14,539][106225] Updated weights for policy 1, policy_version 63731 (0.0009) [2023-12-27 19:41:14,588][106225] Updated weights for policy 1, policy_version 63741 (0.0005) [2023-12-27 19:41:14,651][106225] Updated weights for policy 1, policy_version 63751 (0.0007) [2023-12-27 19:41:14,831][106226] Updated weights for policy 0, policy_version 63534 (0.0011) [2023-12-27 19:41:14,902][106226] Updated weights for policy 0, policy_version 63544 (0.0010) [2023-12-27 19:41:14,971][106226] Updated weights for policy 0, policy_version 63554 (0.0006) [2023-12-27 19:41:15,302][106225] Updated weights for policy 1, policy_version 63761 (0.0006) [2023-12-27 19:41:15,368][106225] Updated weights for policy 1, policy_version 63771 (0.0010) [2023-12-27 19:41:15,425][106225] Updated weights for policy 1, policy_version 63781 (0.0010) [2023-12-27 19:41:15,474][106225] Updated weights for policy 1, policy_version 63791 (0.0010) [2023-12-27 19:41:15,643][106226] Updated weights for policy 0, policy_version 63564 (0.0008) [2023-12-27 19:41:15,698][106226] Updated weights for policy 0, policy_version 63574 (0.0010) [2023-12-27 19:41:15,747][106226] Updated weights for policy 0, policy_version 63584 (0.0010) [2023-12-27 19:41:16,126][106225] Updated weights for policy 1, policy_version 63801 (0.0006) [2023-12-27 19:41:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 32620544. Throughput: 0: 9754.3, 1: 9937.5. Samples: 32612380. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:16,175][105115] Avg episode reward: [(0, '-5.865'), (1, '-5.899')] [2023-12-27 19:41:16,182][106225] Updated weights for policy 1, policy_version 63811 (0.0007) [2023-12-27 19:41:16,235][106225] Updated weights for policy 1, policy_version 63821 (0.0007) [2023-12-27 19:41:16,464][106226] Updated weights for policy 0, policy_version 63594 (0.0009) [2023-12-27 19:41:16,533][106226] Updated weights for policy 0, policy_version 63604 (0.0005) [2023-12-27 19:41:16,596][106226] Updated weights for policy 0, policy_version 63614 (0.0005) [2023-12-27 19:41:16,654][106226] Updated weights for policy 0, policy_version 63624 (0.0005) [2023-12-27 19:41:16,772][106225] Updated weights for policy 1, policy_version 63831 (0.0007) [2023-12-27 19:41:16,819][106225] Updated weights for policy 1, policy_version 63841 (0.0008) [2023-12-27 19:41:16,871][106225] Updated weights for policy 1, policy_version 63851 (0.0009) [2023-12-27 19:41:17,223][106226] Updated weights for policy 0, policy_version 63634 (0.0010) [2023-12-27 19:41:17,281][106226] Updated weights for policy 0, policy_version 63644 (0.0009) [2023-12-27 19:41:17,330][106226] Updated weights for policy 0, policy_version 63654 (0.0009) [2023-12-27 19:41:17,560][106225] Updated weights for policy 1, policy_version 63861 (0.0008) [2023-12-27 19:41:17,622][106225] Updated weights for policy 1, policy_version 63871 (0.0010) [2023-12-27 19:41:17,684][106225] Updated weights for policy 1, policy_version 63881 (0.0009) [2023-12-27 19:41:17,981][106226] Updated weights for policy 0, policy_version 63664 (0.0006) [2023-12-27 19:41:18,035][106226] Updated weights for policy 0, policy_version 63675 (0.0008) [2023-12-27 19:41:18,088][106226] Updated weights for policy 0, policy_version 63685 (0.0009) [2023-12-27 19:41:18,250][106225] Updated weights for policy 1, policy_version 63891 (0.0006) [2023-12-27 19:41:18,302][106225] Updated weights for policy 1, policy_version 63901 (0.0005) [2023-12-27 19:41:18,374][106225] Updated weights for policy 1, policy_version 63911 (0.0007) [2023-12-27 19:41:18,777][106226] Updated weights for policy 0, policy_version 63695 (0.0008) [2023-12-27 19:41:18,837][106226] Updated weights for policy 0, policy_version 63705 (0.0009) [2023-12-27 19:41:18,895][106226] Updated weights for policy 0, policy_version 63715 (0.0008) [2023-12-27 19:41:19,110][106225] Updated weights for policy 1, policy_version 63921 (0.0008) [2023-12-27 19:41:19,161][106225] Updated weights for policy 1, policy_version 63931 (0.0010) [2023-12-27 19:41:19,212][106225] Updated weights for policy 1, policy_version 63941 (0.0008) [2023-12-27 19:41:19,283][106225] Updated weights for policy 1, policy_version 63951 (0.0009) [2023-12-27 19:41:19,663][106226] Updated weights for policy 0, policy_version 63725 (0.0008) [2023-12-27 19:41:19,727][106226] Updated weights for policy 0, policy_version 63735 (0.0008) [2023-12-27 19:41:19,789][106226] Updated weights for policy 0, policy_version 63745 (0.0010) [2023-12-27 19:41:19,988][106225] Updated weights for policy 1, policy_version 63961 (0.0009) [2023-12-27 19:41:20,045][106225] Updated weights for policy 1, policy_version 63971 (0.0009) [2023-12-27 19:41:20,112][106225] Updated weights for policy 1, policy_version 63981 (0.0009) [2023-12-27 19:41:20,579][106226] Updated weights for policy 0, policy_version 63755 (0.0009) [2023-12-27 19:41:20,649][106226] Updated weights for policy 0, policy_version 63765 (0.0007) [2023-12-27 19:41:20,725][106226] Updated weights for policy 0, policy_version 63775 (0.0008) [2023-12-27 19:41:20,874][106225] Updated weights for policy 1, policy_version 63991 (0.0009) [2023-12-27 19:41:20,941][106225] Updated weights for policy 1, policy_version 64001 (0.0010) [2023-12-27 19:41:20,997][106225] Updated weights for policy 1, policy_version 64011 (0.0009) [2023-12-27 19:41:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 32727040. Throughput: 0: 9806.3, 1: 9906.9. Samples: 32733816. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:21,175][105115] Avg episode reward: [(0, '-6.542'), (1, '-6.377')] [2023-12-27 19:41:21,435][106226] Updated weights for policy 0, policy_version 63785 (0.0009) [2023-12-27 19:41:21,498][106226] Updated weights for policy 0, policy_version 63795 (0.0009) [2023-12-27 19:41:21,563][106226] Updated weights for policy 0, policy_version 63805 (0.0009) [2023-12-27 19:41:21,631][106226] Updated weights for policy 0, policy_version 63815 (0.0009) [2023-12-27 19:41:21,811][106225] Updated weights for policy 1, policy_version 64021 (0.0008) [2023-12-27 19:41:21,881][106225] Updated weights for policy 1, policy_version 64031 (0.0006) [2023-12-27 19:41:21,947][106225] Updated weights for policy 1, policy_version 64041 (0.0006) [2023-12-27 19:41:22,440][106226] Updated weights for policy 0, policy_version 63825 (0.0009) [2023-12-27 19:41:22,505][106226] Updated weights for policy 0, policy_version 63835 (0.0011) [2023-12-27 19:41:22,552][106226] Updated weights for policy 0, policy_version 63845 (0.0010) [2023-12-27 19:41:22,683][106225] Updated weights for policy 1, policy_version 64051 (0.0008) [2023-12-27 19:41:22,744][106225] Updated weights for policy 1, policy_version 64061 (0.0008) [2023-12-27 19:41:22,810][106225] Updated weights for policy 1, policy_version 64071 (0.0009) [2023-12-27 19:41:23,307][106226] Updated weights for policy 0, policy_version 63855 (0.0010) [2023-12-27 19:41:23,377][106226] Updated weights for policy 0, policy_version 63865 (0.0011) [2023-12-27 19:41:23,428][106225] Updated weights for policy 1, policy_version 64081 (0.0007) [2023-12-27 19:41:23,444][106226] Updated weights for policy 0, policy_version 63875 (0.0010) [2023-12-27 19:41:23,487][106225] Updated weights for policy 1, policy_version 64091 (0.0006) [2023-12-27 19:41:23,533][106225] Updated weights for policy 1, policy_version 64101 (0.0008) [2023-12-27 19:41:23,589][106225] Updated weights for policy 1, policy_version 64111 (0.0009) [2023-12-27 19:41:24,056][106226] Updated weights for policy 0, policy_version 63885 (0.0009) [2023-12-27 19:41:24,102][106226] Updated weights for policy 0, policy_version 63895 (0.0008) [2023-12-27 19:41:24,148][106226] Updated weights for policy 0, policy_version 63905 (0.0008) [2023-12-27 19:41:24,353][106225] Updated weights for policy 1, policy_version 64121 (0.0008) [2023-12-27 19:41:24,410][106225] Updated weights for policy 1, policy_version 64131 (0.0008) [2023-12-27 19:41:24,478][106225] Updated weights for policy 1, policy_version 64141 (0.0009) [2023-12-27 19:41:24,823][106226] Updated weights for policy 0, policy_version 63915 (0.0008) [2023-12-27 19:41:24,868][106226] Updated weights for policy 0, policy_version 63925 (0.0009) [2023-12-27 19:41:24,928][106226] Updated weights for policy 0, policy_version 63935 (0.0008) [2023-12-27 19:41:25,252][106225] Updated weights for policy 1, policy_version 64151 (0.0008) [2023-12-27 19:41:25,323][106225] Updated weights for policy 1, policy_version 64161 (0.0008) [2023-12-27 19:41:25,392][106225] Updated weights for policy 1, policy_version 64171 (0.0009) [2023-12-27 19:41:25,561][106226] Updated weights for policy 0, policy_version 63945 (0.0009) [2023-12-27 19:41:25,620][106226] Updated weights for policy 0, policy_version 63955 (0.0009) [2023-12-27 19:41:25,667][106226] Updated weights for policy 0, policy_version 63965 (0.0008) [2023-12-27 19:41:25,719][106226] Updated weights for policy 0, policy_version 63975 (0.0009) [2023-12-27 19:41:26,095][106225] Updated weights for policy 1, policy_version 64181 (0.0009) [2023-12-27 19:41:26,155][106225] Updated weights for policy 1, policy_version 64191 (0.0010) [2023-12-27 19:41:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 32817152. Throughput: 0: 9825.4, 1: 9883.5. Samples: 32791132. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:26,175][105115] Avg episode reward: [(0, '-6.465'), (1, '-6.338')] [2023-12-27 19:41:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000063976_16384000.pth... [2023-12-27 19:41:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000062824_16089088.pth [2023-12-27 19:41:26,214][106225] Updated weights for policy 1, policy_version 64201 (0.0010) [2023-12-27 19:41:26,250][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000064208_16441344.pth... [2023-12-27 19:41:26,254][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000063024_16138240.pth [2023-12-27 19:41:26,473][106226] Updated weights for policy 0, policy_version 63985 (0.0009) [2023-12-27 19:41:26,525][106226] Updated weights for policy 0, policy_version 63995 (0.0011) [2023-12-27 19:41:26,581][106226] Updated weights for policy 0, policy_version 64005 (0.0008) [2023-12-27 19:41:26,766][106225] Updated weights for policy 1, policy_version 64211 (0.0009) [2023-12-27 19:41:26,826][106225] Updated weights for policy 1, policy_version 64221 (0.0005) [2023-12-27 19:41:26,888][106225] Updated weights for policy 1, policy_version 64231 (0.0005) [2023-12-27 19:41:27,265][106226] Updated weights for policy 0, policy_version 64015 (0.0007) [2023-12-27 19:41:27,325][106226] Updated weights for policy 0, policy_version 64025 (0.0005) [2023-12-27 19:41:27,390][106226] Updated weights for policy 0, policy_version 64035 (0.0005) [2023-12-27 19:41:27,451][106225] Updated weights for policy 1, policy_version 64241 (0.0009) [2023-12-27 19:41:27,511][106225] Updated weights for policy 1, policy_version 64251 (0.0006) [2023-12-27 19:41:27,559][106225] Updated weights for policy 1, policy_version 64261 (0.0008) [2023-12-27 19:41:27,611][106225] Updated weights for policy 1, policy_version 64271 (0.0007) [2023-12-27 19:41:27,877][106226] Updated weights for policy 0, policy_version 64045 (0.0005) [2023-12-27 19:41:27,923][106226] Updated weights for policy 0, policy_version 64055 (0.0007) [2023-12-27 19:41:27,973][106226] Updated weights for policy 0, policy_version 64065 (0.0008) [2023-12-27 19:41:28,255][106225] Updated weights for policy 1, policy_version 64281 (0.0010) [2023-12-27 19:41:28,302][106225] Updated weights for policy 1, policy_version 64291 (0.0010) [2023-12-27 19:41:28,366][106225] Updated weights for policy 1, policy_version 64301 (0.0009) [2023-12-27 19:41:28,710][106226] Updated weights for policy 0, policy_version 64075 (0.0008) [2023-12-27 19:41:28,770][106226] Updated weights for policy 0, policy_version 64085 (0.0011) [2023-12-27 19:41:28,827][106226] Updated weights for policy 0, policy_version 64095 (0.0010) [2023-12-27 19:41:28,972][106225] Updated weights for policy 1, policy_version 64311 (0.0009) [2023-12-27 19:41:29,024][106225] Updated weights for policy 1, policy_version 64321 (0.0010) [2023-12-27 19:41:29,079][106225] Updated weights for policy 1, policy_version 64331 (0.0010) [2023-12-27 19:41:29,540][106226] Updated weights for policy 0, policy_version 64105 (0.0010) [2023-12-27 19:41:29,615][106226] Updated weights for policy 0, policy_version 64115 (0.0005) [2023-12-27 19:41:29,682][106226] Updated weights for policy 0, policy_version 64125 (0.0006) [2023-12-27 19:41:29,737][106225] Updated weights for policy 1, policy_version 64341 (0.0009) [2023-12-27 19:41:29,749][106226] Updated weights for policy 0, policy_version 64135 (0.0006) [2023-12-27 19:41:29,798][106225] Updated weights for policy 1, policy_version 64351 (0.0008) [2023-12-27 19:41:29,862][106225] Updated weights for policy 1, policy_version 64361 (0.0008) [2023-12-27 19:41:30,355][106226] Updated weights for policy 0, policy_version 64145 (0.0005) [2023-12-27 19:41:30,413][106226] Updated weights for policy 0, policy_version 64155 (0.0008) [2023-12-27 19:41:30,469][106226] Updated weights for policy 0, policy_version 64165 (0.0009) [2023-12-27 19:41:30,516][106225] Updated weights for policy 1, policy_version 64371 (0.0008) [2023-12-27 19:41:30,567][106225] Updated weights for policy 1, policy_version 64381 (0.0008) [2023-12-27 19:41:30,614][106225] Updated weights for policy 1, policy_version 64391 (0.0008) [2023-12-27 19:41:31,093][106226] Updated weights for policy 0, policy_version 64175 (0.0006) [2023-12-27 19:41:31,164][106226] Updated weights for policy 0, policy_version 64185 (0.0008) [2023-12-27 19:41:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 32923648. Throughput: 0: 9944.2, 1: 10031.1. Samples: 32916528. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:31,175][105115] Avg episode reward: [(0, '-6.840'), (1, '-6.560')] [2023-12-27 19:41:31,218][106226] Updated weights for policy 0, policy_version 64195 (0.0005) [2023-12-27 19:41:31,290][106225] Updated weights for policy 1, policy_version 64401 (0.0008) [2023-12-27 19:41:31,363][106225] Updated weights for policy 1, policy_version 64411 (0.0008) [2023-12-27 19:41:31,429][106225] Updated weights for policy 1, policy_version 64421 (0.0008) [2023-12-27 19:41:31,484][106225] Updated weights for policy 1, policy_version 64431 (0.0006) [2023-12-27 19:41:31,875][106226] Updated weights for policy 0, policy_version 64205 (0.0008) [2023-12-27 19:41:31,935][106226] Updated weights for policy 0, policy_version 64215 (0.0009) [2023-12-27 19:41:31,990][106226] Updated weights for policy 0, policy_version 64225 (0.0008) [2023-12-27 19:41:32,211][106225] Updated weights for policy 1, policy_version 64441 (0.0008) [2023-12-27 19:41:32,262][106225] Updated weights for policy 1, policy_version 64451 (0.0006) [2023-12-27 19:41:32,319][106225] Updated weights for policy 1, policy_version 64461 (0.0007) [2023-12-27 19:41:32,763][106226] Updated weights for policy 0, policy_version 64235 (0.0008) [2023-12-27 19:41:32,817][106226] Updated weights for policy 0, policy_version 64245 (0.0007) [2023-12-27 19:41:32,865][106226] Updated weights for policy 0, policy_version 64255 (0.0009) [2023-12-27 19:41:33,010][106225] Updated weights for policy 1, policy_version 64471 (0.0008) [2023-12-27 19:41:33,073][106225] Updated weights for policy 1, policy_version 64481 (0.0009) [2023-12-27 19:41:33,135][106225] Updated weights for policy 1, policy_version 64491 (0.0008) [2023-12-27 19:41:33,521][106226] Updated weights for policy 0, policy_version 64265 (0.0008) [2023-12-27 19:41:33,572][106226] Updated weights for policy 0, policy_version 64275 (0.0009) [2023-12-27 19:41:33,617][106226] Updated weights for policy 0, policy_version 64285 (0.0005) [2023-12-27 19:41:33,671][106226] Updated weights for policy 0, policy_version 64295 (0.0006) [2023-12-27 19:41:33,883][106225] Updated weights for policy 1, policy_version 64501 (0.0008) [2023-12-27 19:41:33,939][106225] Updated weights for policy 1, policy_version 64511 (0.0008) [2023-12-27 19:41:33,993][106225] Updated weights for policy 1, policy_version 64521 (0.0007) [2023-12-27 19:41:34,380][106226] Updated weights for policy 0, policy_version 64305 (0.0008) [2023-12-27 19:41:34,446][106226] Updated weights for policy 0, policy_version 64315 (0.0011) [2023-12-27 19:41:34,510][106226] Updated weights for policy 0, policy_version 64325 (0.0010) [2023-12-27 19:41:34,713][106225] Updated weights for policy 1, policy_version 64531 (0.0008) [2023-12-27 19:41:34,778][106225] Updated weights for policy 1, policy_version 64541 (0.0008) [2023-12-27 19:41:34,834][106225] Updated weights for policy 1, policy_version 64551 (0.0008) [2023-12-27 19:41:35,148][106226] Updated weights for policy 0, policy_version 64335 (0.0009) [2023-12-27 19:41:35,202][106226] Updated weights for policy 0, policy_version 64345 (0.0010) [2023-12-27 19:41:35,251][106226] Updated weights for policy 0, policy_version 64355 (0.0010) [2023-12-27 19:41:35,481][106225] Updated weights for policy 1, policy_version 64561 (0.0008) [2023-12-27 19:41:35,536][106225] Updated weights for policy 1, policy_version 64571 (0.0007) [2023-12-27 19:41:35,593][106225] Updated weights for policy 1, policy_version 64581 (0.0007) [2023-12-27 19:41:35,663][106225] Updated weights for policy 1, policy_version 64591 (0.0008) [2023-12-27 19:41:35,964][106226] Updated weights for policy 0, policy_version 64365 (0.0008) [2023-12-27 19:41:36,034][106226] Updated weights for policy 0, policy_version 64375 (0.0007) [2023-12-27 19:41:36,102][106226] Updated weights for policy 0, policy_version 64385 (0.0006) [2023-12-27 19:41:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 33030144. Throughput: 0: 9933.6, 1: 10027.5. Samples: 33037556. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:36,175][105115] Avg episode reward: [(0, '-6.130'), (1, '-6.071')] [2023-12-27 19:41:36,417][106225] Updated weights for policy 1, policy_version 64601 (0.0008) [2023-12-27 19:41:36,477][106225] Updated weights for policy 1, policy_version 64611 (0.0008) [2023-12-27 19:41:36,535][106225] Updated weights for policy 1, policy_version 64621 (0.0010) [2023-12-27 19:41:36,727][106226] Updated weights for policy 0, policy_version 64395 (0.0009) [2023-12-27 19:41:36,791][106226] Updated weights for policy 0, policy_version 64405 (0.0011) [2023-12-27 19:41:36,842][106226] Updated weights for policy 0, policy_version 64415 (0.0009) [2023-12-27 19:41:37,248][106225] Updated weights for policy 1, policy_version 64631 (0.0010) [2023-12-27 19:41:37,311][106225] Updated weights for policy 1, policy_version 64641 (0.0009) [2023-12-27 19:41:37,361][106225] Updated weights for policy 1, policy_version 64651 (0.0010) [2023-12-27 19:41:37,445][106226] Updated weights for policy 0, policy_version 64425 (0.0006) [2023-12-27 19:41:37,494][106226] Updated weights for policy 0, policy_version 64435 (0.0005) [2023-12-27 19:41:37,543][106226] Updated weights for policy 0, policy_version 64445 (0.0005) [2023-12-27 19:41:37,590][106226] Updated weights for policy 0, policy_version 64455 (0.0008) [2023-12-27 19:41:38,027][106225] Updated weights for policy 1, policy_version 64661 (0.0010) [2023-12-27 19:41:38,083][106225] Updated weights for policy 1, policy_version 64671 (0.0010) [2023-12-27 19:41:38,133][106225] Updated weights for policy 1, policy_version 64681 (0.0010) [2023-12-27 19:41:38,235][106226] Updated weights for policy 0, policy_version 64465 (0.0006) [2023-12-27 19:41:38,291][106226] Updated weights for policy 0, policy_version 64475 (0.0005) [2023-12-27 19:41:38,362][106226] Updated weights for policy 0, policy_version 64485 (0.0009) [2023-12-27 19:41:38,865][106225] Updated weights for policy 1, policy_version 64691 (0.0010) [2023-12-27 19:41:38,912][106225] Updated weights for policy 1, policy_version 64701 (0.0010) [2023-12-27 19:41:38,962][106225] Updated weights for policy 1, policy_version 64711 (0.0010) [2023-12-27 19:41:39,037][106226] Updated weights for policy 0, policy_version 64495 (0.0011) [2023-12-27 19:41:39,103][106226] Updated weights for policy 0, policy_version 64505 (0.0010) [2023-12-27 19:41:39,162][106226] Updated weights for policy 0, policy_version 64515 (0.0010) [2023-12-27 19:41:39,792][106225] Updated weights for policy 1, policy_version 64721 (0.0010) [2023-12-27 19:41:39,817][106226] Updated weights for policy 0, policy_version 64525 (0.0010) [2023-12-27 19:41:39,862][106225] Updated weights for policy 1, policy_version 64731 (0.0008) [2023-12-27 19:41:39,889][106226] Updated weights for policy 0, policy_version 64535 (0.0009) [2023-12-27 19:41:39,925][106225] Updated weights for policy 1, policy_version 64741 (0.0007) [2023-12-27 19:41:39,956][106226] Updated weights for policy 0, policy_version 64545 (0.0008) [2023-12-27 19:41:39,993][106225] Updated weights for policy 1, policy_version 64751 (0.0008) [2023-12-27 19:41:40,656][106225] Updated weights for policy 1, policy_version 64761 (0.0008) [2023-12-27 19:41:40,703][106225] Updated weights for policy 1, policy_version 64771 (0.0008) [2023-12-27 19:41:40,723][106226] Updated weights for policy 0, policy_version 64555 (0.0009) [2023-12-27 19:41:40,755][106225] Updated weights for policy 1, policy_version 64781 (0.0007) [2023-12-27 19:41:40,779][106226] Updated weights for policy 0, policy_version 64565 (0.0010) [2023-12-27 19:41:40,851][106226] Updated weights for policy 0, policy_version 64576 (0.0005) [2023-12-27 19:41:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 33128448. Throughput: 0: 9995.8, 1: 10028.9. Samples: 33098864. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:41,175][105115] Avg episode reward: [(0, '-6.411'), (1, '-6.390')] [2023-12-27 19:41:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000064784_16588800.pth... [2023-12-27 19:41:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000064584_16539648.pth... [2023-12-27 19:41:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000063632_16293888.pth [2023-12-27 19:41:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000063400_16236544.pth [2023-12-27 19:41:41,491][106226] Updated weights for policy 0, policy_version 64586 (0.0007) [2023-12-27 19:41:41,548][106226] Updated weights for policy 0, policy_version 64596 (0.0010) [2023-12-27 19:41:41,561][106225] Updated weights for policy 1, policy_version 64791 (0.0007) [2023-12-27 19:41:41,609][106226] Updated weights for policy 0, policy_version 64606 (0.0009) [2023-12-27 19:41:41,624][106225] Updated weights for policy 1, policy_version 64801 (0.0007) [2023-12-27 19:41:41,673][106226] Updated weights for policy 0, policy_version 64616 (0.0009) [2023-12-27 19:41:41,691][106225] Updated weights for policy 1, policy_version 64811 (0.0007) [2023-12-27 19:41:42,400][106225] Updated weights for policy 1, policy_version 64821 (0.0009) [2023-12-27 19:41:42,459][106225] Updated weights for policy 1, policy_version 64831 (0.0007) [2023-12-27 19:41:42,463][106226] Updated weights for policy 0, policy_version 64626 (0.0010) [2023-12-27 19:41:42,520][106225] Updated weights for policy 1, policy_version 64841 (0.0006) [2023-12-27 19:41:42,522][106226] Updated weights for policy 0, policy_version 64636 (0.0006) [2023-12-27 19:41:42,585][106226] Updated weights for policy 0, policy_version 64646 (0.0009) [2023-12-27 19:41:43,249][106225] Updated weights for policy 1, policy_version 64851 (0.0006) [2023-12-27 19:41:43,291][106226] Updated weights for policy 0, policy_version 64656 (0.0009) [2023-12-27 19:41:43,298][106225] Updated weights for policy 1, policy_version 64861 (0.0007) [2023-12-27 19:41:43,342][106226] Updated weights for policy 0, policy_version 64666 (0.0006) [2023-12-27 19:41:43,344][106225] Updated weights for policy 1, policy_version 64871 (0.0007) [2023-12-27 19:41:43,400][106226] Updated weights for policy 0, policy_version 64676 (0.0007) [2023-12-27 19:41:44,017][106225] Updated weights for policy 1, policy_version 64881 (0.0006) [2023-12-27 19:41:44,080][106225] Updated weights for policy 1, policy_version 64891 (0.0007) [2023-12-27 19:41:44,144][106225] Updated weights for policy 1, policy_version 64901 (0.0007) [2023-12-27 19:41:44,196][106226] Updated weights for policy 0, policy_version 64686 (0.0007) [2023-12-27 19:41:44,203][106225] Updated weights for policy 1, policy_version 64911 (0.0009) [2023-12-27 19:41:44,249][106226] Updated weights for policy 0, policy_version 64696 (0.0005) [2023-12-27 19:41:44,299][106226] Updated weights for policy 0, policy_version 64706 (0.0005) [2023-12-27 19:41:44,903][106225] Updated weights for policy 1, policy_version 64921 (0.0008) [2023-12-27 19:41:44,967][106225] Updated weights for policy 1, policy_version 64931 (0.0008) [2023-12-27 19:41:44,980][106226] Updated weights for policy 0, policy_version 64716 (0.0008) [2023-12-27 19:41:45,027][106225] Updated weights for policy 1, policy_version 64941 (0.0008) [2023-12-27 19:41:45,042][106226] Updated weights for policy 0, policy_version 64726 (0.0006) [2023-12-27 19:41:45,114][106226] Updated weights for policy 0, policy_version 64736 (0.0006) [2023-12-27 19:41:45,771][106226] Updated weights for policy 0, policy_version 64746 (0.0008) [2023-12-27 19:41:45,777][106225] Updated weights for policy 1, policy_version 64951 (0.0009) [2023-12-27 19:41:45,830][106225] Updated weights for policy 1, policy_version 64961 (0.0007) [2023-12-27 19:41:45,833][106226] Updated weights for policy 0, policy_version 64756 (0.0006) [2023-12-27 19:41:45,896][106226] Updated weights for policy 0, policy_version 64766 (0.0006) [2023-12-27 19:41:45,898][106225] Updated weights for policy 1, policy_version 64971 (0.0008) [2023-12-27 19:41:45,954][106226] Updated weights for policy 0, policy_version 64776 (0.0007) [2023-12-27 19:41:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 33226752. Throughput: 0: 9992.6, 1: 9945.0. Samples: 33213436. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:46,175][105115] Avg episode reward: [(0, '-6.651'), (1, '-6.089')] [2023-12-27 19:41:46,571][106226] Updated weights for policy 0, policy_version 64786 (0.0007) [2023-12-27 19:41:46,624][106226] Updated weights for policy 0, policy_version 64796 (0.0005) [2023-12-27 19:41:46,656][106225] Updated weights for policy 1, policy_version 64981 (0.0007) [2023-12-27 19:41:46,677][106226] Updated weights for policy 0, policy_version 64806 (0.0005) [2023-12-27 19:41:46,703][106225] Updated weights for policy 1, policy_version 64991 (0.0008) [2023-12-27 19:41:46,757][106225] Updated weights for policy 1, policy_version 65001 (0.0009) [2023-12-27 19:41:47,243][106226] Updated weights for policy 0, policy_version 64816 (0.0005) [2023-12-27 19:41:47,314][106226] Updated weights for policy 0, policy_version 64826 (0.0005) [2023-12-27 19:41:47,380][106226] Updated weights for policy 0, policy_version 64836 (0.0005) [2023-12-27 19:41:47,471][106225] Updated weights for policy 1, policy_version 65011 (0.0008) [2023-12-27 19:41:47,525][106225] Updated weights for policy 1, policy_version 65021 (0.0008) [2023-12-27 19:41:47,574][106225] Updated weights for policy 1, policy_version 65031 (0.0008) [2023-12-27 19:41:47,908][106226] Updated weights for policy 0, policy_version 64846 (0.0008) [2023-12-27 19:41:47,958][106226] Updated weights for policy 0, policy_version 64856 (0.0010) [2023-12-27 19:41:48,018][106226] Updated weights for policy 0, policy_version 64866 (0.0009) [2023-12-27 19:41:48,407][106225] Updated weights for policy 1, policy_version 65041 (0.0009) [2023-12-27 19:41:48,477][106225] Updated weights for policy 1, policy_version 65051 (0.0005) [2023-12-27 19:41:48,542][106225] Updated weights for policy 1, policy_version 65061 (0.0005) [2023-12-27 19:41:48,607][106225] Updated weights for policy 1, policy_version 65071 (0.0006) [2023-12-27 19:41:48,609][106226] Updated weights for policy 0, policy_version 64876 (0.0006) [2023-12-27 19:41:48,682][106226] Updated weights for policy 0, policy_version 64886 (0.0006) [2023-12-27 19:41:48,748][106226] Updated weights for policy 0, policy_version 64896 (0.0008) [2023-12-27 19:41:49,250][106225] Updated weights for policy 1, policy_version 65081 (0.0009) [2023-12-27 19:41:49,317][106225] Updated weights for policy 1, policy_version 65091 (0.0011) [2023-12-27 19:41:49,386][106225] Updated weights for policy 1, policy_version 65101 (0.0010) [2023-12-27 19:41:49,440][106226] Updated weights for policy 0, policy_version 64906 (0.0008) [2023-12-27 19:41:49,500][106226] Updated weights for policy 0, policy_version 64916 (0.0007) [2023-12-27 19:41:49,548][106226] Updated weights for policy 0, policy_version 64926 (0.0008) [2023-12-27 19:41:49,595][106226] Updated weights for policy 0, policy_version 64936 (0.0008) [2023-12-27 19:41:50,121][106225] Updated weights for policy 1, policy_version 65111 (0.0010) [2023-12-27 19:41:50,179][106225] Updated weights for policy 1, policy_version 65121 (0.0006) [2023-12-27 19:41:50,244][106225] Updated weights for policy 1, policy_version 65131 (0.0007) [2023-12-27 19:41:50,329][106226] Updated weights for policy 0, policy_version 64946 (0.0006) [2023-12-27 19:41:50,386][106226] Updated weights for policy 0, policy_version 64956 (0.0007) [2023-12-27 19:41:50,437][106226] Updated weights for policy 0, policy_version 64966 (0.0010) [2023-12-27 19:41:50,936][106225] Updated weights for policy 1, policy_version 65141 (0.0010) [2023-12-27 19:41:50,996][106225] Updated weights for policy 1, policy_version 65151 (0.0007) [2023-12-27 19:41:51,061][106225] Updated weights for policy 1, policy_version 65161 (0.0011) [2023-12-27 19:41:51,126][106226] Updated weights for policy 0, policy_version 64976 (0.0007) [2023-12-27 19:41:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 33325056. Throughput: 0: 10132.3, 1: 9850.8. Samples: 33334904. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 19:41:51,175][105115] Avg episode reward: [(0, '-6.594'), (1, '-6.624')] [2023-12-27 19:41:51,194][106226] Updated weights for policy 0, policy_version 64986 (0.0008) [2023-12-27 19:41:51,261][106226] Updated weights for policy 0, policy_version 64996 (0.0007) [2023-12-27 19:41:51,842][106225] Updated weights for policy 1, policy_version 65171 (0.0010) [2023-12-27 19:41:51,905][106225] Updated weights for policy 1, policy_version 65181 (0.0011) [2023-12-27 19:41:51,964][106225] Updated weights for policy 1, policy_version 65191 (0.0011) [2023-12-27 19:41:52,011][106226] Updated weights for policy 0, policy_version 65006 (0.0007) [2023-12-27 19:41:52,069][106226] Updated weights for policy 0, policy_version 65016 (0.0007) [2023-12-27 19:41:52,121][106226] Updated weights for policy 0, policy_version 65026 (0.0008) [2023-12-27 19:41:52,627][106225] Updated weights for policy 1, policy_version 65201 (0.0009) [2023-12-27 19:41:52,677][106225] Updated weights for policy 1, policy_version 65211 (0.0010) [2023-12-27 19:41:52,736][106225] Updated weights for policy 1, policy_version 65221 (0.0010) [2023-12-27 19:41:52,793][106225] Updated weights for policy 1, policy_version 65231 (0.0010) [2023-12-27 19:41:52,857][106226] Updated weights for policy 0, policy_version 65036 (0.0008) [2023-12-27 19:41:52,922][106226] Updated weights for policy 0, policy_version 65046 (0.0008) [2023-12-27 19:41:52,986][106226] Updated weights for policy 0, policy_version 65056 (0.0008) [2023-12-27 19:41:53,426][106225] Updated weights for policy 1, policy_version 65241 (0.0009) [2023-12-27 19:41:53,479][106225] Updated weights for policy 1, policy_version 65251 (0.0010) [2023-12-27 19:41:53,532][106225] Updated weights for policy 1, policy_version 65261 (0.0010) [2023-12-27 19:41:53,767][106226] Updated weights for policy 0, policy_version 65066 (0.0009) [2023-12-27 19:41:53,823][106226] Updated weights for policy 0, policy_version 65076 (0.0008) [2023-12-27 19:41:53,880][106226] Updated weights for policy 0, policy_version 65086 (0.0008) [2023-12-27 19:41:53,938][106226] Updated weights for policy 0, policy_version 65096 (0.0008) [2023-12-27 19:41:54,201][106225] Updated weights for policy 1, policy_version 65271 (0.0008) [2023-12-27 19:41:54,251][106225] Updated weights for policy 1, policy_version 65281 (0.0008) [2023-12-27 19:41:54,306][106225] Updated weights for policy 1, policy_version 65291 (0.0007) [2023-12-27 19:41:54,671][106226] Updated weights for policy 0, policy_version 65106 (0.0008) [2023-12-27 19:41:54,729][106226] Updated weights for policy 0, policy_version 65116 (0.0008) [2023-12-27 19:41:54,780][106226] Updated weights for policy 0, policy_version 65126 (0.0008) [2023-12-27 19:41:55,039][106225] Updated weights for policy 1, policy_version 65301 (0.0009) [2023-12-27 19:41:55,089][106225] Updated weights for policy 1, policy_version 65311 (0.0008) [2023-12-27 19:41:55,142][106225] Updated weights for policy 1, policy_version 65321 (0.0010) [2023-12-27 19:41:55,463][106226] Updated weights for policy 0, policy_version 65136 (0.0007) [2023-12-27 19:41:55,521][106226] Updated weights for policy 0, policy_version 65146 (0.0008) [2023-12-27 19:41:55,576][106226] Updated weights for policy 0, policy_version 65156 (0.0007) [2023-12-27 19:41:55,858][106225] Updated weights for policy 1, policy_version 65331 (0.0010) [2023-12-27 19:41:55,915][106225] Updated weights for policy 1, policy_version 65341 (0.0010) [2023-12-27 19:41:55,968][106225] Updated weights for policy 1, policy_version 65351 (0.0010) [2023-12-27 19:41:56,155][106226] Updated weights for policy 0, policy_version 65166 (0.0006) [2023-12-27 19:41:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 33423360. Throughput: 0: 10048.5, 1: 9870.2. Samples: 33392412. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:41:56,175][105115] Avg episode reward: [(0, '-6.691'), (1, '-6.438')] [2023-12-27 19:41:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000065360_16736256.pth... [2023-12-27 19:41:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000064208_16441344.pth [2023-12-27 19:41:56,210][106226] Updated weights for policy 0, policy_version 65176 (0.0008) [2023-12-27 19:41:56,263][106226] Updated weights for policy 0, policy_version 65186 (0.0008) [2023-12-27 19:41:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000065192_16695296.pth... [2023-12-27 19:41:56,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000063976_16384000.pth [2023-12-27 19:41:56,679][106225] Updated weights for policy 1, policy_version 65361 (0.0010) [2023-12-27 19:41:56,729][106225] Updated weights for policy 1, policy_version 65371 (0.0010) [2023-12-27 19:41:56,784][106225] Updated weights for policy 1, policy_version 65381 (0.0010) [2023-12-27 19:41:56,852][106225] Updated weights for policy 1, policy_version 65391 (0.0009) [2023-12-27 19:41:56,969][106226] Updated weights for policy 0, policy_version 65196 (0.0008) [2023-12-27 19:41:57,028][106226] Updated weights for policy 0, policy_version 65206 (0.0008) [2023-12-27 19:41:57,075][106226] Updated weights for policy 0, policy_version 65216 (0.0008) [2023-12-27 19:41:57,553][106225] Updated weights for policy 1, policy_version 65401 (0.0008) [2023-12-27 19:41:57,598][106225] Updated weights for policy 1, policy_version 65411 (0.0009) [2023-12-27 19:41:57,656][106225] Updated weights for policy 1, policy_version 65421 (0.0010) [2023-12-27 19:41:57,724][106226] Updated weights for policy 0, policy_version 65226 (0.0008) [2023-12-27 19:41:57,774][106226] Updated weights for policy 0, policy_version 65236 (0.0009) [2023-12-27 19:41:57,832][106226] Updated weights for policy 0, policy_version 65246 (0.0009) [2023-12-27 19:41:57,893][106226] Updated weights for policy 0, policy_version 65256 (0.0008) [2023-12-27 19:41:58,261][106225] Updated weights for policy 1, policy_version 65431 (0.0008) [2023-12-27 19:41:58,322][106225] Updated weights for policy 1, policy_version 65441 (0.0008) [2023-12-27 19:41:58,389][106225] Updated weights for policy 1, policy_version 65451 (0.0008) [2023-12-27 19:41:58,685][106226] Updated weights for policy 0, policy_version 65266 (0.0007) [2023-12-27 19:41:58,752][106226] Updated weights for policy 0, policy_version 65276 (0.0007) [2023-12-27 19:41:58,824][106226] Updated weights for policy 0, policy_version 65286 (0.0009) [2023-12-27 19:41:59,168][106225] Updated weights for policy 1, policy_version 65461 (0.0009) [2023-12-27 19:41:59,238][106225] Updated weights for policy 1, policy_version 65471 (0.0009) [2023-12-27 19:41:59,304][106225] Updated weights for policy 1, policy_version 65482 (0.0009) [2023-12-27 19:41:59,574][106226] Updated weights for policy 0, policy_version 65296 (0.0010) [2023-12-27 19:41:59,627][106226] Updated weights for policy 0, policy_version 65306 (0.0010) [2023-12-27 19:41:59,681][106226] Updated weights for policy 0, policy_version 65316 (0.0010) [2023-12-27 19:42:00,098][106225] Updated weights for policy 1, policy_version 65492 (0.0008) [2023-12-27 19:42:00,160][106225] Updated weights for policy 1, policy_version 65502 (0.0005) [2023-12-27 19:42:00,227][106225] Updated weights for policy 1, policy_version 65512 (0.0008) [2023-12-27 19:42:00,438][106226] Updated weights for policy 0, policy_version 65326 (0.0009) [2023-12-27 19:42:00,493][106226] Updated weights for policy 0, policy_version 65336 (0.0008) [2023-12-27 19:42:00,544][106226] Updated weights for policy 0, policy_version 65346 (0.0008) [2023-12-27 19:42:00,880][106225] Updated weights for policy 1, policy_version 65522 (0.0009) [2023-12-27 19:42:00,930][106225] Updated weights for policy 1, policy_version 65532 (0.0010) [2023-12-27 19:42:00,980][106225] Updated weights for policy 1, policy_version 65542 (0.0010) [2023-12-27 19:42:01,031][106225] Updated weights for policy 1, policy_version 65552 (0.0009) [2023-12-27 19:42:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 33521664. Throughput: 0: 10074.0, 1: 9888.0. Samples: 33510676. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:01,176][105115] Avg episode reward: [(0, '-6.595'), (1, '-6.655')] [2023-12-27 19:42:01,339][106226] Updated weights for policy 0, policy_version 65356 (0.0008) [2023-12-27 19:42:01,410][106226] Updated weights for policy 0, policy_version 65366 (0.0008) [2023-12-27 19:42:01,469][106226] Updated weights for policy 0, policy_version 65376 (0.0008) [2023-12-27 19:42:01,749][106225] Updated weights for policy 1, policy_version 65562 (0.0008) [2023-12-27 19:42:01,809][106225] Updated weights for policy 1, policy_version 65572 (0.0008) [2023-12-27 19:42:01,868][106225] Updated weights for policy 1, policy_version 65582 (0.0009) [2023-12-27 19:42:02,147][106226] Updated weights for policy 0, policy_version 65386 (0.0007) [2023-12-27 19:42:02,205][106226] Updated weights for policy 0, policy_version 65396 (0.0005) [2023-12-27 19:42:02,268][106226] Updated weights for policy 0, policy_version 65406 (0.0008) [2023-12-27 19:42:02,337][106226] Updated weights for policy 0, policy_version 65416 (0.0009) [2023-12-27 19:42:02,620][106225] Updated weights for policy 1, policy_version 65592 (0.0008) [2023-12-27 19:42:02,679][106225] Updated weights for policy 1, policy_version 65602 (0.0008) [2023-12-27 19:42:02,735][106225] Updated weights for policy 1, policy_version 65612 (0.0008) [2023-12-27 19:42:03,018][106226] Updated weights for policy 0, policy_version 65426 (0.0009) [2023-12-27 19:42:03,065][106226] Updated weights for policy 0, policy_version 65436 (0.0008) [2023-12-27 19:42:03,126][106226] Updated weights for policy 0, policy_version 65446 (0.0009) [2023-12-27 19:42:03,358][106225] Updated weights for policy 1, policy_version 65622 (0.0006) [2023-12-27 19:42:03,408][106225] Updated weights for policy 1, policy_version 65632 (0.0006) [2023-12-27 19:42:03,464][106225] Updated weights for policy 1, policy_version 65642 (0.0010) [2023-12-27 19:42:03,923][106226] Updated weights for policy 0, policy_version 65456 (0.0008) [2023-12-27 19:42:03,991][106226] Updated weights for policy 0, policy_version 65466 (0.0008) [2023-12-27 19:42:04,048][106226] Updated weights for policy 0, policy_version 65476 (0.0007) [2023-12-27 19:42:04,113][106225] Updated weights for policy 1, policy_version 65652 (0.0010) [2023-12-27 19:42:04,178][106225] Updated weights for policy 1, policy_version 65662 (0.0008) [2023-12-27 19:42:04,239][106225] Updated weights for policy 1, policy_version 65672 (0.0010) [2023-12-27 19:42:04,820][106225] Updated weights for policy 1, policy_version 65682 (0.0010) [2023-12-27 19:42:04,831][106226] Updated weights for policy 0, policy_version 65486 (0.0009) [2023-12-27 19:42:04,879][106225] Updated weights for policy 1, policy_version 65692 (0.0007) [2023-12-27 19:42:04,896][106226] Updated weights for policy 0, policy_version 65496 (0.0005) [2023-12-27 19:42:04,938][106225] Updated weights for policy 1, policy_version 65702 (0.0005) [2023-12-27 19:42:04,957][106226] Updated weights for policy 0, policy_version 65506 (0.0005) [2023-12-27 19:42:04,994][106225] Updated weights for policy 1, policy_version 65712 (0.0006) [2023-12-27 19:42:05,605][106226] Updated weights for policy 0, policy_version 65516 (0.0005) [2023-12-27 19:42:05,655][106225] Updated weights for policy 1, policy_version 65722 (0.0010) [2023-12-27 19:42:05,659][106226] Updated weights for policy 0, policy_version 65526 (0.0008) [2023-12-27 19:42:05,701][106225] Updated weights for policy 1, policy_version 65732 (0.0010) [2023-12-27 19:42:05,711][106226] Updated weights for policy 0, policy_version 65536 (0.0008) [2023-12-27 19:42:05,747][106225] Updated weights for policy 1, policy_version 65742 (0.0010) [2023-12-27 19:42:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 33619968. Throughput: 0: 10021.3, 1: 9878.4. Samples: 33629304. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:06,175][105115] Avg episode reward: [(0, '-5.955'), (1, '-6.038')] [2023-12-27 19:42:06,421][106226] Updated weights for policy 0, policy_version 65546 (0.0005) [2023-12-27 19:42:06,450][106225] Updated weights for policy 1, policy_version 65752 (0.0008) [2023-12-27 19:42:06,474][106226] Updated weights for policy 0, policy_version 65556 (0.0005) [2023-12-27 19:42:06,516][106225] Updated weights for policy 1, policy_version 65762 (0.0011) [2023-12-27 19:42:06,540][106226] Updated weights for policy 0, policy_version 65566 (0.0006) [2023-12-27 19:42:06,580][106225] Updated weights for policy 1, policy_version 65772 (0.0009) [2023-12-27 19:42:06,604][106226] Updated weights for policy 0, policy_version 65576 (0.0006) [2023-12-27 19:42:07,216][106225] Updated weights for policy 1, policy_version 65782 (0.0010) [2023-12-27 19:42:07,266][106226] Updated weights for policy 0, policy_version 65586 (0.0008) [2023-12-27 19:42:07,277][106225] Updated weights for policy 1, policy_version 65792 (0.0011) [2023-12-27 19:42:07,314][106226] Updated weights for policy 0, policy_version 65596 (0.0005) [2023-12-27 19:42:07,324][106225] Updated weights for policy 1, policy_version 65802 (0.0010) [2023-12-27 19:42:07,380][106226] Updated weights for policy 0, policy_version 65606 (0.0007) [2023-12-27 19:42:07,971][106226] Updated weights for policy 0, policy_version 65616 (0.0008) [2023-12-27 19:42:08,030][106226] Updated weights for policy 0, policy_version 65626 (0.0008) [2023-12-27 19:42:08,053][106225] Updated weights for policy 1, policy_version 65812 (0.0010) [2023-12-27 19:42:08,085][106226] Updated weights for policy 0, policy_version 65636 (0.0008) [2023-12-27 19:42:08,113][106225] Updated weights for policy 1, policy_version 65822 (0.0006) [2023-12-27 19:42:08,159][106225] Updated weights for policy 1, policy_version 65832 (0.0005) [2023-12-27 19:42:08,813][106225] Updated weights for policy 1, policy_version 65842 (0.0006) [2023-12-27 19:42:08,816][106226] Updated weights for policy 0, policy_version 65646 (0.0007) [2023-12-27 19:42:08,879][106225] Updated weights for policy 1, policy_version 65852 (0.0007) [2023-12-27 19:42:08,888][106226] Updated weights for policy 0, policy_version 65656 (0.0007) [2023-12-27 19:42:08,944][106225] Updated weights for policy 1, policy_version 65862 (0.0007) [2023-12-27 19:42:08,968][106226] Updated weights for policy 0, policy_version 65666 (0.0007) [2023-12-27 19:42:09,014][106225] Updated weights for policy 1, policy_version 65872 (0.0007) [2023-12-27 19:42:09,623][106226] Updated weights for policy 0, policy_version 65676 (0.0007) [2023-12-27 19:42:09,691][106226] Updated weights for policy 0, policy_version 65686 (0.0005) [2023-12-27 19:42:09,703][106225] Updated weights for policy 1, policy_version 65882 (0.0008) [2023-12-27 19:42:09,757][106226] Updated weights for policy 0, policy_version 65696 (0.0005) [2023-12-27 19:42:09,768][106225] Updated weights for policy 1, policy_version 65892 (0.0008) [2023-12-27 19:42:09,833][106225] Updated weights for policy 1, policy_version 65902 (0.0008) [2023-12-27 19:42:10,489][106226] Updated weights for policy 0, policy_version 65706 (0.0007) [2023-12-27 19:42:10,526][106225] Updated weights for policy 1, policy_version 65912 (0.0007) [2023-12-27 19:42:10,549][106226] Updated weights for policy 0, policy_version 65716 (0.0007) [2023-12-27 19:42:10,579][106225] Updated weights for policy 1, policy_version 65922 (0.0008) [2023-12-27 19:42:10,614][106226] Updated weights for policy 0, policy_version 65726 (0.0006) [2023-12-27 19:42:10,640][106225] Updated weights for policy 1, policy_version 65932 (0.0008) [2023-12-27 19:42:10,679][106226] Updated weights for policy 0, policy_version 65736 (0.0009) [2023-12-27 19:42:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 33718272. Throughput: 0: 10061.0, 1: 9937.0. Samples: 33691044. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:11,175][105115] Avg episode reward: [(0, '-6.560'), (1, '-6.238')] [2023-12-27 19:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000065736_16834560.pth... [2023-12-27 19:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000065936_16883712.pth... [2023-12-27 19:42:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000064584_16539648.pth [2023-12-27 19:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000064784_16588800.pth [2023-12-27 19:42:11,266][106225] Updated weights for policy 1, policy_version 65942 (0.0010) [2023-12-27 19:42:11,324][106225] Updated weights for policy 1, policy_version 65952 (0.0008) [2023-12-27 19:42:11,393][106225] Updated weights for policy 1, policy_version 65962 (0.0008) [2023-12-27 19:42:11,487][106226] Updated weights for policy 0, policy_version 65746 (0.0008) [2023-12-27 19:42:11,535][106226] Updated weights for policy 0, policy_version 65756 (0.0008) [2023-12-27 19:42:11,595][106226] Updated weights for policy 0, policy_version 65766 (0.0008) [2023-12-27 19:42:12,168][106225] Updated weights for policy 1, policy_version 65972 (0.0008) [2023-12-27 19:42:12,245][106225] Updated weights for policy 1, policy_version 65982 (0.0008) [2023-12-27 19:42:12,305][106225] Updated weights for policy 1, policy_version 65992 (0.0008) [2023-12-27 19:42:12,378][106226] Updated weights for policy 0, policy_version 65776 (0.0008) [2023-12-27 19:42:12,440][106226] Updated weights for policy 0, policy_version 65786 (0.0007) [2023-12-27 19:42:12,502][106226] Updated weights for policy 0, policy_version 65796 (0.0008) [2023-12-27 19:42:13,049][106225] Updated weights for policy 1, policy_version 66002 (0.0007) [2023-12-27 19:42:13,111][106225] Updated weights for policy 1, policy_version 66012 (0.0009) [2023-12-27 19:42:13,178][106225] Updated weights for policy 1, policy_version 66022 (0.0009) [2023-12-27 19:42:13,234][106225] Updated weights for policy 1, policy_version 66032 (0.0007) [2023-12-27 19:42:13,255][106226] Updated weights for policy 0, policy_version 65806 (0.0008) [2023-12-27 19:42:13,305][106226] Updated weights for policy 0, policy_version 65816 (0.0009) [2023-12-27 19:42:13,366][106226] Updated weights for policy 0, policy_version 65826 (0.0008) [2023-12-27 19:42:13,890][106225] Updated weights for policy 1, policy_version 66042 (0.0010) [2023-12-27 19:42:13,936][106225] Updated weights for policy 1, policy_version 66052 (0.0010) [2023-12-27 19:42:13,996][106225] Updated weights for policy 1, policy_version 66062 (0.0010) [2023-12-27 19:42:14,138][106226] Updated weights for policy 0, policy_version 65836 (0.0007) [2023-12-27 19:42:14,189][106226] Updated weights for policy 0, policy_version 65846 (0.0008) [2023-12-27 19:42:14,256][106226] Updated weights for policy 0, policy_version 65856 (0.0008) [2023-12-27 19:42:14,694][106225] Updated weights for policy 1, policy_version 66072 (0.0006) [2023-12-27 19:42:14,744][106225] Updated weights for policy 1, policy_version 66082 (0.0007) [2023-12-27 19:42:14,810][106225] Updated weights for policy 1, policy_version 66092 (0.0009) [2023-12-27 19:42:14,918][106226] Updated weights for policy 0, policy_version 65866 (0.0008) [2023-12-27 19:42:14,979][106226] Updated weights for policy 0, policy_version 65876 (0.0007) [2023-12-27 19:42:15,046][106226] Updated weights for policy 0, policy_version 65886 (0.0007) [2023-12-27 19:42:15,106][106226] Updated weights for policy 0, policy_version 65896 (0.0006) [2023-12-27 19:42:15,474][106225] Updated weights for policy 1, policy_version 66102 (0.0009) [2023-12-27 19:42:15,521][106225] Updated weights for policy 1, policy_version 66112 (0.0010) [2023-12-27 19:42:15,577][106225] Updated weights for policy 1, policy_version 66122 (0.0010) [2023-12-27 19:42:15,719][106226] Updated weights for policy 0, policy_version 65906 (0.0008) [2023-12-27 19:42:15,772][106226] Updated weights for policy 0, policy_version 65916 (0.0007) [2023-12-27 19:42:15,836][106226] Updated weights for policy 0, policy_version 65926 (0.0008) [2023-12-27 19:42:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 33816576. Throughput: 0: 9925.2, 1: 9835.7. Samples: 33805772. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:16,175][105115] Avg episode reward: [(0, '-6.599'), (1, '-6.417')] [2023-12-27 19:42:16,322][106225] Updated weights for policy 1, policy_version 66132 (0.0010) [2023-12-27 19:42:16,377][106225] Updated weights for policy 1, policy_version 66142 (0.0010) [2023-12-27 19:42:16,434][106225] Updated weights for policy 1, policy_version 66152 (0.0010) [2023-12-27 19:42:16,496][106226] Updated weights for policy 0, policy_version 65936 (0.0008) [2023-12-27 19:42:16,550][106226] Updated weights for policy 0, policy_version 65946 (0.0009) [2023-12-27 19:42:16,597][106226] Updated weights for policy 0, policy_version 65956 (0.0010) [2023-12-27 19:42:17,138][106225] Updated weights for policy 1, policy_version 66162 (0.0010) [2023-12-27 19:42:17,183][106226] Updated weights for policy 0, policy_version 65966 (0.0008) [2023-12-27 19:42:17,189][106225] Updated weights for policy 1, policy_version 66172 (0.0010) [2023-12-27 19:42:17,242][106226] Updated weights for policy 0, policy_version 65976 (0.0005) [2023-12-27 19:42:17,243][106225] Updated weights for policy 1, policy_version 66182 (0.0010) [2023-12-27 19:42:17,294][106225] Updated weights for policy 1, policy_version 66192 (0.0010) [2023-12-27 19:42:17,296][106226] Updated weights for policy 0, policy_version 65986 (0.0005) [2023-12-27 19:42:17,943][106226] Updated weights for policy 0, policy_version 65996 (0.0007) [2023-12-27 19:42:18,006][106226] Updated weights for policy 0, policy_version 66006 (0.0005) [2023-12-27 19:42:18,049][106225] Updated weights for policy 1, policy_version 66202 (0.0010) [2023-12-27 19:42:18,063][106226] Updated weights for policy 0, policy_version 66016 (0.0005) [2023-12-27 19:42:18,113][106225] Updated weights for policy 1, policy_version 66212 (0.0010) [2023-12-27 19:42:18,163][106225] Updated weights for policy 1, policy_version 66222 (0.0010) [2023-12-27 19:42:18,693][106226] Updated weights for policy 0, policy_version 66026 (0.0006) [2023-12-27 19:42:18,753][106226] Updated weights for policy 0, policy_version 66036 (0.0010) [2023-12-27 19:42:18,818][106226] Updated weights for policy 0, policy_version 66046 (0.0011) [2023-12-27 19:42:18,848][106225] Updated weights for policy 1, policy_version 66232 (0.0010) [2023-12-27 19:42:18,876][106226] Updated weights for policy 0, policy_version 66056 (0.0008) [2023-12-27 19:42:18,905][106225] Updated weights for policy 1, policy_version 66242 (0.0010) [2023-12-27 19:42:18,966][106225] Updated weights for policy 1, policy_version 66252 (0.0010) [2023-12-27 19:42:19,539][106226] Updated weights for policy 0, policy_version 66066 (0.0009) [2023-12-27 19:42:19,599][106226] Updated weights for policy 0, policy_version 66076 (0.0009) [2023-12-27 19:42:19,659][106226] Updated weights for policy 0, policy_version 66086 (0.0008) [2023-12-27 19:42:19,698][106225] Updated weights for policy 1, policy_version 66262 (0.0008) [2023-12-27 19:42:19,761][106225] Updated weights for policy 1, policy_version 66272 (0.0008) [2023-12-27 19:42:19,827][106225] Updated weights for policy 1, policy_version 66282 (0.0009) [2023-12-27 19:42:20,401][106226] Updated weights for policy 0, policy_version 66096 (0.0011) [2023-12-27 19:42:20,452][106226] Updated weights for policy 0, policy_version 66106 (0.0010) [2023-12-27 19:42:20,502][106226] Updated weights for policy 0, policy_version 66116 (0.0010) [2023-12-27 19:42:20,527][106225] Updated weights for policy 1, policy_version 66292 (0.0012) [2023-12-27 19:42:20,584][106225] Updated weights for policy 1, policy_version 66302 (0.0010) [2023-12-27 19:42:20,647][106225] Updated weights for policy 1, policy_version 66312 (0.0007) [2023-12-27 19:42:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 33914880. Throughput: 0: 9943.9, 1: 9806.7. Samples: 33926332. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:21,175][105115] Avg episode reward: [(0, '-6.448'), (1, '-6.147')] [2023-12-27 19:42:21,315][106226] Updated weights for policy 0, policy_version 66126 (0.0008) [2023-12-27 19:42:21,383][106226] Updated weights for policy 0, policy_version 66136 (0.0009) [2023-12-27 19:42:21,417][106225] Updated weights for policy 1, policy_version 66322 (0.0007) [2023-12-27 19:42:21,453][106226] Updated weights for policy 0, policy_version 66146 (0.0007) [2023-12-27 19:42:21,479][106225] Updated weights for policy 1, policy_version 66332 (0.0008) [2023-12-27 19:42:21,541][106225] Updated weights for policy 1, policy_version 66342 (0.0008) [2023-12-27 19:42:21,603][106225] Updated weights for policy 1, policy_version 66352 (0.0008) [2023-12-27 19:42:22,181][106226] Updated weights for policy 0, policy_version 66156 (0.0007) [2023-12-27 19:42:22,251][106226] Updated weights for policy 0, policy_version 66166 (0.0010) [2023-12-27 19:42:22,312][106226] Updated weights for policy 0, policy_version 66176 (0.0009) [2023-12-27 19:42:22,412][106225] Updated weights for policy 1, policy_version 66362 (0.0009) [2023-12-27 19:42:22,468][106225] Updated weights for policy 1, policy_version 66372 (0.0008) [2023-12-27 19:42:22,518][106225] Updated weights for policy 1, policy_version 66382 (0.0008) [2023-12-27 19:42:23,041][106226] Updated weights for policy 0, policy_version 66186 (0.0008) [2023-12-27 19:42:23,094][106226] Updated weights for policy 0, policy_version 66196 (0.0009) [2023-12-27 19:42:23,148][106226] Updated weights for policy 0, policy_version 66206 (0.0009) [2023-12-27 19:42:23,200][106226] Updated weights for policy 0, policy_version 66216 (0.0008) [2023-12-27 19:42:23,266][106225] Updated weights for policy 1, policy_version 66392 (0.0009) [2023-12-27 19:42:23,325][106225] Updated weights for policy 1, policy_version 66402 (0.0008) [2023-12-27 19:42:23,377][106225] Updated weights for policy 1, policy_version 66412 (0.0008) [2023-12-27 19:42:23,945][106226] Updated weights for policy 0, policy_version 66226 (0.0005) [2023-12-27 19:42:23,998][106226] Updated weights for policy 0, policy_version 66236 (0.0005) [2023-12-27 19:42:24,047][106226] Updated weights for policy 0, policy_version 66246 (0.0005) [2023-12-27 19:42:24,145][106225] Updated weights for policy 1, policy_version 66422 (0.0008) [2023-12-27 19:42:24,197][106225] Updated weights for policy 1, policy_version 66432 (0.0008) [2023-12-27 19:42:24,258][106225] Updated weights for policy 1, policy_version 66442 (0.0007) [2023-12-27 19:42:24,634][106226] Updated weights for policy 0, policy_version 66256 (0.0009) [2023-12-27 19:42:24,698][106226] Updated weights for policy 0, policy_version 66266 (0.0010) [2023-12-27 19:42:24,763][106226] Updated weights for policy 0, policy_version 66276 (0.0010) [2023-12-27 19:42:24,994][106225] Updated weights for policy 1, policy_version 66452 (0.0010) [2023-12-27 19:42:25,045][106225] Updated weights for policy 1, policy_version 66462 (0.0010) [2023-12-27 19:42:25,098][106225] Updated weights for policy 1, policy_version 66472 (0.0009) [2023-12-27 19:42:25,430][106226] Updated weights for policy 0, policy_version 66286 (0.0007) [2023-12-27 19:42:25,477][106226] Updated weights for policy 0, policy_version 66296 (0.0005) [2023-12-27 19:42:25,530][106226] Updated weights for policy 0, policy_version 66306 (0.0005) [2023-12-27 19:42:25,803][106225] Updated weights for policy 1, policy_version 66482 (0.0007) [2023-12-27 19:42:25,852][106225] Updated weights for policy 1, policy_version 66492 (0.0010) [2023-12-27 19:42:25,909][106225] Updated weights for policy 1, policy_version 66502 (0.0010) [2023-12-27 19:42:25,962][106225] Updated weights for policy 1, policy_version 66512 (0.0010) [2023-12-27 19:42:26,108][106226] Updated weights for policy 0, policy_version 66316 (0.0007) [2023-12-27 19:42:26,164][106226] Updated weights for policy 0, policy_version 66326 (0.0008) [2023-12-27 19:42:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 34013184. Throughput: 0: 9862.2, 1: 9761.5. Samples: 33981932. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:26,175][105115] Avg episode reward: [(0, '-6.877'), (1, '-6.584')] [2023-12-27 19:42:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000066512_17031168.pth... [2023-12-27 19:42:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000065360_16736256.pth [2023-12-27 19:42:26,226][106226] Updated weights for policy 0, policy_version 66336 (0.0006) [2023-12-27 19:42:26,273][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000066344_16990208.pth... [2023-12-27 19:42:26,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000065192_16695296.pth [2023-12-27 19:42:26,705][106225] Updated weights for policy 1, policy_version 66522 (0.0005) [2023-12-27 19:42:26,768][106225] Updated weights for policy 1, policy_version 66532 (0.0005) [2023-12-27 19:42:26,804][106226] Updated weights for policy 0, policy_version 66346 (0.0007) [2023-12-27 19:42:26,827][106225] Updated weights for policy 1, policy_version 66542 (0.0005) [2023-12-27 19:42:26,866][106226] Updated weights for policy 0, policy_version 66356 (0.0009) [2023-12-27 19:42:26,925][106226] Updated weights for policy 0, policy_version 66366 (0.0009) [2023-12-27 19:42:26,974][106226] Updated weights for policy 0, policy_version 66376 (0.0010) [2023-12-27 19:42:27,342][106225] Updated weights for policy 1, policy_version 66552 (0.0006) [2023-12-27 19:42:27,395][106225] Updated weights for policy 1, policy_version 66562 (0.0005) [2023-12-27 19:42:27,441][106225] Updated weights for policy 1, policy_version 66572 (0.0005) [2023-12-27 19:42:27,716][106226] Updated weights for policy 0, policy_version 66386 (0.0010) [2023-12-27 19:42:27,776][106226] Updated weights for policy 0, policy_version 66396 (0.0006) [2023-12-27 19:42:27,830][106226] Updated weights for policy 0, policy_version 66406 (0.0007) [2023-12-27 19:42:28,082][106225] Updated weights for policy 1, policy_version 66582 (0.0008) [2023-12-27 19:42:28,148][106225] Updated weights for policy 1, policy_version 66592 (0.0010) [2023-12-27 19:42:28,200][106225] Updated weights for policy 1, policy_version 66602 (0.0010) [2023-12-27 19:42:28,503][106226] Updated weights for policy 0, policy_version 66416 (0.0006) [2023-12-27 19:42:28,558][106226] Updated weights for policy 0, policy_version 66426 (0.0009) [2023-12-27 19:42:28,641][106226] Updated weights for policy 0, policy_version 66436 (0.0011) [2023-12-27 19:42:28,911][106225] Updated weights for policy 1, policy_version 66612 (0.0010) [2023-12-27 19:42:28,967][106225] Updated weights for policy 1, policy_version 66622 (0.0010) [2023-12-27 19:42:29,019][106225] Updated weights for policy 1, policy_version 66632 (0.0010) [2023-12-27 19:42:29,255][106226] Updated weights for policy 0, policy_version 66446 (0.0009) [2023-12-27 19:42:29,318][106226] Updated weights for policy 0, policy_version 66456 (0.0010) [2023-12-27 19:42:29,389][106226] Updated weights for policy 0, policy_version 66466 (0.0010) [2023-12-27 19:42:29,745][106225] Updated weights for policy 1, policy_version 66642 (0.0010) [2023-12-27 19:42:29,798][106225] Updated weights for policy 1, policy_version 66652 (0.0008) [2023-12-27 19:42:29,864][106225] Updated weights for policy 1, policy_version 66662 (0.0009) [2023-12-27 19:42:29,925][106225] Updated weights for policy 1, policy_version 66672 (0.0008) [2023-12-27 19:42:30,031][106226] Updated weights for policy 0, policy_version 66476 (0.0008) [2023-12-27 19:42:30,086][106226] Updated weights for policy 0, policy_version 66486 (0.0010) [2023-12-27 19:42:30,147][106226] Updated weights for policy 0, policy_version 66496 (0.0011) [2023-12-27 19:42:30,705][106225] Updated weights for policy 1, policy_version 66682 (0.0008) [2023-12-27 19:42:30,746][106225] Updated weights for policy 1, policy_version 66692 (0.0005) [2023-12-27 19:42:30,792][106225] Updated weights for policy 1, policy_version 66702 (0.0005) [2023-12-27 19:42:30,876][106226] Updated weights for policy 0, policy_version 66506 (0.0010) [2023-12-27 19:42:30,924][106226] Updated weights for policy 0, policy_version 66516 (0.0005) [2023-12-27 19:42:30,968][106226] Updated weights for policy 0, policy_version 66526 (0.0005) [2023-12-27 19:42:31,025][106226] Updated weights for policy 0, policy_version 66536 (0.0006) [2023-12-27 19:42:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 34119680. Throughput: 0: 10003.0, 1: 9848.2. Samples: 34106740. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 19:42:31,176][105115] Avg episode reward: [(0, '-6.714'), (1, '-6.297')] [2023-12-27 19:42:31,552][106225] Updated weights for policy 1, policy_version 66712 (0.0009) [2023-12-27 19:42:31,614][106225] Updated weights for policy 1, policy_version 66722 (0.0011) [2023-12-27 19:42:31,678][106225] Updated weights for policy 1, policy_version 66732 (0.0011) [2023-12-27 19:42:31,763][106226] Updated weights for policy 0, policy_version 66546 (0.0008) [2023-12-27 19:42:31,834][106226] Updated weights for policy 0, policy_version 66556 (0.0008) [2023-12-27 19:42:31,903][106226] Updated weights for policy 0, policy_version 66566 (0.0008) [2023-12-27 19:42:32,266][106225] Updated weights for policy 1, policy_version 66742 (0.0008) [2023-12-27 19:42:32,328][106225] Updated weights for policy 1, policy_version 66752 (0.0008) [2023-12-27 19:42:32,391][106225] Updated weights for policy 1, policy_version 66762 (0.0007) [2023-12-27 19:42:32,654][106226] Updated weights for policy 0, policy_version 66576 (0.0008) [2023-12-27 19:42:32,712][106226] Updated weights for policy 0, policy_version 66586 (0.0007) [2023-12-27 19:42:32,771][106226] Updated weights for policy 0, policy_version 66596 (0.0005) [2023-12-27 19:42:33,031][106225] Updated weights for policy 1, policy_version 66772 (0.0007) [2023-12-27 19:42:33,081][106225] Updated weights for policy 1, policy_version 66782 (0.0006) [2023-12-27 19:42:33,131][106225] Updated weights for policy 1, policy_version 66792 (0.0005) [2023-12-27 19:42:33,353][106226] Updated weights for policy 0, policy_version 66606 (0.0007) [2023-12-27 19:42:33,402][106226] Updated weights for policy 0, policy_version 66616 (0.0009) [2023-12-27 19:42:33,460][106226] Updated weights for policy 0, policy_version 66626 (0.0008) [2023-12-27 19:42:33,738][106225] Updated weights for policy 1, policy_version 66802 (0.0005) [2023-12-27 19:42:33,788][106225] Updated weights for policy 1, policy_version 66812 (0.0005) [2023-12-27 19:42:33,834][106225] Updated weights for policy 1, policy_version 66822 (0.0005) [2023-12-27 19:42:33,885][106225] Updated weights for policy 1, policy_version 66832 (0.0005) [2023-12-27 19:42:34,136][106226] Updated weights for policy 0, policy_version 66636 (0.0008) [2023-12-27 19:42:34,198][106226] Updated weights for policy 0, policy_version 66646 (0.0007) [2023-12-27 19:42:34,261][106226] Updated weights for policy 0, policy_version 66656 (0.0006) [2023-12-27 19:42:34,641][106225] Updated weights for policy 1, policy_version 66842 (0.0005) [2023-12-27 19:42:34,699][106225] Updated weights for policy 1, policy_version 66852 (0.0006) [2023-12-27 19:42:34,753][106225] Updated weights for policy 1, policy_version 66862 (0.0005) [2023-12-27 19:42:34,968][106226] Updated weights for policy 0, policy_version 66666 (0.0008) [2023-12-27 19:42:35,021][106226] Updated weights for policy 0, policy_version 66676 (0.0007) [2023-12-27 19:42:35,070][106226] Updated weights for policy 0, policy_version 66686 (0.0009) [2023-12-27 19:42:35,122][106226] Updated weights for policy 0, policy_version 66696 (0.0009) [2023-12-27 19:42:35,366][106225] Updated weights for policy 1, policy_version 66872 (0.0007) [2023-12-27 19:42:35,415][106225] Updated weights for policy 1, policy_version 66882 (0.0009) [2023-12-27 19:42:35,463][106225] Updated weights for policy 1, policy_version 66892 (0.0008) [2023-12-27 19:42:35,876][106226] Updated weights for policy 0, policy_version 66706 (0.0009) [2023-12-27 19:42:35,932][106226] Updated weights for policy 0, policy_version 66716 (0.0008) [2023-12-27 19:42:35,987][106226] Updated weights for policy 0, policy_version 66726 (0.0007) [2023-12-27 19:42:36,095][106225] Updated weights for policy 1, policy_version 66902 (0.0008) [2023-12-27 19:42:36,161][106225] Updated weights for policy 1, policy_version 66912 (0.0008) [2023-12-27 19:42:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 34217984. Throughput: 0: 9878.4, 1: 9975.0. Samples: 34228304. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:42:36,175][105115] Avg episode reward: [(0, '-6.302'), (1, '-6.495')] [2023-12-27 19:42:36,223][106225] Updated weights for policy 1, policy_version 66922 (0.0008) [2023-12-27 19:42:36,676][106226] Updated weights for policy 0, policy_version 66736 (0.0008) [2023-12-27 19:42:36,744][106226] Updated weights for policy 0, policy_version 66746 (0.0009) [2023-12-27 19:42:36,812][106226] Updated weights for policy 0, policy_version 66756 (0.0009) [2023-12-27 19:42:36,965][106225] Updated weights for policy 1, policy_version 66932 (0.0008) [2023-12-27 19:42:37,028][106225] Updated weights for policy 1, policy_version 66942 (0.0008) [2023-12-27 19:42:37,087][106225] Updated weights for policy 1, policy_version 66952 (0.0008) [2023-12-27 19:42:37,425][106226] Updated weights for policy 0, policy_version 66766 (0.0010) [2023-12-27 19:42:37,475][106226] Updated weights for policy 0, policy_version 66776 (0.0010) [2023-12-27 19:42:37,522][106226] Updated weights for policy 0, policy_version 66786 (0.0010) [2023-12-27 19:42:37,905][106225] Updated weights for policy 1, policy_version 66962 (0.0008) [2023-12-27 19:42:37,961][106225] Updated weights for policy 1, policy_version 66972 (0.0008) [2023-12-27 19:42:38,022][106225] Updated weights for policy 1, policy_version 66982 (0.0008) [2023-12-27 19:42:38,081][106225] Updated weights for policy 1, policy_version 66992 (0.0010) [2023-12-27 19:42:38,219][106226] Updated weights for policy 0, policy_version 66796 (0.0009) [2023-12-27 19:42:38,276][106226] Updated weights for policy 0, policy_version 66806 (0.0006) [2023-12-27 19:42:38,333][106226] Updated weights for policy 0, policy_version 66816 (0.0008) [2023-12-27 19:42:38,844][106225] Updated weights for policy 1, policy_version 67002 (0.0007) [2023-12-27 19:42:38,904][106225] Updated weights for policy 1, policy_version 67012 (0.0006) [2023-12-27 19:42:38,960][106225] Updated weights for policy 1, policy_version 67022 (0.0008) [2023-12-27 19:42:39,035][106226] Updated weights for policy 0, policy_version 66826 (0.0007) [2023-12-27 19:42:39,094][106226] Updated weights for policy 0, policy_version 66836 (0.0007) [2023-12-27 19:42:39,155][106226] Updated weights for policy 0, policy_version 66846 (0.0005) [2023-12-27 19:42:39,222][106226] Updated weights for policy 0, policy_version 66856 (0.0006) [2023-12-27 19:42:39,707][106225] Updated weights for policy 1, policy_version 67032 (0.0009) [2023-12-27 19:42:39,775][106225] Updated weights for policy 1, policy_version 67042 (0.0006) [2023-12-27 19:42:39,845][106225] Updated weights for policy 1, policy_version 67052 (0.0006) [2023-12-27 19:42:39,957][106226] Updated weights for policy 0, policy_version 66866 (0.0008) [2023-12-27 19:42:40,021][106226] Updated weights for policy 0, policy_version 66876 (0.0009) [2023-12-27 19:42:40,090][106226] Updated weights for policy 0, policy_version 66886 (0.0008) [2023-12-27 19:42:40,564][106225] Updated weights for policy 1, policy_version 67062 (0.0008) [2023-12-27 19:42:40,610][106225] Updated weights for policy 1, policy_version 67072 (0.0008) [2023-12-27 19:42:40,662][106225] Updated weights for policy 1, policy_version 67082 (0.0009) [2023-12-27 19:42:40,771][106226] Updated weights for policy 0, policy_version 66896 (0.0008) [2023-12-27 19:42:40,848][106226] Updated weights for policy 0, policy_version 66906 (0.0010) [2023-12-27 19:42:40,906][106226] Updated weights for policy 0, policy_version 66916 (0.0009) [2023-12-27 19:42:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 34316288. Throughput: 0: 9961.9, 1: 9926.7. Samples: 34287400. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:42:41,175][105115] Avg episode reward: [(0, '-6.343'), (1, '-6.229')] [2023-12-27 19:42:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000067088_17178624.pth... [2023-12-27 19:42:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000066920_17137664.pth... [2023-12-27 19:42:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000065736_16834560.pth [2023-12-27 19:42:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000065936_16883712.pth [2023-12-27 19:42:41,406][106225] Updated weights for policy 1, policy_version 67092 (0.0008) [2023-12-27 19:42:41,474][106225] Updated weights for policy 1, policy_version 67102 (0.0008) [2023-12-27 19:42:41,543][106225] Updated weights for policy 1, policy_version 67112 (0.0008) [2023-12-27 19:42:41,685][106226] Updated weights for policy 0, policy_version 66926 (0.0008) [2023-12-27 19:42:41,762][106226] Updated weights for policy 0, policy_version 66936 (0.0011) [2023-12-27 19:42:41,822][106226] Updated weights for policy 0, policy_version 66946 (0.0009) [2023-12-27 19:42:42,346][106225] Updated weights for policy 1, policy_version 67122 (0.0008) [2023-12-27 19:42:42,409][106225] Updated weights for policy 1, policy_version 67132 (0.0009) [2023-12-27 19:42:42,467][106225] Updated weights for policy 1, policy_version 67142 (0.0008) [2023-12-27 19:42:42,530][106225] Updated weights for policy 1, policy_version 67152 (0.0008) [2023-12-27 19:42:42,556][106226] Updated weights for policy 0, policy_version 66956 (0.0011) [2023-12-27 19:42:42,619][106226] Updated weights for policy 0, policy_version 66966 (0.0010) [2023-12-27 19:42:42,672][106226] Updated weights for policy 0, policy_version 66976 (0.0010) [2023-12-27 19:42:43,284][106225] Updated weights for policy 1, policy_version 67162 (0.0007) [2023-12-27 19:42:43,346][106225] Updated weights for policy 1, policy_version 67172 (0.0009) [2023-12-27 19:42:43,399][106226] Updated weights for policy 0, policy_version 66986 (0.0009) [2023-12-27 19:42:43,406][106225] Updated weights for policy 1, policy_version 67182 (0.0008) [2023-12-27 19:42:43,462][106226] Updated weights for policy 0, policy_version 66996 (0.0005) [2023-12-27 19:42:43,515][106226] Updated weights for policy 0, policy_version 67006 (0.0006) [2023-12-27 19:42:43,560][106226] Updated weights for policy 0, policy_version 67016 (0.0007) [2023-12-27 19:42:44,115][106225] Updated weights for policy 1, policy_version 67192 (0.0009) [2023-12-27 19:42:44,173][106225] Updated weights for policy 1, policy_version 67202 (0.0008) [2023-12-27 19:42:44,221][106226] Updated weights for policy 0, policy_version 67026 (0.0007) [2023-12-27 19:42:44,231][106225] Updated weights for policy 1, policy_version 67212 (0.0008) [2023-12-27 19:42:44,274][106226] Updated weights for policy 0, policy_version 67036 (0.0006) [2023-12-27 19:42:44,334][106226] Updated weights for policy 0, policy_version 67046 (0.0009) [2023-12-27 19:42:44,917][106225] Updated weights for policy 1, policy_version 67222 (0.0007) [2023-12-27 19:42:44,983][106225] Updated weights for policy 1, policy_version 67232 (0.0009) [2023-12-27 19:42:45,042][106225] Updated weights for policy 1, policy_version 67242 (0.0008) [2023-12-27 19:42:45,144][106226] Updated weights for policy 0, policy_version 67056 (0.0008) [2023-12-27 19:42:45,211][106226] Updated weights for policy 0, policy_version 67066 (0.0009) [2023-12-27 19:42:45,280][106226] Updated weights for policy 0, policy_version 67076 (0.0010) [2023-12-27 19:42:45,795][106225] Updated weights for policy 1, policy_version 67252 (0.0007) [2023-12-27 19:42:45,855][106225] Updated weights for policy 1, policy_version 67262 (0.0005) [2023-12-27 19:42:45,912][106225] Updated weights for policy 1, policy_version 67272 (0.0005) [2023-12-27 19:42:45,984][106226] Updated weights for policy 0, policy_version 67086 (0.0008) [2023-12-27 19:42:46,042][106226] Updated weights for policy 0, policy_version 67096 (0.0008) [2023-12-27 19:42:46,098][106226] Updated weights for policy 0, policy_version 67106 (0.0008) [2023-12-27 19:42:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 34414592. Throughput: 0: 9901.4, 1: 9873.4. Samples: 34400544. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:42:46,175][105115] Avg episode reward: [(0, '-6.154'), (1, '-6.536')] [2023-12-27 19:42:46,592][106225] Updated weights for policy 1, policy_version 67282 (0.0006) [2023-12-27 19:42:46,662][106225] Updated weights for policy 1, policy_version 67292 (0.0009) [2023-12-27 19:42:46,718][106225] Updated weights for policy 1, policy_version 67302 (0.0008) [2023-12-27 19:42:46,722][106226] Updated weights for policy 0, policy_version 67116 (0.0007) [2023-12-27 19:42:46,773][106225] Updated weights for policy 1, policy_version 67312 (0.0007) [2023-12-27 19:42:46,787][106226] Updated weights for policy 0, policy_version 67126 (0.0006) [2023-12-27 19:42:46,855][106226] Updated weights for policy 0, policy_version 67136 (0.0005) [2023-12-27 19:42:47,496][106226] Updated weights for policy 0, policy_version 67146 (0.0005) [2023-12-27 19:42:47,518][106225] Updated weights for policy 1, policy_version 67322 (0.0009) [2023-12-27 19:42:47,561][106226] Updated weights for policy 0, policy_version 67156 (0.0005) [2023-12-27 19:42:47,570][106225] Updated weights for policy 1, policy_version 67332 (0.0008) [2023-12-27 19:42:47,618][106225] Updated weights for policy 1, policy_version 67342 (0.0006) [2023-12-27 19:42:47,619][106226] Updated weights for policy 0, policy_version 67166 (0.0007) [2023-12-27 19:42:47,670][106226] Updated weights for policy 0, policy_version 67176 (0.0007) [2023-12-27 19:42:48,309][106226] Updated weights for policy 0, policy_version 67186 (0.0008) [2023-12-27 19:42:48,377][106226] Updated weights for policy 0, policy_version 67196 (0.0008) [2023-12-27 19:42:48,405][106225] Updated weights for policy 1, policy_version 67352 (0.0007) [2023-12-27 19:42:48,439][106226] Updated weights for policy 0, policy_version 67206 (0.0005) [2023-12-27 19:42:48,467][106225] Updated weights for policy 1, policy_version 67362 (0.0009) [2023-12-27 19:42:48,533][106225] Updated weights for policy 1, policy_version 67372 (0.0008) [2023-12-27 19:42:49,040][106226] Updated weights for policy 0, policy_version 67216 (0.0007) [2023-12-27 19:42:49,107][106226] Updated weights for policy 0, policy_version 67226 (0.0005) [2023-12-27 19:42:49,167][106226] Updated weights for policy 0, policy_version 67236 (0.0005) [2023-12-27 19:42:49,336][106225] Updated weights for policy 1, policy_version 67382 (0.0008) [2023-12-27 19:42:49,394][106225] Updated weights for policy 1, policy_version 67392 (0.0007) [2023-12-27 19:42:49,451][106225] Updated weights for policy 1, policy_version 67402 (0.0008) [2023-12-27 19:42:49,818][106226] Updated weights for policy 0, policy_version 67246 (0.0006) [2023-12-27 19:42:49,886][106226] Updated weights for policy 0, policy_version 67256 (0.0007) [2023-12-27 19:42:49,955][106226] Updated weights for policy 0, policy_version 67266 (0.0008) [2023-12-27 19:42:50,248][106225] Updated weights for policy 1, policy_version 67412 (0.0009) [2023-12-27 19:42:50,304][106225] Updated weights for policy 1, policy_version 67422 (0.0009) [2023-12-27 19:42:50,357][106225] Updated weights for policy 1, policy_version 67432 (0.0008) [2023-12-27 19:42:50,595][106226] Updated weights for policy 0, policy_version 67276 (0.0011) [2023-12-27 19:42:50,659][106226] Updated weights for policy 0, policy_version 67286 (0.0011) [2023-12-27 19:42:50,723][106226] Updated weights for policy 0, policy_version 67296 (0.0010) [2023-12-27 19:42:51,152][106225] Updated weights for policy 1, policy_version 67442 (0.0008) [2023-12-27 19:42:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 34504704. Throughput: 0: 10022.4, 1: 9721.7. Samples: 34517792. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:42:51,175][105115] Avg episode reward: [(0, '-6.009'), (1, '-6.821')] [2023-12-27 19:42:51,219][106225] Updated weights for policy 1, policy_version 67452 (0.0006) [2023-12-27 19:42:51,288][106225] Updated weights for policy 1, policy_version 67462 (0.0006) [2023-12-27 19:42:51,351][106225] Updated weights for policy 1, policy_version 67472 (0.0007) [2023-12-27 19:42:51,456][106226] Updated weights for policy 0, policy_version 67306 (0.0011) [2023-12-27 19:42:51,514][106226] Updated weights for policy 0, policy_version 67316 (0.0011) [2023-12-27 19:42:51,577][106226] Updated weights for policy 0, policy_version 67326 (0.0011) [2023-12-27 19:42:51,642][106226] Updated weights for policy 0, policy_version 67336 (0.0010) [2023-12-27 19:42:52,071][106225] Updated weights for policy 1, policy_version 67482 (0.0008) [2023-12-27 19:42:52,125][106225] Updated weights for policy 1, policy_version 67492 (0.0009) [2023-12-27 19:42:52,179][106225] Updated weights for policy 1, policy_version 67502 (0.0009) [2023-12-27 19:42:52,304][106226] Updated weights for policy 0, policy_version 67346 (0.0011) [2023-12-27 19:42:52,368][106226] Updated weights for policy 0, policy_version 67356 (0.0010) [2023-12-27 19:42:52,434][106226] Updated weights for policy 0, policy_version 67366 (0.0011) [2023-12-27 19:42:52,921][106225] Updated weights for policy 1, policy_version 67512 (0.0006) [2023-12-27 19:42:52,975][106225] Updated weights for policy 1, policy_version 67522 (0.0005) [2023-12-27 19:42:53,034][106225] Updated weights for policy 1, policy_version 67532 (0.0006) [2023-12-27 19:42:53,149][106226] Updated weights for policy 0, policy_version 67376 (0.0006) [2023-12-27 19:42:53,203][106226] Updated weights for policy 0, policy_version 67386 (0.0005) [2023-12-27 19:42:53,258][106226] Updated weights for policy 0, policy_version 67396 (0.0005) [2023-12-27 19:42:53,720][106225] Updated weights for policy 1, policy_version 67542 (0.0007) [2023-12-27 19:42:53,769][106225] Updated weights for policy 1, policy_version 67552 (0.0008) [2023-12-27 19:42:53,820][106225] Updated weights for policy 1, policy_version 67562 (0.0008) [2023-12-27 19:42:53,854][106226] Updated weights for policy 0, policy_version 67406 (0.0007) [2023-12-27 19:42:53,909][106226] Updated weights for policy 0, policy_version 67416 (0.0008) [2023-12-27 19:42:53,975][106226] Updated weights for policy 0, policy_version 67426 (0.0009) [2023-12-27 19:42:54,486][106225] Updated weights for policy 1, policy_version 67572 (0.0005) [2023-12-27 19:42:54,536][106225] Updated weights for policy 1, policy_version 67582 (0.0005) [2023-12-27 19:42:54,587][106225] Updated weights for policy 1, policy_version 67592 (0.0008) [2023-12-27 19:42:54,677][106226] Updated weights for policy 0, policy_version 67436 (0.0008) [2023-12-27 19:42:54,742][106226] Updated weights for policy 0, policy_version 67446 (0.0005) [2023-12-27 19:42:54,808][106226] Updated weights for policy 0, policy_version 67456 (0.0005) [2023-12-27 19:42:55,250][106225] Updated weights for policy 1, policy_version 67602 (0.0006) [2023-12-27 19:42:55,303][106225] Updated weights for policy 1, policy_version 67612 (0.0010) [2023-12-27 19:42:55,359][106225] Updated weights for policy 1, policy_version 67622 (0.0009) [2023-12-27 19:42:55,377][106226] Updated weights for policy 0, policy_version 67466 (0.0006) [2023-12-27 19:42:55,421][106225] Updated weights for policy 1, policy_version 67632 (0.0009) [2023-12-27 19:42:55,435][106226] Updated weights for policy 0, policy_version 67476 (0.0007) [2023-12-27 19:42:55,497][106226] Updated weights for policy 0, policy_version 67486 (0.0007) [2023-12-27 19:42:55,559][106226] Updated weights for policy 0, policy_version 67496 (0.0008) [2023-12-27 19:42:56,136][106225] Updated weights for policy 1, policy_version 67642 (0.0010) [2023-12-27 19:42:56,165][106226] Updated weights for policy 0, policy_version 67506 (0.0005) [2023-12-27 19:42:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 34603008. Throughput: 0: 10009.3, 1: 9673.4. Samples: 34576768. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:42:56,175][105115] Avg episode reward: [(0, '-6.097'), (1, '-5.992')] [2023-12-27 19:42:56,192][106225] Updated weights for policy 1, policy_version 67652 (0.0010) [2023-12-27 19:42:56,225][106226] Updated weights for policy 0, policy_version 67516 (0.0005) [2023-12-27 19:42:56,245][106225] Updated weights for policy 1, policy_version 67662 (0.0010) [2023-12-27 19:42:56,256][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000067664_17326080.pth... [2023-12-27 19:42:56,260][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000066512_17031168.pth [2023-12-27 19:42:56,283][106226] Updated weights for policy 0, policy_version 67526 (0.0007) [2023-12-27 19:42:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000067528_17293312.pth... [2023-12-27 19:42:56,297][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000066344_16990208.pth [2023-12-27 19:42:56,907][106226] Updated weights for policy 0, policy_version 67536 (0.0006) [2023-12-27 19:42:56,965][106226] Updated weights for policy 0, policy_version 67546 (0.0010) [2023-12-27 19:42:56,983][106225] Updated weights for policy 1, policy_version 67672 (0.0007) [2023-12-27 19:42:57,015][106226] Updated weights for policy 0, policy_version 67556 (0.0010) [2023-12-27 19:42:57,041][106225] Updated weights for policy 1, policy_version 67682 (0.0006) [2023-12-27 19:42:57,093][106225] Updated weights for policy 1, policy_version 67692 (0.0009) [2023-12-27 19:42:57,608][106226] Updated weights for policy 0, policy_version 67566 (0.0007) [2023-12-27 19:42:57,665][106226] Updated weights for policy 0, policy_version 67576 (0.0006) [2023-12-27 19:42:57,719][106226] Updated weights for policy 0, policy_version 67586 (0.0006) [2023-12-27 19:42:57,901][106225] Updated weights for policy 1, policy_version 67702 (0.0008) [2023-12-27 19:42:57,962][106225] Updated weights for policy 1, policy_version 67712 (0.0009) [2023-12-27 19:42:58,016][106225] Updated weights for policy 1, policy_version 67722 (0.0008) [2023-12-27 19:42:58,346][106226] Updated weights for policy 0, policy_version 67596 (0.0009) [2023-12-27 19:42:58,412][106226] Updated weights for policy 0, policy_version 67606 (0.0008) [2023-12-27 19:42:58,477][106226] Updated weights for policy 0, policy_version 67616 (0.0009) [2023-12-27 19:42:58,775][106225] Updated weights for policy 1, policy_version 67732 (0.0009) [2023-12-27 19:42:58,843][106225] Updated weights for policy 1, policy_version 67742 (0.0009) [2023-12-27 19:42:58,924][106225] Updated weights for policy 1, policy_version 67752 (0.0008) [2023-12-27 19:42:59,318][106226] Updated weights for policy 0, policy_version 67626 (0.0009) [2023-12-27 19:42:59,382][106226] Updated weights for policy 0, policy_version 67636 (0.0008) [2023-12-27 19:42:59,446][106226] Updated weights for policy 0, policy_version 67646 (0.0008) [2023-12-27 19:42:59,499][106226] Updated weights for policy 0, policy_version 67656 (0.0007) [2023-12-27 19:42:59,688][106225] Updated weights for policy 1, policy_version 67762 (0.0008) [2023-12-27 19:42:59,739][106225] Updated weights for policy 1, policy_version 67772 (0.0009) [2023-12-27 19:42:59,795][106225] Updated weights for policy 1, policy_version 67782 (0.0009) [2023-12-27 19:42:59,874][106225] Updated weights for policy 1, policy_version 67792 (0.0008) [2023-12-27 19:43:00,268][106226] Updated weights for policy 0, policy_version 67666 (0.0008) [2023-12-27 19:43:00,326][106226] Updated weights for policy 0, policy_version 67676 (0.0008) [2023-12-27 19:43:00,386][106226] Updated weights for policy 0, policy_version 67686 (0.0008) [2023-12-27 19:43:00,564][106225] Updated weights for policy 1, policy_version 67802 (0.0009) [2023-12-27 19:43:00,627][106225] Updated weights for policy 1, policy_version 67812 (0.0008) [2023-12-27 19:43:00,687][106225] Updated weights for policy 1, policy_version 67822 (0.0008) [2023-12-27 19:43:01,104][106226] Updated weights for policy 0, policy_version 67696 (0.0009) [2023-12-27 19:43:01,168][106226] Updated weights for policy 0, policy_version 67706 (0.0008) [2023-12-27 19:43:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 34701312. Throughput: 0: 10144.4, 1: 9655.7. Samples: 34696776. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:43:01,175][105115] Avg episode reward: [(0, '-5.467'), (1, '-6.379')] [2023-12-27 19:43:01,234][106226] Updated weights for policy 0, policy_version 67716 (0.0008) [2023-12-27 19:43:01,392][106225] Updated weights for policy 1, policy_version 67832 (0.0009) [2023-12-27 19:43:01,444][106225] Updated weights for policy 1, policy_version 67842 (0.0008) [2023-12-27 19:43:01,504][106225] Updated weights for policy 1, policy_version 67852 (0.0009) [2023-12-27 19:43:01,984][106226] Updated weights for policy 0, policy_version 67726 (0.0009) [2023-12-27 19:43:02,049][106226] Updated weights for policy 0, policy_version 67736 (0.0008) [2023-12-27 19:43:02,107][106226] Updated weights for policy 0, policy_version 67746 (0.0009) [2023-12-27 19:43:02,240][106225] Updated weights for policy 1, policy_version 67862 (0.0009) [2023-12-27 19:43:02,303][106225] Updated weights for policy 1, policy_version 67872 (0.0008) [2023-12-27 19:43:02,376][106225] Updated weights for policy 1, policy_version 67882 (0.0007) [2023-12-27 19:43:02,845][106226] Updated weights for policy 0, policy_version 67756 (0.0009) [2023-12-27 19:43:02,907][106226] Updated weights for policy 0, policy_version 67766 (0.0010) [2023-12-27 19:43:02,965][106226] Updated weights for policy 0, policy_version 67776 (0.0010) [2023-12-27 19:43:03,044][106225] Updated weights for policy 1, policy_version 67892 (0.0008) [2023-12-27 19:43:03,091][106225] Updated weights for policy 1, policy_version 67902 (0.0008) [2023-12-27 19:43:03,133][106225] Updated weights for policy 1, policy_version 67912 (0.0007) [2023-12-27 19:43:03,641][106226] Updated weights for policy 0, policy_version 67786 (0.0010) [2023-12-27 19:43:03,701][106226] Updated weights for policy 0, policy_version 67796 (0.0008) [2023-12-27 19:43:03,754][106226] Updated weights for policy 0, policy_version 67806 (0.0008) [2023-12-27 19:43:03,811][106226] Updated weights for policy 0, policy_version 67816 (0.0009) [2023-12-27 19:43:03,897][106225] Updated weights for policy 1, policy_version 67922 (0.0008) [2023-12-27 19:43:03,946][106225] Updated weights for policy 1, policy_version 67932 (0.0009) [2023-12-27 19:43:03,996][106225] Updated weights for policy 1, policy_version 67942 (0.0008) [2023-12-27 19:43:04,045][106225] Updated weights for policy 1, policy_version 67952 (0.0008) [2023-12-27 19:43:04,572][106226] Updated weights for policy 0, policy_version 67826 (0.0010) [2023-12-27 19:43:04,621][106226] Updated weights for policy 0, policy_version 67836 (0.0007) [2023-12-27 19:43:04,674][106226] Updated weights for policy 0, policy_version 67846 (0.0007) [2023-12-27 19:43:04,733][106225] Updated weights for policy 1, policy_version 67962 (0.0008) [2023-12-27 19:43:04,779][106225] Updated weights for policy 1, policy_version 67972 (0.0007) [2023-12-27 19:43:04,826][106225] Updated weights for policy 1, policy_version 67982 (0.0008) [2023-12-27 19:43:05,388][106226] Updated weights for policy 0, policy_version 67856 (0.0010) [2023-12-27 19:43:05,438][106226] Updated weights for policy 0, policy_version 67866 (0.0010) [2023-12-27 19:43:05,492][106226] Updated weights for policy 0, policy_version 67876 (0.0010) [2023-12-27 19:43:05,503][106225] Updated weights for policy 1, policy_version 67992 (0.0007) [2023-12-27 19:43:05,564][106225] Updated weights for policy 1, policy_version 68002 (0.0005) [2023-12-27 19:43:05,622][106225] Updated weights for policy 1, policy_version 68012 (0.0005) [2023-12-27 19:43:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 34799616. Throughput: 0: 10042.2, 1: 9681.1. Samples: 34813880. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:43:06,175][105115] Avg episode reward: [(0, '-6.217'), (1, '-6.415')] [2023-12-27 19:43:06,209][106226] Updated weights for policy 0, policy_version 67886 (0.0009) [2023-12-27 19:43:06,270][106226] Updated weights for policy 0, policy_version 67896 (0.0011) [2023-12-27 19:43:06,311][106225] Updated weights for policy 1, policy_version 68022 (0.0006) [2023-12-27 19:43:06,322][106226] Updated weights for policy 0, policy_version 67906 (0.0011) [2023-12-27 19:43:06,372][106225] Updated weights for policy 1, policy_version 68032 (0.0006) [2023-12-27 19:43:06,436][106225] Updated weights for policy 1, policy_version 68042 (0.0008) [2023-12-27 19:43:06,994][106226] Updated weights for policy 0, policy_version 67916 (0.0011) [2023-12-27 19:43:07,056][106226] Updated weights for policy 0, policy_version 67926 (0.0011) [2023-12-27 19:43:07,115][106226] Updated weights for policy 0, policy_version 67936 (0.0011) [2023-12-27 19:43:07,222][106225] Updated weights for policy 1, policy_version 68052 (0.0009) [2023-12-27 19:43:07,269][106225] Updated weights for policy 1, policy_version 68062 (0.0008) [2023-12-27 19:43:07,316][106225] Updated weights for policy 1, policy_version 68072 (0.0008) [2023-12-27 19:43:07,837][106226] Updated weights for policy 0, policy_version 67946 (0.0009) [2023-12-27 19:43:07,901][106226] Updated weights for policy 0, policy_version 67956 (0.0005) [2023-12-27 19:43:07,948][106226] Updated weights for policy 0, policy_version 67966 (0.0005) [2023-12-27 19:43:07,999][106226] Updated weights for policy 0, policy_version 67976 (0.0007) [2023-12-27 19:43:08,092][106225] Updated weights for policy 1, policy_version 68082 (0.0007) [2023-12-27 19:43:08,148][106225] Updated weights for policy 1, policy_version 68092 (0.0007) [2023-12-27 19:43:08,204][106225] Updated weights for policy 1, policy_version 68102 (0.0008) [2023-12-27 19:43:08,265][106225] Updated weights for policy 1, policy_version 68112 (0.0007) [2023-12-27 19:43:08,715][106226] Updated weights for policy 0, policy_version 67986 (0.0008) [2023-12-27 19:43:08,764][106226] Updated weights for policy 0, policy_version 67996 (0.0008) [2023-12-27 19:43:08,813][106226] Updated weights for policy 0, policy_version 68006 (0.0009) [2023-12-27 19:43:09,007][106225] Updated weights for policy 1, policy_version 68122 (0.0009) [2023-12-27 19:43:09,057][106225] Updated weights for policy 1, policy_version 68132 (0.0009) [2023-12-27 19:43:09,112][106225] Updated weights for policy 1, policy_version 68142 (0.0009) [2023-12-27 19:43:09,502][106226] Updated weights for policy 0, policy_version 68016 (0.0009) [2023-12-27 19:43:09,560][106226] Updated weights for policy 0, policy_version 68026 (0.0009) [2023-12-27 19:43:09,623][106226] Updated weights for policy 0, policy_version 68036 (0.0008) [2023-12-27 19:43:09,853][106225] Updated weights for policy 1, policy_version 68152 (0.0007) [2023-12-27 19:43:09,921][106225] Updated weights for policy 1, policy_version 68162 (0.0008) [2023-12-27 19:43:09,985][106225] Updated weights for policy 1, policy_version 68172 (0.0008) [2023-12-27 19:43:10,416][106226] Updated weights for policy 0, policy_version 68046 (0.0009) [2023-12-27 19:43:10,480][106226] Updated weights for policy 0, policy_version 68056 (0.0009) [2023-12-27 19:43:10,540][106226] Updated weights for policy 0, policy_version 68066 (0.0009) [2023-12-27 19:43:10,708][106225] Updated weights for policy 1, policy_version 68182 (0.0008) [2023-12-27 19:43:10,752][106225] Updated weights for policy 1, policy_version 68192 (0.0008) [2023-12-27 19:43:10,804][106225] Updated weights for policy 1, policy_version 68202 (0.0008) [2023-12-27 19:43:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 34897920. Throughput: 0: 10067.7, 1: 9685.3. Samples: 34870812. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:43:11,175][105115] Avg episode reward: [(0, '-5.624'), (1, '-6.578')] [2023-12-27 19:43:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000068208_17465344.pth... [2023-12-27 19:43:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000068072_17432576.pth... [2023-12-27 19:43:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000067088_17178624.pth [2023-12-27 19:43:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000066920_17137664.pth [2023-12-27 19:43:11,247][106226] Updated weights for policy 0, policy_version 68076 (0.0008) [2023-12-27 19:43:11,309][106226] Updated weights for policy 0, policy_version 68086 (0.0009) [2023-12-27 19:43:11,372][106226] Updated weights for policy 0, policy_version 68096 (0.0009) [2023-12-27 19:43:11,625][106225] Updated weights for policy 1, policy_version 68212 (0.0008) [2023-12-27 19:43:11,688][106225] Updated weights for policy 1, policy_version 68222 (0.0009) [2023-12-27 19:43:11,757][106225] Updated weights for policy 1, policy_version 68232 (0.0009) [2023-12-27 19:43:12,089][106226] Updated weights for policy 0, policy_version 68106 (0.0007) [2023-12-27 19:43:12,143][106226] Updated weights for policy 0, policy_version 68116 (0.0009) [2023-12-27 19:43:12,206][106226] Updated weights for policy 0, policy_version 68126 (0.0009) [2023-12-27 19:43:12,262][106226] Updated weights for policy 0, policy_version 68136 (0.0009) [2023-12-27 19:43:12,540][106225] Updated weights for policy 1, policy_version 68242 (0.0009) [2023-12-27 19:43:12,603][106225] Updated weights for policy 1, policy_version 68252 (0.0008) [2023-12-27 19:43:12,667][106225] Updated weights for policy 1, policy_version 68262 (0.0009) [2023-12-27 19:43:12,726][106225] Updated weights for policy 1, policy_version 68272 (0.0008) [2023-12-27 19:43:13,021][106226] Updated weights for policy 0, policy_version 68146 (0.0009) [2023-12-27 19:43:13,088][106226] Updated weights for policy 0, policy_version 68156 (0.0008) [2023-12-27 19:43:13,147][106226] Updated weights for policy 0, policy_version 68166 (0.0009) [2023-12-27 19:43:13,456][106225] Updated weights for policy 1, policy_version 68282 (0.0005) [2023-12-27 19:43:13,514][106225] Updated weights for policy 1, policy_version 68292 (0.0006) [2023-12-27 19:43:13,575][106225] Updated weights for policy 1, policy_version 68302 (0.0008) [2023-12-27 19:43:13,833][106226] Updated weights for policy 0, policy_version 68176 (0.0010) [2023-12-27 19:43:13,883][106226] Updated weights for policy 0, policy_version 68186 (0.0010) [2023-12-27 19:43:13,930][106226] Updated weights for policy 0, policy_version 68196 (0.0010) [2023-12-27 19:43:14,178][106225] Updated weights for policy 1, policy_version 68312 (0.0008) [2023-12-27 19:43:14,229][106225] Updated weights for policy 1, policy_version 68322 (0.0007) [2023-12-27 19:43:14,277][106225] Updated weights for policy 1, policy_version 68332 (0.0005) [2023-12-27 19:43:14,616][106226] Updated weights for policy 0, policy_version 68206 (0.0007) [2023-12-27 19:43:14,677][106226] Updated weights for policy 0, policy_version 68216 (0.0006) [2023-12-27 19:43:14,733][106226] Updated weights for policy 0, policy_version 68226 (0.0010) [2023-12-27 19:43:14,919][106225] Updated weights for policy 1, policy_version 68342 (0.0008) [2023-12-27 19:43:14,966][106225] Updated weights for policy 1, policy_version 68352 (0.0010) [2023-12-27 19:43:15,019][106225] Updated weights for policy 1, policy_version 68362 (0.0010) [2023-12-27 19:43:15,476][106226] Updated weights for policy 0, policy_version 68236 (0.0010) [2023-12-27 19:43:15,542][106226] Updated weights for policy 0, policy_version 68246 (0.0011) [2023-12-27 19:43:15,601][106226] Updated weights for policy 0, policy_version 68256 (0.0011) [2023-12-27 19:43:15,791][106225] Updated weights for policy 1, policy_version 68372 (0.0008) [2023-12-27 19:43:15,842][106225] Updated weights for policy 1, policy_version 68382 (0.0010) [2023-12-27 19:43:15,897][106225] Updated weights for policy 1, policy_version 68392 (0.0007) [2023-12-27 19:43:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 34996224. Throughput: 0: 9927.3, 1: 9630.6. Samples: 34986844. Policy #0 lag: (min: 22.0, avg: 23.3, max: 54.0) [2023-12-27 19:43:16,175][105115] Avg episode reward: [(0, '-5.785'), (1, '-6.652')] [2023-12-27 19:43:16,276][106226] Updated weights for policy 0, policy_version 68266 (0.0010) [2023-12-27 19:43:16,342][106226] Updated weights for policy 0, policy_version 68276 (0.0005) [2023-12-27 19:43:16,401][106226] Updated weights for policy 0, policy_version 68286 (0.0009) [2023-12-27 19:43:16,463][106226] Updated weights for policy 0, policy_version 68296 (0.0010) [2023-12-27 19:43:16,480][106225] Updated weights for policy 1, policy_version 68402 (0.0005) [2023-12-27 19:43:16,545][106225] Updated weights for policy 1, policy_version 68412 (0.0005) [2023-12-27 19:43:16,601][106225] Updated weights for policy 1, policy_version 68422 (0.0006) [2023-12-27 19:43:16,659][106225] Updated weights for policy 1, policy_version 68432 (0.0005) [2023-12-27 19:43:17,043][106226] Updated weights for policy 0, policy_version 68306 (0.0005) [2023-12-27 19:43:17,094][106226] Updated weights for policy 0, policy_version 68316 (0.0005) [2023-12-27 19:43:17,147][106226] Updated weights for policy 0, policy_version 68326 (0.0005) [2023-12-27 19:43:17,151][106225] Updated weights for policy 1, policy_version 68442 (0.0010) [2023-12-27 19:43:17,214][106225] Updated weights for policy 1, policy_version 68452 (0.0010) [2023-12-27 19:43:17,282][106225] Updated weights for policy 1, policy_version 68462 (0.0010) [2023-12-27 19:43:17,663][106226] Updated weights for policy 0, policy_version 68336 (0.0005) [2023-12-27 19:43:17,735][106226] Updated weights for policy 0, policy_version 68346 (0.0006) [2023-12-27 19:43:17,799][106226] Updated weights for policy 0, policy_version 68356 (0.0011) [2023-12-27 19:43:17,890][106225] Updated weights for policy 1, policy_version 68472 (0.0008) [2023-12-27 19:43:17,953][106225] Updated weights for policy 1, policy_version 68482 (0.0006) [2023-12-27 19:43:18,019][106225] Updated weights for policy 1, policy_version 68492 (0.0005) [2023-12-27 19:43:18,458][106226] Updated weights for policy 0, policy_version 68366 (0.0008) [2023-12-27 19:43:18,514][106226] Updated weights for policy 0, policy_version 68376 (0.0008) [2023-12-27 19:43:18,569][106226] Updated weights for policy 0, policy_version 68386 (0.0011) [2023-12-27 19:43:18,666][106225] Updated weights for policy 1, policy_version 68502 (0.0008) [2023-12-27 19:43:18,722][106225] Updated weights for policy 1, policy_version 68512 (0.0008) [2023-12-27 19:43:18,769][106225] Updated weights for policy 1, policy_version 68522 (0.0007) [2023-12-27 19:43:19,306][106226] Updated weights for policy 0, policy_version 68396 (0.0011) [2023-12-27 19:43:19,371][106226] Updated weights for policy 0, policy_version 68406 (0.0011) [2023-12-27 19:43:19,436][106226] Updated weights for policy 0, policy_version 68416 (0.0011) [2023-12-27 19:43:19,438][106225] Updated weights for policy 1, policy_version 68532 (0.0007) [2023-12-27 19:43:19,502][106225] Updated weights for policy 1, policy_version 68542 (0.0006) [2023-12-27 19:43:19,574][106225] Updated weights for policy 1, policy_version 68552 (0.0008) [2023-12-27 19:43:20,093][106226] Updated weights for policy 0, policy_version 68426 (0.0009) [2023-12-27 19:43:20,148][106226] Updated weights for policy 0, policy_version 68436 (0.0011) [2023-12-27 19:43:20,204][106226] Updated weights for policy 0, policy_version 68446 (0.0010) [2023-12-27 19:43:20,274][106226] Updated weights for policy 0, policy_version 68456 (0.0006) [2023-12-27 19:43:20,329][106225] Updated weights for policy 1, policy_version 68562 (0.0008) [2023-12-27 19:43:20,385][106225] Updated weights for policy 1, policy_version 68572 (0.0008) [2023-12-27 19:43:20,436][106225] Updated weights for policy 1, policy_version 68582 (0.0008) [2023-12-27 19:43:20,496][106225] Updated weights for policy 1, policy_version 68592 (0.0008) [2023-12-27 19:43:20,969][106226] Updated weights for policy 0, policy_version 68466 (0.0011) [2023-12-27 19:43:21,046][106226] Updated weights for policy 0, policy_version 68476 (0.0011) [2023-12-27 19:43:21,110][106226] Updated weights for policy 0, policy_version 68486 (0.0009) [2023-12-27 19:43:21,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 35102720. Throughput: 0: 9999.2, 1: 9622.4. Samples: 35111280. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:21,175][105115] Avg episode reward: [(0, '-5.636'), (1, '-6.631')] [2023-12-27 19:43:21,372][106225] Updated weights for policy 1, policy_version 68602 (0.0009) [2023-12-27 19:43:21,439][106225] Updated weights for policy 1, policy_version 68612 (0.0009) [2023-12-27 19:43:21,503][106225] Updated weights for policy 1, policy_version 68622 (0.0006) [2023-12-27 19:43:21,866][106226] Updated weights for policy 0, policy_version 68496 (0.0008) [2023-12-27 19:43:21,934][106226] Updated weights for policy 0, policy_version 68506 (0.0010) [2023-12-27 19:43:22,004][106226] Updated weights for policy 0, policy_version 68516 (0.0011) [2023-12-27 19:43:22,182][106225] Updated weights for policy 1, policy_version 68632 (0.0008) [2023-12-27 19:43:22,244][106225] Updated weights for policy 1, policy_version 68642 (0.0006) [2023-12-27 19:43:22,319][106225] Updated weights for policy 1, policy_version 68652 (0.0007) [2023-12-27 19:43:22,732][106226] Updated weights for policy 0, policy_version 68526 (0.0010) [2023-12-27 19:43:22,798][106226] Updated weights for policy 0, policy_version 68536 (0.0009) [2023-12-27 19:43:22,861][106226] Updated weights for policy 0, policy_version 68546 (0.0008) [2023-12-27 19:43:22,967][106225] Updated weights for policy 1, policy_version 68662 (0.0008) [2023-12-27 19:43:23,027][106225] Updated weights for policy 1, policy_version 68672 (0.0009) [2023-12-27 19:43:23,072][106225] Updated weights for policy 1, policy_version 68682 (0.0008) [2023-12-27 19:43:23,543][106226] Updated weights for policy 0, policy_version 68556 (0.0007) [2023-12-27 19:43:23,597][106226] Updated weights for policy 0, policy_version 68566 (0.0006) [2023-12-27 19:43:23,651][106226] Updated weights for policy 0, policy_version 68576 (0.0005) [2023-12-27 19:43:23,816][106225] Updated weights for policy 1, policy_version 68692 (0.0008) [2023-12-27 19:43:23,879][106225] Updated weights for policy 1, policy_version 68702 (0.0010) [2023-12-27 19:43:23,943][106225] Updated weights for policy 1, policy_version 68712 (0.0010) [2023-12-27 19:43:24,288][106226] Updated weights for policy 0, policy_version 68586 (0.0009) [2023-12-27 19:43:24,343][106226] Updated weights for policy 0, policy_version 68596 (0.0009) [2023-12-27 19:43:24,395][106226] Updated weights for policy 0, policy_version 68606 (0.0009) [2023-12-27 19:43:24,447][106226] Updated weights for policy 0, policy_version 68616 (0.0008) [2023-12-27 19:43:24,634][106225] Updated weights for policy 1, policy_version 68722 (0.0010) [2023-12-27 19:43:24,685][106225] Updated weights for policy 1, policy_version 68732 (0.0008) [2023-12-27 19:43:24,734][106225] Updated weights for policy 1, policy_version 68742 (0.0007) [2023-12-27 19:43:24,785][106225] Updated weights for policy 1, policy_version 68752 (0.0008) [2023-12-27 19:43:25,130][106226] Updated weights for policy 0, policy_version 68626 (0.0007) [2023-12-27 19:43:25,186][106226] Updated weights for policy 0, policy_version 68636 (0.0006) [2023-12-27 19:43:25,239][106226] Updated weights for policy 0, policy_version 68646 (0.0008) [2023-12-27 19:43:25,525][106225] Updated weights for policy 1, policy_version 68762 (0.0005) [2023-12-27 19:43:25,586][106225] Updated weights for policy 1, policy_version 68772 (0.0006) [2023-12-27 19:43:25,655][106225] Updated weights for policy 1, policy_version 68782 (0.0005) [2023-12-27 19:43:25,828][106226] Updated weights for policy 0, policy_version 68656 (0.0010) [2023-12-27 19:43:25,889][106226] Updated weights for policy 0, policy_version 68666 (0.0007) [2023-12-27 19:43:25,947][106226] Updated weights for policy 0, policy_version 68676 (0.0010) [2023-12-27 19:43:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 35201024. Throughput: 0: 9955.5, 1: 9650.4. Samples: 35169664. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:26,175][105115] Avg episode reward: [(0, '-6.359'), (1, '-6.713')] [2023-12-27 19:43:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000068784_17612800.pth... [2023-12-27 19:43:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000068680_17588224.pth... [2023-12-27 19:43:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000067664_17326080.pth [2023-12-27 19:43:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000067528_17293312.pth [2023-12-27 19:43:26,267][106225] Updated weights for policy 1, policy_version 68792 (0.0010) [2023-12-27 19:43:26,324][106225] Updated weights for policy 1, policy_version 68802 (0.0010) [2023-12-27 19:43:26,385][106225] Updated weights for policy 1, policy_version 68812 (0.0008) [2023-12-27 19:43:26,604][106226] Updated weights for policy 0, policy_version 68686 (0.0009) [2023-12-27 19:43:26,663][106226] Updated weights for policy 0, policy_version 68696 (0.0010) [2023-12-27 19:43:26,727][106226] Updated weights for policy 0, policy_version 68706 (0.0008) [2023-12-27 19:43:27,048][106225] Updated weights for policy 1, policy_version 68822 (0.0009) [2023-12-27 19:43:27,101][106225] Updated weights for policy 1, policy_version 68832 (0.0008) [2023-12-27 19:43:27,154][106225] Updated weights for policy 1, policy_version 68842 (0.0009) [2023-12-27 19:43:27,248][106226] Updated weights for policy 0, policy_version 68716 (0.0005) [2023-12-27 19:43:27,302][106226] Updated weights for policy 0, policy_version 68726 (0.0006) [2023-12-27 19:43:27,359][106226] Updated weights for policy 0, policy_version 68736 (0.0008) [2023-12-27 19:43:27,851][106225] Updated weights for policy 1, policy_version 68852 (0.0008) [2023-12-27 19:43:27,912][106225] Updated weights for policy 1, policy_version 68862 (0.0008) [2023-12-27 19:43:27,964][106226] Updated weights for policy 0, policy_version 68746 (0.0010) [2023-12-27 19:43:27,968][106225] Updated weights for policy 1, policy_version 68872 (0.0008) [2023-12-27 19:43:28,021][106226] Updated weights for policy 0, policy_version 68756 (0.0008) [2023-12-27 19:43:28,069][106226] Updated weights for policy 0, policy_version 68766 (0.0007) [2023-12-27 19:43:28,120][106226] Updated weights for policy 0, policy_version 68776 (0.0008) [2023-12-27 19:43:28,687][106225] Updated weights for policy 1, policy_version 68882 (0.0007) [2023-12-27 19:43:28,746][106225] Updated weights for policy 1, policy_version 68892 (0.0008) [2023-12-27 19:43:28,797][106225] Updated weights for policy 1, policy_version 68902 (0.0008) [2023-12-27 19:43:28,814][106226] Updated weights for policy 0, policy_version 68786 (0.0009) [2023-12-27 19:43:28,853][106225] Updated weights for policy 1, policy_version 68912 (0.0009) [2023-12-27 19:43:28,864][106226] Updated weights for policy 0, policy_version 68796 (0.0006) [2023-12-27 19:43:28,914][106226] Updated weights for policy 0, policy_version 68806 (0.0008) [2023-12-27 19:43:29,619][106225] Updated weights for policy 1, policy_version 68922 (0.0008) [2023-12-27 19:43:29,652][106226] Updated weights for policy 0, policy_version 68816 (0.0007) [2023-12-27 19:43:29,666][106225] Updated weights for policy 1, policy_version 68932 (0.0005) [2023-12-27 19:43:29,711][106226] Updated weights for policy 0, policy_version 68826 (0.0007) [2023-12-27 19:43:29,715][106225] Updated weights for policy 1, policy_version 68942 (0.0006) [2023-12-27 19:43:29,783][106226] Updated weights for policy 0, policy_version 68836 (0.0011) [2023-12-27 19:43:30,452][106226] Updated weights for policy 0, policy_version 68846 (0.0008) [2023-12-27 19:43:30,469][106225] Updated weights for policy 1, policy_version 68952 (0.0007) [2023-12-27 19:43:30,503][106226] Updated weights for policy 0, policy_version 68856 (0.0005) [2023-12-27 19:43:30,517][106225] Updated weights for policy 1, policy_version 68962 (0.0008) [2023-12-27 19:43:30,558][106226] Updated weights for policy 0, policy_version 68866 (0.0006) [2023-12-27 19:43:30,560][106225] Updated weights for policy 1, policy_version 68972 (0.0006) [2023-12-27 19:43:31,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 35299328. Throughput: 0: 10106.9, 1: 9718.0. Samples: 35292660. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:31,175][106226] Updated weights for policy 0, policy_version 68876 (0.0008) [2023-12-27 19:43:31,175][105115] Avg episode reward: [(0, '-5.659'), (1, '-6.486')] [2023-12-27 19:43:31,203][106225] Updated weights for policy 1, policy_version 68982 (0.0008) [2023-12-27 19:43:31,220][106226] Updated weights for policy 0, policy_version 68886 (0.0006) [2023-12-27 19:43:31,261][106225] Updated weights for policy 1, policy_version 68992 (0.0007) [2023-12-27 19:43:31,282][106226] Updated weights for policy 0, policy_version 68896 (0.0008) [2023-12-27 19:43:31,325][106225] Updated weights for policy 1, policy_version 69002 (0.0008) [2023-12-27 19:43:32,021][106226] Updated weights for policy 0, policy_version 68906 (0.0007) [2023-12-27 19:43:32,078][106226] Updated weights for policy 0, policy_version 68916 (0.0008) [2023-12-27 19:43:32,100][106225] Updated weights for policy 1, policy_version 69012 (0.0008) [2023-12-27 19:43:32,133][106226] Updated weights for policy 0, policy_version 68926 (0.0007) [2023-12-27 19:43:32,160][106225] Updated weights for policy 1, policy_version 69022 (0.0008) [2023-12-27 19:43:32,190][106226] Updated weights for policy 0, policy_version 68936 (0.0007) [2023-12-27 19:43:32,216][106225] Updated weights for policy 1, policy_version 69032 (0.0006) [2023-12-27 19:43:32,861][106226] Updated weights for policy 0, policy_version 68946 (0.0006) [2023-12-27 19:43:32,880][106225] Updated weights for policy 1, policy_version 69042 (0.0007) [2023-12-27 19:43:32,913][106226] Updated weights for policy 0, policy_version 68956 (0.0006) [2023-12-27 19:43:32,941][106225] Updated weights for policy 1, policy_version 69052 (0.0007) [2023-12-27 19:43:32,967][106226] Updated weights for policy 0, policy_version 68966 (0.0005) [2023-12-27 19:43:33,001][106225] Updated weights for policy 1, policy_version 69062 (0.0006) [2023-12-27 19:43:33,069][106225] Updated weights for policy 1, policy_version 69072 (0.0005) [2023-12-27 19:43:33,524][106226] Updated weights for policy 0, policy_version 68976 (0.0009) [2023-12-27 19:43:33,578][106225] Updated weights for policy 1, policy_version 69082 (0.0005) [2023-12-27 19:43:33,580][106226] Updated weights for policy 0, policy_version 68986 (0.0008) [2023-12-27 19:43:33,627][106225] Updated weights for policy 1, policy_version 69092 (0.0005) [2023-12-27 19:43:33,640][106226] Updated weights for policy 0, policy_version 68996 (0.0008) [2023-12-27 19:43:33,680][106225] Updated weights for policy 1, policy_version 69102 (0.0005) [2023-12-27 19:43:34,297][106226] Updated weights for policy 0, policy_version 69006 (0.0008) [2023-12-27 19:43:34,356][106226] Updated weights for policy 0, policy_version 69016 (0.0007) [2023-12-27 19:43:34,361][106225] Updated weights for policy 1, policy_version 69112 (0.0008) [2023-12-27 19:43:34,414][106226] Updated weights for policy 0, policy_version 69026 (0.0005) [2023-12-27 19:43:34,424][106225] Updated weights for policy 1, policy_version 69122 (0.0008) [2023-12-27 19:43:34,485][106225] Updated weights for policy 1, policy_version 69132 (0.0007) [2023-12-27 19:43:35,121][106226] Updated weights for policy 0, policy_version 69036 (0.0007) [2023-12-27 19:43:35,180][106226] Updated weights for policy 0, policy_version 69046 (0.0008) [2023-12-27 19:43:35,209][106225] Updated weights for policy 1, policy_version 69142 (0.0007) [2023-12-27 19:43:35,239][106226] Updated weights for policy 0, policy_version 69056 (0.0008) [2023-12-27 19:43:35,267][106225] Updated weights for policy 1, policy_version 69152 (0.0005) [2023-12-27 19:43:35,325][106225] Updated weights for policy 1, policy_version 69162 (0.0005) [2023-12-27 19:43:35,831][106226] Updated weights for policy 0, policy_version 69066 (0.0009) [2023-12-27 19:43:35,887][106226] Updated weights for policy 0, policy_version 69076 (0.0006) [2023-12-27 19:43:35,896][106225] Updated weights for policy 1, policy_version 69172 (0.0009) [2023-12-27 19:43:35,949][106226] Updated weights for policy 0, policy_version 69086 (0.0006) [2023-12-27 19:43:35,954][106225] Updated weights for policy 1, policy_version 69182 (0.0010) [2023-12-27 19:43:36,009][106225] Updated weights for policy 1, policy_version 69192 (0.0008) [2023-12-27 19:43:36,013][106226] Updated weights for policy 0, policy_version 69096 (0.0005) [2023-12-27 19:43:36,175][105115] Fps is (10 sec: 21298.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 35414016. Throughput: 0: 10154.1, 1: 9888.0. Samples: 35419688. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:36,176][105115] Avg episode reward: [(0, '-5.902'), (1, '-6.331')] [2023-12-27 19:43:36,610][106226] Updated weights for policy 0, policy_version 69106 (0.0008) [2023-12-27 19:43:36,672][106226] Updated weights for policy 0, policy_version 69116 (0.0009) [2023-12-27 19:43:36,733][106226] Updated weights for policy 0, policy_version 69126 (0.0008) [2023-12-27 19:43:36,770][106225] Updated weights for policy 1, policy_version 69202 (0.0009) [2023-12-27 19:43:36,829][106225] Updated weights for policy 1, policy_version 69212 (0.0009) [2023-12-27 19:43:36,889][106225] Updated weights for policy 1, policy_version 69222 (0.0009) [2023-12-27 19:43:36,948][106225] Updated weights for policy 1, policy_version 69232 (0.0008) [2023-12-27 19:43:37,489][106226] Updated weights for policy 0, policy_version 69136 (0.0007) [2023-12-27 19:43:37,557][106226] Updated weights for policy 0, policy_version 69146 (0.0007) [2023-12-27 19:43:37,575][106225] Updated weights for policy 1, policy_version 69242 (0.0010) [2023-12-27 19:43:37,624][106226] Updated weights for policy 0, policy_version 69156 (0.0008) [2023-12-27 19:43:37,627][106225] Updated weights for policy 1, policy_version 69252 (0.0010) [2023-12-27 19:43:37,682][106225] Updated weights for policy 1, policy_version 69262 (0.0010) [2023-12-27 19:43:38,175][106226] Updated weights for policy 0, policy_version 69166 (0.0007) [2023-12-27 19:43:38,237][106226] Updated weights for policy 0, policy_version 69176 (0.0009) [2023-12-27 19:43:38,300][106226] Updated weights for policy 0, policy_version 69186 (0.0008) [2023-12-27 19:43:38,493][106225] Updated weights for policy 1, policy_version 69272 (0.0009) [2023-12-27 19:43:38,539][106225] Updated weights for policy 1, policy_version 69282 (0.0008) [2023-12-27 19:43:38,605][106225] Updated weights for policy 1, policy_version 69292 (0.0008) [2023-12-27 19:43:39,038][106226] Updated weights for policy 0, policy_version 69196 (0.0008) [2023-12-27 19:43:39,096][106226] Updated weights for policy 0, policy_version 69206 (0.0010) [2023-12-27 19:43:39,153][106226] Updated weights for policy 0, policy_version 69216 (0.0009) [2023-12-27 19:43:39,374][106225] Updated weights for policy 1, policy_version 69302 (0.0008) [2023-12-27 19:43:39,448][106225] Updated weights for policy 1, policy_version 69312 (0.0008) [2023-12-27 19:43:39,512][106225] Updated weights for policy 1, policy_version 69322 (0.0007) [2023-12-27 19:43:39,898][106226] Updated weights for policy 0, policy_version 69226 (0.0006) [2023-12-27 19:43:39,969][106226] Updated weights for policy 0, policy_version 69236 (0.0008) [2023-12-27 19:43:40,030][106226] Updated weights for policy 0, policy_version 69246 (0.0009) [2023-12-27 19:43:40,093][106226] Updated weights for policy 0, policy_version 69256 (0.0009) [2023-12-27 19:43:40,277][106225] Updated weights for policy 1, policy_version 69332 (0.0008) [2023-12-27 19:43:40,337][106225] Updated weights for policy 1, policy_version 69342 (0.0009) [2023-12-27 19:43:40,400][106225] Updated weights for policy 1, policy_version 69352 (0.0007) [2023-12-27 19:43:40,870][106226] Updated weights for policy 0, policy_version 69266 (0.0010) [2023-12-27 19:43:40,929][106226] Updated weights for policy 0, policy_version 69276 (0.0008) [2023-12-27 19:43:40,986][106226] Updated weights for policy 0, policy_version 69286 (0.0007) [2023-12-27 19:43:41,058][106225] Updated weights for policy 1, policy_version 69362 (0.0006) [2023-12-27 19:43:41,129][106225] Updated weights for policy 1, policy_version 69372 (0.0008) [2023-12-27 19:43:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 35504128. Throughput: 0: 10161.7, 1: 9872.2. Samples: 35478292. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:41,175][105115] Avg episode reward: [(0, '-5.978'), (1, '-6.342')] [2023-12-27 19:43:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000069288_17743872.pth... [2023-12-27 19:43:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000068072_17432576.pth [2023-12-27 19:43:41,202][106225] Updated weights for policy 1, policy_version 69382 (0.0008) [2023-12-27 19:43:41,265][106225] Updated weights for policy 1, policy_version 69392 (0.0008) [2023-12-27 19:43:41,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000069392_17768448.pth... [2023-12-27 19:43:41,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000068208_17465344.pth [2023-12-27 19:43:41,704][106226] Updated weights for policy 0, policy_version 69296 (0.0011) [2023-12-27 19:43:41,776][106226] Updated weights for policy 0, policy_version 69306 (0.0009) [2023-12-27 19:43:41,835][106226] Updated weights for policy 0, policy_version 69316 (0.0008) [2023-12-27 19:43:42,021][106225] Updated weights for policy 1, policy_version 69402 (0.0009) [2023-12-27 19:43:42,081][106225] Updated weights for policy 1, policy_version 69412 (0.0009) [2023-12-27 19:43:42,146][106225] Updated weights for policy 1, policy_version 69422 (0.0010) [2023-12-27 19:43:42,551][106226] Updated weights for policy 0, policy_version 69326 (0.0009) [2023-12-27 19:43:42,611][106226] Updated weights for policy 0, policy_version 69336 (0.0009) [2023-12-27 19:43:42,669][106226] Updated weights for policy 0, policy_version 69346 (0.0009) [2023-12-27 19:43:42,888][106225] Updated weights for policy 1, policy_version 69432 (0.0010) [2023-12-27 19:43:42,945][106225] Updated weights for policy 1, policy_version 69442 (0.0010) [2023-12-27 19:43:43,004][106225] Updated weights for policy 1, policy_version 69452 (0.0010) [2023-12-27 19:43:43,392][106226] Updated weights for policy 0, policy_version 69356 (0.0007) [2023-12-27 19:43:43,453][106226] Updated weights for policy 0, policy_version 69366 (0.0008) [2023-12-27 19:43:43,514][106226] Updated weights for policy 0, policy_version 69376 (0.0008) [2023-12-27 19:43:43,717][106225] Updated weights for policy 1, policy_version 69462 (0.0010) [2023-12-27 19:43:43,766][106225] Updated weights for policy 1, policy_version 69472 (0.0010) [2023-12-27 19:43:43,816][106225] Updated weights for policy 1, policy_version 69482 (0.0010) [2023-12-27 19:43:44,246][106226] Updated weights for policy 0, policy_version 69386 (0.0008) [2023-12-27 19:43:44,306][106226] Updated weights for policy 0, policy_version 69396 (0.0008) [2023-12-27 19:43:44,363][106226] Updated weights for policy 0, policy_version 69406 (0.0008) [2023-12-27 19:43:44,411][106226] Updated weights for policy 0, policy_version 69416 (0.0008) [2023-12-27 19:43:44,548][106225] Updated weights for policy 1, policy_version 69492 (0.0010) [2023-12-27 19:43:44,608][106225] Updated weights for policy 1, policy_version 69502 (0.0010) [2023-12-27 19:43:44,670][106225] Updated weights for policy 1, policy_version 69512 (0.0010) [2023-12-27 19:43:45,179][106226] Updated weights for policy 0, policy_version 69426 (0.0009) [2023-12-27 19:43:45,243][106226] Updated weights for policy 0, policy_version 69436 (0.0009) [2023-12-27 19:43:45,306][106226] Updated weights for policy 0, policy_version 69446 (0.0009) [2023-12-27 19:43:45,409][106225] Updated weights for policy 1, policy_version 69522 (0.0010) [2023-12-27 19:43:45,472][106225] Updated weights for policy 1, policy_version 69532 (0.0009) [2023-12-27 19:43:45,535][106225] Updated weights for policy 1, policy_version 69542 (0.0006) [2023-12-27 19:43:45,602][106225] Updated weights for policy 1, policy_version 69552 (0.0008) [2023-12-27 19:43:46,075][106226] Updated weights for policy 0, policy_version 69456 (0.0008) [2023-12-27 19:43:46,129][106226] Updated weights for policy 0, policy_version 69466 (0.0006) [2023-12-27 19:43:46,174][105115] Fps is (10 sec: 18022.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 35594240. Throughput: 0: 10015.2, 1: 9849.2. Samples: 35590676. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:46,175][105115] Avg episode reward: [(0, '-5.914'), (1, '-6.633')] [2023-12-27 19:43:46,186][106226] Updated weights for policy 0, policy_version 69476 (0.0005) [2023-12-27 19:43:46,226][106225] Updated weights for policy 1, policy_version 69562 (0.0008) [2023-12-27 19:43:46,294][106225] Updated weights for policy 1, policy_version 69572 (0.0007) [2023-12-27 19:43:46,358][106225] Updated weights for policy 1, policy_version 69582 (0.0005) [2023-12-27 19:43:46,755][106226] Updated weights for policy 0, policy_version 69486 (0.0006) [2023-12-27 19:43:46,819][106226] Updated weights for policy 0, policy_version 69496 (0.0007) [2023-12-27 19:43:46,883][106226] Updated weights for policy 0, policy_version 69506 (0.0007) [2023-12-27 19:43:46,990][106225] Updated weights for policy 1, policy_version 69592 (0.0005) [2023-12-27 19:43:47,040][106225] Updated weights for policy 1, policy_version 69602 (0.0008) [2023-12-27 19:43:47,094][106225] Updated weights for policy 1, policy_version 69612 (0.0007) [2023-12-27 19:43:47,593][106226] Updated weights for policy 0, policy_version 69516 (0.0007) [2023-12-27 19:43:47,642][106226] Updated weights for policy 0, policy_version 69526 (0.0009) [2023-12-27 19:43:47,694][106226] Updated weights for policy 0, policy_version 69536 (0.0008) [2023-12-27 19:43:47,698][106225] Updated weights for policy 1, policy_version 69622 (0.0008) [2023-12-27 19:43:47,760][106225] Updated weights for policy 1, policy_version 69632 (0.0008) [2023-12-27 19:43:47,806][106225] Updated weights for policy 1, policy_version 69642 (0.0007) [2023-12-27 19:43:48,438][106226] Updated weights for policy 0, policy_version 69546 (0.0008) [2023-12-27 19:43:48,475][106225] Updated weights for policy 1, policy_version 69652 (0.0008) [2023-12-27 19:43:48,500][106226] Updated weights for policy 0, policy_version 69556 (0.0009) [2023-12-27 19:43:48,533][106225] Updated weights for policy 1, policy_version 69662 (0.0007) [2023-12-27 19:43:48,559][106226] Updated weights for policy 0, policy_version 69566 (0.0006) [2023-12-27 19:43:48,596][106225] Updated weights for policy 1, policy_version 69672 (0.0007) [2023-12-27 19:43:48,618][106226] Updated weights for policy 0, policy_version 69576 (0.0006) [2023-12-27 19:43:49,330][106226] Updated weights for policy 0, policy_version 69586 (0.0006) [2023-12-27 19:43:49,336][106225] Updated weights for policy 1, policy_version 69682 (0.0007) [2023-12-27 19:43:49,397][106226] Updated weights for policy 0, policy_version 69596 (0.0007) [2023-12-27 19:43:49,403][106225] Updated weights for policy 1, policy_version 69692 (0.0008) [2023-12-27 19:43:49,451][106225] Updated weights for policy 1, policy_version 69702 (0.0006) [2023-12-27 19:43:49,453][106226] Updated weights for policy 0, policy_version 69606 (0.0006) [2023-12-27 19:43:49,508][106225] Updated weights for policy 1, policy_version 69712 (0.0008) [2023-12-27 19:43:50,116][106226] Updated weights for policy 0, policy_version 69616 (0.0008) [2023-12-27 19:43:50,186][106226] Updated weights for policy 0, policy_version 69626 (0.0009) [2023-12-27 19:43:50,215][106225] Updated weights for policy 1, policy_version 69722 (0.0008) [2023-12-27 19:43:50,245][106226] Updated weights for policy 0, policy_version 69636 (0.0007) [2023-12-27 19:43:50,271][106225] Updated weights for policy 1, policy_version 69732 (0.0007) [2023-12-27 19:43:50,330][106225] Updated weights for policy 1, policy_version 69742 (0.0009) [2023-12-27 19:43:50,860][106226] Updated weights for policy 0, policy_version 69646 (0.0006) [2023-12-27 19:43:50,923][106226] Updated weights for policy 0, policy_version 69656 (0.0008) [2023-12-27 19:43:50,985][106226] Updated weights for policy 0, policy_version 69666 (0.0006) [2023-12-27 19:43:51,155][106225] Updated weights for policy 1, policy_version 69752 (0.0008) [2023-12-27 19:43:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 35700736. Throughput: 0: 10061.0, 1: 9872.0. Samples: 35710864. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:51,175][105115] Avg episode reward: [(0, '-5.524'), (1, '-6.434')] [2023-12-27 19:43:51,220][106225] Updated weights for policy 1, policy_version 69762 (0.0008) [2023-12-27 19:43:51,288][106225] Updated weights for policy 1, policy_version 69772 (0.0007) [2023-12-27 19:43:51,655][106226] Updated weights for policy 0, policy_version 69676 (0.0009) [2023-12-27 19:43:51,722][106226] Updated weights for policy 0, policy_version 69686 (0.0010) [2023-12-27 19:43:51,794][106226] Updated weights for policy 0, policy_version 69696 (0.0011) [2023-12-27 19:43:52,000][106225] Updated weights for policy 1, policy_version 69782 (0.0008) [2023-12-27 19:43:52,052][106225] Updated weights for policy 1, policy_version 69792 (0.0008) [2023-12-27 19:43:52,111][106225] Updated weights for policy 1, policy_version 69802 (0.0008) [2023-12-27 19:43:52,518][106226] Updated weights for policy 0, policy_version 69706 (0.0011) [2023-12-27 19:43:52,579][106226] Updated weights for policy 0, policy_version 69716 (0.0008) [2023-12-27 19:43:52,644][106226] Updated weights for policy 0, policy_version 69726 (0.0009) [2023-12-27 19:43:52,699][106226] Updated weights for policy 0, policy_version 69736 (0.0008) [2023-12-27 19:43:52,860][106225] Updated weights for policy 1, policy_version 69812 (0.0009) [2023-12-27 19:43:52,917][106225] Updated weights for policy 1, policy_version 69822 (0.0009) [2023-12-27 19:43:52,980][106225] Updated weights for policy 1, policy_version 69832 (0.0008) [2023-12-27 19:43:53,354][106226] Updated weights for policy 0, policy_version 69746 (0.0009) [2023-12-27 19:43:53,413][106226] Updated weights for policy 0, policy_version 69756 (0.0009) [2023-12-27 19:43:53,463][106226] Updated weights for policy 0, policy_version 69766 (0.0008) [2023-12-27 19:43:53,673][106225] Updated weights for policy 1, policy_version 69842 (0.0008) [2023-12-27 19:43:53,737][106225] Updated weights for policy 1, policy_version 69852 (0.0009) [2023-12-27 19:43:53,795][106225] Updated weights for policy 1, policy_version 69862 (0.0008) [2023-12-27 19:43:53,854][106225] Updated weights for policy 1, policy_version 69872 (0.0008) [2023-12-27 19:43:54,075][106226] Updated weights for policy 0, policy_version 69776 (0.0005) [2023-12-27 19:43:54,127][106226] Updated weights for policy 0, policy_version 69786 (0.0008) [2023-12-27 19:43:54,180][106226] Updated weights for policy 0, policy_version 69796 (0.0009) [2023-12-27 19:43:54,605][106225] Updated weights for policy 1, policy_version 69882 (0.0009) [2023-12-27 19:43:54,655][106225] Updated weights for policy 1, policy_version 69892 (0.0008) [2023-12-27 19:43:54,704][106225] Updated weights for policy 1, policy_version 69902 (0.0008) [2023-12-27 19:43:54,770][106226] Updated weights for policy 0, policy_version 69806 (0.0009) [2023-12-27 19:43:54,823][106226] Updated weights for policy 0, policy_version 69816 (0.0008) [2023-12-27 19:43:54,883][106226] Updated weights for policy 0, policy_version 69826 (0.0008) [2023-12-27 19:43:55,508][106225] Updated weights for policy 1, policy_version 69912 (0.0008) [2023-12-27 19:43:55,519][106226] Updated weights for policy 0, policy_version 69836 (0.0008) [2023-12-27 19:43:55,556][106225] Updated weights for policy 1, policy_version 69922 (0.0006) [2023-12-27 19:43:55,575][106226] Updated weights for policy 0, policy_version 69846 (0.0008) [2023-12-27 19:43:55,603][106225] Updated weights for policy 1, policy_version 69932 (0.0009) [2023-12-27 19:43:55,632][106226] Updated weights for policy 0, policy_version 69856 (0.0009) [2023-12-27 19:43:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 35799040. Throughput: 0: 10096.3, 1: 9889.9. Samples: 35770188. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-27 19:43:56,175][105115] Avg episode reward: [(0, '-5.728'), (1, '-6.525')] [2023-12-27 19:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000069936_17907712.pth... [2023-12-27 19:43:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000069864_17891328.pth... [2023-12-27 19:43:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000068784_17612800.pth [2023-12-27 19:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000068680_17588224.pth [2023-12-27 19:43:56,290][106225] Updated weights for policy 1, policy_version 69942 (0.0009) [2023-12-27 19:43:56,341][106225] Updated weights for policy 1, policy_version 69952 (0.0008) [2023-12-27 19:43:56,356][106226] Updated weights for policy 0, policy_version 69866 (0.0007) [2023-12-27 19:43:56,389][106225] Updated weights for policy 1, policy_version 69962 (0.0006) [2023-12-27 19:43:56,403][106226] Updated weights for policy 0, policy_version 69876 (0.0006) [2023-12-27 19:43:56,450][106226] Updated weights for policy 0, policy_version 69886 (0.0007) [2023-12-27 19:43:56,508][106226] Updated weights for policy 0, policy_version 69896 (0.0009) [2023-12-27 19:43:57,065][106225] Updated weights for policy 1, policy_version 69972 (0.0007) [2023-12-27 19:43:57,130][106225] Updated weights for policy 1, policy_version 69982 (0.0008) [2023-12-27 19:43:57,186][106225] Updated weights for policy 1, policy_version 69992 (0.0007) [2023-12-27 19:43:57,190][106226] Updated weights for policy 0, policy_version 69906 (0.0007) [2023-12-27 19:43:57,250][106226] Updated weights for policy 0, policy_version 69916 (0.0006) [2023-12-27 19:43:57,311][106226] Updated weights for policy 0, policy_version 69926 (0.0011) [2023-12-27 19:43:57,940][106226] Updated weights for policy 0, policy_version 69936 (0.0007) [2023-12-27 19:43:57,951][106225] Updated weights for policy 1, policy_version 70002 (0.0008) [2023-12-27 19:43:58,000][106225] Updated weights for policy 1, policy_version 70012 (0.0008) [2023-12-27 19:43:58,005][106226] Updated weights for policy 0, policy_version 69946 (0.0007) [2023-12-27 19:43:58,051][106225] Updated weights for policy 1, policy_version 70022 (0.0008) [2023-12-27 19:43:58,065][106226] Updated weights for policy 0, policy_version 69956 (0.0009) [2023-12-27 19:43:58,099][106225] Updated weights for policy 1, policy_version 70032 (0.0006) [2023-12-27 19:43:58,893][106226] Updated weights for policy 0, policy_version 69966 (0.0008) [2023-12-27 19:43:58,955][106226] Updated weights for policy 0, policy_version 69976 (0.0011) [2023-12-27 19:43:59,015][106226] Updated weights for policy 0, policy_version 69986 (0.0010) [2023-12-27 19:43:59,019][106225] Updated weights for policy 1, policy_version 70042 (0.0010) [2023-12-27 19:43:59,080][106225] Updated weights for policy 1, policy_version 70052 (0.0011) [2023-12-27 19:43:59,137][106225] Updated weights for policy 1, policy_version 70062 (0.0010) [2023-12-27 19:43:59,781][106225] Updated weights for policy 1, policy_version 70072 (0.0006) [2023-12-27 19:43:59,803][106226] Updated weights for policy 0, policy_version 69996 (0.0007) [2023-12-27 19:43:59,830][106225] Updated weights for policy 1, policy_version 70082 (0.0007) [2023-12-27 19:43:59,870][106226] Updated weights for policy 0, policy_version 70006 (0.0009) [2023-12-27 19:43:59,895][106225] Updated weights for policy 1, policy_version 70092 (0.0008) [2023-12-27 19:43:59,938][106226] Updated weights for policy 0, policy_version 70016 (0.0008) [2023-12-27 19:44:00,557][106226] Updated weights for policy 0, policy_version 70026 (0.0009) [2023-12-27 19:44:00,611][106226] Updated weights for policy 0, policy_version 70036 (0.0008) [2023-12-27 19:44:00,645][106225] Updated weights for policy 1, policy_version 70102 (0.0007) [2023-12-27 19:44:00,656][106226] Updated weights for policy 0, policy_version 70046 (0.0006) [2023-12-27 19:44:00,703][106225] Updated weights for policy 1, policy_version 70112 (0.0008) [2023-12-27 19:44:00,714][106226] Updated weights for policy 0, policy_version 70056 (0.0006) [2023-12-27 19:44:00,767][106225] Updated weights for policy 1, policy_version 70122 (0.0009) [2023-12-27 19:44:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 35897344. Throughput: 0: 10132.5, 1: 9864.6. Samples: 35886716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:01,175][105115] Avg episode reward: [(0, '-5.553'), (1, '-6.566')] [2023-12-27 19:44:01,331][106226] Updated weights for policy 0, policy_version 70066 (0.0010) [2023-12-27 19:44:01,405][106226] Updated weights for policy 0, policy_version 70076 (0.0008) [2023-12-27 19:44:01,476][106226] Updated weights for policy 0, policy_version 70086 (0.0005) [2023-12-27 19:44:01,573][106225] Updated weights for policy 1, policy_version 70132 (0.0007) [2023-12-27 19:44:01,641][106225] Updated weights for policy 1, policy_version 70142 (0.0007) [2023-12-27 19:44:01,710][106225] Updated weights for policy 1, policy_version 70152 (0.0008) [2023-12-27 19:44:02,135][106226] Updated weights for policy 0, policy_version 70096 (0.0006) [2023-12-27 19:44:02,201][106226] Updated weights for policy 0, policy_version 70106 (0.0005) [2023-12-27 19:44:02,255][106226] Updated weights for policy 0, policy_version 70116 (0.0007) [2023-12-27 19:44:02,525][106225] Updated weights for policy 1, policy_version 70162 (0.0008) [2023-12-27 19:44:02,579][106225] Updated weights for policy 1, policy_version 70172 (0.0009) [2023-12-27 19:44:02,632][106225] Updated weights for policy 1, policy_version 70182 (0.0008) [2023-12-27 19:44:02,684][106225] Updated weights for policy 1, policy_version 70192 (0.0009) [2023-12-27 19:44:02,810][106226] Updated weights for policy 0, policy_version 70126 (0.0007) [2023-12-27 19:44:02,872][106226] Updated weights for policy 0, policy_version 70136 (0.0007) [2023-12-27 19:44:02,930][106226] Updated weights for policy 0, policy_version 70146 (0.0009) [2023-12-27 19:44:03,341][106225] Updated weights for policy 1, policy_version 70202 (0.0005) [2023-12-27 19:44:03,395][106225] Updated weights for policy 1, policy_version 70212 (0.0005) [2023-12-27 19:44:03,456][106225] Updated weights for policy 1, policy_version 70222 (0.0005) [2023-12-27 19:44:03,532][106226] Updated weights for policy 0, policy_version 70156 (0.0008) [2023-12-27 19:44:03,581][106226] Updated weights for policy 0, policy_version 70166 (0.0006) [2023-12-27 19:44:03,626][106226] Updated weights for policy 0, policy_version 70176 (0.0005) [2023-12-27 19:44:04,046][106225] Updated weights for policy 1, policy_version 70232 (0.0007) [2023-12-27 19:44:04,116][106225] Updated weights for policy 1, policy_version 70242 (0.0010) [2023-12-27 19:44:04,190][106225] Updated weights for policy 1, policy_version 70252 (0.0010) [2023-12-27 19:44:04,233][106226] Updated weights for policy 0, policy_version 70186 (0.0005) [2023-12-27 19:44:04,294][106226] Updated weights for policy 0, policy_version 70196 (0.0006) [2023-12-27 19:44:04,358][106226] Updated weights for policy 0, policy_version 70206 (0.0008) [2023-12-27 19:44:04,423][106226] Updated weights for policy 0, policy_version 70216 (0.0008) [2023-12-27 19:44:04,891][106225] Updated weights for policy 1, policy_version 70262 (0.0006) [2023-12-27 19:44:04,948][106225] Updated weights for policy 1, policy_version 70272 (0.0005) [2023-12-27 19:44:04,999][106225] Updated weights for policy 1, policy_version 70282 (0.0007) [2023-12-27 19:44:05,076][106226] Updated weights for policy 0, policy_version 70226 (0.0009) [2023-12-27 19:44:05,133][106226] Updated weights for policy 0, policy_version 70236 (0.0009) [2023-12-27 19:44:05,198][106226] Updated weights for policy 0, policy_version 70246 (0.0008) [2023-12-27 19:44:05,656][106225] Updated weights for policy 1, policy_version 70292 (0.0008) [2023-12-27 19:44:05,703][106225] Updated weights for policy 1, policy_version 70302 (0.0008) [2023-12-27 19:44:05,752][106225] Updated weights for policy 1, policy_version 70312 (0.0009) [2023-12-27 19:44:05,895][106226] Updated weights for policy 0, policy_version 70256 (0.0009) [2023-12-27 19:44:05,954][106226] Updated weights for policy 0, policy_version 70266 (0.0009) [2023-12-27 19:44:06,012][106226] Updated weights for policy 0, policy_version 70276 (0.0009) [2023-12-27 19:44:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 36003840. Throughput: 0: 10191.1, 1: 9774.0. Samples: 36009704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:06,175][105115] Avg episode reward: [(0, '-5.285'), (1, '-6.382')] [2023-12-27 19:44:06,520][106225] Updated weights for policy 1, policy_version 70322 (0.0008) [2023-12-27 19:44:06,582][106225] Updated weights for policy 1, policy_version 70332 (0.0008) [2023-12-27 19:44:06,643][106225] Updated weights for policy 1, policy_version 70342 (0.0008) [2023-12-27 19:44:06,704][106225] Updated weights for policy 1, policy_version 70352 (0.0008) [2023-12-27 19:44:06,721][106226] Updated weights for policy 0, policy_version 70286 (0.0008) [2023-12-27 19:44:06,767][106226] Updated weights for policy 0, policy_version 70296 (0.0008) [2023-12-27 19:44:06,824][106226] Updated weights for policy 0, policy_version 70306 (0.0009) [2023-12-27 19:44:07,305][106225] Updated weights for policy 1, policy_version 70362 (0.0007) [2023-12-27 19:44:07,367][106225] Updated weights for policy 1, policy_version 70372 (0.0008) [2023-12-27 19:44:07,430][106225] Updated weights for policy 1, policy_version 70382 (0.0006) [2023-12-27 19:44:07,650][106226] Updated weights for policy 0, policy_version 70316 (0.0008) [2023-12-27 19:44:07,706][106226] Updated weights for policy 0, policy_version 70326 (0.0009) [2023-12-27 19:44:07,766][106226] Updated weights for policy 0, policy_version 70336 (0.0008) [2023-12-27 19:44:08,111][106225] Updated weights for policy 1, policy_version 70392 (0.0008) [2023-12-27 19:44:08,170][106225] Updated weights for policy 1, policy_version 70402 (0.0007) [2023-12-27 19:44:08,225][106225] Updated weights for policy 1, policy_version 70412 (0.0009) [2023-12-27 19:44:08,486][106226] Updated weights for policy 0, policy_version 70346 (0.0009) [2023-12-27 19:44:08,540][106226] Updated weights for policy 0, policy_version 70356 (0.0010) [2023-12-27 19:44:08,593][106226] Updated weights for policy 0, policy_version 70366 (0.0010) [2023-12-27 19:44:08,653][106226] Updated weights for policy 0, policy_version 70376 (0.0007) [2023-12-27 19:44:08,940][106225] Updated weights for policy 1, policy_version 70422 (0.0008) [2023-12-27 19:44:09,000][106225] Updated weights for policy 1, policy_version 70432 (0.0010) [2023-12-27 19:44:09,052][106225] Updated weights for policy 1, policy_version 70442 (0.0010) [2023-12-27 19:44:09,278][106226] Updated weights for policy 0, policy_version 70386 (0.0009) [2023-12-27 19:44:09,339][106226] Updated weights for policy 0, policy_version 70396 (0.0008) [2023-12-27 19:44:09,402][106226] Updated weights for policy 0, policy_version 70406 (0.0011) [2023-12-27 19:44:09,688][106225] Updated weights for policy 1, policy_version 70452 (0.0008) [2023-12-27 19:44:09,760][106225] Updated weights for policy 1, policy_version 70462 (0.0007) [2023-12-27 19:44:09,826][106225] Updated weights for policy 1, policy_version 70472 (0.0006) [2023-12-27 19:44:10,210][106226] Updated weights for policy 0, policy_version 70416 (0.0009) [2023-12-27 19:44:10,280][106226] Updated weights for policy 0, policy_version 70426 (0.0010) [2023-12-27 19:44:10,350][106226] Updated weights for policy 0, policy_version 70436 (0.0009) [2023-12-27 19:44:10,479][106225] Updated weights for policy 1, policy_version 70482 (0.0008) [2023-12-27 19:44:10,538][106225] Updated weights for policy 1, policy_version 70492 (0.0008) [2023-12-27 19:44:10,598][106225] Updated weights for policy 1, policy_version 70502 (0.0008) [2023-12-27 19:44:10,650][106225] Updated weights for policy 1, policy_version 70512 (0.0008) [2023-12-27 19:44:11,076][106226] Updated weights for policy 0, policy_version 70446 (0.0008) [2023-12-27 19:44:11,133][106226] Updated weights for policy 0, policy_version 70456 (0.0008) [2023-12-27 19:44:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 36093952. Throughput: 0: 10206.9, 1: 9790.1. Samples: 36069532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:11,175][105115] Avg episode reward: [(0, '-6.057'), (1, '-6.664')] [2023-12-27 19:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000070512_18055168.pth... [2023-12-27 19:44:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000069392_17768448.pth [2023-12-27 19:44:11,204][106226] Updated weights for policy 0, policy_version 70466 (0.0009) [2023-12-27 19:44:11,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000070472_18046976.pth... [2023-12-27 19:44:11,246][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000069288_17743872.pth [2023-12-27 19:44:11,416][106225] Updated weights for policy 1, policy_version 70522 (0.0008) [2023-12-27 19:44:11,480][106225] Updated weights for policy 1, policy_version 70532 (0.0008) [2023-12-27 19:44:11,543][106225] Updated weights for policy 1, policy_version 70542 (0.0008) [2023-12-27 19:44:12,022][106226] Updated weights for policy 0, policy_version 70476 (0.0007) [2023-12-27 19:44:12,093][106226] Updated weights for policy 0, policy_version 70486 (0.0006) [2023-12-27 19:44:12,160][106226] Updated weights for policy 0, policy_version 70496 (0.0006) [2023-12-27 19:44:12,268][106225] Updated weights for policy 1, policy_version 70552 (0.0009) [2023-12-27 19:44:12,335][106225] Updated weights for policy 1, policy_version 70562 (0.0008) [2023-12-27 19:44:12,409][106225] Updated weights for policy 1, policy_version 70572 (0.0008) [2023-12-27 19:44:12,820][106226] Updated weights for policy 0, policy_version 70506 (0.0006) [2023-12-27 19:44:12,879][106226] Updated weights for policy 0, policy_version 70516 (0.0009) [2023-12-27 19:44:12,938][106226] Updated weights for policy 0, policy_version 70526 (0.0008) [2023-12-27 19:44:12,997][106226] Updated weights for policy 0, policy_version 70536 (0.0009) [2023-12-27 19:44:13,088][106225] Updated weights for policy 1, policy_version 70582 (0.0008) [2023-12-27 19:44:13,139][106225] Updated weights for policy 1, policy_version 70592 (0.0008) [2023-12-27 19:44:13,198][106225] Updated weights for policy 1, policy_version 70602 (0.0008) [2023-12-27 19:44:13,727][106226] Updated weights for policy 0, policy_version 70546 (0.0008) [2023-12-27 19:44:13,778][106226] Updated weights for policy 0, policy_version 70556 (0.0009) [2023-12-27 19:44:13,826][106226] Updated weights for policy 0, policy_version 70566 (0.0008) [2023-12-27 19:44:13,917][106225] Updated weights for policy 1, policy_version 70612 (0.0008) [2023-12-27 19:44:13,972][106225] Updated weights for policy 1, policy_version 70622 (0.0008) [2023-12-27 19:44:14,023][106225] Updated weights for policy 1, policy_version 70632 (0.0008) [2023-12-27 19:44:14,576][106226] Updated weights for policy 0, policy_version 70576 (0.0009) [2023-12-27 19:44:14,641][106226] Updated weights for policy 0, policy_version 70586 (0.0009) [2023-12-27 19:44:14,706][106226] Updated weights for policy 0, policy_version 70596 (0.0009) [2023-12-27 19:44:14,721][106225] Updated weights for policy 1, policy_version 70642 (0.0008) [2023-12-27 19:44:14,791][106225] Updated weights for policy 1, policy_version 70652 (0.0007) [2023-12-27 19:44:14,858][106225] Updated weights for policy 1, policy_version 70662 (0.0011) [2023-12-27 19:44:14,924][106225] Updated weights for policy 1, policy_version 70672 (0.0010) [2023-12-27 19:44:15,514][106226] Updated weights for policy 0, policy_version 70606 (0.0008) [2023-12-27 19:44:15,516][106225] Updated weights for policy 1, policy_version 70682 (0.0005) [2023-12-27 19:44:15,563][106226] Updated weights for policy 0, policy_version 70616 (0.0008) [2023-12-27 19:44:15,566][106225] Updated weights for policy 1, policy_version 70692 (0.0005) [2023-12-27 19:44:15,613][106226] Updated weights for policy 0, policy_version 70626 (0.0008) [2023-12-27 19:44:15,619][106225] Updated weights for policy 1, policy_version 70702 (0.0005) [2023-12-27 19:44:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 36192256. Throughput: 0: 10013.4, 1: 9792.9. Samples: 36183948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:16,176][105115] Avg episode reward: [(0, '-5.904'), (1, '-6.500')] [2023-12-27 19:44:16,241][106225] Updated weights for policy 1, policy_version 70712 (0.0009) [2023-12-27 19:44:16,306][106225] Updated weights for policy 1, policy_version 70722 (0.0010) [2023-12-27 19:44:16,363][106225] Updated weights for policy 1, policy_version 70732 (0.0010) [2023-12-27 19:44:16,394][106226] Updated weights for policy 0, policy_version 70636 (0.0008) [2023-12-27 19:44:16,442][106226] Updated weights for policy 0, policy_version 70646 (0.0007) [2023-12-27 19:44:16,492][106226] Updated weights for policy 0, policy_version 70656 (0.0008) [2023-12-27 19:44:17,065][106225] Updated weights for policy 1, policy_version 70742 (0.0010) [2023-12-27 19:44:17,132][106225] Updated weights for policy 1, policy_version 70752 (0.0010) [2023-12-27 19:44:17,196][106225] Updated weights for policy 1, policy_version 70762 (0.0010) [2023-12-27 19:44:17,257][106226] Updated weights for policy 0, policy_version 70666 (0.0008) [2023-12-27 19:44:17,317][106226] Updated weights for policy 0, policy_version 70676 (0.0009) [2023-12-27 19:44:17,380][106226] Updated weights for policy 0, policy_version 70686 (0.0009) [2023-12-27 19:44:17,443][106226] Updated weights for policy 0, policy_version 70696 (0.0008) [2023-12-27 19:44:17,785][106225] Updated weights for policy 1, policy_version 70772 (0.0008) [2023-12-27 19:44:17,842][106225] Updated weights for policy 1, policy_version 70782 (0.0006) [2023-12-27 19:44:17,899][106225] Updated weights for policy 1, policy_version 70792 (0.0006) [2023-12-27 19:44:18,235][106226] Updated weights for policy 0, policy_version 70706 (0.0009) [2023-12-27 19:44:18,300][106226] Updated weights for policy 0, policy_version 70716 (0.0009) [2023-12-27 19:44:18,364][106226] Updated weights for policy 0, policy_version 70726 (0.0007) [2023-12-27 19:44:18,521][106225] Updated weights for policy 1, policy_version 70802 (0.0006) [2023-12-27 19:44:18,571][106225] Updated weights for policy 1, policy_version 70812 (0.0009) [2023-12-27 19:44:18,633][106225] Updated weights for policy 1, policy_version 70822 (0.0008) [2023-12-27 19:44:18,685][106225] Updated weights for policy 1, policy_version 70832 (0.0008) [2023-12-27 19:44:19,146][106226] Updated weights for policy 0, policy_version 70736 (0.0006) [2023-12-27 19:44:19,223][106226] Updated weights for policy 0, policy_version 70746 (0.0009) [2023-12-27 19:44:19,289][106226] Updated weights for policy 0, policy_version 70756 (0.0008) [2023-12-27 19:44:19,344][106225] Updated weights for policy 1, policy_version 70842 (0.0010) [2023-12-27 19:44:19,399][106225] Updated weights for policy 1, policy_version 70852 (0.0010) [2023-12-27 19:44:19,456][106225] Updated weights for policy 1, policy_version 70862 (0.0010) [2023-12-27 19:44:19,985][106226] Updated weights for policy 0, policy_version 70766 (0.0008) [2023-12-27 19:44:20,057][106226] Updated weights for policy 0, policy_version 70776 (0.0008) [2023-12-27 19:44:20,125][106226] Updated weights for policy 0, policy_version 70786 (0.0008) [2023-12-27 19:44:20,152][106225] Updated weights for policy 1, policy_version 70872 (0.0006) [2023-12-27 19:44:20,214][106225] Updated weights for policy 1, policy_version 70882 (0.0006) [2023-12-27 19:44:20,279][106225] Updated weights for policy 1, policy_version 70892 (0.0006) [2023-12-27 19:44:20,855][106226] Updated weights for policy 0, policy_version 70796 (0.0007) [2023-12-27 19:44:20,912][106226] Updated weights for policy 0, policy_version 70806 (0.0006) [2023-12-27 19:44:20,977][106226] Updated weights for policy 0, policy_version 70816 (0.0008) [2023-12-27 19:44:20,979][106225] Updated weights for policy 1, policy_version 70902 (0.0006) [2023-12-27 19:44:21,044][106225] Updated weights for policy 1, policy_version 70912 (0.0007) [2023-12-27 19:44:21,100][106225] Updated weights for policy 1, policy_version 70922 (0.0007) [2023-12-27 19:44:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 36298752. Throughput: 0: 9796.4, 1: 9808.9. Samples: 36301924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:21,175][105115] Avg episode reward: [(0, '-5.351'), (1, '-6.419')] [2023-12-27 19:44:21,695][106226] Updated weights for policy 0, policy_version 70826 (0.0012) [2023-12-27 19:44:21,754][106226] Updated weights for policy 0, policy_version 70836 (0.0008) [2023-12-27 19:44:21,812][106226] Updated weights for policy 0, policy_version 70846 (0.0009) [2023-12-27 19:44:21,876][106226] Updated weights for policy 0, policy_version 70856 (0.0009) [2023-12-27 19:44:21,894][106225] Updated weights for policy 1, policy_version 70932 (0.0008) [2023-12-27 19:44:21,960][106225] Updated weights for policy 1, policy_version 70942 (0.0008) [2023-12-27 19:44:22,025][106225] Updated weights for policy 1, policy_version 70952 (0.0008) [2023-12-27 19:44:22,647][106226] Updated weights for policy 0, policy_version 70866 (0.0011) [2023-12-27 19:44:22,711][106226] Updated weights for policy 0, policy_version 70876 (0.0011) [2023-12-27 19:44:22,738][106225] Updated weights for policy 1, policy_version 70962 (0.0008) [2023-12-27 19:44:22,779][106226] Updated weights for policy 0, policy_version 70886 (0.0011) [2023-12-27 19:44:22,798][106225] Updated weights for policy 1, policy_version 70972 (0.0010) [2023-12-27 19:44:22,863][106225] Updated weights for policy 1, policy_version 70982 (0.0010) [2023-12-27 19:44:22,921][106225] Updated weights for policy 1, policy_version 70992 (0.0011) [2023-12-27 19:44:23,434][106226] Updated weights for policy 0, policy_version 70896 (0.0009) [2023-12-27 19:44:23,500][106226] Updated weights for policy 0, policy_version 70906 (0.0011) [2023-12-27 19:44:23,560][106226] Updated weights for policy 0, policy_version 70916 (0.0010) [2023-12-27 19:44:23,584][106225] Updated weights for policy 1, policy_version 71002 (0.0008) [2023-12-27 19:44:23,646][106225] Updated weights for policy 1, policy_version 71012 (0.0007) [2023-12-27 19:44:23,694][106225] Updated weights for policy 1, policy_version 71022 (0.0008) [2023-12-27 19:44:24,246][106226] Updated weights for policy 0, policy_version 70926 (0.0010) [2023-12-27 19:44:24,300][106226] Updated weights for policy 0, policy_version 70936 (0.0010) [2023-12-27 19:44:24,350][106226] Updated weights for policy 0, policy_version 70946 (0.0010) [2023-12-27 19:44:24,404][106225] Updated weights for policy 1, policy_version 71032 (0.0007) [2023-12-27 19:44:24,455][106225] Updated weights for policy 1, policy_version 71042 (0.0009) [2023-12-27 19:44:24,510][106225] Updated weights for policy 1, policy_version 71052 (0.0009) [2023-12-27 19:44:24,971][106226] Updated weights for policy 0, policy_version 70956 (0.0011) [2023-12-27 19:44:25,018][106226] Updated weights for policy 0, policy_version 70966 (0.0010) [2023-12-27 19:44:25,065][106226] Updated weights for policy 0, policy_version 70976 (0.0010) [2023-12-27 19:44:25,254][106225] Updated weights for policy 1, policy_version 71062 (0.0007) [2023-12-27 19:44:25,314][106225] Updated weights for policy 1, policy_version 71072 (0.0006) [2023-12-27 19:44:25,370][106225] Updated weights for policy 1, policy_version 71082 (0.0005) [2023-12-27 19:44:25,791][106226] Updated weights for policy 0, policy_version 70986 (0.0009) [2023-12-27 19:44:25,843][106226] Updated weights for policy 0, policy_version 70996 (0.0007) [2023-12-27 19:44:25,899][106226] Updated weights for policy 0, policy_version 71006 (0.0010) [2023-12-27 19:44:25,955][106226] Updated weights for policy 0, policy_version 71016 (0.0010) [2023-12-27 19:44:25,970][106225] Updated weights for policy 1, policy_version 71092 (0.0007) [2023-12-27 19:44:26,019][106225] Updated weights for policy 1, policy_version 71102 (0.0009) [2023-12-27 19:44:26,080][106225] Updated weights for policy 1, policy_version 71112 (0.0008) [2023-12-27 19:44:26,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 36397056. Throughput: 0: 9766.2, 1: 9810.4. Samples: 36359236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:26,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-6.880')] [2023-12-27 19:44:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000071120_18210816.pth... [2023-12-27 19:44:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000071016_18186240.pth... [2023-12-27 19:44:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000069864_17891328.pth [2023-12-27 19:44:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000069936_17907712.pth [2023-12-27 19:44:26,584][106226] Updated weights for policy 0, policy_version 71026 (0.0010) [2023-12-27 19:44:26,633][106226] Updated weights for policy 0, policy_version 71036 (0.0010) [2023-12-27 19:44:26,682][106226] Updated weights for policy 0, policy_version 71046 (0.0010) [2023-12-27 19:44:26,780][106225] Updated weights for policy 1, policy_version 71122 (0.0010) [2023-12-27 19:44:26,829][106225] Updated weights for policy 1, policy_version 71132 (0.0010) [2023-12-27 19:44:26,875][106225] Updated weights for policy 1, policy_version 71142 (0.0010) [2023-12-27 19:44:26,916][106225] Updated weights for policy 1, policy_version 71152 (0.0010) [2023-12-27 19:44:27,375][106226] Updated weights for policy 0, policy_version 71056 (0.0008) [2023-12-27 19:44:27,430][106226] Updated weights for policy 0, policy_version 71066 (0.0006) [2023-12-27 19:44:27,480][106226] Updated weights for policy 0, policy_version 71076 (0.0005) [2023-12-27 19:44:27,663][106225] Updated weights for policy 1, policy_version 71162 (0.0011) [2023-12-27 19:44:27,723][106225] Updated weights for policy 1, policy_version 71172 (0.0010) [2023-12-27 19:44:27,769][106225] Updated weights for policy 1, policy_version 71182 (0.0010) [2023-12-27 19:44:28,138][106226] Updated weights for policy 0, policy_version 71086 (0.0009) [2023-12-27 19:44:28,200][106226] Updated weights for policy 0, policy_version 71096 (0.0010) [2023-12-27 19:44:28,255][106226] Updated weights for policy 0, policy_version 71106 (0.0010) [2023-12-27 19:44:28,488][106225] Updated weights for policy 1, policy_version 71192 (0.0010) [2023-12-27 19:44:28,545][106225] Updated weights for policy 1, policy_version 71202 (0.0010) [2023-12-27 19:44:28,602][106225] Updated weights for policy 1, policy_version 71212 (0.0010) [2023-12-27 19:44:28,938][106226] Updated weights for policy 0, policy_version 71116 (0.0009) [2023-12-27 19:44:28,997][106226] Updated weights for policy 0, policy_version 71126 (0.0005) [2023-12-27 19:44:29,062][106226] Updated weights for policy 0, policy_version 71136 (0.0005) [2023-12-27 19:44:29,357][106225] Updated weights for policy 1, policy_version 71222 (0.0010) [2023-12-27 19:44:29,420][106225] Updated weights for policy 1, policy_version 71232 (0.0010) [2023-12-27 19:44:29,474][106225] Updated weights for policy 1, policy_version 71242 (0.0010) [2023-12-27 19:44:29,753][106226] Updated weights for policy 0, policy_version 71146 (0.0006) [2023-12-27 19:44:29,812][106226] Updated weights for policy 0, policy_version 71156 (0.0008) [2023-12-27 19:44:29,887][106226] Updated weights for policy 0, policy_version 71166 (0.0009) [2023-12-27 19:44:29,954][106226] Updated weights for policy 0, policy_version 71176 (0.0008) [2023-12-27 19:44:30,221][106225] Updated weights for policy 1, policy_version 71252 (0.0010) [2023-12-27 19:44:30,271][106225] Updated weights for policy 1, policy_version 71262 (0.0010) [2023-12-27 19:44:30,316][106225] Updated weights for policy 1, policy_version 71272 (0.0006) [2023-12-27 19:44:30,641][106226] Updated weights for policy 0, policy_version 71186 (0.0005) [2023-12-27 19:44:30,695][106226] Updated weights for policy 0, policy_version 71196 (0.0009) [2023-12-27 19:44:30,754][106226] Updated weights for policy 0, policy_version 71206 (0.0010) [2023-12-27 19:44:30,994][106225] Updated weights for policy 1, policy_version 71282 (0.0007) [2023-12-27 19:44:31,054][106225] Updated weights for policy 1, policy_version 71292 (0.0007) [2023-12-27 19:44:31,109][106225] Updated weights for policy 1, policy_version 71302 (0.0007) [2023-12-27 19:44:31,173][106225] Updated weights for policy 1, policy_version 71312 (0.0007) [2023-12-27 19:44:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 36495360. Throughput: 0: 9901.4, 1: 9867.6. Samples: 36480284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:31,175][105115] Avg episode reward: [(0, '-5.647'), (1, '-6.279')] [2023-12-27 19:44:31,475][106226] Updated weights for policy 0, policy_version 71216 (0.0010) [2023-12-27 19:44:31,530][106226] Updated weights for policy 0, policy_version 71226 (0.0010) [2023-12-27 19:44:31,590][106226] Updated weights for policy 0, policy_version 71236 (0.0010) [2023-12-27 19:44:31,894][106225] Updated weights for policy 1, policy_version 71322 (0.0007) [2023-12-27 19:44:31,950][106225] Updated weights for policy 1, policy_version 71332 (0.0009) [2023-12-27 19:44:31,997][106225] Updated weights for policy 1, policy_version 71342 (0.0008) [2023-12-27 19:44:32,313][106226] Updated weights for policy 0, policy_version 71246 (0.0009) [2023-12-27 19:44:32,378][106226] Updated weights for policy 0, policy_version 71256 (0.0008) [2023-12-27 19:44:32,439][106226] Updated weights for policy 0, policy_version 71266 (0.0007) [2023-12-27 19:44:32,724][106225] Updated weights for policy 1, policy_version 71352 (0.0007) [2023-12-27 19:44:32,780][106225] Updated weights for policy 1, policy_version 71362 (0.0006) [2023-12-27 19:44:32,835][106225] Updated weights for policy 1, policy_version 71372 (0.0009) [2023-12-27 19:44:33,169][106226] Updated weights for policy 0, policy_version 71276 (0.0008) [2023-12-27 19:44:33,228][106226] Updated weights for policy 0, policy_version 71286 (0.0009) [2023-12-27 19:44:33,281][106226] Updated weights for policy 0, policy_version 71296 (0.0008) [2023-12-27 19:44:33,524][106225] Updated weights for policy 1, policy_version 71382 (0.0008) [2023-12-27 19:44:33,575][106225] Updated weights for policy 1, policy_version 71392 (0.0008) [2023-12-27 19:44:33,619][106225] Updated weights for policy 1, policy_version 71402 (0.0008) [2023-12-27 19:44:34,004][106226] Updated weights for policy 0, policy_version 71306 (0.0009) [2023-12-27 19:44:34,061][106226] Updated weights for policy 0, policy_version 71317 (0.0008) [2023-12-27 19:44:34,109][106226] Updated weights for policy 0, policy_version 71327 (0.0009) [2023-12-27 19:44:34,295][106225] Updated weights for policy 1, policy_version 71412 (0.0009) [2023-12-27 19:44:34,356][106225] Updated weights for policy 1, policy_version 71422 (0.0008) [2023-12-27 19:44:34,420][106225] Updated weights for policy 1, policy_version 71432 (0.0009) [2023-12-27 19:44:34,888][106226] Updated weights for policy 0, policy_version 71337 (0.0008) [2023-12-27 19:44:34,947][106226] Updated weights for policy 0, policy_version 71347 (0.0008) [2023-12-27 19:44:35,008][106226] Updated weights for policy 0, policy_version 71357 (0.0009) [2023-12-27 19:44:35,063][106225] Updated weights for policy 1, policy_version 71442 (0.0006) [2023-12-27 19:44:35,072][106226] Updated weights for policy 0, policy_version 71367 (0.0008) [2023-12-27 19:44:35,113][106225] Updated weights for policy 1, policy_version 71452 (0.0007) [2023-12-27 19:44:35,160][106225] Updated weights for policy 1, policy_version 71462 (0.0008) [2023-12-27 19:44:35,214][106225] Updated weights for policy 1, policy_version 71472 (0.0008) [2023-12-27 19:44:35,650][106226] Updated weights for policy 0, policy_version 71377 (0.0005) [2023-12-27 19:44:35,708][106226] Updated weights for policy 0, policy_version 71387 (0.0005) [2023-12-27 19:44:35,768][106226] Updated weights for policy 0, policy_version 71397 (0.0006) [2023-12-27 19:44:36,060][106225] Updated weights for policy 1, policy_version 71482 (0.0006) [2023-12-27 19:44:36,124][106225] Updated weights for policy 1, policy_version 71492 (0.0006) [2023-12-27 19:44:36,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 36585472. Throughput: 0: 9903.2, 1: 9839.0. Samples: 36599264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:36,175][105115] Avg episode reward: [(0, '-5.244'), (1, '-6.827')] [2023-12-27 19:44:36,184][106225] Updated weights for policy 1, policy_version 71502 (0.0007) [2023-12-27 19:44:36,442][106226] Updated weights for policy 0, policy_version 71407 (0.0010) [2023-12-27 19:44:36,494][106226] Updated weights for policy 0, policy_version 71417 (0.0010) [2023-12-27 19:44:36,556][106226] Updated weights for policy 0, policy_version 71427 (0.0011) [2023-12-27 19:44:36,866][106225] Updated weights for policy 1, policy_version 71512 (0.0008) [2023-12-27 19:44:36,923][106225] Updated weights for policy 1, policy_version 71522 (0.0008) [2023-12-27 19:44:36,974][106225] Updated weights for policy 1, policy_version 71532 (0.0006) [2023-12-27 19:44:37,290][106226] Updated weights for policy 0, policy_version 71437 (0.0011) [2023-12-27 19:44:37,346][106226] Updated weights for policy 0, policy_version 71447 (0.0010) [2023-12-27 19:44:37,406][106226] Updated weights for policy 0, policy_version 71457 (0.0010) [2023-12-27 19:44:37,679][106225] Updated weights for policy 1, policy_version 71542 (0.0006) [2023-12-27 19:44:37,745][106225] Updated weights for policy 1, policy_version 71552 (0.0007) [2023-12-27 19:44:37,806][106225] Updated weights for policy 1, policy_version 71562 (0.0009) [2023-12-27 19:44:38,051][106226] Updated weights for policy 0, policy_version 71467 (0.0009) [2023-12-27 19:44:38,109][106226] Updated weights for policy 0, policy_version 71477 (0.0005) [2023-12-27 19:44:38,164][106226] Updated weights for policy 0, policy_version 71487 (0.0006) [2023-12-27 19:44:38,520][106225] Updated weights for policy 1, policy_version 71572 (0.0010) [2023-12-27 19:44:38,582][106225] Updated weights for policy 1, policy_version 71582 (0.0008) [2023-12-27 19:44:38,643][106225] Updated weights for policy 1, policy_version 71592 (0.0008) [2023-12-27 19:44:38,810][106226] Updated weights for policy 0, policy_version 71497 (0.0008) [2023-12-27 19:44:38,881][106226] Updated weights for policy 0, policy_version 71507 (0.0011) [2023-12-27 19:44:38,938][106226] Updated weights for policy 0, policy_version 71517 (0.0011) [2023-12-27 19:44:38,989][106226] Updated weights for policy 0, policy_version 71527 (0.0008) [2023-12-27 19:44:39,353][106225] Updated weights for policy 1, policy_version 71602 (0.0007) [2023-12-27 19:44:39,424][106225] Updated weights for policy 1, policy_version 71612 (0.0009) [2023-12-27 19:44:39,487][106225] Updated weights for policy 1, policy_version 71622 (0.0007) [2023-12-27 19:44:39,555][106225] Updated weights for policy 1, policy_version 71632 (0.0007) [2023-12-27 19:44:39,733][106226] Updated weights for policy 0, policy_version 71537 (0.0007) [2023-12-27 19:44:39,798][106226] Updated weights for policy 0, policy_version 71547 (0.0006) [2023-12-27 19:44:39,873][106226] Updated weights for policy 0, policy_version 71557 (0.0008) [2023-12-27 19:44:40,300][106225] Updated weights for policy 1, policy_version 71642 (0.0008) [2023-12-27 19:44:40,370][106225] Updated weights for policy 1, policy_version 71652 (0.0008) [2023-12-27 19:44:40,432][106225] Updated weights for policy 1, policy_version 71662 (0.0008) [2023-12-27 19:44:40,496][106226] Updated weights for policy 0, policy_version 71567 (0.0009) [2023-12-27 19:44:40,547][106226] Updated weights for policy 0, policy_version 71577 (0.0008) [2023-12-27 19:44:40,608][106226] Updated weights for policy 0, policy_version 71587 (0.0011) [2023-12-27 19:44:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 36683776. Throughput: 0: 9874.1, 1: 9854.7. Samples: 36657988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:44:41,175][105115] Avg episode reward: [(0, '-5.522'), (1, '-6.605')] [2023-12-27 19:44:41,181][106225] Updated weights for policy 1, policy_version 71672 (0.0008) [2023-12-27 19:44:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000071592_18333696.pth... [2023-12-27 19:44:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000070472_18046976.pth [2023-12-27 19:44:41,249][106225] Updated weights for policy 1, policy_version 71682 (0.0007) [2023-12-27 19:44:41,311][106225] Updated weights for policy 1, policy_version 71692 (0.0010) [2023-12-27 19:44:41,322][106226] Updated weights for policy 0, policy_version 71597 (0.0010) [2023-12-27 19:44:41,334][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000071696_18358272.pth... [2023-12-27 19:44:41,343][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000070512_18055168.pth [2023-12-27 19:44:41,393][106226] Updated weights for policy 0, policy_version 71607 (0.0012) [2023-12-27 19:44:41,455][106226] Updated weights for policy 0, policy_version 71617 (0.0009) [2023-12-27 19:44:42,093][106225] Updated weights for policy 1, policy_version 71702 (0.0009) [2023-12-27 19:44:42,152][106225] Updated weights for policy 1, policy_version 71712 (0.0008) [2023-12-27 19:44:42,205][106225] Updated weights for policy 1, policy_version 71722 (0.0007) [2023-12-27 19:44:42,229][106226] Updated weights for policy 0, policy_version 71627 (0.0011) [2023-12-27 19:44:42,301][106226] Updated weights for policy 0, policy_version 71637 (0.0011) [2023-12-27 19:44:42,366][106226] Updated weights for policy 0, policy_version 71647 (0.0013) [2023-12-27 19:44:42,973][106225] Updated weights for policy 1, policy_version 71732 (0.0009) [2023-12-27 19:44:42,984][106226] Updated weights for policy 0, policy_version 71657 (0.0012) [2023-12-27 19:44:43,028][106225] Updated weights for policy 1, policy_version 71742 (0.0006) [2023-12-27 19:44:43,048][106226] Updated weights for policy 0, policy_version 71667 (0.0006) [2023-12-27 19:44:43,081][106225] Updated weights for policy 1, policy_version 71752 (0.0008) [2023-12-27 19:44:43,100][106226] Updated weights for policy 0, policy_version 71677 (0.0005) [2023-12-27 19:44:43,146][106226] Updated weights for policy 0, policy_version 71687 (0.0005) [2023-12-27 19:44:43,714][106226] Updated weights for policy 0, policy_version 71697 (0.0005) [2023-12-27 19:44:43,769][106226] Updated weights for policy 0, policy_version 71707 (0.0005) [2023-12-27 19:44:43,821][106226] Updated weights for policy 0, policy_version 71717 (0.0005) [2023-12-27 19:44:43,898][106225] Updated weights for policy 1, policy_version 71762 (0.0008) [2023-12-27 19:44:43,959][106225] Updated weights for policy 1, policy_version 71772 (0.0008) [2023-12-27 19:44:44,025][106225] Updated weights for policy 1, policy_version 71782 (0.0010) [2023-12-27 19:44:44,074][106225] Updated weights for policy 1, policy_version 71792 (0.0008) [2023-12-27 19:44:44,379][106226] Updated weights for policy 0, policy_version 71727 (0.0009) [2023-12-27 19:44:44,439][106226] Updated weights for policy 0, policy_version 71737 (0.0010) [2023-12-27 19:44:44,496][106226] Updated weights for policy 0, policy_version 71747 (0.0011) [2023-12-27 19:44:44,824][106225] Updated weights for policy 1, policy_version 71802 (0.0007) [2023-12-27 19:44:44,887][106225] Updated weights for policy 1, policy_version 71812 (0.0008) [2023-12-27 19:44:44,949][106225] Updated weights for policy 1, policy_version 71822 (0.0008) [2023-12-27 19:44:45,200][106226] Updated weights for policy 0, policy_version 71757 (0.0010) [2023-12-27 19:44:45,265][106226] Updated weights for policy 0, policy_version 71767 (0.0009) [2023-12-27 19:44:45,332][106226] Updated weights for policy 0, policy_version 71777 (0.0009) [2023-12-27 19:44:45,616][106225] Updated weights for policy 1, policy_version 71832 (0.0008) [2023-12-27 19:44:45,677][106225] Updated weights for policy 1, policy_version 71842 (0.0009) [2023-12-27 19:44:45,745][106225] Updated weights for policy 1, policy_version 71852 (0.0007) [2023-12-27 19:44:46,019][106226] Updated weights for policy 0, policy_version 71787 (0.0008) [2023-12-27 19:44:46,069][106226] Updated weights for policy 0, policy_version 71797 (0.0009) [2023-12-27 19:44:46,132][106226] Updated weights for policy 0, policy_version 71807 (0.0009) [2023-12-27 19:44:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 36782080. Throughput: 0: 9944.2, 1: 9807.2. Samples: 36775528. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:44:46,175][105115] Avg episode reward: [(0, '-5.676'), (1, '-6.455')] [2023-12-27 19:44:46,488][106225] Updated weights for policy 1, policy_version 71862 (0.0008) [2023-12-27 19:44:46,553][106225] Updated weights for policy 1, policy_version 71872 (0.0009) [2023-12-27 19:44:46,613][106225] Updated weights for policy 1, policy_version 71882 (0.0008) [2023-12-27 19:44:46,736][106226] Updated weights for policy 0, policy_version 71817 (0.0008) [2023-12-27 19:44:46,789][106226] Updated weights for policy 0, policy_version 71827 (0.0005) [2023-12-27 19:44:46,840][106226] Updated weights for policy 0, policy_version 71837 (0.0008) [2023-12-27 19:44:46,903][106226] Updated weights for policy 0, policy_version 71847 (0.0009) [2023-12-27 19:44:47,351][106225] Updated weights for policy 1, policy_version 71892 (0.0009) [2023-12-27 19:44:47,421][106225] Updated weights for policy 1, policy_version 71902 (0.0010) [2023-12-27 19:44:47,482][106225] Updated weights for policy 1, policy_version 71912 (0.0008) [2023-12-27 19:44:47,575][106226] Updated weights for policy 0, policy_version 71857 (0.0008) [2023-12-27 19:44:47,638][106226] Updated weights for policy 0, policy_version 71867 (0.0008) [2023-12-27 19:44:47,697][106226] Updated weights for policy 0, policy_version 71877 (0.0008) [2023-12-27 19:44:48,194][106225] Updated weights for policy 1, policy_version 71922 (0.0008) [2023-12-27 19:44:48,257][106225] Updated weights for policy 1, policy_version 71932 (0.0011) [2023-12-27 19:44:48,322][106225] Updated weights for policy 1, policy_version 71942 (0.0010) [2023-12-27 19:44:48,376][106226] Updated weights for policy 0, policy_version 71887 (0.0008) [2023-12-27 19:44:48,399][106225] Updated weights for policy 1, policy_version 71952 (0.0010) [2023-12-27 19:44:48,441][106226] Updated weights for policy 0, policy_version 71897 (0.0008) [2023-12-27 19:44:48,507][106226] Updated weights for policy 0, policy_version 71907 (0.0008) [2023-12-27 19:44:49,111][106225] Updated weights for policy 1, policy_version 71962 (0.0010) [2023-12-27 19:44:49,165][106225] Updated weights for policy 1, policy_version 71972 (0.0010) [2023-12-27 19:44:49,236][106225] Updated weights for policy 1, policy_version 71982 (0.0010) [2023-12-27 19:44:49,256][106226] Updated weights for policy 0, policy_version 71917 (0.0008) [2023-12-27 19:44:49,310][106226] Updated weights for policy 0, policy_version 71927 (0.0006) [2023-12-27 19:44:49,378][106226] Updated weights for policy 0, policy_version 71937 (0.0008) [2023-12-27 19:44:49,957][106225] Updated weights for policy 1, policy_version 71992 (0.0011) [2023-12-27 19:44:50,011][106225] Updated weights for policy 1, policy_version 72002 (0.0010) [2023-12-27 19:44:50,068][106225] Updated weights for policy 1, policy_version 72012 (0.0010) [2023-12-27 19:44:50,104][106226] Updated weights for policy 0, policy_version 71947 (0.0007) [2023-12-27 19:44:50,154][106226] Updated weights for policy 0, policy_version 71957 (0.0008) [2023-12-27 19:44:50,212][106226] Updated weights for policy 0, policy_version 71967 (0.0008) [2023-12-27 19:44:50,801][106225] Updated weights for policy 1, policy_version 72022 (0.0010) [2023-12-27 19:44:50,867][106225] Updated weights for policy 1, policy_version 72032 (0.0010) [2023-12-27 19:44:50,889][106226] Updated weights for policy 0, policy_version 71977 (0.0008) [2023-12-27 19:44:50,926][106225] Updated weights for policy 1, policy_version 72042 (0.0011) [2023-12-27 19:44:50,944][106226] Updated weights for policy 0, policy_version 71987 (0.0006) [2023-12-27 19:44:50,990][106226] Updated weights for policy 0, policy_version 71997 (0.0008) [2023-12-27 19:44:51,064][106226] Updated weights for policy 0, policy_version 72008 (0.0008) [2023-12-27 19:44:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 36888576. Throughput: 0: 9835.5, 1: 9791.0. Samples: 36892900. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:44:51,175][105115] Avg episode reward: [(0, '-5.339'), (1, '-6.339')] [2023-12-27 19:44:51,680][106225] Updated weights for policy 1, policy_version 72052 (0.0009) [2023-12-27 19:44:51,748][106225] Updated weights for policy 1, policy_version 72062 (0.0008) [2023-12-27 19:44:51,812][106225] Updated weights for policy 1, policy_version 72072 (0.0011) [2023-12-27 19:44:51,926][106226] Updated weights for policy 0, policy_version 72018 (0.0007) [2023-12-27 19:44:51,992][106226] Updated weights for policy 0, policy_version 72028 (0.0008) [2023-12-27 19:44:52,056][106226] Updated weights for policy 0, policy_version 72038 (0.0008) [2023-12-27 19:44:52,553][106225] Updated weights for policy 1, policy_version 72082 (0.0010) [2023-12-27 19:44:52,604][106225] Updated weights for policy 1, policy_version 72092 (0.0010) [2023-12-27 19:44:52,673][106225] Updated weights for policy 1, policy_version 72102 (0.0008) [2023-12-27 19:44:52,717][106226] Updated weights for policy 0, policy_version 72048 (0.0011) [2023-12-27 19:44:52,740][106225] Updated weights for policy 1, policy_version 72112 (0.0007) [2023-12-27 19:44:52,803][106226] Updated weights for policy 0, policy_version 72058 (0.0011) [2023-12-27 19:44:52,874][106226] Updated weights for policy 0, policy_version 72068 (0.0011) [2023-12-27 19:44:53,379][106225] Updated weights for policy 1, policy_version 72122 (0.0005) [2023-12-27 19:44:53,427][106225] Updated weights for policy 1, policy_version 72132 (0.0005) [2023-12-27 19:44:53,449][106226] Updated weights for policy 0, policy_version 72078 (0.0011) [2023-12-27 19:44:53,475][106225] Updated weights for policy 1, policy_version 72142 (0.0005) [2023-12-27 19:44:53,496][106226] Updated weights for policy 0, policy_version 72088 (0.0010) [2023-12-27 19:44:53,550][106226] Updated weights for policy 0, policy_version 72098 (0.0011) [2023-12-27 19:44:54,042][106225] Updated weights for policy 1, policy_version 72152 (0.0007) [2023-12-27 19:44:54,094][106225] Updated weights for policy 1, policy_version 72162 (0.0008) [2023-12-27 19:44:54,146][106225] Updated weights for policy 1, policy_version 72172 (0.0008) [2023-12-27 19:44:54,256][106226] Updated weights for policy 0, policy_version 72108 (0.0008) [2023-12-27 19:44:54,306][106226] Updated weights for policy 0, policy_version 72118 (0.0007) [2023-12-27 19:44:54,354][106226] Updated weights for policy 0, policy_version 72128 (0.0008) [2023-12-27 19:44:54,909][106225] Updated weights for policy 1, policy_version 72182 (0.0010) [2023-12-27 19:44:54,970][106225] Updated weights for policy 1, policy_version 72192 (0.0010) [2023-12-27 19:44:54,972][106226] Updated weights for policy 0, policy_version 72138 (0.0008) [2023-12-27 19:44:55,033][106226] Updated weights for policy 0, policy_version 72148 (0.0007) [2023-12-27 19:44:55,042][106225] Updated weights for policy 1, policy_version 72202 (0.0010) [2023-12-27 19:44:55,084][106226] Updated weights for policy 0, policy_version 72158 (0.0006) [2023-12-27 19:44:55,140][106226] Updated weights for policy 0, policy_version 72168 (0.0008) [2023-12-27 19:44:55,605][106225] Updated weights for policy 1, policy_version 72212 (0.0009) [2023-12-27 19:44:55,663][106225] Updated weights for policy 1, policy_version 72222 (0.0008) [2023-12-27 19:44:55,712][106225] Updated weights for policy 1, policy_version 72232 (0.0007) [2023-12-27 19:44:55,858][106226] Updated weights for policy 0, policy_version 72178 (0.0010) [2023-12-27 19:44:55,911][106226] Updated weights for policy 0, policy_version 72188 (0.0010) [2023-12-27 19:44:55,974][106226] Updated weights for policy 0, policy_version 72198 (0.0010) [2023-12-27 19:44:56,175][105115] Fps is (10 sec: 20479.0, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 36986880. Throughput: 0: 9822.5, 1: 9787.5. Samples: 36951988. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:44:56,176][105115] Avg episode reward: [(0, '-5.095'), (1, '-6.855')] [2023-12-27 19:44:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000072200_18489344.pth... [2023-12-27 19:44:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000072240_18497536.pth... [2023-12-27 19:44:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000071016_18186240.pth [2023-12-27 19:44:56,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000071120_18210816.pth [2023-12-27 19:44:56,438][106225] Updated weights for policy 1, policy_version 72242 (0.0008) [2023-12-27 19:44:56,501][106225] Updated weights for policy 1, policy_version 72252 (0.0007) [2023-12-27 19:44:56,567][106225] Updated weights for policy 1, policy_version 72262 (0.0010) [2023-12-27 19:44:56,588][106226] Updated weights for policy 0, policy_version 72208 (0.0007) [2023-12-27 19:44:56,623][106225] Updated weights for policy 1, policy_version 72272 (0.0010) [2023-12-27 19:44:56,648][106226] Updated weights for policy 0, policy_version 72218 (0.0008) [2023-12-27 19:44:56,705][106226] Updated weights for policy 0, policy_version 72228 (0.0010) [2023-12-27 19:44:57,292][106225] Updated weights for policy 1, policy_version 72282 (0.0009) [2023-12-27 19:44:57,341][106226] Updated weights for policy 0, policy_version 72238 (0.0010) [2023-12-27 19:44:57,343][106225] Updated weights for policy 1, policy_version 72292 (0.0007) [2023-12-27 19:44:57,390][106226] Updated weights for policy 0, policy_version 72248 (0.0010) [2023-12-27 19:44:57,391][106225] Updated weights for policy 1, policy_version 72302 (0.0005) [2023-12-27 19:44:57,439][106226] Updated weights for policy 0, policy_version 72258 (0.0008) [2023-12-27 19:44:58,043][106225] Updated weights for policy 1, policy_version 72312 (0.0006) [2023-12-27 19:44:58,097][106225] Updated weights for policy 1, policy_version 72322 (0.0006) [2023-12-27 19:44:58,101][106226] Updated weights for policy 0, policy_version 72268 (0.0007) [2023-12-27 19:44:58,148][106225] Updated weights for policy 1, policy_version 72332 (0.0006) [2023-12-27 19:44:58,150][106226] Updated weights for policy 0, policy_version 72278 (0.0008) [2023-12-27 19:44:58,196][106226] Updated weights for policy 0, policy_version 72288 (0.0008) [2023-12-27 19:44:58,917][106225] Updated weights for policy 1, policy_version 72342 (0.0008) [2023-12-27 19:44:58,979][106225] Updated weights for policy 1, policy_version 72352 (0.0010) [2023-12-27 19:44:59,040][106225] Updated weights for policy 1, policy_version 72362 (0.0008) [2023-12-27 19:44:59,042][106226] Updated weights for policy 0, policy_version 72298 (0.0007) [2023-12-27 19:44:59,107][106226] Updated weights for policy 0, policy_version 72308 (0.0007) [2023-12-27 19:44:59,177][106226] Updated weights for policy 0, policy_version 72318 (0.0010) [2023-12-27 19:44:59,249][106226] Updated weights for policy 0, policy_version 72328 (0.0013) [2023-12-27 19:44:59,849][106225] Updated weights for policy 1, policy_version 72372 (0.0008) [2023-12-27 19:44:59,912][106225] Updated weights for policy 1, policy_version 72382 (0.0009) [2023-12-27 19:44:59,978][106225] Updated weights for policy 1, policy_version 72392 (0.0009) [2023-12-27 19:45:00,042][106226] Updated weights for policy 0, policy_version 72338 (0.0010) [2023-12-27 19:45:00,104][106226] Updated weights for policy 0, policy_version 72348 (0.0007) [2023-12-27 19:45:00,151][106226] Updated weights for policy 0, policy_version 72358 (0.0007) [2023-12-27 19:45:00,702][106225] Updated weights for policy 1, policy_version 72402 (0.0010) [2023-12-27 19:45:00,751][106225] Updated weights for policy 1, policy_version 72412 (0.0010) [2023-12-27 19:45:00,807][106225] Updated weights for policy 1, policy_version 72422 (0.0010) [2023-12-27 19:45:00,870][106225] Updated weights for policy 1, policy_version 72432 (0.0010) [2023-12-27 19:45:00,895][106226] Updated weights for policy 0, policy_version 72368 (0.0006) [2023-12-27 19:45:00,942][106226] Updated weights for policy 0, policy_version 72378 (0.0005) [2023-12-27 19:45:00,992][106226] Updated weights for policy 0, policy_version 72388 (0.0005) [2023-12-27 19:45:01,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 37085184. Throughput: 0: 9932.0, 1: 9797.8. Samples: 37071784. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:01,175][105115] Avg episode reward: [(0, '-5.554'), (1, '-6.591')] [2023-12-27 19:45:01,632][106225] Updated weights for policy 1, policy_version 72442 (0.0007) [2023-12-27 19:45:01,691][106225] Updated weights for policy 1, policy_version 72452 (0.0007) [2023-12-27 19:45:01,744][106226] Updated weights for policy 0, policy_version 72398 (0.0008) [2023-12-27 19:45:01,755][106225] Updated weights for policy 1, policy_version 72462 (0.0009) [2023-12-27 19:45:01,811][106226] Updated weights for policy 0, policy_version 72408 (0.0006) [2023-12-27 19:45:01,892][106226] Updated weights for policy 0, policy_version 72418 (0.0010) [2023-12-27 19:45:02,461][106225] Updated weights for policy 1, policy_version 72472 (0.0009) [2023-12-27 19:45:02,502][106226] Updated weights for policy 0, policy_version 72428 (0.0007) [2023-12-27 19:45:02,524][106225] Updated weights for policy 1, policy_version 72482 (0.0007) [2023-12-27 19:45:02,564][106226] Updated weights for policy 0, policy_version 72438 (0.0007) [2023-12-27 19:45:02,588][106225] Updated weights for policy 1, policy_version 72492 (0.0007) [2023-12-27 19:45:02,613][106226] Updated weights for policy 0, policy_version 72448 (0.0006) [2023-12-27 19:45:03,292][106225] Updated weights for policy 1, policy_version 72502 (0.0008) [2023-12-27 19:45:03,311][106226] Updated weights for policy 0, policy_version 72458 (0.0008) [2023-12-27 19:45:03,341][106225] Updated weights for policy 1, policy_version 72512 (0.0006) [2023-12-27 19:45:03,359][106226] Updated weights for policy 0, policy_version 72468 (0.0005) [2023-12-27 19:45:03,389][106225] Updated weights for policy 1, policy_version 72522 (0.0008) [2023-12-27 19:45:03,407][106226] Updated weights for policy 0, policy_version 72478 (0.0005) [2023-12-27 19:45:03,452][106226] Updated weights for policy 0, policy_version 72488 (0.0005) [2023-12-27 19:45:04,027][106226] Updated weights for policy 0, policy_version 72498 (0.0007) [2023-12-27 19:45:04,091][106226] Updated weights for policy 0, policy_version 72508 (0.0010) [2023-12-27 19:45:04,136][106225] Updated weights for policy 1, policy_version 72532 (0.0009) [2023-12-27 19:45:04,157][106226] Updated weights for policy 0, policy_version 72518 (0.0011) [2023-12-27 19:45:04,201][106225] Updated weights for policy 1, policy_version 72542 (0.0008) [2023-12-27 19:45:04,262][106225] Updated weights for policy 1, policy_version 72552 (0.0008) [2023-12-27 19:45:04,789][106226] Updated weights for policy 0, policy_version 72528 (0.0009) [2023-12-27 19:45:04,838][106226] Updated weights for policy 0, policy_version 72538 (0.0008) [2023-12-27 19:45:04,888][106226] Updated weights for policy 0, policy_version 72548 (0.0010) [2023-12-27 19:45:04,957][106225] Updated weights for policy 1, policy_version 72562 (0.0008) [2023-12-27 19:45:05,016][106225] Updated weights for policy 1, policy_version 72572 (0.0007) [2023-12-27 19:45:05,074][106225] Updated weights for policy 1, policy_version 72582 (0.0010) [2023-12-27 19:45:05,130][106225] Updated weights for policy 1, policy_version 72592 (0.0010) [2023-12-27 19:45:05,540][106226] Updated weights for policy 0, policy_version 72558 (0.0007) [2023-12-27 19:45:05,592][106226] Updated weights for policy 0, policy_version 72568 (0.0005) [2023-12-27 19:45:05,652][106226] Updated weights for policy 0, policy_version 72578 (0.0005) [2023-12-27 19:45:05,730][106225] Updated weights for policy 1, policy_version 72602 (0.0005) [2023-12-27 19:45:05,781][106225] Updated weights for policy 1, policy_version 72612 (0.0005) [2023-12-27 19:45:05,841][106225] Updated weights for policy 1, policy_version 72622 (0.0005) [2023-12-27 19:45:06,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 37183488. Throughput: 0: 10109.3, 1: 9692.0. Samples: 37192984. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:06,175][105115] Avg episode reward: [(0, '-5.080'), (1, '-6.502')] [2023-12-27 19:45:06,300][106226] Updated weights for policy 0, policy_version 72588 (0.0008) [2023-12-27 19:45:06,366][106226] Updated weights for policy 0, policy_version 72598 (0.0009) [2023-12-27 19:45:06,427][106226] Updated weights for policy 0, policy_version 72608 (0.0011) [2023-12-27 19:45:06,528][106225] Updated weights for policy 1, policy_version 72632 (0.0007) [2023-12-27 19:45:06,597][106225] Updated weights for policy 1, policy_version 72642 (0.0008) [2023-12-27 19:45:06,663][106225] Updated weights for policy 1, policy_version 72652 (0.0008) [2023-12-27 19:45:07,108][106226] Updated weights for policy 0, policy_version 72618 (0.0011) [2023-12-27 19:45:07,161][106226] Updated weights for policy 0, policy_version 72628 (0.0010) [2023-12-27 19:45:07,226][106226] Updated weights for policy 0, policy_version 72638 (0.0010) [2023-12-27 19:45:07,289][106226] Updated weights for policy 0, policy_version 72648 (0.0009) [2023-12-27 19:45:07,360][106225] Updated weights for policy 1, policy_version 72662 (0.0006) [2023-12-27 19:45:07,420][106225] Updated weights for policy 1, policy_version 72672 (0.0008) [2023-12-27 19:45:07,479][106225] Updated weights for policy 1, policy_version 72682 (0.0009) [2023-12-27 19:45:07,948][106226] Updated weights for policy 0, policy_version 72658 (0.0007) [2023-12-27 19:45:07,997][106226] Updated weights for policy 0, policy_version 72668 (0.0006) [2023-12-27 19:45:08,060][106226] Updated weights for policy 0, policy_version 72678 (0.0009) [2023-12-27 19:45:08,171][106225] Updated weights for policy 1, policy_version 72692 (0.0008) [2023-12-27 19:45:08,235][106225] Updated weights for policy 1, policy_version 72702 (0.0008) [2023-12-27 19:45:08,303][106225] Updated weights for policy 1, policy_version 72712 (0.0007) [2023-12-27 19:45:08,773][106226] Updated weights for policy 0, policy_version 72688 (0.0010) [2023-12-27 19:45:08,843][106226] Updated weights for policy 0, policy_version 72698 (0.0010) [2023-12-27 19:45:08,872][106225] Updated weights for policy 1, policy_version 72722 (0.0008) [2023-12-27 19:45:08,890][106226] Updated weights for policy 0, policy_version 72708 (0.0009) [2023-12-27 19:45:08,930][106225] Updated weights for policy 1, policy_version 72732 (0.0007) [2023-12-27 19:45:08,982][106225] Updated weights for policy 1, policy_version 72742 (0.0008) [2023-12-27 19:45:09,037][106225] Updated weights for policy 1, policy_version 72752 (0.0008) [2023-12-27 19:45:09,517][106226] Updated weights for policy 0, policy_version 72718 (0.0007) [2023-12-27 19:45:09,578][106226] Updated weights for policy 0, policy_version 72728 (0.0009) [2023-12-27 19:45:09,639][106226] Updated weights for policy 0, policy_version 72738 (0.0007) [2023-12-27 19:45:09,867][106225] Updated weights for policy 1, policy_version 72762 (0.0009) [2023-12-27 19:45:09,931][106225] Updated weights for policy 1, policy_version 72772 (0.0008) [2023-12-27 19:45:09,999][106225] Updated weights for policy 1, policy_version 72782 (0.0009) [2023-12-27 19:45:10,364][106226] Updated weights for policy 0, policy_version 72748 (0.0009) [2023-12-27 19:45:10,429][106226] Updated weights for policy 0, policy_version 72758 (0.0011) [2023-12-27 19:45:10,491][106226] Updated weights for policy 0, policy_version 72768 (0.0011) [2023-12-27 19:45:10,795][106225] Updated weights for policy 1, policy_version 72792 (0.0008) [2023-12-27 19:45:10,852][106225] Updated weights for policy 1, policy_version 72802 (0.0008) [2023-12-27 19:45:10,913][106225] Updated weights for policy 1, policy_version 72812 (0.0008) [2023-12-27 19:45:11,163][106226] Updated weights for policy 0, policy_version 72778 (0.0010) [2023-12-27 19:45:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 37281792. Throughput: 0: 10134.6, 1: 9741.6. Samples: 37253664. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:11,175][105115] Avg episode reward: [(0, '-5.086'), (1, '-6.418')] [2023-12-27 19:45:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000072816_18644992.pth... [2023-12-27 19:45:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000071696_18358272.pth [2023-12-27 19:45:11,232][106226] Updated weights for policy 0, policy_version 72788 (0.0008) [2023-12-27 19:45:11,296][106226] Updated weights for policy 0, policy_version 72798 (0.0009) [2023-12-27 19:45:11,360][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000072808_18644992.pth... [2023-12-27 19:45:11,363][106226] Updated weights for policy 0, policy_version 72808 (0.0008) [2023-12-27 19:45:11,363][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000071592_18333696.pth [2023-12-27 19:45:11,755][106225] Updated weights for policy 1, policy_version 72822 (0.0008) [2023-12-27 19:45:11,811][106225] Updated weights for policy 1, policy_version 72832 (0.0008) [2023-12-27 19:45:11,862][106225] Updated weights for policy 1, policy_version 72842 (0.0008) [2023-12-27 19:45:12,139][106226] Updated weights for policy 0, policy_version 72818 (0.0011) [2023-12-27 19:45:12,200][106226] Updated weights for policy 0, policy_version 72828 (0.0011) [2023-12-27 19:45:12,267][106226] Updated weights for policy 0, policy_version 72838 (0.0010) [2023-12-27 19:45:12,674][106225] Updated weights for policy 1, policy_version 72852 (0.0008) [2023-12-27 19:45:12,732][106225] Updated weights for policy 1, policy_version 72862 (0.0008) [2023-12-27 19:45:12,791][106225] Updated weights for policy 1, policy_version 72872 (0.0008) [2023-12-27 19:45:12,976][106226] Updated weights for policy 0, policy_version 72848 (0.0010) [2023-12-27 19:45:13,039][106226] Updated weights for policy 0, policy_version 72858 (0.0010) [2023-12-27 19:45:13,085][106226] Updated weights for policy 0, policy_version 72868 (0.0010) [2023-12-27 19:45:13,535][106225] Updated weights for policy 1, policy_version 72882 (0.0008) [2023-12-27 19:45:13,587][106225] Updated weights for policy 1, policy_version 72892 (0.0008) [2023-12-27 19:45:13,643][106225] Updated weights for policy 1, policy_version 72902 (0.0008) [2023-12-27 19:45:13,696][106225] Updated weights for policy 1, policy_version 72912 (0.0008) [2023-12-27 19:45:13,805][106226] Updated weights for policy 0, policy_version 72878 (0.0011) [2023-12-27 19:45:13,858][106226] Updated weights for policy 0, policy_version 72888 (0.0010) [2023-12-27 19:45:13,914][106226] Updated weights for policy 0, policy_version 72898 (0.0010) [2023-12-27 19:45:14,435][106225] Updated weights for policy 1, policy_version 72922 (0.0008) [2023-12-27 19:45:14,489][106225] Updated weights for policy 1, policy_version 72932 (0.0008) [2023-12-27 19:45:14,536][106225] Updated weights for policy 1, policy_version 72942 (0.0008) [2023-12-27 19:45:14,641][106226] Updated weights for policy 0, policy_version 72908 (0.0010) [2023-12-27 19:45:14,707][106226] Updated weights for policy 0, policy_version 72918 (0.0011) [2023-12-27 19:45:14,766][106226] Updated weights for policy 0, policy_version 72928 (0.0010) [2023-12-27 19:45:15,286][106225] Updated weights for policy 1, policy_version 72952 (0.0008) [2023-12-27 19:45:15,349][106225] Updated weights for policy 1, policy_version 72962 (0.0009) [2023-12-27 19:45:15,407][106226] Updated weights for policy 0, policy_version 72938 (0.0008) [2023-12-27 19:45:15,410][106225] Updated weights for policy 1, policy_version 72972 (0.0009) [2023-12-27 19:45:15,461][106226] Updated weights for policy 0, policy_version 72948 (0.0006) [2023-12-27 19:45:15,527][106226] Updated weights for policy 0, policy_version 72958 (0.0007) [2023-12-27 19:45:15,594][106226] Updated weights for policy 0, policy_version 72968 (0.0008) [2023-12-27 19:45:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 37371904. Throughput: 0: 10037.9, 1: 9642.9. Samples: 37365920. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:16,175][105115] Avg episode reward: [(0, '-5.564'), (1, '-6.608')] [2023-12-27 19:45:16,177][106225] Updated weights for policy 1, policy_version 72982 (0.0009) [2023-12-27 19:45:16,224][106226] Updated weights for policy 0, policy_version 72978 (0.0005) [2023-12-27 19:45:16,228][106225] Updated weights for policy 1, policy_version 72992 (0.0009) [2023-12-27 19:45:16,277][106225] Updated weights for policy 1, policy_version 73002 (0.0008) [2023-12-27 19:45:16,289][106226] Updated weights for policy 0, policy_version 72988 (0.0007) [2023-12-27 19:45:16,353][106226] Updated weights for policy 0, policy_version 72998 (0.0006) [2023-12-27 19:45:16,943][106226] Updated weights for policy 0, policy_version 73008 (0.0008) [2023-12-27 19:45:16,996][106226] Updated weights for policy 0, policy_version 73018 (0.0006) [2023-12-27 19:45:17,063][106226] Updated weights for policy 0, policy_version 73028 (0.0005) [2023-12-27 19:45:17,092][106225] Updated weights for policy 1, policy_version 73012 (0.0008) [2023-12-27 19:45:17,143][106225] Updated weights for policy 1, policy_version 73022 (0.0009) [2023-12-27 19:45:17,197][106225] Updated weights for policy 1, policy_version 73032 (0.0009) [2023-12-27 19:45:17,624][106226] Updated weights for policy 0, policy_version 73038 (0.0005) [2023-12-27 19:45:17,671][106226] Updated weights for policy 0, policy_version 73048 (0.0007) [2023-12-27 19:45:17,714][106226] Updated weights for policy 0, policy_version 73058 (0.0008) [2023-12-27 19:45:17,980][106225] Updated weights for policy 1, policy_version 73042 (0.0009) [2023-12-27 19:45:18,041][106225] Updated weights for policy 1, policy_version 73052 (0.0008) [2023-12-27 19:45:18,103][106225] Updated weights for policy 1, policy_version 73062 (0.0008) [2023-12-27 19:45:18,159][106225] Updated weights for policy 1, policy_version 73072 (0.0007) [2023-12-27 19:45:18,426][106226] Updated weights for policy 0, policy_version 73068 (0.0007) [2023-12-27 19:45:18,492][106226] Updated weights for policy 0, policy_version 73078 (0.0009) [2023-12-27 19:45:18,559][106226] Updated weights for policy 0, policy_version 73088 (0.0008) [2023-12-27 19:45:18,922][106225] Updated weights for policy 1, policy_version 73082 (0.0011) [2023-12-27 19:45:18,989][106225] Updated weights for policy 1, policy_version 73092 (0.0009) [2023-12-27 19:45:19,050][106225] Updated weights for policy 1, policy_version 73102 (0.0008) [2023-12-27 19:45:19,202][106226] Updated weights for policy 0, policy_version 73098 (0.0009) [2023-12-27 19:45:19,273][106226] Updated weights for policy 0, policy_version 73108 (0.0008) [2023-12-27 19:45:19,338][106226] Updated weights for policy 0, policy_version 73118 (0.0007) [2023-12-27 19:45:19,401][106226] Updated weights for policy 0, policy_version 73128 (0.0008) [2023-12-27 19:45:19,800][106225] Updated weights for policy 1, policy_version 73112 (0.0008) [2023-12-27 19:45:19,868][106225] Updated weights for policy 1, policy_version 73122 (0.0009) [2023-12-27 19:45:19,937][106225] Updated weights for policy 1, policy_version 73132 (0.0009) [2023-12-27 19:45:20,137][106226] Updated weights for policy 0, policy_version 73138 (0.0006) [2023-12-27 19:45:20,187][106226] Updated weights for policy 0, policy_version 73148 (0.0006) [2023-12-27 19:45:20,250][106226] Updated weights for policy 0, policy_version 73158 (0.0009) [2023-12-27 19:45:20,754][106225] Updated weights for policy 1, policy_version 73142 (0.0009) [2023-12-27 19:45:20,814][106225] Updated weights for policy 1, policy_version 73152 (0.0009) [2023-12-27 19:45:20,879][106225] Updated weights for policy 1, policy_version 73162 (0.0009) [2023-12-27 19:45:20,979][106226] Updated weights for policy 0, policy_version 73168 (0.0008) [2023-12-27 19:45:21,041][106226] Updated weights for policy 0, policy_version 73178 (0.0008) [2023-12-27 19:45:21,112][106226] Updated weights for policy 0, policy_version 73188 (0.0009) [2023-12-27 19:45:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 37478400. Throughput: 0: 10098.3, 1: 9543.5. Samples: 37483144. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:21,175][105115] Avg episode reward: [(0, '-5.290'), (1, '-6.832')] [2023-12-27 19:45:21,658][106225] Updated weights for policy 1, policy_version 73172 (0.0009) [2023-12-27 19:45:21,719][106225] Updated weights for policy 1, policy_version 73182 (0.0007) [2023-12-27 19:45:21,784][106225] Updated weights for policy 1, policy_version 73192 (0.0010) [2023-12-27 19:45:21,861][106226] Updated weights for policy 0, policy_version 73198 (0.0009) [2023-12-27 19:45:21,926][106226] Updated weights for policy 0, policy_version 73208 (0.0006) [2023-12-27 19:45:21,988][106226] Updated weights for policy 0, policy_version 73218 (0.0008) [2023-12-27 19:45:22,539][106225] Updated weights for policy 1, policy_version 73202 (0.0009) [2023-12-27 19:45:22,608][106225] Updated weights for policy 1, policy_version 73212 (0.0007) [2023-12-27 19:45:22,661][106226] Updated weights for policy 0, policy_version 73228 (0.0008) [2023-12-27 19:45:22,667][106225] Updated weights for policy 1, policy_version 73222 (0.0007) [2023-12-27 19:45:22,726][106225] Updated weights for policy 1, policy_version 73232 (0.0008) [2023-12-27 19:45:22,728][106226] Updated weights for policy 0, policy_version 73238 (0.0006) [2023-12-27 19:45:22,793][106226] Updated weights for policy 0, policy_version 73248 (0.0008) [2023-12-27 19:45:23,368][106225] Updated weights for policy 1, policy_version 73242 (0.0011) [2023-12-27 19:45:23,425][106225] Updated weights for policy 1, policy_version 73252 (0.0011) [2023-12-27 19:45:23,480][106225] Updated weights for policy 1, policy_version 73262 (0.0006) [2023-12-27 19:45:23,490][106226] Updated weights for policy 0, policy_version 73258 (0.0007) [2023-12-27 19:45:23,551][106226] Updated weights for policy 0, policy_version 73268 (0.0010) [2023-12-27 19:45:23,603][106226] Updated weights for policy 0, policy_version 73278 (0.0010) [2023-12-27 19:45:23,647][106226] Updated weights for policy 0, policy_version 73288 (0.0009) [2023-12-27 19:45:24,069][106225] Updated weights for policy 1, policy_version 73272 (0.0005) [2023-12-27 19:45:24,133][106225] Updated weights for policy 1, policy_version 73282 (0.0005) [2023-12-27 19:45:24,184][106225] Updated weights for policy 1, policy_version 73292 (0.0006) [2023-12-27 19:45:24,351][106226] Updated weights for policy 0, policy_version 73298 (0.0008) [2023-12-27 19:45:24,398][106226] Updated weights for policy 0, policy_version 73308 (0.0008) [2023-12-27 19:45:24,451][106226] Updated weights for policy 0, policy_version 73318 (0.0008) [2023-12-27 19:45:24,849][106225] Updated weights for policy 1, policy_version 73302 (0.0010) [2023-12-27 19:45:24,898][106225] Updated weights for policy 1, policy_version 73312 (0.0010) [2023-12-27 19:45:24,954][106225] Updated weights for policy 1, policy_version 73322 (0.0010) [2023-12-27 19:45:25,198][106226] Updated weights for policy 0, policy_version 73328 (0.0007) [2023-12-27 19:45:25,255][106226] Updated weights for policy 0, policy_version 73338 (0.0007) [2023-12-27 19:45:25,316][106226] Updated weights for policy 0, policy_version 73348 (0.0008) [2023-12-27 19:45:25,662][106225] Updated weights for policy 1, policy_version 73332 (0.0009) [2023-12-27 19:45:25,722][106225] Updated weights for policy 1, policy_version 73342 (0.0010) [2023-12-27 19:45:25,779][106225] Updated weights for policy 1, policy_version 73352 (0.0010) [2023-12-27 19:45:26,039][106226] Updated weights for policy 0, policy_version 73358 (0.0008) [2023-12-27 19:45:26,091][106226] Updated weights for policy 0, policy_version 73368 (0.0007) [2023-12-27 19:45:26,141][106226] Updated weights for policy 0, policy_version 73378 (0.0006) [2023-12-27 19:45:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 37576704. Throughput: 0: 10089.3, 1: 9528.4. Samples: 37540780. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-27 19:45:26,175][105115] Avg episode reward: [(0, '-5.342'), (1, '-6.545')] [2023-12-27 19:45:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000073360_18784256.pth... [2023-12-27 19:45:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000073384_18792448.pth... [2023-12-27 19:45:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000072200_18489344.pth [2023-12-27 19:45:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000072240_18497536.pth [2023-12-27 19:45:26,486][106225] Updated weights for policy 1, policy_version 73362 (0.0010) [2023-12-27 19:45:26,545][106225] Updated weights for policy 1, policy_version 73372 (0.0010) [2023-12-27 19:45:26,605][106225] Updated weights for policy 1, policy_version 73382 (0.0010) [2023-12-27 19:45:26,662][106225] Updated weights for policy 1, policy_version 73392 (0.0010) [2023-12-27 19:45:26,722][106226] Updated weights for policy 0, policy_version 73388 (0.0006) [2023-12-27 19:45:26,781][106226] Updated weights for policy 0, policy_version 73398 (0.0008) [2023-12-27 19:45:26,837][106226] Updated weights for policy 0, policy_version 73408 (0.0008) [2023-12-27 19:45:27,344][106225] Updated weights for policy 1, policy_version 73402 (0.0010) [2023-12-27 19:45:27,396][106225] Updated weights for policy 1, policy_version 73412 (0.0010) [2023-12-27 19:45:27,446][106225] Updated weights for policy 1, policy_version 73422 (0.0010) [2023-12-27 19:45:27,575][106226] Updated weights for policy 0, policy_version 73418 (0.0007) [2023-12-27 19:45:27,622][106226] Updated weights for policy 0, policy_version 73428 (0.0005) [2023-12-27 19:45:27,667][106226] Updated weights for policy 0, policy_version 73438 (0.0005) [2023-12-27 19:45:27,725][106226] Updated weights for policy 0, policy_version 73448 (0.0005) [2023-12-27 19:45:28,155][106225] Updated weights for policy 1, policy_version 73432 (0.0006) [2023-12-27 19:45:28,212][106225] Updated weights for policy 1, policy_version 73442 (0.0005) [2023-12-27 19:45:28,260][106225] Updated weights for policy 1, policy_version 73452 (0.0007) [2023-12-27 19:45:28,367][106226] Updated weights for policy 0, policy_version 73458 (0.0009) [2023-12-27 19:45:28,427][106226] Updated weights for policy 0, policy_version 73468 (0.0008) [2023-12-27 19:45:28,485][106226] Updated weights for policy 0, policy_version 73478 (0.0010) [2023-12-27 19:45:29,000][106225] Updated weights for policy 1, policy_version 73462 (0.0007) [2023-12-27 19:45:29,061][106225] Updated weights for policy 1, policy_version 73472 (0.0007) [2023-12-27 19:45:29,122][106225] Updated weights for policy 1, policy_version 73482 (0.0007) [2023-12-27 19:45:29,183][106226] Updated weights for policy 0, policy_version 73488 (0.0010) [2023-12-27 19:45:29,245][106226] Updated weights for policy 0, policy_version 73498 (0.0010) [2023-12-27 19:45:29,299][106226] Updated weights for policy 0, policy_version 73508 (0.0010) [2023-12-27 19:45:29,845][106225] Updated weights for policy 1, policy_version 73492 (0.0008) [2023-12-27 19:45:29,909][106225] Updated weights for policy 1, policy_version 73502 (0.0009) [2023-12-27 19:45:29,944][106226] Updated weights for policy 0, policy_version 73518 (0.0014) [2023-12-27 19:45:29,971][106225] Updated weights for policy 1, policy_version 73512 (0.0009) [2023-12-27 19:45:29,998][106226] Updated weights for policy 0, policy_version 73528 (0.0010) [2023-12-27 19:45:30,060][106226] Updated weights for policy 0, policy_version 73538 (0.0010) [2023-12-27 19:45:30,666][106225] Updated weights for policy 1, policy_version 73522 (0.0009) [2023-12-27 19:45:30,726][106225] Updated weights for policy 1, policy_version 73532 (0.0007) [2023-12-27 19:45:30,779][106225] Updated weights for policy 1, policy_version 73542 (0.0005) [2023-12-27 19:45:30,782][106226] Updated weights for policy 0, policy_version 73548 (0.0010) [2023-12-27 19:45:30,830][106225] Updated weights for policy 1, policy_version 73552 (0.0005) [2023-12-27 19:45:30,836][106226] Updated weights for policy 0, policy_version 73558 (0.0010) [2023-12-27 19:45:30,902][106226] Updated weights for policy 0, policy_version 73568 (0.0011) [2023-12-27 19:45:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 37675008. Throughput: 0: 10060.2, 1: 9640.6. Samples: 37662064. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:31,175][105115] Avg episode reward: [(0, '-5.305'), (1, '-6.958')] [2023-12-27 19:45:31,497][106225] Updated weights for policy 1, policy_version 73562 (0.0008) [2023-12-27 19:45:31,544][106225] Updated weights for policy 1, policy_version 73572 (0.0007) [2023-12-27 19:45:31,599][106225] Updated weights for policy 1, policy_version 73582 (0.0008) [2023-12-27 19:45:31,629][106226] Updated weights for policy 0, policy_version 73578 (0.0011) [2023-12-27 19:45:31,699][106226] Updated weights for policy 0, policy_version 73588 (0.0009) [2023-12-27 19:45:31,771][106226] Updated weights for policy 0, policy_version 73598 (0.0009) [2023-12-27 19:45:31,829][106226] Updated weights for policy 0, policy_version 73608 (0.0008) [2023-12-27 19:45:32,332][106225] Updated weights for policy 1, policy_version 73592 (0.0008) [2023-12-27 19:45:32,397][106225] Updated weights for policy 1, policy_version 73602 (0.0007) [2023-12-27 19:45:32,453][106225] Updated weights for policy 1, policy_version 73612 (0.0006) [2023-12-27 19:45:32,558][106226] Updated weights for policy 0, policy_version 73618 (0.0006) [2023-12-27 19:45:32,614][106226] Updated weights for policy 0, policy_version 73628 (0.0006) [2023-12-27 19:45:32,684][106226] Updated weights for policy 0, policy_version 73638 (0.0005) [2023-12-27 19:45:33,175][106225] Updated weights for policy 1, policy_version 73622 (0.0008) [2023-12-27 19:45:33,220][106225] Updated weights for policy 1, policy_version 73632 (0.0008) [2023-12-27 19:45:33,268][106225] Updated weights for policy 1, policy_version 73642 (0.0006) [2023-12-27 19:45:33,277][106226] Updated weights for policy 0, policy_version 73648 (0.0006) [2023-12-27 19:45:33,336][106226] Updated weights for policy 0, policy_version 73658 (0.0007) [2023-12-27 19:45:33,392][106226] Updated weights for policy 0, policy_version 73668 (0.0007) [2023-12-27 19:45:33,888][106225] Updated weights for policy 1, policy_version 73652 (0.0008) [2023-12-27 19:45:33,933][106225] Updated weights for policy 1, policy_version 73662 (0.0010) [2023-12-27 19:45:33,982][106225] Updated weights for policy 1, policy_version 73672 (0.0010) [2023-12-27 19:45:34,183][106226] Updated weights for policy 0, policy_version 73678 (0.0008) [2023-12-27 19:45:34,242][106226] Updated weights for policy 0, policy_version 73688 (0.0009) [2023-12-27 19:45:34,294][106226] Updated weights for policy 0, policy_version 73698 (0.0009) [2023-12-27 19:45:34,697][106225] Updated weights for policy 1, policy_version 73682 (0.0010) [2023-12-27 19:45:34,759][106225] Updated weights for policy 1, policy_version 73692 (0.0009) [2023-12-27 19:45:34,819][106225] Updated weights for policy 1, policy_version 73702 (0.0009) [2023-12-27 19:45:34,882][106225] Updated weights for policy 1, policy_version 73712 (0.0006) [2023-12-27 19:45:35,073][106226] Updated weights for policy 0, policy_version 73708 (0.0007) [2023-12-27 19:45:35,131][106226] Updated weights for policy 0, policy_version 73718 (0.0005) [2023-12-27 19:45:35,190][106226] Updated weights for policy 0, policy_version 73728 (0.0008) [2023-12-27 19:45:35,588][106225] Updated weights for policy 1, policy_version 73722 (0.0010) [2023-12-27 19:45:35,635][106225] Updated weights for policy 1, policy_version 73732 (0.0010) [2023-12-27 19:45:35,688][106225] Updated weights for policy 1, policy_version 73742 (0.0010) [2023-12-27 19:45:35,749][106226] Updated weights for policy 0, policy_version 73738 (0.0009) [2023-12-27 19:45:35,798][106226] Updated weights for policy 0, policy_version 73748 (0.0005) [2023-12-27 19:45:35,849][106226] Updated weights for policy 0, policy_version 73758 (0.0005) [2023-12-27 19:45:35,897][106226] Updated weights for policy 0, policy_version 73768 (0.0005) [2023-12-27 19:45:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 37773312. Throughput: 0: 10070.2, 1: 9699.8. Samples: 37782552. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:36,175][105115] Avg episode reward: [(0, '-5.346'), (1, '-6.681')] [2023-12-27 19:45:36,433][106225] Updated weights for policy 1, policy_version 73752 (0.0008) [2023-12-27 19:45:36,493][106225] Updated weights for policy 1, policy_version 73762 (0.0008) [2023-12-27 19:45:36,543][106226] Updated weights for policy 0, policy_version 73778 (0.0011) [2023-12-27 19:45:36,551][106225] Updated weights for policy 1, policy_version 73772 (0.0009) [2023-12-27 19:45:36,608][106226] Updated weights for policy 0, policy_version 73788 (0.0011) [2023-12-27 19:45:36,673][106226] Updated weights for policy 0, policy_version 73798 (0.0011) [2023-12-27 19:45:37,245][106225] Updated weights for policy 1, policy_version 73782 (0.0009) [2023-12-27 19:45:37,302][106225] Updated weights for policy 1, policy_version 73792 (0.0008) [2023-12-27 19:45:37,358][106225] Updated weights for policy 1, policy_version 73802 (0.0007) [2023-12-27 19:45:37,382][106226] Updated weights for policy 0, policy_version 73808 (0.0010) [2023-12-27 19:45:37,433][106226] Updated weights for policy 0, policy_version 73818 (0.0011) [2023-12-27 19:45:37,494][106226] Updated weights for policy 0, policy_version 73828 (0.0009) [2023-12-27 19:45:38,021][106225] Updated weights for policy 1, policy_version 73812 (0.0006) [2023-12-27 19:45:38,083][106225] Updated weights for policy 1, policy_version 73822 (0.0007) [2023-12-27 19:45:38,141][106225] Updated weights for policy 1, policy_version 73832 (0.0007) [2023-12-27 19:45:38,227][106226] Updated weights for policy 0, policy_version 73838 (0.0008) [2023-12-27 19:45:38,288][106226] Updated weights for policy 0, policy_version 73848 (0.0007) [2023-12-27 19:45:38,358][106226] Updated weights for policy 0, policy_version 73858 (0.0008) [2023-12-27 19:45:38,841][106225] Updated weights for policy 1, policy_version 73842 (0.0008) [2023-12-27 19:45:38,892][106225] Updated weights for policy 1, policy_version 73852 (0.0008) [2023-12-27 19:45:38,948][106225] Updated weights for policy 1, policy_version 73862 (0.0008) [2023-12-27 19:45:38,997][106225] Updated weights for policy 1, policy_version 73872 (0.0006) [2023-12-27 19:45:39,097][106226] Updated weights for policy 0, policy_version 73868 (0.0009) [2023-12-27 19:45:39,149][106226] Updated weights for policy 0, policy_version 73878 (0.0008) [2023-12-27 19:45:39,205][106226] Updated weights for policy 0, policy_version 73888 (0.0009) [2023-12-27 19:45:39,773][106225] Updated weights for policy 1, policy_version 73882 (0.0009) [2023-12-27 19:45:39,843][106225] Updated weights for policy 1, policy_version 73892 (0.0009) [2023-12-27 19:45:39,903][106225] Updated weights for policy 1, policy_version 73902 (0.0009) [2023-12-27 19:45:39,971][106226] Updated weights for policy 0, policy_version 73898 (0.0007) [2023-12-27 19:45:40,038][106226] Updated weights for policy 0, policy_version 73908 (0.0008) [2023-12-27 19:45:40,093][106226] Updated weights for policy 0, policy_version 73918 (0.0010) [2023-12-27 19:45:40,155][106226] Updated weights for policy 0, policy_version 73928 (0.0010) [2023-12-27 19:45:40,591][106225] Updated weights for policy 1, policy_version 73912 (0.0008) [2023-12-27 19:45:40,657][106225] Updated weights for policy 1, policy_version 73922 (0.0009) [2023-12-27 19:45:40,714][106225] Updated weights for policy 1, policy_version 73932 (0.0009) [2023-12-27 19:45:40,937][106226] Updated weights for policy 0, policy_version 73938 (0.0008) [2023-12-27 19:45:41,000][106226] Updated weights for policy 0, policy_version 73948 (0.0009) [2023-12-27 19:45:41,074][106226] Updated weights for policy 0, policy_version 73958 (0.0008) [2023-12-27 19:45:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 37871616. Throughput: 0: 10057.1, 1: 9703.5. Samples: 37841204. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:41,175][105115] Avg episode reward: [(0, '-5.517'), (1, '-6.325')] [2023-12-27 19:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000073960_18939904.pth... [2023-12-27 19:45:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000073936_18931712.pth... [2023-12-27 19:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000072816_18644992.pth [2023-12-27 19:45:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000072808_18644992.pth [2023-12-27 19:45:41,510][106225] Updated weights for policy 1, policy_version 73942 (0.0008) [2023-12-27 19:45:41,582][106225] Updated weights for policy 1, policy_version 73952 (0.0009) [2023-12-27 19:45:41,654][106225] Updated weights for policy 1, policy_version 73962 (0.0010) [2023-12-27 19:45:41,896][106226] Updated weights for policy 0, policy_version 73968 (0.0009) [2023-12-27 19:45:41,958][106226] Updated weights for policy 0, policy_version 73978 (0.0009) [2023-12-27 19:45:42,017][106226] Updated weights for policy 0, policy_version 73988 (0.0009) [2023-12-27 19:45:42,337][106225] Updated weights for policy 1, policy_version 73972 (0.0008) [2023-12-27 19:45:42,404][106225] Updated weights for policy 1, policy_version 73982 (0.0008) [2023-12-27 19:45:42,467][106225] Updated weights for policy 1, policy_version 73992 (0.0008) [2023-12-27 19:45:42,834][106226] Updated weights for policy 0, policy_version 73998 (0.0009) [2023-12-27 19:45:42,890][106226] Updated weights for policy 0, policy_version 74008 (0.0009) [2023-12-27 19:45:42,945][106226] Updated weights for policy 0, policy_version 74018 (0.0009) [2023-12-27 19:45:43,149][106225] Updated weights for policy 1, policy_version 74002 (0.0008) [2023-12-27 19:45:43,212][106225] Updated weights for policy 1, policy_version 74012 (0.0007) [2023-12-27 19:45:43,271][106225] Updated weights for policy 1, policy_version 74022 (0.0008) [2023-12-27 19:45:43,334][106225] Updated weights for policy 1, policy_version 74032 (0.0008) [2023-12-27 19:45:43,721][106226] Updated weights for policy 0, policy_version 74028 (0.0010) [2023-12-27 19:45:43,785][106226] Updated weights for policy 0, policy_version 74038 (0.0011) [2023-12-27 19:45:43,850][106226] Updated weights for policy 0, policy_version 74048 (0.0011) [2023-12-27 19:45:44,027][106225] Updated weights for policy 1, policy_version 74042 (0.0008) [2023-12-27 19:45:44,077][106225] Updated weights for policy 1, policy_version 74052 (0.0008) [2023-12-27 19:45:44,134][106225] Updated weights for policy 1, policy_version 74062 (0.0008) [2023-12-27 19:45:44,532][106226] Updated weights for policy 0, policy_version 74058 (0.0010) [2023-12-27 19:45:44,589][106226] Updated weights for policy 0, policy_version 74068 (0.0007) [2023-12-27 19:45:44,654][106226] Updated weights for policy 0, policy_version 74078 (0.0006) [2023-12-27 19:45:44,706][106226] Updated weights for policy 0, policy_version 74088 (0.0006) [2023-12-27 19:45:44,882][106225] Updated weights for policy 1, policy_version 74072 (0.0009) [2023-12-27 19:45:44,948][106225] Updated weights for policy 1, policy_version 74082 (0.0009) [2023-12-27 19:45:45,015][106225] Updated weights for policy 1, policy_version 74092 (0.0009) [2023-12-27 19:45:45,425][106226] Updated weights for policy 0, policy_version 74098 (0.0008) [2023-12-27 19:45:45,479][106226] Updated weights for policy 0, policy_version 74108 (0.0007) [2023-12-27 19:45:45,543][106226] Updated weights for policy 0, policy_version 74118 (0.0007) [2023-12-27 19:45:45,794][106225] Updated weights for policy 1, policy_version 74102 (0.0007) [2023-12-27 19:45:45,850][106225] Updated weights for policy 1, policy_version 74112 (0.0005) [2023-12-27 19:45:45,910][106225] Updated weights for policy 1, policy_version 74122 (0.0008) [2023-12-27 19:45:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 37961728. Throughput: 0: 9934.8, 1: 9649.6. Samples: 37953084. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:46,175][105115] Avg episode reward: [(0, '-5.385'), (1, '-6.495')] [2023-12-27 19:45:46,250][106226] Updated weights for policy 0, policy_version 74128 (0.0008) [2023-12-27 19:45:46,302][106226] Updated weights for policy 0, policy_version 74138 (0.0008) [2023-12-27 19:45:46,362][106226] Updated weights for policy 0, policy_version 74148 (0.0009) [2023-12-27 19:45:46,628][106225] Updated weights for policy 1, policy_version 74132 (0.0007) [2023-12-27 19:45:46,689][106225] Updated weights for policy 1, policy_version 74142 (0.0008) [2023-12-27 19:45:46,753][106225] Updated weights for policy 1, policy_version 74152 (0.0007) [2023-12-27 19:45:47,123][106226] Updated weights for policy 0, policy_version 74158 (0.0009) [2023-12-27 19:45:47,186][106226] Updated weights for policy 0, policy_version 74168 (0.0009) [2023-12-27 19:45:47,250][106226] Updated weights for policy 0, policy_version 74178 (0.0008) [2023-12-27 19:45:47,343][106225] Updated weights for policy 1, policy_version 74162 (0.0007) [2023-12-27 19:45:47,402][106225] Updated weights for policy 1, policy_version 74172 (0.0009) [2023-12-27 19:45:47,457][106225] Updated weights for policy 1, policy_version 74182 (0.0009) [2023-12-27 19:45:47,506][106225] Updated weights for policy 1, policy_version 74192 (0.0009) [2023-12-27 19:45:47,944][106226] Updated weights for policy 0, policy_version 74188 (0.0007) [2023-12-27 19:45:48,007][106226] Updated weights for policy 0, policy_version 74198 (0.0009) [2023-12-27 19:45:48,055][106226] Updated weights for policy 0, policy_version 74208 (0.0007) [2023-12-27 19:45:48,244][106225] Updated weights for policy 1, policy_version 74202 (0.0008) [2023-12-27 19:45:48,296][106225] Updated weights for policy 1, policy_version 74212 (0.0006) [2023-12-27 19:45:48,357][106225] Updated weights for policy 1, policy_version 74222 (0.0008) [2023-12-27 19:45:48,809][106226] Updated weights for policy 0, policy_version 74218 (0.0009) [2023-12-27 19:45:48,875][106226] Updated weights for policy 0, policy_version 74228 (0.0010) [2023-12-27 19:45:48,931][106226] Updated weights for policy 0, policy_version 74238 (0.0009) [2023-12-27 19:45:48,997][106226] Updated weights for policy 0, policy_version 74248 (0.0009) [2023-12-27 19:45:49,138][106225] Updated weights for policy 1, policy_version 74232 (0.0009) [2023-12-27 19:45:49,191][106225] Updated weights for policy 1, policy_version 74242 (0.0009) [2023-12-27 19:45:49,257][106225] Updated weights for policy 1, policy_version 74252 (0.0009) [2023-12-27 19:45:49,778][106226] Updated weights for policy 0, policy_version 74258 (0.0011) [2023-12-27 19:45:49,838][106226] Updated weights for policy 0, policy_version 74268 (0.0011) [2023-12-27 19:45:49,902][106226] Updated weights for policy 0, policy_version 74278 (0.0011) [2023-12-27 19:45:50,052][106225] Updated weights for policy 1, policy_version 74262 (0.0007) [2023-12-27 19:45:50,117][106225] Updated weights for policy 1, policy_version 74272 (0.0007) [2023-12-27 19:45:50,177][106225] Updated weights for policy 1, policy_version 74282 (0.0006) [2023-12-27 19:45:50,657][106226] Updated weights for policy 0, policy_version 74288 (0.0011) [2023-12-27 19:45:50,716][106226] Updated weights for policy 0, policy_version 74298 (0.0011) [2023-12-27 19:45:50,784][106226] Updated weights for policy 0, policy_version 74308 (0.0011) [2023-12-27 19:45:50,829][106225] Updated weights for policy 1, policy_version 74292 (0.0006) [2023-12-27 19:45:50,893][106225] Updated weights for policy 1, policy_version 74302 (0.0006) [2023-12-27 19:45:50,957][106225] Updated weights for policy 1, policy_version 74312 (0.0007) [2023-12-27 19:45:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 38060032. Throughput: 0: 9781.6, 1: 9620.5. Samples: 38066080. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:51,175][105115] Avg episode reward: [(0, '-5.478'), (1, '-6.079')] [2023-12-27 19:45:51,486][106226] Updated weights for policy 0, policy_version 74318 (0.0011) [2023-12-27 19:45:51,544][106226] Updated weights for policy 0, policy_version 74328 (0.0010) [2023-12-27 19:45:51,610][106226] Updated weights for policy 0, policy_version 74338 (0.0011) [2023-12-27 19:45:51,643][106225] Updated weights for policy 1, policy_version 74322 (0.0008) [2023-12-27 19:45:51,706][106225] Updated weights for policy 1, policy_version 74332 (0.0006) [2023-12-27 19:45:51,774][106225] Updated weights for policy 1, policy_version 74342 (0.0007) [2023-12-27 19:45:51,835][106225] Updated weights for policy 1, policy_version 74352 (0.0006) [2023-12-27 19:45:52,409][106226] Updated weights for policy 0, policy_version 74348 (0.0007) [2023-12-27 19:45:52,466][106226] Updated weights for policy 0, policy_version 74358 (0.0006) [2023-12-27 19:45:52,519][106226] Updated weights for policy 0, policy_version 74368 (0.0007) [2023-12-27 19:45:52,549][106225] Updated weights for policy 1, policy_version 74362 (0.0007) [2023-12-27 19:45:52,613][106225] Updated weights for policy 1, policy_version 74372 (0.0007) [2023-12-27 19:45:52,674][106225] Updated weights for policy 1, policy_version 74382 (0.0007) [2023-12-27 19:45:53,209][106226] Updated weights for policy 0, policy_version 74378 (0.0008) [2023-12-27 19:45:53,275][106225] Updated weights for policy 1, policy_version 74392 (0.0010) [2023-12-27 19:45:53,276][106226] Updated weights for policy 0, policy_version 74388 (0.0007) [2023-12-27 19:45:53,333][106225] Updated weights for policy 1, policy_version 74402 (0.0010) [2023-12-27 19:45:53,345][106226] Updated weights for policy 0, policy_version 74398 (0.0009) [2023-12-27 19:45:53,392][106225] Updated weights for policy 1, policy_version 74412 (0.0010) [2023-12-27 19:45:53,407][106226] Updated weights for policy 0, policy_version 74408 (0.0008) [2023-12-27 19:45:54,099][106226] Updated weights for policy 0, policy_version 74418 (0.0008) [2023-12-27 19:45:54,124][106225] Updated weights for policy 1, policy_version 74422 (0.0010) [2023-12-27 19:45:54,150][106226] Updated weights for policy 0, policy_version 74428 (0.0006) [2023-12-27 19:45:54,181][106225] Updated weights for policy 1, policy_version 74432 (0.0010) [2023-12-27 19:45:54,215][106226] Updated weights for policy 0, policy_version 74438 (0.0008) [2023-12-27 19:45:54,238][106225] Updated weights for policy 1, policy_version 74442 (0.0010) [2023-12-27 19:45:54,856][106225] Updated weights for policy 1, policy_version 74452 (0.0010) [2023-12-27 19:45:54,910][106225] Updated weights for policy 1, policy_version 74462 (0.0006) [2023-12-27 19:45:54,971][106225] Updated weights for policy 1, policy_version 74472 (0.0007) [2023-12-27 19:45:54,973][106226] Updated weights for policy 0, policy_version 74448 (0.0007) [2023-12-27 19:45:55,043][106226] Updated weights for policy 0, policy_version 74458 (0.0007) [2023-12-27 19:45:55,100][106226] Updated weights for policy 0, policy_version 74468 (0.0006) [2023-12-27 19:45:55,686][106225] Updated weights for policy 1, policy_version 74482 (0.0006) [2023-12-27 19:45:55,736][106225] Updated weights for policy 1, policy_version 74492 (0.0008) [2023-12-27 19:45:55,792][106225] Updated weights for policy 1, policy_version 74502 (0.0008) [2023-12-27 19:45:55,801][106226] Updated weights for policy 0, policy_version 74478 (0.0008) [2023-12-27 19:45:55,848][106225] Updated weights for policy 1, policy_version 74512 (0.0006) [2023-12-27 19:45:55,862][106226] Updated weights for policy 0, policy_version 74488 (0.0008) [2023-12-27 19:45:55,917][106226] Updated weights for policy 0, policy_version 74498 (0.0008) [2023-12-27 19:45:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.4, 300 sec: 19771.9). Total num frames: 38158336. Throughput: 0: 9749.2, 1: 9611.3. Samples: 38124888. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:45:56,176][105115] Avg episode reward: [(0, '-5.363'), (1, '-6.834')] [2023-12-27 19:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000074512_19079168.pth... [2023-12-27 19:45:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000074504_19079168.pth... [2023-12-27 19:45:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000073360_18784256.pth [2023-12-27 19:45:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000073384_18792448.pth [2023-12-27 19:45:56,498][106225] Updated weights for policy 1, policy_version 74522 (0.0007) [2023-12-27 19:45:56,547][106225] Updated weights for policy 1, policy_version 74532 (0.0008) [2023-12-27 19:45:56,597][106225] Updated weights for policy 1, policy_version 74542 (0.0007) [2023-12-27 19:45:56,606][106226] Updated weights for policy 0, policy_version 74508 (0.0008) [2023-12-27 19:45:56,658][106226] Updated weights for policy 0, policy_version 74518 (0.0009) [2023-12-27 19:45:56,711][106226] Updated weights for policy 0, policy_version 74528 (0.0010) [2023-12-27 19:45:57,165][106225] Updated weights for policy 1, policy_version 74552 (0.0006) [2023-12-27 19:45:57,226][106225] Updated weights for policy 1, policy_version 74562 (0.0007) [2023-12-27 19:45:57,292][106225] Updated weights for policy 1, policy_version 74572 (0.0006) [2023-12-27 19:45:57,544][106226] Updated weights for policy 0, policy_version 74538 (0.0009) [2023-12-27 19:45:57,604][106226] Updated weights for policy 0, policy_version 74548 (0.0008) [2023-12-27 19:45:57,663][106226] Updated weights for policy 0, policy_version 74558 (0.0009) [2023-12-27 19:45:57,721][106226] Updated weights for policy 0, policy_version 74568 (0.0007) [2023-12-27 19:45:57,907][106225] Updated weights for policy 1, policy_version 74582 (0.0008) [2023-12-27 19:45:57,955][106225] Updated weights for policy 1, policy_version 74592 (0.0008) [2023-12-27 19:45:58,008][106225] Updated weights for policy 1, policy_version 74602 (0.0008) [2023-12-27 19:45:58,394][106226] Updated weights for policy 0, policy_version 74578 (0.0009) [2023-12-27 19:45:58,462][106226] Updated weights for policy 0, policy_version 74588 (0.0008) [2023-12-27 19:45:58,519][106226] Updated weights for policy 0, policy_version 74598 (0.0007) [2023-12-27 19:45:58,911][106225] Updated weights for policy 1, policy_version 74612 (0.0008) [2023-12-27 19:45:58,982][106225] Updated weights for policy 1, policy_version 74622 (0.0010) [2023-12-27 19:45:59,051][106225] Updated weights for policy 1, policy_version 74632 (0.0009) [2023-12-27 19:45:59,338][106226] Updated weights for policy 0, policy_version 74608 (0.0006) [2023-12-27 19:45:59,398][106226] Updated weights for policy 0, policy_version 74618 (0.0009) [2023-12-27 19:45:59,459][106226] Updated weights for policy 0, policy_version 74628 (0.0008) [2023-12-27 19:45:59,772][106225] Updated weights for policy 1, policy_version 74642 (0.0007) [2023-12-27 19:45:59,824][106225] Updated weights for policy 1, policy_version 74652 (0.0008) [2023-12-27 19:45:59,888][106225] Updated weights for policy 1, policy_version 74662 (0.0007) [2023-12-27 19:45:59,956][106225] Updated weights for policy 1, policy_version 74672 (0.0006) [2023-12-27 19:46:00,155][106226] Updated weights for policy 0, policy_version 74638 (0.0009) [2023-12-27 19:46:00,213][106226] Updated weights for policy 0, policy_version 74648 (0.0008) [2023-12-27 19:46:00,264][106226] Updated weights for policy 0, policy_version 74658 (0.0008) [2023-12-27 19:46:00,595][106225] Updated weights for policy 1, policy_version 74682 (0.0005) [2023-12-27 19:46:00,652][106225] Updated weights for policy 1, policy_version 74692 (0.0005) [2023-12-27 19:46:00,710][106225] Updated weights for policy 1, policy_version 74702 (0.0008) [2023-12-27 19:46:00,956][106226] Updated weights for policy 0, policy_version 74668 (0.0007) [2023-12-27 19:46:01,011][106226] Updated weights for policy 0, policy_version 74678 (0.0006) [2023-12-27 19:46:01,082][106226] Updated weights for policy 0, policy_version 74688 (0.0008) [2023-12-27 19:46:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 38256640. Throughput: 0: 9731.6, 1: 9747.0. Samples: 38242456. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:46:01,175][105115] Avg episode reward: [(0, '-5.279'), (1, '-5.895')] [2023-12-27 19:46:01,435][106225] Updated weights for policy 1, policy_version 74712 (0.0008) [2023-12-27 19:46:01,489][106225] Updated weights for policy 1, policy_version 74722 (0.0008) [2023-12-27 19:46:01,542][106225] Updated weights for policy 1, policy_version 74732 (0.0008) [2023-12-27 19:46:01,766][106226] Updated weights for policy 0, policy_version 74698 (0.0008) [2023-12-27 19:46:01,822][106226] Updated weights for policy 0, policy_version 74708 (0.0009) [2023-12-27 19:46:01,887][106226] Updated weights for policy 0, policy_version 74718 (0.0009) [2023-12-27 19:46:01,946][106226] Updated weights for policy 0, policy_version 74728 (0.0008) [2023-12-27 19:46:02,253][106225] Updated weights for policy 1, policy_version 74742 (0.0009) [2023-12-27 19:46:02,314][106225] Updated weights for policy 1, policy_version 74752 (0.0007) [2023-12-27 19:46:02,379][106225] Updated weights for policy 1, policy_version 74762 (0.0008) [2023-12-27 19:46:02,720][106226] Updated weights for policy 0, policy_version 74738 (0.0011) [2023-12-27 19:46:02,782][106226] Updated weights for policy 0, policy_version 74748 (0.0011) [2023-12-27 19:46:02,847][106226] Updated weights for policy 0, policy_version 74758 (0.0011) [2023-12-27 19:46:03,145][106225] Updated weights for policy 1, policy_version 74772 (0.0008) [2023-12-27 19:46:03,201][106225] Updated weights for policy 1, policy_version 74782 (0.0010) [2023-12-27 19:46:03,256][106225] Updated weights for policy 1, policy_version 74792 (0.0010) [2023-12-27 19:46:03,521][106226] Updated weights for policy 0, policy_version 74768 (0.0006) [2023-12-27 19:46:03,568][106226] Updated weights for policy 0, policy_version 74778 (0.0005) [2023-12-27 19:46:03,622][106226] Updated weights for policy 0, policy_version 74788 (0.0005) [2023-12-27 19:46:03,943][106225] Updated weights for policy 1, policy_version 74802 (0.0010) [2023-12-27 19:46:04,004][106225] Updated weights for policy 1, policy_version 74812 (0.0010) [2023-12-27 19:46:04,066][106225] Updated weights for policy 1, policy_version 74822 (0.0010) [2023-12-27 19:46:04,124][106225] Updated weights for policy 1, policy_version 74832 (0.0010) [2023-12-27 19:46:04,248][106226] Updated weights for policy 0, policy_version 74798 (0.0006) [2023-12-27 19:46:04,310][106226] Updated weights for policy 0, policy_version 74808 (0.0006) [2023-12-27 19:46:04,375][106226] Updated weights for policy 0, policy_version 74818 (0.0006) [2023-12-27 19:46:04,848][106225] Updated weights for policy 1, policy_version 74842 (0.0007) [2023-12-27 19:46:04,896][106225] Updated weights for policy 1, policy_version 74852 (0.0008) [2023-12-27 19:46:04,941][106226] Updated weights for policy 0, policy_version 74828 (0.0007) [2023-12-27 19:46:04,945][106225] Updated weights for policy 1, policy_version 74862 (0.0006) [2023-12-27 19:46:04,991][106226] Updated weights for policy 0, policy_version 74838 (0.0007) [2023-12-27 19:46:05,057][106226] Updated weights for policy 0, policy_version 74848 (0.0008) [2023-12-27 19:46:05,605][106225] Updated weights for policy 1, policy_version 74872 (0.0006) [2023-12-27 19:46:05,664][106225] Updated weights for policy 1, policy_version 74882 (0.0005) [2023-12-27 19:46:05,715][106225] Updated weights for policy 1, policy_version 74892 (0.0006) [2023-12-27 19:46:05,753][106226] Updated weights for policy 0, policy_version 74858 (0.0009) [2023-12-27 19:46:05,813][106226] Updated weights for policy 0, policy_version 74868 (0.0008) [2023-12-27 19:46:05,870][106226] Updated weights for policy 0, policy_version 74878 (0.0007) [2023-12-27 19:46:05,927][106226] Updated weights for policy 0, policy_version 74888 (0.0008) [2023-12-27 19:46:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 38354944. Throughput: 0: 9692.3, 1: 9853.7. Samples: 38362712. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:46:06,175][105115] Avg episode reward: [(0, '-5.548'), (1, '-6.579')] [2023-12-27 19:46:06,385][106225] Updated weights for policy 1, policy_version 74902 (0.0010) [2023-12-27 19:46:06,447][106225] Updated weights for policy 1, policy_version 74912 (0.0010) [2023-12-27 19:46:06,505][106225] Updated weights for policy 1, policy_version 74922 (0.0011) [2023-12-27 19:46:06,636][106226] Updated weights for policy 0, policy_version 74898 (0.0008) [2023-12-27 19:46:06,702][106226] Updated weights for policy 0, policy_version 74908 (0.0006) [2023-12-27 19:46:06,768][106226] Updated weights for policy 0, policy_version 74918 (0.0006) [2023-12-27 19:46:07,297][106225] Updated weights for policy 1, policy_version 74932 (0.0010) [2023-12-27 19:46:07,308][106226] Updated weights for policy 0, policy_version 74928 (0.0005) [2023-12-27 19:46:07,350][106225] Updated weights for policy 1, policy_version 74942 (0.0007) [2023-12-27 19:46:07,367][106226] Updated weights for policy 0, policy_version 74938 (0.0007) [2023-12-27 19:46:07,409][106225] Updated weights for policy 1, policy_version 74952 (0.0006) [2023-12-27 19:46:07,431][106226] Updated weights for policy 0, policy_version 74948 (0.0007) [2023-12-27 19:46:08,097][106225] Updated weights for policy 1, policy_version 74962 (0.0008) [2023-12-27 19:46:08,139][106226] Updated weights for policy 0, policy_version 74958 (0.0006) [2023-12-27 19:46:08,155][106225] Updated weights for policy 1, policy_version 74972 (0.0009) [2023-12-27 19:46:08,197][106226] Updated weights for policy 0, policy_version 74968 (0.0006) [2023-12-27 19:46:08,215][106225] Updated weights for policy 1, policy_version 74982 (0.0008) [2023-12-27 19:46:08,253][106226] Updated weights for policy 0, policy_version 74978 (0.0007) [2023-12-27 19:46:08,259][106225] Updated weights for policy 1, policy_version 74992 (0.0006) [2023-12-27 19:46:08,974][106225] Updated weights for policy 1, policy_version 75002 (0.0008) [2023-12-27 19:46:09,023][106225] Updated weights for policy 1, policy_version 75012 (0.0008) [2023-12-27 19:46:09,031][106226] Updated weights for policy 0, policy_version 74988 (0.0008) [2023-12-27 19:46:09,081][106226] Updated weights for policy 0, policy_version 74998 (0.0008) [2023-12-27 19:46:09,086][106225] Updated weights for policy 1, policy_version 75022 (0.0007) [2023-12-27 19:46:09,142][106226] Updated weights for policy 0, policy_version 75008 (0.0009) [2023-12-27 19:46:09,857][106225] Updated weights for policy 1, policy_version 75032 (0.0010) [2023-12-27 19:46:09,919][106225] Updated weights for policy 1, policy_version 75042 (0.0008) [2023-12-27 19:46:09,990][106225] Updated weights for policy 1, policy_version 75052 (0.0010) [2023-12-27 19:46:09,993][106226] Updated weights for policy 0, policy_version 75018 (0.0007) [2023-12-27 19:46:10,061][106226] Updated weights for policy 0, policy_version 75028 (0.0008) [2023-12-27 19:46:10,125][106226] Updated weights for policy 0, policy_version 75038 (0.0008) [2023-12-27 19:46:10,186][106226] Updated weights for policy 0, policy_version 75048 (0.0008) [2023-12-27 19:46:10,632][106225] Updated weights for policy 1, policy_version 75062 (0.0007) [2023-12-27 19:46:10,684][106225] Updated weights for policy 1, policy_version 75072 (0.0005) [2023-12-27 19:46:10,733][106225] Updated weights for policy 1, policy_version 75082 (0.0005) [2023-12-27 19:46:10,847][106226] Updated weights for policy 0, policy_version 75058 (0.0009) [2023-12-27 19:46:10,899][106226] Updated weights for policy 0, policy_version 75068 (0.0009) [2023-12-27 19:46:10,952][106226] Updated weights for policy 0, policy_version 75078 (0.0008) [2023-12-27 19:46:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 38453248. Throughput: 0: 9715.5, 1: 9863.3. Samples: 38421828. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-27 19:46:11,175][105115] Avg episode reward: [(0, '-5.354'), (1, '-6.377')] [2023-12-27 19:46:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000075088_19226624.pth... [2023-12-27 19:46:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000075080_19226624.pth... [2023-12-27 19:46:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000073936_18931712.pth [2023-12-27 19:46:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000073960_18939904.pth [2023-12-27 19:46:11,427][106225] Updated weights for policy 1, policy_version 75092 (0.0007) [2023-12-27 19:46:11,485][106225] Updated weights for policy 1, policy_version 75102 (0.0010) [2023-12-27 19:46:11,546][106225] Updated weights for policy 1, policy_version 75112 (0.0010) [2023-12-27 19:46:11,820][106226] Updated weights for policy 0, policy_version 75088 (0.0008) [2023-12-27 19:46:11,883][106226] Updated weights for policy 0, policy_version 75098 (0.0008) [2023-12-27 19:46:11,943][106226] Updated weights for policy 0, policy_version 75108 (0.0009) [2023-12-27 19:46:12,293][106225] Updated weights for policy 1, policy_version 75122 (0.0010) [2023-12-27 19:46:12,358][106225] Updated weights for policy 1, policy_version 75132 (0.0011) [2023-12-27 19:46:12,426][106225] Updated weights for policy 1, policy_version 75142 (0.0009) [2023-12-27 19:46:12,480][106225] Updated weights for policy 1, policy_version 75152 (0.0010) [2023-12-27 19:46:12,694][106226] Updated weights for policy 0, policy_version 75118 (0.0009) [2023-12-27 19:46:12,760][106226] Updated weights for policy 0, policy_version 75128 (0.0008) [2023-12-27 19:46:12,825][106226] Updated weights for policy 0, policy_version 75138 (0.0009) [2023-12-27 19:46:13,228][106225] Updated weights for policy 1, policy_version 75162 (0.0007) [2023-12-27 19:46:13,295][106225] Updated weights for policy 1, policy_version 75172 (0.0006) [2023-12-27 19:46:13,360][106225] Updated weights for policy 1, policy_version 75182 (0.0008) [2023-12-27 19:46:13,399][106226] Updated weights for policy 0, policy_version 75148 (0.0007) [2023-12-27 19:46:13,454][106226] Updated weights for policy 0, policy_version 75158 (0.0007) [2023-12-27 19:46:13,511][106226] Updated weights for policy 0, policy_version 75168 (0.0006) [2023-12-27 19:46:14,003][106225] Updated weights for policy 1, policy_version 75192 (0.0008) [2023-12-27 19:46:14,046][106225] Updated weights for policy 1, policy_version 75202 (0.0008) [2023-12-27 19:46:14,096][106225] Updated weights for policy 1, policy_version 75212 (0.0008) [2023-12-27 19:46:14,194][106226] Updated weights for policy 0, policy_version 75178 (0.0006) [2023-12-27 19:46:14,254][106226] Updated weights for policy 0, policy_version 75188 (0.0009) [2023-12-27 19:46:14,316][106226] Updated weights for policy 0, policy_version 75198 (0.0010) [2023-12-27 19:46:14,372][106226] Updated weights for policy 0, policy_version 75208 (0.0010) [2023-12-27 19:46:14,824][106225] Updated weights for policy 1, policy_version 75222 (0.0008) [2023-12-27 19:46:14,893][106225] Updated weights for policy 1, policy_version 75232 (0.0008) [2023-12-27 19:46:14,958][106225] Updated weights for policy 1, policy_version 75242 (0.0008) [2023-12-27 19:46:14,989][106226] Updated weights for policy 0, policy_version 75218 (0.0008) [2023-12-27 19:46:15,053][106226] Updated weights for policy 0, policy_version 75228 (0.0009) [2023-12-27 19:46:15,112][106226] Updated weights for policy 0, policy_version 75238 (0.0008) [2023-12-27 19:46:15,670][106225] Updated weights for policy 1, policy_version 75252 (0.0007) [2023-12-27 19:46:15,721][106225] Updated weights for policy 1, policy_version 75262 (0.0005) [2023-12-27 19:46:15,777][106225] Updated weights for policy 1, policy_version 75272 (0.0009) [2023-12-27 19:46:15,876][106226] Updated weights for policy 0, policy_version 75248 (0.0008) [2023-12-27 19:46:15,927][106226] Updated weights for policy 0, policy_version 75258 (0.0007) [2023-12-27 19:46:15,977][106226] Updated weights for policy 0, policy_version 75268 (0.0005) [2023-12-27 19:46:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 38551552. Throughput: 0: 9650.5, 1: 9846.8. Samples: 38539444. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:16,176][105115] Avg episode reward: [(0, '-5.430'), (1, '-6.376')] [2023-12-27 19:46:16,479][106225] Updated weights for policy 1, policy_version 75282 (0.0009) [2023-12-27 19:46:16,533][106225] Updated weights for policy 1, policy_version 75292 (0.0008) [2023-12-27 19:46:16,588][106225] Updated weights for policy 1, policy_version 75302 (0.0008) [2023-12-27 19:46:16,648][106225] Updated weights for policy 1, policy_version 75312 (0.0005) [2023-12-27 19:46:16,688][106226] Updated weights for policy 0, policy_version 75278 (0.0008) [2023-12-27 19:46:16,749][106226] Updated weights for policy 0, policy_version 75288 (0.0009) [2023-12-27 19:46:16,812][106226] Updated weights for policy 0, policy_version 75298 (0.0010) [2023-12-27 19:46:17,231][106225] Updated weights for policy 1, policy_version 75322 (0.0007) [2023-12-27 19:46:17,288][106225] Updated weights for policy 1, policy_version 75332 (0.0007) [2023-12-27 19:46:17,340][106225] Updated weights for policy 1, policy_version 75342 (0.0008) [2023-12-27 19:46:17,422][106226] Updated weights for policy 0, policy_version 75308 (0.0008) [2023-12-27 19:46:17,487][106226] Updated weights for policy 0, policy_version 75318 (0.0009) [2023-12-27 19:46:17,554][106226] Updated weights for policy 0, policy_version 75328 (0.0009) [2023-12-27 19:46:17,916][106225] Updated weights for policy 1, policy_version 75352 (0.0005) [2023-12-27 19:46:17,975][106225] Updated weights for policy 1, policy_version 75362 (0.0005) [2023-12-27 19:46:18,036][106225] Updated weights for policy 1, policy_version 75372 (0.0005) [2023-12-27 19:46:18,262][106226] Updated weights for policy 0, policy_version 75338 (0.0008) [2023-12-27 19:46:18,326][106226] Updated weights for policy 0, policy_version 75348 (0.0007) [2023-12-27 19:46:18,398][106226] Updated weights for policy 0, policy_version 75358 (0.0009) [2023-12-27 19:46:18,466][106226] Updated weights for policy 0, policy_version 75368 (0.0009) [2023-12-27 19:46:18,600][106225] Updated weights for policy 1, policy_version 75382 (0.0007) [2023-12-27 19:46:18,656][106225] Updated weights for policy 1, policy_version 75392 (0.0008) [2023-12-27 19:46:18,701][106225] Updated weights for policy 1, policy_version 75402 (0.0008) [2023-12-27 19:46:19,155][106226] Updated weights for policy 0, policy_version 75378 (0.0005) [2023-12-27 19:46:19,214][106226] Updated weights for policy 0, policy_version 75388 (0.0007) [2023-12-27 19:46:19,284][106226] Updated weights for policy 0, policy_version 75398 (0.0010) [2023-12-27 19:46:19,479][106225] Updated weights for policy 1, policy_version 75412 (0.0008) [2023-12-27 19:46:19,549][106225] Updated weights for policy 1, policy_version 75422 (0.0008) [2023-12-27 19:46:19,614][106225] Updated weights for policy 1, policy_version 75432 (0.0008) [2023-12-27 19:46:20,009][106226] Updated weights for policy 0, policy_version 75408 (0.0009) [2023-12-27 19:46:20,077][106226] Updated weights for policy 0, policy_version 75418 (0.0009) [2023-12-27 19:46:20,142][106226] Updated weights for policy 0, policy_version 75428 (0.0009) [2023-12-27 19:46:20,365][106225] Updated weights for policy 1, policy_version 75442 (0.0008) [2023-12-27 19:46:20,429][106225] Updated weights for policy 1, policy_version 75452 (0.0008) [2023-12-27 19:46:20,515][106225] Updated weights for policy 1, policy_version 75462 (0.0008) [2023-12-27 19:46:20,582][106225] Updated weights for policy 1, policy_version 75472 (0.0008) [2023-12-27 19:46:20,866][106226] Updated weights for policy 0, policy_version 75438 (0.0009) [2023-12-27 19:46:20,924][106226] Updated weights for policy 0, policy_version 75448 (0.0009) [2023-12-27 19:46:20,976][106226] Updated weights for policy 0, policy_version 75458 (0.0008) [2023-12-27 19:46:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 38649856. Throughput: 0: 9591.7, 1: 9866.5. Samples: 38658172. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:21,175][105115] Avg episode reward: [(0, '-5.216'), (1, '-6.685')] [2023-12-27 19:46:21,232][106225] Updated weights for policy 1, policy_version 75482 (0.0008) [2023-12-27 19:46:21,299][106225] Updated weights for policy 1, policy_version 75492 (0.0008) [2023-12-27 19:46:21,367][106225] Updated weights for policy 1, policy_version 75502 (0.0006) [2023-12-27 19:46:21,777][106226] Updated weights for policy 0, policy_version 75468 (0.0010) [2023-12-27 19:46:21,837][106226] Updated weights for policy 0, policy_version 75478 (0.0008) [2023-12-27 19:46:21,901][106226] Updated weights for policy 0, policy_version 75488 (0.0008) [2023-12-27 19:46:22,070][106225] Updated weights for policy 1, policy_version 75512 (0.0009) [2023-12-27 19:46:22,131][106225] Updated weights for policy 1, policy_version 75522 (0.0009) [2023-12-27 19:46:22,195][106225] Updated weights for policy 1, policy_version 75532 (0.0007) [2023-12-27 19:46:22,688][106226] Updated weights for policy 0, policy_version 75498 (0.0008) [2023-12-27 19:46:22,754][106226] Updated weights for policy 0, policy_version 75508 (0.0008) [2023-12-27 19:46:22,819][106226] Updated weights for policy 0, policy_version 75518 (0.0008) [2023-12-27 19:46:22,877][106225] Updated weights for policy 1, policy_version 75542 (0.0008) [2023-12-27 19:46:22,880][106226] Updated weights for policy 0, policy_version 75528 (0.0006) [2023-12-27 19:46:22,943][106225] Updated weights for policy 1, policy_version 75552 (0.0006) [2023-12-27 19:46:22,996][106225] Updated weights for policy 1, policy_version 75562 (0.0008) [2023-12-27 19:46:23,565][106226] Updated weights for policy 0, policy_version 75538 (0.0008) [2023-12-27 19:46:23,624][106226] Updated weights for policy 0, policy_version 75548 (0.0008) [2023-12-27 19:46:23,627][106225] Updated weights for policy 1, policy_version 75572 (0.0008) [2023-12-27 19:46:23,685][106226] Updated weights for policy 0, policy_version 75558 (0.0008) [2023-12-27 19:46:23,688][106225] Updated weights for policy 1, policy_version 75582 (0.0009) [2023-12-27 19:46:23,750][106225] Updated weights for policy 1, policy_version 75592 (0.0008) [2023-12-27 19:46:24,373][106226] Updated weights for policy 0, policy_version 75568 (0.0010) [2023-12-27 19:46:24,427][106226] Updated weights for policy 0, policy_version 75578 (0.0010) [2023-12-27 19:46:24,481][106226] Updated weights for policy 0, policy_version 75588 (0.0010) [2023-12-27 19:46:24,543][106225] Updated weights for policy 1, policy_version 75602 (0.0008) [2023-12-27 19:46:24,593][106225] Updated weights for policy 1, policy_version 75612 (0.0008) [2023-12-27 19:46:24,644][106225] Updated weights for policy 1, policy_version 75622 (0.0008) [2023-12-27 19:46:24,697][106225] Updated weights for policy 1, policy_version 75632 (0.0007) [2023-12-27 19:46:25,154][106226] Updated weights for policy 0, policy_version 75598 (0.0010) [2023-12-27 19:46:25,207][106226] Updated weights for policy 0, policy_version 75608 (0.0010) [2023-12-27 19:46:25,264][106226] Updated weights for policy 0, policy_version 75618 (0.0011) [2023-12-27 19:46:25,466][106225] Updated weights for policy 1, policy_version 75642 (0.0007) [2023-12-27 19:46:25,529][106225] Updated weights for policy 1, policy_version 75652 (0.0007) [2023-12-27 19:46:25,582][106225] Updated weights for policy 1, policy_version 75662 (0.0008) [2023-12-27 19:46:26,003][106226] Updated weights for policy 0, policy_version 75628 (0.0011) [2023-12-27 19:46:26,062][106226] Updated weights for policy 0, policy_version 75638 (0.0011) [2023-12-27 19:46:26,109][106226] Updated weights for policy 0, policy_version 75648 (0.0010) [2023-12-27 19:46:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 38748160. Throughput: 0: 9581.4, 1: 9878.9. Samples: 38716920. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:26,175][105115] Avg episode reward: [(0, '-5.623'), (1, '-6.465')] [2023-12-27 19:46:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000075664_19374080.pth... [2023-12-27 19:46:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000075656_19374080.pth... [2023-12-27 19:46:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000074504_19079168.pth [2023-12-27 19:46:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000074512_19079168.pth [2023-12-27 19:46:26,296][106225] Updated weights for policy 1, policy_version 75672 (0.0007) [2023-12-27 19:46:26,347][106225] Updated weights for policy 1, policy_version 75682 (0.0008) [2023-12-27 19:46:26,409][106225] Updated weights for policy 1, policy_version 75692 (0.0005) [2023-12-27 19:46:26,783][106226] Updated weights for policy 0, policy_version 75658 (0.0009) [2023-12-27 19:46:26,847][106226] Updated weights for policy 0, policy_version 75668 (0.0006) [2023-12-27 19:46:26,908][106226] Updated weights for policy 0, policy_version 75678 (0.0008) [2023-12-27 19:46:26,965][106226] Updated weights for policy 0, policy_version 75688 (0.0008) [2023-12-27 19:46:27,008][106225] Updated weights for policy 1, policy_version 75702 (0.0008) [2023-12-27 19:46:27,067][106225] Updated weights for policy 1, policy_version 75712 (0.0010) [2023-12-27 19:46:27,119][106225] Updated weights for policy 1, policy_version 75722 (0.0010) [2023-12-27 19:46:27,575][106226] Updated weights for policy 0, policy_version 75698 (0.0005) [2023-12-27 19:46:27,630][106226] Updated weights for policy 0, policy_version 75708 (0.0007) [2023-12-27 19:46:27,685][106226] Updated weights for policy 0, policy_version 75718 (0.0006) [2023-12-27 19:46:27,808][106225] Updated weights for policy 1, policy_version 75732 (0.0010) [2023-12-27 19:46:27,865][106225] Updated weights for policy 1, policy_version 75742 (0.0006) [2023-12-27 19:46:27,918][106225] Updated weights for policy 1, policy_version 75752 (0.0005) [2023-12-27 19:46:28,218][106226] Updated weights for policy 0, policy_version 75728 (0.0005) [2023-12-27 19:46:28,277][106226] Updated weights for policy 0, policy_version 75738 (0.0005) [2023-12-27 19:46:28,343][106226] Updated weights for policy 0, policy_version 75748 (0.0006) [2023-12-27 19:46:28,481][106225] Updated weights for policy 1, policy_version 75762 (0.0009) [2023-12-27 19:46:28,532][106225] Updated weights for policy 1, policy_version 75772 (0.0005) [2023-12-27 19:46:28,583][106225] Updated weights for policy 1, policy_version 75782 (0.0008) [2023-12-27 19:46:28,633][106225] Updated weights for policy 1, policy_version 75792 (0.0010) [2023-12-27 19:46:28,952][106226] Updated weights for policy 0, policy_version 75758 (0.0007) [2023-12-27 19:46:29,013][106226] Updated weights for policy 0, policy_version 75768 (0.0008) [2023-12-27 19:46:29,073][106226] Updated weights for policy 0, policy_version 75778 (0.0008) [2023-12-27 19:46:29,356][106225] Updated weights for policy 1, policy_version 75802 (0.0009) [2023-12-27 19:46:29,427][106225] Updated weights for policy 1, policy_version 75812 (0.0007) [2023-12-27 19:46:29,489][106225] Updated weights for policy 1, policy_version 75822 (0.0010) [2023-12-27 19:46:29,718][106226] Updated weights for policy 0, policy_version 75788 (0.0007) [2023-12-27 19:46:29,785][106226] Updated weights for policy 0, policy_version 75798 (0.0005) [2023-12-27 19:46:29,856][106226] Updated weights for policy 0, policy_version 75808 (0.0008) [2023-12-27 19:46:30,217][106225] Updated weights for policy 1, policy_version 75832 (0.0009) [2023-12-27 19:46:30,278][106225] Updated weights for policy 1, policy_version 75842 (0.0007) [2023-12-27 19:46:30,325][106225] Updated weights for policy 1, policy_version 75852 (0.0010) [2023-12-27 19:46:30,432][106226] Updated weights for policy 0, policy_version 75818 (0.0007) [2023-12-27 19:46:30,489][106226] Updated weights for policy 0, policy_version 75828 (0.0005) [2023-12-27 19:46:30,544][106226] Updated weights for policy 0, policy_version 75838 (0.0005) [2023-12-27 19:46:30,600][106226] Updated weights for policy 0, policy_version 75848 (0.0005) [2023-12-27 19:46:31,016][106225] Updated weights for policy 1, policy_version 75862 (0.0011) [2023-12-27 19:46:31,084][106225] Updated weights for policy 1, policy_version 75872 (0.0010) [2023-12-27 19:46:31,107][106226] Updated weights for policy 0, policy_version 75858 (0.0009) [2023-12-27 19:46:31,155][106225] Updated weights for policy 1, policy_version 75882 (0.0010) [2023-12-27 19:46:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 38846464. Throughput: 0: 9795.9, 1: 9951.1. Samples: 38841700. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:31,175][105115] Avg episode reward: [(0, '-5.600'), (1, '-6.349')] [2023-12-27 19:46:31,176][106226] Updated weights for policy 0, policy_version 75868 (0.0008) [2023-12-27 19:46:31,235][106226] Updated weights for policy 0, policy_version 75878 (0.0008) [2023-12-27 19:46:31,890][106225] Updated weights for policy 1, policy_version 75892 (0.0010) [2023-12-27 19:46:31,948][106225] Updated weights for policy 1, policy_version 75902 (0.0009) [2023-12-27 19:46:31,989][106226] Updated weights for policy 0, policy_version 75888 (0.0006) [2023-12-27 19:46:32,002][106225] Updated weights for policy 1, policy_version 75912 (0.0010) [2023-12-27 19:46:32,050][106226] Updated weights for policy 0, policy_version 75898 (0.0006) [2023-12-27 19:46:32,117][106226] Updated weights for policy 0, policy_version 75908 (0.0008) [2023-12-27 19:46:32,759][106225] Updated weights for policy 1, policy_version 75922 (0.0010) [2023-12-27 19:46:32,789][106226] Updated weights for policy 0, policy_version 75918 (0.0006) [2023-12-27 19:46:32,823][106225] Updated weights for policy 1, policy_version 75932 (0.0007) [2023-12-27 19:46:32,847][106226] Updated weights for policy 0, policy_version 75928 (0.0007) [2023-12-27 19:46:32,893][106225] Updated weights for policy 1, policy_version 75942 (0.0005) [2023-12-27 19:46:32,906][106226] Updated weights for policy 0, policy_version 75938 (0.0007) [2023-12-27 19:46:32,954][106225] Updated weights for policy 1, policy_version 75952 (0.0005) [2023-12-27 19:46:33,461][106225] Updated weights for policy 1, policy_version 75962 (0.0005) [2023-12-27 19:46:33,507][106225] Updated weights for policy 1, policy_version 75972 (0.0005) [2023-12-27 19:46:33,553][106225] Updated weights for policy 1, policy_version 75982 (0.0006) [2023-12-27 19:46:33,640][106226] Updated weights for policy 0, policy_version 75948 (0.0008) [2023-12-27 19:46:33,687][106226] Updated weights for policy 0, policy_version 75958 (0.0009) [2023-12-27 19:46:33,735][106226] Updated weights for policy 0, policy_version 75968 (0.0009) [2023-12-27 19:46:34,108][106225] Updated weights for policy 1, policy_version 75992 (0.0006) [2023-12-27 19:46:34,189][106225] Updated weights for policy 1, policy_version 76002 (0.0008) [2023-12-27 19:46:34,249][106225] Updated weights for policy 1, policy_version 76012 (0.0008) [2023-12-27 19:46:34,521][106226] Updated weights for policy 0, policy_version 75978 (0.0009) [2023-12-27 19:46:34,584][106226] Updated weights for policy 0, policy_version 75988 (0.0009) [2023-12-27 19:46:34,646][106226] Updated weights for policy 0, policy_version 75998 (0.0008) [2023-12-27 19:46:34,699][106226] Updated weights for policy 0, policy_version 76008 (0.0008) [2023-12-27 19:46:34,955][106225] Updated weights for policy 1, policy_version 76022 (0.0007) [2023-12-27 19:46:35,018][106225] Updated weights for policy 1, policy_version 76032 (0.0005) [2023-12-27 19:46:35,071][106225] Updated weights for policy 1, policy_version 76042 (0.0008) [2023-12-27 19:46:35,364][106226] Updated weights for policy 0, policy_version 76018 (0.0007) [2023-12-27 19:46:35,417][106226] Updated weights for policy 0, policy_version 76028 (0.0008) [2023-12-27 19:46:35,465][106226] Updated weights for policy 0, policy_version 76038 (0.0008) [2023-12-27 19:46:35,631][106225] Updated weights for policy 1, policy_version 76052 (0.0005) [2023-12-27 19:46:35,689][106225] Updated weights for policy 1, policy_version 76062 (0.0005) [2023-12-27 19:46:35,744][106225] Updated weights for policy 1, policy_version 76072 (0.0006) [2023-12-27 19:46:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 38952960. Throughput: 0: 9896.1, 1: 10083.3. Samples: 38965152. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:36,175][105115] Avg episode reward: [(0, '-5.508'), (1, '-6.403')] [2023-12-27 19:46:36,241][106226] Updated weights for policy 0, policy_version 76048 (0.0009) [2023-12-27 19:46:36,301][106226] Updated weights for policy 0, policy_version 76058 (0.0008) [2023-12-27 19:46:36,365][106226] Updated weights for policy 0, policy_version 76068 (0.0009) [2023-12-27 19:46:36,373][106225] Updated weights for policy 1, policy_version 76082 (0.0008) [2023-12-27 19:46:36,432][106225] Updated weights for policy 1, policy_version 76092 (0.0008) [2023-12-27 19:46:36,497][106225] Updated weights for policy 1, policy_version 76102 (0.0009) [2023-12-27 19:46:36,562][106225] Updated weights for policy 1, policy_version 76112 (0.0008) [2023-12-27 19:46:37,093][106226] Updated weights for policy 0, policy_version 76078 (0.0008) [2023-12-27 19:46:37,152][106226] Updated weights for policy 0, policy_version 76088 (0.0009) [2023-12-27 19:46:37,216][106226] Updated weights for policy 0, policy_version 76098 (0.0009) [2023-12-27 19:46:37,285][106225] Updated weights for policy 1, policy_version 76122 (0.0007) [2023-12-27 19:46:37,337][106225] Updated weights for policy 1, policy_version 76132 (0.0008) [2023-12-27 19:46:37,393][106225] Updated weights for policy 1, policy_version 76142 (0.0008) [2023-12-27 19:46:37,983][106226] Updated weights for policy 0, policy_version 76108 (0.0009) [2023-12-27 19:46:38,039][106226] Updated weights for policy 0, policy_version 76118 (0.0008) [2023-12-27 19:46:38,060][106225] Updated weights for policy 1, policy_version 76152 (0.0008) [2023-12-27 19:46:38,100][106226] Updated weights for policy 0, policy_version 76128 (0.0008) [2023-12-27 19:46:38,117][106225] Updated weights for policy 1, policy_version 76162 (0.0007) [2023-12-27 19:46:38,172][106225] Updated weights for policy 1, policy_version 76172 (0.0007) [2023-12-27 19:46:38,820][106226] Updated weights for policy 0, policy_version 76138 (0.0009) [2023-12-27 19:46:38,871][106226] Updated weights for policy 0, policy_version 76148 (0.0008) [2023-12-27 19:46:38,918][106226] Updated weights for policy 0, policy_version 76158 (0.0005) [2023-12-27 19:46:38,946][106225] Updated weights for policy 1, policy_version 76182 (0.0009) [2023-12-27 19:46:38,974][106226] Updated weights for policy 0, policy_version 76168 (0.0006) [2023-12-27 19:46:38,999][106225] Updated weights for policy 1, policy_version 76192 (0.0008) [2023-12-27 19:46:39,053][106225] Updated weights for policy 1, policy_version 76202 (0.0008) [2023-12-27 19:46:39,745][106226] Updated weights for policy 0, policy_version 76178 (0.0008) [2023-12-27 19:46:39,804][106225] Updated weights for policy 1, policy_version 76212 (0.0007) [2023-12-27 19:46:39,812][106226] Updated weights for policy 0, policy_version 76188 (0.0008) [2023-12-27 19:46:39,868][106225] Updated weights for policy 1, policy_version 76222 (0.0008) [2023-12-27 19:46:39,887][106226] Updated weights for policy 0, policy_version 76198 (0.0007) [2023-12-27 19:46:39,941][106225] Updated weights for policy 1, policy_version 76232 (0.0008) [2023-12-27 19:46:40,619][106226] Updated weights for policy 0, policy_version 76208 (0.0009) [2023-12-27 19:46:40,679][106226] Updated weights for policy 0, policy_version 76218 (0.0009) [2023-12-27 19:46:40,686][106225] Updated weights for policy 1, policy_version 76242 (0.0008) [2023-12-27 19:46:40,735][106226] Updated weights for policy 0, policy_version 76228 (0.0006) [2023-12-27 19:46:40,741][106225] Updated weights for policy 1, policy_version 76252 (0.0006) [2023-12-27 19:46:40,798][106225] Updated weights for policy 1, policy_version 76262 (0.0007) [2023-12-27 19:46:40,860][106225] Updated weights for policy 1, policy_version 76272 (0.0008) [2023-12-27 19:46:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 39051264. Throughput: 0: 9885.9, 1: 10071.1. Samples: 39022948. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:41,175][105115] Avg episode reward: [(0, '-5.677'), (1, '-6.499')] [2023-12-27 19:46:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000076272_19529728.pth... [2023-12-27 19:46:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000076232_19521536.pth... [2023-12-27 19:46:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000075088_19226624.pth [2023-12-27 19:46:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000075080_19226624.pth [2023-12-27 19:46:41,521][106226] Updated weights for policy 0, policy_version 76238 (0.0008) [2023-12-27 19:46:41,583][106226] Updated weights for policy 0, policy_version 76248 (0.0009) [2023-12-27 19:46:41,648][106226] Updated weights for policy 0, policy_version 76258 (0.0008) [2023-12-27 19:46:41,659][106225] Updated weights for policy 1, policy_version 76282 (0.0008) [2023-12-27 19:46:41,723][106225] Updated weights for policy 1, policy_version 76292 (0.0009) [2023-12-27 19:46:41,791][106225] Updated weights for policy 1, policy_version 76302 (0.0009) [2023-12-27 19:46:42,442][106226] Updated weights for policy 0, policy_version 76268 (0.0006) [2023-12-27 19:46:42,499][106226] Updated weights for policy 0, policy_version 76278 (0.0006) [2023-12-27 19:46:42,516][106225] Updated weights for policy 1, policy_version 76312 (0.0010) [2023-12-27 19:46:42,555][106226] Updated weights for policy 0, policy_version 76288 (0.0007) [2023-12-27 19:46:42,579][106225] Updated weights for policy 1, policy_version 76322 (0.0009) [2023-12-27 19:46:42,644][106225] Updated weights for policy 1, policy_version 76332 (0.0010) [2023-12-27 19:46:43,218][106225] Updated weights for policy 1, policy_version 76342 (0.0010) [2023-12-27 19:46:43,280][106225] Updated weights for policy 1, policy_version 76352 (0.0010) [2023-12-27 19:46:43,324][106226] Updated weights for policy 0, policy_version 76298 (0.0007) [2023-12-27 19:46:43,337][106225] Updated weights for policy 1, policy_version 76362 (0.0010) [2023-12-27 19:46:43,375][106226] Updated weights for policy 0, policy_version 76308 (0.0006) [2023-12-27 19:46:43,437][106226] Updated weights for policy 0, policy_version 76318 (0.0009) [2023-12-27 19:46:43,485][106226] Updated weights for policy 0, policy_version 76328 (0.0007) [2023-12-27 19:46:44,027][106225] Updated weights for policy 1, policy_version 76372 (0.0009) [2023-12-27 19:46:44,080][106225] Updated weights for policy 1, policy_version 76382 (0.0010) [2023-12-27 19:46:44,136][106225] Updated weights for policy 1, policy_version 76392 (0.0010) [2023-12-27 19:46:44,219][106226] Updated weights for policy 0, policy_version 76338 (0.0007) [2023-12-27 19:46:44,265][106226] Updated weights for policy 0, policy_version 76348 (0.0008) [2023-12-27 19:46:44,316][106226] Updated weights for policy 0, policy_version 76358 (0.0008) [2023-12-27 19:46:44,768][106225] Updated weights for policy 1, policy_version 76402 (0.0010) [2023-12-27 19:46:44,836][106225] Updated weights for policy 1, policy_version 76412 (0.0009) [2023-12-27 19:46:44,898][106225] Updated weights for policy 1, policy_version 76422 (0.0010) [2023-12-27 19:46:44,953][106225] Updated weights for policy 1, policy_version 76432 (0.0011) [2023-12-27 19:46:45,129][106226] Updated weights for policy 0, policy_version 76368 (0.0010) [2023-12-27 19:46:45,192][106226] Updated weights for policy 0, policy_version 76378 (0.0010) [2023-12-27 19:46:45,254][106226] Updated weights for policy 0, policy_version 76388 (0.0009) [2023-12-27 19:46:45,637][106225] Updated weights for policy 1, policy_version 76442 (0.0010) [2023-12-27 19:46:45,691][106225] Updated weights for policy 1, policy_version 76452 (0.0010) [2023-12-27 19:46:45,753][106225] Updated weights for policy 1, policy_version 76462 (0.0010) [2023-12-27 19:46:46,010][106226] Updated weights for policy 0, policy_version 76398 (0.0008) [2023-12-27 19:46:46,065][106226] Updated weights for policy 0, policy_version 76408 (0.0006) [2023-12-27 19:46:46,129][106226] Updated weights for policy 0, policy_version 76418 (0.0005) [2023-12-27 19:46:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 39149568. Throughput: 0: 9849.7, 1: 10024.8. Samples: 39136808. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:46,175][105115] Avg episode reward: [(0, '-5.454'), (1, '-6.444')] [2023-12-27 19:46:46,472][106225] Updated weights for policy 1, policy_version 76472 (0.0007) [2023-12-27 19:46:46,523][106225] Updated weights for policy 1, policy_version 76482 (0.0009) [2023-12-27 19:46:46,577][106225] Updated weights for policy 1, policy_version 76492 (0.0008) [2023-12-27 19:46:46,717][106226] Updated weights for policy 0, policy_version 76428 (0.0006) [2023-12-27 19:46:46,764][106226] Updated weights for policy 0, policy_version 76438 (0.0005) [2023-12-27 19:46:46,818][106226] Updated weights for policy 0, policy_version 76448 (0.0008) [2023-12-27 19:46:47,294][106225] Updated weights for policy 1, policy_version 76502 (0.0010) [2023-12-27 19:46:47,353][106225] Updated weights for policy 1, policy_version 76512 (0.0010) [2023-12-27 19:46:47,413][106225] Updated weights for policy 1, policy_version 76522 (0.0010) [2023-12-27 19:46:47,510][106226] Updated weights for policy 0, policy_version 76458 (0.0008) [2023-12-27 19:46:47,567][106226] Updated weights for policy 0, policy_version 76468 (0.0006) [2023-12-27 19:46:47,624][106226] Updated weights for policy 0, policy_version 76478 (0.0005) [2023-12-27 19:46:47,684][106226] Updated weights for policy 0, policy_version 76488 (0.0005) [2023-12-27 19:46:48,112][106225] Updated weights for policy 1, policy_version 76532 (0.0010) [2023-12-27 19:46:48,162][106225] Updated weights for policy 1, policy_version 76542 (0.0010) [2023-12-27 19:46:48,219][106225] Updated weights for policy 1, policy_version 76552 (0.0010) [2023-12-27 19:46:48,220][106226] Updated weights for policy 0, policy_version 76498 (0.0007) [2023-12-27 19:46:48,276][106226] Updated weights for policy 0, policy_version 76508 (0.0005) [2023-12-27 19:46:48,338][106226] Updated weights for policy 0, policy_version 76518 (0.0007) [2023-12-27 19:46:48,950][106225] Updated weights for policy 1, policy_version 76562 (0.0010) [2023-12-27 19:46:49,002][106225] Updated weights for policy 1, policy_version 76572 (0.0007) [2023-12-27 19:46:49,004][106226] Updated weights for policy 0, policy_version 76528 (0.0007) [2023-12-27 19:46:49,055][106225] Updated weights for policy 1, policy_version 76582 (0.0007) [2023-12-27 19:46:49,064][106226] Updated weights for policy 0, policy_version 76538 (0.0010) [2023-12-27 19:46:49,105][106225] Updated weights for policy 1, policy_version 76592 (0.0009) [2023-12-27 19:46:49,123][106226] Updated weights for policy 0, policy_version 76548 (0.0010) [2023-12-27 19:46:49,749][106226] Updated weights for policy 0, policy_version 76558 (0.0008) [2023-12-27 19:46:49,815][106226] Updated weights for policy 0, policy_version 76568 (0.0006) [2023-12-27 19:46:49,884][106226] Updated weights for policy 0, policy_version 76578 (0.0007) [2023-12-27 19:46:49,921][106225] Updated weights for policy 1, policy_version 76602 (0.0009) [2023-12-27 19:46:50,005][106225] Updated weights for policy 1, policy_version 76612 (0.0008) [2023-12-27 19:46:50,066][106225] Updated weights for policy 1, policy_version 76622 (0.0008) [2023-12-27 19:46:50,533][106226] Updated weights for policy 0, policy_version 76588 (0.0007) [2023-12-27 19:46:50,612][106226] Updated weights for policy 0, policy_version 76598 (0.0009) [2023-12-27 19:46:50,669][106226] Updated weights for policy 0, policy_version 76608 (0.0011) [2023-12-27 19:46:50,847][106225] Updated weights for policy 1, policy_version 76632 (0.0008) [2023-12-27 19:46:50,898][106225] Updated weights for policy 1, policy_version 76642 (0.0008) [2023-12-27 19:46:50,954][106225] Updated weights for policy 1, policy_version 76652 (0.0008) [2023-12-27 19:46:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 39247872. Throughput: 0: 9881.8, 1: 9964.8. Samples: 39255808. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:51,175][105115] Avg episode reward: [(0, '-5.335'), (1, '-6.592')] [2023-12-27 19:46:51,430][106226] Updated weights for policy 0, policy_version 76618 (0.0010) [2023-12-27 19:46:51,495][106226] Updated weights for policy 0, policy_version 76628 (0.0008) [2023-12-27 19:46:51,555][106226] Updated weights for policy 0, policy_version 76638 (0.0008) [2023-12-27 19:46:51,624][106226] Updated weights for policy 0, policy_version 76648 (0.0009) [2023-12-27 19:46:51,752][106225] Updated weights for policy 1, policy_version 76662 (0.0009) [2023-12-27 19:46:51,817][106225] Updated weights for policy 1, policy_version 76672 (0.0009) [2023-12-27 19:46:51,877][106225] Updated weights for policy 1, policy_version 76682 (0.0010) [2023-12-27 19:46:52,354][106226] Updated weights for policy 0, policy_version 76658 (0.0010) [2023-12-27 19:46:52,424][106226] Updated weights for policy 0, policy_version 76668 (0.0011) [2023-12-27 19:46:52,483][106226] Updated weights for policy 0, policy_version 76678 (0.0010) [2023-12-27 19:46:52,651][106225] Updated weights for policy 1, policy_version 76692 (0.0010) [2023-12-27 19:46:52,702][106225] Updated weights for policy 1, policy_version 76702 (0.0008) [2023-12-27 19:46:52,752][106225] Updated weights for policy 1, policy_version 76712 (0.0007) [2023-12-27 19:46:53,081][106226] Updated weights for policy 0, policy_version 76688 (0.0006) [2023-12-27 19:46:53,142][106226] Updated weights for policy 0, policy_version 76698 (0.0005) [2023-12-27 19:46:53,210][106226] Updated weights for policy 0, policy_version 76708 (0.0005) [2023-12-27 19:46:53,399][106225] Updated weights for policy 1, policy_version 76722 (0.0008) [2023-12-27 19:46:53,443][106225] Updated weights for policy 1, policy_version 76732 (0.0005) [2023-12-27 19:46:53,490][106225] Updated weights for policy 1, policy_version 76742 (0.0005) [2023-12-27 19:46:53,549][106225] Updated weights for policy 1, policy_version 76752 (0.0005) [2023-12-27 19:46:53,719][106226] Updated weights for policy 0, policy_version 76718 (0.0007) [2023-12-27 19:46:53,775][106226] Updated weights for policy 0, policy_version 76728 (0.0006) [2023-12-27 19:46:53,826][106226] Updated weights for policy 0, policy_version 76738 (0.0009) [2023-12-27 19:46:54,251][106225] Updated weights for policy 1, policy_version 76762 (0.0006) [2023-12-27 19:46:54,315][106225] Updated weights for policy 1, policy_version 76772 (0.0009) [2023-12-27 19:46:54,373][106225] Updated weights for policy 1, policy_version 76782 (0.0011) [2023-12-27 19:46:54,493][106226] Updated weights for policy 0, policy_version 76748 (0.0006) [2023-12-27 19:46:54,541][106226] Updated weights for policy 0, policy_version 76758 (0.0008) [2023-12-27 19:46:54,594][106226] Updated weights for policy 0, policy_version 76768 (0.0008) [2023-12-27 19:46:55,031][106225] Updated weights for policy 1, policy_version 76792 (0.0007) [2023-12-27 19:46:55,089][106225] Updated weights for policy 1, policy_version 76802 (0.0007) [2023-12-27 19:46:55,152][106225] Updated weights for policy 1, policy_version 76812 (0.0008) [2023-12-27 19:46:55,164][106226] Updated weights for policy 0, policy_version 76778 (0.0008) [2023-12-27 19:46:55,224][106226] Updated weights for policy 0, policy_version 76788 (0.0008) [2023-12-27 19:46:55,284][106226] Updated weights for policy 0, policy_version 76798 (0.0009) [2023-12-27 19:46:55,340][106226] Updated weights for policy 0, policy_version 76808 (0.0009) [2023-12-27 19:46:55,744][106225] Updated weights for policy 1, policy_version 76822 (0.0007) [2023-12-27 19:46:55,790][106225] Updated weights for policy 1, policy_version 76832 (0.0010) [2023-12-27 19:46:55,843][106225] Updated weights for policy 1, policy_version 76842 (0.0005) [2023-12-27 19:46:56,009][106226] Updated weights for policy 0, policy_version 76818 (0.0008) [2023-12-27 19:46:56,065][106226] Updated weights for policy 0, policy_version 76828 (0.0007) [2023-12-27 19:46:56,121][106226] Updated weights for policy 0, policy_version 76838 (0.0008) [2023-12-27 19:46:56,175][105115] Fps is (10 sec: 20478.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 39354368. Throughput: 0: 9909.9, 1: 9973.9. Samples: 39316612. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:46:56,176][105115] Avg episode reward: [(0, '-5.351'), (1, '-6.435')] [2023-12-27 19:46:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000076840_19677184.pth... [2023-12-27 19:46:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000076848_19677184.pth... [2023-12-27 19:46:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000075656_19374080.pth [2023-12-27 19:46:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000075664_19374080.pth [2023-12-27 19:46:56,520][106225] Updated weights for policy 1, policy_version 76852 (0.0006) [2023-12-27 19:46:56,568][106225] Updated weights for policy 1, policy_version 76862 (0.0005) [2023-12-27 19:46:56,637][106225] Updated weights for policy 1, policy_version 76872 (0.0005) [2023-12-27 19:46:56,763][106226] Updated weights for policy 0, policy_version 76848 (0.0009) [2023-12-27 19:46:56,817][106226] Updated weights for policy 0, policy_version 76858 (0.0009) [2023-12-27 19:46:56,876][106226] Updated weights for policy 0, policy_version 76868 (0.0008) [2023-12-27 19:46:57,145][106225] Updated weights for policy 1, policy_version 76882 (0.0005) [2023-12-27 19:46:57,207][106225] Updated weights for policy 1, policy_version 76892 (0.0005) [2023-12-27 19:46:57,271][106225] Updated weights for policy 1, policy_version 76902 (0.0005) [2023-12-27 19:46:57,332][106225] Updated weights for policy 1, policy_version 76912 (0.0005) [2023-12-27 19:46:57,529][106226] Updated weights for policy 0, policy_version 76878 (0.0009) [2023-12-27 19:46:57,588][106226] Updated weights for policy 0, policy_version 76888 (0.0008) [2023-12-27 19:46:57,653][106226] Updated weights for policy 0, policy_version 76898 (0.0009) [2023-12-27 19:46:57,951][106225] Updated weights for policy 1, policy_version 76922 (0.0009) [2023-12-27 19:46:58,008][106225] Updated weights for policy 1, policy_version 76932 (0.0008) [2023-12-27 19:46:58,066][106225] Updated weights for policy 1, policy_version 76942 (0.0008) [2023-12-27 19:46:58,395][106226] Updated weights for policy 0, policy_version 76908 (0.0009) [2023-12-27 19:46:58,449][106226] Updated weights for policy 0, policy_version 76918 (0.0008) [2023-12-27 19:46:58,514][106226] Updated weights for policy 0, policy_version 76928 (0.0008) [2023-12-27 19:46:58,762][106225] Updated weights for policy 1, policy_version 76952 (0.0007) [2023-12-27 19:46:58,829][106225] Updated weights for policy 1, policy_version 76962 (0.0007) [2023-12-27 19:46:58,900][106225] Updated weights for policy 1, policy_version 76972 (0.0008) [2023-12-27 19:46:59,429][106226] Updated weights for policy 0, policy_version 76938 (0.0008) [2023-12-27 19:46:59,495][106226] Updated weights for policy 0, policy_version 76948 (0.0005) [2023-12-27 19:46:59,556][106226] Updated weights for policy 0, policy_version 76958 (0.0005) [2023-12-27 19:46:59,621][106226] Updated weights for policy 0, policy_version 76968 (0.0005) [2023-12-27 19:46:59,692][106225] Updated weights for policy 1, policy_version 76982 (0.0010) [2023-12-27 19:46:59,747][106225] Updated weights for policy 1, policy_version 76992 (0.0009) [2023-12-27 19:46:59,809][106225] Updated weights for policy 1, policy_version 77002 (0.0009) [2023-12-27 19:47:00,232][106226] Updated weights for policy 0, policy_version 76978 (0.0006) [2023-12-27 19:47:00,291][106226] Updated weights for policy 0, policy_version 76988 (0.0010) [2023-12-27 19:47:00,356][106226] Updated weights for policy 0, policy_version 76998 (0.0011) [2023-12-27 19:47:00,562][106225] Updated weights for policy 1, policy_version 77012 (0.0009) [2023-12-27 19:47:00,624][106225] Updated weights for policy 1, policy_version 77022 (0.0008) [2023-12-27 19:47:00,683][106225] Updated weights for policy 1, policy_version 77032 (0.0008) [2023-12-27 19:47:01,047][106226] Updated weights for policy 0, policy_version 77008 (0.0010) [2023-12-27 19:47:01,113][106226] Updated weights for policy 0, policy_version 77018 (0.0009) [2023-12-27 19:47:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 39444480. Throughput: 0: 9960.5, 1: 10048.6. Samples: 39439848. Policy #0 lag: (min: 19.0, avg: 30.8, max: 51.0) [2023-12-27 19:47:01,175][105115] Avg episode reward: [(0, '-5.384'), (1, '-6.731')] [2023-12-27 19:47:01,183][106226] Updated weights for policy 0, policy_version 77028 (0.0009) [2023-12-27 19:47:01,462][106225] Updated weights for policy 1, policy_version 77042 (0.0008) [2023-12-27 19:47:01,521][106225] Updated weights for policy 1, policy_version 77052 (0.0010) [2023-12-27 19:47:01,585][106225] Updated weights for policy 1, policy_version 77062 (0.0008) [2023-12-27 19:47:01,653][106225] Updated weights for policy 1, policy_version 77072 (0.0008) [2023-12-27 19:47:01,843][106226] Updated weights for policy 0, policy_version 77038 (0.0009) [2023-12-27 19:47:01,901][106226] Updated weights for policy 0, policy_version 77048 (0.0008) [2023-12-27 19:47:01,966][106226] Updated weights for policy 0, policy_version 77058 (0.0008) [2023-12-27 19:47:02,324][106225] Updated weights for policy 1, policy_version 77082 (0.0007) [2023-12-27 19:47:02,387][106225] Updated weights for policy 1, policy_version 77092 (0.0007) [2023-12-27 19:47:02,439][106225] Updated weights for policy 1, policy_version 77102 (0.0009) [2023-12-27 19:47:02,649][106226] Updated weights for policy 0, policy_version 77068 (0.0007) [2023-12-27 19:47:02,707][106226] Updated weights for policy 0, policy_version 77078 (0.0009) [2023-12-27 19:47:02,769][106226] Updated weights for policy 0, policy_version 77088 (0.0008) [2023-12-27 19:47:03,097][106225] Updated weights for policy 1, policy_version 77112 (0.0008) [2023-12-27 19:47:03,148][106225] Updated weights for policy 1, policy_version 77122 (0.0007) [2023-12-27 19:47:03,197][106225] Updated weights for policy 1, policy_version 77133 (0.0009) [2023-12-27 19:47:03,343][106226] Updated weights for policy 0, policy_version 77098 (0.0009) [2023-12-27 19:47:03,408][106226] Updated weights for policy 0, policy_version 77109 (0.0009) [2023-12-27 19:47:03,459][106226] Updated weights for policy 0, policy_version 77120 (0.0009) [2023-12-27 19:47:03,791][106225] Updated weights for policy 1, policy_version 77143 (0.0010) [2023-12-27 19:47:03,851][106225] Updated weights for policy 1, policy_version 77153 (0.0008) [2023-12-27 19:47:03,910][106225] Updated weights for policy 1, policy_version 77163 (0.0008) [2023-12-27 19:47:04,191][106226] Updated weights for policy 0, policy_version 77130 (0.0009) [2023-12-27 19:47:04,250][106226] Updated weights for policy 0, policy_version 77140 (0.0006) [2023-12-27 19:47:04,308][106226] Updated weights for policy 0, policy_version 77150 (0.0006) [2023-12-27 19:47:04,370][106226] Updated weights for policy 0, policy_version 77160 (0.0006) [2023-12-27 19:47:04,698][106225] Updated weights for policy 1, policy_version 77173 (0.0007) [2023-12-27 19:47:04,761][106225] Updated weights for policy 1, policy_version 77183 (0.0008) [2023-12-27 19:47:04,814][106225] Updated weights for policy 1, policy_version 77193 (0.0008) [2023-12-27 19:47:04,961][106226] Updated weights for policy 0, policy_version 77170 (0.0008) [2023-12-27 19:47:05,019][106226] Updated weights for policy 0, policy_version 77180 (0.0008) [2023-12-27 19:47:05,075][106226] Updated weights for policy 0, policy_version 77190 (0.0006) [2023-12-27 19:47:05,484][106225] Updated weights for policy 1, policy_version 77203 (0.0008) [2023-12-27 19:47:05,549][106225] Updated weights for policy 1, policy_version 77213 (0.0005) [2023-12-27 19:47:05,601][106225] Updated weights for policy 1, policy_version 77223 (0.0005) [2023-12-27 19:47:05,697][106226] Updated weights for policy 0, policy_version 77200 (0.0008) [2023-12-27 19:47:05,758][106226] Updated weights for policy 0, policy_version 77210 (0.0008) [2023-12-27 19:47:05,816][106226] Updated weights for policy 0, policy_version 77220 (0.0009) [2023-12-27 19:47:06,175][105115] Fps is (10 sec: 19661.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 39550976. Throughput: 0: 10067.5, 1: 10019.4. Samples: 39562080. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:06,175][105115] Avg episode reward: [(0, '-5.776'), (1, '-6.612')] [2023-12-27 19:47:06,195][106225] Updated weights for policy 1, policy_version 77233 (0.0005) [2023-12-27 19:47:06,263][106225] Updated weights for policy 1, policy_version 77243 (0.0008) [2023-12-27 19:47:06,328][106225] Updated weights for policy 1, policy_version 77253 (0.0008) [2023-12-27 19:47:06,392][106225] Updated weights for policy 1, policy_version 77263 (0.0009) [2023-12-27 19:47:06,537][106226] Updated weights for policy 0, policy_version 77230 (0.0009) [2023-12-27 19:47:06,599][106226] Updated weights for policy 0, policy_version 77240 (0.0009) [2023-12-27 19:47:06,663][106226] Updated weights for policy 0, policy_version 77250 (0.0009) [2023-12-27 19:47:07,030][106225] Updated weights for policy 1, policy_version 77273 (0.0006) [2023-12-27 19:47:07,094][106225] Updated weights for policy 1, policy_version 77283 (0.0006) [2023-12-27 19:47:07,160][106225] Updated weights for policy 1, policy_version 77293 (0.0005) [2023-12-27 19:47:07,473][106226] Updated weights for policy 0, policy_version 77260 (0.0009) [2023-12-27 19:47:07,536][106226] Updated weights for policy 0, policy_version 77270 (0.0009) [2023-12-27 19:47:07,599][106226] Updated weights for policy 0, policy_version 77280 (0.0008) [2023-12-27 19:47:07,754][106225] Updated weights for policy 1, policy_version 77303 (0.0007) [2023-12-27 19:47:07,822][106225] Updated weights for policy 1, policy_version 77313 (0.0007) [2023-12-27 19:47:07,882][106225] Updated weights for policy 1, policy_version 77323 (0.0010) [2023-12-27 19:47:08,394][106226] Updated weights for policy 0, policy_version 77290 (0.0008) [2023-12-27 19:47:08,456][106226] Updated weights for policy 0, policy_version 77300 (0.0008) [2023-12-27 19:47:08,480][106225] Updated weights for policy 1, policy_version 77333 (0.0010) [2023-12-27 19:47:08,507][106226] Updated weights for policy 0, policy_version 77310 (0.0007) [2023-12-27 19:47:08,534][106225] Updated weights for policy 1, policy_version 77343 (0.0010) [2023-12-27 19:47:08,569][106226] Updated weights for policy 0, policy_version 77320 (0.0010) [2023-12-27 19:47:08,599][106225] Updated weights for policy 1, policy_version 77353 (0.0010) [2023-12-27 19:47:09,285][106225] Updated weights for policy 1, policy_version 77363 (0.0011) [2023-12-27 19:47:09,350][106225] Updated weights for policy 1, policy_version 77373 (0.0011) [2023-12-27 19:47:09,378][106226] Updated weights for policy 0, policy_version 77330 (0.0008) [2023-12-27 19:47:09,416][106225] Updated weights for policy 1, policy_version 77383 (0.0011) [2023-12-27 19:47:09,446][106226] Updated weights for policy 0, policy_version 77340 (0.0009) [2023-12-27 19:47:09,497][106226] Updated weights for policy 0, policy_version 77350 (0.0010) [2023-12-27 19:47:10,150][106225] Updated weights for policy 1, policy_version 77393 (0.0007) [2023-12-27 19:47:10,212][106225] Updated weights for policy 1, policy_version 77403 (0.0008) [2023-12-27 19:47:10,263][106226] Updated weights for policy 0, policy_version 77360 (0.0010) [2023-12-27 19:47:10,268][106225] Updated weights for policy 1, policy_version 77413 (0.0008) [2023-12-27 19:47:10,319][106225] Updated weights for policy 1, policy_version 77423 (0.0007) [2023-12-27 19:47:10,331][106226] Updated weights for policy 0, policy_version 77370 (0.0011) [2023-12-27 19:47:10,393][106226] Updated weights for policy 0, policy_version 77380 (0.0011) [2023-12-27 19:47:10,993][106225] Updated weights for policy 1, policy_version 77433 (0.0006) [2023-12-27 19:47:10,996][106226] Updated weights for policy 0, policy_version 77390 (0.0008) [2023-12-27 19:47:11,064][106225] Updated weights for policy 1, policy_version 77443 (0.0008) [2023-12-27 19:47:11,081][106226] Updated weights for policy 0, policy_version 77400 (0.0008) [2023-12-27 19:47:11,134][106225] Updated weights for policy 1, policy_version 77453 (0.0007) [2023-12-27 19:47:11,145][106226] Updated weights for policy 0, policy_version 77410 (0.0011) [2023-12-27 19:47:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 39649280. Throughput: 0: 10033.1, 1: 10059.0. Samples: 39621068. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:11,175][105115] Avg episode reward: [(0, '-5.284'), (1, '-6.789')] [2023-12-27 19:47:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000077456_19832832.pth... [2023-12-27 19:47:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000077416_19824640.pth... [2023-12-27 19:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000076272_19529728.pth [2023-12-27 19:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000076232_19521536.pth [2023-12-27 19:47:11,868][106225] Updated weights for policy 1, policy_version 77463 (0.0008) [2023-12-27 19:47:11,924][106225] Updated weights for policy 1, policy_version 77473 (0.0008) [2023-12-27 19:47:11,956][106226] Updated weights for policy 0, policy_version 77420 (0.0010) [2023-12-27 19:47:11,981][106225] Updated weights for policy 1, policy_version 77483 (0.0007) [2023-12-27 19:47:12,024][106226] Updated weights for policy 0, policy_version 77430 (0.0011) [2023-12-27 19:47:12,082][106226] Updated weights for policy 0, policy_version 77440 (0.0010) [2023-12-27 19:47:12,709][106225] Updated weights for policy 1, policy_version 77493 (0.0008) [2023-12-27 19:47:12,767][106225] Updated weights for policy 1, policy_version 77503 (0.0010) [2023-12-27 19:47:12,798][106226] Updated weights for policy 0, policy_version 77450 (0.0011) [2023-12-27 19:47:12,823][106225] Updated weights for policy 1, policy_version 77513 (0.0009) [2023-12-27 19:47:12,852][106226] Updated weights for policy 0, policy_version 77460 (0.0010) [2023-12-27 19:47:12,914][106226] Updated weights for policy 0, policy_version 77470 (0.0010) [2023-12-27 19:47:12,977][106226] Updated weights for policy 0, policy_version 77480 (0.0010) [2023-12-27 19:47:13,475][106225] Updated weights for policy 1, policy_version 77523 (0.0009) [2023-12-27 19:47:13,521][106225] Updated weights for policy 1, policy_version 77533 (0.0010) [2023-12-27 19:47:13,585][106225] Updated weights for policy 1, policy_version 77543 (0.0005) [2023-12-27 19:47:13,675][106226] Updated weights for policy 0, policy_version 77490 (0.0007) [2023-12-27 19:47:13,744][106226] Updated weights for policy 0, policy_version 77500 (0.0008) [2023-12-27 19:47:13,815][106226] Updated weights for policy 0, policy_version 77510 (0.0008) [2023-12-27 19:47:14,164][106225] Updated weights for policy 1, policy_version 77553 (0.0006) [2023-12-27 19:47:14,220][106225] Updated weights for policy 1, policy_version 77563 (0.0008) [2023-12-27 19:47:14,266][106225] Updated weights for policy 1, policy_version 77573 (0.0008) [2023-12-27 19:47:14,320][106225] Updated weights for policy 1, policy_version 77583 (0.0009) [2023-12-27 19:47:14,407][106226] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-12-27 19:47:14,457][106226] Updated weights for policy 0, policy_version 77530 (0.0005) [2023-12-27 19:47:14,510][106226] Updated weights for policy 0, policy_version 77540 (0.0005) [2023-12-27 19:47:15,079][106225] Updated weights for policy 1, policy_version 77593 (0.0008) [2023-12-27 19:47:15,143][106225] Updated weights for policy 1, policy_version 77603 (0.0008) [2023-12-27 19:47:15,198][106226] Updated weights for policy 0, policy_version 77550 (0.0007) [2023-12-27 19:47:15,204][106225] Updated weights for policy 1, policy_version 77613 (0.0010) [2023-12-27 19:47:15,263][106226] Updated weights for policy 0, policy_version 77560 (0.0007) [2023-12-27 19:47:15,326][106226] Updated weights for policy 0, policy_version 77570 (0.0006) [2023-12-27 19:47:15,825][106225] Updated weights for policy 1, policy_version 77623 (0.0007) [2023-12-27 19:47:15,880][106225] Updated weights for policy 1, policy_version 77633 (0.0006) [2023-12-27 19:47:15,935][106225] Updated weights for policy 1, policy_version 77643 (0.0007) [2023-12-27 19:47:16,012][106226] Updated weights for policy 0, policy_version 77580 (0.0006) [2023-12-27 19:47:16,075][106226] Updated weights for policy 0, policy_version 77590 (0.0008) [2023-12-27 19:47:16,138][106226] Updated weights for policy 0, policy_version 77600 (0.0007) [2023-12-27 19:47:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 39747584. Throughput: 0: 9918.2, 1: 10048.9. Samples: 39740220. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:16,175][105115] Avg episode reward: [(0, '-5.530'), (1, '-6.318')] [2023-12-27 19:47:16,558][106225] Updated weights for policy 1, policy_version 77653 (0.0008) [2023-12-27 19:47:16,614][106225] Updated weights for policy 1, policy_version 77663 (0.0005) [2023-12-27 19:47:16,678][106225] Updated weights for policy 1, policy_version 77673 (0.0009) [2023-12-27 19:47:16,830][106226] Updated weights for policy 0, policy_version 77610 (0.0008) [2023-12-27 19:47:16,895][106226] Updated weights for policy 0, policy_version 77620 (0.0007) [2023-12-27 19:47:16,962][106226] Updated weights for policy 0, policy_version 77630 (0.0009) [2023-12-27 19:47:17,016][106226] Updated weights for policy 0, policy_version 77640 (0.0009) [2023-12-27 19:47:17,363][106225] Updated weights for policy 1, policy_version 77683 (0.0009) [2023-12-27 19:47:17,421][106225] Updated weights for policy 1, policy_version 77693 (0.0008) [2023-12-27 19:47:17,483][106225] Updated weights for policy 1, policy_version 77703 (0.0008) [2023-12-27 19:47:17,736][106226] Updated weights for policy 0, policy_version 77650 (0.0009) [2023-12-27 19:47:17,785][106226] Updated weights for policy 0, policy_version 77660 (0.0008) [2023-12-27 19:47:17,835][106226] Updated weights for policy 0, policy_version 77670 (0.0009) [2023-12-27 19:47:18,150][106225] Updated weights for policy 1, policy_version 77713 (0.0008) [2023-12-27 19:47:18,222][106225] Updated weights for policy 1, policy_version 77723 (0.0009) [2023-12-27 19:47:18,279][106225] Updated weights for policy 1, policy_version 77733 (0.0009) [2023-12-27 19:47:18,339][106225] Updated weights for policy 1, policy_version 77743 (0.0008) [2023-12-27 19:47:18,533][106226] Updated weights for policy 0, policy_version 77680 (0.0009) [2023-12-27 19:47:18,584][106226] Updated weights for policy 0, policy_version 77690 (0.0008) [2023-12-27 19:47:18,646][106226] Updated weights for policy 0, policy_version 77700 (0.0005) [2023-12-27 19:47:19,002][106225] Updated weights for policy 1, policy_version 77753 (0.0006) [2023-12-27 19:47:19,060][106225] Updated weights for policy 1, policy_version 77763 (0.0006) [2023-12-27 19:47:19,108][106225] Updated weights for policy 1, policy_version 77773 (0.0005) [2023-12-27 19:47:19,279][106226] Updated weights for policy 0, policy_version 77710 (0.0009) [2023-12-27 19:47:19,340][106226] Updated weights for policy 0, policy_version 77720 (0.0011) [2023-12-27 19:47:19,407][106226] Updated weights for policy 0, policy_version 77730 (0.0009) [2023-12-27 19:47:19,836][106225] Updated weights for policy 1, policy_version 77783 (0.0007) [2023-12-27 19:47:19,900][106225] Updated weights for policy 1, policy_version 77793 (0.0007) [2023-12-27 19:47:19,971][106225] Updated weights for policy 1, policy_version 77803 (0.0006) [2023-12-27 19:47:20,124][106226] Updated weights for policy 0, policy_version 77740 (0.0008) [2023-12-27 19:47:20,195][106226] Updated weights for policy 0, policy_version 77750 (0.0008) [2023-12-27 19:47:20,257][106226] Updated weights for policy 0, policy_version 77760 (0.0008) [2023-12-27 19:47:20,651][106225] Updated weights for policy 1, policy_version 77813 (0.0007) [2023-12-27 19:47:20,716][106225] Updated weights for policy 1, policy_version 77823 (0.0008) [2023-12-27 19:47:20,779][106225] Updated weights for policy 1, policy_version 77833 (0.0008) [2023-12-27 19:47:21,011][106226] Updated weights for policy 0, policy_version 77770 (0.0009) [2023-12-27 19:47:21,081][106226] Updated weights for policy 0, policy_version 77780 (0.0010) [2023-12-27 19:47:21,150][106226] Updated weights for policy 0, policy_version 77790 (0.0010) [2023-12-27 19:47:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 39845888. Throughput: 0: 9870.0, 1: 9999.6. Samples: 39859288. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:21,175][105115] Avg episode reward: [(0, '-5.518'), (1, '-6.236')] [2023-12-27 19:47:21,217][106226] Updated weights for policy 0, policy_version 77800 (0.0008) [2023-12-27 19:47:21,526][106225] Updated weights for policy 1, policy_version 77843 (0.0007) [2023-12-27 19:47:21,590][106225] Updated weights for policy 1, policy_version 77853 (0.0008) [2023-12-27 19:47:21,652][106225] Updated weights for policy 1, policy_version 77863 (0.0007) [2023-12-27 19:47:21,984][106226] Updated weights for policy 0, policy_version 77810 (0.0010) [2023-12-27 19:47:22,053][106226] Updated weights for policy 0, policy_version 77820 (0.0008) [2023-12-27 19:47:22,111][106226] Updated weights for policy 0, policy_version 77830 (0.0010) [2023-12-27 19:47:22,400][106225] Updated weights for policy 1, policy_version 77873 (0.0007) [2023-12-27 19:47:22,456][106225] Updated weights for policy 1, policy_version 77883 (0.0008) [2023-12-27 19:47:22,517][106225] Updated weights for policy 1, policy_version 77893 (0.0008) [2023-12-27 19:47:22,589][106225] Updated weights for policy 1, policy_version 77903 (0.0008) [2023-12-27 19:47:22,840][106226] Updated weights for policy 0, policy_version 77840 (0.0009) [2023-12-27 19:47:22,901][106226] Updated weights for policy 0, policy_version 77850 (0.0011) [2023-12-27 19:47:22,958][106226] Updated weights for policy 0, policy_version 77860 (0.0010) [2023-12-27 19:47:23,368][106225] Updated weights for policy 1, policy_version 77913 (0.0008) [2023-12-27 19:47:23,414][106225] Updated weights for policy 1, policy_version 77923 (0.0007) [2023-12-27 19:47:23,467][106225] Updated weights for policy 1, policy_version 77933 (0.0008) [2023-12-27 19:47:23,616][106226] Updated weights for policy 0, policy_version 77870 (0.0011) [2023-12-27 19:47:23,679][106226] Updated weights for policy 0, policy_version 77880 (0.0010) [2023-12-27 19:47:23,742][106226] Updated weights for policy 0, policy_version 77890 (0.0011) [2023-12-27 19:47:24,182][106225] Updated weights for policy 1, policy_version 77943 (0.0008) [2023-12-27 19:47:24,238][106225] Updated weights for policy 1, policy_version 77953 (0.0007) [2023-12-27 19:47:24,304][106225] Updated weights for policy 1, policy_version 77963 (0.0008) [2023-12-27 19:47:24,485][106226] Updated weights for policy 0, policy_version 77900 (0.0011) [2023-12-27 19:47:24,548][106226] Updated weights for policy 0, policy_version 77910 (0.0011) [2023-12-27 19:47:24,612][106226] Updated weights for policy 0, policy_version 77920 (0.0011) [2023-12-27 19:47:25,039][106225] Updated weights for policy 1, policy_version 77973 (0.0009) [2023-12-27 19:47:25,093][106225] Updated weights for policy 1, policy_version 77983 (0.0008) [2023-12-27 19:47:25,142][106225] Updated weights for policy 1, policy_version 77993 (0.0008) [2023-12-27 19:47:25,248][106226] Updated weights for policy 0, policy_version 77930 (0.0009) [2023-12-27 19:47:25,306][106226] Updated weights for policy 0, policy_version 77940 (0.0005) [2023-12-27 19:47:25,353][106226] Updated weights for policy 0, policy_version 77950 (0.0005) [2023-12-27 19:47:25,401][106226] Updated weights for policy 0, policy_version 77960 (0.0005) [2023-12-27 19:47:25,854][106225] Updated weights for policy 1, policy_version 78003 (0.0009) [2023-12-27 19:47:25,917][106225] Updated weights for policy 1, policy_version 78013 (0.0010) [2023-12-27 19:47:25,967][106226] Updated weights for policy 0, policy_version 77970 (0.0011) [2023-12-27 19:47:25,975][106225] Updated weights for policy 1, policy_version 78023 (0.0010) [2023-12-27 19:47:26,026][106226] Updated weights for policy 0, policy_version 77980 (0.0008) [2023-12-27 19:47:26,087][106226] Updated weights for policy 0, policy_version 77990 (0.0005) [2023-12-27 19:47:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 39952384. Throughput: 0: 9877.5, 1: 9957.2. Samples: 39915508. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:26,175][105115] Avg episode reward: [(0, '-5.771'), (1, '-6.668')] [2023-12-27 19:47:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000078032_19980288.pth... [2023-12-27 19:47:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000077992_19972096.pth... [2023-12-27 19:47:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000076840_19677184.pth [2023-12-27 19:47:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000076848_19677184.pth [2023-12-27 19:47:26,669][106225] Updated weights for policy 1, policy_version 78033 (0.0010) [2023-12-27 19:47:26,670][106226] Updated weights for policy 0, policy_version 78000 (0.0008) [2023-12-27 19:47:26,726][106225] Updated weights for policy 1, policy_version 78043 (0.0006) [2023-12-27 19:47:26,732][106226] Updated weights for policy 0, policy_version 78010 (0.0007) [2023-12-27 19:47:26,780][106225] Updated weights for policy 1, policy_version 78053 (0.0005) [2023-12-27 19:47:26,785][106226] Updated weights for policy 0, policy_version 78020 (0.0007) [2023-12-27 19:47:26,830][106225] Updated weights for policy 1, policy_version 78063 (0.0009) [2023-12-27 19:47:27,448][106226] Updated weights for policy 0, policy_version 78030 (0.0008) [2023-12-27 19:47:27,495][106226] Updated weights for policy 0, policy_version 78040 (0.0007) [2023-12-27 19:47:27,523][106225] Updated weights for policy 1, policy_version 78073 (0.0010) [2023-12-27 19:47:27,552][106226] Updated weights for policy 0, policy_version 78050 (0.0006) [2023-12-27 19:47:27,569][106225] Updated weights for policy 1, policy_version 78083 (0.0010) [2023-12-27 19:47:27,618][106225] Updated weights for policy 1, policy_version 78093 (0.0010) [2023-12-27 19:47:28,141][106226] Updated weights for policy 0, policy_version 78060 (0.0007) [2023-12-27 19:47:28,196][106226] Updated weights for policy 0, policy_version 78070 (0.0006) [2023-12-27 19:47:28,252][106226] Updated weights for policy 0, policy_version 78080 (0.0006) [2023-12-27 19:47:28,336][106225] Updated weights for policy 1, policy_version 78103 (0.0008) [2023-12-27 19:47:28,404][106225] Updated weights for policy 1, policy_version 78113 (0.0010) [2023-12-27 19:47:28,470][106225] Updated weights for policy 1, policy_version 78123 (0.0009) [2023-12-27 19:47:28,786][106226] Updated weights for policy 0, policy_version 78090 (0.0006) [2023-12-27 19:47:28,850][106226] Updated weights for policy 0, policy_version 78100 (0.0007) [2023-12-27 19:47:28,911][106226] Updated weights for policy 0, policy_version 78110 (0.0006) [2023-12-27 19:47:28,966][106226] Updated weights for policy 0, policy_version 78120 (0.0005) [2023-12-27 19:47:29,228][106225] Updated weights for policy 1, policy_version 78133 (0.0009) [2023-12-27 19:47:29,285][106225] Updated weights for policy 1, policy_version 78143 (0.0008) [2023-12-27 19:47:29,345][106225] Updated weights for policy 1, policy_version 78153 (0.0008) [2023-12-27 19:47:29,568][106226] Updated weights for policy 0, policy_version 78130 (0.0008) [2023-12-27 19:47:29,628][106226] Updated weights for policy 0, policy_version 78140 (0.0009) [2023-12-27 19:47:29,690][106226] Updated weights for policy 0, policy_version 78150 (0.0008) [2023-12-27 19:47:30,051][106225] Updated weights for policy 1, policy_version 78163 (0.0007) [2023-12-27 19:47:30,107][106225] Updated weights for policy 1, policy_version 78173 (0.0008) [2023-12-27 19:47:30,158][106225] Updated weights for policy 1, policy_version 78183 (0.0010) [2023-12-27 19:47:30,438][106226] Updated weights for policy 0, policy_version 78160 (0.0010) [2023-12-27 19:47:30,501][106226] Updated weights for policy 0, policy_version 78170 (0.0010) [2023-12-27 19:47:30,566][106226] Updated weights for policy 0, policy_version 78180 (0.0010) [2023-12-27 19:47:30,774][106225] Updated weights for policy 1, policy_version 78193 (0.0010) [2023-12-27 19:47:30,833][106225] Updated weights for policy 1, policy_version 78203 (0.0005) [2023-12-27 19:47:30,897][106225] Updated weights for policy 1, policy_version 78213 (0.0007) [2023-12-27 19:47:30,959][106225] Updated weights for policy 1, policy_version 78223 (0.0008) [2023-12-27 19:47:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 40050688. Throughput: 0: 10123.9, 1: 9956.6. Samples: 40040432. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:31,175][105115] Avg episode reward: [(0, '-5.305'), (1, '-6.392')] [2023-12-27 19:47:31,223][106226] Updated weights for policy 0, policy_version 78190 (0.0010) [2023-12-27 19:47:31,282][106226] Updated weights for policy 0, policy_version 78200 (0.0011) [2023-12-27 19:47:31,349][106226] Updated weights for policy 0, policy_version 78210 (0.0010) [2023-12-27 19:47:31,647][106225] Updated weights for policy 1, policy_version 78233 (0.0010) [2023-12-27 19:47:31,712][106225] Updated weights for policy 1, policy_version 78243 (0.0009) [2023-12-27 19:47:31,775][106225] Updated weights for policy 1, policy_version 78253 (0.0010) [2023-12-27 19:47:32,066][106226] Updated weights for policy 0, policy_version 78220 (0.0008) [2023-12-27 19:47:32,118][106226] Updated weights for policy 0, policy_version 78230 (0.0009) [2023-12-27 19:47:32,180][106226] Updated weights for policy 0, policy_version 78240 (0.0008) [2023-12-27 19:47:32,517][106225] Updated weights for policy 1, policy_version 78263 (0.0011) [2023-12-27 19:47:32,572][106225] Updated weights for policy 1, policy_version 78273 (0.0010) [2023-12-27 19:47:32,632][106225] Updated weights for policy 1, policy_version 78283 (0.0010) [2023-12-27 19:47:32,943][106226] Updated weights for policy 0, policy_version 78250 (0.0008) [2023-12-27 19:47:32,988][106226] Updated weights for policy 0, policy_version 78260 (0.0007) [2023-12-27 19:47:33,035][106226] Updated weights for policy 0, policy_version 78270 (0.0007) [2023-12-27 19:47:33,341][106225] Updated weights for policy 1, policy_version 78293 (0.0010) [2023-12-27 19:47:33,386][106225] Updated weights for policy 1, policy_version 78303 (0.0005) [2023-12-27 19:47:33,434][106225] Updated weights for policy 1, policy_version 78313 (0.0005) [2023-12-27 19:47:33,700][106226] Updated weights for policy 0, policy_version 78281 (0.0008) [2023-12-27 19:47:33,754][106226] Updated weights for policy 0, policy_version 78291 (0.0008) [2023-12-27 19:47:33,804][106226] Updated weights for policy 0, policy_version 78301 (0.0006) [2023-12-27 19:47:33,852][106226] Updated weights for policy 0, policy_version 78311 (0.0006) [2023-12-27 19:47:34,126][106225] Updated weights for policy 1, policy_version 78323 (0.0007) [2023-12-27 19:47:34,188][106225] Updated weights for policy 1, policy_version 78333 (0.0008) [2023-12-27 19:47:34,247][106225] Updated weights for policy 1, policy_version 78343 (0.0008) [2023-12-27 19:47:34,478][106226] Updated weights for policy 0, policy_version 78321 (0.0008) [2023-12-27 19:47:34,534][106226] Updated weights for policy 0, policy_version 78331 (0.0006) [2023-12-27 19:47:34,595][106226] Updated weights for policy 0, policy_version 78341 (0.0006) [2023-12-27 19:47:35,016][106225] Updated weights for policy 1, policy_version 78353 (0.0008) [2023-12-27 19:47:35,065][106225] Updated weights for policy 1, policy_version 78363 (0.0008) [2023-12-27 19:47:35,116][106225] Updated weights for policy 1, policy_version 78373 (0.0008) [2023-12-27 19:47:35,160][106225] Updated weights for policy 1, policy_version 78383 (0.0008) [2023-12-27 19:47:35,217][106226] Updated weights for policy 0, policy_version 78351 (0.0007) [2023-12-27 19:47:35,277][106226] Updated weights for policy 0, policy_version 78361 (0.0009) [2023-12-27 19:47:35,331][106226] Updated weights for policy 0, policy_version 78371 (0.0008) [2023-12-27 19:47:35,849][106225] Updated weights for policy 1, policy_version 78393 (0.0008) [2023-12-27 19:47:35,905][106225] Updated weights for policy 1, policy_version 78403 (0.0009) [2023-12-27 19:47:35,967][106225] Updated weights for policy 1, policy_version 78413 (0.0009) [2023-12-27 19:47:36,024][106226] Updated weights for policy 0, policy_version 78381 (0.0008) [2023-12-27 19:47:36,076][106226] Updated weights for policy 0, policy_version 78391 (0.0005) [2023-12-27 19:47:36,139][106226] Updated weights for policy 0, policy_version 78401 (0.0007) [2023-12-27 19:47:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 40148992. Throughput: 0: 10106.5, 1: 10016.3. Samples: 40161336. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:36,175][105115] Avg episode reward: [(0, '-5.897'), (1, '-6.562')] [2023-12-27 19:47:36,749][106225] Updated weights for policy 1, policy_version 78423 (0.0008) [2023-12-27 19:47:36,796][106225] Updated weights for policy 1, policy_version 78433 (0.0008) [2023-12-27 19:47:36,846][106225] Updated weights for policy 1, policy_version 78443 (0.0008) [2023-12-27 19:47:36,857][106226] Updated weights for policy 0, policy_version 78411 (0.0006) [2023-12-27 19:47:36,909][106226] Updated weights for policy 0, policy_version 78421 (0.0005) [2023-12-27 19:47:36,963][106226] Updated weights for policy 0, policy_version 78431 (0.0008) [2023-12-27 19:47:37,487][106225] Updated weights for policy 1, policy_version 78453 (0.0007) [2023-12-27 19:47:37,549][106225] Updated weights for policy 1, policy_version 78463 (0.0006) [2023-12-27 19:47:37,608][106225] Updated weights for policy 1, policy_version 78473 (0.0008) [2023-12-27 19:47:37,709][106226] Updated weights for policy 0, policy_version 78441 (0.0008) [2023-12-27 19:47:37,766][106226] Updated weights for policy 0, policy_version 78451 (0.0008) [2023-12-27 19:47:37,824][106226] Updated weights for policy 0, policy_version 78461 (0.0005) [2023-12-27 19:47:37,876][106226] Updated weights for policy 0, policy_version 78471 (0.0008) [2023-12-27 19:47:38,284][106225] Updated weights for policy 1, policy_version 78483 (0.0006) [2023-12-27 19:47:38,362][106225] Updated weights for policy 1, policy_version 78495 (0.0008) [2023-12-27 19:47:38,413][106225] Updated weights for policy 1, policy_version 78505 (0.0007) [2023-12-27 19:47:38,553][106226] Updated weights for policy 0, policy_version 78481 (0.0008) [2023-12-27 19:47:38,619][106226] Updated weights for policy 0, policy_version 78491 (0.0009) [2023-12-27 19:47:38,682][106226] Updated weights for policy 0, policy_version 78501 (0.0009) [2023-12-27 19:47:39,087][106225] Updated weights for policy 1, policy_version 78515 (0.0008) [2023-12-27 19:47:39,152][106225] Updated weights for policy 1, policy_version 78525 (0.0009) [2023-12-27 19:47:39,215][106225] Updated weights for policy 1, policy_version 78535 (0.0007) [2023-12-27 19:47:39,481][106226] Updated weights for policy 0, policy_version 78511 (0.0006) [2023-12-27 19:47:39,546][106226] Updated weights for policy 0, policy_version 78521 (0.0007) [2023-12-27 19:47:39,607][106226] Updated weights for policy 0, policy_version 78531 (0.0007) [2023-12-27 19:47:39,974][106225] Updated weights for policy 1, policy_version 78545 (0.0006) [2023-12-27 19:47:40,041][106225] Updated weights for policy 1, policy_version 78555 (0.0006) [2023-12-27 19:47:40,106][106225] Updated weights for policy 1, policy_version 78565 (0.0007) [2023-12-27 19:47:40,165][106225] Updated weights for policy 1, policy_version 78575 (0.0010) [2023-12-27 19:47:40,278][106226] Updated weights for policy 0, policy_version 78541 (0.0007) [2023-12-27 19:47:40,340][106226] Updated weights for policy 0, policy_version 78551 (0.0006) [2023-12-27 19:47:40,396][106226] Updated weights for policy 0, policy_version 78561 (0.0006) [2023-12-27 19:47:40,915][106225] Updated weights for policy 1, policy_version 78585 (0.0007) [2023-12-27 19:47:40,927][106226] Updated weights for policy 0, policy_version 78571 (0.0006) [2023-12-27 19:47:40,968][106225] Updated weights for policy 1, policy_version 78595 (0.0006) [2023-12-27 19:47:40,989][106226] Updated weights for policy 0, policy_version 78581 (0.0008) [2023-12-27 19:47:41,027][106225] Updated weights for policy 1, policy_version 78605 (0.0007) [2023-12-27 19:47:41,067][106226] Updated weights for policy 0, policy_version 78591 (0.0009) [2023-12-27 19:47:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 40255488. Throughput: 0: 10044.6, 1: 10025.2. Samples: 40219748. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:41,175][105115] Avg episode reward: [(0, '-5.310'), (1, '-6.851')] [2023-12-27 19:47:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000078600_20127744.pth... [2023-12-27 19:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000078608_20127744.pth... [2023-12-27 19:47:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000077416_19824640.pth [2023-12-27 19:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000077456_19832832.pth [2023-12-27 19:47:41,749][106226] Updated weights for policy 0, policy_version 78601 (0.0008) [2023-12-27 19:47:41,816][106226] Updated weights for policy 0, policy_version 78611 (0.0008) [2023-12-27 19:47:41,857][106225] Updated weights for policy 1, policy_version 78615 (0.0009) [2023-12-27 19:47:41,877][106226] Updated weights for policy 0, policy_version 78621 (0.0007) [2023-12-27 19:47:41,917][106225] Updated weights for policy 1, policy_version 78625 (0.0008) [2023-12-27 19:47:41,936][106226] Updated weights for policy 0, policy_version 78631 (0.0008) [2023-12-27 19:47:41,986][106225] Updated weights for policy 1, policy_version 78635 (0.0009) [2023-12-27 19:47:42,669][106226] Updated weights for policy 0, policy_version 78641 (0.0009) [2023-12-27 19:47:42,729][106226] Updated weights for policy 0, policy_version 78651 (0.0008) [2023-12-27 19:47:42,750][106225] Updated weights for policy 1, policy_version 78645 (0.0008) [2023-12-27 19:47:42,784][106226] Updated weights for policy 0, policy_version 78661 (0.0006) [2023-12-27 19:47:42,814][106225] Updated weights for policy 1, policy_version 78655 (0.0009) [2023-12-27 19:47:42,882][106225] Updated weights for policy 1, policy_version 78665 (0.0008) [2023-12-27 19:47:43,506][106225] Updated weights for policy 1, policy_version 78675 (0.0009) [2023-12-27 19:47:43,542][106226] Updated weights for policy 0, policy_version 78671 (0.0006) [2023-12-27 19:47:43,564][106225] Updated weights for policy 1, policy_version 78685 (0.0010) [2023-12-27 19:47:43,603][106226] Updated weights for policy 0, policy_version 78681 (0.0005) [2023-12-27 19:47:43,628][106225] Updated weights for policy 1, policy_version 78695 (0.0010) [2023-12-27 19:47:43,661][106226] Updated weights for policy 0, policy_version 78691 (0.0006) [2023-12-27 19:47:44,259][106225] Updated weights for policy 1, policy_version 78705 (0.0010) [2023-12-27 19:47:44,322][106225] Updated weights for policy 1, policy_version 78715 (0.0008) [2023-12-27 19:47:44,335][106226] Updated weights for policy 0, policy_version 78701 (0.0006) [2023-12-27 19:47:44,385][106225] Updated weights for policy 1, policy_version 78725 (0.0007) [2023-12-27 19:47:44,387][106226] Updated weights for policy 0, policy_version 78711 (0.0006) [2023-12-27 19:47:44,437][106226] Updated weights for policy 0, policy_version 78721 (0.0005) [2023-12-27 19:47:44,449][106225] Updated weights for policy 1, policy_version 78735 (0.0007) [2023-12-27 19:47:45,104][106225] Updated weights for policy 1, policy_version 78745 (0.0010) [2023-12-27 19:47:45,160][106225] Updated weights for policy 1, policy_version 78755 (0.0010) [2023-12-27 19:47:45,204][106226] Updated weights for policy 0, policy_version 78731 (0.0007) [2023-12-27 19:47:45,227][106225] Updated weights for policy 1, policy_version 78765 (0.0006) [2023-12-27 19:47:45,272][106226] Updated weights for policy 0, policy_version 78741 (0.0006) [2023-12-27 19:47:45,331][106226] Updated weights for policy 0, policy_version 78751 (0.0006) [2023-12-27 19:47:45,858][106225] Updated weights for policy 1, policy_version 78775 (0.0009) [2023-12-27 19:47:45,860][106226] Updated weights for policy 0, policy_version 78761 (0.0005) [2023-12-27 19:47:45,910][106225] Updated weights for policy 1, policy_version 78785 (0.0006) [2023-12-27 19:47:45,911][106226] Updated weights for policy 0, policy_version 78771 (0.0006) [2023-12-27 19:47:45,967][106225] Updated weights for policy 1, policy_version 78795 (0.0008) [2023-12-27 19:47:45,969][106226] Updated weights for policy 0, policy_version 78781 (0.0006) [2023-12-27 19:47:46,033][106226] Updated weights for policy 0, policy_version 78791 (0.0008) [2023-12-27 19:47:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 40353792. Throughput: 0: 10005.8, 1: 9924.7. Samples: 40336720. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:46,175][105115] Avg episode reward: [(0, '-5.933'), (1, '-6.502')] [2023-12-27 19:47:46,567][106225] Updated weights for policy 1, policy_version 78805 (0.0006) [2023-12-27 19:47:46,630][106225] Updated weights for policy 1, policy_version 78815 (0.0008) [2023-12-27 19:47:46,692][106225] Updated weights for policy 1, policy_version 78825 (0.0007) [2023-12-27 19:47:46,699][106226] Updated weights for policy 0, policy_version 78801 (0.0006) [2023-12-27 19:47:46,760][106226] Updated weights for policy 0, policy_version 78811 (0.0006) [2023-12-27 19:47:46,819][106226] Updated weights for policy 0, policy_version 78821 (0.0010) [2023-12-27 19:47:47,254][106225] Updated weights for policy 1, policy_version 78835 (0.0006) [2023-12-27 19:47:47,308][106225] Updated weights for policy 1, policy_version 78845 (0.0008) [2023-12-27 19:47:47,353][106225] Updated weights for policy 1, policy_version 78855 (0.0005) [2023-12-27 19:47:47,473][106226] Updated weights for policy 0, policy_version 78831 (0.0009) [2023-12-27 19:47:47,527][106226] Updated weights for policy 0, policy_version 78841 (0.0009) [2023-12-27 19:47:47,588][106226] Updated weights for policy 0, policy_version 78851 (0.0007) [2023-12-27 19:47:48,033][106225] Updated weights for policy 1, policy_version 78865 (0.0006) [2023-12-27 19:47:48,096][106225] Updated weights for policy 1, policy_version 78875 (0.0010) [2023-12-27 19:47:48,159][106225] Updated weights for policy 1, policy_version 78885 (0.0008) [2023-12-27 19:47:48,170][106226] Updated weights for policy 0, policy_version 78861 (0.0009) [2023-12-27 19:47:48,221][106225] Updated weights for policy 1, policy_version 78895 (0.0009) [2023-12-27 19:47:48,224][106226] Updated weights for policy 0, policy_version 78871 (0.0008) [2023-12-27 19:47:48,273][106226] Updated weights for policy 0, policy_version 78881 (0.0005) [2023-12-27 19:47:48,874][106225] Updated weights for policy 1, policy_version 78905 (0.0006) [2023-12-27 19:47:48,939][106225] Updated weights for policy 1, policy_version 78915 (0.0009) [2023-12-27 19:47:49,006][106225] Updated weights for policy 1, policy_version 78925 (0.0010) [2023-12-27 19:47:49,027][106226] Updated weights for policy 0, policy_version 78891 (0.0010) [2023-12-27 19:47:49,088][106226] Updated weights for policy 0, policy_version 78901 (0.0008) [2023-12-27 19:47:49,150][106226] Updated weights for policy 0, policy_version 78911 (0.0008) [2023-12-27 19:47:49,627][106225] Updated weights for policy 1, policy_version 78935 (0.0007) [2023-12-27 19:47:49,696][106225] Updated weights for policy 1, policy_version 78945 (0.0005) [2023-12-27 19:47:49,760][106225] Updated weights for policy 1, policy_version 78955 (0.0006) [2023-12-27 19:47:50,014][106226] Updated weights for policy 0, policy_version 78921 (0.0009) [2023-12-27 19:47:50,063][106226] Updated weights for policy 0, policy_version 78931 (0.0008) [2023-12-27 19:47:50,112][106226] Updated weights for policy 0, policy_version 78941 (0.0009) [2023-12-27 19:47:50,163][106226] Updated weights for policy 0, policy_version 78951 (0.0007) [2023-12-27 19:47:50,390][106225] Updated weights for policy 1, policy_version 78965 (0.0006) [2023-12-27 19:47:50,449][106225] Updated weights for policy 1, policy_version 78975 (0.0009) [2023-12-27 19:47:50,503][106225] Updated weights for policy 1, policy_version 78985 (0.0008) [2023-12-27 19:47:50,978][106226] Updated weights for policy 0, policy_version 78961 (0.0010) [2023-12-27 19:47:51,045][106226] Updated weights for policy 0, policy_version 78971 (0.0009) [2023-12-27 19:47:51,108][106226] Updated weights for policy 0, policy_version 78981 (0.0008) [2023-12-27 19:47:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 40452096. Throughput: 0: 9947.7, 1: 10014.1. Samples: 40460360. Policy #0 lag: (min: 10.0, avg: 26.8, max: 42.0) [2023-12-27 19:47:51,175][105115] Avg episode reward: [(0, '-5.333'), (1, '-6.530')] [2023-12-27 19:47:51,246][106225] Updated weights for policy 1, policy_version 78995 (0.0007) [2023-12-27 19:47:51,312][106225] Updated weights for policy 1, policy_version 79005 (0.0006) [2023-12-27 19:47:51,381][106225] Updated weights for policy 1, policy_version 79015 (0.0008) [2023-12-27 19:47:51,866][106226] Updated weights for policy 0, policy_version 78991 (0.0009) [2023-12-27 19:47:51,913][106226] Updated weights for policy 0, policy_version 79001 (0.0006) [2023-12-27 19:47:51,966][106226] Updated weights for policy 0, policy_version 79011 (0.0006) [2023-12-27 19:47:52,114][106225] Updated weights for policy 1, policy_version 79025 (0.0008) [2023-12-27 19:47:52,170][106225] Updated weights for policy 1, policy_version 79035 (0.0006) [2023-12-27 19:47:52,231][106225] Updated weights for policy 1, policy_version 79045 (0.0005) [2023-12-27 19:47:52,297][106225] Updated weights for policy 1, policy_version 79055 (0.0008) [2023-12-27 19:47:52,698][106226] Updated weights for policy 0, policy_version 79021 (0.0008) [2023-12-27 19:47:52,753][106226] Updated weights for policy 0, policy_version 79031 (0.0008) [2023-12-27 19:47:52,806][106226] Updated weights for policy 0, policy_version 79041 (0.0009) [2023-12-27 19:47:52,951][106225] Updated weights for policy 1, policy_version 79065 (0.0008) [2023-12-27 19:47:53,006][106225] Updated weights for policy 1, policy_version 79075 (0.0009) [2023-12-27 19:47:53,068][106225] Updated weights for policy 1, policy_version 79085 (0.0008) [2023-12-27 19:47:53,508][106226] Updated weights for policy 0, policy_version 79051 (0.0010) [2023-12-27 19:47:53,579][106226] Updated weights for policy 0, policy_version 79061 (0.0010) [2023-12-27 19:47:53,645][106226] Updated weights for policy 0, policy_version 79071 (0.0008) [2023-12-27 19:47:53,742][106225] Updated weights for policy 1, policy_version 79095 (0.0007) [2023-12-27 19:47:53,803][106225] Updated weights for policy 1, policy_version 79105 (0.0007) [2023-12-27 19:47:53,864][106225] Updated weights for policy 1, policy_version 79115 (0.0007) [2023-12-27 19:47:54,291][106226] Updated weights for policy 0, policy_version 79081 (0.0006) [2023-12-27 19:47:54,362][106226] Updated weights for policy 0, policy_version 79091 (0.0011) [2023-12-27 19:47:54,426][106226] Updated weights for policy 0, policy_version 79101 (0.0011) [2023-12-27 19:47:54,486][106226] Updated weights for policy 0, policy_version 79111 (0.0010) [2023-12-27 19:47:54,564][106225] Updated weights for policy 1, policy_version 79125 (0.0008) [2023-12-27 19:47:54,611][106225] Updated weights for policy 1, policy_version 79135 (0.0008) [2023-12-27 19:47:54,670][106225] Updated weights for policy 1, policy_version 79145 (0.0006) [2023-12-27 19:47:55,203][106226] Updated weights for policy 0, policy_version 79121 (0.0008) [2023-12-27 19:47:55,259][106226] Updated weights for policy 0, policy_version 79131 (0.0009) [2023-12-27 19:47:55,309][106226] Updated weights for policy 0, policy_version 79141 (0.0009) [2023-12-27 19:47:55,355][106225] Updated weights for policy 1, policy_version 79155 (0.0007) [2023-12-27 19:47:55,406][106225] Updated weights for policy 1, policy_version 79165 (0.0005) [2023-12-27 19:47:55,455][106225] Updated weights for policy 1, policy_version 79175 (0.0006) [2023-12-27 19:47:55,991][106226] Updated weights for policy 0, policy_version 79151 (0.0007) [2023-12-27 19:47:56,040][106226] Updated weights for policy 0, policy_version 79161 (0.0006) [2023-12-27 19:47:56,053][106225] Updated weights for policy 1, policy_version 79185 (0.0005) [2023-12-27 19:47:56,091][106226] Updated weights for policy 0, policy_version 79171 (0.0007) [2023-12-27 19:47:56,113][106225] Updated weights for policy 1, policy_version 79195 (0.0007) [2023-12-27 19:47:56,157][106225] Updated weights for policy 1, policy_version 79205 (0.0007) [2023-12-27 19:47:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 40550400. Throughput: 0: 10000.4, 1: 9956.0. Samples: 40519104. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:47:56,175][105115] Avg episode reward: [(0, '-5.434'), (1, '-6.775')] [2023-12-27 19:47:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000079176_20275200.pth... [2023-12-27 19:47:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000077992_19972096.pth [2023-12-27 19:47:56,215][106225] Updated weights for policy 1, policy_version 79215 (0.0008) [2023-12-27 19:47:56,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000079216_20283392.pth... [2023-12-27 19:47:56,221][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000078032_19980288.pth [2023-12-27 19:47:56,670][106226] Updated weights for policy 0, policy_version 79181 (0.0006) [2023-12-27 19:47:56,722][106226] Updated weights for policy 0, policy_version 79191 (0.0007) [2023-12-27 19:47:56,770][106226] Updated weights for policy 0, policy_version 79201 (0.0009) [2023-12-27 19:47:56,908][106225] Updated weights for policy 1, policy_version 79225 (0.0006) [2023-12-27 19:47:56,952][106225] Updated weights for policy 1, policy_version 79235 (0.0005) [2023-12-27 19:47:57,006][106225] Updated weights for policy 1, policy_version 79245 (0.0005) [2023-12-27 19:47:57,416][106226] Updated weights for policy 0, policy_version 79211 (0.0009) [2023-12-27 19:47:57,466][106226] Updated weights for policy 0, policy_version 79221 (0.0010) [2023-12-27 19:47:57,518][106226] Updated weights for policy 0, policy_version 79231 (0.0005) [2023-12-27 19:47:57,531][106225] Updated weights for policy 1, policy_version 79255 (0.0005) [2023-12-27 19:47:57,592][106225] Updated weights for policy 1, policy_version 79265 (0.0005) [2023-12-27 19:47:57,649][106225] Updated weights for policy 1, policy_version 79275 (0.0005) [2023-12-27 19:47:58,055][106226] Updated weights for policy 0, policy_version 79241 (0.0006) [2023-12-27 19:47:58,108][106226] Updated weights for policy 0, policy_version 79251 (0.0005) [2023-12-27 19:47:58,165][106226] Updated weights for policy 0, policy_version 79261 (0.0008) [2023-12-27 19:47:58,234][106226] Updated weights for policy 0, policy_version 79271 (0.0009) [2023-12-27 19:47:58,241][106225] Updated weights for policy 1, policy_version 79285 (0.0006) [2023-12-27 19:47:58,307][106225] Updated weights for policy 1, policy_version 79295 (0.0006) [2023-12-27 19:47:58,384][106225] Updated weights for policy 1, policy_version 79305 (0.0008) [2023-12-27 19:47:59,096][106226] Updated weights for policy 0, policy_version 79281 (0.0008) [2023-12-27 19:47:59,154][106225] Updated weights for policy 1, policy_version 79315 (0.0008) [2023-12-27 19:47:59,156][106226] Updated weights for policy 0, policy_version 79291 (0.0007) [2023-12-27 19:47:59,218][106225] Updated weights for policy 1, policy_version 79325 (0.0010) [2023-12-27 19:47:59,219][106226] Updated weights for policy 0, policy_version 79301 (0.0007) [2023-12-27 19:47:59,284][106225] Updated weights for policy 1, policy_version 79335 (0.0009) [2023-12-27 19:47:59,928][106226] Updated weights for policy 0, policy_version 79311 (0.0009) [2023-12-27 19:47:59,991][106226] Updated weights for policy 0, policy_version 79321 (0.0007) [2023-12-27 19:48:00,059][106226] Updated weights for policy 0, policy_version 79331 (0.0006) [2023-12-27 19:48:00,070][106225] Updated weights for policy 1, policy_version 79345 (0.0008) [2023-12-27 19:48:00,123][106225] Updated weights for policy 1, policy_version 79355 (0.0007) [2023-12-27 19:48:00,181][106225] Updated weights for policy 1, policy_version 79365 (0.0007) [2023-12-27 19:48:00,232][106225] Updated weights for policy 1, policy_version 79375 (0.0008) [2023-12-27 19:48:00,733][106226] Updated weights for policy 0, policy_version 79341 (0.0007) [2023-12-27 19:48:00,795][106226] Updated weights for policy 0, policy_version 79351 (0.0005) [2023-12-27 19:48:00,855][106226] Updated weights for policy 0, policy_version 79361 (0.0005) [2023-12-27 19:48:00,911][106225] Updated weights for policy 1, policy_version 79385 (0.0009) [2023-12-27 19:48:00,960][106225] Updated weights for policy 1, policy_version 79395 (0.0008) [2023-12-27 19:48:01,010][106225] Updated weights for policy 1, policy_version 79405 (0.0008) [2023-12-27 19:48:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 40656896. Throughput: 0: 10064.5, 1: 9995.0. Samples: 40642900. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:01,175][105115] Avg episode reward: [(0, '-5.425'), (1, '-6.212')] [2023-12-27 19:48:01,448][106226] Updated weights for policy 0, policy_version 79371 (0.0005) [2023-12-27 19:48:01,509][106226] Updated weights for policy 0, policy_version 79381 (0.0008) [2023-12-27 19:48:01,571][106226] Updated weights for policy 0, policy_version 79391 (0.0007) [2023-12-27 19:48:01,853][106225] Updated weights for policy 1, policy_version 79415 (0.0008) [2023-12-27 19:48:01,915][106225] Updated weights for policy 1, policy_version 79425 (0.0010) [2023-12-27 19:48:01,965][106225] Updated weights for policy 1, policy_version 79435 (0.0009) [2023-12-27 19:48:02,258][106226] Updated weights for policy 0, policy_version 79401 (0.0007) [2023-12-27 19:48:02,323][106226] Updated weights for policy 0, policy_version 79411 (0.0008) [2023-12-27 19:48:02,387][106226] Updated weights for policy 0, policy_version 79421 (0.0008) [2023-12-27 19:48:02,436][106226] Updated weights for policy 0, policy_version 79431 (0.0009) [2023-12-27 19:48:02,681][106225] Updated weights for policy 1, policy_version 79445 (0.0007) [2023-12-27 19:48:02,744][106225] Updated weights for policy 1, policy_version 79455 (0.0008) [2023-12-27 19:48:02,803][106225] Updated weights for policy 1, policy_version 79465 (0.0008) [2023-12-27 19:48:03,127][106226] Updated weights for policy 0, policy_version 79441 (0.0006) [2023-12-27 19:48:03,191][106226] Updated weights for policy 0, policy_version 79451 (0.0005) [2023-12-27 19:48:03,256][106226] Updated weights for policy 0, policy_version 79461 (0.0006) [2023-12-27 19:48:03,548][106225] Updated weights for policy 1, policy_version 79475 (0.0008) [2023-12-27 19:48:03,598][106225] Updated weights for policy 1, policy_version 79485 (0.0009) [2023-12-27 19:48:03,654][106225] Updated weights for policy 1, policy_version 79496 (0.0009) [2023-12-27 19:48:03,792][106226] Updated weights for policy 0, policy_version 79471 (0.0005) [2023-12-27 19:48:03,857][106226] Updated weights for policy 0, policy_version 79481 (0.0006) [2023-12-27 19:48:03,915][106226] Updated weights for policy 0, policy_version 79491 (0.0005) [2023-12-27 19:48:04,491][106225] Updated weights for policy 1, policy_version 79506 (0.0008) [2023-12-27 19:48:04,529][106226] Updated weights for policy 0, policy_version 79501 (0.0009) [2023-12-27 19:48:04,554][106225] Updated weights for policy 1, policy_version 79516 (0.0006) [2023-12-27 19:48:04,579][106226] Updated weights for policy 0, policy_version 79511 (0.0010) [2023-12-27 19:48:04,615][106225] Updated weights for policy 1, policy_version 79526 (0.0005) [2023-12-27 19:48:04,630][106226] Updated weights for policy 0, policy_version 79521 (0.0010) [2023-12-27 19:48:04,671][106225] Updated weights for policy 1, policy_version 79536 (0.0005) [2023-12-27 19:48:05,294][106225] Updated weights for policy 1, policy_version 79546 (0.0005) [2023-12-27 19:48:05,347][106225] Updated weights for policy 1, policy_version 79556 (0.0007) [2023-12-27 19:48:05,353][106226] Updated weights for policy 0, policy_version 79531 (0.0010) [2023-12-27 19:48:05,394][106225] Updated weights for policy 1, policy_version 79566 (0.0005) [2023-12-27 19:48:05,403][106226] Updated weights for policy 0, policy_version 79541 (0.0010) [2023-12-27 19:48:05,456][106226] Updated weights for policy 0, policy_version 79551 (0.0010) [2023-12-27 19:48:06,105][106225] Updated weights for policy 1, policy_version 79576 (0.0007) [2023-12-27 19:48:06,163][106225] Updated weights for policy 1, policy_version 79586 (0.0008) [2023-12-27 19:48:06,169][106226] Updated weights for policy 0, policy_version 79561 (0.0009) [2023-12-27 19:48:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 40747008. Throughput: 0: 10163.5, 1: 9917.4. Samples: 40762928. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:06,175][105115] Avg episode reward: [(0, '-5.469'), (1, '-6.190')] [2023-12-27 19:48:06,214][106225] Updated weights for policy 1, policy_version 79596 (0.0008) [2023-12-27 19:48:06,232][106226] Updated weights for policy 0, policy_version 79571 (0.0011) [2023-12-27 19:48:06,286][106226] Updated weights for policy 0, policy_version 79581 (0.0010) [2023-12-27 19:48:06,341][106226] Updated weights for policy 0, policy_version 79591 (0.0011) [2023-12-27 19:48:06,953][106225] Updated weights for policy 1, policy_version 79606 (0.0008) [2023-12-27 19:48:07,007][106225] Updated weights for policy 1, policy_version 79616 (0.0009) [2023-12-27 19:48:07,062][106225] Updated weights for policy 1, policy_version 79626 (0.0007) [2023-12-27 19:48:07,078][106226] Updated weights for policy 0, policy_version 79601 (0.0009) [2023-12-27 19:48:07,135][106226] Updated weights for policy 0, policy_version 79611 (0.0007) [2023-12-27 19:48:07,190][106226] Updated weights for policy 0, policy_version 79621 (0.0008) [2023-12-27 19:48:07,796][106225] Updated weights for policy 1, policy_version 79636 (0.0007) [2023-12-27 19:48:07,848][106225] Updated weights for policy 1, policy_version 79646 (0.0008) [2023-12-27 19:48:07,895][106226] Updated weights for policy 0, policy_version 79631 (0.0009) [2023-12-27 19:48:07,908][106225] Updated weights for policy 1, policy_version 79656 (0.0009) [2023-12-27 19:48:07,954][106226] Updated weights for policy 0, policy_version 79641 (0.0008) [2023-12-27 19:48:08,010][106226] Updated weights for policy 0, policy_version 79651 (0.0009) [2023-12-27 19:48:08,640][106225] Updated weights for policy 1, policy_version 79666 (0.0006) [2023-12-27 19:48:08,666][106226] Updated weights for policy 0, policy_version 79661 (0.0007) [2023-12-27 19:48:08,701][106225] Updated weights for policy 1, policy_version 79676 (0.0009) [2023-12-27 19:48:08,719][106226] Updated weights for policy 0, policy_version 79671 (0.0006) [2023-12-27 19:48:08,758][106225] Updated weights for policy 1, policy_version 79686 (0.0008) [2023-12-27 19:48:08,778][106226] Updated weights for policy 0, policy_version 79681 (0.0007) [2023-12-27 19:48:08,815][106225] Updated weights for policy 1, policy_version 79696 (0.0006) [2023-12-27 19:48:09,498][106225] Updated weights for policy 1, policy_version 79706 (0.0008) [2023-12-27 19:48:09,561][106225] Updated weights for policy 1, policy_version 79716 (0.0009) [2023-12-27 19:48:09,569][106226] Updated weights for policy 0, policy_version 79691 (0.0010) [2023-12-27 19:48:09,623][106225] Updated weights for policy 1, policy_version 79726 (0.0008) [2023-12-27 19:48:09,626][106226] Updated weights for policy 0, policy_version 79701 (0.0006) [2023-12-27 19:48:09,688][106226] Updated weights for policy 0, policy_version 79711 (0.0008) [2023-12-27 19:48:10,303][106225] Updated weights for policy 1, policy_version 79736 (0.0008) [2023-12-27 19:48:10,371][106225] Updated weights for policy 1, policy_version 79746 (0.0009) [2023-12-27 19:48:10,433][106225] Updated weights for policy 1, policy_version 79756 (0.0009) [2023-12-27 19:48:10,464][106226] Updated weights for policy 0, policy_version 79721 (0.0009) [2023-12-27 19:48:10,523][106226] Updated weights for policy 0, policy_version 79731 (0.0009) [2023-12-27 19:48:10,576][106226] Updated weights for policy 0, policy_version 79741 (0.0008) [2023-12-27 19:48:10,629][106226] Updated weights for policy 0, policy_version 79751 (0.0008) [2023-12-27 19:48:11,104][106225] Updated weights for policy 1, policy_version 79766 (0.0009) [2023-12-27 19:48:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 40845312. Throughput: 0: 10187.6, 1: 9934.9. Samples: 40821024. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:11,175][105115] Avg episode reward: [(0, '-5.164'), (1, '-6.598')] [2023-12-27 19:48:11,178][106225] Updated weights for policy 1, policy_version 79776 (0.0009) [2023-12-27 19:48:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000079752_20422656.pth... [2023-12-27 19:48:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000078600_20127744.pth [2023-12-27 19:48:11,243][106225] Updated weights for policy 1, policy_version 79786 (0.0010) [2023-12-27 19:48:11,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000079792_20430848.pth... [2023-12-27 19:48:11,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000078608_20127744.pth [2023-12-27 19:48:11,378][106226] Updated weights for policy 0, policy_version 79761 (0.0009) [2023-12-27 19:48:11,440][106226] Updated weights for policy 0, policy_version 79771 (0.0007) [2023-12-27 19:48:11,495][106226] Updated weights for policy 0, policy_version 79781 (0.0008) [2023-12-27 19:48:12,024][106225] Updated weights for policy 1, policy_version 79796 (0.0009) [2023-12-27 19:48:12,091][106225] Updated weights for policy 1, policy_version 79806 (0.0011) [2023-12-27 19:48:12,152][106225] Updated weights for policy 1, policy_version 79816 (0.0010) [2023-12-27 19:48:12,256][106226] Updated weights for policy 0, policy_version 79791 (0.0007) [2023-12-27 19:48:12,326][106226] Updated weights for policy 0, policy_version 79801 (0.0006) [2023-12-27 19:48:12,398][106226] Updated weights for policy 0, policy_version 79811 (0.0007) [2023-12-27 19:48:12,841][106225] Updated weights for policy 1, policy_version 79826 (0.0010) [2023-12-27 19:48:12,899][106225] Updated weights for policy 1, policy_version 79836 (0.0007) [2023-12-27 19:48:12,955][106225] Updated weights for policy 1, policy_version 79846 (0.0010) [2023-12-27 19:48:13,017][106225] Updated weights for policy 1, policy_version 79856 (0.0010) [2023-12-27 19:48:13,054][106226] Updated weights for policy 0, policy_version 79821 (0.0009) [2023-12-27 19:48:13,100][106226] Updated weights for policy 0, policy_version 79831 (0.0008) [2023-12-27 19:48:13,150][106226] Updated weights for policy 0, policy_version 79841 (0.0008) [2023-12-27 19:48:13,682][106225] Updated weights for policy 1, policy_version 79866 (0.0008) [2023-12-27 19:48:13,728][106225] Updated weights for policy 1, policy_version 79876 (0.0008) [2023-12-27 19:48:13,774][106225] Updated weights for policy 1, policy_version 79886 (0.0008) [2023-12-27 19:48:13,920][106226] Updated weights for policy 0, policy_version 79851 (0.0008) [2023-12-27 19:48:13,967][106226] Updated weights for policy 0, policy_version 79861 (0.0010) [2023-12-27 19:48:14,018][106226] Updated weights for policy 0, policy_version 79871 (0.0011) [2023-12-27 19:48:14,456][106225] Updated weights for policy 1, policy_version 79896 (0.0007) [2023-12-27 19:48:14,510][106225] Updated weights for policy 1, policy_version 79906 (0.0008) [2023-12-27 19:48:14,562][106225] Updated weights for policy 1, policy_version 79916 (0.0007) [2023-12-27 19:48:14,695][106226] Updated weights for policy 0, policy_version 79881 (0.0009) [2023-12-27 19:48:14,759][106226] Updated weights for policy 0, policy_version 79891 (0.0007) [2023-12-27 19:48:14,824][106226] Updated weights for policy 0, policy_version 79901 (0.0011) [2023-12-27 19:48:14,890][106226] Updated weights for policy 0, policy_version 79911 (0.0011) [2023-12-27 19:48:15,316][106225] Updated weights for policy 1, policy_version 79926 (0.0007) [2023-12-27 19:48:15,377][106225] Updated weights for policy 1, policy_version 79936 (0.0008) [2023-12-27 19:48:15,438][106225] Updated weights for policy 1, policy_version 79946 (0.0007) [2023-12-27 19:48:15,583][106226] Updated weights for policy 0, policy_version 79921 (0.0010) [2023-12-27 19:48:15,636][106226] Updated weights for policy 0, policy_version 79931 (0.0010) [2023-12-27 19:48:15,692][106226] Updated weights for policy 0, policy_version 79941 (0.0010) [2023-12-27 19:48:16,061][106225] Updated weights for policy 1, policy_version 79956 (0.0005) [2023-12-27 19:48:16,122][106225] Updated weights for policy 1, policy_version 79966 (0.0006) [2023-12-27 19:48:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 40943616. Throughput: 0: 9975.8, 1: 9955.6. Samples: 40937344. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:16,175][105115] Avg episode reward: [(0, '-5.355'), (1, '-6.515')] [2023-12-27 19:48:16,193][106225] Updated weights for policy 1, policy_version 79976 (0.0010) [2023-12-27 19:48:16,277][106226] Updated weights for policy 0, policy_version 79951 (0.0010) [2023-12-27 19:48:16,327][106226] Updated weights for policy 0, policy_version 79961 (0.0010) [2023-12-27 19:48:16,390][106226] Updated weights for policy 0, policy_version 79971 (0.0010) [2023-12-27 19:48:16,866][106225] Updated weights for policy 1, policy_version 79986 (0.0010) [2023-12-27 19:48:16,929][106225] Updated weights for policy 1, policy_version 79996 (0.0010) [2023-12-27 19:48:16,983][106225] Updated weights for policy 1, policy_version 80006 (0.0010) [2023-12-27 19:48:17,037][106225] Updated weights for policy 1, policy_version 80016 (0.0010) [2023-12-27 19:48:17,121][106226] Updated weights for policy 0, policy_version 79981 (0.0010) [2023-12-27 19:48:17,171][106226] Updated weights for policy 0, policy_version 79991 (0.0010) [2023-12-27 19:48:17,230][106226] Updated weights for policy 0, policy_version 80001 (0.0010) [2023-12-27 19:48:17,645][106225] Updated weights for policy 1, policy_version 80026 (0.0005) [2023-12-27 19:48:17,701][106225] Updated weights for policy 1, policy_version 80036 (0.0005) [2023-12-27 19:48:17,756][106225] Updated weights for policy 1, policy_version 80046 (0.0005) [2023-12-27 19:48:17,954][106226] Updated weights for policy 0, policy_version 80011 (0.0009) [2023-12-27 19:48:18,011][106226] Updated weights for policy 0, policy_version 80021 (0.0006) [2023-12-27 19:48:18,069][106226] Updated weights for policy 0, policy_version 80031 (0.0006) [2023-12-27 19:48:18,325][106225] Updated weights for policy 1, policy_version 80056 (0.0008) [2023-12-27 19:48:18,393][106225] Updated weights for policy 1, policy_version 80066 (0.0007) [2023-12-27 19:48:18,450][106225] Updated weights for policy 1, policy_version 80076 (0.0006) [2023-12-27 19:48:18,668][106226] Updated weights for policy 0, policy_version 80041 (0.0006) [2023-12-27 19:48:18,723][106226] Updated weights for policy 0, policy_version 80051 (0.0011) [2023-12-27 19:48:18,787][106226] Updated weights for policy 0, policy_version 80061 (0.0010) [2023-12-27 19:48:18,857][106226] Updated weights for policy 0, policy_version 80071 (0.0011) [2023-12-27 19:48:19,117][106225] Updated weights for policy 1, policy_version 80086 (0.0006) [2023-12-27 19:48:19,176][106225] Updated weights for policy 1, policy_version 80096 (0.0008) [2023-12-27 19:48:19,250][106225] Updated weights for policy 1, policy_version 80106 (0.0008) [2023-12-27 19:48:19,623][106226] Updated weights for policy 0, policy_version 80081 (0.0008) [2023-12-27 19:48:19,690][106226] Updated weights for policy 0, policy_version 80091 (0.0011) [2023-12-27 19:48:19,754][106226] Updated weights for policy 0, policy_version 80101 (0.0009) [2023-12-27 19:48:19,909][106225] Updated weights for policy 1, policy_version 80116 (0.0009) [2023-12-27 19:48:19,974][106225] Updated weights for policy 1, policy_version 80126 (0.0009) [2023-12-27 19:48:20,038][106225] Updated weights for policy 1, policy_version 80136 (0.0007) [2023-12-27 19:48:20,436][106226] Updated weights for policy 0, policy_version 80111 (0.0009) [2023-12-27 19:48:20,486][106226] Updated weights for policy 0, policy_version 80121 (0.0010) [2023-12-27 19:48:20,546][106226] Updated weights for policy 0, policy_version 80131 (0.0011) [2023-12-27 19:48:20,753][106225] Updated weights for policy 1, policy_version 80146 (0.0007) [2023-12-27 19:48:20,819][106225] Updated weights for policy 1, policy_version 80156 (0.0005) [2023-12-27 19:48:20,875][106225] Updated weights for policy 1, policy_version 80166 (0.0005) [2023-12-27 19:48:20,929][106225] Updated weights for policy 1, policy_version 80176 (0.0005) [2023-12-27 19:48:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 41050112. Throughput: 0: 9935.4, 1: 10014.2. Samples: 41059068. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:21,175][105115] Avg episode reward: [(0, '-4.955'), (1, '-6.555')] [2023-12-27 19:48:21,357][106226] Updated weights for policy 0, policy_version 80141 (0.0009) [2023-12-27 19:48:21,434][106226] Updated weights for policy 0, policy_version 80151 (0.0008) [2023-12-27 19:48:21,504][106226] Updated weights for policy 0, policy_version 80161 (0.0008) [2023-12-27 19:48:21,580][106225] Updated weights for policy 1, policy_version 80186 (0.0007) [2023-12-27 19:48:21,654][106225] Updated weights for policy 1, policy_version 80196 (0.0009) [2023-12-27 19:48:21,729][106225] Updated weights for policy 1, policy_version 80206 (0.0008) [2023-12-27 19:48:22,317][106226] Updated weights for policy 0, policy_version 80171 (0.0008) [2023-12-27 19:48:22,390][106226] Updated weights for policy 0, policy_version 80181 (0.0008) [2023-12-27 19:48:22,423][106225] Updated weights for policy 1, policy_version 80216 (0.0006) [2023-12-27 19:48:22,448][106226] Updated weights for policy 0, policy_version 80191 (0.0009) [2023-12-27 19:48:22,484][106225] Updated weights for policy 1, policy_version 80226 (0.0006) [2023-12-27 19:48:22,550][106225] Updated weights for policy 1, policy_version 80236 (0.0008) [2023-12-27 19:48:23,174][106225] Updated weights for policy 1, policy_version 80246 (0.0009) [2023-12-27 19:48:23,189][106226] Updated weights for policy 0, policy_version 80201 (0.0009) [2023-12-27 19:48:23,220][106225] Updated weights for policy 1, policy_version 80256 (0.0007) [2023-12-27 19:48:23,246][106226] Updated weights for policy 0, policy_version 80211 (0.0011) [2023-12-27 19:48:23,278][106225] Updated weights for policy 1, policy_version 80266 (0.0007) [2023-12-27 19:48:23,307][106226] Updated weights for policy 0, policy_version 80221 (0.0011) [2023-12-27 19:48:23,371][106226] Updated weights for policy 0, policy_version 80231 (0.0010) [2023-12-27 19:48:23,950][106225] Updated weights for policy 1, policy_version 80276 (0.0006) [2023-12-27 19:48:23,992][106226] Updated weights for policy 0, policy_version 80241 (0.0008) [2023-12-27 19:48:24,011][106225] Updated weights for policy 1, policy_version 80286 (0.0007) [2023-12-27 19:48:24,053][106226] Updated weights for policy 0, policy_version 80251 (0.0007) [2023-12-27 19:48:24,061][106225] Updated weights for policy 1, policy_version 80296 (0.0009) [2023-12-27 19:48:24,107][106226] Updated weights for policy 0, policy_version 80261 (0.0006) [2023-12-27 19:48:24,772][106225] Updated weights for policy 1, policy_version 80306 (0.0010) [2023-12-27 19:48:24,827][106225] Updated weights for policy 1, policy_version 80316 (0.0010) [2023-12-27 19:48:24,848][106226] Updated weights for policy 0, policy_version 80271 (0.0006) [2023-12-27 19:48:24,877][106225] Updated weights for policy 1, policy_version 80326 (0.0010) [2023-12-27 19:48:24,907][106226] Updated weights for policy 0, policy_version 80281 (0.0005) [2023-12-27 19:48:24,938][106225] Updated weights for policy 1, policy_version 80336 (0.0010) [2023-12-27 19:48:24,963][106226] Updated weights for policy 0, policy_version 80291 (0.0007) [2023-12-27 19:48:25,667][106225] Updated weights for policy 1, policy_version 80346 (0.0006) [2023-12-27 19:48:25,705][106226] Updated weights for policy 0, policy_version 80301 (0.0009) [2023-12-27 19:48:25,720][106225] Updated weights for policy 1, policy_version 80356 (0.0005) [2023-12-27 19:48:25,761][106226] Updated weights for policy 0, policy_version 80311 (0.0006) [2023-12-27 19:48:25,770][106225] Updated weights for policy 1, policy_version 80366 (0.0007) [2023-12-27 19:48:25,818][106226] Updated weights for policy 0, policy_version 80321 (0.0008) [2023-12-27 19:48:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 41148416. Throughput: 0: 9916.1, 1: 10050.2. Samples: 41118228. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:26,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-6.542')] [2023-12-27 19:48:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000080368_20578304.pth... [2023-12-27 19:48:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000080328_20570112.pth... [2023-12-27 19:48:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000079216_20283392.pth [2023-12-27 19:48:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000079176_20275200.pth [2023-12-27 19:48:26,444][106226] Updated weights for policy 0, policy_version 80331 (0.0008) [2023-12-27 19:48:26,473][106225] Updated weights for policy 1, policy_version 80376 (0.0008) [2023-12-27 19:48:26,501][106226] Updated weights for policy 0, policy_version 80341 (0.0007) [2023-12-27 19:48:26,526][106225] Updated weights for policy 1, policy_version 80386 (0.0008) [2023-12-27 19:48:26,551][106226] Updated weights for policy 0, policy_version 80351 (0.0005) [2023-12-27 19:48:26,574][106225] Updated weights for policy 1, policy_version 80396 (0.0007) [2023-12-27 19:48:27,181][106225] Updated weights for policy 1, policy_version 80406 (0.0008) [2023-12-27 19:48:27,233][106225] Updated weights for policy 1, policy_version 80416 (0.0008) [2023-12-27 19:48:27,284][106226] Updated weights for policy 0, policy_version 80361 (0.0007) [2023-12-27 19:48:27,291][106225] Updated weights for policy 1, policy_version 80426 (0.0008) [2023-12-27 19:48:27,350][106226] Updated weights for policy 0, policy_version 80371 (0.0011) [2023-12-27 19:48:27,400][106226] Updated weights for policy 0, policy_version 80381 (0.0010) [2023-12-27 19:48:27,449][106226] Updated weights for policy 0, policy_version 80391 (0.0010) [2023-12-27 19:48:28,007][106226] Updated weights for policy 0, policy_version 80401 (0.0009) [2023-12-27 19:48:28,056][106226] Updated weights for policy 0, policy_version 80411 (0.0010) [2023-12-27 19:48:28,061][106225] Updated weights for policy 1, policy_version 80436 (0.0006) [2023-12-27 19:48:28,112][106226] Updated weights for policy 0, policy_version 80421 (0.0010) [2023-12-27 19:48:28,118][106225] Updated weights for policy 1, policy_version 80446 (0.0005) [2023-12-27 19:48:28,173][106225] Updated weights for policy 1, policy_version 80456 (0.0007) [2023-12-27 19:48:28,700][106226] Updated weights for policy 0, policy_version 80431 (0.0008) [2023-12-27 19:48:28,757][106226] Updated weights for policy 0, policy_version 80441 (0.0010) [2023-12-27 19:48:28,808][106226] Updated weights for policy 0, policy_version 80451 (0.0010) [2023-12-27 19:48:28,956][106225] Updated weights for policy 1, policy_version 80466 (0.0007) [2023-12-27 19:48:29,015][106225] Updated weights for policy 1, policy_version 80476 (0.0007) [2023-12-27 19:48:29,064][106225] Updated weights for policy 1, policy_version 80486 (0.0007) [2023-12-27 19:48:29,117][106225] Updated weights for policy 1, policy_version 80496 (0.0007) [2023-12-27 19:48:29,541][106226] Updated weights for policy 0, policy_version 80461 (0.0010) [2023-12-27 19:48:29,592][106226] Updated weights for policy 0, policy_version 80471 (0.0009) [2023-12-27 19:48:29,656][106226] Updated weights for policy 0, policy_version 80481 (0.0010) [2023-12-27 19:48:29,818][106225] Updated weights for policy 1, policy_version 80506 (0.0006) [2023-12-27 19:48:29,882][106225] Updated weights for policy 1, policy_version 80516 (0.0006) [2023-12-27 19:48:29,950][106225] Updated weights for policy 1, policy_version 80526 (0.0008) [2023-12-27 19:48:30,312][106226] Updated weights for policy 0, policy_version 80491 (0.0007) [2023-12-27 19:48:30,374][106226] Updated weights for policy 0, policy_version 80501 (0.0006) [2023-12-27 19:48:30,430][106226] Updated weights for policy 0, policy_version 80511 (0.0008) [2023-12-27 19:48:30,606][106225] Updated weights for policy 1, policy_version 80536 (0.0010) [2023-12-27 19:48:30,663][106225] Updated weights for policy 1, policy_version 80546 (0.0010) [2023-12-27 19:48:30,720][106225] Updated weights for policy 1, policy_version 80556 (0.0010) [2023-12-27 19:48:31,051][106226] Updated weights for policy 0, policy_version 80521 (0.0007) [2023-12-27 19:48:31,113][106226] Updated weights for policy 0, policy_version 80531 (0.0007) [2023-12-27 19:48:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 41246720. Throughput: 0: 9983.6, 1: 10062.9. Samples: 41238816. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:31,175][105115] Avg episode reward: [(0, '-5.143'), (1, '-6.425')] [2023-12-27 19:48:31,182][106226] Updated weights for policy 0, policy_version 80541 (0.0007) [2023-12-27 19:48:31,248][106226] Updated weights for policy 0, policy_version 80551 (0.0009) [2023-12-27 19:48:31,455][106225] Updated weights for policy 1, policy_version 80566 (0.0010) [2023-12-27 19:48:31,502][106225] Updated weights for policy 1, policy_version 80576 (0.0010) [2023-12-27 19:48:31,550][106225] Updated weights for policy 1, policy_version 80586 (0.0010) [2023-12-27 19:48:31,929][106226] Updated weights for policy 0, policy_version 80561 (0.0006) [2023-12-27 19:48:31,996][106226] Updated weights for policy 0, policy_version 80571 (0.0006) [2023-12-27 19:48:32,061][106226] Updated weights for policy 0, policy_version 80581 (0.0006) [2023-12-27 19:48:32,307][106225] Updated weights for policy 1, policy_version 80596 (0.0010) [2023-12-27 19:48:32,373][106225] Updated weights for policy 1, policy_version 80606 (0.0010) [2023-12-27 19:48:32,440][106225] Updated weights for policy 1, policy_version 80616 (0.0006) [2023-12-27 19:48:32,773][106226] Updated weights for policy 0, policy_version 80591 (0.0008) [2023-12-27 19:48:32,825][106226] Updated weights for policy 0, policy_version 80601 (0.0008) [2023-12-27 19:48:32,878][106226] Updated weights for policy 0, policy_version 80611 (0.0008) [2023-12-27 19:48:33,077][106225] Updated weights for policy 1, policy_version 80626 (0.0009) [2023-12-27 19:48:33,132][106225] Updated weights for policy 1, policy_version 80636 (0.0010) [2023-12-27 19:48:33,185][106225] Updated weights for policy 1, policy_version 80646 (0.0007) [2023-12-27 19:48:33,231][106225] Updated weights for policy 1, policy_version 80656 (0.0010) [2023-12-27 19:48:33,626][106226] Updated weights for policy 0, policy_version 80621 (0.0008) [2023-12-27 19:48:33,679][106226] Updated weights for policy 0, policy_version 80631 (0.0009) [2023-12-27 19:48:33,739][106226] Updated weights for policy 0, policy_version 80641 (0.0008) [2023-12-27 19:48:33,888][106225] Updated weights for policy 1, policy_version 80666 (0.0010) [2023-12-27 19:48:33,943][106225] Updated weights for policy 1, policy_version 80676 (0.0010) [2023-12-27 19:48:34,008][106225] Updated weights for policy 1, policy_version 80686 (0.0010) [2023-12-27 19:48:34,532][106226] Updated weights for policy 0, policy_version 80651 (0.0007) [2023-12-27 19:48:34,595][106226] Updated weights for policy 0, policy_version 80661 (0.0008) [2023-12-27 19:48:34,656][106226] Updated weights for policy 0, policy_version 80671 (0.0009) [2023-12-27 19:48:34,729][106225] Updated weights for policy 1, policy_version 80696 (0.0007) [2023-12-27 19:48:34,788][106225] Updated weights for policy 1, policy_version 80706 (0.0008) [2023-12-27 19:48:34,846][106225] Updated weights for policy 1, policy_version 80716 (0.0008) [2023-12-27 19:48:35,411][106226] Updated weights for policy 0, policy_version 80681 (0.0009) [2023-12-27 19:48:35,468][106226] Updated weights for policy 0, policy_version 80691 (0.0007) [2023-12-27 19:48:35,484][106225] Updated weights for policy 1, policy_version 80726 (0.0007) [2023-12-27 19:48:35,526][106226] Updated weights for policy 0, policy_version 80701 (0.0009) [2023-12-27 19:48:35,540][106225] Updated weights for policy 1, policy_version 80736 (0.0007) [2023-12-27 19:48:35,593][106226] Updated weights for policy 0, policy_version 80711 (0.0008) [2023-12-27 19:48:35,601][106225] Updated weights for policy 1, policy_version 80746 (0.0006) [2023-12-27 19:48:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 41345024. Throughput: 0: 9967.3, 1: 9995.2. Samples: 41358672. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:36,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-6.285')] [2023-12-27 19:48:36,247][106226] Updated weights for policy 0, policy_version 80721 (0.0010) [2023-12-27 19:48:36,312][106226] Updated weights for policy 0, policy_version 80731 (0.0010) [2023-12-27 19:48:36,321][106225] Updated weights for policy 1, policy_version 80756 (0.0006) [2023-12-27 19:48:36,377][106226] Updated weights for policy 0, policy_version 80741 (0.0011) [2023-12-27 19:48:36,383][106225] Updated weights for policy 1, policy_version 80766 (0.0006) [2023-12-27 19:48:36,447][106225] Updated weights for policy 1, policy_version 80776 (0.0006) [2023-12-27 19:48:37,049][106225] Updated weights for policy 1, policy_version 80786 (0.0008) [2023-12-27 19:48:37,071][106226] Updated weights for policy 0, policy_version 80751 (0.0009) [2023-12-27 19:48:37,100][106225] Updated weights for policy 1, policy_version 80796 (0.0006) [2023-12-27 19:48:37,133][106226] Updated weights for policy 0, policy_version 80761 (0.0008) [2023-12-27 19:48:37,148][106225] Updated weights for policy 1, policy_version 80806 (0.0007) [2023-12-27 19:48:37,189][106226] Updated weights for policy 0, policy_version 80771 (0.0010) [2023-12-27 19:48:37,199][106225] Updated weights for policy 1, policy_version 80816 (0.0006) [2023-12-27 19:48:37,814][106226] Updated weights for policy 0, policy_version 80781 (0.0011) [2023-12-27 19:48:37,871][106226] Updated weights for policy 0, policy_version 80791 (0.0011) [2023-12-27 19:48:37,940][106226] Updated weights for policy 0, policy_version 80801 (0.0011) [2023-12-27 19:48:37,977][106225] Updated weights for policy 1, policy_version 80826 (0.0006) [2023-12-27 19:48:38,033][106225] Updated weights for policy 1, policy_version 80836 (0.0008) [2023-12-27 19:48:38,092][106225] Updated weights for policy 1, policy_version 80846 (0.0007) [2023-12-27 19:48:38,648][106226] Updated weights for policy 0, policy_version 80811 (0.0010) [2023-12-27 19:48:38,698][106225] Updated weights for policy 1, policy_version 80856 (0.0007) [2023-12-27 19:48:38,709][106226] Updated weights for policy 0, policy_version 80821 (0.0011) [2023-12-27 19:48:38,763][106225] Updated weights for policy 1, policy_version 80866 (0.0006) [2023-12-27 19:48:38,770][106226] Updated weights for policy 0, policy_version 80831 (0.0011) [2023-12-27 19:48:38,825][106225] Updated weights for policy 1, policy_version 80876 (0.0006) [2023-12-27 19:48:39,479][106225] Updated weights for policy 1, policy_version 80886 (0.0008) [2023-12-27 19:48:39,529][106226] Updated weights for policy 0, policy_version 80841 (0.0010) [2023-12-27 19:48:39,530][106225] Updated weights for policy 1, policy_version 80896 (0.0008) [2023-12-27 19:48:39,588][106225] Updated weights for policy 1, policy_version 80906 (0.0008) [2023-12-27 19:48:39,596][106226] Updated weights for policy 0, policy_version 80851 (0.0010) [2023-12-27 19:48:39,662][106226] Updated weights for policy 0, policy_version 80861 (0.0010) [2023-12-27 19:48:39,723][106226] Updated weights for policy 0, policy_version 80871 (0.0011) [2023-12-27 19:48:40,355][106225] Updated weights for policy 1, policy_version 80916 (0.0007) [2023-12-27 19:48:40,422][106225] Updated weights for policy 1, policy_version 80926 (0.0005) [2023-12-27 19:48:40,463][106226] Updated weights for policy 0, policy_version 80881 (0.0011) [2023-12-27 19:48:40,480][106225] Updated weights for policy 1, policy_version 80936 (0.0006) [2023-12-27 19:48:40,518][106226] Updated weights for policy 0, policy_version 80891 (0.0010) [2023-12-27 19:48:40,575][106226] Updated weights for policy 0, policy_version 80901 (0.0010) [2023-12-27 19:48:41,173][106225] Updated weights for policy 1, policy_version 80946 (0.0006) [2023-12-27 19:48:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 41443328. Throughput: 0: 9992.6, 1: 10017.1. Samples: 41419544. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-27 19:48:41,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-6.613')] [2023-12-27 19:48:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000080904_20717568.pth... [2023-12-27 19:48:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000079752_20422656.pth [2023-12-27 19:48:41,190][106140] Saving new best policy, reward=-4.733! [2023-12-27 19:48:41,238][106225] Updated weights for policy 1, policy_version 80956 (0.0007) [2023-12-27 19:48:41,309][106225] Updated weights for policy 1, policy_version 80966 (0.0009) [2023-12-27 19:48:41,336][106226] Updated weights for policy 0, policy_version 80911 (0.0011) [2023-12-27 19:48:41,372][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000080976_20733952.pth... [2023-12-27 19:48:41,372][106225] Updated weights for policy 1, policy_version 80976 (0.0007) [2023-12-27 19:48:41,377][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000079792_20430848.pth [2023-12-27 19:48:41,406][106226] Updated weights for policy 0, policy_version 80921 (0.0009) [2023-12-27 19:48:41,469][106226] Updated weights for policy 0, policy_version 80931 (0.0008) [2023-12-27 19:48:42,198][106225] Updated weights for policy 1, policy_version 80986 (0.0008) [2023-12-27 19:48:42,201][106226] Updated weights for policy 0, policy_version 80941 (0.0008) [2023-12-27 19:48:42,270][106225] Updated weights for policy 1, policy_version 80996 (0.0007) [2023-12-27 19:48:42,271][106226] Updated weights for policy 0, policy_version 80951 (0.0008) [2023-12-27 19:48:42,328][106226] Updated weights for policy 0, policy_version 80961 (0.0007) [2023-12-27 19:48:42,328][106225] Updated weights for policy 1, policy_version 81006 (0.0007) [2023-12-27 19:48:42,898][106225] Updated weights for policy 1, policy_version 81016 (0.0009) [2023-12-27 19:48:42,959][106225] Updated weights for policy 1, policy_version 81026 (0.0006) [2023-12-27 19:48:43,032][106225] Updated weights for policy 1, policy_version 81036 (0.0005) [2023-12-27 19:48:43,074][106226] Updated weights for policy 0, policy_version 80971 (0.0008) [2023-12-27 19:48:43,125][106226] Updated weights for policy 0, policy_version 80981 (0.0005) [2023-12-27 19:48:43,173][106226] Updated weights for policy 0, policy_version 80991 (0.0005) [2023-12-27 19:48:43,543][106225] Updated weights for policy 1, policy_version 81046 (0.0007) [2023-12-27 19:48:43,600][106225] Updated weights for policy 1, policy_version 81056 (0.0005) [2023-12-27 19:48:43,671][106225] Updated weights for policy 1, policy_version 81066 (0.0005) [2023-12-27 19:48:43,719][106226] Updated weights for policy 0, policy_version 81001 (0.0006) [2023-12-27 19:48:43,769][106226] Updated weights for policy 0, policy_version 81011 (0.0010) [2023-12-27 19:48:43,821][106226] Updated weights for policy 0, policy_version 81021 (0.0007) [2023-12-27 19:48:43,875][106226] Updated weights for policy 0, policy_version 81031 (0.0005) [2023-12-27 19:48:44,352][106225] Updated weights for policy 1, policy_version 81076 (0.0008) [2023-12-27 19:48:44,400][106225] Updated weights for policy 1, policy_version 81086 (0.0007) [2023-12-27 19:48:44,452][106225] Updated weights for policy 1, policy_version 81096 (0.0010) [2023-12-27 19:48:44,488][106226] Updated weights for policy 0, policy_version 81041 (0.0006) [2023-12-27 19:48:44,538][106226] Updated weights for policy 0, policy_version 81051 (0.0007) [2023-12-27 19:48:44,582][106226] Updated weights for policy 0, policy_version 81061 (0.0008) [2023-12-27 19:48:45,173][106225] Updated weights for policy 1, policy_version 81106 (0.0007) [2023-12-27 19:48:45,240][106225] Updated weights for policy 1, policy_version 81116 (0.0010) [2023-12-27 19:48:45,298][106225] Updated weights for policy 1, policy_version 81126 (0.0007) [2023-12-27 19:48:45,317][106226] Updated weights for policy 0, policy_version 81071 (0.0008) [2023-12-27 19:48:45,350][106225] Updated weights for policy 1, policy_version 81136 (0.0007) [2023-12-27 19:48:45,384][106226] Updated weights for policy 0, policy_version 81081 (0.0009) [2023-12-27 19:48:45,449][106226] Updated weights for policy 0, policy_version 81091 (0.0008) [2023-12-27 19:48:46,066][106225] Updated weights for policy 1, policy_version 81146 (0.0008) [2023-12-27 19:48:46,117][106225] Updated weights for policy 1, policy_version 81156 (0.0008) [2023-12-27 19:48:46,134][106226] Updated weights for policy 0, policy_version 81101 (0.0008) [2023-12-27 19:48:46,163][106225] Updated weights for policy 1, policy_version 81166 (0.0006) [2023-12-27 19:48:46,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 41549824. Throughput: 0: 9936.9, 1: 9987.0. Samples: 41539472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:48:46,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-6.081')] [2023-12-27 19:48:46,190][106226] Updated weights for policy 0, policy_version 81111 (0.0008) [2023-12-27 19:48:46,235][106226] Updated weights for policy 0, policy_version 81121 (0.0008) [2023-12-27 19:48:46,266][106140] Saving new best policy, reward=-4.527! [2023-12-27 19:48:46,877][106226] Updated weights for policy 0, policy_version 81131 (0.0009) [2023-12-27 19:48:46,924][106226] Updated weights for policy 0, policy_version 81141 (0.0010) [2023-12-27 19:48:46,936][106225] Updated weights for policy 1, policy_version 81176 (0.0007) [2023-12-27 19:48:46,971][106226] Updated weights for policy 0, policy_version 81151 (0.0010) [2023-12-27 19:48:46,991][106225] Updated weights for policy 1, policy_version 81186 (0.0006) [2023-12-27 19:48:47,047][106225] Updated weights for policy 1, policy_version 81196 (0.0006) [2023-12-27 19:48:47,668][106226] Updated weights for policy 0, policy_version 81161 (0.0010) [2023-12-27 19:48:47,710][106225] Updated weights for policy 1, policy_version 81206 (0.0009) [2023-12-27 19:48:47,730][106226] Updated weights for policy 0, policy_version 81171 (0.0009) [2023-12-27 19:48:47,779][106225] Updated weights for policy 1, policy_version 81216 (0.0010) [2023-12-27 19:48:47,792][106226] Updated weights for policy 0, policy_version 81181 (0.0008) [2023-12-27 19:48:47,832][106225] Updated weights for policy 1, policy_version 81226 (0.0010) [2023-12-27 19:48:47,850][106226] Updated weights for policy 0, policy_version 81191 (0.0010) [2023-12-27 19:48:48,519][106225] Updated weights for policy 1, policy_version 81236 (0.0009) [2023-12-27 19:48:48,552][106226] Updated weights for policy 0, policy_version 81201 (0.0011) [2023-12-27 19:48:48,575][106225] Updated weights for policy 1, policy_version 81246 (0.0008) [2023-12-27 19:48:48,614][106226] Updated weights for policy 0, policy_version 81211 (0.0011) [2023-12-27 19:48:48,637][106225] Updated weights for policy 1, policy_version 81256 (0.0008) [2023-12-27 19:48:48,675][106226] Updated weights for policy 0, policy_version 81221 (0.0011) [2023-12-27 19:48:49,348][106226] Updated weights for policy 0, policy_version 81231 (0.0010) [2023-12-27 19:48:49,353][106225] Updated weights for policy 1, policy_version 81266 (0.0009) [2023-12-27 19:48:49,416][106226] Updated weights for policy 0, policy_version 81241 (0.0012) [2023-12-27 19:48:49,424][106225] Updated weights for policy 1, policy_version 81276 (0.0007) [2023-12-27 19:48:49,484][106226] Updated weights for policy 0, policy_version 81251 (0.0010) [2023-12-27 19:48:49,490][106225] Updated weights for policy 1, policy_version 81286 (0.0007) [2023-12-27 19:48:49,552][106225] Updated weights for policy 1, policy_version 81296 (0.0007) [2023-12-27 19:48:50,217][106226] Updated weights for policy 0, policy_version 81261 (0.0010) [2023-12-27 19:48:50,275][106226] Updated weights for policy 0, policy_version 81271 (0.0011) [2023-12-27 19:48:50,306][106225] Updated weights for policy 1, policy_version 81306 (0.0008) [2023-12-27 19:48:50,335][106226] Updated weights for policy 0, policy_version 81281 (0.0010) [2023-12-27 19:48:50,366][106225] Updated weights for policy 1, policy_version 81316 (0.0007) [2023-12-27 19:48:50,427][106225] Updated weights for policy 1, policy_version 81326 (0.0007) [2023-12-27 19:48:51,051][106226] Updated weights for policy 0, policy_version 81291 (0.0010) [2023-12-27 19:48:51,119][106226] Updated weights for policy 0, policy_version 81301 (0.0007) [2023-12-27 19:48:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 41639936. Throughput: 0: 9873.2, 1: 9998.5. Samples: 41657152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:48:51,175][105115] Avg episode reward: [(0, '-4.961'), (1, '-6.383')] [2023-12-27 19:48:51,181][106226] Updated weights for policy 0, policy_version 81311 (0.0011) [2023-12-27 19:48:51,192][106225] Updated weights for policy 1, policy_version 81336 (0.0007) [2023-12-27 19:48:51,255][106225] Updated weights for policy 1, policy_version 81346 (0.0006) [2023-12-27 19:48:51,313][106225] Updated weights for policy 1, policy_version 81356 (0.0007) [2023-12-27 19:48:51,886][106226] Updated weights for policy 0, policy_version 81321 (0.0010) [2023-12-27 19:48:51,956][106226] Updated weights for policy 0, policy_version 81331 (0.0011) [2023-12-27 19:48:52,018][106226] Updated weights for policy 0, policy_version 81341 (0.0011) [2023-12-27 19:48:52,073][106226] Updated weights for policy 0, policy_version 81351 (0.0011) [2023-12-27 19:48:52,132][106225] Updated weights for policy 1, policy_version 81366 (0.0008) [2023-12-27 19:48:52,184][106225] Updated weights for policy 1, policy_version 81376 (0.0008) [2023-12-27 19:48:52,242][106225] Updated weights for policy 1, policy_version 81386 (0.0008) [2023-12-27 19:48:52,805][106226] Updated weights for policy 0, policy_version 81361 (0.0011) [2023-12-27 19:48:52,860][106226] Updated weights for policy 0, policy_version 81371 (0.0010) [2023-12-27 19:48:52,908][106226] Updated weights for policy 0, policy_version 81381 (0.0010) [2023-12-27 19:48:53,002][106225] Updated weights for policy 1, policy_version 81396 (0.0008) [2023-12-27 19:48:53,060][106225] Updated weights for policy 1, policy_version 81406 (0.0008) [2023-12-27 19:48:53,124][106225] Updated weights for policy 1, policy_version 81416 (0.0008) [2023-12-27 19:48:53,637][106226] Updated weights for policy 0, policy_version 81391 (0.0010) [2023-12-27 19:48:53,682][106225] Updated weights for policy 1, policy_version 81426 (0.0008) [2023-12-27 19:48:53,697][106226] Updated weights for policy 0, policy_version 81401 (0.0008) [2023-12-27 19:48:53,747][106226] Updated weights for policy 0, policy_version 81411 (0.0005) [2023-12-27 19:48:53,758][106225] Updated weights for policy 1, policy_version 81436 (0.0008) [2023-12-27 19:48:53,822][106225] Updated weights for policy 1, policy_version 81446 (0.0008) [2023-12-27 19:48:53,880][106225] Updated weights for policy 1, policy_version 81456 (0.0008) [2023-12-27 19:48:54,396][106226] Updated weights for policy 0, policy_version 81421 (0.0007) [2023-12-27 19:48:54,459][106226] Updated weights for policy 0, policy_version 81431 (0.0009) [2023-12-27 19:48:54,519][106226] Updated weights for policy 0, policy_version 81441 (0.0007) [2023-12-27 19:48:54,540][106225] Updated weights for policy 1, policy_version 81466 (0.0008) [2023-12-27 19:48:54,597][106225] Updated weights for policy 1, policy_version 81476 (0.0006) [2023-12-27 19:48:54,655][106225] Updated weights for policy 1, policy_version 81486 (0.0008) [2023-12-27 19:48:55,171][106226] Updated weights for policy 0, policy_version 81451 (0.0007) [2023-12-27 19:48:55,236][106226] Updated weights for policy 0, policy_version 81461 (0.0007) [2023-12-27 19:48:55,302][106226] Updated weights for policy 0, policy_version 81471 (0.0009) [2023-12-27 19:48:55,404][106225] Updated weights for policy 1, policy_version 81496 (0.0007) [2023-12-27 19:48:55,460][106225] Updated weights for policy 1, policy_version 81506 (0.0006) [2023-12-27 19:48:55,518][106225] Updated weights for policy 1, policy_version 81516 (0.0007) [2023-12-27 19:48:56,007][106226] Updated weights for policy 0, policy_version 81481 (0.0005) [2023-12-27 19:48:56,078][106226] Updated weights for policy 0, policy_version 81491 (0.0008) [2023-12-27 19:48:56,082][106225] Updated weights for policy 1, policy_version 81526 (0.0005) [2023-12-27 19:48:56,139][106226] Updated weights for policy 0, policy_version 81501 (0.0008) [2023-12-27 19:48:56,144][106225] Updated weights for policy 1, policy_version 81536 (0.0006) [2023-12-27 19:48:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 41738240. Throughput: 0: 9856.5, 1: 10017.3. Samples: 41715348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:48:56,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-6.342')] [2023-12-27 19:48:56,201][106226] Updated weights for policy 0, policy_version 81511 (0.0006) [2023-12-27 19:48:56,206][106225] Updated weights for policy 1, policy_version 81546 (0.0007) [2023-12-27 19:48:56,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000081512_20873216.pth... [2023-12-27 19:48:56,209][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000080328_20570112.pth [2023-12-27 19:48:56,236][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000081552_20881408.pth... [2023-12-27 19:48:56,240][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000080368_20578304.pth [2023-12-27 19:48:56,774][106226] Updated weights for policy 0, policy_version 81521 (0.0006) [2023-12-27 19:48:56,824][106226] Updated weights for policy 0, policy_version 81531 (0.0008) [2023-12-27 19:48:56,873][106226] Updated weights for policy 0, policy_version 81541 (0.0007) [2023-12-27 19:48:56,934][106225] Updated weights for policy 1, policy_version 81556 (0.0009) [2023-12-27 19:48:56,979][106225] Updated weights for policy 1, policy_version 81566 (0.0007) [2023-12-27 19:48:57,036][106225] Updated weights for policy 1, policy_version 81576 (0.0007) [2023-12-27 19:48:57,476][106226] Updated weights for policy 0, policy_version 81551 (0.0007) [2023-12-27 19:48:57,540][106226] Updated weights for policy 0, policy_version 81561 (0.0009) [2023-12-27 19:48:57,590][106226] Updated weights for policy 0, policy_version 81571 (0.0008) [2023-12-27 19:48:57,763][106225] Updated weights for policy 1, policy_version 81586 (0.0005) [2023-12-27 19:48:57,827][106225] Updated weights for policy 1, policy_version 81596 (0.0007) [2023-12-27 19:48:57,878][106225] Updated weights for policy 1, policy_version 81606 (0.0008) [2023-12-27 19:48:57,923][106225] Updated weights for policy 1, policy_version 81616 (0.0008) [2023-12-27 19:48:58,169][106226] Updated weights for policy 0, policy_version 81581 (0.0008) [2023-12-27 19:48:58,228][106226] Updated weights for policy 0, policy_version 81591 (0.0008) [2023-12-27 19:48:58,286][106226] Updated weights for policy 0, policy_version 81601 (0.0008) [2023-12-27 19:48:58,713][106225] Updated weights for policy 1, policy_version 81626 (0.0008) [2023-12-27 19:48:58,782][106225] Updated weights for policy 1, policy_version 81636 (0.0008) [2023-12-27 19:48:58,848][106225] Updated weights for policy 1, policy_version 81646 (0.0008) [2023-12-27 19:48:59,118][106226] Updated weights for policy 0, policy_version 81611 (0.0008) [2023-12-27 19:48:59,176][106226] Updated weights for policy 0, policy_version 81621 (0.0008) [2023-12-27 19:48:59,269][106226] Updated weights for policy 0, policy_version 81631 (0.0008) [2023-12-27 19:48:59,638][106225] Updated weights for policy 1, policy_version 81656 (0.0006) [2023-12-27 19:48:59,689][106225] Updated weights for policy 1, policy_version 81666 (0.0006) [2023-12-27 19:48:59,736][106225] Updated weights for policy 1, policy_version 81676 (0.0008) [2023-12-27 19:49:00,045][106226] Updated weights for policy 0, policy_version 81641 (0.0008) [2023-12-27 19:49:00,105][106226] Updated weights for policy 0, policy_version 81651 (0.0008) [2023-12-27 19:49:00,164][106226] Updated weights for policy 0, policy_version 81661 (0.0009) [2023-12-27 19:49:00,227][106226] Updated weights for policy 0, policy_version 81671 (0.0009) [2023-12-27 19:49:00,450][106225] Updated weights for policy 1, policy_version 81686 (0.0008) [2023-12-27 19:49:00,497][106225] Updated weights for policy 1, policy_version 81696 (0.0008) [2023-12-27 19:49:00,551][106225] Updated weights for policy 1, policy_version 81706 (0.0008) [2023-12-27 19:49:00,941][106226] Updated weights for policy 0, policy_version 81681 (0.0009) [2023-12-27 19:49:01,003][106226] Updated weights for policy 0, policy_version 81691 (0.0009) [2023-12-27 19:49:01,064][106226] Updated weights for policy 0, policy_version 81701 (0.0008) [2023-12-27 19:49:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 41844736. Throughput: 0: 9955.9, 1: 9977.1. Samples: 41834328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:01,175][105115] Avg episode reward: [(0, '-5.012'), (1, '-6.213')] [2023-12-27 19:49:01,219][106225] Updated weights for policy 1, policy_version 81716 (0.0007) [2023-12-27 19:49:01,285][106225] Updated weights for policy 1, policy_version 81726 (0.0009) [2023-12-27 19:49:01,347][106225] Updated weights for policy 1, policy_version 81736 (0.0010) [2023-12-27 19:49:01,807][106226] Updated weights for policy 0, policy_version 81711 (0.0009) [2023-12-27 19:49:01,857][106226] Updated weights for policy 0, policy_version 81721 (0.0008) [2023-12-27 19:49:01,917][106226] Updated weights for policy 0, policy_version 81731 (0.0005) [2023-12-27 19:49:02,013][106225] Updated weights for policy 1, policy_version 81746 (0.0007) [2023-12-27 19:49:02,075][106225] Updated weights for policy 1, policy_version 81756 (0.0006) [2023-12-27 19:49:02,132][106225] Updated weights for policy 1, policy_version 81766 (0.0005) [2023-12-27 19:49:02,187][106225] Updated weights for policy 1, policy_version 81776 (0.0006) [2023-12-27 19:49:02,661][106226] Updated weights for policy 0, policy_version 81741 (0.0008) [2023-12-27 19:49:02,724][106226] Updated weights for policy 0, policy_version 81751 (0.0011) [2023-12-27 19:49:02,785][106226] Updated weights for policy 0, policy_version 81761 (0.0010) [2023-12-27 19:49:02,804][106225] Updated weights for policy 1, policy_version 81786 (0.0006) [2023-12-27 19:49:02,859][106225] Updated weights for policy 1, policy_version 81796 (0.0007) [2023-12-27 19:49:02,919][106225] Updated weights for policy 1, policy_version 81806 (0.0009) [2023-12-27 19:49:03,512][106226] Updated weights for policy 0, policy_version 81771 (0.0011) [2023-12-27 19:49:03,568][106225] Updated weights for policy 1, policy_version 81816 (0.0006) [2023-12-27 19:49:03,573][106226] Updated weights for policy 0, policy_version 81781 (0.0009) [2023-12-27 19:49:03,616][106225] Updated weights for policy 1, policy_version 81826 (0.0005) [2023-12-27 19:49:03,626][106226] Updated weights for policy 0, policy_version 81791 (0.0008) [2023-12-27 19:49:03,666][106225] Updated weights for policy 1, policy_version 81836 (0.0006) [2023-12-27 19:49:04,266][106226] Updated weights for policy 0, policy_version 81801 (0.0008) [2023-12-27 19:49:04,331][106226] Updated weights for policy 0, policy_version 81811 (0.0011) [2023-12-27 19:49:04,363][106225] Updated weights for policy 1, policy_version 81846 (0.0007) [2023-12-27 19:49:04,389][106226] Updated weights for policy 0, policy_version 81821 (0.0010) [2023-12-27 19:49:04,425][106225] Updated weights for policy 1, policy_version 81856 (0.0005) [2023-12-27 19:49:04,452][106226] Updated weights for policy 0, policy_version 81831 (0.0011) [2023-12-27 19:49:04,479][106225] Updated weights for policy 1, policy_version 81866 (0.0006) [2023-12-27 19:49:04,993][106225] Updated weights for policy 1, policy_version 81876 (0.0006) [2023-12-27 19:49:05,036][106226] Updated weights for policy 0, policy_version 81841 (0.0008) [2023-12-27 19:49:05,050][106225] Updated weights for policy 1, policy_version 81886 (0.0007) [2023-12-27 19:49:05,103][106226] Updated weights for policy 0, policy_version 81851 (0.0007) [2023-12-27 19:49:05,107][106225] Updated weights for policy 1, policy_version 81896 (0.0007) [2023-12-27 19:49:05,169][106226] Updated weights for policy 0, policy_version 81861 (0.0008) [2023-12-27 19:49:05,782][106225] Updated weights for policy 1, policy_version 81906 (0.0008) [2023-12-27 19:49:05,843][106225] Updated weights for policy 1, policy_version 81916 (0.0008) [2023-12-27 19:49:05,866][106226] Updated weights for policy 0, policy_version 81871 (0.0006) [2023-12-27 19:49:05,903][106225] Updated weights for policy 1, policy_version 81926 (0.0008) [2023-12-27 19:49:05,923][106226] Updated weights for policy 0, policy_version 81881 (0.0005) [2023-12-27 19:49:05,957][106225] Updated weights for policy 1, policy_version 81936 (0.0006) [2023-12-27 19:49:05,980][106226] Updated weights for policy 0, policy_version 81891 (0.0008) [2023-12-27 19:49:06,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 41951232. Throughput: 0: 9954.5, 1: 10009.4. Samples: 41957444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:06,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-6.225')] [2023-12-27 19:49:06,638][106225] Updated weights for policy 1, policy_version 81946 (0.0008) [2023-12-27 19:49:06,685][106226] Updated weights for policy 0, policy_version 81901 (0.0007) [2023-12-27 19:49:06,690][106225] Updated weights for policy 1, policy_version 81956 (0.0008) [2023-12-27 19:49:06,740][106225] Updated weights for policy 1, policy_version 81966 (0.0008) [2023-12-27 19:49:06,748][106226] Updated weights for policy 0, policy_version 81911 (0.0005) [2023-12-27 19:49:06,807][106226] Updated weights for policy 0, policy_version 81921 (0.0008) [2023-12-27 19:49:07,484][106226] Updated weights for policy 0, policy_version 81931 (0.0009) [2023-12-27 19:49:07,490][106225] Updated weights for policy 1, policy_version 81976 (0.0008) [2023-12-27 19:49:07,536][106226] Updated weights for policy 0, policy_version 81941 (0.0005) [2023-12-27 19:49:07,538][106225] Updated weights for policy 1, policy_version 81986 (0.0007) [2023-12-27 19:49:07,591][106226] Updated weights for policy 0, policy_version 81951 (0.0005) [2023-12-27 19:49:07,596][106225] Updated weights for policy 1, policy_version 81996 (0.0008) [2023-12-27 19:49:08,239][106226] Updated weights for policy 0, policy_version 81961 (0.0007) [2023-12-27 19:49:08,301][106226] Updated weights for policy 0, policy_version 81971 (0.0011) [2023-12-27 19:49:08,344][106225] Updated weights for policy 1, policy_version 82006 (0.0009) [2023-12-27 19:49:08,384][106226] Updated weights for policy 0, policy_version 81981 (0.0011) [2023-12-27 19:49:08,409][106225] Updated weights for policy 1, policy_version 82016 (0.0006) [2023-12-27 19:49:08,450][106226] Updated weights for policy 0, policy_version 81991 (0.0011) [2023-12-27 19:49:08,469][106225] Updated weights for policy 1, policy_version 82026 (0.0008) [2023-12-27 19:49:09,046][106226] Updated weights for policy 0, policy_version 82001 (0.0006) [2023-12-27 19:49:09,098][106226] Updated weights for policy 0, policy_version 82011 (0.0005) [2023-12-27 19:49:09,130][106225] Updated weights for policy 1, policy_version 82036 (0.0008) [2023-12-27 19:49:09,155][106226] Updated weights for policy 0, policy_version 82021 (0.0006) [2023-12-27 19:49:09,186][106225] Updated weights for policy 1, policy_version 82046 (0.0005) [2023-12-27 19:49:09,269][106225] Updated weights for policy 1, policy_version 82056 (0.0009) [2023-12-27 19:49:09,835][106226] Updated weights for policy 0, policy_version 82031 (0.0008) [2023-12-27 19:49:09,908][106226] Updated weights for policy 0, policy_version 82041 (0.0008) [2023-12-27 19:49:09,985][106226] Updated weights for policy 0, policy_version 82051 (0.0008) [2023-12-27 19:49:10,014][106225] Updated weights for policy 1, policy_version 82066 (0.0010) [2023-12-27 19:49:10,076][106225] Updated weights for policy 1, policy_version 82076 (0.0008) [2023-12-27 19:49:10,147][106225] Updated weights for policy 1, policy_version 82086 (0.0007) [2023-12-27 19:49:10,215][106225] Updated weights for policy 1, policy_version 82096 (0.0006) [2023-12-27 19:49:10,610][106226] Updated weights for policy 0, policy_version 82061 (0.0009) [2023-12-27 19:49:10,659][106226] Updated weights for policy 0, policy_version 82071 (0.0008) [2023-12-27 19:49:10,709][106226] Updated weights for policy 0, policy_version 82081 (0.0007) [2023-12-27 19:49:10,803][106225] Updated weights for policy 1, policy_version 82106 (0.0010) [2023-12-27 19:49:10,858][106225] Updated weights for policy 1, policy_version 82116 (0.0008) [2023-12-27 19:49:10,922][106225] Updated weights for policy 1, policy_version 82126 (0.0010) [2023-12-27 19:49:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 42049536. Throughput: 0: 10025.2, 1: 9962.8. Samples: 42017692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:11,176][105115] Avg episode reward: [(0, '-4.812'), (1, '-6.813')] [2023-12-27 19:49:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000082128_21028864.pth... [2023-12-27 19:49:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000082088_21020672.pth... [2023-12-27 19:49:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000080976_20733952.pth [2023-12-27 19:49:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000080904_20717568.pth [2023-12-27 19:49:11,488][106226] Updated weights for policy 0, policy_version 82091 (0.0009) [2023-12-27 19:49:11,559][106226] Updated weights for policy 0, policy_version 82101 (0.0009) [2023-12-27 19:49:11,620][106226] Updated weights for policy 0, policy_version 82111 (0.0009) [2023-12-27 19:49:11,725][106225] Updated weights for policy 1, policy_version 82136 (0.0008) [2023-12-27 19:49:11,792][106225] Updated weights for policy 1, policy_version 82146 (0.0009) [2023-12-27 19:49:11,854][106225] Updated weights for policy 1, policy_version 82156 (0.0008) [2023-12-27 19:49:12,390][106226] Updated weights for policy 0, policy_version 82121 (0.0007) [2023-12-27 19:49:12,446][106226] Updated weights for policy 0, policy_version 82131 (0.0009) [2023-12-27 19:49:12,507][106226] Updated weights for policy 0, policy_version 82141 (0.0009) [2023-12-27 19:49:12,566][106226] Updated weights for policy 0, policy_version 82151 (0.0008) [2023-12-27 19:49:12,568][106225] Updated weights for policy 1, policy_version 82166 (0.0007) [2023-12-27 19:49:12,629][106225] Updated weights for policy 1, policy_version 82176 (0.0008) [2023-12-27 19:49:12,694][106225] Updated weights for policy 1, policy_version 82186 (0.0009) [2023-12-27 19:49:13,266][106226] Updated weights for policy 0, policy_version 82161 (0.0009) [2023-12-27 19:49:13,315][106226] Updated weights for policy 0, policy_version 82171 (0.0009) [2023-12-27 19:49:13,364][106226] Updated weights for policy 0, policy_version 82181 (0.0007) [2023-12-27 19:49:13,408][106225] Updated weights for policy 1, policy_version 82196 (0.0008) [2023-12-27 19:49:13,467][106225] Updated weights for policy 1, policy_version 82206 (0.0008) [2023-12-27 19:49:13,522][106225] Updated weights for policy 1, policy_version 82216 (0.0005) [2023-12-27 19:49:14,065][106226] Updated weights for policy 0, policy_version 82191 (0.0010) [2023-12-27 19:49:14,103][106225] Updated weights for policy 1, policy_version 82226 (0.0005) [2023-12-27 19:49:14,122][106226] Updated weights for policy 0, policy_version 82201 (0.0010) [2023-12-27 19:49:14,157][106225] Updated weights for policy 1, policy_version 82236 (0.0008) [2023-12-27 19:49:14,176][106226] Updated weights for policy 0, policy_version 82211 (0.0010) [2023-12-27 19:49:14,205][106225] Updated weights for policy 1, policy_version 82246 (0.0005) [2023-12-27 19:49:14,254][106225] Updated weights for policy 1, policy_version 82256 (0.0007) [2023-12-27 19:49:14,872][106226] Updated weights for policy 0, policy_version 82221 (0.0007) [2023-12-27 19:49:14,954][106226] Updated weights for policy 0, policy_version 82231 (0.0009) [2023-12-27 19:49:15,023][106226] Updated weights for policy 0, policy_version 82241 (0.0007) [2023-12-27 19:49:15,031][106225] Updated weights for policy 1, policy_version 82266 (0.0008) [2023-12-27 19:49:15,094][106225] Updated weights for policy 1, policy_version 82276 (0.0009) [2023-12-27 19:49:15,157][106225] Updated weights for policy 1, policy_version 82286 (0.0009) [2023-12-27 19:49:15,590][106226] Updated weights for policy 0, policy_version 82251 (0.0006) [2023-12-27 19:49:15,656][106226] Updated weights for policy 0, policy_version 82261 (0.0005) [2023-12-27 19:49:15,721][106226] Updated weights for policy 0, policy_version 82271 (0.0006) [2023-12-27 19:49:15,937][106225] Updated weights for policy 1, policy_version 82296 (0.0010) [2023-12-27 19:49:15,997][106225] Updated weights for policy 1, policy_version 82306 (0.0010) [2023-12-27 19:49:16,050][106225] Updated weights for policy 1, policy_version 82316 (0.0006) [2023-12-27 19:49:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 42147840. Throughput: 0: 9949.2, 1: 9990.9. Samples: 42136124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:16,176][105115] Avg episode reward: [(0, '-4.772'), (1, '-6.221')] [2023-12-27 19:49:16,329][106226] Updated weights for policy 0, policy_version 82281 (0.0006) [2023-12-27 19:49:16,389][106226] Updated weights for policy 0, policy_version 82291 (0.0007) [2023-12-27 19:49:16,456][106226] Updated weights for policy 0, policy_version 82301 (0.0007) [2023-12-27 19:49:16,515][106226] Updated weights for policy 0, policy_version 82311 (0.0010) [2023-12-27 19:49:16,690][106225] Updated weights for policy 1, policy_version 82326 (0.0006) [2023-12-27 19:49:16,743][106225] Updated weights for policy 1, policy_version 82336 (0.0005) [2023-12-27 19:49:16,792][106225] Updated weights for policy 1, policy_version 82346 (0.0008) [2023-12-27 19:49:17,196][106226] Updated weights for policy 0, policy_version 82321 (0.0010) [2023-12-27 19:49:17,252][106226] Updated weights for policy 0, policy_version 82331 (0.0010) [2023-12-27 19:49:17,308][106226] Updated weights for policy 0, policy_version 82341 (0.0010) [2023-12-27 19:49:17,458][106225] Updated weights for policy 1, policy_version 82356 (0.0009) [2023-12-27 19:49:17,509][106225] Updated weights for policy 1, policy_version 82366 (0.0006) [2023-12-27 19:49:17,565][106225] Updated weights for policy 1, policy_version 82376 (0.0005) [2023-12-27 19:49:17,994][106226] Updated weights for policy 0, policy_version 82351 (0.0010) [2023-12-27 19:49:18,062][106226] Updated weights for policy 0, policy_version 82361 (0.0010) [2023-12-27 19:49:18,124][106226] Updated weights for policy 0, policy_version 82371 (0.0010) [2023-12-27 19:49:18,162][106225] Updated weights for policy 1, policy_version 82386 (0.0006) [2023-12-27 19:49:18,220][106225] Updated weights for policy 1, policy_version 82396 (0.0007) [2023-12-27 19:49:18,272][106225] Updated weights for policy 1, policy_version 82406 (0.0006) [2023-12-27 19:49:18,322][106225] Updated weights for policy 1, policy_version 82416 (0.0006) [2023-12-27 19:49:18,776][106226] Updated weights for policy 0, policy_version 82381 (0.0008) [2023-12-27 19:49:18,836][106226] Updated weights for policy 0, policy_version 82391 (0.0009) [2023-12-27 19:49:18,901][106226] Updated weights for policy 0, policy_version 82401 (0.0008) [2023-12-27 19:49:19,094][106225] Updated weights for policy 1, policy_version 82426 (0.0010) [2023-12-27 19:49:19,157][106225] Updated weights for policy 1, policy_version 82436 (0.0010) [2023-12-27 19:49:19,218][106225] Updated weights for policy 1, policy_version 82446 (0.0010) [2023-12-27 19:49:19,646][106226] Updated weights for policy 0, policy_version 82411 (0.0008) [2023-12-27 19:49:19,704][106226] Updated weights for policy 0, policy_version 82421 (0.0008) [2023-12-27 19:49:19,762][106226] Updated weights for policy 0, policy_version 82431 (0.0008) [2023-12-27 19:49:19,985][106225] Updated weights for policy 1, policy_version 82456 (0.0010) [2023-12-27 19:49:20,056][106225] Updated weights for policy 1, policy_version 82466 (0.0009) [2023-12-27 19:49:20,116][106225] Updated weights for policy 1, policy_version 82476 (0.0010) [2023-12-27 19:49:20,500][106226] Updated weights for policy 0, policy_version 82441 (0.0008) [2023-12-27 19:49:20,556][106226] Updated weights for policy 0, policy_version 82451 (0.0006) [2023-12-27 19:49:20,629][106226] Updated weights for policy 0, policy_version 82461 (0.0009) [2023-12-27 19:49:20,690][106226] Updated weights for policy 0, policy_version 82471 (0.0010) [2023-12-27 19:49:20,798][106225] Updated weights for policy 1, policy_version 82486 (0.0008) [2023-12-27 19:49:20,849][106225] Updated weights for policy 1, policy_version 82496 (0.0010) [2023-12-27 19:49:20,908][106225] Updated weights for policy 1, policy_version 82506 (0.0010) [2023-12-27 19:49:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 42246144. Throughput: 0: 9969.4, 1: 9943.0. Samples: 42254724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:21,175][105115] Avg episode reward: [(0, '-5.000'), (1, '-6.142')] [2023-12-27 19:49:21,517][106226] Updated weights for policy 0, policy_version 82481 (0.0009) [2023-12-27 19:49:21,586][106226] Updated weights for policy 0, policy_version 82491 (0.0009) [2023-12-27 19:49:21,626][106225] Updated weights for policy 1, policy_version 82516 (0.0008) [2023-12-27 19:49:21,657][106226] Updated weights for policy 0, policy_version 82501 (0.0008) [2023-12-27 19:49:21,686][106225] Updated weights for policy 1, policy_version 82526 (0.0007) [2023-12-27 19:49:21,757][106225] Updated weights for policy 1, policy_version 82536 (0.0008) [2023-12-27 19:49:22,305][106226] Updated weights for policy 0, policy_version 82511 (0.0009) [2023-12-27 19:49:22,373][106226] Updated weights for policy 0, policy_version 82521 (0.0008) [2023-12-27 19:49:22,445][106226] Updated weights for policy 0, policy_version 82531 (0.0007) [2023-12-27 19:49:22,544][106225] Updated weights for policy 1, policy_version 82546 (0.0008) [2023-12-27 19:49:22,597][106225] Updated weights for policy 1, policy_version 82556 (0.0009) [2023-12-27 19:49:22,661][106225] Updated weights for policy 1, policy_version 82566 (0.0008) [2023-12-27 19:49:22,717][106225] Updated weights for policy 1, policy_version 82576 (0.0008) [2023-12-27 19:49:23,133][106226] Updated weights for policy 0, policy_version 82541 (0.0007) [2023-12-27 19:49:23,189][106226] Updated weights for policy 0, policy_version 82551 (0.0009) [2023-12-27 19:49:23,247][106226] Updated weights for policy 0, policy_version 82561 (0.0008) [2023-12-27 19:49:23,476][106225] Updated weights for policy 1, policy_version 82586 (0.0005) [2023-12-27 19:49:23,529][106225] Updated weights for policy 1, policy_version 82596 (0.0007) [2023-12-27 19:49:23,576][106225] Updated weights for policy 1, policy_version 82606 (0.0006) [2023-12-27 19:49:24,009][106226] Updated weights for policy 0, policy_version 82571 (0.0008) [2023-12-27 19:49:24,066][106226] Updated weights for policy 0, policy_version 82581 (0.0008) [2023-12-27 19:49:24,124][106226] Updated weights for policy 0, policy_version 82591 (0.0008) [2023-12-27 19:49:24,267][106225] Updated weights for policy 1, policy_version 82616 (0.0009) [2023-12-27 19:49:24,329][106225] Updated weights for policy 1, policy_version 82626 (0.0008) [2023-12-27 19:49:24,392][106225] Updated weights for policy 1, policy_version 82636 (0.0008) [2023-12-27 19:49:24,845][106226] Updated weights for policy 0, policy_version 82601 (0.0008) [2023-12-27 19:49:24,896][106226] Updated weights for policy 0, policy_version 82611 (0.0008) [2023-12-27 19:49:24,943][106226] Updated weights for policy 0, policy_version 82621 (0.0008) [2023-12-27 19:49:25,007][106226] Updated weights for policy 0, policy_version 82631 (0.0009) [2023-12-27 19:49:25,123][106225] Updated weights for policy 1, policy_version 82646 (0.0009) [2023-12-27 19:49:25,185][106225] Updated weights for policy 1, policy_version 82656 (0.0008) [2023-12-27 19:49:25,243][106225] Updated weights for policy 1, policy_version 82666 (0.0008) [2023-12-27 19:49:25,765][106226] Updated weights for policy 0, policy_version 82641 (0.0007) [2023-12-27 19:49:25,827][106226] Updated weights for policy 0, policy_version 82651 (0.0010) [2023-12-27 19:49:25,873][106226] Updated weights for policy 0, policy_version 82661 (0.0010) [2023-12-27 19:49:25,942][106225] Updated weights for policy 1, policy_version 82676 (0.0007) [2023-12-27 19:49:25,989][106225] Updated weights for policy 1, policy_version 82686 (0.0008) [2023-12-27 19:49:26,035][106225] Updated weights for policy 1, policy_version 82696 (0.0007) [2023-12-27 19:49:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.7, 300 sec: 19827.4). Total num frames: 42344448. Throughput: 0: 9941.2, 1: 9883.1. Samples: 42311644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:26,176][105115] Avg episode reward: [(0, '-4.693'), (1, '-6.251')] [2023-12-27 19:49:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000082704_21176320.pth... [2023-12-27 19:49:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000082664_21168128.pth... [2023-12-27 19:49:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000081552_20881408.pth [2023-12-27 19:49:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000081512_20873216.pth [2023-12-27 19:49:26,497][106226] Updated weights for policy 0, policy_version 82671 (0.0011) [2023-12-27 19:49:26,550][106226] Updated weights for policy 0, policy_version 82681 (0.0010) [2023-12-27 19:49:26,597][106226] Updated weights for policy 0, policy_version 82691 (0.0009) [2023-12-27 19:49:26,702][106225] Updated weights for policy 1, policy_version 82706 (0.0007) [2023-12-27 19:49:26,751][106225] Updated weights for policy 1, policy_version 82716 (0.0005) [2023-12-27 19:49:26,811][106225] Updated weights for policy 1, policy_version 82726 (0.0005) [2023-12-27 19:49:26,873][106225] Updated weights for policy 1, policy_version 82736 (0.0010) [2023-12-27 19:49:27,157][106226] Updated weights for policy 0, policy_version 82701 (0.0008) [2023-12-27 19:49:27,207][106226] Updated weights for policy 0, policy_version 82711 (0.0010) [2023-12-27 19:49:27,265][106226] Updated weights for policy 0, policy_version 82721 (0.0010) [2023-12-27 19:49:27,524][106225] Updated weights for policy 1, policy_version 82746 (0.0010) [2023-12-27 19:49:27,572][106225] Updated weights for policy 1, policy_version 82756 (0.0009) [2023-12-27 19:49:27,622][106225] Updated weights for policy 1, policy_version 82766 (0.0005) [2023-12-27 19:49:27,950][106226] Updated weights for policy 0, policy_version 82731 (0.0010) [2023-12-27 19:49:28,009][106226] Updated weights for policy 0, policy_version 82741 (0.0010) [2023-12-27 19:49:28,071][106226] Updated weights for policy 0, policy_version 82751 (0.0010) [2023-12-27 19:49:28,254][106225] Updated weights for policy 1, policy_version 82776 (0.0009) [2023-12-27 19:49:28,297][106225] Updated weights for policy 1, policy_version 82786 (0.0010) [2023-12-27 19:49:28,369][106225] Updated weights for policy 1, policy_version 82796 (0.0011) [2023-12-27 19:49:28,765][106226] Updated weights for policy 0, policy_version 82761 (0.0011) [2023-12-27 19:49:28,824][106226] Updated weights for policy 0, policy_version 82771 (0.0009) [2023-12-27 19:49:28,885][106226] Updated weights for policy 0, policy_version 82781 (0.0008) [2023-12-27 19:49:28,951][106226] Updated weights for policy 0, policy_version 82791 (0.0005) [2023-12-27 19:49:29,108][106225] Updated weights for policy 1, policy_version 82806 (0.0010) [2023-12-27 19:49:29,158][106225] Updated weights for policy 1, policy_version 82816 (0.0010) [2023-12-27 19:49:29,205][106225] Updated weights for policy 1, policy_version 82826 (0.0010) [2023-12-27 19:49:29,594][106226] Updated weights for policy 0, policy_version 82801 (0.0010) [2023-12-27 19:49:29,653][106226] Updated weights for policy 0, policy_version 82811 (0.0010) [2023-12-27 19:49:29,710][106226] Updated weights for policy 0, policy_version 82821 (0.0010) [2023-12-27 19:49:29,985][106225] Updated weights for policy 1, policy_version 82836 (0.0007) [2023-12-27 19:49:30,039][106225] Updated weights for policy 1, policy_version 82846 (0.0006) [2023-12-27 19:49:30,084][106225] Updated weights for policy 1, policy_version 82856 (0.0005) [2023-12-27 19:49:30,448][106226] Updated weights for policy 0, policy_version 82831 (0.0011) [2023-12-27 19:49:30,515][106226] Updated weights for policy 0, policy_version 82841 (0.0010) [2023-12-27 19:49:30,568][106226] Updated weights for policy 0, policy_version 82851 (0.0010) [2023-12-27 19:49:30,707][106225] Updated weights for policy 1, policy_version 82866 (0.0005) [2023-12-27 19:49:30,762][106225] Updated weights for policy 1, policy_version 82876 (0.0005) [2023-12-27 19:49:30,807][106225] Updated weights for policy 1, policy_version 82886 (0.0005) [2023-12-27 19:49:30,852][106225] Updated weights for policy 1, policy_version 82896 (0.0005) [2023-12-27 19:49:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 42442752. Throughput: 0: 9990.0, 1: 9878.1. Samples: 42433540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:49:31,175][105115] Avg episode reward: [(0, '-5.139'), (1, '-6.511')] [2023-12-27 19:49:31,309][106226] Updated weights for policy 0, policy_version 82861 (0.0011) [2023-12-27 19:49:31,379][106226] Updated weights for policy 0, policy_version 82871 (0.0009) [2023-12-27 19:49:31,436][106226] Updated weights for policy 0, policy_version 82881 (0.0006) [2023-12-27 19:49:31,511][106225] Updated weights for policy 1, policy_version 82906 (0.0009) [2023-12-27 19:49:31,572][106225] Updated weights for policy 1, policy_version 82917 (0.0009) [2023-12-27 19:49:31,634][106225] Updated weights for policy 1, policy_version 82927 (0.0008) [2023-12-27 19:49:32,137][106226] Updated weights for policy 0, policy_version 82891 (0.0005) [2023-12-27 19:49:32,198][106226] Updated weights for policy 0, policy_version 82901 (0.0007) [2023-12-27 19:49:32,264][106226] Updated weights for policy 0, policy_version 82911 (0.0008) [2023-12-27 19:49:32,354][106225] Updated weights for policy 1, policy_version 82937 (0.0010) [2023-12-27 19:49:32,419][106225] Updated weights for policy 1, policy_version 82947 (0.0011) [2023-12-27 19:49:32,484][106225] Updated weights for policy 1, policy_version 82957 (0.0010) [2023-12-27 19:49:32,942][106226] Updated weights for policy 0, policy_version 82921 (0.0008) [2023-12-27 19:49:32,995][106226] Updated weights for policy 0, policy_version 82931 (0.0008) [2023-12-27 19:49:33,046][106226] Updated weights for policy 0, policy_version 82941 (0.0009) [2023-12-27 19:49:33,097][106226] Updated weights for policy 0, policy_version 82951 (0.0010) [2023-12-27 19:49:33,132][106225] Updated weights for policy 1, policy_version 82967 (0.0009) [2023-12-27 19:49:33,192][106225] Updated weights for policy 1, policy_version 82977 (0.0010) [2023-12-27 19:49:33,243][106225] Updated weights for policy 1, policy_version 82987 (0.0010) [2023-12-27 19:49:33,682][106226] Updated weights for policy 0, policy_version 82961 (0.0006) [2023-12-27 19:49:33,734][106226] Updated weights for policy 0, policy_version 82971 (0.0005) [2023-12-27 19:49:33,800][106226] Updated weights for policy 0, policy_version 82981 (0.0006) [2023-12-27 19:49:33,871][106225] Updated weights for policy 1, policy_version 82997 (0.0008) [2023-12-27 19:49:33,921][106225] Updated weights for policy 1, policy_version 83007 (0.0005) [2023-12-27 19:49:33,969][106225] Updated weights for policy 1, policy_version 83017 (0.0008) [2023-12-27 19:49:34,479][106226] Updated weights for policy 0, policy_version 82991 (0.0011) [2023-12-27 19:49:34,541][106226] Updated weights for policy 0, policy_version 83001 (0.0010) [2023-12-27 19:49:34,605][106226] Updated weights for policy 0, policy_version 83011 (0.0010) [2023-12-27 19:49:34,708][106225] Updated weights for policy 1, policy_version 83027 (0.0010) [2023-12-27 19:49:34,768][106225] Updated weights for policy 1, policy_version 83037 (0.0010) [2023-12-27 19:49:34,825][106225] Updated weights for policy 1, policy_version 83047 (0.0010) [2023-12-27 19:49:35,313][106226] Updated weights for policy 0, policy_version 83021 (0.0011) [2023-12-27 19:49:35,373][106226] Updated weights for policy 0, policy_version 83031 (0.0010) [2023-12-27 19:49:35,432][106226] Updated weights for policy 0, policy_version 83041 (0.0010) [2023-12-27 19:49:35,536][106225] Updated weights for policy 1, policy_version 83057 (0.0010) [2023-12-27 19:49:35,585][106225] Updated weights for policy 1, policy_version 83067 (0.0010) [2023-12-27 19:49:35,632][106225] Updated weights for policy 1, policy_version 83077 (0.0010) [2023-12-27 19:49:35,682][106225] Updated weights for policy 1, policy_version 83087 (0.0010) [2023-12-27 19:49:36,129][106226] Updated weights for policy 0, policy_version 83051 (0.0009) [2023-12-27 19:49:36,175][105115] Fps is (10 sec: 19661.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 42541056. Throughput: 0: 10006.3, 1: 9952.2. Samples: 42555284. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:49:36,175][105115] Avg episode reward: [(0, '-5.186'), (1, '-6.600')] [2023-12-27 19:49:36,190][106226] Updated weights for policy 0, policy_version 83061 (0.0008) [2023-12-27 19:49:36,253][106226] Updated weights for policy 0, policy_version 83071 (0.0008) [2023-12-27 19:49:36,446][106225] Updated weights for policy 1, policy_version 83097 (0.0010) [2023-12-27 19:49:36,504][106225] Updated weights for policy 1, policy_version 83107 (0.0010) [2023-12-27 19:49:36,558][106225] Updated weights for policy 1, policy_version 83117 (0.0010) [2023-12-27 19:49:36,957][106226] Updated weights for policy 0, policy_version 83081 (0.0008) [2023-12-27 19:49:37,043][106226] Updated weights for policy 0, policy_version 83091 (0.0010) [2023-12-27 19:49:37,106][106226] Updated weights for policy 0, policy_version 83101 (0.0011) [2023-12-27 19:49:37,173][106226] Updated weights for policy 0, policy_version 83111 (0.0011) [2023-12-27 19:49:37,280][106225] Updated weights for policy 1, policy_version 83127 (0.0010) [2023-12-27 19:49:37,330][106225] Updated weights for policy 1, policy_version 83137 (0.0010) [2023-12-27 19:49:37,378][106225] Updated weights for policy 1, policy_version 83147 (0.0010) [2023-12-27 19:49:37,797][106226] Updated weights for policy 0, policy_version 83121 (0.0007) [2023-12-27 19:49:37,843][106226] Updated weights for policy 0, policy_version 83131 (0.0007) [2023-12-27 19:49:37,911][106226] Updated weights for policy 0, policy_version 83141 (0.0010) [2023-12-27 19:49:38,019][106225] Updated weights for policy 1, policy_version 83157 (0.0008) [2023-12-27 19:49:38,069][106225] Updated weights for policy 1, policy_version 83167 (0.0008) [2023-12-27 19:49:38,135][106225] Updated weights for policy 1, policy_version 83177 (0.0008) [2023-12-27 19:49:38,605][106226] Updated weights for policy 0, policy_version 83151 (0.0011) [2023-12-27 19:49:38,666][106226] Updated weights for policy 0, policy_version 83161 (0.0011) [2023-12-27 19:49:38,723][106226] Updated weights for policy 0, policy_version 83171 (0.0011) [2023-12-27 19:49:38,882][106225] Updated weights for policy 1, policy_version 83187 (0.0008) [2023-12-27 19:49:38,934][106225] Updated weights for policy 1, policy_version 83197 (0.0008) [2023-12-27 19:49:38,990][106225] Updated weights for policy 1, policy_version 83207 (0.0008) [2023-12-27 19:49:39,471][106226] Updated weights for policy 0, policy_version 83181 (0.0009) [2023-12-27 19:49:39,535][106226] Updated weights for policy 0, policy_version 83191 (0.0008) [2023-12-27 19:49:39,599][106226] Updated weights for policy 0, policy_version 83201 (0.0008) [2023-12-27 19:49:39,797][106225] Updated weights for policy 1, policy_version 83217 (0.0009) [2023-12-27 19:49:39,860][106225] Updated weights for policy 1, policy_version 83227 (0.0010) [2023-12-27 19:49:39,923][106225] Updated weights for policy 1, policy_version 83237 (0.0007) [2023-12-27 19:49:39,994][106225] Updated weights for policy 1, policy_version 83247 (0.0010) [2023-12-27 19:49:40,312][106226] Updated weights for policy 0, policy_version 83211 (0.0008) [2023-12-27 19:49:40,376][106226] Updated weights for policy 0, policy_version 83221 (0.0009) [2023-12-27 19:49:40,426][106226] Updated weights for policy 0, policy_version 83231 (0.0007) [2023-12-27 19:49:40,790][106225] Updated weights for policy 1, policy_version 83257 (0.0008) [2023-12-27 19:49:40,852][106225] Updated weights for policy 1, policy_version 83267 (0.0009) [2023-12-27 19:49:40,914][106225] Updated weights for policy 1, policy_version 83277 (0.0008) [2023-12-27 19:49:41,104][106226] Updated weights for policy 0, policy_version 83241 (0.0008) [2023-12-27 19:49:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 42639360. Throughput: 0: 10020.0, 1: 9962.5. Samples: 42614560. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:49:41,176][105115] Avg episode reward: [(0, '-5.224'), (1, '-6.557')] [2023-12-27 19:49:41,178][106226] Updated weights for policy 0, policy_version 83251 (0.0008) [2023-12-27 19:49:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000083280_21323776.pth... [2023-12-27 19:49:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000082128_21028864.pth [2023-12-27 19:49:41,245][106226] Updated weights for policy 0, policy_version 83261 (0.0008) [2023-12-27 19:49:41,314][106226] Updated weights for policy 0, policy_version 83271 (0.0008) [2023-12-27 19:49:41,321][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000083272_21323776.pth... [2023-12-27 19:49:41,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000082088_21020672.pth [2023-12-27 19:49:41,696][106225] Updated weights for policy 1, policy_version 83287 (0.0008) [2023-12-27 19:49:41,765][106225] Updated weights for policy 1, policy_version 83297 (0.0009) [2023-12-27 19:49:41,816][106225] Updated weights for policy 1, policy_version 83307 (0.0008) [2023-12-27 19:49:42,097][106226] Updated weights for policy 0, policy_version 83281 (0.0008) [2023-12-27 19:49:42,151][106226] Updated weights for policy 0, policy_version 83291 (0.0009) [2023-12-27 19:49:42,209][106226] Updated weights for policy 0, policy_version 83301 (0.0009) [2023-12-27 19:49:42,560][106225] Updated weights for policy 1, policy_version 83317 (0.0008) [2023-12-27 19:49:42,611][106225] Updated weights for policy 1, policy_version 83327 (0.0008) [2023-12-27 19:49:42,661][106225] Updated weights for policy 1, policy_version 83337 (0.0007) [2023-12-27 19:49:42,966][106226] Updated weights for policy 0, policy_version 83311 (0.0006) [2023-12-27 19:49:43,018][106226] Updated weights for policy 0, policy_version 83321 (0.0005) [2023-12-27 19:49:43,072][106226] Updated weights for policy 0, policy_version 83331 (0.0005) [2023-12-27 19:49:43,326][106225] Updated weights for policy 1, policy_version 83347 (0.0005) [2023-12-27 19:49:43,381][106225] Updated weights for policy 1, policy_version 83357 (0.0010) [2023-12-27 19:49:43,431][106225] Updated weights for policy 1, policy_version 83367 (0.0010) [2023-12-27 19:49:43,729][106226] Updated weights for policy 0, policy_version 83341 (0.0008) [2023-12-27 19:49:43,794][106226] Updated weights for policy 0, policy_version 83351 (0.0009) [2023-12-27 19:49:43,848][106226] Updated weights for policy 0, policy_version 83362 (0.0008) [2023-12-27 19:49:44,093][106225] Updated weights for policy 1, policy_version 83377 (0.0010) [2023-12-27 19:49:44,151][106225] Updated weights for policy 1, policy_version 83387 (0.0008) [2023-12-27 19:49:44,200][106225] Updated weights for policy 1, policy_version 83397 (0.0010) [2023-12-27 19:49:44,260][106225] Updated weights for policy 1, policy_version 83407 (0.0007) [2023-12-27 19:49:44,566][106226] Updated weights for policy 0, policy_version 83372 (0.0008) [2023-12-27 19:49:44,621][106226] Updated weights for policy 0, policy_version 83382 (0.0005) [2023-12-27 19:49:44,678][106226] Updated weights for policy 0, policy_version 83392 (0.0008) [2023-12-27 19:49:44,980][106225] Updated weights for policy 1, policy_version 83417 (0.0010) [2023-12-27 19:49:45,043][106225] Updated weights for policy 1, policy_version 83427 (0.0011) [2023-12-27 19:49:45,105][106225] Updated weights for policy 1, policy_version 83437 (0.0010) [2023-12-27 19:49:45,418][106226] Updated weights for policy 0, policy_version 83402 (0.0008) [2023-12-27 19:49:45,466][106226] Updated weights for policy 0, policy_version 83412 (0.0007) [2023-12-27 19:49:45,525][106226] Updated weights for policy 0, policy_version 83422 (0.0005) [2023-12-27 19:49:45,592][106226] Updated weights for policy 0, policy_version 83432 (0.0005) [2023-12-27 19:49:45,745][106225] Updated weights for policy 1, policy_version 83447 (0.0007) [2023-12-27 19:49:45,807][106225] Updated weights for policy 1, policy_version 83457 (0.0005) [2023-12-27 19:49:45,858][106225] Updated weights for policy 1, policy_version 83467 (0.0005) [2023-12-27 19:49:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 42737664. Throughput: 0: 9944.2, 1: 9935.0. Samples: 42728892. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:49:46,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-6.013')] [2023-12-27 19:49:46,203][106226] Updated weights for policy 0, policy_version 83442 (0.0006) [2023-12-27 19:49:46,266][106226] Updated weights for policy 0, policy_version 83452 (0.0005) [2023-12-27 19:49:46,334][106226] Updated weights for policy 0, policy_version 83462 (0.0005) [2023-12-27 19:49:46,436][106225] Updated weights for policy 1, policy_version 83477 (0.0008) [2023-12-27 19:49:46,486][106225] Updated weights for policy 1, policy_version 83487 (0.0010) [2023-12-27 19:49:46,536][106225] Updated weights for policy 1, policy_version 83497 (0.0010) [2023-12-27 19:49:46,826][106226] Updated weights for policy 0, policy_version 83472 (0.0005) [2023-12-27 19:49:46,897][106226] Updated weights for policy 0, policy_version 83482 (0.0007) [2023-12-27 19:49:46,956][106226] Updated weights for policy 0, policy_version 83492 (0.0011) [2023-12-27 19:49:47,189][106225] Updated weights for policy 1, policy_version 83507 (0.0010) [2023-12-27 19:49:47,260][106225] Updated weights for policy 1, policy_version 83517 (0.0010) [2023-12-27 19:49:47,316][106225] Updated weights for policy 1, policy_version 83527 (0.0010) [2023-12-27 19:49:47,532][106226] Updated weights for policy 0, policy_version 83502 (0.0007) [2023-12-27 19:49:47,607][106226] Updated weights for policy 0, policy_version 83512 (0.0006) [2023-12-27 19:49:47,671][106226] Updated weights for policy 0, policy_version 83522 (0.0006) [2023-12-27 19:49:48,032][106225] Updated weights for policy 1, policy_version 83537 (0.0010) [2023-12-27 19:49:48,092][106225] Updated weights for policy 1, policy_version 83547 (0.0010) [2023-12-27 19:49:48,152][106225] Updated weights for policy 1, policy_version 83557 (0.0010) [2023-12-27 19:49:48,180][106226] Updated weights for policy 0, policy_version 83532 (0.0006) [2023-12-27 19:49:48,209][106225] Updated weights for policy 1, policy_version 83567 (0.0010) [2023-12-27 19:49:48,243][106226] Updated weights for policy 0, policy_version 83542 (0.0009) [2023-12-27 19:49:48,307][106226] Updated weights for policy 0, policy_version 83552 (0.0010) [2023-12-27 19:49:48,873][106226] Updated weights for policy 0, policy_version 83562 (0.0010) [2023-12-27 19:49:48,933][106226] Updated weights for policy 0, policy_version 83572 (0.0006) [2023-12-27 19:49:48,938][106225] Updated weights for policy 1, policy_version 83577 (0.0010) [2023-12-27 19:49:48,993][106226] Updated weights for policy 0, policy_version 83582 (0.0009) [2023-12-27 19:49:48,995][106225] Updated weights for policy 1, policy_version 83587 (0.0007) [2023-12-27 19:49:49,046][106226] Updated weights for policy 0, policy_version 83592 (0.0010) [2023-12-27 19:49:49,050][106225] Updated weights for policy 1, policy_version 83597 (0.0005) [2023-12-27 19:49:49,701][106225] Updated weights for policy 1, policy_version 83607 (0.0009) [2023-12-27 19:49:49,754][106225] Updated weights for policy 1, policy_version 83617 (0.0010) [2023-12-27 19:49:49,768][106226] Updated weights for policy 0, policy_version 83602 (0.0011) [2023-12-27 19:49:49,811][106225] Updated weights for policy 1, policy_version 83627 (0.0011) [2023-12-27 19:49:49,846][106226] Updated weights for policy 0, policy_version 83612 (0.0011) [2023-12-27 19:49:49,906][106226] Updated weights for policy 0, policy_version 83622 (0.0010) [2023-12-27 19:49:50,620][106226] Updated weights for policy 0, policy_version 83632 (0.0011) [2023-12-27 19:49:50,640][106225] Updated weights for policy 1, policy_version 83637 (0.0008) [2023-12-27 19:49:50,683][106226] Updated weights for policy 0, policy_version 83642 (0.0011) [2023-12-27 19:49:50,707][106225] Updated weights for policy 1, policy_version 83647 (0.0006) [2023-12-27 19:49:50,750][106226] Updated weights for policy 0, policy_version 83652 (0.0010) [2023-12-27 19:49:50,768][106225] Updated weights for policy 1, policy_version 83657 (0.0010) [2023-12-27 19:49:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 42844160. Throughput: 0: 10053.9, 1: 9860.7. Samples: 42853600. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:49:51,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-6.305')] [2023-12-27 19:49:51,436][106225] Updated weights for policy 1, policy_version 83667 (0.0009) [2023-12-27 19:49:51,464][106226] Updated weights for policy 0, policy_version 83662 (0.0010) [2023-12-27 19:49:51,494][106225] Updated weights for policy 1, policy_version 83677 (0.0006) [2023-12-27 19:49:51,522][106226] Updated weights for policy 0, policy_version 83672 (0.0009) [2023-12-27 19:49:51,550][106225] Updated weights for policy 1, policy_version 83687 (0.0005) [2023-12-27 19:49:51,591][106226] Updated weights for policy 0, policy_version 83682 (0.0008) [2023-12-27 19:49:52,231][106225] Updated weights for policy 1, policy_version 83697 (0.0006) [2023-12-27 19:49:52,291][106225] Updated weights for policy 1, policy_version 83707 (0.0009) [2023-12-27 19:49:52,358][106225] Updated weights for policy 1, policy_version 83717 (0.0008) [2023-12-27 19:49:52,375][106226] Updated weights for policy 0, policy_version 83692 (0.0008) [2023-12-27 19:49:52,419][106225] Updated weights for policy 1, policy_version 83727 (0.0006) [2023-12-27 19:49:52,441][106226] Updated weights for policy 0, policy_version 83702 (0.0006) [2023-12-27 19:49:52,507][106226] Updated weights for policy 0, policy_version 83712 (0.0007) [2023-12-27 19:49:53,114][106225] Updated weights for policy 1, policy_version 83737 (0.0006) [2023-12-27 19:49:53,172][106225] Updated weights for policy 1, policy_version 83747 (0.0006) [2023-12-27 19:49:53,174][106226] Updated weights for policy 0, policy_version 83722 (0.0008) [2023-12-27 19:49:53,233][106225] Updated weights for policy 1, policy_version 83757 (0.0006) [2023-12-27 19:49:53,235][106226] Updated weights for policy 0, policy_version 83732 (0.0007) [2023-12-27 19:49:53,299][106226] Updated weights for policy 0, policy_version 83742 (0.0008) [2023-12-27 19:49:53,352][106226] Updated weights for policy 0, policy_version 83752 (0.0008) [2023-12-27 19:49:53,859][106225] Updated weights for policy 1, policy_version 83767 (0.0007) [2023-12-27 19:49:53,912][106225] Updated weights for policy 1, policy_version 83777 (0.0008) [2023-12-27 19:49:53,966][106225] Updated weights for policy 1, policy_version 83787 (0.0006) [2023-12-27 19:49:53,980][106226] Updated weights for policy 0, policy_version 83762 (0.0007) [2023-12-27 19:49:54,035][106226] Updated weights for policy 0, policy_version 83772 (0.0005) [2023-12-27 19:49:54,095][106226] Updated weights for policy 0, policy_version 83782 (0.0006) [2023-12-27 19:49:54,654][106226] Updated weights for policy 0, policy_version 83792 (0.0010) [2023-12-27 19:49:54,700][106226] Updated weights for policy 0, policy_version 83802 (0.0010) [2023-12-27 19:49:54,745][106226] Updated weights for policy 0, policy_version 83812 (0.0008) [2023-12-27 19:49:54,787][106225] Updated weights for policy 1, policy_version 83797 (0.0008) [2023-12-27 19:49:54,844][106225] Updated weights for policy 1, policy_version 83807 (0.0007) [2023-12-27 19:49:54,897][106225] Updated weights for policy 1, policy_version 83817 (0.0008) [2023-12-27 19:49:55,464][106226] Updated weights for policy 0, policy_version 83822 (0.0008) [2023-12-27 19:49:55,525][106226] Updated weights for policy 0, policy_version 83832 (0.0011) [2023-12-27 19:49:55,581][106226] Updated weights for policy 0, policy_version 83842 (0.0010) [2023-12-27 19:49:55,625][106225] Updated weights for policy 1, policy_version 83827 (0.0007) [2023-12-27 19:49:55,680][106225] Updated weights for policy 1, policy_version 83837 (0.0008) [2023-12-27 19:49:55,735][106225] Updated weights for policy 1, policy_version 83847 (0.0008) [2023-12-27 19:49:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 42942464. Throughput: 0: 10010.3, 1: 9895.0. Samples: 42913424. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:49:56,175][105115] Avg episode reward: [(0, '-4.957'), (1, '-6.362')] [2023-12-27 19:49:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000083856_21471232.pth... [2023-12-27 19:49:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000083848_21471232.pth... [2023-12-27 19:49:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000082704_21176320.pth [2023-12-27 19:49:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000082664_21168128.pth [2023-12-27 19:49:56,298][106226] Updated weights for policy 0, policy_version 83852 (0.0011) [2023-12-27 19:49:56,342][106225] Updated weights for policy 1, policy_version 83857 (0.0008) [2023-12-27 19:49:56,352][106226] Updated weights for policy 0, policy_version 83862 (0.0010) [2023-12-27 19:49:56,386][106225] Updated weights for policy 1, policy_version 83867 (0.0006) [2023-12-27 19:49:56,402][106226] Updated weights for policy 0, policy_version 83872 (0.0010) [2023-12-27 19:49:56,438][106225] Updated weights for policy 1, policy_version 83877 (0.0006) [2023-12-27 19:49:56,497][106225] Updated weights for policy 1, policy_version 83887 (0.0005) [2023-12-27 19:49:57,121][106226] Updated weights for policy 0, policy_version 83882 (0.0010) [2023-12-27 19:49:57,123][106225] Updated weights for policy 1, policy_version 83897 (0.0005) [2023-12-27 19:49:57,175][106226] Updated weights for policy 0, policy_version 83892 (0.0010) [2023-12-27 19:49:57,185][106225] Updated weights for policy 1, policy_version 83907 (0.0005) [2023-12-27 19:49:57,221][106226] Updated weights for policy 0, policy_version 83902 (0.0010) [2023-12-27 19:49:57,231][106225] Updated weights for policy 1, policy_version 83917 (0.0005) [2023-12-27 19:49:57,271][106226] Updated weights for policy 0, policy_version 83912 (0.0010) [2023-12-27 19:49:57,912][106225] Updated weights for policy 1, policy_version 83927 (0.0006) [2023-12-27 19:49:57,964][106225] Updated weights for policy 1, policy_version 83937 (0.0006) [2023-12-27 19:49:58,002][106226] Updated weights for policy 0, policy_version 83922 (0.0010) [2023-12-27 19:49:58,017][106225] Updated weights for policy 1, policy_version 83947 (0.0005) [2023-12-27 19:49:58,052][106226] Updated weights for policy 0, policy_version 83932 (0.0010) [2023-12-27 19:49:58,102][106226] Updated weights for policy 0, policy_version 83942 (0.0010) [2023-12-27 19:49:58,682][106225] Updated weights for policy 1, policy_version 83957 (0.0007) [2023-12-27 19:49:58,770][106225] Updated weights for policy 1, policy_version 83968 (0.0008) [2023-12-27 19:49:58,836][106225] Updated weights for policy 1, policy_version 83978 (0.0007) [2023-12-27 19:49:58,980][106226] Updated weights for policy 0, policy_version 83952 (0.0007) [2023-12-27 19:49:59,039][106226] Updated weights for policy 0, policy_version 83962 (0.0007) [2023-12-27 19:49:59,098][106226] Updated weights for policy 0, policy_version 83972 (0.0008) [2023-12-27 19:49:59,598][106225] Updated weights for policy 1, policy_version 83988 (0.0008) [2023-12-27 19:49:59,659][106225] Updated weights for policy 1, policy_version 83998 (0.0008) [2023-12-27 19:49:59,720][106225] Updated weights for policy 1, policy_version 84008 (0.0006) [2023-12-27 19:49:59,842][106226] Updated weights for policy 0, policy_version 83982 (0.0008) [2023-12-27 19:49:59,911][106226] Updated weights for policy 0, policy_version 83992 (0.0009) [2023-12-27 19:49:59,975][106226] Updated weights for policy 0, policy_version 84002 (0.0008) [2023-12-27 19:50:00,448][106225] Updated weights for policy 1, policy_version 84018 (0.0007) [2023-12-27 19:50:00,503][106225] Updated weights for policy 1, policy_version 84028 (0.0009) [2023-12-27 19:50:00,564][106225] Updated weights for policy 1, policy_version 84038 (0.0008) [2023-12-27 19:50:00,620][106225] Updated weights for policy 1, policy_version 84048 (0.0009) [2023-12-27 19:50:00,689][106226] Updated weights for policy 0, policy_version 84012 (0.0007) [2023-12-27 19:50:00,739][106226] Updated weights for policy 0, policy_version 84022 (0.0009) [2023-12-27 19:50:00,792][106226] Updated weights for policy 0, policy_version 84032 (0.0008) [2023-12-27 19:50:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 43040768. Throughput: 0: 10012.2, 1: 9889.6. Samples: 43031696. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:50:01,175][105115] Avg episode reward: [(0, '-5.033'), (1, '-6.417')] [2023-12-27 19:50:01,349][106225] Updated weights for policy 1, policy_version 84058 (0.0009) [2023-12-27 19:50:01,411][106225] Updated weights for policy 1, policy_version 84068 (0.0008) [2023-12-27 19:50:01,480][106225] Updated weights for policy 1, policy_version 84078 (0.0008) [2023-12-27 19:50:01,593][106226] Updated weights for policy 0, policy_version 84042 (0.0008) [2023-12-27 19:50:01,657][106226] Updated weights for policy 0, policy_version 84052 (0.0008) [2023-12-27 19:50:01,730][106226] Updated weights for policy 0, policy_version 84062 (0.0009) [2023-12-27 19:50:01,791][106226] Updated weights for policy 0, policy_version 84072 (0.0009) [2023-12-27 19:50:02,258][106225] Updated weights for policy 1, policy_version 84088 (0.0009) [2023-12-27 19:50:02,317][106225] Updated weights for policy 1, policy_version 84098 (0.0007) [2023-12-27 19:50:02,375][106225] Updated weights for policy 1, policy_version 84108 (0.0008) [2023-12-27 19:50:02,523][106226] Updated weights for policy 0, policy_version 84082 (0.0009) [2023-12-27 19:50:02,572][106226] Updated weights for policy 0, policy_version 84092 (0.0008) [2023-12-27 19:50:02,623][106226] Updated weights for policy 0, policy_version 84102 (0.0008) [2023-12-27 19:50:03,157][106225] Updated weights for policy 1, policy_version 84118 (0.0008) [2023-12-27 19:50:03,212][106225] Updated weights for policy 1, policy_version 84128 (0.0008) [2023-12-27 19:50:03,257][106226] Updated weights for policy 0, policy_version 84112 (0.0010) [2023-12-27 19:50:03,267][106225] Updated weights for policy 1, policy_version 84138 (0.0005) [2023-12-27 19:50:03,307][106226] Updated weights for policy 0, policy_version 84122 (0.0010) [2023-12-27 19:50:03,356][106226] Updated weights for policy 0, policy_version 84132 (0.0010) [2023-12-27 19:50:03,883][106225] Updated weights for policy 1, policy_version 84148 (0.0007) [2023-12-27 19:50:03,941][106225] Updated weights for policy 1, policy_version 84158 (0.0010) [2023-12-27 19:50:03,998][106225] Updated weights for policy 1, policy_version 84168 (0.0009) [2023-12-27 19:50:04,022][106226] Updated weights for policy 0, policy_version 84142 (0.0008) [2023-12-27 19:50:04,088][106226] Updated weights for policy 0, policy_version 84152 (0.0006) [2023-12-27 19:50:04,151][106226] Updated weights for policy 0, policy_version 84162 (0.0008) [2023-12-27 19:50:04,765][106226] Updated weights for policy 0, policy_version 84172 (0.0009) [2023-12-27 19:50:04,798][106225] Updated weights for policy 1, policy_version 84178 (0.0008) [2023-12-27 19:50:04,827][106226] Updated weights for policy 0, policy_version 84182 (0.0007) [2023-12-27 19:50:04,859][106225] Updated weights for policy 1, policy_version 84188 (0.0007) [2023-12-27 19:50:04,889][106226] Updated weights for policy 0, policy_version 84192 (0.0008) [2023-12-27 19:50:04,918][106225] Updated weights for policy 1, policy_version 84198 (0.0006) [2023-12-27 19:50:04,974][106225] Updated weights for policy 1, policy_version 84208 (0.0007) [2023-12-27 19:50:05,565][106226] Updated weights for policy 0, policy_version 84202 (0.0009) [2023-12-27 19:50:05,632][106226] Updated weights for policy 0, policy_version 84212 (0.0010) [2023-12-27 19:50:05,660][106225] Updated weights for policy 1, policy_version 84218 (0.0005) [2023-12-27 19:50:05,698][106226] Updated weights for policy 0, policy_version 84222 (0.0011) [2023-12-27 19:50:05,721][106225] Updated weights for policy 1, policy_version 84228 (0.0007) [2023-12-27 19:50:05,760][106226] Updated weights for policy 0, policy_version 84232 (0.0010) [2023-12-27 19:50:05,771][106225] Updated weights for policy 1, policy_version 84238 (0.0006) [2023-12-27 19:50:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 43139072. Throughput: 0: 10014.4, 1: 9860.5. Samples: 43149096. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:50:06,175][105115] Avg episode reward: [(0, '-5.347'), (1, '-5.938')] [2023-12-27 19:50:06,413][106226] Updated weights for policy 0, policy_version 84242 (0.0005) [2023-12-27 19:50:06,467][106226] Updated weights for policy 0, policy_version 84252 (0.0011) [2023-12-27 19:50:06,512][106225] Updated weights for policy 1, policy_version 84248 (0.0008) [2023-12-27 19:50:06,519][106226] Updated weights for policy 0, policy_version 84262 (0.0010) [2023-12-27 19:50:06,572][106225] Updated weights for policy 1, policy_version 84258 (0.0008) [2023-12-27 19:50:06,627][106225] Updated weights for policy 1, policy_version 84268 (0.0008) [2023-12-27 19:50:07,200][106226] Updated weights for policy 0, policy_version 84272 (0.0010) [2023-12-27 19:50:07,254][106226] Updated weights for policy 0, policy_version 84282 (0.0011) [2023-12-27 19:50:07,276][106225] Updated weights for policy 1, policy_version 84278 (0.0008) [2023-12-27 19:50:07,306][106226] Updated weights for policy 0, policy_version 84292 (0.0010) [2023-12-27 19:50:07,331][106225] Updated weights for policy 1, policy_version 84288 (0.0005) [2023-12-27 19:50:07,389][106225] Updated weights for policy 1, policy_version 84298 (0.0008) [2023-12-27 19:50:08,016][106226] Updated weights for policy 0, policy_version 84302 (0.0007) [2023-12-27 19:50:08,078][106226] Updated weights for policy 0, policy_version 84312 (0.0007) [2023-12-27 19:50:08,091][106225] Updated weights for policy 1, policy_version 84308 (0.0007) [2023-12-27 19:50:08,136][106226] Updated weights for policy 0, policy_version 84322 (0.0005) [2023-12-27 19:50:08,145][106225] Updated weights for policy 1, policy_version 84319 (0.0009) [2023-12-27 19:50:08,199][106225] Updated weights for policy 1, policy_version 84329 (0.0009) [2023-12-27 19:50:08,714][106226] Updated weights for policy 0, policy_version 84332 (0.0009) [2023-12-27 19:50:08,785][106226] Updated weights for policy 0, policy_version 84342 (0.0011) [2023-12-27 19:50:08,846][106226] Updated weights for policy 0, policy_version 84352 (0.0009) [2023-12-27 19:50:08,937][106225] Updated weights for policy 1, policy_version 84339 (0.0009) [2023-12-27 19:50:09,004][106225] Updated weights for policy 1, policy_version 84349 (0.0010) [2023-12-27 19:50:09,073][106225] Updated weights for policy 1, policy_version 84359 (0.0009) [2023-12-27 19:50:09,498][106226] Updated weights for policy 0, policy_version 84362 (0.0006) [2023-12-27 19:50:09,557][106226] Updated weights for policy 0, policy_version 84372 (0.0008) [2023-12-27 19:50:09,616][106226] Updated weights for policy 0, policy_version 84382 (0.0008) [2023-12-27 19:50:09,678][106226] Updated weights for policy 0, policy_version 84392 (0.0008) [2023-12-27 19:50:09,883][106225] Updated weights for policy 1, policy_version 84369 (0.0011) [2023-12-27 19:50:09,944][106225] Updated weights for policy 1, policy_version 84379 (0.0009) [2023-12-27 19:50:09,993][106225] Updated weights for policy 1, policy_version 84389 (0.0007) [2023-12-27 19:50:10,048][106225] Updated weights for policy 1, policy_version 84399 (0.0006) [2023-12-27 19:50:10,467][106226] Updated weights for policy 0, policy_version 84402 (0.0009) [2023-12-27 19:50:10,527][106226] Updated weights for policy 0, policy_version 84412 (0.0009) [2023-12-27 19:50:10,583][106226] Updated weights for policy 0, policy_version 84422 (0.0008) [2023-12-27 19:50:10,771][106225] Updated weights for policy 1, policy_version 84409 (0.0008) [2023-12-27 19:50:10,831][106225] Updated weights for policy 1, policy_version 84419 (0.0009) [2023-12-27 19:50:10,891][106225] Updated weights for policy 1, policy_version 84429 (0.0008) [2023-12-27 19:50:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 43237376. Throughput: 0: 10073.7, 1: 9889.9. Samples: 43210000. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:50:11,176][105115] Avg episode reward: [(0, '-5.192'), (1, '-6.640')] [2023-12-27 19:50:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000084432_21618688.pth... [2023-12-27 19:50:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000084424_21618688.pth... [2023-12-27 19:50:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000083272_21323776.pth [2023-12-27 19:50:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000083280_21323776.pth [2023-12-27 19:50:11,403][106226] Updated weights for policy 0, policy_version 84432 (0.0009) [2023-12-27 19:50:11,466][106226] Updated weights for policy 0, policy_version 84442 (0.0009) [2023-12-27 19:50:11,533][106226] Updated weights for policy 0, policy_version 84452 (0.0009) [2023-12-27 19:50:11,647][106225] Updated weights for policy 1, policy_version 84439 (0.0009) [2023-12-27 19:50:11,708][106225] Updated weights for policy 1, policy_version 84449 (0.0009) [2023-12-27 19:50:11,780][106225] Updated weights for policy 1, policy_version 84459 (0.0008) [2023-12-27 19:50:12,302][106226] Updated weights for policy 0, policy_version 84462 (0.0008) [2023-12-27 19:50:12,363][106226] Updated weights for policy 0, policy_version 84472 (0.0008) [2023-12-27 19:50:12,432][106226] Updated weights for policy 0, policy_version 84482 (0.0009) [2023-12-27 19:50:12,472][106225] Updated weights for policy 1, policy_version 84469 (0.0005) [2023-12-27 19:50:12,531][106225] Updated weights for policy 1, policy_version 84479 (0.0008) [2023-12-27 19:50:12,588][106225] Updated weights for policy 1, policy_version 84489 (0.0008) [2023-12-27 19:50:13,087][106226] Updated weights for policy 0, policy_version 84492 (0.0008) [2023-12-27 19:50:13,139][106226] Updated weights for policy 0, policy_version 84502 (0.0009) [2023-12-27 19:50:13,193][106226] Updated weights for policy 0, policy_version 84512 (0.0011) [2023-12-27 19:50:13,265][106225] Updated weights for policy 1, policy_version 84499 (0.0009) [2023-12-27 19:50:13,318][106225] Updated weights for policy 1, policy_version 84509 (0.0007) [2023-12-27 19:50:13,373][106225] Updated weights for policy 1, policy_version 84519 (0.0006) [2023-12-27 19:50:13,864][106226] Updated weights for policy 0, policy_version 84522 (0.0010) [2023-12-27 19:50:13,916][106226] Updated weights for policy 0, policy_version 84532 (0.0010) [2023-12-27 19:50:13,965][106226] Updated weights for policy 0, policy_version 84542 (0.0010) [2023-12-27 19:50:14,022][106226] Updated weights for policy 0, policy_version 84552 (0.0010) [2023-12-27 19:50:14,129][106225] Updated weights for policy 1, policy_version 84529 (0.0008) [2023-12-27 19:50:14,190][106225] Updated weights for policy 1, policy_version 84539 (0.0008) [2023-12-27 19:50:14,250][106225] Updated weights for policy 1, policy_version 84549 (0.0007) [2023-12-27 19:50:14,312][106225] Updated weights for policy 1, policy_version 84559 (0.0008) [2023-12-27 19:50:14,738][106226] Updated weights for policy 0, policy_version 84562 (0.0010) [2023-12-27 19:50:14,798][106226] Updated weights for policy 0, policy_version 84572 (0.0009) [2023-12-27 19:50:14,862][106226] Updated weights for policy 0, policy_version 84582 (0.0011) [2023-12-27 19:50:15,053][106225] Updated weights for policy 1, policy_version 84569 (0.0008) [2023-12-27 19:50:15,115][106225] Updated weights for policy 1, policy_version 84579 (0.0008) [2023-12-27 19:50:15,180][106225] Updated weights for policy 1, policy_version 84589 (0.0007) [2023-12-27 19:50:15,596][106226] Updated weights for policy 0, policy_version 84592 (0.0010) [2023-12-27 19:50:15,655][106226] Updated weights for policy 0, policy_version 84602 (0.0010) [2023-12-27 19:50:15,711][106226] Updated weights for policy 0, policy_version 84612 (0.0008) [2023-12-27 19:50:15,907][106225] Updated weights for policy 1, policy_version 84599 (0.0006) [2023-12-27 19:50:15,967][106225] Updated weights for policy 1, policy_version 84609 (0.0005) [2023-12-27 19:50:16,031][106225] Updated weights for policy 1, policy_version 84619 (0.0008) [2023-12-27 19:50:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 43335680. Throughput: 0: 9966.0, 1: 9813.6. Samples: 43323620. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:50:16,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-6.404')] [2023-12-27 19:50:16,351][106226] Updated weights for policy 0, policy_version 84622 (0.0005) [2023-12-27 19:50:16,418][106226] Updated weights for policy 0, policy_version 84632 (0.0010) [2023-12-27 19:50:16,482][106226] Updated weights for policy 0, policy_version 84642 (0.0011) [2023-12-27 19:50:16,676][106225] Updated weights for policy 1, policy_version 84629 (0.0008) [2023-12-27 19:50:16,739][106225] Updated weights for policy 1, policy_version 84639 (0.0006) [2023-12-27 19:50:16,812][106225] Updated weights for policy 1, policy_version 84649 (0.0006) [2023-12-27 19:50:17,088][106226] Updated weights for policy 0, policy_version 84652 (0.0010) [2023-12-27 19:50:17,156][106226] Updated weights for policy 0, policy_version 84662 (0.0009) [2023-12-27 19:50:17,225][106226] Updated weights for policy 0, policy_version 84672 (0.0008) [2023-12-27 19:50:17,397][106225] Updated weights for policy 1, policy_version 84659 (0.0007) [2023-12-27 19:50:17,449][106225] Updated weights for policy 1, policy_version 84669 (0.0008) [2023-12-27 19:50:17,510][106225] Updated weights for policy 1, policy_version 84679 (0.0005) [2023-12-27 19:50:17,941][106226] Updated weights for policy 0, policy_version 84682 (0.0007) [2023-12-27 19:50:17,995][106226] Updated weights for policy 0, policy_version 84692 (0.0005) [2023-12-27 19:50:18,056][106226] Updated weights for policy 0, policy_version 84702 (0.0010) [2023-12-27 19:50:18,109][106226] Updated weights for policy 0, policy_version 84712 (0.0010) [2023-12-27 19:50:18,189][106225] Updated weights for policy 1, policy_version 84689 (0.0006) [2023-12-27 19:50:18,251][106225] Updated weights for policy 1, policy_version 84699 (0.0007) [2023-12-27 19:50:18,310][106225] Updated weights for policy 1, policy_version 84709 (0.0007) [2023-12-27 19:50:18,374][106225] Updated weights for policy 1, policy_version 84719 (0.0008) [2023-12-27 19:50:18,791][106226] Updated weights for policy 0, policy_version 84722 (0.0011) [2023-12-27 19:50:18,859][106226] Updated weights for policy 0, policy_version 84732 (0.0011) [2023-12-27 19:50:18,910][106226] Updated weights for policy 0, policy_version 84742 (0.0011) [2023-12-27 19:50:19,104][106225] Updated weights for policy 1, policy_version 84729 (0.0008) [2023-12-27 19:50:19,157][106225] Updated weights for policy 1, policy_version 84739 (0.0009) [2023-12-27 19:50:19,215][106225] Updated weights for policy 1, policy_version 84749 (0.0009) [2023-12-27 19:50:19,655][106226] Updated weights for policy 0, policy_version 84752 (0.0011) [2023-12-27 19:50:19,723][106226] Updated weights for policy 0, policy_version 84762 (0.0011) [2023-12-27 19:50:19,791][106226] Updated weights for policy 0, policy_version 84772 (0.0010) [2023-12-27 19:50:19,932][106225] Updated weights for policy 1, policy_version 84759 (0.0008) [2023-12-27 19:50:19,992][106225] Updated weights for policy 1, policy_version 84769 (0.0008) [2023-12-27 19:50:20,051][106225] Updated weights for policy 1, policy_version 84779 (0.0008) [2023-12-27 19:50:20,504][106226] Updated weights for policy 0, policy_version 84782 (0.0009) [2023-12-27 19:50:20,565][106226] Updated weights for policy 0, policy_version 84792 (0.0008) [2023-12-27 19:50:20,635][106226] Updated weights for policy 0, policy_version 84802 (0.0009) [2023-12-27 19:50:20,847][106225] Updated weights for policy 1, policy_version 84789 (0.0009) [2023-12-27 19:50:20,906][106225] Updated weights for policy 1, policy_version 84799 (0.0009) [2023-12-27 19:50:20,958][106225] Updated weights for policy 1, policy_version 84809 (0.0008) [2023-12-27 19:50:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 43433984. Throughput: 0: 9946.7, 1: 9763.4. Samples: 43442240. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 19:50:21,175][105115] Avg episode reward: [(0, '-5.251'), (1, '-6.731')] [2023-12-27 19:50:21,451][106226] Updated weights for policy 0, policy_version 84812 (0.0008) [2023-12-27 19:50:21,521][106226] Updated weights for policy 0, policy_version 84822 (0.0007) [2023-12-27 19:50:21,588][106226] Updated weights for policy 0, policy_version 84832 (0.0007) [2023-12-27 19:50:21,821][106225] Updated weights for policy 1, policy_version 84819 (0.0009) [2023-12-27 19:50:21,885][106225] Updated weights for policy 1, policy_version 84829 (0.0008) [2023-12-27 19:50:21,959][106225] Updated weights for policy 1, policy_version 84839 (0.0010) [2023-12-27 19:50:22,274][106226] Updated weights for policy 0, policy_version 84842 (0.0009) [2023-12-27 19:50:22,338][106226] Updated weights for policy 0, policy_version 84852 (0.0007) [2023-12-27 19:50:22,412][106226] Updated weights for policy 0, policy_version 84862 (0.0007) [2023-12-27 19:50:22,479][106226] Updated weights for policy 0, policy_version 84872 (0.0006) [2023-12-27 19:50:22,737][106225] Updated weights for policy 1, policy_version 84849 (0.0008) [2023-12-27 19:50:22,800][106225] Updated weights for policy 1, policy_version 84859 (0.0009) [2023-12-27 19:50:22,870][106225] Updated weights for policy 1, policy_version 84869 (0.0006) [2023-12-27 19:50:22,932][106225] Updated weights for policy 1, policy_version 84879 (0.0008) [2023-12-27 19:50:23,135][106226] Updated weights for policy 0, policy_version 84882 (0.0007) [2023-12-27 19:50:23,185][106226] Updated weights for policy 0, policy_version 84892 (0.0009) [2023-12-27 19:50:23,246][106226] Updated weights for policy 0, policy_version 84902 (0.0009) [2023-12-27 19:50:23,462][106225] Updated weights for policy 1, policy_version 84889 (0.0009) [2023-12-27 19:50:23,518][106225] Updated weights for policy 1, policy_version 84899 (0.0010) [2023-12-27 19:50:23,582][106225] Updated weights for policy 1, policy_version 84909 (0.0010) [2023-12-27 19:50:24,014][106226] Updated weights for policy 0, policy_version 84912 (0.0008) [2023-12-27 19:50:24,062][106226] Updated weights for policy 0, policy_version 84922 (0.0008) [2023-12-27 19:50:24,113][106226] Updated weights for policy 0, policy_version 84932 (0.0008) [2023-12-27 19:50:24,231][106225] Updated weights for policy 1, policy_version 84919 (0.0010) [2023-12-27 19:50:24,292][106225] Updated weights for policy 1, policy_version 84929 (0.0010) [2023-12-27 19:50:24,347][106225] Updated weights for policy 1, policy_version 84939 (0.0010) [2023-12-27 19:50:24,913][106226] Updated weights for policy 0, policy_version 84942 (0.0008) [2023-12-27 19:50:24,959][106226] Updated weights for policy 0, policy_version 84952 (0.0008) [2023-12-27 19:50:24,980][106225] Updated weights for policy 1, policy_version 84949 (0.0010) [2023-12-27 19:50:25,013][106226] Updated weights for policy 0, policy_version 84962 (0.0006) [2023-12-27 19:50:25,037][106225] Updated weights for policy 1, policy_version 84959 (0.0010) [2023-12-27 19:50:25,095][106225] Updated weights for policy 1, policy_version 84969 (0.0010) [2023-12-27 19:50:25,753][106226] Updated weights for policy 0, policy_version 84972 (0.0007) [2023-12-27 19:50:25,782][106225] Updated weights for policy 1, policy_version 84979 (0.0010) [2023-12-27 19:50:25,806][106226] Updated weights for policy 0, policy_version 84982 (0.0007) [2023-12-27 19:50:25,839][106225] Updated weights for policy 1, policy_version 84989 (0.0010) [2023-12-27 19:50:25,875][106226] Updated weights for policy 0, policy_version 84992 (0.0006) [2023-12-27 19:50:25,896][106225] Updated weights for policy 1, policy_version 84999 (0.0010) [2023-12-27 19:50:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.5, 300 sec: 19855.2). Total num frames: 43532288. Throughput: 0: 9911.4, 1: 9740.3. Samples: 43498884. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:26,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-6.277')] [2023-12-27 19:50:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000085000_21766144.pth... [2023-12-27 19:50:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000085008_21766144.pth... [2023-12-27 19:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000083848_21471232.pth [2023-12-27 19:50:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000083856_21471232.pth [2023-12-27 19:50:26,549][106226] Updated weights for policy 0, policy_version 85002 (0.0007) [2023-12-27 19:50:26,611][106225] Updated weights for policy 1, policy_version 85009 (0.0010) [2023-12-27 19:50:26,611][106226] Updated weights for policy 0, policy_version 85012 (0.0010) [2023-12-27 19:50:26,663][106225] Updated weights for policy 1, policy_version 85019 (0.0010) [2023-12-27 19:50:26,668][106226] Updated weights for policy 0, policy_version 85022 (0.0010) [2023-12-27 19:50:26,723][106225] Updated weights for policy 1, policy_version 85029 (0.0010) [2023-12-27 19:50:26,726][106226] Updated weights for policy 0, policy_version 85032 (0.0008) [2023-12-27 19:50:26,791][106225] Updated weights for policy 1, policy_version 85039 (0.0010) [2023-12-27 19:50:27,328][106226] Updated weights for policy 0, policy_version 85042 (0.0010) [2023-12-27 19:50:27,393][106226] Updated weights for policy 0, policy_version 85052 (0.0010) [2023-12-27 19:50:27,454][106226] Updated weights for policy 0, policy_version 85062 (0.0011) [2023-12-27 19:50:27,485][106225] Updated weights for policy 1, policy_version 85049 (0.0010) [2023-12-27 19:50:27,540][106225] Updated weights for policy 1, policy_version 85059 (0.0010) [2023-12-27 19:50:27,596][106225] Updated weights for policy 1, policy_version 85069 (0.0010) [2023-12-27 19:50:27,988][106226] Updated weights for policy 0, policy_version 85072 (0.0006) [2023-12-27 19:50:28,039][106226] Updated weights for policy 0, policy_version 85082 (0.0005) [2023-12-27 19:50:28,097][106226] Updated weights for policy 0, policy_version 85092 (0.0005) [2023-12-27 19:50:28,302][106225] Updated weights for policy 1, policy_version 85079 (0.0010) [2023-12-27 19:50:28,367][106225] Updated weights for policy 1, policy_version 85089 (0.0010) [2023-12-27 19:50:28,423][106225] Updated weights for policy 1, policy_version 85099 (0.0010) [2023-12-27 19:50:28,729][106226] Updated weights for policy 0, policy_version 85102 (0.0006) [2023-12-27 19:50:28,782][106226] Updated weights for policy 0, policy_version 85112 (0.0007) [2023-12-27 19:50:28,838][106226] Updated weights for policy 0, policy_version 85122 (0.0007) [2023-12-27 19:50:29,125][106225] Updated weights for policy 1, policy_version 85109 (0.0008) [2023-12-27 19:50:29,178][106225] Updated weights for policy 1, policy_version 85119 (0.0010) [2023-12-27 19:50:29,247][106225] Updated weights for policy 1, policy_version 85129 (0.0010) [2023-12-27 19:50:29,426][106226] Updated weights for policy 0, policy_version 85132 (0.0008) [2023-12-27 19:50:29,477][106226] Updated weights for policy 0, policy_version 85142 (0.0010) [2023-12-27 19:50:29,540][106226] Updated weights for policy 0, policy_version 85152 (0.0011) [2023-12-27 19:50:29,942][106225] Updated weights for policy 1, policy_version 85139 (0.0009) [2023-12-27 19:50:30,006][106225] Updated weights for policy 1, policy_version 85149 (0.0010) [2023-12-27 19:50:30,069][106225] Updated weights for policy 1, policy_version 85159 (0.0010) [2023-12-27 19:50:30,249][106226] Updated weights for policy 0, policy_version 85162 (0.0011) [2023-12-27 19:50:30,309][106226] Updated weights for policy 0, policy_version 85172 (0.0011) [2023-12-27 19:50:30,370][106226] Updated weights for policy 0, policy_version 85182 (0.0008) [2023-12-27 19:50:30,425][106226] Updated weights for policy 0, policy_version 85192 (0.0005) [2023-12-27 19:50:30,755][106225] Updated weights for policy 1, policy_version 85169 (0.0010) [2023-12-27 19:50:30,801][106225] Updated weights for policy 1, policy_version 85179 (0.0010) [2023-12-27 19:50:30,861][106225] Updated weights for policy 1, policy_version 85189 (0.0007) [2023-12-27 19:50:30,920][106225] Updated weights for policy 1, policy_version 85199 (0.0009) [2023-12-27 19:50:30,999][106226] Updated weights for policy 0, policy_version 85202 (0.0005) [2023-12-27 19:50:31,065][106226] Updated weights for policy 0, policy_version 85212 (0.0007) [2023-12-27 19:50:31,128][106226] Updated weights for policy 0, policy_version 85222 (0.0006) [2023-12-27 19:50:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 43638784. Throughput: 0: 10031.5, 1: 9820.2. Samples: 43622224. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:31,175][105115] Avg episode reward: [(0, '-4.869'), (1, '-6.489')] [2023-12-27 19:50:31,739][106225] Updated weights for policy 1, policy_version 85209 (0.0008) [2023-12-27 19:50:31,814][106225] Updated weights for policy 1, policy_version 85219 (0.0009) [2023-12-27 19:50:31,876][106225] Updated weights for policy 1, policy_version 85229 (0.0007) [2023-12-27 19:50:31,876][106226] Updated weights for policy 0, policy_version 85232 (0.0008) [2023-12-27 19:50:31,946][106226] Updated weights for policy 0, policy_version 85242 (0.0009) [2023-12-27 19:50:32,007][106226] Updated weights for policy 0, policy_version 85252 (0.0008) [2023-12-27 19:50:32,598][106225] Updated weights for policy 1, policy_version 85239 (0.0009) [2023-12-27 19:50:32,657][106225] Updated weights for policy 1, policy_version 85249 (0.0009) [2023-12-27 19:50:32,717][106226] Updated weights for policy 0, policy_version 85262 (0.0008) [2023-12-27 19:50:32,722][106225] Updated weights for policy 1, policy_version 85259 (0.0005) [2023-12-27 19:50:32,781][106226] Updated weights for policy 0, policy_version 85272 (0.0009) [2023-12-27 19:50:32,836][106226] Updated weights for policy 0, policy_version 85282 (0.0007) [2023-12-27 19:50:33,300][106225] Updated weights for policy 1, policy_version 85269 (0.0007) [2023-12-27 19:50:33,357][106225] Updated weights for policy 1, policy_version 85279 (0.0005) [2023-12-27 19:50:33,408][106225] Updated weights for policy 1, policy_version 85289 (0.0005) [2023-12-27 19:50:33,460][106226] Updated weights for policy 0, policy_version 85292 (0.0006) [2023-12-27 19:50:33,522][106226] Updated weights for policy 0, policy_version 85302 (0.0009) [2023-12-27 19:50:33,579][106226] Updated weights for policy 0, policy_version 85312 (0.0009) [2023-12-27 19:50:34,025][106225] Updated weights for policy 1, policy_version 85299 (0.0006) [2023-12-27 19:50:34,073][106225] Updated weights for policy 1, policy_version 85309 (0.0008) [2023-12-27 19:50:34,132][106225] Updated weights for policy 1, policy_version 85319 (0.0008) [2023-12-27 19:50:34,195][106226] Updated weights for policy 0, policy_version 85322 (0.0007) [2023-12-27 19:50:34,250][106226] Updated weights for policy 0, policy_version 85332 (0.0009) [2023-12-27 19:50:34,311][106226] Updated weights for policy 0, policy_version 85342 (0.0008) [2023-12-27 19:50:34,376][106226] Updated weights for policy 0, policy_version 85352 (0.0009) [2023-12-27 19:50:34,883][106225] Updated weights for policy 1, policy_version 85329 (0.0008) [2023-12-27 19:50:34,943][106225] Updated weights for policy 1, policy_version 85339 (0.0007) [2023-12-27 19:50:35,003][106225] Updated weights for policy 1, policy_version 85349 (0.0007) [2023-12-27 19:50:35,070][106225] Updated weights for policy 1, policy_version 85359 (0.0008) [2023-12-27 19:50:35,126][106226] Updated weights for policy 0, policy_version 85362 (0.0010) [2023-12-27 19:50:35,191][106226] Updated weights for policy 0, policy_version 85372 (0.0009) [2023-12-27 19:50:35,250][106226] Updated weights for policy 0, policy_version 85382 (0.0010) [2023-12-27 19:50:35,760][106225] Updated weights for policy 1, policy_version 85369 (0.0007) [2023-12-27 19:50:35,807][106225] Updated weights for policy 1, policy_version 85379 (0.0008) [2023-12-27 19:50:35,856][106225] Updated weights for policy 1, policy_version 85389 (0.0008) [2023-12-27 19:50:35,912][106226] Updated weights for policy 0, policy_version 85392 (0.0006) [2023-12-27 19:50:35,970][106226] Updated weights for policy 0, policy_version 85402 (0.0005) [2023-12-27 19:50:36,018][106226] Updated weights for policy 0, policy_version 85412 (0.0009) [2023-12-27 19:50:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 43737088. Throughput: 0: 9961.3, 1: 9805.1. Samples: 43743088. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:36,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-6.517')] [2023-12-27 19:50:36,624][106226] Updated weights for policy 0, policy_version 85422 (0.0010) [2023-12-27 19:50:36,683][106226] Updated weights for policy 0, policy_version 85432 (0.0011) [2023-12-27 19:50:36,694][106225] Updated weights for policy 1, policy_version 85399 (0.0007) [2023-12-27 19:50:36,744][106226] Updated weights for policy 0, policy_version 85442 (0.0011) [2023-12-27 19:50:36,757][106225] Updated weights for policy 1, policy_version 85409 (0.0009) [2023-12-27 19:50:36,816][106225] Updated weights for policy 1, policy_version 85419 (0.0009) [2023-12-27 19:50:37,398][106226] Updated weights for policy 0, policy_version 85452 (0.0008) [2023-12-27 19:50:37,456][106226] Updated weights for policy 0, policy_version 85462 (0.0005) [2023-12-27 19:50:37,515][106226] Updated weights for policy 0, policy_version 85472 (0.0006) [2023-12-27 19:50:37,559][106225] Updated weights for policy 1, policy_version 85429 (0.0008) [2023-12-27 19:50:37,618][106225] Updated weights for policy 1, policy_version 85439 (0.0009) [2023-12-27 19:50:37,683][106225] Updated weights for policy 1, policy_version 85449 (0.0008) [2023-12-27 19:50:38,165][106226] Updated weights for policy 0, policy_version 85482 (0.0006) [2023-12-27 19:50:38,224][106226] Updated weights for policy 0, policy_version 85492 (0.0010) [2023-12-27 19:50:38,275][106226] Updated weights for policy 0, policy_version 85502 (0.0007) [2023-12-27 19:50:38,337][106226] Updated weights for policy 0, policy_version 85512 (0.0007) [2023-12-27 19:50:38,488][106225] Updated weights for policy 1, policy_version 85459 (0.0007) [2023-12-27 19:50:38,542][106225] Updated weights for policy 1, policy_version 85469 (0.0005) [2023-12-27 19:50:38,604][106225] Updated weights for policy 1, policy_version 85479 (0.0005) [2023-12-27 19:50:39,022][106226] Updated weights for policy 0, policy_version 85522 (0.0010) [2023-12-27 19:50:39,089][106226] Updated weights for policy 0, policy_version 85532 (0.0010) [2023-12-27 19:50:39,135][106226] Updated weights for policy 0, policy_version 85542 (0.0010) [2023-12-27 19:50:39,255][106225] Updated weights for policy 1, policy_version 85489 (0.0008) [2023-12-27 19:50:39,312][106225] Updated weights for policy 1, policy_version 85499 (0.0010) [2023-12-27 19:50:39,385][106225] Updated weights for policy 1, policy_version 85509 (0.0010) [2023-12-27 19:50:39,450][106225] Updated weights for policy 1, policy_version 85519 (0.0008) [2023-12-27 19:50:39,896][106226] Updated weights for policy 0, policy_version 85552 (0.0010) [2023-12-27 19:50:39,964][106226] Updated weights for policy 0, policy_version 85562 (0.0010) [2023-12-27 19:50:40,031][106226] Updated weights for policy 0, policy_version 85572 (0.0011) [2023-12-27 19:50:40,077][106225] Updated weights for policy 1, policy_version 85529 (0.0006) [2023-12-27 19:50:40,136][106225] Updated weights for policy 1, policy_version 85539 (0.0008) [2023-12-27 19:50:40,199][106225] Updated weights for policy 1, policy_version 85549 (0.0008) [2023-12-27 19:50:40,735][106226] Updated weights for policy 0, policy_version 85582 (0.0011) [2023-12-27 19:50:40,804][106226] Updated weights for policy 0, policy_version 85592 (0.0011) [2023-12-27 19:50:40,875][106226] Updated weights for policy 0, policy_version 85602 (0.0010) [2023-12-27 19:50:41,014][106225] Updated weights for policy 1, policy_version 85559 (0.0007) [2023-12-27 19:50:41,078][106225] Updated weights for policy 1, policy_version 85569 (0.0008) [2023-12-27 19:50:41,140][106225] Updated weights for policy 1, policy_version 85579 (0.0008) [2023-12-27 19:50:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 43835392. Throughput: 0: 10018.9, 1: 9730.0. Samples: 43802120. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:41,175][105115] Avg episode reward: [(0, '-5.335'), (1, '-6.380')] [2023-12-27 19:50:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000085584_21913600.pth... [2023-12-27 19:50:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000085608_21921792.pth... [2023-12-27 19:50:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000084424_21618688.pth [2023-12-27 19:50:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000084432_21618688.pth [2023-12-27 19:50:41,634][106226] Updated weights for policy 0, policy_version 85612 (0.0010) [2023-12-27 19:50:41,702][106226] Updated weights for policy 0, policy_version 85622 (0.0009) [2023-12-27 19:50:41,772][106226] Updated weights for policy 0, policy_version 85632 (0.0010) [2023-12-27 19:50:41,939][106225] Updated weights for policy 1, policy_version 85589 (0.0008) [2023-12-27 19:50:42,002][106225] Updated weights for policy 1, policy_version 85599 (0.0008) [2023-12-27 19:50:42,063][106225] Updated weights for policy 1, policy_version 85609 (0.0008) [2023-12-27 19:50:42,567][106226] Updated weights for policy 0, policy_version 85642 (0.0009) [2023-12-27 19:50:42,627][106226] Updated weights for policy 0, policy_version 85652 (0.0009) [2023-12-27 19:50:42,692][106226] Updated weights for policy 0, policy_version 85662 (0.0009) [2023-12-27 19:50:42,732][106225] Updated weights for policy 1, policy_version 85619 (0.0007) [2023-12-27 19:50:42,751][106226] Updated weights for policy 0, policy_version 85672 (0.0008) [2023-12-27 19:50:42,784][106225] Updated weights for policy 1, policy_version 85629 (0.0008) [2023-12-27 19:50:42,833][106225] Updated weights for policy 1, policy_version 85639 (0.0008) [2023-12-27 19:50:43,449][106226] Updated weights for policy 0, policy_version 85682 (0.0008) [2023-12-27 19:50:43,514][106226] Updated weights for policy 0, policy_version 85692 (0.0009) [2023-12-27 19:50:43,541][106225] Updated weights for policy 1, policy_version 85649 (0.0007) [2023-12-27 19:50:43,568][106226] Updated weights for policy 0, policy_version 85702 (0.0008) [2023-12-27 19:50:43,597][106225] Updated weights for policy 1, policy_version 85659 (0.0008) [2023-12-27 19:50:43,641][106225] Updated weights for policy 1, policy_version 85669 (0.0008) [2023-12-27 19:50:43,689][106225] Updated weights for policy 1, policy_version 85679 (0.0008) [2023-12-27 19:50:44,319][106226] Updated weights for policy 0, policy_version 85712 (0.0009) [2023-12-27 19:50:44,376][106226] Updated weights for policy 0, policy_version 85722 (0.0006) [2023-12-27 19:50:44,381][106225] Updated weights for policy 1, policy_version 85689 (0.0008) [2023-12-27 19:50:44,430][106226] Updated weights for policy 0, policy_version 85732 (0.0005) [2023-12-27 19:50:44,442][106225] Updated weights for policy 1, policy_version 85699 (0.0008) [2023-12-27 19:50:44,509][106225] Updated weights for policy 1, policy_version 85709 (0.0009) [2023-12-27 19:50:45,230][106226] Updated weights for policy 0, policy_version 85742 (0.0007) [2023-12-27 19:50:45,235][106225] Updated weights for policy 1, policy_version 85719 (0.0008) [2023-12-27 19:50:45,293][106226] Updated weights for policy 0, policy_version 85752 (0.0007) [2023-12-27 19:50:45,299][106225] Updated weights for policy 1, policy_version 85729 (0.0007) [2023-12-27 19:50:45,350][106226] Updated weights for policy 0, policy_version 85762 (0.0007) [2023-12-27 19:50:45,360][106225] Updated weights for policy 1, policy_version 85739 (0.0006) [2023-12-27 19:50:45,922][106225] Updated weights for policy 1, policy_version 85749 (0.0006) [2023-12-27 19:50:45,980][106225] Updated weights for policy 1, policy_version 85759 (0.0005) [2023-12-27 19:50:46,042][106225] Updated weights for policy 1, policy_version 85769 (0.0008) [2023-12-27 19:50:46,156][106226] Updated weights for policy 0, policy_version 85772 (0.0007) [2023-12-27 19:50:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 43925504. Throughput: 0: 9944.3, 1: 9713.4. Samples: 43916296. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:46,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-6.715')] [2023-12-27 19:50:46,205][106226] Updated weights for policy 0, policy_version 85782 (0.0005) [2023-12-27 19:50:46,257][106226] Updated weights for policy 0, policy_version 85792 (0.0009) [2023-12-27 19:50:46,673][106225] Updated weights for policy 1, policy_version 85779 (0.0008) [2023-12-27 19:50:46,734][106225] Updated weights for policy 1, policy_version 85789 (0.0009) [2023-12-27 19:50:46,792][106225] Updated weights for policy 1, policy_version 85799 (0.0008) [2023-12-27 19:50:46,820][106226] Updated weights for policy 0, policy_version 85802 (0.0008) [2023-12-27 19:50:46,883][106226] Updated weights for policy 0, policy_version 85812 (0.0006) [2023-12-27 19:50:46,947][106226] Updated weights for policy 0, policy_version 85822 (0.0007) [2023-12-27 19:50:47,001][106226] Updated weights for policy 0, policy_version 85832 (0.0009) [2023-12-27 19:50:47,370][106225] Updated weights for policy 1, policy_version 85809 (0.0009) [2023-12-27 19:50:47,415][106225] Updated weights for policy 1, policy_version 85819 (0.0005) [2023-12-27 19:50:47,465][106225] Updated weights for policy 1, policy_version 85829 (0.0005) [2023-12-27 19:50:47,513][106225] Updated weights for policy 1, policy_version 85839 (0.0005) [2023-12-27 19:50:47,800][106226] Updated weights for policy 0, policy_version 85842 (0.0008) [2023-12-27 19:50:47,855][106226] Updated weights for policy 0, policy_version 85852 (0.0009) [2023-12-27 19:50:47,910][106226] Updated weights for policy 0, policy_version 85862 (0.0008) [2023-12-27 19:50:48,105][106225] Updated weights for policy 1, policy_version 85849 (0.0008) [2023-12-27 19:50:48,160][106225] Updated weights for policy 1, policy_version 85859 (0.0009) [2023-12-27 19:50:48,224][106225] Updated weights for policy 1, policy_version 85869 (0.0007) [2023-12-27 19:50:48,638][106226] Updated weights for policy 0, policy_version 85872 (0.0008) [2023-12-27 19:50:48,699][106226] Updated weights for policy 0, policy_version 85882 (0.0009) [2023-12-27 19:50:48,750][106226] Updated weights for policy 0, policy_version 85892 (0.0008) [2023-12-27 19:50:48,965][106225] Updated weights for policy 1, policy_version 85879 (0.0009) [2023-12-27 19:50:49,013][106225] Updated weights for policy 1, policy_version 85889 (0.0010) [2023-12-27 19:50:49,070][106225] Updated weights for policy 1, policy_version 85899 (0.0010) [2023-12-27 19:50:49,502][106226] Updated weights for policy 0, policy_version 85902 (0.0009) [2023-12-27 19:50:49,553][106226] Updated weights for policy 0, policy_version 85912 (0.0010) [2023-12-27 19:50:49,610][106226] Updated weights for policy 0, policy_version 85922 (0.0010) [2023-12-27 19:50:49,820][106225] Updated weights for policy 1, policy_version 85909 (0.0008) [2023-12-27 19:50:49,890][106225] Updated weights for policy 1, policy_version 85919 (0.0008) [2023-12-27 19:50:49,954][106225] Updated weights for policy 1, policy_version 85929 (0.0008) [2023-12-27 19:50:50,338][106226] Updated weights for policy 0, policy_version 85932 (0.0010) [2023-12-27 19:50:50,402][106226] Updated weights for policy 0, policy_version 85942 (0.0010) [2023-12-27 19:50:50,460][106226] Updated weights for policy 0, policy_version 85952 (0.0011) [2023-12-27 19:50:50,622][106225] Updated weights for policy 1, policy_version 85939 (0.0007) [2023-12-27 19:50:50,685][106225] Updated weights for policy 1, policy_version 85949 (0.0008) [2023-12-27 19:50:50,747][106225] Updated weights for policy 1, policy_version 85959 (0.0006) [2023-12-27 19:50:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44023808. Throughput: 0: 9861.7, 1: 9846.0. Samples: 44035948. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:51,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-6.135')] [2023-12-27 19:50:51,249][106226] Updated weights for policy 0, policy_version 85962 (0.0010) [2023-12-27 19:50:51,318][106226] Updated weights for policy 0, policy_version 85972 (0.0010) [2023-12-27 19:50:51,386][106226] Updated weights for policy 0, policy_version 85982 (0.0009) [2023-12-27 19:50:51,423][106225] Updated weights for policy 1, policy_version 85969 (0.0006) [2023-12-27 19:50:51,453][106226] Updated weights for policy 0, policy_version 85992 (0.0006) [2023-12-27 19:50:51,483][106225] Updated weights for policy 1, policy_version 85979 (0.0008) [2023-12-27 19:50:51,545][106225] Updated weights for policy 1, policy_version 85989 (0.0008) [2023-12-27 19:50:51,600][106225] Updated weights for policy 1, policy_version 85999 (0.0009) [2023-12-27 19:50:52,224][106226] Updated weights for policy 0, policy_version 86002 (0.0008) [2023-12-27 19:50:52,284][106226] Updated weights for policy 0, policy_version 86012 (0.0009) [2023-12-27 19:50:52,346][106226] Updated weights for policy 0, policy_version 86022 (0.0007) [2023-12-27 19:50:52,375][106225] Updated weights for policy 1, policy_version 86009 (0.0010) [2023-12-27 19:50:52,442][106225] Updated weights for policy 1, policy_version 86019 (0.0008) [2023-12-27 19:50:52,501][106225] Updated weights for policy 1, policy_version 86029 (0.0007) [2023-12-27 19:50:53,103][106225] Updated weights for policy 1, policy_version 86039 (0.0007) [2023-12-27 19:50:53,140][106226] Updated weights for policy 0, policy_version 86032 (0.0008) [2023-12-27 19:50:53,163][106225] Updated weights for policy 1, policy_version 86049 (0.0005) [2023-12-27 19:50:53,195][106226] Updated weights for policy 0, policy_version 86042 (0.0008) [2023-12-27 19:50:53,219][106225] Updated weights for policy 1, policy_version 86059 (0.0005) [2023-12-27 19:50:53,256][106226] Updated weights for policy 0, policy_version 86052 (0.0009) [2023-12-27 19:50:53,800][106225] Updated weights for policy 1, policy_version 86069 (0.0007) [2023-12-27 19:50:53,848][106225] Updated weights for policy 1, policy_version 86079 (0.0008) [2023-12-27 19:50:53,897][106225] Updated weights for policy 1, policy_version 86089 (0.0008) [2023-12-27 19:50:53,952][106226] Updated weights for policy 0, policy_version 86062 (0.0006) [2023-12-27 19:50:54,006][106226] Updated weights for policy 0, policy_version 86072 (0.0005) [2023-12-27 19:50:54,071][106226] Updated weights for policy 0, policy_version 86082 (0.0005) [2023-12-27 19:50:54,645][106226] Updated weights for policy 0, policy_version 86092 (0.0006) [2023-12-27 19:50:54,685][106225] Updated weights for policy 1, policy_version 86099 (0.0008) [2023-12-27 19:50:54,703][106226] Updated weights for policy 0, policy_version 86102 (0.0008) [2023-12-27 19:50:54,732][106225] Updated weights for policy 1, policy_version 86109 (0.0006) [2023-12-27 19:50:54,761][106226] Updated weights for policy 0, policy_version 86112 (0.0007) [2023-12-27 19:50:54,783][106225] Updated weights for policy 1, policy_version 86119 (0.0005) [2023-12-27 19:50:55,499][106226] Updated weights for policy 0, policy_version 86122 (0.0008) [2023-12-27 19:50:55,521][106225] Updated weights for policy 1, policy_version 86129 (0.0008) [2023-12-27 19:50:55,554][106226] Updated weights for policy 0, policy_version 86132 (0.0007) [2023-12-27 19:50:55,572][106225] Updated weights for policy 1, policy_version 86139 (0.0006) [2023-12-27 19:50:55,605][106226] Updated weights for policy 0, policy_version 86142 (0.0006) [2023-12-27 19:50:55,619][106225] Updated weights for policy 1, policy_version 86149 (0.0005) [2023-12-27 19:50:55,662][106226] Updated weights for policy 0, policy_version 86152 (0.0009) [2023-12-27 19:50:55,669][106225] Updated weights for policy 1, policy_version 86159 (0.0008) [2023-12-27 19:50:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44122112. Throughput: 0: 9783.1, 1: 9890.1. Samples: 44095296. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:50:56,176][105115] Avg episode reward: [(0, '-5.131'), (1, '-6.449')] [2023-12-27 19:50:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000086160_22061056.pth... [2023-12-27 19:50:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000086152_22061056.pth... [2023-12-27 19:50:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000085000_21766144.pth [2023-12-27 19:50:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000085008_21766144.pth [2023-12-27 19:50:56,331][106225] Updated weights for policy 1, policy_version 86169 (0.0009) [2023-12-27 19:50:56,396][106225] Updated weights for policy 1, policy_version 86179 (0.0010) [2023-12-27 19:50:56,458][106225] Updated weights for policy 1, policy_version 86189 (0.0010) [2023-12-27 19:50:56,480][106226] Updated weights for policy 0, policy_version 86162 (0.0005) [2023-12-27 19:50:56,547][106226] Updated weights for policy 0, policy_version 86172 (0.0009) [2023-12-27 19:50:56,606][106226] Updated weights for policy 0, policy_version 86182 (0.0008) [2023-12-27 19:50:57,167][106225] Updated weights for policy 1, policy_version 86199 (0.0008) [2023-12-27 19:50:57,224][106225] Updated weights for policy 1, policy_version 86209 (0.0008) [2023-12-27 19:50:57,284][106225] Updated weights for policy 1, policy_version 86219 (0.0008) [2023-12-27 19:50:57,339][106226] Updated weights for policy 0, policy_version 86192 (0.0008) [2023-12-27 19:50:57,388][106226] Updated weights for policy 0, policy_version 86202 (0.0008) [2023-12-27 19:50:57,438][106226] Updated weights for policy 0, policy_version 86212 (0.0008) [2023-12-27 19:50:57,865][106225] Updated weights for policy 1, policy_version 86229 (0.0006) [2023-12-27 19:50:57,926][106225] Updated weights for policy 1, policy_version 86239 (0.0006) [2023-12-27 19:50:57,986][106225] Updated weights for policy 1, policy_version 86249 (0.0008) [2023-12-27 19:50:58,261][106226] Updated weights for policy 0, policy_version 86222 (0.0009) [2023-12-27 19:50:58,334][106226] Updated weights for policy 0, policy_version 86232 (0.0008) [2023-12-27 19:50:58,404][106226] Updated weights for policy 0, policy_version 86242 (0.0008) [2023-12-27 19:50:58,647][106225] Updated weights for policy 1, policy_version 86259 (0.0009) [2023-12-27 19:50:58,714][106225] Updated weights for policy 1, policy_version 86269 (0.0009) [2023-12-27 19:50:58,793][106225] Updated weights for policy 1, policy_version 86279 (0.0008) [2023-12-27 19:50:59,129][106226] Updated weights for policy 0, policy_version 86252 (0.0008) [2023-12-27 19:50:59,188][106226] Updated weights for policy 0, policy_version 86262 (0.0009) [2023-12-27 19:50:59,259][106226] Updated weights for policy 0, policy_version 86273 (0.0009) [2023-12-27 19:50:59,584][106225] Updated weights for policy 1, policy_version 86289 (0.0008) [2023-12-27 19:50:59,643][106225] Updated weights for policy 1, policy_version 86299 (0.0007) [2023-12-27 19:50:59,701][106225] Updated weights for policy 1, policy_version 86309 (0.0005) [2023-12-27 19:50:59,761][106225] Updated weights for policy 1, policy_version 86319 (0.0005) [2023-12-27 19:50:59,994][106226] Updated weights for policy 0, policy_version 86283 (0.0007) [2023-12-27 19:51:00,047][106226] Updated weights for policy 0, policy_version 86293 (0.0006) [2023-12-27 19:51:00,097][106226] Updated weights for policy 0, policy_version 86303 (0.0005) [2023-12-27 19:51:00,408][106225] Updated weights for policy 1, policy_version 86329 (0.0005) [2023-12-27 19:51:00,468][106225] Updated weights for policy 1, policy_version 86339 (0.0008) [2023-12-27 19:51:00,528][106225] Updated weights for policy 1, policy_version 86349 (0.0006) [2023-12-27 19:51:00,794][106226] Updated weights for policy 0, policy_version 86313 (0.0007) [2023-12-27 19:51:00,842][106226] Updated weights for policy 0, policy_version 86323 (0.0005) [2023-12-27 19:51:00,891][106226] Updated weights for policy 0, policy_version 86333 (0.0005) [2023-12-27 19:51:00,941][106226] Updated weights for policy 0, policy_version 86343 (0.0005) [2023-12-27 19:51:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44220416. Throughput: 0: 9771.6, 1: 9941.9. Samples: 44210724. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:51:01,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-6.542')] [2023-12-27 19:51:01,249][106225] Updated weights for policy 1, policy_version 86359 (0.0006) [2023-12-27 19:51:01,306][106225] Updated weights for policy 1, policy_version 86369 (0.0008) [2023-12-27 19:51:01,368][106225] Updated weights for policy 1, policy_version 86379 (0.0008) [2023-12-27 19:51:01,601][106226] Updated weights for policy 0, policy_version 86353 (0.0009) [2023-12-27 19:51:01,665][106226] Updated weights for policy 0, policy_version 86363 (0.0009) [2023-12-27 19:51:01,744][106226] Updated weights for policy 0, policy_version 86373 (0.0009) [2023-12-27 19:51:02,097][106225] Updated weights for policy 1, policy_version 86389 (0.0008) [2023-12-27 19:51:02,150][106225] Updated weights for policy 1, policy_version 86399 (0.0008) [2023-12-27 19:51:02,201][106225] Updated weights for policy 1, policy_version 86409 (0.0007) [2023-12-27 19:51:02,464][106226] Updated weights for policy 0, policy_version 86383 (0.0008) [2023-12-27 19:51:02,522][106226] Updated weights for policy 0, policy_version 86393 (0.0007) [2023-12-27 19:51:02,582][106226] Updated weights for policy 0, policy_version 86403 (0.0006) [2023-12-27 19:51:02,965][106225] Updated weights for policy 1, policy_version 86419 (0.0008) [2023-12-27 19:51:03,020][106225] Updated weights for policy 1, policy_version 86429 (0.0009) [2023-12-27 19:51:03,075][106225] Updated weights for policy 1, policy_version 86439 (0.0008) [2023-12-27 19:51:03,282][106226] Updated weights for policy 0, policy_version 86413 (0.0008) [2023-12-27 19:51:03,340][106226] Updated weights for policy 0, policy_version 86423 (0.0008) [2023-12-27 19:51:03,395][106226] Updated weights for policy 0, policy_version 86433 (0.0006) [2023-12-27 19:51:03,784][106225] Updated weights for policy 1, policy_version 86449 (0.0008) [2023-12-27 19:51:03,838][106225] Updated weights for policy 1, policy_version 86459 (0.0008) [2023-12-27 19:51:03,904][106225] Updated weights for policy 1, policy_version 86469 (0.0007) [2023-12-27 19:51:03,972][106225] Updated weights for policy 1, policy_version 86479 (0.0008) [2023-12-27 19:51:04,131][106226] Updated weights for policy 0, policy_version 86443 (0.0009) [2023-12-27 19:51:04,198][106226] Updated weights for policy 0, policy_version 86453 (0.0011) [2023-12-27 19:51:04,260][106226] Updated weights for policy 0, policy_version 86463 (0.0011) [2023-12-27 19:51:04,697][106225] Updated weights for policy 1, policy_version 86489 (0.0008) [2023-12-27 19:51:04,752][106225] Updated weights for policy 1, policy_version 86499 (0.0008) [2023-12-27 19:51:04,809][106225] Updated weights for policy 1, policy_version 86509 (0.0008) [2023-12-27 19:51:04,893][106226] Updated weights for policy 0, policy_version 86473 (0.0010) [2023-12-27 19:51:04,953][106226] Updated weights for policy 0, policy_version 86483 (0.0005) [2023-12-27 19:51:05,007][106226] Updated weights for policy 0, policy_version 86493 (0.0005) [2023-12-27 19:51:05,060][106226] Updated weights for policy 0, policy_version 86503 (0.0007) [2023-12-27 19:51:05,554][106225] Updated weights for policy 1, policy_version 86519 (0.0008) [2023-12-27 19:51:05,601][106225] Updated weights for policy 1, policy_version 86529 (0.0008) [2023-12-27 19:51:05,619][106226] Updated weights for policy 0, policy_version 86513 (0.0006) [2023-12-27 19:51:05,648][106225] Updated weights for policy 1, policy_version 86539 (0.0009) [2023-12-27 19:51:05,678][106226] Updated weights for policy 0, policy_version 86523 (0.0007) [2023-12-27 19:51:05,735][106226] Updated weights for policy 0, policy_version 86533 (0.0005) [2023-12-27 19:51:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44318720. Throughput: 0: 9826.7, 1: 9910.0. Samples: 44330388. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:51:06,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-6.690')] [2023-12-27 19:51:06,373][106226] Updated weights for policy 0, policy_version 86543 (0.0009) [2023-12-27 19:51:06,390][106225] Updated weights for policy 1, policy_version 86549 (0.0007) [2023-12-27 19:51:06,431][106226] Updated weights for policy 0, policy_version 86553 (0.0011) [2023-12-27 19:51:06,452][106225] Updated weights for policy 1, policy_version 86559 (0.0006) [2023-12-27 19:51:06,492][106226] Updated weights for policy 0, policy_version 86563 (0.0011) [2023-12-27 19:51:06,505][106225] Updated weights for policy 1, policy_version 86569 (0.0009) [2023-12-27 19:51:07,209][106226] Updated weights for policy 0, policy_version 86573 (0.0011) [2023-12-27 19:51:07,251][106225] Updated weights for policy 1, policy_version 86579 (0.0008) [2023-12-27 19:51:07,257][106226] Updated weights for policy 0, policy_version 86583 (0.0011) [2023-12-27 19:51:07,302][106225] Updated weights for policy 1, policy_version 86589 (0.0005) [2023-12-27 19:51:07,304][106226] Updated weights for policy 0, policy_version 86593 (0.0010) [2023-12-27 19:51:07,349][106225] Updated weights for policy 1, policy_version 86599 (0.0008) [2023-12-27 19:51:07,908][106226] Updated weights for policy 0, policy_version 86603 (0.0009) [2023-12-27 19:51:07,959][106226] Updated weights for policy 0, policy_version 86613 (0.0010) [2023-12-27 19:51:07,981][106225] Updated weights for policy 1, policy_version 86609 (0.0008) [2023-12-27 19:51:08,019][106226] Updated weights for policy 0, policy_version 86623 (0.0008) [2023-12-27 19:51:08,034][106225] Updated weights for policy 1, policy_version 86619 (0.0009) [2023-12-27 19:51:08,084][106225] Updated weights for policy 1, policy_version 86629 (0.0010) [2023-12-27 19:51:08,137][106225] Updated weights for policy 1, policy_version 86639 (0.0010) [2023-12-27 19:51:08,649][106226] Updated weights for policy 0, policy_version 86633 (0.0006) [2023-12-27 19:51:08,707][106226] Updated weights for policy 0, policy_version 86643 (0.0005) [2023-12-27 19:51:08,756][106226] Updated weights for policy 0, policy_version 86653 (0.0005) [2023-12-27 19:51:08,816][106226] Updated weights for policy 0, policy_version 86663 (0.0007) [2023-12-27 19:51:08,934][106225] Updated weights for policy 1, policy_version 86649 (0.0008) [2023-12-27 19:51:09,004][106225] Updated weights for policy 1, policy_version 86659 (0.0007) [2023-12-27 19:51:09,072][106225] Updated weights for policy 1, policy_version 86669 (0.0009) [2023-12-27 19:51:09,445][106226] Updated weights for policy 0, policy_version 86673 (0.0009) [2023-12-27 19:51:09,506][106226] Updated weights for policy 0, policy_version 86683 (0.0011) [2023-12-27 19:51:09,566][106226] Updated weights for policy 0, policy_version 86693 (0.0011) [2023-12-27 19:51:09,861][106225] Updated weights for policy 1, policy_version 86679 (0.0009) [2023-12-27 19:51:09,915][106225] Updated weights for policy 1, policy_version 86689 (0.0006) [2023-12-27 19:51:09,976][106225] Updated weights for policy 1, policy_version 86699 (0.0007) [2023-12-27 19:51:10,317][106226] Updated weights for policy 0, policy_version 86703 (0.0009) [2023-12-27 19:51:10,380][106226] Updated weights for policy 0, policy_version 86713 (0.0008) [2023-12-27 19:51:10,442][106226] Updated weights for policy 0, policy_version 86723 (0.0008) [2023-12-27 19:51:10,686][106225] Updated weights for policy 1, policy_version 86709 (0.0006) [2023-12-27 19:51:10,754][106225] Updated weights for policy 1, policy_version 86719 (0.0005) [2023-12-27 19:51:10,809][106225] Updated weights for policy 1, policy_version 86729 (0.0005) [2023-12-27 19:51:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44417024. Throughput: 0: 9909.0, 1: 9931.4. Samples: 44391700. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:51:11,175][105115] Avg episode reward: [(0, '-5.274'), (1, '-6.490')] [2023-12-27 19:51:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000086736_22208512.pth... [2023-12-27 19:51:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000085584_21913600.pth [2023-12-27 19:51:11,189][106226] Updated weights for policy 0, policy_version 86733 (0.0009) [2023-12-27 19:51:11,255][106226] Updated weights for policy 0, policy_version 86743 (0.0008) [2023-12-27 19:51:11,324][106226] Updated weights for policy 0, policy_version 86753 (0.0009) [2023-12-27 19:51:11,369][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000086760_22216704.pth... [2023-12-27 19:51:11,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000085608_21921792.pth [2023-12-27 19:51:11,402][106225] Updated weights for policy 1, policy_version 86739 (0.0006) [2023-12-27 19:51:11,465][106225] Updated weights for policy 1, policy_version 86749 (0.0007) [2023-12-27 19:51:11,528][106225] Updated weights for policy 1, policy_version 86759 (0.0008) [2023-12-27 19:51:12,105][106226] Updated weights for policy 0, policy_version 86763 (0.0010) [2023-12-27 19:51:12,164][106226] Updated weights for policy 0, policy_version 86773 (0.0006) [2023-12-27 19:51:12,228][106226] Updated weights for policy 0, policy_version 86783 (0.0005) [2023-12-27 19:51:12,293][106225] Updated weights for policy 1, policy_version 86769 (0.0007) [2023-12-27 19:51:12,358][106225] Updated weights for policy 1, policy_version 86779 (0.0008) [2023-12-27 19:51:12,427][106225] Updated weights for policy 1, policy_version 86789 (0.0007) [2023-12-27 19:51:12,492][106225] Updated weights for policy 1, policy_version 86799 (0.0006) [2023-12-27 19:51:12,879][106226] Updated weights for policy 0, policy_version 86793 (0.0008) [2023-12-27 19:51:12,952][106226] Updated weights for policy 0, policy_version 86803 (0.0008) [2023-12-27 19:51:13,022][106226] Updated weights for policy 0, policy_version 86813 (0.0009) [2023-12-27 19:51:13,083][106226] Updated weights for policy 0, policy_version 86823 (0.0008) [2023-12-27 19:51:13,178][106225] Updated weights for policy 1, policy_version 86809 (0.0006) [2023-12-27 19:51:13,242][106225] Updated weights for policy 1, policy_version 86819 (0.0010) [2023-12-27 19:51:13,298][106225] Updated weights for policy 1, policy_version 86829 (0.0008) [2023-12-27 19:51:13,686][106226] Updated weights for policy 0, policy_version 86833 (0.0006) [2023-12-27 19:51:13,734][106226] Updated weights for policy 0, policy_version 86843 (0.0007) [2023-12-27 19:51:13,785][106226] Updated weights for policy 0, policy_version 86853 (0.0007) [2023-12-27 19:51:14,021][106225] Updated weights for policy 1, policy_version 86839 (0.0010) [2023-12-27 19:51:14,091][106225] Updated weights for policy 1, policy_version 86849 (0.0006) [2023-12-27 19:51:14,154][106225] Updated weights for policy 1, policy_version 86859 (0.0010) [2023-12-27 19:51:14,403][106226] Updated weights for policy 0, policy_version 86863 (0.0010) [2023-12-27 19:51:14,455][106226] Updated weights for policy 0, policy_version 86873 (0.0009) [2023-12-27 19:51:14,507][106226] Updated weights for policy 0, policy_version 86883 (0.0008) [2023-12-27 19:51:14,732][106225] Updated weights for policy 1, policy_version 86869 (0.0008) [2023-12-27 19:51:14,805][106225] Updated weights for policy 1, policy_version 86879 (0.0010) [2023-12-27 19:51:14,866][106225] Updated weights for policy 1, policy_version 86889 (0.0010) [2023-12-27 19:51:15,277][106226] Updated weights for policy 0, policy_version 86893 (0.0008) [2023-12-27 19:51:15,350][106226] Updated weights for policy 0, policy_version 86903 (0.0007) [2023-12-27 19:51:15,416][106226] Updated weights for policy 0, policy_version 86913 (0.0008) [2023-12-27 19:51:15,590][106225] Updated weights for policy 1, policy_version 86899 (0.0009) [2023-12-27 19:51:15,657][106225] Updated weights for policy 1, policy_version 86909 (0.0005) [2023-12-27 19:51:15,710][106225] Updated weights for policy 1, policy_version 86919 (0.0005) [2023-12-27 19:51:16,048][106226] Updated weights for policy 0, policy_version 86923 (0.0008) [2023-12-27 19:51:16,102][106226] Updated weights for policy 0, policy_version 86933 (0.0009) [2023-12-27 19:51:16,162][106226] Updated weights for policy 0, policy_version 86943 (0.0009) [2023-12-27 19:51:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44515328. Throughput: 0: 9810.9, 1: 9899.3. Samples: 44509180. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 19:51:16,175][105115] Avg episode reward: [(0, '-5.021'), (1, '-6.808')] [2023-12-27 19:51:16,375][106225] Updated weights for policy 1, policy_version 86929 (0.0006) [2023-12-27 19:51:16,445][106225] Updated weights for policy 1, policy_version 86939 (0.0009) [2023-12-27 19:51:16,507][106225] Updated weights for policy 1, policy_version 86949 (0.0010) [2023-12-27 19:51:16,566][106225] Updated weights for policy 1, policy_version 86959 (0.0010) [2023-12-27 19:51:16,867][106226] Updated weights for policy 0, policy_version 86953 (0.0008) [2023-12-27 19:51:16,931][106226] Updated weights for policy 0, policy_version 86963 (0.0008) [2023-12-27 19:51:16,985][106226] Updated weights for policy 0, policy_version 86973 (0.0007) [2023-12-27 19:51:17,039][106226] Updated weights for policy 0, policy_version 86983 (0.0008) [2023-12-27 19:51:17,287][106225] Updated weights for policy 1, policy_version 86969 (0.0010) [2023-12-27 19:51:17,337][106225] Updated weights for policy 1, policy_version 86979 (0.0010) [2023-12-27 19:51:17,394][106225] Updated weights for policy 1, policy_version 86989 (0.0010) [2023-12-27 19:51:17,772][106226] Updated weights for policy 0, policy_version 86993 (0.0008) [2023-12-27 19:51:17,828][106226] Updated weights for policy 0, policy_version 87003 (0.0008) [2023-12-27 19:51:17,880][106226] Updated weights for policy 0, policy_version 87013 (0.0008) [2023-12-27 19:51:18,082][106225] Updated weights for policy 1, policy_version 86999 (0.0010) [2023-12-27 19:51:18,141][106225] Updated weights for policy 1, policy_version 87009 (0.0010) [2023-12-27 19:51:18,197][106225] Updated weights for policy 1, policy_version 87019 (0.0010) [2023-12-27 19:51:18,615][106226] Updated weights for policy 0, policy_version 87023 (0.0006) [2023-12-27 19:51:18,684][106226] Updated weights for policy 0, policy_version 87033 (0.0005) [2023-12-27 19:51:18,742][106226] Updated weights for policy 0, policy_version 87043 (0.0006) [2023-12-27 19:51:18,921][106225] Updated weights for policy 1, policy_version 87029 (0.0010) [2023-12-27 19:51:18,986][106225] Updated weights for policy 1, policy_version 87039 (0.0009) [2023-12-27 19:51:19,055][106225] Updated weights for policy 1, policy_version 87049 (0.0005) [2023-12-27 19:51:19,348][106226] Updated weights for policy 0, policy_version 87053 (0.0008) [2023-12-27 19:51:19,421][106226] Updated weights for policy 0, policy_version 87063 (0.0008) [2023-12-27 19:51:19,480][106226] Updated weights for policy 0, policy_version 87073 (0.0007) [2023-12-27 19:51:19,702][106225] Updated weights for policy 1, policy_version 87059 (0.0007) [2023-12-27 19:51:19,773][106225] Updated weights for policy 1, policy_version 87069 (0.0009) [2023-12-27 19:51:19,856][106225] Updated weights for policy 1, policy_version 87079 (0.0006) [2023-12-27 19:51:20,328][106226] Updated weights for policy 0, policy_version 87083 (0.0009) [2023-12-27 19:51:20,386][106226] Updated weights for policy 0, policy_version 87093 (0.0009) [2023-12-27 19:51:20,446][106226] Updated weights for policy 0, policy_version 87103 (0.0009) [2023-12-27 19:51:20,451][106225] Updated weights for policy 1, policy_version 87089 (0.0007) [2023-12-27 19:51:20,503][106225] Updated weights for policy 1, policy_version 87099 (0.0009) [2023-12-27 19:51:20,564][106225] Updated weights for policy 1, policy_version 87109 (0.0008) [2023-12-27 19:51:20,625][106225] Updated weights for policy 1, policy_version 87119 (0.0010) [2023-12-27 19:51:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 44613632. Throughput: 0: 9745.2, 1: 9894.4. Samples: 44626872. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:21,175][105115] Avg episode reward: [(0, '-5.198'), (1, '-6.604')] [2023-12-27 19:51:21,180][106226] Updated weights for policy 0, policy_version 87113 (0.0009) [2023-12-27 19:51:21,245][106226] Updated weights for policy 0, policy_version 87123 (0.0008) [2023-12-27 19:51:21,315][106226] Updated weights for policy 0, policy_version 87133 (0.0008) [2023-12-27 19:51:21,383][106226] Updated weights for policy 0, policy_version 87143 (0.0008) [2023-12-27 19:51:21,447][106225] Updated weights for policy 1, policy_version 87129 (0.0009) [2023-12-27 19:51:21,510][106225] Updated weights for policy 1, policy_version 87139 (0.0008) [2023-12-27 19:51:21,572][106225] Updated weights for policy 1, policy_version 87149 (0.0008) [2023-12-27 19:51:22,180][106226] Updated weights for policy 0, policy_version 87153 (0.0009) [2023-12-27 19:51:22,229][106226] Updated weights for policy 0, policy_version 87163 (0.0009) [2023-12-27 19:51:22,294][106225] Updated weights for policy 1, policy_version 87159 (0.0007) [2023-12-27 19:51:22,296][106226] Updated weights for policy 0, policy_version 87173 (0.0007) [2023-12-27 19:51:22,355][106225] Updated weights for policy 1, policy_version 87169 (0.0008) [2023-12-27 19:51:22,418][106225] Updated weights for policy 1, policy_version 87179 (0.0009) [2023-12-27 19:51:23,076][106226] Updated weights for policy 0, policy_version 87183 (0.0008) [2023-12-27 19:51:23,129][106226] Updated weights for policy 0, policy_version 87193 (0.0008) [2023-12-27 19:51:23,154][106225] Updated weights for policy 1, policy_version 87189 (0.0008) [2023-12-27 19:51:23,179][106226] Updated weights for policy 0, policy_version 87203 (0.0005) [2023-12-27 19:51:23,214][106225] Updated weights for policy 1, policy_version 87199 (0.0008) [2023-12-27 19:51:23,268][106225] Updated weights for policy 1, policy_version 87209 (0.0009) [2023-12-27 19:51:23,912][106226] Updated weights for policy 0, policy_version 87213 (0.0007) [2023-12-27 19:51:23,970][106226] Updated weights for policy 0, policy_version 87223 (0.0008) [2023-12-27 19:51:23,981][106225] Updated weights for policy 1, policy_version 87219 (0.0008) [2023-12-27 19:51:24,022][106226] Updated weights for policy 0, policy_version 87233 (0.0009) [2023-12-27 19:51:24,040][106225] Updated weights for policy 1, policy_version 87229 (0.0008) [2023-12-27 19:51:24,099][106225] Updated weights for policy 1, policy_version 87239 (0.0006) [2023-12-27 19:51:24,655][106225] Updated weights for policy 1, policy_version 87249 (0.0006) [2023-12-27 19:51:24,713][106225] Updated weights for policy 1, policy_version 87259 (0.0005) [2023-12-27 19:51:24,758][106226] Updated weights for policy 0, policy_version 87243 (0.0009) [2023-12-27 19:51:24,770][106225] Updated weights for policy 1, policy_version 87269 (0.0005) [2023-12-27 19:51:24,818][106226] Updated weights for policy 0, policy_version 87253 (0.0007) [2023-12-27 19:51:24,824][106225] Updated weights for policy 1, policy_version 87279 (0.0005) [2023-12-27 19:51:24,879][106226] Updated weights for policy 0, policy_version 87263 (0.0009) [2023-12-27 19:51:25,475][106225] Updated weights for policy 1, policy_version 87289 (0.0008) [2023-12-27 19:51:25,524][106225] Updated weights for policy 1, policy_version 87299 (0.0008) [2023-12-27 19:51:25,570][106225] Updated weights for policy 1, policy_version 87309 (0.0008) [2023-12-27 19:51:25,611][106226] Updated weights for policy 0, policy_version 87273 (0.0009) [2023-12-27 19:51:25,672][106226] Updated weights for policy 0, policy_version 87283 (0.0011) [2023-12-27 19:51:25,738][106226] Updated weights for policy 0, policy_version 87293 (0.0011) [2023-12-27 19:51:25,794][106226] Updated weights for policy 0, policy_version 87303 (0.0009) [2023-12-27 19:51:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 44711936. Throughput: 0: 9643.6, 1: 9910.0. Samples: 44682036. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:26,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-6.570')] [2023-12-27 19:51:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000087312_22355968.pth... [2023-12-27 19:51:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000087304_22355968.pth... [2023-12-27 19:51:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000086152_22061056.pth [2023-12-27 19:51:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000086160_22061056.pth [2023-12-27 19:51:26,388][106225] Updated weights for policy 1, policy_version 87319 (0.0010) [2023-12-27 19:51:26,402][106226] Updated weights for policy 0, policy_version 87313 (0.0010) [2023-12-27 19:51:26,446][106225] Updated weights for policy 1, policy_version 87329 (0.0010) [2023-12-27 19:51:26,460][106226] Updated weights for policy 0, policy_version 87323 (0.0010) [2023-12-27 19:51:26,503][106225] Updated weights for policy 1, policy_version 87339 (0.0010) [2023-12-27 19:51:26,525][106226] Updated weights for policy 0, policy_version 87333 (0.0007) [2023-12-27 19:51:27,178][106225] Updated weights for policy 1, policy_version 87349 (0.0008) [2023-12-27 19:51:27,223][106226] Updated weights for policy 0, policy_version 87343 (0.0009) [2023-12-27 19:51:27,228][106225] Updated weights for policy 1, policy_version 87359 (0.0010) [2023-12-27 19:51:27,275][106226] Updated weights for policy 0, policy_version 87353 (0.0005) [2023-12-27 19:51:27,284][106225] Updated weights for policy 1, policy_version 87369 (0.0010) [2023-12-27 19:51:27,330][106226] Updated weights for policy 0, policy_version 87363 (0.0006) [2023-12-27 19:51:27,915][106226] Updated weights for policy 0, policy_version 87373 (0.0008) [2023-12-27 19:51:27,964][106225] Updated weights for policy 1, policy_version 87379 (0.0009) [2023-12-27 19:51:27,965][106226] Updated weights for policy 0, policy_version 87383 (0.0010) [2023-12-27 19:51:28,016][106225] Updated weights for policy 1, policy_version 87389 (0.0006) [2023-12-27 19:51:28,027][106226] Updated weights for policy 0, policy_version 87393 (0.0010) [2023-12-27 19:51:28,070][106225] Updated weights for policy 1, policy_version 87399 (0.0006) [2023-12-27 19:51:28,671][106226] Updated weights for policy 0, policy_version 87403 (0.0010) [2023-12-27 19:51:28,724][106226] Updated weights for policy 0, policy_version 87413 (0.0010) [2023-12-27 19:51:28,760][106225] Updated weights for policy 1, policy_version 87409 (0.0006) [2023-12-27 19:51:28,774][106226] Updated weights for policy 0, policy_version 87423 (0.0010) [2023-12-27 19:51:28,811][106225] Updated weights for policy 1, policy_version 87419 (0.0006) [2023-12-27 19:51:28,872][106225] Updated weights for policy 1, policy_version 87429 (0.0008) [2023-12-27 19:51:28,929][106225] Updated weights for policy 1, policy_version 87439 (0.0008) [2023-12-27 19:51:29,480][106226] Updated weights for policy 0, policy_version 87433 (0.0010) [2023-12-27 19:51:29,540][106226] Updated weights for policy 0, policy_version 87443 (0.0007) [2023-12-27 19:51:29,600][106226] Updated weights for policy 0, policy_version 87453 (0.0008) [2023-12-27 19:51:29,663][106226] Updated weights for policy 0, policy_version 87463 (0.0007) [2023-12-27 19:51:29,674][106225] Updated weights for policy 1, policy_version 87449 (0.0006) [2023-12-27 19:51:29,735][106225] Updated weights for policy 1, policy_version 87459 (0.0009) [2023-12-27 19:51:29,806][106225] Updated weights for policy 1, policy_version 87469 (0.0009) [2023-12-27 19:51:30,323][106226] Updated weights for policy 0, policy_version 87473 (0.0005) [2023-12-27 19:51:30,381][106226] Updated weights for policy 0, policy_version 87483 (0.0005) [2023-12-27 19:51:30,445][106226] Updated weights for policy 0, policy_version 87493 (0.0005) [2023-12-27 19:51:30,568][106225] Updated weights for policy 1, policy_version 87479 (0.0006) [2023-12-27 19:51:30,627][106225] Updated weights for policy 1, policy_version 87489 (0.0005) [2023-12-27 19:51:30,691][106225] Updated weights for policy 1, policy_version 87499 (0.0007) [2023-12-27 19:51:30,980][106226] Updated weights for policy 0, policy_version 87503 (0.0005) [2023-12-27 19:51:31,052][106226] Updated weights for policy 0, policy_version 87513 (0.0006) [2023-12-27 19:51:31,117][106226] Updated weights for policy 0, policy_version 87523 (0.0007) [2023-12-27 19:51:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 44818432. Throughput: 0: 9778.2, 1: 9950.1. Samples: 44804072. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:31,175][105115] Avg episode reward: [(0, '-4.873'), (1, '-6.439')] [2023-12-27 19:51:31,298][106225] Updated weights for policy 1, policy_version 87509 (0.0006) [2023-12-27 19:51:31,367][106225] Updated weights for policy 1, policy_version 87519 (0.0007) [2023-12-27 19:51:31,428][106225] Updated weights for policy 1, policy_version 87529 (0.0009) [2023-12-27 19:51:31,806][106226] Updated weights for policy 0, policy_version 87533 (0.0008) [2023-12-27 19:51:31,872][106226] Updated weights for policy 0, policy_version 87543 (0.0008) [2023-12-27 19:51:31,933][106226] Updated weights for policy 0, policy_version 87553 (0.0009) [2023-12-27 19:51:32,060][106225] Updated weights for policy 1, policy_version 87539 (0.0007) [2023-12-27 19:51:32,124][106225] Updated weights for policy 1, policy_version 87549 (0.0010) [2023-12-27 19:51:32,185][106225] Updated weights for policy 1, policy_version 87559 (0.0010) [2023-12-27 19:51:32,642][106226] Updated weights for policy 0, policy_version 87563 (0.0008) [2023-12-27 19:51:32,695][106226] Updated weights for policy 0, policy_version 87573 (0.0007) [2023-12-27 19:51:32,743][106226] Updated weights for policy 0, policy_version 87583 (0.0005) [2023-12-27 19:51:32,872][106225] Updated weights for policy 1, policy_version 87569 (0.0008) [2023-12-27 19:51:32,936][106225] Updated weights for policy 1, policy_version 87579 (0.0010) [2023-12-27 19:51:32,993][106225] Updated weights for policy 1, policy_version 87589 (0.0010) [2023-12-27 19:51:33,049][106225] Updated weights for policy 1, policy_version 87599 (0.0010) [2023-12-27 19:51:33,370][106226] Updated weights for policy 0, policy_version 87593 (0.0006) [2023-12-27 19:51:33,430][106226] Updated weights for policy 0, policy_version 87603 (0.0009) [2023-12-27 19:51:33,491][106226] Updated weights for policy 0, policy_version 87613 (0.0010) [2023-12-27 19:51:33,537][106226] Updated weights for policy 0, policy_version 87623 (0.0010) [2023-12-27 19:51:33,685][106225] Updated weights for policy 1, policy_version 87609 (0.0006) [2023-12-27 19:51:33,737][106225] Updated weights for policy 1, policy_version 87619 (0.0005) [2023-12-27 19:51:33,791][106225] Updated weights for policy 1, policy_version 87629 (0.0005) [2023-12-27 19:51:34,212][106226] Updated weights for policy 0, policy_version 87633 (0.0008) [2023-12-27 19:51:34,272][106226] Updated weights for policy 0, policy_version 87643 (0.0009) [2023-12-27 19:51:34,329][106226] Updated weights for policy 0, policy_version 87653 (0.0010) [2023-12-27 19:51:34,464][106225] Updated weights for policy 1, policy_version 87639 (0.0007) [2023-12-27 19:51:34,531][106225] Updated weights for policy 1, policy_version 87649 (0.0008) [2023-12-27 19:51:34,600][106225] Updated weights for policy 1, policy_version 87659 (0.0007) [2023-12-27 19:51:35,087][106226] Updated weights for policy 0, policy_version 87663 (0.0008) [2023-12-27 19:51:35,145][106226] Updated weights for policy 0, policy_version 87673 (0.0009) [2023-12-27 19:51:35,210][106226] Updated weights for policy 0, policy_version 87683 (0.0010) [2023-12-27 19:51:35,283][106225] Updated weights for policy 1, policy_version 87669 (0.0007) [2023-12-27 19:51:35,342][106225] Updated weights for policy 1, policy_version 87679 (0.0010) [2023-12-27 19:51:35,401][106225] Updated weights for policy 1, policy_version 87689 (0.0010) [2023-12-27 19:51:35,850][106226] Updated weights for policy 0, policy_version 87693 (0.0010) [2023-12-27 19:51:35,901][106226] Updated weights for policy 0, policy_version 87703 (0.0010) [2023-12-27 19:51:35,961][106226] Updated weights for policy 0, policy_version 87713 (0.0010) [2023-12-27 19:51:36,074][106225] Updated weights for policy 1, policy_version 87699 (0.0009) [2023-12-27 19:51:36,143][106225] Updated weights for policy 1, policy_version 87709 (0.0008) [2023-12-27 19:51:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 44916736. Throughput: 0: 9911.7, 1: 9916.8. Samples: 44928232. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:36,176][105115] Avg episode reward: [(0, '-5.132'), (1, '-6.759')] [2023-12-27 19:51:36,202][106225] Updated weights for policy 1, policy_version 87719 (0.0008) [2023-12-27 19:51:36,649][106226] Updated weights for policy 0, policy_version 87723 (0.0008) [2023-12-27 19:51:36,710][106226] Updated weights for policy 0, policy_version 87733 (0.0011) [2023-12-27 19:51:36,766][106226] Updated weights for policy 0, policy_version 87743 (0.0010) [2023-12-27 19:51:36,957][106225] Updated weights for policy 1, policy_version 87729 (0.0008) [2023-12-27 19:51:37,011][106225] Updated weights for policy 1, policy_version 87739 (0.0008) [2023-12-27 19:51:37,071][106225] Updated weights for policy 1, policy_version 87749 (0.0008) [2023-12-27 19:51:37,129][106225] Updated weights for policy 1, policy_version 87759 (0.0008) [2023-12-27 19:51:37,472][106226] Updated weights for policy 0, policy_version 87753 (0.0010) [2023-12-27 19:51:37,524][106226] Updated weights for policy 0, policy_version 87763 (0.0005) [2023-12-27 19:51:37,575][106226] Updated weights for policy 0, policy_version 87773 (0.0005) [2023-12-27 19:51:37,640][106226] Updated weights for policy 0, policy_version 87783 (0.0010) [2023-12-27 19:51:37,777][106225] Updated weights for policy 1, policy_version 87769 (0.0008) [2023-12-27 19:51:37,830][106225] Updated weights for policy 1, policy_version 87779 (0.0005) [2023-12-27 19:51:37,889][106225] Updated weights for policy 1, policy_version 87789 (0.0006) [2023-12-27 19:51:38,358][106226] Updated weights for policy 0, policy_version 87793 (0.0010) [2023-12-27 19:51:38,422][106226] Updated weights for policy 0, policy_version 87803 (0.0009) [2023-12-27 19:51:38,482][106226] Updated weights for policy 0, policy_version 87813 (0.0010) [2023-12-27 19:51:38,564][106225] Updated weights for policy 1, policy_version 87799 (0.0008) [2023-12-27 19:51:38,617][106225] Updated weights for policy 1, policy_version 87809 (0.0008) [2023-12-27 19:51:38,675][106225] Updated weights for policy 1, policy_version 87819 (0.0005) [2023-12-27 19:51:39,207][106226] Updated weights for policy 0, policy_version 87823 (0.0008) [2023-12-27 19:51:39,274][106226] Updated weights for policy 0, policy_version 87833 (0.0008) [2023-12-27 19:51:39,341][106226] Updated weights for policy 0, policy_version 87843 (0.0009) [2023-12-27 19:51:39,403][106225] Updated weights for policy 1, policy_version 87829 (0.0007) [2023-12-27 19:51:39,466][106225] Updated weights for policy 1, policy_version 87839 (0.0009) [2023-12-27 19:51:39,529][106225] Updated weights for policy 1, policy_version 87849 (0.0009) [2023-12-27 19:51:40,132][106226] Updated weights for policy 0, policy_version 87853 (0.0009) [2023-12-27 19:51:40,190][106226] Updated weights for policy 0, policy_version 87863 (0.0008) [2023-12-27 19:51:40,253][106226] Updated weights for policy 0, policy_version 87873 (0.0008) [2023-12-27 19:51:40,288][106225] Updated weights for policy 1, policy_version 87859 (0.0008) [2023-12-27 19:51:40,343][106225] Updated weights for policy 1, policy_version 87869 (0.0008) [2023-12-27 19:51:40,399][106225] Updated weights for policy 1, policy_version 87879 (0.0008) [2023-12-27 19:51:40,979][106226] Updated weights for policy 0, policy_version 87883 (0.0008) [2023-12-27 19:51:41,054][106226] Updated weights for policy 0, policy_version 87893 (0.0009) [2023-12-27 19:51:41,118][106226] Updated weights for policy 0, policy_version 87903 (0.0008) [2023-12-27 19:51:41,163][106225] Updated weights for policy 1, policy_version 87889 (0.0009) [2023-12-27 19:51:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 45006848. Throughput: 0: 9944.5, 1: 9880.0. Samples: 44987400. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:41,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-6.576')] [2023-12-27 19:51:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000087912_22511616.pth... [2023-12-27 19:51:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000086760_22216704.pth [2023-12-27 19:51:41,224][106225] Updated weights for policy 1, policy_version 87899 (0.0008) [2023-12-27 19:51:41,296][106225] Updated weights for policy 1, policy_version 87909 (0.0007) [2023-12-27 19:51:41,361][106225] Updated weights for policy 1, policy_version 87919 (0.0008) [2023-12-27 19:51:41,363][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000087920_22511616.pth... [2023-12-27 19:51:41,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000086736_22208512.pth [2023-12-27 19:51:41,898][106226] Updated weights for policy 0, policy_version 87913 (0.0009) [2023-12-27 19:51:41,957][106226] Updated weights for policy 0, policy_version 87923 (0.0010) [2023-12-27 19:51:42,018][106226] Updated weights for policy 0, policy_version 87933 (0.0011) [2023-12-27 19:51:42,080][106226] Updated weights for policy 0, policy_version 87943 (0.0010) [2023-12-27 19:51:42,139][106225] Updated weights for policy 1, policy_version 87929 (0.0008) [2023-12-27 19:51:42,204][106225] Updated weights for policy 1, policy_version 87939 (0.0008) [2023-12-27 19:51:42,272][106225] Updated weights for policy 1, policy_version 87949 (0.0008) [2023-12-27 19:51:42,809][106226] Updated weights for policy 0, policy_version 87953 (0.0006) [2023-12-27 19:51:42,859][106226] Updated weights for policy 0, policy_version 87963 (0.0006) [2023-12-27 19:51:42,915][106226] Updated weights for policy 0, policy_version 87973 (0.0008) [2023-12-27 19:51:43,024][106225] Updated weights for policy 1, policy_version 87959 (0.0008) [2023-12-27 19:51:43,077][106225] Updated weights for policy 1, policy_version 87969 (0.0008) [2023-12-27 19:51:43,139][106225] Updated weights for policy 1, policy_version 87979 (0.0008) [2023-12-27 19:51:43,569][106226] Updated weights for policy 0, policy_version 87983 (0.0009) [2023-12-27 19:51:43,631][106226] Updated weights for policy 0, policy_version 87993 (0.0009) [2023-12-27 19:51:43,693][106226] Updated weights for policy 0, policy_version 88003 (0.0008) [2023-12-27 19:51:43,887][106225] Updated weights for policy 1, policy_version 87989 (0.0008) [2023-12-27 19:51:43,953][106225] Updated weights for policy 1, policy_version 87999 (0.0010) [2023-12-27 19:51:44,022][106225] Updated weights for policy 1, policy_version 88009 (0.0008) [2023-12-27 19:51:44,360][106226] Updated weights for policy 0, policy_version 88013 (0.0009) [2023-12-27 19:51:44,419][106226] Updated weights for policy 0, policy_version 88023 (0.0008) [2023-12-27 19:51:44,471][106226] Updated weights for policy 0, policy_version 88033 (0.0009) [2023-12-27 19:51:44,800][106225] Updated weights for policy 1, policy_version 88019 (0.0009) [2023-12-27 19:51:44,857][106225] Updated weights for policy 1, policy_version 88029 (0.0008) [2023-12-27 19:51:44,920][106225] Updated weights for policy 1, policy_version 88039 (0.0009) [2023-12-27 19:51:45,126][106226] Updated weights for policy 0, policy_version 88043 (0.0007) [2023-12-27 19:51:45,189][106226] Updated weights for policy 0, policy_version 88053 (0.0006) [2023-12-27 19:51:45,250][106226] Updated weights for policy 0, policy_version 88063 (0.0009) [2023-12-27 19:51:45,694][106225] Updated weights for policy 1, policy_version 88049 (0.0009) [2023-12-27 19:51:45,747][106225] Updated weights for policy 1, policy_version 88059 (0.0008) [2023-12-27 19:51:45,806][106225] Updated weights for policy 1, policy_version 88069 (0.0008) [2023-12-27 19:51:45,857][106225] Updated weights for policy 1, policy_version 88079 (0.0008) [2023-12-27 19:51:45,908][106226] Updated weights for policy 0, policy_version 88073 (0.0009) [2023-12-27 19:51:45,970][106226] Updated weights for policy 0, policy_version 88083 (0.0010) [2023-12-27 19:51:46,029][106226] Updated weights for policy 0, policy_version 88093 (0.0011) [2023-12-27 19:51:46,086][106226] Updated weights for policy 0, policy_version 88103 (0.0010) [2023-12-27 19:51:46,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 45113344. Throughput: 0: 9974.3, 1: 9780.5. Samples: 45099692. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:46,175][105115] Avg episode reward: [(0, '-5.052'), (1, '-6.766')] [2023-12-27 19:51:46,648][106226] Updated weights for policy 0, policy_version 88113 (0.0006) [2023-12-27 19:51:46,675][106225] Updated weights for policy 1, policy_version 88089 (0.0008) [2023-12-27 19:51:46,695][106226] Updated weights for policy 0, policy_version 88123 (0.0005) [2023-12-27 19:51:46,725][106225] Updated weights for policy 1, policy_version 88099 (0.0008) [2023-12-27 19:51:46,742][106226] Updated weights for policy 0, policy_version 88133 (0.0006) [2023-12-27 19:51:46,784][106225] Updated weights for policy 1, policy_version 88109 (0.0007) [2023-12-27 19:51:47,341][106226] Updated weights for policy 0, policy_version 88143 (0.0009) [2023-12-27 19:51:47,407][106226] Updated weights for policy 0, policy_version 88153 (0.0011) [2023-12-27 19:51:47,471][106226] Updated weights for policy 0, policy_version 88163 (0.0011) [2023-12-27 19:51:47,587][106225] Updated weights for policy 1, policy_version 88119 (0.0006) [2023-12-27 19:51:47,640][106225] Updated weights for policy 1, policy_version 88129 (0.0005) [2023-12-27 19:51:47,691][106225] Updated weights for policy 1, policy_version 88139 (0.0008) [2023-12-27 19:51:48,081][106226] Updated weights for policy 0, policy_version 88173 (0.0009) [2023-12-27 19:51:48,134][106226] Updated weights for policy 0, policy_version 88183 (0.0009) [2023-12-27 19:51:48,198][106226] Updated weights for policy 0, policy_version 88193 (0.0007) [2023-12-27 19:51:48,416][106225] Updated weights for policy 1, policy_version 88149 (0.0008) [2023-12-27 19:51:48,469][106225] Updated weights for policy 1, policy_version 88159 (0.0008) [2023-12-27 19:51:48,517][106225] Updated weights for policy 1, policy_version 88169 (0.0007) [2023-12-27 19:51:48,828][106226] Updated weights for policy 0, policy_version 88203 (0.0008) [2023-12-27 19:51:48,880][106226] Updated weights for policy 0, policy_version 88213 (0.0007) [2023-12-27 19:51:48,933][106226] Updated weights for policy 0, policy_version 88223 (0.0005) [2023-12-27 19:51:49,359][106225] Updated weights for policy 1, policy_version 88179 (0.0009) [2023-12-27 19:51:49,419][106225] Updated weights for policy 1, policy_version 88189 (0.0008) [2023-12-27 19:51:49,472][106225] Updated weights for policy 1, policy_version 88199 (0.0008) [2023-12-27 19:51:49,602][106226] Updated weights for policy 0, policy_version 88233 (0.0006) [2023-12-27 19:51:49,659][106226] Updated weights for policy 0, policy_version 88243 (0.0009) [2023-12-27 19:51:49,719][106226] Updated weights for policy 0, policy_version 88253 (0.0009) [2023-12-27 19:51:49,772][106226] Updated weights for policy 0, policy_version 88263 (0.0008) [2023-12-27 19:51:50,223][106225] Updated weights for policy 1, policy_version 88209 (0.0009) [2023-12-27 19:51:50,294][106225] Updated weights for policy 1, policy_version 88219 (0.0010) [2023-12-27 19:51:50,365][106225] Updated weights for policy 1, policy_version 88229 (0.0009) [2023-12-27 19:51:50,425][106225] Updated weights for policy 1, policy_version 88239 (0.0006) [2023-12-27 19:51:50,474][106226] Updated weights for policy 0, policy_version 88273 (0.0009) [2023-12-27 19:51:50,532][106226] Updated weights for policy 0, policy_version 88283 (0.0008) [2023-12-27 19:51:50,587][106226] Updated weights for policy 0, policy_version 88293 (0.0007) [2023-12-27 19:51:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.5). Total num frames: 45203456. Throughput: 0: 10023.7, 1: 9695.3. Samples: 45217744. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:51,175][105115] Avg episode reward: [(0, '-5.224'), (1, '-6.545')] [2023-12-27 19:51:51,207][106225] Updated weights for policy 1, policy_version 88249 (0.0009) [2023-12-27 19:51:51,264][106226] Updated weights for policy 0, policy_version 88303 (0.0007) [2023-12-27 19:51:51,270][106225] Updated weights for policy 1, policy_version 88259 (0.0008) [2023-12-27 19:51:51,329][106226] Updated weights for policy 0, policy_version 88313 (0.0009) [2023-12-27 19:51:51,336][106225] Updated weights for policy 1, policy_version 88269 (0.0006) [2023-12-27 19:51:51,398][106226] Updated weights for policy 0, policy_version 88323 (0.0009) [2023-12-27 19:51:52,051][106225] Updated weights for policy 1, policy_version 88279 (0.0008) [2023-12-27 19:51:52,118][106225] Updated weights for policy 1, policy_version 88289 (0.0009) [2023-12-27 19:51:52,164][106226] Updated weights for policy 0, policy_version 88333 (0.0007) [2023-12-27 19:51:52,174][106225] Updated weights for policy 1, policy_version 88299 (0.0007) [2023-12-27 19:51:52,221][106226] Updated weights for policy 0, policy_version 88343 (0.0006) [2023-12-27 19:51:52,292][106226] Updated weights for policy 0, policy_version 88353 (0.0006) [2023-12-27 19:51:52,922][106225] Updated weights for policy 1, policy_version 88309 (0.0007) [2023-12-27 19:51:52,928][106226] Updated weights for policy 0, policy_version 88363 (0.0006) [2023-12-27 19:51:52,976][106225] Updated weights for policy 1, policy_version 88319 (0.0006) [2023-12-27 19:51:52,986][106226] Updated weights for policy 0, policy_version 88373 (0.0007) [2023-12-27 19:51:53,032][106225] Updated weights for policy 1, policy_version 88329 (0.0008) [2023-12-27 19:51:53,041][106226] Updated weights for policy 0, policy_version 88383 (0.0007) [2023-12-27 19:51:53,760][106226] Updated weights for policy 0, policy_version 88393 (0.0007) [2023-12-27 19:51:53,766][106225] Updated weights for policy 1, policy_version 88339 (0.0007) [2023-12-27 19:51:53,814][106225] Updated weights for policy 1, policy_version 88349 (0.0007) [2023-12-27 19:51:53,823][106226] Updated weights for policy 0, policy_version 88403 (0.0009) [2023-12-27 19:51:53,865][106225] Updated weights for policy 1, policy_version 88359 (0.0007) [2023-12-27 19:51:53,886][106226] Updated weights for policy 0, policy_version 88413 (0.0008) [2023-12-27 19:51:53,939][106226] Updated weights for policy 0, policy_version 88423 (0.0008) [2023-12-27 19:51:54,623][106226] Updated weights for policy 0, policy_version 88433 (0.0008) [2023-12-27 19:51:54,625][106225] Updated weights for policy 1, policy_version 88369 (0.0005) [2023-12-27 19:51:54,678][106226] Updated weights for policy 0, policy_version 88443 (0.0008) [2023-12-27 19:51:54,682][106225] Updated weights for policy 1, policy_version 88379 (0.0007) [2023-12-27 19:51:54,738][106226] Updated weights for policy 0, policy_version 88453 (0.0009) [2023-12-27 19:51:54,741][106225] Updated weights for policy 1, policy_version 88389 (0.0007) [2023-12-27 19:51:54,809][106225] Updated weights for policy 1, policy_version 88399 (0.0007) [2023-12-27 19:51:55,381][106226] Updated weights for policy 0, policy_version 88463 (0.0009) [2023-12-27 19:51:55,440][106226] Updated weights for policy 0, policy_version 88473 (0.0009) [2023-12-27 19:51:55,497][106226] Updated weights for policy 0, policy_version 88483 (0.0008) [2023-12-27 19:51:55,535][106225] Updated weights for policy 1, policy_version 88409 (0.0008) [2023-12-27 19:51:55,580][106225] Updated weights for policy 1, policy_version 88419 (0.0008) [2023-12-27 19:51:55,631][106225] Updated weights for policy 1, policy_version 88429 (0.0008) [2023-12-27 19:51:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 45301760. Throughput: 0: 9963.2, 1: 9656.8. Samples: 45274600. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:51:56,176][105115] Avg episode reward: [(0, '-4.961'), (1, '-6.580')] [2023-12-27 19:51:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000088432_22642688.pth... [2023-12-27 19:51:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000088488_22659072.pth... [2023-12-27 19:51:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000087312_22355968.pth [2023-12-27 19:51:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000087304_22355968.pth [2023-12-27 19:51:56,238][106226] Updated weights for policy 0, policy_version 88493 (0.0009) [2023-12-27 19:51:56,286][106226] Updated weights for policy 0, policy_version 88503 (0.0008) [2023-12-27 19:51:56,336][106226] Updated weights for policy 0, policy_version 88513 (0.0008) [2023-12-27 19:51:56,377][106225] Updated weights for policy 1, policy_version 88439 (0.0007) [2023-12-27 19:51:56,445][106225] Updated weights for policy 1, policy_version 88449 (0.0009) [2023-12-27 19:51:56,494][106225] Updated weights for policy 1, policy_version 88459 (0.0008) [2023-12-27 19:51:57,042][106226] Updated weights for policy 0, policy_version 88523 (0.0008) [2023-12-27 19:51:57,102][106226] Updated weights for policy 0, policy_version 88533 (0.0009) [2023-12-27 19:51:57,157][106226] Updated weights for policy 0, policy_version 88543 (0.0009) [2023-12-27 19:51:57,243][106225] Updated weights for policy 1, policy_version 88469 (0.0007) [2023-12-27 19:51:57,306][106225] Updated weights for policy 1, policy_version 88479 (0.0006) [2023-12-27 19:51:57,364][106225] Updated weights for policy 1, policy_version 88489 (0.0008) [2023-12-27 19:51:57,903][106226] Updated weights for policy 0, policy_version 88553 (0.0008) [2023-12-27 19:51:57,949][106226] Updated weights for policy 0, policy_version 88563 (0.0008) [2023-12-27 19:51:57,993][106226] Updated weights for policy 0, policy_version 88573 (0.0008) [2023-12-27 19:51:58,036][106225] Updated weights for policy 1, policy_version 88499 (0.0009) [2023-12-27 19:51:58,042][106226] Updated weights for policy 0, policy_version 88583 (0.0007) [2023-12-27 19:51:58,091][106225] Updated weights for policy 1, policy_version 88509 (0.0007) [2023-12-27 19:51:58,148][106225] Updated weights for policy 1, policy_version 88519 (0.0009) [2023-12-27 19:51:58,825][106226] Updated weights for policy 0, policy_version 88593 (0.0008) [2023-12-27 19:51:58,900][106226] Updated weights for policy 0, policy_version 88603 (0.0010) [2023-12-27 19:51:58,959][106226] Updated weights for policy 0, policy_version 88613 (0.0009) [2023-12-27 19:51:59,025][106225] Updated weights for policy 1, policy_version 88529 (0.0008) [2023-12-27 19:51:59,089][106225] Updated weights for policy 1, policy_version 88539 (0.0008) [2023-12-27 19:51:59,152][106225] Updated weights for policy 1, policy_version 88549 (0.0008) [2023-12-27 19:51:59,223][106225] Updated weights for policy 1, policy_version 88559 (0.0008) [2023-12-27 19:51:59,707][106226] Updated weights for policy 0, policy_version 88623 (0.0009) [2023-12-27 19:51:59,756][106226] Updated weights for policy 0, policy_version 88633 (0.0009) [2023-12-27 19:51:59,823][106226] Updated weights for policy 0, policy_version 88643 (0.0009) [2023-12-27 19:51:59,984][106225] Updated weights for policy 1, policy_version 88569 (0.0008) [2023-12-27 19:52:00,034][106225] Updated weights for policy 1, policy_version 88579 (0.0010) [2023-12-27 19:52:00,084][106225] Updated weights for policy 1, policy_version 88589 (0.0007) [2023-12-27 19:52:00,518][106226] Updated weights for policy 0, policy_version 88653 (0.0008) [2023-12-27 19:52:00,564][106226] Updated weights for policy 0, policy_version 88663 (0.0007) [2023-12-27 19:52:00,609][106226] Updated weights for policy 0, policy_version 88673 (0.0009) [2023-12-27 19:52:00,811][106225] Updated weights for policy 1, policy_version 88599 (0.0008) [2023-12-27 19:52:00,858][106225] Updated weights for policy 1, policy_version 88609 (0.0008) [2023-12-27 19:52:00,910][106225] Updated weights for policy 1, policy_version 88619 (0.0008) [2023-12-27 19:52:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 45400064. Throughput: 0: 9958.0, 1: 9590.6. Samples: 45388868. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:52:01,175][105115] Avg episode reward: [(0, '-5.565'), (1, '-6.399')] [2023-12-27 19:52:01,350][106226] Updated weights for policy 0, policy_version 88683 (0.0008) [2023-12-27 19:52:01,422][106226] Updated weights for policy 0, policy_version 88693 (0.0009) [2023-12-27 19:52:01,489][106226] Updated weights for policy 0, policy_version 88703 (0.0010) [2023-12-27 19:52:01,652][106225] Updated weights for policy 1, policy_version 88629 (0.0008) [2023-12-27 19:52:01,722][106225] Updated weights for policy 1, policy_version 88639 (0.0009) [2023-12-27 19:52:01,787][106225] Updated weights for policy 1, policy_version 88649 (0.0009) [2023-12-27 19:52:02,244][106226] Updated weights for policy 0, policy_version 88713 (0.0009) [2023-12-27 19:52:02,302][106226] Updated weights for policy 0, policy_version 88723 (0.0010) [2023-12-27 19:52:02,370][106226] Updated weights for policy 0, policy_version 88733 (0.0007) [2023-12-27 19:52:02,444][106226] Updated weights for policy 0, policy_version 88743 (0.0008) [2023-12-27 19:52:02,506][106225] Updated weights for policy 1, policy_version 88659 (0.0008) [2023-12-27 19:52:02,576][106225] Updated weights for policy 1, policy_version 88669 (0.0006) [2023-12-27 19:52:02,642][106225] Updated weights for policy 1, policy_version 88679 (0.0005) [2023-12-27 19:52:03,122][106226] Updated weights for policy 0, policy_version 88753 (0.0009) [2023-12-27 19:52:03,172][106226] Updated weights for policy 0, policy_version 88763 (0.0010) [2023-12-27 19:52:03,223][106226] Updated weights for policy 0, policy_version 88773 (0.0010) [2023-12-27 19:52:03,258][106225] Updated weights for policy 1, policy_version 88689 (0.0006) [2023-12-27 19:52:03,306][106225] Updated weights for policy 1, policy_version 88699 (0.0008) [2023-12-27 19:52:03,364][106225] Updated weights for policy 1, policy_version 88709 (0.0009) [2023-12-27 19:52:03,409][106225] Updated weights for policy 1, policy_version 88719 (0.0008) [2023-12-27 19:52:03,960][106226] Updated weights for policy 0, policy_version 88783 (0.0007) [2023-12-27 19:52:04,011][106226] Updated weights for policy 0, policy_version 88793 (0.0008) [2023-12-27 19:52:04,076][106226] Updated weights for policy 0, policy_version 88803 (0.0005) [2023-12-27 19:52:04,180][106225] Updated weights for policy 1, policy_version 88729 (0.0010) [2023-12-27 19:52:04,239][106225] Updated weights for policy 1, policy_version 88740 (0.0009) [2023-12-27 19:52:04,289][106225] Updated weights for policy 1, policy_version 88750 (0.0009) [2023-12-27 19:52:04,631][106226] Updated weights for policy 0, policy_version 88813 (0.0005) [2023-12-27 19:52:04,699][106226] Updated weights for policy 0, policy_version 88823 (0.0005) [2023-12-27 19:52:04,763][106226] Updated weights for policy 0, policy_version 88833 (0.0007) [2023-12-27 19:52:05,116][106225] Updated weights for policy 1, policy_version 88760 (0.0006) [2023-12-27 19:52:05,170][106225] Updated weights for policy 1, policy_version 88770 (0.0007) [2023-12-27 19:52:05,218][106225] Updated weights for policy 1, policy_version 88780 (0.0007) [2023-12-27 19:52:05,315][106226] Updated weights for policy 0, policy_version 88843 (0.0009) [2023-12-27 19:52:05,375][106226] Updated weights for policy 0, policy_version 88853 (0.0008) [2023-12-27 19:52:05,433][106226] Updated weights for policy 0, policy_version 88863 (0.0007) [2023-12-27 19:52:05,916][106225] Updated weights for policy 1, policy_version 88790 (0.0005) [2023-12-27 19:52:05,988][106225] Updated weights for policy 1, policy_version 88800 (0.0009) [2023-12-27 19:52:05,988][106226] Updated weights for policy 0, policy_version 88873 (0.0005) [2023-12-27 19:52:06,050][106226] Updated weights for policy 0, policy_version 88883 (0.0005) [2023-12-27 19:52:06,053][106225] Updated weights for policy 1, policy_version 88810 (0.0008) [2023-12-27 19:52:06,102][106226] Updated weights for policy 0, policy_version 88893 (0.0006) [2023-12-27 19:52:06,166][106226] Updated weights for policy 0, policy_version 88903 (0.0008) [2023-12-27 19:52:06,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 45506560. Throughput: 0: 10050.7, 1: 9549.4. Samples: 45508876. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:52:06,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-6.297')] [2023-12-27 19:52:06,794][106225] Updated weights for policy 1, policy_version 88820 (0.0007) [2023-12-27 19:52:06,850][106225] Updated weights for policy 1, policy_version 88830 (0.0008) [2023-12-27 19:52:06,887][106226] Updated weights for policy 0, policy_version 88913 (0.0007) [2023-12-27 19:52:06,905][106225] Updated weights for policy 1, policy_version 88840 (0.0006) [2023-12-27 19:52:06,938][106226] Updated weights for policy 0, policy_version 88923 (0.0006) [2023-12-27 19:52:06,996][106226] Updated weights for policy 0, policy_version 88933 (0.0008) [2023-12-27 19:52:07,628][106225] Updated weights for policy 1, policy_version 88850 (0.0006) [2023-12-27 19:52:07,684][106225] Updated weights for policy 1, policy_version 88860 (0.0008) [2023-12-27 19:52:07,735][106226] Updated weights for policy 0, policy_version 88943 (0.0006) [2023-12-27 19:52:07,741][106225] Updated weights for policy 1, policy_version 88870 (0.0008) [2023-12-27 19:52:07,787][106226] Updated weights for policy 0, policy_version 88953 (0.0006) [2023-12-27 19:52:07,789][106225] Updated weights for policy 1, policy_version 88880 (0.0006) [2023-12-27 19:52:07,845][106226] Updated weights for policy 0, policy_version 88963 (0.0008) [2023-12-27 19:52:08,541][106226] Updated weights for policy 0, policy_version 88973 (0.0010) [2023-12-27 19:52:08,548][106225] Updated weights for policy 1, policy_version 88890 (0.0008) [2023-12-27 19:52:08,596][106226] Updated weights for policy 0, policy_version 88983 (0.0008) [2023-12-27 19:52:08,606][106225] Updated weights for policy 1, policy_version 88900 (0.0008) [2023-12-27 19:52:08,652][106226] Updated weights for policy 0, policy_version 88993 (0.0006) [2023-12-27 19:52:08,667][106225] Updated weights for policy 1, policy_version 88910 (0.0008) [2023-12-27 19:52:09,324][106226] Updated weights for policy 0, policy_version 89003 (0.0006) [2023-12-27 19:52:09,354][106225] Updated weights for policy 1, policy_version 88920 (0.0007) [2023-12-27 19:52:09,395][106226] Updated weights for policy 0, policy_version 89013 (0.0009) [2023-12-27 19:52:09,430][106225] Updated weights for policy 1, policy_version 88930 (0.0008) [2023-12-27 19:52:09,465][106226] Updated weights for policy 0, policy_version 89023 (0.0008) [2023-12-27 19:52:09,492][106225] Updated weights for policy 1, policy_version 88940 (0.0009) [2023-12-27 19:52:10,232][106226] Updated weights for policy 0, policy_version 89033 (0.0008) [2023-12-27 19:52:10,250][106225] Updated weights for policy 1, policy_version 88950 (0.0007) [2023-12-27 19:52:10,299][106226] Updated weights for policy 0, policy_version 89043 (0.0009) [2023-12-27 19:52:10,317][106225] Updated weights for policy 1, policy_version 88960 (0.0006) [2023-12-27 19:52:10,363][106226] Updated weights for policy 0, policy_version 89053 (0.0009) [2023-12-27 19:52:10,380][106225] Updated weights for policy 1, policy_version 88970 (0.0010) [2023-12-27 19:52:10,420][106226] Updated weights for policy 0, policy_version 89063 (0.0008) [2023-12-27 19:52:11,083][106225] Updated weights for policy 1, policy_version 88980 (0.0009) [2023-12-27 19:52:11,154][106225] Updated weights for policy 1, policy_version 88990 (0.0009) [2023-12-27 19:52:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 45588480. Throughput: 0: 10101.6, 1: 9563.4. Samples: 45566960. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 19:52:11,176][105115] Avg episode reward: [(0, '-4.797'), (1, '-6.439')] [2023-12-27 19:52:11,206][106225] Updated weights for policy 1, policy_version 89000 (0.0008) [2023-12-27 19:52:11,218][106226] Updated weights for policy 0, policy_version 89073 (0.0006) [2023-12-27 19:52:11,255][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000089008_22790144.pth... [2023-12-27 19:52:11,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000087920_22511616.pth [2023-12-27 19:52:11,284][106226] Updated weights for policy 0, policy_version 89083 (0.0010) [2023-12-27 19:52:11,351][106226] Updated weights for policy 0, policy_version 89093 (0.0009) [2023-12-27 19:52:11,375][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000089096_22814720.pth... [2023-12-27 19:52:11,380][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000087912_22511616.pth [2023-12-27 19:52:12,045][106225] Updated weights for policy 1, policy_version 89010 (0.0008) [2023-12-27 19:52:12,084][106226] Updated weights for policy 0, policy_version 89103 (0.0006) [2023-12-27 19:52:12,100][106225] Updated weights for policy 1, policy_version 89020 (0.0009) [2023-12-27 19:52:12,139][106226] Updated weights for policy 0, policy_version 89113 (0.0007) [2023-12-27 19:52:12,147][106225] Updated weights for policy 1, policy_version 89030 (0.0007) [2023-12-27 19:52:12,196][106226] Updated weights for policy 0, policy_version 89123 (0.0006) [2023-12-27 19:52:12,202][106225] Updated weights for policy 1, policy_version 89040 (0.0006) [2023-12-27 19:52:12,933][106226] Updated weights for policy 0, policy_version 89133 (0.0007) [2023-12-27 19:52:12,971][106225] Updated weights for policy 1, policy_version 89050 (0.0008) [2023-12-27 19:52:12,989][106226] Updated weights for policy 0, policy_version 89143 (0.0007) [2023-12-27 19:52:13,022][106225] Updated weights for policy 1, policy_version 89060 (0.0006) [2023-12-27 19:52:13,043][106226] Updated weights for policy 0, policy_version 89153 (0.0007) [2023-12-27 19:52:13,076][106225] Updated weights for policy 1, policy_version 89070 (0.0008) [2023-12-27 19:52:13,688][106226] Updated weights for policy 0, policy_version 89163 (0.0005) [2023-12-27 19:52:13,753][106226] Updated weights for policy 0, policy_version 89173 (0.0007) [2023-12-27 19:52:13,803][106225] Updated weights for policy 1, policy_version 89080 (0.0007) [2023-12-27 19:52:13,812][106226] Updated weights for policy 0, policy_version 89183 (0.0009) [2023-12-27 19:52:13,869][106225] Updated weights for policy 1, policy_version 89090 (0.0006) [2023-12-27 19:52:13,928][106225] Updated weights for policy 1, policy_version 89100 (0.0005) [2023-12-27 19:52:14,468][106226] Updated weights for policy 0, policy_version 89193 (0.0007) [2023-12-27 19:52:14,526][106226] Updated weights for policy 0, policy_version 89203 (0.0005) [2023-12-27 19:52:14,567][106225] Updated weights for policy 1, policy_version 89110 (0.0007) [2023-12-27 19:52:14,577][106226] Updated weights for policy 0, policy_version 89213 (0.0006) [2023-12-27 19:52:14,624][106225] Updated weights for policy 1, policy_version 89120 (0.0008) [2023-12-27 19:52:14,638][106226] Updated weights for policy 0, policy_version 89223 (0.0007) [2023-12-27 19:52:14,684][106225] Updated weights for policy 1, policy_version 89130 (0.0006) [2023-12-27 19:52:15,377][106226] Updated weights for policy 0, policy_version 89233 (0.0009) [2023-12-27 19:52:15,429][106225] Updated weights for policy 1, policy_version 89140 (0.0006) [2023-12-27 19:52:15,435][106226] Updated weights for policy 0, policy_version 89243 (0.0007) [2023-12-27 19:52:15,486][106225] Updated weights for policy 1, policy_version 89150 (0.0007) [2023-12-27 19:52:15,492][106226] Updated weights for policy 0, policy_version 89253 (0.0006) [2023-12-27 19:52:15,545][106225] Updated weights for policy 1, policy_version 89160 (0.0007) [2023-12-27 19:52:16,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 45686784. Throughput: 0: 10013.8, 1: 9480.2. Samples: 45681300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:16,175][105115] Avg episode reward: [(0, '-5.144'), (1, '-6.897')] [2023-12-27 19:52:16,193][106225] Updated weights for policy 1, policy_version 89170 (0.0008) [2023-12-27 19:52:16,210][106226] Updated weights for policy 0, policy_version 89263 (0.0009) [2023-12-27 19:52:16,252][106225] Updated weights for policy 1, policy_version 89180 (0.0007) [2023-12-27 19:52:16,267][106226] Updated weights for policy 0, policy_version 89273 (0.0011) [2023-12-27 19:52:16,305][106225] Updated weights for policy 1, policy_version 89190 (0.0007) [2023-12-27 19:52:16,320][106226] Updated weights for policy 0, policy_version 89283 (0.0011) [2023-12-27 19:52:16,354][106225] Updated weights for policy 1, policy_version 89200 (0.0007) [2023-12-27 19:52:16,913][106225] Updated weights for policy 1, policy_version 89210 (0.0010) [2023-12-27 19:52:16,966][106225] Updated weights for policy 1, policy_version 89220 (0.0010) [2023-12-27 19:52:17,023][106225] Updated weights for policy 1, policy_version 89230 (0.0010) [2023-12-27 19:52:17,048][106226] Updated weights for policy 0, policy_version 89293 (0.0008) [2023-12-27 19:52:17,109][106226] Updated weights for policy 0, policy_version 89303 (0.0005) [2023-12-27 19:52:17,165][106226] Updated weights for policy 0, policy_version 89313 (0.0005) [2023-12-27 19:52:17,631][106225] Updated weights for policy 1, policy_version 89240 (0.0006) [2023-12-27 19:52:17,690][106225] Updated weights for policy 1, policy_version 89250 (0.0007) [2023-12-27 19:52:17,703][106226] Updated weights for policy 0, policy_version 89323 (0.0008) [2023-12-27 19:52:17,749][106225] Updated weights for policy 1, policy_version 89260 (0.0006) [2023-12-27 19:52:17,765][106226] Updated weights for policy 0, policy_version 89333 (0.0008) [2023-12-27 19:52:17,820][106226] Updated weights for policy 0, policy_version 89343 (0.0008) [2023-12-27 19:52:18,508][106225] Updated weights for policy 1, policy_version 89270 (0.0007) [2023-12-27 19:52:18,542][106226] Updated weights for policy 0, policy_version 89353 (0.0008) [2023-12-27 19:52:18,562][106225] Updated weights for policy 1, policy_version 89280 (0.0008) [2023-12-27 19:52:18,600][106226] Updated weights for policy 0, policy_version 89363 (0.0011) [2023-12-27 19:52:18,625][106225] Updated weights for policy 1, policy_version 89290 (0.0006) [2023-12-27 19:52:18,651][106226] Updated weights for policy 0, policy_version 89373 (0.0010) [2023-12-27 19:52:18,713][106226] Updated weights for policy 0, policy_version 89383 (0.0011) [2023-12-27 19:52:19,353][106226] Updated weights for policy 0, policy_version 89393 (0.0009) [2023-12-27 19:52:19,373][106225] Updated weights for policy 1, policy_version 89300 (0.0007) [2023-12-27 19:52:19,424][106226] Updated weights for policy 0, policy_version 89403 (0.0008) [2023-12-27 19:52:19,436][106225] Updated weights for policy 1, policy_version 89310 (0.0008) [2023-12-27 19:52:19,483][106226] Updated weights for policy 0, policy_version 89413 (0.0012) [2023-12-27 19:52:19,500][106225] Updated weights for policy 1, policy_version 89320 (0.0006) [2023-12-27 19:52:20,184][106226] Updated weights for policy 0, policy_version 89423 (0.0006) [2023-12-27 19:52:20,253][106226] Updated weights for policy 0, policy_version 89433 (0.0006) [2023-12-27 19:52:20,300][106225] Updated weights for policy 1, policy_version 89330 (0.0007) [2023-12-27 19:52:20,308][106226] Updated weights for policy 0, policy_version 89443 (0.0005) [2023-12-27 19:52:20,360][106225] Updated weights for policy 1, policy_version 89340 (0.0008) [2023-12-27 19:52:20,423][106225] Updated weights for policy 1, policy_version 89350 (0.0007) [2023-12-27 19:52:20,479][106225] Updated weights for policy 1, policy_version 89360 (0.0007) [2023-12-27 19:52:20,982][106226] Updated weights for policy 0, policy_version 89453 (0.0008) [2023-12-27 19:52:21,031][106226] Updated weights for policy 0, policy_version 89463 (0.0011) [2023-12-27 19:52:21,105][106226] Updated weights for policy 0, policy_version 89473 (0.0010) [2023-12-27 19:52:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 45793280. Throughput: 0: 9981.9, 1: 9439.2. Samples: 45802180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:21,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-6.455')] [2023-12-27 19:52:21,214][106225] Updated weights for policy 1, policy_version 89370 (0.0009) [2023-12-27 19:52:21,273][106225] Updated weights for policy 1, policy_version 89380 (0.0008) [2023-12-27 19:52:21,336][106225] Updated weights for policy 1, policy_version 89390 (0.0009) [2023-12-27 19:52:21,837][106226] Updated weights for policy 0, policy_version 89483 (0.0008) [2023-12-27 19:52:21,904][106226] Updated weights for policy 0, policy_version 89493 (0.0007) [2023-12-27 19:52:21,967][106226] Updated weights for policy 0, policy_version 89503 (0.0009) [2023-12-27 19:52:22,169][106225] Updated weights for policy 1, policy_version 89400 (0.0009) [2023-12-27 19:52:22,226][106225] Updated weights for policy 1, policy_version 89410 (0.0008) [2023-12-27 19:52:22,291][106225] Updated weights for policy 1, policy_version 89420 (0.0008) [2023-12-27 19:52:22,631][106226] Updated weights for policy 0, policy_version 89513 (0.0008) [2023-12-27 19:52:22,690][106226] Updated weights for policy 0, policy_version 89523 (0.0009) [2023-12-27 19:52:22,756][106226] Updated weights for policy 0, policy_version 89533 (0.0007) [2023-12-27 19:52:22,822][106226] Updated weights for policy 0, policy_version 89543 (0.0009) [2023-12-27 19:52:22,994][106225] Updated weights for policy 1, policy_version 89430 (0.0006) [2023-12-27 19:52:23,058][106225] Updated weights for policy 1, policy_version 89440 (0.0006) [2023-12-27 19:52:23,117][106225] Updated weights for policy 1, policy_version 89450 (0.0006) [2023-12-27 19:52:23,510][106226] Updated weights for policy 0, policy_version 89553 (0.0008) [2023-12-27 19:52:23,577][106226] Updated weights for policy 0, policy_version 89563 (0.0011) [2023-12-27 19:52:23,639][106226] Updated weights for policy 0, policy_version 89573 (0.0008) [2023-12-27 19:52:23,665][106225] Updated weights for policy 1, policy_version 89460 (0.0006) [2023-12-27 19:52:23,728][106225] Updated weights for policy 1, policy_version 89470 (0.0005) [2023-12-27 19:52:23,786][106225] Updated weights for policy 1, policy_version 89480 (0.0005) [2023-12-27 19:52:24,379][106226] Updated weights for policy 0, policy_version 89583 (0.0006) [2023-12-27 19:52:24,442][106225] Updated weights for policy 1, policy_version 89490 (0.0006) [2023-12-27 19:52:24,444][106226] Updated weights for policy 0, policy_version 89593 (0.0005) [2023-12-27 19:52:24,492][106225] Updated weights for policy 1, policy_version 89500 (0.0005) [2023-12-27 19:52:24,505][106226] Updated weights for policy 0, policy_version 89603 (0.0005) [2023-12-27 19:52:24,556][106225] Updated weights for policy 1, policy_version 89510 (0.0005) [2023-12-27 19:52:24,624][106225] Updated weights for policy 1, policy_version 89520 (0.0006) [2023-12-27 19:52:25,081][106226] Updated weights for policy 0, policy_version 89613 (0.0008) [2023-12-27 19:52:25,144][106226] Updated weights for policy 0, policy_version 89623 (0.0010) [2023-12-27 19:52:25,210][106226] Updated weights for policy 0, policy_version 89633 (0.0010) [2023-12-27 19:52:25,211][106225] Updated weights for policy 1, policy_version 89530 (0.0010) [2023-12-27 19:52:25,266][106225] Updated weights for policy 1, policy_version 89540 (0.0010) [2023-12-27 19:52:25,319][106225] Updated weights for policy 1, policy_version 89550 (0.0010) [2023-12-27 19:52:25,910][106226] Updated weights for policy 0, policy_version 89643 (0.0011) [2023-12-27 19:52:25,915][106225] Updated weights for policy 1, policy_version 89560 (0.0006) [2023-12-27 19:52:25,959][106226] Updated weights for policy 0, policy_version 89653 (0.0009) [2023-12-27 19:52:25,966][106225] Updated weights for policy 1, policy_version 89570 (0.0005) [2023-12-27 19:52:26,014][106225] Updated weights for policy 1, policy_version 89580 (0.0005) [2023-12-27 19:52:26,020][106226] Updated weights for policy 0, policy_version 89663 (0.0011) [2023-12-27 19:52:26,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 45899776. Throughput: 0: 9970.5, 1: 9435.5. Samples: 45860668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:26,175][105115] Avg episode reward: [(0, '-4.846'), (1, '-6.601')] [2023-12-27 19:52:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000089584_22937600.pth... [2023-12-27 19:52:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000089672_22962176.pth... [2023-12-27 19:52:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000088432_22642688.pth [2023-12-27 19:52:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000088488_22659072.pth [2023-12-27 19:52:26,587][106225] Updated weights for policy 1, policy_version 89590 (0.0008) [2023-12-27 19:52:26,639][106225] Updated weights for policy 1, policy_version 89600 (0.0008) [2023-12-27 19:52:26,694][106226] Updated weights for policy 0, policy_version 89673 (0.0011) [2023-12-27 19:52:26,704][106225] Updated weights for policy 1, policy_version 89610 (0.0006) [2023-12-27 19:52:26,753][106226] Updated weights for policy 0, policy_version 89683 (0.0008) [2023-12-27 19:52:26,805][106226] Updated weights for policy 0, policy_version 89693 (0.0008) [2023-12-27 19:52:26,865][106226] Updated weights for policy 0, policy_version 89703 (0.0008) [2023-12-27 19:52:27,406][106225] Updated weights for policy 1, policy_version 89620 (0.0009) [2023-12-27 19:52:27,462][106225] Updated weights for policy 1, policy_version 89630 (0.0009) [2023-12-27 19:52:27,519][106225] Updated weights for policy 1, policy_version 89640 (0.0007) [2023-12-27 19:52:27,562][106226] Updated weights for policy 0, policy_version 89713 (0.0007) [2023-12-27 19:52:27,607][106226] Updated weights for policy 0, policy_version 89723 (0.0008) [2023-12-27 19:52:27,651][106226] Updated weights for policy 0, policy_version 89733 (0.0008) [2023-12-27 19:52:28,244][106225] Updated weights for policy 1, policy_version 89650 (0.0007) [2023-12-27 19:52:28,304][106225] Updated weights for policy 1, policy_version 89660 (0.0009) [2023-12-27 19:52:28,376][106225] Updated weights for policy 1, policy_version 89670 (0.0007) [2023-12-27 19:52:28,396][106226] Updated weights for policy 0, policy_version 89743 (0.0008) [2023-12-27 19:52:28,433][106225] Updated weights for policy 1, policy_version 89680 (0.0006) [2023-12-27 19:52:28,456][106226] Updated weights for policy 0, policy_version 89753 (0.0007) [2023-12-27 19:52:28,523][106226] Updated weights for policy 0, policy_version 89763 (0.0008) [2023-12-27 19:52:29,090][106225] Updated weights for policy 1, policy_version 89690 (0.0010) [2023-12-27 19:52:29,154][106225] Updated weights for policy 1, policy_version 89700 (0.0009) [2023-12-27 19:52:29,216][106225] Updated weights for policy 1, policy_version 89710 (0.0010) [2023-12-27 19:52:29,253][106226] Updated weights for policy 0, policy_version 89773 (0.0011) [2023-12-27 19:52:29,309][106226] Updated weights for policy 0, policy_version 89783 (0.0009) [2023-12-27 19:52:29,379][106226] Updated weights for policy 0, policy_version 89793 (0.0011) [2023-12-27 19:52:29,833][106225] Updated weights for policy 1, policy_version 89720 (0.0007) [2023-12-27 19:52:29,888][106225] Updated weights for policy 1, policy_version 89730 (0.0008) [2023-12-27 19:52:29,946][106225] Updated weights for policy 1, policy_version 89740 (0.0008) [2023-12-27 19:52:30,117][106226] Updated weights for policy 0, policy_version 89803 (0.0009) [2023-12-27 19:52:30,184][106226] Updated weights for policy 0, policy_version 89813 (0.0006) [2023-12-27 19:52:30,240][106226] Updated weights for policy 0, policy_version 89823 (0.0009) [2023-12-27 19:52:30,706][106225] Updated weights for policy 1, policy_version 89750 (0.0008) [2023-12-27 19:52:30,753][106225] Updated weights for policy 1, policy_version 89760 (0.0008) [2023-12-27 19:52:30,814][106225] Updated weights for policy 1, policy_version 89770 (0.0008) [2023-12-27 19:52:30,822][106226] Updated weights for policy 0, policy_version 89833 (0.0008) [2023-12-27 19:52:30,878][106226] Updated weights for policy 0, policy_version 89843 (0.0005) [2023-12-27 19:52:30,938][106226] Updated weights for policy 0, policy_version 89853 (0.0008) [2023-12-27 19:52:30,995][106226] Updated weights for policy 0, policy_version 89863 (0.0007) [2023-12-27 19:52:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 45998080. Throughput: 0: 10019.7, 1: 9637.4. Samples: 45984256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:31,175][105115] Avg episode reward: [(0, '-5.082'), (1, '-6.572')] [2023-12-27 19:52:31,540][106225] Updated weights for policy 1, policy_version 89780 (0.0009) [2023-12-27 19:52:31,600][106225] Updated weights for policy 1, policy_version 89790 (0.0010) [2023-12-27 19:52:31,668][106225] Updated weights for policy 1, policy_version 89800 (0.0008) [2023-12-27 19:52:31,705][106226] Updated weights for policy 0, policy_version 89873 (0.0008) [2023-12-27 19:52:31,766][106226] Updated weights for policy 0, policy_version 89883 (0.0008) [2023-12-27 19:52:31,817][106226] Updated weights for policy 0, policy_version 89893 (0.0008) [2023-12-27 19:52:32,390][106225] Updated weights for policy 1, policy_version 89810 (0.0009) [2023-12-27 19:52:32,454][106225] Updated weights for policy 1, policy_version 89820 (0.0008) [2023-12-27 19:52:32,506][106225] Updated weights for policy 1, policy_version 89830 (0.0009) [2023-12-27 19:52:32,565][106225] Updated weights for policy 1, policy_version 89840 (0.0006) [2023-12-27 19:52:32,568][106226] Updated weights for policy 0, policy_version 89903 (0.0006) [2023-12-27 19:52:32,638][106226] Updated weights for policy 0, policy_version 89913 (0.0009) [2023-12-27 19:52:32,703][106226] Updated weights for policy 0, policy_version 89923 (0.0008) [2023-12-27 19:52:33,241][106226] Updated weights for policy 0, policy_version 89933 (0.0007) [2023-12-27 19:52:33,272][106225] Updated weights for policy 1, policy_version 89850 (0.0005) [2023-12-27 19:52:33,290][106226] Updated weights for policy 0, policy_version 89943 (0.0008) [2023-12-27 19:52:33,324][106225] Updated weights for policy 1, policy_version 89860 (0.0005) [2023-12-27 19:52:33,347][106226] Updated weights for policy 0, policy_version 89953 (0.0008) [2023-12-27 19:52:33,382][106225] Updated weights for policy 1, policy_version 89870 (0.0005) [2023-12-27 19:52:33,928][106225] Updated weights for policy 1, policy_version 89880 (0.0006) [2023-12-27 19:52:33,997][106225] Updated weights for policy 1, policy_version 89890 (0.0008) [2023-12-27 19:52:34,048][106226] Updated weights for policy 0, policy_version 89963 (0.0007) [2023-12-27 19:52:34,061][106225] Updated weights for policy 1, policy_version 89900 (0.0008) [2023-12-27 19:52:34,100][106226] Updated weights for policy 0, policy_version 89973 (0.0006) [2023-12-27 19:52:34,162][106226] Updated weights for policy 0, policy_version 89983 (0.0009) [2023-12-27 19:52:34,696][106225] Updated weights for policy 1, policy_version 89910 (0.0008) [2023-12-27 19:52:34,766][106225] Updated weights for policy 1, policy_version 89920 (0.0008) [2023-12-27 19:52:34,830][106225] Updated weights for policy 1, policy_version 89930 (0.0008) [2023-12-27 19:52:34,960][106226] Updated weights for policy 0, policy_version 89993 (0.0009) [2023-12-27 19:52:35,029][106226] Updated weights for policy 0, policy_version 90003 (0.0010) [2023-12-27 19:52:35,094][106226] Updated weights for policy 0, policy_version 90013 (0.0008) [2023-12-27 19:52:35,151][106226] Updated weights for policy 0, policy_version 90023 (0.0007) [2023-12-27 19:52:35,513][106225] Updated weights for policy 1, policy_version 89940 (0.0007) [2023-12-27 19:52:35,559][106225] Updated weights for policy 1, policy_version 89950 (0.0005) [2023-12-27 19:52:35,610][106225] Updated weights for policy 1, policy_version 89960 (0.0005) [2023-12-27 19:52:35,880][106226] Updated weights for policy 0, policy_version 90033 (0.0008) [2023-12-27 19:52:35,934][106226] Updated weights for policy 0, policy_version 90043 (0.0008) [2023-12-27 19:52:35,996][106226] Updated weights for policy 0, policy_version 90053 (0.0010) [2023-12-27 19:52:36,125][106225] Updated weights for policy 1, policy_version 89970 (0.0006) [2023-12-27 19:52:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 46096384. Throughput: 0: 9900.2, 1: 9801.9. Samples: 46104344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:36,175][105115] Avg episode reward: [(0, '-5.168'), (1, '-6.477')] [2023-12-27 19:52:36,189][106225] Updated weights for policy 1, policy_version 89980 (0.0007) [2023-12-27 19:52:36,237][106225] Updated weights for policy 1, policy_version 89990 (0.0008) [2023-12-27 19:52:36,297][106225] Updated weights for policy 1, policy_version 90000 (0.0008) [2023-12-27 19:52:36,841][106226] Updated weights for policy 0, policy_version 90063 (0.0009) [2023-12-27 19:52:36,895][106226] Updated weights for policy 0, policy_version 90073 (0.0007) [2023-12-27 19:52:36,941][106225] Updated weights for policy 1, policy_version 90010 (0.0009) [2023-12-27 19:52:36,950][106226] Updated weights for policy 0, policy_version 90083 (0.0009) [2023-12-27 19:52:37,000][106225] Updated weights for policy 1, policy_version 90020 (0.0006) [2023-12-27 19:52:37,061][106225] Updated weights for policy 1, policy_version 90030 (0.0008) [2023-12-27 19:52:37,704][106226] Updated weights for policy 0, policy_version 90093 (0.0011) [2023-12-27 19:52:37,757][106226] Updated weights for policy 0, policy_version 90103 (0.0010) [2023-12-27 19:52:37,764][106225] Updated weights for policy 1, policy_version 90040 (0.0006) [2023-12-27 19:52:37,807][106226] Updated weights for policy 0, policy_version 90113 (0.0010) [2023-12-27 19:52:37,816][106225] Updated weights for policy 1, policy_version 90050 (0.0005) [2023-12-27 19:52:37,868][106225] Updated weights for policy 1, policy_version 90060 (0.0006) [2023-12-27 19:52:38,521][106226] Updated weights for policy 0, policy_version 90123 (0.0010) [2023-12-27 19:52:38,572][106225] Updated weights for policy 1, policy_version 90070 (0.0008) [2023-12-27 19:52:38,585][106226] Updated weights for policy 0, policy_version 90133 (0.0006) [2023-12-27 19:52:38,624][106225] Updated weights for policy 1, policy_version 90080 (0.0009) [2023-12-27 19:52:38,642][106226] Updated weights for policy 0, policy_version 90143 (0.0006) [2023-12-27 19:52:38,673][106225] Updated weights for policy 1, policy_version 90090 (0.0009) [2023-12-27 19:52:39,358][106226] Updated weights for policy 0, policy_version 90153 (0.0007) [2023-12-27 19:52:39,432][106226] Updated weights for policy 0, policy_version 90163 (0.0010) [2023-12-27 19:52:39,464][106225] Updated weights for policy 1, policy_version 90100 (0.0008) [2023-12-27 19:52:39,485][106226] Updated weights for policy 0, policy_version 90173 (0.0008) [2023-12-27 19:52:39,523][106225] Updated weights for policy 1, policy_version 90110 (0.0008) [2023-12-27 19:52:39,551][106226] Updated weights for policy 0, policy_version 90183 (0.0008) [2023-12-27 19:52:39,579][106225] Updated weights for policy 1, policy_version 90120 (0.0008) [2023-12-27 19:52:40,295][106226] Updated weights for policy 0, policy_version 90193 (0.0007) [2023-12-27 19:52:40,327][106225] Updated weights for policy 1, policy_version 90130 (0.0007) [2023-12-27 19:52:40,354][106226] Updated weights for policy 0, policy_version 90203 (0.0008) [2023-12-27 19:52:40,384][106225] Updated weights for policy 1, policy_version 90140 (0.0007) [2023-12-27 19:52:40,414][106226] Updated weights for policy 0, policy_version 90213 (0.0007) [2023-12-27 19:52:40,443][106225] Updated weights for policy 1, policy_version 90150 (0.0007) [2023-12-27 19:52:40,503][106225] Updated weights for policy 1, policy_version 90160 (0.0008) [2023-12-27 19:52:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 46186496. Throughput: 0: 9886.4, 1: 9876.7. Samples: 46163932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:41,175][105115] Avg episode reward: [(0, '-5.198'), (1, '-6.213')] [2023-12-27 19:52:41,183][106226] Updated weights for policy 0, policy_version 90223 (0.0006) [2023-12-27 19:52:41,223][106225] Updated weights for policy 1, policy_version 90170 (0.0008) [2023-12-27 19:52:41,250][106226] Updated weights for policy 0, policy_version 90233 (0.0006) [2023-12-27 19:52:41,292][106225] Updated weights for policy 1, policy_version 90180 (0.0008) [2023-12-27 19:52:41,317][106226] Updated weights for policy 0, policy_version 90243 (0.0008) [2023-12-27 19:52:41,350][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000090248_23109632.pth... [2023-12-27 19:52:41,354][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000089096_22814720.pth [2023-12-27 19:52:41,356][106225] Updated weights for policy 1, policy_version 90190 (0.0009) [2023-12-27 19:52:41,371][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000090192_23093248.pth... [2023-12-27 19:52:41,376][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000089008_22790144.pth [2023-12-27 19:52:42,072][106226] Updated weights for policy 0, policy_version 90253 (0.0007) [2023-12-27 19:52:42,091][106225] Updated weights for policy 1, policy_version 90200 (0.0007) [2023-12-27 19:52:42,133][106226] Updated weights for policy 0, policy_version 90263 (0.0007) [2023-12-27 19:52:42,158][106225] Updated weights for policy 1, policy_version 90210 (0.0008) [2023-12-27 19:52:42,191][106226] Updated weights for policy 0, policy_version 90273 (0.0006) [2023-12-27 19:52:42,219][106225] Updated weights for policy 1, policy_version 90220 (0.0008) [2023-12-27 19:52:42,914][106226] Updated weights for policy 0, policy_version 90283 (0.0007) [2023-12-27 19:52:42,967][106225] Updated weights for policy 1, policy_version 90230 (0.0007) [2023-12-27 19:52:42,969][106226] Updated weights for policy 0, policy_version 90293 (0.0007) [2023-12-27 19:52:43,020][106226] Updated weights for policy 0, policy_version 90303 (0.0006) [2023-12-27 19:52:43,021][106225] Updated weights for policy 1, policy_version 90240 (0.0006) [2023-12-27 19:52:43,070][106225] Updated weights for policy 1, policy_version 90250 (0.0007) [2023-12-27 19:52:43,615][106226] Updated weights for policy 0, policy_version 90313 (0.0007) [2023-12-27 19:52:43,665][106226] Updated weights for policy 0, policy_version 90323 (0.0010) [2023-12-27 19:52:43,718][106226] Updated weights for policy 0, policy_version 90333 (0.0010) [2023-12-27 19:52:43,770][106226] Updated weights for policy 0, policy_version 90343 (0.0010) [2023-12-27 19:52:43,875][106225] Updated weights for policy 1, policy_version 90260 (0.0009) [2023-12-27 19:52:43,944][106225] Updated weights for policy 1, policy_version 90270 (0.0010) [2023-12-27 19:52:44,009][106225] Updated weights for policy 1, policy_version 90280 (0.0009) [2023-12-27 19:52:44,396][106226] Updated weights for policy 0, policy_version 90353 (0.0006) [2023-12-27 19:52:44,452][106226] Updated weights for policy 0, policy_version 90363 (0.0007) [2023-12-27 19:52:44,513][106226] Updated weights for policy 0, policy_version 90373 (0.0008) [2023-12-27 19:52:44,757][106225] Updated weights for policy 1, policy_version 90290 (0.0008) [2023-12-27 19:52:44,822][106225] Updated weights for policy 1, policy_version 90300 (0.0008) [2023-12-27 19:52:44,887][106225] Updated weights for policy 1, policy_version 90310 (0.0008) [2023-12-27 19:52:44,950][106225] Updated weights for policy 1, policy_version 90320 (0.0007) [2023-12-27 19:52:45,188][106226] Updated weights for policy 0, policy_version 90383 (0.0011) [2023-12-27 19:52:45,249][106226] Updated weights for policy 0, policy_version 90393 (0.0010) [2023-12-27 19:52:45,311][106226] Updated weights for policy 0, policy_version 90403 (0.0010) [2023-12-27 19:52:45,652][106225] Updated weights for policy 1, policy_version 90330 (0.0008) [2023-12-27 19:52:45,710][106225] Updated weights for policy 1, policy_version 90340 (0.0008) [2023-12-27 19:52:45,764][106225] Updated weights for policy 1, policy_version 90350 (0.0007) [2023-12-27 19:52:46,008][106226] Updated weights for policy 0, policy_version 90413 (0.0011) [2023-12-27 19:52:46,058][106226] Updated weights for policy 0, policy_version 90423 (0.0010) [2023-12-27 19:52:46,108][106226] Updated weights for policy 0, policy_version 90433 (0.0010) [2023-12-27 19:52:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 46292992. Throughput: 0: 9895.3, 1: 9879.8. Samples: 46278748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:46,175][105115] Avg episode reward: [(0, '-5.182'), (1, '-6.046')] [2023-12-27 19:52:46,492][106225] Updated weights for policy 1, policy_version 90360 (0.0009) [2023-12-27 19:52:46,545][106225] Updated weights for policy 1, policy_version 90370 (0.0007) [2023-12-27 19:52:46,600][106225] Updated weights for policy 1, policy_version 90380 (0.0007) [2023-12-27 19:52:46,774][106226] Updated weights for policy 0, policy_version 90443 (0.0009) [2023-12-27 19:52:46,829][106226] Updated weights for policy 0, policy_version 90453 (0.0006) [2023-12-27 19:52:46,894][106226] Updated weights for policy 0, policy_version 90463 (0.0008) [2023-12-27 19:52:47,390][106225] Updated weights for policy 1, policy_version 90390 (0.0008) [2023-12-27 19:52:47,438][106225] Updated weights for policy 1, policy_version 90400 (0.0008) [2023-12-27 19:52:47,488][106225] Updated weights for policy 1, policy_version 90410 (0.0008) [2023-12-27 19:52:47,488][106226] Updated weights for policy 0, policy_version 90473 (0.0008) [2023-12-27 19:52:47,537][106226] Updated weights for policy 0, policy_version 90483 (0.0005) [2023-12-27 19:52:47,580][106226] Updated weights for policy 0, policy_version 90493 (0.0005) [2023-12-27 19:52:47,630][106226] Updated weights for policy 0, policy_version 90503 (0.0005) [2023-12-27 19:52:48,253][106226] Updated weights for policy 0, policy_version 90513 (0.0007) [2023-12-27 19:52:48,284][106225] Updated weights for policy 1, policy_version 90420 (0.0007) [2023-12-27 19:52:48,314][106226] Updated weights for policy 0, policy_version 90523 (0.0006) [2023-12-27 19:52:48,351][106225] Updated weights for policy 1, policy_version 90430 (0.0008) [2023-12-27 19:52:48,384][106226] Updated weights for policy 0, policy_version 90533 (0.0008) [2023-12-27 19:52:48,417][106225] Updated weights for policy 1, policy_version 90440 (0.0008) [2023-12-27 19:52:49,070][106226] Updated weights for policy 0, policy_version 90543 (0.0007) [2023-12-27 19:52:49,124][106225] Updated weights for policy 1, policy_version 90450 (0.0008) [2023-12-27 19:52:49,126][106226] Updated weights for policy 0, policy_version 90553 (0.0005) [2023-12-27 19:52:49,174][106225] Updated weights for policy 1, policy_version 90460 (0.0007) [2023-12-27 19:52:49,182][106226] Updated weights for policy 0, policy_version 90563 (0.0006) [2023-12-27 19:52:49,229][106225] Updated weights for policy 1, policy_version 90470 (0.0008) [2023-12-27 19:52:49,290][106225] Updated weights for policy 1, policy_version 90480 (0.0008) [2023-12-27 19:52:49,980][106226] Updated weights for policy 0, policy_version 90573 (0.0007) [2023-12-27 19:52:50,043][106226] Updated weights for policy 0, policy_version 90583 (0.0008) [2023-12-27 19:52:50,101][106226] Updated weights for policy 0, policy_version 90593 (0.0006) [2023-12-27 19:52:50,103][106225] Updated weights for policy 1, policy_version 90490 (0.0007) [2023-12-27 19:52:50,156][106225] Updated weights for policy 1, policy_version 90500 (0.0005) [2023-12-27 19:52:50,215][106225] Updated weights for policy 1, policy_version 90510 (0.0009) [2023-12-27 19:52:50,800][106226] Updated weights for policy 0, policy_version 90603 (0.0008) [2023-12-27 19:52:50,863][106226] Updated weights for policy 0, policy_version 90613 (0.0008) [2023-12-27 19:52:50,924][106226] Updated weights for policy 0, policy_version 90623 (0.0007) [2023-12-27 19:52:50,940][106225] Updated weights for policy 1, policy_version 90520 (0.0009) [2023-12-27 19:52:51,004][106225] Updated weights for policy 1, policy_version 90530 (0.0010) [2023-12-27 19:52:51,069][106225] Updated weights for policy 1, policy_version 90540 (0.0008) [2023-12-27 19:52:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 46391296. Throughput: 0: 9858.9, 1: 9838.0. Samples: 46395240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:51,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-6.417')] [2023-12-27 19:52:51,660][106226] Updated weights for policy 0, policy_version 90633 (0.0009) [2023-12-27 19:52:51,730][106226] Updated weights for policy 0, policy_version 90643 (0.0009) [2023-12-27 19:52:51,790][106226] Updated weights for policy 0, policy_version 90653 (0.0006) [2023-12-27 19:52:51,829][106225] Updated weights for policy 1, policy_version 90550 (0.0008) [2023-12-27 19:52:51,853][106226] Updated weights for policy 0, policy_version 90663 (0.0009) [2023-12-27 19:52:51,882][106225] Updated weights for policy 1, policy_version 90560 (0.0009) [2023-12-27 19:52:51,936][106225] Updated weights for policy 1, policy_version 90570 (0.0008) [2023-12-27 19:52:52,546][106226] Updated weights for policy 0, policy_version 90673 (0.0009) [2023-12-27 19:52:52,604][106226] Updated weights for policy 0, policy_version 90683 (0.0011) [2023-12-27 19:52:52,666][106226] Updated weights for policy 0, policy_version 90693 (0.0008) [2023-12-27 19:52:52,721][106225] Updated weights for policy 1, policy_version 90580 (0.0008) [2023-12-27 19:52:52,775][106225] Updated weights for policy 1, policy_version 90590 (0.0007) [2023-12-27 19:52:52,838][106225] Updated weights for policy 1, policy_version 90600 (0.0006) [2023-12-27 19:52:53,372][106226] Updated weights for policy 0, policy_version 90703 (0.0010) [2023-12-27 19:52:53,425][106226] Updated weights for policy 0, policy_version 90713 (0.0010) [2023-12-27 19:52:53,478][106226] Updated weights for policy 0, policy_version 90723 (0.0010) [2023-12-27 19:52:53,495][106225] Updated weights for policy 1, policy_version 90610 (0.0005) [2023-12-27 19:52:53,557][106225] Updated weights for policy 1, policy_version 90620 (0.0007) [2023-12-27 19:52:53,617][106225] Updated weights for policy 1, policy_version 90630 (0.0005) [2023-12-27 19:52:53,679][106225] Updated weights for policy 1, policy_version 90640 (0.0005) [2023-12-27 19:52:54,196][106226] Updated weights for policy 0, policy_version 90733 (0.0011) [2023-12-27 19:52:54,254][106226] Updated weights for policy 0, policy_version 90743 (0.0010) [2023-12-27 19:52:54,275][106225] Updated weights for policy 1, policy_version 90650 (0.0007) [2023-12-27 19:52:54,308][106226] Updated weights for policy 0, policy_version 90753 (0.0010) [2023-12-27 19:52:54,330][106225] Updated weights for policy 1, policy_version 90660 (0.0006) [2023-12-27 19:52:54,391][106225] Updated weights for policy 1, policy_version 90670 (0.0007) [2023-12-27 19:52:55,036][106226] Updated weights for policy 0, policy_version 90763 (0.0011) [2023-12-27 19:52:55,091][106226] Updated weights for policy 0, policy_version 90773 (0.0011) [2023-12-27 19:52:55,112][106225] Updated weights for policy 1, policy_version 90680 (0.0006) [2023-12-27 19:52:55,145][106226] Updated weights for policy 0, policy_version 90783 (0.0011) [2023-12-27 19:52:55,172][106225] Updated weights for policy 1, policy_version 90690 (0.0006) [2023-12-27 19:52:55,237][106225] Updated weights for policy 1, policy_version 90700 (0.0007) [2023-12-27 19:52:55,875][106226] Updated weights for policy 0, policy_version 90793 (0.0011) [2023-12-27 19:52:55,931][106226] Updated weights for policy 0, policy_version 90803 (0.0010) [2023-12-27 19:52:55,934][106225] Updated weights for policy 1, policy_version 90710 (0.0006) [2023-12-27 19:52:55,990][106225] Updated weights for policy 1, policy_version 90720 (0.0007) [2023-12-27 19:52:55,995][106226] Updated weights for policy 0, policy_version 90813 (0.0008) [2023-12-27 19:52:56,045][106225] Updated weights for policy 1, policy_version 90730 (0.0007) [2023-12-27 19:52:56,061][106226] Updated weights for policy 0, policy_version 90823 (0.0011) [2023-12-27 19:52:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 46489600. Throughput: 0: 9853.1, 1: 9841.3. Samples: 46453204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:52:56,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-6.591')] [2023-12-27 19:52:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000090736_23232512.pth... [2023-12-27 19:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000090824_23257088.pth... [2023-12-27 19:52:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000089584_22937600.pth [2023-12-27 19:52:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000089672_22962176.pth [2023-12-27 19:52:56,741][106226] Updated weights for policy 0, policy_version 90833 (0.0006) [2023-12-27 19:52:56,768][106225] Updated weights for policy 1, policy_version 90740 (0.0007) [2023-12-27 19:52:56,787][106226] Updated weights for policy 0, policy_version 90843 (0.0006) [2023-12-27 19:52:56,822][106225] Updated weights for policy 1, policy_version 90750 (0.0009) [2023-12-27 19:52:56,838][106226] Updated weights for policy 0, policy_version 90853 (0.0006) [2023-12-27 19:52:56,886][106225] Updated weights for policy 1, policy_version 90760 (0.0007) [2023-12-27 19:52:57,539][106226] Updated weights for policy 0, policy_version 90863 (0.0009) [2023-12-27 19:52:57,595][106226] Updated weights for policy 0, policy_version 90873 (0.0010) [2023-12-27 19:52:57,633][106225] Updated weights for policy 1, policy_version 90770 (0.0007) [2023-12-27 19:52:57,654][106226] Updated weights for policy 0, policy_version 90883 (0.0010) [2023-12-27 19:52:57,696][106225] Updated weights for policy 1, policy_version 90780 (0.0007) [2023-12-27 19:52:57,746][106225] Updated weights for policy 1, policy_version 90790 (0.0007) [2023-12-27 19:52:57,800][106225] Updated weights for policy 1, policy_version 90800 (0.0007) [2023-12-27 19:52:58,375][106226] Updated weights for policy 0, policy_version 90893 (0.0009) [2023-12-27 19:52:58,439][106226] Updated weights for policy 0, policy_version 90903 (0.0008) [2023-12-27 19:52:58,502][106226] Updated weights for policy 0, policy_version 90913 (0.0009) [2023-12-27 19:52:58,587][106225] Updated weights for policy 1, policy_version 90810 (0.0008) [2023-12-27 19:52:58,646][106225] Updated weights for policy 1, policy_version 90820 (0.0008) [2023-12-27 19:52:58,705][106225] Updated weights for policy 1, policy_version 90830 (0.0007) [2023-12-27 19:52:59,363][106226] Updated weights for policy 0, policy_version 90923 (0.0007) [2023-12-27 19:52:59,424][106226] Updated weights for policy 0, policy_version 90933 (0.0010) [2023-12-27 19:52:59,483][106226] Updated weights for policy 0, policy_version 90943 (0.0010) [2023-12-27 19:52:59,500][106225] Updated weights for policy 1, policy_version 90840 (0.0008) [2023-12-27 19:52:59,557][106225] Updated weights for policy 1, policy_version 90850 (0.0006) [2023-12-27 19:52:59,609][106225] Updated weights for policy 1, policy_version 90860 (0.0006) [2023-12-27 19:53:00,180][106226] Updated weights for policy 0, policy_version 90953 (0.0010) [2023-12-27 19:53:00,239][106226] Updated weights for policy 0, policy_version 90963 (0.0008) [2023-12-27 19:53:00,294][106226] Updated weights for policy 0, policy_version 90973 (0.0008) [2023-12-27 19:53:00,323][106225] Updated weights for policy 1, policy_version 90870 (0.0008) [2023-12-27 19:53:00,347][106226] Updated weights for policy 0, policy_version 90983 (0.0007) [2023-12-27 19:53:00,379][106225] Updated weights for policy 1, policy_version 90880 (0.0008) [2023-12-27 19:53:00,435][106225] Updated weights for policy 1, policy_version 90890 (0.0009) [2023-12-27 19:53:01,014][106226] Updated weights for policy 0, policy_version 90993 (0.0007) [2023-12-27 19:53:01,083][106226] Updated weights for policy 0, policy_version 91003 (0.0009) [2023-12-27 19:53:01,144][106226] Updated weights for policy 0, policy_version 91013 (0.0009) [2023-12-27 19:53:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 46579712. Throughput: 0: 9864.0, 1: 9848.9. Samples: 46568380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:53:01,175][105115] Avg episode reward: [(0, '-5.057'), (1, '-6.321')] [2023-12-27 19:53:01,202][106225] Updated weights for policy 1, policy_version 90900 (0.0009) [2023-12-27 19:53:01,269][106225] Updated weights for policy 1, policy_version 90910 (0.0010) [2023-12-27 19:53:01,330][106225] Updated weights for policy 1, policy_version 90920 (0.0009) [2023-12-27 19:53:01,817][106226] Updated weights for policy 0, policy_version 91023 (0.0007) [2023-12-27 19:53:01,870][106226] Updated weights for policy 0, policy_version 91033 (0.0005) [2023-12-27 19:53:01,931][106226] Updated weights for policy 0, policy_version 91043 (0.0005) [2023-12-27 19:53:02,064][106225] Updated weights for policy 1, policy_version 90930 (0.0008) [2023-12-27 19:53:02,117][106225] Updated weights for policy 1, policy_version 90940 (0.0009) [2023-12-27 19:53:02,177][106225] Updated weights for policy 1, policy_version 90950 (0.0005) [2023-12-27 19:53:02,239][106225] Updated weights for policy 1, policy_version 90960 (0.0005) [2023-12-27 19:53:02,624][106226] Updated weights for policy 0, policy_version 91053 (0.0008) [2023-12-27 19:53:02,671][106226] Updated weights for policy 0, policy_version 91063 (0.0007) [2023-12-27 19:53:02,726][106226] Updated weights for policy 0, policy_version 91073 (0.0007) [2023-12-27 19:53:02,873][106225] Updated weights for policy 1, policy_version 90970 (0.0005) [2023-12-27 19:53:02,926][106225] Updated weights for policy 1, policy_version 90980 (0.0010) [2023-12-27 19:53:02,980][106225] Updated weights for policy 1, policy_version 90990 (0.0010) [2023-12-27 19:53:03,381][106226] Updated weights for policy 0, policy_version 91083 (0.0006) [2023-12-27 19:53:03,432][106226] Updated weights for policy 0, policy_version 91093 (0.0007) [2023-12-27 19:53:03,482][106226] Updated weights for policy 0, policy_version 91103 (0.0005) [2023-12-27 19:53:03,622][106225] Updated weights for policy 1, policy_version 91000 (0.0010) [2023-12-27 19:53:03,674][106225] Updated weights for policy 1, policy_version 91010 (0.0010) [2023-12-27 19:53:03,720][106225] Updated weights for policy 1, policy_version 91020 (0.0009) [2023-12-27 19:53:04,136][106226] Updated weights for policy 0, policy_version 91113 (0.0006) [2023-12-27 19:53:04,197][106226] Updated weights for policy 0, policy_version 91123 (0.0006) [2023-12-27 19:53:04,265][106226] Updated weights for policy 0, policy_version 91133 (0.0008) [2023-12-27 19:53:04,334][106226] Updated weights for policy 0, policy_version 91143 (0.0007) [2023-12-27 19:53:04,463][106225] Updated weights for policy 1, policy_version 91030 (0.0010) [2023-12-27 19:53:04,525][106225] Updated weights for policy 1, policy_version 91040 (0.0010) [2023-12-27 19:53:04,578][106225] Updated weights for policy 1, policy_version 91050 (0.0005) [2023-12-27 19:53:05,015][106226] Updated weights for policy 0, policy_version 91153 (0.0007) [2023-12-27 19:53:05,072][106226] Updated weights for policy 0, policy_version 91163 (0.0005) [2023-12-27 19:53:05,125][106226] Updated weights for policy 0, policy_version 91173 (0.0005) [2023-12-27 19:53:05,249][106225] Updated weights for policy 1, policy_version 91060 (0.0007) [2023-12-27 19:53:05,301][106225] Updated weights for policy 1, policy_version 91070 (0.0010) [2023-12-27 19:53:05,353][106225] Updated weights for policy 1, policy_version 91080 (0.0009) [2023-12-27 19:53:05,750][106226] Updated weights for policy 0, policy_version 91183 (0.0005) [2023-12-27 19:53:05,806][106226] Updated weights for policy 0, policy_version 91193 (0.0005) [2023-12-27 19:53:05,866][106226] Updated weights for policy 0, policy_version 91203 (0.0006) [2023-12-27 19:53:05,936][106225] Updated weights for policy 1, policy_version 91090 (0.0009) [2023-12-27 19:53:05,996][106225] Updated weights for policy 1, policy_version 91100 (0.0010) [2023-12-27 19:53:06,053][106225] Updated weights for policy 1, policy_version 91110 (0.0010) [2023-12-27 19:53:06,116][106225] Updated weights for policy 1, policy_version 91120 (0.0006) [2023-12-27 19:53:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 46686208. Throughput: 0: 9880.3, 1: 9857.6. Samples: 46690384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 19:53:06,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-6.826')] [2023-12-27 19:53:06,638][106226] Updated weights for policy 0, policy_version 91213 (0.0008) [2023-12-27 19:53:06,704][106226] Updated weights for policy 0, policy_version 91223 (0.0006) [2023-12-27 19:53:06,711][106225] Updated weights for policy 1, policy_version 91130 (0.0006) [2023-12-27 19:53:06,763][106226] Updated weights for policy 0, policy_version 91233 (0.0008) [2023-12-27 19:53:06,768][106225] Updated weights for policy 1, policy_version 91140 (0.0006) [2023-12-27 19:53:06,832][106225] Updated weights for policy 1, policy_version 91150 (0.0009) [2023-12-27 19:53:07,281][106226] Updated weights for policy 0, policy_version 91243 (0.0006) [2023-12-27 19:53:07,345][106226] Updated weights for policy 0, policy_version 91253 (0.0005) [2023-12-27 19:53:07,410][106226] Updated weights for policy 0, policy_version 91263 (0.0005) [2023-12-27 19:53:07,490][106225] Updated weights for policy 1, policy_version 91160 (0.0008) [2023-12-27 19:53:07,551][106225] Updated weights for policy 1, policy_version 91170 (0.0008) [2023-12-27 19:53:07,615][106225] Updated weights for policy 1, policy_version 91180 (0.0008) [2023-12-27 19:53:08,009][106226] Updated weights for policy 0, policy_version 91273 (0.0007) [2023-12-27 19:53:08,073][106226] Updated weights for policy 0, policy_version 91283 (0.0009) [2023-12-27 19:53:08,129][106226] Updated weights for policy 0, policy_version 91293 (0.0008) [2023-12-27 19:53:08,196][106226] Updated weights for policy 0, policy_version 91303 (0.0008) [2023-12-27 19:53:08,269][106225] Updated weights for policy 1, policy_version 91190 (0.0009) [2023-12-27 19:53:08,333][106225] Updated weights for policy 1, policy_version 91200 (0.0009) [2023-12-27 19:53:08,393][106225] Updated weights for policy 1, policy_version 91210 (0.0009) [2023-12-27 19:53:08,867][106226] Updated weights for policy 0, policy_version 91313 (0.0008) [2023-12-27 19:53:08,933][106226] Updated weights for policy 0, policy_version 91323 (0.0007) [2023-12-27 19:53:08,994][106226] Updated weights for policy 0, policy_version 91333 (0.0008) [2023-12-27 19:53:09,032][106225] Updated weights for policy 1, policy_version 91220 (0.0011) [2023-12-27 19:53:09,092][106225] Updated weights for policy 1, policy_version 91230 (0.0010) [2023-12-27 19:53:09,145][106225] Updated weights for policy 1, policy_version 91240 (0.0010) [2023-12-27 19:53:09,663][106226] Updated weights for policy 0, policy_version 91343 (0.0008) [2023-12-27 19:53:09,726][106226] Updated weights for policy 0, policy_version 91353 (0.0009) [2023-12-27 19:53:09,791][106226] Updated weights for policy 0, policy_version 91363 (0.0011) [2023-12-27 19:53:09,915][106225] Updated weights for policy 1, policy_version 91250 (0.0010) [2023-12-27 19:53:09,984][106225] Updated weights for policy 1, policy_version 91260 (0.0009) [2023-12-27 19:53:10,044][106225] Updated weights for policy 1, policy_version 91270 (0.0007) [2023-12-27 19:53:10,101][106225] Updated weights for policy 1, policy_version 91280 (0.0008) [2023-12-27 19:53:10,511][106226] Updated weights for policy 0, policy_version 91373 (0.0009) [2023-12-27 19:53:10,573][106226] Updated weights for policy 0, policy_version 91383 (0.0011) [2023-12-27 19:53:10,631][106226] Updated weights for policy 0, policy_version 91393 (0.0011) [2023-12-27 19:53:10,850][106225] Updated weights for policy 1, policy_version 91290 (0.0010) [2023-12-27 19:53:10,916][106225] Updated weights for policy 1, policy_version 91300 (0.0008) [2023-12-27 19:53:10,980][106225] Updated weights for policy 1, policy_version 91310 (0.0008) [2023-12-27 19:53:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 46784512. Throughput: 0: 9930.9, 1: 9924.1. Samples: 46754140. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:11,175][105115] Avg episode reward: [(0, '-5.248'), (1, '-6.635')] [2023-12-27 19:53:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000091312_23379968.pth... [2023-12-27 19:53:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000091400_23404544.pth... [2023-12-27 19:53:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000090192_23093248.pth [2023-12-27 19:53:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000090248_23109632.pth [2023-12-27 19:53:11,337][106226] Updated weights for policy 0, policy_version 91403 (0.0010) [2023-12-27 19:53:11,406][106226] Updated weights for policy 0, policy_version 91413 (0.0008) [2023-12-27 19:53:11,469][106226] Updated weights for policy 0, policy_version 91423 (0.0008) [2023-12-27 19:53:11,813][106225] Updated weights for policy 1, policy_version 91320 (0.0009) [2023-12-27 19:53:11,884][106225] Updated weights for policy 1, policy_version 91330 (0.0010) [2023-12-27 19:53:11,946][106225] Updated weights for policy 1, policy_version 91340 (0.0009) [2023-12-27 19:53:12,186][106226] Updated weights for policy 0, policy_version 91433 (0.0008) [2023-12-27 19:53:12,238][106226] Updated weights for policy 0, policy_version 91443 (0.0010) [2023-12-27 19:53:12,299][106226] Updated weights for policy 0, policy_version 91453 (0.0010) [2023-12-27 19:53:12,370][106226] Updated weights for policy 0, policy_version 91463 (0.0009) [2023-12-27 19:53:12,710][106225] Updated weights for policy 1, policy_version 91350 (0.0009) [2023-12-27 19:53:12,765][106225] Updated weights for policy 1, policy_version 91360 (0.0008) [2023-12-27 19:53:12,816][106225] Updated weights for policy 1, policy_version 91370 (0.0008) [2023-12-27 19:53:13,016][106226] Updated weights for policy 0, policy_version 91473 (0.0008) [2023-12-27 19:53:13,069][106226] Updated weights for policy 0, policy_version 91483 (0.0008) [2023-12-27 19:53:13,123][106226] Updated weights for policy 0, policy_version 91493 (0.0007) [2023-12-27 19:53:13,533][106225] Updated weights for policy 1, policy_version 91380 (0.0008) [2023-12-27 19:53:13,586][106225] Updated weights for policy 1, policy_version 91390 (0.0009) [2023-12-27 19:53:13,636][106225] Updated weights for policy 1, policy_version 91400 (0.0008) [2023-12-27 19:53:13,824][106226] Updated weights for policy 0, policy_version 91503 (0.0009) [2023-12-27 19:53:13,875][106226] Updated weights for policy 0, policy_version 91513 (0.0007) [2023-12-27 19:53:13,937][106226] Updated weights for policy 0, policy_version 91523 (0.0007) [2023-12-27 19:53:14,418][106225] Updated weights for policy 1, policy_version 91410 (0.0009) [2023-12-27 19:53:14,480][106225] Updated weights for policy 1, policy_version 91420 (0.0009) [2023-12-27 19:53:14,529][106225] Updated weights for policy 1, policy_version 91430 (0.0008) [2023-12-27 19:53:14,579][106225] Updated weights for policy 1, policy_version 91440 (0.0008) [2023-12-27 19:53:14,608][106226] Updated weights for policy 0, policy_version 91533 (0.0009) [2023-12-27 19:53:14,666][106226] Updated weights for policy 0, policy_version 91543 (0.0008) [2023-12-27 19:53:14,723][106226] Updated weights for policy 0, policy_version 91553 (0.0008) [2023-12-27 19:53:15,255][106225] Updated weights for policy 1, policy_version 91450 (0.0010) [2023-12-27 19:53:15,313][106225] Updated weights for policy 1, policy_version 91460 (0.0010) [2023-12-27 19:53:15,364][106225] Updated weights for policy 1, policy_version 91470 (0.0010) [2023-12-27 19:53:15,539][106226] Updated weights for policy 0, policy_version 91563 (0.0008) [2023-12-27 19:53:15,592][106226] Updated weights for policy 0, policy_version 91573 (0.0007) [2023-12-27 19:53:15,647][106226] Updated weights for policy 0, policy_version 91583 (0.0007) [2023-12-27 19:53:16,046][106225] Updated weights for policy 1, policy_version 91480 (0.0009) [2023-12-27 19:53:16,101][106225] Updated weights for policy 1, policy_version 91490 (0.0010) [2023-12-27 19:53:16,151][106225] Updated weights for policy 1, policy_version 91500 (0.0009) [2023-12-27 19:53:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 46882816. Throughput: 0: 9905.1, 1: 9726.5. Samples: 46867680. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:16,175][105115] Avg episode reward: [(0, '-5.038'), (1, '-6.666')] [2023-12-27 19:53:16,384][106226] Updated weights for policy 0, policy_version 91593 (0.0007) [2023-12-27 19:53:16,435][106226] Updated weights for policy 0, policy_version 91603 (0.0008) [2023-12-27 19:53:16,486][106226] Updated weights for policy 0, policy_version 91613 (0.0008) [2023-12-27 19:53:16,543][106226] Updated weights for policy 0, policy_version 91623 (0.0007) [2023-12-27 19:53:16,868][106225] Updated weights for policy 1, policy_version 91510 (0.0008) [2023-12-27 19:53:16,925][106225] Updated weights for policy 1, policy_version 91520 (0.0010) [2023-12-27 19:53:16,978][106225] Updated weights for policy 1, policy_version 91530 (0.0010) [2023-12-27 19:53:17,136][106226] Updated weights for policy 0, policy_version 91633 (0.0008) [2023-12-27 19:53:17,189][106226] Updated weights for policy 0, policy_version 91643 (0.0010) [2023-12-27 19:53:17,246][106226] Updated weights for policy 0, policy_version 91653 (0.0010) [2023-12-27 19:53:17,648][106225] Updated weights for policy 1, policy_version 91540 (0.0008) [2023-12-27 19:53:17,707][106225] Updated weights for policy 1, policy_version 91550 (0.0005) [2023-12-27 19:53:17,771][106225] Updated weights for policy 1, policy_version 91560 (0.0006) [2023-12-27 19:53:17,948][106226] Updated weights for policy 0, policy_version 91663 (0.0011) [2023-12-27 19:53:18,005][106226] Updated weights for policy 0, policy_version 91673 (0.0008) [2023-12-27 19:53:18,065][106226] Updated weights for policy 0, policy_version 91683 (0.0006) [2023-12-27 19:53:18,393][106225] Updated weights for policy 1, policy_version 91570 (0.0009) [2023-12-27 19:53:18,458][106225] Updated weights for policy 1, policy_version 91580 (0.0008) [2023-12-27 19:53:18,520][106225] Updated weights for policy 1, policy_version 91590 (0.0008) [2023-12-27 19:53:18,583][106225] Updated weights for policy 1, policy_version 91600 (0.0008) [2023-12-27 19:53:18,719][106226] Updated weights for policy 0, policy_version 91693 (0.0008) [2023-12-27 19:53:18,781][106226] Updated weights for policy 0, policy_version 91703 (0.0009) [2023-12-27 19:53:18,833][106226] Updated weights for policy 0, policy_version 91713 (0.0006) [2023-12-27 19:53:19,185][106225] Updated weights for policy 1, policy_version 91610 (0.0005) [2023-12-27 19:53:19,244][106225] Updated weights for policy 1, policy_version 91620 (0.0007) [2023-12-27 19:53:19,311][106225] Updated weights for policy 1, policy_version 91630 (0.0006) [2023-12-27 19:53:19,574][106226] Updated weights for policy 0, policy_version 91723 (0.0007) [2023-12-27 19:53:19,638][106226] Updated weights for policy 0, policy_version 91733 (0.0009) [2023-12-27 19:53:19,695][106226] Updated weights for policy 0, policy_version 91743 (0.0008) [2023-12-27 19:53:20,021][106225] Updated weights for policy 1, policy_version 91640 (0.0008) [2023-12-27 19:53:20,092][106225] Updated weights for policy 1, policy_version 91650 (0.0008) [2023-12-27 19:53:20,158][106225] Updated weights for policy 1, policy_version 91660 (0.0009) [2023-12-27 19:53:20,434][106226] Updated weights for policy 0, policy_version 91753 (0.0008) [2023-12-27 19:53:20,495][106226] Updated weights for policy 0, policy_version 91763 (0.0009) [2023-12-27 19:53:20,555][106226] Updated weights for policy 0, policy_version 91773 (0.0009) [2023-12-27 19:53:20,620][106226] Updated weights for policy 0, policy_version 91783 (0.0008) [2023-12-27 19:53:20,879][106225] Updated weights for policy 1, policy_version 91670 (0.0009) [2023-12-27 19:53:20,945][106225] Updated weights for policy 1, policy_version 91680 (0.0007) [2023-12-27 19:53:21,013][106225] Updated weights for policy 1, policy_version 91690 (0.0006) [2023-12-27 19:53:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 46981120. Throughput: 0: 9904.9, 1: 9736.6. Samples: 46988212. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:21,175][105115] Avg episode reward: [(0, '-5.096'), (1, '-6.660')] [2023-12-27 19:53:21,510][106226] Updated weights for policy 0, policy_version 91793 (0.0010) [2023-12-27 19:53:21,576][106226] Updated weights for policy 0, policy_version 91803 (0.0010) [2023-12-27 19:53:21,644][106226] Updated weights for policy 0, policy_version 91813 (0.0009) [2023-12-27 19:53:21,712][106225] Updated weights for policy 1, policy_version 91700 (0.0008) [2023-12-27 19:53:21,780][106225] Updated weights for policy 1, policy_version 91710 (0.0008) [2023-12-27 19:53:21,840][106225] Updated weights for policy 1, policy_version 91720 (0.0007) [2023-12-27 19:53:22,359][106226] Updated weights for policy 0, policy_version 91823 (0.0008) [2023-12-27 19:53:22,418][106226] Updated weights for policy 0, policy_version 91833 (0.0009) [2023-12-27 19:53:22,471][106226] Updated weights for policy 0, policy_version 91843 (0.0008) [2023-12-27 19:53:22,564][106225] Updated weights for policy 1, policy_version 91730 (0.0009) [2023-12-27 19:53:22,626][106225] Updated weights for policy 1, policy_version 91740 (0.0007) [2023-12-27 19:53:22,686][106225] Updated weights for policy 1, policy_version 91750 (0.0007) [2023-12-27 19:53:22,752][106225] Updated weights for policy 1, policy_version 91760 (0.0009) [2023-12-27 19:53:23,161][106226] Updated weights for policy 0, policy_version 91853 (0.0007) [2023-12-27 19:53:23,231][106226] Updated weights for policy 0, policy_version 91863 (0.0007) [2023-12-27 19:53:23,295][106226] Updated weights for policy 0, policy_version 91873 (0.0007) [2023-12-27 19:53:23,519][106225] Updated weights for policy 1, policy_version 91770 (0.0009) [2023-12-27 19:53:23,578][106225] Updated weights for policy 1, policy_version 91780 (0.0010) [2023-12-27 19:53:23,640][106225] Updated weights for policy 1, policy_version 91790 (0.0006) [2023-12-27 19:53:23,846][106226] Updated weights for policy 0, policy_version 91883 (0.0008) [2023-12-27 19:53:23,902][106226] Updated weights for policy 0, policy_version 91893 (0.0007) [2023-12-27 19:53:23,969][106226] Updated weights for policy 0, policy_version 91903 (0.0008) [2023-12-27 19:53:24,333][106225] Updated weights for policy 1, policy_version 91800 (0.0008) [2023-12-27 19:53:24,399][106225] Updated weights for policy 1, policy_version 91810 (0.0010) [2023-12-27 19:53:24,463][106225] Updated weights for policy 1, policy_version 91820 (0.0010) [2023-12-27 19:53:24,684][106226] Updated weights for policy 0, policy_version 91913 (0.0007) [2023-12-27 19:53:24,740][106226] Updated weights for policy 0, policy_version 91923 (0.0005) [2023-12-27 19:53:24,797][106226] Updated weights for policy 0, policy_version 91933 (0.0005) [2023-12-27 19:53:24,845][106226] Updated weights for policy 0, policy_version 91943 (0.0005) [2023-12-27 19:53:25,126][106225] Updated weights for policy 1, policy_version 91830 (0.0008) [2023-12-27 19:53:25,195][106225] Updated weights for policy 1, policy_version 91840 (0.0009) [2023-12-27 19:53:25,255][106225] Updated weights for policy 1, policy_version 91850 (0.0008) [2023-12-27 19:53:25,455][106226] Updated weights for policy 0, policy_version 91953 (0.0005) [2023-12-27 19:53:25,526][106226] Updated weights for policy 0, policy_version 91963 (0.0005) [2023-12-27 19:53:25,581][106226] Updated weights for policy 0, policy_version 91973 (0.0005) [2023-12-27 19:53:25,873][106225] Updated weights for policy 1, policy_version 91860 (0.0007) [2023-12-27 19:53:25,937][106225] Updated weights for policy 1, policy_version 91870 (0.0008) [2023-12-27 19:53:25,988][106225] Updated weights for policy 1, policy_version 91880 (0.0008) [2023-12-27 19:53:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 47079424. Throughput: 0: 9935.8, 1: 9674.1. Samples: 47046380. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:26,176][105115] Avg episode reward: [(0, '-5.084'), (1, '-6.711')] [2023-12-27 19:53:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000091888_23527424.pth... [2023-12-27 19:53:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000090736_23232512.pth [2023-12-27 19:53:26,209][106226] Updated weights for policy 0, policy_version 91983 (0.0007) [2023-12-27 19:53:26,254][106226] Updated weights for policy 0, policy_version 91993 (0.0005) [2023-12-27 19:53:26,317][106226] Updated weights for policy 0, policy_version 92003 (0.0006) [2023-12-27 19:53:26,350][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000092008_23560192.pth... [2023-12-27 19:53:26,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000090824_23257088.pth [2023-12-27 19:53:26,714][106225] Updated weights for policy 1, policy_version 91890 (0.0009) [2023-12-27 19:53:26,769][106225] Updated weights for policy 1, policy_version 91900 (0.0009) [2023-12-27 19:53:26,827][106225] Updated weights for policy 1, policy_version 91910 (0.0008) [2023-12-27 19:53:26,884][106225] Updated weights for policy 1, policy_version 91920 (0.0008) [2023-12-27 19:53:26,927][106226] Updated weights for policy 0, policy_version 92013 (0.0007) [2023-12-27 19:53:26,984][106226] Updated weights for policy 0, policy_version 92023 (0.0006) [2023-12-27 19:53:27,035][106226] Updated weights for policy 0, policy_version 92033 (0.0008) [2023-12-27 19:53:27,595][106225] Updated weights for policy 1, policy_version 91930 (0.0009) [2023-12-27 19:53:27,648][106225] Updated weights for policy 1, policy_version 91940 (0.0008) [2023-12-27 19:53:27,707][106225] Updated weights for policy 1, policy_version 91950 (0.0009) [2023-12-27 19:53:27,771][106226] Updated weights for policy 0, policy_version 92043 (0.0008) [2023-12-27 19:53:27,833][106226] Updated weights for policy 0, policy_version 92053 (0.0008) [2023-12-27 19:53:27,892][106226] Updated weights for policy 0, policy_version 92063 (0.0009) [2023-12-27 19:53:28,454][106225] Updated weights for policy 1, policy_version 91960 (0.0008) [2023-12-27 19:53:28,520][106225] Updated weights for policy 1, policy_version 91970 (0.0008) [2023-12-27 19:53:28,583][106225] Updated weights for policy 1, policy_version 91980 (0.0009) [2023-12-27 19:53:28,617][106226] Updated weights for policy 0, policy_version 92073 (0.0009) [2023-12-27 19:53:28,678][106226] Updated weights for policy 0, policy_version 92083 (0.0010) [2023-12-27 19:53:28,741][106226] Updated weights for policy 0, policy_version 92093 (0.0009) [2023-12-27 19:53:28,798][106226] Updated weights for policy 0, policy_version 92103 (0.0008) [2023-12-27 19:53:29,231][106225] Updated weights for policy 1, policy_version 91990 (0.0007) [2023-12-27 19:53:29,285][106225] Updated weights for policy 1, policy_version 92000 (0.0009) [2023-12-27 19:53:29,334][106225] Updated weights for policy 1, policy_version 92010 (0.0008) [2023-12-27 19:53:29,587][106226] Updated weights for policy 0, policy_version 92113 (0.0009) [2023-12-27 19:53:29,635][106226] Updated weights for policy 0, policy_version 92123 (0.0008) [2023-12-27 19:53:29,695][106226] Updated weights for policy 0, policy_version 92133 (0.0008) [2023-12-27 19:53:30,056][106225] Updated weights for policy 1, policy_version 92020 (0.0008) [2023-12-27 19:53:30,116][106225] Updated weights for policy 1, policy_version 92030 (0.0009) [2023-12-27 19:53:30,172][106225] Updated weights for policy 1, policy_version 92040 (0.0010) [2023-12-27 19:53:30,411][106226] Updated weights for policy 0, policy_version 92143 (0.0009) [2023-12-27 19:53:30,470][106226] Updated weights for policy 0, policy_version 92153 (0.0007) [2023-12-27 19:53:30,519][106226] Updated weights for policy 0, policy_version 92163 (0.0008) [2023-12-27 19:53:30,898][106225] Updated weights for policy 1, policy_version 92050 (0.0010) [2023-12-27 19:53:30,946][106225] Updated weights for policy 1, policy_version 92060 (0.0008) [2023-12-27 19:53:30,992][106225] Updated weights for policy 1, policy_version 92070 (0.0008) [2023-12-27 19:53:31,051][106225] Updated weights for policy 1, policy_version 92080 (0.0008) [2023-12-27 19:53:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 47177728. Throughput: 0: 9980.6, 1: 9753.2. Samples: 47166772. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:31,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-6.530')] [2023-12-27 19:53:31,227][106226] Updated weights for policy 0, policy_version 92173 (0.0008) [2023-12-27 19:53:31,287][106226] Updated weights for policy 0, policy_version 92183 (0.0010) [2023-12-27 19:53:31,348][106226] Updated weights for policy 0, policy_version 92193 (0.0006) [2023-12-27 19:53:31,791][106225] Updated weights for policy 1, policy_version 92090 (0.0006) [2023-12-27 19:53:31,851][106225] Updated weights for policy 1, policy_version 92100 (0.0007) [2023-12-27 19:53:31,912][106225] Updated weights for policy 1, policy_version 92110 (0.0007) [2023-12-27 19:53:32,106][106226] Updated weights for policy 0, policy_version 92203 (0.0008) [2023-12-27 19:53:32,168][106226] Updated weights for policy 0, policy_version 92213 (0.0007) [2023-12-27 19:53:32,226][106226] Updated weights for policy 0, policy_version 92223 (0.0008) [2023-12-27 19:53:32,545][106225] Updated weights for policy 1, policy_version 92120 (0.0005) [2023-12-27 19:53:32,598][106225] Updated weights for policy 1, policy_version 92130 (0.0005) [2023-12-27 19:53:32,658][106225] Updated weights for policy 1, policy_version 92140 (0.0005) [2023-12-27 19:53:32,981][106226] Updated weights for policy 0, policy_version 92233 (0.0008) [2023-12-27 19:53:33,032][106226] Updated weights for policy 0, policy_version 92243 (0.0005) [2023-12-27 19:53:33,081][106226] Updated weights for policy 0, policy_version 92253 (0.0005) [2023-12-27 19:53:33,132][106226] Updated weights for policy 0, policy_version 92263 (0.0005) [2023-12-27 19:53:33,212][106225] Updated weights for policy 1, policy_version 92150 (0.0005) [2023-12-27 19:53:33,269][106225] Updated weights for policy 1, policy_version 92160 (0.0006) [2023-12-27 19:53:33,318][106225] Updated weights for policy 1, policy_version 92170 (0.0010) [2023-12-27 19:53:33,797][106226] Updated weights for policy 0, policy_version 92273 (0.0007) [2023-12-27 19:53:33,843][106226] Updated weights for policy 0, policy_version 92283 (0.0008) [2023-12-27 19:53:33,888][106226] Updated weights for policy 0, policy_version 92293 (0.0007) [2023-12-27 19:53:34,001][106225] Updated weights for policy 1, policy_version 92180 (0.0010) [2023-12-27 19:53:34,050][106225] Updated weights for policy 1, policy_version 92190 (0.0010) [2023-12-27 19:53:34,098][106225] Updated weights for policy 1, policy_version 92200 (0.0008) [2023-12-27 19:53:34,646][106226] Updated weights for policy 0, policy_version 92303 (0.0008) [2023-12-27 19:53:34,700][106226] Updated weights for policy 0, policy_version 92313 (0.0008) [2023-12-27 19:53:34,744][106225] Updated weights for policy 1, policy_version 92210 (0.0007) [2023-12-27 19:53:34,766][106226] Updated weights for policy 0, policy_version 92323 (0.0005) [2023-12-27 19:53:34,816][106225] Updated weights for policy 1, policy_version 92220 (0.0005) [2023-12-27 19:53:34,881][106225] Updated weights for policy 1, policy_version 92230 (0.0005) [2023-12-27 19:53:34,947][106225] Updated weights for policy 1, policy_version 92240 (0.0005) [2023-12-27 19:53:35,345][106226] Updated weights for policy 0, policy_version 92333 (0.0007) [2023-12-27 19:53:35,402][106226] Updated weights for policy 0, policy_version 92343 (0.0008) [2023-12-27 19:53:35,456][106226] Updated weights for policy 0, policy_version 92353 (0.0008) [2023-12-27 19:53:35,566][106225] Updated weights for policy 1, policy_version 92250 (0.0010) [2023-12-27 19:53:35,616][106225] Updated weights for policy 1, policy_version 92260 (0.0010) [2023-12-27 19:53:35,662][106225] Updated weights for policy 1, policy_version 92270 (0.0010) [2023-12-27 19:53:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 47276032. Throughput: 0: 9952.1, 1: 9899.7. Samples: 47288568. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:36,175][105115] Avg episode reward: [(0, '-5.294'), (1, '-6.627')] [2023-12-27 19:53:36,210][106226] Updated weights for policy 0, policy_version 92363 (0.0008) [2023-12-27 19:53:36,264][106226] Updated weights for policy 0, policy_version 92373 (0.0011) [2023-12-27 19:53:36,329][106226] Updated weights for policy 0, policy_version 92383 (0.0011) [2023-12-27 19:53:36,441][106225] Updated weights for policy 1, policy_version 92280 (0.0009) [2023-12-27 19:53:36,500][106225] Updated weights for policy 1, policy_version 92290 (0.0009) [2023-12-27 19:53:36,561][106225] Updated weights for policy 1, policy_version 92300 (0.0006) [2023-12-27 19:53:37,002][106226] Updated weights for policy 0, policy_version 92393 (0.0008) [2023-12-27 19:53:37,062][106226] Updated weights for policy 0, policy_version 92403 (0.0006) [2023-12-27 19:53:37,120][106226] Updated weights for policy 0, policy_version 92413 (0.0009) [2023-12-27 19:53:37,179][106226] Updated weights for policy 0, policy_version 92423 (0.0011) [2023-12-27 19:53:37,276][106225] Updated weights for policy 1, policy_version 92310 (0.0010) [2023-12-27 19:53:37,334][106225] Updated weights for policy 1, policy_version 92320 (0.0010) [2023-12-27 19:53:37,395][106225] Updated weights for policy 1, policy_version 92330 (0.0010) [2023-12-27 19:53:37,863][106226] Updated weights for policy 0, policy_version 92433 (0.0010) [2023-12-27 19:53:37,916][106226] Updated weights for policy 0, policy_version 92443 (0.0010) [2023-12-27 19:53:37,969][106226] Updated weights for policy 0, policy_version 92453 (0.0010) [2023-12-27 19:53:38,114][106225] Updated weights for policy 1, policy_version 92340 (0.0007) [2023-12-27 19:53:38,171][106225] Updated weights for policy 1, policy_version 92350 (0.0010) [2023-12-27 19:53:38,219][106225] Updated weights for policy 1, policy_version 92360 (0.0010) [2023-12-27 19:53:38,725][106226] Updated weights for policy 0, policy_version 92463 (0.0011) [2023-12-27 19:53:38,792][106226] Updated weights for policy 0, policy_version 92473 (0.0011) [2023-12-27 19:53:38,863][106226] Updated weights for policy 0, policy_version 92483 (0.0011) [2023-12-27 19:53:38,961][106225] Updated weights for policy 1, policy_version 92370 (0.0010) [2023-12-27 19:53:39,014][106225] Updated weights for policy 1, policy_version 92380 (0.0008) [2023-12-27 19:53:39,078][106225] Updated weights for policy 1, policy_version 92390 (0.0005) [2023-12-27 19:53:39,134][106225] Updated weights for policy 1, policy_version 92400 (0.0005) [2023-12-27 19:53:39,549][106226] Updated weights for policy 0, policy_version 92493 (0.0009) [2023-12-27 19:53:39,622][106226] Updated weights for policy 0, policy_version 92503 (0.0006) [2023-12-27 19:53:39,692][106226] Updated weights for policy 0, policy_version 92513 (0.0007) [2023-12-27 19:53:39,783][106225] Updated weights for policy 1, policy_version 92410 (0.0010) [2023-12-27 19:53:39,843][106225] Updated weights for policy 1, policy_version 92420 (0.0011) [2023-12-27 19:53:39,913][106225] Updated weights for policy 1, policy_version 92430 (0.0008) [2023-12-27 19:53:40,345][106226] Updated weights for policy 0, policy_version 92523 (0.0007) [2023-12-27 19:53:40,408][106226] Updated weights for policy 0, policy_version 92533 (0.0008) [2023-12-27 19:53:40,470][106226] Updated weights for policy 0, policy_version 92543 (0.0007) [2023-12-27 19:53:40,639][106225] Updated weights for policy 1, policy_version 92440 (0.0010) [2023-12-27 19:53:40,703][106225] Updated weights for policy 1, policy_version 92450 (0.0009) [2023-12-27 19:53:40,770][106225] Updated weights for policy 1, policy_version 92460 (0.0006) [2023-12-27 19:53:41,090][106226] Updated weights for policy 0, policy_version 92553 (0.0007) [2023-12-27 19:53:41,154][106226] Updated weights for policy 0, policy_version 92563 (0.0011) [2023-12-27 19:53:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 47374336. Throughput: 0: 9955.6, 1: 9904.3. Samples: 47346904. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:41,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-6.968')] [2023-12-27 19:53:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000092464_23674880.pth... [2023-12-27 19:53:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000091312_23379968.pth [2023-12-27 19:53:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000092464_23674880.pth [2023-12-27 19:53:41,213][106226] Updated weights for policy 0, policy_version 92573 (0.0011) [2023-12-27 19:53:41,273][106226] Updated weights for policy 0, policy_version 92583 (0.0010) [2023-12-27 19:53:41,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000092584_23707648.pth... [2023-12-27 19:53:41,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000091400_23404544.pth [2023-12-27 19:53:41,286][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000092584_23707648.pth [2023-12-27 19:53:41,458][106225] Updated weights for policy 1, policy_version 92470 (0.0008) [2023-12-27 19:53:41,512][106225] Updated weights for policy 1, policy_version 92480 (0.0009) [2023-12-27 19:53:41,561][106225] Updated weights for policy 1, policy_version 92490 (0.0008) [2023-12-27 19:53:42,041][106226] Updated weights for policy 0, policy_version 92593 (0.0007) [2023-12-27 19:53:42,108][106226] Updated weights for policy 0, policy_version 92603 (0.0006) [2023-12-27 19:53:42,166][106226] Updated weights for policy 0, policy_version 92613 (0.0007) [2023-12-27 19:53:42,372][106225] Updated weights for policy 1, policy_version 92500 (0.0010) [2023-12-27 19:53:42,435][106225] Updated weights for policy 1, policy_version 92510 (0.0009) [2023-12-27 19:53:42,491][106225] Updated weights for policy 1, policy_version 92520 (0.0009) [2023-12-27 19:53:42,883][106226] Updated weights for policy 0, policy_version 92623 (0.0008) [2023-12-27 19:53:42,938][106226] Updated weights for policy 0, policy_version 92633 (0.0008) [2023-12-27 19:53:42,992][106226] Updated weights for policy 0, policy_version 92643 (0.0007) [2023-12-27 19:53:43,241][106225] Updated weights for policy 1, policy_version 92530 (0.0008) [2023-12-27 19:53:43,301][106225] Updated weights for policy 1, policy_version 92540 (0.0005) [2023-12-27 19:53:43,359][106225] Updated weights for policy 1, policy_version 92550 (0.0005) [2023-12-27 19:53:43,420][106225] Updated weights for policy 1, policy_version 92560 (0.0005) [2023-12-27 19:53:43,626][106226] Updated weights for policy 0, policy_version 92653 (0.0005) [2023-12-27 19:53:43,676][106226] Updated weights for policy 0, policy_version 92663 (0.0005) [2023-12-27 19:53:43,729][106226] Updated weights for policy 0, policy_version 92673 (0.0005) [2023-12-27 19:53:44,049][106225] Updated weights for policy 1, policy_version 92570 (0.0008) [2023-12-27 19:53:44,096][106225] Updated weights for policy 1, policy_version 92580 (0.0008) [2023-12-27 19:53:44,144][106225] Updated weights for policy 1, policy_version 92590 (0.0008) [2023-12-27 19:53:44,330][106226] Updated weights for policy 0, policy_version 92683 (0.0006) [2023-12-27 19:53:44,381][106226] Updated weights for policy 0, policy_version 92693 (0.0006) [2023-12-27 19:53:44,433][106226] Updated weights for policy 0, policy_version 92703 (0.0005) [2023-12-27 19:53:44,894][106225] Updated weights for policy 1, policy_version 92600 (0.0006) [2023-12-27 19:53:44,949][106225] Updated weights for policy 1, policy_version 92610 (0.0009) [2023-12-27 19:53:45,009][106225] Updated weights for policy 1, policy_version 92620 (0.0008) [2023-12-27 19:53:45,099][106226] Updated weights for policy 0, policy_version 92713 (0.0006) [2023-12-27 19:53:45,162][106226] Updated weights for policy 0, policy_version 92723 (0.0006) [2023-12-27 19:53:45,235][106226] Updated weights for policy 0, policy_version 92733 (0.0006) [2023-12-27 19:53:45,309][106226] Updated weights for policy 0, policy_version 92743 (0.0008) [2023-12-27 19:53:45,771][106225] Updated weights for policy 1, policy_version 92631 (0.0009) [2023-12-27 19:53:45,818][106225] Updated weights for policy 1, policy_version 92641 (0.0008) [2023-12-27 19:53:45,863][106226] Updated weights for policy 0, policy_version 92753 (0.0010) [2023-12-27 19:53:45,869][106225] Updated weights for policy 1, policy_version 92651 (0.0006) [2023-12-27 19:53:45,923][106226] Updated weights for policy 0, policy_version 92763 (0.0010) [2023-12-27 19:53:45,977][106226] Updated weights for policy 0, policy_version 92773 (0.0008) [2023-12-27 19:53:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 47480832. Throughput: 0: 10028.9, 1: 9916.2. Samples: 47465916. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:46,175][105115] Avg episode reward: [(0, '-5.117'), (1, '-7.035')] [2023-12-27 19:53:46,598][106226] Updated weights for policy 0, policy_version 92783 (0.0007) [2023-12-27 19:53:46,644][106226] Updated weights for policy 0, policy_version 92793 (0.0005) [2023-12-27 19:53:46,660][106225] Updated weights for policy 1, policy_version 92661 (0.0005) [2023-12-27 19:53:46,690][106226] Updated weights for policy 0, policy_version 92803 (0.0005) [2023-12-27 19:53:46,730][106225] Updated weights for policy 1, policy_version 92671 (0.0009) [2023-12-27 19:53:46,790][106225] Updated weights for policy 1, policy_version 92681 (0.0007) [2023-12-27 19:53:47,232][106226] Updated weights for policy 0, policy_version 92813 (0.0008) [2023-12-27 19:53:47,284][106226] Updated weights for policy 0, policy_version 92823 (0.0007) [2023-12-27 19:53:47,347][106226] Updated weights for policy 0, policy_version 92833 (0.0006) [2023-12-27 19:53:47,405][106225] Updated weights for policy 1, policy_version 92691 (0.0008) [2023-12-27 19:53:47,477][106225] Updated weights for policy 1, policy_version 92701 (0.0008) [2023-12-27 19:53:47,534][106225] Updated weights for policy 1, policy_version 92711 (0.0007) [2023-12-27 19:53:48,003][106226] Updated weights for policy 0, policy_version 92843 (0.0009) [2023-12-27 19:53:48,068][106226] Updated weights for policy 0, policy_version 92853 (0.0006) [2023-12-27 19:53:48,090][106225] Updated weights for policy 1, policy_version 92721 (0.0006) [2023-12-27 19:53:48,131][106226] Updated weights for policy 0, policy_version 92863 (0.0008) [2023-12-27 19:53:48,143][106225] Updated weights for policy 1, policy_version 92731 (0.0010) [2023-12-27 19:53:48,201][106225] Updated weights for policy 1, policy_version 92741 (0.0009) [2023-12-27 19:53:48,261][106225] Updated weights for policy 1, policy_version 92751 (0.0005) [2023-12-27 19:53:48,780][106226] Updated weights for policy 0, policy_version 92873 (0.0011) [2023-12-27 19:53:48,831][106226] Updated weights for policy 0, policy_version 92883 (0.0010) [2023-12-27 19:53:48,882][106226] Updated weights for policy 0, policy_version 92893 (0.0011) [2023-12-27 19:53:48,921][106225] Updated weights for policy 1, policy_version 92761 (0.0006) [2023-12-27 19:53:48,936][106226] Updated weights for policy 0, policy_version 92903 (0.0010) [2023-12-27 19:53:48,973][106225] Updated weights for policy 1, policy_version 92771 (0.0005) [2023-12-27 19:53:49,034][106225] Updated weights for policy 1, policy_version 92781 (0.0008) [2023-12-27 19:53:49,659][106226] Updated weights for policy 0, policy_version 92913 (0.0007) [2023-12-27 19:53:49,699][106225] Updated weights for policy 1, policy_version 92791 (0.0007) [2023-12-27 19:53:49,723][106226] Updated weights for policy 0, policy_version 92923 (0.0011) [2023-12-27 19:53:49,766][106225] Updated weights for policy 1, policy_version 92801 (0.0005) [2023-12-27 19:53:49,791][106226] Updated weights for policy 0, policy_version 92933 (0.0011) [2023-12-27 19:53:49,830][106225] Updated weights for policy 1, policy_version 92811 (0.0006) [2023-12-27 19:53:50,477][106226] Updated weights for policy 0, policy_version 92943 (0.0008) [2023-12-27 19:53:50,526][106226] Updated weights for policy 0, policy_version 92953 (0.0005) [2023-12-27 19:53:50,531][106225] Updated weights for policy 1, policy_version 92821 (0.0009) [2023-12-27 19:53:50,581][106226] Updated weights for policy 0, policy_version 92963 (0.0007) [2023-12-27 19:53:50,587][106225] Updated weights for policy 1, policy_version 92831 (0.0010) [2023-12-27 19:53:50,643][106225] Updated weights for policy 1, policy_version 92841 (0.0010) [2023-12-27 19:53:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 47579136. Throughput: 0: 10072.8, 1: 9922.7. Samples: 47590184. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:51,175][105115] Avg episode reward: [(0, '-5.223'), (1, '-6.667')] [2023-12-27 19:53:51,303][106226] Updated weights for policy 0, policy_version 92973 (0.0007) [2023-12-27 19:53:51,360][106226] Updated weights for policy 0, policy_version 92983 (0.0006) [2023-12-27 19:53:51,363][106225] Updated weights for policy 1, policy_version 92851 (0.0011) [2023-12-27 19:53:51,429][106225] Updated weights for policy 1, policy_version 92861 (0.0010) [2023-12-27 19:53:51,430][106226] Updated weights for policy 0, policy_version 92993 (0.0007) [2023-12-27 19:53:51,480][106225] Updated weights for policy 1, policy_version 92871 (0.0009) [2023-12-27 19:53:52,186][106226] Updated weights for policy 0, policy_version 93003 (0.0008) [2023-12-27 19:53:52,249][106226] Updated weights for policy 0, policy_version 93013 (0.0009) [2023-12-27 19:53:52,257][106225] Updated weights for policy 1, policy_version 92881 (0.0008) [2023-12-27 19:53:52,318][106226] Updated weights for policy 0, policy_version 93023 (0.0008) [2023-12-27 19:53:52,324][106225] Updated weights for policy 1, policy_version 92891 (0.0006) [2023-12-27 19:53:52,391][106225] Updated weights for policy 1, policy_version 92901 (0.0008) [2023-12-27 19:53:52,456][106225] Updated weights for policy 1, policy_version 92911 (0.0008) [2023-12-27 19:53:52,943][106226] Updated weights for policy 0, policy_version 93033 (0.0007) [2023-12-27 19:53:53,001][106226] Updated weights for policy 0, policy_version 93043 (0.0011) [2023-12-27 19:53:53,059][106226] Updated weights for policy 0, policy_version 93053 (0.0010) [2023-12-27 19:53:53,106][106226] Updated weights for policy 0, policy_version 93063 (0.0010) [2023-12-27 19:53:53,204][106225] Updated weights for policy 1, policy_version 92921 (0.0008) [2023-12-27 19:53:53,250][106225] Updated weights for policy 1, policy_version 92931 (0.0007) [2023-12-27 19:53:53,300][106225] Updated weights for policy 1, policy_version 92941 (0.0008) [2023-12-27 19:53:53,803][106226] Updated weights for policy 0, policy_version 93073 (0.0009) [2023-12-27 19:53:53,866][106226] Updated weights for policy 0, policy_version 93083 (0.0007) [2023-12-27 19:53:53,922][106226] Updated weights for policy 0, policy_version 93093 (0.0006) [2023-12-27 19:53:53,959][106225] Updated weights for policy 1, policy_version 92951 (0.0009) [2023-12-27 19:53:54,006][106225] Updated weights for policy 1, policy_version 92961 (0.0008) [2023-12-27 19:53:54,055][106225] Updated weights for policy 1, policy_version 92971 (0.0005) [2023-12-27 19:53:54,664][106226] Updated weights for policy 0, policy_version 93103 (0.0007) [2023-12-27 19:53:54,699][106225] Updated weights for policy 1, policy_version 92981 (0.0008) [2023-12-27 19:53:54,719][106226] Updated weights for policy 0, policy_version 93113 (0.0007) [2023-12-27 19:53:54,746][106225] Updated weights for policy 1, policy_version 92991 (0.0010) [2023-12-27 19:53:54,780][106226] Updated weights for policy 0, policy_version 93123 (0.0008) [2023-12-27 19:53:54,794][106225] Updated weights for policy 1, policy_version 93001 (0.0010) [2023-12-27 19:53:55,480][106226] Updated weights for policy 0, policy_version 93133 (0.0006) [2023-12-27 19:53:55,530][106225] Updated weights for policy 1, policy_version 93011 (0.0010) [2023-12-27 19:53:55,540][106226] Updated weights for policy 0, policy_version 93143 (0.0007) [2023-12-27 19:53:55,592][106225] Updated weights for policy 1, policy_version 93021 (0.0010) [2023-12-27 19:53:55,598][106226] Updated weights for policy 0, policy_version 93153 (0.0006) [2023-12-27 19:53:55,639][106225] Updated weights for policy 1, policy_version 93031 (0.0010) [2023-12-27 19:53:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 47677440. Throughput: 0: 10042.9, 1: 9827.0. Samples: 47648288. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:53:56,176][105115] Avg episode reward: [(0, '-5.025'), (1, '-6.363')] [2023-12-27 19:53:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000093040_23822336.pth... [2023-12-27 19:53:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000093160_23855104.pth... [2023-12-27 19:53:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000091888_23527424.pth [2023-12-27 19:53:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000092008_23560192.pth [2023-12-27 19:53:56,298][106226] Updated weights for policy 0, policy_version 93163 (0.0005) [2023-12-27 19:53:56,355][106226] Updated weights for policy 0, policy_version 93173 (0.0006) [2023-12-27 19:53:56,365][106225] Updated weights for policy 1, policy_version 93041 (0.0010) [2023-12-27 19:53:56,405][106226] Updated weights for policy 0, policy_version 93183 (0.0007) [2023-12-27 19:53:56,417][106225] Updated weights for policy 1, policy_version 93051 (0.0010) [2023-12-27 19:53:56,467][106225] Updated weights for policy 1, policy_version 93061 (0.0010) [2023-12-27 19:53:56,516][106225] Updated weights for policy 1, policy_version 93071 (0.0010) [2023-12-27 19:53:57,088][106226] Updated weights for policy 0, policy_version 93193 (0.0007) [2023-12-27 19:53:57,144][106226] Updated weights for policy 0, policy_version 93203 (0.0008) [2023-12-27 19:53:57,198][106226] Updated weights for policy 0, policy_version 93213 (0.0007) [2023-12-27 19:53:57,233][106225] Updated weights for policy 1, policy_version 93081 (0.0010) [2023-12-27 19:53:57,257][106226] Updated weights for policy 0, policy_version 93223 (0.0007) [2023-12-27 19:53:57,276][106225] Updated weights for policy 1, policy_version 93091 (0.0010) [2023-12-27 19:53:57,335][106225] Updated weights for policy 1, policy_version 93101 (0.0007) [2023-12-27 19:53:57,963][106225] Updated weights for policy 1, policy_version 93111 (0.0009) [2023-12-27 19:53:57,968][106226] Updated weights for policy 0, policy_version 93233 (0.0006) [2023-12-27 19:53:58,017][106225] Updated weights for policy 1, policy_version 93121 (0.0008) [2023-12-27 19:53:58,027][106226] Updated weights for policy 0, policy_version 93243 (0.0007) [2023-12-27 19:53:58,077][106225] Updated weights for policy 1, policy_version 93131 (0.0008) [2023-12-27 19:53:58,083][106226] Updated weights for policy 0, policy_version 93253 (0.0007) [2023-12-27 19:53:58,932][106225] Updated weights for policy 1, policy_version 93141 (0.0009) [2023-12-27 19:53:58,987][106226] Updated weights for policy 0, policy_version 93263 (0.0008) [2023-12-27 19:53:59,002][106225] Updated weights for policy 1, policy_version 93151 (0.0006) [2023-12-27 19:53:59,047][106226] Updated weights for policy 0, policy_version 93273 (0.0009) [2023-12-27 19:53:59,051][106225] Updated weights for policy 1, policy_version 93161 (0.0007) [2023-12-27 19:53:59,106][106226] Updated weights for policy 0, policy_version 93283 (0.0006) [2023-12-27 19:53:59,784][106225] Updated weights for policy 1, policy_version 93171 (0.0007) [2023-12-27 19:53:59,795][106226] Updated weights for policy 0, policy_version 93293 (0.0006) [2023-12-27 19:53:59,855][106225] Updated weights for policy 1, policy_version 93181 (0.0007) [2023-12-27 19:53:59,868][106226] Updated weights for policy 0, policy_version 93303 (0.0007) [2023-12-27 19:53:59,912][106225] Updated weights for policy 1, policy_version 93191 (0.0006) [2023-12-27 19:53:59,922][106226] Updated weights for policy 0, policy_version 93313 (0.0007) [2023-12-27 19:54:00,464][106226] Updated weights for policy 0, policy_version 93323 (0.0006) [2023-12-27 19:54:00,524][106226] Updated weights for policy 0, policy_version 93333 (0.0007) [2023-12-27 19:54:00,571][106225] Updated weights for policy 1, policy_version 93201 (0.0007) [2023-12-27 19:54:00,584][106226] Updated weights for policy 0, policy_version 93343 (0.0008) [2023-12-27 19:54:00,629][106225] Updated weights for policy 1, policy_version 93211 (0.0005) [2023-12-27 19:54:00,678][106225] Updated weights for policy 1, policy_version 93221 (0.0005) [2023-12-27 19:54:00,739][106225] Updated weights for policy 1, policy_version 93231 (0.0006) [2023-12-27 19:54:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 47775744. Throughput: 0: 10022.4, 1: 9923.1. Samples: 47765228. Policy #0 lag: (min: 6.0, avg: 11.4, max: 38.0) [2023-12-27 19:54:01,175][105115] Avg episode reward: [(0, '-5.264'), (1, '-7.054')] [2023-12-27 19:54:01,202][106226] Updated weights for policy 0, policy_version 93353 (0.0008) [2023-12-27 19:54:01,266][106226] Updated weights for policy 0, policy_version 93363 (0.0008) [2023-12-27 19:54:01,332][106226] Updated weights for policy 0, policy_version 93373 (0.0006) [2023-12-27 19:54:01,400][106226] Updated weights for policy 0, policy_version 93383 (0.0010) [2023-12-27 19:54:01,480][106225] Updated weights for policy 1, policy_version 93241 (0.0007) [2023-12-27 19:54:01,546][106225] Updated weights for policy 1, policy_version 93251 (0.0006) [2023-12-27 19:54:01,607][106225] Updated weights for policy 1, policy_version 93261 (0.0006) [2023-12-27 19:54:02,107][106226] Updated weights for policy 0, policy_version 93393 (0.0010) [2023-12-27 19:54:02,171][106226] Updated weights for policy 0, policy_version 93403 (0.0011) [2023-12-27 19:54:02,202][106225] Updated weights for policy 1, policy_version 93271 (0.0010) [2023-12-27 19:54:02,228][106226] Updated weights for policy 0, policy_version 93413 (0.0010) [2023-12-27 19:54:02,257][106225] Updated weights for policy 1, policy_version 93281 (0.0009) [2023-12-27 19:54:02,321][106225] Updated weights for policy 1, policy_version 93291 (0.0009) [2023-12-27 19:54:02,895][106226] Updated weights for policy 0, policy_version 93423 (0.0007) [2023-12-27 19:54:02,944][106226] Updated weights for policy 0, policy_version 93433 (0.0008) [2023-12-27 19:54:02,949][106225] Updated weights for policy 1, policy_version 93301 (0.0008) [2023-12-27 19:54:02,996][106226] Updated weights for policy 0, policy_version 93443 (0.0010) [2023-12-27 19:54:03,007][106225] Updated weights for policy 1, policy_version 93311 (0.0005) [2023-12-27 19:54:03,065][106225] Updated weights for policy 1, policy_version 93321 (0.0005) [2023-12-27 19:54:03,605][106226] Updated weights for policy 0, policy_version 93453 (0.0010) [2023-12-27 19:54:03,638][106225] Updated weights for policy 1, policy_version 93331 (0.0006) [2023-12-27 19:54:03,666][106226] Updated weights for policy 0, policy_version 93463 (0.0011) [2023-12-27 19:54:03,693][106225] Updated weights for policy 1, policy_version 93341 (0.0010) [2023-12-27 19:54:03,722][106226] Updated weights for policy 0, policy_version 93473 (0.0010) [2023-12-27 19:54:03,746][106225] Updated weights for policy 1, policy_version 93351 (0.0010) [2023-12-27 19:54:04,423][106225] Updated weights for policy 1, policy_version 93361 (0.0010) [2023-12-27 19:54:04,465][106226] Updated weights for policy 0, policy_version 93483 (0.0010) [2023-12-27 19:54:04,484][106225] Updated weights for policy 1, policy_version 93371 (0.0010) [2023-12-27 19:54:04,525][106226] Updated weights for policy 0, policy_version 93493 (0.0010) [2023-12-27 19:54:04,544][106225] Updated weights for policy 1, policy_version 93381 (0.0010) [2023-12-27 19:54:04,580][106226] Updated weights for policy 0, policy_version 93503 (0.0010) [2023-12-27 19:54:04,604][106225] Updated weights for policy 1, policy_version 93391 (0.0010) [2023-12-27 19:54:05,303][106226] Updated weights for policy 0, policy_version 93513 (0.0009) [2023-12-27 19:54:05,316][106225] Updated weights for policy 1, policy_version 93401 (0.0006) [2023-12-27 19:54:05,359][106226] Updated weights for policy 0, policy_version 93523 (0.0010) [2023-12-27 19:54:05,367][106225] Updated weights for policy 1, policy_version 93411 (0.0005) [2023-12-27 19:54:05,423][106226] Updated weights for policy 0, policy_version 93533 (0.0011) [2023-12-27 19:54:05,423][106225] Updated weights for policy 1, policy_version 93421 (0.0005) [2023-12-27 19:54:05,480][106226] Updated weights for policy 0, policy_version 93543 (0.0010) [2023-12-27 19:54:05,952][106225] Updated weights for policy 1, policy_version 93431 (0.0006) [2023-12-27 19:54:06,012][106225] Updated weights for policy 1, policy_version 93441 (0.0006) [2023-12-27 19:54:06,073][106225] Updated weights for policy 1, policy_version 93451 (0.0007) [2023-12-27 19:54:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 47882240. Throughput: 0: 10088.4, 1: 9982.4. Samples: 47891400. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:06,175][105115] Avg episode reward: [(0, '-5.156'), (1, '-6.923')] [2023-12-27 19:54:06,177][106226] Updated weights for policy 0, policy_version 93553 (0.0011) [2023-12-27 19:54:06,242][106226] Updated weights for policy 0, policy_version 93563 (0.0011) [2023-12-27 19:54:06,302][106226] Updated weights for policy 0, policy_version 93573 (0.0011) [2023-12-27 19:54:06,722][106225] Updated weights for policy 1, policy_version 93461 (0.0008) [2023-12-27 19:54:06,779][106225] Updated weights for policy 1, policy_version 93471 (0.0008) [2023-12-27 19:54:06,844][106225] Updated weights for policy 1, policy_version 93481 (0.0008) [2023-12-27 19:54:06,973][106226] Updated weights for policy 0, policy_version 93583 (0.0011) [2023-12-27 19:54:07,031][106226] Updated weights for policy 0, policy_version 93593 (0.0011) [2023-12-27 19:54:07,092][106226] Updated weights for policy 0, policy_version 93603 (0.0011) [2023-12-27 19:54:07,632][106225] Updated weights for policy 1, policy_version 93491 (0.0009) [2023-12-27 19:54:07,683][106225] Updated weights for policy 1, policy_version 93501 (0.0009) [2023-12-27 19:54:07,709][106226] Updated weights for policy 0, policy_version 93613 (0.0008) [2023-12-27 19:54:07,736][106225] Updated weights for policy 1, policy_version 93511 (0.0007) [2023-12-27 19:54:07,759][106226] Updated weights for policy 0, policy_version 93623 (0.0005) [2023-12-27 19:54:07,808][106226] Updated weights for policy 0, policy_version 93633 (0.0005) [2023-12-27 19:54:08,387][106225] Updated weights for policy 1, policy_version 93521 (0.0006) [2023-12-27 19:54:08,440][106225] Updated weights for policy 1, policy_version 93531 (0.0008) [2023-12-27 19:54:08,512][106225] Updated weights for policy 1, policy_version 93541 (0.0008) [2023-12-27 19:54:08,513][106226] Updated weights for policy 0, policy_version 93643 (0.0007) [2023-12-27 19:54:08,576][106225] Updated weights for policy 1, policy_version 93551 (0.0007) [2023-12-27 19:54:08,576][106226] Updated weights for policy 0, policy_version 93653 (0.0007) [2023-12-27 19:54:08,642][106226] Updated weights for policy 0, policy_version 93663 (0.0006) [2023-12-27 19:54:09,264][106225] Updated weights for policy 1, policy_version 93561 (0.0006) [2023-12-27 19:54:09,326][106225] Updated weights for policy 1, policy_version 93571 (0.0007) [2023-12-27 19:54:09,336][106226] Updated weights for policy 0, policy_version 93673 (0.0006) [2023-12-27 19:54:09,397][106225] Updated weights for policy 1, policy_version 93581 (0.0008) [2023-12-27 19:54:09,404][106226] Updated weights for policy 0, policy_version 93683 (0.0009) [2023-12-27 19:54:09,473][106226] Updated weights for policy 0, policy_version 93693 (0.0009) [2023-12-27 19:54:09,544][106226] Updated weights for policy 0, policy_version 93703 (0.0009) [2023-12-27 19:54:10,109][106225] Updated weights for policy 1, policy_version 93591 (0.0008) [2023-12-27 19:54:10,170][106225] Updated weights for policy 1, policy_version 93601 (0.0009) [2023-12-27 19:54:10,231][106225] Updated weights for policy 1, policy_version 93611 (0.0009) [2023-12-27 19:54:10,354][106226] Updated weights for policy 0, policy_version 93713 (0.0008) [2023-12-27 19:54:10,412][106226] Updated weights for policy 0, policy_version 93723 (0.0008) [2023-12-27 19:54:10,462][106226] Updated weights for policy 0, policy_version 93733 (0.0009) [2023-12-27 19:54:10,912][106225] Updated weights for policy 1, policy_version 93621 (0.0009) [2023-12-27 19:54:10,966][106225] Updated weights for policy 1, policy_version 93631 (0.0008) [2023-12-27 19:54:11,025][106225] Updated weights for policy 1, policy_version 93641 (0.0010) [2023-12-27 19:54:11,102][106226] Updated weights for policy 0, policy_version 93743 (0.0009) [2023-12-27 19:54:11,174][106226] Updated weights for policy 0, policy_version 93753 (0.0008) [2023-12-27 19:54:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 47980544. Throughput: 0: 10117.1, 1: 10026.9. Samples: 47952856. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:11,176][105115] Avg episode reward: [(0, '-4.678'), (1, '-7.293')] [2023-12-27 19:54:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000093648_23977984.pth... [2023-12-27 19:54:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000092464_23674880.pth [2023-12-27 19:54:11,247][106226] Updated weights for policy 0, policy_version 93763 (0.0007) [2023-12-27 19:54:11,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000093768_24010752.pth... [2023-12-27 19:54:11,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000092584_23707648.pth [2023-12-27 19:54:11,859][106225] Updated weights for policy 1, policy_version 93651 (0.0008) [2023-12-27 19:54:11,926][106225] Updated weights for policy 1, policy_version 93661 (0.0008) [2023-12-27 19:54:11,988][106225] Updated weights for policy 1, policy_version 93671 (0.0008) [2023-12-27 19:54:12,003][106226] Updated weights for policy 0, policy_version 93773 (0.0009) [2023-12-27 19:54:12,064][106226] Updated weights for policy 0, policy_version 93783 (0.0010) [2023-12-27 19:54:12,120][106226] Updated weights for policy 0, policy_version 93793 (0.0008) [2023-12-27 19:54:12,744][106225] Updated weights for policy 1, policy_version 93681 (0.0008) [2023-12-27 19:54:12,806][106225] Updated weights for policy 1, policy_version 93691 (0.0008) [2023-12-27 19:54:12,836][106226] Updated weights for policy 0, policy_version 93803 (0.0009) [2023-12-27 19:54:12,866][106225] Updated weights for policy 1, policy_version 93701 (0.0008) [2023-12-27 19:54:12,902][106226] Updated weights for policy 0, policy_version 93813 (0.0008) [2023-12-27 19:54:12,931][106225] Updated weights for policy 1, policy_version 93711 (0.0006) [2023-12-27 19:54:12,966][106226] Updated weights for policy 0, policy_version 93823 (0.0005) [2023-12-27 19:54:13,606][106225] Updated weights for policy 1, policy_version 93721 (0.0007) [2023-12-27 19:54:13,607][106226] Updated weights for policy 0, policy_version 93833 (0.0006) [2023-12-27 19:54:13,660][106225] Updated weights for policy 1, policy_version 93731 (0.0006) [2023-12-27 19:54:13,670][106226] Updated weights for policy 0, policy_version 93843 (0.0006) [2023-12-27 19:54:13,708][106225] Updated weights for policy 1, policy_version 93741 (0.0005) [2023-12-27 19:54:13,731][106226] Updated weights for policy 0, policy_version 93853 (0.0007) [2023-12-27 19:54:13,790][106226] Updated weights for policy 0, policy_version 93863 (0.0008) [2023-12-27 19:54:14,409][106225] Updated weights for policy 1, policy_version 93751 (0.0008) [2023-12-27 19:54:14,465][106225] Updated weights for policy 1, policy_version 93761 (0.0005) [2023-12-27 19:54:14,523][106225] Updated weights for policy 1, policy_version 93771 (0.0007) [2023-12-27 19:54:14,533][106226] Updated weights for policy 0, policy_version 93873 (0.0008) [2023-12-27 19:54:14,600][106226] Updated weights for policy 0, policy_version 93883 (0.0007) [2023-12-27 19:54:14,665][106226] Updated weights for policy 0, policy_version 93893 (0.0009) [2023-12-27 19:54:15,128][106225] Updated weights for policy 1, policy_version 93781 (0.0007) [2023-12-27 19:54:15,187][106225] Updated weights for policy 1, policy_version 93791 (0.0008) [2023-12-27 19:54:15,250][106225] Updated weights for policy 1, policy_version 93801 (0.0008) [2023-12-27 19:54:15,488][106226] Updated weights for policy 0, policy_version 93903 (0.0009) [2023-12-27 19:54:15,541][106226] Updated weights for policy 0, policy_version 93913 (0.0009) [2023-12-27 19:54:15,594][106226] Updated weights for policy 0, policy_version 93923 (0.0009) [2023-12-27 19:54:15,870][106225] Updated weights for policy 1, policy_version 93811 (0.0008) [2023-12-27 19:54:15,926][106225] Updated weights for policy 1, policy_version 93821 (0.0008) [2023-12-27 19:54:15,975][106225] Updated weights for policy 1, policy_version 93831 (0.0007) [2023-12-27 19:54:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 48078848. Throughput: 0: 10021.5, 1: 9986.7. Samples: 48067144. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:16,175][105115] Avg episode reward: [(0, '-5.037'), (1, '-6.590')] [2023-12-27 19:54:16,303][106226] Updated weights for policy 0, policy_version 93933 (0.0008) [2023-12-27 19:54:16,359][106226] Updated weights for policy 0, policy_version 93943 (0.0009) [2023-12-27 19:54:16,424][106226] Updated weights for policy 0, policy_version 93953 (0.0008) [2023-12-27 19:54:16,651][106225] Updated weights for policy 1, policy_version 93841 (0.0008) [2023-12-27 19:54:16,698][106225] Updated weights for policy 1, policy_version 93851 (0.0005) [2023-12-27 19:54:16,756][106225] Updated weights for policy 1, policy_version 93861 (0.0007) [2023-12-27 19:54:16,818][106225] Updated weights for policy 1, policy_version 93871 (0.0006) [2023-12-27 19:54:17,181][106226] Updated weights for policy 0, policy_version 93963 (0.0009) [2023-12-27 19:54:17,228][106226] Updated weights for policy 0, policy_version 93973 (0.0009) [2023-12-27 19:54:17,277][106226] Updated weights for policy 0, policy_version 93983 (0.0008) [2023-12-27 19:54:17,448][106225] Updated weights for policy 1, policy_version 93881 (0.0008) [2023-12-27 19:54:17,520][106225] Updated weights for policy 1, policy_version 93891 (0.0009) [2023-12-27 19:54:17,586][106225] Updated weights for policy 1, policy_version 93901 (0.0007) [2023-12-27 19:54:18,018][106226] Updated weights for policy 0, policy_version 93993 (0.0008) [2023-12-27 19:54:18,070][106226] Updated weights for policy 0, policy_version 94003 (0.0008) [2023-12-27 19:54:18,126][106226] Updated weights for policy 0, policy_version 94013 (0.0009) [2023-12-27 19:54:18,189][106226] Updated weights for policy 0, policy_version 94023 (0.0006) [2023-12-27 19:54:18,229][106225] Updated weights for policy 1, policy_version 93911 (0.0007) [2023-12-27 19:54:18,290][106225] Updated weights for policy 1, policy_version 93921 (0.0009) [2023-12-27 19:54:18,348][106225] Updated weights for policy 1, policy_version 93931 (0.0008) [2023-12-27 19:54:18,925][106226] Updated weights for policy 0, policy_version 94033 (0.0007) [2023-12-27 19:54:18,981][106226] Updated weights for policy 0, policy_version 94043 (0.0008) [2023-12-27 19:54:18,998][106225] Updated weights for policy 1, policy_version 93941 (0.0006) [2023-12-27 19:54:19,044][106226] Updated weights for policy 0, policy_version 94053 (0.0006) [2023-12-27 19:54:19,053][106225] Updated weights for policy 1, policy_version 93951 (0.0008) [2023-12-27 19:54:19,102][106225] Updated weights for policy 1, policy_version 93961 (0.0008) [2023-12-27 19:54:19,757][106226] Updated weights for policy 0, policy_version 94063 (0.0008) [2023-12-27 19:54:19,825][106226] Updated weights for policy 0, policy_version 94073 (0.0009) [2023-12-27 19:54:19,885][106226] Updated weights for policy 0, policy_version 94083 (0.0009) [2023-12-27 19:54:19,925][106225] Updated weights for policy 1, policy_version 93971 (0.0008) [2023-12-27 19:54:19,987][106225] Updated weights for policy 1, policy_version 93981 (0.0008) [2023-12-27 19:54:20,047][106225] Updated weights for policy 1, policy_version 93991 (0.0008) [2023-12-27 19:54:20,669][106226] Updated weights for policy 0, policy_version 94093 (0.0008) [2023-12-27 19:54:20,721][106226] Updated weights for policy 0, policy_version 94103 (0.0008) [2023-12-27 19:54:20,775][106226] Updated weights for policy 0, policy_version 94113 (0.0008) [2023-12-27 19:54:20,788][106225] Updated weights for policy 1, policy_version 94001 (0.0008) [2023-12-27 19:54:20,859][106225] Updated weights for policy 1, policy_version 94011 (0.0006) [2023-12-27 19:54:20,921][106225] Updated weights for policy 1, policy_version 94021 (0.0010) [2023-12-27 19:54:20,984][106225] Updated weights for policy 1, policy_version 94031 (0.0009) [2023-12-27 19:54:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 48177152. Throughput: 0: 9950.2, 1: 9967.6. Samples: 48184872. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:21,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-6.741')] [2023-12-27 19:54:21,546][106226] Updated weights for policy 0, policy_version 94123 (0.0007) [2023-12-27 19:54:21,614][106226] Updated weights for policy 0, policy_version 94133 (0.0007) [2023-12-27 19:54:21,686][106226] Updated weights for policy 0, policy_version 94143 (0.0012) [2023-12-27 19:54:21,715][106225] Updated weights for policy 1, policy_version 94041 (0.0007) [2023-12-27 19:54:21,783][106225] Updated weights for policy 1, policy_version 94051 (0.0008) [2023-12-27 19:54:21,831][106225] Updated weights for policy 1, policy_version 94061 (0.0007) [2023-12-27 19:54:22,450][106226] Updated weights for policy 0, policy_version 94153 (0.0010) [2023-12-27 19:54:22,513][106226] Updated weights for policy 0, policy_version 94163 (0.0009) [2023-12-27 19:54:22,540][106225] Updated weights for policy 1, policy_version 94071 (0.0007) [2023-12-27 19:54:22,566][106226] Updated weights for policy 0, policy_version 94173 (0.0007) [2023-12-27 19:54:22,600][106225] Updated weights for policy 1, policy_version 94081 (0.0009) [2023-12-27 19:54:22,634][106226] Updated weights for policy 0, policy_version 94183 (0.0006) [2023-12-27 19:54:22,654][106225] Updated weights for policy 1, policy_version 94091 (0.0007) [2023-12-27 19:54:23,290][106226] Updated weights for policy 0, policy_version 94193 (0.0006) [2023-12-27 19:54:23,348][106226] Updated weights for policy 0, policy_version 94203 (0.0009) [2023-12-27 19:54:23,402][106226] Updated weights for policy 0, policy_version 94213 (0.0009) [2023-12-27 19:54:23,441][106225] Updated weights for policy 1, policy_version 94101 (0.0008) [2023-12-27 19:54:23,497][106225] Updated weights for policy 1, policy_version 94111 (0.0009) [2023-12-27 19:54:23,552][106225] Updated weights for policy 1, policy_version 94121 (0.0008) [2023-12-27 19:54:24,037][106226] Updated weights for policy 0, policy_version 94223 (0.0006) [2023-12-27 19:54:24,084][106226] Updated weights for policy 0, policy_version 94233 (0.0005) [2023-12-27 19:54:24,140][106226] Updated weights for policy 0, policy_version 94243 (0.0008) [2023-12-27 19:54:24,314][106225] Updated weights for policy 1, policy_version 94131 (0.0007) [2023-12-27 19:54:24,369][106225] Updated weights for policy 1, policy_version 94141 (0.0009) [2023-12-27 19:54:24,414][106225] Updated weights for policy 1, policy_version 94151 (0.0008) [2023-12-27 19:54:24,815][106226] Updated weights for policy 0, policy_version 94253 (0.0007) [2023-12-27 19:54:24,869][106226] Updated weights for policy 0, policy_version 94263 (0.0005) [2023-12-27 19:54:24,936][106226] Updated weights for policy 0, policy_version 94273 (0.0005) [2023-12-27 19:54:25,194][106225] Updated weights for policy 1, policy_version 94161 (0.0008) [2023-12-27 19:54:25,256][106225] Updated weights for policy 1, policy_version 94171 (0.0009) [2023-12-27 19:54:25,330][106225] Updated weights for policy 1, policy_version 94181 (0.0010) [2023-12-27 19:54:25,378][106225] Updated weights for policy 1, policy_version 94191 (0.0007) [2023-12-27 19:54:25,443][106226] Updated weights for policy 0, policy_version 94283 (0.0006) [2023-12-27 19:54:25,497][106226] Updated weights for policy 0, policy_version 94293 (0.0007) [2023-12-27 19:54:25,552][106226] Updated weights for policy 0, policy_version 94303 (0.0008) [2023-12-27 19:54:26,108][106225] Updated weights for policy 1, policy_version 94201 (0.0008) [2023-12-27 19:54:26,165][106225] Updated weights for policy 1, policy_version 94211 (0.0010) [2023-12-27 19:54:26,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 48267264. Throughput: 0: 9964.8, 1: 9947.2. Samples: 48242944. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:26,175][105115] Avg episode reward: [(0, '-5.158'), (1, '-6.509')] [2023-12-27 19:54:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000094312_24150016.pth... [2023-12-27 19:54:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000093160_23855104.pth [2023-12-27 19:54:26,200][106226] Updated weights for policy 0, policy_version 94313 (0.0007) [2023-12-27 19:54:26,229][106225] Updated weights for policy 1, policy_version 94221 (0.0010) [2023-12-27 19:54:26,243][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000094224_24125440.pth... [2023-12-27 19:54:26,246][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000093040_23822336.pth [2023-12-27 19:54:26,259][106226] Updated weights for policy 0, policy_version 94323 (0.0006) [2023-12-27 19:54:26,317][106226] Updated weights for policy 0, policy_version 94333 (0.0008) [2023-12-27 19:54:26,366][106226] Updated weights for policy 0, policy_version 94343 (0.0007) [2023-12-27 19:54:26,904][106225] Updated weights for policy 1, policy_version 94231 (0.0010) [2023-12-27 19:54:26,953][106225] Updated weights for policy 1, policy_version 94241 (0.0010) [2023-12-27 19:54:27,008][106225] Updated weights for policy 1, policy_version 94251 (0.0010) [2023-12-27 19:54:27,098][106226] Updated weights for policy 0, policy_version 94353 (0.0008) [2023-12-27 19:54:27,151][106226] Updated weights for policy 0, policy_version 94363 (0.0007) [2023-12-27 19:54:27,204][106226] Updated weights for policy 0, policy_version 94373 (0.0008) [2023-12-27 19:54:27,731][106225] Updated weights for policy 1, policy_version 94261 (0.0010) [2023-12-27 19:54:27,793][106225] Updated weights for policy 1, policy_version 94271 (0.0008) [2023-12-27 19:54:27,852][106225] Updated weights for policy 1, policy_version 94281 (0.0009) [2023-12-27 19:54:27,857][106226] Updated weights for policy 0, policy_version 94383 (0.0007) [2023-12-27 19:54:27,919][106226] Updated weights for policy 0, policy_version 94393 (0.0006) [2023-12-27 19:54:27,976][106226] Updated weights for policy 0, policy_version 94403 (0.0007) [2023-12-27 19:54:28,582][106225] Updated weights for policy 1, policy_version 94291 (0.0010) [2023-12-27 19:54:28,641][106225] Updated weights for policy 1, policy_version 94301 (0.0008) [2023-12-27 19:54:28,676][106226] Updated weights for policy 0, policy_version 94413 (0.0007) [2023-12-27 19:54:28,702][106225] Updated weights for policy 1, policy_version 94311 (0.0008) [2023-12-27 19:54:28,739][106226] Updated weights for policy 0, policy_version 94423 (0.0006) [2023-12-27 19:54:28,801][106226] Updated weights for policy 0, policy_version 94433 (0.0008) [2023-12-27 19:54:29,448][106225] Updated weights for policy 1, policy_version 94321 (0.0006) [2023-12-27 19:54:29,509][106225] Updated weights for policy 1, policy_version 94331 (0.0008) [2023-12-27 19:54:29,567][106225] Updated weights for policy 1, policy_version 94341 (0.0007) [2023-12-27 19:54:29,568][106226] Updated weights for policy 0, policy_version 94443 (0.0008) [2023-12-27 19:54:29,620][106226] Updated weights for policy 0, policy_version 94453 (0.0008) [2023-12-27 19:54:29,629][106225] Updated weights for policy 1, policy_version 94351 (0.0007) [2023-12-27 19:54:29,673][106226] Updated weights for policy 0, policy_version 94463 (0.0007) [2023-12-27 19:54:30,369][106225] Updated weights for policy 1, policy_version 94361 (0.0009) [2023-12-27 19:54:30,423][106225] Updated weights for policy 1, policy_version 94371 (0.0008) [2023-12-27 19:54:30,424][106226] Updated weights for policy 0, policy_version 94473 (0.0006) [2023-12-27 19:54:30,481][106225] Updated weights for policy 1, policy_version 94381 (0.0006) [2023-12-27 19:54:30,483][106226] Updated weights for policy 0, policy_version 94483 (0.0008) [2023-12-27 19:54:30,539][106226] Updated weights for policy 0, policy_version 94493 (0.0009) [2023-12-27 19:54:30,593][106226] Updated weights for policy 0, policy_version 94503 (0.0009) [2023-12-27 19:54:31,023][106225] Updated weights for policy 1, policy_version 94391 (0.0007) [2023-12-27 19:54:31,083][106225] Updated weights for policy 1, policy_version 94401 (0.0009) [2023-12-27 19:54:31,137][106225] Updated weights for policy 1, policy_version 94411 (0.0008) [2023-12-27 19:54:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 48373760. Throughput: 0: 9967.6, 1: 9930.1. Samples: 48361308. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:31,175][105115] Avg episode reward: [(0, '-5.019'), (1, '-6.873')] [2023-12-27 19:54:31,405][106226] Updated weights for policy 0, policy_version 94513 (0.0009) [2023-12-27 19:54:31,468][106226] Updated weights for policy 0, policy_version 94523 (0.0008) [2023-12-27 19:54:31,532][106226] Updated weights for policy 0, policy_version 94533 (0.0009) [2023-12-27 19:54:31,859][106225] Updated weights for policy 1, policy_version 94421 (0.0008) [2023-12-27 19:54:31,916][106225] Updated weights for policy 1, policy_version 94431 (0.0008) [2023-12-27 19:54:31,976][106225] Updated weights for policy 1, policy_version 94441 (0.0008) [2023-12-27 19:54:32,285][106226] Updated weights for policy 0, policy_version 94543 (0.0010) [2023-12-27 19:54:32,348][106226] Updated weights for policy 0, policy_version 94553 (0.0009) [2023-12-27 19:54:32,412][106226] Updated weights for policy 0, policy_version 94563 (0.0009) [2023-12-27 19:54:32,698][106225] Updated weights for policy 1, policy_version 94451 (0.0008) [2023-12-27 19:54:32,757][106225] Updated weights for policy 1, policy_version 94461 (0.0008) [2023-12-27 19:54:32,816][106225] Updated weights for policy 1, policy_version 94471 (0.0009) [2023-12-27 19:54:33,082][106226] Updated weights for policy 0, policy_version 94573 (0.0010) [2023-12-27 19:54:33,138][106226] Updated weights for policy 0, policy_version 94583 (0.0010) [2023-12-27 19:54:33,193][106226] Updated weights for policy 0, policy_version 94593 (0.0010) [2023-12-27 19:54:33,585][106225] Updated weights for policy 1, policy_version 94481 (0.0009) [2023-12-27 19:54:33,645][106225] Updated weights for policy 1, policy_version 94491 (0.0007) [2023-12-27 19:54:33,706][106225] Updated weights for policy 1, policy_version 94501 (0.0009) [2023-12-27 19:54:33,751][106226] Updated weights for policy 0, policy_version 94603 (0.0010) [2023-12-27 19:54:33,752][106225] Updated weights for policy 1, policy_version 94511 (0.0007) [2023-12-27 19:54:33,811][106226] Updated weights for policy 0, policy_version 94613 (0.0008) [2023-12-27 19:54:33,875][106226] Updated weights for policy 0, policy_version 94623 (0.0006) [2023-12-27 19:54:34,431][106226] Updated weights for policy 0, policy_version 94633 (0.0005) [2023-12-27 19:54:34,493][106226] Updated weights for policy 0, policy_version 94643 (0.0006) [2023-12-27 19:54:34,554][106226] Updated weights for policy 0, policy_version 94653 (0.0006) [2023-12-27 19:54:34,584][106225] Updated weights for policy 1, policy_version 94521 (0.0009) [2023-12-27 19:54:34,610][106226] Updated weights for policy 0, policy_version 94663 (0.0006) [2023-12-27 19:54:34,640][106225] Updated weights for policy 1, policy_version 94531 (0.0007) [2023-12-27 19:54:34,700][106225] Updated weights for policy 1, policy_version 94541 (0.0009) [2023-12-27 19:54:35,212][106226] Updated weights for policy 0, policy_version 94673 (0.0006) [2023-12-27 19:54:35,272][106226] Updated weights for policy 0, policy_version 94683 (0.0006) [2023-12-27 19:54:35,326][106225] Updated weights for policy 1, policy_version 94551 (0.0006) [2023-12-27 19:54:35,338][106226] Updated weights for policy 0, policy_version 94693 (0.0007) [2023-12-27 19:54:35,390][106225] Updated weights for policy 1, policy_version 94561 (0.0005) [2023-12-27 19:54:35,460][106225] Updated weights for policy 1, policy_version 94571 (0.0005) [2023-12-27 19:54:35,998][106225] Updated weights for policy 1, policy_version 94581 (0.0007) [2023-12-27 19:54:36,035][106226] Updated weights for policy 0, policy_version 94703 (0.0007) [2023-12-27 19:54:36,058][106225] Updated weights for policy 1, policy_version 94591 (0.0008) [2023-12-27 19:54:36,092][106226] Updated weights for policy 0, policy_version 94713 (0.0007) [2023-12-27 19:54:36,119][106225] Updated weights for policy 1, policy_version 94601 (0.0007) [2023-12-27 19:54:36,159][106226] Updated weights for policy 0, policy_version 94723 (0.0007) [2023-12-27 19:54:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 48472064. Throughput: 0: 9902.8, 1: 9925.2. Samples: 48482444. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:36,175][105115] Avg episode reward: [(0, '-5.411'), (1, '-6.601')] [2023-12-27 19:54:36,847][106225] Updated weights for policy 1, policy_version 94611 (0.0006) [2023-12-27 19:54:36,874][106226] Updated weights for policy 0, policy_version 94733 (0.0007) [2023-12-27 19:54:36,916][106225] Updated weights for policy 1, policy_version 94621 (0.0006) [2023-12-27 19:54:36,934][106226] Updated weights for policy 0, policy_version 94743 (0.0005) [2023-12-27 19:54:36,979][106225] Updated weights for policy 1, policy_version 94631 (0.0005) [2023-12-27 19:54:36,999][106226] Updated weights for policy 0, policy_version 94753 (0.0006) [2023-12-27 19:54:37,587][106225] Updated weights for policy 1, policy_version 94641 (0.0006) [2023-12-27 19:54:37,620][106226] Updated weights for policy 0, policy_version 94763 (0.0006) [2023-12-27 19:54:37,641][106225] Updated weights for policy 1, policy_version 94651 (0.0010) [2023-12-27 19:54:37,678][106226] Updated weights for policy 0, policy_version 94773 (0.0006) [2023-12-27 19:54:37,695][106225] Updated weights for policy 1, policy_version 94661 (0.0010) [2023-12-27 19:54:37,740][106226] Updated weights for policy 0, policy_version 94783 (0.0006) [2023-12-27 19:54:37,754][106225] Updated weights for policy 1, policy_version 94671 (0.0010) [2023-12-27 19:54:38,408][106225] Updated weights for policy 1, policy_version 94681 (0.0008) [2023-12-27 19:54:38,447][106226] Updated weights for policy 0, policy_version 94793 (0.0008) [2023-12-27 19:54:38,464][106225] Updated weights for policy 1, policy_version 94691 (0.0008) [2023-12-27 19:54:38,509][106226] Updated weights for policy 0, policy_version 94803 (0.0011) [2023-12-27 19:54:38,526][106225] Updated weights for policy 1, policy_version 94701 (0.0008) [2023-12-27 19:54:38,563][106226] Updated weights for policy 0, policy_version 94813 (0.0010) [2023-12-27 19:54:38,613][106226] Updated weights for policy 0, policy_version 94823 (0.0010) [2023-12-27 19:54:39,226][106225] Updated weights for policy 1, policy_version 94711 (0.0008) [2023-12-27 19:54:39,292][106225] Updated weights for policy 1, policy_version 94721 (0.0009) [2023-12-27 19:54:39,358][106225] Updated weights for policy 1, policy_version 94731 (0.0009) [2023-12-27 19:54:39,360][106226] Updated weights for policy 0, policy_version 94833 (0.0010) [2023-12-27 19:54:39,427][106226] Updated weights for policy 0, policy_version 94843 (0.0008) [2023-12-27 19:54:39,486][106226] Updated weights for policy 0, policy_version 94853 (0.0011) [2023-12-27 19:54:40,092][106225] Updated weights for policy 1, policy_version 94741 (0.0009) [2023-12-27 19:54:40,168][106225] Updated weights for policy 1, policy_version 94751 (0.0011) [2023-12-27 19:54:40,216][106226] Updated weights for policy 0, policy_version 94863 (0.0008) [2023-12-27 19:54:40,233][106225] Updated weights for policy 1, policy_version 94761 (0.0010) [2023-12-27 19:54:40,276][106226] Updated weights for policy 0, policy_version 94873 (0.0008) [2023-12-27 19:54:40,336][106226] Updated weights for policy 0, policy_version 94883 (0.0008) [2023-12-27 19:54:40,906][106225] Updated weights for policy 1, policy_version 94771 (0.0009) [2023-12-27 19:54:40,962][106225] Updated weights for policy 1, policy_version 94781 (0.0006) [2023-12-27 19:54:41,028][106225] Updated weights for policy 1, policy_version 94791 (0.0006) [2023-12-27 19:54:41,134][106226] Updated weights for policy 0, policy_version 94893 (0.0009) [2023-12-27 19:54:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 48570368. Throughput: 0: 9914.8, 1: 9970.1. Samples: 48543108. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:41,176][105115] Avg episode reward: [(0, '-5.035'), (1, '-7.034')] [2023-12-27 19:54:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000094800_24272896.pth... [2023-12-27 19:54:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000093648_23977984.pth [2023-12-27 19:54:41,192][106226] Updated weights for policy 0, policy_version 94903 (0.0009) [2023-12-27 19:54:41,252][106226] Updated weights for policy 0, policy_version 94913 (0.0008) [2023-12-27 19:54:41,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000094920_24305664.pth... [2023-12-27 19:54:41,302][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000093768_24010752.pth [2023-12-27 19:54:41,837][106225] Updated weights for policy 1, policy_version 94801 (0.0010) [2023-12-27 19:54:41,901][106225] Updated weights for policy 1, policy_version 94811 (0.0009) [2023-12-27 19:54:41,951][106225] Updated weights for policy 1, policy_version 94821 (0.0008) [2023-12-27 19:54:41,991][106226] Updated weights for policy 0, policy_version 94923 (0.0007) [2023-12-27 19:54:42,007][106225] Updated weights for policy 1, policy_version 94831 (0.0008) [2023-12-27 19:54:42,050][106226] Updated weights for policy 0, policy_version 94933 (0.0009) [2023-12-27 19:54:42,098][106226] Updated weights for policy 0, policy_version 94943 (0.0009) [2023-12-27 19:54:42,789][106225] Updated weights for policy 1, policy_version 94841 (0.0008) [2023-12-27 19:54:42,850][106225] Updated weights for policy 1, policy_version 94851 (0.0010) [2023-12-27 19:54:42,881][106226] Updated weights for policy 0, policy_version 94953 (0.0009) [2023-12-27 19:54:42,915][106225] Updated weights for policy 1, policy_version 94861 (0.0006) [2023-12-27 19:54:42,941][106226] Updated weights for policy 0, policy_version 94963 (0.0008) [2023-12-27 19:54:42,990][106226] Updated weights for policy 0, policy_version 94973 (0.0008) [2023-12-27 19:54:43,040][106226] Updated weights for policy 0, policy_version 94983 (0.0008) [2023-12-27 19:54:43,615][106225] Updated weights for policy 1, policy_version 94871 (0.0006) [2023-12-27 19:54:43,681][106225] Updated weights for policy 1, policy_version 94881 (0.0005) [2023-12-27 19:54:43,733][106225] Updated weights for policy 1, policy_version 94891 (0.0005) [2023-12-27 19:54:43,750][106226] Updated weights for policy 0, policy_version 94993 (0.0010) [2023-12-27 19:54:43,803][106226] Updated weights for policy 0, policy_version 95003 (0.0010) [2023-12-27 19:54:43,856][106226] Updated weights for policy 0, policy_version 95013 (0.0010) [2023-12-27 19:54:44,319][106225] Updated weights for policy 1, policy_version 94901 (0.0005) [2023-12-27 19:54:44,381][106225] Updated weights for policy 1, policy_version 94911 (0.0005) [2023-12-27 19:54:44,442][106225] Updated weights for policy 1, policy_version 94921 (0.0009) [2023-12-27 19:54:44,568][106226] Updated weights for policy 0, policy_version 95023 (0.0010) [2023-12-27 19:54:44,618][106226] Updated weights for policy 0, policy_version 95033 (0.0010) [2023-12-27 19:54:44,670][106226] Updated weights for policy 0, policy_version 95043 (0.0010) [2023-12-27 19:54:45,086][106225] Updated weights for policy 1, policy_version 94931 (0.0009) [2023-12-27 19:54:45,147][106225] Updated weights for policy 1, policy_version 94941 (0.0010) [2023-12-27 19:54:45,212][106225] Updated weights for policy 1, policy_version 94951 (0.0010) [2023-12-27 19:54:45,371][106226] Updated weights for policy 0, policy_version 95053 (0.0008) [2023-12-27 19:54:45,425][106226] Updated weights for policy 0, policy_version 95063 (0.0005) [2023-12-27 19:54:45,481][106226] Updated weights for policy 0, policy_version 95073 (0.0005) [2023-12-27 19:54:45,922][106225] Updated weights for policy 1, policy_version 94961 (0.0010) [2023-12-27 19:54:45,979][106225] Updated weights for policy 1, policy_version 94971 (0.0010) [2023-12-27 19:54:46,030][106225] Updated weights for policy 1, policy_version 94981 (0.0010) [2023-12-27 19:54:46,051][106226] Updated weights for policy 0, policy_version 95083 (0.0005) [2023-12-27 19:54:46,079][106225] Updated weights for policy 1, policy_version 94991 (0.0010) [2023-12-27 19:54:46,105][106226] Updated weights for policy 0, policy_version 95093 (0.0006) [2023-12-27 19:54:46,166][106226] Updated weights for policy 0, policy_version 95103 (0.0008) [2023-12-27 19:54:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 48668672. Throughput: 0: 9873.7, 1: 9968.3. Samples: 48658116. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:46,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-6.885')] [2023-12-27 19:54:46,781][106226] Updated weights for policy 0, policy_version 95113 (0.0009) [2023-12-27 19:54:46,803][106225] Updated weights for policy 1, policy_version 95001 (0.0010) [2023-12-27 19:54:46,839][106226] Updated weights for policy 0, policy_version 95123 (0.0007) [2023-12-27 19:54:46,856][106225] Updated weights for policy 1, policy_version 95011 (0.0010) [2023-12-27 19:54:46,900][106226] Updated weights for policy 0, policy_version 95133 (0.0005) [2023-12-27 19:54:46,905][106225] Updated weights for policy 1, policy_version 95021 (0.0010) [2023-12-27 19:54:46,955][106226] Updated weights for policy 0, policy_version 95143 (0.0007) [2023-12-27 19:54:47,636][106225] Updated weights for policy 1, policy_version 95031 (0.0010) [2023-12-27 19:54:47,643][106226] Updated weights for policy 0, policy_version 95153 (0.0009) [2023-12-27 19:54:47,690][106225] Updated weights for policy 1, policy_version 95041 (0.0010) [2023-12-27 19:54:47,704][106226] Updated weights for policy 0, policy_version 95163 (0.0006) [2023-12-27 19:54:47,737][106225] Updated weights for policy 1, policy_version 95051 (0.0008) [2023-12-27 19:54:47,761][106226] Updated weights for policy 0, policy_version 95173 (0.0007) [2023-12-27 19:54:48,291][106225] Updated weights for policy 1, policy_version 95061 (0.0006) [2023-12-27 19:54:48,358][106225] Updated weights for policy 1, policy_version 95071 (0.0007) [2023-12-27 19:54:48,395][106226] Updated weights for policy 0, policy_version 95183 (0.0007) [2023-12-27 19:54:48,417][106225] Updated weights for policy 1, policy_version 95081 (0.0009) [2023-12-27 19:54:48,458][106226] Updated weights for policy 0, policy_version 95193 (0.0007) [2023-12-27 19:54:48,522][106226] Updated weights for policy 0, policy_version 95203 (0.0010) [2023-12-27 19:54:49,047][106225] Updated weights for policy 1, policy_version 95091 (0.0007) [2023-12-27 19:54:49,106][106225] Updated weights for policy 1, policy_version 95101 (0.0008) [2023-12-27 19:54:49,170][106225] Updated weights for policy 1, policy_version 95111 (0.0010) [2023-12-27 19:54:49,236][106226] Updated weights for policy 0, policy_version 95213 (0.0008) [2023-12-27 19:54:49,301][106226] Updated weights for policy 0, policy_version 95223 (0.0008) [2023-12-27 19:54:49,363][106226] Updated weights for policy 0, policy_version 95233 (0.0008) [2023-12-27 19:54:49,895][106225] Updated weights for policy 1, policy_version 95121 (0.0009) [2023-12-27 19:54:49,964][106225] Updated weights for policy 1, policy_version 95131 (0.0009) [2023-12-27 19:54:50,026][106225] Updated weights for policy 1, policy_version 95141 (0.0008) [2023-12-27 19:54:50,087][106225] Updated weights for policy 1, policy_version 95151 (0.0008) [2023-12-27 19:54:50,135][106226] Updated weights for policy 0, policy_version 95243 (0.0008) [2023-12-27 19:54:50,201][106226] Updated weights for policy 0, policy_version 95253 (0.0008) [2023-12-27 19:54:50,269][106226] Updated weights for policy 0, policy_version 95263 (0.0009) [2023-12-27 19:54:50,860][106225] Updated weights for policy 1, policy_version 95161 (0.0007) [2023-12-27 19:54:50,922][106225] Updated weights for policy 1, policy_version 95171 (0.0006) [2023-12-27 19:54:50,932][106226] Updated weights for policy 0, policy_version 95273 (0.0009) [2023-12-27 19:54:50,978][106225] Updated weights for policy 1, policy_version 95181 (0.0006) [2023-12-27 19:54:50,995][106226] Updated weights for policy 0, policy_version 95283 (0.0009) [2023-12-27 19:54:51,061][106226] Updated weights for policy 0, policy_version 95293 (0.0008) [2023-12-27 19:54:51,126][106226] Updated weights for policy 0, policy_version 95303 (0.0009) [2023-12-27 19:54:51,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 48775168. Throughput: 0: 9856.1, 1: 9872.8. Samples: 48779200. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:51,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-6.443')] [2023-12-27 19:54:51,753][106225] Updated weights for policy 1, policy_version 95191 (0.0009) [2023-12-27 19:54:51,813][106225] Updated weights for policy 1, policy_version 95201 (0.0011) [2023-12-27 19:54:51,850][106226] Updated weights for policy 0, policy_version 95313 (0.0006) [2023-12-27 19:54:51,874][106225] Updated weights for policy 1, policy_version 95211 (0.0008) [2023-12-27 19:54:51,917][106226] Updated weights for policy 0, policy_version 95323 (0.0008) [2023-12-27 19:54:51,967][106226] Updated weights for policy 0, policy_version 95333 (0.0008) [2023-12-27 19:54:52,565][106225] Updated weights for policy 1, policy_version 95221 (0.0007) [2023-12-27 19:54:52,621][106225] Updated weights for policy 1, policy_version 95231 (0.0009) [2023-12-27 19:54:52,685][106225] Updated weights for policy 1, policy_version 95241 (0.0006) [2023-12-27 19:54:52,740][106226] Updated weights for policy 0, policy_version 95343 (0.0008) [2023-12-27 19:54:52,797][106226] Updated weights for policy 0, policy_version 95353 (0.0009) [2023-12-27 19:54:52,854][106226] Updated weights for policy 0, policy_version 95363 (0.0009) [2023-12-27 19:54:53,270][106225] Updated weights for policy 1, policy_version 95251 (0.0006) [2023-12-27 19:54:53,337][106225] Updated weights for policy 1, policy_version 95261 (0.0005) [2023-12-27 19:54:53,401][106225] Updated weights for policy 1, policy_version 95271 (0.0007) [2023-12-27 19:54:53,622][106226] Updated weights for policy 0, policy_version 95373 (0.0009) [2023-12-27 19:54:53,680][106226] Updated weights for policy 0, policy_version 95383 (0.0009) [2023-12-27 19:54:53,747][106226] Updated weights for policy 0, policy_version 95393 (0.0005) [2023-12-27 19:54:53,919][106225] Updated weights for policy 1, policy_version 95281 (0.0007) [2023-12-27 19:54:53,981][106225] Updated weights for policy 1, policy_version 95291 (0.0006) [2023-12-27 19:54:54,032][106225] Updated weights for policy 1, policy_version 95301 (0.0006) [2023-12-27 19:54:54,086][106225] Updated weights for policy 1, policy_version 95311 (0.0010) [2023-12-27 19:54:54,300][106226] Updated weights for policy 0, policy_version 95403 (0.0007) [2023-12-27 19:54:54,354][106226] Updated weights for policy 0, policy_version 95413 (0.0006) [2023-12-27 19:54:54,417][106226] Updated weights for policy 0, policy_version 95423 (0.0005) [2023-12-27 19:54:54,655][106225] Updated weights for policy 1, policy_version 95321 (0.0010) [2023-12-27 19:54:54,709][106225] Updated weights for policy 1, policy_version 95331 (0.0010) [2023-12-27 19:54:54,765][106225] Updated weights for policy 1, policy_version 95341 (0.0010) [2023-12-27 19:54:55,094][106226] Updated weights for policy 0, policy_version 95433 (0.0007) [2023-12-27 19:54:55,153][106226] Updated weights for policy 0, policy_version 95443 (0.0005) [2023-12-27 19:54:55,214][106226] Updated weights for policy 0, policy_version 95453 (0.0006) [2023-12-27 19:54:55,265][106226] Updated weights for policy 0, policy_version 95463 (0.0006) [2023-12-27 19:54:55,408][106225] Updated weights for policy 1, policy_version 95351 (0.0008) [2023-12-27 19:54:55,451][106225] Updated weights for policy 1, policy_version 95361 (0.0008) [2023-12-27 19:54:55,498][106225] Updated weights for policy 1, policy_version 95371 (0.0008) [2023-12-27 19:54:55,898][106226] Updated weights for policy 0, policy_version 95473 (0.0005) [2023-12-27 19:54:55,960][106226] Updated weights for policy 0, policy_version 95483 (0.0009) [2023-12-27 19:54:56,019][106226] Updated weights for policy 0, policy_version 95493 (0.0006) [2023-12-27 19:54:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 48873472. Throughput: 0: 9808.2, 1: 9894.2. Samples: 48839464. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:54:56,175][105115] Avg episode reward: [(0, '-5.180'), (1, '-6.632')] [2023-12-27 19:54:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000095496_24453120.pth... [2023-12-27 19:54:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000094312_24150016.pth [2023-12-27 19:54:56,215][106225] Updated weights for policy 1, policy_version 95381 (0.0006) [2023-12-27 19:54:56,277][106225] Updated weights for policy 1, policy_version 95391 (0.0005) [2023-12-27 19:54:56,335][106225] Updated weights for policy 1, policy_version 95401 (0.0007) [2023-12-27 19:54:56,370][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000095408_24428544.pth... [2023-12-27 19:54:56,373][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000094224_24125440.pth [2023-12-27 19:54:56,656][106226] Updated weights for policy 0, policy_version 95503 (0.0008) [2023-12-27 19:54:56,711][106226] Updated weights for policy 0, policy_version 95513 (0.0009) [2023-12-27 19:54:56,770][106226] Updated weights for policy 0, policy_version 95523 (0.0008) [2023-12-27 19:54:57,012][106225] Updated weights for policy 1, policy_version 95411 (0.0007) [2023-12-27 19:54:57,065][106225] Updated weights for policy 1, policy_version 95421 (0.0006) [2023-12-27 19:54:57,114][106225] Updated weights for policy 1, policy_version 95431 (0.0006) [2023-12-27 19:54:57,422][106226] Updated weights for policy 0, policy_version 95533 (0.0007) [2023-12-27 19:54:57,480][106226] Updated weights for policy 0, policy_version 95543 (0.0007) [2023-12-27 19:54:57,528][106226] Updated weights for policy 0, policy_version 95553 (0.0008) [2023-12-27 19:54:57,715][106225] Updated weights for policy 1, policy_version 95441 (0.0008) [2023-12-27 19:54:57,765][106225] Updated weights for policy 1, policy_version 95451 (0.0005) [2023-12-27 19:54:57,816][106225] Updated weights for policy 1, policy_version 95461 (0.0005) [2023-12-27 19:54:57,863][106225] Updated weights for policy 1, policy_version 95471 (0.0005) [2023-12-27 19:54:58,310][106226] Updated weights for policy 0, policy_version 95563 (0.0008) [2023-12-27 19:54:58,377][106226] Updated weights for policy 0, policy_version 95573 (0.0008) [2023-12-27 19:54:58,442][106226] Updated weights for policy 0, policy_version 95583 (0.0008) [2023-12-27 19:54:58,563][106225] Updated weights for policy 1, policy_version 95481 (0.0010) [2023-12-27 19:54:58,634][106225] Updated weights for policy 1, policy_version 95492 (0.0011) [2023-12-27 19:54:58,700][106225] Updated weights for policy 1, policy_version 95502 (0.0008) [2023-12-27 19:54:59,290][106226] Updated weights for policy 0, policy_version 95593 (0.0008) [2023-12-27 19:54:59,360][106226] Updated weights for policy 0, policy_version 95603 (0.0009) [2023-12-27 19:54:59,429][106226] Updated weights for policy 0, policy_version 95613 (0.0009) [2023-12-27 19:54:59,494][106226] Updated weights for policy 0, policy_version 95623 (0.0011) [2023-12-27 19:54:59,567][106225] Updated weights for policy 1, policy_version 95512 (0.0008) [2023-12-27 19:54:59,625][106225] Updated weights for policy 1, policy_version 95522 (0.0008) [2023-12-27 19:54:59,681][106225] Updated weights for policy 1, policy_version 95532 (0.0006) [2023-12-27 19:55:00,209][106226] Updated weights for policy 0, policy_version 95633 (0.0008) [2023-12-27 19:55:00,266][106226] Updated weights for policy 0, policy_version 95643 (0.0008) [2023-12-27 19:55:00,325][106226] Updated weights for policy 0, policy_version 95653 (0.0008) [2023-12-27 19:55:00,382][106225] Updated weights for policy 1, policy_version 95542 (0.0007) [2023-12-27 19:55:00,444][106225] Updated weights for policy 1, policy_version 95552 (0.0008) [2023-12-27 19:55:00,504][106225] Updated weights for policy 1, policy_version 95562 (0.0009) [2023-12-27 19:55:01,037][106226] Updated weights for policy 0, policy_version 95663 (0.0008) [2023-12-27 19:55:01,100][106226] Updated weights for policy 0, policy_version 95673 (0.0008) [2023-12-27 19:55:01,166][106226] Updated weights for policy 0, policy_version 95683 (0.0008) [2023-12-27 19:55:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 48963584. Throughput: 0: 9863.5, 1: 9977.2. Samples: 48959972. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-27 19:55:01,175][105115] Avg episode reward: [(0, '-5.044'), (1, '-6.590')] [2023-12-27 19:55:01,233][106225] Updated weights for policy 1, policy_version 95572 (0.0008) [2023-12-27 19:55:01,296][106225] Updated weights for policy 1, policy_version 95582 (0.0009) [2023-12-27 19:55:01,345][106225] Updated weights for policy 1, policy_version 95592 (0.0008) [2023-12-27 19:55:01,947][106226] Updated weights for policy 0, policy_version 95693 (0.0008) [2023-12-27 19:55:02,009][106226] Updated weights for policy 0, policy_version 95703 (0.0006) [2023-12-27 19:55:02,073][106226] Updated weights for policy 0, policy_version 95713 (0.0006) [2023-12-27 19:55:02,098][106225] Updated weights for policy 1, policy_version 95602 (0.0008) [2023-12-27 19:55:02,153][106225] Updated weights for policy 1, policy_version 95612 (0.0010) [2023-12-27 19:55:02,215][106225] Updated weights for policy 1, policy_version 95622 (0.0010) [2023-12-27 19:55:02,277][106225] Updated weights for policy 1, policy_version 95632 (0.0011) [2023-12-27 19:55:02,786][106226] Updated weights for policy 0, policy_version 95723 (0.0008) [2023-12-27 19:55:02,836][106226] Updated weights for policy 0, policy_version 95733 (0.0010) [2023-12-27 19:55:02,888][106226] Updated weights for policy 0, policy_version 95743 (0.0010) [2023-12-27 19:55:02,967][106225] Updated weights for policy 1, policy_version 95642 (0.0007) [2023-12-27 19:55:03,024][106225] Updated weights for policy 1, policy_version 95652 (0.0007) [2023-12-27 19:55:03,088][106225] Updated weights for policy 1, policy_version 95662 (0.0008) [2023-12-27 19:55:03,588][106226] Updated weights for policy 0, policy_version 95753 (0.0010) [2023-12-27 19:55:03,637][106226] Updated weights for policy 0, policy_version 95763 (0.0010) [2023-12-27 19:55:03,689][106226] Updated weights for policy 0, policy_version 95773 (0.0010) [2023-12-27 19:55:03,742][106226] Updated weights for policy 0, policy_version 95783 (0.0010) [2023-12-27 19:55:03,743][106225] Updated weights for policy 1, policy_version 95672 (0.0009) [2023-12-27 19:55:03,789][106225] Updated weights for policy 1, policy_version 95682 (0.0010) [2023-12-27 19:55:03,836][106225] Updated weights for policy 1, policy_version 95692 (0.0010) [2023-12-27 19:55:04,471][106226] Updated weights for policy 0, policy_version 95793 (0.0011) [2023-12-27 19:55:04,530][106226] Updated weights for policy 0, policy_version 95803 (0.0010) [2023-12-27 19:55:04,571][106225] Updated weights for policy 1, policy_version 95702 (0.0006) [2023-12-27 19:55:04,594][106226] Updated weights for policy 0, policy_version 95813 (0.0010) [2023-12-27 19:55:04,629][106225] Updated weights for policy 1, policy_version 95712 (0.0010) [2023-12-27 19:55:04,686][106225] Updated weights for policy 1, policy_version 95722 (0.0010) [2023-12-27 19:55:05,294][106226] Updated weights for policy 0, policy_version 95823 (0.0010) [2023-12-27 19:55:05,325][106225] Updated weights for policy 1, policy_version 95732 (0.0010) [2023-12-27 19:55:05,344][106226] Updated weights for policy 0, policy_version 95833 (0.0010) [2023-12-27 19:55:05,379][106225] Updated weights for policy 1, policy_version 95742 (0.0010) [2023-12-27 19:55:05,394][106226] Updated weights for policy 0, policy_version 95843 (0.0010) [2023-12-27 19:55:05,441][106225] Updated weights for policy 1, policy_version 95752 (0.0010) [2023-12-27 19:55:06,071][106226] Updated weights for policy 0, policy_version 95853 (0.0010) [2023-12-27 19:55:06,115][106225] Updated weights for policy 1, policy_version 95762 (0.0011) [2023-12-27 19:55:06,141][106226] Updated weights for policy 0, policy_version 95863 (0.0008) [2023-12-27 19:55:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 49061888. Throughput: 0: 9923.0, 1: 9935.7. Samples: 49078512. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:06,175][105115] Avg episode reward: [(0, '-5.252'), (1, '-6.734')] [2023-12-27 19:55:06,176][106225] Updated weights for policy 1, policy_version 95772 (0.0010) [2023-12-27 19:55:06,202][106226] Updated weights for policy 0, policy_version 95873 (0.0011) [2023-12-27 19:55:06,235][106225] Updated weights for policy 1, policy_version 95782 (0.0008) [2023-12-27 19:55:06,298][106225] Updated weights for policy 1, policy_version 95792 (0.0008) [2023-12-27 19:55:06,938][106226] Updated weights for policy 0, policy_version 95883 (0.0011) [2023-12-27 19:55:06,999][106226] Updated weights for policy 0, policy_version 95893 (0.0011) [2023-12-27 19:55:07,020][106225] Updated weights for policy 1, policy_version 95802 (0.0007) [2023-12-27 19:55:07,057][106226] Updated weights for policy 0, policy_version 95903 (0.0011) [2023-12-27 19:55:07,072][106225] Updated weights for policy 1, policy_version 95812 (0.0009) [2023-12-27 19:55:07,133][106225] Updated weights for policy 1, policy_version 95822 (0.0010) [2023-12-27 19:55:07,780][106226] Updated weights for policy 0, policy_version 95913 (0.0010) [2023-12-27 19:55:07,792][106225] Updated weights for policy 1, policy_version 95832 (0.0010) [2023-12-27 19:55:07,841][106226] Updated weights for policy 0, policy_version 95923 (0.0009) [2023-12-27 19:55:07,849][106225] Updated weights for policy 1, policy_version 95842 (0.0010) [2023-12-27 19:55:07,897][106226] Updated weights for policy 0, policy_version 95933 (0.0008) [2023-12-27 19:55:07,899][106225] Updated weights for policy 1, policy_version 95852 (0.0010) [2023-12-27 19:55:07,953][106226] Updated weights for policy 0, policy_version 95943 (0.0007) [2023-12-27 19:55:08,635][106226] Updated weights for policy 0, policy_version 95953 (0.0006) [2023-12-27 19:55:08,643][106225] Updated weights for policy 1, policy_version 95862 (0.0009) [2023-12-27 19:55:08,694][106226] Updated weights for policy 0, policy_version 95963 (0.0006) [2023-12-27 19:55:08,696][106225] Updated weights for policy 1, policy_version 95872 (0.0009) [2023-12-27 19:55:08,744][106225] Updated weights for policy 1, policy_version 95882 (0.0008) [2023-12-27 19:55:08,754][106226] Updated weights for policy 0, policy_version 95973 (0.0007) [2023-12-27 19:55:09,417][106225] Updated weights for policy 1, policy_version 95892 (0.0007) [2023-12-27 19:55:09,480][106226] Updated weights for policy 0, policy_version 95983 (0.0008) [2023-12-27 19:55:09,483][106225] Updated weights for policy 1, policy_version 95902 (0.0008) [2023-12-27 19:55:09,536][106226] Updated weights for policy 0, policy_version 95993 (0.0009) [2023-12-27 19:55:09,540][106225] Updated weights for policy 1, policy_version 95912 (0.0008) [2023-12-27 19:55:09,598][106226] Updated weights for policy 0, policy_version 96003 (0.0008) [2023-12-27 19:55:10,293][106225] Updated weights for policy 1, policy_version 95922 (0.0007) [2023-12-27 19:55:10,351][106225] Updated weights for policy 1, policy_version 95932 (0.0007) [2023-12-27 19:55:10,363][106226] Updated weights for policy 0, policy_version 96013 (0.0008) [2023-12-27 19:55:10,413][106225] Updated weights for policy 1, policy_version 95942 (0.0011) [2023-12-27 19:55:10,429][106226] Updated weights for policy 0, policy_version 96023 (0.0008) [2023-12-27 19:55:10,477][106225] Updated weights for policy 1, policy_version 95952 (0.0009) [2023-12-27 19:55:10,487][106226] Updated weights for policy 0, policy_version 96033 (0.0006) [2023-12-27 19:55:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 49160192. Throughput: 0: 9900.5, 1: 9974.8. Samples: 49137336. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:11,175][105115] Avg episode reward: [(0, '-5.297'), (1, '-7.105')] [2023-12-27 19:55:11,191][106226] Updated weights for policy 0, policy_version 96043 (0.0007) [2023-12-27 19:55:11,192][106225] Updated weights for policy 1, policy_version 95962 (0.0008) [2023-12-27 19:55:11,252][106226] Updated weights for policy 0, policy_version 96053 (0.0012) [2023-12-27 19:55:11,257][106225] Updated weights for policy 1, policy_version 95972 (0.0010) [2023-12-27 19:55:11,316][106226] Updated weights for policy 0, policy_version 96063 (0.0008) [2023-12-27 19:55:11,320][106225] Updated weights for policy 1, policy_version 95982 (0.0011) [2023-12-27 19:55:11,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000095984_24576000.pth... [2023-12-27 19:55:11,336][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000094800_24272896.pth [2023-12-27 19:55:11,379][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000096072_24600576.pth... [2023-12-27 19:55:11,383][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000094920_24305664.pth [2023-12-27 19:55:12,052][106226] Updated weights for policy 0, policy_version 96073 (0.0009) [2023-12-27 19:55:12,119][106225] Updated weights for policy 1, policy_version 95992 (0.0010) [2023-12-27 19:55:12,121][106226] Updated weights for policy 0, policy_version 96083 (0.0009) [2023-12-27 19:55:12,181][106226] Updated weights for policy 0, policy_version 96093 (0.0006) [2023-12-27 19:55:12,186][106225] Updated weights for policy 1, policy_version 96002 (0.0010) [2023-12-27 19:55:12,244][106226] Updated weights for policy 0, policy_version 96103 (0.0007) [2023-12-27 19:55:12,255][106225] Updated weights for policy 1, policy_version 96012 (0.0008) [2023-12-27 19:55:12,935][106225] Updated weights for policy 1, policy_version 96022 (0.0008) [2023-12-27 19:55:13,005][106225] Updated weights for policy 1, policy_version 96032 (0.0008) [2023-12-27 19:55:13,055][106226] Updated weights for policy 0, policy_version 96113 (0.0006) [2023-12-27 19:55:13,064][106225] Updated weights for policy 1, policy_version 96042 (0.0006) [2023-12-27 19:55:13,111][106226] Updated weights for policy 0, policy_version 96123 (0.0008) [2023-12-27 19:55:13,164][106226] Updated weights for policy 0, policy_version 96133 (0.0009) [2023-12-27 19:55:13,760][106225] Updated weights for policy 1, policy_version 96052 (0.0009) [2023-12-27 19:55:13,817][106225] Updated weights for policy 1, policy_version 96062 (0.0006) [2023-12-27 19:55:13,860][106226] Updated weights for policy 0, policy_version 96143 (0.0006) [2023-12-27 19:55:13,875][106225] Updated weights for policy 1, policy_version 96072 (0.0006) [2023-12-27 19:55:13,912][106226] Updated weights for policy 0, policy_version 96153 (0.0007) [2023-12-27 19:55:13,973][106226] Updated weights for policy 0, policy_version 96163 (0.0006) [2023-12-27 19:55:14,513][106225] Updated weights for policy 1, policy_version 96082 (0.0007) [2023-12-27 19:55:14,571][106225] Updated weights for policy 1, policy_version 96092 (0.0008) [2023-12-27 19:55:14,631][106225] Updated weights for policy 1, policy_version 96102 (0.0008) [2023-12-27 19:55:14,680][106226] Updated weights for policy 0, policy_version 96173 (0.0007) [2023-12-27 19:55:14,692][106225] Updated weights for policy 1, policy_version 96112 (0.0009) [2023-12-27 19:55:14,730][106226] Updated weights for policy 0, policy_version 96183 (0.0005) [2023-12-27 19:55:14,794][106226] Updated weights for policy 0, policy_version 96193 (0.0008) [2023-12-27 19:55:15,416][106225] Updated weights for policy 1, policy_version 96122 (0.0008) [2023-12-27 19:55:15,474][106225] Updated weights for policy 1, policy_version 96132 (0.0008) [2023-12-27 19:55:15,538][106226] Updated weights for policy 0, policy_version 96203 (0.0007) [2023-12-27 19:55:15,540][106225] Updated weights for policy 1, policy_version 96142 (0.0008) [2023-12-27 19:55:15,591][106226] Updated weights for policy 0, policy_version 96213 (0.0008) [2023-12-27 19:55:15,636][106226] Updated weights for policy 0, policy_version 96223 (0.0008) [2023-12-27 19:55:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 49258496. Throughput: 0: 9786.3, 1: 9984.9. Samples: 49251012. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:16,175][105115] Avg episode reward: [(0, '-5.284'), (1, '-6.819')] [2023-12-27 19:55:16,239][106225] Updated weights for policy 1, policy_version 96152 (0.0008) [2023-12-27 19:55:16,287][106225] Updated weights for policy 1, policy_version 96162 (0.0008) [2023-12-27 19:55:16,342][106225] Updated weights for policy 1, policy_version 96172 (0.0008) [2023-12-27 19:55:16,370][106226] Updated weights for policy 0, policy_version 96233 (0.0008) [2023-12-27 19:55:16,436][106226] Updated weights for policy 0, policy_version 96243 (0.0009) [2023-12-27 19:55:16,503][106226] Updated weights for policy 0, policy_version 96253 (0.0010) [2023-12-27 19:55:16,553][106226] Updated weights for policy 0, policy_version 96263 (0.0009) [2023-12-27 19:55:16,947][106225] Updated weights for policy 1, policy_version 96182 (0.0007) [2023-12-27 19:55:17,000][106225] Updated weights for policy 1, policy_version 96192 (0.0009) [2023-12-27 19:55:17,054][106225] Updated weights for policy 1, policy_version 96202 (0.0008) [2023-12-27 19:55:17,321][106226] Updated weights for policy 0, policy_version 96273 (0.0006) [2023-12-27 19:55:17,378][106226] Updated weights for policy 0, policy_version 96283 (0.0008) [2023-12-27 19:55:17,436][106226] Updated weights for policy 0, policy_version 96293 (0.0011) [2023-12-27 19:55:17,794][106225] Updated weights for policy 1, policy_version 96212 (0.0006) [2023-12-27 19:55:17,851][106225] Updated weights for policy 1, policy_version 96222 (0.0008) [2023-12-27 19:55:17,906][106225] Updated weights for policy 1, policy_version 96232 (0.0007) [2023-12-27 19:55:18,066][106226] Updated weights for policy 0, policy_version 96303 (0.0010) [2023-12-27 19:55:18,126][106226] Updated weights for policy 0, policy_version 96313 (0.0010) [2023-12-27 19:55:18,185][106226] Updated weights for policy 0, policy_version 96323 (0.0010) [2023-12-27 19:55:18,649][106225] Updated weights for policy 1, policy_version 96242 (0.0009) [2023-12-27 19:55:18,710][106225] Updated weights for policy 1, policy_version 96252 (0.0008) [2023-12-27 19:55:18,770][106225] Updated weights for policy 1, policy_version 96262 (0.0008) [2023-12-27 19:55:18,822][106225] Updated weights for policy 1, policy_version 96272 (0.0008) [2023-12-27 19:55:18,832][106226] Updated weights for policy 0, policy_version 96333 (0.0010) [2023-12-27 19:55:18,887][106226] Updated weights for policy 0, policy_version 96343 (0.0005) [2023-12-27 19:55:18,934][106226] Updated weights for policy 0, policy_version 96353 (0.0005) [2023-12-27 19:55:19,597][106226] Updated weights for policy 0, policy_version 96363 (0.0005) [2023-12-27 19:55:19,652][106226] Updated weights for policy 0, policy_version 96373 (0.0006) [2023-12-27 19:55:19,668][106225] Updated weights for policy 1, policy_version 96282 (0.0009) [2023-12-27 19:55:19,708][106226] Updated weights for policy 0, policy_version 96383 (0.0009) [2023-12-27 19:55:19,731][106225] Updated weights for policy 1, policy_version 96292 (0.0008) [2023-12-27 19:55:19,788][106225] Updated weights for policy 1, policy_version 96302 (0.0007) [2023-12-27 19:55:20,463][106226] Updated weights for policy 0, policy_version 96393 (0.0008) [2023-12-27 19:55:20,507][106225] Updated weights for policy 1, policy_version 96312 (0.0006) [2023-12-27 19:55:20,527][106226] Updated weights for policy 0, policy_version 96403 (0.0009) [2023-12-27 19:55:20,589][106225] Updated weights for policy 1, policy_version 96322 (0.0008) [2023-12-27 19:55:20,591][106226] Updated weights for policy 0, policy_version 96413 (0.0007) [2023-12-27 19:55:20,651][106225] Updated weights for policy 1, policy_version 96332 (0.0007) [2023-12-27 19:55:20,656][106226] Updated weights for policy 0, policy_version 96423 (0.0008) [2023-12-27 19:55:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 49356800. Throughput: 0: 9737.8, 1: 9937.0. Samples: 49367808. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:21,175][105115] Avg episode reward: [(0, '-5.190'), (1, '-6.640')] [2023-12-27 19:55:21,392][106225] Updated weights for policy 1, policy_version 96342 (0.0009) [2023-12-27 19:55:21,411][106226] Updated weights for policy 0, policy_version 96433 (0.0008) [2023-12-27 19:55:21,456][106225] Updated weights for policy 1, policy_version 96352 (0.0007) [2023-12-27 19:55:21,478][106226] Updated weights for policy 0, policy_version 96443 (0.0007) [2023-12-27 19:55:21,516][106225] Updated weights for policy 1, policy_version 96362 (0.0006) [2023-12-27 19:55:21,534][106226] Updated weights for policy 0, policy_version 96453 (0.0006) [2023-12-27 19:55:22,170][106226] Updated weights for policy 0, policy_version 96463 (0.0006) [2023-12-27 19:55:22,234][106226] Updated weights for policy 0, policy_version 96473 (0.0007) [2023-12-27 19:55:22,301][106226] Updated weights for policy 0, policy_version 96483 (0.0009) [2023-12-27 19:55:22,351][106225] Updated weights for policy 1, policy_version 96372 (0.0007) [2023-12-27 19:55:22,421][106225] Updated weights for policy 1, policy_version 96382 (0.0008) [2023-12-27 19:55:22,486][106225] Updated weights for policy 1, policy_version 96392 (0.0006) [2023-12-27 19:55:22,988][106226] Updated weights for policy 0, policy_version 96493 (0.0008) [2023-12-27 19:55:23,058][106226] Updated weights for policy 0, policy_version 96503 (0.0009) [2023-12-27 19:55:23,117][106226] Updated weights for policy 0, policy_version 96513 (0.0008) [2023-12-27 19:55:23,252][106225] Updated weights for policy 1, policy_version 96402 (0.0008) [2023-12-27 19:55:23,308][106225] Updated weights for policy 1, policy_version 96412 (0.0009) [2023-12-27 19:55:23,356][106225] Updated weights for policy 1, policy_version 96422 (0.0008) [2023-12-27 19:55:23,408][106225] Updated weights for policy 1, policy_version 96432 (0.0009) [2023-12-27 19:55:23,811][106226] Updated weights for policy 0, policy_version 96523 (0.0009) [2023-12-27 19:55:23,859][106226] Updated weights for policy 0, policy_version 96533 (0.0008) [2023-12-27 19:55:23,907][106226] Updated weights for policy 0, policy_version 96543 (0.0008) [2023-12-27 19:55:24,167][106225] Updated weights for policy 1, policy_version 96442 (0.0010) [2023-12-27 19:55:24,229][106225] Updated weights for policy 1, policy_version 96452 (0.0011) [2023-12-27 19:55:24,286][106225] Updated weights for policy 1, policy_version 96462 (0.0010) [2023-12-27 19:55:24,624][106226] Updated weights for policy 0, policy_version 96553 (0.0008) [2023-12-27 19:55:24,667][106226] Updated weights for policy 0, policy_version 96563 (0.0008) [2023-12-27 19:55:24,714][106226] Updated weights for policy 0, policy_version 96573 (0.0008) [2023-12-27 19:55:24,761][106226] Updated weights for policy 0, policy_version 96583 (0.0007) [2023-12-27 19:55:24,986][106225] Updated weights for policy 1, policy_version 96472 (0.0010) [2023-12-27 19:55:25,036][106225] Updated weights for policy 1, policy_version 96482 (0.0010) [2023-12-27 19:55:25,086][106225] Updated weights for policy 1, policy_version 96493 (0.0011) [2023-12-27 19:55:25,556][106226] Updated weights for policy 0, policy_version 96593 (0.0008) [2023-12-27 19:55:25,618][106226] Updated weights for policy 0, policy_version 96603 (0.0009) [2023-12-27 19:55:25,671][106226] Updated weights for policy 0, policy_version 96613 (0.0009) [2023-12-27 19:55:25,715][106225] Updated weights for policy 1, policy_version 96503 (0.0007) [2023-12-27 19:55:25,768][106225] Updated weights for policy 1, policy_version 96513 (0.0008) [2023-12-27 19:55:25,827][106225] Updated weights for policy 1, policy_version 96523 (0.0008) [2023-12-27 19:55:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 49455104. Throughput: 0: 9728.5, 1: 9864.7. Samples: 49424796. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:26,175][105115] Avg episode reward: [(0, '-5.548'), (1, '-7.060')] [2023-12-27 19:55:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000096528_24715264.pth... [2023-12-27 19:55:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000096616_24739840.pth... [2023-12-27 19:55:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000095496_24453120.pth [2023-12-27 19:55:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000095408_24428544.pth [2023-12-27 19:55:26,452][106226] Updated weights for policy 0, policy_version 96623 (0.0007) [2023-12-27 19:55:26,504][106225] Updated weights for policy 1, policy_version 96533 (0.0007) [2023-12-27 19:55:26,517][106226] Updated weights for policy 0, policy_version 96633 (0.0008) [2023-12-27 19:55:26,553][106225] Updated weights for policy 1, policy_version 96543 (0.0005) [2023-12-27 19:55:26,573][106226] Updated weights for policy 0, policy_version 96643 (0.0008) [2023-12-27 19:55:26,608][106225] Updated weights for policy 1, policy_version 96553 (0.0005) [2023-12-27 19:55:27,177][106226] Updated weights for policy 0, policy_version 96653 (0.0007) [2023-12-27 19:55:27,229][106226] Updated weights for policy 0, policy_version 96663 (0.0005) [2023-12-27 19:55:27,269][106225] Updated weights for policy 1, policy_version 96563 (0.0006) [2023-12-27 19:55:27,281][106226] Updated weights for policy 0, policy_version 96673 (0.0006) [2023-12-27 19:55:27,337][106225] Updated weights for policy 1, policy_version 96573 (0.0008) [2023-12-27 19:55:27,398][106225] Updated weights for policy 1, policy_version 96583 (0.0008) [2023-12-27 19:55:27,871][106226] Updated weights for policy 0, policy_version 96683 (0.0006) [2023-12-27 19:55:27,934][106226] Updated weights for policy 0, policy_version 96693 (0.0006) [2023-12-27 19:55:27,996][106226] Updated weights for policy 0, policy_version 96703 (0.0006) [2023-12-27 19:55:28,118][106225] Updated weights for policy 1, policy_version 96593 (0.0008) [2023-12-27 19:55:28,179][106225] Updated weights for policy 1, policy_version 96603 (0.0008) [2023-12-27 19:55:28,243][106225] Updated weights for policy 1, policy_version 96613 (0.0007) [2023-12-27 19:55:28,303][106225] Updated weights for policy 1, policy_version 96623 (0.0008) [2023-12-27 19:55:28,662][106226] Updated weights for policy 0, policy_version 96713 (0.0006) [2023-12-27 19:55:28,725][106226] Updated weights for policy 0, policy_version 96723 (0.0010) [2023-12-27 19:55:28,788][106226] Updated weights for policy 0, policy_version 96733 (0.0010) [2023-12-27 19:55:28,851][106226] Updated weights for policy 0, policy_version 96743 (0.0010) [2023-12-27 19:55:29,022][106225] Updated weights for policy 1, policy_version 96633 (0.0010) [2023-12-27 19:55:29,075][106225] Updated weights for policy 1, policy_version 96643 (0.0010) [2023-12-27 19:55:29,127][106225] Updated weights for policy 1, policy_version 96653 (0.0009) [2023-12-27 19:55:29,588][106226] Updated weights for policy 0, policy_version 96753 (0.0010) [2023-12-27 19:55:29,641][106226] Updated weights for policy 0, policy_version 96763 (0.0010) [2023-12-27 19:55:29,706][106226] Updated weights for policy 0, policy_version 96773 (0.0011) [2023-12-27 19:55:29,800][106225] Updated weights for policy 1, policy_version 96663 (0.0009) [2023-12-27 19:55:29,869][106225] Updated weights for policy 1, policy_version 96673 (0.0010) [2023-12-27 19:55:29,932][106225] Updated weights for policy 1, policy_version 96683 (0.0010) [2023-12-27 19:55:30,400][106226] Updated weights for policy 0, policy_version 96783 (0.0007) [2023-12-27 19:55:30,455][106226] Updated weights for policy 0, policy_version 96793 (0.0006) [2023-12-27 19:55:30,518][106226] Updated weights for policy 0, policy_version 96803 (0.0006) [2023-12-27 19:55:30,627][106225] Updated weights for policy 1, policy_version 96693 (0.0008) [2023-12-27 19:55:30,699][106225] Updated weights for policy 1, policy_version 96703 (0.0007) [2023-12-27 19:55:30,763][106225] Updated weights for policy 1, policy_version 96713 (0.0008) [2023-12-27 19:55:31,068][106226] Updated weights for policy 0, policy_version 96813 (0.0007) [2023-12-27 19:55:31,120][106226] Updated weights for policy 0, policy_version 96823 (0.0008) [2023-12-27 19:55:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 49553408. Throughput: 0: 9821.9, 1: 9906.5. Samples: 49545896. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:31,175][105115] Avg episode reward: [(0, '-5.255'), (1, '-6.693')] [2023-12-27 19:55:31,191][106226] Updated weights for policy 0, policy_version 96833 (0.0008) [2023-12-27 19:55:31,393][106225] Updated weights for policy 1, policy_version 96723 (0.0007) [2023-12-27 19:55:31,445][106225] Updated weights for policy 1, policy_version 96733 (0.0008) [2023-12-27 19:55:31,502][106225] Updated weights for policy 1, policy_version 96743 (0.0009) [2023-12-27 19:55:31,954][106226] Updated weights for policy 0, policy_version 96843 (0.0008) [2023-12-27 19:55:32,003][106226] Updated weights for policy 0, policy_version 96853 (0.0008) [2023-12-27 19:55:32,052][106226] Updated weights for policy 0, policy_version 96863 (0.0009) [2023-12-27 19:55:32,214][106225] Updated weights for policy 1, policy_version 96753 (0.0008) [2023-12-27 19:55:32,273][106225] Updated weights for policy 1, policy_version 96763 (0.0010) [2023-12-27 19:55:32,331][106225] Updated weights for policy 1, policy_version 96773 (0.0008) [2023-12-27 19:55:32,392][106225] Updated weights for policy 1, policy_version 96783 (0.0009) [2023-12-27 19:55:32,775][106226] Updated weights for policy 0, policy_version 96873 (0.0006) [2023-12-27 19:55:32,833][106226] Updated weights for policy 0, policy_version 96883 (0.0006) [2023-12-27 19:55:32,892][106226] Updated weights for policy 0, policy_version 96893 (0.0007) [2023-12-27 19:55:32,937][106226] Updated weights for policy 0, policy_version 96903 (0.0008) [2023-12-27 19:55:33,092][106225] Updated weights for policy 1, policy_version 96793 (0.0006) [2023-12-27 19:55:33,147][106225] Updated weights for policy 1, policy_version 96803 (0.0005) [2023-12-27 19:55:33,201][106225] Updated weights for policy 1, policy_version 96813 (0.0006) [2023-12-27 19:55:33,565][106226] Updated weights for policy 0, policy_version 96913 (0.0008) [2023-12-27 19:55:33,617][106226] Updated weights for policy 0, policy_version 96923 (0.0010) [2023-12-27 19:55:33,663][106226] Updated weights for policy 0, policy_version 96933 (0.0007) [2023-12-27 19:55:33,759][106225] Updated weights for policy 1, policy_version 96823 (0.0005) [2023-12-27 19:55:33,808][106225] Updated weights for policy 1, policy_version 96833 (0.0005) [2023-12-27 19:55:33,852][106225] Updated weights for policy 1, policy_version 96843 (0.0005) [2023-12-27 19:55:34,393][106226] Updated weights for policy 0, policy_version 96943 (0.0009) [2023-12-27 19:55:34,460][106226] Updated weights for policy 0, policy_version 96953 (0.0008) [2023-12-27 19:55:34,510][106225] Updated weights for policy 1, policy_version 96853 (0.0009) [2023-12-27 19:55:34,515][106226] Updated weights for policy 0, policy_version 96963 (0.0010) [2023-12-27 19:55:34,569][106225] Updated weights for policy 1, policy_version 96863 (0.0008) [2023-12-27 19:55:34,634][106225] Updated weights for policy 1, policy_version 96873 (0.0008) [2023-12-27 19:55:35,162][106226] Updated weights for policy 0, policy_version 96973 (0.0010) [2023-12-27 19:55:35,216][106226] Updated weights for policy 0, policy_version 96983 (0.0006) [2023-12-27 19:55:35,276][106226] Updated weights for policy 0, policy_version 96993 (0.0010) [2023-12-27 19:55:35,322][106225] Updated weights for policy 1, policy_version 96883 (0.0007) [2023-12-27 19:55:35,371][106225] Updated weights for policy 1, policy_version 96893 (0.0009) [2023-12-27 19:55:35,414][106225] Updated weights for policy 1, policy_version 96903 (0.0007) [2023-12-27 19:55:35,920][106226] Updated weights for policy 0, policy_version 97003 (0.0010) [2023-12-27 19:55:35,976][106226] Updated weights for policy 0, policy_version 97013 (0.0007) [2023-12-27 19:55:36,032][106226] Updated weights for policy 0, policy_version 97023 (0.0006) [2023-12-27 19:55:36,127][106225] Updated weights for policy 1, policy_version 96913 (0.0008) [2023-12-27 19:55:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 49659904. Throughput: 0: 9839.6, 1: 9934.1. Samples: 49669020. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:36,175][105115] Avg episode reward: [(0, '-5.375'), (1, '-6.648')] [2023-12-27 19:55:36,187][106225] Updated weights for policy 1, policy_version 96923 (0.0009) [2023-12-27 19:55:36,244][106225] Updated weights for policy 1, policy_version 96933 (0.0008) [2023-12-27 19:55:36,306][106225] Updated weights for policy 1, policy_version 96943 (0.0009) [2023-12-27 19:55:36,752][106226] Updated weights for policy 0, policy_version 97033 (0.0009) [2023-12-27 19:55:36,812][106226] Updated weights for policy 0, policy_version 97043 (0.0009) [2023-12-27 19:55:36,875][106226] Updated weights for policy 0, policy_version 97053 (0.0008) [2023-12-27 19:55:36,926][106226] Updated weights for policy 0, policy_version 97063 (0.0008) [2023-12-27 19:55:37,048][106225] Updated weights for policy 1, policy_version 96953 (0.0009) [2023-12-27 19:55:37,098][106225] Updated weights for policy 1, policy_version 96963 (0.0010) [2023-12-27 19:55:37,159][106225] Updated weights for policy 1, policy_version 96973 (0.0010) [2023-12-27 19:55:37,677][106226] Updated weights for policy 0, policy_version 97073 (0.0008) [2023-12-27 19:55:37,736][106226] Updated weights for policy 0, policy_version 97083 (0.0007) [2023-12-27 19:55:37,801][106226] Updated weights for policy 0, policy_version 97093 (0.0008) [2023-12-27 19:55:37,839][106225] Updated weights for policy 1, policy_version 96983 (0.0010) [2023-12-27 19:55:37,885][106225] Updated weights for policy 1, policy_version 96993 (0.0010) [2023-12-27 19:55:37,939][106225] Updated weights for policy 1, policy_version 97003 (0.0010) [2023-12-27 19:55:38,508][106226] Updated weights for policy 0, policy_version 97103 (0.0008) [2023-12-27 19:55:38,569][106226] Updated weights for policy 0, policy_version 97113 (0.0009) [2023-12-27 19:55:38,631][106226] Updated weights for policy 0, policy_version 97123 (0.0009) [2023-12-27 19:55:38,677][106225] Updated weights for policy 1, policy_version 97013 (0.0009) [2023-12-27 19:55:38,729][106225] Updated weights for policy 1, policy_version 97023 (0.0008) [2023-12-27 19:55:38,781][106225] Updated weights for policy 1, policy_version 97033 (0.0008) [2023-12-27 19:55:39,347][106226] Updated weights for policy 0, policy_version 97133 (0.0009) [2023-12-27 19:55:39,414][106226] Updated weights for policy 0, policy_version 97143 (0.0009) [2023-12-27 19:55:39,477][106226] Updated weights for policy 0, policy_version 97153 (0.0009) [2023-12-27 19:55:39,483][106225] Updated weights for policy 1, policy_version 97043 (0.0008) [2023-12-27 19:55:39,545][106225] Updated weights for policy 1, policy_version 97053 (0.0008) [2023-12-27 19:55:39,603][106225] Updated weights for policy 1, policy_version 97063 (0.0008) [2023-12-27 19:55:40,234][106226] Updated weights for policy 0, policy_version 97163 (0.0007) [2023-12-27 19:55:40,307][106226] Updated weights for policy 0, policy_version 97173 (0.0010) [2023-12-27 19:55:40,358][106225] Updated weights for policy 1, policy_version 97073 (0.0008) [2023-12-27 19:55:40,372][106226] Updated weights for policy 0, policy_version 97183 (0.0007) [2023-12-27 19:55:40,422][106225] Updated weights for policy 1, policy_version 97083 (0.0006) [2023-12-27 19:55:40,485][106225] Updated weights for policy 1, policy_version 97093 (0.0008) [2023-12-27 19:55:40,551][106225] Updated weights for policy 1, policy_version 97103 (0.0008) [2023-12-27 19:55:41,096][106226] Updated weights for policy 0, policy_version 97193 (0.0008) [2023-12-27 19:55:41,162][106226] Updated weights for policy 0, policy_version 97203 (0.0008) [2023-12-27 19:55:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 49750016. Throughput: 0: 9846.6, 1: 9898.4. Samples: 49727988. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:41,175][105115] Avg episode reward: [(0, '-5.060'), (1, '-6.691')] [2023-12-27 19:55:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000097104_24862720.pth... [2023-12-27 19:55:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000095984_24576000.pth [2023-12-27 19:55:41,223][106226] Updated weights for policy 0, policy_version 97213 (0.0008) [2023-12-27 19:55:41,266][106225] Updated weights for policy 1, policy_version 97113 (0.0009) [2023-12-27 19:55:41,284][106226] Updated weights for policy 0, policy_version 97223 (0.0006) [2023-12-27 19:55:41,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000097224_24895488.pth... [2023-12-27 19:55:41,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000096072_24600576.pth [2023-12-27 19:55:41,334][106225] Updated weights for policy 1, policy_version 97123 (0.0007) [2023-12-27 19:55:41,401][106225] Updated weights for policy 1, policy_version 97133 (0.0010) [2023-12-27 19:55:42,036][106226] Updated weights for policy 0, policy_version 97233 (0.0009) [2023-12-27 19:55:42,097][106226] Updated weights for policy 0, policy_version 97243 (0.0009) [2023-12-27 19:55:42,155][106226] Updated weights for policy 0, policy_version 97253 (0.0008) [2023-12-27 19:55:42,177][106225] Updated weights for policy 1, policy_version 97143 (0.0007) [2023-12-27 19:55:42,229][106225] Updated weights for policy 1, policy_version 97153 (0.0008) [2023-12-27 19:55:42,289][106225] Updated weights for policy 1, policy_version 97163 (0.0008) [2023-12-27 19:55:42,920][106226] Updated weights for policy 0, policy_version 97263 (0.0009) [2023-12-27 19:55:42,972][106226] Updated weights for policy 0, policy_version 97273 (0.0007) [2023-12-27 19:55:42,994][106225] Updated weights for policy 1, policy_version 97173 (0.0008) [2023-12-27 19:55:43,030][106226] Updated weights for policy 0, policy_version 97283 (0.0005) [2023-12-27 19:55:43,047][106225] Updated weights for policy 1, policy_version 97183 (0.0010) [2023-12-27 19:55:43,112][106225] Updated weights for policy 1, policy_version 97193 (0.0010) [2023-12-27 19:55:43,600][106226] Updated weights for policy 0, policy_version 97293 (0.0007) [2023-12-27 19:55:43,659][106226] Updated weights for policy 0, policy_version 97303 (0.0009) [2023-12-27 19:55:43,721][106226] Updated weights for policy 0, policy_version 97313 (0.0007) [2023-12-27 19:55:43,735][106225] Updated weights for policy 1, policy_version 97203 (0.0010) [2023-12-27 19:55:43,797][106225] Updated weights for policy 1, policy_version 97213 (0.0009) [2023-12-27 19:55:43,860][106225] Updated weights for policy 1, policy_version 97223 (0.0010) [2023-12-27 19:55:44,484][106226] Updated weights for policy 0, policy_version 97323 (0.0007) [2023-12-27 19:55:44,497][106225] Updated weights for policy 1, policy_version 97233 (0.0008) [2023-12-27 19:55:44,551][106226] Updated weights for policy 0, policy_version 97333 (0.0006) [2023-12-27 19:55:44,556][106225] Updated weights for policy 1, policy_version 97243 (0.0006) [2023-12-27 19:55:44,613][106226] Updated weights for policy 0, policy_version 97343 (0.0006) [2023-12-27 19:55:44,619][106225] Updated weights for policy 1, policy_version 97253 (0.0006) [2023-12-27 19:55:44,673][106225] Updated weights for policy 1, policy_version 97263 (0.0008) [2023-12-27 19:55:45,213][106226] Updated weights for policy 0, policy_version 97353 (0.0006) [2023-12-27 19:55:45,275][106226] Updated weights for policy 0, policy_version 97363 (0.0006) [2023-12-27 19:55:45,332][106226] Updated weights for policy 0, policy_version 97373 (0.0009) [2023-12-27 19:55:45,360][106225] Updated weights for policy 1, policy_version 97273 (0.0006) [2023-12-27 19:55:45,391][106226] Updated weights for policy 0, policy_version 97383 (0.0006) [2023-12-27 19:55:45,411][106225] Updated weights for policy 1, policy_version 97283 (0.0007) [2023-12-27 19:55:45,470][106225] Updated weights for policy 1, policy_version 97293 (0.0005) [2023-12-27 19:55:46,008][106226] Updated weights for policy 0, policy_version 97393 (0.0009) [2023-12-27 19:55:46,060][106225] Updated weights for policy 1, policy_version 97303 (0.0006) [2023-12-27 19:55:46,071][106226] Updated weights for policy 0, policy_version 97403 (0.0009) [2023-12-27 19:55:46,120][106226] Updated weights for policy 0, policy_version 97413 (0.0008) [2023-12-27 19:55:46,124][106225] Updated weights for policy 1, policy_version 97313 (0.0006) [2023-12-27 19:55:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 49856512. Throughput: 0: 9825.8, 1: 9831.3. Samples: 49844540. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:46,175][105115] Avg episode reward: [(0, '-5.404'), (1, '-6.569')] [2023-12-27 19:55:46,188][106225] Updated weights for policy 1, policy_version 97323 (0.0007) [2023-12-27 19:55:46,717][106226] Updated weights for policy 0, policy_version 97423 (0.0008) [2023-12-27 19:55:46,773][106226] Updated weights for policy 0, policy_version 97433 (0.0009) [2023-12-27 19:55:46,839][106226] Updated weights for policy 0, policy_version 97443 (0.0008) [2023-12-27 19:55:46,902][106225] Updated weights for policy 1, policy_version 97333 (0.0008) [2023-12-27 19:55:46,949][106225] Updated weights for policy 1, policy_version 97343 (0.0007) [2023-12-27 19:55:47,005][106225] Updated weights for policy 1, policy_version 97353 (0.0008) [2023-12-27 19:55:47,541][106226] Updated weights for policy 0, policy_version 97453 (0.0007) [2023-12-27 19:55:47,607][106226] Updated weights for policy 0, policy_version 97463 (0.0005) [2023-12-27 19:55:47,670][106226] Updated weights for policy 0, policy_version 97473 (0.0005) [2023-12-27 19:55:47,754][106225] Updated weights for policy 1, policy_version 97363 (0.0009) [2023-12-27 19:55:47,805][106225] Updated weights for policy 1, policy_version 97373 (0.0008) [2023-12-27 19:55:47,855][106225] Updated weights for policy 1, policy_version 97383 (0.0008) [2023-12-27 19:55:48,170][106226] Updated weights for policy 0, policy_version 97483 (0.0007) [2023-12-27 19:55:48,220][106226] Updated weights for policy 0, policy_version 97493 (0.0010) [2023-12-27 19:55:48,277][106226] Updated weights for policy 0, policy_version 97503 (0.0010) [2023-12-27 19:55:48,632][106225] Updated weights for policy 1, policy_version 97393 (0.0009) [2023-12-27 19:55:48,694][106225] Updated weights for policy 1, policy_version 97403 (0.0007) [2023-12-27 19:55:48,757][106225] Updated weights for policy 1, policy_version 97413 (0.0006) [2023-12-27 19:55:48,806][106225] Updated weights for policy 1, policy_version 97423 (0.0005) [2023-12-27 19:55:48,944][106226] Updated weights for policy 0, policy_version 97513 (0.0010) [2023-12-27 19:55:49,005][106226] Updated weights for policy 0, policy_version 97523 (0.0011) [2023-12-27 19:55:49,063][106226] Updated weights for policy 0, policy_version 97533 (0.0011) [2023-12-27 19:55:49,111][106226] Updated weights for policy 0, policy_version 97543 (0.0010) [2023-12-27 19:55:49,474][106225] Updated weights for policy 1, policy_version 97433 (0.0007) [2023-12-27 19:55:49,533][106225] Updated weights for policy 1, policy_version 97443 (0.0008) [2023-12-27 19:55:49,591][106225] Updated weights for policy 1, policy_version 97453 (0.0009) [2023-12-27 19:55:49,805][106226] Updated weights for policy 0, policy_version 97553 (0.0011) [2023-12-27 19:55:49,873][106226] Updated weights for policy 0, policy_version 97563 (0.0010) [2023-12-27 19:55:49,935][106226] Updated weights for policy 0, policy_version 97573 (0.0011) [2023-12-27 19:55:50,286][106225] Updated weights for policy 1, policy_version 97463 (0.0008) [2023-12-27 19:55:50,347][106225] Updated weights for policy 1, policy_version 97473 (0.0007) [2023-12-27 19:55:50,412][106225] Updated weights for policy 1, policy_version 97483 (0.0006) [2023-12-27 19:55:50,707][106226] Updated weights for policy 0, policy_version 97583 (0.0011) [2023-12-27 19:55:50,773][106226] Updated weights for policy 0, policy_version 97593 (0.0011) [2023-12-27 19:55:50,835][106226] Updated weights for policy 0, policy_version 97603 (0.0011) [2023-12-27 19:55:51,098][106225] Updated weights for policy 1, policy_version 97493 (0.0008) [2023-12-27 19:55:51,162][106225] Updated weights for policy 1, policy_version 97503 (0.0008) [2023-12-27 19:55:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 49954816. Throughput: 0: 9911.0, 1: 9836.8. Samples: 49967164. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:51,175][105115] Avg episode reward: [(0, '-5.400'), (1, '-6.945')] [2023-12-27 19:55:51,223][106225] Updated weights for policy 1, policy_version 97513 (0.0008) [2023-12-27 19:55:51,550][106226] Updated weights for policy 0, policy_version 97613 (0.0011) [2023-12-27 19:55:51,609][106226] Updated weights for policy 0, policy_version 97623 (0.0009) [2023-12-27 19:55:51,677][106226] Updated weights for policy 0, policy_version 97633 (0.0008) [2023-12-27 19:55:51,984][106225] Updated weights for policy 1, policy_version 97523 (0.0008) [2023-12-27 19:55:52,047][106225] Updated weights for policy 1, policy_version 97533 (0.0009) [2023-12-27 19:55:52,117][106225] Updated weights for policy 1, policy_version 97543 (0.0010) [2023-12-27 19:55:52,302][106226] Updated weights for policy 0, policy_version 97643 (0.0007) [2023-12-27 19:55:52,363][106226] Updated weights for policy 0, policy_version 97653 (0.0008) [2023-12-27 19:55:52,427][106226] Updated weights for policy 0, policy_version 97663 (0.0008) [2023-12-27 19:55:52,833][106225] Updated weights for policy 1, policy_version 97553 (0.0009) [2023-12-27 19:55:52,894][106225] Updated weights for policy 1, policy_version 97563 (0.0007) [2023-12-27 19:55:52,952][106225] Updated weights for policy 1, policy_version 97573 (0.0007) [2023-12-27 19:55:53,007][106225] Updated weights for policy 1, policy_version 97583 (0.0006) [2023-12-27 19:55:53,152][106226] Updated weights for policy 0, policy_version 97673 (0.0009) [2023-12-27 19:55:53,209][106226] Updated weights for policy 0, policy_version 97683 (0.0010) [2023-12-27 19:55:53,265][106226] Updated weights for policy 0, policy_version 97693 (0.0010) [2023-12-27 19:55:53,320][106226] Updated weights for policy 0, policy_version 97703 (0.0010) [2023-12-27 19:55:53,665][106225] Updated weights for policy 1, policy_version 97593 (0.0005) [2023-12-27 19:55:53,715][106225] Updated weights for policy 1, policy_version 97603 (0.0006) [2023-12-27 19:55:53,765][106225] Updated weights for policy 1, policy_version 97613 (0.0010) [2023-12-27 19:55:53,976][106226] Updated weights for policy 0, policy_version 97713 (0.0006) [2023-12-27 19:55:54,041][106226] Updated weights for policy 0, policy_version 97723 (0.0006) [2023-12-27 19:55:54,102][106226] Updated weights for policy 0, policy_version 97733 (0.0010) [2023-12-27 19:55:54,310][106225] Updated weights for policy 1, policy_version 97623 (0.0007) [2023-12-27 19:55:54,370][106225] Updated weights for policy 1, policy_version 97633 (0.0005) [2023-12-27 19:55:54,440][106225] Updated weights for policy 1, policy_version 97643 (0.0007) [2023-12-27 19:55:54,782][106226] Updated weights for policy 0, policy_version 97743 (0.0008) [2023-12-27 19:55:54,827][106226] Updated weights for policy 0, policy_version 97753 (0.0010) [2023-12-27 19:55:54,889][106226] Updated weights for policy 0, policy_version 97763 (0.0005) [2023-12-27 19:55:55,084][106225] Updated weights for policy 1, policy_version 97653 (0.0008) [2023-12-27 19:55:55,150][106225] Updated weights for policy 1, policy_version 97663 (0.0008) [2023-12-27 19:55:55,212][106225] Updated weights for policy 1, policy_version 97673 (0.0009) [2023-12-27 19:55:55,574][106226] Updated weights for policy 0, policy_version 97773 (0.0008) [2023-12-27 19:55:55,633][106226] Updated weights for policy 0, policy_version 97783 (0.0010) [2023-12-27 19:55:55,689][106226] Updated weights for policy 0, policy_version 97793 (0.0010) [2023-12-27 19:55:55,862][106225] Updated weights for policy 1, policy_version 97683 (0.0010) [2023-12-27 19:55:55,925][106225] Updated weights for policy 1, policy_version 97693 (0.0009) [2023-12-27 19:55:55,988][106225] Updated weights for policy 1, policy_version 97703 (0.0005) [2023-12-27 19:55:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 50061312. Throughput: 0: 9934.2, 1: 9827.9. Samples: 50026632. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 19:55:56,175][105115] Avg episode reward: [(0, '-5.307'), (1, '-6.558')] [2023-12-27 19:55:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000097800_25042944.pth... [2023-12-27 19:55:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000097712_25018368.pth... [2023-12-27 19:55:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000096528_24715264.pth [2023-12-27 19:55:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000096616_24739840.pth [2023-12-27 19:55:56,359][106226] Updated weights for policy 0, policy_version 97803 (0.0009) [2023-12-27 19:55:56,420][106226] Updated weights for policy 0, policy_version 97813 (0.0006) [2023-12-27 19:55:56,466][106226] Updated weights for policy 0, policy_version 97823 (0.0008) [2023-12-27 19:55:56,604][106225] Updated weights for policy 1, policy_version 97713 (0.0005) [2023-12-27 19:55:56,673][106225] Updated weights for policy 1, policy_version 97723 (0.0005) [2023-12-27 19:55:56,743][106225] Updated weights for policy 1, policy_version 97733 (0.0005) [2023-12-27 19:55:56,814][106225] Updated weights for policy 1, policy_version 97743 (0.0008) [2023-12-27 19:55:56,994][106226] Updated weights for policy 0, policy_version 97833 (0.0005) [2023-12-27 19:55:57,052][106226] Updated weights for policy 0, policy_version 97843 (0.0005) [2023-12-27 19:55:57,121][106226] Updated weights for policy 0, policy_version 97853 (0.0008) [2023-12-27 19:55:57,180][106226] Updated weights for policy 0, policy_version 97863 (0.0009) [2023-12-27 19:55:57,423][106225] Updated weights for policy 1, policy_version 97753 (0.0008) [2023-12-27 19:55:57,472][106225] Updated weights for policy 1, policy_version 97763 (0.0006) [2023-12-27 19:55:57,527][106225] Updated weights for policy 1, policy_version 97773 (0.0005) [2023-12-27 19:55:57,845][106226] Updated weights for policy 0, policy_version 97873 (0.0005) [2023-12-27 19:55:57,913][106226] Updated weights for policy 0, policy_version 97883 (0.0009) [2023-12-27 19:55:57,972][106226] Updated weights for policy 0, policy_version 97893 (0.0010) [2023-12-27 19:55:58,109][106225] Updated weights for policy 1, policy_version 97783 (0.0006) [2023-12-27 19:55:58,167][106225] Updated weights for policy 1, policy_version 97793 (0.0007) [2023-12-27 19:55:58,232][106225] Updated weights for policy 1, policy_version 97803 (0.0007) [2023-12-27 19:55:58,687][106226] Updated weights for policy 0, policy_version 97903 (0.0008) [2023-12-27 19:55:58,754][106226] Updated weights for policy 0, policy_version 97913 (0.0008) [2023-12-27 19:55:58,819][106226] Updated weights for policy 0, policy_version 97923 (0.0008) [2023-12-27 19:55:59,046][106225] Updated weights for policy 1, policy_version 97813 (0.0009) [2023-12-27 19:55:59,109][106225] Updated weights for policy 1, policy_version 97823 (0.0011) [2023-12-27 19:55:59,174][106225] Updated weights for policy 1, policy_version 97833 (0.0010) [2023-12-27 19:55:59,662][106226] Updated weights for policy 0, policy_version 97933 (0.0008) [2023-12-27 19:55:59,724][106226] Updated weights for policy 0, policy_version 97943 (0.0009) [2023-12-27 19:55:59,784][106226] Updated weights for policy 0, policy_version 97953 (0.0009) [2023-12-27 19:55:59,900][106225] Updated weights for policy 1, policy_version 97843 (0.0009) [2023-12-27 19:55:59,963][106225] Updated weights for policy 1, policy_version 97853 (0.0008) [2023-12-27 19:56:00,021][106225] Updated weights for policy 1, policy_version 97863 (0.0008) [2023-12-27 19:56:00,573][106226] Updated weights for policy 0, policy_version 97963 (0.0009) [2023-12-27 19:56:00,623][106226] Updated weights for policy 0, policy_version 97973 (0.0008) [2023-12-27 19:56:00,634][106225] Updated weights for policy 1, policy_version 97873 (0.0008) [2023-12-27 19:56:00,687][106226] Updated weights for policy 0, policy_version 97983 (0.0007) [2023-12-27 19:56:00,694][106225] Updated weights for policy 1, policy_version 97883 (0.0008) [2023-12-27 19:56:00,753][106225] Updated weights for policy 1, policy_version 97893 (0.0007) [2023-12-27 19:56:00,817][106225] Updated weights for policy 1, policy_version 97903 (0.0005) [2023-12-27 19:56:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 50159616. Throughput: 0: 10019.9, 1: 9940.5. Samples: 50149232. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:01,175][105115] Avg episode reward: [(0, '-5.128'), (1, '-6.761')] [2023-12-27 19:56:01,427][106225] Updated weights for policy 1, policy_version 97913 (0.0010) [2023-12-27 19:56:01,431][106226] Updated weights for policy 0, policy_version 97993 (0.0008) [2023-12-27 19:56:01,486][106225] Updated weights for policy 1, policy_version 97923 (0.0010) [2023-12-27 19:56:01,487][106226] Updated weights for policy 0, policy_version 98003 (0.0006) [2023-12-27 19:56:01,550][106225] Updated weights for policy 1, policy_version 97933 (0.0010) [2023-12-27 19:56:01,556][106226] Updated weights for policy 0, policy_version 98013 (0.0005) [2023-12-27 19:56:01,615][106226] Updated weights for policy 0, policy_version 98023 (0.0006) [2023-12-27 19:56:02,190][106225] Updated weights for policy 1, policy_version 97943 (0.0008) [2023-12-27 19:56:02,256][106225] Updated weights for policy 1, policy_version 97953 (0.0006) [2023-12-27 19:56:02,321][106225] Updated weights for policy 1, policy_version 97963 (0.0007) [2023-12-27 19:56:02,383][106226] Updated weights for policy 0, policy_version 98033 (0.0010) [2023-12-27 19:56:02,434][106226] Updated weights for policy 0, policy_version 98043 (0.0009) [2023-12-27 19:56:02,486][106226] Updated weights for policy 0, policy_version 98053 (0.0008) [2023-12-27 19:56:03,004][106225] Updated weights for policy 1, policy_version 97973 (0.0008) [2023-12-27 19:56:03,061][106225] Updated weights for policy 1, policy_version 97983 (0.0008) [2023-12-27 19:56:03,119][106225] Updated weights for policy 1, policy_version 97993 (0.0008) [2023-12-27 19:56:03,231][106226] Updated weights for policy 0, policy_version 98063 (0.0009) [2023-12-27 19:56:03,280][106226] Updated weights for policy 0, policy_version 98073 (0.0008) [2023-12-27 19:56:03,325][106226] Updated weights for policy 0, policy_version 98083 (0.0008) [2023-12-27 19:56:03,829][106225] Updated weights for policy 1, policy_version 98003 (0.0008) [2023-12-27 19:56:03,895][106225] Updated weights for policy 1, policy_version 98013 (0.0009) [2023-12-27 19:56:03,958][106225] Updated weights for policy 1, policy_version 98023 (0.0009) [2023-12-27 19:56:04,095][106226] Updated weights for policy 0, policy_version 98093 (0.0009) [2023-12-27 19:56:04,156][106226] Updated weights for policy 0, policy_version 98103 (0.0009) [2023-12-27 19:56:04,224][106226] Updated weights for policy 0, policy_version 98113 (0.0008) [2023-12-27 19:56:04,727][106225] Updated weights for policy 1, policy_version 98033 (0.0008) [2023-12-27 19:56:04,786][106225] Updated weights for policy 1, policy_version 98043 (0.0008) [2023-12-27 19:56:04,834][106225] Updated weights for policy 1, policy_version 98053 (0.0008) [2023-12-27 19:56:04,885][106225] Updated weights for policy 1, policy_version 98063 (0.0009) [2023-12-27 19:56:04,913][106226] Updated weights for policy 0, policy_version 98123 (0.0007) [2023-12-27 19:56:04,969][106226] Updated weights for policy 0, policy_version 98133 (0.0009) [2023-12-27 19:56:05,021][106226] Updated weights for policy 0, policy_version 98143 (0.0007) [2023-12-27 19:56:05,608][106225] Updated weights for policy 1, policy_version 98073 (0.0007) [2023-12-27 19:56:05,655][106225] Updated weights for policy 1, policy_version 98083 (0.0008) [2023-12-27 19:56:05,709][106225] Updated weights for policy 1, policy_version 98093 (0.0008) [2023-12-27 19:56:05,710][106226] Updated weights for policy 0, policy_version 98153 (0.0009) [2023-12-27 19:56:05,766][106226] Updated weights for policy 0, policy_version 98163 (0.0008) [2023-12-27 19:56:05,821][106226] Updated weights for policy 0, policy_version 98173 (0.0009) [2023-12-27 19:56:05,873][106226] Updated weights for policy 0, policy_version 98183 (0.0009) [2023-12-27 19:56:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 50257920. Throughput: 0: 9982.1, 1: 9994.1. Samples: 50266736. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:06,175][105115] Avg episode reward: [(0, '-5.191'), (1, '-7.043')] [2023-12-27 19:56:06,418][106225] Updated weights for policy 1, policy_version 98103 (0.0008) [2023-12-27 19:56:06,477][106225] Updated weights for policy 1, policy_version 98113 (0.0008) [2023-12-27 19:56:06,541][106225] Updated weights for policy 1, policy_version 98123 (0.0009) [2023-12-27 19:56:06,623][106226] Updated weights for policy 0, policy_version 98193 (0.0009) [2023-12-27 19:56:06,682][106226] Updated weights for policy 0, policy_version 98203 (0.0008) [2023-12-27 19:56:06,745][106226] Updated weights for policy 0, policy_version 98213 (0.0006) [2023-12-27 19:56:07,227][106225] Updated weights for policy 1, policy_version 98133 (0.0009) [2023-12-27 19:56:07,296][106225] Updated weights for policy 1, policy_version 98143 (0.0009) [2023-12-27 19:56:07,346][106225] Updated weights for policy 1, policy_version 98153 (0.0009) [2023-12-27 19:56:07,464][106226] Updated weights for policy 0, policy_version 98223 (0.0007) [2023-12-27 19:56:07,521][106226] Updated weights for policy 0, policy_version 98233 (0.0008) [2023-12-27 19:56:07,582][106226] Updated weights for policy 0, policy_version 98243 (0.0008) [2023-12-27 19:56:08,114][106225] Updated weights for policy 1, policy_version 98163 (0.0009) [2023-12-27 19:56:08,168][106225] Updated weights for policy 1, policy_version 98173 (0.0010) [2023-12-27 19:56:08,216][106226] Updated weights for policy 0, policy_version 98253 (0.0007) [2023-12-27 19:56:08,228][106225] Updated weights for policy 1, policy_version 98183 (0.0010) [2023-12-27 19:56:08,274][106226] Updated weights for policy 0, policy_version 98263 (0.0005) [2023-12-27 19:56:08,338][106226] Updated weights for policy 0, policy_version 98273 (0.0007) [2023-12-27 19:56:08,902][106225] Updated weights for policy 1, policy_version 98193 (0.0011) [2023-12-27 19:56:08,964][106225] Updated weights for policy 1, policy_version 98203 (0.0010) [2023-12-27 19:56:08,977][106226] Updated weights for policy 0, policy_version 98283 (0.0010) [2023-12-27 19:56:09,018][106225] Updated weights for policy 1, policy_version 98213 (0.0010) [2023-12-27 19:56:09,041][106226] Updated weights for policy 0, policy_version 98293 (0.0010) [2023-12-27 19:56:09,076][106225] Updated weights for policy 1, policy_version 98223 (0.0010) [2023-12-27 19:56:09,093][106226] Updated weights for policy 0, policy_version 98303 (0.0007) [2023-12-27 19:56:09,734][106226] Updated weights for policy 0, policy_version 98313 (0.0005) [2023-12-27 19:56:09,806][106226] Updated weights for policy 0, policy_version 98323 (0.0006) [2023-12-27 19:56:09,859][106225] Updated weights for policy 1, policy_version 98233 (0.0008) [2023-12-27 19:56:09,877][106226] Updated weights for policy 0, policy_version 98333 (0.0008) [2023-12-27 19:56:09,919][106225] Updated weights for policy 1, policy_version 98243 (0.0007) [2023-12-27 19:56:09,945][106226] Updated weights for policy 0, policy_version 98343 (0.0006) [2023-12-27 19:56:09,991][106225] Updated weights for policy 1, policy_version 98253 (0.0009) [2023-12-27 19:56:10,596][106226] Updated weights for policy 0, policy_version 98353 (0.0009) [2023-12-27 19:56:10,659][106226] Updated weights for policy 0, policy_version 98363 (0.0008) [2023-12-27 19:56:10,723][106226] Updated weights for policy 0, policy_version 98374 (0.0008) [2023-12-27 19:56:10,754][106225] Updated weights for policy 1, policy_version 98263 (0.0009) [2023-12-27 19:56:10,810][106225] Updated weights for policy 1, policy_version 98273 (0.0008) [2023-12-27 19:56:10,863][106225] Updated weights for policy 1, policy_version 98283 (0.0009) [2023-12-27 19:56:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 50356224. Throughput: 0: 9994.1, 1: 10043.4. Samples: 50326484. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:11,175][105115] Avg episode reward: [(0, '-5.249'), (1, '-6.615')] [2023-12-27 19:56:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000098288_25165824.pth... [2023-12-27 19:56:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000098376_25190400.pth... [2023-12-27 19:56:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000097224_24895488.pth [2023-12-27 19:56:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000097104_24862720.pth [2023-12-27 19:56:11,399][106226] Updated weights for policy 0, policy_version 98384 (0.0009) [2023-12-27 19:56:11,457][106226] Updated weights for policy 0, policy_version 98394 (0.0009) [2023-12-27 19:56:11,516][106226] Updated weights for policy 0, policy_version 98404 (0.0008) [2023-12-27 19:56:11,622][106225] Updated weights for policy 1, policy_version 98293 (0.0009) [2023-12-27 19:56:11,691][106225] Updated weights for policy 1, policy_version 98303 (0.0009) [2023-12-27 19:56:11,765][106225] Updated weights for policy 1, policy_version 98313 (0.0009) [2023-12-27 19:56:12,350][106226] Updated weights for policy 0, policy_version 98414 (0.0009) [2023-12-27 19:56:12,418][106226] Updated weights for policy 0, policy_version 98424 (0.0008) [2023-12-27 19:56:12,478][106225] Updated weights for policy 1, policy_version 98323 (0.0008) [2023-12-27 19:56:12,487][106226] Updated weights for policy 0, policy_version 98434 (0.0008) [2023-12-27 19:56:12,542][106225] Updated weights for policy 1, policy_version 98333 (0.0006) [2023-12-27 19:56:12,612][106225] Updated weights for policy 1, policy_version 98343 (0.0008) [2023-12-27 19:56:13,185][106226] Updated weights for policy 0, policy_version 98444 (0.0009) [2023-12-27 19:56:13,231][106225] Updated weights for policy 1, policy_version 98353 (0.0011) [2023-12-27 19:56:13,242][106226] Updated weights for policy 0, policy_version 98454 (0.0010) [2023-12-27 19:56:13,278][106225] Updated weights for policy 1, policy_version 98363 (0.0010) [2023-12-27 19:56:13,289][106226] Updated weights for policy 0, policy_version 98464 (0.0010) [2023-12-27 19:56:13,333][106225] Updated weights for policy 1, policy_version 98373 (0.0010) [2023-12-27 19:56:13,389][106225] Updated weights for policy 1, policy_version 98383 (0.0010) [2023-12-27 19:56:14,032][106226] Updated weights for policy 0, policy_version 98474 (0.0009) [2023-12-27 19:56:14,098][106226] Updated weights for policy 0, policy_version 98484 (0.0006) [2023-12-27 19:56:14,116][106225] Updated weights for policy 1, policy_version 98393 (0.0010) [2023-12-27 19:56:14,162][106226] Updated weights for policy 0, policy_version 98494 (0.0007) [2023-12-27 19:56:14,180][106225] Updated weights for policy 1, policy_version 98403 (0.0009) [2023-12-27 19:56:14,228][106226] Updated weights for policy 0, policy_version 98504 (0.0010) [2023-12-27 19:56:14,245][106225] Updated weights for policy 1, policy_version 98413 (0.0008) [2023-12-27 19:56:14,888][106225] Updated weights for policy 1, policy_version 98423 (0.0010) [2023-12-27 19:56:14,892][106226] Updated weights for policy 0, policy_version 98514 (0.0011) [2023-12-27 19:56:14,950][106225] Updated weights for policy 1, policy_version 98433 (0.0010) [2023-12-27 19:56:14,954][106226] Updated weights for policy 0, policy_version 98524 (0.0011) [2023-12-27 19:56:15,012][106225] Updated weights for policy 1, policy_version 98443 (0.0010) [2023-12-27 19:56:15,019][106226] Updated weights for policy 0, policy_version 98534 (0.0011) [2023-12-27 19:56:15,669][106226] Updated weights for policy 0, policy_version 98544 (0.0005) [2023-12-27 19:56:15,704][106225] Updated weights for policy 1, policy_version 98453 (0.0010) [2023-12-27 19:56:15,723][106226] Updated weights for policy 0, policy_version 98554 (0.0005) [2023-12-27 19:56:15,751][106225] Updated weights for policy 1, policy_version 98463 (0.0010) [2023-12-27 19:56:15,771][106226] Updated weights for policy 0, policy_version 98564 (0.0005) [2023-12-27 19:56:15,808][106225] Updated weights for policy 1, policy_version 98473 (0.0010) [2023-12-27 19:56:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 50454528. Throughput: 0: 9954.4, 1: 9981.1. Samples: 50442992. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:16,175][105115] Avg episode reward: [(0, '-5.149'), (1, '-6.376')] [2023-12-27 19:56:16,448][106226] Updated weights for policy 0, policy_version 98574 (0.0010) [2023-12-27 19:56:16,502][106225] Updated weights for policy 1, policy_version 98483 (0.0009) [2023-12-27 19:56:16,508][106226] Updated weights for policy 0, policy_version 98584 (0.0011) [2023-12-27 19:56:16,566][106226] Updated weights for policy 0, policy_version 98594 (0.0007) [2023-12-27 19:56:16,570][106225] Updated weights for policy 1, policy_version 98493 (0.0008) [2023-12-27 19:56:16,632][106225] Updated weights for policy 1, policy_version 98503 (0.0007) [2023-12-27 19:56:17,144][106226] Updated weights for policy 0, policy_version 98604 (0.0005) [2023-12-27 19:56:17,176][106225] Updated weights for policy 1, policy_version 98513 (0.0006) [2023-12-27 19:56:17,208][106226] Updated weights for policy 0, policy_version 98614 (0.0008) [2023-12-27 19:56:17,238][106225] Updated weights for policy 1, policy_version 98523 (0.0010) [2023-12-27 19:56:17,268][106226] Updated weights for policy 0, policy_version 98624 (0.0010) [2023-12-27 19:56:17,292][106225] Updated weights for policy 1, policy_version 98533 (0.0010) [2023-12-27 19:56:17,347][106225] Updated weights for policy 1, policy_version 98543 (0.0010) [2023-12-27 19:56:17,914][106226] Updated weights for policy 0, policy_version 98634 (0.0009) [2023-12-27 19:56:17,939][106225] Updated weights for policy 1, policy_version 98553 (0.0010) [2023-12-27 19:56:17,972][106226] Updated weights for policy 0, policy_version 98644 (0.0006) [2023-12-27 19:56:17,989][106225] Updated weights for policy 1, policy_version 98563 (0.0010) [2023-12-27 19:56:18,030][106226] Updated weights for policy 0, policy_version 98654 (0.0006) [2023-12-27 19:56:18,057][106225] Updated weights for policy 1, policy_version 98573 (0.0011) [2023-12-27 19:56:18,078][106226] Updated weights for policy 0, policy_version 98664 (0.0005) [2023-12-27 19:56:18,684][106226] Updated weights for policy 0, policy_version 98674 (0.0007) [2023-12-27 19:56:18,735][106226] Updated weights for policy 0, policy_version 98684 (0.0008) [2023-12-27 19:56:18,793][106225] Updated weights for policy 1, policy_version 98583 (0.0007) [2023-12-27 19:56:18,793][106226] Updated weights for policy 0, policy_version 98694 (0.0008) [2023-12-27 19:56:18,853][106225] Updated weights for policy 1, policy_version 98593 (0.0005) [2023-12-27 19:56:18,907][106225] Updated weights for policy 1, policy_version 98603 (0.0006) [2023-12-27 19:56:19,506][106226] Updated weights for policy 0, policy_version 98704 (0.0008) [2023-12-27 19:56:19,573][106226] Updated weights for policy 0, policy_version 98714 (0.0008) [2023-12-27 19:56:19,626][106226] Updated weights for policy 0, policy_version 98724 (0.0007) [2023-12-27 19:56:19,699][106225] Updated weights for policy 1, policy_version 98613 (0.0008) [2023-12-27 19:56:19,759][106225] Updated weights for policy 1, policy_version 98623 (0.0008) [2023-12-27 19:56:19,829][106225] Updated weights for policy 1, policy_version 98633 (0.0008) [2023-12-27 19:56:20,354][106226] Updated weights for policy 0, policy_version 98734 (0.0009) [2023-12-27 19:56:20,417][106226] Updated weights for policy 0, policy_version 98744 (0.0008) [2023-12-27 19:56:20,481][106226] Updated weights for policy 0, policy_version 98754 (0.0008) [2023-12-27 19:56:20,588][106225] Updated weights for policy 1, policy_version 98643 (0.0008) [2023-12-27 19:56:20,655][106225] Updated weights for policy 1, policy_version 98653 (0.0008) [2023-12-27 19:56:20,721][106225] Updated weights for policy 1, policy_version 98663 (0.0009) [2023-12-27 19:56:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 50552832. Throughput: 0: 9947.8, 1: 9952.1. Samples: 50564516. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:21,175][105115] Avg episode reward: [(0, '-5.617'), (1, '-6.937')] [2023-12-27 19:56:21,269][106226] Updated weights for policy 0, policy_version 98764 (0.0008) [2023-12-27 19:56:21,325][106226] Updated weights for policy 0, policy_version 98774 (0.0008) [2023-12-27 19:56:21,396][106226] Updated weights for policy 0, policy_version 98784 (0.0008) [2023-12-27 19:56:21,504][106225] Updated weights for policy 1, policy_version 98673 (0.0009) [2023-12-27 19:56:21,557][106225] Updated weights for policy 1, policy_version 98683 (0.0009) [2023-12-27 19:56:21,611][106225] Updated weights for policy 1, policy_version 98693 (0.0008) [2023-12-27 19:56:21,679][106225] Updated weights for policy 1, policy_version 98703 (0.0009) [2023-12-27 19:56:22,158][106226] Updated weights for policy 0, policy_version 98794 (0.0008) [2023-12-27 19:56:22,223][106226] Updated weights for policy 0, policy_version 98804 (0.0007) [2023-12-27 19:56:22,288][106226] Updated weights for policy 0, policy_version 98814 (0.0009) [2023-12-27 19:56:22,350][106226] Updated weights for policy 0, policy_version 98824 (0.0009) [2023-12-27 19:56:22,437][106225] Updated weights for policy 1, policy_version 98713 (0.0007) [2023-12-27 19:56:22,497][106225] Updated weights for policy 1, policy_version 98723 (0.0009) [2023-12-27 19:56:22,553][106225] Updated weights for policy 1, policy_version 98733 (0.0008) [2023-12-27 19:56:23,109][106226] Updated weights for policy 0, policy_version 98834 (0.0008) [2023-12-27 19:56:23,147][106225] Updated weights for policy 1, policy_version 98743 (0.0007) [2023-12-27 19:56:23,172][106226] Updated weights for policy 0, policy_version 98844 (0.0009) [2023-12-27 19:56:23,208][106225] Updated weights for policy 1, policy_version 98753 (0.0008) [2023-12-27 19:56:23,227][106226] Updated weights for policy 0, policy_version 98854 (0.0006) [2023-12-27 19:56:23,269][106225] Updated weights for policy 1, policy_version 98763 (0.0009) [2023-12-27 19:56:23,959][106226] Updated weights for policy 0, policy_version 98864 (0.0008) [2023-12-27 19:56:23,971][106225] Updated weights for policy 1, policy_version 98773 (0.0007) [2023-12-27 19:56:24,005][106226] Updated weights for policy 0, policy_version 98874 (0.0008) [2023-12-27 19:56:24,026][106225] Updated weights for policy 1, policy_version 98783 (0.0005) [2023-12-27 19:56:24,060][106226] Updated weights for policy 0, policy_version 98884 (0.0007) [2023-12-27 19:56:24,091][106225] Updated weights for policy 1, policy_version 98793 (0.0007) [2023-12-27 19:56:24,673][106226] Updated weights for policy 0, policy_version 98894 (0.0007) [2023-12-27 19:56:24,734][106226] Updated weights for policy 0, policy_version 98904 (0.0009) [2023-12-27 19:56:24,788][106226] Updated weights for policy 0, policy_version 98914 (0.0006) [2023-12-27 19:56:24,808][106225] Updated weights for policy 1, policy_version 98803 (0.0008) [2023-12-27 19:56:24,861][106225] Updated weights for policy 1, policy_version 98813 (0.0008) [2023-12-27 19:56:24,909][106225] Updated weights for policy 1, policy_version 98823 (0.0008) [2023-12-27 19:56:25,491][106226] Updated weights for policy 0, policy_version 98924 (0.0008) [2023-12-27 19:56:25,548][106226] Updated weights for policy 0, policy_version 98934 (0.0011) [2023-12-27 19:56:25,592][106225] Updated weights for policy 1, policy_version 98833 (0.0008) [2023-12-27 19:56:25,594][106226] Updated weights for policy 0, policy_version 98944 (0.0010) [2023-12-27 19:56:25,650][106225] Updated weights for policy 1, policy_version 98843 (0.0006) [2023-12-27 19:56:25,711][106225] Updated weights for policy 1, policy_version 98853 (0.0008) [2023-12-27 19:56:25,766][106225] Updated weights for policy 1, policy_version 98863 (0.0008) [2023-12-27 19:56:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 50651136. Throughput: 0: 9909.6, 1: 9940.9. Samples: 50621260. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:26,176][105115] Avg episode reward: [(0, '-5.439'), (1, '-7.002')] [2023-12-27 19:56:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000098952_25337856.pth... [2023-12-27 19:56:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000098864_25313280.pth... [2023-12-27 19:56:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000097800_25042944.pth [2023-12-27 19:56:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000097712_25018368.pth [2023-12-27 19:56:26,317][106226] Updated weights for policy 0, policy_version 98954 (0.0010) [2023-12-27 19:56:26,365][106226] Updated weights for policy 0, policy_version 98964 (0.0010) [2023-12-27 19:56:26,421][106226] Updated weights for policy 0, policy_version 98974 (0.0009) [2023-12-27 19:56:26,481][106226] Updated weights for policy 0, policy_version 98984 (0.0007) [2023-12-27 19:56:26,490][106225] Updated weights for policy 1, policy_version 98873 (0.0008) [2023-12-27 19:56:26,550][106225] Updated weights for policy 1, policy_version 98883 (0.0008) [2023-12-27 19:56:26,604][106225] Updated weights for policy 1, policy_version 98893 (0.0008) [2023-12-27 19:56:27,162][106226] Updated weights for policy 0, policy_version 98994 (0.0005) [2023-12-27 19:56:27,215][106225] Updated weights for policy 1, policy_version 98903 (0.0010) [2023-12-27 19:56:27,224][106226] Updated weights for policy 0, policy_version 99004 (0.0006) [2023-12-27 19:56:27,261][106225] Updated weights for policy 1, policy_version 98913 (0.0010) [2023-12-27 19:56:27,275][106226] Updated weights for policy 0, policy_version 99014 (0.0006) [2023-12-27 19:56:27,312][106225] Updated weights for policy 1, policy_version 98923 (0.0010) [2023-12-27 19:56:27,921][106226] Updated weights for policy 0, policy_version 99024 (0.0007) [2023-12-27 19:56:27,970][106226] Updated weights for policy 0, policy_version 99034 (0.0005) [2023-12-27 19:56:28,028][106226] Updated weights for policy 0, policy_version 99044 (0.0005) [2023-12-27 19:56:28,062][106225] Updated weights for policy 1, policy_version 98933 (0.0008) [2023-12-27 19:56:28,127][106225] Updated weights for policy 1, policy_version 98943 (0.0006) [2023-12-27 19:56:28,192][106225] Updated weights for policy 1, policy_version 98953 (0.0006) [2023-12-27 19:56:28,634][106226] Updated weights for policy 0, policy_version 99054 (0.0009) [2023-12-27 19:56:28,693][106226] Updated weights for policy 0, policy_version 99064 (0.0011) [2023-12-27 19:56:28,704][106225] Updated weights for policy 1, policy_version 98963 (0.0006) [2023-12-27 19:56:28,747][106226] Updated weights for policy 0, policy_version 99074 (0.0011) [2023-12-27 19:56:28,757][106225] Updated weights for policy 1, policy_version 98973 (0.0007) [2023-12-27 19:56:28,819][106225] Updated weights for policy 1, policy_version 98983 (0.0007) [2023-12-27 19:56:29,476][106226] Updated weights for policy 0, policy_version 99084 (0.0008) [2023-12-27 19:56:29,510][106225] Updated weights for policy 1, policy_version 98993 (0.0006) [2023-12-27 19:56:29,538][106226] Updated weights for policy 0, policy_version 99094 (0.0008) [2023-12-27 19:56:29,564][106225] Updated weights for policy 1, policy_version 99003 (0.0005) [2023-12-27 19:56:29,595][106226] Updated weights for policy 0, policy_version 99104 (0.0008) [2023-12-27 19:56:29,619][106225] Updated weights for policy 1, policy_version 99013 (0.0007) [2023-12-27 19:56:29,672][106225] Updated weights for policy 1, policy_version 99023 (0.0007) [2023-12-27 19:56:30,223][106226] Updated weights for policy 0, policy_version 99114 (0.0010) [2023-12-27 19:56:30,283][106226] Updated weights for policy 0, policy_version 99124 (0.0011) [2023-12-27 19:56:30,337][106226] Updated weights for policy 0, policy_version 99134 (0.0010) [2023-12-27 19:56:30,389][106226] Updated weights for policy 0, policy_version 99144 (0.0010) [2023-12-27 19:56:30,439][106225] Updated weights for policy 1, policy_version 99033 (0.0008) [2023-12-27 19:56:30,500][106225] Updated weights for policy 1, policy_version 99043 (0.0005) [2023-12-27 19:56:30,549][106225] Updated weights for policy 1, policy_version 99053 (0.0005) [2023-12-27 19:56:31,067][106226] Updated weights for policy 0, policy_version 99154 (0.0014) [2023-12-27 19:56:31,136][106226] Updated weights for policy 0, policy_version 99164 (0.0008) [2023-12-27 19:56:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 50749440. Throughput: 0: 10016.3, 1: 10002.5. Samples: 50745384. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:31,175][105115] Avg episode reward: [(0, '-5.272'), (1, '-7.069')] [2023-12-27 19:56:31,205][106226] Updated weights for policy 0, policy_version 99174 (0.0010) [2023-12-27 19:56:31,243][106225] Updated weights for policy 1, policy_version 99063 (0.0006) [2023-12-27 19:56:31,312][106225] Updated weights for policy 1, policy_version 99073 (0.0008) [2023-12-27 19:56:31,381][106225] Updated weights for policy 1, policy_version 99083 (0.0008) [2023-12-27 19:56:31,928][106226] Updated weights for policy 0, policy_version 99184 (0.0011) [2023-12-27 19:56:31,981][106226] Updated weights for policy 0, policy_version 99194 (0.0010) [2023-12-27 19:56:32,029][106226] Updated weights for policy 0, policy_version 99204 (0.0010) [2023-12-27 19:56:32,098][106225] Updated weights for policy 1, policy_version 99093 (0.0007) [2023-12-27 19:56:32,150][106225] Updated weights for policy 1, policy_version 99103 (0.0005) [2023-12-27 19:56:32,214][106225] Updated weights for policy 1, policy_version 99113 (0.0005) [2023-12-27 19:56:32,721][106226] Updated weights for policy 0, policy_version 99214 (0.0010) [2023-12-27 19:56:32,773][106226] Updated weights for policy 0, policy_version 99224 (0.0010) [2023-12-27 19:56:32,826][106226] Updated weights for policy 0, policy_version 99234 (0.0010) [2023-12-27 19:56:32,910][106225] Updated weights for policy 1, policy_version 99123 (0.0007) [2023-12-27 19:56:32,975][106225] Updated weights for policy 1, policy_version 99133 (0.0005) [2023-12-27 19:56:33,023][106225] Updated weights for policy 1, policy_version 99143 (0.0005) [2023-12-27 19:56:33,446][106226] Updated weights for policy 0, policy_version 99244 (0.0008) [2023-12-27 19:56:33,501][106226] Updated weights for policy 0, policy_version 99254 (0.0005) [2023-12-27 19:56:33,549][106226] Updated weights for policy 0, policy_version 99264 (0.0008) [2023-12-27 19:56:33,664][106225] Updated weights for policy 1, policy_version 99153 (0.0006) [2023-12-27 19:56:33,707][106225] Updated weights for policy 1, policy_version 99163 (0.0010) [2023-12-27 19:56:33,767][106225] Updated weights for policy 1, policy_version 99173 (0.0007) [2023-12-27 19:56:33,819][106225] Updated weights for policy 1, policy_version 99183 (0.0009) [2023-12-27 19:56:34,182][106226] Updated weights for policy 0, policy_version 99274 (0.0006) [2023-12-27 19:56:34,239][106226] Updated weights for policy 0, policy_version 99284 (0.0009) [2023-12-27 19:56:34,303][106226] Updated weights for policy 0, policy_version 99294 (0.0010) [2023-12-27 19:56:34,367][106226] Updated weights for policy 0, policy_version 99304 (0.0009) [2023-12-27 19:56:34,510][106225] Updated weights for policy 1, policy_version 99193 (0.0008) [2023-12-27 19:56:34,576][106225] Updated weights for policy 1, policy_version 99203 (0.0008) [2023-12-27 19:56:34,633][106225] Updated weights for policy 1, policy_version 99213 (0.0009) [2023-12-27 19:56:35,177][106226] Updated weights for policy 0, policy_version 99314 (0.0008) [2023-12-27 19:56:35,235][106226] Updated weights for policy 0, policy_version 99324 (0.0006) [2023-12-27 19:56:35,237][106225] Updated weights for policy 1, policy_version 99223 (0.0009) [2023-12-27 19:56:35,280][106225] Updated weights for policy 1, policy_version 99233 (0.0010) [2023-12-27 19:56:35,290][106226] Updated weights for policy 0, policy_version 99334 (0.0006) [2023-12-27 19:56:35,330][106225] Updated weights for policy 1, policy_version 99243 (0.0010) [2023-12-27 19:56:35,939][106225] Updated weights for policy 1, policy_version 99253 (0.0008) [2023-12-27 19:56:35,995][106225] Updated weights for policy 1, policy_version 99263 (0.0005) [2023-12-27 19:56:36,056][106225] Updated weights for policy 1, policy_version 99273 (0.0005) [2023-12-27 19:56:36,101][106226] Updated weights for policy 0, policy_version 99344 (0.0006) [2023-12-27 19:56:36,172][106226] Updated weights for policy 0, policy_version 99354 (0.0008) [2023-12-27 19:56:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 50855936. Throughput: 0: 9926.0, 1: 10044.4. Samples: 50865832. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:36,175][105115] Avg episode reward: [(0, '-5.498'), (1, '-6.775')] [2023-12-27 19:56:36,223][106226] Updated weights for policy 0, policy_version 99364 (0.0008) [2023-12-27 19:56:36,681][106225] Updated weights for policy 1, policy_version 99283 (0.0008) [2023-12-27 19:56:36,741][106225] Updated weights for policy 1, policy_version 99293 (0.0011) [2023-12-27 19:56:36,801][106225] Updated weights for policy 1, policy_version 99303 (0.0010) [2023-12-27 19:56:36,965][106226] Updated weights for policy 0, policy_version 99374 (0.0006) [2023-12-27 19:56:37,024][106226] Updated weights for policy 0, policy_version 99384 (0.0005) [2023-12-27 19:56:37,074][106226] Updated weights for policy 0, policy_version 99394 (0.0008) [2023-12-27 19:56:37,373][106225] Updated weights for policy 1, policy_version 99313 (0.0006) [2023-12-27 19:56:37,422][106225] Updated weights for policy 1, policy_version 99323 (0.0005) [2023-12-27 19:56:37,482][106225] Updated weights for policy 1, policy_version 99333 (0.0007) [2023-12-27 19:56:37,547][106225] Updated weights for policy 1, policy_version 99343 (0.0010) [2023-12-27 19:56:37,670][106226] Updated weights for policy 0, policy_version 99404 (0.0008) [2023-12-27 19:56:37,738][106226] Updated weights for policy 0, policy_version 99414 (0.0005) [2023-12-27 19:56:37,804][106226] Updated weights for policy 0, policy_version 99424 (0.0005) [2023-12-27 19:56:38,190][106225] Updated weights for policy 1, policy_version 99353 (0.0009) [2023-12-27 19:56:38,253][106225] Updated weights for policy 1, policy_version 99363 (0.0010) [2023-12-27 19:56:38,322][106225] Updated weights for policy 1, policy_version 99373 (0.0011) [2023-12-27 19:56:38,462][106226] Updated weights for policy 0, policy_version 99434 (0.0008) [2023-12-27 19:56:38,521][106226] Updated weights for policy 0, policy_version 99444 (0.0008) [2023-12-27 19:56:38,579][106226] Updated weights for policy 0, policy_version 99454 (0.0007) [2023-12-27 19:56:38,642][106226] Updated weights for policy 0, policy_version 99464 (0.0006) [2023-12-27 19:56:39,058][106225] Updated weights for policy 1, policy_version 99383 (0.0010) [2023-12-27 19:56:39,111][106225] Updated weights for policy 1, policy_version 99393 (0.0010) [2023-12-27 19:56:39,161][106225] Updated weights for policy 1, policy_version 99403 (0.0010) [2023-12-27 19:56:39,369][106226] Updated weights for policy 0, policy_version 99474 (0.0008) [2023-12-27 19:56:39,437][106226] Updated weights for policy 0, policy_version 99484 (0.0009) [2023-12-27 19:56:39,494][106226] Updated weights for policy 0, policy_version 99494 (0.0008) [2023-12-27 19:56:39,936][106225] Updated weights for policy 1, policy_version 99413 (0.0010) [2023-12-27 19:56:39,996][106225] Updated weights for policy 1, policy_version 99423 (0.0010) [2023-12-27 19:56:40,055][106225] Updated weights for policy 1, policy_version 99433 (0.0011) [2023-12-27 19:56:40,264][106226] Updated weights for policy 0, policy_version 99504 (0.0008) [2023-12-27 19:56:40,323][106226] Updated weights for policy 0, policy_version 99514 (0.0008) [2023-12-27 19:56:40,386][106226] Updated weights for policy 0, policy_version 99524 (0.0008) [2023-12-27 19:56:40,796][106225] Updated weights for policy 1, policy_version 99443 (0.0010) [2023-12-27 19:56:40,859][106225] Updated weights for policy 1, policy_version 99453 (0.0010) [2023-12-27 19:56:40,912][106225] Updated weights for policy 1, policy_version 99463 (0.0010) [2023-12-27 19:56:41,134][106226] Updated weights for policy 0, policy_version 99534 (0.0008) [2023-12-27 19:56:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 50954240. Throughput: 0: 9936.5, 1: 10107.8. Samples: 50928628. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:41,175][105115] Avg episode reward: [(0, '-5.214'), (1, '-7.010')] [2023-12-27 19:56:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000099472_25468928.pth... [2023-12-27 19:56:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000098288_25165824.pth [2023-12-27 19:56:41,203][106226] Updated weights for policy 0, policy_version 99544 (0.0008) [2023-12-27 19:56:41,270][106226] Updated weights for policy 0, policy_version 99554 (0.0008) [2023-12-27 19:56:41,307][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000099560_25493504.pth... [2023-12-27 19:56:41,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000098376_25190400.pth [2023-12-27 19:56:41,669][106225] Updated weights for policy 1, policy_version 99473 (0.0010) [2023-12-27 19:56:41,732][106225] Updated weights for policy 1, policy_version 99483 (0.0010) [2023-12-27 19:56:41,810][106225] Updated weights for policy 1, policy_version 99493 (0.0010) [2023-12-27 19:56:41,880][106225] Updated weights for policy 1, policy_version 99503 (0.0011) [2023-12-27 19:56:42,040][106226] Updated weights for policy 0, policy_version 99564 (0.0008) [2023-12-27 19:56:42,096][106226] Updated weights for policy 0, policy_version 99574 (0.0010) [2023-12-27 19:56:42,154][106226] Updated weights for policy 0, policy_version 99584 (0.0011) [2023-12-27 19:56:42,589][106225] Updated weights for policy 1, policy_version 99513 (0.0010) [2023-12-27 19:56:42,646][106225] Updated weights for policy 1, policy_version 99523 (0.0010) [2023-12-27 19:56:42,703][106225] Updated weights for policy 1, policy_version 99533 (0.0010) [2023-12-27 19:56:42,865][106226] Updated weights for policy 0, policy_version 99594 (0.0010) [2023-12-27 19:56:42,923][106226] Updated weights for policy 0, policy_version 99604 (0.0006) [2023-12-27 19:56:42,976][106226] Updated weights for policy 0, policy_version 99614 (0.0007) [2023-12-27 19:56:43,026][106226] Updated weights for policy 0, policy_version 99624 (0.0008) [2023-12-27 19:56:43,407][106225] Updated weights for policy 1, policy_version 99543 (0.0010) [2023-12-27 19:56:43,463][106225] Updated weights for policy 1, policy_version 99553 (0.0010) [2023-12-27 19:56:43,529][106225] Updated weights for policy 1, policy_version 99563 (0.0010) [2023-12-27 19:56:43,712][106226] Updated weights for policy 0, policy_version 99634 (0.0007) [2023-12-27 19:56:43,768][106226] Updated weights for policy 0, policy_version 99644 (0.0008) [2023-12-27 19:56:43,820][106226] Updated weights for policy 0, policy_version 99654 (0.0006) [2023-12-27 19:56:44,201][106225] Updated weights for policy 1, policy_version 99573 (0.0010) [2023-12-27 19:56:44,252][106225] Updated weights for policy 1, policy_version 99583 (0.0010) [2023-12-27 19:56:44,306][106225] Updated weights for policy 1, policy_version 99593 (0.0010) [2023-12-27 19:56:44,611][106226] Updated weights for policy 0, policy_version 99664 (0.0009) [2023-12-27 19:56:44,661][106226] Updated weights for policy 0, policy_version 99674 (0.0010) [2023-12-27 19:56:44,716][106226] Updated weights for policy 0, policy_version 99684 (0.0008) [2023-12-27 19:56:45,091][106225] Updated weights for policy 1, policy_version 99603 (0.0010) [2023-12-27 19:56:45,162][106225] Updated weights for policy 1, policy_version 99613 (0.0011) [2023-12-27 19:56:45,237][106225] Updated weights for policy 1, policy_version 99623 (0.0011) [2023-12-27 19:56:45,340][106226] Updated weights for policy 0, policy_version 99694 (0.0005) [2023-12-27 19:56:45,399][106226] Updated weights for policy 0, policy_version 99704 (0.0006) [2023-12-27 19:56:45,460][106226] Updated weights for policy 0, policy_version 99714 (0.0009) [2023-12-27 19:56:45,854][106225] Updated weights for policy 1, policy_version 99633 (0.0009) [2023-12-27 19:56:45,915][106225] Updated weights for policy 1, policy_version 99643 (0.0009) [2023-12-27 19:56:45,973][106225] Updated weights for policy 1, policy_version 99653 (0.0008) [2023-12-27 19:56:46,030][106225] Updated weights for policy 1, policy_version 99663 (0.0010) [2023-12-27 19:56:46,138][106226] Updated weights for policy 0, policy_version 99724 (0.0009) [2023-12-27 19:56:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 51052544. Throughput: 0: 9855.7, 1: 9988.9. Samples: 51042240. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:46,175][105115] Avg episode reward: [(0, '-5.355'), (1, '-7.020')] [2023-12-27 19:56:46,184][106226] Updated weights for policy 0, policy_version 99734 (0.0007) [2023-12-27 19:56:46,238][106226] Updated weights for policy 0, policy_version 99744 (0.0007) [2023-12-27 19:56:46,705][106225] Updated weights for policy 1, policy_version 99673 (0.0009) [2023-12-27 19:56:46,763][106225] Updated weights for policy 1, policy_version 99683 (0.0009) [2023-12-27 19:56:46,823][106225] Updated weights for policy 1, policy_version 99693 (0.0010) [2023-12-27 19:56:47,024][106226] Updated weights for policy 0, policy_version 99754 (0.0008) [2023-12-27 19:56:47,090][106226] Updated weights for policy 0, policy_version 99764 (0.0008) [2023-12-27 19:56:47,148][106226] Updated weights for policy 0, policy_version 99774 (0.0009) [2023-12-27 19:56:47,204][106226] Updated weights for policy 0, policy_version 99784 (0.0007) [2023-12-27 19:56:47,413][106225] Updated weights for policy 1, policy_version 99703 (0.0005) [2023-12-27 19:56:47,467][106225] Updated weights for policy 1, policy_version 99713 (0.0007) [2023-12-27 19:56:47,529][106225] Updated weights for policy 1, policy_version 99723 (0.0008) [2023-12-27 19:56:47,823][106226] Updated weights for policy 0, policy_version 99794 (0.0011) [2023-12-27 19:56:47,886][106226] Updated weights for policy 0, policy_version 99804 (0.0011) [2023-12-27 19:56:47,948][106226] Updated weights for policy 0, policy_version 99814 (0.0010) [2023-12-27 19:56:48,214][106225] Updated weights for policy 1, policy_version 99733 (0.0010) [2023-12-27 19:56:48,266][106225] Updated weights for policy 1, policy_version 99743 (0.0010) [2023-12-27 19:56:48,316][106225] Updated weights for policy 1, policy_version 99753 (0.0010) [2023-12-27 19:56:48,653][106226] Updated weights for policy 0, policy_version 99824 (0.0008) [2023-12-27 19:56:48,712][106226] Updated weights for policy 0, policy_version 99834 (0.0008) [2023-12-27 19:56:48,763][106226] Updated weights for policy 0, policy_version 99844 (0.0008) [2023-12-27 19:56:49,061][106225] Updated weights for policy 1, policy_version 99763 (0.0009) [2023-12-27 19:56:49,122][106225] Updated weights for policy 1, policy_version 99773 (0.0010) [2023-12-27 19:56:49,179][106225] Updated weights for policy 1, policy_version 99783 (0.0010) [2023-12-27 19:56:49,531][106226] Updated weights for policy 0, policy_version 99854 (0.0007) [2023-12-27 19:56:49,589][106226] Updated weights for policy 0, policy_version 99864 (0.0008) [2023-12-27 19:56:49,653][106226] Updated weights for policy 0, policy_version 99874 (0.0009) [2023-12-27 19:56:49,884][106225] Updated weights for policy 1, policy_version 99793 (0.0010) [2023-12-27 19:56:49,957][106225] Updated weights for policy 1, policy_version 99803 (0.0008) [2023-12-27 19:56:50,017][106225] Updated weights for policy 1, policy_version 99813 (0.0008) [2023-12-27 19:56:50,064][106225] Updated weights for policy 1, policy_version 99823 (0.0008) [2023-12-27 19:56:50,429][106226] Updated weights for policy 0, policy_version 99884 (0.0009) [2023-12-27 19:56:50,492][106226] Updated weights for policy 0, policy_version 99894 (0.0006) [2023-12-27 19:56:50,552][106226] Updated weights for policy 0, policy_version 99904 (0.0005) [2023-12-27 19:56:50,719][106225] Updated weights for policy 1, policy_version 99833 (0.0007) [2023-12-27 19:56:50,772][106225] Updated weights for policy 1, policy_version 99843 (0.0009) [2023-12-27 19:56:50,823][106225] Updated weights for policy 1, policy_version 99853 (0.0008) [2023-12-27 19:56:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 51150848. Throughput: 0: 9905.1, 1: 10004.1. Samples: 51162648. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:51,175][105115] Avg episode reward: [(0, '-5.280'), (1, '-6.798')] [2023-12-27 19:56:51,247][106226] Updated weights for policy 0, policy_version 99914 (0.0008) [2023-12-27 19:56:51,303][106226] Updated weights for policy 0, policy_version 99924 (0.0008) [2023-12-27 19:56:51,368][106226] Updated weights for policy 0, policy_version 99934 (0.0009) [2023-12-27 19:56:51,430][106226] Updated weights for policy 0, policy_version 99944 (0.0007) [2023-12-27 19:56:51,573][106225] Updated weights for policy 1, policy_version 99863 (0.0008) [2023-12-27 19:56:51,638][106225] Updated weights for policy 1, policy_version 99873 (0.0008) [2023-12-27 19:56:51,702][106225] Updated weights for policy 1, policy_version 99883 (0.0008) [2023-12-27 19:56:52,246][106226] Updated weights for policy 0, policy_version 99954 (0.0008) [2023-12-27 19:56:52,306][106226] Updated weights for policy 0, policy_version 99964 (0.0008) [2023-12-27 19:56:52,360][106225] Updated weights for policy 1, policy_version 99893 (0.0007) [2023-12-27 19:56:52,372][106226] Updated weights for policy 0, policy_version 99974 (0.0008) [2023-12-27 19:56:52,419][106225] Updated weights for policy 1, policy_version 99903 (0.0007) [2023-12-27 19:56:52,475][106225] Updated weights for policy 1, policy_version 99913 (0.0008) [2023-12-27 19:56:53,038][106226] Updated weights for policy 0, policy_version 99984 (0.0006) [2023-12-27 19:56:53,085][106226] Updated weights for policy 0, policy_version 99994 (0.0005) [2023-12-27 19:56:53,134][106226] Updated weights for policy 0, policy_version 100004 (0.0005) [2023-12-27 19:56:53,165][106225] Updated weights for policy 1, policy_version 99923 (0.0008) [2023-12-27 19:56:53,210][106225] Updated weights for policy 1, policy_version 99933 (0.0006) [2023-12-27 19:56:53,260][106225] Updated weights for policy 1, policy_version 99943 (0.0008) [2023-12-27 19:56:53,667][106226] Updated weights for policy 0, policy_version 100014 (0.0005) [2023-12-27 19:56:53,733][106226] Updated weights for policy 0, policy_version 100024 (0.0005) [2023-12-27 19:56:53,799][106226] Updated weights for policy 0, policy_version 100034 (0.0005) [2023-12-27 19:56:53,964][106225] Updated weights for policy 1, policy_version 99953 (0.0008) [2023-12-27 19:56:54,016][106225] Updated weights for policy 1, policy_version 99963 (0.0008) [2023-12-27 19:56:54,077][106225] Updated weights for policy 1, policy_version 99973 (0.0008) [2023-12-27 19:56:54,144][106225] Updated weights for policy 1, policy_version 99983 (0.0005) [2023-12-27 19:56:54,320][106226] Updated weights for policy 0, policy_version 100044 (0.0008) [2023-12-27 19:56:54,380][106226] Updated weights for policy 0, policy_version 100054 (0.0011) [2023-12-27 19:56:54,435][106226] Updated weights for policy 0, policy_version 100064 (0.0007) [2023-12-27 19:56:54,761][106225] Updated weights for policy 1, policy_version 99993 (0.0010) [2023-12-27 19:56:54,829][106225] Updated weights for policy 1, policy_version 100003 (0.0010) [2023-12-27 19:56:54,894][106225] Updated weights for policy 1, policy_version 100013 (0.0008) [2023-12-27 19:56:54,997][106226] Updated weights for policy 0, policy_version 100074 (0.0005) [2023-12-27 19:56:55,064][106226] Updated weights for policy 0, policy_version 100084 (0.0005) [2023-12-27 19:56:55,131][106226] Updated weights for policy 0, policy_version 100094 (0.0006) [2023-12-27 19:56:55,187][106226] Updated weights for policy 0, policy_version 100104 (0.0005) [2023-12-27 19:56:55,596][106225] Updated weights for policy 1, policy_version 100023 (0.0009) [2023-12-27 19:56:55,652][106225] Updated weights for policy 1, policy_version 100033 (0.0008) [2023-12-27 19:56:55,705][106225] Updated weights for policy 1, policy_version 100043 (0.0006) [2023-12-27 19:56:55,745][106226] Updated weights for policy 0, policy_version 100114 (0.0005) [2023-12-27 19:56:55,797][106226] Updated weights for policy 0, policy_version 100124 (0.0005) [2023-12-27 19:56:55,849][106226] Updated weights for policy 0, policy_version 100134 (0.0005) [2023-12-27 19:56:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 51257344. Throughput: 0: 9922.1, 1: 10022.8. Samples: 51224000. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:56:56,175][105115] Avg episode reward: [(0, '-5.276'), (1, '-6.454')] [2023-12-27 19:56:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000100136_25640960.pth... [2023-12-27 19:56:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000100048_25616384.pth... [2023-12-27 19:56:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000098864_25313280.pth [2023-12-27 19:56:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000098952_25337856.pth [2023-12-27 19:56:56,476][106225] Updated weights for policy 1, policy_version 100053 (0.0008) [2023-12-27 19:56:56,509][106226] Updated weights for policy 0, policy_version 100144 (0.0006) [2023-12-27 19:56:56,541][106225] Updated weights for policy 1, policy_version 100063 (0.0008) [2023-12-27 19:56:56,569][106226] Updated weights for policy 0, policy_version 100154 (0.0005) [2023-12-27 19:56:56,606][106225] Updated weights for policy 1, policy_version 100073 (0.0007) [2023-12-27 19:56:56,628][106226] Updated weights for policy 0, policy_version 100164 (0.0005) [2023-12-27 19:56:57,175][106226] Updated weights for policy 0, policy_version 100174 (0.0007) [2023-12-27 19:56:57,229][106226] Updated weights for policy 0, policy_version 100184 (0.0009) [2023-12-27 19:56:57,270][106225] Updated weights for policy 1, policy_version 100083 (0.0006) [2023-12-27 19:56:57,279][106226] Updated weights for policy 0, policy_version 100194 (0.0009) [2023-12-27 19:56:57,330][106225] Updated weights for policy 1, policy_version 100093 (0.0006) [2023-12-27 19:56:57,382][106225] Updated weights for policy 1, policy_version 100103 (0.0010) [2023-12-27 19:56:58,009][106225] Updated weights for policy 1, policy_version 100113 (0.0010) [2023-12-27 19:56:58,028][106226] Updated weights for policy 0, policy_version 100204 (0.0006) [2023-12-27 19:56:58,066][106225] Updated weights for policy 1, policy_version 100123 (0.0010) [2023-12-27 19:56:58,087][106226] Updated weights for policy 0, policy_version 100214 (0.0006) [2023-12-27 19:56:58,124][106225] Updated weights for policy 1, policy_version 100133 (0.0010) [2023-12-27 19:56:58,143][106226] Updated weights for policy 0, policy_version 100224 (0.0006) [2023-12-27 19:56:58,184][106225] Updated weights for policy 1, policy_version 100143 (0.0010) [2023-12-27 19:56:58,924][106226] Updated weights for policy 0, policy_version 100234 (0.0006) [2023-12-27 19:56:58,968][106225] Updated weights for policy 1, policy_version 100153 (0.0008) [2023-12-27 19:56:58,988][106226] Updated weights for policy 0, policy_version 100244 (0.0008) [2023-12-27 19:56:59,028][106225] Updated weights for policy 1, policy_version 100163 (0.0007) [2023-12-27 19:56:59,052][106226] Updated weights for policy 0, policy_version 100254 (0.0010) [2023-12-27 19:56:59,090][106225] Updated weights for policy 1, policy_version 100173 (0.0008) [2023-12-27 19:56:59,124][106226] Updated weights for policy 0, policy_version 100264 (0.0008) [2023-12-27 19:56:59,877][106225] Updated weights for policy 1, policy_version 100183 (0.0009) [2023-12-27 19:56:59,922][106226] Updated weights for policy 0, policy_version 100274 (0.0007) [2023-12-27 19:56:59,943][106225] Updated weights for policy 1, policy_version 100193 (0.0009) [2023-12-27 19:56:59,987][106226] Updated weights for policy 0, policy_version 100284 (0.0007) [2023-12-27 19:57:00,008][106225] Updated weights for policy 1, policy_version 100203 (0.0009) [2023-12-27 19:57:00,050][106226] Updated weights for policy 0, policy_version 100294 (0.0009) [2023-12-27 19:57:00,644][106225] Updated weights for policy 1, policy_version 100213 (0.0007) [2023-12-27 19:57:00,700][106225] Updated weights for policy 1, policy_version 100223 (0.0007) [2023-12-27 19:57:00,746][106226] Updated weights for policy 0, policy_version 100304 (0.0010) [2023-12-27 19:57:00,758][106225] Updated weights for policy 1, policy_version 100233 (0.0008) [2023-12-27 19:57:00,804][106226] Updated weights for policy 0, policy_version 100314 (0.0010) [2023-12-27 19:57:00,863][106226] Updated weights for policy 0, policy_version 100324 (0.0010) [2023-12-27 19:57:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 51355648. Throughput: 0: 10000.2, 1: 10023.3. Samples: 51344048. Policy #0 lag: (min: 27.0, avg: 37.9, max: 59.0) [2023-12-27 19:57:01,175][105115] Avg episode reward: [(0, '-5.365'), (1, '-6.804')] [2023-12-27 19:57:01,551][106225] Updated weights for policy 1, policy_version 100243 (0.0005) [2023-12-27 19:57:01,622][106225] Updated weights for policy 1, policy_version 100253 (0.0006) [2023-12-27 19:57:01,661][106226] Updated weights for policy 0, policy_version 100334 (0.0009) [2023-12-27 19:57:01,685][106225] Updated weights for policy 1, policy_version 100263 (0.0006) [2023-12-27 19:57:01,726][106226] Updated weights for policy 0, policy_version 100344 (0.0008) [2023-12-27 19:57:01,786][106226] Updated weights for policy 0, policy_version 100354 (0.0008) [2023-12-27 19:57:02,251][106225] Updated weights for policy 1, policy_version 100273 (0.0007) [2023-12-27 19:57:02,312][106225] Updated weights for policy 1, policy_version 100283 (0.0008) [2023-12-27 19:57:02,371][106225] Updated weights for policy 1, policy_version 100293 (0.0009) [2023-12-27 19:57:02,436][106225] Updated weights for policy 1, policy_version 100303 (0.0008) [2023-12-27 19:57:02,609][106226] Updated weights for policy 0, policy_version 100364 (0.0009) [2023-12-27 19:57:02,678][106226] Updated weights for policy 0, policy_version 100374 (0.0010) [2023-12-27 19:57:02,734][106226] Updated weights for policy 0, policy_version 100384 (0.0010) [2023-12-27 19:57:03,078][106225] Updated weights for policy 1, policy_version 100313 (0.0005) [2023-12-27 19:57:03,134][106225] Updated weights for policy 1, policy_version 100323 (0.0005) [2023-12-27 19:57:03,180][106225] Updated weights for policy 1, policy_version 100333 (0.0005) [2023-12-27 19:57:03,324][106226] Updated weights for policy 0, policy_version 100394 (0.0005) [2023-12-27 19:57:03,374][106226] Updated weights for policy 0, policy_version 100404 (0.0007) [2023-12-27 19:57:03,427][106226] Updated weights for policy 0, policy_version 100414 (0.0008) [2023-12-27 19:57:03,475][106226] Updated weights for policy 0, policy_version 100424 (0.0008) [2023-12-27 19:57:03,810][106225] Updated weights for policy 1, policy_version 100343 (0.0007) [2023-12-27 19:57:03,879][106225] Updated weights for policy 1, policy_version 100353 (0.0007) [2023-12-27 19:57:03,933][106225] Updated weights for policy 1, policy_version 100363 (0.0005) [2023-12-27 19:57:04,212][106226] Updated weights for policy 0, policy_version 100434 (0.0009) [2023-12-27 19:57:04,269][106226] Updated weights for policy 0, policy_version 100444 (0.0009) [2023-12-27 19:57:04,325][106226] Updated weights for policy 0, policy_version 100454 (0.0009) [2023-12-27 19:57:04,564][106225] Updated weights for policy 1, policy_version 100373 (0.0005) [2023-12-27 19:57:04,619][106225] Updated weights for policy 1, policy_version 100383 (0.0005) [2023-12-27 19:57:04,678][106225] Updated weights for policy 1, policy_version 100393 (0.0005) [2023-12-27 19:57:04,971][106226] Updated weights for policy 0, policy_version 100464 (0.0006) [2023-12-27 19:57:05,033][106226] Updated weights for policy 0, policy_version 100474 (0.0007) [2023-12-27 19:57:05,082][106226] Updated weights for policy 0, policy_version 100484 (0.0008) [2023-12-27 19:57:05,289][106225] Updated weights for policy 1, policy_version 100403 (0.0006) [2023-12-27 19:57:05,346][106225] Updated weights for policy 1, policy_version 100413 (0.0008) [2023-12-27 19:57:05,398][106225] Updated weights for policy 1, policy_version 100423 (0.0008) [2023-12-27 19:57:05,861][106226] Updated weights for policy 0, policy_version 100494 (0.0009) [2023-12-27 19:57:05,906][106226] Updated weights for policy 0, policy_version 100504 (0.0008) [2023-12-27 19:57:05,962][106226] Updated weights for policy 0, policy_version 100514 (0.0008) [2023-12-27 19:57:05,973][106225] Updated weights for policy 1, policy_version 100433 (0.0008) [2023-12-27 19:57:06,029][106225] Updated weights for policy 1, policy_version 100443 (0.0007) [2023-12-27 19:57:06,079][106225] Updated weights for policy 1, policy_version 100453 (0.0008) [2023-12-27 19:57:06,149][106225] Updated weights for policy 1, policy_version 100463 (0.0009) [2023-12-27 19:57:06,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 51462144. Throughput: 0: 9920.6, 1: 10105.0. Samples: 51465668. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:06,175][105115] Avg episode reward: [(0, '-5.719'), (1, '-6.698')] [2023-12-27 19:57:06,664][106226] Updated weights for policy 0, policy_version 100524 (0.0008) [2023-12-27 19:57:06,725][106226] Updated weights for policy 0, policy_version 100534 (0.0006) [2023-12-27 19:57:06,784][106226] Updated weights for policy 0, policy_version 100544 (0.0005) [2023-12-27 19:57:06,912][106225] Updated weights for policy 1, policy_version 100473 (0.0009) [2023-12-27 19:57:06,973][106225] Updated weights for policy 1, policy_version 100483 (0.0008) [2023-12-27 19:57:07,045][106225] Updated weights for policy 1, policy_version 100493 (0.0009) [2023-12-27 19:57:07,387][106226] Updated weights for policy 0, policy_version 100554 (0.0007) [2023-12-27 19:57:07,438][106226] Updated weights for policy 0, policy_version 100564 (0.0006) [2023-12-27 19:57:07,486][106226] Updated weights for policy 0, policy_version 100574 (0.0005) [2023-12-27 19:57:07,538][106226] Updated weights for policy 0, policy_version 100584 (0.0005) [2023-12-27 19:57:07,669][106225] Updated weights for policy 1, policy_version 100503 (0.0009) [2023-12-27 19:57:07,725][106225] Updated weights for policy 1, policy_version 100513 (0.0007) [2023-12-27 19:57:07,771][106225] Updated weights for policy 1, policy_version 100523 (0.0005) [2023-12-27 19:57:08,130][106226] Updated weights for policy 0, policy_version 100594 (0.0005) [2023-12-27 19:57:08,179][106226] Updated weights for policy 0, policy_version 100604 (0.0009) [2023-12-27 19:57:08,230][106226] Updated weights for policy 0, policy_version 100614 (0.0006) [2023-12-27 19:57:08,446][106225] Updated weights for policy 1, policy_version 100533 (0.0007) [2023-12-27 19:57:08,500][106225] Updated weights for policy 1, policy_version 100543 (0.0008) [2023-12-27 19:57:08,547][106225] Updated weights for policy 1, policy_version 100553 (0.0008) [2023-12-27 19:57:08,915][106226] Updated weights for policy 0, policy_version 100624 (0.0008) [2023-12-27 19:57:08,968][106226] Updated weights for policy 0, policy_version 100634 (0.0009) [2023-12-27 19:57:09,019][106226] Updated weights for policy 0, policy_version 100644 (0.0009) [2023-12-27 19:57:09,326][106225] Updated weights for policy 1, policy_version 100563 (0.0009) [2023-12-27 19:57:09,397][106225] Updated weights for policy 1, policy_version 100573 (0.0008) [2023-12-27 19:57:09,461][106225] Updated weights for policy 1, policy_version 100583 (0.0008) [2023-12-27 19:57:09,837][106226] Updated weights for policy 0, policy_version 100654 (0.0008) [2023-12-27 19:57:09,895][106226] Updated weights for policy 0, policy_version 100664 (0.0008) [2023-12-27 19:57:09,954][106226] Updated weights for policy 0, policy_version 100674 (0.0008) [2023-12-27 19:57:10,217][106225] Updated weights for policy 1, policy_version 100593 (0.0008) [2023-12-27 19:57:10,281][106225] Updated weights for policy 1, policy_version 100603 (0.0009) [2023-12-27 19:57:10,343][106225] Updated weights for policy 1, policy_version 100613 (0.0007) [2023-12-27 19:57:10,409][106225] Updated weights for policy 1, policy_version 100623 (0.0006) [2023-12-27 19:57:10,726][106226] Updated weights for policy 0, policy_version 100684 (0.0009) [2023-12-27 19:57:10,792][106226] Updated weights for policy 0, policy_version 100694 (0.0010) [2023-12-27 19:57:10,844][106226] Updated weights for policy 0, policy_version 100704 (0.0008) [2023-12-27 19:57:11,023][106225] Updated weights for policy 1, policy_version 100633 (0.0008) [2023-12-27 19:57:11,098][106225] Updated weights for policy 1, policy_version 100643 (0.0008) [2023-12-27 19:57:11,167][106225] Updated weights for policy 1, policy_version 100653 (0.0009) [2023-12-27 19:57:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 51552256. Throughput: 0: 10021.7, 1: 10126.0. Samples: 51527904. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:11,175][105115] Avg episode reward: [(0, '-5.325'), (1, '-7.200')] [2023-12-27 19:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000100712_25788416.pth... [2023-12-27 19:57:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000100656_25772032.pth... [2023-12-27 19:57:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000099560_25493504.pth [2023-12-27 19:57:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000099472_25468928.pth [2023-12-27 19:57:11,593][106226] Updated weights for policy 0, policy_version 100714 (0.0008) [2023-12-27 19:57:11,663][106226] Updated weights for policy 0, policy_version 100724 (0.0008) [2023-12-27 19:57:11,729][106226] Updated weights for policy 0, policy_version 100734 (0.0008) [2023-12-27 19:57:11,791][106226] Updated weights for policy 0, policy_version 100744 (0.0008) [2023-12-27 19:57:11,894][106225] Updated weights for policy 1, policy_version 100663 (0.0008) [2023-12-27 19:57:11,946][106225] Updated weights for policy 1, policy_version 100673 (0.0008) [2023-12-27 19:57:12,008][106225] Updated weights for policy 1, policy_version 100683 (0.0005) [2023-12-27 19:57:12,586][106226] Updated weights for policy 0, policy_version 100754 (0.0009) [2023-12-27 19:57:12,640][106226] Updated weights for policy 0, policy_version 100764 (0.0009) [2023-12-27 19:57:12,667][106225] Updated weights for policy 1, policy_version 100693 (0.0008) [2023-12-27 19:57:12,701][106226] Updated weights for policy 0, policy_version 100774 (0.0007) [2023-12-27 19:57:12,729][106225] Updated weights for policy 1, policy_version 100703 (0.0008) [2023-12-27 19:57:12,788][106225] Updated weights for policy 1, policy_version 100713 (0.0007) [2023-12-27 19:57:13,338][106226] Updated weights for policy 0, policy_version 100784 (0.0006) [2023-12-27 19:57:13,395][106226] Updated weights for policy 0, policy_version 100794 (0.0005) [2023-12-27 19:57:13,418][106225] Updated weights for policy 1, policy_version 100723 (0.0009) [2023-12-27 19:57:13,451][106226] Updated weights for policy 0, policy_version 100804 (0.0006) [2023-12-27 19:57:13,467][106225] Updated weights for policy 1, policy_version 100733 (0.0006) [2023-12-27 19:57:13,528][106225] Updated weights for policy 1, policy_version 100743 (0.0009) [2023-12-27 19:57:13,990][106226] Updated weights for policy 0, policy_version 100814 (0.0005) [2023-12-27 19:57:14,046][106226] Updated weights for policy 0, policy_version 100824 (0.0005) [2023-12-27 19:57:14,100][106226] Updated weights for policy 0, policy_version 100834 (0.0008) [2023-12-27 19:57:14,262][106225] Updated weights for policy 1, policy_version 100753 (0.0010) [2023-12-27 19:57:14,328][106225] Updated weights for policy 1, policy_version 100763 (0.0009) [2023-12-27 19:57:14,395][106225] Updated weights for policy 1, policy_version 100773 (0.0009) [2023-12-27 19:57:14,458][106225] Updated weights for policy 1, policy_version 100783 (0.0008) [2023-12-27 19:57:14,843][106226] Updated weights for policy 0, policy_version 100844 (0.0008) [2023-12-27 19:57:14,904][106226] Updated weights for policy 0, policy_version 100854 (0.0008) [2023-12-27 19:57:14,967][106226] Updated weights for policy 0, policy_version 100864 (0.0009) [2023-12-27 19:57:15,074][106225] Updated weights for policy 1, policy_version 100793 (0.0008) [2023-12-27 19:57:15,132][106225] Updated weights for policy 1, policy_version 100803 (0.0008) [2023-12-27 19:57:15,203][106225] Updated weights for policy 1, policy_version 100813 (0.0007) [2023-12-27 19:57:15,700][106226] Updated weights for policy 0, policy_version 100874 (0.0009) [2023-12-27 19:57:15,750][106226] Updated weights for policy 0, policy_version 100884 (0.0007) [2023-12-27 19:57:15,807][106226] Updated weights for policy 0, policy_version 100894 (0.0005) [2023-12-27 19:57:15,829][106225] Updated weights for policy 1, policy_version 100823 (0.0007) [2023-12-27 19:57:15,872][106226] Updated weights for policy 0, policy_version 100904 (0.0005) [2023-12-27 19:57:15,883][106225] Updated weights for policy 1, policy_version 100833 (0.0006) [2023-12-27 19:57:15,938][106225] Updated weights for policy 1, policy_version 100843 (0.0005) [2023-12-27 19:57:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.3, 300 sec: 19882.9). Total num frames: 51658752. Throughput: 0: 9907.8, 1: 10080.4. Samples: 51644856. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:16,176][105115] Avg episode reward: [(0, '-5.223'), (1, '-6.844')] [2023-12-27 19:57:16,448][106226] Updated weights for policy 0, policy_version 100914 (0.0005) [2023-12-27 19:57:16,503][106226] Updated weights for policy 0, policy_version 100924 (0.0005) [2023-12-27 19:57:16,556][106226] Updated weights for policy 0, policy_version 100934 (0.0005) [2023-12-27 19:57:16,615][106225] Updated weights for policy 1, policy_version 100853 (0.0007) [2023-12-27 19:57:16,665][106225] Updated weights for policy 1, policy_version 100863 (0.0008) [2023-12-27 19:57:16,666][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000006 [2023-12-27 19:57:17,100][106226] Updated weights for policy 0, policy_version 100944 (0.0006) [2023-12-27 19:57:17,151][106226] Updated weights for policy 0, policy_version 100954 (0.0008) [2023-12-27 19:57:17,205][106226] Updated weights for policy 0, policy_version 100964 (0.0008) [2023-12-27 19:57:17,468][106225] Updated weights for policy 1, policy_version 100873 (0.0007) [2023-12-27 19:57:17,512][106225] Updated weights for policy 1, policy_version 100883 (0.0008) [2023-12-27 19:57:17,555][106225] Updated weights for policy 1, policy_version 100893 (0.0008) [2023-12-27 19:57:17,975][106226] Updated weights for policy 0, policy_version 100974 (0.0009) [2023-12-27 19:57:18,036][106226] Updated weights for policy 0, policy_version 100984 (0.0009) [2023-12-27 19:57:18,085][106226] Updated weights for policy 0, policy_version 100994 (0.0009) [2023-12-27 19:57:18,175][106225] Updated weights for policy 1, policy_version 100903 (0.0006) [2023-12-27 19:57:18,246][106225] Updated weights for policy 1, policy_version 100913 (0.0006) [2023-12-27 19:57:18,304][106225] Updated weights for policy 1, policy_version 100923 (0.0005) [2023-12-27 19:57:18,829][106226] Updated weights for policy 0, policy_version 101004 (0.0008) [2023-12-27 19:57:18,871][106225] Updated weights for policy 1, policy_version 100933 (0.0007) [2023-12-27 19:57:18,884][106226] Updated weights for policy 0, policy_version 101014 (0.0006) [2023-12-27 19:57:18,932][106225] Updated weights for policy 1, policy_version 100943 (0.0008) [2023-12-27 19:57:18,943][106226] Updated weights for policy 0, policy_version 101024 (0.0006) [2023-12-27 19:57:18,986][106225] Updated weights for policy 1, policy_version 100953 (0.0008) [2023-12-27 19:57:19,646][106226] Updated weights for policy 0, policy_version 101034 (0.0007) [2023-12-27 19:57:19,707][106226] Updated weights for policy 0, policy_version 101044 (0.0006) [2023-12-27 19:57:19,763][106225] Updated weights for policy 1, policy_version 100963 (0.0008) [2023-12-27 19:57:19,768][106226] Updated weights for policy 0, policy_version 101054 (0.0006) [2023-12-27 19:57:19,829][106225] Updated weights for policy 1, policy_version 100973 (0.0007) [2023-12-27 19:57:19,831][106226] Updated weights for policy 0, policy_version 101064 (0.0007) [2023-12-27 19:57:19,888][106225] Updated weights for policy 1, policy_version 100983 (0.0009) [2023-12-27 19:57:20,546][106225] Updated weights for policy 1, policy_version 100993 (0.0008) [2023-12-27 19:57:20,604][106226] Updated weights for policy 0, policy_version 101074 (0.0007) [2023-12-27 19:57:20,616][106225] Updated weights for policy 1, policy_version 101003 (0.0009) [2023-12-27 19:57:20,663][106226] Updated weights for policy 0, policy_version 101084 (0.0006) [2023-12-27 19:57:20,673][106225] Updated weights for policy 1, policy_version 101013 (0.0008) [2023-12-27 19:57:20,727][106226] Updated weights for policy 0, policy_version 101094 (0.0006) [2023-12-27 19:57:20,736][106225] Updated weights for policy 1, policy_version 101023 (0.0008) [2023-12-27 19:57:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 51757056. Throughput: 0: 9943.3, 1: 10087.5. Samples: 51767220. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:21,175][105115] Avg episode reward: [(0, '-5.551'), (1, '-6.799')] [2023-12-27 19:57:21,501][106225] Updated weights for policy 1, policy_version 101033 (0.0008) [2023-12-27 19:57:21,512][106226] Updated weights for policy 0, policy_version 101104 (0.0006) [2023-12-27 19:57:21,557][106225] Updated weights for policy 1, policy_version 101043 (0.0008) [2023-12-27 19:57:21,573][106226] Updated weights for policy 0, policy_version 101114 (0.0008) [2023-12-27 19:57:21,615][106225] Updated weights for policy 1, policy_version 101053 (0.0009) [2023-12-27 19:57:21,639][106226] Updated weights for policy 0, policy_version 101124 (0.0006) [2023-12-27 19:57:22,336][106226] Updated weights for policy 0, policy_version 101134 (0.0010) [2023-12-27 19:57:22,397][106225] Updated weights for policy 1, policy_version 101063 (0.0007) [2023-12-27 19:57:22,411][106226] Updated weights for policy 0, policy_version 101144 (0.0010) [2023-12-27 19:57:22,466][106225] Updated weights for policy 1, policy_version 101073 (0.0007) [2023-12-27 19:57:22,474][106226] Updated weights for policy 0, policy_version 101154 (0.0008) [2023-12-27 19:57:22,534][106225] Updated weights for policy 1, policy_version 101083 (0.0007) [2023-12-27 19:57:23,196][106226] Updated weights for policy 0, policy_version 101164 (0.0008) [2023-12-27 19:57:23,217][106225] Updated weights for policy 1, policy_version 101093 (0.0006) [2023-12-27 19:57:23,242][106226] Updated weights for policy 0, policy_version 101174 (0.0010) [2023-12-27 19:57:23,274][106225] Updated weights for policy 1, policy_version 101103 (0.0007) [2023-12-27 19:57:23,298][106226] Updated weights for policy 0, policy_version 101184 (0.0007) [2023-12-27 19:57:23,331][106225] Updated weights for policy 1, policy_version 101113 (0.0008) [2023-12-27 19:57:23,890][106226] Updated weights for policy 0, policy_version 101194 (0.0007) [2023-12-27 19:57:23,947][106226] Updated weights for policy 0, policy_version 101204 (0.0005) [2023-12-27 19:57:24,001][106226] Updated weights for policy 0, policy_version 101214 (0.0005) [2023-12-27 19:57:24,061][106226] Updated weights for policy 0, policy_version 101224 (0.0008) [2023-12-27 19:57:24,121][106225] Updated weights for policy 1, policy_version 101123 (0.0007) [2023-12-27 19:57:24,170][106225] Updated weights for policy 1, policy_version 101133 (0.0009) [2023-12-27 19:57:24,230][106225] Updated weights for policy 1, policy_version 101143 (0.0009) [2023-12-27 19:57:24,710][106226] Updated weights for policy 0, policy_version 101234 (0.0006) [2023-12-27 19:57:24,757][106226] Updated weights for policy 0, policy_version 101244 (0.0005) [2023-12-27 19:57:24,809][106226] Updated weights for policy 0, policy_version 101254 (0.0006) [2023-12-27 19:57:25,000][106225] Updated weights for policy 1, policy_version 101153 (0.0008) [2023-12-27 19:57:25,054][106225] Updated weights for policy 1, policy_version 101163 (0.0009) [2023-12-27 19:57:25,111][106225] Updated weights for policy 1, policy_version 101173 (0.0009) [2023-12-27 19:57:25,161][106225] Updated weights for policy 1, policy_version 101183 (0.0009) [2023-12-27 19:57:25,353][106226] Updated weights for policy 0, policy_version 101264 (0.0006) [2023-12-27 19:57:25,406][106226] Updated weights for policy 0, policy_version 101274 (0.0007) [2023-12-27 19:57:25,459][106226] Updated weights for policy 0, policy_version 101284 (0.0005) [2023-12-27 19:57:25,990][106225] Updated weights for policy 1, policy_version 101193 (0.0008) [2023-12-27 19:57:26,030][106226] Updated weights for policy 0, policy_version 101294 (0.0008) [2023-12-27 19:57:26,054][106225] Updated weights for policy 1, policy_version 101203 (0.0010) [2023-12-27 19:57:26,090][106226] Updated weights for policy 0, policy_version 101304 (0.0009) [2023-12-27 19:57:26,109][106225] Updated weights for policy 1, policy_version 101213 (0.0006) [2023-12-27 19:57:26,152][106226] Updated weights for policy 0, policy_version 101314 (0.0006) [2023-12-27 19:57:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 51855360. Throughput: 0: 9928.9, 1: 9995.5. Samples: 51825224. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:26,175][105115] Avg episode reward: [(0, '-5.300'), (1, '-6.807')] [2023-12-27 19:57:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000101216_25919488.pth... [2023-12-27 19:57:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000100048_25616384.pth [2023-12-27 19:57:26,191][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000101320_25944064.pth... [2023-12-27 19:57:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000100136_25640960.pth [2023-12-27 19:57:26,816][106225] Updated weights for policy 1, policy_version 101223 (0.0007) [2023-12-27 19:57:26,860][106226] Updated weights for policy 0, policy_version 101324 (0.0006) [2023-12-27 19:57:26,871][106225] Updated weights for policy 1, policy_version 101233 (0.0005) [2023-12-27 19:57:26,916][106226] Updated weights for policy 0, policy_version 101334 (0.0007) [2023-12-27 19:57:26,930][106225] Updated weights for policy 1, policy_version 101243 (0.0008) [2023-12-27 19:57:26,966][106226] Updated weights for policy 0, policy_version 101344 (0.0009) [2023-12-27 19:57:27,523][106226] Updated weights for policy 0, policy_version 101354 (0.0005) [2023-12-27 19:57:27,569][106226] Updated weights for policy 0, policy_version 101364 (0.0005) [2023-12-27 19:57:27,578][106225] Updated weights for policy 1, policy_version 101253 (0.0008) [2023-12-27 19:57:27,618][106226] Updated weights for policy 0, policy_version 101374 (0.0006) [2023-12-27 19:57:27,627][106225] Updated weights for policy 1, policy_version 101263 (0.0010) [2023-12-27 19:57:27,670][106226] Updated weights for policy 0, policy_version 101384 (0.0010) [2023-12-27 19:57:27,684][106225] Updated weights for policy 1, policy_version 101273 (0.0007) [2023-12-27 19:57:28,286][106226] Updated weights for policy 0, policy_version 101394 (0.0008) [2023-12-27 19:57:28,362][106226] Updated weights for policy 0, policy_version 101404 (0.0008) [2023-12-27 19:57:28,389][106225] Updated weights for policy 1, policy_version 101283 (0.0006) [2023-12-27 19:57:28,424][106226] Updated weights for policy 0, policy_version 101414 (0.0008) [2023-12-27 19:57:28,458][106225] Updated weights for policy 1, policy_version 101293 (0.0007) [2023-12-27 19:57:28,521][106225] Updated weights for policy 1, policy_version 101303 (0.0007) [2023-12-27 19:57:29,131][106226] Updated weights for policy 0, policy_version 101424 (0.0006) [2023-12-27 19:57:29,185][106225] Updated weights for policy 1, policy_version 101313 (0.0007) [2023-12-27 19:57:29,190][106226] Updated weights for policy 0, policy_version 101434 (0.0006) [2023-12-27 19:57:29,252][106225] Updated weights for policy 1, policy_version 101323 (0.0009) [2023-12-27 19:57:29,255][106226] Updated weights for policy 0, policy_version 101444 (0.0008) [2023-12-27 19:57:29,308][106225] Updated weights for policy 1, policy_version 101333 (0.0008) [2023-12-27 19:57:29,372][106225] Updated weights for policy 1, policy_version 101343 (0.0008) [2023-12-27 19:57:30,026][106226] Updated weights for policy 0, policy_version 101454 (0.0010) [2023-12-27 19:57:30,081][106225] Updated weights for policy 1, policy_version 101353 (0.0006) [2023-12-27 19:57:30,083][106226] Updated weights for policy 0, policy_version 101464 (0.0010) [2023-12-27 19:57:30,146][106225] Updated weights for policy 1, policy_version 101363 (0.0006) [2023-12-27 19:57:30,147][106226] Updated weights for policy 0, policy_version 101474 (0.0010) [2023-12-27 19:57:30,205][106225] Updated weights for policy 1, policy_version 101373 (0.0006) [2023-12-27 19:57:30,761][106226] Updated weights for policy 0, policy_version 101484 (0.0011) [2023-12-27 19:57:30,824][106226] Updated weights for policy 0, policy_version 101494 (0.0010) [2023-12-27 19:57:30,877][106226] Updated weights for policy 0, policy_version 101504 (0.0010) [2023-12-27 19:57:30,889][106225] Updated weights for policy 1, policy_version 101383 (0.0007) [2023-12-27 19:57:30,948][106225] Updated weights for policy 1, policy_version 101393 (0.0008) [2023-12-27 19:57:31,001][106225] Updated weights for policy 1, policy_version 101403 (0.0007) [2023-12-27 19:57:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 51961856. Throughput: 0: 10107.3, 1: 10008.3. Samples: 51947440. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:31,175][105115] Avg episode reward: [(0, '-5.376'), (1, '-6.978')] [2023-12-27 19:57:31,581][106226] Updated weights for policy 0, policy_version 101514 (0.0010) [2023-12-27 19:57:31,646][106226] Updated weights for policy 0, policy_version 101524 (0.0009) [2023-12-27 19:57:31,707][106226] Updated weights for policy 0, policy_version 101534 (0.0009) [2023-12-27 19:57:31,754][106225] Updated weights for policy 1, policy_version 101413 (0.0008) [2023-12-27 19:57:31,773][106226] Updated weights for policy 0, policy_version 101544 (0.0007) [2023-12-27 19:57:31,810][106225] Updated weights for policy 1, policy_version 101423 (0.0006) [2023-12-27 19:57:31,873][106225] Updated weights for policy 1, policy_version 101433 (0.0005) [2023-12-27 19:57:32,551][106226] Updated weights for policy 0, policy_version 101554 (0.0007) [2023-12-27 19:57:32,582][106225] Updated weights for policy 1, policy_version 101443 (0.0005) [2023-12-27 19:57:32,612][106226] Updated weights for policy 0, policy_version 101564 (0.0008) [2023-12-27 19:57:32,641][106225] Updated weights for policy 1, policy_version 101453 (0.0007) [2023-12-27 19:57:32,670][106226] Updated weights for policy 0, policy_version 101574 (0.0008) [2023-12-27 19:57:32,700][106225] Updated weights for policy 1, policy_version 101463 (0.0006) [2023-12-27 19:57:33,287][106226] Updated weights for policy 0, policy_version 101584 (0.0006) [2023-12-27 19:57:33,338][106226] Updated weights for policy 0, policy_version 101594 (0.0005) [2023-12-27 19:57:33,390][106226] Updated weights for policy 0, policy_version 101604 (0.0008) [2023-12-27 19:57:33,397][106225] Updated weights for policy 1, policy_version 101473 (0.0007) [2023-12-27 19:57:33,444][106225] Updated weights for policy 1, policy_version 101483 (0.0010) [2023-12-27 19:57:33,511][106225] Updated weights for policy 1, policy_version 101493 (0.0007) [2023-12-27 19:57:33,563][106225] Updated weights for policy 1, policy_version 101503 (0.0010) [2023-12-27 19:57:33,939][106226] Updated weights for policy 0, policy_version 101614 (0.0009) [2023-12-27 19:57:33,990][106226] Updated weights for policy 0, policy_version 101624 (0.0010) [2023-12-27 19:57:34,044][106226] Updated weights for policy 0, policy_version 101634 (0.0009) [2023-12-27 19:57:34,209][106225] Updated weights for policy 1, policy_version 101513 (0.0010) [2023-12-27 19:57:34,266][106225] Updated weights for policy 1, policy_version 101523 (0.0010) [2023-12-27 19:57:34,317][106225] Updated weights for policy 1, policy_version 101533 (0.0010) [2023-12-27 19:57:34,765][106226] Updated weights for policy 0, policy_version 101644 (0.0010) [2023-12-27 19:57:34,827][106226] Updated weights for policy 0, policy_version 101654 (0.0011) [2023-12-27 19:57:34,887][106226] Updated weights for policy 0, policy_version 101664 (0.0010) [2023-12-27 19:57:35,089][106225] Updated weights for policy 1, policy_version 101543 (0.0010) [2023-12-27 19:57:35,136][106225] Updated weights for policy 1, policy_version 101553 (0.0010) [2023-12-27 19:57:35,188][106225] Updated weights for policy 1, policy_version 101563 (0.0010) [2023-12-27 19:57:35,589][106226] Updated weights for policy 0, policy_version 101674 (0.0011) [2023-12-27 19:57:35,639][106226] Updated weights for policy 0, policy_version 101684 (0.0010) [2023-12-27 19:57:35,692][106226] Updated weights for policy 0, policy_version 101694 (0.0007) [2023-12-27 19:57:35,747][106226] Updated weights for policy 0, policy_version 101704 (0.0006) [2023-12-27 19:57:35,837][106225] Updated weights for policy 1, policy_version 101573 (0.0008) [2023-12-27 19:57:35,894][106225] Updated weights for policy 1, policy_version 101583 (0.0006) [2023-12-27 19:57:35,946][106225] Updated weights for policy 1, policy_version 101593 (0.0009) [2023-12-27 19:57:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 52060160. Throughput: 0: 10151.3, 1: 9976.3. Samples: 52068392. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:36,175][105115] Avg episode reward: [(0, '-5.199'), (1, '-7.053')] [2023-12-27 19:57:36,472][106226] Updated weights for policy 0, policy_version 101714 (0.0011) [2023-12-27 19:57:36,541][106226] Updated weights for policy 0, policy_version 101724 (0.0011) [2023-12-27 19:57:36,603][106226] Updated weights for policy 0, policy_version 101734 (0.0011) [2023-12-27 19:57:36,649][106225] Updated weights for policy 1, policy_version 101603 (0.0010) [2023-12-27 19:57:36,716][106225] Updated weights for policy 1, policy_version 101613 (0.0010) [2023-12-27 19:57:36,772][106225] Updated weights for policy 1, policy_version 101623 (0.0010) [2023-12-27 19:57:37,308][106226] Updated weights for policy 0, policy_version 101744 (0.0010) [2023-12-27 19:57:37,369][106226] Updated weights for policy 0, policy_version 101754 (0.0010) [2023-12-27 19:57:37,404][106225] Updated weights for policy 1, policy_version 101633 (0.0007) [2023-12-27 19:57:37,423][106226] Updated weights for policy 0, policy_version 101764 (0.0010) [2023-12-27 19:57:37,458][106225] Updated weights for policy 1, policy_version 101643 (0.0010) [2023-12-27 19:57:37,508][106225] Updated weights for policy 1, policy_version 101653 (0.0010) [2023-12-27 19:57:37,566][106225] Updated weights for policy 1, policy_version 101663 (0.0010) [2023-12-27 19:57:38,112][106226] Updated weights for policy 0, policy_version 101774 (0.0009) [2023-12-27 19:57:38,167][106226] Updated weights for policy 0, policy_version 101784 (0.0010) [2023-12-27 19:57:38,224][106226] Updated weights for policy 0, policy_version 101794 (0.0010) [2023-12-27 19:57:38,257][106225] Updated weights for policy 1, policy_version 101673 (0.0006) [2023-12-27 19:57:38,317][106225] Updated weights for policy 1, policy_version 101683 (0.0006) [2023-12-27 19:57:38,391][106225] Updated weights for policy 1, policy_version 101693 (0.0007) [2023-12-27 19:57:38,913][106226] Updated weights for policy 0, policy_version 101804 (0.0011) [2023-12-27 19:57:38,968][106226] Updated weights for policy 0, policy_version 101814 (0.0011) [2023-12-27 19:57:39,031][106226] Updated weights for policy 0, policy_version 101824 (0.0007) [2023-12-27 19:57:39,045][106225] Updated weights for policy 1, policy_version 101703 (0.0006) [2023-12-27 19:57:39,094][106225] Updated weights for policy 1, policy_version 101713 (0.0005) [2023-12-27 19:57:39,155][106225] Updated weights for policy 1, policy_version 101723 (0.0006) [2023-12-27 19:57:39,685][106226] Updated weights for policy 0, policy_version 101834 (0.0006) [2023-12-27 19:57:39,745][106226] Updated weights for policy 0, policy_version 101844 (0.0007) [2023-12-27 19:57:39,804][106226] Updated weights for policy 0, policy_version 101854 (0.0009) [2023-12-27 19:57:39,834][106225] Updated weights for policy 1, policy_version 101733 (0.0007) [2023-12-27 19:57:39,877][106226] Updated weights for policy 0, policy_version 101864 (0.0008) [2023-12-27 19:57:39,906][106225] Updated weights for policy 1, policy_version 101743 (0.0009) [2023-12-27 19:57:39,976][106225] Updated weights for policy 1, policy_version 101753 (0.0008) [2023-12-27 19:57:40,622][106225] Updated weights for policy 1, policy_version 101763 (0.0008) [2023-12-27 19:57:40,664][106226] Updated weights for policy 0, policy_version 101874 (0.0007) [2023-12-27 19:57:40,677][106225] Updated weights for policy 1, policy_version 101773 (0.0009) [2023-12-27 19:57:40,719][106226] Updated weights for policy 0, policy_version 101884 (0.0009) [2023-12-27 19:57:40,740][106225] Updated weights for policy 1, policy_version 101783 (0.0007) [2023-12-27 19:57:40,779][106226] Updated weights for policy 0, policy_version 101894 (0.0007) [2023-12-27 19:57:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 52158464. Throughput: 0: 10109.7, 1: 9993.1. Samples: 52128632. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:41,175][105115] Avg episode reward: [(0, '-5.287'), (1, '-6.961')] [2023-12-27 19:57:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000101792_26066944.pth... [2023-12-27 19:57:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000101896_26091520.pth... [2023-12-27 19:57:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000100656_25772032.pth [2023-12-27 19:57:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000100712_25788416.pth [2023-12-27 19:57:41,510][106225] Updated weights for policy 1, policy_version 101793 (0.0007) [2023-12-27 19:57:41,515][106226] Updated weights for policy 0, policy_version 101904 (0.0008) [2023-12-27 19:57:41,573][106226] Updated weights for policy 0, policy_version 101914 (0.0008) [2023-12-27 19:57:41,577][106225] Updated weights for policy 1, policy_version 101803 (0.0005) [2023-12-27 19:57:41,632][106226] Updated weights for policy 0, policy_version 101924 (0.0008) [2023-12-27 19:57:41,641][106225] Updated weights for policy 1, policy_version 101813 (0.0007) [2023-12-27 19:57:41,706][106225] Updated weights for policy 1, policy_version 101823 (0.0009) [2023-12-27 19:57:42,389][106226] Updated weights for policy 0, policy_version 101934 (0.0009) [2023-12-27 19:57:42,451][106226] Updated weights for policy 0, policy_version 101944 (0.0007) [2023-12-27 19:57:42,487][106225] Updated weights for policy 1, policy_version 101833 (0.0010) [2023-12-27 19:57:42,507][106226] Updated weights for policy 0, policy_version 101954 (0.0006) [2023-12-27 19:57:42,558][106225] Updated weights for policy 1, policy_version 101843 (0.0011) [2023-12-27 19:57:42,630][106225] Updated weights for policy 1, policy_version 101853 (0.0011) [2023-12-27 19:57:43,218][106226] Updated weights for policy 0, policy_version 101964 (0.0007) [2023-12-27 19:57:43,273][106226] Updated weights for policy 0, policy_version 101974 (0.0009) [2023-12-27 19:57:43,324][106226] Updated weights for policy 0, policy_version 101984 (0.0009) [2023-12-27 19:57:43,346][106225] Updated weights for policy 1, policy_version 101863 (0.0007) [2023-12-27 19:57:43,401][106225] Updated weights for policy 1, policy_version 101873 (0.0005) [2023-12-27 19:57:43,458][106225] Updated weights for policy 1, policy_version 101883 (0.0005) [2023-12-27 19:57:44,050][106225] Updated weights for policy 1, policy_version 101893 (0.0005) [2023-12-27 19:57:44,120][106225] Updated weights for policy 1, policy_version 101903 (0.0006) [2023-12-27 19:57:44,142][106226] Updated weights for policy 0, policy_version 101994 (0.0008) [2023-12-27 19:57:44,188][106225] Updated weights for policy 1, policy_version 101913 (0.0007) [2023-12-27 19:57:44,194][106226] Updated weights for policy 0, policy_version 102004 (0.0008) [2023-12-27 19:57:44,248][106226] Updated weights for policy 0, policy_version 102014 (0.0008) [2023-12-27 19:57:44,295][106226] Updated weights for policy 0, policy_version 102024 (0.0008) [2023-12-27 19:57:44,713][106225] Updated weights for policy 1, policy_version 101923 (0.0006) [2023-12-27 19:57:44,772][106225] Updated weights for policy 1, policy_version 101933 (0.0008) [2023-12-27 19:57:44,838][106225] Updated weights for policy 1, policy_version 101943 (0.0009) [2023-12-27 19:57:45,071][106226] Updated weights for policy 0, policy_version 102034 (0.0006) [2023-12-27 19:57:45,131][106226] Updated weights for policy 0, policy_version 102044 (0.0008) [2023-12-27 19:57:45,194][106226] Updated weights for policy 0, policy_version 102054 (0.0009) [2023-12-27 19:57:45,593][106225] Updated weights for policy 1, policy_version 101953 (0.0008) [2023-12-27 19:57:45,644][106225] Updated weights for policy 1, policy_version 101963 (0.0009) [2023-12-27 19:57:45,695][106225] Updated weights for policy 1, policy_version 101973 (0.0008) [2023-12-27 19:57:45,748][106225] Updated weights for policy 1, policy_version 101983 (0.0008) [2023-12-27 19:57:45,791][106226] Updated weights for policy 0, policy_version 102064 (0.0006) [2023-12-27 19:57:45,846][106226] Updated weights for policy 0, policy_version 102074 (0.0005) [2023-12-27 19:57:45,914][106226] Updated weights for policy 0, policy_version 102084 (0.0005) [2023-12-27 19:57:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.3, 300 sec: 19882.9). Total num frames: 52256768. Throughput: 0: 9986.4, 1: 10037.6. Samples: 52245136. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:46,176][105115] Avg episode reward: [(0, '-5.578'), (1, '-6.857')] [2023-12-27 19:57:46,426][106226] Updated weights for policy 0, policy_version 102094 (0.0005) [2023-12-27 19:57:46,484][106226] Updated weights for policy 0, policy_version 102104 (0.0005) [2023-12-27 19:57:46,504][106225] Updated weights for policy 1, policy_version 101993 (0.0008) [2023-12-27 19:57:46,546][106226] Updated weights for policy 0, policy_version 102114 (0.0006) [2023-12-27 19:57:46,549][106225] Updated weights for policy 1, policy_version 102003 (0.0007) [2023-12-27 19:57:46,598][106225] Updated weights for policy 1, policy_version 102013 (0.0006) [2023-12-27 19:57:47,109][106226] Updated weights for policy 0, policy_version 102124 (0.0008) [2023-12-27 19:57:47,155][106226] Updated weights for policy 0, policy_version 102134 (0.0006) [2023-12-27 19:57:47,204][106226] Updated weights for policy 0, policy_version 102144 (0.0005) [2023-12-27 19:57:47,340][106225] Updated weights for policy 1, policy_version 102023 (0.0008) [2023-12-27 19:57:47,389][106225] Updated weights for policy 1, policy_version 102033 (0.0008) [2023-12-27 19:57:47,443][106225] Updated weights for policy 1, policy_version 102043 (0.0008) [2023-12-27 19:57:47,763][106226] Updated weights for policy 0, policy_version 102154 (0.0006) [2023-12-27 19:57:47,811][106226] Updated weights for policy 0, policy_version 102164 (0.0008) [2023-12-27 19:57:47,880][106226] Updated weights for policy 0, policy_version 102174 (0.0008) [2023-12-27 19:57:47,943][106226] Updated weights for policy 0, policy_version 102184 (0.0008) [2023-12-27 19:57:48,226][106225] Updated weights for policy 1, policy_version 102053 (0.0009) [2023-12-27 19:57:48,273][106225] Updated weights for policy 1, policy_version 102063 (0.0008) [2023-12-27 19:57:48,329][106225] Updated weights for policy 1, policy_version 102073 (0.0008) [2023-12-27 19:57:48,700][106226] Updated weights for policy 0, policy_version 102194 (0.0009) [2023-12-27 19:57:48,753][106226] Updated weights for policy 0, policy_version 102204 (0.0008) [2023-12-27 19:57:48,805][106226] Updated weights for policy 0, policy_version 102214 (0.0008) [2023-12-27 19:57:49,053][106225] Updated weights for policy 1, policy_version 102083 (0.0009) [2023-12-27 19:57:49,115][106225] Updated weights for policy 1, policy_version 102093 (0.0008) [2023-12-27 19:57:49,170][106225] Updated weights for policy 1, policy_version 102103 (0.0005) [2023-12-27 19:57:49,589][106226] Updated weights for policy 0, policy_version 102224 (0.0007) [2023-12-27 19:57:49,651][106226] Updated weights for policy 0, policy_version 102234 (0.0007) [2023-12-27 19:57:49,713][106226] Updated weights for policy 0, policy_version 102244 (0.0009) [2023-12-27 19:57:49,884][106225] Updated weights for policy 1, policy_version 102113 (0.0006) [2023-12-27 19:57:49,955][106225] Updated weights for policy 1, policy_version 102123 (0.0007) [2023-12-27 19:57:50,020][106225] Updated weights for policy 1, policy_version 102133 (0.0008) [2023-12-27 19:57:50,084][106225] Updated weights for policy 1, policy_version 102143 (0.0007) [2023-12-27 19:57:50,378][106226] Updated weights for policy 0, policy_version 102254 (0.0008) [2023-12-27 19:57:50,439][106226] Updated weights for policy 0, policy_version 102264 (0.0007) [2023-12-27 19:57:50,502][106226] Updated weights for policy 0, policy_version 102274 (0.0011) [2023-12-27 19:57:50,844][106225] Updated weights for policy 1, policy_version 102153 (0.0006) [2023-12-27 19:57:50,896][106225] Updated weights for policy 1, policy_version 102163 (0.0006) [2023-12-27 19:57:50,949][106225] Updated weights for policy 1, policy_version 102173 (0.0006) [2023-12-27 19:57:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 52355072. Throughput: 0: 10112.8, 1: 9870.0. Samples: 52364892. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:51,175][105115] Avg episode reward: [(0, '-5.282'), (1, '-7.292')] [2023-12-27 19:57:51,250][106226] Updated weights for policy 0, policy_version 102284 (0.0010) [2023-12-27 19:57:51,316][106226] Updated weights for policy 0, policy_version 102294 (0.0009) [2023-12-27 19:57:51,384][106226] Updated weights for policy 0, policy_version 102304 (0.0010) [2023-12-27 19:57:51,705][106225] Updated weights for policy 1, policy_version 102183 (0.0007) [2023-12-27 19:57:51,773][106225] Updated weights for policy 1, policy_version 102193 (0.0008) [2023-12-27 19:57:51,835][106225] Updated weights for policy 1, policy_version 102203 (0.0008) [2023-12-27 19:57:52,111][106226] Updated weights for policy 0, policy_version 102314 (0.0009) [2023-12-27 19:57:52,165][106226] Updated weights for policy 0, policy_version 102324 (0.0010) [2023-12-27 19:57:52,226][106226] Updated weights for policy 0, policy_version 102334 (0.0011) [2023-12-27 19:57:52,288][106226] Updated weights for policy 0, policy_version 102344 (0.0010) [2023-12-27 19:57:52,559][106225] Updated weights for policy 1, policy_version 102213 (0.0008) [2023-12-27 19:57:52,624][106225] Updated weights for policy 1, policy_version 102223 (0.0009) [2023-12-27 19:57:52,686][106225] Updated weights for policy 1, policy_version 102233 (0.0008) [2023-12-27 19:57:52,936][106226] Updated weights for policy 0, policy_version 102354 (0.0009) [2023-12-27 19:57:52,995][106226] Updated weights for policy 0, policy_version 102364 (0.0008) [2023-12-27 19:57:53,059][106226] Updated weights for policy 0, policy_version 102374 (0.0008) [2023-12-27 19:57:53,435][106225] Updated weights for policy 1, policy_version 102243 (0.0009) [2023-12-27 19:57:53,486][106225] Updated weights for policy 1, policy_version 102253 (0.0008) [2023-12-27 19:57:53,542][106225] Updated weights for policy 1, policy_version 102263 (0.0009) [2023-12-27 19:57:53,756][106226] Updated weights for policy 0, policy_version 102384 (0.0009) [2023-12-27 19:57:53,809][106226] Updated weights for policy 0, policy_version 102394 (0.0008) [2023-12-27 19:57:53,861][106226] Updated weights for policy 0, policy_version 102404 (0.0008) [2023-12-27 19:57:54,139][106225] Updated weights for policy 1, policy_version 102273 (0.0008) [2023-12-27 19:57:54,204][106225] Updated weights for policy 1, policy_version 102283 (0.0008) [2023-12-27 19:57:54,266][106225] Updated weights for policy 1, policy_version 102293 (0.0008) [2023-12-27 19:57:54,330][106225] Updated weights for policy 1, policy_version 102303 (0.0008) [2023-12-27 19:57:54,487][106226] Updated weights for policy 0, policy_version 102414 (0.0006) [2023-12-27 19:57:54,560][106226] Updated weights for policy 0, policy_version 102424 (0.0005) [2023-12-27 19:57:54,623][106226] Updated weights for policy 0, policy_version 102434 (0.0007) [2023-12-27 19:57:55,014][106225] Updated weights for policy 1, policy_version 102313 (0.0007) [2023-12-27 19:57:55,078][106225] Updated weights for policy 1, policy_version 102323 (0.0006) [2023-12-27 19:57:55,129][106225] Updated weights for policy 1, policy_version 102333 (0.0008) [2023-12-27 19:57:55,274][106226] Updated weights for policy 0, policy_version 102444 (0.0009) [2023-12-27 19:57:55,316][106226] Updated weights for policy 0, policy_version 102454 (0.0010) [2023-12-27 19:57:55,375][106226] Updated weights for policy 0, policy_version 102464 (0.0007) [2023-12-27 19:57:55,739][106225] Updated weights for policy 1, policy_version 102343 (0.0007) [2023-12-27 19:57:55,793][106225] Updated weights for policy 1, policy_version 102353 (0.0008) [2023-12-27 19:57:55,847][106225] Updated weights for policy 1, policy_version 102363 (0.0007) [2023-12-27 19:57:56,090][106226] Updated weights for policy 0, policy_version 102474 (0.0010) [2023-12-27 19:57:56,137][106226] Updated weights for policy 0, policy_version 102484 (0.0010) [2023-12-27 19:57:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 52453376. Throughput: 0: 10060.5, 1: 9826.1. Samples: 52422800. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:57:56,175][105115] Avg episode reward: [(0, '-5.600'), (1, '-6.734')] [2023-12-27 19:57:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000102368_26214400.pth... [2023-12-27 19:57:56,185][106226] Updated weights for policy 0, policy_version 102494 (0.0006) [2023-12-27 19:57:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000101216_25919488.pth [2023-12-27 19:57:56,231][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000102504_26247168.pth... [2023-12-27 19:57:56,232][106226] Updated weights for policy 0, policy_version 102504 (0.0010) [2023-12-27 19:57:56,234][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000101320_25944064.pth [2023-12-27 19:57:56,507][106225] Updated weights for policy 1, policy_version 102373 (0.0006) [2023-12-27 19:57:56,567][106225] Updated weights for policy 1, policy_version 102383 (0.0008) [2023-12-27 19:57:56,624][106225] Updated weights for policy 1, policy_version 102393 (0.0007) [2023-12-27 19:57:56,888][106226] Updated weights for policy 0, policy_version 102514 (0.0005) [2023-12-27 19:57:56,941][106226] Updated weights for policy 0, policy_version 102524 (0.0007) [2023-12-27 19:57:56,987][106226] Updated weights for policy 0, policy_version 102534 (0.0010) [2023-12-27 19:57:57,177][106225] Updated weights for policy 1, policy_version 102403 (0.0007) [2023-12-27 19:57:57,238][106225] Updated weights for policy 1, policy_version 102413 (0.0005) [2023-12-27 19:57:57,288][106225] Updated weights for policy 1, policy_version 102423 (0.0005) [2023-12-27 19:57:57,574][106226] Updated weights for policy 0, policy_version 102544 (0.0007) [2023-12-27 19:57:57,631][106226] Updated weights for policy 0, policy_version 102554 (0.0009) [2023-12-27 19:57:57,700][106226] Updated weights for policy 0, policy_version 102564 (0.0005) [2023-12-27 19:57:57,966][106225] Updated weights for policy 1, policy_version 102433 (0.0007) [2023-12-27 19:57:58,029][106225] Updated weights for policy 1, policy_version 102443 (0.0006) [2023-12-27 19:57:58,087][106225] Updated weights for policy 1, policy_version 102453 (0.0005) [2023-12-27 19:57:58,145][106225] Updated weights for policy 1, policy_version 102463 (0.0008) [2023-12-27 19:57:58,307][106226] Updated weights for policy 0, policy_version 102574 (0.0010) [2023-12-27 19:57:58,380][106226] Updated weights for policy 0, policy_version 102584 (0.0008) [2023-12-27 19:57:58,444][106226] Updated weights for policy 0, policy_version 102594 (0.0009) [2023-12-27 19:57:58,914][106225] Updated weights for policy 1, policy_version 102473 (0.0008) [2023-12-27 19:57:58,983][106225] Updated weights for policy 1, policy_version 102483 (0.0006) [2023-12-27 19:57:59,052][106225] Updated weights for policy 1, policy_version 102493 (0.0008) [2023-12-27 19:57:59,208][106226] Updated weights for policy 0, policy_version 102604 (0.0009) [2023-12-27 19:57:59,286][106226] Updated weights for policy 0, policy_version 102614 (0.0010) [2023-12-27 19:57:59,348][106226] Updated weights for policy 0, policy_version 102624 (0.0010) [2023-12-27 19:57:59,841][106225] Updated weights for policy 1, policy_version 102503 (0.0009) [2023-12-27 19:57:59,905][106225] Updated weights for policy 1, policy_version 102513 (0.0009) [2023-12-27 19:57:59,966][106225] Updated weights for policy 1, policy_version 102523 (0.0007) [2023-12-27 19:58:00,059][106226] Updated weights for policy 0, policy_version 102634 (0.0010) [2023-12-27 19:58:00,120][106226] Updated weights for policy 0, policy_version 102644 (0.0009) [2023-12-27 19:58:00,180][106226] Updated weights for policy 0, policy_version 102654 (0.0008) [2023-12-27 19:58:00,237][106226] Updated weights for policy 0, policy_version 102664 (0.0007) [2023-12-27 19:58:00,646][106225] Updated weights for policy 1, policy_version 102533 (0.0007) [2023-12-27 19:58:00,699][106225] Updated weights for policy 1, policy_version 102543 (0.0006) [2023-12-27 19:58:00,747][106225] Updated weights for policy 1, policy_version 102553 (0.0005) [2023-12-27 19:58:00,877][106226] Updated weights for policy 0, policy_version 102674 (0.0009) [2023-12-27 19:58:00,943][106226] Updated weights for policy 0, policy_version 102684 (0.0010) [2023-12-27 19:58:01,002][106226] Updated weights for policy 0, policy_version 102694 (0.0010) [2023-12-27 19:58:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 52559872. Throughput: 0: 10163.2, 1: 9890.5. Samples: 52547272. Policy #0 lag: (min: 0.0, avg: 26.4, max: 32.0) [2023-12-27 19:58:01,175][105115] Avg episode reward: [(0, '-5.522'), (1, '-6.653')] [2023-12-27 19:58:01,391][106225] Updated weights for policy 1, policy_version 102563 (0.0006) [2023-12-27 19:58:01,445][106225] Updated weights for policy 1, policy_version 102573 (0.0010) [2023-12-27 19:58:01,494][106225] Updated weights for policy 1, policy_version 102583 (0.0010) [2023-12-27 19:58:01,678][106226] Updated weights for policy 0, policy_version 102704 (0.0008) [2023-12-27 19:58:01,752][106226] Updated weights for policy 0, policy_version 102714 (0.0008) [2023-12-27 19:58:01,810][106226] Updated weights for policy 0, policy_version 102724 (0.0008) [2023-12-27 19:58:02,256][106225] Updated weights for policy 1, policy_version 102593 (0.0010) [2023-12-27 19:58:02,321][106225] Updated weights for policy 1, policy_version 102603 (0.0007) [2023-12-27 19:58:02,384][106225] Updated weights for policy 1, policy_version 102613 (0.0009) [2023-12-27 19:58:02,449][106225] Updated weights for policy 1, policy_version 102623 (0.0009) [2023-12-27 19:58:02,604][106226] Updated weights for policy 0, policy_version 102734 (0.0009) [2023-12-27 19:58:02,675][106226] Updated weights for policy 0, policy_version 102744 (0.0009) [2023-12-27 19:58:02,742][106226] Updated weights for policy 0, policy_version 102754 (0.0008) [2023-12-27 19:58:03,147][106225] Updated weights for policy 1, policy_version 102633 (0.0008) [2023-12-27 19:58:03,191][106225] Updated weights for policy 1, policy_version 102643 (0.0008) [2023-12-27 19:58:03,243][106225] Updated weights for policy 1, policy_version 102653 (0.0008) [2023-12-27 19:58:03,477][106226] Updated weights for policy 0, policy_version 102764 (0.0010) [2023-12-27 19:58:03,539][106226] Updated weights for policy 0, policy_version 102774 (0.0009) [2023-12-27 19:58:03,601][106226] Updated weights for policy 0, policy_version 102784 (0.0009) [2023-12-27 19:58:03,973][106225] Updated weights for policy 1, policy_version 102663 (0.0009) [2023-12-27 19:58:04,037][106225] Updated weights for policy 1, policy_version 102673 (0.0008) [2023-12-27 19:58:04,108][106225] Updated weights for policy 1, policy_version 102683 (0.0009) [2023-12-27 19:58:04,354][106226] Updated weights for policy 0, policy_version 102794 (0.0008) [2023-12-27 19:58:04,423][106226] Updated weights for policy 0, policy_version 102804 (0.0008) [2023-12-27 19:58:04,490][106226] Updated weights for policy 0, policy_version 102814 (0.0009) [2023-12-27 19:58:04,549][106226] Updated weights for policy 0, policy_version 102824 (0.0008) [2023-12-27 19:58:04,800][106225] Updated weights for policy 1, policy_version 102693 (0.0008) [2023-12-27 19:58:04,862][106225] Updated weights for policy 1, policy_version 102703 (0.0008) [2023-12-27 19:58:04,927][106225] Updated weights for policy 1, policy_version 102713 (0.0009) [2023-12-27 19:58:05,268][106226] Updated weights for policy 0, policy_version 102834 (0.0009) [2023-12-27 19:58:05,330][106226] Updated weights for policy 0, policy_version 102844 (0.0008) [2023-12-27 19:58:05,393][106226] Updated weights for policy 0, policy_version 102854 (0.0008) [2023-12-27 19:58:05,583][106225] Updated weights for policy 1, policy_version 102723 (0.0007) [2023-12-27 19:58:05,642][106225] Updated weights for policy 1, policy_version 102733 (0.0006) [2023-12-27 19:58:05,698][106225] Updated weights for policy 1, policy_version 102743 (0.0006) [2023-12-27 19:58:06,172][106226] Updated weights for policy 0, policy_version 102864 (0.0009) [2023-12-27 19:58:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 52649984. Throughput: 0: 10075.0, 1: 9836.9. Samples: 52663256. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:06,175][105115] Avg episode reward: [(0, '-5.258'), (1, '-7.129')] [2023-12-27 19:58:06,240][106226] Updated weights for policy 0, policy_version 102874 (0.0008) [2023-12-27 19:58:06,305][106226] Updated weights for policy 0, policy_version 102884 (0.0009) [2023-12-27 19:58:06,367][106225] Updated weights for policy 1, policy_version 102753 (0.0006) [2023-12-27 19:58:06,438][106225] Updated weights for policy 1, policy_version 102763 (0.0008) [2023-12-27 19:58:06,493][106225] Updated weights for policy 1, policy_version 102773 (0.0008) [2023-12-27 19:58:06,548][106225] Updated weights for policy 1, policy_version 102783 (0.0008) [2023-12-27 19:58:07,039][106226] Updated weights for policy 0, policy_version 102894 (0.0008) [2023-12-27 19:58:07,102][106226] Updated weights for policy 0, policy_version 102904 (0.0009) [2023-12-27 19:58:07,163][106226] Updated weights for policy 0, policy_version 102914 (0.0009) [2023-12-27 19:58:07,301][106225] Updated weights for policy 1, policy_version 102793 (0.0008) [2023-12-27 19:58:07,359][106225] Updated weights for policy 1, policy_version 102803 (0.0008) [2023-12-27 19:58:07,419][106225] Updated weights for policy 1, policy_version 102813 (0.0008) [2023-12-27 19:58:07,920][106226] Updated weights for policy 0, policy_version 102924 (0.0009) [2023-12-27 19:58:07,975][106226] Updated weights for policy 0, policy_version 102934 (0.0009) [2023-12-27 19:58:08,031][106226] Updated weights for policy 0, policy_version 102944 (0.0008) [2023-12-27 19:58:08,082][106225] Updated weights for policy 1, policy_version 102823 (0.0010) [2023-12-27 19:58:08,139][106225] Updated weights for policy 1, policy_version 102833 (0.0010) [2023-12-27 19:58:08,189][106225] Updated weights for policy 1, policy_version 102843 (0.0010) [2023-12-27 19:58:08,684][106226] Updated weights for policy 0, policy_version 102954 (0.0007) [2023-12-27 19:58:08,746][106226] Updated weights for policy 0, policy_version 102964 (0.0008) [2023-12-27 19:58:08,808][106226] Updated weights for policy 0, policy_version 102974 (0.0009) [2023-12-27 19:58:08,857][106225] Updated weights for policy 1, policy_version 102853 (0.0008) [2023-12-27 19:58:08,864][106226] Updated weights for policy 0, policy_version 102984 (0.0010) [2023-12-27 19:58:08,914][106225] Updated weights for policy 1, policy_version 102863 (0.0005) [2023-12-27 19:58:08,979][106225] Updated weights for policy 1, policy_version 102873 (0.0005) [2023-12-27 19:58:09,605][106226] Updated weights for policy 0, policy_version 102994 (0.0006) [2023-12-27 19:58:09,659][106225] Updated weights for policy 1, policy_version 102883 (0.0006) [2023-12-27 19:58:09,663][106226] Updated weights for policy 0, policy_version 103004 (0.0008) [2023-12-27 19:58:09,718][106225] Updated weights for policy 1, policy_version 102893 (0.0006) [2023-12-27 19:58:09,724][106226] Updated weights for policy 0, policy_version 103014 (0.0008) [2023-12-27 19:58:09,775][106225] Updated weights for policy 1, policy_version 102903 (0.0008) [2023-12-27 19:58:10,434][106226] Updated weights for policy 0, policy_version 103024 (0.0008) [2023-12-27 19:58:10,460][106225] Updated weights for policy 1, policy_version 102913 (0.0008) [2023-12-27 19:58:10,498][106226] Updated weights for policy 0, policy_version 103034 (0.0006) [2023-12-27 19:58:10,522][106225] Updated weights for policy 1, policy_version 102923 (0.0007) [2023-12-27 19:58:10,560][106226] Updated weights for policy 0, policy_version 103044 (0.0007) [2023-12-27 19:58:10,581][106225] Updated weights for policy 1, policy_version 102933 (0.0007) [2023-12-27 19:58:10,641][106225] Updated weights for policy 1, policy_version 102943 (0.0008) [2023-12-27 19:58:11,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 52748288. Throughput: 0: 10033.1, 1: 9877.6. Samples: 52721204. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:11,175][105115] Avg episode reward: [(0, '-5.032'), (1, '-7.160')] [2023-12-27 19:58:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000102944_26361856.pth... [2023-12-27 19:58:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000103048_26386432.pth... [2023-12-27 19:58:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000101792_26066944.pth [2023-12-27 19:58:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000101896_26091520.pth [2023-12-27 19:58:11,302][106226] Updated weights for policy 0, policy_version 103054 (0.0007) [2023-12-27 19:58:11,371][106226] Updated weights for policy 0, policy_version 103064 (0.0007) [2023-12-27 19:58:11,380][106225] Updated weights for policy 1, policy_version 102953 (0.0008) [2023-12-27 19:58:11,438][106226] Updated weights for policy 0, policy_version 103074 (0.0008) [2023-12-27 19:58:11,441][106225] Updated weights for policy 1, policy_version 102963 (0.0008) [2023-12-27 19:58:11,497][106225] Updated weights for policy 1, policy_version 102973 (0.0008) [2023-12-27 19:58:12,220][106226] Updated weights for policy 0, policy_version 103084 (0.0008) [2023-12-27 19:58:12,280][106226] Updated weights for policy 0, policy_version 103094 (0.0008) [2023-12-27 19:58:12,316][106225] Updated weights for policy 1, policy_version 102983 (0.0008) [2023-12-27 19:58:12,343][106226] Updated weights for policy 0, policy_version 103104 (0.0007) [2023-12-27 19:58:12,382][106225] Updated weights for policy 1, policy_version 102993 (0.0007) [2023-12-27 19:58:12,439][106225] Updated weights for policy 1, policy_version 103003 (0.0007) [2023-12-27 19:58:13,078][106226] Updated weights for policy 0, policy_version 103114 (0.0008) [2023-12-27 19:58:13,112][106225] Updated weights for policy 1, policy_version 103013 (0.0007) [2023-12-27 19:58:13,145][106226] Updated weights for policy 0, policy_version 103124 (0.0006) [2023-12-27 19:58:13,161][106225] Updated weights for policy 1, policy_version 103023 (0.0005) [2023-12-27 19:58:13,210][106226] Updated weights for policy 0, policy_version 103134 (0.0005) [2023-12-27 19:58:13,213][106225] Updated weights for policy 1, policy_version 103033 (0.0005) [2023-12-27 19:58:13,269][106226] Updated weights for policy 0, policy_version 103144 (0.0005) [2023-12-27 19:58:13,746][106226] Updated weights for policy 0, policy_version 103154 (0.0011) [2023-12-27 19:58:13,806][106226] Updated weights for policy 0, policy_version 103164 (0.0010) [2023-12-27 19:58:13,870][106226] Updated weights for policy 0, policy_version 103174 (0.0010) [2023-12-27 19:58:13,962][106225] Updated weights for policy 1, policy_version 103043 (0.0007) [2023-12-27 19:58:14,008][106225] Updated weights for policy 1, policy_version 103053 (0.0010) [2023-12-27 19:58:14,055][106225] Updated weights for policy 1, policy_version 103063 (0.0010) [2023-12-27 19:58:14,475][106226] Updated weights for policy 0, policy_version 103184 (0.0006) [2023-12-27 19:58:14,532][106226] Updated weights for policy 0, policy_version 103194 (0.0005) [2023-12-27 19:58:14,595][106226] Updated weights for policy 0, policy_version 103204 (0.0005) [2023-12-27 19:58:14,770][106225] Updated weights for policy 1, policy_version 103073 (0.0010) [2023-12-27 19:58:14,837][106225] Updated weights for policy 1, policy_version 103083 (0.0008) [2023-12-27 19:58:14,901][106225] Updated weights for policy 1, policy_version 103093 (0.0009) [2023-12-27 19:58:14,959][106225] Updated weights for policy 1, policy_version 103103 (0.0010) [2023-12-27 19:58:15,255][106226] Updated weights for policy 0, policy_version 103214 (0.0006) [2023-12-27 19:58:15,322][106226] Updated weights for policy 0, policy_version 103224 (0.0008) [2023-12-27 19:58:15,384][106226] Updated weights for policy 0, policy_version 103234 (0.0008) [2023-12-27 19:58:15,626][106225] Updated weights for policy 1, policy_version 103113 (0.0006) [2023-12-27 19:58:15,681][106225] Updated weights for policy 1, policy_version 103123 (0.0005) [2023-12-27 19:58:15,736][106225] Updated weights for policy 1, policy_version 103133 (0.0005) [2023-12-27 19:58:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 52846592. Throughput: 0: 9943.4, 1: 9881.2. Samples: 52839548. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:16,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-7.066')] [2023-12-27 19:58:16,195][106226] Updated weights for policy 0, policy_version 103244 (0.0008) [2023-12-27 19:58:16,246][106226] Updated weights for policy 0, policy_version 103254 (0.0008) [2023-12-27 19:58:16,299][106225] Updated weights for policy 1, policy_version 103143 (0.0005) [2023-12-27 19:58:16,300][106226] Updated weights for policy 0, policy_version 103264 (0.0006) [2023-12-27 19:58:16,355][106225] Updated weights for policy 1, policy_version 103153 (0.0005) [2023-12-27 19:58:16,401][106225] Updated weights for policy 1, policy_version 103163 (0.0005) [2023-12-27 19:58:16,889][106226] Updated weights for policy 0, policy_version 103274 (0.0006) [2023-12-27 19:58:16,944][106226] Updated weights for policy 0, policy_version 103284 (0.0007) [2023-12-27 19:58:16,994][106226] Updated weights for policy 0, policy_version 103294 (0.0007) [2023-12-27 19:58:17,049][106226] Updated weights for policy 0, policy_version 103304 (0.0007) [2023-12-27 19:58:17,083][106225] Updated weights for policy 1, policy_version 103173 (0.0008) [2023-12-27 19:58:17,137][106225] Updated weights for policy 1, policy_version 103183 (0.0010) [2023-12-27 19:58:17,190][106225] Updated weights for policy 1, policy_version 103193 (0.0010) [2023-12-27 19:58:17,685][106226] Updated weights for policy 0, policy_version 103314 (0.0010) [2023-12-27 19:58:17,738][106226] Updated weights for policy 0, policy_version 103324 (0.0010) [2023-12-27 19:58:17,792][106226] Updated weights for policy 0, policy_version 103334 (0.0010) [2023-12-27 19:58:17,915][106225] Updated weights for policy 1, policy_version 103203 (0.0009) [2023-12-27 19:58:17,974][106225] Updated weights for policy 1, policy_version 103213 (0.0007) [2023-12-27 19:58:18,024][106225] Updated weights for policy 1, policy_version 103223 (0.0007) [2023-12-27 19:58:18,561][106226] Updated weights for policy 0, policy_version 103344 (0.0010) [2023-12-27 19:58:18,621][106226] Updated weights for policy 0, policy_version 103354 (0.0011) [2023-12-27 19:58:18,686][106226] Updated weights for policy 0, policy_version 103364 (0.0011) [2023-12-27 19:58:18,750][106225] Updated weights for policy 1, policy_version 103233 (0.0008) [2023-12-27 19:58:18,809][106225] Updated weights for policy 1, policy_version 103243 (0.0011) [2023-12-27 19:58:18,867][106225] Updated weights for policy 1, policy_version 103253 (0.0010) [2023-12-27 19:58:18,929][106225] Updated weights for policy 1, policy_version 103263 (0.0011) [2023-12-27 19:58:19,360][106226] Updated weights for policy 0, policy_version 103374 (0.0009) [2023-12-27 19:58:19,417][106226] Updated weights for policy 0, policy_version 103384 (0.0008) [2023-12-27 19:58:19,482][106226] Updated weights for policy 0, policy_version 103394 (0.0008) [2023-12-27 19:58:19,658][106225] Updated weights for policy 1, policy_version 103273 (0.0009) [2023-12-27 19:58:19,720][106225] Updated weights for policy 1, policy_version 103283 (0.0009) [2023-12-27 19:58:19,769][106225] Updated weights for policy 1, policy_version 103293 (0.0008) [2023-12-27 19:58:20,195][106226] Updated weights for policy 0, policy_version 103404 (0.0008) [2023-12-27 19:58:20,255][106226] Updated weights for policy 0, policy_version 103414 (0.0009) [2023-12-27 19:58:20,316][106226] Updated weights for policy 0, policy_version 103424 (0.0009) [2023-12-27 19:58:20,541][106225] Updated weights for policy 1, policy_version 103303 (0.0008) [2023-12-27 19:58:20,600][106225] Updated weights for policy 1, policy_version 103313 (0.0009) [2023-12-27 19:58:20,657][106225] Updated weights for policy 1, policy_version 103323 (0.0007) [2023-12-27 19:58:21,099][106226] Updated weights for policy 0, policy_version 103434 (0.0009) [2023-12-27 19:58:21,172][106226] Updated weights for policy 0, policy_version 103444 (0.0010) [2023-12-27 19:58:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 52944896. Throughput: 0: 9886.2, 1: 9870.5. Samples: 52957444. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:21,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-6.825')] [2023-12-27 19:58:21,240][106226] Updated weights for policy 0, policy_version 103454 (0.0010) [2023-12-27 19:58:21,308][106226] Updated weights for policy 0, policy_version 103464 (0.0007) [2023-12-27 19:58:21,453][106225] Updated weights for policy 1, policy_version 103333 (0.0008) [2023-12-27 19:58:21,505][106225] Updated weights for policy 1, policy_version 103343 (0.0008) [2023-12-27 19:58:21,558][106225] Updated weights for policy 1, policy_version 103353 (0.0007) [2023-12-27 19:58:22,035][106226] Updated weights for policy 0, policy_version 103474 (0.0011) [2023-12-27 19:58:22,093][106226] Updated weights for policy 0, policy_version 103484 (0.0011) [2023-12-27 19:58:22,158][106226] Updated weights for policy 0, policy_version 103494 (0.0011) [2023-12-27 19:58:22,325][106225] Updated weights for policy 1, policy_version 103363 (0.0006) [2023-12-27 19:58:22,398][106225] Updated weights for policy 1, policy_version 103373 (0.0009) [2023-12-27 19:58:22,457][106225] Updated weights for policy 1, policy_version 103383 (0.0009) [2023-12-27 19:58:22,916][106226] Updated weights for policy 0, policy_version 103504 (0.0011) [2023-12-27 19:58:22,977][106226] Updated weights for policy 0, policy_version 103514 (0.0011) [2023-12-27 19:58:23,027][106226] Updated weights for policy 0, policy_version 103524 (0.0010) [2023-12-27 19:58:23,132][106225] Updated weights for policy 1, policy_version 103393 (0.0010) [2023-12-27 19:58:23,199][106225] Updated weights for policy 1, policy_version 103403 (0.0008) [2023-12-27 19:58:23,264][106225] Updated weights for policy 1, policy_version 103413 (0.0006) [2023-12-27 19:58:23,324][106225] Updated weights for policy 1, policy_version 103423 (0.0007) [2023-12-27 19:58:23,748][106226] Updated weights for policy 0, policy_version 103534 (0.0010) [2023-12-27 19:58:23,797][106226] Updated weights for policy 0, policy_version 103544 (0.0010) [2023-12-27 19:58:23,851][106226] Updated weights for policy 0, policy_version 103554 (0.0010) [2023-12-27 19:58:23,968][106225] Updated weights for policy 1, policy_version 103433 (0.0006) [2023-12-27 19:58:24,031][106225] Updated weights for policy 1, policy_version 103443 (0.0005) [2023-12-27 19:58:24,097][106225] Updated weights for policy 1, policy_version 103453 (0.0006) [2023-12-27 19:58:24,463][106226] Updated weights for policy 0, policy_version 103564 (0.0008) [2023-12-27 19:58:24,518][106226] Updated weights for policy 0, policy_version 103574 (0.0009) [2023-12-27 19:58:24,574][106226] Updated weights for policy 0, policy_version 103584 (0.0010) [2023-12-27 19:58:24,640][106225] Updated weights for policy 1, policy_version 103463 (0.0006) [2023-12-27 19:58:24,693][106225] Updated weights for policy 1, policy_version 103473 (0.0008) [2023-12-27 19:58:24,749][106225] Updated weights for policy 1, policy_version 103483 (0.0008) [2023-12-27 19:58:25,265][106226] Updated weights for policy 0, policy_version 103594 (0.0008) [2023-12-27 19:58:25,322][106226] Updated weights for policy 0, policy_version 103604 (0.0010) [2023-12-27 19:58:25,369][106226] Updated weights for policy 0, policy_version 103614 (0.0010) [2023-12-27 19:58:25,396][106225] Updated weights for policy 1, policy_version 103493 (0.0007) [2023-12-27 19:58:25,416][106226] Updated weights for policy 0, policy_version 103624 (0.0007) [2023-12-27 19:58:25,449][106225] Updated weights for policy 1, policy_version 103503 (0.0005) [2023-12-27 19:58:25,504][106225] Updated weights for policy 1, policy_version 103513 (0.0005) [2023-12-27 19:58:26,040][106226] Updated weights for policy 0, policy_version 103634 (0.0011) [2023-12-27 19:58:26,090][106226] Updated weights for policy 0, policy_version 103644 (0.0010) [2023-12-27 19:58:26,144][106225] Updated weights for policy 1, policy_version 103523 (0.0005) [2023-12-27 19:58:26,146][106226] Updated weights for policy 0, policy_version 103654 (0.0010) [2023-12-27 19:58:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 53051392. Throughput: 0: 9868.0, 1: 9841.5. Samples: 53015552. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:26,175][105115] Avg episode reward: [(0, '-5.590'), (1, '-7.190')] [2023-12-27 19:58:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000103656_26542080.pth... [2023-12-27 19:58:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000102504_26247168.pth [2023-12-27 19:58:26,200][106225] Updated weights for policy 1, policy_version 103533 (0.0007) [2023-12-27 19:58:26,257][106225] Updated weights for policy 1, policy_version 103543 (0.0007) [2023-12-27 19:58:26,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000103552_26517504.pth... [2023-12-27 19:58:26,312][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000102368_26214400.pth [2023-12-27 19:58:26,761][106226] Updated weights for policy 0, policy_version 103664 (0.0006) [2023-12-27 19:58:26,812][106226] Updated weights for policy 0, policy_version 103674 (0.0005) [2023-12-27 19:58:26,851][106225] Updated weights for policy 1, policy_version 103553 (0.0008) [2023-12-27 19:58:26,868][106226] Updated weights for policy 0, policy_version 103684 (0.0005) [2023-12-27 19:58:26,904][106225] Updated weights for policy 1, policy_version 103563 (0.0007) [2023-12-27 19:58:26,950][106225] Updated weights for policy 1, policy_version 103573 (0.0008) [2023-12-27 19:58:26,995][106225] Updated weights for policy 1, policy_version 103583 (0.0005) [2023-12-27 19:58:27,539][106226] Updated weights for policy 0, policy_version 103694 (0.0007) [2023-12-27 19:58:27,592][106226] Updated weights for policy 0, policy_version 103704 (0.0005) [2023-12-27 19:58:27,649][106226] Updated weights for policy 0, policy_version 103714 (0.0006) [2023-12-27 19:58:27,747][106225] Updated weights for policy 1, policy_version 103593 (0.0009) [2023-12-27 19:58:27,802][106225] Updated weights for policy 1, policy_version 103603 (0.0009) [2023-12-27 19:58:27,854][106225] Updated weights for policy 1, policy_version 103613 (0.0008) [2023-12-27 19:58:28,304][106226] Updated weights for policy 0, policy_version 103724 (0.0009) [2023-12-27 19:58:28,369][106226] Updated weights for policy 0, policy_version 103734 (0.0008) [2023-12-27 19:58:28,426][106226] Updated weights for policy 0, policy_version 103744 (0.0008) [2023-12-27 19:58:28,557][106225] Updated weights for policy 1, policy_version 103623 (0.0006) [2023-12-27 19:58:28,615][106225] Updated weights for policy 1, policy_version 103633 (0.0008) [2023-12-27 19:58:28,672][106225] Updated weights for policy 1, policy_version 103643 (0.0008) [2023-12-27 19:58:29,079][106226] Updated weights for policy 0, policy_version 103754 (0.0007) [2023-12-27 19:58:29,139][106226] Updated weights for policy 0, policy_version 103764 (0.0005) [2023-12-27 19:58:29,193][106226] Updated weights for policy 0, policy_version 103774 (0.0007) [2023-12-27 19:58:29,263][106226] Updated weights for policy 0, policy_version 103784 (0.0009) [2023-12-27 19:58:29,406][106225] Updated weights for policy 1, policy_version 103653 (0.0007) [2023-12-27 19:58:29,460][106225] Updated weights for policy 1, policy_version 103663 (0.0005) [2023-12-27 19:58:29,511][106225] Updated weights for policy 1, policy_version 103673 (0.0005) [2023-12-27 19:58:29,984][106226] Updated weights for policy 0, policy_version 103794 (0.0008) [2023-12-27 19:58:30,049][106226] Updated weights for policy 0, policy_version 103804 (0.0008) [2023-12-27 19:58:30,106][106226] Updated weights for policy 0, policy_version 103814 (0.0008) [2023-12-27 19:58:30,232][106225] Updated weights for policy 1, policy_version 103683 (0.0007) [2023-12-27 19:58:30,291][106225] Updated weights for policy 1, policy_version 103693 (0.0008) [2023-12-27 19:58:30,353][106225] Updated weights for policy 1, policy_version 103703 (0.0008) [2023-12-27 19:58:30,782][106226] Updated weights for policy 0, policy_version 103824 (0.0006) [2023-12-27 19:58:30,835][106226] Updated weights for policy 0, policy_version 103834 (0.0005) [2023-12-27 19:58:30,897][106226] Updated weights for policy 0, policy_version 103844 (0.0005) [2023-12-27 19:58:31,141][106225] Updated weights for policy 1, policy_version 103713 (0.0008) [2023-12-27 19:58:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 53149696. Throughput: 0: 10018.8, 1: 9901.0. Samples: 53141524. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:31,175][105115] Avg episode reward: [(0, '-5.328'), (1, '-6.658')] [2023-12-27 19:58:31,200][106225] Updated weights for policy 1, policy_version 103723 (0.0008) [2023-12-27 19:58:31,258][106225] Updated weights for policy 1, policy_version 103733 (0.0008) [2023-12-27 19:58:31,319][106225] Updated weights for policy 1, policy_version 103743 (0.0009) [2023-12-27 19:58:31,579][106226] Updated weights for policy 0, policy_version 103854 (0.0008) [2023-12-27 19:58:31,641][106226] Updated weights for policy 0, policy_version 103864 (0.0008) [2023-12-27 19:58:31,702][106226] Updated weights for policy 0, policy_version 103874 (0.0008) [2023-12-27 19:58:31,976][106225] Updated weights for policy 1, policy_version 103753 (0.0009) [2023-12-27 19:58:32,030][106225] Updated weights for policy 1, policy_version 103763 (0.0010) [2023-12-27 19:58:32,079][106225] Updated weights for policy 1, policy_version 103773 (0.0009) [2023-12-27 19:58:32,428][106226] Updated weights for policy 0, policy_version 103884 (0.0008) [2023-12-27 19:58:32,476][106226] Updated weights for policy 0, policy_version 103894 (0.0008) [2023-12-27 19:58:32,528][106226] Updated weights for policy 0, policy_version 103904 (0.0005) [2023-12-27 19:58:32,897][106225] Updated weights for policy 1, policy_version 103783 (0.0008) [2023-12-27 19:58:32,952][106225] Updated weights for policy 1, policy_version 103793 (0.0008) [2023-12-27 19:58:33,023][106225] Updated weights for policy 1, policy_version 103803 (0.0009) [2023-12-27 19:58:33,162][106226] Updated weights for policy 0, policy_version 103914 (0.0006) [2023-12-27 19:58:33,218][106226] Updated weights for policy 0, policy_version 103924 (0.0008) [2023-12-27 19:58:33,275][106226] Updated weights for policy 0, policy_version 103934 (0.0008) [2023-12-27 19:58:33,339][106226] Updated weights for policy 0, policy_version 103944 (0.0008) [2023-12-27 19:58:33,743][106225] Updated weights for policy 1, policy_version 103813 (0.0010) [2023-12-27 19:58:33,810][106225] Updated weights for policy 1, policy_version 103823 (0.0006) [2023-12-27 19:58:33,871][106225] Updated weights for policy 1, policy_version 103833 (0.0006) [2023-12-27 19:58:34,070][106226] Updated weights for policy 0, policy_version 103954 (0.0007) [2023-12-27 19:58:34,132][106226] Updated weights for policy 0, policy_version 103964 (0.0008) [2023-12-27 19:58:34,202][106226] Updated weights for policy 0, policy_version 103974 (0.0008) [2023-12-27 19:58:34,566][106225] Updated weights for policy 1, policy_version 103843 (0.0008) [2023-12-27 19:58:34,629][106225] Updated weights for policy 1, policy_version 103853 (0.0011) [2023-12-27 19:58:34,691][106225] Updated weights for policy 1, policy_version 103863 (0.0010) [2023-12-27 19:58:34,855][106226] Updated weights for policy 0, policy_version 103984 (0.0007) [2023-12-27 19:58:34,922][106226] Updated weights for policy 0, policy_version 103994 (0.0006) [2023-12-27 19:58:34,979][106226] Updated weights for policy 0, policy_version 104004 (0.0005) [2023-12-27 19:58:35,402][106225] Updated weights for policy 1, policy_version 103873 (0.0010) [2023-12-27 19:58:35,462][106225] Updated weights for policy 1, policy_version 103883 (0.0010) [2023-12-27 19:58:35,512][106225] Updated weights for policy 1, policy_version 103893 (0.0010) [2023-12-27 19:58:35,527][106226] Updated weights for policy 0, policy_version 104014 (0.0006) [2023-12-27 19:58:35,565][106225] Updated weights for policy 1, policy_version 103903 (0.0010) [2023-12-27 19:58:35,580][106226] Updated weights for policy 0, policy_version 104024 (0.0008) [2023-12-27 19:58:35,629][106226] Updated weights for policy 0, policy_version 104034 (0.0007) [2023-12-27 19:58:36,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19910.7). Total num frames: 53248000. Throughput: 0: 10013.4, 1: 9910.9. Samples: 53261496. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:36,176][105115] Avg episode reward: [(0, '-5.471'), (1, '-6.717')] [2023-12-27 19:58:36,204][106226] Updated weights for policy 0, policy_version 104044 (0.0006) [2023-12-27 19:58:36,257][106225] Updated weights for policy 1, policy_version 103913 (0.0010) [2023-12-27 19:58:36,272][106226] Updated weights for policy 0, policy_version 104054 (0.0006) [2023-12-27 19:58:36,325][106225] Updated weights for policy 1, policy_version 103923 (0.0010) [2023-12-27 19:58:36,341][106226] Updated weights for policy 0, policy_version 104064 (0.0006) [2023-12-27 19:58:36,386][106225] Updated weights for policy 1, policy_version 103933 (0.0010) [2023-12-27 19:58:36,855][106226] Updated weights for policy 0, policy_version 104074 (0.0006) [2023-12-27 19:58:36,919][106226] Updated weights for policy 0, policy_version 104084 (0.0006) [2023-12-27 19:58:36,965][106226] Updated weights for policy 0, policy_version 104094 (0.0005) [2023-12-27 19:58:37,013][106226] Updated weights for policy 0, policy_version 104104 (0.0005) [2023-12-27 19:58:37,100][106225] Updated weights for policy 1, policy_version 103943 (0.0010) [2023-12-27 19:58:37,161][106225] Updated weights for policy 1, policy_version 103953 (0.0010) [2023-12-27 19:58:37,214][106225] Updated weights for policy 1, policy_version 103963 (0.0010) [2023-12-27 19:58:37,692][106226] Updated weights for policy 0, policy_version 104114 (0.0010) [2023-12-27 19:58:37,761][106226] Updated weights for policy 0, policy_version 104124 (0.0009) [2023-12-27 19:58:37,825][106226] Updated weights for policy 0, policy_version 104134 (0.0009) [2023-12-27 19:58:37,895][106225] Updated weights for policy 1, policy_version 103973 (0.0009) [2023-12-27 19:58:37,955][106225] Updated weights for policy 1, policy_version 103983 (0.0007) [2023-12-27 19:58:38,015][106225] Updated weights for policy 1, policy_version 103993 (0.0005) [2023-12-27 19:58:38,580][106225] Updated weights for policy 1, policy_version 104003 (0.0006) [2023-12-27 19:58:38,639][106225] Updated weights for policy 1, policy_version 104013 (0.0005) [2023-12-27 19:58:38,656][106226] Updated weights for policy 0, policy_version 104144 (0.0008) [2023-12-27 19:58:38,698][106225] Updated weights for policy 1, policy_version 104023 (0.0006) [2023-12-27 19:58:38,714][106226] Updated weights for policy 0, policy_version 104154 (0.0007) [2023-12-27 19:58:38,772][106226] Updated weights for policy 0, policy_version 104164 (0.0007) [2023-12-27 19:58:39,460][106225] Updated weights for policy 1, policy_version 104033 (0.0006) [2023-12-27 19:58:39,513][106225] Updated weights for policy 1, policy_version 104043 (0.0008) [2023-12-27 19:58:39,559][106226] Updated weights for policy 0, policy_version 104174 (0.0007) [2023-12-27 19:58:39,569][106225] Updated weights for policy 1, policy_version 104053 (0.0007) [2023-12-27 19:58:39,621][106225] Updated weights for policy 1, policy_version 104063 (0.0007) [2023-12-27 19:58:39,623][106226] Updated weights for policy 0, policy_version 104184 (0.0008) [2023-12-27 19:58:39,691][106226] Updated weights for policy 0, policy_version 104194 (0.0008) [2023-12-27 19:58:40,369][106226] Updated weights for policy 0, policy_version 104204 (0.0007) [2023-12-27 19:58:40,415][106225] Updated weights for policy 1, policy_version 104073 (0.0010) [2023-12-27 19:58:40,421][106226] Updated weights for policy 0, policy_version 104214 (0.0006) [2023-12-27 19:58:40,470][106225] Updated weights for policy 1, policy_version 104083 (0.0010) [2023-12-27 19:58:40,477][106226] Updated weights for policy 0, policy_version 104224 (0.0006) [2023-12-27 19:58:40,526][106225] Updated weights for policy 1, policy_version 104093 (0.0010) [2023-12-27 19:58:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 53346304. Throughput: 0: 10022.7, 1: 9971.7. Samples: 53322552. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:41,175][105115] Avg episode reward: [(0, '-5.339'), (1, '-6.838')] [2023-12-27 19:58:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000104096_26656768.pth... [2023-12-27 19:58:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000104232_26689536.pth... [2023-12-27 19:58:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000102944_26361856.pth [2023-12-27 19:58:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000103048_26386432.pth [2023-12-27 19:58:41,223][106226] Updated weights for policy 0, policy_version 104234 (0.0007) [2023-12-27 19:58:41,284][106225] Updated weights for policy 1, policy_version 104103 (0.0007) [2023-12-27 19:58:41,289][106226] Updated weights for policy 0, policy_version 104244 (0.0011) [2023-12-27 19:58:41,344][106225] Updated weights for policy 1, policy_version 104113 (0.0007) [2023-12-27 19:58:41,362][106226] Updated weights for policy 0, policy_version 104254 (0.0009) [2023-12-27 19:58:41,410][106225] Updated weights for policy 1, policy_version 104123 (0.0009) [2023-12-27 19:58:42,085][106226] Updated weights for policy 0, policy_version 104265 (0.0011) [2023-12-27 19:58:42,150][106226] Updated weights for policy 0, policy_version 104275 (0.0011) [2023-12-27 19:58:42,211][106226] Updated weights for policy 0, policy_version 104285 (0.0011) [2023-12-27 19:58:42,216][106225] Updated weights for policy 1, policy_version 104133 (0.0008) [2023-12-27 19:58:42,275][106225] Updated weights for policy 1, policy_version 104143 (0.0010) [2023-12-27 19:58:42,278][106226] Updated weights for policy 0, policy_version 104295 (0.0009) [2023-12-27 19:58:42,334][106225] Updated weights for policy 1, policy_version 104153 (0.0010) [2023-12-27 19:58:42,991][106226] Updated weights for policy 0, policy_version 104305 (0.0010) [2023-12-27 19:58:43,051][106226] Updated weights for policy 0, policy_version 104315 (0.0010) [2023-12-27 19:58:43,069][106225] Updated weights for policy 1, policy_version 104163 (0.0009) [2023-12-27 19:58:43,111][106226] Updated weights for policy 0, policy_version 104325 (0.0010) [2023-12-27 19:58:43,125][106225] Updated weights for policy 1, policy_version 104173 (0.0010) [2023-12-27 19:58:43,188][106225] Updated weights for policy 1, policy_version 104183 (0.0010) [2023-12-27 19:58:43,713][106226] Updated weights for policy 0, policy_version 104335 (0.0010) [2023-12-27 19:58:43,766][106226] Updated weights for policy 0, policy_version 104345 (0.0010) [2023-12-27 19:58:43,812][106226] Updated weights for policy 0, policy_version 104355 (0.0010) [2023-12-27 19:58:43,908][106225] Updated weights for policy 1, policy_version 104193 (0.0010) [2023-12-27 19:58:43,957][106225] Updated weights for policy 1, policy_version 104203 (0.0010) [2023-12-27 19:58:44,001][106225] Updated weights for policy 1, policy_version 104213 (0.0010) [2023-12-27 19:58:44,049][106225] Updated weights for policy 1, policy_version 104223 (0.0010) [2023-12-27 19:58:44,481][106226] Updated weights for policy 0, policy_version 104365 (0.0010) [2023-12-27 19:58:44,540][106226] Updated weights for policy 0, policy_version 104375 (0.0010) [2023-12-27 19:58:44,600][106226] Updated weights for policy 0, policy_version 104385 (0.0010) [2023-12-27 19:58:44,778][106225] Updated weights for policy 1, policy_version 104233 (0.0007) [2023-12-27 19:58:44,842][106225] Updated weights for policy 1, policy_version 104243 (0.0010) [2023-12-27 19:58:44,908][106225] Updated weights for policy 1, policy_version 104253 (0.0009) [2023-12-27 19:58:45,310][106226] Updated weights for policy 0, policy_version 104395 (0.0010) [2023-12-27 19:58:45,370][106226] Updated weights for policy 0, policy_version 104405 (0.0009) [2023-12-27 19:58:45,429][106226] Updated weights for policy 0, policy_version 104415 (0.0009) [2023-12-27 19:58:45,591][106225] Updated weights for policy 1, policy_version 104263 (0.0006) [2023-12-27 19:58:45,644][106225] Updated weights for policy 1, policy_version 104273 (0.0005) [2023-12-27 19:58:45,707][106225] Updated weights for policy 1, policy_version 104283 (0.0006) [2023-12-27 19:58:46,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 53444608. Throughput: 0: 9951.5, 1: 9833.9. Samples: 53437612. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:46,175][105115] Avg episode reward: [(0, '-5.029'), (1, '-7.241')] [2023-12-27 19:58:46,208][106226] Updated weights for policy 0, policy_version 104425 (0.0008) [2023-12-27 19:58:46,261][106226] Updated weights for policy 0, policy_version 104435 (0.0009) [2023-12-27 19:58:46,298][106225] Updated weights for policy 1, policy_version 104293 (0.0007) [2023-12-27 19:58:46,316][106226] Updated weights for policy 0, policy_version 104445 (0.0007) [2023-12-27 19:58:46,354][106225] Updated weights for policy 1, policy_version 104303 (0.0005) [2023-12-27 19:58:46,362][106226] Updated weights for policy 0, policy_version 104455 (0.0009) [2023-12-27 19:58:46,410][106225] Updated weights for policy 1, policy_version 104313 (0.0005) [2023-12-27 19:58:47,050][106225] Updated weights for policy 1, policy_version 104323 (0.0006) [2023-12-27 19:58:47,106][106225] Updated weights for policy 1, policy_version 104333 (0.0005) [2023-12-27 19:58:47,132][106226] Updated weights for policy 0, policy_version 104465 (0.0008) [2023-12-27 19:58:47,161][106225] Updated weights for policy 1, policy_version 104343 (0.0005) [2023-12-27 19:58:47,185][106226] Updated weights for policy 0, policy_version 104475 (0.0008) [2023-12-27 19:58:47,250][106226] Updated weights for policy 0, policy_version 104485 (0.0008) [2023-12-27 19:58:47,785][106225] Updated weights for policy 1, policy_version 104353 (0.0007) [2023-12-27 19:58:47,847][106225] Updated weights for policy 1, policy_version 104363 (0.0008) [2023-12-27 19:58:47,894][106225] Updated weights for policy 1, policy_version 104373 (0.0008) [2023-12-27 19:58:47,940][106225] Updated weights for policy 1, policy_version 104383 (0.0008) [2023-12-27 19:58:48,006][106226] Updated weights for policy 0, policy_version 104495 (0.0007) [2023-12-27 19:58:48,052][106226] Updated weights for policy 0, policy_version 104505 (0.0005) [2023-12-27 19:58:48,101][106226] Updated weights for policy 0, policy_version 104515 (0.0005) [2023-12-27 19:58:48,702][106225] Updated weights for policy 1, policy_version 104393 (0.0009) [2023-12-27 19:58:48,769][106225] Updated weights for policy 1, policy_version 104403 (0.0009) [2023-12-27 19:58:48,832][106225] Updated weights for policy 1, policy_version 104413 (0.0008) [2023-12-27 19:58:48,834][106226] Updated weights for policy 0, policy_version 104525 (0.0007) [2023-12-27 19:58:48,900][106226] Updated weights for policy 0, policy_version 104535 (0.0008) [2023-12-27 19:58:48,962][106226] Updated weights for policy 0, policy_version 104545 (0.0007) [2023-12-27 19:58:49,629][106225] Updated weights for policy 1, policy_version 104423 (0.0008) [2023-12-27 19:58:49,686][106226] Updated weights for policy 0, policy_version 104555 (0.0006) [2023-12-27 19:58:49,689][106225] Updated weights for policy 1, policy_version 104433 (0.0008) [2023-12-27 19:58:49,741][106226] Updated weights for policy 0, policy_version 104565 (0.0008) [2023-12-27 19:58:49,760][106225] Updated weights for policy 1, policy_version 104443 (0.0007) [2023-12-27 19:58:49,790][106226] Updated weights for policy 0, policy_version 104575 (0.0007) [2023-12-27 19:58:50,414][106225] Updated weights for policy 1, policy_version 104453 (0.0007) [2023-12-27 19:58:50,477][106225] Updated weights for policy 1, policy_version 104463 (0.0007) [2023-12-27 19:58:50,506][106226] Updated weights for policy 0, policy_version 104585 (0.0007) [2023-12-27 19:58:50,533][106225] Updated weights for policy 1, policy_version 104473 (0.0006) [2023-12-27 19:58:50,574][106226] Updated weights for policy 0, policy_version 104595 (0.0007) [2023-12-27 19:58:50,633][106226] Updated weights for policy 0, policy_version 104605 (0.0007) [2023-12-27 19:58:50,697][106226] Updated weights for policy 0, policy_version 104615 (0.0009) [2023-12-27 19:58:51,125][106225] Updated weights for policy 1, policy_version 104483 (0.0008) [2023-12-27 19:58:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 53542912. Throughput: 0: 9944.8, 1: 9869.8. Samples: 53554912. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:51,175][105115] Avg episode reward: [(0, '-5.323'), (1, '-6.800')] [2023-12-27 19:58:51,189][106225] Updated weights for policy 1, policy_version 104493 (0.0010) [2023-12-27 19:58:51,258][106225] Updated weights for policy 1, policy_version 104503 (0.0009) [2023-12-27 19:58:51,430][106226] Updated weights for policy 0, policy_version 104625 (0.0008) [2023-12-27 19:58:51,494][106226] Updated weights for policy 0, policy_version 104635 (0.0009) [2023-12-27 19:58:51,553][106226] Updated weights for policy 0, policy_version 104645 (0.0008) [2023-12-27 19:58:51,979][106225] Updated weights for policy 1, policy_version 104513 (0.0008) [2023-12-27 19:58:52,044][106225] Updated weights for policy 1, policy_version 104523 (0.0007) [2023-12-27 19:58:52,105][106225] Updated weights for policy 1, policy_version 104533 (0.0008) [2023-12-27 19:58:52,157][106225] Updated weights for policy 1, policy_version 104543 (0.0009) [2023-12-27 19:58:52,274][106226] Updated weights for policy 0, policy_version 104655 (0.0008) [2023-12-27 19:58:52,337][106226] Updated weights for policy 0, policy_version 104665 (0.0008) [2023-12-27 19:58:52,411][106226] Updated weights for policy 0, policy_version 104675 (0.0008) [2023-12-27 19:58:52,882][106225] Updated weights for policy 1, policy_version 104553 (0.0008) [2023-12-27 19:58:52,942][106225] Updated weights for policy 1, policy_version 104563 (0.0007) [2023-12-27 19:58:53,003][106225] Updated weights for policy 1, policy_version 104573 (0.0005) [2023-12-27 19:58:53,130][106226] Updated weights for policy 0, policy_version 104685 (0.0008) [2023-12-27 19:58:53,190][106226] Updated weights for policy 0, policy_version 104695 (0.0008) [2023-12-27 19:58:53,250][106226] Updated weights for policy 0, policy_version 104705 (0.0008) [2023-12-27 19:58:53,669][106225] Updated weights for policy 1, policy_version 104583 (0.0009) [2023-12-27 19:58:53,725][106225] Updated weights for policy 1, policy_version 104593 (0.0008) [2023-12-27 19:58:53,774][106225] Updated weights for policy 1, policy_version 104603 (0.0006) [2023-12-27 19:58:53,875][106226] Updated weights for policy 0, policy_version 104715 (0.0008) [2023-12-27 19:58:53,946][106226] Updated weights for policy 0, policy_version 104725 (0.0005) [2023-12-27 19:58:54,014][106226] Updated weights for policy 0, policy_version 104735 (0.0006) [2023-12-27 19:58:54,457][106225] Updated weights for policy 1, policy_version 104613 (0.0008) [2023-12-27 19:58:54,525][106225] Updated weights for policy 1, policy_version 104623 (0.0008) [2023-12-27 19:58:54,574][106225] Updated weights for policy 1, policy_version 104633 (0.0009) [2023-12-27 19:58:54,660][106226] Updated weights for policy 0, policy_version 104745 (0.0009) [2023-12-27 19:58:54,720][106226] Updated weights for policy 0, policy_version 104755 (0.0009) [2023-12-27 19:58:54,775][106226] Updated weights for policy 0, policy_version 104765 (0.0008) [2023-12-27 19:58:54,831][106226] Updated weights for policy 0, policy_version 104775 (0.0009) [2023-12-27 19:58:55,275][106225] Updated weights for policy 1, policy_version 104643 (0.0008) [2023-12-27 19:58:55,329][106225] Updated weights for policy 1, policy_version 104653 (0.0008) [2023-12-27 19:58:55,393][106225] Updated weights for policy 1, policy_version 104663 (0.0009) [2023-12-27 19:58:55,540][106226] Updated weights for policy 0, policy_version 104785 (0.0007) [2023-12-27 19:58:55,604][106226] Updated weights for policy 0, policy_version 104795 (0.0005) [2023-12-27 19:58:55,655][106226] Updated weights for policy 0, policy_version 104805 (0.0005) [2023-12-27 19:58:56,159][106225] Updated weights for policy 1, policy_version 104673 (0.0008) [2023-12-27 19:58:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 53641216. Throughput: 0: 9985.9, 1: 9867.6. Samples: 53614616. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:58:56,175][105115] Avg episode reward: [(0, '-5.236'), (1, '-7.022')] [2023-12-27 19:58:56,187][106226] Updated weights for policy 0, policy_version 104815 (0.0007) [2023-12-27 19:58:56,217][106225] Updated weights for policy 1, policy_version 104683 (0.0008) [2023-12-27 19:58:56,243][106226] Updated weights for policy 0, policy_version 104825 (0.0007) [2023-12-27 19:58:56,268][106225] Updated weights for policy 1, policy_version 104693 (0.0006) [2023-12-27 19:58:56,308][106226] Updated weights for policy 0, policy_version 104835 (0.0008) [2023-12-27 19:58:56,327][106225] Updated weights for policy 1, policy_version 104703 (0.0007) [2023-12-27 19:58:56,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000104704_26812416.pth... [2023-12-27 19:58:56,336][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000103552_26517504.pth [2023-12-27 19:58:56,338][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000104840_26845184.pth... [2023-12-27 19:58:56,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000103656_26542080.pth [2023-12-27 19:58:56,840][106226] Updated weights for policy 0, policy_version 104845 (0.0007) [2023-12-27 19:58:56,884][106226] Updated weights for policy 0, policy_version 104855 (0.0007) [2023-12-27 19:58:56,948][106226] Updated weights for policy 0, policy_version 104865 (0.0007) [2023-12-27 19:58:57,064][106225] Updated weights for policy 1, policy_version 104713 (0.0008) [2023-12-27 19:58:57,126][106225] Updated weights for policy 1, policy_version 104723 (0.0009) [2023-12-27 19:58:57,194][106225] Updated weights for policy 1, policy_version 104733 (0.0009) [2023-12-27 19:58:57,617][106226] Updated weights for policy 0, policy_version 104875 (0.0007) [2023-12-27 19:58:57,672][106226] Updated weights for policy 0, policy_version 104885 (0.0007) [2023-12-27 19:58:57,724][106226] Updated weights for policy 0, policy_version 104895 (0.0008) [2023-12-27 19:58:57,774][106225] Updated weights for policy 1, policy_version 104743 (0.0009) [2023-12-27 19:58:57,833][106225] Updated weights for policy 1, policy_version 104753 (0.0010) [2023-12-27 19:58:57,894][106225] Updated weights for policy 1, policy_version 104763 (0.0005) [2023-12-27 19:58:58,298][106226] Updated weights for policy 0, policy_version 104905 (0.0005) [2023-12-27 19:58:58,368][106226] Updated weights for policy 0, policy_version 104915 (0.0007) [2023-12-27 19:58:58,436][106226] Updated weights for policy 0, policy_version 104925 (0.0007) [2023-12-27 19:58:58,504][106226] Updated weights for policy 0, policy_version 104935 (0.0010) [2023-12-27 19:58:58,583][106225] Updated weights for policy 1, policy_version 104773 (0.0008) [2023-12-27 19:58:58,653][106225] Updated weights for policy 1, policy_version 104783 (0.0009) [2023-12-27 19:58:58,717][106225] Updated weights for policy 1, policy_version 104793 (0.0007) [2023-12-27 19:58:59,298][106226] Updated weights for policy 0, policy_version 104945 (0.0009) [2023-12-27 19:58:59,369][106226] Updated weights for policy 0, policy_version 104955 (0.0009) [2023-12-27 19:58:59,430][106226] Updated weights for policy 0, policy_version 104965 (0.0008) [2023-12-27 19:58:59,520][106225] Updated weights for policy 1, policy_version 104803 (0.0007) [2023-12-27 19:58:59,578][106225] Updated weights for policy 1, policy_version 104813 (0.0005) [2023-12-27 19:58:59,647][106225] Updated weights for policy 1, policy_version 104823 (0.0007) [2023-12-27 19:59:00,172][106226] Updated weights for policy 0, policy_version 104975 (0.0009) [2023-12-27 19:59:00,232][106226] Updated weights for policy 0, policy_version 104985 (0.0008) [2023-12-27 19:59:00,284][106226] Updated weights for policy 0, policy_version 104995 (0.0009) [2023-12-27 19:59:00,332][106225] Updated weights for policy 1, policy_version 104833 (0.0008) [2023-12-27 19:59:00,394][106225] Updated weights for policy 1, policy_version 104843 (0.0009) [2023-12-27 19:59:00,453][106225] Updated weights for policy 1, policy_version 104853 (0.0008) [2023-12-27 19:59:00,515][106225] Updated weights for policy 1, policy_version 104863 (0.0008) [2023-12-27 19:59:01,062][106226] Updated weights for policy 0, policy_version 105005 (0.0009) [2023-12-27 19:59:01,120][106226] Updated weights for policy 0, policy_version 105015 (0.0009) [2023-12-27 19:59:01,149][106225] Updated weights for policy 1, policy_version 104873 (0.0007) [2023-12-27 19:59:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 53739520. Throughput: 0: 10032.5, 1: 9884.3. Samples: 53735804. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-27 19:59:01,175][105115] Avg episode reward: [(0, '-5.047'), (1, '-6.888')] [2023-12-27 19:59:01,189][106226] Updated weights for policy 0, policy_version 105025 (0.0009) [2023-12-27 19:59:01,215][106225] Updated weights for policy 1, policy_version 104883 (0.0006) [2023-12-27 19:59:01,281][106225] Updated weights for policy 1, policy_version 104893 (0.0006) [2023-12-27 19:59:01,961][106226] Updated weights for policy 0, policy_version 105035 (0.0009) [2023-12-27 19:59:01,979][106225] Updated weights for policy 1, policy_version 104903 (0.0006) [2023-12-27 19:59:02,030][106226] Updated weights for policy 0, policy_version 105045 (0.0008) [2023-12-27 19:59:02,035][106225] Updated weights for policy 1, policy_version 104913 (0.0006) [2023-12-27 19:59:02,090][106226] Updated weights for policy 0, policy_version 105055 (0.0010) [2023-12-27 19:59:02,095][106225] Updated weights for policy 1, policy_version 104923 (0.0008) [2023-12-27 19:59:02,801][106225] Updated weights for policy 1, policy_version 104933 (0.0008) [2023-12-27 19:59:02,827][106226] Updated weights for policy 0, policy_version 105065 (0.0007) [2023-12-27 19:59:02,862][106225] Updated weights for policy 1, policy_version 104943 (0.0009) [2023-12-27 19:59:02,884][106226] Updated weights for policy 0, policy_version 105075 (0.0005) [2023-12-27 19:59:02,920][106225] Updated weights for policy 1, policy_version 104953 (0.0007) [2023-12-27 19:59:02,942][106226] Updated weights for policy 0, policy_version 105085 (0.0008) [2023-12-27 19:59:02,996][106226] Updated weights for policy 0, policy_version 105095 (0.0007) [2023-12-27 19:59:03,573][106225] Updated weights for policy 1, policy_version 104963 (0.0006) [2023-12-27 19:59:03,618][106225] Updated weights for policy 1, policy_version 104973 (0.0005) [2023-12-27 19:59:03,667][106225] Updated weights for policy 1, policy_version 104983 (0.0007) [2023-12-27 19:59:03,757][106226] Updated weights for policy 0, policy_version 105105 (0.0007) [2023-12-27 19:59:03,806][106226] Updated weights for policy 0, policy_version 105115 (0.0005) [2023-12-27 19:59:03,867][106226] Updated weights for policy 0, policy_version 105125 (0.0011) [2023-12-27 19:59:04,376][106225] Updated weights for policy 1, policy_version 104993 (0.0009) [2023-12-27 19:59:04,437][106225] Updated weights for policy 1, policy_version 105003 (0.0010) [2023-12-27 19:59:04,495][106225] Updated weights for policy 1, policy_version 105013 (0.0010) [2023-12-27 19:59:04,549][106225] Updated weights for policy 1, policy_version 105023 (0.0010) [2023-12-27 19:59:04,560][106226] Updated weights for policy 0, policy_version 105135 (0.0010) [2023-12-27 19:59:04,624][106226] Updated weights for policy 0, policy_version 105145 (0.0011) [2023-12-27 19:59:04,684][106226] Updated weights for policy 0, policy_version 105155 (0.0011) [2023-12-27 19:59:05,193][106225] Updated weights for policy 1, policy_version 105033 (0.0009) [2023-12-27 19:59:05,255][106225] Updated weights for policy 1, policy_version 105043 (0.0008) [2023-12-27 19:59:05,317][106225] Updated weights for policy 1, policy_version 105053 (0.0007) [2023-12-27 19:59:05,408][106226] Updated weights for policy 0, policy_version 105165 (0.0010) [2023-12-27 19:59:05,461][106226] Updated weights for policy 0, policy_version 105175 (0.0009) [2023-12-27 19:59:05,517][106226] Updated weights for policy 0, policy_version 105185 (0.0011) [2023-12-27 19:59:05,929][106225] Updated weights for policy 1, policy_version 105063 (0.0006) [2023-12-27 19:59:05,983][106225] Updated weights for policy 1, policy_version 105073 (0.0010) [2023-12-27 19:59:06,034][106225] Updated weights for policy 1, policy_version 105083 (0.0007) [2023-12-27 19:59:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 53846016. Throughput: 0: 9996.1, 1: 9925.5. Samples: 53853916. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:06,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-6.758')] [2023-12-27 19:59:06,198][106226] Updated weights for policy 0, policy_version 105195 (0.0010) [2023-12-27 19:59:06,264][106226] Updated weights for policy 0, policy_version 105205 (0.0011) [2023-12-27 19:59:06,318][106226] Updated weights for policy 0, policy_version 105215 (0.0011) [2023-12-27 19:59:06,771][106225] Updated weights for policy 1, policy_version 105093 (0.0007) [2023-12-27 19:59:06,836][106225] Updated weights for policy 1, policy_version 105103 (0.0005) [2023-12-27 19:59:06,906][106225] Updated weights for policy 1, policy_version 105113 (0.0005) [2023-12-27 19:59:06,917][106226] Updated weights for policy 0, policy_version 105225 (0.0010) [2023-12-27 19:59:06,966][106226] Updated weights for policy 0, policy_version 105235 (0.0005) [2023-12-27 19:59:07,018][106226] Updated weights for policy 0, policy_version 105245 (0.0006) [2023-12-27 19:59:07,073][106226] Updated weights for policy 0, policy_version 105255 (0.0006) [2023-12-27 19:59:07,458][106225] Updated weights for policy 1, policy_version 105123 (0.0006) [2023-12-27 19:59:07,516][106225] Updated weights for policy 1, policy_version 105133 (0.0008) [2023-12-27 19:59:07,572][106225] Updated weights for policy 1, policy_version 105143 (0.0008) [2023-12-27 19:59:07,733][106226] Updated weights for policy 0, policy_version 105265 (0.0005) [2023-12-27 19:59:07,784][106226] Updated weights for policy 0, policy_version 105275 (0.0005) [2023-12-27 19:59:07,841][106226] Updated weights for policy 0, policy_version 105285 (0.0010) [2023-12-27 19:59:08,273][106225] Updated weights for policy 1, policy_version 105153 (0.0008) [2023-12-27 19:59:08,332][106225] Updated weights for policy 1, policy_version 105163 (0.0008) [2023-12-27 19:59:08,395][106225] Updated weights for policy 1, policy_version 105173 (0.0008) [2023-12-27 19:59:08,458][106225] Updated weights for policy 1, policy_version 105183 (0.0008) [2023-12-27 19:59:08,535][106226] Updated weights for policy 0, policy_version 105295 (0.0011) [2023-12-27 19:59:08,603][106226] Updated weights for policy 0, policy_version 105305 (0.0011) [2023-12-27 19:59:08,668][106226] Updated weights for policy 0, policy_version 105315 (0.0011) [2023-12-27 19:59:09,200][106225] Updated weights for policy 1, policy_version 105193 (0.0008) [2023-12-27 19:59:09,271][106225] Updated weights for policy 1, policy_version 105203 (0.0008) [2023-12-27 19:59:09,334][106225] Updated weights for policy 1, policy_version 105213 (0.0008) [2023-12-27 19:59:09,376][106226] Updated weights for policy 0, policy_version 105325 (0.0010) [2023-12-27 19:59:09,442][106226] Updated weights for policy 0, policy_version 105335 (0.0010) [2023-12-27 19:59:09,497][106226] Updated weights for policy 0, policy_version 105345 (0.0009) [2023-12-27 19:59:10,146][106225] Updated weights for policy 1, policy_version 105223 (0.0009) [2023-12-27 19:59:10,206][106225] Updated weights for policy 1, policy_version 105233 (0.0009) [2023-12-27 19:59:10,212][106226] Updated weights for policy 0, policy_version 105355 (0.0008) [2023-12-27 19:59:10,267][106225] Updated weights for policy 1, policy_version 105243 (0.0007) [2023-12-27 19:59:10,274][106226] Updated weights for policy 0, policy_version 105365 (0.0008) [2023-12-27 19:59:10,331][106226] Updated weights for policy 0, policy_version 105375 (0.0008) [2023-12-27 19:59:10,987][106225] Updated weights for policy 1, policy_version 105253 (0.0010) [2023-12-27 19:59:11,051][106225] Updated weights for policy 1, policy_version 105263 (0.0008) [2023-12-27 19:59:11,091][106226] Updated weights for policy 0, policy_version 105385 (0.0009) [2023-12-27 19:59:11,110][106225] Updated weights for policy 1, policy_version 105273 (0.0009) [2023-12-27 19:59:11,164][106226] Updated weights for policy 0, policy_version 105395 (0.0007) [2023-12-27 19:59:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 53944320. Throughput: 0: 10051.4, 1: 9958.2. Samples: 53915988. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:11,175][105115] Avg episode reward: [(0, '-5.258'), (1, '-6.932')] [2023-12-27 19:59:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000105280_26959872.pth... [2023-12-27 19:59:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000104096_26656768.pth [2023-12-27 19:59:11,228][106226] Updated weights for policy 0, policy_version 105405 (0.0008) [2023-12-27 19:59:11,292][106226] Updated weights for policy 0, policy_version 105415 (0.0008) [2023-12-27 19:59:11,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000105416_26992640.pth... [2023-12-27 19:59:11,302][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000104232_26689536.pth [2023-12-27 19:59:11,923][106225] Updated weights for policy 1, policy_version 105283 (0.0008) [2023-12-27 19:59:11,985][106225] Updated weights for policy 1, policy_version 105293 (0.0008) [2023-12-27 19:59:12,047][106225] Updated weights for policy 1, policy_version 105303 (0.0009) [2023-12-27 19:59:12,093][106226] Updated weights for policy 0, policy_version 105425 (0.0008) [2023-12-27 19:59:12,155][106226] Updated weights for policy 0, policy_version 105435 (0.0008) [2023-12-27 19:59:12,220][106226] Updated weights for policy 0, policy_version 105445 (0.0008) [2023-12-27 19:59:12,799][106225] Updated weights for policy 1, policy_version 105313 (0.0008) [2023-12-27 19:59:12,862][106225] Updated weights for policy 1, policy_version 105323 (0.0008) [2023-12-27 19:59:12,883][106226] Updated weights for policy 0, policy_version 105455 (0.0006) [2023-12-27 19:59:12,922][106225] Updated weights for policy 1, policy_version 105333 (0.0007) [2023-12-27 19:59:12,932][106226] Updated weights for policy 0, policy_version 105465 (0.0009) [2023-12-27 19:59:12,988][106225] Updated weights for policy 1, policy_version 105343 (0.0006) [2023-12-27 19:59:12,989][106226] Updated weights for policy 0, policy_version 105475 (0.0006) [2023-12-27 19:59:13,621][106225] Updated weights for policy 1, policy_version 105353 (0.0008) [2023-12-27 19:59:13,678][106225] Updated weights for policy 1, policy_version 105363 (0.0007) [2023-12-27 19:59:13,733][106225] Updated weights for policy 1, policy_version 105373 (0.0008) [2023-12-27 19:59:13,743][106226] Updated weights for policy 0, policy_version 105485 (0.0006) [2023-12-27 19:59:13,793][106226] Updated weights for policy 0, policy_version 105495 (0.0007) [2023-12-27 19:59:13,852][106226] Updated weights for policy 0, policy_version 105505 (0.0008) [2023-12-27 19:59:14,354][106225] Updated weights for policy 1, policy_version 105383 (0.0006) [2023-12-27 19:59:14,411][106225] Updated weights for policy 1, policy_version 105393 (0.0005) [2023-12-27 19:59:14,460][106225] Updated weights for policy 1, policy_version 105403 (0.0007) [2023-12-27 19:59:14,604][106226] Updated weights for policy 0, policy_version 105515 (0.0007) [2023-12-27 19:59:14,652][106226] Updated weights for policy 0, policy_version 105525 (0.0008) [2023-12-27 19:59:14,705][106226] Updated weights for policy 0, policy_version 105535 (0.0005) [2023-12-27 19:59:15,160][106225] Updated weights for policy 1, policy_version 105413 (0.0008) [2023-12-27 19:59:15,224][106225] Updated weights for policy 1, policy_version 105423 (0.0009) [2023-12-27 19:59:15,282][106225] Updated weights for policy 1, policy_version 105433 (0.0008) [2023-12-27 19:59:15,465][106226] Updated weights for policy 0, policy_version 105545 (0.0008) [2023-12-27 19:59:15,524][106226] Updated weights for policy 0, policy_version 105555 (0.0008) [2023-12-27 19:59:15,578][106226] Updated weights for policy 0, policy_version 105565 (0.0009) [2023-12-27 19:59:15,640][106226] Updated weights for policy 0, policy_version 105575 (0.0009) [2023-12-27 19:59:15,948][106225] Updated weights for policy 1, policy_version 105443 (0.0009) [2023-12-27 19:59:15,996][106225] Updated weights for policy 1, policy_version 105453 (0.0008) [2023-12-27 19:59:16,042][106225] Updated weights for policy 1, policy_version 105463 (0.0008) [2023-12-27 19:59:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 54042624. Throughput: 0: 9905.4, 1: 9833.2. Samples: 54029760. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:16,175][105115] Avg episode reward: [(0, '-5.279'), (1, '-7.159')] [2023-12-27 19:59:16,392][106226] Updated weights for policy 0, policy_version 105585 (0.0009) [2023-12-27 19:59:16,448][106226] Updated weights for policy 0, policy_version 105595 (0.0009) [2023-12-27 19:59:16,501][106226] Updated weights for policy 0, policy_version 105605 (0.0009) [2023-12-27 19:59:16,700][106225] Updated weights for policy 1, policy_version 105473 (0.0008) [2023-12-27 19:59:16,761][106225] Updated weights for policy 1, policy_version 105483 (0.0006) [2023-12-27 19:59:16,817][106225] Updated weights for policy 1, policy_version 105493 (0.0005) [2023-12-27 19:59:16,866][106225] Updated weights for policy 1, policy_version 105503 (0.0006) [2023-12-27 19:59:17,213][106226] Updated weights for policy 0, policy_version 105615 (0.0008) [2023-12-27 19:59:17,261][106226] Updated weights for policy 0, policy_version 105625 (0.0008) [2023-12-27 19:59:17,318][106226] Updated weights for policy 0, policy_version 105635 (0.0009) [2023-12-27 19:59:17,489][106225] Updated weights for policy 1, policy_version 105513 (0.0008) [2023-12-27 19:59:17,554][106225] Updated weights for policy 1, policy_version 105523 (0.0008) [2023-12-27 19:59:17,608][106225] Updated weights for policy 1, policy_version 105533 (0.0007) [2023-12-27 19:59:18,071][106226] Updated weights for policy 0, policy_version 105645 (0.0008) [2023-12-27 19:59:18,147][106226] Updated weights for policy 0, policy_version 105655 (0.0007) [2023-12-27 19:59:18,204][106226] Updated weights for policy 0, policy_version 105665 (0.0008) [2023-12-27 19:59:18,348][106225] Updated weights for policy 1, policy_version 105543 (0.0009) [2023-12-27 19:59:18,409][106225] Updated weights for policy 1, policy_version 105553 (0.0008) [2023-12-27 19:59:18,464][106225] Updated weights for policy 1, policy_version 105563 (0.0008) [2023-12-27 19:59:18,911][106226] Updated weights for policy 0, policy_version 105675 (0.0009) [2023-12-27 19:59:18,963][106226] Updated weights for policy 0, policy_version 105685 (0.0008) [2023-12-27 19:59:19,009][106226] Updated weights for policy 0, policy_version 105695 (0.0008) [2023-12-27 19:59:19,213][106225] Updated weights for policy 1, policy_version 105573 (0.0010) [2023-12-27 19:59:19,286][106225] Updated weights for policy 1, policy_version 105583 (0.0009) [2023-12-27 19:59:19,350][106225] Updated weights for policy 1, policy_version 105593 (0.0009) [2023-12-27 19:59:19,710][106226] Updated weights for policy 0, policy_version 105705 (0.0006) [2023-12-27 19:59:19,776][106226] Updated weights for policy 0, policy_version 105715 (0.0009) [2023-12-27 19:59:19,841][106226] Updated weights for policy 0, policy_version 105725 (0.0009) [2023-12-27 19:59:19,903][106226] Updated weights for policy 0, policy_version 105735 (0.0008) [2023-12-27 19:59:20,079][106225] Updated weights for policy 1, policy_version 105603 (0.0008) [2023-12-27 19:59:20,147][106225] Updated weights for policy 1, policy_version 105613 (0.0007) [2023-12-27 19:59:20,222][106225] Updated weights for policy 1, policy_version 105623 (0.0009) [2023-12-27 19:59:20,540][106226] Updated weights for policy 0, policy_version 105745 (0.0008) [2023-12-27 19:59:20,615][106226] Updated weights for policy 0, policy_version 105755 (0.0008) [2023-12-27 19:59:20,677][106226] Updated weights for policy 0, policy_version 105765 (0.0008) [2023-12-27 19:59:20,915][106225] Updated weights for policy 1, policy_version 105633 (0.0008) [2023-12-27 19:59:20,978][106225] Updated weights for policy 1, policy_version 105643 (0.0008) [2023-12-27 19:59:21,050][106225] Updated weights for policy 1, policy_version 105653 (0.0007) [2023-12-27 19:59:21,114][106225] Updated weights for policy 1, policy_version 105663 (0.0009) [2023-12-27 19:59:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 54140928. Throughput: 0: 9783.3, 1: 9896.8. Samples: 54147092. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:21,175][105115] Avg episode reward: [(0, '-5.317'), (1, '-6.843')] [2023-12-27 19:59:21,467][106226] Updated weights for policy 0, policy_version 105775 (0.0008) [2023-12-27 19:59:21,517][106226] Updated weights for policy 0, policy_version 105785 (0.0009) [2023-12-27 19:59:21,576][106226] Updated weights for policy 0, policy_version 105795 (0.0009) [2023-12-27 19:59:21,894][106225] Updated weights for policy 1, policy_version 105673 (0.0009) [2023-12-27 19:59:21,950][106225] Updated weights for policy 1, policy_version 105683 (0.0008) [2023-12-27 19:59:22,014][106225] Updated weights for policy 1, policy_version 105693 (0.0009) [2023-12-27 19:59:22,363][106226] Updated weights for policy 0, policy_version 105805 (0.0009) [2023-12-27 19:59:22,419][106226] Updated weights for policy 0, policy_version 105815 (0.0009) [2023-12-27 19:59:22,483][106226] Updated weights for policy 0, policy_version 105825 (0.0009) [2023-12-27 19:59:22,759][106225] Updated weights for policy 1, policy_version 105703 (0.0008) [2023-12-27 19:59:22,825][106225] Updated weights for policy 1, policy_version 105713 (0.0008) [2023-12-27 19:59:22,884][106225] Updated weights for policy 1, policy_version 105723 (0.0008) [2023-12-27 19:59:23,231][106226] Updated weights for policy 0, policy_version 105835 (0.0009) [2023-12-27 19:59:23,275][106226] Updated weights for policy 0, policy_version 105845 (0.0007) [2023-12-27 19:59:23,325][106226] Updated weights for policy 0, policy_version 105855 (0.0005) [2023-12-27 19:59:23,595][106225] Updated weights for policy 1, policy_version 105733 (0.0009) [2023-12-27 19:59:23,651][106225] Updated weights for policy 1, policy_version 105743 (0.0009) [2023-12-27 19:59:23,712][106225] Updated weights for policy 1, policy_version 105753 (0.0010) [2023-12-27 19:59:23,990][106226] Updated weights for policy 0, policy_version 105865 (0.0008) [2023-12-27 19:59:24,044][106226] Updated weights for policy 0, policy_version 105875 (0.0009) [2023-12-27 19:59:24,102][106226] Updated weights for policy 0, policy_version 105885 (0.0006) [2023-12-27 19:59:24,151][106226] Updated weights for policy 0, policy_version 105895 (0.0009) [2023-12-27 19:59:24,325][106225] Updated weights for policy 1, policy_version 105763 (0.0010) [2023-12-27 19:59:24,383][106225] Updated weights for policy 1, policy_version 105773 (0.0010) [2023-12-27 19:59:24,435][106225] Updated weights for policy 1, policy_version 105783 (0.0010) [2023-12-27 19:59:24,880][106226] Updated weights for policy 0, policy_version 105905 (0.0008) [2023-12-27 19:59:24,933][106226] Updated weights for policy 0, policy_version 105915 (0.0007) [2023-12-27 19:59:25,000][106226] Updated weights for policy 0, policy_version 105925 (0.0007) [2023-12-27 19:59:25,174][106225] Updated weights for policy 1, policy_version 105793 (0.0010) [2023-12-27 19:59:25,225][106225] Updated weights for policy 1, policy_version 105803 (0.0010) [2023-12-27 19:59:25,271][106225] Updated weights for policy 1, policy_version 105813 (0.0010) [2023-12-27 19:59:25,319][106225] Updated weights for policy 1, policy_version 105823 (0.0010) [2023-12-27 19:59:25,746][106226] Updated weights for policy 0, policy_version 105935 (0.0008) [2023-12-27 19:59:25,805][106226] Updated weights for policy 0, policy_version 105945 (0.0005) [2023-12-27 19:59:25,864][106226] Updated weights for policy 0, policy_version 105955 (0.0005) [2023-12-27 19:59:25,978][106225] Updated weights for policy 1, policy_version 105833 (0.0010) [2023-12-27 19:59:26,036][106225] Updated weights for policy 1, policy_version 105843 (0.0010) [2023-12-27 19:59:26,102][106225] Updated weights for policy 1, policy_version 105853 (0.0007) [2023-12-27 19:59:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 54239232. Throughput: 0: 9745.7, 1: 9824.8. Samples: 54203224. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:26,176][105115] Avg episode reward: [(0, '-5.500'), (1, '-6.987')] [2023-12-27 19:59:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000105856_27107328.pth... [2023-12-27 19:59:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000105960_27131904.pth... [2023-12-27 19:59:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000104704_26812416.pth [2023-12-27 19:59:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000104840_26845184.pth [2023-12-27 19:59:26,420][106226] Updated weights for policy 0, policy_version 105965 (0.0006) [2023-12-27 19:59:26,482][106226] Updated weights for policy 0, policy_version 105975 (0.0005) [2023-12-27 19:59:26,546][106226] Updated weights for policy 0, policy_version 105985 (0.0005) [2023-12-27 19:59:26,793][106225] Updated weights for policy 1, policy_version 105863 (0.0009) [2023-12-27 19:59:26,846][106225] Updated weights for policy 1, policy_version 105873 (0.0010) [2023-12-27 19:59:26,895][106225] Updated weights for policy 1, policy_version 105883 (0.0010) [2023-12-27 19:59:27,153][106226] Updated weights for policy 0, policy_version 105995 (0.0006) [2023-12-27 19:59:27,202][106226] Updated weights for policy 0, policy_version 106005 (0.0009) [2023-12-27 19:59:27,262][106226] Updated weights for policy 0, policy_version 106015 (0.0007) [2023-12-27 19:59:27,493][106225] Updated weights for policy 1, policy_version 105893 (0.0009) [2023-12-27 19:59:27,542][106225] Updated weights for policy 1, policy_version 105903 (0.0010) [2023-12-27 19:59:27,588][106225] Updated weights for policy 1, policy_version 105913 (0.0010) [2023-12-27 19:59:27,806][106226] Updated weights for policy 0, policy_version 106025 (0.0005) [2023-12-27 19:59:27,857][106226] Updated weights for policy 0, policy_version 106035 (0.0010) [2023-12-27 19:59:27,913][106226] Updated weights for policy 0, policy_version 106045 (0.0008) [2023-12-27 19:59:27,964][106226] Updated weights for policy 0, policy_version 106055 (0.0005) [2023-12-27 19:59:28,265][106225] Updated weights for policy 1, policy_version 105923 (0.0009) [2023-12-27 19:59:28,337][106225] Updated weights for policy 1, policy_version 105933 (0.0009) [2023-12-27 19:59:28,397][106225] Updated weights for policy 1, policy_version 105943 (0.0008) [2023-12-27 19:59:28,504][106226] Updated weights for policy 0, policy_version 106065 (0.0005) [2023-12-27 19:59:28,555][106226] Updated weights for policy 0, policy_version 106075 (0.0007) [2023-12-27 19:59:28,603][106226] Updated weights for policy 0, policy_version 106085 (0.0008) [2023-12-27 19:59:29,067][106225] Updated weights for policy 1, policy_version 105953 (0.0008) [2023-12-27 19:59:29,122][106225] Updated weights for policy 1, policy_version 105963 (0.0008) [2023-12-27 19:59:29,181][106225] Updated weights for policy 1, policy_version 105973 (0.0010) [2023-12-27 19:59:29,240][106225] Updated weights for policy 1, policy_version 105983 (0.0010) [2023-12-27 19:59:29,363][106226] Updated weights for policy 0, policy_version 106095 (0.0008) [2023-12-27 19:59:29,427][106226] Updated weights for policy 0, policy_version 106105 (0.0006) [2023-12-27 19:59:29,492][106226] Updated weights for policy 0, policy_version 106115 (0.0007) [2023-12-27 19:59:29,979][106225] Updated weights for policy 1, policy_version 105993 (0.0010) [2023-12-27 19:59:30,044][106225] Updated weights for policy 1, policy_version 106003 (0.0010) [2023-12-27 19:59:30,112][106225] Updated weights for policy 1, policy_version 106013 (0.0010) [2023-12-27 19:59:30,160][106226] Updated weights for policy 0, policy_version 106125 (0.0009) [2023-12-27 19:59:30,223][106226] Updated weights for policy 0, policy_version 106135 (0.0008) [2023-12-27 19:59:30,283][106226] Updated weights for policy 0, policy_version 106145 (0.0006) [2023-12-27 19:59:30,763][106225] Updated weights for policy 1, policy_version 106023 (0.0009) [2023-12-27 19:59:30,818][106225] Updated weights for policy 1, policy_version 106033 (0.0008) [2023-12-27 19:59:30,866][106225] Updated weights for policy 1, policy_version 106043 (0.0008) [2023-12-27 19:59:30,924][106226] Updated weights for policy 0, policy_version 106155 (0.0007) [2023-12-27 19:59:30,984][106226] Updated weights for policy 0, policy_version 106165 (0.0009) [2023-12-27 19:59:31,036][106226] Updated weights for policy 0, policy_version 106175 (0.0008) [2023-12-27 19:59:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 54345728. Throughput: 0: 9853.2, 1: 9968.2. Samples: 54329572. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:31,175][105115] Avg episode reward: [(0, '-5.125'), (1, '-6.676')] [2023-12-27 19:59:31,647][106225] Updated weights for policy 1, policy_version 106053 (0.0008) [2023-12-27 19:59:31,715][106225] Updated weights for policy 1, policy_version 106063 (0.0006) [2023-12-27 19:59:31,780][106225] Updated weights for policy 1, policy_version 106073 (0.0006) [2023-12-27 19:59:31,879][106226] Updated weights for policy 0, policy_version 106185 (0.0009) [2023-12-27 19:59:31,931][106226] Updated weights for policy 0, policy_version 106195 (0.0008) [2023-12-27 19:59:31,984][106226] Updated weights for policy 0, policy_version 106205 (0.0009) [2023-12-27 19:59:32,040][106226] Updated weights for policy 0, policy_version 106215 (0.0009) [2023-12-27 19:59:32,415][106225] Updated weights for policy 1, policy_version 106083 (0.0007) [2023-12-27 19:59:32,481][106225] Updated weights for policy 1, policy_version 106093 (0.0009) [2023-12-27 19:59:32,542][106225] Updated weights for policy 1, policy_version 106103 (0.0009) [2023-12-27 19:59:32,738][106226] Updated weights for policy 0, policy_version 106225 (0.0008) [2023-12-27 19:59:32,804][106226] Updated weights for policy 0, policy_version 106235 (0.0008) [2023-12-27 19:59:32,866][106226] Updated weights for policy 0, policy_version 106245 (0.0007) [2023-12-27 19:59:33,163][106225] Updated weights for policy 1, policy_version 106113 (0.0008) [2023-12-27 19:59:33,208][106225] Updated weights for policy 1, policy_version 106123 (0.0005) [2023-12-27 19:59:33,266][106225] Updated weights for policy 1, policy_version 106133 (0.0005) [2023-12-27 19:59:33,321][106225] Updated weights for policy 1, policy_version 106143 (0.0008) [2023-12-27 19:59:33,412][106226] Updated weights for policy 0, policy_version 106255 (0.0007) [2023-12-27 19:59:33,467][106226] Updated weights for policy 0, policy_version 106265 (0.0005) [2023-12-27 19:59:33,520][106226] Updated weights for policy 0, policy_version 106275 (0.0005) [2023-12-27 19:59:34,042][106226] Updated weights for policy 0, policy_version 106285 (0.0005) [2023-12-27 19:59:34,093][106226] Updated weights for policy 0, policy_version 106295 (0.0005) [2023-12-27 19:59:34,107][106225] Updated weights for policy 1, policy_version 106153 (0.0008) [2023-12-27 19:59:34,155][106226] Updated weights for policy 0, policy_version 106305 (0.0007) [2023-12-27 19:59:34,173][106225] Updated weights for policy 1, policy_version 106163 (0.0007) [2023-12-27 19:59:34,231][106225] Updated weights for policy 1, policy_version 106173 (0.0005) [2023-12-27 19:59:34,856][106226] Updated weights for policy 0, policy_version 106315 (0.0007) [2023-12-27 19:59:34,910][106226] Updated weights for policy 0, policy_version 106325 (0.0005) [2023-12-27 19:59:34,929][106225] Updated weights for policy 1, policy_version 106183 (0.0007) [2023-12-27 19:59:34,959][106226] Updated weights for policy 0, policy_version 106335 (0.0005) [2023-12-27 19:59:34,989][106225] Updated weights for policy 1, policy_version 106193 (0.0008) [2023-12-27 19:59:35,052][106225] Updated weights for policy 1, policy_version 106203 (0.0008) [2023-12-27 19:59:35,575][106226] Updated weights for policy 0, policy_version 106345 (0.0006) [2023-12-27 19:59:35,633][106226] Updated weights for policy 0, policy_version 106355 (0.0008) [2023-12-27 19:59:35,692][106226] Updated weights for policy 0, policy_version 106365 (0.0009) [2023-12-27 19:59:35,738][106225] Updated weights for policy 1, policy_version 106213 (0.0007) [2023-12-27 19:59:35,748][106226] Updated weights for policy 0, policy_version 106375 (0.0007) [2023-12-27 19:59:35,795][106225] Updated weights for policy 1, policy_version 106223 (0.0007) [2023-12-27 19:59:35,851][106225] Updated weights for policy 1, policy_version 106233 (0.0005) [2023-12-27 19:59:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 54444032. Throughput: 0: 9992.6, 1: 9940.1. Samples: 54451884. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:36,176][105115] Avg episode reward: [(0, '-5.320'), (1, '-6.851')] [2023-12-27 19:59:36,534][106225] Updated weights for policy 1, policy_version 106243 (0.0006) [2023-12-27 19:59:36,550][106226] Updated weights for policy 0, policy_version 106385 (0.0008) [2023-12-27 19:59:36,596][106225] Updated weights for policy 1, policy_version 106253 (0.0007) [2023-12-27 19:59:36,615][106226] Updated weights for policy 0, policy_version 106395 (0.0006) [2023-12-27 19:59:36,669][106225] Updated weights for policy 1, policy_version 106263 (0.0007) [2023-12-27 19:59:36,682][106226] Updated weights for policy 0, policy_version 106405 (0.0009) [2023-12-27 19:59:37,318][106225] Updated weights for policy 1, policy_version 106273 (0.0009) [2023-12-27 19:59:37,376][106225] Updated weights for policy 1, policy_version 106283 (0.0009) [2023-12-27 19:59:37,415][106226] Updated weights for policy 0, policy_version 106415 (0.0007) [2023-12-27 19:59:37,427][106225] Updated weights for policy 1, policy_version 106293 (0.0009) [2023-12-27 19:59:37,486][106225] Updated weights for policy 1, policy_version 106303 (0.0006) [2023-12-27 19:59:37,492][106226] Updated weights for policy 0, policy_version 106425 (0.0008) [2023-12-27 19:59:37,556][106226] Updated weights for policy 0, policy_version 106435 (0.0008) [2023-12-27 19:59:38,134][106226] Updated weights for policy 0, policy_version 106445 (0.0007) [2023-12-27 19:59:38,195][106226] Updated weights for policy 0, policy_version 106455 (0.0005) [2023-12-27 19:59:38,243][106225] Updated weights for policy 1, policy_version 106313 (0.0007) [2023-12-27 19:59:38,249][106226] Updated weights for policy 0, policy_version 106465 (0.0005) [2023-12-27 19:59:38,304][106225] Updated weights for policy 1, policy_version 106323 (0.0006) [2023-12-27 19:59:38,371][106225] Updated weights for policy 1, policy_version 106333 (0.0007) [2023-12-27 19:59:38,878][106226] Updated weights for policy 0, policy_version 106475 (0.0006) [2023-12-27 19:59:38,932][106226] Updated weights for policy 0, policy_version 106485 (0.0007) [2023-12-27 19:59:38,969][106225] Updated weights for policy 1, policy_version 106343 (0.0006) [2023-12-27 19:59:38,992][106226] Updated weights for policy 0, policy_version 106495 (0.0008) [2023-12-27 19:59:39,027][106225] Updated weights for policy 1, policy_version 106353 (0.0007) [2023-12-27 19:59:39,084][106225] Updated weights for policy 1, policy_version 106363 (0.0008) [2023-12-27 19:59:39,661][106226] Updated weights for policy 0, policy_version 106505 (0.0006) [2023-12-27 19:59:39,717][106226] Updated weights for policy 0, policy_version 106515 (0.0006) [2023-12-27 19:59:39,776][106226] Updated weights for policy 0, policy_version 106525 (0.0005) [2023-12-27 19:59:39,851][106226] Updated weights for policy 0, policy_version 106535 (0.0007) [2023-12-27 19:59:39,913][106225] Updated weights for policy 1, policy_version 106373 (0.0008) [2023-12-27 19:59:39,984][106225] Updated weights for policy 1, policy_version 106383 (0.0008) [2023-12-27 19:59:40,055][106225] Updated weights for policy 1, policy_version 106393 (0.0009) [2023-12-27 19:59:40,518][106226] Updated weights for policy 0, policy_version 106545 (0.0009) [2023-12-27 19:59:40,576][106226] Updated weights for policy 0, policy_version 106555 (0.0006) [2023-12-27 19:59:40,642][106226] Updated weights for policy 0, policy_version 106565 (0.0005) [2023-12-27 19:59:40,801][106225] Updated weights for policy 1, policy_version 106403 (0.0009) [2023-12-27 19:59:40,858][106225] Updated weights for policy 1, policy_version 106413 (0.0009) [2023-12-27 19:59:40,919][106225] Updated weights for policy 1, policy_version 106423 (0.0008) [2023-12-27 19:59:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 54542336. Throughput: 0: 9999.9, 1: 9952.4. Samples: 54512472. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:41,175][105115] Avg episode reward: [(0, '-5.207'), (1, '-6.457')] [2023-12-27 19:59:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000106432_27254784.pth... [2023-12-27 19:59:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000106568_27287552.pth... [2023-12-27 19:59:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000105280_26959872.pth [2023-12-27 19:59:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000105416_26992640.pth [2023-12-27 19:59:41,316][106226] Updated weights for policy 0, policy_version 106575 (0.0009) [2023-12-27 19:59:41,386][106226] Updated weights for policy 0, policy_version 106585 (0.0009) [2023-12-27 19:59:41,456][106226] Updated weights for policy 0, policy_version 106595 (0.0011) [2023-12-27 19:59:41,706][106225] Updated weights for policy 1, policy_version 106433 (0.0008) [2023-12-27 19:59:41,770][106225] Updated weights for policy 1, policy_version 106443 (0.0009) [2023-12-27 19:59:41,835][106225] Updated weights for policy 1, policy_version 106453 (0.0008) [2023-12-27 19:59:41,907][106225] Updated weights for policy 1, policy_version 106463 (0.0007) [2023-12-27 19:59:42,229][106226] Updated weights for policy 0, policy_version 106605 (0.0011) [2023-12-27 19:59:42,287][106226] Updated weights for policy 0, policy_version 106615 (0.0009) [2023-12-27 19:59:42,361][106226] Updated weights for policy 0, policy_version 106625 (0.0009) [2023-12-27 19:59:42,660][106225] Updated weights for policy 1, policy_version 106473 (0.0006) [2023-12-27 19:59:42,715][106225] Updated weights for policy 1, policy_version 106483 (0.0005) [2023-12-27 19:59:42,764][106225] Updated weights for policy 1, policy_version 106493 (0.0005) [2023-12-27 19:59:43,042][106226] Updated weights for policy 0, policy_version 106635 (0.0006) [2023-12-27 19:59:43,117][106226] Updated weights for policy 0, policy_version 106645 (0.0010) [2023-12-27 19:59:43,179][106226] Updated weights for policy 0, policy_version 106655 (0.0009) [2023-12-27 19:59:43,338][106225] Updated weights for policy 1, policy_version 106503 (0.0006) [2023-12-27 19:59:43,403][106225] Updated weights for policy 1, policy_version 106513 (0.0005) [2023-12-27 19:59:43,459][106225] Updated weights for policy 1, policy_version 106523 (0.0005) [2023-12-27 19:59:43,921][106226] Updated weights for policy 0, policy_version 106665 (0.0009) [2023-12-27 19:59:43,979][106226] Updated weights for policy 0, policy_version 106675 (0.0005) [2023-12-27 19:59:44,030][106226] Updated weights for policy 0, policy_version 106685 (0.0005) [2023-12-27 19:59:44,083][106226] Updated weights for policy 0, policy_version 106695 (0.0006) [2023-12-27 19:59:44,120][106225] Updated weights for policy 1, policy_version 106533 (0.0007) [2023-12-27 19:59:44,182][106225] Updated weights for policy 1, policy_version 106543 (0.0008) [2023-12-27 19:59:44,244][106225] Updated weights for policy 1, policy_version 106553 (0.0008) [2023-12-27 19:59:44,684][106226] Updated weights for policy 0, policy_version 106705 (0.0007) [2023-12-27 19:59:44,746][106226] Updated weights for policy 0, policy_version 106715 (0.0007) [2023-12-27 19:59:44,813][106226] Updated weights for policy 0, policy_version 106725 (0.0008) [2023-12-27 19:59:45,055][106225] Updated weights for policy 1, policy_version 106563 (0.0008) [2023-12-27 19:59:45,120][106225] Updated weights for policy 1, policy_version 106573 (0.0008) [2023-12-27 19:59:45,184][106225] Updated weights for policy 1, policy_version 106583 (0.0008) [2023-12-27 19:59:45,530][106226] Updated weights for policy 0, policy_version 106735 (0.0007) [2023-12-27 19:59:45,592][106226] Updated weights for policy 0, policy_version 106745 (0.0007) [2023-12-27 19:59:45,658][106226] Updated weights for policy 0, policy_version 106755 (0.0008) [2023-12-27 19:59:45,960][106225] Updated weights for policy 1, policy_version 106593 (0.0009) [2023-12-27 19:59:46,016][106225] Updated weights for policy 1, policy_version 106603 (0.0009) [2023-12-27 19:59:46,080][106225] Updated weights for policy 1, policy_version 106613 (0.0008) [2023-12-27 19:59:46,139][106225] Updated weights for policy 1, policy_version 106623 (0.0009) [2023-12-27 19:59:46,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 54640640. Throughput: 0: 9942.0, 1: 9908.4. Samples: 54629072. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:46,175][105115] Avg episode reward: [(0, '-5.324'), (1, '-6.898')] [2023-12-27 19:59:46,345][106226] Updated weights for policy 0, policy_version 106765 (0.0009) [2023-12-27 19:59:46,397][106226] Updated weights for policy 0, policy_version 106775 (0.0008) [2023-12-27 19:59:46,441][106226] Updated weights for policy 0, policy_version 106785 (0.0008) [2023-12-27 19:59:46,830][106225] Updated weights for policy 1, policy_version 106633 (0.0007) [2023-12-27 19:59:46,877][106225] Updated weights for policy 1, policy_version 106643 (0.0005) [2023-12-27 19:59:46,938][106225] Updated weights for policy 1, policy_version 106653 (0.0007) [2023-12-27 19:59:47,222][106226] Updated weights for policy 0, policy_version 106795 (0.0008) [2023-12-27 19:59:47,287][106226] Updated weights for policy 0, policy_version 106805 (0.0005) [2023-12-27 19:59:47,345][106226] Updated weights for policy 0, policy_version 106815 (0.0006) [2023-12-27 19:59:47,586][106225] Updated weights for policy 1, policy_version 106663 (0.0006) [2023-12-27 19:59:47,634][106225] Updated weights for policy 1, policy_version 106673 (0.0005) [2023-12-27 19:59:47,687][106225] Updated weights for policy 1, policy_version 106683 (0.0006) [2023-12-27 19:59:47,990][106226] Updated weights for policy 0, policy_version 106825 (0.0006) [2023-12-27 19:59:48,035][106226] Updated weights for policy 0, policy_version 106835 (0.0008) [2023-12-27 19:59:48,084][106226] Updated weights for policy 0, policy_version 106845 (0.0008) [2023-12-27 19:59:48,140][106226] Updated weights for policy 0, policy_version 106855 (0.0008) [2023-12-27 19:59:48,414][106225] Updated weights for policy 1, policy_version 106693 (0.0008) [2023-12-27 19:59:48,470][106225] Updated weights for policy 1, policy_version 106703 (0.0009) [2023-12-27 19:59:48,524][106225] Updated weights for policy 1, policy_version 106713 (0.0008) [2023-12-27 19:59:48,862][106226] Updated weights for policy 0, policy_version 106865 (0.0009) [2023-12-27 19:59:48,907][106226] Updated weights for policy 0, policy_version 106875 (0.0008) [2023-12-27 19:59:48,956][106226] Updated weights for policy 0, policy_version 106885 (0.0008) [2023-12-27 19:59:49,260][106225] Updated weights for policy 1, policy_version 106723 (0.0009) [2023-12-27 19:59:49,323][106225] Updated weights for policy 1, policy_version 106733 (0.0008) [2023-12-27 19:59:49,382][106225] Updated weights for policy 1, policy_version 106743 (0.0009) [2023-12-27 19:59:49,770][106226] Updated weights for policy 0, policy_version 106895 (0.0009) [2023-12-27 19:59:49,823][106226] Updated weights for policy 0, policy_version 106905 (0.0008) [2023-12-27 19:59:49,893][106226] Updated weights for policy 0, policy_version 106915 (0.0008) [2023-12-27 19:59:50,167][106225] Updated weights for policy 1, policy_version 106753 (0.0008) [2023-12-27 19:59:50,232][106225] Updated weights for policy 1, policy_version 106763 (0.0009) [2023-12-27 19:59:50,300][106225] Updated weights for policy 1, policy_version 106773 (0.0008) [2023-12-27 19:59:50,362][106225] Updated weights for policy 1, policy_version 106783 (0.0009) [2023-12-27 19:59:50,600][106226] Updated weights for policy 0, policy_version 106925 (0.0008) [2023-12-27 19:59:50,665][106226] Updated weights for policy 0, policy_version 106935 (0.0010) [2023-12-27 19:59:50,730][106226] Updated weights for policy 0, policy_version 106945 (0.0010) [2023-12-27 19:59:51,059][106225] Updated weights for policy 1, policy_version 106793 (0.0008) [2023-12-27 19:59:51,128][106225] Updated weights for policy 1, policy_version 106803 (0.0010) [2023-12-27 19:59:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 54730752. Throughput: 0: 9977.4, 1: 9831.1. Samples: 54745300. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:51,175][105115] Avg episode reward: [(0, '-5.653'), (1, '-7.295')] [2023-12-27 19:59:51,187][106225] Updated weights for policy 1, policy_version 106813 (0.0010) [2023-12-27 19:59:51,396][106226] Updated weights for policy 0, policy_version 106955 (0.0010) [2023-12-27 19:59:51,464][106226] Updated weights for policy 0, policy_version 106965 (0.0008) [2023-12-27 19:59:51,527][106226] Updated weights for policy 0, policy_version 106975 (0.0007) [2023-12-27 19:59:51,934][106225] Updated weights for policy 1, policy_version 106823 (0.0011) [2023-12-27 19:59:51,990][106225] Updated weights for policy 1, policy_version 106833 (0.0010) [2023-12-27 19:59:52,058][106225] Updated weights for policy 1, policy_version 106843 (0.0009) [2023-12-27 19:59:52,185][106226] Updated weights for policy 0, policy_version 106985 (0.0008) [2023-12-27 19:59:52,251][106226] Updated weights for policy 0, policy_version 106995 (0.0006) [2023-12-27 19:59:52,314][106226] Updated weights for policy 0, policy_version 107005 (0.0007) [2023-12-27 19:59:52,409][106226] Updated weights for policy 0, policy_version 107015 (0.0008) [2023-12-27 19:59:52,793][106225] Updated weights for policy 1, policy_version 106853 (0.0010) [2023-12-27 19:59:52,841][106225] Updated weights for policy 1, policy_version 106863 (0.0010) [2023-12-27 19:59:52,900][106225] Updated weights for policy 1, policy_version 106873 (0.0005) [2023-12-27 19:59:53,127][106226] Updated weights for policy 0, policy_version 107025 (0.0007) [2023-12-27 19:59:53,185][106226] Updated weights for policy 0, policy_version 107035 (0.0006) [2023-12-27 19:59:53,245][106226] Updated weights for policy 0, policy_version 107045 (0.0008) [2023-12-27 19:59:53,508][106225] Updated weights for policy 1, policy_version 106883 (0.0005) [2023-12-27 19:59:53,559][106225] Updated weights for policy 1, policy_version 106893 (0.0005) [2023-12-27 19:59:53,609][106225] Updated weights for policy 1, policy_version 106903 (0.0005) [2023-12-27 19:59:53,872][106226] Updated weights for policy 0, policy_version 107055 (0.0009) [2023-12-27 19:59:53,918][106226] Updated weights for policy 0, policy_version 107065 (0.0007) [2023-12-27 19:59:53,966][106226] Updated weights for policy 0, policy_version 107075 (0.0005) [2023-12-27 19:59:54,132][106225] Updated weights for policy 1, policy_version 106913 (0.0006) [2023-12-27 19:59:54,201][106225] Updated weights for policy 1, policy_version 106923 (0.0007) [2023-12-27 19:59:54,249][106225] Updated weights for policy 1, policy_version 106933 (0.0007) [2023-12-27 19:59:54,299][106225] Updated weights for policy 1, policy_version 106943 (0.0008) [2023-12-27 19:59:54,731][106226] Updated weights for policy 0, policy_version 107085 (0.0007) [2023-12-27 19:59:54,789][106226] Updated weights for policy 0, policy_version 107095 (0.0009) [2023-12-27 19:59:54,858][106226] Updated weights for policy 0, policy_version 107105 (0.0007) [2023-12-27 19:59:54,891][106225] Updated weights for policy 1, policy_version 106953 (0.0007) [2023-12-27 19:59:54,937][106225] Updated weights for policy 1, policy_version 106963 (0.0005) [2023-12-27 19:59:54,989][106225] Updated weights for policy 1, policy_version 106973 (0.0005) [2023-12-27 19:59:55,525][106226] Updated weights for policy 0, policy_version 107115 (0.0009) [2023-12-27 19:59:55,581][106226] Updated weights for policy 0, policy_version 107125 (0.0007) [2023-12-27 19:59:55,602][106225] Updated weights for policy 1, policy_version 106983 (0.0009) [2023-12-27 19:59:55,641][106226] Updated weights for policy 0, policy_version 107135 (0.0005) [2023-12-27 19:59:55,658][106225] Updated weights for policy 1, policy_version 106993 (0.0010) [2023-12-27 19:59:55,711][106225] Updated weights for policy 1, policy_version 107003 (0.0010) [2023-12-27 19:59:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 54837248. Throughput: 0: 9948.4, 1: 9825.0. Samples: 54805788. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 19:59:56,175][105115] Avg episode reward: [(0, '-5.427'), (1, '-7.004')] [2023-12-27 19:59:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000107008_27402240.pth... [2023-12-27 19:59:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000107144_27435008.pth... [2023-12-27 19:59:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000105856_27107328.pth [2023-12-27 19:59:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000105960_27131904.pth [2023-12-27 19:59:56,365][106226] Updated weights for policy 0, policy_version 107145 (0.0005) [2023-12-27 19:59:56,377][106225] Updated weights for policy 1, policy_version 107013 (0.0010) [2023-12-27 19:59:56,422][106226] Updated weights for policy 0, policy_version 107155 (0.0005) [2023-12-27 19:59:56,434][106225] Updated weights for policy 1, policy_version 107023 (0.0010) [2023-12-27 19:59:56,482][106226] Updated weights for policy 0, policy_version 107165 (0.0006) [2023-12-27 19:59:56,494][106225] Updated weights for policy 1, policy_version 107033 (0.0010) [2023-12-27 19:59:56,539][106226] Updated weights for policy 0, policy_version 107175 (0.0007) [2023-12-27 19:59:57,131][106225] Updated weights for policy 1, policy_version 107043 (0.0009) [2023-12-27 19:59:57,159][106226] Updated weights for policy 0, policy_version 107185 (0.0008) [2023-12-27 19:59:57,179][106225] Updated weights for policy 1, policy_version 107053 (0.0008) [2023-12-27 19:59:57,220][106226] Updated weights for policy 0, policy_version 107195 (0.0005) [2023-12-27 19:59:57,229][106225] Updated weights for policy 1, policy_version 107063 (0.0010) [2023-12-27 19:59:57,275][106226] Updated weights for policy 0, policy_version 107205 (0.0005) [2023-12-27 19:59:57,824][106225] Updated weights for policy 1, policy_version 107073 (0.0010) [2023-12-27 19:59:57,872][106225] Updated weights for policy 1, policy_version 107083 (0.0005) [2023-12-27 19:59:57,923][106225] Updated weights for policy 1, policy_version 107093 (0.0005) [2023-12-27 19:59:57,976][106225] Updated weights for policy 1, policy_version 107103 (0.0009) [2023-12-27 19:59:57,983][106226] Updated weights for policy 0, policy_version 107215 (0.0007) [2023-12-27 19:59:58,029][106226] Updated weights for policy 0, policy_version 107225 (0.0008) [2023-12-27 19:59:58,074][106226] Updated weights for policy 0, policy_version 107235 (0.0008) [2023-12-27 19:59:58,638][106225] Updated weights for policy 1, policy_version 107113 (0.0010) [2023-12-27 19:59:58,709][106225] Updated weights for policy 1, policy_version 107123 (0.0009) [2023-12-27 19:59:58,773][106225] Updated weights for policy 1, policy_version 107133 (0.0011) [2023-12-27 19:59:58,938][106226] Updated weights for policy 0, policy_version 107245 (0.0009) [2023-12-27 19:59:58,996][106226] Updated weights for policy 0, policy_version 107255 (0.0008) [2023-12-27 19:59:59,048][106226] Updated weights for policy 0, policy_version 107265 (0.0008) [2023-12-27 19:59:59,574][106225] Updated weights for policy 1, policy_version 107143 (0.0009) [2023-12-27 19:59:59,626][106225] Updated weights for policy 1, policy_version 107153 (0.0008) [2023-12-27 19:59:59,672][106225] Updated weights for policy 1, policy_version 107163 (0.0005) [2023-12-27 19:59:59,804][106226] Updated weights for policy 0, policy_version 107275 (0.0009) [2023-12-27 19:59:59,874][106226] Updated weights for policy 0, policy_version 107285 (0.0008) [2023-12-27 19:59:59,944][106226] Updated weights for policy 0, policy_version 107295 (0.0007) [2023-12-27 20:00:00,329][106225] Updated weights for policy 1, policy_version 107173 (0.0006) [2023-12-27 20:00:00,390][106225] Updated weights for policy 1, policy_version 107183 (0.0007) [2023-12-27 20:00:00,449][106225] Updated weights for policy 1, policy_version 107193 (0.0005) [2023-12-27 20:00:00,565][106226] Updated weights for policy 0, policy_version 107305 (0.0008) [2023-12-27 20:00:00,619][106226] Updated weights for policy 0, policy_version 107315 (0.0007) [2023-12-27 20:00:00,666][106226] Updated weights for policy 0, policy_version 107325 (0.0005) [2023-12-27 20:00:00,729][106226] Updated weights for policy 0, policy_version 107335 (0.0010) [2023-12-27 20:00:01,125][106225] Updated weights for policy 1, policy_version 107203 (0.0007) [2023-12-27 20:00:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 54935552. Throughput: 0: 9974.8, 1: 9971.6. Samples: 54927348. Policy #0 lag: (min: 2.0, avg: 15.1, max: 34.0) [2023-12-27 20:00:01,175][105115] Avg episode reward: [(0, '-5.160'), (1, '-6.873')] [2023-12-27 20:00:01,189][106225] Updated weights for policy 1, policy_version 107213 (0.0008) [2023-12-27 20:00:01,247][106225] Updated weights for policy 1, policy_version 107223 (0.0009) [2023-12-27 20:00:01,413][106226] Updated weights for policy 0, policy_version 107345 (0.0009) [2023-12-27 20:00:01,475][106226] Updated weights for policy 0, policy_version 107355 (0.0008) [2023-12-27 20:00:01,538][106226] Updated weights for policy 0, policy_version 107365 (0.0008) [2023-12-27 20:00:02,014][106225] Updated weights for policy 1, policy_version 107233 (0.0007) [2023-12-27 20:00:02,069][106225] Updated weights for policy 1, policy_version 107243 (0.0006) [2023-12-27 20:00:02,134][106225] Updated weights for policy 1, policy_version 107253 (0.0005) [2023-12-27 20:00:02,193][106225] Updated weights for policy 1, policy_version 107263 (0.0007) [2023-12-27 20:00:02,297][106226] Updated weights for policy 0, policy_version 107375 (0.0010) [2023-12-27 20:00:02,361][106226] Updated weights for policy 0, policy_version 107385 (0.0011) [2023-12-27 20:00:02,426][106226] Updated weights for policy 0, policy_version 107395 (0.0010) [2023-12-27 20:00:02,791][106225] Updated weights for policy 1, policy_version 107273 (0.0006) [2023-12-27 20:00:02,842][106225] Updated weights for policy 1, policy_version 107283 (0.0005) [2023-12-27 20:00:02,899][106225] Updated weights for policy 1, policy_version 107293 (0.0007) [2023-12-27 20:00:03,075][106226] Updated weights for policy 0, policy_version 107405 (0.0007) [2023-12-27 20:00:03,124][106226] Updated weights for policy 0, policy_version 107415 (0.0005) [2023-12-27 20:00:03,184][106226] Updated weights for policy 0, policy_version 107425 (0.0008) [2023-12-27 20:00:03,516][106225] Updated weights for policy 1, policy_version 107303 (0.0005) [2023-12-27 20:00:03,576][106225] Updated weights for policy 1, policy_version 107313 (0.0005) [2023-12-27 20:00:03,627][106225] Updated weights for policy 1, policy_version 107323 (0.0006) [2023-12-27 20:00:03,903][106226] Updated weights for policy 0, policy_version 107435 (0.0009) [2023-12-27 20:00:03,968][106226] Updated weights for policy 0, policy_version 107445 (0.0005) [2023-12-27 20:00:04,039][106226] Updated weights for policy 0, policy_version 107455 (0.0006) [2023-12-27 20:00:04,243][106225] Updated weights for policy 1, policy_version 107333 (0.0007) [2023-12-27 20:00:04,288][106225] Updated weights for policy 1, policy_version 107343 (0.0006) [2023-12-27 20:00:04,339][106225] Updated weights for policy 1, policy_version 107353 (0.0007) [2023-12-27 20:00:04,645][106226] Updated weights for policy 0, policy_version 107465 (0.0006) [2023-12-27 20:00:04,701][106226] Updated weights for policy 0, policy_version 107475 (0.0008) [2023-12-27 20:00:04,762][106226] Updated weights for policy 0, policy_version 107485 (0.0008) [2023-12-27 20:00:04,824][106226] Updated weights for policy 0, policy_version 107495 (0.0008) [2023-12-27 20:00:05,074][106225] Updated weights for policy 1, policy_version 107363 (0.0008) [2023-12-27 20:00:05,132][106225] Updated weights for policy 1, policy_version 107373 (0.0008) [2023-12-27 20:00:05,181][106225] Updated weights for policy 1, policy_version 107383 (0.0008) [2023-12-27 20:00:05,556][106226] Updated weights for policy 0, policy_version 107505 (0.0009) [2023-12-27 20:00:05,603][106226] Updated weights for policy 0, policy_version 107515 (0.0006) [2023-12-27 20:00:05,657][106226] Updated weights for policy 0, policy_version 107525 (0.0005) [2023-12-27 20:00:05,890][106225] Updated weights for policy 1, policy_version 107393 (0.0009) [2023-12-27 20:00:05,946][106225] Updated weights for policy 1, policy_version 107403 (0.0009) [2023-12-27 20:00:06,007][106225] Updated weights for policy 1, policy_version 107413 (0.0008) [2023-12-27 20:00:06,065][106225] Updated weights for policy 1, policy_version 107423 (0.0008) [2023-12-27 20:00:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 55042048. Throughput: 0: 10023.6, 1: 10032.1. Samples: 55049600. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:06,175][105115] Avg episode reward: [(0, '-4.992'), (1, '-6.673')] [2023-12-27 20:00:06,360][106226] Updated weights for policy 0, policy_version 107535 (0.0008) [2023-12-27 20:00:06,414][106226] Updated weights for policy 0, policy_version 107545 (0.0008) [2023-12-27 20:00:06,477][106226] Updated weights for policy 0, policy_version 107555 (0.0008) [2023-12-27 20:00:06,736][106225] Updated weights for policy 1, policy_version 107433 (0.0005) [2023-12-27 20:00:06,793][106225] Updated weights for policy 1, policy_version 107443 (0.0010) [2023-12-27 20:00:06,849][106225] Updated weights for policy 1, policy_version 107453 (0.0010) [2023-12-27 20:00:07,276][106226] Updated weights for policy 0, policy_version 107565 (0.0009) [2023-12-27 20:00:07,338][106226] Updated weights for policy 0, policy_version 107575 (0.0008) [2023-12-27 20:00:07,400][106226] Updated weights for policy 0, policy_version 107585 (0.0008) [2023-12-27 20:00:07,426][106225] Updated weights for policy 1, policy_version 107463 (0.0007) [2023-12-27 20:00:07,481][106225] Updated weights for policy 1, policy_version 107473 (0.0008) [2023-12-27 20:00:07,537][106225] Updated weights for policy 1, policy_version 107483 (0.0009) [2023-12-27 20:00:08,133][106226] Updated weights for policy 0, policy_version 107595 (0.0007) [2023-12-27 20:00:08,190][106226] Updated weights for policy 0, policy_version 107605 (0.0009) [2023-12-27 20:00:08,252][106226] Updated weights for policy 0, policy_version 107615 (0.0009) [2023-12-27 20:00:08,285][106225] Updated weights for policy 1, policy_version 107493 (0.0007) [2023-12-27 20:00:08,344][106225] Updated weights for policy 1, policy_version 107503 (0.0007) [2023-12-27 20:00:08,406][106225] Updated weights for policy 1, policy_version 107513 (0.0007) [2023-12-27 20:00:09,005][106226] Updated weights for policy 0, policy_version 107625 (0.0009) [2023-12-27 20:00:09,047][106225] Updated weights for policy 1, policy_version 107523 (0.0007) [2023-12-27 20:00:09,062][106226] Updated weights for policy 0, policy_version 107635 (0.0010) [2023-12-27 20:00:09,097][106225] Updated weights for policy 1, policy_version 107533 (0.0008) [2023-12-27 20:00:09,126][106226] Updated weights for policy 0, policy_version 107645 (0.0011) [2023-12-27 20:00:09,154][106225] Updated weights for policy 1, policy_version 107543 (0.0006) [2023-12-27 20:00:09,185][106226] Updated weights for policy 0, policy_version 107655 (0.0010) [2023-12-27 20:00:09,953][106225] Updated weights for policy 1, policy_version 107553 (0.0008) [2023-12-27 20:00:09,987][106226] Updated weights for policy 0, policy_version 107665 (0.0010) [2023-12-27 20:00:10,012][106225] Updated weights for policy 1, policy_version 107563 (0.0006) [2023-12-27 20:00:10,049][106226] Updated weights for policy 0, policy_version 107675 (0.0011) [2023-12-27 20:00:10,069][106225] Updated weights for policy 1, policy_version 107573 (0.0006) [2023-12-27 20:00:10,113][106226] Updated weights for policy 0, policy_version 107685 (0.0009) [2023-12-27 20:00:10,137][106225] Updated weights for policy 1, policy_version 107583 (0.0007) [2023-12-27 20:00:10,765][106225] Updated weights for policy 1, policy_version 107593 (0.0007) [2023-12-27 20:00:10,828][106225] Updated weights for policy 1, policy_version 107603 (0.0009) [2023-12-27 20:00:10,838][106226] Updated weights for policy 0, policy_version 107695 (0.0007) [2023-12-27 20:00:10,893][106225] Updated weights for policy 1, policy_version 107613 (0.0008) [2023-12-27 20:00:10,900][106226] Updated weights for policy 0, policy_version 107705 (0.0006) [2023-12-27 20:00:10,951][106226] Updated weights for policy 0, policy_version 107715 (0.0008) [2023-12-27 20:00:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 55140352. Throughput: 0: 10014.4, 1: 10101.8. Samples: 55108452. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:11,175][105115] Avg episode reward: [(0, '-5.195'), (1, '-7.099')] [2023-12-27 20:00:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000107616_27557888.pth... [2023-12-27 20:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000107720_27582464.pth... [2023-12-27 20:00:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000106432_27254784.pth [2023-12-27 20:00:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000106568_27287552.pth [2023-12-27 20:00:11,633][106225] Updated weights for policy 1, policy_version 107623 (0.0007) [2023-12-27 20:00:11,696][106225] Updated weights for policy 1, policy_version 107633 (0.0008) [2023-12-27 20:00:11,704][106226] Updated weights for policy 0, policy_version 107725 (0.0010) [2023-12-27 20:00:11,759][106225] Updated weights for policy 1, policy_version 107643 (0.0008) [2023-12-27 20:00:11,774][106226] Updated weights for policy 0, policy_version 107735 (0.0009) [2023-12-27 20:00:11,840][106226] Updated weights for policy 0, policy_version 107745 (0.0010) [2023-12-27 20:00:12,483][106225] Updated weights for policy 1, policy_version 107653 (0.0010) [2023-12-27 20:00:12,542][106225] Updated weights for policy 1, policy_version 107663 (0.0010) [2023-12-27 20:00:12,547][106226] Updated weights for policy 0, policy_version 107755 (0.0010) [2023-12-27 20:00:12,605][106225] Updated weights for policy 1, policy_version 107673 (0.0009) [2023-12-27 20:00:12,612][106226] Updated weights for policy 0, policy_version 107765 (0.0011) [2023-12-27 20:00:12,676][106226] Updated weights for policy 0, policy_version 107775 (0.0011) [2023-12-27 20:00:13,226][106225] Updated weights for policy 1, policy_version 107683 (0.0009) [2023-12-27 20:00:13,279][106225] Updated weights for policy 1, policy_version 107693 (0.0005) [2023-12-27 20:00:13,344][106225] Updated weights for policy 1, policy_version 107703 (0.0005) [2023-12-27 20:00:13,375][106226] Updated weights for policy 0, policy_version 107785 (0.0011) [2023-12-27 20:00:13,445][106226] Updated weights for policy 0, policy_version 107795 (0.0011) [2023-12-27 20:00:13,512][106226] Updated weights for policy 0, policy_version 107805 (0.0010) [2023-12-27 20:00:13,573][106226] Updated weights for policy 0, policy_version 107815 (0.0011) [2023-12-27 20:00:13,930][106225] Updated weights for policy 1, policy_version 107713 (0.0006) [2023-12-27 20:00:13,979][106225] Updated weights for policy 1, policy_version 107723 (0.0010) [2023-12-27 20:00:14,026][106225] Updated weights for policy 1, policy_version 107733 (0.0010) [2023-12-27 20:00:14,082][106225] Updated weights for policy 1, policy_version 107743 (0.0010) [2023-12-27 20:00:14,235][106226] Updated weights for policy 0, policy_version 107825 (0.0011) [2023-12-27 20:00:14,298][106226] Updated weights for policy 0, policy_version 107835 (0.0010) [2023-12-27 20:00:14,363][106226] Updated weights for policy 0, policy_version 107845 (0.0010) [2023-12-27 20:00:14,758][106225] Updated weights for policy 1, policy_version 107753 (0.0008) [2023-12-27 20:00:14,822][106225] Updated weights for policy 1, policy_version 107763 (0.0008) [2023-12-27 20:00:14,884][106225] Updated weights for policy 1, policy_version 107773 (0.0008) [2023-12-27 20:00:15,070][106226] Updated weights for policy 0, policy_version 107855 (0.0010) [2023-12-27 20:00:15,135][106226] Updated weights for policy 0, policy_version 107865 (0.0009) [2023-12-27 20:00:15,204][106226] Updated weights for policy 0, policy_version 107875 (0.0009) [2023-12-27 20:00:15,562][106225] Updated weights for policy 1, policy_version 107783 (0.0006) [2023-12-27 20:00:15,612][106225] Updated weights for policy 1, policy_version 107793 (0.0005) [2023-12-27 20:00:15,671][106225] Updated weights for policy 1, policy_version 107803 (0.0007) [2023-12-27 20:00:15,867][106226] Updated weights for policy 0, policy_version 107885 (0.0009) [2023-12-27 20:00:15,937][106226] Updated weights for policy 0, policy_version 107895 (0.0009) [2023-12-27 20:00:16,004][106226] Updated weights for policy 0, policy_version 107905 (0.0011) [2023-12-27 20:00:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 55238656. Throughput: 0: 9855.9, 1: 10071.3. Samples: 55226300. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:16,176][105115] Avg episode reward: [(0, '-5.455'), (1, '-7.034')] [2023-12-27 20:00:16,395][106225] Updated weights for policy 1, policy_version 107813 (0.0008) [2023-12-27 20:00:16,447][106225] Updated weights for policy 1, policy_version 107823 (0.0008) [2023-12-27 20:00:16,499][106225] Updated weights for policy 1, policy_version 107833 (0.0008) [2023-12-27 20:00:16,711][106226] Updated weights for policy 0, policy_version 107915 (0.0010) [2023-12-27 20:00:16,772][106226] Updated weights for policy 0, policy_version 107925 (0.0009) [2023-12-27 20:00:16,828][106226] Updated weights for policy 0, policy_version 107935 (0.0008) [2023-12-27 20:00:17,253][106225] Updated weights for policy 1, policy_version 107843 (0.0008) [2023-12-27 20:00:17,314][106225] Updated weights for policy 1, policy_version 107853 (0.0009) [2023-12-27 20:00:17,374][106225] Updated weights for policy 1, policy_version 107863 (0.0008) [2023-12-27 20:00:17,542][106226] Updated weights for policy 0, policy_version 107945 (0.0009) [2023-12-27 20:00:17,606][106226] Updated weights for policy 0, policy_version 107955 (0.0006) [2023-12-27 20:00:17,670][106226] Updated weights for policy 0, policy_version 107965 (0.0008) [2023-12-27 20:00:17,732][106226] Updated weights for policy 0, policy_version 107975 (0.0009) [2023-12-27 20:00:18,077][106225] Updated weights for policy 1, policy_version 107873 (0.0008) [2023-12-27 20:00:18,135][106225] Updated weights for policy 1, policy_version 107883 (0.0008) [2023-12-27 20:00:18,196][106225] Updated weights for policy 1, policy_version 107893 (0.0008) [2023-12-27 20:00:18,254][106225] Updated weights for policy 1, policy_version 107903 (0.0008) [2023-12-27 20:00:18,433][106226] Updated weights for policy 0, policy_version 107985 (0.0010) [2023-12-27 20:00:18,497][106226] Updated weights for policy 0, policy_version 107995 (0.0011) [2023-12-27 20:00:18,555][106226] Updated weights for policy 0, policy_version 108005 (0.0011) [2023-12-27 20:00:19,012][106225] Updated weights for policy 1, policy_version 107913 (0.0006) [2023-12-27 20:00:19,059][106225] Updated weights for policy 1, policy_version 107923 (0.0005) [2023-12-27 20:00:19,112][106225] Updated weights for policy 1, policy_version 107933 (0.0005) [2023-12-27 20:00:19,255][106226] Updated weights for policy 0, policy_version 108015 (0.0010) [2023-12-27 20:00:19,309][106226] Updated weights for policy 0, policy_version 108025 (0.0010) [2023-12-27 20:00:19,366][106226] Updated weights for policy 0, policy_version 108035 (0.0010) [2023-12-27 20:00:19,868][106225] Updated weights for policy 1, policy_version 107943 (0.0007) [2023-12-27 20:00:19,936][106225] Updated weights for policy 1, policy_version 107953 (0.0007) [2023-12-27 20:00:19,997][106225] Updated weights for policy 1, policy_version 107963 (0.0007) [2023-12-27 20:00:20,192][106226] Updated weights for policy 0, policy_version 108045 (0.0008) [2023-12-27 20:00:20,251][106226] Updated weights for policy 0, policy_version 108055 (0.0008) [2023-12-27 20:00:20,316][106226] Updated weights for policy 0, policy_version 108065 (0.0008) [2023-12-27 20:00:20,667][106225] Updated weights for policy 1, policy_version 107973 (0.0008) [2023-12-27 20:00:20,731][106225] Updated weights for policy 1, policy_version 107983 (0.0008) [2023-12-27 20:00:20,790][106225] Updated weights for policy 1, policy_version 107993 (0.0008) [2023-12-27 20:00:21,083][106226] Updated weights for policy 0, policy_version 108075 (0.0008) [2023-12-27 20:00:21,154][106226] Updated weights for policy 0, policy_version 108085 (0.0009) [2023-12-27 20:00:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 55328768. Throughput: 0: 9743.3, 1: 10031.1. Samples: 55341732. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:21,175][105115] Avg episode reward: [(0, '-5.530'), (1, '-6.588')] [2023-12-27 20:00:21,219][106226] Updated weights for policy 0, policy_version 108095 (0.0008) [2023-12-27 20:00:21,560][106225] Updated weights for policy 1, policy_version 108003 (0.0008) [2023-12-27 20:00:21,627][106225] Updated weights for policy 1, policy_version 108013 (0.0009) [2023-12-27 20:00:21,695][106225] Updated weights for policy 1, policy_version 108023 (0.0008) [2023-12-27 20:00:22,002][106226] Updated weights for policy 0, policy_version 108105 (0.0008) [2023-12-27 20:00:22,064][106226] Updated weights for policy 0, policy_version 108115 (0.0011) [2023-12-27 20:00:22,116][106226] Updated weights for policy 0, policy_version 108125 (0.0010) [2023-12-27 20:00:22,178][106226] Updated weights for policy 0, policy_version 108135 (0.0011) [2023-12-27 20:00:22,374][106225] Updated weights for policy 1, policy_version 108033 (0.0008) [2023-12-27 20:00:22,440][106225] Updated weights for policy 1, policy_version 108043 (0.0008) [2023-12-27 20:00:22,505][106225] Updated weights for policy 1, policy_version 108053 (0.0006) [2023-12-27 20:00:22,573][106225] Updated weights for policy 1, policy_version 108063 (0.0008) [2023-12-27 20:00:22,879][106226] Updated weights for policy 0, policy_version 108145 (0.0011) [2023-12-27 20:00:22,945][106226] Updated weights for policy 0, policy_version 108155 (0.0011) [2023-12-27 20:00:23,007][106226] Updated weights for policy 0, policy_version 108165 (0.0009) [2023-12-27 20:00:23,322][106225] Updated weights for policy 1, policy_version 108073 (0.0009) [2023-12-27 20:00:23,387][106225] Updated weights for policy 1, policy_version 108083 (0.0009) [2023-12-27 20:00:23,441][106225] Updated weights for policy 1, policy_version 108093 (0.0009) [2023-12-27 20:00:23,657][106226] Updated weights for policy 0, policy_version 108175 (0.0007) [2023-12-27 20:00:23,719][106226] Updated weights for policy 0, policy_version 108185 (0.0008) [2023-12-27 20:00:23,780][106226] Updated weights for policy 0, policy_version 108195 (0.0007) [2023-12-27 20:00:24,162][106225] Updated weights for policy 1, policy_version 108103 (0.0008) [2023-12-27 20:00:24,213][106225] Updated weights for policy 1, policy_version 108113 (0.0008) [2023-12-27 20:00:24,266][106225] Updated weights for policy 1, policy_version 108123 (0.0007) [2023-12-27 20:00:24,468][106226] Updated weights for policy 0, policy_version 108205 (0.0008) [2023-12-27 20:00:24,519][106226] Updated weights for policy 0, policy_version 108215 (0.0008) [2023-12-27 20:00:24,574][106226] Updated weights for policy 0, policy_version 108225 (0.0008) [2023-12-27 20:00:25,034][106225] Updated weights for policy 1, policy_version 108133 (0.0008) [2023-12-27 20:00:25,084][106225] Updated weights for policy 1, policy_version 108143 (0.0008) [2023-12-27 20:00:25,140][106225] Updated weights for policy 1, policy_version 108153 (0.0008) [2023-12-27 20:00:25,162][106226] Updated weights for policy 0, policy_version 108235 (0.0009) [2023-12-27 20:00:25,220][106226] Updated weights for policy 0, policy_version 108245 (0.0009) [2023-12-27 20:00:25,273][106226] Updated weights for policy 0, policy_version 108255 (0.0008) [2023-12-27 20:00:25,852][106226] Updated weights for policy 0, policy_version 108265 (0.0008) [2023-12-27 20:00:25,903][106226] Updated weights for policy 0, policy_version 108275 (0.0007) [2023-12-27 20:00:25,906][106225] Updated weights for policy 1, policy_version 108163 (0.0009) [2023-12-27 20:00:25,951][106225] Updated weights for policy 1, policy_version 108173 (0.0007) [2023-12-27 20:00:25,961][106226] Updated weights for policy 0, policy_version 108285 (0.0005) [2023-12-27 20:00:26,003][106225] Updated weights for policy 1, policy_version 108183 (0.0007) [2023-12-27 20:00:26,022][106226] Updated weights for policy 0, policy_version 108295 (0.0005) [2023-12-27 20:00:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 55435264. Throughput: 0: 9710.4, 1: 9977.2. Samples: 55398412. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:26,175][105115] Avg episode reward: [(0, '-5.347'), (1, '-7.046')] [2023-12-27 20:00:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000108296_27729920.pth... [2023-12-27 20:00:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000108192_27705344.pth... [2023-12-27 20:00:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000107144_27435008.pth [2023-12-27 20:00:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000107008_27402240.pth [2023-12-27 20:00:26,665][106226] Updated weights for policy 0, policy_version 108305 (0.0006) [2023-12-27 20:00:26,710][106226] Updated weights for policy 0, policy_version 108315 (0.0009) [2023-12-27 20:00:26,756][106226] Updated weights for policy 0, policy_version 108325 (0.0006) [2023-12-27 20:00:26,785][106225] Updated weights for policy 1, policy_version 108193 (0.0009) [2023-12-27 20:00:26,843][106225] Updated weights for policy 1, policy_version 108203 (0.0008) [2023-12-27 20:00:26,898][106225] Updated weights for policy 1, policy_version 108214 (0.0010) [2023-12-27 20:00:26,951][106225] Updated weights for policy 1, policy_version 108224 (0.0008) [2023-12-27 20:00:27,303][106226] Updated weights for policy 0, policy_version 108335 (0.0007) [2023-12-27 20:00:27,351][106226] Updated weights for policy 0, policy_version 108345 (0.0005) [2023-12-27 20:00:27,413][106226] Updated weights for policy 0, policy_version 108355 (0.0005) [2023-12-27 20:00:27,768][106225] Updated weights for policy 1, policy_version 108234 (0.0008) [2023-12-27 20:00:27,822][106225] Updated weights for policy 1, policy_version 108244 (0.0008) [2023-12-27 20:00:27,885][106225] Updated weights for policy 1, policy_version 108254 (0.0009) [2023-12-27 20:00:28,017][106226] Updated weights for policy 0, policy_version 108365 (0.0005) [2023-12-27 20:00:28,071][106226] Updated weights for policy 0, policy_version 108375 (0.0007) [2023-12-27 20:00:28,122][106226] Updated weights for policy 0, policy_version 108385 (0.0008) [2023-12-27 20:00:28,628][106225] Updated weights for policy 1, policy_version 108264 (0.0008) [2023-12-27 20:00:28,691][106225] Updated weights for policy 1, policy_version 108274 (0.0008) [2023-12-27 20:00:28,740][106225] Updated weights for policy 1, policy_version 108284 (0.0009) [2023-12-27 20:00:28,841][106226] Updated weights for policy 0, policy_version 108395 (0.0009) [2023-12-27 20:00:28,903][106226] Updated weights for policy 0, policy_version 108405 (0.0008) [2023-12-27 20:00:28,960][106226] Updated weights for policy 0, policy_version 108415 (0.0007) [2023-12-27 20:00:29,522][106225] Updated weights for policy 1, policy_version 108294 (0.0008) [2023-12-27 20:00:29,576][106225] Updated weights for policy 1, policy_version 108304 (0.0007) [2023-12-27 20:00:29,627][106225] Updated weights for policy 1, policy_version 108314 (0.0008) [2023-12-27 20:00:29,644][106226] Updated weights for policy 0, policy_version 108425 (0.0007) [2023-12-27 20:00:29,701][106226] Updated weights for policy 0, policy_version 108435 (0.0009) [2023-12-27 20:00:29,753][106226] Updated weights for policy 0, policy_version 108445 (0.0008) [2023-12-27 20:00:29,802][106226] Updated weights for policy 0, policy_version 108455 (0.0009) [2023-12-27 20:00:30,362][106225] Updated weights for policy 1, policy_version 108324 (0.0009) [2023-12-27 20:00:30,412][106225] Updated weights for policy 1, policy_version 108334 (0.0008) [2023-12-27 20:00:30,461][106225] Updated weights for policy 1, policy_version 108344 (0.0008) [2023-12-27 20:00:30,513][106226] Updated weights for policy 0, policy_version 108465 (0.0006) [2023-12-27 20:00:30,568][106226] Updated weights for policy 0, policy_version 108475 (0.0005) [2023-12-27 20:00:30,635][106226] Updated weights for policy 0, policy_version 108485 (0.0005) [2023-12-27 20:00:31,078][106225] Updated weights for policy 1, policy_version 108354 (0.0008) [2023-12-27 20:00:31,144][106225] Updated weights for policy 1, policy_version 108364 (0.0007) [2023-12-27 20:00:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 55525376. Throughput: 0: 9823.0, 1: 9938.2. Samples: 55518328. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:31,175][105115] Avg episode reward: [(0, '-5.292'), (1, '-6.515')] [2023-12-27 20:00:31,204][106225] Updated weights for policy 1, policy_version 108374 (0.0007) [2023-12-27 20:00:31,222][106226] Updated weights for policy 0, policy_version 108495 (0.0006) [2023-12-27 20:00:31,264][106225] Updated weights for policy 1, policy_version 108384 (0.0007) [2023-12-27 20:00:31,289][106226] Updated weights for policy 0, policy_version 108505 (0.0008) [2023-12-27 20:00:31,358][106226] Updated weights for policy 0, policy_version 108515 (0.0008) [2023-12-27 20:00:32,008][106226] Updated weights for policy 0, policy_version 108525 (0.0009) [2023-12-27 20:00:32,036][106225] Updated weights for policy 1, policy_version 108394 (0.0008) [2023-12-27 20:00:32,066][106226] Updated weights for policy 0, policy_version 108535 (0.0006) [2023-12-27 20:00:32,095][106225] Updated weights for policy 1, policy_version 108404 (0.0007) [2023-12-27 20:00:32,121][106226] Updated weights for policy 0, policy_version 108545 (0.0006) [2023-12-27 20:00:32,153][106225] Updated weights for policy 1, policy_version 108414 (0.0007) [2023-12-27 20:00:32,859][106226] Updated weights for policy 0, policy_version 108555 (0.0006) [2023-12-27 20:00:32,876][106225] Updated weights for policy 1, policy_version 108424 (0.0008) [2023-12-27 20:00:32,914][106226] Updated weights for policy 0, policy_version 108565 (0.0006) [2023-12-27 20:00:32,933][106225] Updated weights for policy 1, policy_version 108434 (0.0007) [2023-12-27 20:00:32,970][106226] Updated weights for policy 0, policy_version 108575 (0.0006) [2023-12-27 20:00:32,992][106225] Updated weights for policy 1, policy_version 108444 (0.0006) [2023-12-27 20:00:33,569][106226] Updated weights for policy 0, policy_version 108585 (0.0008) [2023-12-27 20:00:33,619][106226] Updated weights for policy 0, policy_version 108595 (0.0008) [2023-12-27 20:00:33,673][106226] Updated weights for policy 0, policy_version 108605 (0.0008) [2023-12-27 20:00:33,710][106225] Updated weights for policy 1, policy_version 108454 (0.0008) [2023-12-27 20:00:33,720][106226] Updated weights for policy 0, policy_version 108615 (0.0006) [2023-12-27 20:00:33,760][106225] Updated weights for policy 1, policy_version 108464 (0.0008) [2023-12-27 20:00:33,811][106225] Updated weights for policy 1, policy_version 108474 (0.0009) [2023-12-27 20:00:34,418][106226] Updated weights for policy 0, policy_version 108625 (0.0006) [2023-12-27 20:00:34,483][106226] Updated weights for policy 0, policy_version 108635 (0.0005) [2023-12-27 20:00:34,547][106226] Updated weights for policy 0, policy_version 108645 (0.0011) [2023-12-27 20:00:34,553][106225] Updated weights for policy 1, policy_version 108484 (0.0007) [2023-12-27 20:00:34,623][106225] Updated weights for policy 1, policy_version 108494 (0.0007) [2023-12-27 20:00:34,689][106225] Updated weights for policy 1, policy_version 108504 (0.0008) [2023-12-27 20:00:35,166][106226] Updated weights for policy 0, policy_version 108655 (0.0010) [2023-12-27 20:00:35,227][106226] Updated weights for policy 0, policy_version 108665 (0.0010) [2023-12-27 20:00:35,273][106226] Updated weights for policy 0, policy_version 108675 (0.0010) [2023-12-27 20:00:35,298][106225] Updated weights for policy 1, policy_version 108514 (0.0009) [2023-12-27 20:00:35,352][106225] Updated weights for policy 1, policy_version 108524 (0.0007) [2023-12-27 20:00:35,410][106225] Updated weights for policy 1, policy_version 108534 (0.0006) [2023-12-27 20:00:35,472][106225] Updated weights for policy 1, policy_version 108544 (0.0006) [2023-12-27 20:00:35,984][106226] Updated weights for policy 0, policy_version 108685 (0.0010) [2023-12-27 20:00:36,047][106226] Updated weights for policy 0, policy_version 108695 (0.0010) [2023-12-27 20:00:36,115][106226] Updated weights for policy 0, policy_version 108705 (0.0010) [2023-12-27 20:00:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 55631872. Throughput: 0: 9909.2, 1: 9969.0. Samples: 55639816. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:36,175][105115] Avg episode reward: [(0, '-5.428'), (1, '-6.555')] [2023-12-27 20:00:36,204][106225] Updated weights for policy 1, policy_version 108554 (0.0010) [2023-12-27 20:00:36,269][106225] Updated weights for policy 1, policy_version 108564 (0.0008) [2023-12-27 20:00:36,332][106225] Updated weights for policy 1, policy_version 108574 (0.0008) [2023-12-27 20:00:36,798][106226] Updated weights for policy 0, policy_version 108715 (0.0011) [2023-12-27 20:00:36,863][106226] Updated weights for policy 0, policy_version 108725 (0.0011) [2023-12-27 20:00:36,933][106226] Updated weights for policy 0, policy_version 108735 (0.0011) [2023-12-27 20:00:37,077][106225] Updated weights for policy 1, policy_version 108584 (0.0008) [2023-12-27 20:00:37,122][106225] Updated weights for policy 1, policy_version 108594 (0.0008) [2023-12-27 20:00:37,179][106225] Updated weights for policy 1, policy_version 108604 (0.0008) [2023-12-27 20:00:37,609][106226] Updated weights for policy 0, policy_version 108745 (0.0010) [2023-12-27 20:00:37,674][106226] Updated weights for policy 0, policy_version 108755 (0.0011) [2023-12-27 20:00:37,738][106226] Updated weights for policy 0, policy_version 108765 (0.0009) [2023-12-27 20:00:37,803][106226] Updated weights for policy 0, policy_version 108775 (0.0011) [2023-12-27 20:00:37,864][106225] Updated weights for policy 1, policy_version 108614 (0.0008) [2023-12-27 20:00:37,914][106225] Updated weights for policy 1, policy_version 108624 (0.0007) [2023-12-27 20:00:37,967][106225] Updated weights for policy 1, policy_version 108634 (0.0007) [2023-12-27 20:00:38,530][106226] Updated weights for policy 0, policy_version 108785 (0.0011) [2023-12-27 20:00:38,592][106226] Updated weights for policy 0, policy_version 108795 (0.0011) [2023-12-27 20:00:38,660][106226] Updated weights for policy 0, policy_version 108805 (0.0011) [2023-12-27 20:00:38,744][106225] Updated weights for policy 1, policy_version 108644 (0.0008) [2023-12-27 20:00:38,808][106225] Updated weights for policy 1, policy_version 108654 (0.0008) [2023-12-27 20:00:38,872][106225] Updated weights for policy 1, policy_version 108664 (0.0009) [2023-12-27 20:00:39,292][106226] Updated weights for policy 0, policy_version 108815 (0.0011) [2023-12-27 20:00:39,363][106226] Updated weights for policy 0, policy_version 108825 (0.0010) [2023-12-27 20:00:39,440][106226] Updated weights for policy 0, policy_version 108835 (0.0008) [2023-12-27 20:00:39,699][106225] Updated weights for policy 1, policy_version 108674 (0.0009) [2023-12-27 20:00:39,760][106225] Updated weights for policy 1, policy_version 108684 (0.0008) [2023-12-27 20:00:39,825][106225] Updated weights for policy 1, policy_version 108694 (0.0009) [2023-12-27 20:00:39,896][106225] Updated weights for policy 1, policy_version 108704 (0.0008) [2023-12-27 20:00:40,194][106226] Updated weights for policy 0, policy_version 108845 (0.0009) [2023-12-27 20:00:40,256][106226] Updated weights for policy 0, policy_version 108855 (0.0008) [2023-12-27 20:00:40,315][106226] Updated weights for policy 0, policy_version 108865 (0.0007) [2023-12-27 20:00:40,681][106225] Updated weights for policy 1, policy_version 108714 (0.0008) [2023-12-27 20:00:40,736][106225] Updated weights for policy 1, policy_version 108724 (0.0008) [2023-12-27 20:00:40,798][106225] Updated weights for policy 1, policy_version 108734 (0.0009) [2023-12-27 20:00:41,114][106226] Updated weights for policy 0, policy_version 108875 (0.0009) [2023-12-27 20:00:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 55721984. Throughput: 0: 9901.7, 1: 9923.3. Samples: 55697920. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:41,176][105115] Avg episode reward: [(0, '-5.151'), (1, '-6.518')] [2023-12-27 20:00:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000108736_27844608.pth... [2023-12-27 20:00:41,187][106226] Updated weights for policy 0, policy_version 108885 (0.0009) [2023-12-27 20:00:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000107616_27557888.pth [2023-12-27 20:00:41,258][106226] Updated weights for policy 0, policy_version 108895 (0.0007) [2023-12-27 20:00:41,315][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000108904_27885568.pth... [2023-12-27 20:00:41,321][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000107720_27582464.pth [2023-12-27 20:00:41,645][106225] Updated weights for policy 1, policy_version 108744 (0.0009) [2023-12-27 20:00:41,715][106225] Updated weights for policy 1, policy_version 108754 (0.0010) [2023-12-27 20:00:41,791][106225] Updated weights for policy 1, policy_version 108764 (0.0010) [2023-12-27 20:00:42,103][106226] Updated weights for policy 0, policy_version 108905 (0.0008) [2023-12-27 20:00:42,153][106226] Updated weights for policy 0, policy_version 108915 (0.0008) [2023-12-27 20:00:42,203][106226] Updated weights for policy 0, policy_version 108925 (0.0007) [2023-12-27 20:00:42,253][106226] Updated weights for policy 0, policy_version 108935 (0.0008) [2023-12-27 20:00:42,574][106225] Updated weights for policy 1, policy_version 108774 (0.0011) [2023-12-27 20:00:42,634][106225] Updated weights for policy 1, policy_version 108784 (0.0009) [2023-12-27 20:00:42,688][106225] Updated weights for policy 1, policy_version 108794 (0.0009) [2023-12-27 20:00:42,961][106226] Updated weights for policy 0, policy_version 108945 (0.0005) [2023-12-27 20:00:43,022][106226] Updated weights for policy 0, policy_version 108955 (0.0006) [2023-12-27 20:00:43,075][106226] Updated weights for policy 0, policy_version 108965 (0.0009) [2023-12-27 20:00:43,462][106225] Updated weights for policy 1, policy_version 108804 (0.0007) [2023-12-27 20:00:43,521][106225] Updated weights for policy 1, policy_version 108814 (0.0005) [2023-12-27 20:00:43,580][106225] Updated weights for policy 1, policy_version 108824 (0.0005) [2023-12-27 20:00:43,719][106226] Updated weights for policy 0, policy_version 108975 (0.0010) [2023-12-27 20:00:43,781][106226] Updated weights for policy 0, policy_version 108985 (0.0011) [2023-12-27 20:00:43,838][106226] Updated weights for policy 0, policy_version 108995 (0.0010) [2023-12-27 20:00:44,184][106225] Updated weights for policy 1, policy_version 108834 (0.0006) [2023-12-27 20:00:44,247][106225] Updated weights for policy 1, policy_version 108844 (0.0009) [2023-12-27 20:00:44,297][106225] Updated weights for policy 1, policy_version 108854 (0.0007) [2023-12-27 20:00:44,348][106225] Updated weights for policy 1, policy_version 108864 (0.0006) [2023-12-27 20:00:44,520][106226] Updated weights for policy 0, policy_version 109005 (0.0007) [2023-12-27 20:00:44,575][106226] Updated weights for policy 0, policy_version 109015 (0.0009) [2023-12-27 20:00:44,630][106226] Updated weights for policy 0, policy_version 109025 (0.0009) [2023-12-27 20:00:45,047][106225] Updated weights for policy 1, policy_version 108874 (0.0007) [2023-12-27 20:00:45,112][106225] Updated weights for policy 1, policy_version 108884 (0.0006) [2023-12-27 20:00:45,179][106225] Updated weights for policy 1, policy_version 108894 (0.0007) [2023-12-27 20:00:45,396][106226] Updated weights for policy 0, policy_version 109035 (0.0010) [2023-12-27 20:00:45,462][106226] Updated weights for policy 0, policy_version 109045 (0.0009) [2023-12-27 20:00:45,533][106226] Updated weights for policy 0, policy_version 109055 (0.0007) [2023-12-27 20:00:45,860][106225] Updated weights for policy 1, policy_version 108904 (0.0007) [2023-12-27 20:00:45,929][106225] Updated weights for policy 1, policy_version 108914 (0.0006) [2023-12-27 20:00:45,994][106225] Updated weights for policy 1, policy_version 108924 (0.0005) [2023-12-27 20:00:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 55820288. Throughput: 0: 9889.7, 1: 9727.3. Samples: 55810112. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:46,175][105115] Avg episode reward: [(0, '-5.364'), (1, '-6.412')] [2023-12-27 20:00:46,228][106226] Updated weights for policy 0, policy_version 109065 (0.0006) [2023-12-27 20:00:46,300][106226] Updated weights for policy 0, policy_version 109075 (0.0009) [2023-12-27 20:00:46,363][106226] Updated weights for policy 0, policy_version 109085 (0.0008) [2023-12-27 20:00:46,427][106226] Updated weights for policy 0, policy_version 109095 (0.0008) [2023-12-27 20:00:46,689][106225] Updated weights for policy 1, policy_version 108934 (0.0007) [2023-12-27 20:00:46,753][106225] Updated weights for policy 1, policy_version 108944 (0.0008) [2023-12-27 20:00:46,817][106225] Updated weights for policy 1, policy_version 108954 (0.0009) [2023-12-27 20:00:47,154][106226] Updated weights for policy 0, policy_version 109105 (0.0008) [2023-12-27 20:00:47,220][106226] Updated weights for policy 0, policy_version 109115 (0.0009) [2023-12-27 20:00:47,289][106226] Updated weights for policy 0, policy_version 109125 (0.0009) [2023-12-27 20:00:47,505][106225] Updated weights for policy 1, policy_version 108964 (0.0007) [2023-12-27 20:00:47,561][106225] Updated weights for policy 1, policy_version 108974 (0.0005) [2023-12-27 20:00:47,622][106225] Updated weights for policy 1, policy_version 108984 (0.0007) [2023-12-27 20:00:48,004][106226] Updated weights for policy 0, policy_version 109135 (0.0007) [2023-12-27 20:00:48,062][106226] Updated weights for policy 0, policy_version 109145 (0.0006) [2023-12-27 20:00:48,125][106226] Updated weights for policy 0, policy_version 109155 (0.0008) [2023-12-27 20:00:48,234][106225] Updated weights for policy 1, policy_version 108994 (0.0006) [2023-12-27 20:00:48,300][106225] Updated weights for policy 1, policy_version 109004 (0.0007) [2023-12-27 20:00:48,368][106225] Updated weights for policy 1, policy_version 109014 (0.0007) [2023-12-27 20:00:48,435][106225] Updated weights for policy 1, policy_version 109024 (0.0008) [2023-12-27 20:00:48,900][106226] Updated weights for policy 0, policy_version 109165 (0.0009) [2023-12-27 20:00:48,960][106226] Updated weights for policy 0, policy_version 109175 (0.0009) [2023-12-27 20:00:49,025][106226] Updated weights for policy 0, policy_version 109185 (0.0007) [2023-12-27 20:00:49,083][106225] Updated weights for policy 1, policy_version 109034 (0.0008) [2023-12-27 20:00:49,147][106225] Updated weights for policy 1, policy_version 109044 (0.0008) [2023-12-27 20:00:49,211][106225] Updated weights for policy 1, policy_version 109054 (0.0009) [2023-12-27 20:00:49,769][106226] Updated weights for policy 0, policy_version 109195 (0.0007) [2023-12-27 20:00:49,835][106226] Updated weights for policy 0, policy_version 109205 (0.0009) [2023-12-27 20:00:49,906][106226] Updated weights for policy 0, policy_version 109215 (0.0009) [2023-12-27 20:00:50,038][106225] Updated weights for policy 1, policy_version 109064 (0.0008) [2023-12-27 20:00:50,097][106225] Updated weights for policy 1, policy_version 109074 (0.0007) [2023-12-27 20:00:50,162][106225] Updated weights for policy 1, policy_version 109084 (0.0009) [2023-12-27 20:00:50,650][106226] Updated weights for policy 0, policy_version 109225 (0.0007) [2023-12-27 20:00:50,718][106226] Updated weights for policy 0, policy_version 109235 (0.0008) [2023-12-27 20:00:50,783][106226] Updated weights for policy 0, policy_version 109245 (0.0008) [2023-12-27 20:00:50,852][106226] Updated weights for policy 0, policy_version 109255 (0.0009) [2023-12-27 20:00:50,912][106225] Updated weights for policy 1, policy_version 109094 (0.0008) [2023-12-27 20:00:50,963][106225] Updated weights for policy 1, policy_version 109104 (0.0009) [2023-12-27 20:00:51,017][106225] Updated weights for policy 1, policy_version 109114 (0.0009) [2023-12-27 20:00:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 55918592. Throughput: 0: 9804.0, 1: 9650.1. Samples: 55925036. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:51,175][105115] Avg episode reward: [(0, '-5.328'), (1, '-6.849')] [2023-12-27 20:00:51,615][106226] Updated weights for policy 0, policy_version 109265 (0.0008) [2023-12-27 20:00:51,686][106226] Updated weights for policy 0, policy_version 109275 (0.0009) [2023-12-27 20:00:51,762][106226] Updated weights for policy 0, policy_version 109285 (0.0008) [2023-12-27 20:00:51,778][106225] Updated weights for policy 1, policy_version 109124 (0.0009) [2023-12-27 20:00:51,834][106225] Updated weights for policy 1, policy_version 109134 (0.0008) [2023-12-27 20:00:51,900][106225] Updated weights for policy 1, policy_version 109144 (0.0009) [2023-12-27 20:00:52,500][106226] Updated weights for policy 0, policy_version 109295 (0.0007) [2023-12-27 20:00:52,555][106226] Updated weights for policy 0, policy_version 109305 (0.0008) [2023-12-27 20:00:52,614][106226] Updated weights for policy 0, policy_version 109315 (0.0008) [2023-12-27 20:00:52,643][106225] Updated weights for policy 1, policy_version 109154 (0.0009) [2023-12-27 20:00:52,710][106225] Updated weights for policy 1, policy_version 109164 (0.0010) [2023-12-27 20:00:52,773][106225] Updated weights for policy 1, policy_version 109174 (0.0006) [2023-12-27 20:00:52,836][106225] Updated weights for policy 1, policy_version 109184 (0.0007) [2023-12-27 20:00:53,298][106226] Updated weights for policy 0, policy_version 109325 (0.0006) [2023-12-27 20:00:53,355][106226] Updated weights for policy 0, policy_version 109335 (0.0008) [2023-12-27 20:00:53,413][106226] Updated weights for policy 0, policy_version 109345 (0.0009) [2023-12-27 20:00:53,431][106225] Updated weights for policy 1, policy_version 109194 (0.0007) [2023-12-27 20:00:53,476][106225] Updated weights for policy 1, policy_version 109204 (0.0007) [2023-12-27 20:00:53,525][106225] Updated weights for policy 1, policy_version 109214 (0.0008) [2023-12-27 20:00:54,125][106226] Updated weights for policy 0, policy_version 109355 (0.0007) [2023-12-27 20:00:54,191][106226] Updated weights for policy 0, policy_version 109365 (0.0006) [2023-12-27 20:00:54,200][106225] Updated weights for policy 1, policy_version 109224 (0.0010) [2023-12-27 20:00:54,245][106225] Updated weights for policy 1, policy_version 109234 (0.0010) [2023-12-27 20:00:54,246][106226] Updated weights for policy 0, policy_version 109375 (0.0007) [2023-12-27 20:00:54,304][106225] Updated weights for policy 1, policy_version 109244 (0.0010) [2023-12-27 20:00:54,922][106226] Updated weights for policy 0, policy_version 109385 (0.0006) [2023-12-27 20:00:54,984][106226] Updated weights for policy 0, policy_version 109395 (0.0008) [2023-12-27 20:00:55,034][106225] Updated weights for policy 1, policy_version 109254 (0.0010) [2023-12-27 20:00:55,046][106226] Updated weights for policy 0, policy_version 109405 (0.0007) [2023-12-27 20:00:55,097][106226] Updated weights for policy 0, policy_version 109415 (0.0007) [2023-12-27 20:00:55,101][106225] Updated weights for policy 1, policy_version 109264 (0.0007) [2023-12-27 20:00:55,165][106225] Updated weights for policy 1, policy_version 109274 (0.0005) [2023-12-27 20:00:55,743][106226] Updated weights for policy 0, policy_version 109425 (0.0009) [2023-12-27 20:00:55,804][106226] Updated weights for policy 0, policy_version 109435 (0.0010) [2023-12-27 20:00:55,818][106225] Updated weights for policy 1, policy_version 109284 (0.0006) [2023-12-27 20:00:55,865][106226] Updated weights for policy 0, policy_version 109445 (0.0006) [2023-12-27 20:00:55,883][106225] Updated weights for policy 1, policy_version 109294 (0.0008) [2023-12-27 20:00:55,935][106225] Updated weights for policy 1, policy_version 109304 (0.0008) [2023-12-27 20:00:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 56016896. Throughput: 0: 9811.8, 1: 9615.6. Samples: 55982688. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:00:56,176][105115] Avg episode reward: [(0, '-5.407'), (1, '-7.112')] [2023-12-27 20:00:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000109312_27992064.pth... [2023-12-27 20:00:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000109448_28024832.pth... [2023-12-27 20:00:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000108192_27705344.pth [2023-12-27 20:00:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000108296_27729920.pth [2023-12-27 20:00:56,592][106225] Updated weights for policy 1, policy_version 109314 (0.0007) [2023-12-27 20:00:56,610][106226] Updated weights for policy 0, policy_version 109455 (0.0010) [2023-12-27 20:00:56,655][106225] Updated weights for policy 1, policy_version 109324 (0.0005) [2023-12-27 20:00:56,658][106226] Updated weights for policy 0, policy_version 109465 (0.0008) [2023-12-27 20:00:56,718][106225] Updated weights for policy 1, policy_version 109334 (0.0007) [2023-12-27 20:00:56,718][106226] Updated weights for policy 0, policy_version 109475 (0.0006) [2023-12-27 20:00:56,773][106225] Updated weights for policy 1, policy_version 109344 (0.0009) [2023-12-27 20:00:57,404][106225] Updated weights for policy 1, policy_version 109354 (0.0006) [2023-12-27 20:00:57,419][106226] Updated weights for policy 0, policy_version 109485 (0.0009) [2023-12-27 20:00:57,455][106225] Updated weights for policy 1, policy_version 109364 (0.0006) [2023-12-27 20:00:57,479][106226] Updated weights for policy 0, policy_version 109495 (0.0010) [2023-12-27 20:00:57,511][106225] Updated weights for policy 1, policy_version 109374 (0.0005) [2023-12-27 20:00:57,532][106226] Updated weights for policy 0, policy_version 109505 (0.0010) [2023-12-27 20:00:58,178][106226] Updated weights for policy 0, policy_version 109515 (0.0010) [2023-12-27 20:00:58,180][106225] Updated weights for policy 1, policy_version 109384 (0.0006) [2023-12-27 20:00:58,232][106226] Updated weights for policy 0, policy_version 109525 (0.0011) [2023-12-27 20:00:58,248][106225] Updated weights for policy 1, policy_version 109394 (0.0007) [2023-12-27 20:00:58,290][106226] Updated weights for policy 0, policy_version 109535 (0.0011) [2023-12-27 20:00:58,304][106225] Updated weights for policy 1, policy_version 109404 (0.0007) [2023-12-27 20:00:59,090][106225] Updated weights for policy 1, policy_version 109414 (0.0008) [2023-12-27 20:00:59,146][106226] Updated weights for policy 0, policy_version 109545 (0.0009) [2023-12-27 20:00:59,151][106225] Updated weights for policy 1, policy_version 109424 (0.0007) [2023-12-27 20:00:59,205][106226] Updated weights for policy 0, policy_version 109555 (0.0008) [2023-12-27 20:00:59,213][106225] Updated weights for policy 1, policy_version 109434 (0.0008) [2023-12-27 20:00:59,273][106226] Updated weights for policy 0, policy_version 109565 (0.0010) [2023-12-27 20:00:59,334][106226] Updated weights for policy 0, policy_version 109575 (0.0009) [2023-12-27 20:00:59,990][106225] Updated weights for policy 1, policy_version 109444 (0.0009) [2023-12-27 20:01:00,049][106225] Updated weights for policy 1, policy_version 109454 (0.0008) [2023-12-27 20:01:00,064][106226] Updated weights for policy 0, policy_version 109585 (0.0006) [2023-12-27 20:01:00,112][106225] Updated weights for policy 1, policy_version 109464 (0.0006) [2023-12-27 20:01:00,125][106226] Updated weights for policy 0, policy_version 109595 (0.0008) [2023-12-27 20:01:00,185][106226] Updated weights for policy 0, policy_version 109605 (0.0008) [2023-12-27 20:01:00,863][106226] Updated weights for policy 0, policy_version 109615 (0.0008) [2023-12-27 20:01:00,865][106225] Updated weights for policy 1, policy_version 109474 (0.0006) [2023-12-27 20:01:00,911][106226] Updated weights for policy 0, policy_version 109625 (0.0007) [2023-12-27 20:01:00,924][106225] Updated weights for policy 1, policy_version 109484 (0.0007) [2023-12-27 20:01:00,964][106226] Updated weights for policy 0, policy_version 109635 (0.0006) [2023-12-27 20:01:00,981][106225] Updated weights for policy 1, policy_version 109494 (0.0007) [2023-12-27 20:01:01,039][106225] Updated weights for policy 1, policy_version 109504 (0.0008) [2023-12-27 20:01:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 56115200. Throughput: 0: 9855.3, 1: 9596.9. Samples: 56101648. Policy #0 lag: (min: 31.0, avg: 44.2, max: 63.0) [2023-12-27 20:01:01,175][105115] Avg episode reward: [(0, '-5.435'), (1, '-6.817')] [2023-12-27 20:01:01,638][106226] Updated weights for policy 0, policy_version 109645 (0.0007) [2023-12-27 20:01:01,708][106226] Updated weights for policy 0, policy_version 109655 (0.0008) [2023-12-27 20:01:01,761][106225] Updated weights for policy 1, policy_version 109514 (0.0008) [2023-12-27 20:01:01,770][106226] Updated weights for policy 0, policy_version 109665 (0.0009) [2023-12-27 20:01:01,813][106225] Updated weights for policy 1, policy_version 109524 (0.0005) [2023-12-27 20:01:01,870][106225] Updated weights for policy 1, policy_version 109534 (0.0009) [2023-12-27 20:01:02,433][106226] Updated weights for policy 0, policy_version 109675 (0.0008) [2023-12-27 20:01:02,492][106226] Updated weights for policy 0, policy_version 109685 (0.0008) [2023-12-27 20:01:02,544][106226] Updated weights for policy 0, policy_version 109695 (0.0006) [2023-12-27 20:01:02,643][106225] Updated weights for policy 1, policy_version 109544 (0.0008) [2023-12-27 20:01:02,702][106225] Updated weights for policy 1, policy_version 109554 (0.0008) [2023-12-27 20:01:02,761][106225] Updated weights for policy 1, policy_version 109564 (0.0008) [2023-12-27 20:01:03,236][106226] Updated weights for policy 0, policy_version 109705 (0.0006) [2023-12-27 20:01:03,294][106226] Updated weights for policy 0, policy_version 109715 (0.0008) [2023-12-27 20:01:03,355][106226] Updated weights for policy 0, policy_version 109725 (0.0009) [2023-12-27 20:01:03,416][106226] Updated weights for policy 0, policy_version 109735 (0.0008) [2023-12-27 20:01:03,429][106225] Updated weights for policy 1, policy_version 109574 (0.0008) [2023-12-27 20:01:03,485][106225] Updated weights for policy 1, policy_version 109584 (0.0005) [2023-12-27 20:01:03,535][106225] Updated weights for policy 1, policy_version 109594 (0.0006) [2023-12-27 20:01:04,181][106226] Updated weights for policy 0, policy_version 109745 (0.0008) [2023-12-27 20:01:04,227][106225] Updated weights for policy 1, policy_version 109604 (0.0010) [2023-12-27 20:01:04,241][106226] Updated weights for policy 0, policy_version 109755 (0.0006) [2023-12-27 20:01:04,287][106225] Updated weights for policy 1, policy_version 109614 (0.0011) [2023-12-27 20:01:04,301][106226] Updated weights for policy 0, policy_version 109765 (0.0006) [2023-12-27 20:01:04,349][106225] Updated weights for policy 1, policy_version 109624 (0.0010) [2023-12-27 20:01:04,949][106226] Updated weights for policy 0, policy_version 109775 (0.0007) [2023-12-27 20:01:05,004][106226] Updated weights for policy 0, policy_version 109785 (0.0008) [2023-12-27 20:01:05,051][106226] Updated weights for policy 0, policy_version 109795 (0.0007) [2023-12-27 20:01:05,056][106225] Updated weights for policy 1, policy_version 109634 (0.0010) [2023-12-27 20:01:05,115][106225] Updated weights for policy 1, policy_version 109644 (0.0010) [2023-12-27 20:01:05,182][106225] Updated weights for policy 1, policy_version 109654 (0.0010) [2023-12-27 20:01:05,238][106225] Updated weights for policy 1, policy_version 109664 (0.0010) [2023-12-27 20:01:05,727][106226] Updated weights for policy 0, policy_version 109805 (0.0006) [2023-12-27 20:01:05,791][106226] Updated weights for policy 0, policy_version 109815 (0.0005) [2023-12-27 20:01:05,853][106226] Updated weights for policy 0, policy_version 109825 (0.0006) [2023-12-27 20:01:05,938][106225] Updated weights for policy 1, policy_version 109674 (0.0010) [2023-12-27 20:01:06,000][106225] Updated weights for policy 1, policy_version 109684 (0.0010) [2023-12-27 20:01:06,067][106225] Updated weights for policy 1, policy_version 109694 (0.0010) [2023-12-27 20:01:06,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 56213504. Throughput: 0: 9927.5, 1: 9596.6. Samples: 56220316. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:06,175][105115] Avg episode reward: [(0, '-5.513'), (1, '-6.653')] [2023-12-27 20:01:06,539][106226] Updated weights for policy 0, policy_version 109835 (0.0008) [2023-12-27 20:01:06,605][106226] Updated weights for policy 0, policy_version 109845 (0.0008) [2023-12-27 20:01:06,666][106226] Updated weights for policy 0, policy_version 109855 (0.0009) [2023-12-27 20:01:06,792][106225] Updated weights for policy 1, policy_version 109704 (0.0007) [2023-12-27 20:01:06,851][106225] Updated weights for policy 1, policy_version 109714 (0.0006) [2023-12-27 20:01:06,900][106225] Updated weights for policy 1, policy_version 109724 (0.0008) [2023-12-27 20:01:07,460][106226] Updated weights for policy 0, policy_version 109865 (0.0009) [2023-12-27 20:01:07,486][106225] Updated weights for policy 1, policy_version 109734 (0.0010) [2023-12-27 20:01:07,510][106226] Updated weights for policy 0, policy_version 109875 (0.0010) [2023-12-27 20:01:07,541][106225] Updated weights for policy 1, policy_version 109744 (0.0010) [2023-12-27 20:01:07,560][106226] Updated weights for policy 0, policy_version 109885 (0.0010) [2023-12-27 20:01:07,592][106225] Updated weights for policy 1, policy_version 109754 (0.0005) [2023-12-27 20:01:07,616][106226] Updated weights for policy 0, policy_version 109895 (0.0005) [2023-12-27 20:01:08,219][106225] Updated weights for policy 1, policy_version 109764 (0.0007) [2023-12-27 20:01:08,270][106225] Updated weights for policy 1, policy_version 109774 (0.0010) [2023-12-27 20:01:08,314][106226] Updated weights for policy 0, policy_version 109905 (0.0009) [2023-12-27 20:01:08,324][106225] Updated weights for policy 1, policy_version 109784 (0.0006) [2023-12-27 20:01:08,378][106226] Updated weights for policy 0, policy_version 109915 (0.0007) [2023-12-27 20:01:08,448][106226] Updated weights for policy 0, policy_version 109925 (0.0009) [2023-12-27 20:01:08,948][106225] Updated weights for policy 1, policy_version 109794 (0.0008) [2023-12-27 20:01:08,995][106225] Updated weights for policy 1, policy_version 109804 (0.0005) [2023-12-27 20:01:09,048][106225] Updated weights for policy 1, policy_version 109814 (0.0005) [2023-12-27 20:01:09,098][106225] Updated weights for policy 1, policy_version 109824 (0.0005) [2023-12-27 20:01:09,250][106226] Updated weights for policy 0, policy_version 109935 (0.0008) [2023-12-27 20:01:09,313][106226] Updated weights for policy 0, policy_version 109945 (0.0009) [2023-12-27 20:01:09,381][106226] Updated weights for policy 0, policy_version 109955 (0.0008) [2023-12-27 20:01:09,907][106225] Updated weights for policy 1, policy_version 109834 (0.0010) [2023-12-27 20:01:09,980][106225] Updated weights for policy 1, policy_version 109844 (0.0011) [2023-12-27 20:01:10,043][106225] Updated weights for policy 1, policy_version 109854 (0.0010) [2023-12-27 20:01:10,131][106226] Updated weights for policy 0, policy_version 109965 (0.0008) [2023-12-27 20:01:10,201][106226] Updated weights for policy 0, policy_version 109975 (0.0008) [2023-12-27 20:01:10,289][106226] Updated weights for policy 0, policy_version 109985 (0.0007) [2023-12-27 20:01:10,743][106225] Updated weights for policy 1, policy_version 109864 (0.0009) [2023-12-27 20:01:10,800][106225] Updated weights for policy 1, policy_version 109874 (0.0009) [2023-12-27 20:01:10,860][106225] Updated weights for policy 1, policy_version 109884 (0.0010) [2023-12-27 20:01:10,898][106226] Updated weights for policy 0, policy_version 109995 (0.0008) [2023-12-27 20:01:10,959][106226] Updated weights for policy 0, policy_version 110005 (0.0008) [2023-12-27 20:01:11,024][106226] Updated weights for policy 0, policy_version 110015 (0.0008) [2023-12-27 20:01:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 56311808. Throughput: 0: 9891.2, 1: 9684.3. Samples: 56279312. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:11,175][105115] Avg episode reward: [(0, '-5.685'), (1, '-6.502')] [2023-12-27 20:01:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000109888_28139520.pth... [2023-12-27 20:01:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000110024_28172288.pth... [2023-12-27 20:01:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000108736_27844608.pth [2023-12-27 20:01:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000108904_27885568.pth [2023-12-27 20:01:11,661][106225] Updated weights for policy 1, policy_version 109894 (0.0010) [2023-12-27 20:01:11,726][106225] Updated weights for policy 1, policy_version 109904 (0.0010) [2023-12-27 20:01:11,790][106226] Updated weights for policy 0, policy_version 110025 (0.0008) [2023-12-27 20:01:11,796][106225] Updated weights for policy 1, policy_version 109914 (0.0009) [2023-12-27 20:01:11,855][106226] Updated weights for policy 0, policy_version 110035 (0.0006) [2023-12-27 20:01:11,918][106226] Updated weights for policy 0, policy_version 110045 (0.0008) [2023-12-27 20:01:11,986][106226] Updated weights for policy 0, policy_version 110055 (0.0009) [2023-12-27 20:01:12,560][106225] Updated weights for policy 1, policy_version 109924 (0.0008) [2023-12-27 20:01:12,625][106225] Updated weights for policy 1, policy_version 109934 (0.0009) [2023-12-27 20:01:12,685][106225] Updated weights for policy 1, policy_version 109944 (0.0009) [2023-12-27 20:01:12,704][106226] Updated weights for policy 0, policy_version 110065 (0.0010) [2023-12-27 20:01:12,768][106226] Updated weights for policy 0, policy_version 110075 (0.0011) [2023-12-27 20:01:12,823][106226] Updated weights for policy 0, policy_version 110085 (0.0011) [2023-12-27 20:01:13,401][106225] Updated weights for policy 1, policy_version 109954 (0.0007) [2023-12-27 20:01:13,459][106225] Updated weights for policy 1, policy_version 109964 (0.0008) [2023-12-27 20:01:13,508][106226] Updated weights for policy 0, policy_version 110095 (0.0008) [2023-12-27 20:01:13,518][106225] Updated weights for policy 1, policy_version 109974 (0.0009) [2023-12-27 20:01:13,570][106226] Updated weights for policy 0, policy_version 110105 (0.0006) [2023-12-27 20:01:13,572][106225] Updated weights for policy 1, policy_version 109984 (0.0007) [2023-12-27 20:01:13,626][106226] Updated weights for policy 0, policy_version 110115 (0.0005) [2023-12-27 20:01:14,227][106226] Updated weights for policy 0, policy_version 110125 (0.0007) [2023-12-27 20:01:14,288][106226] Updated weights for policy 0, policy_version 110135 (0.0008) [2023-12-27 20:01:14,336][106226] Updated weights for policy 0, policy_version 110145 (0.0009) [2023-12-27 20:01:14,360][106225] Updated weights for policy 1, policy_version 109994 (0.0005) [2023-12-27 20:01:14,415][106225] Updated weights for policy 1, policy_version 110004 (0.0008) [2023-12-27 20:01:14,465][106225] Updated weights for policy 1, policy_version 110014 (0.0010) [2023-12-27 20:01:15,110][106226] Updated weights for policy 0, policy_version 110155 (0.0008) [2023-12-27 20:01:15,154][106225] Updated weights for policy 1, policy_version 110024 (0.0011) [2023-12-27 20:01:15,172][106226] Updated weights for policy 0, policy_version 110165 (0.0006) [2023-12-27 20:01:15,206][106225] Updated weights for policy 1, policy_version 110034 (0.0010) [2023-12-27 20:01:15,232][106226] Updated weights for policy 0, policy_version 110175 (0.0007) [2023-12-27 20:01:15,258][106225] Updated weights for policy 1, policy_version 110044 (0.0010) [2023-12-27 20:01:15,900][106226] Updated weights for policy 0, policy_version 110185 (0.0006) [2023-12-27 20:01:15,926][106225] Updated weights for policy 1, policy_version 110054 (0.0007) [2023-12-27 20:01:15,958][106226] Updated weights for policy 0, policy_version 110195 (0.0009) [2023-12-27 20:01:15,987][106225] Updated weights for policy 1, policy_version 110064 (0.0010) [2023-12-27 20:01:16,005][106226] Updated weights for policy 0, policy_version 110205 (0.0005) [2023-12-27 20:01:16,034][106225] Updated weights for policy 1, policy_version 110074 (0.0010) [2023-12-27 20:01:16,056][106226] Updated weights for policy 0, policy_version 110215 (0.0005) [2023-12-27 20:01:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 56410112. Throughput: 0: 9743.9, 1: 9714.3. Samples: 56393948. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:16,176][105115] Avg episode reward: [(0, '-5.096'), (1, '-6.734')] [2023-12-27 20:01:16,646][106225] Updated weights for policy 1, policy_version 110084 (0.0010) [2023-12-27 20:01:16,709][106225] Updated weights for policy 1, policy_version 110094 (0.0009) [2023-12-27 20:01:16,768][106225] Updated weights for policy 1, policy_version 110104 (0.0008) [2023-12-27 20:01:16,835][106226] Updated weights for policy 0, policy_version 110225 (0.0007) [2023-12-27 20:01:16,898][106226] Updated weights for policy 0, policy_version 110235 (0.0009) [2023-12-27 20:01:16,952][106226] Updated weights for policy 0, policy_version 110245 (0.0010) [2023-12-27 20:01:17,490][106225] Updated weights for policy 1, policy_version 110114 (0.0009) [2023-12-27 20:01:17,545][106225] Updated weights for policy 1, policy_version 110124 (0.0010) [2023-12-27 20:01:17,595][106225] Updated weights for policy 1, policy_version 110134 (0.0007) [2023-12-27 20:01:17,606][106226] Updated weights for policy 0, policy_version 110255 (0.0006) [2023-12-27 20:01:17,652][106225] Updated weights for policy 1, policy_version 110144 (0.0005) [2023-12-27 20:01:17,654][106226] Updated weights for policy 0, policy_version 110265 (0.0005) [2023-12-27 20:01:17,703][106226] Updated weights for policy 0, policy_version 110275 (0.0005) [2023-12-27 20:01:18,289][106226] Updated weights for policy 0, policy_version 110285 (0.0006) [2023-12-27 20:01:18,341][106225] Updated weights for policy 1, policy_version 110154 (0.0011) [2023-12-27 20:01:18,360][106226] Updated weights for policy 0, policy_version 110295 (0.0008) [2023-12-27 20:01:18,405][106225] Updated weights for policy 1, policy_version 110164 (0.0009) [2023-12-27 20:01:18,416][106226] Updated weights for policy 0, policy_version 110305 (0.0008) [2023-12-27 20:01:18,460][106225] Updated weights for policy 1, policy_version 110174 (0.0011) [2023-12-27 20:01:19,144][106226] Updated weights for policy 0, policy_version 110315 (0.0008) [2023-12-27 20:01:19,180][106225] Updated weights for policy 1, policy_version 110184 (0.0010) [2023-12-27 20:01:19,200][106226] Updated weights for policy 0, policy_version 110325 (0.0010) [2023-12-27 20:01:19,245][106225] Updated weights for policy 1, policy_version 110194 (0.0010) [2023-12-27 20:01:19,266][106226] Updated weights for policy 0, policy_version 110335 (0.0009) [2023-12-27 20:01:19,308][106225] Updated weights for policy 1, policy_version 110204 (0.0008) [2023-12-27 20:01:20,030][106226] Updated weights for policy 0, policy_version 110345 (0.0010) [2023-12-27 20:01:20,045][106225] Updated weights for policy 1, policy_version 110214 (0.0010) [2023-12-27 20:01:20,095][106226] Updated weights for policy 0, policy_version 110355 (0.0011) [2023-12-27 20:01:20,107][106225] Updated weights for policy 1, policy_version 110224 (0.0011) [2023-12-27 20:01:20,161][106226] Updated weights for policy 0, policy_version 110365 (0.0006) [2023-12-27 20:01:20,170][106225] Updated weights for policy 1, policy_version 110234 (0.0011) [2023-12-27 20:01:20,224][106226] Updated weights for policy 0, policy_version 110375 (0.0006) [2023-12-27 20:01:20,826][106226] Updated weights for policy 0, policy_version 110385 (0.0010) [2023-12-27 20:01:20,893][106226] Updated weights for policy 0, policy_version 110395 (0.0011) [2023-12-27 20:01:20,922][106225] Updated weights for policy 1, policy_version 110244 (0.0011) [2023-12-27 20:01:20,952][106226] Updated weights for policy 0, policy_version 110405 (0.0009) [2023-12-27 20:01:20,991][106225] Updated weights for policy 1, policy_version 110254 (0.0011) [2023-12-27 20:01:21,061][106225] Updated weights for policy 1, policy_version 110264 (0.0009) [2023-12-27 20:01:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 56508416. Throughput: 0: 9696.8, 1: 9715.6. Samples: 56513372. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:21,175][105115] Avg episode reward: [(0, '-5.454'), (1, '-6.648')] [2023-12-27 20:01:21,683][106226] Updated weights for policy 0, policy_version 110415 (0.0008) [2023-12-27 20:01:21,758][106226] Updated weights for policy 0, policy_version 110425 (0.0009) [2023-12-27 20:01:21,820][106226] Updated weights for policy 0, policy_version 110435 (0.0008) [2023-12-27 20:01:21,869][106225] Updated weights for policy 1, policy_version 110274 (0.0010) [2023-12-27 20:01:21,936][106225] Updated weights for policy 1, policy_version 110284 (0.0009) [2023-12-27 20:01:21,999][106225] Updated weights for policy 1, policy_version 110294 (0.0008) [2023-12-27 20:01:22,056][106225] Updated weights for policy 1, policy_version 110304 (0.0008) [2023-12-27 20:01:22,542][106226] Updated weights for policy 0, policy_version 110445 (0.0008) [2023-12-27 20:01:22,608][106226] Updated weights for policy 0, policy_version 110455 (0.0008) [2023-12-27 20:01:22,671][106226] Updated weights for policy 0, policy_version 110465 (0.0008) [2023-12-27 20:01:22,856][106225] Updated weights for policy 1, policy_version 110314 (0.0007) [2023-12-27 20:01:22,913][106225] Updated weights for policy 1, policy_version 110324 (0.0007) [2023-12-27 20:01:22,982][106225] Updated weights for policy 1, policy_version 110334 (0.0009) [2023-12-27 20:01:23,390][106226] Updated weights for policy 0, policy_version 110475 (0.0008) [2023-12-27 20:01:23,455][106226] Updated weights for policy 0, policy_version 110485 (0.0008) [2023-12-27 20:01:23,505][106226] Updated weights for policy 0, policy_version 110495 (0.0008) [2023-12-27 20:01:23,706][106225] Updated weights for policy 1, policy_version 110344 (0.0008) [2023-12-27 20:01:23,773][106225] Updated weights for policy 1, policy_version 110354 (0.0009) [2023-12-27 20:01:23,830][106225] Updated weights for policy 1, policy_version 110364 (0.0009) [2023-12-27 20:01:24,155][106226] Updated weights for policy 0, policy_version 110505 (0.0008) [2023-12-27 20:01:24,210][106226] Updated weights for policy 0, policy_version 110515 (0.0008) [2023-12-27 20:01:24,264][106226] Updated weights for policy 0, policy_version 110525 (0.0009) [2023-12-27 20:01:24,323][106226] Updated weights for policy 0, policy_version 110535 (0.0008) [2023-12-27 20:01:24,519][106225] Updated weights for policy 1, policy_version 110374 (0.0008) [2023-12-27 20:01:24,571][106225] Updated weights for policy 1, policy_version 110384 (0.0009) [2023-12-27 20:01:24,620][106225] Updated weights for policy 1, policy_version 110394 (0.0009) [2023-12-27 20:01:25,051][106226] Updated weights for policy 0, policy_version 110545 (0.0008) [2023-12-27 20:01:25,116][106226] Updated weights for policy 0, policy_version 110555 (0.0009) [2023-12-27 20:01:25,181][106226] Updated weights for policy 0, policy_version 110565 (0.0008) [2023-12-27 20:01:25,301][106225] Updated weights for policy 1, policy_version 110404 (0.0008) [2023-12-27 20:01:25,349][106225] Updated weights for policy 1, policy_version 110414 (0.0008) [2023-12-27 20:01:25,398][106225] Updated weights for policy 1, policy_version 110424 (0.0009) [2023-12-27 20:01:25,777][106226] Updated weights for policy 0, policy_version 110575 (0.0007) [2023-12-27 20:01:25,824][106226] Updated weights for policy 0, policy_version 110585 (0.0010) [2023-12-27 20:01:25,870][106226] Updated weights for policy 0, policy_version 110595 (0.0010) [2023-12-27 20:01:26,161][106225] Updated weights for policy 1, policy_version 110434 (0.0009) [2023-12-27 20:01:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 56598528. Throughput: 0: 9694.7, 1: 9688.3. Samples: 56570152. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:26,176][105115] Avg episode reward: [(0, '-5.519'), (1, '-7.056')] [2023-12-27 20:01:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000110600_28319744.pth... [2023-12-27 20:01:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000109448_28024832.pth [2023-12-27 20:01:26,222][106225] Updated weights for policy 1, policy_version 110444 (0.0009) [2023-12-27 20:01:26,288][106225] Updated weights for policy 1, policy_version 110454 (0.0008) [2023-12-27 20:01:26,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000110464_28286976.pth... [2023-12-27 20:01:26,359][106225] Updated weights for policy 1, policy_version 110464 (0.0010) [2023-12-27 20:01:26,360][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000109312_27992064.pth [2023-12-27 20:01:26,514][106226] Updated weights for policy 0, policy_version 110605 (0.0008) [2023-12-27 20:01:26,571][106226] Updated weights for policy 0, policy_version 110615 (0.0005) [2023-12-27 20:01:26,633][106226] Updated weights for policy 0, policy_version 110625 (0.0006) [2023-12-27 20:01:27,130][106225] Updated weights for policy 1, policy_version 110474 (0.0008) [2023-12-27 20:01:27,188][106225] Updated weights for policy 1, policy_version 110484 (0.0009) [2023-12-27 20:01:27,205][106226] Updated weights for policy 0, policy_version 110635 (0.0007) [2023-12-27 20:01:27,251][106225] Updated weights for policy 1, policy_version 110494 (0.0009) [2023-12-27 20:01:27,262][106226] Updated weights for policy 0, policy_version 110645 (0.0005) [2023-12-27 20:01:27,312][106226] Updated weights for policy 0, policy_version 110655 (0.0006) [2023-12-27 20:01:27,870][106226] Updated weights for policy 0, policy_version 110665 (0.0007) [2023-12-27 20:01:27,923][106225] Updated weights for policy 1, policy_version 110504 (0.0006) [2023-12-27 20:01:27,936][106226] Updated weights for policy 0, policy_version 110675 (0.0005) [2023-12-27 20:01:27,981][106225] Updated weights for policy 1, policy_version 110514 (0.0005) [2023-12-27 20:01:28,000][106226] Updated weights for policy 0, policy_version 110685 (0.0005) [2023-12-27 20:01:28,043][106225] Updated weights for policy 1, policy_version 110524 (0.0005) [2023-12-27 20:01:28,061][106226] Updated weights for policy 0, policy_version 110695 (0.0008) [2023-12-27 20:01:28,687][106226] Updated weights for policy 0, policy_version 110705 (0.0006) [2023-12-27 20:01:28,738][106225] Updated weights for policy 1, policy_version 110534 (0.0007) [2023-12-27 20:01:28,744][106226] Updated weights for policy 0, policy_version 110715 (0.0007) [2023-12-27 20:01:28,795][106225] Updated weights for policy 1, policy_version 110544 (0.0008) [2023-12-27 20:01:28,802][106226] Updated weights for policy 0, policy_version 110725 (0.0007) [2023-12-27 20:01:28,861][106225] Updated weights for policy 1, policy_version 110554 (0.0008) [2023-12-27 20:01:29,419][106226] Updated weights for policy 0, policy_version 110735 (0.0007) [2023-12-27 20:01:29,489][106226] Updated weights for policy 0, policy_version 110745 (0.0007) [2023-12-27 20:01:29,556][106226] Updated weights for policy 0, policy_version 110755 (0.0007) [2023-12-27 20:01:29,616][106225] Updated weights for policy 1, policy_version 110564 (0.0008) [2023-12-27 20:01:29,669][106225] Updated weights for policy 1, policy_version 110574 (0.0008) [2023-12-27 20:01:29,733][106225] Updated weights for policy 1, policy_version 110584 (0.0009) [2023-12-27 20:01:30,212][106226] Updated weights for policy 0, policy_version 110765 (0.0006) [2023-12-27 20:01:30,260][106226] Updated weights for policy 0, policy_version 110775 (0.0005) [2023-12-27 20:01:30,308][106226] Updated weights for policy 0, policy_version 110785 (0.0005) [2023-12-27 20:01:30,468][106225] Updated weights for policy 1, policy_version 110594 (0.0009) [2023-12-27 20:01:30,520][106225] Updated weights for policy 1, policy_version 110604 (0.0006) [2023-12-27 20:01:30,579][106225] Updated weights for policy 1, policy_version 110614 (0.0008) [2023-12-27 20:01:30,636][106225] Updated weights for policy 1, policy_version 110624 (0.0008) [2023-12-27 20:01:30,894][106226] Updated weights for policy 0, policy_version 110795 (0.0006) [2023-12-27 20:01:30,952][106226] Updated weights for policy 0, policy_version 110805 (0.0005) [2023-12-27 20:01:31,014][106226] Updated weights for policy 0, policy_version 110815 (0.0006) [2023-12-27 20:01:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 56705024. Throughput: 0: 9873.1, 1: 9746.1. Samples: 56692972. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:31,175][105115] Avg episode reward: [(0, '-5.346'), (1, '-6.581')] [2023-12-27 20:01:31,376][106225] Updated weights for policy 1, policy_version 110634 (0.0009) [2023-12-27 20:01:31,443][106225] Updated weights for policy 1, policy_version 110644 (0.0007) [2023-12-27 20:01:31,496][106225] Updated weights for policy 1, policy_version 110654 (0.0008) [2023-12-27 20:01:31,717][106226] Updated weights for policy 0, policy_version 110827 (0.0007) [2023-12-27 20:01:31,761][106226] Updated weights for policy 0, policy_version 110837 (0.0006) [2023-12-27 20:01:31,808][106226] Updated weights for policy 0, policy_version 110847 (0.0005) [2023-12-27 20:01:32,259][106225] Updated weights for policy 1, policy_version 110664 (0.0008) [2023-12-27 20:01:32,320][106225] Updated weights for policy 1, policy_version 110674 (0.0008) [2023-12-27 20:01:32,380][106225] Updated weights for policy 1, policy_version 110684 (0.0008) [2023-12-27 20:01:32,430][106226] Updated weights for policy 0, policy_version 110857 (0.0006) [2023-12-27 20:01:32,487][106226] Updated weights for policy 0, policy_version 110867 (0.0008) [2023-12-27 20:01:32,551][106226] Updated weights for policy 0, policy_version 110877 (0.0009) [2023-12-27 20:01:32,609][106226] Updated weights for policy 0, policy_version 110887 (0.0009) [2023-12-27 20:01:33,083][106225] Updated weights for policy 1, policy_version 110694 (0.0007) [2023-12-27 20:01:33,135][106225] Updated weights for policy 1, policy_version 110704 (0.0005) [2023-12-27 20:01:33,186][106225] Updated weights for policy 1, policy_version 110714 (0.0005) [2023-12-27 20:01:33,364][106226] Updated weights for policy 0, policy_version 110897 (0.0007) [2023-12-27 20:01:33,414][106226] Updated weights for policy 0, policy_version 110907 (0.0008) [2023-12-27 20:01:33,467][106226] Updated weights for policy 0, policy_version 110917 (0.0010) [2023-12-27 20:01:33,717][106225] Updated weights for policy 1, policy_version 110724 (0.0006) [2023-12-27 20:01:33,779][106225] Updated weights for policy 1, policy_version 110734 (0.0008) [2023-12-27 20:01:33,830][106225] Updated weights for policy 1, policy_version 110744 (0.0005) [2023-12-27 20:01:34,100][106226] Updated weights for policy 0, policy_version 110927 (0.0007) [2023-12-27 20:01:34,160][106226] Updated weights for policy 0, policy_version 110937 (0.0009) [2023-12-27 20:01:34,217][106226] Updated weights for policy 0, policy_version 110947 (0.0010) [2023-12-27 20:01:34,399][106225] Updated weights for policy 1, policy_version 110754 (0.0006) [2023-12-27 20:01:34,462][106225] Updated weights for policy 1, policy_version 110764 (0.0008) [2023-12-27 20:01:34,520][106225] Updated weights for policy 1, policy_version 110774 (0.0009) [2023-12-27 20:01:34,581][106225] Updated weights for policy 1, policy_version 110784 (0.0007) [2023-12-27 20:01:34,915][106226] Updated weights for policy 0, policy_version 110957 (0.0010) [2023-12-27 20:01:34,973][106226] Updated weights for policy 0, policy_version 110967 (0.0008) [2023-12-27 20:01:35,026][106226] Updated weights for policy 0, policy_version 110977 (0.0008) [2023-12-27 20:01:35,254][106225] Updated weights for policy 1, policy_version 110794 (0.0008) [2023-12-27 20:01:35,310][106225] Updated weights for policy 1, policy_version 110804 (0.0009) [2023-12-27 20:01:35,363][106225] Updated weights for policy 1, policy_version 110814 (0.0009) [2023-12-27 20:01:35,641][106226] Updated weights for policy 0, policy_version 110987 (0.0007) [2023-12-27 20:01:35,703][106226] Updated weights for policy 0, policy_version 110997 (0.0007) [2023-12-27 20:01:35,762][106226] Updated weights for policy 0, policy_version 111007 (0.0009) [2023-12-27 20:01:36,169][106225] Updated weights for policy 1, policy_version 110824 (0.0007) [2023-12-27 20:01:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 56803328. Throughput: 0: 10005.2, 1: 9785.5. Samples: 56815620. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:36,175][105115] Avg episode reward: [(0, '-5.488'), (1, '-7.322')] [2023-12-27 20:01:36,235][106225] Updated weights for policy 1, policy_version 110834 (0.0007) [2023-12-27 20:01:36,288][106225] Updated weights for policy 1, policy_version 110844 (0.0009) [2023-12-27 20:01:36,480][106226] Updated weights for policy 0, policy_version 111017 (0.0008) [2023-12-27 20:01:36,542][106226] Updated weights for policy 0, policy_version 111027 (0.0009) [2023-12-27 20:01:36,611][106226] Updated weights for policy 0, policy_version 111037 (0.0005) [2023-12-27 20:01:36,680][106226] Updated weights for policy 0, policy_version 111047 (0.0008) [2023-12-27 20:01:36,975][106225] Updated weights for policy 1, policy_version 110854 (0.0008) [2023-12-27 20:01:37,035][106225] Updated weights for policy 1, policy_version 110864 (0.0008) [2023-12-27 20:01:37,101][106225] Updated weights for policy 1, policy_version 110874 (0.0008) [2023-12-27 20:01:37,325][106226] Updated weights for policy 0, policy_version 111057 (0.0008) [2023-12-27 20:01:37,379][106226] Updated weights for policy 0, policy_version 111067 (0.0010) [2023-12-27 20:01:37,442][106226] Updated weights for policy 0, policy_version 111077 (0.0006) [2023-12-27 20:01:37,853][106225] Updated weights for policy 1, policy_version 110884 (0.0010) [2023-12-27 20:01:37,906][106225] Updated weights for policy 1, policy_version 110894 (0.0010) [2023-12-27 20:01:37,956][106225] Updated weights for policy 1, policy_version 110904 (0.0010) [2023-12-27 20:01:38,074][106226] Updated weights for policy 0, policy_version 111087 (0.0008) [2023-12-27 20:01:38,130][106226] Updated weights for policy 0, policy_version 111097 (0.0005) [2023-12-27 20:01:38,192][106226] Updated weights for policy 0, policy_version 111107 (0.0010) [2023-12-27 20:01:38,631][106225] Updated weights for policy 1, policy_version 110914 (0.0010) [2023-12-27 20:01:38,681][106225] Updated weights for policy 1, policy_version 110924 (0.0010) [2023-12-27 20:01:38,743][106225] Updated weights for policy 1, policy_version 110934 (0.0011) [2023-12-27 20:01:38,794][106225] Updated weights for policy 1, policy_version 110944 (0.0010) [2023-12-27 20:01:38,843][106226] Updated weights for policy 0, policy_version 111117 (0.0009) [2023-12-27 20:01:38,897][106226] Updated weights for policy 0, policy_version 111127 (0.0008) [2023-12-27 20:01:38,949][106226] Updated weights for policy 0, policy_version 111137 (0.0007) [2023-12-27 20:01:39,570][106225] Updated weights for policy 1, policy_version 110954 (0.0008) [2023-12-27 20:01:39,636][106225] Updated weights for policy 1, policy_version 110964 (0.0008) [2023-12-27 20:01:39,659][106226] Updated weights for policy 0, policy_version 111147 (0.0009) [2023-12-27 20:01:39,694][106225] Updated weights for policy 1, policy_version 110974 (0.0008) [2023-12-27 20:01:39,724][106226] Updated weights for policy 0, policy_version 111157 (0.0006) [2023-12-27 20:01:39,787][106226] Updated weights for policy 0, policy_version 111167 (0.0009) [2023-12-27 20:01:40,440][106225] Updated weights for policy 1, policy_version 110984 (0.0010) [2023-12-27 20:01:40,462][106226] Updated weights for policy 0, policy_version 111177 (0.0009) [2023-12-27 20:01:40,497][106225] Updated weights for policy 1, policy_version 110994 (0.0010) [2023-12-27 20:01:40,519][106226] Updated weights for policy 0, policy_version 111187 (0.0006) [2023-12-27 20:01:40,555][106225] Updated weights for policy 1, policy_version 111004 (0.0010) [2023-12-27 20:01:40,583][106226] Updated weights for policy 0, policy_version 111197 (0.0007) [2023-12-27 20:01:40,639][106226] Updated weights for policy 0, policy_version 111207 (0.0008) [2023-12-27 20:01:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 56901632. Throughput: 0: 10059.9, 1: 9784.5. Samples: 56875680. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:41,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-6.725')] [2023-12-27 20:01:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000111208_28475392.pth... [2023-12-27 20:01:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000111008_28426240.pth... [2023-12-27 20:01:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000110024_28172288.pth [2023-12-27 20:01:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000109888_28139520.pth [2023-12-27 20:01:41,243][106225] Updated weights for policy 1, policy_version 111014 (0.0010) [2023-12-27 20:01:41,313][106225] Updated weights for policy 1, policy_version 111024 (0.0008) [2023-12-27 20:01:41,381][106225] Updated weights for policy 1, policy_version 111034 (0.0008) [2023-12-27 20:01:41,443][106226] Updated weights for policy 0, policy_version 111217 (0.0009) [2023-12-27 20:01:41,514][106226] Updated weights for policy 0, policy_version 111227 (0.0009) [2023-12-27 20:01:41,581][106226] Updated weights for policy 0, policy_version 111237 (0.0009) [2023-12-27 20:01:42,133][106225] Updated weights for policy 1, policy_version 111044 (0.0008) [2023-12-27 20:01:42,189][106225] Updated weights for policy 1, policy_version 111054 (0.0008) [2023-12-27 20:01:42,249][106225] Updated weights for policy 1, policy_version 111064 (0.0010) [2023-12-27 20:01:42,302][106226] Updated weights for policy 0, policy_version 111247 (0.0008) [2023-12-27 20:01:42,362][106226] Updated weights for policy 0, policy_version 111257 (0.0009) [2023-12-27 20:01:42,432][106226] Updated weights for policy 0, policy_version 111267 (0.0007) [2023-12-27 20:01:43,001][106225] Updated weights for policy 1, policy_version 111074 (0.0008) [2023-12-27 20:01:43,058][106225] Updated weights for policy 1, policy_version 111084 (0.0005) [2023-12-27 20:01:43,110][106225] Updated weights for policy 1, policy_version 111094 (0.0005) [2023-12-27 20:01:43,112][106226] Updated weights for policy 0, policy_version 111277 (0.0006) [2023-12-27 20:01:43,168][106225] Updated weights for policy 1, policy_version 111104 (0.0007) [2023-12-27 20:01:43,169][106226] Updated weights for policy 0, policy_version 111287 (0.0006) [2023-12-27 20:01:43,229][106226] Updated weights for policy 0, policy_version 111297 (0.0007) [2023-12-27 20:01:43,802][106225] Updated weights for policy 1, policy_version 111114 (0.0008) [2023-12-27 20:01:43,860][106225] Updated weights for policy 1, policy_version 111124 (0.0008) [2023-12-27 20:01:43,915][106225] Updated weights for policy 1, policy_version 111134 (0.0008) [2023-12-27 20:01:43,966][106226] Updated weights for policy 0, policy_version 111307 (0.0007) [2023-12-27 20:01:44,015][106226] Updated weights for policy 0, policy_version 111317 (0.0008) [2023-12-27 20:01:44,074][106226] Updated weights for policy 0, policy_version 111327 (0.0009) [2023-12-27 20:01:44,510][106225] Updated weights for policy 1, policy_version 111144 (0.0009) [2023-12-27 20:01:44,561][106225] Updated weights for policy 1, policy_version 111154 (0.0008) [2023-12-27 20:01:44,619][106225] Updated weights for policy 1, policy_version 111164 (0.0007) [2023-12-27 20:01:44,926][106226] Updated weights for policy 0, policy_version 111337 (0.0008) [2023-12-27 20:01:44,982][106226] Updated weights for policy 0, policy_version 111347 (0.0009) [2023-12-27 20:01:45,038][106226] Updated weights for policy 0, policy_version 111357 (0.0007) [2023-12-27 20:01:45,090][106226] Updated weights for policy 0, policy_version 111367 (0.0009) [2023-12-27 20:01:45,323][106225] Updated weights for policy 1, policy_version 111174 (0.0007) [2023-12-27 20:01:45,381][106225] Updated weights for policy 1, policy_version 111184 (0.0006) [2023-12-27 20:01:45,443][106225] Updated weights for policy 1, policy_version 111194 (0.0008) [2023-12-27 20:01:45,830][106226] Updated weights for policy 0, policy_version 111377 (0.0008) [2023-12-27 20:01:45,892][106226] Updated weights for policy 0, policy_version 111387 (0.0006) [2023-12-27 20:01:45,942][106226] Updated weights for policy 0, policy_version 111397 (0.0007) [2023-12-27 20:01:46,119][106225] Updated weights for policy 1, policy_version 111204 (0.0008) [2023-12-27 20:01:46,168][106225] Updated weights for policy 1, policy_version 111214 (0.0009) [2023-12-27 20:01:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 56999936. Throughput: 0: 10012.8, 1: 9751.6. Samples: 56991048. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:46,175][105115] Avg episode reward: [(0, '-5.443'), (1, '-7.002')] [2023-12-27 20:01:46,220][106225] Updated weights for policy 1, policy_version 111224 (0.0007) [2023-12-27 20:01:46,495][106226] Updated weights for policy 0, policy_version 111407 (0.0005) [2023-12-27 20:01:46,556][106226] Updated weights for policy 0, policy_version 111417 (0.0005) [2023-12-27 20:01:46,613][106226] Updated weights for policy 0, policy_version 111427 (0.0006) [2023-12-27 20:01:46,985][106225] Updated weights for policy 1, policy_version 111234 (0.0006) [2023-12-27 20:01:47,046][106225] Updated weights for policy 1, policy_version 111244 (0.0008) [2023-12-27 20:01:47,108][106225] Updated weights for policy 1, policy_version 111254 (0.0008) [2023-12-27 20:01:47,165][106225] Updated weights for policy 1, policy_version 111264 (0.0007) [2023-12-27 20:01:47,280][106226] Updated weights for policy 0, policy_version 111437 (0.0010) [2023-12-27 20:01:47,334][106226] Updated weights for policy 0, policy_version 111447 (0.0008) [2023-12-27 20:01:47,388][106226] Updated weights for policy 0, policy_version 111457 (0.0006) [2023-12-27 20:01:47,895][106225] Updated weights for policy 1, policy_version 111274 (0.0008) [2023-12-27 20:01:47,952][106225] Updated weights for policy 1, policy_version 111284 (0.0008) [2023-12-27 20:01:48,008][106225] Updated weights for policy 1, policy_version 111294 (0.0008) [2023-12-27 20:01:48,032][106226] Updated weights for policy 0, policy_version 111467 (0.0006) [2023-12-27 20:01:48,096][106226] Updated weights for policy 0, policy_version 111477 (0.0008) [2023-12-27 20:01:48,159][106226] Updated weights for policy 0, policy_version 111487 (0.0009) [2023-12-27 20:01:48,766][106225] Updated weights for policy 1, policy_version 111304 (0.0007) [2023-12-27 20:01:48,815][106225] Updated weights for policy 1, policy_version 111314 (0.0008) [2023-12-27 20:01:48,875][106225] Updated weights for policy 1, policy_version 111324 (0.0008) [2023-12-27 20:01:48,887][106226] Updated weights for policy 0, policy_version 111497 (0.0009) [2023-12-27 20:01:48,938][106226] Updated weights for policy 0, policy_version 111507 (0.0009) [2023-12-27 20:01:48,991][106226] Updated weights for policy 0, policy_version 111517 (0.0008) [2023-12-27 20:01:49,042][106226] Updated weights for policy 0, policy_version 111527 (0.0009) [2023-12-27 20:01:49,557][106225] Updated weights for policy 1, policy_version 111334 (0.0008) [2023-12-27 20:01:49,615][106225] Updated weights for policy 1, policy_version 111344 (0.0009) [2023-12-27 20:01:49,666][106225] Updated weights for policy 1, policy_version 111354 (0.0005) [2023-12-27 20:01:49,837][106226] Updated weights for policy 0, policy_version 111537 (0.0009) [2023-12-27 20:01:49,900][106226] Updated weights for policy 0, policy_version 111547 (0.0010) [2023-12-27 20:01:49,963][106226] Updated weights for policy 0, policy_version 111557 (0.0009) [2023-12-27 20:01:50,407][106225] Updated weights for policy 1, policy_version 111364 (0.0006) [2023-12-27 20:01:50,465][106225] Updated weights for policy 1, policy_version 111374 (0.0005) [2023-12-27 20:01:50,522][106225] Updated weights for policy 1, policy_version 111384 (0.0006) [2023-12-27 20:01:50,655][106226] Updated weights for policy 0, policy_version 111567 (0.0006) [2023-12-27 20:01:50,720][106226] Updated weights for policy 0, policy_version 111577 (0.0006) [2023-12-27 20:01:50,784][106226] Updated weights for policy 0, policy_version 111587 (0.0005) [2023-12-27 20:01:51,174][106225] Updated weights for policy 1, policy_version 111394 (0.0008) [2023-12-27 20:01:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 57098240. Throughput: 0: 10020.1, 1: 9766.4. Samples: 57110708. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:51,175][105115] Avg episode reward: [(0, '-5.547'), (1, '-6.822')] [2023-12-27 20:01:51,230][106225] Updated weights for policy 1, policy_version 111404 (0.0006) [2023-12-27 20:01:51,293][106225] Updated weights for policy 1, policy_version 111414 (0.0010) [2023-12-27 20:01:51,363][106225] Updated weights for policy 1, policy_version 111424 (0.0010) [2023-12-27 20:01:51,405][106226] Updated weights for policy 0, policy_version 111597 (0.0007) [2023-12-27 20:01:51,460][106226] Updated weights for policy 0, policy_version 111607 (0.0008) [2023-12-27 20:01:51,507][106226] Updated weights for policy 0, policy_version 111617 (0.0008) [2023-12-27 20:01:52,122][106225] Updated weights for policy 1, policy_version 111434 (0.0007) [2023-12-27 20:01:52,185][106225] Updated weights for policy 1, policy_version 111444 (0.0010) [2023-12-27 20:01:52,245][106225] Updated weights for policy 1, policy_version 111454 (0.0010) [2023-12-27 20:01:52,256][106226] Updated weights for policy 0, policy_version 111627 (0.0009) [2023-12-27 20:01:52,318][106226] Updated weights for policy 0, policy_version 111637 (0.0008) [2023-12-27 20:01:52,387][106226] Updated weights for policy 0, policy_version 111647 (0.0009) [2023-12-27 20:01:53,030][106225] Updated weights for policy 1, policy_version 111464 (0.0008) [2023-12-27 20:01:53,077][106225] Updated weights for policy 1, policy_version 111474 (0.0005) [2023-12-27 20:01:53,139][106225] Updated weights for policy 1, policy_version 111484 (0.0007) [2023-12-27 20:01:53,173][106226] Updated weights for policy 0, policy_version 111657 (0.0008) [2023-12-27 20:01:53,229][106226] Updated weights for policy 0, policy_version 111667 (0.0008) [2023-12-27 20:01:53,294][106226] Updated weights for policy 0, policy_version 111677 (0.0008) [2023-12-27 20:01:53,348][106226] Updated weights for policy 0, policy_version 111687 (0.0009) [2023-12-27 20:01:53,888][106225] Updated weights for policy 1, policy_version 111494 (0.0009) [2023-12-27 20:01:53,935][106226] Updated weights for policy 0, policy_version 111697 (0.0009) [2023-12-27 20:01:53,947][106225] Updated weights for policy 1, policy_version 111504 (0.0007) [2023-12-27 20:01:53,998][106226] Updated weights for policy 0, policy_version 111707 (0.0006) [2023-12-27 20:01:54,003][106225] Updated weights for policy 1, policy_version 111514 (0.0008) [2023-12-27 20:01:54,058][106226] Updated weights for policy 0, policy_version 111717 (0.0006) [2023-12-27 20:01:54,662][106226] Updated weights for policy 0, policy_version 111727 (0.0009) [2023-12-27 20:01:54,710][106225] Updated weights for policy 1, policy_version 111524 (0.0007) [2023-12-27 20:01:54,722][106226] Updated weights for policy 0, policy_version 111737 (0.0010) [2023-12-27 20:01:54,772][106225] Updated weights for policy 1, policy_version 111534 (0.0008) [2023-12-27 20:01:54,779][106226] Updated weights for policy 0, policy_version 111747 (0.0010) [2023-12-27 20:01:54,841][106225] Updated weights for policy 1, policy_version 111544 (0.0009) [2023-12-27 20:01:55,492][106226] Updated weights for policy 0, policy_version 111757 (0.0010) [2023-12-27 20:01:55,541][106225] Updated weights for policy 1, policy_version 111554 (0.0007) [2023-12-27 20:01:55,551][106226] Updated weights for policy 0, policy_version 111767 (0.0010) [2023-12-27 20:01:55,602][106225] Updated weights for policy 1, policy_version 111564 (0.0008) [2023-12-27 20:01:55,613][106226] Updated weights for policy 0, policy_version 111777 (0.0010) [2023-12-27 20:01:55,656][106225] Updated weights for policy 1, policy_version 111574 (0.0005) [2023-12-27 20:01:55,707][106225] Updated weights for policy 1, policy_version 111584 (0.0005) [2023-12-27 20:01:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 57196544. Throughput: 0: 10074.0, 1: 9695.4. Samples: 57168936. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:01:56,175][105115] Avg episode reward: [(0, '-5.274'), (1, '-6.866')] [2023-12-27 20:01:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000111784_28622848.pth... [2023-12-27 20:01:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000111584_28573696.pth... [2023-12-27 20:01:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000110464_28286976.pth [2023-12-27 20:01:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000110600_28319744.pth [2023-12-27 20:01:56,319][106225] Updated weights for policy 1, policy_version 111594 (0.0010) [2023-12-27 20:01:56,319][106226] Updated weights for policy 0, policy_version 111787 (0.0010) [2023-12-27 20:01:56,373][106225] Updated weights for policy 1, policy_version 111604 (0.0010) [2023-12-27 20:01:56,374][106226] Updated weights for policy 0, policy_version 111797 (0.0010) [2023-12-27 20:01:56,427][106226] Updated weights for policy 0, policy_version 111807 (0.0010) [2023-12-27 20:01:56,435][106225] Updated weights for policy 1, policy_version 111614 (0.0010) [2023-12-27 20:01:57,142][106226] Updated weights for policy 0, policy_version 111817 (0.0010) [2023-12-27 20:01:57,152][106225] Updated weights for policy 1, policy_version 111624 (0.0010) [2023-12-27 20:01:57,191][106226] Updated weights for policy 0, policy_version 111827 (0.0005) [2023-12-27 20:01:57,215][106225] Updated weights for policy 1, policy_version 111634 (0.0008) [2023-12-27 20:01:57,243][106226] Updated weights for policy 0, policy_version 111837 (0.0006) [2023-12-27 20:01:57,271][106225] Updated weights for policy 1, policy_version 111644 (0.0006) [2023-12-27 20:01:57,297][106226] Updated weights for policy 0, policy_version 111847 (0.0010) [2023-12-27 20:01:57,813][106225] Updated weights for policy 1, policy_version 111654 (0.0005) [2023-12-27 20:01:57,870][106225] Updated weights for policy 1, policy_version 111664 (0.0005) [2023-12-27 20:01:57,915][106225] Updated weights for policy 1, policy_version 111674 (0.0005) [2023-12-27 20:01:57,996][106226] Updated weights for policy 0, policy_version 111857 (0.0010) [2023-12-27 20:01:58,069][106226] Updated weights for policy 0, policy_version 111867 (0.0010) [2023-12-27 20:01:58,125][106226] Updated weights for policy 0, policy_version 111877 (0.0010) [2023-12-27 20:01:58,544][106225] Updated weights for policy 1, policy_version 111684 (0.0007) [2023-12-27 20:01:58,606][106225] Updated weights for policy 1, policy_version 111694 (0.0008) [2023-12-27 20:01:58,673][106225] Updated weights for policy 1, policy_version 111704 (0.0008) [2023-12-27 20:01:58,936][106226] Updated weights for policy 0, policy_version 111887 (0.0009) [2023-12-27 20:01:58,996][106226] Updated weights for policy 0, policy_version 111897 (0.0011) [2023-12-27 20:01:59,064][106226] Updated weights for policy 0, policy_version 111907 (0.0011) [2023-12-27 20:01:59,433][106225] Updated weights for policy 1, policy_version 111714 (0.0009) [2023-12-27 20:01:59,492][106225] Updated weights for policy 1, policy_version 111724 (0.0005) [2023-12-27 20:01:59,559][106225] Updated weights for policy 1, policy_version 111734 (0.0008) [2023-12-27 20:01:59,616][106225] Updated weights for policy 1, policy_version 111744 (0.0008) [2023-12-27 20:01:59,922][106226] Updated weights for policy 0, policy_version 111917 (0.0010) [2023-12-27 20:01:59,982][106226] Updated weights for policy 0, policy_version 111927 (0.0009) [2023-12-27 20:02:00,035][106226] Updated weights for policy 0, policy_version 111937 (0.0009) [2023-12-27 20:02:00,286][106225] Updated weights for policy 1, policy_version 111754 (0.0008) [2023-12-27 20:02:00,345][106225] Updated weights for policy 1, policy_version 111764 (0.0008) [2023-12-27 20:02:00,406][106225] Updated weights for policy 1, policy_version 111774 (0.0005) [2023-12-27 20:02:00,741][106226] Updated weights for policy 0, policy_version 111947 (0.0007) [2023-12-27 20:02:00,801][106226] Updated weights for policy 0, policy_version 111957 (0.0005) [2023-12-27 20:02:00,866][106226] Updated weights for policy 0, policy_version 111967 (0.0006) [2023-12-27 20:02:01,062][106225] Updated weights for policy 1, policy_version 111784 (0.0008) [2023-12-27 20:02:01,123][106225] Updated weights for policy 1, policy_version 111794 (0.0008) [2023-12-27 20:02:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 57294848. Throughput: 0: 10056.0, 1: 9799.9. Samples: 57287460. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:02:01,175][105115] Avg episode reward: [(0, '-5.113'), (1, '-6.642')] [2023-12-27 20:02:01,190][106225] Updated weights for policy 1, policy_version 111804 (0.0007) [2023-12-27 20:02:01,513][106226] Updated weights for policy 0, policy_version 111977 (0.0009) [2023-12-27 20:02:01,563][106226] Updated weights for policy 0, policy_version 111987 (0.0009) [2023-12-27 20:02:01,623][106226] Updated weights for policy 0, policy_version 111997 (0.0009) [2023-12-27 20:02:01,686][106226] Updated weights for policy 0, policy_version 112007 (0.0009) [2023-12-27 20:02:01,916][106225] Updated weights for policy 1, policy_version 111814 (0.0009) [2023-12-27 20:02:01,980][106225] Updated weights for policy 1, policy_version 111824 (0.0009) [2023-12-27 20:02:02,035][106225] Updated weights for policy 1, policy_version 111834 (0.0008) [2023-12-27 20:02:02,431][106226] Updated weights for policy 0, policy_version 112017 (0.0005) [2023-12-27 20:02:02,493][106226] Updated weights for policy 0, policy_version 112027 (0.0008) [2023-12-27 20:02:02,552][106226] Updated weights for policy 0, policy_version 112037 (0.0009) [2023-12-27 20:02:02,812][106225] Updated weights for policy 1, policy_version 111844 (0.0008) [2023-12-27 20:02:02,874][106225] Updated weights for policy 1, policy_version 111854 (0.0009) [2023-12-27 20:02:02,934][106225] Updated weights for policy 1, policy_version 111864 (0.0007) [2023-12-27 20:02:03,135][106226] Updated weights for policy 0, policy_version 112047 (0.0006) [2023-12-27 20:02:03,195][106226] Updated weights for policy 0, policy_version 112057 (0.0005) [2023-12-27 20:02:03,251][106226] Updated weights for policy 0, policy_version 112067 (0.0005) [2023-12-27 20:02:03,693][106225] Updated weights for policy 1, policy_version 111874 (0.0005) [2023-12-27 20:02:03,750][106225] Updated weights for policy 1, policy_version 111884 (0.0009) [2023-12-27 20:02:03,763][106226] Updated weights for policy 0, policy_version 112077 (0.0005) [2023-12-27 20:02:03,796][106225] Updated weights for policy 1, policy_version 111894 (0.0006) [2023-12-27 20:02:03,829][106226] Updated weights for policy 0, policy_version 112087 (0.0007) [2023-12-27 20:02:03,845][106225] Updated weights for policy 1, policy_version 111904 (0.0007) [2023-12-27 20:02:03,892][106226] Updated weights for policy 0, policy_version 112097 (0.0008) [2023-12-27 20:02:04,565][106226] Updated weights for policy 0, policy_version 112107 (0.0008) [2023-12-27 20:02:04,619][106226] Updated weights for policy 0, policy_version 112117 (0.0007) [2023-12-27 20:02:04,642][106225] Updated weights for policy 1, policy_version 111914 (0.0009) [2023-12-27 20:02:04,674][106226] Updated weights for policy 0, policy_version 112127 (0.0007) [2023-12-27 20:02:04,706][106225] Updated weights for policy 1, policy_version 111924 (0.0007) [2023-12-27 20:02:04,764][106225] Updated weights for policy 1, policy_version 111934 (0.0007) [2023-12-27 20:02:05,379][106226] Updated weights for policy 0, policy_version 112137 (0.0006) [2023-12-27 20:02:05,435][106226] Updated weights for policy 0, policy_version 112147 (0.0009) [2023-12-27 20:02:05,481][106225] Updated weights for policy 1, policy_version 111944 (0.0007) [2023-12-27 20:02:05,491][106226] Updated weights for policy 0, policy_version 112157 (0.0006) [2023-12-27 20:02:05,529][106225] Updated weights for policy 1, policy_version 111954 (0.0006) [2023-12-27 20:02:05,546][106226] Updated weights for policy 0, policy_version 112167 (0.0008) [2023-12-27 20:02:05,578][106225] Updated weights for policy 1, policy_version 111964 (0.0007) [2023-12-27 20:02:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 57393152. Throughput: 0: 10121.0, 1: 9758.9. Samples: 57407968. Policy #0 lag: (min: 12.0, avg: 21.1, max: 44.0) [2023-12-27 20:02:06,175][105115] Avg episode reward: [(0, '-5.145'), (1, '-6.782')] [2023-12-27 20:02:06,205][106226] Updated weights for policy 0, policy_version 112177 (0.0009) [2023-12-27 20:02:06,268][106226] Updated weights for policy 0, policy_version 112187 (0.0009) [2023-12-27 20:02:06,322][106225] Updated weights for policy 1, policy_version 111974 (0.0008) [2023-12-27 20:02:06,328][106226] Updated weights for policy 0, policy_version 112197 (0.0007) [2023-12-27 20:02:06,383][106225] Updated weights for policy 1, policy_version 111984 (0.0008) [2023-12-27 20:02:06,447][106225] Updated weights for policy 1, policy_version 111994 (0.0008) [2023-12-27 20:02:07,083][106226] Updated weights for policy 0, policy_version 112207 (0.0008) [2023-12-27 20:02:07,142][106225] Updated weights for policy 1, policy_version 112004 (0.0007) [2023-12-27 20:02:07,151][106226] Updated weights for policy 0, policy_version 112217 (0.0009) [2023-12-27 20:02:07,190][106225] Updated weights for policy 1, policy_version 112014 (0.0009) [2023-12-27 20:02:07,207][106226] Updated weights for policy 0, policy_version 112227 (0.0009) [2023-12-27 20:02:07,244][106225] Updated weights for policy 1, policy_version 112024 (0.0010) [2023-12-27 20:02:07,911][106225] Updated weights for policy 1, policy_version 112034 (0.0009) [2023-12-27 20:02:07,951][106226] Updated weights for policy 0, policy_version 112237 (0.0006) [2023-12-27 20:02:07,972][106225] Updated weights for policy 1, policy_version 112044 (0.0005) [2023-12-27 20:02:08,014][106226] Updated weights for policy 0, policy_version 112247 (0.0007) [2023-12-27 20:02:08,032][106225] Updated weights for policy 1, policy_version 112054 (0.0008) [2023-12-27 20:02:08,067][106226] Updated weights for policy 0, policy_version 112257 (0.0006) [2023-12-27 20:02:08,088][106225] Updated weights for policy 1, policy_version 112064 (0.0008) [2023-12-27 20:02:08,778][106225] Updated weights for policy 1, policy_version 112074 (0.0005) [2023-12-27 20:02:08,796][106226] Updated weights for policy 0, policy_version 112267 (0.0008) [2023-12-27 20:02:08,839][106225] Updated weights for policy 1, policy_version 112084 (0.0006) [2023-12-27 20:02:08,846][106226] Updated weights for policy 0, policy_version 112277 (0.0007) [2023-12-27 20:02:08,899][106225] Updated weights for policy 1, policy_version 112094 (0.0008) [2023-12-27 20:02:08,901][106226] Updated weights for policy 0, policy_version 112287 (0.0006) [2023-12-27 20:02:09,545][106225] Updated weights for policy 1, policy_version 112104 (0.0010) [2023-12-27 20:02:09,607][106225] Updated weights for policy 1, policy_version 112114 (0.0011) [2023-12-27 20:02:09,665][106225] Updated weights for policy 1, policy_version 112124 (0.0011) [2023-12-27 20:02:09,728][106226] Updated weights for policy 0, policy_version 112297 (0.0007) [2023-12-27 20:02:09,797][106226] Updated weights for policy 0, policy_version 112307 (0.0007) [2023-12-27 20:02:09,871][106226] Updated weights for policy 0, policy_version 112317 (0.0008) [2023-12-27 20:02:09,940][106226] Updated weights for policy 0, policy_version 112327 (0.0007) [2023-12-27 20:02:10,395][106225] Updated weights for policy 1, policy_version 112134 (0.0008) [2023-12-27 20:02:10,459][106225] Updated weights for policy 1, policy_version 112144 (0.0005) [2023-12-27 20:02:10,534][106225] Updated weights for policy 1, policy_version 112154 (0.0005) [2023-12-27 20:02:10,646][106226] Updated weights for policy 0, policy_version 112337 (0.0007) [2023-12-27 20:02:10,705][106226] Updated weights for policy 0, policy_version 112347 (0.0008) [2023-12-27 20:02:10,764][106226] Updated weights for policy 0, policy_version 112357 (0.0008) [2023-12-27 20:02:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 57491456. Throughput: 0: 10082.1, 1: 9818.7. Samples: 57465684. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:11,175][105115] Avg episode reward: [(0, '-4.950'), (1, '-6.694')] [2023-12-27 20:02:11,181][106225] Updated weights for policy 1, policy_version 112164 (0.0007) [2023-12-27 20:02:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000112360_28770304.pth... [2023-12-27 20:02:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000111208_28475392.pth [2023-12-27 20:02:11,236][106225] Updated weights for policy 1, policy_version 112174 (0.0008) [2023-12-27 20:02:11,301][106225] Updated weights for policy 1, policy_version 112184 (0.0008) [2023-12-27 20:02:11,356][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000112192_28729344.pth... [2023-12-27 20:02:11,361][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000111008_28426240.pth [2023-12-27 20:02:11,546][106226] Updated weights for policy 0, policy_version 112367 (0.0007) [2023-12-27 20:02:11,611][106226] Updated weights for policy 0, policy_version 112377 (0.0009) [2023-12-27 20:02:11,678][106226] Updated weights for policy 0, policy_version 112387 (0.0009) [2023-12-27 20:02:12,082][106225] Updated weights for policy 1, policy_version 112194 (0.0009) [2023-12-27 20:02:12,140][106225] Updated weights for policy 1, policy_version 112204 (0.0009) [2023-12-27 20:02:12,200][106225] Updated weights for policy 1, policy_version 112214 (0.0007) [2023-12-27 20:02:12,257][106225] Updated weights for policy 1, policy_version 112224 (0.0007) [2023-12-27 20:02:12,353][106226] Updated weights for policy 0, policy_version 112397 (0.0008) [2023-12-27 20:02:12,418][106226] Updated weights for policy 0, policy_version 112407 (0.0008) [2023-12-27 20:02:12,491][106226] Updated weights for policy 0, policy_version 112417 (0.0006) [2023-12-27 20:02:12,986][106225] Updated weights for policy 1, policy_version 112234 (0.0007) [2023-12-27 20:02:13,051][106225] Updated weights for policy 1, policy_version 112244 (0.0008) [2023-12-27 20:02:13,055][106226] Updated weights for policy 0, policy_version 112427 (0.0007) [2023-12-27 20:02:13,095][106225] Updated weights for policy 1, policy_version 112254 (0.0009) [2023-12-27 20:02:13,104][106226] Updated weights for policy 0, policy_version 112437 (0.0008) [2023-12-27 20:02:13,153][106226] Updated weights for policy 0, policy_version 112447 (0.0005) [2023-12-27 20:02:13,719][106226] Updated weights for policy 0, policy_version 112457 (0.0006) [2023-12-27 20:02:13,788][106226] Updated weights for policy 0, policy_version 112467 (0.0008) [2023-12-27 20:02:13,850][106226] Updated weights for policy 0, policy_version 112477 (0.0008) [2023-12-27 20:02:13,896][106225] Updated weights for policy 1, policy_version 112264 (0.0006) [2023-12-27 20:02:13,903][106226] Updated weights for policy 0, policy_version 112487 (0.0006) [2023-12-27 20:02:13,948][106225] Updated weights for policy 1, policy_version 112274 (0.0009) [2023-12-27 20:02:13,997][106225] Updated weights for policy 1, policy_version 112284 (0.0007) [2023-12-27 20:02:14,565][106226] Updated weights for policy 0, policy_version 112497 (0.0007) [2023-12-27 20:02:14,612][106226] Updated weights for policy 0, policy_version 112507 (0.0008) [2023-12-27 20:02:14,658][106226] Updated weights for policy 0, policy_version 112517 (0.0008) [2023-12-27 20:02:14,736][106225] Updated weights for policy 1, policy_version 112294 (0.0009) [2023-12-27 20:02:14,815][106225] Updated weights for policy 1, policy_version 112304 (0.0008) [2023-12-27 20:02:14,879][106225] Updated weights for policy 1, policy_version 112314 (0.0006) [2023-12-27 20:02:15,478][106226] Updated weights for policy 0, policy_version 112527 (0.0010) [2023-12-27 20:02:15,533][106226] Updated weights for policy 0, policy_version 112537 (0.0011) [2023-12-27 20:02:15,536][106225] Updated weights for policy 1, policy_version 112324 (0.0009) [2023-12-27 20:02:15,587][106226] Updated weights for policy 0, policy_version 112547 (0.0011) [2023-12-27 20:02:15,593][106225] Updated weights for policy 1, policy_version 112334 (0.0010) [2023-12-27 20:02:15,653][106225] Updated weights for policy 1, policy_version 112344 (0.0010) [2023-12-27 20:02:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 57589760. Throughput: 0: 9967.2, 1: 9805.5. Samples: 57582744. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:16,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-6.647')] [2023-12-27 20:02:16,265][106225] Updated weights for policy 1, policy_version 112354 (0.0009) [2023-12-27 20:02:16,312][106226] Updated weights for policy 0, policy_version 112557 (0.0010) [2023-12-27 20:02:16,319][106225] Updated weights for policy 1, policy_version 112364 (0.0010) [2023-12-27 20:02:16,370][106226] Updated weights for policy 0, policy_version 112567 (0.0009) [2023-12-27 20:02:16,376][106225] Updated weights for policy 1, policy_version 112374 (0.0010) [2023-12-27 20:02:16,429][106225] Updated weights for policy 1, policy_version 112384 (0.0010) [2023-12-27 20:02:16,429][106226] Updated weights for policy 0, policy_version 112577 (0.0010) [2023-12-27 20:02:17,103][106226] Updated weights for policy 0, policy_version 112587 (0.0011) [2023-12-27 20:02:17,154][106225] Updated weights for policy 1, policy_version 112394 (0.0010) [2023-12-27 20:02:17,163][106226] Updated weights for policy 0, policy_version 112597 (0.0010) [2023-12-27 20:02:17,212][106225] Updated weights for policy 1, policy_version 112404 (0.0010) [2023-12-27 20:02:17,219][106226] Updated weights for policy 0, policy_version 112607 (0.0011) [2023-12-27 20:02:17,276][106225] Updated weights for policy 1, policy_version 112414 (0.0010) [2023-12-27 20:02:17,883][106225] Updated weights for policy 1, policy_version 112424 (0.0010) [2023-12-27 20:02:17,888][106226] Updated weights for policy 0, policy_version 112617 (0.0010) [2023-12-27 20:02:17,937][106225] Updated weights for policy 1, policy_version 112434 (0.0010) [2023-12-27 20:02:17,939][106226] Updated weights for policy 0, policy_version 112627 (0.0005) [2023-12-27 20:02:17,992][106226] Updated weights for policy 0, policy_version 112637 (0.0005) [2023-12-27 20:02:17,994][106225] Updated weights for policy 1, policy_version 112444 (0.0010) [2023-12-27 20:02:18,046][106226] Updated weights for policy 0, policy_version 112647 (0.0011) [2023-12-27 20:02:18,635][106225] Updated weights for policy 1, policy_version 112454 (0.0008) [2023-12-27 20:02:18,669][106226] Updated weights for policy 0, policy_version 112657 (0.0007) [2023-12-27 20:02:18,687][106225] Updated weights for policy 1, policy_version 112464 (0.0006) [2023-12-27 20:02:18,729][106226] Updated weights for policy 0, policy_version 112667 (0.0007) [2023-12-27 20:02:18,740][106225] Updated weights for policy 1, policy_version 112474 (0.0006) [2023-12-27 20:02:18,792][106226] Updated weights for policy 0, policy_version 112677 (0.0010) [2023-12-27 20:02:19,501][106226] Updated weights for policy 0, policy_version 112687 (0.0009) [2023-12-27 20:02:19,534][106225] Updated weights for policy 1, policy_version 112484 (0.0009) [2023-12-27 20:02:19,566][106226] Updated weights for policy 0, policy_version 112697 (0.0008) [2023-12-27 20:02:19,596][106225] Updated weights for policy 1, policy_version 112494 (0.0006) [2023-12-27 20:02:19,613][106226] Updated weights for policy 0, policy_version 112707 (0.0007) [2023-12-27 20:02:19,655][106225] Updated weights for policy 1, policy_version 112504 (0.0005) [2023-12-27 20:02:20,339][106225] Updated weights for policy 1, policy_version 112514 (0.0009) [2023-12-27 20:02:20,402][106225] Updated weights for policy 1, policy_version 112524 (0.0007) [2023-12-27 20:02:20,415][106226] Updated weights for policy 0, policy_version 112717 (0.0008) [2023-12-27 20:02:20,465][106225] Updated weights for policy 1, policy_version 112534 (0.0008) [2023-12-27 20:02:20,475][106226] Updated weights for policy 0, policy_version 112727 (0.0006) [2023-12-27 20:02:20,532][106225] Updated weights for policy 1, policy_version 112544 (0.0008) [2023-12-27 20:02:20,533][106226] Updated weights for policy 0, policy_version 112737 (0.0006) [2023-12-27 20:02:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 57688064. Throughput: 0: 9897.1, 1: 9808.2. Samples: 57702356. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:21,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-6.970')] [2023-12-27 20:02:21,258][106226] Updated weights for policy 0, policy_version 112747 (0.0007) [2023-12-27 20:02:21,270][106225] Updated weights for policy 1, policy_version 112554 (0.0008) [2023-12-27 20:02:21,334][106226] Updated weights for policy 0, policy_version 112757 (0.0008) [2023-12-27 20:02:21,358][106225] Updated weights for policy 1, policy_version 112565 (0.0008) [2023-12-27 20:02:21,409][106226] Updated weights for policy 0, policy_version 112767 (0.0011) [2023-12-27 20:02:21,431][106225] Updated weights for policy 1, policy_version 112575 (0.0008) [2023-12-27 20:02:22,083][106226] Updated weights for policy 0, policy_version 112777 (0.0010) [2023-12-27 20:02:22,154][106226] Updated weights for policy 0, policy_version 112787 (0.0006) [2023-12-27 20:02:22,179][106225] Updated weights for policy 1, policy_version 112585 (0.0009) [2023-12-27 20:02:22,218][106226] Updated weights for policy 0, policy_version 112797 (0.0006) [2023-12-27 20:02:22,238][106225] Updated weights for policy 1, policy_version 112595 (0.0008) [2023-12-27 20:02:22,279][106226] Updated weights for policy 0, policy_version 112807 (0.0007) [2023-12-27 20:02:22,297][106225] Updated weights for policy 1, policy_version 112605 (0.0007) [2023-12-27 20:02:22,958][106226] Updated weights for policy 0, policy_version 112817 (0.0008) [2023-12-27 20:02:23,014][106226] Updated weights for policy 0, policy_version 112827 (0.0009) [2023-12-27 20:02:23,056][106225] Updated weights for policy 1, policy_version 112615 (0.0006) [2023-12-27 20:02:23,071][106226] Updated weights for policy 0, policy_version 112837 (0.0006) [2023-12-27 20:02:23,119][106225] Updated weights for policy 1, policy_version 112625 (0.0009) [2023-12-27 20:02:23,181][106225] Updated weights for policy 1, policy_version 112635 (0.0007) [2023-12-27 20:02:23,735][106226] Updated weights for policy 0, policy_version 112847 (0.0006) [2023-12-27 20:02:23,756][106225] Updated weights for policy 1, policy_version 112645 (0.0005) [2023-12-27 20:02:23,784][106226] Updated weights for policy 0, policy_version 112857 (0.0005) [2023-12-27 20:02:23,819][106225] Updated weights for policy 1, policy_version 112655 (0.0005) [2023-12-27 20:02:23,838][106226] Updated weights for policy 0, policy_version 112867 (0.0005) [2023-12-27 20:02:23,880][106225] Updated weights for policy 1, policy_version 112665 (0.0007) [2023-12-27 20:02:24,437][106225] Updated weights for policy 1, policy_version 112675 (0.0007) [2023-12-27 20:02:24,450][106226] Updated weights for policy 0, policy_version 112877 (0.0005) [2023-12-27 20:02:24,501][106225] Updated weights for policy 1, policy_version 112685 (0.0005) [2023-12-27 20:02:24,510][106226] Updated weights for policy 0, policy_version 112887 (0.0008) [2023-12-27 20:02:24,556][106225] Updated weights for policy 1, policy_version 112695 (0.0005) [2023-12-27 20:02:24,563][106226] Updated weights for policy 0, policy_version 112897 (0.0008) [2023-12-27 20:02:25,091][106225] Updated weights for policy 1, policy_version 112705 (0.0005) [2023-12-27 20:02:25,150][106225] Updated weights for policy 1, policy_version 112715 (0.0006) [2023-12-27 20:02:25,193][106225] Updated weights for policy 1, policy_version 112725 (0.0010) [2023-12-27 20:02:25,239][106225] Updated weights for policy 1, policy_version 112735 (0.0010) [2023-12-27 20:02:25,362][106226] Updated weights for policy 0, policy_version 112907 (0.0008) [2023-12-27 20:02:25,423][106226] Updated weights for policy 0, policy_version 112917 (0.0009) [2023-12-27 20:02:25,483][106226] Updated weights for policy 0, policy_version 112927 (0.0008) [2023-12-27 20:02:25,940][106225] Updated weights for policy 1, policy_version 112745 (0.0010) [2023-12-27 20:02:26,003][106225] Updated weights for policy 1, policy_version 112755 (0.0010) [2023-12-27 20:02:26,052][106225] Updated weights for policy 1, policy_version 112765 (0.0008) [2023-12-27 20:02:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 57794560. Throughput: 0: 9888.9, 1: 9808.1. Samples: 57762044. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:26,175][105115] Avg episode reward: [(0, '-5.145'), (1, '-7.000')] [2023-12-27 20:02:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000112768_28876800.pth... [2023-12-27 20:02:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000112936_28917760.pth... [2023-12-27 20:02:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000111584_28573696.pth [2023-12-27 20:02:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000111784_28622848.pth [2023-12-27 20:02:26,216][106226] Updated weights for policy 0, policy_version 112937 (0.0007) [2023-12-27 20:02:26,275][106226] Updated weights for policy 0, policy_version 112947 (0.0005) [2023-12-27 20:02:26,333][106226] Updated weights for policy 0, policy_version 112957 (0.0005) [2023-12-27 20:02:26,392][106226] Updated weights for policy 0, policy_version 112967 (0.0005) [2023-12-27 20:02:26,748][106225] Updated weights for policy 1, policy_version 112775 (0.0008) [2023-12-27 20:02:26,799][106225] Updated weights for policy 1, policy_version 112785 (0.0006) [2023-12-27 20:02:26,847][106225] Updated weights for policy 1, policy_version 112795 (0.0005) [2023-12-27 20:02:26,883][106226] Updated weights for policy 0, policy_version 112977 (0.0005) [2023-12-27 20:02:26,936][106226] Updated weights for policy 0, policy_version 112987 (0.0007) [2023-12-27 20:02:27,025][106226] Updated weights for policy 0, policy_version 112997 (0.0009) [2023-12-27 20:02:27,432][106225] Updated weights for policy 1, policy_version 112805 (0.0007) [2023-12-27 20:02:27,498][106225] Updated weights for policy 1, policy_version 112815 (0.0006) [2023-12-27 20:02:27,548][106225] Updated weights for policy 1, policy_version 112825 (0.0005) [2023-12-27 20:02:27,601][106226] Updated weights for policy 0, policy_version 113007 (0.0006) [2023-12-27 20:02:27,656][106226] Updated weights for policy 0, policy_version 113017 (0.0005) [2023-12-27 20:02:27,704][106226] Updated weights for policy 0, policy_version 113027 (0.0005) [2023-12-27 20:02:28,115][106225] Updated weights for policy 1, policy_version 112835 (0.0007) [2023-12-27 20:02:28,171][106225] Updated weights for policy 1, policy_version 112845 (0.0010) [2023-12-27 20:02:28,226][106225] Updated weights for policy 1, policy_version 112855 (0.0009) [2023-12-27 20:02:28,281][106226] Updated weights for policy 0, policy_version 113037 (0.0006) [2023-12-27 20:02:28,331][106226] Updated weights for policy 0, policy_version 113047 (0.0007) [2023-12-27 20:02:28,393][106226] Updated weights for policy 0, policy_version 113057 (0.0007) [2023-12-27 20:02:28,810][106225] Updated weights for policy 1, policy_version 112865 (0.0010) [2023-12-27 20:02:28,865][106225] Updated weights for policy 1, policy_version 112875 (0.0005) [2023-12-27 20:02:28,926][106225] Updated weights for policy 1, policy_version 112885 (0.0005) [2023-12-27 20:02:28,975][106225] Updated weights for policy 1, policy_version 112895 (0.0008) [2023-12-27 20:02:29,163][106226] Updated weights for policy 0, policy_version 113067 (0.0008) [2023-12-27 20:02:29,228][106226] Updated weights for policy 0, policy_version 113077 (0.0010) [2023-12-27 20:02:29,286][106226] Updated weights for policy 0, policy_version 113087 (0.0010) [2023-12-27 20:02:29,646][106225] Updated weights for policy 1, policy_version 112905 (0.0010) [2023-12-27 20:02:29,701][106225] Updated weights for policy 1, policy_version 112915 (0.0010) [2023-12-27 20:02:29,766][106225] Updated weights for policy 1, policy_version 112925 (0.0010) [2023-12-27 20:02:29,939][106226] Updated weights for policy 0, policy_version 113097 (0.0010) [2023-12-27 20:02:29,998][106226] Updated weights for policy 0, policy_version 113107 (0.0007) [2023-12-27 20:02:30,064][106226] Updated weights for policy 0, policy_version 113117 (0.0007) [2023-12-27 20:02:30,124][106226] Updated weights for policy 0, policy_version 113127 (0.0008) [2023-12-27 20:02:30,475][106225] Updated weights for policy 1, policy_version 112935 (0.0010) [2023-12-27 20:02:30,538][106225] Updated weights for policy 1, policy_version 112945 (0.0010) [2023-12-27 20:02:30,591][106225] Updated weights for policy 1, policy_version 112955 (0.0010) [2023-12-27 20:02:30,806][106226] Updated weights for policy 0, policy_version 113137 (0.0007) [2023-12-27 20:02:30,864][106226] Updated weights for policy 0, policy_version 113147 (0.0008) [2023-12-27 20:02:30,918][106226] Updated weights for policy 0, policy_version 113157 (0.0008) [2023-12-27 20:02:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 57901056. Throughput: 0: 10014.3, 1: 9985.1. Samples: 57891020. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:31,175][105115] Avg episode reward: [(0, '-5.619'), (1, '-6.946')] [2023-12-27 20:02:31,231][106225] Updated weights for policy 1, policy_version 112965 (0.0008) [2023-12-27 20:02:31,297][106225] Updated weights for policy 1, policy_version 112975 (0.0010) [2023-12-27 20:02:31,367][106225] Updated weights for policy 1, policy_version 112985 (0.0010) [2023-12-27 20:02:31,672][106226] Updated weights for policy 0, policy_version 113167 (0.0009) [2023-12-27 20:02:31,729][106226] Updated weights for policy 0, policy_version 113177 (0.0009) [2023-12-27 20:02:31,783][106226] Updated weights for policy 0, policy_version 113187 (0.0009) [2023-12-27 20:02:32,019][106225] Updated weights for policy 1, policy_version 112995 (0.0008) [2023-12-27 20:02:32,078][106225] Updated weights for policy 1, policy_version 113005 (0.0007) [2023-12-27 20:02:32,141][106225] Updated weights for policy 1, policy_version 113015 (0.0008) [2023-12-27 20:02:32,609][106226] Updated weights for policy 0, policy_version 113197 (0.0009) [2023-12-27 20:02:32,680][106226] Updated weights for policy 0, policy_version 113207 (0.0009) [2023-12-27 20:02:32,737][106225] Updated weights for policy 1, policy_version 113025 (0.0009) [2023-12-27 20:02:32,743][106226] Updated weights for policy 0, policy_version 113217 (0.0008) [2023-12-27 20:02:32,799][106225] Updated weights for policy 1, policy_version 113035 (0.0007) [2023-12-27 20:02:32,856][106225] Updated weights for policy 1, policy_version 113045 (0.0007) [2023-12-27 20:02:32,902][106225] Updated weights for policy 1, policy_version 113055 (0.0010) [2023-12-27 20:02:33,435][106226] Updated weights for policy 0, policy_version 113227 (0.0006) [2023-12-27 20:02:33,500][106226] Updated weights for policy 0, policy_version 113237 (0.0008) [2023-12-27 20:02:33,536][106225] Updated weights for policy 1, policy_version 113065 (0.0010) [2023-12-27 20:02:33,553][106226] Updated weights for policy 0, policy_version 113247 (0.0005) [2023-12-27 20:02:33,582][106225] Updated weights for policy 1, policy_version 113075 (0.0010) [2023-12-27 20:02:33,627][106225] Updated weights for policy 1, policy_version 113085 (0.0008) [2023-12-27 20:02:34,193][106225] Updated weights for policy 1, policy_version 113095 (0.0008) [2023-12-27 20:02:34,248][106225] Updated weights for policy 1, policy_version 113105 (0.0010) [2023-12-27 20:02:34,263][106226] Updated weights for policy 0, policy_version 113257 (0.0006) [2023-12-27 20:02:34,302][106225] Updated weights for policy 1, policy_version 113115 (0.0010) [2023-12-27 20:02:34,328][106226] Updated weights for policy 0, policy_version 113267 (0.0006) [2023-12-27 20:02:34,392][106226] Updated weights for policy 0, policy_version 113277 (0.0008) [2023-12-27 20:02:34,458][106226] Updated weights for policy 0, policy_version 113287 (0.0008) [2023-12-27 20:02:34,934][106225] Updated weights for policy 1, policy_version 113125 (0.0008) [2023-12-27 20:02:34,981][106225] Updated weights for policy 1, policy_version 113135 (0.0005) [2023-12-27 20:02:35,038][106225] Updated weights for policy 1, policy_version 113145 (0.0005) [2023-12-27 20:02:35,150][106226] Updated weights for policy 0, policy_version 113297 (0.0008) [2023-12-27 20:02:35,213][106226] Updated weights for policy 0, policy_version 113307 (0.0010) [2023-12-27 20:02:35,267][106226] Updated weights for policy 0, policy_version 113317 (0.0009) [2023-12-27 20:02:35,646][106225] Updated weights for policy 1, policy_version 113155 (0.0007) [2023-12-27 20:02:35,712][106225] Updated weights for policy 1, policy_version 113165 (0.0007) [2023-12-27 20:02:35,763][106225] Updated weights for policy 1, policy_version 113175 (0.0007) [2023-12-27 20:02:36,023][106226] Updated weights for policy 0, policy_version 113327 (0.0009) [2023-12-27 20:02:36,078][106226] Updated weights for policy 0, policy_version 113337 (0.0008) [2023-12-27 20:02:36,141][106226] Updated weights for policy 0, policy_version 113347 (0.0008) [2023-12-27 20:02:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58007552. Throughput: 0: 9919.5, 1: 10132.0. Samples: 58013024. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:36,175][105115] Avg episode reward: [(0, '-5.466'), (1, '-6.874')] [2023-12-27 20:02:36,418][106225] Updated weights for policy 1, policy_version 113185 (0.0010) [2023-12-27 20:02:36,482][106225] Updated weights for policy 1, policy_version 113195 (0.0007) [2023-12-27 20:02:36,550][106225] Updated weights for policy 1, policy_version 113205 (0.0007) [2023-12-27 20:02:36,614][106225] Updated weights for policy 1, policy_version 113215 (0.0009) [2023-12-27 20:02:36,964][106226] Updated weights for policy 0, policy_version 113357 (0.0008) [2023-12-27 20:02:37,028][106226] Updated weights for policy 0, policy_version 113367 (0.0008) [2023-12-27 20:02:37,094][106226] Updated weights for policy 0, policy_version 113377 (0.0008) [2023-12-27 20:02:37,215][106225] Updated weights for policy 1, policy_version 113225 (0.0010) [2023-12-27 20:02:37,282][106225] Updated weights for policy 1, policy_version 113235 (0.0010) [2023-12-27 20:02:37,345][106225] Updated weights for policy 1, policy_version 113245 (0.0010) [2023-12-27 20:02:37,681][106226] Updated weights for policy 0, policy_version 113387 (0.0007) [2023-12-27 20:02:37,735][106226] Updated weights for policy 0, policy_version 113397 (0.0006) [2023-12-27 20:02:37,786][106226] Updated weights for policy 0, policy_version 113407 (0.0005) [2023-12-27 20:02:38,018][106225] Updated weights for policy 1, policy_version 113255 (0.0010) [2023-12-27 20:02:38,066][106225] Updated weights for policy 1, policy_version 113265 (0.0009) [2023-12-27 20:02:38,115][106225] Updated weights for policy 1, policy_version 113275 (0.0006) [2023-12-27 20:02:38,394][106226] Updated weights for policy 0, policy_version 113417 (0.0006) [2023-12-27 20:02:38,463][106226] Updated weights for policy 0, policy_version 113427 (0.0008) [2023-12-27 20:02:38,523][106226] Updated weights for policy 0, policy_version 113437 (0.0008) [2023-12-27 20:02:38,582][106226] Updated weights for policy 0, policy_version 113447 (0.0009) [2023-12-27 20:02:38,805][106225] Updated weights for policy 1, policy_version 113285 (0.0006) [2023-12-27 20:02:38,857][106225] Updated weights for policy 1, policy_version 113295 (0.0009) [2023-12-27 20:02:38,912][106225] Updated weights for policy 1, policy_version 113305 (0.0009) [2023-12-27 20:02:39,265][106226] Updated weights for policy 0, policy_version 113457 (0.0008) [2023-12-27 20:02:39,327][106226] Updated weights for policy 0, policy_version 113467 (0.0007) [2023-12-27 20:02:39,393][106226] Updated weights for policy 0, policy_version 113477 (0.0009) [2023-12-27 20:02:39,716][106225] Updated weights for policy 1, policy_version 113315 (0.0007) [2023-12-27 20:02:39,766][106225] Updated weights for policy 1, policy_version 113325 (0.0008) [2023-12-27 20:02:39,814][106225] Updated weights for policy 1, policy_version 113335 (0.0008) [2023-12-27 20:02:40,101][106226] Updated weights for policy 0, policy_version 113487 (0.0009) [2023-12-27 20:02:40,168][106226] Updated weights for policy 0, policy_version 113497 (0.0009) [2023-12-27 20:02:40,233][106226] Updated weights for policy 0, policy_version 113507 (0.0008) [2023-12-27 20:02:40,555][106225] Updated weights for policy 1, policy_version 113345 (0.0009) [2023-12-27 20:02:40,607][106225] Updated weights for policy 1, policy_version 113355 (0.0008) [2023-12-27 20:02:40,660][106225] Updated weights for policy 1, policy_version 113365 (0.0006) [2023-12-27 20:02:40,714][106225] Updated weights for policy 1, policy_version 113375 (0.0005) [2023-12-27 20:02:40,970][106226] Updated weights for policy 0, policy_version 113517 (0.0009) [2023-12-27 20:02:41,029][106226] Updated weights for policy 0, policy_version 113527 (0.0007) [2023-12-27 20:02:41,096][106226] Updated weights for policy 0, policy_version 113537 (0.0007) [2023-12-27 20:02:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58105856. Throughput: 0: 9944.9, 1: 10194.7. Samples: 58075216. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:41,175][105115] Avg episode reward: [(0, '-5.401'), (1, '-6.810')] [2023-12-27 20:02:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000113376_29032448.pth... [2023-12-27 20:02:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000113544_29073408.pth... [2023-12-27 20:02:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000112360_28770304.pth [2023-12-27 20:02:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000112192_28729344.pth [2023-12-27 20:02:41,397][106225] Updated weights for policy 1, policy_version 113385 (0.0008) [2023-12-27 20:02:41,462][106225] Updated weights for policy 1, policy_version 113395 (0.0009) [2023-12-27 20:02:41,528][106225] Updated weights for policy 1, policy_version 113405 (0.0007) [2023-12-27 20:02:41,929][106226] Updated weights for policy 0, policy_version 113547 (0.0009) [2023-12-27 20:02:41,990][106226] Updated weights for policy 0, policy_version 113557 (0.0009) [2023-12-27 20:02:42,044][106226] Updated weights for policy 0, policy_version 113567 (0.0008) [2023-12-27 20:02:42,205][106225] Updated weights for policy 1, policy_version 113415 (0.0008) [2023-12-27 20:02:42,262][106225] Updated weights for policy 1, policy_version 113425 (0.0008) [2023-12-27 20:02:42,327][106225] Updated weights for policy 1, policy_version 113435 (0.0008) [2023-12-27 20:02:42,805][106226] Updated weights for policy 0, policy_version 113577 (0.0008) [2023-12-27 20:02:42,870][106226] Updated weights for policy 0, policy_version 113587 (0.0009) [2023-12-27 20:02:42,934][106226] Updated weights for policy 0, policy_version 113597 (0.0009) [2023-12-27 20:02:42,987][106226] Updated weights for policy 0, policy_version 113607 (0.0008) [2023-12-27 20:02:43,037][106225] Updated weights for policy 1, policy_version 113445 (0.0007) [2023-12-27 20:02:43,107][106225] Updated weights for policy 1, policy_version 113455 (0.0007) [2023-12-27 20:02:43,173][106225] Updated weights for policy 1, policy_version 113465 (0.0009) [2023-12-27 20:02:43,704][106226] Updated weights for policy 0, policy_version 113617 (0.0009) [2023-12-27 20:02:43,767][106226] Updated weights for policy 0, policy_version 113627 (0.0010) [2023-12-27 20:02:43,826][106226] Updated weights for policy 0, policy_version 113637 (0.0008) [2023-12-27 20:02:43,842][106225] Updated weights for policy 1, policy_version 113475 (0.0008) [2023-12-27 20:02:43,896][106225] Updated weights for policy 1, policy_version 113485 (0.0010) [2023-12-27 20:02:43,951][106225] Updated weights for policy 1, policy_version 113495 (0.0010) [2023-12-27 20:02:44,548][106226] Updated weights for policy 0, policy_version 113647 (0.0008) [2023-12-27 20:02:44,614][106226] Updated weights for policy 0, policy_version 113657 (0.0008) [2023-12-27 20:02:44,662][106225] Updated weights for policy 1, policy_version 113505 (0.0008) [2023-12-27 20:02:44,673][106226] Updated weights for policy 0, policy_version 113667 (0.0008) [2023-12-27 20:02:44,714][106225] Updated weights for policy 1, policy_version 113515 (0.0007) [2023-12-27 20:02:44,770][106225] Updated weights for policy 1, policy_version 113525 (0.0007) [2023-12-27 20:02:44,837][106225] Updated weights for policy 1, policy_version 113535 (0.0008) [2023-12-27 20:02:45,316][106226] Updated weights for policy 0, policy_version 113677 (0.0009) [2023-12-27 20:02:45,385][106226] Updated weights for policy 0, policy_version 113687 (0.0010) [2023-12-27 20:02:45,448][106226] Updated weights for policy 0, policy_version 113697 (0.0009) [2023-12-27 20:02:45,561][106225] Updated weights for policy 1, policy_version 113545 (0.0008) [2023-12-27 20:02:45,613][106225] Updated weights for policy 1, policy_version 113555 (0.0009) [2023-12-27 20:02:45,660][106225] Updated weights for policy 1, policy_version 113565 (0.0007) [2023-12-27 20:02:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 58195968. Throughput: 0: 9922.4, 1: 10129.2. Samples: 58189780. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:46,175][105115] Avg episode reward: [(0, '-5.444'), (1, '-6.758')] [2023-12-27 20:02:46,244][106226] Updated weights for policy 0, policy_version 113707 (0.0008) [2023-12-27 20:02:46,250][106225] Updated weights for policy 1, policy_version 113575 (0.0006) [2023-12-27 20:02:46,298][106225] Updated weights for policy 1, policy_version 113585 (0.0006) [2023-12-27 20:02:46,303][106226] Updated weights for policy 0, policy_version 113717 (0.0008) [2023-12-27 20:02:46,353][106225] Updated weights for policy 1, policy_version 113595 (0.0005) [2023-12-27 20:02:46,359][106226] Updated weights for policy 0, policy_version 113727 (0.0007) [2023-12-27 20:02:46,959][106225] Updated weights for policy 1, policy_version 113605 (0.0006) [2023-12-27 20:02:47,020][106225] Updated weights for policy 1, policy_version 113615 (0.0007) [2023-12-27 20:02:47,081][106225] Updated weights for policy 1, policy_version 113625 (0.0005) [2023-12-27 20:02:47,162][106226] Updated weights for policy 0, policy_version 113737 (0.0007) [2023-12-27 20:02:47,220][106226] Updated weights for policy 0, policy_version 113747 (0.0010) [2023-12-27 20:02:47,290][106226] Updated weights for policy 0, policy_version 113757 (0.0008) [2023-12-27 20:02:47,347][106226] Updated weights for policy 0, policy_version 113767 (0.0006) [2023-12-27 20:02:47,755][106225] Updated weights for policy 1, policy_version 113635 (0.0006) [2023-12-27 20:02:47,814][106225] Updated weights for policy 1, policy_version 113645 (0.0010) [2023-12-27 20:02:47,879][106225] Updated weights for policy 1, policy_version 113655 (0.0005) [2023-12-27 20:02:48,071][106226] Updated weights for policy 0, policy_version 113777 (0.0008) [2023-12-27 20:02:48,124][106226] Updated weights for policy 0, policy_version 113787 (0.0007) [2023-12-27 20:02:48,177][106226] Updated weights for policy 0, policy_version 113797 (0.0008) [2023-12-27 20:02:48,479][106225] Updated weights for policy 1, policy_version 113665 (0.0006) [2023-12-27 20:02:48,539][106225] Updated weights for policy 1, policy_version 113675 (0.0010) [2023-12-27 20:02:48,597][106225] Updated weights for policy 1, policy_version 113685 (0.0008) [2023-12-27 20:02:48,661][106225] Updated weights for policy 1, policy_version 113695 (0.0010) [2023-12-27 20:02:48,976][106226] Updated weights for policy 0, policy_version 113807 (0.0006) [2023-12-27 20:02:49,028][106226] Updated weights for policy 0, policy_version 113817 (0.0008) [2023-12-27 20:02:49,081][106226] Updated weights for policy 0, policy_version 113827 (0.0009) [2023-12-27 20:02:49,370][106225] Updated weights for policy 1, policy_version 113705 (0.0009) [2023-12-27 20:02:49,428][106225] Updated weights for policy 1, policy_version 113715 (0.0007) [2023-12-27 20:02:49,480][106225] Updated weights for policy 1, policy_version 113725 (0.0009) [2023-12-27 20:02:49,790][106226] Updated weights for policy 0, policy_version 113837 (0.0007) [2023-12-27 20:02:49,849][106226] Updated weights for policy 0, policy_version 113847 (0.0007) [2023-12-27 20:02:49,904][106226] Updated weights for policy 0, policy_version 113857 (0.0006) [2023-12-27 20:02:50,281][106225] Updated weights for policy 1, policy_version 113735 (0.0008) [2023-12-27 20:02:50,342][106225] Updated weights for policy 1, policy_version 113745 (0.0008) [2023-12-27 20:02:50,409][106225] Updated weights for policy 1, policy_version 113755 (0.0007) [2023-12-27 20:02:50,577][106226] Updated weights for policy 0, policy_version 113867 (0.0008) [2023-12-27 20:02:50,649][106226] Updated weights for policy 0, policy_version 113877 (0.0008) [2023-12-27 20:02:50,720][106226] Updated weights for policy 0, policy_version 113887 (0.0011) [2023-12-27 20:02:51,009][106225] Updated weights for policy 1, policy_version 113765 (0.0007) [2023-12-27 20:02:51,080][106225] Updated weights for policy 1, policy_version 113775 (0.0008) [2023-12-27 20:02:51,146][106225] Updated weights for policy 1, policy_version 113785 (0.0009) [2023-12-27 20:02:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 58294272. Throughput: 0: 9773.2, 1: 10233.9. Samples: 58308288. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:51,175][105115] Avg episode reward: [(0, '-5.395'), (1, '-6.812')] [2023-12-27 20:02:51,463][106226] Updated weights for policy 0, policy_version 113897 (0.0010) [2023-12-27 20:02:51,517][106226] Updated weights for policy 0, policy_version 113907 (0.0006) [2023-12-27 20:02:51,587][106226] Updated weights for policy 0, policy_version 113917 (0.0009) [2023-12-27 20:02:51,658][106226] Updated weights for policy 0, policy_version 113927 (0.0007) [2023-12-27 20:02:51,887][106225] Updated weights for policy 1, policy_version 113795 (0.0009) [2023-12-27 20:02:51,936][106225] Updated weights for policy 1, policy_version 113805 (0.0008) [2023-12-27 20:02:51,984][106225] Updated weights for policy 1, policy_version 113815 (0.0010) [2023-12-27 20:02:52,372][106226] Updated weights for policy 0, policy_version 113937 (0.0007) [2023-12-27 20:02:52,426][106226] Updated weights for policy 0, policy_version 113947 (0.0006) [2023-12-27 20:02:52,488][106226] Updated weights for policy 0, policy_version 113957 (0.0006) [2023-12-27 20:02:52,801][106225] Updated weights for policy 1, policy_version 113825 (0.0009) [2023-12-27 20:02:52,860][106225] Updated weights for policy 1, policy_version 113835 (0.0009) [2023-12-27 20:02:52,953][106225] Updated weights for policy 1, policy_version 113845 (0.0009) [2023-12-27 20:02:53,009][106225] Updated weights for policy 1, policy_version 113855 (0.0007) [2023-12-27 20:02:53,088][106226] Updated weights for policy 0, policy_version 113967 (0.0005) [2023-12-27 20:02:53,134][106226] Updated weights for policy 0, policy_version 113977 (0.0005) [2023-12-27 20:02:53,186][106226] Updated weights for policy 0, policy_version 113987 (0.0007) [2023-12-27 20:02:53,698][106225] Updated weights for policy 1, policy_version 113865 (0.0007) [2023-12-27 20:02:53,750][106225] Updated weights for policy 1, policy_version 113875 (0.0008) [2023-12-27 20:02:53,803][106225] Updated weights for policy 1, policy_version 113885 (0.0008) [2023-12-27 20:02:53,879][106226] Updated weights for policy 0, policy_version 113997 (0.0008) [2023-12-27 20:02:53,931][106226] Updated weights for policy 0, policy_version 114007 (0.0005) [2023-12-27 20:02:54,003][106226] Updated weights for policy 0, policy_version 114017 (0.0005) [2023-12-27 20:02:54,590][106226] Updated weights for policy 0, policy_version 114027 (0.0007) [2023-12-27 20:02:54,611][106225] Updated weights for policy 1, policy_version 113895 (0.0006) [2023-12-27 20:02:54,643][106226] Updated weights for policy 0, policy_version 114037 (0.0010) [2023-12-27 20:02:54,661][106225] Updated weights for policy 1, policy_version 113905 (0.0005) [2023-12-27 20:02:54,693][106226] Updated weights for policy 0, policy_version 114047 (0.0010) [2023-12-27 20:02:54,722][106225] Updated weights for policy 1, policy_version 113915 (0.0008) [2023-12-27 20:02:55,332][106226] Updated weights for policy 0, policy_version 114057 (0.0009) [2023-12-27 20:02:55,391][106226] Updated weights for policy 0, policy_version 114067 (0.0010) [2023-12-27 20:02:55,443][106226] Updated weights for policy 0, policy_version 114077 (0.0010) [2023-12-27 20:02:55,493][106225] Updated weights for policy 1, policy_version 113925 (0.0007) [2023-12-27 20:02:55,497][106226] Updated weights for policy 0, policy_version 114087 (0.0006) [2023-12-27 20:02:55,540][106225] Updated weights for policy 1, policy_version 113935 (0.0005) [2023-12-27 20:02:55,599][106225] Updated weights for policy 1, policy_version 113945 (0.0005) [2023-12-27 20:02:56,124][106226] Updated weights for policy 0, policy_version 114097 (0.0010) [2023-12-27 20:02:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 58392576. Throughput: 0: 9826.9, 1: 10188.9. Samples: 58366400. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:02:56,176][105115] Avg episode reward: [(0, '-5.460'), (1, '-6.735')] [2023-12-27 20:02:56,177][106226] Updated weights for policy 0, policy_version 114107 (0.0011) [2023-12-27 20:02:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000113952_29179904.pth... [2023-12-27 20:02:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000112768_28876800.pth [2023-12-27 20:02:56,244][106226] Updated weights for policy 0, policy_version 114117 (0.0011) [2023-12-27 20:02:56,262][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000114120_29220864.pth... [2023-12-27 20:02:56,263][106225] Updated weights for policy 1, policy_version 113955 (0.0006) [2023-12-27 20:02:56,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000112936_28917760.pth [2023-12-27 20:02:56,322][106225] Updated weights for policy 1, policy_version 113965 (0.0006) [2023-12-27 20:02:56,382][106225] Updated weights for policy 1, policy_version 113975 (0.0006) [2023-12-27 20:02:56,891][106226] Updated weights for policy 0, policy_version 114127 (0.0010) [2023-12-27 20:02:56,916][106225] Updated weights for policy 1, policy_version 113985 (0.0005) [2023-12-27 20:02:56,938][106226] Updated weights for policy 0, policy_version 114137 (0.0010) [2023-12-27 20:02:56,977][106225] Updated weights for policy 1, policy_version 113995 (0.0005) [2023-12-27 20:02:56,984][106226] Updated weights for policy 0, policy_version 114147 (0.0010) [2023-12-27 20:02:57,035][106225] Updated weights for policy 1, policy_version 114005 (0.0005) [2023-12-27 20:02:57,093][106225] Updated weights for policy 1, policy_version 114015 (0.0005) [2023-12-27 20:02:57,590][106225] Updated weights for policy 1, policy_version 114025 (0.0010) [2023-12-27 20:02:57,636][106225] Updated weights for policy 1, policy_version 114035 (0.0010) [2023-12-27 20:02:57,683][106225] Updated weights for policy 1, policy_version 114045 (0.0006) [2023-12-27 20:02:57,690][106226] Updated weights for policy 0, policy_version 114157 (0.0010) [2023-12-27 20:02:57,746][106226] Updated weights for policy 0, policy_version 114167 (0.0010) [2023-12-27 20:02:57,799][106226] Updated weights for policy 0, policy_version 114177 (0.0010) [2023-12-27 20:02:58,247][106225] Updated weights for policy 1, policy_version 114055 (0.0007) [2023-12-27 20:02:58,311][106225] Updated weights for policy 1, policy_version 114065 (0.0010) [2023-12-27 20:02:58,387][106225] Updated weights for policy 1, policy_version 114075 (0.0010) [2023-12-27 20:02:58,516][106226] Updated weights for policy 0, policy_version 114187 (0.0010) [2023-12-27 20:02:58,583][106226] Updated weights for policy 0, policy_version 114197 (0.0008) [2023-12-27 20:02:58,645][106226] Updated weights for policy 0, policy_version 114207 (0.0008) [2023-12-27 20:02:59,203][106225] Updated weights for policy 1, policy_version 114085 (0.0009) [2023-12-27 20:02:59,278][106225] Updated weights for policy 1, policy_version 114095 (0.0007) [2023-12-27 20:02:59,344][106225] Updated weights for policy 1, policy_version 114105 (0.0008) [2023-12-27 20:02:59,496][106226] Updated weights for policy 0, policy_version 114217 (0.0008) [2023-12-27 20:02:59,562][106226] Updated weights for policy 0, policy_version 114227 (0.0008) [2023-12-27 20:02:59,617][106226] Updated weights for policy 0, policy_version 114237 (0.0006) [2023-12-27 20:02:59,673][106226] Updated weights for policy 0, policy_version 114247 (0.0008) [2023-12-27 20:03:00,053][106225] Updated weights for policy 1, policy_version 114115 (0.0009) [2023-12-27 20:03:00,108][106225] Updated weights for policy 1, policy_version 114125 (0.0010) [2023-12-27 20:03:00,167][106225] Updated weights for policy 1, policy_version 114135 (0.0009) [2023-12-27 20:03:00,351][106226] Updated weights for policy 0, policy_version 114257 (0.0010) [2023-12-27 20:03:00,411][106226] Updated weights for policy 0, policy_version 114267 (0.0006) [2023-12-27 20:03:00,471][106226] Updated weights for policy 0, policy_version 114277 (0.0010) [2023-12-27 20:03:00,748][106225] Updated weights for policy 1, policy_version 114145 (0.0005) [2023-12-27 20:03:00,795][106225] Updated weights for policy 1, policy_version 114155 (0.0005) [2023-12-27 20:03:00,867][106225] Updated weights for policy 1, policy_version 114165 (0.0005) [2023-12-27 20:03:00,923][106225] Updated weights for policy 1, policy_version 114175 (0.0005) [2023-12-27 20:03:01,102][106226] Updated weights for policy 0, policy_version 114287 (0.0010) [2023-12-27 20:03:01,167][106226] Updated weights for policy 0, policy_version 114297 (0.0010) [2023-12-27 20:03:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58499072. Throughput: 0: 9839.7, 1: 10286.3. Samples: 58488412. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:03:01,175][105115] Avg episode reward: [(0, '-5.470'), (1, '-6.507')] [2023-12-27 20:03:01,225][106226] Updated weights for policy 0, policy_version 114307 (0.0010) [2023-12-27 20:03:01,538][106225] Updated weights for policy 1, policy_version 114185 (0.0007) [2023-12-27 20:03:01,599][106225] Updated weights for policy 1, policy_version 114195 (0.0006) [2023-12-27 20:03:01,662][106225] Updated weights for policy 1, policy_version 114205 (0.0009) [2023-12-27 20:03:02,040][106226] Updated weights for policy 0, policy_version 114317 (0.0011) [2023-12-27 20:03:02,096][106226] Updated weights for policy 0, policy_version 114327 (0.0010) [2023-12-27 20:03:02,146][106226] Updated weights for policy 0, policy_version 114337 (0.0010) [2023-12-27 20:03:02,386][106225] Updated weights for policy 1, policy_version 114215 (0.0007) [2023-12-27 20:03:02,450][106225] Updated weights for policy 1, policy_version 114225 (0.0008) [2023-12-27 20:03:02,510][106225] Updated weights for policy 1, policy_version 114235 (0.0008) [2023-12-27 20:03:02,885][106226] Updated weights for policy 0, policy_version 114347 (0.0010) [2023-12-27 20:03:02,938][106226] Updated weights for policy 0, policy_version 114357 (0.0010) [2023-12-27 20:03:02,992][106226] Updated weights for policy 0, policy_version 114367 (0.0010) [2023-12-27 20:03:03,237][106225] Updated weights for policy 1, policy_version 114245 (0.0007) [2023-12-27 20:03:03,296][106225] Updated weights for policy 1, policy_version 114255 (0.0008) [2023-12-27 20:03:03,354][106225] Updated weights for policy 1, policy_version 114265 (0.0008) [2023-12-27 20:03:03,680][106226] Updated weights for policy 0, policy_version 114377 (0.0010) [2023-12-27 20:03:03,745][106226] Updated weights for policy 0, policy_version 114387 (0.0007) [2023-12-27 20:03:03,806][106226] Updated weights for policy 0, policy_version 114397 (0.0008) [2023-12-27 20:03:03,871][106226] Updated weights for policy 0, policy_version 114407 (0.0008) [2023-12-27 20:03:04,120][106225] Updated weights for policy 1, policy_version 114275 (0.0009) [2023-12-27 20:03:04,184][106225] Updated weights for policy 1, policy_version 114285 (0.0011) [2023-12-27 20:03:04,242][106225] Updated weights for policy 1, policy_version 114295 (0.0011) [2023-12-27 20:03:04,619][106226] Updated weights for policy 0, policy_version 114417 (0.0009) [2023-12-27 20:03:04,682][106226] Updated weights for policy 0, policy_version 114427 (0.0008) [2023-12-27 20:03:04,739][106226] Updated weights for policy 0, policy_version 114437 (0.0008) [2023-12-27 20:03:04,878][106225] Updated weights for policy 1, policy_version 114305 (0.0010) [2023-12-27 20:03:04,931][106225] Updated weights for policy 1, policy_version 114315 (0.0005) [2023-12-27 20:03:04,988][106225] Updated weights for policy 1, policy_version 114325 (0.0007) [2023-12-27 20:03:05,040][106225] Updated weights for policy 1, policy_version 114335 (0.0008) [2023-12-27 20:03:05,455][106226] Updated weights for policy 0, policy_version 114447 (0.0009) [2023-12-27 20:03:05,513][106226] Updated weights for policy 0, policy_version 114457 (0.0011) [2023-12-27 20:03:05,574][106226] Updated weights for policy 0, policy_version 114467 (0.0011) [2023-12-27 20:03:05,750][106225] Updated weights for policy 1, policy_version 114345 (0.0009) [2023-12-27 20:03:05,802][106225] Updated weights for policy 1, policy_version 114355 (0.0009) [2023-12-27 20:03:05,852][106225] Updated weights for policy 1, policy_version 114365 (0.0009) [2023-12-27 20:03:06,174][105115] Fps is (10 sec: 20480.7, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58597376. Throughput: 0: 9843.3, 1: 10300.0. Samples: 58608804. Policy #0 lag: (min: 14.0, avg: 31.4, max: 32.0) [2023-12-27 20:03:06,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-7.008')] [2023-12-27 20:03:06,229][106226] Updated weights for policy 0, policy_version 114477 (0.0009) [2023-12-27 20:03:06,288][106226] Updated weights for policy 0, policy_version 114487 (0.0009) [2023-12-27 20:03:06,340][106226] Updated weights for policy 0, policy_version 114497 (0.0009) [2023-12-27 20:03:06,543][106225] Updated weights for policy 1, policy_version 114375 (0.0008) [2023-12-27 20:03:06,608][106225] Updated weights for policy 1, policy_version 114385 (0.0008) [2023-12-27 20:03:06,668][106225] Updated weights for policy 1, policy_version 114395 (0.0009) [2023-12-27 20:03:07,160][106226] Updated weights for policy 0, policy_version 114507 (0.0010) [2023-12-27 20:03:07,224][106226] Updated weights for policy 0, policy_version 114517 (0.0010) [2023-12-27 20:03:07,275][106226] Updated weights for policy 0, policy_version 114527 (0.0009) [2023-12-27 20:03:07,301][106225] Updated weights for policy 1, policy_version 114405 (0.0006) [2023-12-27 20:03:07,348][106225] Updated weights for policy 1, policy_version 114415 (0.0005) [2023-12-27 20:03:07,398][106225] Updated weights for policy 1, policy_version 114425 (0.0005) [2023-12-27 20:03:08,027][106225] Updated weights for policy 1, policy_version 114435 (0.0007) [2023-12-27 20:03:08,074][106226] Updated weights for policy 0, policy_version 114537 (0.0008) [2023-12-27 20:03:08,086][106225] Updated weights for policy 1, policy_version 114445 (0.0008) [2023-12-27 20:03:08,130][106226] Updated weights for policy 0, policy_version 114547 (0.0008) [2023-12-27 20:03:08,138][106225] Updated weights for policy 1, policy_version 114455 (0.0008) [2023-12-27 20:03:08,178][106226] Updated weights for policy 0, policy_version 114557 (0.0008) [2023-12-27 20:03:08,229][106226] Updated weights for policy 0, policy_version 114567 (0.0008) [2023-12-27 20:03:08,839][106225] Updated weights for policy 1, policy_version 114465 (0.0006) [2023-12-27 20:03:08,897][106225] Updated weights for policy 1, policy_version 114475 (0.0010) [2023-12-27 20:03:08,956][106225] Updated weights for policy 1, policy_version 114485 (0.0011) [2023-12-27 20:03:09,001][106226] Updated weights for policy 0, policy_version 114577 (0.0007) [2023-12-27 20:03:09,014][106225] Updated weights for policy 1, policy_version 114495 (0.0010) [2023-12-27 20:03:09,063][106226] Updated weights for policy 0, policy_version 114587 (0.0007) [2023-12-27 20:03:09,121][106226] Updated weights for policy 0, policy_version 114597 (0.0008) [2023-12-27 20:03:09,782][106225] Updated weights for policy 1, policy_version 114505 (0.0011) [2023-12-27 20:03:09,840][106225] Updated weights for policy 1, policy_version 114515 (0.0011) [2023-12-27 20:03:09,909][106225] Updated weights for policy 1, policy_version 114525 (0.0008) [2023-12-27 20:03:09,916][106226] Updated weights for policy 0, policy_version 114607 (0.0008) [2023-12-27 20:03:09,981][106226] Updated weights for policy 0, policy_version 114617 (0.0008) [2023-12-27 20:03:10,043][106226] Updated weights for policy 0, policy_version 114627 (0.0010) [2023-12-27 20:03:10,614][106225] Updated weights for policy 1, policy_version 114535 (0.0006) [2023-12-27 20:03:10,669][106225] Updated weights for policy 1, policy_version 114545 (0.0006) [2023-12-27 20:03:10,722][106225] Updated weights for policy 1, policy_version 114555 (0.0005) [2023-12-27 20:03:10,755][106226] Updated weights for policy 0, policy_version 114637 (0.0007) [2023-12-27 20:03:10,811][106226] Updated weights for policy 0, policy_version 114647 (0.0005) [2023-12-27 20:03:10,869][106226] Updated weights for policy 0, policy_version 114657 (0.0005) [2023-12-27 20:03:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58695680. Throughput: 0: 9764.3, 1: 10342.2. Samples: 58666836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:11,175][105115] Avg episode reward: [(0, '-5.302'), (1, '-6.774')] [2023-12-27 20:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000114560_29335552.pth... [2023-12-27 20:03:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000114664_29360128.pth... [2023-12-27 20:03:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000113376_29032448.pth [2023-12-27 20:03:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000113544_29073408.pth [2023-12-27 20:03:11,475][106225] Updated weights for policy 1, policy_version 114565 (0.0009) [2023-12-27 20:03:11,526][106226] Updated weights for policy 0, policy_version 114667 (0.0007) [2023-12-27 20:03:11,533][106225] Updated weights for policy 1, policy_version 114575 (0.0006) [2023-12-27 20:03:11,587][106226] Updated weights for policy 0, policy_version 114677 (0.0010) [2023-12-27 20:03:11,597][106225] Updated weights for policy 1, policy_version 114585 (0.0006) [2023-12-27 20:03:11,654][106226] Updated weights for policy 0, policy_version 114687 (0.0010) [2023-12-27 20:03:12,285][106225] Updated weights for policy 1, policy_version 114595 (0.0007) [2023-12-27 20:03:12,339][106226] Updated weights for policy 0, policy_version 114697 (0.0010) [2023-12-27 20:03:12,345][106225] Updated weights for policy 1, policy_version 114605 (0.0007) [2023-12-27 20:03:12,400][106226] Updated weights for policy 0, policy_version 114707 (0.0009) [2023-12-27 20:03:12,413][106225] Updated weights for policy 1, policy_version 114615 (0.0007) [2023-12-27 20:03:12,459][106226] Updated weights for policy 0, policy_version 114717 (0.0007) [2023-12-27 20:03:12,512][106226] Updated weights for policy 0, policy_version 114727 (0.0009) [2023-12-27 20:03:13,143][106225] Updated weights for policy 1, policy_version 114625 (0.0008) [2023-12-27 20:03:13,193][106226] Updated weights for policy 0, policy_version 114737 (0.0007) [2023-12-27 20:03:13,199][106225] Updated weights for policy 1, policy_version 114635 (0.0005) [2023-12-27 20:03:13,253][106225] Updated weights for policy 1, policy_version 114645 (0.0006) [2023-12-27 20:03:13,255][106226] Updated weights for policy 0, policy_version 114747 (0.0007) [2023-12-27 20:03:13,305][106225] Updated weights for policy 1, policy_version 114655 (0.0006) [2023-12-27 20:03:13,307][106226] Updated weights for policy 0, policy_version 114757 (0.0005) [2023-12-27 20:03:14,022][106226] Updated weights for policy 0, policy_version 114767 (0.0009) [2023-12-27 20:03:14,028][106225] Updated weights for policy 1, policy_version 114665 (0.0007) [2023-12-27 20:03:14,075][106226] Updated weights for policy 0, policy_version 114777 (0.0010) [2023-12-27 20:03:14,084][106225] Updated weights for policy 1, policy_version 114675 (0.0005) [2023-12-27 20:03:14,131][106225] Updated weights for policy 1, policy_version 114685 (0.0006) [2023-12-27 20:03:14,135][106226] Updated weights for policy 0, policy_version 114787 (0.0010) [2023-12-27 20:03:14,812][106225] Updated weights for policy 1, policy_version 114695 (0.0008) [2023-12-27 20:03:14,845][106226] Updated weights for policy 0, policy_version 114797 (0.0009) [2023-12-27 20:03:14,870][106225] Updated weights for policy 1, policy_version 114705 (0.0007) [2023-12-27 20:03:14,913][106226] Updated weights for policy 0, policy_version 114807 (0.0009) [2023-12-27 20:03:14,941][106225] Updated weights for policy 1, policy_version 114715 (0.0007) [2023-12-27 20:03:14,983][106226] Updated weights for policy 0, policy_version 114817 (0.0008) [2023-12-27 20:03:15,642][106225] Updated weights for policy 1, policy_version 114725 (0.0008) [2023-12-27 20:03:15,692][106225] Updated weights for policy 1, policy_version 114735 (0.0010) [2023-12-27 20:03:15,711][106226] Updated weights for policy 0, policy_version 114827 (0.0008) [2023-12-27 20:03:15,751][106225] Updated weights for policy 1, policy_version 114745 (0.0006) [2023-12-27 20:03:15,778][106226] Updated weights for policy 0, policy_version 114837 (0.0009) [2023-12-27 20:03:15,840][106226] Updated weights for policy 0, policy_version 114847 (0.0007) [2023-12-27 20:03:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 58793984. Throughput: 0: 9669.8, 1: 10154.7. Samples: 58783128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:16,176][105115] Avg episode reward: [(0, '-5.663'), (1, '-6.880')] [2023-12-27 20:03:16,476][106226] Updated weights for policy 0, policy_version 114857 (0.0009) [2023-12-27 20:03:16,496][106225] Updated weights for policy 1, policy_version 114755 (0.0008) [2023-12-27 20:03:16,545][106226] Updated weights for policy 0, policy_version 114867 (0.0009) [2023-12-27 20:03:16,547][106225] Updated weights for policy 1, policy_version 114765 (0.0005) [2023-12-27 20:03:16,599][106225] Updated weights for policy 1, policy_version 114775 (0.0007) [2023-12-27 20:03:16,604][106226] Updated weights for policy 0, policy_version 114877 (0.0008) [2023-12-27 20:03:16,657][106226] Updated weights for policy 0, policy_version 114887 (0.0005) [2023-12-27 20:03:17,210][106225] Updated weights for policy 1, policy_version 114785 (0.0007) [2023-12-27 20:03:17,274][106225] Updated weights for policy 1, policy_version 114795 (0.0008) [2023-12-27 20:03:17,341][106225] Updated weights for policy 1, policy_version 114805 (0.0008) [2023-12-27 20:03:17,385][106226] Updated weights for policy 0, policy_version 114897 (0.0006) [2023-12-27 20:03:17,407][106225] Updated weights for policy 1, policy_version 114815 (0.0008) [2023-12-27 20:03:17,447][106226] Updated weights for policy 0, policy_version 114907 (0.0007) [2023-12-27 20:03:17,510][106226] Updated weights for policy 0, policy_version 114917 (0.0006) [2023-12-27 20:03:18,110][106225] Updated weights for policy 1, policy_version 114825 (0.0008) [2023-12-27 20:03:18,172][106225] Updated weights for policy 1, policy_version 114835 (0.0005) [2023-12-27 20:03:18,219][106226] Updated weights for policy 0, policy_version 114927 (0.0009) [2023-12-27 20:03:18,233][106225] Updated weights for policy 1, policy_version 114845 (0.0005) [2023-12-27 20:03:18,270][106226] Updated weights for policy 0, policy_version 114937 (0.0008) [2023-12-27 20:03:18,319][106226] Updated weights for policy 0, policy_version 114947 (0.0009) [2023-12-27 20:03:18,823][106225] Updated weights for policy 1, policy_version 114855 (0.0007) [2023-12-27 20:03:18,884][106225] Updated weights for policy 1, policy_version 114865 (0.0007) [2023-12-27 20:03:18,946][106225] Updated weights for policy 1, policy_version 114875 (0.0009) [2023-12-27 20:03:19,129][106226] Updated weights for policy 0, policy_version 114957 (0.0008) [2023-12-27 20:03:19,189][106226] Updated weights for policy 0, policy_version 114967 (0.0008) [2023-12-27 20:03:19,253][106226] Updated weights for policy 0, policy_version 114977 (0.0008) [2023-12-27 20:03:19,616][106225] Updated weights for policy 1, policy_version 114885 (0.0008) [2023-12-27 20:03:19,678][106225] Updated weights for policy 1, policy_version 114895 (0.0008) [2023-12-27 20:03:19,748][106225] Updated weights for policy 1, policy_version 114905 (0.0008) [2023-12-27 20:03:19,998][106226] Updated weights for policy 0, policy_version 114987 (0.0006) [2023-12-27 20:03:20,065][106226] Updated weights for policy 0, policy_version 114997 (0.0006) [2023-12-27 20:03:20,123][106226] Updated weights for policy 0, policy_version 115007 (0.0005) [2023-12-27 20:03:20,543][106225] Updated weights for policy 1, policy_version 114915 (0.0008) [2023-12-27 20:03:20,622][106225] Updated weights for policy 1, policy_version 114925 (0.0009) [2023-12-27 20:03:20,688][106225] Updated weights for policy 1, policy_version 114935 (0.0009) [2023-12-27 20:03:20,734][106226] Updated weights for policy 0, policy_version 115017 (0.0006) [2023-12-27 20:03:20,793][106226] Updated weights for policy 0, policy_version 115027 (0.0007) [2023-12-27 20:03:20,852][106226] Updated weights for policy 0, policy_version 115037 (0.0007) [2023-12-27 20:03:20,905][106226] Updated weights for policy 0, policy_version 115047 (0.0006) [2023-12-27 20:03:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 58892288. Throughput: 0: 9706.0, 1: 10014.6. Samples: 58900448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:21,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-6.281')] [2023-12-27 20:03:21,479][106225] Updated weights for policy 1, policy_version 114945 (0.0009) [2023-12-27 20:03:21,532][106225] Updated weights for policy 1, policy_version 114955 (0.0008) [2023-12-27 20:03:21,591][106225] Updated weights for policy 1, policy_version 114965 (0.0009) [2023-12-27 20:03:21,649][106225] Updated weights for policy 1, policy_version 114975 (0.0009) [2023-12-27 20:03:21,658][106226] Updated weights for policy 0, policy_version 115057 (0.0007) [2023-12-27 20:03:21,724][106226] Updated weights for policy 0, policy_version 115067 (0.0008) [2023-12-27 20:03:21,787][106226] Updated weights for policy 0, policy_version 115077 (0.0008) [2023-12-27 20:03:22,425][106225] Updated weights for policy 1, policy_version 114985 (0.0008) [2023-12-27 20:03:22,488][106225] Updated weights for policy 1, policy_version 114995 (0.0008) [2023-12-27 20:03:22,516][106226] Updated weights for policy 0, policy_version 115087 (0.0007) [2023-12-27 20:03:22,540][106225] Updated weights for policy 1, policy_version 115005 (0.0008) [2023-12-27 20:03:22,563][106226] Updated weights for policy 0, policy_version 115097 (0.0006) [2023-12-27 20:03:22,613][106226] Updated weights for policy 0, policy_version 115107 (0.0005) [2023-12-27 20:03:23,250][106225] Updated weights for policy 1, policy_version 115015 (0.0008) [2023-12-27 20:03:23,296][106225] Updated weights for policy 1, policy_version 115025 (0.0007) [2023-12-27 20:03:23,350][106225] Updated weights for policy 1, policy_version 115035 (0.0006) [2023-12-27 20:03:23,356][106226] Updated weights for policy 0, policy_version 115117 (0.0006) [2023-12-27 20:03:23,405][106226] Updated weights for policy 0, policy_version 115127 (0.0008) [2023-12-27 20:03:23,456][106226] Updated weights for policy 0, policy_version 115137 (0.0008) [2023-12-27 20:03:24,080][106225] Updated weights for policy 1, policy_version 115045 (0.0008) [2023-12-27 20:03:24,128][106225] Updated weights for policy 1, policy_version 115055 (0.0008) [2023-12-27 20:03:24,173][106225] Updated weights for policy 1, policy_version 115065 (0.0008) [2023-12-27 20:03:24,196][106226] Updated weights for policy 0, policy_version 115147 (0.0009) [2023-12-27 20:03:24,266][106226] Updated weights for policy 0, policy_version 115157 (0.0011) [2023-12-27 20:03:24,326][106226] Updated weights for policy 0, policy_version 115167 (0.0010) [2023-12-27 20:03:24,912][106225] Updated weights for policy 1, policy_version 115075 (0.0007) [2023-12-27 20:03:24,965][106225] Updated weights for policy 1, policy_version 115085 (0.0008) [2023-12-27 20:03:24,999][106226] Updated weights for policy 0, policy_version 115177 (0.0010) [2023-12-27 20:03:25,012][106225] Updated weights for policy 1, policy_version 115095 (0.0010) [2023-12-27 20:03:25,059][106226] Updated weights for policy 0, policy_version 115187 (0.0006) [2023-12-27 20:03:25,124][106226] Updated weights for policy 0, policy_version 115197 (0.0008) [2023-12-27 20:03:25,187][106226] Updated weights for policy 0, policy_version 115207 (0.0008) [2023-12-27 20:03:25,736][106225] Updated weights for policy 1, policy_version 115105 (0.0009) [2023-12-27 20:03:25,798][106225] Updated weights for policy 1, policy_version 115115 (0.0008) [2023-12-27 20:03:25,854][106225] Updated weights for policy 1, policy_version 115125 (0.0008) [2023-12-27 20:03:25,880][106226] Updated weights for policy 0, policy_version 115217 (0.0009) [2023-12-27 20:03:25,912][106225] Updated weights for policy 1, policy_version 115135 (0.0007) [2023-12-27 20:03:25,934][106226] Updated weights for policy 0, policy_version 115227 (0.0007) [2023-12-27 20:03:25,989][106226] Updated weights for policy 0, policy_version 115237 (0.0008) [2023-12-27 20:03:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 58990592. Throughput: 0: 9653.8, 1: 9934.1. Samples: 58956668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:26,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-6.936')] [2023-12-27 20:03:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000115136_29483008.pth... [2023-12-27 20:03:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000115240_29507584.pth... [2023-12-27 20:03:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000113952_29179904.pth [2023-12-27 20:03:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000114120_29220864.pth [2023-12-27 20:03:26,508][106225] Updated weights for policy 1, policy_version 115145 (0.0006) [2023-12-27 20:03:26,568][106225] Updated weights for policy 1, policy_version 115155 (0.0008) [2023-12-27 20:03:26,630][106225] Updated weights for policy 1, policy_version 115165 (0.0008) [2023-12-27 20:03:26,772][106226] Updated weights for policy 0, policy_version 115247 (0.0008) [2023-12-27 20:03:26,834][106226] Updated weights for policy 0, policy_version 115257 (0.0009) [2023-12-27 20:03:26,891][106226] Updated weights for policy 0, policy_version 115267 (0.0009) [2023-12-27 20:03:27,296][106225] Updated weights for policy 1, policy_version 115175 (0.0009) [2023-12-27 20:03:27,356][106225] Updated weights for policy 1, policy_version 115185 (0.0007) [2023-12-27 20:03:27,422][106225] Updated weights for policy 1, policy_version 115195 (0.0009) [2023-12-27 20:03:27,556][106226] Updated weights for policy 0, policy_version 115277 (0.0008) [2023-12-27 20:03:27,614][106226] Updated weights for policy 0, policy_version 115287 (0.0009) [2023-12-27 20:03:27,670][106226] Updated weights for policy 0, policy_version 115297 (0.0009) [2023-12-27 20:03:28,189][106225] Updated weights for policy 1, policy_version 115205 (0.0008) [2023-12-27 20:03:28,244][106225] Updated weights for policy 1, policy_version 115215 (0.0007) [2023-12-27 20:03:28,300][106225] Updated weights for policy 1, policy_version 115225 (0.0008) [2023-12-27 20:03:28,349][106226] Updated weights for policy 0, policy_version 115307 (0.0009) [2023-12-27 20:03:28,417][106226] Updated weights for policy 0, policy_version 115317 (0.0010) [2023-12-27 20:03:28,471][106226] Updated weights for policy 0, policy_version 115327 (0.0010) [2023-12-27 20:03:29,048][106225] Updated weights for policy 1, policy_version 115235 (0.0008) [2023-12-27 20:03:29,110][106225] Updated weights for policy 1, policy_version 115245 (0.0008) [2023-12-27 20:03:29,153][106226] Updated weights for policy 0, policy_version 115337 (0.0010) [2023-12-27 20:03:29,166][106225] Updated weights for policy 1, policy_version 115255 (0.0008) [2023-12-27 20:03:29,207][106226] Updated weights for policy 0, policy_version 115347 (0.0010) [2023-12-27 20:03:29,270][106226] Updated weights for policy 0, policy_version 115357 (0.0010) [2023-12-27 20:03:29,336][106226] Updated weights for policy 0, policy_version 115367 (0.0010) [2023-12-27 20:03:29,974][106225] Updated weights for policy 1, policy_version 115265 (0.0006) [2023-12-27 20:03:30,041][106225] Updated weights for policy 1, policy_version 115275 (0.0006) [2023-12-27 20:03:30,098][106226] Updated weights for policy 0, policy_version 115377 (0.0007) [2023-12-27 20:03:30,101][106225] Updated weights for policy 1, policy_version 115285 (0.0006) [2023-12-27 20:03:30,150][106225] Updated weights for policy 1, policy_version 115295 (0.0006) [2023-12-27 20:03:30,166][106226] Updated weights for policy 0, policy_version 115387 (0.0008) [2023-12-27 20:03:30,238][106226] Updated weights for policy 0, policy_version 115397 (0.0008) [2023-12-27 20:03:30,754][106225] Updated weights for policy 1, policy_version 115305 (0.0005) [2023-12-27 20:03:30,809][106225] Updated weights for policy 1, policy_version 115315 (0.0005) [2023-12-27 20:03:30,865][106225] Updated weights for policy 1, policy_version 115325 (0.0005) [2023-12-27 20:03:30,911][106226] Updated weights for policy 0, policy_version 115407 (0.0009) [2023-12-27 20:03:30,956][106226] Updated weights for policy 0, policy_version 115417 (0.0007) [2023-12-27 20:03:31,001][106226] Updated weights for policy 0, policy_version 115427 (0.0008) [2023-12-27 20:03:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 59088896. Throughput: 0: 9705.9, 1: 9945.6. Samples: 59074100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:31,175][105115] Avg episode reward: [(0, '-5.539'), (1, '-7.045')] [2023-12-27 20:03:31,504][106225] Updated weights for policy 1, policy_version 115335 (0.0007) [2023-12-27 20:03:31,564][106225] Updated weights for policy 1, policy_version 115345 (0.0009) [2023-12-27 20:03:31,629][106225] Updated weights for policy 1, policy_version 115355 (0.0008) [2023-12-27 20:03:31,793][106226] Updated weights for policy 0, policy_version 115437 (0.0008) [2023-12-27 20:03:31,856][106226] Updated weights for policy 0, policy_version 115447 (0.0008) [2023-12-27 20:03:31,919][106226] Updated weights for policy 0, policy_version 115457 (0.0007) [2023-12-27 20:03:32,300][106225] Updated weights for policy 1, policy_version 115365 (0.0006) [2023-12-27 20:03:32,362][106225] Updated weights for policy 1, policy_version 115375 (0.0005) [2023-12-27 20:03:32,431][106225] Updated weights for policy 1, policy_version 115385 (0.0008) [2023-12-27 20:03:32,714][106226] Updated weights for policy 0, policy_version 115467 (0.0006) [2023-12-27 20:03:32,774][106226] Updated weights for policy 0, policy_version 115477 (0.0008) [2023-12-27 20:03:32,833][106226] Updated weights for policy 0, policy_version 115487 (0.0008) [2023-12-27 20:03:33,110][106225] Updated weights for policy 1, policy_version 115395 (0.0010) [2023-12-27 20:03:33,166][106225] Updated weights for policy 1, policy_version 115405 (0.0009) [2023-12-27 20:03:33,225][106225] Updated weights for policy 1, policy_version 115415 (0.0010) [2023-12-27 20:03:33,451][106226] Updated weights for policy 0, policy_version 115497 (0.0008) [2023-12-27 20:03:33,504][106226] Updated weights for policy 0, policy_version 115507 (0.0005) [2023-12-27 20:03:33,550][106226] Updated weights for policy 0, policy_version 115517 (0.0005) [2023-12-27 20:03:33,600][106226] Updated weights for policy 0, policy_version 115528 (0.0006) [2023-12-27 20:03:33,887][106225] Updated weights for policy 1, policy_version 115425 (0.0009) [2023-12-27 20:03:33,951][106225] Updated weights for policy 1, policy_version 115435 (0.0008) [2023-12-27 20:03:34,009][106225] Updated weights for policy 1, policy_version 115445 (0.0010) [2023-12-27 20:03:34,067][106225] Updated weights for policy 1, policy_version 115455 (0.0010) [2023-12-27 20:03:34,208][106226] Updated weights for policy 0, policy_version 115538 (0.0008) [2023-12-27 20:03:34,270][106226] Updated weights for policy 0, policy_version 115548 (0.0009) [2023-12-27 20:03:34,332][106226] Updated weights for policy 0, policy_version 115558 (0.0007) [2023-12-27 20:03:34,753][106225] Updated weights for policy 1, policy_version 115465 (0.0010) [2023-12-27 20:03:34,815][106225] Updated weights for policy 1, policy_version 115475 (0.0010) [2023-12-27 20:03:34,875][106225] Updated weights for policy 1, policy_version 115485 (0.0010) [2023-12-27 20:03:35,041][106226] Updated weights for policy 0, policy_version 115568 (0.0007) [2023-12-27 20:03:35,088][106226] Updated weights for policy 0, policy_version 115578 (0.0008) [2023-12-27 20:03:35,142][106226] Updated weights for policy 0, policy_version 115588 (0.0008) [2023-12-27 20:03:35,578][106225] Updated weights for policy 1, policy_version 115495 (0.0010) [2023-12-27 20:03:35,624][106225] Updated weights for policy 1, policy_version 115505 (0.0010) [2023-12-27 20:03:35,671][106225] Updated weights for policy 1, policy_version 115515 (0.0010) [2023-12-27 20:03:35,872][106226] Updated weights for policy 0, policy_version 115598 (0.0008) [2023-12-27 20:03:35,923][106226] Updated weights for policy 0, policy_version 115608 (0.0008) [2023-12-27 20:03:35,986][106226] Updated weights for policy 0, policy_version 115618 (0.0008) [2023-12-27 20:03:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 59187200. Throughput: 0: 9760.4, 1: 9936.0. Samples: 59194628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:36,175][105115] Avg episode reward: [(0, '-5.187'), (1, '-6.722')] [2023-12-27 20:03:36,431][106225] Updated weights for policy 1, policy_version 115525 (0.0010) [2023-12-27 20:03:36,489][106225] Updated weights for policy 1, policy_version 115535 (0.0010) [2023-12-27 20:03:36,548][106225] Updated weights for policy 1, policy_version 115545 (0.0010) [2023-12-27 20:03:36,756][106226] Updated weights for policy 0, policy_version 115628 (0.0007) [2023-12-27 20:03:36,807][106226] Updated weights for policy 0, policy_version 115638 (0.0008) [2023-12-27 20:03:36,864][106226] Updated weights for policy 0, policy_version 115648 (0.0008) [2023-12-27 20:03:37,277][106225] Updated weights for policy 1, policy_version 115555 (0.0010) [2023-12-27 20:03:37,338][106225] Updated weights for policy 1, policy_version 115565 (0.0010) [2023-12-27 20:03:37,396][106225] Updated weights for policy 1, policy_version 115575 (0.0010) [2023-12-27 20:03:37,628][106226] Updated weights for policy 0, policy_version 115658 (0.0008) [2023-12-27 20:03:37,688][106226] Updated weights for policy 0, policy_version 115668 (0.0008) [2023-12-27 20:03:37,743][106226] Updated weights for policy 0, policy_version 115678 (0.0009) [2023-12-27 20:03:37,802][106226] Updated weights for policy 0, policy_version 115688 (0.0008) [2023-12-27 20:03:38,038][106225] Updated weights for policy 1, policy_version 115585 (0.0010) [2023-12-27 20:03:38,102][106225] Updated weights for policy 1, policy_version 115595 (0.0009) [2023-12-27 20:03:38,166][106225] Updated weights for policy 1, policy_version 115605 (0.0010) [2023-12-27 20:03:38,212][106225] Updated weights for policy 1, policy_version 115615 (0.0010) [2023-12-27 20:03:38,425][106226] Updated weights for policy 0, policy_version 115698 (0.0008) [2023-12-27 20:03:38,480][106226] Updated weights for policy 0, policy_version 115708 (0.0008) [2023-12-27 20:03:38,529][106226] Updated weights for policy 0, policy_version 115718 (0.0008) [2023-12-27 20:03:38,925][106225] Updated weights for policy 1, policy_version 115625 (0.0010) [2023-12-27 20:03:38,976][106225] Updated weights for policy 1, policy_version 115635 (0.0010) [2023-12-27 20:03:39,019][106225] Updated weights for policy 1, policy_version 115645 (0.0009) [2023-12-27 20:03:39,317][106226] Updated weights for policy 0, policy_version 115728 (0.0008) [2023-12-27 20:03:39,391][106226] Updated weights for policy 0, policy_version 115738 (0.0008) [2023-12-27 20:03:39,468][106226] Updated weights for policy 0, policy_version 115748 (0.0009) [2023-12-27 20:03:39,739][106225] Updated weights for policy 1, policy_version 115655 (0.0008) [2023-12-27 20:03:39,793][106225] Updated weights for policy 1, policy_version 115665 (0.0008) [2023-12-27 20:03:39,857][106225] Updated weights for policy 1, policy_version 115675 (0.0008) [2023-12-27 20:03:40,177][106226] Updated weights for policy 0, policy_version 115758 (0.0010) [2023-12-27 20:03:40,239][106226] Updated weights for policy 0, policy_version 115768 (0.0011) [2023-12-27 20:03:40,297][106226] Updated weights for policy 0, policy_version 115778 (0.0010) [2023-12-27 20:03:40,680][106225] Updated weights for policy 1, policy_version 115685 (0.0007) [2023-12-27 20:03:40,744][106225] Updated weights for policy 1, policy_version 115695 (0.0009) [2023-12-27 20:03:40,805][106225] Updated weights for policy 1, policy_version 115705 (0.0007) [2023-12-27 20:03:40,983][106226] Updated weights for policy 0, policy_version 115788 (0.0011) [2023-12-27 20:03:41,045][106226] Updated weights for policy 0, policy_version 115798 (0.0011) [2023-12-27 20:03:41,111][106226] Updated weights for policy 0, policy_version 115808 (0.0010) [2023-12-27 20:03:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 59285504. Throughput: 0: 9744.9, 1: 9972.9. Samples: 59253696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:41,175][105115] Avg episode reward: [(0, '-5.576'), (1, '-6.878')] [2023-12-27 20:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000115712_29630464.pth... [2023-12-27 20:03:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000115816_29655040.pth... [2023-12-27 20:03:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000114560_29335552.pth [2023-12-27 20:03:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000114664_29360128.pth [2023-12-27 20:03:41,558][106225] Updated weights for policy 1, policy_version 115715 (0.0008) [2023-12-27 20:03:41,622][106225] Updated weights for policy 1, policy_version 115725 (0.0009) [2023-12-27 20:03:41,690][106225] Updated weights for policy 1, policy_version 115735 (0.0008) [2023-12-27 20:03:41,885][106226] Updated weights for policy 0, policy_version 115818 (0.0008) [2023-12-27 20:03:41,944][106226] Updated weights for policy 0, policy_version 115828 (0.0006) [2023-12-27 20:03:42,001][106226] Updated weights for policy 0, policy_version 115838 (0.0006) [2023-12-27 20:03:42,064][106226] Updated weights for policy 0, policy_version 115848 (0.0006) [2023-12-27 20:03:42,353][106225] Updated weights for policy 1, policy_version 115745 (0.0008) [2023-12-27 20:03:42,413][106225] Updated weights for policy 1, policy_version 115755 (0.0008) [2023-12-27 20:03:42,462][106225] Updated weights for policy 1, policy_version 115765 (0.0008) [2023-12-27 20:03:42,511][106225] Updated weights for policy 1, policy_version 115775 (0.0008) [2023-12-27 20:03:42,761][106226] Updated weights for policy 0, policy_version 115858 (0.0008) [2023-12-27 20:03:42,823][106226] Updated weights for policy 0, policy_version 115868 (0.0010) [2023-12-27 20:03:42,897][106226] Updated weights for policy 0, policy_version 115878 (0.0010) [2023-12-27 20:03:43,215][106225] Updated weights for policy 1, policy_version 115785 (0.0008) [2023-12-27 20:03:43,266][106225] Updated weights for policy 1, policy_version 115795 (0.0008) [2023-12-27 20:03:43,317][106225] Updated weights for policy 1, policy_version 115805 (0.0008) [2023-12-27 20:03:43,620][106226] Updated weights for policy 0, policy_version 115888 (0.0008) [2023-12-27 20:03:43,679][106226] Updated weights for policy 0, policy_version 115898 (0.0008) [2023-12-27 20:03:43,737][106226] Updated weights for policy 0, policy_version 115908 (0.0009) [2023-12-27 20:03:44,038][106225] Updated weights for policy 1, policy_version 115815 (0.0008) [2023-12-27 20:03:44,099][106225] Updated weights for policy 1, policy_version 115825 (0.0008) [2023-12-27 20:03:44,165][106225] Updated weights for policy 1, policy_version 115835 (0.0009) [2023-12-27 20:03:44,434][106226] Updated weights for policy 0, policy_version 115918 (0.0008) [2023-12-27 20:03:44,488][106226] Updated weights for policy 0, policy_version 115928 (0.0007) [2023-12-27 20:03:44,546][106226] Updated weights for policy 0, policy_version 115938 (0.0005) [2023-12-27 20:03:44,921][106225] Updated weights for policy 1, policy_version 115845 (0.0007) [2023-12-27 20:03:44,985][106225] Updated weights for policy 1, policy_version 115855 (0.0009) [2023-12-27 20:03:45,052][106225] Updated weights for policy 1, policy_version 115865 (0.0008) [2023-12-27 20:03:45,237][106226] Updated weights for policy 0, policy_version 115948 (0.0007) [2023-12-27 20:03:45,294][106226] Updated weights for policy 0, policy_version 115958 (0.0009) [2023-12-27 20:03:45,354][106226] Updated weights for policy 0, policy_version 115968 (0.0008) [2023-12-27 20:03:45,677][106225] Updated weights for policy 1, policy_version 115875 (0.0008) [2023-12-27 20:03:45,724][106225] Updated weights for policy 1, policy_version 115885 (0.0005) [2023-12-27 20:03:45,779][106225] Updated weights for policy 1, policy_version 115895 (0.0005) [2023-12-27 20:03:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59375616. Throughput: 0: 9678.0, 1: 9873.2. Samples: 59368220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:46,175][105115] Avg episode reward: [(0, '-5.365'), (1, '-6.582')] [2023-12-27 20:03:46,203][106226] Updated weights for policy 0, policy_version 115978 (0.0008) [2023-12-27 20:03:46,271][106226] Updated weights for policy 0, policy_version 115988 (0.0008) [2023-12-27 20:03:46,316][106226] Updated weights for policy 0, policy_version 115998 (0.0008) [2023-12-27 20:03:46,348][106225] Updated weights for policy 1, policy_version 115905 (0.0006) [2023-12-27 20:03:46,370][106226] Updated weights for policy 0, policy_version 116008 (0.0007) [2023-12-27 20:03:46,398][106225] Updated weights for policy 1, policy_version 115915 (0.0008) [2023-12-27 20:03:46,450][106225] Updated weights for policy 1, policy_version 115925 (0.0009) [2023-12-27 20:03:46,498][106225] Updated weights for policy 1, policy_version 115935 (0.0008) [2023-12-27 20:03:47,083][106225] Updated weights for policy 1, policy_version 115945 (0.0006) [2023-12-27 20:03:47,139][106225] Updated weights for policy 1, policy_version 115955 (0.0007) [2023-12-27 20:03:47,176][106226] Updated weights for policy 0, policy_version 116018 (0.0007) [2023-12-27 20:03:47,197][106225] Updated weights for policy 1, policy_version 115965 (0.0006) [2023-12-27 20:03:47,234][106226] Updated weights for policy 0, policy_version 116028 (0.0006) [2023-12-27 20:03:47,282][106226] Updated weights for policy 0, policy_version 116038 (0.0008) [2023-12-27 20:03:47,877][106225] Updated weights for policy 1, policy_version 115975 (0.0009) [2023-12-27 20:03:47,938][106225] Updated weights for policy 1, policy_version 115985 (0.0010) [2023-12-27 20:03:47,989][106225] Updated weights for policy 1, policy_version 115995 (0.0011) [2023-12-27 20:03:48,050][106226] Updated weights for policy 0, policy_version 116048 (0.0009) [2023-12-27 20:03:48,118][106226] Updated weights for policy 0, policy_version 116058 (0.0008) [2023-12-27 20:03:48,173][106226] Updated weights for policy 0, policy_version 116068 (0.0009) [2023-12-27 20:03:48,669][106225] Updated weights for policy 1, policy_version 116005 (0.0011) [2023-12-27 20:03:48,722][106225] Updated weights for policy 1, policy_version 116015 (0.0010) [2023-12-27 20:03:48,779][106225] Updated weights for policy 1, policy_version 116025 (0.0010) [2023-12-27 20:03:48,967][106226] Updated weights for policy 0, policy_version 116078 (0.0008) [2023-12-27 20:03:49,013][106226] Updated weights for policy 0, policy_version 116088 (0.0008) [2023-12-27 20:03:49,066][106226] Updated weights for policy 0, policy_version 116098 (0.0008) [2023-12-27 20:03:49,461][106225] Updated weights for policy 1, policy_version 116035 (0.0009) [2023-12-27 20:03:49,531][106225] Updated weights for policy 1, policy_version 116045 (0.0005) [2023-12-27 20:03:49,596][106225] Updated weights for policy 1, policy_version 116055 (0.0007) [2023-12-27 20:03:49,877][106226] Updated weights for policy 0, policy_version 116108 (0.0009) [2023-12-27 20:03:49,943][106226] Updated weights for policy 0, policy_version 116118 (0.0007) [2023-12-27 20:03:49,994][106226] Updated weights for policy 0, policy_version 116128 (0.0008) [2023-12-27 20:03:50,281][106225] Updated weights for policy 1, policy_version 116065 (0.0008) [2023-12-27 20:03:50,344][106225] Updated weights for policy 1, policy_version 116075 (0.0009) [2023-12-27 20:03:50,404][106225] Updated weights for policy 1, policy_version 116085 (0.0008) [2023-12-27 20:03:50,466][106225] Updated weights for policy 1, policy_version 116095 (0.0008) [2023-12-27 20:03:50,674][106226] Updated weights for policy 0, policy_version 116138 (0.0008) [2023-12-27 20:03:50,739][106226] Updated weights for policy 0, policy_version 116148 (0.0007) [2023-12-27 20:03:50,804][106226] Updated weights for policy 0, policy_version 116158 (0.0007) [2023-12-27 20:03:50,864][106226] Updated weights for policy 0, policy_version 116168 (0.0009) [2023-12-27 20:03:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59473920. Throughput: 0: 9564.1, 1: 9906.0. Samples: 59484964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:51,175][105115] Avg episode reward: [(0, '-5.304'), (1, '-7.105')] [2023-12-27 20:03:51,229][106225] Updated weights for policy 1, policy_version 116105 (0.0007) [2023-12-27 20:03:51,303][106225] Updated weights for policy 1, policy_version 116115 (0.0010) [2023-12-27 20:03:51,379][106225] Updated weights for policy 1, policy_version 116125 (0.0009) [2023-12-27 20:03:51,540][106226] Updated weights for policy 0, policy_version 116178 (0.0009) [2023-12-27 20:03:51,603][106226] Updated weights for policy 0, policy_version 116188 (0.0009) [2023-12-27 20:03:51,663][106226] Updated weights for policy 0, policy_version 116198 (0.0008) [2023-12-27 20:03:52,071][106225] Updated weights for policy 1, policy_version 116135 (0.0009) [2023-12-27 20:03:52,136][106225] Updated weights for policy 1, policy_version 116145 (0.0009) [2023-12-27 20:03:52,200][106225] Updated weights for policy 1, policy_version 116155 (0.0009) [2023-12-27 20:03:52,431][106226] Updated weights for policy 0, policy_version 116208 (0.0007) [2023-12-27 20:03:52,494][106226] Updated weights for policy 0, policy_version 116218 (0.0008) [2023-12-27 20:03:52,560][106226] Updated weights for policy 0, policy_version 116228 (0.0009) [2023-12-27 20:03:52,925][106225] Updated weights for policy 1, policy_version 116165 (0.0008) [2023-12-27 20:03:52,973][106225] Updated weights for policy 1, policy_version 116175 (0.0008) [2023-12-27 20:03:53,027][106225] Updated weights for policy 1, policy_version 116185 (0.0008) [2023-12-27 20:03:53,269][106226] Updated weights for policy 0, policy_version 116238 (0.0007) [2023-12-27 20:03:53,327][106226] Updated weights for policy 0, policy_version 116248 (0.0008) [2023-12-27 20:03:53,386][106226] Updated weights for policy 0, policy_version 116258 (0.0009) [2023-12-27 20:03:53,751][106225] Updated weights for policy 1, policy_version 116195 (0.0008) [2023-12-27 20:03:53,797][106225] Updated weights for policy 1, policy_version 116205 (0.0009) [2023-12-27 20:03:53,851][106225] Updated weights for policy 1, policy_version 116215 (0.0008) [2023-12-27 20:03:54,119][106226] Updated weights for policy 0, policy_version 116268 (0.0009) [2023-12-27 20:03:54,172][106226] Updated weights for policy 0, policy_version 116278 (0.0008) [2023-12-27 20:03:54,241][106226] Updated weights for policy 0, policy_version 116288 (0.0006) [2023-12-27 20:03:54,619][106225] Updated weights for policy 1, policy_version 116225 (0.0008) [2023-12-27 20:03:54,665][106225] Updated weights for policy 1, policy_version 116235 (0.0010) [2023-12-27 20:03:54,715][106225] Updated weights for policy 1, policy_version 116245 (0.0010) [2023-12-27 20:03:54,767][106225] Updated weights for policy 1, policy_version 116255 (0.0008) [2023-12-27 20:03:54,891][106226] Updated weights for policy 0, policy_version 116298 (0.0006) [2023-12-27 20:03:54,951][106226] Updated weights for policy 0, policy_version 116308 (0.0005) [2023-12-27 20:03:55,016][106226] Updated weights for policy 0, policy_version 116318 (0.0009) [2023-12-27 20:03:55,070][106226] Updated weights for policy 0, policy_version 116328 (0.0007) [2023-12-27 20:03:55,356][106225] Updated weights for policy 1, policy_version 116265 (0.0005) [2023-12-27 20:03:55,410][106225] Updated weights for policy 1, policy_version 116275 (0.0005) [2023-12-27 20:03:55,465][106225] Updated weights for policy 1, policy_version 116285 (0.0006) [2023-12-27 20:03:55,769][106226] Updated weights for policy 0, policy_version 116338 (0.0011) [2023-12-27 20:03:55,816][106226] Updated weights for policy 0, policy_version 116348 (0.0010) [2023-12-27 20:03:55,867][106226] Updated weights for policy 0, policy_version 116358 (0.0010) [2023-12-27 20:03:56,100][106225] Updated weights for policy 1, policy_version 116295 (0.0007) [2023-12-27 20:03:56,167][106225] Updated weights for policy 1, policy_version 116305 (0.0005) [2023-12-27 20:03:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 59572224. Throughput: 0: 9611.2, 1: 9852.5. Samples: 59542700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:03:56,175][105115] Avg episode reward: [(0, '-5.389'), (1, '-6.977')] [2023-12-27 20:03:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000116360_29794304.pth... [2023-12-27 20:03:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000115240_29507584.pth [2023-12-27 20:03:56,215][106225] Updated weights for policy 1, policy_version 116315 (0.0005) [2023-12-27 20:03:56,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000116320_29786112.pth... [2023-12-27 20:03:56,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000115136_29483008.pth [2023-12-27 20:03:56,537][106226] Updated weights for policy 0, policy_version 116368 (0.0006) [2023-12-27 20:03:56,592][106226] Updated weights for policy 0, policy_version 116378 (0.0007) [2023-12-27 20:03:56,651][106226] Updated weights for policy 0, policy_version 116388 (0.0010) [2023-12-27 20:03:56,801][106225] Updated weights for policy 1, policy_version 116325 (0.0007) [2023-12-27 20:03:56,857][106225] Updated weights for policy 1, policy_version 116335 (0.0006) [2023-12-27 20:03:56,917][106225] Updated weights for policy 1, policy_version 116345 (0.0008) [2023-12-27 20:03:57,221][106226] Updated weights for policy 0, policy_version 116398 (0.0010) [2023-12-27 20:03:57,269][106226] Updated weights for policy 0, policy_version 116408 (0.0008) [2023-12-27 20:03:57,319][106226] Updated weights for policy 0, policy_version 116418 (0.0009) [2023-12-27 20:03:57,564][106225] Updated weights for policy 1, policy_version 116355 (0.0006) [2023-12-27 20:03:57,617][106225] Updated weights for policy 1, policy_version 116365 (0.0005) [2023-12-27 20:03:57,669][106225] Updated weights for policy 1, policy_version 116375 (0.0005) [2023-12-27 20:03:58,150][106226] Updated weights for policy 0, policy_version 116428 (0.0008) [2023-12-27 20:03:58,209][106225] Updated weights for policy 1, policy_version 116385 (0.0005) [2023-12-27 20:03:58,215][106226] Updated weights for policy 0, policy_version 116438 (0.0008) [2023-12-27 20:03:58,269][106225] Updated weights for policy 1, policy_version 116395 (0.0009) [2023-12-27 20:03:58,279][106226] Updated weights for policy 0, policy_version 116448 (0.0007) [2023-12-27 20:03:58,318][106225] Updated weights for policy 1, policy_version 116405 (0.0008) [2023-12-27 20:03:58,388][106225] Updated weights for policy 1, policy_version 116415 (0.0007) [2023-12-27 20:03:59,075][106226] Updated weights for policy 0, policy_version 116458 (0.0007) [2023-12-27 20:03:59,139][106226] Updated weights for policy 0, policy_version 116468 (0.0009) [2023-12-27 20:03:59,183][106225] Updated weights for policy 1, policy_version 116425 (0.0008) [2023-12-27 20:03:59,202][106226] Updated weights for policy 0, policy_version 116478 (0.0009) [2023-12-27 20:03:59,245][106225] Updated weights for policy 1, policy_version 116435 (0.0009) [2023-12-27 20:03:59,274][106226] Updated weights for policy 0, policy_version 116488 (0.0008) [2023-12-27 20:03:59,320][106225] Updated weights for policy 1, policy_version 116445 (0.0008) [2023-12-27 20:03:59,979][106225] Updated weights for policy 1, policy_version 116455 (0.0007) [2023-12-27 20:03:59,980][106226] Updated weights for policy 0, policy_version 116498 (0.0007) [2023-12-27 20:04:00,031][106226] Updated weights for policy 0, policy_version 116508 (0.0006) [2023-12-27 20:04:00,050][106225] Updated weights for policy 1, policy_version 116465 (0.0008) [2023-12-27 20:04:00,093][106226] Updated weights for policy 0, policy_version 116518 (0.0008) [2023-12-27 20:04:00,115][106225] Updated weights for policy 1, policy_version 116475 (0.0006) [2023-12-27 20:04:00,764][106226] Updated weights for policy 0, policy_version 116528 (0.0006) [2023-12-27 20:04:00,819][106226] Updated weights for policy 0, policy_version 116538 (0.0005) [2023-12-27 20:04:00,845][106225] Updated weights for policy 1, policy_version 116485 (0.0008) [2023-12-27 20:04:00,884][106226] Updated weights for policy 0, policy_version 116548 (0.0006) [2023-12-27 20:04:00,902][106225] Updated weights for policy 1, policy_version 116495 (0.0007) [2023-12-27 20:04:00,962][106225] Updated weights for policy 1, policy_version 116505 (0.0008) [2023-12-27 20:04:01,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59678720. Throughput: 0: 9618.8, 1: 9958.9. Samples: 59664120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:04:01,175][105115] Avg episode reward: [(0, '-5.252'), (1, '-6.720')] [2023-12-27 20:04:01,522][106226] Updated weights for policy 0, policy_version 116558 (0.0008) [2023-12-27 20:04:01,587][106226] Updated weights for policy 0, policy_version 116568 (0.0011) [2023-12-27 20:04:01,657][106226] Updated weights for policy 0, policy_version 116578 (0.0011) [2023-12-27 20:04:01,748][106225] Updated weights for policy 1, policy_version 116515 (0.0008) [2023-12-27 20:04:01,809][106225] Updated weights for policy 1, policy_version 116525 (0.0008) [2023-12-27 20:04:01,870][106225] Updated weights for policy 1, policy_version 116535 (0.0008) [2023-12-27 20:04:02,351][106226] Updated weights for policy 0, policy_version 116588 (0.0009) [2023-12-27 20:04:02,404][106226] Updated weights for policy 0, policy_version 116598 (0.0005) [2023-12-27 20:04:02,462][106226] Updated weights for policy 0, policy_version 116608 (0.0007) [2023-12-27 20:04:02,622][106225] Updated weights for policy 1, policy_version 116545 (0.0007) [2023-12-27 20:04:02,680][106225] Updated weights for policy 1, policy_version 116555 (0.0008) [2023-12-27 20:04:02,725][106225] Updated weights for policy 1, policy_version 116565 (0.0008) [2023-12-27 20:04:02,775][106225] Updated weights for policy 1, policy_version 116575 (0.0008) [2023-12-27 20:04:03,211][106226] Updated weights for policy 0, policy_version 116618 (0.0011) [2023-12-27 20:04:03,269][106226] Updated weights for policy 0, policy_version 116628 (0.0010) [2023-12-27 20:04:03,325][106226] Updated weights for policy 0, policy_version 116638 (0.0010) [2023-12-27 20:04:03,381][106226] Updated weights for policy 0, policy_version 116648 (0.0010) [2023-12-27 20:04:03,536][106225] Updated weights for policy 1, policy_version 116585 (0.0010) [2023-12-27 20:04:03,600][106225] Updated weights for policy 1, policy_version 116595 (0.0008) [2023-12-27 20:04:03,648][106225] Updated weights for policy 1, policy_version 116605 (0.0005) [2023-12-27 20:04:04,085][106226] Updated weights for policy 0, policy_version 116658 (0.0006) [2023-12-27 20:04:04,152][106226] Updated weights for policy 0, policy_version 116668 (0.0006) [2023-12-27 20:04:04,218][106226] Updated weights for policy 0, policy_version 116678 (0.0007) [2023-12-27 20:04:04,360][106225] Updated weights for policy 1, policy_version 116615 (0.0009) [2023-12-27 20:04:04,431][106225] Updated weights for policy 1, policy_version 116625 (0.0010) [2023-12-27 20:04:04,494][106225] Updated weights for policy 1, policy_version 116635 (0.0010) [2023-12-27 20:04:04,807][106226] Updated weights for policy 0, policy_version 116688 (0.0007) [2023-12-27 20:04:04,857][106226] Updated weights for policy 0, policy_version 116698 (0.0009) [2023-12-27 20:04:04,916][106226] Updated weights for policy 0, policy_version 116708 (0.0007) [2023-12-27 20:04:05,076][106225] Updated weights for policy 1, policy_version 116645 (0.0008) [2023-12-27 20:04:05,140][106225] Updated weights for policy 1, policy_version 116655 (0.0006) [2023-12-27 20:04:05,197][106225] Updated weights for policy 1, policy_version 116665 (0.0005) [2023-12-27 20:04:05,651][106226] Updated weights for policy 0, policy_version 116718 (0.0008) [2023-12-27 20:04:05,705][106226] Updated weights for policy 0, policy_version 116728 (0.0008) [2023-12-27 20:04:05,750][106225] Updated weights for policy 1, policy_version 116675 (0.0006) [2023-12-27 20:04:05,757][106226] Updated weights for policy 0, policy_version 116738 (0.0010) [2023-12-27 20:04:05,811][106225] Updated weights for policy 1, policy_version 116685 (0.0010) [2023-12-27 20:04:05,875][106225] Updated weights for policy 1, policy_version 116695 (0.0010) [2023-12-27 20:04:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59777024. Throughput: 0: 9665.4, 1: 9977.9. Samples: 59784400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:04:06,175][105115] Avg episode reward: [(0, '-5.475'), (1, '-6.502')] [2023-12-27 20:04:06,478][106226] Updated weights for policy 0, policy_version 116748 (0.0007) [2023-12-27 20:04:06,542][106226] Updated weights for policy 0, policy_version 116758 (0.0009) [2023-12-27 20:04:06,604][106225] Updated weights for policy 1, policy_version 116705 (0.0008) [2023-12-27 20:04:06,610][106226] Updated weights for policy 0, policy_version 116768 (0.0009) [2023-12-27 20:04:06,652][106225] Updated weights for policy 1, policy_version 116715 (0.0006) [2023-12-27 20:04:06,705][106225] Updated weights for policy 1, policy_version 116725 (0.0008) [2023-12-27 20:04:06,754][106225] Updated weights for policy 1, policy_version 116735 (0.0008) [2023-12-27 20:04:07,281][106226] Updated weights for policy 0, policy_version 116778 (0.0007) [2023-12-27 20:04:07,339][106226] Updated weights for policy 0, policy_version 116788 (0.0008) [2023-12-27 20:04:07,402][106226] Updated weights for policy 0, policy_version 116798 (0.0009) [2023-12-27 20:04:07,463][106226] Updated weights for policy 0, policy_version 116808 (0.0010) [2023-12-27 20:04:07,512][106225] Updated weights for policy 1, policy_version 116745 (0.0006) [2023-12-27 20:04:07,570][106225] Updated weights for policy 1, policy_version 116755 (0.0005) [2023-12-27 20:04:07,629][106225] Updated weights for policy 1, policy_version 116765 (0.0007) [2023-12-27 20:04:08,218][106226] Updated weights for policy 0, policy_version 116818 (0.0007) [2023-12-27 20:04:08,272][106226] Updated weights for policy 0, policy_version 116828 (0.0009) [2023-12-27 20:04:08,305][106225] Updated weights for policy 1, policy_version 116775 (0.0007) [2023-12-27 20:04:08,329][106226] Updated weights for policy 0, policy_version 116838 (0.0008) [2023-12-27 20:04:08,364][106225] Updated weights for policy 1, policy_version 116785 (0.0008) [2023-12-27 20:04:08,423][106225] Updated weights for policy 1, policy_version 116795 (0.0009) [2023-12-27 20:04:09,064][106226] Updated weights for policy 0, policy_version 116848 (0.0009) [2023-12-27 20:04:09,114][106225] Updated weights for policy 1, policy_version 116805 (0.0007) [2023-12-27 20:04:09,121][106226] Updated weights for policy 0, policy_version 116858 (0.0007) [2023-12-27 20:04:09,172][106225] Updated weights for policy 1, policy_version 116815 (0.0008) [2023-12-27 20:04:09,178][106226] Updated weights for policy 0, policy_version 116868 (0.0006) [2023-12-27 20:04:09,238][106225] Updated weights for policy 1, policy_version 116825 (0.0008) [2023-12-27 20:04:09,963][106226] Updated weights for policy 0, policy_version 116878 (0.0007) [2023-12-27 20:04:10,021][106226] Updated weights for policy 0, policy_version 116888 (0.0008) [2023-12-27 20:04:10,043][106225] Updated weights for policy 1, policy_version 116835 (0.0008) [2023-12-27 20:04:10,080][106226] Updated weights for policy 0, policy_version 116898 (0.0010) [2023-12-27 20:04:10,099][106225] Updated weights for policy 1, policy_version 116845 (0.0008) [2023-12-27 20:04:10,162][106225] Updated weights for policy 1, policy_version 116855 (0.0008) [2023-12-27 20:04:10,833][106226] Updated weights for policy 0, policy_version 116908 (0.0011) [2023-12-27 20:04:10,893][106226] Updated weights for policy 0, policy_version 116918 (0.0011) [2023-12-27 20:04:10,930][106225] Updated weights for policy 1, policy_version 116865 (0.0008) [2023-12-27 20:04:10,953][106226] Updated weights for policy 0, policy_version 116928 (0.0010) [2023-12-27 20:04:10,994][106225] Updated weights for policy 1, policy_version 116875 (0.0007) [2023-12-27 20:04:11,060][106225] Updated weights for policy 1, policy_version 116885 (0.0007) [2023-12-27 20:04:11,131][106225] Updated weights for policy 1, policy_version 116895 (0.0008) [2023-12-27 20:04:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59875328. Throughput: 0: 9685.6, 1: 9997.6. Samples: 59842412. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:11,175][105115] Avg episode reward: [(0, '-5.516'), (1, '-6.704')] [2023-12-27 20:04:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000116896_29933568.pth... [2023-12-27 20:04:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000116936_29941760.pth... [2023-12-27 20:04:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000115816_29655040.pth [2023-12-27 20:04:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000115712_29630464.pth [2023-12-27 20:04:11,687][106226] Updated weights for policy 0, policy_version 116938 (0.0010) [2023-12-27 20:04:11,772][106226] Updated weights for policy 0, policy_version 116948 (0.0008) [2023-12-27 20:04:11,829][106225] Updated weights for policy 1, policy_version 116905 (0.0006) [2023-12-27 20:04:11,834][106226] Updated weights for policy 0, policy_version 116958 (0.0007) [2023-12-27 20:04:11,893][106225] Updated weights for policy 1, policy_version 116915 (0.0008) [2023-12-27 20:04:11,895][106226] Updated weights for policy 0, policy_version 116968 (0.0007) [2023-12-27 20:04:11,955][106225] Updated weights for policy 1, policy_version 116925 (0.0008) [2023-12-27 20:04:12,576][106226] Updated weights for policy 0, policy_version 116978 (0.0008) [2023-12-27 20:04:12,636][106226] Updated weights for policy 0, policy_version 116988 (0.0009) [2023-12-27 20:04:12,697][106226] Updated weights for policy 0, policy_version 116998 (0.0008) [2023-12-27 20:04:12,741][106225] Updated weights for policy 1, policy_version 116935 (0.0008) [2023-12-27 20:04:12,797][106225] Updated weights for policy 1, policy_version 116945 (0.0008) [2023-12-27 20:04:12,846][106225] Updated weights for policy 1, policy_version 116955 (0.0008) [2023-12-27 20:04:13,424][106225] Updated weights for policy 1, policy_version 116965 (0.0005) [2023-12-27 20:04:13,462][106226] Updated weights for policy 0, policy_version 117008 (0.0008) [2023-12-27 20:04:13,487][106225] Updated weights for policy 1, policy_version 116975 (0.0006) [2023-12-27 20:04:13,515][106226] Updated weights for policy 0, policy_version 117018 (0.0010) [2023-12-27 20:04:13,543][106225] Updated weights for policy 1, policy_version 116985 (0.0010) [2023-12-27 20:04:13,572][106226] Updated weights for policy 0, policy_version 117028 (0.0010) [2023-12-27 20:04:14,182][106225] Updated weights for policy 1, policy_version 116995 (0.0009) [2023-12-27 20:04:14,234][106225] Updated weights for policy 1, policy_version 117005 (0.0005) [2023-12-27 20:04:14,275][106226] Updated weights for policy 0, policy_version 117038 (0.0010) [2023-12-27 20:04:14,288][106225] Updated weights for policy 1, policy_version 117015 (0.0007) [2023-12-27 20:04:14,325][106226] Updated weights for policy 0, policy_version 117048 (0.0010) [2023-12-27 20:04:14,371][106226] Updated weights for policy 0, policy_version 117058 (0.0010) [2023-12-27 20:04:14,918][106225] Updated weights for policy 1, policy_version 117025 (0.0006) [2023-12-27 20:04:14,985][106225] Updated weights for policy 1, policy_version 117035 (0.0011) [2023-12-27 20:04:15,047][106225] Updated weights for policy 1, policy_version 117045 (0.0011) [2023-12-27 20:04:15,051][106226] Updated weights for policy 0, policy_version 117068 (0.0010) [2023-12-27 20:04:15,113][106225] Updated weights for policy 1, policy_version 117055 (0.0011) [2023-12-27 20:04:15,113][106226] Updated weights for policy 0, policy_version 117078 (0.0006) [2023-12-27 20:04:15,167][106226] Updated weights for policy 0, policy_version 117088 (0.0008) [2023-12-27 20:04:15,718][106226] Updated weights for policy 0, policy_version 117098 (0.0006) [2023-12-27 20:04:15,778][106226] Updated weights for policy 0, policy_version 117108 (0.0005) [2023-12-27 20:04:15,834][106226] Updated weights for policy 0, policy_version 117118 (0.0005) [2023-12-27 20:04:15,848][106225] Updated weights for policy 1, policy_version 117065 (0.0007) [2023-12-27 20:04:15,890][106226] Updated weights for policy 0, policy_version 117128 (0.0006) [2023-12-27 20:04:15,900][106225] Updated weights for policy 1, policy_version 117075 (0.0005) [2023-12-27 20:04:15,955][106225] Updated weights for policy 1, policy_version 117085 (0.0007) [2023-12-27 20:04:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 59973632. Throughput: 0: 9641.6, 1: 10019.6. Samples: 59958852. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:16,175][105115] Avg episode reward: [(0, '-5.503'), (1, '-6.657')] [2023-12-27 20:04:16,435][106226] Updated weights for policy 0, policy_version 117138 (0.0008) [2023-12-27 20:04:16,485][106226] Updated weights for policy 0, policy_version 117148 (0.0007) [2023-12-27 20:04:16,536][106226] Updated weights for policy 0, policy_version 117158 (0.0007) [2023-12-27 20:04:16,577][106225] Updated weights for policy 1, policy_version 117095 (0.0010) [2023-12-27 20:04:16,624][106225] Updated weights for policy 1, policy_version 117105 (0.0010) [2023-12-27 20:04:16,674][106225] Updated weights for policy 1, policy_version 117115 (0.0010) [2023-12-27 20:04:17,135][106226] Updated weights for policy 0, policy_version 117168 (0.0008) [2023-12-27 20:04:17,198][106226] Updated weights for policy 0, policy_version 117178 (0.0009) [2023-12-27 20:04:17,255][106226] Updated weights for policy 0, policy_version 117188 (0.0009) [2023-12-27 20:04:17,358][106225] Updated weights for policy 1, policy_version 117125 (0.0009) [2023-12-27 20:04:17,412][106225] Updated weights for policy 1, policy_version 117135 (0.0009) [2023-12-27 20:04:17,462][106225] Updated weights for policy 1, policy_version 117145 (0.0009) [2023-12-27 20:04:17,892][106226] Updated weights for policy 0, policy_version 117198 (0.0008) [2023-12-27 20:04:17,955][106226] Updated weights for policy 0, policy_version 117208 (0.0006) [2023-12-27 20:04:18,026][106226] Updated weights for policy 0, policy_version 117218 (0.0012) [2023-12-27 20:04:18,252][106225] Updated weights for policy 1, policy_version 117155 (0.0007) [2023-12-27 20:04:18,310][106225] Updated weights for policy 1, policy_version 117165 (0.0008) [2023-12-27 20:04:18,376][106225] Updated weights for policy 1, policy_version 117175 (0.0007) [2023-12-27 20:04:18,760][106226] Updated weights for policy 0, policy_version 117228 (0.0008) [2023-12-27 20:04:18,812][106226] Updated weights for policy 0, policy_version 117238 (0.0006) [2023-12-27 20:04:18,867][106226] Updated weights for policy 0, policy_version 117248 (0.0008) [2023-12-27 20:04:19,100][106225] Updated weights for policy 1, policy_version 117185 (0.0009) [2023-12-27 20:04:19,159][106225] Updated weights for policy 1, policy_version 117195 (0.0008) [2023-12-27 20:04:19,215][106225] Updated weights for policy 1, policy_version 117205 (0.0008) [2023-12-27 20:04:19,283][106225] Updated weights for policy 1, policy_version 117215 (0.0008) [2023-12-27 20:04:19,609][106226] Updated weights for policy 0, policy_version 117258 (0.0009) [2023-12-27 20:04:19,674][106226] Updated weights for policy 0, policy_version 117268 (0.0011) [2023-12-27 20:04:19,734][106226] Updated weights for policy 0, policy_version 117278 (0.0011) [2023-12-27 20:04:19,795][106226] Updated weights for policy 0, policy_version 117288 (0.0011) [2023-12-27 20:04:20,044][106225] Updated weights for policy 1, policy_version 117225 (0.0008) [2023-12-27 20:04:20,106][106225] Updated weights for policy 1, policy_version 117235 (0.0008) [2023-12-27 20:04:20,165][106225] Updated weights for policy 1, policy_version 117245 (0.0008) [2023-12-27 20:04:20,527][106226] Updated weights for policy 0, policy_version 117298 (0.0010) [2023-12-27 20:04:20,592][106226] Updated weights for policy 0, policy_version 117308 (0.0009) [2023-12-27 20:04:20,655][106226] Updated weights for policy 0, policy_version 117318 (0.0007) [2023-12-27 20:04:20,921][106225] Updated weights for policy 1, policy_version 117255 (0.0009) [2023-12-27 20:04:20,972][106225] Updated weights for policy 1, policy_version 117265 (0.0010) [2023-12-27 20:04:21,035][106225] Updated weights for policy 1, policy_version 117275 (0.0009) [2023-12-27 20:04:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 60071936. Throughput: 0: 9730.0, 1: 9936.2. Samples: 60079604. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:21,175][105115] Avg episode reward: [(0, '-5.409'), (1, '-6.730')] [2023-12-27 20:04:21,449][106226] Updated weights for policy 0, policy_version 117328 (0.0009) [2023-12-27 20:04:21,512][106226] Updated weights for policy 0, policy_version 117338 (0.0009) [2023-12-27 20:04:21,568][106226] Updated weights for policy 0, policy_version 117348 (0.0009) [2023-12-27 20:04:21,776][106225] Updated weights for policy 1, policy_version 117285 (0.0008) [2023-12-27 20:04:21,835][106225] Updated weights for policy 1, policy_version 117295 (0.0006) [2023-12-27 20:04:21,902][106225] Updated weights for policy 1, policy_version 117305 (0.0006) [2023-12-27 20:04:22,397][106226] Updated weights for policy 0, policy_version 117358 (0.0010) [2023-12-27 20:04:22,459][106226] Updated weights for policy 0, policy_version 117368 (0.0007) [2023-12-27 20:04:22,530][106226] Updated weights for policy 0, policy_version 117378 (0.0006) [2023-12-27 20:04:22,605][106225] Updated weights for policy 1, policy_version 117315 (0.0006) [2023-12-27 20:04:22,677][106225] Updated weights for policy 1, policy_version 117325 (0.0006) [2023-12-27 20:04:22,748][106225] Updated weights for policy 1, policy_version 117335 (0.0006) [2023-12-27 20:04:23,191][106226] Updated weights for policy 0, policy_version 117388 (0.0008) [2023-12-27 20:04:23,239][106226] Updated weights for policy 0, policy_version 117398 (0.0005) [2023-12-27 20:04:23,308][106226] Updated weights for policy 0, policy_version 117408 (0.0009) [2023-12-27 20:04:23,347][106225] Updated weights for policy 1, policy_version 117345 (0.0006) [2023-12-27 20:04:23,408][106225] Updated weights for policy 1, policy_version 117355 (0.0008) [2023-12-27 20:04:23,473][106225] Updated weights for policy 1, policy_version 117365 (0.0008) [2023-12-27 20:04:23,537][106225] Updated weights for policy 1, policy_version 117375 (0.0008) [2023-12-27 20:04:23,998][106226] Updated weights for policy 0, policy_version 117418 (0.0010) [2023-12-27 20:04:24,056][106226] Updated weights for policy 0, policy_version 117428 (0.0011) [2023-12-27 20:04:24,120][106226] Updated weights for policy 0, policy_version 117438 (0.0011) [2023-12-27 20:04:24,134][106225] Updated weights for policy 1, policy_version 117385 (0.0007) [2023-12-27 20:04:24,184][106226] Updated weights for policy 0, policy_version 117448 (0.0011) [2023-12-27 20:04:24,189][106225] Updated weights for policy 1, policy_version 117395 (0.0008) [2023-12-27 20:04:24,238][106225] Updated weights for policy 1, policy_version 117405 (0.0010) [2023-12-27 20:04:24,875][106226] Updated weights for policy 0, policy_version 117458 (0.0010) [2023-12-27 20:04:24,925][106226] Updated weights for policy 0, policy_version 117468 (0.0010) [2023-12-27 20:04:24,947][106225] Updated weights for policy 1, policy_version 117415 (0.0010) [2023-12-27 20:04:24,974][106226] Updated weights for policy 0, policy_version 117478 (0.0010) [2023-12-27 20:04:25,008][106225] Updated weights for policy 1, policy_version 117425 (0.0010) [2023-12-27 20:04:25,067][106225] Updated weights for policy 1, policy_version 117435 (0.0010) [2023-12-27 20:04:25,705][106226] Updated weights for policy 0, policy_version 117488 (0.0010) [2023-12-27 20:04:25,750][106226] Updated weights for policy 0, policy_version 117498 (0.0010) [2023-12-27 20:04:25,779][106225] Updated weights for policy 1, policy_version 117445 (0.0010) [2023-12-27 20:04:25,797][106226] Updated weights for policy 0, policy_version 117508 (0.0010) [2023-12-27 20:04:25,835][106225] Updated weights for policy 1, policy_version 117455 (0.0010) [2023-12-27 20:04:25,881][106225] Updated weights for policy 1, policy_version 117465 (0.0010) [2023-12-27 20:04:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 60170240. Throughput: 0: 9696.3, 1: 9931.3. Samples: 60136940. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:26,175][105115] Avg episode reward: [(0, '-5.445'), (1, '-7.152')] [2023-12-27 20:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000117472_30081024.pth... [2023-12-27 20:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000117512_30089216.pth... [2023-12-27 20:04:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000116320_29786112.pth [2023-12-27 20:04:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000116360_29794304.pth [2023-12-27 20:04:26,529][106226] Updated weights for policy 0, policy_version 117518 (0.0010) [2023-12-27 20:04:26,575][106226] Updated weights for policy 0, policy_version 117528 (0.0010) [2023-12-27 20:04:26,599][106225] Updated weights for policy 1, policy_version 117475 (0.0010) [2023-12-27 20:04:26,624][106226] Updated weights for policy 0, policy_version 117538 (0.0010) [2023-12-27 20:04:26,655][106225] Updated weights for policy 1, policy_version 117485 (0.0010) [2023-12-27 20:04:26,715][106225] Updated weights for policy 1, policy_version 117495 (0.0010) [2023-12-27 20:04:27,358][106226] Updated weights for policy 0, policy_version 117548 (0.0010) [2023-12-27 20:04:27,410][106226] Updated weights for policy 0, policy_version 117558 (0.0010) [2023-12-27 20:04:27,413][106225] Updated weights for policy 1, policy_version 117505 (0.0010) [2023-12-27 20:04:27,456][106226] Updated weights for policy 0, policy_version 117568 (0.0010) [2023-12-27 20:04:27,471][106225] Updated weights for policy 1, policy_version 117515 (0.0009) [2023-12-27 20:04:27,518][106225] Updated weights for policy 1, policy_version 117525 (0.0009) [2023-12-27 20:04:27,564][106225] Updated weights for policy 1, policy_version 117535 (0.0010) [2023-12-27 20:04:28,179][106226] Updated weights for policy 0, policy_version 117578 (0.0008) [2023-12-27 20:04:28,223][106225] Updated weights for policy 1, policy_version 117545 (0.0010) [2023-12-27 20:04:28,228][106226] Updated weights for policy 0, policy_version 117588 (0.0010) [2023-12-27 20:04:28,270][106225] Updated weights for policy 1, policy_version 117555 (0.0010) [2023-12-27 20:04:28,271][106226] Updated weights for policy 0, policy_version 117598 (0.0010) [2023-12-27 20:04:28,323][106226] Updated weights for policy 0, policy_version 117608 (0.0009) [2023-12-27 20:04:28,325][106225] Updated weights for policy 1, policy_version 117565 (0.0008) [2023-12-27 20:04:28,974][106226] Updated weights for policy 0, policy_version 117618 (0.0005) [2023-12-27 20:04:29,032][106226] Updated weights for policy 0, policy_version 117628 (0.0005) [2023-12-27 20:04:29,045][106225] Updated weights for policy 1, policy_version 117575 (0.0010) [2023-12-27 20:04:29,082][106226] Updated weights for policy 0, policy_version 117638 (0.0008) [2023-12-27 20:04:29,104][106225] Updated weights for policy 1, policy_version 117585 (0.0010) [2023-12-27 20:04:29,159][106225] Updated weights for policy 1, policy_version 117595 (0.0010) [2023-12-27 20:04:29,749][106226] Updated weights for policy 0, policy_version 117648 (0.0011) [2023-12-27 20:04:29,799][106226] Updated weights for policy 0, policy_version 117658 (0.0010) [2023-12-27 20:04:29,847][106225] Updated weights for policy 1, policy_version 117605 (0.0009) [2023-12-27 20:04:29,860][106226] Updated weights for policy 0, policy_version 117668 (0.0011) [2023-12-27 20:04:29,911][106225] Updated weights for policy 1, policy_version 117615 (0.0009) [2023-12-27 20:04:29,970][106225] Updated weights for policy 1, policy_version 117625 (0.0008) [2023-12-27 20:04:30,532][106226] Updated weights for policy 0, policy_version 117678 (0.0008) [2023-12-27 20:04:30,599][106226] Updated weights for policy 0, policy_version 117688 (0.0005) [2023-12-27 20:04:30,640][106225] Updated weights for policy 1, policy_version 117635 (0.0008) [2023-12-27 20:04:30,664][106226] Updated weights for policy 0, policy_version 117698 (0.0006) [2023-12-27 20:04:30,692][106225] Updated weights for policy 1, policy_version 117645 (0.0007) [2023-12-27 20:04:30,742][106225] Updated weights for policy 1, policy_version 117655 (0.0008) [2023-12-27 20:04:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 60268544. Throughput: 0: 9740.1, 1: 10020.7. Samples: 60257456. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:31,175][105115] Avg episode reward: [(0, '-5.271'), (1, '-6.569')] [2023-12-27 20:04:31,322][106226] Updated weights for policy 0, policy_version 117708 (0.0007) [2023-12-27 20:04:31,384][106226] Updated weights for policy 0, policy_version 117718 (0.0009) [2023-12-27 20:04:31,454][106226] Updated weights for policy 0, policy_version 117728 (0.0008) [2023-12-27 20:04:31,531][106225] Updated weights for policy 1, policy_version 117665 (0.0008) [2023-12-27 20:04:31,601][106225] Updated weights for policy 1, policy_version 117675 (0.0006) [2023-12-27 20:04:31,663][106225] Updated weights for policy 1, policy_version 117685 (0.0008) [2023-12-27 20:04:31,725][106225] Updated weights for policy 1, policy_version 117695 (0.0008) [2023-12-27 20:04:32,241][106226] Updated weights for policy 0, policy_version 117738 (0.0008) [2023-12-27 20:04:32,308][106226] Updated weights for policy 0, policy_version 117748 (0.0009) [2023-12-27 20:04:32,314][106225] Updated weights for policy 1, policy_version 117705 (0.0008) [2023-12-27 20:04:32,377][106226] Updated weights for policy 0, policy_version 117758 (0.0009) [2023-12-27 20:04:32,386][106225] Updated weights for policy 1, policy_version 117715 (0.0008) [2023-12-27 20:04:32,445][106225] Updated weights for policy 1, policy_version 117725 (0.0008) [2023-12-27 20:04:32,445][106226] Updated weights for policy 0, policy_version 117768 (0.0007) [2023-12-27 20:04:33,154][106225] Updated weights for policy 1, policy_version 117735 (0.0008) [2023-12-27 20:04:33,163][106226] Updated weights for policy 0, policy_version 117778 (0.0007) [2023-12-27 20:04:33,216][106225] Updated weights for policy 1, policy_version 117745 (0.0006) [2023-12-27 20:04:33,229][106226] Updated weights for policy 0, policy_version 117788 (0.0005) [2023-12-27 20:04:33,276][106225] Updated weights for policy 1, policy_version 117755 (0.0006) [2023-12-27 20:04:33,296][106226] Updated weights for policy 0, policy_version 117798 (0.0005) [2023-12-27 20:04:33,849][106226] Updated weights for policy 0, policy_version 117808 (0.0008) [2023-12-27 20:04:33,908][106226] Updated weights for policy 0, policy_version 117818 (0.0007) [2023-12-27 20:04:33,914][106225] Updated weights for policy 1, policy_version 117765 (0.0007) [2023-12-27 20:04:33,964][106225] Updated weights for policy 1, policy_version 117775 (0.0006) [2023-12-27 20:04:33,967][106226] Updated weights for policy 0, policy_version 117828 (0.0007) [2023-12-27 20:04:34,017][106225] Updated weights for policy 1, policy_version 117785 (0.0009) [2023-12-27 20:04:34,608][106226] Updated weights for policy 0, policy_version 117838 (0.0007) [2023-12-27 20:04:34,667][106226] Updated weights for policy 0, policy_version 117848 (0.0009) [2023-12-27 20:04:34,710][106225] Updated weights for policy 1, policy_version 117795 (0.0007) [2023-12-27 20:04:34,731][106226] Updated weights for policy 0, policy_version 117858 (0.0008) [2023-12-27 20:04:34,771][106225] Updated weights for policy 1, policy_version 117805 (0.0006) [2023-12-27 20:04:34,826][106225] Updated weights for policy 1, policy_version 117815 (0.0008) [2023-12-27 20:04:35,431][106226] Updated weights for policy 0, policy_version 117868 (0.0006) [2023-12-27 20:04:35,494][106226] Updated weights for policy 0, policy_version 117878 (0.0005) [2023-12-27 20:04:35,526][106225] Updated weights for policy 1, policy_version 117825 (0.0009) [2023-12-27 20:04:35,546][106226] Updated weights for policy 0, policy_version 117888 (0.0007) [2023-12-27 20:04:35,577][106225] Updated weights for policy 1, policy_version 117835 (0.0006) [2023-12-27 20:04:35,624][106225] Updated weights for policy 1, policy_version 117845 (0.0008) [2023-12-27 20:04:35,682][106225] Updated weights for policy 1, policy_version 117855 (0.0008) [2023-12-27 20:04:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 60366848. Throughput: 0: 9891.7, 1: 9959.9. Samples: 60378288. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:36,176][105115] Avg episode reward: [(0, '-5.398'), (1, '-6.973')] [2023-12-27 20:04:36,227][106226] Updated weights for policy 0, policy_version 117898 (0.0007) [2023-12-27 20:04:36,287][106226] Updated weights for policy 0, policy_version 117908 (0.0008) [2023-12-27 20:04:36,346][106226] Updated weights for policy 0, policy_version 117918 (0.0008) [2023-12-27 20:04:36,407][106225] Updated weights for policy 1, policy_version 117865 (0.0006) [2023-12-27 20:04:36,409][106226] Updated weights for policy 0, policy_version 117928 (0.0009) [2023-12-27 20:04:36,476][106225] Updated weights for policy 1, policy_version 117875 (0.0008) [2023-12-27 20:04:36,537][106225] Updated weights for policy 1, policy_version 117885 (0.0008) [2023-12-27 20:04:37,068][106226] Updated weights for policy 0, policy_version 117938 (0.0005) [2023-12-27 20:04:37,127][106226] Updated weights for policy 0, policy_version 117948 (0.0007) [2023-12-27 20:04:37,197][106226] Updated weights for policy 0, policy_version 117958 (0.0005) [2023-12-27 20:04:37,299][106225] Updated weights for policy 1, policy_version 117895 (0.0009) [2023-12-27 20:04:37,354][106225] Updated weights for policy 1, policy_version 117905 (0.0008) [2023-12-27 20:04:37,412][106225] Updated weights for policy 1, policy_version 117915 (0.0008) [2023-12-27 20:04:37,799][106226] Updated weights for policy 0, policy_version 117968 (0.0010) [2023-12-27 20:04:37,852][106226] Updated weights for policy 0, policy_version 117978 (0.0010) [2023-12-27 20:04:37,905][106226] Updated weights for policy 0, policy_version 117988 (0.0010) [2023-12-27 20:04:38,208][106225] Updated weights for policy 1, policy_version 117925 (0.0008) [2023-12-27 20:04:38,254][106225] Updated weights for policy 1, policy_version 117935 (0.0007) [2023-12-27 20:04:38,298][106225] Updated weights for policy 1, policy_version 117945 (0.0007) [2023-12-27 20:04:38,532][106226] Updated weights for policy 0, policy_version 117998 (0.0010) [2023-12-27 20:04:38,592][106226] Updated weights for policy 0, policy_version 118008 (0.0010) [2023-12-27 20:04:38,656][106226] Updated weights for policy 0, policy_version 118018 (0.0011) [2023-12-27 20:04:39,013][106225] Updated weights for policy 1, policy_version 117955 (0.0008) [2023-12-27 20:04:39,074][106225] Updated weights for policy 1, policy_version 117965 (0.0006) [2023-12-27 20:04:39,124][106225] Updated weights for policy 1, policy_version 117975 (0.0007) [2023-12-27 20:04:39,361][106226] Updated weights for policy 0, policy_version 118028 (0.0011) [2023-12-27 20:04:39,433][106226] Updated weights for policy 0, policy_version 118038 (0.0008) [2023-12-27 20:04:39,490][106226] Updated weights for policy 0, policy_version 118048 (0.0011) [2023-12-27 20:04:39,890][106225] Updated weights for policy 1, policy_version 117985 (0.0008) [2023-12-27 20:04:39,958][106225] Updated weights for policy 1, policy_version 117995 (0.0008) [2023-12-27 20:04:40,021][106225] Updated weights for policy 1, policy_version 118005 (0.0008) [2023-12-27 20:04:40,075][106225] Updated weights for policy 1, policy_version 118015 (0.0008) [2023-12-27 20:04:40,223][106226] Updated weights for policy 0, policy_version 118058 (0.0011) [2023-12-27 20:04:40,293][106226] Updated weights for policy 0, policy_version 118068 (0.0007) [2023-12-27 20:04:40,360][106226] Updated weights for policy 0, policy_version 118078 (0.0011) [2023-12-27 20:04:40,421][106226] Updated weights for policy 0, policy_version 118088 (0.0011) [2023-12-27 20:04:40,839][106225] Updated weights for policy 1, policy_version 118025 (0.0006) [2023-12-27 20:04:40,904][106225] Updated weights for policy 1, policy_version 118035 (0.0007) [2023-12-27 20:04:40,958][106225] Updated weights for policy 1, policy_version 118045 (0.0007) [2023-12-27 20:04:41,093][106226] Updated weights for policy 0, policy_version 118098 (0.0009) [2023-12-27 20:04:41,164][106226] Updated weights for policy 0, policy_version 118108 (0.0009) [2023-12-27 20:04:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 60465152. Throughput: 0: 9940.2, 1: 9947.4. Samples: 60437644. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:41,175][105115] Avg episode reward: [(0, '-5.573'), (1, '-6.717')] [2023-12-27 20:04:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000118048_30228480.pth... [2023-12-27 20:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000116896_29933568.pth [2023-12-27 20:04:41,229][106226] Updated weights for policy 0, policy_version 118118 (0.0009) [2023-12-27 20:04:41,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000118120_30244864.pth... [2023-12-27 20:04:41,244][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000116936_29941760.pth [2023-12-27 20:04:41,752][106225] Updated weights for policy 1, policy_version 118055 (0.0008) [2023-12-27 20:04:41,823][106225] Updated weights for policy 1, policy_version 118065 (0.0007) [2023-12-27 20:04:41,886][106225] Updated weights for policy 1, policy_version 118075 (0.0009) [2023-12-27 20:04:42,054][106226] Updated weights for policy 0, policy_version 118128 (0.0006) [2023-12-27 20:04:42,112][106226] Updated weights for policy 0, policy_version 118138 (0.0007) [2023-12-27 20:04:42,181][106226] Updated weights for policy 0, policy_version 118148 (0.0006) [2023-12-27 20:04:42,609][106225] Updated weights for policy 1, policy_version 118085 (0.0008) [2023-12-27 20:04:42,669][106225] Updated weights for policy 1, policy_version 118095 (0.0009) [2023-12-27 20:04:42,728][106225] Updated weights for policy 1, policy_version 118105 (0.0008) [2023-12-27 20:04:42,856][106226] Updated weights for policy 0, policy_version 118158 (0.0008) [2023-12-27 20:04:42,917][106226] Updated weights for policy 0, policy_version 118168 (0.0007) [2023-12-27 20:04:42,979][106226] Updated weights for policy 0, policy_version 118178 (0.0005) [2023-12-27 20:04:43,513][106225] Updated weights for policy 1, policy_version 118115 (0.0009) [2023-12-27 20:04:43,560][106226] Updated weights for policy 0, policy_version 118188 (0.0006) [2023-12-27 20:04:43,566][106225] Updated weights for policy 1, policy_version 118125 (0.0007) [2023-12-27 20:04:43,611][106226] Updated weights for policy 0, policy_version 118198 (0.0006) [2023-12-27 20:04:43,617][106225] Updated weights for policy 1, policy_version 118135 (0.0007) [2023-12-27 20:04:43,671][106226] Updated weights for policy 0, policy_version 118208 (0.0009) [2023-12-27 20:04:44,368][106226] Updated weights for policy 0, policy_version 118218 (0.0009) [2023-12-27 20:04:44,373][106225] Updated weights for policy 1, policy_version 118145 (0.0007) [2023-12-27 20:04:44,420][106225] Updated weights for policy 1, policy_version 118155 (0.0008) [2023-12-27 20:04:44,427][106226] Updated weights for policy 0, policy_version 118228 (0.0010) [2023-12-27 20:04:44,478][106225] Updated weights for policy 1, policy_version 118165 (0.0007) [2023-12-27 20:04:44,487][106226] Updated weights for policy 0, policy_version 118238 (0.0010) [2023-12-27 20:04:44,522][106225] Updated weights for policy 1, policy_version 118175 (0.0008) [2023-12-27 20:04:44,536][106226] Updated weights for policy 0, policy_version 118248 (0.0010) [2023-12-27 20:04:45,265][106226] Updated weights for policy 0, policy_version 118258 (0.0011) [2023-12-27 20:04:45,300][106225] Updated weights for policy 1, policy_version 118185 (0.0009) [2023-12-27 20:04:45,326][106226] Updated weights for policy 0, policy_version 118268 (0.0011) [2023-12-27 20:04:45,355][106225] Updated weights for policy 1, policy_version 118195 (0.0006) [2023-12-27 20:04:45,382][106226] Updated weights for policy 0, policy_version 118278 (0.0010) [2023-12-27 20:04:45,420][106225] Updated weights for policy 1, policy_version 118205 (0.0007) [2023-12-27 20:04:46,021][106226] Updated weights for policy 0, policy_version 118288 (0.0009) [2023-12-27 20:04:46,077][106226] Updated weights for policy 0, policy_version 118298 (0.0008) [2023-12-27 20:04:46,137][106226] Updated weights for policy 0, policy_version 118308 (0.0007) [2023-12-27 20:04:46,171][106225] Updated weights for policy 1, policy_version 118215 (0.0007) [2023-12-27 20:04:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 60563456. Throughput: 0: 9953.3, 1: 9777.3. Samples: 60552000. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:46,175][105115] Avg episode reward: [(0, '-5.611'), (1, '-6.755')] [2023-12-27 20:04:46,232][106225] Updated weights for policy 1, policy_version 118225 (0.0008) [2023-12-27 20:04:46,289][106225] Updated weights for policy 1, policy_version 118235 (0.0008) [2023-12-27 20:04:46,856][106226] Updated weights for policy 0, policy_version 118318 (0.0006) [2023-12-27 20:04:46,910][106226] Updated weights for policy 0, policy_version 118328 (0.0006) [2023-12-27 20:04:46,958][106226] Updated weights for policy 0, policy_version 118338 (0.0008) [2023-12-27 20:04:47,017][106225] Updated weights for policy 1, policy_version 118245 (0.0009) [2023-12-27 20:04:47,068][106225] Updated weights for policy 1, policy_version 118255 (0.0008) [2023-12-27 20:04:47,125][106225] Updated weights for policy 1, policy_version 118265 (0.0009) [2023-12-27 20:04:47,678][106225] Updated weights for policy 1, policy_version 118275 (0.0006) [2023-12-27 20:04:47,735][106225] Updated weights for policy 1, policy_version 118285 (0.0005) [2023-12-27 20:04:47,758][106226] Updated weights for policy 0, policy_version 118348 (0.0008) [2023-12-27 20:04:47,786][106225] Updated weights for policy 1, policy_version 118295 (0.0005) [2023-12-27 20:04:47,819][106226] Updated weights for policy 0, policy_version 118358 (0.0007) [2023-12-27 20:04:47,880][106226] Updated weights for policy 0, policy_version 118368 (0.0009) [2023-12-27 20:04:48,337][106225] Updated weights for policy 1, policy_version 118305 (0.0006) [2023-12-27 20:04:48,409][106225] Updated weights for policy 1, policy_version 118315 (0.0010) [2023-12-27 20:04:48,474][106225] Updated weights for policy 1, policy_version 118325 (0.0011) [2023-12-27 20:04:48,538][106225] Updated weights for policy 1, policy_version 118335 (0.0010) [2023-12-27 20:04:48,577][106226] Updated weights for policy 0, policy_version 118378 (0.0007) [2023-12-27 20:04:48,639][106226] Updated weights for policy 0, policy_version 118388 (0.0010) [2023-12-27 20:04:48,690][106226] Updated weights for policy 0, policy_version 118398 (0.0009) [2023-12-27 20:04:48,757][106226] Updated weights for policy 0, policy_version 118408 (0.0010) [2023-12-27 20:04:49,232][106225] Updated weights for policy 1, policy_version 118345 (0.0010) [2023-12-27 20:04:49,299][106225] Updated weights for policy 1, policy_version 118355 (0.0008) [2023-12-27 20:04:49,367][106225] Updated weights for policy 1, policy_version 118365 (0.0009) [2023-12-27 20:04:49,498][106226] Updated weights for policy 0, policy_version 118418 (0.0009) [2023-12-27 20:04:49,559][106226] Updated weights for policy 0, policy_version 118428 (0.0009) [2023-12-27 20:04:49,621][106226] Updated weights for policy 0, policy_version 118438 (0.0007) [2023-12-27 20:04:50,059][106225] Updated weights for policy 1, policy_version 118375 (0.0008) [2023-12-27 20:04:50,125][106225] Updated weights for policy 1, policy_version 118385 (0.0009) [2023-12-27 20:04:50,184][106225] Updated weights for policy 1, policy_version 118395 (0.0006) [2023-12-27 20:04:50,413][106226] Updated weights for policy 0, policy_version 118448 (0.0010) [2023-12-27 20:04:50,468][106226] Updated weights for policy 0, policy_version 118458 (0.0008) [2023-12-27 20:04:50,528][106226] Updated weights for policy 0, policy_version 118468 (0.0009) [2023-12-27 20:04:50,883][106225] Updated weights for policy 1, policy_version 118405 (0.0007) [2023-12-27 20:04:50,945][106225] Updated weights for policy 1, policy_version 118415 (0.0009) [2023-12-27 20:04:51,006][106225] Updated weights for policy 1, policy_version 118425 (0.0009) [2023-12-27 20:04:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 60661760. Throughput: 0: 9875.2, 1: 9813.9. Samples: 60670408. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:51,175][105115] Avg episode reward: [(0, '-5.314'), (1, '-6.919')] [2023-12-27 20:04:51,338][106226] Updated weights for policy 0, policy_version 118478 (0.0009) [2023-12-27 20:04:51,414][106226] Updated weights for policy 0, policy_version 118488 (0.0009) [2023-12-27 20:04:51,484][106226] Updated weights for policy 0, policy_version 118498 (0.0011) [2023-12-27 20:04:51,775][106225] Updated weights for policy 1, policy_version 118435 (0.0008) [2023-12-27 20:04:51,838][106225] Updated weights for policy 1, policy_version 118445 (0.0008) [2023-12-27 20:04:51,893][106225] Updated weights for policy 1, policy_version 118455 (0.0008) [2023-12-27 20:04:52,141][106226] Updated weights for policy 0, policy_version 118508 (0.0009) [2023-12-27 20:04:52,195][106226] Updated weights for policy 0, policy_version 118518 (0.0008) [2023-12-27 20:04:52,266][106226] Updated weights for policy 0, policy_version 118528 (0.0007) [2023-12-27 20:04:52,672][106225] Updated weights for policy 1, policy_version 118466 (0.0010) [2023-12-27 20:04:52,728][106225] Updated weights for policy 1, policy_version 118476 (0.0008) [2023-12-27 20:04:52,790][106225] Updated weights for policy 1, policy_version 118486 (0.0010) [2023-12-27 20:04:52,841][106225] Updated weights for policy 1, policy_version 118496 (0.0008) [2023-12-27 20:04:53,003][106226] Updated weights for policy 0, policy_version 118538 (0.0008) [2023-12-27 20:04:53,056][106226] Updated weights for policy 0, policy_version 118548 (0.0008) [2023-12-27 20:04:53,119][106226] Updated weights for policy 0, policy_version 118558 (0.0006) [2023-12-27 20:04:53,173][106226] Updated weights for policy 0, policy_version 118568 (0.0007) [2023-12-27 20:04:53,506][106225] Updated weights for policy 1, policy_version 118506 (0.0005) [2023-12-27 20:04:53,562][106225] Updated weights for policy 1, policy_version 118516 (0.0007) [2023-12-27 20:04:53,623][106225] Updated weights for policy 1, policy_version 118526 (0.0007) [2023-12-27 20:04:53,850][106226] Updated weights for policy 0, policy_version 118578 (0.0008) [2023-12-27 20:04:53,908][106226] Updated weights for policy 0, policy_version 118588 (0.0008) [2023-12-27 20:04:53,961][106226] Updated weights for policy 0, policy_version 118598 (0.0007) [2023-12-27 20:04:54,280][106225] Updated weights for policy 1, policy_version 118536 (0.0005) [2023-12-27 20:04:54,337][106225] Updated weights for policy 1, policy_version 118546 (0.0005) [2023-12-27 20:04:54,391][106225] Updated weights for policy 1, policy_version 118556 (0.0005) [2023-12-27 20:04:54,753][106226] Updated weights for policy 0, policy_version 118608 (0.0009) [2023-12-27 20:04:54,798][106226] Updated weights for policy 0, policy_version 118618 (0.0008) [2023-12-27 20:04:54,843][106226] Updated weights for policy 0, policy_version 118628 (0.0007) [2023-12-27 20:04:55,009][106225] Updated weights for policy 1, policy_version 118566 (0.0009) [2023-12-27 20:04:55,067][106225] Updated weights for policy 1, policy_version 118576 (0.0010) [2023-12-27 20:04:55,117][106225] Updated weights for policy 1, policy_version 118586 (0.0010) [2023-12-27 20:04:55,566][106226] Updated weights for policy 0, policy_version 118638 (0.0007) [2023-12-27 20:04:55,615][106226] Updated weights for policy 0, policy_version 118648 (0.0008) [2023-12-27 20:04:55,659][106226] Updated weights for policy 0, policy_version 118658 (0.0005) [2023-12-27 20:04:55,763][106225] Updated weights for policy 1, policy_version 118596 (0.0009) [2023-12-27 20:04:55,812][106225] Updated weights for policy 1, policy_version 118606 (0.0009) [2023-12-27 20:04:55,862][106225] Updated weights for policy 1, policy_version 118616 (0.0009) [2023-12-27 20:04:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 60760064. Throughput: 0: 9866.6, 1: 9802.9. Samples: 60727540. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:04:56,175][105115] Avg episode reward: [(0, '-5.545'), (1, '-6.414')] [2023-12-27 20:04:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000118624_30375936.pth... [2023-12-27 20:04:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000117472_30081024.pth [2023-12-27 20:04:56,213][106226] Updated weights for policy 0, policy_version 118668 (0.0010) [2023-12-27 20:04:56,274][106226] Updated weights for policy 0, policy_version 118678 (0.0011) [2023-12-27 20:04:56,338][106226] Updated weights for policy 0, policy_version 118688 (0.0011) [2023-12-27 20:04:56,377][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000118696_30392320.pth... [2023-12-27 20:04:56,380][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000117512_30089216.pth [2023-12-27 20:04:56,602][106225] Updated weights for policy 1, policy_version 118626 (0.0008) [2023-12-27 20:04:56,655][106225] Updated weights for policy 1, policy_version 118636 (0.0006) [2023-12-27 20:04:56,698][106225] Updated weights for policy 1, policy_version 118646 (0.0005) [2023-12-27 20:04:56,745][106225] Updated weights for policy 1, policy_version 118656 (0.0005) [2023-12-27 20:04:56,948][106226] Updated weights for policy 0, policy_version 118698 (0.0010) [2023-12-27 20:04:57,017][106226] Updated weights for policy 0, policy_version 118708 (0.0008) [2023-12-27 20:04:57,083][106226] Updated weights for policy 0, policy_version 118718 (0.0008) [2023-12-27 20:04:57,143][106226] Updated weights for policy 0, policy_version 118728 (0.0010) [2023-12-27 20:04:57,335][106225] Updated weights for policy 1, policy_version 118666 (0.0005) [2023-12-27 20:04:57,398][106225] Updated weights for policy 1, policy_version 118676 (0.0005) [2023-12-27 20:04:57,454][106225] Updated weights for policy 1, policy_version 118686 (0.0005) [2023-12-27 20:04:57,826][106226] Updated weights for policy 0, policy_version 118738 (0.0010) [2023-12-27 20:04:57,872][106226] Updated weights for policy 0, policy_version 118748 (0.0010) [2023-12-27 20:04:57,928][106226] Updated weights for policy 0, policy_version 118758 (0.0010) [2023-12-27 20:04:57,975][106225] Updated weights for policy 1, policy_version 118696 (0.0005) [2023-12-27 20:04:58,029][106225] Updated weights for policy 1, policy_version 118706 (0.0007) [2023-12-27 20:04:58,081][106225] Updated weights for policy 1, policy_version 118716 (0.0007) [2023-12-27 20:04:58,689][106226] Updated weights for policy 0, policy_version 118768 (0.0011) [2023-12-27 20:04:58,755][106226] Updated weights for policy 0, policy_version 118778 (0.0012) [2023-12-27 20:04:58,826][106225] Updated weights for policy 1, policy_version 118726 (0.0009) [2023-12-27 20:04:58,834][106226] Updated weights for policy 0, policy_version 118788 (0.0010) [2023-12-27 20:04:58,889][106225] Updated weights for policy 1, policy_version 118736 (0.0009) [2023-12-27 20:04:58,964][106225] Updated weights for policy 1, policy_version 118746 (0.0009) [2023-12-27 20:04:59,670][106226] Updated weights for policy 0, policy_version 118798 (0.0010) [2023-12-27 20:04:59,717][106226] Updated weights for policy 0, policy_version 118808 (0.0010) [2023-12-27 20:04:59,758][106225] Updated weights for policy 1, policy_version 118756 (0.0007) [2023-12-27 20:04:59,767][106226] Updated weights for policy 0, policy_version 118818 (0.0010) [2023-12-27 20:04:59,817][106225] Updated weights for policy 1, policy_version 118766 (0.0006) [2023-12-27 20:04:59,879][106225] Updated weights for policy 1, policy_version 118776 (0.0008) [2023-12-27 20:05:00,386][106226] Updated weights for policy 0, policy_version 118828 (0.0010) [2023-12-27 20:05:00,440][106226] Updated weights for policy 0, policy_version 118838 (0.0008) [2023-12-27 20:05:00,501][106226] Updated weights for policy 0, policy_version 118848 (0.0005) [2023-12-27 20:05:00,643][106225] Updated weights for policy 1, policy_version 118786 (0.0012) [2023-12-27 20:05:00,700][106225] Updated weights for policy 1, policy_version 118796 (0.0010) [2023-12-27 20:05:00,746][106225] Updated weights for policy 1, policy_version 118806 (0.0007) [2023-12-27 20:05:00,806][106225] Updated weights for policy 1, policy_version 118816 (0.0010) [2023-12-27 20:05:01,055][106226] Updated weights for policy 0, policy_version 118858 (0.0008) [2023-12-27 20:05:01,114][106226] Updated weights for policy 0, policy_version 118868 (0.0008) [2023-12-27 20:05:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 60858368. Throughput: 0: 9928.8, 1: 9863.4. Samples: 60849504. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:05:01,175][105115] Avg episode reward: [(0, '-5.508'), (1, '-6.680')] [2023-12-27 20:05:01,177][106226] Updated weights for policy 0, policy_version 118878 (0.0008) [2023-12-27 20:05:01,232][106226] Updated weights for policy 0, policy_version 118888 (0.0008) [2023-12-27 20:05:01,576][106225] Updated weights for policy 1, policy_version 118826 (0.0008) [2023-12-27 20:05:01,642][106225] Updated weights for policy 1, policy_version 118836 (0.0008) [2023-12-27 20:05:01,703][106225] Updated weights for policy 1, policy_version 118846 (0.0008) [2023-12-27 20:05:01,976][106226] Updated weights for policy 0, policy_version 118898 (0.0008) [2023-12-27 20:05:02,039][106226] Updated weights for policy 0, policy_version 118908 (0.0006) [2023-12-27 20:05:02,102][106226] Updated weights for policy 0, policy_version 118918 (0.0009) [2023-12-27 20:05:02,438][106225] Updated weights for policy 1, policy_version 118856 (0.0008) [2023-12-27 20:05:02,490][106225] Updated weights for policy 1, policy_version 118866 (0.0008) [2023-12-27 20:05:02,547][106225] Updated weights for policy 1, policy_version 118876 (0.0009) [2023-12-27 20:05:02,887][106226] Updated weights for policy 0, policy_version 118928 (0.0008) [2023-12-27 20:05:02,935][106226] Updated weights for policy 0, policy_version 118938 (0.0008) [2023-12-27 20:05:03,001][106226] Updated weights for policy 0, policy_version 118948 (0.0009) [2023-12-27 20:05:03,212][106225] Updated weights for policy 1, policy_version 118886 (0.0008) [2023-12-27 20:05:03,265][106225] Updated weights for policy 1, policy_version 118896 (0.0007) [2023-12-27 20:05:03,318][106225] Updated weights for policy 1, policy_version 118906 (0.0005) [2023-12-27 20:05:03,725][106226] Updated weights for policy 0, policy_version 118958 (0.0008) [2023-12-27 20:05:03,778][106226] Updated weights for policy 0, policy_version 118968 (0.0009) [2023-12-27 20:05:03,867][106226] Updated weights for policy 0, policy_version 118978 (0.0008) [2023-12-27 20:05:04,035][106225] Updated weights for policy 1, policy_version 118916 (0.0007) [2023-12-27 20:05:04,095][106225] Updated weights for policy 1, policy_version 118926 (0.0009) [2023-12-27 20:05:04,159][106225] Updated weights for policy 1, policy_version 118936 (0.0008) [2023-12-27 20:05:04,624][106226] Updated weights for policy 0, policy_version 118988 (0.0009) [2023-12-27 20:05:04,675][106226] Updated weights for policy 0, policy_version 118998 (0.0009) [2023-12-27 20:05:04,735][106226] Updated weights for policy 0, policy_version 119008 (0.0009) [2023-12-27 20:05:04,846][106225] Updated weights for policy 1, policy_version 118946 (0.0008) [2023-12-27 20:05:04,905][106225] Updated weights for policy 1, policy_version 118956 (0.0008) [2023-12-27 20:05:04,957][106225] Updated weights for policy 1, policy_version 118966 (0.0009) [2023-12-27 20:05:05,006][106225] Updated weights for policy 1, policy_version 118976 (0.0008) [2023-12-27 20:05:05,452][106226] Updated weights for policy 0, policy_version 119018 (0.0009) [2023-12-27 20:05:05,497][106226] Updated weights for policy 0, policy_version 119028 (0.0008) [2023-12-27 20:05:05,546][106226] Updated weights for policy 0, policy_version 119038 (0.0009) [2023-12-27 20:05:05,600][106226] Updated weights for policy 0, policy_version 119048 (0.0008) [2023-12-27 20:05:05,741][106225] Updated weights for policy 1, policy_version 118986 (0.0008) [2023-12-27 20:05:05,796][106225] Updated weights for policy 1, policy_version 118996 (0.0008) [2023-12-27 20:05:05,847][106225] Updated weights for policy 1, policy_version 119006 (0.0008) [2023-12-27 20:05:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 60956672. Throughput: 0: 9840.2, 1: 9873.7. Samples: 60966728. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:05:06,175][105115] Avg episode reward: [(0, '-5.645'), (1, '-6.691')] [2023-12-27 20:05:06,367][106226] Updated weights for policy 0, policy_version 119058 (0.0009) [2023-12-27 20:05:06,429][106226] Updated weights for policy 0, policy_version 119068 (0.0009) [2023-12-27 20:05:06,499][106226] Updated weights for policy 0, policy_version 119078 (0.0009) [2023-12-27 20:05:06,600][106225] Updated weights for policy 1, policy_version 119016 (0.0008) [2023-12-27 20:05:06,648][106225] Updated weights for policy 1, policy_version 119026 (0.0008) [2023-12-27 20:05:06,704][106225] Updated weights for policy 1, policy_version 119036 (0.0008) [2023-12-27 20:05:07,222][106226] Updated weights for policy 0, policy_version 119088 (0.0009) [2023-12-27 20:05:07,278][106226] Updated weights for policy 0, policy_version 119098 (0.0009) [2023-12-27 20:05:07,335][106226] Updated weights for policy 0, policy_version 119108 (0.0009) [2023-12-27 20:05:07,455][106225] Updated weights for policy 1, policy_version 119046 (0.0009) [2023-12-27 20:05:07,517][106225] Updated weights for policy 1, policy_version 119056 (0.0008) [2023-12-27 20:05:07,577][106225] Updated weights for policy 1, policy_version 119066 (0.0008) [2023-12-27 20:05:08,083][106226] Updated weights for policy 0, policy_version 119118 (0.0008) [2023-12-27 20:05:08,147][106226] Updated weights for policy 0, policy_version 119128 (0.0008) [2023-12-27 20:05:08,211][106226] Updated weights for policy 0, policy_version 119138 (0.0008) [2023-12-27 20:05:08,268][106225] Updated weights for policy 1, policy_version 119076 (0.0008) [2023-12-27 20:05:08,327][106225] Updated weights for policy 1, policy_version 119086 (0.0010) [2023-12-27 20:05:08,398][106225] Updated weights for policy 1, policy_version 119096 (0.0011) [2023-12-27 20:05:08,957][106226] Updated weights for policy 0, policy_version 119148 (0.0008) [2023-12-27 20:05:09,007][106226] Updated weights for policy 0, policy_version 119158 (0.0008) [2023-12-27 20:05:09,054][106225] Updated weights for policy 1, policy_version 119106 (0.0010) [2023-12-27 20:05:09,060][106226] Updated weights for policy 0, policy_version 119168 (0.0007) [2023-12-27 20:05:09,105][106225] Updated weights for policy 1, policy_version 119116 (0.0009) [2023-12-27 20:05:09,151][106225] Updated weights for policy 1, policy_version 119126 (0.0010) [2023-12-27 20:05:09,203][106225] Updated weights for policy 1, policy_version 119136 (0.0010) [2023-12-27 20:05:09,889][106226] Updated weights for policy 0, policy_version 119178 (0.0007) [2023-12-27 20:05:09,961][106226] Updated weights for policy 0, policy_version 119188 (0.0007) [2023-12-27 20:05:09,978][106225] Updated weights for policy 1, policy_version 119146 (0.0010) [2023-12-27 20:05:10,025][106226] Updated weights for policy 0, policy_version 119198 (0.0007) [2023-12-27 20:05:10,041][106225] Updated weights for policy 1, policy_version 119156 (0.0008) [2023-12-27 20:05:10,091][106226] Updated weights for policy 0, policy_version 119208 (0.0007) [2023-12-27 20:05:10,106][106225] Updated weights for policy 1, policy_version 119166 (0.0009) [2023-12-27 20:05:10,741][106225] Updated weights for policy 1, policy_version 119176 (0.0010) [2023-12-27 20:05:10,796][106225] Updated weights for policy 1, policy_version 119186 (0.0009) [2023-12-27 20:05:10,834][106226] Updated weights for policy 0, policy_version 119218 (0.0009) [2023-12-27 20:05:10,854][106225] Updated weights for policy 1, policy_version 119196 (0.0009) [2023-12-27 20:05:10,893][106226] Updated weights for policy 0, policy_version 119228 (0.0009) [2023-12-27 20:05:10,940][106226] Updated weights for policy 0, policy_version 119238 (0.0008) [2023-12-27 20:05:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 61054976. Throughput: 0: 9845.8, 1: 9858.9. Samples: 61023648. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:05:11,175][105115] Avg episode reward: [(0, '-5.384'), (1, '-6.736')] [2023-12-27 20:05:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000119240_30531584.pth... [2023-12-27 20:05:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000119200_30523392.pth... [2023-12-27 20:05:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000118120_30244864.pth [2023-12-27 20:05:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000118048_30228480.pth [2023-12-27 20:05:11,562][106225] Updated weights for policy 1, policy_version 119206 (0.0008) [2023-12-27 20:05:11,635][106225] Updated weights for policy 1, policy_version 119216 (0.0008) [2023-12-27 20:05:11,696][106225] Updated weights for policy 1, policy_version 119226 (0.0009) [2023-12-27 20:05:11,804][106226] Updated weights for policy 0, policy_version 119248 (0.0009) [2023-12-27 20:05:11,860][106226] Updated weights for policy 0, policy_version 119258 (0.0008) [2023-12-27 20:05:11,925][106226] Updated weights for policy 0, policy_version 119268 (0.0008) [2023-12-27 20:05:12,524][106225] Updated weights for policy 1, policy_version 119236 (0.0007) [2023-12-27 20:05:12,587][106225] Updated weights for policy 1, policy_version 119246 (0.0007) [2023-12-27 20:05:12,597][106226] Updated weights for policy 0, policy_version 119278 (0.0008) [2023-12-27 20:05:12,645][106225] Updated weights for policy 1, policy_version 119256 (0.0008) [2023-12-27 20:05:12,661][106226] Updated weights for policy 0, policy_version 119288 (0.0008) [2023-12-27 20:05:12,728][106226] Updated weights for policy 0, policy_version 119298 (0.0009) [2023-12-27 20:05:13,327][106225] Updated weights for policy 1, policy_version 119266 (0.0010) [2023-12-27 20:05:13,381][106226] Updated weights for policy 0, policy_version 119308 (0.0007) [2023-12-27 20:05:13,382][106225] Updated weights for policy 1, policy_version 119276 (0.0009) [2023-12-27 20:05:13,438][106225] Updated weights for policy 1, policy_version 119286 (0.0007) [2023-12-27 20:05:13,441][106226] Updated weights for policy 0, policy_version 119318 (0.0007) [2023-12-27 20:05:13,500][106225] Updated weights for policy 1, policy_version 119296 (0.0006) [2023-12-27 20:05:13,507][106226] Updated weights for policy 0, policy_version 119328 (0.0008) [2023-12-27 20:05:14,047][106226] Updated weights for policy 0, policy_version 119338 (0.0009) [2023-12-27 20:05:14,099][106225] Updated weights for policy 1, policy_version 119306 (0.0005) [2023-12-27 20:05:14,103][106226] Updated weights for policy 0, policy_version 119348 (0.0005) [2023-12-27 20:05:14,151][106225] Updated weights for policy 1, policy_version 119316 (0.0008) [2023-12-27 20:05:14,153][106226] Updated weights for policy 0, policy_version 119358 (0.0005) [2023-12-27 20:05:14,207][106226] Updated weights for policy 0, policy_version 119368 (0.0010) [2023-12-27 20:05:14,209][106225] Updated weights for policy 1, policy_version 119326 (0.0006) [2023-12-27 20:05:14,874][106226] Updated weights for policy 0, policy_version 119378 (0.0011) [2023-12-27 20:05:14,939][106226] Updated weights for policy 0, policy_version 119388 (0.0010) [2023-12-27 20:05:14,939][106225] Updated weights for policy 1, policy_version 119336 (0.0009) [2023-12-27 20:05:14,998][106225] Updated weights for policy 1, policy_version 119346 (0.0007) [2023-12-27 20:05:15,000][106226] Updated weights for policy 0, policy_version 119398 (0.0010) [2023-12-27 20:05:15,064][106225] Updated weights for policy 1, policy_version 119356 (0.0008) [2023-12-27 20:05:15,613][106226] Updated weights for policy 0, policy_version 119408 (0.0006) [2023-12-27 20:05:15,666][106226] Updated weights for policy 0, policy_version 119418 (0.0005) [2023-12-27 20:05:15,721][106226] Updated weights for policy 0, policy_version 119428 (0.0005) [2023-12-27 20:05:15,866][106225] Updated weights for policy 1, policy_version 119366 (0.0009) [2023-12-27 20:05:15,915][106225] Updated weights for policy 1, policy_version 119376 (0.0009) [2023-12-27 20:05:15,966][106225] Updated weights for policy 1, policy_version 119386 (0.0007) [2023-12-27 20:05:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 61153280. Throughput: 0: 9820.1, 1: 9834.0. Samples: 61141892. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:16,175][105115] Avg episode reward: [(0, '-5.397'), (1, '-6.686')] [2023-12-27 20:05:16,288][106226] Updated weights for policy 0, policy_version 119438 (0.0008) [2023-12-27 20:05:16,347][106226] Updated weights for policy 0, policy_version 119448 (0.0010) [2023-12-27 20:05:16,410][106226] Updated weights for policy 0, policy_version 119458 (0.0010) [2023-12-27 20:05:16,672][106225] Updated weights for policy 1, policy_version 119396 (0.0006) [2023-12-27 20:05:16,721][106225] Updated weights for policy 1, policy_version 119406 (0.0005) [2023-12-27 20:05:16,774][106225] Updated weights for policy 1, policy_version 119416 (0.0005) [2023-12-27 20:05:17,052][106226] Updated weights for policy 0, policy_version 119468 (0.0008) [2023-12-27 20:05:17,113][106226] Updated weights for policy 0, policy_version 119478 (0.0007) [2023-12-27 20:05:17,178][106226] Updated weights for policy 0, policy_version 119488 (0.0005) [2023-12-27 20:05:17,319][106225] Updated weights for policy 1, policy_version 119426 (0.0005) [2023-12-27 20:05:17,371][106225] Updated weights for policy 1, policy_version 119436 (0.0005) [2023-12-27 20:05:17,426][106225] Updated weights for policy 1, policy_version 119446 (0.0005) [2023-12-27 20:05:17,490][106225] Updated weights for policy 1, policy_version 119456 (0.0005) [2023-12-27 20:05:17,700][106226] Updated weights for policy 0, policy_version 119498 (0.0010) [2023-12-27 20:05:17,767][106226] Updated weights for policy 0, policy_version 119508 (0.0010) [2023-12-27 20:05:17,822][106226] Updated weights for policy 0, policy_version 119518 (0.0007) [2023-12-27 20:05:17,884][106226] Updated weights for policy 0, policy_version 119528 (0.0005) [2023-12-27 20:05:18,076][106225] Updated weights for policy 1, policy_version 119466 (0.0005) [2023-12-27 20:05:18,138][106225] Updated weights for policy 1, policy_version 119476 (0.0005) [2023-12-27 20:05:18,201][106225] Updated weights for policy 1, policy_version 119486 (0.0005) [2023-12-27 20:05:18,527][106226] Updated weights for policy 0, policy_version 119538 (0.0011) [2023-12-27 20:05:18,591][106226] Updated weights for policy 0, policy_version 119548 (0.0010) [2023-12-27 20:05:18,652][106226] Updated weights for policy 0, policy_version 119558 (0.0007) [2023-12-27 20:05:18,892][106225] Updated weights for policy 1, policy_version 119496 (0.0007) [2023-12-27 20:05:18,941][106225] Updated weights for policy 1, policy_version 119506 (0.0007) [2023-12-27 20:05:18,997][106225] Updated weights for policy 1, policy_version 119516 (0.0009) [2023-12-27 20:05:19,347][106226] Updated weights for policy 0, policy_version 119568 (0.0009) [2023-12-27 20:05:19,413][106226] Updated weights for policy 0, policy_version 119578 (0.0008) [2023-12-27 20:05:19,472][106226] Updated weights for policy 0, policy_version 119588 (0.0009) [2023-12-27 20:05:19,693][106225] Updated weights for policy 1, policy_version 119526 (0.0008) [2023-12-27 20:05:19,753][106225] Updated weights for policy 1, policy_version 119536 (0.0008) [2023-12-27 20:05:19,817][106225] Updated weights for policy 1, policy_version 119546 (0.0009) [2023-12-27 20:05:20,306][106226] Updated weights for policy 0, policy_version 119598 (0.0011) [2023-12-27 20:05:20,374][106226] Updated weights for policy 0, policy_version 119608 (0.0007) [2023-12-27 20:05:20,445][106226] Updated weights for policy 0, policy_version 119618 (0.0008) [2023-12-27 20:05:20,603][106225] Updated weights for policy 1, policy_version 119556 (0.0008) [2023-12-27 20:05:20,670][106225] Updated weights for policy 1, policy_version 119566 (0.0007) [2023-12-27 20:05:20,727][106225] Updated weights for policy 1, policy_version 119576 (0.0008) [2023-12-27 20:05:21,163][106226] Updated weights for policy 0, policy_version 119628 (0.0009) [2023-12-27 20:05:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 61251584. Throughput: 0: 9861.8, 1: 9834.4. Samples: 61264616. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:21,175][105115] Avg episode reward: [(0, '-5.312'), (1, '-6.980')] [2023-12-27 20:05:21,219][106226] Updated weights for policy 0, policy_version 119638 (0.0011) [2023-12-27 20:05:21,281][106226] Updated weights for policy 0, policy_version 119648 (0.0011) [2023-12-27 20:05:21,507][106225] Updated weights for policy 1, policy_version 119586 (0.0008) [2023-12-27 20:05:21,572][106225] Updated weights for policy 1, policy_version 119596 (0.0008) [2023-12-27 20:05:21,637][106225] Updated weights for policy 1, policy_version 119606 (0.0007) [2023-12-27 20:05:21,701][106225] Updated weights for policy 1, policy_version 119616 (0.0007) [2023-12-27 20:05:22,068][106226] Updated weights for policy 0, policy_version 119658 (0.0010) [2023-12-27 20:05:22,120][106226] Updated weights for policy 0, policy_version 119668 (0.0005) [2023-12-27 20:05:22,183][106226] Updated weights for policy 0, policy_version 119678 (0.0006) [2023-12-27 20:05:22,245][106226] Updated weights for policy 0, policy_version 119688 (0.0007) [2023-12-27 20:05:22,456][106225] Updated weights for policy 1, policy_version 119626 (0.0007) [2023-12-27 20:05:22,522][106225] Updated weights for policy 1, policy_version 119636 (0.0009) [2023-12-27 20:05:22,586][106225] Updated weights for policy 1, policy_version 119646 (0.0008) [2023-12-27 20:05:22,944][106226] Updated weights for policy 0, policy_version 119698 (0.0010) [2023-12-27 20:05:23,012][106226] Updated weights for policy 0, policy_version 119708 (0.0011) [2023-12-27 20:05:23,070][106226] Updated weights for policy 0, policy_version 119718 (0.0011) [2023-12-27 20:05:23,308][106225] Updated weights for policy 1, policy_version 119656 (0.0008) [2023-12-27 20:05:23,371][106225] Updated weights for policy 1, policy_version 119666 (0.0008) [2023-12-27 20:05:23,427][106225] Updated weights for policy 1, policy_version 119676 (0.0008) [2023-12-27 20:05:23,693][106226] Updated weights for policy 0, policy_version 119728 (0.0007) [2023-12-27 20:05:23,739][106226] Updated weights for policy 0, policy_version 119738 (0.0005) [2023-12-27 20:05:23,788][106226] Updated weights for policy 0, policy_version 119748 (0.0005) [2023-12-27 20:05:24,243][106225] Updated weights for policy 1, policy_version 119686 (0.0007) [2023-12-27 20:05:24,303][106225] Updated weights for policy 1, policy_version 119696 (0.0007) [2023-12-27 20:05:24,368][106225] Updated weights for policy 1, policy_version 119706 (0.0007) [2023-12-27 20:05:24,381][106226] Updated weights for policy 0, policy_version 119758 (0.0006) [2023-12-27 20:05:24,445][106226] Updated weights for policy 0, policy_version 119768 (0.0006) [2023-12-27 20:05:24,510][106226] Updated weights for policy 0, policy_version 119778 (0.0008) [2023-12-27 20:05:25,066][106225] Updated weights for policy 1, policy_version 119716 (0.0006) [2023-12-27 20:05:25,125][106225] Updated weights for policy 1, policy_version 119726 (0.0007) [2023-12-27 20:05:25,185][106225] Updated weights for policy 1, policy_version 119736 (0.0008) [2023-12-27 20:05:25,196][106226] Updated weights for policy 0, policy_version 119788 (0.0011) [2023-12-27 20:05:25,257][106226] Updated weights for policy 0, policy_version 119798 (0.0011) [2023-12-27 20:05:25,311][106226] Updated weights for policy 0, policy_version 119808 (0.0008) [2023-12-27 20:05:25,841][106225] Updated weights for policy 1, policy_version 119746 (0.0008) [2023-12-27 20:05:25,903][106225] Updated weights for policy 1, policy_version 119756 (0.0009) [2023-12-27 20:05:25,972][106225] Updated weights for policy 1, policy_version 119766 (0.0007) [2023-12-27 20:05:26,001][106226] Updated weights for policy 0, policy_version 119818 (0.0010) [2023-12-27 20:05:26,033][106225] Updated weights for policy 1, policy_version 119776 (0.0009) [2023-12-27 20:05:26,050][106226] Updated weights for policy 0, policy_version 119828 (0.0005) [2023-12-27 20:05:26,103][106226] Updated weights for policy 0, policy_version 119838 (0.0005) [2023-12-27 20:05:26,173][106226] Updated weights for policy 0, policy_version 119848 (0.0005) [2023-12-27 20:05:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 61358080. Throughput: 0: 9844.0, 1: 9814.9. Samples: 61322292. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:26,175][105115] Avg episode reward: [(0, '-5.115'), (1, '-6.706')] [2023-12-27 20:05:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000119776_30670848.pth... [2023-12-27 20:05:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000119848_30687232.pth... [2023-12-27 20:05:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000118624_30375936.pth [2023-12-27 20:05:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000118696_30392320.pth [2023-12-27 20:05:26,753][106225] Updated weights for policy 1, policy_version 119786 (0.0006) [2023-12-27 20:05:26,800][106225] Updated weights for policy 1, policy_version 119796 (0.0006) [2023-12-27 20:05:26,817][106226] Updated weights for policy 0, policy_version 119858 (0.0010) [2023-12-27 20:05:26,847][106225] Updated weights for policy 1, policy_version 119806 (0.0005) [2023-12-27 20:05:26,868][106226] Updated weights for policy 0, policy_version 119868 (0.0010) [2023-12-27 20:05:26,910][106226] Updated weights for policy 0, policy_version 119878 (0.0010) [2023-12-27 20:05:27,592][106225] Updated weights for policy 1, policy_version 119816 (0.0007) [2023-12-27 20:05:27,641][106226] Updated weights for policy 0, policy_version 119888 (0.0007) [2023-12-27 20:05:27,657][106225] Updated weights for policy 1, policy_version 119826 (0.0008) [2023-12-27 20:05:27,688][106226] Updated weights for policy 0, policy_version 119898 (0.0007) [2023-12-27 20:05:27,713][106225] Updated weights for policy 1, policy_version 119836 (0.0007) [2023-12-27 20:05:27,738][106226] Updated weights for policy 0, policy_version 119908 (0.0007) [2023-12-27 20:05:28,367][106225] Updated weights for policy 1, policy_version 119846 (0.0006) [2023-12-27 20:05:28,425][106225] Updated weights for policy 1, policy_version 119856 (0.0006) [2023-12-27 20:05:28,457][106226] Updated weights for policy 0, policy_version 119918 (0.0009) [2023-12-27 20:05:28,486][106225] Updated weights for policy 1, policy_version 119866 (0.0008) [2023-12-27 20:05:28,516][106226] Updated weights for policy 0, policy_version 119928 (0.0007) [2023-12-27 20:05:28,576][106226] Updated weights for policy 0, policy_version 119938 (0.0008) [2023-12-27 20:05:29,190][106226] Updated weights for policy 0, policy_version 119948 (0.0007) [2023-12-27 20:05:29,215][106225] Updated weights for policy 1, policy_version 119876 (0.0008) [2023-12-27 20:05:29,260][106226] Updated weights for policy 0, policy_version 119958 (0.0007) [2023-12-27 20:05:29,278][106225] Updated weights for policy 1, policy_version 119886 (0.0008) [2023-12-27 20:05:29,321][106226] Updated weights for policy 0, policy_version 119968 (0.0011) [2023-12-27 20:05:29,335][106225] Updated weights for policy 1, policy_version 119896 (0.0006) [2023-12-27 20:05:29,957][106226] Updated weights for policy 0, policy_version 119978 (0.0009) [2023-12-27 20:05:30,011][106226] Updated weights for policy 0, policy_version 119988 (0.0008) [2023-12-27 20:05:30,065][106226] Updated weights for policy 0, policy_version 119998 (0.0006) [2023-12-27 20:05:30,114][106226] Updated weights for policy 0, policy_version 120008 (0.0007) [2023-12-27 20:05:30,174][106225] Updated weights for policy 1, policy_version 119906 (0.0007) [2023-12-27 20:05:30,232][106225] Updated weights for policy 1, policy_version 119916 (0.0008) [2023-12-27 20:05:30,286][106225] Updated weights for policy 1, policy_version 119926 (0.0008) [2023-12-27 20:05:30,337][106225] Updated weights for policy 1, policy_version 119936 (0.0007) [2023-12-27 20:05:30,857][106226] Updated weights for policy 0, policy_version 120018 (0.0010) [2023-12-27 20:05:30,909][106226] Updated weights for policy 0, policy_version 120028 (0.0010) [2023-12-27 20:05:30,962][106226] Updated weights for policy 0, policy_version 120038 (0.0010) [2023-12-27 20:05:31,007][106225] Updated weights for policy 1, policy_version 119946 (0.0010) [2023-12-27 20:05:31,071][106225] Updated weights for policy 1, policy_version 119956 (0.0010) [2023-12-27 20:05:31,134][106225] Updated weights for policy 1, policy_version 119966 (0.0010) [2023-12-27 20:05:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 61456384. Throughput: 0: 9902.7, 1: 9868.5. Samples: 61441708. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:31,175][105115] Avg episode reward: [(0, '-4.993'), (1, '-6.758')] [2023-12-27 20:05:31,730][106226] Updated weights for policy 0, policy_version 120048 (0.0009) [2023-12-27 20:05:31,800][106226] Updated weights for policy 0, policy_version 120058 (0.0007) [2023-12-27 20:05:31,822][106225] Updated weights for policy 1, policy_version 119976 (0.0008) [2023-12-27 20:05:31,862][106226] Updated weights for policy 0, policy_version 120068 (0.0008) [2023-12-27 20:05:31,884][106225] Updated weights for policy 1, policy_version 119986 (0.0006) [2023-12-27 20:05:31,941][106225] Updated weights for policy 1, policy_version 119996 (0.0009) [2023-12-27 20:05:32,517][106226] Updated weights for policy 0, policy_version 120078 (0.0010) [2023-12-27 20:05:32,577][106226] Updated weights for policy 0, policy_version 120088 (0.0010) [2023-12-27 20:05:32,642][106226] Updated weights for policy 0, policy_version 120098 (0.0010) [2023-12-27 20:05:32,682][106225] Updated weights for policy 1, policy_version 120006 (0.0008) [2023-12-27 20:05:32,743][106225] Updated weights for policy 1, policy_version 120016 (0.0008) [2023-12-27 20:05:32,813][106225] Updated weights for policy 1, policy_version 120026 (0.0005) [2023-12-27 20:05:33,358][106226] Updated weights for policy 0, policy_version 120108 (0.0011) [2023-12-27 20:05:33,375][106225] Updated weights for policy 1, policy_version 120036 (0.0006) [2023-12-27 20:05:33,415][106226] Updated weights for policy 0, policy_version 120118 (0.0010) [2023-12-27 20:05:33,432][106225] Updated weights for policy 1, policy_version 120046 (0.0006) [2023-12-27 20:05:33,468][106226] Updated weights for policy 0, policy_version 120128 (0.0010) [2023-12-27 20:05:33,485][106225] Updated weights for policy 1, policy_version 120056 (0.0005) [2023-12-27 20:05:34,089][106225] Updated weights for policy 1, policy_version 120066 (0.0006) [2023-12-27 20:05:34,150][106225] Updated weights for policy 1, policy_version 120076 (0.0010) [2023-12-27 20:05:34,167][106226] Updated weights for policy 0, policy_version 120138 (0.0010) [2023-12-27 20:05:34,216][106225] Updated weights for policy 1, policy_version 120086 (0.0009) [2023-12-27 20:05:34,235][106226] Updated weights for policy 0, policy_version 120148 (0.0007) [2023-12-27 20:05:34,280][106225] Updated weights for policy 1, policy_version 120096 (0.0010) [2023-12-27 20:05:34,300][106226] Updated weights for policy 0, policy_version 120158 (0.0008) [2023-12-27 20:05:34,361][106226] Updated weights for policy 0, policy_version 120168 (0.0008) [2023-12-27 20:05:34,947][106225] Updated weights for policy 1, policy_version 120106 (0.0005) [2023-12-27 20:05:34,987][106226] Updated weights for policy 0, policy_version 120178 (0.0005) [2023-12-27 20:05:35,001][106225] Updated weights for policy 1, policy_version 120116 (0.0005) [2023-12-27 20:05:35,043][106226] Updated weights for policy 0, policy_version 120188 (0.0007) [2023-12-27 20:05:35,053][106225] Updated weights for policy 1, policy_version 120126 (0.0009) [2023-12-27 20:05:35,092][106226] Updated weights for policy 0, policy_version 120198 (0.0007) [2023-12-27 20:05:35,697][106225] Updated weights for policy 1, policy_version 120136 (0.0010) [2023-12-27 20:05:35,715][106226] Updated weights for policy 0, policy_version 120208 (0.0009) [2023-12-27 20:05:35,764][106225] Updated weights for policy 1, policy_version 120146 (0.0010) [2023-12-27 20:05:35,784][106226] Updated weights for policy 0, policy_version 120218 (0.0011) [2023-12-27 20:05:35,828][106225] Updated weights for policy 1, policy_version 120156 (0.0009) [2023-12-27 20:05:35,846][106226] Updated weights for policy 0, policy_version 120228 (0.0011) [2023-12-27 20:05:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 61554688. Throughput: 0: 9968.3, 1: 9873.2. Samples: 61563276. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:36,175][105115] Avg episode reward: [(0, '-5.444'), (1, '-6.775')] [2023-12-27 20:05:36,446][106225] Updated weights for policy 1, policy_version 120166 (0.0009) [2023-12-27 20:05:36,510][106225] Updated weights for policy 1, policy_version 120176 (0.0005) [2023-12-27 20:05:36,554][106226] Updated weights for policy 0, policy_version 120238 (0.0011) [2023-12-27 20:05:36,576][106225] Updated weights for policy 1, policy_version 120186 (0.0008) [2023-12-27 20:05:36,616][106226] Updated weights for policy 0, policy_version 120248 (0.0011) [2023-12-27 20:05:36,675][106226] Updated weights for policy 0, policy_version 120258 (0.0011) [2023-12-27 20:05:37,247][106225] Updated weights for policy 1, policy_version 120196 (0.0008) [2023-12-27 20:05:37,295][106226] Updated weights for policy 0, policy_version 120268 (0.0008) [2023-12-27 20:05:37,308][106225] Updated weights for policy 1, policy_version 120206 (0.0007) [2023-12-27 20:05:37,358][106226] Updated weights for policy 0, policy_version 120278 (0.0005) [2023-12-27 20:05:37,374][106225] Updated weights for policy 1, policy_version 120216 (0.0007) [2023-12-27 20:05:37,414][106226] Updated weights for policy 0, policy_version 120288 (0.0005) [2023-12-27 20:05:37,958][106226] Updated weights for policy 0, policy_version 120298 (0.0005) [2023-12-27 20:05:37,992][106225] Updated weights for policy 1, policy_version 120226 (0.0007) [2023-12-27 20:05:38,021][106226] Updated weights for policy 0, policy_version 120308 (0.0005) [2023-12-27 20:05:38,052][106225] Updated weights for policy 1, policy_version 120236 (0.0008) [2023-12-27 20:05:38,074][106226] Updated weights for policy 0, policy_version 120318 (0.0005) [2023-12-27 20:05:38,100][106225] Updated weights for policy 1, policy_version 120246 (0.0007) [2023-12-27 20:05:38,132][106226] Updated weights for policy 0, policy_version 120328 (0.0005) [2023-12-27 20:05:38,147][106225] Updated weights for policy 1, policy_version 120256 (0.0009) [2023-12-27 20:05:38,752][106226] Updated weights for policy 0, policy_version 120338 (0.0011) [2023-12-27 20:05:38,809][106226] Updated weights for policy 0, policy_version 120348 (0.0011) [2023-12-27 20:05:38,868][106225] Updated weights for policy 1, policy_version 120266 (0.0006) [2023-12-27 20:05:38,870][106226] Updated weights for policy 0, policy_version 120358 (0.0011) [2023-12-27 20:05:38,933][106225] Updated weights for policy 1, policy_version 120276 (0.0008) [2023-12-27 20:05:38,982][106225] Updated weights for policy 1, policy_version 120286 (0.0008) [2023-12-27 20:05:39,614][106226] Updated weights for policy 0, policy_version 120368 (0.0009) [2023-12-27 20:05:39,671][106226] Updated weights for policy 0, policy_version 120378 (0.0009) [2023-12-27 20:05:39,713][106225] Updated weights for policy 1, policy_version 120296 (0.0007) [2023-12-27 20:05:39,728][106226] Updated weights for policy 0, policy_version 120388 (0.0006) [2023-12-27 20:05:39,770][106225] Updated weights for policy 1, policy_version 120306 (0.0008) [2023-12-27 20:05:39,823][106225] Updated weights for policy 1, policy_version 120316 (0.0009) [2023-12-27 20:05:40,406][106226] Updated weights for policy 0, policy_version 120398 (0.0007) [2023-12-27 20:05:40,474][106226] Updated weights for policy 0, policy_version 120408 (0.0008) [2023-12-27 20:05:40,531][106226] Updated weights for policy 0, policy_version 120418 (0.0010) [2023-12-27 20:05:40,619][106225] Updated weights for policy 1, policy_version 120326 (0.0008) [2023-12-27 20:05:40,672][106225] Updated weights for policy 1, policy_version 120336 (0.0008) [2023-12-27 20:05:40,727][106225] Updated weights for policy 1, policy_version 120346 (0.0008) [2023-12-27 20:05:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 61652992. Throughput: 0: 10048.7, 1: 9939.3. Samples: 61627000. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:41,175][105115] Avg episode reward: [(0, '-5.242'), (1, '-6.602')] [2023-12-27 20:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000120352_30818304.pth... [2023-12-27 20:05:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000119200_30523392.pth [2023-12-27 20:05:41,188][106226] Updated weights for policy 0, policy_version 120428 (0.0007) [2023-12-27 20:05:41,254][106226] Updated weights for policy 0, policy_version 120438 (0.0008) [2023-12-27 20:05:41,317][106226] Updated weights for policy 0, policy_version 120448 (0.0006) [2023-12-27 20:05:41,390][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000120456_30842880.pth... [2023-12-27 20:05:41,395][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000119240_30531584.pth [2023-12-27 20:05:41,519][106225] Updated weights for policy 1, policy_version 120356 (0.0008) [2023-12-27 20:05:41,578][106225] Updated weights for policy 1, policy_version 120366 (0.0006) [2023-12-27 20:05:41,645][106225] Updated weights for policy 1, policy_version 120376 (0.0007) [2023-12-27 20:05:42,087][106226] Updated weights for policy 0, policy_version 120458 (0.0008) [2023-12-27 20:05:42,143][106226] Updated weights for policy 0, policy_version 120468 (0.0008) [2023-12-27 20:05:42,209][106226] Updated weights for policy 0, policy_version 120478 (0.0008) [2023-12-27 20:05:42,267][106226] Updated weights for policy 0, policy_version 120488 (0.0008) [2023-12-27 20:05:42,369][106225] Updated weights for policy 1, policy_version 120386 (0.0007) [2023-12-27 20:05:42,442][106225] Updated weights for policy 1, policy_version 120396 (0.0008) [2023-12-27 20:05:42,504][106225] Updated weights for policy 1, policy_version 120406 (0.0008) [2023-12-27 20:05:42,562][106225] Updated weights for policy 1, policy_version 120416 (0.0005) [2023-12-27 20:05:43,028][106226] Updated weights for policy 0, policy_version 120498 (0.0011) [2023-12-27 20:05:43,086][106226] Updated weights for policy 0, policy_version 120508 (0.0011) [2023-12-27 20:05:43,142][106226] Updated weights for policy 0, policy_version 120518 (0.0011) [2023-12-27 20:05:43,231][106225] Updated weights for policy 1, policy_version 120426 (0.0008) [2023-12-27 20:05:43,286][106225] Updated weights for policy 1, policy_version 120436 (0.0008) [2023-12-27 20:05:43,343][106225] Updated weights for policy 1, policy_version 120446 (0.0007) [2023-12-27 20:05:43,838][106226] Updated weights for policy 0, policy_version 120528 (0.0008) [2023-12-27 20:05:43,885][106226] Updated weights for policy 0, policy_version 120538 (0.0009) [2023-12-27 20:05:43,934][106226] Updated weights for policy 0, policy_version 120548 (0.0005) [2023-12-27 20:05:44,081][106225] Updated weights for policy 1, policy_version 120456 (0.0010) [2023-12-27 20:05:44,127][106225] Updated weights for policy 1, policy_version 120466 (0.0010) [2023-12-27 20:05:44,173][106225] Updated weights for policy 1, policy_version 120476 (0.0010) [2023-12-27 20:05:44,619][106226] Updated weights for policy 0, policy_version 120558 (0.0008) [2023-12-27 20:05:44,682][106226] Updated weights for policy 0, policy_version 120568 (0.0008) [2023-12-27 20:05:44,744][106226] Updated weights for policy 0, policy_version 120578 (0.0009) [2023-12-27 20:05:44,853][106225] Updated weights for policy 1, policy_version 120486 (0.0009) [2023-12-27 20:05:44,912][106225] Updated weights for policy 1, policy_version 120496 (0.0008) [2023-12-27 20:05:44,979][106225] Updated weights for policy 1, policy_version 120506 (0.0007) [2023-12-27 20:05:45,501][106226] Updated weights for policy 0, policy_version 120588 (0.0007) [2023-12-27 20:05:45,565][106226] Updated weights for policy 0, policy_version 120598 (0.0005) [2023-12-27 20:05:45,628][106226] Updated weights for policy 0, policy_version 120608 (0.0005) [2023-12-27 20:05:45,692][106225] Updated weights for policy 1, policy_version 120516 (0.0010) [2023-12-27 20:05:45,741][106225] Updated weights for policy 1, policy_version 120526 (0.0010) [2023-12-27 20:05:45,797][106225] Updated weights for policy 1, policy_version 120536 (0.0010) [2023-12-27 20:05:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 61751296. Throughput: 0: 10010.4, 1: 9820.2. Samples: 61741880. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:46,176][105115] Avg episode reward: [(0, '-5.300'), (1, '-6.671')] [2023-12-27 20:05:46,203][106226] Updated weights for policy 0, policy_version 120618 (0.0005) [2023-12-27 20:05:46,272][106226] Updated weights for policy 0, policy_version 120628 (0.0005) [2023-12-27 20:05:46,332][106226] Updated weights for policy 0, policy_version 120638 (0.0005) [2023-12-27 20:05:46,385][106226] Updated weights for policy 0, policy_version 120648 (0.0005) [2023-12-27 20:05:46,525][106225] Updated weights for policy 1, policy_version 120546 (0.0010) [2023-12-27 20:05:46,572][106225] Updated weights for policy 1, policy_version 120556 (0.0010) [2023-12-27 20:05:46,616][106225] Updated weights for policy 1, policy_version 120566 (0.0010) [2023-12-27 20:05:46,666][106225] Updated weights for policy 1, policy_version 120576 (0.0010) [2023-12-27 20:05:46,972][106226] Updated weights for policy 0, policy_version 120658 (0.0008) [2023-12-27 20:05:47,026][106226] Updated weights for policy 0, policy_version 120668 (0.0007) [2023-12-27 20:05:47,073][106226] Updated weights for policy 0, policy_version 120678 (0.0008) [2023-12-27 20:05:47,408][106225] Updated weights for policy 1, policy_version 120586 (0.0010) [2023-12-27 20:05:47,464][106225] Updated weights for policy 1, policy_version 120596 (0.0010) [2023-12-27 20:05:47,522][106225] Updated weights for policy 1, policy_version 120606 (0.0010) [2023-12-27 20:05:47,805][106226] Updated weights for policy 0, policy_version 120688 (0.0008) [2023-12-27 20:05:47,862][106226] Updated weights for policy 0, policy_version 120698 (0.0008) [2023-12-27 20:05:47,923][106226] Updated weights for policy 0, policy_version 120708 (0.0008) [2023-12-27 20:05:48,181][106225] Updated weights for policy 1, policy_version 120616 (0.0009) [2023-12-27 20:05:48,239][106225] Updated weights for policy 1, policy_version 120626 (0.0009) [2023-12-27 20:05:48,290][106225] Updated weights for policy 1, policy_version 120636 (0.0008) [2023-12-27 20:05:48,719][106226] Updated weights for policy 0, policy_version 120718 (0.0009) [2023-12-27 20:05:48,773][106226] Updated weights for policy 0, policy_version 120728 (0.0008) [2023-12-27 20:05:48,840][106226] Updated weights for policy 0, policy_version 120738 (0.0009) [2023-12-27 20:05:48,969][106225] Updated weights for policy 1, policy_version 120646 (0.0008) [2023-12-27 20:05:49,029][106225] Updated weights for policy 1, policy_version 120656 (0.0009) [2023-12-27 20:05:49,086][106225] Updated weights for policy 1, policy_version 120666 (0.0009) [2023-12-27 20:05:49,649][106226] Updated weights for policy 0, policy_version 120748 (0.0009) [2023-12-27 20:05:49,714][106226] Updated weights for policy 0, policy_version 120758 (0.0008) [2023-12-27 20:05:49,728][106225] Updated weights for policy 1, policy_version 120676 (0.0008) [2023-12-27 20:05:49,776][106226] Updated weights for policy 0, policy_version 120768 (0.0007) [2023-12-27 20:05:49,790][106225] Updated weights for policy 1, policy_version 120686 (0.0007) [2023-12-27 20:05:49,862][106225] Updated weights for policy 1, policy_version 120696 (0.0008) [2023-12-27 20:05:50,495][106226] Updated weights for policy 0, policy_version 120778 (0.0007) [2023-12-27 20:05:50,558][106226] Updated weights for policy 0, policy_version 120788 (0.0008) [2023-12-27 20:05:50,622][106226] Updated weights for policy 0, policy_version 120798 (0.0008) [2023-12-27 20:05:50,623][106225] Updated weights for policy 1, policy_version 120706 (0.0009) [2023-12-27 20:05:50,683][106225] Updated weights for policy 1, policy_version 120716 (0.0006) [2023-12-27 20:05:50,687][106226] Updated weights for policy 0, policy_version 120808 (0.0007) [2023-12-27 20:05:50,732][106225] Updated weights for policy 1, policy_version 120726 (0.0009) [2023-12-27 20:05:50,789][106225] Updated weights for policy 1, policy_version 120736 (0.0009) [2023-12-27 20:05:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 61849600. Throughput: 0: 10001.6, 1: 9841.4. Samples: 61859664. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:51,175][105115] Avg episode reward: [(0, '-5.418'), (1, '-6.811')] [2023-12-27 20:05:51,429][106226] Updated weights for policy 0, policy_version 120818 (0.0007) [2023-12-27 20:05:51,495][106226] Updated weights for policy 0, policy_version 120828 (0.0006) [2023-12-27 20:05:51,545][106225] Updated weights for policy 1, policy_version 120746 (0.0008) [2023-12-27 20:05:51,558][106226] Updated weights for policy 0, policy_version 120838 (0.0006) [2023-12-27 20:05:51,603][106225] Updated weights for policy 1, policy_version 120756 (0.0009) [2023-12-27 20:05:51,667][106225] Updated weights for policy 1, policy_version 120766 (0.0008) [2023-12-27 20:05:52,255][106226] Updated weights for policy 0, policy_version 120848 (0.0008) [2023-12-27 20:05:52,318][106226] Updated weights for policy 0, policy_version 120858 (0.0009) [2023-12-27 20:05:52,396][106226] Updated weights for policy 0, policy_version 120868 (0.0008) [2023-12-27 20:05:52,433][106225] Updated weights for policy 1, policy_version 120776 (0.0009) [2023-12-27 20:05:52,500][106225] Updated weights for policy 1, policy_version 120786 (0.0008) [2023-12-27 20:05:52,561][106225] Updated weights for policy 1, policy_version 120796 (0.0006) [2023-12-27 20:05:53,162][106226] Updated weights for policy 0, policy_version 120878 (0.0006) [2023-12-27 20:05:53,176][106225] Updated weights for policy 1, policy_version 120806 (0.0009) [2023-12-27 20:05:53,209][106226] Updated weights for policy 0, policy_version 120888 (0.0005) [2023-12-27 20:05:53,229][106225] Updated weights for policy 1, policy_version 120816 (0.0010) [2023-12-27 20:05:53,262][106226] Updated weights for policy 0, policy_version 120898 (0.0007) [2023-12-27 20:05:53,282][106225] Updated weights for policy 1, policy_version 120826 (0.0010) [2023-12-27 20:05:53,875][106225] Updated weights for policy 1, policy_version 120836 (0.0008) [2023-12-27 20:05:53,926][106225] Updated weights for policy 1, policy_version 120846 (0.0008) [2023-12-27 20:05:53,963][106226] Updated weights for policy 0, policy_version 120908 (0.0006) [2023-12-27 20:05:53,974][106225] Updated weights for policy 1, policy_version 120856 (0.0007) [2023-12-27 20:05:54,012][106226] Updated weights for policy 0, policy_version 120918 (0.0006) [2023-12-27 20:05:54,068][106226] Updated weights for policy 0, policy_version 120928 (0.0005) [2023-12-27 20:05:54,633][106225] Updated weights for policy 1, policy_version 120866 (0.0010) [2023-12-27 20:05:54,690][106226] Updated weights for policy 0, policy_version 120938 (0.0007) [2023-12-27 20:05:54,696][106225] Updated weights for policy 1, policy_version 120876 (0.0010) [2023-12-27 20:05:54,751][106226] Updated weights for policy 0, policy_version 120948 (0.0010) [2023-12-27 20:05:54,757][106225] Updated weights for policy 1, policy_version 120886 (0.0005) [2023-12-27 20:05:54,817][106226] Updated weights for policy 0, policy_version 120958 (0.0005) [2023-12-27 20:05:54,823][106225] Updated weights for policy 1, policy_version 120896 (0.0006) [2023-12-27 20:05:54,881][106226] Updated weights for policy 0, policy_version 120968 (0.0005) [2023-12-27 20:05:55,475][106225] Updated weights for policy 1, policy_version 120906 (0.0010) [2023-12-27 20:05:55,525][106225] Updated weights for policy 1, policy_version 120916 (0.0010) [2023-12-27 20:05:55,555][106226] Updated weights for policy 0, policy_version 120978 (0.0006) [2023-12-27 20:05:55,571][106225] Updated weights for policy 1, policy_version 120926 (0.0010) [2023-12-27 20:05:55,619][106226] Updated weights for policy 0, policy_version 120988 (0.0005) [2023-12-27 20:05:55,680][106226] Updated weights for policy 0, policy_version 120998 (0.0008) [2023-12-27 20:05:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 61947904. Throughput: 0: 10018.4, 1: 9867.0. Samples: 61918496. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:05:56,176][105115] Avg episode reward: [(0, '-5.323'), (1, '-6.748')] [2023-12-27 20:05:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000120928_30965760.pth... [2023-12-27 20:05:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000121000_30982144.pth... [2023-12-27 20:05:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000119776_30670848.pth [2023-12-27 20:05:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000119848_30687232.pth [2023-12-27 20:05:56,292][106225] Updated weights for policy 1, policy_version 120936 (0.0010) [2023-12-27 20:05:56,348][106225] Updated weights for policy 1, policy_version 120946 (0.0010) [2023-12-27 20:05:56,351][106226] Updated weights for policy 0, policy_version 121008 (0.0006) [2023-12-27 20:05:56,401][106225] Updated weights for policy 1, policy_version 120956 (0.0010) [2023-12-27 20:05:56,409][106226] Updated weights for policy 0, policy_version 121018 (0.0007) [2023-12-27 20:05:56,463][106226] Updated weights for policy 0, policy_version 121028 (0.0009) [2023-12-27 20:05:57,128][106225] Updated weights for policy 1, policy_version 120966 (0.0007) [2023-12-27 20:05:57,157][106226] Updated weights for policy 0, policy_version 121038 (0.0008) [2023-12-27 20:05:57,189][106225] Updated weights for policy 1, policy_version 120976 (0.0006) [2023-12-27 20:05:57,211][106226] Updated weights for policy 0, policy_version 121049 (0.0007) [2023-12-27 20:05:57,245][106225] Updated weights for policy 1, policy_version 120986 (0.0010) [2023-12-27 20:05:57,268][106226] Updated weights for policy 0, policy_version 121059 (0.0010) [2023-12-27 20:05:57,831][106225] Updated weights for policy 1, policy_version 120996 (0.0010) [2023-12-27 20:05:57,883][106225] Updated weights for policy 1, policy_version 121006 (0.0010) [2023-12-27 20:05:57,935][106225] Updated weights for policy 1, policy_version 121016 (0.0010) [2023-12-27 20:05:57,945][106226] Updated weights for policy 0, policy_version 121069 (0.0006) [2023-12-27 20:05:58,007][106226] Updated weights for policy 0, policy_version 121079 (0.0008) [2023-12-27 20:05:58,058][106226] Updated weights for policy 0, policy_version 121089 (0.0005) [2023-12-27 20:05:58,705][106225] Updated weights for policy 1, policy_version 121026 (0.0010) [2023-12-27 20:05:58,753][106226] Updated weights for policy 0, policy_version 121099 (0.0006) [2023-12-27 20:05:58,770][106225] Updated weights for policy 1, policy_version 121036 (0.0009) [2023-12-27 20:05:58,820][106226] Updated weights for policy 0, policy_version 121109 (0.0009) [2023-12-27 20:05:58,848][106225] Updated weights for policy 1, policy_version 121046 (0.0007) [2023-12-27 20:05:58,881][106226] Updated weights for policy 0, policy_version 121119 (0.0007) [2023-12-27 20:05:58,914][106225] Updated weights for policy 1, policy_version 121056 (0.0008) [2023-12-27 20:05:59,642][106226] Updated weights for policy 0, policy_version 121129 (0.0009) [2023-12-27 20:05:59,656][106225] Updated weights for policy 1, policy_version 121066 (0.0009) [2023-12-27 20:05:59,690][106226] Updated weights for policy 0, policy_version 121139 (0.0010) [2023-12-27 20:05:59,707][106225] Updated weights for policy 1, policy_version 121076 (0.0010) [2023-12-27 20:05:59,745][106226] Updated weights for policy 0, policy_version 121149 (0.0010) [2023-12-27 20:05:59,764][106225] Updated weights for policy 1, policy_version 121086 (0.0010) [2023-12-27 20:05:59,799][106226] Updated weights for policy 0, policy_version 121159 (0.0007) [2023-12-27 20:06:00,493][106226] Updated weights for policy 0, policy_version 121169 (0.0005) [2023-12-27 20:06:00,541][106226] Updated weights for policy 0, policy_version 121179 (0.0005) [2023-12-27 20:06:00,594][106226] Updated weights for policy 0, policy_version 121189 (0.0007) [2023-12-27 20:06:00,597][106225] Updated weights for policy 1, policy_version 121096 (0.0007) [2023-12-27 20:06:00,649][106225] Updated weights for policy 1, policy_version 121106 (0.0007) [2023-12-27 20:06:00,706][106225] Updated weights for policy 1, policy_version 121116 (0.0008) [2023-12-27 20:06:01,174][106226] Updated weights for policy 0, policy_version 121199 (0.0010) [2023-12-27 20:06:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 62046208. Throughput: 0: 10045.8, 1: 9864.6. Samples: 62037860. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:06:01,175][105115] Avg episode reward: [(0, '-5.165'), (1, '-6.771')] [2023-12-27 20:06:01,233][106226] Updated weights for policy 0, policy_version 121209 (0.0011) [2023-12-27 20:06:01,290][106226] Updated weights for policy 0, policy_version 121219 (0.0007) [2023-12-27 20:06:01,568][106225] Updated weights for policy 1, policy_version 121126 (0.0007) [2023-12-27 20:06:01,620][106225] Updated weights for policy 1, policy_version 121136 (0.0008) [2023-12-27 20:06:01,685][106225] Updated weights for policy 1, policy_version 121146 (0.0009) [2023-12-27 20:06:01,950][106226] Updated weights for policy 0, policy_version 121229 (0.0007) [2023-12-27 20:06:02,009][106226] Updated weights for policy 0, policy_version 121239 (0.0008) [2023-12-27 20:06:02,064][106226] Updated weights for policy 0, policy_version 121249 (0.0009) [2023-12-27 20:06:02,430][106225] Updated weights for policy 1, policy_version 121156 (0.0008) [2023-12-27 20:06:02,506][106225] Updated weights for policy 1, policy_version 121166 (0.0010) [2023-12-27 20:06:02,571][106225] Updated weights for policy 1, policy_version 121176 (0.0009) [2023-12-27 20:06:02,808][106226] Updated weights for policy 0, policy_version 121259 (0.0009) [2023-12-27 20:06:02,871][106226] Updated weights for policy 0, policy_version 121269 (0.0008) [2023-12-27 20:06:02,926][106226] Updated weights for policy 0, policy_version 121279 (0.0008) [2023-12-27 20:06:03,310][106225] Updated weights for policy 1, policy_version 121186 (0.0007) [2023-12-27 20:06:03,361][106225] Updated weights for policy 1, policy_version 121196 (0.0008) [2023-12-27 20:06:03,424][106225] Updated weights for policy 1, policy_version 121206 (0.0009) [2023-12-27 20:06:03,472][106225] Updated weights for policy 1, policy_version 121216 (0.0010) [2023-12-27 20:06:03,615][106226] Updated weights for policy 0, policy_version 121289 (0.0008) [2023-12-27 20:06:03,672][106226] Updated weights for policy 0, policy_version 121299 (0.0010) [2023-12-27 20:06:03,731][106226] Updated weights for policy 0, policy_version 121309 (0.0010) [2023-12-27 20:06:03,786][106226] Updated weights for policy 0, policy_version 121319 (0.0010) [2023-12-27 20:06:04,192][106225] Updated weights for policy 1, policy_version 121226 (0.0008) [2023-12-27 20:06:04,259][106225] Updated weights for policy 1, policy_version 121236 (0.0008) [2023-12-27 20:06:04,321][106225] Updated weights for policy 1, policy_version 121246 (0.0006) [2023-12-27 20:06:04,511][106226] Updated weights for policy 0, policy_version 121329 (0.0006) [2023-12-27 20:06:04,579][106226] Updated weights for policy 0, policy_version 121339 (0.0006) [2023-12-27 20:06:04,637][106226] Updated weights for policy 0, policy_version 121349 (0.0009) [2023-12-27 20:06:05,069][106225] Updated weights for policy 1, policy_version 121256 (0.0005) [2023-12-27 20:06:05,128][106225] Updated weights for policy 1, policy_version 121266 (0.0005) [2023-12-27 20:06:05,188][106225] Updated weights for policy 1, policy_version 121276 (0.0007) [2023-12-27 20:06:05,193][106226] Updated weights for policy 0, policy_version 121359 (0.0008) [2023-12-27 20:06:05,253][106226] Updated weights for policy 0, policy_version 121369 (0.0009) [2023-12-27 20:06:05,309][106226] Updated weights for policy 0, policy_version 121379 (0.0009) [2023-12-27 20:06:05,793][106225] Updated weights for policy 1, policy_version 121286 (0.0005) [2023-12-27 20:06:05,839][106225] Updated weights for policy 1, policy_version 121296 (0.0009) [2023-12-27 20:06:05,889][106225] Updated weights for policy 1, policy_version 121306 (0.0010) [2023-12-27 20:06:06,048][106226] Updated weights for policy 0, policy_version 121389 (0.0009) [2023-12-27 20:06:06,109][106226] Updated weights for policy 0, policy_version 121399 (0.0008) [2023-12-27 20:06:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 62144512. Throughput: 0: 10031.5, 1: 9785.1. Samples: 62156364. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:06:06,175][105115] Avg episode reward: [(0, '-5.588'), (1, '-7.332')] [2023-12-27 20:06:06,181][106226] Updated weights for policy 0, policy_version 121409 (0.0009) [2023-12-27 20:06:06,616][106225] Updated weights for policy 1, policy_version 121316 (0.0010) [2023-12-27 20:06:06,674][106225] Updated weights for policy 1, policy_version 121326 (0.0010) [2023-12-27 20:06:06,742][106225] Updated weights for policy 1, policy_version 121336 (0.0011) [2023-12-27 20:06:06,866][106226] Updated weights for policy 0, policy_version 121419 (0.0009) [2023-12-27 20:06:06,918][106226] Updated weights for policy 0, policy_version 121429 (0.0007) [2023-12-27 20:06:06,983][106226] Updated weights for policy 0, policy_version 121439 (0.0006) [2023-12-27 20:06:07,377][106225] Updated weights for policy 1, policy_version 121346 (0.0010) [2023-12-27 20:06:07,441][106225] Updated weights for policy 1, policy_version 121356 (0.0010) [2023-12-27 20:06:07,492][106225] Updated weights for policy 1, policy_version 121366 (0.0009) [2023-12-27 20:06:07,540][106225] Updated weights for policy 1, policy_version 121376 (0.0010) [2023-12-27 20:06:07,572][106226] Updated weights for policy 0, policy_version 121449 (0.0005) [2023-12-27 20:06:07,627][106226] Updated weights for policy 0, policy_version 121459 (0.0008) [2023-12-27 20:06:07,686][106226] Updated weights for policy 0, policy_version 121469 (0.0011) [2023-12-27 20:06:07,740][106226] Updated weights for policy 0, policy_version 121479 (0.0010) [2023-12-27 20:06:08,225][106225] Updated weights for policy 1, policy_version 121386 (0.0005) [2023-12-27 20:06:08,275][106225] Updated weights for policy 1, policy_version 121396 (0.0006) [2023-12-27 20:06:08,336][106225] Updated weights for policy 1, policy_version 121406 (0.0009) [2023-12-27 20:06:08,378][106226] Updated weights for policy 0, policy_version 121489 (0.0007) [2023-12-27 20:06:08,431][106226] Updated weights for policy 0, policy_version 121499 (0.0008) [2023-12-27 20:06:08,497][106226] Updated weights for policy 0, policy_version 121509 (0.0008) [2023-12-27 20:06:09,050][106225] Updated weights for policy 1, policy_version 121416 (0.0010) [2023-12-27 20:06:09,097][106225] Updated weights for policy 1, policy_version 121426 (0.0010) [2023-12-27 20:06:09,150][106225] Updated weights for policy 1, policy_version 121436 (0.0009) [2023-12-27 20:06:09,273][106226] Updated weights for policy 0, policy_version 121519 (0.0007) [2023-12-27 20:06:09,341][106226] Updated weights for policy 0, policy_version 121529 (0.0008) [2023-12-27 20:06:09,406][106226] Updated weights for policy 0, policy_version 121539 (0.0010) [2023-12-27 20:06:09,995][106225] Updated weights for policy 1, policy_version 121446 (0.0008) [2023-12-27 20:06:10,050][106225] Updated weights for policy 1, policy_version 121456 (0.0008) [2023-12-27 20:06:10,109][106225] Updated weights for policy 1, policy_version 121466 (0.0008) [2023-12-27 20:06:10,121][106226] Updated weights for policy 0, policy_version 121549 (0.0008) [2023-12-27 20:06:10,178][106226] Updated weights for policy 0, policy_version 121559 (0.0006) [2023-12-27 20:06:10,237][106226] Updated weights for policy 0, policy_version 121569 (0.0007) [2023-12-27 20:06:10,846][106225] Updated weights for policy 1, policy_version 121476 (0.0007) [2023-12-27 20:06:10,886][106226] Updated weights for policy 0, policy_version 121579 (0.0008) [2023-12-27 20:06:10,906][106225] Updated weights for policy 1, policy_version 121486 (0.0008) [2023-12-27 20:06:10,946][106226] Updated weights for policy 0, policy_version 121589 (0.0006) [2023-12-27 20:06:10,969][106225] Updated weights for policy 1, policy_version 121496 (0.0010) [2023-12-27 20:06:11,007][106226] Updated weights for policy 0, policy_version 121599 (0.0008) [2023-12-27 20:06:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 62251008. Throughput: 0: 10044.9, 1: 9843.7. Samples: 62217280. Policy #0 lag: (min: 31.0, avg: 32.8, max: 56.0) [2023-12-27 20:06:11,175][105115] Avg episode reward: [(0, '-5.321'), (1, '-6.765')] [2023-12-27 20:06:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000121504_31113216.pth... [2023-12-27 20:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000121608_31137792.pth... [2023-12-27 20:06:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000120352_30818304.pth [2023-12-27 20:06:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000120456_30842880.pth [2023-12-27 20:06:11,765][106225] Updated weights for policy 1, policy_version 121506 (0.0010) [2023-12-27 20:06:11,807][106226] Updated weights for policy 0, policy_version 121609 (0.0008) [2023-12-27 20:06:11,825][106225] Updated weights for policy 1, policy_version 121516 (0.0008) [2023-12-27 20:06:11,870][106226] Updated weights for policy 0, policy_version 121619 (0.0009) [2023-12-27 20:06:11,892][106225] Updated weights for policy 1, policy_version 121526 (0.0006) [2023-12-27 20:06:11,927][106226] Updated weights for policy 0, policy_version 121629 (0.0006) [2023-12-27 20:06:11,952][106225] Updated weights for policy 1, policy_version 121536 (0.0008) [2023-12-27 20:06:11,980][106226] Updated weights for policy 0, policy_version 121639 (0.0007) [2023-12-27 20:06:12,616][106225] Updated weights for policy 1, policy_version 121546 (0.0009) [2023-12-27 20:06:12,677][106225] Updated weights for policy 1, policy_version 121556 (0.0009) [2023-12-27 20:06:12,703][106226] Updated weights for policy 0, policy_version 121649 (0.0006) [2023-12-27 20:06:12,731][106225] Updated weights for policy 1, policy_version 121566 (0.0006) [2023-12-27 20:06:12,761][106226] Updated weights for policy 0, policy_version 121659 (0.0007) [2023-12-27 20:06:12,824][106226] Updated weights for policy 0, policy_version 121669 (0.0009) [2023-12-27 20:06:13,442][106225] Updated weights for policy 1, policy_version 121576 (0.0010) [2023-12-27 20:06:13,505][106225] Updated weights for policy 1, policy_version 121586 (0.0011) [2023-12-27 20:06:13,552][106225] Updated weights for policy 1, policy_version 121596 (0.0010) [2023-12-27 20:06:13,563][106226] Updated weights for policy 0, policy_version 121679 (0.0009) [2023-12-27 20:06:13,618][106226] Updated weights for policy 0, policy_version 121689 (0.0007) [2023-12-27 20:06:13,679][106226] Updated weights for policy 0, policy_version 121699 (0.0006) [2023-12-27 20:06:14,211][106225] Updated weights for policy 1, policy_version 121606 (0.0007) [2023-12-27 20:06:14,273][106225] Updated weights for policy 1, policy_version 121616 (0.0006) [2023-12-27 20:06:14,337][106225] Updated weights for policy 1, policy_version 121626 (0.0007) [2023-12-27 20:06:14,391][106226] Updated weights for policy 0, policy_version 121709 (0.0010) [2023-12-27 20:06:14,441][106226] Updated weights for policy 0, policy_version 121719 (0.0010) [2023-12-27 20:06:14,490][106226] Updated weights for policy 0, policy_version 121729 (0.0010) [2023-12-27 20:06:14,915][106225] Updated weights for policy 1, policy_version 121636 (0.0010) [2023-12-27 20:06:14,976][106225] Updated weights for policy 1, policy_version 121646 (0.0010) [2023-12-27 20:06:15,039][106225] Updated weights for policy 1, policy_version 121656 (0.0010) [2023-12-27 20:06:15,224][106226] Updated weights for policy 0, policy_version 121739 (0.0010) [2023-12-27 20:06:15,285][106226] Updated weights for policy 0, policy_version 121749 (0.0011) [2023-12-27 20:06:15,349][106226] Updated weights for policy 0, policy_version 121759 (0.0011) [2023-12-27 20:06:15,774][106225] Updated weights for policy 1, policy_version 121666 (0.0010) [2023-12-27 20:06:15,824][106225] Updated weights for policy 1, policy_version 121676 (0.0010) [2023-12-27 20:06:15,873][106225] Updated weights for policy 1, policy_version 121686 (0.0009) [2023-12-27 20:06:15,932][106225] Updated weights for policy 1, policy_version 121696 (0.0009) [2023-12-27 20:06:15,942][106226] Updated weights for policy 0, policy_version 121769 (0.0010) [2023-12-27 20:06:16,003][106226] Updated weights for policy 0, policy_version 121779 (0.0005) [2023-12-27 20:06:16,064][106226] Updated weights for policy 0, policy_version 121789 (0.0007) [2023-12-27 20:06:16,123][106226] Updated weights for policy 0, policy_version 121799 (0.0007) [2023-12-27 20:06:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 62349312. Throughput: 0: 9956.2, 1: 9861.8. Samples: 62333524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:16,176][105115] Avg episode reward: [(0, '-5.443'), (1, '-6.722')] [2023-12-27 20:06:16,557][106225] Updated weights for policy 1, policy_version 121706 (0.0005) [2023-12-27 20:06:16,608][106225] Updated weights for policy 1, policy_version 121716 (0.0005) [2023-12-27 20:06:16,656][106225] Updated weights for policy 1, policy_version 121726 (0.0005) [2023-12-27 20:06:16,741][106226] Updated weights for policy 0, policy_version 121809 (0.0010) [2023-12-27 20:06:16,795][106226] Updated weights for policy 0, policy_version 121819 (0.0010) [2023-12-27 20:06:16,849][106226] Updated weights for policy 0, policy_version 121829 (0.0011) [2023-12-27 20:06:17,337][106225] Updated weights for policy 1, policy_version 121736 (0.0010) [2023-12-27 20:06:17,384][106225] Updated weights for policy 1, policy_version 121746 (0.0010) [2023-12-27 20:06:17,434][106225] Updated weights for policy 1, policy_version 121756 (0.0010) [2023-12-27 20:06:17,451][106226] Updated weights for policy 0, policy_version 121839 (0.0010) [2023-12-27 20:06:17,497][106226] Updated weights for policy 0, policy_version 121849 (0.0010) [2023-12-27 20:06:17,551][106226] Updated weights for policy 0, policy_version 121859 (0.0010) [2023-12-27 20:06:18,019][106225] Updated weights for policy 1, policy_version 121766 (0.0007) [2023-12-27 20:06:18,078][106225] Updated weights for policy 1, policy_version 121776 (0.0005) [2023-12-27 20:06:18,138][106225] Updated weights for policy 1, policy_version 121786 (0.0008) [2023-12-27 20:06:18,286][106226] Updated weights for policy 0, policy_version 121869 (0.0010) [2023-12-27 20:06:18,348][106226] Updated weights for policy 0, policy_version 121879 (0.0007) [2023-12-27 20:06:18,404][106226] Updated weights for policy 0, policy_version 121889 (0.0007) [2023-12-27 20:06:18,818][106225] Updated weights for policy 1, policy_version 121796 (0.0010) [2023-12-27 20:06:18,881][106225] Updated weights for policy 1, policy_version 121806 (0.0009) [2023-12-27 20:06:18,938][106225] Updated weights for policy 1, policy_version 121816 (0.0008) [2023-12-27 20:06:19,135][106226] Updated weights for policy 0, policy_version 121899 (0.0008) [2023-12-27 20:06:19,196][106226] Updated weights for policy 0, policy_version 121909 (0.0009) [2023-12-27 20:06:19,277][106226] Updated weights for policy 0, policy_version 121919 (0.0007) [2023-12-27 20:06:19,707][106225] Updated weights for policy 1, policy_version 121826 (0.0009) [2023-12-27 20:06:19,766][106225] Updated weights for policy 1, policy_version 121836 (0.0008) [2023-12-27 20:06:19,828][106225] Updated weights for policy 1, policy_version 121846 (0.0008) [2023-12-27 20:06:19,888][106225] Updated weights for policy 1, policy_version 121856 (0.0006) [2023-12-27 20:06:20,008][106226] Updated weights for policy 0, policy_version 121929 (0.0007) [2023-12-27 20:06:20,068][106226] Updated weights for policy 0, policy_version 121939 (0.0010) [2023-12-27 20:06:20,128][106226] Updated weights for policy 0, policy_version 121949 (0.0008) [2023-12-27 20:06:20,194][106226] Updated weights for policy 0, policy_version 121959 (0.0009) [2023-12-27 20:06:20,603][106225] Updated weights for policy 1, policy_version 121866 (0.0008) [2023-12-27 20:06:20,663][106225] Updated weights for policy 1, policy_version 121876 (0.0008) [2023-12-27 20:06:20,723][106225] Updated weights for policy 1, policy_version 121886 (0.0008) [2023-12-27 20:06:20,992][106226] Updated weights for policy 0, policy_version 121969 (0.0010) [2023-12-27 20:06:21,062][106226] Updated weights for policy 0, policy_version 121979 (0.0011) [2023-12-27 20:06:21,131][106226] Updated weights for policy 0, policy_version 121989 (0.0010) [2023-12-27 20:06:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 62447616. Throughput: 0: 9954.9, 1: 9831.8. Samples: 62453676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:21,175][105115] Avg episode reward: [(0, '-5.400'), (1, '-6.744')] [2023-12-27 20:06:21,520][106225] Updated weights for policy 1, policy_version 121896 (0.0006) [2023-12-27 20:06:21,589][106225] Updated weights for policy 1, policy_version 121906 (0.0005) [2023-12-27 20:06:21,661][106225] Updated weights for policy 1, policy_version 121916 (0.0008) [2023-12-27 20:06:21,909][106226] Updated weights for policy 0, policy_version 121999 (0.0009) [2023-12-27 20:06:21,970][106226] Updated weights for policy 0, policy_version 122009 (0.0009) [2023-12-27 20:06:22,032][106226] Updated weights for policy 0, policy_version 122019 (0.0009) [2023-12-27 20:06:22,278][106225] Updated weights for policy 1, policy_version 121926 (0.0009) [2023-12-27 20:06:22,344][106225] Updated weights for policy 1, policy_version 121936 (0.0007) [2023-12-27 20:06:22,412][106225] Updated weights for policy 1, policy_version 121946 (0.0007) [2023-12-27 20:06:22,826][106226] Updated weights for policy 0, policy_version 122029 (0.0009) [2023-12-27 20:06:22,890][106226] Updated weights for policy 0, policy_version 122039 (0.0010) [2023-12-27 20:06:22,940][106226] Updated weights for policy 0, policy_version 122049 (0.0008) [2023-12-27 20:06:22,969][106225] Updated weights for policy 1, policy_version 121956 (0.0006) [2023-12-27 20:06:23,026][106225] Updated weights for policy 1, policy_version 121966 (0.0006) [2023-12-27 20:06:23,077][106225] Updated weights for policy 1, policy_version 121976 (0.0006) [2023-12-27 20:06:23,729][106226] Updated weights for policy 0, policy_version 122059 (0.0009) [2023-12-27 20:06:23,779][106225] Updated weights for policy 1, policy_version 121986 (0.0008) [2023-12-27 20:06:23,783][106226] Updated weights for policy 0, policy_version 122069 (0.0008) [2023-12-27 20:06:23,826][106225] Updated weights for policy 1, policy_version 121996 (0.0009) [2023-12-27 20:06:23,841][106226] Updated weights for policy 0, policy_version 122079 (0.0008) [2023-12-27 20:06:23,891][106225] Updated weights for policy 1, policy_version 122006 (0.0008) [2023-12-27 20:06:23,942][106225] Updated weights for policy 1, policy_version 122016 (0.0008) [2023-12-27 20:06:24,531][106226] Updated weights for policy 0, policy_version 122089 (0.0006) [2023-12-27 20:06:24,575][106225] Updated weights for policy 1, policy_version 122026 (0.0009) [2023-12-27 20:06:24,581][106226] Updated weights for policy 0, policy_version 122099 (0.0006) [2023-12-27 20:06:24,622][106225] Updated weights for policy 1, policy_version 122036 (0.0008) [2023-12-27 20:06:24,626][106226] Updated weights for policy 0, policy_version 122109 (0.0007) [2023-12-27 20:06:24,676][106225] Updated weights for policy 1, policy_version 122046 (0.0009) [2023-12-27 20:06:24,685][106226] Updated weights for policy 0, policy_version 122119 (0.0008) [2023-12-27 20:06:25,316][106226] Updated weights for policy 0, policy_version 122129 (0.0007) [2023-12-27 20:06:25,362][106226] Updated weights for policy 0, policy_version 122139 (0.0005) [2023-12-27 20:06:25,405][106226] Updated weights for policy 0, policy_version 122149 (0.0005) [2023-12-27 20:06:25,459][106225] Updated weights for policy 1, policy_version 122056 (0.0007) [2023-12-27 20:06:25,511][106225] Updated weights for policy 1, policy_version 122066 (0.0006) [2023-12-27 20:06:25,557][106225] Updated weights for policy 1, policy_version 122076 (0.0005) [2023-12-27 20:06:26,074][106226] Updated weights for policy 0, policy_version 122159 (0.0005) [2023-12-27 20:06:26,126][106226] Updated weights for policy 0, policy_version 122169 (0.0005) [2023-12-27 20:06:26,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 62537728. Throughput: 0: 9828.2, 1: 9831.7. Samples: 62511696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:26,175][105115] Avg episode reward: [(0, '-5.338'), (1, '-7.183')] [2023-12-27 20:06:26,188][106226] Updated weights for policy 0, policy_version 122179 (0.0006) [2023-12-27 20:06:26,201][106225] Updated weights for policy 1, policy_version 122086 (0.0006) [2023-12-27 20:06:26,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000122184_31285248.pth... [2023-12-27 20:06:26,226][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000121000_30982144.pth [2023-12-27 20:06:26,250][106225] Updated weights for policy 1, policy_version 122096 (0.0006) [2023-12-27 20:06:26,311][106225] Updated weights for policy 1, policy_version 122106 (0.0005) [2023-12-27 20:06:26,346][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000122112_31268864.pth... [2023-12-27 20:06:26,350][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000120928_30965760.pth [2023-12-27 20:06:26,701][106226] Updated weights for policy 0, policy_version 122189 (0.0006) [2023-12-27 20:06:26,759][106226] Updated weights for policy 0, policy_version 122199 (0.0008) [2023-12-27 20:06:26,825][106226] Updated weights for policy 0, policy_version 122209 (0.0005) [2023-12-27 20:06:27,011][106225] Updated weights for policy 1, policy_version 122116 (0.0006) [2023-12-27 20:06:27,062][106225] Updated weights for policy 1, policy_version 122126 (0.0007) [2023-12-27 20:06:27,111][106225] Updated weights for policy 1, policy_version 122136 (0.0007) [2023-12-27 20:06:27,351][106226] Updated weights for policy 0, policy_version 122219 (0.0005) [2023-12-27 20:06:27,406][106226] Updated weights for policy 0, policy_version 122229 (0.0005) [2023-12-27 20:06:27,464][106226] Updated weights for policy 0, policy_version 122239 (0.0005) [2023-12-27 20:06:27,847][106225] Updated weights for policy 1, policy_version 122146 (0.0006) [2023-12-27 20:06:27,905][106225] Updated weights for policy 1, policy_version 122156 (0.0008) [2023-12-27 20:06:27,954][106225] Updated weights for policy 1, policy_version 122166 (0.0007) [2023-12-27 20:06:28,013][106225] Updated weights for policy 1, policy_version 122176 (0.0008) [2023-12-27 20:06:28,085][106226] Updated weights for policy 0, policy_version 122249 (0.0006) [2023-12-27 20:06:28,128][106226] Updated weights for policy 0, policy_version 122259 (0.0006) [2023-12-27 20:06:28,187][106226] Updated weights for policy 0, policy_version 122269 (0.0005) [2023-12-27 20:06:28,240][106226] Updated weights for policy 0, policy_version 122279 (0.0005) [2023-12-27 20:06:28,763][106225] Updated weights for policy 1, policy_version 122186 (0.0005) [2023-12-27 20:06:28,822][106225] Updated weights for policy 1, policy_version 122196 (0.0008) [2023-12-27 20:06:28,881][106226] Updated weights for policy 0, policy_version 122289 (0.0005) [2023-12-27 20:06:28,888][106225] Updated weights for policy 1, policy_version 122206 (0.0008) [2023-12-27 20:06:28,944][106226] Updated weights for policy 0, policy_version 122299 (0.0008) [2023-12-27 20:06:29,004][106226] Updated weights for policy 0, policy_version 122309 (0.0010) [2023-12-27 20:06:29,601][106225] Updated weights for policy 1, policy_version 122216 (0.0006) [2023-12-27 20:06:29,658][106225] Updated weights for policy 1, policy_version 122226 (0.0007) [2023-12-27 20:06:29,668][106226] Updated weights for policy 0, policy_version 122319 (0.0010) [2023-12-27 20:06:29,711][106225] Updated weights for policy 1, policy_version 122236 (0.0007) [2023-12-27 20:06:29,717][106226] Updated weights for policy 0, policy_version 122329 (0.0010) [2023-12-27 20:06:29,777][106226] Updated weights for policy 0, policy_version 122339 (0.0010) [2023-12-27 20:06:30,434][106226] Updated weights for policy 0, policy_version 122349 (0.0010) [2023-12-27 20:06:30,452][106225] Updated weights for policy 1, policy_version 122246 (0.0006) [2023-12-27 20:06:30,487][106226] Updated weights for policy 0, policy_version 122359 (0.0010) [2023-12-27 20:06:30,508][106225] Updated weights for policy 1, policy_version 122256 (0.0007) [2023-12-27 20:06:30,543][106226] Updated weights for policy 0, policy_version 122369 (0.0010) [2023-12-27 20:06:30,554][106225] Updated weights for policy 1, policy_version 122266 (0.0008) [2023-12-27 20:06:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 62644224. Throughput: 0: 10017.2, 1: 9883.3. Samples: 62637400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:31,175][105115] Avg episode reward: [(0, '-5.351'), (1, '-6.846')] [2023-12-27 20:06:31,182][106225] Updated weights for policy 1, policy_version 122276 (0.0007) [2023-12-27 20:06:31,208][106226] Updated weights for policy 0, policy_version 122379 (0.0010) [2023-12-27 20:06:31,243][106225] Updated weights for policy 1, policy_version 122286 (0.0007) [2023-12-27 20:06:31,270][106226] Updated weights for policy 0, policy_version 122389 (0.0011) [2023-12-27 20:06:31,300][106225] Updated weights for policy 1, policy_version 122296 (0.0008) [2023-12-27 20:06:31,325][106226] Updated weights for policy 0, policy_version 122399 (0.0011) [2023-12-27 20:06:32,012][106225] Updated weights for policy 1, policy_version 122306 (0.0007) [2023-12-27 20:06:32,060][106226] Updated weights for policy 0, policy_version 122409 (0.0009) [2023-12-27 20:06:32,074][106225] Updated weights for policy 1, policy_version 122316 (0.0006) [2023-12-27 20:06:32,124][106226] Updated weights for policy 0, policy_version 122419 (0.0011) [2023-12-27 20:06:32,141][106225] Updated weights for policy 1, policy_version 122326 (0.0006) [2023-12-27 20:06:32,183][106226] Updated weights for policy 0, policy_version 122429 (0.0010) [2023-12-27 20:06:32,192][106225] Updated weights for policy 1, policy_version 122336 (0.0007) [2023-12-27 20:06:32,244][106226] Updated weights for policy 0, policy_version 122439 (0.0010) [2023-12-27 20:06:32,811][106225] Updated weights for policy 1, policy_version 122346 (0.0008) [2023-12-27 20:06:32,864][106225] Updated weights for policy 1, policy_version 122356 (0.0008) [2023-12-27 20:06:32,913][106225] Updated weights for policy 1, policy_version 122366 (0.0006) [2023-12-27 20:06:32,927][106226] Updated weights for policy 0, policy_version 122449 (0.0010) [2023-12-27 20:06:32,987][106226] Updated weights for policy 0, policy_version 122459 (0.0010) [2023-12-27 20:06:33,036][106226] Updated weights for policy 0, policy_version 122469 (0.0010) [2023-12-27 20:06:33,646][106225] Updated weights for policy 1, policy_version 122376 (0.0007) [2023-12-27 20:06:33,697][106225] Updated weights for policy 1, policy_version 122386 (0.0008) [2023-12-27 20:06:33,729][106226] Updated weights for policy 0, policy_version 122479 (0.0008) [2023-12-27 20:06:33,751][106225] Updated weights for policy 1, policy_version 122396 (0.0005) [2023-12-27 20:06:33,779][106226] Updated weights for policy 0, policy_version 122489 (0.0007) [2023-12-27 20:06:33,835][106226] Updated weights for policy 0, policy_version 122499 (0.0008) [2023-12-27 20:06:34,453][106225] Updated weights for policy 1, policy_version 122406 (0.0007) [2023-12-27 20:06:34,511][106225] Updated weights for policy 1, policy_version 122416 (0.0008) [2023-12-27 20:06:34,548][106226] Updated weights for policy 0, policy_version 122509 (0.0010) [2023-12-27 20:06:34,572][106225] Updated weights for policy 1, policy_version 122426 (0.0008) [2023-12-27 20:06:34,610][106226] Updated weights for policy 0, policy_version 122519 (0.0011) [2023-12-27 20:06:34,676][106226] Updated weights for policy 0, policy_version 122529 (0.0008) [2023-12-27 20:06:35,352][106226] Updated weights for policy 0, policy_version 122539 (0.0009) [2023-12-27 20:06:35,353][106225] Updated weights for policy 1, policy_version 122436 (0.0005) [2023-12-27 20:06:35,404][106226] Updated weights for policy 0, policy_version 122549 (0.0006) [2023-12-27 20:06:35,420][106225] Updated weights for policy 1, policy_version 122446 (0.0008) [2023-12-27 20:06:35,451][106226] Updated weights for policy 0, policy_version 122559 (0.0006) [2023-12-27 20:06:35,481][106225] Updated weights for policy 1, policy_version 122456 (0.0006) [2023-12-27 20:06:36,100][106226] Updated weights for policy 0, policy_version 122569 (0.0007) [2023-12-27 20:06:36,168][106226] Updated weights for policy 0, policy_version 122579 (0.0007) [2023-12-27 20:06:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 62742528. Throughput: 0: 10072.2, 1: 9885.3. Samples: 62757748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:36,175][105115] Avg episode reward: [(0, '-5.234'), (1, '-7.032')] [2023-12-27 20:06:36,176][106225] Updated weights for policy 1, policy_version 122466 (0.0007) [2023-12-27 20:06:36,234][106225] Updated weights for policy 1, policy_version 122476 (0.0010) [2023-12-27 20:06:36,236][106226] Updated weights for policy 0, policy_version 122589 (0.0006) [2023-12-27 20:06:36,297][106226] Updated weights for policy 0, policy_version 122599 (0.0008) [2023-12-27 20:06:36,299][106225] Updated weights for policy 1, policy_version 122486 (0.0011) [2023-12-27 20:06:36,360][106225] Updated weights for policy 1, policy_version 122496 (0.0011) [2023-12-27 20:06:37,012][106226] Updated weights for policy 0, policy_version 122609 (0.0008) [2023-12-27 20:06:37,066][106226] Updated weights for policy 0, policy_version 122619 (0.0006) [2023-12-27 20:06:37,072][106225] Updated weights for policy 1, policy_version 122506 (0.0010) [2023-12-27 20:06:37,117][106226] Updated weights for policy 0, policy_version 122629 (0.0005) [2023-12-27 20:06:37,119][106225] Updated weights for policy 1, policy_version 122516 (0.0010) [2023-12-27 20:06:37,168][106225] Updated weights for policy 1, policy_version 122526 (0.0010) [2023-12-27 20:06:37,704][106226] Updated weights for policy 0, policy_version 122639 (0.0006) [2023-12-27 20:06:37,763][106226] Updated weights for policy 0, policy_version 122649 (0.0010) [2023-12-27 20:06:37,825][106226] Updated weights for policy 0, policy_version 122659 (0.0007) [2023-12-27 20:06:37,850][106225] Updated weights for policy 1, policy_version 122536 (0.0008) [2023-12-27 20:06:37,915][106225] Updated weights for policy 1, policy_version 122546 (0.0007) [2023-12-27 20:06:37,971][106225] Updated weights for policy 1, policy_version 122556 (0.0005) [2023-12-27 20:06:38,569][106226] Updated weights for policy 0, policy_version 122669 (0.0007) [2023-12-27 20:06:38,605][106225] Updated weights for policy 1, policy_version 122566 (0.0009) [2023-12-27 20:06:38,630][106226] Updated weights for policy 0, policy_version 122679 (0.0006) [2023-12-27 20:06:38,664][106225] Updated weights for policy 1, policy_version 122576 (0.0010) [2023-12-27 20:06:38,690][106226] Updated weights for policy 0, policy_version 122689 (0.0006) [2023-12-27 20:06:38,726][106225] Updated weights for policy 1, policy_version 122586 (0.0010) [2023-12-27 20:06:39,439][106225] Updated weights for policy 1, policy_version 122596 (0.0009) [2023-12-27 20:06:39,474][106226] Updated weights for policy 0, policy_version 122699 (0.0008) [2023-12-27 20:06:39,505][106225] Updated weights for policy 1, policy_version 122606 (0.0007) [2023-12-27 20:06:39,529][106226] Updated weights for policy 0, policy_version 122709 (0.0008) [2023-12-27 20:06:39,567][106225] Updated weights for policy 1, policy_version 122616 (0.0006) [2023-12-27 20:06:39,593][106226] Updated weights for policy 0, policy_version 122719 (0.0007) [2023-12-27 20:06:40,266][106225] Updated weights for policy 1, policy_version 122626 (0.0007) [2023-12-27 20:06:40,326][106225] Updated weights for policy 1, policy_version 122636 (0.0008) [2023-12-27 20:06:40,394][106225] Updated weights for policy 1, policy_version 122646 (0.0007) [2023-12-27 20:06:40,398][106226] Updated weights for policy 0, policy_version 122729 (0.0007) [2023-12-27 20:06:40,456][106225] Updated weights for policy 1, policy_version 122656 (0.0007) [2023-12-27 20:06:40,458][106226] Updated weights for policy 0, policy_version 122739 (0.0009) [2023-12-27 20:06:40,517][106226] Updated weights for policy 0, policy_version 122749 (0.0009) [2023-12-27 20:06:40,575][106226] Updated weights for policy 0, policy_version 122759 (0.0009) [2023-12-27 20:06:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 62840832. Throughput: 0: 10090.3, 1: 9891.3. Samples: 62817664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:41,175][105115] Avg episode reward: [(0, '-5.364'), (1, '-6.839')] [2023-12-27 20:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000122760_31432704.pth... [2023-12-27 20:06:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000121608_31137792.pth [2023-12-27 20:06:41,205][106225] Updated weights for policy 1, policy_version 122666 (0.0007) [2023-12-27 20:06:41,272][106225] Updated weights for policy 1, policy_version 122676 (0.0008) [2023-12-27 20:06:41,292][106226] Updated weights for policy 0, policy_version 122769 (0.0007) [2023-12-27 20:06:41,334][106225] Updated weights for policy 1, policy_version 122686 (0.0008) [2023-12-27 20:06:41,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000122688_31416320.pth... [2023-12-27 20:06:41,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000121504_31113216.pth [2023-12-27 20:06:41,361][106226] Updated weights for policy 0, policy_version 122779 (0.0008) [2023-12-27 20:06:41,428][106226] Updated weights for policy 0, policy_version 122789 (0.0009) [2023-12-27 20:06:42,145][106225] Updated weights for policy 1, policy_version 122696 (0.0006) [2023-12-27 20:06:42,202][106225] Updated weights for policy 1, policy_version 122706 (0.0006) [2023-12-27 20:06:42,209][106226] Updated weights for policy 0, policy_version 122799 (0.0008) [2023-12-27 20:06:42,262][106225] Updated weights for policy 1, policy_version 122716 (0.0008) [2023-12-27 20:06:42,272][106226] Updated weights for policy 0, policy_version 122809 (0.0008) [2023-12-27 20:06:42,340][106226] Updated weights for policy 0, policy_version 122819 (0.0007) [2023-12-27 20:06:42,949][106225] Updated weights for policy 1, policy_version 122726 (0.0006) [2023-12-27 20:06:43,002][106225] Updated weights for policy 1, policy_version 122736 (0.0005) [2023-12-27 20:06:43,052][106225] Updated weights for policy 1, policy_version 122746 (0.0007) [2023-12-27 20:06:43,058][106226] Updated weights for policy 0, policy_version 122829 (0.0008) [2023-12-27 20:06:43,117][106226] Updated weights for policy 0, policy_version 122839 (0.0007) [2023-12-27 20:06:43,169][106226] Updated weights for policy 0, policy_version 122849 (0.0009) [2023-12-27 20:06:43,748][106225] Updated weights for policy 1, policy_version 122756 (0.0007) [2023-12-27 20:06:43,799][106225] Updated weights for policy 1, policy_version 122766 (0.0010) [2023-12-27 20:06:43,829][106226] Updated weights for policy 0, policy_version 122859 (0.0008) [2023-12-27 20:06:43,858][106225] Updated weights for policy 1, policy_version 122776 (0.0008) [2023-12-27 20:06:43,887][106226] Updated weights for policy 0, policy_version 122869 (0.0007) [2023-12-27 20:06:43,948][106226] Updated weights for policy 0, policy_version 122879 (0.0007) [2023-12-27 20:06:44,576][106226] Updated weights for policy 0, policy_version 122889 (0.0006) [2023-12-27 20:06:44,619][106225] Updated weights for policy 1, policy_version 122786 (0.0005) [2023-12-27 20:06:44,633][106226] Updated weights for policy 0, policy_version 122899 (0.0007) [2023-12-27 20:06:44,670][106225] Updated weights for policy 1, policy_version 122796 (0.0008) [2023-12-27 20:06:44,688][106226] Updated weights for policy 0, policy_version 122909 (0.0007) [2023-12-27 20:06:44,721][106225] Updated weights for policy 1, policy_version 122806 (0.0006) [2023-12-27 20:06:44,750][106226] Updated weights for policy 0, policy_version 122919 (0.0009) [2023-12-27 20:06:44,789][106225] Updated weights for policy 1, policy_version 122816 (0.0007) [2023-12-27 20:06:45,390][106226] Updated weights for policy 0, policy_version 122929 (0.0010) [2023-12-27 20:06:45,460][106226] Updated weights for policy 0, policy_version 122939 (0.0011) [2023-12-27 20:06:45,523][106226] Updated weights for policy 0, policy_version 122949 (0.0010) [2023-12-27 20:06:45,585][106225] Updated weights for policy 1, policy_version 122826 (0.0008) [2023-12-27 20:06:45,640][106225] Updated weights for policy 1, policy_version 122836 (0.0008) [2023-12-27 20:06:45,696][106225] Updated weights for policy 1, policy_version 122846 (0.0006) [2023-12-27 20:06:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 62939136. Throughput: 0: 10031.5, 1: 9848.2. Samples: 62932452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:46,175][105115] Avg episode reward: [(0, '-5.366'), (1, '-6.451')] [2023-12-27 20:06:46,195][106226] Updated weights for policy 0, policy_version 122959 (0.0009) [2023-12-27 20:06:46,245][106226] Updated weights for policy 0, policy_version 122969 (0.0010) [2023-12-27 20:06:46,296][106226] Updated weights for policy 0, policy_version 122979 (0.0007) [2023-12-27 20:06:46,315][106225] Updated weights for policy 1, policy_version 122856 (0.0007) [2023-12-27 20:06:46,369][106225] Updated weights for policy 1, policy_version 122866 (0.0005) [2023-12-27 20:06:46,426][106225] Updated weights for policy 1, policy_version 122876 (0.0005) [2023-12-27 20:06:46,905][106226] Updated weights for policy 0, policy_version 122989 (0.0008) [2023-12-27 20:06:46,943][106225] Updated weights for policy 1, policy_version 122886 (0.0007) [2023-12-27 20:06:46,961][106226] Updated weights for policy 0, policy_version 122999 (0.0010) [2023-12-27 20:06:46,994][106225] Updated weights for policy 1, policy_version 122896 (0.0007) [2023-12-27 20:06:47,014][106226] Updated weights for policy 0, policy_version 123009 (0.0010) [2023-12-27 20:06:47,051][106225] Updated weights for policy 1, policy_version 122906 (0.0007) [2023-12-27 20:06:47,640][106225] Updated weights for policy 1, policy_version 122916 (0.0007) [2023-12-27 20:06:47,704][106225] Updated weights for policy 1, policy_version 122926 (0.0008) [2023-12-27 20:06:47,718][106226] Updated weights for policy 0, policy_version 123019 (0.0010) [2023-12-27 20:06:47,766][106225] Updated weights for policy 1, policy_version 122936 (0.0005) [2023-12-27 20:06:47,774][106226] Updated weights for policy 0, policy_version 123029 (0.0010) [2023-12-27 20:06:47,831][106226] Updated weights for policy 0, policy_version 123039 (0.0010) [2023-12-27 20:06:48,348][106225] Updated weights for policy 1, policy_version 122946 (0.0007) [2023-12-27 20:06:48,407][106225] Updated weights for policy 1, policy_version 122956 (0.0008) [2023-12-27 20:06:48,459][106225] Updated weights for policy 1, policy_version 122966 (0.0008) [2023-12-27 20:06:48,513][106225] Updated weights for policy 1, policy_version 122976 (0.0008) [2023-12-27 20:06:48,529][106226] Updated weights for policy 0, policy_version 123049 (0.0010) [2023-12-27 20:06:48,592][106226] Updated weights for policy 0, policy_version 123059 (0.0005) [2023-12-27 20:06:48,652][106226] Updated weights for policy 0, policy_version 123069 (0.0011) [2023-12-27 20:06:48,707][106226] Updated weights for policy 0, policy_version 123079 (0.0011) [2023-12-27 20:06:49,271][106225] Updated weights for policy 1, policy_version 122986 (0.0010) [2023-12-27 20:06:49,336][106225] Updated weights for policy 1, policy_version 122996 (0.0010) [2023-12-27 20:06:49,409][106225] Updated weights for policy 1, policy_version 123006 (0.0008) [2023-12-27 20:06:49,416][106226] Updated weights for policy 0, policy_version 123089 (0.0009) [2023-12-27 20:06:49,478][106226] Updated weights for policy 0, policy_version 123099 (0.0008) [2023-12-27 20:06:49,528][106226] Updated weights for policy 0, policy_version 123109 (0.0010) [2023-12-27 20:06:50,138][106225] Updated weights for policy 1, policy_version 123016 (0.0008) [2023-12-27 20:06:50,197][106225] Updated weights for policy 1, policy_version 123026 (0.0008) [2023-12-27 20:06:50,249][106225] Updated weights for policy 1, policy_version 123036 (0.0008) [2023-12-27 20:06:50,282][106226] Updated weights for policy 0, policy_version 123119 (0.0009) [2023-12-27 20:06:50,348][106226] Updated weights for policy 0, policy_version 123129 (0.0008) [2023-12-27 20:06:50,417][106226] Updated weights for policy 0, policy_version 123139 (0.0009) [2023-12-27 20:06:50,931][106225] Updated weights for policy 1, policy_version 123046 (0.0009) [2023-12-27 20:06:50,993][106225] Updated weights for policy 1, policy_version 123056 (0.0008) [2023-12-27 20:06:51,063][106225] Updated weights for policy 1, policy_version 123066 (0.0007) [2023-12-27 20:06:51,154][106226] Updated weights for policy 0, policy_version 123149 (0.0008) [2023-12-27 20:06:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 63045632. Throughput: 0: 9987.5, 1: 9990.3. Samples: 63055364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:51,175][105115] Avg episode reward: [(0, '-5.214'), (1, '-7.034')] [2023-12-27 20:06:51,217][106226] Updated weights for policy 0, policy_version 123159 (0.0008) [2023-12-27 20:06:51,281][106226] Updated weights for policy 0, policy_version 123169 (0.0008) [2023-12-27 20:06:51,861][106225] Updated weights for policy 1, policy_version 123076 (0.0009) [2023-12-27 20:06:51,910][106225] Updated weights for policy 1, policy_version 123086 (0.0009) [2023-12-27 20:06:51,959][106225] Updated weights for policy 1, policy_version 123096 (0.0009) [2023-12-27 20:06:52,032][106226] Updated weights for policy 0, policy_version 123179 (0.0008) [2023-12-27 20:06:52,082][106226] Updated weights for policy 0, policy_version 123189 (0.0009) [2023-12-27 20:06:52,129][106226] Updated weights for policy 0, policy_version 123199 (0.0008) [2023-12-27 20:06:52,714][106225] Updated weights for policy 1, policy_version 123106 (0.0009) [2023-12-27 20:06:52,774][106225] Updated weights for policy 1, policy_version 123116 (0.0010) [2023-12-27 20:06:52,835][106225] Updated weights for policy 1, policy_version 123126 (0.0010) [2023-12-27 20:06:52,875][106226] Updated weights for policy 0, policy_version 123209 (0.0006) [2023-12-27 20:06:52,890][106225] Updated weights for policy 1, policy_version 123136 (0.0008) [2023-12-27 20:06:52,933][106226] Updated weights for policy 0, policy_version 123219 (0.0009) [2023-12-27 20:06:52,997][106226] Updated weights for policy 0, policy_version 123229 (0.0009) [2023-12-27 20:06:53,067][106226] Updated weights for policy 0, policy_version 123239 (0.0008) [2023-12-27 20:06:53,511][106225] Updated weights for policy 1, policy_version 123146 (0.0005) [2023-12-27 20:06:53,573][106225] Updated weights for policy 1, policy_version 123156 (0.0008) [2023-12-27 20:06:53,633][106225] Updated weights for policy 1, policy_version 123166 (0.0008) [2023-12-27 20:06:53,802][106226] Updated weights for policy 0, policy_version 123249 (0.0009) [2023-12-27 20:06:53,858][106226] Updated weights for policy 0, policy_version 123259 (0.0008) [2023-12-27 20:06:53,918][106226] Updated weights for policy 0, policy_version 123269 (0.0008) [2023-12-27 20:06:54,266][106225] Updated weights for policy 1, policy_version 123176 (0.0007) [2023-12-27 20:06:54,330][106225] Updated weights for policy 1, policy_version 123186 (0.0008) [2023-12-27 20:06:54,400][106225] Updated weights for policy 1, policy_version 123196 (0.0009) [2023-12-27 20:06:54,645][106226] Updated weights for policy 0, policy_version 123279 (0.0007) [2023-12-27 20:06:54,697][106226] Updated weights for policy 0, policy_version 123289 (0.0009) [2023-12-27 20:06:54,749][106226] Updated weights for policy 0, policy_version 123299 (0.0007) [2023-12-27 20:06:55,140][106225] Updated weights for policy 1, policy_version 123206 (0.0009) [2023-12-27 20:06:55,196][106225] Updated weights for policy 1, policy_version 123216 (0.0007) [2023-12-27 20:06:55,256][106225] Updated weights for policy 1, policy_version 123226 (0.0008) [2023-12-27 20:06:55,487][106226] Updated weights for policy 0, policy_version 123309 (0.0010) [2023-12-27 20:06:55,538][106226] Updated weights for policy 0, policy_version 123319 (0.0009) [2023-12-27 20:06:55,598][106226] Updated weights for policy 0, policy_version 123329 (0.0011) [2023-12-27 20:06:55,970][106225] Updated weights for policy 1, policy_version 123236 (0.0008) [2023-12-27 20:06:56,022][106225] Updated weights for policy 1, policy_version 123246 (0.0008) [2023-12-27 20:06:56,079][106225] Updated weights for policy 1, policy_version 123256 (0.0007) [2023-12-27 20:06:56,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 63143936. Throughput: 0: 9924.0, 1: 9968.7. Samples: 63112460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:06:56,176][105115] Avg episode reward: [(0, '-5.215'), (1, '-6.640')] [2023-12-27 20:06:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000123336_31580160.pth... [2023-12-27 20:06:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000123264_31563776.pth... [2023-12-27 20:06:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000122184_31285248.pth [2023-12-27 20:06:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000122112_31268864.pth [2023-12-27 20:06:56,328][106226] Updated weights for policy 0, policy_version 123339 (0.0010) [2023-12-27 20:06:56,393][106226] Updated weights for policy 0, policy_version 123349 (0.0010) [2023-12-27 20:06:56,455][106226] Updated weights for policy 0, policy_version 123359 (0.0010) [2023-12-27 20:06:56,694][106225] Updated weights for policy 1, policy_version 123266 (0.0008) [2023-12-27 20:06:56,755][106225] Updated weights for policy 1, policy_version 123276 (0.0007) [2023-12-27 20:06:56,822][106225] Updated weights for policy 1, policy_version 123286 (0.0005) [2023-12-27 20:06:56,887][106225] Updated weights for policy 1, policy_version 123296 (0.0005) [2023-12-27 20:06:57,139][106226] Updated weights for policy 0, policy_version 123369 (0.0010) [2023-12-27 20:06:57,185][106226] Updated weights for policy 0, policy_version 123379 (0.0010) [2023-12-27 20:06:57,234][106226] Updated weights for policy 0, policy_version 123389 (0.0010) [2023-12-27 20:06:57,280][106226] Updated weights for policy 0, policy_version 123399 (0.0010) [2023-12-27 20:06:57,389][106225] Updated weights for policy 1, policy_version 123306 (0.0005) [2023-12-27 20:06:57,452][106225] Updated weights for policy 1, policy_version 123316 (0.0005) [2023-12-27 20:06:57,509][106225] Updated weights for policy 1, policy_version 123326 (0.0005) [2023-12-27 20:06:57,919][106226] Updated weights for policy 0, policy_version 123409 (0.0006) [2023-12-27 20:06:57,968][106226] Updated weights for policy 0, policy_version 123419 (0.0010) [2023-12-27 20:06:57,980][106225] Updated weights for policy 1, policy_version 123336 (0.0005) [2023-12-27 20:06:58,015][106226] Updated weights for policy 0, policy_version 123429 (0.0010) [2023-12-27 20:06:58,030][106225] Updated weights for policy 1, policy_version 123346 (0.0008) [2023-12-27 20:06:58,085][106225] Updated weights for policy 1, policy_version 123356 (0.0005) [2023-12-27 20:06:58,769][106226] Updated weights for policy 0, policy_version 123439 (0.0009) [2023-12-27 20:06:58,836][106226] Updated weights for policy 0, policy_version 123449 (0.0009) [2023-12-27 20:06:58,854][106225] Updated weights for policy 1, policy_version 123366 (0.0007) [2023-12-27 20:06:58,910][106226] Updated weights for policy 0, policy_version 123459 (0.0009) [2023-12-27 20:06:58,924][106225] Updated weights for policy 1, policy_version 123376 (0.0010) [2023-12-27 20:06:58,989][106225] Updated weights for policy 1, policy_version 123386 (0.0010) [2023-12-27 20:06:59,683][106226] Updated weights for policy 0, policy_version 123469 (0.0008) [2023-12-27 20:06:59,687][106225] Updated weights for policy 1, policy_version 123396 (0.0009) [2023-12-27 20:06:59,743][106226] Updated weights for policy 0, policy_version 123479 (0.0007) [2023-12-27 20:06:59,756][106225] Updated weights for policy 1, policy_version 123406 (0.0009) [2023-12-27 20:06:59,810][106226] Updated weights for policy 0, policy_version 123489 (0.0009) [2023-12-27 20:06:59,816][106225] Updated weights for policy 1, policy_version 123416 (0.0010) [2023-12-27 20:07:00,505][106225] Updated weights for policy 1, policy_version 123426 (0.0009) [2023-12-27 20:07:00,530][106226] Updated weights for policy 0, policy_version 123499 (0.0008) [2023-12-27 20:07:00,562][106225] Updated weights for policy 1, policy_version 123436 (0.0010) [2023-12-27 20:07:00,582][106226] Updated weights for policy 0, policy_version 123509 (0.0008) [2023-12-27 20:07:00,622][106225] Updated weights for policy 1, policy_version 123446 (0.0010) [2023-12-27 20:07:00,637][106226] Updated weights for policy 0, policy_version 123519 (0.0005) [2023-12-27 20:07:00,680][106225] Updated weights for policy 1, policy_version 123456 (0.0010) [2023-12-27 20:07:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 63242240. Throughput: 0: 9943.1, 1: 10073.1. Samples: 63234248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:07:01,175][105115] Avg episode reward: [(0, '-5.341'), (1, '-6.341')] [2023-12-27 20:07:01,275][106226] Updated weights for policy 0, policy_version 123529 (0.0005) [2023-12-27 20:07:01,332][106226] Updated weights for policy 0, policy_version 123539 (0.0007) [2023-12-27 20:07:01,364][106225] Updated weights for policy 1, policy_version 123466 (0.0007) [2023-12-27 20:07:01,403][106226] Updated weights for policy 0, policy_version 123549 (0.0007) [2023-12-27 20:07:01,429][106225] Updated weights for policy 1, policy_version 123476 (0.0008) [2023-12-27 20:07:01,461][106226] Updated weights for policy 0, policy_version 123559 (0.0008) [2023-12-27 20:07:01,484][106225] Updated weights for policy 1, policy_version 123486 (0.0007) [2023-12-27 20:07:02,131][106226] Updated weights for policy 0, policy_version 123569 (0.0008) [2023-12-27 20:07:02,197][106226] Updated weights for policy 0, policy_version 123579 (0.0008) [2023-12-27 20:07:02,220][106225] Updated weights for policy 1, policy_version 123496 (0.0006) [2023-12-27 20:07:02,250][106226] Updated weights for policy 0, policy_version 123589 (0.0008) [2023-12-27 20:07:02,281][106225] Updated weights for policy 1, policy_version 123506 (0.0007) [2023-12-27 20:07:02,333][106225] Updated weights for policy 1, policy_version 123516 (0.0009) [2023-12-27 20:07:03,011][106225] Updated weights for policy 1, policy_version 123526 (0.0010) [2023-12-27 20:07:03,025][106226] Updated weights for policy 0, policy_version 123599 (0.0010) [2023-12-27 20:07:03,067][106225] Updated weights for policy 1, policy_version 123536 (0.0010) [2023-12-27 20:07:03,077][106226] Updated weights for policy 0, policy_version 123609 (0.0005) [2023-12-27 20:07:03,127][106225] Updated weights for policy 1, policy_version 123546 (0.0010) [2023-12-27 20:07:03,128][106226] Updated weights for policy 0, policy_version 123619 (0.0008) [2023-12-27 20:07:03,716][106226] Updated weights for policy 0, policy_version 123629 (0.0008) [2023-12-27 20:07:03,781][106226] Updated weights for policy 0, policy_version 123639 (0.0005) [2023-12-27 20:07:03,845][106226] Updated weights for policy 0, policy_version 123649 (0.0006) [2023-12-27 20:07:03,848][106225] Updated weights for policy 1, policy_version 123556 (0.0010) [2023-12-27 20:07:03,914][106225] Updated weights for policy 1, policy_version 123566 (0.0009) [2023-12-27 20:07:03,969][106225] Updated weights for policy 1, policy_version 123576 (0.0009) [2023-12-27 20:07:04,551][106226] Updated weights for policy 0, policy_version 123659 (0.0011) [2023-12-27 20:07:04,613][106226] Updated weights for policy 0, policy_version 123669 (0.0006) [2023-12-27 20:07:04,677][106226] Updated weights for policy 0, policy_version 123679 (0.0009) [2023-12-27 20:07:04,759][106225] Updated weights for policy 1, policy_version 123586 (0.0009) [2023-12-27 20:07:04,811][106225] Updated weights for policy 1, policy_version 123596 (0.0008) [2023-12-27 20:07:04,859][106225] Updated weights for policy 1, policy_version 123606 (0.0008) [2023-12-27 20:07:04,903][106225] Updated weights for policy 1, policy_version 123616 (0.0008) [2023-12-27 20:07:05,302][106226] Updated weights for policy 0, policy_version 123689 (0.0008) [2023-12-27 20:07:05,353][106226] Updated weights for policy 0, policy_version 123699 (0.0005) [2023-12-27 20:07:05,406][106226] Updated weights for policy 0, policy_version 123709 (0.0006) [2023-12-27 20:07:05,465][106226] Updated weights for policy 0, policy_version 123719 (0.0010) [2023-12-27 20:07:05,692][106225] Updated weights for policy 1, policy_version 123626 (0.0007) [2023-12-27 20:07:05,744][106225] Updated weights for policy 1, policy_version 123636 (0.0005) [2023-12-27 20:07:05,802][106225] Updated weights for policy 1, policy_version 123646 (0.0009) [2023-12-27 20:07:06,055][106226] Updated weights for policy 0, policy_version 123729 (0.0007) [2023-12-27 20:07:06,107][106226] Updated weights for policy 0, policy_version 123739 (0.0007) [2023-12-27 20:07:06,165][106226] Updated weights for policy 0, policy_version 123749 (0.0009) [2023-12-27 20:07:06,174][105115] Fps is (10 sec: 19661.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 63340544. Throughput: 0: 9995.1, 1: 10020.8. Samples: 63354392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:07:06,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-6.784')] [2023-12-27 20:07:06,440][106225] Updated weights for policy 1, policy_version 123656 (0.0008) [2023-12-27 20:07:06,502][106225] Updated weights for policy 1, policy_version 123666 (0.0007) [2023-12-27 20:07:06,566][106225] Updated weights for policy 1, policy_version 123676 (0.0009) [2023-12-27 20:07:06,998][106226] Updated weights for policy 0, policy_version 123759 (0.0008) [2023-12-27 20:07:07,049][106226] Updated weights for policy 0, policy_version 123770 (0.0010) [2023-12-27 20:07:07,103][106226] Updated weights for policy 0, policy_version 123780 (0.0008) [2023-12-27 20:07:07,194][106225] Updated weights for policy 1, policy_version 123686 (0.0008) [2023-12-27 20:07:07,253][106225] Updated weights for policy 1, policy_version 123696 (0.0007) [2023-12-27 20:07:07,317][106225] Updated weights for policy 1, policy_version 123706 (0.0009) [2023-12-27 20:07:07,808][106226] Updated weights for policy 0, policy_version 123790 (0.0008) [2023-12-27 20:07:07,860][106226] Updated weights for policy 0, policy_version 123800 (0.0009) [2023-12-27 20:07:07,891][106225] Updated weights for policy 1, policy_version 123716 (0.0007) [2023-12-27 20:07:07,909][106226] Updated weights for policy 0, policy_version 123810 (0.0008) [2023-12-27 20:07:07,946][106225] Updated weights for policy 1, policy_version 123726 (0.0007) [2023-12-27 20:07:07,997][106225] Updated weights for policy 1, policy_version 123736 (0.0008) [2023-12-27 20:07:08,549][106226] Updated weights for policy 0, policy_version 123820 (0.0006) [2023-12-27 20:07:08,605][106226] Updated weights for policy 0, policy_version 123830 (0.0010) [2023-12-27 20:07:08,660][106226] Updated weights for policy 0, policy_version 123840 (0.0008) [2023-12-27 20:07:08,707][106225] Updated weights for policy 1, policy_version 123746 (0.0008) [2023-12-27 20:07:08,773][106225] Updated weights for policy 1, policy_version 123756 (0.0010) [2023-12-27 20:07:08,837][106225] Updated weights for policy 1, policy_version 123766 (0.0008) [2023-12-27 20:07:08,900][106225] Updated weights for policy 1, policy_version 123776 (0.0009) [2023-12-27 20:07:09,448][106226] Updated weights for policy 0, policy_version 123850 (0.0008) [2023-12-27 20:07:09,512][106226] Updated weights for policy 0, policy_version 123860 (0.0007) [2023-12-27 20:07:09,563][106226] Updated weights for policy 0, policy_version 123870 (0.0008) [2023-12-27 20:07:09,622][106225] Updated weights for policy 1, policy_version 123786 (0.0008) [2023-12-27 20:07:09,625][106226] Updated weights for policy 0, policy_version 123880 (0.0006) [2023-12-27 20:07:09,683][106225] Updated weights for policy 1, policy_version 123796 (0.0009) [2023-12-27 20:07:09,746][106225] Updated weights for policy 1, policy_version 123806 (0.0009) [2023-12-27 20:07:10,317][106226] Updated weights for policy 0, policy_version 123890 (0.0009) [2023-12-27 20:07:10,380][106226] Updated weights for policy 0, policy_version 123900 (0.0010) [2023-12-27 20:07:10,454][106226] Updated weights for policy 0, policy_version 123910 (0.0009) [2023-12-27 20:07:10,485][106225] Updated weights for policy 1, policy_version 123816 (0.0007) [2023-12-27 20:07:10,544][106225] Updated weights for policy 1, policy_version 123826 (0.0006) [2023-12-27 20:07:10,601][106225] Updated weights for policy 1, policy_version 123836 (0.0006) [2023-12-27 20:07:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 63438848. Throughput: 0: 10054.6, 1: 10042.3. Samples: 63416056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:07:11,175][105115] Avg episode reward: [(0, '-5.428'), (1, '-6.626')] [2023-12-27 20:07:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000123912_31727616.pth... [2023-12-27 20:07:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000122760_31432704.pth [2023-12-27 20:07:11,207][106225] Updated weights for policy 1, policy_version 123846 (0.0006) [2023-12-27 20:07:11,257][106226] Updated weights for policy 0, policy_version 123920 (0.0010) [2023-12-27 20:07:11,278][106225] Updated weights for policy 1, policy_version 123856 (0.0007) [2023-12-27 20:07:11,329][106226] Updated weights for policy 0, policy_version 123930 (0.0011) [2023-12-27 20:07:11,345][106225] Updated weights for policy 1, policy_version 123866 (0.0007) [2023-12-27 20:07:11,391][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000123872_31719424.pth... [2023-12-27 20:07:11,396][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000122688_31416320.pth [2023-12-27 20:07:11,398][106226] Updated weights for policy 0, policy_version 123940 (0.0011) [2023-12-27 20:07:12,054][106226] Updated weights for policy 0, policy_version 123950 (0.0009) [2023-12-27 20:07:12,108][106226] Updated weights for policy 0, policy_version 123960 (0.0008) [2023-12-27 20:07:12,128][106225] Updated weights for policy 1, policy_version 123876 (0.0009) [2023-12-27 20:07:12,168][106226] Updated weights for policy 0, policy_version 123970 (0.0006) [2023-12-27 20:07:12,189][106225] Updated weights for policy 1, policy_version 123886 (0.0007) [2023-12-27 20:07:12,255][106225] Updated weights for policy 1, policy_version 123896 (0.0008) [2023-12-27 20:07:12,884][106226] Updated weights for policy 0, policy_version 123980 (0.0007) [2023-12-27 20:07:12,944][106226] Updated weights for policy 0, policy_version 123990 (0.0008) [2023-12-27 20:07:12,970][106225] Updated weights for policy 1, policy_version 123906 (0.0007) [2023-12-27 20:07:12,991][106226] Updated weights for policy 0, policy_version 124000 (0.0008) [2023-12-27 20:07:13,030][106225] Updated weights for policy 1, policy_version 123916 (0.0006) [2023-12-27 20:07:13,076][106225] Updated weights for policy 1, policy_version 123926 (0.0005) [2023-12-27 20:07:13,120][106225] Updated weights for policy 1, policy_version 123936 (0.0005) [2023-12-27 20:07:13,711][106225] Updated weights for policy 1, policy_version 123946 (0.0005) [2023-12-27 20:07:13,769][106226] Updated weights for policy 0, policy_version 124010 (0.0008) [2023-12-27 20:07:13,770][106225] Updated weights for policy 1, policy_version 123956 (0.0008) [2023-12-27 20:07:13,818][106225] Updated weights for policy 1, policy_version 123966 (0.0008) [2023-12-27 20:07:13,824][106226] Updated weights for policy 0, policy_version 124020 (0.0006) [2023-12-27 20:07:13,886][106226] Updated weights for policy 0, policy_version 124030 (0.0008) [2023-12-27 20:07:13,950][106226] Updated weights for policy 0, policy_version 124040 (0.0009) [2023-12-27 20:07:14,383][106225] Updated weights for policy 1, policy_version 123976 (0.0007) [2023-12-27 20:07:14,440][106225] Updated weights for policy 1, policy_version 123986 (0.0008) [2023-12-27 20:07:14,501][106225] Updated weights for policy 1, policy_version 123996 (0.0008) [2023-12-27 20:07:14,720][106226] Updated weights for policy 0, policy_version 124050 (0.0010) [2023-12-27 20:07:14,785][106226] Updated weights for policy 0, policy_version 124060 (0.0009) [2023-12-27 20:07:14,848][106226] Updated weights for policy 0, policy_version 124070 (0.0009) [2023-12-27 20:07:15,145][106225] Updated weights for policy 1, policy_version 124006 (0.0007) [2023-12-27 20:07:15,202][106225] Updated weights for policy 1, policy_version 124016 (0.0008) [2023-12-27 20:07:15,268][106225] Updated weights for policy 1, policy_version 124026 (0.0009) [2023-12-27 20:07:15,558][106226] Updated weights for policy 0, policy_version 124080 (0.0006) [2023-12-27 20:07:15,617][106226] Updated weights for policy 0, policy_version 124090 (0.0008) [2023-12-27 20:07:15,670][106226] Updated weights for policy 0, policy_version 124100 (0.0007) [2023-12-27 20:07:15,949][106225] Updated weights for policy 1, policy_version 124036 (0.0007) [2023-12-27 20:07:15,995][106225] Updated weights for policy 1, policy_version 124046 (0.0008) [2023-12-27 20:07:16,043][106225] Updated weights for policy 1, policy_version 124056 (0.0008) [2023-12-27 20:07:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 63545344. Throughput: 0: 9794.2, 1: 10069.8. Samples: 63531280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:16,175][105115] Avg episode reward: [(0, '-5.089'), (1, '-6.610')] [2023-12-27 20:07:16,374][106226] Updated weights for policy 0, policy_version 124110 (0.0008) [2023-12-27 20:07:16,432][106226] Updated weights for policy 0, policy_version 124120 (0.0005) [2023-12-27 20:07:16,497][106226] Updated weights for policy 0, policy_version 124130 (0.0005) [2023-12-27 20:07:16,768][106225] Updated weights for policy 1, policy_version 124066 (0.0008) [2023-12-27 20:07:16,823][106225] Updated weights for policy 1, policy_version 124076 (0.0005) [2023-12-27 20:07:16,877][106225] Updated weights for policy 1, policy_version 124086 (0.0005) [2023-12-27 20:07:16,929][106225] Updated weights for policy 1, policy_version 124096 (0.0005) [2023-12-27 20:07:17,166][106226] Updated weights for policy 0, policy_version 124140 (0.0008) [2023-12-27 20:07:17,219][106226] Updated weights for policy 0, policy_version 124150 (0.0005) [2023-12-27 20:07:17,273][106226] Updated weights for policy 0, policy_version 124160 (0.0009) [2023-12-27 20:07:17,543][106225] Updated weights for policy 1, policy_version 124106 (0.0008) [2023-12-27 20:07:17,605][106225] Updated weights for policy 1, policy_version 124116 (0.0008) [2023-12-27 20:07:17,659][106225] Updated weights for policy 1, policy_version 124126 (0.0008) [2023-12-27 20:07:17,996][106226] Updated weights for policy 0, policy_version 124170 (0.0009) [2023-12-27 20:07:18,049][106226] Updated weights for policy 0, policy_version 124180 (0.0009) [2023-12-27 20:07:18,095][106226] Updated weights for policy 0, policy_version 124190 (0.0009) [2023-12-27 20:07:18,144][106226] Updated weights for policy 0, policy_version 124200 (0.0009) [2023-12-27 20:07:18,380][106225] Updated weights for policy 1, policy_version 124136 (0.0008) [2023-12-27 20:07:18,438][106225] Updated weights for policy 1, policy_version 124146 (0.0009) [2023-12-27 20:07:18,494][106225] Updated weights for policy 1, policy_version 124156 (0.0008) [2023-12-27 20:07:18,948][106226] Updated weights for policy 0, policy_version 124210 (0.0010) [2023-12-27 20:07:19,008][106226] Updated weights for policy 0, policy_version 124220 (0.0008) [2023-12-27 20:07:19,060][106226] Updated weights for policy 0, policy_version 124230 (0.0008) [2023-12-27 20:07:19,168][106225] Updated weights for policy 1, policy_version 124166 (0.0006) [2023-12-27 20:07:19,230][106225] Updated weights for policy 1, policy_version 124176 (0.0007) [2023-12-27 20:07:19,297][106225] Updated weights for policy 1, policy_version 124186 (0.0011) [2023-12-27 20:07:19,846][106226] Updated weights for policy 0, policy_version 124240 (0.0008) [2023-12-27 20:07:19,911][106226] Updated weights for policy 0, policy_version 124250 (0.0007) [2023-12-27 20:07:19,967][106226] Updated weights for policy 0, policy_version 124260 (0.0008) [2023-12-27 20:07:20,053][106225] Updated weights for policy 1, policy_version 124196 (0.0008) [2023-12-27 20:07:20,107][106225] Updated weights for policy 1, policy_version 124206 (0.0006) [2023-12-27 20:07:20,160][106225] Updated weights for policy 1, policy_version 124216 (0.0006) [2023-12-27 20:07:20,683][106226] Updated weights for policy 0, policy_version 124270 (0.0008) [2023-12-27 20:07:20,750][106226] Updated weights for policy 0, policy_version 124280 (0.0008) [2023-12-27 20:07:20,810][106226] Updated weights for policy 0, policy_version 124290 (0.0009) [2023-12-27 20:07:20,888][106225] Updated weights for policy 1, policy_version 124226 (0.0008) [2023-12-27 20:07:20,948][106225] Updated weights for policy 1, policy_version 124236 (0.0008) [2023-12-27 20:07:21,008][106225] Updated weights for policy 1, policy_version 124246 (0.0008) [2023-12-27 20:07:21,077][106225] Updated weights for policy 1, policy_version 124256 (0.0009) [2023-12-27 20:07:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 63643648. Throughput: 0: 9728.1, 1: 10085.7. Samples: 63649368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:21,175][105115] Avg episode reward: [(0, '-5.470'), (1, '-6.773')] [2023-12-27 20:07:21,590][106226] Updated weights for policy 0, policy_version 124300 (0.0009) [2023-12-27 20:07:21,662][106226] Updated weights for policy 0, policy_version 124310 (0.0008) [2023-12-27 20:07:21,724][106226] Updated weights for policy 0, policy_version 124320 (0.0008) [2023-12-27 20:07:21,875][106225] Updated weights for policy 1, policy_version 124266 (0.0008) [2023-12-27 20:07:21,936][106225] Updated weights for policy 1, policy_version 124276 (0.0008) [2023-12-27 20:07:21,999][106225] Updated weights for policy 1, policy_version 124286 (0.0009) [2023-12-27 20:07:22,488][106226] Updated weights for policy 0, policy_version 124330 (0.0009) [2023-12-27 20:07:22,551][106226] Updated weights for policy 0, policy_version 124340 (0.0008) [2023-12-27 20:07:22,611][106226] Updated weights for policy 0, policy_version 124350 (0.0008) [2023-12-27 20:07:22,675][106226] Updated weights for policy 0, policy_version 124360 (0.0009) [2023-12-27 20:07:22,751][106225] Updated weights for policy 1, policy_version 124296 (0.0006) [2023-12-27 20:07:22,816][106225] Updated weights for policy 1, policy_version 124306 (0.0008) [2023-12-27 20:07:22,878][106225] Updated weights for policy 1, policy_version 124316 (0.0008) [2023-12-27 20:07:23,402][106226] Updated weights for policy 0, policy_version 124370 (0.0006) [2023-12-27 20:07:23,463][106226] Updated weights for policy 0, policy_version 124380 (0.0008) [2023-12-27 20:07:23,528][106226] Updated weights for policy 0, policy_version 124390 (0.0006) [2023-12-27 20:07:23,562][106225] Updated weights for policy 1, policy_version 124326 (0.0009) [2023-12-27 20:07:23,616][106225] Updated weights for policy 1, policy_version 124336 (0.0008) [2023-12-27 20:07:23,672][106225] Updated weights for policy 1, policy_version 124346 (0.0009) [2023-12-27 20:07:24,120][106226] Updated weights for policy 0, policy_version 124400 (0.0008) [2023-12-27 20:07:24,174][106226] Updated weights for policy 0, policy_version 124410 (0.0008) [2023-12-27 20:07:24,229][106226] Updated weights for policy 0, policy_version 124420 (0.0006) [2023-12-27 20:07:24,426][106225] Updated weights for policy 1, policy_version 124356 (0.0009) [2023-12-27 20:07:24,473][106225] Updated weights for policy 1, policy_version 124366 (0.0008) [2023-12-27 20:07:24,521][106225] Updated weights for policy 1, policy_version 124376 (0.0009) [2023-12-27 20:07:24,930][106226] Updated weights for policy 0, policy_version 124430 (0.0007) [2023-12-27 20:07:24,980][106226] Updated weights for policy 0, policy_version 124440 (0.0008) [2023-12-27 20:07:25,048][106226] Updated weights for policy 0, policy_version 124450 (0.0009) [2023-12-27 20:07:25,212][106225] Updated weights for policy 1, policy_version 124386 (0.0009) [2023-12-27 20:07:25,275][106225] Updated weights for policy 1, policy_version 124396 (0.0005) [2023-12-27 20:07:25,344][106225] Updated weights for policy 1, policy_version 124406 (0.0007) [2023-12-27 20:07:25,406][106225] Updated weights for policy 1, policy_version 124416 (0.0008) [2023-12-27 20:07:25,807][106226] Updated weights for policy 0, policy_version 124460 (0.0009) [2023-12-27 20:07:25,863][106226] Updated weights for policy 0, policy_version 124470 (0.0007) [2023-12-27 20:07:25,926][106226] Updated weights for policy 0, policy_version 124480 (0.0008) [2023-12-27 20:07:26,036][106225] Updated weights for policy 1, policy_version 124426 (0.0008) [2023-12-27 20:07:26,086][106225] Updated weights for policy 1, policy_version 124436 (0.0008) [2023-12-27 20:07:26,144][106225] Updated weights for policy 1, policy_version 124446 (0.0008) [2023-12-27 20:07:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 63741952. Throughput: 0: 9714.2, 1: 10019.9. Samples: 63705700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:26,175][105115] Avg episode reward: [(0, '-5.562'), (1, '-6.589')] [2023-12-27 20:07:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000124448_31866880.pth... [2023-12-27 20:07:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000124488_31875072.pth... [2023-12-27 20:07:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000123264_31563776.pth [2023-12-27 20:07:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000123336_31580160.pth [2023-12-27 20:07:26,646][106226] Updated weights for policy 0, policy_version 124490 (0.0008) [2023-12-27 20:07:26,699][106226] Updated weights for policy 0, policy_version 124500 (0.0009) [2023-12-27 20:07:26,746][106226] Updated weights for policy 0, policy_version 124510 (0.0008) [2023-12-27 20:07:26,793][106226] Updated weights for policy 0, policy_version 124520 (0.0007) [2023-12-27 20:07:26,826][106225] Updated weights for policy 1, policy_version 124456 (0.0008) [2023-12-27 20:07:26,880][106225] Updated weights for policy 1, policy_version 124466 (0.0008) [2023-12-27 20:07:26,937][106225] Updated weights for policy 1, policy_version 124476 (0.0008) [2023-12-27 20:07:27,571][106225] Updated weights for policy 1, policy_version 124486 (0.0007) [2023-12-27 20:07:27,580][106226] Updated weights for policy 0, policy_version 124530 (0.0007) [2023-12-27 20:07:27,614][106225] Updated weights for policy 1, policy_version 124496 (0.0005) [2023-12-27 20:07:27,633][106226] Updated weights for policy 0, policy_version 124540 (0.0008) [2023-12-27 20:07:27,659][106225] Updated weights for policy 1, policy_version 124506 (0.0007) [2023-12-27 20:07:27,681][106226] Updated weights for policy 0, policy_version 124550 (0.0008) [2023-12-27 20:07:28,331][106225] Updated weights for policy 1, policy_version 124516 (0.0006) [2023-12-27 20:07:28,367][106226] Updated weights for policy 0, policy_version 124560 (0.0008) [2023-12-27 20:07:28,392][106225] Updated weights for policy 1, policy_version 124526 (0.0006) [2023-12-27 20:07:28,429][106226] Updated weights for policy 0, policy_version 124570 (0.0008) [2023-12-27 20:07:28,443][106225] Updated weights for policy 1, policy_version 124536 (0.0006) [2023-12-27 20:07:28,484][106226] Updated weights for policy 0, policy_version 124580 (0.0008) [2023-12-27 20:07:29,185][106225] Updated weights for policy 1, policy_version 124546 (0.0007) [2023-12-27 20:07:29,208][106226] Updated weights for policy 0, policy_version 124590 (0.0007) [2023-12-27 20:07:29,243][106225] Updated weights for policy 1, policy_version 124556 (0.0008) [2023-12-27 20:07:29,276][106226] Updated weights for policy 0, policy_version 124600 (0.0007) [2023-12-27 20:07:29,294][106225] Updated weights for policy 1, policy_version 124566 (0.0007) [2023-12-27 20:07:29,338][106226] Updated weights for policy 0, policy_version 124610 (0.0009) [2023-12-27 20:07:29,348][106225] Updated weights for policy 1, policy_version 124576 (0.0006) [2023-12-27 20:07:30,065][106226] Updated weights for policy 0, policy_version 124620 (0.0006) [2023-12-27 20:07:30,104][106225] Updated weights for policy 1, policy_version 124586 (0.0009) [2023-12-27 20:07:30,132][106226] Updated weights for policy 0, policy_version 124630 (0.0006) [2023-12-27 20:07:30,157][106225] Updated weights for policy 1, policy_version 124596 (0.0007) [2023-12-27 20:07:30,194][106226] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-12-27 20:07:30,213][106225] Updated weights for policy 1, policy_version 124606 (0.0008) [2023-12-27 20:07:30,814][106226] Updated weights for policy 0, policy_version 124650 (0.0007) [2023-12-27 20:07:30,866][106226] Updated weights for policy 0, policy_version 124660 (0.0006) [2023-12-27 20:07:30,922][106226] Updated weights for policy 0, policy_version 124670 (0.0005) [2023-12-27 20:07:30,961][106225] Updated weights for policy 1, policy_version 124616 (0.0007) [2023-12-27 20:07:30,971][106226] Updated weights for policy 0, policy_version 124680 (0.0006) [2023-12-27 20:07:31,008][106225] Updated weights for policy 1, policy_version 124626 (0.0007) [2023-12-27 20:07:31,066][106225] Updated weights for policy 1, policy_version 124636 (0.0007) [2023-12-27 20:07:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 63840256. Throughput: 0: 9737.0, 1: 10091.7. Samples: 63824744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:31,175][105115] Avg episode reward: [(0, '-5.081'), (1, '-7.095')] [2023-12-27 20:07:31,697][106226] Updated weights for policy 0, policy_version 124690 (0.0008) [2023-12-27 20:07:31,766][106226] Updated weights for policy 0, policy_version 124700 (0.0008) [2023-12-27 20:07:31,821][106226] Updated weights for policy 0, policy_version 124710 (0.0008) [2023-12-27 20:07:31,842][106225] Updated weights for policy 1, policy_version 124646 (0.0008) [2023-12-27 20:07:31,895][106225] Updated weights for policy 1, policy_version 124656 (0.0008) [2023-12-27 20:07:31,953][106225] Updated weights for policy 1, policy_version 124666 (0.0007) [2023-12-27 20:07:32,495][106226] Updated weights for policy 0, policy_version 124720 (0.0008) [2023-12-27 20:07:32,554][106226] Updated weights for policy 0, policy_version 124730 (0.0008) [2023-12-27 20:07:32,626][106226] Updated weights for policy 0, policy_version 124740 (0.0008) [2023-12-27 20:07:32,751][106225] Updated weights for policy 1, policy_version 124676 (0.0008) [2023-12-27 20:07:32,799][106225] Updated weights for policy 1, policy_version 124686 (0.0007) [2023-12-27 20:07:32,847][106225] Updated weights for policy 1, policy_version 124696 (0.0008) [2023-12-27 20:07:33,300][106226] Updated weights for policy 0, policy_version 124750 (0.0008) [2023-12-27 20:07:33,354][106226] Updated weights for policy 0, policy_version 124760 (0.0008) [2023-12-27 20:07:33,408][106226] Updated weights for policy 0, policy_version 124770 (0.0008) [2023-12-27 20:07:33,587][106225] Updated weights for policy 1, policy_version 124706 (0.0008) [2023-12-27 20:07:33,638][106225] Updated weights for policy 1, policy_version 124716 (0.0008) [2023-12-27 20:07:33,690][106225] Updated weights for policy 1, policy_version 124726 (0.0008) [2023-12-27 20:07:33,738][106225] Updated weights for policy 1, policy_version 124736 (0.0008) [2023-12-27 20:07:34,108][106226] Updated weights for policy 0, policy_version 124780 (0.0007) [2023-12-27 20:07:34,169][106226] Updated weights for policy 0, policy_version 124790 (0.0009) [2023-12-27 20:07:34,229][106226] Updated weights for policy 0, policy_version 124800 (0.0010) [2023-12-27 20:07:34,494][106225] Updated weights for policy 1, policy_version 124746 (0.0009) [2023-12-27 20:07:34,552][106225] Updated weights for policy 1, policy_version 124756 (0.0009) [2023-12-27 20:07:34,622][106225] Updated weights for policy 1, policy_version 124766 (0.0009) [2023-12-27 20:07:34,871][106226] Updated weights for policy 0, policy_version 124810 (0.0011) [2023-12-27 20:07:34,933][106226] Updated weights for policy 0, policy_version 124820 (0.0010) [2023-12-27 20:07:34,993][106226] Updated weights for policy 0, policy_version 124830 (0.0010) [2023-12-27 20:07:35,061][106226] Updated weights for policy 0, policy_version 124840 (0.0011) [2023-12-27 20:07:35,363][106225] Updated weights for policy 1, policy_version 124776 (0.0005) [2023-12-27 20:07:35,413][106225] Updated weights for policy 1, policy_version 124786 (0.0005) [2023-12-27 20:07:35,471][106225] Updated weights for policy 1, policy_version 124796 (0.0005) [2023-12-27 20:07:35,751][106226] Updated weights for policy 0, policy_version 124850 (0.0008) [2023-12-27 20:07:35,801][106226] Updated weights for policy 0, policy_version 124860 (0.0009) [2023-12-27 20:07:35,857][106226] Updated weights for policy 0, policy_version 124870 (0.0009) [2023-12-27 20:07:36,014][106225] Updated weights for policy 1, policy_version 124806 (0.0008) [2023-12-27 20:07:36,063][106225] Updated weights for policy 1, policy_version 124816 (0.0007) [2023-12-27 20:07:36,124][106225] Updated weights for policy 1, policy_version 124826 (0.0007) [2023-12-27 20:07:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 63938560. Throughput: 0: 9739.3, 1: 9967.6. Samples: 63942172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:36,175][105115] Avg episode reward: [(0, '-5.348'), (1, '-7.028')] [2023-12-27 20:07:36,632][106226] Updated weights for policy 0, policy_version 124880 (0.0008) [2023-12-27 20:07:36,700][106226] Updated weights for policy 0, policy_version 124890 (0.0009) [2023-12-27 20:07:36,747][106225] Updated weights for policy 1, policy_version 124836 (0.0007) [2023-12-27 20:07:36,769][106226] Updated weights for policy 0, policy_version 124900 (0.0008) [2023-12-27 20:07:36,795][106225] Updated weights for policy 1, policy_version 124846 (0.0009) [2023-12-27 20:07:36,854][106225] Updated weights for policy 1, policy_version 124856 (0.0008) [2023-12-27 20:07:37,472][106226] Updated weights for policy 0, policy_version 124910 (0.0009) [2023-12-27 20:07:37,528][106226] Updated weights for policy 0, policy_version 124920 (0.0008) [2023-12-27 20:07:37,589][106226] Updated weights for policy 0, policy_version 124930 (0.0009) [2023-12-27 20:07:37,595][106225] Updated weights for policy 1, policy_version 124866 (0.0008) [2023-12-27 20:07:37,660][106225] Updated weights for policy 1, policy_version 124876 (0.0007) [2023-12-27 20:07:37,726][106225] Updated weights for policy 1, policy_version 124886 (0.0009) [2023-12-27 20:07:37,785][106225] Updated weights for policy 1, policy_version 124896 (0.0009) [2023-12-27 20:07:38,359][106226] Updated weights for policy 0, policy_version 124940 (0.0009) [2023-12-27 20:07:38,421][106226] Updated weights for policy 0, policy_version 124950 (0.0008) [2023-12-27 20:07:38,454][106225] Updated weights for policy 1, policy_version 124906 (0.0007) [2023-12-27 20:07:38,481][106226] Updated weights for policy 0, policy_version 124960 (0.0006) [2023-12-27 20:07:38,518][106225] Updated weights for policy 1, policy_version 124916 (0.0008) [2023-12-27 20:07:38,575][106225] Updated weights for policy 1, policy_version 124926 (0.0007) [2023-12-27 20:07:39,131][106226] Updated weights for policy 0, policy_version 124970 (0.0010) [2023-12-27 20:07:39,176][106226] Updated weights for policy 0, policy_version 124980 (0.0008) [2023-12-27 20:07:39,234][106226] Updated weights for policy 0, policy_version 124990 (0.0009) [2023-12-27 20:07:39,290][106226] Updated weights for policy 0, policy_version 125000 (0.0008) [2023-12-27 20:07:39,330][106225] Updated weights for policy 1, policy_version 124936 (0.0009) [2023-12-27 20:07:39,397][106225] Updated weights for policy 1, policy_version 124946 (0.0008) [2023-12-27 20:07:39,469][106225] Updated weights for policy 1, policy_version 124956 (0.0008) [2023-12-27 20:07:40,076][106226] Updated weights for policy 0, policy_version 125010 (0.0009) [2023-12-27 20:07:40,131][106226] Updated weights for policy 0, policy_version 125020 (0.0008) [2023-12-27 20:07:40,184][106226] Updated weights for policy 0, policy_version 125030 (0.0009) [2023-12-27 20:07:40,257][106225] Updated weights for policy 1, policy_version 124966 (0.0008) [2023-12-27 20:07:40,307][106225] Updated weights for policy 1, policy_version 124976 (0.0009) [2023-12-27 20:07:40,360][106225] Updated weights for policy 1, policy_version 124986 (0.0008) [2023-12-27 20:07:40,972][106226] Updated weights for policy 0, policy_version 125040 (0.0007) [2023-12-27 20:07:41,038][106226] Updated weights for policy 0, policy_version 125050 (0.0008) [2023-12-27 20:07:41,103][106226] Updated weights for policy 0, policy_version 125060 (0.0009) [2023-12-27 20:07:41,130][106225] Updated weights for policy 1, policy_version 124996 (0.0008) [2023-12-27 20:07:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 64028672. Throughput: 0: 9748.8, 1: 10002.0. Samples: 64001236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:41,175][105115] Avg episode reward: [(0, '-5.189'), (1, '-6.945')] [2023-12-27 20:07:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000125064_32022528.pth... [2023-12-27 20:07:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000123912_31727616.pth [2023-12-27 20:07:41,199][106225] Updated weights for policy 1, policy_version 125006 (0.0008) [2023-12-27 20:07:41,259][106225] Updated weights for policy 1, policy_version 125016 (0.0008) [2023-12-27 20:07:41,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000125024_32014336.pth... [2023-12-27 20:07:41,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000123872_31719424.pth [2023-12-27 20:07:41,933][106225] Updated weights for policy 1, policy_version 125026 (0.0009) [2023-12-27 20:07:41,936][106226] Updated weights for policy 0, policy_version 125070 (0.0008) [2023-12-27 20:07:41,989][106225] Updated weights for policy 1, policy_version 125036 (0.0008) [2023-12-27 20:07:41,991][106226] Updated weights for policy 0, policy_version 125080 (0.0007) [2023-12-27 20:07:42,048][106225] Updated weights for policy 1, policy_version 125046 (0.0008) [2023-12-27 20:07:42,049][106226] Updated weights for policy 0, policy_version 125090 (0.0008) [2023-12-27 20:07:42,103][106225] Updated weights for policy 1, policy_version 125056 (0.0008) [2023-12-27 20:07:42,854][106226] Updated weights for policy 0, policy_version 125100 (0.0007) [2023-12-27 20:07:42,881][106225] Updated weights for policy 1, policy_version 125066 (0.0008) [2023-12-27 20:07:42,919][106226] Updated weights for policy 0, policy_version 125110 (0.0007) [2023-12-27 20:07:42,942][106225] Updated weights for policy 1, policy_version 125076 (0.0007) [2023-12-27 20:07:42,980][106226] Updated weights for policy 0, policy_version 125120 (0.0006) [2023-12-27 20:07:43,005][106225] Updated weights for policy 1, policy_version 125086 (0.0007) [2023-12-27 20:07:43,654][106225] Updated weights for policy 1, policy_version 125096 (0.0007) [2023-12-27 20:07:43,660][106226] Updated weights for policy 0, policy_version 125130 (0.0007) [2023-12-27 20:07:43,722][106225] Updated weights for policy 1, policy_version 125106 (0.0005) [2023-12-27 20:07:43,724][106226] Updated weights for policy 0, policy_version 125140 (0.0005) [2023-12-27 20:07:43,783][106226] Updated weights for policy 0, policy_version 125150 (0.0005) [2023-12-27 20:07:43,783][106225] Updated weights for policy 1, policy_version 125116 (0.0006) [2023-12-27 20:07:43,837][106226] Updated weights for policy 0, policy_version 125160 (0.0005) [2023-12-27 20:07:44,407][106226] Updated weights for policy 0, policy_version 125170 (0.0010) [2023-12-27 20:07:44,470][106226] Updated weights for policy 0, policy_version 125180 (0.0010) [2023-12-27 20:07:44,496][106225] Updated weights for policy 1, policy_version 125126 (0.0009) [2023-12-27 20:07:44,527][106226] Updated weights for policy 0, policy_version 125190 (0.0010) [2023-12-27 20:07:44,554][106225] Updated weights for policy 1, policy_version 125136 (0.0005) [2023-12-27 20:07:44,618][106225] Updated weights for policy 1, policy_version 125146 (0.0007) [2023-12-27 20:07:45,229][106225] Updated weights for policy 1, policy_version 125156 (0.0007) [2023-12-27 20:07:45,255][106226] Updated weights for policy 0, policy_version 125200 (0.0011) [2023-12-27 20:07:45,294][106225] Updated weights for policy 1, policy_version 125166 (0.0006) [2023-12-27 20:07:45,323][106226] Updated weights for policy 0, policy_version 125210 (0.0011) [2023-12-27 20:07:45,352][106225] Updated weights for policy 1, policy_version 125176 (0.0006) [2023-12-27 20:07:45,385][106226] Updated weights for policy 0, policy_version 125220 (0.0011) [2023-12-27 20:07:45,891][106225] Updated weights for policy 1, policy_version 125186 (0.0006) [2023-12-27 20:07:45,942][106225] Updated weights for policy 1, policy_version 125196 (0.0005) [2023-12-27 20:07:46,000][106225] Updated weights for policy 1, policy_version 125206 (0.0006) [2023-12-27 20:07:46,061][106225] Updated weights for policy 1, policy_version 125216 (0.0009) [2023-12-27 20:07:46,079][106226] Updated weights for policy 0, policy_version 125230 (0.0008) [2023-12-27 20:07:46,139][106226] Updated weights for policy 0, policy_version 125240 (0.0006) [2023-12-27 20:07:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 64126976. Throughput: 0: 9718.1, 1: 9867.5. Samples: 64115600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:46,175][105115] Avg episode reward: [(0, '-5.511'), (1, '-6.877')] [2023-12-27 20:07:46,192][106226] Updated weights for policy 0, policy_version 125250 (0.0005) [2023-12-27 20:07:46,722][106225] Updated weights for policy 1, policy_version 125226 (0.0010) [2023-12-27 20:07:46,756][106226] Updated weights for policy 0, policy_version 125260 (0.0007) [2023-12-27 20:07:46,777][106225] Updated weights for policy 1, policy_version 125236 (0.0010) [2023-12-27 20:07:46,818][106226] Updated weights for policy 0, policy_version 125270 (0.0008) [2023-12-27 20:07:46,831][106225] Updated weights for policy 1, policy_version 125246 (0.0010) [2023-12-27 20:07:46,883][106226] Updated weights for policy 0, policy_version 125280 (0.0006) [2023-12-27 20:07:47,472][106225] Updated weights for policy 1, policy_version 125256 (0.0006) [2023-12-27 20:07:47,532][106225] Updated weights for policy 1, policy_version 125266 (0.0007) [2023-12-27 20:07:47,544][106226] Updated weights for policy 0, policy_version 125290 (0.0007) [2023-12-27 20:07:47,592][106225] Updated weights for policy 1, policy_version 125276 (0.0007) [2023-12-27 20:07:47,605][106226] Updated weights for policy 0, policy_version 125300 (0.0010) [2023-12-27 20:07:47,659][106226] Updated weights for policy 0, policy_version 125310 (0.0007) [2023-12-27 20:07:47,721][106226] Updated weights for policy 0, policy_version 125320 (0.0006) [2023-12-27 20:07:48,305][106226] Updated weights for policy 0, policy_version 125330 (0.0010) [2023-12-27 20:07:48,319][106225] Updated weights for policy 1, policy_version 125286 (0.0005) [2023-12-27 20:07:48,371][106226] Updated weights for policy 0, policy_version 125340 (0.0011) [2023-12-27 20:07:48,385][106225] Updated weights for policy 1, policy_version 125296 (0.0006) [2023-12-27 20:07:48,436][106226] Updated weights for policy 0, policy_version 125350 (0.0010) [2023-12-27 20:07:48,447][106225] Updated weights for policy 1, policy_version 125306 (0.0008) [2023-12-27 20:07:49,145][106226] Updated weights for policy 0, policy_version 125360 (0.0007) [2023-12-27 20:07:49,155][106225] Updated weights for policy 1, policy_version 125316 (0.0010) [2023-12-27 20:07:49,207][106226] Updated weights for policy 0, policy_version 125370 (0.0006) [2023-12-27 20:07:49,211][106225] Updated weights for policy 1, policy_version 125326 (0.0010) [2023-12-27 20:07:49,276][106225] Updated weights for policy 1, policy_version 125336 (0.0011) [2023-12-27 20:07:49,280][106226] Updated weights for policy 0, policy_version 125380 (0.0008) [2023-12-27 20:07:49,889][106226] Updated weights for policy 0, policy_version 125390 (0.0009) [2023-12-27 20:07:49,952][106226] Updated weights for policy 0, policy_version 125400 (0.0006) [2023-12-27 20:07:50,015][106226] Updated weights for policy 0, policy_version 125410 (0.0006) [2023-12-27 20:07:50,055][106225] Updated weights for policy 1, policy_version 125346 (0.0010) [2023-12-27 20:07:50,110][106225] Updated weights for policy 1, policy_version 125356 (0.0008) [2023-12-27 20:07:50,175][106225] Updated weights for policy 1, policy_version 125366 (0.0010) [2023-12-27 20:07:50,240][106225] Updated weights for policy 1, policy_version 125376 (0.0009) [2023-12-27 20:07:50,632][106226] Updated weights for policy 0, policy_version 125420 (0.0009) [2023-12-27 20:07:50,697][106226] Updated weights for policy 0, policy_version 125430 (0.0011) [2023-12-27 20:07:50,762][106226] Updated weights for policy 0, policy_version 125440 (0.0011) [2023-12-27 20:07:50,879][106225] Updated weights for policy 1, policy_version 125386 (0.0008) [2023-12-27 20:07:50,940][106225] Updated weights for policy 1, policy_version 125396 (0.0006) [2023-12-27 20:07:51,002][106225] Updated weights for policy 1, policy_version 125406 (0.0006) [2023-12-27 20:07:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 64233472. Throughput: 0: 9721.3, 1: 9957.3. Samples: 64239932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:51,175][105115] Avg episode reward: [(0, '-5.394'), (1, '-6.744')] [2023-12-27 20:07:51,496][106226] Updated weights for policy 0, policy_version 125450 (0.0010) [2023-12-27 20:07:51,546][106226] Updated weights for policy 0, policy_version 125460 (0.0009) [2023-12-27 20:07:51,598][106226] Updated weights for policy 0, policy_version 125470 (0.0008) [2023-12-27 20:07:51,670][106226] Updated weights for policy 0, policy_version 125480 (0.0008) [2023-12-27 20:07:51,757][106225] Updated weights for policy 1, policy_version 125416 (0.0008) [2023-12-27 20:07:51,815][106225] Updated weights for policy 1, policy_version 125426 (0.0008) [2023-12-27 20:07:51,873][106225] Updated weights for policy 1, policy_version 125436 (0.0007) [2023-12-27 20:07:52,496][106226] Updated weights for policy 0, policy_version 125490 (0.0008) [2023-12-27 20:07:52,562][106226] Updated weights for policy 0, policy_version 125500 (0.0009) [2023-12-27 20:07:52,621][106225] Updated weights for policy 1, policy_version 125446 (0.0007) [2023-12-27 20:07:52,624][106226] Updated weights for policy 0, policy_version 125510 (0.0008) [2023-12-27 20:07:52,683][106225] Updated weights for policy 1, policy_version 125456 (0.0008) [2023-12-27 20:07:52,743][106225] Updated weights for policy 1, policy_version 125466 (0.0008) [2023-12-27 20:07:53,320][106226] Updated weights for policy 0, policy_version 125520 (0.0008) [2023-12-27 20:07:53,378][106226] Updated weights for policy 0, policy_version 125530 (0.0008) [2023-12-27 20:07:53,442][106226] Updated weights for policy 0, policy_version 125540 (0.0006) [2023-12-27 20:07:53,479][106225] Updated weights for policy 1, policy_version 125476 (0.0008) [2023-12-27 20:07:53,536][106225] Updated weights for policy 1, policy_version 125486 (0.0008) [2023-12-27 20:07:53,594][106225] Updated weights for policy 1, policy_version 125496 (0.0008) [2023-12-27 20:07:54,059][106226] Updated weights for policy 0, policy_version 125550 (0.0005) [2023-12-27 20:07:54,120][106226] Updated weights for policy 0, policy_version 125560 (0.0005) [2023-12-27 20:07:54,168][106226] Updated weights for policy 0, policy_version 125570 (0.0005) [2023-12-27 20:07:54,398][106225] Updated weights for policy 1, policy_version 125506 (0.0009) [2023-12-27 20:07:54,464][106225] Updated weights for policy 1, policy_version 125516 (0.0009) [2023-12-27 20:07:54,524][106225] Updated weights for policy 1, policy_version 125526 (0.0008) [2023-12-27 20:07:54,573][106225] Updated weights for policy 1, policy_version 125536 (0.0005) [2023-12-27 20:07:54,788][106226] Updated weights for policy 0, policy_version 125580 (0.0007) [2023-12-27 20:07:54,837][106226] Updated weights for policy 0, policy_version 125590 (0.0009) [2023-12-27 20:07:54,896][106226] Updated weights for policy 0, policy_version 125600 (0.0008) [2023-12-27 20:07:55,205][106225] Updated weights for policy 1, policy_version 125546 (0.0009) [2023-12-27 20:07:55,260][106225] Updated weights for policy 1, policy_version 125556 (0.0008) [2023-12-27 20:07:55,323][106225] Updated weights for policy 1, policy_version 125566 (0.0008) [2023-12-27 20:07:55,637][106226] Updated weights for policy 0, policy_version 125610 (0.0009) [2023-12-27 20:07:55,699][106226] Updated weights for policy 0, policy_version 125620 (0.0009) [2023-12-27 20:07:55,761][106226] Updated weights for policy 0, policy_version 125630 (0.0008) [2023-12-27 20:07:55,825][106226] Updated weights for policy 0, policy_version 125640 (0.0008) [2023-12-27 20:07:55,989][106225] Updated weights for policy 1, policy_version 125576 (0.0008) [2023-12-27 20:07:56,047][106225] Updated weights for policy 1, policy_version 125586 (0.0009) [2023-12-27 20:07:56,106][106225] Updated weights for policy 1, policy_version 125596 (0.0009) [2023-12-27 20:07:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 64331776. Throughput: 0: 9717.6, 1: 9864.9. Samples: 64297272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:07:56,175][105115] Avg episode reward: [(0, '-5.437'), (1, '-6.753')] [2023-12-27 20:07:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000125600_32161792.pth... [2023-12-27 20:07:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000125640_32169984.pth... [2023-12-27 20:07:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000124488_31875072.pth [2023-12-27 20:07:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000124448_31866880.pth [2023-12-27 20:07:56,546][106226] Updated weights for policy 0, policy_version 125650 (0.0008) [2023-12-27 20:07:56,607][106226] Updated weights for policy 0, policy_version 125660 (0.0008) [2023-12-27 20:07:56,654][106226] Updated weights for policy 0, policy_version 125670 (0.0008) [2023-12-27 20:07:56,762][106225] Updated weights for policy 1, policy_version 125606 (0.0008) [2023-12-27 20:07:56,812][106225] Updated weights for policy 1, policy_version 125616 (0.0007) [2023-12-27 20:07:56,873][106225] Updated weights for policy 1, policy_version 125626 (0.0005) [2023-12-27 20:07:57,348][106226] Updated weights for policy 0, policy_version 125680 (0.0008) [2023-12-27 20:07:57,400][106226] Updated weights for policy 0, policy_version 125690 (0.0010) [2023-12-27 20:07:57,453][106225] Updated weights for policy 1, policy_version 125636 (0.0006) [2023-12-27 20:07:57,458][106226] Updated weights for policy 0, policy_version 125700 (0.0007) [2023-12-27 20:07:57,511][106225] Updated weights for policy 1, policy_version 125646 (0.0009) [2023-12-27 20:07:57,569][106225] Updated weights for policy 1, policy_version 125656 (0.0007) [2023-12-27 20:07:58,151][106225] Updated weights for policy 1, policy_version 125666 (0.0006) [2023-12-27 20:07:58,205][106226] Updated weights for policy 0, policy_version 125710 (0.0007) [2023-12-27 20:07:58,208][106225] Updated weights for policy 1, policy_version 125676 (0.0009) [2023-12-27 20:07:58,269][106225] Updated weights for policy 1, policy_version 125686 (0.0010) [2023-12-27 20:07:58,271][106226] Updated weights for policy 0, policy_version 125720 (0.0005) [2023-12-27 20:07:58,330][106225] Updated weights for policy 1, policy_version 125696 (0.0010) [2023-12-27 20:07:58,331][106226] Updated weights for policy 0, policy_version 125730 (0.0007) [2023-12-27 20:07:59,066][106226] Updated weights for policy 0, policy_version 125740 (0.0009) [2023-12-27 20:07:59,129][106226] Updated weights for policy 0, policy_version 125750 (0.0008) [2023-12-27 20:07:59,139][106225] Updated weights for policy 1, policy_version 125706 (0.0006) [2023-12-27 20:07:59,189][106226] Updated weights for policy 0, policy_version 125760 (0.0008) [2023-12-27 20:07:59,194][106225] Updated weights for policy 1, policy_version 125716 (0.0006) [2023-12-27 20:07:59,263][106225] Updated weights for policy 1, policy_version 125726 (0.0012) [2023-12-27 20:07:59,915][106226] Updated weights for policy 0, policy_version 125770 (0.0008) [2023-12-27 20:07:59,976][106226] Updated weights for policy 0, policy_version 125780 (0.0008) [2023-12-27 20:08:00,033][106226] Updated weights for policy 0, policy_version 125790 (0.0008) [2023-12-27 20:08:00,086][106225] Updated weights for policy 1, policy_version 125736 (0.0006) [2023-12-27 20:08:00,088][106226] Updated weights for policy 0, policy_version 125800 (0.0008) [2023-12-27 20:08:00,150][106225] Updated weights for policy 1, policy_version 125746 (0.0008) [2023-12-27 20:08:00,211][106225] Updated weights for policy 1, policy_version 125756 (0.0008) [2023-12-27 20:08:00,756][106226] Updated weights for policy 0, policy_version 125810 (0.0005) [2023-12-27 20:08:00,805][106225] Updated weights for policy 1, policy_version 125766 (0.0007) [2023-12-27 20:08:00,811][106226] Updated weights for policy 0, policy_version 125820 (0.0005) [2023-12-27 20:08:00,858][106225] Updated weights for policy 1, policy_version 125776 (0.0009) [2023-12-27 20:08:00,897][106226] Updated weights for policy 0, policy_version 125830 (0.0005) [2023-12-27 20:08:00,906][106225] Updated weights for policy 1, policy_version 125786 (0.0010) [2023-12-27 20:08:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 64430080. Throughput: 0: 9785.4, 1: 9855.1. Samples: 64415104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:08:01,175][105115] Avg episode reward: [(0, '-5.382'), (1, '-6.750')] [2023-12-27 20:08:01,463][106226] Updated weights for policy 0, policy_version 125840 (0.0008) [2023-12-27 20:08:01,526][106226] Updated weights for policy 0, policy_version 125850 (0.0010) [2023-12-27 20:08:01,566][106225] Updated weights for policy 1, policy_version 125796 (0.0007) [2023-12-27 20:08:01,576][106226] Updated weights for policy 0, policy_version 125860 (0.0007) [2023-12-27 20:08:01,629][106225] Updated weights for policy 1, policy_version 125806 (0.0007) [2023-12-27 20:08:01,680][106225] Updated weights for policy 1, policy_version 125816 (0.0006) [2023-12-27 20:08:02,354][106226] Updated weights for policy 0, policy_version 125870 (0.0007) [2023-12-27 20:08:02,366][106225] Updated weights for policy 1, policy_version 125826 (0.0009) [2023-12-27 20:08:02,419][106226] Updated weights for policy 0, policy_version 125880 (0.0006) [2023-12-27 20:08:02,432][106225] Updated weights for policy 1, policy_version 125836 (0.0007) [2023-12-27 20:08:02,473][106226] Updated weights for policy 0, policy_version 125890 (0.0005) [2023-12-27 20:08:02,493][106225] Updated weights for policy 1, policy_version 125846 (0.0009) [2023-12-27 20:08:02,563][106225] Updated weights for policy 1, policy_version 125856 (0.0010) [2023-12-27 20:08:03,100][106226] Updated weights for policy 0, policy_version 125900 (0.0008) [2023-12-27 20:08:03,151][106226] Updated weights for policy 0, policy_version 125910 (0.0008) [2023-12-27 20:08:03,207][106226] Updated weights for policy 0, policy_version 125920 (0.0008) [2023-12-27 20:08:03,280][106225] Updated weights for policy 1, policy_version 125866 (0.0008) [2023-12-27 20:08:03,338][106225] Updated weights for policy 1, policy_version 125876 (0.0008) [2023-12-27 20:08:03,393][106225] Updated weights for policy 1, policy_version 125886 (0.0008) [2023-12-27 20:08:03,931][106226] Updated weights for policy 0, policy_version 125930 (0.0008) [2023-12-27 20:08:03,980][106226] Updated weights for policy 0, policy_version 125940 (0.0008) [2023-12-27 20:08:04,032][106226] Updated weights for policy 0, policy_version 125950 (0.0008) [2023-12-27 20:08:04,091][106226] Updated weights for policy 0, policy_version 125960 (0.0008) [2023-12-27 20:08:04,158][106225] Updated weights for policy 1, policy_version 125896 (0.0010) [2023-12-27 20:08:04,220][106225] Updated weights for policy 1, policy_version 125906 (0.0008) [2023-12-27 20:08:04,287][106225] Updated weights for policy 1, policy_version 125916 (0.0007) [2023-12-27 20:08:04,902][106226] Updated weights for policy 0, policy_version 125970 (0.0010) [2023-12-27 20:08:04,906][106225] Updated weights for policy 1, policy_version 125926 (0.0006) [2023-12-27 20:08:04,966][106226] Updated weights for policy 0, policy_version 125980 (0.0010) [2023-12-27 20:08:04,970][106225] Updated weights for policy 1, policy_version 125936 (0.0009) [2023-12-27 20:08:05,025][106225] Updated weights for policy 1, policy_version 125946 (0.0010) [2023-12-27 20:08:05,027][106226] Updated weights for policy 0, policy_version 125990 (0.0011) [2023-12-27 20:08:05,683][106226] Updated weights for policy 0, policy_version 126000 (0.0010) [2023-12-27 20:08:05,741][106225] Updated weights for policy 1, policy_version 125956 (0.0010) [2023-12-27 20:08:05,742][106226] Updated weights for policy 0, policy_version 126010 (0.0010) [2023-12-27 20:08:05,796][106225] Updated weights for policy 1, policy_version 125966 (0.0010) [2023-12-27 20:08:05,798][106226] Updated weights for policy 0, policy_version 126020 (0.0010) [2023-12-27 20:08:05,852][106225] Updated weights for policy 1, policy_version 125976 (0.0010) [2023-12-27 20:08:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 64528384. Throughput: 0: 9835.0, 1: 9870.5. Samples: 64536116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:08:06,175][105115] Avg episode reward: [(0, '-5.372'), (1, '-6.600')] [2023-12-27 20:08:06,481][106226] Updated weights for policy 0, policy_version 126030 (0.0010) [2023-12-27 20:08:06,488][106225] Updated weights for policy 1, policy_version 125986 (0.0007) [2023-12-27 20:08:06,542][106226] Updated weights for policy 0, policy_version 126040 (0.0011) [2023-12-27 20:08:06,548][106225] Updated weights for policy 1, policy_version 125996 (0.0009) [2023-12-27 20:08:06,600][106226] Updated weights for policy 0, policy_version 126050 (0.0011) [2023-12-27 20:08:06,606][106225] Updated weights for policy 1, policy_version 126006 (0.0005) [2023-12-27 20:08:06,664][106225] Updated weights for policy 1, policy_version 126016 (0.0008) [2023-12-27 20:08:07,253][106226] Updated weights for policy 0, policy_version 126060 (0.0011) [2023-12-27 20:08:07,311][106226] Updated weights for policy 0, policy_version 126070 (0.0010) [2023-12-27 20:08:07,369][106226] Updated weights for policy 0, policy_version 126080 (0.0011) [2023-12-27 20:08:07,371][106225] Updated weights for policy 1, policy_version 126026 (0.0006) [2023-12-27 20:08:07,418][106225] Updated weights for policy 1, policy_version 126036 (0.0006) [2023-12-27 20:08:07,476][106225] Updated weights for policy 1, policy_version 126046 (0.0008) [2023-12-27 20:08:08,084][106226] Updated weights for policy 0, policy_version 126090 (0.0010) [2023-12-27 20:08:08,145][106226] Updated weights for policy 0, policy_version 126100 (0.0008) [2023-12-27 20:08:08,190][106226] Updated weights for policy 0, policy_version 126110 (0.0007) [2023-12-27 20:08:08,248][106225] Updated weights for policy 1, policy_version 126056 (0.0010) [2023-12-27 20:08:08,249][106226] Updated weights for policy 0, policy_version 126120 (0.0006) [2023-12-27 20:08:08,305][106225] Updated weights for policy 1, policy_version 126066 (0.0010) [2023-12-27 20:08:08,371][106225] Updated weights for policy 1, policy_version 126076 (0.0009) [2023-12-27 20:08:09,004][106226] Updated weights for policy 0, policy_version 126130 (0.0007) [2023-12-27 20:08:09,062][106226] Updated weights for policy 0, policy_version 126140 (0.0008) [2023-12-27 20:08:09,116][106225] Updated weights for policy 1, policy_version 126086 (0.0010) [2023-12-27 20:08:09,120][106226] Updated weights for policy 0, policy_version 126150 (0.0007) [2023-12-27 20:08:09,162][106225] Updated weights for policy 1, policy_version 126096 (0.0010) [2023-12-27 20:08:09,219][106225] Updated weights for policy 1, policy_version 126106 (0.0010) [2023-12-27 20:08:09,823][106226] Updated weights for policy 0, policy_version 126160 (0.0007) [2023-12-27 20:08:09,898][106226] Updated weights for policy 0, policy_version 126170 (0.0008) [2023-12-27 20:08:09,963][106226] Updated weights for policy 0, policy_version 126180 (0.0008) [2023-12-27 20:08:09,992][106225] Updated weights for policy 1, policy_version 126116 (0.0007) [2023-12-27 20:08:10,046][106225] Updated weights for policy 1, policy_version 126126 (0.0009) [2023-12-27 20:08:10,098][106225] Updated weights for policy 1, policy_version 126136 (0.0009) [2023-12-27 20:08:10,626][106226] Updated weights for policy 0, policy_version 126190 (0.0008) [2023-12-27 20:08:10,690][106226] Updated weights for policy 0, policy_version 126200 (0.0008) [2023-12-27 20:08:10,751][106226] Updated weights for policy 0, policy_version 126210 (0.0007) [2023-12-27 20:08:10,839][106225] Updated weights for policy 1, policy_version 126146 (0.0009) [2023-12-27 20:08:10,897][106225] Updated weights for policy 1, policy_version 126156 (0.0010) [2023-12-27 20:08:10,948][106225] Updated weights for policy 1, policy_version 126166 (0.0010) [2023-12-27 20:08:11,002][106225] Updated weights for policy 1, policy_version 126176 (0.0010) [2023-12-27 20:08:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 64626688. Throughput: 0: 9850.9, 1: 9908.4. Samples: 64594872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:08:11,175][105115] Avg episode reward: [(0, '-5.646'), (1, '-6.738')] [2023-12-27 20:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000126176_32309248.pth... [2023-12-27 20:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000126216_32317440.pth... [2023-12-27 20:08:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000125064_32022528.pth [2023-12-27 20:08:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000125024_32014336.pth [2023-12-27 20:08:11,487][106226] Updated weights for policy 0, policy_version 126220 (0.0008) [2023-12-27 20:08:11,549][106226] Updated weights for policy 0, policy_version 126230 (0.0008) [2023-12-27 20:08:11,606][106226] Updated weights for policy 0, policy_version 126240 (0.0008) [2023-12-27 20:08:11,780][106225] Updated weights for policy 1, policy_version 126186 (0.0007) [2023-12-27 20:08:11,837][106225] Updated weights for policy 1, policy_version 126196 (0.0006) [2023-12-27 20:08:11,891][106225] Updated weights for policy 1, policy_version 126206 (0.0009) [2023-12-27 20:08:12,401][106226] Updated weights for policy 0, policy_version 126250 (0.0007) [2023-12-27 20:08:12,457][106226] Updated weights for policy 0, policy_version 126260 (0.0007) [2023-12-27 20:08:12,506][106226] Updated weights for policy 0, policy_version 126270 (0.0008) [2023-12-27 20:08:12,563][106226] Updated weights for policy 0, policy_version 126280 (0.0009) [2023-12-27 20:08:12,647][106225] Updated weights for policy 1, policy_version 126216 (0.0008) [2023-12-27 20:08:12,716][106225] Updated weights for policy 1, policy_version 126226 (0.0008) [2023-12-27 20:08:12,774][106225] Updated weights for policy 1, policy_version 126236 (0.0008) [2023-12-27 20:08:13,351][106226] Updated weights for policy 0, policy_version 126290 (0.0008) [2023-12-27 20:08:13,398][106225] Updated weights for policy 1, policy_version 126246 (0.0007) [2023-12-27 20:08:13,408][106226] Updated weights for policy 0, policy_version 126300 (0.0007) [2023-12-27 20:08:13,446][106225] Updated weights for policy 1, policy_version 126256 (0.0006) [2023-12-27 20:08:13,462][106226] Updated weights for policy 0, policy_version 126310 (0.0008) [2023-12-27 20:08:13,499][106225] Updated weights for policy 1, policy_version 126266 (0.0008) [2023-12-27 20:08:14,153][106225] Updated weights for policy 1, policy_version 126276 (0.0007) [2023-12-27 20:08:14,215][106225] Updated weights for policy 1, policy_version 126286 (0.0006) [2023-12-27 20:08:14,230][106226] Updated weights for policy 0, policy_version 126320 (0.0006) [2023-12-27 20:08:14,268][106225] Updated weights for policy 1, policy_version 126296 (0.0008) [2023-12-27 20:08:14,283][106226] Updated weights for policy 0, policy_version 126330 (0.0005) [2023-12-27 20:08:14,332][106226] Updated weights for policy 0, policy_version 126340 (0.0006) [2023-12-27 20:08:14,983][106225] Updated weights for policy 1, policy_version 126306 (0.0007) [2023-12-27 20:08:15,045][106225] Updated weights for policy 1, policy_version 126316 (0.0008) [2023-12-27 20:08:15,052][106226] Updated weights for policy 0, policy_version 126350 (0.0008) [2023-12-27 20:08:15,098][106225] Updated weights for policy 1, policy_version 126326 (0.0007) [2023-12-27 20:08:15,104][106226] Updated weights for policy 0, policy_version 126360 (0.0006) [2023-12-27 20:08:15,158][106225] Updated weights for policy 1, policy_version 126336 (0.0006) [2023-12-27 20:08:15,160][106226] Updated weights for policy 0, policy_version 126370 (0.0007) [2023-12-27 20:08:15,898][106225] Updated weights for policy 1, policy_version 126346 (0.0008) [2023-12-27 20:08:15,905][106226] Updated weights for policy 0, policy_version 126380 (0.0007) [2023-12-27 20:08:15,947][106225] Updated weights for policy 1, policy_version 126356 (0.0006) [2023-12-27 20:08:15,955][106226] Updated weights for policy 0, policy_version 126390 (0.0005) [2023-12-27 20:08:15,992][106225] Updated weights for policy 1, policy_version 126366 (0.0007) [2023-12-27 20:08:16,016][106226] Updated weights for policy 0, policy_version 126400 (0.0007) [2023-12-27 20:08:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 64724992. Throughput: 0: 9822.9, 1: 9857.9. Samples: 64710380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 20:08:16,175][105115] Avg episode reward: [(0, '-5.615'), (1, '-6.817')] [2023-12-27 20:08:16,718][106226] Updated weights for policy 0, policy_version 126410 (0.0009) [2023-12-27 20:08:16,741][106225] Updated weights for policy 1, policy_version 126376 (0.0008) [2023-12-27 20:08:16,775][106226] Updated weights for policy 0, policy_version 126420 (0.0007) [2023-12-27 20:08:16,801][106225] Updated weights for policy 1, policy_version 126386 (0.0008) [2023-12-27 20:08:16,833][106226] Updated weights for policy 0, policy_version 126430 (0.0009) [2023-12-27 20:08:16,863][106225] Updated weights for policy 1, policy_version 126396 (0.0006) [2023-12-27 20:08:16,896][106226] Updated weights for policy 0, policy_version 126440 (0.0007) [2023-12-27 20:08:17,570][106225] Updated weights for policy 1, policy_version 126406 (0.0007) [2023-12-27 20:08:17,624][106226] Updated weights for policy 0, policy_version 126450 (0.0006) [2023-12-27 20:08:17,630][106225] Updated weights for policy 1, policy_version 126416 (0.0006) [2023-12-27 20:08:17,672][106226] Updated weights for policy 0, policy_version 126460 (0.0006) [2023-12-27 20:08:17,690][106225] Updated weights for policy 1, policy_version 126426 (0.0007) [2023-12-27 20:08:17,729][106226] Updated weights for policy 0, policy_version 126470 (0.0007) [2023-12-27 20:08:18,437][106225] Updated weights for policy 1, policy_version 126436 (0.0008) [2023-12-27 20:08:18,457][106226] Updated weights for policy 0, policy_version 126480 (0.0008) [2023-12-27 20:08:18,494][106225] Updated weights for policy 1, policy_version 126446 (0.0006) [2023-12-27 20:08:18,519][106226] Updated weights for policy 0, policy_version 126490 (0.0008) [2023-12-27 20:08:18,552][106225] Updated weights for policy 1, policy_version 126456 (0.0005) [2023-12-27 20:08:18,581][106226] Updated weights for policy 0, policy_version 126500 (0.0008) [2023-12-27 20:08:19,277][106225] Updated weights for policy 1, policy_version 126466 (0.0008) [2023-12-27 20:08:19,307][106226] Updated weights for policy 0, policy_version 126510 (0.0007) [2023-12-27 20:08:19,340][106225] Updated weights for policy 1, policy_version 126476 (0.0008) [2023-12-27 20:08:19,372][106226] Updated weights for policy 0, policy_version 126520 (0.0006) [2023-12-27 20:08:19,411][106225] Updated weights for policy 1, policy_version 126486 (0.0007) [2023-12-27 20:08:19,437][106226] Updated weights for policy 0, policy_version 126530 (0.0006) [2023-12-27 20:08:19,479][106225] Updated weights for policy 1, policy_version 126496 (0.0006) [2023-12-27 20:08:20,196][106225] Updated weights for policy 1, policy_version 126506 (0.0009) [2023-12-27 20:08:20,211][106226] Updated weights for policy 0, policy_version 126540 (0.0009) [2023-12-27 20:08:20,255][106225] Updated weights for policy 1, policy_version 126516 (0.0008) [2023-12-27 20:08:20,279][106226] Updated weights for policy 0, policy_version 126550 (0.0008) [2023-12-27 20:08:20,307][106225] Updated weights for policy 1, policy_version 126526 (0.0009) [2023-12-27 20:08:20,339][106226] Updated weights for policy 0, policy_version 126560 (0.0006) [2023-12-27 20:08:21,028][106225] Updated weights for policy 1, policy_version 126536 (0.0008) [2023-12-27 20:08:21,097][106225] Updated weights for policy 1, policy_version 126546 (0.0008) [2023-12-27 20:08:21,108][106226] Updated weights for policy 0, policy_version 126570 (0.0008) [2023-12-27 20:08:21,161][106225] Updated weights for policy 1, policy_version 126556 (0.0009) [2023-12-27 20:08:21,174][106226] Updated weights for policy 0, policy_version 126580 (0.0009) [2023-12-27 20:08:21,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 64806912. Throughput: 0: 9739.3, 1: 9855.9. Samples: 64823956. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:21,175][105115] Avg episode reward: [(0, '-5.437'), (1, '-6.860')] [2023-12-27 20:08:21,225][106226] Updated weights for policy 0, policy_version 126590 (0.0009) [2023-12-27 20:08:21,295][106226] Updated weights for policy 0, policy_version 126600 (0.0008) [2023-12-27 20:08:21,853][106225] Updated weights for policy 1, policy_version 126566 (0.0007) [2023-12-27 20:08:21,914][106225] Updated weights for policy 1, policy_version 126576 (0.0009) [2023-12-27 20:08:21,978][106225] Updated weights for policy 1, policy_version 126586 (0.0009) [2023-12-27 20:08:22,153][106226] Updated weights for policy 0, policy_version 126610 (0.0009) [2023-12-27 20:08:22,211][106226] Updated weights for policy 0, policy_version 126620 (0.0009) [2023-12-27 20:08:22,272][106226] Updated weights for policy 0, policy_version 126630 (0.0008) [2023-12-27 20:08:22,660][106225] Updated weights for policy 1, policy_version 126596 (0.0009) [2023-12-27 20:08:22,716][106225] Updated weights for policy 1, policy_version 126606 (0.0008) [2023-12-27 20:08:22,775][106225] Updated weights for policy 1, policy_version 126616 (0.0010) [2023-12-27 20:08:22,993][106226] Updated weights for policy 0, policy_version 126640 (0.0006) [2023-12-27 20:08:23,045][106226] Updated weights for policy 0, policy_version 126650 (0.0006) [2023-12-27 20:08:23,095][106226] Updated weights for policy 0, policy_version 126660 (0.0009) [2023-12-27 20:08:23,580][106225] Updated weights for policy 1, policy_version 126626 (0.0009) [2023-12-27 20:08:23,642][106225] Updated weights for policy 1, policy_version 126636 (0.0009) [2023-12-27 20:08:23,667][106226] Updated weights for policy 0, policy_version 126670 (0.0007) [2023-12-27 20:08:23,694][106225] Updated weights for policy 1, policy_version 126646 (0.0007) [2023-12-27 20:08:23,718][106226] Updated weights for policy 0, policy_version 126680 (0.0007) [2023-12-27 20:08:23,753][106225] Updated weights for policy 1, policy_version 126656 (0.0006) [2023-12-27 20:08:23,772][106226] Updated weights for policy 0, policy_version 126690 (0.0009) [2023-12-27 20:08:24,468][106226] Updated weights for policy 0, policy_version 126700 (0.0008) [2023-12-27 20:08:24,513][106226] Updated weights for policy 0, policy_version 126710 (0.0006) [2023-12-27 20:08:24,521][106225] Updated weights for policy 1, policy_version 126666 (0.0007) [2023-12-27 20:08:24,567][106226] Updated weights for policy 0, policy_version 126720 (0.0010) [2023-12-27 20:08:24,577][106225] Updated weights for policy 1, policy_version 126676 (0.0007) [2023-12-27 20:08:24,637][106225] Updated weights for policy 1, policy_version 126686 (0.0007) [2023-12-27 20:08:25,305][106226] Updated weights for policy 0, policy_version 126730 (0.0007) [2023-12-27 20:08:25,361][106225] Updated weights for policy 1, policy_version 126696 (0.0007) [2023-12-27 20:08:25,366][106226] Updated weights for policy 0, policy_version 126740 (0.0008) [2023-12-27 20:08:25,415][106225] Updated weights for policy 1, policy_version 126706 (0.0008) [2023-12-27 20:08:25,425][106226] Updated weights for policy 0, policy_version 126750 (0.0006) [2023-12-27 20:08:25,471][106225] Updated weights for policy 1, policy_version 126716 (0.0006) [2023-12-27 20:08:25,490][106226] Updated weights for policy 0, policy_version 126760 (0.0008) [2023-12-27 20:08:26,153][106225] Updated weights for policy 1, policy_version 126726 (0.0007) [2023-12-27 20:08:26,175][105115] Fps is (10 sec: 18022.1, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 64905216. Throughput: 0: 9762.3, 1: 9804.3. Samples: 64881736. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:26,175][105115] Avg episode reward: [(0, '-5.611'), (1, '-6.762')] [2023-12-27 20:08:26,203][106225] Updated weights for policy 1, policy_version 126736 (0.0006) [2023-12-27 20:08:26,225][106226] Updated weights for policy 0, policy_version 126770 (0.0008) [2023-12-27 20:08:26,252][106225] Updated weights for policy 1, policy_version 126746 (0.0008) [2023-12-27 20:08:26,281][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000126752_32456704.pth... [2023-12-27 20:08:26,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000125600_32161792.pth [2023-12-27 20:08:26,297][106226] Updated weights for policy 0, policy_version 126780 (0.0009) [2023-12-27 20:08:26,357][106226] Updated weights for policy 0, policy_version 126790 (0.0009) [2023-12-27 20:08:26,370][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000126792_32464896.pth... [2023-12-27 20:08:26,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000125640_32169984.pth [2023-12-27 20:08:26,895][106225] Updated weights for policy 1, policy_version 126756 (0.0007) [2023-12-27 20:08:26,939][106225] Updated weights for policy 1, policy_version 126766 (0.0008) [2023-12-27 20:08:26,994][106225] Updated weights for policy 1, policy_version 126776 (0.0009) [2023-12-27 20:08:27,103][106226] Updated weights for policy 0, policy_version 126800 (0.0008) [2023-12-27 20:08:27,162][106226] Updated weights for policy 0, policy_version 126810 (0.0009) [2023-12-27 20:08:27,215][106226] Updated weights for policy 0, policy_version 126820 (0.0009) [2023-12-27 20:08:27,594][106225] Updated weights for policy 1, policy_version 126786 (0.0008) [2023-12-27 20:08:27,652][106225] Updated weights for policy 1, policy_version 126796 (0.0007) [2023-12-27 20:08:27,715][106225] Updated weights for policy 1, policy_version 126806 (0.0005) [2023-12-27 20:08:27,786][106225] Updated weights for policy 1, policy_version 126816 (0.0005) [2023-12-27 20:08:28,030][106226] Updated weights for policy 0, policy_version 126830 (0.0008) [2023-12-27 20:08:28,080][106226] Updated weights for policy 0, policy_version 126840 (0.0009) [2023-12-27 20:08:28,138][106226] Updated weights for policy 0, policy_version 126850 (0.0006) [2023-12-27 20:08:28,280][106225] Updated weights for policy 1, policy_version 126826 (0.0007) [2023-12-27 20:08:28,358][106225] Updated weights for policy 1, policy_version 126836 (0.0009) [2023-12-27 20:08:28,422][106225] Updated weights for policy 1, policy_version 126846 (0.0007) [2023-12-27 20:08:28,869][106226] Updated weights for policy 0, policy_version 126860 (0.0007) [2023-12-27 20:08:28,924][106226] Updated weights for policy 0, policy_version 126870 (0.0008) [2023-12-27 20:08:28,975][106226] Updated weights for policy 0, policy_version 126880 (0.0006) [2023-12-27 20:08:28,976][106225] Updated weights for policy 1, policy_version 126856 (0.0008) [2023-12-27 20:08:29,034][106225] Updated weights for policy 1, policy_version 126866 (0.0006) [2023-12-27 20:08:29,095][106225] Updated weights for policy 1, policy_version 126876 (0.0005) [2023-12-27 20:08:29,643][106226] Updated weights for policy 0, policy_version 126890 (0.0006) [2023-12-27 20:08:29,715][106226] Updated weights for policy 0, policy_version 126900 (0.0009) [2023-12-27 20:08:29,760][106225] Updated weights for policy 1, policy_version 126886 (0.0008) [2023-12-27 20:08:29,776][106226] Updated weights for policy 0, policy_version 126910 (0.0008) [2023-12-27 20:08:29,817][106225] Updated weights for policy 1, policy_version 126896 (0.0007) [2023-12-27 20:08:29,842][106226] Updated weights for policy 0, policy_version 126920 (0.0008) [2023-12-27 20:08:29,883][106225] Updated weights for policy 1, policy_version 126906 (0.0008) [2023-12-27 20:08:30,578][106226] Updated weights for policy 0, policy_version 126930 (0.0008) [2023-12-27 20:08:30,596][106225] Updated weights for policy 1, policy_version 126916 (0.0007) [2023-12-27 20:08:30,636][106226] Updated weights for policy 0, policy_version 126940 (0.0008) [2023-12-27 20:08:30,650][106225] Updated weights for policy 1, policy_version 126926 (0.0007) [2023-12-27 20:08:30,698][106226] Updated weights for policy 0, policy_version 126950 (0.0006) [2023-12-27 20:08:30,711][106225] Updated weights for policy 1, policy_version 126936 (0.0009) [2023-12-27 20:08:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 65011712. Throughput: 0: 9748.7, 1: 9965.7. Samples: 65002748. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:31,175][105115] Avg episode reward: [(0, '-5.580'), (1, '-6.849')] [2023-12-27 20:08:31,385][106226] Updated weights for policy 0, policy_version 126960 (0.0010) [2023-12-27 20:08:31,441][106226] Updated weights for policy 0, policy_version 126970 (0.0009) [2023-12-27 20:08:31,481][106225] Updated weights for policy 1, policy_version 126946 (0.0008) [2023-12-27 20:08:31,495][106226] Updated weights for policy 0, policy_version 126980 (0.0010) [2023-12-27 20:08:31,533][106225] Updated weights for policy 1, policy_version 126956 (0.0007) [2023-12-27 20:08:31,586][106225] Updated weights for policy 1, policy_version 126966 (0.0008) [2023-12-27 20:08:31,652][106225] Updated weights for policy 1, policy_version 126976 (0.0007) [2023-12-27 20:08:32,281][106226] Updated weights for policy 0, policy_version 126990 (0.0008) [2023-12-27 20:08:32,294][106225] Updated weights for policy 1, policy_version 126986 (0.0009) [2023-12-27 20:08:32,344][106226] Updated weights for policy 0, policy_version 127000 (0.0006) [2023-12-27 20:08:32,356][106225] Updated weights for policy 1, policy_version 126996 (0.0008) [2023-12-27 20:08:32,405][106226] Updated weights for policy 0, policy_version 127010 (0.0007) [2023-12-27 20:08:32,415][106225] Updated weights for policy 1, policy_version 127006 (0.0007) [2023-12-27 20:08:33,032][106225] Updated weights for policy 1, policy_version 127016 (0.0006) [2023-12-27 20:08:33,087][106225] Updated weights for policy 1, policy_version 127026 (0.0005) [2023-12-27 20:08:33,136][106225] Updated weights for policy 1, policy_version 127036 (0.0007) [2023-12-27 20:08:33,147][106226] Updated weights for policy 0, policy_version 127020 (0.0006) [2023-12-27 20:08:33,201][106226] Updated weights for policy 0, policy_version 127030 (0.0005) [2023-12-27 20:08:33,251][106226] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-12-27 20:08:33,680][106225] Updated weights for policy 1, policy_version 127046 (0.0006) [2023-12-27 20:08:33,739][106225] Updated weights for policy 1, policy_version 127056 (0.0005) [2023-12-27 20:08:33,787][106225] Updated weights for policy 1, policy_version 127066 (0.0005) [2023-12-27 20:08:34,001][106226] Updated weights for policy 0, policy_version 127050 (0.0007) [2023-12-27 20:08:34,055][106226] Updated weights for policy 0, policy_version 127060 (0.0009) [2023-12-27 20:08:34,110][106226] Updated weights for policy 0, policy_version 127070 (0.0008) [2023-12-27 20:08:34,178][106226] Updated weights for policy 0, policy_version 127080 (0.0008) [2023-12-27 20:08:34,392][106225] Updated weights for policy 1, policy_version 127076 (0.0007) [2023-12-27 20:08:34,451][106225] Updated weights for policy 1, policy_version 127086 (0.0010) [2023-12-27 20:08:34,515][106225] Updated weights for policy 1, policy_version 127096 (0.0010) [2023-12-27 20:08:34,927][106226] Updated weights for policy 0, policy_version 127090 (0.0008) [2023-12-27 20:08:34,987][106226] Updated weights for policy 0, policy_version 127100 (0.0006) [2023-12-27 20:08:35,042][106226] Updated weights for policy 0, policy_version 127110 (0.0007) [2023-12-27 20:08:35,267][106225] Updated weights for policy 1, policy_version 127106 (0.0010) [2023-12-27 20:08:35,328][106225] Updated weights for policy 1, policy_version 127116 (0.0008) [2023-12-27 20:08:35,378][106225] Updated weights for policy 1, policy_version 127126 (0.0009) [2023-12-27 20:08:35,434][106225] Updated weights for policy 1, policy_version 127136 (0.0009) [2023-12-27 20:08:35,698][106226] Updated weights for policy 0, policy_version 127120 (0.0009) [2023-12-27 20:08:35,759][106226] Updated weights for policy 0, policy_version 127130 (0.0008) [2023-12-27 20:08:35,820][106226] Updated weights for policy 0, policy_version 127140 (0.0009) [2023-12-27 20:08:36,135][106225] Updated weights for policy 1, policy_version 127146 (0.0007) [2023-12-27 20:08:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 65110016. Throughput: 0: 9622.9, 1: 9949.0. Samples: 65120668. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:36,175][105115] Avg episode reward: [(0, '-5.434'), (1, '-6.768')] [2023-12-27 20:08:36,191][106225] Updated weights for policy 1, policy_version 127156 (0.0007) [2023-12-27 20:08:36,249][106225] Updated weights for policy 1, policy_version 127166 (0.0009) [2023-12-27 20:08:36,606][106226] Updated weights for policy 0, policy_version 127150 (0.0008) [2023-12-27 20:08:36,668][106226] Updated weights for policy 0, policy_version 127160 (0.0008) [2023-12-27 20:08:36,733][106226] Updated weights for policy 0, policy_version 127170 (0.0006) [2023-12-27 20:08:36,988][106225] Updated weights for policy 1, policy_version 127176 (0.0008) [2023-12-27 20:08:37,046][106225] Updated weights for policy 1, policy_version 127186 (0.0008) [2023-12-27 20:08:37,097][106225] Updated weights for policy 1, policy_version 127196 (0.0008) [2023-12-27 20:08:37,268][106226] Updated weights for policy 0, policy_version 127180 (0.0006) [2023-12-27 20:08:37,330][106226] Updated weights for policy 0, policy_version 127190 (0.0008) [2023-12-27 20:08:37,381][106226] Updated weights for policy 0, policy_version 127200 (0.0008) [2023-12-27 20:08:37,812][106225] Updated weights for policy 1, policy_version 127206 (0.0007) [2023-12-27 20:08:37,886][106225] Updated weights for policy 1, policy_version 127216 (0.0006) [2023-12-27 20:08:37,948][106225] Updated weights for policy 1, policy_version 127226 (0.0006) [2023-12-27 20:08:38,138][106226] Updated weights for policy 0, policy_version 127210 (0.0009) [2023-12-27 20:08:38,190][106226] Updated weights for policy 0, policy_version 127220 (0.0008) [2023-12-27 20:08:38,241][106226] Updated weights for policy 0, policy_version 127230 (0.0008) [2023-12-27 20:08:38,293][106226] Updated weights for policy 0, policy_version 127240 (0.0007) [2023-12-27 20:08:38,563][106225] Updated weights for policy 1, policy_version 127236 (0.0007) [2023-12-27 20:08:38,620][106225] Updated weights for policy 1, policy_version 127246 (0.0010) [2023-12-27 20:08:38,670][106225] Updated weights for policy 1, policy_version 127256 (0.0010) [2023-12-27 20:08:39,065][106226] Updated weights for policy 0, policy_version 127250 (0.0009) [2023-12-27 20:08:39,113][106226] Updated weights for policy 0, policy_version 127260 (0.0008) [2023-12-27 20:08:39,158][106226] Updated weights for policy 0, policy_version 127270 (0.0007) [2023-12-27 20:08:39,306][106225] Updated weights for policy 1, policy_version 127266 (0.0010) [2023-12-27 20:08:39,376][106225] Updated weights for policy 1, policy_version 127276 (0.0009) [2023-12-27 20:08:39,441][106225] Updated weights for policy 1, policy_version 127286 (0.0008) [2023-12-27 20:08:39,496][106225] Updated weights for policy 1, policy_version 127296 (0.0008) [2023-12-27 20:08:40,019][106226] Updated weights for policy 0, policy_version 127280 (0.0009) [2023-12-27 20:08:40,083][106226] Updated weights for policy 0, policy_version 127290 (0.0008) [2023-12-27 20:08:40,151][106226] Updated weights for policy 0, policy_version 127300 (0.0009) [2023-12-27 20:08:40,311][106225] Updated weights for policy 1, policy_version 127306 (0.0009) [2023-12-27 20:08:40,370][106225] Updated weights for policy 1, policy_version 127316 (0.0008) [2023-12-27 20:08:40,427][106225] Updated weights for policy 1, policy_version 127326 (0.0008) [2023-12-27 20:08:40,837][106226] Updated weights for policy 0, policy_version 127310 (0.0009) [2023-12-27 20:08:40,901][106226] Updated weights for policy 0, policy_version 127320 (0.0008) [2023-12-27 20:08:40,965][106226] Updated weights for policy 0, policy_version 127330 (0.0005) [2023-12-27 20:08:41,051][106225] Updated weights for policy 1, policy_version 127336 (0.0008) [2023-12-27 20:08:41,109][106225] Updated weights for policy 1, policy_version 127346 (0.0009) [2023-12-27 20:08:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 65208320. Throughput: 0: 9631.0, 1: 10008.9. Samples: 65181068. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:41,175][105115] Avg episode reward: [(0, '-5.494'), (1, '-6.971')] [2023-12-27 20:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000127336_32604160.pth... [2023-12-27 20:08:41,183][106225] Updated weights for policy 1, policy_version 127356 (0.0008) [2023-12-27 20:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000126216_32317440.pth [2023-12-27 20:08:41,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000127360_32612352.pth... [2023-12-27 20:08:41,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000126176_32309248.pth [2023-12-27 20:08:41,746][106226] Updated weights for policy 0, policy_version 127340 (0.0007) [2023-12-27 20:08:41,815][106226] Updated weights for policy 0, policy_version 127350 (0.0009) [2023-12-27 20:08:41,881][106226] Updated weights for policy 0, policy_version 127360 (0.0008) [2023-12-27 20:08:41,984][106225] Updated weights for policy 1, policy_version 127366 (0.0007) [2023-12-27 20:08:42,039][106225] Updated weights for policy 1, policy_version 127376 (0.0005) [2023-12-27 20:08:42,090][106225] Updated weights for policy 1, policy_version 127386 (0.0005) [2023-12-27 20:08:42,686][106226] Updated weights for policy 0, policy_version 127370 (0.0008) [2023-12-27 20:08:42,701][106225] Updated weights for policy 1, policy_version 127396 (0.0007) [2023-12-27 20:08:42,747][106226] Updated weights for policy 0, policy_version 127380 (0.0008) [2023-12-27 20:08:42,770][106225] Updated weights for policy 1, policy_version 127406 (0.0006) [2023-12-27 20:08:42,805][106226] Updated weights for policy 0, policy_version 127390 (0.0007) [2023-12-27 20:08:42,837][106225] Updated weights for policy 1, policy_version 127416 (0.0006) [2023-12-27 20:08:42,863][106226] Updated weights for policy 0, policy_version 127400 (0.0007) [2023-12-27 20:08:43,487][106225] Updated weights for policy 1, policy_version 127426 (0.0006) [2023-12-27 20:08:43,558][106225] Updated weights for policy 1, policy_version 127436 (0.0007) [2023-12-27 20:08:43,607][106226] Updated weights for policy 0, policy_version 127410 (0.0009) [2023-12-27 20:08:43,617][106225] Updated weights for policy 1, policy_version 127446 (0.0006) [2023-12-27 20:08:43,663][106226] Updated weights for policy 0, policy_version 127420 (0.0009) [2023-12-27 20:08:43,670][106225] Updated weights for policy 1, policy_version 127456 (0.0005) [2023-12-27 20:08:43,719][106226] Updated weights for policy 0, policy_version 127430 (0.0010) [2023-12-27 20:08:44,374][106225] Updated weights for policy 1, policy_version 127466 (0.0009) [2023-12-27 20:08:44,419][106225] Updated weights for policy 1, policy_version 127476 (0.0007) [2023-12-27 20:08:44,425][106226] Updated weights for policy 0, policy_version 127440 (0.0007) [2023-12-27 20:08:44,476][106225] Updated weights for policy 1, policy_version 127486 (0.0006) [2023-12-27 20:08:44,483][106226] Updated weights for policy 0, policy_version 127450 (0.0009) [2023-12-27 20:08:44,544][106226] Updated weights for policy 0, policy_version 127460 (0.0008) [2023-12-27 20:08:45,260][106225] Updated weights for policy 1, policy_version 127496 (0.0010) [2023-12-27 20:08:45,306][106226] Updated weights for policy 0, policy_version 127470 (0.0010) [2023-12-27 20:08:45,326][106225] Updated weights for policy 1, policy_version 127506 (0.0008) [2023-12-27 20:08:45,372][106226] Updated weights for policy 0, policy_version 127480 (0.0011) [2023-12-27 20:08:45,385][106225] Updated weights for policy 1, policy_version 127516 (0.0006) [2023-12-27 20:08:45,428][106226] Updated weights for policy 0, policy_version 127490 (0.0010) [2023-12-27 20:08:46,044][106225] Updated weights for policy 1, policy_version 127526 (0.0008) [2023-12-27 20:08:46,104][106225] Updated weights for policy 1, policy_version 127536 (0.0010) [2023-12-27 20:08:46,124][106226] Updated weights for policy 0, policy_version 127500 (0.0010) [2023-12-27 20:08:46,154][106225] Updated weights for policy 1, policy_version 127546 (0.0010) [2023-12-27 20:08:46,174][106226] Updated weights for policy 0, policy_version 127510 (0.0010) [2023-12-27 20:08:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 65298432. Throughput: 0: 9578.1, 1: 9997.0. Samples: 65295980. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:46,175][105115] Avg episode reward: [(0, '-5.770'), (1, '-6.688')] [2023-12-27 20:08:46,226][106226] Updated weights for policy 0, policy_version 127520 (0.0010) [2023-12-27 20:08:46,834][106225] Updated weights for policy 1, policy_version 127556 (0.0009) [2023-12-27 20:08:46,889][106225] Updated weights for policy 1, policy_version 127566 (0.0005) [2023-12-27 20:08:46,915][106226] Updated weights for policy 0, policy_version 127530 (0.0010) [2023-12-27 20:08:46,940][106225] Updated weights for policy 1, policy_version 127576 (0.0006) [2023-12-27 20:08:46,975][106226] Updated weights for policy 0, policy_version 127540 (0.0010) [2023-12-27 20:08:47,032][106226] Updated weights for policy 0, policy_version 127550 (0.0007) [2023-12-27 20:08:47,099][106226] Updated weights for policy 0, policy_version 127560 (0.0005) [2023-12-27 20:08:47,605][106225] Updated weights for policy 1, policy_version 127586 (0.0005) [2023-12-27 20:08:47,661][106225] Updated weights for policy 1, policy_version 127596 (0.0008) [2023-12-27 20:08:47,716][106225] Updated weights for policy 1, policy_version 127606 (0.0007) [2023-12-27 20:08:47,718][106226] Updated weights for policy 0, policy_version 127570 (0.0010) [2023-12-27 20:08:47,773][106225] Updated weights for policy 1, policy_version 127616 (0.0005) [2023-12-27 20:08:47,778][106226] Updated weights for policy 0, policy_version 127580 (0.0010) [2023-12-27 20:08:47,834][106226] Updated weights for policy 0, policy_version 127590 (0.0010) [2023-12-27 20:08:48,536][106225] Updated weights for policy 1, policy_version 127626 (0.0009) [2023-12-27 20:08:48,568][106226] Updated weights for policy 0, policy_version 127600 (0.0009) [2023-12-27 20:08:48,588][106225] Updated weights for policy 1, policy_version 127636 (0.0009) [2023-12-27 20:08:48,620][106226] Updated weights for policy 0, policy_version 127610 (0.0009) [2023-12-27 20:08:48,640][106225] Updated weights for policy 1, policy_version 127646 (0.0007) [2023-12-27 20:08:48,688][106226] Updated weights for policy 0, policy_version 127620 (0.0009) [2023-12-27 20:08:49,373][106226] Updated weights for policy 0, policy_version 127630 (0.0008) [2023-12-27 20:08:49,414][106225] Updated weights for policy 1, policy_version 127656 (0.0006) [2023-12-27 20:08:49,439][106226] Updated weights for policy 0, policy_version 127640 (0.0005) [2023-12-27 20:08:49,470][106225] Updated weights for policy 1, policy_version 127666 (0.0006) [2023-12-27 20:08:49,494][106226] Updated weights for policy 0, policy_version 127650 (0.0006) [2023-12-27 20:08:49,522][106225] Updated weights for policy 1, policy_version 127676 (0.0006) [2023-12-27 20:08:50,125][106225] Updated weights for policy 1, policy_version 127686 (0.0006) [2023-12-27 20:08:50,188][106225] Updated weights for policy 1, policy_version 127696 (0.0009) [2023-12-27 20:08:50,241][106226] Updated weights for policy 0, policy_version 127660 (0.0007) [2023-12-27 20:08:50,252][106225] Updated weights for policy 1, policy_version 127706 (0.0008) [2023-12-27 20:08:50,305][106226] Updated weights for policy 0, policy_version 127670 (0.0006) [2023-12-27 20:08:50,375][106226] Updated weights for policy 0, policy_version 127680 (0.0006) [2023-12-27 20:08:50,941][106226] Updated weights for policy 0, policy_version 127690 (0.0007) [2023-12-27 20:08:51,004][106226] Updated weights for policy 0, policy_version 127700 (0.0008) [2023-12-27 20:08:51,030][106225] Updated weights for policy 1, policy_version 127716 (0.0009) [2023-12-27 20:08:51,076][106226] Updated weights for policy 0, policy_version 127710 (0.0010) [2023-12-27 20:08:51,093][106225] Updated weights for policy 1, policy_version 127726 (0.0006) [2023-12-27 20:08:51,140][106226] Updated weights for policy 0, policy_version 127720 (0.0011) [2023-12-27 20:08:51,159][106225] Updated weights for policy 1, policy_version 127736 (0.0007) [2023-12-27 20:08:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 65404928. Throughput: 0: 9586.6, 1: 9962.5. Samples: 65415824. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:51,175][105115] Avg episode reward: [(0, '-5.681'), (1, '-6.756')] [2023-12-27 20:08:51,882][106226] Updated weights for policy 0, policy_version 127730 (0.0011) [2023-12-27 20:08:51,936][106226] Updated weights for policy 0, policy_version 127740 (0.0011) [2023-12-27 20:08:51,942][106225] Updated weights for policy 1, policy_version 127746 (0.0008) [2023-12-27 20:08:51,998][106226] Updated weights for policy 0, policy_version 127750 (0.0011) [2023-12-27 20:08:52,004][106225] Updated weights for policy 1, policy_version 127756 (0.0005) [2023-12-27 20:08:52,064][106225] Updated weights for policy 1, policy_version 127766 (0.0007) [2023-12-27 20:08:52,124][106225] Updated weights for policy 1, policy_version 127776 (0.0008) [2023-12-27 20:08:52,697][106226] Updated weights for policy 0, policy_version 127760 (0.0010) [2023-12-27 20:08:52,765][106226] Updated weights for policy 0, policy_version 127770 (0.0011) [2023-12-27 20:08:52,830][106226] Updated weights for policy 0, policy_version 127780 (0.0011) [2023-12-27 20:08:52,866][106225] Updated weights for policy 1, policy_version 127786 (0.0008) [2023-12-27 20:08:52,934][106225] Updated weights for policy 1, policy_version 127796 (0.0008) [2023-12-27 20:08:52,985][106225] Updated weights for policy 1, policy_version 127806 (0.0008) [2023-12-27 20:08:53,441][106226] Updated weights for policy 0, policy_version 127790 (0.0008) [2023-12-27 20:08:53,507][106226] Updated weights for policy 0, policy_version 127800 (0.0007) [2023-12-27 20:08:53,573][106226] Updated weights for policy 0, policy_version 127810 (0.0010) [2023-12-27 20:08:53,714][106225] Updated weights for policy 1, policy_version 127816 (0.0008) [2023-12-27 20:08:53,779][106225] Updated weights for policy 1, policy_version 127826 (0.0010) [2023-12-27 20:08:53,843][106225] Updated weights for policy 1, policy_version 127836 (0.0008) [2023-12-27 20:08:54,179][106226] Updated weights for policy 0, policy_version 127820 (0.0010) [2023-12-27 20:08:54,244][106226] Updated weights for policy 0, policy_version 127830 (0.0010) [2023-12-27 20:08:54,298][106226] Updated weights for policy 0, policy_version 127840 (0.0010) [2023-12-27 20:08:54,481][106225] Updated weights for policy 1, policy_version 127846 (0.0010) [2023-12-27 20:08:54,542][106225] Updated weights for policy 1, policy_version 127856 (0.0010) [2023-12-27 20:08:54,604][106225] Updated weights for policy 1, policy_version 127866 (0.0007) [2023-12-27 20:08:54,861][106226] Updated weights for policy 0, policy_version 127850 (0.0008) [2023-12-27 20:08:54,910][106226] Updated weights for policy 0, policy_version 127860 (0.0009) [2023-12-27 20:08:54,958][106226] Updated weights for policy 0, policy_version 127870 (0.0009) [2023-12-27 20:08:55,011][106226] Updated weights for policy 0, policy_version 127880 (0.0008) [2023-12-27 20:08:55,349][106225] Updated weights for policy 1, policy_version 127876 (0.0006) [2023-12-27 20:08:55,400][106225] Updated weights for policy 1, policy_version 127886 (0.0005) [2023-12-27 20:08:55,466][106225] Updated weights for policy 1, policy_version 127896 (0.0007) [2023-12-27 20:08:55,665][106226] Updated weights for policy 0, policy_version 127890 (0.0009) [2023-12-27 20:08:55,714][106226] Updated weights for policy 0, policy_version 127900 (0.0009) [2023-12-27 20:08:55,764][106226] Updated weights for policy 0, policy_version 127910 (0.0009) [2023-12-27 20:08:56,140][106225] Updated weights for policy 1, policy_version 127906 (0.0009) [2023-12-27 20:08:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 65503232. Throughput: 0: 9599.7, 1: 9924.0. Samples: 65473440. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:08:56,175][105115] Avg episode reward: [(0, '-5.516'), (1, '-6.704')] [2023-12-27 20:08:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000127912_32751616.pth... [2023-12-27 20:08:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000126792_32464896.pth [2023-12-27 20:08:56,191][106225] Updated weights for policy 1, policy_version 127916 (0.0010) [2023-12-27 20:08:56,242][106225] Updated weights for policy 1, policy_version 127926 (0.0008) [2023-12-27 20:08:56,286][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000127936_32759808.pth... [2023-12-27 20:08:56,287][106225] Updated weights for policy 1, policy_version 127936 (0.0008) [2023-12-27 20:08:56,289][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000126752_32456704.pth [2023-12-27 20:08:56,480][106226] Updated weights for policy 0, policy_version 127920 (0.0006) [2023-12-27 20:08:56,541][106226] Updated weights for policy 0, policy_version 127930 (0.0005) [2023-12-27 20:08:56,604][106226] Updated weights for policy 0, policy_version 127940 (0.0005) [2023-12-27 20:08:57,090][106225] Updated weights for policy 1, policy_version 127946 (0.0006) [2023-12-27 20:08:57,154][106225] Updated weights for policy 1, policy_version 127956 (0.0008) [2023-12-27 20:08:57,172][106226] Updated weights for policy 0, policy_version 127950 (0.0006) [2023-12-27 20:08:57,218][106225] Updated weights for policy 1, policy_version 127966 (0.0007) [2023-12-27 20:08:57,230][106226] Updated weights for policy 0, policy_version 127960 (0.0008) [2023-12-27 20:08:57,284][106226] Updated weights for policy 0, policy_version 127970 (0.0005) [2023-12-27 20:08:57,911][106225] Updated weights for policy 1, policy_version 127976 (0.0006) [2023-12-27 20:08:57,931][106226] Updated weights for policy 0, policy_version 127980 (0.0009) [2023-12-27 20:08:57,963][106225] Updated weights for policy 1, policy_version 127986 (0.0005) [2023-12-27 20:08:57,987][106226] Updated weights for policy 0, policy_version 127990 (0.0010) [2023-12-27 20:08:58,017][106225] Updated weights for policy 1, policy_version 127996 (0.0006) [2023-12-27 20:08:58,043][106226] Updated weights for policy 0, policy_version 128000 (0.0010) [2023-12-27 20:08:58,747][106225] Updated weights for policy 1, policy_version 128006 (0.0007) [2023-12-27 20:08:58,808][106225] Updated weights for policy 1, policy_version 128016 (0.0008) [2023-12-27 20:08:58,878][106225] Updated weights for policy 1, policy_version 128026 (0.0010) [2023-12-27 20:08:58,895][106226] Updated weights for policy 0, policy_version 128010 (0.0010) [2023-12-27 20:08:58,955][106226] Updated weights for policy 0, policy_version 128020 (0.0008) [2023-12-27 20:08:59,022][106226] Updated weights for policy 0, policy_version 128030 (0.0007) [2023-12-27 20:08:59,088][106226] Updated weights for policy 0, policy_version 128040 (0.0008) [2023-12-27 20:08:59,705][106225] Updated weights for policy 1, policy_version 128036 (0.0009) [2023-12-27 20:08:59,770][106225] Updated weights for policy 1, policy_version 128046 (0.0010) [2023-12-27 20:08:59,839][106225] Updated weights for policy 1, policy_version 128056 (0.0011) [2023-12-27 20:08:59,897][106226] Updated weights for policy 0, policy_version 128050 (0.0009) [2023-12-27 20:08:59,965][106226] Updated weights for policy 0, policy_version 128060 (0.0009) [2023-12-27 20:09:00,029][106226] Updated weights for policy 0, policy_version 128070 (0.0006) [2023-12-27 20:09:00,538][106225] Updated weights for policy 1, policy_version 128066 (0.0010) [2023-12-27 20:09:00,583][106225] Updated weights for policy 1, policy_version 128076 (0.0007) [2023-12-27 20:09:00,628][106225] Updated weights for policy 1, policy_version 128086 (0.0005) [2023-12-27 20:09:00,674][106225] Updated weights for policy 1, policy_version 128096 (0.0005) [2023-12-27 20:09:00,725][106226] Updated weights for policy 0, policy_version 128080 (0.0007) [2023-12-27 20:09:00,778][106226] Updated weights for policy 0, policy_version 128090 (0.0008) [2023-12-27 20:09:00,839][106226] Updated weights for policy 0, policy_version 128100 (0.0007) [2023-12-27 20:09:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 65601536. Throughput: 0: 9680.0, 1: 9897.7. Samples: 65591376. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:09:01,175][105115] Avg episode reward: [(0, '-5.365'), (1, '-6.559')] [2023-12-27 20:09:01,417][106225] Updated weights for policy 1, policy_version 128106 (0.0008) [2023-12-27 20:09:01,478][106225] Updated weights for policy 1, policy_version 128116 (0.0006) [2023-12-27 20:09:01,525][106226] Updated weights for policy 0, policy_version 128110 (0.0006) [2023-12-27 20:09:01,547][106225] Updated weights for policy 1, policy_version 128126 (0.0007) [2023-12-27 20:09:01,585][106226] Updated weights for policy 0, policy_version 128120 (0.0007) [2023-12-27 20:09:01,644][106226] Updated weights for policy 0, policy_version 128130 (0.0008) [2023-12-27 20:09:02,247][106226] Updated weights for policy 0, policy_version 128140 (0.0006) [2023-12-27 20:09:02,312][106226] Updated weights for policy 0, policy_version 128150 (0.0010) [2023-12-27 20:09:02,353][106225] Updated weights for policy 1, policy_version 128136 (0.0007) [2023-12-27 20:09:02,380][106226] Updated weights for policy 0, policy_version 128160 (0.0009) [2023-12-27 20:09:02,419][106225] Updated weights for policy 1, policy_version 128146 (0.0007) [2023-12-27 20:09:02,477][106225] Updated weights for policy 1, policy_version 128156 (0.0009) [2023-12-27 20:09:02,943][106226] Updated weights for policy 0, policy_version 128170 (0.0008) [2023-12-27 20:09:02,988][106226] Updated weights for policy 0, policy_version 128180 (0.0005) [2023-12-27 20:09:03,040][106226] Updated weights for policy 0, policy_version 128190 (0.0006) [2023-12-27 20:09:03,105][106226] Updated weights for policy 0, policy_version 128200 (0.0010) [2023-12-27 20:09:03,291][106225] Updated weights for policy 1, policy_version 128166 (0.0007) [2023-12-27 20:09:03,348][106225] Updated weights for policy 1, policy_version 128176 (0.0005) [2023-12-27 20:09:03,394][106225] Updated weights for policy 1, policy_version 128186 (0.0005) [2023-12-27 20:09:03,763][106226] Updated weights for policy 0, policy_version 128210 (0.0009) [2023-12-27 20:09:03,812][106226] Updated weights for policy 0, policy_version 128220 (0.0005) [2023-12-27 20:09:03,871][106226] Updated weights for policy 0, policy_version 128230 (0.0010) [2023-12-27 20:09:04,018][106225] Updated weights for policy 1, policy_version 128196 (0.0006) [2023-12-27 20:09:04,073][106225] Updated weights for policy 1, policy_version 128206 (0.0007) [2023-12-27 20:09:04,132][106225] Updated weights for policy 1, policy_version 128216 (0.0006) [2023-12-27 20:09:04,590][106226] Updated weights for policy 0, policy_version 128240 (0.0010) [2023-12-27 20:09:04,646][106226] Updated weights for policy 0, policy_version 128250 (0.0011) [2023-12-27 20:09:04,706][106226] Updated weights for policy 0, policy_version 128260 (0.0010) [2023-12-27 20:09:04,793][106225] Updated weights for policy 1, policy_version 128226 (0.0008) [2023-12-27 20:09:04,845][106225] Updated weights for policy 1, policy_version 128236 (0.0010) [2023-12-27 20:09:04,893][106225] Updated weights for policy 1, policy_version 128246 (0.0006) [2023-12-27 20:09:04,952][106225] Updated weights for policy 1, policy_version 128256 (0.0009) [2023-12-27 20:09:05,392][106226] Updated weights for policy 0, policy_version 128270 (0.0008) [2023-12-27 20:09:05,473][106226] Updated weights for policy 0, policy_version 128280 (0.0007) [2023-12-27 20:09:05,530][106226] Updated weights for policy 0, policy_version 128290 (0.0007) [2023-12-27 20:09:05,574][106225] Updated weights for policy 1, policy_version 128266 (0.0010) [2023-12-27 20:09:05,641][106225] Updated weights for policy 1, policy_version 128276 (0.0010) [2023-12-27 20:09:05,710][106225] Updated weights for policy 1, policy_version 128286 (0.0010) [2023-12-27 20:09:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 65699840. Throughput: 0: 9809.5, 1: 9934.1. Samples: 65712416. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:09:06,175][105115] Avg episode reward: [(0, '-5.647'), (1, '-7.070')] [2023-12-27 20:09:06,219][106226] Updated weights for policy 0, policy_version 128300 (0.0011) [2023-12-27 20:09:06,284][106226] Updated weights for policy 0, policy_version 128310 (0.0010) [2023-12-27 20:09:06,348][106226] Updated weights for policy 0, policy_version 128320 (0.0011) [2023-12-27 20:09:06,417][106225] Updated weights for policy 1, policy_version 128296 (0.0010) [2023-12-27 20:09:06,474][106225] Updated weights for policy 1, policy_version 128306 (0.0007) [2023-12-27 20:09:06,536][106225] Updated weights for policy 1, policy_version 128316 (0.0008) [2023-12-27 20:09:07,056][106226] Updated weights for policy 0, policy_version 128330 (0.0011) [2023-12-27 20:09:07,122][106226] Updated weights for policy 0, policy_version 128341 (0.0010) [2023-12-27 20:09:07,192][106226] Updated weights for policy 0, policy_version 128351 (0.0011) [2023-12-27 20:09:07,233][106225] Updated weights for policy 1, policy_version 128326 (0.0007) [2023-12-27 20:09:07,299][106225] Updated weights for policy 1, policy_version 128336 (0.0006) [2023-12-27 20:09:07,356][106225] Updated weights for policy 1, policy_version 128346 (0.0008) [2023-12-27 20:09:07,908][106225] Updated weights for policy 1, policy_version 128356 (0.0006) [2023-12-27 20:09:07,914][106226] Updated weights for policy 0, policy_version 128361 (0.0010) [2023-12-27 20:09:07,963][106225] Updated weights for policy 1, policy_version 128366 (0.0005) [2023-12-27 20:09:07,971][106226] Updated weights for policy 0, policy_version 128371 (0.0007) [2023-12-27 20:09:08,015][106225] Updated weights for policy 1, policy_version 128376 (0.0005) [2023-12-27 20:09:08,023][106226] Updated weights for policy 0, policy_version 128381 (0.0008) [2023-12-27 20:09:08,075][106226] Updated weights for policy 0, policy_version 128391 (0.0008) [2023-12-27 20:09:08,677][106225] Updated weights for policy 1, policy_version 128386 (0.0006) [2023-12-27 20:09:08,732][106225] Updated weights for policy 1, policy_version 128396 (0.0010) [2023-12-27 20:09:08,761][106226] Updated weights for policy 0, policy_version 128401 (0.0006) [2023-12-27 20:09:08,787][106225] Updated weights for policy 1, policy_version 128406 (0.0010) [2023-12-27 20:09:08,816][106226] Updated weights for policy 0, policy_version 128411 (0.0006) [2023-12-27 20:09:08,848][106225] Updated weights for policy 1, policy_version 128416 (0.0010) [2023-12-27 20:09:08,871][106226] Updated weights for policy 0, policy_version 128421 (0.0007) [2023-12-27 20:09:09,594][106225] Updated weights for policy 1, policy_version 128426 (0.0010) [2023-12-27 20:09:09,635][106226] Updated weights for policy 0, policy_version 128431 (0.0008) [2023-12-27 20:09:09,659][106225] Updated weights for policy 1, policy_version 128436 (0.0010) [2023-12-27 20:09:09,688][106226] Updated weights for policy 0, policy_version 128441 (0.0006) [2023-12-27 20:09:09,723][106225] Updated weights for policy 1, policy_version 128446 (0.0010) [2023-12-27 20:09:09,741][106226] Updated weights for policy 0, policy_version 128451 (0.0009) [2023-12-27 20:09:10,463][106225] Updated weights for policy 1, policy_version 128456 (0.0008) [2023-12-27 20:09:10,492][106226] Updated weights for policy 0, policy_version 128461 (0.0008) [2023-12-27 20:09:10,528][106225] Updated weights for policy 1, policy_version 128466 (0.0006) [2023-12-27 20:09:10,545][106226] Updated weights for policy 0, policy_version 128471 (0.0006) [2023-12-27 20:09:10,587][106225] Updated weights for policy 1, policy_version 128476 (0.0008) [2023-12-27 20:09:10,604][106226] Updated weights for policy 0, policy_version 128481 (0.0008) [2023-12-27 20:09:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 65798144. Throughput: 0: 9797.3, 1: 9999.3. Samples: 65772584. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:09:11,176][105115] Avg episode reward: [(0, '-5.607'), (1, '-6.901')] [2023-12-27 20:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000128488_32899072.pth... [2023-12-27 20:09:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000128480_32899072.pth... [2023-12-27 20:09:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000127360_32612352.pth [2023-12-27 20:09:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000127336_32604160.pth [2023-12-27 20:09:11,300][106226] Updated weights for policy 0, policy_version 128491 (0.0008) [2023-12-27 20:09:11,349][106225] Updated weights for policy 1, policy_version 128486 (0.0007) [2023-12-27 20:09:11,369][106226] Updated weights for policy 0, policy_version 128501 (0.0008) [2023-12-27 20:09:11,416][106225] Updated weights for policy 1, policy_version 128496 (0.0008) [2023-12-27 20:09:11,437][106226] Updated weights for policy 0, policy_version 128511 (0.0010) [2023-12-27 20:09:11,470][106225] Updated weights for policy 1, policy_version 128506 (0.0006) [2023-12-27 20:09:12,155][106226] Updated weights for policy 0, policy_version 128521 (0.0011) [2023-12-27 20:09:12,193][106225] Updated weights for policy 1, policy_version 128516 (0.0008) [2023-12-27 20:09:12,220][106226] Updated weights for policy 0, policy_version 128531 (0.0011) [2023-12-27 20:09:12,248][106225] Updated weights for policy 1, policy_version 128526 (0.0010) [2023-12-27 20:09:12,280][106226] Updated weights for policy 0, policy_version 128541 (0.0009) [2023-12-27 20:09:12,319][106225] Updated weights for policy 1, policy_version 128536 (0.0010) [2023-12-27 20:09:12,351][106226] Updated weights for policy 0, policy_version 128551 (0.0009) [2023-12-27 20:09:12,969][106226] Updated weights for policy 0, policy_version 128561 (0.0006) [2023-12-27 20:09:12,973][106225] Updated weights for policy 1, policy_version 128546 (0.0010) [2023-12-27 20:09:13,018][106226] Updated weights for policy 0, policy_version 128571 (0.0005) [2023-12-27 20:09:13,028][106225] Updated weights for policy 1, policy_version 128556 (0.0010) [2023-12-27 20:09:13,077][106226] Updated weights for policy 0, policy_version 128581 (0.0009) [2023-12-27 20:09:13,086][106225] Updated weights for policy 1, policy_version 128566 (0.0010) [2023-12-27 20:09:13,140][106225] Updated weights for policy 1, policy_version 128576 (0.0010) [2023-12-27 20:09:13,768][106226] Updated weights for policy 0, policy_version 128591 (0.0010) [2023-12-27 20:09:13,780][106225] Updated weights for policy 1, policy_version 128586 (0.0008) [2023-12-27 20:09:13,818][106226] Updated weights for policy 0, policy_version 128601 (0.0009) [2023-12-27 20:09:13,837][106225] Updated weights for policy 1, policy_version 128596 (0.0010) [2023-12-27 20:09:13,876][106226] Updated weights for policy 0, policy_version 128611 (0.0011) [2023-12-27 20:09:13,901][106225] Updated weights for policy 1, policy_version 128606 (0.0010) [2023-12-27 20:09:14,610][106225] Updated weights for policy 1, policy_version 128616 (0.0010) [2023-12-27 20:09:14,611][106226] Updated weights for policy 0, policy_version 128621 (0.0009) [2023-12-27 20:09:14,665][106226] Updated weights for policy 0, policy_version 128631 (0.0005) [2023-12-27 20:09:14,667][106225] Updated weights for policy 1, policy_version 128626 (0.0010) [2023-12-27 20:09:14,709][106226] Updated weights for policy 0, policy_version 128641 (0.0008) [2023-12-27 20:09:14,724][106225] Updated weights for policy 1, policy_version 128636 (0.0010) [2023-12-27 20:09:15,465][106225] Updated weights for policy 1, policy_version 128646 (0.0011) [2023-12-27 20:09:15,504][106226] Updated weights for policy 0, policy_version 128651 (0.0009) [2023-12-27 20:09:15,518][106225] Updated weights for policy 1, policy_version 128656 (0.0010) [2023-12-27 20:09:15,552][106226] Updated weights for policy 0, policy_version 128661 (0.0005) [2023-12-27 20:09:15,576][106225] Updated weights for policy 1, policy_version 128666 (0.0010) [2023-12-27 20:09:15,611][106226] Updated weights for policy 0, policy_version 128672 (0.0006) [2023-12-27 20:09:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 65896448. Throughput: 0: 9841.5, 1: 9848.4. Samples: 65888792. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-27 20:09:16,175][105115] Avg episode reward: [(0, '-5.536'), (1, '-6.514')] [2023-12-27 20:09:16,258][106226] Updated weights for policy 0, policy_version 128682 (0.0008) [2023-12-27 20:09:16,292][106225] Updated weights for policy 1, policy_version 128676 (0.0010) [2023-12-27 20:09:16,310][106226] Updated weights for policy 0, policy_version 128692 (0.0005) [2023-12-27 20:09:16,350][106225] Updated weights for policy 1, policy_version 128686 (0.0010) [2023-12-27 20:09:16,364][106226] Updated weights for policy 0, policy_version 128702 (0.0005) [2023-12-27 20:09:16,406][106225] Updated weights for policy 1, policy_version 128696 (0.0010) [2023-12-27 20:09:16,423][106226] Updated weights for policy 0, policy_version 128712 (0.0005) [2023-12-27 20:09:17,082][106226] Updated weights for policy 0, policy_version 128722 (0.0010) [2023-12-27 20:09:17,133][106225] Updated weights for policy 1, policy_version 128706 (0.0010) [2023-12-27 20:09:17,142][106226] Updated weights for policy 0, policy_version 128732 (0.0008) [2023-12-27 20:09:17,197][106225] Updated weights for policy 1, policy_version 128716 (0.0010) [2023-12-27 20:09:17,200][106226] Updated weights for policy 0, policy_version 128742 (0.0005) [2023-12-27 20:09:17,247][106225] Updated weights for policy 1, policy_version 128726 (0.0010) [2023-12-27 20:09:17,293][106225] Updated weights for policy 1, policy_version 128736 (0.0010) [2023-12-27 20:09:17,751][106226] Updated weights for policy 0, policy_version 128752 (0.0009) [2023-12-27 20:09:17,801][106226] Updated weights for policy 0, policy_version 128762 (0.0010) [2023-12-27 20:09:17,852][106226] Updated weights for policy 0, policy_version 128772 (0.0010) [2023-12-27 20:09:18,007][106225] Updated weights for policy 1, policy_version 128746 (0.0010) [2023-12-27 20:09:18,068][106225] Updated weights for policy 1, policy_version 128756 (0.0010) [2023-12-27 20:09:18,128][106225] Updated weights for policy 1, policy_version 128766 (0.0010) [2023-12-27 20:09:18,546][106226] Updated weights for policy 0, policy_version 128782 (0.0008) [2023-12-27 20:09:18,614][106226] Updated weights for policy 0, policy_version 128792 (0.0007) [2023-12-27 20:09:18,674][106226] Updated weights for policy 0, policy_version 128802 (0.0007) [2023-12-27 20:09:18,863][106225] Updated weights for policy 1, policy_version 128776 (0.0010) [2023-12-27 20:09:18,931][106225] Updated weights for policy 1, policy_version 128786 (0.0009) [2023-12-27 20:09:18,992][106225] Updated weights for policy 1, policy_version 128796 (0.0010) [2023-12-27 20:09:19,344][106226] Updated weights for policy 0, policy_version 128812 (0.0008) [2023-12-27 20:09:19,415][106226] Updated weights for policy 0, policy_version 128822 (0.0008) [2023-12-27 20:09:19,476][106226] Updated weights for policy 0, policy_version 128832 (0.0007) [2023-12-27 20:09:19,744][106225] Updated weights for policy 1, policy_version 128806 (0.0009) [2023-12-27 20:09:19,806][106225] Updated weights for policy 1, policy_version 128816 (0.0008) [2023-12-27 20:09:19,874][106225] Updated weights for policy 1, policy_version 128826 (0.0009) [2023-12-27 20:09:20,259][106226] Updated weights for policy 0, policy_version 128842 (0.0009) [2023-12-27 20:09:20,321][106226] Updated weights for policy 0, policy_version 128852 (0.0011) [2023-12-27 20:09:20,392][106226] Updated weights for policy 0, policy_version 128862 (0.0011) [2023-12-27 20:09:20,457][106226] Updated weights for policy 0, policy_version 128872 (0.0011) [2023-12-27 20:09:20,563][106225] Updated weights for policy 1, policy_version 128836 (0.0008) [2023-12-27 20:09:20,632][106225] Updated weights for policy 1, policy_version 128846 (0.0008) [2023-12-27 20:09:20,698][106225] Updated weights for policy 1, policy_version 128856 (0.0008) [2023-12-27 20:09:21,139][106226] Updated weights for policy 0, policy_version 128882 (0.0008) [2023-12-27 20:09:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 65994752. Throughput: 0: 9937.1, 1: 9757.4. Samples: 66006924. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:21,175][105115] Avg episode reward: [(0, '-5.398'), (1, '-6.538')] [2023-12-27 20:09:21,201][106226] Updated weights for policy 0, policy_version 128892 (0.0008) [2023-12-27 20:09:21,270][106226] Updated weights for policy 0, policy_version 128902 (0.0007) [2023-12-27 20:09:21,494][106225] Updated weights for policy 1, policy_version 128866 (0.0008) [2023-12-27 20:09:21,552][106225] Updated weights for policy 1, policy_version 128876 (0.0009) [2023-12-27 20:09:21,605][106225] Updated weights for policy 1, policy_version 128886 (0.0009) [2023-12-27 20:09:21,674][106225] Updated weights for policy 1, policy_version 128896 (0.0008) [2023-12-27 20:09:21,971][106226] Updated weights for policy 0, policy_version 128912 (0.0009) [2023-12-27 20:09:22,035][106226] Updated weights for policy 0, policy_version 128922 (0.0008) [2023-12-27 20:09:22,099][106226] Updated weights for policy 0, policy_version 128932 (0.0007) [2023-12-27 20:09:22,476][106225] Updated weights for policy 1, policy_version 128906 (0.0006) [2023-12-27 20:09:22,539][106225] Updated weights for policy 1, policy_version 128916 (0.0006) [2023-12-27 20:09:22,595][106225] Updated weights for policy 1, policy_version 128926 (0.0005) [2023-12-27 20:09:22,805][106226] Updated weights for policy 0, policy_version 128942 (0.0006) [2023-12-27 20:09:22,867][106226] Updated weights for policy 0, policy_version 128952 (0.0006) [2023-12-27 20:09:22,924][106226] Updated weights for policy 0, policy_version 128962 (0.0006) [2023-12-27 20:09:23,194][106225] Updated weights for policy 1, policy_version 128936 (0.0007) [2023-12-27 20:09:23,247][106225] Updated weights for policy 1, policy_version 128946 (0.0007) [2023-12-27 20:09:23,298][106225] Updated weights for policy 1, policy_version 128956 (0.0008) [2023-12-27 20:09:23,580][106226] Updated weights for policy 0, policy_version 128972 (0.0010) [2023-12-27 20:09:23,639][106226] Updated weights for policy 0, policy_version 128982 (0.0010) [2023-12-27 20:09:23,693][106226] Updated weights for policy 0, policy_version 128992 (0.0005) [2023-12-27 20:09:24,002][106225] Updated weights for policy 1, policy_version 128966 (0.0009) [2023-12-27 20:09:24,065][106225] Updated weights for policy 1, policy_version 128976 (0.0010) [2023-12-27 20:09:24,115][106225] Updated weights for policy 1, policy_version 128986 (0.0008) [2023-12-27 20:09:24,290][106226] Updated weights for policy 0, policy_version 129002 (0.0006) [2023-12-27 20:09:24,352][106226] Updated weights for policy 0, policy_version 129012 (0.0010) [2023-12-27 20:09:24,423][106226] Updated weights for policy 0, policy_version 129022 (0.0011) [2023-12-27 20:09:24,496][106226] Updated weights for policy 0, policy_version 129032 (0.0011) [2023-12-27 20:09:24,734][106225] Updated weights for policy 1, policy_version 128996 (0.0007) [2023-12-27 20:09:24,780][106225] Updated weights for policy 1, policy_version 129006 (0.0005) [2023-12-27 20:09:24,834][106225] Updated weights for policy 1, policy_version 129016 (0.0005) [2023-12-27 20:09:25,097][106226] Updated weights for policy 0, policy_version 129042 (0.0006) [2023-12-27 20:09:25,150][106226] Updated weights for policy 0, policy_version 129052 (0.0006) [2023-12-27 20:09:25,205][106226] Updated weights for policy 0, policy_version 129062 (0.0005) [2023-12-27 20:09:25,408][106225] Updated weights for policy 1, policy_version 129026 (0.0005) [2023-12-27 20:09:25,463][106225] Updated weights for policy 1, policy_version 129036 (0.0005) [2023-12-27 20:09:25,518][106225] Updated weights for policy 1, policy_version 129046 (0.0005) [2023-12-27 20:09:25,577][106225] Updated weights for policy 1, policy_version 129056 (0.0008) [2023-12-27 20:09:25,804][106226] Updated weights for policy 0, policy_version 129072 (0.0005) [2023-12-27 20:09:25,854][106226] Updated weights for policy 0, policy_version 129082 (0.0005) [2023-12-27 20:09:25,910][106226] Updated weights for policy 0, policy_version 129092 (0.0006) [2023-12-27 20:09:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 66101248. Throughput: 0: 9958.4, 1: 9720.0. Samples: 66066596. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:26,175][105115] Avg episode reward: [(0, '-5.339'), (1, '-6.795')] [2023-12-27 20:09:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000129096_33054720.pth... [2023-12-27 20:09:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000127912_32751616.pth [2023-12-27 20:09:26,214][106225] Updated weights for policy 1, policy_version 129066 (0.0005) [2023-12-27 20:09:26,259][106225] Updated weights for policy 1, policy_version 129076 (0.0005) [2023-12-27 20:09:26,303][106225] Updated weights for policy 1, policy_version 129086 (0.0005) [2023-12-27 20:09:26,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000129088_33054720.pth... [2023-12-27 20:09:26,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000127936_32759808.pth [2023-12-27 20:09:26,564][106226] Updated weights for policy 0, policy_version 129102 (0.0007) [2023-12-27 20:09:26,625][106226] Updated weights for policy 0, policy_version 129112 (0.0010) [2023-12-27 20:09:26,681][106226] Updated weights for policy 0, policy_version 129122 (0.0009) [2023-12-27 20:09:26,875][106225] Updated weights for policy 1, policy_version 129096 (0.0006) [2023-12-27 20:09:26,928][106225] Updated weights for policy 1, policy_version 129106 (0.0006) [2023-12-27 20:09:26,984][106225] Updated weights for policy 1, policy_version 129116 (0.0008) [2023-12-27 20:09:27,466][106226] Updated weights for policy 0, policy_version 129132 (0.0009) [2023-12-27 20:09:27,512][106226] Updated weights for policy 0, policy_version 129142 (0.0006) [2023-12-27 20:09:27,557][106226] Updated weights for policy 0, policy_version 129152 (0.0005) [2023-12-27 20:09:27,630][106225] Updated weights for policy 1, policy_version 129126 (0.0008) [2023-12-27 20:09:27,679][106225] Updated weights for policy 1, policy_version 129136 (0.0008) [2023-12-27 20:09:27,728][106225] Updated weights for policy 1, policy_version 129146 (0.0010) [2023-12-27 20:09:28,107][106226] Updated weights for policy 0, policy_version 129162 (0.0005) [2023-12-27 20:09:28,155][106226] Updated weights for policy 0, policy_version 129172 (0.0005) [2023-12-27 20:09:28,204][106226] Updated weights for policy 0, policy_version 129182 (0.0006) [2023-12-27 20:09:28,253][106226] Updated weights for policy 0, policy_version 129192 (0.0009) [2023-12-27 20:09:28,429][106225] Updated weights for policy 1, policy_version 129156 (0.0007) [2023-12-27 20:09:28,495][106225] Updated weights for policy 1, policy_version 129166 (0.0007) [2023-12-27 20:09:28,560][106225] Updated weights for policy 1, policy_version 129176 (0.0005) [2023-12-27 20:09:28,975][106226] Updated weights for policy 0, policy_version 129202 (0.0006) [2023-12-27 20:09:29,039][106226] Updated weights for policy 0, policy_version 129212 (0.0005) [2023-12-27 20:09:29,094][106226] Updated weights for policy 0, policy_version 129222 (0.0005) [2023-12-27 20:09:29,218][106225] Updated weights for policy 1, policy_version 129186 (0.0006) [2023-12-27 20:09:29,289][106225] Updated weights for policy 1, policy_version 129196 (0.0010) [2023-12-27 20:09:29,351][106225] Updated weights for policy 1, policy_version 129206 (0.0010) [2023-12-27 20:09:29,412][106225] Updated weights for policy 1, policy_version 129216 (0.0010) [2023-12-27 20:09:29,693][106226] Updated weights for policy 0, policy_version 129232 (0.0006) [2023-12-27 20:09:29,756][106226] Updated weights for policy 0, policy_version 129242 (0.0005) [2023-12-27 20:09:29,825][106226] Updated weights for policy 0, policy_version 129252 (0.0007) [2023-12-27 20:09:30,172][106225] Updated weights for policy 1, policy_version 129226 (0.0008) [2023-12-27 20:09:30,221][106225] Updated weights for policy 1, policy_version 129236 (0.0008) [2023-12-27 20:09:30,266][106225] Updated weights for policy 1, policy_version 129246 (0.0008) [2023-12-27 20:09:30,452][106226] Updated weights for policy 0, policy_version 129262 (0.0007) [2023-12-27 20:09:30,511][106226] Updated weights for policy 0, policy_version 129272 (0.0007) [2023-12-27 20:09:30,567][106226] Updated weights for policy 0, policy_version 129282 (0.0007) [2023-12-27 20:09:30,992][106225] Updated weights for policy 1, policy_version 129256 (0.0006) [2023-12-27 20:09:31,054][106225] Updated weights for policy 1, policy_version 129266 (0.0007) [2023-12-27 20:09:31,109][106225] Updated weights for policy 1, policy_version 129276 (0.0008) [2023-12-27 20:09:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 66207744. Throughput: 0: 10153.7, 1: 9833.1. Samples: 66195384. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:31,175][105115] Avg episode reward: [(0, '-5.560'), (1, '-6.964')] [2023-12-27 20:09:31,309][106226] Updated weights for policy 0, policy_version 129292 (0.0008) [2023-12-27 20:09:31,377][106226] Updated weights for policy 0, policy_version 129302 (0.0009) [2023-12-27 20:09:31,430][106226] Updated weights for policy 0, policy_version 129312 (0.0007) [2023-12-27 20:09:31,857][106225] Updated weights for policy 1, policy_version 129286 (0.0008) [2023-12-27 20:09:31,915][106225] Updated weights for policy 1, policy_version 129296 (0.0008) [2023-12-27 20:09:31,975][106225] Updated weights for policy 1, policy_version 129306 (0.0009) [2023-12-27 20:09:32,116][106226] Updated weights for policy 0, policy_version 129322 (0.0006) [2023-12-27 20:09:32,164][106226] Updated weights for policy 0, policy_version 129332 (0.0008) [2023-12-27 20:09:32,229][106226] Updated weights for policy 0, policy_version 129342 (0.0010) [2023-12-27 20:09:32,296][106226] Updated weights for policy 0, policy_version 129352 (0.0008) [2023-12-27 20:09:32,599][106225] Updated weights for policy 1, policy_version 129316 (0.0007) [2023-12-27 20:09:32,656][106225] Updated weights for policy 1, policy_version 129326 (0.0005) [2023-12-27 20:09:32,708][106225] Updated weights for policy 1, policy_version 129336 (0.0005) [2023-12-27 20:09:33,022][106226] Updated weights for policy 0, policy_version 129362 (0.0005) [2023-12-27 20:09:33,071][106226] Updated weights for policy 0, policy_version 129372 (0.0005) [2023-12-27 20:09:33,121][106226] Updated weights for policy 0, policy_version 129382 (0.0005) [2023-12-27 20:09:33,282][106225] Updated weights for policy 1, policy_version 129346 (0.0005) [2023-12-27 20:09:33,335][106225] Updated weights for policy 1, policy_version 129356 (0.0005) [2023-12-27 20:09:33,380][106225] Updated weights for policy 1, policy_version 129366 (0.0005) [2023-12-27 20:09:33,423][106225] Updated weights for policy 1, policy_version 129376 (0.0005) [2023-12-27 20:09:33,746][106226] Updated weights for policy 0, policy_version 129392 (0.0007) [2023-12-27 20:09:33,801][106226] Updated weights for policy 0, policy_version 129402 (0.0005) [2023-12-27 20:09:33,855][106226] Updated weights for policy 0, policy_version 129412 (0.0005) [2023-12-27 20:09:33,952][106225] Updated weights for policy 1, policy_version 129386 (0.0008) [2023-12-27 20:09:34,011][106225] Updated weights for policy 1, policy_version 129396 (0.0010) [2023-12-27 20:09:34,068][106225] Updated weights for policy 1, policy_version 129406 (0.0010) [2023-12-27 20:09:34,524][106226] Updated weights for policy 0, policy_version 129422 (0.0005) [2023-12-27 20:09:34,590][106226] Updated weights for policy 0, policy_version 129432 (0.0005) [2023-12-27 20:09:34,649][106226] Updated weights for policy 0, policy_version 129442 (0.0007) [2023-12-27 20:09:34,813][106225] Updated weights for policy 1, policy_version 129416 (0.0007) [2023-12-27 20:09:34,876][106225] Updated weights for policy 1, policy_version 129426 (0.0005) [2023-12-27 20:09:34,932][106225] Updated weights for policy 1, policy_version 129436 (0.0005) [2023-12-27 20:09:35,285][106226] Updated weights for policy 0, policy_version 129452 (0.0009) [2023-12-27 20:09:35,344][106226] Updated weights for policy 0, policy_version 129462 (0.0008) [2023-12-27 20:09:35,404][106226] Updated weights for policy 0, policy_version 129472 (0.0010) [2023-12-27 20:09:35,541][106225] Updated weights for policy 1, policy_version 129446 (0.0007) [2023-12-27 20:09:35,593][106225] Updated weights for policy 1, policy_version 129456 (0.0008) [2023-12-27 20:09:35,656][106225] Updated weights for policy 1, policy_version 129466 (0.0006) [2023-12-27 20:09:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 66306048. Throughput: 0: 10143.2, 1: 9914.2. Samples: 66318404. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:36,175][105115] Avg episode reward: [(0, '-5.230'), (1, '-6.882')] [2023-12-27 20:09:36,178][106226] Updated weights for policy 0, policy_version 129482 (0.0009) [2023-12-27 20:09:36,246][106226] Updated weights for policy 0, policy_version 129492 (0.0011) [2023-12-27 20:09:36,308][106226] Updated weights for policy 0, policy_version 129502 (0.0011) [2023-12-27 20:09:36,352][106225] Updated weights for policy 1, policy_version 129476 (0.0006) [2023-12-27 20:09:36,369][106226] Updated weights for policy 0, policy_version 129512 (0.0011) [2023-12-27 20:09:36,416][106225] Updated weights for policy 1, policy_version 129486 (0.0008) [2023-12-27 20:09:36,475][106225] Updated weights for policy 1, policy_version 129496 (0.0008) [2023-12-27 20:09:37,030][106226] Updated weights for policy 0, policy_version 129522 (0.0006) [2023-12-27 20:09:37,075][106226] Updated weights for policy 0, policy_version 129532 (0.0007) [2023-12-27 20:09:37,122][106226] Updated weights for policy 0, policy_version 129542 (0.0008) [2023-12-27 20:09:37,174][106225] Updated weights for policy 1, policy_version 129506 (0.0008) [2023-12-27 20:09:37,224][106225] Updated weights for policy 1, policy_version 129516 (0.0009) [2023-12-27 20:09:37,292][106225] Updated weights for policy 1, policy_version 129526 (0.0011) [2023-12-27 20:09:37,352][106225] Updated weights for policy 1, policy_version 129536 (0.0006) [2023-12-27 20:09:37,814][106226] Updated weights for policy 0, policy_version 129552 (0.0006) [2023-12-27 20:09:37,883][106226] Updated weights for policy 0, policy_version 129562 (0.0006) [2023-12-27 20:09:37,930][106226] Updated weights for policy 0, policy_version 129572 (0.0005) [2023-12-27 20:09:38,010][106225] Updated weights for policy 1, policy_version 129546 (0.0010) [2023-12-27 20:09:38,063][106225] Updated weights for policy 1, policy_version 129556 (0.0010) [2023-12-27 20:09:38,113][106225] Updated weights for policy 1, policy_version 129566 (0.0010) [2023-12-27 20:09:38,554][106226] Updated weights for policy 0, policy_version 129582 (0.0007) [2023-12-27 20:09:38,622][106226] Updated weights for policy 0, policy_version 129592 (0.0009) [2023-12-27 20:09:38,683][106226] Updated weights for policy 0, policy_version 129602 (0.0008) [2023-12-27 20:09:38,867][106225] Updated weights for policy 1, policy_version 129576 (0.0008) [2023-12-27 20:09:38,929][106225] Updated weights for policy 1, policy_version 129586 (0.0005) [2023-12-27 20:09:38,987][106225] Updated weights for policy 1, policy_version 129596 (0.0006) [2023-12-27 20:09:39,418][106226] Updated weights for policy 0, policy_version 129612 (0.0009) [2023-12-27 20:09:39,484][106226] Updated weights for policy 0, policy_version 129622 (0.0010) [2023-12-27 20:09:39,544][106226] Updated weights for policy 0, policy_version 129632 (0.0011) [2023-12-27 20:09:39,641][106225] Updated weights for policy 1, policy_version 129606 (0.0007) [2023-12-27 20:09:39,705][106225] Updated weights for policy 1, policy_version 129616 (0.0008) [2023-12-27 20:09:39,774][106225] Updated weights for policy 1, policy_version 129626 (0.0009) [2023-12-27 20:09:40,216][106226] Updated weights for policy 0, policy_version 129642 (0.0009) [2023-12-27 20:09:40,273][106226] Updated weights for policy 0, policy_version 129652 (0.0008) [2023-12-27 20:09:40,336][106226] Updated weights for policy 0, policy_version 129662 (0.0008) [2023-12-27 20:09:40,397][106226] Updated weights for policy 0, policy_version 129672 (0.0009) [2023-12-27 20:09:40,524][106225] Updated weights for policy 1, policy_version 129636 (0.0009) [2023-12-27 20:09:40,584][106225] Updated weights for policy 1, policy_version 129646 (0.0008) [2023-12-27 20:09:40,638][106225] Updated weights for policy 1, policy_version 129656 (0.0005) [2023-12-27 20:09:41,134][106226] Updated weights for policy 0, policy_version 129682 (0.0009) [2023-12-27 20:09:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 66404352. Throughput: 0: 10144.7, 1: 9969.8. Samples: 66378592. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:41,175][105115] Avg episode reward: [(0, '-5.513'), (1, '-7.157')] [2023-12-27 20:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000129664_33202176.pth... [2023-12-27 20:09:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000128480_32899072.pth [2023-12-27 20:09:41,204][106226] Updated weights for policy 0, policy_version 129692 (0.0008) [2023-12-27 20:09:41,269][106226] Updated weights for policy 0, policy_version 129702 (0.0006) [2023-12-27 20:09:41,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000129704_33210368.pth... [2023-12-27 20:09:41,286][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000128488_32899072.pth [2023-12-27 20:09:41,346][106225] Updated weights for policy 1, policy_version 129666 (0.0006) [2023-12-27 20:09:41,425][106225] Updated weights for policy 1, policy_version 129676 (0.0009) [2023-12-27 20:09:41,483][106225] Updated weights for policy 1, policy_version 129686 (0.0008) [2023-12-27 20:09:41,548][106225] Updated weights for policy 1, policy_version 129696 (0.0009) [2023-12-27 20:09:41,990][106226] Updated weights for policy 0, policy_version 129712 (0.0008) [2023-12-27 20:09:42,043][106226] Updated weights for policy 0, policy_version 129722 (0.0007) [2023-12-27 20:09:42,094][106226] Updated weights for policy 0, policy_version 129732 (0.0008) [2023-12-27 20:09:42,337][106225] Updated weights for policy 1, policy_version 129706 (0.0009) [2023-12-27 20:09:42,421][106225] Updated weights for policy 1, policy_version 129716 (0.0009) [2023-12-27 20:09:42,485][106225] Updated weights for policy 1, policy_version 129726 (0.0009) [2023-12-27 20:09:42,810][106226] Updated weights for policy 0, policy_version 129742 (0.0007) [2023-12-27 20:09:42,874][106226] Updated weights for policy 0, policy_version 129752 (0.0009) [2023-12-27 20:09:42,938][106226] Updated weights for policy 0, policy_version 129762 (0.0010) [2023-12-27 20:09:43,120][106225] Updated weights for policy 1, policy_version 129736 (0.0010) [2023-12-27 20:09:43,179][106225] Updated weights for policy 1, policy_version 129746 (0.0009) [2023-12-27 20:09:43,246][106225] Updated weights for policy 1, policy_version 129756 (0.0005) [2023-12-27 20:09:43,729][106226] Updated weights for policy 0, policy_version 129772 (0.0008) [2023-12-27 20:09:43,781][106226] Updated weights for policy 0, policy_version 129782 (0.0008) [2023-12-27 20:09:43,804][106225] Updated weights for policy 1, policy_version 129766 (0.0008) [2023-12-27 20:09:43,842][106226] Updated weights for policy 0, policy_version 129792 (0.0009) [2023-12-27 20:09:43,860][106225] Updated weights for policy 1, policy_version 129776 (0.0010) [2023-12-27 20:09:43,917][106225] Updated weights for policy 1, policy_version 129786 (0.0010) [2023-12-27 20:09:44,513][106225] Updated weights for policy 1, policy_version 129796 (0.0007) [2023-12-27 20:09:44,554][106226] Updated weights for policy 0, policy_version 129802 (0.0008) [2023-12-27 20:09:44,563][106225] Updated weights for policy 1, policy_version 129806 (0.0010) [2023-12-27 20:09:44,610][106226] Updated weights for policy 0, policy_version 129812 (0.0005) [2023-12-27 20:09:44,619][106225] Updated weights for policy 1, policy_version 129816 (0.0010) [2023-12-27 20:09:44,665][106226] Updated weights for policy 0, policy_version 129822 (0.0006) [2023-12-27 20:09:44,728][106226] Updated weights for policy 0, policy_version 129832 (0.0006) [2023-12-27 20:09:45,425][106225] Updated weights for policy 1, policy_version 129826 (0.0009) [2023-12-27 20:09:45,427][106226] Updated weights for policy 0, policy_version 129842 (0.0011) [2023-12-27 20:09:45,491][106226] Updated weights for policy 0, policy_version 129852 (0.0011) [2023-12-27 20:09:45,495][106225] Updated weights for policy 1, policy_version 129836 (0.0008) [2023-12-27 20:09:45,547][106226] Updated weights for policy 0, policy_version 129862 (0.0009) [2023-12-27 20:09:45,564][106225] Updated weights for policy 1, policy_version 129846 (0.0008) [2023-12-27 20:09:45,626][106225] Updated weights for policy 1, policy_version 129856 (0.0009) [2023-12-27 20:09:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 66502656. Throughput: 0: 10085.6, 1: 10034.9. Samples: 66496796. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:46,175][105115] Avg episode reward: [(0, '-5.477'), (1, '-7.244')] [2023-12-27 20:09:46,242][106226] Updated weights for policy 0, policy_version 129872 (0.0007) [2023-12-27 20:09:46,290][106225] Updated weights for policy 1, policy_version 129866 (0.0006) [2023-12-27 20:09:46,292][106226] Updated weights for policy 0, policy_version 129882 (0.0010) [2023-12-27 20:09:46,341][106226] Updated weights for policy 0, policy_version 129892 (0.0010) [2023-12-27 20:09:46,348][106225] Updated weights for policy 1, policy_version 129876 (0.0006) [2023-12-27 20:09:46,415][106225] Updated weights for policy 1, policy_version 129886 (0.0006) [2023-12-27 20:09:47,053][106226] Updated weights for policy 0, policy_version 129902 (0.0010) [2023-12-27 20:09:47,070][106225] Updated weights for policy 1, policy_version 129896 (0.0008) [2023-12-27 20:09:47,100][106226] Updated weights for policy 0, policy_version 129912 (0.0010) [2023-12-27 20:09:47,125][106225] Updated weights for policy 1, policy_version 129906 (0.0009) [2023-12-27 20:09:47,157][106226] Updated weights for policy 0, policy_version 129922 (0.0009) [2023-12-27 20:09:47,179][106225] Updated weights for policy 1, policy_version 129916 (0.0009) [2023-12-27 20:09:47,795][106225] Updated weights for policy 1, policy_version 129926 (0.0008) [2023-12-27 20:09:47,852][106225] Updated weights for policy 1, policy_version 129936 (0.0010) [2023-12-27 20:09:47,854][106226] Updated weights for policy 0, policy_version 129932 (0.0010) [2023-12-27 20:09:47,911][106225] Updated weights for policy 1, policy_version 129946 (0.0010) [2023-12-27 20:09:47,912][106226] Updated weights for policy 0, policy_version 129942 (0.0010) [2023-12-27 20:09:47,968][106226] Updated weights for policy 0, policy_version 129952 (0.0010) [2023-12-27 20:09:48,553][106225] Updated weights for policy 1, policy_version 129956 (0.0010) [2023-12-27 20:09:48,615][106225] Updated weights for policy 1, policy_version 129966 (0.0009) [2023-12-27 20:09:48,617][106226] Updated weights for policy 0, policy_version 129962 (0.0010) [2023-12-27 20:09:48,669][106225] Updated weights for policy 1, policy_version 129976 (0.0010) [2023-12-27 20:09:48,677][106226] Updated weights for policy 0, policy_version 129972 (0.0011) [2023-12-27 20:09:48,741][106226] Updated weights for policy 0, policy_version 129982 (0.0011) [2023-12-27 20:09:48,805][106226] Updated weights for policy 0, policy_version 129992 (0.0011) [2023-12-27 20:09:49,404][106225] Updated weights for policy 1, policy_version 129986 (0.0010) [2023-12-27 20:09:49,466][106225] Updated weights for policy 1, policy_version 129996 (0.0011) [2023-12-27 20:09:49,528][106225] Updated weights for policy 1, policy_version 130006 (0.0011) [2023-12-27 20:09:49,537][106226] Updated weights for policy 0, policy_version 130002 (0.0011) [2023-12-27 20:09:49,589][106225] Updated weights for policy 1, policy_version 130016 (0.0011) [2023-12-27 20:09:49,595][106226] Updated weights for policy 0, policy_version 130012 (0.0011) [2023-12-27 20:09:49,660][106226] Updated weights for policy 0, policy_version 130022 (0.0011) [2023-12-27 20:09:50,348][106225] Updated weights for policy 1, policy_version 130026 (0.0009) [2023-12-27 20:09:50,406][106225] Updated weights for policy 1, policy_version 130036 (0.0009) [2023-12-27 20:09:50,413][106226] Updated weights for policy 0, policy_version 130032 (0.0009) [2023-12-27 20:09:50,462][106225] Updated weights for policy 1, policy_version 130046 (0.0007) [2023-12-27 20:09:50,471][106226] Updated weights for policy 0, policy_version 130042 (0.0006) [2023-12-27 20:09:50,531][106226] Updated weights for policy 0, policy_version 130052 (0.0007) [2023-12-27 20:09:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 66600960. Throughput: 0: 10002.3, 1: 10053.2. Samples: 66614916. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:51,175][105115] Avg episode reward: [(0, '-5.333'), (1, '-6.809')] [2023-12-27 20:09:51,204][106225] Updated weights for policy 1, policy_version 130056 (0.0009) [2023-12-27 20:09:51,271][106225] Updated weights for policy 1, policy_version 130066 (0.0007) [2023-12-27 20:09:51,284][106226] Updated weights for policy 0, policy_version 130062 (0.0007) [2023-12-27 20:09:51,325][106225] Updated weights for policy 1, policy_version 130076 (0.0008) [2023-12-27 20:09:51,344][106226] Updated weights for policy 0, policy_version 130072 (0.0005) [2023-12-27 20:09:51,416][106226] Updated weights for policy 0, policy_version 130082 (0.0008) [2023-12-27 20:09:52,092][106225] Updated weights for policy 1, policy_version 130086 (0.0008) [2023-12-27 20:09:52,145][106226] Updated weights for policy 0, policy_version 130092 (0.0007) [2023-12-27 20:09:52,153][106225] Updated weights for policy 1, policy_version 130096 (0.0007) [2023-12-27 20:09:52,203][106226] Updated weights for policy 0, policy_version 130102 (0.0007) [2023-12-27 20:09:52,212][106225] Updated weights for policy 1, policy_version 130106 (0.0007) [2023-12-27 20:09:52,262][106226] Updated weights for policy 0, policy_version 130112 (0.0006) [2023-12-27 20:09:52,891][106225] Updated weights for policy 1, policy_version 130116 (0.0007) [2023-12-27 20:09:52,940][106225] Updated weights for policy 1, policy_version 130126 (0.0008) [2023-12-27 20:09:52,989][106225] Updated weights for policy 1, policy_version 130136 (0.0008) [2023-12-27 20:09:53,014][106226] Updated weights for policy 0, policy_version 130122 (0.0010) [2023-12-27 20:09:53,070][106226] Updated weights for policy 0, policy_version 130132 (0.0006) [2023-12-27 20:09:53,134][106226] Updated weights for policy 0, policy_version 130142 (0.0009) [2023-12-27 20:09:53,146][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000009 [2023-12-27 20:09:53,631][106225] Updated weights for policy 1, policy_version 130146 (0.0007) [2023-12-27 20:09:53,689][106225] Updated weights for policy 1, policy_version 130156 (0.0009) [2023-12-27 20:09:53,744][106225] Updated weights for policy 1, policy_version 130166 (0.0008) [2023-12-27 20:09:53,803][106225] Updated weights for policy 1, policy_version 130176 (0.0008) [2023-12-27 20:09:53,902][106226] Updated weights for policy 0, policy_version 130152 (0.0009) [2023-12-27 20:09:53,956][106226] Updated weights for policy 0, policy_version 130162 (0.0005) [2023-12-27 20:09:54,016][106226] Updated weights for policy 0, policy_version 130172 (0.0005) [2023-12-27 20:09:54,579][106225] Updated weights for policy 1, policy_version 130186 (0.0008) [2023-12-27 20:09:54,623][106225] Updated weights for policy 1, policy_version 130196 (0.0008) [2023-12-27 20:09:54,651][106226] Updated weights for policy 0, policy_version 130182 (0.0009) [2023-12-27 20:09:54,669][106225] Updated weights for policy 1, policy_version 130206 (0.0007) [2023-12-27 20:09:54,704][106226] Updated weights for policy 0, policy_version 130192 (0.0009) [2023-12-27 20:09:54,760][106226] Updated weights for policy 0, policy_version 130202 (0.0009) [2023-12-27 20:09:55,393][106225] Updated weights for policy 1, policy_version 130216 (0.0009) [2023-12-27 20:09:55,449][106225] Updated weights for policy 1, policy_version 130226 (0.0005) [2023-12-27 20:09:55,508][106225] Updated weights for policy 1, policy_version 130236 (0.0007) [2023-12-27 20:09:55,521][106226] Updated weights for policy 0, policy_version 130212 (0.0007) [2023-12-27 20:09:55,579][106226] Updated weights for policy 0, policy_version 130222 (0.0008) [2023-12-27 20:09:55,629][106226] Updated weights for policy 0, policy_version 130232 (0.0009) [2023-12-27 20:09:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 66699264. Throughput: 0: 9991.8, 1: 10025.2. Samples: 66673348. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:09:56,175][105115] Avg episode reward: [(0, '-5.165'), (1, '-6.948')] [2023-12-27 20:09:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000130240_33349632.pth... [2023-12-27 20:09:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000129096_33054720.pth [2023-12-27 20:09:56,208][106225] Updated weights for policy 1, policy_version 130246 (0.0008) [2023-12-27 20:09:56,265][106225] Updated weights for policy 1, policy_version 130256 (0.0010) [2023-12-27 20:09:56,332][106225] Updated weights for policy 1, policy_version 130266 (0.0005) [2023-12-27 20:09:56,366][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000130272_33357824.pth... [2023-12-27 20:09:56,370][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000129088_33054720.pth [2023-12-27 20:09:56,379][106226] Updated weights for policy 0, policy_version 130242 (0.0008) [2023-12-27 20:09:56,430][106226] Updated weights for policy 0, policy_version 130252 (0.0009) [2023-12-27 20:09:56,482][106226] Updated weights for policy 0, policy_version 130262 (0.0008) [2023-12-27 20:09:56,543][106226] Updated weights for policy 0, policy_version 130272 (0.0008) [2023-12-27 20:09:56,984][106225] Updated weights for policy 1, policy_version 130276 (0.0009) [2023-12-27 20:09:57,041][106225] Updated weights for policy 1, policy_version 130286 (0.0008) [2023-12-27 20:09:57,098][106225] Updated weights for policy 1, policy_version 130296 (0.0007) [2023-12-27 20:09:57,128][106226] Updated weights for policy 0, policy_version 130282 (0.0009) [2023-12-27 20:09:57,180][106226] Updated weights for policy 0, policy_version 130292 (0.0008) [2023-12-27 20:09:57,244][106226] Updated weights for policy 0, policy_version 130302 (0.0009) [2023-12-27 20:09:57,760][106225] Updated weights for policy 1, policy_version 130306 (0.0006) [2023-12-27 20:09:57,814][106225] Updated weights for policy 1, policy_version 130316 (0.0008) [2023-12-27 20:09:57,858][106225] Updated weights for policy 1, policy_version 130326 (0.0008) [2023-12-27 20:09:57,905][106225] Updated weights for policy 1, policy_version 130336 (0.0008) [2023-12-27 20:09:58,002][106226] Updated weights for policy 0, policy_version 130312 (0.0009) [2023-12-27 20:09:58,066][106226] Updated weights for policy 0, policy_version 130322 (0.0009) [2023-12-27 20:09:58,138][106226] Updated weights for policy 0, policy_version 130332 (0.0010) [2023-12-27 20:09:58,637][106225] Updated weights for policy 1, policy_version 130346 (0.0007) [2023-12-27 20:09:58,707][106225] Updated weights for policy 1, policy_version 130356 (0.0008) [2023-12-27 20:09:58,979][106226] Updated weights for policy 0, policy_version 130342 (0.0007) [2023-12-27 20:09:59,042][106226] Updated weights for policy 0, policy_version 130352 (0.0010) [2023-12-27 20:09:59,116][106226] Updated weights for policy 0, policy_version 130362 (0.0011) [2023-12-27 20:09:59,523][106225] Updated weights for policy 1, policy_version 130369 (0.0013) [2023-12-27 20:09:59,583][106225] Updated weights for policy 1, policy_version 130379 (0.0008) [2023-12-27 20:09:59,645][106225] Updated weights for policy 1, policy_version 130389 (0.0008) [2023-12-27 20:09:59,703][106225] Updated weights for policy 1, policy_version 130399 (0.0008) [2023-12-27 20:09:59,816][106226] Updated weights for policy 0, policy_version 130372 (0.0010) [2023-12-27 20:09:59,882][106226] Updated weights for policy 0, policy_version 130382 (0.0007) [2023-12-27 20:09:59,936][106226] Updated weights for policy 0, policy_version 130392 (0.0006) [2023-12-27 20:10:00,454][106225] Updated weights for policy 1, policy_version 130409 (0.0008) [2023-12-27 20:10:00,505][106225] Updated weights for policy 1, policy_version 130419 (0.0008) [2023-12-27 20:10:00,556][106225] Updated weights for policy 1, policy_version 130429 (0.0008) [2023-12-27 20:10:00,587][106226] Updated weights for policy 0, policy_version 130402 (0.0007) [2023-12-27 20:10:00,638][106226] Updated weights for policy 0, policy_version 130412 (0.0010) [2023-12-27 20:10:00,698][106226] Updated weights for policy 0, policy_version 130422 (0.0010) [2023-12-27 20:10:00,756][106226] Updated weights for policy 0, policy_version 130432 (0.0008) [2023-12-27 20:10:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 66797568. Throughput: 0: 9978.1, 1: 10031.6. Samples: 66789232. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:10:01,175][105115] Avg episode reward: [(0, '-5.340'), (1, '-7.120')] [2023-12-27 20:10:01,225][106225] Updated weights for policy 1, policy_version 130439 (0.0007) [2023-12-27 20:10:01,286][106225] Updated weights for policy 1, policy_version 130449 (0.0008) [2023-12-27 20:10:01,349][106225] Updated weights for policy 1, policy_version 130459 (0.0008) [2023-12-27 20:10:01,428][106226] Updated weights for policy 0, policy_version 130442 (0.0010) [2023-12-27 20:10:01,476][106226] Updated weights for policy 0, policy_version 130452 (0.0010) [2023-12-27 20:10:01,526][106226] Updated weights for policy 0, policy_version 130462 (0.0008) [2023-12-27 20:10:02,085][106225] Updated weights for policy 1, policy_version 130469 (0.0007) [2023-12-27 20:10:02,156][106225] Updated weights for policy 1, policy_version 130479 (0.0005) [2023-12-27 20:10:02,220][106225] Updated weights for policy 1, policy_version 130489 (0.0005) [2023-12-27 20:10:02,360][106226] Updated weights for policy 0, policy_version 130472 (0.0009) [2023-12-27 20:10:02,431][106226] Updated weights for policy 0, policy_version 130482 (0.0006) [2023-12-27 20:10:02,496][106226] Updated weights for policy 0, policy_version 130492 (0.0008) [2023-12-27 20:10:02,882][106225] Updated weights for policy 1, policy_version 130499 (0.0007) [2023-12-27 20:10:02,938][106225] Updated weights for policy 1, policy_version 130509 (0.0008) [2023-12-27 20:10:02,992][106225] Updated weights for policy 1, policy_version 130519 (0.0008) [2023-12-27 20:10:03,161][106226] Updated weights for policy 0, policy_version 130502 (0.0008) [2023-12-27 20:10:03,219][106226] Updated weights for policy 0, policy_version 130512 (0.0006) [2023-12-27 20:10:03,283][106226] Updated weights for policy 0, policy_version 130522 (0.0005) [2023-12-27 20:10:03,724][106225] Updated weights for policy 1, policy_version 130529 (0.0008) [2023-12-27 20:10:03,776][106225] Updated weights for policy 1, policy_version 130539 (0.0009) [2023-12-27 20:10:03,826][106225] Updated weights for policy 1, policy_version 130549 (0.0009) [2023-12-27 20:10:03,886][106225] Updated weights for policy 1, policy_version 130559 (0.0009) [2023-12-27 20:10:03,922][106226] Updated weights for policy 0, policy_version 130532 (0.0007) [2023-12-27 20:10:03,976][106226] Updated weights for policy 0, policy_version 130542 (0.0009) [2023-12-27 20:10:04,025][106226] Updated weights for policy 0, policy_version 130552 (0.0009) [2023-12-27 20:10:04,661][106225] Updated weights for policy 1, policy_version 130569 (0.0008) [2023-12-27 20:10:04,721][106225] Updated weights for policy 1, policy_version 130579 (0.0008) [2023-12-27 20:10:04,731][106226] Updated weights for policy 0, policy_version 130562 (0.0008) [2023-12-27 20:10:04,782][106225] Updated weights for policy 1, policy_version 130589 (0.0008) [2023-12-27 20:10:04,789][106226] Updated weights for policy 0, policy_version 130572 (0.0007) [2023-12-27 20:10:04,840][106226] Updated weights for policy 0, policy_version 130582 (0.0005) [2023-12-27 20:10:04,896][106226] Updated weights for policy 0, policy_version 130592 (0.0005) [2023-12-27 20:10:05,527][106225] Updated weights for policy 1, policy_version 130599 (0.0010) [2023-12-27 20:10:05,537][106226] Updated weights for policy 0, policy_version 130602 (0.0007) [2023-12-27 20:10:05,586][106225] Updated weights for policy 1, policy_version 130609 (0.0010) [2023-12-27 20:10:05,595][106226] Updated weights for policy 0, policy_version 130612 (0.0007) [2023-12-27 20:10:05,642][106225] Updated weights for policy 1, policy_version 130619 (0.0010) [2023-12-27 20:10:05,645][106226] Updated weights for policy 0, policy_version 130622 (0.0007) [2023-12-27 20:10:06,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.7, 300 sec: 19799.6). Total num frames: 66895872. Throughput: 0: 9982.6, 1: 10050.3. Samples: 66908408. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:10:06,176][105115] Avg episode reward: [(0, '-5.491'), (1, '-6.773')] [2023-12-27 20:10:06,312][106226] Updated weights for policy 0, policy_version 130632 (0.0008) [2023-12-27 20:10:06,375][106226] Updated weights for policy 0, policy_version 130642 (0.0008) [2023-12-27 20:10:06,422][106225] Updated weights for policy 1, policy_version 130629 (0.0010) [2023-12-27 20:10:06,435][106226] Updated weights for policy 0, policy_version 130652 (0.0006) [2023-12-27 20:10:06,483][106225] Updated weights for policy 1, policy_version 130639 (0.0009) [2023-12-27 20:10:06,545][106225] Updated weights for policy 1, policy_version 130649 (0.0008) [2023-12-27 20:10:07,150][106226] Updated weights for policy 0, policy_version 130662 (0.0007) [2023-12-27 20:10:07,210][106226] Updated weights for policy 0, policy_version 130672 (0.0008) [2023-12-27 20:10:07,239][106225] Updated weights for policy 1, policy_version 130659 (0.0010) [2023-12-27 20:10:07,272][106226] Updated weights for policy 0, policy_version 130682 (0.0008) [2023-12-27 20:10:07,285][106225] Updated weights for policy 1, policy_version 130669 (0.0010) [2023-12-27 20:10:07,335][106225] Updated weights for policy 1, policy_version 130679 (0.0010) [2023-12-27 20:10:07,996][106226] Updated weights for policy 0, policy_version 130692 (0.0006) [2023-12-27 20:10:08,050][106226] Updated weights for policy 0, policy_version 130702 (0.0008) [2023-12-27 20:10:08,075][106225] Updated weights for policy 1, policy_version 130689 (0.0010) [2023-12-27 20:10:08,111][106226] Updated weights for policy 0, policy_version 130712 (0.0006) [2023-12-27 20:10:08,128][106225] Updated weights for policy 1, policy_version 130699 (0.0010) [2023-12-27 20:10:08,172][106225] Updated weights for policy 1, policy_version 130709 (0.0010) [2023-12-27 20:10:08,225][106225] Updated weights for policy 1, policy_version 130719 (0.0010) [2023-12-27 20:10:08,835][106226] Updated weights for policy 0, policy_version 130722 (0.0006) [2023-12-27 20:10:08,897][106226] Updated weights for policy 0, policy_version 130732 (0.0006) [2023-12-27 20:10:08,912][106225] Updated weights for policy 1, policy_version 130729 (0.0006) [2023-12-27 20:10:08,960][106226] Updated weights for policy 0, policy_version 130742 (0.0008) [2023-12-27 20:10:08,968][106225] Updated weights for policy 1, policy_version 130739 (0.0006) [2023-12-27 20:10:09,022][106225] Updated weights for policy 1, policy_version 130749 (0.0005) [2023-12-27 20:10:09,023][106226] Updated weights for policy 0, policy_version 130752 (0.0008) [2023-12-27 20:10:09,681][106225] Updated weights for policy 1, policy_version 130759 (0.0007) [2023-12-27 20:10:09,748][106225] Updated weights for policy 1, policy_version 130769 (0.0008) [2023-12-27 20:10:09,800][106226] Updated weights for policy 0, policy_version 130762 (0.0006) [2023-12-27 20:10:09,803][106225] Updated weights for policy 1, policy_version 130779 (0.0008) [2023-12-27 20:10:09,866][106226] Updated weights for policy 0, policy_version 130772 (0.0008) [2023-12-27 20:10:09,943][106226] Updated weights for policy 0, policy_version 130782 (0.0009) [2023-12-27 20:10:10,588][106226] Updated weights for policy 0, policy_version 130792 (0.0007) [2023-12-27 20:10:10,612][106225] Updated weights for policy 1, policy_version 130789 (0.0010) [2023-12-27 20:10:10,643][106226] Updated weights for policy 0, policy_version 130802 (0.0008) [2023-12-27 20:10:10,661][106225] Updated weights for policy 1, policy_version 130799 (0.0007) [2023-12-27 20:10:10,706][106226] Updated weights for policy 0, policy_version 130812 (0.0008) [2023-12-27 20:10:10,715][106225] Updated weights for policy 1, policy_version 130809 (0.0005) [2023-12-27 20:10:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 66994176. Throughput: 0: 9937.6, 1: 10051.4. Samples: 66966100. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:10:11,175][105115] Avg episode reward: [(0, '-5.479'), (1, '-6.779')] [2023-12-27 20:10:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000130816_33497088.pth... [2023-12-27 20:10:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000130816_33497088.pth... [2023-12-27 20:10:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000129704_33210368.pth [2023-12-27 20:10:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000129664_33202176.pth [2023-12-27 20:10:11,404][106225] Updated weights for policy 1, policy_version 130819 (0.0007) [2023-12-27 20:10:11,449][106226] Updated weights for policy 0, policy_version 130822 (0.0009) [2023-12-27 20:10:11,470][106225] Updated weights for policy 1, policy_version 130829 (0.0006) [2023-12-27 20:10:11,503][106226] Updated weights for policy 0, policy_version 130832 (0.0008) [2023-12-27 20:10:11,541][106225] Updated weights for policy 1, policy_version 130839 (0.0006) [2023-12-27 20:10:11,562][106226] Updated weights for policy 0, policy_version 130842 (0.0008) [2023-12-27 20:10:12,207][106225] Updated weights for policy 1, policy_version 130849 (0.0006) [2023-12-27 20:10:12,269][106225] Updated weights for policy 1, policy_version 130859 (0.0008) [2023-12-27 20:10:12,333][106225] Updated weights for policy 1, policy_version 130869 (0.0007) [2023-12-27 20:10:12,374][106226] Updated weights for policy 0, policy_version 130852 (0.0009) [2023-12-27 20:10:12,402][106225] Updated weights for policy 1, policy_version 130879 (0.0007) [2023-12-27 20:10:12,442][106226] Updated weights for policy 0, policy_version 130862 (0.0011) [2023-12-27 20:10:12,507][106226] Updated weights for policy 0, policy_version 130872 (0.0011) [2023-12-27 20:10:13,104][106225] Updated weights for policy 1, policy_version 130889 (0.0010) [2023-12-27 20:10:13,157][106225] Updated weights for policy 1, policy_version 130899 (0.0009) [2023-12-27 20:10:13,219][106225] Updated weights for policy 1, policy_version 130909 (0.0008) [2023-12-27 20:10:13,225][106226] Updated weights for policy 0, policy_version 130882 (0.0011) [2023-12-27 20:10:13,275][106226] Updated weights for policy 0, policy_version 130892 (0.0010) [2023-12-27 20:10:13,331][106226] Updated weights for policy 0, policy_version 130902 (0.0010) [2023-12-27 20:10:13,377][106226] Updated weights for policy 0, policy_version 130912 (0.0010) [2023-12-27 20:10:13,853][106225] Updated weights for policy 1, policy_version 130919 (0.0007) [2023-12-27 20:10:13,911][106225] Updated weights for policy 1, policy_version 130929 (0.0005) [2023-12-27 20:10:13,969][106225] Updated weights for policy 1, policy_version 130939 (0.0006) [2023-12-27 20:10:14,087][106226] Updated weights for policy 0, policy_version 130922 (0.0009) [2023-12-27 20:10:14,136][106226] Updated weights for policy 0, policy_version 130932 (0.0006) [2023-12-27 20:10:14,184][106226] Updated weights for policy 0, policy_version 130942 (0.0005) [2023-12-27 20:10:14,578][106225] Updated weights for policy 1, policy_version 130949 (0.0008) [2023-12-27 20:10:14,632][106225] Updated weights for policy 1, policy_version 130959 (0.0006) [2023-12-27 20:10:14,695][106225] Updated weights for policy 1, policy_version 130969 (0.0008) [2023-12-27 20:10:14,753][106226] Updated weights for policy 0, policy_version 130952 (0.0007) [2023-12-27 20:10:14,822][106226] Updated weights for policy 0, policy_version 130962 (0.0009) [2023-12-27 20:10:14,877][106226] Updated weights for policy 0, policy_version 130972 (0.0008) [2023-12-27 20:10:15,402][106225] Updated weights for policy 1, policy_version 130979 (0.0010) [2023-12-27 20:10:15,459][106225] Updated weights for policy 1, policy_version 130989 (0.0010) [2023-12-27 20:10:15,507][106226] Updated weights for policy 0, policy_version 130982 (0.0009) [2023-12-27 20:10:15,521][106225] Updated weights for policy 1, policy_version 130999 (0.0010) [2023-12-27 20:10:15,568][106226] Updated weights for policy 0, policy_version 130992 (0.0008) [2023-12-27 20:10:15,631][106226] Updated weights for policy 0, policy_version 131002 (0.0008) [2023-12-27 20:10:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 67092480. Throughput: 0: 9813.7, 1: 9948.6. Samples: 67084696. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:10:16,176][105115] Avg episode reward: [(0, '-5.580'), (1, '-6.329')] [2023-12-27 20:10:16,234][106225] Updated weights for policy 1, policy_version 131009 (0.0010) [2023-12-27 20:10:16,264][106226] Updated weights for policy 0, policy_version 131012 (0.0007) [2023-12-27 20:10:16,293][106225] Updated weights for policy 1, policy_version 131019 (0.0008) [2023-12-27 20:10:16,323][106226] Updated weights for policy 0, policy_version 131022 (0.0007) [2023-12-27 20:10:16,355][106225] Updated weights for policy 1, policy_version 131029 (0.0008) [2023-12-27 20:10:16,386][106226] Updated weights for policy 0, policy_version 131032 (0.0007) [2023-12-27 20:10:16,412][106225] Updated weights for policy 1, policy_version 131039 (0.0007) [2023-12-27 20:10:17,064][106225] Updated weights for policy 1, policy_version 131049 (0.0007) [2023-12-27 20:10:17,114][106225] Updated weights for policy 1, policy_version 131059 (0.0010) [2023-12-27 20:10:17,121][106226] Updated weights for policy 0, policy_version 131042 (0.0007) [2023-12-27 20:10:17,168][106225] Updated weights for policy 1, policy_version 131069 (0.0010) [2023-12-27 20:10:17,181][106226] Updated weights for policy 0, policy_version 131052 (0.0011) [2023-12-27 20:10:17,248][106226] Updated weights for policy 0, policy_version 131062 (0.0011) [2023-12-27 20:10:17,300][106226] Updated weights for policy 0, policy_version 131072 (0.0010) [2023-12-27 20:10:17,782][106225] Updated weights for policy 1, policy_version 131079 (0.0009) [2023-12-27 20:10:17,832][106225] Updated weights for policy 1, policy_version 131090 (0.0009) [2023-12-27 20:10:17,885][106225] Updated weights for policy 1, policy_version 131101 (0.0008) [2023-12-27 20:10:17,928][106226] Updated weights for policy 0, policy_version 131082 (0.0005) [2023-12-27 20:10:17,990][106226] Updated weights for policy 0, policy_version 131092 (0.0009) [2023-12-27 20:10:18,045][106226] Updated weights for policy 0, policy_version 131102 (0.0008) [2023-12-27 20:10:18,578][106225] Updated weights for policy 1, policy_version 131111 (0.0009) [2023-12-27 20:10:18,635][106225] Updated weights for policy 1, policy_version 131121 (0.0010) [2023-12-27 20:10:18,689][106225] Updated weights for policy 1, policy_version 131131 (0.0010) [2023-12-27 20:10:18,693][106226] Updated weights for policy 0, policy_version 131112 (0.0010) [2023-12-27 20:10:18,747][106226] Updated weights for policy 0, policy_version 131122 (0.0010) [2023-12-27 20:10:18,800][106226] Updated weights for policy 0, policy_version 131132 (0.0010) [2023-12-27 20:10:19,325][106225] Updated weights for policy 1, policy_version 131141 (0.0009) [2023-12-27 20:10:19,391][106225] Updated weights for policy 1, policy_version 131151 (0.0010) [2023-12-27 20:10:19,452][106225] Updated weights for policy 1, policy_version 131161 (0.0009) [2023-12-27 20:10:19,641][106226] Updated weights for policy 0, policy_version 131142 (0.0011) [2023-12-27 20:10:19,703][106226] Updated weights for policy 0, policy_version 131152 (0.0011) [2023-12-27 20:10:19,762][106226] Updated weights for policy 0, policy_version 131162 (0.0011) [2023-12-27 20:10:20,274][106225] Updated weights for policy 1, policy_version 131171 (0.0009) [2023-12-27 20:10:20,336][106225] Updated weights for policy 1, policy_version 131181 (0.0008) [2023-12-27 20:10:20,406][106225] Updated weights for policy 1, policy_version 131191 (0.0008) [2023-12-27 20:10:20,509][106226] Updated weights for policy 0, policy_version 131172 (0.0011) [2023-12-27 20:10:20,556][106226] Updated weights for policy 0, policy_version 131182 (0.0011) [2023-12-27 20:10:20,619][106226] Updated weights for policy 0, policy_version 131192 (0.0011) [2023-12-27 20:10:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 67190784. Throughput: 0: 9797.8, 1: 9875.9. Samples: 67203724. Policy #0 lag: (min: 16.0, avg: 41.9, max: 48.0) [2023-12-27 20:10:21,175][105115] Avg episode reward: [(0, '-5.614'), (1, '-7.149')] [2023-12-27 20:10:21,217][106225] Updated weights for policy 1, policy_version 131201 (0.0008) [2023-12-27 20:10:21,286][106225] Updated weights for policy 1, policy_version 131211 (0.0008) [2023-12-27 20:10:21,351][106225] Updated weights for policy 1, policy_version 131221 (0.0008) [2023-12-27 20:10:21,384][106226] Updated weights for policy 0, policy_version 131202 (0.0011) [2023-12-27 20:10:21,423][106225] Updated weights for policy 1, policy_version 131231 (0.0007) [2023-12-27 20:10:21,446][106226] Updated weights for policy 0, policy_version 131212 (0.0010) [2023-12-27 20:10:21,508][106226] Updated weights for policy 0, policy_version 131222 (0.0010) [2023-12-27 20:10:21,572][106226] Updated weights for policy 0, policy_version 131232 (0.0010) [2023-12-27 20:10:22,175][106225] Updated weights for policy 1, policy_version 131241 (0.0008) [2023-12-27 20:10:22,233][106225] Updated weights for policy 1, policy_version 131251 (0.0008) [2023-12-27 20:10:22,294][106225] Updated weights for policy 1, policy_version 131261 (0.0007) [2023-12-27 20:10:22,317][106226] Updated weights for policy 0, policy_version 131242 (0.0010) [2023-12-27 20:10:22,384][106226] Updated weights for policy 0, policy_version 131252 (0.0010) [2023-12-27 20:10:22,449][106226] Updated weights for policy 0, policy_version 131262 (0.0011) [2023-12-27 20:10:23,049][106225] Updated weights for policy 1, policy_version 131271 (0.0009) [2023-12-27 20:10:23,107][106225] Updated weights for policy 1, policy_version 131281 (0.0007) [2023-12-27 20:10:23,166][106225] Updated weights for policy 1, policy_version 131291 (0.0006) [2023-12-27 20:10:23,171][106226] Updated weights for policy 0, policy_version 131272 (0.0011) [2023-12-27 20:10:23,228][106226] Updated weights for policy 0, policy_version 131282 (0.0010) [2023-12-27 20:10:23,271][106226] Updated weights for policy 0, policy_version 131292 (0.0010) [2023-12-27 20:10:23,847][106225] Updated weights for policy 1, policy_version 131301 (0.0005) [2023-12-27 20:10:23,908][106225] Updated weights for policy 1, policy_version 131311 (0.0005) [2023-12-27 20:10:23,964][106225] Updated weights for policy 1, policy_version 131321 (0.0008) [2023-12-27 20:10:23,990][106226] Updated weights for policy 0, policy_version 131302 (0.0010) [2023-12-27 20:10:24,050][106226] Updated weights for policy 0, policy_version 131312 (0.0011) [2023-12-27 20:10:24,110][106226] Updated weights for policy 0, policy_version 131322 (0.0010) [2023-12-27 20:10:24,534][106225] Updated weights for policy 1, policy_version 131331 (0.0007) [2023-12-27 20:10:24,587][106225] Updated weights for policy 1, policy_version 131341 (0.0005) [2023-12-27 20:10:24,650][106225] Updated weights for policy 1, policy_version 131351 (0.0006) [2023-12-27 20:10:24,819][106226] Updated weights for policy 0, policy_version 131332 (0.0010) [2023-12-27 20:10:24,882][106226] Updated weights for policy 0, policy_version 131342 (0.0010) [2023-12-27 20:10:24,938][106226] Updated weights for policy 0, policy_version 131352 (0.0010) [2023-12-27 20:10:25,244][106225] Updated weights for policy 1, policy_version 131361 (0.0006) [2023-12-27 20:10:25,300][106225] Updated weights for policy 1, policy_version 131371 (0.0010) [2023-12-27 20:10:25,345][106225] Updated weights for policy 1, policy_version 131381 (0.0010) [2023-12-27 20:10:25,392][106225] Updated weights for policy 1, policy_version 131391 (0.0009) [2023-12-27 20:10:25,645][106226] Updated weights for policy 0, policy_version 131362 (0.0010) [2023-12-27 20:10:25,705][106226] Updated weights for policy 0, policy_version 131372 (0.0011) [2023-12-27 20:10:25,765][106226] Updated weights for policy 0, policy_version 131382 (0.0010) [2023-12-27 20:10:25,823][106226] Updated weights for policy 0, policy_version 131392 (0.0010) [2023-12-27 20:10:26,021][106225] Updated weights for policy 1, policy_version 131401 (0.0007) [2023-12-27 20:10:26,076][106225] Updated weights for policy 1, policy_version 131411 (0.0005) [2023-12-27 20:10:26,136][106225] Updated weights for policy 1, policy_version 131421 (0.0005) [2023-12-27 20:10:26,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 67297280. Throughput: 0: 9746.5, 1: 9830.9. Samples: 67259576. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:26,175][105115] Avg episode reward: [(0, '-5.353'), (1, '-6.800')] [2023-12-27 20:10:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000131424_33652736.pth... [2023-12-27 20:10:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000131392_33644544.pth... [2023-12-27 20:10:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000130240_33349632.pth [2023-12-27 20:10:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000130272_33357824.pth [2023-12-27 20:10:26,535][106226] Updated weights for policy 0, policy_version 131402 (0.0010) [2023-12-27 20:10:26,594][106226] Updated weights for policy 0, policy_version 131412 (0.0010) [2023-12-27 20:10:26,652][106226] Updated weights for policy 0, policy_version 131422 (0.0010) [2023-12-27 20:10:26,740][106225] Updated weights for policy 1, policy_version 131431 (0.0005) [2023-12-27 20:10:26,802][106225] Updated weights for policy 1, policy_version 131441 (0.0005) [2023-12-27 20:10:26,852][106225] Updated weights for policy 1, policy_version 131451 (0.0005) [2023-12-27 20:10:27,366][106226] Updated weights for policy 0, policy_version 131432 (0.0007) [2023-12-27 20:10:27,369][106225] Updated weights for policy 1, policy_version 131461 (0.0008) [2023-12-27 20:10:27,419][106226] Updated weights for policy 0, policy_version 131442 (0.0010) [2023-12-27 20:10:27,423][106225] Updated weights for policy 1, policy_version 131471 (0.0008) [2023-12-27 20:10:27,469][106226] Updated weights for policy 0, policy_version 131452 (0.0010) [2023-12-27 20:10:27,480][106225] Updated weights for policy 1, policy_version 131481 (0.0009) [2023-12-27 20:10:28,086][106226] Updated weights for policy 0, policy_version 131462 (0.0007) [2023-12-27 20:10:28,142][106225] Updated weights for policy 1, policy_version 131491 (0.0009) [2023-12-27 20:10:28,144][106226] Updated weights for policy 0, policy_version 131472 (0.0007) [2023-12-27 20:10:28,198][106225] Updated weights for policy 1, policy_version 131501 (0.0010) [2023-12-27 20:10:28,204][106226] Updated weights for policy 0, policy_version 131482 (0.0007) [2023-12-27 20:10:28,251][106225] Updated weights for policy 1, policy_version 131511 (0.0010) [2023-12-27 20:10:28,899][106226] Updated weights for policy 0, policy_version 131492 (0.0007) [2023-12-27 20:10:28,907][106225] Updated weights for policy 1, policy_version 131521 (0.0010) [2023-12-27 20:10:28,955][106226] Updated weights for policy 0, policy_version 131502 (0.0010) [2023-12-27 20:10:28,962][106225] Updated weights for policy 1, policy_version 131531 (0.0006) [2023-12-27 20:10:29,015][106226] Updated weights for policy 0, policy_version 131512 (0.0010) [2023-12-27 20:10:29,018][106225] Updated weights for policy 1, policy_version 131541 (0.0007) [2023-12-27 20:10:29,073][106225] Updated weights for policy 1, policy_version 131551 (0.0007) [2023-12-27 20:10:29,732][106225] Updated weights for policy 1, policy_version 131561 (0.0009) [2023-12-27 20:10:29,747][106226] Updated weights for policy 0, policy_version 131522 (0.0009) [2023-12-27 20:10:29,791][106225] Updated weights for policy 1, policy_version 131571 (0.0008) [2023-12-27 20:10:29,813][106226] Updated weights for policy 0, policy_version 131532 (0.0008) [2023-12-27 20:10:29,859][106225] Updated weights for policy 1, policy_version 131581 (0.0008) [2023-12-27 20:10:29,882][106226] Updated weights for policy 0, policy_version 131542 (0.0009) [2023-12-27 20:10:29,946][106226] Updated weights for policy 0, policy_version 131552 (0.0007) [2023-12-27 20:10:30,564][106226] Updated weights for policy 0, policy_version 131562 (0.0008) [2023-12-27 20:10:30,605][106225] Updated weights for policy 1, policy_version 131591 (0.0006) [2023-12-27 20:10:30,618][106226] Updated weights for policy 0, policy_version 131572 (0.0009) [2023-12-27 20:10:30,663][106225] Updated weights for policy 1, policy_version 131601 (0.0009) [2023-12-27 20:10:30,674][106226] Updated weights for policy 0, policy_version 131582 (0.0009) [2023-12-27 20:10:30,721][106225] Updated weights for policy 1, policy_version 131611 (0.0007) [2023-12-27 20:10:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 67395584. Throughput: 0: 9800.4, 1: 9967.0. Samples: 67386328. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:31,175][105115] Avg episode reward: [(0, '-5.459'), (1, '-7.157')] [2023-12-27 20:10:31,375][106225] Updated weights for policy 1, policy_version 131621 (0.0008) [2023-12-27 20:10:31,398][106226] Updated weights for policy 0, policy_version 131592 (0.0008) [2023-12-27 20:10:31,437][106225] Updated weights for policy 1, policy_version 131631 (0.0007) [2023-12-27 20:10:31,447][106226] Updated weights for policy 0, policy_version 131602 (0.0008) [2023-12-27 20:10:31,496][106225] Updated weights for policy 1, policy_version 131641 (0.0008) [2023-12-27 20:10:31,502][106226] Updated weights for policy 0, policy_version 131612 (0.0006) [2023-12-27 20:10:32,232][106225] Updated weights for policy 1, policy_version 131651 (0.0006) [2023-12-27 20:10:32,236][106226] Updated weights for policy 0, policy_version 131622 (0.0007) [2023-12-27 20:10:32,293][106225] Updated weights for policy 1, policy_version 131661 (0.0007) [2023-12-27 20:10:32,294][106226] Updated weights for policy 0, policy_version 131632 (0.0007) [2023-12-27 20:10:32,353][106226] Updated weights for policy 0, policy_version 131642 (0.0007) [2023-12-27 20:10:32,359][106225] Updated weights for policy 1, policy_version 131671 (0.0008) [2023-12-27 20:10:33,054][106225] Updated weights for policy 1, policy_version 131681 (0.0007) [2023-12-27 20:10:33,066][106226] Updated weights for policy 0, policy_version 131652 (0.0008) [2023-12-27 20:10:33,108][106225] Updated weights for policy 1, policy_version 131691 (0.0006) [2023-12-27 20:10:33,125][106226] Updated weights for policy 0, policy_version 131662 (0.0009) [2023-12-27 20:10:33,162][106225] Updated weights for policy 1, policy_version 131701 (0.0006) [2023-12-27 20:10:33,179][106226] Updated weights for policy 0, policy_version 131672 (0.0007) [2023-12-27 20:10:33,210][106225] Updated weights for policy 1, policy_version 131711 (0.0005) [2023-12-27 20:10:33,842][106226] Updated weights for policy 0, policy_version 131682 (0.0007) [2023-12-27 20:10:33,866][106225] Updated weights for policy 1, policy_version 131721 (0.0005) [2023-12-27 20:10:33,893][106226] Updated weights for policy 0, policy_version 131692 (0.0006) [2023-12-27 20:10:33,924][106225] Updated weights for policy 1, policy_version 131731 (0.0005) [2023-12-27 20:10:33,958][106226] Updated weights for policy 0, policy_version 131702 (0.0006) [2023-12-27 20:10:33,980][106225] Updated weights for policy 1, policy_version 131741 (0.0005) [2023-12-27 20:10:34,011][106226] Updated weights for policy 0, policy_version 131712 (0.0005) [2023-12-27 20:10:34,616][106226] Updated weights for policy 0, policy_version 131722 (0.0006) [2023-12-27 20:10:34,621][106225] Updated weights for policy 1, policy_version 131751 (0.0007) [2023-12-27 20:10:34,679][106226] Updated weights for policy 0, policy_version 131732 (0.0006) [2023-12-27 20:10:34,679][106225] Updated weights for policy 1, policy_version 131761 (0.0010) [2023-12-27 20:10:34,739][106226] Updated weights for policy 0, policy_version 131742 (0.0006) [2023-12-27 20:10:34,758][106225] Updated weights for policy 1, policy_version 131771 (0.0008) [2023-12-27 20:10:35,327][106226] Updated weights for policy 0, policy_version 131752 (0.0005) [2023-12-27 20:10:35,386][106226] Updated weights for policy 0, policy_version 131762 (0.0005) [2023-12-27 20:10:35,443][106226] Updated weights for policy 0, policy_version 131772 (0.0009) [2023-12-27 20:10:35,461][106225] Updated weights for policy 1, policy_version 131781 (0.0007) [2023-12-27 20:10:35,505][106225] Updated weights for policy 1, policy_version 131791 (0.0008) [2023-12-27 20:10:35,554][106225] Updated weights for policy 1, policy_version 131801 (0.0008) [2023-12-27 20:10:36,092][106226] Updated weights for policy 0, policy_version 131782 (0.0009) [2023-12-27 20:10:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 67493888. Throughput: 0: 9874.5, 1: 9959.5. Samples: 67507444. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:36,175][105115] Avg episode reward: [(0, '-5.407'), (1, '-6.796')] [2023-12-27 20:10:36,181][106226] Updated weights for policy 0, policy_version 131794 (0.0007) [2023-12-27 20:10:36,251][106226] Updated weights for policy 0, policy_version 131804 (0.0009) [2023-12-27 20:10:36,380][106225] Updated weights for policy 1, policy_version 131811 (0.0008) [2023-12-27 20:10:36,438][106225] Updated weights for policy 1, policy_version 131821 (0.0007) [2023-12-27 20:10:36,500][106225] Updated weights for policy 1, policy_version 131831 (0.0009) [2023-12-27 20:10:36,926][106226] Updated weights for policy 0, policy_version 131814 (0.0009) [2023-12-27 20:10:36,988][106226] Updated weights for policy 0, policy_version 131824 (0.0008) [2023-12-27 20:10:37,054][106226] Updated weights for policy 0, policy_version 131834 (0.0005) [2023-12-27 20:10:37,126][106225] Updated weights for policy 1, policy_version 131841 (0.0008) [2023-12-27 20:10:37,174][106225] Updated weights for policy 1, policy_version 131851 (0.0005) [2023-12-27 20:10:37,226][106225] Updated weights for policy 1, policy_version 131861 (0.0006) [2023-12-27 20:10:37,286][106225] Updated weights for policy 1, policy_version 131871 (0.0009) [2023-12-27 20:10:37,723][106226] Updated weights for policy 0, policy_version 131844 (0.0006) [2023-12-27 20:10:37,778][106226] Updated weights for policy 0, policy_version 131854 (0.0007) [2023-12-27 20:10:37,835][106226] Updated weights for policy 0, policy_version 131864 (0.0005) [2023-12-27 20:10:38,024][106225] Updated weights for policy 1, policy_version 131881 (0.0009) [2023-12-27 20:10:38,094][106225] Updated weights for policy 1, policy_version 131891 (0.0006) [2023-12-27 20:10:38,147][106225] Updated weights for policy 1, policy_version 131901 (0.0008) [2023-12-27 20:10:38,463][106226] Updated weights for policy 0, policy_version 131874 (0.0007) [2023-12-27 20:10:38,530][106226] Updated weights for policy 0, policy_version 131884 (0.0008) [2023-12-27 20:10:38,595][106226] Updated weights for policy 0, policy_version 131894 (0.0009) [2023-12-27 20:10:38,661][106226] Updated weights for policy 0, policy_version 131904 (0.0008) [2023-12-27 20:10:38,853][106225] Updated weights for policy 1, policy_version 131911 (0.0008) [2023-12-27 20:10:38,914][106225] Updated weights for policy 1, policy_version 131921 (0.0008) [2023-12-27 20:10:38,965][106225] Updated weights for policy 1, policy_version 131931 (0.0008) [2023-12-27 20:10:39,397][106226] Updated weights for policy 0, policy_version 131914 (0.0008) [2023-12-27 20:10:39,467][106226] Updated weights for policy 0, policy_version 131924 (0.0008) [2023-12-27 20:10:39,530][106226] Updated weights for policy 0, policy_version 131934 (0.0008) [2023-12-27 20:10:39,676][106225] Updated weights for policy 1, policy_version 131941 (0.0009) [2023-12-27 20:10:39,748][106225] Updated weights for policy 1, policy_version 131951 (0.0009) [2023-12-27 20:10:39,805][106225] Updated weights for policy 1, policy_version 131961 (0.0009) [2023-12-27 20:10:40,285][106226] Updated weights for policy 0, policy_version 131944 (0.0010) [2023-12-27 20:10:40,347][106226] Updated weights for policy 0, policy_version 131954 (0.0010) [2023-12-27 20:10:40,408][106226] Updated weights for policy 0, policy_version 131964 (0.0008) [2023-12-27 20:10:40,533][106225] Updated weights for policy 1, policy_version 131971 (0.0008) [2023-12-27 20:10:40,590][106225] Updated weights for policy 1, policy_version 131981 (0.0008) [2023-12-27 20:10:40,647][106225] Updated weights for policy 1, policy_version 131991 (0.0008) [2023-12-27 20:10:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 67592192. Throughput: 0: 9912.2, 1: 9950.9. Samples: 67567184. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:41,175][105115] Avg episode reward: [(0, '-5.324'), (1, '-6.756')] [2023-12-27 20:10:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000132000_33800192.pth... [2023-12-27 20:10:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000130816_33497088.pth [2023-12-27 20:10:41,186][106226] Updated weights for policy 0, policy_version 131974 (0.0008) [2023-12-27 20:10:41,245][106226] Updated weights for policy 0, policy_version 131984 (0.0007) [2023-12-27 20:10:41,310][106226] Updated weights for policy 0, policy_version 131994 (0.0009) [2023-12-27 20:10:41,363][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000132000_33800192.pth... [2023-12-27 20:10:41,367][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000130816_33497088.pth [2023-12-27 20:10:41,427][106225] Updated weights for policy 1, policy_version 132001 (0.0008) [2023-12-27 20:10:41,488][106225] Updated weights for policy 1, policy_version 132011 (0.0009) [2023-12-27 20:10:41,553][106225] Updated weights for policy 1, policy_version 132021 (0.0008) [2023-12-27 20:10:41,631][106225] Updated weights for policy 1, policy_version 132031 (0.0008) [2023-12-27 20:10:42,117][106226] Updated weights for policy 0, policy_version 132004 (0.0009) [2023-12-27 20:10:42,183][106226] Updated weights for policy 0, policy_version 132014 (0.0010) [2023-12-27 20:10:42,244][106226] Updated weights for policy 0, policy_version 132024 (0.0007) [2023-12-27 20:10:42,247][106225] Updated weights for policy 1, policy_version 132041 (0.0007) [2023-12-27 20:10:42,315][106225] Updated weights for policy 1, policy_version 132051 (0.0007) [2023-12-27 20:10:42,376][106225] Updated weights for policy 1, policy_version 132061 (0.0008) [2023-12-27 20:10:42,904][106226] Updated weights for policy 0, policy_version 132034 (0.0009) [2023-12-27 20:10:42,949][106226] Updated weights for policy 0, policy_version 132044 (0.0009) [2023-12-27 20:10:43,008][106226] Updated weights for policy 0, policy_version 132054 (0.0007) [2023-12-27 20:10:43,070][106226] Updated weights for policy 0, policy_version 132064 (0.0005) [2023-12-27 20:10:43,186][106225] Updated weights for policy 1, policy_version 132071 (0.0009) [2023-12-27 20:10:43,234][106225] Updated weights for policy 1, policy_version 132081 (0.0008) [2023-12-27 20:10:43,283][106225] Updated weights for policy 1, policy_version 132091 (0.0008) [2023-12-27 20:10:43,724][106226] Updated weights for policy 0, policy_version 132074 (0.0008) [2023-12-27 20:10:43,783][106226] Updated weights for policy 0, policy_version 132084 (0.0008) [2023-12-27 20:10:43,838][106226] Updated weights for policy 0, policy_version 132094 (0.0005) [2023-12-27 20:10:43,987][106225] Updated weights for policy 1, policy_version 132102 (0.0008) [2023-12-27 20:10:44,040][106225] Updated weights for policy 1, policy_version 132112 (0.0008) [2023-12-27 20:10:44,094][106225] Updated weights for policy 1, policy_version 132122 (0.0008) [2023-12-27 20:10:44,571][106226] Updated weights for policy 0, policy_version 132104 (0.0007) [2023-12-27 20:10:44,623][106226] Updated weights for policy 0, policy_version 132114 (0.0005) [2023-12-27 20:10:44,677][106226] Updated weights for policy 0, policy_version 132124 (0.0006) [2023-12-27 20:10:44,732][106225] Updated weights for policy 1, policy_version 132132 (0.0008) [2023-12-27 20:10:44,792][106225] Updated weights for policy 1, policy_version 132142 (0.0008) [2023-12-27 20:10:44,845][106225] Updated weights for policy 1, policy_version 132152 (0.0010) [2023-12-27 20:10:45,365][106226] Updated weights for policy 0, policy_version 132134 (0.0006) [2023-12-27 20:10:45,422][106226] Updated weights for policy 0, policy_version 132144 (0.0006) [2023-12-27 20:10:45,470][106226] Updated weights for policy 0, policy_version 132154 (0.0006) [2023-12-27 20:10:45,527][106225] Updated weights for policy 1, policy_version 132162 (0.0008) [2023-12-27 20:10:45,589][106225] Updated weights for policy 1, policy_version 132172 (0.0008) [2023-12-27 20:10:45,650][106225] Updated weights for policy 1, policy_version 132182 (0.0008) [2023-12-27 20:10:45,704][106225] Updated weights for policy 1, policy_version 132192 (0.0009) [2023-12-27 20:10:46,061][106226] Updated weights for policy 0, policy_version 132164 (0.0005) [2023-12-27 20:10:46,117][106226] Updated weights for policy 0, policy_version 132174 (0.0005) [2023-12-27 20:10:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 67690496. Throughput: 0: 9907.2, 1: 9961.4. Samples: 67683320. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:46,176][105115] Avg episode reward: [(0, '-5.708'), (1, '-6.919')] [2023-12-27 20:10:46,177][106226] Updated weights for policy 0, policy_version 132184 (0.0005) [2023-12-27 20:10:46,412][106225] Updated weights for policy 1, policy_version 132202 (0.0005) [2023-12-27 20:10:46,463][106225] Updated weights for policy 1, policy_version 132212 (0.0005) [2023-12-27 20:10:46,515][106225] Updated weights for policy 1, policy_version 132222 (0.0005) [2023-12-27 20:10:46,815][106226] Updated weights for policy 0, policy_version 132194 (0.0005) [2023-12-27 20:10:46,883][106226] Updated weights for policy 0, policy_version 132204 (0.0006) [2023-12-27 20:10:46,956][106226] Updated weights for policy 0, policy_version 132214 (0.0010) [2023-12-27 20:10:47,025][106226] Updated weights for policy 0, policy_version 132224 (0.0009) [2023-12-27 20:10:47,051][106225] Updated weights for policy 1, policy_version 132232 (0.0006) [2023-12-27 20:10:47,109][106225] Updated weights for policy 1, policy_version 132242 (0.0007) [2023-12-27 20:10:47,178][106225] Updated weights for policy 1, policy_version 132252 (0.0011) [2023-12-27 20:10:47,659][106226] Updated weights for policy 0, policy_version 132234 (0.0005) [2023-12-27 20:10:47,716][106226] Updated weights for policy 0, policy_version 132244 (0.0006) [2023-12-27 20:10:47,779][106226] Updated weights for policy 0, policy_version 132254 (0.0009) [2023-12-27 20:10:47,786][106225] Updated weights for policy 1, policy_version 132262 (0.0007) [2023-12-27 20:10:47,846][106225] Updated weights for policy 1, policy_version 132272 (0.0010) [2023-12-27 20:10:47,903][106225] Updated weights for policy 1, policy_version 132282 (0.0008) [2023-12-27 20:10:48,493][106226] Updated weights for policy 0, policy_version 132264 (0.0008) [2023-12-27 20:10:48,541][106225] Updated weights for policy 1, policy_version 132292 (0.0006) [2023-12-27 20:10:48,555][106226] Updated weights for policy 0, policy_version 132274 (0.0007) [2023-12-27 20:10:48,612][106225] Updated weights for policy 1, policy_version 132302 (0.0006) [2023-12-27 20:10:48,616][106226] Updated weights for policy 0, policy_version 132284 (0.0007) [2023-12-27 20:10:48,687][106225] Updated weights for policy 1, policy_version 132312 (0.0006) [2023-12-27 20:10:49,194][106226] Updated weights for policy 0, policy_version 132294 (0.0006) [2023-12-27 20:10:49,267][106226] Updated weights for policy 0, policy_version 132304 (0.0009) [2023-12-27 20:10:49,327][106226] Updated weights for policy 0, policy_version 132314 (0.0008) [2023-12-27 20:10:49,453][106225] Updated weights for policy 1, policy_version 132322 (0.0007) [2023-12-27 20:10:49,502][106225] Updated weights for policy 1, policy_version 132332 (0.0007) [2023-12-27 20:10:49,548][106225] Updated weights for policy 1, policy_version 132342 (0.0010) [2023-12-27 20:10:49,606][106225] Updated weights for policy 1, policy_version 132352 (0.0010) [2023-12-27 20:10:50,028][106226] Updated weights for policy 0, policy_version 132324 (0.0008) [2023-12-27 20:10:50,082][106226] Updated weights for policy 0, policy_version 132334 (0.0007) [2023-12-27 20:10:50,144][106226] Updated weights for policy 0, policy_version 132344 (0.0005) [2023-12-27 20:10:50,370][106225] Updated weights for policy 1, policy_version 132362 (0.0010) [2023-12-27 20:10:50,425][106225] Updated weights for policy 1, policy_version 132372 (0.0010) [2023-12-27 20:10:50,479][106225] Updated weights for policy 1, policy_version 132382 (0.0010) [2023-12-27 20:10:50,863][106226] Updated weights for policy 0, policy_version 132354 (0.0007) [2023-12-27 20:10:50,932][106226] Updated weights for policy 0, policy_version 132364 (0.0011) [2023-12-27 20:10:50,993][106226] Updated weights for policy 0, policy_version 132374 (0.0011) [2023-12-27 20:10:51,060][106226] Updated weights for policy 0, policy_version 132384 (0.0008) [2023-12-27 20:10:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 67796992. Throughput: 0: 9918.5, 1: 10025.9. Samples: 67805900. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:51,175][105115] Avg episode reward: [(0, '-5.220'), (1, '-6.967')] [2023-12-27 20:10:51,280][106225] Updated weights for policy 1, policy_version 132392 (0.0009) [2023-12-27 20:10:51,346][106225] Updated weights for policy 1, policy_version 132402 (0.0010) [2023-12-27 20:10:51,423][106225] Updated weights for policy 1, policy_version 132412 (0.0010) [2023-12-27 20:10:51,824][106226] Updated weights for policy 0, policy_version 132394 (0.0008) [2023-12-27 20:10:51,884][106226] Updated weights for policy 0, policy_version 132404 (0.0008) [2023-12-27 20:10:51,950][106226] Updated weights for policy 0, policy_version 132414 (0.0005) [2023-12-27 20:10:52,172][106225] Updated weights for policy 1, policy_version 132422 (0.0008) [2023-12-27 20:10:52,234][106225] Updated weights for policy 1, policy_version 132432 (0.0009) [2023-12-27 20:10:52,297][106225] Updated weights for policy 1, policy_version 132442 (0.0009) [2023-12-27 20:10:52,578][106226] Updated weights for policy 0, policy_version 132424 (0.0008) [2023-12-27 20:10:52,634][106226] Updated weights for policy 0, policy_version 132434 (0.0008) [2023-12-27 20:10:52,699][106226] Updated weights for policy 0, policy_version 132444 (0.0008) [2023-12-27 20:10:53,030][106225] Updated weights for policy 1, policy_version 132452 (0.0008) [2023-12-27 20:10:53,084][106225] Updated weights for policy 1, policy_version 132462 (0.0007) [2023-12-27 20:10:53,140][106225] Updated weights for policy 1, policy_version 132472 (0.0007) [2023-12-27 20:10:53,458][106226] Updated weights for policy 0, policy_version 132454 (0.0010) [2023-12-27 20:10:53,519][106226] Updated weights for policy 0, policy_version 132464 (0.0011) [2023-12-27 20:10:53,573][106226] Updated weights for policy 0, policy_version 132474 (0.0011) [2023-12-27 20:10:53,726][106225] Updated weights for policy 1, policy_version 132482 (0.0007) [2023-12-27 20:10:53,787][106225] Updated weights for policy 1, policy_version 132492 (0.0005) [2023-12-27 20:10:53,854][106225] Updated weights for policy 1, policy_version 132502 (0.0005) [2023-12-27 20:10:53,913][106225] Updated weights for policy 1, policy_version 132512 (0.0005) [2023-12-27 20:10:54,186][106226] Updated weights for policy 0, policy_version 132484 (0.0011) [2023-12-27 20:10:54,246][106226] Updated weights for policy 0, policy_version 132494 (0.0010) [2023-12-27 20:10:54,303][106226] Updated weights for policy 0, policy_version 132504 (0.0010) [2023-12-27 20:10:54,503][106225] Updated weights for policy 1, policy_version 132522 (0.0007) [2023-12-27 20:10:54,566][106225] Updated weights for policy 1, policy_version 132532 (0.0010) [2023-12-27 20:10:54,621][106225] Updated weights for policy 1, policy_version 132542 (0.0010) [2023-12-27 20:10:54,952][106226] Updated weights for policy 0, policy_version 132514 (0.0007) [2023-12-27 20:10:55,011][106226] Updated weights for policy 0, policy_version 132524 (0.0010) [2023-12-27 20:10:55,077][106226] Updated weights for policy 0, policy_version 132534 (0.0010) [2023-12-27 20:10:55,144][106226] Updated weights for policy 0, policy_version 132544 (0.0011) [2023-12-27 20:10:55,186][106225] Updated weights for policy 1, policy_version 132552 (0.0006) [2023-12-27 20:10:55,238][106225] Updated weights for policy 1, policy_version 132562 (0.0005) [2023-12-27 20:10:55,294][106225] Updated weights for policy 1, policy_version 132572 (0.0005) [2023-12-27 20:10:55,831][106225] Updated weights for policy 1, policy_version 132582 (0.0009) [2023-12-27 20:10:55,842][106226] Updated weights for policy 0, policy_version 132554 (0.0011) [2023-12-27 20:10:55,891][106225] Updated weights for policy 1, policy_version 132592 (0.0010) [2023-12-27 20:10:55,905][106226] Updated weights for policy 0, policy_version 132564 (0.0007) [2023-12-27 20:10:55,954][106225] Updated weights for policy 1, policy_version 132602 (0.0010) [2023-12-27 20:10:55,970][106226] Updated weights for policy 0, policy_version 132574 (0.0006) [2023-12-27 20:10:56,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 67903488. Throughput: 0: 9949.5, 1: 10037.4. Samples: 67865512. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:10:56,176][105115] Avg episode reward: [(0, '-5.483'), (1, '-6.707')] [2023-12-27 20:10:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000132576_33947648.pth... [2023-12-27 20:10:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000132608_33955840.pth... [2023-12-27 20:10:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000131392_33644544.pth [2023-12-27 20:10:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000131424_33652736.pth [2023-12-27 20:10:56,513][106226] Updated weights for policy 0, policy_version 132584 (0.0005) [2023-12-27 20:10:56,569][106226] Updated weights for policy 0, policy_version 132594 (0.0005) [2023-12-27 20:10:56,613][106225] Updated weights for policy 1, policy_version 132612 (0.0010) [2023-12-27 20:10:56,623][106226] Updated weights for policy 0, policy_version 132604 (0.0005) [2023-12-27 20:10:56,666][106225] Updated weights for policy 1, policy_version 132622 (0.0010) [2023-12-27 20:10:56,719][106225] Updated weights for policy 1, policy_version 132632 (0.0010) [2023-12-27 20:10:57,141][106226] Updated weights for policy 0, policy_version 132614 (0.0005) [2023-12-27 20:10:57,196][106226] Updated weights for policy 0, policy_version 132624 (0.0005) [2023-12-27 20:10:57,244][106226] Updated weights for policy 0, policy_version 132634 (0.0005) [2023-12-27 20:10:57,417][106225] Updated weights for policy 1, policy_version 132642 (0.0010) [2023-12-27 20:10:57,479][106225] Updated weights for policy 1, policy_version 132652 (0.0010) [2023-12-27 20:10:57,525][106225] Updated weights for policy 1, policy_version 132662 (0.0010) [2023-12-27 20:10:57,572][106225] Updated weights for policy 1, policy_version 132672 (0.0010) [2023-12-27 20:10:57,824][106226] Updated weights for policy 0, policy_version 132644 (0.0006) [2023-12-27 20:10:57,885][106226] Updated weights for policy 0, policy_version 132654 (0.0005) [2023-12-27 20:10:57,946][106226] Updated weights for policy 0, policy_version 132664 (0.0007) [2023-12-27 20:10:58,292][106225] Updated weights for policy 1, policy_version 132682 (0.0008) [2023-12-27 20:10:58,362][106225] Updated weights for policy 1, policy_version 132692 (0.0009) [2023-12-27 20:10:58,429][106225] Updated weights for policy 1, policy_version 132702 (0.0010) [2023-12-27 20:10:58,682][106226] Updated weights for policy 0, policy_version 132674 (0.0010) [2023-12-27 20:10:58,757][106226] Updated weights for policy 0, policy_version 132684 (0.0008) [2023-12-27 20:10:58,838][106226] Updated weights for policy 0, policy_version 132694 (0.0007) [2023-12-27 20:10:58,905][106226] Updated weights for policy 0, policy_version 132704 (0.0008) [2023-12-27 20:10:59,265][106225] Updated weights for policy 1, policy_version 132712 (0.0009) [2023-12-27 20:10:59,332][106225] Updated weights for policy 1, policy_version 132722 (0.0011) [2023-12-27 20:10:59,401][106225] Updated weights for policy 1, policy_version 132732 (0.0008) [2023-12-27 20:10:59,677][106226] Updated weights for policy 0, policy_version 132714 (0.0010) [2023-12-27 20:10:59,734][106226] Updated weights for policy 0, policy_version 132724 (0.0010) [2023-12-27 20:10:59,797][106226] Updated weights for policy 0, policy_version 132734 (0.0010) [2023-12-27 20:11:00,065][106225] Updated weights for policy 1, policy_version 132742 (0.0006) [2023-12-27 20:11:00,128][106225] Updated weights for policy 1, policy_version 132752 (0.0007) [2023-12-27 20:11:00,190][106225] Updated weights for policy 1, policy_version 132762 (0.0008) [2023-12-27 20:11:00,523][106226] Updated weights for policy 0, policy_version 132744 (0.0009) [2023-12-27 20:11:00,591][106226] Updated weights for policy 0, policy_version 132754 (0.0008) [2023-12-27 20:11:00,654][106226] Updated weights for policy 0, policy_version 132764 (0.0008) [2023-12-27 20:11:00,901][106225] Updated weights for policy 1, policy_version 132772 (0.0006) [2023-12-27 20:11:00,964][106225] Updated weights for policy 1, policy_version 132782 (0.0005) [2023-12-27 20:11:01,028][106225] Updated weights for policy 1, policy_version 132792 (0.0007) [2023-12-27 20:11:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68001792. Throughput: 0: 10040.0, 1: 10090.4. Samples: 67990556. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:11:01,175][105115] Avg episode reward: [(0, '-5.342'), (1, '-6.739')] [2023-12-27 20:11:01,294][106226] Updated weights for policy 0, policy_version 132774 (0.0006) [2023-12-27 20:11:01,357][106226] Updated weights for policy 0, policy_version 132784 (0.0006) [2023-12-27 20:11:01,419][106226] Updated weights for policy 0, policy_version 132794 (0.0006) [2023-12-27 20:11:01,745][106225] Updated weights for policy 1, policy_version 132802 (0.0008) [2023-12-27 20:11:01,804][106225] Updated weights for policy 1, policy_version 132812 (0.0008) [2023-12-27 20:11:01,861][106225] Updated weights for policy 1, policy_version 132822 (0.0008) [2023-12-27 20:11:01,921][106225] Updated weights for policy 1, policy_version 132832 (0.0009) [2023-12-27 20:11:02,044][106226] Updated weights for policy 0, policy_version 132804 (0.0007) [2023-12-27 20:11:02,118][106226] Updated weights for policy 0, policy_version 132814 (0.0006) [2023-12-27 20:11:02,188][106226] Updated weights for policy 0, policy_version 132824 (0.0006) [2023-12-27 20:11:02,587][106225] Updated weights for policy 1, policy_version 132842 (0.0008) [2023-12-27 20:11:02,650][106225] Updated weights for policy 1, policy_version 132852 (0.0009) [2023-12-27 20:11:02,710][106225] Updated weights for policy 1, policy_version 132862 (0.0009) [2023-12-27 20:11:02,841][106226] Updated weights for policy 0, policy_version 132834 (0.0008) [2023-12-27 20:11:02,908][106226] Updated weights for policy 0, policy_version 132844 (0.0006) [2023-12-27 20:11:02,958][106226] Updated weights for policy 0, policy_version 132854 (0.0005) [2023-12-27 20:11:03,014][106226] Updated weights for policy 0, policy_version 132864 (0.0006) [2023-12-27 20:11:03,355][106225] Updated weights for policy 1, policy_version 132872 (0.0008) [2023-12-27 20:11:03,417][106225] Updated weights for policy 1, policy_version 132882 (0.0008) [2023-12-27 20:11:03,469][106225] Updated weights for policy 1, policy_version 132892 (0.0008) [2023-12-27 20:11:03,585][106226] Updated weights for policy 0, policy_version 132874 (0.0008) [2023-12-27 20:11:03,637][106226] Updated weights for policy 0, policy_version 132884 (0.0006) [2023-12-27 20:11:03,699][106226] Updated weights for policy 0, policy_version 132894 (0.0010) [2023-12-27 20:11:04,224][106225] Updated weights for policy 1, policy_version 132902 (0.0008) [2023-12-27 20:11:04,288][106225] Updated weights for policy 1, policy_version 132912 (0.0008) [2023-12-27 20:11:04,350][106225] Updated weights for policy 1, policy_version 132922 (0.0008) [2023-12-27 20:11:04,447][106226] Updated weights for policy 0, policy_version 132904 (0.0011) [2023-12-27 20:11:04,516][106226] Updated weights for policy 0, policy_version 132914 (0.0010) [2023-12-27 20:11:04,578][106226] Updated weights for policy 0, policy_version 132924 (0.0011) [2023-12-27 20:11:04,986][106225] Updated weights for policy 1, policy_version 132932 (0.0008) [2023-12-27 20:11:05,035][106225] Updated weights for policy 1, policy_version 132942 (0.0006) [2023-12-27 20:11:05,090][106225] Updated weights for policy 1, policy_version 132952 (0.0007) [2023-12-27 20:11:05,280][106226] Updated weights for policy 0, policy_version 132934 (0.0010) [2023-12-27 20:11:05,326][106226] Updated weights for policy 0, policy_version 132944 (0.0010) [2023-12-27 20:11:05,376][106226] Updated weights for policy 0, policy_version 132954 (0.0010) [2023-12-27 20:11:05,855][106225] Updated weights for policy 1, policy_version 132962 (0.0007) [2023-12-27 20:11:05,908][106225] Updated weights for policy 1, policy_version 132972 (0.0005) [2023-12-27 20:11:05,973][106225] Updated weights for policy 1, policy_version 132982 (0.0005) [2023-12-27 20:11:06,018][106226] Updated weights for policy 0, policy_version 132964 (0.0010) [2023-12-27 20:11:06,022][106225] Updated weights for policy 1, policy_version 132992 (0.0006) [2023-12-27 20:11:06,065][106226] Updated weights for policy 0, policy_version 132974 (0.0010) [2023-12-27 20:11:06,119][106226] Updated weights for policy 0, policy_version 132984 (0.0010) [2023-12-27 20:11:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 68108288. Throughput: 0: 10102.2, 1: 10081.9. Samples: 68112008. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:11:06,175][105115] Avg episode reward: [(0, '-5.255'), (1, '-6.831')] [2023-12-27 20:11:06,674][106225] Updated weights for policy 1, policy_version 133002 (0.0007) [2023-12-27 20:11:06,732][106225] Updated weights for policy 1, policy_version 133012 (0.0008) [2023-12-27 20:11:06,794][106225] Updated weights for policy 1, policy_version 133022 (0.0008) [2023-12-27 20:11:06,875][106226] Updated weights for policy 0, policy_version 132994 (0.0010) [2023-12-27 20:11:06,939][106226] Updated weights for policy 0, policy_version 133004 (0.0011) [2023-12-27 20:11:07,002][106226] Updated weights for policy 0, policy_version 133014 (0.0010) [2023-12-27 20:11:07,065][106226] Updated weights for policy 0, policy_version 133024 (0.0011) [2023-12-27 20:11:07,483][106225] Updated weights for policy 1, policy_version 133032 (0.0008) [2023-12-27 20:11:07,542][106225] Updated weights for policy 1, policy_version 133042 (0.0008) [2023-12-27 20:11:07,591][106225] Updated weights for policy 1, policy_version 133052 (0.0008) [2023-12-27 20:11:07,736][106226] Updated weights for policy 0, policy_version 133034 (0.0011) [2023-12-27 20:11:07,794][106226] Updated weights for policy 0, policy_version 133044 (0.0011) [2023-12-27 20:11:07,853][106226] Updated weights for policy 0, policy_version 133054 (0.0010) [2023-12-27 20:11:08,282][106225] Updated weights for policy 1, policy_version 133062 (0.0008) [2023-12-27 20:11:08,342][106225] Updated weights for policy 1, policy_version 133072 (0.0007) [2023-12-27 20:11:08,403][106225] Updated weights for policy 1, policy_version 133082 (0.0008) [2023-12-27 20:11:08,564][106226] Updated weights for policy 0, policy_version 133064 (0.0009) [2023-12-27 20:11:08,626][106226] Updated weights for policy 0, policy_version 133074 (0.0005) [2023-12-27 20:11:08,696][106226] Updated weights for policy 0, policy_version 133084 (0.0005) [2023-12-27 20:11:09,167][106225] Updated weights for policy 1, policy_version 133092 (0.0007) [2023-12-27 20:11:09,230][106226] Updated weights for policy 0, policy_version 133094 (0.0007) [2023-12-27 20:11:09,238][106225] Updated weights for policy 1, policy_version 133102 (0.0008) [2023-12-27 20:11:09,295][106226] Updated weights for policy 0, policy_version 133104 (0.0008) [2023-12-27 20:11:09,301][106225] Updated weights for policy 1, policy_version 133112 (0.0007) [2023-12-27 20:11:09,360][106226] Updated weights for policy 0, policy_version 133114 (0.0008) [2023-12-27 20:11:09,989][106225] Updated weights for policy 1, policy_version 133122 (0.0007) [2023-12-27 20:11:10,055][106225] Updated weights for policy 1, policy_version 133132 (0.0008) [2023-12-27 20:11:10,117][106225] Updated weights for policy 1, policy_version 133142 (0.0008) [2023-12-27 20:11:10,177][106226] Updated weights for policy 0, policy_version 133124 (0.0008) [2023-12-27 20:11:10,183][106225] Updated weights for policy 1, policy_version 133152 (0.0009) [2023-12-27 20:11:10,250][106226] Updated weights for policy 0, policy_version 133134 (0.0006) [2023-12-27 20:11:10,307][106226] Updated weights for policy 0, policy_version 133144 (0.0009) [2023-12-27 20:11:10,886][106225] Updated weights for policy 1, policy_version 133162 (0.0006) [2023-12-27 20:11:10,934][106225] Updated weights for policy 1, policy_version 133172 (0.0008) [2023-12-27 20:11:10,984][106226] Updated weights for policy 0, policy_version 133154 (0.0009) [2023-12-27 20:11:10,985][106225] Updated weights for policy 1, policy_version 133182 (0.0008) [2023-12-27 20:11:11,043][106226] Updated weights for policy 0, policy_version 133164 (0.0008) [2023-12-27 20:11:11,109][106226] Updated weights for policy 0, policy_version 133174 (0.0009) [2023-12-27 20:11:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 68198400. Throughput: 0: 10154.4, 1: 10128.8. Samples: 68172320. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:11:11,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-6.812')] [2023-12-27 20:11:11,177][106226] Updated weights for policy 0, policy_version 133184 (0.0009) [2023-12-27 20:11:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000133184_34103296.pth... [2023-12-27 20:11:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000133184_34103296.pth... [2023-12-27 20:11:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000132000_33800192.pth [2023-12-27 20:11:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000132000_33800192.pth [2023-12-27 20:11:11,770][106225] Updated weights for policy 1, policy_version 133192 (0.0010) [2023-12-27 20:11:11,829][106225] Updated weights for policy 1, policy_version 133202 (0.0011) [2023-12-27 20:11:11,887][106225] Updated weights for policy 1, policy_version 133212 (0.0011) [2023-12-27 20:11:11,936][106226] Updated weights for policy 0, policy_version 133194 (0.0008) [2023-12-27 20:11:12,002][106226] Updated weights for policy 0, policy_version 133204 (0.0008) [2023-12-27 20:11:12,064][106226] Updated weights for policy 0, policy_version 133214 (0.0008) [2023-12-27 20:11:12,644][106225] Updated weights for policy 1, policy_version 133222 (0.0011) [2023-12-27 20:11:12,705][106225] Updated weights for policy 1, policy_version 133232 (0.0010) [2023-12-27 20:11:12,770][106225] Updated weights for policy 1, policy_version 133242 (0.0010) [2023-12-27 20:11:12,820][106226] Updated weights for policy 0, policy_version 133224 (0.0007) [2023-12-27 20:11:12,884][106226] Updated weights for policy 0, policy_version 133234 (0.0008) [2023-12-27 20:11:12,948][106226] Updated weights for policy 0, policy_version 133244 (0.0008) [2023-12-27 20:11:13,407][106225] Updated weights for policy 1, policy_version 133252 (0.0010) [2023-12-27 20:11:13,470][106225] Updated weights for policy 1, policy_version 133262 (0.0008) [2023-12-27 20:11:13,527][106225] Updated weights for policy 1, policy_version 133272 (0.0006) [2023-12-27 20:11:13,639][106226] Updated weights for policy 0, policy_version 133254 (0.0011) [2023-12-27 20:11:13,685][106226] Updated weights for policy 0, policy_version 133264 (0.0010) [2023-12-27 20:11:13,742][106226] Updated weights for policy 0, policy_version 133274 (0.0010) [2023-12-27 20:11:14,067][106225] Updated weights for policy 1, policy_version 133282 (0.0006) [2023-12-27 20:11:14,126][106225] Updated weights for policy 1, policy_version 133292 (0.0006) [2023-12-27 20:11:14,188][106225] Updated weights for policy 1, policy_version 133302 (0.0005) [2023-12-27 20:11:14,239][106225] Updated weights for policy 1, policy_version 133312 (0.0006) [2023-12-27 20:11:14,488][106226] Updated weights for policy 0, policy_version 133284 (0.0011) [2023-12-27 20:11:14,547][106226] Updated weights for policy 0, policy_version 133294 (0.0010) [2023-12-27 20:11:14,603][106226] Updated weights for policy 0, policy_version 133304 (0.0010) [2023-12-27 20:11:14,966][106225] Updated weights for policy 1, policy_version 133322 (0.0008) [2023-12-27 20:11:15,031][106225] Updated weights for policy 1, policy_version 133332 (0.0009) [2023-12-27 20:11:15,097][106225] Updated weights for policy 1, policy_version 133342 (0.0010) [2023-12-27 20:11:15,283][106226] Updated weights for policy 0, policy_version 133314 (0.0010) [2023-12-27 20:11:15,341][106226] Updated weights for policy 0, policy_version 133324 (0.0005) [2023-12-27 20:11:15,405][106226] Updated weights for policy 0, policy_version 133334 (0.0006) [2023-12-27 20:11:15,457][106226] Updated weights for policy 0, policy_version 133344 (0.0008) [2023-12-27 20:11:15,848][106225] Updated weights for policy 1, policy_version 133352 (0.0008) [2023-12-27 20:11:15,912][106225] Updated weights for policy 1, policy_version 133362 (0.0005) [2023-12-27 20:11:15,973][106225] Updated weights for policy 1, policy_version 133372 (0.0008) [2023-12-27 20:11:16,162][106226] Updated weights for policy 0, policy_version 133354 (0.0009) [2023-12-27 20:11:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 68296704. Throughput: 0: 10074.5, 1: 9977.9. Samples: 68288688. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:11:16,175][105115] Avg episode reward: [(0, '-5.460'), (1, '-6.767')] [2023-12-27 20:11:16,218][106226] Updated weights for policy 0, policy_version 133364 (0.0009) [2023-12-27 20:11:16,270][106226] Updated weights for policy 0, policy_version 133374 (0.0008) [2023-12-27 20:11:16,621][106225] Updated weights for policy 1, policy_version 133382 (0.0009) [2023-12-27 20:11:16,688][106225] Updated weights for policy 1, policy_version 133392 (0.0010) [2023-12-27 20:11:16,745][106225] Updated weights for policy 1, policy_version 133402 (0.0009) [2023-12-27 20:11:16,997][106226] Updated weights for policy 0, policy_version 133384 (0.0006) [2023-12-27 20:11:17,045][106226] Updated weights for policy 0, policy_version 133394 (0.0005) [2023-12-27 20:11:17,100][106226] Updated weights for policy 0, policy_version 133404 (0.0010) [2023-12-27 20:11:17,333][106225] Updated weights for policy 1, policy_version 133412 (0.0008) [2023-12-27 20:11:17,395][106225] Updated weights for policy 1, policy_version 133422 (0.0005) [2023-12-27 20:11:17,455][106225] Updated weights for policy 1, policy_version 133432 (0.0005) [2023-12-27 20:11:17,774][106226] Updated weights for policy 0, policy_version 133414 (0.0009) [2023-12-27 20:11:17,844][106226] Updated weights for policy 0, policy_version 133424 (0.0010) [2023-12-27 20:11:17,905][106226] Updated weights for policy 0, policy_version 133434 (0.0011) [2023-12-27 20:11:18,068][106225] Updated weights for policy 1, policy_version 133442 (0.0006) [2023-12-27 20:11:18,125][106225] Updated weights for policy 1, policy_version 133452 (0.0010) [2023-12-27 20:11:18,179][106225] Updated weights for policy 1, policy_version 133462 (0.0009) [2023-12-27 20:11:18,238][106225] Updated weights for policy 1, policy_version 133472 (0.0005) [2023-12-27 20:11:18,603][106226] Updated weights for policy 0, policy_version 133444 (0.0010) [2023-12-27 20:11:18,654][106226] Updated weights for policy 0, policy_version 133454 (0.0010) [2023-12-27 20:11:18,704][106226] Updated weights for policy 0, policy_version 133464 (0.0010) [2023-12-27 20:11:18,907][106225] Updated weights for policy 1, policy_version 133482 (0.0010) [2023-12-27 20:11:18,963][106225] Updated weights for policy 1, policy_version 133492 (0.0010) [2023-12-27 20:11:19,026][106225] Updated weights for policy 1, policy_version 133502 (0.0008) [2023-12-27 20:11:19,444][106226] Updated weights for policy 0, policy_version 133474 (0.0009) [2023-12-27 20:11:19,507][106226] Updated weights for policy 0, policy_version 133484 (0.0007) [2023-12-27 20:11:19,557][106226] Updated weights for policy 0, policy_version 133494 (0.0008) [2023-12-27 20:11:19,612][106226] Updated weights for policy 0, policy_version 133504 (0.0009) [2023-12-27 20:11:19,760][106225] Updated weights for policy 1, policy_version 133512 (0.0009) [2023-12-27 20:11:19,829][106225] Updated weights for policy 1, policy_version 133522 (0.0008) [2023-12-27 20:11:19,897][106225] Updated weights for policy 1, policy_version 133532 (0.0007) [2023-12-27 20:11:20,306][106226] Updated weights for policy 0, policy_version 133514 (0.0006) [2023-12-27 20:11:20,372][106226] Updated weights for policy 0, policy_version 133524 (0.0008) [2023-12-27 20:11:20,442][106226] Updated weights for policy 0, policy_version 133534 (0.0008) [2023-12-27 20:11:20,696][106225] Updated weights for policy 1, policy_version 133542 (0.0008) [2023-12-27 20:11:20,761][106225] Updated weights for policy 1, policy_version 133552 (0.0008) [2023-12-27 20:11:20,830][106225] Updated weights for policy 1, policy_version 133562 (0.0008) [2023-12-27 20:11:21,124][106226] Updated weights for policy 0, policy_version 133544 (0.0006) [2023-12-27 20:11:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68395008. Throughput: 0: 10024.7, 1: 9980.4. Samples: 68407672. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-27 20:11:21,175][105115] Avg episode reward: [(0, '-5.322'), (1, '-6.402')] [2023-12-27 20:11:21,197][106226] Updated weights for policy 0, policy_version 133554 (0.0008) [2023-12-27 20:11:21,259][106226] Updated weights for policy 0, policy_version 133564 (0.0009) [2023-12-27 20:11:21,618][106225] Updated weights for policy 1, policy_version 133572 (0.0009) [2023-12-27 20:11:21,686][106225] Updated weights for policy 1, policy_version 133582 (0.0008) [2023-12-27 20:11:21,741][106225] Updated weights for policy 1, policy_version 133592 (0.0008) [2023-12-27 20:11:22,010][106226] Updated weights for policy 0, policy_version 133574 (0.0008) [2023-12-27 20:11:22,070][106226] Updated weights for policy 0, policy_version 133584 (0.0008) [2023-12-27 20:11:22,132][106226] Updated weights for policy 0, policy_version 133594 (0.0009) [2023-12-27 20:11:22,571][106225] Updated weights for policy 1, policy_version 133602 (0.0008) [2023-12-27 20:11:22,636][106225] Updated weights for policy 1, policy_version 133612 (0.0008) [2023-12-27 20:11:22,696][106225] Updated weights for policy 1, policy_version 133622 (0.0008) [2023-12-27 20:11:22,757][106225] Updated weights for policy 1, policy_version 133632 (0.0008) [2023-12-27 20:11:22,818][106226] Updated weights for policy 0, policy_version 133604 (0.0008) [2023-12-27 20:11:22,873][106226] Updated weights for policy 0, policy_version 133614 (0.0008) [2023-12-27 20:11:22,932][106226] Updated weights for policy 0, policy_version 133624 (0.0009) [2023-12-27 20:11:23,501][106225] Updated weights for policy 1, policy_version 133642 (0.0008) [2023-12-27 20:11:23,552][106225] Updated weights for policy 1, policy_version 133652 (0.0007) [2023-12-27 20:11:23,613][106225] Updated weights for policy 1, policy_version 133662 (0.0006) [2023-12-27 20:11:23,647][106226] Updated weights for policy 0, policy_version 133634 (0.0009) [2023-12-27 20:11:23,716][106226] Updated weights for policy 0, policy_version 133644 (0.0011) [2023-12-27 20:11:23,779][106226] Updated weights for policy 0, policy_version 133654 (0.0010) [2023-12-27 20:11:23,843][106226] Updated weights for policy 0, policy_version 133664 (0.0007) [2023-12-27 20:11:24,295][106225] Updated weights for policy 1, policy_version 133672 (0.0010) [2023-12-27 20:11:24,351][106225] Updated weights for policy 1, policy_version 133682 (0.0010) [2023-12-27 20:11:24,412][106225] Updated weights for policy 1, policy_version 133692 (0.0009) [2023-12-27 20:11:24,517][106226] Updated weights for policy 0, policy_version 133674 (0.0008) [2023-12-27 20:11:24,570][106226] Updated weights for policy 0, policy_version 133684 (0.0005) [2023-12-27 20:11:24,618][106226] Updated weights for policy 0, policy_version 133694 (0.0005) [2023-12-27 20:11:25,078][106225] Updated weights for policy 1, policy_version 133702 (0.0007) [2023-12-27 20:11:25,129][106225] Updated weights for policy 1, policy_version 133712 (0.0007) [2023-12-27 20:11:25,186][106225] Updated weights for policy 1, policy_version 133722 (0.0007) [2023-12-27 20:11:25,238][106226] Updated weights for policy 0, policy_version 133704 (0.0009) [2023-12-27 20:11:25,296][106226] Updated weights for policy 0, policy_version 133714 (0.0008) [2023-12-27 20:11:25,356][106226] Updated weights for policy 0, policy_version 133724 (0.0009) [2023-12-27 20:11:25,929][106225] Updated weights for policy 1, policy_version 133732 (0.0009) [2023-12-27 20:11:25,978][106225] Updated weights for policy 1, policy_version 133742 (0.0007) [2023-12-27 20:11:25,995][106226] Updated weights for policy 0, policy_version 133734 (0.0006) [2023-12-27 20:11:26,025][106225] Updated weights for policy 1, policy_version 133752 (0.0008) [2023-12-27 20:11:26,055][106226] Updated weights for policy 0, policy_version 133744 (0.0006) [2023-12-27 20:11:26,110][106226] Updated weights for policy 0, policy_version 133754 (0.0009) [2023-12-27 20:11:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68501504. Throughput: 0: 9991.4, 1: 9924.9. Samples: 68463416. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:26,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-6.826')] [2023-12-27 20:11:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000133760_34250752.pth... [2023-12-27 20:11:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000133760_34250752.pth... [2023-12-27 20:11:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000132576_33947648.pth [2023-12-27 20:11:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000132608_33955840.pth [2023-12-27 20:11:26,651][106225] Updated weights for policy 1, policy_version 133762 (0.0008) [2023-12-27 20:11:26,702][106225] Updated weights for policy 1, policy_version 133772 (0.0009) [2023-12-27 20:11:26,757][106225] Updated weights for policy 1, policy_version 133782 (0.0006) [2023-12-27 20:11:26,757][106226] Updated weights for policy 0, policy_version 133764 (0.0007) [2023-12-27 20:11:26,812][106225] Updated weights for policy 1, policy_version 133792 (0.0007) [2023-12-27 20:11:26,818][106226] Updated weights for policy 0, policy_version 133774 (0.0006) [2023-12-27 20:11:26,877][106226] Updated weights for policy 0, policy_version 133784 (0.0008) [2023-12-27 20:11:27,443][106225] Updated weights for policy 1, policy_version 133802 (0.0008) [2023-12-27 20:11:27,500][106225] Updated weights for policy 1, policy_version 133812 (0.0008) [2023-12-27 20:11:27,565][106225] Updated weights for policy 1, policy_version 133822 (0.0008) [2023-12-27 20:11:27,595][106226] Updated weights for policy 0, policy_version 133794 (0.0008) [2023-12-27 20:11:27,648][106226] Updated weights for policy 0, policy_version 133804 (0.0007) [2023-12-27 20:11:27,699][106226] Updated weights for policy 0, policy_version 133814 (0.0008) [2023-12-27 20:11:27,746][106226] Updated weights for policy 0, policy_version 133824 (0.0008) [2023-12-27 20:11:28,260][106225] Updated weights for policy 1, policy_version 133832 (0.0010) [2023-12-27 20:11:28,314][106225] Updated weights for policy 1, policy_version 133842 (0.0008) [2023-12-27 20:11:28,376][106225] Updated weights for policy 1, policy_version 133852 (0.0009) [2023-12-27 20:11:28,491][106226] Updated weights for policy 0, policy_version 133834 (0.0006) [2023-12-27 20:11:28,557][106226] Updated weights for policy 0, policy_version 133844 (0.0006) [2023-12-27 20:11:28,627][106226] Updated weights for policy 0, policy_version 133854 (0.0005) [2023-12-27 20:11:29,100][106225] Updated weights for policy 1, policy_version 133862 (0.0010) [2023-12-27 20:11:29,155][106225] Updated weights for policy 1, policy_version 133872 (0.0010) [2023-12-27 20:11:29,191][106226] Updated weights for policy 0, policy_version 133864 (0.0009) [2023-12-27 20:11:29,202][106225] Updated weights for policy 1, policy_version 133882 (0.0010) [2023-12-27 20:11:29,258][106226] Updated weights for policy 0, policy_version 133874 (0.0011) [2023-12-27 20:11:29,325][106226] Updated weights for policy 0, policy_version 133884 (0.0011) [2023-12-27 20:11:29,911][106225] Updated weights for policy 1, policy_version 133892 (0.0008) [2023-12-27 20:11:29,979][106225] Updated weights for policy 1, policy_version 133902 (0.0009) [2023-12-27 20:11:30,023][106226] Updated weights for policy 0, policy_version 133894 (0.0010) [2023-12-27 20:11:30,035][106225] Updated weights for policy 1, policy_version 133912 (0.0007) [2023-12-27 20:11:30,089][106226] Updated weights for policy 0, policy_version 133904 (0.0010) [2023-12-27 20:11:30,152][106226] Updated weights for policy 0, policy_version 133914 (0.0010) [2023-12-27 20:11:30,705][106225] Updated weights for policy 1, policy_version 133922 (0.0005) [2023-12-27 20:11:30,751][106225] Updated weights for policy 1, policy_version 133932 (0.0005) [2023-12-27 20:11:30,803][106225] Updated weights for policy 1, policy_version 133942 (0.0005) [2023-12-27 20:11:30,858][106225] Updated weights for policy 1, policy_version 133952 (0.0005) [2023-12-27 20:11:30,877][106226] Updated weights for policy 0, policy_version 133924 (0.0010) [2023-12-27 20:11:30,928][106226] Updated weights for policy 0, policy_version 133934 (0.0005) [2023-12-27 20:11:30,983][106226] Updated weights for policy 0, policy_version 133944 (0.0006) [2023-12-27 20:11:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68599808. Throughput: 0: 10075.9, 1: 9983.8. Samples: 68586000. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:31,175][105115] Avg episode reward: [(0, '-5.304'), (1, '-7.044')] [2023-12-27 20:11:31,466][106225] Updated weights for policy 1, policy_version 133962 (0.0009) [2023-12-27 20:11:31,523][106225] Updated weights for policy 1, policy_version 133972 (0.0008) [2023-12-27 20:11:31,574][106225] Updated weights for policy 1, policy_version 133982 (0.0010) [2023-12-27 20:11:31,751][106226] Updated weights for policy 0, policy_version 133954 (0.0008) [2023-12-27 20:11:31,804][106226] Updated weights for policy 0, policy_version 133964 (0.0007) [2023-12-27 20:11:31,865][106226] Updated weights for policy 0, policy_version 133974 (0.0007) [2023-12-27 20:11:31,922][106226] Updated weights for policy 0, policy_version 133984 (0.0007) [2023-12-27 20:11:32,293][106225] Updated weights for policy 1, policy_version 133992 (0.0010) [2023-12-27 20:11:32,362][106225] Updated weights for policy 1, policy_version 134002 (0.0010) [2023-12-27 20:11:32,427][106225] Updated weights for policy 1, policy_version 134012 (0.0010) [2023-12-27 20:11:32,615][106226] Updated weights for policy 0, policy_version 133994 (0.0008) [2023-12-27 20:11:32,669][106226] Updated weights for policy 0, policy_version 134004 (0.0008) [2023-12-27 20:11:32,727][106226] Updated weights for policy 0, policy_version 134014 (0.0007) [2023-12-27 20:11:33,123][106225] Updated weights for policy 1, policy_version 134022 (0.0010) [2023-12-27 20:11:33,179][106225] Updated weights for policy 1, policy_version 134032 (0.0010) [2023-12-27 20:11:33,235][106225] Updated weights for policy 1, policy_version 134042 (0.0010) [2023-12-27 20:11:33,447][106226] Updated weights for policy 0, policy_version 134024 (0.0008) [2023-12-27 20:11:33,510][106226] Updated weights for policy 0, policy_version 134034 (0.0009) [2023-12-27 20:11:33,570][106226] Updated weights for policy 0, policy_version 134044 (0.0008) [2023-12-27 20:11:33,865][106225] Updated weights for policy 1, policy_version 134052 (0.0009) [2023-12-27 20:11:33,920][106225] Updated weights for policy 1, policy_version 134062 (0.0008) [2023-12-27 20:11:33,970][106225] Updated weights for policy 1, policy_version 134072 (0.0008) [2023-12-27 20:11:34,303][106226] Updated weights for policy 0, policy_version 134054 (0.0008) [2023-12-27 20:11:34,367][106226] Updated weights for policy 0, policy_version 134064 (0.0008) [2023-12-27 20:11:34,434][106226] Updated weights for policy 0, policy_version 134074 (0.0006) [2023-12-27 20:11:34,689][106225] Updated weights for policy 1, policy_version 134082 (0.0008) [2023-12-27 20:11:34,738][106225] Updated weights for policy 1, policy_version 134092 (0.0008) [2023-12-27 20:11:34,786][106225] Updated weights for policy 1, policy_version 134102 (0.0008) [2023-12-27 20:11:34,844][106225] Updated weights for policy 1, policy_version 134112 (0.0009) [2023-12-27 20:11:35,037][106226] Updated weights for policy 0, policy_version 134084 (0.0006) [2023-12-27 20:11:35,106][106226] Updated weights for policy 0, policy_version 134094 (0.0007) [2023-12-27 20:11:35,163][106226] Updated weights for policy 0, policy_version 134104 (0.0009) [2023-12-27 20:11:35,469][106225] Updated weights for policy 1, policy_version 134122 (0.0007) [2023-12-27 20:11:35,522][106225] Updated weights for policy 1, policy_version 134132 (0.0009) [2023-12-27 20:11:35,583][106225] Updated weights for policy 1, policy_version 134142 (0.0008) [2023-12-27 20:11:35,780][106226] Updated weights for policy 0, policy_version 134114 (0.0008) [2023-12-27 20:11:35,840][106226] Updated weights for policy 0, policy_version 134124 (0.0009) [2023-12-27 20:11:35,907][106226] Updated weights for policy 0, policy_version 134134 (0.0008) [2023-12-27 20:11:35,967][106226] Updated weights for policy 0, policy_version 134144 (0.0008) [2023-12-27 20:11:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68698112. Throughput: 0: 10013.6, 1: 10002.3. Samples: 68706616. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:36,175][105115] Avg episode reward: [(0, '-5.129'), (1, '-7.173')] [2023-12-27 20:11:36,311][106225] Updated weights for policy 1, policy_version 134152 (0.0007) [2023-12-27 20:11:36,375][106225] Updated weights for policy 1, policy_version 134162 (0.0007) [2023-12-27 20:11:36,443][106225] Updated weights for policy 1, policy_version 134172 (0.0005) [2023-12-27 20:11:36,617][106226] Updated weights for policy 0, policy_version 134154 (0.0005) [2023-12-27 20:11:36,667][106226] Updated weights for policy 0, policy_version 134164 (0.0006) [2023-12-27 20:11:36,734][106226] Updated weights for policy 0, policy_version 134174 (0.0007) [2023-12-27 20:11:37,068][106225] Updated weights for policy 1, policy_version 134182 (0.0007) [2023-12-27 20:11:37,124][106225] Updated weights for policy 1, policy_version 134192 (0.0007) [2023-12-27 20:11:37,179][106225] Updated weights for policy 1, policy_version 134202 (0.0008) [2023-12-27 20:11:37,423][106226] Updated weights for policy 0, policy_version 134184 (0.0008) [2023-12-27 20:11:37,484][106226] Updated weights for policy 0, policy_version 134194 (0.0008) [2023-12-27 20:11:37,541][106226] Updated weights for policy 0, policy_version 134204 (0.0010) [2023-12-27 20:11:37,845][106225] Updated weights for policy 1, policy_version 134212 (0.0009) [2023-12-27 20:11:37,915][106225] Updated weights for policy 1, policy_version 134222 (0.0009) [2023-12-27 20:11:37,986][106225] Updated weights for policy 1, policy_version 134232 (0.0009) [2023-12-27 20:11:38,181][106226] Updated weights for policy 0, policy_version 134214 (0.0009) [2023-12-27 20:11:38,240][106226] Updated weights for policy 0, policy_version 134224 (0.0008) [2023-12-27 20:11:38,302][106226] Updated weights for policy 0, policy_version 134234 (0.0008) [2023-12-27 20:11:38,725][106225] Updated weights for policy 1, policy_version 134242 (0.0009) [2023-12-27 20:11:38,795][106225] Updated weights for policy 1, policy_version 134252 (0.0010) [2023-12-27 20:11:38,862][106225] Updated weights for policy 1, policy_version 134262 (0.0010) [2023-12-27 20:11:38,931][106225] Updated weights for policy 1, policy_version 134272 (0.0009) [2023-12-27 20:11:38,946][106226] Updated weights for policy 0, policy_version 134244 (0.0008) [2023-12-27 20:11:39,003][106226] Updated weights for policy 0, policy_version 134254 (0.0005) [2023-12-27 20:11:39,063][106226] Updated weights for policy 0, policy_version 134264 (0.0005) [2023-12-27 20:11:39,659][106225] Updated weights for policy 1, policy_version 134282 (0.0009) [2023-12-27 20:11:39,718][106225] Updated weights for policy 1, policy_version 134292 (0.0008) [2023-12-27 20:11:39,736][106226] Updated weights for policy 0, policy_version 134274 (0.0006) [2023-12-27 20:11:39,779][106225] Updated weights for policy 1, policy_version 134302 (0.0008) [2023-12-27 20:11:39,798][106226] Updated weights for policy 0, policy_version 134284 (0.0007) [2023-12-27 20:11:39,872][106226] Updated weights for policy 0, policy_version 134294 (0.0007) [2023-12-27 20:11:39,940][106226] Updated weights for policy 0, policy_version 134304 (0.0009) [2023-12-27 20:11:40,498][106225] Updated weights for policy 1, policy_version 134312 (0.0010) [2023-12-27 20:11:40,549][106225] Updated weights for policy 1, policy_version 134322 (0.0010) [2023-12-27 20:11:40,610][106225] Updated weights for policy 1, policy_version 134332 (0.0010) [2023-12-27 20:11:40,643][106226] Updated weights for policy 0, policy_version 134314 (0.0008) [2023-12-27 20:11:40,703][106226] Updated weights for policy 0, policy_version 134324 (0.0008) [2023-12-27 20:11:40,789][106226] Updated weights for policy 0, policy_version 134334 (0.0009) [2023-12-27 20:11:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 68796416. Throughput: 0: 10057.5, 1: 10015.7. Samples: 68768804. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:41,175][105115] Avg episode reward: [(0, '-5.217'), (1, '-6.421')] [2023-12-27 20:11:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000134336_34398208.pth... [2023-12-27 20:11:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000134336_34398208.pth... [2023-12-27 20:11:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000133184_34103296.pth [2023-12-27 20:11:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000133184_34103296.pth [2023-12-27 20:11:41,283][106225] Updated weights for policy 1, policy_version 134342 (0.0009) [2023-12-27 20:11:41,348][106225] Updated weights for policy 1, policy_version 134352 (0.0008) [2023-12-27 20:11:41,414][106225] Updated weights for policy 1, policy_version 134362 (0.0007) [2023-12-27 20:11:41,657][106226] Updated weights for policy 0, policy_version 134344 (0.0010) [2023-12-27 20:11:41,729][106226] Updated weights for policy 0, policy_version 134354 (0.0010) [2023-12-27 20:11:41,788][106226] Updated weights for policy 0, policy_version 134364 (0.0010) [2023-12-27 20:11:42,095][106225] Updated weights for policy 1, policy_version 134372 (0.0006) [2023-12-27 20:11:42,165][106225] Updated weights for policy 1, policy_version 134382 (0.0006) [2023-12-27 20:11:42,234][106225] Updated weights for policy 1, policy_version 134392 (0.0006) [2023-12-27 20:11:42,516][106226] Updated weights for policy 0, policy_version 134374 (0.0008) [2023-12-27 20:11:42,580][106226] Updated weights for policy 0, policy_version 134384 (0.0008) [2023-12-27 20:11:42,644][106226] Updated weights for policy 0, policy_version 134394 (0.0008) [2023-12-27 20:11:42,957][106225] Updated weights for policy 1, policy_version 134402 (0.0008) [2023-12-27 20:11:43,011][106225] Updated weights for policy 1, policy_version 134412 (0.0008) [2023-12-27 20:11:43,064][106225] Updated weights for policy 1, policy_version 134422 (0.0008) [2023-12-27 20:11:43,113][106225] Updated weights for policy 1, policy_version 134432 (0.0009) [2023-12-27 20:11:43,262][106226] Updated weights for policy 0, policy_version 134404 (0.0009) [2023-12-27 20:11:43,319][106226] Updated weights for policy 0, policy_version 134414 (0.0007) [2023-12-27 20:11:43,372][106226] Updated weights for policy 0, policy_version 134424 (0.0005) [2023-12-27 20:11:43,731][106225] Updated weights for policy 1, policy_version 134442 (0.0005) [2023-12-27 20:11:43,783][106225] Updated weights for policy 1, policy_version 134452 (0.0005) [2023-12-27 20:11:43,833][106225] Updated weights for policy 1, policy_version 134462 (0.0008) [2023-12-27 20:11:43,997][106226] Updated weights for policy 0, policy_version 134434 (0.0006) [2023-12-27 20:11:44,056][106226] Updated weights for policy 0, policy_version 134444 (0.0007) [2023-12-27 20:11:44,108][106226] Updated weights for policy 0, policy_version 134454 (0.0008) [2023-12-27 20:11:44,160][106226] Updated weights for policy 0, policy_version 134464 (0.0008) [2023-12-27 20:11:44,477][106225] Updated weights for policy 1, policy_version 134472 (0.0006) [2023-12-27 20:11:44,534][106225] Updated weights for policy 1, policy_version 134482 (0.0008) [2023-12-27 20:11:44,592][106225] Updated weights for policy 1, policy_version 134492 (0.0008) [2023-12-27 20:11:44,932][106226] Updated weights for policy 0, policy_version 134474 (0.0007) [2023-12-27 20:11:45,003][106226] Updated weights for policy 0, policy_version 134484 (0.0008) [2023-12-27 20:11:45,069][106226] Updated weights for policy 0, policy_version 134494 (0.0008) [2023-12-27 20:11:45,215][106225] Updated weights for policy 1, policy_version 134502 (0.0006) [2023-12-27 20:11:45,281][106225] Updated weights for policy 1, policy_version 134512 (0.0006) [2023-12-27 20:11:45,342][106225] Updated weights for policy 1, policy_version 134522 (0.0008) [2023-12-27 20:11:45,769][106226] Updated weights for policy 0, policy_version 134504 (0.0009) [2023-12-27 20:11:45,843][106226] Updated weights for policy 0, policy_version 134514 (0.0006) [2023-12-27 20:11:45,907][106226] Updated weights for policy 0, policy_version 134524 (0.0007) [2023-12-27 20:11:45,915][106225] Updated weights for policy 1, policy_version 134532 (0.0007) [2023-12-27 20:11:45,974][106225] Updated weights for policy 1, policy_version 134542 (0.0005) [2023-12-27 20:11:46,027][106225] Updated weights for policy 1, policy_version 134552 (0.0009) [2023-12-27 20:11:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 68902912. Throughput: 0: 9960.6, 1: 9976.8. Samples: 68887740. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:46,175][105115] Avg episode reward: [(0, '-5.435'), (1, '-6.724')] [2023-12-27 20:11:46,603][106226] Updated weights for policy 0, policy_version 134534 (0.0009) [2023-12-27 20:11:46,639][106225] Updated weights for policy 1, policy_version 134562 (0.0009) [2023-12-27 20:11:46,660][106226] Updated weights for policy 0, policy_version 134544 (0.0010) [2023-12-27 20:11:46,699][106225] Updated weights for policy 1, policy_version 134572 (0.0005) [2023-12-27 20:11:46,713][106226] Updated weights for policy 0, policy_version 134554 (0.0011) [2023-12-27 20:11:46,758][106225] Updated weights for policy 1, policy_version 134582 (0.0006) [2023-12-27 20:11:46,814][106225] Updated weights for policy 1, policy_version 134592 (0.0010) [2023-12-27 20:11:47,315][106226] Updated weights for policy 0, policy_version 134564 (0.0008) [2023-12-27 20:11:47,375][106226] Updated weights for policy 0, policy_version 134574 (0.0005) [2023-12-27 20:11:47,409][106225] Updated weights for policy 1, policy_version 134602 (0.0010) [2023-12-27 20:11:47,431][106226] Updated weights for policy 0, policy_version 134584 (0.0006) [2023-12-27 20:11:47,467][106225] Updated weights for policy 1, policy_version 134612 (0.0011) [2023-12-27 20:11:47,524][106225] Updated weights for policy 1, policy_version 134622 (0.0005) [2023-12-27 20:11:47,974][106226] Updated weights for policy 0, policy_version 134594 (0.0006) [2023-12-27 20:11:48,029][106226] Updated weights for policy 0, policy_version 134604 (0.0006) [2023-12-27 20:11:48,094][106226] Updated weights for policy 0, policy_version 134614 (0.0005) [2023-12-27 20:11:48,148][106226] Updated weights for policy 0, policy_version 134624 (0.0006) [2023-12-27 20:11:48,160][106225] Updated weights for policy 1, policy_version 134632 (0.0007) [2023-12-27 20:11:48,228][106225] Updated weights for policy 1, policy_version 134642 (0.0008) [2023-12-27 20:11:48,284][106225] Updated weights for policy 1, policy_version 134652 (0.0008) [2023-12-27 20:11:48,810][106226] Updated weights for policy 0, policy_version 134634 (0.0010) [2023-12-27 20:11:48,877][106226] Updated weights for policy 0, policy_version 134644 (0.0010) [2023-12-27 20:11:48,942][106226] Updated weights for policy 0, policy_version 134654 (0.0011) [2023-12-27 20:11:49,007][106225] Updated weights for policy 1, policy_version 134662 (0.0007) [2023-12-27 20:11:49,060][106225] Updated weights for policy 1, policy_version 134672 (0.0007) [2023-12-27 20:11:49,110][106225] Updated weights for policy 1, policy_version 134682 (0.0008) [2023-12-27 20:11:49,655][106226] Updated weights for policy 0, policy_version 134664 (0.0010) [2023-12-27 20:11:49,713][106226] Updated weights for policy 0, policy_version 134674 (0.0010) [2023-12-27 20:11:49,774][106226] Updated weights for policy 0, policy_version 134684 (0.0008) [2023-12-27 20:11:49,898][106225] Updated weights for policy 1, policy_version 134692 (0.0009) [2023-12-27 20:11:49,961][106225] Updated weights for policy 1, policy_version 134702 (0.0012) [2023-12-27 20:11:50,028][106225] Updated weights for policy 1, policy_version 134712 (0.0010) [2023-12-27 20:11:50,484][106226] Updated weights for policy 0, policy_version 134694 (0.0007) [2023-12-27 20:11:50,532][106226] Updated weights for policy 0, policy_version 134704 (0.0010) [2023-12-27 20:11:50,586][106226] Updated weights for policy 0, policy_version 134714 (0.0010) [2023-12-27 20:11:50,674][106225] Updated weights for policy 1, policy_version 134722 (0.0006) [2023-12-27 20:11:50,726][106225] Updated weights for policy 1, policy_version 134732 (0.0006) [2023-12-27 20:11:50,779][106225] Updated weights for policy 1, policy_version 134742 (0.0005) [2023-12-27 20:11:50,832][106225] Updated weights for policy 1, policy_version 134752 (0.0006) [2023-12-27 20:11:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 69001216. Throughput: 0: 9931.6, 1: 10054.6. Samples: 69011388. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:51,175][105115] Avg episode reward: [(0, '-5.382'), (1, '-6.587')] [2023-12-27 20:11:51,368][106226] Updated weights for policy 0, policy_version 134724 (0.0009) [2023-12-27 20:11:51,435][106226] Updated weights for policy 0, policy_version 134734 (0.0008) [2023-12-27 20:11:51,479][106225] Updated weights for policy 1, policy_version 134762 (0.0011) [2023-12-27 20:11:51,493][106226] Updated weights for policy 0, policy_version 134744 (0.0006) [2023-12-27 20:11:51,539][106225] Updated weights for policy 1, policy_version 134772 (0.0010) [2023-12-27 20:11:51,602][106225] Updated weights for policy 1, policy_version 134782 (0.0007) [2023-12-27 20:11:52,246][106226] Updated weights for policy 0, policy_version 134754 (0.0008) [2023-12-27 20:11:52,314][106226] Updated weights for policy 0, policy_version 134764 (0.0006) [2023-12-27 20:11:52,341][106225] Updated weights for policy 1, policy_version 134792 (0.0008) [2023-12-27 20:11:52,379][106226] Updated weights for policy 0, policy_version 134774 (0.0008) [2023-12-27 20:11:52,410][106225] Updated weights for policy 1, policy_version 134802 (0.0007) [2023-12-27 20:11:52,440][106226] Updated weights for policy 0, policy_version 134784 (0.0007) [2023-12-27 20:11:52,468][106225] Updated weights for policy 1, policy_version 134812 (0.0008) [2023-12-27 20:11:53,168][106226] Updated weights for policy 0, policy_version 134794 (0.0009) [2023-12-27 20:11:53,216][106225] Updated weights for policy 1, policy_version 134822 (0.0007) [2023-12-27 20:11:53,234][106226] Updated weights for policy 0, policy_version 134804 (0.0008) [2023-12-27 20:11:53,270][106225] Updated weights for policy 1, policy_version 134832 (0.0006) [2023-12-27 20:11:53,284][106226] Updated weights for policy 0, policy_version 134814 (0.0007) [2023-12-27 20:11:53,316][106225] Updated weights for policy 1, policy_version 134842 (0.0005) [2023-12-27 20:11:53,908][106225] Updated weights for policy 1, policy_version 134852 (0.0008) [2023-12-27 20:11:53,967][106225] Updated weights for policy 1, policy_version 134862 (0.0005) [2023-12-27 20:11:54,007][106226] Updated weights for policy 0, policy_version 134824 (0.0010) [2023-12-27 20:11:54,017][106225] Updated weights for policy 1, policy_version 134872 (0.0006) [2023-12-27 20:11:54,072][106226] Updated weights for policy 0, policy_version 134834 (0.0009) [2023-12-27 20:11:54,131][106226] Updated weights for policy 0, policy_version 134844 (0.0011) [2023-12-27 20:11:54,709][106225] Updated weights for policy 1, policy_version 134882 (0.0006) [2023-12-27 20:11:54,759][106225] Updated weights for policy 1, policy_version 134892 (0.0008) [2023-12-27 20:11:54,818][106225] Updated weights for policy 1, policy_version 134902 (0.0007) [2023-12-27 20:11:54,842][106226] Updated weights for policy 0, policy_version 134854 (0.0010) [2023-12-27 20:11:54,874][106225] Updated weights for policy 1, policy_version 134912 (0.0006) [2023-12-27 20:11:54,894][106226] Updated weights for policy 0, policy_version 134864 (0.0010) [2023-12-27 20:11:54,950][106226] Updated weights for policy 0, policy_version 134874 (0.0010) [2023-12-27 20:11:55,574][106225] Updated weights for policy 1, policy_version 134922 (0.0010) [2023-12-27 20:11:55,600][106226] Updated weights for policy 0, policy_version 134884 (0.0009) [2023-12-27 20:11:55,632][106225] Updated weights for policy 1, policy_version 134932 (0.0010) [2023-12-27 20:11:55,652][106226] Updated weights for policy 0, policy_version 134894 (0.0010) [2023-12-27 20:11:55,689][106225] Updated weights for policy 1, policy_version 134942 (0.0005) [2023-12-27 20:11:55,711][106226] Updated weights for policy 0, policy_version 134904 (0.0011) [2023-12-27 20:11:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 69099520. Throughput: 0: 9877.2, 1: 10057.7. Samples: 69069396. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:11:56,176][105115] Avg episode reward: [(0, '-5.404'), (1, '-7.096')] [2023-12-27 20:11:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000134944_34553856.pth... [2023-12-27 20:11:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000134912_34545664.pth... [2023-12-27 20:11:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000133760_34250752.pth [2023-12-27 20:11:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000133760_34250752.pth [2023-12-27 20:11:56,250][106225] Updated weights for policy 1, policy_version 134952 (0.0009) [2023-12-27 20:11:56,310][106225] Updated weights for policy 1, policy_version 134962 (0.0010) [2023-12-27 20:11:56,370][106225] Updated weights for policy 1, policy_version 134972 (0.0010) [2023-12-27 20:11:56,424][106226] Updated weights for policy 0, policy_version 134914 (0.0009) [2023-12-27 20:11:56,477][106226] Updated weights for policy 0, policy_version 134924 (0.0005) [2023-12-27 20:11:56,537][106226] Updated weights for policy 0, policy_version 134934 (0.0005) [2023-12-27 20:11:56,593][106226] Updated weights for policy 0, policy_version 134944 (0.0010) [2023-12-27 20:11:57,059][106225] Updated weights for policy 1, policy_version 134982 (0.0007) [2023-12-27 20:11:57,117][106225] Updated weights for policy 1, policy_version 134992 (0.0005) [2023-12-27 20:11:57,166][106225] Updated weights for policy 1, policy_version 135002 (0.0006) [2023-12-27 20:11:57,228][106226] Updated weights for policy 0, policy_version 134954 (0.0007) [2023-12-27 20:11:57,282][106226] Updated weights for policy 0, policy_version 134964 (0.0009) [2023-12-27 20:11:57,336][106226] Updated weights for policy 0, policy_version 134974 (0.0007) [2023-12-27 20:11:57,765][106225] Updated weights for policy 1, policy_version 135012 (0.0007) [2023-12-27 20:11:57,825][106225] Updated weights for policy 1, policy_version 135022 (0.0010) [2023-12-27 20:11:57,884][106225] Updated weights for policy 1, policy_version 135032 (0.0010) [2023-12-27 20:11:57,899][106226] Updated weights for policy 0, policy_version 134984 (0.0005) [2023-12-27 20:11:57,954][106226] Updated weights for policy 0, policy_version 134994 (0.0006) [2023-12-27 20:11:58,009][106226] Updated weights for policy 0, policy_version 135004 (0.0008) [2023-12-27 20:11:58,558][106225] Updated weights for policy 1, policy_version 135042 (0.0010) [2023-12-27 20:11:58,629][106225] Updated weights for policy 1, policy_version 135052 (0.0010) [2023-12-27 20:11:58,697][106225] Updated weights for policy 1, policy_version 135062 (0.0010) [2023-12-27 20:11:58,766][106225] Updated weights for policy 1, policy_version 135072 (0.0009) [2023-12-27 20:11:58,788][106226] Updated weights for policy 0, policy_version 135014 (0.0008) [2023-12-27 20:11:58,859][106226] Updated weights for policy 0, policy_version 135024 (0.0009) [2023-12-27 20:11:58,917][106226] Updated weights for policy 0, policy_version 135034 (0.0009) [2023-12-27 20:11:59,534][106225] Updated weights for policy 1, policy_version 135082 (0.0010) [2023-12-27 20:11:59,586][106225] Updated weights for policy 1, policy_version 135092 (0.0010) [2023-12-27 20:11:59,626][106226] Updated weights for policy 0, policy_version 135044 (0.0011) [2023-12-27 20:11:59,640][106225] Updated weights for policy 1, policy_version 135102 (0.0008) [2023-12-27 20:11:59,676][106226] Updated weights for policy 0, policy_version 135054 (0.0010) [2023-12-27 20:11:59,738][106226] Updated weights for policy 0, policy_version 135064 (0.0008) [2023-12-27 20:12:00,289][106225] Updated weights for policy 1, policy_version 135112 (0.0005) [2023-12-27 20:12:00,346][106225] Updated weights for policy 1, policy_version 135122 (0.0005) [2023-12-27 20:12:00,403][106226] Updated weights for policy 0, policy_version 135074 (0.0006) [2023-12-27 20:12:00,411][106225] Updated weights for policy 1, policy_version 135132 (0.0006) [2023-12-27 20:12:00,459][106226] Updated weights for policy 0, policy_version 135084 (0.0009) [2023-12-27 20:12:00,511][106226] Updated weights for policy 0, policy_version 135094 (0.0008) [2023-12-27 20:12:00,558][106226] Updated weights for policy 0, policy_version 135104 (0.0008) [2023-12-27 20:12:01,048][106225] Updated weights for policy 1, policy_version 135142 (0.0008) [2023-12-27 20:12:01,108][106225] Updated weights for policy 1, policy_version 135152 (0.0009) [2023-12-27 20:12:01,174][106225] Updated weights for policy 1, policy_version 135162 (0.0008) [2023-12-27 20:12:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 69197824. Throughput: 0: 9969.1, 1: 10102.8. Samples: 69191924. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:01,175][105115] Avg episode reward: [(0, '-5.163'), (1, '-6.623')] [2023-12-27 20:12:01,338][106226] Updated weights for policy 0, policy_version 135114 (0.0010) [2023-12-27 20:12:01,407][106226] Updated weights for policy 0, policy_version 135124 (0.0008) [2023-12-27 20:12:01,470][106226] Updated weights for policy 0, policy_version 135134 (0.0009) [2023-12-27 20:12:01,905][106225] Updated weights for policy 1, policy_version 135172 (0.0007) [2023-12-27 20:12:01,963][106225] Updated weights for policy 1, policy_version 135182 (0.0006) [2023-12-27 20:12:02,029][106225] Updated weights for policy 1, policy_version 135192 (0.0005) [2023-12-27 20:12:02,135][106226] Updated weights for policy 0, policy_version 135144 (0.0009) [2023-12-27 20:12:02,196][106226] Updated weights for policy 0, policy_version 135154 (0.0009) [2023-12-27 20:12:02,261][106226] Updated weights for policy 0, policy_version 135164 (0.0008) [2023-12-27 20:12:02,701][106225] Updated weights for policy 1, policy_version 135202 (0.0007) [2023-12-27 20:12:02,769][106225] Updated weights for policy 1, policy_version 135212 (0.0010) [2023-12-27 20:12:02,819][106225] Updated weights for policy 1, policy_version 135222 (0.0010) [2023-12-27 20:12:02,867][106225] Updated weights for policy 1, policy_version 135232 (0.0010) [2023-12-27 20:12:02,907][106226] Updated weights for policy 0, policy_version 135174 (0.0008) [2023-12-27 20:12:02,965][106226] Updated weights for policy 0, policy_version 135184 (0.0008) [2023-12-27 20:12:03,021][106226] Updated weights for policy 0, policy_version 135194 (0.0009) [2023-12-27 20:12:03,478][106225] Updated weights for policy 1, policy_version 135242 (0.0005) [2023-12-27 20:12:03,525][106225] Updated weights for policy 1, policy_version 135252 (0.0007) [2023-12-27 20:12:03,574][106225] Updated weights for policy 1, policy_version 135262 (0.0006) [2023-12-27 20:12:03,786][106226] Updated weights for policy 0, policy_version 135204 (0.0007) [2023-12-27 20:12:03,841][106226] Updated weights for policy 0, policy_version 135214 (0.0008) [2023-12-27 20:12:03,907][106226] Updated weights for policy 0, policy_version 135225 (0.0009) [2023-12-27 20:12:04,212][106225] Updated weights for policy 1, policy_version 135272 (0.0007) [2023-12-27 20:12:04,280][106225] Updated weights for policy 1, policy_version 135282 (0.0010) [2023-12-27 20:12:04,344][106225] Updated weights for policy 1, policy_version 135292 (0.0008) [2023-12-27 20:12:04,664][106226] Updated weights for policy 0, policy_version 135235 (0.0009) [2023-12-27 20:12:04,724][106226] Updated weights for policy 0, policy_version 135245 (0.0008) [2023-12-27 20:12:04,782][106226] Updated weights for policy 0, policy_version 135255 (0.0008) [2023-12-27 20:12:05,013][106225] Updated weights for policy 1, policy_version 135302 (0.0007) [2023-12-27 20:12:05,066][106225] Updated weights for policy 1, policy_version 135312 (0.0008) [2023-12-27 20:12:05,110][106225] Updated weights for policy 1, policy_version 135322 (0.0007) [2023-12-27 20:12:05,540][106226] Updated weights for policy 0, policy_version 135265 (0.0008) [2023-12-27 20:12:05,594][106226] Updated weights for policy 0, policy_version 135275 (0.0009) [2023-12-27 20:12:05,646][106226] Updated weights for policy 0, policy_version 135285 (0.0009) [2023-12-27 20:12:05,706][106226] Updated weights for policy 0, policy_version 135295 (0.0008) [2023-12-27 20:12:05,766][106225] Updated weights for policy 1, policy_version 135332 (0.0007) [2023-12-27 20:12:05,819][106225] Updated weights for policy 1, policy_version 135342 (0.0008) [2023-12-27 20:12:05,867][106225] Updated weights for policy 1, policy_version 135352 (0.0009) [2023-12-27 20:12:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 69304320. Throughput: 0: 9925.6, 1: 10182.0. Samples: 69312512. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:06,175][105115] Avg episode reward: [(0, '-5.678'), (1, '-6.578')] [2023-12-27 20:12:06,471][106226] Updated weights for policy 0, policy_version 135305 (0.0009) [2023-12-27 20:12:06,526][106225] Updated weights for policy 1, policy_version 135362 (0.0006) [2023-12-27 20:12:06,532][106226] Updated weights for policy 0, policy_version 135315 (0.0007) [2023-12-27 20:12:06,593][106225] Updated weights for policy 1, policy_version 135372 (0.0008) [2023-12-27 20:12:06,594][106226] Updated weights for policy 0, policy_version 135325 (0.0006) [2023-12-27 20:12:06,660][106225] Updated weights for policy 1, policy_version 135382 (0.0007) [2023-12-27 20:12:06,713][106225] Updated weights for policy 1, policy_version 135392 (0.0009) [2023-12-27 20:12:07,369][106226] Updated weights for policy 0, policy_version 135335 (0.0007) [2023-12-27 20:12:07,433][106226] Updated weights for policy 0, policy_version 135345 (0.0009) [2023-12-27 20:12:07,452][106225] Updated weights for policy 1, policy_version 135402 (0.0007) [2023-12-27 20:12:07,497][106226] Updated weights for policy 0, policy_version 135355 (0.0009) [2023-12-27 20:12:07,515][106225] Updated weights for policy 1, policy_version 135412 (0.0006) [2023-12-27 20:12:07,570][106225] Updated weights for policy 1, policy_version 135422 (0.0009) [2023-12-27 20:12:08,213][106225] Updated weights for policy 1, policy_version 135432 (0.0008) [2023-12-27 20:12:08,260][106226] Updated weights for policy 0, policy_version 135365 (0.0007) [2023-12-27 20:12:08,265][106225] Updated weights for policy 1, policy_version 135442 (0.0008) [2023-12-27 20:12:08,311][106226] Updated weights for policy 0, policy_version 135375 (0.0007) [2023-12-27 20:12:08,318][106225] Updated weights for policy 1, policy_version 135452 (0.0007) [2023-12-27 20:12:08,376][106226] Updated weights for policy 0, policy_version 135385 (0.0009) [2023-12-27 20:12:09,043][106226] Updated weights for policy 0, policy_version 135395 (0.0007) [2023-12-27 20:12:09,069][106225] Updated weights for policy 1, policy_version 135462 (0.0008) [2023-12-27 20:12:09,091][106226] Updated weights for policy 0, policy_version 135405 (0.0006) [2023-12-27 20:12:09,127][106225] Updated weights for policy 1, policy_version 135472 (0.0010) [2023-12-27 20:12:09,142][106226] Updated weights for policy 0, policy_version 135415 (0.0008) [2023-12-27 20:12:09,183][106225] Updated weights for policy 1, policy_version 135482 (0.0006) [2023-12-27 20:12:09,941][106226] Updated weights for policy 0, policy_version 135425 (0.0007) [2023-12-27 20:12:09,952][106225] Updated weights for policy 1, policy_version 135492 (0.0009) [2023-12-27 20:12:10,005][106226] Updated weights for policy 0, policy_version 135435 (0.0006) [2023-12-27 20:12:10,016][106225] Updated weights for policy 1, policy_version 135502 (0.0008) [2023-12-27 20:12:10,068][106226] Updated weights for policy 0, policy_version 135445 (0.0007) [2023-12-27 20:12:10,079][106225] Updated weights for policy 1, policy_version 135512 (0.0007) [2023-12-27 20:12:10,130][106226] Updated weights for policy 0, policy_version 135455 (0.0006) [2023-12-27 20:12:10,797][106226] Updated weights for policy 0, policy_version 135465 (0.0006) [2023-12-27 20:12:10,831][106225] Updated weights for policy 1, policy_version 135522 (0.0008) [2023-12-27 20:12:10,855][106226] Updated weights for policy 0, policy_version 135475 (0.0007) [2023-12-27 20:12:10,900][106225] Updated weights for policy 1, policy_version 135532 (0.0005) [2023-12-27 20:12:10,913][106226] Updated weights for policy 0, policy_version 135485 (0.0007) [2023-12-27 20:12:10,971][106225] Updated weights for policy 1, policy_version 135542 (0.0006) [2023-12-27 20:12:11,022][106225] Updated weights for policy 1, policy_version 135552 (0.0005) [2023-12-27 20:12:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 69402624. Throughput: 0: 9913.2, 1: 10243.9. Samples: 69370484. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:11,175][105115] Avg episode reward: [(0, '-5.422'), (1, '-6.991')] [2023-12-27 20:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000135552_34709504.pth... [2023-12-27 20:12:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000135488_34693120.pth... [2023-12-27 20:12:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000134336_34398208.pth [2023-12-27 20:12:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000134336_34398208.pth [2023-12-27 20:12:11,709][106226] Updated weights for policy 0, policy_version 135495 (0.0007) [2023-12-27 20:12:11,787][106226] Updated weights for policy 0, policy_version 135505 (0.0008) [2023-12-27 20:12:11,820][106225] Updated weights for policy 1, policy_version 135562 (0.0009) [2023-12-27 20:12:11,847][106226] Updated weights for policy 0, policy_version 135515 (0.0006) [2023-12-27 20:12:11,879][106225] Updated weights for policy 1, policy_version 135572 (0.0011) [2023-12-27 20:12:11,933][106225] Updated weights for policy 1, policy_version 135582 (0.0010) [2023-12-27 20:12:12,573][106226] Updated weights for policy 0, policy_version 135525 (0.0007) [2023-12-27 20:12:12,631][106226] Updated weights for policy 0, policy_version 135535 (0.0008) [2023-12-27 20:12:12,691][106226] Updated weights for policy 0, policy_version 135545 (0.0007) [2023-12-27 20:12:12,692][106225] Updated weights for policy 1, policy_version 135592 (0.0011) [2023-12-27 20:12:12,753][106225] Updated weights for policy 1, policy_version 135602 (0.0010) [2023-12-27 20:12:12,812][106225] Updated weights for policy 1, policy_version 135612 (0.0011) [2023-12-27 20:12:13,301][106226] Updated weights for policy 0, policy_version 135555 (0.0008) [2023-12-27 20:12:13,356][106226] Updated weights for policy 0, policy_version 135565 (0.0005) [2023-12-27 20:12:13,408][106226] Updated weights for policy 0, policy_version 135575 (0.0008) [2023-12-27 20:12:13,521][106225] Updated weights for policy 1, policy_version 135622 (0.0010) [2023-12-27 20:12:13,581][106225] Updated weights for policy 1, policy_version 135632 (0.0010) [2023-12-27 20:12:13,638][106225] Updated weights for policy 1, policy_version 135642 (0.0010) [2023-12-27 20:12:14,074][106226] Updated weights for policy 0, policy_version 135585 (0.0007) [2023-12-27 20:12:14,140][106226] Updated weights for policy 0, policy_version 135595 (0.0011) [2023-12-27 20:12:14,190][106226] Updated weights for policy 0, policy_version 135605 (0.0010) [2023-12-27 20:12:14,250][106226] Updated weights for policy 0, policy_version 135615 (0.0010) [2023-12-27 20:12:14,326][106225] Updated weights for policy 1, policy_version 135652 (0.0010) [2023-12-27 20:12:14,375][106225] Updated weights for policy 1, policy_version 135662 (0.0010) [2023-12-27 20:12:14,425][106225] Updated weights for policy 1, policy_version 135672 (0.0010) [2023-12-27 20:12:14,950][106226] Updated weights for policy 0, policy_version 135625 (0.0011) [2023-12-27 20:12:15,015][106226] Updated weights for policy 0, policy_version 135635 (0.0011) [2023-12-27 20:12:15,080][106226] Updated weights for policy 0, policy_version 135645 (0.0010) [2023-12-27 20:12:15,171][106225] Updated weights for policy 1, policy_version 135682 (0.0010) [2023-12-27 20:12:15,235][106225] Updated weights for policy 1, policy_version 135692 (0.0010) [2023-12-27 20:12:15,292][106225] Updated weights for policy 1, policy_version 135702 (0.0010) [2023-12-27 20:12:15,355][106225] Updated weights for policy 1, policy_version 135712 (0.0010) [2023-12-27 20:12:15,747][106226] Updated weights for policy 0, policy_version 135655 (0.0007) [2023-12-27 20:12:15,805][106226] Updated weights for policy 0, policy_version 135665 (0.0008) [2023-12-27 20:12:15,862][106226] Updated weights for policy 0, policy_version 135675 (0.0007) [2023-12-27 20:12:16,055][106225] Updated weights for policy 1, policy_version 135722 (0.0010) [2023-12-27 20:12:16,114][106225] Updated weights for policy 1, policy_version 135732 (0.0010) [2023-12-27 20:12:16,160][106225] Updated weights for policy 1, policy_version 135742 (0.0010) [2023-12-27 20:12:16,175][105115] Fps is (10 sec: 19660.1, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 69500928. Throughput: 0: 9848.8, 1: 10130.0. Samples: 69485052. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:16,176][105115] Avg episode reward: [(0, '-5.154'), (1, '-6.880')] [2023-12-27 20:12:16,519][106226] Updated weights for policy 0, policy_version 135685 (0.0007) [2023-12-27 20:12:16,584][106226] Updated weights for policy 0, policy_version 135695 (0.0006) [2023-12-27 20:12:16,640][106226] Updated weights for policy 0, policy_version 135705 (0.0007) [2023-12-27 20:12:16,806][106225] Updated weights for policy 1, policy_version 135752 (0.0006) [2023-12-27 20:12:16,871][106225] Updated weights for policy 1, policy_version 135762 (0.0009) [2023-12-27 20:12:16,930][106225] Updated weights for policy 1, policy_version 135772 (0.0009) [2023-12-27 20:12:17,197][106226] Updated weights for policy 0, policy_version 135715 (0.0008) [2023-12-27 20:12:17,255][106226] Updated weights for policy 0, policy_version 135725 (0.0008) [2023-12-27 20:12:17,303][106226] Updated weights for policy 0, policy_version 135735 (0.0009) [2023-12-27 20:12:17,609][106225] Updated weights for policy 1, policy_version 135782 (0.0009) [2023-12-27 20:12:17,666][106225] Updated weights for policy 1, policy_version 135792 (0.0009) [2023-12-27 20:12:17,727][106225] Updated weights for policy 1, policy_version 135802 (0.0010) [2023-12-27 20:12:18,021][106226] Updated weights for policy 0, policy_version 135745 (0.0008) [2023-12-27 20:12:18,084][106226] Updated weights for policy 0, policy_version 135755 (0.0005) [2023-12-27 20:12:18,137][106226] Updated weights for policy 0, policy_version 135765 (0.0007) [2023-12-27 20:12:18,195][106226] Updated weights for policy 0, policy_version 135775 (0.0009) [2023-12-27 20:12:18,357][106225] Updated weights for policy 1, policy_version 135812 (0.0009) [2023-12-27 20:12:18,423][106225] Updated weights for policy 1, policy_version 135822 (0.0008) [2023-12-27 20:12:18,490][106225] Updated weights for policy 1, policy_version 135832 (0.0006) [2023-12-27 20:12:18,905][106226] Updated weights for policy 0, policy_version 135785 (0.0008) [2023-12-27 20:12:18,968][106226] Updated weights for policy 0, policy_version 135795 (0.0010) [2023-12-27 20:12:19,029][106226] Updated weights for policy 0, policy_version 135805 (0.0007) [2023-12-27 20:12:19,107][106225] Updated weights for policy 1, policy_version 135842 (0.0007) [2023-12-27 20:12:19,161][106225] Updated weights for policy 1, policy_version 135852 (0.0006) [2023-12-27 20:12:19,214][106225] Updated weights for policy 1, policy_version 135862 (0.0008) [2023-12-27 20:12:19,287][106225] Updated weights for policy 1, policy_version 135872 (0.0009) [2023-12-27 20:12:19,837][106226] Updated weights for policy 0, policy_version 135815 (0.0008) [2023-12-27 20:12:19,899][106226] Updated weights for policy 0, policy_version 135825 (0.0009) [2023-12-27 20:12:19,970][106226] Updated weights for policy 0, policy_version 135835 (0.0010) [2023-12-27 20:12:20,048][106225] Updated weights for policy 1, policy_version 135882 (0.0006) [2023-12-27 20:12:20,104][106225] Updated weights for policy 1, policy_version 135892 (0.0006) [2023-12-27 20:12:20,167][106225] Updated weights for policy 1, policy_version 135902 (0.0010) [2023-12-27 20:12:20,739][106226] Updated weights for policy 0, policy_version 135845 (0.0008) [2023-12-27 20:12:20,798][106226] Updated weights for policy 0, policy_version 135855 (0.0008) [2023-12-27 20:12:20,858][106225] Updated weights for policy 1, policy_version 135912 (0.0010) [2023-12-27 20:12:20,862][106226] Updated weights for policy 0, policy_version 135865 (0.0010) [2023-12-27 20:12:20,917][106225] Updated weights for policy 1, policy_version 135922 (0.0010) [2023-12-27 20:12:20,979][106225] Updated weights for policy 1, policy_version 135932 (0.0010) [2023-12-27 20:12:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 69599232. Throughput: 0: 9845.8, 1: 10102.7. Samples: 69604296. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:21,175][105115] Avg episode reward: [(0, '-5.285'), (1, '-6.841')] [2023-12-27 20:12:21,631][106226] Updated weights for policy 0, policy_version 135875 (0.0010) [2023-12-27 20:12:21,701][106226] Updated weights for policy 0, policy_version 135885 (0.0008) [2023-12-27 20:12:21,765][106225] Updated weights for policy 1, policy_version 135942 (0.0009) [2023-12-27 20:12:21,774][106226] Updated weights for policy 0, policy_version 135895 (0.0008) [2023-12-27 20:12:21,830][106225] Updated weights for policy 1, policy_version 135952 (0.0008) [2023-12-27 20:12:21,892][106225] Updated weights for policy 1, policy_version 135962 (0.0010) [2023-12-27 20:12:22,486][106226] Updated weights for policy 0, policy_version 135905 (0.0007) [2023-12-27 20:12:22,547][106226] Updated weights for policy 0, policy_version 135915 (0.0007) [2023-12-27 20:12:22,610][106226] Updated weights for policy 0, policy_version 135925 (0.0008) [2023-12-27 20:12:22,672][106226] Updated weights for policy 0, policy_version 135935 (0.0008) [2023-12-27 20:12:22,704][106225] Updated weights for policy 1, policy_version 135972 (0.0011) [2023-12-27 20:12:22,774][106225] Updated weights for policy 1, policy_version 135982 (0.0011) [2023-12-27 20:12:22,838][106225] Updated weights for policy 1, policy_version 135992 (0.0010) [2023-12-27 20:12:23,379][106226] Updated weights for policy 0, policy_version 135945 (0.0009) [2023-12-27 20:12:23,441][106226] Updated weights for policy 0, policy_version 135955 (0.0008) [2023-12-27 20:12:23,503][106226] Updated weights for policy 0, policy_version 135965 (0.0009) [2023-12-27 20:12:23,518][106225] Updated weights for policy 1, policy_version 136002 (0.0009) [2023-12-27 20:12:23,583][106225] Updated weights for policy 1, policy_version 136012 (0.0005) [2023-12-27 20:12:23,638][106225] Updated weights for policy 1, policy_version 136022 (0.0005) [2023-12-27 20:12:23,699][106225] Updated weights for policy 1, policy_version 136032 (0.0010) [2023-12-27 20:12:24,277][106226] Updated weights for policy 0, policy_version 135975 (0.0009) [2023-12-27 20:12:24,326][106225] Updated weights for policy 1, policy_version 136042 (0.0007) [2023-12-27 20:12:24,336][106226] Updated weights for policy 0, policy_version 135985 (0.0008) [2023-12-27 20:12:24,379][106225] Updated weights for policy 1, policy_version 136052 (0.0006) [2023-12-27 20:12:24,397][106226] Updated weights for policy 0, policy_version 135995 (0.0007) [2023-12-27 20:12:24,427][106225] Updated weights for policy 1, policy_version 136062 (0.0007) [2023-12-27 20:12:25,023][106225] Updated weights for policy 1, policy_version 136072 (0.0006) [2023-12-27 20:12:25,079][106225] Updated weights for policy 1, policy_version 136082 (0.0005) [2023-12-27 20:12:25,097][106226] Updated weights for policy 0, policy_version 136005 (0.0006) [2023-12-27 20:12:25,139][106225] Updated weights for policy 1, policy_version 136092 (0.0005) [2023-12-27 20:12:25,150][106226] Updated weights for policy 0, policy_version 136015 (0.0007) [2023-12-27 20:12:25,197][106226] Updated weights for policy 0, policy_version 136025 (0.0009) [2023-12-27 20:12:25,639][106225] Updated weights for policy 1, policy_version 136102 (0.0007) [2023-12-27 20:12:25,689][106225] Updated weights for policy 1, policy_version 136112 (0.0007) [2023-12-27 20:12:25,749][106225] Updated weights for policy 1, policy_version 136122 (0.0005) [2023-12-27 20:12:25,840][106226] Updated weights for policy 0, policy_version 136035 (0.0009) [2023-12-27 20:12:25,893][106226] Updated weights for policy 0, policy_version 136045 (0.0005) [2023-12-27 20:12:25,946][106226] Updated weights for policy 0, policy_version 136055 (0.0005) [2023-12-27 20:12:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 69697536. Throughput: 0: 9760.6, 1: 10064.9. Samples: 69660952. Policy #0 lag: (min: 15.0, avg: 23.1, max: 47.0) [2023-12-27 20:12:26,176][105115] Avg episode reward: [(0, '-5.141'), (1, '-6.643')] [2023-12-27 20:12:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000136128_34856960.pth... [2023-12-27 20:12:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000136064_34840576.pth... [2023-12-27 20:12:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000134912_34545664.pth [2023-12-27 20:12:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000134944_34553856.pth [2023-12-27 20:12:26,321][106225] Updated weights for policy 1, policy_version 136132 (0.0005) [2023-12-27 20:12:26,376][106225] Updated weights for policy 1, policy_version 136142 (0.0005) [2023-12-27 20:12:26,441][106225] Updated weights for policy 1, policy_version 136152 (0.0005) [2023-12-27 20:12:26,459][106226] Updated weights for policy 0, policy_version 136065 (0.0005) [2023-12-27 20:12:26,508][106226] Updated weights for policy 0, policy_version 136075 (0.0005) [2023-12-27 20:12:26,558][106226] Updated weights for policy 0, policy_version 136085 (0.0005) [2023-12-27 20:12:26,603][106226] Updated weights for policy 0, policy_version 136095 (0.0005) [2023-12-27 20:12:26,938][106225] Updated weights for policy 1, policy_version 136162 (0.0005) [2023-12-27 20:12:26,982][106225] Updated weights for policy 1, policy_version 136172 (0.0006) [2023-12-27 20:12:27,030][106225] Updated weights for policy 1, policy_version 136182 (0.0005) [2023-12-27 20:12:27,073][106225] Updated weights for policy 1, policy_version 136192 (0.0005) [2023-12-27 20:12:27,154][106226] Updated weights for policy 0, policy_version 136105 (0.0005) [2023-12-27 20:12:27,217][106226] Updated weights for policy 0, policy_version 136115 (0.0005) [2023-12-27 20:12:27,286][106226] Updated weights for policy 0, policy_version 136125 (0.0005) [2023-12-27 20:12:27,620][106225] Updated weights for policy 1, policy_version 136202 (0.0005) [2023-12-27 20:12:27,668][106225] Updated weights for policy 1, policy_version 136212 (0.0005) [2023-12-27 20:12:27,717][106225] Updated weights for policy 1, policy_version 136222 (0.0005) [2023-12-27 20:12:27,786][106226] Updated weights for policy 0, policy_version 136135 (0.0009) [2023-12-27 20:12:27,840][106226] Updated weights for policy 0, policy_version 136145 (0.0011) [2023-12-27 20:12:27,899][106226] Updated weights for policy 0, policy_version 136155 (0.0010) [2023-12-27 20:12:28,356][106225] Updated weights for policy 1, policy_version 136232 (0.0007) [2023-12-27 20:12:28,421][106225] Updated weights for policy 1, policy_version 136242 (0.0006) [2023-12-27 20:12:28,481][106225] Updated weights for policy 1, policy_version 136252 (0.0007) [2023-12-27 20:12:28,626][106226] Updated weights for policy 0, policy_version 136165 (0.0010) [2023-12-27 20:12:28,689][106226] Updated weights for policy 0, policy_version 136175 (0.0010) [2023-12-27 20:12:28,756][106226] Updated weights for policy 0, policy_version 136185 (0.0010) [2023-12-27 20:12:29,145][106225] Updated weights for policy 1, policy_version 136262 (0.0008) [2023-12-27 20:12:29,199][106225] Updated weights for policy 1, policy_version 136272 (0.0008) [2023-12-27 20:12:29,260][106225] Updated weights for policy 1, policy_version 136282 (0.0006) [2023-12-27 20:12:29,411][106226] Updated weights for policy 0, policy_version 136195 (0.0008) [2023-12-27 20:12:29,461][106226] Updated weights for policy 0, policy_version 136205 (0.0006) [2023-12-27 20:12:29,511][106226] Updated weights for policy 0, policy_version 136215 (0.0008) [2023-12-27 20:12:29,955][106225] Updated weights for policy 1, policy_version 136292 (0.0007) [2023-12-27 20:12:30,014][106225] Updated weights for policy 1, policy_version 136302 (0.0008) [2023-12-27 20:12:30,068][106225] Updated weights for policy 1, policy_version 136312 (0.0008) [2023-12-27 20:12:30,219][106226] Updated weights for policy 0, policy_version 136225 (0.0008) [2023-12-27 20:12:30,267][106226] Updated weights for policy 0, policy_version 136235 (0.0005) [2023-12-27 20:12:30,316][106226] Updated weights for policy 0, policy_version 136245 (0.0009) [2023-12-27 20:12:30,377][106226] Updated weights for policy 0, policy_version 136255 (0.0010) [2023-12-27 20:12:30,743][106225] Updated weights for policy 1, policy_version 136322 (0.0008) [2023-12-27 20:12:30,793][106225] Updated weights for policy 1, policy_version 136332 (0.0008) [2023-12-27 20:12:30,850][106225] Updated weights for policy 1, policy_version 136342 (0.0006) [2023-12-27 20:12:30,916][106225] Updated weights for policy 1, policy_version 136352 (0.0008) [2023-12-27 20:12:31,087][106226] Updated weights for policy 0, policy_version 136265 (0.0011) [2023-12-27 20:12:31,148][106226] Updated weights for policy 0, policy_version 136275 (0.0011) [2023-12-27 20:12:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 69804032. Throughput: 0: 9914.1, 1: 10250.7. Samples: 69795156. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:31,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-6.841')] [2023-12-27 20:12:31,218][106226] Updated weights for policy 0, policy_version 136285 (0.0011) [2023-12-27 20:12:31,620][106225] Updated weights for policy 1, policy_version 136362 (0.0009) [2023-12-27 20:12:31,679][106225] Updated weights for policy 1, policy_version 136372 (0.0008) [2023-12-27 20:12:31,745][106225] Updated weights for policy 1, policy_version 136382 (0.0009) [2023-12-27 20:12:31,948][106226] Updated weights for policy 0, policy_version 136295 (0.0007) [2023-12-27 20:12:32,015][106226] Updated weights for policy 0, policy_version 136305 (0.0005) [2023-12-27 20:12:32,086][106226] Updated weights for policy 0, policy_version 136315 (0.0006) [2023-12-27 20:12:32,502][106225] Updated weights for policy 1, policy_version 136392 (0.0008) [2023-12-27 20:12:32,550][106225] Updated weights for policy 1, policy_version 136402 (0.0005) [2023-12-27 20:12:32,617][106225] Updated weights for policy 1, policy_version 136412 (0.0008) [2023-12-27 20:12:32,702][106226] Updated weights for policy 0, policy_version 136325 (0.0008) [2023-12-27 20:12:32,766][106226] Updated weights for policy 0, policy_version 136335 (0.0008) [2023-12-27 20:12:32,827][106226] Updated weights for policy 0, policy_version 136345 (0.0008) [2023-12-27 20:12:33,292][106225] Updated weights for policy 1, policy_version 136422 (0.0010) [2023-12-27 20:12:33,336][106225] Updated weights for policy 1, policy_version 136432 (0.0010) [2023-12-27 20:12:33,393][106225] Updated weights for policy 1, policy_version 136442 (0.0010) [2023-12-27 20:12:33,561][106226] Updated weights for policy 0, policy_version 136355 (0.0007) [2023-12-27 20:12:33,608][106226] Updated weights for policy 0, policy_version 136365 (0.0009) [2023-12-27 20:12:33,661][106226] Updated weights for policy 0, policy_version 136376 (0.0009) [2023-12-27 20:12:33,995][106225] Updated weights for policy 1, policy_version 136452 (0.0006) [2023-12-27 20:12:34,042][106225] Updated weights for policy 1, policy_version 136462 (0.0006) [2023-12-27 20:12:34,094][106225] Updated weights for policy 1, policy_version 136472 (0.0008) [2023-12-27 20:12:34,415][106226] Updated weights for policy 0, policy_version 136386 (0.0009) [2023-12-27 20:12:34,473][106226] Updated weights for policy 0, policy_version 136396 (0.0008) [2023-12-27 20:12:34,535][106226] Updated weights for policy 0, policy_version 136406 (0.0008) [2023-12-27 20:12:34,599][106226] Updated weights for policy 0, policy_version 136416 (0.0008) [2023-12-27 20:12:34,853][106225] Updated weights for policy 1, policy_version 136482 (0.0009) [2023-12-27 20:12:34,917][106225] Updated weights for policy 1, policy_version 136492 (0.0010) [2023-12-27 20:12:34,976][106225] Updated weights for policy 1, policy_version 136502 (0.0010) [2023-12-27 20:12:35,032][106225] Updated weights for policy 1, policy_version 136512 (0.0009) [2023-12-27 20:12:35,328][106226] Updated weights for policy 0, policy_version 136426 (0.0008) [2023-12-27 20:12:35,378][106226] Updated weights for policy 0, policy_version 136436 (0.0010) [2023-12-27 20:12:35,425][106226] Updated weights for policy 0, policy_version 136446 (0.0010) [2023-12-27 20:12:35,733][106225] Updated weights for policy 1, policy_version 136522 (0.0008) [2023-12-27 20:12:35,784][106225] Updated weights for policy 1, policy_version 136532 (0.0009) [2023-12-27 20:12:35,838][106225] Updated weights for policy 1, policy_version 136542 (0.0007) [2023-12-27 20:12:36,091][106226] Updated weights for policy 0, policy_version 136456 (0.0010) [2023-12-27 20:12:36,158][106226] Updated weights for policy 0, policy_version 136466 (0.0010) [2023-12-27 20:12:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 69902336. Throughput: 0: 9871.5, 1: 10185.4. Samples: 69913944. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:36,175][105115] Avg episode reward: [(0, '-5.307'), (1, '-6.472')] [2023-12-27 20:12:36,222][106226] Updated weights for policy 0, policy_version 136476 (0.0010) [2023-12-27 20:12:36,584][106225] Updated weights for policy 1, policy_version 136552 (0.0007) [2023-12-27 20:12:36,636][106225] Updated weights for policy 1, policy_version 136562 (0.0008) [2023-12-27 20:12:36,687][106225] Updated weights for policy 1, policy_version 136572 (0.0008) [2023-12-27 20:12:36,973][106226] Updated weights for policy 0, policy_version 136486 (0.0011) [2023-12-27 20:12:37,027][106226] Updated weights for policy 0, policy_version 136496 (0.0010) [2023-12-27 20:12:37,078][106226] Updated weights for policy 0, policy_version 136506 (0.0010) [2023-12-27 20:12:37,367][106225] Updated weights for policy 1, policy_version 136582 (0.0007) [2023-12-27 20:12:37,420][106225] Updated weights for policy 1, policy_version 136592 (0.0007) [2023-12-27 20:12:37,481][106225] Updated weights for policy 1, policy_version 136602 (0.0008) [2023-12-27 20:12:37,840][106226] Updated weights for policy 0, policy_version 136516 (0.0010) [2023-12-27 20:12:37,903][106226] Updated weights for policy 0, policy_version 136526 (0.0008) [2023-12-27 20:12:37,964][106226] Updated weights for policy 0, policy_version 136536 (0.0008) [2023-12-27 20:12:38,196][106225] Updated weights for policy 1, policy_version 136612 (0.0007) [2023-12-27 20:12:38,249][106225] Updated weights for policy 1, policy_version 136622 (0.0008) [2023-12-27 20:12:38,300][106225] Updated weights for policy 1, policy_version 136632 (0.0010) [2023-12-27 20:12:38,674][106226] Updated weights for policy 0, policy_version 136546 (0.0007) [2023-12-27 20:12:38,738][106226] Updated weights for policy 0, policy_version 136556 (0.0008) [2023-12-27 20:12:38,800][106226] Updated weights for policy 0, policy_version 136566 (0.0008) [2023-12-27 20:12:38,848][106226] Updated weights for policy 0, policy_version 136576 (0.0009) [2023-12-27 20:12:39,007][106225] Updated weights for policy 1, policy_version 136642 (0.0009) [2023-12-27 20:12:39,055][106225] Updated weights for policy 1, policy_version 136652 (0.0008) [2023-12-27 20:12:39,113][106225] Updated weights for policy 1, policy_version 136662 (0.0010) [2023-12-27 20:12:39,161][106225] Updated weights for policy 1, policy_version 136672 (0.0010) [2023-12-27 20:12:39,510][106226] Updated weights for policy 0, policy_version 136586 (0.0006) [2023-12-27 20:12:39,576][106226] Updated weights for policy 0, policy_version 136596 (0.0006) [2023-12-27 20:12:39,640][106226] Updated weights for policy 0, policy_version 136606 (0.0006) [2023-12-27 20:12:39,900][106225] Updated weights for policy 1, policy_version 136682 (0.0009) [2023-12-27 20:12:39,954][106225] Updated weights for policy 1, policy_version 136692 (0.0012) [2023-12-27 20:12:40,020][106225] Updated weights for policy 1, policy_version 136702 (0.0010) [2023-12-27 20:12:40,397][106226] Updated weights for policy 0, policy_version 136616 (0.0008) [2023-12-27 20:12:40,459][106226] Updated weights for policy 0, policy_version 136626 (0.0008) [2023-12-27 20:12:40,524][106226] Updated weights for policy 0, policy_version 136636 (0.0009) [2023-12-27 20:12:40,669][106225] Updated weights for policy 1, policy_version 136712 (0.0011) [2023-12-27 20:12:40,733][106225] Updated weights for policy 1, policy_version 136722 (0.0011) [2023-12-27 20:12:40,800][106225] Updated weights for policy 1, policy_version 136732 (0.0011) [2023-12-27 20:12:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 70000640. Throughput: 0: 9880.4, 1: 10170.3. Samples: 69971672. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:41,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-6.834')] [2023-12-27 20:12:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000136736_35012608.pth... [2023-12-27 20:12:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000136640_34988032.pth... [2023-12-27 20:12:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000135552_34709504.pth [2023-12-27 20:12:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000135488_34693120.pth [2023-12-27 20:12:41,332][106226] Updated weights for policy 0, policy_version 136646 (0.0009) [2023-12-27 20:12:41,403][106226] Updated weights for policy 0, policy_version 136656 (0.0009) [2023-12-27 20:12:41,452][106225] Updated weights for policy 1, policy_version 136742 (0.0009) [2023-12-27 20:12:41,458][106226] Updated weights for policy 0, policy_version 136666 (0.0008) [2023-12-27 20:12:41,510][106225] Updated weights for policy 1, policy_version 136752 (0.0008) [2023-12-27 20:12:41,572][106225] Updated weights for policy 1, policy_version 136762 (0.0008) [2023-12-27 20:12:42,267][106226] Updated weights for policy 0, policy_version 136676 (0.0009) [2023-12-27 20:12:42,317][106225] Updated weights for policy 1, policy_version 136772 (0.0008) [2023-12-27 20:12:42,329][106226] Updated weights for policy 0, policy_version 136686 (0.0010) [2023-12-27 20:12:42,384][106225] Updated weights for policy 1, policy_version 136782 (0.0009) [2023-12-27 20:12:42,394][106226] Updated weights for policy 0, policy_version 136696 (0.0009) [2023-12-27 20:12:42,441][106225] Updated weights for policy 1, policy_version 136792 (0.0007) [2023-12-27 20:12:43,091][106225] Updated weights for policy 1, policy_version 136802 (0.0009) [2023-12-27 20:12:43,133][106226] Updated weights for policy 0, policy_version 136706 (0.0008) [2023-12-27 20:12:43,147][106225] Updated weights for policy 1, policy_version 136812 (0.0007) [2023-12-27 20:12:43,191][106226] Updated weights for policy 0, policy_version 136716 (0.0008) [2023-12-27 20:12:43,197][106225] Updated weights for policy 1, policy_version 136822 (0.0006) [2023-12-27 20:12:43,239][106226] Updated weights for policy 0, policy_version 136726 (0.0006) [2023-12-27 20:12:43,252][106225] Updated weights for policy 1, policy_version 136832 (0.0006) [2023-12-27 20:12:43,292][106226] Updated weights for policy 0, policy_version 136736 (0.0009) [2023-12-27 20:12:43,824][106225] Updated weights for policy 1, policy_version 136842 (0.0005) [2023-12-27 20:12:43,899][106225] Updated weights for policy 1, policy_version 136852 (0.0010) [2023-12-27 20:12:43,966][106225] Updated weights for policy 1, policy_version 136862 (0.0010) [2023-12-27 20:12:44,080][106226] Updated weights for policy 0, policy_version 136746 (0.0006) [2023-12-27 20:12:44,146][106226] Updated weights for policy 0, policy_version 136756 (0.0006) [2023-12-27 20:12:44,215][106226] Updated weights for policy 0, policy_version 136766 (0.0008) [2023-12-27 20:12:44,641][106225] Updated weights for policy 1, policy_version 136872 (0.0010) [2023-12-27 20:12:44,687][106225] Updated weights for policy 1, policy_version 136882 (0.0010) [2023-12-27 20:12:44,745][106225] Updated weights for policy 1, policy_version 136892 (0.0010) [2023-12-27 20:12:44,763][106226] Updated weights for policy 0, policy_version 136776 (0.0008) [2023-12-27 20:12:44,830][106226] Updated weights for policy 0, policy_version 136786 (0.0009) [2023-12-27 20:12:44,898][106226] Updated weights for policy 0, policy_version 136796 (0.0008) [2023-12-27 20:12:45,448][106225] Updated weights for policy 1, policy_version 136902 (0.0010) [2023-12-27 20:12:45,498][106225] Updated weights for policy 1, policy_version 136912 (0.0010) [2023-12-27 20:12:45,557][106225] Updated weights for policy 1, policy_version 136922 (0.0010) [2023-12-27 20:12:45,585][106226] Updated weights for policy 0, policy_version 136806 (0.0009) [2023-12-27 20:12:45,644][106226] Updated weights for policy 0, policy_version 136816 (0.0010) [2023-12-27 20:12:45,700][106226] Updated weights for policy 0, policy_version 136826 (0.0010) [2023-12-27 20:12:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 70098944. Throughput: 0: 9785.7, 1: 10154.5. Samples: 70089232. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:46,175][105115] Avg episode reward: [(0, '-5.238'), (1, '-6.660')] [2023-12-27 20:12:46,293][106225] Updated weights for policy 1, policy_version 136932 (0.0010) [2023-12-27 20:12:46,346][106225] Updated weights for policy 1, policy_version 136942 (0.0010) [2023-12-27 20:12:46,354][106226] Updated weights for policy 0, policy_version 136836 (0.0010) [2023-12-27 20:12:46,393][106225] Updated weights for policy 1, policy_version 136952 (0.0010) [2023-12-27 20:12:46,417][106226] Updated weights for policy 0, policy_version 136846 (0.0010) [2023-12-27 20:12:46,466][106226] Updated weights for policy 0, policy_version 136856 (0.0010) [2023-12-27 20:12:47,112][106226] Updated weights for policy 0, policy_version 136866 (0.0009) [2023-12-27 20:12:47,115][106225] Updated weights for policy 1, policy_version 136962 (0.0010) [2023-12-27 20:12:47,164][106226] Updated weights for policy 0, policy_version 136876 (0.0007) [2023-12-27 20:12:47,173][106225] Updated weights for policy 1, policy_version 136972 (0.0010) [2023-12-27 20:12:47,227][106226] Updated weights for policy 0, policy_version 136886 (0.0005) [2023-12-27 20:12:47,233][106225] Updated weights for policy 1, policy_version 136982 (0.0010) [2023-12-27 20:12:47,288][106226] Updated weights for policy 0, policy_version 136896 (0.0005) [2023-12-27 20:12:47,295][106225] Updated weights for policy 1, policy_version 136992 (0.0010) [2023-12-27 20:12:47,888][106226] Updated weights for policy 0, policy_version 136906 (0.0005) [2023-12-27 20:12:47,943][106226] Updated weights for policy 0, policy_version 136916 (0.0006) [2023-12-27 20:12:47,997][106226] Updated weights for policy 0, policy_version 136926 (0.0006) [2023-12-27 20:12:48,015][106225] Updated weights for policy 1, policy_version 137002 (0.0010) [2023-12-27 20:12:48,079][106225] Updated weights for policy 1, policy_version 137012 (0.0010) [2023-12-27 20:12:48,140][106225] Updated weights for policy 1, policy_version 137022 (0.0010) [2023-12-27 20:12:48,710][106226] Updated weights for policy 0, policy_version 136936 (0.0010) [2023-12-27 20:12:48,774][106226] Updated weights for policy 0, policy_version 136946 (0.0011) [2023-12-27 20:12:48,812][106225] Updated weights for policy 1, policy_version 137032 (0.0010) [2023-12-27 20:12:48,832][106226] Updated weights for policy 0, policy_version 136956 (0.0010) [2023-12-27 20:12:48,867][106225] Updated weights for policy 1, policy_version 137042 (0.0010) [2023-12-27 20:12:48,917][106225] Updated weights for policy 1, policy_version 137052 (0.0010) [2023-12-27 20:12:49,577][106226] Updated weights for policy 0, policy_version 136966 (0.0009) [2023-12-27 20:12:49,643][106226] Updated weights for policy 0, policy_version 136976 (0.0009) [2023-12-27 20:12:49,664][106225] Updated weights for policy 1, policy_version 137062 (0.0008) [2023-12-27 20:12:49,714][106226] Updated weights for policy 0, policy_version 136986 (0.0008) [2023-12-27 20:12:49,722][106225] Updated weights for policy 1, policy_version 137072 (0.0007) [2023-12-27 20:12:49,786][106225] Updated weights for policy 1, policy_version 137082 (0.0007) [2023-12-27 20:12:50,483][106226] Updated weights for policy 0, policy_version 136996 (0.0009) [2023-12-27 20:12:50,516][106225] Updated weights for policy 1, policy_version 137092 (0.0008) [2023-12-27 20:12:50,535][106226] Updated weights for policy 0, policy_version 137006 (0.0008) [2023-12-27 20:12:50,575][106225] Updated weights for policy 1, policy_version 137102 (0.0008) [2023-12-27 20:12:50,593][106226] Updated weights for policy 0, policy_version 137016 (0.0008) [2023-12-27 20:12:50,634][106225] Updated weights for policy 1, policy_version 137112 (0.0008) [2023-12-27 20:12:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 70197248. Throughput: 0: 9824.9, 1: 10048.1. Samples: 70206796. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:51,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-6.881')] [2023-12-27 20:12:51,382][106225] Updated weights for policy 1, policy_version 137122 (0.0009) [2023-12-27 20:12:51,432][106226] Updated weights for policy 0, policy_version 137026 (0.0009) [2023-12-27 20:12:51,447][106225] Updated weights for policy 1, policy_version 137132 (0.0009) [2023-12-27 20:12:51,500][106226] Updated weights for policy 0, policy_version 137036 (0.0007) [2023-12-27 20:12:51,511][106225] Updated weights for policy 1, policy_version 137142 (0.0007) [2023-12-27 20:12:51,561][106226] Updated weights for policy 0, policy_version 137046 (0.0006) [2023-12-27 20:12:51,574][106225] Updated weights for policy 1, policy_version 137152 (0.0008) [2023-12-27 20:12:51,622][106226] Updated weights for policy 0, policy_version 137056 (0.0007) [2023-12-27 20:12:52,243][106225] Updated weights for policy 1, policy_version 137162 (0.0007) [2023-12-27 20:12:52,301][106225] Updated weights for policy 1, policy_version 137172 (0.0007) [2023-12-27 20:12:52,359][106225] Updated weights for policy 1, policy_version 137182 (0.0006) [2023-12-27 20:12:52,377][106226] Updated weights for policy 0, policy_version 137066 (0.0009) [2023-12-27 20:12:52,445][106226] Updated weights for policy 0, policy_version 137076 (0.0009) [2023-12-27 20:12:52,506][106226] Updated weights for policy 0, policy_version 137086 (0.0007) [2023-12-27 20:12:53,052][106225] Updated weights for policy 1, policy_version 137192 (0.0006) [2023-12-27 20:12:53,108][106225] Updated weights for policy 1, policy_version 137202 (0.0005) [2023-12-27 20:12:53,170][106225] Updated weights for policy 1, policy_version 137212 (0.0005) [2023-12-27 20:12:53,248][106226] Updated weights for policy 0, policy_version 137096 (0.0009) [2023-12-27 20:12:53,297][106226] Updated weights for policy 0, policy_version 137106 (0.0009) [2023-12-27 20:12:53,342][106226] Updated weights for policy 0, policy_version 137116 (0.0008) [2023-12-27 20:12:53,790][106225] Updated weights for policy 1, policy_version 137222 (0.0007) [2023-12-27 20:12:53,844][106225] Updated weights for policy 1, policy_version 137232 (0.0008) [2023-12-27 20:12:53,892][106225] Updated weights for policy 1, policy_version 137242 (0.0008) [2023-12-27 20:12:54,102][106226] Updated weights for policy 0, policy_version 137126 (0.0009) [2023-12-27 20:12:54,174][106226] Updated weights for policy 0, policy_version 137136 (0.0009) [2023-12-27 20:12:54,239][106226] Updated weights for policy 0, policy_version 137146 (0.0009) [2023-12-27 20:12:54,578][106225] Updated weights for policy 1, policy_version 137252 (0.0007) [2023-12-27 20:12:54,633][106225] Updated weights for policy 1, policy_version 137262 (0.0008) [2023-12-27 20:12:54,684][106225] Updated weights for policy 1, policy_version 137272 (0.0008) [2023-12-27 20:12:55,033][106226] Updated weights for policy 0, policy_version 137156 (0.0010) [2023-12-27 20:12:55,091][106226] Updated weights for policy 0, policy_version 137166 (0.0008) [2023-12-27 20:12:55,154][106226] Updated weights for policy 0, policy_version 137176 (0.0009) [2023-12-27 20:12:55,302][106225] Updated weights for policy 1, policy_version 137282 (0.0008) [2023-12-27 20:12:55,349][106225] Updated weights for policy 1, policy_version 137292 (0.0008) [2023-12-27 20:12:55,397][106225] Updated weights for policy 1, policy_version 137302 (0.0008) [2023-12-27 20:12:55,448][106225] Updated weights for policy 1, policy_version 137312 (0.0008) [2023-12-27 20:12:55,876][106226] Updated weights for policy 0, policy_version 137186 (0.0009) [2023-12-27 20:12:55,941][106226] Updated weights for policy 0, policy_version 137196 (0.0010) [2023-12-27 20:12:55,997][106226] Updated weights for policy 0, policy_version 137206 (0.0010) [2023-12-27 20:12:56,051][106226] Updated weights for policy 0, policy_version 137216 (0.0010) [2023-12-27 20:12:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 70295552. Throughput: 0: 9815.3, 1: 10059.3. Samples: 70264844. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:12:56,175][105115] Avg episode reward: [(0, '-5.017'), (1, '-6.562')] [2023-12-27 20:12:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000137216_35135488.pth... [2023-12-27 20:12:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000136064_34840576.pth [2023-12-27 20:12:56,201][106225] Updated weights for policy 1, policy_version 137322 (0.0010) [2023-12-27 20:12:56,255][106225] Updated weights for policy 1, policy_version 137332 (0.0010) [2023-12-27 20:12:56,304][106225] Updated weights for policy 1, policy_version 137342 (0.0010) [2023-12-27 20:12:56,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000137344_35168256.pth... [2023-12-27 20:12:56,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000136128_34856960.pth [2023-12-27 20:12:56,660][106226] Updated weights for policy 0, policy_version 137226 (0.0005) [2023-12-27 20:12:56,710][106226] Updated weights for policy 0, policy_version 137236 (0.0005) [2023-12-27 20:12:56,760][106226] Updated weights for policy 0, policy_version 137246 (0.0005) [2023-12-27 20:12:57,022][106225] Updated weights for policy 1, policy_version 137352 (0.0009) [2023-12-27 20:12:57,071][106225] Updated weights for policy 1, policy_version 137362 (0.0008) [2023-12-27 20:12:57,118][106225] Updated weights for policy 1, policy_version 137373 (0.0010) [2023-12-27 20:12:57,404][106226] Updated weights for policy 0, policy_version 137256 (0.0006) [2023-12-27 20:12:57,460][106226] Updated weights for policy 0, policy_version 137266 (0.0010) [2023-12-27 20:12:57,513][106226] Updated weights for policy 0, policy_version 137276 (0.0010) [2023-12-27 20:12:57,674][106225] Updated weights for policy 1, policy_version 137383 (0.0008) [2023-12-27 20:12:57,726][106225] Updated weights for policy 1, policy_version 137393 (0.0010) [2023-12-27 20:12:57,781][106225] Updated weights for policy 1, policy_version 137403 (0.0010) [2023-12-27 20:12:58,135][106226] Updated weights for policy 0, policy_version 137286 (0.0007) [2023-12-27 20:12:58,195][106226] Updated weights for policy 0, policy_version 137296 (0.0008) [2023-12-27 20:12:58,262][106226] Updated weights for policy 0, policy_version 137306 (0.0006) [2023-12-27 20:12:58,585][106225] Updated weights for policy 1, policy_version 137413 (0.0009) [2023-12-27 20:12:58,645][106225] Updated weights for policy 1, policy_version 137423 (0.0009) [2023-12-27 20:12:58,706][106225] Updated weights for policy 1, policy_version 137433 (0.0008) [2023-12-27 20:12:59,056][106226] Updated weights for policy 0, policy_version 137316 (0.0007) [2023-12-27 20:12:59,117][106226] Updated weights for policy 0, policy_version 137326 (0.0008) [2023-12-27 20:12:59,177][106226] Updated weights for policy 0, policy_version 137336 (0.0007) [2023-12-27 20:12:59,493][106225] Updated weights for policy 1, policy_version 137443 (0.0009) [2023-12-27 20:12:59,543][106225] Updated weights for policy 1, policy_version 137453 (0.0008) [2023-12-27 20:12:59,594][106225] Updated weights for policy 1, policy_version 137463 (0.0006) [2023-12-27 20:12:59,943][106226] Updated weights for policy 0, policy_version 137346 (0.0008) [2023-12-27 20:13:00,007][106226] Updated weights for policy 0, policy_version 137356 (0.0009) [2023-12-27 20:13:00,068][106226] Updated weights for policy 0, policy_version 137366 (0.0008) [2023-12-27 20:13:00,133][106226] Updated weights for policy 0, policy_version 137376 (0.0008) [2023-12-27 20:13:00,293][106225] Updated weights for policy 1, policy_version 137473 (0.0006) [2023-12-27 20:13:00,353][106225] Updated weights for policy 1, policy_version 137483 (0.0009) [2023-12-27 20:13:00,415][106225] Updated weights for policy 1, policy_version 137493 (0.0009) [2023-12-27 20:13:00,475][106225] Updated weights for policy 1, policy_version 137503 (0.0008) [2023-12-27 20:13:00,836][106226] Updated weights for policy 0, policy_version 137386 (0.0007) [2023-12-27 20:13:00,901][106226] Updated weights for policy 0, policy_version 137396 (0.0008) [2023-12-27 20:13:00,954][106226] Updated weights for policy 0, policy_version 137406 (0.0009) [2023-12-27 20:13:01,163][106225] Updated weights for policy 1, policy_version 137513 (0.0008) [2023-12-27 20:13:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 70393856. Throughput: 0: 9818.7, 1: 10162.3. Samples: 70384188. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:01,175][105115] Avg episode reward: [(0, '-5.231'), (1, '-6.724')] [2023-12-27 20:13:01,224][106225] Updated weights for policy 1, policy_version 137523 (0.0010) [2023-12-27 20:13:01,284][106225] Updated weights for policy 1, policy_version 137533 (0.0008) [2023-12-27 20:13:01,636][106226] Updated weights for policy 0, policy_version 137416 (0.0007) [2023-12-27 20:13:01,701][106226] Updated weights for policy 0, policy_version 137426 (0.0007) [2023-12-27 20:13:01,764][106226] Updated weights for policy 0, policy_version 137436 (0.0008) [2023-12-27 20:13:02,004][106225] Updated weights for policy 1, policy_version 137543 (0.0006) [2023-12-27 20:13:02,054][106225] Updated weights for policy 1, policy_version 137553 (0.0006) [2023-12-27 20:13:02,112][106225] Updated weights for policy 1, policy_version 137563 (0.0005) [2023-12-27 20:13:02,530][106226] Updated weights for policy 0, policy_version 137446 (0.0007) [2023-12-27 20:13:02,599][106226] Updated weights for policy 0, policy_version 137456 (0.0005) [2023-12-27 20:13:02,666][106226] Updated weights for policy 0, policy_version 137466 (0.0007) [2023-12-27 20:13:02,723][106225] Updated weights for policy 1, policy_version 137573 (0.0007) [2023-12-27 20:13:02,775][106225] Updated weights for policy 1, policy_version 137583 (0.0008) [2023-12-27 20:13:02,827][106225] Updated weights for policy 1, policy_version 137593 (0.0008) [2023-12-27 20:13:03,274][106226] Updated weights for policy 0, policy_version 137476 (0.0008) [2023-12-27 20:13:03,331][106226] Updated weights for policy 0, policy_version 137486 (0.0007) [2023-12-27 20:13:03,390][106226] Updated weights for policy 0, policy_version 137496 (0.0005) [2023-12-27 20:13:03,616][106225] Updated weights for policy 1, policy_version 137603 (0.0008) [2023-12-27 20:13:03,685][106225] Updated weights for policy 1, policy_version 137613 (0.0009) [2023-12-27 20:13:03,750][106225] Updated weights for policy 1, policy_version 137623 (0.0007) [2023-12-27 20:13:03,973][106226] Updated weights for policy 0, policy_version 137506 (0.0009) [2023-12-27 20:13:04,029][106226] Updated weights for policy 0, policy_version 137516 (0.0008) [2023-12-27 20:13:04,086][106226] Updated weights for policy 0, policy_version 137526 (0.0009) [2023-12-27 20:13:04,151][106226] Updated weights for policy 0, policy_version 137536 (0.0008) [2023-12-27 20:13:04,501][106225] Updated weights for policy 1, policy_version 137633 (0.0008) [2023-12-27 20:13:04,568][106225] Updated weights for policy 1, policy_version 137643 (0.0006) [2023-12-27 20:13:04,614][106225] Updated weights for policy 1, policy_version 137653 (0.0005) [2023-12-27 20:13:04,670][106225] Updated weights for policy 1, policy_version 137663 (0.0005) [2023-12-27 20:13:04,759][106226] Updated weights for policy 0, policy_version 137546 (0.0009) [2023-12-27 20:13:04,826][106226] Updated weights for policy 0, policy_version 137556 (0.0008) [2023-12-27 20:13:04,879][106226] Updated weights for policy 0, policy_version 137566 (0.0008) [2023-12-27 20:13:05,321][106225] Updated weights for policy 1, policy_version 137673 (0.0009) [2023-12-27 20:13:05,380][106225] Updated weights for policy 1, policy_version 137683 (0.0005) [2023-12-27 20:13:05,439][106225] Updated weights for policy 1, policy_version 137693 (0.0008) [2023-12-27 20:13:05,633][106226] Updated weights for policy 0, policy_version 137576 (0.0008) [2023-12-27 20:13:05,686][106226] Updated weights for policy 0, policy_version 137586 (0.0008) [2023-12-27 20:13:05,740][106226] Updated weights for policy 0, policy_version 137596 (0.0008) [2023-12-27 20:13:05,991][106225] Updated weights for policy 1, policy_version 137703 (0.0009) [2023-12-27 20:13:06,040][106225] Updated weights for policy 1, policy_version 137713 (0.0010) [2023-12-27 20:13:06,100][106225] Updated weights for policy 1, policy_version 137723 (0.0010) [2023-12-27 20:13:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 70500352. Throughput: 0: 9852.8, 1: 10139.5. Samples: 70503952. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:06,175][105115] Avg episode reward: [(0, '-5.314'), (1, '-6.706')] [2023-12-27 20:13:06,532][106226] Updated weights for policy 0, policy_version 137606 (0.0010) [2023-12-27 20:13:06,590][106226] Updated weights for policy 0, policy_version 137616 (0.0011) [2023-12-27 20:13:06,655][106226] Updated weights for policy 0, policy_version 137626 (0.0011) [2023-12-27 20:13:06,816][106225] Updated weights for policy 1, policy_version 137733 (0.0010) [2023-12-27 20:13:06,880][106225] Updated weights for policy 1, policy_version 137743 (0.0010) [2023-12-27 20:13:06,966][106225] Updated weights for policy 1, policy_version 137753 (0.0009) [2023-12-27 20:13:07,372][106226] Updated weights for policy 0, policy_version 137636 (0.0011) [2023-12-27 20:13:07,433][106226] Updated weights for policy 0, policy_version 137646 (0.0010) [2023-12-27 20:13:07,501][106226] Updated weights for policy 0, policy_version 137656 (0.0010) [2023-12-27 20:13:07,664][106225] Updated weights for policy 1, policy_version 137763 (0.0009) [2023-12-27 20:13:07,728][106225] Updated weights for policy 1, policy_version 137773 (0.0008) [2023-12-27 20:13:07,776][106225] Updated weights for policy 1, policy_version 137783 (0.0008) [2023-12-27 20:13:08,107][106226] Updated weights for policy 0, policy_version 137666 (0.0009) [2023-12-27 20:13:08,169][106226] Updated weights for policy 0, policy_version 137676 (0.0010) [2023-12-27 20:13:08,222][106226] Updated weights for policy 0, policy_version 137686 (0.0008) [2023-12-27 20:13:08,273][106226] Updated weights for policy 0, policy_version 137696 (0.0005) [2023-12-27 20:13:08,513][106225] Updated weights for policy 1, policy_version 137793 (0.0008) [2023-12-27 20:13:08,576][106225] Updated weights for policy 1, policy_version 137803 (0.0005) [2023-12-27 20:13:08,642][106225] Updated weights for policy 1, policy_version 137813 (0.0007) [2023-12-27 20:13:08,709][106225] Updated weights for policy 1, policy_version 137823 (0.0006) [2023-12-27 20:13:08,956][106226] Updated weights for policy 0, policy_version 137706 (0.0011) [2023-12-27 20:13:09,017][106226] Updated weights for policy 0, policy_version 137716 (0.0011) [2023-12-27 20:13:09,087][106226] Updated weights for policy 0, policy_version 137726 (0.0006) [2023-12-27 20:13:09,338][106225] Updated weights for policy 1, policy_version 137833 (0.0010) [2023-12-27 20:13:09,406][106225] Updated weights for policy 1, policy_version 137843 (0.0009) [2023-12-27 20:13:09,468][106225] Updated weights for policy 1, policy_version 137853 (0.0012) [2023-12-27 20:13:09,782][106226] Updated weights for policy 0, policy_version 137736 (0.0010) [2023-12-27 20:13:09,854][106226] Updated weights for policy 0, policy_version 137746 (0.0011) [2023-12-27 20:13:09,917][106226] Updated weights for policy 0, policy_version 137756 (0.0011) [2023-12-27 20:13:10,201][106225] Updated weights for policy 1, policy_version 137863 (0.0009) [2023-12-27 20:13:10,267][106225] Updated weights for policy 1, policy_version 137873 (0.0006) [2023-12-27 20:13:10,337][106225] Updated weights for policy 1, policy_version 137883 (0.0006) [2023-12-27 20:13:10,589][106226] Updated weights for policy 0, policy_version 137766 (0.0011) [2023-12-27 20:13:10,646][106226] Updated weights for policy 0, policy_version 137776 (0.0011) [2023-12-27 20:13:10,698][106226] Updated weights for policy 0, policy_version 137786 (0.0011) [2023-12-27 20:13:11,003][106225] Updated weights for policy 1, policy_version 137893 (0.0008) [2023-12-27 20:13:11,067][106225] Updated weights for policy 1, policy_version 137903 (0.0008) [2023-12-27 20:13:11,130][106225] Updated weights for policy 1, policy_version 137913 (0.0009) [2023-12-27 20:13:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 70598656. Throughput: 0: 9904.8, 1: 10171.2. Samples: 70564372. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:11,175][105115] Avg episode reward: [(0, '-5.322'), (1, '-7.083')] [2023-12-27 20:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000137792_35282944.pth... [2023-12-27 20:13:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000137920_35315712.pth... [2023-12-27 20:13:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000136640_34988032.pth [2023-12-27 20:13:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000136736_35012608.pth [2023-12-27 20:13:11,487][106226] Updated weights for policy 0, policy_version 137796 (0.0009) [2023-12-27 20:13:11,537][106226] Updated weights for policy 0, policy_version 137806 (0.0006) [2023-12-27 20:13:11,592][106226] Updated weights for policy 0, policy_version 137816 (0.0008) [2023-12-27 20:13:11,964][106225] Updated weights for policy 1, policy_version 137923 (0.0009) [2023-12-27 20:13:12,022][106225] Updated weights for policy 1, policy_version 137933 (0.0010) [2023-12-27 20:13:12,088][106225] Updated weights for policy 1, policy_version 137943 (0.0011) [2023-12-27 20:13:12,410][106226] Updated weights for policy 0, policy_version 137826 (0.0007) [2023-12-27 20:13:12,476][106226] Updated weights for policy 0, policy_version 137836 (0.0006) [2023-12-27 20:13:12,539][106226] Updated weights for policy 0, policy_version 137846 (0.0007) [2023-12-27 20:13:12,595][106226] Updated weights for policy 0, policy_version 137856 (0.0007) [2023-12-27 20:13:12,802][106225] Updated weights for policy 1, policy_version 137953 (0.0008) [2023-12-27 20:13:12,853][106225] Updated weights for policy 1, policy_version 137963 (0.0010) [2023-12-27 20:13:12,903][106225] Updated weights for policy 1, policy_version 137973 (0.0010) [2023-12-27 20:13:12,953][106225] Updated weights for policy 1, policy_version 137983 (0.0005) [2023-12-27 20:13:13,301][106226] Updated weights for policy 0, policy_version 137866 (0.0006) [2023-12-27 20:13:13,366][106226] Updated weights for policy 0, policy_version 137876 (0.0005) [2023-12-27 20:13:13,423][106226] Updated weights for policy 0, policy_version 137886 (0.0010) [2023-12-27 20:13:13,521][106225] Updated weights for policy 1, policy_version 137993 (0.0008) [2023-12-27 20:13:13,578][106225] Updated weights for policy 1, policy_version 138003 (0.0007) [2023-12-27 20:13:13,639][106225] Updated weights for policy 1, policy_version 138013 (0.0009) [2023-12-27 20:13:14,004][106226] Updated weights for policy 0, policy_version 137896 (0.0006) [2023-12-27 20:13:14,069][106226] Updated weights for policy 0, policy_version 137906 (0.0008) [2023-12-27 20:13:14,117][106226] Updated weights for policy 0, policy_version 137916 (0.0007) [2023-12-27 20:13:14,179][106225] Updated weights for policy 1, policy_version 138023 (0.0005) [2023-12-27 20:13:14,245][106225] Updated weights for policy 1, policy_version 138033 (0.0006) [2023-12-27 20:13:14,307][106225] Updated weights for policy 1, policy_version 138043 (0.0005) [2023-12-27 20:13:14,679][106226] Updated weights for policy 0, policy_version 137926 (0.0008) [2023-12-27 20:13:14,738][106226] Updated weights for policy 0, policy_version 137936 (0.0008) [2023-12-27 20:13:14,806][106226] Updated weights for policy 0, policy_version 137946 (0.0009) [2023-12-27 20:13:14,851][106225] Updated weights for policy 1, policy_version 138053 (0.0008) [2023-12-27 20:13:14,914][106225] Updated weights for policy 1, policy_version 138063 (0.0009) [2023-12-27 20:13:14,980][106225] Updated weights for policy 1, policy_version 138073 (0.0009) [2023-12-27 20:13:15,444][106226] Updated weights for policy 0, policy_version 137956 (0.0007) [2023-12-27 20:13:15,499][106226] Updated weights for policy 0, policy_version 137966 (0.0005) [2023-12-27 20:13:15,560][106226] Updated weights for policy 0, policy_version 137976 (0.0006) [2023-12-27 20:13:15,748][106225] Updated weights for policy 1, policy_version 138083 (0.0008) [2023-12-27 20:13:15,805][106225] Updated weights for policy 1, policy_version 138093 (0.0008) [2023-12-27 20:13:15,858][106225] Updated weights for policy 1, policy_version 138103 (0.0009) [2023-12-27 20:13:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19966.3). Total num frames: 70696960. Throughput: 0: 9782.9, 1: 10026.5. Samples: 70686580. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:16,175][105115] Avg episode reward: [(0, '-5.608'), (1, '-7.111')] [2023-12-27 20:13:16,220][106226] Updated weights for policy 0, policy_version 137986 (0.0009) [2023-12-27 20:13:16,291][106226] Updated weights for policy 0, policy_version 137996 (0.0008) [2023-12-27 20:13:16,347][106226] Updated weights for policy 0, policy_version 138006 (0.0008) [2023-12-27 20:13:16,405][106226] Updated weights for policy 0, policy_version 138016 (0.0008) [2023-12-27 20:13:16,586][106225] Updated weights for policy 1, policy_version 138113 (0.0009) [2023-12-27 20:13:16,646][106225] Updated weights for policy 1, policy_version 138123 (0.0009) [2023-12-27 20:13:16,698][106225] Updated weights for policy 1, policy_version 138133 (0.0008) [2023-12-27 20:13:16,760][106225] Updated weights for policy 1, policy_version 138143 (0.0008) [2023-12-27 20:13:17,114][106226] Updated weights for policy 0, policy_version 138026 (0.0009) [2023-12-27 20:13:17,168][106226] Updated weights for policy 0, policy_version 138036 (0.0008) [2023-12-27 20:13:17,219][106226] Updated weights for policy 0, policy_version 138046 (0.0009) [2023-12-27 20:13:17,485][106225] Updated weights for policy 1, policy_version 138153 (0.0008) [2023-12-27 20:13:17,554][106225] Updated weights for policy 1, policy_version 138163 (0.0006) [2023-12-27 20:13:17,604][106225] Updated weights for policy 1, policy_version 138173 (0.0008) [2023-12-27 20:13:17,949][106226] Updated weights for policy 0, policy_version 138056 (0.0008) [2023-12-27 20:13:18,006][106226] Updated weights for policy 0, policy_version 138066 (0.0008) [2023-12-27 20:13:18,062][106226] Updated weights for policy 0, policy_version 138076 (0.0008) [2023-12-27 20:13:18,299][106225] Updated weights for policy 1, policy_version 138183 (0.0006) [2023-12-27 20:13:18,367][106225] Updated weights for policy 1, policy_version 138193 (0.0008) [2023-12-27 20:13:18,427][106225] Updated weights for policy 1, policy_version 138203 (0.0009) [2023-12-27 20:13:18,825][106226] Updated weights for policy 0, policy_version 138086 (0.0008) [2023-12-27 20:13:18,885][106226] Updated weights for policy 0, policy_version 138096 (0.0009) [2023-12-27 20:13:18,949][106226] Updated weights for policy 0, policy_version 138106 (0.0009) [2023-12-27 20:13:19,039][106225] Updated weights for policy 1, policy_version 138213 (0.0008) [2023-12-27 20:13:19,097][106225] Updated weights for policy 1, policy_version 138223 (0.0006) [2023-12-27 20:13:19,153][106225] Updated weights for policy 1, policy_version 138233 (0.0008) [2023-12-27 20:13:19,655][106226] Updated weights for policy 0, policy_version 138116 (0.0008) [2023-12-27 20:13:19,709][106226] Updated weights for policy 0, policy_version 138126 (0.0005) [2023-12-27 20:13:19,761][106226] Updated weights for policy 0, policy_version 138136 (0.0007) [2023-12-27 20:13:19,926][106225] Updated weights for policy 1, policy_version 138243 (0.0008) [2023-12-27 20:13:19,995][106225] Updated weights for policy 1, policy_version 138253 (0.0007) [2023-12-27 20:13:20,056][106225] Updated weights for policy 1, policy_version 138263 (0.0006) [2023-12-27 20:13:20,487][106226] Updated weights for policy 0, policy_version 138146 (0.0009) [2023-12-27 20:13:20,540][106226] Updated weights for policy 0, policy_version 138156 (0.0008) [2023-12-27 20:13:20,606][106226] Updated weights for policy 0, policy_version 138166 (0.0008) [2023-12-27 20:13:20,674][106226] Updated weights for policy 0, policy_version 138176 (0.0009) [2023-12-27 20:13:20,737][106225] Updated weights for policy 1, policy_version 138273 (0.0008) [2023-12-27 20:13:20,802][106225] Updated weights for policy 1, policy_version 138283 (0.0007) [2023-12-27 20:13:20,869][106225] Updated weights for policy 1, policy_version 138293 (0.0007) [2023-12-27 20:13:20,932][106225] Updated weights for policy 1, policy_version 138303 (0.0010) [2023-12-27 20:13:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 70795264. Throughput: 0: 9769.5, 1: 9991.6. Samples: 70803192. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:21,175][105115] Avg episode reward: [(0, '-5.306'), (1, '-6.532')] [2023-12-27 20:13:21,451][106226] Updated weights for policy 0, policy_version 138186 (0.0005) [2023-12-27 20:13:21,515][106226] Updated weights for policy 0, policy_version 138196 (0.0006) [2023-12-27 20:13:21,565][106226] Updated weights for policy 0, policy_version 138206 (0.0009) [2023-12-27 20:13:21,677][106225] Updated weights for policy 1, policy_version 138313 (0.0009) [2023-12-27 20:13:21,747][106225] Updated weights for policy 1, policy_version 138323 (0.0008) [2023-12-27 20:13:21,808][106225] Updated weights for policy 1, policy_version 138333 (0.0008) [2023-12-27 20:13:22,200][106226] Updated weights for policy 0, policy_version 138216 (0.0006) [2023-12-27 20:13:22,269][106226] Updated weights for policy 0, policy_version 138226 (0.0008) [2023-12-27 20:13:22,339][106226] Updated weights for policy 0, policy_version 138236 (0.0009) [2023-12-27 20:13:22,621][106225] Updated weights for policy 1, policy_version 138343 (0.0008) [2023-12-27 20:13:22,683][106225] Updated weights for policy 1, policy_version 138353 (0.0008) [2023-12-27 20:13:22,745][106225] Updated weights for policy 1, policy_version 138363 (0.0008) [2023-12-27 20:13:23,006][106226] Updated weights for policy 0, policy_version 138246 (0.0008) [2023-12-27 20:13:23,069][106226] Updated weights for policy 0, policy_version 138256 (0.0010) [2023-12-27 20:13:23,134][106226] Updated weights for policy 0, policy_version 138266 (0.0009) [2023-12-27 20:13:23,478][106225] Updated weights for policy 1, policy_version 138373 (0.0007) [2023-12-27 20:13:23,531][106225] Updated weights for policy 1, policy_version 138383 (0.0008) [2023-12-27 20:13:23,575][106225] Updated weights for policy 1, policy_version 138393 (0.0008) [2023-12-27 20:13:23,864][106226] Updated weights for policy 0, policy_version 138276 (0.0008) [2023-12-27 20:13:23,919][106226] Updated weights for policy 0, policy_version 138286 (0.0008) [2023-12-27 20:13:23,980][106226] Updated weights for policy 0, policy_version 138296 (0.0008) [2023-12-27 20:13:24,242][106225] Updated weights for policy 1, policy_version 138403 (0.0008) [2023-12-27 20:13:24,295][106225] Updated weights for policy 1, policy_version 138413 (0.0008) [2023-12-27 20:13:24,363][106225] Updated weights for policy 1, policy_version 138423 (0.0008) [2023-12-27 20:13:24,747][106226] Updated weights for policy 0, policy_version 138306 (0.0009) [2023-12-27 20:13:24,807][106226] Updated weights for policy 0, policy_version 138316 (0.0008) [2023-12-27 20:13:24,875][106226] Updated weights for policy 0, policy_version 138326 (0.0008) [2023-12-27 20:13:24,938][106226] Updated weights for policy 0, policy_version 138336 (0.0005) [2023-12-27 20:13:25,040][106225] Updated weights for policy 1, policy_version 138433 (0.0009) [2023-12-27 20:13:25,096][106225] Updated weights for policy 1, policy_version 138443 (0.0008) [2023-12-27 20:13:25,159][106225] Updated weights for policy 1, policy_version 138453 (0.0006) [2023-12-27 20:13:25,225][106225] Updated weights for policy 1, policy_version 138464 (0.0008) [2023-12-27 20:13:25,519][106226] Updated weights for policy 0, policy_version 138346 (0.0008) [2023-12-27 20:13:25,574][106226] Updated weights for policy 0, policy_version 138356 (0.0007) [2023-12-27 20:13:25,627][106226] Updated weights for policy 0, policy_version 138366 (0.0008) [2023-12-27 20:13:25,954][106225] Updated weights for policy 1, policy_version 138474 (0.0010) [2023-12-27 20:13:26,020][106225] Updated weights for policy 1, policy_version 138484 (0.0009) [2023-12-27 20:13:26,070][106225] Updated weights for policy 1, policy_version 138494 (0.0010) [2023-12-27 20:13:26,175][105115] Fps is (10 sec: 19659.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 70893568. Throughput: 0: 9788.1, 1: 9942.9. Samples: 70859576. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:26,176][105115] Avg episode reward: [(0, '-5.470'), (1, '-6.574')] [2023-12-27 20:13:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000138496_35463168.pth... [2023-12-27 20:13:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000138368_35430400.pth... [2023-12-27 20:13:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000137344_35168256.pth [2023-12-27 20:13:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000137216_35135488.pth [2023-12-27 20:13:26,271][106226] Updated weights for policy 0, policy_version 138376 (0.0006) [2023-12-27 20:13:26,328][106226] Updated weights for policy 0, policy_version 138386 (0.0007) [2023-12-27 20:13:26,381][106226] Updated weights for policy 0, policy_version 138396 (0.0010) [2023-12-27 20:13:26,755][106225] Updated weights for policy 1, policy_version 138504 (0.0008) [2023-12-27 20:13:26,820][106225] Updated weights for policy 1, policy_version 138514 (0.0009) [2023-12-27 20:13:26,882][106225] Updated weights for policy 1, policy_version 138524 (0.0010) [2023-12-27 20:13:27,012][106226] Updated weights for policy 0, policy_version 138406 (0.0008) [2023-12-27 20:13:27,066][106226] Updated weights for policy 0, policy_version 138416 (0.0010) [2023-12-27 20:13:27,122][106226] Updated weights for policy 0, policy_version 138426 (0.0010) [2023-12-27 20:13:27,513][106225] Updated weights for policy 1, policy_version 138534 (0.0006) [2023-12-27 20:13:27,571][106225] Updated weights for policy 1, policy_version 138544 (0.0009) [2023-12-27 20:13:27,621][106225] Updated weights for policy 1, policy_version 138554 (0.0010) [2023-12-27 20:13:27,821][106226] Updated weights for policy 0, policy_version 138436 (0.0010) [2023-12-27 20:13:27,883][106226] Updated weights for policy 0, policy_version 138446 (0.0010) [2023-12-27 20:13:27,939][106226] Updated weights for policy 0, policy_version 138456 (0.0010) [2023-12-27 20:13:28,207][106225] Updated weights for policy 1, policy_version 138564 (0.0009) [2023-12-27 20:13:28,268][106225] Updated weights for policy 1, policy_version 138574 (0.0008) [2023-12-27 20:13:28,333][106225] Updated weights for policy 1, policy_version 138584 (0.0006) [2023-12-27 20:13:28,636][106226] Updated weights for policy 0, policy_version 138466 (0.0010) [2023-12-27 20:13:28,689][106226] Updated weights for policy 0, policy_version 138476 (0.0010) [2023-12-27 20:13:28,740][106226] Updated weights for policy 0, policy_version 138486 (0.0010) [2023-12-27 20:13:28,789][106226] Updated weights for policy 0, policy_version 138496 (0.0010) [2023-12-27 20:13:28,925][106225] Updated weights for policy 1, policy_version 138594 (0.0006) [2023-12-27 20:13:28,992][106225] Updated weights for policy 1, policy_version 138604 (0.0005) [2023-12-27 20:13:29,055][106225] Updated weights for policy 1, policy_version 138614 (0.0006) [2023-12-27 20:13:29,106][106225] Updated weights for policy 1, policy_version 138624 (0.0007) [2023-12-27 20:13:29,547][106226] Updated weights for policy 0, policy_version 138506 (0.0008) [2023-12-27 20:13:29,606][106226] Updated weights for policy 0, policy_version 138516 (0.0008) [2023-12-27 20:13:29,676][106226] Updated weights for policy 0, policy_version 138526 (0.0008) [2023-12-27 20:13:29,840][106225] Updated weights for policy 1, policy_version 138634 (0.0010) [2023-12-27 20:13:29,905][106225] Updated weights for policy 1, policy_version 138644 (0.0008) [2023-12-27 20:13:29,974][106225] Updated weights for policy 1, policy_version 138654 (0.0008) [2023-12-27 20:13:30,337][106226] Updated weights for policy 0, policy_version 138536 (0.0006) [2023-12-27 20:13:30,403][106226] Updated weights for policy 0, policy_version 138546 (0.0005) [2023-12-27 20:13:30,470][106226] Updated weights for policy 0, policy_version 138556 (0.0005) [2023-12-27 20:13:30,700][106225] Updated weights for policy 1, policy_version 138664 (0.0007) [2023-12-27 20:13:30,761][106225] Updated weights for policy 1, policy_version 138674 (0.0008) [2023-12-27 20:13:30,825][106225] Updated weights for policy 1, policy_version 138684 (0.0009) [2023-12-27 20:13:30,999][106226] Updated weights for policy 0, policy_version 138566 (0.0007) [2023-12-27 20:13:31,064][106226] Updated weights for policy 0, policy_version 138576 (0.0009) [2023-12-27 20:13:31,125][106226] Updated weights for policy 0, policy_version 138586 (0.0009) [2023-12-27 20:13:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 71000064. Throughput: 0: 9894.2, 1: 9982.0. Samples: 70983656. Policy #0 lag: (min: 0.0, avg: 26.7, max: 32.0) [2023-12-27 20:13:31,175][105115] Avg episode reward: [(0, '-5.249'), (1, '-6.589')] [2023-12-27 20:13:31,562][106225] Updated weights for policy 1, policy_version 138694 (0.0008) [2023-12-27 20:13:31,617][106225] Updated weights for policy 1, policy_version 138704 (0.0008) [2023-12-27 20:13:31,679][106225] Updated weights for policy 1, policy_version 138714 (0.0009) [2023-12-27 20:13:31,887][106226] Updated weights for policy 0, policy_version 138596 (0.0009) [2023-12-27 20:13:31,948][106226] Updated weights for policy 0, policy_version 138606 (0.0008) [2023-12-27 20:13:32,000][106226] Updated weights for policy 0, policy_version 138616 (0.0007) [2023-12-27 20:13:32,436][106225] Updated weights for policy 1, policy_version 138724 (0.0009) [2023-12-27 20:13:32,489][106225] Updated weights for policy 1, policy_version 138734 (0.0010) [2023-12-27 20:13:32,544][106225] Updated weights for policy 1, policy_version 138744 (0.0010) [2023-12-27 20:13:32,723][106226] Updated weights for policy 0, policy_version 138626 (0.0009) [2023-12-27 20:13:32,784][106226] Updated weights for policy 0, policy_version 138636 (0.0009) [2023-12-27 20:13:32,842][106226] Updated weights for policy 0, policy_version 138646 (0.0008) [2023-12-27 20:13:32,885][106226] Updated weights for policy 0, policy_version 138656 (0.0008) [2023-12-27 20:13:33,190][106225] Updated weights for policy 1, policy_version 138754 (0.0010) [2023-12-27 20:13:33,239][106225] Updated weights for policy 1, policy_version 138764 (0.0010) [2023-12-27 20:13:33,295][106225] Updated weights for policy 1, policy_version 138774 (0.0010) [2023-12-27 20:13:33,350][106225] Updated weights for policy 1, policy_version 138784 (0.0010) [2023-12-27 20:13:33,612][106226] Updated weights for policy 0, policy_version 138666 (0.0008) [2023-12-27 20:13:33,662][106226] Updated weights for policy 0, policy_version 138676 (0.0008) [2023-12-27 20:13:33,716][106226] Updated weights for policy 0, policy_version 138686 (0.0008) [2023-12-27 20:13:34,033][106225] Updated weights for policy 1, policy_version 138794 (0.0010) [2023-12-27 20:13:34,083][106225] Updated weights for policy 1, policy_version 138804 (0.0010) [2023-12-27 20:13:34,136][106225] Updated weights for policy 1, policy_version 138814 (0.0010) [2023-12-27 20:13:34,408][106226] Updated weights for policy 0, policy_version 138696 (0.0008) [2023-12-27 20:13:34,474][106226] Updated weights for policy 0, policy_version 138706 (0.0007) [2023-12-27 20:13:34,533][106226] Updated weights for policy 0, policy_version 138716 (0.0008) [2023-12-27 20:13:34,888][106225] Updated weights for policy 1, policy_version 138824 (0.0010) [2023-12-27 20:13:34,934][106225] Updated weights for policy 1, policy_version 138834 (0.0010) [2023-12-27 20:13:34,980][106225] Updated weights for policy 1, policy_version 138844 (0.0010) [2023-12-27 20:13:35,248][106226] Updated weights for policy 0, policy_version 138726 (0.0007) [2023-12-27 20:13:35,310][106226] Updated weights for policy 0, policy_version 138736 (0.0008) [2023-12-27 20:13:35,373][106226] Updated weights for policy 0, policy_version 138746 (0.0008) [2023-12-27 20:13:35,729][106225] Updated weights for policy 1, policy_version 138854 (0.0010) [2023-12-27 20:13:35,785][106225] Updated weights for policy 1, policy_version 138864 (0.0010) [2023-12-27 20:13:35,844][106225] Updated weights for policy 1, policy_version 138874 (0.0010) [2023-12-27 20:13:35,926][106226] Updated weights for policy 0, policy_version 138756 (0.0007) [2023-12-27 20:13:35,978][106226] Updated weights for policy 0, policy_version 138766 (0.0008) [2023-12-27 20:13:36,024][106226] Updated weights for policy 0, policy_version 138776 (0.0010) [2023-12-27 20:13:36,175][105115] Fps is (10 sec: 20480.8, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 71098368. Throughput: 0: 9935.3, 1: 9993.9. Samples: 71103612. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:13:36,175][105115] Avg episode reward: [(0, '-5.494'), (1, '-6.602')] [2023-12-27 20:13:36,652][106225] Updated weights for policy 1, policy_version 138884 (0.0009) [2023-12-27 20:13:36,713][106225] Updated weights for policy 1, policy_version 138894 (0.0008) [2023-12-27 20:13:36,762][106226] Updated weights for policy 0, policy_version 138786 (0.0010) [2023-12-27 20:13:36,767][106225] Updated weights for policy 1, policy_version 138904 (0.0009) [2023-12-27 20:13:36,825][106226] Updated weights for policy 0, policy_version 138796 (0.0011) [2023-12-27 20:13:36,892][106226] Updated weights for policy 0, policy_version 138806 (0.0011) [2023-12-27 20:13:36,959][106226] Updated weights for policy 0, policy_version 138816 (0.0011) [2023-12-27 20:13:37,499][106225] Updated weights for policy 1, policy_version 138914 (0.0006) [2023-12-27 20:13:37,550][106225] Updated weights for policy 1, policy_version 138924 (0.0008) [2023-12-27 20:13:37,606][106225] Updated weights for policy 1, policy_version 138934 (0.0007) [2023-12-27 20:13:37,654][106226] Updated weights for policy 0, policy_version 138826 (0.0011) [2023-12-27 20:13:37,659][106225] Updated weights for policy 1, policy_version 138944 (0.0009) [2023-12-27 20:13:37,716][106226] Updated weights for policy 0, policy_version 138836 (0.0009) [2023-12-27 20:13:37,785][106226] Updated weights for policy 0, policy_version 138846 (0.0008) [2023-12-27 20:13:38,426][106225] Updated weights for policy 1, policy_version 138954 (0.0009) [2023-12-27 20:13:38,492][106225] Updated weights for policy 1, policy_version 138964 (0.0009) [2023-12-27 20:13:38,548][106226] Updated weights for policy 0, policy_version 138856 (0.0007) [2023-12-27 20:13:38,550][106225] Updated weights for policy 1, policy_version 138974 (0.0006) [2023-12-27 20:13:38,594][106226] Updated weights for policy 0, policy_version 138866 (0.0008) [2023-12-27 20:13:38,651][106226] Updated weights for policy 0, policy_version 138876 (0.0009) [2023-12-27 20:13:39,242][106225] Updated weights for policy 1, policy_version 138984 (0.0008) [2023-12-27 20:13:39,305][106225] Updated weights for policy 1, policy_version 138994 (0.0010) [2023-12-27 20:13:39,363][106226] Updated weights for policy 0, policy_version 138886 (0.0008) [2023-12-27 20:13:39,372][106225] Updated weights for policy 1, policy_version 139004 (0.0009) [2023-12-27 20:13:39,437][106226] Updated weights for policy 0, policy_version 138896 (0.0009) [2023-12-27 20:13:39,491][106226] Updated weights for policy 0, policy_version 138906 (0.0009) [2023-12-27 20:13:40,203][106225] Updated weights for policy 1, policy_version 139014 (0.0008) [2023-12-27 20:13:40,242][106226] Updated weights for policy 0, policy_version 138916 (0.0007) [2023-12-27 20:13:40,267][106225] Updated weights for policy 1, policy_version 139024 (0.0009) [2023-12-27 20:13:40,308][106226] Updated weights for policy 0, policy_version 138926 (0.0006) [2023-12-27 20:13:40,334][106225] Updated weights for policy 1, policy_version 139034 (0.0007) [2023-12-27 20:13:40,381][106226] Updated weights for policy 0, policy_version 138936 (0.0006) [2023-12-27 20:13:41,023][106225] Updated weights for policy 1, policy_version 139044 (0.0007) [2023-12-27 20:13:41,080][106226] Updated weights for policy 0, policy_version 138946 (0.0006) [2023-12-27 20:13:41,090][106225] Updated weights for policy 1, policy_version 139054 (0.0010) [2023-12-27 20:13:41,146][106226] Updated weights for policy 0, policy_version 138956 (0.0008) [2023-12-27 20:13:41,159][106225] Updated weights for policy 1, policy_version 139064 (0.0013) [2023-12-27 20:13:41,175][105115] Fps is (10 sec: 18022.0, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 71180288. Throughput: 0: 9955.0, 1: 9937.9. Samples: 71160024. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:13:41,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-6.813')] [2023-12-27 20:13:41,211][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000139072_35610624.pth... [2023-12-27 20:13:41,212][106226] Updated weights for policy 0, policy_version 138966 (0.0008) [2023-12-27 20:13:41,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000137920_35315712.pth [2023-12-27 20:13:41,216][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000139072_35610624.pth [2023-12-27 20:13:41,282][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000138976_35586048.pth... [2023-12-27 20:13:41,284][106226] Updated weights for policy 0, policy_version 138976 (0.0009) [2023-12-27 20:13:41,287][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000137792_35282944.pth [2023-12-27 20:13:41,288][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000138976_35586048.pth [2023-12-27 20:13:41,922][106225] Updated weights for policy 1, policy_version 139074 (0.0007) [2023-12-27 20:13:41,985][106225] Updated weights for policy 1, policy_version 139084 (0.0008) [2023-12-27 20:13:42,022][106226] Updated weights for policy 0, policy_version 138986 (0.0007) [2023-12-27 20:13:42,043][106225] Updated weights for policy 1, policy_version 139094 (0.0007) [2023-12-27 20:13:42,082][106226] Updated weights for policy 0, policy_version 138996 (0.0008) [2023-12-27 20:13:42,105][106225] Updated weights for policy 1, policy_version 139104 (0.0008) [2023-12-27 20:13:42,149][106226] Updated weights for policy 0, policy_version 139006 (0.0009) [2023-12-27 20:13:42,759][106225] Updated weights for policy 1, policy_version 139114 (0.0010) [2023-12-27 20:13:42,826][106225] Updated weights for policy 1, policy_version 139124 (0.0010) [2023-12-27 20:13:42,893][106226] Updated weights for policy 0, policy_version 139016 (0.0007) [2023-12-27 20:13:42,893][106225] Updated weights for policy 1, policy_version 139134 (0.0010) [2023-12-27 20:13:42,950][106226] Updated weights for policy 0, policy_version 139026 (0.0008) [2023-12-27 20:13:43,008][106226] Updated weights for policy 0, policy_version 139036 (0.0008) [2023-12-27 20:13:43,525][106225] Updated weights for policy 1, policy_version 139144 (0.0010) [2023-12-27 20:13:43,582][106225] Updated weights for policy 1, policy_version 139154 (0.0010) [2023-12-27 20:13:43,641][106225] Updated weights for policy 1, policy_version 139164 (0.0010) [2023-12-27 20:13:43,750][106226] Updated weights for policy 0, policy_version 139046 (0.0006) [2023-12-27 20:13:43,796][106226] Updated weights for policy 0, policy_version 139056 (0.0005) [2023-12-27 20:13:43,845][106226] Updated weights for policy 0, policy_version 139066 (0.0006) [2023-12-27 20:13:44,205][106225] Updated weights for policy 1, policy_version 139174 (0.0010) [2023-12-27 20:13:44,251][106225] Updated weights for policy 1, policy_version 139184 (0.0010) [2023-12-27 20:13:44,309][106225] Updated weights for policy 1, policy_version 139194 (0.0010) [2023-12-27 20:13:44,584][106226] Updated weights for policy 0, policy_version 139076 (0.0006) [2023-12-27 20:13:44,645][106226] Updated weights for policy 0, policy_version 139086 (0.0008) [2023-12-27 20:13:44,702][106226] Updated weights for policy 0, policy_version 139096 (0.0007) [2023-12-27 20:13:45,038][106225] Updated weights for policy 1, policy_version 139204 (0.0010) [2023-12-27 20:13:45,103][106225] Updated weights for policy 1, policy_version 139214 (0.0010) [2023-12-27 20:13:45,164][106225] Updated weights for policy 1, policy_version 139224 (0.0010) [2023-12-27 20:13:45,459][106226] Updated weights for policy 0, policy_version 139106 (0.0009) [2023-12-27 20:13:45,521][106226] Updated weights for policy 0, policy_version 139116 (0.0009) [2023-12-27 20:13:45,574][106226] Updated weights for policy 0, policy_version 139126 (0.0009) [2023-12-27 20:13:45,621][106226] Updated weights for policy 0, policy_version 139136 (0.0009) [2023-12-27 20:13:45,835][106225] Updated weights for policy 1, policy_version 139234 (0.0010) [2023-12-27 20:13:45,887][106225] Updated weights for policy 1, policy_version 139244 (0.0010) [2023-12-27 20:13:45,943][106225] Updated weights for policy 1, policy_version 139254 (0.0010) [2023-12-27 20:13:46,012][106225] Updated weights for policy 1, policy_version 139264 (0.0010) [2023-12-27 20:13:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 71286784. Throughput: 0: 9915.2, 1: 9918.9. Samples: 71276724. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:13:46,175][105115] Avg episode reward: [(0, '-5.256'), (1, '-6.966')] [2023-12-27 20:13:46,248][106226] Updated weights for policy 0, policy_version 139146 (0.0008) [2023-12-27 20:13:46,304][106226] Updated weights for policy 0, policy_version 139156 (0.0010) [2023-12-27 20:13:46,359][106226] Updated weights for policy 0, policy_version 139166 (0.0009) [2023-12-27 20:13:46,681][106225] Updated weights for policy 1, policy_version 139274 (0.0010) [2023-12-27 20:13:46,736][106225] Updated weights for policy 1, policy_version 139284 (0.0010) [2023-12-27 20:13:46,798][106225] Updated weights for policy 1, policy_version 139294 (0.0010) [2023-12-27 20:13:47,089][106226] Updated weights for policy 0, policy_version 139176 (0.0007) [2023-12-27 20:13:47,149][106226] Updated weights for policy 0, policy_version 139186 (0.0005) [2023-12-27 20:13:47,210][106226] Updated weights for policy 0, policy_version 139196 (0.0008) [2023-12-27 20:13:47,493][106225] Updated weights for policy 1, policy_version 139304 (0.0010) [2023-12-27 20:13:47,553][106225] Updated weights for policy 1, policy_version 139314 (0.0010) [2023-12-27 20:13:47,614][106225] Updated weights for policy 1, policy_version 139324 (0.0010) [2023-12-27 20:13:47,864][106226] Updated weights for policy 0, policy_version 139206 (0.0008) [2023-12-27 20:13:47,913][106226] Updated weights for policy 0, policy_version 139216 (0.0008) [2023-12-27 20:13:47,966][106226] Updated weights for policy 0, policy_version 139226 (0.0007) [2023-12-27 20:13:48,317][106225] Updated weights for policy 1, policy_version 139334 (0.0008) [2023-12-27 20:13:48,386][106225] Updated weights for policy 1, policy_version 139344 (0.0007) [2023-12-27 20:13:48,448][106225] Updated weights for policy 1, policy_version 139354 (0.0008) [2023-12-27 20:13:48,631][106226] Updated weights for policy 0, policy_version 139236 (0.0008) [2023-12-27 20:13:48,691][106226] Updated weights for policy 0, policy_version 139246 (0.0005) [2023-12-27 20:13:48,747][106226] Updated weights for policy 0, policy_version 139256 (0.0005) [2023-12-27 20:13:49,076][106225] Updated weights for policy 1, policy_version 139364 (0.0007) [2023-12-27 20:13:49,139][106225] Updated weights for policy 1, policy_version 139374 (0.0008) [2023-12-27 20:13:49,205][106225] Updated weights for policy 1, policy_version 139384 (0.0009) [2023-12-27 20:13:49,309][106226] Updated weights for policy 0, policy_version 139266 (0.0008) [2023-12-27 20:13:49,378][106226] Updated weights for policy 0, policy_version 139276 (0.0008) [2023-12-27 20:13:49,440][106226] Updated weights for policy 0, policy_version 139286 (0.0006) [2023-12-27 20:13:49,499][106226] Updated weights for policy 0, policy_version 139296 (0.0006) [2023-12-27 20:13:49,895][106225] Updated weights for policy 1, policy_version 139394 (0.0008) [2023-12-27 20:13:49,963][106225] Updated weights for policy 1, policy_version 139404 (0.0007) [2023-12-27 20:13:50,037][106225] Updated weights for policy 1, policy_version 139414 (0.0009) [2023-12-27 20:13:50,101][106225] Updated weights for policy 1, policy_version 139424 (0.0008) [2023-12-27 20:13:50,163][106226] Updated weights for policy 0, policy_version 139306 (0.0008) [2023-12-27 20:13:50,236][106226] Updated weights for policy 0, policy_version 139316 (0.0008) [2023-12-27 20:13:50,300][106226] Updated weights for policy 0, policy_version 139326 (0.0008) [2023-12-27 20:13:50,805][106225] Updated weights for policy 1, policy_version 139434 (0.0005) [2023-12-27 20:13:50,867][106225] Updated weights for policy 1, policy_version 139444 (0.0008) [2023-12-27 20:13:50,930][106225] Updated weights for policy 1, policy_version 139454 (0.0008) [2023-12-27 20:13:51,036][106226] Updated weights for policy 0, policy_version 139336 (0.0008) [2023-12-27 20:13:51,106][106226] Updated weights for policy 0, policy_version 139346 (0.0008) [2023-12-27 20:13:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 71385088. Throughput: 0: 9942.6, 1: 9918.9. Samples: 71397720. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:13:51,175][105115] Avg episode reward: [(0, '-5.440'), (1, '-6.665')] [2023-12-27 20:13:51,179][106226] Updated weights for policy 0, policy_version 139356 (0.0008) [2023-12-27 20:13:51,612][106225] Updated weights for policy 1, policy_version 139464 (0.0009) [2023-12-27 20:13:51,669][106225] Updated weights for policy 1, policy_version 139474 (0.0008) [2023-12-27 20:13:51,729][106225] Updated weights for policy 1, policy_version 139484 (0.0009) [2023-12-27 20:13:51,947][106226] Updated weights for policy 0, policy_version 139366 (0.0010) [2023-12-27 20:13:52,012][106226] Updated weights for policy 0, policy_version 139376 (0.0008) [2023-12-27 20:13:52,076][106226] Updated weights for policy 0, policy_version 139386 (0.0010) [2023-12-27 20:13:52,503][106225] Updated weights for policy 1, policy_version 139494 (0.0007) [2023-12-27 20:13:52,558][106225] Updated weights for policy 1, policy_version 139504 (0.0008) [2023-12-27 20:13:52,616][106225] Updated weights for policy 1, policy_version 139514 (0.0009) [2023-12-27 20:13:52,740][106226] Updated weights for policy 0, policy_version 139396 (0.0010) [2023-12-27 20:13:52,801][106226] Updated weights for policy 0, policy_version 139406 (0.0010) [2023-12-27 20:13:52,873][106226] Updated weights for policy 0, policy_version 139416 (0.0010) [2023-12-27 20:13:53,258][106225] Updated weights for policy 1, policy_version 139524 (0.0007) [2023-12-27 20:13:53,320][106225] Updated weights for policy 1, policy_version 139534 (0.0009) [2023-12-27 20:13:53,378][106225] Updated weights for policy 1, policy_version 139544 (0.0009) [2023-12-27 20:13:53,551][106226] Updated weights for policy 0, policy_version 139426 (0.0010) [2023-12-27 20:13:53,613][106226] Updated weights for policy 0, policy_version 139436 (0.0008) [2023-12-27 20:13:53,678][106226] Updated weights for policy 0, policy_version 139446 (0.0009) [2023-12-27 20:13:53,734][106226] Updated weights for policy 0, policy_version 139456 (0.0008) [2023-12-27 20:13:54,050][106225] Updated weights for policy 1, policy_version 139554 (0.0009) [2023-12-27 20:13:54,103][106225] Updated weights for policy 1, policy_version 139564 (0.0010) [2023-12-27 20:13:54,174][106225] Updated weights for policy 1, policy_version 139574 (0.0010) [2023-12-27 20:13:54,227][106225] Updated weights for policy 1, policy_version 139584 (0.0010) [2023-12-27 20:13:54,451][106226] Updated weights for policy 0, policy_version 139466 (0.0006) [2023-12-27 20:13:54,497][106226] Updated weights for policy 0, policy_version 139476 (0.0007) [2023-12-27 20:13:54,546][106226] Updated weights for policy 0, policy_version 139486 (0.0007) [2023-12-27 20:13:54,895][106225] Updated weights for policy 1, policy_version 139594 (0.0007) [2023-12-27 20:13:54,953][106225] Updated weights for policy 1, policy_version 139604 (0.0008) [2023-12-27 20:13:55,026][106225] Updated weights for policy 1, policy_version 139614 (0.0008) [2023-12-27 20:13:55,275][106226] Updated weights for policy 0, policy_version 139496 (0.0009) [2023-12-27 20:13:55,327][106226] Updated weights for policy 0, policy_version 139506 (0.0009) [2023-12-27 20:13:55,383][106226] Updated weights for policy 0, policy_version 139516 (0.0008) [2023-12-27 20:13:55,655][106225] Updated weights for policy 1, policy_version 139624 (0.0007) [2023-12-27 20:13:55,709][106225] Updated weights for policy 1, policy_version 139634 (0.0006) [2023-12-27 20:13:55,761][106225] Updated weights for policy 1, policy_version 139644 (0.0007) [2023-12-27 20:13:56,159][106226] Updated weights for policy 0, policy_version 139526 (0.0008) [2023-12-27 20:13:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 71483392. Throughput: 0: 9899.3, 1: 9907.6. Samples: 71455680. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:13:56,175][105115] Avg episode reward: [(0, '-5.533'), (1, '-6.355')] [2023-12-27 20:13:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000139648_35758080.pth... [2023-12-27 20:13:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000138496_35463168.pth [2023-12-27 20:13:56,214][106226] Updated weights for policy 0, policy_version 139536 (0.0009) [2023-12-27 20:13:56,265][106226] Updated weights for policy 0, policy_version 139546 (0.0008) [2023-12-27 20:13:56,301][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000139552_35733504.pth... [2023-12-27 20:13:56,307][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000138368_35430400.pth [2023-12-27 20:13:56,400][106225] Updated weights for policy 1, policy_version 139654 (0.0007) [2023-12-27 20:13:56,458][106225] Updated weights for policy 1, policy_version 139664 (0.0007) [2023-12-27 20:13:56,506][106225] Updated weights for policy 1, policy_version 139674 (0.0005) [2023-12-27 20:13:56,974][106226] Updated weights for policy 0, policy_version 139556 (0.0007) [2023-12-27 20:13:57,027][106226] Updated weights for policy 0, policy_version 139566 (0.0005) [2023-12-27 20:13:57,077][106226] Updated weights for policy 0, policy_version 139576 (0.0005) [2023-12-27 20:13:57,094][106225] Updated weights for policy 1, policy_version 139684 (0.0005) [2023-12-27 20:13:57,162][106225] Updated weights for policy 1, policy_version 139694 (0.0006) [2023-12-27 20:13:57,221][106225] Updated weights for policy 1, policy_version 139704 (0.0007) [2023-12-27 20:13:57,658][106226] Updated weights for policy 0, policy_version 139586 (0.0007) [2023-12-27 20:13:57,723][106226] Updated weights for policy 0, policy_version 139596 (0.0010) [2023-12-27 20:13:57,776][106225] Updated weights for policy 1, policy_version 139714 (0.0007) [2023-12-27 20:13:57,782][106226] Updated weights for policy 0, policy_version 139606 (0.0010) [2023-12-27 20:13:57,830][106225] Updated weights for policy 1, policy_version 139724 (0.0005) [2023-12-27 20:13:57,845][106226] Updated weights for policy 0, policy_version 139616 (0.0010) [2023-12-27 20:13:57,877][106225] Updated weights for policy 1, policy_version 139734 (0.0005) [2023-12-27 20:13:57,929][106225] Updated weights for policy 1, policy_version 139744 (0.0005) [2023-12-27 20:13:58,587][106226] Updated weights for policy 0, policy_version 139626 (0.0011) [2023-12-27 20:13:58,627][106225] Updated weights for policy 1, policy_version 139754 (0.0011) [2023-12-27 20:13:58,649][106226] Updated weights for policy 0, policy_version 139636 (0.0010) [2023-12-27 20:13:58,681][106225] Updated weights for policy 1, policy_version 139764 (0.0010) [2023-12-27 20:13:58,719][106226] Updated weights for policy 0, policy_version 139646 (0.0007) [2023-12-27 20:13:58,746][106225] Updated weights for policy 1, policy_version 139774 (0.0007) [2023-12-27 20:13:59,464][106226] Updated weights for policy 0, policy_version 139656 (0.0009) [2023-12-27 20:13:59,524][106226] Updated weights for policy 0, policy_version 139666 (0.0010) [2023-12-27 20:13:59,564][106225] Updated weights for policy 1, policy_version 139784 (0.0006) [2023-12-27 20:13:59,583][106226] Updated weights for policy 0, policy_version 139676 (0.0010) [2023-12-27 20:13:59,620][106225] Updated weights for policy 1, policy_version 139794 (0.0008) [2023-12-27 20:13:59,674][106225] Updated weights for policy 1, policy_version 139804 (0.0007) [2023-12-27 20:14:00,318][106226] Updated weights for policy 0, policy_version 139686 (0.0011) [2023-12-27 20:14:00,335][106225] Updated weights for policy 1, policy_version 139814 (0.0006) [2023-12-27 20:14:00,378][106226] Updated weights for policy 0, policy_version 139696 (0.0010) [2023-12-27 20:14:00,390][106225] Updated weights for policy 1, policy_version 139824 (0.0008) [2023-12-27 20:14:00,438][106226] Updated weights for policy 0, policy_version 139706 (0.0010) [2023-12-27 20:14:00,441][106225] Updated weights for policy 1, policy_version 139834 (0.0007) [2023-12-27 20:14:01,013][106226] Updated weights for policy 0, policy_version 139716 (0.0008) [2023-12-27 20:14:01,089][106226] Updated weights for policy 0, policy_version 139726 (0.0007) [2023-12-27 20:14:01,094][106225] Updated weights for policy 1, policy_version 139844 (0.0006) [2023-12-27 20:14:01,144][106226] Updated weights for policy 0, policy_version 139736 (0.0007) [2023-12-27 20:14:01,163][106225] Updated weights for policy 1, policy_version 139854 (0.0007) [2023-12-27 20:14:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 71581696. Throughput: 0: 9875.1, 1: 9918.8. Samples: 71577304. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:01,175][105115] Avg episode reward: [(0, '-4.931'), (1, '-6.493')] [2023-12-27 20:14:01,222][106225] Updated weights for policy 1, policy_version 139864 (0.0008) [2023-12-27 20:14:01,837][106226] Updated weights for policy 0, policy_version 139746 (0.0007) [2023-12-27 20:14:01,901][106226] Updated weights for policy 0, policy_version 139756 (0.0008) [2023-12-27 20:14:01,959][106226] Updated weights for policy 0, policy_version 139766 (0.0008) [2023-12-27 20:14:01,976][106225] Updated weights for policy 1, policy_version 139874 (0.0008) [2023-12-27 20:14:02,022][106226] Updated weights for policy 0, policy_version 139776 (0.0007) [2023-12-27 20:14:02,032][106225] Updated weights for policy 1, policy_version 139884 (0.0008) [2023-12-27 20:14:02,079][106225] Updated weights for policy 1, policy_version 139894 (0.0009) [2023-12-27 20:14:02,138][106225] Updated weights for policy 1, policy_version 139904 (0.0006) [2023-12-27 20:14:02,740][106226] Updated weights for policy 0, policy_version 139786 (0.0005) [2023-12-27 20:14:02,802][106226] Updated weights for policy 0, policy_version 139796 (0.0006) [2023-12-27 20:14:02,836][106225] Updated weights for policy 1, policy_version 139914 (0.0009) [2023-12-27 20:14:02,866][106226] Updated weights for policy 0, policy_version 139806 (0.0005) [2023-12-27 20:14:02,897][106225] Updated weights for policy 1, policy_version 139924 (0.0008) [2023-12-27 20:14:02,946][106225] Updated weights for policy 1, policy_version 139934 (0.0008) [2023-12-27 20:14:03,398][106226] Updated weights for policy 0, policy_version 139816 (0.0005) [2023-12-27 20:14:03,448][106226] Updated weights for policy 0, policy_version 139826 (0.0005) [2023-12-27 20:14:03,503][106226] Updated weights for policy 0, policy_version 139836 (0.0005) [2023-12-27 20:14:03,782][106225] Updated weights for policy 1, policy_version 139944 (0.0009) [2023-12-27 20:14:03,831][106225] Updated weights for policy 1, policy_version 139954 (0.0007) [2023-12-27 20:14:03,896][106225] Updated weights for policy 1, policy_version 139964 (0.0008) [2023-12-27 20:14:04,161][106226] Updated weights for policy 0, policy_version 139846 (0.0007) [2023-12-27 20:14:04,222][106226] Updated weights for policy 0, policy_version 139856 (0.0009) [2023-12-27 20:14:04,289][106226] Updated weights for policy 0, policy_version 139866 (0.0009) [2023-12-27 20:14:04,629][106225] Updated weights for policy 1, policy_version 139974 (0.0008) [2023-12-27 20:14:04,682][106225] Updated weights for policy 1, policy_version 139984 (0.0006) [2023-12-27 20:14:04,737][106225] Updated weights for policy 1, policy_version 139994 (0.0005) [2023-12-27 20:14:05,040][106226] Updated weights for policy 0, policy_version 139876 (0.0008) [2023-12-27 20:14:05,086][106226] Updated weights for policy 0, policy_version 139886 (0.0008) [2023-12-27 20:14:05,139][106226] Updated weights for policy 0, policy_version 139896 (0.0007) [2023-12-27 20:14:05,408][106225] Updated weights for policy 1, policy_version 140004 (0.0008) [2023-12-27 20:14:05,471][106225] Updated weights for policy 1, policy_version 140014 (0.0010) [2023-12-27 20:14:05,529][106225] Updated weights for policy 1, policy_version 140024 (0.0010) [2023-12-27 20:14:05,817][106226] Updated weights for policy 0, policy_version 139906 (0.0007) [2023-12-27 20:14:05,873][106226] Updated weights for policy 0, policy_version 139916 (0.0005) [2023-12-27 20:14:05,934][106226] Updated weights for policy 0, policy_version 139926 (0.0005) [2023-12-27 20:14:05,994][106226] Updated weights for policy 0, policy_version 139936 (0.0007) [2023-12-27 20:14:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 71688192. Throughput: 0: 9964.3, 1: 9934.4. Samples: 71698632. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:06,175][105115] Avg episode reward: [(0, '-5.463'), (1, '-6.864')] [2023-12-27 20:14:06,228][106225] Updated weights for policy 1, policy_version 140034 (0.0010) [2023-12-27 20:14:06,293][106225] Updated weights for policy 1, policy_version 140044 (0.0011) [2023-12-27 20:14:06,348][106225] Updated weights for policy 1, policy_version 140054 (0.0010) [2023-12-27 20:14:06,397][106225] Updated weights for policy 1, policy_version 140064 (0.0010) [2023-12-27 20:14:06,584][106226] Updated weights for policy 0, policy_version 139946 (0.0006) [2023-12-27 20:14:06,650][106226] Updated weights for policy 0, policy_version 139956 (0.0006) [2023-12-27 20:14:06,711][106226] Updated weights for policy 0, policy_version 139966 (0.0008) [2023-12-27 20:14:07,135][106225] Updated weights for policy 1, policy_version 140074 (0.0010) [2023-12-27 20:14:07,182][106225] Updated weights for policy 1, policy_version 140084 (0.0010) [2023-12-27 20:14:07,227][106226] Updated weights for policy 0, policy_version 139976 (0.0007) [2023-12-27 20:14:07,233][106225] Updated weights for policy 1, policy_version 140094 (0.0010) [2023-12-27 20:14:07,279][106226] Updated weights for policy 0, policy_version 139986 (0.0007) [2023-12-27 20:14:07,338][106226] Updated weights for policy 0, policy_version 139996 (0.0008) [2023-12-27 20:14:07,978][106225] Updated weights for policy 1, policy_version 140104 (0.0010) [2023-12-27 20:14:08,005][106226] Updated weights for policy 0, policy_version 140006 (0.0008) [2023-12-27 20:14:08,044][106225] Updated weights for policy 1, policy_version 140114 (0.0010) [2023-12-27 20:14:08,067][106226] Updated weights for policy 0, policy_version 140016 (0.0008) [2023-12-27 20:14:08,109][106225] Updated weights for policy 1, policy_version 140124 (0.0010) [2023-12-27 20:14:08,126][106226] Updated weights for policy 0, policy_version 140026 (0.0007) [2023-12-27 20:14:08,764][106226] Updated weights for policy 0, policy_version 140036 (0.0007) [2023-12-27 20:14:08,833][106226] Updated weights for policy 0, policy_version 140046 (0.0008) [2023-12-27 20:14:08,846][106225] Updated weights for policy 1, policy_version 140134 (0.0009) [2023-12-27 20:14:08,900][106226] Updated weights for policy 0, policy_version 140056 (0.0008) [2023-12-27 20:14:08,912][106225] Updated weights for policy 1, policy_version 140144 (0.0010) [2023-12-27 20:14:08,974][106225] Updated weights for policy 1, policy_version 140154 (0.0010) [2023-12-27 20:14:09,560][106226] Updated weights for policy 0, policy_version 140066 (0.0008) [2023-12-27 20:14:09,626][106226] Updated weights for policy 0, policy_version 140076 (0.0008) [2023-12-27 20:14:09,693][106226] Updated weights for policy 0, policy_version 140086 (0.0008) [2023-12-27 20:14:09,712][106225] Updated weights for policy 1, policy_version 140164 (0.0010) [2023-12-27 20:14:09,756][106226] Updated weights for policy 0, policy_version 140096 (0.0007) [2023-12-27 20:14:09,772][106225] Updated weights for policy 1, policy_version 140174 (0.0009) [2023-12-27 20:14:09,836][106225] Updated weights for policy 1, policy_version 140184 (0.0007) [2023-12-27 20:14:10,511][106226] Updated weights for policy 0, policy_version 140106 (0.0008) [2023-12-27 20:14:10,532][106225] Updated weights for policy 1, policy_version 140194 (0.0009) [2023-12-27 20:14:10,560][106226] Updated weights for policy 0, policy_version 140116 (0.0009) [2023-12-27 20:14:10,586][106225] Updated weights for policy 1, policy_version 140204 (0.0005) [2023-12-27 20:14:10,617][106226] Updated weights for policy 0, policy_version 140126 (0.0009) [2023-12-27 20:14:10,655][106225] Updated weights for policy 1, policy_version 140214 (0.0005) [2023-12-27 20:14:10,716][106225] Updated weights for policy 1, policy_version 140224 (0.0010) [2023-12-27 20:14:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19966.3). Total num frames: 71786496. Throughput: 0: 10044.9, 1: 9963.8. Samples: 71759960. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:11,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-6.626')] [2023-12-27 20:14:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000140224_35905536.pth... [2023-12-27 20:14:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000140128_35880960.pth... [2023-12-27 20:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000139072_35610624.pth [2023-12-27 20:14:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000138976_35586048.pth [2023-12-27 20:14:11,399][106226] Updated weights for policy 0, policy_version 140136 (0.0009) [2023-12-27 20:14:11,461][106226] Updated weights for policy 0, policy_version 140146 (0.0009) [2023-12-27 20:14:11,465][106225] Updated weights for policy 1, policy_version 140234 (0.0008) [2023-12-27 20:14:11,521][106226] Updated weights for policy 0, policy_version 140156 (0.0007) [2023-12-27 20:14:11,527][106225] Updated weights for policy 1, policy_version 140244 (0.0006) [2023-12-27 20:14:11,590][106225] Updated weights for policy 1, policy_version 140254 (0.0008) [2023-12-27 20:14:12,245][106226] Updated weights for policy 0, policy_version 140166 (0.0006) [2023-12-27 20:14:12,319][106226] Updated weights for policy 0, policy_version 140176 (0.0008) [2023-12-27 20:14:12,329][106225] Updated weights for policy 1, policy_version 140264 (0.0008) [2023-12-27 20:14:12,386][106226] Updated weights for policy 0, policy_version 140186 (0.0007) [2023-12-27 20:14:12,396][106225] Updated weights for policy 1, policy_version 140274 (0.0008) [2023-12-27 20:14:12,455][106225] Updated weights for policy 1, policy_version 140284 (0.0008) [2023-12-27 20:14:13,071][106226] Updated weights for policy 0, policy_version 140196 (0.0008) [2023-12-27 20:14:13,132][106226] Updated weights for policy 0, policy_version 140206 (0.0008) [2023-12-27 20:14:13,134][106225] Updated weights for policy 1, policy_version 140294 (0.0008) [2023-12-27 20:14:13,180][106225] Updated weights for policy 1, policy_version 140304 (0.0006) [2023-12-27 20:14:13,190][106226] Updated weights for policy 0, policy_version 140216 (0.0007) [2023-12-27 20:14:13,227][106225] Updated weights for policy 1, policy_version 140314 (0.0006) [2023-12-27 20:14:13,928][106225] Updated weights for policy 1, policy_version 140324 (0.0007) [2023-12-27 20:14:13,942][106226] Updated weights for policy 0, policy_version 140226 (0.0007) [2023-12-27 20:14:13,989][106225] Updated weights for policy 1, policy_version 140334 (0.0007) [2023-12-27 20:14:13,999][106226] Updated weights for policy 0, policy_version 140236 (0.0006) [2023-12-27 20:14:14,048][106225] Updated weights for policy 1, policy_version 140344 (0.0009) [2023-12-27 20:14:14,064][106226] Updated weights for policy 0, policy_version 140246 (0.0006) [2023-12-27 20:14:14,125][106226] Updated weights for policy 0, policy_version 140256 (0.0008) [2023-12-27 20:14:14,725][106225] Updated weights for policy 1, policy_version 140354 (0.0007) [2023-12-27 20:14:14,792][106225] Updated weights for policy 1, policy_version 140364 (0.0008) [2023-12-27 20:14:14,846][106225] Updated weights for policy 1, policy_version 140374 (0.0006) [2023-12-27 20:14:14,860][106226] Updated weights for policy 0, policy_version 140266 (0.0006) [2023-12-27 20:14:14,908][106225] Updated weights for policy 1, policy_version 140384 (0.0007) [2023-12-27 20:14:14,923][106226] Updated weights for policy 0, policy_version 140276 (0.0008) [2023-12-27 20:14:14,989][106226] Updated weights for policy 0, policy_version 140286 (0.0009) [2023-12-27 20:14:15,611][106225] Updated weights for policy 1, policy_version 140394 (0.0007) [2023-12-27 20:14:15,672][106225] Updated weights for policy 1, policy_version 140404 (0.0008) [2023-12-27 20:14:15,722][106226] Updated weights for policy 0, policy_version 140296 (0.0006) [2023-12-27 20:14:15,730][106225] Updated weights for policy 1, policy_version 140414 (0.0007) [2023-12-27 20:14:15,774][106226] Updated weights for policy 0, policy_version 140306 (0.0008) [2023-12-27 20:14:15,846][106226] Updated weights for policy 0, policy_version 140316 (0.0009) [2023-12-27 20:14:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 71884800. Throughput: 0: 9942.7, 1: 9856.0. Samples: 71874600. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:16,176][105115] Avg episode reward: [(0, '-4.969'), (1, '-6.891')] [2023-12-27 20:14:16,422][106225] Updated weights for policy 1, policy_version 140424 (0.0009) [2023-12-27 20:14:16,477][106225] Updated weights for policy 1, policy_version 140434 (0.0008) [2023-12-27 20:14:16,543][106225] Updated weights for policy 1, policy_version 140444 (0.0009) [2023-12-27 20:14:16,574][106226] Updated weights for policy 0, policy_version 140326 (0.0009) [2023-12-27 20:14:16,623][106226] Updated weights for policy 0, policy_version 140336 (0.0008) [2023-12-27 20:14:16,671][106226] Updated weights for policy 0, policy_version 140346 (0.0008) [2023-12-27 20:14:17,302][106225] Updated weights for policy 1, policy_version 140454 (0.0008) [2023-12-27 20:14:17,319][106226] Updated weights for policy 0, policy_version 140356 (0.0009) [2023-12-27 20:14:17,355][106225] Updated weights for policy 1, policy_version 140464 (0.0006) [2023-12-27 20:14:17,370][106226] Updated weights for policy 0, policy_version 140366 (0.0010) [2023-12-27 20:14:17,408][106225] Updated weights for policy 1, policy_version 140474 (0.0005) [2023-12-27 20:14:17,416][106226] Updated weights for policy 0, policy_version 140376 (0.0010) [2023-12-27 20:14:17,971][106226] Updated weights for policy 0, policy_version 140386 (0.0005) [2023-12-27 20:14:18,019][106226] Updated weights for policy 0, policy_version 140396 (0.0006) [2023-12-27 20:14:18,077][106226] Updated weights for policy 0, policy_version 140406 (0.0010) [2023-12-27 20:14:18,135][106226] Updated weights for policy 0, policy_version 140416 (0.0006) [2023-12-27 20:14:18,154][106225] Updated weights for policy 1, policy_version 140484 (0.0006) [2023-12-27 20:14:18,207][106225] Updated weights for policy 1, policy_version 140494 (0.0009) [2023-12-27 20:14:18,272][106225] Updated weights for policy 1, policy_version 140504 (0.0005) [2023-12-27 20:14:18,788][106226] Updated weights for policy 0, policy_version 140426 (0.0005) [2023-12-27 20:14:18,842][106226] Updated weights for policy 0, policy_version 140436 (0.0010) [2023-12-27 20:14:18,909][106226] Updated weights for policy 0, policy_version 140446 (0.0011) [2023-12-27 20:14:19,023][106225] Updated weights for policy 1, policy_version 140514 (0.0006) [2023-12-27 20:14:19,083][106225] Updated weights for policy 1, policy_version 140524 (0.0008) [2023-12-27 20:14:19,142][106225] Updated weights for policy 1, policy_version 140534 (0.0007) [2023-12-27 20:14:19,195][106225] Updated weights for policy 1, policy_version 140544 (0.0007) [2023-12-27 20:14:19,626][106226] Updated weights for policy 0, policy_version 140456 (0.0009) [2023-12-27 20:14:19,684][106226] Updated weights for policy 0, policy_version 140466 (0.0008) [2023-12-27 20:14:19,749][106226] Updated weights for policy 0, policy_version 140476 (0.0009) [2023-12-27 20:14:19,986][106225] Updated weights for policy 1, policy_version 140554 (0.0009) [2023-12-27 20:14:20,056][106225] Updated weights for policy 1, policy_version 140564 (0.0008) [2023-12-27 20:14:20,124][106225] Updated weights for policy 1, policy_version 140574 (0.0009) [2023-12-27 20:14:20,457][106226] Updated weights for policy 0, policy_version 140486 (0.0006) [2023-12-27 20:14:20,521][106226] Updated weights for policy 0, policy_version 140496 (0.0009) [2023-12-27 20:14:20,586][106226] Updated weights for policy 0, policy_version 140506 (0.0008) [2023-12-27 20:14:20,867][106225] Updated weights for policy 1, policy_version 140584 (0.0008) [2023-12-27 20:14:20,920][106225] Updated weights for policy 1, policy_version 140594 (0.0009) [2023-12-27 20:14:20,978][106225] Updated weights for policy 1, policy_version 140604 (0.0007) [2023-12-27 20:14:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 71983104. Throughput: 0: 9949.9, 1: 9799.2. Samples: 71992320. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:21,175][105115] Avg episode reward: [(0, '-5.344'), (1, '-6.442')] [2023-12-27 20:14:21,263][106226] Updated weights for policy 0, policy_version 140516 (0.0010) [2023-12-27 20:14:21,332][106226] Updated weights for policy 0, policy_version 140526 (0.0007) [2023-12-27 20:14:21,401][106226] Updated weights for policy 0, policy_version 140536 (0.0009) [2023-12-27 20:14:21,751][106225] Updated weights for policy 1, policy_version 140614 (0.0008) [2023-12-27 20:14:21,810][106225] Updated weights for policy 1, policy_version 140624 (0.0008) [2023-12-27 20:14:21,868][106225] Updated weights for policy 1, policy_version 140634 (0.0009) [2023-12-27 20:14:22,128][106226] Updated weights for policy 0, policy_version 140546 (0.0009) [2023-12-27 20:14:22,191][106226] Updated weights for policy 0, policy_version 140556 (0.0009) [2023-12-27 20:14:22,253][106226] Updated weights for policy 0, policy_version 140566 (0.0009) [2023-12-27 20:14:22,316][106226] Updated weights for policy 0, policy_version 140576 (0.0008) [2023-12-27 20:14:22,723][106225] Updated weights for policy 1, policy_version 140644 (0.0009) [2023-12-27 20:14:22,786][106225] Updated weights for policy 1, policy_version 140654 (0.0009) [2023-12-27 20:14:22,841][106225] Updated weights for policy 1, policy_version 140664 (0.0009) [2023-12-27 20:14:22,960][106226] Updated weights for policy 0, policy_version 140586 (0.0008) [2023-12-27 20:14:23,022][106226] Updated weights for policy 0, policy_version 140596 (0.0009) [2023-12-27 20:14:23,075][106226] Updated weights for policy 0, policy_version 140606 (0.0008) [2023-12-27 20:14:23,605][106225] Updated weights for policy 1, policy_version 140674 (0.0008) [2023-12-27 20:14:23,669][106225] Updated weights for policy 1, policy_version 140684 (0.0007) [2023-12-27 20:14:23,688][106226] Updated weights for policy 0, policy_version 140616 (0.0008) [2023-12-27 20:14:23,732][106225] Updated weights for policy 1, policy_version 140694 (0.0008) [2023-12-27 20:14:23,742][106226] Updated weights for policy 0, policy_version 140626 (0.0006) [2023-12-27 20:14:23,790][106225] Updated weights for policy 1, policy_version 140704 (0.0009) [2023-12-27 20:14:23,793][106226] Updated weights for policy 0, policy_version 140636 (0.0006) [2023-12-27 20:14:24,469][106225] Updated weights for policy 1, policy_version 140714 (0.0010) [2023-12-27 20:14:24,520][106225] Updated weights for policy 1, policy_version 140724 (0.0010) [2023-12-27 20:14:24,540][106226] Updated weights for policy 0, policy_version 140646 (0.0007) [2023-12-27 20:14:24,576][106225] Updated weights for policy 1, policy_version 140734 (0.0010) [2023-12-27 20:14:24,602][106226] Updated weights for policy 0, policy_version 140656 (0.0006) [2023-12-27 20:14:24,648][106226] Updated weights for policy 0, policy_version 140666 (0.0007) [2023-12-27 20:14:25,255][106226] Updated weights for policy 0, policy_version 140676 (0.0006) [2023-12-27 20:14:25,290][106225] Updated weights for policy 1, policy_version 140744 (0.0007) [2023-12-27 20:14:25,323][106226] Updated weights for policy 0, policy_version 140686 (0.0006) [2023-12-27 20:14:25,352][106225] Updated weights for policy 1, policy_version 140754 (0.0008) [2023-12-27 20:14:25,375][106226] Updated weights for policy 0, policy_version 140696 (0.0007) [2023-12-27 20:14:25,404][106225] Updated weights for policy 1, policy_version 140764 (0.0006) [2023-12-27 20:14:26,054][106225] Updated weights for policy 1, policy_version 140774 (0.0007) [2023-12-27 20:14:26,074][106226] Updated weights for policy 0, policy_version 140706 (0.0008) [2023-12-27 20:14:26,114][106225] Updated weights for policy 1, policy_version 140784 (0.0010) [2023-12-27 20:14:26,127][106226] Updated weights for policy 0, policy_version 140716 (0.0007) [2023-12-27 20:14:26,170][106225] Updated weights for policy 1, policy_version 140794 (0.0008) [2023-12-27 20:14:26,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 72073216. Throughput: 0: 9995.3, 1: 9776.1. Samples: 72049736. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:26,175][105115] Avg episode reward: [(0, '-5.193'), (1, '-6.500')] [2023-12-27 20:14:26,178][106226] Updated weights for policy 0, policy_version 140726 (0.0008) [2023-12-27 20:14:26,201][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000140800_36052992.pth... [2023-12-27 20:14:26,206][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000139648_35758080.pth [2023-12-27 20:14:26,232][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000140736_36036608.pth... [2023-12-27 20:14:26,233][106226] Updated weights for policy 0, policy_version 140736 (0.0008) [2023-12-27 20:14:26,235][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000139552_35733504.pth [2023-12-27 20:14:26,825][106225] Updated weights for policy 1, policy_version 140804 (0.0009) [2023-12-27 20:14:26,880][106225] Updated weights for policy 1, policy_version 140814 (0.0006) [2023-12-27 20:14:26,935][106225] Updated weights for policy 1, policy_version 140824 (0.0005) [2023-12-27 20:14:26,973][106226] Updated weights for policy 0, policy_version 140746 (0.0010) [2023-12-27 20:14:27,019][106226] Updated weights for policy 0, policy_version 140756 (0.0006) [2023-12-27 20:14:27,086][106226] Updated weights for policy 0, policy_version 140766 (0.0005) [2023-12-27 20:14:27,590][106225] Updated weights for policy 1, policy_version 140834 (0.0005) [2023-12-27 20:14:27,647][106225] Updated weights for policy 1, policy_version 140844 (0.0006) [2023-12-27 20:14:27,711][106225] Updated weights for policy 1, policy_version 140854 (0.0007) [2023-12-27 20:14:27,712][106226] Updated weights for policy 0, policy_version 140776 (0.0007) [2023-12-27 20:14:27,761][106226] Updated weights for policy 0, policy_version 140786 (0.0010) [2023-12-27 20:14:27,771][106225] Updated weights for policy 1, policy_version 140864 (0.0010) [2023-12-27 20:14:27,813][106226] Updated weights for policy 0, policy_version 140796 (0.0010) [2023-12-27 20:14:28,410][106225] Updated weights for policy 1, policy_version 140874 (0.0009) [2023-12-27 20:14:28,427][106226] Updated weights for policy 0, policy_version 140806 (0.0007) [2023-12-27 20:14:28,472][106225] Updated weights for policy 1, policy_version 140884 (0.0008) [2023-12-27 20:14:28,487][106226] Updated weights for policy 0, policy_version 140816 (0.0007) [2023-12-27 20:14:28,532][106225] Updated weights for policy 1, policy_version 140894 (0.0008) [2023-12-27 20:14:28,542][106226] Updated weights for policy 0, policy_version 140826 (0.0005) [2023-12-27 20:14:29,170][106226] Updated weights for policy 0, policy_version 140836 (0.0009) [2023-12-27 20:14:29,177][106225] Updated weights for policy 1, policy_version 140904 (0.0007) [2023-12-27 20:14:29,233][106226] Updated weights for policy 0, policy_version 140846 (0.0010) [2023-12-27 20:14:29,236][106225] Updated weights for policy 1, policy_version 140914 (0.0008) [2023-12-27 20:14:29,297][106226] Updated weights for policy 0, policy_version 140856 (0.0009) [2023-12-27 20:14:29,301][106225] Updated weights for policy 1, policy_version 140924 (0.0006) [2023-12-27 20:14:30,013][106225] Updated weights for policy 1, policy_version 140934 (0.0007) [2023-12-27 20:14:30,038][106226] Updated weights for policy 0, policy_version 140866 (0.0010) [2023-12-27 20:14:30,076][106225] Updated weights for policy 1, policy_version 140944 (0.0007) [2023-12-27 20:14:30,104][106226] Updated weights for policy 0, policy_version 140876 (0.0007) [2023-12-27 20:14:30,137][106225] Updated weights for policy 1, policy_version 140954 (0.0006) [2023-12-27 20:14:30,173][106226] Updated weights for policy 0, policy_version 140886 (0.0006) [2023-12-27 20:14:30,244][106226] Updated weights for policy 0, policy_version 140896 (0.0005) [2023-12-27 20:14:30,714][106225] Updated weights for policy 1, policy_version 140964 (0.0006) [2023-12-27 20:14:30,771][106225] Updated weights for policy 1, policy_version 140974 (0.0008) [2023-12-27 20:14:30,825][106225] Updated weights for policy 1, policy_version 140984 (0.0008) [2023-12-27 20:14:30,887][106226] Updated weights for policy 0, policy_version 140906 (0.0007) [2023-12-27 20:14:30,934][106226] Updated weights for policy 0, policy_version 140916 (0.0008) [2023-12-27 20:14:30,977][106226] Updated weights for policy 0, policy_version 140926 (0.0008) [2023-12-27 20:14:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 72187904. Throughput: 0: 10113.1, 1: 9821.8. Samples: 72173792. Policy #0 lag: (min: 18.0, avg: 25.6, max: 50.0) [2023-12-27 20:14:31,175][105115] Avg episode reward: [(0, '-5.208'), (1, '-6.337')] [2023-12-27 20:14:31,600][106225] Updated weights for policy 1, policy_version 140994 (0.0007) [2023-12-27 20:14:31,661][106225] Updated weights for policy 1, policy_version 141004 (0.0007) [2023-12-27 20:14:31,676][106226] Updated weights for policy 0, policy_version 140936 (0.0009) [2023-12-27 20:14:31,726][106225] Updated weights for policy 1, policy_version 141014 (0.0008) [2023-12-27 20:14:31,741][106226] Updated weights for policy 0, policy_version 140946 (0.0008) [2023-12-27 20:14:31,786][106225] Updated weights for policy 1, policy_version 141024 (0.0008) [2023-12-27 20:14:31,801][106226] Updated weights for policy 0, policy_version 140956 (0.0005) [2023-12-27 20:14:32,441][106226] Updated weights for policy 0, policy_version 140966 (0.0007) [2023-12-27 20:14:32,496][106226] Updated weights for policy 0, policy_version 140976 (0.0008) [2023-12-27 20:14:32,507][106225] Updated weights for policy 1, policy_version 141034 (0.0007) [2023-12-27 20:14:32,553][106226] Updated weights for policy 0, policy_version 140986 (0.0008) [2023-12-27 20:14:32,556][106225] Updated weights for policy 1, policy_version 141044 (0.0007) [2023-12-27 20:14:32,611][106225] Updated weights for policy 1, policy_version 141054 (0.0007) [2023-12-27 20:14:33,305][106226] Updated weights for policy 0, policy_version 140996 (0.0010) [2023-12-27 20:14:33,321][106225] Updated weights for policy 1, policy_version 141064 (0.0006) [2023-12-27 20:14:33,361][106226] Updated weights for policy 0, policy_version 141006 (0.0010) [2023-12-27 20:14:33,365][106225] Updated weights for policy 1, policy_version 141074 (0.0005) [2023-12-27 20:14:33,407][106226] Updated weights for policy 0, policy_version 141016 (0.0010) [2023-12-27 20:14:33,410][106225] Updated weights for policy 1, policy_version 141084 (0.0005) [2023-12-27 20:14:34,035][106225] Updated weights for policy 1, policy_version 141094 (0.0006) [2023-12-27 20:14:34,082][106225] Updated weights for policy 1, policy_version 141104 (0.0007) [2023-12-27 20:14:34,123][106226] Updated weights for policy 0, policy_version 141026 (0.0010) [2023-12-27 20:14:34,126][106225] Updated weights for policy 1, policy_version 141114 (0.0008) [2023-12-27 20:14:34,193][106226] Updated weights for policy 0, policy_version 141036 (0.0011) [2023-12-27 20:14:34,250][106226] Updated weights for policy 0, policy_version 141046 (0.0011) [2023-12-27 20:14:34,313][106226] Updated weights for policy 0, policy_version 141056 (0.0010) [2023-12-27 20:14:34,880][106225] Updated weights for policy 1, policy_version 141124 (0.0007) [2023-12-27 20:14:34,937][106225] Updated weights for policy 1, policy_version 141134 (0.0007) [2023-12-27 20:14:34,993][106225] Updated weights for policy 1, policy_version 141144 (0.0007) [2023-12-27 20:14:35,035][106226] Updated weights for policy 0, policy_version 141066 (0.0011) [2023-12-27 20:14:35,095][106226] Updated weights for policy 0, policy_version 141076 (0.0010) [2023-12-27 20:14:35,159][106226] Updated weights for policy 0, policy_version 141086 (0.0011) [2023-12-27 20:14:35,605][106225] Updated weights for policy 1, policy_version 141154 (0.0008) [2023-12-27 20:14:35,662][106225] Updated weights for policy 1, policy_version 141164 (0.0008) [2023-12-27 20:14:35,717][106225] Updated weights for policy 1, policy_version 141174 (0.0007) [2023-12-27 20:14:35,762][106226] Updated weights for policy 0, policy_version 141096 (0.0008) [2023-12-27 20:14:35,772][106225] Updated weights for policy 1, policy_version 141184 (0.0006) [2023-12-27 20:14:35,826][106226] Updated weights for policy 0, policy_version 141106 (0.0008) [2023-12-27 20:14:35,890][106226] Updated weights for policy 0, policy_version 141116 (0.0007) [2023-12-27 20:14:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 72286208. Throughput: 0: 10088.5, 1: 9852.0. Samples: 72295040. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:14:36,175][105115] Avg episode reward: [(0, '-5.297'), (1, '-6.345')] [2023-12-27 20:14:36,515][106226] Updated weights for policy 0, policy_version 141126 (0.0008) [2023-12-27 20:14:36,574][106225] Updated weights for policy 1, policy_version 141194 (0.0006) [2023-12-27 20:14:36,582][106226] Updated weights for policy 0, policy_version 141136 (0.0007) [2023-12-27 20:14:36,628][106225] Updated weights for policy 1, policy_version 141204 (0.0009) [2023-12-27 20:14:36,645][106226] Updated weights for policy 0, policy_version 141146 (0.0008) [2023-12-27 20:14:36,691][106225] Updated weights for policy 1, policy_version 141214 (0.0007) [2023-12-27 20:14:37,314][106226] Updated weights for policy 0, policy_version 141156 (0.0007) [2023-12-27 20:14:37,371][106226] Updated weights for policy 0, policy_version 141166 (0.0009) [2023-12-27 20:14:37,371][106225] Updated weights for policy 1, policy_version 141224 (0.0007) [2023-12-27 20:14:37,428][106226] Updated weights for policy 0, policy_version 141176 (0.0008) [2023-12-27 20:14:37,439][106225] Updated weights for policy 1, policy_version 141234 (0.0006) [2023-12-27 20:14:37,502][106225] Updated weights for policy 1, policy_version 141244 (0.0007) [2023-12-27 20:14:38,139][106226] Updated weights for policy 0, policy_version 141186 (0.0009) [2023-12-27 20:14:38,189][106225] Updated weights for policy 1, policy_version 141254 (0.0008) [2023-12-27 20:14:38,195][106226] Updated weights for policy 0, policy_version 141196 (0.0006) [2023-12-27 20:14:38,240][106225] Updated weights for policy 1, policy_version 141264 (0.0006) [2023-12-27 20:14:38,246][106226] Updated weights for policy 0, policy_version 141206 (0.0006) [2023-12-27 20:14:38,304][106225] Updated weights for policy 1, policy_version 141274 (0.0008) [2023-12-27 20:14:38,320][106226] Updated weights for policy 0, policy_version 141216 (0.0007) [2023-12-27 20:14:39,023][106226] Updated weights for policy 0, policy_version 141226 (0.0007) [2023-12-27 20:14:39,075][106226] Updated weights for policy 0, policy_version 141236 (0.0008) [2023-12-27 20:14:39,080][106225] Updated weights for policy 1, policy_version 141284 (0.0007) [2023-12-27 20:14:39,128][106226] Updated weights for policy 0, policy_version 141246 (0.0006) [2023-12-27 20:14:39,129][106225] Updated weights for policy 1, policy_version 141294 (0.0008) [2023-12-27 20:14:39,179][106225] Updated weights for policy 1, policy_version 141304 (0.0008) [2023-12-27 20:14:39,905][106226] Updated weights for policy 0, policy_version 141256 (0.0008) [2023-12-27 20:14:39,963][106225] Updated weights for policy 1, policy_version 141314 (0.0008) [2023-12-27 20:14:39,977][106226] Updated weights for policy 0, policy_version 141266 (0.0009) [2023-12-27 20:14:40,025][106225] Updated weights for policy 1, policy_version 141324 (0.0007) [2023-12-27 20:14:40,047][106226] Updated weights for policy 0, policy_version 141276 (0.0007) [2023-12-27 20:14:40,088][106225] Updated weights for policy 1, policy_version 141334 (0.0006) [2023-12-27 20:14:40,155][106225] Updated weights for policy 1, policy_version 141344 (0.0008) [2023-12-27 20:14:40,793][106226] Updated weights for policy 0, policy_version 141286 (0.0009) [2023-12-27 20:14:40,863][106226] Updated weights for policy 0, policy_version 141296 (0.0009) [2023-12-27 20:14:40,870][106225] Updated weights for policy 1, policy_version 141354 (0.0007) [2023-12-27 20:14:40,914][106226] Updated weights for policy 0, policy_version 141306 (0.0006) [2023-12-27 20:14:40,920][106225] Updated weights for policy 1, policy_version 141364 (0.0007) [2023-12-27 20:14:40,980][106225] Updated weights for policy 1, policy_version 141374 (0.0008) [2023-12-27 20:14:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 72384512. Throughput: 0: 10130.3, 1: 9836.3. Samples: 72354176. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:14:41,175][105115] Avg episode reward: [(0, '-5.123'), (1, '-6.775')] [2023-12-27 20:14:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000141376_36200448.pth... [2023-12-27 20:14:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000141312_36184064.pth... [2023-12-27 20:14:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000140224_35905536.pth [2023-12-27 20:14:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000140128_35880960.pth [2023-12-27 20:14:41,738][106226] Updated weights for policy 0, policy_version 141316 (0.0007) [2023-12-27 20:14:41,794][106225] Updated weights for policy 1, policy_version 141384 (0.0008) [2023-12-27 20:14:41,804][106226] Updated weights for policy 0, policy_version 141326 (0.0007) [2023-12-27 20:14:41,859][106225] Updated weights for policy 1, policy_version 141394 (0.0008) [2023-12-27 20:14:41,874][106226] Updated weights for policy 0, policy_version 141336 (0.0009) [2023-12-27 20:14:41,921][106225] Updated weights for policy 1, policy_version 141404 (0.0008) [2023-12-27 20:14:42,543][106226] Updated weights for policy 0, policy_version 141346 (0.0008) [2023-12-27 20:14:42,595][106226] Updated weights for policy 0, policy_version 141356 (0.0006) [2023-12-27 20:14:42,647][106226] Updated weights for policy 0, policy_version 141366 (0.0005) [2023-12-27 20:14:42,692][106225] Updated weights for policy 1, policy_version 141414 (0.0008) [2023-12-27 20:14:42,705][106226] Updated weights for policy 0, policy_version 141376 (0.0007) [2023-12-27 20:14:42,747][106225] Updated weights for policy 1, policy_version 141424 (0.0008) [2023-12-27 20:14:42,801][106225] Updated weights for policy 1, policy_version 141434 (0.0009) [2023-12-27 20:14:43,326][106226] Updated weights for policy 0, policy_version 141386 (0.0008) [2023-12-27 20:14:43,391][106226] Updated weights for policy 0, policy_version 141396 (0.0008) [2023-12-27 20:14:43,451][106226] Updated weights for policy 0, policy_version 141406 (0.0009) [2023-12-27 20:14:43,502][106225] Updated weights for policy 1, policy_version 141444 (0.0008) [2023-12-27 20:14:43,564][106225] Updated weights for policy 1, policy_version 141454 (0.0008) [2023-12-27 20:14:43,620][106225] Updated weights for policy 1, policy_version 141464 (0.0007) [2023-12-27 20:14:44,163][106226] Updated weights for policy 0, policy_version 141416 (0.0009) [2023-12-27 20:14:44,230][106226] Updated weights for policy 0, policy_version 141426 (0.0007) [2023-12-27 20:14:44,299][106226] Updated weights for policy 0, policy_version 141436 (0.0009) [2023-12-27 20:14:44,325][106225] Updated weights for policy 1, policy_version 141474 (0.0008) [2023-12-27 20:14:44,385][106225] Updated weights for policy 1, policy_version 141484 (0.0010) [2023-12-27 20:14:44,441][106225] Updated weights for policy 1, policy_version 141494 (0.0010) [2023-12-27 20:14:44,495][106225] Updated weights for policy 1, policy_version 141504 (0.0010) [2023-12-27 20:14:44,936][106226] Updated weights for policy 0, policy_version 141446 (0.0010) [2023-12-27 20:14:44,991][106226] Updated weights for policy 0, policy_version 141456 (0.0010) [2023-12-27 20:14:45,060][106226] Updated weights for policy 0, policy_version 141466 (0.0011) [2023-12-27 20:14:45,143][106225] Updated weights for policy 1, policy_version 141514 (0.0010) [2023-12-27 20:14:45,204][106225] Updated weights for policy 1, policy_version 141524 (0.0011) [2023-12-27 20:14:45,265][106225] Updated weights for policy 1, policy_version 141534 (0.0010) [2023-12-27 20:14:45,703][106226] Updated weights for policy 0, policy_version 141476 (0.0010) [2023-12-27 20:14:45,762][106226] Updated weights for policy 0, policy_version 141486 (0.0008) [2023-12-27 20:14:45,817][106226] Updated weights for policy 0, policy_version 141496 (0.0008) [2023-12-27 20:14:45,963][106225] Updated weights for policy 1, policy_version 141544 (0.0009) [2023-12-27 20:14:46,014][106225] Updated weights for policy 1, policy_version 141554 (0.0007) [2023-12-27 20:14:46,071][106225] Updated weights for policy 1, policy_version 141564 (0.0008) [2023-12-27 20:14:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 72482816. Throughput: 0: 10112.0, 1: 9700.2. Samples: 72468860. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:14:46,176][105115] Avg episode reward: [(0, '-5.036'), (1, '-6.307')] [2023-12-27 20:14:46,489][106226] Updated weights for policy 0, policy_version 141506 (0.0007) [2023-12-27 20:14:46,544][106226] Updated weights for policy 0, policy_version 141516 (0.0005) [2023-12-27 20:14:46,599][106226] Updated weights for policy 0, policy_version 141526 (0.0005) [2023-12-27 20:14:46,653][106226] Updated weights for policy 0, policy_version 141536 (0.0008) [2023-12-27 20:14:46,872][106225] Updated weights for policy 1, policy_version 141574 (0.0008) [2023-12-27 20:14:46,932][106225] Updated weights for policy 1, policy_version 141584 (0.0008) [2023-12-27 20:14:46,985][106225] Updated weights for policy 1, policy_version 141594 (0.0008) [2023-12-27 20:14:47,225][106226] Updated weights for policy 0, policy_version 141546 (0.0007) [2023-12-27 20:14:47,284][106226] Updated weights for policy 0, policy_version 141556 (0.0010) [2023-12-27 20:14:47,337][106226] Updated weights for policy 0, policy_version 141566 (0.0006) [2023-12-27 20:14:47,734][106225] Updated weights for policy 1, policy_version 141604 (0.0010) [2023-12-27 20:14:47,790][106225] Updated weights for policy 1, policy_version 141614 (0.0010) [2023-12-27 20:14:47,850][106226] Updated weights for policy 0, policy_version 141576 (0.0005) [2023-12-27 20:14:47,853][106225] Updated weights for policy 1, policy_version 141624 (0.0010) [2023-12-27 20:14:47,896][106226] Updated weights for policy 0, policy_version 141586 (0.0006) [2023-12-27 20:14:47,942][106226] Updated weights for policy 0, policy_version 141596 (0.0005) [2023-12-27 20:14:48,520][106226] Updated weights for policy 0, policy_version 141606 (0.0006) [2023-12-27 20:14:48,533][106225] Updated weights for policy 1, policy_version 141634 (0.0010) [2023-12-27 20:14:48,582][106226] Updated weights for policy 0, policy_version 141616 (0.0005) [2023-12-27 20:14:48,585][106225] Updated weights for policy 1, policy_version 141644 (0.0010) [2023-12-27 20:14:48,636][106225] Updated weights for policy 1, policy_version 141654 (0.0010) [2023-12-27 20:14:48,641][106226] Updated weights for policy 0, policy_version 141626 (0.0005) [2023-12-27 20:14:48,683][106225] Updated weights for policy 1, policy_version 141664 (0.0010) [2023-12-27 20:14:49,250][106226] Updated weights for policy 0, policy_version 141636 (0.0006) [2023-12-27 20:14:49,315][106226] Updated weights for policy 0, policy_version 141646 (0.0008) [2023-12-27 20:14:49,382][106226] Updated weights for policy 0, policy_version 141656 (0.0008) [2023-12-27 20:14:49,386][106225] Updated weights for policy 1, policy_version 141674 (0.0008) [2023-12-27 20:14:49,448][106225] Updated weights for policy 1, policy_version 141684 (0.0008) [2023-12-27 20:14:49,503][106225] Updated weights for policy 1, policy_version 141694 (0.0008) [2023-12-27 20:14:50,002][106226] Updated weights for policy 0, policy_version 141666 (0.0007) [2023-12-27 20:14:50,060][106226] Updated weights for policy 0, policy_version 141676 (0.0011) [2023-12-27 20:14:50,121][106226] Updated weights for policy 0, policy_version 141686 (0.0010) [2023-12-27 20:14:50,186][106226] Updated weights for policy 0, policy_version 141696 (0.0008) [2023-12-27 20:14:50,250][106225] Updated weights for policy 1, policy_version 141704 (0.0008) [2023-12-27 20:14:50,315][106225] Updated weights for policy 1, policy_version 141714 (0.0007) [2023-12-27 20:14:50,380][106225] Updated weights for policy 1, policy_version 141724 (0.0007) [2023-12-27 20:14:50,874][106226] Updated weights for policy 0, policy_version 141706 (0.0008) [2023-12-27 20:14:50,946][106226] Updated weights for policy 0, policy_version 141716 (0.0007) [2023-12-27 20:14:50,962][106225] Updated weights for policy 1, policy_version 141734 (0.0007) [2023-12-27 20:14:51,012][106226] Updated weights for policy 0, policy_version 141726 (0.0010) [2023-12-27 20:14:51,028][106225] Updated weights for policy 1, policy_version 141744 (0.0008) [2023-12-27 20:14:51,097][106225] Updated weights for policy 1, policy_version 141754 (0.0009) [2023-12-27 20:14:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 72589312. Throughput: 0: 10199.3, 1: 9692.2. Samples: 72593752. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:14:51,175][105115] Avg episode reward: [(0, '-5.157'), (1, '-6.484')] [2023-12-27 20:14:51,657][106226] Updated weights for policy 0, policy_version 141736 (0.0008) [2023-12-27 20:14:51,714][106226] Updated weights for policy 0, policy_version 141746 (0.0007) [2023-12-27 20:14:51,774][106226] Updated weights for policy 0, policy_version 141756 (0.0008) [2023-12-27 20:14:51,897][106225] Updated weights for policy 1, policy_version 141764 (0.0007) [2023-12-27 20:14:51,944][106225] Updated weights for policy 1, policy_version 141774 (0.0007) [2023-12-27 20:14:51,989][106225] Updated weights for policy 1, policy_version 141784 (0.0008) [2023-12-27 20:14:52,498][106226] Updated weights for policy 0, policy_version 141766 (0.0008) [2023-12-27 20:14:52,558][106226] Updated weights for policy 0, policy_version 141776 (0.0008) [2023-12-27 20:14:52,614][106226] Updated weights for policy 0, policy_version 141786 (0.0008) [2023-12-27 20:14:52,760][106225] Updated weights for policy 1, policy_version 141794 (0.0009) [2023-12-27 20:14:52,822][106225] Updated weights for policy 1, policy_version 141804 (0.0008) [2023-12-27 20:14:52,880][106225] Updated weights for policy 1, policy_version 141814 (0.0005) [2023-12-27 20:14:52,936][106225] Updated weights for policy 1, policy_version 141824 (0.0005) [2023-12-27 20:14:53,370][106226] Updated weights for policy 0, policy_version 141796 (0.0008) [2023-12-27 20:14:53,424][106226] Updated weights for policy 0, policy_version 141806 (0.0007) [2023-12-27 20:14:53,488][106226] Updated weights for policy 0, policy_version 141816 (0.0007) [2023-12-27 20:14:53,636][106225] Updated weights for policy 1, policy_version 141834 (0.0009) [2023-12-27 20:14:53,700][106225] Updated weights for policy 1, policy_version 141844 (0.0010) [2023-12-27 20:14:53,758][106225] Updated weights for policy 1, policy_version 141854 (0.0008) [2023-12-27 20:14:54,072][106226] Updated weights for policy 0, policy_version 141826 (0.0008) [2023-12-27 20:14:54,133][106226] Updated weights for policy 0, policy_version 141836 (0.0007) [2023-12-27 20:14:54,178][106226] Updated weights for policy 0, policy_version 141846 (0.0008) [2023-12-27 20:14:54,231][106226] Updated weights for policy 0, policy_version 141856 (0.0008) [2023-12-27 20:14:54,463][106225] Updated weights for policy 1, policy_version 141864 (0.0006) [2023-12-27 20:14:54,522][106225] Updated weights for policy 1, policy_version 141874 (0.0008) [2023-12-27 20:14:54,585][106225] Updated weights for policy 1, policy_version 141884 (0.0008) [2023-12-27 20:14:54,996][106226] Updated weights for policy 0, policy_version 141866 (0.0010) [2023-12-27 20:14:55,057][106226] Updated weights for policy 0, policy_version 141876 (0.0010) [2023-12-27 20:14:55,120][106226] Updated weights for policy 0, policy_version 141886 (0.0011) [2023-12-27 20:14:55,215][106225] Updated weights for policy 1, policy_version 141894 (0.0006) [2023-12-27 20:14:55,279][106225] Updated weights for policy 1, policy_version 141904 (0.0007) [2023-12-27 20:14:55,347][106225] Updated weights for policy 1, policy_version 141914 (0.0007) [2023-12-27 20:14:55,696][106226] Updated weights for policy 0, policy_version 141896 (0.0010) [2023-12-27 20:14:55,752][106226] Updated weights for policy 0, policy_version 141906 (0.0010) [2023-12-27 20:14:55,812][106226] Updated weights for policy 0, policy_version 141916 (0.0010) [2023-12-27 20:14:55,949][106225] Updated weights for policy 1, policy_version 141924 (0.0006) [2023-12-27 20:14:56,002][106225] Updated weights for policy 1, policy_version 141934 (0.0007) [2023-12-27 20:14:56,057][106225] Updated weights for policy 1, policy_version 141944 (0.0008) [2023-12-27 20:14:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19966.2). Total num frames: 72687616. Throughput: 0: 10140.1, 1: 9683.8. Samples: 72652044. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:14:56,176][105115] Avg episode reward: [(0, '-5.120'), (1, '-6.790')] [2023-12-27 20:14:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000141952_36347904.pth... [2023-12-27 20:14:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000141920_36339712.pth... [2023-12-27 20:14:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000140800_36052992.pth [2023-12-27 20:14:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000140736_36036608.pth [2023-12-27 20:14:56,505][106226] Updated weights for policy 0, policy_version 141926 (0.0011) [2023-12-27 20:14:56,562][106226] Updated weights for policy 0, policy_version 141936 (0.0010) [2023-12-27 20:14:56,608][106226] Updated weights for policy 0, policy_version 141946 (0.0010) [2023-12-27 20:14:56,750][106225] Updated weights for policy 1, policy_version 141954 (0.0007) [2023-12-27 20:14:56,800][106225] Updated weights for policy 1, policy_version 141964 (0.0006) [2023-12-27 20:14:56,849][106225] Updated weights for policy 1, policy_version 141974 (0.0005) [2023-12-27 20:14:56,902][106225] Updated weights for policy 1, policy_version 141984 (0.0005) [2023-12-27 20:14:57,295][106226] Updated weights for policy 0, policy_version 141956 (0.0010) [2023-12-27 20:14:57,352][106226] Updated weights for policy 0, policy_version 141966 (0.0006) [2023-12-27 20:14:57,414][106226] Updated weights for policy 0, policy_version 141976 (0.0010) [2023-12-27 20:14:57,516][106225] Updated weights for policy 1, policy_version 141994 (0.0010) [2023-12-27 20:14:57,579][106225] Updated weights for policy 1, policy_version 142004 (0.0010) [2023-12-27 20:14:57,629][106225] Updated weights for policy 1, policy_version 142014 (0.0010) [2023-12-27 20:14:58,080][106226] Updated weights for policy 0, policy_version 141986 (0.0010) [2023-12-27 20:14:58,136][106226] Updated weights for policy 0, policy_version 141996 (0.0011) [2023-12-27 20:14:58,189][106226] Updated weights for policy 0, policy_version 142006 (0.0010) [2023-12-27 20:14:58,257][106226] Updated weights for policy 0, policy_version 142016 (0.0010) [2023-12-27 20:14:58,302][106225] Updated weights for policy 1, policy_version 142024 (0.0008) [2023-12-27 20:14:58,363][106225] Updated weights for policy 1, policy_version 142034 (0.0008) [2023-12-27 20:14:58,422][106225] Updated weights for policy 1, policy_version 142044 (0.0007) [2023-12-27 20:14:59,055][106226] Updated weights for policy 0, policy_version 142026 (0.0008) [2023-12-27 20:14:59,123][106226] Updated weights for policy 0, policy_version 142036 (0.0009) [2023-12-27 20:14:59,187][106226] Updated weights for policy 0, policy_version 142046 (0.0008) [2023-12-27 20:14:59,248][106225] Updated weights for policy 1, policy_version 142054 (0.0008) [2023-12-27 20:14:59,312][106225] Updated weights for policy 1, policy_version 142064 (0.0008) [2023-12-27 20:14:59,381][106225] Updated weights for policy 1, policy_version 142074 (0.0008) [2023-12-27 20:14:59,917][106226] Updated weights for policy 0, policy_version 142056 (0.0006) [2023-12-27 20:14:59,981][106226] Updated weights for policy 0, policy_version 142066 (0.0008) [2023-12-27 20:14:59,987][106225] Updated weights for policy 1, policy_version 142084 (0.0006) [2023-12-27 20:15:00,045][106226] Updated weights for policy 0, policy_version 142076 (0.0006) [2023-12-27 20:15:00,046][106225] Updated weights for policy 1, policy_version 142094 (0.0007) [2023-12-27 20:15:00,107][106225] Updated weights for policy 1, policy_version 142104 (0.0006) [2023-12-27 20:15:00,756][106225] Updated weights for policy 1, policy_version 142114 (0.0005) [2023-12-27 20:15:00,770][106226] Updated weights for policy 0, policy_version 142086 (0.0008) [2023-12-27 20:15:00,802][106225] Updated weights for policy 1, policy_version 142124 (0.0005) [2023-12-27 20:15:00,825][106226] Updated weights for policy 0, policy_version 142096 (0.0008) [2023-12-27 20:15:00,853][106225] Updated weights for policy 1, policy_version 142134 (0.0005) [2023-12-27 20:15:00,877][106226] Updated weights for policy 0, policy_version 142106 (0.0007) [2023-12-27 20:15:00,903][106225] Updated weights for policy 1, policy_version 142144 (0.0006) [2023-12-27 20:15:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 72785920. Throughput: 0: 10192.8, 1: 9767.3. Samples: 72772804. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:01,175][105115] Avg episode reward: [(0, '-5.199'), (1, '-6.321')] [2023-12-27 20:15:01,603][106226] Updated weights for policy 0, policy_version 142116 (0.0009) [2023-12-27 20:15:01,676][106226] Updated weights for policy 0, policy_version 142126 (0.0008) [2023-12-27 20:15:01,698][106225] Updated weights for policy 1, policy_version 142154 (0.0008) [2023-12-27 20:15:01,745][106226] Updated weights for policy 0, policy_version 142136 (0.0008) [2023-12-27 20:15:01,770][106225] Updated weights for policy 1, policy_version 142164 (0.0007) [2023-12-27 20:15:01,829][106225] Updated weights for policy 1, policy_version 142174 (0.0005) [2023-12-27 20:15:02,449][106225] Updated weights for policy 1, policy_version 142184 (0.0009) [2023-12-27 20:15:02,494][106226] Updated weights for policy 0, policy_version 142146 (0.0008) [2023-12-27 20:15:02,512][106225] Updated weights for policy 1, policy_version 142194 (0.0005) [2023-12-27 20:15:02,552][106226] Updated weights for policy 0, policy_version 142156 (0.0006) [2023-12-27 20:15:02,580][106225] Updated weights for policy 1, policy_version 142204 (0.0008) [2023-12-27 20:15:02,612][106226] Updated weights for policy 0, policy_version 142166 (0.0008) [2023-12-27 20:15:02,667][106226] Updated weights for policy 0, policy_version 142176 (0.0007) [2023-12-27 20:15:03,217][106225] Updated weights for policy 1, policy_version 142214 (0.0007) [2023-12-27 20:15:03,272][106225] Updated weights for policy 1, policy_version 142224 (0.0005) [2023-12-27 20:15:03,329][106225] Updated weights for policy 1, policy_version 142234 (0.0005) [2023-12-27 20:15:03,379][106226] Updated weights for policy 0, policy_version 142186 (0.0007) [2023-12-27 20:15:03,432][106226] Updated weights for policy 0, policy_version 142196 (0.0008) [2023-12-27 20:15:03,488][106226] Updated weights for policy 0, policy_version 142206 (0.0007) [2023-12-27 20:15:03,863][106225] Updated weights for policy 1, policy_version 142244 (0.0006) [2023-12-27 20:15:03,931][106225] Updated weights for policy 1, policy_version 142254 (0.0010) [2023-12-27 20:15:03,994][106225] Updated weights for policy 1, policy_version 142264 (0.0009) [2023-12-27 20:15:04,254][106226] Updated weights for policy 0, policy_version 142216 (0.0007) [2023-12-27 20:15:04,325][106226] Updated weights for policy 0, policy_version 142226 (0.0009) [2023-12-27 20:15:04,387][106226] Updated weights for policy 0, policy_version 142236 (0.0007) [2023-12-27 20:15:04,670][106225] Updated weights for policy 1, policy_version 142274 (0.0008) [2023-12-27 20:15:04,724][106225] Updated weights for policy 1, policy_version 142284 (0.0005) [2023-12-27 20:15:04,784][106225] Updated weights for policy 1, policy_version 142294 (0.0005) [2023-12-27 20:15:04,841][106225] Updated weights for policy 1, policy_version 142304 (0.0008) [2023-12-27 20:15:05,079][106226] Updated weights for policy 0, policy_version 142246 (0.0008) [2023-12-27 20:15:05,141][106226] Updated weights for policy 0, policy_version 142256 (0.0008) [2023-12-27 20:15:05,190][106226] Updated weights for policy 0, policy_version 142266 (0.0006) [2023-12-27 20:15:05,505][106225] Updated weights for policy 1, policy_version 142314 (0.0010) [2023-12-27 20:15:05,566][106225] Updated weights for policy 1, policy_version 142324 (0.0010) [2023-12-27 20:15:05,613][106225] Updated weights for policy 1, policy_version 142334 (0.0010) [2023-12-27 20:15:05,929][106226] Updated weights for policy 0, policy_version 142276 (0.0007) [2023-12-27 20:15:05,985][106226] Updated weights for policy 0, policy_version 142286 (0.0005) [2023-12-27 20:15:06,042][106226] Updated weights for policy 0, policy_version 142296 (0.0007) [2023-12-27 20:15:06,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 72884224. Throughput: 0: 10093.3, 1: 9922.5. Samples: 72893032. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:06,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-6.595')] [2023-12-27 20:15:06,330][106225] Updated weights for policy 1, policy_version 142344 (0.0009) [2023-12-27 20:15:06,389][106225] Updated weights for policy 1, policy_version 142354 (0.0009) [2023-12-27 20:15:06,451][106225] Updated weights for policy 1, policy_version 142364 (0.0008) [2023-12-27 20:15:06,780][106226] Updated weights for policy 0, policy_version 142306 (0.0009) [2023-12-27 20:15:06,844][106226] Updated weights for policy 0, policy_version 142316 (0.0008) [2023-12-27 20:15:06,910][106226] Updated weights for policy 0, policy_version 142326 (0.0007) [2023-12-27 20:15:06,978][106226] Updated weights for policy 0, policy_version 142336 (0.0006) [2023-12-27 20:15:07,091][106225] Updated weights for policy 1, policy_version 142374 (0.0007) [2023-12-27 20:15:07,151][106225] Updated weights for policy 1, policy_version 142384 (0.0006) [2023-12-27 20:15:07,214][106225] Updated weights for policy 1, policy_version 142394 (0.0008) [2023-12-27 20:15:07,651][106226] Updated weights for policy 0, policy_version 142346 (0.0006) [2023-12-27 20:15:07,707][106226] Updated weights for policy 0, policy_version 142356 (0.0007) [2023-12-27 20:15:07,779][106226] Updated weights for policy 0, policy_version 142366 (0.0008) [2023-12-27 20:15:07,877][106225] Updated weights for policy 1, policy_version 142404 (0.0008) [2023-12-27 20:15:07,942][106225] Updated weights for policy 1, policy_version 142414 (0.0010) [2023-12-27 20:15:08,007][106225] Updated weights for policy 1, policy_version 142424 (0.0009) [2023-12-27 20:15:08,317][106226] Updated weights for policy 0, policy_version 142376 (0.0006) [2023-12-27 20:15:08,404][106226] Updated weights for policy 0, policy_version 142386 (0.0008) [2023-12-27 20:15:08,456][106226] Updated weights for policy 0, policy_version 142396 (0.0008) [2023-12-27 20:15:08,786][106225] Updated weights for policy 1, policy_version 142434 (0.0007) [2023-12-27 20:15:08,845][106225] Updated weights for policy 1, policy_version 142444 (0.0005) [2023-12-27 20:15:08,898][106225] Updated weights for policy 1, policy_version 142454 (0.0005) [2023-12-27 20:15:08,955][106225] Updated weights for policy 1, policy_version 142464 (0.0007) [2023-12-27 20:15:09,254][106226] Updated weights for policy 0, policy_version 142406 (0.0008) [2023-12-27 20:15:09,317][106226] Updated weights for policy 0, policy_version 142416 (0.0009) [2023-12-27 20:15:09,385][106226] Updated weights for policy 0, policy_version 142426 (0.0007) [2023-12-27 20:15:09,620][106225] Updated weights for policy 1, policy_version 142474 (0.0007) [2023-12-27 20:15:09,688][106225] Updated weights for policy 1, policy_version 142484 (0.0007) [2023-12-27 20:15:09,759][106225] Updated weights for policy 1, policy_version 142494 (0.0006) [2023-12-27 20:15:10,134][106226] Updated weights for policy 0, policy_version 142436 (0.0008) [2023-12-27 20:15:10,195][106226] Updated weights for policy 0, policy_version 142446 (0.0007) [2023-12-27 20:15:10,251][106226] Updated weights for policy 0, policy_version 142456 (0.0005) [2023-12-27 20:15:10,399][106225] Updated weights for policy 1, policy_version 142504 (0.0005) [2023-12-27 20:15:10,469][106225] Updated weights for policy 1, policy_version 142514 (0.0006) [2023-12-27 20:15:10,536][106225] Updated weights for policy 1, policy_version 142524 (0.0006) [2023-12-27 20:15:10,904][106226] Updated weights for policy 0, policy_version 142466 (0.0007) [2023-12-27 20:15:10,962][106226] Updated weights for policy 0, policy_version 142476 (0.0009) [2023-12-27 20:15:11,016][106226] Updated weights for policy 0, policy_version 142486 (0.0009) [2023-12-27 20:15:11,088][106226] Updated weights for policy 0, policy_version 142496 (0.0007) [2023-12-27 20:15:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 72982528. Throughput: 0: 10080.6, 1: 9982.0. Samples: 72952552. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:11,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-6.857')] [2023-12-27 20:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000142496_36487168.pth... [2023-12-27 20:15:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000141312_36184064.pth [2023-12-27 20:15:11,190][106225] Updated weights for policy 1, policy_version 142534 (0.0008) [2023-12-27 20:15:11,249][106225] Updated weights for policy 1, policy_version 142544 (0.0008) [2023-12-27 20:15:11,314][106225] Updated weights for policy 1, policy_version 142554 (0.0009) [2023-12-27 20:15:11,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000142560_36503552.pth... [2023-12-27 20:15:11,360][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000141376_36200448.pth [2023-12-27 20:15:11,976][106225] Updated weights for policy 1, policy_version 142564 (0.0008) [2023-12-27 20:15:12,011][106226] Updated weights for policy 0, policy_version 142506 (0.0007) [2023-12-27 20:15:12,033][106225] Updated weights for policy 1, policy_version 142574 (0.0007) [2023-12-27 20:15:12,075][106226] Updated weights for policy 0, policy_version 142516 (0.0007) [2023-12-27 20:15:12,096][106225] Updated weights for policy 1, policy_version 142584 (0.0007) [2023-12-27 20:15:12,140][106226] Updated weights for policy 0, policy_version 142526 (0.0009) [2023-12-27 20:15:12,836][106225] Updated weights for policy 1, policy_version 142594 (0.0007) [2023-12-27 20:15:12,865][106226] Updated weights for policy 0, policy_version 142536 (0.0008) [2023-12-27 20:15:12,884][106225] Updated weights for policy 1, policy_version 142604 (0.0006) [2023-12-27 20:15:12,926][106226] Updated weights for policy 0, policy_version 142546 (0.0007) [2023-12-27 20:15:12,936][106225] Updated weights for policy 1, policy_version 142614 (0.0007) [2023-12-27 20:15:12,985][106226] Updated weights for policy 0, policy_version 142556 (0.0008) [2023-12-27 20:15:12,990][106225] Updated weights for policy 1, policy_version 142624 (0.0005) [2023-12-27 20:15:13,697][106225] Updated weights for policy 1, policy_version 142634 (0.0005) [2023-12-27 20:15:13,722][106226] Updated weights for policy 0, policy_version 142566 (0.0008) [2023-12-27 20:15:13,753][106225] Updated weights for policy 1, policy_version 142644 (0.0005) [2023-12-27 20:15:13,786][106226] Updated weights for policy 0, policy_version 142576 (0.0008) [2023-12-27 20:15:13,810][106225] Updated weights for policy 1, policy_version 142654 (0.0005) [2023-12-27 20:15:13,849][106226] Updated weights for policy 0, policy_version 142586 (0.0009) [2023-12-27 20:15:14,376][106225] Updated weights for policy 1, policy_version 142664 (0.0008) [2023-12-27 20:15:14,435][106225] Updated weights for policy 1, policy_version 142674 (0.0008) [2023-12-27 20:15:14,498][106225] Updated weights for policy 1, policy_version 142684 (0.0008) [2023-12-27 20:15:14,605][106226] Updated weights for policy 0, policy_version 142596 (0.0008) [2023-12-27 20:15:14,657][106226] Updated weights for policy 0, policy_version 142606 (0.0009) [2023-12-27 20:15:14,708][106226] Updated weights for policy 0, policy_version 142616 (0.0009) [2023-12-27 20:15:15,295][106225] Updated weights for policy 1, policy_version 142694 (0.0008) [2023-12-27 20:15:15,366][106225] Updated weights for policy 1, policy_version 142704 (0.0008) [2023-12-27 20:15:15,421][106225] Updated weights for policy 1, policy_version 142714 (0.0007) [2023-12-27 20:15:15,426][106226] Updated weights for policy 0, policy_version 142626 (0.0008) [2023-12-27 20:15:15,488][106226] Updated weights for policy 0, policy_version 142636 (0.0010) [2023-12-27 20:15:15,551][106226] Updated weights for policy 0, policy_version 142646 (0.0009) [2023-12-27 20:15:15,615][106226] Updated weights for policy 0, policy_version 142656 (0.0008) [2023-12-27 20:15:16,134][106225] Updated weights for policy 1, policy_version 142724 (0.0007) [2023-12-27 20:15:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 73072640. Throughput: 0: 9918.6, 1: 9971.4. Samples: 73068840. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:16,175][105115] Avg episode reward: [(0, '-5.149'), (1, '-6.686')] [2023-12-27 20:15:16,184][106225] Updated weights for policy 1, policy_version 142734 (0.0009) [2023-12-27 20:15:16,233][106225] Updated weights for policy 1, policy_version 142744 (0.0008) [2023-12-27 20:15:16,318][106226] Updated weights for policy 0, policy_version 142666 (0.0008) [2023-12-27 20:15:16,379][106226] Updated weights for policy 0, policy_version 142676 (0.0008) [2023-12-27 20:15:16,436][106226] Updated weights for policy 0, policy_version 142686 (0.0008) [2023-12-27 20:15:16,972][106225] Updated weights for policy 1, policy_version 142754 (0.0007) [2023-12-27 20:15:17,017][106225] Updated weights for policy 1, policy_version 142764 (0.0008) [2023-12-27 20:15:17,060][106225] Updated weights for policy 1, policy_version 142774 (0.0008) [2023-12-27 20:15:17,105][106225] Updated weights for policy 1, policy_version 142784 (0.0008) [2023-12-27 20:15:17,144][106226] Updated weights for policy 0, policy_version 142696 (0.0008) [2023-12-27 20:15:17,198][106226] Updated weights for policy 0, policy_version 142706 (0.0008) [2023-12-27 20:15:17,246][106226] Updated weights for policy 0, policy_version 142716 (0.0009) [2023-12-27 20:15:17,883][106225] Updated weights for policy 1, policy_version 142794 (0.0009) [2023-12-27 20:15:17,936][106225] Updated weights for policy 1, policy_version 142804 (0.0009) [2023-12-27 20:15:17,978][106226] Updated weights for policy 0, policy_version 142726 (0.0009) [2023-12-27 20:15:17,993][106225] Updated weights for policy 1, policy_version 142814 (0.0006) [2023-12-27 20:15:18,028][106226] Updated weights for policy 0, policy_version 142736 (0.0008) [2023-12-27 20:15:18,088][106226] Updated weights for policy 0, policy_version 142746 (0.0005) [2023-12-27 20:15:18,747][106225] Updated weights for policy 1, policy_version 142824 (0.0008) [2023-12-27 20:15:18,767][106226] Updated weights for policy 0, policy_version 142756 (0.0008) [2023-12-27 20:15:18,804][106225] Updated weights for policy 1, policy_version 142834 (0.0006) [2023-12-27 20:15:18,829][106226] Updated weights for policy 0, policy_version 142766 (0.0009) [2023-12-27 20:15:18,859][106225] Updated weights for policy 1, policy_version 142844 (0.0006) [2023-12-27 20:15:18,897][106226] Updated weights for policy 0, policy_version 142776 (0.0008) [2023-12-27 20:15:19,567][106225] Updated weights for policy 1, policy_version 142854 (0.0008) [2023-12-27 20:15:19,631][106225] Updated weights for policy 1, policy_version 142864 (0.0007) [2023-12-27 20:15:19,651][106226] Updated weights for policy 0, policy_version 142786 (0.0008) [2023-12-27 20:15:19,695][106225] Updated weights for policy 1, policy_version 142874 (0.0006) [2023-12-27 20:15:19,717][106226] Updated weights for policy 0, policy_version 142796 (0.0008) [2023-12-27 20:15:19,785][106226] Updated weights for policy 0, policy_version 142806 (0.0009) [2023-12-27 20:15:19,850][106226] Updated weights for policy 0, policy_version 142816 (0.0009) [2023-12-27 20:15:20,383][106225] Updated weights for policy 1, policy_version 142884 (0.0008) [2023-12-27 20:15:20,450][106225] Updated weights for policy 1, policy_version 142894 (0.0009) [2023-12-27 20:15:20,520][106225] Updated weights for policy 1, policy_version 142904 (0.0008) [2023-12-27 20:15:20,610][106226] Updated weights for policy 0, policy_version 142826 (0.0010) [2023-12-27 20:15:20,673][106226] Updated weights for policy 0, policy_version 142836 (0.0011) [2023-12-27 20:15:20,738][106226] Updated weights for policy 0, policy_version 142846 (0.0011) [2023-12-27 20:15:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 73170944. Throughput: 0: 9864.3, 1: 9887.7. Samples: 73183884. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:21,175][105115] Avg episode reward: [(0, '-5.213'), (1, '-6.490')] [2023-12-27 20:15:21,258][106225] Updated weights for policy 1, policy_version 142914 (0.0009) [2023-12-27 20:15:21,326][106225] Updated weights for policy 1, policy_version 142924 (0.0008) [2023-12-27 20:15:21,398][106225] Updated weights for policy 1, policy_version 142934 (0.0010) [2023-12-27 20:15:21,461][106225] Updated weights for policy 1, policy_version 142944 (0.0007) [2023-12-27 20:15:21,463][106226] Updated weights for policy 0, policy_version 142856 (0.0009) [2023-12-27 20:15:21,531][106226] Updated weights for policy 0, policy_version 142866 (0.0011) [2023-12-27 20:15:21,591][106226] Updated weights for policy 0, policy_version 142876 (0.0011) [2023-12-27 20:15:22,169][106225] Updated weights for policy 1, policy_version 142954 (0.0008) [2023-12-27 20:15:22,234][106225] Updated weights for policy 1, policy_version 142964 (0.0009) [2023-12-27 20:15:22,300][106225] Updated weights for policy 1, policy_version 142974 (0.0007) [2023-12-27 20:15:22,307][106226] Updated weights for policy 0, policy_version 142886 (0.0009) [2023-12-27 20:15:22,375][106226] Updated weights for policy 0, policy_version 142896 (0.0008) [2023-12-27 20:15:22,438][106226] Updated weights for policy 0, policy_version 142906 (0.0008) [2023-12-27 20:15:23,065][106225] Updated weights for policy 1, policy_version 142984 (0.0006) [2023-12-27 20:15:23,118][106226] Updated weights for policy 0, policy_version 142916 (0.0008) [2023-12-27 20:15:23,136][106225] Updated weights for policy 1, policy_version 142994 (0.0007) [2023-12-27 20:15:23,188][106226] Updated weights for policy 0, policy_version 142926 (0.0007) [2023-12-27 20:15:23,193][106225] Updated weights for policy 1, policy_version 143004 (0.0008) [2023-12-27 20:15:23,252][106226] Updated weights for policy 0, policy_version 142936 (0.0007) [2023-12-27 20:15:23,884][106225] Updated weights for policy 1, policy_version 143014 (0.0006) [2023-12-27 20:15:23,949][106225] Updated weights for policy 1, policy_version 143024 (0.0005) [2023-12-27 20:15:23,986][106226] Updated weights for policy 0, policy_version 142946 (0.0007) [2023-12-27 20:15:24,007][106225] Updated weights for policy 1, policy_version 143034 (0.0006) [2023-12-27 20:15:24,038][106226] Updated weights for policy 0, policy_version 142956 (0.0009) [2023-12-27 20:15:24,089][106226] Updated weights for policy 0, policy_version 142966 (0.0009) [2023-12-27 20:15:24,143][106226] Updated weights for policy 0, policy_version 142976 (0.0008) [2023-12-27 20:15:24,543][106225] Updated weights for policy 1, policy_version 143044 (0.0005) [2023-12-27 20:15:24,603][106225] Updated weights for policy 1, policy_version 143054 (0.0008) [2023-12-27 20:15:24,658][106225] Updated weights for policy 1, policy_version 143064 (0.0008) [2023-12-27 20:15:24,829][106226] Updated weights for policy 0, policy_version 142986 (0.0005) [2023-12-27 20:15:24,896][106226] Updated weights for policy 0, policy_version 142996 (0.0006) [2023-12-27 20:15:24,962][106226] Updated weights for policy 0, policy_version 143006 (0.0005) [2023-12-27 20:15:25,225][106225] Updated weights for policy 1, policy_version 143074 (0.0009) [2023-12-27 20:15:25,284][106225] Updated weights for policy 1, policy_version 143084 (0.0005) [2023-12-27 20:15:25,339][106225] Updated weights for policy 1, policy_version 143094 (0.0005) [2023-12-27 20:15:25,395][106225] Updated weights for policy 1, policy_version 143104 (0.0005) [2023-12-27 20:15:25,611][106226] Updated weights for policy 0, policy_version 143016 (0.0006) [2023-12-27 20:15:25,662][106226] Updated weights for policy 0, policy_version 143026 (0.0007) [2023-12-27 20:15:25,718][106226] Updated weights for policy 0, policy_version 143036 (0.0006) [2023-12-27 20:15:26,001][106225] Updated weights for policy 1, policy_version 143114 (0.0010) [2023-12-27 20:15:26,056][106225] Updated weights for policy 1, policy_version 143124 (0.0010) [2023-12-27 20:15:26,110][106225] Updated weights for policy 1, policy_version 143134 (0.0010) [2023-12-27 20:15:26,175][105115] Fps is (10 sec: 20479.2, 60 sec: 20070.3, 300 sec: 19938.5). Total num frames: 73277440. Throughput: 0: 9814.6, 1: 9876.1. Samples: 73240264. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:26,176][105115] Avg episode reward: [(0, '-5.168'), (1, '-6.433')] [2023-12-27 20:15:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000143136_36651008.pth... [2023-12-27 20:15:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000143040_36626432.pth... [2023-12-27 20:15:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000141920_36339712.pth [2023-12-27 20:15:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000141952_36347904.pth [2023-12-27 20:15:26,336][106226] Updated weights for policy 0, policy_version 143046 (0.0008) [2023-12-27 20:15:26,392][106226] Updated weights for policy 0, policy_version 143056 (0.0009) [2023-12-27 20:15:26,450][106226] Updated weights for policy 0, policy_version 143066 (0.0008) [2023-12-27 20:15:26,730][106225] Updated weights for policy 1, policy_version 143144 (0.0008) [2023-12-27 20:15:26,779][106225] Updated weights for policy 1, policy_version 143154 (0.0008) [2023-12-27 20:15:26,835][106225] Updated weights for policy 1, policy_version 143164 (0.0008) [2023-12-27 20:15:27,180][106226] Updated weights for policy 0, policy_version 143076 (0.0010) [2023-12-27 20:15:27,246][106226] Updated weights for policy 0, policy_version 143086 (0.0010) [2023-12-27 20:15:27,306][106226] Updated weights for policy 0, policy_version 143096 (0.0011) [2023-12-27 20:15:27,528][106225] Updated weights for policy 1, policy_version 143174 (0.0006) [2023-12-27 20:15:27,591][106225] Updated weights for policy 1, policy_version 143184 (0.0005) [2023-12-27 20:15:27,657][106225] Updated weights for policy 1, policy_version 143194 (0.0007) [2023-12-27 20:15:28,012][106226] Updated weights for policy 0, policy_version 143106 (0.0011) [2023-12-27 20:15:28,070][106226] Updated weights for policy 0, policy_version 143116 (0.0008) [2023-12-27 20:15:28,131][106226] Updated weights for policy 0, policy_version 143126 (0.0007) [2023-12-27 20:15:28,193][106226] Updated weights for policy 0, policy_version 143136 (0.0010) [2023-12-27 20:15:28,258][106225] Updated weights for policy 1, policy_version 143204 (0.0007) [2023-12-27 20:15:28,305][106225] Updated weights for policy 1, policy_version 143214 (0.0005) [2023-12-27 20:15:28,367][106225] Updated weights for policy 1, policy_version 143224 (0.0007) [2023-12-27 20:15:28,830][106226] Updated weights for policy 0, policy_version 143146 (0.0005) [2023-12-27 20:15:28,883][106226] Updated weights for policy 0, policy_version 143156 (0.0007) [2023-12-27 20:15:28,928][106226] Updated weights for policy 0, policy_version 143166 (0.0008) [2023-12-27 20:15:29,086][106225] Updated weights for policy 1, policy_version 143234 (0.0008) [2023-12-27 20:15:29,149][106225] Updated weights for policy 1, policy_version 143244 (0.0009) [2023-12-27 20:15:29,201][106225] Updated weights for policy 1, policy_version 143254 (0.0009) [2023-12-27 20:15:29,270][106225] Updated weights for policy 1, policy_version 143264 (0.0008) [2023-12-27 20:15:29,594][106226] Updated weights for policy 0, policy_version 143176 (0.0009) [2023-12-27 20:15:29,653][106226] Updated weights for policy 0, policy_version 143186 (0.0009) [2023-12-27 20:15:29,707][106226] Updated weights for policy 0, policy_version 143196 (0.0008) [2023-12-27 20:15:30,044][106225] Updated weights for policy 1, policy_version 143274 (0.0006) [2023-12-27 20:15:30,103][106225] Updated weights for policy 1, policy_version 143284 (0.0007) [2023-12-27 20:15:30,152][106225] Updated weights for policy 1, policy_version 143294 (0.0005) [2023-12-27 20:15:30,449][106226] Updated weights for policy 0, policy_version 143206 (0.0007) [2023-12-27 20:15:30,495][106226] Updated weights for policy 0, policy_version 143216 (0.0005) [2023-12-27 20:15:30,540][106226] Updated weights for policy 0, policy_version 143226 (0.0005) [2023-12-27 20:15:30,734][106225] Updated weights for policy 1, policy_version 143304 (0.0007) [2023-12-27 20:15:30,784][106225] Updated weights for policy 1, policy_version 143314 (0.0006) [2023-12-27 20:15:30,830][106225] Updated weights for policy 1, policy_version 143324 (0.0007) [2023-12-27 20:15:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 73375744. Throughput: 0: 9888.4, 1: 10038.2. Samples: 73365556. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:31,175][105115] Avg episode reward: [(0, '-5.439'), (1, '-6.455')] [2023-12-27 20:15:31,207][106226] Updated weights for policy 0, policy_version 143236 (0.0006) [2023-12-27 20:15:31,267][106226] Updated weights for policy 0, policy_version 143246 (0.0007) [2023-12-27 20:15:31,332][106226] Updated weights for policy 0, policy_version 143256 (0.0006) [2023-12-27 20:15:31,595][106225] Updated weights for policy 1, policy_version 143334 (0.0008) [2023-12-27 20:15:31,654][106225] Updated weights for policy 1, policy_version 143344 (0.0008) [2023-12-27 20:15:31,724][106225] Updated weights for policy 1, policy_version 143354 (0.0008) [2023-12-27 20:15:31,986][106226] Updated weights for policy 0, policy_version 143266 (0.0008) [2023-12-27 20:15:32,040][106226] Updated weights for policy 0, policy_version 143276 (0.0007) [2023-12-27 20:15:32,092][106226] Updated weights for policy 0, policy_version 143286 (0.0007) [2023-12-27 20:15:32,140][106226] Updated weights for policy 0, policy_version 143296 (0.0008) [2023-12-27 20:15:32,402][106225] Updated weights for policy 1, policy_version 143364 (0.0008) [2023-12-27 20:15:32,459][106225] Updated weights for policy 1, policy_version 143374 (0.0008) [2023-12-27 20:15:32,510][106225] Updated weights for policy 1, policy_version 143384 (0.0007) [2023-12-27 20:15:32,875][106226] Updated weights for policy 0, policy_version 143306 (0.0005) [2023-12-27 20:15:32,928][106226] Updated weights for policy 0, policy_version 143316 (0.0005) [2023-12-27 20:15:32,980][106226] Updated weights for policy 0, policy_version 143326 (0.0008) [2023-12-27 20:15:33,275][106225] Updated weights for policy 1, policy_version 143394 (0.0008) [2023-12-27 20:15:33,321][106225] Updated weights for policy 1, policy_version 143404 (0.0008) [2023-12-27 20:15:33,370][106225] Updated weights for policy 1, policy_version 143414 (0.0008) [2023-12-27 20:15:33,426][106225] Updated weights for policy 1, policy_version 143424 (0.0008) [2023-12-27 20:15:33,685][106226] Updated weights for policy 0, policy_version 143336 (0.0006) [2023-12-27 20:15:33,751][106226] Updated weights for policy 0, policy_version 143346 (0.0008) [2023-12-27 20:15:33,813][106226] Updated weights for policy 0, policy_version 143356 (0.0010) [2023-12-27 20:15:34,041][106225] Updated weights for policy 1, policy_version 143434 (0.0010) [2023-12-27 20:15:34,101][106225] Updated weights for policy 1, policy_version 143444 (0.0010) [2023-12-27 20:15:34,167][106225] Updated weights for policy 1, policy_version 143454 (0.0010) [2023-12-27 20:15:34,496][106226] Updated weights for policy 0, policy_version 143366 (0.0010) [2023-12-27 20:15:34,554][106226] Updated weights for policy 0, policy_version 143376 (0.0011) [2023-12-27 20:15:34,611][106226] Updated weights for policy 0, policy_version 143386 (0.0011) [2023-12-27 20:15:34,775][106225] Updated weights for policy 1, policy_version 143464 (0.0006) [2023-12-27 20:15:34,836][106225] Updated weights for policy 1, policy_version 143474 (0.0005) [2023-12-27 20:15:34,896][106225] Updated weights for policy 1, policy_version 143484 (0.0009) [2023-12-27 20:15:35,322][106226] Updated weights for policy 0, policy_version 143396 (0.0009) [2023-12-27 20:15:35,375][106226] Updated weights for policy 0, policy_version 143406 (0.0008) [2023-12-27 20:15:35,434][106226] Updated weights for policy 0, policy_version 143416 (0.0008) [2023-12-27 20:15:35,487][106225] Updated weights for policy 1, policy_version 143494 (0.0010) [2023-12-27 20:15:35,539][106225] Updated weights for policy 1, policy_version 143504 (0.0010) [2023-12-27 20:15:35,592][106225] Updated weights for policy 1, policy_version 143514 (0.0010) [2023-12-27 20:15:36,170][106226] Updated weights for policy 0, policy_version 143426 (0.0007) [2023-12-27 20:15:36,174][105115] Fps is (10 sec: 19661.8, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 73474048. Throughput: 0: 9744.7, 1: 10120.7. Samples: 73487692. Policy #0 lag: (min: 28.0, avg: 40.1, max: 41.0) [2023-12-27 20:15:36,175][105115] Avg episode reward: [(0, '-5.313'), (1, '-6.930')] [2023-12-27 20:15:36,228][106226] Updated weights for policy 0, policy_version 143436 (0.0008) [2023-12-27 20:15:36,276][106226] Updated weights for policy 0, policy_version 143446 (0.0008) [2023-12-27 20:15:36,320][106225] Updated weights for policy 1, policy_version 143524 (0.0010) [2023-12-27 20:15:36,326][106226] Updated weights for policy 0, policy_version 143456 (0.0007) [2023-12-27 20:15:36,378][106225] Updated weights for policy 1, policy_version 143534 (0.0010) [2023-12-27 20:15:36,439][106225] Updated weights for policy 1, policy_version 143544 (0.0010) [2023-12-27 20:15:37,080][106226] Updated weights for policy 0, policy_version 143466 (0.0008) [2023-12-27 20:15:37,153][106226] Updated weights for policy 0, policy_version 143476 (0.0008) [2023-12-27 20:15:37,162][106225] Updated weights for policy 1, policy_version 143554 (0.0010) [2023-12-27 20:15:37,207][106226] Updated weights for policy 0, policy_version 143486 (0.0006) [2023-12-27 20:15:37,217][106225] Updated weights for policy 1, policy_version 143564 (0.0010) [2023-12-27 20:15:37,270][106225] Updated weights for policy 1, policy_version 143574 (0.0010) [2023-12-27 20:15:37,323][106225] Updated weights for policy 1, policy_version 143584 (0.0010) [2023-12-27 20:15:37,932][106226] Updated weights for policy 0, policy_version 143496 (0.0008) [2023-12-27 20:15:37,982][106226] Updated weights for policy 0, policy_version 143506 (0.0008) [2023-12-27 20:15:38,032][106226] Updated weights for policy 0, policy_version 143516 (0.0006) [2023-12-27 20:15:38,052][106225] Updated weights for policy 1, policy_version 143594 (0.0010) [2023-12-27 20:15:38,109][106225] Updated weights for policy 1, policy_version 143604 (0.0010) [2023-12-27 20:15:38,167][106225] Updated weights for policy 1, policy_version 143614 (0.0010) [2023-12-27 20:15:38,799][106226] Updated weights for policy 0, policy_version 143526 (0.0008) [2023-12-27 20:15:38,863][106226] Updated weights for policy 0, policy_version 143536 (0.0009) [2023-12-27 20:15:38,910][106225] Updated weights for policy 1, policy_version 143624 (0.0009) [2023-12-27 20:15:38,925][106226] Updated weights for policy 0, policy_version 143546 (0.0009) [2023-12-27 20:15:38,962][106225] Updated weights for policy 1, policy_version 143634 (0.0008) [2023-12-27 20:15:39,017][106225] Updated weights for policy 1, policy_version 143644 (0.0008) [2023-12-27 20:15:39,635][106226] Updated weights for policy 0, policy_version 143556 (0.0009) [2023-12-27 20:15:39,693][106226] Updated weights for policy 0, policy_version 143566 (0.0008) [2023-12-27 20:15:39,754][106225] Updated weights for policy 1, policy_version 143654 (0.0009) [2023-12-27 20:15:39,756][106226] Updated weights for policy 0, policy_version 143576 (0.0009) [2023-12-27 20:15:39,810][106225] Updated weights for policy 1, policy_version 143664 (0.0008) [2023-12-27 20:15:39,879][106225] Updated weights for policy 1, policy_version 143674 (0.0008) [2023-12-27 20:15:40,461][106226] Updated weights for policy 0, policy_version 143586 (0.0008) [2023-12-27 20:15:40,519][106226] Updated weights for policy 0, policy_version 143596 (0.0005) [2023-12-27 20:15:40,574][106226] Updated weights for policy 0, policy_version 143606 (0.0008) [2023-12-27 20:15:40,635][106226] Updated weights for policy 0, policy_version 143616 (0.0008) [2023-12-27 20:15:40,676][106225] Updated weights for policy 1, policy_version 143684 (0.0007) [2023-12-27 20:15:40,733][106225] Updated weights for policy 1, policy_version 143694 (0.0008) [2023-12-27 20:15:40,799][106225] Updated weights for policy 1, policy_version 143704 (0.0008) [2023-12-27 20:15:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 73572352. Throughput: 0: 9693.1, 1: 10138.5. Samples: 73544460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:15:41,175][105115] Avg episode reward: [(0, '-4.998'), (1, '-6.080')] [2023-12-27 20:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000143616_36773888.pth... [2023-12-27 20:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000143712_36798464.pth... [2023-12-27 20:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000142560_36503552.pth [2023-12-27 20:15:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000142496_36487168.pth [2023-12-27 20:15:41,328][106226] Updated weights for policy 0, policy_version 143626 (0.0008) [2023-12-27 20:15:41,397][106226] Updated weights for policy 0, policy_version 143636 (0.0009) [2023-12-27 20:15:41,457][106226] Updated weights for policy 0, policy_version 143646 (0.0008) [2023-12-27 20:15:41,570][106225] Updated weights for policy 1, policy_version 143714 (0.0008) [2023-12-27 20:15:41,640][106225] Updated weights for policy 1, policy_version 143724 (0.0008) [2023-12-27 20:15:41,711][106225] Updated weights for policy 1, policy_version 143734 (0.0007) [2023-12-27 20:15:41,782][106225] Updated weights for policy 1, policy_version 143744 (0.0006) [2023-12-27 20:15:42,242][106226] Updated weights for policy 0, policy_version 143656 (0.0011) [2023-12-27 20:15:42,308][106226] Updated weights for policy 0, policy_version 143666 (0.0011) [2023-12-27 20:15:42,355][106225] Updated weights for policy 1, policy_version 143754 (0.0006) [2023-12-27 20:15:42,383][106226] Updated weights for policy 0, policy_version 143676 (0.0011) [2023-12-27 20:15:42,422][106225] Updated weights for policy 1, policy_version 143764 (0.0008) [2023-12-27 20:15:42,483][106225] Updated weights for policy 1, policy_version 143774 (0.0008) [2023-12-27 20:15:43,031][106226] Updated weights for policy 0, policy_version 143686 (0.0007) [2023-12-27 20:15:43,096][106226] Updated weights for policy 0, policy_version 143696 (0.0007) [2023-12-27 20:15:43,163][106226] Updated weights for policy 0, policy_version 143706 (0.0009) [2023-12-27 20:15:43,209][106225] Updated weights for policy 1, policy_version 143784 (0.0007) [2023-12-27 20:15:43,262][106225] Updated weights for policy 1, policy_version 143794 (0.0006) [2023-12-27 20:15:43,313][106225] Updated weights for policy 1, policy_version 143804 (0.0008) [2023-12-27 20:15:43,777][106226] Updated weights for policy 0, policy_version 143716 (0.0008) [2023-12-27 20:15:43,840][106226] Updated weights for policy 0, policy_version 143726 (0.0011) [2023-12-27 20:15:43,900][106226] Updated weights for policy 0, policy_version 143736 (0.0010) [2023-12-27 20:15:43,956][106225] Updated weights for policy 1, policy_version 143814 (0.0008) [2023-12-27 20:15:44,002][106225] Updated weights for policy 1, policy_version 143824 (0.0005) [2023-12-27 20:15:44,059][106225] Updated weights for policy 1, policy_version 143834 (0.0007) [2023-12-27 20:15:44,519][106226] Updated weights for policy 0, policy_version 143746 (0.0009) [2023-12-27 20:15:44,573][106226] Updated weights for policy 0, policy_version 143756 (0.0010) [2023-12-27 20:15:44,624][106226] Updated weights for policy 0, policy_version 143766 (0.0010) [2023-12-27 20:15:44,677][106226] Updated weights for policy 0, policy_version 143776 (0.0010) [2023-12-27 20:15:44,817][106225] Updated weights for policy 1, policy_version 143844 (0.0007) [2023-12-27 20:15:44,878][106225] Updated weights for policy 1, policy_version 143854 (0.0008) [2023-12-27 20:15:44,946][106225] Updated weights for policy 1, policy_version 143864 (0.0008) [2023-12-27 20:15:45,452][106226] Updated weights for policy 0, policy_version 143786 (0.0008) [2023-12-27 20:15:45,510][106226] Updated weights for policy 0, policy_version 143796 (0.0008) [2023-12-27 20:15:45,565][106225] Updated weights for policy 1, policy_version 143874 (0.0006) [2023-12-27 20:15:45,575][106226] Updated weights for policy 0, policy_version 143806 (0.0008) [2023-12-27 20:15:45,615][106225] Updated weights for policy 1, policy_version 143884 (0.0007) [2023-12-27 20:15:45,661][106225] Updated weights for policy 1, policy_version 143894 (0.0007) [2023-12-27 20:15:45,723][106225] Updated weights for policy 1, policy_version 143904 (0.0009) [2023-12-27 20:15:46,152][106226] Updated weights for policy 0, policy_version 143816 (0.0007) [2023-12-27 20:15:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 73670656. Throughput: 0: 9720.0, 1: 10051.2. Samples: 73662508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:15:46,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-6.750')] [2023-12-27 20:15:46,206][106226] Updated weights for policy 0, policy_version 143826 (0.0009) [2023-12-27 20:15:46,263][106226] Updated weights for policy 0, policy_version 143836 (0.0010) [2023-12-27 20:15:46,556][106225] Updated weights for policy 1, policy_version 143914 (0.0006) [2023-12-27 20:15:46,614][106225] Updated weights for policy 1, policy_version 143924 (0.0009) [2023-12-27 20:15:46,675][106225] Updated weights for policy 1, policy_version 143934 (0.0007) [2023-12-27 20:15:46,871][106226] Updated weights for policy 0, policy_version 143846 (0.0005) [2023-12-27 20:15:46,933][106226] Updated weights for policy 0, policy_version 143856 (0.0005) [2023-12-27 20:15:46,983][106226] Updated weights for policy 0, policy_version 143866 (0.0005) [2023-12-27 20:15:47,286][106225] Updated weights for policy 1, policy_version 143944 (0.0009) [2023-12-27 20:15:47,338][106225] Updated weights for policy 1, policy_version 143954 (0.0008) [2023-12-27 20:15:47,388][106225] Updated weights for policy 1, policy_version 143964 (0.0009) [2023-12-27 20:15:47,535][106226] Updated weights for policy 0, policy_version 143876 (0.0005) [2023-12-27 20:15:47,602][106226] Updated weights for policy 0, policy_version 143886 (0.0005) [2023-12-27 20:15:47,659][106226] Updated weights for policy 0, policy_version 143896 (0.0010) [2023-12-27 20:15:48,133][106225] Updated weights for policy 1, policy_version 143974 (0.0007) [2023-12-27 20:15:48,197][106225] Updated weights for policy 1, policy_version 143984 (0.0008) [2023-12-27 20:15:48,261][106225] Updated weights for policy 1, policy_version 143994 (0.0007) [2023-12-27 20:15:48,342][106226] Updated weights for policy 0, policy_version 143906 (0.0010) [2023-12-27 20:15:48,420][106226] Updated weights for policy 0, policy_version 143917 (0.0006) [2023-12-27 20:15:48,483][106226] Updated weights for policy 0, policy_version 143927 (0.0006) [2023-12-27 20:15:49,060][106225] Updated weights for policy 1, policy_version 144004 (0.0008) [2023-12-27 20:15:49,117][106225] Updated weights for policy 1, policy_version 144014 (0.0007) [2023-12-27 20:15:49,128][106226] Updated weights for policy 0, policy_version 143937 (0.0006) [2023-12-27 20:15:49,177][106225] Updated weights for policy 1, policy_version 144024 (0.0006) [2023-12-27 20:15:49,193][106226] Updated weights for policy 0, policy_version 143947 (0.0011) [2023-12-27 20:15:49,267][106226] Updated weights for policy 0, policy_version 143957 (0.0009) [2023-12-27 20:15:49,336][106226] Updated weights for policy 0, policy_version 143967 (0.0009) [2023-12-27 20:15:49,922][106225] Updated weights for policy 1, policy_version 144034 (0.0008) [2023-12-27 20:15:49,989][106225] Updated weights for policy 1, policy_version 144044 (0.0007) [2023-12-27 20:15:50,056][106225] Updated weights for policy 1, policy_version 144054 (0.0007) [2023-12-27 20:15:50,109][106226] Updated weights for policy 0, policy_version 143977 (0.0008) [2023-12-27 20:15:50,121][106225] Updated weights for policy 1, policy_version 144064 (0.0008) [2023-12-27 20:15:50,173][106226] Updated weights for policy 0, policy_version 143987 (0.0007) [2023-12-27 20:15:50,235][106226] Updated weights for policy 0, policy_version 143997 (0.0008) [2023-12-27 20:15:50,881][106225] Updated weights for policy 1, policy_version 144074 (0.0008) [2023-12-27 20:15:50,939][106225] Updated weights for policy 1, policy_version 144084 (0.0007) [2023-12-27 20:15:50,943][106226] Updated weights for policy 0, policy_version 144007 (0.0009) [2023-12-27 20:15:51,000][106225] Updated weights for policy 1, policy_version 144094 (0.0006) [2023-12-27 20:15:51,006][106226] Updated weights for policy 0, policy_version 144017 (0.0008) [2023-12-27 20:15:51,077][106226] Updated weights for policy 0, policy_version 144027 (0.0008) [2023-12-27 20:15:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 73777152. Throughput: 0: 9815.8, 1: 9919.9. Samples: 73781140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:15:51,175][105115] Avg episode reward: [(0, '-5.133'), (1, '-6.728')] [2023-12-27 20:15:51,843][106225] Updated weights for policy 1, policy_version 144104 (0.0010) [2023-12-27 20:15:51,850][106226] Updated weights for policy 0, policy_version 144037 (0.0008) [2023-12-27 20:15:51,904][106225] Updated weights for policy 1, policy_version 144114 (0.0010) [2023-12-27 20:15:51,910][106226] Updated weights for policy 0, policy_version 144047 (0.0007) [2023-12-27 20:15:51,962][106225] Updated weights for policy 1, policy_version 144124 (0.0011) [2023-12-27 20:15:51,969][106226] Updated weights for policy 0, policy_version 144057 (0.0006) [2023-12-27 20:15:52,729][106225] Updated weights for policy 1, policy_version 144134 (0.0011) [2023-12-27 20:15:52,733][106226] Updated weights for policy 0, policy_version 144067 (0.0008) [2023-12-27 20:15:52,783][106225] Updated weights for policy 1, policy_version 144144 (0.0010) [2023-12-27 20:15:52,789][106226] Updated weights for policy 0, policy_version 144077 (0.0006) [2023-12-27 20:15:52,841][106225] Updated weights for policy 1, policy_version 144154 (0.0011) [2023-12-27 20:15:52,851][106226] Updated weights for policy 0, policy_version 144087 (0.0006) [2023-12-27 20:15:53,472][106225] Updated weights for policy 1, policy_version 144164 (0.0010) [2023-12-27 20:15:53,480][106226] Updated weights for policy 0, policy_version 144097 (0.0006) [2023-12-27 20:15:53,523][106225] Updated weights for policy 1, policy_version 144174 (0.0010) [2023-12-27 20:15:53,541][106226] Updated weights for policy 0, policy_version 144107 (0.0010) [2023-12-27 20:15:53,577][106225] Updated weights for policy 1, policy_version 144184 (0.0010) [2023-12-27 20:15:53,598][106226] Updated weights for policy 0, policy_version 144117 (0.0010) [2023-12-27 20:15:53,654][106226] Updated weights for policy 0, policy_version 144127 (0.0009) [2023-12-27 20:15:54,264][106225] Updated weights for policy 1, policy_version 144194 (0.0010) [2023-12-27 20:15:54,330][106225] Updated weights for policy 1, policy_version 144204 (0.0009) [2023-12-27 20:15:54,373][106226] Updated weights for policy 0, policy_version 144137 (0.0008) [2023-12-27 20:15:54,397][106225] Updated weights for policy 1, policy_version 144214 (0.0011) [2023-12-27 20:15:54,444][106226] Updated weights for policy 0, policy_version 144147 (0.0008) [2023-12-27 20:15:54,460][106225] Updated weights for policy 1, policy_version 144224 (0.0011) [2023-12-27 20:15:54,507][106226] Updated weights for policy 0, policy_version 144157 (0.0008) [2023-12-27 20:15:55,203][106225] Updated weights for policy 1, policy_version 144234 (0.0005) [2023-12-27 20:15:55,254][106226] Updated weights for policy 0, policy_version 144167 (0.0010) [2023-12-27 20:15:55,264][106225] Updated weights for policy 1, policy_version 144244 (0.0005) [2023-12-27 20:15:55,307][106226] Updated weights for policy 0, policy_version 144177 (0.0010) [2023-12-27 20:15:55,321][106225] Updated weights for policy 1, policy_version 144254 (0.0005) [2023-12-27 20:15:55,359][106226] Updated weights for policy 0, policy_version 144187 (0.0010) [2023-12-27 20:15:55,953][106225] Updated weights for policy 1, policy_version 144264 (0.0009) [2023-12-27 20:15:56,009][106225] Updated weights for policy 1, policy_version 144274 (0.0010) [2023-12-27 20:15:56,069][106225] Updated weights for policy 1, policy_version 144284 (0.0008) [2023-12-27 20:15:56,093][106226] Updated weights for policy 0, policy_version 144197 (0.0011) [2023-12-27 20:15:56,139][106226] Updated weights for policy 0, policy_version 144207 (0.0010) [2023-12-27 20:15:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 73867264. Throughput: 0: 9791.0, 1: 9895.4. Samples: 73838440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:15:56,175][105115] Avg episode reward: [(0, '-4.933'), (1, '-6.811')] [2023-12-27 20:15:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000144288_36945920.pth... [2023-12-27 20:15:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000143136_36651008.pth [2023-12-27 20:15:56,196][106226] Updated weights for policy 0, policy_version 144217 (0.0010) [2023-12-27 20:15:56,228][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000144224_36929536.pth... [2023-12-27 20:15:56,231][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000143040_36626432.pth [2023-12-27 20:15:56,750][106225] Updated weights for policy 1, policy_version 144294 (0.0008) [2023-12-27 20:15:56,812][106225] Updated weights for policy 1, policy_version 144304 (0.0010) [2023-12-27 20:15:56,868][106225] Updated weights for policy 1, policy_version 144314 (0.0010) [2023-12-27 20:15:56,877][106226] Updated weights for policy 0, policy_version 144227 (0.0010) [2023-12-27 20:15:56,932][106226] Updated weights for policy 0, policy_version 144237 (0.0010) [2023-12-27 20:15:56,982][106226] Updated weights for policy 0, policy_version 144247 (0.0010) [2023-12-27 20:15:57,582][106225] Updated weights for policy 1, policy_version 144324 (0.0008) [2023-12-27 20:15:57,632][106225] Updated weights for policy 1, policy_version 144334 (0.0008) [2023-12-27 20:15:57,687][106225] Updated weights for policy 1, policy_version 144344 (0.0008) [2023-12-27 20:15:57,692][106226] Updated weights for policy 0, policy_version 144257 (0.0010) [2023-12-27 20:15:57,754][106226] Updated weights for policy 0, policy_version 144267 (0.0007) [2023-12-27 20:15:57,812][106226] Updated weights for policy 0, policy_version 144277 (0.0008) [2023-12-27 20:15:57,874][106226] Updated weights for policy 0, policy_version 144287 (0.0008) [2023-12-27 20:15:58,410][106225] Updated weights for policy 1, policy_version 144354 (0.0007) [2023-12-27 20:15:58,480][106225] Updated weights for policy 1, policy_version 144364 (0.0008) [2023-12-27 20:15:58,540][106225] Updated weights for policy 1, policy_version 144374 (0.0009) [2023-12-27 20:15:58,609][106225] Updated weights for policy 1, policy_version 144384 (0.0007) [2023-12-27 20:15:58,627][106226] Updated weights for policy 0, policy_version 144297 (0.0009) [2023-12-27 20:15:58,692][106226] Updated weights for policy 0, policy_version 144307 (0.0008) [2023-12-27 20:15:58,754][106226] Updated weights for policy 0, policy_version 144317 (0.0008) [2023-12-27 20:15:59,369][106225] Updated weights for policy 1, policy_version 144394 (0.0009) [2023-12-27 20:15:59,439][106225] Updated weights for policy 1, policy_version 144404 (0.0009) [2023-12-27 20:15:59,503][106225] Updated weights for policy 1, policy_version 144414 (0.0009) [2023-12-27 20:15:59,589][106226] Updated weights for policy 0, policy_version 144327 (0.0008) [2023-12-27 20:15:59,652][106226] Updated weights for policy 0, policy_version 144337 (0.0009) [2023-12-27 20:15:59,715][106226] Updated weights for policy 0, policy_version 144347 (0.0009) [2023-12-27 20:16:00,225][106225] Updated weights for policy 1, policy_version 144424 (0.0006) [2023-12-27 20:16:00,279][106225] Updated weights for policy 1, policy_version 144434 (0.0005) [2023-12-27 20:16:00,337][106225] Updated weights for policy 1, policy_version 144444 (0.0008) [2023-12-27 20:16:00,491][106226] Updated weights for policy 0, policy_version 144357 (0.0008) [2023-12-27 20:16:00,542][106226] Updated weights for policy 0, policy_version 144367 (0.0007) [2023-12-27 20:16:00,603][106226] Updated weights for policy 0, policy_version 144377 (0.0006) [2023-12-27 20:16:00,975][106225] Updated weights for policy 1, policy_version 144454 (0.0007) [2023-12-27 20:16:01,039][106225] Updated weights for policy 1, policy_version 144464 (0.0008) [2023-12-27 20:16:01,103][106225] Updated weights for policy 1, policy_version 144474 (0.0009) [2023-12-27 20:16:01,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 73965568. Throughput: 0: 9810.0, 1: 9836.4. Samples: 73952924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:01,175][105115] Avg episode reward: [(0, '-5.237'), (1, '-6.686')] [2023-12-27 20:16:01,343][106226] Updated weights for policy 0, policy_version 144387 (0.0010) [2023-12-27 20:16:01,411][106226] Updated weights for policy 0, policy_version 144397 (0.0008) [2023-12-27 20:16:01,464][106226] Updated weights for policy 0, policy_version 144407 (0.0008) [2023-12-27 20:16:01,758][106225] Updated weights for policy 1, policy_version 144484 (0.0008) [2023-12-27 20:16:01,805][106225] Updated weights for policy 1, policy_version 144494 (0.0008) [2023-12-27 20:16:01,859][106225] Updated weights for policy 1, policy_version 144504 (0.0008) [2023-12-27 20:16:02,253][106226] Updated weights for policy 0, policy_version 144417 (0.0009) [2023-12-27 20:16:02,321][106226] Updated weights for policy 0, policy_version 144427 (0.0008) [2023-12-27 20:16:02,384][106226] Updated weights for policy 0, policy_version 144437 (0.0008) [2023-12-27 20:16:02,437][106226] Updated weights for policy 0, policy_version 144447 (0.0008) [2023-12-27 20:16:02,569][106225] Updated weights for policy 1, policy_version 144514 (0.0009) [2023-12-27 20:16:02,634][106225] Updated weights for policy 1, policy_version 144524 (0.0009) [2023-12-27 20:16:02,695][106225] Updated weights for policy 1, policy_version 144534 (0.0005) [2023-12-27 20:16:02,753][106225] Updated weights for policy 1, policy_version 144544 (0.0006) [2023-12-27 20:16:03,183][106226] Updated weights for policy 0, policy_version 144457 (0.0006) [2023-12-27 20:16:03,240][106226] Updated weights for policy 0, policy_version 144467 (0.0005) [2023-12-27 20:16:03,297][106226] Updated weights for policy 0, policy_version 144477 (0.0005) [2023-12-27 20:16:03,406][106225] Updated weights for policy 1, policy_version 144554 (0.0010) [2023-12-27 20:16:03,469][106225] Updated weights for policy 1, policy_version 144564 (0.0010) [2023-12-27 20:16:03,525][106225] Updated weights for policy 1, policy_version 144574 (0.0010) [2023-12-27 20:16:03,895][106226] Updated weights for policy 0, policy_version 144487 (0.0007) [2023-12-27 20:16:03,962][106226] Updated weights for policy 0, policy_version 144497 (0.0007) [2023-12-27 20:16:04,033][106226] Updated weights for policy 0, policy_version 144507 (0.0008) [2023-12-27 20:16:04,236][106225] Updated weights for policy 1, policy_version 144584 (0.0009) [2023-12-27 20:16:04,299][106225] Updated weights for policy 1, policy_version 144594 (0.0009) [2023-12-27 20:16:04,366][106225] Updated weights for policy 1, policy_version 144604 (0.0007) [2023-12-27 20:16:04,737][106226] Updated weights for policy 0, policy_version 144517 (0.0008) [2023-12-27 20:16:04,802][106226] Updated weights for policy 0, policy_version 144527 (0.0011) [2023-12-27 20:16:04,866][106226] Updated weights for policy 0, policy_version 144537 (0.0009) [2023-12-27 20:16:04,964][106225] Updated weights for policy 1, policy_version 144614 (0.0006) [2023-12-27 20:16:05,034][106225] Updated weights for policy 1, policy_version 144624 (0.0006) [2023-12-27 20:16:05,106][106225] Updated weights for policy 1, policy_version 144634 (0.0005) [2023-12-27 20:16:05,517][106226] Updated weights for policy 0, policy_version 144547 (0.0010) [2023-12-27 20:16:05,567][106226] Updated weights for policy 0, policy_version 144557 (0.0008) [2023-12-27 20:16:05,620][106226] Updated weights for policy 0, policy_version 144567 (0.0008) [2023-12-27 20:16:05,768][106225] Updated weights for policy 1, policy_version 144644 (0.0008) [2023-12-27 20:16:05,823][106225] Updated weights for policy 1, policy_version 144654 (0.0010) [2023-12-27 20:16:05,877][106225] Updated weights for policy 1, policy_version 144664 (0.0009) [2023-12-27 20:16:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 74063872. Throughput: 0: 9827.5, 1: 9933.1. Samples: 74073108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:06,175][105115] Avg episode reward: [(0, '-5.126'), (1, '-6.277')] [2023-12-27 20:16:06,304][106226] Updated weights for policy 0, policy_version 144577 (0.0008) [2023-12-27 20:16:06,356][106226] Updated weights for policy 0, policy_version 144587 (0.0011) [2023-12-27 20:16:06,422][106226] Updated weights for policy 0, policy_version 144597 (0.0010) [2023-12-27 20:16:06,486][106226] Updated weights for policy 0, policy_version 144607 (0.0007) [2023-12-27 20:16:06,573][106225] Updated weights for policy 1, policy_version 144674 (0.0009) [2023-12-27 20:16:06,640][106225] Updated weights for policy 1, policy_version 144684 (0.0008) [2023-12-27 20:16:06,704][106225] Updated weights for policy 1, policy_version 144694 (0.0008) [2023-12-27 20:16:06,769][106225] Updated weights for policy 1, policy_version 144704 (0.0008) [2023-12-27 20:16:07,160][106226] Updated weights for policy 0, policy_version 144617 (0.0008) [2023-12-27 20:16:07,219][106226] Updated weights for policy 0, policy_version 144627 (0.0011) [2023-12-27 20:16:07,281][106226] Updated weights for policy 0, policy_version 144637 (0.0011) [2023-12-27 20:16:07,419][106225] Updated weights for policy 1, policy_version 144714 (0.0006) [2023-12-27 20:16:07,478][106225] Updated weights for policy 1, policy_version 144724 (0.0005) [2023-12-27 20:16:07,531][106225] Updated weights for policy 1, policy_version 144734 (0.0005) [2023-12-27 20:16:07,959][106226] Updated weights for policy 0, policy_version 144647 (0.0011) [2023-12-27 20:16:08,019][106226] Updated weights for policy 0, policy_version 144657 (0.0010) [2023-12-27 20:16:08,079][106226] Updated weights for policy 0, policy_version 144667 (0.0011) [2023-12-27 20:16:08,092][106225] Updated weights for policy 1, policy_version 144744 (0.0005) [2023-12-27 20:16:08,140][106225] Updated weights for policy 1, policy_version 144754 (0.0005) [2023-12-27 20:16:08,195][106225] Updated weights for policy 1, policy_version 144764 (0.0005) [2023-12-27 20:16:08,806][106226] Updated weights for policy 0, policy_version 144677 (0.0010) [2023-12-27 20:16:08,829][106225] Updated weights for policy 1, policy_version 144774 (0.0006) [2023-12-27 20:16:08,867][106226] Updated weights for policy 0, policy_version 144687 (0.0011) [2023-12-27 20:16:08,894][106225] Updated weights for policy 1, policy_version 144784 (0.0007) [2023-12-27 20:16:08,928][106226] Updated weights for policy 0, policy_version 144697 (0.0011) [2023-12-27 20:16:08,954][106225] Updated weights for policy 1, policy_version 144794 (0.0010) [2023-12-27 20:16:09,626][106225] Updated weights for policy 1, policy_version 144804 (0.0010) [2023-12-27 20:16:09,632][106226] Updated weights for policy 0, policy_version 144707 (0.0009) [2023-12-27 20:16:09,677][106225] Updated weights for policy 1, policy_version 144814 (0.0010) [2023-12-27 20:16:09,703][106226] Updated weights for policy 0, policy_version 144717 (0.0006) [2023-12-27 20:16:09,732][106225] Updated weights for policy 1, policy_version 144824 (0.0010) [2023-12-27 20:16:09,766][106226] Updated weights for policy 0, policy_version 144727 (0.0006) [2023-12-27 20:16:10,466][106225] Updated weights for policy 1, policy_version 144834 (0.0010) [2023-12-27 20:16:10,516][106225] Updated weights for policy 1, policy_version 144844 (0.0010) [2023-12-27 20:16:10,551][106226] Updated weights for policy 0, policy_version 144737 (0.0006) [2023-12-27 20:16:10,576][106225] Updated weights for policy 1, policy_version 144854 (0.0010) [2023-12-27 20:16:10,607][106226] Updated weights for policy 0, policy_version 144747 (0.0007) [2023-12-27 20:16:10,637][106225] Updated weights for policy 1, policy_version 144864 (0.0009) [2023-12-27 20:16:10,661][106226] Updated weights for policy 0, policy_version 144757 (0.0007) [2023-12-27 20:16:10,721][106226] Updated weights for policy 0, policy_version 144767 (0.0008) [2023-12-27 20:16:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 74162176. Throughput: 0: 9864.3, 1: 10014.8. Samples: 74134812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:11,175][105115] Avg episode reward: [(0, '-5.280'), (1, '-6.431')] [2023-12-27 20:16:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000144768_37068800.pth... [2023-12-27 20:16:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000144864_37093376.pth... [2023-12-27 20:16:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000143616_36773888.pth [2023-12-27 20:16:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000143712_36798464.pth [2023-12-27 20:16:11,283][106225] Updated weights for policy 1, policy_version 144874 (0.0011) [2023-12-27 20:16:11,342][106225] Updated weights for policy 1, policy_version 144884 (0.0010) [2023-12-27 20:16:11,419][106225] Updated weights for policy 1, policy_version 144894 (0.0007) [2023-12-27 20:16:11,457][106226] Updated weights for policy 0, policy_version 144777 (0.0009) [2023-12-27 20:16:11,522][106226] Updated weights for policy 0, policy_version 144787 (0.0007) [2023-12-27 20:16:11,583][106226] Updated weights for policy 0, policy_version 144797 (0.0008) [2023-12-27 20:16:12,128][106225] Updated weights for policy 1, policy_version 144904 (0.0008) [2023-12-27 20:16:12,197][106225] Updated weights for policy 1, policy_version 144914 (0.0008) [2023-12-27 20:16:12,263][106225] Updated weights for policy 1, policy_version 144924 (0.0010) [2023-12-27 20:16:12,320][106226] Updated weights for policy 0, policy_version 144807 (0.0008) [2023-12-27 20:16:12,388][106226] Updated weights for policy 0, policy_version 144817 (0.0008) [2023-12-27 20:16:12,458][106226] Updated weights for policy 0, policy_version 144827 (0.0005) [2023-12-27 20:16:12,937][106225] Updated weights for policy 1, policy_version 144934 (0.0009) [2023-12-27 20:16:12,991][106225] Updated weights for policy 1, policy_version 144944 (0.0010) [2023-12-27 20:16:13,054][106225] Updated weights for policy 1, policy_version 144954 (0.0010) [2023-12-27 20:16:13,099][106226] Updated weights for policy 0, policy_version 144837 (0.0007) [2023-12-27 20:16:13,155][106226] Updated weights for policy 0, policy_version 144847 (0.0009) [2023-12-27 20:16:13,208][106226] Updated weights for policy 0, policy_version 144857 (0.0009) [2023-12-27 20:16:13,811][106225] Updated weights for policy 1, policy_version 144964 (0.0007) [2023-12-27 20:16:13,822][106226] Updated weights for policy 0, policy_version 144867 (0.0009) [2023-12-27 20:16:13,870][106225] Updated weights for policy 1, policy_version 144974 (0.0005) [2023-12-27 20:16:13,872][106226] Updated weights for policy 0, policy_version 144877 (0.0010) [2023-12-27 20:16:13,926][106226] Updated weights for policy 0, policy_version 144887 (0.0011) [2023-12-27 20:16:13,927][106225] Updated weights for policy 1, policy_version 144984 (0.0005) [2023-12-27 20:16:14,528][106226] Updated weights for policy 0, policy_version 144897 (0.0010) [2023-12-27 20:16:14,560][106225] Updated weights for policy 1, policy_version 144994 (0.0005) [2023-12-27 20:16:14,585][106226] Updated weights for policy 0, policy_version 144907 (0.0005) [2023-12-27 20:16:14,613][106225] Updated weights for policy 1, policy_version 145004 (0.0006) [2023-12-27 20:16:14,646][106226] Updated weights for policy 0, policy_version 144917 (0.0005) [2023-12-27 20:16:14,677][106225] Updated weights for policy 1, policy_version 145014 (0.0006) [2023-12-27 20:16:14,707][106226] Updated weights for policy 0, policy_version 144927 (0.0006) [2023-12-27 20:16:14,740][106225] Updated weights for policy 1, policy_version 145024 (0.0008) [2023-12-27 20:16:15,418][106226] Updated weights for policy 0, policy_version 144937 (0.0007) [2023-12-27 20:16:15,440][106225] Updated weights for policy 1, policy_version 145034 (0.0007) [2023-12-27 20:16:15,479][106226] Updated weights for policy 0, policy_version 144947 (0.0009) [2023-12-27 20:16:15,491][106225] Updated weights for policy 1, policy_version 145044 (0.0005) [2023-12-27 20:16:15,544][106226] Updated weights for policy 0, policy_version 144957 (0.0008) [2023-12-27 20:16:15,555][106225] Updated weights for policy 1, policy_version 145054 (0.0005) [2023-12-27 20:16:16,161][106225] Updated weights for policy 1, policy_version 145064 (0.0008) [2023-12-27 20:16:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 74260480. Throughput: 0: 9855.6, 1: 9910.6. Samples: 74255032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:16,175][105115] Avg episode reward: [(0, '-5.173'), (1, '-6.811')] [2023-12-27 20:16:16,209][106225] Updated weights for policy 1, policy_version 145074 (0.0007) [2023-12-27 20:16:16,270][106225] Updated weights for policy 1, policy_version 145084 (0.0008) [2023-12-27 20:16:16,297][106226] Updated weights for policy 0, policy_version 144967 (0.0007) [2023-12-27 20:16:16,345][106226] Updated weights for policy 0, policy_version 144977 (0.0008) [2023-12-27 20:16:16,390][106226] Updated weights for policy 0, policy_version 144987 (0.0008) [2023-12-27 20:16:17,032][106225] Updated weights for policy 1, policy_version 145094 (0.0009) [2023-12-27 20:16:17,053][106226] Updated weights for policy 0, policy_version 144997 (0.0010) [2023-12-27 20:16:17,091][106225] Updated weights for policy 1, policy_version 145104 (0.0008) [2023-12-27 20:16:17,110][106226] Updated weights for policy 0, policy_version 145007 (0.0011) [2023-12-27 20:16:17,151][106225] Updated weights for policy 1, policy_version 145114 (0.0006) [2023-12-27 20:16:17,168][106226] Updated weights for policy 0, policy_version 145017 (0.0010) [2023-12-27 20:16:17,736][106225] Updated weights for policy 1, policy_version 145124 (0.0005) [2023-12-27 20:16:17,780][106225] Updated weights for policy 1, policy_version 145134 (0.0005) [2023-12-27 20:16:17,816][106226] Updated weights for policy 0, policy_version 145027 (0.0009) [2023-12-27 20:16:17,839][106225] Updated weights for policy 1, policy_version 145144 (0.0005) [2023-12-27 20:16:17,868][106226] Updated weights for policy 0, policy_version 145037 (0.0005) [2023-12-27 20:16:17,916][106226] Updated weights for policy 0, policy_version 145047 (0.0005) [2023-12-27 20:16:18,493][106226] Updated weights for policy 0, policy_version 145057 (0.0005) [2023-12-27 20:16:18,542][106225] Updated weights for policy 1, policy_version 145154 (0.0006) [2023-12-27 20:16:18,557][106226] Updated weights for policy 0, policy_version 145067 (0.0005) [2023-12-27 20:16:18,607][106225] Updated weights for policy 1, policy_version 145164 (0.0010) [2023-12-27 20:16:18,616][106226] Updated weights for policy 0, policy_version 145077 (0.0005) [2023-12-27 20:16:18,668][106225] Updated weights for policy 1, policy_version 145174 (0.0010) [2023-12-27 20:16:18,677][106226] Updated weights for policy 0, policy_version 145087 (0.0010) [2023-12-27 20:16:18,725][106225] Updated weights for policy 1, policy_version 145184 (0.0010) [2023-12-27 20:16:19,349][106225] Updated weights for policy 1, policy_version 145194 (0.0010) [2023-12-27 20:16:19,361][106226] Updated weights for policy 0, policy_version 145097 (0.0011) [2023-12-27 20:16:19,413][106225] Updated weights for policy 1, policy_version 145204 (0.0009) [2023-12-27 20:16:19,422][106226] Updated weights for policy 0, policy_version 145107 (0.0010) [2023-12-27 20:16:19,469][106225] Updated weights for policy 1, policy_version 145214 (0.0009) [2023-12-27 20:16:19,479][106226] Updated weights for policy 0, policy_version 145117 (0.0011) [2023-12-27 20:16:20,204][106225] Updated weights for policy 1, policy_version 145224 (0.0008) [2023-12-27 20:16:20,221][106226] Updated weights for policy 0, policy_version 145127 (0.0007) [2023-12-27 20:16:20,265][106225] Updated weights for policy 1, policy_version 145234 (0.0007) [2023-12-27 20:16:20,283][106226] Updated weights for policy 0, policy_version 145137 (0.0006) [2023-12-27 20:16:20,322][106225] Updated weights for policy 1, policy_version 145244 (0.0009) [2023-12-27 20:16:20,345][106226] Updated weights for policy 0, policy_version 145147 (0.0009) [2023-12-27 20:16:21,079][106225] Updated weights for policy 1, policy_version 145254 (0.0007) [2023-12-27 20:16:21,093][106226] Updated weights for policy 0, policy_version 145157 (0.0009) [2023-12-27 20:16:21,146][106225] Updated weights for policy 1, policy_version 145264 (0.0008) [2023-12-27 20:16:21,154][106226] Updated weights for policy 0, policy_version 145167 (0.0008) [2023-12-27 20:16:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 74358784. Throughput: 0: 9857.6, 1: 9876.4. Samples: 74375724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:21,175][105115] Avg episode reward: [(0, '-5.171'), (1, '-6.677')] [2023-12-27 20:16:21,207][106225] Updated weights for policy 1, policy_version 145274 (0.0007) [2023-12-27 20:16:21,221][106226] Updated weights for policy 0, policy_version 145177 (0.0009) [2023-12-27 20:16:21,921][106226] Updated weights for policy 0, policy_version 145187 (0.0007) [2023-12-27 20:16:21,971][106225] Updated weights for policy 1, policy_version 145284 (0.0007) [2023-12-27 20:16:21,980][106226] Updated weights for policy 0, policy_version 145197 (0.0007) [2023-12-27 20:16:22,033][106225] Updated weights for policy 1, policy_version 145294 (0.0006) [2023-12-27 20:16:22,040][106226] Updated weights for policy 0, policy_version 145207 (0.0007) [2023-12-27 20:16:22,092][106225] Updated weights for policy 1, policy_version 145304 (0.0007) [2023-12-27 20:16:22,770][106226] Updated weights for policy 0, policy_version 145217 (0.0007) [2023-12-27 20:16:22,827][106226] Updated weights for policy 0, policy_version 145227 (0.0007) [2023-12-27 20:16:22,829][106225] Updated weights for policy 1, policy_version 145314 (0.0007) [2023-12-27 20:16:22,883][106225] Updated weights for policy 1, policy_version 145324 (0.0010) [2023-12-27 20:16:22,890][106226] Updated weights for policy 0, policy_version 145237 (0.0006) [2023-12-27 20:16:22,931][106225] Updated weights for policy 1, policy_version 145334 (0.0010) [2023-12-27 20:16:22,944][106226] Updated weights for policy 0, policy_version 145247 (0.0006) [2023-12-27 20:16:22,978][106225] Updated weights for policy 1, policy_version 145344 (0.0010) [2023-12-27 20:16:23,668][106226] Updated weights for policy 0, policy_version 145257 (0.0008) [2023-12-27 20:16:23,725][106225] Updated weights for policy 1, policy_version 145354 (0.0010) [2023-12-27 20:16:23,730][106226] Updated weights for policy 0, policy_version 145267 (0.0006) [2023-12-27 20:16:23,785][106225] Updated weights for policy 1, policy_version 145364 (0.0010) [2023-12-27 20:16:23,791][106226] Updated weights for policy 0, policy_version 145277 (0.0005) [2023-12-27 20:16:23,850][106225] Updated weights for policy 1, policy_version 145374 (0.0010) [2023-12-27 20:16:24,527][106226] Updated weights for policy 0, policy_version 145287 (0.0007) [2023-12-27 20:16:24,583][106226] Updated weights for policy 0, policy_version 145297 (0.0006) [2023-12-27 20:16:24,588][106225] Updated weights for policy 1, policy_version 145384 (0.0010) [2023-12-27 20:16:24,647][106226] Updated weights for policy 0, policy_version 145307 (0.0007) [2023-12-27 20:16:24,650][106225] Updated weights for policy 1, policy_version 145394 (0.0009) [2023-12-27 20:16:24,713][106225] Updated weights for policy 1, policy_version 145404 (0.0010) [2023-12-27 20:16:25,382][106226] Updated weights for policy 0, policy_version 145317 (0.0008) [2023-12-27 20:16:25,421][106225] Updated weights for policy 1, policy_version 145414 (0.0010) [2023-12-27 20:16:25,446][106226] Updated weights for policy 0, policy_version 145327 (0.0007) [2023-12-27 20:16:25,478][106225] Updated weights for policy 1, policy_version 145424 (0.0010) [2023-12-27 20:16:25,503][106226] Updated weights for policy 0, policy_version 145337 (0.0006) [2023-12-27 20:16:25,539][106225] Updated weights for policy 1, policy_version 145434 (0.0008) [2023-12-27 20:16:26,141][106225] Updated weights for policy 1, policy_version 145444 (0.0005) [2023-12-27 20:16:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 74457088. Throughput: 0: 9866.7, 1: 9865.9. Samples: 74432424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:26,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-6.640')] [2023-12-27 20:16:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000145344_37216256.pth... [2023-12-27 20:16:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000144224_36929536.pth [2023-12-27 20:16:26,195][106225] Updated weights for policy 1, policy_version 145454 (0.0009) [2023-12-27 20:16:26,250][106225] Updated weights for policy 1, policy_version 145464 (0.0010) [2023-12-27 20:16:26,251][106226] Updated weights for policy 0, policy_version 145347 (0.0007) [2023-12-27 20:16:26,285][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000145472_37249024.pth... [2023-12-27 20:16:26,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000144288_36945920.pth [2023-12-27 20:16:26,309][106226] Updated weights for policy 0, policy_version 145357 (0.0008) [2023-12-27 20:16:26,356][106226] Updated weights for policy 0, policy_version 145367 (0.0008) [2023-12-27 20:16:26,947][106225] Updated weights for policy 1, policy_version 145474 (0.0009) [2023-12-27 20:16:26,999][106225] Updated weights for policy 1, policy_version 145484 (0.0005) [2023-12-27 20:16:27,049][106225] Updated weights for policy 1, policy_version 145494 (0.0005) [2023-12-27 20:16:27,113][106226] Updated weights for policy 0, policy_version 145377 (0.0007) [2023-12-27 20:16:27,116][106225] Updated weights for policy 1, policy_version 145504 (0.0005) [2023-12-27 20:16:27,165][106226] Updated weights for policy 0, policy_version 145387 (0.0008) [2023-12-27 20:16:27,217][106226] Updated weights for policy 0, policy_version 145397 (0.0008) [2023-12-27 20:16:27,270][106226] Updated weights for policy 0, policy_version 145407 (0.0008) [2023-12-27 20:16:27,713][106225] Updated weights for policy 1, policy_version 145514 (0.0010) [2023-12-27 20:16:27,766][106225] Updated weights for policy 1, policy_version 145524 (0.0010) [2023-12-27 20:16:27,811][106225] Updated weights for policy 1, policy_version 145534 (0.0010) [2023-12-27 20:16:27,967][106226] Updated weights for policy 0, policy_version 145417 (0.0008) [2023-12-27 20:16:28,031][106226] Updated weights for policy 0, policy_version 145427 (0.0008) [2023-12-27 20:16:28,091][106226] Updated weights for policy 0, policy_version 145437 (0.0008) [2023-12-27 20:16:28,559][106225] Updated weights for policy 1, policy_version 145544 (0.0010) [2023-12-27 20:16:28,620][106225] Updated weights for policy 1, policy_version 145554 (0.0010) [2023-12-27 20:16:28,674][106225] Updated weights for policy 1, policy_version 145564 (0.0010) [2023-12-27 20:16:28,806][106226] Updated weights for policy 0, policy_version 145447 (0.0008) [2023-12-27 20:16:28,866][106226] Updated weights for policy 0, policy_version 145457 (0.0007) [2023-12-27 20:16:28,925][106226] Updated weights for policy 0, policy_version 145467 (0.0008) [2023-12-27 20:16:29,389][106225] Updated weights for policy 1, policy_version 145574 (0.0009) [2023-12-27 20:16:29,455][106225] Updated weights for policy 1, policy_version 145584 (0.0006) [2023-12-27 20:16:29,521][106225] Updated weights for policy 1, policy_version 145594 (0.0005) [2023-12-27 20:16:29,623][106226] Updated weights for policy 0, policy_version 145477 (0.0008) [2023-12-27 20:16:29,680][106226] Updated weights for policy 0, policy_version 145487 (0.0007) [2023-12-27 20:16:29,733][106226] Updated weights for policy 0, policy_version 145497 (0.0008) [2023-12-27 20:16:30,184][106225] Updated weights for policy 1, policy_version 145604 (0.0007) [2023-12-27 20:16:30,237][106225] Updated weights for policy 1, policy_version 145614 (0.0009) [2023-12-27 20:16:30,291][106225] Updated weights for policy 1, policy_version 145624 (0.0008) [2023-12-27 20:16:30,401][106226] Updated weights for policy 0, policy_version 145507 (0.0010) [2023-12-27 20:16:30,451][106226] Updated weights for policy 0, policy_version 145517 (0.0010) [2023-12-27 20:16:30,507][106226] Updated weights for policy 0, policy_version 145527 (0.0010) [2023-12-27 20:16:30,957][106225] Updated weights for policy 1, policy_version 145634 (0.0010) [2023-12-27 20:16:31,011][106225] Updated weights for policy 1, policy_version 145644 (0.0010) [2023-12-27 20:16:31,076][106225] Updated weights for policy 1, policy_version 145654 (0.0009) [2023-12-27 20:16:31,146][106225] Updated weights for policy 1, policy_version 145664 (0.0009) [2023-12-27 20:16:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 74563584. Throughput: 0: 9808.1, 1: 9932.6. Samples: 74550840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:31,175][105115] Avg episode reward: [(0, '-5.138'), (1, '-6.963')] [2023-12-27 20:16:31,215][106226] Updated weights for policy 0, policy_version 145537 (0.0010) [2023-12-27 20:16:31,283][106226] Updated weights for policy 0, policy_version 145547 (0.0007) [2023-12-27 20:16:31,359][106226] Updated weights for policy 0, policy_version 145557 (0.0009) [2023-12-27 20:16:31,427][106226] Updated weights for policy 0, policy_version 145567 (0.0007) [2023-12-27 20:16:31,805][106225] Updated weights for policy 1, policy_version 145674 (0.0009) [2023-12-27 20:16:31,862][106225] Updated weights for policy 1, policy_version 145684 (0.0007) [2023-12-27 20:16:31,930][106225] Updated weights for policy 1, policy_version 145694 (0.0005) [2023-12-27 20:16:32,102][106226] Updated weights for policy 0, policy_version 145577 (0.0008) [2023-12-27 20:16:32,169][106226] Updated weights for policy 0, policy_version 145587 (0.0009) [2023-12-27 20:16:32,232][106226] Updated weights for policy 0, policy_version 145597 (0.0008) [2023-12-27 20:16:32,588][106225] Updated weights for policy 1, policy_version 145704 (0.0008) [2023-12-27 20:16:32,647][106225] Updated weights for policy 1, policy_version 145714 (0.0008) [2023-12-27 20:16:32,703][106225] Updated weights for policy 1, policy_version 145724 (0.0008) [2023-12-27 20:16:32,963][106226] Updated weights for policy 0, policy_version 145607 (0.0009) [2023-12-27 20:16:33,022][106226] Updated weights for policy 0, policy_version 145617 (0.0008) [2023-12-27 20:16:33,084][106226] Updated weights for policy 0, policy_version 145627 (0.0010) [2023-12-27 20:16:33,301][106225] Updated weights for policy 1, policy_version 145734 (0.0006) [2023-12-27 20:16:33,352][106225] Updated weights for policy 1, policy_version 145744 (0.0005) [2023-12-27 20:16:33,417][106225] Updated weights for policy 1, policy_version 145754 (0.0005) [2023-12-27 20:16:33,681][106226] Updated weights for policy 0, policy_version 145637 (0.0009) [2023-12-27 20:16:33,738][106226] Updated weights for policy 0, policy_version 145648 (0.0009) [2023-12-27 20:16:33,785][106226] Updated weights for policy 0, policy_version 145658 (0.0007) [2023-12-27 20:16:33,916][106225] Updated weights for policy 1, policy_version 145764 (0.0005) [2023-12-27 20:16:33,970][106225] Updated weights for policy 1, policy_version 145774 (0.0005) [2023-12-27 20:16:34,026][106225] Updated weights for policy 1, policy_version 145784 (0.0005) [2023-12-27 20:16:34,592][106225] Updated weights for policy 1, policy_version 145794 (0.0006) [2023-12-27 20:16:34,653][106225] Updated weights for policy 1, policy_version 145804 (0.0007) [2023-12-27 20:16:34,671][106226] Updated weights for policy 0, policy_version 145668 (0.0007) [2023-12-27 20:16:34,712][106225] Updated weights for policy 1, policy_version 145814 (0.0008) [2023-12-27 20:16:34,729][106226] Updated weights for policy 0, policy_version 145678 (0.0007) [2023-12-27 20:16:34,774][106225] Updated weights for policy 1, policy_version 145824 (0.0006) [2023-12-27 20:16:34,791][106226] Updated weights for policy 0, policy_version 145688 (0.0008) [2023-12-27 20:16:35,419][106226] Updated weights for policy 0, policy_version 145698 (0.0008) [2023-12-27 20:16:35,468][106226] Updated weights for policy 0, policy_version 145708 (0.0007) [2023-12-27 20:16:35,480][106225] Updated weights for policy 1, policy_version 145834 (0.0007) [2023-12-27 20:16:35,514][106226] Updated weights for policy 0, policy_version 145718 (0.0007) [2023-12-27 20:16:35,528][106225] Updated weights for policy 1, policy_version 145844 (0.0007) [2023-12-27 20:16:35,565][106226] Updated weights for policy 0, policy_version 145728 (0.0006) [2023-12-27 20:16:35,578][106225] Updated weights for policy 1, policy_version 145854 (0.0006) [2023-12-27 20:16:36,155][106225] Updated weights for policy 1, policy_version 145864 (0.0007) [2023-12-27 20:16:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 74661888. Throughput: 0: 9743.5, 1: 10105.0. Samples: 74674320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:36,175][105115] Avg episode reward: [(0, '-5.191'), (1, '-6.625')] [2023-12-27 20:16:36,214][106225] Updated weights for policy 1, policy_version 145874 (0.0008) [2023-12-27 20:16:36,276][106225] Updated weights for policy 1, policy_version 145884 (0.0008) [2023-12-27 20:16:36,350][106226] Updated weights for policy 0, policy_version 145738 (0.0007) [2023-12-27 20:16:36,401][106226] Updated weights for policy 0, policy_version 145748 (0.0008) [2023-12-27 20:16:36,461][106226] Updated weights for policy 0, policy_version 145758 (0.0008) [2023-12-27 20:16:36,995][106225] Updated weights for policy 1, policy_version 145894 (0.0009) [2023-12-27 20:16:37,053][106225] Updated weights for policy 1, policy_version 145904 (0.0008) [2023-12-27 20:16:37,114][106225] Updated weights for policy 1, policy_version 145914 (0.0008) [2023-12-27 20:16:37,181][106226] Updated weights for policy 0, policy_version 145768 (0.0009) [2023-12-27 20:16:37,232][106226] Updated weights for policy 0, policy_version 145778 (0.0008) [2023-12-27 20:16:37,284][106226] Updated weights for policy 0, policy_version 145788 (0.0008) [2023-12-27 20:16:37,734][106225] Updated weights for policy 1, policy_version 145924 (0.0009) [2023-12-27 20:16:37,787][106225] Updated weights for policy 1, policy_version 145934 (0.0008) [2023-12-27 20:16:37,839][106225] Updated weights for policy 1, policy_version 145944 (0.0008) [2023-12-27 20:16:38,063][106226] Updated weights for policy 0, policy_version 145798 (0.0009) [2023-12-27 20:16:38,122][106226] Updated weights for policy 0, policy_version 145808 (0.0008) [2023-12-27 20:16:38,170][106226] Updated weights for policy 0, policy_version 145818 (0.0008) [2023-12-27 20:16:38,602][106225] Updated weights for policy 1, policy_version 145954 (0.0007) [2023-12-27 20:16:38,663][106225] Updated weights for policy 1, policy_version 145964 (0.0005) [2023-12-27 20:16:38,727][106225] Updated weights for policy 1, policy_version 145974 (0.0005) [2023-12-27 20:16:38,792][106225] Updated weights for policy 1, policy_version 145984 (0.0008) [2023-12-27 20:16:38,985][106226] Updated weights for policy 0, policy_version 145828 (0.0008) [2023-12-27 20:16:39,042][106226] Updated weights for policy 0, policy_version 145838 (0.0006) [2023-12-27 20:16:39,102][106226] Updated weights for policy 0, policy_version 145848 (0.0006) [2023-12-27 20:16:39,387][106225] Updated weights for policy 1, policy_version 145994 (0.0008) [2023-12-27 20:16:39,450][106225] Updated weights for policy 1, policy_version 146004 (0.0008) [2023-12-27 20:16:39,510][106225] Updated weights for policy 1, policy_version 146014 (0.0008) [2023-12-27 20:16:39,802][106226] Updated weights for policy 0, policy_version 145858 (0.0011) [2023-12-27 20:16:39,866][106226] Updated weights for policy 0, policy_version 145868 (0.0010) [2023-12-27 20:16:39,929][106226] Updated weights for policy 0, policy_version 145878 (0.0007) [2023-12-27 20:16:39,995][106226] Updated weights for policy 0, policy_version 145888 (0.0011) [2023-12-27 20:16:40,274][106225] Updated weights for policy 1, policy_version 146024 (0.0010) [2023-12-27 20:16:40,338][106225] Updated weights for policy 1, policy_version 146034 (0.0010) [2023-12-27 20:16:40,399][106225] Updated weights for policy 1, policy_version 146044 (0.0009) [2023-12-27 20:16:40,696][106226] Updated weights for policy 0, policy_version 145898 (0.0011) [2023-12-27 20:16:40,747][106226] Updated weights for policy 0, policy_version 145908 (0.0009) [2023-12-27 20:16:40,803][106226] Updated weights for policy 0, policy_version 145918 (0.0006) [2023-12-27 20:16:41,027][106225] Updated weights for policy 1, policy_version 146054 (0.0009) [2023-12-27 20:16:41,094][106225] Updated weights for policy 1, policy_version 146064 (0.0009) [2023-12-27 20:16:41,159][106225] Updated weights for policy 1, policy_version 146074 (0.0014) [2023-12-27 20:16:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 74760192. Throughput: 0: 9729.7, 1: 10163.3. Samples: 74733632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:16:41,175][105115] Avg episode reward: [(0, '-5.230'), (1, '-6.840')] [2023-12-27 20:16:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000145920_37363712.pth... [2023-12-27 20:16:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000144768_37068800.pth [2023-12-27 20:16:41,193][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000146080_37404672.pth... [2023-12-27 20:16:41,197][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000144864_37093376.pth [2023-12-27 20:16:41,585][106226] Updated weights for policy 0, policy_version 145928 (0.0009) [2023-12-27 20:16:41,652][106226] Updated weights for policy 0, policy_version 145938 (0.0008) [2023-12-27 20:16:41,722][106226] Updated weights for policy 0, policy_version 145948 (0.0008) [2023-12-27 20:16:41,914][106225] Updated weights for policy 1, policy_version 146084 (0.0010) [2023-12-27 20:16:41,974][106225] Updated weights for policy 1, policy_version 146094 (0.0007) [2023-12-27 20:16:42,030][106225] Updated weights for policy 1, policy_version 146104 (0.0008) [2023-12-27 20:16:42,392][106226] Updated weights for policy 0, policy_version 145958 (0.0006) [2023-12-27 20:16:42,450][106226] Updated weights for policy 0, policy_version 145968 (0.0010) [2023-12-27 20:16:42,508][106226] Updated weights for policy 0, policy_version 145978 (0.0010) [2023-12-27 20:16:42,797][106225] Updated weights for policy 1, policy_version 146114 (0.0008) [2023-12-27 20:16:42,858][106225] Updated weights for policy 1, policy_version 146124 (0.0009) [2023-12-27 20:16:42,923][106225] Updated weights for policy 1, policy_version 146134 (0.0008) [2023-12-27 20:16:42,987][106225] Updated weights for policy 1, policy_version 146144 (0.0007) [2023-12-27 20:16:43,155][106226] Updated weights for policy 0, policy_version 145988 (0.0011) [2023-12-27 20:16:43,208][106226] Updated weights for policy 0, policy_version 145998 (0.0010) [2023-12-27 20:16:43,256][106226] Updated weights for policy 0, policy_version 146008 (0.0007) [2023-12-27 20:16:43,791][106225] Updated weights for policy 1, policy_version 146154 (0.0009) [2023-12-27 20:16:43,802][106226] Updated weights for policy 0, policy_version 146018 (0.0005) [2023-12-27 20:16:43,852][106226] Updated weights for policy 0, policy_version 146028 (0.0005) [2023-12-27 20:16:43,855][106225] Updated weights for policy 1, policy_version 146164 (0.0008) [2023-12-27 20:16:43,906][106226] Updated weights for policy 0, policy_version 146038 (0.0005) [2023-12-27 20:16:43,908][106225] Updated weights for policy 1, policy_version 146174 (0.0006) [2023-12-27 20:16:43,962][106226] Updated weights for policy 0, policy_version 146048 (0.0006) [2023-12-27 20:16:44,497][106225] Updated weights for policy 1, policy_version 146184 (0.0005) [2023-12-27 20:16:44,553][106225] Updated weights for policy 1, policy_version 146194 (0.0005) [2023-12-27 20:16:44,575][106226] Updated weights for policy 0, policy_version 146058 (0.0005) [2023-12-27 20:16:44,617][106225] Updated weights for policy 1, policy_version 146204 (0.0007) [2023-12-27 20:16:44,635][106226] Updated weights for policy 0, policy_version 146068 (0.0005) [2023-12-27 20:16:44,695][106226] Updated weights for policy 0, policy_version 146078 (0.0006) [2023-12-27 20:16:45,234][106225] Updated weights for policy 1, policy_version 146214 (0.0008) [2023-12-27 20:16:45,300][106225] Updated weights for policy 1, policy_version 146224 (0.0010) [2023-12-27 20:16:45,349][106226] Updated weights for policy 0, policy_version 146088 (0.0010) [2023-12-27 20:16:45,361][106225] Updated weights for policy 1, policy_version 146234 (0.0010) [2023-12-27 20:16:45,413][106226] Updated weights for policy 0, policy_version 146098 (0.0008) [2023-12-27 20:16:45,479][106226] Updated weights for policy 0, policy_version 146108 (0.0009) [2023-12-27 20:16:45,962][106225] Updated weights for policy 1, policy_version 146244 (0.0008) [2023-12-27 20:16:46,030][106225] Updated weights for policy 1, policy_version 146254 (0.0005) [2023-12-27 20:16:46,087][106225] Updated weights for policy 1, policy_version 146264 (0.0006) [2023-12-27 20:16:46,114][106226] Updated weights for policy 0, policy_version 146118 (0.0009) [2023-12-27 20:16:46,170][106226] Updated weights for policy 0, policy_version 146128 (0.0006) [2023-12-27 20:16:46,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 74866688. Throughput: 0: 9863.8, 1: 10170.2. Samples: 74854460. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:16:46,176][105115] Avg episode reward: [(0, '-4.997'), (1, '-6.364')] [2023-12-27 20:16:46,225][106226] Updated weights for policy 0, policy_version 146138 (0.0009) [2023-12-27 20:16:46,754][106225] Updated weights for policy 1, policy_version 146274 (0.0007) [2023-12-27 20:16:46,810][106225] Updated weights for policy 1, policy_version 146284 (0.0007) [2023-12-27 20:16:46,843][106226] Updated weights for policy 0, policy_version 146148 (0.0010) [2023-12-27 20:16:46,868][106225] Updated weights for policy 1, policy_version 146294 (0.0006) [2023-12-27 20:16:46,900][106226] Updated weights for policy 0, policy_version 146158 (0.0011) [2023-12-27 20:16:46,921][106225] Updated weights for policy 1, policy_version 146304 (0.0006) [2023-12-27 20:16:46,957][106226] Updated weights for policy 0, policy_version 146168 (0.0011) [2023-12-27 20:16:47,587][106225] Updated weights for policy 1, policy_version 146314 (0.0008) [2023-12-27 20:16:47,648][106225] Updated weights for policy 1, policy_version 146324 (0.0005) [2023-12-27 20:16:47,679][106226] Updated weights for policy 0, policy_version 146178 (0.0011) [2023-12-27 20:16:47,707][106225] Updated weights for policy 1, policy_version 146334 (0.0009) [2023-12-27 20:16:47,739][106226] Updated weights for policy 0, policy_version 146188 (0.0010) [2023-12-27 20:16:47,802][106226] Updated weights for policy 0, policy_version 146198 (0.0011) [2023-12-27 20:16:47,853][106226] Updated weights for policy 0, policy_version 146208 (0.0010) [2023-12-27 20:16:48,422][106225] Updated weights for policy 1, policy_version 146344 (0.0011) [2023-12-27 20:16:48,480][106225] Updated weights for policy 1, policy_version 146354 (0.0011) [2023-12-27 20:16:48,548][106225] Updated weights for policy 1, policy_version 146364 (0.0011) [2023-12-27 20:16:48,575][106226] Updated weights for policy 0, policy_version 146218 (0.0006) [2023-12-27 20:16:48,645][106226] Updated weights for policy 0, policy_version 146228 (0.0006) [2023-12-27 20:16:48,712][106226] Updated weights for policy 0, policy_version 146238 (0.0006) [2023-12-27 20:16:49,177][106225] Updated weights for policy 1, policy_version 146374 (0.0006) [2023-12-27 20:16:49,246][106225] Updated weights for policy 1, policy_version 146384 (0.0007) [2023-12-27 20:16:49,309][106225] Updated weights for policy 1, policy_version 146394 (0.0008) [2023-12-27 20:16:49,438][106226] Updated weights for policy 0, policy_version 146248 (0.0008) [2023-12-27 20:16:49,492][106226] Updated weights for policy 0, policy_version 146258 (0.0008) [2023-12-27 20:16:49,554][106226] Updated weights for policy 0, policy_version 146268 (0.0008) [2023-12-27 20:16:49,934][106225] Updated weights for policy 1, policy_version 146404 (0.0006) [2023-12-27 20:16:50,002][106225] Updated weights for policy 1, policy_version 146414 (0.0006) [2023-12-27 20:16:50,065][106225] Updated weights for policy 1, policy_version 146424 (0.0006) [2023-12-27 20:16:50,271][106226] Updated weights for policy 0, policy_version 146278 (0.0008) [2023-12-27 20:16:50,335][106226] Updated weights for policy 0, policy_version 146288 (0.0011) [2023-12-27 20:16:50,419][106226] Updated weights for policy 0, policy_version 146298 (0.0011) [2023-12-27 20:16:50,714][106225] Updated weights for policy 1, policy_version 146434 (0.0007) [2023-12-27 20:16:50,787][106225] Updated weights for policy 1, policy_version 146444 (0.0008) [2023-12-27 20:16:50,845][106225] Updated weights for policy 1, policy_version 146454 (0.0010) [2023-12-27 20:16:50,903][106225] Updated weights for policy 1, policy_version 146464 (0.0008) [2023-12-27 20:16:51,056][106226] Updated weights for policy 0, policy_version 146308 (0.0009) [2023-12-27 20:16:51,123][106226] Updated weights for policy 0, policy_version 146318 (0.0008) [2023-12-27 20:16:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 74964992. Throughput: 0: 9897.5, 1: 10202.1. Samples: 74977592. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:16:51,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-6.458')] [2023-12-27 20:16:51,186][106226] Updated weights for policy 0, policy_version 146328 (0.0008) [2023-12-27 20:16:51,593][106225] Updated weights for policy 1, policy_version 146474 (0.0006) [2023-12-27 20:16:51,658][106225] Updated weights for policy 1, policy_version 146484 (0.0009) [2023-12-27 20:16:51,715][106225] Updated weights for policy 1, policy_version 146494 (0.0009) [2023-12-27 20:16:51,980][106226] Updated weights for policy 0, policy_version 146338 (0.0008) [2023-12-27 20:16:52,033][106226] Updated weights for policy 0, policy_version 146348 (0.0009) [2023-12-27 20:16:52,085][106226] Updated weights for policy 0, policy_version 146358 (0.0008) [2023-12-27 20:16:52,146][106226] Updated weights for policy 0, policy_version 146368 (0.0009) [2023-12-27 20:16:52,465][106225] Updated weights for policy 1, policy_version 146504 (0.0008) [2023-12-27 20:16:52,529][106225] Updated weights for policy 1, policy_version 146514 (0.0009) [2023-12-27 20:16:52,585][106225] Updated weights for policy 1, policy_version 146524 (0.0008) [2023-12-27 20:16:52,926][106226] Updated weights for policy 0, policy_version 146378 (0.0005) [2023-12-27 20:16:52,989][106226] Updated weights for policy 0, policy_version 146388 (0.0006) [2023-12-27 20:16:53,045][106226] Updated weights for policy 0, policy_version 146398 (0.0005) [2023-12-27 20:16:53,361][106225] Updated weights for policy 1, policy_version 146534 (0.0009) [2023-12-27 20:16:53,408][106225] Updated weights for policy 1, policy_version 146544 (0.0007) [2023-12-27 20:16:53,459][106225] Updated weights for policy 1, policy_version 146554 (0.0008) [2023-12-27 20:16:53,664][106226] Updated weights for policy 0, policy_version 146408 (0.0009) [2023-12-27 20:16:53,710][106226] Updated weights for policy 0, policy_version 146418 (0.0009) [2023-12-27 20:16:53,764][106226] Updated weights for policy 0, policy_version 146428 (0.0010) [2023-12-27 20:16:54,205][106225] Updated weights for policy 1, policy_version 146564 (0.0008) [2023-12-27 20:16:54,253][106225] Updated weights for policy 1, policy_version 146574 (0.0008) [2023-12-27 20:16:54,311][106225] Updated weights for policy 1, policy_version 146584 (0.0009) [2023-12-27 20:16:54,488][106226] Updated weights for policy 0, policy_version 146438 (0.0009) [2023-12-27 20:16:54,569][106226] Updated weights for policy 0, policy_version 146448 (0.0008) [2023-12-27 20:16:54,639][106226] Updated weights for policy 0, policy_version 146458 (0.0007) [2023-12-27 20:16:55,015][106225] Updated weights for policy 1, policy_version 146594 (0.0008) [2023-12-27 20:16:55,074][106225] Updated weights for policy 1, policy_version 146604 (0.0008) [2023-12-27 20:16:55,131][106225] Updated weights for policy 1, policy_version 146614 (0.0008) [2023-12-27 20:16:55,185][106225] Updated weights for policy 1, policy_version 146624 (0.0008) [2023-12-27 20:16:55,334][106226] Updated weights for policy 0, policy_version 146468 (0.0008) [2023-12-27 20:16:55,399][106226] Updated weights for policy 0, policy_version 146478 (0.0011) [2023-12-27 20:16:55,462][106226] Updated weights for policy 0, policy_version 146488 (0.0011) [2023-12-27 20:16:55,959][106225] Updated weights for policy 1, policy_version 146634 (0.0009) [2023-12-27 20:16:56,024][106225] Updated weights for policy 1, policy_version 146644 (0.0009) [2023-12-27 20:16:56,078][106225] Updated weights for policy 1, policy_version 146654 (0.0008) [2023-12-27 20:16:56,107][106226] Updated weights for policy 0, policy_version 146498 (0.0011) [2023-12-27 20:16:56,166][106226] Updated weights for policy 0, policy_version 146508 (0.0010) [2023-12-27 20:16:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 75063296. Throughput: 0: 9863.9, 1: 10115.7. Samples: 75033900. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:16:56,176][105115] Avg episode reward: [(0, '-5.317'), (1, '-6.632')] [2023-12-27 20:16:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000146656_37552128.pth... [2023-12-27 20:16:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000145472_37249024.pth [2023-12-27 20:16:56,229][106226] Updated weights for policy 0, policy_version 146518 (0.0010) [2023-12-27 20:16:56,289][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000146528_37519360.pth... [2023-12-27 20:16:56,289][106226] Updated weights for policy 0, policy_version 146528 (0.0010) [2023-12-27 20:16:56,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000145344_37216256.pth [2023-12-27 20:16:56,812][106225] Updated weights for policy 1, policy_version 146664 (0.0008) [2023-12-27 20:16:56,869][106225] Updated weights for policy 1, policy_version 146675 (0.0010) [2023-12-27 20:16:56,916][106225] Updated weights for policy 1, policy_version 146685 (0.0008) [2023-12-27 20:16:56,946][106226] Updated weights for policy 0, policy_version 146538 (0.0006) [2023-12-27 20:16:56,995][106226] Updated weights for policy 0, policy_version 146548 (0.0008) [2023-12-27 20:16:57,053][106226] Updated weights for policy 0, policy_version 146558 (0.0008) [2023-12-27 20:16:57,653][106226] Updated weights for policy 0, policy_version 146568 (0.0006) [2023-12-27 20:16:57,674][106225] Updated weights for policy 1, policy_version 146695 (0.0006) [2023-12-27 20:16:57,713][106226] Updated weights for policy 0, policy_version 146578 (0.0006) [2023-12-27 20:16:57,731][106225] Updated weights for policy 1, policy_version 146705 (0.0006) [2023-12-27 20:16:57,768][106226] Updated weights for policy 0, policy_version 146588 (0.0006) [2023-12-27 20:16:57,788][106225] Updated weights for policy 1, policy_version 146715 (0.0006) [2023-12-27 20:16:58,485][106226] Updated weights for policy 0, policy_version 146598 (0.0008) [2023-12-27 20:16:58,526][106225] Updated weights for policy 1, policy_version 146725 (0.0009) [2023-12-27 20:16:58,553][106226] Updated weights for policy 0, policy_version 146608 (0.0009) [2023-12-27 20:16:58,586][106225] Updated weights for policy 1, policy_version 146735 (0.0008) [2023-12-27 20:16:58,612][106226] Updated weights for policy 0, policy_version 146618 (0.0010) [2023-12-27 20:16:58,655][106225] Updated weights for policy 1, policy_version 146745 (0.0007) [2023-12-27 20:16:59,423][106226] Updated weights for policy 0, policy_version 146628 (0.0010) [2023-12-27 20:16:59,470][106226] Updated weights for policy 0, policy_version 146638 (0.0011) [2023-12-27 20:16:59,521][106226] Updated weights for policy 0, policy_version 146648 (0.0010) [2023-12-27 20:16:59,575][106225] Updated weights for policy 1, policy_version 146755 (0.0008) [2023-12-27 20:16:59,640][106225] Updated weights for policy 1, policy_version 146765 (0.0008) [2023-12-27 20:16:59,699][106225] Updated weights for policy 1, policy_version 146775 (0.0008) [2023-12-27 20:17:00,298][106226] Updated weights for policy 0, policy_version 146658 (0.0011) [2023-12-27 20:17:00,358][106226] Updated weights for policy 0, policy_version 146668 (0.0010) [2023-12-27 20:17:00,421][106226] Updated weights for policy 0, policy_version 146678 (0.0011) [2023-12-27 20:17:00,448][106225] Updated weights for policy 1, policy_version 146785 (0.0008) [2023-12-27 20:17:00,481][106226] Updated weights for policy 0, policy_version 146688 (0.0011) [2023-12-27 20:17:00,505][106225] Updated weights for policy 1, policy_version 146795 (0.0005) [2023-12-27 20:17:00,562][106225] Updated weights for policy 1, policy_version 146805 (0.0008) [2023-12-27 20:17:00,622][106225] Updated weights for policy 1, policy_version 146815 (0.0010) [2023-12-27 20:17:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 75153408. Throughput: 0: 9831.3, 1: 10024.5. Samples: 75148540. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:01,175][105115] Avg episode reward: [(0, '-4.856'), (1, '-6.963')] [2023-12-27 20:17:01,202][106226] Updated weights for policy 0, policy_version 146698 (0.0009) [2023-12-27 20:17:01,231][106225] Updated weights for policy 1, policy_version 146825 (0.0007) [2023-12-27 20:17:01,263][106226] Updated weights for policy 0, policy_version 146708 (0.0009) [2023-12-27 20:17:01,294][106225] Updated weights for policy 1, policy_version 146835 (0.0010) [2023-12-27 20:17:01,323][106226] Updated weights for policy 0, policy_version 146718 (0.0010) [2023-12-27 20:17:01,353][106225] Updated weights for policy 1, policy_version 146845 (0.0006) [2023-12-27 20:17:02,051][106226] Updated weights for policy 0, policy_version 146728 (0.0009) [2023-12-27 20:17:02,084][106225] Updated weights for policy 1, policy_version 146855 (0.0009) [2023-12-27 20:17:02,102][106226] Updated weights for policy 0, policy_version 146738 (0.0006) [2023-12-27 20:17:02,149][106225] Updated weights for policy 1, policy_version 146865 (0.0008) [2023-12-27 20:17:02,155][106226] Updated weights for policy 0, policy_version 146748 (0.0008) [2023-12-27 20:17:02,214][106225] Updated weights for policy 1, policy_version 146875 (0.0008) [2023-12-27 20:17:02,840][106225] Updated weights for policy 1, policy_version 146885 (0.0008) [2023-12-27 20:17:02,853][106226] Updated weights for policy 0, policy_version 146758 (0.0006) [2023-12-27 20:17:02,894][106225] Updated weights for policy 1, policy_version 146895 (0.0006) [2023-12-27 20:17:02,904][106226] Updated weights for policy 0, policy_version 146768 (0.0006) [2023-12-27 20:17:02,957][106225] Updated weights for policy 1, policy_version 146905 (0.0006) [2023-12-27 20:17:02,959][106226] Updated weights for policy 0, policy_version 146778 (0.0006) [2023-12-27 20:17:03,571][106226] Updated weights for policy 0, policy_version 146788 (0.0009) [2023-12-27 20:17:03,598][106225] Updated weights for policy 1, policy_version 146915 (0.0006) [2023-12-27 20:17:03,623][106226] Updated weights for policy 0, policy_version 146798 (0.0008) [2023-12-27 20:17:03,652][106225] Updated weights for policy 1, policy_version 146925 (0.0005) [2023-12-27 20:17:03,667][106226] Updated weights for policy 0, policy_version 146808 (0.0008) [2023-12-27 20:17:03,707][106225] Updated weights for policy 1, policy_version 146935 (0.0005) [2023-12-27 20:17:04,277][106225] Updated weights for policy 1, policy_version 146945 (0.0005) [2023-12-27 20:17:04,331][106225] Updated weights for policy 1, policy_version 146955 (0.0008) [2023-12-27 20:17:04,387][106225] Updated weights for policy 1, policy_version 146965 (0.0005) [2023-12-27 20:17:04,445][106225] Updated weights for policy 1, policy_version 146975 (0.0007) [2023-12-27 20:17:04,471][106226] Updated weights for policy 0, policy_version 146818 (0.0008) [2023-12-27 20:17:04,537][106226] Updated weights for policy 0, policy_version 146828 (0.0009) [2023-12-27 20:17:04,597][106226] Updated weights for policy 0, policy_version 146838 (0.0010) [2023-12-27 20:17:04,645][106226] Updated weights for policy 0, policy_version 146848 (0.0009) [2023-12-27 20:17:05,058][106225] Updated weights for policy 1, policy_version 146985 (0.0009) [2023-12-27 20:17:05,115][106225] Updated weights for policy 1, policy_version 146995 (0.0008) [2023-12-27 20:17:05,186][106225] Updated weights for policy 1, policy_version 147005 (0.0005) [2023-12-27 20:17:05,355][106226] Updated weights for policy 0, policy_version 146858 (0.0009) [2023-12-27 20:17:05,401][106226] Updated weights for policy 0, policy_version 146868 (0.0009) [2023-12-27 20:17:05,451][106226] Updated weights for policy 0, policy_version 146878 (0.0008) [2023-12-27 20:17:05,800][106225] Updated weights for policy 1, policy_version 147015 (0.0005) [2023-12-27 20:17:05,864][106225] Updated weights for policy 1, policy_version 147025 (0.0009) [2023-12-27 20:17:05,918][106225] Updated weights for policy 1, policy_version 147035 (0.0010) [2023-12-27 20:17:06,167][106226] Updated weights for policy 0, policy_version 146888 (0.0006) [2023-12-27 20:17:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 75259904. Throughput: 0: 9810.7, 1: 10092.5. Samples: 75271368. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:06,175][105115] Avg episode reward: [(0, '-4.959'), (1, '-6.751')] [2023-12-27 20:17:06,233][106226] Updated weights for policy 0, policy_version 146898 (0.0009) [2023-12-27 20:17:06,300][106226] Updated weights for policy 0, policy_version 146908 (0.0008) [2023-12-27 20:17:06,610][106225] Updated weights for policy 1, policy_version 147045 (0.0010) [2023-12-27 20:17:06,669][106225] Updated weights for policy 1, policy_version 147055 (0.0010) [2023-12-27 20:17:06,729][106225] Updated weights for policy 1, policy_version 147065 (0.0010) [2023-12-27 20:17:06,902][106226] Updated weights for policy 0, policy_version 146918 (0.0005) [2023-12-27 20:17:06,960][106226] Updated weights for policy 0, policy_version 146928 (0.0008) [2023-12-27 20:17:07,016][106226] Updated weights for policy 0, policy_version 146938 (0.0008) [2023-12-27 20:17:07,391][106225] Updated weights for policy 1, policy_version 147075 (0.0009) [2023-12-27 20:17:07,454][106225] Updated weights for policy 1, policy_version 147085 (0.0005) [2023-12-27 20:17:07,514][106225] Updated weights for policy 1, policy_version 147095 (0.0005) [2023-12-27 20:17:07,725][106226] Updated weights for policy 0, policy_version 146948 (0.0008) [2023-12-27 20:17:07,779][106226] Updated weights for policy 0, policy_version 146958 (0.0008) [2023-12-27 20:17:07,827][106226] Updated weights for policy 0, policy_version 146968 (0.0008) [2023-12-27 20:17:08,027][106225] Updated weights for policy 1, policy_version 147105 (0.0006) [2023-12-27 20:17:08,087][106225] Updated weights for policy 1, policy_version 147115 (0.0009) [2023-12-27 20:17:08,144][106225] Updated weights for policy 1, policy_version 147125 (0.0010) [2023-12-27 20:17:08,204][106225] Updated weights for policy 1, policy_version 147135 (0.0010) [2023-12-27 20:17:08,571][106226] Updated weights for policy 0, policy_version 146978 (0.0009) [2023-12-27 20:17:08,635][106226] Updated weights for policy 0, policy_version 146988 (0.0011) [2023-12-27 20:17:08,702][106226] Updated weights for policy 0, policy_version 146998 (0.0011) [2023-12-27 20:17:08,766][106226] Updated weights for policy 0, policy_version 147008 (0.0008) [2023-12-27 20:17:08,934][106225] Updated weights for policy 1, policy_version 147145 (0.0009) [2023-12-27 20:17:08,985][106225] Updated weights for policy 1, policy_version 147155 (0.0010) [2023-12-27 20:17:09,046][106225] Updated weights for policy 1, policy_version 147165 (0.0010) [2023-12-27 20:17:09,491][106226] Updated weights for policy 0, policy_version 147018 (0.0008) [2023-12-27 20:17:09,550][106226] Updated weights for policy 0, policy_version 147028 (0.0008) [2023-12-27 20:17:09,609][106226] Updated weights for policy 0, policy_version 147038 (0.0008) [2023-12-27 20:17:09,795][106225] Updated weights for policy 1, policy_version 147175 (0.0009) [2023-12-27 20:17:09,866][106225] Updated weights for policy 1, policy_version 147185 (0.0009) [2023-12-27 20:17:09,927][106225] Updated weights for policy 1, policy_version 147195 (0.0009) [2023-12-27 20:17:10,359][106226] Updated weights for policy 0, policy_version 147048 (0.0007) [2023-12-27 20:17:10,413][106226] Updated weights for policy 0, policy_version 147058 (0.0007) [2023-12-27 20:17:10,459][106226] Updated weights for policy 0, policy_version 147068 (0.0009) [2023-12-27 20:17:10,663][106225] Updated weights for policy 1, policy_version 147205 (0.0009) [2023-12-27 20:17:10,721][106225] Updated weights for policy 1, policy_version 147215 (0.0006) [2023-12-27 20:17:10,784][106225] Updated weights for policy 1, policy_version 147225 (0.0005) [2023-12-27 20:17:11,176][105115] Fps is (10 sec: 20477.4, 60 sec: 19933.5, 300 sec: 19855.1). Total num frames: 75358208. Throughput: 0: 9847.1, 1: 10163.9. Samples: 75332940. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:11,176][105115] Avg episode reward: [(0, '-5.325'), (1, '-6.208')] [2023-12-27 20:17:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000147232_37699584.pth... [2023-12-27 20:17:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000147072_37658624.pth... [2023-12-27 20:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000146080_37404672.pth [2023-12-27 20:17:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000145920_37363712.pth [2023-12-27 20:17:11,244][106226] Updated weights for policy 0, policy_version 147078 (0.0009) [2023-12-27 20:17:11,308][106226] Updated weights for policy 0, policy_version 147088 (0.0010) [2023-12-27 20:17:11,380][106226] Updated weights for policy 0, policy_version 147098 (0.0008) [2023-12-27 20:17:11,497][106225] Updated weights for policy 1, policy_version 147235 (0.0006) [2023-12-27 20:17:11,561][106225] Updated weights for policy 1, policy_version 147245 (0.0009) [2023-12-27 20:17:11,620][106225] Updated weights for policy 1, policy_version 147255 (0.0008) [2023-12-27 20:17:12,128][106226] Updated weights for policy 0, policy_version 147108 (0.0010) [2023-12-27 20:17:12,185][106226] Updated weights for policy 0, policy_version 147118 (0.0010) [2023-12-27 20:17:12,255][106226] Updated weights for policy 0, policy_version 147128 (0.0011) [2023-12-27 20:17:12,415][106225] Updated weights for policy 1, policy_version 147265 (0.0008) [2023-12-27 20:17:12,476][106225] Updated weights for policy 1, policy_version 147275 (0.0008) [2023-12-27 20:17:12,536][106225] Updated weights for policy 1, policy_version 147285 (0.0006) [2023-12-27 20:17:12,596][106225] Updated weights for policy 1, policy_version 147295 (0.0008) [2023-12-27 20:17:13,016][106226] Updated weights for policy 0, policy_version 147138 (0.0011) [2023-12-27 20:17:13,079][106226] Updated weights for policy 0, policy_version 147148 (0.0011) [2023-12-27 20:17:13,155][106226] Updated weights for policy 0, policy_version 147158 (0.0011) [2023-12-27 20:17:13,191][106225] Updated weights for policy 1, policy_version 147305 (0.0006) [2023-12-27 20:17:13,209][106226] Updated weights for policy 0, policy_version 147168 (0.0011) [2023-12-27 20:17:13,250][106225] Updated weights for policy 1, policy_version 147315 (0.0007) [2023-12-27 20:17:13,321][106225] Updated weights for policy 1, policy_version 147325 (0.0006) [2023-12-27 20:17:13,896][106226] Updated weights for policy 0, policy_version 147178 (0.0007) [2023-12-27 20:17:13,911][106225] Updated weights for policy 1, policy_version 147335 (0.0008) [2023-12-27 20:17:13,940][106226] Updated weights for policy 0, policy_version 147188 (0.0008) [2023-12-27 20:17:13,963][106225] Updated weights for policy 1, policy_version 147345 (0.0006) [2023-12-27 20:17:13,985][106226] Updated weights for policy 0, policy_version 147198 (0.0008) [2023-12-27 20:17:14,022][106225] Updated weights for policy 1, policy_version 147355 (0.0006) [2023-12-27 20:17:14,632][106225] Updated weights for policy 1, policy_version 147365 (0.0007) [2023-12-27 20:17:14,681][106225] Updated weights for policy 1, policy_version 147375 (0.0009) [2023-12-27 20:17:14,731][106225] Updated weights for policy 1, policy_version 147385 (0.0006) [2023-12-27 20:17:14,770][106226] Updated weights for policy 0, policy_version 147208 (0.0007) [2023-12-27 20:17:14,827][106226] Updated weights for policy 0, policy_version 147218 (0.0008) [2023-12-27 20:17:14,887][106226] Updated weights for policy 0, policy_version 147228 (0.0008) [2023-12-27 20:17:15,463][106225] Updated weights for policy 1, policy_version 147395 (0.0008) [2023-12-27 20:17:15,521][106225] Updated weights for policy 1, policy_version 147405 (0.0008) [2023-12-27 20:17:15,579][106225] Updated weights for policy 1, policy_version 147415 (0.0008) [2023-12-27 20:17:15,669][106226] Updated weights for policy 0, policy_version 147238 (0.0007) [2023-12-27 20:17:15,713][106226] Updated weights for policy 0, policy_version 147248 (0.0008) [2023-12-27 20:17:15,767][106226] Updated weights for policy 0, policy_version 147258 (0.0009) [2023-12-27 20:17:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 75456512. Throughput: 0: 9792.2, 1: 10152.8. Samples: 75448368. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:16,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-6.536')] [2023-12-27 20:17:16,270][106225] Updated weights for policy 1, policy_version 147425 (0.0009) [2023-12-27 20:17:16,315][106225] Updated weights for policy 1, policy_version 147435 (0.0008) [2023-12-27 20:17:16,362][106225] Updated weights for policy 1, policy_version 147445 (0.0008) [2023-12-27 20:17:16,427][106225] Updated weights for policy 1, policy_version 147455 (0.0007) [2023-12-27 20:17:16,482][106226] Updated weights for policy 0, policy_version 147268 (0.0009) [2023-12-27 20:17:16,541][106226] Updated weights for policy 0, policy_version 147278 (0.0008) [2023-12-27 20:17:16,604][106226] Updated weights for policy 0, policy_version 147288 (0.0009) [2023-12-27 20:17:17,135][106225] Updated weights for policy 1, policy_version 147465 (0.0009) [2023-12-27 20:17:17,195][106225] Updated weights for policy 1, policy_version 147475 (0.0005) [2023-12-27 20:17:17,218][106226] Updated weights for policy 0, policy_version 147298 (0.0008) [2023-12-27 20:17:17,253][106225] Updated weights for policy 1, policy_version 147485 (0.0005) [2023-12-27 20:17:17,275][106226] Updated weights for policy 0, policy_version 147308 (0.0008) [2023-12-27 20:17:17,323][106226] Updated weights for policy 0, policy_version 147318 (0.0008) [2023-12-27 20:17:17,371][106226] Updated weights for policy 0, policy_version 147328 (0.0006) [2023-12-27 20:17:17,874][106225] Updated weights for policy 1, policy_version 147495 (0.0008) [2023-12-27 20:17:17,920][106225] Updated weights for policy 1, policy_version 147505 (0.0010) [2023-12-27 20:17:17,970][106225] Updated weights for policy 1, policy_version 147515 (0.0010) [2023-12-27 20:17:18,042][106226] Updated weights for policy 0, policy_version 147338 (0.0008) [2023-12-27 20:17:18,095][106226] Updated weights for policy 0, policy_version 147348 (0.0009) [2023-12-27 20:17:18,157][106226] Updated weights for policy 0, policy_version 147358 (0.0010) [2023-12-27 20:17:18,704][106225] Updated weights for policy 1, policy_version 147525 (0.0010) [2023-12-27 20:17:18,765][106225] Updated weights for policy 1, policy_version 147535 (0.0010) [2023-12-27 20:17:18,826][106225] Updated weights for policy 1, policy_version 147545 (0.0010) [2023-12-27 20:17:18,878][106226] Updated weights for policy 0, policy_version 147368 (0.0006) [2023-12-27 20:17:18,942][106226] Updated weights for policy 0, policy_version 147378 (0.0010) [2023-12-27 20:17:18,994][106226] Updated weights for policy 0, policy_version 147388 (0.0008) [2023-12-27 20:17:19,519][106225] Updated weights for policy 1, policy_version 147555 (0.0009) [2023-12-27 20:17:19,585][106225] Updated weights for policy 1, policy_version 147565 (0.0006) [2023-12-27 20:17:19,653][106225] Updated weights for policy 1, policy_version 147575 (0.0008) [2023-12-27 20:17:19,798][106226] Updated weights for policy 0, policy_version 147398 (0.0009) [2023-12-27 20:17:19,858][106226] Updated weights for policy 0, policy_version 147408 (0.0007) [2023-12-27 20:17:19,925][106226] Updated weights for policy 0, policy_version 147418 (0.0007) [2023-12-27 20:17:20,281][106225] Updated weights for policy 1, policy_version 147585 (0.0005) [2023-12-27 20:17:20,349][106225] Updated weights for policy 1, policy_version 147595 (0.0006) [2023-12-27 20:17:20,414][106225] Updated weights for policy 1, policy_version 147605 (0.0006) [2023-12-27 20:17:20,477][106225] Updated weights for policy 1, policy_version 147615 (0.0005) [2023-12-27 20:17:20,711][106226] Updated weights for policy 0, policy_version 147428 (0.0007) [2023-12-27 20:17:20,773][106226] Updated weights for policy 0, policy_version 147438 (0.0008) [2023-12-27 20:17:20,840][106226] Updated weights for policy 0, policy_version 147448 (0.0008) [2023-12-27 20:17:21,135][106225] Updated weights for policy 1, policy_version 147625 (0.0009) [2023-12-27 20:17:21,175][105115] Fps is (10 sec: 19663.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 75554816. Throughput: 0: 9780.5, 1: 10062.2. Samples: 75567244. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:21,175][105115] Avg episode reward: [(0, '-5.134'), (1, '-6.674')] [2023-12-27 20:17:21,199][106225] Updated weights for policy 1, policy_version 147635 (0.0008) [2023-12-27 20:17:21,266][106225] Updated weights for policy 1, policy_version 147645 (0.0009) [2023-12-27 20:17:21,555][106226] Updated weights for policy 0, policy_version 147458 (0.0008) [2023-12-27 20:17:21,620][106226] Updated weights for policy 0, policy_version 147468 (0.0007) [2023-12-27 20:17:21,694][106226] Updated weights for policy 0, policy_version 147479 (0.0009) [2023-12-27 20:17:22,051][106225] Updated weights for policy 1, policy_version 147655 (0.0007) [2023-12-27 20:17:22,122][106225] Updated weights for policy 1, policy_version 147665 (0.0007) [2023-12-27 20:17:22,190][106225] Updated weights for policy 1, policy_version 147675 (0.0008) [2023-12-27 20:17:22,503][106226] Updated weights for policy 0, policy_version 147489 (0.0010) [2023-12-27 20:17:22,560][106226] Updated weights for policy 0, policy_version 147499 (0.0009) [2023-12-27 20:17:22,623][106226] Updated weights for policy 0, policy_version 147509 (0.0010) [2023-12-27 20:17:22,685][106226] Updated weights for policy 0, policy_version 147519 (0.0011) [2023-12-27 20:17:22,830][106225] Updated weights for policy 1, policy_version 147685 (0.0006) [2023-12-27 20:17:22,885][106225] Updated weights for policy 1, policy_version 147695 (0.0007) [2023-12-27 20:17:22,940][106225] Updated weights for policy 1, policy_version 147705 (0.0008) [2023-12-27 20:17:23,401][106226] Updated weights for policy 0, policy_version 147529 (0.0009) [2023-12-27 20:17:23,455][106226] Updated weights for policy 0, policy_version 147539 (0.0009) [2023-12-27 20:17:23,512][106226] Updated weights for policy 0, policy_version 147549 (0.0007) [2023-12-27 20:17:23,594][106225] Updated weights for policy 1, policy_version 147715 (0.0008) [2023-12-27 20:17:23,649][106225] Updated weights for policy 1, policy_version 147725 (0.0008) [2023-12-27 20:17:23,715][106225] Updated weights for policy 1, policy_version 147735 (0.0008) [2023-12-27 20:17:24,274][106226] Updated weights for policy 0, policy_version 147559 (0.0009) [2023-12-27 20:17:24,342][106226] Updated weights for policy 0, policy_version 147569 (0.0009) [2023-12-27 20:17:24,403][106226] Updated weights for policy 0, policy_version 147579 (0.0009) [2023-12-27 20:17:24,437][106225] Updated weights for policy 1, policy_version 147745 (0.0008) [2023-12-27 20:17:24,490][106225] Updated weights for policy 1, policy_version 147755 (0.0005) [2023-12-27 20:17:24,548][106225] Updated weights for policy 1, policy_version 147765 (0.0009) [2023-12-27 20:17:24,601][106225] Updated weights for policy 1, policy_version 147775 (0.0009) [2023-12-27 20:17:24,990][106226] Updated weights for policy 0, policy_version 147589 (0.0007) [2023-12-27 20:17:25,054][106226] Updated weights for policy 0, policy_version 147599 (0.0009) [2023-12-27 20:17:25,104][106226] Updated weights for policy 0, policy_version 147609 (0.0008) [2023-12-27 20:17:25,336][106225] Updated weights for policy 1, policy_version 147785 (0.0008) [2023-12-27 20:17:25,390][106225] Updated weights for policy 1, policy_version 147795 (0.0008) [2023-12-27 20:17:25,436][106225] Updated weights for policy 1, policy_version 147805 (0.0008) [2023-12-27 20:17:25,882][106226] Updated weights for policy 0, policy_version 147619 (0.0008) [2023-12-27 20:17:25,943][106226] Updated weights for policy 0, policy_version 147629 (0.0009) [2023-12-27 20:17:25,992][106226] Updated weights for policy 0, policy_version 147639 (0.0009) [2023-12-27 20:17:26,076][106225] Updated weights for policy 1, policy_version 147815 (0.0008) [2023-12-27 20:17:26,134][106225] Updated weights for policy 1, policy_version 147825 (0.0008) [2023-12-27 20:17:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 75653120. Throughput: 0: 9776.1, 1: 10019.0. Samples: 75624408. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:26,175][105115] Avg episode reward: [(0, '-5.218'), (1, '-6.590')] [2023-12-27 20:17:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000147648_37806080.pth... [2023-12-27 20:17:26,182][106225] Updated weights for policy 1, policy_version 147835 (0.0009) [2023-12-27 20:17:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000146528_37519360.pth [2023-12-27 20:17:26,208][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000147840_37855232.pth... [2023-12-27 20:17:26,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000146656_37552128.pth [2023-12-27 20:17:26,750][106226] Updated weights for policy 0, policy_version 147649 (0.0009) [2023-12-27 20:17:26,800][106226] Updated weights for policy 0, policy_version 147659 (0.0008) [2023-12-27 20:17:26,848][106226] Updated weights for policy 0, policy_version 147669 (0.0008) [2023-12-27 20:17:26,893][106226] Updated weights for policy 0, policy_version 147679 (0.0008) [2023-12-27 20:17:26,914][106225] Updated weights for policy 1, policy_version 147845 (0.0009) [2023-12-27 20:17:26,964][106225] Updated weights for policy 1, policy_version 147855 (0.0008) [2023-12-27 20:17:27,024][106225] Updated weights for policy 1, policy_version 147865 (0.0008) [2023-12-27 20:17:27,675][106225] Updated weights for policy 1, policy_version 147875 (0.0007) [2023-12-27 20:17:27,677][106226] Updated weights for policy 0, policy_version 147689 (0.0008) [2023-12-27 20:17:27,734][106226] Updated weights for policy 0, policy_version 147699 (0.0007) [2023-12-27 20:17:27,739][106225] Updated weights for policy 1, policy_version 147885 (0.0008) [2023-12-27 20:17:27,780][106226] Updated weights for policy 0, policy_version 147709 (0.0006) [2023-12-27 20:17:27,795][106225] Updated weights for policy 1, policy_version 147895 (0.0010) [2023-12-27 20:17:28,418][106225] Updated weights for policy 1, policy_version 147905 (0.0010) [2023-12-27 20:17:28,472][106225] Updated weights for policy 1, policy_version 147915 (0.0008) [2023-12-27 20:17:28,520][106226] Updated weights for policy 0, policy_version 147719 (0.0006) [2023-12-27 20:17:28,526][106225] Updated weights for policy 1, policy_version 147925 (0.0010) [2023-12-27 20:17:28,579][106226] Updated weights for policy 0, policy_version 147729 (0.0008) [2023-12-27 20:17:28,580][106225] Updated weights for policy 1, policy_version 147935 (0.0010) [2023-12-27 20:17:28,636][106226] Updated weights for policy 0, policy_version 147739 (0.0010) [2023-12-27 20:17:29,253][106226] Updated weights for policy 0, policy_version 147749 (0.0010) [2023-12-27 20:17:29,316][106226] Updated weights for policy 0, policy_version 147759 (0.0006) [2023-12-27 20:17:29,318][106225] Updated weights for policy 1, policy_version 147945 (0.0010) [2023-12-27 20:17:29,384][106226] Updated weights for policy 0, policy_version 147769 (0.0008) [2023-12-27 20:17:29,387][106225] Updated weights for policy 1, policy_version 147955 (0.0008) [2023-12-27 20:17:29,481][106225] Updated weights for policy 1, policy_version 147965 (0.0007) [2023-12-27 20:17:29,979][106226] Updated weights for policy 0, policy_version 147779 (0.0007) [2023-12-27 20:17:30,030][106226] Updated weights for policy 0, policy_version 147789 (0.0010) [2023-12-27 20:17:30,085][106226] Updated weights for policy 0, policy_version 147799 (0.0010) [2023-12-27 20:17:30,107][106225] Updated weights for policy 1, policy_version 147975 (0.0009) [2023-12-27 20:17:30,161][106225] Updated weights for policy 1, policy_version 147985 (0.0010) [2023-12-27 20:17:30,221][106225] Updated weights for policy 1, policy_version 147995 (0.0010) [2023-12-27 20:17:30,753][106226] Updated weights for policy 0, policy_version 147809 (0.0008) [2023-12-27 20:17:30,803][106226] Updated weights for policy 0, policy_version 147819 (0.0006) [2023-12-27 20:17:30,860][106226] Updated weights for policy 0, policy_version 147829 (0.0005) [2023-12-27 20:17:30,916][106226] Updated weights for policy 0, policy_version 147839 (0.0006) [2023-12-27 20:17:30,928][106225] Updated weights for policy 1, policy_version 148005 (0.0010) [2023-12-27 20:17:30,977][106225] Updated weights for policy 1, policy_version 148015 (0.0010) [2023-12-27 20:17:31,032][106225] Updated weights for policy 1, policy_version 148025 (0.0010) [2023-12-27 20:17:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 75759616. Throughput: 0: 9733.6, 1: 10061.6. Samples: 75745236. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:31,175][105115] Avg episode reward: [(0, '-5.254'), (1, '-6.635')] [2023-12-27 20:17:31,530][106226] Updated weights for policy 0, policy_version 147849 (0.0010) [2023-12-27 20:17:31,584][106226] Updated weights for policy 0, policy_version 147859 (0.0011) [2023-12-27 20:17:31,654][106226] Updated weights for policy 0, policy_version 147869 (0.0009) [2023-12-27 20:17:31,822][106225] Updated weights for policy 1, policy_version 148035 (0.0008) [2023-12-27 20:17:31,870][106225] Updated weights for policy 1, policy_version 148045 (0.0007) [2023-12-27 20:17:31,925][106225] Updated weights for policy 1, policy_version 148055 (0.0006) [2023-12-27 20:17:32,316][106226] Updated weights for policy 0, policy_version 147879 (0.0008) [2023-12-27 20:17:32,384][106226] Updated weights for policy 0, policy_version 147889 (0.0009) [2023-12-27 20:17:32,452][106226] Updated weights for policy 0, policy_version 147899 (0.0008) [2023-12-27 20:17:32,628][106225] Updated weights for policy 1, policy_version 148065 (0.0006) [2023-12-27 20:17:32,686][106225] Updated weights for policy 1, policy_version 148075 (0.0010) [2023-12-27 20:17:32,741][106225] Updated weights for policy 1, policy_version 148085 (0.0009) [2023-12-27 20:17:32,790][106225] Updated weights for policy 1, policy_version 148095 (0.0010) [2023-12-27 20:17:33,147][106226] Updated weights for policy 0, policy_version 147909 (0.0009) [2023-12-27 20:17:33,196][106226] Updated weights for policy 0, policy_version 147919 (0.0010) [2023-12-27 20:17:33,252][106226] Updated weights for policy 0, policy_version 147929 (0.0010) [2023-12-27 20:17:33,394][106225] Updated weights for policy 1, policy_version 148105 (0.0010) [2023-12-27 20:17:33,443][106225] Updated weights for policy 1, policy_version 148115 (0.0010) [2023-12-27 20:17:33,499][106225] Updated weights for policy 1, policy_version 148125 (0.0008) [2023-12-27 20:17:33,946][106226] Updated weights for policy 0, policy_version 147939 (0.0009) [2023-12-27 20:17:34,003][106226] Updated weights for policy 0, policy_version 147949 (0.0008) [2023-12-27 20:17:34,054][106226] Updated weights for policy 0, policy_version 147959 (0.0009) [2023-12-27 20:17:34,125][106225] Updated weights for policy 1, policy_version 148135 (0.0009) [2023-12-27 20:17:34,195][106225] Updated weights for policy 1, policy_version 148145 (0.0008) [2023-12-27 20:17:34,265][106225] Updated weights for policy 1, policy_version 148155 (0.0009) [2023-12-27 20:17:34,747][106226] Updated weights for policy 0, policy_version 147969 (0.0010) [2023-12-27 20:17:34,810][106226] Updated weights for policy 0, policy_version 147979 (0.0010) [2023-12-27 20:17:34,862][106226] Updated weights for policy 0, policy_version 147989 (0.0010) [2023-12-27 20:17:34,919][106226] Updated weights for policy 0, policy_version 147999 (0.0010) [2023-12-27 20:17:34,993][106225] Updated weights for policy 1, policy_version 148165 (0.0010) [2023-12-27 20:17:35,048][106225] Updated weights for policy 1, policy_version 148175 (0.0010) [2023-12-27 20:17:35,098][106225] Updated weights for policy 1, policy_version 148185 (0.0010) [2023-12-27 20:17:35,633][106226] Updated weights for policy 0, policy_version 148009 (0.0006) [2023-12-27 20:17:35,683][106226] Updated weights for policy 0, policy_version 148019 (0.0005) [2023-12-27 20:17:35,737][106226] Updated weights for policy 0, policy_version 148029 (0.0005) [2023-12-27 20:17:35,806][106225] Updated weights for policy 1, policy_version 148195 (0.0010) [2023-12-27 20:17:35,865][106225] Updated weights for policy 1, policy_version 148205 (0.0010) [2023-12-27 20:17:35,914][106225] Updated weights for policy 1, policy_version 148215 (0.0010) [2023-12-27 20:17:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 75857920. Throughput: 0: 9757.0, 1: 10010.0. Samples: 75867108. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:36,175][105115] Avg episode reward: [(0, '-5.291'), (1, '-6.801')] [2023-12-27 20:17:36,365][106226] Updated weights for policy 0, policy_version 148039 (0.0005) [2023-12-27 20:17:36,428][106226] Updated weights for policy 0, policy_version 148049 (0.0005) [2023-12-27 20:17:36,486][106226] Updated weights for policy 0, policy_version 148059 (0.0008) [2023-12-27 20:17:36,649][106225] Updated weights for policy 1, policy_version 148225 (0.0010) [2023-12-27 20:17:36,706][106225] Updated weights for policy 1, policy_version 148235 (0.0010) [2023-12-27 20:17:36,762][106225] Updated weights for policy 1, policy_version 148245 (0.0010) [2023-12-27 20:17:36,812][106225] Updated weights for policy 1, policy_version 148255 (0.0010) [2023-12-27 20:17:37,076][106226] Updated weights for policy 0, policy_version 148069 (0.0008) [2023-12-27 20:17:37,148][106226] Updated weights for policy 0, policy_version 148079 (0.0008) [2023-12-27 20:17:37,212][106226] Updated weights for policy 0, policy_version 148089 (0.0009) [2023-12-27 20:17:37,516][106225] Updated weights for policy 1, policy_version 148265 (0.0006) [2023-12-27 20:17:37,567][106225] Updated weights for policy 1, policy_version 148275 (0.0005) [2023-12-27 20:17:37,619][106225] Updated weights for policy 1, policy_version 148285 (0.0005) [2023-12-27 20:17:37,855][106226] Updated weights for policy 0, policy_version 148099 (0.0006) [2023-12-27 20:17:37,912][106226] Updated weights for policy 0, policy_version 148109 (0.0008) [2023-12-27 20:17:37,970][106226] Updated weights for policy 0, policy_version 148119 (0.0007) [2023-12-27 20:17:38,218][106225] Updated weights for policy 1, policy_version 148295 (0.0006) [2023-12-27 20:17:38,287][106225] Updated weights for policy 1, policy_version 148305 (0.0005) [2023-12-27 20:17:38,356][106225] Updated weights for policy 1, policy_version 148315 (0.0007) [2023-12-27 20:17:38,665][106226] Updated weights for policy 0, policy_version 148129 (0.0006) [2023-12-27 20:17:38,720][106226] Updated weights for policy 0, policy_version 148139 (0.0011) [2023-12-27 20:17:38,782][106226] Updated weights for policy 0, policy_version 148149 (0.0011) [2023-12-27 20:17:38,844][106226] Updated weights for policy 0, policy_version 148159 (0.0011) [2023-12-27 20:17:39,018][106225] Updated weights for policy 1, policy_version 148325 (0.0009) [2023-12-27 20:17:39,081][106225] Updated weights for policy 1, policy_version 148335 (0.0006) [2023-12-27 20:17:39,145][106225] Updated weights for policy 1, policy_version 148345 (0.0006) [2023-12-27 20:17:39,545][106226] Updated weights for policy 0, policy_version 148169 (0.0009) [2023-12-27 20:17:39,601][106226] Updated weights for policy 0, policy_version 148179 (0.0007) [2023-12-27 20:17:39,663][106226] Updated weights for policy 0, policy_version 148189 (0.0008) [2023-12-27 20:17:39,863][106225] Updated weights for policy 1, policy_version 148355 (0.0010) [2023-12-27 20:17:39,925][106225] Updated weights for policy 1, policy_version 148365 (0.0009) [2023-12-27 20:17:39,996][106225] Updated weights for policy 1, policy_version 148375 (0.0009) [2023-12-27 20:17:40,427][106226] Updated weights for policy 0, policy_version 148199 (0.0009) [2023-12-27 20:17:40,484][106226] Updated weights for policy 0, policy_version 148209 (0.0009) [2023-12-27 20:17:40,542][106226] Updated weights for policy 0, policy_version 148219 (0.0008) [2023-12-27 20:17:40,733][106225] Updated weights for policy 1, policy_version 148385 (0.0009) [2023-12-27 20:17:40,790][106225] Updated weights for policy 1, policy_version 148395 (0.0008) [2023-12-27 20:17:40,852][106225] Updated weights for policy 1, policy_version 148405 (0.0008) [2023-12-27 20:17:40,908][106225] Updated weights for policy 1, policy_version 148415 (0.0008) [2023-12-27 20:17:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 75956224. Throughput: 0: 9829.6, 1: 10070.0. Samples: 75929376. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:41,175][105115] Avg episode reward: [(0, '-5.133'), (1, '-6.722')] [2023-12-27 20:17:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000148224_37953536.pth... [2023-12-27 20:17:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000148416_38002688.pth... [2023-12-27 20:17:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000147232_37699584.pth [2023-12-27 20:17:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000147072_37658624.pth [2023-12-27 20:17:41,247][106226] Updated weights for policy 0, policy_version 148229 (0.0009) [2023-12-27 20:17:41,310][106226] Updated weights for policy 0, policy_version 148239 (0.0008) [2023-12-27 20:17:41,368][106226] Updated weights for policy 0, policy_version 148249 (0.0008) [2023-12-27 20:17:41,714][106225] Updated weights for policy 1, policy_version 148425 (0.0010) [2023-12-27 20:17:41,779][106225] Updated weights for policy 1, policy_version 148435 (0.0008) [2023-12-27 20:17:41,833][106225] Updated weights for policy 1, policy_version 148445 (0.0009) [2023-12-27 20:17:42,163][106226] Updated weights for policy 0, policy_version 148259 (0.0008) [2023-12-27 20:17:42,222][106226] Updated weights for policy 0, policy_version 148269 (0.0010) [2023-12-27 20:17:42,290][106226] Updated weights for policy 0, policy_version 148279 (0.0008) [2023-12-27 20:17:42,522][106225] Updated weights for policy 1, policy_version 148455 (0.0009) [2023-12-27 20:17:42,580][106225] Updated weights for policy 1, policy_version 148465 (0.0010) [2023-12-27 20:17:42,631][106225] Updated weights for policy 1, policy_version 148475 (0.0010) [2023-12-27 20:17:43,064][106226] Updated weights for policy 0, policy_version 148289 (0.0008) [2023-12-27 20:17:43,131][106226] Updated weights for policy 0, policy_version 148299 (0.0009) [2023-12-27 20:17:43,191][106226] Updated weights for policy 0, policy_version 148309 (0.0009) [2023-12-27 20:17:43,234][106225] Updated weights for policy 1, policy_version 148485 (0.0008) [2023-12-27 20:17:43,252][106226] Updated weights for policy 0, policy_version 148319 (0.0006) [2023-12-27 20:17:43,296][106225] Updated weights for policy 1, policy_version 148495 (0.0005) [2023-12-27 20:17:43,359][106225] Updated weights for policy 1, policy_version 148505 (0.0005) [2023-12-27 20:17:43,869][106226] Updated weights for policy 0, policy_version 148329 (0.0008) [2023-12-27 20:17:43,912][106226] Updated weights for policy 0, policy_version 148339 (0.0007) [2023-12-27 20:17:43,925][106225] Updated weights for policy 1, policy_version 148515 (0.0007) [2023-12-27 20:17:43,959][106226] Updated weights for policy 0, policy_version 148349 (0.0006) [2023-12-27 20:17:43,972][106225] Updated weights for policy 1, policy_version 148525 (0.0010) [2023-12-27 20:17:44,030][106225] Updated weights for policy 1, policy_version 148535 (0.0008) [2023-12-27 20:17:44,651][106226] Updated weights for policy 0, policy_version 148359 (0.0005) [2023-12-27 20:17:44,708][106226] Updated weights for policy 0, policy_version 148369 (0.0005) [2023-12-27 20:17:44,732][106225] Updated weights for policy 1, policy_version 148545 (0.0009) [2023-12-27 20:17:44,771][106226] Updated weights for policy 0, policy_version 148379 (0.0010) [2023-12-27 20:17:44,819][106225] Updated weights for policy 1, policy_version 148555 (0.0010) [2023-12-27 20:17:44,880][106225] Updated weights for policy 1, policy_version 148565 (0.0010) [2023-12-27 20:17:44,940][106225] Updated weights for policy 1, policy_version 148575 (0.0006) [2023-12-27 20:17:45,431][106226] Updated weights for policy 0, policy_version 148389 (0.0011) [2023-12-27 20:17:45,477][106226] Updated weights for policy 0, policy_version 148399 (0.0010) [2023-12-27 20:17:45,523][106226] Updated weights for policy 0, policy_version 148409 (0.0010) [2023-12-27 20:17:45,643][106225] Updated weights for policy 1, policy_version 148585 (0.0008) [2023-12-27 20:17:45,695][106225] Updated weights for policy 1, policy_version 148595 (0.0009) [2023-12-27 20:17:45,741][106225] Updated weights for policy 1, policy_version 148605 (0.0010) [2023-12-27 20:17:46,157][106226] Updated weights for policy 0, policy_version 148419 (0.0011) [2023-12-27 20:17:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 76054528. Throughput: 0: 9797.2, 1: 10155.8. Samples: 76046428. Policy #0 lag: (min: 6.0, avg: 11.2, max: 38.0) [2023-12-27 20:17:46,176][105115] Avg episode reward: [(0, '-5.211'), (1, '-6.353')] [2023-12-27 20:17:46,221][106226] Updated weights for policy 0, policy_version 148429 (0.0010) [2023-12-27 20:17:46,280][106226] Updated weights for policy 0, policy_version 148439 (0.0010) [2023-12-27 20:17:46,413][106225] Updated weights for policy 1, policy_version 148615 (0.0010) [2023-12-27 20:17:46,467][106225] Updated weights for policy 1, policy_version 148625 (0.0010) [2023-12-27 20:17:46,513][106225] Updated weights for policy 1, policy_version 148635 (0.0010) [2023-12-27 20:17:46,946][106226] Updated weights for policy 0, policy_version 148449 (0.0010) [2023-12-27 20:17:46,998][106226] Updated weights for policy 0, policy_version 148459 (0.0007) [2023-12-27 20:17:47,042][106226] Updated weights for policy 0, policy_version 148469 (0.0006) [2023-12-27 20:17:47,090][106226] Updated weights for policy 0, policy_version 148479 (0.0005) [2023-12-27 20:17:47,193][106225] Updated weights for policy 1, policy_version 148645 (0.0008) [2023-12-27 20:17:47,250][106225] Updated weights for policy 1, policy_version 148655 (0.0006) [2023-12-27 20:17:47,299][106225] Updated weights for policy 1, policy_version 148665 (0.0005) [2023-12-27 20:17:47,841][106226] Updated weights for policy 0, policy_version 148489 (0.0005) [2023-12-27 20:17:47,901][106226] Updated weights for policy 0, policy_version 148499 (0.0007) [2023-12-27 20:17:47,948][106225] Updated weights for policy 1, policy_version 148675 (0.0007) [2023-12-27 20:17:47,961][106226] Updated weights for policy 0, policy_version 148509 (0.0008) [2023-12-27 20:17:48,015][106225] Updated weights for policy 1, policy_version 148685 (0.0010) [2023-12-27 20:17:48,078][106225] Updated weights for policy 1, policy_version 148695 (0.0010) [2023-12-27 20:17:48,575][106226] Updated weights for policy 0, policy_version 148519 (0.0010) [2023-12-27 20:17:48,637][106226] Updated weights for policy 0, policy_version 148529 (0.0009) [2023-12-27 20:17:48,684][106225] Updated weights for policy 1, policy_version 148705 (0.0010) [2023-12-27 20:17:48,705][106226] Updated weights for policy 0, policy_version 148539 (0.0006) [2023-12-27 20:17:48,738][106225] Updated weights for policy 1, policy_version 148715 (0.0009) [2023-12-27 20:17:48,801][106225] Updated weights for policy 1, policy_version 148726 (0.0011) [2023-12-27 20:17:48,854][106225] Updated weights for policy 1, policy_version 148736 (0.0009) [2023-12-27 20:17:49,268][106226] Updated weights for policy 0, policy_version 148549 (0.0007) [2023-12-27 20:17:49,336][106226] Updated weights for policy 0, policy_version 148559 (0.0010) [2023-12-27 20:17:49,393][106226] Updated weights for policy 0, policy_version 148569 (0.0009) [2023-12-27 20:17:49,551][106225] Updated weights for policy 1, policy_version 148746 (0.0005) [2023-12-27 20:17:49,617][106225] Updated weights for policy 1, policy_version 148756 (0.0005) [2023-12-27 20:17:49,681][106225] Updated weights for policy 1, policy_version 148766 (0.0006) [2023-12-27 20:17:50,232][106226] Updated weights for policy 0, policy_version 148579 (0.0009) [2023-12-27 20:17:50,282][106225] Updated weights for policy 1, policy_version 148776 (0.0006) [2023-12-27 20:17:50,294][106226] Updated weights for policy 0, policy_version 148589 (0.0008) [2023-12-27 20:17:50,344][106225] Updated weights for policy 1, policy_version 148786 (0.0010) [2023-12-27 20:17:50,351][106226] Updated weights for policy 0, policy_version 148599 (0.0007) [2023-12-27 20:17:50,401][106225] Updated weights for policy 1, policy_version 148796 (0.0010) [2023-12-27 20:17:51,047][106226] Updated weights for policy 0, policy_version 148609 (0.0006) [2023-12-27 20:17:51,064][106225] Updated weights for policy 1, policy_version 148806 (0.0008) [2023-12-27 20:17:51,105][106226] Updated weights for policy 0, policy_version 148619 (0.0009) [2023-12-27 20:17:51,121][106225] Updated weights for policy 1, policy_version 148816 (0.0009) [2023-12-27 20:17:51,165][106226] Updated weights for policy 0, policy_version 148629 (0.0009) [2023-12-27 20:17:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 76152832. Throughput: 0: 9844.2, 1: 10130.9. Samples: 76170248. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:17:51,175][105115] Avg episode reward: [(0, '-5.001'), (1, '-6.336')] [2023-12-27 20:17:51,184][106225] Updated weights for policy 1, policy_version 148826 (0.0008) [2023-12-27 20:17:51,236][106226] Updated weights for policy 0, policy_version 148639 (0.0008) [2023-12-27 20:17:51,921][106225] Updated weights for policy 1, policy_version 148836 (0.0008) [2023-12-27 20:17:51,983][106225] Updated weights for policy 1, policy_version 148846 (0.0009) [2023-12-27 20:17:52,036][106225] Updated weights for policy 1, policy_version 148856 (0.0008) [2023-12-27 20:17:52,069][106226] Updated weights for policy 0, policy_version 148649 (0.0008) [2023-12-27 20:17:52,133][106226] Updated weights for policy 0, policy_version 148659 (0.0008) [2023-12-27 20:17:52,184][106226] Updated weights for policy 0, policy_version 148669 (0.0008) [2023-12-27 20:17:52,751][106225] Updated weights for policy 1, policy_version 148866 (0.0008) [2023-12-27 20:17:52,806][106225] Updated weights for policy 1, policy_version 148876 (0.0009) [2023-12-27 20:17:52,858][106225] Updated weights for policy 1, policy_version 148886 (0.0009) [2023-12-27 20:17:52,884][106226] Updated weights for policy 0, policy_version 148679 (0.0007) [2023-12-27 20:17:52,912][106225] Updated weights for policy 1, policy_version 148896 (0.0008) [2023-12-27 20:17:52,935][106226] Updated weights for policy 0, policy_version 148689 (0.0005) [2023-12-27 20:17:52,979][106226] Updated weights for policy 0, policy_version 148699 (0.0005) [2023-12-27 20:17:53,618][106225] Updated weights for policy 1, policy_version 148906 (0.0010) [2023-12-27 20:17:53,661][106226] Updated weights for policy 0, policy_version 148709 (0.0008) [2023-12-27 20:17:53,668][106225] Updated weights for policy 1, policy_version 148916 (0.0010) [2023-12-27 20:17:53,713][106226] Updated weights for policy 0, policy_version 148719 (0.0009) [2023-12-27 20:17:53,716][106225] Updated weights for policy 1, policy_version 148926 (0.0009) [2023-12-27 20:17:53,766][106226] Updated weights for policy 0, policy_version 148729 (0.0010) [2023-12-27 20:17:54,384][106225] Updated weights for policy 1, policy_version 148936 (0.0009) [2023-12-27 20:17:54,448][106225] Updated weights for policy 1, policy_version 148946 (0.0008) [2023-12-27 20:17:54,497][106225] Updated weights for policy 1, policy_version 148956 (0.0005) [2023-12-27 20:17:54,533][106226] Updated weights for policy 0, policy_version 148739 (0.0009) [2023-12-27 20:17:54,586][106226] Updated weights for policy 0, policy_version 148749 (0.0009) [2023-12-27 20:17:54,646][106226] Updated weights for policy 0, policy_version 148759 (0.0008) [2023-12-27 20:17:55,140][106225] Updated weights for policy 1, policy_version 148966 (0.0007) [2023-12-27 20:17:55,198][106225] Updated weights for policy 1, policy_version 148976 (0.0010) [2023-12-27 20:17:55,248][106225] Updated weights for policy 1, policy_version 148986 (0.0010) [2023-12-27 20:17:55,404][106226] Updated weights for policy 0, policy_version 148769 (0.0008) [2023-12-27 20:17:55,467][106226] Updated weights for policy 0, policy_version 148779 (0.0008) [2023-12-27 20:17:55,532][106226] Updated weights for policy 0, policy_version 148789 (0.0008) [2023-12-27 20:17:55,597][106226] Updated weights for policy 0, policy_version 148799 (0.0008) [2023-12-27 20:17:55,985][106225] Updated weights for policy 1, policy_version 148996 (0.0010) [2023-12-27 20:17:56,038][106225] Updated weights for policy 1, policy_version 149006 (0.0010) [2023-12-27 20:17:56,098][106225] Updated weights for policy 1, policy_version 149016 (0.0010) [2023-12-27 20:17:56,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 76259328. Throughput: 0: 9803.6, 1: 10084.4. Samples: 76227880. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:17:56,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-6.319')] [2023-12-27 20:17:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000149024_38158336.pth... [2023-12-27 20:17:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000148800_38100992.pth... [2023-12-27 20:17:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000147648_37806080.pth [2023-12-27 20:17:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000147840_37855232.pth [2023-12-27 20:17:56,253][106226] Updated weights for policy 0, policy_version 148809 (0.0008) [2023-12-27 20:17:56,310][106226] Updated weights for policy 0, policy_version 148819 (0.0007) [2023-12-27 20:17:56,368][106226] Updated weights for policy 0, policy_version 148829 (0.0007) [2023-12-27 20:17:56,767][106225] Updated weights for policy 1, policy_version 149026 (0.0008) [2023-12-27 20:17:56,822][106225] Updated weights for policy 1, policy_version 149036 (0.0005) [2023-12-27 20:17:56,867][106225] Updated weights for policy 1, policy_version 149046 (0.0005) [2023-12-27 20:17:56,913][106225] Updated weights for policy 1, policy_version 149056 (0.0005) [2023-12-27 20:17:57,156][106226] Updated weights for policy 0, policy_version 148839 (0.0010) [2023-12-27 20:17:57,222][106226] Updated weights for policy 0, policy_version 148849 (0.0009) [2023-12-27 20:17:57,284][106226] Updated weights for policy 0, policy_version 148859 (0.0008) [2023-12-27 20:17:57,467][106225] Updated weights for policy 1, policy_version 149066 (0.0010) [2023-12-27 20:17:57,518][106225] Updated weights for policy 1, policy_version 149076 (0.0006) [2023-12-27 20:17:57,568][106225] Updated weights for policy 1, policy_version 149086 (0.0005) [2023-12-27 20:17:57,974][106226] Updated weights for policy 0, policy_version 148869 (0.0007) [2023-12-27 20:17:58,041][106226] Updated weights for policy 0, policy_version 148879 (0.0006) [2023-12-27 20:17:58,098][106226] Updated weights for policy 0, policy_version 148889 (0.0005) [2023-12-27 20:17:58,115][106225] Updated weights for policy 1, policy_version 149096 (0.0009) [2023-12-27 20:17:58,173][106225] Updated weights for policy 1, policy_version 149106 (0.0010) [2023-12-27 20:17:58,248][106225] Updated weights for policy 1, policy_version 149116 (0.0010) [2023-12-27 20:17:58,791][106226] Updated weights for policy 0, policy_version 148899 (0.0007) [2023-12-27 20:17:58,865][106226] Updated weights for policy 0, policy_version 148909 (0.0008) [2023-12-27 20:17:58,931][106226] Updated weights for policy 0, policy_version 148919 (0.0007) [2023-12-27 20:17:59,106][106225] Updated weights for policy 1, policy_version 149126 (0.0009) [2023-12-27 20:17:59,169][106225] Updated weights for policy 1, policy_version 149136 (0.0008) [2023-12-27 20:17:59,242][106225] Updated weights for policy 1, policy_version 149146 (0.0008) [2023-12-27 20:17:59,655][106226] Updated weights for policy 0, policy_version 148929 (0.0006) [2023-12-27 20:17:59,717][106226] Updated weights for policy 0, policy_version 148939 (0.0005) [2023-12-27 20:17:59,781][106226] Updated weights for policy 0, policy_version 148949 (0.0008) [2023-12-27 20:17:59,846][106226] Updated weights for policy 0, policy_version 148959 (0.0008) [2023-12-27 20:17:59,939][106225] Updated weights for policy 1, policy_version 149156 (0.0008) [2023-12-27 20:18:00,003][106225] Updated weights for policy 1, policy_version 149166 (0.0006) [2023-12-27 20:18:00,069][106225] Updated weights for policy 1, policy_version 149176 (0.0005) [2023-12-27 20:18:00,543][106226] Updated weights for policy 0, policy_version 148969 (0.0008) [2023-12-27 20:18:00,611][106226] Updated weights for policy 0, policy_version 148979 (0.0009) [2023-12-27 20:18:00,680][106226] Updated weights for policy 0, policy_version 148989 (0.0007) [2023-12-27 20:18:00,692][106225] Updated weights for policy 1, policy_version 149186 (0.0008) [2023-12-27 20:18:00,745][106225] Updated weights for policy 1, policy_version 149196 (0.0005) [2023-12-27 20:18:00,808][106225] Updated weights for policy 1, policy_version 149206 (0.0008) [2023-12-27 20:18:00,871][106225] Updated weights for policy 1, policy_version 149216 (0.0009) [2023-12-27 20:18:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 76357632. Throughput: 0: 9867.2, 1: 10115.6. Samples: 76347592. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:01,175][105115] Avg episode reward: [(0, '-5.291'), (1, '-6.658')] [2023-12-27 20:18:01,467][106226] Updated weights for policy 0, policy_version 148999 (0.0009) [2023-12-27 20:18:01,518][106226] Updated weights for policy 0, policy_version 149009 (0.0008) [2023-12-27 20:18:01,579][106225] Updated weights for policy 1, policy_version 149226 (0.0008) [2023-12-27 20:18:01,580][106226] Updated weights for policy 0, policy_version 149019 (0.0006) [2023-12-27 20:18:01,644][106225] Updated weights for policy 1, policy_version 149236 (0.0008) [2023-12-27 20:18:01,709][106225] Updated weights for policy 1, policy_version 149246 (0.0009) [2023-12-27 20:18:02,404][106225] Updated weights for policy 1, policy_version 149256 (0.0008) [2023-12-27 20:18:02,422][106226] Updated weights for policy 0, policy_version 149029 (0.0006) [2023-12-27 20:18:02,466][106225] Updated weights for policy 1, policy_version 149266 (0.0009) [2023-12-27 20:18:02,473][106226] Updated weights for policy 0, policy_version 149039 (0.0006) [2023-12-27 20:18:02,524][106225] Updated weights for policy 1, policy_version 149276 (0.0007) [2023-12-27 20:18:02,526][106226] Updated weights for policy 0, policy_version 149049 (0.0007) [2023-12-27 20:18:03,121][106225] Updated weights for policy 1, policy_version 149286 (0.0005) [2023-12-27 20:18:03,166][106225] Updated weights for policy 1, policy_version 149296 (0.0005) [2023-12-27 20:18:03,218][106225] Updated weights for policy 1, policy_version 149306 (0.0006) [2023-12-27 20:18:03,325][106226] Updated weights for policy 0, policy_version 149059 (0.0008) [2023-12-27 20:18:03,373][106226] Updated weights for policy 0, policy_version 149069 (0.0008) [2023-12-27 20:18:03,420][106226] Updated weights for policy 0, policy_version 149079 (0.0008) [2023-12-27 20:18:03,763][106225] Updated weights for policy 1, policy_version 149316 (0.0006) [2023-12-27 20:18:03,811][106225] Updated weights for policy 1, policy_version 149326 (0.0007) [2023-12-27 20:18:03,873][106225] Updated weights for policy 1, policy_version 149336 (0.0007) [2023-12-27 20:18:04,191][106226] Updated weights for policy 0, policy_version 149089 (0.0008) [2023-12-27 20:18:04,250][106226] Updated weights for policy 0, policy_version 149099 (0.0008) [2023-12-27 20:18:04,297][106226] Updated weights for policy 0, policy_version 149109 (0.0007) [2023-12-27 20:18:04,348][106226] Updated weights for policy 0, policy_version 149119 (0.0008) [2023-12-27 20:18:04,596][106225] Updated weights for policy 1, policy_version 149346 (0.0010) [2023-12-27 20:18:04,652][106225] Updated weights for policy 1, policy_version 149356 (0.0010) [2023-12-27 20:18:04,715][106225] Updated weights for policy 1, policy_version 149366 (0.0010) [2023-12-27 20:18:04,774][106225] Updated weights for policy 1, policy_version 149376 (0.0008) [2023-12-27 20:18:05,156][106226] Updated weights for policy 0, policy_version 149129 (0.0008) [2023-12-27 20:18:05,213][106226] Updated weights for policy 0, policy_version 149139 (0.0008) [2023-12-27 20:18:05,270][106226] Updated weights for policy 0, policy_version 149149 (0.0008) [2023-12-27 20:18:05,393][106225] Updated weights for policy 1, policy_version 149386 (0.0005) [2023-12-27 20:18:05,451][106225] Updated weights for policy 1, policy_version 149396 (0.0009) [2023-12-27 20:18:05,514][106225] Updated weights for policy 1, policy_version 149406 (0.0010) [2023-12-27 20:18:05,986][106226] Updated weights for policy 0, policy_version 149159 (0.0009) [2023-12-27 20:18:06,043][106226] Updated weights for policy 0, policy_version 149169 (0.0009) [2023-12-27 20:18:06,094][106226] Updated weights for policy 0, policy_version 149179 (0.0008) [2023-12-27 20:18:06,162][106225] Updated weights for policy 1, policy_version 149416 (0.0010) [2023-12-27 20:18:06,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 76455936. Throughput: 0: 9788.9, 1: 10177.1. Samples: 76465712. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:06,175][105115] Avg episode reward: [(0, '-5.114'), (1, '-6.799')] [2023-12-27 20:18:06,226][106225] Updated weights for policy 1, policy_version 149426 (0.0009) [2023-12-27 20:18:06,289][106225] Updated weights for policy 1, policy_version 149436 (0.0009) [2023-12-27 20:18:06,904][106226] Updated weights for policy 0, policy_version 149189 (0.0009) [2023-12-27 20:18:06,943][106225] Updated weights for policy 1, policy_version 149446 (0.0009) [2023-12-27 20:18:06,965][106226] Updated weights for policy 0, policy_version 149199 (0.0008) [2023-12-27 20:18:07,001][106225] Updated weights for policy 1, policy_version 149456 (0.0010) [2023-12-27 20:18:07,022][106226] Updated weights for policy 0, policy_version 149209 (0.0006) [2023-12-27 20:18:07,065][106225] Updated weights for policy 1, policy_version 149466 (0.0006) [2023-12-27 20:18:07,630][106225] Updated weights for policy 1, policy_version 149476 (0.0005) [2023-12-27 20:18:07,681][106225] Updated weights for policy 1, policy_version 149486 (0.0005) [2023-12-27 20:18:07,737][106225] Updated weights for policy 1, policy_version 149496 (0.0005) [2023-12-27 20:18:07,844][106226] Updated weights for policy 0, policy_version 149219 (0.0008) [2023-12-27 20:18:07,893][106226] Updated weights for policy 0, policy_version 149229 (0.0008) [2023-12-27 20:18:07,945][106226] Updated weights for policy 0, policy_version 149239 (0.0009) [2023-12-27 20:18:08,292][106225] Updated weights for policy 1, policy_version 149506 (0.0006) [2023-12-27 20:18:08,363][106225] Updated weights for policy 1, policy_version 149516 (0.0009) [2023-12-27 20:18:08,422][106225] Updated weights for policy 1, policy_version 149526 (0.0006) [2023-12-27 20:18:08,488][106225] Updated weights for policy 1, policy_version 149536 (0.0005) [2023-12-27 20:18:08,756][106226] Updated weights for policy 0, policy_version 149249 (0.0010) [2023-12-27 20:18:08,820][106226] Updated weights for policy 0, policy_version 149259 (0.0010) [2023-12-27 20:18:08,883][106226] Updated weights for policy 0, policy_version 149269 (0.0008) [2023-12-27 20:18:08,949][106226] Updated weights for policy 0, policy_version 149279 (0.0008) [2023-12-27 20:18:09,151][106225] Updated weights for policy 1, policy_version 149546 (0.0007) [2023-12-27 20:18:09,218][106225] Updated weights for policy 1, policy_version 149556 (0.0008) [2023-12-27 20:18:09,280][106225] Updated weights for policy 1, policy_version 149566 (0.0008) [2023-12-27 20:18:09,739][106226] Updated weights for policy 0, policy_version 149289 (0.0010) [2023-12-27 20:18:09,808][106226] Updated weights for policy 0, policy_version 149299 (0.0010) [2023-12-27 20:18:09,880][106226] Updated weights for policy 0, policy_version 149309 (0.0008) [2023-12-27 20:18:10,036][106225] Updated weights for policy 1, policy_version 149576 (0.0006) [2023-12-27 20:18:10,095][106225] Updated weights for policy 1, policy_version 149586 (0.0007) [2023-12-27 20:18:10,150][106225] Updated weights for policy 1, policy_version 149596 (0.0008) [2023-12-27 20:18:10,490][106226] Updated weights for policy 0, policy_version 149319 (0.0008) [2023-12-27 20:18:10,554][106226] Updated weights for policy 0, policy_version 149329 (0.0011) [2023-12-27 20:18:10,619][106226] Updated weights for policy 0, policy_version 149339 (0.0007) [2023-12-27 20:18:10,883][106225] Updated weights for policy 1, policy_version 149606 (0.0010) [2023-12-27 20:18:10,945][106225] Updated weights for policy 1, policy_version 149616 (0.0005) [2023-12-27 20:18:11,001][106225] Updated weights for policy 1, policy_version 149626 (0.0005) [2023-12-27 20:18:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19934.2, 300 sec: 19855.2). Total num frames: 76554240. Throughput: 0: 9753.6, 1: 10275.5. Samples: 76525720. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:11,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-6.456')] [2023-12-27 20:18:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000149632_38313984.pth... [2023-12-27 20:18:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000149344_38240256.pth... [2023-12-27 20:18:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000148416_38002688.pth [2023-12-27 20:18:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000148224_37953536.pth [2023-12-27 20:18:11,327][106226] Updated weights for policy 0, policy_version 149349 (0.0008) [2023-12-27 20:18:11,405][106226] Updated weights for policy 0, policy_version 149359 (0.0009) [2023-12-27 20:18:11,468][106226] Updated weights for policy 0, policy_version 149369 (0.0007) [2023-12-27 20:18:11,772][106225] Updated weights for policy 1, policy_version 149636 (0.0007) [2023-12-27 20:18:11,828][106225] Updated weights for policy 1, policy_version 149646 (0.0007) [2023-12-27 20:18:11,887][106225] Updated weights for policy 1, policy_version 149656 (0.0009) [2023-12-27 20:18:12,218][106226] Updated weights for policy 0, policy_version 149379 (0.0008) [2023-12-27 20:18:12,274][106226] Updated weights for policy 0, policy_version 149389 (0.0009) [2023-12-27 20:18:12,337][106226] Updated weights for policy 0, policy_version 149399 (0.0009) [2023-12-27 20:18:12,517][106225] Updated weights for policy 1, policy_version 149666 (0.0007) [2023-12-27 20:18:12,574][106225] Updated weights for policy 1, policy_version 149676 (0.0006) [2023-12-27 20:18:12,631][106225] Updated weights for policy 1, policy_version 149686 (0.0009) [2023-12-27 20:18:12,687][106225] Updated weights for policy 1, policy_version 149696 (0.0009) [2023-12-27 20:18:13,091][106226] Updated weights for policy 0, policy_version 149409 (0.0010) [2023-12-27 20:18:13,153][106226] Updated weights for policy 0, policy_version 149419 (0.0011) [2023-12-27 20:18:13,210][106226] Updated weights for policy 0, policy_version 149429 (0.0010) [2023-12-27 20:18:13,266][106226] Updated weights for policy 0, policy_version 149439 (0.0010) [2023-12-27 20:18:13,366][106225] Updated weights for policy 1, policy_version 149706 (0.0008) [2023-12-27 20:18:13,430][106225] Updated weights for policy 1, policy_version 149716 (0.0008) [2023-12-27 20:18:13,492][106225] Updated weights for policy 1, policy_version 149726 (0.0008) [2023-12-27 20:18:13,949][106226] Updated weights for policy 0, policy_version 149449 (0.0006) [2023-12-27 20:18:14,003][106226] Updated weights for policy 0, policy_version 149459 (0.0005) [2023-12-27 20:18:14,057][106226] Updated weights for policy 0, policy_version 149469 (0.0009) [2023-12-27 20:18:14,206][106225] Updated weights for policy 1, policy_version 149736 (0.0008) [2023-12-27 20:18:14,263][106225] Updated weights for policy 1, policy_version 149746 (0.0009) [2023-12-27 20:18:14,324][106225] Updated weights for policy 1, policy_version 149756 (0.0008) [2023-12-27 20:18:14,641][106226] Updated weights for policy 0, policy_version 149479 (0.0008) [2023-12-27 20:18:14,696][106226] Updated weights for policy 0, policy_version 149489 (0.0010) [2023-12-27 20:18:14,756][106226] Updated weights for policy 0, policy_version 149499 (0.0006) [2023-12-27 20:18:15,091][106225] Updated weights for policy 1, policy_version 149766 (0.0010) [2023-12-27 20:18:15,153][106225] Updated weights for policy 1, policy_version 149776 (0.0007) [2023-12-27 20:18:15,215][106225] Updated weights for policy 1, policy_version 149786 (0.0008) [2023-12-27 20:18:15,468][106226] Updated weights for policy 0, policy_version 149509 (0.0009) [2023-12-27 20:18:15,536][106226] Updated weights for policy 0, policy_version 149519 (0.0007) [2023-12-27 20:18:15,585][106226] Updated weights for policy 0, policy_version 149529 (0.0010) [2023-12-27 20:18:15,851][106225] Updated weights for policy 1, policy_version 149796 (0.0008) [2023-12-27 20:18:15,913][106225] Updated weights for policy 1, policy_version 149806 (0.0007) [2023-12-27 20:18:15,975][106225] Updated weights for policy 1, policy_version 149816 (0.0010) [2023-12-27 20:18:16,167][106226] Updated weights for policy 0, policy_version 149539 (0.0007) [2023-12-27 20:18:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 76652544. Throughput: 0: 9731.7, 1: 10198.7. Samples: 76642104. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:16,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-7.050')] [2023-12-27 20:18:16,225][106226] Updated weights for policy 0, policy_version 149549 (0.0008) [2023-12-27 20:18:16,278][106226] Updated weights for policy 0, policy_version 149559 (0.0008) [2023-12-27 20:18:16,582][106225] Updated weights for policy 1, policy_version 149826 (0.0010) [2023-12-27 20:18:16,641][106225] Updated weights for policy 1, policy_version 149836 (0.0010) [2023-12-27 20:18:16,703][106225] Updated weights for policy 1, policy_version 149846 (0.0010) [2023-12-27 20:18:16,767][106225] Updated weights for policy 1, policy_version 149856 (0.0010) [2023-12-27 20:18:17,054][106226] Updated weights for policy 0, policy_version 149569 (0.0009) [2023-12-27 20:18:17,118][106226] Updated weights for policy 0, policy_version 149579 (0.0008) [2023-12-27 20:18:17,179][106226] Updated weights for policy 0, policy_version 149589 (0.0008) [2023-12-27 20:18:17,239][106226] Updated weights for policy 0, policy_version 149599 (0.0007) [2023-12-27 20:18:17,387][106225] Updated weights for policy 1, policy_version 149866 (0.0006) [2023-12-27 20:18:17,445][106225] Updated weights for policy 1, policy_version 149876 (0.0005) [2023-12-27 20:18:17,501][106225] Updated weights for policy 1, policy_version 149886 (0.0005) [2023-12-27 20:18:17,977][106226] Updated weights for policy 0, policy_version 149609 (0.0007) [2023-12-27 20:18:18,028][106225] Updated weights for policy 1, policy_version 149896 (0.0007) [2023-12-27 20:18:18,038][106226] Updated weights for policy 0, policy_version 149619 (0.0006) [2023-12-27 20:18:18,091][106225] Updated weights for policy 1, policy_version 149906 (0.0008) [2023-12-27 20:18:18,103][106226] Updated weights for policy 0, policy_version 149629 (0.0006) [2023-12-27 20:18:18,161][106225] Updated weights for policy 1, policy_version 149916 (0.0010) [2023-12-27 20:18:18,756][106226] Updated weights for policy 0, policy_version 149639 (0.0007) [2023-12-27 20:18:18,811][106226] Updated weights for policy 0, policy_version 149649 (0.0009) [2023-12-27 20:18:18,842][106225] Updated weights for policy 1, policy_version 149926 (0.0007) [2023-12-27 20:18:18,869][106226] Updated weights for policy 0, policy_version 149659 (0.0008) [2023-12-27 20:18:18,894][106225] Updated weights for policy 1, policy_version 149936 (0.0005) [2023-12-27 20:18:18,947][106225] Updated weights for policy 1, policy_version 149946 (0.0005) [2023-12-27 20:18:19,604][106226] Updated weights for policy 0, policy_version 149669 (0.0009) [2023-12-27 20:18:19,627][106225] Updated weights for policy 1, policy_version 149956 (0.0006) [2023-12-27 20:18:19,667][106226] Updated weights for policy 0, policy_version 149679 (0.0008) [2023-12-27 20:18:19,680][106225] Updated weights for policy 1, policy_version 149966 (0.0006) [2023-12-27 20:18:19,725][106226] Updated weights for policy 0, policy_version 149689 (0.0008) [2023-12-27 20:18:19,747][106225] Updated weights for policy 1, policy_version 149976 (0.0007) [2023-12-27 20:18:20,450][106225] Updated weights for policy 1, policy_version 149986 (0.0010) [2023-12-27 20:18:20,491][106226] Updated weights for policy 0, policy_version 149699 (0.0007) [2023-12-27 20:18:20,505][106225] Updated weights for policy 1, policy_version 149996 (0.0010) [2023-12-27 20:18:20,547][106226] Updated weights for policy 0, policy_version 149709 (0.0011) [2023-12-27 20:18:20,565][106225] Updated weights for policy 1, policy_version 150006 (0.0010) [2023-12-27 20:18:20,611][106226] Updated weights for policy 0, policy_version 149719 (0.0011) [2023-12-27 20:18:20,624][106225] Updated weights for policy 1, policy_version 150016 (0.0009) [2023-12-27 20:18:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 76750848. Throughput: 0: 9663.8, 1: 10256.1. Samples: 76763504. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:21,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-6.748')] [2023-12-27 20:18:21,398][106226] Updated weights for policy 0, policy_version 149729 (0.0010) [2023-12-27 20:18:21,404][106225] Updated weights for policy 1, policy_version 150026 (0.0008) [2023-12-27 20:18:21,462][106226] Updated weights for policy 0, policy_version 149739 (0.0008) [2023-12-27 20:18:21,466][106225] Updated weights for policy 1, policy_version 150036 (0.0007) [2023-12-27 20:18:21,517][106226] Updated weights for policy 0, policy_version 149749 (0.0008) [2023-12-27 20:18:21,529][106225] Updated weights for policy 1, policy_version 150046 (0.0007) [2023-12-27 20:18:21,584][106226] Updated weights for policy 0, policy_version 149759 (0.0008) [2023-12-27 20:18:22,250][106225] Updated weights for policy 1, policy_version 150056 (0.0010) [2023-12-27 20:18:22,326][106225] Updated weights for policy 1, policy_version 150066 (0.0011) [2023-12-27 20:18:22,356][106226] Updated weights for policy 0, policy_version 149769 (0.0008) [2023-12-27 20:18:22,402][106225] Updated weights for policy 1, policy_version 150076 (0.0012) [2023-12-27 20:18:22,429][106226] Updated weights for policy 0, policy_version 149779 (0.0007) [2023-12-27 20:18:22,501][106226] Updated weights for policy 0, policy_version 149789 (0.0007) [2023-12-27 20:18:23,138][106226] Updated weights for policy 0, policy_version 149799 (0.0006) [2023-12-27 20:18:23,158][106225] Updated weights for policy 1, policy_version 150086 (0.0007) [2023-12-27 20:18:23,199][106226] Updated weights for policy 0, policy_version 149809 (0.0007) [2023-12-27 20:18:23,220][106225] Updated weights for policy 1, policy_version 150096 (0.0007) [2023-12-27 20:18:23,253][106226] Updated weights for policy 0, policy_version 149819 (0.0010) [2023-12-27 20:18:23,279][106225] Updated weights for policy 1, policy_version 150106 (0.0005) [2023-12-27 20:18:23,931][106226] Updated weights for policy 0, policy_version 149829 (0.0008) [2023-12-27 20:18:23,977][106226] Updated weights for policy 0, policy_version 149839 (0.0008) [2023-12-27 20:18:23,992][106225] Updated weights for policy 1, policy_version 150116 (0.0006) [2023-12-27 20:18:24,025][106226] Updated weights for policy 0, policy_version 149849 (0.0008) [2023-12-27 20:18:24,048][106225] Updated weights for policy 1, policy_version 150126 (0.0005) [2023-12-27 20:18:24,098][106225] Updated weights for policy 1, policy_version 150136 (0.0005) [2023-12-27 20:18:24,643][106225] Updated weights for policy 1, policy_version 150146 (0.0006) [2023-12-27 20:18:24,692][106225] Updated weights for policy 1, policy_version 150156 (0.0009) [2023-12-27 20:18:24,739][106225] Updated weights for policy 1, policy_version 150166 (0.0008) [2023-12-27 20:18:24,800][106225] Updated weights for policy 1, policy_version 150176 (0.0008) [2023-12-27 20:18:24,802][106226] Updated weights for policy 0, policy_version 149859 (0.0008) [2023-12-27 20:18:24,865][106226] Updated weights for policy 0, policy_version 149869 (0.0009) [2023-12-27 20:18:24,925][106226] Updated weights for policy 0, policy_version 149879 (0.0008) [2023-12-27 20:18:25,445][106225] Updated weights for policy 1, policy_version 150186 (0.0008) [2023-12-27 20:18:25,499][106225] Updated weights for policy 1, policy_version 150196 (0.0008) [2023-12-27 20:18:25,547][106225] Updated weights for policy 1, policy_version 150206 (0.0008) [2023-12-27 20:18:25,702][106226] Updated weights for policy 0, policy_version 149889 (0.0009) [2023-12-27 20:18:25,763][106226] Updated weights for policy 0, policy_version 149899 (0.0006) [2023-12-27 20:18:25,815][106226] Updated weights for policy 0, policy_version 149909 (0.0008) [2023-12-27 20:18:25,875][106226] Updated weights for policy 0, policy_version 149919 (0.0009) [2023-12-27 20:18:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 76849152. Throughput: 0: 9592.9, 1: 10190.3. Samples: 76819624. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:26,176][105115] Avg episode reward: [(0, '-5.056'), (1, '-6.383')] [2023-12-27 20:18:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000149920_38387712.pth... [2023-12-27 20:18:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000150208_38461440.pth... [2023-12-27 20:18:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000148800_38100992.pth [2023-12-27 20:18:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000149024_38158336.pth [2023-12-27 20:18:26,293][106225] Updated weights for policy 1, policy_version 150216 (0.0008) [2023-12-27 20:18:26,352][106225] Updated weights for policy 1, policy_version 150226 (0.0008) [2023-12-27 20:18:26,404][106225] Updated weights for policy 1, policy_version 150236 (0.0009) [2023-12-27 20:18:26,582][106226] Updated weights for policy 0, policy_version 149929 (0.0009) [2023-12-27 20:18:26,635][106226] Updated weights for policy 0, policy_version 149939 (0.0010) [2023-12-27 20:18:26,678][106226] Updated weights for policy 0, policy_version 149949 (0.0010) [2023-12-27 20:18:27,062][106225] Updated weights for policy 1, policy_version 150246 (0.0007) [2023-12-27 20:18:27,123][106225] Updated weights for policy 1, policy_version 150256 (0.0007) [2023-12-27 20:18:27,185][106225] Updated weights for policy 1, policy_version 150266 (0.0007) [2023-12-27 20:18:27,400][106226] Updated weights for policy 0, policy_version 149959 (0.0011) [2023-12-27 20:18:27,454][106226] Updated weights for policy 0, policy_version 149969 (0.0011) [2023-12-27 20:18:27,500][106226] Updated weights for policy 0, policy_version 149979 (0.0010) [2023-12-27 20:18:27,845][106225] Updated weights for policy 1, policy_version 150276 (0.0007) [2023-12-27 20:18:27,917][106225] Updated weights for policy 1, policy_version 150286 (0.0005) [2023-12-27 20:18:27,974][106225] Updated weights for policy 1, policy_version 150296 (0.0005) [2023-12-27 20:18:28,181][106226] Updated weights for policy 0, policy_version 149989 (0.0011) [2023-12-27 20:18:28,245][106226] Updated weights for policy 0, policy_version 149999 (0.0010) [2023-12-27 20:18:28,311][106226] Updated weights for policy 0, policy_version 150009 (0.0008) [2023-12-27 20:18:28,623][106225] Updated weights for policy 1, policy_version 150306 (0.0009) [2023-12-27 20:18:28,680][106225] Updated weights for policy 1, policy_version 150316 (0.0010) [2023-12-27 20:18:28,733][106225] Updated weights for policy 1, policy_version 150326 (0.0010) [2023-12-27 20:18:28,790][106225] Updated weights for policy 1, policy_version 150336 (0.0010) [2023-12-27 20:18:29,033][106226] Updated weights for policy 0, policy_version 150019 (0.0009) [2023-12-27 20:18:29,081][106226] Updated weights for policy 0, policy_version 150029 (0.0010) [2023-12-27 20:18:29,127][106226] Updated weights for policy 0, policy_version 150039 (0.0010) [2023-12-27 20:18:29,550][106225] Updated weights for policy 1, policy_version 150346 (0.0010) [2023-12-27 20:18:29,614][106225] Updated weights for policy 1, policy_version 150356 (0.0010) [2023-12-27 20:18:29,678][106225] Updated weights for policy 1, policy_version 150366 (0.0010) [2023-12-27 20:18:29,880][106226] Updated weights for policy 0, policy_version 150049 (0.0010) [2023-12-27 20:18:29,944][106226] Updated weights for policy 0, policy_version 150059 (0.0011) [2023-12-27 20:18:29,997][106226] Updated weights for policy 0, policy_version 150069 (0.0010) [2023-12-27 20:18:30,055][106226] Updated weights for policy 0, policy_version 150079 (0.0010) [2023-12-27 20:18:30,385][106225] Updated weights for policy 1, policy_version 150376 (0.0010) [2023-12-27 20:18:30,444][106225] Updated weights for policy 1, policy_version 150386 (0.0010) [2023-12-27 20:18:30,487][106225] Updated weights for policy 1, policy_version 150396 (0.0010) [2023-12-27 20:18:30,777][106226] Updated weights for policy 0, policy_version 150089 (0.0010) [2023-12-27 20:18:30,835][106226] Updated weights for policy 0, policy_version 150099 (0.0010) [2023-12-27 20:18:30,892][106226] Updated weights for policy 0, policy_version 150109 (0.0010) [2023-12-27 20:18:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 76947456. Throughput: 0: 9586.4, 1: 10259.3. Samples: 76939484. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:31,175][105115] Avg episode reward: [(0, '-5.243'), (1, '-6.500')] [2023-12-27 20:18:31,217][106225] Updated weights for policy 1, policy_version 150406 (0.0009) [2023-12-27 20:18:31,281][106225] Updated weights for policy 1, policy_version 150416 (0.0009) [2023-12-27 20:18:31,345][106225] Updated weights for policy 1, policy_version 150426 (0.0009) [2023-12-27 20:18:31,613][106226] Updated weights for policy 0, policy_version 150119 (0.0008) [2023-12-27 20:18:31,684][106226] Updated weights for policy 0, policy_version 150129 (0.0007) [2023-12-27 20:18:31,756][106226] Updated weights for policy 0, policy_version 150139 (0.0008) [2023-12-27 20:18:32,149][106225] Updated weights for policy 1, policy_version 150436 (0.0010) [2023-12-27 20:18:32,210][106225] Updated weights for policy 1, policy_version 150446 (0.0010) [2023-12-27 20:18:32,274][106225] Updated weights for policy 1, policy_version 150456 (0.0011) [2023-12-27 20:18:32,469][106226] Updated weights for policy 0, policy_version 150149 (0.0007) [2023-12-27 20:18:32,540][106226] Updated weights for policy 0, policy_version 150159 (0.0008) [2023-12-27 20:18:32,599][106226] Updated weights for policy 0, policy_version 150169 (0.0009) [2023-12-27 20:18:33,016][106225] Updated weights for policy 1, policy_version 150466 (0.0009) [2023-12-27 20:18:33,062][106225] Updated weights for policy 1, policy_version 150476 (0.0005) [2023-12-27 20:18:33,110][106225] Updated weights for policy 1, policy_version 150486 (0.0005) [2023-12-27 20:18:33,164][106225] Updated weights for policy 1, policy_version 150496 (0.0010) [2023-12-27 20:18:33,257][106226] Updated weights for policy 0, policy_version 150179 (0.0008) [2023-12-27 20:18:33,306][106226] Updated weights for policy 0, policy_version 150189 (0.0008) [2023-12-27 20:18:33,360][106226] Updated weights for policy 0, policy_version 150199 (0.0009) [2023-12-27 20:18:33,727][106225] Updated weights for policy 1, policy_version 150506 (0.0008) [2023-12-27 20:18:33,779][106225] Updated weights for policy 1, policy_version 150516 (0.0008) [2023-12-27 20:18:33,829][106225] Updated weights for policy 1, policy_version 150526 (0.0005) [2023-12-27 20:18:34,193][106226] Updated weights for policy 0, policy_version 150209 (0.0008) [2023-12-27 20:18:34,247][106226] Updated weights for policy 0, policy_version 150219 (0.0008) [2023-12-27 20:18:34,306][106226] Updated weights for policy 0, policy_version 150229 (0.0008) [2023-12-27 20:18:34,370][106226] Updated weights for policy 0, policy_version 150239 (0.0008) [2023-12-27 20:18:34,413][106225] Updated weights for policy 1, policy_version 150536 (0.0009) [2023-12-27 20:18:34,474][106225] Updated weights for policy 1, policy_version 150546 (0.0010) [2023-12-27 20:18:34,543][106225] Updated weights for policy 1, policy_version 150556 (0.0010) [2023-12-27 20:18:35,098][106226] Updated weights for policy 0, policy_version 150249 (0.0006) [2023-12-27 20:18:35,152][106226] Updated weights for policy 0, policy_version 150259 (0.0007) [2023-12-27 20:18:35,201][106226] Updated weights for policy 0, policy_version 150269 (0.0007) [2023-12-27 20:18:35,235][106225] Updated weights for policy 1, policy_version 150566 (0.0010) [2023-12-27 20:18:35,298][106225] Updated weights for policy 1, policy_version 150576 (0.0010) [2023-12-27 20:18:35,360][106225] Updated weights for policy 1, policy_version 150586 (0.0010) [2023-12-27 20:18:35,910][106226] Updated weights for policy 0, policy_version 150279 (0.0007) [2023-12-27 20:18:35,979][106226] Updated weights for policy 0, policy_version 150289 (0.0006) [2023-12-27 20:18:36,030][106225] Updated weights for policy 1, policy_version 150596 (0.0009) [2023-12-27 20:18:36,043][106226] Updated weights for policy 0, policy_version 150299 (0.0007) [2023-12-27 20:18:36,079][106225] Updated weights for policy 1, policy_version 150606 (0.0007) [2023-12-27 20:18:36,146][106225] Updated weights for policy 1, policy_version 150616 (0.0008) [2023-12-27 20:18:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 77045760. Throughput: 0: 9517.7, 1: 10196.2. Samples: 77057372. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:36,175][105115] Avg episode reward: [(0, '-5.138'), (1, '-5.960')] [2023-12-27 20:18:36,729][106226] Updated weights for policy 0, policy_version 150309 (0.0007) [2023-12-27 20:18:36,786][106226] Updated weights for policy 0, policy_version 150319 (0.0008) [2023-12-27 20:18:36,840][106226] Updated weights for policy 0, policy_version 150329 (0.0008) [2023-12-27 20:18:36,864][106225] Updated weights for policy 1, policy_version 150626 (0.0009) [2023-12-27 20:18:36,929][106225] Updated weights for policy 1, policy_version 150636 (0.0006) [2023-12-27 20:18:36,998][106225] Updated weights for policy 1, policy_version 150646 (0.0006) [2023-12-27 20:18:37,061][106225] Updated weights for policy 1, policy_version 150656 (0.0009) [2023-12-27 20:18:37,410][106226] Updated weights for policy 0, policy_version 150339 (0.0008) [2023-12-27 20:18:37,473][106226] Updated weights for policy 0, policy_version 150349 (0.0006) [2023-12-27 20:18:37,525][106226] Updated weights for policy 0, policy_version 150359 (0.0009) [2023-12-27 20:18:37,796][106225] Updated weights for policy 1, policy_version 150666 (0.0010) [2023-12-27 20:18:37,857][106225] Updated weights for policy 1, policy_version 150676 (0.0006) [2023-12-27 20:18:37,920][106225] Updated weights for policy 1, policy_version 150686 (0.0009) [2023-12-27 20:18:38,184][106226] Updated weights for policy 0, policy_version 150369 (0.0011) [2023-12-27 20:18:38,243][106226] Updated weights for policy 0, policy_version 150379 (0.0010) [2023-12-27 20:18:38,306][106226] Updated weights for policy 0, policy_version 150389 (0.0011) [2023-12-27 20:18:38,376][106226] Updated weights for policy 0, policy_version 150399 (0.0009) [2023-12-27 20:18:38,622][106225] Updated weights for policy 1, policy_version 150696 (0.0009) [2023-12-27 20:18:38,673][106225] Updated weights for policy 1, policy_version 150706 (0.0008) [2023-12-27 20:18:38,734][106225] Updated weights for policy 1, policy_version 150716 (0.0009) [2023-12-27 20:18:39,027][106226] Updated weights for policy 0, policy_version 150409 (0.0010) [2023-12-27 20:18:39,087][106226] Updated weights for policy 0, policy_version 150419 (0.0010) [2023-12-27 20:18:39,139][106226] Updated weights for policy 0, policy_version 150429 (0.0010) [2023-12-27 20:18:39,485][106225] Updated weights for policy 1, policy_version 150726 (0.0008) [2023-12-27 20:18:39,552][106225] Updated weights for policy 1, policy_version 150736 (0.0009) [2023-12-27 20:18:39,613][106225] Updated weights for policy 1, policy_version 150746 (0.0009) [2023-12-27 20:18:39,868][106226] Updated weights for policy 0, policy_version 150439 (0.0009) [2023-12-27 20:18:39,939][106226] Updated weights for policy 0, policy_version 150449 (0.0009) [2023-12-27 20:18:40,004][106226] Updated weights for policy 0, policy_version 150459 (0.0009) [2023-12-27 20:18:40,314][106225] Updated weights for policy 1, policy_version 150756 (0.0007) [2023-12-27 20:18:40,382][106225] Updated weights for policy 1, policy_version 150766 (0.0005) [2023-12-27 20:18:40,450][106225] Updated weights for policy 1, policy_version 150776 (0.0008) [2023-12-27 20:18:40,757][106226] Updated weights for policy 0, policy_version 150469 (0.0009) [2023-12-27 20:18:40,815][106226] Updated weights for policy 0, policy_version 150479 (0.0007) [2023-12-27 20:18:40,880][106226] Updated weights for policy 0, policy_version 150489 (0.0007) [2023-12-27 20:18:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 77144064. Throughput: 0: 9583.7, 1: 10183.8. Samples: 77117420. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:41,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-6.042')] [2023-12-27 20:18:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000150784_38608896.pth... [2023-12-27 20:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000150496_38535168.pth... [2023-12-27 20:18:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000149632_38313984.pth [2023-12-27 20:18:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000149344_38240256.pth [2023-12-27 20:18:41,209][106225] Updated weights for policy 1, policy_version 150786 (0.0009) [2023-12-27 20:18:41,281][106225] Updated weights for policy 1, policy_version 150796 (0.0008) [2023-12-27 20:18:41,339][106225] Updated weights for policy 1, policy_version 150806 (0.0007) [2023-12-27 20:18:41,407][106225] Updated weights for policy 1, policy_version 150816 (0.0009) [2023-12-27 20:18:41,616][106226] Updated weights for policy 0, policy_version 150499 (0.0008) [2023-12-27 20:18:41,690][106226] Updated weights for policy 0, policy_version 150509 (0.0009) [2023-12-27 20:18:41,767][106226] Updated weights for policy 0, policy_version 150519 (0.0009) [2023-12-27 20:18:42,170][106225] Updated weights for policy 1, policy_version 150826 (0.0009) [2023-12-27 20:18:42,230][106225] Updated weights for policy 1, policy_version 150836 (0.0008) [2023-12-27 20:18:42,289][106225] Updated weights for policy 1, policy_version 150846 (0.0009) [2023-12-27 20:18:42,461][106226] Updated weights for policy 0, policy_version 150529 (0.0009) [2023-12-27 20:18:42,525][106226] Updated weights for policy 0, policy_version 150539 (0.0007) [2023-12-27 20:18:42,582][106226] Updated weights for policy 0, policy_version 150549 (0.0009) [2023-12-27 20:18:42,642][106226] Updated weights for policy 0, policy_version 150559 (0.0008) [2023-12-27 20:18:43,010][106225] Updated weights for policy 1, policy_version 150856 (0.0008) [2023-12-27 20:18:43,075][106225] Updated weights for policy 1, policy_version 150866 (0.0009) [2023-12-27 20:18:43,134][106225] Updated weights for policy 1, policy_version 150876 (0.0008) [2023-12-27 20:18:43,345][106226] Updated weights for policy 0, policy_version 150569 (0.0008) [2023-12-27 20:18:43,400][106226] Updated weights for policy 0, policy_version 150579 (0.0005) [2023-12-27 20:18:43,457][106226] Updated weights for policy 0, policy_version 150589 (0.0007) [2023-12-27 20:18:43,872][106225] Updated weights for policy 1, policy_version 150886 (0.0008) [2023-12-27 20:18:43,929][106225] Updated weights for policy 1, policy_version 150896 (0.0008) [2023-12-27 20:18:43,978][106225] Updated weights for policy 1, policy_version 150906 (0.0007) [2023-12-27 20:18:44,031][106226] Updated weights for policy 0, policy_version 150599 (0.0007) [2023-12-27 20:18:44,077][106226] Updated weights for policy 0, policy_version 150609 (0.0010) [2023-12-27 20:18:44,137][106226] Updated weights for policy 0, policy_version 150619 (0.0009) [2023-12-27 20:18:44,662][106225] Updated weights for policy 1, policy_version 150916 (0.0006) [2023-12-27 20:18:44,719][106225] Updated weights for policy 1, policy_version 150926 (0.0007) [2023-12-27 20:18:44,789][106225] Updated weights for policy 1, policy_version 150936 (0.0008) [2023-12-27 20:18:44,822][106226] Updated weights for policy 0, policy_version 150629 (0.0006) [2023-12-27 20:18:44,884][106226] Updated weights for policy 0, policy_version 150639 (0.0007) [2023-12-27 20:18:44,943][106226] Updated weights for policy 0, policy_version 150649 (0.0008) [2023-12-27 20:18:45,538][106225] Updated weights for policy 1, policy_version 150946 (0.0009) [2023-12-27 20:18:45,593][106225] Updated weights for policy 1, policy_version 150956 (0.0011) [2023-12-27 20:18:45,655][106225] Updated weights for policy 1, policy_version 150966 (0.0011) [2023-12-27 20:18:45,665][106226] Updated weights for policy 0, policy_version 150659 (0.0007) [2023-12-27 20:18:45,713][106225] Updated weights for policy 1, policy_version 150976 (0.0011) [2023-12-27 20:18:45,720][106226] Updated weights for policy 0, policy_version 150669 (0.0007) [2023-12-27 20:18:45,770][106226] Updated weights for policy 0, policy_version 150679 (0.0008) [2023-12-27 20:18:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 77242368. Throughput: 0: 9590.5, 1: 10067.4. Samples: 77232196. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:18:46,175][105115] Avg episode reward: [(0, '-5.395'), (1, '-6.711')] [2023-12-27 20:18:46,439][106225] Updated weights for policy 1, policy_version 150986 (0.0005) [2023-12-27 20:18:46,446][106226] Updated weights for policy 0, policy_version 150689 (0.0008) [2023-12-27 20:18:46,490][106225] Updated weights for policy 1, policy_version 150996 (0.0005) [2023-12-27 20:18:46,495][106226] Updated weights for policy 0, policy_version 150699 (0.0008) [2023-12-27 20:18:46,551][106225] Updated weights for policy 1, policy_version 151006 (0.0005) [2023-12-27 20:18:46,561][106226] Updated weights for policy 0, policy_version 150709 (0.0008) [2023-12-27 20:18:46,614][106226] Updated weights for policy 0, policy_version 150719 (0.0009) [2023-12-27 20:18:47,071][106225] Updated weights for policy 1, policy_version 151016 (0.0008) [2023-12-27 20:18:47,129][106225] Updated weights for policy 1, policy_version 151026 (0.0008) [2023-12-27 20:18:47,180][106225] Updated weights for policy 1, policy_version 151036 (0.0008) [2023-12-27 20:18:47,437][106226] Updated weights for policy 0, policy_version 150729 (0.0007) [2023-12-27 20:18:47,490][106226] Updated weights for policy 0, policy_version 150739 (0.0008) [2023-12-27 20:18:47,544][106226] Updated weights for policy 0, policy_version 150749 (0.0010) [2023-12-27 20:18:47,770][106225] Updated weights for policy 1, policy_version 151046 (0.0009) [2023-12-27 20:18:47,836][106225] Updated weights for policy 1, policy_version 151056 (0.0010) [2023-12-27 20:18:47,899][106225] Updated weights for policy 1, policy_version 151066 (0.0010) [2023-12-27 20:18:48,201][106226] Updated weights for policy 0, policy_version 150759 (0.0009) [2023-12-27 20:18:48,261][106226] Updated weights for policy 0, policy_version 150769 (0.0011) [2023-12-27 20:18:48,330][106226] Updated weights for policy 0, policy_version 150779 (0.0011) [2023-12-27 20:18:48,644][106225] Updated weights for policy 1, policy_version 151076 (0.0011) [2023-12-27 20:18:48,712][106225] Updated weights for policy 1, policy_version 151086 (0.0010) [2023-12-27 20:18:48,773][106225] Updated weights for policy 1, policy_version 151096 (0.0010) [2023-12-27 20:18:48,959][106226] Updated weights for policy 0, policy_version 150789 (0.0009) [2023-12-27 20:18:49,018][106226] Updated weights for policy 0, policy_version 150799 (0.0008) [2023-12-27 20:18:49,082][106226] Updated weights for policy 0, policy_version 150809 (0.0005) [2023-12-27 20:18:49,483][106225] Updated weights for policy 1, policy_version 151106 (0.0010) [2023-12-27 20:18:49,550][106225] Updated weights for policy 1, policy_version 151116 (0.0011) [2023-12-27 20:18:49,611][106225] Updated weights for policy 1, policy_version 151126 (0.0011) [2023-12-27 20:18:49,668][106225] Updated weights for policy 1, policy_version 151136 (0.0010) [2023-12-27 20:18:49,770][106226] Updated weights for policy 0, policy_version 150819 (0.0007) [2023-12-27 20:18:49,821][106226] Updated weights for policy 0, policy_version 150829 (0.0010) [2023-12-27 20:18:49,884][106226] Updated weights for policy 0, policy_version 150839 (0.0009) [2023-12-27 20:18:50,397][106225] Updated weights for policy 1, policy_version 151146 (0.0011) [2023-12-27 20:18:50,457][106225] Updated weights for policy 1, policy_version 151156 (0.0010) [2023-12-27 20:18:50,516][106225] Updated weights for policy 1, policy_version 151166 (0.0010) [2023-12-27 20:18:50,536][106226] Updated weights for policy 0, policy_version 150849 (0.0011) [2023-12-27 20:18:50,603][106226] Updated weights for policy 0, policy_version 150859 (0.0009) [2023-12-27 20:18:50,661][106226] Updated weights for policy 0, policy_version 150869 (0.0011) [2023-12-27 20:18:50,718][106226] Updated weights for policy 0, policy_version 150879 (0.0010) [2023-12-27 20:18:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 77340672. Throughput: 0: 9713.5, 1: 9997.0. Samples: 77352684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:18:51,175][105115] Avg episode reward: [(0, '-5.724'), (1, '-6.207')] [2023-12-27 20:18:51,219][106225] Updated weights for policy 1, policy_version 151176 (0.0010) [2023-12-27 20:18:51,284][106225] Updated weights for policy 1, policy_version 151186 (0.0010) [2023-12-27 20:18:51,335][106225] Updated weights for policy 1, policy_version 151196 (0.0010) [2023-12-27 20:18:51,399][106226] Updated weights for policy 0, policy_version 150889 (0.0009) [2023-12-27 20:18:51,467][106226] Updated weights for policy 0, policy_version 150899 (0.0008) [2023-12-27 20:18:51,534][106226] Updated weights for policy 0, policy_version 150909 (0.0008) [2023-12-27 20:18:52,073][106225] Updated weights for policy 1, policy_version 151206 (0.0010) [2023-12-27 20:18:52,132][106225] Updated weights for policy 1, policy_version 151216 (0.0007) [2023-12-27 20:18:52,192][106226] Updated weights for policy 0, policy_version 150919 (0.0010) [2023-12-27 20:18:52,193][106225] Updated weights for policy 1, policy_version 151226 (0.0009) [2023-12-27 20:18:52,239][106226] Updated weights for policy 0, policy_version 150929 (0.0010) [2023-12-27 20:18:52,304][106226] Updated weights for policy 0, policy_version 150939 (0.0011) [2023-12-27 20:18:52,911][106225] Updated weights for policy 1, policy_version 151236 (0.0010) [2023-12-27 20:18:52,962][106225] Updated weights for policy 1, policy_version 151246 (0.0009) [2023-12-27 20:18:52,989][106226] Updated weights for policy 0, policy_version 150949 (0.0011) [2023-12-27 20:18:53,013][106225] Updated weights for policy 1, policy_version 151256 (0.0009) [2023-12-27 20:18:53,048][106226] Updated weights for policy 0, policy_version 150959 (0.0011) [2023-12-27 20:18:53,110][106226] Updated weights for policy 0, policy_version 150969 (0.0009) [2023-12-27 20:18:53,643][106225] Updated weights for policy 1, policy_version 151266 (0.0006) [2023-12-27 20:18:53,694][106225] Updated weights for policy 1, policy_version 151276 (0.0009) [2023-12-27 20:18:53,740][106225] Updated weights for policy 1, policy_version 151286 (0.0008) [2023-12-27 20:18:53,791][106225] Updated weights for policy 1, policy_version 151296 (0.0010) [2023-12-27 20:18:53,798][106226] Updated weights for policy 0, policy_version 150979 (0.0007) [2023-12-27 20:18:53,854][106226] Updated weights for policy 0, policy_version 150989 (0.0008) [2023-12-27 20:18:53,905][106226] Updated weights for policy 0, policy_version 150999 (0.0008) [2023-12-27 20:18:54,543][106225] Updated weights for policy 1, policy_version 151306 (0.0006) [2023-12-27 20:18:54,614][106225] Updated weights for policy 1, policy_version 151316 (0.0005) [2023-12-27 20:18:54,651][106226] Updated weights for policy 0, policy_version 151009 (0.0008) [2023-12-27 20:18:54,678][106225] Updated weights for policy 1, policy_version 151326 (0.0005) [2023-12-27 20:18:54,707][106226] Updated weights for policy 0, policy_version 151019 (0.0010) [2023-12-27 20:18:54,763][106226] Updated weights for policy 0, policy_version 151029 (0.0005) [2023-12-27 20:18:54,812][106226] Updated weights for policy 0, policy_version 151039 (0.0005) [2023-12-27 20:18:55,280][106225] Updated weights for policy 1, policy_version 151336 (0.0009) [2023-12-27 20:18:55,333][106225] Updated weights for policy 1, policy_version 151346 (0.0010) [2023-12-27 20:18:55,381][106226] Updated weights for policy 0, policy_version 151049 (0.0005) [2023-12-27 20:18:55,382][106225] Updated weights for policy 1, policy_version 151356 (0.0010) [2023-12-27 20:18:55,443][106226] Updated weights for policy 0, policy_version 151059 (0.0007) [2023-12-27 20:18:55,507][106226] Updated weights for policy 0, policy_version 151069 (0.0008) [2023-12-27 20:18:56,150][106225] Updated weights for policy 1, policy_version 151366 (0.0011) [2023-12-27 20:18:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 77438976. Throughput: 0: 9794.5, 1: 9909.6. Samples: 77412404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:18:56,175][105115] Avg episode reward: [(0, '-5.143'), (1, '-6.288')] [2023-12-27 20:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000151072_38682624.pth... [2023-12-27 20:18:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000149920_38387712.pth [2023-12-27 20:18:56,214][106225] Updated weights for policy 1, policy_version 151376 (0.0011) [2023-12-27 20:18:56,262][106226] Updated weights for policy 0, policy_version 151079 (0.0006) [2023-12-27 20:18:56,272][106225] Updated weights for policy 1, policy_version 151386 (0.0010) [2023-12-27 20:18:56,300][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000151392_38764544.pth... [2023-12-27 20:18:56,303][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000150208_38461440.pth [2023-12-27 20:18:56,317][106226] Updated weights for policy 0, policy_version 151089 (0.0006) [2023-12-27 20:18:56,368][106226] Updated weights for policy 0, policy_version 151099 (0.0008) [2023-12-27 20:18:56,984][106225] Updated weights for policy 1, policy_version 151396 (0.0010) [2023-12-27 20:18:57,027][106226] Updated weights for policy 0, policy_version 151109 (0.0006) [2023-12-27 20:18:57,033][106225] Updated weights for policy 1, policy_version 151406 (0.0010) [2023-12-27 20:18:57,086][106226] Updated weights for policy 0, policy_version 151119 (0.0005) [2023-12-27 20:18:57,086][106225] Updated weights for policy 1, policy_version 151416 (0.0010) [2023-12-27 20:18:57,147][106226] Updated weights for policy 0, policy_version 151129 (0.0006) [2023-12-27 20:18:57,705][106226] Updated weights for policy 0, policy_version 151139 (0.0006) [2023-12-27 20:18:57,758][106226] Updated weights for policy 0, policy_version 151149 (0.0005) [2023-12-27 20:18:57,764][106225] Updated weights for policy 1, policy_version 151426 (0.0010) [2023-12-27 20:18:57,813][106226] Updated weights for policy 0, policy_version 151159 (0.0007) [2023-12-27 20:18:57,833][106225] Updated weights for policy 1, policy_version 151436 (0.0010) [2023-12-27 20:18:57,899][106225] Updated weights for policy 1, policy_version 151446 (0.0010) [2023-12-27 20:18:57,964][106225] Updated weights for policy 1, policy_version 151456 (0.0010) [2023-12-27 20:18:58,504][106226] Updated weights for policy 0, policy_version 151169 (0.0006) [2023-12-27 20:18:58,571][106226] Updated weights for policy 0, policy_version 151179 (0.0009) [2023-12-27 20:18:58,637][106226] Updated weights for policy 0, policy_version 151189 (0.0008) [2023-12-27 20:18:58,678][106225] Updated weights for policy 1, policy_version 151466 (0.0008) [2023-12-27 20:18:58,704][106226] Updated weights for policy 0, policy_version 151199 (0.0008) [2023-12-27 20:18:58,747][106225] Updated weights for policy 1, policy_version 151476 (0.0008) [2023-12-27 20:18:58,826][106225] Updated weights for policy 1, policy_version 151486 (0.0009) [2023-12-27 20:18:59,560][106226] Updated weights for policy 0, policy_version 151209 (0.0008) [2023-12-27 20:18:59,629][106226] Updated weights for policy 0, policy_version 151219 (0.0007) [2023-12-27 20:18:59,650][106225] Updated weights for policy 1, policy_version 151496 (0.0010) [2023-12-27 20:18:59,694][106226] Updated weights for policy 0, policy_version 151229 (0.0007) [2023-12-27 20:18:59,709][106225] Updated weights for policy 1, policy_version 151506 (0.0010) [2023-12-27 20:18:59,765][106225] Updated weights for policy 1, policy_version 151516 (0.0010) [2023-12-27 20:19:00,399][106225] Updated weights for policy 1, policy_version 151526 (0.0007) [2023-12-27 20:19:00,450][106225] Updated weights for policy 1, policy_version 151536 (0.0008) [2023-12-27 20:19:00,485][106226] Updated weights for policy 0, policy_version 151239 (0.0006) [2023-12-27 20:19:00,514][106225] Updated weights for policy 1, policy_version 151546 (0.0007) [2023-12-27 20:19:00,536][106226] Updated weights for policy 0, policy_version 151249 (0.0007) [2023-12-27 20:19:00,598][106226] Updated weights for policy 0, policy_version 151259 (0.0006) [2023-12-27 20:19:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 77537280. Throughput: 0: 9822.0, 1: 9918.0. Samples: 77530408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:01,175][105115] Avg episode reward: [(0, '-5.213'), (1, '-6.469')] [2023-12-27 20:19:01,183][106225] Updated weights for policy 1, policy_version 151556 (0.0009) [2023-12-27 20:19:01,241][106225] Updated weights for policy 1, policy_version 151566 (0.0009) [2023-12-27 20:19:01,295][106226] Updated weights for policy 0, policy_version 151269 (0.0008) [2023-12-27 20:19:01,300][106225] Updated weights for policy 1, policy_version 151576 (0.0007) [2023-12-27 20:19:01,364][106226] Updated weights for policy 0, policy_version 151279 (0.0008) [2023-12-27 20:19:01,432][106226] Updated weights for policy 0, policy_version 151289 (0.0008) [2023-12-27 20:19:01,990][106225] Updated weights for policy 1, policy_version 151586 (0.0007) [2023-12-27 20:19:02,039][106225] Updated weights for policy 1, policy_version 151596 (0.0008) [2023-12-27 20:19:02,091][106225] Updated weights for policy 1, policy_version 151606 (0.0008) [2023-12-27 20:19:02,142][106225] Updated weights for policy 1, policy_version 151616 (0.0008) [2023-12-27 20:19:02,162][106226] Updated weights for policy 0, policy_version 151299 (0.0008) [2023-12-27 20:19:02,224][106226] Updated weights for policy 0, policy_version 151309 (0.0007) [2023-12-27 20:19:02,291][106226] Updated weights for policy 0, policy_version 151319 (0.0007) [2023-12-27 20:19:02,926][106225] Updated weights for policy 1, policy_version 151626 (0.0008) [2023-12-27 20:19:02,975][106226] Updated weights for policy 0, policy_version 151329 (0.0008) [2023-12-27 20:19:02,981][106225] Updated weights for policy 1, policy_version 151636 (0.0008) [2023-12-27 20:19:03,027][106226] Updated weights for policy 0, policy_version 151339 (0.0007) [2023-12-27 20:19:03,035][106225] Updated weights for policy 1, policy_version 151646 (0.0007) [2023-12-27 20:19:03,077][106226] Updated weights for policy 0, policy_version 151349 (0.0008) [2023-12-27 20:19:03,122][106226] Updated weights for policy 0, policy_version 151359 (0.0007) [2023-12-27 20:19:03,743][106225] Updated weights for policy 1, policy_version 151656 (0.0006) [2023-12-27 20:19:03,793][106226] Updated weights for policy 0, policy_version 151369 (0.0006) [2023-12-27 20:19:03,798][106225] Updated weights for policy 1, policy_version 151666 (0.0008) [2023-12-27 20:19:03,848][106225] Updated weights for policy 1, policy_version 151676 (0.0006) [2023-12-27 20:19:03,856][106226] Updated weights for policy 0, policy_version 151379 (0.0007) [2023-12-27 20:19:03,914][106226] Updated weights for policy 0, policy_version 151389 (0.0007) [2023-12-27 20:19:04,570][106225] Updated weights for policy 1, policy_version 151686 (0.0007) [2023-12-27 20:19:04,622][106225] Updated weights for policy 1, policy_version 151696 (0.0008) [2023-12-27 20:19:04,658][106226] Updated weights for policy 0, policy_version 151399 (0.0010) [2023-12-27 20:19:04,676][106225] Updated weights for policy 1, policy_version 151706 (0.0007) [2023-12-27 20:19:04,724][106226] Updated weights for policy 0, policy_version 151409 (0.0007) [2023-12-27 20:19:04,791][106226] Updated weights for policy 0, policy_version 151419 (0.0006) [2023-12-27 20:19:05,357][106225] Updated weights for policy 1, policy_version 151717 (0.0010) [2023-12-27 20:19:05,410][106225] Updated weights for policy 1, policy_version 151727 (0.0010) [2023-12-27 20:19:05,419][106226] Updated weights for policy 0, policy_version 151429 (0.0006) [2023-12-27 20:19:05,463][106225] Updated weights for policy 1, policy_version 151737 (0.0010) [2023-12-27 20:19:05,473][106226] Updated weights for policy 0, policy_version 151439 (0.0006) [2023-12-27 20:19:05,526][106226] Updated weights for policy 0, policy_version 151449 (0.0008) [2023-12-27 20:19:06,012][106225] Updated weights for policy 1, policy_version 151747 (0.0007) [2023-12-27 20:19:06,067][106225] Updated weights for policy 1, policy_version 151757 (0.0005) [2023-12-27 20:19:06,133][106225] Updated weights for policy 1, policy_version 151767 (0.0007) [2023-12-27 20:19:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 77635584. Throughput: 0: 9831.6, 1: 9871.3. Samples: 77650132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:06,175][105115] Avg episode reward: [(0, '-5.447'), (1, '-6.453')] [2023-12-27 20:19:06,366][106226] Updated weights for policy 0, policy_version 151459 (0.0010) [2023-12-27 20:19:06,426][106226] Updated weights for policy 0, policy_version 151469 (0.0010) [2023-12-27 20:19:06,487][106226] Updated weights for policy 0, policy_version 151479 (0.0011) [2023-12-27 20:19:06,838][106225] Updated weights for policy 1, policy_version 151777 (0.0008) [2023-12-27 20:19:06,886][106225] Updated weights for policy 1, policy_version 151787 (0.0010) [2023-12-27 20:19:06,940][106225] Updated weights for policy 1, policy_version 151797 (0.0010) [2023-12-27 20:19:06,986][106225] Updated weights for policy 1, policy_version 151807 (0.0010) [2023-12-27 20:19:07,201][106226] Updated weights for policy 0, policy_version 151489 (0.0011) [2023-12-27 20:19:07,264][106226] Updated weights for policy 0, policy_version 151499 (0.0011) [2023-12-27 20:19:07,324][106226] Updated weights for policy 0, policy_version 151509 (0.0010) [2023-12-27 20:19:07,387][106226] Updated weights for policy 0, policy_version 151519 (0.0011) [2023-12-27 20:19:07,705][106225] Updated weights for policy 1, policy_version 151817 (0.0006) [2023-12-27 20:19:07,767][106225] Updated weights for policy 1, policy_version 151827 (0.0009) [2023-12-27 20:19:07,823][106225] Updated weights for policy 1, policy_version 151837 (0.0010) [2023-12-27 20:19:08,085][106226] Updated weights for policy 0, policy_version 151529 (0.0011) [2023-12-27 20:19:08,135][106226] Updated weights for policy 0, policy_version 151539 (0.0010) [2023-12-27 20:19:08,194][106226] Updated weights for policy 0, policy_version 151549 (0.0010) [2023-12-27 20:19:08,465][106225] Updated weights for policy 1, policy_version 151847 (0.0009) [2023-12-27 20:19:08,540][106225] Updated weights for policy 1, policy_version 151857 (0.0009) [2023-12-27 20:19:08,604][106225] Updated weights for policy 1, policy_version 151867 (0.0007) [2023-12-27 20:19:08,869][106226] Updated weights for policy 0, policy_version 151559 (0.0011) [2023-12-27 20:19:08,923][106226] Updated weights for policy 0, policy_version 151569 (0.0010) [2023-12-27 20:19:08,970][106226] Updated weights for policy 0, policy_version 151579 (0.0010) [2023-12-27 20:19:09,271][106225] Updated weights for policy 1, policy_version 151877 (0.0008) [2023-12-27 20:19:09,331][106225] Updated weights for policy 1, policy_version 151887 (0.0006) [2023-12-27 20:19:09,399][106225] Updated weights for policy 1, policy_version 151897 (0.0009) [2023-12-27 20:19:09,755][106226] Updated weights for policy 0, policy_version 151589 (0.0009) [2023-12-27 20:19:09,813][106226] Updated weights for policy 0, policy_version 151599 (0.0008) [2023-12-27 20:19:09,883][106226] Updated weights for policy 0, policy_version 151609 (0.0007) [2023-12-27 20:19:10,153][106225] Updated weights for policy 1, policy_version 151907 (0.0008) [2023-12-27 20:19:10,214][106225] Updated weights for policy 1, policy_version 151917 (0.0009) [2023-12-27 20:19:10,274][106225] Updated weights for policy 1, policy_version 151927 (0.0009) [2023-12-27 20:19:10,607][106226] Updated weights for policy 0, policy_version 151619 (0.0008) [2023-12-27 20:19:10,655][106226] Updated weights for policy 0, policy_version 151629 (0.0008) [2023-12-27 20:19:10,710][106226] Updated weights for policy 0, policy_version 151639 (0.0008) [2023-12-27 20:19:11,013][106225] Updated weights for policy 1, policy_version 151937 (0.0008) [2023-12-27 20:19:11,085][106225] Updated weights for policy 1, policy_version 151947 (0.0008) [2023-12-27 20:19:11,151][106225] Updated weights for policy 1, policy_version 151957 (0.0009) [2023-12-27 20:19:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 77733888. Throughput: 0: 9846.9, 1: 9942.3. Samples: 77710140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:11,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-6.265')] [2023-12-27 20:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000151648_38830080.pth... [2023-12-27 20:19:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000150496_38535168.pth [2023-12-27 20:19:11,206][106225] Updated weights for policy 1, policy_version 151967 (0.0008) [2023-12-27 20:19:11,212][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000151968_38912000.pth... [2023-12-27 20:19:11,216][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000150784_38608896.pth [2023-12-27 20:19:11,497][106226] Updated weights for policy 0, policy_version 151649 (0.0007) [2023-12-27 20:19:11,556][106226] Updated weights for policy 0, policy_version 151659 (0.0008) [2023-12-27 20:19:11,614][106226] Updated weights for policy 0, policy_version 151669 (0.0008) [2023-12-27 20:19:11,683][106226] Updated weights for policy 0, policy_version 151679 (0.0008) [2023-12-27 20:19:11,954][106225] Updated weights for policy 1, policy_version 151977 (0.0006) [2023-12-27 20:19:12,020][106225] Updated weights for policy 1, policy_version 151987 (0.0006) [2023-12-27 20:19:12,084][106225] Updated weights for policy 1, policy_version 151997 (0.0007) [2023-12-27 20:19:12,489][106226] Updated weights for policy 0, policy_version 151689 (0.0008) [2023-12-27 20:19:12,558][106226] Updated weights for policy 0, policy_version 151699 (0.0008) [2023-12-27 20:19:12,628][106226] Updated weights for policy 0, policy_version 151709 (0.0007) [2023-12-27 20:19:12,715][106225] Updated weights for policy 1, policy_version 152007 (0.0008) [2023-12-27 20:19:12,784][106225] Updated weights for policy 1, policy_version 152017 (0.0009) [2023-12-27 20:19:12,841][106225] Updated weights for policy 1, policy_version 152027 (0.0008) [2023-12-27 20:19:13,191][106226] Updated weights for policy 0, policy_version 151719 (0.0005) [2023-12-27 20:19:13,256][106226] Updated weights for policy 0, policy_version 151729 (0.0005) [2023-12-27 20:19:13,312][106226] Updated weights for policy 0, policy_version 151739 (0.0005) [2023-12-27 20:19:13,669][106225] Updated weights for policy 1, policy_version 152037 (0.0008) [2023-12-27 20:19:13,726][106225] Updated weights for policy 1, policy_version 152047 (0.0008) [2023-12-27 20:19:13,783][106225] Updated weights for policy 1, policy_version 152057 (0.0009) [2023-12-27 20:19:13,889][106226] Updated weights for policy 0, policy_version 151749 (0.0006) [2023-12-27 20:19:13,948][106226] Updated weights for policy 0, policy_version 151759 (0.0005) [2023-12-27 20:19:14,004][106226] Updated weights for policy 0, policy_version 151769 (0.0006) [2023-12-27 20:19:14,550][106226] Updated weights for policy 0, policy_version 151779 (0.0007) [2023-12-27 20:19:14,559][106225] Updated weights for policy 1, policy_version 152067 (0.0008) [2023-12-27 20:19:14,603][106226] Updated weights for policy 0, policy_version 151789 (0.0005) [2023-12-27 20:19:14,605][106225] Updated weights for policy 1, policy_version 152077 (0.0008) [2023-12-27 20:19:14,653][106225] Updated weights for policy 1, policy_version 152087 (0.0007) [2023-12-27 20:19:14,662][106226] Updated weights for policy 0, policy_version 151799 (0.0007) [2023-12-27 20:19:15,320][106226] Updated weights for policy 0, policy_version 151809 (0.0006) [2023-12-27 20:19:15,385][106226] Updated weights for policy 0, policy_version 151819 (0.0006) [2023-12-27 20:19:15,441][106226] Updated weights for policy 0, policy_version 151829 (0.0007) [2023-12-27 20:19:15,477][106225] Updated weights for policy 1, policy_version 152097 (0.0008) [2023-12-27 20:19:15,507][106226] Updated weights for policy 0, policy_version 151839 (0.0007) [2023-12-27 20:19:15,545][106225] Updated weights for policy 1, policy_version 152107 (0.0007) [2023-12-27 20:19:15,611][106225] Updated weights for policy 1, policy_version 152117 (0.0009) [2023-12-27 20:19:15,669][106225] Updated weights for policy 1, policy_version 152127 (0.0008) [2023-12-27 20:19:16,127][106226] Updated weights for policy 0, policy_version 151849 (0.0009) [2023-12-27 20:19:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 77832192. Throughput: 0: 9916.9, 1: 9792.4. Samples: 77826404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:16,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-6.609')] [2023-12-27 20:19:16,185][106226] Updated weights for policy 0, policy_version 151859 (0.0009) [2023-12-27 20:19:16,241][106226] Updated weights for policy 0, policy_version 151869 (0.0008) [2023-12-27 20:19:16,396][106225] Updated weights for policy 1, policy_version 152137 (0.0008) [2023-12-27 20:19:16,460][106225] Updated weights for policy 1, policy_version 152147 (0.0008) [2023-12-27 20:19:16,519][106225] Updated weights for policy 1, policy_version 152157 (0.0008) [2023-12-27 20:19:16,956][106226] Updated weights for policy 0, policy_version 151879 (0.0008) [2023-12-27 20:19:17,008][106226] Updated weights for policy 0, policy_version 151889 (0.0008) [2023-12-27 20:19:17,052][106226] Updated weights for policy 0, policy_version 151899 (0.0008) [2023-12-27 20:19:17,242][106225] Updated weights for policy 1, policy_version 152167 (0.0009) [2023-12-27 20:19:17,293][106225] Updated weights for policy 1, policy_version 152177 (0.0007) [2023-12-27 20:19:17,348][106225] Updated weights for policy 1, policy_version 152187 (0.0009) [2023-12-27 20:19:17,772][106226] Updated weights for policy 0, policy_version 151909 (0.0007) [2023-12-27 20:19:17,826][106226] Updated weights for policy 0, policy_version 151919 (0.0005) [2023-12-27 20:19:17,885][106226] Updated weights for policy 0, policy_version 151929 (0.0005) [2023-12-27 20:19:18,098][106225] Updated weights for policy 1, policy_version 152197 (0.0010) [2023-12-27 20:19:18,148][106225] Updated weights for policy 1, policy_version 152207 (0.0009) [2023-12-27 20:19:18,193][106225] Updated weights for policy 1, policy_version 152217 (0.0007) [2023-12-27 20:19:18,452][106226] Updated weights for policy 0, policy_version 151939 (0.0005) [2023-12-27 20:19:18,511][106226] Updated weights for policy 0, policy_version 151949 (0.0005) [2023-12-27 20:19:18,560][106226] Updated weights for policy 0, policy_version 151959 (0.0008) [2023-12-27 20:19:18,921][106225] Updated weights for policy 1, policy_version 152227 (0.0007) [2023-12-27 20:19:18,980][106225] Updated weights for policy 1, policy_version 152237 (0.0008) [2023-12-27 20:19:19,049][106225] Updated weights for policy 1, policy_version 152247 (0.0006) [2023-12-27 20:19:19,255][106226] Updated weights for policy 0, policy_version 151969 (0.0008) [2023-12-27 20:19:19,322][106226] Updated weights for policy 0, policy_version 151979 (0.0009) [2023-12-27 20:19:19,400][106226] Updated weights for policy 0, policy_version 151989 (0.0008) [2023-12-27 20:19:19,457][106226] Updated weights for policy 0, policy_version 151999 (0.0009) [2023-12-27 20:19:19,702][106225] Updated weights for policy 1, policy_version 152257 (0.0006) [2023-12-27 20:19:19,759][106225] Updated weights for policy 1, policy_version 152267 (0.0008) [2023-12-27 20:19:19,815][106225] Updated weights for policy 1, policy_version 152277 (0.0008) [2023-12-27 20:19:19,883][106225] Updated weights for policy 1, policy_version 152287 (0.0008) [2023-12-27 20:19:20,193][106226] Updated weights for policy 0, policy_version 152009 (0.0007) [2023-12-27 20:19:20,256][106226] Updated weights for policy 0, policy_version 152019 (0.0006) [2023-12-27 20:19:20,310][106226] Updated weights for policy 0, policy_version 152029 (0.0008) [2023-12-27 20:19:20,646][106225] Updated weights for policy 1, policy_version 152297 (0.0008) [2023-12-27 20:19:20,710][106225] Updated weights for policy 1, policy_version 152307 (0.0009) [2023-12-27 20:19:20,769][106225] Updated weights for policy 1, policy_version 152317 (0.0010) [2023-12-27 20:19:20,982][106226] Updated weights for policy 0, policy_version 152039 (0.0006) [2023-12-27 20:19:21,041][106226] Updated weights for policy 0, policy_version 152049 (0.0008) [2023-12-27 20:19:21,105][106226] Updated weights for policy 0, policy_version 152059 (0.0008) [2023-12-27 20:19:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 77938688. Throughput: 0: 9991.8, 1: 9728.4. Samples: 77944784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:21,175][105115] Avg episode reward: [(0, '-5.147'), (1, '-6.634')] [2023-12-27 20:19:21,515][106225] Updated weights for policy 1, policy_version 152327 (0.0008) [2023-12-27 20:19:21,577][106225] Updated weights for policy 1, policy_version 152337 (0.0005) [2023-12-27 20:19:21,641][106225] Updated weights for policy 1, policy_version 152347 (0.0009) [2023-12-27 20:19:21,892][106226] Updated weights for policy 0, policy_version 152069 (0.0008) [2023-12-27 20:19:21,954][106226] Updated weights for policy 0, policy_version 152079 (0.0008) [2023-12-27 20:19:22,018][106226] Updated weights for policy 0, policy_version 152089 (0.0007) [2023-12-27 20:19:22,408][106225] Updated weights for policy 1, policy_version 152357 (0.0009) [2023-12-27 20:19:22,474][106225] Updated weights for policy 1, policy_version 152367 (0.0008) [2023-12-27 20:19:22,540][106225] Updated weights for policy 1, policy_version 152377 (0.0008) [2023-12-27 20:19:22,749][106226] Updated weights for policy 0, policy_version 152099 (0.0008) [2023-12-27 20:19:22,814][106226] Updated weights for policy 0, policy_version 152109 (0.0009) [2023-12-27 20:19:22,880][106226] Updated weights for policy 0, policy_version 152119 (0.0008) [2023-12-27 20:19:23,257][106225] Updated weights for policy 1, policy_version 152387 (0.0008) [2023-12-27 20:19:23,306][106225] Updated weights for policy 1, policy_version 152397 (0.0008) [2023-12-27 20:19:23,355][106225] Updated weights for policy 1, policy_version 152407 (0.0008) [2023-12-27 20:19:23,555][106226] Updated weights for policy 0, policy_version 152129 (0.0009) [2023-12-27 20:19:23,608][106226] Updated weights for policy 0, policy_version 152139 (0.0007) [2023-12-27 20:19:23,664][106226] Updated weights for policy 0, policy_version 152149 (0.0008) [2023-12-27 20:19:23,724][106226] Updated weights for policy 0, policy_version 152159 (0.0008) [2023-12-27 20:19:24,069][106225] Updated weights for policy 1, policy_version 152417 (0.0009) [2023-12-27 20:19:24,122][106225] Updated weights for policy 1, policy_version 152427 (0.0007) [2023-12-27 20:19:24,171][106225] Updated weights for policy 1, policy_version 152437 (0.0008) [2023-12-27 20:19:24,222][106225] Updated weights for policy 1, policy_version 152447 (0.0007) [2023-12-27 20:19:24,368][106226] Updated weights for policy 0, policy_version 152169 (0.0008) [2023-12-27 20:19:24,427][106226] Updated weights for policy 0, policy_version 152179 (0.0008) [2023-12-27 20:19:24,490][106226] Updated weights for policy 0, policy_version 152189 (0.0008) [2023-12-27 20:19:24,969][106225] Updated weights for policy 1, policy_version 152457 (0.0008) [2023-12-27 20:19:25,022][106225] Updated weights for policy 1, policy_version 152467 (0.0008) [2023-12-27 20:19:25,083][106225] Updated weights for policy 1, policy_version 152477 (0.0006) [2023-12-27 20:19:25,129][106226] Updated weights for policy 0, policy_version 152199 (0.0009) [2023-12-27 20:19:25,186][106226] Updated weights for policy 0, policy_version 152209 (0.0009) [2023-12-27 20:19:25,247][106226] Updated weights for policy 0, policy_version 152219 (0.0009) [2023-12-27 20:19:25,773][106225] Updated weights for policy 1, policy_version 152487 (0.0009) [2023-12-27 20:19:25,835][106225] Updated weights for policy 1, policy_version 152497 (0.0007) [2023-12-27 20:19:25,899][106225] Updated weights for policy 1, policy_version 152507 (0.0014) [2023-12-27 20:19:25,965][106226] Updated weights for policy 0, policy_version 152229 (0.0009) [2023-12-27 20:19:26,013][106226] Updated weights for policy 0, policy_version 152239 (0.0009) [2023-12-27 20:19:26,061][106226] Updated weights for policy 0, policy_version 152249 (0.0006) [2023-12-27 20:19:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 78036992. Throughput: 0: 9932.2, 1: 9698.5. Samples: 78000800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:26,175][105115] Avg episode reward: [(0, '-5.525'), (1, '-6.501')] [2023-12-27 20:19:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000152512_39051264.pth... [2023-12-27 20:19:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000152256_38985728.pth... [2023-12-27 20:19:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000151392_38764544.pth [2023-12-27 20:19:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000151072_38682624.pth [2023-12-27 20:19:26,613][106225] Updated weights for policy 1, policy_version 152517 (0.0007) [2023-12-27 20:19:26,661][106225] Updated weights for policy 1, policy_version 152527 (0.0005) [2023-12-27 20:19:26,709][106225] Updated weights for policy 1, policy_version 152537 (0.0005) [2023-12-27 20:19:26,765][106226] Updated weights for policy 0, policy_version 152259 (0.0010) [2023-12-27 20:19:26,847][106226] Updated weights for policy 0, policy_version 152269 (0.0008) [2023-12-27 20:19:26,911][106226] Updated weights for policy 0, policy_version 152279 (0.0007) [2023-12-27 20:19:27,237][106225] Updated weights for policy 1, policy_version 152547 (0.0005) [2023-12-27 20:19:27,299][106225] Updated weights for policy 1, policy_version 152557 (0.0006) [2023-12-27 20:19:27,355][106225] Updated weights for policy 1, policy_version 152567 (0.0008) [2023-12-27 20:19:27,571][106226] Updated weights for policy 0, policy_version 152289 (0.0010) [2023-12-27 20:19:27,624][106226] Updated weights for policy 0, policy_version 152299 (0.0010) [2023-12-27 20:19:27,683][106226] Updated weights for policy 0, policy_version 152309 (0.0010) [2023-12-27 20:19:27,746][106226] Updated weights for policy 0, policy_version 152319 (0.0006) [2023-12-27 20:19:28,113][106225] Updated weights for policy 1, policy_version 152577 (0.0009) [2023-12-27 20:19:28,162][106225] Updated weights for policy 1, policy_version 152587 (0.0007) [2023-12-27 20:19:28,212][106225] Updated weights for policy 1, policy_version 152597 (0.0009) [2023-12-27 20:19:28,267][106225] Updated weights for policy 1, policy_version 152607 (0.0010) [2023-12-27 20:19:28,292][106226] Updated weights for policy 0, policy_version 152329 (0.0006) [2023-12-27 20:19:28,353][106226] Updated weights for policy 0, policy_version 152339 (0.0008) [2023-12-27 20:19:28,416][106226] Updated weights for policy 0, policy_version 152349 (0.0011) [2023-12-27 20:19:29,004][106225] Updated weights for policy 1, policy_version 152617 (0.0010) [2023-12-27 20:19:29,053][106225] Updated weights for policy 1, policy_version 152627 (0.0010) [2023-12-27 20:19:29,102][106225] Updated weights for policy 1, policy_version 152637 (0.0010) [2023-12-27 20:19:29,104][106226] Updated weights for policy 0, policy_version 152359 (0.0007) [2023-12-27 20:19:29,161][106226] Updated weights for policy 0, policy_version 152369 (0.0006) [2023-12-27 20:19:29,224][106226] Updated weights for policy 0, policy_version 152379 (0.0009) [2023-12-27 20:19:29,839][106225] Updated weights for policy 1, policy_version 152647 (0.0009) [2023-12-27 20:19:29,901][106225] Updated weights for policy 1, policy_version 152657 (0.0007) [2023-12-27 20:19:29,968][106225] Updated weights for policy 1, policy_version 152667 (0.0010) [2023-12-27 20:19:29,984][106226] Updated weights for policy 0, policy_version 152389 (0.0007) [2023-12-27 20:19:30,045][106226] Updated weights for policy 0, policy_version 152399 (0.0007) [2023-12-27 20:19:30,109][106226] Updated weights for policy 0, policy_version 152409 (0.0006) [2023-12-27 20:19:30,644][106225] Updated weights for policy 1, policy_version 152677 (0.0010) [2023-12-27 20:19:30,694][106225] Updated weights for policy 1, policy_version 152687 (0.0010) [2023-12-27 20:19:30,751][106225] Updated weights for policy 1, policy_version 152697 (0.0007) [2023-12-27 20:19:30,769][106226] Updated weights for policy 0, policy_version 152419 (0.0009) [2023-12-27 20:19:30,819][106226] Updated weights for policy 0, policy_version 152429 (0.0010) [2023-12-27 20:19:30,865][106226] Updated weights for policy 0, policy_version 152439 (0.0010) [2023-12-27 20:19:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 78135296. Throughput: 0: 10011.4, 1: 9785.9. Samples: 78123072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:31,175][105115] Avg episode reward: [(0, '-5.179'), (1, '-6.496')] [2023-12-27 20:19:31,412][106225] Updated weights for policy 1, policy_version 152707 (0.0006) [2023-12-27 20:19:31,477][106225] Updated weights for policy 1, policy_version 152717 (0.0008) [2023-12-27 20:19:31,535][106225] Updated weights for policy 1, policy_version 152727 (0.0007) [2023-12-27 20:19:31,631][106226] Updated weights for policy 0, policy_version 152449 (0.0010) [2023-12-27 20:19:31,698][106226] Updated weights for policy 0, policy_version 152459 (0.0009) [2023-12-27 20:19:31,768][106226] Updated weights for policy 0, policy_version 152469 (0.0012) [2023-12-27 20:19:31,829][106226] Updated weights for policy 0, policy_version 152479 (0.0011) [2023-12-27 20:19:32,222][106225] Updated weights for policy 1, policy_version 152737 (0.0008) [2023-12-27 20:19:32,274][106225] Updated weights for policy 1, policy_version 152747 (0.0009) [2023-12-27 20:19:32,323][106225] Updated weights for policy 1, policy_version 152757 (0.0009) [2023-12-27 20:19:32,383][106225] Updated weights for policy 1, policy_version 152767 (0.0007) [2023-12-27 20:19:32,563][106226] Updated weights for policy 0, policy_version 152489 (0.0011) [2023-12-27 20:19:32,619][106226] Updated weights for policy 0, policy_version 152499 (0.0010) [2023-12-27 20:19:32,676][106226] Updated weights for policy 0, policy_version 152509 (0.0005) [2023-12-27 20:19:33,140][106225] Updated weights for policy 1, policy_version 152777 (0.0008) [2023-12-27 20:19:33,190][106225] Updated weights for policy 1, policy_version 152787 (0.0008) [2023-12-27 20:19:33,238][106225] Updated weights for policy 1, policy_version 152797 (0.0009) [2023-12-27 20:19:33,280][106226] Updated weights for policy 0, policy_version 152519 (0.0009) [2023-12-27 20:19:33,339][106226] Updated weights for policy 0, policy_version 152529 (0.0010) [2023-12-27 20:19:33,397][106226] Updated weights for policy 0, policy_version 152539 (0.0010) [2023-12-27 20:19:33,998][106225] Updated weights for policy 1, policy_version 152807 (0.0008) [2023-12-27 20:19:34,043][106225] Updated weights for policy 1, policy_version 152817 (0.0007) [2023-12-27 20:19:34,068][106226] Updated weights for policy 0, policy_version 152549 (0.0006) [2023-12-27 20:19:34,092][106225] Updated weights for policy 1, policy_version 152827 (0.0008) [2023-12-27 20:19:34,121][106226] Updated weights for policy 0, policy_version 152559 (0.0006) [2023-12-27 20:19:34,184][106226] Updated weights for policy 0, policy_version 152569 (0.0010) [2023-12-27 20:19:34,811][106226] Updated weights for policy 0, policy_version 152579 (0.0006) [2023-12-27 20:19:34,871][106226] Updated weights for policy 0, policy_version 152589 (0.0008) [2023-12-27 20:19:34,906][106225] Updated weights for policy 1, policy_version 152837 (0.0007) [2023-12-27 20:19:34,923][106226] Updated weights for policy 0, policy_version 152599 (0.0007) [2023-12-27 20:19:34,959][106225] Updated weights for policy 1, policy_version 152847 (0.0006) [2023-12-27 20:19:35,023][106225] Updated weights for policy 1, policy_version 152857 (0.0008) [2023-12-27 20:19:35,526][106226] Updated weights for policy 0, policy_version 152609 (0.0008) [2023-12-27 20:19:35,586][106226] Updated weights for policy 0, policy_version 152619 (0.0009) [2023-12-27 20:19:35,633][106226] Updated weights for policy 0, policy_version 152629 (0.0008) [2023-12-27 20:19:35,679][106226] Updated weights for policy 0, policy_version 152639 (0.0008) [2023-12-27 20:19:35,735][106225] Updated weights for policy 1, policy_version 152867 (0.0009) [2023-12-27 20:19:35,783][106225] Updated weights for policy 1, policy_version 152877 (0.0007) [2023-12-27 20:19:35,843][106225] Updated weights for policy 1, policy_version 152887 (0.0008) [2023-12-27 20:19:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 78233600. Throughput: 0: 10046.5, 1: 9740.6. Samples: 78243104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:36,175][105115] Avg episode reward: [(0, '-5.244'), (1, '-6.586')] [2023-12-27 20:19:36,379][106226] Updated weights for policy 0, policy_version 152649 (0.0008) [2023-12-27 20:19:36,442][106226] Updated weights for policy 0, policy_version 152659 (0.0007) [2023-12-27 20:19:36,506][106226] Updated weights for policy 0, policy_version 152669 (0.0006) [2023-12-27 20:19:36,586][106225] Updated weights for policy 1, policy_version 152897 (0.0008) [2023-12-27 20:19:36,654][106225] Updated weights for policy 1, policy_version 152907 (0.0010) [2023-12-27 20:19:36,721][106225] Updated weights for policy 1, policy_version 152917 (0.0011) [2023-12-27 20:19:36,784][106225] Updated weights for policy 1, policy_version 152927 (0.0009) [2023-12-27 20:19:37,109][106226] Updated weights for policy 0, policy_version 152679 (0.0008) [2023-12-27 20:19:37,175][106226] Updated weights for policy 0, policy_version 152689 (0.0008) [2023-12-27 20:19:37,234][106226] Updated weights for policy 0, policy_version 152699 (0.0008) [2023-12-27 20:19:37,479][106225] Updated weights for policy 1, policy_version 152937 (0.0006) [2023-12-27 20:19:37,530][106225] Updated weights for policy 1, policy_version 152947 (0.0007) [2023-12-27 20:19:37,577][106225] Updated weights for policy 1, policy_version 152957 (0.0007) [2023-12-27 20:19:38,009][106226] Updated weights for policy 0, policy_version 152709 (0.0009) [2023-12-27 20:19:38,063][106226] Updated weights for policy 0, policy_version 152719 (0.0010) [2023-12-27 20:19:38,123][106226] Updated weights for policy 0, policy_version 152729 (0.0010) [2023-12-27 20:19:38,226][106225] Updated weights for policy 1, policy_version 152967 (0.0007) [2023-12-27 20:19:38,289][106225] Updated weights for policy 1, policy_version 152977 (0.0009) [2023-12-27 20:19:38,352][106225] Updated weights for policy 1, policy_version 152987 (0.0009) [2023-12-27 20:19:38,833][106226] Updated weights for policy 0, policy_version 152739 (0.0010) [2023-12-27 20:19:38,907][106226] Updated weights for policy 0, policy_version 152749 (0.0009) [2023-12-27 20:19:38,972][106226] Updated weights for policy 0, policy_version 152759 (0.0009) [2023-12-27 20:19:39,048][106225] Updated weights for policy 1, policy_version 152997 (0.0009) [2023-12-27 20:19:39,095][106225] Updated weights for policy 1, policy_version 153007 (0.0010) [2023-12-27 20:19:39,148][106225] Updated weights for policy 1, policy_version 153017 (0.0010) [2023-12-27 20:19:39,662][106226] Updated weights for policy 0, policy_version 152769 (0.0008) [2023-12-27 20:19:39,724][106226] Updated weights for policy 0, policy_version 152779 (0.0008) [2023-12-27 20:19:39,793][106226] Updated weights for policy 0, policy_version 152789 (0.0008) [2023-12-27 20:19:39,857][106226] Updated weights for policy 0, policy_version 152799 (0.0009) [2023-12-27 20:19:39,922][106225] Updated weights for policy 1, policy_version 153027 (0.0010) [2023-12-27 20:19:39,984][106225] Updated weights for policy 1, policy_version 153037 (0.0011) [2023-12-27 20:19:40,041][106225] Updated weights for policy 1, policy_version 153047 (0.0010) [2023-12-27 20:19:40,598][106226] Updated weights for policy 0, policy_version 152809 (0.0008) [2023-12-27 20:19:40,654][106226] Updated weights for policy 0, policy_version 152819 (0.0008) [2023-12-27 20:19:40,705][106226] Updated weights for policy 0, policy_version 152829 (0.0008) [2023-12-27 20:19:40,765][106225] Updated weights for policy 1, policy_version 153057 (0.0010) [2023-12-27 20:19:40,825][106225] Updated weights for policy 1, policy_version 153067 (0.0008) [2023-12-27 20:19:40,885][106225] Updated weights for policy 1, policy_version 153077 (0.0010) [2023-12-27 20:19:40,948][106225] Updated weights for policy 1, policy_version 153087 (0.0010) [2023-12-27 20:19:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 78331904. Throughput: 0: 10028.8, 1: 9745.3. Samples: 78302240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:41,175][105115] Avg episode reward: [(0, '-5.221'), (1, '-6.333')] [2023-12-27 20:19:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000153088_39198720.pth... [2023-12-27 20:19:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000152832_39133184.pth... [2023-12-27 20:19:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000151968_38912000.pth [2023-12-27 20:19:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000151648_38830080.pth [2023-12-27 20:19:41,505][106226] Updated weights for policy 0, policy_version 152839 (0.0008) [2023-12-27 20:19:41,571][106226] Updated weights for policy 0, policy_version 152849 (0.0007) [2023-12-27 20:19:41,642][106226] Updated weights for policy 0, policy_version 152859 (0.0007) [2023-12-27 20:19:41,760][106225] Updated weights for policy 1, policy_version 153097 (0.0008) [2023-12-27 20:19:41,813][106225] Updated weights for policy 1, policy_version 153107 (0.0007) [2023-12-27 20:19:41,874][106225] Updated weights for policy 1, policy_version 153117 (0.0008) [2023-12-27 20:19:42,385][106226] Updated weights for policy 0, policy_version 152869 (0.0008) [2023-12-27 20:19:42,452][106226] Updated weights for policy 0, policy_version 152879 (0.0008) [2023-12-27 20:19:42,520][106226] Updated weights for policy 0, policy_version 152889 (0.0007) [2023-12-27 20:19:42,538][106225] Updated weights for policy 1, policy_version 153127 (0.0008) [2023-12-27 20:19:42,606][106225] Updated weights for policy 1, policy_version 153137 (0.0008) [2023-12-27 20:19:42,658][106225] Updated weights for policy 1, policy_version 153147 (0.0010) [2023-12-27 20:19:43,258][106226] Updated weights for policy 0, policy_version 152899 (0.0008) [2023-12-27 20:19:43,312][106225] Updated weights for policy 1, policy_version 153157 (0.0010) [2023-12-27 20:19:43,322][106226] Updated weights for policy 0, policy_version 152909 (0.0005) [2023-12-27 20:19:43,370][106225] Updated weights for policy 1, policy_version 153167 (0.0007) [2023-12-27 20:19:43,386][106226] Updated weights for policy 0, policy_version 152919 (0.0008) [2023-12-27 20:19:43,421][106225] Updated weights for policy 1, policy_version 153177 (0.0005) [2023-12-27 20:19:43,947][106225] Updated weights for policy 1, policy_version 153187 (0.0005) [2023-12-27 20:19:44,007][106225] Updated weights for policy 1, policy_version 153197 (0.0005) [2023-12-27 20:19:44,056][106225] Updated weights for policy 1, policy_version 153207 (0.0005) [2023-12-27 20:19:44,154][106226] Updated weights for policy 0, policy_version 152929 (0.0007) [2023-12-27 20:19:44,213][106226] Updated weights for policy 0, policy_version 152939 (0.0006) [2023-12-27 20:19:44,271][106226] Updated weights for policy 0, policy_version 152949 (0.0005) [2023-12-27 20:19:44,324][106226] Updated weights for policy 0, policy_version 152959 (0.0005) [2023-12-27 20:19:44,610][106225] Updated weights for policy 1, policy_version 153217 (0.0006) [2023-12-27 20:19:44,673][106225] Updated weights for policy 1, policy_version 153227 (0.0005) [2023-12-27 20:19:44,725][106225] Updated weights for policy 1, policy_version 153237 (0.0005) [2023-12-27 20:19:44,783][106225] Updated weights for policy 1, policy_version 153247 (0.0007) [2023-12-27 20:19:44,905][106226] Updated weights for policy 0, policy_version 152969 (0.0008) [2023-12-27 20:19:44,972][106226] Updated weights for policy 0, policy_version 152979 (0.0006) [2023-12-27 20:19:45,042][106226] Updated weights for policy 0, policy_version 152989 (0.0006) [2023-12-27 20:19:45,467][106225] Updated weights for policy 1, policy_version 153257 (0.0010) [2023-12-27 20:19:45,518][106225] Updated weights for policy 1, policy_version 153267 (0.0010) [2023-12-27 20:19:45,562][106225] Updated weights for policy 1, policy_version 153277 (0.0010) [2023-12-27 20:19:45,694][106226] Updated weights for policy 0, policy_version 152999 (0.0006) [2023-12-27 20:19:45,744][106226] Updated weights for policy 0, policy_version 153009 (0.0005) [2023-12-27 20:19:45,801][106226] Updated weights for policy 0, policy_version 153019 (0.0005) [2023-12-27 20:19:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 78430208. Throughput: 0: 9962.8, 1: 9835.0. Samples: 78421312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:46,176][105115] Avg episode reward: [(0, '-5.232'), (1, '-6.365')] [2023-12-27 20:19:46,298][106225] Updated weights for policy 1, policy_version 153287 (0.0008) [2023-12-27 20:19:46,334][106226] Updated weights for policy 0, policy_version 153029 (0.0007) [2023-12-27 20:19:46,347][106225] Updated weights for policy 1, policy_version 153297 (0.0008) [2023-12-27 20:19:46,391][106226] Updated weights for policy 0, policy_version 153039 (0.0009) [2023-12-27 20:19:46,399][106225] Updated weights for policy 1, policy_version 153307 (0.0008) [2023-12-27 20:19:46,442][106226] Updated weights for policy 0, policy_version 153049 (0.0007) [2023-12-27 20:19:47,090][106225] Updated weights for policy 1, policy_version 153317 (0.0008) [2023-12-27 20:19:47,144][106225] Updated weights for policy 1, policy_version 153327 (0.0007) [2023-12-27 20:19:47,146][106226] Updated weights for policy 0, policy_version 153059 (0.0006) [2023-12-27 20:19:47,190][106225] Updated weights for policy 1, policy_version 153337 (0.0007) [2023-12-27 20:19:47,205][106226] Updated weights for policy 0, policy_version 153069 (0.0006) [2023-12-27 20:19:47,261][106226] Updated weights for policy 0, policy_version 153079 (0.0008) [2023-12-27 20:19:47,914][106226] Updated weights for policy 0, policy_version 153089 (0.0006) [2023-12-27 20:19:47,957][106225] Updated weights for policy 1, policy_version 153347 (0.0008) [2023-12-27 20:19:47,970][106226] Updated weights for policy 0, policy_version 153099 (0.0007) [2023-12-27 20:19:48,012][106225] Updated weights for policy 1, policy_version 153357 (0.0008) [2023-12-27 20:19:48,025][106226] Updated weights for policy 0, policy_version 153109 (0.0006) [2023-12-27 20:19:48,063][106225] Updated weights for policy 1, policy_version 153367 (0.0007) [2023-12-27 20:19:48,081][106226] Updated weights for policy 0, policy_version 153119 (0.0006) [2023-12-27 20:19:48,728][106226] Updated weights for policy 0, policy_version 153129 (0.0008) [2023-12-27 20:19:48,788][106226] Updated weights for policy 0, policy_version 153139 (0.0009) [2023-12-27 20:19:48,820][106225] Updated weights for policy 1, policy_version 153377 (0.0008) [2023-12-27 20:19:48,849][106226] Updated weights for policy 0, policy_version 153149 (0.0007) [2023-12-27 20:19:48,875][106225] Updated weights for policy 1, policy_version 153387 (0.0006) [2023-12-27 20:19:48,934][106225] Updated weights for policy 1, policy_version 153397 (0.0008) [2023-12-27 20:19:48,992][106225] Updated weights for policy 1, policy_version 153407 (0.0008) [2023-12-27 20:19:49,612][106226] Updated weights for policy 0, policy_version 153159 (0.0008) [2023-12-27 20:19:49,675][106226] Updated weights for policy 0, policy_version 153169 (0.0008) [2023-12-27 20:19:49,727][106226] Updated weights for policy 0, policy_version 153179 (0.0007) [2023-12-27 20:19:49,730][106225] Updated weights for policy 1, policy_version 153417 (0.0007) [2023-12-27 20:19:49,790][106225] Updated weights for policy 1, policy_version 153427 (0.0008) [2023-12-27 20:19:49,856][106225] Updated weights for policy 1, policy_version 153437 (0.0009) [2023-12-27 20:19:50,535][106226] Updated weights for policy 0, policy_version 153189 (0.0007) [2023-12-27 20:19:50,561][106225] Updated weights for policy 1, policy_version 153447 (0.0008) [2023-12-27 20:19:50,611][106226] Updated weights for policy 0, policy_version 153199 (0.0008) [2023-12-27 20:19:50,623][106225] Updated weights for policy 1, policy_version 153457 (0.0007) [2023-12-27 20:19:50,669][106226] Updated weights for policy 0, policy_version 153209 (0.0008) [2023-12-27 20:19:50,683][106225] Updated weights for policy 1, policy_version 153467 (0.0006) [2023-12-27 20:19:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 78528512. Throughput: 0: 9997.0, 1: 9759.2. Samples: 78539160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:19:51,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-6.368')] [2023-12-27 20:19:51,392][106226] Updated weights for policy 0, policy_version 153219 (0.0009) [2023-12-27 20:19:51,426][106225] Updated weights for policy 1, policy_version 153477 (0.0007) [2023-12-27 20:19:51,453][106226] Updated weights for policy 0, policy_version 153229 (0.0008) [2023-12-27 20:19:51,483][106225] Updated weights for policy 1, policy_version 153487 (0.0007) [2023-12-27 20:19:51,512][106226] Updated weights for policy 0, policy_version 153239 (0.0006) [2023-12-27 20:19:51,534][106225] Updated weights for policy 1, policy_version 153497 (0.0007) [2023-12-27 20:19:52,254][106226] Updated weights for policy 0, policy_version 153249 (0.0007) [2023-12-27 20:19:52,301][106225] Updated weights for policy 1, policy_version 153507 (0.0008) [2023-12-27 20:19:52,315][106226] Updated weights for policy 0, policy_version 153259 (0.0010) [2023-12-27 20:19:52,368][106225] Updated weights for policy 1, policy_version 153517 (0.0007) [2023-12-27 20:19:52,380][106226] Updated weights for policy 0, policy_version 153269 (0.0011) [2023-12-27 20:19:52,431][106225] Updated weights for policy 1, policy_version 153527 (0.0006) [2023-12-27 20:19:52,444][106226] Updated weights for policy 0, policy_version 153279 (0.0011) [2023-12-27 20:19:53,118][106225] Updated weights for policy 1, policy_version 153537 (0.0008) [2023-12-27 20:19:53,169][106226] Updated weights for policy 0, policy_version 153289 (0.0006) [2023-12-27 20:19:53,179][106225] Updated weights for policy 1, policy_version 153547 (0.0005) [2023-12-27 20:19:53,230][106225] Updated weights for policy 1, policy_version 153557 (0.0005) [2023-12-27 20:19:53,235][106226] Updated weights for policy 0, policy_version 153299 (0.0007) [2023-12-27 20:19:53,288][106225] Updated weights for policy 1, policy_version 153567 (0.0005) [2023-12-27 20:19:53,297][106226] Updated weights for policy 0, policy_version 153309 (0.0009) [2023-12-27 20:19:53,892][106225] Updated weights for policy 1, policy_version 153577 (0.0006) [2023-12-27 20:19:53,945][106226] Updated weights for policy 0, policy_version 153319 (0.0009) [2023-12-27 20:19:53,946][106225] Updated weights for policy 1, policy_version 153587 (0.0006) [2023-12-27 20:19:53,991][106226] Updated weights for policy 0, policy_version 153329 (0.0008) [2023-12-27 20:19:53,993][106225] Updated weights for policy 1, policy_version 153597 (0.0007) [2023-12-27 20:19:54,044][106226] Updated weights for policy 0, policy_version 153339 (0.0008) [2023-12-27 20:19:54,555][106225] Updated weights for policy 1, policy_version 153607 (0.0005) [2023-12-27 20:19:54,611][106225] Updated weights for policy 1, policy_version 153617 (0.0006) [2023-12-27 20:19:54,667][106225] Updated weights for policy 1, policy_version 153627 (0.0005) [2023-12-27 20:19:54,812][106226] Updated weights for policy 0, policy_version 153349 (0.0009) [2023-12-27 20:19:54,874][106226] Updated weights for policy 0, policy_version 153359 (0.0005) [2023-12-27 20:19:54,939][106226] Updated weights for policy 0, policy_version 153369 (0.0005) [2023-12-27 20:19:55,386][106225] Updated weights for policy 1, policy_version 153637 (0.0007) [2023-12-27 20:19:55,443][106225] Updated weights for policy 1, policy_version 153647 (0.0007) [2023-12-27 20:19:55,500][106225] Updated weights for policy 1, policy_version 153657 (0.0005) [2023-12-27 20:19:55,544][106226] Updated weights for policy 0, policy_version 153379 (0.0007) [2023-12-27 20:19:55,595][106226] Updated weights for policy 0, policy_version 153389 (0.0008) [2023-12-27 20:19:55,644][106226] Updated weights for policy 0, policy_version 153399 (0.0008) [2023-12-27 20:19:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 78626816. Throughput: 0: 9997.4, 1: 9738.8. Samples: 78598268. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:19:56,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-6.542')] [2023-12-27 20:19:56,192][106225] Updated weights for policy 1, policy_version 153667 (0.0006) [2023-12-27 20:19:56,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000153408_39280640.pth... [2023-12-27 20:19:56,218][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000152256_38985728.pth [2023-12-27 20:19:56,256][106225] Updated weights for policy 1, policy_version 153677 (0.0008) [2023-12-27 20:19:56,316][106225] Updated weights for policy 1, policy_version 153687 (0.0008) [2023-12-27 20:19:56,371][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000153696_39354368.pth... [2023-12-27 20:19:56,375][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000152512_39051264.pth [2023-12-27 20:19:56,403][106226] Updated weights for policy 0, policy_version 153409 (0.0009) [2023-12-27 20:19:56,459][106226] Updated weights for policy 0, policy_version 153419 (0.0008) [2023-12-27 20:19:56,515][106226] Updated weights for policy 0, policy_version 153429 (0.0008) [2023-12-27 20:19:56,574][106226] Updated weights for policy 0, policy_version 153439 (0.0008) [2023-12-27 20:19:56,970][106225] Updated weights for policy 1, policy_version 153697 (0.0007) [2023-12-27 20:19:57,024][106225] Updated weights for policy 1, policy_version 153707 (0.0005) [2023-12-27 20:19:57,079][106225] Updated weights for policy 1, policy_version 153717 (0.0005) [2023-12-27 20:19:57,141][106225] Updated weights for policy 1, policy_version 153727 (0.0005) [2023-12-27 20:19:57,249][106226] Updated weights for policy 0, policy_version 153449 (0.0009) [2023-12-27 20:19:57,296][106226] Updated weights for policy 0, policy_version 153459 (0.0007) [2023-12-27 20:19:57,354][106226] Updated weights for policy 0, policy_version 153469 (0.0007) [2023-12-27 20:19:57,723][106225] Updated weights for policy 1, policy_version 153737 (0.0008) [2023-12-27 20:19:57,779][106225] Updated weights for policy 1, policy_version 153747 (0.0007) [2023-12-27 20:19:57,828][106225] Updated weights for policy 1, policy_version 153757 (0.0008) [2023-12-27 20:19:58,047][106226] Updated weights for policy 0, policy_version 153479 (0.0009) [2023-12-27 20:19:58,092][106226] Updated weights for policy 0, policy_version 153489 (0.0008) [2023-12-27 20:19:58,139][106226] Updated weights for policy 0, policy_version 153499 (0.0008) [2023-12-27 20:19:58,534][106225] Updated weights for policy 1, policy_version 153767 (0.0009) [2023-12-27 20:19:58,599][106225] Updated weights for policy 1, policy_version 153777 (0.0008) [2023-12-27 20:19:58,668][106225] Updated weights for policy 1, policy_version 153787 (0.0009) [2023-12-27 20:19:58,964][106226] Updated weights for policy 0, policy_version 153509 (0.0010) [2023-12-27 20:19:59,020][106226] Updated weights for policy 0, policy_version 153519 (0.0011) [2023-12-27 20:19:59,078][106226] Updated weights for policy 0, policy_version 153529 (0.0011) [2023-12-27 20:19:59,456][106225] Updated weights for policy 1, policy_version 153797 (0.0008) [2023-12-27 20:19:59,511][106225] Updated weights for policy 1, policy_version 153807 (0.0007) [2023-12-27 20:19:59,561][106225] Updated weights for policy 1, policy_version 153817 (0.0008) [2023-12-27 20:19:59,849][106226] Updated weights for policy 0, policy_version 153539 (0.0010) [2023-12-27 20:19:59,922][106226] Updated weights for policy 0, policy_version 153549 (0.0008) [2023-12-27 20:19:59,992][106226] Updated weights for policy 0, policy_version 153559 (0.0010) [2023-12-27 20:20:00,306][106225] Updated weights for policy 1, policy_version 153827 (0.0008) [2023-12-27 20:20:00,365][106225] Updated weights for policy 1, policy_version 153837 (0.0006) [2023-12-27 20:20:00,417][106225] Updated weights for policy 1, policy_version 153847 (0.0005) [2023-12-27 20:20:00,658][106226] Updated weights for policy 0, policy_version 153569 (0.0007) [2023-12-27 20:20:00,719][106226] Updated weights for policy 0, policy_version 153579 (0.0010) [2023-12-27 20:20:00,781][106226] Updated weights for policy 0, policy_version 153589 (0.0010) [2023-12-27 20:20:00,843][106226] Updated weights for policy 0, policy_version 153599 (0.0005) [2023-12-27 20:20:01,086][106225] Updated weights for policy 1, policy_version 153857 (0.0006) [2023-12-27 20:20:01,154][106225] Updated weights for policy 1, policy_version 153867 (0.0009) [2023-12-27 20:20:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 78725120. Throughput: 0: 9939.7, 1: 9852.4. Samples: 78717048. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:01,175][105115] Avg episode reward: [(0, '-5.368'), (1, '-6.293')] [2023-12-27 20:20:01,203][106225] Updated weights for policy 1, policy_version 153877 (0.0006) [2023-12-27 20:20:01,261][106225] Updated weights for policy 1, policy_version 153887 (0.0008) [2023-12-27 20:20:01,527][106226] Updated weights for policy 0, policy_version 153609 (0.0007) [2023-12-27 20:20:01,591][106226] Updated weights for policy 0, policy_version 153619 (0.0009) [2023-12-27 20:20:01,660][106226] Updated weights for policy 0, policy_version 153629 (0.0007) [2023-12-27 20:20:02,023][106225] Updated weights for policy 1, policy_version 153897 (0.0008) [2023-12-27 20:20:02,078][106225] Updated weights for policy 1, policy_version 153907 (0.0008) [2023-12-27 20:20:02,131][106225] Updated weights for policy 1, policy_version 153917 (0.0009) [2023-12-27 20:20:02,323][106226] Updated weights for policy 0, policy_version 153639 (0.0009) [2023-12-27 20:20:02,390][106226] Updated weights for policy 0, policy_version 153649 (0.0009) [2023-12-27 20:20:02,449][106226] Updated weights for policy 0, policy_version 153659 (0.0008) [2023-12-27 20:20:02,877][106225] Updated weights for policy 1, policy_version 153927 (0.0008) [2023-12-27 20:20:02,935][106225] Updated weights for policy 1, policy_version 153937 (0.0007) [2023-12-27 20:20:03,022][106225] Updated weights for policy 1, policy_version 153947 (0.0008) [2023-12-27 20:20:03,185][106226] Updated weights for policy 0, policy_version 153669 (0.0010) [2023-12-27 20:20:03,234][106226] Updated weights for policy 0, policy_version 153679 (0.0010) [2023-12-27 20:20:03,293][106226] Updated weights for policy 0, policy_version 153689 (0.0010) [2023-12-27 20:20:03,695][106225] Updated weights for policy 1, policy_version 153957 (0.0007) [2023-12-27 20:20:03,761][106225] Updated weights for policy 1, policy_version 153967 (0.0006) [2023-12-27 20:20:03,829][106225] Updated weights for policy 1, policy_version 153977 (0.0009) [2023-12-27 20:20:03,975][106226] Updated weights for policy 0, policy_version 153699 (0.0009) [2023-12-27 20:20:04,048][106226] Updated weights for policy 0, policy_version 153709 (0.0008) [2023-12-27 20:20:04,112][106226] Updated weights for policy 0, policy_version 153719 (0.0008) [2023-12-27 20:20:04,494][106225] Updated weights for policy 1, policy_version 153987 (0.0008) [2023-12-27 20:20:04,567][106225] Updated weights for policy 1, policy_version 153997 (0.0008) [2023-12-27 20:20:04,627][106225] Updated weights for policy 1, policy_version 154007 (0.0007) [2023-12-27 20:20:04,804][106226] Updated weights for policy 0, policy_version 153729 (0.0006) [2023-12-27 20:20:04,854][106226] Updated weights for policy 0, policy_version 153739 (0.0010) [2023-12-27 20:20:04,900][106226] Updated weights for policy 0, policy_version 153749 (0.0010) [2023-12-27 20:20:04,961][106226] Updated weights for policy 0, policy_version 153759 (0.0010) [2023-12-27 20:20:05,243][106225] Updated weights for policy 1, policy_version 154017 (0.0010) [2023-12-27 20:20:05,300][106225] Updated weights for policy 1, policy_version 154027 (0.0010) [2023-12-27 20:20:05,360][106225] Updated weights for policy 1, policy_version 154037 (0.0008) [2023-12-27 20:20:05,419][106225] Updated weights for policy 1, policy_version 154047 (0.0008) [2023-12-27 20:20:05,644][106226] Updated weights for policy 0, policy_version 153769 (0.0010) [2023-12-27 20:20:05,707][106226] Updated weights for policy 0, policy_version 153779 (0.0006) [2023-12-27 20:20:05,771][106226] Updated weights for policy 0, policy_version 153789 (0.0006) [2023-12-27 20:20:06,036][106225] Updated weights for policy 1, policy_version 154057 (0.0008) [2023-12-27 20:20:06,090][106225] Updated weights for policy 1, policy_version 154067 (0.0006) [2023-12-27 20:20:06,153][106225] Updated weights for policy 1, policy_version 154077 (0.0010) [2023-12-27 20:20:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 78831616. Throughput: 0: 9918.4, 1: 9928.3. Samples: 78837884. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:06,175][105115] Avg episode reward: [(0, '-5.205'), (1, '-5.918')] [2023-12-27 20:20:06,361][106226] Updated weights for policy 0, policy_version 153799 (0.0010) [2023-12-27 20:20:06,420][106226] Updated weights for policy 0, policy_version 153809 (0.0011) [2023-12-27 20:20:06,481][106226] Updated weights for policy 0, policy_version 153819 (0.0011) [2023-12-27 20:20:06,867][106225] Updated weights for policy 1, policy_version 154087 (0.0010) [2023-12-27 20:20:06,924][106225] Updated weights for policy 1, policy_version 154097 (0.0010) [2023-12-27 20:20:06,977][106225] Updated weights for policy 1, policy_version 154107 (0.0010) [2023-12-27 20:20:07,175][106226] Updated weights for policy 0, policy_version 153829 (0.0009) [2023-12-27 20:20:07,224][106226] Updated weights for policy 0, policy_version 153839 (0.0009) [2023-12-27 20:20:07,282][106226] Updated weights for policy 0, policy_version 153849 (0.0008) [2023-12-27 20:20:07,605][106225] Updated weights for policy 1, policy_version 154117 (0.0010) [2023-12-27 20:20:07,656][106225] Updated weights for policy 1, policy_version 154127 (0.0009) [2023-12-27 20:20:07,714][106225] Updated weights for policy 1, policy_version 154137 (0.0008) [2023-12-27 20:20:07,954][106226] Updated weights for policy 0, policy_version 153859 (0.0008) [2023-12-27 20:20:08,012][106226] Updated weights for policy 0, policy_version 153869 (0.0008) [2023-12-27 20:20:08,066][106226] Updated weights for policy 0, policy_version 153879 (0.0007) [2023-12-27 20:20:08,450][106225] Updated weights for policy 1, policy_version 154147 (0.0009) [2023-12-27 20:20:08,510][106225] Updated weights for policy 1, policy_version 154157 (0.0006) [2023-12-27 20:20:08,577][106225] Updated weights for policy 1, policy_version 154167 (0.0007) [2023-12-27 20:20:08,795][106226] Updated weights for policy 0, policy_version 153889 (0.0007) [2023-12-27 20:20:08,846][106226] Updated weights for policy 0, policy_version 153899 (0.0009) [2023-12-27 20:20:08,906][106226] Updated weights for policy 0, policy_version 153909 (0.0009) [2023-12-27 20:20:08,966][106226] Updated weights for policy 0, policy_version 153919 (0.0009) [2023-12-27 20:20:09,307][106225] Updated weights for policy 1, policy_version 154177 (0.0008) [2023-12-27 20:20:09,379][106225] Updated weights for policy 1, policy_version 154187 (0.0007) [2023-12-27 20:20:09,454][106225] Updated weights for policy 1, policy_version 154197 (0.0008) [2023-12-27 20:20:09,510][106225] Updated weights for policy 1, policy_version 154207 (0.0007) [2023-12-27 20:20:09,742][106226] Updated weights for policy 0, policy_version 153929 (0.0006) [2023-12-27 20:20:09,803][106226] Updated weights for policy 0, policy_version 153939 (0.0011) [2023-12-27 20:20:09,871][106226] Updated weights for policy 0, policy_version 153949 (0.0009) [2023-12-27 20:20:10,268][106225] Updated weights for policy 1, policy_version 154217 (0.0008) [2023-12-27 20:20:10,326][106225] Updated weights for policy 1, policy_version 154227 (0.0007) [2023-12-27 20:20:10,383][106225] Updated weights for policy 1, policy_version 154237 (0.0007) [2023-12-27 20:20:10,579][106226] Updated weights for policy 0, policy_version 153959 (0.0010) [2023-12-27 20:20:10,639][106226] Updated weights for policy 0, policy_version 153969 (0.0006) [2023-12-27 20:20:10,698][106226] Updated weights for policy 0, policy_version 153979 (0.0008) [2023-12-27 20:20:11,117][106225] Updated weights for policy 1, policy_version 154247 (0.0008) [2023-12-27 20:20:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 78921728. Throughput: 0: 9945.3, 1: 9970.9. Samples: 78897028. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:11,175][105115] Avg episode reward: [(0, '-5.517'), (1, '-6.225')] [2023-12-27 20:20:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000153984_39428096.pth... [2023-12-27 20:20:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000152832_39133184.pth [2023-12-27 20:20:11,188][106225] Updated weights for policy 1, policy_version 154257 (0.0007) [2023-12-27 20:20:11,246][106225] Updated weights for policy 1, policy_version 154267 (0.0008) [2023-12-27 20:20:11,278][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000154272_39501824.pth... [2023-12-27 20:20:11,282][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000153088_39198720.pth [2023-12-27 20:20:11,408][106226] Updated weights for policy 0, policy_version 153989 (0.0007) [2023-12-27 20:20:11,473][106226] Updated weights for policy 0, policy_version 153999 (0.0008) [2023-12-27 20:20:11,537][106226] Updated weights for policy 0, policy_version 154009 (0.0010) [2023-12-27 20:20:11,949][106225] Updated weights for policy 1, policy_version 154277 (0.0008) [2023-12-27 20:20:12,000][106225] Updated weights for policy 1, policy_version 154287 (0.0008) [2023-12-27 20:20:12,047][106225] Updated weights for policy 1, policy_version 154297 (0.0008) [2023-12-27 20:20:12,252][106226] Updated weights for policy 0, policy_version 154019 (0.0009) [2023-12-27 20:20:12,318][106226] Updated weights for policy 0, policy_version 154029 (0.0008) [2023-12-27 20:20:12,388][106226] Updated weights for policy 0, policy_version 154039 (0.0009) [2023-12-27 20:20:12,726][106225] Updated weights for policy 1, policy_version 154307 (0.0008) [2023-12-27 20:20:12,792][106225] Updated weights for policy 1, policy_version 154317 (0.0008) [2023-12-27 20:20:12,855][106225] Updated weights for policy 1, policy_version 154327 (0.0008) [2023-12-27 20:20:13,184][106226] Updated weights for policy 0, policy_version 154049 (0.0009) [2023-12-27 20:20:13,245][106226] Updated weights for policy 0, policy_version 154059 (0.0007) [2023-12-27 20:20:13,295][106226] Updated weights for policy 0, policy_version 154069 (0.0009) [2023-12-27 20:20:13,351][106226] Updated weights for policy 0, policy_version 154079 (0.0009) [2023-12-27 20:20:13,563][106225] Updated weights for policy 1, policy_version 154337 (0.0009) [2023-12-27 20:20:13,616][106225] Updated weights for policy 1, policy_version 154347 (0.0008) [2023-12-27 20:20:13,676][106225] Updated weights for policy 1, policy_version 154357 (0.0007) [2023-12-27 20:20:13,726][106225] Updated weights for policy 1, policy_version 154367 (0.0009) [2023-12-27 20:20:13,913][106226] Updated weights for policy 0, policy_version 154089 (0.0006) [2023-12-27 20:20:13,970][106226] Updated weights for policy 0, policy_version 154099 (0.0005) [2023-12-27 20:20:14,025][106226] Updated weights for policy 0, policy_version 154109 (0.0005) [2023-12-27 20:20:14,541][106225] Updated weights for policy 1, policy_version 154377 (0.0008) [2023-12-27 20:20:14,590][106225] Updated weights for policy 1, policy_version 154387 (0.0008) [2023-12-27 20:20:14,639][106226] Updated weights for policy 0, policy_version 154119 (0.0006) [2023-12-27 20:20:14,648][106225] Updated weights for policy 1, policy_version 154397 (0.0007) [2023-12-27 20:20:14,692][106226] Updated weights for policy 0, policy_version 154129 (0.0007) [2023-12-27 20:20:14,742][106226] Updated weights for policy 0, policy_version 154139 (0.0009) [2023-12-27 20:20:15,367][106225] Updated weights for policy 1, policy_version 154407 (0.0009) [2023-12-27 20:20:15,415][106225] Updated weights for policy 1, policy_version 154417 (0.0008) [2023-12-27 20:20:15,469][106225] Updated weights for policy 1, policy_version 154427 (0.0008) [2023-12-27 20:20:15,500][106226] Updated weights for policy 0, policy_version 154149 (0.0007) [2023-12-27 20:20:15,549][106226] Updated weights for policy 0, policy_version 154159 (0.0009) [2023-12-27 20:20:15,605][106226] Updated weights for policy 0, policy_version 154169 (0.0009) [2023-12-27 20:20:16,119][106225] Updated weights for policy 1, policy_version 154437 (0.0008) [2023-12-27 20:20:16,168][106225] Updated weights for policy 1, policy_version 154447 (0.0008) [2023-12-27 20:20:16,175][105115] Fps is (10 sec: 18840.9, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 79020032. Throughput: 0: 9892.2, 1: 9883.6. Samples: 79012988. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:16,176][105115] Avg episode reward: [(0, '-5.137'), (1, '-6.583')] [2023-12-27 20:20:16,216][106225] Updated weights for policy 1, policy_version 154457 (0.0008) [2023-12-27 20:20:16,291][106226] Updated weights for policy 0, policy_version 154179 (0.0007) [2023-12-27 20:20:16,346][106226] Updated weights for policy 0, policy_version 154189 (0.0005) [2023-12-27 20:20:16,401][106226] Updated weights for policy 0, policy_version 154199 (0.0005) [2023-12-27 20:20:16,934][106226] Updated weights for policy 0, policy_version 154209 (0.0008) [2023-12-27 20:20:16,980][106225] Updated weights for policy 1, policy_version 154467 (0.0007) [2023-12-27 20:20:16,993][106226] Updated weights for policy 0, policy_version 154219 (0.0008) [2023-12-27 20:20:17,029][106225] Updated weights for policy 1, policy_version 154477 (0.0005) [2023-12-27 20:20:17,049][106226] Updated weights for policy 0, policy_version 154229 (0.0009) [2023-12-27 20:20:17,081][106225] Updated weights for policy 1, policy_version 154487 (0.0009) [2023-12-27 20:20:17,107][106226] Updated weights for policy 0, policy_version 154239 (0.0007) [2023-12-27 20:20:17,718][106226] Updated weights for policy 0, policy_version 154249 (0.0006) [2023-12-27 20:20:17,771][106226] Updated weights for policy 0, policy_version 154259 (0.0006) [2023-12-27 20:20:17,826][106226] Updated weights for policy 0, policy_version 154269 (0.0006) [2023-12-27 20:20:17,844][106225] Updated weights for policy 1, policy_version 154497 (0.0006) [2023-12-27 20:20:17,911][106225] Updated weights for policy 1, policy_version 154507 (0.0009) [2023-12-27 20:20:17,971][106225] Updated weights for policy 1, policy_version 154517 (0.0007) [2023-12-27 20:20:18,036][106225] Updated weights for policy 1, policy_version 154527 (0.0008) [2023-12-27 20:20:18,517][106226] Updated weights for policy 0, policy_version 154279 (0.0010) [2023-12-27 20:20:18,581][106226] Updated weights for policy 0, policy_version 154289 (0.0011) [2023-12-27 20:20:18,631][106226] Updated weights for policy 0, policy_version 154299 (0.0010) [2023-12-27 20:20:18,752][106225] Updated weights for policy 1, policy_version 154537 (0.0007) [2023-12-27 20:20:18,814][106225] Updated weights for policy 1, policy_version 154547 (0.0007) [2023-12-27 20:20:18,876][106225] Updated weights for policy 1, policy_version 154557 (0.0005) [2023-12-27 20:20:19,307][106226] Updated weights for policy 0, policy_version 154309 (0.0010) [2023-12-27 20:20:19,379][106226] Updated weights for policy 0, policy_version 154319 (0.0009) [2023-12-27 20:20:19,432][106226] Updated weights for policy 0, policy_version 154329 (0.0009) [2023-12-27 20:20:19,523][106225] Updated weights for policy 1, policy_version 154567 (0.0008) [2023-12-27 20:20:19,586][106225] Updated weights for policy 1, policy_version 154577 (0.0005) [2023-12-27 20:20:19,658][106225] Updated weights for policy 1, policy_version 154587 (0.0005) [2023-12-27 20:20:20,213][106226] Updated weights for policy 0, policy_version 154339 (0.0008) [2023-12-27 20:20:20,273][106226] Updated weights for policy 0, policy_version 154349 (0.0009) [2023-12-27 20:20:20,332][106225] Updated weights for policy 1, policy_version 154597 (0.0007) [2023-12-27 20:20:20,334][106226] Updated weights for policy 0, policy_version 154359 (0.0008) [2023-12-27 20:20:20,393][106225] Updated weights for policy 1, policy_version 154607 (0.0006) [2023-12-27 20:20:20,450][106225] Updated weights for policy 1, policy_version 154617 (0.0008) [2023-12-27 20:20:21,070][106226] Updated weights for policy 0, policy_version 154369 (0.0009) [2023-12-27 20:20:21,131][106226] Updated weights for policy 0, policy_version 154379 (0.0008) [2023-12-27 20:20:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 79118336. Throughput: 0: 9878.0, 1: 9903.9. Samples: 79133292. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:21,175][105115] Avg episode reward: [(0, '-5.305'), (1, '-6.755')] [2023-12-27 20:20:21,192][106226] Updated weights for policy 0, policy_version 154389 (0.0006) [2023-12-27 20:20:21,253][106226] Updated weights for policy 0, policy_version 154399 (0.0008) [2023-12-27 20:20:21,255][106225] Updated weights for policy 1, policy_version 154627 (0.0009) [2023-12-27 20:20:21,321][106225] Updated weights for policy 1, policy_version 154637 (0.0008) [2023-12-27 20:20:21,392][106225] Updated weights for policy 1, policy_version 154647 (0.0009) [2023-12-27 20:20:21,983][106226] Updated weights for policy 0, policy_version 154409 (0.0007) [2023-12-27 20:20:22,038][106226] Updated weights for policy 0, policy_version 154419 (0.0009) [2023-12-27 20:20:22,096][106226] Updated weights for policy 0, policy_version 154429 (0.0009) [2023-12-27 20:20:22,205][106225] Updated weights for policy 1, policy_version 154657 (0.0008) [2023-12-27 20:20:22,268][106225] Updated weights for policy 1, policy_version 154667 (0.0006) [2023-12-27 20:20:22,340][106225] Updated weights for policy 1, policy_version 154677 (0.0008) [2023-12-27 20:20:22,406][106225] Updated weights for policy 1, policy_version 154687 (0.0008) [2023-12-27 20:20:22,821][106226] Updated weights for policy 0, policy_version 154439 (0.0010) [2023-12-27 20:20:22,886][106226] Updated weights for policy 0, policy_version 154449 (0.0011) [2023-12-27 20:20:22,940][106226] Updated weights for policy 0, policy_version 154459 (0.0010) [2023-12-27 20:20:23,084][106225] Updated weights for policy 1, policy_version 154697 (0.0008) [2023-12-27 20:20:23,149][106225] Updated weights for policy 1, policy_version 154707 (0.0008) [2023-12-27 20:20:23,207][106225] Updated weights for policy 1, policy_version 154717 (0.0008) [2023-12-27 20:20:23,573][106226] Updated weights for policy 0, policy_version 154469 (0.0006) [2023-12-27 20:20:23,635][106226] Updated weights for policy 0, policy_version 154479 (0.0009) [2023-12-27 20:20:23,698][106226] Updated weights for policy 0, policy_version 154489 (0.0011) [2023-12-27 20:20:23,984][106225] Updated weights for policy 1, policy_version 154727 (0.0009) [2023-12-27 20:20:24,048][106225] Updated weights for policy 1, policy_version 154737 (0.0008) [2023-12-27 20:20:24,101][106225] Updated weights for policy 1, policy_version 154747 (0.0007) [2023-12-27 20:20:24,381][106226] Updated weights for policy 0, policy_version 154499 (0.0010) [2023-12-27 20:20:24,444][106226] Updated weights for policy 0, policy_version 154509 (0.0010) [2023-12-27 20:20:24,497][106226] Updated weights for policy 0, policy_version 154519 (0.0011) [2023-12-27 20:20:24,757][106225] Updated weights for policy 1, policy_version 154757 (0.0006) [2023-12-27 20:20:24,805][106225] Updated weights for policy 1, policy_version 154767 (0.0005) [2023-12-27 20:20:24,857][106225] Updated weights for policy 1, policy_version 154777 (0.0005) [2023-12-27 20:20:25,229][106226] Updated weights for policy 0, policy_version 154529 (0.0010) [2023-12-27 20:20:25,287][106226] Updated weights for policy 0, policy_version 154539 (0.0010) [2023-12-27 20:20:25,347][106226] Updated weights for policy 0, policy_version 154549 (0.0010) [2023-12-27 20:20:25,405][106226] Updated weights for policy 0, policy_version 154559 (0.0009) [2023-12-27 20:20:25,456][106225] Updated weights for policy 1, policy_version 154787 (0.0007) [2023-12-27 20:20:25,517][106225] Updated weights for policy 1, policy_version 154797 (0.0007) [2023-12-27 20:20:25,577][106225] Updated weights for policy 1, policy_version 154807 (0.0006) [2023-12-27 20:20:25,972][106226] Updated weights for policy 0, policy_version 154569 (0.0006) [2023-12-27 20:20:26,038][106226] Updated weights for policy 0, policy_version 154579 (0.0005) [2023-12-27 20:20:26,097][106226] Updated weights for policy 0, policy_version 154589 (0.0005) [2023-12-27 20:20:26,149][106225] Updated weights for policy 1, policy_version 154817 (0.0005) [2023-12-27 20:20:26,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 79224832. Throughput: 0: 9889.2, 1: 9847.8. Samples: 79190408. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:26,176][105115] Avg episode reward: [(0, '-5.391'), (1, '-6.546')] [2023-12-27 20:20:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000154592_39583744.pth... [2023-12-27 20:20:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000153408_39280640.pth [2023-12-27 20:20:26,213][106225] Updated weights for policy 1, policy_version 154827 (0.0005) [2023-12-27 20:20:26,261][106225] Updated weights for policy 1, policy_version 154837 (0.0007) [2023-12-27 20:20:26,306][106225] Updated weights for policy 1, policy_version 154847 (0.0008) [2023-12-27 20:20:26,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000154848_39649280.pth... [2023-12-27 20:20:26,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000153696_39354368.pth [2023-12-27 20:20:26,715][106226] Updated weights for policy 0, policy_version 154599 (0.0006) [2023-12-27 20:20:26,784][106226] Updated weights for policy 0, policy_version 154609 (0.0006) [2023-12-27 20:20:26,843][106226] Updated weights for policy 0, policy_version 154619 (0.0008) [2023-12-27 20:20:27,051][106225] Updated weights for policy 1, policy_version 154857 (0.0010) [2023-12-27 20:20:27,109][106225] Updated weights for policy 1, policy_version 154867 (0.0010) [2023-12-27 20:20:27,168][106225] Updated weights for policy 1, policy_version 154877 (0.0010) [2023-12-27 20:20:27,462][106226] Updated weights for policy 0, policy_version 154629 (0.0007) [2023-12-27 20:20:27,512][106226] Updated weights for policy 0, policy_version 154639 (0.0008) [2023-12-27 20:20:27,577][106226] Updated weights for policy 0, policy_version 154649 (0.0008) [2023-12-27 20:20:27,849][106225] Updated weights for policy 1, policy_version 154887 (0.0007) [2023-12-27 20:20:27,911][106225] Updated weights for policy 1, policy_version 154897 (0.0006) [2023-12-27 20:20:27,960][106225] Updated weights for policy 1, policy_version 154907 (0.0005) [2023-12-27 20:20:28,297][106226] Updated weights for policy 0, policy_version 154659 (0.0007) [2023-12-27 20:20:28,370][106226] Updated weights for policy 0, policy_version 154669 (0.0008) [2023-12-27 20:20:28,439][106226] Updated weights for policy 0, policy_version 154679 (0.0009) [2023-12-27 20:20:28,505][106225] Updated weights for policy 1, policy_version 154917 (0.0006) [2023-12-27 20:20:28,564][106225] Updated weights for policy 1, policy_version 154927 (0.0007) [2023-12-27 20:20:28,629][106225] Updated weights for policy 1, policy_version 154937 (0.0008) [2023-12-27 20:20:29,115][106226] Updated weights for policy 0, policy_version 154689 (0.0009) [2023-12-27 20:20:29,166][106226] Updated weights for policy 0, policy_version 154699 (0.0008) [2023-12-27 20:20:29,215][106226] Updated weights for policy 0, policy_version 154709 (0.0009) [2023-12-27 20:20:29,277][106226] Updated weights for policy 0, policy_version 154719 (0.0008) [2023-12-27 20:20:29,342][106225] Updated weights for policy 1, policy_version 154947 (0.0008) [2023-12-27 20:20:29,411][106225] Updated weights for policy 1, policy_version 154957 (0.0008) [2023-12-27 20:20:29,469][106225] Updated weights for policy 1, policy_version 154967 (0.0008) [2023-12-27 20:20:30,015][106226] Updated weights for policy 0, policy_version 154729 (0.0010) [2023-12-27 20:20:30,076][106226] Updated weights for policy 0, policy_version 154739 (0.0009) [2023-12-27 20:20:30,134][106226] Updated weights for policy 0, policy_version 154749 (0.0008) [2023-12-27 20:20:30,147][106225] Updated weights for policy 1, policy_version 154977 (0.0007) [2023-12-27 20:20:30,199][106225] Updated weights for policy 1, policy_version 154987 (0.0010) [2023-12-27 20:20:30,255][106225] Updated weights for policy 1, policy_version 154997 (0.0010) [2023-12-27 20:20:30,312][106225] Updated weights for policy 1, policy_version 155007 (0.0009) [2023-12-27 20:20:30,817][106226] Updated weights for policy 0, policy_version 154759 (0.0008) [2023-12-27 20:20:30,866][106226] Updated weights for policy 0, policy_version 154769 (0.0007) [2023-12-27 20:20:30,924][106226] Updated weights for policy 0, policy_version 154779 (0.0006) [2023-12-27 20:20:31,043][106225] Updated weights for policy 1, policy_version 155017 (0.0010) [2023-12-27 20:20:31,109][106225] Updated weights for policy 1, policy_version 155027 (0.0011) [2023-12-27 20:20:31,175][106225] Updated weights for policy 1, policy_version 155037 (0.0009) [2023-12-27 20:20:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 79323136. Throughput: 0: 9974.3, 1: 9884.2. Samples: 79314944. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:31,175][105115] Avg episode reward: [(0, '-5.148'), (1, '-6.447')] [2023-12-27 20:20:31,713][106226] Updated weights for policy 0, policy_version 154789 (0.0008) [2023-12-27 20:20:31,786][106226] Updated weights for policy 0, policy_version 154799 (0.0008) [2023-12-27 20:20:31,855][106226] Updated weights for policy 0, policy_version 154809 (0.0008) [2023-12-27 20:20:31,880][106225] Updated weights for policy 1, policy_version 155047 (0.0006) [2023-12-27 20:20:31,945][106225] Updated weights for policy 1, policy_version 155057 (0.0006) [2023-12-27 20:20:31,994][106225] Updated weights for policy 1, policy_version 155067 (0.0008) [2023-12-27 20:20:32,488][106226] Updated weights for policy 0, policy_version 154819 (0.0007) [2023-12-27 20:20:32,547][106226] Updated weights for policy 0, policy_version 154829 (0.0007) [2023-12-27 20:20:32,596][106226] Updated weights for policy 0, policy_version 154839 (0.0010) [2023-12-27 20:20:32,637][106225] Updated weights for policy 1, policy_version 155077 (0.0007) [2023-12-27 20:20:32,691][106225] Updated weights for policy 1, policy_version 155087 (0.0005) [2023-12-27 20:20:32,743][106225] Updated weights for policy 1, policy_version 155097 (0.0007) [2023-12-27 20:20:33,274][106225] Updated weights for policy 1, policy_version 155107 (0.0006) [2023-12-27 20:20:33,337][106225] Updated weights for policy 1, policy_version 155117 (0.0005) [2023-12-27 20:20:33,350][106226] Updated weights for policy 0, policy_version 154849 (0.0008) [2023-12-27 20:20:33,387][106225] Updated weights for policy 1, policy_version 155127 (0.0005) [2023-12-27 20:20:33,403][106226] Updated weights for policy 0, policy_version 154859 (0.0006) [2023-12-27 20:20:33,455][106226] Updated weights for policy 0, policy_version 154869 (0.0008) [2023-12-27 20:20:33,504][106226] Updated weights for policy 0, policy_version 154879 (0.0008) [2023-12-27 20:20:33,953][106225] Updated weights for policy 1, policy_version 155137 (0.0006) [2023-12-27 20:20:34,015][106225] Updated weights for policy 1, policy_version 155147 (0.0008) [2023-12-27 20:20:34,077][106225] Updated weights for policy 1, policy_version 155157 (0.0008) [2023-12-27 20:20:34,136][106225] Updated weights for policy 1, policy_version 155167 (0.0009) [2023-12-27 20:20:34,206][106226] Updated weights for policy 0, policy_version 154889 (0.0008) [2023-12-27 20:20:34,267][106226] Updated weights for policy 0, policy_version 154899 (0.0009) [2023-12-27 20:20:34,319][106226] Updated weights for policy 0, policy_version 154909 (0.0008) [2023-12-27 20:20:34,865][106225] Updated weights for policy 1, policy_version 155177 (0.0008) [2023-12-27 20:20:34,920][106225] Updated weights for policy 1, policy_version 155187 (0.0007) [2023-12-27 20:20:34,974][106225] Updated weights for policy 1, policy_version 155197 (0.0007) [2023-12-27 20:20:35,118][106226] Updated weights for policy 0, policy_version 154919 (0.0010) [2023-12-27 20:20:35,172][106226] Updated weights for policy 0, policy_version 154929 (0.0011) [2023-12-27 20:20:35,229][106226] Updated weights for policy 0, policy_version 154939 (0.0010) [2023-12-27 20:20:35,620][106225] Updated weights for policy 1, policy_version 155207 (0.0006) [2023-12-27 20:20:35,666][106225] Updated weights for policy 1, policy_version 155217 (0.0005) [2023-12-27 20:20:35,731][106225] Updated weights for policy 1, policy_version 155227 (0.0005) [2023-12-27 20:20:35,937][106226] Updated weights for policy 0, policy_version 154949 (0.0010) [2023-12-27 20:20:35,997][106226] Updated weights for policy 0, policy_version 154959 (0.0011) [2023-12-27 20:20:36,047][106226] Updated weights for policy 0, policy_version 154969 (0.0010) [2023-12-27 20:20:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 79429632. Throughput: 0: 9934.3, 1: 10002.9. Samples: 79436336. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:36,175][105115] Avg episode reward: [(0, '-5.147'), (1, '-5.999')] [2023-12-27 20:20:36,432][106225] Updated weights for policy 1, policy_version 155237 (0.0010) [2023-12-27 20:20:36,497][106225] Updated weights for policy 1, policy_version 155247 (0.0011) [2023-12-27 20:20:36,548][106225] Updated weights for policy 1, policy_version 155257 (0.0010) [2023-12-27 20:20:36,744][106226] Updated weights for policy 0, policy_version 154979 (0.0010) [2023-12-27 20:20:36,808][106226] Updated weights for policy 0, policy_version 154989 (0.0011) [2023-12-27 20:20:36,868][106226] Updated weights for policy 0, policy_version 154999 (0.0010) [2023-12-27 20:20:37,285][106225] Updated weights for policy 1, policy_version 155267 (0.0010) [2023-12-27 20:20:37,349][106225] Updated weights for policy 1, policy_version 155277 (0.0007) [2023-12-27 20:20:37,414][106225] Updated weights for policy 1, policy_version 155287 (0.0006) [2023-12-27 20:20:37,470][106226] Updated weights for policy 0, policy_version 155009 (0.0006) [2023-12-27 20:20:37,533][106226] Updated weights for policy 0, policy_version 155019 (0.0006) [2023-12-27 20:20:37,605][106226] Updated weights for policy 0, policy_version 155029 (0.0008) [2023-12-27 20:20:37,676][106226] Updated weights for policy 0, policy_version 155039 (0.0010) [2023-12-27 20:20:38,101][106225] Updated weights for policy 1, policy_version 155297 (0.0009) [2023-12-27 20:20:38,153][106225] Updated weights for policy 1, policy_version 155307 (0.0007) [2023-12-27 20:20:38,204][106225] Updated weights for policy 1, policy_version 155317 (0.0007) [2023-12-27 20:20:38,256][106225] Updated weights for policy 1, policy_version 155327 (0.0007) [2023-12-27 20:20:38,300][106226] Updated weights for policy 0, policy_version 155049 (0.0009) [2023-12-27 20:20:38,367][106226] Updated weights for policy 0, policy_version 155059 (0.0008) [2023-12-27 20:20:38,434][106226] Updated weights for policy 0, policy_version 155069 (0.0009) [2023-12-27 20:20:38,963][106225] Updated weights for policy 1, policy_version 155337 (0.0008) [2023-12-27 20:20:39,016][106225] Updated weights for policy 1, policy_version 155347 (0.0008) [2023-12-27 20:20:39,086][106225] Updated weights for policy 1, policy_version 155357 (0.0008) [2023-12-27 20:20:39,165][106226] Updated weights for policy 0, policy_version 155079 (0.0010) [2023-12-27 20:20:39,232][106226] Updated weights for policy 0, policy_version 155089 (0.0010) [2023-12-27 20:20:39,302][106226] Updated weights for policy 0, policy_version 155099 (0.0011) [2023-12-27 20:20:39,908][106225] Updated weights for policy 1, policy_version 155367 (0.0008) [2023-12-27 20:20:39,976][106225] Updated weights for policy 1, policy_version 155377 (0.0008) [2023-12-27 20:20:40,016][106226] Updated weights for policy 0, policy_version 155109 (0.0010) [2023-12-27 20:20:40,038][106225] Updated weights for policy 1, policy_version 155387 (0.0008) [2023-12-27 20:20:40,077][106226] Updated weights for policy 0, policy_version 155119 (0.0011) [2023-12-27 20:20:40,139][106226] Updated weights for policy 0, policy_version 155129 (0.0011) [2023-12-27 20:20:40,770][106225] Updated weights for policy 1, policy_version 155397 (0.0008) [2023-12-27 20:20:40,824][106225] Updated weights for policy 1, policy_version 155407 (0.0008) [2023-12-27 20:20:40,833][106226] Updated weights for policy 0, policy_version 155139 (0.0011) [2023-12-27 20:20:40,883][106225] Updated weights for policy 1, policy_version 155417 (0.0006) [2023-12-27 20:20:40,890][106226] Updated weights for policy 0, policy_version 155149 (0.0010) [2023-12-27 20:20:40,943][106226] Updated weights for policy 0, policy_version 155159 (0.0010) [2023-12-27 20:20:41,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 79527936. Throughput: 0: 9970.3, 1: 9980.3. Samples: 79496044. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:41,175][105115] Avg episode reward: [(0, '-5.317'), (1, '-6.533')] [2023-12-27 20:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000155424_39796736.pth... [2023-12-27 20:20:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000155168_39731200.pth... [2023-12-27 20:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000153984_39428096.pth [2023-12-27 20:20:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000154272_39501824.pth [2023-12-27 20:20:41,639][106225] Updated weights for policy 1, policy_version 155427 (0.0007) [2023-12-27 20:20:41,709][106225] Updated weights for policy 1, policy_version 155437 (0.0008) [2023-12-27 20:20:41,758][106226] Updated weights for policy 0, policy_version 155169 (0.0010) [2023-12-27 20:20:41,775][106225] Updated weights for policy 1, policy_version 155447 (0.0008) [2023-12-27 20:20:41,825][106226] Updated weights for policy 0, policy_version 155179 (0.0008) [2023-12-27 20:20:41,902][106226] Updated weights for policy 0, policy_version 155189 (0.0008) [2023-12-27 20:20:41,972][106226] Updated weights for policy 0, policy_version 155199 (0.0009) [2023-12-27 20:20:42,417][106225] Updated weights for policy 1, policy_version 155457 (0.0007) [2023-12-27 20:20:42,470][106225] Updated weights for policy 1, policy_version 155467 (0.0009) [2023-12-27 20:20:42,528][106225] Updated weights for policy 1, policy_version 155477 (0.0009) [2023-12-27 20:20:42,588][106225] Updated weights for policy 1, policy_version 155487 (0.0008) [2023-12-27 20:20:42,678][106226] Updated weights for policy 0, policy_version 155209 (0.0007) [2023-12-27 20:20:42,739][106226] Updated weights for policy 0, policy_version 155219 (0.0009) [2023-12-27 20:20:42,807][106226] Updated weights for policy 0, policy_version 155229 (0.0009) [2023-12-27 20:20:43,318][106225] Updated weights for policy 1, policy_version 155497 (0.0007) [2023-12-27 20:20:43,376][106225] Updated weights for policy 1, policy_version 155507 (0.0006) [2023-12-27 20:20:43,434][106225] Updated weights for policy 1, policy_version 155517 (0.0008) [2023-12-27 20:20:43,531][106226] Updated weights for policy 0, policy_version 155239 (0.0010) [2023-12-27 20:20:43,591][106226] Updated weights for policy 0, policy_version 155249 (0.0010) [2023-12-27 20:20:43,648][106226] Updated weights for policy 0, policy_version 155259 (0.0008) [2023-12-27 20:20:44,064][106225] Updated weights for policy 1, policy_version 155527 (0.0008) [2023-12-27 20:20:44,124][106225] Updated weights for policy 1, policy_version 155537 (0.0008) [2023-12-27 20:20:44,185][106225] Updated weights for policy 1, policy_version 155547 (0.0008) [2023-12-27 20:20:44,309][106226] Updated weights for policy 0, policy_version 155269 (0.0006) [2023-12-27 20:20:44,375][106226] Updated weights for policy 0, policy_version 155279 (0.0005) [2023-12-27 20:20:44,444][106226] Updated weights for policy 0, policy_version 155289 (0.0007) [2023-12-27 20:20:44,882][106225] Updated weights for policy 1, policy_version 155557 (0.0009) [2023-12-27 20:20:44,947][106225] Updated weights for policy 1, policy_version 155567 (0.0010) [2023-12-27 20:20:45,014][106225] Updated weights for policy 1, policy_version 155577 (0.0011) [2023-12-27 20:20:45,133][106226] Updated weights for policy 0, policy_version 155299 (0.0011) [2023-12-27 20:20:45,205][106226] Updated weights for policy 0, policy_version 155309 (0.0009) [2023-12-27 20:20:45,274][106226] Updated weights for policy 0, policy_version 155319 (0.0011) [2023-12-27 20:20:45,742][106225] Updated weights for policy 1, policy_version 155587 (0.0011) [2023-12-27 20:20:45,791][106225] Updated weights for policy 1, policy_version 155597 (0.0008) [2023-12-27 20:20:45,812][106226] Updated weights for policy 0, policy_version 155329 (0.0010) [2023-12-27 20:20:45,852][106225] Updated weights for policy 1, policy_version 155607 (0.0009) [2023-12-27 20:20:45,858][106226] Updated weights for policy 0, policy_version 155339 (0.0005) [2023-12-27 20:20:45,907][106226] Updated weights for policy 0, policy_version 155349 (0.0008) [2023-12-27 20:20:45,960][106226] Updated weights for policy 0, policy_version 155359 (0.0010) [2023-12-27 20:20:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 79626240. Throughput: 0: 9953.0, 1: 9930.6. Samples: 79611808. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:46,175][105115] Avg episode reward: [(0, '-5.319'), (1, '-6.095')] [2023-12-27 20:20:46,491][106225] Updated weights for policy 1, policy_version 155617 (0.0007) [2023-12-27 20:20:46,560][106225] Updated weights for policy 1, policy_version 155627 (0.0008) [2023-12-27 20:20:46,610][106225] Updated weights for policy 1, policy_version 155637 (0.0007) [2023-12-27 20:20:46,655][106225] Updated weights for policy 1, policy_version 155647 (0.0005) [2023-12-27 20:20:46,656][106226] Updated weights for policy 0, policy_version 155369 (0.0006) [2023-12-27 20:20:46,704][106226] Updated weights for policy 0, policy_version 155379 (0.0006) [2023-12-27 20:20:46,759][106226] Updated weights for policy 0, policy_version 155389 (0.0009) [2023-12-27 20:20:47,324][106225] Updated weights for policy 1, policy_version 155657 (0.0009) [2023-12-27 20:20:47,388][106225] Updated weights for policy 1, policy_version 155667 (0.0009) [2023-12-27 20:20:47,435][106226] Updated weights for policy 0, policy_version 155399 (0.0008) [2023-12-27 20:20:47,447][106225] Updated weights for policy 1, policy_version 155677 (0.0007) [2023-12-27 20:20:47,483][106226] Updated weights for policy 0, policy_version 155409 (0.0006) [2023-12-27 20:20:47,545][106226] Updated weights for policy 0, policy_version 155419 (0.0008) [2023-12-27 20:20:48,142][106225] Updated weights for policy 1, policy_version 155687 (0.0008) [2023-12-27 20:20:48,201][106225] Updated weights for policy 1, policy_version 155697 (0.0008) [2023-12-27 20:20:48,246][106226] Updated weights for policy 0, policy_version 155429 (0.0008) [2023-12-27 20:20:48,253][106225] Updated weights for policy 1, policy_version 155707 (0.0007) [2023-12-27 20:20:48,303][106226] Updated weights for policy 0, policy_version 155439 (0.0008) [2023-12-27 20:20:48,373][106226] Updated weights for policy 0, policy_version 155449 (0.0009) [2023-12-27 20:20:48,983][106225] Updated weights for policy 1, policy_version 155717 (0.0007) [2023-12-27 20:20:49,042][106225] Updated weights for policy 1, policy_version 155727 (0.0006) [2023-12-27 20:20:49,095][106226] Updated weights for policy 0, policy_version 155459 (0.0011) [2023-12-27 20:20:49,097][106225] Updated weights for policy 1, policy_version 155737 (0.0006) [2023-12-27 20:20:49,159][106226] Updated weights for policy 0, policy_version 155469 (0.0011) [2023-12-27 20:20:49,226][106226] Updated weights for policy 0, policy_version 155479 (0.0009) [2023-12-27 20:20:49,778][106225] Updated weights for policy 1, policy_version 155747 (0.0006) [2023-12-27 20:20:49,844][106225] Updated weights for policy 1, policy_version 155757 (0.0008) [2023-12-27 20:20:49,909][106225] Updated weights for policy 1, policy_version 155767 (0.0008) [2023-12-27 20:20:49,969][106226] Updated weights for policy 0, policy_version 155489 (0.0009) [2023-12-27 20:20:50,034][106226] Updated weights for policy 0, policy_version 155499 (0.0007) [2023-12-27 20:20:50,091][106226] Updated weights for policy 0, policy_version 155509 (0.0011) [2023-12-27 20:20:50,154][106226] Updated weights for policy 0, policy_version 155519 (0.0011) [2023-12-27 20:20:50,748][106225] Updated weights for policy 1, policy_version 155777 (0.0008) [2023-12-27 20:20:50,758][106226] Updated weights for policy 0, policy_version 155529 (0.0006) [2023-12-27 20:20:50,809][106225] Updated weights for policy 1, policy_version 155787 (0.0008) [2023-12-27 20:20:50,830][106226] Updated weights for policy 0, policy_version 155539 (0.0006) [2023-12-27 20:20:50,860][106225] Updated weights for policy 1, policy_version 155797 (0.0008) [2023-12-27 20:20:50,891][106226] Updated weights for policy 0, policy_version 155549 (0.0006) [2023-12-27 20:20:50,918][106225] Updated weights for policy 1, policy_version 155807 (0.0009) [2023-12-27 20:20:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 79724544. Throughput: 0: 9980.5, 1: 9891.0. Samples: 79732104. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:51,175][105115] Avg episode reward: [(0, '-5.247'), (1, '-6.303')] [2023-12-27 20:20:51,572][106226] Updated weights for policy 0, policy_version 155559 (0.0010) [2023-12-27 20:20:51,643][106226] Updated weights for policy 0, policy_version 155569 (0.0009) [2023-12-27 20:20:51,674][106225] Updated weights for policy 1, policy_version 155817 (0.0009) [2023-12-27 20:20:51,711][106226] Updated weights for policy 0, policy_version 155579 (0.0009) [2023-12-27 20:20:51,739][106225] Updated weights for policy 1, policy_version 155827 (0.0007) [2023-12-27 20:20:51,803][106225] Updated weights for policy 1, policy_version 155837 (0.0008) [2023-12-27 20:20:52,405][106226] Updated weights for policy 0, policy_version 155589 (0.0008) [2023-12-27 20:20:52,460][106226] Updated weights for policy 0, policy_version 155599 (0.0008) [2023-12-27 20:20:52,521][106225] Updated weights for policy 1, policy_version 155847 (0.0007) [2023-12-27 20:20:52,527][106226] Updated weights for policy 0, policy_version 155609 (0.0008) [2023-12-27 20:20:52,581][106225] Updated weights for policy 1, policy_version 155857 (0.0007) [2023-12-27 20:20:52,648][106225] Updated weights for policy 1, policy_version 155867 (0.0008) [2023-12-27 20:20:53,232][106226] Updated weights for policy 0, policy_version 155619 (0.0007) [2023-12-27 20:20:53,290][106226] Updated weights for policy 0, policy_version 155629 (0.0005) [2023-12-27 20:20:53,344][106226] Updated weights for policy 0, policy_version 155639 (0.0005) [2023-12-27 20:20:53,351][106225] Updated weights for policy 1, policy_version 155877 (0.0006) [2023-12-27 20:20:53,412][106225] Updated weights for policy 1, policy_version 155887 (0.0005) [2023-12-27 20:20:53,471][106225] Updated weights for policy 1, policy_version 155897 (0.0005) [2023-12-27 20:20:54,055][106226] Updated weights for policy 0, policy_version 155649 (0.0006) [2023-12-27 20:20:54,072][106225] Updated weights for policy 1, policy_version 155907 (0.0006) [2023-12-27 20:20:54,113][106226] Updated weights for policy 0, policy_version 155659 (0.0006) [2023-12-27 20:20:54,134][106225] Updated weights for policy 1, policy_version 155917 (0.0007) [2023-12-27 20:20:54,161][106226] Updated weights for policy 0, policy_version 155669 (0.0008) [2023-12-27 20:20:54,191][106225] Updated weights for policy 1, policy_version 155927 (0.0007) [2023-12-27 20:20:54,223][106226] Updated weights for policy 0, policy_version 155679 (0.0007) [2023-12-27 20:20:54,866][106225] Updated weights for policy 1, policy_version 155937 (0.0006) [2023-12-27 20:20:54,919][106225] Updated weights for policy 1, policy_version 155947 (0.0008) [2023-12-27 20:20:54,971][106225] Updated weights for policy 1, policy_version 155957 (0.0008) [2023-12-27 20:20:54,978][106226] Updated weights for policy 0, policy_version 155689 (0.0006) [2023-12-27 20:20:55,033][106226] Updated weights for policy 0, policy_version 155699 (0.0007) [2023-12-27 20:20:55,034][106225] Updated weights for policy 1, policy_version 155967 (0.0007) [2023-12-27 20:20:55,085][106226] Updated weights for policy 0, policy_version 155709 (0.0008) [2023-12-27 20:20:55,761][106225] Updated weights for policy 1, policy_version 155977 (0.0008) [2023-12-27 20:20:55,802][106226] Updated weights for policy 0, policy_version 155719 (0.0007) [2023-12-27 20:20:55,819][106225] Updated weights for policy 1, policy_version 155987 (0.0007) [2023-12-27 20:20:55,852][106226] Updated weights for policy 0, policy_version 155729 (0.0006) [2023-12-27 20:20:55,880][106225] Updated weights for policy 1, policy_version 155997 (0.0009) [2023-12-27 20:20:55,901][106226] Updated weights for policy 0, policy_version 155739 (0.0009) [2023-12-27 20:20:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 79822848. Throughput: 0: 9966.2, 1: 9893.8. Samples: 79790724. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-27 20:20:56,175][105115] Avg episode reward: [(0, '-5.560'), (1, '-6.335')] [2023-12-27 20:20:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000155744_39878656.pth... [2023-12-27 20:20:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000156000_39944192.pth... [2023-12-27 20:20:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000154592_39583744.pth [2023-12-27 20:20:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000154848_39649280.pth [2023-12-27 20:20:56,438][106225] Updated weights for policy 1, policy_version 156007 (0.0006) [2023-12-27 20:20:56,501][106225] Updated weights for policy 1, policy_version 156017 (0.0007) [2023-12-27 20:20:56,553][106225] Updated weights for policy 1, policy_version 156027 (0.0007) [2023-12-27 20:20:56,698][106226] Updated weights for policy 0, policy_version 155749 (0.0008) [2023-12-27 20:20:56,761][106226] Updated weights for policy 0, policy_version 155759 (0.0009) [2023-12-27 20:20:56,826][106226] Updated weights for policy 0, policy_version 155769 (0.0006) [2023-12-27 20:20:57,248][106225] Updated weights for policy 1, policy_version 156037 (0.0008) [2023-12-27 20:20:57,304][106225] Updated weights for policy 1, policy_version 156047 (0.0010) [2023-12-27 20:20:57,358][106225] Updated weights for policy 1, policy_version 156057 (0.0010) [2023-12-27 20:20:57,538][106226] Updated weights for policy 0, policy_version 155779 (0.0007) [2023-12-27 20:20:57,581][106226] Updated weights for policy 0, policy_version 155789 (0.0008) [2023-12-27 20:20:57,636][106226] Updated weights for policy 0, policy_version 155799 (0.0007) [2023-12-27 20:20:58,028][106225] Updated weights for policy 1, policy_version 156067 (0.0010) [2023-12-27 20:20:58,084][106225] Updated weights for policy 1, policy_version 156077 (0.0010) [2023-12-27 20:20:58,138][106225] Updated weights for policy 1, policy_version 156087 (0.0010) [2023-12-27 20:20:58,329][106226] Updated weights for policy 0, policy_version 155809 (0.0008) [2023-12-27 20:20:58,402][106226] Updated weights for policy 0, policy_version 155819 (0.0008) [2023-12-27 20:20:58,475][106226] Updated weights for policy 0, policy_version 155829 (0.0011) [2023-12-27 20:20:58,541][106226] Updated weights for policy 0, policy_version 155839 (0.0008) [2023-12-27 20:20:59,016][106225] Updated weights for policy 1, policy_version 156097 (0.0010) [2023-12-27 20:20:59,083][106225] Updated weights for policy 1, policy_version 156107 (0.0006) [2023-12-27 20:20:59,150][106225] Updated weights for policy 1, policy_version 156117 (0.0006) [2023-12-27 20:20:59,215][106225] Updated weights for policy 1, policy_version 156127 (0.0006) [2023-12-27 20:20:59,329][106226] Updated weights for policy 0, policy_version 155849 (0.0008) [2023-12-27 20:20:59,397][106226] Updated weights for policy 0, policy_version 155859 (0.0007) [2023-12-27 20:20:59,453][106226] Updated weights for policy 0, policy_version 155869 (0.0006) [2023-12-27 20:20:59,915][106225] Updated weights for policy 1, policy_version 156137 (0.0010) [2023-12-27 20:20:59,981][106225] Updated weights for policy 1, policy_version 156147 (0.0011) [2023-12-27 20:21:00,040][106225] Updated weights for policy 1, policy_version 156157 (0.0008) [2023-12-27 20:21:00,167][106226] Updated weights for policy 0, policy_version 155879 (0.0008) [2023-12-27 20:21:00,228][106226] Updated weights for policy 0, policy_version 155889 (0.0008) [2023-12-27 20:21:00,289][106226] Updated weights for policy 0, policy_version 155899 (0.0007) [2023-12-27 20:21:00,720][106225] Updated weights for policy 1, policy_version 156167 (0.0008) [2023-12-27 20:21:00,772][106225] Updated weights for policy 1, policy_version 156177 (0.0007) [2023-12-27 20:21:00,816][106225] Updated weights for policy 1, policy_version 156187 (0.0007) [2023-12-27 20:21:01,033][106226] Updated weights for policy 0, policy_version 155909 (0.0009) [2023-12-27 20:21:01,097][106226] Updated weights for policy 0, policy_version 155919 (0.0008) [2023-12-27 20:21:01,169][106226] Updated weights for policy 0, policy_version 155930 (0.0008) [2023-12-27 20:21:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 79912960. Throughput: 0: 9909.8, 1: 9964.5. Samples: 79907328. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:01,175][105115] Avg episode reward: [(0, '-5.457'), (1, '-6.694')] [2023-12-27 20:21:01,510][106225] Updated weights for policy 1, policy_version 156197 (0.0008) [2023-12-27 20:21:01,562][106225] Updated weights for policy 1, policy_version 156207 (0.0006) [2023-12-27 20:21:01,615][106225] Updated weights for policy 1, policy_version 156217 (0.0006) [2023-12-27 20:21:01,897][106226] Updated weights for policy 0, policy_version 155940 (0.0008) [2023-12-27 20:21:01,964][106226] Updated weights for policy 0, policy_version 155950 (0.0009) [2023-12-27 20:21:02,028][106226] Updated weights for policy 0, policy_version 155960 (0.0008) [2023-12-27 20:21:02,216][106225] Updated weights for policy 1, policy_version 156227 (0.0007) [2023-12-27 20:21:02,281][106225] Updated weights for policy 1, policy_version 156237 (0.0008) [2023-12-27 20:21:02,350][106225] Updated weights for policy 1, policy_version 156247 (0.0007) [2023-12-27 20:21:02,708][106226] Updated weights for policy 0, policy_version 155970 (0.0009) [2023-12-27 20:21:02,768][106226] Updated weights for policy 0, policy_version 155980 (0.0011) [2023-12-27 20:21:02,828][106226] Updated weights for policy 0, policy_version 155990 (0.0010) [2023-12-27 20:21:02,891][106226] Updated weights for policy 0, policy_version 156000 (0.0010) [2023-12-27 20:21:02,926][106225] Updated weights for policy 1, policy_version 156257 (0.0006) [2023-12-27 20:21:02,987][106225] Updated weights for policy 1, policy_version 156267 (0.0005) [2023-12-27 20:21:03,051][106225] Updated weights for policy 1, policy_version 156277 (0.0006) [2023-12-27 20:21:03,109][106225] Updated weights for policy 1, policy_version 156287 (0.0005) [2023-12-27 20:21:03,524][106226] Updated weights for policy 0, policy_version 156010 (0.0008) [2023-12-27 20:21:03,594][106226] Updated weights for policy 0, policy_version 156020 (0.0005) [2023-12-27 20:21:03,663][106226] Updated weights for policy 0, policy_version 156030 (0.0005) [2023-12-27 20:21:03,788][106225] Updated weights for policy 1, policy_version 156297 (0.0007) [2023-12-27 20:21:03,860][106225] Updated weights for policy 1, policy_version 156307 (0.0008) [2023-12-27 20:21:03,928][106225] Updated weights for policy 1, policy_version 156317 (0.0006) [2023-12-27 20:21:04,369][106226] Updated weights for policy 0, policy_version 156040 (0.0008) [2023-12-27 20:21:04,438][106226] Updated weights for policy 0, policy_version 156050 (0.0011) [2023-12-27 20:21:04,501][106226] Updated weights for policy 0, policy_version 156060 (0.0011) [2023-12-27 20:21:04,649][106225] Updated weights for policy 1, policy_version 156327 (0.0007) [2023-12-27 20:21:04,714][106225] Updated weights for policy 1, policy_version 156337 (0.0008) [2023-12-27 20:21:04,780][106225] Updated weights for policy 1, policy_version 156347 (0.0006) [2023-12-27 20:21:05,246][106226] Updated weights for policy 0, policy_version 156070 (0.0010) [2023-12-27 20:21:05,311][106226] Updated weights for policy 0, policy_version 156080 (0.0010) [2023-12-27 20:21:05,380][106226] Updated weights for policy 0, policy_version 156090 (0.0006) [2023-12-27 20:21:05,424][106225] Updated weights for policy 1, policy_version 156357 (0.0007) [2023-12-27 20:21:05,476][106225] Updated weights for policy 1, policy_version 156367 (0.0005) [2023-12-27 20:21:05,524][106225] Updated weights for policy 1, policy_version 156377 (0.0005) [2023-12-27 20:21:06,044][106226] Updated weights for policy 0, policy_version 156100 (0.0008) [2023-12-27 20:21:06,091][106226] Updated weights for policy 0, policy_version 156110 (0.0010) [2023-12-27 20:21:06,139][106225] Updated weights for policy 1, policy_version 156387 (0.0008) [2023-12-27 20:21:06,157][106226] Updated weights for policy 0, policy_version 156120 (0.0009) [2023-12-27 20:21:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 80011264. Throughput: 0: 9851.6, 1: 10032.2. Samples: 80028068. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:06,175][105115] Avg episode reward: [(0, '-5.591'), (1, '-6.352')] [2023-12-27 20:21:06,202][106225] Updated weights for policy 1, policy_version 156397 (0.0008) [2023-12-27 20:21:06,261][106225] Updated weights for policy 1, policy_version 156407 (0.0008) [2023-12-27 20:21:06,878][106226] Updated weights for policy 0, policy_version 156130 (0.0009) [2023-12-27 20:21:06,944][106226] Updated weights for policy 0, policy_version 156140 (0.0011) [2023-12-27 20:21:06,986][106225] Updated weights for policy 1, policy_version 156417 (0.0008) [2023-12-27 20:21:07,008][106226] Updated weights for policy 0, policy_version 156150 (0.0010) [2023-12-27 20:21:07,035][106225] Updated weights for policy 1, policy_version 156427 (0.0005) [2023-12-27 20:21:07,071][106226] Updated weights for policy 0, policy_version 156160 (0.0011) [2023-12-27 20:21:07,091][106225] Updated weights for policy 1, policy_version 156437 (0.0005) [2023-12-27 20:21:07,137][106225] Updated weights for policy 1, policy_version 156447 (0.0005) [2023-12-27 20:21:07,736][106225] Updated weights for policy 1, policy_version 156457 (0.0010) [2023-12-27 20:21:07,772][106226] Updated weights for policy 0, policy_version 156170 (0.0007) [2023-12-27 20:21:07,803][106225] Updated weights for policy 1, policy_version 156467 (0.0010) [2023-12-27 20:21:07,827][106226] Updated weights for policy 0, policy_version 156180 (0.0008) [2023-12-27 20:21:07,867][106225] Updated weights for policy 1, policy_version 156477 (0.0010) [2023-12-27 20:21:07,881][106226] Updated weights for policy 0, policy_version 156190 (0.0007) [2023-12-27 20:21:08,535][106225] Updated weights for policy 1, policy_version 156487 (0.0010) [2023-12-27 20:21:08,543][106226] Updated weights for policy 0, policy_version 156200 (0.0009) [2023-12-27 20:21:08,600][106225] Updated weights for policy 1, policy_version 156497 (0.0011) [2023-12-27 20:21:08,602][106226] Updated weights for policy 0, policy_version 156210 (0.0007) [2023-12-27 20:21:08,660][106225] Updated weights for policy 1, policy_version 156507 (0.0009) [2023-12-27 20:21:08,666][106226] Updated weights for policy 0, policy_version 156220 (0.0006) [2023-12-27 20:21:09,347][106226] Updated weights for policy 0, policy_version 156230 (0.0007) [2023-12-27 20:21:09,395][106225] Updated weights for policy 1, policy_version 156517 (0.0010) [2023-12-27 20:21:09,411][106226] Updated weights for policy 0, policy_version 156240 (0.0008) [2023-12-27 20:21:09,458][106225] Updated weights for policy 1, policy_version 156527 (0.0009) [2023-12-27 20:21:09,466][106226] Updated weights for policy 0, policy_version 156250 (0.0008) [2023-12-27 20:21:09,522][106225] Updated weights for policy 1, policy_version 156537 (0.0010) [2023-12-27 20:21:10,217][106226] Updated weights for policy 0, policy_version 156260 (0.0008) [2023-12-27 20:21:10,264][106225] Updated weights for policy 1, policy_version 156547 (0.0010) [2023-12-27 20:21:10,275][106226] Updated weights for policy 0, policy_version 156270 (0.0008) [2023-12-27 20:21:10,323][106225] Updated weights for policy 1, policy_version 156557 (0.0009) [2023-12-27 20:21:10,337][106226] Updated weights for policy 0, policy_version 156280 (0.0006) [2023-12-27 20:21:10,386][106225] Updated weights for policy 1, policy_version 156567 (0.0008) [2023-12-27 20:21:10,993][106226] Updated weights for policy 0, policy_version 156290 (0.0007) [2023-12-27 20:21:11,049][106226] Updated weights for policy 0, policy_version 156300 (0.0008) [2023-12-27 20:21:11,104][106226] Updated weights for policy 0, policy_version 156310 (0.0008) [2023-12-27 20:21:11,172][106226] Updated weights for policy 0, policy_version 156320 (0.0009) [2023-12-27 20:21:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 80117760. Throughput: 0: 9838.9, 1: 10119.0. Samples: 80088508. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:11,175][105115] Avg episode reward: [(0, '-5.322'), (1, '-6.180')] [2023-12-27 20:21:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000156320_40026112.pth... [2023-12-27 20:21:11,182][106225] Updated weights for policy 1, policy_version 156577 (0.0010) [2023-12-27 20:21:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000155168_39731200.pth [2023-12-27 20:21:11,248][106225] Updated weights for policy 1, policy_version 156587 (0.0009) [2023-12-27 20:21:11,312][106225] Updated weights for policy 1, policy_version 156597 (0.0009) [2023-12-27 20:21:11,380][106225] Updated weights for policy 1, policy_version 156607 (0.0009) [2023-12-27 20:21:11,386][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000156608_40099840.pth... [2023-12-27 20:21:11,390][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000155424_39796736.pth [2023-12-27 20:21:11,940][106226] Updated weights for policy 0, policy_version 156330 (0.0008) [2023-12-27 20:21:12,005][106226] Updated weights for policy 0, policy_version 156340 (0.0009) [2023-12-27 20:21:12,065][106226] Updated weights for policy 0, policy_version 156350 (0.0009) [2023-12-27 20:21:12,126][106225] Updated weights for policy 1, policy_version 156617 (0.0008) [2023-12-27 20:21:12,180][106225] Updated weights for policy 1, policy_version 156627 (0.0010) [2023-12-27 20:21:12,245][106225] Updated weights for policy 1, policy_version 156637 (0.0011) [2023-12-27 20:21:12,719][106226] Updated weights for policy 0, policy_version 156360 (0.0007) [2023-12-27 20:21:12,787][106226] Updated weights for policy 0, policy_version 156370 (0.0006) [2023-12-27 20:21:12,852][106226] Updated weights for policy 0, policy_version 156380 (0.0005) [2023-12-27 20:21:12,898][106225] Updated weights for policy 1, policy_version 156647 (0.0007) [2023-12-27 20:21:12,951][106225] Updated weights for policy 1, policy_version 156657 (0.0010) [2023-12-27 20:21:13,006][106225] Updated weights for policy 1, policy_version 156667 (0.0009) [2023-12-27 20:21:13,526][106226] Updated weights for policy 0, policy_version 156390 (0.0007) [2023-12-27 20:21:13,580][106226] Updated weights for policy 0, policy_version 156400 (0.0007) [2023-12-27 20:21:13,636][106225] Updated weights for policy 1, policy_version 156677 (0.0008) [2023-12-27 20:21:13,639][106226] Updated weights for policy 0, policy_version 156410 (0.0007) [2023-12-27 20:21:13,685][106225] Updated weights for policy 1, policy_version 156687 (0.0010) [2023-12-27 20:21:13,745][106225] Updated weights for policy 1, policy_version 156697 (0.0010) [2023-12-27 20:21:14,360][106226] Updated weights for policy 0, policy_version 156420 (0.0007) [2023-12-27 20:21:14,410][106226] Updated weights for policy 0, policy_version 156430 (0.0007) [2023-12-27 20:21:14,419][106225] Updated weights for policy 1, policy_version 156707 (0.0010) [2023-12-27 20:21:14,464][106226] Updated weights for policy 0, policy_version 156440 (0.0007) [2023-12-27 20:21:14,483][106225] Updated weights for policy 1, policy_version 156717 (0.0009) [2023-12-27 20:21:14,535][106225] Updated weights for policy 1, policy_version 156727 (0.0008) [2023-12-27 20:21:15,167][106226] Updated weights for policy 0, policy_version 156450 (0.0006) [2023-12-27 20:21:15,226][106225] Updated weights for policy 1, policy_version 156737 (0.0007) [2023-12-27 20:21:15,227][106226] Updated weights for policy 0, policy_version 156460 (0.0008) [2023-12-27 20:21:15,285][106225] Updated weights for policy 1, policy_version 156747 (0.0009) [2023-12-27 20:21:15,287][106226] Updated weights for policy 0, policy_version 156470 (0.0007) [2023-12-27 20:21:15,343][106225] Updated weights for policy 1, policy_version 156757 (0.0009) [2023-12-27 20:21:15,344][106226] Updated weights for policy 0, policy_version 156480 (0.0007) [2023-12-27 20:21:15,394][106225] Updated weights for policy 1, policy_version 156767 (0.0010) [2023-12-27 20:21:15,939][106225] Updated weights for policy 1, policy_version 156777 (0.0007) [2023-12-27 20:21:15,998][106225] Updated weights for policy 1, policy_version 156787 (0.0005) [2023-12-27 20:21:16,064][106225] Updated weights for policy 1, policy_version 156797 (0.0007) [2023-12-27 20:21:16,119][106226] Updated weights for policy 0, policy_version 156490 (0.0007) [2023-12-27 20:21:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 80216064. Throughput: 0: 9794.5, 1: 10016.8. Samples: 80206452. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:16,175][105115] Avg episode reward: [(0, '-5.360'), (1, '-6.502')] [2023-12-27 20:21:16,188][106226] Updated weights for policy 0, policy_version 156500 (0.0008) [2023-12-27 20:21:16,254][106226] Updated weights for policy 0, policy_version 156510 (0.0008) [2023-12-27 20:21:16,701][106225] Updated weights for policy 1, policy_version 156807 (0.0007) [2023-12-27 20:21:16,766][106225] Updated weights for policy 1, policy_version 156817 (0.0005) [2023-12-27 20:21:16,816][106225] Updated weights for policy 1, policy_version 156827 (0.0006) [2023-12-27 20:21:16,981][106226] Updated weights for policy 0, policy_version 156520 (0.0006) [2023-12-27 20:21:17,036][106226] Updated weights for policy 0, policy_version 156530 (0.0005) [2023-12-27 20:21:17,092][106226] Updated weights for policy 0, policy_version 156540 (0.0005) [2023-12-27 20:21:17,409][106225] Updated weights for policy 1, policy_version 156837 (0.0005) [2023-12-27 20:21:17,474][106225] Updated weights for policy 1, policy_version 156847 (0.0005) [2023-12-27 20:21:17,533][106225] Updated weights for policy 1, policy_version 156857 (0.0005) [2023-12-27 20:21:17,677][106226] Updated weights for policy 0, policy_version 156550 (0.0005) [2023-12-27 20:21:17,732][106226] Updated weights for policy 0, policy_version 156560 (0.0007) [2023-12-27 20:21:17,791][106226] Updated weights for policy 0, policy_version 156570 (0.0008) [2023-12-27 20:21:18,127][106225] Updated weights for policy 1, policy_version 156867 (0.0008) [2023-12-27 20:21:18,189][106225] Updated weights for policy 1, policy_version 156877 (0.0008) [2023-12-27 20:21:18,247][106225] Updated weights for policy 1, policy_version 156887 (0.0008) [2023-12-27 20:21:18,480][106226] Updated weights for policy 0, policy_version 156580 (0.0008) [2023-12-27 20:21:18,544][106226] Updated weights for policy 0, policy_version 156590 (0.0009) [2023-12-27 20:21:18,606][106226] Updated weights for policy 0, policy_version 156600 (0.0010) [2023-12-27 20:21:18,982][106225] Updated weights for policy 1, policy_version 156897 (0.0008) [2023-12-27 20:21:19,045][106225] Updated weights for policy 1, policy_version 156907 (0.0010) [2023-12-27 20:21:19,101][106225] Updated weights for policy 1, policy_version 156917 (0.0010) [2023-12-27 20:21:19,164][106225] Updated weights for policy 1, policy_version 156927 (0.0010) [2023-12-27 20:21:19,364][106226] Updated weights for policy 0, policy_version 156610 (0.0010) [2023-12-27 20:21:19,426][106226] Updated weights for policy 0, policy_version 156620 (0.0008) [2023-12-27 20:21:19,490][106226] Updated weights for policy 0, policy_version 156630 (0.0008) [2023-12-27 20:21:19,557][106226] Updated weights for policy 0, policy_version 156640 (0.0007) [2023-12-27 20:21:19,904][106225] Updated weights for policy 1, policy_version 156937 (0.0011) [2023-12-27 20:21:19,965][106225] Updated weights for policy 1, policy_version 156947 (0.0008) [2023-12-27 20:21:20,025][106225] Updated weights for policy 1, policy_version 156957 (0.0008) [2023-12-27 20:21:20,197][106226] Updated weights for policy 0, policy_version 156650 (0.0008) [2023-12-27 20:21:20,252][106226] Updated weights for policy 0, policy_version 156660 (0.0008) [2023-12-27 20:21:20,311][106226] Updated weights for policy 0, policy_version 156670 (0.0008) [2023-12-27 20:21:20,817][106225] Updated weights for policy 1, policy_version 156967 (0.0008) [2023-12-27 20:21:20,876][106225] Updated weights for policy 1, policy_version 156977 (0.0008) [2023-12-27 20:21:20,943][106225] Updated weights for policy 1, policy_version 156987 (0.0006) [2023-12-27 20:21:21,037][106226] Updated weights for policy 0, policy_version 156680 (0.0009) [2023-12-27 20:21:21,095][106226] Updated weights for policy 0, policy_version 156690 (0.0008) [2023-12-27 20:21:21,157][106226] Updated weights for policy 0, policy_version 156700 (0.0008) [2023-12-27 20:21:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 80314368. Throughput: 0: 9803.1, 1: 9988.7. Samples: 80326968. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:21,175][105115] Avg episode reward: [(0, '-5.303'), (1, '-6.495')] [2023-12-27 20:21:21,652][106225] Updated weights for policy 1, policy_version 156997 (0.0006) [2023-12-27 20:21:21,710][106225] Updated weights for policy 1, policy_version 157007 (0.0009) [2023-12-27 20:21:21,784][106225] Updated weights for policy 1, policy_version 157017 (0.0008) [2023-12-27 20:21:21,985][106226] Updated weights for policy 0, policy_version 156710 (0.0009) [2023-12-27 20:21:22,047][106226] Updated weights for policy 0, policy_version 156720 (0.0009) [2023-12-27 20:21:22,110][106226] Updated weights for policy 0, policy_version 156730 (0.0008) [2023-12-27 20:21:22,480][106225] Updated weights for policy 1, policy_version 157027 (0.0008) [2023-12-27 20:21:22,544][106225] Updated weights for policy 1, policy_version 157037 (0.0008) [2023-12-27 20:21:22,606][106225] Updated weights for policy 1, policy_version 157047 (0.0008) [2023-12-27 20:21:22,866][106226] Updated weights for policy 0, policy_version 156740 (0.0009) [2023-12-27 20:21:22,930][106226] Updated weights for policy 0, policy_version 156750 (0.0008) [2023-12-27 20:21:22,987][106226] Updated weights for policy 0, policy_version 156760 (0.0008) [2023-12-27 20:21:23,337][106225] Updated weights for policy 1, policy_version 157057 (0.0008) [2023-12-27 20:21:23,401][106225] Updated weights for policy 1, policy_version 157067 (0.0007) [2023-12-27 20:21:23,461][106225] Updated weights for policy 1, policy_version 157077 (0.0008) [2023-12-27 20:21:23,525][106225] Updated weights for policy 1, policy_version 157087 (0.0009) [2023-12-27 20:21:23,714][106226] Updated weights for policy 0, policy_version 156770 (0.0008) [2023-12-27 20:21:23,784][106226] Updated weights for policy 0, policy_version 156780 (0.0010) [2023-12-27 20:21:23,845][106226] Updated weights for policy 0, policy_version 156790 (0.0009) [2023-12-27 20:21:23,913][106226] Updated weights for policy 0, policy_version 156800 (0.0009) [2023-12-27 20:21:24,201][106225] Updated weights for policy 1, policy_version 157097 (0.0009) [2023-12-27 20:21:24,254][106225] Updated weights for policy 1, policy_version 157107 (0.0008) [2023-12-27 20:21:24,305][106225] Updated weights for policy 1, policy_version 157117 (0.0008) [2023-12-27 20:21:24,515][106226] Updated weights for policy 0, policy_version 156810 (0.0008) [2023-12-27 20:21:24,569][106226] Updated weights for policy 0, policy_version 156820 (0.0010) [2023-12-27 20:21:24,625][106226] Updated weights for policy 0, policy_version 156830 (0.0008) [2023-12-27 20:21:25,007][106225] Updated weights for policy 1, policy_version 157127 (0.0010) [2023-12-27 20:21:25,066][106225] Updated weights for policy 1, policy_version 157137 (0.0006) [2023-12-27 20:21:25,133][106225] Updated weights for policy 1, policy_version 157147 (0.0008) [2023-12-27 20:21:25,174][106226] Updated weights for policy 0, policy_version 156840 (0.0006) [2023-12-27 20:21:25,236][106226] Updated weights for policy 0, policy_version 156850 (0.0007) [2023-12-27 20:21:25,299][106226] Updated weights for policy 0, policy_version 156860 (0.0006) [2023-12-27 20:21:25,739][106225] Updated weights for policy 1, policy_version 157157 (0.0008) [2023-12-27 20:21:25,801][106225] Updated weights for policy 1, policy_version 157167 (0.0009) [2023-12-27 20:21:25,833][106226] Updated weights for policy 0, policy_version 156870 (0.0006) [2023-12-27 20:21:25,870][106225] Updated weights for policy 1, policy_version 157177 (0.0010) [2023-12-27 20:21:25,882][106226] Updated weights for policy 0, policy_version 156880 (0.0007) [2023-12-27 20:21:25,936][106226] Updated weights for policy 0, policy_version 156890 (0.0008) [2023-12-27 20:21:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 80420864. Throughput: 0: 9728.0, 1: 9984.7. Samples: 80383116. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:26,175][105115] Avg episode reward: [(0, '-5.211'), (1, '-6.406')] [2023-12-27 20:21:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000156896_40173568.pth... [2023-12-27 20:21:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000157184_40247296.pth... [2023-12-27 20:21:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000155744_39878656.pth [2023-12-27 20:21:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000156000_39944192.pth [2023-12-27 20:21:26,550][106225] Updated weights for policy 1, policy_version 157187 (0.0010) [2023-12-27 20:21:26,573][106226] Updated weights for policy 0, policy_version 156900 (0.0005) [2023-12-27 20:21:26,609][106225] Updated weights for policy 1, policy_version 157197 (0.0010) [2023-12-27 20:21:26,638][106226] Updated weights for policy 0, policy_version 156910 (0.0008) [2023-12-27 20:21:26,660][106225] Updated weights for policy 1, policy_version 157207 (0.0010) [2023-12-27 20:21:26,692][106226] Updated weights for policy 0, policy_version 156920 (0.0011) [2023-12-27 20:21:27,304][106225] Updated weights for policy 1, policy_version 157217 (0.0010) [2023-12-27 20:21:27,361][106225] Updated weights for policy 1, policy_version 157227 (0.0010) [2023-12-27 20:21:27,379][106226] Updated weights for policy 0, policy_version 156930 (0.0010) [2023-12-27 20:21:27,422][106225] Updated weights for policy 1, policy_version 157237 (0.0010) [2023-12-27 20:21:27,430][106226] Updated weights for policy 0, policy_version 156940 (0.0010) [2023-12-27 20:21:27,483][106225] Updated weights for policy 1, policy_version 157247 (0.0010) [2023-12-27 20:21:27,488][106226] Updated weights for policy 0, policy_version 156950 (0.0008) [2023-12-27 20:21:27,549][106226] Updated weights for policy 0, policy_version 156960 (0.0009) [2023-12-27 20:21:28,160][106225] Updated weights for policy 1, policy_version 157257 (0.0010) [2023-12-27 20:21:28,224][106225] Updated weights for policy 1, policy_version 157267 (0.0010) [2023-12-27 20:21:28,256][106226] Updated weights for policy 0, policy_version 156970 (0.0007) [2023-12-27 20:21:28,270][106225] Updated weights for policy 1, policy_version 157277 (0.0010) [2023-12-27 20:21:28,315][106226] Updated weights for policy 0, policy_version 156980 (0.0009) [2023-12-27 20:21:28,370][106226] Updated weights for policy 0, policy_version 156990 (0.0010) [2023-12-27 20:21:28,917][106225] Updated weights for policy 1, policy_version 157287 (0.0007) [2023-12-27 20:21:28,966][106225] Updated weights for policy 1, policy_version 157297 (0.0007) [2023-12-27 20:21:29,012][106225] Updated weights for policy 1, policy_version 157307 (0.0010) [2023-12-27 20:21:29,127][106226] Updated weights for policy 0, policy_version 157000 (0.0010) [2023-12-27 20:21:29,186][106226] Updated weights for policy 0, policy_version 157010 (0.0010) [2023-12-27 20:21:29,252][106226] Updated weights for policy 0, policy_version 157020 (0.0010) [2023-12-27 20:21:29,713][106225] Updated weights for policy 1, policy_version 157317 (0.0010) [2023-12-27 20:21:29,776][106225] Updated weights for policy 1, policy_version 157327 (0.0010) [2023-12-27 20:21:29,846][106225] Updated weights for policy 1, policy_version 157337 (0.0010) [2023-12-27 20:21:29,992][106226] Updated weights for policy 0, policy_version 157030 (0.0007) [2023-12-27 20:21:30,051][106226] Updated weights for policy 0, policy_version 157040 (0.0006) [2023-12-27 20:21:30,104][106226] Updated weights for policy 0, policy_version 157050 (0.0007) [2023-12-27 20:21:30,571][106225] Updated weights for policy 1, policy_version 157347 (0.0010) [2023-12-27 20:21:30,643][106225] Updated weights for policy 1, policy_version 157357 (0.0010) [2023-12-27 20:21:30,709][106225] Updated weights for policy 1, policy_version 157367 (0.0011) [2023-12-27 20:21:30,723][106226] Updated weights for policy 0, policy_version 157060 (0.0006) [2023-12-27 20:21:30,780][106226] Updated weights for policy 0, policy_version 157070 (0.0007) [2023-12-27 20:21:30,833][106226] Updated weights for policy 0, policy_version 157080 (0.0009) [2023-12-27 20:21:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 80519168. Throughput: 0: 9864.2, 1: 10059.1. Samples: 80508360. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:31,175][105115] Avg episode reward: [(0, '-5.381'), (1, '-6.482')] [2023-12-27 20:21:31,373][106225] Updated weights for policy 1, policy_version 157377 (0.0007) [2023-12-27 20:21:31,437][106225] Updated weights for policy 1, policy_version 157387 (0.0010) [2023-12-27 20:21:31,491][106225] Updated weights for policy 1, policy_version 157397 (0.0010) [2023-12-27 20:21:31,548][106225] Updated weights for policy 1, policy_version 157407 (0.0010) [2023-12-27 20:21:31,557][106226] Updated weights for policy 0, policy_version 157090 (0.0009) [2023-12-27 20:21:31,620][106226] Updated weights for policy 0, policy_version 157100 (0.0008) [2023-12-27 20:21:31,686][106226] Updated weights for policy 0, policy_version 157110 (0.0007) [2023-12-27 20:21:31,753][106226] Updated weights for policy 0, policy_version 157120 (0.0009) [2023-12-27 20:21:32,345][106225] Updated weights for policy 1, policy_version 157417 (0.0010) [2023-12-27 20:21:32,406][106225] Updated weights for policy 1, policy_version 157427 (0.0006) [2023-12-27 20:21:32,441][106226] Updated weights for policy 0, policy_version 157130 (0.0008) [2023-12-27 20:21:32,463][106225] Updated weights for policy 1, policy_version 157437 (0.0007) [2023-12-27 20:21:32,498][106226] Updated weights for policy 0, policy_version 157140 (0.0008) [2023-12-27 20:21:32,559][106226] Updated weights for policy 0, policy_version 157150 (0.0008) [2023-12-27 20:21:33,106][106225] Updated weights for policy 1, policy_version 157447 (0.0006) [2023-12-27 20:21:33,160][106225] Updated weights for policy 1, policy_version 157457 (0.0005) [2023-12-27 20:21:33,219][106225] Updated weights for policy 1, policy_version 157467 (0.0005) [2023-12-27 20:21:33,266][106226] Updated weights for policy 0, policy_version 157160 (0.0008) [2023-12-27 20:21:33,310][106226] Updated weights for policy 0, policy_version 157170 (0.0008) [2023-12-27 20:21:33,354][106226] Updated weights for policy 0, policy_version 157180 (0.0005) [2023-12-27 20:21:33,862][106225] Updated weights for policy 1, policy_version 157477 (0.0008) [2023-12-27 20:21:33,928][106225] Updated weights for policy 1, policy_version 157487 (0.0010) [2023-12-27 20:21:33,959][106226] Updated weights for policy 0, policy_version 157190 (0.0008) [2023-12-27 20:21:33,982][106225] Updated weights for policy 1, policy_version 157497 (0.0010) [2023-12-27 20:21:34,006][106226] Updated weights for policy 0, policy_version 157200 (0.0010) [2023-12-27 20:21:34,052][106226] Updated weights for policy 0, policy_version 157210 (0.0010) [2023-12-27 20:21:34,696][106225] Updated weights for policy 1, policy_version 157507 (0.0010) [2023-12-27 20:21:34,751][106225] Updated weights for policy 1, policy_version 157517 (0.0007) [2023-12-27 20:21:34,780][106226] Updated weights for policy 0, policy_version 157220 (0.0010) [2023-12-27 20:21:34,812][106225] Updated weights for policy 1, policy_version 157527 (0.0007) [2023-12-27 20:21:34,839][106226] Updated weights for policy 0, policy_version 157230 (0.0010) [2023-12-27 20:21:34,899][106226] Updated weights for policy 0, policy_version 157240 (0.0009) [2023-12-27 20:21:35,458][106225] Updated weights for policy 1, policy_version 157537 (0.0007) [2023-12-27 20:21:35,517][106225] Updated weights for policy 1, policy_version 157547 (0.0010) [2023-12-27 20:21:35,518][106226] Updated weights for policy 0, policy_version 157250 (0.0006) [2023-12-27 20:21:35,576][106225] Updated weights for policy 1, policy_version 157557 (0.0007) [2023-12-27 20:21:35,584][106226] Updated weights for policy 0, policy_version 157260 (0.0008) [2023-12-27 20:21:35,634][106225] Updated weights for policy 1, policy_version 157567 (0.0008) [2023-12-27 20:21:35,649][106226] Updated weights for policy 0, policy_version 157270 (0.0011) [2023-12-27 20:21:35,700][106226] Updated weights for policy 0, policy_version 157280 (0.0011) [2023-12-27 20:21:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 80617472. Throughput: 0: 9886.4, 1: 10090.6. Samples: 80631068. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:36,175][105115] Avg episode reward: [(0, '-5.476'), (1, '-6.032')] [2023-12-27 20:21:36,294][106226] Updated weights for policy 0, policy_version 157290 (0.0008) [2023-12-27 20:21:36,307][106225] Updated weights for policy 1, policy_version 157577 (0.0011) [2023-12-27 20:21:36,356][106225] Updated weights for policy 1, policy_version 157587 (0.0008) [2023-12-27 20:21:36,357][106226] Updated weights for policy 0, policy_version 157300 (0.0008) [2023-12-27 20:21:36,408][106225] Updated weights for policy 1, policy_version 157597 (0.0010) [2023-12-27 20:21:36,418][106226] Updated weights for policy 0, policy_version 157310 (0.0009) [2023-12-27 20:21:37,117][106225] Updated weights for policy 1, policy_version 157607 (0.0010) [2023-12-27 20:21:37,139][106226] Updated weights for policy 0, policy_version 157320 (0.0007) [2023-12-27 20:21:37,177][106225] Updated weights for policy 1, policy_version 157617 (0.0011) [2023-12-27 20:21:37,203][106226] Updated weights for policy 0, policy_version 157330 (0.0006) [2023-12-27 20:21:37,235][106225] Updated weights for policy 1, policy_version 157627 (0.0010) [2023-12-27 20:21:37,272][106226] Updated weights for policy 0, policy_version 157340 (0.0006) [2023-12-27 20:21:37,906][106226] Updated weights for policy 0, policy_version 157350 (0.0006) [2023-12-27 20:21:37,962][106226] Updated weights for policy 0, policy_version 157360 (0.0006) [2023-12-27 20:21:37,962][106225] Updated weights for policy 1, policy_version 157637 (0.0009) [2023-12-27 20:21:38,013][106225] Updated weights for policy 1, policy_version 157647 (0.0007) [2023-12-27 20:21:38,015][106226] Updated weights for policy 0, policy_version 157370 (0.0007) [2023-12-27 20:21:38,064][106225] Updated weights for policy 1, policy_version 157657 (0.0005) [2023-12-27 20:21:38,686][106225] Updated weights for policy 1, policy_version 157667 (0.0006) [2023-12-27 20:21:38,727][106226] Updated weights for policy 0, policy_version 157380 (0.0007) [2023-12-27 20:21:38,750][106225] Updated weights for policy 1, policy_version 157677 (0.0007) [2023-12-27 20:21:38,790][106226] Updated weights for policy 0, policy_version 157390 (0.0007) [2023-12-27 20:21:38,813][106225] Updated weights for policy 1, policy_version 157687 (0.0006) [2023-12-27 20:21:38,852][106226] Updated weights for policy 0, policy_version 157400 (0.0007) [2023-12-27 20:21:39,509][106226] Updated weights for policy 0, policy_version 157410 (0.0008) [2023-12-27 20:21:39,582][106226] Updated weights for policy 0, policy_version 157420 (0.0008) [2023-12-27 20:21:39,599][106225] Updated weights for policy 1, policy_version 157697 (0.0007) [2023-12-27 20:21:39,644][106226] Updated weights for policy 0, policy_version 157430 (0.0007) [2023-12-27 20:21:39,662][106225] Updated weights for policy 1, policy_version 157707 (0.0008) [2023-12-27 20:21:39,703][106226] Updated weights for policy 0, policy_version 157440 (0.0006) [2023-12-27 20:21:39,726][106225] Updated weights for policy 1, policy_version 157717 (0.0007) [2023-12-27 20:21:39,800][106225] Updated weights for policy 1, policy_version 157727 (0.0008) [2023-12-27 20:21:40,408][106226] Updated weights for policy 0, policy_version 157450 (0.0010) [2023-12-27 20:21:40,476][106226] Updated weights for policy 0, policy_version 157460 (0.0010) [2023-12-27 20:21:40,544][106226] Updated weights for policy 0, policy_version 157470 (0.0010) [2023-12-27 20:21:40,565][106225] Updated weights for policy 1, policy_version 157737 (0.0006) [2023-12-27 20:21:40,633][106225] Updated weights for policy 1, policy_version 157747 (0.0008) [2023-12-27 20:21:40,681][106225] Updated weights for policy 1, policy_version 157757 (0.0008) [2023-12-27 20:21:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 80715776. Throughput: 0: 9901.2, 1: 10108.1. Samples: 80691140. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:41,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-6.429')] [2023-12-27 20:21:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000157760_40394752.pth... [2023-12-27 20:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000157472_40321024.pth... [2023-12-27 20:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000156320_40026112.pth [2023-12-27 20:21:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000156608_40099840.pth [2023-12-27 20:21:41,261][106226] Updated weights for policy 0, policy_version 157480 (0.0008) [2023-12-27 20:21:41,326][106226] Updated weights for policy 0, policy_version 157490 (0.0008) [2023-12-27 20:21:41,357][106225] Updated weights for policy 1, policy_version 157767 (0.0008) [2023-12-27 20:21:41,402][106226] Updated weights for policy 0, policy_version 157500 (0.0009) [2023-12-27 20:21:41,427][106225] Updated weights for policy 1, policy_version 157777 (0.0006) [2023-12-27 20:21:41,486][106225] Updated weights for policy 1, policy_version 157787 (0.0008) [2023-12-27 20:21:42,178][106226] Updated weights for policy 0, policy_version 157510 (0.0010) [2023-12-27 20:21:42,205][106225] Updated weights for policy 1, policy_version 157797 (0.0008) [2023-12-27 20:21:42,241][106226] Updated weights for policy 0, policy_version 157520 (0.0006) [2023-12-27 20:21:42,267][106225] Updated weights for policy 1, policy_version 157807 (0.0008) [2023-12-27 20:21:42,308][106226] Updated weights for policy 0, policy_version 157530 (0.0007) [2023-12-27 20:21:42,332][106225] Updated weights for policy 1, policy_version 157817 (0.0007) [2023-12-27 20:21:43,029][106226] Updated weights for policy 0, policy_version 157540 (0.0007) [2023-12-27 20:21:43,074][106225] Updated weights for policy 1, policy_version 157827 (0.0009) [2023-12-27 20:21:43,088][106226] Updated weights for policy 0, policy_version 157550 (0.0007) [2023-12-27 20:21:43,135][106225] Updated weights for policy 1, policy_version 157837 (0.0007) [2023-12-27 20:21:43,143][106226] Updated weights for policy 0, policy_version 157560 (0.0006) [2023-12-27 20:21:43,191][106225] Updated weights for policy 1, policy_version 157847 (0.0007) [2023-12-27 20:21:43,789][106226] Updated weights for policy 0, policy_version 157570 (0.0006) [2023-12-27 20:21:43,843][106226] Updated weights for policy 0, policy_version 157580 (0.0008) [2023-12-27 20:21:43,895][106226] Updated weights for policy 0, policy_version 157590 (0.0009) [2023-12-27 20:21:43,931][106225] Updated weights for policy 1, policy_version 157857 (0.0008) [2023-12-27 20:21:43,951][106226] Updated weights for policy 0, policy_version 157600 (0.0007) [2023-12-27 20:21:43,979][106225] Updated weights for policy 1, policy_version 157867 (0.0008) [2023-12-27 20:21:44,041][106225] Updated weights for policy 1, policy_version 157877 (0.0009) [2023-12-27 20:21:44,095][106225] Updated weights for policy 1, policy_version 157887 (0.0009) [2023-12-27 20:21:44,649][106226] Updated weights for policy 0, policy_version 157610 (0.0009) [2023-12-27 20:21:44,705][106226] Updated weights for policy 0, policy_version 157620 (0.0008) [2023-12-27 20:21:44,772][106226] Updated weights for policy 0, policy_version 157630 (0.0009) [2023-12-27 20:21:44,793][106225] Updated weights for policy 1, policy_version 157897 (0.0007) [2023-12-27 20:21:44,858][106225] Updated weights for policy 1, policy_version 157907 (0.0008) [2023-12-27 20:21:44,921][106225] Updated weights for policy 1, policy_version 157917 (0.0010) [2023-12-27 20:21:45,475][106226] Updated weights for policy 0, policy_version 157640 (0.0008) [2023-12-27 20:21:45,531][106226] Updated weights for policy 0, policy_version 157650 (0.0008) [2023-12-27 20:21:45,588][106226] Updated weights for policy 0, policy_version 157660 (0.0008) [2023-12-27 20:21:45,652][106225] Updated weights for policy 1, policy_version 157927 (0.0008) [2023-12-27 20:21:45,701][106225] Updated weights for policy 1, policy_version 157937 (0.0007) [2023-12-27 20:21:45,752][106225] Updated weights for policy 1, policy_version 157947 (0.0008) [2023-12-27 20:21:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 80814080. Throughput: 0: 9945.5, 1: 10037.9. Samples: 80806580. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:46,175][105115] Avg episode reward: [(0, '-5.142'), (1, '-6.560')] [2023-12-27 20:21:46,258][106226] Updated weights for policy 0, policy_version 157670 (0.0008) [2023-12-27 20:21:46,311][106226] Updated weights for policy 0, policy_version 157680 (0.0009) [2023-12-27 20:21:46,366][106226] Updated weights for policy 0, policy_version 157690 (0.0008) [2023-12-27 20:21:46,511][106225] Updated weights for policy 1, policy_version 157957 (0.0008) [2023-12-27 20:21:46,563][106225] Updated weights for policy 1, policy_version 157967 (0.0009) [2023-12-27 20:21:46,614][106225] Updated weights for policy 1, policy_version 157977 (0.0008) [2023-12-27 20:21:47,010][106226] Updated weights for policy 0, policy_version 157700 (0.0007) [2023-12-27 20:21:47,056][106226] Updated weights for policy 0, policy_version 157710 (0.0005) [2023-12-27 20:21:47,103][106226] Updated weights for policy 0, policy_version 157720 (0.0006) [2023-12-27 20:21:47,365][106225] Updated weights for policy 1, policy_version 157987 (0.0008) [2023-12-27 20:21:47,423][106225] Updated weights for policy 1, policy_version 157997 (0.0008) [2023-12-27 20:21:47,470][106225] Updated weights for policy 1, policy_version 158007 (0.0008) [2023-12-27 20:21:47,789][106226] Updated weights for policy 0, policy_version 157730 (0.0009) [2023-12-27 20:21:47,854][106226] Updated weights for policy 0, policy_version 157740 (0.0008) [2023-12-27 20:21:47,917][106226] Updated weights for policy 0, policy_version 157750 (0.0009) [2023-12-27 20:21:47,982][106226] Updated weights for policy 0, policy_version 157760 (0.0007) [2023-12-27 20:21:48,154][106225] Updated weights for policy 1, policy_version 158017 (0.0008) [2023-12-27 20:21:48,212][106225] Updated weights for policy 1, policy_version 158027 (0.0009) [2023-12-27 20:21:48,257][106225] Updated weights for policy 1, policy_version 158037 (0.0007) [2023-12-27 20:21:48,308][106225] Updated weights for policy 1, policy_version 158047 (0.0005) [2023-12-27 20:21:48,696][106226] Updated weights for policy 0, policy_version 157770 (0.0009) [2023-12-27 20:21:48,756][106226] Updated weights for policy 0, policy_version 157780 (0.0009) [2023-12-27 20:21:48,818][106226] Updated weights for policy 0, policy_version 157790 (0.0009) [2023-12-27 20:21:48,977][106225] Updated weights for policy 1, policy_version 158057 (0.0008) [2023-12-27 20:21:49,038][106225] Updated weights for policy 1, policy_version 158067 (0.0008) [2023-12-27 20:21:49,091][106225] Updated weights for policy 1, policy_version 158077 (0.0006) [2023-12-27 20:21:49,564][106226] Updated weights for policy 0, policy_version 157800 (0.0009) [2023-12-27 20:21:49,620][106226] Updated weights for policy 0, policy_version 157810 (0.0008) [2023-12-27 20:21:49,684][106226] Updated weights for policy 0, policy_version 157820 (0.0007) [2023-12-27 20:21:49,728][106225] Updated weights for policy 1, policy_version 158087 (0.0005) [2023-12-27 20:21:49,797][106225] Updated weights for policy 1, policy_version 158097 (0.0006) [2023-12-27 20:21:49,863][106225] Updated weights for policy 1, policy_version 158107 (0.0009) [2023-12-27 20:21:50,446][106226] Updated weights for policy 0, policy_version 157830 (0.0008) [2023-12-27 20:21:50,488][106225] Updated weights for policy 1, policy_version 158117 (0.0009) [2023-12-27 20:21:50,501][106226] Updated weights for policy 0, policy_version 157840 (0.0007) [2023-12-27 20:21:50,538][106225] Updated weights for policy 1, policy_version 158127 (0.0006) [2023-12-27 20:21:50,561][106226] Updated weights for policy 0, policy_version 157850 (0.0008) [2023-12-27 20:21:50,604][106225] Updated weights for policy 1, policy_version 158137 (0.0008) [2023-12-27 20:21:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 80912384. Throughput: 0: 9950.1, 1: 9974.7. Samples: 80924680. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:51,175][105115] Avg episode reward: [(0, '-5.240'), (1, '-6.387')] [2023-12-27 20:21:51,327][106226] Updated weights for policy 0, policy_version 157860 (0.0008) [2023-12-27 20:21:51,349][106225] Updated weights for policy 1, policy_version 158147 (0.0007) [2023-12-27 20:21:51,399][106226] Updated weights for policy 0, policy_version 157870 (0.0009) [2023-12-27 20:21:51,427][106225] Updated weights for policy 1, policy_version 158157 (0.0007) [2023-12-27 20:21:51,462][106226] Updated weights for policy 0, policy_version 157880 (0.0008) [2023-12-27 20:21:51,489][106225] Updated weights for policy 1, policy_version 158167 (0.0007) [2023-12-27 20:21:52,173][106226] Updated weights for policy 0, policy_version 157890 (0.0008) [2023-12-27 20:21:52,233][106226] Updated weights for policy 0, policy_version 157900 (0.0008) [2023-12-27 20:21:52,262][106225] Updated weights for policy 1, policy_version 158177 (0.0008) [2023-12-27 20:21:52,297][106226] Updated weights for policy 0, policy_version 157910 (0.0007) [2023-12-27 20:21:52,326][106225] Updated weights for policy 1, policy_version 158187 (0.0007) [2023-12-27 20:21:52,367][106226] Updated weights for policy 0, policy_version 157920 (0.0006) [2023-12-27 20:21:52,398][106225] Updated weights for policy 1, policy_version 158197 (0.0008) [2023-12-27 20:21:52,446][106225] Updated weights for policy 1, policy_version 158207 (0.0007) [2023-12-27 20:21:53,042][106226] Updated weights for policy 0, policy_version 157930 (0.0005) [2023-12-27 20:21:53,091][106226] Updated weights for policy 0, policy_version 157940 (0.0005) [2023-12-27 20:21:53,141][106226] Updated weights for policy 0, policy_version 157950 (0.0005) [2023-12-27 20:21:53,212][106225] Updated weights for policy 1, policy_version 158217 (0.0010) [2023-12-27 20:21:53,284][106225] Updated weights for policy 1, policy_version 158227 (0.0010) [2023-12-27 20:21:53,350][106225] Updated weights for policy 1, policy_version 158237 (0.0010) [2023-12-27 20:21:53,680][106226] Updated weights for policy 0, policy_version 157960 (0.0008) [2023-12-27 20:21:53,742][106226] Updated weights for policy 0, policy_version 157970 (0.0008) [2023-12-27 20:21:53,799][106226] Updated weights for policy 0, policy_version 157980 (0.0010) [2023-12-27 20:21:54,018][106225] Updated weights for policy 1, policy_version 158247 (0.0010) [2023-12-27 20:21:54,074][106225] Updated weights for policy 1, policy_version 158257 (0.0010) [2023-12-27 20:21:54,124][106225] Updated weights for policy 1, policy_version 158267 (0.0010) [2023-12-27 20:21:54,436][106226] Updated weights for policy 0, policy_version 157990 (0.0011) [2023-12-27 20:21:54,489][106226] Updated weights for policy 0, policy_version 158000 (0.0010) [2023-12-27 20:21:54,550][106226] Updated weights for policy 0, policy_version 158010 (0.0009) [2023-12-27 20:21:54,771][106225] Updated weights for policy 1, policy_version 158277 (0.0008) [2023-12-27 20:21:54,821][106225] Updated weights for policy 1, policy_version 158287 (0.0010) [2023-12-27 20:21:54,878][106225] Updated weights for policy 1, policy_version 158297 (0.0010) [2023-12-27 20:21:55,209][106226] Updated weights for policy 0, policy_version 158020 (0.0010) [2023-12-27 20:21:55,266][106226] Updated weights for policy 0, policy_version 158030 (0.0010) [2023-12-27 20:21:55,316][106226] Updated weights for policy 0, policy_version 158040 (0.0010) [2023-12-27 20:21:55,511][106225] Updated weights for policy 1, policy_version 158307 (0.0010) [2023-12-27 20:21:55,567][106225] Updated weights for policy 1, policy_version 158317 (0.0010) [2023-12-27 20:21:55,621][106225] Updated weights for policy 1, policy_version 158327 (0.0008) [2023-12-27 20:21:56,048][106226] Updated weights for policy 0, policy_version 158050 (0.0010) [2023-12-27 20:21:56,101][106226] Updated weights for policy 0, policy_version 158060 (0.0010) [2023-12-27 20:21:56,147][106226] Updated weights for policy 0, policy_version 158070 (0.0010) [2023-12-27 20:21:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 81010688. Throughput: 0: 9992.0, 1: 9906.7. Samples: 80983952. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:21:56,175][105115] Avg episode reward: [(0, '-5.431'), (1, '-6.406')] [2023-12-27 20:21:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000158336_40542208.pth... [2023-12-27 20:21:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000157184_40247296.pth [2023-12-27 20:21:56,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000158080_40476672.pth... [2023-12-27 20:21:56,194][106226] Updated weights for policy 0, policy_version 158080 (0.0010) [2023-12-27 20:21:56,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000156896_40173568.pth [2023-12-27 20:21:56,220][106225] Updated weights for policy 1, policy_version 158337 (0.0005) [2023-12-27 20:21:56,274][106225] Updated weights for policy 1, policy_version 158347 (0.0007) [2023-12-27 20:21:56,328][106225] Updated weights for policy 1, policy_version 158357 (0.0008) [2023-12-27 20:21:56,387][106225] Updated weights for policy 1, policy_version 158367 (0.0005) [2023-12-27 20:21:56,798][106226] Updated weights for policy 0, policy_version 158090 (0.0007) [2023-12-27 20:21:56,858][106226] Updated weights for policy 0, policy_version 158100 (0.0009) [2023-12-27 20:21:56,928][106226] Updated weights for policy 0, policy_version 158110 (0.0006) [2023-12-27 20:21:56,963][106225] Updated weights for policy 1, policy_version 158377 (0.0008) [2023-12-27 20:21:57,016][106225] Updated weights for policy 1, policy_version 158387 (0.0008) [2023-12-27 20:21:57,068][106225] Updated weights for policy 1, policy_version 158397 (0.0009) [2023-12-27 20:21:57,510][106226] Updated weights for policy 0, policy_version 158120 (0.0008) [2023-12-27 20:21:57,573][106226] Updated weights for policy 0, policy_version 158130 (0.0008) [2023-12-27 20:21:57,627][106226] Updated weights for policy 0, policy_version 158140 (0.0008) [2023-12-27 20:21:57,753][106225] Updated weights for policy 1, policy_version 158407 (0.0008) [2023-12-27 20:21:57,800][106225] Updated weights for policy 1, policy_version 158417 (0.0008) [2023-12-27 20:21:57,858][106225] Updated weights for policy 1, policy_version 158427 (0.0005) [2023-12-27 20:21:58,276][106226] Updated weights for policy 0, policy_version 158150 (0.0009) [2023-12-27 20:21:58,341][106226] Updated weights for policy 0, policy_version 158160 (0.0010) [2023-12-27 20:21:58,411][106226] Updated weights for policy 0, policy_version 158170 (0.0009) [2023-12-27 20:21:58,583][106225] Updated weights for policy 1, policy_version 158437 (0.0007) [2023-12-27 20:21:58,644][106225] Updated weights for policy 1, policy_version 158447 (0.0009) [2023-12-27 20:21:58,705][106225] Updated weights for policy 1, policy_version 158457 (0.0008) [2023-12-27 20:21:59,203][106226] Updated weights for policy 0, policy_version 158180 (0.0008) [2023-12-27 20:21:59,271][106226] Updated weights for policy 0, policy_version 158190 (0.0008) [2023-12-27 20:21:59,335][106226] Updated weights for policy 0, policy_version 158200 (0.0007) [2023-12-27 20:21:59,585][106225] Updated weights for policy 1, policy_version 158467 (0.0008) [2023-12-27 20:21:59,645][106225] Updated weights for policy 1, policy_version 158477 (0.0008) [2023-12-27 20:21:59,709][106225] Updated weights for policy 1, policy_version 158487 (0.0008) [2023-12-27 20:22:00,076][106226] Updated weights for policy 0, policy_version 158210 (0.0008) [2023-12-27 20:22:00,134][106226] Updated weights for policy 0, policy_version 158220 (0.0005) [2023-12-27 20:22:00,197][106226] Updated weights for policy 0, policy_version 158230 (0.0005) [2023-12-27 20:22:00,259][106226] Updated weights for policy 0, policy_version 158240 (0.0006) [2023-12-27 20:22:00,449][106225] Updated weights for policy 1, policy_version 158497 (0.0008) [2023-12-27 20:22:00,509][106225] Updated weights for policy 1, policy_version 158507 (0.0008) [2023-12-27 20:22:00,577][106225] Updated weights for policy 1, policy_version 158517 (0.0005) [2023-12-27 20:22:00,631][106225] Updated weights for policy 1, policy_version 158527 (0.0006) [2023-12-27 20:22:00,816][106226] Updated weights for policy 0, policy_version 158250 (0.0008) [2023-12-27 20:22:00,870][106226] Updated weights for policy 0, policy_version 158260 (0.0008) [2023-12-27 20:22:00,943][106226] Updated weights for policy 0, policy_version 158270 (0.0008) [2023-12-27 20:22:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 81117184. Throughput: 0: 10028.2, 1: 9958.5. Samples: 81105852. Policy #0 lag: (min: 12.0, avg: 13.1, max: 27.0) [2023-12-27 20:22:01,175][105115] Avg episode reward: [(0, '-5.279'), (1, '-6.631')] [2023-12-27 20:22:01,254][106225] Updated weights for policy 1, policy_version 158537 (0.0009) [2023-12-27 20:22:01,316][106225] Updated weights for policy 1, policy_version 158547 (0.0009) [2023-12-27 20:22:01,382][106225] Updated weights for policy 1, policy_version 158557 (0.0010) [2023-12-27 20:22:01,710][106226] Updated weights for policy 0, policy_version 158280 (0.0008) [2023-12-27 20:22:01,779][106226] Updated weights for policy 0, policy_version 158290 (0.0006) [2023-12-27 20:22:01,848][106226] Updated weights for policy 0, policy_version 158300 (0.0005) [2023-12-27 20:22:02,119][106225] Updated weights for policy 1, policy_version 158567 (0.0007) [2023-12-27 20:22:02,175][106225] Updated weights for policy 1, policy_version 158577 (0.0008) [2023-12-27 20:22:02,241][106225] Updated weights for policy 1, policy_version 158587 (0.0008) [2023-12-27 20:22:02,539][106226] Updated weights for policy 0, policy_version 158310 (0.0007) [2023-12-27 20:22:02,606][106226] Updated weights for policy 0, policy_version 158320 (0.0008) [2023-12-27 20:22:02,673][106226] Updated weights for policy 0, policy_version 158330 (0.0009) [2023-12-27 20:22:02,985][106225] Updated weights for policy 1, policy_version 158597 (0.0008) [2023-12-27 20:22:03,049][106225] Updated weights for policy 1, policy_version 158607 (0.0007) [2023-12-27 20:22:03,111][106225] Updated weights for policy 1, policy_version 158617 (0.0009) [2023-12-27 20:22:03,336][106226] Updated weights for policy 0, policy_version 158340 (0.0008) [2023-12-27 20:22:03,396][106226] Updated weights for policy 0, policy_version 158350 (0.0008) [2023-12-27 20:22:03,453][106226] Updated weights for policy 0, policy_version 158360 (0.0007) [2023-12-27 20:22:03,770][106225] Updated weights for policy 1, policy_version 158627 (0.0007) [2023-12-27 20:22:03,819][106225] Updated weights for policy 1, policy_version 158637 (0.0007) [2023-12-27 20:22:03,880][106225] Updated weights for policy 1, policy_version 158647 (0.0009) [2023-12-27 20:22:04,140][106226] Updated weights for policy 0, policy_version 158370 (0.0009) [2023-12-27 20:22:04,195][106226] Updated weights for policy 0, policy_version 158380 (0.0008) [2023-12-27 20:22:04,256][106226] Updated weights for policy 0, policy_version 158390 (0.0009) [2023-12-27 20:22:04,318][106226] Updated weights for policy 0, policy_version 158400 (0.0010) [2023-12-27 20:22:04,562][106225] Updated weights for policy 1, policy_version 158657 (0.0008) [2023-12-27 20:22:04,626][106225] Updated weights for policy 1, policy_version 158667 (0.0006) [2023-12-27 20:22:04,678][106225] Updated weights for policy 1, policy_version 158677 (0.0005) [2023-12-27 20:22:04,728][106225] Updated weights for policy 1, policy_version 158687 (0.0005) [2023-12-27 20:22:05,039][106226] Updated weights for policy 0, policy_version 158410 (0.0006) [2023-12-27 20:22:05,093][106226] Updated weights for policy 0, policy_version 158420 (0.0005) [2023-12-27 20:22:05,147][106226] Updated weights for policy 0, policy_version 158430 (0.0005) [2023-12-27 20:22:05,335][106225] Updated weights for policy 1, policy_version 158697 (0.0010) [2023-12-27 20:22:05,395][106225] Updated weights for policy 1, policy_version 158707 (0.0010) [2023-12-27 20:22:05,453][106225] Updated weights for policy 1, policy_version 158717 (0.0010) [2023-12-27 20:22:05,764][106226] Updated weights for policy 0, policy_version 158440 (0.0010) [2023-12-27 20:22:05,815][106226] Updated weights for policy 0, policy_version 158450 (0.0011) [2023-12-27 20:22:05,868][106226] Updated weights for policy 0, policy_version 158460 (0.0010) [2023-12-27 20:22:06,161][106225] Updated weights for policy 1, policy_version 158727 (0.0010) [2023-12-27 20:22:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.3). Total num frames: 81215488. Throughput: 0: 10071.8, 1: 9928.3. Samples: 81226972. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:06,175][105115] Avg episode reward: [(0, '-5.363'), (1, '-6.390')] [2023-12-27 20:22:06,230][106225] Updated weights for policy 1, policy_version 158737 (0.0010) [2023-12-27 20:22:06,294][106225] Updated weights for policy 1, policy_version 158747 (0.0011) [2023-12-27 20:22:06,589][106226] Updated weights for policy 0, policy_version 158470 (0.0009) [2023-12-27 20:22:06,650][106226] Updated weights for policy 0, policy_version 158480 (0.0008) [2023-12-27 20:22:06,707][106226] Updated weights for policy 0, policy_version 158490 (0.0008) [2023-12-27 20:22:06,903][106225] Updated weights for policy 1, policy_version 158757 (0.0010) [2023-12-27 20:22:06,973][106225] Updated weights for policy 1, policy_version 158767 (0.0010) [2023-12-27 20:22:07,032][106225] Updated weights for policy 1, policy_version 158777 (0.0009) [2023-12-27 20:22:07,407][106226] Updated weights for policy 0, policy_version 158500 (0.0008) [2023-12-27 20:22:07,461][106226] Updated weights for policy 0, policy_version 158510 (0.0009) [2023-12-27 20:22:07,515][106226] Updated weights for policy 0, policy_version 158520 (0.0009) [2023-12-27 20:22:07,701][106225] Updated weights for policy 1, policy_version 158787 (0.0008) [2023-12-27 20:22:07,756][106225] Updated weights for policy 1, policy_version 158797 (0.0008) [2023-12-27 20:22:07,807][106225] Updated weights for policy 1, policy_version 158807 (0.0008) [2023-12-27 20:22:08,188][106226] Updated weights for policy 0, policy_version 158530 (0.0008) [2023-12-27 20:22:08,244][106226] Updated weights for policy 0, policy_version 158540 (0.0008) [2023-12-27 20:22:08,300][106226] Updated weights for policy 0, policy_version 158550 (0.0009) [2023-12-27 20:22:08,366][106226] Updated weights for policy 0, policy_version 158560 (0.0007) [2023-12-27 20:22:08,587][106225] Updated weights for policy 1, policy_version 158817 (0.0008) [2023-12-27 20:22:08,646][106225] Updated weights for policy 1, policy_version 158827 (0.0009) [2023-12-27 20:22:08,698][106225] Updated weights for policy 1, policy_version 158837 (0.0008) [2023-12-27 20:22:08,751][106225] Updated weights for policy 1, policy_version 158847 (0.0009) [2023-12-27 20:22:09,046][106226] Updated weights for policy 0, policy_version 158570 (0.0009) [2023-12-27 20:22:09,103][106226] Updated weights for policy 0, policy_version 158581 (0.0008) [2023-12-27 20:22:09,158][106226] Updated weights for policy 0, policy_version 158591 (0.0009) [2023-12-27 20:22:09,542][106225] Updated weights for policy 1, policy_version 158857 (0.0009) [2023-12-27 20:22:09,600][106225] Updated weights for policy 1, policy_version 158867 (0.0010) [2023-12-27 20:22:09,669][106225] Updated weights for policy 1, policy_version 158877 (0.0011) [2023-12-27 20:22:09,986][106226] Updated weights for policy 0, policy_version 158601 (0.0009) [2023-12-27 20:22:10,051][106226] Updated weights for policy 0, policy_version 158611 (0.0009) [2023-12-27 20:22:10,116][106226] Updated weights for policy 0, policy_version 158621 (0.0008) [2023-12-27 20:22:10,390][106225] Updated weights for policy 1, policy_version 158887 (0.0007) [2023-12-27 20:22:10,446][106225] Updated weights for policy 1, policy_version 158897 (0.0006) [2023-12-27 20:22:10,508][106225] Updated weights for policy 1, policy_version 158907 (0.0008) [2023-12-27 20:22:10,891][106226] Updated weights for policy 0, policy_version 158631 (0.0009) [2023-12-27 20:22:10,940][106226] Updated weights for policy 0, policy_version 158641 (0.0008) [2023-12-27 20:22:10,990][106226] Updated weights for policy 0, policy_version 158651 (0.0010) [2023-12-27 20:22:11,157][106225] Updated weights for policy 1, policy_version 158917 (0.0009) [2023-12-27 20:22:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 81313792. Throughput: 0: 10128.0, 1: 9946.9. Samples: 81286488. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:11,175][105115] Avg episode reward: [(0, '-5.356'), (1, '-6.952')] [2023-12-27 20:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000158656_40624128.pth... [2023-12-27 20:22:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000157472_40321024.pth [2023-12-27 20:22:11,222][106225] Updated weights for policy 1, policy_version 158927 (0.0009) [2023-12-27 20:22:11,289][106225] Updated weights for policy 1, policy_version 158937 (0.0008) [2023-12-27 20:22:11,325][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000158944_40697856.pth... [2023-12-27 20:22:11,330][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000157760_40394752.pth [2023-12-27 20:22:11,840][106226] Updated weights for policy 0, policy_version 158661 (0.0009) [2023-12-27 20:22:11,906][106226] Updated weights for policy 0, policy_version 158671 (0.0008) [2023-12-27 20:22:11,968][106226] Updated weights for policy 0, policy_version 158681 (0.0009) [2023-12-27 20:22:12,059][106225] Updated weights for policy 1, policy_version 158947 (0.0008) [2023-12-27 20:22:12,124][106225] Updated weights for policy 1, policy_version 158957 (0.0009) [2023-12-27 20:22:12,189][106225] Updated weights for policy 1, policy_version 158967 (0.0008) [2023-12-27 20:22:12,645][106226] Updated weights for policy 0, policy_version 158691 (0.0008) [2023-12-27 20:22:12,702][106226] Updated weights for policy 0, policy_version 158701 (0.0006) [2023-12-27 20:22:12,761][106226] Updated weights for policy 0, policy_version 158711 (0.0008) [2023-12-27 20:22:12,978][106225] Updated weights for policy 1, policy_version 158977 (0.0010) [2023-12-27 20:22:13,033][106225] Updated weights for policy 1, policy_version 158987 (0.0007) [2023-12-27 20:22:13,081][106225] Updated weights for policy 1, policy_version 158997 (0.0005) [2023-12-27 20:22:13,129][106225] Updated weights for policy 1, policy_version 159007 (0.0005) [2023-12-27 20:22:13,442][106226] Updated weights for policy 0, policy_version 158721 (0.0008) [2023-12-27 20:22:13,498][106226] Updated weights for policy 0, policy_version 158731 (0.0009) [2023-12-27 20:22:13,558][106226] Updated weights for policy 0, policy_version 158741 (0.0008) [2023-12-27 20:22:13,618][106226] Updated weights for policy 0, policy_version 158751 (0.0009) [2023-12-27 20:22:13,738][106225] Updated weights for policy 1, policy_version 159017 (0.0008) [2023-12-27 20:22:13,786][106225] Updated weights for policy 1, policy_version 159027 (0.0008) [2023-12-27 20:22:13,837][106225] Updated weights for policy 1, policy_version 159037 (0.0008) [2023-12-27 20:22:14,301][106226] Updated weights for policy 0, policy_version 158761 (0.0009) [2023-12-27 20:22:14,356][106226] Updated weights for policy 0, policy_version 158771 (0.0007) [2023-12-27 20:22:14,407][106226] Updated weights for policy 0, policy_version 158781 (0.0005) [2023-12-27 20:22:14,594][106225] Updated weights for policy 1, policy_version 159047 (0.0008) [2023-12-27 20:22:14,642][106225] Updated weights for policy 1, policy_version 159057 (0.0008) [2023-12-27 20:22:14,697][106225] Updated weights for policy 1, policy_version 159067 (0.0008) [2023-12-27 20:22:15,173][106226] Updated weights for policy 0, policy_version 158791 (0.0009) [2023-12-27 20:22:15,232][106226] Updated weights for policy 0, policy_version 158801 (0.0010) [2023-12-27 20:22:15,294][106226] Updated weights for policy 0, policy_version 158811 (0.0009) [2023-12-27 20:22:15,346][106225] Updated weights for policy 1, policy_version 159077 (0.0008) [2023-12-27 20:22:15,398][106225] Updated weights for policy 1, policy_version 159087 (0.0008) [2023-12-27 20:22:15,457][106225] Updated weights for policy 1, policy_version 159097 (0.0008) [2023-12-27 20:22:16,031][106226] Updated weights for policy 0, policy_version 158821 (0.0008) [2023-12-27 20:22:16,087][106226] Updated weights for policy 0, policy_version 158831 (0.0008) [2023-12-27 20:22:16,145][106226] Updated weights for policy 0, policy_version 158841 (0.0009) [2023-12-27 20:22:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 81403904. Throughput: 0: 9969.2, 1: 9843.0. Samples: 81399908. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:16,175][105115] Avg episode reward: [(0, '-5.586'), (1, '-6.659')] [2023-12-27 20:22:16,187][106225] Updated weights for policy 1, policy_version 159107 (0.0008) [2023-12-27 20:22:16,236][106225] Updated weights for policy 1, policy_version 159117 (0.0009) [2023-12-27 20:22:16,284][106225] Updated weights for policy 1, policy_version 159127 (0.0008) [2023-12-27 20:22:16,878][106226] Updated weights for policy 0, policy_version 158851 (0.0009) [2023-12-27 20:22:16,923][106226] Updated weights for policy 0, policy_version 158861 (0.0008) [2023-12-27 20:22:16,968][106226] Updated weights for policy 0, policy_version 158871 (0.0008) [2023-12-27 20:22:17,020][106225] Updated weights for policy 1, policy_version 159137 (0.0009) [2023-12-27 20:22:17,068][106225] Updated weights for policy 1, policy_version 159147 (0.0008) [2023-12-27 20:22:17,122][106225] Updated weights for policy 1, policy_version 159157 (0.0008) [2023-12-27 20:22:17,174][106225] Updated weights for policy 1, policy_version 159167 (0.0008) [2023-12-27 20:22:17,756][106226] Updated weights for policy 0, policy_version 158881 (0.0008) [2023-12-27 20:22:17,813][106226] Updated weights for policy 0, policy_version 158891 (0.0009) [2023-12-27 20:22:17,843][106225] Updated weights for policy 1, policy_version 159177 (0.0008) [2023-12-27 20:22:17,878][106226] Updated weights for policy 0, policy_version 158901 (0.0008) [2023-12-27 20:22:17,909][106225] Updated weights for policy 1, policy_version 159187 (0.0005) [2023-12-27 20:22:17,939][106226] Updated weights for policy 0, policy_version 158911 (0.0008) [2023-12-27 20:22:17,964][106225] Updated weights for policy 1, policy_version 159197 (0.0006) [2023-12-27 20:22:18,530][106225] Updated weights for policy 1, policy_version 159207 (0.0008) [2023-12-27 20:22:18,585][106225] Updated weights for policy 1, policy_version 159217 (0.0008) [2023-12-27 20:22:18,647][106225] Updated weights for policy 1, policy_version 159227 (0.0008) [2023-12-27 20:22:18,711][106226] Updated weights for policy 0, policy_version 158921 (0.0008) [2023-12-27 20:22:18,764][106226] Updated weights for policy 0, policy_version 158931 (0.0009) [2023-12-27 20:22:18,823][106226] Updated weights for policy 0, policy_version 158941 (0.0008) [2023-12-27 20:22:19,366][106225] Updated weights for policy 1, policy_version 159237 (0.0008) [2023-12-27 20:22:19,429][106225] Updated weights for policy 1, policy_version 159247 (0.0009) [2023-12-27 20:22:19,492][106225] Updated weights for policy 1, policy_version 159257 (0.0008) [2023-12-27 20:22:19,509][106226] Updated weights for policy 0, policy_version 158951 (0.0009) [2023-12-27 20:22:19,563][106226] Updated weights for policy 0, policy_version 158961 (0.0010) [2023-12-27 20:22:19,618][106226] Updated weights for policy 0, policy_version 158971 (0.0011) [2023-12-27 20:22:20,115][106225] Updated weights for policy 1, policy_version 159267 (0.0006) [2023-12-27 20:22:20,179][106225] Updated weights for policy 1, policy_version 159277 (0.0006) [2023-12-27 20:22:20,247][106225] Updated weights for policy 1, policy_version 159287 (0.0007) [2023-12-27 20:22:20,440][106226] Updated weights for policy 0, policy_version 158981 (0.0009) [2023-12-27 20:22:20,500][106226] Updated weights for policy 0, policy_version 158991 (0.0009) [2023-12-27 20:22:20,566][106226] Updated weights for policy 0, policy_version 159001 (0.0009) [2023-12-27 20:22:20,891][106225] Updated weights for policy 1, policy_version 159297 (0.0008) [2023-12-27 20:22:20,949][106225] Updated weights for policy 1, policy_version 159307 (0.0008) [2023-12-27 20:22:21,003][106225] Updated weights for policy 1, policy_version 159317 (0.0008) [2023-12-27 20:22:21,070][106225] Updated weights for policy 1, policy_version 159327 (0.0007) [2023-12-27 20:22:21,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 81510400. Throughput: 0: 9796.2, 1: 9906.8. Samples: 81517700. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:21,175][105115] Avg episode reward: [(0, '-5.557'), (1, '-6.862')] [2023-12-27 20:22:21,423][106226] Updated weights for policy 0, policy_version 159011 (0.0009) [2023-12-27 20:22:21,481][106226] Updated weights for policy 0, policy_version 159021 (0.0008) [2023-12-27 20:22:21,549][106226] Updated weights for policy 0, policy_version 159031 (0.0009) [2023-12-27 20:22:21,889][106225] Updated weights for policy 1, policy_version 159337 (0.0008) [2023-12-27 20:22:21,953][106225] Updated weights for policy 1, policy_version 159347 (0.0008) [2023-12-27 20:22:22,015][106225] Updated weights for policy 1, policy_version 159357 (0.0008) [2023-12-27 20:22:22,264][106226] Updated weights for policy 0, policy_version 159041 (0.0011) [2023-12-27 20:22:22,322][106226] Updated weights for policy 0, policy_version 159051 (0.0011) [2023-12-27 20:22:22,385][106226] Updated weights for policy 0, policy_version 159061 (0.0011) [2023-12-27 20:22:22,452][106226] Updated weights for policy 0, policy_version 159071 (0.0010) [2023-12-27 20:22:22,734][106225] Updated weights for policy 1, policy_version 159367 (0.0008) [2023-12-27 20:22:22,795][106225] Updated weights for policy 1, policy_version 159377 (0.0008) [2023-12-27 20:22:22,854][106225] Updated weights for policy 1, policy_version 159387 (0.0008) [2023-12-27 20:22:23,167][106226] Updated weights for policy 0, policy_version 159081 (0.0007) [2023-12-27 20:22:23,227][106226] Updated weights for policy 0, policy_version 159091 (0.0008) [2023-12-27 20:22:23,281][106226] Updated weights for policy 0, policy_version 159101 (0.0008) [2023-12-27 20:22:23,602][106225] Updated weights for policy 1, policy_version 159397 (0.0008) [2023-12-27 20:22:23,656][106225] Updated weights for policy 1, policy_version 159407 (0.0008) [2023-12-27 20:22:23,725][106225] Updated weights for policy 1, policy_version 159417 (0.0008) [2023-12-27 20:22:23,957][106226] Updated weights for policy 0, policy_version 159111 (0.0007) [2023-12-27 20:22:24,013][106226] Updated weights for policy 0, policy_version 159121 (0.0005) [2023-12-27 20:22:24,066][106226] Updated weights for policy 0, policy_version 159131 (0.0006) [2023-12-27 20:22:24,455][106225] Updated weights for policy 1, policy_version 159427 (0.0008) [2023-12-27 20:22:24,516][106225] Updated weights for policy 1, policy_version 159437 (0.0005) [2023-12-27 20:22:24,582][106225] Updated weights for policy 1, policy_version 159447 (0.0007) [2023-12-27 20:22:24,783][106226] Updated weights for policy 0, policy_version 159141 (0.0008) [2023-12-27 20:22:24,844][106226] Updated weights for policy 0, policy_version 159151 (0.0009) [2023-12-27 20:22:24,900][106226] Updated weights for policy 0, policy_version 159161 (0.0007) [2023-12-27 20:22:25,141][106225] Updated weights for policy 1, policy_version 159457 (0.0007) [2023-12-27 20:22:25,196][106225] Updated weights for policy 1, policy_version 159467 (0.0007) [2023-12-27 20:22:25,245][106225] Updated weights for policy 1, policy_version 159477 (0.0005) [2023-12-27 20:22:25,300][106225] Updated weights for policy 1, policy_version 159487 (0.0005) [2023-12-27 20:22:25,561][106226] Updated weights for policy 0, policy_version 159171 (0.0006) [2023-12-27 20:22:25,631][106226] Updated weights for policy 0, policy_version 159181 (0.0011) [2023-12-27 20:22:25,693][106226] Updated weights for policy 0, policy_version 159191 (0.0009) [2023-12-27 20:22:25,912][106225] Updated weights for policy 1, policy_version 159497 (0.0009) [2023-12-27 20:22:25,971][106225] Updated weights for policy 1, policy_version 159507 (0.0008) [2023-12-27 20:22:26,018][106225] Updated weights for policy 1, policy_version 159517 (0.0005) [2023-12-27 20:22:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 81608704. Throughput: 0: 9786.0, 1: 9835.8. Samples: 81574124. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:26,175][105115] Avg episode reward: [(0, '-5.418'), (1, '-6.454')] [2023-12-27 20:22:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000159200_40763392.pth... [2023-12-27 20:22:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000159520_40845312.pth... [2023-12-27 20:22:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000158080_40476672.pth [2023-12-27 20:22:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000158336_40542208.pth [2023-12-27 20:22:26,297][106226] Updated weights for policy 0, policy_version 159201 (0.0008) [2023-12-27 20:22:26,355][106226] Updated weights for policy 0, policy_version 159211 (0.0008) [2023-12-27 20:22:26,415][106226] Updated weights for policy 0, policy_version 159221 (0.0008) [2023-12-27 20:22:26,469][106226] Updated weights for policy 0, policy_version 159231 (0.0008) [2023-12-27 20:22:26,677][106225] Updated weights for policy 1, policy_version 159527 (0.0009) [2023-12-27 20:22:26,725][106225] Updated weights for policy 1, policy_version 159537 (0.0009) [2023-12-27 20:22:26,774][106225] Updated weights for policy 1, policy_version 159547 (0.0009) [2023-12-27 20:22:27,140][106226] Updated weights for policy 0, policy_version 159241 (0.0010) [2023-12-27 20:22:27,186][106226] Updated weights for policy 0, policy_version 159251 (0.0010) [2023-12-27 20:22:27,241][106226] Updated weights for policy 0, policy_version 159261 (0.0010) [2023-12-27 20:22:27,380][106225] Updated weights for policy 1, policy_version 159557 (0.0007) [2023-12-27 20:22:27,433][106225] Updated weights for policy 1, policy_version 159567 (0.0005) [2023-12-27 20:22:27,483][106225] Updated weights for policy 1, policy_version 159577 (0.0005) [2023-12-27 20:22:27,866][106226] Updated weights for policy 0, policy_version 159271 (0.0010) [2023-12-27 20:22:27,922][106226] Updated weights for policy 0, policy_version 159281 (0.0009) [2023-12-27 20:22:27,973][106226] Updated weights for policy 0, policy_version 159291 (0.0005) [2023-12-27 20:22:28,202][106225] Updated weights for policy 1, policy_version 159587 (0.0008) [2023-12-27 20:22:28,254][106225] Updated weights for policy 1, policy_version 159597 (0.0008) [2023-12-27 20:22:28,304][106225] Updated weights for policy 1, policy_version 159607 (0.0008) [2023-12-27 20:22:28,631][106226] Updated weights for policy 0, policy_version 159301 (0.0007) [2023-12-27 20:22:28,689][106226] Updated weights for policy 0, policy_version 159311 (0.0008) [2023-12-27 20:22:28,743][106226] Updated weights for policy 0, policy_version 159321 (0.0009) [2023-12-27 20:22:29,054][106225] Updated weights for policy 1, policy_version 159617 (0.0008) [2023-12-27 20:22:29,108][106225] Updated weights for policy 1, policy_version 159627 (0.0005) [2023-12-27 20:22:29,159][106225] Updated weights for policy 1, policy_version 159637 (0.0007) [2023-12-27 20:22:29,212][106225] Updated weights for policy 1, policy_version 159647 (0.0008) [2023-12-27 20:22:29,383][106226] Updated weights for policy 0, policy_version 159331 (0.0007) [2023-12-27 20:22:29,452][106226] Updated weights for policy 0, policy_version 159341 (0.0008) [2023-12-27 20:22:29,519][106226] Updated weights for policy 0, policy_version 159351 (0.0007) [2023-12-27 20:22:29,910][106225] Updated weights for policy 1, policy_version 159657 (0.0007) [2023-12-27 20:22:29,976][106225] Updated weights for policy 1, policy_version 159667 (0.0008) [2023-12-27 20:22:30,042][106225] Updated weights for policy 1, policy_version 159677 (0.0008) [2023-12-27 20:22:30,135][106226] Updated weights for policy 0, policy_version 159361 (0.0008) [2023-12-27 20:22:30,198][106226] Updated weights for policy 0, policy_version 159371 (0.0010) [2023-12-27 20:22:30,249][106226] Updated weights for policy 0, policy_version 159381 (0.0008) [2023-12-27 20:22:30,305][106226] Updated weights for policy 0, policy_version 159391 (0.0007) [2023-12-27 20:22:30,780][106225] Updated weights for policy 1, policy_version 159687 (0.0008) [2023-12-27 20:22:30,828][106225] Updated weights for policy 1, policy_version 159697 (0.0008) [2023-12-27 20:22:30,876][106225] Updated weights for policy 1, policy_version 159707 (0.0008) [2023-12-27 20:22:30,982][106226] Updated weights for policy 0, policy_version 159401 (0.0009) [2023-12-27 20:22:31,046][106226] Updated weights for policy 0, policy_version 159411 (0.0009) [2023-12-27 20:22:31,109][106226] Updated weights for policy 0, policy_version 159421 (0.0007) [2023-12-27 20:22:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 81715200. Throughput: 0: 9878.0, 1: 9981.0. Samples: 81700236. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:31,175][105115] Avg episode reward: [(0, '-5.533'), (1, '-6.275')] [2023-12-27 20:22:31,607][106225] Updated weights for policy 1, policy_version 159717 (0.0006) [2023-12-27 20:22:31,666][106225] Updated weights for policy 1, policy_version 159727 (0.0008) [2023-12-27 20:22:31,732][106225] Updated weights for policy 1, policy_version 159737 (0.0009) [2023-12-27 20:22:31,828][106226] Updated weights for policy 0, policy_version 159431 (0.0009) [2023-12-27 20:22:31,876][106226] Updated weights for policy 0, policy_version 159441 (0.0006) [2023-12-27 20:22:31,929][106226] Updated weights for policy 0, policy_version 159451 (0.0005) [2023-12-27 20:22:32,451][106225] Updated weights for policy 1, policy_version 159747 (0.0008) [2023-12-27 20:22:32,517][106225] Updated weights for policy 1, policy_version 159757 (0.0008) [2023-12-27 20:22:32,570][106225] Updated weights for policy 1, policy_version 159767 (0.0009) [2023-12-27 20:22:32,675][106226] Updated weights for policy 0, policy_version 159461 (0.0007) [2023-12-27 20:22:32,734][106226] Updated weights for policy 0, policy_version 159471 (0.0008) [2023-12-27 20:22:32,796][106226] Updated weights for policy 0, policy_version 159481 (0.0008) [2023-12-27 20:22:33,316][106225] Updated weights for policy 1, policy_version 159777 (0.0009) [2023-12-27 20:22:33,369][106225] Updated weights for policy 1, policy_version 159787 (0.0008) [2023-12-27 20:22:33,413][106225] Updated weights for policy 1, policy_version 159797 (0.0007) [2023-12-27 20:22:33,414][106226] Updated weights for policy 0, policy_version 159491 (0.0009) [2023-12-27 20:22:33,460][106225] Updated weights for policy 1, policy_version 159807 (0.0006) [2023-12-27 20:22:33,471][106226] Updated weights for policy 0, policy_version 159501 (0.0008) [2023-12-27 20:22:33,530][106226] Updated weights for policy 0, policy_version 159511 (0.0006) [2023-12-27 20:22:34,182][106226] Updated weights for policy 0, policy_version 159521 (0.0005) [2023-12-27 20:22:34,188][106225] Updated weights for policy 1, policy_version 159817 (0.0008) [2023-12-27 20:22:34,243][106226] Updated weights for policy 0, policy_version 159531 (0.0008) [2023-12-27 20:22:34,248][106225] Updated weights for policy 1, policy_version 159827 (0.0009) [2023-12-27 20:22:34,305][106226] Updated weights for policy 0, policy_version 159541 (0.0007) [2023-12-27 20:22:34,307][106225] Updated weights for policy 1, policy_version 159837 (0.0005) [2023-12-27 20:22:34,368][106226] Updated weights for policy 0, policy_version 159551 (0.0007) [2023-12-27 20:22:34,998][106226] Updated weights for policy 0, policy_version 159561 (0.0006) [2023-12-27 20:22:35,052][106226] Updated weights for policy 0, policy_version 159571 (0.0006) [2023-12-27 20:22:35,090][106225] Updated weights for policy 1, policy_version 159847 (0.0009) [2023-12-27 20:22:35,104][106226] Updated weights for policy 0, policy_version 159581 (0.0005) [2023-12-27 20:22:35,137][106225] Updated weights for policy 1, policy_version 159857 (0.0008) [2023-12-27 20:22:35,194][106225] Updated weights for policy 1, policy_version 159867 (0.0010) [2023-12-27 20:22:35,730][106226] Updated weights for policy 0, policy_version 159591 (0.0008) [2023-12-27 20:22:35,790][106226] Updated weights for policy 0, policy_version 159601 (0.0007) [2023-12-27 20:22:35,855][106226] Updated weights for policy 0, policy_version 159611 (0.0005) [2023-12-27 20:22:35,936][106225] Updated weights for policy 1, policy_version 159877 (0.0009) [2023-12-27 20:22:35,993][106225] Updated weights for policy 1, policy_version 159887 (0.0009) [2023-12-27 20:22:36,051][106225] Updated weights for policy 1, policy_version 159897 (0.0009) [2023-12-27 20:22:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 81813504. Throughput: 0: 9945.7, 1: 9907.2. Samples: 81818060. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:36,175][105115] Avg episode reward: [(0, '-5.390'), (1, '-6.460')] [2023-12-27 20:22:36,557][106226] Updated weights for policy 0, policy_version 159621 (0.0007) [2023-12-27 20:22:36,618][106226] Updated weights for policy 0, policy_version 159631 (0.0006) [2023-12-27 20:22:36,678][106226] Updated weights for policy 0, policy_version 159641 (0.0006) [2023-12-27 20:22:36,787][106225] Updated weights for policy 1, policy_version 159907 (0.0009) [2023-12-27 20:22:36,851][106225] Updated weights for policy 1, policy_version 159917 (0.0008) [2023-12-27 20:22:36,905][106225] Updated weights for policy 1, policy_version 159927 (0.0008) [2023-12-27 20:22:37,242][106226] Updated weights for policy 0, policy_version 159651 (0.0008) [2023-12-27 20:22:37,304][106226] Updated weights for policy 0, policy_version 159661 (0.0008) [2023-12-27 20:22:37,362][106226] Updated weights for policy 0, policy_version 159671 (0.0009) [2023-12-27 20:22:37,625][106225] Updated weights for policy 1, policy_version 159937 (0.0008) [2023-12-27 20:22:37,694][106225] Updated weights for policy 1, policy_version 159947 (0.0008) [2023-12-27 20:22:37,756][106225] Updated weights for policy 1, policy_version 159957 (0.0008) [2023-12-27 20:22:37,820][106225] Updated weights for policy 1, policy_version 159967 (0.0008) [2023-12-27 20:22:38,035][106226] Updated weights for policy 0, policy_version 159681 (0.0008) [2023-12-27 20:22:38,104][106226] Updated weights for policy 0, policy_version 159691 (0.0008) [2023-12-27 20:22:38,159][106226] Updated weights for policy 0, policy_version 159701 (0.0008) [2023-12-27 20:22:38,211][106226] Updated weights for policy 0, policy_version 159711 (0.0008) [2023-12-27 20:22:38,555][106225] Updated weights for policy 1, policy_version 159977 (0.0009) [2023-12-27 20:22:38,604][106225] Updated weights for policy 1, policy_version 159987 (0.0008) [2023-12-27 20:22:38,654][106225] Updated weights for policy 1, policy_version 159998 (0.0009) [2023-12-27 20:22:38,938][106226] Updated weights for policy 0, policy_version 159721 (0.0008) [2023-12-27 20:22:38,996][106226] Updated weights for policy 0, policy_version 159731 (0.0008) [2023-12-27 20:22:39,059][106226] Updated weights for policy 0, policy_version 159741 (0.0008) [2023-12-27 20:22:39,414][106225] Updated weights for policy 1, policy_version 160008 (0.0009) [2023-12-27 20:22:39,485][106225] Updated weights for policy 1, policy_version 160018 (0.0008) [2023-12-27 20:22:39,553][106225] Updated weights for policy 1, policy_version 160028 (0.0007) [2023-12-27 20:22:39,888][106226] Updated weights for policy 0, policy_version 159751 (0.0008) [2023-12-27 20:22:39,955][106226] Updated weights for policy 0, policy_version 159761 (0.0008) [2023-12-27 20:22:40,016][106226] Updated weights for policy 0, policy_version 159771 (0.0008) [2023-12-27 20:22:40,261][106225] Updated weights for policy 1, policy_version 160038 (0.0007) [2023-12-27 20:22:40,325][106225] Updated weights for policy 1, policy_version 160048 (0.0007) [2023-12-27 20:22:40,387][106225] Updated weights for policy 1, policy_version 160058 (0.0008) [2023-12-27 20:22:40,717][106226] Updated weights for policy 0, policy_version 159781 (0.0011) [2023-12-27 20:22:40,776][106226] Updated weights for policy 0, policy_version 159791 (0.0010) [2023-12-27 20:22:40,836][106226] Updated weights for policy 0, policy_version 159801 (0.0011) [2023-12-27 20:22:41,145][106225] Updated weights for policy 1, policy_version 160068 (0.0008) [2023-12-27 20:22:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 81903616. Throughput: 0: 9930.0, 1: 9911.7. Samples: 81876832. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:41,175][105115] Avg episode reward: [(0, '-5.762'), (1, '-6.459')] [2023-12-27 20:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000159808_40919040.pth... [2023-12-27 20:22:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000158656_40624128.pth [2023-12-27 20:22:41,213][106225] Updated weights for policy 1, policy_version 160078 (0.0009) [2023-12-27 20:22:41,278][106225] Updated weights for policy 1, policy_version 160088 (0.0007) [2023-12-27 20:22:41,322][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000160096_40992768.pth... [2023-12-27 20:22:41,326][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000158944_40697856.pth [2023-12-27 20:22:41,598][106226] Updated weights for policy 0, policy_version 159811 (0.0011) [2023-12-27 20:22:41,676][106226] Updated weights for policy 0, policy_version 159821 (0.0008) [2023-12-27 20:22:41,747][106226] Updated weights for policy 0, policy_version 159831 (0.0007) [2023-12-27 20:22:42,027][106225] Updated weights for policy 1, policy_version 160098 (0.0008) [2023-12-27 20:22:42,086][106225] Updated weights for policy 1, policy_version 160108 (0.0009) [2023-12-27 20:22:42,142][106225] Updated weights for policy 1, policy_version 160118 (0.0009) [2023-12-27 20:22:42,198][106225] Updated weights for policy 1, policy_version 160128 (0.0010) [2023-12-27 20:22:42,400][106226] Updated weights for policy 0, policy_version 159841 (0.0011) [2023-12-27 20:22:42,450][106226] Updated weights for policy 0, policy_version 159851 (0.0008) [2023-12-27 20:22:42,498][106226] Updated weights for policy 0, policy_version 159861 (0.0008) [2023-12-27 20:22:42,559][106226] Updated weights for policy 0, policy_version 159871 (0.0008) [2023-12-27 20:22:42,961][106225] Updated weights for policy 1, policy_version 160138 (0.0010) [2023-12-27 20:22:43,024][106225] Updated weights for policy 1, policy_version 160148 (0.0010) [2023-12-27 20:22:43,089][106225] Updated weights for policy 1, policy_version 160158 (0.0010) [2023-12-27 20:22:43,330][106226] Updated weights for policy 0, policy_version 159881 (0.0008) [2023-12-27 20:22:43,387][106226] Updated weights for policy 0, policy_version 159891 (0.0008) [2023-12-27 20:22:43,439][106226] Updated weights for policy 0, policy_version 159901 (0.0008) [2023-12-27 20:22:43,703][106225] Updated weights for policy 1, policy_version 160168 (0.0006) [2023-12-27 20:22:43,751][106225] Updated weights for policy 1, policy_version 160178 (0.0005) [2023-12-27 20:22:43,819][106225] Updated weights for policy 1, policy_version 160188 (0.0007) [2023-12-27 20:22:44,130][106226] Updated weights for policy 0, policy_version 159911 (0.0008) [2023-12-27 20:22:44,179][106226] Updated weights for policy 0, policy_version 159921 (0.0009) [2023-12-27 20:22:44,228][106226] Updated weights for policy 0, policy_version 159931 (0.0009) [2023-12-27 20:22:44,428][106225] Updated weights for policy 1, policy_version 160198 (0.0008) [2023-12-27 20:22:44,479][106225] Updated weights for policy 1, policy_version 160208 (0.0007) [2023-12-27 20:22:44,530][106225] Updated weights for policy 1, policy_version 160218 (0.0007) [2023-12-27 20:22:44,951][106226] Updated weights for policy 0, policy_version 159942 (0.0009) [2023-12-27 20:22:45,000][106226] Updated weights for policy 0, policy_version 159952 (0.0009) [2023-12-27 20:22:45,061][106226] Updated weights for policy 0, policy_version 159962 (0.0008) [2023-12-27 20:22:45,222][106225] Updated weights for policy 1, policy_version 160228 (0.0007) [2023-12-27 20:22:45,285][106225] Updated weights for policy 1, policy_version 160238 (0.0008) [2023-12-27 20:22:45,345][106225] Updated weights for policy 1, policy_version 160248 (0.0009) [2023-12-27 20:22:45,811][106226] Updated weights for policy 0, policy_version 159972 (0.0008) [2023-12-27 20:22:45,874][106226] Updated weights for policy 0, policy_version 159982 (0.0008) [2023-12-27 20:22:45,932][106226] Updated weights for policy 0, policy_version 159992 (0.0006) [2023-12-27 20:22:46,073][106225] Updated weights for policy 1, policy_version 160258 (0.0008) [2023-12-27 20:22:46,135][106225] Updated weights for policy 1, policy_version 160268 (0.0008) [2023-12-27 20:22:46,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 82001920. Throughput: 0: 9847.5, 1: 9871.7. Samples: 81993224. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:46,176][105115] Avg episode reward: [(0, '-5.565'), (1, '-6.604')] [2023-12-27 20:22:46,190][106225] Updated weights for policy 1, policy_version 160278 (0.0007) [2023-12-27 20:22:46,242][106225] Updated weights for policy 1, policy_version 160288 (0.0008) [2023-12-27 20:22:46,539][106226] Updated weights for policy 0, policy_version 160002 (0.0005) [2023-12-27 20:22:46,594][106226] Updated weights for policy 0, policy_version 160012 (0.0006) [2023-12-27 20:22:46,647][106226] Updated weights for policy 0, policy_version 160022 (0.0005) [2023-12-27 20:22:46,699][106226] Updated weights for policy 0, policy_version 160032 (0.0005) [2023-12-27 20:22:47,039][106225] Updated weights for policy 1, policy_version 160298 (0.0008) [2023-12-27 20:22:47,106][106225] Updated weights for policy 1, policy_version 160308 (0.0006) [2023-12-27 20:22:47,160][106225] Updated weights for policy 1, policy_version 160318 (0.0005) [2023-12-27 20:22:47,256][106226] Updated weights for policy 0, policy_version 160042 (0.0008) [2023-12-27 20:22:47,311][106226] Updated weights for policy 0, policy_version 160052 (0.0008) [2023-12-27 20:22:47,358][106226] Updated weights for policy 0, policy_version 160062 (0.0009) [2023-12-27 20:22:47,858][106225] Updated weights for policy 1, policy_version 160328 (0.0009) [2023-12-27 20:22:47,917][106225] Updated weights for policy 1, policy_version 160338 (0.0008) [2023-12-27 20:22:47,950][106226] Updated weights for policy 0, policy_version 160072 (0.0007) [2023-12-27 20:22:47,977][106225] Updated weights for policy 1, policy_version 160348 (0.0007) [2023-12-27 20:22:48,004][106226] Updated weights for policy 0, policy_version 160082 (0.0006) [2023-12-27 20:22:48,058][106226] Updated weights for policy 0, policy_version 160092 (0.0009) [2023-12-27 20:22:48,699][106225] Updated weights for policy 1, policy_version 160358 (0.0008) [2023-12-27 20:22:48,766][106225] Updated weights for policy 1, policy_version 160368 (0.0010) [2023-12-27 20:22:48,808][106226] Updated weights for policy 0, policy_version 160102 (0.0007) [2023-12-27 20:22:48,830][106225] Updated weights for policy 1, policy_version 160378 (0.0010) [2023-12-27 20:22:48,874][106226] Updated weights for policy 0, policy_version 160112 (0.0006) [2023-12-27 20:22:48,939][106226] Updated weights for policy 0, policy_version 160122 (0.0006) [2023-12-27 20:22:49,556][106225] Updated weights for policy 1, policy_version 160388 (0.0010) [2023-12-27 20:22:49,562][106226] Updated weights for policy 0, policy_version 160132 (0.0006) [2023-12-27 20:22:49,614][106225] Updated weights for policy 1, policy_version 160398 (0.0010) [2023-12-27 20:22:49,620][106226] Updated weights for policy 0, policy_version 160142 (0.0006) [2023-12-27 20:22:49,675][106225] Updated weights for policy 1, policy_version 160408 (0.0010) [2023-12-27 20:22:49,681][106226] Updated weights for policy 0, policy_version 160152 (0.0006) [2023-12-27 20:22:50,368][106225] Updated weights for policy 1, policy_version 160418 (0.0010) [2023-12-27 20:22:50,422][106226] Updated weights for policy 0, policy_version 160162 (0.0006) [2023-12-27 20:22:50,428][106225] Updated weights for policy 1, policy_version 160428 (0.0010) [2023-12-27 20:22:50,466][106226] Updated weights for policy 0, policy_version 160172 (0.0005) [2023-12-27 20:22:50,489][106225] Updated weights for policy 1, policy_version 160438 (0.0010) [2023-12-27 20:22:50,517][106226] Updated weights for policy 0, policy_version 160182 (0.0005) [2023-12-27 20:22:50,552][106225] Updated weights for policy 1, policy_version 160448 (0.0010) [2023-12-27 20:22:50,574][106226] Updated weights for policy 0, policy_version 160192 (0.0006) [2023-12-27 20:22:51,176][105115] Fps is (10 sec: 19658.8, 60 sec: 19797.0, 300 sec: 19799.6). Total num frames: 82100224. Throughput: 0: 9881.5, 1: 9813.2. Samples: 82113256. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:51,176][105115] Avg episode reward: [(0, '-5.934'), (1, '-6.966')] [2023-12-27 20:22:51,272][106225] Updated weights for policy 1, policy_version 160458 (0.0006) [2023-12-27 20:22:51,337][106225] Updated weights for policy 1, policy_version 160468 (0.0007) [2023-12-27 20:22:51,359][106226] Updated weights for policy 0, policy_version 160202 (0.0008) [2023-12-27 20:22:51,402][106225] Updated weights for policy 1, policy_version 160478 (0.0007) [2023-12-27 20:22:51,418][106226] Updated weights for policy 0, policy_version 160212 (0.0008) [2023-12-27 20:22:51,476][106226] Updated weights for policy 0, policy_version 160222 (0.0008) [2023-12-27 20:22:52,073][106225] Updated weights for policy 1, policy_version 160488 (0.0009) [2023-12-27 20:22:52,125][106225] Updated weights for policy 1, policy_version 160498 (0.0008) [2023-12-27 20:22:52,166][106226] Updated weights for policy 0, policy_version 160232 (0.0008) [2023-12-27 20:22:52,170][106225] Updated weights for policy 1, policy_version 160508 (0.0006) [2023-12-27 20:22:52,222][106226] Updated weights for policy 0, policy_version 160242 (0.0008) [2023-12-27 20:22:52,283][106226] Updated weights for policy 0, policy_version 160252 (0.0008) [2023-12-27 20:22:52,927][106225] Updated weights for policy 1, policy_version 160518 (0.0007) [2023-12-27 20:22:52,940][106226] Updated weights for policy 0, policy_version 160262 (0.0007) [2023-12-27 20:22:52,974][106225] Updated weights for policy 1, policy_version 160528 (0.0005) [2023-12-27 20:22:52,993][106226] Updated weights for policy 0, policy_version 160272 (0.0007) [2023-12-27 20:22:53,019][106225] Updated weights for policy 1, policy_version 160538 (0.0007) [2023-12-27 20:22:53,051][106226] Updated weights for policy 0, policy_version 160282 (0.0008) [2023-12-27 20:22:53,727][106225] Updated weights for policy 1, policy_version 160548 (0.0007) [2023-12-27 20:22:53,790][106225] Updated weights for policy 1, policy_version 160558 (0.0008) [2023-12-27 20:22:53,795][106226] Updated weights for policy 0, policy_version 160292 (0.0010) [2023-12-27 20:22:53,852][106226] Updated weights for policy 0, policy_version 160302 (0.0010) [2023-12-27 20:22:53,854][106225] Updated weights for policy 1, policy_version 160568 (0.0009) [2023-12-27 20:22:53,904][106226] Updated weights for policy 0, policy_version 160312 (0.0007) [2023-12-27 20:22:54,543][106225] Updated weights for policy 1, policy_version 160578 (0.0009) [2023-12-27 20:22:54,606][106225] Updated weights for policy 1, policy_version 160588 (0.0008) [2023-12-27 20:22:54,649][106226] Updated weights for policy 0, policy_version 160322 (0.0008) [2023-12-27 20:22:54,674][106225] Updated weights for policy 1, policy_version 160598 (0.0009) [2023-12-27 20:22:54,709][106226] Updated weights for policy 0, policy_version 160332 (0.0005) [2023-12-27 20:22:54,739][106225] Updated weights for policy 1, policy_version 160608 (0.0007) [2023-12-27 20:22:54,755][106226] Updated weights for policy 0, policy_version 160342 (0.0006) [2023-12-27 20:22:54,803][106226] Updated weights for policy 0, policy_version 160352 (0.0008) [2023-12-27 20:22:55,429][106225] Updated weights for policy 1, policy_version 160618 (0.0005) [2023-12-27 20:22:55,476][106225] Updated weights for policy 1, policy_version 160628 (0.0006) [2023-12-27 20:22:55,527][106226] Updated weights for policy 0, policy_version 160362 (0.0007) [2023-12-27 20:22:55,532][106225] Updated weights for policy 1, policy_version 160638 (0.0008) [2023-12-27 20:22:55,577][106226] Updated weights for policy 0, policy_version 160372 (0.0009) [2023-12-27 20:22:55,628][106226] Updated weights for policy 0, policy_version 160382 (0.0009) [2023-12-27 20:22:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 82198528. Throughput: 0: 9867.7, 1: 9803.9. Samples: 82171712. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:22:56,177][105115] Avg episode reward: [(0, '-5.729'), (1, '-6.336')] [2023-12-27 20:22:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000160640_41132032.pth... [2023-12-27 20:22:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000160384_41066496.pth... [2023-12-27 20:22:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000159520_40845312.pth [2023-12-27 20:22:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000159200_40763392.pth [2023-12-27 20:22:56,245][106225] Updated weights for policy 1, policy_version 160648 (0.0010) [2023-12-27 20:22:56,293][106226] Updated weights for policy 0, policy_version 160392 (0.0008) [2023-12-27 20:22:56,308][106225] Updated weights for policy 1, policy_version 160658 (0.0010) [2023-12-27 20:22:56,350][106226] Updated weights for policy 0, policy_version 160402 (0.0008) [2023-12-27 20:22:56,373][106225] Updated weights for policy 1, policy_version 160668 (0.0006) [2023-12-27 20:22:56,410][106226] Updated weights for policy 0, policy_version 160412 (0.0008) [2023-12-27 20:22:57,087][106225] Updated weights for policy 1, policy_version 160678 (0.0008) [2023-12-27 20:22:57,132][106225] Updated weights for policy 1, policy_version 160688 (0.0008) [2023-12-27 20:22:57,138][106226] Updated weights for policy 0, policy_version 160422 (0.0008) [2023-12-27 20:22:57,182][106225] Updated weights for policy 1, policy_version 160698 (0.0006) [2023-12-27 20:22:57,204][106226] Updated weights for policy 0, policy_version 160432 (0.0008) [2023-12-27 20:22:57,255][106226] Updated weights for policy 0, policy_version 160442 (0.0008) [2023-12-27 20:22:57,908][106225] Updated weights for policy 1, policy_version 160708 (0.0007) [2023-12-27 20:22:57,964][106226] Updated weights for policy 0, policy_version 160452 (0.0009) [2023-12-27 20:22:57,966][106225] Updated weights for policy 1, policy_version 160718 (0.0007) [2023-12-27 20:22:58,020][106225] Updated weights for policy 1, policy_version 160728 (0.0006) [2023-12-27 20:22:58,022][106226] Updated weights for policy 0, policy_version 160462 (0.0007) [2023-12-27 20:22:58,079][106226] Updated weights for policy 0, policy_version 160472 (0.0008) [2023-12-27 20:22:58,793][106225] Updated weights for policy 1, policy_version 160738 (0.0006) [2023-12-27 20:22:58,856][106226] Updated weights for policy 0, policy_version 160482 (0.0009) [2023-12-27 20:22:58,861][106225] Updated weights for policy 1, policy_version 160748 (0.0007) [2023-12-27 20:22:58,920][106226] Updated weights for policy 0, policy_version 160492 (0.0007) [2023-12-27 20:22:58,930][106225] Updated weights for policy 1, policy_version 160758 (0.0007) [2023-12-27 20:22:58,990][106226] Updated weights for policy 0, policy_version 160502 (0.0008) [2023-12-27 20:22:58,999][106225] Updated weights for policy 1, policy_version 160768 (0.0007) [2023-12-27 20:22:59,045][106226] Updated weights for policy 0, policy_version 160512 (0.0008) [2023-12-27 20:22:59,767][106225] Updated weights for policy 1, policy_version 160778 (0.0009) [2023-12-27 20:22:59,794][106226] Updated weights for policy 0, policy_version 160522 (0.0007) [2023-12-27 20:22:59,827][106225] Updated weights for policy 1, policy_version 160788 (0.0006) [2023-12-27 20:22:59,856][106226] Updated weights for policy 0, policy_version 160532 (0.0008) [2023-12-27 20:22:59,893][106225] Updated weights for policy 1, policy_version 160798 (0.0007) [2023-12-27 20:22:59,915][106226] Updated weights for policy 0, policy_version 160542 (0.0006) [2023-12-27 20:23:00,514][106225] Updated weights for policy 1, policy_version 160808 (0.0010) [2023-12-27 20:23:00,559][106225] Updated weights for policy 1, policy_version 160818 (0.0009) [2023-12-27 20:23:00,615][106225] Updated weights for policy 1, policy_version 160828 (0.0009) [2023-12-27 20:23:00,621][106226] Updated weights for policy 0, policy_version 160552 (0.0006) [2023-12-27 20:23:00,673][106226] Updated weights for policy 0, policy_version 160562 (0.0008) [2023-12-27 20:23:00,729][106226] Updated weights for policy 0, policy_version 160572 (0.0009) [2023-12-27 20:23:01,175][105115] Fps is (10 sec: 19662.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 82296832. Throughput: 0: 9898.8, 1: 9821.4. Samples: 82287316. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:23:01,175][105115] Avg episode reward: [(0, '-5.413'), (1, '-6.593')] [2023-12-27 20:23:01,280][106225] Updated weights for policy 1, policy_version 160838 (0.0009) [2023-12-27 20:23:01,344][106225] Updated weights for policy 1, policy_version 160848 (0.0009) [2023-12-27 20:23:01,412][106225] Updated weights for policy 1, policy_version 160858 (0.0011) [2023-12-27 20:23:01,511][106226] Updated weights for policy 0, policy_version 160582 (0.0009) [2023-12-27 20:23:01,569][106226] Updated weights for policy 0, policy_version 160592 (0.0008) [2023-12-27 20:23:01,636][106226] Updated weights for policy 0, policy_version 160602 (0.0008) [2023-12-27 20:23:02,145][106225] Updated weights for policy 1, policy_version 160868 (0.0009) [2023-12-27 20:23:02,201][106225] Updated weights for policy 1, policy_version 160878 (0.0008) [2023-12-27 20:23:02,262][106225] Updated weights for policy 1, policy_version 160888 (0.0008) [2023-12-27 20:23:02,306][106226] Updated weights for policy 0, policy_version 160612 (0.0006) [2023-12-27 20:23:02,365][106226] Updated weights for policy 0, policy_version 160622 (0.0007) [2023-12-27 20:23:02,430][106226] Updated weights for policy 0, policy_version 160632 (0.0008) [2023-12-27 20:23:03,009][106225] Updated weights for policy 1, policy_version 160898 (0.0008) [2023-12-27 20:23:03,058][106225] Updated weights for policy 1, policy_version 160908 (0.0008) [2023-12-27 20:23:03,071][106226] Updated weights for policy 0, policy_version 160642 (0.0008) [2023-12-27 20:23:03,104][106225] Updated weights for policy 1, policy_version 160918 (0.0008) [2023-12-27 20:23:03,126][106226] Updated weights for policy 0, policy_version 160652 (0.0006) [2023-12-27 20:23:03,154][106225] Updated weights for policy 1, policy_version 160928 (0.0007) [2023-12-27 20:23:03,177][106226] Updated weights for policy 0, policy_version 160662 (0.0008) [2023-12-27 20:23:03,236][106226] Updated weights for policy 0, policy_version 160672 (0.0009) [2023-12-27 20:23:03,872][106226] Updated weights for policy 0, policy_version 160682 (0.0013) [2023-12-27 20:23:03,931][106226] Updated weights for policy 0, policy_version 160692 (0.0008) [2023-12-27 20:23:03,945][106225] Updated weights for policy 1, policy_version 160938 (0.0008) [2023-12-27 20:23:03,997][106226] Updated weights for policy 0, policy_version 160702 (0.0009) [2023-12-27 20:23:03,999][106225] Updated weights for policy 1, policy_version 160948 (0.0007) [2023-12-27 20:23:04,055][106225] Updated weights for policy 1, policy_version 160958 (0.0008) [2023-12-27 20:23:04,672][106226] Updated weights for policy 0, policy_version 160712 (0.0011) [2023-12-27 20:23:04,736][106226] Updated weights for policy 0, policy_version 160722 (0.0011) [2023-12-27 20:23:04,796][106226] Updated weights for policy 0, policy_version 160732 (0.0011) [2023-12-27 20:23:04,840][106225] Updated weights for policy 1, policy_version 160968 (0.0007) [2023-12-27 20:23:04,894][106225] Updated weights for policy 1, policy_version 160978 (0.0008) [2023-12-27 20:23:04,939][106225] Updated weights for policy 1, policy_version 160988 (0.0007) [2023-12-27 20:23:05,509][106226] Updated weights for policy 0, policy_version 160742 (0.0011) [2023-12-27 20:23:05,569][106226] Updated weights for policy 0, policy_version 160752 (0.0011) [2023-12-27 20:23:05,618][106226] Updated weights for policy 0, policy_version 160762 (0.0010) [2023-12-27 20:23:05,673][106225] Updated weights for policy 1, policy_version 160998 (0.0007) [2023-12-27 20:23:05,725][106225] Updated weights for policy 1, policy_version 161008 (0.0008) [2023-12-27 20:23:05,777][106225] Updated weights for policy 1, policy_version 161018 (0.0007) [2023-12-27 20:23:06,174][105115] Fps is (10 sec: 19661.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 82395136. Throughput: 0: 10017.3, 1: 9702.9. Samples: 82405104. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 20:23:06,175][105115] Avg episode reward: [(0, '-5.180'), (1, '-6.751')] [2023-12-27 20:23:06,281][106226] Updated weights for policy 0, policy_version 160772 (0.0008) [2023-12-27 20:23:06,335][106226] Updated weights for policy 0, policy_version 160782 (0.0009) [2023-12-27 20:23:06,393][106226] Updated weights for policy 0, policy_version 160792 (0.0010) [2023-12-27 20:23:06,585][106225] Updated weights for policy 1, policy_version 161028 (0.0007) [2023-12-27 20:23:06,655][106225] Updated weights for policy 1, policy_version 161038 (0.0008) [2023-12-27 20:23:06,716][106225] Updated weights for policy 1, policy_version 161048 (0.0008) [2023-12-27 20:23:07,084][106226] Updated weights for policy 0, policy_version 160802 (0.0010) [2023-12-27 20:23:07,136][106226] Updated weights for policy 0, policy_version 160812 (0.0010) [2023-12-27 20:23:07,194][106226] Updated weights for policy 0, policy_version 160822 (0.0011) [2023-12-27 20:23:07,256][106226] Updated weights for policy 0, policy_version 160832 (0.0010) [2023-12-27 20:23:07,486][106225] Updated weights for policy 1, policy_version 161058 (0.0008) [2023-12-27 20:23:07,534][106225] Updated weights for policy 1, policy_version 161068 (0.0007) [2023-12-27 20:23:07,603][106225] Updated weights for policy 1, policy_version 161078 (0.0005) [2023-12-27 20:23:07,660][106225] Updated weights for policy 1, policy_version 161088 (0.0009) [2023-12-27 20:23:07,870][106226] Updated weights for policy 0, policy_version 160842 (0.0009) [2023-12-27 20:23:07,932][106226] Updated weights for policy 0, policy_version 160852 (0.0010) [2023-12-27 20:23:07,998][106226] Updated weights for policy 0, policy_version 160862 (0.0010) [2023-12-27 20:23:08,370][106225] Updated weights for policy 1, policy_version 161098 (0.0008) [2023-12-27 20:23:08,430][106225] Updated weights for policy 1, policy_version 161108 (0.0008) [2023-12-27 20:23:08,496][106225] Updated weights for policy 1, policy_version 161118 (0.0008) [2023-12-27 20:23:08,695][106226] Updated weights for policy 0, policy_version 160872 (0.0011) [2023-12-27 20:23:08,752][106226] Updated weights for policy 0, policy_version 160882 (0.0010) [2023-12-27 20:23:08,813][106226] Updated weights for policy 0, policy_version 160892 (0.0011) [2023-12-27 20:23:09,238][106225] Updated weights for policy 1, policy_version 161128 (0.0008) [2023-12-27 20:23:09,307][106225] Updated weights for policy 1, policy_version 161138 (0.0006) [2023-12-27 20:23:09,380][106225] Updated weights for policy 1, policy_version 161148 (0.0007) [2023-12-27 20:23:09,587][106226] Updated weights for policy 0, policy_version 160902 (0.0010) [2023-12-27 20:23:09,649][106226] Updated weights for policy 0, policy_version 160912 (0.0009) [2023-12-27 20:23:09,710][106226] Updated weights for policy 0, policy_version 160922 (0.0009) [2023-12-27 20:23:10,134][106225] Updated weights for policy 1, policy_version 161158 (0.0009) [2023-12-27 20:23:10,200][106225] Updated weights for policy 1, policy_version 161168 (0.0008) [2023-12-27 20:23:10,266][106225] Updated weights for policy 1, policy_version 161178 (0.0007) [2023-12-27 20:23:10,449][106226] Updated weights for policy 0, policy_version 160932 (0.0008) [2023-12-27 20:23:10,497][106226] Updated weights for policy 0, policy_version 160942 (0.0008) [2023-12-27 20:23:10,552][106226] Updated weights for policy 0, policy_version 160952 (0.0008) [2023-12-27 20:23:10,911][106225] Updated weights for policy 1, policy_version 161188 (0.0006) [2023-12-27 20:23:10,972][106225] Updated weights for policy 1, policy_version 161198 (0.0006) [2023-12-27 20:23:11,029][106225] Updated weights for policy 1, policy_version 161208 (0.0009) [2023-12-27 20:23:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 82493440. Throughput: 0: 10049.7, 1: 9708.5. Samples: 82463244. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:11,175][105115] Avg episode reward: [(0, '-5.521'), (1, '-6.398')] [2023-12-27 20:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000161216_41279488.pth... [2023-12-27 20:23:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000160960_41213952.pth... [2023-12-27 20:23:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000160096_40992768.pth [2023-12-27 20:23:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000159808_40919040.pth [2023-12-27 20:23:11,433][106226] Updated weights for policy 0, policy_version 160962 (0.0009) [2023-12-27 20:23:11,499][106226] Updated weights for policy 0, policy_version 160972 (0.0009) [2023-12-27 20:23:11,560][106226] Updated weights for policy 0, policy_version 160982 (0.0009) [2023-12-27 20:23:11,625][106226] Updated weights for policy 0, policy_version 160992 (0.0009) [2023-12-27 20:23:11,741][106225] Updated weights for policy 1, policy_version 161218 (0.0009) [2023-12-27 20:23:11,803][106225] Updated weights for policy 1, policy_version 161228 (0.0008) [2023-12-27 20:23:11,862][106225] Updated weights for policy 1, policy_version 161238 (0.0008) [2023-12-27 20:23:11,922][106225] Updated weights for policy 1, policy_version 161248 (0.0008) [2023-12-27 20:23:12,411][106226] Updated weights for policy 0, policy_version 161002 (0.0007) [2023-12-27 20:23:12,479][106226] Updated weights for policy 0, policy_version 161012 (0.0005) [2023-12-27 20:23:12,546][106226] Updated weights for policy 0, policy_version 161022 (0.0007) [2023-12-27 20:23:12,698][106225] Updated weights for policy 1, policy_version 161258 (0.0010) [2023-12-27 20:23:12,759][106225] Updated weights for policy 1, policy_version 161268 (0.0010) [2023-12-27 20:23:12,820][106225] Updated weights for policy 1, policy_version 161278 (0.0010) [2023-12-27 20:23:13,257][106226] Updated weights for policy 0, policy_version 161032 (0.0008) [2023-12-27 20:23:13,318][106226] Updated weights for policy 0, policy_version 161042 (0.0008) [2023-12-27 20:23:13,383][106226] Updated weights for policy 0, policy_version 161052 (0.0008) [2023-12-27 20:23:13,554][106225] Updated weights for policy 1, policy_version 161288 (0.0010) [2023-12-27 20:23:13,618][106225] Updated weights for policy 1, policy_version 161298 (0.0008) [2023-12-27 20:23:13,687][106225] Updated weights for policy 1, policy_version 161308 (0.0005) [2023-12-27 20:23:14,008][106226] Updated weights for policy 0, policy_version 161062 (0.0009) [2023-12-27 20:23:14,070][106226] Updated weights for policy 0, policy_version 161072 (0.0010) [2023-12-27 20:23:14,133][106226] Updated weights for policy 0, policy_version 161082 (0.0010) [2023-12-27 20:23:14,279][106225] Updated weights for policy 1, policy_version 161318 (0.0008) [2023-12-27 20:23:14,342][106225] Updated weights for policy 1, policy_version 161328 (0.0010) [2023-12-27 20:23:14,392][106225] Updated weights for policy 1, policy_version 161338 (0.0010) [2023-12-27 20:23:14,835][106226] Updated weights for policy 0, policy_version 161092 (0.0010) [2023-12-27 20:23:14,899][106226] Updated weights for policy 0, policy_version 161102 (0.0011) [2023-12-27 20:23:14,963][106226] Updated weights for policy 0, policy_version 161112 (0.0011) [2023-12-27 20:23:15,117][106225] Updated weights for policy 1, policy_version 161348 (0.0010) [2023-12-27 20:23:15,175][106225] Updated weights for policy 1, policy_version 161358 (0.0010) [2023-12-27 20:23:15,234][106225] Updated weights for policy 1, policy_version 161368 (0.0010) [2023-12-27 20:23:15,670][106226] Updated weights for policy 0, policy_version 161122 (0.0011) [2023-12-27 20:23:15,719][106226] Updated weights for policy 0, policy_version 161132 (0.0010) [2023-12-27 20:23:15,768][106226] Updated weights for policy 0, policy_version 161142 (0.0010) [2023-12-27 20:23:15,815][106226] Updated weights for policy 0, policy_version 161152 (0.0010) [2023-12-27 20:23:15,892][106225] Updated weights for policy 1, policy_version 161378 (0.0010) [2023-12-27 20:23:15,952][106225] Updated weights for policy 1, policy_version 161388 (0.0005) [2023-12-27 20:23:16,015][106225] Updated weights for policy 1, policy_version 161398 (0.0005) [2023-12-27 20:23:16,081][106225] Updated weights for policy 1, policy_version 161408 (0.0005) [2023-12-27 20:23:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 82591744. Throughput: 0: 9901.9, 1: 9599.6. Samples: 82577800. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:16,175][105115] Avg episode reward: [(0, '-5.538'), (1, '-6.648')] [2023-12-27 20:23:16,542][106226] Updated weights for policy 0, policy_version 161162 (0.0010) [2023-12-27 20:23:16,599][106226] Updated weights for policy 0, policy_version 161172 (0.0010) [2023-12-27 20:23:16,656][106225] Updated weights for policy 1, policy_version 161418 (0.0010) [2023-12-27 20:23:16,659][106226] Updated weights for policy 0, policy_version 161182 (0.0011) [2023-12-27 20:23:16,713][106225] Updated weights for policy 1, policy_version 161428 (0.0010) [2023-12-27 20:23:16,764][106225] Updated weights for policy 1, policy_version 161438 (0.0010) [2023-12-27 20:23:17,364][106226] Updated weights for policy 0, policy_version 161192 (0.0011) [2023-12-27 20:23:17,419][106226] Updated weights for policy 0, policy_version 161202 (0.0010) [2023-12-27 20:23:17,472][106226] Updated weights for policy 0, policy_version 161212 (0.0010) [2023-12-27 20:23:17,472][106225] Updated weights for policy 1, policy_version 161448 (0.0010) [2023-12-27 20:23:17,532][106225] Updated weights for policy 1, policy_version 161458 (0.0010) [2023-12-27 20:23:17,589][106225] Updated weights for policy 1, policy_version 161468 (0.0010) [2023-12-27 20:23:18,188][106226] Updated weights for policy 0, policy_version 161222 (0.0010) [2023-12-27 20:23:18,238][106226] Updated weights for policy 0, policy_version 161232 (0.0010) [2023-12-27 20:23:18,249][106225] Updated weights for policy 1, policy_version 161478 (0.0010) [2023-12-27 20:23:18,298][106226] Updated weights for policy 0, policy_version 161242 (0.0010) [2023-12-27 20:23:18,307][106225] Updated weights for policy 1, policy_version 161488 (0.0008) [2023-12-27 20:23:18,374][106225] Updated weights for policy 1, policy_version 161498 (0.0008) [2023-12-27 20:23:19,001][106226] Updated weights for policy 0, policy_version 161252 (0.0008) [2023-12-27 20:23:19,063][106225] Updated weights for policy 1, policy_version 161508 (0.0008) [2023-12-27 20:23:19,065][106226] Updated weights for policy 0, policy_version 161262 (0.0005) [2023-12-27 20:23:19,113][106225] Updated weights for policy 1, policy_version 161518 (0.0010) [2023-12-27 20:23:19,119][106226] Updated weights for policy 0, policy_version 161272 (0.0005) [2023-12-27 20:23:19,167][106225] Updated weights for policy 1, policy_version 161528 (0.0010) [2023-12-27 20:23:19,792][106225] Updated weights for policy 1, policy_version 161538 (0.0009) [2023-12-27 20:23:19,854][106225] Updated weights for policy 1, policy_version 161548 (0.0007) [2023-12-27 20:23:19,877][106226] Updated weights for policy 0, policy_version 161282 (0.0005) [2023-12-27 20:23:19,914][106225] Updated weights for policy 1, policy_version 161558 (0.0010) [2023-12-27 20:23:19,940][106226] Updated weights for policy 0, policy_version 161292 (0.0007) [2023-12-27 20:23:19,970][106225] Updated weights for policy 1, policy_version 161568 (0.0010) [2023-12-27 20:23:20,004][106226] Updated weights for policy 0, policy_version 161302 (0.0006) [2023-12-27 20:23:20,064][106226] Updated weights for policy 0, policy_version 161312 (0.0008) [2023-12-27 20:23:20,691][106225] Updated weights for policy 1, policy_version 161578 (0.0011) [2023-12-27 20:23:20,742][106226] Updated weights for policy 0, policy_version 161322 (0.0007) [2023-12-27 20:23:20,751][106225] Updated weights for policy 1, policy_version 161588 (0.0010) [2023-12-27 20:23:20,804][106226] Updated weights for policy 0, policy_version 161332 (0.0006) [2023-12-27 20:23:20,813][106225] Updated weights for policy 1, policy_version 161598 (0.0011) [2023-12-27 20:23:20,871][106226] Updated weights for policy 0, policy_version 161342 (0.0008) [2023-12-27 20:23:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 82690048. Throughput: 0: 9830.4, 1: 9714.5. Samples: 82697580. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:21,175][105115] Avg episode reward: [(0, '-5.413'), (1, '-6.361')] [2023-12-27 20:23:21,519][106225] Updated weights for policy 1, policy_version 161608 (0.0009) [2023-12-27 20:23:21,574][106225] Updated weights for policy 1, policy_version 161618 (0.0006) [2023-12-27 20:23:21,593][106226] Updated weights for policy 0, policy_version 161352 (0.0008) [2023-12-27 20:23:21,642][106225] Updated weights for policy 1, policy_version 161628 (0.0007) [2023-12-27 20:23:21,664][106226] Updated weights for policy 0, policy_version 161362 (0.0007) [2023-12-27 20:23:21,737][106226] Updated weights for policy 0, policy_version 161372 (0.0007) [2023-12-27 20:23:22,317][106226] Updated weights for policy 0, policy_version 161382 (0.0008) [2023-12-27 20:23:22,382][106226] Updated weights for policy 0, policy_version 161392 (0.0009) [2023-12-27 20:23:22,450][106226] Updated weights for policy 0, policy_version 161402 (0.0007) [2023-12-27 20:23:22,467][106225] Updated weights for policy 1, policy_version 161638 (0.0008) [2023-12-27 20:23:22,528][106225] Updated weights for policy 1, policy_version 161648 (0.0007) [2023-12-27 20:23:22,588][106225] Updated weights for policy 1, policy_version 161658 (0.0009) [2023-12-27 20:23:23,183][106226] Updated weights for policy 0, policy_version 161412 (0.0006) [2023-12-27 20:23:23,245][106226] Updated weights for policy 0, policy_version 161422 (0.0005) [2023-12-27 20:23:23,281][106225] Updated weights for policy 1, policy_version 161668 (0.0009) [2023-12-27 20:23:23,307][106226] Updated weights for policy 0, policy_version 161432 (0.0006) [2023-12-27 20:23:23,329][106225] Updated weights for policy 1, policy_version 161678 (0.0007) [2023-12-27 20:23:23,384][106225] Updated weights for policy 1, policy_version 161688 (0.0007) [2023-12-27 20:23:23,930][106226] Updated weights for policy 0, policy_version 161442 (0.0008) [2023-12-27 20:23:23,972][106225] Updated weights for policy 1, policy_version 161698 (0.0009) [2023-12-27 20:23:23,996][106226] Updated weights for policy 0, policy_version 161452 (0.0007) [2023-12-27 20:23:24,031][106225] Updated weights for policy 1, policy_version 161708 (0.0006) [2023-12-27 20:23:24,064][106226] Updated weights for policy 0, policy_version 161462 (0.0008) [2023-12-27 20:23:24,086][106225] Updated weights for policy 1, policy_version 161718 (0.0005) [2023-12-27 20:23:24,131][106226] Updated weights for policy 0, policy_version 161472 (0.0008) [2023-12-27 20:23:24,145][106225] Updated weights for policy 1, policy_version 161728 (0.0009) [2023-12-27 20:23:24,784][106226] Updated weights for policy 0, policy_version 161482 (0.0011) [2023-12-27 20:23:24,795][106225] Updated weights for policy 1, policy_version 161738 (0.0010) [2023-12-27 20:23:24,841][106226] Updated weights for policy 0, policy_version 161492 (0.0010) [2023-12-27 20:23:24,852][106225] Updated weights for policy 1, policy_version 161748 (0.0010) [2023-12-27 20:23:24,896][106226] Updated weights for policy 0, policy_version 161502 (0.0009) [2023-12-27 20:23:24,907][106225] Updated weights for policy 1, policy_version 161758 (0.0010) [2023-12-27 20:23:25,481][106226] Updated weights for policy 0, policy_version 161512 (0.0005) [2023-12-27 20:23:25,532][106226] Updated weights for policy 0, policy_version 161522 (0.0005) [2023-12-27 20:23:25,537][106225] Updated weights for policy 1, policy_version 161768 (0.0006) [2023-12-27 20:23:25,583][106226] Updated weights for policy 0, policy_version 161532 (0.0009) [2023-12-27 20:23:25,594][106225] Updated weights for policy 1, policy_version 161778 (0.0007) [2023-12-27 20:23:25,650][106225] Updated weights for policy 1, policy_version 161788 (0.0009) [2023-12-27 20:23:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 82788352. Throughput: 0: 9836.9, 1: 9728.4. Samples: 82757272. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:26,175][105115] Avg episode reward: [(0, '-5.319'), (1, '-6.361')] [2023-12-27 20:23:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000161792_41426944.pth... [2023-12-27 20:23:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000160640_41132032.pth [2023-12-27 20:23:26,194][106226] Updated weights for policy 0, policy_version 161542 (0.0010) [2023-12-27 20:23:26,245][106226] Updated weights for policy 0, policy_version 161552 (0.0010) [2023-12-27 20:23:26,286][106225] Updated weights for policy 1, policy_version 161798 (0.0007) [2023-12-27 20:23:26,294][106226] Updated weights for policy 0, policy_version 161562 (0.0010) [2023-12-27 20:23:26,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000161568_41369600.pth... [2023-12-27 20:23:26,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000160384_41066496.pth [2023-12-27 20:23:26,351][106225] Updated weights for policy 1, policy_version 161808 (0.0005) [2023-12-27 20:23:26,405][106225] Updated weights for policy 1, policy_version 161818 (0.0006) [2023-12-27 20:23:26,962][106225] Updated weights for policy 1, policy_version 161828 (0.0005) [2023-12-27 20:23:27,025][106225] Updated weights for policy 1, policy_version 161838 (0.0005) [2023-12-27 20:23:27,029][106226] Updated weights for policy 0, policy_version 161572 (0.0011) [2023-12-27 20:23:27,085][106225] Updated weights for policy 1, policy_version 161848 (0.0005) [2023-12-27 20:23:27,093][106226] Updated weights for policy 0, policy_version 161582 (0.0010) [2023-12-27 20:23:27,145][106226] Updated weights for policy 0, policy_version 161592 (0.0010) [2023-12-27 20:23:27,668][106225] Updated weights for policy 1, policy_version 161858 (0.0006) [2023-12-27 20:23:27,727][106225] Updated weights for policy 1, policy_version 161868 (0.0008) [2023-12-27 20:23:27,780][106225] Updated weights for policy 1, policy_version 161878 (0.0007) [2023-12-27 20:23:27,825][106226] Updated weights for policy 0, policy_version 161602 (0.0010) [2023-12-27 20:23:27,844][106225] Updated weights for policy 1, policy_version 161888 (0.0006) [2023-12-27 20:23:27,886][106226] Updated weights for policy 0, policy_version 161612 (0.0010) [2023-12-27 20:23:27,943][106226] Updated weights for policy 0, policy_version 161622 (0.0010) [2023-12-27 20:23:28,003][106226] Updated weights for policy 0, policy_version 161632 (0.0009) [2023-12-27 20:23:28,493][106225] Updated weights for policy 1, policy_version 161898 (0.0005) [2023-12-27 20:23:28,552][106225] Updated weights for policy 1, policy_version 161908 (0.0005) [2023-12-27 20:23:28,607][106225] Updated weights for policy 1, policy_version 161918 (0.0006) [2023-12-27 20:23:28,645][106226] Updated weights for policy 0, policy_version 161642 (0.0007) [2023-12-27 20:23:28,708][106226] Updated weights for policy 0, policy_version 161652 (0.0008) [2023-12-27 20:23:28,776][106226] Updated weights for policy 0, policy_version 161662 (0.0010) [2023-12-27 20:23:29,258][106225] Updated weights for policy 1, policy_version 161928 (0.0007) [2023-12-27 20:23:29,325][106225] Updated weights for policy 1, policy_version 161938 (0.0005) [2023-12-27 20:23:29,393][106225] Updated weights for policy 1, policy_version 161948 (0.0008) [2023-12-27 20:23:29,465][106226] Updated weights for policy 0, policy_version 161672 (0.0007) [2023-12-27 20:23:29,529][106226] Updated weights for policy 0, policy_version 161682 (0.0008) [2023-12-27 20:23:29,592][106226] Updated weights for policy 0, policy_version 161692 (0.0011) [2023-12-27 20:23:30,057][106225] Updated weights for policy 1, policy_version 161958 (0.0009) [2023-12-27 20:23:30,118][106225] Updated weights for policy 1, policy_version 161968 (0.0008) [2023-12-27 20:23:30,175][106225] Updated weights for policy 1, policy_version 161978 (0.0010) [2023-12-27 20:23:30,255][106226] Updated weights for policy 0, policy_version 161702 (0.0008) [2023-12-27 20:23:30,318][106226] Updated weights for policy 0, policy_version 161712 (0.0006) [2023-12-27 20:23:30,368][106226] Updated weights for policy 0, policy_version 161722 (0.0010) [2023-12-27 20:23:30,901][106225] Updated weights for policy 1, policy_version 161988 (0.0007) [2023-12-27 20:23:30,957][106225] Updated weights for policy 1, policy_version 161998 (0.0008) [2023-12-27 20:23:31,010][106225] Updated weights for policy 1, policy_version 162008 (0.0008) [2023-12-27 20:23:31,067][106226] Updated weights for policy 0, policy_version 161732 (0.0010) [2023-12-27 20:23:31,132][106226] Updated weights for policy 0, policy_version 161742 (0.0008) [2023-12-27 20:23:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 82894848. Throughput: 0: 9956.0, 1: 9868.0. Samples: 82885296. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:31,175][105115] Avg episode reward: [(0, '-5.535'), (1, '-6.374')] [2023-12-27 20:23:31,189][106226] Updated weights for policy 0, policy_version 161752 (0.0008) [2023-12-27 20:23:31,803][106226] Updated weights for policy 0, policy_version 161762 (0.0006) [2023-12-27 20:23:31,837][106225] Updated weights for policy 1, policy_version 162018 (0.0007) [2023-12-27 20:23:31,853][106226] Updated weights for policy 0, policy_version 161772 (0.0008) [2023-12-27 20:23:31,895][106225] Updated weights for policy 1, policy_version 162028 (0.0008) [2023-12-27 20:23:31,907][106226] Updated weights for policy 0, policy_version 161782 (0.0007) [2023-12-27 20:23:31,950][106225] Updated weights for policy 1, policy_version 162038 (0.0008) [2023-12-27 20:23:31,957][106226] Updated weights for policy 0, policy_version 161792 (0.0007) [2023-12-27 20:23:32,007][106225] Updated weights for policy 1, policy_version 162048 (0.0008) [2023-12-27 20:23:32,679][106226] Updated weights for policy 0, policy_version 161802 (0.0007) [2023-12-27 20:23:32,723][106225] Updated weights for policy 1, policy_version 162058 (0.0009) [2023-12-27 20:23:32,741][106226] Updated weights for policy 0, policy_version 161812 (0.0006) [2023-12-27 20:23:32,776][106225] Updated weights for policy 1, policy_version 162068 (0.0008) [2023-12-27 20:23:32,807][106226] Updated weights for policy 0, policy_version 161822 (0.0005) [2023-12-27 20:23:32,828][106225] Updated weights for policy 1, policy_version 162078 (0.0006) [2023-12-27 20:23:33,332][106226] Updated weights for policy 0, policy_version 161832 (0.0005) [2023-12-27 20:23:33,396][106226] Updated weights for policy 0, policy_version 161842 (0.0005) [2023-12-27 20:23:33,454][106226] Updated weights for policy 0, policy_version 161852 (0.0005) [2023-12-27 20:23:33,560][106225] Updated weights for policy 1, policy_version 162088 (0.0006) [2023-12-27 20:23:33,613][106225] Updated weights for policy 1, policy_version 162098 (0.0005) [2023-12-27 20:23:33,664][106225] Updated weights for policy 1, policy_version 162108 (0.0005) [2023-12-27 20:23:34,130][106226] Updated weights for policy 0, policy_version 161862 (0.0008) [2023-12-27 20:23:34,208][106226] Updated weights for policy 0, policy_version 161872 (0.0008) [2023-12-27 20:23:34,272][106226] Updated weights for policy 0, policy_version 161882 (0.0008) [2023-12-27 20:23:34,295][106225] Updated weights for policy 1, policy_version 162118 (0.0007) [2023-12-27 20:23:34,357][106225] Updated weights for policy 1, policy_version 162128 (0.0006) [2023-12-27 20:23:34,419][106225] Updated weights for policy 1, policy_version 162138 (0.0007) [2023-12-27 20:23:34,937][106226] Updated weights for policy 0, policy_version 161892 (0.0007) [2023-12-27 20:23:34,989][106226] Updated weights for policy 0, policy_version 161902 (0.0005) [2023-12-27 20:23:35,039][106226] Updated weights for policy 0, policy_version 161912 (0.0008) [2023-12-27 20:23:35,096][106225] Updated weights for policy 1, policy_version 162148 (0.0007) [2023-12-27 20:23:35,158][106225] Updated weights for policy 1, policy_version 162158 (0.0006) [2023-12-27 20:23:35,216][106225] Updated weights for policy 1, policy_version 162168 (0.0005) [2023-12-27 20:23:35,711][106226] Updated weights for policy 0, policy_version 161922 (0.0007) [2023-12-27 20:23:35,770][106226] Updated weights for policy 0, policy_version 161932 (0.0007) [2023-12-27 20:23:35,834][106226] Updated weights for policy 0, policy_version 161942 (0.0008) [2023-12-27 20:23:35,890][106226] Updated weights for policy 0, policy_version 161952 (0.0009) [2023-12-27 20:23:35,926][106225] Updated weights for policy 1, policy_version 162178 (0.0006) [2023-12-27 20:23:35,984][106225] Updated weights for policy 1, policy_version 162188 (0.0009) [2023-12-27 20:23:36,035][106225] Updated weights for policy 1, policy_version 162198 (0.0008) [2023-12-27 20:23:36,091][106225] Updated weights for policy 1, policy_version 162208 (0.0009) [2023-12-27 20:23:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 83001344. Throughput: 0: 9971.8, 1: 9873.5. Samples: 83006272. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:36,175][105115] Avg episode reward: [(0, '-5.730'), (1, '-6.434')] [2023-12-27 20:23:36,611][106226] Updated weights for policy 0, policy_version 161962 (0.0009) [2023-12-27 20:23:36,674][106226] Updated weights for policy 0, policy_version 161972 (0.0008) [2023-12-27 20:23:36,740][106226] Updated weights for policy 0, policy_version 161982 (0.0009) [2023-12-27 20:23:36,811][106225] Updated weights for policy 1, policy_version 162218 (0.0005) [2023-12-27 20:23:36,868][106225] Updated weights for policy 1, policy_version 162228 (0.0006) [2023-12-27 20:23:36,922][106225] Updated weights for policy 1, policy_version 162238 (0.0005) [2023-12-27 20:23:37,470][106226] Updated weights for policy 0, policy_version 161992 (0.0009) [2023-12-27 20:23:37,525][106225] Updated weights for policy 1, policy_version 162248 (0.0006) [2023-12-27 20:23:37,527][106226] Updated weights for policy 0, policy_version 162002 (0.0007) [2023-12-27 20:23:37,582][106225] Updated weights for policy 1, policy_version 162258 (0.0006) [2023-12-27 20:23:37,591][106226] Updated weights for policy 0, policy_version 162012 (0.0007) [2023-12-27 20:23:37,646][106225] Updated weights for policy 1, policy_version 162268 (0.0006) [2023-12-27 20:23:38,271][106225] Updated weights for policy 1, policy_version 162278 (0.0007) [2023-12-27 20:23:38,355][106225] Updated weights for policy 1, policy_version 162288 (0.0007) [2023-12-27 20:23:38,389][106226] Updated weights for policy 0, policy_version 162022 (0.0008) [2023-12-27 20:23:38,414][106225] Updated weights for policy 1, policy_version 162298 (0.0007) [2023-12-27 20:23:38,449][106226] Updated weights for policy 0, policy_version 162032 (0.0009) [2023-12-27 20:23:38,513][106226] Updated weights for policy 0, policy_version 162042 (0.0009) [2023-12-27 20:23:39,031][106225] Updated weights for policy 1, policy_version 162308 (0.0006) [2023-12-27 20:23:39,090][106225] Updated weights for policy 1, policy_version 162318 (0.0005) [2023-12-27 20:23:39,147][106225] Updated weights for policy 1, policy_version 162328 (0.0006) [2023-12-27 20:23:39,194][106226] Updated weights for policy 0, policy_version 162052 (0.0008) [2023-12-27 20:23:39,256][106226] Updated weights for policy 0, policy_version 162062 (0.0007) [2023-12-27 20:23:39,321][106226] Updated weights for policy 0, policy_version 162072 (0.0007) [2023-12-27 20:23:39,888][106225] Updated weights for policy 1, policy_version 162338 (0.0007) [2023-12-27 20:23:39,961][106225] Updated weights for policy 1, policy_version 162348 (0.0007) [2023-12-27 20:23:39,972][106226] Updated weights for policy 0, policy_version 162082 (0.0009) [2023-12-27 20:23:40,025][106225] Updated weights for policy 1, policy_version 162358 (0.0007) [2023-12-27 20:23:40,039][106226] Updated weights for policy 0, policy_version 162092 (0.0007) [2023-12-27 20:23:40,089][106225] Updated weights for policy 1, policy_version 162368 (0.0008) [2023-12-27 20:23:40,103][106226] Updated weights for policy 0, policy_version 162102 (0.0007) [2023-12-27 20:23:40,155][106226] Updated weights for policy 0, policy_version 162112 (0.0008) [2023-12-27 20:23:40,803][106226] Updated weights for policy 0, policy_version 162122 (0.0007) [2023-12-27 20:23:40,848][106225] Updated weights for policy 1, policy_version 162378 (0.0006) [2023-12-27 20:23:40,852][106226] Updated weights for policy 0, policy_version 162132 (0.0008) [2023-12-27 20:23:40,895][106225] Updated weights for policy 1, policy_version 162388 (0.0007) [2023-12-27 20:23:40,914][106226] Updated weights for policy 0, policy_version 162142 (0.0011) [2023-12-27 20:23:40,944][106225] Updated weights for policy 1, policy_version 162398 (0.0007) [2023-12-27 20:23:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 83099648. Throughput: 0: 9941.4, 1: 9927.7. Samples: 83065816. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:41,175][105115] Avg episode reward: [(0, '-5.617'), (1, '-6.592')] [2023-12-27 20:23:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000162400_41582592.pth... [2023-12-27 20:23:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000162144_41517056.pth... [2023-12-27 20:23:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000161216_41279488.pth [2023-12-27 20:23:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000160960_41213952.pth [2023-12-27 20:23:41,707][106226] Updated weights for policy 0, policy_version 162152 (0.0009) [2023-12-27 20:23:41,772][106225] Updated weights for policy 1, policy_version 162408 (0.0009) [2023-12-27 20:23:41,782][106226] Updated weights for policy 0, policy_version 162162 (0.0008) [2023-12-27 20:23:41,836][106225] Updated weights for policy 1, policy_version 162418 (0.0007) [2023-12-27 20:23:41,846][106226] Updated weights for policy 0, policy_version 162172 (0.0007) [2023-12-27 20:23:41,900][106225] Updated weights for policy 1, policy_version 162428 (0.0008) [2023-12-27 20:23:42,526][106225] Updated weights for policy 1, policy_version 162438 (0.0008) [2023-12-27 20:23:42,589][106225] Updated weights for policy 1, policy_version 162448 (0.0007) [2023-12-27 20:23:42,635][106226] Updated weights for policy 0, policy_version 162182 (0.0007) [2023-12-27 20:23:42,655][106225] Updated weights for policy 1, policy_version 162458 (0.0008) [2023-12-27 20:23:42,690][106226] Updated weights for policy 0, policy_version 162192 (0.0008) [2023-12-27 20:23:42,750][106226] Updated weights for policy 0, policy_version 162202 (0.0009) [2023-12-27 20:23:43,363][106225] Updated weights for policy 1, policy_version 162468 (0.0008) [2023-12-27 20:23:43,392][106226] Updated weights for policy 0, policy_version 162212 (0.0007) [2023-12-27 20:23:43,432][106225] Updated weights for policy 1, policy_version 162478 (0.0008) [2023-12-27 20:23:43,457][106226] Updated weights for policy 0, policy_version 162222 (0.0006) [2023-12-27 20:23:43,491][106225] Updated weights for policy 1, policy_version 162488 (0.0008) [2023-12-27 20:23:43,518][106226] Updated weights for policy 0, policy_version 162232 (0.0005) [2023-12-27 20:23:44,174][106226] Updated weights for policy 0, policy_version 162242 (0.0010) [2023-12-27 20:23:44,194][106225] Updated weights for policy 1, policy_version 162498 (0.0007) [2023-12-27 20:23:44,240][106226] Updated weights for policy 0, policy_version 162252 (0.0011) [2023-12-27 20:23:44,253][106225] Updated weights for policy 1, policy_version 162508 (0.0005) [2023-12-27 20:23:44,298][106226] Updated weights for policy 0, policy_version 162262 (0.0011) [2023-12-27 20:23:44,311][106225] Updated weights for policy 1, policy_version 162518 (0.0006) [2023-12-27 20:23:44,355][106226] Updated weights for policy 0, policy_version 162272 (0.0010) [2023-12-27 20:23:44,370][106225] Updated weights for policy 1, policy_version 162528 (0.0006) [2023-12-27 20:23:45,056][106226] Updated weights for policy 0, policy_version 162282 (0.0006) [2023-12-27 20:23:45,085][106225] Updated weights for policy 1, policy_version 162538 (0.0008) [2023-12-27 20:23:45,122][106226] Updated weights for policy 0, policy_version 162292 (0.0007) [2023-12-27 20:23:45,152][106225] Updated weights for policy 1, policy_version 162548 (0.0007) [2023-12-27 20:23:45,185][106226] Updated weights for policy 0, policy_version 162302 (0.0008) [2023-12-27 20:23:45,218][106225] Updated weights for policy 1, policy_version 162558 (0.0006) [2023-12-27 20:23:45,732][106226] Updated weights for policy 0, policy_version 162312 (0.0006) [2023-12-27 20:23:45,795][106226] Updated weights for policy 0, policy_version 162322 (0.0007) [2023-12-27 20:23:45,846][106225] Updated weights for policy 1, policy_version 162568 (0.0006) [2023-12-27 20:23:45,852][106226] Updated weights for policy 0, policy_version 162332 (0.0010) [2023-12-27 20:23:45,902][106225] Updated weights for policy 1, policy_version 162578 (0.0005) [2023-12-27 20:23:45,951][106225] Updated weights for policy 1, policy_version 162588 (0.0005) [2023-12-27 20:23:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 83197952. Throughput: 0: 9976.5, 1: 9924.3. Samples: 83182856. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:46,176][105115] Avg episode reward: [(0, '-5.288'), (1, '-6.377')] [2023-12-27 20:23:46,499][106226] Updated weights for policy 0, policy_version 162342 (0.0010) [2023-12-27 20:23:46,536][106225] Updated weights for policy 1, policy_version 162598 (0.0005) [2023-12-27 20:23:46,568][106226] Updated weights for policy 0, policy_version 162352 (0.0011) [2023-12-27 20:23:46,590][106225] Updated weights for policy 1, policy_version 162608 (0.0005) [2023-12-27 20:23:46,629][106226] Updated weights for policy 0, policy_version 162362 (0.0011) [2023-12-27 20:23:46,641][106225] Updated weights for policy 1, policy_version 162618 (0.0005) [2023-12-27 20:23:47,290][106225] Updated weights for policy 1, policy_version 162628 (0.0006) [2023-12-27 20:23:47,297][106226] Updated weights for policy 0, policy_version 162372 (0.0008) [2023-12-27 20:23:47,350][106225] Updated weights for policy 1, policy_version 162638 (0.0008) [2023-12-27 20:23:47,350][106226] Updated weights for policy 0, policy_version 162382 (0.0005) [2023-12-27 20:23:47,405][106225] Updated weights for policy 1, policy_version 162648 (0.0008) [2023-12-27 20:23:47,407][106226] Updated weights for policy 0, policy_version 162392 (0.0007) [2023-12-27 20:23:48,045][106226] Updated weights for policy 0, policy_version 162402 (0.0006) [2023-12-27 20:23:48,092][106226] Updated weights for policy 0, policy_version 162412 (0.0010) [2023-12-27 20:23:48,135][106226] Updated weights for policy 0, policy_version 162422 (0.0010) [2023-12-27 20:23:48,153][106225] Updated weights for policy 1, policy_version 162658 (0.0008) [2023-12-27 20:23:48,193][106226] Updated weights for policy 0, policy_version 162432 (0.0010) [2023-12-27 20:23:48,204][106225] Updated weights for policy 1, policy_version 162668 (0.0009) [2023-12-27 20:23:48,262][106225] Updated weights for policy 1, policy_version 162678 (0.0007) [2023-12-27 20:23:48,326][106225] Updated weights for policy 1, policy_version 162688 (0.0009) [2023-12-27 20:23:48,932][106226] Updated weights for policy 0, policy_version 162442 (0.0011) [2023-12-27 20:23:48,990][106226] Updated weights for policy 0, policy_version 162452 (0.0011) [2023-12-27 20:23:49,044][106226] Updated weights for policy 0, policy_version 162462 (0.0010) [2023-12-27 20:23:49,084][106225] Updated weights for policy 1, policy_version 162698 (0.0007) [2023-12-27 20:23:49,135][106225] Updated weights for policy 1, policy_version 162708 (0.0008) [2023-12-27 20:23:49,185][106225] Updated weights for policy 1, policy_version 162718 (0.0007) [2023-12-27 20:23:49,754][106226] Updated weights for policy 0, policy_version 162472 (0.0009) [2023-12-27 20:23:49,820][106226] Updated weights for policy 0, policy_version 162482 (0.0007) [2023-12-27 20:23:49,889][106226] Updated weights for policy 0, policy_version 162492 (0.0010) [2023-12-27 20:23:49,926][106225] Updated weights for policy 1, policy_version 162728 (0.0007) [2023-12-27 20:23:49,995][106225] Updated weights for policy 1, policy_version 162738 (0.0007) [2023-12-27 20:23:50,054][106225] Updated weights for policy 1, policy_version 162748 (0.0010) [2023-12-27 20:23:50,600][106226] Updated weights for policy 0, policy_version 162502 (0.0010) [2023-12-27 20:23:50,662][106226] Updated weights for policy 0, policy_version 162512 (0.0008) [2023-12-27 20:23:50,719][106226] Updated weights for policy 0, policy_version 162522 (0.0008) [2023-12-27 20:23:50,795][106225] Updated weights for policy 1, policy_version 162758 (0.0011) [2023-12-27 20:23:50,855][106225] Updated weights for policy 1, policy_version 162768 (0.0010) [2023-12-27 20:23:50,916][106225] Updated weights for policy 1, policy_version 162778 (0.0005) [2023-12-27 20:23:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19934.2, 300 sec: 19855.2). Total num frames: 83296256. Throughput: 0: 9998.5, 1: 9977.3. Samples: 83304016. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:51,175][105115] Avg episode reward: [(0, '-5.565'), (1, '-6.760')] [2023-12-27 20:23:51,501][106226] Updated weights for policy 0, policy_version 162532 (0.0008) [2023-12-27 20:23:51,554][106226] Updated weights for policy 0, policy_version 162542 (0.0006) [2023-12-27 20:23:51,608][106225] Updated weights for policy 1, policy_version 162788 (0.0007) [2023-12-27 20:23:51,610][106226] Updated weights for policy 0, policy_version 162552 (0.0006) [2023-12-27 20:23:51,679][106225] Updated weights for policy 1, policy_version 162798 (0.0009) [2023-12-27 20:23:51,752][106225] Updated weights for policy 1, policy_version 162808 (0.0008) [2023-12-27 20:23:52,357][106226] Updated weights for policy 0, policy_version 162562 (0.0009) [2023-12-27 20:23:52,423][106226] Updated weights for policy 0, policy_version 162572 (0.0007) [2023-12-27 20:23:52,470][106225] Updated weights for policy 1, policy_version 162818 (0.0010) [2023-12-27 20:23:52,472][106226] Updated weights for policy 0, policy_version 162582 (0.0007) [2023-12-27 20:23:52,523][106226] Updated weights for policy 0, policy_version 162592 (0.0007) [2023-12-27 20:23:52,526][106225] Updated weights for policy 1, policy_version 162828 (0.0008) [2023-12-27 20:23:52,577][106225] Updated weights for policy 1, policy_version 162838 (0.0008) [2023-12-27 20:23:52,624][106225] Updated weights for policy 1, policy_version 162848 (0.0008) [2023-12-27 20:23:53,228][106226] Updated weights for policy 0, policy_version 162602 (0.0005) [2023-12-27 20:23:53,288][106226] Updated weights for policy 0, policy_version 162612 (0.0005) [2023-12-27 20:23:53,346][106226] Updated weights for policy 0, policy_version 162622 (0.0007) [2023-12-27 20:23:53,375][106225] Updated weights for policy 1, policy_version 162858 (0.0010) [2023-12-27 20:23:53,431][106225] Updated weights for policy 1, policy_version 162868 (0.0010) [2023-12-27 20:23:53,487][106225] Updated weights for policy 1, policy_version 162878 (0.0010) [2023-12-27 20:23:53,910][106226] Updated weights for policy 0, policy_version 162632 (0.0006) [2023-12-27 20:23:53,957][106226] Updated weights for policy 0, policy_version 162642 (0.0010) [2023-12-27 20:23:54,001][106226] Updated weights for policy 0, policy_version 162652 (0.0010) [2023-12-27 20:23:54,196][106225] Updated weights for policy 1, policy_version 162888 (0.0011) [2023-12-27 20:23:54,258][106225] Updated weights for policy 1, policy_version 162898 (0.0010) [2023-12-27 20:23:54,312][106225] Updated weights for policy 1, policy_version 162908 (0.0010) [2023-12-27 20:23:54,676][106226] Updated weights for policy 0, policy_version 162662 (0.0009) [2023-12-27 20:23:54,731][106226] Updated weights for policy 0, policy_version 162672 (0.0006) [2023-12-27 20:23:54,789][106226] Updated weights for policy 0, policy_version 162682 (0.0005) [2023-12-27 20:23:55,002][106225] Updated weights for policy 1, policy_version 162918 (0.0009) [2023-12-27 20:23:55,058][106225] Updated weights for policy 1, policy_version 162928 (0.0006) [2023-12-27 20:23:55,104][106225] Updated weights for policy 1, policy_version 162938 (0.0005) [2023-12-27 20:23:55,414][106226] Updated weights for policy 0, policy_version 162692 (0.0005) [2023-12-27 20:23:55,472][106226] Updated weights for policy 0, policy_version 162702 (0.0006) [2023-12-27 20:23:55,531][106226] Updated weights for policy 0, policy_version 162712 (0.0008) [2023-12-27 20:23:55,783][106225] Updated weights for policy 1, policy_version 162948 (0.0007) [2023-12-27 20:23:55,845][106225] Updated weights for policy 1, policy_version 162958 (0.0009) [2023-12-27 20:23:55,905][106225] Updated weights for policy 1, policy_version 162968 (0.0009) [2023-12-27 20:23:56,145][106226] Updated weights for policy 0, policy_version 162722 (0.0009) [2023-12-27 20:23:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 83394560. Throughput: 0: 9994.3, 1: 10008.3. Samples: 83363364. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:23:56,175][105115] Avg episode reward: [(0, '-5.285'), (1, '-6.226')] [2023-12-27 20:23:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000162976_41730048.pth... [2023-12-27 20:23:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000161792_41426944.pth [2023-12-27 20:23:56,194][106226] Updated weights for policy 0, policy_version 162732 (0.0008) [2023-12-27 20:23:56,243][106226] Updated weights for policy 0, policy_version 162742 (0.0008) [2023-12-27 20:23:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000162752_41672704.pth... [2023-12-27 20:23:56,294][106226] Updated weights for policy 0, policy_version 162752 (0.0008) [2023-12-27 20:23:56,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000161568_41369600.pth [2023-12-27 20:23:56,655][106225] Updated weights for policy 1, policy_version 162978 (0.0009) [2023-12-27 20:23:56,702][106225] Updated weights for policy 1, policy_version 162988 (0.0008) [2023-12-27 20:23:56,746][106225] Updated weights for policy 1, policy_version 162998 (0.0008) [2023-12-27 20:23:56,795][106225] Updated weights for policy 1, policy_version 163008 (0.0009) [2023-12-27 20:23:56,974][106226] Updated weights for policy 0, policy_version 162762 (0.0009) [2023-12-27 20:23:57,035][106226] Updated weights for policy 0, policy_version 162772 (0.0009) [2023-12-27 20:23:57,102][106226] Updated weights for policy 0, policy_version 162782 (0.0009) [2023-12-27 20:23:57,451][106225] Updated weights for policy 1, policy_version 163018 (0.0005) [2023-12-27 20:23:57,510][106225] Updated weights for policy 1, policy_version 163028 (0.0005) [2023-12-27 20:23:57,570][106225] Updated weights for policy 1, policy_version 163038 (0.0006) [2023-12-27 20:23:57,728][106226] Updated weights for policy 0, policy_version 162792 (0.0009) [2023-12-27 20:23:57,788][106226] Updated weights for policy 0, policy_version 162802 (0.0008) [2023-12-27 20:23:57,850][106226] Updated weights for policy 0, policy_version 162812 (0.0009) [2023-12-27 20:23:58,125][106225] Updated weights for policy 1, policy_version 163048 (0.0007) [2023-12-27 20:23:58,191][106225] Updated weights for policy 1, policy_version 163058 (0.0006) [2023-12-27 20:23:58,250][106225] Updated weights for policy 1, policy_version 163068 (0.0008) [2023-12-27 20:23:58,659][106226] Updated weights for policy 0, policy_version 162822 (0.0007) [2023-12-27 20:23:58,723][106226] Updated weights for policy 0, policy_version 162832 (0.0008) [2023-12-27 20:23:58,793][106226] Updated weights for policy 0, policy_version 162842 (0.0009) [2023-12-27 20:23:59,061][106225] Updated weights for policy 1, policy_version 163078 (0.0007) [2023-12-27 20:23:59,123][106225] Updated weights for policy 1, policy_version 163088 (0.0007) [2023-12-27 20:23:59,188][106225] Updated weights for policy 1, policy_version 163098 (0.0006) [2023-12-27 20:23:59,606][106226] Updated weights for policy 0, policy_version 162852 (0.0007) [2023-12-27 20:23:59,662][106226] Updated weights for policy 0, policy_version 162862 (0.0005) [2023-12-27 20:23:59,732][106226] Updated weights for policy 0, policy_version 162872 (0.0006) [2023-12-27 20:23:59,885][106225] Updated weights for policy 1, policy_version 163108 (0.0008) [2023-12-27 20:23:59,943][106225] Updated weights for policy 1, policy_version 163118 (0.0009) [2023-12-27 20:24:00,015][106225] Updated weights for policy 1, policy_version 163128 (0.0009) [2023-12-27 20:24:00,342][106226] Updated weights for policy 0, policy_version 162882 (0.0008) [2023-12-27 20:24:00,404][106226] Updated weights for policy 0, policy_version 162892 (0.0007) [2023-12-27 20:24:00,462][106226] Updated weights for policy 0, policy_version 162902 (0.0008) [2023-12-27 20:24:00,518][106226] Updated weights for policy 0, policy_version 162912 (0.0009) [2023-12-27 20:24:00,791][106225] Updated weights for policy 1, policy_version 163138 (0.0008) [2023-12-27 20:24:00,839][106225] Updated weights for policy 1, policy_version 163148 (0.0008) [2023-12-27 20:24:00,890][106225] Updated weights for policy 1, policy_version 163158 (0.0008) [2023-12-27 20:24:00,950][106225] Updated weights for policy 1, policy_version 163168 (0.0008) [2023-12-27 20:24:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 83492864. Throughput: 0: 10070.8, 1: 10052.2. Samples: 83483332. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:24:01,175][105115] Avg episode reward: [(0, '-5.122'), (1, '-6.269')] [2023-12-27 20:24:01,183][106226] Updated weights for policy 0, policy_version 162922 (0.0007) [2023-12-27 20:24:01,246][106226] Updated weights for policy 0, policy_version 162932 (0.0006) [2023-12-27 20:24:01,310][106226] Updated weights for policy 0, policy_version 162942 (0.0007) [2023-12-27 20:24:01,728][106225] Updated weights for policy 1, policy_version 163178 (0.0008) [2023-12-27 20:24:01,791][106225] Updated weights for policy 1, policy_version 163188 (0.0008) [2023-12-27 20:24:01,846][106225] Updated weights for policy 1, policy_version 163198 (0.0008) [2023-12-27 20:24:02,016][106226] Updated weights for policy 0, policy_version 162952 (0.0010) [2023-12-27 20:24:02,072][106226] Updated weights for policy 0, policy_version 162962 (0.0010) [2023-12-27 20:24:02,133][106226] Updated weights for policy 0, policy_version 162972 (0.0010) [2023-12-27 20:24:02,617][106225] Updated weights for policy 1, policy_version 163208 (0.0008) [2023-12-27 20:24:02,667][106225] Updated weights for policy 1, policy_version 163218 (0.0008) [2023-12-27 20:24:02,715][106225] Updated weights for policy 1, policy_version 163228 (0.0007) [2023-12-27 20:24:02,859][106226] Updated weights for policy 0, policy_version 162982 (0.0007) [2023-12-27 20:24:02,919][106226] Updated weights for policy 0, policy_version 162992 (0.0005) [2023-12-27 20:24:02,964][106226] Updated weights for policy 0, policy_version 163002 (0.0005) [2023-12-27 20:24:03,388][106225] Updated weights for policy 1, policy_version 163238 (0.0009) [2023-12-27 20:24:03,443][106225] Updated weights for policy 1, policy_version 163248 (0.0005) [2023-12-27 20:24:03,500][106226] Updated weights for policy 0, policy_version 163012 (0.0008) [2023-12-27 20:24:03,502][106225] Updated weights for policy 1, policy_version 163258 (0.0007) [2023-12-27 20:24:03,561][106226] Updated weights for policy 0, policy_version 163022 (0.0010) [2023-12-27 20:24:03,616][106226] Updated weights for policy 0, policy_version 163032 (0.0010) [2023-12-27 20:24:04,136][106225] Updated weights for policy 1, policy_version 163268 (0.0008) [2023-12-27 20:24:04,193][106225] Updated weights for policy 1, policy_version 163278 (0.0006) [2023-12-27 20:24:04,242][106226] Updated weights for policy 0, policy_version 163042 (0.0007) [2023-12-27 20:24:04,251][106225] Updated weights for policy 1, policy_version 163288 (0.0008) [2023-12-27 20:24:04,301][106226] Updated weights for policy 0, policy_version 163052 (0.0011) [2023-12-27 20:24:04,362][106226] Updated weights for policy 0, policy_version 163062 (0.0011) [2023-12-27 20:24:04,424][106226] Updated weights for policy 0, policy_version 163072 (0.0011) [2023-12-27 20:24:04,913][106225] Updated weights for policy 1, policy_version 163298 (0.0007) [2023-12-27 20:24:04,973][106225] Updated weights for policy 1, policy_version 163308 (0.0006) [2023-12-27 20:24:05,030][106225] Updated weights for policy 1, policy_version 163318 (0.0005) [2023-12-27 20:24:05,082][106225] Updated weights for policy 1, policy_version 163328 (0.0005) [2023-12-27 20:24:05,155][106226] Updated weights for policy 0, policy_version 163082 (0.0010) [2023-12-27 20:24:05,224][106226] Updated weights for policy 0, policy_version 163092 (0.0008) [2023-12-27 20:24:05,276][106226] Updated weights for policy 0, policy_version 163102 (0.0008) [2023-12-27 20:24:05,623][106225] Updated weights for policy 1, policy_version 163338 (0.0007) [2023-12-27 20:24:05,684][106225] Updated weights for policy 1, policy_version 163348 (0.0006) [2023-12-27 20:24:05,733][106225] Updated weights for policy 1, policy_version 163358 (0.0006) [2023-12-27 20:24:05,925][106226] Updated weights for policy 0, policy_version 163112 (0.0011) [2023-12-27 20:24:05,987][106226] Updated weights for policy 0, policy_version 163122 (0.0010) [2023-12-27 20:24:06,044][106226] Updated weights for policy 0, policy_version 163132 (0.0007) [2023-12-27 20:24:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.3, 300 sec: 19883.0). Total num frames: 83599360. Throughput: 0: 10149.2, 1: 10028.7. Samples: 83605588. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:24:06,176][105115] Avg episode reward: [(0, '-5.631'), (1, '-6.490')] [2023-12-27 20:24:06,418][106225] Updated weights for policy 1, policy_version 163368 (0.0006) [2023-12-27 20:24:06,483][106225] Updated weights for policy 1, policy_version 163378 (0.0008) [2023-12-27 20:24:06,546][106225] Updated weights for policy 1, policy_version 163388 (0.0006) [2023-12-27 20:24:06,790][106226] Updated weights for policy 0, policy_version 163142 (0.0009) [2023-12-27 20:24:06,845][106226] Updated weights for policy 0, policy_version 163152 (0.0008) [2023-12-27 20:24:06,904][106226] Updated weights for policy 0, policy_version 163162 (0.0008) [2023-12-27 20:24:07,240][106225] Updated weights for policy 1, policy_version 163398 (0.0009) [2023-12-27 20:24:07,307][106225] Updated weights for policy 1, policy_version 163408 (0.0010) [2023-12-27 20:24:07,368][106225] Updated weights for policy 1, policy_version 163418 (0.0010) [2023-12-27 20:24:07,555][106226] Updated weights for policy 0, policy_version 163172 (0.0007) [2023-12-27 20:24:07,603][106226] Updated weights for policy 0, policy_version 163182 (0.0007) [2023-12-27 20:24:07,651][106226] Updated weights for policy 0, policy_version 163192 (0.0008) [2023-12-27 20:24:08,071][106225] Updated weights for policy 1, policy_version 163428 (0.0010) [2023-12-27 20:24:08,130][106225] Updated weights for policy 1, policy_version 163438 (0.0010) [2023-12-27 20:24:08,188][106225] Updated weights for policy 1, policy_version 163448 (0.0010) [2023-12-27 20:24:08,297][106226] Updated weights for policy 0, policy_version 163202 (0.0008) [2023-12-27 20:24:08,368][106226] Updated weights for policy 0, policy_version 163212 (0.0008) [2023-12-27 20:24:08,432][106226] Updated weights for policy 0, policy_version 163222 (0.0008) [2023-12-27 20:24:08,495][106226] Updated weights for policy 0, policy_version 163232 (0.0008) [2023-12-27 20:24:08,932][106225] Updated weights for policy 1, policy_version 163458 (0.0010) [2023-12-27 20:24:08,987][106225] Updated weights for policy 1, policy_version 163468 (0.0008) [2023-12-27 20:24:09,044][106225] Updated weights for policy 1, policy_version 163478 (0.0008) [2023-12-27 20:24:09,097][106225] Updated weights for policy 1, policy_version 163488 (0.0008) [2023-12-27 20:24:09,265][106226] Updated weights for policy 0, policy_version 163242 (0.0011) [2023-12-27 20:24:09,325][106226] Updated weights for policy 0, policy_version 163252 (0.0008) [2023-12-27 20:24:09,399][106226] Updated weights for policy 0, policy_version 163262 (0.0010) [2023-12-27 20:24:09,886][106225] Updated weights for policy 1, policy_version 163498 (0.0009) [2023-12-27 20:24:09,949][106225] Updated weights for policy 1, policy_version 163508 (0.0008) [2023-12-27 20:24:10,015][106225] Updated weights for policy 1, policy_version 163518 (0.0008) [2023-12-27 20:24:10,121][106226] Updated weights for policy 0, policy_version 163272 (0.0011) [2023-12-27 20:24:10,182][106226] Updated weights for policy 0, policy_version 163282 (0.0011) [2023-12-27 20:24:10,237][106226] Updated weights for policy 0, policy_version 163292 (0.0011) [2023-12-27 20:24:10,744][106225] Updated weights for policy 1, policy_version 163528 (0.0008) [2023-12-27 20:24:10,808][106225] Updated weights for policy 1, policy_version 163538 (0.0007) [2023-12-27 20:24:10,878][106225] Updated weights for policy 1, policy_version 163548 (0.0010) [2023-12-27 20:24:10,950][106226] Updated weights for policy 0, policy_version 163302 (0.0009) [2023-12-27 20:24:11,010][106226] Updated weights for policy 0, policy_version 163312 (0.0006) [2023-12-27 20:24:11,084][106226] Updated weights for policy 0, policy_version 163322 (0.0007) [2023-12-27 20:24:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 83697664. Throughput: 0: 10126.2, 1: 10030.2. Samples: 83664312. Policy #0 lag: (min: 27.0, avg: 31.9, max: 59.0) [2023-12-27 20:24:11,175][105115] Avg episode reward: [(0, '-5.405'), (1, '-6.415')] [2023-12-27 20:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000163328_41820160.pth... [2023-12-27 20:24:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000163552_41877504.pth... [2023-12-27 20:24:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000162144_41517056.pth [2023-12-27 20:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000162400_41582592.pth [2023-12-27 20:24:11,727][106225] Updated weights for policy 1, policy_version 163558 (0.0007) [2023-12-27 20:24:11,795][106225] Updated weights for policy 1, policy_version 163568 (0.0008) [2023-12-27 20:24:11,820][106226] Updated weights for policy 0, policy_version 163332 (0.0008) [2023-12-27 20:24:11,855][106225] Updated weights for policy 1, policy_version 163578 (0.0008) [2023-12-27 20:24:11,882][106226] Updated weights for policy 0, policy_version 163342 (0.0006) [2023-12-27 20:24:11,947][106226] Updated weights for policy 0, policy_version 163352 (0.0008) [2023-12-27 20:24:12,613][106225] Updated weights for policy 1, policy_version 163588 (0.0009) [2023-12-27 20:24:12,677][106225] Updated weights for policy 1, policy_version 163598 (0.0009) [2023-12-27 20:24:12,697][106226] Updated weights for policy 0, policy_version 163362 (0.0009) [2023-12-27 20:24:12,735][106225] Updated weights for policy 1, policy_version 163608 (0.0008) [2023-12-27 20:24:12,754][106226] Updated weights for policy 0, policy_version 163372 (0.0008) [2023-12-27 20:24:12,813][106226] Updated weights for policy 0, policy_version 163382 (0.0008) [2023-12-27 20:24:12,876][106226] Updated weights for policy 0, policy_version 163392 (0.0007) [2023-12-27 20:24:13,356][106225] Updated weights for policy 1, policy_version 163618 (0.0009) [2023-12-27 20:24:13,415][106225] Updated weights for policy 1, policy_version 163628 (0.0005) [2023-12-27 20:24:13,460][106225] Updated weights for policy 1, policy_version 163638 (0.0005) [2023-12-27 20:24:13,506][106225] Updated weights for policy 1, policy_version 163648 (0.0005) [2023-12-27 20:24:13,687][106226] Updated weights for policy 0, policy_version 163402 (0.0006) [2023-12-27 20:24:13,745][106226] Updated weights for policy 0, policy_version 163412 (0.0008) [2023-12-27 20:24:13,804][106226] Updated weights for policy 0, policy_version 163422 (0.0005) [2023-12-27 20:24:14,159][106225] Updated weights for policy 1, policy_version 163658 (0.0007) [2023-12-27 20:24:14,224][106225] Updated weights for policy 1, policy_version 163668 (0.0007) [2023-12-27 20:24:14,290][106225] Updated weights for policy 1, policy_version 163678 (0.0010) [2023-12-27 20:24:14,434][106226] Updated weights for policy 0, policy_version 163432 (0.0008) [2023-12-27 20:24:14,495][106226] Updated weights for policy 0, policy_version 163442 (0.0007) [2023-12-27 20:24:14,562][106226] Updated weights for policy 0, policy_version 163452 (0.0007) [2023-12-27 20:24:14,982][106225] Updated weights for policy 1, policy_version 163688 (0.0010) [2023-12-27 20:24:15,044][106225] Updated weights for policy 1, policy_version 163698 (0.0010) [2023-12-27 20:24:15,106][106225] Updated weights for policy 1, policy_version 163708 (0.0010) [2023-12-27 20:24:15,301][106226] Updated weights for policy 0, policy_version 163462 (0.0008) [2023-12-27 20:24:15,376][106226] Updated weights for policy 0, policy_version 163472 (0.0009) [2023-12-27 20:24:15,448][106226] Updated weights for policy 0, policy_version 163482 (0.0008) [2023-12-27 20:24:15,820][106225] Updated weights for policy 1, policy_version 163718 (0.0011) [2023-12-27 20:24:15,873][106225] Updated weights for policy 1, policy_version 163728 (0.0010) [2023-12-27 20:24:15,920][106225] Updated weights for policy 1, policy_version 163738 (0.0010) [2023-12-27 20:24:16,110][106226] Updated weights for policy 0, policy_version 163492 (0.0007) [2023-12-27 20:24:16,170][106226] Updated weights for policy 0, policy_version 163502 (0.0008) [2023-12-27 20:24:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 83787776. Throughput: 0: 9992.0, 1: 9845.2. Samples: 83777976. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:16,176][105115] Avg episode reward: [(0, '-5.361'), (1, '-6.778')] [2023-12-27 20:24:16,220][106226] Updated weights for policy 0, policy_version 163512 (0.0008) [2023-12-27 20:24:16,629][106225] Updated weights for policy 1, policy_version 163748 (0.0010) [2023-12-27 20:24:16,681][106225] Updated weights for policy 1, policy_version 163758 (0.0010) [2023-12-27 20:24:16,732][106225] Updated weights for policy 1, policy_version 163768 (0.0010) [2023-12-27 20:24:16,940][106226] Updated weights for policy 0, policy_version 163522 (0.0008) [2023-12-27 20:24:17,001][106226] Updated weights for policy 0, policy_version 163532 (0.0008) [2023-12-27 20:24:17,051][106226] Updated weights for policy 0, policy_version 163542 (0.0008) [2023-12-27 20:24:17,103][106226] Updated weights for policy 0, policy_version 163552 (0.0008) [2023-12-27 20:24:17,456][106225] Updated weights for policy 1, policy_version 163778 (0.0010) [2023-12-27 20:24:17,517][106225] Updated weights for policy 1, policy_version 163788 (0.0010) [2023-12-27 20:24:17,574][106225] Updated weights for policy 1, policy_version 163798 (0.0009) [2023-12-27 20:24:17,636][106225] Updated weights for policy 1, policy_version 163808 (0.0006) [2023-12-27 20:24:17,843][106226] Updated weights for policy 0, policy_version 163562 (0.0008) [2023-12-27 20:24:17,910][106226] Updated weights for policy 0, policy_version 163572 (0.0009) [2023-12-27 20:24:17,960][106226] Updated weights for policy 0, policy_version 163582 (0.0009) [2023-12-27 20:24:18,225][106225] Updated weights for policy 1, policy_version 163818 (0.0008) [2023-12-27 20:24:18,278][106225] Updated weights for policy 1, policy_version 163828 (0.0009) [2023-12-27 20:24:18,341][106225] Updated weights for policy 1, policy_version 163838 (0.0007) [2023-12-27 20:24:18,660][106226] Updated weights for policy 0, policy_version 163592 (0.0008) [2023-12-27 20:24:18,721][106226] Updated weights for policy 0, policy_version 163602 (0.0009) [2023-12-27 20:24:18,784][106226] Updated weights for policy 0, policy_version 163612 (0.0007) [2023-12-27 20:24:19,070][106225] Updated weights for policy 1, policy_version 163848 (0.0008) [2023-12-27 20:24:19,123][106225] Updated weights for policy 1, policy_version 163858 (0.0008) [2023-12-27 20:24:19,177][106225] Updated weights for policy 1, policy_version 163868 (0.0008) [2023-12-27 20:24:19,505][106226] Updated weights for policy 0, policy_version 163622 (0.0008) [2023-12-27 20:24:19,568][106226] Updated weights for policy 0, policy_version 163632 (0.0008) [2023-12-27 20:24:19,621][106226] Updated weights for policy 0, policy_version 163642 (0.0009) [2023-12-27 20:24:19,975][106225] Updated weights for policy 1, policy_version 163878 (0.0009) [2023-12-27 20:24:20,037][106225] Updated weights for policy 1, policy_version 163888 (0.0009) [2023-12-27 20:24:20,100][106225] Updated weights for policy 1, policy_version 163898 (0.0008) [2023-12-27 20:24:20,437][106226] Updated weights for policy 0, policy_version 163652 (0.0008) [2023-12-27 20:24:20,497][106226] Updated weights for policy 0, policy_version 163662 (0.0009) [2023-12-27 20:24:20,563][106226] Updated weights for policy 0, policy_version 163672 (0.0008) [2023-12-27 20:24:20,824][106225] Updated weights for policy 1, policy_version 163908 (0.0008) [2023-12-27 20:24:20,893][106225] Updated weights for policy 1, policy_version 163918 (0.0008) [2023-12-27 20:24:20,962][106225] Updated weights for policy 1, policy_version 163928 (0.0008) [2023-12-27 20:24:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 83886080. Throughput: 0: 9873.4, 1: 9854.0. Samples: 83894008. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:21,175][105115] Avg episode reward: [(0, '-5.435'), (1, '-6.529')] [2023-12-27 20:24:21,276][106226] Updated weights for policy 0, policy_version 163682 (0.0008) [2023-12-27 20:24:21,349][106226] Updated weights for policy 0, policy_version 163692 (0.0007) [2023-12-27 20:24:21,428][106226] Updated weights for policy 0, policy_version 163702 (0.0008) [2023-12-27 20:24:21,493][106226] Updated weights for policy 0, policy_version 163712 (0.0007) [2023-12-27 20:24:21,813][106225] Updated weights for policy 1, policy_version 163938 (0.0008) [2023-12-27 20:24:21,864][106225] Updated weights for policy 1, policy_version 163948 (0.0008) [2023-12-27 20:24:21,916][106225] Updated weights for policy 1, policy_version 163958 (0.0008) [2023-12-27 20:24:21,974][106225] Updated weights for policy 1, policy_version 163968 (0.0008) [2023-12-27 20:24:22,165][106226] Updated weights for policy 0, policy_version 163722 (0.0011) [2023-12-27 20:24:22,216][106226] Updated weights for policy 0, policy_version 163732 (0.0008) [2023-12-27 20:24:22,275][106226] Updated weights for policy 0, policy_version 163742 (0.0006) [2023-12-27 20:24:22,786][106225] Updated weights for policy 1, policy_version 163978 (0.0008) [2023-12-27 20:24:22,842][106225] Updated weights for policy 1, policy_version 163988 (0.0007) [2023-12-27 20:24:22,893][106225] Updated weights for policy 1, policy_version 163998 (0.0007) [2023-12-27 20:24:22,915][106226] Updated weights for policy 0, policy_version 163752 (0.0007) [2023-12-27 20:24:22,977][106226] Updated weights for policy 0, policy_version 163762 (0.0006) [2023-12-27 20:24:23,032][106226] Updated weights for policy 0, policy_version 163772 (0.0006) [2023-12-27 20:24:23,655][106226] Updated weights for policy 0, policy_version 163782 (0.0006) [2023-12-27 20:24:23,658][106225] Updated weights for policy 1, policy_version 164008 (0.0006) [2023-12-27 20:24:23,705][106225] Updated weights for policy 1, policy_version 164018 (0.0005) [2023-12-27 20:24:23,709][106226] Updated weights for policy 0, policy_version 163792 (0.0008) [2023-12-27 20:24:23,755][106225] Updated weights for policy 1, policy_version 164028 (0.0007) [2023-12-27 20:24:23,772][106226] Updated weights for policy 0, policy_version 163802 (0.0006) [2023-12-27 20:24:24,463][106226] Updated weights for policy 0, policy_version 163812 (0.0006) [2023-12-27 20:24:24,510][106225] Updated weights for policy 1, policy_version 164038 (0.0009) [2023-12-27 20:24:24,522][106226] Updated weights for policy 0, policy_version 163822 (0.0010) [2023-12-27 20:24:24,567][106225] Updated weights for policy 1, policy_version 164048 (0.0006) [2023-12-27 20:24:24,581][106226] Updated weights for policy 0, policy_version 163832 (0.0007) [2023-12-27 20:24:24,625][106225] Updated weights for policy 1, policy_version 164058 (0.0006) [2023-12-27 20:24:25,233][106225] Updated weights for policy 1, policy_version 164068 (0.0008) [2023-12-27 20:24:25,281][106226] Updated weights for policy 0, policy_version 163842 (0.0009) [2023-12-27 20:24:25,286][106225] Updated weights for policy 1, policy_version 164078 (0.0010) [2023-12-27 20:24:25,336][106225] Updated weights for policy 1, policy_version 164088 (0.0010) [2023-12-27 20:24:25,345][106226] Updated weights for policy 0, policy_version 163852 (0.0006) [2023-12-27 20:24:25,405][106226] Updated weights for policy 0, policy_version 163862 (0.0007) [2023-12-27 20:24:25,468][106226] Updated weights for policy 0, policy_version 163872 (0.0008) [2023-12-27 20:24:26,064][106225] Updated weights for policy 1, policy_version 164098 (0.0010) [2023-12-27 20:24:26,118][106225] Updated weights for policy 1, policy_version 164108 (0.0010) [2023-12-27 20:24:26,135][106226] Updated weights for policy 0, policy_version 163882 (0.0010) [2023-12-27 20:24:26,165][106225] Updated weights for policy 1, policy_version 164118 (0.0010) [2023-12-27 20:24:26,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 83976192. Throughput: 0: 9939.2, 1: 9741.9. Samples: 83951460. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:26,175][105115] Avg episode reward: [(0, '-5.212'), (1, '-6.163')] [2023-12-27 20:24:26,192][106226] Updated weights for policy 0, policy_version 163892 (0.0011) [2023-12-27 20:24:26,211][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000164128_42024960.pth... [2023-12-27 20:24:26,212][106225] Updated weights for policy 1, policy_version 164128 (0.0010) [2023-12-27 20:24:26,214][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000162976_41730048.pth [2023-12-27 20:24:26,245][106226] Updated weights for policy 0, policy_version 163902 (0.0010) [2023-12-27 20:24:26,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000163904_41967616.pth... [2023-12-27 20:24:26,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000162752_41672704.pth [2023-12-27 20:24:26,822][106225] Updated weights for policy 1, policy_version 164138 (0.0005) [2023-12-27 20:24:26,880][106225] Updated weights for policy 1, policy_version 164148 (0.0005) [2023-12-27 20:24:26,939][106225] Updated weights for policy 1, policy_version 164158 (0.0008) [2023-12-27 20:24:26,939][106226] Updated weights for policy 0, policy_version 163912 (0.0010) [2023-12-27 20:24:26,989][106226] Updated weights for policy 0, policy_version 163922 (0.0009) [2023-12-27 20:24:27,037][106226] Updated weights for policy 0, policy_version 163932 (0.0005) [2023-12-27 20:24:27,502][106225] Updated weights for policy 1, policy_version 164168 (0.0006) [2023-12-27 20:24:27,553][106225] Updated weights for policy 1, policy_version 164178 (0.0005) [2023-12-27 20:24:27,606][106225] Updated weights for policy 1, policy_version 164188 (0.0007) [2023-12-27 20:24:27,625][106226] Updated weights for policy 0, policy_version 163942 (0.0005) [2023-12-27 20:24:27,677][106226] Updated weights for policy 0, policy_version 163952 (0.0008) [2023-12-27 20:24:27,732][106226] Updated weights for policy 0, policy_version 163962 (0.0007) [2023-12-27 20:24:28,294][106225] Updated weights for policy 1, policy_version 164198 (0.0010) [2023-12-27 20:24:28,353][106225] Updated weights for policy 1, policy_version 164208 (0.0010) [2023-12-27 20:24:28,414][106225] Updated weights for policy 1, policy_version 164218 (0.0010) [2023-12-27 20:24:28,473][106226] Updated weights for policy 0, policy_version 163972 (0.0008) [2023-12-27 20:24:28,530][106226] Updated weights for policy 0, policy_version 163982 (0.0008) [2023-12-27 20:24:28,593][106226] Updated weights for policy 0, policy_version 163992 (0.0008) [2023-12-27 20:24:29,136][106225] Updated weights for policy 1, policy_version 164228 (0.0010) [2023-12-27 20:24:29,191][106225] Updated weights for policy 1, policy_version 164238 (0.0010) [2023-12-27 20:24:29,252][106225] Updated weights for policy 1, policy_version 164248 (0.0010) [2023-12-27 20:24:29,335][106226] Updated weights for policy 0, policy_version 164002 (0.0008) [2023-12-27 20:24:29,403][106226] Updated weights for policy 0, policy_version 164012 (0.0008) [2023-12-27 20:24:29,463][106226] Updated weights for policy 0, policy_version 164022 (0.0008) [2023-12-27 20:24:29,521][106226] Updated weights for policy 0, policy_version 164032 (0.0009) [2023-12-27 20:24:29,984][106225] Updated weights for policy 1, policy_version 164258 (0.0010) [2023-12-27 20:24:30,032][106225] Updated weights for policy 1, policy_version 164268 (0.0008) [2023-12-27 20:24:30,083][106225] Updated weights for policy 1, policy_version 164278 (0.0008) [2023-12-27 20:24:30,137][106225] Updated weights for policy 1, policy_version 164288 (0.0009) [2023-12-27 20:24:30,273][106226] Updated weights for policy 0, policy_version 164042 (0.0008) [2023-12-27 20:24:30,330][106226] Updated weights for policy 0, policy_version 164052 (0.0010) [2023-12-27 20:24:30,384][106226] Updated weights for policy 0, policy_version 164062 (0.0008) [2023-12-27 20:24:30,866][106225] Updated weights for policy 1, policy_version 164298 (0.0008) [2023-12-27 20:24:30,910][106225] Updated weights for policy 1, policy_version 164308 (0.0008) [2023-12-27 20:24:30,966][106225] Updated weights for policy 1, policy_version 164318 (0.0009) [2023-12-27 20:24:31,080][106226] Updated weights for policy 0, policy_version 164072 (0.0009) [2023-12-27 20:24:31,147][106226] Updated weights for policy 0, policy_version 164082 (0.0008) [2023-12-27 20:24:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 84082688. Throughput: 0: 9948.7, 1: 9838.0. Samples: 84073256. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:31,175][105115] Avg episode reward: [(0, '-5.192'), (1, '-6.523')] [2023-12-27 20:24:31,213][106226] Updated weights for policy 0, policy_version 164092 (0.0008) [2023-12-27 20:24:31,748][106225] Updated weights for policy 1, policy_version 164328 (0.0008) [2023-12-27 20:24:31,810][106225] Updated weights for policy 1, policy_version 164338 (0.0008) [2023-12-27 20:24:31,873][106225] Updated weights for policy 1, policy_version 164348 (0.0008) [2023-12-27 20:24:31,940][106226] Updated weights for policy 0, policy_version 164102 (0.0006) [2023-12-27 20:24:31,998][106226] Updated weights for policy 0, policy_version 164112 (0.0005) [2023-12-27 20:24:32,068][106226] Updated weights for policy 0, policy_version 164122 (0.0006) [2023-12-27 20:24:32,600][106225] Updated weights for policy 1, policy_version 164358 (0.0008) [2023-12-27 20:24:32,665][106225] Updated weights for policy 1, policy_version 164368 (0.0008) [2023-12-27 20:24:32,703][106226] Updated weights for policy 0, policy_version 164132 (0.0008) [2023-12-27 20:24:32,721][106225] Updated weights for policy 1, policy_version 164378 (0.0006) [2023-12-27 20:24:32,758][106226] Updated weights for policy 0, policy_version 164142 (0.0007) [2023-12-27 20:24:32,819][106226] Updated weights for policy 0, policy_version 164152 (0.0008) [2023-12-27 20:24:33,330][106225] Updated weights for policy 1, policy_version 164388 (0.0008) [2023-12-27 20:24:33,387][106225] Updated weights for policy 1, policy_version 164398 (0.0005) [2023-12-27 20:24:33,445][106225] Updated weights for policy 1, policy_version 164408 (0.0005) [2023-12-27 20:24:33,588][106226] Updated weights for policy 0, policy_version 164162 (0.0008) [2023-12-27 20:24:33,644][106226] Updated weights for policy 0, policy_version 164172 (0.0009) [2023-12-27 20:24:33,695][106226] Updated weights for policy 0, policy_version 164182 (0.0008) [2023-12-27 20:24:33,753][106226] Updated weights for policy 0, policy_version 164192 (0.0008) [2023-12-27 20:24:34,079][106225] Updated weights for policy 1, policy_version 164418 (0.0008) [2023-12-27 20:24:34,137][106225] Updated weights for policy 1, policy_version 164428 (0.0008) [2023-12-27 20:24:34,202][106225] Updated weights for policy 1, policy_version 164438 (0.0009) [2023-12-27 20:24:34,264][106225] Updated weights for policy 1, policy_version 164448 (0.0008) [2023-12-27 20:24:34,496][106226] Updated weights for policy 0, policy_version 164202 (0.0008) [2023-12-27 20:24:34,550][106226] Updated weights for policy 0, policy_version 164212 (0.0008) [2023-12-27 20:24:34,606][106226] Updated weights for policy 0, policy_version 164222 (0.0009) [2023-12-27 20:24:34,963][106225] Updated weights for policy 1, policy_version 164458 (0.0005) [2023-12-27 20:24:35,024][106225] Updated weights for policy 1, policy_version 164468 (0.0006) [2023-12-27 20:24:35,080][106225] Updated weights for policy 1, policy_version 164478 (0.0008) [2023-12-27 20:24:35,368][106226] Updated weights for policy 0, policy_version 164232 (0.0008) [2023-12-27 20:24:35,423][106226] Updated weights for policy 0, policy_version 164242 (0.0008) [2023-12-27 20:24:35,485][106226] Updated weights for policy 0, policy_version 164252 (0.0009) [2023-12-27 20:24:35,778][106225] Updated weights for policy 1, policy_version 164488 (0.0008) [2023-12-27 20:24:35,836][106225] Updated weights for policy 1, policy_version 164498 (0.0009) [2023-12-27 20:24:35,899][106225] Updated weights for policy 1, policy_version 164508 (0.0007) [2023-12-27 20:24:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 84180992. Throughput: 0: 9886.9, 1: 9833.7. Samples: 84191444. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:36,175][105115] Avg episode reward: [(0, '-5.165'), (1, '-6.729')] [2023-12-27 20:24:36,183][106226] Updated weights for policy 0, policy_version 164262 (0.0008) [2023-12-27 20:24:36,241][106226] Updated weights for policy 0, policy_version 164272 (0.0007) [2023-12-27 20:24:36,296][106226] Updated weights for policy 0, policy_version 164282 (0.0008) [2023-12-27 20:24:36,603][106225] Updated weights for policy 1, policy_version 164518 (0.0009) [2023-12-27 20:24:36,662][106225] Updated weights for policy 1, policy_version 164528 (0.0011) [2023-12-27 20:24:36,719][106225] Updated weights for policy 1, policy_version 164538 (0.0010) [2023-12-27 20:24:36,977][106226] Updated weights for policy 0, policy_version 164292 (0.0008) [2023-12-27 20:24:37,037][106226] Updated weights for policy 0, policy_version 164302 (0.0010) [2023-12-27 20:24:37,101][106226] Updated weights for policy 0, policy_version 164312 (0.0011) [2023-12-27 20:24:37,392][106225] Updated weights for policy 1, policy_version 164548 (0.0008) [2023-12-27 20:24:37,440][106225] Updated weights for policy 1, policy_version 164558 (0.0009) [2023-12-27 20:24:37,488][106225] Updated weights for policy 1, policy_version 164568 (0.0007) [2023-12-27 20:24:37,714][106226] Updated weights for policy 0, policy_version 164322 (0.0008) [2023-12-27 20:24:37,772][106226] Updated weights for policy 0, policy_version 164332 (0.0007) [2023-12-27 20:24:37,830][106226] Updated weights for policy 0, policy_version 164342 (0.0011) [2023-12-27 20:24:37,890][106226] Updated weights for policy 0, policy_version 164352 (0.0008) [2023-12-27 20:24:38,149][106225] Updated weights for policy 1, policy_version 164578 (0.0007) [2023-12-27 20:24:38,209][106225] Updated weights for policy 1, policy_version 164588 (0.0007) [2023-12-27 20:24:38,267][106225] Updated weights for policy 1, policy_version 164598 (0.0008) [2023-12-27 20:24:38,326][106225] Updated weights for policy 1, policy_version 164608 (0.0008) [2023-12-27 20:24:38,553][106226] Updated weights for policy 0, policy_version 164362 (0.0009) [2023-12-27 20:24:38,607][106226] Updated weights for policy 0, policy_version 164372 (0.0009) [2023-12-27 20:24:38,671][106226] Updated weights for policy 0, policy_version 164382 (0.0009) [2023-12-27 20:24:39,081][106225] Updated weights for policy 1, policy_version 164618 (0.0005) [2023-12-27 20:24:39,139][106225] Updated weights for policy 1, policy_version 164628 (0.0005) [2023-12-27 20:24:39,195][106225] Updated weights for policy 1, policy_version 164638 (0.0010) [2023-12-27 20:24:39,457][106226] Updated weights for policy 0, policy_version 164392 (0.0010) [2023-12-27 20:24:39,526][106226] Updated weights for policy 0, policy_version 164402 (0.0011) [2023-12-27 20:24:39,590][106226] Updated weights for policy 0, policy_version 164412 (0.0011) [2023-12-27 20:24:39,945][106225] Updated weights for policy 1, policy_version 164648 (0.0008) [2023-12-27 20:24:40,003][106225] Updated weights for policy 1, policy_version 164658 (0.0008) [2023-12-27 20:24:40,058][106225] Updated weights for policy 1, policy_version 164668 (0.0008) [2023-12-27 20:24:40,307][106226] Updated weights for policy 0, policy_version 164422 (0.0010) [2023-12-27 20:24:40,373][106226] Updated weights for policy 0, policy_version 164432 (0.0011) [2023-12-27 20:24:40,427][106226] Updated weights for policy 0, policy_version 164442 (0.0011) [2023-12-27 20:24:40,820][106225] Updated weights for policy 1, policy_version 164678 (0.0008) [2023-12-27 20:24:40,870][106225] Updated weights for policy 1, policy_version 164688 (0.0009) [2023-12-27 20:24:40,921][106225] Updated weights for policy 1, policy_version 164698 (0.0008) [2023-12-27 20:24:41,075][106226] Updated weights for policy 0, policy_version 164452 (0.0009) [2023-12-27 20:24:41,143][106226] Updated weights for policy 0, policy_version 164462 (0.0009) [2023-12-27 20:24:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 84279296. Throughput: 0: 9883.9, 1: 9854.1. Samples: 84251576. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:41,175][105115] Avg episode reward: [(0, '-5.359'), (1, '-5.886')] [2023-12-27 20:24:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000164704_42172416.pth... [2023-12-27 20:24:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000163552_41877504.pth [2023-12-27 20:24:41,212][106226] Updated weights for policy 0, policy_version 164472 (0.0007) [2023-12-27 20:24:41,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000164480_42115072.pth... [2023-12-27 20:24:41,272][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000163328_41820160.pth [2023-12-27 20:24:41,717][106225] Updated weights for policy 1, policy_version 164708 (0.0009) [2023-12-27 20:24:41,788][106225] Updated weights for policy 1, policy_version 164718 (0.0008) [2023-12-27 20:24:41,856][106225] Updated weights for policy 1, policy_version 164728 (0.0009) [2023-12-27 20:24:41,939][106226] Updated weights for policy 0, policy_version 164482 (0.0007) [2023-12-27 20:24:41,995][106226] Updated weights for policy 0, policy_version 164492 (0.0009) [2023-12-27 20:24:42,059][106226] Updated weights for policy 0, policy_version 164502 (0.0008) [2023-12-27 20:24:42,119][106226] Updated weights for policy 0, policy_version 164512 (0.0009) [2023-12-27 20:24:42,657][106225] Updated weights for policy 1, policy_version 164738 (0.0008) [2023-12-27 20:24:42,720][106225] Updated weights for policy 1, policy_version 164748 (0.0008) [2023-12-27 20:24:42,781][106225] Updated weights for policy 1, policy_version 164758 (0.0007) [2023-12-27 20:24:42,811][106226] Updated weights for policy 0, policy_version 164522 (0.0008) [2023-12-27 20:24:42,843][106225] Updated weights for policy 1, policy_version 164768 (0.0007) [2023-12-27 20:24:42,874][106226] Updated weights for policy 0, policy_version 164532 (0.0007) [2023-12-27 20:24:42,934][106226] Updated weights for policy 0, policy_version 164542 (0.0009) [2023-12-27 20:24:43,578][106225] Updated weights for policy 1, policy_version 164778 (0.0008) [2023-12-27 20:24:43,624][106226] Updated weights for policy 0, policy_version 164552 (0.0010) [2023-12-27 20:24:43,633][106225] Updated weights for policy 1, policy_version 164788 (0.0009) [2023-12-27 20:24:43,674][106226] Updated weights for policy 0, policy_version 164562 (0.0010) [2023-12-27 20:24:43,695][106225] Updated weights for policy 1, policy_version 164798 (0.0007) [2023-12-27 20:24:43,727][106226] Updated weights for policy 0, policy_version 164572 (0.0010) [2023-12-27 20:24:44,415][106225] Updated weights for policy 1, policy_version 164808 (0.0008) [2023-12-27 20:24:44,467][106226] Updated weights for policy 0, policy_version 164582 (0.0009) [2023-12-27 20:24:44,473][106225] Updated weights for policy 1, policy_version 164818 (0.0006) [2023-12-27 20:24:44,511][106226] Updated weights for policy 0, policy_version 164592 (0.0007) [2023-12-27 20:24:44,527][106225] Updated weights for policy 1, policy_version 164828 (0.0007) [2023-12-27 20:24:44,562][106226] Updated weights for policy 0, policy_version 164602 (0.0005) [2023-12-27 20:24:45,287][106226] Updated weights for policy 0, policy_version 164612 (0.0009) [2023-12-27 20:24:45,314][106225] Updated weights for policy 1, policy_version 164838 (0.0008) [2023-12-27 20:24:45,347][106226] Updated weights for policy 0, policy_version 164622 (0.0009) [2023-12-27 20:24:45,371][106225] Updated weights for policy 1, policy_version 164848 (0.0006) [2023-12-27 20:24:45,400][106226] Updated weights for policy 0, policy_version 164632 (0.0008) [2023-12-27 20:24:45,426][106225] Updated weights for policy 1, policy_version 164858 (0.0007) [2023-12-27 20:24:46,047][106226] Updated weights for policy 0, policy_version 164642 (0.0006) [2023-12-27 20:24:46,099][106226] Updated weights for policy 0, policy_version 164652 (0.0005) [2023-12-27 20:24:46,152][106226] Updated weights for policy 0, policy_version 164662 (0.0005) [2023-12-27 20:24:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 84369408. Throughput: 0: 9868.2, 1: 9745.5. Samples: 84365952. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:46,176][105115] Avg episode reward: [(0, '-5.677'), (1, '-6.444')] [2023-12-27 20:24:46,196][106225] Updated weights for policy 1, policy_version 164868 (0.0008) [2023-12-27 20:24:46,215][106226] Updated weights for policy 0, policy_version 164672 (0.0006) [2023-12-27 20:24:46,255][106225] Updated weights for policy 1, policy_version 164878 (0.0009) [2023-12-27 20:24:46,314][106225] Updated weights for policy 1, policy_version 164888 (0.0008) [2023-12-27 20:24:46,730][106226] Updated weights for policy 0, policy_version 164682 (0.0008) [2023-12-27 20:24:46,778][106226] Updated weights for policy 0, policy_version 164692 (0.0005) [2023-12-27 20:24:46,829][106226] Updated weights for policy 0, policy_version 164702 (0.0008) [2023-12-27 20:24:47,123][106225] Updated weights for policy 1, policy_version 164898 (0.0008) [2023-12-27 20:24:47,187][106225] Updated weights for policy 1, policy_version 164908 (0.0006) [2023-12-27 20:24:47,245][106225] Updated weights for policy 1, policy_version 164918 (0.0006) [2023-12-27 20:24:47,315][106225] Updated weights for policy 1, policy_version 164928 (0.0008) [2023-12-27 20:24:47,478][106226] Updated weights for policy 0, policy_version 164712 (0.0007) [2023-12-27 20:24:47,542][106226] Updated weights for policy 0, policy_version 164722 (0.0005) [2023-12-27 20:24:47,611][106226] Updated weights for policy 0, policy_version 164732 (0.0007) [2023-12-27 20:24:47,838][106225] Updated weights for policy 1, policy_version 164938 (0.0009) [2023-12-27 20:24:47,887][106225] Updated weights for policy 1, policy_version 164948 (0.0009) [2023-12-27 20:24:47,940][106225] Updated weights for policy 1, policy_version 164958 (0.0008) [2023-12-27 20:24:48,156][106226] Updated weights for policy 0, policy_version 164742 (0.0007) [2023-12-27 20:24:48,207][106226] Updated weights for policy 0, policy_version 164752 (0.0007) [2023-12-27 20:24:48,262][106226] Updated weights for policy 0, policy_version 164762 (0.0006) [2023-12-27 20:24:48,755][106225] Updated weights for policy 1, policy_version 164968 (0.0008) [2023-12-27 20:24:48,813][106225] Updated weights for policy 1, policy_version 164978 (0.0007) [2023-12-27 20:24:48,873][106225] Updated weights for policy 1, policy_version 164988 (0.0008) [2023-12-27 20:24:48,927][106226] Updated weights for policy 0, policy_version 164772 (0.0011) [2023-12-27 20:24:48,984][106226] Updated weights for policy 0, policy_version 164782 (0.0010) [2023-12-27 20:24:49,041][106226] Updated weights for policy 0, policy_version 164792 (0.0011) [2023-12-27 20:24:49,590][106225] Updated weights for policy 1, policy_version 164998 (0.0009) [2023-12-27 20:24:49,647][106225] Updated weights for policy 1, policy_version 165008 (0.0008) [2023-12-27 20:24:49,708][106225] Updated weights for policy 1, policy_version 165018 (0.0008) [2023-12-27 20:24:49,769][106226] Updated weights for policy 0, policy_version 164802 (0.0011) [2023-12-27 20:24:49,834][106226] Updated weights for policy 0, policy_version 164812 (0.0011) [2023-12-27 20:24:49,893][106226] Updated weights for policy 0, policy_version 164822 (0.0011) [2023-12-27 20:24:49,958][106226] Updated weights for policy 0, policy_version 164832 (0.0009) [2023-12-27 20:24:50,472][106225] Updated weights for policy 1, policy_version 165028 (0.0008) [2023-12-27 20:24:50,531][106225] Updated weights for policy 1, policy_version 165038 (0.0009) [2023-12-27 20:24:50,592][106225] Updated weights for policy 1, policy_version 165048 (0.0007) [2023-12-27 20:24:50,636][106226] Updated weights for policy 0, policy_version 164842 (0.0009) [2023-12-27 20:24:50,697][106226] Updated weights for policy 0, policy_version 164852 (0.0010) [2023-12-27 20:24:50,761][106226] Updated weights for policy 0, policy_version 164862 (0.0011) [2023-12-27 20:24:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 84475904. Throughput: 0: 9902.3, 1: 9653.5. Samples: 84485592. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:51,175][105115] Avg episode reward: [(0, '-5.258'), (1, '-6.460')] [2023-12-27 20:24:51,404][106225] Updated weights for policy 1, policy_version 165058 (0.0008) [2023-12-27 20:24:51,476][106225] Updated weights for policy 1, policy_version 165068 (0.0008) [2023-12-27 20:24:51,509][106226] Updated weights for policy 0, policy_version 164872 (0.0011) [2023-12-27 20:24:51,538][106225] Updated weights for policy 1, policy_version 165078 (0.0008) [2023-12-27 20:24:51,562][106226] Updated weights for policy 0, policy_version 164882 (0.0010) [2023-12-27 20:24:51,602][106225] Updated weights for policy 1, policy_version 165088 (0.0007) [2023-12-27 20:24:51,626][106226] Updated weights for policy 0, policy_version 164892 (0.0010) [2023-12-27 20:24:52,329][106225] Updated weights for policy 1, policy_version 165098 (0.0008) [2023-12-27 20:24:52,398][106226] Updated weights for policy 0, policy_version 164902 (0.0008) [2023-12-27 20:24:52,400][106225] Updated weights for policy 1, policy_version 165108 (0.0007) [2023-12-27 20:24:52,461][106226] Updated weights for policy 0, policy_version 164912 (0.0007) [2023-12-27 20:24:52,464][106225] Updated weights for policy 1, policy_version 165118 (0.0006) [2023-12-27 20:24:52,521][106226] Updated weights for policy 0, policy_version 164922 (0.0008) [2023-12-27 20:24:53,120][106225] Updated weights for policy 1, policy_version 165128 (0.0009) [2023-12-27 20:24:53,182][106225] Updated weights for policy 1, policy_version 165138 (0.0008) [2023-12-27 20:24:53,240][106225] Updated weights for policy 1, policy_version 165148 (0.0008) [2023-12-27 20:24:53,268][106226] Updated weights for policy 0, policy_version 164932 (0.0008) [2023-12-27 20:24:53,326][106226] Updated weights for policy 0, policy_version 164942 (0.0009) [2023-12-27 20:24:53,388][106226] Updated weights for policy 0, policy_version 164952 (0.0008) [2023-12-27 20:24:53,890][106225] Updated weights for policy 1, policy_version 165158 (0.0007) [2023-12-27 20:24:53,948][106225] Updated weights for policy 1, policy_version 165168 (0.0008) [2023-12-27 20:24:53,999][106225] Updated weights for policy 1, policy_version 165178 (0.0008) [2023-12-27 20:24:54,044][106226] Updated weights for policy 0, policy_version 164962 (0.0006) [2023-12-27 20:24:54,103][106226] Updated weights for policy 0, policy_version 164972 (0.0008) [2023-12-27 20:24:54,152][106226] Updated weights for policy 0, policy_version 164982 (0.0008) [2023-12-27 20:24:54,210][106226] Updated weights for policy 0, policy_version 164992 (0.0008) [2023-12-27 20:24:54,704][106225] Updated weights for policy 1, policy_version 165188 (0.0007) [2023-12-27 20:24:54,750][106225] Updated weights for policy 1, policy_version 165198 (0.0005) [2023-12-27 20:24:54,798][106225] Updated weights for policy 1, policy_version 165208 (0.0008) [2023-12-27 20:24:54,825][106226] Updated weights for policy 0, policy_version 165002 (0.0005) [2023-12-27 20:24:54,876][106226] Updated weights for policy 0, policy_version 165012 (0.0006) [2023-12-27 20:24:54,938][106226] Updated weights for policy 0, policy_version 165022 (0.0009) [2023-12-27 20:24:55,463][106225] Updated weights for policy 1, policy_version 165218 (0.0009) [2023-12-27 20:24:55,517][106225] Updated weights for policy 1, policy_version 165228 (0.0008) [2023-12-27 20:24:55,570][106225] Updated weights for policy 1, policy_version 165238 (0.0008) [2023-12-27 20:24:55,629][106225] Updated weights for policy 1, policy_version 165248 (0.0008) [2023-12-27 20:24:55,633][106226] Updated weights for policy 0, policy_version 165032 (0.0006) [2023-12-27 20:24:55,695][106226] Updated weights for policy 0, policy_version 165042 (0.0005) [2023-12-27 20:24:55,760][106226] Updated weights for policy 0, policy_version 165052 (0.0005) [2023-12-27 20:24:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 84574208. Throughput: 0: 9882.8, 1: 9660.5. Samples: 84543764. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:24:56,176][105115] Avg episode reward: [(0, '-5.313'), (1, '-6.158')] [2023-12-27 20:24:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000165248_42311680.pth... [2023-12-27 20:24:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000165056_42262528.pth... [2023-12-27 20:24:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000164128_42024960.pth [2023-12-27 20:24:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000163904_41967616.pth [2023-12-27 20:24:56,344][106226] Updated weights for policy 0, policy_version 165062 (0.0008) [2023-12-27 20:24:56,405][106226] Updated weights for policy 0, policy_version 165072 (0.0007) [2023-12-27 20:24:56,429][106225] Updated weights for policy 1, policy_version 165258 (0.0010) [2023-12-27 20:24:56,458][106226] Updated weights for policy 0, policy_version 165082 (0.0006) [2023-12-27 20:24:56,489][106225] Updated weights for policy 1, policy_version 165268 (0.0009) [2023-12-27 20:24:56,535][106225] Updated weights for policy 1, policy_version 165278 (0.0010) [2023-12-27 20:24:57,045][106226] Updated weights for policy 0, policy_version 165092 (0.0007) [2023-12-27 20:24:57,103][106226] Updated weights for policy 0, policy_version 165102 (0.0008) [2023-12-27 20:24:57,143][106225] Updated weights for policy 1, policy_version 165288 (0.0010) [2023-12-27 20:24:57,150][106226] Updated weights for policy 0, policy_version 165112 (0.0006) [2023-12-27 20:24:57,195][106225] Updated weights for policy 1, policy_version 165298 (0.0010) [2023-12-27 20:24:57,248][106225] Updated weights for policy 1, policy_version 165308 (0.0010) [2023-12-27 20:24:57,866][106226] Updated weights for policy 0, policy_version 165122 (0.0006) [2023-12-27 20:24:57,916][106226] Updated weights for policy 0, policy_version 165132 (0.0008) [2023-12-27 20:24:57,976][106225] Updated weights for policy 1, policy_version 165318 (0.0010) [2023-12-27 20:24:57,977][106226] Updated weights for policy 0, policy_version 165142 (0.0006) [2023-12-27 20:24:58,035][106226] Updated weights for policy 0, policy_version 165152 (0.0005) [2023-12-27 20:24:58,037][106225] Updated weights for policy 1, policy_version 165328 (0.0010) [2023-12-27 20:24:58,087][106225] Updated weights for policy 1, policy_version 165338 (0.0010) [2023-12-27 20:24:58,843][106226] Updated weights for policy 0, policy_version 165162 (0.0015) [2023-12-27 20:24:58,865][106225] Updated weights for policy 1, policy_version 165348 (0.0009) [2023-12-27 20:24:58,921][106226] Updated weights for policy 0, policy_version 165173 (0.0008) [2023-12-27 20:24:58,937][106225] Updated weights for policy 1, policy_version 165358 (0.0007) [2023-12-27 20:24:58,994][106226] Updated weights for policy 0, policy_version 165183 (0.0010) [2023-12-27 20:24:59,014][106225] Updated weights for policy 1, policy_version 165368 (0.0009) [2023-12-27 20:24:59,754][106225] Updated weights for policy 1, policy_version 165378 (0.0006) [2023-12-27 20:24:59,782][106226] Updated weights for policy 0, policy_version 165193 (0.0010) [2023-12-27 20:24:59,806][106225] Updated weights for policy 1, policy_version 165388 (0.0005) [2023-12-27 20:24:59,836][106226] Updated weights for policy 0, policy_version 165203 (0.0010) [2023-12-27 20:24:59,873][106225] Updated weights for policy 1, policy_version 165398 (0.0008) [2023-12-27 20:24:59,898][106226] Updated weights for policy 0, policy_version 165213 (0.0010) [2023-12-27 20:24:59,930][106225] Updated weights for policy 1, policy_version 165408 (0.0006) [2023-12-27 20:25:00,481][106225] Updated weights for policy 1, policy_version 165418 (0.0005) [2023-12-27 20:25:00,534][106225] Updated weights for policy 1, policy_version 165428 (0.0005) [2023-12-27 20:25:00,593][106225] Updated weights for policy 1, policy_version 165438 (0.0005) [2023-12-27 20:25:00,615][106226] Updated weights for policy 0, policy_version 165223 (0.0011) [2023-12-27 20:25:00,662][106226] Updated weights for policy 0, policy_version 165233 (0.0005) [2023-12-27 20:25:00,714][106226] Updated weights for policy 0, policy_version 165243 (0.0006) [2023-12-27 20:25:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 84672512. Throughput: 0: 9974.9, 1: 9685.3. Samples: 84662680. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:25:01,175][105115] Avg episode reward: [(0, '-5.296'), (1, '-6.408')] [2023-12-27 20:25:01,177][106225] Updated weights for policy 1, policy_version 165448 (0.0008) [2023-12-27 20:25:01,234][106225] Updated weights for policy 1, policy_version 165458 (0.0009) [2023-12-27 20:25:01,291][106225] Updated weights for policy 1, policy_version 165468 (0.0008) [2023-12-27 20:25:01,377][106226] Updated weights for policy 0, policy_version 165253 (0.0008) [2023-12-27 20:25:01,434][106226] Updated weights for policy 0, policy_version 165263 (0.0010) [2023-12-27 20:25:01,488][106226] Updated weights for policy 0, policy_version 165273 (0.0006) [2023-12-27 20:25:01,974][106225] Updated weights for policy 1, policy_version 165478 (0.0007) [2023-12-27 20:25:02,035][106225] Updated weights for policy 1, policy_version 165488 (0.0008) [2023-12-27 20:25:02,101][106225] Updated weights for policy 1, policy_version 165498 (0.0008) [2023-12-27 20:25:02,126][106226] Updated weights for policy 0, policy_version 165283 (0.0006) [2023-12-27 20:25:02,184][106226] Updated weights for policy 0, policy_version 165293 (0.0007) [2023-12-27 20:25:02,243][106226] Updated weights for policy 0, policy_version 165303 (0.0008) [2023-12-27 20:25:02,804][106225] Updated weights for policy 1, policy_version 165508 (0.0009) [2023-12-27 20:25:02,866][106225] Updated weights for policy 1, policy_version 165518 (0.0009) [2023-12-27 20:25:02,921][106225] Updated weights for policy 1, policy_version 165528 (0.0008) [2023-12-27 20:25:02,952][106226] Updated weights for policy 0, policy_version 165313 (0.0008) [2023-12-27 20:25:03,011][106226] Updated weights for policy 0, policy_version 165323 (0.0008) [2023-12-27 20:25:03,077][106226] Updated weights for policy 0, policy_version 165333 (0.0008) [2023-12-27 20:25:03,142][106226] Updated weights for policy 0, policy_version 165343 (0.0008) [2023-12-27 20:25:03,632][106225] Updated weights for policy 1, policy_version 165538 (0.0008) [2023-12-27 20:25:03,692][106225] Updated weights for policy 1, policy_version 165548 (0.0010) [2023-12-27 20:25:03,745][106225] Updated weights for policy 1, policy_version 165558 (0.0010) [2023-12-27 20:25:03,803][106225] Updated weights for policy 1, policy_version 165568 (0.0010) [2023-12-27 20:25:03,872][106226] Updated weights for policy 0, policy_version 165353 (0.0009) [2023-12-27 20:25:03,933][106226] Updated weights for policy 0, policy_version 165363 (0.0009) [2023-12-27 20:25:04,000][106226] Updated weights for policy 0, policy_version 165373 (0.0007) [2023-12-27 20:25:04,519][106225] Updated weights for policy 1, policy_version 165578 (0.0009) [2023-12-27 20:25:04,580][106225] Updated weights for policy 1, policy_version 165588 (0.0007) [2023-12-27 20:25:04,630][106225] Updated weights for policy 1, policy_version 165598 (0.0007) [2023-12-27 20:25:04,653][106226] Updated weights for policy 0, policy_version 165383 (0.0008) [2023-12-27 20:25:04,712][106226] Updated weights for policy 0, policy_version 165393 (0.0007) [2023-12-27 20:25:04,767][106226] Updated weights for policy 0, policy_version 165403 (0.0005) [2023-12-27 20:25:05,388][106226] Updated weights for policy 0, policy_version 165413 (0.0007) [2023-12-27 20:25:05,406][106225] Updated weights for policy 1, policy_version 165608 (0.0006) [2023-12-27 20:25:05,452][106226] Updated weights for policy 0, policy_version 165423 (0.0008) [2023-12-27 20:25:05,454][106225] Updated weights for policy 1, policy_version 165618 (0.0005) [2023-12-27 20:25:05,506][106226] Updated weights for policy 0, policy_version 165433 (0.0008) [2023-12-27 20:25:05,506][106225] Updated weights for policy 1, policy_version 165628 (0.0007) [2023-12-27 20:25:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 84770816. Throughput: 0: 10058.7, 1: 9735.8. Samples: 84784760. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:25:06,175][105115] Avg episode reward: [(0, '-5.444'), (1, '-6.390')] [2023-12-27 20:25:06,181][106226] Updated weights for policy 0, policy_version 165443 (0.0009) [2023-12-27 20:25:06,243][106226] Updated weights for policy 0, policy_version 165453 (0.0011) [2023-12-27 20:25:06,273][106225] Updated weights for policy 1, policy_version 165638 (0.0008) [2023-12-27 20:25:06,298][106226] Updated weights for policy 0, policy_version 165463 (0.0011) [2023-12-27 20:25:06,336][106225] Updated weights for policy 1, policy_version 165648 (0.0006) [2023-12-27 20:25:06,393][106225] Updated weights for policy 1, policy_version 165658 (0.0007) [2023-12-27 20:25:07,030][106226] Updated weights for policy 0, policy_version 165473 (0.0011) [2023-12-27 20:25:07,076][106226] Updated weights for policy 0, policy_version 165483 (0.0010) [2023-12-27 20:25:07,128][106226] Updated weights for policy 0, policy_version 165493 (0.0011) [2023-12-27 20:25:07,130][106225] Updated weights for policy 1, policy_version 165668 (0.0008) [2023-12-27 20:25:07,185][106226] Updated weights for policy 0, policy_version 165503 (0.0011) [2023-12-27 20:25:07,188][106225] Updated weights for policy 1, policy_version 165678 (0.0005) [2023-12-27 20:25:07,249][106225] Updated weights for policy 1, policy_version 165688 (0.0008) [2023-12-27 20:25:07,892][106226] Updated weights for policy 0, policy_version 165513 (0.0011) [2023-12-27 20:25:07,949][106225] Updated weights for policy 1, policy_version 165698 (0.0007) [2023-12-27 20:25:07,954][106226] Updated weights for policy 0, policy_version 165523 (0.0010) [2023-12-27 20:25:08,004][106225] Updated weights for policy 1, policy_version 165708 (0.0007) [2023-12-27 20:25:08,010][106226] Updated weights for policy 0, policy_version 165533 (0.0007) [2023-12-27 20:25:08,059][106225] Updated weights for policy 1, policy_version 165718 (0.0008) [2023-12-27 20:25:08,112][106225] Updated weights for policy 1, policy_version 165728 (0.0009) [2023-12-27 20:25:08,720][106226] Updated weights for policy 0, policy_version 165543 (0.0006) [2023-12-27 20:25:08,774][106226] Updated weights for policy 0, policy_version 165553 (0.0005) [2023-12-27 20:25:08,832][106226] Updated weights for policy 0, policy_version 165563 (0.0006) [2023-12-27 20:25:08,840][106225] Updated weights for policy 1, policy_version 165738 (0.0008) [2023-12-27 20:25:08,908][106225] Updated weights for policy 1, policy_version 165748 (0.0007) [2023-12-27 20:25:08,972][106225] Updated weights for policy 1, policy_version 165758 (0.0008) [2023-12-27 20:25:09,612][106226] Updated weights for policy 0, policy_version 165573 (0.0006) [2023-12-27 20:25:09,664][106225] Updated weights for policy 1, policy_version 165768 (0.0007) [2023-12-27 20:25:09,686][106226] Updated weights for policy 0, policy_version 165584 (0.0011) [2023-12-27 20:25:09,730][106225] Updated weights for policy 1, policy_version 165778 (0.0006) [2023-12-27 20:25:09,749][106226] Updated weights for policy 0, policy_version 165594 (0.0008) [2023-12-27 20:25:09,788][106225] Updated weights for policy 1, policy_version 165788 (0.0007) [2023-12-27 20:25:10,440][106226] Updated weights for policy 0, policy_version 165604 (0.0008) [2023-12-27 20:25:10,501][106226] Updated weights for policy 0, policy_version 165614 (0.0008) [2023-12-27 20:25:10,523][106225] Updated weights for policy 1, policy_version 165798 (0.0007) [2023-12-27 20:25:10,564][106226] Updated weights for policy 0, policy_version 165624 (0.0007) [2023-12-27 20:25:10,574][106225] Updated weights for policy 1, policy_version 165808 (0.0005) [2023-12-27 20:25:10,623][106225] Updated weights for policy 1, policy_version 165818 (0.0008) [2023-12-27 20:25:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 84869120. Throughput: 0: 10022.4, 1: 9806.1. Samples: 84843744. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:25:11,175][105115] Avg episode reward: [(0, '-5.555'), (1, '-6.394')] [2023-12-27 20:25:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000165824_42459136.pth... [2023-12-27 20:25:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000165632_42409984.pth... [2023-12-27 20:25:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000164704_42172416.pth [2023-12-27 20:25:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000164480_42115072.pth [2023-12-27 20:25:11,319][106226] Updated weights for policy 0, policy_version 165634 (0.0008) [2023-12-27 20:25:11,380][106225] Updated weights for policy 1, policy_version 165828 (0.0008) [2023-12-27 20:25:11,397][106226] Updated weights for policy 0, policy_version 165644 (0.0008) [2023-12-27 20:25:11,444][106225] Updated weights for policy 1, policy_version 165838 (0.0007) [2023-12-27 20:25:11,462][106226] Updated weights for policy 0, policy_version 165655 (0.0008) [2023-12-27 20:25:11,507][106225] Updated weights for policy 1, policy_version 165848 (0.0008) [2023-12-27 20:25:12,186][106225] Updated weights for policy 1, policy_version 165858 (0.0008) [2023-12-27 20:25:12,242][106225] Updated weights for policy 1, policy_version 165868 (0.0008) [2023-12-27 20:25:12,270][106226] Updated weights for policy 0, policy_version 165665 (0.0007) [2023-12-27 20:25:12,309][106225] Updated weights for policy 1, policy_version 165878 (0.0008) [2023-12-27 20:25:12,335][106226] Updated weights for policy 0, policy_version 165675 (0.0006) [2023-12-27 20:25:12,376][106225] Updated weights for policy 1, policy_version 165888 (0.0008) [2023-12-27 20:25:12,400][106226] Updated weights for policy 0, policy_version 165685 (0.0008) [2023-12-27 20:25:12,458][106226] Updated weights for policy 0, policy_version 165695 (0.0009) [2023-12-27 20:25:13,072][106225] Updated weights for policy 1, policy_version 165898 (0.0008) [2023-12-27 20:25:13,126][106225] Updated weights for policy 1, policy_version 165908 (0.0008) [2023-12-27 20:25:13,181][106225] Updated weights for policy 1, policy_version 165918 (0.0007) [2023-12-27 20:25:13,199][106226] Updated weights for policy 0, policy_version 165705 (0.0008) [2023-12-27 20:25:13,252][106226] Updated weights for policy 0, policy_version 165715 (0.0008) [2023-12-27 20:25:13,312][106226] Updated weights for policy 0, policy_version 165725 (0.0009) [2023-12-27 20:25:13,936][106225] Updated weights for policy 1, policy_version 165928 (0.0005) [2023-12-27 20:25:13,990][106225] Updated weights for policy 1, policy_version 165938 (0.0005) [2023-12-27 20:25:14,020][106226] Updated weights for policy 0, policy_version 165735 (0.0009) [2023-12-27 20:25:14,041][106225] Updated weights for policy 1, policy_version 165948 (0.0005) [2023-12-27 20:25:14,076][106226] Updated weights for policy 0, policy_version 165745 (0.0008) [2023-12-27 20:25:14,143][106226] Updated weights for policy 0, policy_version 165755 (0.0008) [2023-12-27 20:25:14,730][106225] Updated weights for policy 1, policy_version 165958 (0.0009) [2023-12-27 20:25:14,808][106225] Updated weights for policy 1, policy_version 165968 (0.0010) [2023-12-27 20:25:14,865][106225] Updated weights for policy 1, policy_version 165978 (0.0010) [2023-12-27 20:25:14,893][106226] Updated weights for policy 0, policy_version 165765 (0.0009) [2023-12-27 20:25:14,958][106226] Updated weights for policy 0, policy_version 165775 (0.0008) [2023-12-27 20:25:15,026][106226] Updated weights for policy 0, policy_version 165785 (0.0008) [2023-12-27 20:25:15,565][106225] Updated weights for policy 1, policy_version 165988 (0.0010) [2023-12-27 20:25:15,625][106225] Updated weights for policy 1, policy_version 165998 (0.0010) [2023-12-27 20:25:15,682][106225] Updated weights for policy 1, policy_version 166008 (0.0008) [2023-12-27 20:25:15,687][106226] Updated weights for policy 0, policy_version 165795 (0.0010) [2023-12-27 20:25:15,734][106226] Updated weights for policy 0, policy_version 165805 (0.0010) [2023-12-27 20:25:15,781][106226] Updated weights for policy 0, policy_version 165815 (0.0010) [2023-12-27 20:25:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 84967424. Throughput: 0: 9931.9, 1: 9709.6. Samples: 84957120. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 20:25:16,175][105115] Avg episode reward: [(0, '-5.495'), (1, '-6.256')] [2023-12-27 20:25:16,298][106225] Updated weights for policy 1, policy_version 166018 (0.0006) [2023-12-27 20:25:16,360][106225] Updated weights for policy 1, policy_version 166028 (0.0006) [2023-12-27 20:25:16,422][106225] Updated weights for policy 1, policy_version 166038 (0.0005) [2023-12-27 20:25:16,483][106225] Updated weights for policy 1, policy_version 166048 (0.0005) [2023-12-27 20:25:16,504][106226] Updated weights for policy 0, policy_version 165825 (0.0010) [2023-12-27 20:25:16,561][106226] Updated weights for policy 0, policy_version 165835 (0.0010) [2023-12-27 20:25:16,614][106226] Updated weights for policy 0, policy_version 165845 (0.0010) [2023-12-27 20:25:16,666][106226] Updated weights for policy 0, policy_version 165855 (0.0010) [2023-12-27 20:25:17,155][106225] Updated weights for policy 1, policy_version 166058 (0.0006) [2023-12-27 20:25:17,203][106225] Updated weights for policy 1, policy_version 166068 (0.0005) [2023-12-27 20:25:17,258][106225] Updated weights for policy 1, policy_version 166078 (0.0005) [2023-12-27 20:25:17,333][106226] Updated weights for policy 0, policy_version 165865 (0.0006) [2023-12-27 20:25:17,394][106226] Updated weights for policy 0, policy_version 165875 (0.0005) [2023-12-27 20:25:17,455][106226] Updated weights for policy 0, policy_version 165885 (0.0005) [2023-12-27 20:25:17,929][106225] Updated weights for policy 1, policy_version 166088 (0.0007) [2023-12-27 20:25:17,979][106225] Updated weights for policy 1, policy_version 166098 (0.0009) [2023-12-27 20:25:18,039][106225] Updated weights for policy 1, policy_version 166108 (0.0009) [2023-12-27 20:25:18,074][106226] Updated weights for policy 0, policy_version 165895 (0.0005) [2023-12-27 20:25:18,132][106226] Updated weights for policy 0, policy_version 165905 (0.0005) [2023-12-27 20:25:18,182][106226] Updated weights for policy 0, policy_version 165915 (0.0005) [2023-12-27 20:25:18,768][106226] Updated weights for policy 0, policy_version 165925 (0.0008) [2023-12-27 20:25:18,790][106225] Updated weights for policy 1, policy_version 166118 (0.0007) [2023-12-27 20:25:18,833][106226] Updated weights for policy 0, policy_version 165935 (0.0011) [2023-12-27 20:25:18,851][106225] Updated weights for policy 1, policy_version 166128 (0.0006) [2023-12-27 20:25:18,894][106226] Updated weights for policy 0, policy_version 165945 (0.0010) [2023-12-27 20:25:18,913][106225] Updated weights for policy 1, policy_version 166138 (0.0008) [2023-12-27 20:25:19,573][106225] Updated weights for policy 1, policy_version 166148 (0.0009) [2023-12-27 20:25:19,631][106225] Updated weights for policy 1, policy_version 166158 (0.0009) [2023-12-27 20:25:19,647][106226] Updated weights for policy 0, policy_version 165955 (0.0009) [2023-12-27 20:25:19,684][106225] Updated weights for policy 1, policy_version 166168 (0.0007) [2023-12-27 20:25:19,709][106226] Updated weights for policy 0, policy_version 165965 (0.0009) [2023-12-27 20:25:19,781][106226] Updated weights for policy 0, policy_version 165975 (0.0008) [2023-12-27 20:25:20,444][106225] Updated weights for policy 1, policy_version 166178 (0.0007) [2023-12-27 20:25:20,499][106225] Updated weights for policy 1, policy_version 166188 (0.0008) [2023-12-27 20:25:20,524][106226] Updated weights for policy 0, policy_version 165985 (0.0009) [2023-12-27 20:25:20,556][106225] Updated weights for policy 1, policy_version 166198 (0.0008) [2023-12-27 20:25:20,585][106226] Updated weights for policy 0, policy_version 165995 (0.0011) [2023-12-27 20:25:20,625][106225] Updated weights for policy 1, policy_version 166208 (0.0008) [2023-12-27 20:25:20,647][106226] Updated weights for policy 0, policy_version 166005 (0.0010) [2023-12-27 20:25:20,710][106226] Updated weights for policy 0, policy_version 166015 (0.0009) [2023-12-27 20:25:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 85065728. Throughput: 0: 9975.0, 1: 9694.8. Samples: 85076580. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:21,175][105115] Avg episode reward: [(0, '-5.538'), (1, '-6.307')] [2023-12-27 20:25:21,416][106225] Updated weights for policy 1, policy_version 166218 (0.0008) [2023-12-27 20:25:21,480][106225] Updated weights for policy 1, policy_version 166228 (0.0007) [2023-12-27 20:25:21,489][106226] Updated weights for policy 0, policy_version 166025 (0.0008) [2023-12-27 20:25:21,545][106225] Updated weights for policy 1, policy_version 166238 (0.0006) [2023-12-27 20:25:21,551][106226] Updated weights for policy 0, policy_version 166035 (0.0009) [2023-12-27 20:25:21,616][106226] Updated weights for policy 0, policy_version 166045 (0.0011) [2023-12-27 20:25:22,385][106225] Updated weights for policy 1, policy_version 166248 (0.0008) [2023-12-27 20:25:22,441][106225] Updated weights for policy 1, policy_version 166258 (0.0009) [2023-12-27 20:25:22,451][106226] Updated weights for policy 0, policy_version 166055 (0.0009) [2023-12-27 20:25:22,498][106225] Updated weights for policy 1, policy_version 166268 (0.0009) [2023-12-27 20:25:22,508][106226] Updated weights for policy 0, policy_version 166065 (0.0009) [2023-12-27 20:25:22,560][106226] Updated weights for policy 0, policy_version 166076 (0.0009) [2023-12-27 20:25:23,246][106226] Updated weights for policy 0, policy_version 166086 (0.0010) [2023-12-27 20:25:23,248][106225] Updated weights for policy 1, policy_version 166278 (0.0007) [2023-12-27 20:25:23,303][106225] Updated weights for policy 1, policy_version 166288 (0.0010) [2023-12-27 20:25:23,305][106226] Updated weights for policy 0, policy_version 166096 (0.0010) [2023-12-27 20:25:23,360][106225] Updated weights for policy 1, policy_version 166298 (0.0010) [2023-12-27 20:25:23,365][106226] Updated weights for policy 0, policy_version 166106 (0.0010) [2023-12-27 20:25:23,977][106225] Updated weights for policy 1, policy_version 166308 (0.0008) [2023-12-27 20:25:24,023][106225] Updated weights for policy 1, policy_version 166318 (0.0005) [2023-12-27 20:25:24,070][106225] Updated weights for policy 1, policy_version 166328 (0.0005) [2023-12-27 20:25:24,083][106226] Updated weights for policy 0, policy_version 166116 (0.0010) [2023-12-27 20:25:24,144][106226] Updated weights for policy 0, policy_version 166126 (0.0011) [2023-12-27 20:25:24,201][106226] Updated weights for policy 0, policy_version 166136 (0.0008) [2023-12-27 20:25:24,652][106225] Updated weights for policy 1, policy_version 166338 (0.0006) [2023-12-27 20:25:24,705][106225] Updated weights for policy 1, policy_version 166348 (0.0006) [2023-12-27 20:25:24,754][106225] Updated weights for policy 1, policy_version 166358 (0.0010) [2023-12-27 20:25:24,801][106225] Updated weights for policy 1, policy_version 166368 (0.0010) [2023-12-27 20:25:24,896][106226] Updated weights for policy 0, policy_version 166146 (0.0008) [2023-12-27 20:25:24,953][106226] Updated weights for policy 0, policy_version 166156 (0.0007) [2023-12-27 20:25:25,009][106226] Updated weights for policy 0, policy_version 166166 (0.0005) [2023-12-27 20:25:25,058][106226] Updated weights for policy 0, policy_version 166176 (0.0006) [2023-12-27 20:25:25,513][106225] Updated weights for policy 1, policy_version 166378 (0.0010) [2023-12-27 20:25:25,569][106225] Updated weights for policy 1, policy_version 166388 (0.0010) [2023-12-27 20:25:25,629][106225] Updated weights for policy 1, policy_version 166398 (0.0010) [2023-12-27 20:25:25,752][106226] Updated weights for policy 0, policy_version 166186 (0.0008) [2023-12-27 20:25:25,812][106226] Updated weights for policy 0, policy_version 166196 (0.0008) [2023-12-27 20:25:25,868][106226] Updated weights for policy 0, policy_version 166206 (0.0008) [2023-12-27 20:25:26,175][105115] Fps is (10 sec: 19659.8, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 85164032. Throughput: 0: 9925.0, 1: 9642.5. Samples: 85132120. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:26,176][105115] Avg episode reward: [(0, '-5.483'), (1, '-6.629')] [2023-12-27 20:25:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000166400_42606592.pth... [2023-12-27 20:25:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000166208_42557440.pth... [2023-12-27 20:25:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000165248_42311680.pth [2023-12-27 20:25:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000165056_42262528.pth [2023-12-27 20:25:26,349][106225] Updated weights for policy 1, policy_version 166408 (0.0010) [2023-12-27 20:25:26,406][106225] Updated weights for policy 1, policy_version 166418 (0.0010) [2023-12-27 20:25:26,463][106225] Updated weights for policy 1, policy_version 166428 (0.0010) [2023-12-27 20:25:26,583][106226] Updated weights for policy 0, policy_version 166216 (0.0008) [2023-12-27 20:25:26,636][106226] Updated weights for policy 0, policy_version 166226 (0.0008) [2023-12-27 20:25:26,689][106226] Updated weights for policy 0, policy_version 166236 (0.0009) [2023-12-27 20:25:27,075][106225] Updated weights for policy 1, policy_version 166438 (0.0010) [2023-12-27 20:25:27,118][106225] Updated weights for policy 1, policy_version 166448 (0.0010) [2023-12-27 20:25:27,169][106225] Updated weights for policy 1, policy_version 166458 (0.0010) [2023-12-27 20:25:27,347][106226] Updated weights for policy 0, policy_version 166246 (0.0007) [2023-12-27 20:25:27,394][106226] Updated weights for policy 0, policy_version 166256 (0.0007) [2023-12-27 20:25:27,448][106226] Updated weights for policy 0, policy_version 166266 (0.0007) [2023-12-27 20:25:27,809][106225] Updated weights for policy 1, policy_version 166468 (0.0010) [2023-12-27 20:25:27,857][106225] Updated weights for policy 1, policy_version 166479 (0.0008) [2023-12-27 20:25:27,906][106225] Updated weights for policy 1, policy_version 166489 (0.0008) [2023-12-27 20:25:28,059][106226] Updated weights for policy 0, policy_version 166276 (0.0008) [2023-12-27 20:25:28,109][106226] Updated weights for policy 0, policy_version 166286 (0.0008) [2023-12-27 20:25:28,162][106226] Updated weights for policy 0, policy_version 166296 (0.0009) [2023-12-27 20:25:28,612][106225] Updated weights for policy 1, policy_version 166499 (0.0008) [2023-12-27 20:25:28,668][106225] Updated weights for policy 1, policy_version 166509 (0.0006) [2023-12-27 20:25:28,729][106225] Updated weights for policy 1, policy_version 166519 (0.0007) [2023-12-27 20:25:28,850][106226] Updated weights for policy 0, policy_version 166306 (0.0007) [2023-12-27 20:25:28,911][106226] Updated weights for policy 0, policy_version 166316 (0.0008) [2023-12-27 20:25:28,975][106226] Updated weights for policy 0, policy_version 166326 (0.0009) [2023-12-27 20:25:29,035][106226] Updated weights for policy 0, policy_version 166336 (0.0007) [2023-12-27 20:25:29,437][106225] Updated weights for policy 1, policy_version 166529 (0.0008) [2023-12-27 20:25:29,500][106225] Updated weights for policy 1, policy_version 166539 (0.0008) [2023-12-27 20:25:29,563][106225] Updated weights for policy 1, policy_version 166549 (0.0008) [2023-12-27 20:25:29,624][106225] Updated weights for policy 1, policy_version 166559 (0.0008) [2023-12-27 20:25:29,774][106226] Updated weights for policy 0, policy_version 166346 (0.0009) [2023-12-27 20:25:29,840][106226] Updated weights for policy 0, policy_version 166356 (0.0009) [2023-12-27 20:25:29,903][106226] Updated weights for policy 0, policy_version 166366 (0.0009) [2023-12-27 20:25:30,294][106225] Updated weights for policy 1, policy_version 166569 (0.0008) [2023-12-27 20:25:30,351][106225] Updated weights for policy 1, policy_version 166579 (0.0008) [2023-12-27 20:25:30,413][106225] Updated weights for policy 1, policy_version 166589 (0.0008) [2023-12-27 20:25:30,584][106226] Updated weights for policy 0, policy_version 166376 (0.0008) [2023-12-27 20:25:30,642][106226] Updated weights for policy 0, policy_version 166386 (0.0008) [2023-12-27 20:25:30,699][106226] Updated weights for policy 0, policy_version 166396 (0.0009) [2023-12-27 20:25:31,093][106225] Updated weights for policy 1, policy_version 166599 (0.0007) [2023-12-27 20:25:31,155][106225] Updated weights for policy 1, policy_version 166609 (0.0009) [2023-12-27 20:25:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 85262336. Throughput: 0: 9953.3, 1: 9806.5. Samples: 85255140. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:31,175][105115] Avg episode reward: [(0, '-5.308'), (1, '-6.819')] [2023-12-27 20:25:31,216][106225] Updated weights for policy 1, policy_version 166619 (0.0008) [2023-12-27 20:25:31,366][106226] Updated weights for policy 0, policy_version 166406 (0.0008) [2023-12-27 20:25:31,430][106226] Updated weights for policy 0, policy_version 166416 (0.0008) [2023-12-27 20:25:31,480][106226] Updated weights for policy 0, policy_version 166426 (0.0008) [2023-12-27 20:25:31,936][106225] Updated weights for policy 1, policy_version 166629 (0.0006) [2023-12-27 20:25:31,996][106225] Updated weights for policy 1, policy_version 166639 (0.0009) [2023-12-27 20:25:32,041][106225] Updated weights for policy 1, policy_version 166649 (0.0008) [2023-12-27 20:25:32,271][106226] Updated weights for policy 0, policy_version 166436 (0.0008) [2023-12-27 20:25:32,335][106226] Updated weights for policy 0, policy_version 166446 (0.0008) [2023-12-27 20:25:32,400][106226] Updated weights for policy 0, policy_version 166456 (0.0009) [2023-12-27 20:25:32,802][106225] Updated weights for policy 1, policy_version 166659 (0.0009) [2023-12-27 20:25:32,859][106225] Updated weights for policy 1, policy_version 166669 (0.0008) [2023-12-27 20:25:32,905][106225] Updated weights for policy 1, policy_version 166679 (0.0008) [2023-12-27 20:25:33,149][106226] Updated weights for policy 0, policy_version 166466 (0.0008) [2023-12-27 20:25:33,201][106226] Updated weights for policy 0, policy_version 166476 (0.0008) [2023-12-27 20:25:33,261][106226] Updated weights for policy 0, policy_version 166486 (0.0008) [2023-12-27 20:25:33,316][106226] Updated weights for policy 0, policy_version 166496 (0.0007) [2023-12-27 20:25:33,638][106225] Updated weights for policy 1, policy_version 166689 (0.0009) [2023-12-27 20:25:33,696][106225] Updated weights for policy 1, policy_version 166699 (0.0009) [2023-12-27 20:25:33,758][106225] Updated weights for policy 1, policy_version 166710 (0.0010) [2023-12-27 20:25:33,805][106225] Updated weights for policy 1, policy_version 166720 (0.0008) [2023-12-27 20:25:33,856][106226] Updated weights for policy 0, policy_version 166506 (0.0008) [2023-12-27 20:25:33,916][106226] Updated weights for policy 0, policy_version 166516 (0.0008) [2023-12-27 20:25:33,974][106226] Updated weights for policy 0, policy_version 166526 (0.0008) [2023-12-27 20:25:34,548][106225] Updated weights for policy 1, policy_version 166730 (0.0010) [2023-12-27 20:25:34,617][106225] Updated weights for policy 1, policy_version 166740 (0.0010) [2023-12-27 20:25:34,683][106225] Updated weights for policy 1, policy_version 166750 (0.0010) [2023-12-27 20:25:34,731][106226] Updated weights for policy 0, policy_version 166536 (0.0008) [2023-12-27 20:25:34,795][106226] Updated weights for policy 0, policy_version 166546 (0.0006) [2023-12-27 20:25:34,862][106226] Updated weights for policy 0, policy_version 166556 (0.0005) [2023-12-27 20:25:35,368][106225] Updated weights for policy 1, policy_version 166760 (0.0010) [2023-12-27 20:25:35,427][106225] Updated weights for policy 1, policy_version 166770 (0.0010) [2023-12-27 20:25:35,490][106225] Updated weights for policy 1, policy_version 166780 (0.0010) [2023-12-27 20:25:35,497][106226] Updated weights for policy 0, policy_version 166566 (0.0007) [2023-12-27 20:25:35,550][106226] Updated weights for policy 0, policy_version 166576 (0.0005) [2023-12-27 20:25:35,610][106226] Updated weights for policy 0, policy_version 166586 (0.0008) [2023-12-27 20:25:36,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 85360640. Throughput: 0: 9882.6, 1: 9863.4. Samples: 85374164. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:36,175][105115] Avg episode reward: [(0, '-5.082'), (1, '-6.299')] [2023-12-27 20:25:36,204][106225] Updated weights for policy 1, policy_version 166790 (0.0009) [2023-12-27 20:25:36,264][106225] Updated weights for policy 1, policy_version 166800 (0.0009) [2023-12-27 20:25:36,264][106226] Updated weights for policy 0, policy_version 166596 (0.0007) [2023-12-27 20:25:36,327][106226] Updated weights for policy 0, policy_version 166606 (0.0008) [2023-12-27 20:25:36,329][106225] Updated weights for policy 1, policy_version 166810 (0.0010) [2023-12-27 20:25:36,392][106226] Updated weights for policy 0, policy_version 166616 (0.0007) [2023-12-27 20:25:37,045][106225] Updated weights for policy 1, policy_version 166820 (0.0009) [2023-12-27 20:25:37,085][106226] Updated weights for policy 0, policy_version 166626 (0.0007) [2023-12-27 20:25:37,096][106225] Updated weights for policy 1, policy_version 166830 (0.0007) [2023-12-27 20:25:37,144][106225] Updated weights for policy 1, policy_version 166840 (0.0007) [2023-12-27 20:25:37,148][106226] Updated weights for policy 0, policy_version 166636 (0.0006) [2023-12-27 20:25:37,215][106226] Updated weights for policy 0, policy_version 166646 (0.0006) [2023-12-27 20:25:37,278][106226] Updated weights for policy 0, policy_version 166656 (0.0009) [2023-12-27 20:25:37,822][106225] Updated weights for policy 1, policy_version 166850 (0.0009) [2023-12-27 20:25:37,877][106225] Updated weights for policy 1, policy_version 166860 (0.0005) [2023-12-27 20:25:37,927][106225] Updated weights for policy 1, policy_version 166870 (0.0005) [2023-12-27 20:25:37,993][106225] Updated weights for policy 1, policy_version 166880 (0.0005) [2023-12-27 20:25:38,007][106226] Updated weights for policy 0, policy_version 166666 (0.0010) [2023-12-27 20:25:38,067][106226] Updated weights for policy 0, policy_version 166676 (0.0009) [2023-12-27 20:25:38,118][106226] Updated weights for policy 0, policy_version 166686 (0.0008) [2023-12-27 20:25:38,616][106225] Updated weights for policy 1, policy_version 166890 (0.0011) [2023-12-27 20:25:38,675][106225] Updated weights for policy 1, policy_version 166900 (0.0011) [2023-12-27 20:25:38,741][106225] Updated weights for policy 1, policy_version 166910 (0.0010) [2023-12-27 20:25:38,805][106226] Updated weights for policy 0, policy_version 166696 (0.0008) [2023-12-27 20:25:38,864][106226] Updated weights for policy 0, policy_version 166706 (0.0008) [2023-12-27 20:25:38,918][106226] Updated weights for policy 0, policy_version 166716 (0.0008) [2023-12-27 20:25:39,503][106225] Updated weights for policy 1, policy_version 166920 (0.0010) [2023-12-27 20:25:39,569][106225] Updated weights for policy 1, policy_version 166930 (0.0011) [2023-12-27 20:25:39,623][106225] Updated weights for policy 1, policy_version 166940 (0.0010) [2023-12-27 20:25:39,699][106226] Updated weights for policy 0, policy_version 166726 (0.0007) [2023-12-27 20:25:39,768][106226] Updated weights for policy 0, policy_version 166736 (0.0007) [2023-12-27 20:25:39,836][106226] Updated weights for policy 0, policy_version 166746 (0.0010) [2023-12-27 20:25:40,406][106225] Updated weights for policy 1, policy_version 166950 (0.0010) [2023-12-27 20:25:40,463][106225] Updated weights for policy 1, policy_version 166960 (0.0010) [2023-12-27 20:25:40,531][106225] Updated weights for policy 1, policy_version 166970 (0.0010) [2023-12-27 20:25:40,612][106226] Updated weights for policy 0, policy_version 166756 (0.0009) [2023-12-27 20:25:40,668][106226] Updated weights for policy 0, policy_version 166766 (0.0008) [2023-12-27 20:25:40,731][106226] Updated weights for policy 0, policy_version 166776 (0.0008) [2023-12-27 20:25:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 85458944. Throughput: 0: 9882.9, 1: 9887.2. Samples: 85433416. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:41,175][105115] Avg episode reward: [(0, '-5.415'), (1, '-6.296')] [2023-12-27 20:25:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000166784_42704896.pth... [2023-12-27 20:25:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000166976_42754048.pth... [2023-12-27 20:25:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000165632_42409984.pth [2023-12-27 20:25:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000165824_42459136.pth [2023-12-27 20:25:41,313][106225] Updated weights for policy 1, policy_version 166980 (0.0008) [2023-12-27 20:25:41,392][106225] Updated weights for policy 1, policy_version 166990 (0.0008) [2023-12-27 20:25:41,435][106226] Updated weights for policy 0, policy_version 166786 (0.0008) [2023-12-27 20:25:41,445][106225] Updated weights for policy 1, policy_version 167000 (0.0007) [2023-12-27 20:25:41,499][106226] Updated weights for policy 0, policy_version 166796 (0.0006) [2023-12-27 20:25:41,556][106226] Updated weights for policy 0, policy_version 166806 (0.0009) [2023-12-27 20:25:41,619][106226] Updated weights for policy 0, policy_version 166816 (0.0009) [2023-12-27 20:25:42,180][106225] Updated weights for policy 1, policy_version 167010 (0.0007) [2023-12-27 20:25:42,243][106225] Updated weights for policy 1, policy_version 167020 (0.0008) [2023-12-27 20:25:42,308][106225] Updated weights for policy 1, policy_version 167030 (0.0008) [2023-12-27 20:25:42,379][106225] Updated weights for policy 1, policy_version 167040 (0.0008) [2023-12-27 20:25:42,418][106226] Updated weights for policy 0, policy_version 166826 (0.0008) [2023-12-27 20:25:42,485][106226] Updated weights for policy 0, policy_version 166836 (0.0010) [2023-12-27 20:25:42,541][106226] Updated weights for policy 0, policy_version 166846 (0.0008) [2023-12-27 20:25:43,037][106225] Updated weights for policy 1, policy_version 167050 (0.0007) [2023-12-27 20:25:43,099][106225] Updated weights for policy 1, policy_version 167060 (0.0009) [2023-12-27 20:25:43,162][106225] Updated weights for policy 1, policy_version 167070 (0.0008) [2023-12-27 20:25:43,199][106226] Updated weights for policy 0, policy_version 166856 (0.0006) [2023-12-27 20:25:43,257][106226] Updated weights for policy 0, policy_version 166866 (0.0005) [2023-12-27 20:25:43,322][106226] Updated weights for policy 0, policy_version 166876 (0.0005) [2023-12-27 20:25:43,751][106225] Updated weights for policy 1, policy_version 167080 (0.0007) [2023-12-27 20:25:43,803][106225] Updated weights for policy 1, policy_version 167090 (0.0009) [2023-12-27 20:25:43,823][106226] Updated weights for policy 0, policy_version 166886 (0.0005) [2023-12-27 20:25:43,848][106225] Updated weights for policy 1, policy_version 167100 (0.0008) [2023-12-27 20:25:43,880][106226] Updated weights for policy 0, policy_version 166896 (0.0005) [2023-12-27 20:25:43,942][106226] Updated weights for policy 0, policy_version 166906 (0.0006) [2023-12-27 20:25:44,547][106225] Updated weights for policy 1, policy_version 167110 (0.0009) [2023-12-27 20:25:44,606][106225] Updated weights for policy 1, policy_version 167120 (0.0009) [2023-12-27 20:25:44,630][106226] Updated weights for policy 0, policy_version 166916 (0.0008) [2023-12-27 20:25:44,659][106225] Updated weights for policy 1, policy_version 167130 (0.0007) [2023-12-27 20:25:44,691][106226] Updated weights for policy 0, policy_version 166926 (0.0011) [2023-12-27 20:25:44,752][106226] Updated weights for policy 0, policy_version 166936 (0.0011) [2023-12-27 20:25:45,426][106226] Updated weights for policy 0, policy_version 166946 (0.0010) [2023-12-27 20:25:45,427][106225] Updated weights for policy 1, policy_version 167140 (0.0008) [2023-12-27 20:25:45,484][106225] Updated weights for policy 1, policy_version 167150 (0.0010) [2023-12-27 20:25:45,488][106226] Updated weights for policy 0, policy_version 166956 (0.0005) [2023-12-27 20:25:45,545][106225] Updated weights for policy 1, policy_version 167160 (0.0010) [2023-12-27 20:25:45,549][106226] Updated weights for policy 0, policy_version 166966 (0.0005) [2023-12-27 20:25:45,614][106226] Updated weights for policy 0, policy_version 166976 (0.0005) [2023-12-27 20:25:46,120][106225] Updated weights for policy 1, policy_version 167170 (0.0009) [2023-12-27 20:25:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 85557248. Throughput: 0: 9851.4, 1: 9872.5. Samples: 85550256. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:46,175][105115] Avg episode reward: [(0, '-5.193'), (1, '-6.345')] [2023-12-27 20:25:46,186][106225] Updated weights for policy 1, policy_version 167180 (0.0005) [2023-12-27 20:25:46,205][106226] Updated weights for policy 0, policy_version 166986 (0.0005) [2023-12-27 20:25:46,250][106225] Updated weights for policy 1, policy_version 167190 (0.0005) [2023-12-27 20:25:46,266][106226] Updated weights for policy 0, policy_version 166996 (0.0009) [2023-12-27 20:25:46,311][106225] Updated weights for policy 1, policy_version 167200 (0.0005) [2023-12-27 20:25:46,318][106226] Updated weights for policy 0, policy_version 167006 (0.0010) [2023-12-27 20:25:46,847][106225] Updated weights for policy 1, policy_version 167210 (0.0005) [2023-12-27 20:25:46,907][106225] Updated weights for policy 1, policy_version 167220 (0.0005) [2023-12-27 20:25:46,965][106225] Updated weights for policy 1, policy_version 167230 (0.0005) [2023-12-27 20:25:47,018][106226] Updated weights for policy 0, policy_version 167016 (0.0007) [2023-12-27 20:25:47,071][106226] Updated weights for policy 0, policy_version 167026 (0.0009) [2023-12-27 20:25:47,133][106226] Updated weights for policy 0, policy_version 167036 (0.0005) [2023-12-27 20:25:47,466][106225] Updated weights for policy 1, policy_version 167240 (0.0008) [2023-12-27 20:25:47,526][106225] Updated weights for policy 1, policy_version 167250 (0.0010) [2023-12-27 20:25:47,583][106225] Updated weights for policy 1, policy_version 167260 (0.0010) [2023-12-27 20:25:47,779][106226] Updated weights for policy 0, policy_version 167046 (0.0006) [2023-12-27 20:25:47,850][106226] Updated weights for policy 0, policy_version 167056 (0.0005) [2023-12-27 20:25:47,907][106226] Updated weights for policy 0, policy_version 167066 (0.0005) [2023-12-27 20:25:48,137][106225] Updated weights for policy 1, policy_version 167270 (0.0010) [2023-12-27 20:25:48,203][106225] Updated weights for policy 1, policy_version 167280 (0.0010) [2023-12-27 20:25:48,273][106225] Updated weights for policy 1, policy_version 167290 (0.0010) [2023-12-27 20:25:48,455][106226] Updated weights for policy 0, policy_version 167076 (0.0006) [2023-12-27 20:25:48,509][106226] Updated weights for policy 0, policy_version 167086 (0.0008) [2023-12-27 20:25:48,564][106226] Updated weights for policy 0, policy_version 167096 (0.0008) [2023-12-27 20:25:48,945][106225] Updated weights for policy 1, policy_version 167300 (0.0008) [2023-12-27 20:25:49,002][106225] Updated weights for policy 1, policy_version 167310 (0.0009) [2023-12-27 20:25:49,063][106225] Updated weights for policy 1, policy_version 167320 (0.0010) [2023-12-27 20:25:49,363][106226] Updated weights for policy 0, policy_version 167106 (0.0008) [2023-12-27 20:25:49,427][106226] Updated weights for policy 0, policy_version 167116 (0.0007) [2023-12-27 20:25:49,482][106226] Updated weights for policy 0, policy_version 167126 (0.0008) [2023-12-27 20:25:49,542][106226] Updated weights for policy 0, policy_version 167136 (0.0008) [2023-12-27 20:25:49,751][106225] Updated weights for policy 1, policy_version 167330 (0.0010) [2023-12-27 20:25:49,823][106225] Updated weights for policy 1, policy_version 167340 (0.0011) [2023-12-27 20:25:49,895][106225] Updated weights for policy 1, policy_version 167350 (0.0011) [2023-12-27 20:25:49,964][106225] Updated weights for policy 1, policy_version 167360 (0.0011) [2023-12-27 20:25:50,296][106226] Updated weights for policy 0, policy_version 167146 (0.0008) [2023-12-27 20:25:50,372][106226] Updated weights for policy 0, policy_version 167156 (0.0008) [2023-12-27 20:25:50,433][106226] Updated weights for policy 0, policy_version 167166 (0.0006) [2023-12-27 20:25:50,602][106225] Updated weights for policy 1, policy_version 167370 (0.0011) [2023-12-27 20:25:50,670][106225] Updated weights for policy 1, policy_version 167380 (0.0009) [2023-12-27 20:25:50,732][106225] Updated weights for policy 1, policy_version 167390 (0.0009) [2023-12-27 20:25:51,155][106226] Updated weights for policy 0, policy_version 167176 (0.0007) [2023-12-27 20:25:51,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 85663744. Throughput: 0: 9845.4, 1: 9981.3. Samples: 85676964. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:51,175][105115] Avg episode reward: [(0, '-5.700'), (1, '-6.383')] [2023-12-27 20:25:51,212][106226] Updated weights for policy 0, policy_version 167186 (0.0008) [2023-12-27 20:25:51,271][106226] Updated weights for policy 0, policy_version 167196 (0.0007) [2023-12-27 20:25:51,412][106225] Updated weights for policy 1, policy_version 167400 (0.0008) [2023-12-27 20:25:51,476][106225] Updated weights for policy 1, policy_version 167410 (0.0006) [2023-12-27 20:25:51,528][106225] Updated weights for policy 1, policy_version 167420 (0.0006) [2023-12-27 20:25:52,075][106226] Updated weights for policy 0, policy_version 167206 (0.0007) [2023-12-27 20:25:52,128][106226] Updated weights for policy 0, policy_version 167216 (0.0009) [2023-12-27 20:25:52,155][106225] Updated weights for policy 1, policy_version 167430 (0.0007) [2023-12-27 20:25:52,183][106226] Updated weights for policy 0, policy_version 167226 (0.0008) [2023-12-27 20:25:52,212][106225] Updated weights for policy 1, policy_version 167440 (0.0006) [2023-12-27 20:25:52,276][106225] Updated weights for policy 1, policy_version 167450 (0.0008) [2023-12-27 20:25:52,855][106226] Updated weights for policy 0, policy_version 167236 (0.0007) [2023-12-27 20:25:52,911][106226] Updated weights for policy 0, policy_version 167246 (0.0008) [2023-12-27 20:25:52,972][106226] Updated weights for policy 0, policy_version 167256 (0.0008) [2023-12-27 20:25:53,048][106225] Updated weights for policy 1, policy_version 167460 (0.0008) [2023-12-27 20:25:53,098][106225] Updated weights for policy 1, policy_version 167470 (0.0009) [2023-12-27 20:25:53,151][106225] Updated weights for policy 1, policy_version 167481 (0.0009) [2023-12-27 20:25:53,594][106226] Updated weights for policy 0, policy_version 167266 (0.0005) [2023-12-27 20:25:53,647][106226] Updated weights for policy 0, policy_version 167276 (0.0005) [2023-12-27 20:25:53,693][106226] Updated weights for policy 0, policy_version 167286 (0.0005) [2023-12-27 20:25:53,748][106226] Updated weights for policy 0, policy_version 167296 (0.0010) [2023-12-27 20:25:53,811][106225] Updated weights for policy 1, policy_version 167491 (0.0008) [2023-12-27 20:25:53,864][106225] Updated weights for policy 1, policy_version 167501 (0.0005) [2023-12-27 20:25:53,912][106225] Updated weights for policy 1, policy_version 167511 (0.0006) [2023-12-27 20:25:54,510][106226] Updated weights for policy 0, policy_version 167306 (0.0009) [2023-12-27 20:25:54,532][106225] Updated weights for policy 1, policy_version 167521 (0.0006) [2023-12-27 20:25:54,574][106226] Updated weights for policy 0, policy_version 167316 (0.0008) [2023-12-27 20:25:54,580][106225] Updated weights for policy 1, policy_version 167531 (0.0007) [2023-12-27 20:25:54,628][106226] Updated weights for policy 0, policy_version 167326 (0.0006) [2023-12-27 20:25:54,635][106225] Updated weights for policy 1, policy_version 167541 (0.0005) [2023-12-27 20:25:54,686][106225] Updated weights for policy 1, policy_version 167551 (0.0008) [2023-12-27 20:25:55,362][106226] Updated weights for policy 0, policy_version 167336 (0.0008) [2023-12-27 20:25:55,407][106225] Updated weights for policy 1, policy_version 167561 (0.0008) [2023-12-27 20:25:55,423][106226] Updated weights for policy 0, policy_version 167346 (0.0010) [2023-12-27 20:25:55,467][106225] Updated weights for policy 1, policy_version 167571 (0.0007) [2023-12-27 20:25:55,477][106226] Updated weights for policy 0, policy_version 167356 (0.0007) [2023-12-27 20:25:55,529][106225] Updated weights for policy 1, policy_version 167581 (0.0008) [2023-12-27 20:25:56,138][106226] Updated weights for policy 0, policy_version 167366 (0.0008) [2023-12-27 20:25:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 85762048. Throughput: 0: 9847.2, 1: 9993.3. Samples: 85736568. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:25:56,175][105115] Avg episode reward: [(0, '-5.078'), (1, '-6.287')] [2023-12-27 20:25:56,180][106225] Updated weights for policy 1, policy_version 167591 (0.0009) [2023-12-27 20:25:56,187][106226] Updated weights for policy 0, policy_version 167376 (0.0006) [2023-12-27 20:25:56,232][106225] Updated weights for policy 1, policy_version 167601 (0.0006) [2023-12-27 20:25:56,248][106226] Updated weights for policy 0, policy_version 167386 (0.0007) [2023-12-27 20:25:56,283][106225] Updated weights for policy 1, policy_version 167611 (0.0005) [2023-12-27 20:25:56,287][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000167392_42860544.pth... [2023-12-27 20:25:56,291][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000166208_42557440.pth [2023-12-27 20:25:56,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000167616_42917888.pth... [2023-12-27 20:25:56,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000166400_42606592.pth [2023-12-27 20:25:56,911][106225] Updated weights for policy 1, policy_version 167621 (0.0005) [2023-12-27 20:25:56,957][106225] Updated weights for policy 1, policy_version 167631 (0.0006) [2023-12-27 20:25:57,004][106225] Updated weights for policy 1, policy_version 167641 (0.0008) [2023-12-27 20:25:57,009][106226] Updated weights for policy 0, policy_version 167396 (0.0007) [2023-12-27 20:25:57,059][106226] Updated weights for policy 0, policy_version 167406 (0.0007) [2023-12-27 20:25:57,109][106226] Updated weights for policy 0, policy_version 167416 (0.0008) [2023-12-27 20:25:57,664][106225] Updated weights for policy 1, policy_version 167651 (0.0006) [2023-12-27 20:25:57,716][106225] Updated weights for policy 1, policy_version 167661 (0.0006) [2023-12-27 20:25:57,769][106225] Updated weights for policy 1, policy_version 167671 (0.0005) [2023-12-27 20:25:57,886][106226] Updated weights for policy 0, policy_version 167426 (0.0009) [2023-12-27 20:25:57,946][106226] Updated weights for policy 0, policy_version 167436 (0.0010) [2023-12-27 20:25:57,999][106226] Updated weights for policy 0, policy_version 167446 (0.0008) [2023-12-27 20:25:58,056][106226] Updated weights for policy 0, policy_version 167456 (0.0009) [2023-12-27 20:25:58,290][106225] Updated weights for policy 1, policy_version 167681 (0.0005) [2023-12-27 20:25:58,371][106225] Updated weights for policy 1, policy_version 167691 (0.0009) [2023-12-27 20:25:58,429][106225] Updated weights for policy 1, policy_version 167701 (0.0008) [2023-12-27 20:25:58,495][106225] Updated weights for policy 1, policy_version 167711 (0.0009) [2023-12-27 20:25:58,940][106226] Updated weights for policy 0, policy_version 167466 (0.0009) [2023-12-27 20:25:59,009][106226] Updated weights for policy 0, policy_version 167476 (0.0006) [2023-12-27 20:25:59,073][106226] Updated weights for policy 0, policy_version 167486 (0.0008) [2023-12-27 20:25:59,339][106225] Updated weights for policy 1, policy_version 167721 (0.0008) [2023-12-27 20:25:59,405][106225] Updated weights for policy 1, policy_version 167731 (0.0009) [2023-12-27 20:25:59,469][106225] Updated weights for policy 1, policy_version 167741 (0.0009) [2023-12-27 20:25:59,786][106226] Updated weights for policy 0, policy_version 167496 (0.0009) [2023-12-27 20:25:59,851][106226] Updated weights for policy 0, policy_version 167506 (0.0009) [2023-12-27 20:25:59,911][106226] Updated weights for policy 0, policy_version 167516 (0.0010) [2023-12-27 20:26:00,216][106225] Updated weights for policy 1, policy_version 167751 (0.0008) [2023-12-27 20:26:00,287][106225] Updated weights for policy 1, policy_version 167761 (0.0009) [2023-12-27 20:26:00,357][106225] Updated weights for policy 1, policy_version 167771 (0.0008) [2023-12-27 20:26:00,611][106226] Updated weights for policy 0, policy_version 167526 (0.0008) [2023-12-27 20:26:00,660][106226] Updated weights for policy 0, policy_version 167536 (0.0008) [2023-12-27 20:26:00,714][106226] Updated weights for policy 0, policy_version 167546 (0.0009) [2023-12-27 20:26:00,902][106225] Updated weights for policy 1, policy_version 167781 (0.0009) [2023-12-27 20:26:00,963][106225] Updated weights for policy 1, policy_version 167791 (0.0009) [2023-12-27 20:26:01,021][106225] Updated weights for policy 1, policy_version 167801 (0.0008) [2023-12-27 20:26:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 85868544. Throughput: 0: 9849.0, 1: 10083.0. Samples: 85854060. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:26:01,175][105115] Avg episode reward: [(0, '-5.018'), (1, '-6.188')] [2023-12-27 20:26:01,428][106226] Updated weights for policy 0, policy_version 167556 (0.0008) [2023-12-27 20:26:01,478][106226] Updated weights for policy 0, policy_version 167566 (0.0005) [2023-12-27 20:26:01,545][106226] Updated weights for policy 0, policy_version 167576 (0.0009) [2023-12-27 20:26:01,819][106225] Updated weights for policy 1, policy_version 167811 (0.0008) [2023-12-27 20:26:01,885][106225] Updated weights for policy 1, policy_version 167821 (0.0005) [2023-12-27 20:26:01,953][106225] Updated weights for policy 1, policy_version 167831 (0.0006) [2023-12-27 20:26:02,251][106226] Updated weights for policy 0, policy_version 167586 (0.0006) [2023-12-27 20:26:02,315][106226] Updated weights for policy 0, policy_version 167596 (0.0008) [2023-12-27 20:26:02,379][106226] Updated weights for policy 0, policy_version 167606 (0.0009) [2023-12-27 20:26:02,448][106226] Updated weights for policy 0, policy_version 167616 (0.0009) [2023-12-27 20:26:02,571][106225] Updated weights for policy 1, policy_version 167841 (0.0006) [2023-12-27 20:26:02,631][106225] Updated weights for policy 1, policy_version 167851 (0.0008) [2023-12-27 20:26:02,683][106225] Updated weights for policy 1, policy_version 167861 (0.0009) [2023-12-27 20:26:02,744][106225] Updated weights for policy 1, policy_version 167871 (0.0012) [2023-12-27 20:26:03,170][106226] Updated weights for policy 0, policy_version 167626 (0.0010) [2023-12-27 20:26:03,234][106226] Updated weights for policy 0, policy_version 167636 (0.0006) [2023-12-27 20:26:03,295][106226] Updated weights for policy 0, policy_version 167646 (0.0005) [2023-12-27 20:26:03,382][106225] Updated weights for policy 1, policy_version 167881 (0.0009) [2023-12-27 20:26:03,427][106225] Updated weights for policy 1, policy_version 167891 (0.0008) [2023-12-27 20:26:03,481][106225] Updated weights for policy 1, policy_version 167901 (0.0008) [2023-12-27 20:26:03,972][106226] Updated weights for policy 0, policy_version 167656 (0.0008) [2023-12-27 20:26:04,021][106226] Updated weights for policy 0, policy_version 167666 (0.0010) [2023-12-27 20:26:04,081][106226] Updated weights for policy 0, policy_version 167676 (0.0008) [2023-12-27 20:26:04,215][106225] Updated weights for policy 1, policy_version 167911 (0.0009) [2023-12-27 20:26:04,286][106225] Updated weights for policy 1, policy_version 167921 (0.0009) [2023-12-27 20:26:04,355][106225] Updated weights for policy 1, policy_version 167931 (0.0008) [2023-12-27 20:26:04,863][106226] Updated weights for policy 0, policy_version 167686 (0.0006) [2023-12-27 20:26:04,913][106226] Updated weights for policy 0, policy_version 167696 (0.0005) [2023-12-27 20:26:04,972][106226] Updated weights for policy 0, policy_version 167706 (0.0006) [2023-12-27 20:26:04,994][106225] Updated weights for policy 1, policy_version 167941 (0.0008) [2023-12-27 20:26:05,042][106225] Updated weights for policy 1, policy_version 167951 (0.0009) [2023-12-27 20:26:05,101][106225] Updated weights for policy 1, policy_version 167962 (0.0011) [2023-12-27 20:26:05,546][106226] Updated weights for policy 0, policy_version 167716 (0.0005) [2023-12-27 20:26:05,598][106226] Updated weights for policy 0, policy_version 167726 (0.0005) [2023-12-27 20:26:05,648][106226] Updated weights for policy 0, policy_version 167736 (0.0005) [2023-12-27 20:26:05,946][106225] Updated weights for policy 1, policy_version 167972 (0.0007) [2023-12-27 20:26:06,011][106225] Updated weights for policy 1, policy_version 167982 (0.0005) [2023-12-27 20:26:06,074][106225] Updated weights for policy 1, policy_version 167992 (0.0005) [2023-12-27 20:26:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 85966848. Throughput: 0: 9877.9, 1: 10112.6. Samples: 85976156. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:26:06,176][106226] Updated weights for policy 0, policy_version 167746 (0.0005) [2023-12-27 20:26:06,175][105115] Avg episode reward: [(0, '-5.778'), (1, '-6.547')] [2023-12-27 20:26:06,242][106226] Updated weights for policy 0, policy_version 167756 (0.0008) [2023-12-27 20:26:06,306][106226] Updated weights for policy 0, policy_version 167766 (0.0008) [2023-12-27 20:26:06,368][106226] Updated weights for policy 0, policy_version 167776 (0.0008) [2023-12-27 20:26:06,717][106225] Updated weights for policy 1, policy_version 168002 (0.0007) [2023-12-27 20:26:06,779][106225] Updated weights for policy 1, policy_version 168012 (0.0009) [2023-12-27 20:26:06,842][106225] Updated weights for policy 1, policy_version 168022 (0.0008) [2023-12-27 20:26:06,892][106225] Updated weights for policy 1, policy_version 168032 (0.0009) [2023-12-27 20:26:07,094][106226] Updated weights for policy 0, policy_version 167786 (0.0008) [2023-12-27 20:26:07,151][106226] Updated weights for policy 0, policy_version 167796 (0.0009) [2023-12-27 20:26:07,199][106226] Updated weights for policy 0, policy_version 167806 (0.0008) [2023-12-27 20:26:07,651][106225] Updated weights for policy 1, policy_version 168042 (0.0008) [2023-12-27 20:26:07,708][106225] Updated weights for policy 1, policy_version 168052 (0.0009) [2023-12-27 20:26:07,760][106225] Updated weights for policy 1, policy_version 168062 (0.0008) [2023-12-27 20:26:07,901][106226] Updated weights for policy 0, policy_version 167816 (0.0009) [2023-12-27 20:26:07,950][106226] Updated weights for policy 0, policy_version 167826 (0.0008) [2023-12-27 20:26:07,999][106226] Updated weights for policy 0, policy_version 167836 (0.0008) [2023-12-27 20:26:08,425][106225] Updated weights for policy 1, policy_version 168072 (0.0010) [2023-12-27 20:26:08,491][106225] Updated weights for policy 1, policy_version 168082 (0.0011) [2023-12-27 20:26:08,552][106225] Updated weights for policy 1, policy_version 168092 (0.0011) [2023-12-27 20:26:08,754][106226] Updated weights for policy 0, policy_version 167846 (0.0009) [2023-12-27 20:26:08,814][106226] Updated weights for policy 0, policy_version 167856 (0.0007) [2023-12-27 20:26:08,872][106226] Updated weights for policy 0, policy_version 167866 (0.0008) [2023-12-27 20:26:09,284][106225] Updated weights for policy 1, policy_version 168102 (0.0010) [2023-12-27 20:26:09,348][106225] Updated weights for policy 1, policy_version 168112 (0.0010) [2023-12-27 20:26:09,426][106225] Updated weights for policy 1, policy_version 168123 (0.0010) [2023-12-27 20:26:09,556][106226] Updated weights for policy 0, policy_version 167876 (0.0007) [2023-12-27 20:26:09,607][106226] Updated weights for policy 0, policy_version 167886 (0.0008) [2023-12-27 20:26:09,658][106226] Updated weights for policy 0, policy_version 167896 (0.0008) [2023-12-27 20:26:10,223][106225] Updated weights for policy 1, policy_version 168133 (0.0010) [2023-12-27 20:26:10,278][106225] Updated weights for policy 1, policy_version 168143 (0.0011) [2023-12-27 20:26:10,334][106225] Updated weights for policy 1, policy_version 168153 (0.0011) [2023-12-27 20:26:10,442][106226] Updated weights for policy 0, policy_version 167906 (0.0008) [2023-12-27 20:26:10,503][106226] Updated weights for policy 0, policy_version 167916 (0.0007) [2023-12-27 20:26:10,567][106226] Updated weights for policy 0, policy_version 167926 (0.0008) [2023-12-27 20:26:10,632][106226] Updated weights for policy 0, policy_version 167936 (0.0008) [2023-12-27 20:26:11,104][106225] Updated weights for policy 1, policy_version 168163 (0.0010) [2023-12-27 20:26:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 86056960. Throughput: 0: 9896.3, 1: 10152.2. Samples: 86034292. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:26:11,175][105115] Avg episode reward: [(0, '-5.662'), (1, '-6.502')] [2023-12-27 20:26:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000167936_42999808.pth... [2023-12-27 20:26:11,183][106225] Updated weights for policy 1, policy_version 168173 (0.0008) [2023-12-27 20:26:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000166784_42704896.pth [2023-12-27 20:26:11,250][106225] Updated weights for policy 1, policy_version 168183 (0.0008) [2023-12-27 20:26:11,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000168192_43065344.pth... [2023-12-27 20:26:11,313][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000166976_42754048.pth [2023-12-27 20:26:11,370][106226] Updated weights for policy 0, policy_version 167946 (0.0008) [2023-12-27 20:26:11,444][106226] Updated weights for policy 0, policy_version 167956 (0.0008) [2023-12-27 20:26:11,509][106226] Updated weights for policy 0, policy_version 167966 (0.0008) [2023-12-27 20:26:12,010][106225] Updated weights for policy 1, policy_version 168193 (0.0009) [2023-12-27 20:26:12,080][106225] Updated weights for policy 1, policy_version 168203 (0.0009) [2023-12-27 20:26:12,133][106225] Updated weights for policy 1, policy_version 168213 (0.0009) [2023-12-27 20:26:12,190][106225] Updated weights for policy 1, policy_version 168223 (0.0009) [2023-12-27 20:26:12,304][106226] Updated weights for policy 0, policy_version 167976 (0.0009) [2023-12-27 20:26:12,375][106226] Updated weights for policy 0, policy_version 167986 (0.0009) [2023-12-27 20:26:12,434][106226] Updated weights for policy 0, policy_version 167996 (0.0008) [2023-12-27 20:26:12,958][106225] Updated weights for policy 1, policy_version 168233 (0.0009) [2023-12-27 20:26:13,022][106225] Updated weights for policy 1, policy_version 168243 (0.0008) [2023-12-27 20:26:13,077][106225] Updated weights for policy 1, policy_version 168253 (0.0007) [2023-12-27 20:26:13,185][106226] Updated weights for policy 0, policy_version 168006 (0.0009) [2023-12-27 20:26:13,232][106226] Updated weights for policy 0, policy_version 168016 (0.0010) [2023-12-27 20:26:13,288][106226] Updated weights for policy 0, policy_version 168026 (0.0010) [2023-12-27 20:26:13,738][106225] Updated weights for policy 1, policy_version 168263 (0.0006) [2023-12-27 20:26:13,789][106225] Updated weights for policy 1, policy_version 168273 (0.0005) [2023-12-27 20:26:13,849][106225] Updated weights for policy 1, policy_version 168283 (0.0005) [2023-12-27 20:26:14,103][106226] Updated weights for policy 0, policy_version 168036 (0.0009) [2023-12-27 20:26:14,158][106226] Updated weights for policy 0, policy_version 168046 (0.0009) [2023-12-27 20:26:14,243][106226] Updated weights for policy 0, policy_version 168056 (0.0006) [2023-12-27 20:26:14,420][106225] Updated weights for policy 1, policy_version 168293 (0.0008) [2023-12-27 20:26:14,476][106225] Updated weights for policy 1, policy_version 168303 (0.0010) [2023-12-27 20:26:14,542][106225] Updated weights for policy 1, policy_version 168313 (0.0010) [2023-12-27 20:26:14,872][106226] Updated weights for policy 0, policy_version 168066 (0.0006) [2023-12-27 20:26:14,935][106226] Updated weights for policy 0, policy_version 168076 (0.0011) [2023-12-27 20:26:15,003][106226] Updated weights for policy 0, policy_version 168086 (0.0011) [2023-12-27 20:26:15,068][106226] Updated weights for policy 0, policy_version 168096 (0.0005) [2023-12-27 20:26:15,241][106225] Updated weights for policy 1, policy_version 168323 (0.0009) [2023-12-27 20:26:15,304][106225] Updated weights for policy 1, policy_version 168333 (0.0005) [2023-12-27 20:26:15,367][106225] Updated weights for policy 1, policy_version 168343 (0.0007) [2023-12-27 20:26:15,691][106226] Updated weights for policy 0, policy_version 168106 (0.0009) [2023-12-27 20:26:15,743][106226] Updated weights for policy 0, policy_version 168116 (0.0006) [2023-12-27 20:26:15,791][106226] Updated weights for policy 0, policy_version 168126 (0.0010) [2023-12-27 20:26:16,045][106225] Updated weights for policy 1, policy_version 168353 (0.0008) [2023-12-27 20:26:16,106][106225] Updated weights for policy 1, policy_version 168363 (0.0010) [2023-12-27 20:26:16,159][106225] Updated weights for policy 1, policy_version 168373 (0.0010) [2023-12-27 20:26:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 86155264. Throughput: 0: 9805.2, 1: 10035.5. Samples: 86147976. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:26:16,176][105115] Avg episode reward: [(0, '-5.618'), (1, '-6.692')] [2023-12-27 20:26:16,212][106225] Updated weights for policy 1, policy_version 168383 (0.0010) [2023-12-27 20:26:16,444][106226] Updated weights for policy 0, policy_version 168136 (0.0006) [2023-12-27 20:26:16,506][106226] Updated weights for policy 0, policy_version 168146 (0.0005) [2023-12-27 20:26:16,571][106226] Updated weights for policy 0, policy_version 168156 (0.0005) [2023-12-27 20:26:16,776][106225] Updated weights for policy 1, policy_version 168393 (0.0007) [2023-12-27 20:26:16,837][106225] Updated weights for policy 1, policy_version 168403 (0.0008) [2023-12-27 20:26:16,892][106225] Updated weights for policy 1, policy_version 168413 (0.0007) [2023-12-27 20:26:17,072][106226] Updated weights for policy 0, policy_version 168166 (0.0006) [2023-12-27 20:26:17,139][106226] Updated weights for policy 0, policy_version 168176 (0.0011) [2023-12-27 20:26:17,195][106226] Updated weights for policy 0, policy_version 168186 (0.0010) [2023-12-27 20:26:17,480][106225] Updated weights for policy 1, policy_version 168423 (0.0006) [2023-12-27 20:26:17,540][106225] Updated weights for policy 1, policy_version 168433 (0.0010) [2023-12-27 20:26:17,606][106225] Updated weights for policy 1, policy_version 168443 (0.0010) [2023-12-27 20:26:17,779][106226] Updated weights for policy 0, policy_version 168196 (0.0007) [2023-12-27 20:26:17,837][106226] Updated weights for policy 0, policy_version 168206 (0.0005) [2023-12-27 20:26:17,898][106226] Updated weights for policy 0, policy_version 168216 (0.0005) [2023-12-27 20:26:18,292][106225] Updated weights for policy 1, policy_version 168453 (0.0011) [2023-12-27 20:26:18,347][106225] Updated weights for policy 1, policy_version 168463 (0.0010) [2023-12-27 20:26:18,412][106225] Updated weights for policy 1, policy_version 168473 (0.0009) [2023-12-27 20:26:18,457][106226] Updated weights for policy 0, policy_version 168226 (0.0006) [2023-12-27 20:26:18,524][106226] Updated weights for policy 0, policy_version 168236 (0.0008) [2023-12-27 20:26:18,591][106226] Updated weights for policy 0, policy_version 168246 (0.0008) [2023-12-27 20:26:18,654][106226] Updated weights for policy 0, policy_version 168256 (0.0011) [2023-12-27 20:26:19,041][106225] Updated weights for policy 1, policy_version 168483 (0.0008) [2023-12-27 20:26:19,089][106225] Updated weights for policy 1, policy_version 168493 (0.0005) [2023-12-27 20:26:19,135][106225] Updated weights for policy 1, policy_version 168503 (0.0005) [2023-12-27 20:26:19,462][106226] Updated weights for policy 0, policy_version 168266 (0.0008) [2023-12-27 20:26:19,530][106226] Updated weights for policy 0, policy_version 168276 (0.0007) [2023-12-27 20:26:19,590][106226] Updated weights for policy 0, policy_version 168286 (0.0008) [2023-12-27 20:26:19,775][106225] Updated weights for policy 1, policy_version 168513 (0.0008) [2023-12-27 20:26:19,841][106225] Updated weights for policy 1, policy_version 168523 (0.0010) [2023-12-27 20:26:19,907][106225] Updated weights for policy 1, policy_version 168533 (0.0009) [2023-12-27 20:26:19,971][106225] Updated weights for policy 1, policy_version 168543 (0.0008) [2023-12-27 20:26:20,366][106226] Updated weights for policy 0, policy_version 168296 (0.0009) [2023-12-27 20:26:20,429][106226] Updated weights for policy 0, policy_version 168306 (0.0008) [2023-12-27 20:26:20,488][106226] Updated weights for policy 0, policy_version 168316 (0.0008) [2023-12-27 20:26:20,737][106225] Updated weights for policy 1, policy_version 168553 (0.0010) [2023-12-27 20:26:20,795][106225] Updated weights for policy 1, policy_version 168563 (0.0008) [2023-12-27 20:26:20,853][106225] Updated weights for policy 1, policy_version 168573 (0.0009) [2023-12-27 20:26:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 86261760. Throughput: 0: 9863.0, 1: 10133.9. Samples: 86274024. Policy #0 lag: (min: 3.0, avg: 4.2, max: 31.0) [2023-12-27 20:26:21,175][105115] Avg episode reward: [(0, '-5.276'), (1, '-6.433')] [2023-12-27 20:26:21,180][106226] Updated weights for policy 0, policy_version 168326 (0.0010) [2023-12-27 20:26:21,240][106226] Updated weights for policy 0, policy_version 168336 (0.0008) [2023-12-27 20:26:21,303][106226] Updated weights for policy 0, policy_version 168346 (0.0007) [2023-12-27 20:26:21,737][106225] Updated weights for policy 1, policy_version 168583 (0.0009) [2023-12-27 20:26:21,803][106225] Updated weights for policy 1, policy_version 168593 (0.0008) [2023-12-27 20:26:21,863][106225] Updated weights for policy 1, policy_version 168603 (0.0008) [2023-12-27 20:26:22,098][106226] Updated weights for policy 0, policy_version 168356 (0.0009) [2023-12-27 20:26:22,163][106226] Updated weights for policy 0, policy_version 168366 (0.0009) [2023-12-27 20:26:22,215][106226] Updated weights for policy 0, policy_version 168376 (0.0008) [2023-12-27 20:26:22,635][106225] Updated weights for policy 1, policy_version 168613 (0.0008) [2023-12-27 20:26:22,698][106225] Updated weights for policy 1, policy_version 168623 (0.0006) [2023-12-27 20:26:22,761][106225] Updated weights for policy 1, policy_version 168633 (0.0007) [2023-12-27 20:26:22,975][106226] Updated weights for policy 0, policy_version 168386 (0.0009) [2023-12-27 20:26:23,040][106226] Updated weights for policy 0, policy_version 168396 (0.0011) [2023-12-27 20:26:23,114][106226] Updated weights for policy 0, policy_version 168406 (0.0011) [2023-12-27 20:26:23,170][106226] Updated weights for policy 0, policy_version 168416 (0.0010) [2023-12-27 20:26:23,441][106225] Updated weights for policy 1, policy_version 168643 (0.0006) [2023-12-27 20:26:23,491][106225] Updated weights for policy 1, policy_version 168653 (0.0008) [2023-12-27 20:26:23,552][106225] Updated weights for policy 1, policy_version 168663 (0.0009) [2023-12-27 20:26:23,876][106226] Updated weights for policy 0, policy_version 168426 (0.0006) [2023-12-27 20:26:23,933][106226] Updated weights for policy 0, policy_version 168436 (0.0011) [2023-12-27 20:26:23,988][106226] Updated weights for policy 0, policy_version 168446 (0.0010) [2023-12-27 20:26:24,189][106225] Updated weights for policy 1, policy_version 168673 (0.0007) [2023-12-27 20:26:24,246][106225] Updated weights for policy 1, policy_version 168683 (0.0008) [2023-12-27 20:26:24,299][106225] Updated weights for policy 1, policy_version 168693 (0.0007) [2023-12-27 20:26:24,345][106225] Updated weights for policy 1, policy_version 168703 (0.0007) [2023-12-27 20:26:24,658][106226] Updated weights for policy 0, policy_version 168456 (0.0010) [2023-12-27 20:26:24,705][106226] Updated weights for policy 0, policy_version 168466 (0.0010) [2023-12-27 20:26:24,762][106226] Updated weights for policy 0, policy_version 168476 (0.0010) [2023-12-27 20:26:25,001][106225] Updated weights for policy 1, policy_version 168713 (0.0007) [2023-12-27 20:26:25,051][106225] Updated weights for policy 1, policy_version 168723 (0.0008) [2023-12-27 20:26:25,098][106225] Updated weights for policy 1, policy_version 168733 (0.0007) [2023-12-27 20:26:25,482][106226] Updated weights for policy 0, policy_version 168486 (0.0007) [2023-12-27 20:26:25,532][106226] Updated weights for policy 0, policy_version 168496 (0.0005) [2023-12-27 20:26:25,588][106226] Updated weights for policy 0, policy_version 168506 (0.0008) [2023-12-27 20:26:25,858][106225] Updated weights for policy 1, policy_version 168743 (0.0008) [2023-12-27 20:26:25,917][106225] Updated weights for policy 1, policy_version 168753 (0.0007) [2023-12-27 20:26:25,976][106225] Updated weights for policy 1, policy_version 168763 (0.0007) [2023-12-27 20:26:26,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19934.0, 300 sec: 19799.7). Total num frames: 86360064. Throughput: 0: 9836.8, 1: 10069.9. Samples: 86329216. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:26,175][105115] Avg episode reward: [(0, '-5.677'), (1, '-6.312')] [2023-12-27 20:26:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000168512_43147264.pth... [2023-12-27 20:26:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000168768_43212800.pth... [2023-12-27 20:26:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000167392_42860544.pth [2023-12-27 20:26:26,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000167616_42917888.pth [2023-12-27 20:26:26,274][106226] Updated weights for policy 0, policy_version 168516 (0.0010) [2023-12-27 20:26:26,328][106226] Updated weights for policy 0, policy_version 168526 (0.0010) [2023-12-27 20:26:26,378][106226] Updated weights for policy 0, policy_version 168536 (0.0010) [2023-12-27 20:26:26,700][106225] Updated weights for policy 1, policy_version 168773 (0.0009) [2023-12-27 20:26:26,756][106225] Updated weights for policy 1, policy_version 168783 (0.0008) [2023-12-27 20:26:26,808][106225] Updated weights for policy 1, policy_version 168793 (0.0005) [2023-12-27 20:26:27,083][106226] Updated weights for policy 0, policy_version 168546 (0.0010) [2023-12-27 20:26:27,135][106226] Updated weights for policy 0, policy_version 168556 (0.0010) [2023-12-27 20:26:27,194][106226] Updated weights for policy 0, policy_version 168566 (0.0010) [2023-12-27 20:26:27,252][106226] Updated weights for policy 0, policy_version 168576 (0.0010) [2023-12-27 20:26:27,367][106225] Updated weights for policy 1, policy_version 168803 (0.0008) [2023-12-27 20:26:27,425][106225] Updated weights for policy 1, policy_version 168813 (0.0008) [2023-12-27 20:26:27,491][106225] Updated weights for policy 1, policy_version 168823 (0.0008) [2023-12-27 20:26:27,915][106226] Updated weights for policy 0, policy_version 168586 (0.0010) [2023-12-27 20:26:27,963][106226] Updated weights for policy 0, policy_version 168596 (0.0010) [2023-12-27 20:26:28,020][106225] Updated weights for policy 1, policy_version 168833 (0.0006) [2023-12-27 20:26:28,022][106226] Updated weights for policy 0, policy_version 168606 (0.0010) [2023-12-27 20:26:28,068][106225] Updated weights for policy 1, policy_version 168843 (0.0005) [2023-12-27 20:26:28,125][106225] Updated weights for policy 1, policy_version 168853 (0.0005) [2023-12-27 20:26:28,187][106225] Updated weights for policy 1, policy_version 168863 (0.0007) [2023-12-27 20:26:28,712][106226] Updated weights for policy 0, policy_version 168616 (0.0006) [2023-12-27 20:26:28,774][106226] Updated weights for policy 0, policy_version 168626 (0.0009) [2023-12-27 20:26:28,837][106226] Updated weights for policy 0, policy_version 168636 (0.0010) [2023-12-27 20:26:28,857][106225] Updated weights for policy 1, policy_version 168873 (0.0010) [2023-12-27 20:26:28,919][106225] Updated weights for policy 1, policy_version 168883 (0.0010) [2023-12-27 20:26:28,974][106225] Updated weights for policy 1, policy_version 168893 (0.0010) [2023-12-27 20:26:29,494][106226] Updated weights for policy 0, policy_version 168646 (0.0010) [2023-12-27 20:26:29,548][106226] Updated weights for policy 0, policy_version 168656 (0.0009) [2023-12-27 20:26:29,569][106225] Updated weights for policy 1, policy_version 168903 (0.0006) [2023-12-27 20:26:29,604][106226] Updated weights for policy 0, policy_version 168666 (0.0009) [2023-12-27 20:26:29,615][106225] Updated weights for policy 1, policy_version 168913 (0.0007) [2023-12-27 20:26:29,669][106225] Updated weights for policy 1, policy_version 168923 (0.0007) [2023-12-27 20:26:30,338][106226] Updated weights for policy 0, policy_version 168676 (0.0007) [2023-12-27 20:26:30,381][106225] Updated weights for policy 1, policy_version 168933 (0.0010) [2023-12-27 20:26:30,403][106226] Updated weights for policy 0, policy_version 168686 (0.0007) [2023-12-27 20:26:30,441][106225] Updated weights for policy 1, policy_version 168943 (0.0010) [2023-12-27 20:26:30,469][106226] Updated weights for policy 0, policy_version 168696 (0.0008) [2023-12-27 20:26:30,497][106225] Updated weights for policy 1, policy_version 168953 (0.0008) [2023-12-27 20:26:31,080][106225] Updated weights for policy 1, policy_version 168963 (0.0007) [2023-12-27 20:26:31,142][106225] Updated weights for policy 1, policy_version 168973 (0.0010) [2023-12-27 20:26:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 86458368. Throughput: 0: 9864.3, 1: 10216.8. Samples: 86453904. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:31,175][105115] Avg episode reward: [(0, '-5.704'), (1, '-6.108')] [2023-12-27 20:26:31,204][106225] Updated weights for policy 1, policy_version 168983 (0.0011) [2023-12-27 20:26:31,211][106226] Updated weights for policy 0, policy_version 168706 (0.0008) [2023-12-27 20:26:31,273][106226] Updated weights for policy 0, policy_version 168716 (0.0007) [2023-12-27 20:26:31,331][106226] Updated weights for policy 0, policy_version 168726 (0.0008) [2023-12-27 20:26:31,396][106226] Updated weights for policy 0, policy_version 168736 (0.0009) [2023-12-27 20:26:31,862][106225] Updated weights for policy 1, policy_version 168993 (0.0010) [2023-12-27 20:26:31,926][106225] Updated weights for policy 1, policy_version 169003 (0.0006) [2023-12-27 20:26:31,979][106225] Updated weights for policy 1, policy_version 169013 (0.0005) [2023-12-27 20:26:32,026][106225] Updated weights for policy 1, policy_version 169023 (0.0005) [2023-12-27 20:26:32,150][106226] Updated weights for policy 0, policy_version 168746 (0.0007) [2023-12-27 20:26:32,213][106226] Updated weights for policy 0, policy_version 168756 (0.0007) [2023-12-27 20:26:32,280][106226] Updated weights for policy 0, policy_version 168766 (0.0009) [2023-12-27 20:26:32,665][106225] Updated weights for policy 1, policy_version 169033 (0.0009) [2023-12-27 20:26:32,731][106225] Updated weights for policy 1, policy_version 169043 (0.0007) [2023-12-27 20:26:32,799][106225] Updated weights for policy 1, policy_version 169053 (0.0007) [2023-12-27 20:26:33,012][106226] Updated weights for policy 0, policy_version 168776 (0.0008) [2023-12-27 20:26:33,065][106226] Updated weights for policy 0, policy_version 168786 (0.0009) [2023-12-27 20:26:33,110][106226] Updated weights for policy 0, policy_version 168796 (0.0008) [2023-12-27 20:26:33,461][106225] Updated weights for policy 1, policy_version 169063 (0.0006) [2023-12-27 20:26:33,523][106225] Updated weights for policy 1, policy_version 169073 (0.0008) [2023-12-27 20:26:33,582][106225] Updated weights for policy 1, policy_version 169083 (0.0008) [2023-12-27 20:26:33,881][106226] Updated weights for policy 0, policy_version 168806 (0.0009) [2023-12-27 20:26:33,934][106226] Updated weights for policy 0, policy_version 168816 (0.0008) [2023-12-27 20:26:34,001][106226] Updated weights for policy 0, policy_version 168826 (0.0010) [2023-12-27 20:26:34,119][106225] Updated weights for policy 1, policy_version 169093 (0.0006) [2023-12-27 20:26:34,181][106225] Updated weights for policy 1, policy_version 169103 (0.0008) [2023-12-27 20:26:34,237][106225] Updated weights for policy 1, policy_version 169113 (0.0008) [2023-12-27 20:26:34,797][106226] Updated weights for policy 0, policy_version 168836 (0.0009) [2023-12-27 20:26:34,867][106226] Updated weights for policy 0, policy_version 168846 (0.0011) [2023-12-27 20:26:34,922][106226] Updated weights for policy 0, policy_version 168856 (0.0008) [2023-12-27 20:26:34,939][106225] Updated weights for policy 1, policy_version 169123 (0.0009) [2023-12-27 20:26:34,996][106225] Updated weights for policy 1, policy_version 169133 (0.0007) [2023-12-27 20:26:35,052][106225] Updated weights for policy 1, policy_version 169143 (0.0009) [2023-12-27 20:26:35,589][106226] Updated weights for policy 0, policy_version 168866 (0.0007) [2023-12-27 20:26:35,637][106226] Updated weights for policy 0, policy_version 168876 (0.0008) [2023-12-27 20:26:35,694][106226] Updated weights for policy 0, policy_version 168886 (0.0006) [2023-12-27 20:26:35,754][106226] Updated weights for policy 0, policy_version 168896 (0.0006) [2023-12-27 20:26:35,760][106225] Updated weights for policy 1, policy_version 169153 (0.0008) [2023-12-27 20:26:35,822][106225] Updated weights for policy 1, policy_version 169163 (0.0010) [2023-12-27 20:26:35,879][106225] Updated weights for policy 1, policy_version 169173 (0.0010) [2023-12-27 20:26:35,935][106225] Updated weights for policy 1, policy_version 169183 (0.0010) [2023-12-27 20:26:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 86564864. Throughput: 0: 9776.8, 1: 10157.9. Samples: 86574028. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:36,176][105115] Avg episode reward: [(0, '-5.794'), (1, '-6.639')] [2023-12-27 20:26:36,394][106226] Updated weights for policy 0, policy_version 168906 (0.0006) [2023-12-27 20:26:36,458][106226] Updated weights for policy 0, policy_version 168916 (0.0010) [2023-12-27 20:26:36,524][106226] Updated weights for policy 0, policy_version 168926 (0.0011) [2023-12-27 20:26:36,668][106225] Updated weights for policy 1, policy_version 169193 (0.0011) [2023-12-27 20:26:36,721][106225] Updated weights for policy 1, policy_version 169203 (0.0010) [2023-12-27 20:26:36,768][106225] Updated weights for policy 1, policy_version 169213 (0.0010) [2023-12-27 20:26:37,174][106226] Updated weights for policy 0, policy_version 168936 (0.0010) [2023-12-27 20:26:37,223][106226] Updated weights for policy 0, policy_version 168946 (0.0010) [2023-12-27 20:26:37,273][106226] Updated weights for policy 0, policy_version 168956 (0.0010) [2023-12-27 20:26:37,469][106225] Updated weights for policy 1, policy_version 169223 (0.0010) [2023-12-27 20:26:37,516][106225] Updated weights for policy 1, policy_version 169233 (0.0010) [2023-12-27 20:26:37,570][106225] Updated weights for policy 1, policy_version 169243 (0.0010) [2023-12-27 20:26:37,955][106226] Updated weights for policy 0, policy_version 168966 (0.0011) [2023-12-27 20:26:38,015][106226] Updated weights for policy 0, policy_version 168976 (0.0010) [2023-12-27 20:26:38,082][106226] Updated weights for policy 0, policy_version 168986 (0.0011) [2023-12-27 20:26:38,302][106225] Updated weights for policy 1, policy_version 169253 (0.0011) [2023-12-27 20:26:38,362][106225] Updated weights for policy 1, policy_version 169263 (0.0011) [2023-12-27 20:26:38,434][106225] Updated weights for policy 1, policy_version 169273 (0.0009) [2023-12-27 20:26:38,746][106226] Updated weights for policy 0, policy_version 168996 (0.0007) [2023-12-27 20:26:38,805][106226] Updated weights for policy 0, policy_version 169006 (0.0008) [2023-12-27 20:26:38,861][106226] Updated weights for policy 0, policy_version 169016 (0.0008) [2023-12-27 20:26:39,158][106225] Updated weights for policy 1, policy_version 169283 (0.0009) [2023-12-27 20:26:39,209][106225] Updated weights for policy 1, policy_version 169293 (0.0009) [2023-12-27 20:26:39,276][106225] Updated weights for policy 1, policy_version 169303 (0.0009) [2023-12-27 20:26:39,566][106226] Updated weights for policy 0, policy_version 169026 (0.0008) [2023-12-27 20:26:39,626][106226] Updated weights for policy 0, policy_version 169036 (0.0007) [2023-12-27 20:26:39,684][106226] Updated weights for policy 0, policy_version 169046 (0.0008) [2023-12-27 20:26:39,743][106226] Updated weights for policy 0, policy_version 169056 (0.0008) [2023-12-27 20:26:40,080][106225] Updated weights for policy 1, policy_version 169313 (0.0008) [2023-12-27 20:26:40,148][106225] Updated weights for policy 1, policy_version 169323 (0.0010) [2023-12-27 20:26:40,215][106225] Updated weights for policy 1, policy_version 169333 (0.0009) [2023-12-27 20:26:40,273][106225] Updated weights for policy 1, policy_version 169343 (0.0010) [2023-12-27 20:26:40,476][106226] Updated weights for policy 0, policy_version 169066 (0.0008) [2023-12-27 20:26:40,543][106226] Updated weights for policy 0, policy_version 169076 (0.0005) [2023-12-27 20:26:40,598][106226] Updated weights for policy 0, policy_version 169086 (0.0007) [2023-12-27 20:26:40,904][106225] Updated weights for policy 1, policy_version 169353 (0.0006) [2023-12-27 20:26:40,951][106225] Updated weights for policy 1, policy_version 169363 (0.0005) [2023-12-27 20:26:41,016][106225] Updated weights for policy 1, policy_version 169373 (0.0007) [2023-12-27 20:26:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 86663168. Throughput: 0: 9811.3, 1: 10129.1. Samples: 86633892. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:41,175][105115] Avg episode reward: [(0, '-5.459'), (1, '-6.223')] [2023-12-27 20:26:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000169376_43368448.pth... [2023-12-27 20:26:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000169088_43294720.pth... [2023-12-27 20:26:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000168192_43065344.pth [2023-12-27 20:26:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000167936_42999808.pth [2023-12-27 20:26:41,368][106226] Updated weights for policy 0, policy_version 169096 (0.0011) [2023-12-27 20:26:41,433][106226] Updated weights for policy 0, policy_version 169106 (0.0010) [2023-12-27 20:26:41,494][106226] Updated weights for policy 0, policy_version 169116 (0.0011) [2023-12-27 20:26:41,758][106225] Updated weights for policy 1, policy_version 169383 (0.0010) [2023-12-27 20:26:41,828][106225] Updated weights for policy 1, policy_version 169393 (0.0009) [2023-12-27 20:26:41,927][106225] Updated weights for policy 1, policy_version 169403 (0.0008) [2023-12-27 20:26:42,282][106226] Updated weights for policy 0, policy_version 169126 (0.0008) [2023-12-27 20:26:42,349][106226] Updated weights for policy 0, policy_version 169136 (0.0009) [2023-12-27 20:26:42,418][106226] Updated weights for policy 0, policy_version 169146 (0.0008) [2023-12-27 20:26:42,669][106225] Updated weights for policy 1, policy_version 169413 (0.0008) [2023-12-27 20:26:42,717][106225] Updated weights for policy 1, policy_version 169423 (0.0008) [2023-12-27 20:26:42,773][106225] Updated weights for policy 1, policy_version 169433 (0.0008) [2023-12-27 20:26:43,114][106226] Updated weights for policy 0, policy_version 169156 (0.0007) [2023-12-27 20:26:43,162][106226] Updated weights for policy 0, policy_version 169166 (0.0007) [2023-12-27 20:26:43,219][106226] Updated weights for policy 0, policy_version 169176 (0.0007) [2023-12-27 20:26:43,595][106225] Updated weights for policy 1, policy_version 169443 (0.0008) [2023-12-27 20:26:43,650][106225] Updated weights for policy 1, policy_version 169453 (0.0008) [2023-12-27 20:26:43,705][106225] Updated weights for policy 1, policy_version 169463 (0.0008) [2023-12-27 20:26:43,854][106226] Updated weights for policy 0, policy_version 169186 (0.0008) [2023-12-27 20:26:43,916][106226] Updated weights for policy 0, policy_version 169196 (0.0008) [2023-12-27 20:26:43,985][106226] Updated weights for policy 0, policy_version 169206 (0.0008) [2023-12-27 20:26:44,049][106226] Updated weights for policy 0, policy_version 169216 (0.0008) [2023-12-27 20:26:44,402][106225] Updated weights for policy 1, policy_version 169473 (0.0008) [2023-12-27 20:26:44,458][106225] Updated weights for policy 1, policy_version 169483 (0.0010) [2023-12-27 20:26:44,514][106225] Updated weights for policy 1, policy_version 169493 (0.0010) [2023-12-27 20:26:44,570][106225] Updated weights for policy 1, policy_version 169503 (0.0010) [2023-12-27 20:26:44,750][106226] Updated weights for policy 0, policy_version 169226 (0.0009) [2023-12-27 20:26:44,810][106226] Updated weights for policy 0, policy_version 169236 (0.0010) [2023-12-27 20:26:44,866][106226] Updated weights for policy 0, policy_version 169246 (0.0009) [2023-12-27 20:26:45,310][106225] Updated weights for policy 1, policy_version 169513 (0.0009) [2023-12-27 20:26:45,376][106225] Updated weights for policy 1, policy_version 169523 (0.0009) [2023-12-27 20:26:45,439][106225] Updated weights for policy 1, policy_version 169533 (0.0010) [2023-12-27 20:26:45,551][106226] Updated weights for policy 0, policy_version 169256 (0.0006) [2023-12-27 20:26:45,611][106226] Updated weights for policy 0, policy_version 169266 (0.0008) [2023-12-27 20:26:45,671][106226] Updated weights for policy 0, policy_version 169276 (0.0008) [2023-12-27 20:26:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 86753280. Throughput: 0: 9852.6, 1: 10016.3. Samples: 86748160. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:46,175][105115] Avg episode reward: [(0, '-5.276'), (1, '-6.299')] [2023-12-27 20:26:46,188][106225] Updated weights for policy 1, policy_version 169543 (0.0006) [2023-12-27 20:26:46,250][106225] Updated weights for policy 1, policy_version 169553 (0.0008) [2023-12-27 20:26:46,287][106226] Updated weights for policy 0, policy_version 169286 (0.0008) [2023-12-27 20:26:46,314][106225] Updated weights for policy 1, policy_version 169563 (0.0007) [2023-12-27 20:26:46,331][106226] Updated weights for policy 0, policy_version 169296 (0.0007) [2023-12-27 20:26:46,380][106226] Updated weights for policy 0, policy_version 169306 (0.0007) [2023-12-27 20:26:46,859][106225] Updated weights for policy 1, policy_version 169573 (0.0008) [2023-12-27 20:26:46,916][106225] Updated weights for policy 1, policy_version 169583 (0.0008) [2023-12-27 20:26:46,962][106225] Updated weights for policy 1, policy_version 169593 (0.0005) [2023-12-27 20:26:47,077][106226] Updated weights for policy 0, policy_version 169316 (0.0010) [2023-12-27 20:26:47,142][106226] Updated weights for policy 0, policy_version 169326 (0.0010) [2023-12-27 20:26:47,204][106226] Updated weights for policy 0, policy_version 169336 (0.0010) [2023-12-27 20:26:47,588][106225] Updated weights for policy 1, policy_version 169603 (0.0006) [2023-12-27 20:26:47,651][106225] Updated weights for policy 1, policy_version 169613 (0.0006) [2023-12-27 20:26:47,712][106225] Updated weights for policy 1, policy_version 169623 (0.0006) [2023-12-27 20:26:47,864][106226] Updated weights for policy 0, policy_version 169346 (0.0010) [2023-12-27 20:26:47,912][106226] Updated weights for policy 0, policy_version 169356 (0.0007) [2023-12-27 20:26:47,960][106226] Updated weights for policy 0, policy_version 169366 (0.0005) [2023-12-27 20:26:48,014][106226] Updated weights for policy 0, policy_version 169376 (0.0005) [2023-12-27 20:26:48,277][106225] Updated weights for policy 1, policy_version 169633 (0.0010) [2023-12-27 20:26:48,340][106225] Updated weights for policy 1, policy_version 169643 (0.0009) [2023-12-27 20:26:48,410][106225] Updated weights for policy 1, policy_version 169653 (0.0010) [2023-12-27 20:26:48,472][106225] Updated weights for policy 1, policy_version 169663 (0.0010) [2023-12-27 20:26:48,695][106226] Updated weights for policy 0, policy_version 169386 (0.0007) [2023-12-27 20:26:48,757][106226] Updated weights for policy 0, policy_version 169396 (0.0008) [2023-12-27 20:26:48,817][106226] Updated weights for policy 0, policy_version 169406 (0.0007) [2023-12-27 20:26:49,152][106225] Updated weights for policy 1, policy_version 169673 (0.0008) [2023-12-27 20:26:49,204][106225] Updated weights for policy 1, policy_version 169683 (0.0008) [2023-12-27 20:26:49,276][106225] Updated weights for policy 1, policy_version 169693 (0.0006) [2023-12-27 20:26:49,512][106226] Updated weights for policy 0, policy_version 169416 (0.0011) [2023-12-27 20:26:49,576][106226] Updated weights for policy 0, policy_version 169426 (0.0011) [2023-12-27 20:26:49,637][106226] Updated weights for policy 0, policy_version 169436 (0.0010) [2023-12-27 20:26:50,029][106225] Updated weights for policy 1, policy_version 169703 (0.0007) [2023-12-27 20:26:50,087][106225] Updated weights for policy 1, policy_version 169713 (0.0008) [2023-12-27 20:26:50,152][106225] Updated weights for policy 1, policy_version 169723 (0.0008) [2023-12-27 20:26:50,414][106226] Updated weights for policy 0, policy_version 169446 (0.0011) [2023-12-27 20:26:50,475][106226] Updated weights for policy 0, policy_version 169456 (0.0011) [2023-12-27 20:26:50,528][106226] Updated weights for policy 0, policy_version 169466 (0.0010) [2023-12-27 20:26:50,899][106225] Updated weights for policy 1, policy_version 169733 (0.0008) [2023-12-27 20:26:50,951][106225] Updated weights for policy 1, policy_version 169743 (0.0008) [2023-12-27 20:26:51,006][106225] Updated weights for policy 1, policy_version 169753 (0.0008) [2023-12-27 20:26:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 86859776. Throughput: 0: 9827.2, 1: 10035.9. Samples: 86869996. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:51,175][105115] Avg episode reward: [(0, '-5.179'), (1, '-6.568')] [2023-12-27 20:26:51,248][106226] Updated weights for policy 0, policy_version 169476 (0.0010) [2023-12-27 20:26:51,309][106226] Updated weights for policy 0, policy_version 169486 (0.0008) [2023-12-27 20:26:51,384][106226] Updated weights for policy 0, policy_version 169496 (0.0013) [2023-12-27 20:26:51,760][106225] Updated weights for policy 1, policy_version 169763 (0.0007) [2023-12-27 20:26:51,810][106225] Updated weights for policy 1, policy_version 169773 (0.0009) [2023-12-27 20:26:51,863][106225] Updated weights for policy 1, policy_version 169783 (0.0009) [2023-12-27 20:26:52,090][106226] Updated weights for policy 0, policy_version 169506 (0.0008) [2023-12-27 20:26:52,156][106226] Updated weights for policy 0, policy_version 169516 (0.0009) [2023-12-27 20:26:52,231][106226] Updated weights for policy 0, policy_version 169526 (0.0007) [2023-12-27 20:26:52,293][106226] Updated weights for policy 0, policy_version 169536 (0.0009) [2023-12-27 20:26:52,631][106225] Updated weights for policy 1, policy_version 169793 (0.0009) [2023-12-27 20:26:52,690][106225] Updated weights for policy 1, policy_version 169803 (0.0008) [2023-12-27 20:26:52,745][106225] Updated weights for policy 1, policy_version 169813 (0.0008) [2023-12-27 20:26:52,793][106225] Updated weights for policy 1, policy_version 169823 (0.0008) [2023-12-27 20:26:53,005][106226] Updated weights for policy 0, policy_version 169546 (0.0008) [2023-12-27 20:26:53,066][106226] Updated weights for policy 0, policy_version 169556 (0.0005) [2023-12-27 20:26:53,122][106226] Updated weights for policy 0, policy_version 169566 (0.0005) [2023-12-27 20:26:53,539][106225] Updated weights for policy 1, policy_version 169833 (0.0007) [2023-12-27 20:26:53,592][106225] Updated weights for policy 1, policy_version 169843 (0.0008) [2023-12-27 20:26:53,646][106225] Updated weights for policy 1, policy_version 169853 (0.0008) [2023-12-27 20:26:53,720][106226] Updated weights for policy 0, policy_version 169576 (0.0007) [2023-12-27 20:26:53,777][106226] Updated weights for policy 0, policy_version 169586 (0.0007) [2023-12-27 20:26:53,831][106226] Updated weights for policy 0, policy_version 169596 (0.0005) [2023-12-27 20:26:54,435][106225] Updated weights for policy 1, policy_version 169863 (0.0007) [2023-12-27 20:26:54,443][106226] Updated weights for policy 0, policy_version 169606 (0.0005) [2023-12-27 20:26:54,490][106225] Updated weights for policy 1, policy_version 169873 (0.0008) [2023-12-27 20:26:54,497][106226] Updated weights for policy 0, policy_version 169616 (0.0006) [2023-12-27 20:26:54,538][106225] Updated weights for policy 1, policy_version 169883 (0.0008) [2023-12-27 20:26:54,557][106226] Updated weights for policy 0, policy_version 169626 (0.0006) [2023-12-27 20:26:55,211][106226] Updated weights for policy 0, policy_version 169636 (0.0007) [2023-12-27 20:26:55,273][106226] Updated weights for policy 0, policy_version 169646 (0.0007) [2023-12-27 20:26:55,290][106225] Updated weights for policy 1, policy_version 169893 (0.0008) [2023-12-27 20:26:55,333][106226] Updated weights for policy 0, policy_version 169656 (0.0005) [2023-12-27 20:26:55,339][106225] Updated weights for policy 1, policy_version 169903 (0.0008) [2023-12-27 20:26:55,394][106225] Updated weights for policy 1, policy_version 169913 (0.0008) [2023-12-27 20:26:55,998][106225] Updated weights for policy 1, policy_version 169923 (0.0006) [2023-12-27 20:26:56,053][106225] Updated weights for policy 1, policy_version 169933 (0.0008) [2023-12-27 20:26:56,060][106226] Updated weights for policy 0, policy_version 169666 (0.0006) [2023-12-27 20:26:56,101][106225] Updated weights for policy 1, policy_version 169943 (0.0007) [2023-12-27 20:26:56,114][106226] Updated weights for policy 0, policy_version 169676 (0.0006) [2023-12-27 20:26:56,171][106226] Updated weights for policy 0, policy_version 169686 (0.0007) [2023-12-27 20:26:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 86958080. Throughput: 0: 9870.5, 1: 9996.4. Samples: 86928300. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:26:56,175][105115] Avg episode reward: [(0, '-5.546'), (1, '-6.906')] [2023-12-27 20:26:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000169952_43515904.pth... [2023-12-27 20:26:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000168768_43212800.pth [2023-12-27 20:26:56,215][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000169696_43450368.pth... [2023-12-27 20:26:56,217][106226] Updated weights for policy 0, policy_version 169696 (0.0009) [2023-12-27 20:26:56,221][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000168512_43147264.pth [2023-12-27 20:26:56,829][106225] Updated weights for policy 1, policy_version 169953 (0.0006) [2023-12-27 20:26:56,877][106225] Updated weights for policy 1, policy_version 169963 (0.0008) [2023-12-27 20:26:56,929][106225] Updated weights for policy 1, policy_version 169973 (0.0007) [2023-12-27 20:26:56,955][106226] Updated weights for policy 0, policy_version 169706 (0.0007) [2023-12-27 20:26:56,972][106225] Updated weights for policy 1, policy_version 169983 (0.0006) [2023-12-27 20:26:57,014][106226] Updated weights for policy 0, policy_version 169716 (0.0007) [2023-12-27 20:26:57,075][106226] Updated weights for policy 0, policy_version 169726 (0.0009) [2023-12-27 20:26:57,644][106225] Updated weights for policy 1, policy_version 169993 (0.0008) [2023-12-27 20:26:57,705][106225] Updated weights for policy 1, policy_version 170003 (0.0008) [2023-12-27 20:26:57,758][106225] Updated weights for policy 1, policy_version 170013 (0.0008) [2023-12-27 20:26:57,804][106226] Updated weights for policy 0, policy_version 169736 (0.0009) [2023-12-27 20:26:57,852][106226] Updated weights for policy 0, policy_version 169746 (0.0008) [2023-12-27 20:26:57,907][106226] Updated weights for policy 0, policy_version 169756 (0.0009) [2023-12-27 20:26:58,402][106225] Updated weights for policy 1, policy_version 170023 (0.0007) [2023-12-27 20:26:58,471][106225] Updated weights for policy 1, policy_version 170033 (0.0007) [2023-12-27 20:26:58,536][106225] Updated weights for policy 1, policy_version 170043 (0.0008) [2023-12-27 20:26:58,719][106226] Updated weights for policy 0, policy_version 169766 (0.0009) [2023-12-27 20:26:58,784][106226] Updated weights for policy 0, policy_version 169776 (0.0008) [2023-12-27 20:26:58,850][106226] Updated weights for policy 0, policy_version 169786 (0.0008) [2023-12-27 20:26:59,275][106225] Updated weights for policy 1, policy_version 170053 (0.0008) [2023-12-27 20:26:59,335][106225] Updated weights for policy 1, policy_version 170063 (0.0008) [2023-12-27 20:26:59,423][106225] Updated weights for policy 1, policy_version 170073 (0.0008) [2023-12-27 20:26:59,665][106226] Updated weights for policy 0, policy_version 169796 (0.0009) [2023-12-27 20:26:59,727][106226] Updated weights for policy 0, policy_version 169806 (0.0009) [2023-12-27 20:26:59,787][106226] Updated weights for policy 0, policy_version 169816 (0.0007) [2023-12-27 20:27:00,121][106225] Updated weights for policy 1, policy_version 170083 (0.0007) [2023-12-27 20:27:00,183][106225] Updated weights for policy 1, policy_version 170093 (0.0009) [2023-12-27 20:27:00,242][106225] Updated weights for policy 1, policy_version 170103 (0.0008) [2023-12-27 20:27:00,469][106226] Updated weights for policy 0, policy_version 169826 (0.0007) [2023-12-27 20:27:00,523][106226] Updated weights for policy 0, policy_version 169836 (0.0008) [2023-12-27 20:27:00,572][106226] Updated weights for policy 0, policy_version 169846 (0.0007) [2023-12-27 20:27:00,634][106226] Updated weights for policy 0, policy_version 169856 (0.0005) [2023-12-27 20:27:00,880][106225] Updated weights for policy 1, policy_version 170113 (0.0007) [2023-12-27 20:27:00,930][106225] Updated weights for policy 1, policy_version 170123 (0.0006) [2023-12-27 20:27:00,979][106225] Updated weights for policy 1, policy_version 170133 (0.0005) [2023-12-27 20:27:01,042][106225] Updated weights for policy 1, policy_version 170143 (0.0006) [2023-12-27 20:27:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 87056384. Throughput: 0: 9876.6, 1: 10049.3. Samples: 87044636. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:01,175][105115] Avg episode reward: [(0, '-5.268'), (1, '-6.383')] [2023-12-27 20:27:01,273][106226] Updated weights for policy 0, policy_version 169866 (0.0011) [2023-12-27 20:27:01,340][106226] Updated weights for policy 0, policy_version 169876 (0.0010) [2023-12-27 20:27:01,416][106226] Updated weights for policy 0, policy_version 169886 (0.0009) [2023-12-27 20:27:01,699][106225] Updated weights for policy 1, policy_version 170153 (0.0007) [2023-12-27 20:27:01,770][106225] Updated weights for policy 1, policy_version 170163 (0.0008) [2023-12-27 20:27:01,832][106225] Updated weights for policy 1, policy_version 170173 (0.0008) [2023-12-27 20:27:02,080][106226] Updated weights for policy 0, policy_version 169896 (0.0005) [2023-12-27 20:27:02,147][106226] Updated weights for policy 0, policy_version 169906 (0.0010) [2023-12-27 20:27:02,204][106226] Updated weights for policy 0, policy_version 169916 (0.0010) [2023-12-27 20:27:02,618][106225] Updated weights for policy 1, policy_version 170183 (0.0008) [2023-12-27 20:27:02,665][106225] Updated weights for policy 1, policy_version 170193 (0.0008) [2023-12-27 20:27:02,718][106225] Updated weights for policy 1, policy_version 170203 (0.0008) [2023-12-27 20:27:02,844][106226] Updated weights for policy 0, policy_version 169926 (0.0009) [2023-12-27 20:27:02,897][106226] Updated weights for policy 0, policy_version 169936 (0.0009) [2023-12-27 20:27:02,954][106226] Updated weights for policy 0, policy_version 169946 (0.0009) [2023-12-27 20:27:03,467][106225] Updated weights for policy 1, policy_version 170213 (0.0007) [2023-12-27 20:27:03,519][106225] Updated weights for policy 1, policy_version 170223 (0.0005) [2023-12-27 20:27:03,563][106225] Updated weights for policy 1, policy_version 170233 (0.0005) [2023-12-27 20:27:03,725][106226] Updated weights for policy 0, policy_version 169956 (0.0008) [2023-12-27 20:27:03,773][106226] Updated weights for policy 0, policy_version 169966 (0.0008) [2023-12-27 20:27:03,821][106226] Updated weights for policy 0, policy_version 169976 (0.0007) [2023-12-27 20:27:04,228][106225] Updated weights for policy 1, policy_version 170243 (0.0006) [2023-12-27 20:27:04,290][106225] Updated weights for policy 1, policy_version 170253 (0.0008) [2023-12-27 20:27:04,353][106225] Updated weights for policy 1, policy_version 170263 (0.0009) [2023-12-27 20:27:04,586][106226] Updated weights for policy 0, policy_version 169986 (0.0007) [2023-12-27 20:27:04,644][106226] Updated weights for policy 0, policy_version 169996 (0.0005) [2023-12-27 20:27:04,703][106226] Updated weights for policy 0, policy_version 170006 (0.0008) [2023-12-27 20:27:04,758][106226] Updated weights for policy 0, policy_version 170016 (0.0008) [2023-12-27 20:27:05,063][106225] Updated weights for policy 1, policy_version 170273 (0.0007) [2023-12-27 20:27:05,127][106225] Updated weights for policy 1, policy_version 170283 (0.0006) [2023-12-27 20:27:05,184][106225] Updated weights for policy 1, policy_version 170293 (0.0008) [2023-12-27 20:27:05,234][106225] Updated weights for policy 1, policy_version 170303 (0.0008) [2023-12-27 20:27:05,457][106226] Updated weights for policy 0, policy_version 170026 (0.0009) [2023-12-27 20:27:05,516][106226] Updated weights for policy 0, policy_version 170036 (0.0008) [2023-12-27 20:27:05,578][106226] Updated weights for policy 0, policy_version 170046 (0.0009) [2023-12-27 20:27:05,934][106225] Updated weights for policy 1, policy_version 170313 (0.0009) [2023-12-27 20:27:05,985][106225] Updated weights for policy 1, policy_version 170323 (0.0006) [2023-12-27 20:27:06,043][106225] Updated weights for policy 1, policy_version 170333 (0.0008) [2023-12-27 20:27:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 87154688. Throughput: 0: 9807.5, 1: 9968.2. Samples: 87163928. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:06,175][105115] Avg episode reward: [(0, '-5.530'), (1, '-6.581')] [2023-12-27 20:27:06,307][106226] Updated weights for policy 0, policy_version 170056 (0.0008) [2023-12-27 20:27:06,375][106226] Updated weights for policy 0, policy_version 170066 (0.0009) [2023-12-27 20:27:06,438][106226] Updated weights for policy 0, policy_version 170076 (0.0009) [2023-12-27 20:27:06,685][106225] Updated weights for policy 1, policy_version 170343 (0.0008) [2023-12-27 20:27:06,746][106225] Updated weights for policy 1, policy_version 170353 (0.0008) [2023-12-27 20:27:06,811][106225] Updated weights for policy 1, policy_version 170363 (0.0005) [2023-12-27 20:27:07,197][106226] Updated weights for policy 0, policy_version 170086 (0.0009) [2023-12-27 20:27:07,247][106226] Updated weights for policy 0, policy_version 170096 (0.0010) [2023-12-27 20:27:07,298][106226] Updated weights for policy 0, policy_version 170106 (0.0009) [2023-12-27 20:27:07,449][106225] Updated weights for policy 1, policy_version 170373 (0.0007) [2023-12-27 20:27:07,499][106225] Updated weights for policy 1, policy_version 170383 (0.0008) [2023-12-27 20:27:07,553][106225] Updated weights for policy 1, policy_version 170393 (0.0008) [2023-12-27 20:27:08,064][106226] Updated weights for policy 0, policy_version 170116 (0.0010) [2023-12-27 20:27:08,127][106226] Updated weights for policy 0, policy_version 170126 (0.0010) [2023-12-27 20:27:08,178][106225] Updated weights for policy 1, policy_version 170403 (0.0008) [2023-12-27 20:27:08,195][106226] Updated weights for policy 0, policy_version 170136 (0.0011) [2023-12-27 20:27:08,231][106225] Updated weights for policy 1, policy_version 170413 (0.0007) [2023-12-27 20:27:08,293][106225] Updated weights for policy 1, policy_version 170423 (0.0006) [2023-12-27 20:27:08,821][106226] Updated weights for policy 0, policy_version 170146 (0.0010) [2023-12-27 20:27:08,879][106226] Updated weights for policy 0, policy_version 170156 (0.0009) [2023-12-27 20:27:08,940][106226] Updated weights for policy 0, policy_version 170166 (0.0008) [2023-12-27 20:27:08,942][106225] Updated weights for policy 1, policy_version 170433 (0.0007) [2023-12-27 20:27:08,998][106225] Updated weights for policy 1, policy_version 170443 (0.0007) [2023-12-27 20:27:09,004][106226] Updated weights for policy 0, policy_version 170176 (0.0008) [2023-12-27 20:27:09,060][106225] Updated weights for policy 1, policy_version 170453 (0.0008) [2023-12-27 20:27:09,123][106225] Updated weights for policy 1, policy_version 170463 (0.0008) [2023-12-27 20:27:09,740][106226] Updated weights for policy 0, policy_version 170186 (0.0007) [2023-12-27 20:27:09,804][106226] Updated weights for policy 0, policy_version 170196 (0.0008) [2023-12-27 20:27:09,876][106226] Updated weights for policy 0, policy_version 170206 (0.0008) [2023-12-27 20:27:09,924][106225] Updated weights for policy 1, policy_version 170473 (0.0007) [2023-12-27 20:27:09,991][106225] Updated weights for policy 1, policy_version 170483 (0.0008) [2023-12-27 20:27:10,046][106225] Updated weights for policy 1, policy_version 170493 (0.0008) [2023-12-27 20:27:10,697][106225] Updated weights for policy 1, policy_version 170503 (0.0010) [2023-12-27 20:27:10,700][106226] Updated weights for policy 0, policy_version 170216 (0.0006) [2023-12-27 20:27:10,749][106225] Updated weights for policy 1, policy_version 170513 (0.0010) [2023-12-27 20:27:10,751][106226] Updated weights for policy 0, policy_version 170226 (0.0006) [2023-12-27 20:27:10,804][106226] Updated weights for policy 0, policy_version 170236 (0.0007) [2023-12-27 20:27:10,805][106225] Updated weights for policy 1, policy_version 170523 (0.0010) [2023-12-27 20:27:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 87252992. Throughput: 0: 9820.5, 1: 10054.4. Samples: 87223588. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:11,175][105115] Avg episode reward: [(0, '-5.750'), (1, '-6.583')] [2023-12-27 20:27:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000170528_43663360.pth... [2023-12-27 20:27:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000170240_43589632.pth... [2023-12-27 20:27:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000169376_43368448.pth [2023-12-27 20:27:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000169088_43294720.pth [2023-12-27 20:27:11,576][106226] Updated weights for policy 0, policy_version 170246 (0.0007) [2023-12-27 20:27:11,594][106225] Updated weights for policy 1, policy_version 170533 (0.0009) [2023-12-27 20:27:11,644][106226] Updated weights for policy 0, policy_version 170256 (0.0007) [2023-12-27 20:27:11,664][106225] Updated weights for policy 1, policy_version 170543 (0.0008) [2023-12-27 20:27:11,709][106226] Updated weights for policy 0, policy_version 170266 (0.0009) [2023-12-27 20:27:11,736][106225] Updated weights for policy 1, policy_version 170553 (0.0008) [2023-12-27 20:27:11,786][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000006 [2023-12-27 20:27:12,426][106225] Updated weights for policy 1, policy_version 170563 (0.0011) [2023-12-27 20:27:12,478][106225] Updated weights for policy 1, policy_version 170573 (0.0006) [2023-12-27 20:27:12,498][106226] Updated weights for policy 0, policy_version 170276 (0.0007) [2023-12-27 20:27:12,534][106225] Updated weights for policy 1, policy_version 170583 (0.0009) [2023-12-27 20:27:12,556][106226] Updated weights for policy 0, policy_version 170286 (0.0007) [2023-12-27 20:27:12,614][106226] Updated weights for policy 0, policy_version 170296 (0.0007) [2023-12-27 20:27:13,265][106225] Updated weights for policy 1, policy_version 170593 (0.0007) [2023-12-27 20:27:13,321][106225] Updated weights for policy 1, policy_version 170603 (0.0009) [2023-12-27 20:27:13,349][106226] Updated weights for policy 0, policy_version 170306 (0.0008) [2023-12-27 20:27:13,371][106225] Updated weights for policy 1, policy_version 170613 (0.0007) [2023-12-27 20:27:13,394][106226] Updated weights for policy 0, policy_version 170316 (0.0007) [2023-12-27 20:27:13,423][106225] Updated weights for policy 1, policy_version 170623 (0.0008) [2023-12-27 20:27:13,442][106226] Updated weights for policy 0, policy_version 170326 (0.0007) [2023-12-27 20:27:13,494][106226] Updated weights for policy 0, policy_version 170336 (0.0008) [2023-12-27 20:27:14,083][106225] Updated weights for policy 1, policy_version 170633 (0.0008) [2023-12-27 20:27:14,144][106225] Updated weights for policy 1, policy_version 170643 (0.0009) [2023-12-27 20:27:14,209][106225] Updated weights for policy 1, policy_version 170653 (0.0008) [2023-12-27 20:27:14,302][106226] Updated weights for policy 0, policy_version 170346 (0.0005) [2023-12-27 20:27:14,366][106226] Updated weights for policy 0, policy_version 170356 (0.0005) [2023-12-27 20:27:14,418][106226] Updated weights for policy 0, policy_version 170366 (0.0006) [2023-12-27 20:27:14,875][106225] Updated weights for policy 1, policy_version 170663 (0.0008) [2023-12-27 20:27:14,938][106225] Updated weights for policy 1, policy_version 170673 (0.0008) [2023-12-27 20:27:14,998][106225] Updated weights for policy 1, policy_version 170683 (0.0008) [2023-12-27 20:27:15,127][106226] Updated weights for policy 0, policy_version 170376 (0.0009) [2023-12-27 20:27:15,197][106226] Updated weights for policy 0, policy_version 170386 (0.0010) [2023-12-27 20:27:15,248][106226] Updated weights for policy 0, policy_version 170396 (0.0010) [2023-12-27 20:27:15,649][106225] Updated weights for policy 1, policy_version 170693 (0.0009) [2023-12-27 20:27:15,702][106225] Updated weights for policy 1, policy_version 170703 (0.0008) [2023-12-27 20:27:15,751][106225] Updated weights for policy 1, policy_version 170713 (0.0008) [2023-12-27 20:27:16,035][106226] Updated weights for policy 0, policy_version 170406 (0.0009) [2023-12-27 20:27:16,097][106226] Updated weights for policy 0, policy_version 170416 (0.0006) [2023-12-27 20:27:16,159][106226] Updated weights for policy 0, policy_version 170426 (0.0005) [2023-12-27 20:27:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 87343104. Throughput: 0: 9699.4, 1: 9941.0. Samples: 87337728. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:16,175][105115] Avg episode reward: [(0, '-5.570'), (1, '-6.417')] [2023-12-27 20:27:16,456][106225] Updated weights for policy 1, policy_version 170723 (0.0006) [2023-12-27 20:27:16,513][106225] Updated weights for policy 1, policy_version 170733 (0.0005) [2023-12-27 20:27:16,567][106225] Updated weights for policy 1, policy_version 170743 (0.0006) [2023-12-27 20:27:16,907][106226] Updated weights for policy 0, policy_version 170436 (0.0009) [2023-12-27 20:27:16,957][106226] Updated weights for policy 0, policy_version 170446 (0.0008) [2023-12-27 20:27:17,011][106226] Updated weights for policy 0, policy_version 170456 (0.0010) [2023-12-27 20:27:17,110][106225] Updated weights for policy 1, policy_version 170753 (0.0007) [2023-12-27 20:27:17,167][106225] Updated weights for policy 1, policy_version 170763 (0.0008) [2023-12-27 20:27:17,228][106225] Updated weights for policy 1, policy_version 170773 (0.0008) [2023-12-27 20:27:17,285][106225] Updated weights for policy 1, policy_version 170783 (0.0008) [2023-12-27 20:27:17,747][106226] Updated weights for policy 0, policy_version 170466 (0.0008) [2023-12-27 20:27:17,797][106226] Updated weights for policy 0, policy_version 170476 (0.0008) [2023-12-27 20:27:17,852][106226] Updated weights for policy 0, policy_version 170486 (0.0010) [2023-12-27 20:27:17,904][106226] Updated weights for policy 0, policy_version 170496 (0.0008) [2023-12-27 20:27:17,979][106225] Updated weights for policy 1, policy_version 170793 (0.0006) [2023-12-27 20:27:18,042][106225] Updated weights for policy 1, policy_version 170803 (0.0009) [2023-12-27 20:27:18,099][106225] Updated weights for policy 1, policy_version 170813 (0.0010) [2023-12-27 20:27:18,711][106225] Updated weights for policy 1, policy_version 170823 (0.0009) [2023-12-27 20:27:18,721][106226] Updated weights for policy 0, policy_version 170506 (0.0007) [2023-12-27 20:27:18,765][106225] Updated weights for policy 1, policy_version 170833 (0.0010) [2023-12-27 20:27:18,776][106226] Updated weights for policy 0, policy_version 170516 (0.0007) [2023-12-27 20:27:18,816][106225] Updated weights for policy 1, policy_version 170843 (0.0008) [2023-12-27 20:27:18,834][106226] Updated weights for policy 0, policy_version 170526 (0.0008) [2023-12-27 20:27:19,457][106225] Updated weights for policy 1, policy_version 170853 (0.0008) [2023-12-27 20:27:19,530][106225] Updated weights for policy 1, policy_version 170863 (0.0009) [2023-12-27 20:27:19,589][106225] Updated weights for policy 1, policy_version 170873 (0.0009) [2023-12-27 20:27:19,685][106226] Updated weights for policy 0, policy_version 170536 (0.0009) [2023-12-27 20:27:19,744][106226] Updated weights for policy 0, policy_version 170546 (0.0008) [2023-12-27 20:27:19,813][106226] Updated weights for policy 0, policy_version 170556 (0.0008) [2023-12-27 20:27:20,358][106225] Updated weights for policy 1, policy_version 170883 (0.0009) [2023-12-27 20:27:20,422][106225] Updated weights for policy 1, policy_version 170893 (0.0008) [2023-12-27 20:27:20,485][106226] Updated weights for policy 0, policy_version 170566 (0.0006) [2023-12-27 20:27:20,492][106225] Updated weights for policy 1, policy_version 170903 (0.0009) [2023-12-27 20:27:20,553][106226] Updated weights for policy 0, policy_version 170576 (0.0006) [2023-12-27 20:27:20,630][106226] Updated weights for policy 0, policy_version 170586 (0.0008) [2023-12-27 20:27:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 87441408. Throughput: 0: 9660.6, 1: 9907.8. Samples: 87454600. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:21,175][105115] Avg episode reward: [(0, '-5.561'), (1, '-6.226')] [2023-12-27 20:27:21,325][106225] Updated weights for policy 1, policy_version 170913 (0.0009) [2023-12-27 20:27:21,329][106226] Updated weights for policy 0, policy_version 170596 (0.0009) [2023-12-27 20:27:21,402][106225] Updated weights for policy 1, policy_version 170923 (0.0009) [2023-12-27 20:27:21,403][106226] Updated weights for policy 0, policy_version 170606 (0.0008) [2023-12-27 20:27:21,466][106225] Updated weights for policy 1, policy_version 170933 (0.0007) [2023-12-27 20:27:21,466][106226] Updated weights for policy 0, policy_version 170616 (0.0008) [2023-12-27 20:27:21,529][106225] Updated weights for policy 1, policy_version 170943 (0.0007) [2023-12-27 20:27:22,169][106226] Updated weights for policy 0, policy_version 170626 (0.0008) [2023-12-27 20:27:22,234][106226] Updated weights for policy 0, policy_version 170636 (0.0009) [2023-12-27 20:27:22,244][106225] Updated weights for policy 1, policy_version 170953 (0.0006) [2023-12-27 20:27:22,303][106226] Updated weights for policy 0, policy_version 170646 (0.0007) [2023-12-27 20:27:22,310][106225] Updated weights for policy 1, policy_version 170963 (0.0008) [2023-12-27 20:27:22,370][106225] Updated weights for policy 1, policy_version 170973 (0.0008) [2023-12-27 20:27:22,370][106226] Updated weights for policy 0, policy_version 170656 (0.0008) [2023-12-27 20:27:23,081][106226] Updated weights for policy 0, policy_version 170666 (0.0007) [2023-12-27 20:27:23,102][106225] Updated weights for policy 1, policy_version 170983 (0.0009) [2023-12-27 20:27:23,129][106226] Updated weights for policy 0, policy_version 170676 (0.0007) [2023-12-27 20:27:23,163][106225] Updated weights for policy 1, policy_version 170993 (0.0008) [2023-12-27 20:27:23,178][106226] Updated weights for policy 0, policy_version 170686 (0.0005) [2023-12-27 20:27:23,216][106225] Updated weights for policy 1, policy_version 171003 (0.0006) [2023-12-27 20:27:23,839][106226] Updated weights for policy 0, policy_version 170696 (0.0009) [2023-12-27 20:27:23,904][106226] Updated weights for policy 0, policy_version 170706 (0.0010) [2023-12-27 20:27:23,949][106225] Updated weights for policy 1, policy_version 171013 (0.0010) [2023-12-27 20:27:23,968][106226] Updated weights for policy 0, policy_version 170716 (0.0009) [2023-12-27 20:27:24,006][106225] Updated weights for policy 1, policy_version 171023 (0.0010) [2023-12-27 20:27:24,056][106225] Updated weights for policy 1, policy_version 171033 (0.0010) [2023-12-27 20:27:24,511][106226] Updated weights for policy 0, policy_version 170726 (0.0007) [2023-12-27 20:27:24,565][106226] Updated weights for policy 0, policy_version 170736 (0.0010) [2023-12-27 20:27:24,621][106226] Updated weights for policy 0, policy_version 170746 (0.0010) [2023-12-27 20:27:24,774][106225] Updated weights for policy 1, policy_version 171043 (0.0010) [2023-12-27 20:27:24,825][106225] Updated weights for policy 1, policy_version 171053 (0.0010) [2023-12-27 20:27:24,871][106225] Updated weights for policy 1, policy_version 171063 (0.0010) [2023-12-27 20:27:25,277][106226] Updated weights for policy 0, policy_version 170756 (0.0010) [2023-12-27 20:27:25,330][106226] Updated weights for policy 0, policy_version 170766 (0.0010) [2023-12-27 20:27:25,384][106226] Updated weights for policy 0, policy_version 170776 (0.0010) [2023-12-27 20:27:25,558][106225] Updated weights for policy 1, policy_version 171073 (0.0010) [2023-12-27 20:27:25,622][106225] Updated weights for policy 1, policy_version 171083 (0.0010) [2023-12-27 20:27:25,675][106225] Updated weights for policy 1, policy_version 171093 (0.0010) [2023-12-27 20:27:25,725][106225] Updated weights for policy 1, policy_version 171103 (0.0010) [2023-12-27 20:27:26,101][106226] Updated weights for policy 0, policy_version 170786 (0.0010) [2023-12-27 20:27:26,158][106226] Updated weights for policy 0, policy_version 170796 (0.0011) [2023-12-27 20:27:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 87539712. Throughput: 0: 9627.8, 1: 9882.1. Samples: 87511832. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 20:27:26,175][105115] Avg episode reward: [(0, '-5.364'), (1, '-6.321')] [2023-12-27 20:27:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000171104_43810816.pth... [2023-12-27 20:27:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000169952_43515904.pth [2023-12-27 20:27:26,230][106226] Updated weights for policy 0, policy_version 170806 (0.0008) [2023-12-27 20:27:26,294][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000170816_43737088.pth... [2023-12-27 20:27:26,295][106226] Updated weights for policy 0, policy_version 170816 (0.0010) [2023-12-27 20:27:26,298][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000169696_43450368.pth [2023-12-27 20:27:26,370][106225] Updated weights for policy 1, policy_version 171113 (0.0006) [2023-12-27 20:27:26,424][106225] Updated weights for policy 1, policy_version 171123 (0.0005) [2023-12-27 20:27:26,481][106225] Updated weights for policy 1, policy_version 171133 (0.0009) [2023-12-27 20:27:26,834][106226] Updated weights for policy 0, policy_version 170826 (0.0010) [2023-12-27 20:27:26,890][106226] Updated weights for policy 0, policy_version 170836 (0.0010) [2023-12-27 20:27:26,952][106226] Updated weights for policy 0, policy_version 170846 (0.0010) [2023-12-27 20:27:27,022][106225] Updated weights for policy 1, policy_version 171143 (0.0005) [2023-12-27 20:27:27,075][106225] Updated weights for policy 1, policy_version 171153 (0.0005) [2023-12-27 20:27:27,128][106225] Updated weights for policy 1, policy_version 171163 (0.0005) [2023-12-27 20:27:27,636][106225] Updated weights for policy 1, policy_version 171173 (0.0005) [2023-12-27 20:27:27,654][106226] Updated weights for policy 0, policy_version 170856 (0.0010) [2023-12-27 20:27:27,698][106225] Updated weights for policy 1, policy_version 171183 (0.0010) [2023-12-27 20:27:27,709][106226] Updated weights for policy 0, policy_version 170866 (0.0010) [2023-12-27 20:27:27,751][106225] Updated weights for policy 1, policy_version 171193 (0.0010) [2023-12-27 20:27:27,769][106226] Updated weights for policy 0, policy_version 170876 (0.0010) [2023-12-27 20:27:28,457][106225] Updated weights for policy 1, policy_version 171203 (0.0010) [2023-12-27 20:27:28,469][106226] Updated weights for policy 0, policy_version 170886 (0.0010) [2023-12-27 20:27:28,510][106225] Updated weights for policy 1, policy_version 171213 (0.0010) [2023-12-27 20:27:28,519][106226] Updated weights for policy 0, policy_version 170896 (0.0010) [2023-12-27 20:27:28,573][106225] Updated weights for policy 1, policy_version 171223 (0.0011) [2023-12-27 20:27:28,580][106226] Updated weights for policy 0, policy_version 170906 (0.0010) [2023-12-27 20:27:29,290][106226] Updated weights for policy 0, policy_version 170916 (0.0011) [2023-12-27 20:27:29,292][106225] Updated weights for policy 1, policy_version 171233 (0.0011) [2023-12-27 20:27:29,347][106226] Updated weights for policy 0, policy_version 170926 (0.0011) [2023-12-27 20:27:29,356][106225] Updated weights for policy 1, policy_version 171243 (0.0010) [2023-12-27 20:27:29,412][106226] Updated weights for policy 0, policy_version 170936 (0.0009) [2023-12-27 20:27:29,417][106225] Updated weights for policy 1, policy_version 171253 (0.0009) [2023-12-27 20:27:29,471][106225] Updated weights for policy 1, policy_version 171263 (0.0010) [2023-12-27 20:27:30,124][106226] Updated weights for policy 0, policy_version 170946 (0.0010) [2023-12-27 20:27:30,172][106226] Updated weights for policy 0, policy_version 170956 (0.0008) [2023-12-27 20:27:30,188][106225] Updated weights for policy 1, policy_version 171273 (0.0007) [2023-12-27 20:27:30,222][106226] Updated weights for policy 0, policy_version 170966 (0.0010) [2023-12-27 20:27:30,251][106225] Updated weights for policy 1, policy_version 171283 (0.0008) [2023-12-27 20:27:30,286][106226] Updated weights for policy 0, policy_version 170976 (0.0007) [2023-12-27 20:27:30,301][106225] Updated weights for policy 1, policy_version 171293 (0.0010) [2023-12-27 20:27:30,947][106226] Updated weights for policy 0, policy_version 170986 (0.0005) [2023-12-27 20:27:31,000][106226] Updated weights for policy 0, policy_version 170996 (0.0005) [2023-12-27 20:27:31,019][106225] Updated weights for policy 1, policy_version 171303 (0.0010) [2023-12-27 20:27:31,067][106226] Updated weights for policy 0, policy_version 171006 (0.0007) [2023-12-27 20:27:31,080][106225] Updated weights for policy 1, policy_version 171313 (0.0010) [2023-12-27 20:27:31,145][106225] Updated weights for policy 1, policy_version 171323 (0.0010) [2023-12-27 20:27:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 87646208. Throughput: 0: 9732.7, 1: 10025.9. Samples: 87637296. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:31,175][105115] Avg episode reward: [(0, '-5.560'), (1, '-6.609')] [2023-12-27 20:27:31,737][106226] Updated weights for policy 0, policy_version 171016 (0.0008) [2023-12-27 20:27:31,797][106226] Updated weights for policy 0, policy_version 171026 (0.0009) [2023-12-27 20:27:31,853][106226] Updated weights for policy 0, policy_version 171036 (0.0009) [2023-12-27 20:27:31,899][106225] Updated weights for policy 1, policy_version 171333 (0.0008) [2023-12-27 20:27:31,962][106225] Updated weights for policy 1, policy_version 171343 (0.0008) [2023-12-27 20:27:32,016][106225] Updated weights for policy 1, policy_version 171353 (0.0008) [2023-12-27 20:27:32,499][106226] Updated weights for policy 0, policy_version 171046 (0.0009) [2023-12-27 20:27:32,574][106226] Updated weights for policy 0, policy_version 171056 (0.0008) [2023-12-27 20:27:32,626][106226] Updated weights for policy 0, policy_version 171066 (0.0005) [2023-12-27 20:27:32,776][106225] Updated weights for policy 1, policy_version 171363 (0.0009) [2023-12-27 20:27:32,844][106225] Updated weights for policy 1, policy_version 171373 (0.0007) [2023-12-27 20:27:32,906][106225] Updated weights for policy 1, policy_version 171383 (0.0008) [2023-12-27 20:27:33,291][106226] Updated weights for policy 0, policy_version 171076 (0.0006) [2023-12-27 20:27:33,347][106226] Updated weights for policy 0, policy_version 171086 (0.0008) [2023-12-27 20:27:33,411][106226] Updated weights for policy 0, policy_version 171096 (0.0008) [2023-12-27 20:27:33,594][106225] Updated weights for policy 1, policy_version 171393 (0.0008) [2023-12-27 20:27:33,651][106225] Updated weights for policy 1, policy_version 171403 (0.0008) [2023-12-27 20:27:33,708][106225] Updated weights for policy 1, policy_version 171413 (0.0008) [2023-12-27 20:27:33,766][106225] Updated weights for policy 1, policy_version 171423 (0.0007) [2023-12-27 20:27:34,073][106226] Updated weights for policy 0, policy_version 171106 (0.0008) [2023-12-27 20:27:34,128][106226] Updated weights for policy 0, policy_version 171116 (0.0007) [2023-12-27 20:27:34,198][106226] Updated weights for policy 0, policy_version 171126 (0.0009) [2023-12-27 20:27:34,252][106226] Updated weights for policy 0, policy_version 171136 (0.0009) [2023-12-27 20:27:34,496][106225] Updated weights for policy 1, policy_version 171433 (0.0008) [2023-12-27 20:27:34,559][106225] Updated weights for policy 1, policy_version 171443 (0.0008) [2023-12-27 20:27:34,622][106225] Updated weights for policy 1, policy_version 171453 (0.0009) [2023-12-27 20:27:34,975][106226] Updated weights for policy 0, policy_version 171146 (0.0008) [2023-12-27 20:27:35,030][106226] Updated weights for policy 0, policy_version 171156 (0.0005) [2023-12-27 20:27:35,082][106226] Updated weights for policy 0, policy_version 171166 (0.0005) [2023-12-27 20:27:35,320][106225] Updated weights for policy 1, policy_version 171463 (0.0008) [2023-12-27 20:27:35,382][106225] Updated weights for policy 1, policy_version 171473 (0.0008) [2023-12-27 20:27:35,443][106225] Updated weights for policy 1, policy_version 171483 (0.0008) [2023-12-27 20:27:35,765][106226] Updated weights for policy 0, policy_version 171176 (0.0008) [2023-12-27 20:27:35,827][106226] Updated weights for policy 0, policy_version 171186 (0.0009) [2023-12-27 20:27:35,885][106226] Updated weights for policy 0, policy_version 171196 (0.0009) [2023-12-27 20:27:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 87744512. Throughput: 0: 9744.2, 1: 9938.3. Samples: 87755708. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:36,175][105115] Avg episode reward: [(0, '-5.447'), (1, '-6.642')] [2023-12-27 20:27:36,203][106225] Updated weights for policy 1, policy_version 171493 (0.0008) [2023-12-27 20:27:36,261][106225] Updated weights for policy 1, policy_version 171503 (0.0007) [2023-12-27 20:27:36,322][106225] Updated weights for policy 1, policy_version 171513 (0.0008) [2023-12-27 20:27:36,556][106226] Updated weights for policy 0, policy_version 171206 (0.0010) [2023-12-27 20:27:36,621][106226] Updated weights for policy 0, policy_version 171216 (0.0008) [2023-12-27 20:27:36,681][106226] Updated weights for policy 0, policy_version 171226 (0.0009) [2023-12-27 20:27:36,984][106225] Updated weights for policy 1, policy_version 171523 (0.0007) [2023-12-27 20:27:37,042][106225] Updated weights for policy 1, policy_version 171533 (0.0008) [2023-12-27 20:27:37,093][106225] Updated weights for policy 1, policy_version 171543 (0.0008) [2023-12-27 20:27:37,374][106226] Updated weights for policy 0, policy_version 171236 (0.0007) [2023-12-27 20:27:37,428][106226] Updated weights for policy 0, policy_version 171246 (0.0008) [2023-12-27 20:27:37,490][106226] Updated weights for policy 0, policy_version 171256 (0.0009) [2023-12-27 20:27:37,698][106225] Updated weights for policy 1, policy_version 171553 (0.0007) [2023-12-27 20:27:37,753][106225] Updated weights for policy 1, policy_version 171563 (0.0006) [2023-12-27 20:27:37,810][106225] Updated weights for policy 1, policy_version 171573 (0.0005) [2023-12-27 20:27:37,868][106225] Updated weights for policy 1, policy_version 171583 (0.0005) [2023-12-27 20:27:38,233][106226] Updated weights for policy 0, policy_version 171266 (0.0008) [2023-12-27 20:27:38,285][106226] Updated weights for policy 0, policy_version 171276 (0.0010) [2023-12-27 20:27:38,369][106226] Updated weights for policy 0, policy_version 171286 (0.0009) [2023-12-27 20:27:38,435][106226] Updated weights for policy 0, policy_version 171296 (0.0011) [2023-12-27 20:27:38,465][106225] Updated weights for policy 1, policy_version 171593 (0.0006) [2023-12-27 20:27:38,526][106225] Updated weights for policy 1, policy_version 171603 (0.0006) [2023-12-27 20:27:38,588][106225] Updated weights for policy 1, policy_version 171613 (0.0005) [2023-12-27 20:27:39,146][106226] Updated weights for policy 0, policy_version 171306 (0.0007) [2023-12-27 20:27:39,205][106226] Updated weights for policy 0, policy_version 171316 (0.0007) [2023-12-27 20:27:39,241][106225] Updated weights for policy 1, policy_version 171623 (0.0007) [2023-12-27 20:27:39,276][106226] Updated weights for policy 0, policy_version 171326 (0.0010) [2023-12-27 20:27:39,306][106225] Updated weights for policy 1, policy_version 171633 (0.0010) [2023-12-27 20:27:39,371][106225] Updated weights for policy 1, policy_version 171643 (0.0009) [2023-12-27 20:27:39,990][106226] Updated weights for policy 0, policy_version 171336 (0.0009) [2023-12-27 20:27:40,050][106226] Updated weights for policy 0, policy_version 171346 (0.0009) [2023-12-27 20:27:40,114][106225] Updated weights for policy 1, policy_version 171653 (0.0011) [2023-12-27 20:27:40,115][106226] Updated weights for policy 0, policy_version 171356 (0.0007) [2023-12-27 20:27:40,177][106225] Updated weights for policy 1, policy_version 171663 (0.0007) [2023-12-27 20:27:40,240][106225] Updated weights for policy 1, policy_version 171673 (0.0006) [2023-12-27 20:27:40,747][106226] Updated weights for policy 0, policy_version 171366 (0.0006) [2023-12-27 20:27:40,816][106226] Updated weights for policy 0, policy_version 171376 (0.0006) [2023-12-27 20:27:40,875][106226] Updated weights for policy 0, policy_version 171386 (0.0006) [2023-12-27 20:27:40,977][106225] Updated weights for policy 1, policy_version 171683 (0.0007) [2023-12-27 20:27:41,036][106225] Updated weights for policy 1, policy_version 171693 (0.0010) [2023-12-27 20:27:41,098][106225] Updated weights for policy 1, policy_version 171703 (0.0008) [2023-12-27 20:27:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 87851008. Throughput: 0: 9710.1, 1: 10046.4. Samples: 87817348. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:41,175][105115] Avg episode reward: [(0, '-5.525'), (1, '-6.577')] [2023-12-27 20:27:41,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000171392_43884544.pth... [2023-12-27 20:27:41,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000171712_43966464.pth... [2023-12-27 20:27:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000170240_43589632.pth [2023-12-27 20:27:41,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000170528_43663360.pth [2023-12-27 20:27:41,552][106226] Updated weights for policy 0, policy_version 171396 (0.0007) [2023-12-27 20:27:41,615][106226] Updated weights for policy 0, policy_version 171406 (0.0009) [2023-12-27 20:27:41,681][106226] Updated weights for policy 0, policy_version 171416 (0.0008) [2023-12-27 20:27:42,004][106225] Updated weights for policy 1, policy_version 171713 (0.0007) [2023-12-27 20:27:42,065][106225] Updated weights for policy 1, policy_version 171723 (0.0009) [2023-12-27 20:27:42,119][106225] Updated weights for policy 1, policy_version 171733 (0.0009) [2023-12-27 20:27:42,170][106225] Updated weights for policy 1, policy_version 171743 (0.0010) [2023-12-27 20:27:42,313][106226] Updated weights for policy 0, policy_version 171426 (0.0007) [2023-12-27 20:27:42,382][106226] Updated weights for policy 0, policy_version 171436 (0.0008) [2023-12-27 20:27:42,445][106226] Updated weights for policy 0, policy_version 171446 (0.0009) [2023-12-27 20:27:42,506][106226] Updated weights for policy 0, policy_version 171456 (0.0009) [2023-12-27 20:27:42,884][106225] Updated weights for policy 1, policy_version 171753 (0.0006) [2023-12-27 20:27:42,943][106225] Updated weights for policy 1, policy_version 171763 (0.0006) [2023-12-27 20:27:43,003][106225] Updated weights for policy 1, policy_version 171773 (0.0007) [2023-12-27 20:27:43,192][106226] Updated weights for policy 0, policy_version 171466 (0.0008) [2023-12-27 20:27:43,262][106226] Updated weights for policy 0, policy_version 171476 (0.0008) [2023-12-27 20:27:43,311][106226] Updated weights for policy 0, policy_version 171486 (0.0009) [2023-12-27 20:27:43,678][106225] Updated weights for policy 1, policy_version 171783 (0.0007) [2023-12-27 20:27:43,739][106225] Updated weights for policy 1, policy_version 171793 (0.0009) [2023-12-27 20:27:43,802][106225] Updated weights for policy 1, policy_version 171803 (0.0011) [2023-12-27 20:27:44,009][106226] Updated weights for policy 0, policy_version 171496 (0.0008) [2023-12-27 20:27:44,064][106226] Updated weights for policy 0, policy_version 171506 (0.0008) [2023-12-27 20:27:44,120][106226] Updated weights for policy 0, policy_version 171516 (0.0008) [2023-12-27 20:27:44,494][106225] Updated weights for policy 1, policy_version 171813 (0.0011) [2023-12-27 20:27:44,563][106225] Updated weights for policy 1, policy_version 171823 (0.0010) [2023-12-27 20:27:44,626][106225] Updated weights for policy 1, policy_version 171833 (0.0007) [2023-12-27 20:27:44,810][106226] Updated weights for policy 0, policy_version 171526 (0.0008) [2023-12-27 20:27:44,875][106226] Updated weights for policy 0, policy_version 171536 (0.0008) [2023-12-27 20:27:44,937][106226] Updated weights for policy 0, policy_version 171546 (0.0006) [2023-12-27 20:27:45,332][106225] Updated weights for policy 1, policy_version 171843 (0.0006) [2023-12-27 20:27:45,399][106225] Updated weights for policy 1, policy_version 171853 (0.0009) [2023-12-27 20:27:45,465][106225] Updated weights for policy 1, policy_version 171863 (0.0008) [2023-12-27 20:27:45,680][106226] Updated weights for policy 0, policy_version 171556 (0.0008) [2023-12-27 20:27:45,738][106226] Updated weights for policy 0, policy_version 171566 (0.0011) [2023-12-27 20:27:45,796][106226] Updated weights for policy 0, policy_version 171576 (0.0010) [2023-12-27 20:27:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 87941120. Throughput: 0: 9786.4, 1: 9976.1. Samples: 87933948. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:46,175][105115] Avg episode reward: [(0, '-5.353'), (1, '-6.654')] [2023-12-27 20:27:46,197][106225] Updated weights for policy 1, policy_version 171873 (0.0008) [2023-12-27 20:27:46,257][106225] Updated weights for policy 1, policy_version 171883 (0.0008) [2023-12-27 20:27:46,322][106225] Updated weights for policy 1, policy_version 171893 (0.0005) [2023-12-27 20:27:46,391][106225] Updated weights for policy 1, policy_version 171903 (0.0009) [2023-12-27 20:27:46,414][106226] Updated weights for policy 0, policy_version 171586 (0.0009) [2023-12-27 20:27:46,462][106226] Updated weights for policy 0, policy_version 171596 (0.0005) [2023-12-27 20:27:46,522][106226] Updated weights for policy 0, policy_version 171606 (0.0005) [2023-12-27 20:27:46,584][106226] Updated weights for policy 0, policy_version 171616 (0.0007) [2023-12-27 20:27:47,037][106225] Updated weights for policy 1, policy_version 171913 (0.0009) [2023-12-27 20:27:47,088][106225] Updated weights for policy 1, policy_version 171923 (0.0010) [2023-12-27 20:27:47,141][106225] Updated weights for policy 1, policy_version 171933 (0.0010) [2023-12-27 20:27:47,181][106226] Updated weights for policy 0, policy_version 171626 (0.0010) [2023-12-27 20:27:47,243][106226] Updated weights for policy 0, policy_version 171636 (0.0010) [2023-12-27 20:27:47,306][106226] Updated weights for policy 0, policy_version 171646 (0.0010) [2023-12-27 20:27:47,860][106225] Updated weights for policy 1, policy_version 171943 (0.0010) [2023-12-27 20:27:47,881][106226] Updated weights for policy 0, policy_version 171656 (0.0006) [2023-12-27 20:27:47,916][106225] Updated weights for policy 1, policy_version 171953 (0.0010) [2023-12-27 20:27:47,935][106226] Updated weights for policy 0, policy_version 171666 (0.0008) [2023-12-27 20:27:47,967][106225] Updated weights for policy 1, policy_version 171963 (0.0010) [2023-12-27 20:27:47,981][106226] Updated weights for policy 0, policy_version 171676 (0.0010) [2023-12-27 20:27:48,627][106226] Updated weights for policy 0, policy_version 171686 (0.0009) [2023-12-27 20:27:48,694][106226] Updated weights for policy 0, policy_version 171696 (0.0011) [2023-12-27 20:27:48,697][106225] Updated weights for policy 1, policy_version 171973 (0.0009) [2023-12-27 20:27:48,747][106225] Updated weights for policy 1, policy_version 171983 (0.0010) [2023-12-27 20:27:48,752][106226] Updated weights for policy 0, policy_version 171706 (0.0011) [2023-12-27 20:27:48,812][106225] Updated weights for policy 1, policy_version 171993 (0.0010) [2023-12-27 20:27:49,440][106226] Updated weights for policy 0, policy_version 171716 (0.0011) [2023-12-27 20:27:49,501][106226] Updated weights for policy 0, policy_version 171726 (0.0010) [2023-12-27 20:27:49,528][106225] Updated weights for policy 1, policy_version 172003 (0.0011) [2023-12-27 20:27:49,561][106226] Updated weights for policy 0, policy_version 171736 (0.0010) [2023-12-27 20:27:49,585][106225] Updated weights for policy 1, policy_version 172013 (0.0010) [2023-12-27 20:27:49,646][106225] Updated weights for policy 1, policy_version 172023 (0.0010) [2023-12-27 20:27:50,253][106226] Updated weights for policy 0, policy_version 171746 (0.0007) [2023-12-27 20:27:50,302][106225] Updated weights for policy 1, policy_version 172033 (0.0010) [2023-12-27 20:27:50,320][106226] Updated weights for policy 0, policy_version 171756 (0.0005) [2023-12-27 20:27:50,369][106225] Updated weights for policy 1, policy_version 172043 (0.0006) [2023-12-27 20:27:50,377][106226] Updated weights for policy 0, policy_version 171766 (0.0009) [2023-12-27 20:27:50,430][106225] Updated weights for policy 1, policy_version 172053 (0.0006) [2023-12-27 20:27:50,435][106226] Updated weights for policy 0, policy_version 171776 (0.0010) [2023-12-27 20:27:50,487][106225] Updated weights for policy 1, policy_version 172063 (0.0007) [2023-12-27 20:27:51,117][106226] Updated weights for policy 0, policy_version 171786 (0.0011) [2023-12-27 20:27:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 88039424. Throughput: 0: 9858.6, 1: 9962.0. Samples: 88055856. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:51,175][105115] Avg episode reward: [(0, '-5.664'), (1, '-6.032')] [2023-12-27 20:27:51,182][106226] Updated weights for policy 0, policy_version 171796 (0.0009) [2023-12-27 20:27:51,200][106225] Updated weights for policy 1, policy_version 172073 (0.0006) [2023-12-27 20:27:51,233][106226] Updated weights for policy 0, policy_version 171806 (0.0011) [2023-12-27 20:27:51,270][106225] Updated weights for policy 1, policy_version 172083 (0.0006) [2023-12-27 20:27:51,329][106225] Updated weights for policy 1, policy_version 172093 (0.0009) [2023-12-27 20:27:51,982][106226] Updated weights for policy 0, policy_version 171816 (0.0010) [2023-12-27 20:27:52,017][106225] Updated weights for policy 1, policy_version 172103 (0.0007) [2023-12-27 20:27:52,040][106226] Updated weights for policy 0, policy_version 171826 (0.0007) [2023-12-27 20:27:52,082][106225] Updated weights for policy 1, policy_version 172113 (0.0007) [2023-12-27 20:27:52,094][106226] Updated weights for policy 0, policy_version 171836 (0.0009) [2023-12-27 20:27:52,147][106225] Updated weights for policy 1, policy_version 172123 (0.0010) [2023-12-27 20:27:52,803][106226] Updated weights for policy 0, policy_version 171846 (0.0008) [2023-12-27 20:27:52,850][106225] Updated weights for policy 1, policy_version 172133 (0.0008) [2023-12-27 20:27:52,856][106226] Updated weights for policy 0, policy_version 171856 (0.0006) [2023-12-27 20:27:52,905][106226] Updated weights for policy 0, policy_version 171866 (0.0008) [2023-12-27 20:27:52,911][106225] Updated weights for policy 1, policy_version 172143 (0.0010) [2023-12-27 20:27:52,965][106225] Updated weights for policy 1, policy_version 172153 (0.0010) [2023-12-27 20:27:53,590][106226] Updated weights for policy 0, policy_version 171877 (0.0007) [2023-12-27 20:27:53,649][106226] Updated weights for policy 0, policy_version 171887 (0.0006) [2023-12-27 20:27:53,649][106225] Updated weights for policy 1, policy_version 172163 (0.0010) [2023-12-27 20:27:53,711][106226] Updated weights for policy 0, policy_version 171897 (0.0007) [2023-12-27 20:27:53,712][106225] Updated weights for policy 1, policy_version 172173 (0.0008) [2023-12-27 20:27:53,769][106225] Updated weights for policy 1, policy_version 172183 (0.0008) [2023-12-27 20:27:54,308][106226] Updated weights for policy 0, policy_version 171907 (0.0010) [2023-12-27 20:27:54,363][106226] Updated weights for policy 0, policy_version 171917 (0.0006) [2023-12-27 20:27:54,418][106226] Updated weights for policy 0, policy_version 171927 (0.0006) [2023-12-27 20:27:54,462][106225] Updated weights for policy 1, policy_version 172193 (0.0008) [2023-12-27 20:27:54,523][106225] Updated weights for policy 1, policy_version 172203 (0.0005) [2023-12-27 20:27:54,584][106225] Updated weights for policy 1, policy_version 172213 (0.0005) [2023-12-27 20:27:54,646][106225] Updated weights for policy 1, policy_version 172223 (0.0005) [2023-12-27 20:27:55,017][106226] Updated weights for policy 0, policy_version 171937 (0.0006) [2023-12-27 20:27:55,078][106226] Updated weights for policy 0, policy_version 171947 (0.0008) [2023-12-27 20:27:55,131][106226] Updated weights for policy 0, policy_version 171957 (0.0008) [2023-12-27 20:27:55,152][106225] Updated weights for policy 1, policy_version 172233 (0.0005) [2023-12-27 20:27:55,179][106226] Updated weights for policy 0, policy_version 171967 (0.0008) [2023-12-27 20:27:55,201][106225] Updated weights for policy 1, policy_version 172243 (0.0005) [2023-12-27 20:27:55,260][106225] Updated weights for policy 1, policy_version 172253 (0.0005) [2023-12-27 20:27:55,839][106225] Updated weights for policy 1, policy_version 172263 (0.0005) [2023-12-27 20:27:55,849][106226] Updated weights for policy 0, policy_version 171977 (0.0010) [2023-12-27 20:27:55,898][106225] Updated weights for policy 1, policy_version 172273 (0.0009) [2023-12-27 20:27:55,910][106226] Updated weights for policy 0, policy_version 171987 (0.0011) [2023-12-27 20:27:55,954][106225] Updated weights for policy 1, policy_version 172283 (0.0010) [2023-12-27 20:27:55,966][106226] Updated weights for policy 0, policy_version 171997 (0.0010) [2023-12-27 20:27:56,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 88154112. Throughput: 0: 9895.7, 1: 9916.5. Samples: 88115140. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:27:56,176][105115] Avg episode reward: [(0, '-5.628'), (1, '-6.869')] [2023-12-27 20:27:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000172000_44040192.pth... [2023-12-27 20:27:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000172288_44113920.pth... [2023-12-27 20:27:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000170816_43737088.pth [2023-12-27 20:27:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000171104_43810816.pth [2023-12-27 20:27:56,613][106225] Updated weights for policy 1, policy_version 172293 (0.0010) [2023-12-27 20:27:56,622][106226] Updated weights for policy 0, policy_version 172007 (0.0010) [2023-12-27 20:27:56,662][106225] Updated weights for policy 1, policy_version 172303 (0.0010) [2023-12-27 20:27:56,672][106226] Updated weights for policy 0, policy_version 172017 (0.0010) [2023-12-27 20:27:56,712][106225] Updated weights for policy 1, policy_version 172313 (0.0010) [2023-12-27 20:27:56,725][106226] Updated weights for policy 0, policy_version 172027 (0.0010) [2023-12-27 20:27:57,437][106225] Updated weights for policy 1, policy_version 172323 (0.0010) [2023-12-27 20:27:57,443][106226] Updated weights for policy 0, policy_version 172037 (0.0010) [2023-12-27 20:27:57,496][106226] Updated weights for policy 0, policy_version 172047 (0.0010) [2023-12-27 20:27:57,497][106225] Updated weights for policy 1, policy_version 172333 (0.0005) [2023-12-27 20:27:57,553][106225] Updated weights for policy 1, policy_version 172343 (0.0006) [2023-12-27 20:27:57,554][106226] Updated weights for policy 0, policy_version 172057 (0.0010) [2023-12-27 20:27:58,148][106226] Updated weights for policy 0, policy_version 172067 (0.0009) [2023-12-27 20:27:58,215][106226] Updated weights for policy 0, policy_version 172077 (0.0010) [2023-12-27 20:27:58,266][106226] Updated weights for policy 0, policy_version 172087 (0.0010) [2023-12-27 20:27:58,287][106225] Updated weights for policy 1, policy_version 172353 (0.0008) [2023-12-27 20:27:58,357][106225] Updated weights for policy 1, policy_version 172363 (0.0008) [2023-12-27 20:27:58,420][106225] Updated weights for policy 1, policy_version 172373 (0.0009) [2023-12-27 20:27:58,483][106225] Updated weights for policy 1, policy_version 172383 (0.0008) [2023-12-27 20:27:59,023][106226] Updated weights for policy 0, policy_version 172097 (0.0010) [2023-12-27 20:27:59,093][106226] Updated weights for policy 0, policy_version 172107 (0.0009) [2023-12-27 20:27:59,163][106226] Updated weights for policy 0, policy_version 172117 (0.0009) [2023-12-27 20:27:59,233][106226] Updated weights for policy 0, policy_version 172127 (0.0010) [2023-12-27 20:27:59,313][106225] Updated weights for policy 1, policy_version 172393 (0.0008) [2023-12-27 20:27:59,381][106225] Updated weights for policy 1, policy_version 172403 (0.0011) [2023-12-27 20:27:59,436][106225] Updated weights for policy 1, policy_version 172413 (0.0010) [2023-12-27 20:27:59,833][106226] Updated weights for policy 0, policy_version 172137 (0.0008) [2023-12-27 20:27:59,902][106226] Updated weights for policy 0, policy_version 172147 (0.0008) [2023-12-27 20:27:59,966][106226] Updated weights for policy 0, policy_version 172157 (0.0008) [2023-12-27 20:28:00,183][106225] Updated weights for policy 1, policy_version 172423 (0.0010) [2023-12-27 20:28:00,249][106225] Updated weights for policy 1, policy_version 172433 (0.0010) [2023-12-27 20:28:00,311][106225] Updated weights for policy 1, policy_version 172443 (0.0010) [2023-12-27 20:28:00,705][106226] Updated weights for policy 0, policy_version 172167 (0.0009) [2023-12-27 20:28:00,763][106226] Updated weights for policy 0, policy_version 172177 (0.0009) [2023-12-27 20:28:00,826][106226] Updated weights for policy 0, policy_version 172187 (0.0009) [2023-12-27 20:28:00,964][106225] Updated weights for policy 1, policy_version 172453 (0.0010) [2023-12-27 20:28:01,019][106225] Updated weights for policy 1, policy_version 172463 (0.0010) [2023-12-27 20:28:01,081][106225] Updated weights for policy 1, policy_version 172473 (0.0010) [2023-12-27 20:28:01,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 88252416. Throughput: 0: 10059.1, 1: 9947.2. Samples: 88238012. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:01,175][105115] Avg episode reward: [(0, '-5.320'), (1, '-6.418')] [2023-12-27 20:28:01,568][106226] Updated weights for policy 0, policy_version 172197 (0.0009) [2023-12-27 20:28:01,625][106226] Updated weights for policy 0, policy_version 172207 (0.0010) [2023-12-27 20:28:01,687][106226] Updated weights for policy 0, policy_version 172217 (0.0007) [2023-12-27 20:28:01,815][106225] Updated weights for policy 1, policy_version 172483 (0.0010) [2023-12-27 20:28:01,870][106225] Updated weights for policy 1, policy_version 172493 (0.0010) [2023-12-27 20:28:01,929][106225] Updated weights for policy 1, policy_version 172503 (0.0010) [2023-12-27 20:28:02,422][106226] Updated weights for policy 0, policy_version 172227 (0.0008) [2023-12-27 20:28:02,478][106226] Updated weights for policy 0, policy_version 172237 (0.0008) [2023-12-27 20:28:02,531][106226] Updated weights for policy 0, policy_version 172247 (0.0009) [2023-12-27 20:28:02,684][106225] Updated weights for policy 1, policy_version 172513 (0.0010) [2023-12-27 20:28:02,740][106225] Updated weights for policy 1, policy_version 172523 (0.0005) [2023-12-27 20:28:02,796][106225] Updated weights for policy 1, policy_version 172533 (0.0005) [2023-12-27 20:28:02,862][106225] Updated weights for policy 1, policy_version 172543 (0.0006) [2023-12-27 20:28:03,340][106226] Updated weights for policy 0, policy_version 172257 (0.0008) [2023-12-27 20:28:03,388][106226] Updated weights for policy 0, policy_version 172267 (0.0006) [2023-12-27 20:28:03,397][106225] Updated weights for policy 1, policy_version 172553 (0.0008) [2023-12-27 20:28:03,437][106226] Updated weights for policy 0, policy_version 172277 (0.0005) [2023-12-27 20:28:03,453][106225] Updated weights for policy 1, policy_version 172563 (0.0008) [2023-12-27 20:28:03,484][106226] Updated weights for policy 0, policy_version 172287 (0.0008) [2023-12-27 20:28:03,506][106225] Updated weights for policy 1, policy_version 172573 (0.0008) [2023-12-27 20:28:04,142][106225] Updated weights for policy 1, policy_version 172583 (0.0008) [2023-12-27 20:28:04,169][106226] Updated weights for policy 0, policy_version 172297 (0.0010) [2023-12-27 20:28:04,206][106225] Updated weights for policy 1, policy_version 172593 (0.0007) [2023-12-27 20:28:04,228][106226] Updated weights for policy 0, policy_version 172307 (0.0010) [2023-12-27 20:28:04,265][106225] Updated weights for policy 1, policy_version 172603 (0.0006) [2023-12-27 20:28:04,293][106226] Updated weights for policy 0, policy_version 172317 (0.0011) [2023-12-27 20:28:04,960][106225] Updated weights for policy 1, policy_version 172613 (0.0006) [2023-12-27 20:28:04,976][106226] Updated weights for policy 0, policy_version 172327 (0.0010) [2023-12-27 20:28:05,022][106225] Updated weights for policy 1, policy_version 172623 (0.0005) [2023-12-27 20:28:05,033][106226] Updated weights for policy 0, policy_version 172337 (0.0010) [2023-12-27 20:28:05,083][106225] Updated weights for policy 1, policy_version 172633 (0.0005) [2023-12-27 20:28:05,084][106226] Updated weights for policy 0, policy_version 172347 (0.0010) [2023-12-27 20:28:05,600][106225] Updated weights for policy 1, policy_version 172643 (0.0005) [2023-12-27 20:28:05,640][106226] Updated weights for policy 0, policy_version 172357 (0.0008) [2023-12-27 20:28:05,660][106225] Updated weights for policy 1, policy_version 172653 (0.0005) [2023-12-27 20:28:05,694][106226] Updated weights for policy 0, policy_version 172367 (0.0006) [2023-12-27 20:28:05,721][106225] Updated weights for policy 1, policy_version 172663 (0.0008) [2023-12-27 20:28:05,746][106226] Updated weights for policy 0, policy_version 172377 (0.0005) [2023-12-27 20:28:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 88350720. Throughput: 0: 10167.6, 1: 9986.8. Samples: 88361548. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:06,175][105115] Avg episode reward: [(0, '-5.809'), (1, '-6.645')] [2023-12-27 20:28:06,266][106225] Updated weights for policy 1, policy_version 172673 (0.0005) [2023-12-27 20:28:06,328][106225] Updated weights for policy 1, policy_version 172683 (0.0008) [2023-12-27 20:28:06,387][106225] Updated weights for policy 1, policy_version 172693 (0.0008) [2023-12-27 20:28:06,397][106226] Updated weights for policy 0, policy_version 172387 (0.0007) [2023-12-27 20:28:06,447][106225] Updated weights for policy 1, policy_version 172703 (0.0007) [2023-12-27 20:28:06,459][106226] Updated weights for policy 0, policy_version 172397 (0.0006) [2023-12-27 20:28:06,523][106226] Updated weights for policy 0, policy_version 172407 (0.0010) [2023-12-27 20:28:07,177][106226] Updated weights for policy 0, policy_version 172417 (0.0010) [2023-12-27 20:28:07,229][106225] Updated weights for policy 1, policy_version 172713 (0.0009) [2023-12-27 20:28:07,236][106226] Updated weights for policy 0, policy_version 172427 (0.0007) [2023-12-27 20:28:07,292][106225] Updated weights for policy 1, policy_version 172723 (0.0008) [2023-12-27 20:28:07,302][106226] Updated weights for policy 0, policy_version 172437 (0.0006) [2023-12-27 20:28:07,355][106225] Updated weights for policy 1, policy_version 172733 (0.0009) [2023-12-27 20:28:07,365][106226] Updated weights for policy 0, policy_version 172447 (0.0007) [2023-12-27 20:28:07,944][106226] Updated weights for policy 0, policy_version 172457 (0.0010) [2023-12-27 20:28:08,004][106226] Updated weights for policy 0, policy_version 172467 (0.0010) [2023-12-27 20:28:08,060][106226] Updated weights for policy 0, policy_version 172477 (0.0010) [2023-12-27 20:28:08,127][106225] Updated weights for policy 1, policy_version 172743 (0.0007) [2023-12-27 20:28:08,180][106225] Updated weights for policy 1, policy_version 172753 (0.0007) [2023-12-27 20:28:08,239][106225] Updated weights for policy 1, policy_version 172763 (0.0007) [2023-12-27 20:28:08,716][106226] Updated weights for policy 0, policy_version 172487 (0.0009) [2023-12-27 20:28:08,767][106226] Updated weights for policy 0, policy_version 172497 (0.0010) [2023-12-27 20:28:08,821][106226] Updated weights for policy 0, policy_version 172507 (0.0010) [2023-12-27 20:28:08,979][106225] Updated weights for policy 1, policy_version 172773 (0.0009) [2023-12-27 20:28:09,037][106225] Updated weights for policy 1, policy_version 172783 (0.0010) [2023-12-27 20:28:09,093][106225] Updated weights for policy 1, policy_version 172793 (0.0010) [2023-12-27 20:28:09,589][106226] Updated weights for policy 0, policy_version 172517 (0.0011) [2023-12-27 20:28:09,646][106226] Updated weights for policy 0, policy_version 172527 (0.0010) [2023-12-27 20:28:09,711][106226] Updated weights for policy 0, policy_version 172537 (0.0011) [2023-12-27 20:28:09,817][106225] Updated weights for policy 1, policy_version 172803 (0.0007) [2023-12-27 20:28:09,884][106225] Updated weights for policy 1, policy_version 172813 (0.0011) [2023-12-27 20:28:09,947][106225] Updated weights for policy 1, policy_version 172823 (0.0011) [2023-12-27 20:28:10,471][106226] Updated weights for policy 0, policy_version 172547 (0.0011) [2023-12-27 20:28:10,532][106226] Updated weights for policy 0, policy_version 172557 (0.0010) [2023-12-27 20:28:10,590][106226] Updated weights for policy 0, policy_version 172567 (0.0011) [2023-12-27 20:28:10,596][106225] Updated weights for policy 1, policy_version 172833 (0.0007) [2023-12-27 20:28:10,646][106225] Updated weights for policy 1, policy_version 172843 (0.0010) [2023-12-27 20:28:10,697][106225] Updated weights for policy 1, policy_version 172853 (0.0010) [2023-12-27 20:28:10,760][106225] Updated weights for policy 1, policy_version 172863 (0.0011) [2023-12-27 20:28:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 88449024. Throughput: 0: 10216.9, 1: 9999.6. Samples: 88421576. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:11,175][105115] Avg episode reward: [(0, '-5.493'), (1, '-6.236')] [2023-12-27 20:28:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000172864_44261376.pth... [2023-12-27 20:28:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000172576_44187648.pth... [2023-12-27 20:28:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000171712_43966464.pth [2023-12-27 20:28:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000171392_43884544.pth [2023-12-27 20:28:11,333][106226] Updated weights for policy 0, policy_version 172577 (0.0010) [2023-12-27 20:28:11,406][106226] Updated weights for policy 0, policy_version 172587 (0.0010) [2023-12-27 20:28:11,468][106226] Updated weights for policy 0, policy_version 172597 (0.0009) [2023-12-27 20:28:11,519][106225] Updated weights for policy 1, policy_version 172873 (0.0007) [2023-12-27 20:28:11,522][106226] Updated weights for policy 0, policy_version 172607 (0.0007) [2023-12-27 20:28:11,584][106225] Updated weights for policy 1, policy_version 172883 (0.0009) [2023-12-27 20:28:11,660][106225] Updated weights for policy 1, policy_version 172893 (0.0009) [2023-12-27 20:28:12,333][106226] Updated weights for policy 0, policy_version 172617 (0.0008) [2023-12-27 20:28:12,372][106225] Updated weights for policy 1, policy_version 172903 (0.0009) [2023-12-27 20:28:12,405][106226] Updated weights for policy 0, policy_version 172627 (0.0008) [2023-12-27 20:28:12,432][106225] Updated weights for policy 1, policy_version 172913 (0.0007) [2023-12-27 20:28:12,474][106226] Updated weights for policy 0, policy_version 172637 (0.0008) [2023-12-27 20:28:12,491][106225] Updated weights for policy 1, policy_version 172923 (0.0008) [2023-12-27 20:28:13,154][106226] Updated weights for policy 0, policy_version 172647 (0.0006) [2023-12-27 20:28:13,182][106225] Updated weights for policy 1, policy_version 172933 (0.0008) [2023-12-27 20:28:13,210][106226] Updated weights for policy 0, policy_version 172657 (0.0008) [2023-12-27 20:28:13,241][106225] Updated weights for policy 1, policy_version 172943 (0.0007) [2023-12-27 20:28:13,269][106226] Updated weights for policy 0, policy_version 172667 (0.0008) [2023-12-27 20:28:13,303][106225] Updated weights for policy 1, policy_version 172953 (0.0007) [2023-12-27 20:28:13,893][106225] Updated weights for policy 1, policy_version 172963 (0.0007) [2023-12-27 20:28:13,948][106225] Updated weights for policy 1, policy_version 172973 (0.0008) [2023-12-27 20:28:14,001][106225] Updated weights for policy 1, policy_version 172983 (0.0009) [2023-12-27 20:28:14,021][106226] Updated weights for policy 0, policy_version 172677 (0.0007) [2023-12-27 20:28:14,073][106226] Updated weights for policy 0, policy_version 172687 (0.0008) [2023-12-27 20:28:14,124][106226] Updated weights for policy 0, policy_version 172697 (0.0008) [2023-12-27 20:28:14,656][106225] Updated weights for policy 1, policy_version 172993 (0.0009) [2023-12-27 20:28:14,716][106225] Updated weights for policy 1, policy_version 173003 (0.0007) [2023-12-27 20:28:14,775][106225] Updated weights for policy 1, policy_version 173013 (0.0009) [2023-12-27 20:28:14,796][106226] Updated weights for policy 0, policy_version 172707 (0.0009) [2023-12-27 20:28:14,833][106225] Updated weights for policy 1, policy_version 173023 (0.0009) [2023-12-27 20:28:14,860][106226] Updated weights for policy 0, policy_version 172717 (0.0007) [2023-12-27 20:28:14,927][106226] Updated weights for policy 0, policy_version 172727 (0.0008) [2023-12-27 20:28:15,571][106225] Updated weights for policy 1, policy_version 173033 (0.0010) [2023-12-27 20:28:15,630][106225] Updated weights for policy 1, policy_version 173043 (0.0010) [2023-12-27 20:28:15,654][106226] Updated weights for policy 0, policy_version 172737 (0.0009) [2023-12-27 20:28:15,701][106225] Updated weights for policy 1, policy_version 173053 (0.0011) [2023-12-27 20:28:15,719][106226] Updated weights for policy 0, policy_version 172747 (0.0007) [2023-12-27 20:28:15,776][106226] Updated weights for policy 0, policy_version 172757 (0.0007) [2023-12-27 20:28:15,830][106226] Updated weights for policy 0, policy_version 172767 (0.0007) [2023-12-27 20:28:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 88547328. Throughput: 0: 10077.6, 1: 9950.9. Samples: 88538580. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:16,175][105115] Avg episode reward: [(0, '-5.457'), (1, '-6.413')] [2023-12-27 20:28:16,433][106225] Updated weights for policy 1, policy_version 173063 (0.0007) [2023-12-27 20:28:16,489][106225] Updated weights for policy 1, policy_version 173073 (0.0007) [2023-12-27 20:28:16,540][106226] Updated weights for policy 0, policy_version 172777 (0.0006) [2023-12-27 20:28:16,545][106225] Updated weights for policy 1, policy_version 173083 (0.0010) [2023-12-27 20:28:16,596][106226] Updated weights for policy 0, policy_version 172787 (0.0008) [2023-12-27 20:28:16,656][106226] Updated weights for policy 0, policy_version 172797 (0.0010) [2023-12-27 20:28:17,138][106225] Updated weights for policy 1, policy_version 173093 (0.0010) [2023-12-27 20:28:17,204][106225] Updated weights for policy 1, policy_version 173103 (0.0010) [2023-12-27 20:28:17,242][106226] Updated weights for policy 0, policy_version 172807 (0.0007) [2023-12-27 20:28:17,261][106225] Updated weights for policy 1, policy_version 173113 (0.0007) [2023-12-27 20:28:17,292][106226] Updated weights for policy 0, policy_version 172817 (0.0008) [2023-12-27 20:28:17,345][106226] Updated weights for policy 0, policy_version 172827 (0.0008) [2023-12-27 20:28:17,799][106225] Updated weights for policy 1, policy_version 173123 (0.0007) [2023-12-27 20:28:17,845][106225] Updated weights for policy 1, policy_version 173133 (0.0010) [2023-12-27 20:28:17,894][106225] Updated weights for policy 1, policy_version 173143 (0.0007) [2023-12-27 20:28:18,193][106226] Updated weights for policy 0, policy_version 172837 (0.0009) [2023-12-27 20:28:18,259][106226] Updated weights for policy 0, policy_version 172847 (0.0008) [2023-12-27 20:28:18,324][106226] Updated weights for policy 0, policy_version 172857 (0.0008) [2023-12-27 20:28:18,514][106225] Updated weights for policy 1, policy_version 173153 (0.0005) [2023-12-27 20:28:18,577][106225] Updated weights for policy 1, policy_version 173163 (0.0007) [2023-12-27 20:28:18,644][106225] Updated weights for policy 1, policy_version 173173 (0.0009) [2023-12-27 20:28:18,708][106225] Updated weights for policy 1, policy_version 173183 (0.0009) [2023-12-27 20:28:18,981][106226] Updated weights for policy 0, policy_version 172867 (0.0009) [2023-12-27 20:28:19,037][106226] Updated weights for policy 0, policy_version 172877 (0.0010) [2023-12-27 20:28:19,093][106226] Updated weights for policy 0, policy_version 172887 (0.0010) [2023-12-27 20:28:19,290][106225] Updated weights for policy 1, policy_version 173193 (0.0008) [2023-12-27 20:28:19,342][106225] Updated weights for policy 1, policy_version 173203 (0.0008) [2023-12-27 20:28:19,406][106225] Updated weights for policy 1, policy_version 173213 (0.0008) [2023-12-27 20:28:19,785][106226] Updated weights for policy 0, policy_version 172897 (0.0010) [2023-12-27 20:28:19,852][106226] Updated weights for policy 0, policy_version 172907 (0.0008) [2023-12-27 20:28:19,919][106226] Updated weights for policy 0, policy_version 172917 (0.0011) [2023-12-27 20:28:19,989][106226] Updated weights for policy 0, policy_version 172927 (0.0009) [2023-12-27 20:28:20,108][106225] Updated weights for policy 1, policy_version 173223 (0.0008) [2023-12-27 20:28:20,170][106225] Updated weights for policy 1, policy_version 173233 (0.0008) [2023-12-27 20:28:20,233][106225] Updated weights for policy 1, policy_version 173243 (0.0008) [2023-12-27 20:28:20,713][106226] Updated weights for policy 0, policy_version 172937 (0.0008) [2023-12-27 20:28:20,778][106226] Updated weights for policy 0, policy_version 172947 (0.0010) [2023-12-27 20:28:20,840][106226] Updated weights for policy 0, policy_version 172957 (0.0009) [2023-12-27 20:28:20,970][106225] Updated weights for policy 1, policy_version 173253 (0.0007) [2023-12-27 20:28:21,027][106225] Updated weights for policy 1, policy_version 173263 (0.0007) [2023-12-27 20:28:21,091][106225] Updated weights for policy 1, policy_version 173273 (0.0007) [2023-12-27 20:28:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 88653824. Throughput: 0: 10003.7, 1: 10058.5. Samples: 88658508. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:21,175][105115] Avg episode reward: [(0, '-5.626'), (1, '-6.753')] [2023-12-27 20:28:21,622][106226] Updated weights for policy 0, policy_version 172967 (0.0009) [2023-12-27 20:28:21,688][106226] Updated weights for policy 0, policy_version 172977 (0.0009) [2023-12-27 20:28:21,758][106226] Updated weights for policy 0, policy_version 172987 (0.0009) [2023-12-27 20:28:21,888][106225] Updated weights for policy 1, policy_version 173283 (0.0009) [2023-12-27 20:28:21,937][106225] Updated weights for policy 1, policy_version 173293 (0.0008) [2023-12-27 20:28:21,997][106225] Updated weights for policy 1, policy_version 173303 (0.0008) [2023-12-27 20:28:22,525][106226] Updated weights for policy 0, policy_version 172997 (0.0009) [2023-12-27 20:28:22,581][106226] Updated weights for policy 0, policy_version 173007 (0.0008) [2023-12-27 20:28:22,643][106226] Updated weights for policy 0, policy_version 173017 (0.0009) [2023-12-27 20:28:22,793][106225] Updated weights for policy 1, policy_version 173313 (0.0009) [2023-12-27 20:28:22,858][106225] Updated weights for policy 1, policy_version 173323 (0.0008) [2023-12-27 20:28:22,917][106225] Updated weights for policy 1, policy_version 173333 (0.0009) [2023-12-27 20:28:22,980][106225] Updated weights for policy 1, policy_version 173343 (0.0008) [2023-12-27 20:28:23,401][106226] Updated weights for policy 0, policy_version 173027 (0.0008) [2023-12-27 20:28:23,457][106226] Updated weights for policy 0, policy_version 173037 (0.0009) [2023-12-27 20:28:23,511][106226] Updated weights for policy 0, policy_version 173047 (0.0007) [2023-12-27 20:28:23,660][106225] Updated weights for policy 1, policy_version 173353 (0.0009) [2023-12-27 20:28:23,714][106225] Updated weights for policy 1, policy_version 173363 (0.0009) [2023-12-27 20:28:23,764][106225] Updated weights for policy 1, policy_version 173373 (0.0005) [2023-12-27 20:28:24,264][106226] Updated weights for policy 0, policy_version 173057 (0.0008) [2023-12-27 20:28:24,327][106226] Updated weights for policy 0, policy_version 173067 (0.0008) [2023-12-27 20:28:24,387][106226] Updated weights for policy 0, policy_version 173077 (0.0009) [2023-12-27 20:28:24,444][106226] Updated weights for policy 0, policy_version 173087 (0.0008) [2023-12-27 20:28:24,486][106225] Updated weights for policy 1, policy_version 173383 (0.0007) [2023-12-27 20:28:24,535][106225] Updated weights for policy 1, policy_version 173393 (0.0009) [2023-12-27 20:28:24,583][106225] Updated weights for policy 1, policy_version 173403 (0.0008) [2023-12-27 20:28:25,131][106226] Updated weights for policy 0, policy_version 173097 (0.0009) [2023-12-27 20:28:25,190][106226] Updated weights for policy 0, policy_version 173107 (0.0009) [2023-12-27 20:28:25,247][106226] Updated weights for policy 0, policy_version 173117 (0.0009) [2023-12-27 20:28:25,356][106225] Updated weights for policy 1, policy_version 173413 (0.0008) [2023-12-27 20:28:25,404][106225] Updated weights for policy 1, policy_version 173423 (0.0009) [2023-12-27 20:28:25,457][106225] Updated weights for policy 1, policy_version 173433 (0.0009) [2023-12-27 20:28:25,841][106226] Updated weights for policy 0, policy_version 173127 (0.0009) [2023-12-27 20:28:25,900][106226] Updated weights for policy 0, policy_version 173137 (0.0009) [2023-12-27 20:28:25,963][106226] Updated weights for policy 0, policy_version 173147 (0.0009) [2023-12-27 20:28:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 88743936. Throughput: 0: 9974.9, 1: 9972.7. Samples: 88714988. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:26,175][105115] Avg episode reward: [(0, '-5.642'), (1, '-6.267')] [2023-12-27 20:28:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000173440_44408832.pth... [2023-12-27 20:28:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000173152_44335104.pth... [2023-12-27 20:28:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000172288_44113920.pth [2023-12-27 20:28:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000172000_44040192.pth [2023-12-27 20:28:26,244][106225] Updated weights for policy 1, policy_version 173443 (0.0008) [2023-12-27 20:28:26,293][106225] Updated weights for policy 1, policy_version 173453 (0.0005) [2023-12-27 20:28:26,343][106225] Updated weights for policy 1, policy_version 173463 (0.0006) [2023-12-27 20:28:26,610][106226] Updated weights for policy 0, policy_version 173157 (0.0007) [2023-12-27 20:28:26,664][106226] Updated weights for policy 0, policy_version 173167 (0.0005) [2023-12-27 20:28:26,717][106226] Updated weights for policy 0, policy_version 173177 (0.0005) [2023-12-27 20:28:27,138][106225] Updated weights for policy 1, policy_version 173473 (0.0009) [2023-12-27 20:28:27,189][106225] Updated weights for policy 1, policy_version 173483 (0.0008) [2023-12-27 20:28:27,241][106225] Updated weights for policy 1, policy_version 173493 (0.0008) [2023-12-27 20:28:27,283][106226] Updated weights for policy 0, policy_version 173187 (0.0005) [2023-12-27 20:28:27,299][106225] Updated weights for policy 1, policy_version 173503 (0.0008) [2023-12-27 20:28:27,337][106226] Updated weights for policy 0, policy_version 173197 (0.0008) [2023-12-27 20:28:27,395][106226] Updated weights for policy 0, policy_version 173207 (0.0008) [2023-12-27 20:28:27,999][106226] Updated weights for policy 0, policy_version 173217 (0.0008) [2023-12-27 20:28:28,056][106226] Updated weights for policy 0, policy_version 173227 (0.0009) [2023-12-27 20:28:28,066][106225] Updated weights for policy 1, policy_version 173513 (0.0006) [2023-12-27 20:28:28,106][106226] Updated weights for policy 0, policy_version 173237 (0.0010) [2023-12-27 20:28:28,112][106225] Updated weights for policy 1, policy_version 173523 (0.0006) [2023-12-27 20:28:28,161][106225] Updated weights for policy 1, policy_version 173533 (0.0006) [2023-12-27 20:28:28,162][106226] Updated weights for policy 0, policy_version 173247 (0.0010) [2023-12-27 20:28:28,843][106226] Updated weights for policy 0, policy_version 173257 (0.0009) [2023-12-27 20:28:28,896][106226] Updated weights for policy 0, policy_version 173267 (0.0007) [2023-12-27 20:28:28,925][106225] Updated weights for policy 1, policy_version 173543 (0.0008) [2023-12-27 20:28:28,953][106226] Updated weights for policy 0, policy_version 173277 (0.0006) [2023-12-27 20:28:28,980][106225] Updated weights for policy 1, policy_version 173554 (0.0008) [2023-12-27 20:28:29,030][106225] Updated weights for policy 1, policy_version 173564 (0.0008) [2023-12-27 20:28:29,603][106226] Updated weights for policy 0, policy_version 173287 (0.0006) [2023-12-27 20:28:29,662][106226] Updated weights for policy 0, policy_version 173297 (0.0005) [2023-12-27 20:28:29,722][106226] Updated weights for policy 0, policy_version 173307 (0.0007) [2023-12-27 20:28:29,747][106225] Updated weights for policy 1, policy_version 173574 (0.0007) [2023-12-27 20:28:29,813][106225] Updated weights for policy 1, policy_version 173584 (0.0007) [2023-12-27 20:28:29,874][106225] Updated weights for policy 1, policy_version 173594 (0.0008) [2023-12-27 20:28:30,433][106226] Updated weights for policy 0, policy_version 173317 (0.0007) [2023-12-27 20:28:30,488][106226] Updated weights for policy 0, policy_version 173327 (0.0007) [2023-12-27 20:28:30,524][106225] Updated weights for policy 1, policy_version 173604 (0.0005) [2023-12-27 20:28:30,535][106226] Updated weights for policy 0, policy_version 173337 (0.0007) [2023-12-27 20:28:30,586][106225] Updated weights for policy 1, policy_version 173614 (0.0009) [2023-12-27 20:28:30,644][106225] Updated weights for policy 1, policy_version 173624 (0.0009) [2023-12-27 20:28:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 88842240. Throughput: 0: 10067.6, 1: 9967.4. Samples: 88835524. Policy #0 lag: (min: 7.0, avg: 7.5, max: 24.0) [2023-12-27 20:28:31,175][105115] Avg episode reward: [(0, '-5.526'), (1, '-6.540')] [2023-12-27 20:28:31,250][106226] Updated weights for policy 0, policy_version 173347 (0.0008) [2023-12-27 20:28:31,318][106226] Updated weights for policy 0, policy_version 173357 (0.0008) [2023-12-27 20:28:31,389][106226] Updated weights for policy 0, policy_version 173367 (0.0007) [2023-12-27 20:28:31,420][106225] Updated weights for policy 1, policy_version 173634 (0.0009) [2023-12-27 20:28:31,483][106225] Updated weights for policy 1, policy_version 173644 (0.0010) [2023-12-27 20:28:31,552][106225] Updated weights for policy 1, policy_version 173654 (0.0010) [2023-12-27 20:28:31,622][106225] Updated weights for policy 1, policy_version 173664 (0.0010) [2023-12-27 20:28:32,051][106226] Updated weights for policy 0, policy_version 173377 (0.0006) [2023-12-27 20:28:32,105][106226] Updated weights for policy 0, policy_version 173387 (0.0008) [2023-12-27 20:28:32,159][106226] Updated weights for policy 0, policy_version 173397 (0.0009) [2023-12-27 20:28:32,221][106226] Updated weights for policy 0, policy_version 173407 (0.0007) [2023-12-27 20:28:32,308][106225] Updated weights for policy 1, policy_version 173674 (0.0010) [2023-12-27 20:28:32,369][106225] Updated weights for policy 1, policy_version 173684 (0.0010) [2023-12-27 20:28:32,434][106225] Updated weights for policy 1, policy_version 173694 (0.0010) [2023-12-27 20:28:32,920][106226] Updated weights for policy 0, policy_version 173417 (0.0007) [2023-12-27 20:28:32,970][106226] Updated weights for policy 0, policy_version 173427 (0.0008) [2023-12-27 20:28:33,022][106226] Updated weights for policy 0, policy_version 173437 (0.0007) [2023-12-27 20:28:33,149][106225] Updated weights for policy 1, policy_version 173704 (0.0006) [2023-12-27 20:28:33,214][106225] Updated weights for policy 1, policy_version 173714 (0.0005) [2023-12-27 20:28:33,280][106225] Updated weights for policy 1, policy_version 173724 (0.0007) [2023-12-27 20:28:33,765][106226] Updated weights for policy 0, policy_version 173447 (0.0009) [2023-12-27 20:28:33,822][106226] Updated weights for policy 0, policy_version 173457 (0.0010) [2023-12-27 20:28:33,849][106225] Updated weights for policy 1, policy_version 173734 (0.0007) [2023-12-27 20:28:33,871][106226] Updated weights for policy 0, policy_version 173467 (0.0007) [2023-12-27 20:28:33,905][106225] Updated weights for policy 1, policy_version 173744 (0.0005) [2023-12-27 20:28:33,966][106225] Updated weights for policy 1, policy_version 173754 (0.0007) [2023-12-27 20:28:34,594][106225] Updated weights for policy 1, policy_version 173764 (0.0006) [2023-12-27 20:28:34,644][106225] Updated weights for policy 1, policy_version 173774 (0.0006) [2023-12-27 20:28:34,667][106226] Updated weights for policy 0, policy_version 173477 (0.0008) [2023-12-27 20:28:34,702][106225] Updated weights for policy 1, policy_version 173784 (0.0006) [2023-12-27 20:28:34,725][106226] Updated weights for policy 0, policy_version 173487 (0.0008) [2023-12-27 20:28:34,778][106226] Updated weights for policy 0, policy_version 173497 (0.0007) [2023-12-27 20:28:35,334][106225] Updated weights for policy 1, policy_version 173794 (0.0009) [2023-12-27 20:28:35,387][106225] Updated weights for policy 1, policy_version 173804 (0.0005) [2023-12-27 20:28:35,436][106225] Updated weights for policy 1, policy_version 173814 (0.0005) [2023-12-27 20:28:35,484][106225] Updated weights for policy 1, policy_version 173824 (0.0005) [2023-12-27 20:28:35,526][106226] Updated weights for policy 0, policy_version 173507 (0.0006) [2023-12-27 20:28:35,580][106226] Updated weights for policy 0, policy_version 173517 (0.0009) [2023-12-27 20:28:35,643][106226] Updated weights for policy 0, policy_version 173527 (0.0009) [2023-12-27 20:28:36,094][106225] Updated weights for policy 1, policy_version 173834 (0.0009) [2023-12-27 20:28:36,160][106225] Updated weights for policy 1, policy_version 173844 (0.0009) [2023-12-27 20:28:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 88940544. Throughput: 0: 9939.6, 1: 10037.1. Samples: 88954804. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:28:36,175][105115] Avg episode reward: [(0, '-5.338'), (1, '-6.373')] [2023-12-27 20:28:36,222][106225] Updated weights for policy 1, policy_version 173854 (0.0010) [2023-12-27 20:28:36,407][106226] Updated weights for policy 0, policy_version 173537 (0.0009) [2023-12-27 20:28:36,464][106226] Updated weights for policy 0, policy_version 173547 (0.0007) [2023-12-27 20:28:36,526][106226] Updated weights for policy 0, policy_version 173557 (0.0008) [2023-12-27 20:28:36,590][106226] Updated weights for policy 0, policy_version 173567 (0.0008) [2023-12-27 20:28:36,940][106225] Updated weights for policy 1, policy_version 173864 (0.0010) [2023-12-27 20:28:36,994][106225] Updated weights for policy 1, policy_version 173874 (0.0010) [2023-12-27 20:28:37,041][106225] Updated weights for policy 1, policy_version 173884 (0.0010) [2023-12-27 20:28:37,346][106226] Updated weights for policy 0, policy_version 173577 (0.0007) [2023-12-27 20:28:37,404][106226] Updated weights for policy 0, policy_version 173587 (0.0008) [2023-12-27 20:28:37,467][106226] Updated weights for policy 0, policy_version 173597 (0.0008) [2023-12-27 20:28:37,721][106225] Updated weights for policy 1, policy_version 173894 (0.0009) [2023-12-27 20:28:37,771][106225] Updated weights for policy 1, policy_version 173904 (0.0005) [2023-12-27 20:28:37,830][106225] Updated weights for policy 1, policy_version 173914 (0.0007) [2023-12-27 20:28:38,252][106226] Updated weights for policy 0, policy_version 173607 (0.0010) [2023-12-27 20:28:38,315][106226] Updated weights for policy 0, policy_version 173617 (0.0008) [2023-12-27 20:28:38,390][106226] Updated weights for policy 0, policy_version 173627 (0.0007) [2023-12-27 20:28:38,445][106225] Updated weights for policy 1, policy_version 173924 (0.0008) [2023-12-27 20:28:38,507][106225] Updated weights for policy 1, policy_version 173934 (0.0008) [2023-12-27 20:28:38,564][106225] Updated weights for policy 1, policy_version 173944 (0.0010) [2023-12-27 20:28:39,055][106226] Updated weights for policy 0, policy_version 173637 (0.0007) [2023-12-27 20:28:39,106][106226] Updated weights for policy 0, policy_version 173647 (0.0009) [2023-12-27 20:28:39,153][106226] Updated weights for policy 0, policy_version 173657 (0.0010) [2023-12-27 20:28:39,336][106225] Updated weights for policy 1, policy_version 173954 (0.0010) [2023-12-27 20:28:39,411][106225] Updated weights for policy 1, policy_version 173964 (0.0008) [2023-12-27 20:28:39,477][106225] Updated weights for policy 1, policy_version 173974 (0.0007) [2023-12-27 20:28:39,537][106225] Updated weights for policy 1, policy_version 173984 (0.0008) [2023-12-27 20:28:39,889][106226] Updated weights for policy 0, policy_version 173667 (0.0009) [2023-12-27 20:28:39,952][106226] Updated weights for policy 0, policy_version 173677 (0.0007) [2023-12-27 20:28:40,018][106226] Updated weights for policy 0, policy_version 173687 (0.0008) [2023-12-27 20:28:40,256][106225] Updated weights for policy 1, policy_version 173994 (0.0007) [2023-12-27 20:28:40,317][106225] Updated weights for policy 1, policy_version 174004 (0.0008) [2023-12-27 20:28:40,379][106225] Updated weights for policy 1, policy_version 174014 (0.0007) [2023-12-27 20:28:40,736][106226] Updated weights for policy 0, policy_version 173697 (0.0008) [2023-12-27 20:28:40,792][106226] Updated weights for policy 0, policy_version 173707 (0.0005) [2023-12-27 20:28:40,841][106226] Updated weights for policy 0, policy_version 173717 (0.0005) [2023-12-27 20:28:40,896][106226] Updated weights for policy 0, policy_version 173727 (0.0005) [2023-12-27 20:28:41,063][106225] Updated weights for policy 1, policy_version 174024 (0.0007) [2023-12-27 20:28:41,131][106225] Updated weights for policy 1, policy_version 174034 (0.0008) [2023-12-27 20:28:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 89038848. Throughput: 0: 9903.5, 1: 10056.0. Samples: 89013312. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:28:41,175][105115] Avg episode reward: [(0, '-5.090'), (1, '-6.562')] [2023-12-27 20:28:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000173728_44482560.pth... [2023-12-27 20:28:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000172576_44187648.pth [2023-12-27 20:28:41,198][106225] Updated weights for policy 1, policy_version 174044 (0.0008) [2023-12-27 20:28:41,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000174048_44564480.pth... [2023-12-27 20:28:41,221][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000172864_44261376.pth [2023-12-27 20:28:41,601][106226] Updated weights for policy 0, policy_version 173737 (0.0006) [2023-12-27 20:28:41,673][106226] Updated weights for policy 0, policy_version 173747 (0.0010) [2023-12-27 20:28:41,744][106226] Updated weights for policy 0, policy_version 173757 (0.0009) [2023-12-27 20:28:41,959][106225] Updated weights for policy 1, policy_version 174054 (0.0007) [2023-12-27 20:28:42,030][106225] Updated weights for policy 1, policy_version 174064 (0.0008) [2023-12-27 20:28:42,097][106225] Updated weights for policy 1, policy_version 174074 (0.0007) [2023-12-27 20:28:42,488][106226] Updated weights for policy 0, policy_version 173767 (0.0008) [2023-12-27 20:28:42,554][106226] Updated weights for policy 0, policy_version 173777 (0.0009) [2023-12-27 20:28:42,616][106226] Updated weights for policy 0, policy_version 173787 (0.0008) [2023-12-27 20:28:42,786][106225] Updated weights for policy 1, policy_version 174084 (0.0008) [2023-12-27 20:28:42,843][106225] Updated weights for policy 1, policy_version 174094 (0.0008) [2023-12-27 20:28:42,899][106225] Updated weights for policy 1, policy_version 174104 (0.0009) [2023-12-27 20:28:43,299][106226] Updated weights for policy 0, policy_version 173797 (0.0008) [2023-12-27 20:28:43,356][106226] Updated weights for policy 0, policy_version 173807 (0.0009) [2023-12-27 20:28:43,412][106226] Updated weights for policy 0, policy_version 173817 (0.0009) [2023-12-27 20:28:43,612][106225] Updated weights for policy 1, policy_version 174114 (0.0009) [2023-12-27 20:28:43,673][106225] Updated weights for policy 1, policy_version 174124 (0.0008) [2023-12-27 20:28:43,727][106225] Updated weights for policy 1, policy_version 174134 (0.0008) [2023-12-27 20:28:43,785][106225] Updated weights for policy 1, policy_version 174144 (0.0008) [2023-12-27 20:28:44,168][106226] Updated weights for policy 0, policy_version 173827 (0.0009) [2023-12-27 20:28:44,221][106226] Updated weights for policy 0, policy_version 173837 (0.0009) [2023-12-27 20:28:44,274][106226] Updated weights for policy 0, policy_version 173847 (0.0008) [2023-12-27 20:28:44,398][106225] Updated weights for policy 1, policy_version 174154 (0.0006) [2023-12-27 20:28:44,454][106225] Updated weights for policy 1, policy_version 174164 (0.0006) [2023-12-27 20:28:44,513][106225] Updated weights for policy 1, policy_version 174174 (0.0008) [2023-12-27 20:28:45,100][106226] Updated weights for policy 0, policy_version 173857 (0.0008) [2023-12-27 20:28:45,168][106226] Updated weights for policy 0, policy_version 173867 (0.0008) [2023-12-27 20:28:45,195][106225] Updated weights for policy 1, policy_version 174184 (0.0006) [2023-12-27 20:28:45,237][106226] Updated weights for policy 0, policy_version 173877 (0.0006) [2023-12-27 20:28:45,254][106225] Updated weights for policy 1, policy_version 174194 (0.0007) [2023-12-27 20:28:45,305][106225] Updated weights for policy 1, policy_version 174204 (0.0007) [2023-12-27 20:28:45,305][106226] Updated weights for policy 0, policy_version 173887 (0.0008) [2023-12-27 20:28:46,016][106225] Updated weights for policy 1, policy_version 174214 (0.0007) [2023-12-27 20:28:46,072][106226] Updated weights for policy 0, policy_version 173897 (0.0009) [2023-12-27 20:28:46,078][106225] Updated weights for policy 1, policy_version 174224 (0.0009) [2023-12-27 20:28:46,136][106226] Updated weights for policy 0, policy_version 173907 (0.0010) [2023-12-27 20:28:46,142][106225] Updated weights for policy 1, policy_version 174234 (0.0009) [2023-12-27 20:28:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 89137152. Throughput: 0: 9780.8, 1: 10007.0. Samples: 89128464. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:28:46,175][105115] Avg episode reward: [(0, '-5.294'), (1, '-6.230')] [2023-12-27 20:28:46,194][106226] Updated weights for policy 0, policy_version 173917 (0.0010) [2023-12-27 20:28:46,786][106225] Updated weights for policy 1, policy_version 174244 (0.0008) [2023-12-27 20:28:46,856][106225] Updated weights for policy 1, policy_version 174254 (0.0007) [2023-12-27 20:28:46,864][106226] Updated weights for policy 0, policy_version 173927 (0.0011) [2023-12-27 20:28:46,910][106225] Updated weights for policy 1, policy_version 174264 (0.0008) [2023-12-27 20:28:46,922][106226] Updated weights for policy 0, policy_version 173937 (0.0011) [2023-12-27 20:28:46,978][106226] Updated weights for policy 0, policy_version 173947 (0.0010) [2023-12-27 20:28:47,466][106225] Updated weights for policy 1, policy_version 174274 (0.0008) [2023-12-27 20:28:47,516][106225] Updated weights for policy 1, policy_version 174284 (0.0010) [2023-12-27 20:28:47,581][106225] Updated weights for policy 1, policy_version 174294 (0.0010) [2023-12-27 20:28:47,638][106225] Updated weights for policy 1, policy_version 174304 (0.0010) [2023-12-27 20:28:47,639][106226] Updated weights for policy 0, policy_version 173957 (0.0010) [2023-12-27 20:28:47,689][106226] Updated weights for policy 0, policy_version 173967 (0.0010) [2023-12-27 20:28:47,745][106226] Updated weights for policy 0, policy_version 173977 (0.0008) [2023-12-27 20:28:48,366][106226] Updated weights for policy 0, policy_version 173987 (0.0006) [2023-12-27 20:28:48,384][106225] Updated weights for policy 1, policy_version 174314 (0.0007) [2023-12-27 20:28:48,434][106226] Updated weights for policy 0, policy_version 173997 (0.0006) [2023-12-27 20:28:48,452][106225] Updated weights for policy 1, policy_version 174324 (0.0009) [2023-12-27 20:28:48,500][106226] Updated weights for policy 0, policy_version 174007 (0.0006) [2023-12-27 20:28:48,511][106225] Updated weights for policy 1, policy_version 174334 (0.0008) [2023-12-27 20:28:49,104][106226] Updated weights for policy 0, policy_version 174017 (0.0006) [2023-12-27 20:28:49,162][106226] Updated weights for policy 0, policy_version 174027 (0.0008) [2023-12-27 20:28:49,180][106225] Updated weights for policy 1, policy_version 174344 (0.0009) [2023-12-27 20:28:49,220][106226] Updated weights for policy 0, policy_version 174037 (0.0010) [2023-12-27 20:28:49,246][106225] Updated weights for policy 1, policy_version 174354 (0.0009) [2023-12-27 20:28:49,302][106225] Updated weights for policy 1, policy_version 174364 (0.0008) [2023-12-27 20:28:49,308][106226] Updated weights for policy 0, policy_version 174047 (0.0010) [2023-12-27 20:28:49,939][106226] Updated weights for policy 0, policy_version 174057 (0.0008) [2023-12-27 20:28:50,003][106226] Updated weights for policy 0, policy_version 174067 (0.0011) [2023-12-27 20:28:50,056][106225] Updated weights for policy 1, policy_version 174374 (0.0006) [2023-12-27 20:28:50,062][106226] Updated weights for policy 0, policy_version 174077 (0.0011) [2023-12-27 20:28:50,129][106225] Updated weights for policy 1, policy_version 174384 (0.0006) [2023-12-27 20:28:50,194][106225] Updated weights for policy 1, policy_version 174394 (0.0007) [2023-12-27 20:28:50,782][106226] Updated weights for policy 0, policy_version 174087 (0.0009) [2023-12-27 20:28:50,803][106225] Updated weights for policy 1, policy_version 174404 (0.0007) [2023-12-27 20:28:50,841][106226] Updated weights for policy 0, policy_version 174097 (0.0006) [2023-12-27 20:28:50,858][106225] Updated weights for policy 1, policy_version 174414 (0.0010) [2023-12-27 20:28:50,900][106226] Updated weights for policy 0, policy_version 174107 (0.0006) [2023-12-27 20:28:50,913][106225] Updated weights for policy 1, policy_version 174424 (0.0010) [2023-12-27 20:28:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 89243648. Throughput: 0: 9781.5, 1: 9972.0. Samples: 89250456. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:28:51,175][105115] Avg episode reward: [(0, '-5.791'), (1, '-6.507')] [2023-12-27 20:28:51,615][106225] Updated weights for policy 1, policy_version 174434 (0.0011) [2023-12-27 20:28:51,675][106225] Updated weights for policy 1, policy_version 174444 (0.0011) [2023-12-27 20:28:51,701][106226] Updated weights for policy 0, policy_version 174117 (0.0007) [2023-12-27 20:28:51,738][106225] Updated weights for policy 1, policy_version 174454 (0.0011) [2023-12-27 20:28:51,772][106226] Updated weights for policy 0, policy_version 174127 (0.0007) [2023-12-27 20:28:51,790][106225] Updated weights for policy 1, policy_version 174464 (0.0008) [2023-12-27 20:28:51,828][106226] Updated weights for policy 0, policy_version 174137 (0.0007) [2023-12-27 20:28:52,560][106226] Updated weights for policy 0, policy_version 174147 (0.0007) [2023-12-27 20:28:52,604][106225] Updated weights for policy 1, policy_version 174474 (0.0010) [2023-12-27 20:28:52,624][106226] Updated weights for policy 0, policy_version 174157 (0.0008) [2023-12-27 20:28:52,666][106225] Updated weights for policy 1, policy_version 174484 (0.0006) [2023-12-27 20:28:52,685][106226] Updated weights for policy 0, policy_version 174167 (0.0008) [2023-12-27 20:28:52,729][106225] Updated weights for policy 1, policy_version 174494 (0.0008) [2023-12-27 20:28:53,371][106225] Updated weights for policy 1, policy_version 174504 (0.0006) [2023-12-27 20:28:53,406][106226] Updated weights for policy 0, policy_version 174177 (0.0007) [2023-12-27 20:28:53,423][106225] Updated weights for policy 1, policy_version 174514 (0.0008) [2023-12-27 20:28:53,467][106226] Updated weights for policy 0, policy_version 174187 (0.0010) [2023-12-27 20:28:53,474][106225] Updated weights for policy 1, policy_version 174524 (0.0010) [2023-12-27 20:28:53,526][106226] Updated weights for policy 0, policy_version 174197 (0.0010) [2023-12-27 20:28:53,590][106226] Updated weights for policy 0, policy_version 174207 (0.0005) [2023-12-27 20:28:54,091][106225] Updated weights for policy 1, policy_version 174534 (0.0007) [2023-12-27 20:28:54,162][106225] Updated weights for policy 1, policy_version 174544 (0.0006) [2023-12-27 20:28:54,219][106225] Updated weights for policy 1, policy_version 174554 (0.0010) [2023-12-27 20:28:54,221][106226] Updated weights for policy 0, policy_version 174217 (0.0008) [2023-12-27 20:28:54,269][106226] Updated weights for policy 0, policy_version 174227 (0.0008) [2023-12-27 20:28:54,323][106226] Updated weights for policy 0, policy_version 174237 (0.0006) [2023-12-27 20:28:54,784][106225] Updated weights for policy 1, policy_version 174564 (0.0008) [2023-12-27 20:28:54,830][106225] Updated weights for policy 1, policy_version 174574 (0.0005) [2023-12-27 20:28:54,884][106225] Updated weights for policy 1, policy_version 174584 (0.0005) [2023-12-27 20:28:55,026][106226] Updated weights for policy 0, policy_version 174247 (0.0009) [2023-12-27 20:28:55,087][106226] Updated weights for policy 0, policy_version 174257 (0.0011) [2023-12-27 20:28:55,137][106226] Updated weights for policy 0, policy_version 174267 (0.0010) [2023-12-27 20:28:55,543][106225] Updated weights for policy 1, policy_version 174594 (0.0006) [2023-12-27 20:28:55,602][106225] Updated weights for policy 1, policy_version 174604 (0.0010) [2023-12-27 20:28:55,659][106225] Updated weights for policy 1, policy_version 174614 (0.0007) [2023-12-27 20:28:55,710][106225] Updated weights for policy 1, policy_version 174624 (0.0006) [2023-12-27 20:28:55,860][106226] Updated weights for policy 0, policy_version 174277 (0.0011) [2023-12-27 20:28:55,914][106226] Updated weights for policy 0, policy_version 174287 (0.0010) [2023-12-27 20:28:55,964][106226] Updated weights for policy 0, policy_version 174297 (0.0010) [2023-12-27 20:28:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 89341952. Throughput: 0: 9715.2, 1: 9992.3. Samples: 89308412. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:28:56,175][105115] Avg episode reward: [(0, '-5.738'), (1, '-6.337')] [2023-12-27 20:28:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000174624_44711936.pth... [2023-12-27 20:28:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000174304_44630016.pth... [2023-12-27 20:28:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000173440_44408832.pth [2023-12-27 20:28:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000173152_44335104.pth [2023-12-27 20:28:56,338][106225] Updated weights for policy 1, policy_version 174634 (0.0010) [2023-12-27 20:28:56,392][106225] Updated weights for policy 1, policy_version 174644 (0.0006) [2023-12-27 20:28:56,442][106225] Updated weights for policy 1, policy_version 174654 (0.0007) [2023-12-27 20:28:56,610][106226] Updated weights for policy 0, policy_version 174307 (0.0010) [2023-12-27 20:28:56,656][106226] Updated weights for policy 0, policy_version 174317 (0.0010) [2023-12-27 20:28:56,707][106226] Updated weights for policy 0, policy_version 174327 (0.0009) [2023-12-27 20:28:57,063][106225] Updated weights for policy 1, policy_version 174664 (0.0010) [2023-12-27 20:28:57,125][106225] Updated weights for policy 1, policy_version 174674 (0.0010) [2023-12-27 20:28:57,184][106225] Updated weights for policy 1, policy_version 174684 (0.0010) [2023-12-27 20:28:57,372][106226] Updated weights for policy 0, policy_version 174337 (0.0010) [2023-12-27 20:28:57,435][106226] Updated weights for policy 0, policy_version 174347 (0.0005) [2023-12-27 20:28:57,503][106226] Updated weights for policy 0, policy_version 174357 (0.0005) [2023-12-27 20:28:57,566][106226] Updated weights for policy 0, policy_version 174367 (0.0005) [2023-12-27 20:28:57,736][106225] Updated weights for policy 1, policy_version 174694 (0.0007) [2023-12-27 20:28:57,803][106225] Updated weights for policy 1, policy_version 174704 (0.0008) [2023-12-27 20:28:57,852][106225] Updated weights for policy 1, policy_version 174714 (0.0010) [2023-12-27 20:28:58,165][106226] Updated weights for policy 0, policy_version 174377 (0.0010) [2023-12-27 20:28:58,231][106226] Updated weights for policy 0, policy_version 174387 (0.0010) [2023-12-27 20:28:58,292][106226] Updated weights for policy 0, policy_version 174397 (0.0011) [2023-12-27 20:28:58,448][106225] Updated weights for policy 1, policy_version 174724 (0.0009) [2023-12-27 20:28:58,517][106225] Updated weights for policy 1, policy_version 174734 (0.0007) [2023-12-27 20:28:58,586][106225] Updated weights for policy 1, policy_version 174744 (0.0009) [2023-12-27 20:28:59,131][106226] Updated weights for policy 0, policy_version 174407 (0.0011) [2023-12-27 20:28:59,177][106226] Updated weights for policy 0, policy_version 174417 (0.0010) [2023-12-27 20:28:59,233][106226] Updated weights for policy 0, policy_version 174427 (0.0009) [2023-12-27 20:28:59,385][106225] Updated weights for policy 1, policy_version 174754 (0.0007) [2023-12-27 20:28:59,442][106225] Updated weights for policy 1, policy_version 174764 (0.0008) [2023-12-27 20:28:59,494][106225] Updated weights for policy 1, policy_version 174774 (0.0008) [2023-12-27 20:28:59,544][106225] Updated weights for policy 1, policy_version 174784 (0.0009) [2023-12-27 20:28:59,870][106226] Updated weights for policy 0, policy_version 174437 (0.0007) [2023-12-27 20:28:59,940][106226] Updated weights for policy 0, policy_version 174447 (0.0008) [2023-12-27 20:29:00,003][106226] Updated weights for policy 0, policy_version 174457 (0.0008) [2023-12-27 20:29:00,370][106225] Updated weights for policy 1, policy_version 174794 (0.0008) [2023-12-27 20:29:00,434][106225] Updated weights for policy 1, policy_version 174804 (0.0009) [2023-12-27 20:29:00,497][106225] Updated weights for policy 1, policy_version 174814 (0.0010) [2023-12-27 20:29:00,739][106226] Updated weights for policy 0, policy_version 174467 (0.0008) [2023-12-27 20:29:00,788][106226] Updated weights for policy 0, policy_version 174477 (0.0009) [2023-12-27 20:29:00,846][106226] Updated weights for policy 0, policy_version 174487 (0.0009) [2023-12-27 20:29:01,072][106225] Updated weights for policy 1, policy_version 174824 (0.0008) [2023-12-27 20:29:01,137][106225] Updated weights for policy 1, policy_version 174834 (0.0008) [2023-12-27 20:29:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 89440256. Throughput: 0: 9816.2, 1: 10056.5. Samples: 89432852. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:01,175][105115] Avg episode reward: [(0, '-5.525'), (1, '-6.982')] [2023-12-27 20:29:01,205][106225] Updated weights for policy 1, policy_version 174844 (0.0008) [2023-12-27 20:29:01,617][106226] Updated weights for policy 0, policy_version 174497 (0.0008) [2023-12-27 20:29:01,686][106226] Updated weights for policy 0, policy_version 174507 (0.0008) [2023-12-27 20:29:01,751][106226] Updated weights for policy 0, policy_version 174517 (0.0008) [2023-12-27 20:29:01,811][106226] Updated weights for policy 0, policy_version 174527 (0.0008) [2023-12-27 20:29:01,958][106225] Updated weights for policy 1, policy_version 174854 (0.0008) [2023-12-27 20:29:02,008][106225] Updated weights for policy 1, policy_version 174864 (0.0010) [2023-12-27 20:29:02,071][106225] Updated weights for policy 1, policy_version 174874 (0.0007) [2023-12-27 20:29:02,526][106226] Updated weights for policy 0, policy_version 174537 (0.0005) [2023-12-27 20:29:02,577][106226] Updated weights for policy 0, policy_version 174547 (0.0007) [2023-12-27 20:29:02,627][106226] Updated weights for policy 0, policy_version 174557 (0.0008) [2023-12-27 20:29:02,735][106225] Updated weights for policy 1, policy_version 174884 (0.0007) [2023-12-27 20:29:02,788][106225] Updated weights for policy 1, policy_version 174894 (0.0010) [2023-12-27 20:29:02,844][106225] Updated weights for policy 1, policy_version 174904 (0.0010) [2023-12-27 20:29:03,391][106226] Updated weights for policy 0, policy_version 174567 (0.0008) [2023-12-27 20:29:03,440][106226] Updated weights for policy 0, policy_version 174577 (0.0007) [2023-12-27 20:29:03,459][106225] Updated weights for policy 1, policy_version 174914 (0.0009) [2023-12-27 20:29:03,498][106226] Updated weights for policy 0, policy_version 174587 (0.0006) [2023-12-27 20:29:03,507][106225] Updated weights for policy 1, policy_version 174924 (0.0010) [2023-12-27 20:29:03,553][106225] Updated weights for policy 1, policy_version 174934 (0.0010) [2023-12-27 20:29:03,605][106225] Updated weights for policy 1, policy_version 174944 (0.0010) [2023-12-27 20:29:04,266][106226] Updated weights for policy 0, policy_version 174597 (0.0008) [2023-12-27 20:29:04,326][106226] Updated weights for policy 0, policy_version 174607 (0.0006) [2023-12-27 20:29:04,335][106225] Updated weights for policy 1, policy_version 174954 (0.0008) [2023-12-27 20:29:04,389][106226] Updated weights for policy 0, policy_version 174617 (0.0008) [2023-12-27 20:29:04,390][106225] Updated weights for policy 1, policy_version 174964 (0.0010) [2023-12-27 20:29:04,441][106225] Updated weights for policy 1, policy_version 174974 (0.0010) [2023-12-27 20:29:05,114][106226] Updated weights for policy 0, policy_version 174627 (0.0008) [2023-12-27 20:29:05,160][106225] Updated weights for policy 1, policy_version 174984 (0.0010) [2023-12-27 20:29:05,176][106226] Updated weights for policy 0, policy_version 174637 (0.0009) [2023-12-27 20:29:05,216][106225] Updated weights for policy 1, policy_version 174994 (0.0010) [2023-12-27 20:29:05,237][106226] Updated weights for policy 0, policy_version 174647 (0.0005) [2023-12-27 20:29:05,276][106225] Updated weights for policy 1, policy_version 175004 (0.0010) [2023-12-27 20:29:05,955][106226] Updated weights for policy 0, policy_version 174657 (0.0008) [2023-12-27 20:29:05,995][106225] Updated weights for policy 1, policy_version 175014 (0.0010) [2023-12-27 20:29:06,013][106226] Updated weights for policy 0, policy_version 174667 (0.0006) [2023-12-27 20:29:06,055][106225] Updated weights for policy 1, policy_version 175024 (0.0010) [2023-12-27 20:29:06,074][106226] Updated weights for policy 0, policy_version 174677 (0.0009) [2023-12-27 20:29:06,121][106225] Updated weights for policy 1, policy_version 175034 (0.0009) [2023-12-27 20:29:06,159][106226] Updated weights for policy 0, policy_version 174687 (0.0007) [2023-12-27 20:29:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 89546752. Throughput: 0: 9791.7, 1: 10026.3. Samples: 89550320. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:06,176][105115] Avg episode reward: [(0, '-5.406'), (1, '-6.155')] [2023-12-27 20:29:06,798][106225] Updated weights for policy 1, policy_version 175044 (0.0010) [2023-12-27 20:29:06,858][106225] Updated weights for policy 1, policy_version 175054 (0.0010) [2023-12-27 20:29:06,900][106226] Updated weights for policy 0, policy_version 174697 (0.0006) [2023-12-27 20:29:06,917][106225] Updated weights for policy 1, policy_version 175064 (0.0011) [2023-12-27 20:29:06,969][106226] Updated weights for policy 0, policy_version 174707 (0.0006) [2023-12-27 20:29:07,024][106226] Updated weights for policy 0, policy_version 174717 (0.0008) [2023-12-27 20:29:07,578][106225] Updated weights for policy 1, policy_version 175074 (0.0010) [2023-12-27 20:29:07,639][106225] Updated weights for policy 1, policy_version 175084 (0.0007) [2023-12-27 20:29:07,700][106225] Updated weights for policy 1, policy_version 175094 (0.0005) [2023-12-27 20:29:07,757][106225] Updated weights for policy 1, policy_version 175104 (0.0005) [2023-12-27 20:29:07,779][106226] Updated weights for policy 0, policy_version 174727 (0.0009) [2023-12-27 20:29:07,831][106226] Updated weights for policy 0, policy_version 174737 (0.0008) [2023-12-27 20:29:07,884][106226] Updated weights for policy 0, policy_version 174747 (0.0009) [2023-12-27 20:29:08,301][106225] Updated weights for policy 1, policy_version 175114 (0.0005) [2023-12-27 20:29:08,370][106225] Updated weights for policy 1, policy_version 175124 (0.0007) [2023-12-27 20:29:08,432][106225] Updated weights for policy 1, policy_version 175134 (0.0008) [2023-12-27 20:29:08,715][106226] Updated weights for policy 0, policy_version 174757 (0.0009) [2023-12-27 20:29:08,784][106226] Updated weights for policy 0, policy_version 174767 (0.0010) [2023-12-27 20:29:08,852][106226] Updated weights for policy 0, policy_version 174777 (0.0009) [2023-12-27 20:29:09,007][106225] Updated weights for policy 1, policy_version 175144 (0.0009) [2023-12-27 20:29:09,066][106225] Updated weights for policy 1, policy_version 175154 (0.0008) [2023-12-27 20:29:09,123][106225] Updated weights for policy 1, policy_version 175164 (0.0010) [2023-12-27 20:29:09,659][106226] Updated weights for policy 0, policy_version 174787 (0.0009) [2023-12-27 20:29:09,718][106226] Updated weights for policy 0, policy_version 174797 (0.0008) [2023-12-27 20:29:09,788][106226] Updated weights for policy 0, policy_version 174807 (0.0008) [2023-12-27 20:29:09,801][106225] Updated weights for policy 1, policy_version 175174 (0.0008) [2023-12-27 20:29:09,872][106225] Updated weights for policy 1, policy_version 175184 (0.0009) [2023-12-27 20:29:09,924][106225] Updated weights for policy 1, policy_version 175194 (0.0008) [2023-12-27 20:29:10,530][106226] Updated weights for policy 0, policy_version 174817 (0.0013) [2023-12-27 20:29:10,595][106226] Updated weights for policy 0, policy_version 174827 (0.0006) [2023-12-27 20:29:10,660][106226] Updated weights for policy 0, policy_version 174837 (0.0007) [2023-12-27 20:29:10,665][106225] Updated weights for policy 1, policy_version 175204 (0.0009) [2023-12-27 20:29:10,726][106225] Updated weights for policy 1, policy_version 175214 (0.0010) [2023-12-27 20:29:10,727][106226] Updated weights for policy 0, policy_version 174847 (0.0006) [2023-12-27 20:29:10,790][106225] Updated weights for policy 1, policy_version 175224 (0.0007) [2023-12-27 20:29:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 89636864. Throughput: 0: 9758.7, 1: 10109.5. Samples: 89609060. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:11,175][105115] Avg episode reward: [(0, '-5.408'), (1, '-6.742')] [2023-12-27 20:29:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000175232_44867584.pth... [2023-12-27 20:29:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000174848_44769280.pth... [2023-12-27 20:29:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000173728_44482560.pth [2023-12-27 20:29:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000174048_44564480.pth [2023-12-27 20:29:11,427][106226] Updated weights for policy 0, policy_version 174857 (0.0010) [2023-12-27 20:29:11,489][106226] Updated weights for policy 0, policy_version 174867 (0.0011) [2023-12-27 20:29:11,508][106225] Updated weights for policy 1, policy_version 175234 (0.0008) [2023-12-27 20:29:11,551][106226] Updated weights for policy 0, policy_version 174877 (0.0011) [2023-12-27 20:29:11,565][106225] Updated weights for policy 1, policy_version 175244 (0.0006) [2023-12-27 20:29:11,632][106225] Updated weights for policy 1, policy_version 175254 (0.0008) [2023-12-27 20:29:11,704][106225] Updated weights for policy 1, policy_version 175264 (0.0009) [2023-12-27 20:29:12,317][106226] Updated weights for policy 0, policy_version 174887 (0.0009) [2023-12-27 20:29:12,388][106226] Updated weights for policy 0, policy_version 174897 (0.0009) [2023-12-27 20:29:12,449][106226] Updated weights for policy 0, policy_version 174907 (0.0006) [2023-12-27 20:29:12,504][106225] Updated weights for policy 1, policy_version 175274 (0.0010) [2023-12-27 20:29:12,570][106225] Updated weights for policy 1, policy_version 175284 (0.0005) [2023-12-27 20:29:12,634][106225] Updated weights for policy 1, policy_version 175294 (0.0008) [2023-12-27 20:29:13,106][106226] Updated weights for policy 0, policy_version 174917 (0.0006) [2023-12-27 20:29:13,164][106226] Updated weights for policy 0, policy_version 174927 (0.0008) [2023-12-27 20:29:13,210][106226] Updated weights for policy 0, policy_version 174937 (0.0008) [2023-12-27 20:29:13,317][106225] Updated weights for policy 1, policy_version 175304 (0.0010) [2023-12-27 20:29:13,376][106225] Updated weights for policy 1, policy_version 175314 (0.0010) [2023-12-27 20:29:13,429][106225] Updated weights for policy 1, policy_version 175324 (0.0010) [2023-12-27 20:29:13,956][106226] Updated weights for policy 0, policy_version 174947 (0.0008) [2023-12-27 20:29:14,005][106226] Updated weights for policy 0, policy_version 174957 (0.0007) [2023-12-27 20:29:14,058][106226] Updated weights for policy 0, policy_version 174967 (0.0008) [2023-12-27 20:29:14,143][106225] Updated weights for policy 1, policy_version 175334 (0.0010) [2023-12-27 20:29:14,206][106225] Updated weights for policy 1, policy_version 175344 (0.0008) [2023-12-27 20:29:14,255][106225] Updated weights for policy 1, policy_version 175354 (0.0010) [2023-12-27 20:29:14,795][106226] Updated weights for policy 0, policy_version 174977 (0.0008) [2023-12-27 20:29:14,860][106226] Updated weights for policy 0, policy_version 174987 (0.0007) [2023-12-27 20:29:14,924][106226] Updated weights for policy 0, policy_version 174997 (0.0009) [2023-12-27 20:29:14,941][106225] Updated weights for policy 1, policy_version 175364 (0.0010) [2023-12-27 20:29:14,990][106226] Updated weights for policy 0, policy_version 175007 (0.0006) [2023-12-27 20:29:15,030][106225] Updated weights for policy 1, policy_version 175374 (0.0011) [2023-12-27 20:29:15,091][106225] Updated weights for policy 1, policy_version 175384 (0.0011) [2023-12-27 20:29:15,674][106226] Updated weights for policy 0, policy_version 175017 (0.0006) [2023-12-27 20:29:15,738][106226] Updated weights for policy 0, policy_version 175027 (0.0008) [2023-12-27 20:29:15,766][106225] Updated weights for policy 1, policy_version 175394 (0.0011) [2023-12-27 20:29:15,795][106226] Updated weights for policy 0, policy_version 175037 (0.0005) [2023-12-27 20:29:15,815][106225] Updated weights for policy 1, policy_version 175404 (0.0010) [2023-12-27 20:29:15,872][106225] Updated weights for policy 1, policy_version 175414 (0.0010) [2023-12-27 20:29:15,935][106225] Updated weights for policy 1, policy_version 175424 (0.0010) [2023-12-27 20:29:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 89735168. Throughput: 0: 9589.9, 1: 10153.8. Samples: 89723988. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:16,175][105115] Avg episode reward: [(0, '-5.412'), (1, '-6.671')] [2023-12-27 20:29:16,505][106226] Updated weights for policy 0, policy_version 175047 (0.0009) [2023-12-27 20:29:16,561][106226] Updated weights for policy 0, policy_version 175057 (0.0011) [2023-12-27 20:29:16,620][106226] Updated weights for policy 0, policy_version 175067 (0.0011) [2023-12-27 20:29:16,646][106225] Updated weights for policy 1, policy_version 175434 (0.0010) [2023-12-27 20:29:16,704][106225] Updated weights for policy 1, policy_version 175444 (0.0010) [2023-12-27 20:29:16,769][106225] Updated weights for policy 1, policy_version 175454 (0.0011) [2023-12-27 20:29:17,354][106226] Updated weights for policy 0, policy_version 175077 (0.0010) [2023-12-27 20:29:17,403][106226] Updated weights for policy 0, policy_version 175087 (0.0010) [2023-12-27 20:29:17,463][106226] Updated weights for policy 0, policy_version 175097 (0.0010) [2023-12-27 20:29:17,473][106225] Updated weights for policy 1, policy_version 175464 (0.0007) [2023-12-27 20:29:17,531][106225] Updated weights for policy 1, policy_version 175474 (0.0006) [2023-12-27 20:29:17,594][106225] Updated weights for policy 1, policy_version 175484 (0.0008) [2023-12-27 20:29:18,080][106226] Updated weights for policy 0, policy_version 175107 (0.0009) [2023-12-27 20:29:18,151][106226] Updated weights for policy 0, policy_version 175117 (0.0005) [2023-12-27 20:29:18,209][106225] Updated weights for policy 1, policy_version 175494 (0.0009) [2023-12-27 20:29:18,215][106226] Updated weights for policy 0, policy_version 175127 (0.0006) [2023-12-27 20:29:18,268][106225] Updated weights for policy 1, policy_version 175504 (0.0009) [2023-12-27 20:29:18,336][106225] Updated weights for policy 1, policy_version 175514 (0.0008) [2023-12-27 20:29:18,862][106226] Updated weights for policy 0, policy_version 175137 (0.0007) [2023-12-27 20:29:18,932][106226] Updated weights for policy 0, policy_version 175147 (0.0005) [2023-12-27 20:29:18,993][106226] Updated weights for policy 0, policy_version 175157 (0.0006) [2023-12-27 20:29:19,040][106226] Updated weights for policy 0, policy_version 175167 (0.0007) [2023-12-27 20:29:19,086][106225] Updated weights for policy 1, policy_version 175524 (0.0011) [2023-12-27 20:29:19,137][106225] Updated weights for policy 1, policy_version 175534 (0.0010) [2023-12-27 20:29:19,188][106225] Updated weights for policy 1, policy_version 175544 (0.0010) [2023-12-27 20:29:19,719][106226] Updated weights for policy 0, policy_version 175177 (0.0006) [2023-12-27 20:29:19,780][106226] Updated weights for policy 0, policy_version 175187 (0.0007) [2023-12-27 20:29:19,842][106226] Updated weights for policy 0, policy_version 175197 (0.0009) [2023-12-27 20:29:19,959][106225] Updated weights for policy 1, policy_version 175554 (0.0013) [2023-12-27 20:29:20,015][106225] Updated weights for policy 1, policy_version 175564 (0.0008) [2023-12-27 20:29:20,081][106225] Updated weights for policy 1, policy_version 175574 (0.0007) [2023-12-27 20:29:20,143][106225] Updated weights for policy 1, policy_version 175584 (0.0007) [2023-12-27 20:29:20,578][106226] Updated weights for policy 0, policy_version 175207 (0.0009) [2023-12-27 20:29:20,647][106226] Updated weights for policy 0, policy_version 175217 (0.0009) [2023-12-27 20:29:20,716][106226] Updated weights for policy 0, policy_version 175227 (0.0008) [2023-12-27 20:29:20,873][106225] Updated weights for policy 1, policy_version 175594 (0.0008) [2023-12-27 20:29:20,926][106225] Updated weights for policy 1, policy_version 175604 (0.0008) [2023-12-27 20:29:20,986][106225] Updated weights for policy 1, policy_version 175614 (0.0006) [2023-12-27 20:29:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 89833472. Throughput: 0: 9656.1, 1: 10064.2. Samples: 89842216. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:21,175][105115] Avg episode reward: [(0, '-5.361'), (1, '-7.141')] [2023-12-27 20:29:21,464][106226] Updated weights for policy 0, policy_version 175237 (0.0009) [2023-12-27 20:29:21,530][106226] Updated weights for policy 0, policy_version 175247 (0.0011) [2023-12-27 20:29:21,597][106226] Updated weights for policy 0, policy_version 175257 (0.0011) [2023-12-27 20:29:21,754][106225] Updated weights for policy 1, policy_version 175624 (0.0009) [2023-12-27 20:29:21,825][106225] Updated weights for policy 1, policy_version 175634 (0.0009) [2023-12-27 20:29:21,889][106225] Updated weights for policy 1, policy_version 175644 (0.0009) [2023-12-27 20:29:22,274][106226] Updated weights for policy 0, policy_version 175267 (0.0010) [2023-12-27 20:29:22,341][106226] Updated weights for policy 0, policy_version 175277 (0.0010) [2023-12-27 20:29:22,404][106226] Updated weights for policy 0, policy_version 175287 (0.0011) [2023-12-27 20:29:22,706][106225] Updated weights for policy 1, policy_version 175654 (0.0008) [2023-12-27 20:29:22,767][106225] Updated weights for policy 1, policy_version 175664 (0.0008) [2023-12-27 20:29:22,830][106225] Updated weights for policy 1, policy_version 175674 (0.0009) [2023-12-27 20:29:23,091][106226] Updated weights for policy 0, policy_version 175297 (0.0010) [2023-12-27 20:29:23,144][106226] Updated weights for policy 0, policy_version 175307 (0.0011) [2023-12-27 20:29:23,199][106226] Updated weights for policy 0, policy_version 175317 (0.0011) [2023-12-27 20:29:23,249][106226] Updated weights for policy 0, policy_version 175327 (0.0011) [2023-12-27 20:29:23,537][106225] Updated weights for policy 1, policy_version 175684 (0.0008) [2023-12-27 20:29:23,598][106225] Updated weights for policy 1, policy_version 175694 (0.0008) [2023-12-27 20:29:23,648][106225] Updated weights for policy 1, policy_version 175704 (0.0008) [2023-12-27 20:29:23,984][106226] Updated weights for policy 0, policy_version 175337 (0.0011) [2023-12-27 20:29:24,038][106226] Updated weights for policy 0, policy_version 175347 (0.0011) [2023-12-27 20:29:24,092][106226] Updated weights for policy 0, policy_version 175357 (0.0010) [2023-12-27 20:29:24,385][106225] Updated weights for policy 1, policy_version 175714 (0.0007) [2023-12-27 20:29:24,448][106225] Updated weights for policy 1, policy_version 175724 (0.0005) [2023-12-27 20:29:24,515][106225] Updated weights for policy 1, policy_version 175734 (0.0005) [2023-12-27 20:29:24,579][106225] Updated weights for policy 1, policy_version 175744 (0.0005) [2023-12-27 20:29:24,809][106226] Updated weights for policy 0, policy_version 175367 (0.0009) [2023-12-27 20:29:24,866][106226] Updated weights for policy 0, policy_version 175377 (0.0009) [2023-12-27 20:29:24,922][106226] Updated weights for policy 0, policy_version 175387 (0.0008) [2023-12-27 20:29:25,162][106225] Updated weights for policy 1, policy_version 175754 (0.0005) [2023-12-27 20:29:25,216][106225] Updated weights for policy 1, policy_version 175764 (0.0006) [2023-12-27 20:29:25,264][106225] Updated weights for policy 1, policy_version 175774 (0.0005) [2023-12-27 20:29:25,595][106226] Updated weights for policy 0, policy_version 175397 (0.0007) [2023-12-27 20:29:25,649][106226] Updated weights for policy 0, policy_version 175407 (0.0005) [2023-12-27 20:29:25,707][106226] Updated weights for policy 0, policy_version 175417 (0.0008) [2023-12-27 20:29:25,866][106225] Updated weights for policy 1, policy_version 175784 (0.0008) [2023-12-27 20:29:25,923][106225] Updated weights for policy 1, policy_version 175794 (0.0008) [2023-12-27 20:29:25,982][106225] Updated weights for policy 1, policy_version 175804 (0.0008) [2023-12-27 20:29:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 89931776. Throughput: 0: 9671.4, 1: 10001.9. Samples: 89898612. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:26,175][105115] Avg episode reward: [(0, '-5.898'), (1, '-6.763')] [2023-12-27 20:29:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000175808_45015040.pth... [2023-12-27 20:29:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000175424_44916736.pth... [2023-12-27 20:29:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000174304_44630016.pth [2023-12-27 20:29:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000174624_44711936.pth [2023-12-27 20:29:26,390][106226] Updated weights for policy 0, policy_version 175427 (0.0008) [2023-12-27 20:29:26,441][106226] Updated weights for policy 0, policy_version 175437 (0.0008) [2023-12-27 20:29:26,493][106226] Updated weights for policy 0, policy_version 175447 (0.0005) [2023-12-27 20:29:26,580][106225] Updated weights for policy 1, policy_version 175814 (0.0006) [2023-12-27 20:29:26,639][106225] Updated weights for policy 1, policy_version 175824 (0.0005) [2023-12-27 20:29:26,699][106225] Updated weights for policy 1, policy_version 175834 (0.0005) [2023-12-27 20:29:27,105][106226] Updated weights for policy 0, policy_version 175457 (0.0006) [2023-12-27 20:29:27,159][106226] Updated weights for policy 0, policy_version 175467 (0.0010) [2023-12-27 20:29:27,222][106226] Updated weights for policy 0, policy_version 175477 (0.0010) [2023-12-27 20:29:27,244][106225] Updated weights for policy 1, policy_version 175844 (0.0005) [2023-12-27 20:29:27,279][106226] Updated weights for policy 0, policy_version 175487 (0.0010) [2023-12-27 20:29:27,298][106225] Updated weights for policy 1, policy_version 175854 (0.0007) [2023-12-27 20:29:27,351][106225] Updated weights for policy 1, policy_version 175864 (0.0008) [2023-12-27 20:29:27,968][106226] Updated weights for policy 0, policy_version 175497 (0.0010) [2023-12-27 20:29:27,970][106225] Updated weights for policy 1, policy_version 175874 (0.0007) [2023-12-27 20:29:28,022][106226] Updated weights for policy 0, policy_version 175507 (0.0010) [2023-12-27 20:29:28,023][106225] Updated weights for policy 1, policy_version 175884 (0.0006) [2023-12-27 20:29:28,074][106226] Updated weights for policy 0, policy_version 175517 (0.0010) [2023-12-27 20:29:28,083][106225] Updated weights for policy 1, policy_version 175894 (0.0005) [2023-12-27 20:29:28,141][106225] Updated weights for policy 1, policy_version 175904 (0.0005) [2023-12-27 20:29:28,717][106225] Updated weights for policy 1, policy_version 175914 (0.0005) [2023-12-27 20:29:28,775][106226] Updated weights for policy 0, policy_version 175527 (0.0007) [2023-12-27 20:29:28,783][106225] Updated weights for policy 1, policy_version 175924 (0.0006) [2023-12-27 20:29:28,839][106226] Updated weights for policy 0, policy_version 175537 (0.0005) [2023-12-27 20:29:28,850][106225] Updated weights for policy 1, policy_version 175934 (0.0008) [2023-12-27 20:29:28,900][106226] Updated weights for policy 0, policy_version 175547 (0.0008) [2023-12-27 20:29:29,389][106225] Updated weights for policy 1, policy_version 175944 (0.0007) [2023-12-27 20:29:29,446][106225] Updated weights for policy 1, policy_version 175954 (0.0007) [2023-12-27 20:29:29,502][106225] Updated weights for policy 1, policy_version 175964 (0.0010) [2023-12-27 20:29:29,557][106226] Updated weights for policy 0, policy_version 175557 (0.0010) [2023-12-27 20:29:29,617][106226] Updated weights for policy 0, policy_version 175567 (0.0010) [2023-12-27 20:29:29,678][106226] Updated weights for policy 0, policy_version 175577 (0.0010) [2023-12-27 20:29:30,184][106225] Updated weights for policy 1, policy_version 175974 (0.0007) [2023-12-27 20:29:30,251][106225] Updated weights for policy 1, policy_version 175984 (0.0005) [2023-12-27 20:29:30,311][106225] Updated weights for policy 1, policy_version 175994 (0.0007) [2023-12-27 20:29:30,423][106226] Updated weights for policy 0, policy_version 175587 (0.0009) [2023-12-27 20:29:30,473][106226] Updated weights for policy 0, policy_version 175597 (0.0010) [2023-12-27 20:29:30,542][106226] Updated weights for policy 0, policy_version 175607 (0.0011) [2023-12-27 20:29:30,827][106225] Updated weights for policy 1, policy_version 176004 (0.0006) [2023-12-27 20:29:30,875][106225] Updated weights for policy 1, policy_version 176014 (0.0005) [2023-12-27 20:29:30,923][106225] Updated weights for policy 1, policy_version 176024 (0.0005) [2023-12-27 20:29:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 90038272. Throughput: 0: 9772.7, 1: 10202.5. Samples: 90027348. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:31,175][105115] Avg episode reward: [(0, '-5.505'), (1, '-6.520')] [2023-12-27 20:29:31,254][106226] Updated weights for policy 0, policy_version 175617 (0.0011) [2023-12-27 20:29:31,321][106226] Updated weights for policy 0, policy_version 175627 (0.0011) [2023-12-27 20:29:31,387][106226] Updated weights for policy 0, policy_version 175637 (0.0011) [2023-12-27 20:29:31,451][106226] Updated weights for policy 0, policy_version 175647 (0.0010) [2023-12-27 20:29:31,568][106225] Updated weights for policy 1, policy_version 176034 (0.0006) [2023-12-27 20:29:31,634][106225] Updated weights for policy 1, policy_version 176044 (0.0008) [2023-12-27 20:29:31,688][106225] Updated weights for policy 1, policy_version 176054 (0.0008) [2023-12-27 20:29:31,753][106225] Updated weights for policy 1, policy_version 176064 (0.0007) [2023-12-27 20:29:32,134][106226] Updated weights for policy 0, policy_version 175657 (0.0011) [2023-12-27 20:29:32,194][106226] Updated weights for policy 0, policy_version 175667 (0.0011) [2023-12-27 20:29:32,257][106226] Updated weights for policy 0, policy_version 175677 (0.0011) [2023-12-27 20:29:32,425][106225] Updated weights for policy 1, policy_version 176074 (0.0008) [2023-12-27 20:29:32,486][106225] Updated weights for policy 1, policy_version 176084 (0.0007) [2023-12-27 20:29:32,540][106225] Updated weights for policy 1, policy_version 176094 (0.0006) [2023-12-27 20:29:33,045][106226] Updated weights for policy 0, policy_version 175687 (0.0008) [2023-12-27 20:29:33,104][106226] Updated weights for policy 0, policy_version 175697 (0.0008) [2023-12-27 20:29:33,168][106226] Updated weights for policy 0, policy_version 175707 (0.0007) [2023-12-27 20:29:33,180][106225] Updated weights for policy 1, policy_version 176104 (0.0007) [2023-12-27 20:29:33,240][106225] Updated weights for policy 1, policy_version 176114 (0.0008) [2023-12-27 20:29:33,305][106225] Updated weights for policy 1, policy_version 176124 (0.0007) [2023-12-27 20:29:33,806][106226] Updated weights for policy 0, policy_version 175717 (0.0008) [2023-12-27 20:29:33,848][106226] Updated weights for policy 0, policy_version 175727 (0.0010) [2023-12-27 20:29:33,906][106226] Updated weights for policy 0, policy_version 175737 (0.0010) [2023-12-27 20:29:34,047][106225] Updated weights for policy 1, policy_version 176134 (0.0008) [2023-12-27 20:29:34,107][106225] Updated weights for policy 1, policy_version 176144 (0.0008) [2023-12-27 20:29:34,170][106225] Updated weights for policy 1, policy_version 176154 (0.0008) [2023-12-27 20:29:34,565][106226] Updated weights for policy 0, policy_version 175747 (0.0007) [2023-12-27 20:29:34,625][106226] Updated weights for policy 0, policy_version 175757 (0.0008) [2023-12-27 20:29:34,679][106226] Updated weights for policy 0, policy_version 175767 (0.0010) [2023-12-27 20:29:34,959][106225] Updated weights for policy 1, policy_version 176164 (0.0008) [2023-12-27 20:29:35,019][106225] Updated weights for policy 1, policy_version 176174 (0.0007) [2023-12-27 20:29:35,078][106225] Updated weights for policy 1, policy_version 176184 (0.0007) [2023-12-27 20:29:35,371][106226] Updated weights for policy 0, policy_version 175777 (0.0011) [2023-12-27 20:29:35,416][106226] Updated weights for policy 0, policy_version 175787 (0.0010) [2023-12-27 20:29:35,466][106226] Updated weights for policy 0, policy_version 175797 (0.0010) [2023-12-27 20:29:35,512][106226] Updated weights for policy 0, policy_version 175807 (0.0010) [2023-12-27 20:29:35,794][106225] Updated weights for policy 1, policy_version 176194 (0.0007) [2023-12-27 20:29:35,839][106225] Updated weights for policy 1, policy_version 176204 (0.0007) [2023-12-27 20:29:35,886][106225] Updated weights for policy 1, policy_version 176214 (0.0008) [2023-12-27 20:29:35,931][106225] Updated weights for policy 1, policy_version 176224 (0.0008) [2023-12-27 20:29:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 90136576. Throughput: 0: 9744.3, 1: 10203.3. Samples: 90148096. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 20:29:36,176][105115] Avg episode reward: [(0, '-5.098'), (1, '-6.723')] [2023-12-27 20:29:36,253][106226] Updated weights for policy 0, policy_version 175817 (0.0011) [2023-12-27 20:29:36,316][106226] Updated weights for policy 0, policy_version 175827 (0.0011) [2023-12-27 20:29:36,380][106226] Updated weights for policy 0, policy_version 175837 (0.0011) [2023-12-27 20:29:36,711][106225] Updated weights for policy 1, policy_version 176234 (0.0008) [2023-12-27 20:29:36,758][106225] Updated weights for policy 1, policy_version 176244 (0.0007) [2023-12-27 20:29:36,806][106225] Updated weights for policy 1, policy_version 176254 (0.0007) [2023-12-27 20:29:37,072][106226] Updated weights for policy 0, policy_version 175847 (0.0010) [2023-12-27 20:29:37,129][106226] Updated weights for policy 0, policy_version 175857 (0.0010) [2023-12-27 20:29:37,186][106226] Updated weights for policy 0, policy_version 175867 (0.0010) [2023-12-27 20:29:37,540][106225] Updated weights for policy 1, policy_version 176264 (0.0007) [2023-12-27 20:29:37,597][106225] Updated weights for policy 1, policy_version 176274 (0.0008) [2023-12-27 20:29:37,653][106225] Updated weights for policy 1, policy_version 176284 (0.0007) [2023-12-27 20:29:37,894][106226] Updated weights for policy 0, policy_version 175877 (0.0010) [2023-12-27 20:29:37,951][106226] Updated weights for policy 0, policy_version 175887 (0.0005) [2023-12-27 20:29:38,010][106226] Updated weights for policy 0, policy_version 175897 (0.0007) [2023-12-27 20:29:38,430][106225] Updated weights for policy 1, policy_version 176294 (0.0008) [2023-12-27 20:29:38,483][106225] Updated weights for policy 1, policy_version 176304 (0.0007) [2023-12-27 20:29:38,537][106225] Updated weights for policy 1, policy_version 176314 (0.0007) [2023-12-27 20:29:38,725][106226] Updated weights for policy 0, policy_version 175907 (0.0010) [2023-12-27 20:29:38,774][106226] Updated weights for policy 0, policy_version 175917 (0.0010) [2023-12-27 20:29:38,833][106226] Updated weights for policy 0, policy_version 175927 (0.0011) [2023-12-27 20:29:39,287][106225] Updated weights for policy 1, policy_version 176324 (0.0009) [2023-12-27 20:29:39,347][106225] Updated weights for policy 1, policy_version 176334 (0.0009) [2023-12-27 20:29:39,424][106225] Updated weights for policy 1, policy_version 176344 (0.0007) [2023-12-27 20:29:39,562][106226] Updated weights for policy 0, policy_version 175937 (0.0010) [2023-12-27 20:29:39,626][106226] Updated weights for policy 0, policy_version 175947 (0.0010) [2023-12-27 20:29:39,695][106226] Updated weights for policy 0, policy_version 175957 (0.0011) [2023-12-27 20:29:39,764][106226] Updated weights for policy 0, policy_version 175967 (0.0011) [2023-12-27 20:29:40,188][106225] Updated weights for policy 1, policy_version 176354 (0.0009) [2023-12-27 20:29:40,249][106225] Updated weights for policy 1, policy_version 176364 (0.0009) [2023-12-27 20:29:40,302][106225] Updated weights for policy 1, policy_version 176374 (0.0008) [2023-12-27 20:29:40,364][106225] Updated weights for policy 1, policy_version 176384 (0.0008) [2023-12-27 20:29:40,464][106226] Updated weights for policy 0, policy_version 175977 (0.0011) [2023-12-27 20:29:40,521][106226] Updated weights for policy 0, policy_version 175987 (0.0011) [2023-12-27 20:29:40,569][106226] Updated weights for policy 0, policy_version 175997 (0.0011) [2023-12-27 20:29:41,141][106225] Updated weights for policy 1, policy_version 176394 (0.0009) [2023-12-27 20:29:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 90226688. Throughput: 0: 9752.8, 1: 10170.6. Samples: 90204964. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:29:41,175][105115] Avg episode reward: [(0, '-5.427'), (1, '-6.501')] [2023-12-27 20:29:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000176000_45064192.pth... [2023-12-27 20:29:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000174848_44769280.pth [2023-12-27 20:29:41,196][106225] Updated weights for policy 1, policy_version 176404 (0.0009) [2023-12-27 20:29:41,258][106225] Updated weights for policy 1, policy_version 176414 (0.0008) [2023-12-27 20:29:41,261][106226] Updated weights for policy 0, policy_version 176007 (0.0008) [2023-12-27 20:29:41,271][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000176416_45170688.pth... [2023-12-27 20:29:41,276][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000175232_44867584.pth [2023-12-27 20:29:41,317][106226] Updated weights for policy 0, policy_version 176017 (0.0008) [2023-12-27 20:29:41,396][106226] Updated weights for policy 0, policy_version 176027 (0.0008) [2023-12-27 20:29:42,048][106226] Updated weights for policy 0, policy_version 176037 (0.0007) [2023-12-27 20:29:42,072][106225] Updated weights for policy 1, policy_version 176424 (0.0009) [2023-12-27 20:29:42,118][106226] Updated weights for policy 0, policy_version 176047 (0.0007) [2023-12-27 20:29:42,128][106225] Updated weights for policy 1, policy_version 176434 (0.0008) [2023-12-27 20:29:42,190][106225] Updated weights for policy 1, policy_version 176444 (0.0008) [2023-12-27 20:29:42,190][106226] Updated weights for policy 0, policy_version 176057 (0.0008) [2023-12-27 20:29:42,864][106226] Updated weights for policy 0, policy_version 176067 (0.0010) [2023-12-27 20:29:42,908][106225] Updated weights for policy 1, policy_version 176454 (0.0005) [2023-12-27 20:29:42,925][106226] Updated weights for policy 0, policy_version 176077 (0.0011) [2023-12-27 20:29:42,963][106225] Updated weights for policy 1, policy_version 176464 (0.0009) [2023-12-27 20:29:42,982][106226] Updated weights for policy 0, policy_version 176087 (0.0010) [2023-12-27 20:29:43,023][106225] Updated weights for policy 1, policy_version 176474 (0.0007) [2023-12-27 20:29:43,679][106225] Updated weights for policy 1, policy_version 176484 (0.0006) [2023-12-27 20:29:43,692][106226] Updated weights for policy 0, policy_version 176097 (0.0011) [2023-12-27 20:29:43,725][106225] Updated weights for policy 1, policy_version 176494 (0.0009) [2023-12-27 20:29:43,748][106226] Updated weights for policy 0, policy_version 176107 (0.0010) [2023-12-27 20:29:43,780][106225] Updated weights for policy 1, policy_version 176504 (0.0005) [2023-12-27 20:29:43,801][106226] Updated weights for policy 0, policy_version 176117 (0.0010) [2023-12-27 20:29:43,854][106226] Updated weights for policy 0, policy_version 176127 (0.0010) [2023-12-27 20:29:44,397][106225] Updated weights for policy 1, policy_version 176514 (0.0006) [2023-12-27 20:29:44,454][106225] Updated weights for policy 1, policy_version 176524 (0.0010) [2023-12-27 20:29:44,514][106225] Updated weights for policy 1, policy_version 176534 (0.0010) [2023-12-27 20:29:44,574][106225] Updated weights for policy 1, policy_version 176544 (0.0010) [2023-12-27 20:29:44,576][106226] Updated weights for policy 0, policy_version 176137 (0.0010) [2023-12-27 20:29:44,633][106226] Updated weights for policy 0, policy_version 176147 (0.0010) [2023-12-27 20:29:44,692][106226] Updated weights for policy 0, policy_version 176157 (0.0010) [2023-12-27 20:29:45,229][106225] Updated weights for policy 1, policy_version 176554 (0.0009) [2023-12-27 20:29:45,290][106225] Updated weights for policy 1, policy_version 176564 (0.0007) [2023-12-27 20:29:45,350][106225] Updated weights for policy 1, policy_version 176574 (0.0009) [2023-12-27 20:29:45,352][106226] Updated weights for policy 0, policy_version 176167 (0.0008) [2023-12-27 20:29:45,407][106226] Updated weights for policy 0, policy_version 176177 (0.0008) [2023-12-27 20:29:45,461][106226] Updated weights for policy 0, policy_version 176187 (0.0008) [2023-12-27 20:29:46,079][106226] Updated weights for policy 0, policy_version 176197 (0.0009) [2023-12-27 20:29:46,111][106225] Updated weights for policy 1, policy_version 176584 (0.0007) [2023-12-27 20:29:46,128][106226] Updated weights for policy 0, policy_version 176207 (0.0007) [2023-12-27 20:29:46,169][106225] Updated weights for policy 1, policy_version 176594 (0.0007) [2023-12-27 20:29:46,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 90324992. Throughput: 0: 9720.7, 1: 10022.5. Samples: 90321296. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:29:46,175][105115] Avg episode reward: [(0, '-5.149'), (1, '-6.468')] [2023-12-27 20:29:46,183][106226] Updated weights for policy 0, policy_version 176217 (0.0007) [2023-12-27 20:29:46,226][106225] Updated weights for policy 1, policy_version 176604 (0.0007) [2023-12-27 20:29:46,889][106226] Updated weights for policy 0, policy_version 176227 (0.0006) [2023-12-27 20:29:46,959][106226] Updated weights for policy 0, policy_version 176237 (0.0007) [2023-12-27 20:29:47,004][106225] Updated weights for policy 1, policy_version 176614 (0.0009) [2023-12-27 20:29:47,020][106226] Updated weights for policy 0, policy_version 176247 (0.0010) [2023-12-27 20:29:47,066][106225] Updated weights for policy 1, policy_version 176624 (0.0008) [2023-12-27 20:29:47,128][106225] Updated weights for policy 1, policy_version 176634 (0.0008) [2023-12-27 20:29:47,661][106226] Updated weights for policy 0, policy_version 176257 (0.0007) [2023-12-27 20:29:47,719][106226] Updated weights for policy 0, policy_version 176267 (0.0005) [2023-12-27 20:29:47,783][106226] Updated weights for policy 0, policy_version 176277 (0.0006) [2023-12-27 20:29:47,838][106226] Updated weights for policy 0, policy_version 176287 (0.0005) [2023-12-27 20:29:47,882][106225] Updated weights for policy 1, policy_version 176644 (0.0009) [2023-12-27 20:29:47,943][106225] Updated weights for policy 1, policy_version 176654 (0.0009) [2023-12-27 20:29:48,007][106225] Updated weights for policy 1, policy_version 176664 (0.0009) [2023-12-27 20:29:48,470][106226] Updated weights for policy 0, policy_version 176297 (0.0010) [2023-12-27 20:29:48,527][106226] Updated weights for policy 0, policy_version 176307 (0.0010) [2023-12-27 20:29:48,587][106226] Updated weights for policy 0, policy_version 176317 (0.0010) [2023-12-27 20:29:48,764][106225] Updated weights for policy 1, policy_version 176674 (0.0008) [2023-12-27 20:29:48,828][106225] Updated weights for policy 1, policy_version 176684 (0.0007) [2023-12-27 20:29:48,891][106225] Updated weights for policy 1, policy_version 176694 (0.0009) [2023-12-27 20:29:48,951][106225] Updated weights for policy 1, policy_version 176704 (0.0010) [2023-12-27 20:29:49,321][106226] Updated weights for policy 0, policy_version 176327 (0.0011) [2023-12-27 20:29:49,395][106226] Updated weights for policy 0, policy_version 176337 (0.0009) [2023-12-27 20:29:49,452][106226] Updated weights for policy 0, policy_version 176347 (0.0009) [2023-12-27 20:29:49,710][106225] Updated weights for policy 1, policy_version 176714 (0.0006) [2023-12-27 20:29:49,780][106225] Updated weights for policy 1, policy_version 176724 (0.0005) [2023-12-27 20:29:49,853][106225] Updated weights for policy 1, policy_version 176734 (0.0007) [2023-12-27 20:29:50,139][106226] Updated weights for policy 0, policy_version 176357 (0.0007) [2023-12-27 20:29:50,204][106226] Updated weights for policy 0, policy_version 176367 (0.0008) [2023-12-27 20:29:50,267][106226] Updated weights for policy 0, policy_version 176377 (0.0007) [2023-12-27 20:29:50,504][106225] Updated weights for policy 1, policy_version 176744 (0.0008) [2023-12-27 20:29:50,570][106225] Updated weights for policy 1, policy_version 176754 (0.0009) [2023-12-27 20:29:50,633][106225] Updated weights for policy 1, policy_version 176764 (0.0007) [2023-12-27 20:29:51,000][106226] Updated weights for policy 0, policy_version 176387 (0.0007) [2023-12-27 20:29:51,062][106226] Updated weights for policy 0, policy_version 176397 (0.0011) [2023-12-27 20:29:51,135][106226] Updated weights for policy 0, policy_version 176407 (0.0011) [2023-12-27 20:29:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 90423296. Throughput: 0: 9814.5, 1: 9934.4. Samples: 90439020. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:29:51,175][105115] Avg episode reward: [(0, '-5.583'), (1, '-6.579')] [2023-12-27 20:29:51,315][106225] Updated weights for policy 1, policy_version 176774 (0.0007) [2023-12-27 20:29:51,388][106225] Updated weights for policy 1, policy_version 176784 (0.0008) [2023-12-27 20:29:51,445][106225] Updated weights for policy 1, policy_version 176794 (0.0008) [2023-12-27 20:29:51,891][106226] Updated weights for policy 0, policy_version 176417 (0.0010) [2023-12-27 20:29:51,950][106226] Updated weights for policy 0, policy_version 176427 (0.0008) [2023-12-27 20:29:52,005][106226] Updated weights for policy 0, policy_version 176437 (0.0008) [2023-12-27 20:29:52,053][106226] Updated weights for policy 0, policy_version 176447 (0.0008) [2023-12-27 20:29:52,186][106225] Updated weights for policy 1, policy_version 176804 (0.0008) [2023-12-27 20:29:52,236][106225] Updated weights for policy 1, policy_version 176814 (0.0009) [2023-12-27 20:29:52,297][106225] Updated weights for policy 1, policy_version 176824 (0.0007) [2023-12-27 20:29:52,854][106226] Updated weights for policy 0, policy_version 176457 (0.0009) [2023-12-27 20:29:52,912][106226] Updated weights for policy 0, policy_version 176467 (0.0009) [2023-12-27 20:29:52,968][106226] Updated weights for policy 0, policy_version 176477 (0.0008) [2023-12-27 20:29:52,994][106225] Updated weights for policy 1, policy_version 176834 (0.0006) [2023-12-27 20:29:53,059][106225] Updated weights for policy 1, policy_version 176844 (0.0008) [2023-12-27 20:29:53,124][106225] Updated weights for policy 1, policy_version 176854 (0.0009) [2023-12-27 20:29:53,171][106225] Updated weights for policy 1, policy_version 176864 (0.0005) [2023-12-27 20:29:53,682][106226] Updated weights for policy 0, policy_version 176487 (0.0006) [2023-12-27 20:29:53,716][106225] Updated weights for policy 1, policy_version 176874 (0.0010) [2023-12-27 20:29:53,746][106226] Updated weights for policy 0, policy_version 176497 (0.0006) [2023-12-27 20:29:53,776][106225] Updated weights for policy 1, policy_version 176884 (0.0010) [2023-12-27 20:29:53,807][106226] Updated weights for policy 0, policy_version 176507 (0.0007) [2023-12-27 20:29:53,840][106225] Updated weights for policy 1, policy_version 176894 (0.0010) [2023-12-27 20:29:54,341][106226] Updated weights for policy 0, policy_version 176517 (0.0007) [2023-12-27 20:29:54,403][106226] Updated weights for policy 0, policy_version 176527 (0.0006) [2023-12-27 20:29:54,463][106226] Updated weights for policy 0, policy_version 176537 (0.0005) [2023-12-27 20:29:54,491][106225] Updated weights for policy 1, policy_version 176904 (0.0007) [2023-12-27 20:29:54,555][106225] Updated weights for policy 1, policy_version 176914 (0.0006) [2023-12-27 20:29:54,604][106225] Updated weights for policy 1, policy_version 176924 (0.0010) [2023-12-27 20:29:55,025][106226] Updated weights for policy 0, policy_version 176547 (0.0007) [2023-12-27 20:29:55,076][106226] Updated weights for policy 0, policy_version 176557 (0.0008) [2023-12-27 20:29:55,126][106226] Updated weights for policy 0, policy_version 176567 (0.0008) [2023-12-27 20:29:55,262][106225] Updated weights for policy 1, policy_version 176934 (0.0007) [2023-12-27 20:29:55,319][106225] Updated weights for policy 1, policy_version 176944 (0.0006) [2023-12-27 20:29:55,369][106225] Updated weights for policy 1, policy_version 176954 (0.0008) [2023-12-27 20:29:55,896][106226] Updated weights for policy 0, policy_version 176577 (0.0009) [2023-12-27 20:29:55,946][106226] Updated weights for policy 0, policy_version 176587 (0.0010) [2023-12-27 20:29:55,993][106226] Updated weights for policy 0, policy_version 176597 (0.0010) [2023-12-27 20:29:56,049][106226] Updated weights for policy 0, policy_version 176607 (0.0010) [2023-12-27 20:29:56,086][106225] Updated weights for policy 1, policy_version 176964 (0.0008) [2023-12-27 20:29:56,147][106225] Updated weights for policy 1, policy_version 176974 (0.0008) [2023-12-27 20:29:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 90529792. Throughput: 0: 9872.7, 1: 9903.9. Samples: 90499008. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:29:56,175][105115] Avg episode reward: [(0, '-5.140'), (1, '-6.676')] [2023-12-27 20:29:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000176608_45219840.pth... [2023-12-27 20:29:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000175424_44916736.pth [2023-12-27 20:29:56,198][106225] Updated weights for policy 1, policy_version 176984 (0.0008) [2023-12-27 20:29:56,233][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000176992_45318144.pth... [2023-12-27 20:29:56,236][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000175808_45015040.pth [2023-12-27 20:29:56,775][106226] Updated weights for policy 0, policy_version 176617 (0.0010) [2023-12-27 20:29:56,821][106226] Updated weights for policy 0, policy_version 176627 (0.0010) [2023-12-27 20:29:56,873][106226] Updated weights for policy 0, policy_version 176637 (0.0010) [2023-12-27 20:29:56,943][106225] Updated weights for policy 1, policy_version 176994 (0.0008) [2023-12-27 20:29:56,997][106225] Updated weights for policy 1, policy_version 177004 (0.0008) [2023-12-27 20:29:57,054][106225] Updated weights for policy 1, policy_version 177014 (0.0007) [2023-12-27 20:29:57,110][106225] Updated weights for policy 1, policy_version 177024 (0.0007) [2023-12-27 20:29:57,590][106226] Updated weights for policy 0, policy_version 176647 (0.0010) [2023-12-27 20:29:57,636][106226] Updated weights for policy 0, policy_version 176657 (0.0010) [2023-12-27 20:29:57,688][106226] Updated weights for policy 0, policy_version 176667 (0.0010) [2023-12-27 20:29:57,840][106225] Updated weights for policy 1, policy_version 177034 (0.0008) [2023-12-27 20:29:57,900][106225] Updated weights for policy 1, policy_version 177044 (0.0008) [2023-12-27 20:29:57,962][106225] Updated weights for policy 1, policy_version 177054 (0.0007) [2023-12-27 20:29:58,461][106226] Updated weights for policy 0, policy_version 176677 (0.0009) [2023-12-27 20:29:58,533][106226] Updated weights for policy 0, policy_version 176687 (0.0009) [2023-12-27 20:29:58,595][106226] Updated weights for policy 0, policy_version 176697 (0.0008) [2023-12-27 20:29:58,747][106225] Updated weights for policy 1, policy_version 177064 (0.0009) [2023-12-27 20:29:58,826][106225] Updated weights for policy 1, policy_version 177074 (0.0009) [2023-12-27 20:29:58,898][106225] Updated weights for policy 1, policy_version 177084 (0.0008) [2023-12-27 20:29:59,366][106226] Updated weights for policy 0, policy_version 176707 (0.0007) [2023-12-27 20:29:59,432][106226] Updated weights for policy 0, policy_version 176717 (0.0006) [2023-12-27 20:29:59,490][106226] Updated weights for policy 0, policy_version 176727 (0.0008) [2023-12-27 20:29:59,673][106225] Updated weights for policy 1, policy_version 177094 (0.0010) [2023-12-27 20:29:59,727][106225] Updated weights for policy 1, policy_version 177104 (0.0010) [2023-12-27 20:29:59,786][106225] Updated weights for policy 1, policy_version 177114 (0.0010) [2023-12-27 20:30:00,094][106226] Updated weights for policy 0, policy_version 176737 (0.0008) [2023-12-27 20:30:00,158][106226] Updated weights for policy 0, policy_version 176747 (0.0008) [2023-12-27 20:30:00,216][106226] Updated weights for policy 0, policy_version 176757 (0.0008) [2023-12-27 20:30:00,277][106226] Updated weights for policy 0, policy_version 176767 (0.0008) [2023-12-27 20:30:00,534][106225] Updated weights for policy 1, policy_version 177124 (0.0008) [2023-12-27 20:30:00,590][106225] Updated weights for policy 1, policy_version 177134 (0.0005) [2023-12-27 20:30:00,641][106225] Updated weights for policy 1, policy_version 177144 (0.0007) [2023-12-27 20:30:00,913][106226] Updated weights for policy 0, policy_version 176777 (0.0006) [2023-12-27 20:30:00,985][106226] Updated weights for policy 0, policy_version 176787 (0.0008) [2023-12-27 20:30:01,052][106226] Updated weights for policy 0, policy_version 176797 (0.0009) [2023-12-27 20:30:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 90628096. Throughput: 0: 9945.8, 1: 9884.5. Samples: 90616352. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:01,175][105115] Avg episode reward: [(0, '-5.623'), (1, '-6.840')] [2023-12-27 20:30:01,274][106225] Updated weights for policy 1, policy_version 177154 (0.0008) [2023-12-27 20:30:01,330][106225] Updated weights for policy 1, policy_version 177164 (0.0008) [2023-12-27 20:30:01,389][106225] Updated weights for policy 1, policy_version 177174 (0.0009) [2023-12-27 20:30:01,444][106225] Updated weights for policy 1, policy_version 177184 (0.0008) [2023-12-27 20:30:01,804][106226] Updated weights for policy 0, policy_version 176807 (0.0008) [2023-12-27 20:30:01,857][106226] Updated weights for policy 0, policy_version 176817 (0.0009) [2023-12-27 20:30:01,908][106226] Updated weights for policy 0, policy_version 176827 (0.0009) [2023-12-27 20:30:02,111][106225] Updated weights for policy 1, policy_version 177194 (0.0005) [2023-12-27 20:30:02,168][106225] Updated weights for policy 1, policy_version 177204 (0.0005) [2023-12-27 20:30:02,227][106225] Updated weights for policy 1, policy_version 177214 (0.0005) [2023-12-27 20:30:02,717][106226] Updated weights for policy 0, policy_version 176837 (0.0009) [2023-12-27 20:30:02,781][106226] Updated weights for policy 0, policy_version 176847 (0.0006) [2023-12-27 20:30:02,845][106226] Updated weights for policy 0, policy_version 176857 (0.0006) [2023-12-27 20:30:02,885][106225] Updated weights for policy 1, policy_version 177224 (0.0008) [2023-12-27 20:30:02,945][106225] Updated weights for policy 1, policy_version 177234 (0.0008) [2023-12-27 20:30:03,014][106225] Updated weights for policy 1, policy_version 177244 (0.0009) [2023-12-27 20:30:03,412][106226] Updated weights for policy 0, policy_version 176867 (0.0007) [2023-12-27 20:30:03,469][106226] Updated weights for policy 0, policy_version 176877 (0.0009) [2023-12-27 20:30:03,524][106226] Updated weights for policy 0, policy_version 176887 (0.0005) [2023-12-27 20:30:03,785][106225] Updated weights for policy 1, policy_version 177254 (0.0009) [2023-12-27 20:30:03,841][106225] Updated weights for policy 1, policy_version 177264 (0.0009) [2023-12-27 20:30:03,901][106225] Updated weights for policy 1, policy_version 177274 (0.0008) [2023-12-27 20:30:04,122][106226] Updated weights for policy 0, policy_version 176897 (0.0006) [2023-12-27 20:30:04,192][106226] Updated weights for policy 0, policy_version 176907 (0.0009) [2023-12-27 20:30:04,259][106226] Updated weights for policy 0, policy_version 176917 (0.0007) [2023-12-27 20:30:04,329][106226] Updated weights for policy 0, policy_version 176927 (0.0007) [2023-12-27 20:30:04,672][106225] Updated weights for policy 1, policy_version 177284 (0.0009) [2023-12-27 20:30:04,724][106225] Updated weights for policy 1, policy_version 177294 (0.0008) [2023-12-27 20:30:04,768][106225] Updated weights for policy 1, policy_version 177304 (0.0008) [2023-12-27 20:30:04,963][106226] Updated weights for policy 0, policy_version 176937 (0.0008) [2023-12-27 20:30:05,025][106226] Updated weights for policy 0, policy_version 176947 (0.0009) [2023-12-27 20:30:05,080][106226] Updated weights for policy 0, policy_version 176957 (0.0008) [2023-12-27 20:30:05,569][106225] Updated weights for policy 1, policy_version 177314 (0.0008) [2023-12-27 20:30:05,619][106225] Updated weights for policy 1, policy_version 177324 (0.0008) [2023-12-27 20:30:05,663][106225] Updated weights for policy 1, policy_version 177334 (0.0008) [2023-12-27 20:30:05,688][106226] Updated weights for policy 0, policy_version 176967 (0.0007) [2023-12-27 20:30:05,716][106225] Updated weights for policy 1, policy_version 177344 (0.0007) [2023-12-27 20:30:05,744][106226] Updated weights for policy 0, policy_version 176977 (0.0005) [2023-12-27 20:30:05,805][106226] Updated weights for policy 0, policy_version 176987 (0.0008) [2023-12-27 20:30:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 90726400. Throughput: 0: 9968.9, 1: 9887.8. Samples: 90735768. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:06,175][105115] Avg episode reward: [(0, '-5.430'), (1, '-7.150')] [2023-12-27 20:30:06,406][106225] Updated weights for policy 1, policy_version 177354 (0.0010) [2023-12-27 20:30:06,476][106225] Updated weights for policy 1, policy_version 177364 (0.0011) [2023-12-27 20:30:06,512][106226] Updated weights for policy 0, policy_version 176997 (0.0006) [2023-12-27 20:30:06,544][106225] Updated weights for policy 1, policy_version 177374 (0.0010) [2023-12-27 20:30:06,575][106226] Updated weights for policy 0, policy_version 177007 (0.0008) [2023-12-27 20:30:06,639][106226] Updated weights for policy 0, policy_version 177017 (0.0009) [2023-12-27 20:30:07,254][106226] Updated weights for policy 0, policy_version 177027 (0.0008) [2023-12-27 20:30:07,306][106226] Updated weights for policy 0, policy_version 177037 (0.0006) [2023-12-27 20:30:07,321][106225] Updated weights for policy 1, policy_version 177384 (0.0008) [2023-12-27 20:30:07,365][106226] Updated weights for policy 0, policy_version 177047 (0.0007) [2023-12-27 20:30:07,371][106225] Updated weights for policy 1, policy_version 177394 (0.0005) [2023-12-27 20:30:07,420][106225] Updated weights for policy 1, policy_version 177404 (0.0005) [2023-12-27 20:30:07,964][106225] Updated weights for policy 1, policy_version 177414 (0.0005) [2023-12-27 20:30:08,016][106225] Updated weights for policy 1, policy_version 177424 (0.0006) [2023-12-27 20:30:08,067][106225] Updated weights for policy 1, policy_version 177434 (0.0008) [2023-12-27 20:30:08,095][106226] Updated weights for policy 0, policy_version 177057 (0.0008) [2023-12-27 20:30:08,145][106226] Updated weights for policy 0, policy_version 177067 (0.0005) [2023-12-27 20:30:08,196][106226] Updated weights for policy 0, policy_version 177077 (0.0005) [2023-12-27 20:30:08,250][106226] Updated weights for policy 0, policy_version 177087 (0.0005) [2023-12-27 20:30:08,722][106225] Updated weights for policy 1, policy_version 177444 (0.0008) [2023-12-27 20:30:08,774][106225] Updated weights for policy 1, policy_version 177454 (0.0008) [2023-12-27 20:30:08,831][106225] Updated weights for policy 1, policy_version 177464 (0.0005) [2023-12-27 20:30:08,968][106226] Updated weights for policy 0, policy_version 177097 (0.0010) [2023-12-27 20:30:09,021][106226] Updated weights for policy 0, policy_version 177107 (0.0010) [2023-12-27 20:30:09,076][106226] Updated weights for policy 0, policy_version 177117 (0.0010) [2023-12-27 20:30:09,522][106225] Updated weights for policy 1, policy_version 177474 (0.0005) [2023-12-27 20:30:09,585][106225] Updated weights for policy 1, policy_version 177484 (0.0006) [2023-12-27 20:30:09,649][106225] Updated weights for policy 1, policy_version 177494 (0.0006) [2023-12-27 20:30:09,706][106225] Updated weights for policy 1, policy_version 177504 (0.0006) [2023-12-27 20:30:09,887][106226] Updated weights for policy 0, policy_version 177127 (0.0011) [2023-12-27 20:30:09,952][106226] Updated weights for policy 0, policy_version 177137 (0.0009) [2023-12-27 20:30:10,019][106226] Updated weights for policy 0, policy_version 177147 (0.0008) [2023-12-27 20:30:10,389][106225] Updated weights for policy 1, policy_version 177514 (0.0010) [2023-12-27 20:30:10,450][106225] Updated weights for policy 1, policy_version 177524 (0.0010) [2023-12-27 20:30:10,507][106225] Updated weights for policy 1, policy_version 177534 (0.0010) [2023-12-27 20:30:10,780][106226] Updated weights for policy 0, policy_version 177157 (0.0007) [2023-12-27 20:30:10,838][106226] Updated weights for policy 0, policy_version 177167 (0.0007) [2023-12-27 20:30:10,899][106226] Updated weights for policy 0, policy_version 177177 (0.0008) [2023-12-27 20:30:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 90824704. Throughput: 0: 9995.6, 1: 9974.1. Samples: 90797244. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:11,175][105115] Avg episode reward: [(0, '-5.214'), (1, '-6.900')] [2023-12-27 20:30:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000177184_45367296.pth... [2023-12-27 20:30:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000176000_45064192.pth [2023-12-27 20:30:11,240][106225] Updated weights for policy 1, policy_version 177544 (0.0010) [2023-12-27 20:30:11,308][106225] Updated weights for policy 1, policy_version 177554 (0.0009) [2023-12-27 20:30:11,387][106225] Updated weights for policy 1, policy_version 177564 (0.0013) [2023-12-27 20:30:11,411][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000177568_45465600.pth... [2023-12-27 20:30:11,416][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000176416_45170688.pth [2023-12-27 20:30:11,692][106226] Updated weights for policy 0, policy_version 177187 (0.0009) [2023-12-27 20:30:11,766][106226] Updated weights for policy 0, policy_version 177197 (0.0008) [2023-12-27 20:30:11,830][106226] Updated weights for policy 0, policy_version 177207 (0.0008) [2023-12-27 20:30:12,156][106225] Updated weights for policy 1, policy_version 177574 (0.0008) [2023-12-27 20:30:12,213][106225] Updated weights for policy 1, policy_version 177584 (0.0008) [2023-12-27 20:30:12,273][106225] Updated weights for policy 1, policy_version 177594 (0.0009) [2023-12-27 20:30:12,537][106226] Updated weights for policy 0, policy_version 177217 (0.0008) [2023-12-27 20:30:12,596][106226] Updated weights for policy 0, policy_version 177227 (0.0005) [2023-12-27 20:30:12,659][106226] Updated weights for policy 0, policy_version 177237 (0.0007) [2023-12-27 20:30:12,722][106226] Updated weights for policy 0, policy_version 177247 (0.0008) [2023-12-27 20:30:12,987][106225] Updated weights for policy 1, policy_version 177604 (0.0007) [2023-12-27 20:30:13,042][106225] Updated weights for policy 1, policy_version 177614 (0.0009) [2023-12-27 20:30:13,098][106225] Updated weights for policy 1, policy_version 177624 (0.0007) [2023-12-27 20:30:13,433][106226] Updated weights for policy 0, policy_version 177257 (0.0005) [2023-12-27 20:30:13,492][106226] Updated weights for policy 0, policy_version 177267 (0.0005) [2023-12-27 20:30:13,549][106226] Updated weights for policy 0, policy_version 177277 (0.0005) [2023-12-27 20:30:13,720][106225] Updated weights for policy 1, policy_version 177634 (0.0006) [2023-12-27 20:30:13,773][106225] Updated weights for policy 1, policy_version 177644 (0.0005) [2023-12-27 20:30:13,825][106225] Updated weights for policy 1, policy_version 177654 (0.0005) [2023-12-27 20:30:13,874][106225] Updated weights for policy 1, policy_version 177664 (0.0005) [2023-12-27 20:30:14,118][106226] Updated weights for policy 0, policy_version 177287 (0.0009) [2023-12-27 20:30:14,175][106226] Updated weights for policy 0, policy_version 177297 (0.0010) [2023-12-27 20:30:14,224][106226] Updated weights for policy 0, policy_version 177307 (0.0010) [2023-12-27 20:30:14,457][106225] Updated weights for policy 1, policy_version 177674 (0.0008) [2023-12-27 20:30:14,518][106225] Updated weights for policy 1, policy_version 177684 (0.0008) [2023-12-27 20:30:14,578][106225] Updated weights for policy 1, policy_version 177694 (0.0007) [2023-12-27 20:30:14,972][106226] Updated weights for policy 0, policy_version 177317 (0.0008) [2023-12-27 20:30:15,034][106226] Updated weights for policy 0, policy_version 177327 (0.0008) [2023-12-27 20:30:15,099][106226] Updated weights for policy 0, policy_version 177337 (0.0010) [2023-12-27 20:30:15,263][106225] Updated weights for policy 1, policy_version 177704 (0.0007) [2023-12-27 20:30:15,324][106225] Updated weights for policy 1, policy_version 177714 (0.0008) [2023-12-27 20:30:15,371][106225] Updated weights for policy 1, policy_version 177724 (0.0008) [2023-12-27 20:30:15,782][106226] Updated weights for policy 0, policy_version 177347 (0.0010) [2023-12-27 20:30:15,828][106226] Updated weights for policy 0, policy_version 177357 (0.0010) [2023-12-27 20:30:15,889][106226] Updated weights for policy 0, policy_version 177367 (0.0010) [2023-12-27 20:30:15,996][106225] Updated weights for policy 1, policy_version 177734 (0.0008) [2023-12-27 20:30:16,049][106225] Updated weights for policy 1, policy_version 177744 (0.0008) [2023-12-27 20:30:16,099][106225] Updated weights for policy 1, policy_version 177754 (0.0009) [2023-12-27 20:30:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 90931200. Throughput: 0: 9923.0, 1: 9808.7. Samples: 90915276. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:16,176][105115] Avg episode reward: [(0, '-5.575'), (1, '-7.071')] [2023-12-27 20:30:16,514][106226] Updated weights for policy 0, policy_version 177377 (0.0010) [2023-12-27 20:30:16,573][106226] Updated weights for policy 0, policy_version 177387 (0.0010) [2023-12-27 20:30:16,633][106226] Updated weights for policy 0, policy_version 177397 (0.0010) [2023-12-27 20:30:16,693][106226] Updated weights for policy 0, policy_version 177407 (0.0010) [2023-12-27 20:30:16,731][106225] Updated weights for policy 1, policy_version 177764 (0.0008) [2023-12-27 20:30:16,799][106225] Updated weights for policy 1, policy_version 177774 (0.0006) [2023-12-27 20:30:16,859][106225] Updated weights for policy 1, policy_version 177784 (0.0008) [2023-12-27 20:30:17,403][106226] Updated weights for policy 0, policy_version 177417 (0.0010) [2023-12-27 20:30:17,464][106226] Updated weights for policy 0, policy_version 177427 (0.0011) [2023-12-27 20:30:17,525][106226] Updated weights for policy 0, policy_version 177437 (0.0011) [2023-12-27 20:30:17,594][106225] Updated weights for policy 1, policy_version 177794 (0.0008) [2023-12-27 20:30:17,652][106225] Updated weights for policy 1, policy_version 177804 (0.0010) [2023-12-27 20:30:17,717][106225] Updated weights for policy 1, policy_version 177814 (0.0008) [2023-12-27 20:30:17,775][106225] Updated weights for policy 1, policy_version 177824 (0.0008) [2023-12-27 20:30:18,218][106226] Updated weights for policy 0, policy_version 177447 (0.0011) [2023-12-27 20:30:18,267][106226] Updated weights for policy 0, policy_version 177457 (0.0010) [2023-12-27 20:30:18,316][106226] Updated weights for policy 0, policy_version 177467 (0.0010) [2023-12-27 20:30:18,531][106225] Updated weights for policy 1, policy_version 177834 (0.0008) [2023-12-27 20:30:18,589][106225] Updated weights for policy 1, policy_version 177844 (0.0008) [2023-12-27 20:30:18,654][106225] Updated weights for policy 1, policy_version 177854 (0.0008) [2023-12-27 20:30:19,025][106226] Updated weights for policy 0, policy_version 177477 (0.0010) [2023-12-27 20:30:19,071][106226] Updated weights for policy 0, policy_version 177487 (0.0010) [2023-12-27 20:30:19,119][106226] Updated weights for policy 0, policy_version 177497 (0.0010) [2023-12-27 20:30:19,390][106225] Updated weights for policy 1, policy_version 177864 (0.0009) [2023-12-27 20:30:19,446][106225] Updated weights for policy 1, policy_version 177874 (0.0009) [2023-12-27 20:30:19,515][106225] Updated weights for policy 1, policy_version 177884 (0.0008) [2023-12-27 20:30:19,909][106226] Updated weights for policy 0, policy_version 177507 (0.0009) [2023-12-27 20:30:19,985][106226] Updated weights for policy 0, policy_version 177518 (0.0010) [2023-12-27 20:30:20,055][106226] Updated weights for policy 0, policy_version 177528 (0.0010) [2023-12-27 20:30:20,267][106225] Updated weights for policy 1, policy_version 177894 (0.0008) [2023-12-27 20:30:20,327][106225] Updated weights for policy 1, policy_version 177904 (0.0007) [2023-12-27 20:30:20,385][106225] Updated weights for policy 1, policy_version 177914 (0.0008) [2023-12-27 20:30:20,797][106226] Updated weights for policy 0, policy_version 177538 (0.0010) [2023-12-27 20:30:20,854][106226] Updated weights for policy 0, policy_version 177548 (0.0010) [2023-12-27 20:30:20,920][106226] Updated weights for policy 0, policy_version 177558 (0.0011) [2023-12-27 20:30:20,972][106226] Updated weights for policy 0, policy_version 177568 (0.0011) [2023-12-27 20:30:21,027][106225] Updated weights for policy 1, policy_version 177924 (0.0008) [2023-12-27 20:30:21,101][106225] Updated weights for policy 1, policy_version 177934 (0.0008) [2023-12-27 20:30:21,171][106225] Updated weights for policy 1, policy_version 177944 (0.0008) [2023-12-27 20:30:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 91021312. Throughput: 0: 9904.1, 1: 9747.4. Samples: 91032412. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:21,175][105115] Avg episode reward: [(0, '-5.721'), (1, '-7.726')] [2023-12-27 20:30:21,800][106226] Updated weights for policy 0, policy_version 177578 (0.0009) [2023-12-27 20:30:21,860][106226] Updated weights for policy 0, policy_version 177588 (0.0010) [2023-12-27 20:30:21,889][106225] Updated weights for policy 1, policy_version 177954 (0.0007) [2023-12-27 20:30:21,914][106226] Updated weights for policy 0, policy_version 177598 (0.0010) [2023-12-27 20:30:21,949][106225] Updated weights for policy 1, policy_version 177964 (0.0007) [2023-12-27 20:30:22,017][106225] Updated weights for policy 1, policy_version 177974 (0.0009) [2023-12-27 20:30:22,080][106225] Updated weights for policy 1, policy_version 177984 (0.0010) [2023-12-27 20:30:22,637][106226] Updated weights for policy 0, policy_version 177608 (0.0011) [2023-12-27 20:30:22,698][106226] Updated weights for policy 0, policy_version 177618 (0.0011) [2023-12-27 20:30:22,746][106226] Updated weights for policy 0, policy_version 177628 (0.0010) [2023-12-27 20:30:22,832][106225] Updated weights for policy 1, policy_version 177994 (0.0010) [2023-12-27 20:30:22,891][106225] Updated weights for policy 1, policy_version 178004 (0.0010) [2023-12-27 20:30:22,938][106225] Updated weights for policy 1, policy_version 178014 (0.0010) [2023-12-27 20:30:23,411][106226] Updated weights for policy 0, policy_version 177638 (0.0007) [2023-12-27 20:30:23,461][106226] Updated weights for policy 0, policy_version 177648 (0.0008) [2023-12-27 20:30:23,523][106226] Updated weights for policy 0, policy_version 177658 (0.0010) [2023-12-27 20:30:23,549][106225] Updated weights for policy 1, policy_version 178024 (0.0010) [2023-12-27 20:30:23,596][106225] Updated weights for policy 1, policy_version 178034 (0.0010) [2023-12-27 20:30:23,644][106225] Updated weights for policy 1, policy_version 178044 (0.0008) [2023-12-27 20:30:24,156][106226] Updated weights for policy 0, policy_version 177668 (0.0011) [2023-12-27 20:30:24,217][106226] Updated weights for policy 0, policy_version 177678 (0.0011) [2023-12-27 20:30:24,275][106226] Updated weights for policy 0, policy_version 177688 (0.0008) [2023-12-27 20:30:24,280][106225] Updated weights for policy 1, policy_version 178054 (0.0008) [2023-12-27 20:30:24,343][106225] Updated weights for policy 1, policy_version 178064 (0.0010) [2023-12-27 20:30:24,412][106225] Updated weights for policy 1, policy_version 178074 (0.0010) [2023-12-27 20:30:24,910][106226] Updated weights for policy 0, policy_version 177698 (0.0007) [2023-12-27 20:30:24,973][106226] Updated weights for policy 0, policy_version 177708 (0.0008) [2023-12-27 20:30:25,031][106226] Updated weights for policy 0, policy_version 177718 (0.0008) [2023-12-27 20:30:25,082][106226] Updated weights for policy 0, policy_version 177728 (0.0008) [2023-12-27 20:30:25,105][106225] Updated weights for policy 1, policy_version 178084 (0.0010) [2023-12-27 20:30:25,164][106225] Updated weights for policy 1, policy_version 178094 (0.0010) [2023-12-27 20:30:25,218][106225] Updated weights for policy 1, policy_version 178104 (0.0010) [2023-12-27 20:30:25,772][106226] Updated weights for policy 0, policy_version 177738 (0.0005) [2023-12-27 20:30:25,824][106226] Updated weights for policy 0, policy_version 177748 (0.0005) [2023-12-27 20:30:25,880][106226] Updated weights for policy 0, policy_version 177758 (0.0005) [2023-12-27 20:30:25,935][106225] Updated weights for policy 1, policy_version 178114 (0.0010) [2023-12-27 20:30:25,988][106225] Updated weights for policy 1, policy_version 178124 (0.0010) [2023-12-27 20:30:26,050][106225] Updated weights for policy 1, policy_version 178134 (0.0008) [2023-12-27 20:30:26,118][106225] Updated weights for policy 1, policy_version 178144 (0.0006) [2023-12-27 20:30:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 91127808. Throughput: 0: 9922.3, 1: 9804.1. Samples: 91092652. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:26,175][105115] Avg episode reward: [(0, '-5.770'), (1, '-7.103')] [2023-12-27 20:30:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000177760_45514752.pth... [2023-12-27 20:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000178144_45613056.pth... [2023-12-27 20:30:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000176608_45219840.pth [2023-12-27 20:30:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000176992_45318144.pth [2023-12-27 20:30:26,551][106226] Updated weights for policy 0, policy_version 177768 (0.0009) [2023-12-27 20:30:26,602][106226] Updated weights for policy 0, policy_version 177778 (0.0009) [2023-12-27 20:30:26,657][106226] Updated weights for policy 0, policy_version 177788 (0.0009) [2023-12-27 20:30:26,758][106225] Updated weights for policy 1, policy_version 178154 (0.0005) [2023-12-27 20:30:26,814][106225] Updated weights for policy 1, policy_version 178164 (0.0005) [2023-12-27 20:30:26,878][106225] Updated weights for policy 1, policy_version 178174 (0.0006) [2023-12-27 20:30:27,452][106226] Updated weights for policy 0, policy_version 177798 (0.0007) [2023-12-27 20:30:27,475][106225] Updated weights for policy 1, policy_version 178184 (0.0007) [2023-12-27 20:30:27,497][106226] Updated weights for policy 0, policy_version 177808 (0.0005) [2023-12-27 20:30:27,523][106225] Updated weights for policy 1, policy_version 178194 (0.0009) [2023-12-27 20:30:27,544][106226] Updated weights for policy 0, policy_version 177818 (0.0005) [2023-12-27 20:30:27,582][106225] Updated weights for policy 1, policy_version 178204 (0.0008) [2023-12-27 20:30:28,172][106226] Updated weights for policy 0, policy_version 177828 (0.0005) [2023-12-27 20:30:28,223][106226] Updated weights for policy 0, policy_version 177838 (0.0007) [2023-12-27 20:30:28,274][106226] Updated weights for policy 0, policy_version 177848 (0.0005) [2023-12-27 20:30:28,360][106225] Updated weights for policy 1, policy_version 178214 (0.0008) [2023-12-27 20:30:28,420][106225] Updated weights for policy 1, policy_version 178224 (0.0009) [2023-12-27 20:30:28,483][106225] Updated weights for policy 1, policy_version 178234 (0.0009) [2023-12-27 20:30:28,848][106226] Updated weights for policy 0, policy_version 177858 (0.0006) [2023-12-27 20:30:28,908][106226] Updated weights for policy 0, policy_version 177868 (0.0006) [2023-12-27 20:30:28,965][106226] Updated weights for policy 0, policy_version 177878 (0.0006) [2023-12-27 20:30:29,022][106226] Updated weights for policy 0, policy_version 177888 (0.0006) [2023-12-27 20:30:29,270][106225] Updated weights for policy 1, policy_version 178244 (0.0010) [2023-12-27 20:30:29,331][106225] Updated weights for policy 1, policy_version 178254 (0.0008) [2023-12-27 20:30:29,400][106225] Updated weights for policy 1, policy_version 178264 (0.0006) [2023-12-27 20:30:29,651][106226] Updated weights for policy 0, policy_version 177898 (0.0006) [2023-12-27 20:30:29,698][106226] Updated weights for policy 0, policy_version 177908 (0.0008) [2023-12-27 20:30:29,754][106226] Updated weights for policy 0, policy_version 177918 (0.0008) [2023-12-27 20:30:30,024][106225] Updated weights for policy 1, policy_version 178274 (0.0006) [2023-12-27 20:30:30,083][106225] Updated weights for policy 1, policy_version 178284 (0.0008) [2023-12-27 20:30:30,141][106225] Updated weights for policy 1, policy_version 178294 (0.0008) [2023-12-27 20:30:30,196][106225] Updated weights for policy 1, policy_version 178304 (0.0008) [2023-12-27 20:30:30,429][106226] Updated weights for policy 0, policy_version 177928 (0.0009) [2023-12-27 20:30:30,487][106226] Updated weights for policy 0, policy_version 177938 (0.0008) [2023-12-27 20:30:30,548][106226] Updated weights for policy 0, policy_version 177948 (0.0005) [2023-12-27 20:30:30,895][106225] Updated weights for policy 1, policy_version 178314 (0.0008) [2023-12-27 20:30:30,952][106225] Updated weights for policy 1, policy_version 178324 (0.0006) [2023-12-27 20:30:31,014][106225] Updated weights for policy 1, policy_version 178334 (0.0007) [2023-12-27 20:30:31,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 91226112. Throughput: 0: 10009.1, 1: 9872.5. Samples: 91215968. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:31,175][105115] Avg episode reward: [(0, '-5.369'), (1, '-7.448')] [2023-12-27 20:30:31,210][106226] Updated weights for policy 0, policy_version 177958 (0.0007) [2023-12-27 20:30:31,270][106226] Updated weights for policy 0, policy_version 177968 (0.0008) [2023-12-27 20:30:31,329][106226] Updated weights for policy 0, policy_version 177978 (0.0007) [2023-12-27 20:30:31,734][106225] Updated weights for policy 1, policy_version 178344 (0.0008) [2023-12-27 20:30:31,785][106225] Updated weights for policy 1, policy_version 178354 (0.0008) [2023-12-27 20:30:31,844][106225] Updated weights for policy 1, policy_version 178364 (0.0008) [2023-12-27 20:30:32,049][106226] Updated weights for policy 0, policy_version 177988 (0.0007) [2023-12-27 20:30:32,115][106226] Updated weights for policy 0, policy_version 177998 (0.0007) [2023-12-27 20:30:32,182][106226] Updated weights for policy 0, policy_version 178008 (0.0007) [2023-12-27 20:30:32,600][106225] Updated weights for policy 1, policy_version 178374 (0.0007) [2023-12-27 20:30:32,657][106225] Updated weights for policy 1, policy_version 178384 (0.0008) [2023-12-27 20:30:32,718][106225] Updated weights for policy 1, policy_version 178394 (0.0008) [2023-12-27 20:30:32,835][106226] Updated weights for policy 0, policy_version 178018 (0.0006) [2023-12-27 20:30:32,886][106226] Updated weights for policy 0, policy_version 178028 (0.0009) [2023-12-27 20:30:32,934][106226] Updated weights for policy 0, policy_version 178038 (0.0009) [2023-12-27 20:30:32,985][106226] Updated weights for policy 0, policy_version 178048 (0.0009) [2023-12-27 20:30:33,457][106225] Updated weights for policy 1, policy_version 178404 (0.0008) [2023-12-27 20:30:33,504][106225] Updated weights for policy 1, policy_version 178414 (0.0008) [2023-12-27 20:30:33,556][106225] Updated weights for policy 1, policy_version 178424 (0.0008) [2023-12-27 20:30:33,634][106226] Updated weights for policy 0, policy_version 178058 (0.0009) [2023-12-27 20:30:33,687][106226] Updated weights for policy 0, policy_version 178068 (0.0008) [2023-12-27 20:30:33,740][106226] Updated weights for policy 0, policy_version 178078 (0.0008) [2023-12-27 20:30:34,309][106225] Updated weights for policy 1, policy_version 178434 (0.0009) [2023-12-27 20:30:34,377][106225] Updated weights for policy 1, policy_version 178444 (0.0009) [2023-12-27 20:30:34,443][106225] Updated weights for policy 1, policy_version 178454 (0.0006) [2023-12-27 20:30:34,479][106226] Updated weights for policy 0, policy_version 178088 (0.0010) [2023-12-27 20:30:34,504][106225] Updated weights for policy 1, policy_version 178464 (0.0006) [2023-12-27 20:30:34,540][106226] Updated weights for policy 0, policy_version 178098 (0.0008) [2023-12-27 20:30:34,595][106226] Updated weights for policy 0, policy_version 178108 (0.0009) [2023-12-27 20:30:35,177][106225] Updated weights for policy 1, policy_version 178474 (0.0008) [2023-12-27 20:30:35,236][106225] Updated weights for policy 1, policy_version 178484 (0.0008) [2023-12-27 20:30:35,292][106225] Updated weights for policy 1, policy_version 178494 (0.0008) [2023-12-27 20:30:35,326][106226] Updated weights for policy 0, policy_version 178118 (0.0008) [2023-12-27 20:30:35,381][106226] Updated weights for policy 0, policy_version 178128 (0.0008) [2023-12-27 20:30:35,433][106226] Updated weights for policy 0, policy_version 178138 (0.0008) [2023-12-27 20:30:36,025][106225] Updated weights for policy 1, policy_version 178504 (0.0008) [2023-12-27 20:30:36,073][106225] Updated weights for policy 1, policy_version 178514 (0.0009) [2023-12-27 20:30:36,135][106225] Updated weights for policy 1, policy_version 178524 (0.0008) [2023-12-27 20:30:36,173][106226] Updated weights for policy 0, policy_version 178148 (0.0009) [2023-12-27 20:30:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 91324416. Throughput: 0: 9985.7, 1: 9892.9. Samples: 91333556. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:36,175][105115] Avg episode reward: [(0, '-5.690'), (1, '-7.272')] [2023-12-27 20:30:36,235][106226] Updated weights for policy 0, policy_version 178158 (0.0009) [2023-12-27 20:30:36,294][106226] Updated weights for policy 0, policy_version 178168 (0.0009) [2023-12-27 20:30:36,774][106225] Updated weights for policy 1, policy_version 178534 (0.0007) [2023-12-27 20:30:36,829][106225] Updated weights for policy 1, policy_version 178544 (0.0006) [2023-12-27 20:30:36,878][106225] Updated weights for policy 1, policy_version 178554 (0.0005) [2023-12-27 20:30:36,971][106226] Updated weights for policy 0, policy_version 178178 (0.0009) [2023-12-27 20:30:37,023][106226] Updated weights for policy 0, policy_version 178188 (0.0007) [2023-12-27 20:30:37,076][106226] Updated weights for policy 0, policy_version 178198 (0.0005) [2023-12-27 20:30:37,134][106226] Updated weights for policy 0, policy_version 178208 (0.0006) [2023-12-27 20:30:37,486][106225] Updated weights for policy 1, policy_version 178564 (0.0006) [2023-12-27 20:30:37,544][106225] Updated weights for policy 1, policy_version 178574 (0.0009) [2023-12-27 20:30:37,605][106225] Updated weights for policy 1, policy_version 178584 (0.0009) [2023-12-27 20:30:37,841][106226] Updated weights for policy 0, policy_version 178218 (0.0008) [2023-12-27 20:30:37,887][106226] Updated weights for policy 0, policy_version 178228 (0.0008) [2023-12-27 20:30:37,942][106226] Updated weights for policy 0, policy_version 178238 (0.0007) [2023-12-27 20:30:38,262][106225] Updated weights for policy 1, policy_version 178594 (0.0008) [2023-12-27 20:30:38,331][106225] Updated weights for policy 1, policy_version 178604 (0.0006) [2023-12-27 20:30:38,391][106225] Updated weights for policy 1, policy_version 178614 (0.0008) [2023-12-27 20:30:38,451][106225] Updated weights for policy 1, policy_version 178624 (0.0008) [2023-12-27 20:30:38,700][106226] Updated weights for policy 0, policy_version 178248 (0.0008) [2023-12-27 20:30:38,758][106226] Updated weights for policy 0, policy_version 178258 (0.0009) [2023-12-27 20:30:38,821][106226] Updated weights for policy 0, policy_version 178268 (0.0006) [2023-12-27 20:30:39,147][106225] Updated weights for policy 1, policy_version 178634 (0.0009) [2023-12-27 20:30:39,198][106225] Updated weights for policy 1, policy_version 178644 (0.0008) [2023-12-27 20:30:39,283][106225] Updated weights for policy 1, policy_version 178654 (0.0007) [2023-12-27 20:30:39,518][106226] Updated weights for policy 0, policy_version 178278 (0.0006) [2023-12-27 20:30:39,582][106226] Updated weights for policy 0, policy_version 178288 (0.0008) [2023-12-27 20:30:39,652][106226] Updated weights for policy 0, policy_version 178298 (0.0008) [2023-12-27 20:30:40,073][106225] Updated weights for policy 1, policy_version 178664 (0.0008) [2023-12-27 20:30:40,135][106225] Updated weights for policy 1, policy_version 178674 (0.0008) [2023-12-27 20:30:40,199][106225] Updated weights for policy 1, policy_version 178684 (0.0009) [2023-12-27 20:30:40,342][106226] Updated weights for policy 0, policy_version 178308 (0.0010) [2023-12-27 20:30:40,399][106226] Updated weights for policy 0, policy_version 178318 (0.0008) [2023-12-27 20:30:40,453][106226] Updated weights for policy 0, policy_version 178328 (0.0008) [2023-12-27 20:30:40,960][106225] Updated weights for policy 1, policy_version 178694 (0.0008) [2023-12-27 20:30:41,012][106225] Updated weights for policy 1, policy_version 178704 (0.0008) [2023-12-27 20:30:41,077][106225] Updated weights for policy 1, policy_version 178714 (0.0009) [2023-12-27 20:30:41,096][106226] Updated weights for policy 0, policy_version 178338 (0.0008) [2023-12-27 20:30:41,173][106226] Updated weights for policy 0, policy_version 178348 (0.0008) [2023-12-27 20:30:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 91422720. Throughput: 0: 9992.1, 1: 9908.9. Samples: 91394552. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:30:41,175][105115] Avg episode reward: [(0, '-5.338'), (1, '-7.220')] [2023-12-27 20:30:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000178720_45760512.pth... [2023-12-27 20:30:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000177568_45465600.pth [2023-12-27 20:30:41,245][106226] Updated weights for policy 0, policy_version 178358 (0.0009) [2023-12-27 20:30:41,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000178368_45670400.pth... [2023-12-27 20:30:41,312][106226] Updated weights for policy 0, policy_version 178368 (0.0009) [2023-12-27 20:30:41,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000177184_45367296.pth [2023-12-27 20:30:41,942][106225] Updated weights for policy 1, policy_version 178724 (0.0008) [2023-12-27 20:30:42,011][106225] Updated weights for policy 1, policy_version 178734 (0.0008) [2023-12-27 20:30:42,069][106225] Updated weights for policy 1, policy_version 178744 (0.0007) [2023-12-27 20:30:42,103][106226] Updated weights for policy 0, policy_version 178378 (0.0006) [2023-12-27 20:30:42,169][106226] Updated weights for policy 0, policy_version 178388 (0.0007) [2023-12-27 20:30:42,226][106226] Updated weights for policy 0, policy_version 178398 (0.0007) [2023-12-27 20:30:42,769][106225] Updated weights for policy 1, policy_version 178754 (0.0007) [2023-12-27 20:30:42,826][106225] Updated weights for policy 1, policy_version 178764 (0.0005) [2023-12-27 20:30:42,881][106225] Updated weights for policy 1, policy_version 178774 (0.0007) [2023-12-27 20:30:42,933][106225] Updated weights for policy 1, policy_version 178784 (0.0007) [2023-12-27 20:30:42,936][106226] Updated weights for policy 0, policy_version 178408 (0.0007) [2023-12-27 20:30:43,000][106226] Updated weights for policy 0, policy_version 178418 (0.0007) [2023-12-27 20:30:43,068][106226] Updated weights for policy 0, policy_version 178428 (0.0005) [2023-12-27 20:30:43,638][106225] Updated weights for policy 1, policy_version 178794 (0.0005) [2023-12-27 20:30:43,693][106225] Updated weights for policy 1, policy_version 178804 (0.0006) [2023-12-27 20:30:43,713][106226] Updated weights for policy 0, policy_version 178438 (0.0008) [2023-12-27 20:30:43,739][106225] Updated weights for policy 1, policy_version 178814 (0.0007) [2023-12-27 20:30:43,766][106226] Updated weights for policy 0, policy_version 178448 (0.0007) [2023-12-27 20:30:43,815][106226] Updated weights for policy 0, policy_version 178458 (0.0008) [2023-12-27 20:30:44,370][106225] Updated weights for policy 1, policy_version 178824 (0.0010) [2023-12-27 20:30:44,426][106225] Updated weights for policy 1, policy_version 178834 (0.0006) [2023-12-27 20:30:44,476][106225] Updated weights for policy 1, policy_version 178844 (0.0008) [2023-12-27 20:30:44,606][106226] Updated weights for policy 0, policy_version 178468 (0.0007) [2023-12-27 20:30:44,671][106226] Updated weights for policy 0, policy_version 178478 (0.0005) [2023-12-27 20:30:44,737][106226] Updated weights for policy 0, policy_version 178488 (0.0005) [2023-12-27 20:30:45,178][106225] Updated weights for policy 1, policy_version 178854 (0.0006) [2023-12-27 20:30:45,249][106225] Updated weights for policy 1, policy_version 178864 (0.0006) [2023-12-27 20:30:45,317][106225] Updated weights for policy 1, policy_version 178874 (0.0006) [2023-12-27 20:30:45,378][106226] Updated weights for policy 0, policy_version 178498 (0.0008) [2023-12-27 20:30:45,424][106226] Updated weights for policy 0, policy_version 178508 (0.0008) [2023-12-27 20:30:45,473][106226] Updated weights for policy 0, policy_version 178518 (0.0008) [2023-12-27 20:30:45,519][106226] Updated weights for policy 0, policy_version 178528 (0.0008) [2023-12-27 20:30:46,000][106225] Updated weights for policy 1, policy_version 178884 (0.0008) [2023-12-27 20:30:46,070][106225] Updated weights for policy 1, policy_version 178894 (0.0007) [2023-12-27 20:30:46,131][106225] Updated weights for policy 1, policy_version 178904 (0.0006) [2023-12-27 20:30:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 91521024. Throughput: 0: 9960.6, 1: 9902.2. Samples: 91510180. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:30:46,175][105115] Avg episode reward: [(0, '-5.055'), (1, '-6.617')] [2023-12-27 20:30:46,319][106226] Updated weights for policy 0, policy_version 178538 (0.0010) [2023-12-27 20:30:46,380][106226] Updated weights for policy 0, policy_version 178548 (0.0009) [2023-12-27 20:30:46,441][106226] Updated weights for policy 0, policy_version 178558 (0.0008) [2023-12-27 20:30:46,795][106225] Updated weights for policy 1, policy_version 178914 (0.0007) [2023-12-27 20:30:46,858][106225] Updated weights for policy 1, policy_version 178924 (0.0007) [2023-12-27 20:30:46,917][106225] Updated weights for policy 1, policy_version 178934 (0.0008) [2023-12-27 20:30:46,979][106225] Updated weights for policy 1, policy_version 178944 (0.0009) [2023-12-27 20:30:47,233][106226] Updated weights for policy 0, policy_version 178568 (0.0009) [2023-12-27 20:30:47,289][106226] Updated weights for policy 0, policy_version 178578 (0.0008) [2023-12-27 20:30:47,341][106226] Updated weights for policy 0, policy_version 178588 (0.0009) [2023-12-27 20:30:47,664][106225] Updated weights for policy 1, policy_version 178954 (0.0010) [2023-12-27 20:30:47,726][106225] Updated weights for policy 1, policy_version 178964 (0.0008) [2023-12-27 20:30:47,797][106225] Updated weights for policy 1, policy_version 178974 (0.0009) [2023-12-27 20:30:48,005][106226] Updated weights for policy 0, policy_version 178598 (0.0009) [2023-12-27 20:30:48,060][106226] Updated weights for policy 0, policy_version 178608 (0.0009) [2023-12-27 20:30:48,113][106226] Updated weights for policy 0, policy_version 178618 (0.0009) [2023-12-27 20:30:48,534][106225] Updated weights for policy 1, policy_version 178984 (0.0007) [2023-12-27 20:30:48,600][106225] Updated weights for policy 1, policy_version 178994 (0.0008) [2023-12-27 20:30:48,666][106225] Updated weights for policy 1, policy_version 179004 (0.0006) [2023-12-27 20:30:48,919][106226] Updated weights for policy 0, policy_version 178628 (0.0008) [2023-12-27 20:30:48,981][106226] Updated weights for policy 0, policy_version 178638 (0.0009) [2023-12-27 20:30:49,039][106226] Updated weights for policy 0, policy_version 178648 (0.0009) [2023-12-27 20:30:49,302][106225] Updated weights for policy 1, policy_version 179014 (0.0006) [2023-12-27 20:30:49,368][106225] Updated weights for policy 1, policy_version 179024 (0.0008) [2023-12-27 20:30:49,436][106225] Updated weights for policy 1, policy_version 179034 (0.0007) [2023-12-27 20:30:49,830][106226] Updated weights for policy 0, policy_version 178658 (0.0008) [2023-12-27 20:30:49,900][106226] Updated weights for policy 0, policy_version 178668 (0.0009) [2023-12-27 20:30:49,973][106226] Updated weights for policy 0, policy_version 178678 (0.0009) [2023-12-27 20:30:50,041][106226] Updated weights for policy 0, policy_version 178688 (0.0010) [2023-12-27 20:30:50,088][106225] Updated weights for policy 1, policy_version 179044 (0.0007) [2023-12-27 20:30:50,153][106225] Updated weights for policy 1, policy_version 179054 (0.0008) [2023-12-27 20:30:50,206][106225] Updated weights for policy 1, policy_version 179064 (0.0008) [2023-12-27 20:30:50,815][106226] Updated weights for policy 0, policy_version 178698 (0.0011) [2023-12-27 20:30:50,844][106225] Updated weights for policy 1, policy_version 179074 (0.0006) [2023-12-27 20:30:50,864][106226] Updated weights for policy 0, policy_version 178708 (0.0012) [2023-12-27 20:30:50,904][106225] Updated weights for policy 1, policy_version 179084 (0.0010) [2023-12-27 20:30:50,919][106226] Updated weights for policy 0, policy_version 178718 (0.0009) [2023-12-27 20:30:50,965][106225] Updated weights for policy 1, policy_version 179094 (0.0009) [2023-12-27 20:30:51,027][106225] Updated weights for policy 1, policy_version 179104 (0.0006) [2023-12-27 20:30:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 91619328. Throughput: 0: 9811.4, 1: 9948.1. Samples: 91624944. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:30:51,175][105115] Avg episode reward: [(0, '-5.241'), (1, '-6.893')] [2023-12-27 20:30:51,707][106225] Updated weights for policy 1, policy_version 179114 (0.0008) [2023-12-27 20:30:51,752][106226] Updated weights for policy 0, policy_version 178728 (0.0008) [2023-12-27 20:30:51,786][106225] Updated weights for policy 1, policy_version 179124 (0.0008) [2023-12-27 20:30:51,824][106226] Updated weights for policy 0, policy_version 178738 (0.0008) [2023-12-27 20:30:51,853][106225] Updated weights for policy 1, policy_version 179134 (0.0008) [2023-12-27 20:30:51,886][106226] Updated weights for policy 0, policy_version 178748 (0.0007) [2023-12-27 20:30:52,596][106226] Updated weights for policy 0, policy_version 178758 (0.0007) [2023-12-27 20:30:52,630][106225] Updated weights for policy 1, policy_version 179144 (0.0006) [2023-12-27 20:30:52,663][106226] Updated weights for policy 0, policy_version 178768 (0.0008) [2023-12-27 20:30:52,694][106225] Updated weights for policy 1, policy_version 179154 (0.0008) [2023-12-27 20:30:52,729][106226] Updated weights for policy 0, policy_version 178778 (0.0007) [2023-12-27 20:30:52,760][106225] Updated weights for policy 1, policy_version 179164 (0.0008) [2023-12-27 20:30:53,477][106225] Updated weights for policy 1, policy_version 179174 (0.0008) [2023-12-27 20:30:53,487][106226] Updated weights for policy 0, policy_version 178788 (0.0008) [2023-12-27 20:30:53,536][106225] Updated weights for policy 1, policy_version 179184 (0.0007) [2023-12-27 20:30:53,548][106226] Updated weights for policy 0, policy_version 178798 (0.0006) [2023-12-27 20:30:53,589][106225] Updated weights for policy 1, policy_version 179194 (0.0009) [2023-12-27 20:30:53,603][106226] Updated weights for policy 0, policy_version 178808 (0.0005) [2023-12-27 20:30:54,288][106226] Updated weights for policy 0, policy_version 178818 (0.0007) [2023-12-27 20:30:54,322][106225] Updated weights for policy 1, policy_version 179204 (0.0009) [2023-12-27 20:30:54,353][106226] Updated weights for policy 0, policy_version 178828 (0.0008) [2023-12-27 20:30:54,375][106225] Updated weights for policy 1, policy_version 179214 (0.0008) [2023-12-27 20:30:54,415][106226] Updated weights for policy 0, policy_version 178838 (0.0007) [2023-12-27 20:30:54,434][106225] Updated weights for policy 1, policy_version 179224 (0.0009) [2023-12-27 20:30:54,482][106226] Updated weights for policy 0, policy_version 178848 (0.0008) [2023-12-27 20:30:55,145][106226] Updated weights for policy 0, policy_version 178858 (0.0008) [2023-12-27 20:30:55,164][106225] Updated weights for policy 1, policy_version 179234 (0.0010) [2023-12-27 20:30:55,201][106226] Updated weights for policy 0, policy_version 178868 (0.0006) [2023-12-27 20:30:55,226][106225] Updated weights for policy 1, policy_version 179244 (0.0010) [2023-12-27 20:30:55,264][106226] Updated weights for policy 0, policy_version 178878 (0.0007) [2023-12-27 20:30:55,277][106225] Updated weights for policy 1, policy_version 179254 (0.0010) [2023-12-27 20:30:55,347][106225] Updated weights for policy 1, policy_version 179264 (0.0010) [2023-12-27 20:30:55,871][106226] Updated weights for policy 0, policy_version 178888 (0.0006) [2023-12-27 20:30:55,930][106226] Updated weights for policy 0, policy_version 178898 (0.0005) [2023-12-27 20:30:55,991][106226] Updated weights for policy 0, policy_version 178908 (0.0005) [2023-12-27 20:30:56,051][106225] Updated weights for policy 1, policy_version 179274 (0.0010) [2023-12-27 20:30:56,101][106225] Updated weights for policy 1, policy_version 179284 (0.0010) [2023-12-27 20:30:56,156][106225] Updated weights for policy 1, policy_version 179294 (0.0010) [2023-12-27 20:30:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 91717632. Throughput: 0: 9777.6, 1: 9874.9. Samples: 91681608. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:30:56,175][105115] Avg episode reward: [(0, '-5.149'), (1, '-7.407')] [2023-12-27 20:30:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000178912_45809664.pth... [2023-12-27 20:30:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000179296_45907968.pth... [2023-12-27 20:30:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000177760_45514752.pth [2023-12-27 20:30:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000178144_45613056.pth [2023-12-27 20:30:56,571][106226] Updated weights for policy 0, policy_version 178918 (0.0007) [2023-12-27 20:30:56,630][106226] Updated weights for policy 0, policy_version 178928 (0.0008) [2023-12-27 20:30:56,690][106226] Updated weights for policy 0, policy_version 178938 (0.0009) [2023-12-27 20:30:56,880][106225] Updated weights for policy 1, policy_version 179304 (0.0010) [2023-12-27 20:30:56,940][106225] Updated weights for policy 1, policy_version 179314 (0.0010) [2023-12-27 20:30:56,990][106225] Updated weights for policy 1, policy_version 179324 (0.0010) [2023-12-27 20:30:57,366][106226] Updated weights for policy 0, policy_version 178948 (0.0007) [2023-12-27 20:30:57,427][106226] Updated weights for policy 0, policy_version 178959 (0.0008) [2023-12-27 20:30:57,478][106226] Updated weights for policy 0, policy_version 178969 (0.0007) [2023-12-27 20:30:57,628][106225] Updated weights for policy 1, policy_version 179334 (0.0007) [2023-12-27 20:30:57,688][106225] Updated weights for policy 1, policy_version 179344 (0.0006) [2023-12-27 20:30:57,748][106225] Updated weights for policy 1, policy_version 179354 (0.0010) [2023-12-27 20:30:58,077][106226] Updated weights for policy 0, policy_version 178979 (0.0005) [2023-12-27 20:30:58,127][106226] Updated weights for policy 0, policy_version 178989 (0.0005) [2023-12-27 20:30:58,177][106226] Updated weights for policy 0, policy_version 178999 (0.0005) [2023-12-27 20:30:58,456][106225] Updated weights for policy 1, policy_version 179364 (0.0009) [2023-12-27 20:30:58,520][106225] Updated weights for policy 1, policy_version 179374 (0.0010) [2023-12-27 20:30:58,586][106225] Updated weights for policy 1, policy_version 179384 (0.0008) [2023-12-27 20:30:58,911][106226] Updated weights for policy 0, policy_version 179009 (0.0010) [2023-12-27 20:30:58,980][106226] Updated weights for policy 0, policy_version 179019 (0.0008) [2023-12-27 20:30:59,045][106226] Updated weights for policy 0, policy_version 179029 (0.0008) [2023-12-27 20:30:59,108][106226] Updated weights for policy 0, policy_version 179039 (0.0008) [2023-12-27 20:30:59,376][106225] Updated weights for policy 1, policy_version 179394 (0.0008) [2023-12-27 20:30:59,430][106225] Updated weights for policy 1, policy_version 179404 (0.0007) [2023-12-27 20:30:59,492][106225] Updated weights for policy 1, policy_version 179414 (0.0009) [2023-12-27 20:30:59,559][106225] Updated weights for policy 1, policy_version 179424 (0.0008) [2023-12-27 20:30:59,828][106226] Updated weights for policy 0, policy_version 179049 (0.0008) [2023-12-27 20:30:59,889][106226] Updated weights for policy 0, policy_version 179059 (0.0008) [2023-12-27 20:30:59,958][106226] Updated weights for policy 0, policy_version 179069 (0.0009) [2023-12-27 20:31:00,221][106225] Updated weights for policy 1, policy_version 179434 (0.0005) [2023-12-27 20:31:00,277][106225] Updated weights for policy 1, policy_version 179444 (0.0005) [2023-12-27 20:31:00,342][106225] Updated weights for policy 1, policy_version 179454 (0.0007) [2023-12-27 20:31:00,713][106226] Updated weights for policy 0, policy_version 179079 (0.0009) [2023-12-27 20:31:00,763][106226] Updated weights for policy 0, policy_version 179089 (0.0010) [2023-12-27 20:31:00,815][106226] Updated weights for policy 0, policy_version 179099 (0.0010) [2023-12-27 20:31:00,971][106225] Updated weights for policy 1, policy_version 179464 (0.0008) [2023-12-27 20:31:01,028][106225] Updated weights for policy 1, policy_version 179474 (0.0008) [2023-12-27 20:31:01,088][106225] Updated weights for policy 1, policy_version 179484 (0.0008) [2023-12-27 20:31:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 91815936. Throughput: 0: 9845.9, 1: 9840.6. Samples: 91801164. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:01,175][105115] Avg episode reward: [(0, '-5.273'), (1, '-7.607')] [2023-12-27 20:31:01,550][106226] Updated weights for policy 0, policy_version 179109 (0.0011) [2023-12-27 20:31:01,614][106226] Updated weights for policy 0, policy_version 179119 (0.0008) [2023-12-27 20:31:01,679][106226] Updated weights for policy 0, policy_version 179129 (0.0008) [2023-12-27 20:31:01,870][106225] Updated weights for policy 1, policy_version 179494 (0.0008) [2023-12-27 20:31:01,920][106225] Updated weights for policy 1, policy_version 179504 (0.0009) [2023-12-27 20:31:01,970][106225] Updated weights for policy 1, policy_version 179514 (0.0009) [2023-12-27 20:31:02,321][106226] Updated weights for policy 0, policy_version 179139 (0.0008) [2023-12-27 20:31:02,384][106226] Updated weights for policy 0, policy_version 179149 (0.0008) [2023-12-27 20:31:02,448][106226] Updated weights for policy 0, policy_version 179159 (0.0008) [2023-12-27 20:31:02,765][106225] Updated weights for policy 1, policy_version 179524 (0.0009) [2023-12-27 20:31:02,824][106225] Updated weights for policy 1, policy_version 179534 (0.0008) [2023-12-27 20:31:02,878][106225] Updated weights for policy 1, policy_version 179544 (0.0007) [2023-12-27 20:31:03,147][106226] Updated weights for policy 0, policy_version 179169 (0.0008) [2023-12-27 20:31:03,205][106226] Updated weights for policy 0, policy_version 179179 (0.0006) [2023-12-27 20:31:03,264][106226] Updated weights for policy 0, policy_version 179189 (0.0006) [2023-12-27 20:31:03,328][106226] Updated weights for policy 0, policy_version 179199 (0.0006) [2023-12-27 20:31:03,675][106225] Updated weights for policy 1, policy_version 179554 (0.0009) [2023-12-27 20:31:03,738][106225] Updated weights for policy 1, policy_version 179564 (0.0009) [2023-12-27 20:31:03,798][106225] Updated weights for policy 1, policy_version 179574 (0.0008) [2023-12-27 20:31:03,859][106225] Updated weights for policy 1, policy_version 179584 (0.0008) [2023-12-27 20:31:03,897][106226] Updated weights for policy 0, policy_version 179209 (0.0008) [2023-12-27 20:31:03,956][106226] Updated weights for policy 0, policy_version 179219 (0.0008) [2023-12-27 20:31:04,011][106226] Updated weights for policy 0, policy_version 179229 (0.0008) [2023-12-27 20:31:04,608][106225] Updated weights for policy 1, policy_version 179594 (0.0008) [2023-12-27 20:31:04,661][106225] Updated weights for policy 1, policy_version 179604 (0.0008) [2023-12-27 20:31:04,713][106225] Updated weights for policy 1, policy_version 179614 (0.0008) [2023-12-27 20:31:04,750][106226] Updated weights for policy 0, policy_version 179239 (0.0008) [2023-12-27 20:31:04,809][106226] Updated weights for policy 0, policy_version 179249 (0.0010) [2023-12-27 20:31:04,862][106226] Updated weights for policy 0, policy_version 179259 (0.0010) [2023-12-27 20:31:05,448][106225] Updated weights for policy 1, policy_version 179624 (0.0007) [2023-12-27 20:31:05,511][106225] Updated weights for policy 1, policy_version 179634 (0.0008) [2023-12-27 20:31:05,570][106226] Updated weights for policy 0, policy_version 179269 (0.0010) [2023-12-27 20:31:05,572][106225] Updated weights for policy 1, policy_version 179644 (0.0007) [2023-12-27 20:31:05,623][106226] Updated weights for policy 0, policy_version 179279 (0.0010) [2023-12-27 20:31:05,676][106226] Updated weights for policy 0, policy_version 179289 (0.0011) [2023-12-27 20:31:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 91906048. Throughput: 0: 9888.7, 1: 9794.1. Samples: 91918132. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:06,175][105115] Avg episode reward: [(0, '-5.046'), (1, '-7.769')] [2023-12-27 20:31:06,295][106225] Updated weights for policy 1, policy_version 179654 (0.0007) [2023-12-27 20:31:06,353][106225] Updated weights for policy 1, policy_version 179664 (0.0008) [2023-12-27 20:31:06,395][106226] Updated weights for policy 0, policy_version 179299 (0.0010) [2023-12-27 20:31:06,408][106225] Updated weights for policy 1, policy_version 179674 (0.0008) [2023-12-27 20:31:06,454][106226] Updated weights for policy 0, policy_version 179309 (0.0011) [2023-12-27 20:31:06,513][106226] Updated weights for policy 0, policy_version 179319 (0.0010) [2023-12-27 20:31:07,149][106225] Updated weights for policy 1, policy_version 179684 (0.0009) [2023-12-27 20:31:07,205][106225] Updated weights for policy 1, policy_version 179694 (0.0009) [2023-12-27 20:31:07,252][106225] Updated weights for policy 1, policy_version 179704 (0.0007) [2023-12-27 20:31:07,254][106226] Updated weights for policy 0, policy_version 179329 (0.0008) [2023-12-27 20:31:07,314][106226] Updated weights for policy 0, policy_version 179339 (0.0008) [2023-12-27 20:31:07,370][106226] Updated weights for policy 0, policy_version 179350 (0.0009) [2023-12-27 20:31:07,424][106226] Updated weights for policy 0, policy_version 179360 (0.0008) [2023-12-27 20:31:07,930][106225] Updated weights for policy 1, policy_version 179714 (0.0006) [2023-12-27 20:31:07,976][106225] Updated weights for policy 1, policy_version 179724 (0.0008) [2023-12-27 20:31:08,029][106225] Updated weights for policy 1, policy_version 179734 (0.0008) [2023-12-27 20:31:08,087][106225] Updated weights for policy 1, policy_version 179744 (0.0008) [2023-12-27 20:31:08,182][106226] Updated weights for policy 0, policy_version 179370 (0.0008) [2023-12-27 20:31:08,242][106226] Updated weights for policy 0, policy_version 179380 (0.0009) [2023-12-27 20:31:08,286][106226] Updated weights for policy 0, policy_version 179390 (0.0006) [2023-12-27 20:31:08,777][106225] Updated weights for policy 1, policy_version 179754 (0.0008) [2023-12-27 20:31:08,833][106225] Updated weights for policy 1, policy_version 179764 (0.0009) [2023-12-27 20:31:08,893][106226] Updated weights for policy 0, policy_version 179400 (0.0006) [2023-12-27 20:31:08,896][106225] Updated weights for policy 1, policy_version 179774 (0.0007) [2023-12-27 20:31:08,951][106226] Updated weights for policy 0, policy_version 179410 (0.0009) [2023-12-27 20:31:09,002][106226] Updated weights for policy 0, policy_version 179420 (0.0005) [2023-12-27 20:31:09,632][106226] Updated weights for policy 0, policy_version 179430 (0.0006) [2023-12-27 20:31:09,687][106225] Updated weights for policy 1, policy_version 179784 (0.0006) [2023-12-27 20:31:09,698][106226] Updated weights for policy 0, policy_version 179440 (0.0007) [2023-12-27 20:31:09,749][106225] Updated weights for policy 1, policy_version 179794 (0.0008) [2023-12-27 20:31:09,769][106226] Updated weights for policy 0, policy_version 179450 (0.0006) [2023-12-27 20:31:09,813][106225] Updated weights for policy 1, policy_version 179804 (0.0007) [2023-12-27 20:31:10,438][106226] Updated weights for policy 0, policy_version 179460 (0.0008) [2023-12-27 20:31:10,504][106226] Updated weights for policy 0, policy_version 179470 (0.0009) [2023-12-27 20:31:10,533][106225] Updated weights for policy 1, policy_version 179814 (0.0009) [2023-12-27 20:31:10,560][106226] Updated weights for policy 0, policy_version 179480 (0.0006) [2023-12-27 20:31:10,592][106225] Updated weights for policy 1, policy_version 179824 (0.0006) [2023-12-27 20:31:10,643][106225] Updated weights for policy 1, policy_version 179834 (0.0008) [2023-12-27 20:31:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 92004352. Throughput: 0: 9887.3, 1: 9776.3. Samples: 91977512. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:11,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-7.593')] [2023-12-27 20:31:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000179840_46047232.pth... [2023-12-27 20:31:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000179488_45957120.pth... [2023-12-27 20:31:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000178720_45760512.pth [2023-12-27 20:31:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000178368_45670400.pth [2023-12-27 20:31:11,272][106226] Updated weights for policy 0, policy_version 179490 (0.0007) [2023-12-27 20:31:11,339][106226] Updated weights for policy 0, policy_version 179500 (0.0007) [2023-12-27 20:31:11,344][106225] Updated weights for policy 1, policy_version 179844 (0.0010) [2023-12-27 20:31:11,414][106226] Updated weights for policy 0, policy_version 179510 (0.0007) [2023-12-27 20:31:11,415][106225] Updated weights for policy 1, policy_version 179854 (0.0008) [2023-12-27 20:31:11,472][106225] Updated weights for policy 1, policy_version 179864 (0.0008) [2023-12-27 20:31:11,473][106226] Updated weights for policy 0, policy_version 179520 (0.0006) [2023-12-27 20:31:12,186][106226] Updated weights for policy 0, policy_version 179530 (0.0007) [2023-12-27 20:31:12,204][106225] Updated weights for policy 1, policy_version 179874 (0.0008) [2023-12-27 20:31:12,253][106226] Updated weights for policy 0, policy_version 179540 (0.0008) [2023-12-27 20:31:12,266][106225] Updated weights for policy 1, policy_version 179884 (0.0007) [2023-12-27 20:31:12,318][106226] Updated weights for policy 0, policy_version 179550 (0.0007) [2023-12-27 20:31:12,332][106225] Updated weights for policy 1, policy_version 179894 (0.0008) [2023-12-27 20:31:12,394][106225] Updated weights for policy 1, policy_version 179904 (0.0009) [2023-12-27 20:31:13,019][106226] Updated weights for policy 0, policy_version 179560 (0.0008) [2023-12-27 20:31:13,074][106226] Updated weights for policy 0, policy_version 179570 (0.0008) [2023-12-27 20:31:13,131][106225] Updated weights for policy 1, policy_version 179914 (0.0010) [2023-12-27 20:31:13,137][106226] Updated weights for policy 0, policy_version 179580 (0.0006) [2023-12-27 20:31:13,188][106225] Updated weights for policy 1, policy_version 179924 (0.0005) [2023-12-27 20:31:13,250][106225] Updated weights for policy 1, policy_version 179934 (0.0006) [2023-12-27 20:31:13,832][106225] Updated weights for policy 1, policy_version 179944 (0.0008) [2023-12-27 20:31:13,881][106225] Updated weights for policy 1, policy_version 179954 (0.0008) [2023-12-27 20:31:13,910][106226] Updated weights for policy 0, policy_version 179590 (0.0008) [2023-12-27 20:31:13,928][106225] Updated weights for policy 1, policy_version 179964 (0.0006) [2023-12-27 20:31:13,957][106226] Updated weights for policy 0, policy_version 179600 (0.0007) [2023-12-27 20:31:14,008][106226] Updated weights for policy 0, policy_version 179611 (0.0009) [2023-12-27 20:31:14,560][106225] Updated weights for policy 1, policy_version 179974 (0.0007) [2023-12-27 20:31:14,620][106225] Updated weights for policy 1, policy_version 179984 (0.0008) [2023-12-27 20:31:14,668][106225] Updated weights for policy 1, policy_version 179994 (0.0008) [2023-12-27 20:31:14,807][106226] Updated weights for policy 0, policy_version 179621 (0.0009) [2023-12-27 20:31:14,874][106226] Updated weights for policy 0, policy_version 179631 (0.0009) [2023-12-27 20:31:14,940][106226] Updated weights for policy 0, policy_version 179641 (0.0008) [2023-12-27 20:31:15,450][106225] Updated weights for policy 1, policy_version 180004 (0.0008) [2023-12-27 20:31:15,507][106225] Updated weights for policy 1, policy_version 180014 (0.0009) [2023-12-27 20:31:15,561][106225] Updated weights for policy 1, policy_version 180024 (0.0010) [2023-12-27 20:31:15,641][106226] Updated weights for policy 0, policy_version 179651 (0.0009) [2023-12-27 20:31:15,700][106226] Updated weights for policy 0, policy_version 179661 (0.0008) [2023-12-27 20:31:15,754][106226] Updated weights for policy 0, policy_version 179671 (0.0008) [2023-12-27 20:31:15,809][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000001 [2023-12-27 20:31:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 92102656. Throughput: 0: 9757.9, 1: 9738.5. Samples: 92093312. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:16,176][105115] Avg episode reward: [(0, '-5.423'), (1, '-7.268')] [2023-12-27 20:31:16,241][106225] Updated weights for policy 1, policy_version 180034 (0.0009) [2023-12-27 20:31:16,287][106225] Updated weights for policy 1, policy_version 180044 (0.0005) [2023-12-27 20:31:16,342][106225] Updated weights for policy 1, policy_version 180054 (0.0006) [2023-12-27 20:31:16,401][106225] Updated weights for policy 1, policy_version 180064 (0.0010) [2023-12-27 20:31:16,493][106226] Updated weights for policy 0, policy_version 179681 (0.0008) [2023-12-27 20:31:16,551][106226] Updated weights for policy 0, policy_version 179691 (0.0008) [2023-12-27 20:31:16,607][106226] Updated weights for policy 0, policy_version 179701 (0.0008) [2023-12-27 20:31:16,677][106226] Updated weights for policy 0, policy_version 179711 (0.0007) [2023-12-27 20:31:17,044][106225] Updated weights for policy 1, policy_version 180074 (0.0005) [2023-12-27 20:31:17,111][106225] Updated weights for policy 1, policy_version 180084 (0.0006) [2023-12-27 20:31:17,170][106225] Updated weights for policy 1, policy_version 180094 (0.0010) [2023-12-27 20:31:17,423][106226] Updated weights for policy 0, policy_version 179721 (0.0006) [2023-12-27 20:31:17,477][106226] Updated weights for policy 0, policy_version 179731 (0.0007) [2023-12-27 20:31:17,531][106226] Updated weights for policy 0, policy_version 179741 (0.0008) [2023-12-27 20:31:17,785][106225] Updated weights for policy 1, policy_version 180104 (0.0008) [2023-12-27 20:31:17,844][106225] Updated weights for policy 1, policy_version 180114 (0.0007) [2023-12-27 20:31:17,907][106225] Updated weights for policy 1, policy_version 180124 (0.0008) [2023-12-27 20:31:18,196][106226] Updated weights for policy 0, policy_version 179751 (0.0008) [2023-12-27 20:31:18,253][106226] Updated weights for policy 0, policy_version 179761 (0.0010) [2023-12-27 20:31:18,305][106226] Updated weights for policy 0, policy_version 179771 (0.0010) [2023-12-27 20:31:18,608][106225] Updated weights for policy 1, policy_version 180134 (0.0009) [2023-12-27 20:31:18,673][106225] Updated weights for policy 1, policy_version 180144 (0.0008) [2023-12-27 20:31:18,739][106225] Updated weights for policy 1, policy_version 180154 (0.0008) [2023-12-27 20:31:19,019][106226] Updated weights for policy 0, policy_version 179781 (0.0011) [2023-12-27 20:31:19,076][106226] Updated weights for policy 0, policy_version 179791 (0.0006) [2023-12-27 20:31:19,138][106226] Updated weights for policy 0, policy_version 179801 (0.0005) [2023-12-27 20:31:19,556][106225] Updated weights for policy 1, policy_version 180164 (0.0007) [2023-12-27 20:31:19,619][106225] Updated weights for policy 1, policy_version 180174 (0.0008) [2023-12-27 20:31:19,675][106225] Updated weights for policy 1, policy_version 180184 (0.0008) [2023-12-27 20:31:19,755][106226] Updated weights for policy 0, policy_version 179811 (0.0006) [2023-12-27 20:31:19,818][106226] Updated weights for policy 0, policy_version 179821 (0.0007) [2023-12-27 20:31:19,889][106226] Updated weights for policy 0, policy_version 179832 (0.0009) [2023-12-27 20:31:20,471][106225] Updated weights for policy 1, policy_version 180194 (0.0010) [2023-12-27 20:31:20,537][106225] Updated weights for policy 1, policy_version 180204 (0.0008) [2023-12-27 20:31:20,595][106225] Updated weights for policy 1, policy_version 180214 (0.0008) [2023-12-27 20:31:20,611][106226] Updated weights for policy 0, policy_version 179842 (0.0009) [2023-12-27 20:31:20,648][106225] Updated weights for policy 1, policy_version 180224 (0.0008) [2023-12-27 20:31:20,676][106226] Updated weights for policy 0, policy_version 179852 (0.0011) [2023-12-27 20:31:20,738][106226] Updated weights for policy 0, policy_version 179862 (0.0011) [2023-12-27 20:31:20,803][106226] Updated weights for policy 0, policy_version 179872 (0.0010) [2023-12-27 20:31:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 92200960. Throughput: 0: 9743.0, 1: 9740.4. Samples: 92210312. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:21,175][105115] Avg episode reward: [(0, '-6.045'), (1, '-7.178')] [2023-12-27 20:31:21,454][106225] Updated weights for policy 1, policy_version 180234 (0.0009) [2023-12-27 20:31:21,521][106225] Updated weights for policy 1, policy_version 180244 (0.0008) [2023-12-27 20:31:21,588][106225] Updated weights for policy 1, policy_version 180254 (0.0009) [2023-12-27 20:31:21,608][106226] Updated weights for policy 0, policy_version 179882 (0.0007) [2023-12-27 20:31:21,682][106226] Updated weights for policy 0, policy_version 179892 (0.0008) [2023-12-27 20:31:21,751][106226] Updated weights for policy 0, policy_version 179902 (0.0009) [2023-12-27 20:31:22,385][106225] Updated weights for policy 1, policy_version 180264 (0.0007) [2023-12-27 20:31:22,455][106225] Updated weights for policy 1, policy_version 180274 (0.0006) [2023-12-27 20:31:22,474][106226] Updated weights for policy 0, policy_version 179912 (0.0008) [2023-12-27 20:31:22,518][106225] Updated weights for policy 1, policy_version 180284 (0.0006) [2023-12-27 20:31:22,529][106226] Updated weights for policy 0, policy_version 179922 (0.0008) [2023-12-27 20:31:22,578][106226] Updated weights for policy 0, policy_version 179932 (0.0009) [2023-12-27 20:31:23,163][106225] Updated weights for policy 1, policy_version 180294 (0.0007) [2023-12-27 20:31:23,221][106225] Updated weights for policy 1, policy_version 180304 (0.0008) [2023-12-27 20:31:23,276][106225] Updated weights for policy 1, policy_version 180314 (0.0009) [2023-12-27 20:31:23,342][106226] Updated weights for policy 0, policy_version 179942 (0.0009) [2023-12-27 20:31:23,393][106226] Updated weights for policy 0, policy_version 179952 (0.0008) [2023-12-27 20:31:23,437][106226] Updated weights for policy 0, policy_version 179962 (0.0008) [2023-12-27 20:31:23,929][106225] Updated weights for policy 1, policy_version 180324 (0.0008) [2023-12-27 20:31:23,988][106225] Updated weights for policy 1, policy_version 180334 (0.0007) [2023-12-27 20:31:24,042][106225] Updated weights for policy 1, policy_version 180344 (0.0005) [2023-12-27 20:31:24,203][106226] Updated weights for policy 0, policy_version 179972 (0.0009) [2023-12-27 20:31:24,258][106226] Updated weights for policy 0, policy_version 179982 (0.0008) [2023-12-27 20:31:24,305][106226] Updated weights for policy 0, policy_version 179992 (0.0008) [2023-12-27 20:31:24,676][106225] Updated weights for policy 1, policy_version 180354 (0.0006) [2023-12-27 20:31:24,733][106225] Updated weights for policy 1, policy_version 180364 (0.0008) [2023-12-27 20:31:24,791][106225] Updated weights for policy 1, policy_version 180374 (0.0008) [2023-12-27 20:31:24,848][106225] Updated weights for policy 1, policy_version 180384 (0.0007) [2023-12-27 20:31:25,074][106226] Updated weights for policy 0, policy_version 180002 (0.0009) [2023-12-27 20:31:25,130][106226] Updated weights for policy 0, policy_version 180012 (0.0010) [2023-12-27 20:31:25,177][106226] Updated weights for policy 0, policy_version 180022 (0.0010) [2023-12-27 20:31:25,236][106226] Updated weights for policy 0, policy_version 180032 (0.0010) [2023-12-27 20:31:25,568][106225] Updated weights for policy 1, policy_version 180394 (0.0008) [2023-12-27 20:31:25,622][106225] Updated weights for policy 1, policy_version 180404 (0.0007) [2023-12-27 20:31:25,678][106225] Updated weights for policy 1, policy_version 180414 (0.0007) [2023-12-27 20:31:25,949][106226] Updated weights for policy 0, policy_version 180042 (0.0011) [2023-12-27 20:31:25,993][106226] Updated weights for policy 0, policy_version 180052 (0.0010) [2023-12-27 20:31:26,044][106226] Updated weights for policy 0, policy_version 180062 (0.0010) [2023-12-27 20:31:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 92299264. Throughput: 0: 9705.1, 1: 9681.4. Samples: 92266944. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:26,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-7.133')] [2023-12-27 20:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000180064_46104576.pth... [2023-12-27 20:31:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000180416_46194688.pth... [2023-12-27 20:31:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000178912_45809664.pth [2023-12-27 20:31:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000179296_45907968.pth [2023-12-27 20:31:26,424][106225] Updated weights for policy 1, policy_version 180424 (0.0007) [2023-12-27 20:31:26,467][106225] Updated weights for policy 1, policy_version 180434 (0.0007) [2023-12-27 20:31:26,516][106225] Updated weights for policy 1, policy_version 180444 (0.0008) [2023-12-27 20:31:26,820][106226] Updated weights for policy 0, policy_version 180072 (0.0009) [2023-12-27 20:31:26,869][106226] Updated weights for policy 0, policy_version 180082 (0.0009) [2023-12-27 20:31:26,924][106226] Updated weights for policy 0, policy_version 180092 (0.0009) [2023-12-27 20:31:27,096][106225] Updated weights for policy 1, policy_version 180454 (0.0006) [2023-12-27 20:31:27,155][106225] Updated weights for policy 1, policy_version 180464 (0.0005) [2023-12-27 20:31:27,202][106225] Updated weights for policy 1, policy_version 180474 (0.0007) [2023-12-27 20:31:27,545][106226] Updated weights for policy 0, policy_version 180102 (0.0007) [2023-12-27 20:31:27,606][106226] Updated weights for policy 0, policy_version 180112 (0.0006) [2023-12-27 20:31:27,664][106226] Updated weights for policy 0, policy_version 180122 (0.0008) [2023-12-27 20:31:27,746][106225] Updated weights for policy 1, policy_version 180484 (0.0008) [2023-12-27 20:31:27,796][106225] Updated weights for policy 1, policy_version 180494 (0.0005) [2023-12-27 20:31:27,842][106225] Updated weights for policy 1, policy_version 180504 (0.0005) [2023-12-27 20:31:28,429][106226] Updated weights for policy 0, policy_version 180132 (0.0009) [2023-12-27 20:31:28,438][106225] Updated weights for policy 1, policy_version 180514 (0.0006) [2023-12-27 20:31:28,484][106226] Updated weights for policy 0, policy_version 180142 (0.0008) [2023-12-27 20:31:28,497][106225] Updated weights for policy 1, policy_version 180524 (0.0008) [2023-12-27 20:31:28,539][106226] Updated weights for policy 0, policy_version 180152 (0.0005) [2023-12-27 20:31:28,556][106225] Updated weights for policy 1, policy_version 180534 (0.0007) [2023-12-27 20:31:28,617][106225] Updated weights for policy 1, policy_version 180544 (0.0007) [2023-12-27 20:31:29,274][106226] Updated weights for policy 0, policy_version 180162 (0.0007) [2023-12-27 20:31:29,323][106225] Updated weights for policy 1, policy_version 180554 (0.0007) [2023-12-27 20:31:29,333][106226] Updated weights for policy 0, policy_version 180172 (0.0006) [2023-12-27 20:31:29,390][106225] Updated weights for policy 1, policy_version 180564 (0.0008) [2023-12-27 20:31:29,393][106226] Updated weights for policy 0, policy_version 180182 (0.0007) [2023-12-27 20:31:29,446][106226] Updated weights for policy 0, policy_version 180192 (0.0006) [2023-12-27 20:31:29,447][106225] Updated weights for policy 1, policy_version 180574 (0.0007) [2023-12-27 20:31:30,122][106225] Updated weights for policy 1, policy_version 180584 (0.0008) [2023-12-27 20:31:30,180][106225] Updated weights for policy 1, policy_version 180594 (0.0007) [2023-12-27 20:31:30,210][106226] Updated weights for policy 0, policy_version 180202 (0.0006) [2023-12-27 20:31:30,240][106225] Updated weights for policy 1, policy_version 180604 (0.0007) [2023-12-27 20:31:30,266][106226] Updated weights for policy 0, policy_version 180212 (0.0008) [2023-12-27 20:31:30,325][106226] Updated weights for policy 0, policy_version 180222 (0.0009) [2023-12-27 20:31:30,986][106225] Updated weights for policy 1, policy_version 180614 (0.0007) [2023-12-27 20:31:31,039][106225] Updated weights for policy 1, policy_version 180624 (0.0007) [2023-12-27 20:31:31,053][106226] Updated weights for policy 0, policy_version 180232 (0.0007) [2023-12-27 20:31:31,098][106225] Updated weights for policy 1, policy_version 180634 (0.0007) [2023-12-27 20:31:31,113][106226] Updated weights for policy 0, policy_version 180242 (0.0006) [2023-12-27 20:31:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 92397568. Throughput: 0: 9687.2, 1: 9822.8. Samples: 92388128. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:31,175][105115] Avg episode reward: [(0, '-5.325'), (1, '-6.475')] [2023-12-27 20:31:31,179][106226] Updated weights for policy 0, policy_version 180252 (0.0008) [2023-12-27 20:31:31,814][106225] Updated weights for policy 1, policy_version 180644 (0.0008) [2023-12-27 20:31:31,878][106225] Updated weights for policy 1, policy_version 180654 (0.0010) [2023-12-27 20:31:31,931][106226] Updated weights for policy 0, policy_version 180262 (0.0008) [2023-12-27 20:31:31,933][106225] Updated weights for policy 1, policy_version 180664 (0.0008) [2023-12-27 20:31:31,989][106226] Updated weights for policy 0, policy_version 180272 (0.0008) [2023-12-27 20:31:32,047][106226] Updated weights for policy 0, policy_version 180282 (0.0008) [2023-12-27 20:31:32,660][106225] Updated weights for policy 1, policy_version 180674 (0.0010) [2023-12-27 20:31:32,708][106225] Updated weights for policy 1, policy_version 180684 (0.0010) [2023-12-27 20:31:32,752][106226] Updated weights for policy 0, policy_version 180292 (0.0007) [2023-12-27 20:31:32,767][106225] Updated weights for policy 1, policy_version 180694 (0.0009) [2023-12-27 20:31:32,809][106226] Updated weights for policy 0, policy_version 180302 (0.0008) [2023-12-27 20:31:32,822][106225] Updated weights for policy 1, policy_version 180704 (0.0010) [2023-12-27 20:31:32,864][106226] Updated weights for policy 0, policy_version 180312 (0.0007) [2023-12-27 20:31:33,521][106225] Updated weights for policy 1, policy_version 180714 (0.0008) [2023-12-27 20:31:33,547][106226] Updated weights for policy 0, policy_version 180322 (0.0008) [2023-12-27 20:31:33,569][106225] Updated weights for policy 1, policy_version 180724 (0.0006) [2023-12-27 20:31:33,594][106226] Updated weights for policy 0, policy_version 180332 (0.0006) [2023-12-27 20:31:33,619][106225] Updated weights for policy 1, policy_version 180734 (0.0006) [2023-12-27 20:31:33,642][106226] Updated weights for policy 0, policy_version 180342 (0.0006) [2023-12-27 20:31:33,688][106226] Updated weights for policy 0, policy_version 180352 (0.0008) [2023-12-27 20:31:34,378][106225] Updated weights for policy 1, policy_version 180744 (0.0007) [2023-12-27 20:31:34,400][106226] Updated weights for policy 0, policy_version 180362 (0.0007) [2023-12-27 20:31:34,439][106225] Updated weights for policy 1, policy_version 180754 (0.0007) [2023-12-27 20:31:34,465][106226] Updated weights for policy 0, policy_version 180372 (0.0008) [2023-12-27 20:31:34,501][106225] Updated weights for policy 1, policy_version 180764 (0.0006) [2023-12-27 20:31:34,536][106226] Updated weights for policy 0, policy_version 180382 (0.0008) [2023-12-27 20:31:35,163][106225] Updated weights for policy 1, policy_version 180774 (0.0007) [2023-12-27 20:31:35,220][106225] Updated weights for policy 1, policy_version 180784 (0.0007) [2023-12-27 20:31:35,222][106226] Updated weights for policy 0, policy_version 180392 (0.0008) [2023-12-27 20:31:35,273][106226] Updated weights for policy 0, policy_version 180402 (0.0005) [2023-12-27 20:31:35,278][106225] Updated weights for policy 1, policy_version 180794 (0.0007) [2023-12-27 20:31:35,321][106226] Updated weights for policy 0, policy_version 180412 (0.0007) [2023-12-27 20:31:35,985][106225] Updated weights for policy 1, policy_version 180804 (0.0006) [2023-12-27 20:31:36,039][106225] Updated weights for policy 1, policy_version 180814 (0.0006) [2023-12-27 20:31:36,058][106226] Updated weights for policy 0, policy_version 180422 (0.0008) [2023-12-27 20:31:36,087][106225] Updated weights for policy 1, policy_version 180824 (0.0006) [2023-12-27 20:31:36,113][106226] Updated weights for policy 0, policy_version 180432 (0.0007) [2023-12-27 20:31:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 92495872. Throughput: 0: 9771.0, 1: 9798.0. Samples: 92505552. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:36,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-6.830')] [2023-12-27 20:31:36,177][106226] Updated weights for policy 0, policy_version 180442 (0.0008) [2023-12-27 20:31:36,710][106225] Updated weights for policy 1, policy_version 180834 (0.0007) [2023-12-27 20:31:36,761][106225] Updated weights for policy 1, policy_version 180844 (0.0008) [2023-12-27 20:31:36,820][106225] Updated weights for policy 1, policy_version 180854 (0.0008) [2023-12-27 20:31:36,879][106225] Updated weights for policy 1, policy_version 180864 (0.0009) [2023-12-27 20:31:36,955][106226] Updated weights for policy 0, policy_version 180452 (0.0009) [2023-12-27 20:31:37,004][106226] Updated weights for policy 0, policy_version 180462 (0.0008) [2023-12-27 20:31:37,057][106226] Updated weights for policy 0, policy_version 180472 (0.0009) [2023-12-27 20:31:37,594][106225] Updated weights for policy 1, policy_version 180874 (0.0009) [2023-12-27 20:31:37,659][106225] Updated weights for policy 1, policy_version 180884 (0.0006) [2023-12-27 20:31:37,717][106225] Updated weights for policy 1, policy_version 180894 (0.0005) [2023-12-27 20:31:37,825][106226] Updated weights for policy 0, policy_version 180482 (0.0009) [2023-12-27 20:31:37,887][106226] Updated weights for policy 0, policy_version 180492 (0.0009) [2023-12-27 20:31:37,952][106226] Updated weights for policy 0, policy_version 180502 (0.0007) [2023-12-27 20:31:38,005][106226] Updated weights for policy 0, policy_version 180512 (0.0007) [2023-12-27 20:31:38,320][106225] Updated weights for policy 1, policy_version 180904 (0.0005) [2023-12-27 20:31:38,392][106225] Updated weights for policy 1, policy_version 180914 (0.0008) [2023-12-27 20:31:38,446][106225] Updated weights for policy 1, policy_version 180924 (0.0007) [2023-12-27 20:31:38,757][106226] Updated weights for policy 0, policy_version 180522 (0.0007) [2023-12-27 20:31:38,823][106226] Updated weights for policy 0, policy_version 180532 (0.0006) [2023-12-27 20:31:38,887][106226] Updated weights for policy 0, policy_version 180542 (0.0005) [2023-12-27 20:31:39,136][106225] Updated weights for policy 1, policy_version 180934 (0.0009) [2023-12-27 20:31:39,186][106225] Updated weights for policy 1, policy_version 180944 (0.0010) [2023-12-27 20:31:39,249][106225] Updated weights for policy 1, policy_version 180954 (0.0009) [2023-12-27 20:31:39,566][106226] Updated weights for policy 0, policy_version 180552 (0.0008) [2023-12-27 20:31:39,620][106226] Updated weights for policy 0, policy_version 180562 (0.0008) [2023-12-27 20:31:39,679][106226] Updated weights for policy 0, policy_version 180572 (0.0008) [2023-12-27 20:31:40,039][106225] Updated weights for policy 1, policy_version 180964 (0.0008) [2023-12-27 20:31:40,092][106225] Updated weights for policy 1, policy_version 180974 (0.0008) [2023-12-27 20:31:40,157][106225] Updated weights for policy 1, policy_version 180984 (0.0009) [2023-12-27 20:31:40,465][106226] Updated weights for policy 0, policy_version 180582 (0.0008) [2023-12-27 20:31:40,530][106226] Updated weights for policy 0, policy_version 180592 (0.0009) [2023-12-27 20:31:40,592][106226] Updated weights for policy 0, policy_version 180602 (0.0008) [2023-12-27 20:31:40,900][106225] Updated weights for policy 1, policy_version 180994 (0.0009) [2023-12-27 20:31:40,962][106225] Updated weights for policy 1, policy_version 181004 (0.0008) [2023-12-27 20:31:41,022][106225] Updated weights for policy 1, policy_version 181014 (0.0008) [2023-12-27 20:31:41,090][106225] Updated weights for policy 1, policy_version 181024 (0.0009) [2023-12-27 20:31:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 92594176. Throughput: 0: 9764.4, 1: 9873.6. Samples: 92565316. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:41,175][105115] Avg episode reward: [(0, '-5.366'), (1, '-6.994')] [2023-12-27 20:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000181024_46350336.pth... [2023-12-27 20:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000180608_46243840.pth... [2023-12-27 20:31:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000179840_46047232.pth [2023-12-27 20:31:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000179488_45957120.pth [2023-12-27 20:31:41,357][106226] Updated weights for policy 0, policy_version 180612 (0.0008) [2023-12-27 20:31:41,433][106226] Updated weights for policy 0, policy_version 180622 (0.0009) [2023-12-27 20:31:41,506][106226] Updated weights for policy 0, policy_version 180632 (0.0008) [2023-12-27 20:31:41,835][106225] Updated weights for policy 1, policy_version 181034 (0.0007) [2023-12-27 20:31:41,899][106225] Updated weights for policy 1, policy_version 181044 (0.0006) [2023-12-27 20:31:41,966][106225] Updated weights for policy 1, policy_version 181054 (0.0006) [2023-12-27 20:31:42,271][106226] Updated weights for policy 0, policy_version 180642 (0.0009) [2023-12-27 20:31:42,336][106226] Updated weights for policy 0, policy_version 180652 (0.0008) [2023-12-27 20:31:42,397][106226] Updated weights for policy 0, policy_version 180662 (0.0008) [2023-12-27 20:31:42,462][106226] Updated weights for policy 0, policy_version 180672 (0.0006) [2023-12-27 20:31:42,702][106225] Updated weights for policy 1, policy_version 181064 (0.0010) [2023-12-27 20:31:42,759][106225] Updated weights for policy 1, policy_version 181074 (0.0010) [2023-12-27 20:31:42,824][106225] Updated weights for policy 1, policy_version 181084 (0.0009) [2023-12-27 20:31:43,147][106226] Updated weights for policy 0, policy_version 180682 (0.0008) [2023-12-27 20:31:43,209][106226] Updated weights for policy 0, policy_version 180692 (0.0010) [2023-12-27 20:31:43,275][106226] Updated weights for policy 0, policy_version 180702 (0.0009) [2023-12-27 20:31:43,420][106225] Updated weights for policy 1, policy_version 181094 (0.0008) [2023-12-27 20:31:43,484][106225] Updated weights for policy 1, policy_version 181104 (0.0008) [2023-12-27 20:31:43,554][106225] Updated weights for policy 1, policy_version 181114 (0.0008) [2023-12-27 20:31:44,032][106226] Updated weights for policy 0, policy_version 180712 (0.0009) [2023-12-27 20:31:44,106][106226] Updated weights for policy 0, policy_version 180722 (0.0008) [2023-12-27 20:31:44,153][106226] Updated weights for policy 0, policy_version 180732 (0.0010) [2023-12-27 20:31:44,167][106225] Updated weights for policy 1, policy_version 181124 (0.0007) [2023-12-27 20:31:44,223][106225] Updated weights for policy 1, policy_version 181134 (0.0007) [2023-12-27 20:31:44,284][106225] Updated weights for policy 1, policy_version 181144 (0.0007) [2023-12-27 20:31:44,887][106226] Updated weights for policy 0, policy_version 180742 (0.0011) [2023-12-27 20:31:44,950][106226] Updated weights for policy 0, policy_version 180752 (0.0011) [2023-12-27 20:31:45,018][106226] Updated weights for policy 0, policy_version 180762 (0.0010) [2023-12-27 20:31:45,043][106225] Updated weights for policy 1, policy_version 181154 (0.0007) [2023-12-27 20:31:45,100][106225] Updated weights for policy 1, policy_version 181164 (0.0007) [2023-12-27 20:31:45,162][106225] Updated weights for policy 1, policy_version 181174 (0.0008) [2023-12-27 20:31:45,225][106225] Updated weights for policy 1, policy_version 181184 (0.0008) [2023-12-27 20:31:45,736][106226] Updated weights for policy 0, policy_version 180772 (0.0009) [2023-12-27 20:31:45,789][106226] Updated weights for policy 0, policy_version 180782 (0.0010) [2023-12-27 20:31:45,845][106226] Updated weights for policy 0, policy_version 180792 (0.0007) [2023-12-27 20:31:45,942][106225] Updated weights for policy 1, policy_version 181194 (0.0009) [2023-12-27 20:31:45,993][106225] Updated weights for policy 1, policy_version 181204 (0.0008) [2023-12-27 20:31:46,044][106225] Updated weights for policy 1, policy_version 181214 (0.0008) [2023-12-27 20:31:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 92692480. Throughput: 0: 9643.8, 1: 9865.7. Samples: 92679096. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 20:31:46,175][105115] Avg episode reward: [(0, '-5.498'), (1, '-6.565')] [2023-12-27 20:31:46,578][106226] Updated weights for policy 0, policy_version 180802 (0.0008) [2023-12-27 20:31:46,615][106225] Updated weights for policy 1, policy_version 181224 (0.0006) [2023-12-27 20:31:46,635][106226] Updated weights for policy 0, policy_version 180812 (0.0005) [2023-12-27 20:31:46,667][106225] Updated weights for policy 1, policy_version 181234 (0.0005) [2023-12-27 20:31:46,698][106226] Updated weights for policy 0, policy_version 180822 (0.0005) [2023-12-27 20:31:46,725][106225] Updated weights for policy 1, policy_version 181244 (0.0005) [2023-12-27 20:31:46,756][106226] Updated weights for policy 0, policy_version 180832 (0.0005) [2023-12-27 20:31:47,259][106226] Updated weights for policy 0, policy_version 180842 (0.0006) [2023-12-27 20:31:47,314][106226] Updated weights for policy 0, policy_version 180852 (0.0005) [2023-12-27 20:31:47,368][106226] Updated weights for policy 0, policy_version 180862 (0.0005) [2023-12-27 20:31:47,521][106225] Updated weights for policy 1, policy_version 181254 (0.0009) [2023-12-27 20:31:47,585][106225] Updated weights for policy 1, policy_version 181264 (0.0009) [2023-12-27 20:31:47,635][106225] Updated weights for policy 1, policy_version 181274 (0.0009) [2023-12-27 20:31:47,900][106226] Updated weights for policy 0, policy_version 180872 (0.0006) [2023-12-27 20:31:47,970][106226] Updated weights for policy 0, policy_version 180882 (0.0007) [2023-12-27 20:31:48,024][106226] Updated weights for policy 0, policy_version 180892 (0.0009) [2023-12-27 20:31:48,337][106225] Updated weights for policy 1, policy_version 181284 (0.0008) [2023-12-27 20:31:48,399][106225] Updated weights for policy 1, policy_version 181294 (0.0009) [2023-12-27 20:31:48,462][106225] Updated weights for policy 1, policy_version 181304 (0.0009) [2023-12-27 20:31:48,777][106226] Updated weights for policy 0, policy_version 180902 (0.0009) [2023-12-27 20:31:48,837][106226] Updated weights for policy 0, policy_version 180912 (0.0009) [2023-12-27 20:31:48,893][106226] Updated weights for policy 0, policy_version 180922 (0.0009) [2023-12-27 20:31:49,183][106225] Updated weights for policy 1, policy_version 181314 (0.0009) [2023-12-27 20:31:49,255][106225] Updated weights for policy 1, policy_version 181324 (0.0008) [2023-12-27 20:31:49,327][106225] Updated weights for policy 1, policy_version 181334 (0.0008) [2023-12-27 20:31:49,396][106225] Updated weights for policy 1, policy_version 181344 (0.0008) [2023-12-27 20:31:49,675][106226] Updated weights for policy 0, policy_version 180932 (0.0007) [2023-12-27 20:31:49,738][106226] Updated weights for policy 0, policy_version 180942 (0.0006) [2023-12-27 20:31:49,806][106226] Updated weights for policy 0, policy_version 180952 (0.0006) [2023-12-27 20:31:50,235][106225] Updated weights for policy 1, policy_version 181354 (0.0009) [2023-12-27 20:31:50,302][106225] Updated weights for policy 1, policy_version 181364 (0.0009) [2023-12-27 20:31:50,359][106225] Updated weights for policy 1, policy_version 181374 (0.0009) [2023-12-27 20:31:50,445][106226] Updated weights for policy 0, policy_version 180962 (0.0007) [2023-12-27 20:31:50,512][106226] Updated weights for policy 0, policy_version 180972 (0.0009) [2023-12-27 20:31:50,584][106226] Updated weights for policy 0, policy_version 180982 (0.0009) [2023-12-27 20:31:50,651][106226] Updated weights for policy 0, policy_version 180992 (0.0008) [2023-12-27 20:31:51,174][106225] Updated weights for policy 1, policy_version 181384 (0.0008) [2023-12-27 20:31:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 92782592. Throughput: 0: 9678.1, 1: 9862.1. Samples: 92797444. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:31:51,175][105115] Avg episode reward: [(0, '-5.243'), (1, '-6.865')] [2023-12-27 20:31:51,241][106225] Updated weights for policy 1, policy_version 181394 (0.0008) [2023-12-27 20:31:51,313][106225] Updated weights for policy 1, policy_version 181405 (0.0008) [2023-12-27 20:31:51,321][106226] Updated weights for policy 0, policy_version 181002 (0.0008) [2023-12-27 20:31:51,390][106226] Updated weights for policy 0, policy_version 181012 (0.0008) [2023-12-27 20:31:51,461][106226] Updated weights for policy 0, policy_version 181022 (0.0006) [2023-12-27 20:31:52,040][106225] Updated weights for policy 1, policy_version 181415 (0.0010) [2023-12-27 20:31:52,095][106225] Updated weights for policy 1, policy_version 181425 (0.0010) [2023-12-27 20:31:52,154][106225] Updated weights for policy 1, policy_version 181435 (0.0008) [2023-12-27 20:31:52,246][106226] Updated weights for policy 0, policy_version 181032 (0.0007) [2023-12-27 20:31:52,315][106226] Updated weights for policy 0, policy_version 181042 (0.0007) [2023-12-27 20:31:52,380][106226] Updated weights for policy 0, policy_version 181052 (0.0009) [2023-12-27 20:31:52,942][106225] Updated weights for policy 1, policy_version 181445 (0.0009) [2023-12-27 20:31:52,992][106225] Updated weights for policy 1, policy_version 181455 (0.0010) [2023-12-27 20:31:53,033][106226] Updated weights for policy 0, policy_version 181062 (0.0007) [2023-12-27 20:31:53,040][106225] Updated weights for policy 1, policy_version 181465 (0.0009) [2023-12-27 20:31:53,101][106226] Updated weights for policy 0, policy_version 181072 (0.0006) [2023-12-27 20:31:53,159][106226] Updated weights for policy 0, policy_version 181082 (0.0007) [2023-12-27 20:31:53,661][106225] Updated weights for policy 1, policy_version 181475 (0.0005) [2023-12-27 20:31:53,730][106225] Updated weights for policy 1, policy_version 181485 (0.0006) [2023-12-27 20:31:53,786][106225] Updated weights for policy 1, policy_version 181495 (0.0010) [2023-12-27 20:31:53,809][106226] Updated weights for policy 0, policy_version 181092 (0.0005) [2023-12-27 20:31:53,875][106226] Updated weights for policy 0, policy_version 181102 (0.0005) [2023-12-27 20:31:53,940][106226] Updated weights for policy 0, policy_version 181112 (0.0005) [2023-12-27 20:31:54,372][106225] Updated weights for policy 1, policy_version 181505 (0.0010) [2023-12-27 20:31:54,428][106225] Updated weights for policy 1, policy_version 181515 (0.0010) [2023-12-27 20:31:54,485][106225] Updated weights for policy 1, policy_version 181525 (0.0010) [2023-12-27 20:31:54,527][106226] Updated weights for policy 0, policy_version 181122 (0.0006) [2023-12-27 20:31:54,548][106225] Updated weights for policy 1, policy_version 181535 (0.0010) [2023-12-27 20:31:54,584][106226] Updated weights for policy 0, policy_version 181132 (0.0011) [2023-12-27 20:31:54,646][106226] Updated weights for policy 0, policy_version 181142 (0.0009) [2023-12-27 20:31:54,705][106226] Updated weights for policy 0, policy_version 181152 (0.0010) [2023-12-27 20:31:55,257][106225] Updated weights for policy 1, policy_version 181545 (0.0011) [2023-12-27 20:31:55,319][106225] Updated weights for policy 1, policy_version 181555 (0.0011) [2023-12-27 20:31:55,384][106225] Updated weights for policy 1, policy_version 181565 (0.0011) [2023-12-27 20:31:55,387][106226] Updated weights for policy 0, policy_version 181162 (0.0011) [2023-12-27 20:31:55,450][106226] Updated weights for policy 0, policy_version 181172 (0.0010) [2023-12-27 20:31:55,513][106226] Updated weights for policy 0, policy_version 181182 (0.0010) [2023-12-27 20:31:56,019][106225] Updated weights for policy 1, policy_version 181575 (0.0009) [2023-12-27 20:31:56,075][106225] Updated weights for policy 1, policy_version 181585 (0.0007) [2023-12-27 20:31:56,135][106225] Updated weights for policy 1, policy_version 181595 (0.0007) [2023-12-27 20:31:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 92889088. Throughput: 0: 9691.8, 1: 9849.9. Samples: 92856888. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:31:56,175][105115] Avg episode reward: [(0, '-5.263'), (1, '-6.775')] [2023-12-27 20:31:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000181600_46497792.pth... [2023-12-27 20:31:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000180416_46194688.pth [2023-12-27 20:31:56,218][106226] Updated weights for policy 0, policy_version 181192 (0.0010) [2023-12-27 20:31:56,281][106226] Updated weights for policy 0, policy_version 181202 (0.0011) [2023-12-27 20:31:56,332][106226] Updated weights for policy 0, policy_version 181212 (0.0011) [2023-12-27 20:31:56,354][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000181216_46399488.pth... [2023-12-27 20:31:56,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000180064_46104576.pth [2023-12-27 20:31:56,859][106225] Updated weights for policy 1, policy_version 181605 (0.0006) [2023-12-27 20:31:56,910][106225] Updated weights for policy 1, policy_version 181615 (0.0006) [2023-12-27 20:31:56,952][106225] Updated weights for policy 1, policy_version 181625 (0.0005) [2023-12-27 20:31:57,003][106226] Updated weights for policy 0, policy_version 181222 (0.0009) [2023-12-27 20:31:57,060][106226] Updated weights for policy 0, policy_version 181232 (0.0005) [2023-12-27 20:31:57,108][106226] Updated weights for policy 0, policy_version 181242 (0.0008) [2023-12-27 20:31:57,627][106225] Updated weights for policy 1, policy_version 181635 (0.0007) [2023-12-27 20:31:57,677][106225] Updated weights for policy 1, policy_version 181645 (0.0010) [2023-12-27 20:31:57,733][106225] Updated weights for policy 1, policy_version 181655 (0.0010) [2023-12-27 20:31:57,814][106226] Updated weights for policy 0, policy_version 181252 (0.0010) [2023-12-27 20:31:57,869][106226] Updated weights for policy 0, policy_version 181262 (0.0010) [2023-12-27 20:31:57,934][106226] Updated weights for policy 0, policy_version 181272 (0.0010) [2023-12-27 20:31:58,427][106225] Updated weights for policy 1, policy_version 181665 (0.0006) [2023-12-27 20:31:58,493][106225] Updated weights for policy 1, policy_version 181675 (0.0008) [2023-12-27 20:31:58,567][106225] Updated weights for policy 1, policy_version 181685 (0.0008) [2023-12-27 20:31:58,637][106225] Updated weights for policy 1, policy_version 181695 (0.0007) [2023-12-27 20:31:58,765][106226] Updated weights for policy 0, policy_version 181282 (0.0010) [2023-12-27 20:31:58,834][106226] Updated weights for policy 0, policy_version 181292 (0.0008) [2023-12-27 20:31:58,903][106226] Updated weights for policy 0, policy_version 181302 (0.0012) [2023-12-27 20:31:58,976][106226] Updated weights for policy 0, policy_version 181312 (0.0008) [2023-12-27 20:31:59,480][106225] Updated weights for policy 1, policy_version 181705 (0.0008) [2023-12-27 20:31:59,545][106225] Updated weights for policy 1, policy_version 181715 (0.0008) [2023-12-27 20:31:59,618][106225] Updated weights for policy 1, policy_version 181725 (0.0008) [2023-12-27 20:31:59,764][106226] Updated weights for policy 0, policy_version 181322 (0.0008) [2023-12-27 20:31:59,831][106226] Updated weights for policy 0, policy_version 181332 (0.0006) [2023-12-27 20:31:59,902][106226] Updated weights for policy 0, policy_version 181342 (0.0009) [2023-12-27 20:32:00,396][106225] Updated weights for policy 1, policy_version 181735 (0.0009) [2023-12-27 20:32:00,452][106225] Updated weights for policy 1, policy_version 181745 (0.0009) [2023-12-27 20:32:00,505][106225] Updated weights for policy 1, policy_version 181755 (0.0008) [2023-12-27 20:32:00,553][106226] Updated weights for policy 0, policy_version 181352 (0.0009) [2023-12-27 20:32:00,616][106226] Updated weights for policy 0, policy_version 181362 (0.0010) [2023-12-27 20:32:00,674][106226] Updated weights for policy 0, policy_version 181372 (0.0009) [2023-12-27 20:32:01,082][106225] Updated weights for policy 1, policy_version 181765 (0.0008) [2023-12-27 20:32:01,149][106225] Updated weights for policy 1, policy_version 181775 (0.0008) [2023-12-27 20:32:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 92979200. Throughput: 0: 9692.9, 1: 9859.2. Samples: 92973148. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:01,175][105115] Avg episode reward: [(0, '-5.014'), (1, '-7.049')] [2023-12-27 20:32:01,218][106225] Updated weights for policy 1, policy_version 181785 (0.0009) [2023-12-27 20:32:01,397][106226] Updated weights for policy 0, policy_version 181382 (0.0009) [2023-12-27 20:32:01,449][106226] Updated weights for policy 0, policy_version 181392 (0.0008) [2023-12-27 20:32:01,496][106226] Updated weights for policy 0, policy_version 181402 (0.0008) [2023-12-27 20:32:02,013][106225] Updated weights for policy 1, policy_version 181795 (0.0008) [2023-12-27 20:32:02,076][106225] Updated weights for policy 1, policy_version 181805 (0.0005) [2023-12-27 20:32:02,132][106225] Updated weights for policy 1, policy_version 181815 (0.0005) [2023-12-27 20:32:02,316][106226] Updated weights for policy 0, policy_version 181412 (0.0007) [2023-12-27 20:32:02,388][106226] Updated weights for policy 0, policy_version 181422 (0.0008) [2023-12-27 20:32:02,457][106226] Updated weights for policy 0, policy_version 181432 (0.0005) [2023-12-27 20:32:02,792][106225] Updated weights for policy 1, policy_version 181825 (0.0006) [2023-12-27 20:32:02,853][106225] Updated weights for policy 1, policy_version 181835 (0.0008) [2023-12-27 20:32:02,912][106225] Updated weights for policy 1, policy_version 181845 (0.0007) [2023-12-27 20:32:02,968][106225] Updated weights for policy 1, policy_version 181855 (0.0005) [2023-12-27 20:32:03,114][106226] Updated weights for policy 0, policy_version 181442 (0.0008) [2023-12-27 20:32:03,181][106226] Updated weights for policy 0, policy_version 181452 (0.0005) [2023-12-27 20:32:03,239][106226] Updated weights for policy 0, policy_version 181462 (0.0005) [2023-12-27 20:32:03,295][106226] Updated weights for policy 0, policy_version 181472 (0.0005) [2023-12-27 20:32:03,665][106225] Updated weights for policy 1, policy_version 181865 (0.0008) [2023-12-27 20:32:03,720][106225] Updated weights for policy 1, policy_version 181875 (0.0006) [2023-12-27 20:32:03,774][106225] Updated weights for policy 1, policy_version 181885 (0.0005) [2023-12-27 20:32:03,960][106226] Updated weights for policy 0, policy_version 181482 (0.0007) [2023-12-27 20:32:04,030][106226] Updated weights for policy 0, policy_version 181492 (0.0009) [2023-12-27 20:32:04,103][106226] Updated weights for policy 0, policy_version 181502 (0.0010) [2023-12-27 20:32:04,399][106225] Updated weights for policy 1, policy_version 181895 (0.0009) [2023-12-27 20:32:04,456][106225] Updated weights for policy 1, policy_version 181905 (0.0010) [2023-12-27 20:32:04,512][106225] Updated weights for policy 1, policy_version 181915 (0.0005) [2023-12-27 20:32:04,888][106226] Updated weights for policy 0, policy_version 181512 (0.0008) [2023-12-27 20:32:04,941][106226] Updated weights for policy 0, policy_version 181522 (0.0008) [2023-12-27 20:32:05,003][106226] Updated weights for policy 0, policy_version 181532 (0.0007) [2023-12-27 20:32:05,097][106225] Updated weights for policy 1, policy_version 181925 (0.0007) [2023-12-27 20:32:05,148][106225] Updated weights for policy 1, policy_version 181935 (0.0009) [2023-12-27 20:32:05,206][106225] Updated weights for policy 1, policy_version 181945 (0.0008) [2023-12-27 20:32:05,687][106226] Updated weights for policy 0, policy_version 181542 (0.0009) [2023-12-27 20:32:05,737][106226] Updated weights for policy 0, policy_version 181552 (0.0007) [2023-12-27 20:32:05,796][106226] Updated weights for policy 0, policy_version 181562 (0.0009) [2023-12-27 20:32:05,882][106225] Updated weights for policy 1, policy_version 181955 (0.0007) [2023-12-27 20:32:05,932][106225] Updated weights for policy 1, policy_version 181965 (0.0010) [2023-12-27 20:32:05,980][106225] Updated weights for policy 1, policy_version 181975 (0.0010) [2023-12-27 20:32:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 93085696. Throughput: 0: 9666.1, 1: 9948.2. Samples: 93092952. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:06,175][105115] Avg episode reward: [(0, '-5.374'), (1, '-6.896')] [2023-12-27 20:32:06,565][106226] Updated weights for policy 0, policy_version 181572 (0.0008) [2023-12-27 20:32:06,627][106226] Updated weights for policy 0, policy_version 181582 (0.0008) [2023-12-27 20:32:06,688][106226] Updated weights for policy 0, policy_version 181592 (0.0007) [2023-12-27 20:32:06,729][106225] Updated weights for policy 1, policy_version 181985 (0.0010) [2023-12-27 20:32:06,793][106225] Updated weights for policy 1, policy_version 181995 (0.0011) [2023-12-27 20:32:06,857][106225] Updated weights for policy 1, policy_version 182005 (0.0010) [2023-12-27 20:32:06,920][106225] Updated weights for policy 1, policy_version 182015 (0.0010) [2023-12-27 20:32:07,433][106226] Updated weights for policy 0, policy_version 181602 (0.0009) [2023-12-27 20:32:07,501][106226] Updated weights for policy 0, policy_version 181612 (0.0008) [2023-12-27 20:32:07,548][106226] Updated weights for policy 0, policy_version 181622 (0.0008) [2023-12-27 20:32:07,600][106226] Updated weights for policy 0, policy_version 181632 (0.0008) [2023-12-27 20:32:07,639][106225] Updated weights for policy 1, policy_version 182025 (0.0010) [2023-12-27 20:32:07,696][106225] Updated weights for policy 1, policy_version 182035 (0.0010) [2023-12-27 20:32:07,755][106225] Updated weights for policy 1, policy_version 182045 (0.0008) [2023-12-27 20:32:08,329][106226] Updated weights for policy 0, policy_version 181642 (0.0008) [2023-12-27 20:32:08,399][106226] Updated weights for policy 0, policy_version 181652 (0.0008) [2023-12-27 20:32:08,435][106225] Updated weights for policy 1, policy_version 182055 (0.0008) [2023-12-27 20:32:08,464][106226] Updated weights for policy 0, policy_version 181662 (0.0006) [2023-12-27 20:32:08,503][106225] Updated weights for policy 1, policy_version 182065 (0.0008) [2023-12-27 20:32:08,558][106225] Updated weights for policy 1, policy_version 182075 (0.0008) [2023-12-27 20:32:09,167][106226] Updated weights for policy 0, policy_version 181672 (0.0008) [2023-12-27 20:32:09,237][106226] Updated weights for policy 0, policy_version 181682 (0.0009) [2023-12-27 20:32:09,301][106226] Updated weights for policy 0, policy_version 181692 (0.0007) [2023-12-27 20:32:09,306][106225] Updated weights for policy 1, policy_version 182085 (0.0009) [2023-12-27 20:32:09,377][106225] Updated weights for policy 1, policy_version 182095 (0.0008) [2023-12-27 20:32:09,449][106225] Updated weights for policy 1, policy_version 182105 (0.0011) [2023-12-27 20:32:10,064][106226] Updated weights for policy 0, policy_version 181702 (0.0006) [2023-12-27 20:32:10,133][106226] Updated weights for policy 0, policy_version 181712 (0.0006) [2023-12-27 20:32:10,144][106225] Updated weights for policy 1, policy_version 182115 (0.0007) [2023-12-27 20:32:10,198][106225] Updated weights for policy 1, policy_version 182125 (0.0009) [2023-12-27 20:32:10,199][106226] Updated weights for policy 0, policy_version 181722 (0.0007) [2023-12-27 20:32:10,258][106225] Updated weights for policy 1, policy_version 182135 (0.0009) [2023-12-27 20:32:10,854][106226] Updated weights for policy 0, policy_version 181732 (0.0006) [2023-12-27 20:32:10,915][106226] Updated weights for policy 0, policy_version 181742 (0.0005) [2023-12-27 20:32:10,977][106226] Updated weights for policy 0, policy_version 181752 (0.0006) [2023-12-27 20:32:11,081][106225] Updated weights for policy 1, policy_version 182145 (0.0009) [2023-12-27 20:32:11,151][106225] Updated weights for policy 1, policy_version 182155 (0.0009) [2023-12-27 20:32:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 93175808. Throughput: 0: 9682.3, 1: 9943.1. Samples: 93150088. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:11,175][105115] Avg episode reward: [(0, '-5.536'), (1, '-6.761')] [2023-12-27 20:32:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000181760_46538752.pth... [2023-12-27 20:32:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000180608_46243840.pth [2023-12-27 20:32:11,220][106225] Updated weights for policy 1, policy_version 182165 (0.0009) [2023-12-27 20:32:11,283][106225] Updated weights for policy 1, policy_version 182175 (0.0008) [2023-12-27 20:32:11,287][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000182176_46645248.pth... [2023-12-27 20:32:11,291][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000181024_46350336.pth [2023-12-27 20:32:11,726][106226] Updated weights for policy 0, policy_version 181762 (0.0008) [2023-12-27 20:32:11,794][106226] Updated weights for policy 0, policy_version 181772 (0.0008) [2023-12-27 20:32:11,858][106226] Updated weights for policy 0, policy_version 181782 (0.0008) [2023-12-27 20:32:11,914][106226] Updated weights for policy 0, policy_version 181792 (0.0008) [2023-12-27 20:32:12,062][106225] Updated weights for policy 1, policy_version 182185 (0.0008) [2023-12-27 20:32:12,119][106225] Updated weights for policy 1, policy_version 182195 (0.0008) [2023-12-27 20:32:12,169][106225] Updated weights for policy 1, policy_version 182205 (0.0009) [2023-12-27 20:32:12,635][106226] Updated weights for policy 0, policy_version 181802 (0.0009) [2023-12-27 20:32:12,698][106226] Updated weights for policy 0, policy_version 181812 (0.0008) [2023-12-27 20:32:12,757][106226] Updated weights for policy 0, policy_version 181822 (0.0008) [2023-12-27 20:32:12,938][106225] Updated weights for policy 1, policy_version 182215 (0.0009) [2023-12-27 20:32:13,000][106225] Updated weights for policy 1, policy_version 182225 (0.0008) [2023-12-27 20:32:13,050][106225] Updated weights for policy 1, policy_version 182235 (0.0009) [2023-12-27 20:32:13,426][106226] Updated weights for policy 0, policy_version 181832 (0.0006) [2023-12-27 20:32:13,488][106226] Updated weights for policy 0, policy_version 181842 (0.0008) [2023-12-27 20:32:13,552][106226] Updated weights for policy 0, policy_version 181852 (0.0008) [2023-12-27 20:32:13,823][106225] Updated weights for policy 1, policy_version 182245 (0.0008) [2023-12-27 20:32:13,875][106225] Updated weights for policy 1, policy_version 182255 (0.0009) [2023-12-27 20:32:13,927][106225] Updated weights for policy 1, policy_version 182265 (0.0008) [2023-12-27 20:32:14,235][106226] Updated weights for policy 0, policy_version 181862 (0.0008) [2023-12-27 20:32:14,290][106226] Updated weights for policy 0, policy_version 181872 (0.0008) [2023-12-27 20:32:14,349][106226] Updated weights for policy 0, policy_version 181882 (0.0008) [2023-12-27 20:32:14,690][106225] Updated weights for policy 1, policy_version 182275 (0.0008) [2023-12-27 20:32:14,738][106225] Updated weights for policy 1, policy_version 182285 (0.0008) [2023-12-27 20:32:14,804][106225] Updated weights for policy 1, policy_version 182295 (0.0008) [2023-12-27 20:32:15,022][106226] Updated weights for policy 0, policy_version 181892 (0.0008) [2023-12-27 20:32:15,084][106226] Updated weights for policy 0, policy_version 181902 (0.0008) [2023-12-27 20:32:15,153][106226] Updated weights for policy 0, policy_version 181912 (0.0009) [2023-12-27 20:32:15,615][106225] Updated weights for policy 1, policy_version 182305 (0.0008) [2023-12-27 20:32:15,685][106225] Updated weights for policy 1, policy_version 182315 (0.0010) [2023-12-27 20:32:15,754][106225] Updated weights for policy 1, policy_version 182325 (0.0009) [2023-12-27 20:32:15,818][106225] Updated weights for policy 1, policy_version 182335 (0.0009) [2023-12-27 20:32:15,847][106226] Updated weights for policy 0, policy_version 181922 (0.0008) [2023-12-27 20:32:15,904][106226] Updated weights for policy 0, policy_version 181932 (0.0005) [2023-12-27 20:32:15,976][106226] Updated weights for policy 0, policy_version 181942 (0.0006) [2023-12-27 20:32:16,041][106226] Updated weights for policy 0, policy_version 181952 (0.0005) [2023-12-27 20:32:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 93274112. Throughput: 0: 9687.1, 1: 9738.5. Samples: 93262280. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:16,175][105115] Avg episode reward: [(0, '-5.693'), (1, '-6.646')] [2023-12-27 20:32:16,531][106225] Updated weights for policy 1, policy_version 182345 (0.0009) [2023-12-27 20:32:16,599][106225] Updated weights for policy 1, policy_version 182355 (0.0007) [2023-12-27 20:32:16,601][106226] Updated weights for policy 0, policy_version 181962 (0.0009) [2023-12-27 20:32:16,652][106226] Updated weights for policy 0, policy_version 181972 (0.0005) [2023-12-27 20:32:16,655][106225] Updated weights for policy 1, policy_version 182365 (0.0006) [2023-12-27 20:32:16,704][106226] Updated weights for policy 0, policy_version 181982 (0.0008) [2023-12-27 20:32:17,329][106226] Updated weights for policy 0, policy_version 181992 (0.0009) [2023-12-27 20:32:17,351][106225] Updated weights for policy 1, policy_version 182375 (0.0007) [2023-12-27 20:32:17,392][106226] Updated weights for policy 0, policy_version 182002 (0.0008) [2023-12-27 20:32:17,396][106225] Updated weights for policy 1, policy_version 182385 (0.0005) [2023-12-27 20:32:17,443][106225] Updated weights for policy 1, policy_version 182395 (0.0005) [2023-12-27 20:32:17,456][106226] Updated weights for policy 0, policy_version 182012 (0.0007) [2023-12-27 20:32:18,120][106226] Updated weights for policy 0, policy_version 182022 (0.0007) [2023-12-27 20:32:18,182][106226] Updated weights for policy 0, policy_version 182032 (0.0006) [2023-12-27 20:32:18,188][106225] Updated weights for policy 1, policy_version 182405 (0.0006) [2023-12-27 20:32:18,244][106226] Updated weights for policy 0, policy_version 182042 (0.0006) [2023-12-27 20:32:18,253][106225] Updated weights for policy 1, policy_version 182415 (0.0008) [2023-12-27 20:32:18,309][106225] Updated weights for policy 1, policy_version 182425 (0.0009) [2023-12-27 20:32:18,882][106226] Updated weights for policy 0, policy_version 182052 (0.0006) [2023-12-27 20:32:18,946][106226] Updated weights for policy 0, policy_version 182062 (0.0009) [2023-12-27 20:32:19,006][106226] Updated weights for policy 0, policy_version 182072 (0.0008) [2023-12-27 20:32:19,015][106225] Updated weights for policy 1, policy_version 182435 (0.0008) [2023-12-27 20:32:19,061][106225] Updated weights for policy 1, policy_version 182445 (0.0007) [2023-12-27 20:32:19,113][106225] Updated weights for policy 1, policy_version 182455 (0.0009) [2023-12-27 20:32:19,777][106226] Updated weights for policy 0, policy_version 182082 (0.0007) [2023-12-27 20:32:19,835][106226] Updated weights for policy 0, policy_version 182092 (0.0009) [2023-12-27 20:32:19,897][106225] Updated weights for policy 1, policy_version 182465 (0.0008) [2023-12-27 20:32:19,901][106226] Updated weights for policy 0, policy_version 182102 (0.0009) [2023-12-27 20:32:19,964][106225] Updated weights for policy 1, policy_version 182475 (0.0009) [2023-12-27 20:32:19,970][106226] Updated weights for policy 0, policy_version 182112 (0.0009) [2023-12-27 20:32:20,027][106225] Updated weights for policy 1, policy_version 182485 (0.0006) [2023-12-27 20:32:20,095][106225] Updated weights for policy 1, policy_version 182495 (0.0007) [2023-12-27 20:32:20,741][106226] Updated weights for policy 0, policy_version 182122 (0.0008) [2023-12-27 20:32:20,781][106225] Updated weights for policy 1, policy_version 182505 (0.0007) [2023-12-27 20:32:20,800][106226] Updated weights for policy 0, policy_version 182132 (0.0008) [2023-12-27 20:32:20,839][106225] Updated weights for policy 1, policy_version 182515 (0.0008) [2023-12-27 20:32:20,863][106226] Updated weights for policy 0, policy_version 182142 (0.0008) [2023-12-27 20:32:20,890][106225] Updated weights for policy 1, policy_version 182525 (0.0006) [2023-12-27 20:32:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 93372416. Throughput: 0: 9728.4, 1: 9688.6. Samples: 93379316. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:21,175][105115] Avg episode reward: [(0, '-5.562'), (1, '-7.096')] [2023-12-27 20:32:21,654][106226] Updated weights for policy 0, policy_version 182152 (0.0009) [2023-12-27 20:32:21,721][106226] Updated weights for policy 0, policy_version 182162 (0.0008) [2023-12-27 20:32:21,765][106225] Updated weights for policy 1, policy_version 182535 (0.0007) [2023-12-27 20:32:21,783][106226] Updated weights for policy 0, policy_version 182172 (0.0007) [2023-12-27 20:32:21,834][106225] Updated weights for policy 1, policy_version 182545 (0.0008) [2023-12-27 20:32:21,889][106225] Updated weights for policy 1, policy_version 182555 (0.0008) [2023-12-27 20:32:22,566][106226] Updated weights for policy 0, policy_version 182182 (0.0010) [2023-12-27 20:32:22,611][106225] Updated weights for policy 1, policy_version 182565 (0.0007) [2023-12-27 20:32:22,631][106226] Updated weights for policy 0, policy_version 182192 (0.0011) [2023-12-27 20:32:22,677][106225] Updated weights for policy 1, policy_version 182575 (0.0008) [2023-12-27 20:32:22,693][106226] Updated weights for policy 0, policy_version 182202 (0.0009) [2023-12-27 20:32:22,741][106225] Updated weights for policy 1, policy_version 182585 (0.0008) [2023-12-27 20:32:23,346][106226] Updated weights for policy 0, policy_version 182212 (0.0009) [2023-12-27 20:32:23,405][106226] Updated weights for policy 0, policy_version 182222 (0.0007) [2023-12-27 20:32:23,466][106226] Updated weights for policy 0, policy_version 182232 (0.0006) [2023-12-27 20:32:23,477][106225] Updated weights for policy 1, policy_version 182595 (0.0009) [2023-12-27 20:32:23,539][106225] Updated weights for policy 1, policy_version 182605 (0.0011) [2023-12-27 20:32:23,596][106225] Updated weights for policy 1, policy_version 182615 (0.0009) [2023-12-27 20:32:24,047][106226] Updated weights for policy 0, policy_version 182242 (0.0006) [2023-12-27 20:32:24,105][106226] Updated weights for policy 0, policy_version 182252 (0.0006) [2023-12-27 20:32:24,154][106226] Updated weights for policy 0, policy_version 182262 (0.0009) [2023-12-27 20:32:24,210][106226] Updated weights for policy 0, policy_version 182272 (0.0008) [2023-12-27 20:32:24,231][106225] Updated weights for policy 1, policy_version 182625 (0.0007) [2023-12-27 20:32:24,282][106225] Updated weights for policy 1, policy_version 182635 (0.0009) [2023-12-27 20:32:24,337][106225] Updated weights for policy 1, policy_version 182645 (0.0008) [2023-12-27 20:32:24,399][106225] Updated weights for policy 1, policy_version 182655 (0.0009) [2023-12-27 20:32:24,895][106226] Updated weights for policy 0, policy_version 182282 (0.0009) [2023-12-27 20:32:24,957][106226] Updated weights for policy 0, policy_version 182292 (0.0009) [2023-12-27 20:32:25,023][106226] Updated weights for policy 0, policy_version 182302 (0.0010) [2023-12-27 20:32:25,087][106225] Updated weights for policy 1, policy_version 182665 (0.0005) [2023-12-27 20:32:25,137][106225] Updated weights for policy 1, policy_version 182675 (0.0007) [2023-12-27 20:32:25,198][106225] Updated weights for policy 1, policy_version 182685 (0.0006) [2023-12-27 20:32:25,748][106225] Updated weights for policy 1, policy_version 182695 (0.0006) [2023-12-27 20:32:25,753][106226] Updated weights for policy 0, policy_version 182312 (0.0007) [2023-12-27 20:32:25,800][106225] Updated weights for policy 1, policy_version 182705 (0.0006) [2023-12-27 20:32:25,812][106226] Updated weights for policy 0, policy_version 182322 (0.0007) [2023-12-27 20:32:25,855][106225] Updated weights for policy 1, policy_version 182715 (0.0008) [2023-12-27 20:32:25,866][106226] Updated weights for policy 0, policy_version 182332 (0.0008) [2023-12-27 20:32:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 93470720. Throughput: 0: 9764.9, 1: 9591.1. Samples: 93436336. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:26,175][105115] Avg episode reward: [(0, '-5.225'), (1, '-6.966')] [2023-12-27 20:32:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000182720_46784512.pth... [2023-12-27 20:32:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000182336_46686208.pth... [2023-12-27 20:32:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000181600_46497792.pth [2023-12-27 20:32:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000181216_46399488.pth [2023-12-27 20:32:26,541][106226] Updated weights for policy 0, policy_version 182342 (0.0010) [2023-12-27 20:32:26,585][106225] Updated weights for policy 1, policy_version 182725 (0.0006) [2023-12-27 20:32:26,603][106226] Updated weights for policy 0, policy_version 182352 (0.0009) [2023-12-27 20:32:26,644][106225] Updated weights for policy 1, policy_version 182735 (0.0005) [2023-12-27 20:32:26,667][106226] Updated weights for policy 0, policy_version 182362 (0.0007) [2023-12-27 20:32:26,694][106225] Updated weights for policy 1, policy_version 182745 (0.0006) [2023-12-27 20:32:27,315][106225] Updated weights for policy 1, policy_version 182755 (0.0008) [2023-12-27 20:32:27,366][106225] Updated weights for policy 1, policy_version 182765 (0.0006) [2023-12-27 20:32:27,422][106225] Updated weights for policy 1, policy_version 182775 (0.0005) [2023-12-27 20:32:27,430][106226] Updated weights for policy 0, policy_version 182372 (0.0008) [2023-12-27 20:32:27,487][106226] Updated weights for policy 0, policy_version 182382 (0.0009) [2023-12-27 20:32:27,548][106226] Updated weights for policy 0, policy_version 182392 (0.0008) [2023-12-27 20:32:27,961][106225] Updated weights for policy 1, policy_version 182785 (0.0005) [2023-12-27 20:32:28,022][106225] Updated weights for policy 1, policy_version 182795 (0.0008) [2023-12-27 20:32:28,075][106225] Updated weights for policy 1, policy_version 182805 (0.0008) [2023-12-27 20:32:28,123][106225] Updated weights for policy 1, policy_version 182815 (0.0009) [2023-12-27 20:32:28,259][106226] Updated weights for policy 0, policy_version 182402 (0.0008) [2023-12-27 20:32:28,311][106226] Updated weights for policy 0, policy_version 182412 (0.0008) [2023-12-27 20:32:28,376][106226] Updated weights for policy 0, policy_version 182422 (0.0009) [2023-12-27 20:32:28,439][106226] Updated weights for policy 0, policy_version 182432 (0.0008) [2023-12-27 20:32:28,889][106225] Updated weights for policy 1, policy_version 182825 (0.0007) [2023-12-27 20:32:28,944][106225] Updated weights for policy 1, policy_version 182835 (0.0008) [2023-12-27 20:32:28,996][106225] Updated weights for policy 1, policy_version 182845 (0.0008) [2023-12-27 20:32:29,140][106226] Updated weights for policy 0, policy_version 182442 (0.0010) [2023-12-27 20:32:29,186][106226] Updated weights for policy 0, policy_version 182452 (0.0010) [2023-12-27 20:32:29,755][106225] Updated weights for policy 1, policy_version 182855 (0.0009) [2023-12-27 20:32:29,810][106225] Updated weights for policy 1, policy_version 182865 (0.0008) [2023-12-27 20:32:29,877][106225] Updated weights for policy 1, policy_version 182875 (0.0009) [2023-12-27 20:32:29,917][106226] Updated weights for policy 0, policy_version 182466 (0.0008) [2023-12-27 20:32:29,983][106226] Updated weights for policy 0, policy_version 182476 (0.0009) [2023-12-27 20:32:30,043][106226] Updated weights for policy 0, policy_version 182486 (0.0009) [2023-12-27 20:32:30,101][106226] Updated weights for policy 0, policy_version 182496 (0.0008) [2023-12-27 20:32:30,534][106225] Updated weights for policy 1, policy_version 182885 (0.0009) [2023-12-27 20:32:30,588][106225] Updated weights for policy 1, policy_version 182895 (0.0008) [2023-12-27 20:32:30,634][106225] Updated weights for policy 1, policy_version 182905 (0.0009) [2023-12-27 20:32:30,732][106226] Updated weights for policy 0, policy_version 182506 (0.0010) [2023-12-27 20:32:30,784][106226] Updated weights for policy 0, policy_version 182516 (0.0008) [2023-12-27 20:32:30,833][106226] Updated weights for policy 0, policy_version 182526 (0.0006) [2023-12-27 20:32:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 93569024. Throughput: 0: 9819.5, 1: 9704.8. Samples: 93557684. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:31,175][105115] Avg episode reward: [(0, '-5.426'), (1, '-7.475')] [2023-12-27 20:32:31,347][106225] Updated weights for policy 1, policy_version 182915 (0.0008) [2023-12-27 20:32:31,423][106225] Updated weights for policy 1, policy_version 182925 (0.0008) [2023-12-27 20:32:31,479][106225] Updated weights for policy 1, policy_version 182935 (0.0007) [2023-12-27 20:32:31,503][106226] Updated weights for policy 0, policy_version 182536 (0.0005) [2023-12-27 20:32:31,572][106226] Updated weights for policy 0, policy_version 182546 (0.0007) [2023-12-27 20:32:31,638][106226] Updated weights for policy 0, policy_version 182556 (0.0008) [2023-12-27 20:32:32,090][106225] Updated weights for policy 1, policy_version 182945 (0.0007) [2023-12-27 20:32:32,149][106225] Updated weights for policy 1, policy_version 182955 (0.0008) [2023-12-27 20:32:32,205][106225] Updated weights for policy 1, policy_version 182965 (0.0008) [2023-12-27 20:32:32,270][106225] Updated weights for policy 1, policy_version 182975 (0.0009) [2023-12-27 20:32:32,357][106226] Updated weights for policy 0, policy_version 182566 (0.0008) [2023-12-27 20:32:32,420][106226] Updated weights for policy 0, policy_version 182576 (0.0009) [2023-12-27 20:32:32,480][106226] Updated weights for policy 0, policy_version 182586 (0.0007) [2023-12-27 20:32:33,051][106225] Updated weights for policy 1, policy_version 182985 (0.0008) [2023-12-27 20:32:33,111][106225] Updated weights for policy 1, policy_version 182995 (0.0007) [2023-12-27 20:32:33,165][106225] Updated weights for policy 1, policy_version 183005 (0.0010) [2023-12-27 20:32:33,191][106226] Updated weights for policy 0, policy_version 182596 (0.0009) [2023-12-27 20:32:33,250][106226] Updated weights for policy 0, policy_version 182606 (0.0010) [2023-12-27 20:32:33,310][106226] Updated weights for policy 0, policy_version 182616 (0.0011) [2023-12-27 20:32:33,881][106225] Updated weights for policy 1, policy_version 183015 (0.0009) [2023-12-27 20:32:33,929][106225] Updated weights for policy 1, policy_version 183025 (0.0007) [2023-12-27 20:32:33,984][106225] Updated weights for policy 1, policy_version 183035 (0.0007) [2023-12-27 20:32:33,988][106226] Updated weights for policy 0, policy_version 182626 (0.0010) [2023-12-27 20:32:34,036][106226] Updated weights for policy 0, policy_version 182636 (0.0010) [2023-12-27 20:32:34,082][106226] Updated weights for policy 0, policy_version 182646 (0.0010) [2023-12-27 20:32:34,132][106226] Updated weights for policy 0, policy_version 182656 (0.0010) [2023-12-27 20:32:34,745][106225] Updated weights for policy 1, policy_version 183045 (0.0007) [2023-12-27 20:32:34,802][106225] Updated weights for policy 1, policy_version 183055 (0.0008) [2023-12-27 20:32:34,850][106225] Updated weights for policy 1, policy_version 183065 (0.0008) [2023-12-27 20:32:34,857][106226] Updated weights for policy 0, policy_version 182666 (0.0008) [2023-12-27 20:32:34,917][106226] Updated weights for policy 0, policy_version 182676 (0.0008) [2023-12-27 20:32:34,982][106226] Updated weights for policy 0, policy_version 182686 (0.0009) [2023-12-27 20:32:35,598][106225] Updated weights for policy 1, policy_version 183075 (0.0008) [2023-12-27 20:32:35,642][106226] Updated weights for policy 0, policy_version 182696 (0.0010) [2023-12-27 20:32:35,655][106225] Updated weights for policy 1, policy_version 183085 (0.0005) [2023-12-27 20:32:35,702][106226] Updated weights for policy 0, policy_version 182706 (0.0010) [2023-12-27 20:32:35,713][106225] Updated weights for policy 1, policy_version 183095 (0.0005) [2023-12-27 20:32:35,759][106226] Updated weights for policy 0, policy_version 182716 (0.0010) [2023-12-27 20:32:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 93667328. Throughput: 0: 9794.0, 1: 9749.7. Samples: 93676912. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:36,175][105115] Avg episode reward: [(0, '-5.666'), (1, '-7.129')] [2023-12-27 20:32:36,412][106225] Updated weights for policy 1, policy_version 183105 (0.0008) [2023-12-27 20:32:36,466][106226] Updated weights for policy 0, policy_version 182726 (0.0008) [2023-12-27 20:32:36,476][106225] Updated weights for policy 1, policy_version 183115 (0.0007) [2023-12-27 20:32:36,528][106226] Updated weights for policy 0, policy_version 182736 (0.0006) [2023-12-27 20:32:36,538][106225] Updated weights for policy 1, policy_version 183125 (0.0010) [2023-12-27 20:32:36,591][106226] Updated weights for policy 0, policy_version 182746 (0.0006) [2023-12-27 20:32:36,601][106225] Updated weights for policy 1, policy_version 183135 (0.0011) [2023-12-27 20:32:37,318][106225] Updated weights for policy 1, policy_version 183145 (0.0009) [2023-12-27 20:32:37,324][106226] Updated weights for policy 0, policy_version 182756 (0.0006) [2023-12-27 20:32:37,380][106225] Updated weights for policy 1, policy_version 183155 (0.0011) [2023-12-27 20:32:37,382][106226] Updated weights for policy 0, policy_version 182766 (0.0006) [2023-12-27 20:32:37,441][106226] Updated weights for policy 0, policy_version 182776 (0.0006) [2023-12-27 20:32:37,442][106225] Updated weights for policy 1, policy_version 183165 (0.0011) [2023-12-27 20:32:38,017][106226] Updated weights for policy 0, policy_version 182786 (0.0006) [2023-12-27 20:32:38,080][106226] Updated weights for policy 0, policy_version 182796 (0.0007) [2023-12-27 20:32:38,145][106226] Updated weights for policy 0, policy_version 182806 (0.0005) [2023-12-27 20:32:38,164][106225] Updated weights for policy 1, policy_version 183175 (0.0011) [2023-12-27 20:32:38,209][106226] Updated weights for policy 0, policy_version 182816 (0.0005) [2023-12-27 20:32:38,217][106225] Updated weights for policy 1, policy_version 183185 (0.0010) [2023-12-27 20:32:38,278][106225] Updated weights for policy 1, policy_version 183195 (0.0009) [2023-12-27 20:32:38,845][106226] Updated weights for policy 0, policy_version 182826 (0.0008) [2023-12-27 20:32:38,917][106226] Updated weights for policy 0, policy_version 182836 (0.0010) [2023-12-27 20:32:38,982][106225] Updated weights for policy 1, policy_version 183205 (0.0008) [2023-12-27 20:32:38,983][106226] Updated weights for policy 0, policy_version 182846 (0.0008) [2023-12-27 20:32:39,039][106225] Updated weights for policy 1, policy_version 183215 (0.0007) [2023-12-27 20:32:39,107][106225] Updated weights for policy 1, policy_version 183225 (0.0007) [2023-12-27 20:32:39,752][106226] Updated weights for policy 0, policy_version 182856 (0.0008) [2023-12-27 20:32:39,816][106226] Updated weights for policy 0, policy_version 182866 (0.0008) [2023-12-27 20:32:39,818][106225] Updated weights for policy 1, policy_version 183235 (0.0006) [2023-12-27 20:32:39,882][106226] Updated weights for policy 0, policy_version 182876 (0.0007) [2023-12-27 20:32:39,887][106225] Updated weights for policy 1, policy_version 183245 (0.0007) [2023-12-27 20:32:39,956][106225] Updated weights for policy 1, policy_version 183255 (0.0008) [2023-12-27 20:32:40,615][106226] Updated weights for policy 0, policy_version 182886 (0.0009) [2023-12-27 20:32:40,665][106225] Updated weights for policy 1, policy_version 183265 (0.0008) [2023-12-27 20:32:40,685][106226] Updated weights for policy 0, policy_version 182896 (0.0008) [2023-12-27 20:32:40,724][106225] Updated weights for policy 1, policy_version 183275 (0.0005) [2023-12-27 20:32:40,734][106226] Updated weights for policy 0, policy_version 182906 (0.0008) [2023-12-27 20:32:40,777][106225] Updated weights for policy 1, policy_version 183285 (0.0007) [2023-12-27 20:32:40,837][106225] Updated weights for policy 1, policy_version 183295 (0.0007) [2023-12-27 20:32:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 93765632. Throughput: 0: 9797.3, 1: 9748.0. Samples: 93736424. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:41,175][105115] Avg episode reward: [(0, '-5.473'), (1, '-7.056')] [2023-12-27 20:32:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000183296_46931968.pth... [2023-12-27 20:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000182912_46833664.pth... [2023-12-27 20:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000182176_46645248.pth [2023-12-27 20:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000181760_46538752.pth [2023-12-27 20:32:41,512][106226] Updated weights for policy 0, policy_version 182916 (0.0007) [2023-12-27 20:32:41,567][106225] Updated weights for policy 1, policy_version 183305 (0.0007) [2023-12-27 20:32:41,569][106226] Updated weights for policy 0, policy_version 182926 (0.0007) [2023-12-27 20:32:41,630][106226] Updated weights for policy 0, policy_version 182936 (0.0007) [2023-12-27 20:32:41,648][106225] Updated weights for policy 1, policy_version 183315 (0.0007) [2023-12-27 20:32:41,713][106225] Updated weights for policy 1, policy_version 183325 (0.0007) [2023-12-27 20:32:42,391][106226] Updated weights for policy 0, policy_version 182946 (0.0008) [2023-12-27 20:32:42,451][106226] Updated weights for policy 0, policy_version 182956 (0.0008) [2023-12-27 20:32:42,497][106225] Updated weights for policy 1, policy_version 183335 (0.0007) [2023-12-27 20:32:42,503][106226] Updated weights for policy 0, policy_version 182966 (0.0008) [2023-12-27 20:32:42,560][106225] Updated weights for policy 1, policy_version 183345 (0.0007) [2023-12-27 20:32:42,560][106226] Updated weights for policy 0, policy_version 182976 (0.0009) [2023-12-27 20:32:42,617][106225] Updated weights for policy 1, policy_version 183355 (0.0008) [2023-12-27 20:32:43,167][106226] Updated weights for policy 0, policy_version 182986 (0.0006) [2023-12-27 20:32:43,231][106226] Updated weights for policy 0, policy_version 182996 (0.0005) [2023-12-27 20:32:43,283][106226] Updated weights for policy 0, policy_version 183006 (0.0005) [2023-12-27 20:32:43,375][106225] Updated weights for policy 1, policy_version 183365 (0.0007) [2023-12-27 20:32:43,442][106225] Updated weights for policy 1, policy_version 183375 (0.0005) [2023-12-27 20:32:43,507][106225] Updated weights for policy 1, policy_version 183385 (0.0005) [2023-12-27 20:32:43,805][106226] Updated weights for policy 0, policy_version 183016 (0.0010) [2023-12-27 20:32:43,862][106226] Updated weights for policy 0, policy_version 183026 (0.0010) [2023-12-27 20:32:43,923][106226] Updated weights for policy 0, policy_version 183036 (0.0011) [2023-12-27 20:32:44,146][106225] Updated weights for policy 1, policy_version 183395 (0.0006) [2023-12-27 20:32:44,208][106225] Updated weights for policy 1, policy_version 183405 (0.0008) [2023-12-27 20:32:44,268][106225] Updated weights for policy 1, policy_version 183415 (0.0007) [2023-12-27 20:32:44,594][106226] Updated weights for policy 0, policy_version 183046 (0.0011) [2023-12-27 20:32:44,643][106226] Updated weights for policy 0, policy_version 183056 (0.0010) [2023-12-27 20:32:44,702][106226] Updated weights for policy 0, policy_version 183066 (0.0010) [2023-12-27 20:32:45,043][106225] Updated weights for policy 1, policy_version 183425 (0.0008) [2023-12-27 20:32:45,106][106225] Updated weights for policy 1, policy_version 183435 (0.0008) [2023-12-27 20:32:45,164][106225] Updated weights for policy 1, policy_version 183445 (0.0010) [2023-12-27 20:32:45,226][106225] Updated weights for policy 1, policy_version 183455 (0.0010) [2023-12-27 20:32:45,346][106226] Updated weights for policy 0, policy_version 183076 (0.0010) [2023-12-27 20:32:45,403][106226] Updated weights for policy 0, policy_version 183086 (0.0009) [2023-12-27 20:32:45,455][106226] Updated weights for policy 0, policy_version 183096 (0.0010) [2023-12-27 20:32:45,993][106225] Updated weights for policy 1, policy_version 183465 (0.0008) [2023-12-27 20:32:46,045][106225] Updated weights for policy 1, policy_version 183475 (0.0007) [2023-12-27 20:32:46,102][106225] Updated weights for policy 1, policy_version 183485 (0.0005) [2023-12-27 20:32:46,162][106226] Updated weights for policy 0, policy_version 183106 (0.0009) [2023-12-27 20:32:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 93863936. Throughput: 0: 9861.6, 1: 9707.1. Samples: 93853740. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:46,176][105115] Avg episode reward: [(0, '-5.520'), (1, '-6.780')] [2023-12-27 20:32:46,226][106226] Updated weights for policy 0, policy_version 183116 (0.0011) [2023-12-27 20:32:46,283][106226] Updated weights for policy 0, policy_version 183126 (0.0010) [2023-12-27 20:32:46,330][106226] Updated weights for policy 0, policy_version 183136 (0.0010) [2023-12-27 20:32:46,808][106225] Updated weights for policy 1, policy_version 183495 (0.0009) [2023-12-27 20:32:46,859][106225] Updated weights for policy 1, policy_version 183505 (0.0010) [2023-12-27 20:32:46,918][106225] Updated weights for policy 1, policy_version 183515 (0.0007) [2023-12-27 20:32:47,023][106226] Updated weights for policy 0, policy_version 183146 (0.0005) [2023-12-27 20:32:47,079][106226] Updated weights for policy 0, policy_version 183156 (0.0005) [2023-12-27 20:32:47,138][106226] Updated weights for policy 0, policy_version 183166 (0.0005) [2023-12-27 20:32:47,560][106225] Updated weights for policy 1, policy_version 183525 (0.0006) [2023-12-27 20:32:47,609][106225] Updated weights for policy 1, policy_version 183535 (0.0005) [2023-12-27 20:32:47,648][106226] Updated weights for policy 0, policy_version 183176 (0.0005) [2023-12-27 20:32:47,668][106225] Updated weights for policy 1, policy_version 183545 (0.0005) [2023-12-27 20:32:47,709][106226] Updated weights for policy 0, policy_version 183186 (0.0005) [2023-12-27 20:32:47,766][106226] Updated weights for policy 0, policy_version 183196 (0.0005) [2023-12-27 20:32:48,284][106225] Updated weights for policy 1, policy_version 183555 (0.0007) [2023-12-27 20:32:48,347][106225] Updated weights for policy 1, policy_version 183565 (0.0009) [2023-12-27 20:32:48,408][106225] Updated weights for policy 1, policy_version 183575 (0.0010) [2023-12-27 20:32:48,459][106226] Updated weights for policy 0, policy_version 183206 (0.0009) [2023-12-27 20:32:48,523][106226] Updated weights for policy 0, policy_version 183216 (0.0008) [2023-12-27 20:32:48,592][106226] Updated weights for policy 0, policy_version 183226 (0.0008) [2023-12-27 20:32:49,125][106225] Updated weights for policy 1, policy_version 183585 (0.0008) [2023-12-27 20:32:49,182][106225] Updated weights for policy 1, policy_version 183595 (0.0010) [2023-12-27 20:32:49,250][106225] Updated weights for policy 1, policy_version 183605 (0.0012) [2023-12-27 20:32:49,287][106226] Updated weights for policy 0, policy_version 183236 (0.0007) [2023-12-27 20:32:49,317][106225] Updated weights for policy 1, policy_version 183615 (0.0008) [2023-12-27 20:32:49,351][106226] Updated weights for policy 0, policy_version 183246 (0.0007) [2023-12-27 20:32:49,414][106226] Updated weights for policy 0, policy_version 183256 (0.0009) [2023-12-27 20:32:50,045][106225] Updated weights for policy 1, policy_version 183625 (0.0009) [2023-12-27 20:32:50,064][106226] Updated weights for policy 0, policy_version 183266 (0.0008) [2023-12-27 20:32:50,109][106225] Updated weights for policy 1, policy_version 183635 (0.0007) [2023-12-27 20:32:50,132][106226] Updated weights for policy 0, policy_version 183276 (0.0006) [2023-12-27 20:32:50,170][106225] Updated weights for policy 1, policy_version 183645 (0.0007) [2023-12-27 20:32:50,188][106226] Updated weights for policy 0, policy_version 183286 (0.0006) [2023-12-27 20:32:50,247][106226] Updated weights for policy 0, policy_version 183296 (0.0009) [2023-12-27 20:32:50,860][106226] Updated weights for policy 0, policy_version 183306 (0.0007) [2023-12-27 20:32:50,924][106226] Updated weights for policy 0, policy_version 183316 (0.0010) [2023-12-27 20:32:50,925][106225] Updated weights for policy 1, policy_version 183655 (0.0007) [2023-12-27 20:32:50,985][106225] Updated weights for policy 1, policy_version 183665 (0.0008) [2023-12-27 20:32:50,985][106226] Updated weights for policy 0, policy_version 183326 (0.0006) [2023-12-27 20:32:51,054][106225] Updated weights for policy 1, policy_version 183675 (0.0008) [2023-12-27 20:32:51,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 93970432. Throughput: 0: 9970.8, 1: 9642.0. Samples: 93975532. Policy #0 lag: (min: 27.0, avg: 38.9, max: 40.0) [2023-12-27 20:32:51,175][105115] Avg episode reward: [(0, '-5.449'), (1, '-7.271')] [2023-12-27 20:32:51,696][106226] Updated weights for policy 0, policy_version 183336 (0.0008) [2023-12-27 20:32:51,762][106226] Updated weights for policy 0, policy_version 183346 (0.0010) [2023-12-27 20:32:51,825][106226] Updated weights for policy 0, policy_version 183356 (0.0011) [2023-12-27 20:32:51,862][106225] Updated weights for policy 1, policy_version 183685 (0.0007) [2023-12-27 20:32:51,920][106225] Updated weights for policy 1, policy_version 183695 (0.0008) [2023-12-27 20:32:51,981][106225] Updated weights for policy 1, policy_version 183705 (0.0008) [2023-12-27 20:32:52,594][106226] Updated weights for policy 0, policy_version 183366 (0.0011) [2023-12-27 20:32:52,655][106226] Updated weights for policy 0, policy_version 183376 (0.0011) [2023-12-27 20:32:52,721][106226] Updated weights for policy 0, policy_version 183386 (0.0006) [2023-12-27 20:32:52,729][106225] Updated weights for policy 1, policy_version 183715 (0.0007) [2023-12-27 20:32:52,793][106225] Updated weights for policy 1, policy_version 183725 (0.0007) [2023-12-27 20:32:52,864][106225] Updated weights for policy 1, policy_version 183735 (0.0005) [2023-12-27 20:32:53,399][106225] Updated weights for policy 1, policy_version 183745 (0.0006) [2023-12-27 20:32:53,413][106226] Updated weights for policy 0, policy_version 183396 (0.0007) [2023-12-27 20:32:53,461][106225] Updated weights for policy 1, policy_version 183755 (0.0007) [2023-12-27 20:32:53,473][106226] Updated weights for policy 0, policy_version 183406 (0.0007) [2023-12-27 20:32:53,518][106225] Updated weights for policy 1, policy_version 183765 (0.0006) [2023-12-27 20:32:53,520][106226] Updated weights for policy 0, policy_version 183416 (0.0006) [2023-12-27 20:32:53,576][106225] Updated weights for policy 1, policy_version 183775 (0.0007) [2023-12-27 20:32:54,194][106226] Updated weights for policy 0, policy_version 183426 (0.0005) [2023-12-27 20:32:54,257][106226] Updated weights for policy 0, policy_version 183436 (0.0005) [2023-12-27 20:32:54,322][106226] Updated weights for policy 0, policy_version 183446 (0.0005) [2023-12-27 20:32:54,358][106225] Updated weights for policy 1, policy_version 183785 (0.0008) [2023-12-27 20:32:54,386][106226] Updated weights for policy 0, policy_version 183456 (0.0005) [2023-12-27 20:32:54,407][106225] Updated weights for policy 1, policy_version 183795 (0.0008) [2023-12-27 20:32:54,470][106225] Updated weights for policy 1, policy_version 183805 (0.0010) [2023-12-27 20:32:54,954][106226] Updated weights for policy 0, policy_version 183466 (0.0008) [2023-12-27 20:32:55,016][106226] Updated weights for policy 0, policy_version 183476 (0.0010) [2023-12-27 20:32:55,081][106226] Updated weights for policy 0, policy_version 183486 (0.0010) [2023-12-27 20:32:55,187][106225] Updated weights for policy 1, policy_version 183815 (0.0006) [2023-12-27 20:32:55,243][106225] Updated weights for policy 1, policy_version 183825 (0.0008) [2023-12-27 20:32:55,291][106225] Updated weights for policy 1, policy_version 183835 (0.0010) [2023-12-27 20:32:55,806][106226] Updated weights for policy 0, policy_version 183496 (0.0006) [2023-12-27 20:32:55,854][106226] Updated weights for policy 0, policy_version 183506 (0.0007) [2023-12-27 20:32:55,901][106226] Updated weights for policy 0, policy_version 183516 (0.0006) [2023-12-27 20:32:55,937][106225] Updated weights for policy 1, policy_version 183845 (0.0009) [2023-12-27 20:32:55,990][106225] Updated weights for policy 1, policy_version 183855 (0.0005) [2023-12-27 20:32:56,051][106225] Updated weights for policy 1, policy_version 183865 (0.0008) [2023-12-27 20:32:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 94068736. Throughput: 0: 9976.4, 1: 9642.6. Samples: 94032948. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:32:56,176][105115] Avg episode reward: [(0, '-5.222'), (1, '-7.079')] [2023-12-27 20:32:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000183520_46989312.pth... [2023-12-27 20:32:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000183872_47079424.pth... [2023-12-27 20:32:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000182336_46686208.pth [2023-12-27 20:32:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000182720_46784512.pth [2023-12-27 20:32:56,515][106226] Updated weights for policy 0, policy_version 183526 (0.0007) [2023-12-27 20:32:56,575][106226] Updated weights for policy 0, policy_version 183536 (0.0007) [2023-12-27 20:32:56,634][106226] Updated weights for policy 0, policy_version 183546 (0.0008) [2023-12-27 20:32:56,744][106225] Updated weights for policy 1, policy_version 183875 (0.0010) [2023-12-27 20:32:56,800][106225] Updated weights for policy 1, policy_version 183885 (0.0010) [2023-12-27 20:32:56,855][106225] Updated weights for policy 1, policy_version 183895 (0.0010) [2023-12-27 20:32:57,330][106226] Updated weights for policy 0, policy_version 183556 (0.0008) [2023-12-27 20:32:57,390][106226] Updated weights for policy 0, policy_version 183566 (0.0010) [2023-12-27 20:32:57,439][106226] Updated weights for policy 0, policy_version 183576 (0.0010) [2023-12-27 20:32:57,525][106225] Updated weights for policy 1, policy_version 183905 (0.0007) [2023-12-27 20:32:57,588][106225] Updated weights for policy 1, policy_version 183915 (0.0008) [2023-12-27 20:32:57,645][106225] Updated weights for policy 1, policy_version 183925 (0.0008) [2023-12-27 20:32:57,698][106225] Updated weights for policy 1, policy_version 183935 (0.0008) [2023-12-27 20:32:58,121][106226] Updated weights for policy 0, policy_version 183586 (0.0009) [2023-12-27 20:32:58,180][106226] Updated weights for policy 0, policy_version 183596 (0.0008) [2023-12-27 20:32:58,241][106226] Updated weights for policy 0, policy_version 183606 (0.0009) [2023-12-27 20:32:58,291][106226] Updated weights for policy 0, policy_version 183616 (0.0008) [2023-12-27 20:32:58,409][106225] Updated weights for policy 1, policy_version 183945 (0.0007) [2023-12-27 20:32:58,479][106225] Updated weights for policy 1, policy_version 183955 (0.0008) [2023-12-27 20:32:58,544][106225] Updated weights for policy 1, policy_version 183965 (0.0008) [2023-12-27 20:32:59,140][106226] Updated weights for policy 0, policy_version 183626 (0.0008) [2023-12-27 20:32:59,202][106226] Updated weights for policy 0, policy_version 183636 (0.0008) [2023-12-27 20:32:59,271][106226] Updated weights for policy 0, policy_version 183646 (0.0008) [2023-12-27 20:32:59,345][106225] Updated weights for policy 1, policy_version 183975 (0.0007) [2023-12-27 20:32:59,420][106225] Updated weights for policy 1, policy_version 183985 (0.0008) [2023-12-27 20:32:59,478][106225] Updated weights for policy 1, policy_version 183995 (0.0008) [2023-12-27 20:33:00,055][106226] Updated weights for policy 0, policy_version 183656 (0.0007) [2023-12-27 20:33:00,118][106226] Updated weights for policy 0, policy_version 183666 (0.0005) [2023-12-27 20:33:00,144][106225] Updated weights for policy 1, policy_version 184005 (0.0007) [2023-12-27 20:33:00,174][106226] Updated weights for policy 0, policy_version 183676 (0.0005) [2023-12-27 20:33:00,197][106225] Updated weights for policy 1, policy_version 184015 (0.0008) [2023-12-27 20:33:00,256][106225] Updated weights for policy 1, policy_version 184025 (0.0008) [2023-12-27 20:33:00,841][106226] Updated weights for policy 0, policy_version 183686 (0.0007) [2023-12-27 20:33:00,897][106226] Updated weights for policy 0, policy_version 183696 (0.0009) [2023-12-27 20:33:00,911][106225] Updated weights for policy 1, policy_version 184035 (0.0006) [2023-12-27 20:33:00,945][106226] Updated weights for policy 0, policy_version 183706 (0.0006) [2023-12-27 20:33:00,960][106225] Updated weights for policy 1, policy_version 184045 (0.0006) [2023-12-27 20:33:01,014][106225] Updated weights for policy 1, policy_version 184055 (0.0008) [2023-12-27 20:33:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 94167040. Throughput: 0: 10010.8, 1: 9748.1. Samples: 94151428. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:01,175][105115] Avg episode reward: [(0, '-5.355'), (1, '-6.983')] [2023-12-27 20:33:01,730][106226] Updated weights for policy 0, policy_version 183716 (0.0008) [2023-12-27 20:33:01,780][106225] Updated weights for policy 1, policy_version 184065 (0.0008) [2023-12-27 20:33:01,790][106226] Updated weights for policy 0, policy_version 183726 (0.0007) [2023-12-27 20:33:01,832][106225] Updated weights for policy 1, policy_version 184075 (0.0008) [2023-12-27 20:33:01,844][106226] Updated weights for policy 0, policy_version 183736 (0.0007) [2023-12-27 20:33:01,880][106225] Updated weights for policy 1, policy_version 184085 (0.0008) [2023-12-27 20:33:01,939][106225] Updated weights for policy 1, policy_version 184095 (0.0008) [2023-12-27 20:33:02,589][106226] Updated weights for policy 0, policy_version 183746 (0.0007) [2023-12-27 20:33:02,655][106226] Updated weights for policy 0, policy_version 183756 (0.0009) [2023-12-27 20:33:02,696][106225] Updated weights for policy 1, policy_version 184105 (0.0007) [2023-12-27 20:33:02,712][106226] Updated weights for policy 0, policy_version 183766 (0.0007) [2023-12-27 20:33:02,755][106225] Updated weights for policy 1, policy_version 184115 (0.0006) [2023-12-27 20:33:02,777][106226] Updated weights for policy 0, policy_version 183776 (0.0008) [2023-12-27 20:33:02,809][106225] Updated weights for policy 1, policy_version 184125 (0.0005) [2023-12-27 20:33:03,417][106225] Updated weights for policy 1, policy_version 184135 (0.0007) [2023-12-27 20:33:03,477][106225] Updated weights for policy 1, policy_version 184145 (0.0008) [2023-12-27 20:33:03,507][106226] Updated weights for policy 0, policy_version 183786 (0.0005) [2023-12-27 20:33:03,535][106225] Updated weights for policy 1, policy_version 184155 (0.0009) [2023-12-27 20:33:03,559][106226] Updated weights for policy 0, policy_version 183796 (0.0008) [2023-12-27 20:33:03,617][106226] Updated weights for policy 0, policy_version 183806 (0.0008) [2023-12-27 20:33:04,191][106225] Updated weights for policy 1, policy_version 184165 (0.0005) [2023-12-27 20:33:04,259][106225] Updated weights for policy 1, policy_version 184175 (0.0006) [2023-12-27 20:33:04,318][106225] Updated weights for policy 1, policy_version 184185 (0.0008) [2023-12-27 20:33:04,398][106226] Updated weights for policy 0, policy_version 183816 (0.0006) [2023-12-27 20:33:04,457][106226] Updated weights for policy 0, policy_version 183826 (0.0008) [2023-12-27 20:33:04,514][106226] Updated weights for policy 0, policy_version 183836 (0.0008) [2023-12-27 20:33:04,971][106225] Updated weights for policy 1, policy_version 184195 (0.0010) [2023-12-27 20:33:05,023][106225] Updated weights for policy 1, policy_version 184205 (0.0010) [2023-12-27 20:33:05,070][106225] Updated weights for policy 1, policy_version 184215 (0.0010) [2023-12-27 20:33:05,230][106226] Updated weights for policy 0, policy_version 183846 (0.0006) [2023-12-27 20:33:05,293][106226] Updated weights for policy 0, policy_version 183856 (0.0005) [2023-12-27 20:33:05,354][106226] Updated weights for policy 0, policy_version 183866 (0.0005) [2023-12-27 20:33:05,707][106225] Updated weights for policy 1, policy_version 184225 (0.0010) [2023-12-27 20:33:05,753][106225] Updated weights for policy 1, policy_version 184235 (0.0010) [2023-12-27 20:33:05,798][106225] Updated weights for policy 1, policy_version 184245 (0.0010) [2023-12-27 20:33:05,850][106225] Updated weights for policy 1, policy_version 184255 (0.0010) [2023-12-27 20:33:06,036][106226] Updated weights for policy 0, policy_version 183876 (0.0009) [2023-12-27 20:33:06,112][106226] Updated weights for policy 0, policy_version 183886 (0.0009) [2023-12-27 20:33:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 94257152. Throughput: 0: 9940.8, 1: 9854.6. Samples: 94270108. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:06,175][105115] Avg episode reward: [(0, '-5.440'), (1, '-7.300')] [2023-12-27 20:33:06,178][106226] Updated weights for policy 0, policy_version 183896 (0.0007) [2023-12-27 20:33:06,575][106225] Updated weights for policy 1, policy_version 184265 (0.0009) [2023-12-27 20:33:06,634][106225] Updated weights for policy 1, policy_version 184275 (0.0006) [2023-12-27 20:33:06,698][106225] Updated weights for policy 1, policy_version 184285 (0.0006) [2023-12-27 20:33:06,939][106226] Updated weights for policy 0, policy_version 183906 (0.0006) [2023-12-27 20:33:06,989][106226] Updated weights for policy 0, policy_version 183916 (0.0007) [2023-12-27 20:33:07,035][106226] Updated weights for policy 0, policy_version 183926 (0.0008) [2023-12-27 20:33:07,086][106226] Updated weights for policy 0, policy_version 183936 (0.0008) [2023-12-27 20:33:07,352][106225] Updated weights for policy 1, policy_version 184295 (0.0009) [2023-12-27 20:33:07,417][106225] Updated weights for policy 1, policy_version 184305 (0.0011) [2023-12-27 20:33:07,479][106225] Updated weights for policy 1, policy_version 184315 (0.0010) [2023-12-27 20:33:07,847][106226] Updated weights for policy 0, policy_version 183946 (0.0008) [2023-12-27 20:33:07,893][106226] Updated weights for policy 0, policy_version 183956 (0.0007) [2023-12-27 20:33:07,948][106226] Updated weights for policy 0, policy_version 183966 (0.0007) [2023-12-27 20:33:08,133][106225] Updated weights for policy 1, policy_version 184325 (0.0009) [2023-12-27 20:33:08,194][106225] Updated weights for policy 1, policy_version 184335 (0.0008) [2023-12-27 20:33:08,255][106225] Updated weights for policy 1, policy_version 184345 (0.0010) [2023-12-27 20:33:08,760][106226] Updated weights for policy 0, policy_version 183976 (0.0009) [2023-12-27 20:33:08,813][106226] Updated weights for policy 0, policy_version 183986 (0.0007) [2023-12-27 20:33:08,876][106226] Updated weights for policy 0, policy_version 183996 (0.0008) [2023-12-27 20:33:08,885][106225] Updated weights for policy 1, policy_version 184355 (0.0010) [2023-12-27 20:33:08,935][106225] Updated weights for policy 1, policy_version 184365 (0.0010) [2023-12-27 20:33:08,991][106225] Updated weights for policy 1, policy_version 184375 (0.0010) [2023-12-27 20:33:09,652][106226] Updated weights for policy 0, policy_version 184006 (0.0008) [2023-12-27 20:33:09,691][106225] Updated weights for policy 1, policy_version 184385 (0.0010) [2023-12-27 20:33:09,700][106226] Updated weights for policy 0, policy_version 184016 (0.0008) [2023-12-27 20:33:09,754][106226] Updated weights for policy 0, policy_version 184026 (0.0006) [2023-12-27 20:33:09,755][106225] Updated weights for policy 1, policy_version 184395 (0.0008) [2023-12-27 20:33:09,824][106225] Updated weights for policy 1, policy_version 184405 (0.0008) [2023-12-27 20:33:09,890][106225] Updated weights for policy 1, policy_version 184415 (0.0009) [2023-12-27 20:33:10,479][106226] Updated weights for policy 0, policy_version 184036 (0.0006) [2023-12-27 20:33:10,538][106226] Updated weights for policy 0, policy_version 184046 (0.0005) [2023-12-27 20:33:10,548][106225] Updated weights for policy 1, policy_version 184425 (0.0008) [2023-12-27 20:33:10,592][106226] Updated weights for policy 0, policy_version 184056 (0.0007) [2023-12-27 20:33:10,601][106225] Updated weights for policy 1, policy_version 184435 (0.0006) [2023-12-27 20:33:10,662][106225] Updated weights for policy 1, policy_version 184445 (0.0008) [2023-12-27 20:33:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 94355456. Throughput: 0: 9884.2, 1: 9946.3. Samples: 94328708. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:11,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-6.747')] [2023-12-27 20:33:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000184448_47226880.pth... [2023-12-27 20:33:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000184064_47128576.pth... [2023-12-27 20:33:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000183296_46931968.pth [2023-12-27 20:33:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000182912_46833664.pth [2023-12-27 20:33:11,271][106226] Updated weights for policy 0, policy_version 184066 (0.0006) [2023-12-27 20:33:11,335][106226] Updated weights for policy 0, policy_version 184076 (0.0009) [2023-12-27 20:33:11,413][106226] Updated weights for policy 0, policy_version 184086 (0.0009) [2023-12-27 20:33:11,464][106225] Updated weights for policy 1, policy_version 184455 (0.0007) [2023-12-27 20:33:11,470][106226] Updated weights for policy 0, policy_version 184096 (0.0008) [2023-12-27 20:33:11,525][106225] Updated weights for policy 1, policy_version 184465 (0.0008) [2023-12-27 20:33:11,584][106225] Updated weights for policy 1, policy_version 184475 (0.0009) [2023-12-27 20:33:12,124][106226] Updated weights for policy 0, policy_version 184106 (0.0008) [2023-12-27 20:33:12,181][106226] Updated weights for policy 0, policy_version 184116 (0.0006) [2023-12-27 20:33:12,244][106226] Updated weights for policy 0, policy_version 184126 (0.0008) [2023-12-27 20:33:12,304][106225] Updated weights for policy 1, policy_version 184485 (0.0008) [2023-12-27 20:33:12,363][106225] Updated weights for policy 1, policy_version 184495 (0.0008) [2023-12-27 20:33:12,419][106225] Updated weights for policy 1, policy_version 184505 (0.0008) [2023-12-27 20:33:12,882][106226] Updated weights for policy 0, policy_version 184136 (0.0007) [2023-12-27 20:33:12,937][106226] Updated weights for policy 0, policy_version 184146 (0.0005) [2023-12-27 20:33:12,992][106226] Updated weights for policy 0, policy_version 184156 (0.0005) [2023-12-27 20:33:13,185][106225] Updated weights for policy 1, policy_version 184515 (0.0009) [2023-12-27 20:33:13,247][106225] Updated weights for policy 1, policy_version 184525 (0.0008) [2023-12-27 20:33:13,309][106225] Updated weights for policy 1, policy_version 184535 (0.0010) [2023-12-27 20:33:13,548][106226] Updated weights for policy 0, policy_version 184166 (0.0006) [2023-12-27 20:33:13,600][106226] Updated weights for policy 0, policy_version 184176 (0.0005) [2023-12-27 20:33:13,653][106226] Updated weights for policy 0, policy_version 184186 (0.0007) [2023-12-27 20:33:13,926][106225] Updated weights for policy 1, policy_version 184545 (0.0010) [2023-12-27 20:33:13,986][106225] Updated weights for policy 1, policy_version 184555 (0.0005) [2023-12-27 20:33:14,049][106225] Updated weights for policy 1, policy_version 184565 (0.0005) [2023-12-27 20:33:14,102][106225] Updated weights for policy 1, policy_version 184575 (0.0007) [2023-12-27 20:33:14,267][106226] Updated weights for policy 0, policy_version 184196 (0.0008) [2023-12-27 20:33:14,317][106226] Updated weights for policy 0, policy_version 184206 (0.0008) [2023-12-27 20:33:14,364][106226] Updated weights for policy 0, policy_version 184216 (0.0008) [2023-12-27 20:33:14,724][106225] Updated weights for policy 1, policy_version 184585 (0.0010) [2023-12-27 20:33:14,794][106225] Updated weights for policy 1, policy_version 184595 (0.0009) [2023-12-27 20:33:14,856][106225] Updated weights for policy 1, policy_version 184605 (0.0008) [2023-12-27 20:33:15,039][106226] Updated weights for policy 0, policy_version 184226 (0.0007) [2023-12-27 20:33:15,107][106226] Updated weights for policy 0, policy_version 184236 (0.0006) [2023-12-27 20:33:15,178][106226] Updated weights for policy 0, policy_version 184246 (0.0006) [2023-12-27 20:33:15,245][106226] Updated weights for policy 0, policy_version 184256 (0.0006) [2023-12-27 20:33:15,566][106225] Updated weights for policy 1, policy_version 184615 (0.0010) [2023-12-27 20:33:15,630][106225] Updated weights for policy 1, policy_version 184625 (0.0010) [2023-12-27 20:33:15,683][106225] Updated weights for policy 1, policy_version 184635 (0.0010) [2023-12-27 20:33:15,868][106226] Updated weights for policy 0, policy_version 184266 (0.0009) [2023-12-27 20:33:15,935][106226] Updated weights for policy 0, policy_version 184276 (0.0005) [2023-12-27 20:33:15,990][106226] Updated weights for policy 0, policy_version 184286 (0.0005) [2023-12-27 20:33:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 94461952. Throughput: 0: 9979.2, 1: 9849.7. Samples: 94449984. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:16,175][105115] Avg episode reward: [(0, '-5.183'), (1, '-6.635')] [2023-12-27 20:33:16,343][106225] Updated weights for policy 1, policy_version 184645 (0.0010) [2023-12-27 20:33:16,402][106225] Updated weights for policy 1, policy_version 184655 (0.0010) [2023-12-27 20:33:16,465][106225] Updated weights for policy 1, policy_version 184665 (0.0009) [2023-12-27 20:33:16,598][106226] Updated weights for policy 0, policy_version 184296 (0.0010) [2023-12-27 20:33:16,648][106226] Updated weights for policy 0, policy_version 184306 (0.0010) [2023-12-27 20:33:16,706][106226] Updated weights for policy 0, policy_version 184316 (0.0009) [2023-12-27 20:33:17,096][106225] Updated weights for policy 1, policy_version 184675 (0.0005) [2023-12-27 20:33:17,146][106225] Updated weights for policy 1, policy_version 184685 (0.0006) [2023-12-27 20:33:17,197][106225] Updated weights for policy 1, policy_version 184695 (0.0005) [2023-12-27 20:33:17,418][106226] Updated weights for policy 0, policy_version 184326 (0.0009) [2023-12-27 20:33:17,480][106226] Updated weights for policy 0, policy_version 184336 (0.0008) [2023-12-27 20:33:17,544][106226] Updated weights for policy 0, policy_version 184346 (0.0009) [2023-12-27 20:33:17,841][106225] Updated weights for policy 1, policy_version 184705 (0.0007) [2023-12-27 20:33:17,903][106225] Updated weights for policy 1, policy_version 184715 (0.0008) [2023-12-27 20:33:17,965][106225] Updated weights for policy 1, policy_version 184725 (0.0008) [2023-12-27 20:33:18,024][106225] Updated weights for policy 1, policy_version 184735 (0.0009) [2023-12-27 20:33:18,241][106226] Updated weights for policy 0, policy_version 184356 (0.0008) [2023-12-27 20:33:18,310][106226] Updated weights for policy 0, policy_version 184366 (0.0007) [2023-12-27 20:33:18,375][106226] Updated weights for policy 0, policy_version 184376 (0.0008) [2023-12-27 20:33:18,743][106225] Updated weights for policy 1, policy_version 184745 (0.0006) [2023-12-27 20:33:18,797][106225] Updated weights for policy 1, policy_version 184755 (0.0006) [2023-12-27 20:33:18,854][106225] Updated weights for policy 1, policy_version 184765 (0.0008) [2023-12-27 20:33:19,093][106226] Updated weights for policy 0, policy_version 184386 (0.0008) [2023-12-27 20:33:19,143][106226] Updated weights for policy 0, policy_version 184396 (0.0008) [2023-12-27 20:33:19,203][106226] Updated weights for policy 0, policy_version 184406 (0.0008) [2023-12-27 20:33:19,276][106226] Updated weights for policy 0, policy_version 184416 (0.0008) [2023-12-27 20:33:19,520][106225] Updated weights for policy 1, policy_version 184775 (0.0008) [2023-12-27 20:33:19,579][106225] Updated weights for policy 1, policy_version 184785 (0.0010) [2023-12-27 20:33:19,646][106225] Updated weights for policy 1, policy_version 184795 (0.0011) [2023-12-27 20:33:20,090][106226] Updated weights for policy 0, policy_version 184426 (0.0006) [2023-12-27 20:33:20,152][106226] Updated weights for policy 0, policy_version 184436 (0.0009) [2023-12-27 20:33:20,206][106226] Updated weights for policy 0, policy_version 184446 (0.0009) [2023-12-27 20:33:20,315][106225] Updated weights for policy 1, policy_version 184805 (0.0008) [2023-12-27 20:33:20,380][106225] Updated weights for policy 1, policy_version 184815 (0.0006) [2023-12-27 20:33:20,436][106225] Updated weights for policy 1, policy_version 184825 (0.0006) [2023-12-27 20:33:21,022][106226] Updated weights for policy 0, policy_version 184456 (0.0010) [2023-12-27 20:33:21,091][106226] Updated weights for policy 0, policy_version 184466 (0.0008) [2023-12-27 20:33:21,093][106225] Updated weights for policy 1, policy_version 184835 (0.0006) [2023-12-27 20:33:21,156][106225] Updated weights for policy 1, policy_version 184845 (0.0006) [2023-12-27 20:33:21,157][106226] Updated weights for policy 0, policy_version 184476 (0.0011) [2023-12-27 20:33:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 94552064. Throughput: 0: 9924.8, 1: 9908.9. Samples: 94569428. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:21,175][105115] Avg episode reward: [(0, '-5.740'), (1, '-7.158')] [2023-12-27 20:33:21,210][106225] Updated weights for policy 1, policy_version 184855 (0.0007) [2023-12-27 20:33:21,878][106226] Updated weights for policy 0, policy_version 184486 (0.0011) [2023-12-27 20:33:21,922][106225] Updated weights for policy 1, policy_version 184865 (0.0008) [2023-12-27 20:33:21,934][106226] Updated weights for policy 0, policy_version 184496 (0.0008) [2023-12-27 20:33:21,986][106225] Updated weights for policy 1, policy_version 184875 (0.0006) [2023-12-27 20:33:22,000][106226] Updated weights for policy 0, policy_version 184506 (0.0007) [2023-12-27 20:33:22,048][106225] Updated weights for policy 1, policy_version 184885 (0.0008) [2023-12-27 20:33:22,104][106225] Updated weights for policy 1, policy_version 184895 (0.0006) [2023-12-27 20:33:22,782][106225] Updated weights for policy 1, policy_version 184905 (0.0010) [2023-12-27 20:33:22,829][106226] Updated weights for policy 0, policy_version 184516 (0.0008) [2023-12-27 20:33:22,844][106225] Updated weights for policy 1, policy_version 184915 (0.0009) [2023-12-27 20:33:22,886][106226] Updated weights for policy 0, policy_version 184526 (0.0008) [2023-12-27 20:33:22,907][106225] Updated weights for policy 1, policy_version 184925 (0.0006) [2023-12-27 20:33:22,939][106226] Updated weights for policy 0, policy_version 184536 (0.0008) [2023-12-27 20:33:23,569][106225] Updated weights for policy 1, policy_version 184935 (0.0008) [2023-12-27 20:33:23,571][106226] Updated weights for policy 0, policy_version 184546 (0.0006) [2023-12-27 20:33:23,627][106225] Updated weights for policy 1, policy_version 184945 (0.0007) [2023-12-27 20:33:23,637][106226] Updated weights for policy 0, policy_version 184556 (0.0006) [2023-12-27 20:33:23,687][106225] Updated weights for policy 1, policy_version 184955 (0.0008) [2023-12-27 20:33:23,689][106226] Updated weights for policy 0, policy_version 184566 (0.0006) [2023-12-27 20:33:23,748][106226] Updated weights for policy 0, policy_version 184576 (0.0008) [2023-12-27 20:33:24,356][106225] Updated weights for policy 1, policy_version 184965 (0.0008) [2023-12-27 20:33:24,409][106225] Updated weights for policy 1, policy_version 184975 (0.0008) [2023-12-27 20:33:24,438][106226] Updated weights for policy 0, policy_version 184586 (0.0007) [2023-12-27 20:33:24,465][106225] Updated weights for policy 1, policy_version 184985 (0.0006) [2023-12-27 20:33:24,492][106226] Updated weights for policy 0, policy_version 184596 (0.0005) [2023-12-27 20:33:24,549][106226] Updated weights for policy 0, policy_version 184606 (0.0008) [2023-12-27 20:33:25,152][106226] Updated weights for policy 0, policy_version 184616 (0.0007) [2023-12-27 20:33:25,213][106226] Updated weights for policy 0, policy_version 184626 (0.0008) [2023-12-27 20:33:25,250][106225] Updated weights for policy 1, policy_version 184995 (0.0008) [2023-12-27 20:33:25,271][106226] Updated weights for policy 0, policy_version 184636 (0.0008) [2023-12-27 20:33:25,305][106225] Updated weights for policy 1, policy_version 185005 (0.0005) [2023-12-27 20:33:25,358][106225] Updated weights for policy 1, policy_version 185015 (0.0007) [2023-12-27 20:33:25,871][106226] Updated weights for policy 0, policy_version 184646 (0.0009) [2023-12-27 20:33:25,928][106226] Updated weights for policy 0, policy_version 184656 (0.0009) [2023-12-27 20:33:25,983][106226] Updated weights for policy 0, policy_version 184666 (0.0009) [2023-12-27 20:33:26,047][106225] Updated weights for policy 1, policy_version 185025 (0.0008) [2023-12-27 20:33:26,111][106225] Updated weights for policy 1, policy_version 185035 (0.0005) [2023-12-27 20:33:26,169][106225] Updated weights for policy 1, policy_version 185045 (0.0005) [2023-12-27 20:33:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 94658560. Throughput: 0: 9872.4, 1: 9925.0. Samples: 94627308. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:26,175][105115] Avg episode reward: [(0, '-5.400'), (1, '-6.680')] [2023-12-27 20:33:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000184672_47284224.pth... [2023-12-27 20:33:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000183520_46989312.pth [2023-12-27 20:33:26,217][106225] Updated weights for policy 1, policy_version 185055 (0.0007) [2023-12-27 20:33:26,222][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000185056_47382528.pth... [2023-12-27 20:33:26,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000183872_47079424.pth [2023-12-27 20:33:26,720][106226] Updated weights for policy 0, policy_version 184676 (0.0007) [2023-12-27 20:33:26,771][106226] Updated weights for policy 0, policy_version 184686 (0.0005) [2023-12-27 20:33:26,818][106226] Updated weights for policy 0, policy_version 184696 (0.0007) [2023-12-27 20:33:26,893][106225] Updated weights for policy 1, policy_version 185065 (0.0008) [2023-12-27 20:33:26,938][106225] Updated weights for policy 1, policy_version 185075 (0.0007) [2023-12-27 20:33:26,988][106225] Updated weights for policy 1, policy_version 185085 (0.0009) [2023-12-27 20:33:27,410][106226] Updated weights for policy 0, policy_version 184706 (0.0010) [2023-12-27 20:33:27,464][106226] Updated weights for policy 0, policy_version 184716 (0.0005) [2023-12-27 20:33:27,516][106226] Updated weights for policy 0, policy_version 184726 (0.0005) [2023-12-27 20:33:27,564][106226] Updated weights for policy 0, policy_version 184736 (0.0005) [2023-12-27 20:33:27,677][106225] Updated weights for policy 1, policy_version 185095 (0.0008) [2023-12-27 20:33:27,735][106225] Updated weights for policy 1, policy_version 185105 (0.0009) [2023-12-27 20:33:27,783][106225] Updated weights for policy 1, policy_version 185115 (0.0008) [2023-12-27 20:33:28,173][106226] Updated weights for policy 0, policy_version 184746 (0.0008) [2023-12-27 20:33:28,220][106226] Updated weights for policy 0, policy_version 184756 (0.0005) [2023-12-27 20:33:28,274][106226] Updated weights for policy 0, policy_version 184766 (0.0005) [2023-12-27 20:33:28,468][106225] Updated weights for policy 1, policy_version 185125 (0.0007) [2023-12-27 20:33:28,529][106225] Updated weights for policy 1, policy_version 185135 (0.0008) [2023-12-27 20:33:28,586][106225] Updated weights for policy 1, policy_version 185145 (0.0008) [2023-12-27 20:33:28,946][106226] Updated weights for policy 0, policy_version 184776 (0.0009) [2023-12-27 20:33:29,000][106226] Updated weights for policy 0, policy_version 184786 (0.0005) [2023-12-27 20:33:29,050][106226] Updated weights for policy 0, policy_version 184796 (0.0006) [2023-12-27 20:33:29,283][106225] Updated weights for policy 1, policy_version 185155 (0.0007) [2023-12-27 20:33:29,353][106225] Updated weights for policy 1, policy_version 185165 (0.0007) [2023-12-27 20:33:29,414][106225] Updated weights for policy 1, policy_version 185175 (0.0008) [2023-12-27 20:33:29,735][106226] Updated weights for policy 0, policy_version 184806 (0.0008) [2023-12-27 20:33:29,800][106226] Updated weights for policy 0, policy_version 184816 (0.0007) [2023-12-27 20:33:29,866][106226] Updated weights for policy 0, policy_version 184826 (0.0009) [2023-12-27 20:33:30,118][106225] Updated weights for policy 1, policy_version 185185 (0.0008) [2023-12-27 20:33:30,183][106225] Updated weights for policy 1, policy_version 185195 (0.0008) [2023-12-27 20:33:30,245][106225] Updated weights for policy 1, policy_version 185205 (0.0009) [2023-12-27 20:33:30,311][106225] Updated weights for policy 1, policy_version 185215 (0.0007) [2023-12-27 20:33:30,514][106226] Updated weights for policy 0, policy_version 184836 (0.0006) [2023-12-27 20:33:30,568][106226] Updated weights for policy 0, policy_version 184846 (0.0005) [2023-12-27 20:33:30,626][106226] Updated weights for policy 0, policy_version 184856 (0.0005) [2023-12-27 20:33:31,012][106225] Updated weights for policy 1, policy_version 185225 (0.0007) [2023-12-27 20:33:31,075][106225] Updated weights for policy 1, policy_version 185235 (0.0007) [2023-12-27 20:33:31,133][106225] Updated weights for policy 1, policy_version 185245 (0.0008) [2023-12-27 20:33:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 94765056. Throughput: 0: 9969.5, 1: 9983.7. Samples: 94751628. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:31,175][105115] Avg episode reward: [(0, '-5.097'), (1, '-6.369')] [2023-12-27 20:33:31,275][106226] Updated weights for policy 0, policy_version 184866 (0.0009) [2023-12-27 20:33:31,330][106226] Updated weights for policy 0, policy_version 184876 (0.0007) [2023-12-27 20:33:31,398][106226] Updated weights for policy 0, policy_version 184886 (0.0009) [2023-12-27 20:33:31,467][106226] Updated weights for policy 0, policy_version 184896 (0.0008) [2023-12-27 20:33:31,918][106225] Updated weights for policy 1, policy_version 185255 (0.0009) [2023-12-27 20:33:31,973][106225] Updated weights for policy 1, policy_version 185265 (0.0009) [2023-12-27 20:33:32,032][106225] Updated weights for policy 1, policy_version 185275 (0.0009) [2023-12-27 20:33:32,158][106226] Updated weights for policy 0, policy_version 184906 (0.0008) [2023-12-27 20:33:32,215][106226] Updated weights for policy 0, policy_version 184916 (0.0006) [2023-12-27 20:33:32,274][106226] Updated weights for policy 0, policy_version 184926 (0.0006) [2023-12-27 20:33:32,850][106226] Updated weights for policy 0, policy_version 184936 (0.0008) [2023-12-27 20:33:32,906][106225] Updated weights for policy 1, policy_version 185285 (0.0007) [2023-12-27 20:33:32,908][106226] Updated weights for policy 0, policy_version 184946 (0.0007) [2023-12-27 20:33:32,957][106225] Updated weights for policy 1, policy_version 185295 (0.0006) [2023-12-27 20:33:32,963][106226] Updated weights for policy 0, policy_version 184956 (0.0006) [2023-12-27 20:33:33,006][106225] Updated weights for policy 1, policy_version 185305 (0.0006) [2023-12-27 20:33:33,682][106226] Updated weights for policy 0, policy_version 184966 (0.0009) [2023-12-27 20:33:33,741][106226] Updated weights for policy 0, policy_version 184976 (0.0010) [2023-12-27 20:33:33,761][106225] Updated weights for policy 1, policy_version 185315 (0.0008) [2023-12-27 20:33:33,805][106226] Updated weights for policy 0, policy_version 184986 (0.0011) [2023-12-27 20:33:33,812][106225] Updated weights for policy 1, policy_version 185325 (0.0006) [2023-12-27 20:33:33,867][106225] Updated weights for policy 1, policy_version 185335 (0.0007) [2023-12-27 20:33:34,451][106226] Updated weights for policy 0, policy_version 184996 (0.0011) [2023-12-27 20:33:34,508][106226] Updated weights for policy 0, policy_version 185006 (0.0011) [2023-12-27 20:33:34,574][106226] Updated weights for policy 0, policy_version 185016 (0.0011) [2023-12-27 20:33:34,591][106225] Updated weights for policy 1, policy_version 185345 (0.0007) [2023-12-27 20:33:34,658][106225] Updated weights for policy 1, policy_version 185355 (0.0007) [2023-12-27 20:33:34,722][106225] Updated weights for policy 1, policy_version 185365 (0.0008) [2023-12-27 20:33:34,786][106225] Updated weights for policy 1, policy_version 185375 (0.0007) [2023-12-27 20:33:35,243][106226] Updated weights for policy 0, policy_version 185026 (0.0009) [2023-12-27 20:33:35,303][106226] Updated weights for policy 0, policy_version 185036 (0.0009) [2023-12-27 20:33:35,362][106226] Updated weights for policy 0, policy_version 185046 (0.0010) [2023-12-27 20:33:35,422][106226] Updated weights for policy 0, policy_version 185056 (0.0010) [2023-12-27 20:33:35,489][106225] Updated weights for policy 1, policy_version 185385 (0.0008) [2023-12-27 20:33:35,550][106225] Updated weights for policy 1, policy_version 185395 (0.0006) [2023-12-27 20:33:35,616][106225] Updated weights for policy 1, policy_version 185405 (0.0007) [2023-12-27 20:33:36,086][106226] Updated weights for policy 0, policy_version 185066 (0.0010) [2023-12-27 20:33:36,153][106226] Updated weights for policy 0, policy_version 185076 (0.0007) [2023-12-27 20:33:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 94855168. Throughput: 0: 9967.4, 1: 9920.2. Samples: 94870476. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:36,175][105115] Avg episode reward: [(0, '-5.497'), (1, '-6.685')] [2023-12-27 20:33:36,217][106226] Updated weights for policy 0, policy_version 185086 (0.0009) [2023-12-27 20:33:36,318][106225] Updated weights for policy 1, policy_version 185415 (0.0008) [2023-12-27 20:33:36,384][106225] Updated weights for policy 1, policy_version 185425 (0.0009) [2023-12-27 20:33:36,447][106225] Updated weights for policy 1, policy_version 185435 (0.0008) [2023-12-27 20:33:36,864][106226] Updated weights for policy 0, policy_version 185096 (0.0007) [2023-12-27 20:33:36,928][106226] Updated weights for policy 0, policy_version 185106 (0.0007) [2023-12-27 20:33:36,988][106226] Updated weights for policy 0, policy_version 185116 (0.0011) [2023-12-27 20:33:37,130][106225] Updated weights for policy 1, policy_version 185445 (0.0008) [2023-12-27 20:33:37,195][106225] Updated weights for policy 1, policy_version 185455 (0.0010) [2023-12-27 20:33:37,246][106225] Updated weights for policy 1, policy_version 185465 (0.0010) [2023-12-27 20:33:37,630][106226] Updated weights for policy 0, policy_version 185126 (0.0011) [2023-12-27 20:33:37,695][106226] Updated weights for policy 0, policy_version 185136 (0.0010) [2023-12-27 20:33:37,750][106226] Updated weights for policy 0, policy_version 185146 (0.0010) [2023-12-27 20:33:37,860][106225] Updated weights for policy 1, policy_version 185475 (0.0010) [2023-12-27 20:33:37,921][106225] Updated weights for policy 1, policy_version 185485 (0.0008) [2023-12-27 20:33:37,977][106225] Updated weights for policy 1, policy_version 185495 (0.0007) [2023-12-27 20:33:38,457][106226] Updated weights for policy 0, policy_version 185156 (0.0011) [2023-12-27 20:33:38,517][106226] Updated weights for policy 0, policy_version 185166 (0.0009) [2023-12-27 20:33:38,570][106226] Updated weights for policy 0, policy_version 185176 (0.0008) [2023-12-27 20:33:38,701][106225] Updated weights for policy 1, policy_version 185505 (0.0008) [2023-12-27 20:33:38,770][106225] Updated weights for policy 1, policy_version 185515 (0.0007) [2023-12-27 20:33:38,838][106225] Updated weights for policy 1, policy_version 185525 (0.0009) [2023-12-27 20:33:38,904][106225] Updated weights for policy 1, policy_version 185535 (0.0009) [2023-12-27 20:33:39,230][106226] Updated weights for policy 0, policy_version 185186 (0.0008) [2023-12-27 20:33:39,297][106226] Updated weights for policy 0, policy_version 185196 (0.0008) [2023-12-27 20:33:39,362][106226] Updated weights for policy 0, policy_version 185206 (0.0008) [2023-12-27 20:33:39,435][106226] Updated weights for policy 0, policy_version 185216 (0.0008) [2023-12-27 20:33:39,579][106225] Updated weights for policy 1, policy_version 185545 (0.0008) [2023-12-27 20:33:39,641][106225] Updated weights for policy 1, policy_version 185555 (0.0008) [2023-12-27 20:33:39,696][106225] Updated weights for policy 1, policy_version 185565 (0.0009) [2023-12-27 20:33:40,119][106226] Updated weights for policy 0, policy_version 185226 (0.0009) [2023-12-27 20:33:40,179][106226] Updated weights for policy 0, policy_version 185236 (0.0009) [2023-12-27 20:33:40,240][106226] Updated weights for policy 0, policy_version 185246 (0.0009) [2023-12-27 20:33:40,449][106225] Updated weights for policy 1, policy_version 185575 (0.0009) [2023-12-27 20:33:40,514][106225] Updated weights for policy 1, policy_version 185585 (0.0009) [2023-12-27 20:33:40,569][106225] Updated weights for policy 1, policy_version 185595 (0.0008) [2023-12-27 20:33:40,977][106226] Updated weights for policy 0, policy_version 185256 (0.0010) [2023-12-27 20:33:41,035][106226] Updated weights for policy 0, policy_version 185266 (0.0010) [2023-12-27 20:33:41,105][106226] Updated weights for policy 0, policy_version 185276 (0.0007) [2023-12-27 20:33:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 94961664. Throughput: 0: 10012.4, 1: 9954.0. Samples: 94931432. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:41,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-6.851')] [2023-12-27 20:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000185600_47521792.pth... [2023-12-27 20:33:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000185280_47439872.pth... [2023-12-27 20:33:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000184448_47226880.pth [2023-12-27 20:33:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000184064_47128576.pth [2023-12-27 20:33:41,186][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000185600_47521792.pth [2023-12-27 20:33:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000185280_47439872.pth [2023-12-27 20:33:41,308][106225] Updated weights for policy 1, policy_version 185605 (0.0008) [2023-12-27 20:33:41,373][106225] Updated weights for policy 1, policy_version 185615 (0.0008) [2023-12-27 20:33:41,436][106225] Updated weights for policy 1, policy_version 185625 (0.0009) [2023-12-27 20:33:41,852][106226] Updated weights for policy 0, policy_version 185286 (0.0008) [2023-12-27 20:33:41,921][106226] Updated weights for policy 0, policy_version 185296 (0.0006) [2023-12-27 20:33:41,988][106226] Updated weights for policy 0, policy_version 185306 (0.0010) [2023-12-27 20:33:42,207][106225] Updated weights for policy 1, policy_version 185635 (0.0008) [2023-12-27 20:33:42,263][106225] Updated weights for policy 1, policy_version 185645 (0.0009) [2023-12-27 20:33:42,328][106225] Updated weights for policy 1, policy_version 185655 (0.0008) [2023-12-27 20:33:42,595][106226] Updated weights for policy 0, policy_version 185316 (0.0009) [2023-12-27 20:33:42,653][106226] Updated weights for policy 0, policy_version 185326 (0.0011) [2023-12-27 20:33:42,713][106226] Updated weights for policy 0, policy_version 185336 (0.0010) [2023-12-27 20:33:43,067][106225] Updated weights for policy 1, policy_version 185665 (0.0006) [2023-12-27 20:33:43,132][106225] Updated weights for policy 1, policy_version 185675 (0.0009) [2023-12-27 20:33:43,192][106225] Updated weights for policy 1, policy_version 185685 (0.0007) [2023-12-27 20:33:43,252][106225] Updated weights for policy 1, policy_version 185695 (0.0009) [2023-12-27 20:33:43,323][106226] Updated weights for policy 0, policy_version 185346 (0.0010) [2023-12-27 20:33:43,383][106226] Updated weights for policy 0, policy_version 185356 (0.0010) [2023-12-27 20:33:43,451][106226] Updated weights for policy 0, policy_version 185366 (0.0010) [2023-12-27 20:33:43,517][106226] Updated weights for policy 0, policy_version 185376 (0.0006) [2023-12-27 20:33:43,917][106225] Updated weights for policy 1, policy_version 185705 (0.0008) [2023-12-27 20:33:43,974][106225] Updated weights for policy 1, policy_version 185715 (0.0007) [2023-12-27 20:33:44,024][106225] Updated weights for policy 1, policy_version 185725 (0.0007) [2023-12-27 20:33:44,193][106226] Updated weights for policy 0, policy_version 185386 (0.0008) [2023-12-27 20:33:44,260][106226] Updated weights for policy 0, policy_version 185396 (0.0007) [2023-12-27 20:33:44,317][106226] Updated weights for policy 0, policy_version 185406 (0.0007) [2023-12-27 20:33:44,685][106225] Updated weights for policy 1, policy_version 185735 (0.0006) [2023-12-27 20:33:44,733][106225] Updated weights for policy 1, policy_version 185745 (0.0005) [2023-12-27 20:33:44,793][106225] Updated weights for policy 1, policy_version 185755 (0.0010) [2023-12-27 20:33:45,070][106226] Updated weights for policy 0, policy_version 185416 (0.0008) [2023-12-27 20:33:45,131][106226] Updated weights for policy 0, policy_version 185426 (0.0007) [2023-12-27 20:33:45,194][106226] Updated weights for policy 0, policy_version 185436 (0.0008) [2023-12-27 20:33:45,528][106225] Updated weights for policy 1, policy_version 185765 (0.0009) [2023-12-27 20:33:45,592][106225] Updated weights for policy 1, policy_version 185775 (0.0006) [2023-12-27 20:33:45,652][106225] Updated weights for policy 1, policy_version 185785 (0.0005) [2023-12-27 20:33:45,966][106226] Updated weights for policy 0, policy_version 185446 (0.0008) [2023-12-27 20:33:46,026][106226] Updated weights for policy 0, policy_version 185456 (0.0008) [2023-12-27 20:33:46,080][106226] Updated weights for policy 0, policy_version 185466 (0.0009) [2023-12-27 20:33:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 95059968. Throughput: 0: 10005.8, 1: 9922.3. Samples: 95048192. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:46,175][105115] Avg episode reward: [(0, '-5.222'), (1, '-7.184')] [2023-12-27 20:33:46,201][106225] Updated weights for policy 1, policy_version 185795 (0.0007) [2023-12-27 20:33:46,264][106225] Updated weights for policy 1, policy_version 185805 (0.0009) [2023-12-27 20:33:46,326][106225] Updated weights for policy 1, policy_version 185815 (0.0008) [2023-12-27 20:33:46,715][106226] Updated weights for policy 0, policy_version 185476 (0.0009) [2023-12-27 20:33:46,773][106226] Updated weights for policy 0, policy_version 185486 (0.0008) [2023-12-27 20:33:46,828][106226] Updated weights for policy 0, policy_version 185496 (0.0008) [2023-12-27 20:33:47,094][106225] Updated weights for policy 1, policy_version 185825 (0.0009) [2023-12-27 20:33:47,150][106225] Updated weights for policy 1, policy_version 185835 (0.0008) [2023-12-27 20:33:47,215][106225] Updated weights for policy 1, policy_version 185845 (0.0008) [2023-12-27 20:33:47,274][106225] Updated weights for policy 1, policy_version 185855 (0.0008) [2023-12-27 20:33:47,535][106226] Updated weights for policy 0, policy_version 185506 (0.0007) [2023-12-27 20:33:47,596][106226] Updated weights for policy 0, policy_version 185516 (0.0007) [2023-12-27 20:33:47,655][106226] Updated weights for policy 0, policy_version 185526 (0.0008) [2023-12-27 20:33:47,716][106226] Updated weights for policy 0, policy_version 185536 (0.0008) [2023-12-27 20:33:47,939][106225] Updated weights for policy 1, policy_version 185865 (0.0008) [2023-12-27 20:33:48,008][106225] Updated weights for policy 1, policy_version 185875 (0.0009) [2023-12-27 20:33:48,072][106225] Updated weights for policy 1, policy_version 185885 (0.0008) [2023-12-27 20:33:48,285][106226] Updated weights for policy 0, policy_version 185546 (0.0006) [2023-12-27 20:33:48,358][106226] Updated weights for policy 0, policy_version 185556 (0.0008) [2023-12-27 20:33:48,425][106226] Updated weights for policy 0, policy_version 185566 (0.0008) [2023-12-27 20:33:48,846][106225] Updated weights for policy 1, policy_version 185895 (0.0009) [2023-12-27 20:33:48,911][106225] Updated weights for policy 1, policy_version 185905 (0.0010) [2023-12-27 20:33:48,968][106225] Updated weights for policy 1, policy_version 185915 (0.0010) [2023-12-27 20:33:49,121][106226] Updated weights for policy 0, policy_version 185576 (0.0008) [2023-12-27 20:33:49,175][106226] Updated weights for policy 0, policy_version 185586 (0.0008) [2023-12-27 20:33:49,230][106226] Updated weights for policy 0, policy_version 185596 (0.0008) [2023-12-27 20:33:49,656][106225] Updated weights for policy 1, policy_version 185925 (0.0010) [2023-12-27 20:33:49,717][106225] Updated weights for policy 1, policy_version 185935 (0.0006) [2023-12-27 20:33:49,772][106225] Updated weights for policy 1, policy_version 185945 (0.0005) [2023-12-27 20:33:50,072][106226] Updated weights for policy 0, policy_version 185606 (0.0008) [2023-12-27 20:33:50,135][106226] Updated weights for policy 0, policy_version 185616 (0.0008) [2023-12-27 20:33:50,197][106226] Updated weights for policy 0, policy_version 185626 (0.0008) [2023-12-27 20:33:50,442][106225] Updated weights for policy 1, policy_version 185955 (0.0006) [2023-12-27 20:33:50,495][106225] Updated weights for policy 1, policy_version 185965 (0.0007) [2023-12-27 20:33:50,547][106225] Updated weights for policy 1, policy_version 185975 (0.0007) [2023-12-27 20:33:50,933][106226] Updated weights for policy 0, policy_version 185636 (0.0009) [2023-12-27 20:33:50,992][106226] Updated weights for policy 0, policy_version 185646 (0.0011) [2023-12-27 20:33:51,054][106226] Updated weights for policy 0, policy_version 185656 (0.0010) [2023-12-27 20:33:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 95158272. Throughput: 0: 10029.7, 1: 9873.9. Samples: 95165772. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:51,175][105115] Avg episode reward: [(0, '-5.110'), (1, '-7.005')] [2023-12-27 20:33:51,214][106225] Updated weights for policy 1, policy_version 185985 (0.0009) [2023-12-27 20:33:51,276][106225] Updated weights for policy 1, policy_version 185995 (0.0007) [2023-12-27 20:33:51,343][106225] Updated weights for policy 1, policy_version 186005 (0.0009) [2023-12-27 20:33:51,416][106225] Updated weights for policy 1, policy_version 186015 (0.0009) [2023-12-27 20:33:51,844][106226] Updated weights for policy 0, policy_version 185666 (0.0010) [2023-12-27 20:33:51,911][106226] Updated weights for policy 0, policy_version 185676 (0.0006) [2023-12-27 20:33:51,974][106226] Updated weights for policy 0, policy_version 185686 (0.0008) [2023-12-27 20:33:52,033][106226] Updated weights for policy 0, policy_version 185696 (0.0008) [2023-12-27 20:33:52,133][106225] Updated weights for policy 1, policy_version 186025 (0.0008) [2023-12-27 20:33:52,196][106225] Updated weights for policy 1, policy_version 186035 (0.0009) [2023-12-27 20:33:52,247][106225] Updated weights for policy 1, policy_version 186045 (0.0008) [2023-12-27 20:33:52,740][106226] Updated weights for policy 0, policy_version 185706 (0.0008) [2023-12-27 20:33:52,798][106226] Updated weights for policy 0, policy_version 185716 (0.0007) [2023-12-27 20:33:52,864][106226] Updated weights for policy 0, policy_version 185726 (0.0009) [2023-12-27 20:33:52,968][106225] Updated weights for policy 1, policy_version 186055 (0.0007) [2023-12-27 20:33:53,022][106225] Updated weights for policy 1, policy_version 186065 (0.0008) [2023-12-27 20:33:53,076][106225] Updated weights for policy 1, policy_version 186075 (0.0009) [2023-12-27 20:33:53,528][106226] Updated weights for policy 0, policy_version 185736 (0.0008) [2023-12-27 20:33:53,580][106226] Updated weights for policy 0, policy_version 185746 (0.0008) [2023-12-27 20:33:53,625][106226] Updated weights for policy 0, policy_version 185756 (0.0008) [2023-12-27 20:33:53,795][106225] Updated weights for policy 1, policy_version 186085 (0.0009) [2023-12-27 20:33:53,852][106225] Updated weights for policy 1, policy_version 186095 (0.0010) [2023-12-27 20:33:53,907][106225] Updated weights for policy 1, policy_version 186105 (0.0010) [2023-12-27 20:33:54,230][106226] Updated weights for policy 0, policy_version 185766 (0.0009) [2023-12-27 20:33:54,281][106226] Updated weights for policy 0, policy_version 185776 (0.0008) [2023-12-27 20:33:54,347][106226] Updated weights for policy 0, policy_version 185786 (0.0008) [2023-12-27 20:33:54,626][106225] Updated weights for policy 1, policy_version 186115 (0.0010) [2023-12-27 20:33:54,696][106225] Updated weights for policy 1, policy_version 186125 (0.0009) [2023-12-27 20:33:54,752][106225] Updated weights for policy 1, policy_version 186135 (0.0007) [2023-12-27 20:33:54,976][106226] Updated weights for policy 0, policy_version 185796 (0.0008) [2023-12-27 20:33:55,034][106226] Updated weights for policy 0, policy_version 185806 (0.0010) [2023-12-27 20:33:55,091][106226] Updated weights for policy 0, policy_version 185816 (0.0010) [2023-12-27 20:33:55,420][106225] Updated weights for policy 1, policy_version 186146 (0.0009) [2023-12-27 20:33:55,474][106225] Updated weights for policy 1, policy_version 186156 (0.0009) [2023-12-27 20:33:55,533][106225] Updated weights for policy 1, policy_version 186166 (0.0009) [2023-12-27 20:33:55,590][106225] Updated weights for policy 1, policy_version 186176 (0.0008) [2023-12-27 20:33:55,805][106226] Updated weights for policy 0, policy_version 185826 (0.0009) [2023-12-27 20:33:55,855][106226] Updated weights for policy 0, policy_version 185836 (0.0008) [2023-12-27 20:33:55,916][106226] Updated weights for policy 0, policy_version 185846 (0.0008) [2023-12-27 20:33:55,964][106226] Updated weights for policy 0, policy_version 185856 (0.0008) [2023-12-27 20:33:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 95256576. Throughput: 0: 10086.2, 1: 9851.9. Samples: 95225924. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:33:56,175][105115] Avg episode reward: [(0, '-5.786'), (1, '-7.036')] [2023-12-27 20:33:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000185856_47587328.pth... [2023-12-27 20:33:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000186176_47669248.pth... [2023-12-27 20:33:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000184672_47284224.pth [2023-12-27 20:33:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000185056_47382528.pth [2023-12-27 20:33:56,299][106225] Updated weights for policy 1, policy_version 186186 (0.0008) [2023-12-27 20:33:56,353][106225] Updated weights for policy 1, policy_version 186196 (0.0008) [2023-12-27 20:33:56,421][106225] Updated weights for policy 1, policy_version 186206 (0.0009) [2023-12-27 20:33:56,698][106226] Updated weights for policy 0, policy_version 185866 (0.0008) [2023-12-27 20:33:56,747][106226] Updated weights for policy 0, policy_version 185876 (0.0008) [2023-12-27 20:33:56,794][106226] Updated weights for policy 0, policy_version 185886 (0.0008) [2023-12-27 20:33:57,141][106225] Updated weights for policy 1, policy_version 186216 (0.0006) [2023-12-27 20:33:57,189][106225] Updated weights for policy 1, policy_version 186226 (0.0005) [2023-12-27 20:33:57,235][106225] Updated weights for policy 1, policy_version 186236 (0.0005) [2023-12-27 20:33:57,509][106226] Updated weights for policy 0, policy_version 185896 (0.0006) [2023-12-27 20:33:57,560][106226] Updated weights for policy 0, policy_version 185906 (0.0007) [2023-12-27 20:33:57,610][106226] Updated weights for policy 0, policy_version 185916 (0.0005) [2023-12-27 20:33:57,891][106225] Updated weights for policy 1, policy_version 186246 (0.0008) [2023-12-27 20:33:57,939][106225] Updated weights for policy 1, policy_version 186256 (0.0008) [2023-12-27 20:33:57,992][106225] Updated weights for policy 1, policy_version 186266 (0.0009) [2023-12-27 20:33:58,158][106226] Updated weights for policy 0, policy_version 185926 (0.0007) [2023-12-27 20:33:58,216][106226] Updated weights for policy 0, policy_version 185936 (0.0008) [2023-12-27 20:33:58,277][106226] Updated weights for policy 0, policy_version 185946 (0.0008) [2023-12-27 20:33:58,739][106225] Updated weights for policy 1, policy_version 186276 (0.0008) [2023-12-27 20:33:58,804][106225] Updated weights for policy 1, policy_version 186286 (0.0008) [2023-12-27 20:33:58,874][106225] Updated weights for policy 1, policy_version 186296 (0.0008) [2023-12-27 20:33:59,110][106226] Updated weights for policy 0, policy_version 185956 (0.0008) [2023-12-27 20:33:59,169][106226] Updated weights for policy 0, policy_version 185966 (0.0006) [2023-12-27 20:33:59,229][106226] Updated weights for policy 0, policy_version 185976 (0.0008) [2023-12-27 20:33:59,700][106225] Updated weights for policy 1, policy_version 186306 (0.0006) [2023-12-27 20:33:59,769][106225] Updated weights for policy 1, policy_version 186316 (0.0009) [2023-12-27 20:33:59,826][106226] Updated weights for policy 0, policy_version 185986 (0.0008) [2023-12-27 20:33:59,835][106225] Updated weights for policy 1, policy_version 186326 (0.0008) [2023-12-27 20:33:59,889][106226] Updated weights for policy 0, policy_version 185996 (0.0009) [2023-12-27 20:33:59,895][106225] Updated weights for policy 1, policy_version 186336 (0.0008) [2023-12-27 20:33:59,957][106226] Updated weights for policy 0, policy_version 186006 (0.0007) [2023-12-27 20:34:00,023][106226] Updated weights for policy 0, policy_version 186016 (0.0011) [2023-12-27 20:34:00,611][106225] Updated weights for policy 1, policy_version 186346 (0.0006) [2023-12-27 20:34:00,656][106225] Updated weights for policy 1, policy_version 186356 (0.0005) [2023-12-27 20:34:00,714][106225] Updated weights for policy 1, policy_version 186366 (0.0005) [2023-12-27 20:34:00,768][106226] Updated weights for policy 0, policy_version 186026 (0.0011) [2023-12-27 20:34:00,831][106226] Updated weights for policy 0, policy_version 186036 (0.0010) [2023-12-27 20:34:00,887][106226] Updated weights for policy 0, policy_version 186046 (0.0010) [2023-12-27 20:34:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 95354880. Throughput: 0: 10053.2, 1: 9830.7. Samples: 95344764. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 20:34:01,175][105115] Avg episode reward: [(0, '-5.713'), (1, '-6.911')] [2023-12-27 20:34:01,425][106225] Updated weights for policy 1, policy_version 186376 (0.0008) [2023-12-27 20:34:01,486][106225] Updated weights for policy 1, policy_version 186386 (0.0008) [2023-12-27 20:34:01,554][106225] Updated weights for policy 1, policy_version 186396 (0.0009) [2023-12-27 20:34:01,575][106226] Updated weights for policy 0, policy_version 186056 (0.0006) [2023-12-27 20:34:01,639][106226] Updated weights for policy 0, policy_version 186066 (0.0006) [2023-12-27 20:34:01,713][106226] Updated weights for policy 0, policy_version 186076 (0.0007) [2023-12-27 20:34:02,267][106225] Updated weights for policy 1, policy_version 186406 (0.0008) [2023-12-27 20:34:02,326][106225] Updated weights for policy 1, policy_version 186416 (0.0006) [2023-12-27 20:34:02,390][106225] Updated weights for policy 1, policy_version 186426 (0.0007) [2023-12-27 20:34:02,445][106226] Updated weights for policy 0, policy_version 186086 (0.0008) [2023-12-27 20:34:02,513][106226] Updated weights for policy 0, policy_version 186096 (0.0007) [2023-12-27 20:34:02,585][106226] Updated weights for policy 0, policy_version 186106 (0.0006) [2023-12-27 20:34:03,058][106225] Updated weights for policy 1, policy_version 186436 (0.0007) [2023-12-27 20:34:03,109][106225] Updated weights for policy 1, policy_version 186446 (0.0005) [2023-12-27 20:34:03,162][106225] Updated weights for policy 1, policy_version 186456 (0.0005) [2023-12-27 20:34:03,269][106226] Updated weights for policy 0, policy_version 186116 (0.0009) [2023-12-27 20:34:03,313][106226] Updated weights for policy 0, policy_version 186126 (0.0009) [2023-12-27 20:34:03,356][106226] Updated weights for policy 0, policy_version 186136 (0.0008) [2023-12-27 20:34:03,708][106225] Updated weights for policy 1, policy_version 186466 (0.0008) [2023-12-27 20:34:03,773][106225] Updated weights for policy 1, policy_version 186476 (0.0009) [2023-12-27 20:34:03,832][106225] Updated weights for policy 1, policy_version 186486 (0.0008) [2023-12-27 20:34:03,903][106225] Updated weights for policy 1, policy_version 186496 (0.0009) [2023-12-27 20:34:03,972][106226] Updated weights for policy 0, policy_version 186146 (0.0009) [2023-12-27 20:34:04,034][106226] Updated weights for policy 0, policy_version 186156 (0.0011) [2023-12-27 20:34:04,096][106226] Updated weights for policy 0, policy_version 186166 (0.0011) [2023-12-27 20:34:04,161][106226] Updated weights for policy 0, policy_version 186176 (0.0011) [2023-12-27 20:34:04,633][106225] Updated weights for policy 1, policy_version 186506 (0.0007) [2023-12-27 20:34:04,683][106225] Updated weights for policy 1, policy_version 186516 (0.0008) [2023-12-27 20:34:04,732][106225] Updated weights for policy 1, policy_version 186526 (0.0007) [2023-12-27 20:34:04,865][106226] Updated weights for policy 0, policy_version 186186 (0.0011) [2023-12-27 20:34:04,928][106226] Updated weights for policy 0, policy_version 186196 (0.0010) [2023-12-27 20:34:04,984][106226] Updated weights for policy 0, policy_version 186206 (0.0011) [2023-12-27 20:34:05,498][106225] Updated weights for policy 1, policy_version 186536 (0.0008) [2023-12-27 20:34:05,552][106225] Updated weights for policy 1, policy_version 186546 (0.0008) [2023-12-27 20:34:05,601][106225] Updated weights for policy 1, policy_version 186556 (0.0006) [2023-12-27 20:34:05,685][106226] Updated weights for policy 0, policy_version 186216 (0.0010) [2023-12-27 20:34:05,738][106226] Updated weights for policy 0, policy_version 186226 (0.0010) [2023-12-27 20:34:05,788][106226] Updated weights for policy 0, policy_version 186236 (0.0010) [2023-12-27 20:34:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 95453184. Throughput: 0: 10084.9, 1: 9793.0. Samples: 95463932. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:06,175][105115] Avg episode reward: [(0, '-5.300'), (1, '-6.759')] [2023-12-27 20:34:06,266][106225] Updated weights for policy 1, policy_version 186566 (0.0008) [2023-12-27 20:34:06,331][106225] Updated weights for policy 1, policy_version 186576 (0.0010) [2023-12-27 20:34:06,389][106225] Updated weights for policy 1, policy_version 186586 (0.0010) [2023-12-27 20:34:06,532][106226] Updated weights for policy 0, policy_version 186246 (0.0011) [2023-12-27 20:34:06,593][106226] Updated weights for policy 0, policy_version 186256 (0.0011) [2023-12-27 20:34:06,657][106226] Updated weights for policy 0, policy_version 186266 (0.0011) [2023-12-27 20:34:07,031][106225] Updated weights for policy 1, policy_version 186596 (0.0009) [2023-12-27 20:34:07,084][106225] Updated weights for policy 1, policy_version 186606 (0.0010) [2023-12-27 20:34:07,139][106225] Updated weights for policy 1, policy_version 186616 (0.0011) [2023-12-27 20:34:07,353][106226] Updated weights for policy 0, policy_version 186276 (0.0011) [2023-12-27 20:34:07,415][106226] Updated weights for policy 0, policy_version 186286 (0.0007) [2023-12-27 20:34:07,477][106226] Updated weights for policy 0, policy_version 186296 (0.0008) [2023-12-27 20:34:07,861][106225] Updated weights for policy 1, policy_version 186626 (0.0010) [2023-12-27 20:34:07,921][106225] Updated weights for policy 1, policy_version 186636 (0.0008) [2023-12-27 20:34:07,977][106225] Updated weights for policy 1, policy_version 186646 (0.0010) [2023-12-27 20:34:08,024][106225] Updated weights for policy 1, policy_version 186656 (0.0010) [2023-12-27 20:34:08,163][106226] Updated weights for policy 0, policy_version 186306 (0.0010) [2023-12-27 20:34:08,223][106226] Updated weights for policy 0, policy_version 186316 (0.0010) [2023-12-27 20:34:08,269][106226] Updated weights for policy 0, policy_version 186326 (0.0010) [2023-12-27 20:34:08,326][106226] Updated weights for policy 0, policy_version 186336 (0.0010) [2023-12-27 20:34:08,751][106225] Updated weights for policy 1, policy_version 186666 (0.0009) [2023-12-27 20:34:08,816][106225] Updated weights for policy 1, policy_version 186676 (0.0010) [2023-12-27 20:34:08,876][106225] Updated weights for policy 1, policy_version 186686 (0.0010) [2023-12-27 20:34:09,002][106226] Updated weights for policy 0, policy_version 186346 (0.0010) [2023-12-27 20:34:09,048][106226] Updated weights for policy 0, policy_version 186356 (0.0010) [2023-12-27 20:34:09,096][106226] Updated weights for policy 0, policy_version 186366 (0.0008) [2023-12-27 20:34:09,564][106225] Updated weights for policy 1, policy_version 186696 (0.0006) [2023-12-27 20:34:09,616][106225] Updated weights for policy 1, policy_version 186706 (0.0005) [2023-12-27 20:34:09,668][106225] Updated weights for policy 1, policy_version 186716 (0.0006) [2023-12-27 20:34:09,895][106226] Updated weights for policy 0, policy_version 186376 (0.0007) [2023-12-27 20:34:09,961][106226] Updated weights for policy 0, policy_version 186386 (0.0009) [2023-12-27 20:34:10,023][106226] Updated weights for policy 0, policy_version 186396 (0.0008) [2023-12-27 20:34:10,351][106225] Updated weights for policy 1, policy_version 186726 (0.0007) [2023-12-27 20:34:10,409][106225] Updated weights for policy 1, policy_version 186736 (0.0006) [2023-12-27 20:34:10,462][106225] Updated weights for policy 1, policy_version 186746 (0.0006) [2023-12-27 20:34:10,786][106226] Updated weights for policy 0, policy_version 186406 (0.0009) [2023-12-27 20:34:10,844][106226] Updated weights for policy 0, policy_version 186416 (0.0010) [2023-12-27 20:34:10,897][106226] Updated weights for policy 0, policy_version 186426 (0.0009) [2023-12-27 20:34:11,032][106225] Updated weights for policy 1, policy_version 186756 (0.0007) [2023-12-27 20:34:11,096][106225] Updated weights for policy 1, policy_version 186766 (0.0009) [2023-12-27 20:34:11,164][106225] Updated weights for policy 1, policy_version 186776 (0.0008) [2023-12-27 20:34:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 95551488. Throughput: 0: 10125.3, 1: 9809.2. Samples: 95524364. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:11,175][105115] Avg episode reward: [(0, '-5.198'), (1, '-6.907')] [2023-12-27 20:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000186432_47734784.pth... [2023-12-27 20:34:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000185280_47439872.pth [2023-12-27 20:34:11,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000186784_47824896.pth... [2023-12-27 20:34:11,220][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000185600_47521792.pth [2023-12-27 20:34:11,590][106226] Updated weights for policy 0, policy_version 186436 (0.0010) [2023-12-27 20:34:11,657][106226] Updated weights for policy 0, policy_version 186446 (0.0009) [2023-12-27 20:34:11,715][106226] Updated weights for policy 0, policy_version 186456 (0.0008) [2023-12-27 20:34:11,945][106225] Updated weights for policy 1, policy_version 186786 (0.0008) [2023-12-27 20:34:12,008][106225] Updated weights for policy 1, policy_version 186796 (0.0007) [2023-12-27 20:34:12,066][106225] Updated weights for policy 1, policy_version 186806 (0.0005) [2023-12-27 20:34:12,121][106225] Updated weights for policy 1, policy_version 186816 (0.0005) [2023-12-27 20:34:12,511][106226] Updated weights for policy 0, policy_version 186466 (0.0009) [2023-12-27 20:34:12,568][106226] Updated weights for policy 0, policy_version 186476 (0.0008) [2023-12-27 20:34:12,622][106226] Updated weights for policy 0, policy_version 186486 (0.0009) [2023-12-27 20:34:12,675][106226] Updated weights for policy 0, policy_version 186496 (0.0008) [2023-12-27 20:34:12,825][106225] Updated weights for policy 1, policy_version 186826 (0.0009) [2023-12-27 20:34:12,885][106225] Updated weights for policy 1, policy_version 186836 (0.0008) [2023-12-27 20:34:12,944][106225] Updated weights for policy 1, policy_version 186846 (0.0007) [2023-12-27 20:34:13,365][106226] Updated weights for policy 0, policy_version 186506 (0.0005) [2023-12-27 20:34:13,422][106226] Updated weights for policy 0, policy_version 186516 (0.0006) [2023-12-27 20:34:13,479][106226] Updated weights for policy 0, policy_version 186526 (0.0005) [2023-12-27 20:34:13,549][106225] Updated weights for policy 1, policy_version 186856 (0.0006) [2023-12-27 20:34:13,611][106225] Updated weights for policy 1, policy_version 186866 (0.0005) [2023-12-27 20:34:13,659][106225] Updated weights for policy 1, policy_version 186876 (0.0005) [2023-12-27 20:34:14,054][106226] Updated weights for policy 0, policy_version 186536 (0.0009) [2023-12-27 20:34:14,104][106226] Updated weights for policy 0, policy_version 186546 (0.0010) [2023-12-27 20:34:14,161][106226] Updated weights for policy 0, policy_version 186556 (0.0010) [2023-12-27 20:34:14,262][106225] Updated weights for policy 1, policy_version 186886 (0.0005) [2023-12-27 20:34:14,319][106225] Updated weights for policy 1, policy_version 186896 (0.0008) [2023-12-27 20:34:14,382][106225] Updated weights for policy 1, policy_version 186906 (0.0006) [2023-12-27 20:34:14,814][106226] Updated weights for policy 0, policy_version 186566 (0.0007) [2023-12-27 20:34:14,884][106226] Updated weights for policy 0, policy_version 186576 (0.0007) [2023-12-27 20:34:14,945][106226] Updated weights for policy 0, policy_version 186586 (0.0011) [2023-12-27 20:34:14,950][106225] Updated weights for policy 1, policy_version 186916 (0.0007) [2023-12-27 20:34:15,009][106225] Updated weights for policy 1, policy_version 186926 (0.0008) [2023-12-27 20:34:15,067][106225] Updated weights for policy 1, policy_version 186936 (0.0008) [2023-12-27 20:34:15,569][106226] Updated weights for policy 0, policy_version 186596 (0.0010) [2023-12-27 20:34:15,628][106226] Updated weights for policy 0, policy_version 186606 (0.0010) [2023-12-27 20:34:15,683][106226] Updated weights for policy 0, policy_version 186616 (0.0010) [2023-12-27 20:34:15,784][106225] Updated weights for policy 1, policy_version 186946 (0.0009) [2023-12-27 20:34:15,841][106225] Updated weights for policy 1, policy_version 186956 (0.0010) [2023-12-27 20:34:15,896][106225] Updated weights for policy 1, policy_version 186966 (0.0010) [2023-12-27 20:34:15,957][106225] Updated weights for policy 1, policy_version 186976 (0.0010) [2023-12-27 20:34:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 95657984. Throughput: 0: 10000.8, 1: 9889.9. Samples: 95646716. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:16,176][105115] Avg episode reward: [(0, '-5.506'), (1, '-7.149')] [2023-12-27 20:34:16,328][106226] Updated weights for policy 0, policy_version 186626 (0.0008) [2023-12-27 20:34:16,379][106226] Updated weights for policy 0, policy_version 186636 (0.0005) [2023-12-27 20:34:16,437][106226] Updated weights for policy 0, policy_version 186646 (0.0006) [2023-12-27 20:34:16,493][106226] Updated weights for policy 0, policy_version 186656 (0.0010) [2023-12-27 20:34:16,674][106225] Updated weights for policy 1, policy_version 186986 (0.0010) [2023-12-27 20:34:16,735][106225] Updated weights for policy 1, policy_version 186996 (0.0010) [2023-12-27 20:34:16,800][106225] Updated weights for policy 1, policy_version 187006 (0.0010) [2023-12-27 20:34:17,083][106226] Updated weights for policy 0, policy_version 186666 (0.0010) [2023-12-27 20:34:17,132][106226] Updated weights for policy 0, policy_version 186676 (0.0005) [2023-12-27 20:34:17,186][106226] Updated weights for policy 0, policy_version 186686 (0.0005) [2023-12-27 20:34:17,513][106225] Updated weights for policy 1, policy_version 187016 (0.0010) [2023-12-27 20:34:17,576][106225] Updated weights for policy 1, policy_version 187026 (0.0010) [2023-12-27 20:34:17,643][106225] Updated weights for policy 1, policy_version 187036 (0.0010) [2023-12-27 20:34:17,825][106226] Updated weights for policy 0, policy_version 186696 (0.0008) [2023-12-27 20:34:17,881][106226] Updated weights for policy 0, policy_version 186706 (0.0011) [2023-12-27 20:34:17,943][106226] Updated weights for policy 0, policy_version 186716 (0.0010) [2023-12-27 20:34:18,311][106225] Updated weights for policy 1, policy_version 187046 (0.0007) [2023-12-27 20:34:18,379][106225] Updated weights for policy 1, policy_version 187056 (0.0008) [2023-12-27 20:34:18,446][106225] Updated weights for policy 1, policy_version 187066 (0.0008) [2023-12-27 20:34:18,541][106226] Updated weights for policy 0, policy_version 186726 (0.0005) [2023-12-27 20:34:18,600][106226] Updated weights for policy 0, policy_version 186736 (0.0008) [2023-12-27 20:34:18,663][106226] Updated weights for policy 0, policy_version 186746 (0.0009) [2023-12-27 20:34:19,166][106225] Updated weights for policy 1, policy_version 187076 (0.0006) [2023-12-27 20:34:19,231][106225] Updated weights for policy 1, policy_version 187086 (0.0007) [2023-12-27 20:34:19,274][106226] Updated weights for policy 0, policy_version 186756 (0.0008) [2023-12-27 20:34:19,295][106225] Updated weights for policy 1, policy_version 187096 (0.0008) [2023-12-27 20:34:19,346][106226] Updated weights for policy 0, policy_version 186766 (0.0008) [2023-12-27 20:34:19,413][106226] Updated weights for policy 0, policy_version 186776 (0.0008) [2023-12-27 20:34:19,925][106225] Updated weights for policy 1, policy_version 187106 (0.0007) [2023-12-27 20:34:19,992][106225] Updated weights for policy 1, policy_version 187116 (0.0008) [2023-12-27 20:34:20,062][106225] Updated weights for policy 1, policy_version 187126 (0.0008) [2023-12-27 20:34:20,127][106225] Updated weights for policy 1, policy_version 187136 (0.0007) [2023-12-27 20:34:20,175][106226] Updated weights for policy 0, policy_version 186786 (0.0009) [2023-12-27 20:34:20,226][106226] Updated weights for policy 0, policy_version 186796 (0.0010) [2023-12-27 20:34:20,279][106226] Updated weights for policy 0, policy_version 186806 (0.0011) [2023-12-27 20:34:20,333][106226] Updated weights for policy 0, policy_version 186816 (0.0011) [2023-12-27 20:34:20,891][106225] Updated weights for policy 1, policy_version 187146 (0.0008) [2023-12-27 20:34:20,949][106225] Updated weights for policy 1, policy_version 187156 (0.0008) [2023-12-27 20:34:21,010][106225] Updated weights for policy 1, policy_version 187166 (0.0008) [2023-12-27 20:34:21,088][106226] Updated weights for policy 0, policy_version 186826 (0.0010) [2023-12-27 20:34:21,154][106226] Updated weights for policy 0, policy_version 186836 (0.0010) [2023-12-27 20:34:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 95756288. Throughput: 0: 9990.1, 1: 9932.4. Samples: 95766984. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:21,175][105115] Avg episode reward: [(0, '-5.374'), (1, '-6.595')] [2023-12-27 20:34:21,216][106226] Updated weights for policy 0, policy_version 186846 (0.0011) [2023-12-27 20:34:21,805][106225] Updated weights for policy 1, policy_version 187176 (0.0006) [2023-12-27 20:34:21,878][106225] Updated weights for policy 1, policy_version 187186 (0.0006) [2023-12-27 20:34:21,940][106225] Updated weights for policy 1, policy_version 187196 (0.0008) [2023-12-27 20:34:21,981][106226] Updated weights for policy 0, policy_version 186856 (0.0009) [2023-12-27 20:34:22,042][106226] Updated weights for policy 0, policy_version 186866 (0.0009) [2023-12-27 20:34:22,111][106226] Updated weights for policy 0, policy_version 186876 (0.0011) [2023-12-27 20:34:22,626][106225] Updated weights for policy 1, policy_version 187206 (0.0008) [2023-12-27 20:34:22,684][106225] Updated weights for policy 1, policy_version 187216 (0.0010) [2023-12-27 20:34:22,749][106225] Updated weights for policy 1, policy_version 187226 (0.0009) [2023-12-27 20:34:22,873][106226] Updated weights for policy 0, policy_version 186886 (0.0010) [2023-12-27 20:34:22,941][106226] Updated weights for policy 0, policy_version 186896 (0.0011) [2023-12-27 20:34:23,005][106226] Updated weights for policy 0, policy_version 186906 (0.0011) [2023-12-27 20:34:23,435][106225] Updated weights for policy 1, policy_version 187236 (0.0010) [2023-12-27 20:34:23,486][106225] Updated weights for policy 1, policy_version 187246 (0.0010) [2023-12-27 20:34:23,537][106225] Updated weights for policy 1, policy_version 187256 (0.0010) [2023-12-27 20:34:23,616][106226] Updated weights for policy 0, policy_version 186916 (0.0009) [2023-12-27 20:34:23,666][106226] Updated weights for policy 0, policy_version 186926 (0.0010) [2023-12-27 20:34:23,723][106226] Updated weights for policy 0, policy_version 186936 (0.0011) [2023-12-27 20:34:24,220][106225] Updated weights for policy 1, policy_version 187266 (0.0009) [2023-12-27 20:34:24,270][106225] Updated weights for policy 1, policy_version 187276 (0.0010) [2023-12-27 20:34:24,319][106225] Updated weights for policy 1, policy_version 187286 (0.0010) [2023-12-27 20:34:24,377][106225] Updated weights for policy 1, policy_version 187296 (0.0009) [2023-12-27 20:34:24,424][106226] Updated weights for policy 0, policy_version 186946 (0.0010) [2023-12-27 20:34:24,485][106226] Updated weights for policy 0, policy_version 186956 (0.0006) [2023-12-27 20:34:24,546][106226] Updated weights for policy 0, policy_version 186966 (0.0006) [2023-12-27 20:34:24,601][106226] Updated weights for policy 0, policy_version 186976 (0.0007) [2023-12-27 20:34:25,126][106225] Updated weights for policy 1, policy_version 187306 (0.0010) [2023-12-27 20:34:25,170][106226] Updated weights for policy 0, policy_version 186986 (0.0006) [2023-12-27 20:34:25,183][106225] Updated weights for policy 1, policy_version 187316 (0.0010) [2023-12-27 20:34:25,221][106226] Updated weights for policy 0, policy_version 186996 (0.0007) [2023-12-27 20:34:25,242][106225] Updated weights for policy 1, policy_version 187326 (0.0010) [2023-12-27 20:34:25,273][106226] Updated weights for policy 0, policy_version 187006 (0.0005) [2023-12-27 20:34:25,887][106226] Updated weights for policy 0, policy_version 187016 (0.0007) [2023-12-27 20:34:25,942][106225] Updated weights for policy 1, policy_version 187336 (0.0010) [2023-12-27 20:34:25,946][106226] Updated weights for policy 0, policy_version 187026 (0.0008) [2023-12-27 20:34:25,994][106226] Updated weights for policy 0, policy_version 187036 (0.0005) [2023-12-27 20:34:25,999][106225] Updated weights for policy 1, policy_version 187346 (0.0010) [2023-12-27 20:34:26,056][106225] Updated weights for policy 1, policy_version 187356 (0.0010) [2023-12-27 20:34:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 95862784. Throughput: 0: 9956.7, 1: 9899.9. Samples: 95824980. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:26,176][105115] Avg episode reward: [(0, '-5.132'), (1, '-7.032')] [2023-12-27 20:34:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000187360_47972352.pth... [2023-12-27 20:34:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000187040_47890432.pth... [2023-12-27 20:34:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000185856_47587328.pth [2023-12-27 20:34:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000186176_47669248.pth [2023-12-27 20:34:26,614][106226] Updated weights for policy 0, policy_version 187046 (0.0007) [2023-12-27 20:34:26,671][106226] Updated weights for policy 0, policy_version 187056 (0.0010) [2023-12-27 20:34:26,734][106226] Updated weights for policy 0, policy_version 187066 (0.0011) [2023-12-27 20:34:26,734][106225] Updated weights for policy 1, policy_version 187366 (0.0008) [2023-12-27 20:34:26,780][106225] Updated weights for policy 1, policy_version 187376 (0.0006) [2023-12-27 20:34:26,824][106225] Updated weights for policy 1, policy_version 187386 (0.0005) [2023-12-27 20:34:27,355][106226] Updated weights for policy 0, policy_version 187076 (0.0011) [2023-12-27 20:34:27,419][106226] Updated weights for policy 0, policy_version 187086 (0.0006) [2023-12-27 20:34:27,481][106226] Updated weights for policy 0, policy_version 187096 (0.0007) [2023-12-27 20:34:27,571][106225] Updated weights for policy 1, policy_version 187396 (0.0007) [2023-12-27 20:34:27,631][106225] Updated weights for policy 1, policy_version 187406 (0.0005) [2023-12-27 20:34:27,686][106225] Updated weights for policy 1, policy_version 187416 (0.0007) [2023-12-27 20:34:28,124][106226] Updated weights for policy 0, policy_version 187106 (0.0009) [2023-12-27 20:34:28,189][106226] Updated weights for policy 0, policy_version 187116 (0.0005) [2023-12-27 20:34:28,242][106226] Updated weights for policy 0, policy_version 187126 (0.0008) [2023-12-27 20:34:28,292][106226] Updated weights for policy 0, policy_version 187136 (0.0010) [2023-12-27 20:34:28,397][106225] Updated weights for policy 1, policy_version 187426 (0.0009) [2023-12-27 20:34:28,450][106225] Updated weights for policy 1, policy_version 187436 (0.0007) [2023-12-27 20:34:28,511][106225] Updated weights for policy 1, policy_version 187446 (0.0010) [2023-12-27 20:34:28,562][106225] Updated weights for policy 1, policy_version 187456 (0.0010) [2023-12-27 20:34:28,981][106226] Updated weights for policy 0, policy_version 187146 (0.0010) [2023-12-27 20:34:29,031][106226] Updated weights for policy 0, policy_version 187156 (0.0010) [2023-12-27 20:34:29,084][106226] Updated weights for policy 0, policy_version 187166 (0.0006) [2023-12-27 20:34:29,301][106225] Updated weights for policy 1, policy_version 187466 (0.0008) [2023-12-27 20:34:29,363][106225] Updated weights for policy 1, policy_version 187476 (0.0008) [2023-12-27 20:34:29,423][106225] Updated weights for policy 1, policy_version 187486 (0.0008) [2023-12-27 20:34:29,730][106226] Updated weights for policy 0, policy_version 187176 (0.0007) [2023-12-27 20:34:29,798][106226] Updated weights for policy 0, policy_version 187186 (0.0008) [2023-12-27 20:34:29,865][106226] Updated weights for policy 0, policy_version 187196 (0.0008) [2023-12-27 20:34:30,123][106225] Updated weights for policy 1, policy_version 187496 (0.0010) [2023-12-27 20:34:30,183][106225] Updated weights for policy 1, policy_version 187506 (0.0010) [2023-12-27 20:34:30,236][106225] Updated weights for policy 1, policy_version 187516 (0.0010) [2023-12-27 20:34:30,565][106226] Updated weights for policy 0, policy_version 187206 (0.0008) [2023-12-27 20:34:30,614][106226] Updated weights for policy 0, policy_version 187216 (0.0008) [2023-12-27 20:34:30,664][106226] Updated weights for policy 0, policy_version 187226 (0.0007) [2023-12-27 20:34:30,953][106225] Updated weights for policy 1, policy_version 187526 (0.0007) [2023-12-27 20:34:31,002][106225] Updated weights for policy 1, policy_version 187536 (0.0005) [2023-12-27 20:34:31,071][106225] Updated weights for policy 1, policy_version 187546 (0.0009) [2023-12-27 20:34:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 95961088. Throughput: 0: 10069.2, 1: 9922.7. Samples: 95947824. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:31,175][105115] Avg episode reward: [(0, '-5.356'), (1, '-6.611')] [2023-12-27 20:34:31,492][106226] Updated weights for policy 0, policy_version 187236 (0.0008) [2023-12-27 20:34:31,556][106226] Updated weights for policy 0, policy_version 187246 (0.0009) [2023-12-27 20:34:31,625][106226] Updated weights for policy 0, policy_version 187256 (0.0007) [2023-12-27 20:34:31,793][106225] Updated weights for policy 1, policy_version 187556 (0.0010) [2023-12-27 20:34:31,850][106225] Updated weights for policy 1, policy_version 187566 (0.0009) [2023-12-27 20:34:31,904][106225] Updated weights for policy 1, policy_version 187576 (0.0008) [2023-12-27 20:34:32,434][106226] Updated weights for policy 0, policy_version 187266 (0.0009) [2023-12-27 20:34:32,500][106226] Updated weights for policy 0, policy_version 187276 (0.0009) [2023-12-27 20:34:32,563][106226] Updated weights for policy 0, policy_version 187286 (0.0008) [2023-12-27 20:34:32,603][106225] Updated weights for policy 1, policy_version 187586 (0.0008) [2023-12-27 20:34:32,625][106226] Updated weights for policy 0, policy_version 187296 (0.0008) [2023-12-27 20:34:32,663][106225] Updated weights for policy 1, policy_version 187596 (0.0007) [2023-12-27 20:34:32,713][106225] Updated weights for policy 1, policy_version 187606 (0.0008) [2023-12-27 20:34:32,772][106225] Updated weights for policy 1, policy_version 187616 (0.0007) [2023-12-27 20:34:33,373][106226] Updated weights for policy 0, policy_version 187306 (0.0008) [2023-12-27 20:34:33,428][106226] Updated weights for policy 0, policy_version 187316 (0.0007) [2023-12-27 20:34:33,441][106225] Updated weights for policy 1, policy_version 187626 (0.0007) [2023-12-27 20:34:33,479][106226] Updated weights for policy 0, policy_version 187326 (0.0007) [2023-12-27 20:34:33,492][106225] Updated weights for policy 1, policy_version 187636 (0.0007) [2023-12-27 20:34:33,552][106225] Updated weights for policy 1, policy_version 187646 (0.0008) [2023-12-27 20:34:34,213][106226] Updated weights for policy 0, policy_version 187336 (0.0008) [2023-12-27 20:34:34,275][106226] Updated weights for policy 0, policy_version 187346 (0.0008) [2023-12-27 20:34:34,275][106225] Updated weights for policy 1, policy_version 187656 (0.0007) [2023-12-27 20:34:34,331][106226] Updated weights for policy 0, policy_version 187356 (0.0009) [2023-12-27 20:34:34,337][106225] Updated weights for policy 1, policy_version 187666 (0.0007) [2023-12-27 20:34:34,395][106225] Updated weights for policy 1, policy_version 187676 (0.0007) [2023-12-27 20:34:35,054][106225] Updated weights for policy 1, policy_version 187686 (0.0006) [2023-12-27 20:34:35,082][106226] Updated weights for policy 0, policy_version 187366 (0.0008) [2023-12-27 20:34:35,112][106225] Updated weights for policy 1, policy_version 187696 (0.0006) [2023-12-27 20:34:35,140][106226] Updated weights for policy 0, policy_version 187376 (0.0011) [2023-12-27 20:34:35,168][106225] Updated weights for policy 1, policy_version 187706 (0.0008) [2023-12-27 20:34:35,202][106226] Updated weights for policy 0, policy_version 187386 (0.0011) [2023-12-27 20:34:35,794][106225] Updated weights for policy 1, policy_version 187716 (0.0008) [2023-12-27 20:34:35,814][106226] Updated weights for policy 0, policy_version 187396 (0.0011) [2023-12-27 20:34:35,845][106225] Updated weights for policy 1, policy_version 187726 (0.0007) [2023-12-27 20:34:35,868][106226] Updated weights for policy 0, policy_version 187406 (0.0010) [2023-12-27 20:34:35,889][106225] Updated weights for policy 1, policy_version 187736 (0.0006) [2023-12-27 20:34:35,924][106226] Updated weights for policy 0, policy_version 187416 (0.0011) [2023-12-27 20:34:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 96059392. Throughput: 0: 10038.2, 1: 9933.3. Samples: 96064492. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:36,175][105115] Avg episode reward: [(0, '-5.617'), (1, '-6.928')] [2023-12-27 20:34:36,627][106226] Updated weights for policy 0, policy_version 187426 (0.0010) [2023-12-27 20:34:36,662][106225] Updated weights for policy 1, policy_version 187746 (0.0009) [2023-12-27 20:34:36,688][106226] Updated weights for policy 0, policy_version 187436 (0.0007) [2023-12-27 20:34:36,719][106225] Updated weights for policy 1, policy_version 187756 (0.0007) [2023-12-27 20:34:36,752][106226] Updated weights for policy 0, policy_version 187446 (0.0007) [2023-12-27 20:34:36,770][106225] Updated weights for policy 1, policy_version 187766 (0.0008) [2023-12-27 20:34:36,818][106226] Updated weights for policy 0, policy_version 187456 (0.0008) [2023-12-27 20:34:36,827][106225] Updated weights for policy 1, policy_version 187776 (0.0006) [2023-12-27 20:34:37,425][106226] Updated weights for policy 0, policy_version 187466 (0.0007) [2023-12-27 20:34:37,485][106226] Updated weights for policy 0, policy_version 187476 (0.0008) [2023-12-27 20:34:37,540][106226] Updated weights for policy 0, policy_version 187486 (0.0008) [2023-12-27 20:34:37,637][106225] Updated weights for policy 1, policy_version 187786 (0.0009) [2023-12-27 20:34:37,698][106225] Updated weights for policy 1, policy_version 187796 (0.0008) [2023-12-27 20:34:37,755][106225] Updated weights for policy 1, policy_version 187806 (0.0007) [2023-12-27 20:34:38,144][106226] Updated weights for policy 0, policy_version 187496 (0.0006) [2023-12-27 20:34:38,190][106226] Updated weights for policy 0, policy_version 187506 (0.0005) [2023-12-27 20:34:38,249][106226] Updated weights for policy 0, policy_version 187516 (0.0007) [2023-12-27 20:34:38,519][106225] Updated weights for policy 1, policy_version 187816 (0.0009) [2023-12-27 20:34:38,585][106225] Updated weights for policy 1, policy_version 187826 (0.0008) [2023-12-27 20:34:38,648][106225] Updated weights for policy 1, policy_version 187836 (0.0008) [2023-12-27 20:34:38,884][106226] Updated weights for policy 0, policy_version 187526 (0.0007) [2023-12-27 20:34:38,948][106226] Updated weights for policy 0, policy_version 187536 (0.0008) [2023-12-27 20:34:38,998][106226] Updated weights for policy 0, policy_version 187546 (0.0008) [2023-12-27 20:34:39,340][106225] Updated weights for policy 1, policy_version 187846 (0.0007) [2023-12-27 20:34:39,400][106225] Updated weights for policy 1, policy_version 187856 (0.0008) [2023-12-27 20:34:39,469][106225] Updated weights for policy 1, policy_version 187866 (0.0008) [2023-12-27 20:34:39,730][106226] Updated weights for policy 0, policy_version 187556 (0.0008) [2023-12-27 20:34:39,799][106226] Updated weights for policy 0, policy_version 187566 (0.0009) [2023-12-27 20:34:39,866][106226] Updated weights for policy 0, policy_version 187576 (0.0009) [2023-12-27 20:34:40,155][106225] Updated weights for policy 1, policy_version 187876 (0.0007) [2023-12-27 20:34:40,214][106225] Updated weights for policy 1, policy_version 187886 (0.0008) [2023-12-27 20:34:40,274][106225] Updated weights for policy 1, policy_version 187896 (0.0009) [2023-12-27 20:34:40,646][106226] Updated weights for policy 0, policy_version 187586 (0.0010) [2023-12-27 20:34:40,697][106226] Updated weights for policy 0, policy_version 187596 (0.0010) [2023-12-27 20:34:40,746][106226] Updated weights for policy 0, policy_version 187606 (0.0005) [2023-12-27 20:34:40,805][106226] Updated weights for policy 0, policy_version 187616 (0.0008) [2023-12-27 20:34:40,963][106225] Updated weights for policy 1, policy_version 187906 (0.0009) [2023-12-27 20:34:41,026][106225] Updated weights for policy 1, policy_version 187916 (0.0008) [2023-12-27 20:34:41,088][106225] Updated weights for policy 1, policy_version 187926 (0.0009) [2023-12-27 20:34:41,158][106225] Updated weights for policy 1, policy_version 187936 (0.0010) [2023-12-27 20:34:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 96157696. Throughput: 0: 10084.1, 1: 9861.9. Samples: 96123496. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:41,175][105115] Avg episode reward: [(0, '-5.296'), (1, '-6.799')] [2023-12-27 20:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000187936_48119808.pth... [2023-12-27 20:34:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000187616_48037888.pth... [2023-12-27 20:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000186432_47734784.pth [2023-12-27 20:34:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000186784_47824896.pth [2023-12-27 20:34:41,502][106226] Updated weights for policy 0, policy_version 187626 (0.0008) [2023-12-27 20:34:41,573][106226] Updated weights for policy 0, policy_version 187636 (0.0008) [2023-12-27 20:34:41,644][106226] Updated weights for policy 0, policy_version 187646 (0.0009) [2023-12-27 20:34:42,018][106225] Updated weights for policy 1, policy_version 187946 (0.0009) [2023-12-27 20:34:42,078][106225] Updated weights for policy 1, policy_version 187956 (0.0009) [2023-12-27 20:34:42,149][106225] Updated weights for policy 1, policy_version 187966 (0.0010) [2023-12-27 20:34:42,370][106226] Updated weights for policy 0, policy_version 187657 (0.0009) [2023-12-27 20:34:42,430][106226] Updated weights for policy 0, policy_version 187667 (0.0008) [2023-12-27 20:34:42,483][106226] Updated weights for policy 0, policy_version 187677 (0.0009) [2023-12-27 20:34:42,842][106225] Updated weights for policy 1, policy_version 187976 (0.0007) [2023-12-27 20:34:42,894][106225] Updated weights for policy 1, policy_version 187986 (0.0006) [2023-12-27 20:34:42,944][106225] Updated weights for policy 1, policy_version 187996 (0.0005) [2023-12-27 20:34:43,214][106226] Updated weights for policy 0, policy_version 187687 (0.0008) [2023-12-27 20:34:43,263][106226] Updated weights for policy 0, policy_version 187697 (0.0008) [2023-12-27 20:34:43,315][106226] Updated weights for policy 0, policy_version 187707 (0.0009) [2023-12-27 20:34:43,567][106225] Updated weights for policy 1, policy_version 188006 (0.0006) [2023-12-27 20:34:43,612][106225] Updated weights for policy 1, policy_version 188016 (0.0005) [2023-12-27 20:34:43,659][106225] Updated weights for policy 1, policy_version 188026 (0.0006) [2023-12-27 20:34:44,025][106226] Updated weights for policy 0, policy_version 187717 (0.0008) [2023-12-27 20:34:44,083][106226] Updated weights for policy 0, policy_version 187727 (0.0007) [2023-12-27 20:34:44,145][106226] Updated weights for policy 0, policy_version 187737 (0.0007) [2023-12-27 20:34:44,309][106225] Updated weights for policy 1, policy_version 188036 (0.0007) [2023-12-27 20:34:44,367][106225] Updated weights for policy 1, policy_version 188046 (0.0008) [2023-12-27 20:34:44,415][106225] Updated weights for policy 1, policy_version 188056 (0.0008) [2023-12-27 20:34:44,790][106226] Updated weights for policy 0, policy_version 187747 (0.0010) [2023-12-27 20:34:44,855][106226] Updated weights for policy 0, policy_version 187757 (0.0007) [2023-12-27 20:34:44,916][106226] Updated weights for policy 0, policy_version 187767 (0.0008) [2023-12-27 20:34:45,208][106225] Updated weights for policy 1, policy_version 188066 (0.0009) [2023-12-27 20:34:45,261][106225] Updated weights for policy 1, policy_version 188076 (0.0008) [2023-12-27 20:34:45,311][106225] Updated weights for policy 1, policy_version 188086 (0.0009) [2023-12-27 20:34:45,364][106225] Updated weights for policy 1, policy_version 188096 (0.0009) [2023-12-27 20:34:45,527][106226] Updated weights for policy 0, policy_version 187777 (0.0006) [2023-12-27 20:34:45,593][106226] Updated weights for policy 0, policy_version 187787 (0.0007) [2023-12-27 20:34:45,651][106226] Updated weights for policy 0, policy_version 187797 (0.0008) [2023-12-27 20:34:45,713][106226] Updated weights for policy 0, policy_version 187807 (0.0008) [2023-12-27 20:34:46,163][106225] Updated weights for policy 1, policy_version 188106 (0.0005) [2023-12-27 20:34:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 96247808. Throughput: 0: 10022.0, 1: 9893.1. Samples: 96240940. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:46,175][105115] Avg episode reward: [(0, '-5.334'), (1, '-6.800')] [2023-12-27 20:34:46,228][106225] Updated weights for policy 1, policy_version 188116 (0.0005) [2023-12-27 20:34:46,282][106226] Updated weights for policy 0, policy_version 187817 (0.0008) [2023-12-27 20:34:46,295][106225] Updated weights for policy 1, policy_version 188126 (0.0005) [2023-12-27 20:34:46,333][106226] Updated weights for policy 0, policy_version 187827 (0.0008) [2023-12-27 20:34:46,384][106226] Updated weights for policy 0, policy_version 187837 (0.0008) [2023-12-27 20:34:46,854][106225] Updated weights for policy 1, policy_version 188136 (0.0005) [2023-12-27 20:34:46,919][106225] Updated weights for policy 1, policy_version 188146 (0.0005) [2023-12-27 20:34:46,973][106225] Updated weights for policy 1, policy_version 188156 (0.0005) [2023-12-27 20:34:47,038][106226] Updated weights for policy 0, policy_version 187847 (0.0007) [2023-12-27 20:34:47,088][106226] Updated weights for policy 0, policy_version 187857 (0.0009) [2023-12-27 20:34:47,134][106226] Updated weights for policy 0, policy_version 187867 (0.0005) [2023-12-27 20:34:47,479][106225] Updated weights for policy 1, policy_version 188166 (0.0007) [2023-12-27 20:34:47,532][106225] Updated weights for policy 1, policy_version 188176 (0.0009) [2023-12-27 20:34:47,596][106225] Updated weights for policy 1, policy_version 188186 (0.0010) [2023-12-27 20:34:47,687][106226] Updated weights for policy 0, policy_version 187877 (0.0006) [2023-12-27 20:34:47,744][106226] Updated weights for policy 0, policy_version 187887 (0.0005) [2023-12-27 20:34:47,798][106226] Updated weights for policy 0, policy_version 187897 (0.0006) [2023-12-27 20:34:48,370][106225] Updated weights for policy 1, policy_version 188196 (0.0009) [2023-12-27 20:34:48,436][106225] Updated weights for policy 1, policy_version 188206 (0.0008) [2023-12-27 20:34:48,442][106226] Updated weights for policy 0, policy_version 187907 (0.0006) [2023-12-27 20:34:48,492][106225] Updated weights for policy 1, policy_version 188216 (0.0008) [2023-12-27 20:34:48,502][106226] Updated weights for policy 0, policy_version 187917 (0.0006) [2023-12-27 20:34:48,560][106226] Updated weights for policy 0, policy_version 187927 (0.0008) [2023-12-27 20:34:49,207][106226] Updated weights for policy 0, policy_version 187937 (0.0008) [2023-12-27 20:34:49,242][106225] Updated weights for policy 1, policy_version 188226 (0.0008) [2023-12-27 20:34:49,288][106226] Updated weights for policy 0, policy_version 187947 (0.0008) [2023-12-27 20:34:49,316][106225] Updated weights for policy 1, policy_version 188236 (0.0009) [2023-12-27 20:34:49,354][106226] Updated weights for policy 0, policy_version 187957 (0.0007) [2023-12-27 20:34:49,379][106225] Updated weights for policy 1, policy_version 188246 (0.0007) [2023-12-27 20:34:49,415][106226] Updated weights for policy 0, policy_version 187967 (0.0008) [2023-12-27 20:34:49,446][106225] Updated weights for policy 1, policy_version 188256 (0.0007) [2023-12-27 20:34:50,159][106225] Updated weights for policy 1, policy_version 188266 (0.0010) [2023-12-27 20:34:50,162][106226] Updated weights for policy 0, policy_version 187977 (0.0006) [2023-12-27 20:34:50,214][106225] Updated weights for policy 1, policy_version 188276 (0.0010) [2023-12-27 20:34:50,224][106226] Updated weights for policy 0, policy_version 187987 (0.0006) [2023-12-27 20:34:50,270][106225] Updated weights for policy 1, policy_version 188286 (0.0010) [2023-12-27 20:34:50,272][106226] Updated weights for policy 0, policy_version 187997 (0.0006) [2023-12-27 20:34:50,923][106225] Updated weights for policy 1, policy_version 188296 (0.0010) [2023-12-27 20:34:50,990][106225] Updated weights for policy 1, policy_version 188306 (0.0011) [2023-12-27 20:34:50,991][106226] Updated weights for policy 0, policy_version 188007 (0.0008) [2023-12-27 20:34:51,058][106226] Updated weights for policy 0, policy_version 188017 (0.0008) [2023-12-27 20:34:51,063][106225] Updated weights for policy 1, policy_version 188316 (0.0010) [2023-12-27 20:34:51,123][106226] Updated weights for policy 0, policy_version 188027 (0.0008) [2023-12-27 20:34:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 96362496. Throughput: 0: 10117.1, 1: 9897.9. Samples: 96364612. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:51,176][105115] Avg episode reward: [(0, '-5.385'), (1, '-6.676')] [2023-12-27 20:34:51,709][106225] Updated weights for policy 1, policy_version 188326 (0.0008) [2023-12-27 20:34:51,780][106225] Updated weights for policy 1, policy_version 188336 (0.0010) [2023-12-27 20:34:51,837][106225] Updated weights for policy 1, policy_version 188346 (0.0010) [2023-12-27 20:34:51,933][106226] Updated weights for policy 0, policy_version 188037 (0.0008) [2023-12-27 20:34:51,998][106226] Updated weights for policy 0, policy_version 188047 (0.0008) [2023-12-27 20:34:52,057][106226] Updated weights for policy 0, policy_version 188057 (0.0007) [2023-12-27 20:34:52,609][106225] Updated weights for policy 1, policy_version 188356 (0.0010) [2023-12-27 20:34:52,670][106225] Updated weights for policy 1, policy_version 188366 (0.0010) [2023-12-27 20:34:52,734][106225] Updated weights for policy 1, policy_version 188376 (0.0011) [2023-12-27 20:34:52,796][106226] Updated weights for policy 0, policy_version 188067 (0.0008) [2023-12-27 20:34:52,854][106226] Updated weights for policy 0, policy_version 188077 (0.0008) [2023-12-27 20:34:52,916][106226] Updated weights for policy 0, policy_version 188087 (0.0007) [2023-12-27 20:34:53,423][106225] Updated weights for policy 1, policy_version 188386 (0.0010) [2023-12-27 20:34:53,482][106225] Updated weights for policy 1, policy_version 188396 (0.0010) [2023-12-27 20:34:53,537][106225] Updated weights for policy 1, policy_version 188406 (0.0010) [2023-12-27 20:34:53,548][106226] Updated weights for policy 0, policy_version 188097 (0.0005) [2023-12-27 20:34:53,587][106225] Updated weights for policy 1, policy_version 188416 (0.0010) [2023-12-27 20:34:53,609][106226] Updated weights for policy 0, policy_version 188107 (0.0007) [2023-12-27 20:34:53,661][106226] Updated weights for policy 0, policy_version 188117 (0.0008) [2023-12-27 20:34:53,729][106226] Updated weights for policy 0, policy_version 188127 (0.0008) [2023-12-27 20:34:54,286][106225] Updated weights for policy 1, policy_version 188426 (0.0006) [2023-12-27 20:34:54,347][106225] Updated weights for policy 1, policy_version 188436 (0.0008) [2023-12-27 20:34:54,407][106226] Updated weights for policy 0, policy_version 188137 (0.0009) [2023-12-27 20:34:54,410][106225] Updated weights for policy 1, policy_version 188446 (0.0006) [2023-12-27 20:34:54,462][106226] Updated weights for policy 0, policy_version 188148 (0.0009) [2023-12-27 20:34:54,518][106226] Updated weights for policy 0, policy_version 188158 (0.0009) [2023-12-27 20:34:55,052][106225] Updated weights for policy 1, policy_version 188456 (0.0008) [2023-12-27 20:34:55,121][106225] Updated weights for policy 1, policy_version 188466 (0.0009) [2023-12-27 20:34:55,170][106225] Updated weights for policy 1, policy_version 188476 (0.0008) [2023-12-27 20:34:55,267][106226] Updated weights for policy 0, policy_version 188168 (0.0006) [2023-12-27 20:34:55,324][106226] Updated weights for policy 0, policy_version 188178 (0.0005) [2023-12-27 20:34:55,380][106226] Updated weights for policy 0, policy_version 188188 (0.0005) [2023-12-27 20:34:55,953][106225] Updated weights for policy 1, policy_version 188486 (0.0008) [2023-12-27 20:34:55,958][106226] Updated weights for policy 0, policy_version 188198 (0.0008) [2023-12-27 20:34:56,011][106226] Updated weights for policy 0, policy_version 188208 (0.0010) [2023-12-27 20:34:56,013][106225] Updated weights for policy 1, policy_version 188496 (0.0006) [2023-12-27 20:34:56,072][106226] Updated weights for policy 0, policy_version 188218 (0.0011) [2023-12-27 20:34:56,074][106225] Updated weights for policy 1, policy_version 188506 (0.0007) [2023-12-27 20:34:56,175][105115] Fps is (10 sec: 21298.5, 60 sec: 20070.3, 300 sec: 19771.9). Total num frames: 96460800. Throughput: 0: 10085.9, 1: 9871.9. Samples: 96422468. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:34:56,176][105115] Avg episode reward: [(0, '-5.383'), (1, '-6.904')] [2023-12-27 20:34:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000188224_48193536.pth... [2023-12-27 20:34:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000188512_48267264.pth... [2023-12-27 20:34:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000187040_47890432.pth [2023-12-27 20:34:56,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000187360_47972352.pth [2023-12-27 20:34:56,659][106225] Updated weights for policy 1, policy_version 188516 (0.0005) [2023-12-27 20:34:56,677][106226] Updated weights for policy 0, policy_version 188228 (0.0010) [2023-12-27 20:34:56,710][106225] Updated weights for policy 1, policy_version 188526 (0.0005) [2023-12-27 20:34:56,733][106226] Updated weights for policy 0, policy_version 188238 (0.0010) [2023-12-27 20:34:56,758][106225] Updated weights for policy 1, policy_version 188536 (0.0005) [2023-12-27 20:34:56,784][106226] Updated weights for policy 0, policy_version 188248 (0.0010) [2023-12-27 20:34:57,449][106225] Updated weights for policy 1, policy_version 188546 (0.0006) [2023-12-27 20:34:57,489][106226] Updated weights for policy 0, policy_version 188258 (0.0010) [2023-12-27 20:34:57,501][106225] Updated weights for policy 1, policy_version 188556 (0.0008) [2023-12-27 20:34:57,548][106226] Updated weights for policy 0, policy_version 188268 (0.0010) [2023-12-27 20:34:57,551][106225] Updated weights for policy 1, policy_version 188566 (0.0005) [2023-12-27 20:34:57,606][106225] Updated weights for policy 1, policy_version 188576 (0.0005) [2023-12-27 20:34:57,608][106226] Updated weights for policy 0, policy_version 188278 (0.0010) [2023-12-27 20:34:57,667][106226] Updated weights for policy 0, policy_version 188288 (0.0010) [2023-12-27 20:34:58,372][106225] Updated weights for policy 1, policy_version 188586 (0.0009) [2023-12-27 20:34:58,381][106226] Updated weights for policy 0, policy_version 188298 (0.0008) [2023-12-27 20:34:58,440][106225] Updated weights for policy 1, policy_version 188596 (0.0008) [2023-12-27 20:34:58,443][106226] Updated weights for policy 0, policy_version 188308 (0.0008) [2023-12-27 20:34:58,503][106225] Updated weights for policy 1, policy_version 188606 (0.0010) [2023-12-27 20:34:58,511][106226] Updated weights for policy 0, policy_version 188318 (0.0008) [2023-12-27 20:34:59,371][106225] Updated weights for policy 1, policy_version 188616 (0.0008) [2023-12-27 20:34:59,392][106226] Updated weights for policy 0, policy_version 188328 (0.0009) [2023-12-27 20:34:59,437][106225] Updated weights for policy 1, policy_version 188626 (0.0006) [2023-12-27 20:34:59,454][106226] Updated weights for policy 0, policy_version 188338 (0.0009) [2023-12-27 20:34:59,492][106225] Updated weights for policy 1, policy_version 188636 (0.0006) [2023-12-27 20:34:59,512][106226] Updated weights for policy 0, policy_version 188348 (0.0009) [2023-12-27 20:35:00,167][106225] Updated weights for policy 1, policy_version 188646 (0.0008) [2023-12-27 20:35:00,230][106226] Updated weights for policy 0, policy_version 188359 (0.0008) [2023-12-27 20:35:00,238][106225] Updated weights for policy 1, policy_version 188656 (0.0009) [2023-12-27 20:35:00,285][106226] Updated weights for policy 0, policy_version 188369 (0.0010) [2023-12-27 20:35:00,299][106225] Updated weights for policy 1, policy_version 188666 (0.0009) [2023-12-27 20:35:00,335][106226] Updated weights for policy 0, policy_version 188379 (0.0010) [2023-12-27 20:35:00,969][106226] Updated weights for policy 0, policy_version 188389 (0.0008) [2023-12-27 20:35:01,028][106226] Updated weights for policy 0, policy_version 188399 (0.0007) [2023-12-27 20:35:01,058][106225] Updated weights for policy 1, policy_version 188676 (0.0006) [2023-12-27 20:35:01,088][106226] Updated weights for policy 0, policy_version 188409 (0.0011) [2023-12-27 20:35:01,117][106225] Updated weights for policy 1, policy_version 188686 (0.0006) [2023-12-27 20:35:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 96550912. Throughput: 0: 10100.8, 1: 9767.9. Samples: 96540804. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:35:01,175][105115] Avg episode reward: [(0, '-5.341'), (1, '-6.742')] [2023-12-27 20:35:01,180][106225] Updated weights for policy 1, policy_version 188696 (0.0008) [2023-12-27 20:35:01,813][106226] Updated weights for policy 0, policy_version 188419 (0.0008) [2023-12-27 20:35:01,871][106226] Updated weights for policy 0, policy_version 188429 (0.0008) [2023-12-27 20:35:01,926][106226] Updated weights for policy 0, policy_version 188439 (0.0008) [2023-12-27 20:35:01,975][106225] Updated weights for policy 1, policy_version 188706 (0.0009) [2023-12-27 20:35:02,039][106225] Updated weights for policy 1, policy_version 188716 (0.0006) [2023-12-27 20:35:02,109][106225] Updated weights for policy 1, policy_version 188726 (0.0006) [2023-12-27 20:35:02,169][106225] Updated weights for policy 1, policy_version 188736 (0.0005) [2023-12-27 20:35:02,694][106226] Updated weights for policy 0, policy_version 188449 (0.0008) [2023-12-27 20:35:02,749][106225] Updated weights for policy 1, policy_version 188746 (0.0009) [2023-12-27 20:35:02,751][106226] Updated weights for policy 0, policy_version 188459 (0.0009) [2023-12-27 20:35:02,807][106226] Updated weights for policy 0, policy_version 188469 (0.0008) [2023-12-27 20:35:02,810][106225] Updated weights for policy 1, policy_version 188756 (0.0007) [2023-12-27 20:35:02,861][106226] Updated weights for policy 0, policy_version 188479 (0.0005) [2023-12-27 20:35:02,875][106225] Updated weights for policy 1, policy_version 188766 (0.0009) [2023-12-27 20:35:03,453][106225] Updated weights for policy 1, policy_version 188776 (0.0008) [2023-12-27 20:35:03,513][106225] Updated weights for policy 1, policy_version 188786 (0.0008) [2023-12-27 20:35:03,532][106226] Updated weights for policy 0, policy_version 188489 (0.0006) [2023-12-27 20:35:03,560][106225] Updated weights for policy 1, policy_version 188796 (0.0008) [2023-12-27 20:35:03,590][106226] Updated weights for policy 0, policy_version 188499 (0.0006) [2023-12-27 20:35:03,650][106226] Updated weights for policy 0, policy_version 188509 (0.0006) [2023-12-27 20:35:04,306][106225] Updated weights for policy 1, policy_version 188806 (0.0008) [2023-12-27 20:35:04,307][106226] Updated weights for policy 0, policy_version 188519 (0.0007) [2023-12-27 20:35:04,370][106225] Updated weights for policy 1, policy_version 188816 (0.0008) [2023-12-27 20:35:04,376][106226] Updated weights for policy 0, policy_version 188529 (0.0006) [2023-12-27 20:35:04,427][106225] Updated weights for policy 1, policy_version 188826 (0.0007) [2023-12-27 20:35:04,445][106226] Updated weights for policy 0, policy_version 188539 (0.0006) [2023-12-27 20:35:05,088][106225] Updated weights for policy 1, policy_version 188836 (0.0008) [2023-12-27 20:35:05,126][106226] Updated weights for policy 0, policy_version 188549 (0.0008) [2023-12-27 20:35:05,139][106225] Updated weights for policy 1, policy_version 188846 (0.0005) [2023-12-27 20:35:05,188][106226] Updated weights for policy 0, policy_version 188559 (0.0007) [2023-12-27 20:35:05,197][106225] Updated weights for policy 1, policy_version 188856 (0.0007) [2023-12-27 20:35:05,251][106226] Updated weights for policy 0, policy_version 188569 (0.0006) [2023-12-27 20:35:05,925][106225] Updated weights for policy 1, policy_version 188866 (0.0007) [2023-12-27 20:35:05,940][106226] Updated weights for policy 0, policy_version 188579 (0.0006) [2023-12-27 20:35:05,977][106225] Updated weights for policy 1, policy_version 188876 (0.0008) [2023-12-27 20:35:05,991][106226] Updated weights for policy 0, policy_version 188589 (0.0006) [2023-12-27 20:35:06,029][106225] Updated weights for policy 1, policy_version 188886 (0.0006) [2023-12-27 20:35:06,043][106226] Updated weights for policy 0, policy_version 188599 (0.0006) [2023-12-27 20:35:06,085][106225] Updated weights for policy 1, policy_version 188896 (0.0007) [2023-12-27 20:35:06,175][105115] Fps is (10 sec: 19661.5, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 96657408. Throughput: 0: 10047.4, 1: 9808.3. Samples: 96660488. Policy #0 lag: (min: 28.0, avg: 38.4, max: 60.0) [2023-12-27 20:35:06,175][105115] Avg episode reward: [(0, '-5.148'), (1, '-6.922')] [2023-12-27 20:35:06,778][106226] Updated weights for policy 0, policy_version 188609 (0.0007) [2023-12-27 20:35:06,843][106226] Updated weights for policy 0, policy_version 188619 (0.0009) [2023-12-27 20:35:06,849][106225] Updated weights for policy 1, policy_version 188906 (0.0005) [2023-12-27 20:35:06,905][106226] Updated weights for policy 0, policy_version 188629 (0.0007) [2023-12-27 20:35:06,907][106225] Updated weights for policy 1, policy_version 188916 (0.0007) [2023-12-27 20:35:06,965][106225] Updated weights for policy 1, policy_version 188926 (0.0009) [2023-12-27 20:35:06,968][106226] Updated weights for policy 0, policy_version 188639 (0.0009) [2023-12-27 20:35:07,634][106226] Updated weights for policy 0, policy_version 188649 (0.0005) [2023-12-27 20:35:07,685][106226] Updated weights for policy 0, policy_version 188659 (0.0005) [2023-12-27 20:35:07,709][106225] Updated weights for policy 1, policy_version 188936 (0.0008) [2023-12-27 20:35:07,743][106226] Updated weights for policy 0, policy_version 188669 (0.0006) [2023-12-27 20:35:07,757][106225] Updated weights for policy 1, policy_version 188946 (0.0006) [2023-12-27 20:35:07,810][106225] Updated weights for policy 1, policy_version 188956 (0.0005) [2023-12-27 20:35:08,404][106226] Updated weights for policy 0, policy_version 188679 (0.0008) [2023-12-27 20:35:08,468][106226] Updated weights for policy 0, policy_version 188689 (0.0006) [2023-12-27 20:35:08,517][106225] Updated weights for policy 1, policy_version 188966 (0.0007) [2023-12-27 20:35:08,532][106226] Updated weights for policy 0, policy_version 188699 (0.0005) [2023-12-27 20:35:08,576][106225] Updated weights for policy 1, policy_version 188976 (0.0006) [2023-12-27 20:35:08,635][106225] Updated weights for policy 1, policy_version 188986 (0.0006) [2023-12-27 20:35:09,120][106226] Updated weights for policy 0, policy_version 188709 (0.0009) [2023-12-27 20:35:09,173][106226] Updated weights for policy 0, policy_version 188719 (0.0010) [2023-12-27 20:35:09,239][106226] Updated weights for policy 0, policy_version 188729 (0.0010) [2023-12-27 20:35:09,338][106225] Updated weights for policy 1, policy_version 188996 (0.0009) [2023-12-27 20:35:09,403][106225] Updated weights for policy 1, policy_version 189006 (0.0008) [2023-12-27 20:35:09,469][106225] Updated weights for policy 1, policy_version 189016 (0.0007) [2023-12-27 20:35:09,965][106226] Updated weights for policy 0, policy_version 188739 (0.0011) [2023-12-27 20:35:10,025][106226] Updated weights for policy 0, policy_version 188749 (0.0010) [2023-12-27 20:35:10,093][106226] Updated weights for policy 0, policy_version 188759 (0.0010) [2023-12-27 20:35:10,194][106225] Updated weights for policy 1, policy_version 189026 (0.0008) [2023-12-27 20:35:10,249][106225] Updated weights for policy 1, policy_version 189036 (0.0008) [2023-12-27 20:35:10,312][106225] Updated weights for policy 1, policy_version 189046 (0.0007) [2023-12-27 20:35:10,376][106225] Updated weights for policy 1, policy_version 189056 (0.0007) [2023-12-27 20:35:10,813][106226] Updated weights for policy 0, policy_version 188769 (0.0010) [2023-12-27 20:35:10,863][106226] Updated weights for policy 0, policy_version 188779 (0.0005) [2023-12-27 20:35:10,918][106226] Updated weights for policy 0, policy_version 188789 (0.0005) [2023-12-27 20:35:10,964][106226] Updated weights for policy 0, policy_version 188799 (0.0005) [2023-12-27 20:35:11,138][106225] Updated weights for policy 1, policy_version 189066 (0.0007) [2023-12-27 20:35:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 96747520. Throughput: 0: 10094.5, 1: 9813.3. Samples: 96720832. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:11,175][105115] Avg episode reward: [(0, '-5.621'), (1, '-6.753')] [2023-12-27 20:35:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000188800_48340992.pth... [2023-12-27 20:35:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000187616_48037888.pth [2023-12-27 20:35:11,209][106225] Updated weights for policy 1, policy_version 189076 (0.0009) [2023-12-27 20:35:11,279][106225] Updated weights for policy 1, policy_version 189086 (0.0008) [2023-12-27 20:35:11,292][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000189088_48414720.pth... [2023-12-27 20:35:11,296][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000187936_48119808.pth [2023-12-27 20:35:11,658][106226] Updated weights for policy 0, policy_version 188809 (0.0007) [2023-12-27 20:35:11,727][106226] Updated weights for policy 0, policy_version 188819 (0.0008) [2023-12-27 20:35:11,801][106226] Updated weights for policy 0, policy_version 188829 (0.0009) [2023-12-27 20:35:12,022][106225] Updated weights for policy 1, policy_version 189096 (0.0008) [2023-12-27 20:35:12,091][106225] Updated weights for policy 1, policy_version 189106 (0.0005) [2023-12-27 20:35:12,150][106225] Updated weights for policy 1, policy_version 189116 (0.0005) [2023-12-27 20:35:12,437][106226] Updated weights for policy 0, policy_version 188839 (0.0008) [2023-12-27 20:35:12,493][106226] Updated weights for policy 0, policy_version 188849 (0.0008) [2023-12-27 20:35:12,549][106226] Updated weights for policy 0, policy_version 188859 (0.0008) [2023-12-27 20:35:12,754][106225] Updated weights for policy 1, policy_version 189126 (0.0007) [2023-12-27 20:35:12,816][106225] Updated weights for policy 1, policy_version 189136 (0.0008) [2023-12-27 20:35:12,879][106225] Updated weights for policy 1, policy_version 189146 (0.0009) [2023-12-27 20:35:13,242][106226] Updated weights for policy 0, policy_version 188869 (0.0008) [2023-12-27 20:35:13,307][106226] Updated weights for policy 0, policy_version 188879 (0.0009) [2023-12-27 20:35:13,363][106226] Updated weights for policy 0, policy_version 188889 (0.0009) [2023-12-27 20:35:13,592][106225] Updated weights for policy 1, policy_version 189156 (0.0009) [2023-12-27 20:35:13,648][106225] Updated weights for policy 1, policy_version 189166 (0.0007) [2023-12-27 20:35:13,698][106225] Updated weights for policy 1, policy_version 189176 (0.0009) [2023-12-27 20:35:13,970][106226] Updated weights for policy 0, policy_version 188899 (0.0007) [2023-12-27 20:35:14,026][106226] Updated weights for policy 0, policy_version 188909 (0.0005) [2023-12-27 20:35:14,090][106226] Updated weights for policy 0, policy_version 188919 (0.0005) [2023-12-27 20:35:14,434][106225] Updated weights for policy 1, policy_version 189186 (0.0008) [2023-12-27 20:35:14,492][106225] Updated weights for policy 1, policy_version 189196 (0.0008) [2023-12-27 20:35:14,551][106225] Updated weights for policy 1, policy_version 189206 (0.0009) [2023-12-27 20:35:14,596][106225] Updated weights for policy 1, policy_version 189216 (0.0008) [2023-12-27 20:35:14,752][106226] Updated weights for policy 0, policy_version 188929 (0.0007) [2023-12-27 20:35:14,820][106226] Updated weights for policy 0, policy_version 188939 (0.0009) [2023-12-27 20:35:14,880][106226] Updated weights for policy 0, policy_version 188949 (0.0008) [2023-12-27 20:35:14,940][106226] Updated weights for policy 0, policy_version 188959 (0.0009) [2023-12-27 20:35:15,307][106225] Updated weights for policy 1, policy_version 189226 (0.0007) [2023-12-27 20:35:15,373][106225] Updated weights for policy 1, policy_version 189236 (0.0008) [2023-12-27 20:35:15,432][106225] Updated weights for policy 1, policy_version 189246 (0.0008) [2023-12-27 20:35:15,718][106226] Updated weights for policy 0, policy_version 188969 (0.0009) [2023-12-27 20:35:15,780][106226] Updated weights for policy 0, policy_version 188979 (0.0009) [2023-12-27 20:35:15,832][106226] Updated weights for policy 0, policy_version 188989 (0.0008) [2023-12-27 20:35:16,109][106225] Updated weights for policy 1, policy_version 189256 (0.0006) [2023-12-27 20:35:16,161][106225] Updated weights for policy 1, policy_version 189266 (0.0005) [2023-12-27 20:35:16,175][105115] Fps is (10 sec: 18840.7, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 96845824. Throughput: 0: 10005.2, 1: 9782.2. Samples: 96838268. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:16,176][105115] Avg episode reward: [(0, '-5.167'), (1, '-7.385')] [2023-12-27 20:35:16,230][106225] Updated weights for policy 1, policy_version 189276 (0.0005) [2023-12-27 20:35:16,566][106226] Updated weights for policy 0, policy_version 188999 (0.0009) [2023-12-27 20:35:16,631][106226] Updated weights for policy 0, policy_version 189009 (0.0010) [2023-12-27 20:35:16,693][106226] Updated weights for policy 0, policy_version 189019 (0.0008) [2023-12-27 20:35:16,800][106225] Updated weights for policy 1, policy_version 189286 (0.0007) [2023-12-27 20:35:16,855][106225] Updated weights for policy 1, policy_version 189296 (0.0009) [2023-12-27 20:35:16,904][106225] Updated weights for policy 1, policy_version 189306 (0.0009) [2023-12-27 20:35:17,468][106226] Updated weights for policy 0, policy_version 189029 (0.0009) [2023-12-27 20:35:17,528][106226] Updated weights for policy 0, policy_version 189039 (0.0008) [2023-12-27 20:35:17,531][106225] Updated weights for policy 1, policy_version 189316 (0.0008) [2023-12-27 20:35:17,580][106225] Updated weights for policy 1, policy_version 189326 (0.0005) [2023-12-27 20:35:17,583][106226] Updated weights for policy 0, policy_version 189049 (0.0007) [2023-12-27 20:35:17,633][106225] Updated weights for policy 1, policy_version 189336 (0.0005) [2023-12-27 20:35:18,215][106226] Updated weights for policy 0, policy_version 189059 (0.0009) [2023-12-27 20:35:18,276][106226] Updated weights for policy 0, policy_version 189069 (0.0006) [2023-12-27 20:35:18,334][106225] Updated weights for policy 1, policy_version 189346 (0.0005) [2023-12-27 20:35:18,335][106226] Updated weights for policy 0, policy_version 189079 (0.0006) [2023-12-27 20:35:18,395][106225] Updated weights for policy 1, policy_version 189356 (0.0007) [2023-12-27 20:35:18,453][106225] Updated weights for policy 1, policy_version 189366 (0.0006) [2023-12-27 20:35:18,515][106225] Updated weights for policy 1, policy_version 189376 (0.0007) [2023-12-27 20:35:19,034][106226] Updated weights for policy 0, policy_version 189089 (0.0009) [2023-12-27 20:35:19,099][106226] Updated weights for policy 0, policy_version 189099 (0.0009) [2023-12-27 20:35:19,156][106226] Updated weights for policy 0, policy_version 189109 (0.0009) [2023-12-27 20:35:19,216][106226] Updated weights for policy 0, policy_version 189119 (0.0007) [2023-12-27 20:35:19,224][106225] Updated weights for policy 1, policy_version 189386 (0.0007) [2023-12-27 20:35:19,285][106225] Updated weights for policy 1, policy_version 189396 (0.0008) [2023-12-27 20:35:19,351][106225] Updated weights for policy 1, policy_version 189406 (0.0007) [2023-12-27 20:35:19,943][106226] Updated weights for policy 0, policy_version 189129 (0.0009) [2023-12-27 20:35:20,017][106226] Updated weights for policy 0, policy_version 189139 (0.0008) [2023-12-27 20:35:20,017][106225] Updated weights for policy 1, policy_version 189416 (0.0007) [2023-12-27 20:35:20,082][106225] Updated weights for policy 1, policy_version 189426 (0.0008) [2023-12-27 20:35:20,084][106226] Updated weights for policy 0, policy_version 189149 (0.0006) [2023-12-27 20:35:20,144][106225] Updated weights for policy 1, policy_version 189436 (0.0008) [2023-12-27 20:35:20,781][106226] Updated weights for policy 0, policy_version 189159 (0.0006) [2023-12-27 20:35:20,834][106226] Updated weights for policy 0, policy_version 189169 (0.0006) [2023-12-27 20:35:20,883][106225] Updated weights for policy 1, policy_version 189446 (0.0010) [2023-12-27 20:35:20,885][106226] Updated weights for policy 0, policy_version 189179 (0.0007) [2023-12-27 20:35:20,946][106225] Updated weights for policy 1, policy_version 189456 (0.0011) [2023-12-27 20:35:21,013][106225] Updated weights for policy 1, policy_version 189466 (0.0011) [2023-12-27 20:35:21,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 96952320. Throughput: 0: 10027.7, 1: 9819.3. Samples: 96957608. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:21,175][105115] Avg episode reward: [(0, '-5.336'), (1, '-6.813')] [2023-12-27 20:35:21,711][106226] Updated weights for policy 0, policy_version 189189 (0.0007) [2023-12-27 20:35:21,786][106226] Updated weights for policy 0, policy_version 189199 (0.0008) [2023-12-27 20:35:21,801][106225] Updated weights for policy 1, policy_version 189476 (0.0008) [2023-12-27 20:35:21,838][106226] Updated weights for policy 0, policy_version 189209 (0.0009) [2023-12-27 20:35:21,857][106225] Updated weights for policy 1, policy_version 189486 (0.0006) [2023-12-27 20:35:21,917][106225] Updated weights for policy 1, policy_version 189496 (0.0006) [2023-12-27 20:35:22,606][106226] Updated weights for policy 0, policy_version 189219 (0.0009) [2023-12-27 20:35:22,654][106225] Updated weights for policy 1, policy_version 189506 (0.0007) [2023-12-27 20:35:22,671][106226] Updated weights for policy 0, policy_version 189229 (0.0011) [2023-12-27 20:35:22,716][106225] Updated weights for policy 1, policy_version 189516 (0.0006) [2023-12-27 20:35:22,737][106226] Updated weights for policy 0, policy_version 189239 (0.0011) [2023-12-27 20:35:22,774][106225] Updated weights for policy 1, policy_version 189526 (0.0006) [2023-12-27 20:35:22,842][106225] Updated weights for policy 1, policy_version 189536 (0.0008) [2023-12-27 20:35:23,326][106226] Updated weights for policy 0, policy_version 189249 (0.0011) [2023-12-27 20:35:23,378][106226] Updated weights for policy 0, policy_version 189259 (0.0010) [2023-12-27 20:35:23,433][106226] Updated weights for policy 0, policy_version 189269 (0.0006) [2023-12-27 20:35:23,487][106226] Updated weights for policy 0, policy_version 189279 (0.0005) [2023-12-27 20:35:23,627][106225] Updated weights for policy 1, policy_version 189546 (0.0007) [2023-12-27 20:35:23,685][106225] Updated weights for policy 1, policy_version 189556 (0.0008) [2023-12-27 20:35:23,733][106225] Updated weights for policy 1, policy_version 189566 (0.0007) [2023-12-27 20:35:24,077][106226] Updated weights for policy 0, policy_version 189289 (0.0007) [2023-12-27 20:35:24,124][106226] Updated weights for policy 0, policy_version 189299 (0.0010) [2023-12-27 20:35:24,186][106226] Updated weights for policy 0, policy_version 189309 (0.0010) [2023-12-27 20:35:24,491][106225] Updated weights for policy 1, policy_version 189576 (0.0007) [2023-12-27 20:35:24,546][106225] Updated weights for policy 1, policy_version 189586 (0.0008) [2023-12-27 20:35:24,601][106225] Updated weights for policy 1, policy_version 189596 (0.0007) [2023-12-27 20:35:24,870][106226] Updated weights for policy 0, policy_version 189319 (0.0011) [2023-12-27 20:35:24,927][106226] Updated weights for policy 0, policy_version 189329 (0.0011) [2023-12-27 20:35:24,984][106226] Updated weights for policy 0, policy_version 189339 (0.0010) [2023-12-27 20:35:25,256][106225] Updated weights for policy 1, policy_version 189606 (0.0006) [2023-12-27 20:35:25,311][106225] Updated weights for policy 1, policy_version 189616 (0.0008) [2023-12-27 20:35:25,374][106225] Updated weights for policy 1, policy_version 189626 (0.0008) [2023-12-27 20:35:25,657][106226] Updated weights for policy 0, policy_version 189349 (0.0009) [2023-12-27 20:35:25,717][106226] Updated weights for policy 0, policy_version 189359 (0.0009) [2023-12-27 20:35:25,785][106226] Updated weights for policy 0, policy_version 189369 (0.0010) [2023-12-27 20:35:25,958][106225] Updated weights for policy 1, policy_version 189636 (0.0007) [2023-12-27 20:35:26,007][106225] Updated weights for policy 1, policy_version 189646 (0.0009) [2023-12-27 20:35:26,064][106225] Updated weights for policy 1, policy_version 189656 (0.0008) [2023-12-27 20:35:26,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 97050624. Throughput: 0: 9988.3, 1: 9821.7. Samples: 97014952. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:26,176][105115] Avg episode reward: [(0, '-5.464'), (1, '-6.925')] [2023-12-27 20:35:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000189376_48488448.pth... [2023-12-27 20:35:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000189664_48562176.pth... [2023-12-27 20:35:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000188512_48267264.pth [2023-12-27 20:35:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000188224_48193536.pth [2023-12-27 20:35:26,469][106226] Updated weights for policy 0, policy_version 189379 (0.0010) [2023-12-27 20:35:26,517][106226] Updated weights for policy 0, policy_version 189389 (0.0008) [2023-12-27 20:35:26,562][106226] Updated weights for policy 0, policy_version 189399 (0.0008) [2023-12-27 20:35:26,790][106225] Updated weights for policy 1, policy_version 189666 (0.0009) [2023-12-27 20:35:26,835][106225] Updated weights for policy 1, policy_version 189676 (0.0010) [2023-12-27 20:35:26,888][106225] Updated weights for policy 1, policy_version 189686 (0.0010) [2023-12-27 20:35:26,942][106225] Updated weights for policy 1, policy_version 189696 (0.0010) [2023-12-27 20:35:27,280][106226] Updated weights for policy 0, policy_version 189409 (0.0007) [2023-12-27 20:35:27,338][106226] Updated weights for policy 0, policy_version 189419 (0.0010) [2023-12-27 20:35:27,395][106226] Updated weights for policy 0, policy_version 189429 (0.0010) [2023-12-27 20:35:27,454][106226] Updated weights for policy 0, policy_version 189439 (0.0010) [2023-12-27 20:35:27,578][106225] Updated weights for policy 1, policy_version 189706 (0.0009) [2023-12-27 20:35:27,630][106225] Updated weights for policy 1, policy_version 189716 (0.0008) [2023-12-27 20:35:27,675][106225] Updated weights for policy 1, policy_version 189726 (0.0005) [2023-12-27 20:35:28,072][106226] Updated weights for policy 0, policy_version 189449 (0.0007) [2023-12-27 20:35:28,141][106226] Updated weights for policy 0, policy_version 189459 (0.0005) [2023-12-27 20:35:28,202][106226] Updated weights for policy 0, policy_version 189469 (0.0007) [2023-12-27 20:35:28,350][106225] Updated weights for policy 1, policy_version 189736 (0.0009) [2023-12-27 20:35:28,413][106225] Updated weights for policy 1, policy_version 189746 (0.0010) [2023-12-27 20:35:28,477][106225] Updated weights for policy 1, policy_version 189756 (0.0010) [2023-12-27 20:35:28,882][106226] Updated weights for policy 0, policy_version 189479 (0.0007) [2023-12-27 20:35:28,932][106226] Updated weights for policy 0, policy_version 189489 (0.0007) [2023-12-27 20:35:28,985][106226] Updated weights for policy 0, policy_version 189499 (0.0010) [2023-12-27 20:35:29,186][106225] Updated weights for policy 1, policy_version 189766 (0.0009) [2023-12-27 20:35:29,254][106225] Updated weights for policy 1, policy_version 189776 (0.0007) [2023-12-27 20:35:29,322][106225] Updated weights for policy 1, policy_version 189786 (0.0008) [2023-12-27 20:35:29,729][106226] Updated weights for policy 0, policy_version 189509 (0.0011) [2023-12-27 20:35:29,779][106226] Updated weights for policy 0, policy_version 189519 (0.0010) [2023-12-27 20:35:29,840][106226] Updated weights for policy 0, policy_version 189529 (0.0011) [2023-12-27 20:35:29,973][106225] Updated weights for policy 1, policy_version 189796 (0.0008) [2023-12-27 20:35:30,032][106225] Updated weights for policy 1, policy_version 189806 (0.0006) [2023-12-27 20:35:30,093][106225] Updated weights for policy 1, policy_version 189816 (0.0007) [2023-12-27 20:35:30,579][106226] Updated weights for policy 0, policy_version 189539 (0.0008) [2023-12-27 20:35:30,632][106226] Updated weights for policy 0, policy_version 189549 (0.0008) [2023-12-27 20:35:30,683][106226] Updated weights for policy 0, policy_version 189559 (0.0008) [2023-12-27 20:35:30,785][106225] Updated weights for policy 1, policy_version 189826 (0.0008) [2023-12-27 20:35:30,832][106225] Updated weights for policy 1, policy_version 189836 (0.0008) [2023-12-27 20:35:30,880][106225] Updated weights for policy 1, policy_version 189846 (0.0008) [2023-12-27 20:35:30,931][106225] Updated weights for policy 1, policy_version 189856 (0.0008) [2023-12-27 20:35:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 97148928. Throughput: 0: 10034.6, 1: 9881.3. Samples: 97137156. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:31,175][105115] Avg episode reward: [(0, '-5.388'), (1, '-7.084')] [2023-12-27 20:35:31,359][106226] Updated weights for policy 0, policy_version 189569 (0.0008) [2023-12-27 20:35:31,450][106226] Updated weights for policy 0, policy_version 189581 (0.0008) [2023-12-27 20:35:31,510][106226] Updated weights for policy 0, policy_version 189591 (0.0008) [2023-12-27 20:35:31,724][106225] Updated weights for policy 1, policy_version 189866 (0.0007) [2023-12-27 20:35:31,787][106225] Updated weights for policy 1, policy_version 189876 (0.0009) [2023-12-27 20:35:31,852][106225] Updated weights for policy 1, policy_version 189886 (0.0009) [2023-12-27 20:35:32,179][106226] Updated weights for policy 0, policy_version 189601 (0.0009) [2023-12-27 20:35:32,243][106226] Updated weights for policy 0, policy_version 189611 (0.0006) [2023-12-27 20:35:32,305][106226] Updated weights for policy 0, policy_version 189621 (0.0009) [2023-12-27 20:35:32,375][106226] Updated weights for policy 0, policy_version 189631 (0.0008) [2023-12-27 20:35:32,494][106225] Updated weights for policy 1, policy_version 189896 (0.0006) [2023-12-27 20:35:32,550][106225] Updated weights for policy 1, policy_version 189906 (0.0005) [2023-12-27 20:35:32,612][106225] Updated weights for policy 1, policy_version 189916 (0.0006) [2023-12-27 20:35:33,061][106226] Updated weights for policy 0, policy_version 189641 (0.0007) [2023-12-27 20:35:33,109][106226] Updated weights for policy 0, policy_version 189651 (0.0009) [2023-12-27 20:35:33,158][106225] Updated weights for policy 1, policy_version 189926 (0.0006) [2023-12-27 20:35:33,160][106226] Updated weights for policy 0, policy_version 189661 (0.0009) [2023-12-27 20:35:33,211][106225] Updated weights for policy 1, policy_version 189936 (0.0007) [2023-12-27 20:35:33,271][106225] Updated weights for policy 1, policy_version 189946 (0.0008) [2023-12-27 20:35:33,849][106226] Updated weights for policy 0, policy_version 189671 (0.0006) [2023-12-27 20:35:33,878][106225] Updated weights for policy 1, policy_version 189956 (0.0007) [2023-12-27 20:35:33,903][106226] Updated weights for policy 0, policy_version 189681 (0.0008) [2023-12-27 20:35:33,944][106225] Updated weights for policy 1, policy_version 189966 (0.0005) [2023-12-27 20:35:33,967][106226] Updated weights for policy 0, policy_version 189691 (0.0008) [2023-12-27 20:35:34,005][106225] Updated weights for policy 1, policy_version 189976 (0.0006) [2023-12-27 20:35:34,665][106225] Updated weights for policy 1, policy_version 189986 (0.0008) [2023-12-27 20:35:34,725][106226] Updated weights for policy 0, policy_version 189701 (0.0007) [2023-12-27 20:35:34,728][106225] Updated weights for policy 1, policy_version 189996 (0.0008) [2023-12-27 20:35:34,795][106225] Updated weights for policy 1, policy_version 190006 (0.0009) [2023-12-27 20:35:34,797][106226] Updated weights for policy 0, policy_version 189711 (0.0006) [2023-12-27 20:35:34,856][106225] Updated weights for policy 1, policy_version 190016 (0.0008) [2023-12-27 20:35:34,866][106226] Updated weights for policy 0, policy_version 189721 (0.0006) [2023-12-27 20:35:35,430][106226] Updated weights for policy 0, policy_version 189731 (0.0006) [2023-12-27 20:35:35,495][106226] Updated weights for policy 0, policy_version 189741 (0.0005) [2023-12-27 20:35:35,563][106226] Updated weights for policy 0, policy_version 189751 (0.0005) [2023-12-27 20:35:35,639][106225] Updated weights for policy 1, policy_version 190026 (0.0008) [2023-12-27 20:35:35,703][106225] Updated weights for policy 1, policy_version 190036 (0.0008) [2023-12-27 20:35:35,761][106225] Updated weights for policy 1, policy_version 190046 (0.0008) [2023-12-27 20:35:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 97247232. Throughput: 0: 9970.5, 1: 9905.4. Samples: 97259024. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:36,175][105115] Avg episode reward: [(0, '-5.474'), (1, '-7.028')] [2023-12-27 20:35:36,213][106226] Updated weights for policy 0, policy_version 189761 (0.0006) [2023-12-27 20:35:36,283][106226] Updated weights for policy 0, policy_version 189771 (0.0010) [2023-12-27 20:35:36,357][106226] Updated weights for policy 0, policy_version 189781 (0.0011) [2023-12-27 20:35:36,422][106225] Updated weights for policy 1, policy_version 190056 (0.0008) [2023-12-27 20:35:36,424][106226] Updated weights for policy 0, policy_version 189791 (0.0006) [2023-12-27 20:35:36,475][106225] Updated weights for policy 1, policy_version 190066 (0.0008) [2023-12-27 20:35:36,536][106225] Updated weights for policy 1, policy_version 190076 (0.0008) [2023-12-27 20:35:37,092][106226] Updated weights for policy 0, policy_version 189801 (0.0008) [2023-12-27 20:35:37,155][106226] Updated weights for policy 0, policy_version 189811 (0.0009) [2023-12-27 20:35:37,219][106226] Updated weights for policy 0, policy_version 189821 (0.0008) [2023-12-27 20:35:37,284][106225] Updated weights for policy 1, policy_version 190086 (0.0007) [2023-12-27 20:35:37,336][106225] Updated weights for policy 1, policy_version 190096 (0.0008) [2023-12-27 20:35:37,388][106225] Updated weights for policy 1, policy_version 190106 (0.0009) [2023-12-27 20:35:37,807][106226] Updated weights for policy 0, policy_version 189831 (0.0006) [2023-12-27 20:35:37,872][106226] Updated weights for policy 0, policy_version 189841 (0.0005) [2023-12-27 20:35:37,944][106226] Updated weights for policy 0, policy_version 189851 (0.0006) [2023-12-27 20:35:38,190][106225] Updated weights for policy 1, policy_version 190116 (0.0007) [2023-12-27 20:35:38,251][106225] Updated weights for policy 1, policy_version 190126 (0.0008) [2023-12-27 20:35:38,316][106225] Updated weights for policy 1, policy_version 190136 (0.0008) [2023-12-27 20:35:38,562][106226] Updated weights for policy 0, policy_version 189861 (0.0007) [2023-12-27 20:35:38,628][106226] Updated weights for policy 0, policy_version 189871 (0.0008) [2023-12-27 20:35:38,697][106226] Updated weights for policy 0, policy_version 189881 (0.0009) [2023-12-27 20:35:39,063][106225] Updated weights for policy 1, policy_version 190146 (0.0009) [2023-12-27 20:35:39,128][106225] Updated weights for policy 1, policy_version 190156 (0.0009) [2023-12-27 20:35:39,194][106225] Updated weights for policy 1, policy_version 190166 (0.0008) [2023-12-27 20:35:39,256][106225] Updated weights for policy 1, policy_version 190176 (0.0007) [2023-12-27 20:35:39,410][106226] Updated weights for policy 0, policy_version 189891 (0.0009) [2023-12-27 20:35:39,466][106226] Updated weights for policy 0, policy_version 189901 (0.0009) [2023-12-27 20:35:39,530][106226] Updated weights for policy 0, policy_version 189911 (0.0009) [2023-12-27 20:35:40,011][106225] Updated weights for policy 1, policy_version 190186 (0.0008) [2023-12-27 20:35:40,076][106225] Updated weights for policy 1, policy_version 190196 (0.0007) [2023-12-27 20:35:40,140][106225] Updated weights for policy 1, policy_version 190206 (0.0009) [2023-12-27 20:35:40,253][106226] Updated weights for policy 0, policy_version 189921 (0.0008) [2023-12-27 20:35:40,322][106226] Updated weights for policy 0, policy_version 189931 (0.0006) [2023-12-27 20:35:40,390][106226] Updated weights for policy 0, policy_version 189941 (0.0005) [2023-12-27 20:35:40,447][106226] Updated weights for policy 0, policy_version 189951 (0.0006) [2023-12-27 20:35:40,853][106225] Updated weights for policy 1, policy_version 190216 (0.0008) [2023-12-27 20:35:40,899][106225] Updated weights for policy 1, policy_version 190226 (0.0006) [2023-12-27 20:35:40,948][106225] Updated weights for policy 1, policy_version 190236 (0.0005) [2023-12-27 20:35:41,125][106226] Updated weights for policy 0, policy_version 189961 (0.0008) [2023-12-27 20:35:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 97345536. Throughput: 0: 10018.3, 1: 9883.9. Samples: 97318060. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:41,175][105115] Avg episode reward: [(0, '-5.465'), (1, '-6.844')] [2023-12-27 20:35:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000190240_48709632.pth... [2023-12-27 20:35:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000189088_48414720.pth [2023-12-27 20:35:41,196][106226] Updated weights for policy 0, policy_version 189971 (0.0006) [2023-12-27 20:35:41,265][106226] Updated weights for policy 0, policy_version 189981 (0.0007) [2023-12-27 20:35:41,283][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000189984_48644096.pth... [2023-12-27 20:35:41,287][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000188800_48340992.pth [2023-12-27 20:35:41,718][106225] Updated weights for policy 1, policy_version 190246 (0.0007) [2023-12-27 20:35:41,786][106225] Updated weights for policy 1, policy_version 190256 (0.0008) [2023-12-27 20:35:41,845][106225] Updated weights for policy 1, policy_version 190266 (0.0008) [2023-12-27 20:35:41,999][106226] Updated weights for policy 0, policy_version 189991 (0.0010) [2023-12-27 20:35:42,066][106226] Updated weights for policy 0, policy_version 190001 (0.0011) [2023-12-27 20:35:42,134][106226] Updated weights for policy 0, policy_version 190011 (0.0010) [2023-12-27 20:35:42,630][106225] Updated weights for policy 1, policy_version 190276 (0.0009) [2023-12-27 20:35:42,689][106225] Updated weights for policy 1, policy_version 190286 (0.0007) [2023-12-27 20:35:42,754][106225] Updated weights for policy 1, policy_version 190296 (0.0008) [2023-12-27 20:35:42,827][106226] Updated weights for policy 0, policy_version 190021 (0.0009) [2023-12-27 20:35:42,883][106226] Updated weights for policy 0, policy_version 190031 (0.0009) [2023-12-27 20:35:42,940][106226] Updated weights for policy 0, policy_version 190041 (0.0009) [2023-12-27 20:35:43,450][106225] Updated weights for policy 1, policy_version 190306 (0.0006) [2023-12-27 20:35:43,510][106225] Updated weights for policy 1, policy_version 190316 (0.0008) [2023-12-27 20:35:43,565][106225] Updated weights for policy 1, policy_version 190326 (0.0008) [2023-12-27 20:35:43,625][106225] Updated weights for policy 1, policy_version 190336 (0.0008) [2023-12-27 20:35:43,691][106226] Updated weights for policy 0, policy_version 190051 (0.0008) [2023-12-27 20:35:43,749][106226] Updated weights for policy 0, policy_version 190061 (0.0005) [2023-12-27 20:35:43,801][106226] Updated weights for policy 0, policy_version 190071 (0.0006) [2023-12-27 20:35:44,389][106225] Updated weights for policy 1, policy_version 190346 (0.0008) [2023-12-27 20:35:44,414][106226] Updated weights for policy 0, policy_version 190081 (0.0009) [2023-12-27 20:35:44,441][106225] Updated weights for policy 1, policy_version 190356 (0.0007) [2023-12-27 20:35:44,472][106226] Updated weights for policy 0, policy_version 190091 (0.0009) [2023-12-27 20:35:44,501][106225] Updated weights for policy 1, policy_version 190366 (0.0005) [2023-12-27 20:35:44,529][106226] Updated weights for policy 0, policy_version 190101 (0.0008) [2023-12-27 20:35:44,587][106226] Updated weights for policy 0, policy_version 190111 (0.0009) [2023-12-27 20:35:45,171][106225] Updated weights for policy 1, policy_version 190376 (0.0008) [2023-12-27 20:35:45,233][106225] Updated weights for policy 1, policy_version 190386 (0.0011) [2023-12-27 20:35:45,293][106225] Updated weights for policy 1, policy_version 190396 (0.0007) [2023-12-27 20:35:45,366][106226] Updated weights for policy 0, policy_version 190121 (0.0008) [2023-12-27 20:35:45,416][106226] Updated weights for policy 0, policy_version 190131 (0.0008) [2023-12-27 20:35:45,464][106226] Updated weights for policy 0, policy_version 190141 (0.0007) [2023-12-27 20:35:45,946][106225] Updated weights for policy 1, policy_version 190406 (0.0006) [2023-12-27 20:35:46,001][106225] Updated weights for policy 1, policy_version 190416 (0.0007) [2023-12-27 20:35:46,054][106225] Updated weights for policy 1, policy_version 190426 (0.0010) [2023-12-27 20:35:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 97443840. Throughput: 0: 9990.6, 1: 9834.0. Samples: 97432912. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:46,175][105115] Avg episode reward: [(0, '-5.289'), (1, '-7.053')] [2023-12-27 20:35:46,200][106226] Updated weights for policy 0, policy_version 190151 (0.0007) [2023-12-27 20:35:46,261][106226] Updated weights for policy 0, policy_version 190161 (0.0005) [2023-12-27 20:35:46,328][106226] Updated weights for policy 0, policy_version 190171 (0.0005) [2023-12-27 20:35:46,719][106225] Updated weights for policy 1, policy_version 190436 (0.0008) [2023-12-27 20:35:46,770][106225] Updated weights for policy 1, policy_version 190446 (0.0005) [2023-12-27 20:35:46,821][106225] Updated weights for policy 1, policy_version 190456 (0.0005) [2023-12-27 20:35:46,968][106226] Updated weights for policy 0, policy_version 190181 (0.0007) [2023-12-27 20:35:47,019][106226] Updated weights for policy 0, policy_version 190191 (0.0009) [2023-12-27 20:35:47,072][106226] Updated weights for policy 0, policy_version 190202 (0.0008) [2023-12-27 20:35:47,367][106225] Updated weights for policy 1, policy_version 190466 (0.0005) [2023-12-27 20:35:47,427][106225] Updated weights for policy 1, policy_version 190476 (0.0008) [2023-12-27 20:35:47,485][106225] Updated weights for policy 1, policy_version 190486 (0.0008) [2023-12-27 20:35:47,545][106225] Updated weights for policy 1, policy_version 190496 (0.0007) [2023-12-27 20:35:47,922][106226] Updated weights for policy 0, policy_version 190212 (0.0009) [2023-12-27 20:35:47,972][106226] Updated weights for policy 0, policy_version 190222 (0.0009) [2023-12-27 20:35:48,031][106226] Updated weights for policy 0, policy_version 190232 (0.0008) [2023-12-27 20:35:48,130][106225] Updated weights for policy 1, policy_version 190506 (0.0009) [2023-12-27 20:35:48,188][106225] Updated weights for policy 1, policy_version 190516 (0.0008) [2023-12-27 20:35:48,246][106225] Updated weights for policy 1, policy_version 190526 (0.0008) [2023-12-27 20:35:48,740][106226] Updated weights for policy 0, policy_version 190242 (0.0006) [2023-12-27 20:35:48,807][106226] Updated weights for policy 0, policy_version 190252 (0.0009) [2023-12-27 20:35:48,867][106226] Updated weights for policy 0, policy_version 190262 (0.0007) [2023-12-27 20:35:48,924][106226] Updated weights for policy 0, policy_version 190272 (0.0005) [2023-12-27 20:35:48,993][106225] Updated weights for policy 1, policy_version 190536 (0.0010) [2023-12-27 20:35:49,055][106225] Updated weights for policy 1, policy_version 190546 (0.0010) [2023-12-27 20:35:49,111][106225] Updated weights for policy 1, policy_version 190556 (0.0010) [2023-12-27 20:35:49,564][106226] Updated weights for policy 0, policy_version 190282 (0.0009) [2023-12-27 20:35:49,636][106226] Updated weights for policy 0, policy_version 190292 (0.0009) [2023-12-27 20:35:49,697][106226] Updated weights for policy 0, policy_version 190302 (0.0007) [2023-12-27 20:35:49,821][106225] Updated weights for policy 1, policy_version 190566 (0.0008) [2023-12-27 20:35:49,885][106225] Updated weights for policy 1, policy_version 190576 (0.0009) [2023-12-27 20:35:49,949][106225] Updated weights for policy 1, policy_version 190586 (0.0009) [2023-12-27 20:35:50,383][106226] Updated weights for policy 0, policy_version 190312 (0.0008) [2023-12-27 20:35:50,451][106226] Updated weights for policy 0, policy_version 190322 (0.0009) [2023-12-27 20:35:50,514][106226] Updated weights for policy 0, policy_version 190332 (0.0009) [2023-12-27 20:35:50,745][106225] Updated weights for policy 1, policy_version 190596 (0.0008) [2023-12-27 20:35:50,816][106225] Updated weights for policy 1, policy_version 190606 (0.0008) [2023-12-27 20:35:50,882][106225] Updated weights for policy 1, policy_version 190616 (0.0009) [2023-12-27 20:35:51,103][106226] Updated weights for policy 0, policy_version 190342 (0.0009) [2023-12-27 20:35:51,166][106226] Updated weights for policy 0, policy_version 190352 (0.0008) [2023-12-27 20:35:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 97542144. Throughput: 0: 9979.9, 1: 9876.3. Samples: 97554016. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:51,175][105115] Avg episode reward: [(0, '-5.737'), (1, '-6.683')] [2023-12-27 20:35:51,239][106226] Updated weights for policy 0, policy_version 190362 (0.0009) [2023-12-27 20:35:51,712][106225] Updated weights for policy 1, policy_version 190626 (0.0008) [2023-12-27 20:35:51,771][106225] Updated weights for policy 1, policy_version 190636 (0.0008) [2023-12-27 20:35:51,833][106225] Updated weights for policy 1, policy_version 190646 (0.0008) [2023-12-27 20:35:51,895][106225] Updated weights for policy 1, policy_version 190656 (0.0008) [2023-12-27 20:35:52,013][106226] Updated weights for policy 0, policy_version 190372 (0.0008) [2023-12-27 20:35:52,076][106226] Updated weights for policy 0, policy_version 190382 (0.0010) [2023-12-27 20:35:52,135][106226] Updated weights for policy 0, policy_version 190392 (0.0007) [2023-12-27 20:35:52,663][106225] Updated weights for policy 1, policy_version 190666 (0.0011) [2023-12-27 20:35:52,723][106225] Updated weights for policy 1, policy_version 190676 (0.0011) [2023-12-27 20:35:52,783][106225] Updated weights for policy 1, policy_version 190686 (0.0011) [2023-12-27 20:35:52,851][106226] Updated weights for policy 0, policy_version 190402 (0.0008) [2023-12-27 20:35:52,915][106226] Updated weights for policy 0, policy_version 190412 (0.0011) [2023-12-27 20:35:52,982][106226] Updated weights for policy 0, policy_version 190422 (0.0011) [2023-12-27 20:35:53,043][106226] Updated weights for policy 0, policy_version 190432 (0.0011) [2023-12-27 20:35:53,403][106225] Updated weights for policy 1, policy_version 190696 (0.0006) [2023-12-27 20:35:53,466][106225] Updated weights for policy 1, policy_version 190706 (0.0005) [2023-12-27 20:35:53,525][106225] Updated weights for policy 1, policy_version 190716 (0.0005) [2023-12-27 20:35:53,738][106226] Updated weights for policy 0, policy_version 190442 (0.0010) [2023-12-27 20:35:53,784][106226] Updated weights for policy 0, policy_version 190452 (0.0010) [2023-12-27 20:35:53,827][106226] Updated weights for policy 0, policy_version 190462 (0.0010) [2023-12-27 20:35:54,107][106225] Updated weights for policy 1, policy_version 190726 (0.0006) [2023-12-27 20:35:54,159][106225] Updated weights for policy 1, policy_version 190736 (0.0005) [2023-12-27 20:35:54,221][106225] Updated weights for policy 1, policy_version 190746 (0.0006) [2023-12-27 20:35:54,581][106226] Updated weights for policy 0, policy_version 190472 (0.0010) [2023-12-27 20:35:54,641][106226] Updated weights for policy 0, policy_version 190482 (0.0010) [2023-12-27 20:35:54,709][106226] Updated weights for policy 0, policy_version 190492 (0.0011) [2023-12-27 20:35:54,872][106225] Updated weights for policy 1, policy_version 190756 (0.0008) [2023-12-27 20:35:54,923][106225] Updated weights for policy 1, policy_version 190766 (0.0010) [2023-12-27 20:35:54,977][106225] Updated weights for policy 1, policy_version 190776 (0.0009) [2023-12-27 20:35:55,423][106226] Updated weights for policy 0, policy_version 190502 (0.0011) [2023-12-27 20:35:55,475][106226] Updated weights for policy 0, policy_version 190512 (0.0006) [2023-12-27 20:35:55,530][106226] Updated weights for policy 0, policy_version 190522 (0.0005) [2023-12-27 20:35:55,645][106225] Updated weights for policy 1, policy_version 190786 (0.0010) [2023-12-27 20:35:55,698][106225] Updated weights for policy 1, policy_version 190796 (0.0007) [2023-12-27 20:35:55,759][106225] Updated weights for policy 1, policy_version 190806 (0.0006) [2023-12-27 20:35:55,818][106225] Updated weights for policy 1, policy_version 190816 (0.0007) [2023-12-27 20:35:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 97640448. Throughput: 0: 9914.7, 1: 9881.0. Samples: 97611636. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:35:56,175][105115] Avg episode reward: [(0, '-5.622'), (1, '-6.936')] [2023-12-27 20:35:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000190816_48857088.pth... [2023-12-27 20:35:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000190528_48783360.pth... [2023-12-27 20:35:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000189664_48562176.pth [2023-12-27 20:35:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000189376_48488448.pth [2023-12-27 20:35:56,220][106226] Updated weights for policy 0, policy_version 190532 (0.0009) [2023-12-27 20:35:56,277][106226] Updated weights for policy 0, policy_version 190542 (0.0010) [2023-12-27 20:35:56,333][106226] Updated weights for policy 0, policy_version 190552 (0.0006) [2023-12-27 20:35:56,443][106225] Updated weights for policy 1, policy_version 190826 (0.0008) [2023-12-27 20:35:56,498][106225] Updated weights for policy 1, policy_version 190836 (0.0007) [2023-12-27 20:35:56,556][106225] Updated weights for policy 1, policy_version 190846 (0.0005) [2023-12-27 20:35:57,022][106226] Updated weights for policy 0, policy_version 190562 (0.0006) [2023-12-27 20:35:57,077][106226] Updated weights for policy 0, policy_version 190572 (0.0010) [2023-12-27 20:35:57,130][106226] Updated weights for policy 0, policy_version 190582 (0.0010) [2023-12-27 20:35:57,140][106225] Updated weights for policy 1, policy_version 190856 (0.0006) [2023-12-27 20:35:57,184][106226] Updated weights for policy 0, policy_version 190592 (0.0010) [2023-12-27 20:35:57,189][106225] Updated weights for policy 1, policy_version 190866 (0.0007) [2023-12-27 20:35:57,235][106225] Updated weights for policy 1, policy_version 190876 (0.0005) [2023-12-27 20:35:57,765][106225] Updated weights for policy 1, policy_version 190886 (0.0005) [2023-12-27 20:35:57,816][106225] Updated weights for policy 1, policy_version 190896 (0.0005) [2023-12-27 20:35:57,867][106225] Updated weights for policy 1, policy_version 190906 (0.0005) [2023-12-27 20:35:57,894][106226] Updated weights for policy 0, policy_version 190602 (0.0010) [2023-12-27 20:35:57,952][106226] Updated weights for policy 0, policy_version 190612 (0.0010) [2023-12-27 20:35:58,002][106226] Updated weights for policy 0, policy_version 190622 (0.0010) [2023-12-27 20:35:58,548][106225] Updated weights for policy 1, policy_version 190916 (0.0007) [2023-12-27 20:35:58,617][106225] Updated weights for policy 1, policy_version 190926 (0.0009) [2023-12-27 20:35:58,684][106225] Updated weights for policy 1, policy_version 190936 (0.0008) [2023-12-27 20:35:58,760][106226] Updated weights for policy 0, policy_version 190632 (0.0010) [2023-12-27 20:35:58,827][106226] Updated weights for policy 0, policy_version 190642 (0.0011) [2023-12-27 20:35:58,897][106226] Updated weights for policy 0, policy_version 190652 (0.0009) [2023-12-27 20:35:59,529][106225] Updated weights for policy 1, policy_version 190946 (0.0008) [2023-12-27 20:35:59,582][106225] Updated weights for policy 1, policy_version 190956 (0.0008) [2023-12-27 20:35:59,634][106225] Updated weights for policy 1, policy_version 190966 (0.0008) [2023-12-27 20:35:59,673][106226] Updated weights for policy 0, policy_version 190662 (0.0011) [2023-12-27 20:35:59,688][106225] Updated weights for policy 1, policy_version 190976 (0.0007) [2023-12-27 20:35:59,726][106226] Updated weights for policy 0, policy_version 190672 (0.0010) [2023-12-27 20:35:59,780][106226] Updated weights for policy 0, policy_version 190682 (0.0010) [2023-12-27 20:36:00,345][106225] Updated weights for policy 1, policy_version 190986 (0.0010) [2023-12-27 20:36:00,403][106225] Updated weights for policy 1, policy_version 190996 (0.0008) [2023-12-27 20:36:00,456][106225] Updated weights for policy 1, policy_version 191006 (0.0005) [2023-12-27 20:36:00,541][106226] Updated weights for policy 0, policy_version 190692 (0.0010) [2023-12-27 20:36:00,586][106226] Updated weights for policy 0, policy_version 190702 (0.0010) [2023-12-27 20:36:00,632][106226] Updated weights for policy 0, policy_version 190712 (0.0010) [2023-12-27 20:36:01,017][106225] Updated weights for policy 1, policy_version 191016 (0.0005) [2023-12-27 20:36:01,083][106225] Updated weights for policy 1, policy_version 191026 (0.0009) [2023-12-27 20:36:01,146][106225] Updated weights for policy 1, policy_version 191036 (0.0010) [2023-12-27 20:36:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 97746944. Throughput: 0: 9860.8, 1: 9998.6. Samples: 97731932. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:36:01,175][105115] Avg episode reward: [(0, '-5.564'), (1, '-6.996')] [2023-12-27 20:36:01,285][106226] Updated weights for policy 0, policy_version 190722 (0.0010) [2023-12-27 20:36:01,350][106226] Updated weights for policy 0, policy_version 190732 (0.0011) [2023-12-27 20:36:01,420][106226] Updated weights for policy 0, policy_version 190742 (0.0011) [2023-12-27 20:36:01,486][106226] Updated weights for policy 0, policy_version 190752 (0.0011) [2023-12-27 20:36:01,891][106225] Updated weights for policy 1, policy_version 191046 (0.0009) [2023-12-27 20:36:01,949][106225] Updated weights for policy 1, policy_version 191056 (0.0008) [2023-12-27 20:36:01,999][106225] Updated weights for policy 1, policy_version 191066 (0.0008) [2023-12-27 20:36:02,173][106226] Updated weights for policy 0, policy_version 190762 (0.0010) [2023-12-27 20:36:02,230][106226] Updated weights for policy 0, policy_version 190772 (0.0011) [2023-12-27 20:36:02,299][106226] Updated weights for policy 0, policy_version 190782 (0.0010) [2023-12-27 20:36:02,759][106225] Updated weights for policy 1, policy_version 191076 (0.0009) [2023-12-27 20:36:02,810][106225] Updated weights for policy 1, policy_version 191086 (0.0008) [2023-12-27 20:36:02,860][106225] Updated weights for policy 1, policy_version 191096 (0.0008) [2023-12-27 20:36:02,930][106226] Updated weights for policy 0, policy_version 190792 (0.0007) [2023-12-27 20:36:02,980][106226] Updated weights for policy 0, policy_version 190802 (0.0008) [2023-12-27 20:36:03,029][106226] Updated weights for policy 0, policy_version 190812 (0.0010) [2023-12-27 20:36:03,474][106225] Updated weights for policy 1, policy_version 191106 (0.0009) [2023-12-27 20:36:03,541][106225] Updated weights for policy 1, policy_version 191116 (0.0007) [2023-12-27 20:36:03,601][106225] Updated weights for policy 1, policy_version 191126 (0.0010) [2023-12-27 20:36:03,664][106225] Updated weights for policy 1, policy_version 191136 (0.0010) [2023-12-27 20:36:03,715][106226] Updated weights for policy 0, policy_version 190822 (0.0008) [2023-12-27 20:36:03,770][106226] Updated weights for policy 0, policy_version 190832 (0.0010) [2023-12-27 20:36:03,825][106226] Updated weights for policy 0, policy_version 190842 (0.0010) [2023-12-27 20:36:04,363][106225] Updated weights for policy 1, policy_version 191146 (0.0010) [2023-12-27 20:36:04,419][106225] Updated weights for policy 1, policy_version 191156 (0.0010) [2023-12-27 20:36:04,477][106225] Updated weights for policy 1, policy_version 191166 (0.0010) [2023-12-27 20:36:04,609][106226] Updated weights for policy 0, policy_version 190852 (0.0009) [2023-12-27 20:36:04,667][106226] Updated weights for policy 0, policy_version 190862 (0.0009) [2023-12-27 20:36:04,721][106226] Updated weights for policy 0, policy_version 190872 (0.0008) [2023-12-27 20:36:05,174][106225] Updated weights for policy 1, policy_version 191176 (0.0011) [2023-12-27 20:36:05,242][106225] Updated weights for policy 1, policy_version 191186 (0.0009) [2023-12-27 20:36:05,305][106225] Updated weights for policy 1, policy_version 191196 (0.0010) [2023-12-27 20:36:05,341][106226] Updated weights for policy 0, policy_version 190882 (0.0008) [2023-12-27 20:36:05,402][106226] Updated weights for policy 0, policy_version 190892 (0.0008) [2023-12-27 20:36:05,470][106226] Updated weights for policy 0, policy_version 190902 (0.0006) [2023-12-27 20:36:05,531][106226] Updated weights for policy 0, policy_version 190912 (0.0007) [2023-12-27 20:36:05,941][106225] Updated weights for policy 1, policy_version 191206 (0.0010) [2023-12-27 20:36:06,004][106225] Updated weights for policy 1, policy_version 191216 (0.0010) [2023-12-27 20:36:06,057][106225] Updated weights for policy 1, policy_version 191226 (0.0010) [2023-12-27 20:36:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 97845248. Throughput: 0: 9917.5, 1: 10006.1. Samples: 97854168. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:36:06,175][105115] Avg episode reward: [(0, '-5.372'), (1, '-7.184')] [2023-12-27 20:36:06,272][106226] Updated weights for policy 0, policy_version 190922 (0.0009) [2023-12-27 20:36:06,338][106226] Updated weights for policy 0, policy_version 190932 (0.0010) [2023-12-27 20:36:06,400][106226] Updated weights for policy 0, policy_version 190942 (0.0008) [2023-12-27 20:36:06,779][106225] Updated weights for policy 1, policy_version 191236 (0.0009) [2023-12-27 20:36:06,830][106225] Updated weights for policy 1, policy_version 191246 (0.0010) [2023-12-27 20:36:06,888][106225] Updated weights for policy 1, policy_version 191256 (0.0010) [2023-12-27 20:36:07,018][106226] Updated weights for policy 0, policy_version 190952 (0.0010) [2023-12-27 20:36:07,077][106226] Updated weights for policy 0, policy_version 190962 (0.0010) [2023-12-27 20:36:07,137][106226] Updated weights for policy 0, policy_version 190972 (0.0008) [2023-12-27 20:36:07,605][106225] Updated weights for policy 1, policy_version 191266 (0.0009) [2023-12-27 20:36:07,661][106225] Updated weights for policy 1, policy_version 191276 (0.0005) [2023-12-27 20:36:07,710][106225] Updated weights for policy 1, policy_version 191286 (0.0006) [2023-12-27 20:36:07,759][106225] Updated weights for policy 1, policy_version 191296 (0.0005) [2023-12-27 20:36:07,777][106226] Updated weights for policy 0, policy_version 190982 (0.0009) [2023-12-27 20:36:07,842][106226] Updated weights for policy 0, policy_version 190992 (0.0008) [2023-12-27 20:36:07,908][106226] Updated weights for policy 0, policy_version 191002 (0.0008) [2023-12-27 20:36:08,386][106225] Updated weights for policy 1, policy_version 191306 (0.0010) [2023-12-27 20:36:08,449][106225] Updated weights for policy 1, policy_version 191316 (0.0009) [2023-12-27 20:36:08,516][106225] Updated weights for policy 1, policy_version 191326 (0.0011) [2023-12-27 20:36:08,608][106226] Updated weights for policy 0, policy_version 191012 (0.0007) [2023-12-27 20:36:08,666][106226] Updated weights for policy 0, policy_version 191022 (0.0007) [2023-12-27 20:36:08,718][106226] Updated weights for policy 0, policy_version 191032 (0.0006) [2023-12-27 20:36:09,230][106225] Updated weights for policy 1, policy_version 191336 (0.0009) [2023-12-27 20:36:09,293][106225] Updated weights for policy 1, policy_version 191346 (0.0007) [2023-12-27 20:36:09,359][106225] Updated weights for policy 1, policy_version 191356 (0.0008) [2023-12-27 20:36:09,375][106226] Updated weights for policy 0, policy_version 191042 (0.0006) [2023-12-27 20:36:09,447][106226] Updated weights for policy 0, policy_version 191052 (0.0008) [2023-12-27 20:36:09,506][106226] Updated weights for policy 0, policy_version 191062 (0.0008) [2023-12-27 20:36:09,573][106226] Updated weights for policy 0, policy_version 191072 (0.0008) [2023-12-27 20:36:10,101][106225] Updated weights for policy 1, policy_version 191366 (0.0008) [2023-12-27 20:36:10,162][106225] Updated weights for policy 1, policy_version 191376 (0.0007) [2023-12-27 20:36:10,224][106225] Updated weights for policy 1, policy_version 191386 (0.0008) [2023-12-27 20:36:10,311][106226] Updated weights for policy 0, policy_version 191082 (0.0008) [2023-12-27 20:36:10,373][106226] Updated weights for policy 0, policy_version 191092 (0.0008) [2023-12-27 20:36:10,438][106226] Updated weights for policy 0, policy_version 191102 (0.0007) [2023-12-27 20:36:10,964][106225] Updated weights for policy 1, policy_version 191396 (0.0009) [2023-12-27 20:36:11,019][106225] Updated weights for policy 1, policy_version 191406 (0.0008) [2023-12-27 20:36:11,082][106226] Updated weights for policy 0, policy_version 191112 (0.0008) [2023-12-27 20:36:11,087][106225] Updated weights for policy 1, policy_version 191416 (0.0007) [2023-12-27 20:36:11,152][106226] Updated weights for policy 0, policy_version 191122 (0.0008) [2023-12-27 20:36:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 97943552. Throughput: 0: 9944.1, 1: 10071.8. Samples: 97915664. Policy #0 lag: (min: 23.0, avg: 28.6, max: 55.0) [2023-12-27 20:36:11,175][105115] Avg episode reward: [(0, '-5.378'), (1, '-6.660')] [2023-12-27 20:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000191424_49012736.pth... [2023-12-27 20:36:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000190240_48709632.pth [2023-12-27 20:36:11,213][106226] Updated weights for policy 0, policy_version 191132 (0.0009) [2023-12-27 20:36:11,237][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000191136_48939008.pth... [2023-12-27 20:36:11,241][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000189984_48644096.pth [2023-12-27 20:36:11,883][106225] Updated weights for policy 1, policy_version 191426 (0.0008) [2023-12-27 20:36:11,935][106225] Updated weights for policy 1, policy_version 191436 (0.0008) [2023-12-27 20:36:11,996][106226] Updated weights for policy 0, policy_version 191142 (0.0007) [2023-12-27 20:36:11,997][106225] Updated weights for policy 1, policy_version 191446 (0.0009) [2023-12-27 20:36:12,056][106226] Updated weights for policy 0, policy_version 191152 (0.0006) [2023-12-27 20:36:12,056][106225] Updated weights for policy 1, policy_version 191456 (0.0008) [2023-12-27 20:36:12,118][106226] Updated weights for policy 0, policy_version 191162 (0.0009) [2023-12-27 20:36:12,772][106226] Updated weights for policy 0, policy_version 191172 (0.0008) [2023-12-27 20:36:12,829][106226] Updated weights for policy 0, policy_version 191182 (0.0007) [2023-12-27 20:36:12,852][106225] Updated weights for policy 1, policy_version 191466 (0.0008) [2023-12-27 20:36:12,892][106226] Updated weights for policy 0, policy_version 191192 (0.0008) [2023-12-27 20:36:12,918][106225] Updated weights for policy 1, policy_version 191476 (0.0007) [2023-12-27 20:36:12,972][106225] Updated weights for policy 1, policy_version 191486 (0.0007) [2023-12-27 20:36:13,505][106226] Updated weights for policy 0, policy_version 191202 (0.0008) [2023-12-27 20:36:13,569][106226] Updated weights for policy 0, policy_version 191212 (0.0011) [2023-12-27 20:36:13,636][106226] Updated weights for policy 0, policy_version 191222 (0.0006) [2023-12-27 20:36:13,694][106225] Updated weights for policy 1, policy_version 191496 (0.0007) [2023-12-27 20:36:13,703][106226] Updated weights for policy 0, policy_version 191232 (0.0006) [2023-12-27 20:36:13,749][106225] Updated weights for policy 1, policy_version 191506 (0.0009) [2023-12-27 20:36:13,799][106225] Updated weights for policy 1, policy_version 191516 (0.0009) [2023-12-27 20:36:14,245][106226] Updated weights for policy 0, policy_version 191242 (0.0009) [2023-12-27 20:36:14,294][106226] Updated weights for policy 0, policy_version 191252 (0.0010) [2023-12-27 20:36:14,357][106226] Updated weights for policy 0, policy_version 191262 (0.0011) [2023-12-27 20:36:14,517][106225] Updated weights for policy 1, policy_version 191526 (0.0007) [2023-12-27 20:36:14,579][106225] Updated weights for policy 1, policy_version 191536 (0.0006) [2023-12-27 20:36:14,635][106225] Updated weights for policy 1, policy_version 191546 (0.0006) [2023-12-27 20:36:14,978][106226] Updated weights for policy 0, policy_version 191272 (0.0009) [2023-12-27 20:36:15,035][106226] Updated weights for policy 0, policy_version 191282 (0.0009) [2023-12-27 20:36:15,121][106226] Updated weights for policy 0, policy_version 191292 (0.0009) [2023-12-27 20:36:15,295][106225] Updated weights for policy 1, policy_version 191556 (0.0007) [2023-12-27 20:36:15,359][106225] Updated weights for policy 1, policy_version 191566 (0.0008) [2023-12-27 20:36:15,416][106225] Updated weights for policy 1, policy_version 191576 (0.0009) [2023-12-27 20:36:15,795][106226] Updated weights for policy 0, policy_version 191302 (0.0006) [2023-12-27 20:36:15,860][106226] Updated weights for policy 0, policy_version 191312 (0.0005) [2023-12-27 20:36:15,914][106226] Updated weights for policy 0, policy_version 191322 (0.0007) [2023-12-27 20:36:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 98041856. Throughput: 0: 9962.1, 1: 9942.7. Samples: 98032876. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:16,176][105115] Avg episode reward: [(0, '-5.356'), (1, '-6.817')] [2023-12-27 20:36:16,201][106225] Updated weights for policy 1, policy_version 191586 (0.0008) [2023-12-27 20:36:16,255][106225] Updated weights for policy 1, policy_version 191596 (0.0010) [2023-12-27 20:36:16,309][106225] Updated weights for policy 1, policy_version 191606 (0.0010) [2023-12-27 20:36:16,355][106225] Updated weights for policy 1, policy_version 191616 (0.0010) [2023-12-27 20:36:16,595][106226] Updated weights for policy 0, policy_version 191332 (0.0009) [2023-12-27 20:36:16,640][106226] Updated weights for policy 0, policy_version 191342 (0.0008) [2023-12-27 20:36:16,688][106226] Updated weights for policy 0, policy_version 191352 (0.0008) [2023-12-27 20:36:17,066][106225] Updated weights for policy 1, policy_version 191626 (0.0005) [2023-12-27 20:36:17,120][106225] Updated weights for policy 1, policy_version 191636 (0.0005) [2023-12-27 20:36:17,173][106225] Updated weights for policy 1, policy_version 191646 (0.0005) [2023-12-27 20:36:17,471][106226] Updated weights for policy 0, policy_version 191362 (0.0009) [2023-12-27 20:36:17,529][106226] Updated weights for policy 0, policy_version 191372 (0.0008) [2023-12-27 20:36:17,595][106226] Updated weights for policy 0, policy_version 191382 (0.0009) [2023-12-27 20:36:17,664][106226] Updated weights for policy 0, policy_version 191392 (0.0008) [2023-12-27 20:36:17,771][106225] Updated weights for policy 1, policy_version 191656 (0.0007) [2023-12-27 20:36:17,835][106225] Updated weights for policy 1, policy_version 191666 (0.0005) [2023-12-27 20:36:17,896][106225] Updated weights for policy 1, policy_version 191676 (0.0006) [2023-12-27 20:36:18,461][106225] Updated weights for policy 1, policy_version 191686 (0.0006) [2023-12-27 20:36:18,463][106226] Updated weights for policy 0, policy_version 191402 (0.0007) [2023-12-27 20:36:18,522][106226] Updated weights for policy 0, policy_version 191412 (0.0006) [2023-12-27 20:36:18,524][106225] Updated weights for policy 1, policy_version 191696 (0.0008) [2023-12-27 20:36:18,580][106226] Updated weights for policy 0, policy_version 191422 (0.0007) [2023-12-27 20:36:18,587][106225] Updated weights for policy 1, policy_version 191706 (0.0007) [2023-12-27 20:36:19,269][106226] Updated weights for policy 0, policy_version 191432 (0.0008) [2023-12-27 20:36:19,324][106226] Updated weights for policy 0, policy_version 191442 (0.0006) [2023-12-27 20:36:19,329][106225] Updated weights for policy 1, policy_version 191716 (0.0008) [2023-12-27 20:36:19,391][106226] Updated weights for policy 0, policy_version 191452 (0.0011) [2023-12-27 20:36:19,395][106225] Updated weights for policy 1, policy_version 191726 (0.0007) [2023-12-27 20:36:19,468][106225] Updated weights for policy 1, policy_version 191736 (0.0006) [2023-12-27 20:36:20,062][106226] Updated weights for policy 0, policy_version 191462 (0.0006) [2023-12-27 20:36:20,133][106226] Updated weights for policy 0, policy_version 191472 (0.0006) [2023-12-27 20:36:20,172][106225] Updated weights for policy 1, policy_version 191746 (0.0008) [2023-12-27 20:36:20,197][106226] Updated weights for policy 0, policy_version 191482 (0.0007) [2023-12-27 20:36:20,231][106225] Updated weights for policy 1, policy_version 191756 (0.0007) [2023-12-27 20:36:20,280][106225] Updated weights for policy 1, policy_version 191766 (0.0008) [2023-12-27 20:36:20,325][106225] Updated weights for policy 1, policy_version 191776 (0.0008) [2023-12-27 20:36:20,856][106226] Updated weights for policy 0, policy_version 191492 (0.0009) [2023-12-27 20:36:20,911][106226] Updated weights for policy 0, policy_version 191502 (0.0009) [2023-12-27 20:36:20,974][106226] Updated weights for policy 0, policy_version 191512 (0.0010) [2023-12-27 20:36:21,159][106225] Updated weights for policy 1, policy_version 191786 (0.0009) [2023-12-27 20:36:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 98140160. Throughput: 0: 9888.5, 1: 9916.4. Samples: 98150244. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:21,175][105115] Avg episode reward: [(0, '-5.528'), (1, '-6.781')] [2023-12-27 20:36:21,211][106225] Updated weights for policy 1, policy_version 191796 (0.0007) [2023-12-27 20:36:21,274][106225] Updated weights for policy 1, policy_version 191806 (0.0008) [2023-12-27 20:36:21,799][106226] Updated weights for policy 0, policy_version 191522 (0.0009) [2023-12-27 20:36:21,863][106226] Updated weights for policy 0, policy_version 191532 (0.0008) [2023-12-27 20:36:21,923][106226] Updated weights for policy 0, policy_version 191542 (0.0008) [2023-12-27 20:36:21,978][106225] Updated weights for policy 1, policy_version 191816 (0.0006) [2023-12-27 20:36:21,980][106226] Updated weights for policy 0, policy_version 191552 (0.0008) [2023-12-27 20:36:22,038][106225] Updated weights for policy 1, policy_version 191826 (0.0007) [2023-12-27 20:36:22,102][106225] Updated weights for policy 1, policy_version 191836 (0.0009) [2023-12-27 20:36:22,717][106226] Updated weights for policy 0, policy_version 191562 (0.0008) [2023-12-27 20:36:22,776][106226] Updated weights for policy 0, policy_version 191572 (0.0009) [2023-12-27 20:36:22,834][106225] Updated weights for policy 1, policy_version 191846 (0.0007) [2023-12-27 20:36:22,837][106226] Updated weights for policy 0, policy_version 191582 (0.0007) [2023-12-27 20:36:22,895][106225] Updated weights for policy 1, policy_version 191856 (0.0008) [2023-12-27 20:36:22,950][106225] Updated weights for policy 1, policy_version 191866 (0.0009) [2023-12-27 20:36:23,518][106226] Updated weights for policy 0, policy_version 191592 (0.0007) [2023-12-27 20:36:23,566][106226] Updated weights for policy 0, policy_version 191602 (0.0008) [2023-12-27 20:36:23,605][106225] Updated weights for policy 1, policy_version 191876 (0.0008) [2023-12-27 20:36:23,615][106226] Updated weights for policy 0, policy_version 191612 (0.0007) [2023-12-27 20:36:23,661][106225] Updated weights for policy 1, policy_version 191886 (0.0007) [2023-12-27 20:36:23,726][106225] Updated weights for policy 1, policy_version 191896 (0.0008) [2023-12-27 20:36:24,204][106226] Updated weights for policy 0, policy_version 191622 (0.0006) [2023-12-27 20:36:24,263][106226] Updated weights for policy 0, policy_version 191632 (0.0006) [2023-12-27 20:36:24,315][106226] Updated weights for policy 0, policy_version 191642 (0.0005) [2023-12-27 20:36:24,420][106225] Updated weights for policy 1, policy_version 191906 (0.0011) [2023-12-27 20:36:24,476][106225] Updated weights for policy 1, policy_version 191916 (0.0008) [2023-12-27 20:36:24,524][106225] Updated weights for policy 1, policy_version 191926 (0.0010) [2023-12-27 20:36:24,573][106225] Updated weights for policy 1, policy_version 191936 (0.0010) [2023-12-27 20:36:24,957][106226] Updated weights for policy 0, policy_version 191652 (0.0005) [2023-12-27 20:36:25,033][106226] Updated weights for policy 0, policy_version 191662 (0.0007) [2023-12-27 20:36:25,103][106226] Updated weights for policy 0, policy_version 191672 (0.0005) [2023-12-27 20:36:25,220][106225] Updated weights for policy 1, policy_version 191946 (0.0010) [2023-12-27 20:36:25,266][106225] Updated weights for policy 1, policy_version 191956 (0.0010) [2023-12-27 20:36:25,313][106225] Updated weights for policy 1, policy_version 191966 (0.0010) [2023-12-27 20:36:25,781][106226] Updated weights for policy 0, policy_version 191682 (0.0007) [2023-12-27 20:36:25,832][106226] Updated weights for policy 0, policy_version 191692 (0.0007) [2023-12-27 20:36:25,889][106226] Updated weights for policy 0, policy_version 191702 (0.0009) [2023-12-27 20:36:25,946][106226] Updated weights for policy 0, policy_version 191712 (0.0008) [2023-12-27 20:36:25,985][106225] Updated weights for policy 1, policy_version 191976 (0.0009) [2023-12-27 20:36:26,036][106225] Updated weights for policy 1, policy_version 191986 (0.0007) [2023-12-27 20:36:26,078][106225] Updated weights for policy 1, policy_version 191996 (0.0006) [2023-12-27 20:36:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 98246656. Throughput: 0: 9865.7, 1: 9931.7. Samples: 98208948. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:26,176][105115] Avg episode reward: [(0, '-5.496'), (1, '-6.968')] [2023-12-27 20:36:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000192000_49160192.pth... [2023-12-27 20:36:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000191712_49086464.pth... [2023-12-27 20:36:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000190816_48857088.pth [2023-12-27 20:36:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000190528_48783360.pth [2023-12-27 20:36:26,678][106225] Updated weights for policy 1, policy_version 192006 (0.0007) [2023-12-27 20:36:26,726][106225] Updated weights for policy 1, policy_version 192016 (0.0007) [2023-12-27 20:36:26,728][106226] Updated weights for policy 0, policy_version 191722 (0.0007) [2023-12-27 20:36:26,778][106225] Updated weights for policy 1, policy_version 192026 (0.0007) [2023-12-27 20:36:26,786][106226] Updated weights for policy 0, policy_version 191732 (0.0006) [2023-12-27 20:36:26,845][106226] Updated weights for policy 0, policy_version 191742 (0.0009) [2023-12-27 20:36:27,447][106225] Updated weights for policy 1, policy_version 192036 (0.0006) [2023-12-27 20:36:27,495][106226] Updated weights for policy 0, policy_version 191752 (0.0006) [2023-12-27 20:36:27,496][106225] Updated weights for policy 1, policy_version 192046 (0.0005) [2023-12-27 20:36:27,549][106226] Updated weights for policy 0, policy_version 191762 (0.0006) [2023-12-27 20:36:27,551][106225] Updated weights for policy 1, policy_version 192056 (0.0007) [2023-12-27 20:36:27,598][106226] Updated weights for policy 0, policy_version 191772 (0.0005) [2023-12-27 20:36:28,126][106226] Updated weights for policy 0, policy_version 191782 (0.0007) [2023-12-27 20:36:28,186][106226] Updated weights for policy 0, policy_version 191792 (0.0006) [2023-12-27 20:36:28,243][106226] Updated weights for policy 0, policy_version 191802 (0.0008) [2023-12-27 20:36:28,300][106225] Updated weights for policy 1, policy_version 192066 (0.0008) [2023-12-27 20:36:28,362][106225] Updated weights for policy 1, policy_version 192076 (0.0007) [2023-12-27 20:36:28,424][106225] Updated weights for policy 1, policy_version 192086 (0.0008) [2023-12-27 20:36:28,485][106225] Updated weights for policy 1, policy_version 192096 (0.0008) [2023-12-27 20:36:28,957][106226] Updated weights for policy 0, policy_version 191812 (0.0008) [2023-12-27 20:36:29,005][106226] Updated weights for policy 0, policy_version 191822 (0.0008) [2023-12-27 20:36:29,053][106226] Updated weights for policy 0, policy_version 191832 (0.0008) [2023-12-27 20:36:29,202][106225] Updated weights for policy 1, policy_version 192106 (0.0008) [2023-12-27 20:36:29,266][106225] Updated weights for policy 1, policy_version 192116 (0.0009) [2023-12-27 20:36:29,327][106225] Updated weights for policy 1, policy_version 192126 (0.0006) [2023-12-27 20:36:29,850][106226] Updated weights for policy 0, policy_version 191842 (0.0008) [2023-12-27 20:36:29,912][106226] Updated weights for policy 0, policy_version 191852 (0.0008) [2023-12-27 20:36:29,981][106226] Updated weights for policy 0, policy_version 191862 (0.0010) [2023-12-27 20:36:30,046][106226] Updated weights for policy 0, policy_version 191872 (0.0009) [2023-12-27 20:36:30,057][106225] Updated weights for policy 1, policy_version 192136 (0.0006) [2023-12-27 20:36:30,117][106225] Updated weights for policy 1, policy_version 192146 (0.0009) [2023-12-27 20:36:30,166][106225] Updated weights for policy 1, policy_version 192156 (0.0009) [2023-12-27 20:36:30,676][106226] Updated weights for policy 0, policy_version 191882 (0.0006) [2023-12-27 20:36:30,736][106226] Updated weights for policy 0, policy_version 191892 (0.0009) [2023-12-27 20:36:30,791][106226] Updated weights for policy 0, policy_version 191902 (0.0008) [2023-12-27 20:36:30,901][106225] Updated weights for policy 1, policy_version 192166 (0.0007) [2023-12-27 20:36:30,955][106225] Updated weights for policy 1, policy_version 192176 (0.0007) [2023-12-27 20:36:31,008][106225] Updated weights for policy 1, policy_version 192186 (0.0005) [2023-12-27 20:36:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 98344960. Throughput: 0: 9914.0, 1: 10041.4. Samples: 98330900. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:31,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-6.936')] [2023-12-27 20:36:31,554][106226] Updated weights for policy 0, policy_version 191912 (0.0009) [2023-12-27 20:36:31,614][106226] Updated weights for policy 0, policy_version 191922 (0.0009) [2023-12-27 20:36:31,683][106226] Updated weights for policy 0, policy_version 191932 (0.0006) [2023-12-27 20:36:31,709][106225] Updated weights for policy 1, policy_version 192196 (0.0006) [2023-12-27 20:36:31,773][106225] Updated weights for policy 1, policy_version 192206 (0.0009) [2023-12-27 20:36:31,835][106225] Updated weights for policy 1, policy_version 192216 (0.0008) [2023-12-27 20:36:32,402][106226] Updated weights for policy 0, policy_version 191942 (0.0009) [2023-12-27 20:36:32,460][106226] Updated weights for policy 0, policy_version 191952 (0.0009) [2023-12-27 20:36:32,515][106226] Updated weights for policy 0, policy_version 191962 (0.0009) [2023-12-27 20:36:32,538][106225] Updated weights for policy 1, policy_version 192226 (0.0008) [2023-12-27 20:36:32,605][106225] Updated weights for policy 1, policy_version 192236 (0.0005) [2023-12-27 20:36:32,669][106225] Updated weights for policy 1, policy_version 192246 (0.0005) [2023-12-27 20:36:32,731][106225] Updated weights for policy 1, policy_version 192256 (0.0006) [2023-12-27 20:36:33,282][106226] Updated weights for policy 0, policy_version 191972 (0.0007) [2023-12-27 20:36:33,330][106226] Updated weights for policy 0, policy_version 191982 (0.0005) [2023-12-27 20:36:33,345][106225] Updated weights for policy 1, policy_version 192266 (0.0010) [2023-12-27 20:36:33,382][106226] Updated weights for policy 0, policy_version 191992 (0.0005) [2023-12-27 20:36:33,388][106225] Updated weights for policy 1, policy_version 192276 (0.0010) [2023-12-27 20:36:33,431][106225] Updated weights for policy 1, policy_version 192286 (0.0010) [2023-12-27 20:36:33,973][106226] Updated weights for policy 0, policy_version 192002 (0.0005) [2023-12-27 20:36:34,037][106226] Updated weights for policy 0, policy_version 192012 (0.0005) [2023-12-27 20:36:34,086][106226] Updated weights for policy 0, policy_version 192022 (0.0006) [2023-12-27 20:36:34,116][106225] Updated weights for policy 1, policy_version 192296 (0.0010) [2023-12-27 20:36:34,138][106226] Updated weights for policy 0, policy_version 192032 (0.0006) [2023-12-27 20:36:34,175][106225] Updated weights for policy 1, policy_version 192306 (0.0011) [2023-12-27 20:36:34,222][106225] Updated weights for policy 1, policy_version 192316 (0.0008) [2023-12-27 20:36:34,842][106226] Updated weights for policy 0, policy_version 192042 (0.0010) [2023-12-27 20:36:34,883][106225] Updated weights for policy 1, policy_version 192326 (0.0006) [2023-12-27 20:36:34,899][106226] Updated weights for policy 0, policy_version 192052 (0.0008) [2023-12-27 20:36:34,932][106225] Updated weights for policy 1, policy_version 192336 (0.0007) [2023-12-27 20:36:34,955][106226] Updated weights for policy 0, policy_version 192062 (0.0007) [2023-12-27 20:36:34,991][106225] Updated weights for policy 1, policy_version 192346 (0.0008) [2023-12-27 20:36:35,730][106225] Updated weights for policy 1, policy_version 192356 (0.0008) [2023-12-27 20:36:35,731][106226] Updated weights for policy 0, policy_version 192072 (0.0006) [2023-12-27 20:36:35,779][106225] Updated weights for policy 1, policy_version 192366 (0.0008) [2023-12-27 20:36:35,795][106226] Updated weights for policy 0, policy_version 192082 (0.0005) [2023-12-27 20:36:35,832][106225] Updated weights for policy 1, policy_version 192376 (0.0007) [2023-12-27 20:36:35,852][106226] Updated weights for policy 0, policy_version 192092 (0.0008) [2023-12-27 20:36:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 98443264. Throughput: 0: 9937.0, 1: 10013.8. Samples: 98451804. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:36,175][105115] Avg episode reward: [(0, '-4.947'), (1, '-6.522')] [2023-12-27 20:36:36,462][106226] Updated weights for policy 0, policy_version 192102 (0.0005) [2023-12-27 20:36:36,528][106226] Updated weights for policy 0, policy_version 192112 (0.0006) [2023-12-27 20:36:36,594][106226] Updated weights for policy 0, policy_version 192122 (0.0006) [2023-12-27 20:36:36,622][106225] Updated weights for policy 1, policy_version 192386 (0.0008) [2023-12-27 20:36:36,684][106225] Updated weights for policy 1, policy_version 192396 (0.0009) [2023-12-27 20:36:36,748][106225] Updated weights for policy 1, policy_version 192406 (0.0008) [2023-12-27 20:36:36,808][106225] Updated weights for policy 1, policy_version 192416 (0.0009) [2023-12-27 20:36:37,220][106226] Updated weights for policy 0, policy_version 192132 (0.0008) [2023-12-27 20:36:37,273][106226] Updated weights for policy 0, policy_version 192142 (0.0009) [2023-12-27 20:36:37,334][106226] Updated weights for policy 0, policy_version 192152 (0.0008) [2023-12-27 20:36:37,555][106225] Updated weights for policy 1, policy_version 192426 (0.0009) [2023-12-27 20:36:37,621][106225] Updated weights for policy 1, policy_version 192436 (0.0009) [2023-12-27 20:36:37,684][106225] Updated weights for policy 1, policy_version 192446 (0.0008) [2023-12-27 20:36:38,043][106226] Updated weights for policy 0, policy_version 192162 (0.0008) [2023-12-27 20:36:38,091][106226] Updated weights for policy 0, policy_version 192172 (0.0008) [2023-12-27 20:36:38,147][106226] Updated weights for policy 0, policy_version 192182 (0.0007) [2023-12-27 20:36:38,201][106226] Updated weights for policy 0, policy_version 192192 (0.0007) [2023-12-27 20:36:38,423][106225] Updated weights for policy 1, policy_version 192456 (0.0008) [2023-12-27 20:36:38,484][106225] Updated weights for policy 1, policy_version 192466 (0.0009) [2023-12-27 20:36:38,538][106225] Updated weights for policy 1, policy_version 192476 (0.0008) [2023-12-27 20:36:38,857][106226] Updated weights for policy 0, policy_version 192202 (0.0005) [2023-12-27 20:36:38,921][106226] Updated weights for policy 0, policy_version 192212 (0.0006) [2023-12-27 20:36:38,984][106226] Updated weights for policy 0, policy_version 192222 (0.0008) [2023-12-27 20:36:39,314][106225] Updated weights for policy 1, policy_version 192486 (0.0007) [2023-12-27 20:36:39,381][106225] Updated weights for policy 1, policy_version 192496 (0.0007) [2023-12-27 20:36:39,448][106225] Updated weights for policy 1, policy_version 192506 (0.0008) [2023-12-27 20:36:39,666][106226] Updated weights for policy 0, policy_version 192232 (0.0010) [2023-12-27 20:36:39,732][106226] Updated weights for policy 0, policy_version 192242 (0.0011) [2023-12-27 20:36:39,798][106226] Updated weights for policy 0, policy_version 192252 (0.0011) [2023-12-27 20:36:40,212][106225] Updated weights for policy 1, policy_version 192516 (0.0008) [2023-12-27 20:36:40,271][106225] Updated weights for policy 1, policy_version 192526 (0.0008) [2023-12-27 20:36:40,332][106225] Updated weights for policy 1, policy_version 192536 (0.0007) [2023-12-27 20:36:40,509][106226] Updated weights for policy 0, policy_version 192262 (0.0010) [2023-12-27 20:36:40,572][106226] Updated weights for policy 0, policy_version 192272 (0.0006) [2023-12-27 20:36:40,638][106226] Updated weights for policy 0, policy_version 192282 (0.0008) [2023-12-27 20:36:41,126][106225] Updated weights for policy 1, policy_version 192546 (0.0008) [2023-12-27 20:36:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 98533376. Throughput: 0: 9993.1, 1: 9977.4. Samples: 98510308. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:41,175][105115] Avg episode reward: [(0, '-5.331'), (1, '-6.369')] [2023-12-27 20:36:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000192288_49233920.pth... [2023-12-27 20:36:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000191136_48939008.pth [2023-12-27 20:36:41,195][106225] Updated weights for policy 1, policy_version 192556 (0.0007) [2023-12-27 20:36:41,250][106226] Updated weights for policy 0, policy_version 192292 (0.0006) [2023-12-27 20:36:41,253][106225] Updated weights for policy 1, policy_version 192566 (0.0008) [2023-12-27 20:36:41,309][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000192576_49307648.pth... [2023-12-27 20:36:41,310][106226] Updated weights for policy 0, policy_version 192302 (0.0006) [2023-12-27 20:36:41,311][106225] Updated weights for policy 1, policy_version 192576 (0.0008) [2023-12-27 20:36:41,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000191424_49012736.pth [2023-12-27 20:36:41,381][106226] Updated weights for policy 0, policy_version 192312 (0.0008) [2023-12-27 20:36:42,092][106225] Updated weights for policy 1, policy_version 192586 (0.0008) [2023-12-27 20:36:42,154][106225] Updated weights for policy 1, policy_version 192596 (0.0009) [2023-12-27 20:36:42,175][106226] Updated weights for policy 0, policy_version 192322 (0.0008) [2023-12-27 20:36:42,222][106225] Updated weights for policy 1, policy_version 192606 (0.0008) [2023-12-27 20:36:42,234][106226] Updated weights for policy 0, policy_version 192332 (0.0006) [2023-12-27 20:36:42,298][106226] Updated weights for policy 0, policy_version 192342 (0.0008) [2023-12-27 20:36:42,370][106226] Updated weights for policy 0, policy_version 192352 (0.0011) [2023-12-27 20:36:42,911][106225] Updated weights for policy 1, policy_version 192616 (0.0008) [2023-12-27 20:36:42,970][106225] Updated weights for policy 1, policy_version 192626 (0.0008) [2023-12-27 20:36:42,984][106226] Updated weights for policy 0, policy_version 192362 (0.0006) [2023-12-27 20:36:43,026][106225] Updated weights for policy 1, policy_version 192636 (0.0008) [2023-12-27 20:36:43,042][106226] Updated weights for policy 0, policy_version 192372 (0.0010) [2023-12-27 20:36:43,098][106226] Updated weights for policy 0, policy_version 192382 (0.0010) [2023-12-27 20:36:43,652][106226] Updated weights for policy 0, policy_version 192392 (0.0006) [2023-12-27 20:36:43,699][106226] Updated weights for policy 0, policy_version 192402 (0.0005) [2023-12-27 20:36:43,745][106226] Updated weights for policy 0, policy_version 192412 (0.0005) [2023-12-27 20:36:43,826][106225] Updated weights for policy 1, policy_version 192646 (0.0007) [2023-12-27 20:36:43,875][106225] Updated weights for policy 1, policy_version 192656 (0.0008) [2023-12-27 20:36:43,924][106225] Updated weights for policy 1, policy_version 192666 (0.0009) [2023-12-27 20:36:44,328][106226] Updated weights for policy 0, policy_version 192422 (0.0008) [2023-12-27 20:36:44,392][106226] Updated weights for policy 0, policy_version 192432 (0.0011) [2023-12-27 20:36:44,448][106226] Updated weights for policy 0, policy_version 192442 (0.0008) [2023-12-27 20:36:44,677][106225] Updated weights for policy 1, policy_version 192676 (0.0009) [2023-12-27 20:36:44,728][106225] Updated weights for policy 1, policy_version 192686 (0.0010) [2023-12-27 20:36:44,782][106225] Updated weights for policy 1, policy_version 192696 (0.0010) [2023-12-27 20:36:45,169][106226] Updated weights for policy 0, policy_version 192452 (0.0008) [2023-12-27 20:36:45,232][106226] Updated weights for policy 0, policy_version 192462 (0.0009) [2023-12-27 20:36:45,293][106226] Updated weights for policy 0, policy_version 192472 (0.0008) [2023-12-27 20:36:45,561][106225] Updated weights for policy 1, policy_version 192706 (0.0010) [2023-12-27 20:36:45,608][106225] Updated weights for policy 1, policy_version 192716 (0.0010) [2023-12-27 20:36:45,660][106225] Updated weights for policy 1, policy_version 192726 (0.0011) [2023-12-27 20:36:45,713][106225] Updated weights for policy 1, policy_version 192736 (0.0010) [2023-12-27 20:36:45,912][106226] Updated weights for policy 0, policy_version 192482 (0.0006) [2023-12-27 20:36:45,962][106226] Updated weights for policy 0, policy_version 192492 (0.0008) [2023-12-27 20:36:46,010][106226] Updated weights for policy 0, policy_version 192502 (0.0008) [2023-12-27 20:36:46,066][106226] Updated weights for policy 0, policy_version 192512 (0.0008) [2023-12-27 20:36:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 98639872. Throughput: 0: 10086.0, 1: 9802.5. Samples: 98626916. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:46,175][105115] Avg episode reward: [(0, '-5.204'), (1, '-6.409')] [2023-12-27 20:36:46,452][106225] Updated weights for policy 1, policy_version 192746 (0.0010) [2023-12-27 20:36:46,517][106225] Updated weights for policy 1, policy_version 192756 (0.0010) [2023-12-27 20:36:46,574][106225] Updated weights for policy 1, policy_version 192766 (0.0010) [2023-12-27 20:36:46,707][106226] Updated weights for policy 0, policy_version 192522 (0.0008) [2023-12-27 20:36:46,757][106226] Updated weights for policy 0, policy_version 192532 (0.0008) [2023-12-27 20:36:46,808][106226] Updated weights for policy 0, policy_version 192542 (0.0008) [2023-12-27 20:36:47,232][106225] Updated weights for policy 1, policy_version 192776 (0.0008) [2023-12-27 20:36:47,292][106225] Updated weights for policy 1, policy_version 192786 (0.0010) [2023-12-27 20:36:47,347][106225] Updated weights for policy 1, policy_version 192796 (0.0010) [2023-12-27 20:36:47,512][106226] Updated weights for policy 0, policy_version 192552 (0.0010) [2023-12-27 20:36:47,568][106226] Updated weights for policy 0, policy_version 192562 (0.0010) [2023-12-27 20:36:47,628][106226] Updated weights for policy 0, policy_version 192572 (0.0011) [2023-12-27 20:36:48,038][106225] Updated weights for policy 1, policy_version 192806 (0.0010) [2023-12-27 20:36:48,091][106225] Updated weights for policy 1, policy_version 192816 (0.0010) [2023-12-27 20:36:48,148][106225] Updated weights for policy 1, policy_version 192826 (0.0007) [2023-12-27 20:36:48,344][106226] Updated weights for policy 0, policy_version 192582 (0.0010) [2023-12-27 20:36:48,403][106226] Updated weights for policy 0, policy_version 192592 (0.0008) [2023-12-27 20:36:48,468][106226] Updated weights for policy 0, policy_version 192602 (0.0007) [2023-12-27 20:36:48,868][106225] Updated weights for policy 1, policy_version 192836 (0.0007) [2023-12-27 20:36:48,930][106225] Updated weights for policy 1, policy_version 192846 (0.0009) [2023-12-27 20:36:48,992][106225] Updated weights for policy 1, policy_version 192856 (0.0008) [2023-12-27 20:36:49,171][106226] Updated weights for policy 0, policy_version 192612 (0.0008) [2023-12-27 20:36:49,240][106226] Updated weights for policy 0, policy_version 192623 (0.0008) [2023-12-27 20:36:49,306][106226] Updated weights for policy 0, policy_version 192633 (0.0006) [2023-12-27 20:36:49,770][106225] Updated weights for policy 1, policy_version 192866 (0.0008) [2023-12-27 20:36:49,837][106225] Updated weights for policy 1, policy_version 192876 (0.0008) [2023-12-27 20:36:49,899][106225] Updated weights for policy 1, policy_version 192886 (0.0007) [2023-12-27 20:36:49,932][106226] Updated weights for policy 0, policy_version 192643 (0.0008) [2023-12-27 20:36:49,971][106225] Updated weights for policy 1, policy_version 192896 (0.0011) [2023-12-27 20:36:49,995][106226] Updated weights for policy 0, policy_version 192653 (0.0007) [2023-12-27 20:36:50,049][106226] Updated weights for policy 0, policy_version 192663 (0.0008) [2023-12-27 20:36:50,735][106225] Updated weights for policy 1, policy_version 192906 (0.0008) [2023-12-27 20:36:50,794][106225] Updated weights for policy 1, policy_version 192916 (0.0008) [2023-12-27 20:36:50,796][106226] Updated weights for policy 0, policy_version 192673 (0.0008) [2023-12-27 20:36:50,848][106226] Updated weights for policy 0, policy_version 192683 (0.0005) [2023-12-27 20:36:50,853][106225] Updated weights for policy 1, policy_version 192926 (0.0007) [2023-12-27 20:36:50,901][106226] Updated weights for policy 0, policy_version 192693 (0.0008) [2023-12-27 20:36:50,958][106226] Updated weights for policy 0, policy_version 192703 (0.0009) [2023-12-27 20:36:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 98738176. Throughput: 0: 10081.0, 1: 9700.1. Samples: 98744316. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:51,175][105115] Avg episode reward: [(0, '-5.181'), (1, '-6.232')] [2023-12-27 20:36:51,632][106225] Updated weights for policy 1, policy_version 192936 (0.0008) [2023-12-27 20:36:51,692][106225] Updated weights for policy 1, policy_version 192946 (0.0008) [2023-12-27 20:36:51,736][106226] Updated weights for policy 0, policy_version 192713 (0.0007) [2023-12-27 20:36:51,751][106225] Updated weights for policy 1, policy_version 192956 (0.0008) [2023-12-27 20:36:51,796][106226] Updated weights for policy 0, policy_version 192723 (0.0006) [2023-12-27 20:36:51,853][106226] Updated weights for policy 0, policy_version 192733 (0.0005) [2023-12-27 20:36:52,498][106225] Updated weights for policy 1, policy_version 192966 (0.0010) [2023-12-27 20:36:52,523][106226] Updated weights for policy 0, policy_version 192743 (0.0006) [2023-12-27 20:36:52,563][106225] Updated weights for policy 1, policy_version 192976 (0.0010) [2023-12-27 20:36:52,588][106226] Updated weights for policy 0, policy_version 192753 (0.0006) [2023-12-27 20:36:52,622][106225] Updated weights for policy 1, policy_version 192986 (0.0010) [2023-12-27 20:36:52,651][106226] Updated weights for policy 0, policy_version 192763 (0.0007) [2023-12-27 20:36:53,238][106226] Updated weights for policy 0, policy_version 192773 (0.0009) [2023-12-27 20:36:53,301][106226] Updated weights for policy 0, policy_version 192783 (0.0005) [2023-12-27 20:36:53,310][106225] Updated weights for policy 1, policy_version 192996 (0.0010) [2023-12-27 20:36:53,347][106226] Updated weights for policy 0, policy_version 192793 (0.0005) [2023-12-27 20:36:53,370][106225] Updated weights for policy 1, policy_version 193006 (0.0010) [2023-12-27 20:36:53,423][106225] Updated weights for policy 1, policy_version 193016 (0.0010) [2023-12-27 20:36:53,466][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000002 [2023-12-27 20:36:53,944][106226] Updated weights for policy 0, policy_version 192803 (0.0007) [2023-12-27 20:36:54,003][106226] Updated weights for policy 0, policy_version 192813 (0.0010) [2023-12-27 20:36:54,062][106226] Updated weights for policy 0, policy_version 192823 (0.0010) [2023-12-27 20:36:54,068][106225] Updated weights for policy 1, policy_version 193026 (0.0009) [2023-12-27 20:36:54,134][106225] Updated weights for policy 1, policy_version 193036 (0.0006) [2023-12-27 20:36:54,195][106225] Updated weights for policy 1, policy_version 193046 (0.0006) [2023-12-27 20:36:54,260][106225] Updated weights for policy 1, policy_version 193056 (0.0005) [2023-12-27 20:36:54,732][106226] Updated weights for policy 0, policy_version 192833 (0.0006) [2023-12-27 20:36:54,790][106226] Updated weights for policy 0, policy_version 192843 (0.0008) [2023-12-27 20:36:54,852][106226] Updated weights for policy 0, policy_version 192853 (0.0009) [2023-12-27 20:36:54,858][106225] Updated weights for policy 1, policy_version 193066 (0.0005) [2023-12-27 20:36:54,913][106225] Updated weights for policy 1, policy_version 193076 (0.0005) [2023-12-27 20:36:54,918][106226] Updated weights for policy 0, policy_version 192863 (0.0005) [2023-12-27 20:36:54,970][106225] Updated weights for policy 1, policy_version 193086 (0.0006) [2023-12-27 20:36:55,584][106225] Updated weights for policy 1, policy_version 193096 (0.0010) [2023-12-27 20:36:55,588][106226] Updated weights for policy 0, policy_version 192873 (0.0009) [2023-12-27 20:36:55,640][106225] Updated weights for policy 1, policy_version 193106 (0.0010) [2023-12-27 20:36:55,642][106226] Updated weights for policy 0, policy_version 192883 (0.0008) [2023-12-27 20:36:55,692][106226] Updated weights for policy 0, policy_version 192893 (0.0006) [2023-12-27 20:36:55,697][106225] Updated weights for policy 1, policy_version 193116 (0.0010) [2023-12-27 20:36:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 98836480. Throughput: 0: 10086.6, 1: 9662.3. Samples: 98804372. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:36:56,176][105115] Avg episode reward: [(0, '-4.885'), (1, '-6.692')] [2023-12-27 20:36:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000193120_49446912.pth... [2023-12-27 20:36:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000192896_49389568.pth... [2023-12-27 20:36:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000192000_49160192.pth [2023-12-27 20:36:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000191712_49086464.pth [2023-12-27 20:36:56,438][106226] Updated weights for policy 0, policy_version 192903 (0.0010) [2023-12-27 20:36:56,439][106225] Updated weights for policy 1, policy_version 193126 (0.0010) [2023-12-27 20:36:56,486][106225] Updated weights for policy 1, policy_version 193136 (0.0010) [2023-12-27 20:36:56,496][106226] Updated weights for policy 0, policy_version 192913 (0.0011) [2023-12-27 20:36:56,537][106225] Updated weights for policy 1, policy_version 193146 (0.0010) [2023-12-27 20:36:56,552][106226] Updated weights for policy 0, policy_version 192923 (0.0008) [2023-12-27 20:36:57,149][106225] Updated weights for policy 1, policy_version 193156 (0.0008) [2023-12-27 20:36:57,171][106226] Updated weights for policy 0, policy_version 192933 (0.0005) [2023-12-27 20:36:57,204][106225] Updated weights for policy 1, policy_version 193166 (0.0010) [2023-12-27 20:36:57,230][106226] Updated weights for policy 0, policy_version 192943 (0.0006) [2023-12-27 20:36:57,257][106225] Updated weights for policy 1, policy_version 193176 (0.0010) [2023-12-27 20:36:57,286][106226] Updated weights for policy 0, policy_version 192953 (0.0010) [2023-12-27 20:36:57,912][106226] Updated weights for policy 0, policy_version 192963 (0.0008) [2023-12-27 20:36:57,940][106225] Updated weights for policy 1, policy_version 193186 (0.0010) [2023-12-27 20:36:57,962][106226] Updated weights for policy 0, policy_version 192973 (0.0006) [2023-12-27 20:36:57,991][106225] Updated weights for policy 1, policy_version 193196 (0.0010) [2023-12-27 20:36:58,024][106226] Updated weights for policy 0, policy_version 192983 (0.0006) [2023-12-27 20:36:58,045][106225] Updated weights for policy 1, policy_version 193206 (0.0010) [2023-12-27 20:36:58,105][106225] Updated weights for policy 1, policy_version 193216 (0.0010) [2023-12-27 20:36:58,717][106226] Updated weights for policy 0, policy_version 192993 (0.0006) [2023-12-27 20:36:58,792][106226] Updated weights for policy 0, policy_version 193003 (0.0009) [2023-12-27 20:36:58,855][106226] Updated weights for policy 0, policy_version 193013 (0.0009) [2023-12-27 20:36:58,923][106226] Updated weights for policy 0, policy_version 193023 (0.0009) [2023-12-27 20:36:58,968][106225] Updated weights for policy 1, policy_version 193226 (0.0009) [2023-12-27 20:36:59,025][106225] Updated weights for policy 1, policy_version 193236 (0.0009) [2023-12-27 20:36:59,077][106225] Updated weights for policy 1, policy_version 193246 (0.0009) [2023-12-27 20:36:59,726][106226] Updated weights for policy 0, policy_version 193033 (0.0008) [2023-12-27 20:36:59,792][106226] Updated weights for policy 0, policy_version 193043 (0.0006) [2023-12-27 20:36:59,858][106225] Updated weights for policy 1, policy_version 193256 (0.0009) [2023-12-27 20:36:59,858][106226] Updated weights for policy 0, policy_version 193053 (0.0007) [2023-12-27 20:36:59,927][106225] Updated weights for policy 1, policy_version 193266 (0.0008) [2023-12-27 20:36:59,986][106225] Updated weights for policy 1, policy_version 193276 (0.0010) [2023-12-27 20:37:00,549][106226] Updated weights for policy 0, policy_version 193063 (0.0008) [2023-12-27 20:37:00,606][106226] Updated weights for policy 0, policy_version 193073 (0.0008) [2023-12-27 20:37:00,665][106226] Updated weights for policy 0, policy_version 193083 (0.0008) [2023-12-27 20:37:00,686][106225] Updated weights for policy 1, policy_version 193286 (0.0007) [2023-12-27 20:37:00,737][106225] Updated weights for policy 1, policy_version 193296 (0.0008) [2023-12-27 20:37:00,810][106225] Updated weights for policy 1, policy_version 193306 (0.0008) [2023-12-27 20:37:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 98934784. Throughput: 0: 10068.3, 1: 9749.4. Samples: 98924668. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:37:01,175][105115] Avg episode reward: [(0, '-5.234'), (1, '-6.664')] [2023-12-27 20:37:01,460][106226] Updated weights for policy 0, policy_version 193093 (0.0007) [2023-12-27 20:37:01,511][106226] Updated weights for policy 0, policy_version 193103 (0.0009) [2023-12-27 20:37:01,570][106226] Updated weights for policy 0, policy_version 193113 (0.0009) [2023-12-27 20:37:01,608][106225] Updated weights for policy 1, policy_version 193316 (0.0007) [2023-12-27 20:37:01,677][106225] Updated weights for policy 1, policy_version 193326 (0.0007) [2023-12-27 20:37:01,746][106225] Updated weights for policy 1, policy_version 193336 (0.0009) [2023-12-27 20:37:02,323][106226] Updated weights for policy 0, policy_version 193123 (0.0009) [2023-12-27 20:37:02,389][106226] Updated weights for policy 0, policy_version 193133 (0.0009) [2023-12-27 20:37:02,456][106226] Updated weights for policy 0, policy_version 193143 (0.0010) [2023-12-27 20:37:02,478][106225] Updated weights for policy 1, policy_version 193346 (0.0007) [2023-12-27 20:37:02,537][106225] Updated weights for policy 1, policy_version 193356 (0.0008) [2023-12-27 20:37:02,587][106225] Updated weights for policy 1, policy_version 193366 (0.0009) [2023-12-27 20:37:02,638][106225] Updated weights for policy 1, policy_version 193376 (0.0005) [2023-12-27 20:37:03,050][106226] Updated weights for policy 0, policy_version 193153 (0.0006) [2023-12-27 20:37:03,115][106226] Updated weights for policy 0, policy_version 193163 (0.0005) [2023-12-27 20:37:03,173][106226] Updated weights for policy 0, policy_version 193173 (0.0009) [2023-12-27 20:37:03,204][106225] Updated weights for policy 1, policy_version 193386 (0.0007) [2023-12-27 20:37:03,222][106226] Updated weights for policy 0, policy_version 193183 (0.0008) [2023-12-27 20:37:03,254][106225] Updated weights for policy 1, policy_version 193396 (0.0010) [2023-12-27 20:37:03,307][106225] Updated weights for policy 1, policy_version 193406 (0.0010) [2023-12-27 20:37:03,753][106226] Updated weights for policy 0, policy_version 193193 (0.0006) [2023-12-27 20:37:03,812][106226] Updated weights for policy 0, policy_version 193203 (0.0005) [2023-12-27 20:37:03,875][106226] Updated weights for policy 0, policy_version 193213 (0.0007) [2023-12-27 20:37:03,996][106225] Updated weights for policy 1, policy_version 193416 (0.0010) [2023-12-27 20:37:04,054][106225] Updated weights for policy 1, policy_version 193426 (0.0010) [2023-12-27 20:37:04,114][106225] Updated weights for policy 1, policy_version 193436 (0.0010) [2023-12-27 20:37:04,493][106226] Updated weights for policy 0, policy_version 193223 (0.0010) [2023-12-27 20:37:04,547][106226] Updated weights for policy 0, policy_version 193233 (0.0011) [2023-12-27 20:37:04,604][106226] Updated weights for policy 0, policy_version 193243 (0.0010) [2023-12-27 20:37:04,785][106225] Updated weights for policy 1, policy_version 193446 (0.0006) [2023-12-27 20:37:04,850][106225] Updated weights for policy 1, policy_version 193456 (0.0005) [2023-12-27 20:37:04,908][106225] Updated weights for policy 1, policy_version 193466 (0.0005) [2023-12-27 20:37:05,316][106226] Updated weights for policy 0, policy_version 193253 (0.0009) [2023-12-27 20:37:05,383][106226] Updated weights for policy 0, policy_version 193263 (0.0008) [2023-12-27 20:37:05,453][106226] Updated weights for policy 0, policy_version 193273 (0.0009) [2023-12-27 20:37:05,508][106225] Updated weights for policy 1, policy_version 193476 (0.0006) [2023-12-27 20:37:05,570][106225] Updated weights for policy 1, policy_version 193486 (0.0008) [2023-12-27 20:37:05,631][106225] Updated weights for policy 1, policy_version 193496 (0.0008) [2023-12-27 20:37:06,099][106226] Updated weights for policy 0, policy_version 193283 (0.0008) [2023-12-27 20:37:06,164][106226] Updated weights for policy 0, policy_version 193293 (0.0011) [2023-12-27 20:37:06,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 99033088. Throughput: 0: 10167.6, 1: 9771.9. Samples: 99047524. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:37:06,175][105115] Avg episode reward: [(0, '-5.142'), (1, '-6.099')] [2023-12-27 20:37:06,218][106225] Updated weights for policy 1, policy_version 193506 (0.0009) [2023-12-27 20:37:06,226][106226] Updated weights for policy 0, policy_version 193303 (0.0011) [2023-12-27 20:37:06,280][106225] Updated weights for policy 1, policy_version 193516 (0.0011) [2023-12-27 20:37:06,343][106225] Updated weights for policy 1, policy_version 193526 (0.0010) [2023-12-27 20:37:06,410][106225] Updated weights for policy 1, policy_version 193536 (0.0008) [2023-12-27 20:37:06,959][106226] Updated weights for policy 0, policy_version 193313 (0.0011) [2023-12-27 20:37:07,020][106226] Updated weights for policy 0, policy_version 193323 (0.0011) [2023-12-27 20:37:07,074][106226] Updated weights for policy 0, policy_version 193333 (0.0010) [2023-12-27 20:37:07,112][106225] Updated weights for policy 1, policy_version 193546 (0.0006) [2023-12-27 20:37:07,134][106226] Updated weights for policy 0, policy_version 193343 (0.0011) [2023-12-27 20:37:07,173][106225] Updated weights for policy 1, policy_version 193556 (0.0007) [2023-12-27 20:37:07,239][106225] Updated weights for policy 1, policy_version 193566 (0.0008) [2023-12-27 20:37:07,809][106226] Updated weights for policy 0, policy_version 193353 (0.0011) [2023-12-27 20:37:07,859][106226] Updated weights for policy 0, policy_version 193363 (0.0010) [2023-12-27 20:37:07,916][106226] Updated weights for policy 0, policy_version 193373 (0.0010) [2023-12-27 20:37:07,984][106225] Updated weights for policy 1, policy_version 193576 (0.0006) [2023-12-27 20:37:08,055][106225] Updated weights for policy 1, policy_version 193586 (0.0007) [2023-12-27 20:37:08,124][106225] Updated weights for policy 1, policy_version 193596 (0.0006) [2023-12-27 20:37:08,585][106226] Updated weights for policy 0, policy_version 193383 (0.0010) [2023-12-27 20:37:08,650][106226] Updated weights for policy 0, policy_version 193393 (0.0011) [2023-12-27 20:37:08,710][106226] Updated weights for policy 0, policy_version 193403 (0.0011) [2023-12-27 20:37:08,790][106225] Updated weights for policy 1, policy_version 193606 (0.0009) [2023-12-27 20:37:08,856][106225] Updated weights for policy 1, policy_version 193616 (0.0006) [2023-12-27 20:37:08,919][106225] Updated weights for policy 1, policy_version 193626 (0.0006) [2023-12-27 20:37:09,396][106226] Updated weights for policy 0, policy_version 193413 (0.0010) [2023-12-27 20:37:09,457][106226] Updated weights for policy 0, policy_version 193423 (0.0006) [2023-12-27 20:37:09,521][106226] Updated weights for policy 0, policy_version 193433 (0.0008) [2023-12-27 20:37:09,574][106225] Updated weights for policy 1, policy_version 193636 (0.0006) [2023-12-27 20:37:09,638][106225] Updated weights for policy 1, policy_version 193646 (0.0007) [2023-12-27 20:37:09,710][106225] Updated weights for policy 1, policy_version 193656 (0.0006) [2023-12-27 20:37:10,275][106226] Updated weights for policy 0, policy_version 193443 (0.0008) [2023-12-27 20:37:10,333][106226] Updated weights for policy 0, policy_version 193453 (0.0006) [2023-12-27 20:37:10,379][106225] Updated weights for policy 1, policy_version 193666 (0.0006) [2023-12-27 20:37:10,395][106226] Updated weights for policy 0, policy_version 193463 (0.0010) [2023-12-27 20:37:10,442][106225] Updated weights for policy 1, policy_version 193676 (0.0006) [2023-12-27 20:37:10,500][106225] Updated weights for policy 1, policy_version 193686 (0.0008) [2023-12-27 20:37:10,563][106225] Updated weights for policy 1, policy_version 193696 (0.0009) [2023-12-27 20:37:11,060][106226] Updated weights for policy 0, policy_version 193473 (0.0007) [2023-12-27 20:37:11,129][106226] Updated weights for policy 0, policy_version 193483 (0.0006) [2023-12-27 20:37:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 99131392. Throughput: 0: 10169.0, 1: 9801.1. Samples: 99107600. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:37:11,175][105115] Avg episode reward: [(0, '-4.949'), (1, '-6.463')] [2023-12-27 20:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000193696_49594368.pth... [2023-12-27 20:37:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000192576_49307648.pth [2023-12-27 20:37:11,201][106226] Updated weights for policy 0, policy_version 193493 (0.0007) [2023-12-27 20:37:11,275][106226] Updated weights for policy 0, policy_version 193503 (0.0006) [2023-12-27 20:37:11,277][106225] Updated weights for policy 1, policy_version 193706 (0.0008) [2023-12-27 20:37:11,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000193504_49545216.pth... [2023-12-27 20:37:11,286][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000192288_49233920.pth [2023-12-27 20:37:11,338][106225] Updated weights for policy 1, policy_version 193716 (0.0008) [2023-12-27 20:37:11,406][106225] Updated weights for policy 1, policy_version 193726 (0.0008) [2023-12-27 20:37:12,033][106226] Updated weights for policy 0, policy_version 193513 (0.0009) [2023-12-27 20:37:12,100][106226] Updated weights for policy 0, policy_version 193523 (0.0009) [2023-12-27 20:37:12,143][106225] Updated weights for policy 1, policy_version 193736 (0.0008) [2023-12-27 20:37:12,165][106226] Updated weights for policy 0, policy_version 193533 (0.0008) [2023-12-27 20:37:12,205][106225] Updated weights for policy 1, policy_version 193746 (0.0007) [2023-12-27 20:37:12,268][106225] Updated weights for policy 1, policy_version 193756 (0.0009) [2023-12-27 20:37:12,900][106226] Updated weights for policy 0, policy_version 193543 (0.0009) [2023-12-27 20:37:12,953][106226] Updated weights for policy 0, policy_version 193553 (0.0009) [2023-12-27 20:37:12,961][106225] Updated weights for policy 1, policy_version 193766 (0.0007) [2023-12-27 20:37:13,001][106226] Updated weights for policy 0, policy_version 193563 (0.0007) [2023-12-27 20:37:13,018][106225] Updated weights for policy 1, policy_version 193777 (0.0007) [2023-12-27 20:37:13,075][106225] Updated weights for policy 1, policy_version 193787 (0.0006) [2023-12-27 20:37:13,697][106225] Updated weights for policy 1, policy_version 193797 (0.0010) [2023-12-27 20:37:13,720][106226] Updated weights for policy 0, policy_version 193573 (0.0007) [2023-12-27 20:37:13,757][106225] Updated weights for policy 1, policy_version 193807 (0.0010) [2023-12-27 20:37:13,777][106226] Updated weights for policy 0, policy_version 193583 (0.0005) [2023-12-27 20:37:13,817][106225] Updated weights for policy 1, policy_version 193817 (0.0010) [2023-12-27 20:37:13,835][106226] Updated weights for policy 0, policy_version 193593 (0.0009) [2023-12-27 20:37:14,492][106226] Updated weights for policy 0, policy_version 193603 (0.0007) [2023-12-27 20:37:14,494][106225] Updated weights for policy 1, policy_version 193827 (0.0009) [2023-12-27 20:37:14,549][106226] Updated weights for policy 0, policy_version 193613 (0.0006) [2023-12-27 20:37:14,557][106225] Updated weights for policy 1, policy_version 193837 (0.0006) [2023-12-27 20:37:14,607][106226] Updated weights for policy 0, policy_version 193623 (0.0005) [2023-12-27 20:37:14,608][106225] Updated weights for policy 1, policy_version 193847 (0.0008) [2023-12-27 20:37:15,223][106225] Updated weights for policy 1, policy_version 193857 (0.0008) [2023-12-27 20:37:15,271][106226] Updated weights for policy 0, policy_version 193633 (0.0006) [2023-12-27 20:37:15,280][106225] Updated weights for policy 1, policy_version 193867 (0.0010) [2023-12-27 20:37:15,333][106226] Updated weights for policy 0, policy_version 193643 (0.0010) [2023-12-27 20:37:15,346][106225] Updated weights for policy 1, policy_version 193877 (0.0011) [2023-12-27 20:37:15,397][106226] Updated weights for policy 0, policy_version 193653 (0.0006) [2023-12-27 20:37:15,408][106225] Updated weights for policy 1, policy_version 193887 (0.0010) [2023-12-27 20:37:15,460][106226] Updated weights for policy 0, policy_version 193663 (0.0008) [2023-12-27 20:37:16,098][106225] Updated weights for policy 1, policy_version 193897 (0.0006) [2023-12-27 20:37:16,104][106226] Updated weights for policy 0, policy_version 193673 (0.0007) [2023-12-27 20:37:16,148][106225] Updated weights for policy 1, policy_version 193907 (0.0006) [2023-12-27 20:37:16,155][106226] Updated weights for policy 0, policy_version 193683 (0.0010) [2023-12-27 20:37:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 99229696. Throughput: 0: 10116.7, 1: 9764.4. Samples: 99225552. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:37:16,176][105115] Avg episode reward: [(0, '-5.015'), (1, '-6.231')] [2023-12-27 20:37:16,201][106225] Updated weights for policy 1, policy_version 193917 (0.0005) [2023-12-27 20:37:16,203][106226] Updated weights for policy 0, policy_version 193693 (0.0010) [2023-12-27 20:37:16,751][106225] Updated weights for policy 1, policy_version 193927 (0.0009) [2023-12-27 20:37:16,817][106225] Updated weights for policy 1, policy_version 193937 (0.0010) [2023-12-27 20:37:16,870][106225] Updated weights for policy 1, policy_version 193947 (0.0010) [2023-12-27 20:37:16,908][106226] Updated weights for policy 0, policy_version 193703 (0.0010) [2023-12-27 20:37:16,966][106226] Updated weights for policy 0, policy_version 193713 (0.0010) [2023-12-27 20:37:17,020][106226] Updated weights for policy 0, policy_version 193723 (0.0010) [2023-12-27 20:37:17,574][106225] Updated weights for policy 1, policy_version 193957 (0.0010) [2023-12-27 20:37:17,620][106225] Updated weights for policy 1, policy_version 193967 (0.0010) [2023-12-27 20:37:17,667][106225] Updated weights for policy 1, policy_version 193977 (0.0010) [2023-12-27 20:37:17,728][106226] Updated weights for policy 0, policy_version 193733 (0.0010) [2023-12-27 20:37:17,781][106226] Updated weights for policy 0, policy_version 193743 (0.0010) [2023-12-27 20:37:17,844][106226] Updated weights for policy 0, policy_version 193753 (0.0011) [2023-12-27 20:37:18,261][106225] Updated weights for policy 1, policy_version 193987 (0.0010) [2023-12-27 20:37:18,339][106225] Updated weights for policy 1, policy_version 193997 (0.0010) [2023-12-27 20:37:18,406][106225] Updated weights for policy 1, policy_version 194007 (0.0007) [2023-12-27 20:37:18,563][106226] Updated weights for policy 0, policy_version 193763 (0.0011) [2023-12-27 20:37:18,617][106226] Updated weights for policy 0, policy_version 193773 (0.0010) [2023-12-27 20:37:18,677][106226] Updated weights for policy 0, policy_version 193783 (0.0011) [2023-12-27 20:37:19,106][106225] Updated weights for policy 1, policy_version 194017 (0.0009) [2023-12-27 20:37:19,169][106225] Updated weights for policy 1, policy_version 194027 (0.0010) [2023-12-27 20:37:19,235][106225] Updated weights for policy 1, policy_version 194037 (0.0009) [2023-12-27 20:37:19,304][106225] Updated weights for policy 1, policy_version 194047 (0.0010) [2023-12-27 20:37:19,422][106226] Updated weights for policy 0, policy_version 193793 (0.0010) [2023-12-27 20:37:19,489][106226] Updated weights for policy 0, policy_version 193803 (0.0012) [2023-12-27 20:37:19,543][106226] Updated weights for policy 0, policy_version 193813 (0.0009) [2023-12-27 20:37:19,595][106226] Updated weights for policy 0, policy_version 193823 (0.0009) [2023-12-27 20:37:20,140][106225] Updated weights for policy 1, policy_version 194057 (0.0008) [2023-12-27 20:37:20,199][106225] Updated weights for policy 1, policy_version 194067 (0.0008) [2023-12-27 20:37:20,263][106225] Updated weights for policy 1, policy_version 194077 (0.0008) [2023-12-27 20:37:20,422][106226] Updated weights for policy 0, policy_version 193833 (0.0009) [2023-12-27 20:37:20,496][106226] Updated weights for policy 0, policy_version 193843 (0.0011) [2023-12-27 20:37:20,553][106226] Updated weights for policy 0, policy_version 193853 (0.0007) [2023-12-27 20:37:21,023][106225] Updated weights for policy 1, policy_version 194087 (0.0010) [2023-12-27 20:37:21,087][106225] Updated weights for policy 1, policy_version 194097 (0.0010) [2023-12-27 20:37:21,156][106225] Updated weights for policy 1, policy_version 194107 (0.0011) [2023-12-27 20:37:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 99328000. Throughput: 0: 10058.2, 1: 9768.1. Samples: 99343988. Policy #0 lag: (min: 17.0, avg: 39.0, max: 49.0) [2023-12-27 20:37:21,175][105115] Avg episode reward: [(0, '-4.999'), (1, '-6.137')] [2023-12-27 20:37:21,296][106226] Updated weights for policy 0, policy_version 193863 (0.0009) [2023-12-27 20:37:21,365][106226] Updated weights for policy 0, policy_version 193873 (0.0010) [2023-12-27 20:37:21,436][106226] Updated weights for policy 0, policy_version 193883 (0.0012) [2023-12-27 20:37:21,939][106225] Updated weights for policy 1, policy_version 194117 (0.0009) [2023-12-27 20:37:22,006][106225] Updated weights for policy 1, policy_version 194127 (0.0008) [2023-12-27 20:37:22,073][106225] Updated weights for policy 1, policy_version 194137 (0.0008) [2023-12-27 20:37:22,168][106226] Updated weights for policy 0, policy_version 193893 (0.0009) [2023-12-27 20:37:22,224][106226] Updated weights for policy 0, policy_version 193903 (0.0009) [2023-12-27 20:37:22,284][106226] Updated weights for policy 0, policy_version 193913 (0.0009) [2023-12-27 20:37:22,835][106225] Updated weights for policy 1, policy_version 194147 (0.0008) [2023-12-27 20:37:22,894][106225] Updated weights for policy 1, policy_version 194157 (0.0006) [2023-12-27 20:37:22,955][106225] Updated weights for policy 1, policy_version 194167 (0.0006) [2023-12-27 20:37:23,054][106226] Updated weights for policy 0, policy_version 193923 (0.0007) [2023-12-27 20:37:23,113][106226] Updated weights for policy 0, policy_version 193933 (0.0010) [2023-12-27 20:37:23,177][106226] Updated weights for policy 0, policy_version 193943 (0.0009) [2023-12-27 20:37:23,647][106225] Updated weights for policy 1, policy_version 194177 (0.0006) [2023-12-27 20:37:23,708][106225] Updated weights for policy 1, policy_version 194187 (0.0009) [2023-12-27 20:37:23,771][106225] Updated weights for policy 1, policy_version 194197 (0.0008) [2023-12-27 20:37:23,827][106225] Updated weights for policy 1, policy_version 194207 (0.0005) [2023-12-27 20:37:23,844][106226] Updated weights for policy 0, policy_version 193953 (0.0009) [2023-12-27 20:37:23,893][106226] Updated weights for policy 0, policy_version 193963 (0.0008) [2023-12-27 20:37:23,953][106226] Updated weights for policy 0, policy_version 193973 (0.0006) [2023-12-27 20:37:24,012][106226] Updated weights for policy 0, policy_version 193983 (0.0007) [2023-12-27 20:37:24,471][106225] Updated weights for policy 1, policy_version 194217 (0.0010) [2023-12-27 20:37:24,523][106225] Updated weights for policy 1, policy_version 194227 (0.0010) [2023-12-27 20:37:24,583][106225] Updated weights for policy 1, policy_version 194237 (0.0010) [2023-12-27 20:37:24,655][106226] Updated weights for policy 0, policy_version 193993 (0.0005) [2023-12-27 20:37:24,725][106226] Updated weights for policy 0, policy_version 194003 (0.0005) [2023-12-27 20:37:24,780][106226] Updated weights for policy 0, policy_version 194013 (0.0005) [2023-12-27 20:37:25,308][106225] Updated weights for policy 1, policy_version 194247 (0.0010) [2023-12-27 20:37:25,364][106225] Updated weights for policy 1, policy_version 194257 (0.0010) [2023-12-27 20:37:25,390][106226] Updated weights for policy 0, policy_version 194023 (0.0005) [2023-12-27 20:37:25,420][106225] Updated weights for policy 1, policy_version 194267 (0.0010) [2023-12-27 20:37:25,444][106226] Updated weights for policy 0, policy_version 194033 (0.0009) [2023-12-27 20:37:25,490][106226] Updated weights for policy 0, policy_version 194043 (0.0007) [2023-12-27 20:37:26,090][106225] Updated weights for policy 1, policy_version 194277 (0.0010) [2023-12-27 20:37:26,147][106225] Updated weights for policy 1, policy_version 194287 (0.0010) [2023-12-27 20:37:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 99426304. Throughput: 0: 9995.4, 1: 9773.4. Samples: 99399900. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:26,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-6.278')] [2023-12-27 20:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000194048_49684480.pth... [2023-12-27 20:37:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000192896_49389568.pth [2023-12-27 20:37:26,214][106225] Updated weights for policy 1, policy_version 194297 (0.0011) [2023-12-27 20:37:26,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000194304_49750016.pth... [2023-12-27 20:37:26,250][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000193120_49446912.pth [2023-12-27 20:37:26,270][106226] Updated weights for policy 0, policy_version 194053 (0.0009) [2023-12-27 20:37:26,335][106226] Updated weights for policy 0, policy_version 194063 (0.0009) [2023-12-27 20:37:26,399][106226] Updated weights for policy 0, policy_version 194073 (0.0010) [2023-12-27 20:37:26,784][106225] Updated weights for policy 1, policy_version 194307 (0.0009) [2023-12-27 20:37:26,840][106225] Updated weights for policy 1, policy_version 194317 (0.0006) [2023-12-27 20:37:26,894][106225] Updated weights for policy 1, policy_version 194327 (0.0007) [2023-12-27 20:37:27,174][106226] Updated weights for policy 0, policy_version 194083 (0.0010) [2023-12-27 20:37:27,230][106226] Updated weights for policy 0, policy_version 194093 (0.0010) [2023-12-27 20:37:27,290][106226] Updated weights for policy 0, policy_version 194103 (0.0010) [2023-12-27 20:37:27,461][106225] Updated weights for policy 1, policy_version 194337 (0.0006) [2023-12-27 20:37:27,520][106225] Updated weights for policy 1, policy_version 194347 (0.0010) [2023-12-27 20:37:27,563][106225] Updated weights for policy 1, policy_version 194357 (0.0010) [2023-12-27 20:37:27,619][106225] Updated weights for policy 1, policy_version 194367 (0.0010) [2023-12-27 20:37:27,907][106226] Updated weights for policy 0, policy_version 194113 (0.0008) [2023-12-27 20:37:27,960][106226] Updated weights for policy 0, policy_version 194123 (0.0006) [2023-12-27 20:37:28,018][106226] Updated weights for policy 0, policy_version 194133 (0.0005) [2023-12-27 20:37:28,061][106226] Updated weights for policy 0, policy_version 194143 (0.0008) [2023-12-27 20:37:28,325][106225] Updated weights for policy 1, policy_version 194377 (0.0009) [2023-12-27 20:37:28,387][106225] Updated weights for policy 1, policy_version 194387 (0.0010) [2023-12-27 20:37:28,450][106225] Updated weights for policy 1, policy_version 194397 (0.0010) [2023-12-27 20:37:28,711][106226] Updated weights for policy 0, policy_version 194153 (0.0008) [2023-12-27 20:37:28,762][106226] Updated weights for policy 0, policy_version 194163 (0.0008) [2023-12-27 20:37:28,825][106226] Updated weights for policy 0, policy_version 194173 (0.0006) [2023-12-27 20:37:29,093][106225] Updated weights for policy 1, policy_version 194407 (0.0010) [2023-12-27 20:37:29,160][106225] Updated weights for policy 1, policy_version 194417 (0.0010) [2023-12-27 20:37:29,217][106225] Updated weights for policy 1, policy_version 194427 (0.0010) [2023-12-27 20:37:29,483][106226] Updated weights for policy 0, policy_version 194183 (0.0008) [2023-12-27 20:37:29,540][106226] Updated weights for policy 0, policy_version 194193 (0.0009) [2023-12-27 20:37:29,596][106226] Updated weights for policy 0, policy_version 194203 (0.0009) [2023-12-27 20:37:29,974][106225] Updated weights for policy 1, policy_version 194437 (0.0009) [2023-12-27 20:37:30,034][106225] Updated weights for policy 1, policy_version 194447 (0.0008) [2023-12-27 20:37:30,094][106225] Updated weights for policy 1, policy_version 194457 (0.0008) [2023-12-27 20:37:30,318][106226] Updated weights for policy 0, policy_version 194213 (0.0010) [2023-12-27 20:37:30,377][106226] Updated weights for policy 0, policy_version 194223 (0.0007) [2023-12-27 20:37:30,428][106226] Updated weights for policy 0, policy_version 194233 (0.0005) [2023-12-27 20:37:30,859][106225] Updated weights for policy 1, policy_version 194467 (0.0009) [2023-12-27 20:37:30,914][106225] Updated weights for policy 1, policy_version 194477 (0.0009) [2023-12-27 20:37:30,953][106226] Updated weights for policy 0, policy_version 194243 (0.0005) [2023-12-27 20:37:30,965][106225] Updated weights for policy 1, policy_version 194487 (0.0009) [2023-12-27 20:37:31,007][106226] Updated weights for policy 0, policy_version 194253 (0.0009) [2023-12-27 20:37:31,067][106226] Updated weights for policy 0, policy_version 194263 (0.0010) [2023-12-27 20:37:31,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 99540992. Throughput: 0: 9974.0, 1: 9949.0. Samples: 99523448. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:31,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-6.778')] [2023-12-27 20:37:31,704][106225] Updated weights for policy 1, policy_version 194497 (0.0006) [2023-12-27 20:37:31,772][106225] Updated weights for policy 1, policy_version 194507 (0.0009) [2023-12-27 20:37:31,803][106226] Updated weights for policy 0, policy_version 194273 (0.0009) [2023-12-27 20:37:31,835][106225] Updated weights for policy 1, policy_version 194517 (0.0009) [2023-12-27 20:37:31,853][106226] Updated weights for policy 0, policy_version 194283 (0.0006) [2023-12-27 20:37:31,883][106225] Updated weights for policy 1, policy_version 194527 (0.0006) [2023-12-27 20:37:31,905][106226] Updated weights for policy 0, policy_version 194293 (0.0006) [2023-12-27 20:37:31,966][106226] Updated weights for policy 0, policy_version 194303 (0.0008) [2023-12-27 20:37:32,635][106225] Updated weights for policy 1, policy_version 194537 (0.0009) [2023-12-27 20:37:32,687][106225] Updated weights for policy 1, policy_version 194547 (0.0007) [2023-12-27 20:37:32,694][106226] Updated weights for policy 0, policy_version 194313 (0.0008) [2023-12-27 20:37:32,746][106225] Updated weights for policy 1, policy_version 194557 (0.0005) [2023-12-27 20:37:32,754][106226] Updated weights for policy 0, policy_version 194323 (0.0008) [2023-12-27 20:37:32,815][106226] Updated weights for policy 0, policy_version 194333 (0.0008) [2023-12-27 20:37:33,419][106225] Updated weights for policy 1, policy_version 194567 (0.0005) [2023-12-27 20:37:33,471][106225] Updated weights for policy 1, policy_version 194577 (0.0006) [2023-12-27 20:37:33,491][106226] Updated weights for policy 0, policy_version 194343 (0.0006) [2023-12-27 20:37:33,526][106225] Updated weights for policy 1, policy_version 194587 (0.0007) [2023-12-27 20:37:33,558][106226] Updated weights for policy 0, policy_version 194353 (0.0009) [2023-12-27 20:37:33,614][106226] Updated weights for policy 0, policy_version 194363 (0.0010) [2023-12-27 20:37:34,270][106226] Updated weights for policy 0, policy_version 194373 (0.0009) [2023-12-27 20:37:34,277][106225] Updated weights for policy 1, policy_version 194597 (0.0007) [2023-12-27 20:37:34,331][106226] Updated weights for policy 0, policy_version 194383 (0.0010) [2023-12-27 20:37:34,337][106225] Updated weights for policy 1, policy_version 194607 (0.0008) [2023-12-27 20:37:34,396][106226] Updated weights for policy 0, policy_version 194393 (0.0011) [2023-12-27 20:37:34,397][106225] Updated weights for policy 1, policy_version 194617 (0.0008) [2023-12-27 20:37:35,030][106226] Updated weights for policy 0, policy_version 194403 (0.0010) [2023-12-27 20:37:35,081][106226] Updated weights for policy 0, policy_version 194413 (0.0010) [2023-12-27 20:37:35,132][106226] Updated weights for policy 0, policy_version 194423 (0.0010) [2023-12-27 20:37:35,137][106225] Updated weights for policy 1, policy_version 194627 (0.0007) [2023-12-27 20:37:35,188][106225] Updated weights for policy 1, policy_version 194637 (0.0006) [2023-12-27 20:37:35,235][106225] Updated weights for policy 1, policy_version 194647 (0.0007) [2023-12-27 20:37:35,829][106226] Updated weights for policy 0, policy_version 194433 (0.0010) [2023-12-27 20:37:35,896][106226] Updated weights for policy 0, policy_version 194443 (0.0010) [2023-12-27 20:37:35,943][106225] Updated weights for policy 1, policy_version 194657 (0.0008) [2023-12-27 20:37:35,955][106226] Updated weights for policy 0, policy_version 194453 (0.0007) [2023-12-27 20:37:36,003][106225] Updated weights for policy 1, policy_version 194667 (0.0006) [2023-12-27 20:37:36,021][106226] Updated weights for policy 0, policy_version 194463 (0.0006) [2023-12-27 20:37:36,064][106225] Updated weights for policy 1, policy_version 194677 (0.0006) [2023-12-27 20:37:36,127][106225] Updated weights for policy 1, policy_version 194687 (0.0009) [2023-12-27 20:37:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 99639296. Throughput: 0: 10009.2, 1: 9947.3. Samples: 99642360. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:36,175][105115] Avg episode reward: [(0, '-5.130'), (1, '-6.000')] [2023-12-27 20:37:36,635][106226] Updated weights for policy 0, policy_version 194473 (0.0010) [2023-12-27 20:37:36,701][106226] Updated weights for policy 0, policy_version 194483 (0.0009) [2023-12-27 20:37:36,760][106225] Updated weights for policy 1, policy_version 194697 (0.0006) [2023-12-27 20:37:36,770][106226] Updated weights for policy 0, policy_version 194493 (0.0008) [2023-12-27 20:37:36,828][106225] Updated weights for policy 1, policy_version 194707 (0.0010) [2023-12-27 20:37:36,889][106225] Updated weights for policy 1, policy_version 194717 (0.0010) [2023-12-27 20:37:37,421][106226] Updated weights for policy 0, policy_version 194503 (0.0007) [2023-12-27 20:37:37,483][106226] Updated weights for policy 0, policy_version 194513 (0.0008) [2023-12-27 20:37:37,489][106225] Updated weights for policy 1, policy_version 194727 (0.0007) [2023-12-27 20:37:37,537][106226] Updated weights for policy 0, policy_version 194523 (0.0007) [2023-12-27 20:37:37,555][106225] Updated weights for policy 1, policy_version 194737 (0.0006) [2023-12-27 20:37:37,610][106225] Updated weights for policy 1, policy_version 194747 (0.0010) [2023-12-27 20:37:38,183][106226] Updated weights for policy 0, policy_version 194533 (0.0008) [2023-12-27 20:37:38,237][106226] Updated weights for policy 0, policy_version 194543 (0.0008) [2023-12-27 20:37:38,259][106225] Updated weights for policy 1, policy_version 194757 (0.0010) [2023-12-27 20:37:38,297][106226] Updated weights for policy 0, policy_version 194553 (0.0006) [2023-12-27 20:37:38,312][106225] Updated weights for policy 1, policy_version 194767 (0.0009) [2023-12-27 20:37:38,378][106225] Updated weights for policy 1, policy_version 194777 (0.0008) [2023-12-27 20:37:39,027][106226] Updated weights for policy 0, policy_version 194563 (0.0008) [2023-12-27 20:37:39,084][106226] Updated weights for policy 0, policy_version 194573 (0.0008) [2023-12-27 20:37:39,119][106225] Updated weights for policy 1, policy_version 194787 (0.0010) [2023-12-27 20:37:39,142][106226] Updated weights for policy 0, policy_version 194583 (0.0007) [2023-12-27 20:37:39,172][106225] Updated weights for policy 1, policy_version 194797 (0.0006) [2023-12-27 20:37:39,240][106225] Updated weights for policy 1, policy_version 194807 (0.0008) [2023-12-27 20:37:39,993][106226] Updated weights for policy 0, policy_version 194593 (0.0008) [2023-12-27 20:37:40,002][106225] Updated weights for policy 1, policy_version 194817 (0.0007) [2023-12-27 20:37:40,056][106226] Updated weights for policy 0, policy_version 194603 (0.0008) [2023-12-27 20:37:40,070][106225] Updated weights for policy 1, policy_version 194827 (0.0008) [2023-12-27 20:37:40,116][106226] Updated weights for policy 0, policy_version 194613 (0.0007) [2023-12-27 20:37:40,134][106225] Updated weights for policy 1, policy_version 194837 (0.0008) [2023-12-27 20:37:40,176][106226] Updated weights for policy 0, policy_version 194623 (0.0006) [2023-12-27 20:37:40,199][106225] Updated weights for policy 1, policy_version 194847 (0.0007) [2023-12-27 20:37:40,882][106226] Updated weights for policy 0, policy_version 194633 (0.0005) [2023-12-27 20:37:40,928][106225] Updated weights for policy 1, policy_version 194857 (0.0007) [2023-12-27 20:37:40,938][106226] Updated weights for policy 0, policy_version 194643 (0.0006) [2023-12-27 20:37:40,977][106225] Updated weights for policy 1, policy_version 194867 (0.0007) [2023-12-27 20:37:40,990][106226] Updated weights for policy 0, policy_version 194653 (0.0006) [2023-12-27 20:37:41,035][106225] Updated weights for policy 1, policy_version 194877 (0.0007) [2023-12-27 20:37:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 99737600. Throughput: 0: 9992.8, 1: 10017.7. Samples: 99704836. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:41,175][105115] Avg episode reward: [(0, '-5.080'), (1, '-6.005')] [2023-12-27 20:37:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000194880_49897472.pth... [2023-12-27 20:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000194656_49840128.pth... [2023-12-27 20:37:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000193504_49545216.pth [2023-12-27 20:37:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000193696_49594368.pth [2023-12-27 20:37:41,760][106226] Updated weights for policy 0, policy_version 194663 (0.0008) [2023-12-27 20:37:41,816][106226] Updated weights for policy 0, policy_version 194673 (0.0009) [2023-12-27 20:37:41,870][106226] Updated weights for policy 0, policy_version 194683 (0.0008) [2023-12-27 20:37:41,877][106225] Updated weights for policy 1, policy_version 194887 (0.0008) [2023-12-27 20:37:41,943][106225] Updated weights for policy 1, policy_version 194897 (0.0008) [2023-12-27 20:37:41,991][106225] Updated weights for policy 1, policy_version 194907 (0.0008) [2023-12-27 20:37:42,571][106226] Updated weights for policy 0, policy_version 194693 (0.0007) [2023-12-27 20:37:42,631][106226] Updated weights for policy 0, policy_version 194703 (0.0005) [2023-12-27 20:37:42,698][106226] Updated weights for policy 0, policy_version 194713 (0.0008) [2023-12-27 20:37:42,782][106225] Updated weights for policy 1, policy_version 194917 (0.0008) [2023-12-27 20:37:42,841][106225] Updated weights for policy 1, policy_version 194927 (0.0008) [2023-12-27 20:37:42,899][106225] Updated weights for policy 1, policy_version 194937 (0.0008) [2023-12-27 20:37:43,353][106226] Updated weights for policy 0, policy_version 194723 (0.0009) [2023-12-27 20:37:43,414][106226] Updated weights for policy 0, policy_version 194733 (0.0007) [2023-12-27 20:37:43,475][106226] Updated weights for policy 0, policy_version 194743 (0.0005) [2023-12-27 20:37:43,650][106225] Updated weights for policy 1, policy_version 194947 (0.0009) [2023-12-27 20:37:43,717][106225] Updated weights for policy 1, policy_version 194957 (0.0009) [2023-12-27 20:37:43,775][106225] Updated weights for policy 1, policy_version 194967 (0.0009) [2023-12-27 20:37:44,075][106226] Updated weights for policy 0, policy_version 194753 (0.0006) [2023-12-27 20:37:44,136][106226] Updated weights for policy 0, policy_version 194763 (0.0006) [2023-12-27 20:37:44,189][106226] Updated weights for policy 0, policy_version 194773 (0.0006) [2023-12-27 20:37:44,239][106226] Updated weights for policy 0, policy_version 194783 (0.0008) [2023-12-27 20:37:44,514][106225] Updated weights for policy 1, policy_version 194977 (0.0009) [2023-12-27 20:37:44,564][106225] Updated weights for policy 1, policy_version 194987 (0.0008) [2023-12-27 20:37:44,618][106225] Updated weights for policy 1, policy_version 194997 (0.0009) [2023-12-27 20:37:44,674][106225] Updated weights for policy 1, policy_version 195007 (0.0008) [2023-12-27 20:37:44,943][106226] Updated weights for policy 0, policy_version 194793 (0.0008) [2023-12-27 20:37:45,011][106226] Updated weights for policy 0, policy_version 194804 (0.0009) [2023-12-27 20:37:45,071][106226] Updated weights for policy 0, policy_version 194814 (0.0009) [2023-12-27 20:37:45,409][106225] Updated weights for policy 1, policy_version 195017 (0.0008) [2023-12-27 20:37:45,464][106225] Updated weights for policy 1, policy_version 195027 (0.0008) [2023-12-27 20:37:45,511][106225] Updated weights for policy 1, policy_version 195037 (0.0008) [2023-12-27 20:37:45,807][106226] Updated weights for policy 0, policy_version 194824 (0.0008) [2023-12-27 20:37:45,856][106226] Updated weights for policy 0, policy_version 194834 (0.0008) [2023-12-27 20:37:45,906][106226] Updated weights for policy 0, policy_version 194844 (0.0009) [2023-12-27 20:37:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 99827712. Throughput: 0: 9953.7, 1: 9896.5. Samples: 99817928. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:46,175][105115] Avg episode reward: [(0, '-5.197'), (1, '-6.351')] [2023-12-27 20:37:46,230][106225] Updated weights for policy 1, policy_version 195047 (0.0009) [2023-12-27 20:37:46,283][106225] Updated weights for policy 1, policy_version 195057 (0.0009) [2023-12-27 20:37:46,341][106225] Updated weights for policy 1, policy_version 195067 (0.0008) [2023-12-27 20:37:46,631][106226] Updated weights for policy 0, policy_version 194854 (0.0008) [2023-12-27 20:37:46,680][106226] Updated weights for policy 0, policy_version 194864 (0.0009) [2023-12-27 20:37:46,730][106226] Updated weights for policy 0, policy_version 194874 (0.0006) [2023-12-27 20:37:47,149][106225] Updated weights for policy 1, policy_version 195077 (0.0008) [2023-12-27 20:37:47,206][106225] Updated weights for policy 1, policy_version 195087 (0.0007) [2023-12-27 20:37:47,257][106225] Updated weights for policy 1, policy_version 195097 (0.0007) [2023-12-27 20:37:47,261][106226] Updated weights for policy 0, policy_version 194884 (0.0005) [2023-12-27 20:37:47,320][106226] Updated weights for policy 0, policy_version 194894 (0.0005) [2023-12-27 20:37:47,375][106226] Updated weights for policy 0, policy_version 194904 (0.0005) [2023-12-27 20:37:47,939][106226] Updated weights for policy 0, policy_version 194914 (0.0005) [2023-12-27 20:37:47,990][106226] Updated weights for policy 0, policy_version 194924 (0.0005) [2023-12-27 20:37:48,044][106225] Updated weights for policy 1, policy_version 195107 (0.0006) [2023-12-27 20:37:48,058][106226] Updated weights for policy 0, policy_version 194934 (0.0007) [2023-12-27 20:37:48,094][106225] Updated weights for policy 1, policy_version 195117 (0.0005) [2023-12-27 20:37:48,111][106226] Updated weights for policy 0, policy_version 194944 (0.0010) [2023-12-27 20:37:48,160][106225] Updated weights for policy 1, policy_version 195127 (0.0006) [2023-12-27 20:37:48,775][106225] Updated weights for policy 1, policy_version 195137 (0.0006) [2023-12-27 20:37:48,818][106226] Updated weights for policy 0, policy_version 194954 (0.0007) [2023-12-27 20:37:48,838][106225] Updated weights for policy 1, policy_version 195147 (0.0008) [2023-12-27 20:37:48,871][106226] Updated weights for policy 0, policy_version 194964 (0.0008) [2023-12-27 20:37:48,901][106225] Updated weights for policy 1, policy_version 195157 (0.0007) [2023-12-27 20:37:48,927][106226] Updated weights for policy 0, policy_version 194974 (0.0006) [2023-12-27 20:37:48,957][106225] Updated weights for policy 1, policy_version 195167 (0.0007) [2023-12-27 20:37:49,647][106226] Updated weights for policy 0, policy_version 194984 (0.0007) [2023-12-27 20:37:49,709][106226] Updated weights for policy 0, policy_version 194994 (0.0008) [2023-12-27 20:37:49,737][106225] Updated weights for policy 1, policy_version 195177 (0.0008) [2023-12-27 20:37:49,776][106226] Updated weights for policy 0, policy_version 195004 (0.0005) [2023-12-27 20:37:49,796][106225] Updated weights for policy 1, policy_version 195187 (0.0008) [2023-12-27 20:37:49,864][106225] Updated weights for policy 1, policy_version 195197 (0.0008) [2023-12-27 20:37:50,347][106226] Updated weights for policy 0, policy_version 195014 (0.0006) [2023-12-27 20:37:50,412][106226] Updated weights for policy 0, policy_version 195024 (0.0005) [2023-12-27 20:37:50,473][106226] Updated weights for policy 0, policy_version 195034 (0.0005) [2023-12-27 20:37:50,671][106225] Updated weights for policy 1, policy_version 195207 (0.0009) [2023-12-27 20:37:50,744][106225] Updated weights for policy 1, policy_version 195217 (0.0008) [2023-12-27 20:37:50,804][106225] Updated weights for policy 1, policy_version 195227 (0.0008) [2023-12-27 20:37:51,099][106226] Updated weights for policy 0, policy_version 195044 (0.0009) [2023-12-27 20:37:51,158][106226] Updated weights for policy 0, policy_version 195054 (0.0008) [2023-12-27 20:37:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 99926016. Throughput: 0: 9999.2, 1: 9789.9. Samples: 99938032. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:51,175][105115] Avg episode reward: [(0, '-5.040'), (1, '-6.258')] [2023-12-27 20:37:51,212][106226] Updated weights for policy 0, policy_version 195064 (0.0007) [2023-12-27 20:37:51,576][106225] Updated weights for policy 1, policy_version 195237 (0.0009) [2023-12-27 20:37:51,647][106225] Updated weights for policy 1, policy_version 195247 (0.0008) [2023-12-27 20:37:51,715][106225] Updated weights for policy 1, policy_version 195257 (0.0008) [2023-12-27 20:37:51,963][106226] Updated weights for policy 0, policy_version 195074 (0.0008) [2023-12-27 20:37:52,023][106226] Updated weights for policy 0, policy_version 195084 (0.0005) [2023-12-27 20:37:52,088][106226] Updated weights for policy 0, policy_version 195094 (0.0005) [2023-12-27 20:37:52,142][106226] Updated weights for policy 0, policy_version 195104 (0.0005) [2023-12-27 20:37:52,488][106225] Updated weights for policy 1, policy_version 195267 (0.0008) [2023-12-27 20:37:52,541][106225] Updated weights for policy 1, policy_version 195277 (0.0007) [2023-12-27 20:37:52,604][106225] Updated weights for policy 1, policy_version 195287 (0.0007) [2023-12-27 20:37:52,807][106226] Updated weights for policy 0, policy_version 195114 (0.0009) [2023-12-27 20:37:52,878][106226] Updated weights for policy 0, policy_version 195124 (0.0010) [2023-12-27 20:37:52,937][106226] Updated weights for policy 0, policy_version 195134 (0.0009) [2023-12-27 20:37:53,278][106225] Updated weights for policy 1, policy_version 195297 (0.0008) [2023-12-27 20:37:53,334][106225] Updated weights for policy 1, policy_version 195307 (0.0007) [2023-12-27 20:37:53,388][106225] Updated weights for policy 1, policy_version 195317 (0.0008) [2023-12-27 20:37:53,450][106225] Updated weights for policy 1, policy_version 195327 (0.0008) [2023-12-27 20:37:53,701][106226] Updated weights for policy 0, policy_version 195144 (0.0009) [2023-12-27 20:37:53,751][106226] Updated weights for policy 0, policy_version 195154 (0.0009) [2023-12-27 20:37:53,808][106226] Updated weights for policy 0, policy_version 195164 (0.0009) [2023-12-27 20:37:54,035][106225] Updated weights for policy 1, policy_version 195337 (0.0008) [2023-12-27 20:37:54,087][106225] Updated weights for policy 1, policy_version 195347 (0.0009) [2023-12-27 20:37:54,143][106225] Updated weights for policy 1, policy_version 195357 (0.0009) [2023-12-27 20:37:54,584][106226] Updated weights for policy 0, policy_version 195174 (0.0007) [2023-12-27 20:37:54,638][106226] Updated weights for policy 0, policy_version 195184 (0.0005) [2023-12-27 20:37:54,695][106226] Updated weights for policy 0, policy_version 195194 (0.0005) [2023-12-27 20:37:54,857][106225] Updated weights for policy 1, policy_version 195367 (0.0007) [2023-12-27 20:37:54,908][106225] Updated weights for policy 1, policy_version 195377 (0.0005) [2023-12-27 20:37:54,961][106225] Updated weights for policy 1, policy_version 195387 (0.0005) [2023-12-27 20:37:55,362][106226] Updated weights for policy 0, policy_version 195204 (0.0008) [2023-12-27 20:37:55,427][106226] Updated weights for policy 0, policy_version 195214 (0.0007) [2023-12-27 20:37:55,476][106226] Updated weights for policy 0, policy_version 195224 (0.0008) [2023-12-27 20:37:55,647][106225] Updated weights for policy 1, policy_version 195397 (0.0008) [2023-12-27 20:37:55,706][106225] Updated weights for policy 1, policy_version 195407 (0.0010) [2023-12-27 20:37:55,762][106225] Updated weights for policy 1, policy_version 195417 (0.0010) [2023-12-27 20:37:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 100024320. Throughput: 0: 9965.3, 1: 9761.6. Samples: 99995312. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:37:56,176][105115] Avg episode reward: [(0, '-5.161'), (1, '-6.489')] [2023-12-27 20:37:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000195232_49987584.pth... [2023-12-27 20:37:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000195424_50036736.pth... [2023-12-27 20:37:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000194048_49684480.pth [2023-12-27 20:37:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000194304_49750016.pth [2023-12-27 20:37:56,271][106226] Updated weights for policy 0, policy_version 195234 (0.0007) [2023-12-27 20:37:56,310][106225] Updated weights for policy 1, policy_version 195427 (0.0010) [2023-12-27 20:37:56,328][106226] Updated weights for policy 0, policy_version 195244 (0.0007) [2023-12-27 20:37:56,361][106225] Updated weights for policy 1, policy_version 195437 (0.0010) [2023-12-27 20:37:56,382][106226] Updated weights for policy 0, policy_version 195254 (0.0005) [2023-12-27 20:37:56,411][106225] Updated weights for policy 1, policy_version 195447 (0.0007) [2023-12-27 20:37:56,436][106226] Updated weights for policy 0, policy_version 195264 (0.0007) [2023-12-27 20:37:57,038][106225] Updated weights for policy 1, policy_version 195457 (0.0009) [2023-12-27 20:37:57,086][106225] Updated weights for policy 1, policy_version 195467 (0.0005) [2023-12-27 20:37:57,145][106225] Updated weights for policy 1, policy_version 195477 (0.0009) [2023-12-27 20:37:57,201][106225] Updated weights for policy 1, policy_version 195487 (0.0007) [2023-12-27 20:37:57,234][106226] Updated weights for policy 0, policy_version 195274 (0.0008) [2023-12-27 20:37:57,301][106226] Updated weights for policy 0, policy_version 195284 (0.0009) [2023-12-27 20:37:57,366][106226] Updated weights for policy 0, policy_version 195294 (0.0011) [2023-12-27 20:37:57,762][106225] Updated weights for policy 1, policy_version 195497 (0.0006) [2023-12-27 20:37:57,824][106225] Updated weights for policy 1, policy_version 195507 (0.0007) [2023-12-27 20:37:57,877][106225] Updated weights for policy 1, policy_version 195517 (0.0010) [2023-12-27 20:37:58,077][106226] Updated weights for policy 0, policy_version 195304 (0.0010) [2023-12-27 20:37:58,124][106226] Updated weights for policy 0, policy_version 195314 (0.0010) [2023-12-27 20:37:58,180][106226] Updated weights for policy 0, policy_version 195324 (0.0010) [2023-12-27 20:37:58,553][106225] Updated weights for policy 1, policy_version 195527 (0.0009) [2023-12-27 20:37:58,611][106225] Updated weights for policy 1, policy_version 195537 (0.0008) [2023-12-27 20:37:58,676][106225] Updated weights for policy 1, policy_version 195547 (0.0009) [2023-12-27 20:37:59,047][106226] Updated weights for policy 0, policy_version 195334 (0.0008) [2023-12-27 20:37:59,111][106226] Updated weights for policy 0, policy_version 195344 (0.0010) [2023-12-27 20:37:59,168][106226] Updated weights for policy 0, policy_version 195354 (0.0009) [2023-12-27 20:37:59,386][106225] Updated weights for policy 1, policy_version 195557 (0.0009) [2023-12-27 20:37:59,455][106225] Updated weights for policy 1, policy_version 195567 (0.0009) [2023-12-27 20:37:59,522][106225] Updated weights for policy 1, policy_version 195577 (0.0007) [2023-12-27 20:37:59,898][106226] Updated weights for policy 0, policy_version 195364 (0.0008) [2023-12-27 20:37:59,957][106226] Updated weights for policy 0, policy_version 195374 (0.0008) [2023-12-27 20:38:00,020][106226] Updated weights for policy 0, policy_version 195384 (0.0008) [2023-12-27 20:38:00,145][106225] Updated weights for policy 1, policy_version 195587 (0.0006) [2023-12-27 20:38:00,209][106225] Updated weights for policy 1, policy_version 195597 (0.0006) [2023-12-27 20:38:00,266][106225] Updated weights for policy 1, policy_version 195607 (0.0005) [2023-12-27 20:38:00,824][106226] Updated weights for policy 0, policy_version 195394 (0.0009) [2023-12-27 20:38:00,829][106225] Updated weights for policy 1, policy_version 195617 (0.0006) [2023-12-27 20:38:00,872][106226] Updated weights for policy 0, policy_version 195404 (0.0008) [2023-12-27 20:38:00,874][106225] Updated weights for policy 1, policy_version 195627 (0.0007) [2023-12-27 20:38:00,918][106225] Updated weights for policy 1, policy_version 195637 (0.0006) [2023-12-27 20:38:00,924][106226] Updated weights for policy 0, policy_version 195414 (0.0006) [2023-12-27 20:38:00,968][106225] Updated weights for policy 1, policy_version 195647 (0.0006) [2023-12-27 20:38:00,982][106226] Updated weights for policy 0, policy_version 195424 (0.0006) [2023-12-27 20:38:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 100130816. Throughput: 0: 9904.4, 1: 9847.5. Samples: 100114384. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:01,175][105115] Avg episode reward: [(0, '-5.065'), (1, '-6.541')] [2023-12-27 20:38:01,671][106225] Updated weights for policy 1, policy_version 195657 (0.0008) [2023-12-27 20:38:01,734][106225] Updated weights for policy 1, policy_version 195667 (0.0009) [2023-12-27 20:38:01,798][106225] Updated weights for policy 1, policy_version 195677 (0.0008) [2023-12-27 20:38:01,842][106226] Updated weights for policy 0, policy_version 195434 (0.0007) [2023-12-27 20:38:01,898][106226] Updated weights for policy 0, policy_version 195444 (0.0009) [2023-12-27 20:38:01,962][106226] Updated weights for policy 0, policy_version 195454 (0.0009) [2023-12-27 20:38:02,566][106225] Updated weights for policy 1, policy_version 195687 (0.0007) [2023-12-27 20:38:02,617][106225] Updated weights for policy 1, policy_version 195697 (0.0008) [2023-12-27 20:38:02,646][106226] Updated weights for policy 0, policy_version 195464 (0.0007) [2023-12-27 20:38:02,669][106225] Updated weights for policy 1, policy_version 195707 (0.0006) [2023-12-27 20:38:02,703][106226] Updated weights for policy 0, policy_version 195474 (0.0008) [2023-12-27 20:38:02,755][106226] Updated weights for policy 0, policy_version 195484 (0.0008) [2023-12-27 20:38:03,322][106225] Updated weights for policy 1, policy_version 195717 (0.0008) [2023-12-27 20:38:03,378][106225] Updated weights for policy 1, policy_version 195727 (0.0010) [2023-12-27 20:38:03,433][106225] Updated weights for policy 1, policy_version 195737 (0.0010) [2023-12-27 20:38:03,483][106226] Updated weights for policy 0, policy_version 195494 (0.0006) [2023-12-27 20:38:03,529][106226] Updated weights for policy 0, policy_version 195504 (0.0005) [2023-12-27 20:38:03,574][106226] Updated weights for policy 0, policy_version 195514 (0.0005) [2023-12-27 20:38:04,091][106225] Updated weights for policy 1, policy_version 195747 (0.0010) [2023-12-27 20:38:04,157][106225] Updated weights for policy 1, policy_version 195757 (0.0008) [2023-12-27 20:38:04,223][106225] Updated weights for policy 1, policy_version 195767 (0.0008) [2023-12-27 20:38:04,285][106226] Updated weights for policy 0, policy_version 195524 (0.0007) [2023-12-27 20:38:04,348][106226] Updated weights for policy 0, policy_version 195534 (0.0006) [2023-12-27 20:38:04,414][106226] Updated weights for policy 0, policy_version 195544 (0.0006) [2023-12-27 20:38:04,888][106225] Updated weights for policy 1, policy_version 195777 (0.0008) [2023-12-27 20:38:04,945][106225] Updated weights for policy 1, policy_version 195787 (0.0009) [2023-12-27 20:38:04,995][106225] Updated weights for policy 1, policy_version 195797 (0.0005) [2023-12-27 20:38:05,053][106225] Updated weights for policy 1, policy_version 195807 (0.0009) [2023-12-27 20:38:05,084][106226] Updated weights for policy 0, policy_version 195554 (0.0008) [2023-12-27 20:38:05,156][106226] Updated weights for policy 0, policy_version 195564 (0.0008) [2023-12-27 20:38:05,210][106226] Updated weights for policy 0, policy_version 195574 (0.0010) [2023-12-27 20:38:05,263][106226] Updated weights for policy 0, policy_version 195584 (0.0006) [2023-12-27 20:38:05,696][106225] Updated weights for policy 1, policy_version 195817 (0.0006) [2023-12-27 20:38:05,760][106225] Updated weights for policy 1, policy_version 195827 (0.0005) [2023-12-27 20:38:05,830][106225] Updated weights for policy 1, policy_version 195837 (0.0007) [2023-12-27 20:38:06,013][106226] Updated weights for policy 0, policy_version 195594 (0.0007) [2023-12-27 20:38:06,081][106226] Updated weights for policy 0, policy_version 195604 (0.0006) [2023-12-27 20:38:06,150][106226] Updated weights for policy 0, policy_version 195614 (0.0009) [2023-12-27 20:38:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 100229120. Throughput: 0: 9895.1, 1: 9901.4. Samples: 100234832. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:06,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-6.087')] [2023-12-27 20:38:06,557][106225] Updated weights for policy 1, policy_version 195847 (0.0008) [2023-12-27 20:38:06,604][106225] Updated weights for policy 1, policy_version 195857 (0.0007) [2023-12-27 20:38:06,650][106225] Updated weights for policy 1, policy_version 195867 (0.0005) [2023-12-27 20:38:06,765][106226] Updated weights for policy 0, policy_version 195624 (0.0010) [2023-12-27 20:38:06,821][106226] Updated weights for policy 0, policy_version 195634 (0.0010) [2023-12-27 20:38:06,875][106226] Updated weights for policy 0, policy_version 195644 (0.0010) [2023-12-27 20:38:07,276][106225] Updated weights for policy 1, policy_version 195877 (0.0005) [2023-12-27 20:38:07,326][106225] Updated weights for policy 1, policy_version 195887 (0.0008) [2023-12-27 20:38:07,383][106225] Updated weights for policy 1, policy_version 195897 (0.0007) [2023-12-27 20:38:07,569][106226] Updated weights for policy 0, policy_version 195654 (0.0008) [2023-12-27 20:38:07,624][106226] Updated weights for policy 0, policy_version 195664 (0.0005) [2023-12-27 20:38:07,679][106226] Updated weights for policy 0, policy_version 195674 (0.0005) [2023-12-27 20:38:08,093][106225] Updated weights for policy 1, policy_version 195907 (0.0007) [2023-12-27 20:38:08,146][106225] Updated weights for policy 1, policy_version 195917 (0.0010) [2023-12-27 20:38:08,206][106225] Updated weights for policy 1, policy_version 195927 (0.0010) [2023-12-27 20:38:08,243][106226] Updated weights for policy 0, policy_version 195684 (0.0005) [2023-12-27 20:38:08,308][106226] Updated weights for policy 0, policy_version 195694 (0.0006) [2023-12-27 20:38:08,378][106226] Updated weights for policy 0, policy_version 195704 (0.0011) [2023-12-27 20:38:08,939][106226] Updated weights for policy 0, policy_version 195714 (0.0010) [2023-12-27 20:38:08,950][106225] Updated weights for policy 1, policy_version 195937 (0.0009) [2023-12-27 20:38:08,994][106226] Updated weights for policy 0, policy_version 195724 (0.0005) [2023-12-27 20:38:09,010][106225] Updated weights for policy 1, policy_version 195947 (0.0011) [2023-12-27 20:38:09,046][106226] Updated weights for policy 0, policy_version 195734 (0.0005) [2023-12-27 20:38:09,063][106225] Updated weights for policy 1, policy_version 195957 (0.0010) [2023-12-27 20:38:09,106][106226] Updated weights for policy 0, policy_version 195744 (0.0005) [2023-12-27 20:38:09,110][106225] Updated weights for policy 1, policy_version 195967 (0.0010) [2023-12-27 20:38:09,772][106226] Updated weights for policy 0, policy_version 195754 (0.0011) [2023-12-27 20:38:09,848][106226] Updated weights for policy 0, policy_version 195764 (0.0010) [2023-12-27 20:38:09,912][106225] Updated weights for policy 1, policy_version 195977 (0.0007) [2023-12-27 20:38:09,913][106226] Updated weights for policy 0, policy_version 195774 (0.0009) [2023-12-27 20:38:09,977][106225] Updated weights for policy 1, policy_version 195987 (0.0008) [2023-12-27 20:38:10,031][106225] Updated weights for policy 1, policy_version 195997 (0.0008) [2023-12-27 20:38:10,674][106226] Updated weights for policy 0, policy_version 195784 (0.0009) [2023-12-27 20:38:10,733][106226] Updated weights for policy 0, policy_version 195794 (0.0009) [2023-12-27 20:38:10,790][106226] Updated weights for policy 0, policy_version 195804 (0.0007) [2023-12-27 20:38:10,792][106225] Updated weights for policy 1, policy_version 196007 (0.0008) [2023-12-27 20:38:10,846][106225] Updated weights for policy 1, policy_version 196017 (0.0007) [2023-12-27 20:38:10,896][106225] Updated weights for policy 1, policy_version 196027 (0.0010) [2023-12-27 20:38:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 100327424. Throughput: 0: 10007.2, 1: 9947.1. Samples: 100297844. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:11,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-6.372')] [2023-12-27 20:38:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000196032_50192384.pth... [2023-12-27 20:38:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000195808_50135040.pth... [2023-12-27 20:38:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000194880_49897472.pth [2023-12-27 20:38:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000194656_49840128.pth [2023-12-27 20:38:11,495][106226] Updated weights for policy 0, policy_version 195814 (0.0008) [2023-12-27 20:38:11,558][106226] Updated weights for policy 0, policy_version 195824 (0.0008) [2023-12-27 20:38:11,626][106226] Updated weights for policy 0, policy_version 195834 (0.0007) [2023-12-27 20:38:11,720][106225] Updated weights for policy 1, policy_version 196037 (0.0008) [2023-12-27 20:38:11,786][106225] Updated weights for policy 1, policy_version 196047 (0.0010) [2023-12-27 20:38:11,847][106225] Updated weights for policy 1, policy_version 196057 (0.0009) [2023-12-27 20:38:12,370][106226] Updated weights for policy 0, policy_version 195844 (0.0008) [2023-12-27 20:38:12,436][106226] Updated weights for policy 0, policy_version 195854 (0.0008) [2023-12-27 20:38:12,503][106226] Updated weights for policy 0, policy_version 195864 (0.0008) [2023-12-27 20:38:12,621][106225] Updated weights for policy 1, policy_version 196067 (0.0009) [2023-12-27 20:38:12,673][106225] Updated weights for policy 1, policy_version 196077 (0.0008) [2023-12-27 20:38:12,724][106225] Updated weights for policy 1, policy_version 196087 (0.0007) [2023-12-27 20:38:13,233][106226] Updated weights for policy 0, policy_version 195874 (0.0010) [2023-12-27 20:38:13,292][106226] Updated weights for policy 0, policy_version 195884 (0.0010) [2023-12-27 20:38:13,342][106226] Updated weights for policy 0, policy_version 195894 (0.0010) [2023-12-27 20:38:13,402][106226] Updated weights for policy 0, policy_version 195904 (0.0010) [2023-12-27 20:38:13,438][106225] Updated weights for policy 1, policy_version 196097 (0.0008) [2023-12-27 20:38:13,492][106225] Updated weights for policy 1, policy_version 196107 (0.0006) [2023-12-27 20:38:13,549][106225] Updated weights for policy 1, policy_version 196117 (0.0007) [2023-12-27 20:38:13,603][106225] Updated weights for policy 1, policy_version 196127 (0.0007) [2023-12-27 20:38:14,108][106226] Updated weights for policy 0, policy_version 195914 (0.0006) [2023-12-27 20:38:14,167][106226] Updated weights for policy 0, policy_version 195924 (0.0005) [2023-12-27 20:38:14,222][106226] Updated weights for policy 0, policy_version 195934 (0.0005) [2023-12-27 20:38:14,287][106225] Updated weights for policy 1, policy_version 196137 (0.0008) [2023-12-27 20:38:14,335][106225] Updated weights for policy 1, policy_version 196147 (0.0009) [2023-12-27 20:38:14,380][106225] Updated weights for policy 1, policy_version 196157 (0.0008) [2023-12-27 20:38:14,858][106226] Updated weights for policy 0, policy_version 195944 (0.0006) [2023-12-27 20:38:14,922][106226] Updated weights for policy 0, policy_version 195954 (0.0007) [2023-12-27 20:38:14,988][106226] Updated weights for policy 0, policy_version 195964 (0.0006) [2023-12-27 20:38:15,153][106225] Updated weights for policy 1, policy_version 196167 (0.0008) [2023-12-27 20:38:15,218][106225] Updated weights for policy 1, policy_version 196177 (0.0009) [2023-12-27 20:38:15,281][106225] Updated weights for policy 1, policy_version 196187 (0.0007) [2023-12-27 20:38:15,602][106226] Updated weights for policy 0, policy_version 195974 (0.0006) [2023-12-27 20:38:15,651][106226] Updated weights for policy 0, policy_version 195984 (0.0008) [2023-12-27 20:38:15,710][106226] Updated weights for policy 0, policy_version 195994 (0.0008) [2023-12-27 20:38:15,940][106225] Updated weights for policy 1, policy_version 196197 (0.0007) [2023-12-27 20:38:16,002][106225] Updated weights for policy 1, policy_version 196207 (0.0009) [2023-12-27 20:38:16,059][106225] Updated weights for policy 1, policy_version 196217 (0.0009) [2023-12-27 20:38:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 100425728. Throughput: 0: 9955.7, 1: 9796.3. Samples: 100412288. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:16,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-6.122')] [2023-12-27 20:38:16,391][106226] Updated weights for policy 0, policy_version 196004 (0.0008) [2023-12-27 20:38:16,447][106226] Updated weights for policy 0, policy_version 196014 (0.0005) [2023-12-27 20:38:16,501][106226] Updated weights for policy 0, policy_version 196024 (0.0006) [2023-12-27 20:38:16,857][106225] Updated weights for policy 1, policy_version 196227 (0.0008) [2023-12-27 20:38:16,922][106225] Updated weights for policy 1, policy_version 196237 (0.0008) [2023-12-27 20:38:16,971][106225] Updated weights for policy 1, policy_version 196247 (0.0009) [2023-12-27 20:38:17,069][106226] Updated weights for policy 0, policy_version 196034 (0.0006) [2023-12-27 20:38:17,121][106226] Updated weights for policy 0, policy_version 196044 (0.0009) [2023-12-27 20:38:17,177][106226] Updated weights for policy 0, policy_version 196054 (0.0009) [2023-12-27 20:38:17,236][106226] Updated weights for policy 0, policy_version 196064 (0.0008) [2023-12-27 20:38:17,598][106225] Updated weights for policy 1, policy_version 196257 (0.0008) [2023-12-27 20:38:17,664][106225] Updated weights for policy 1, policy_version 196267 (0.0007) [2023-12-27 20:38:17,717][106225] Updated weights for policy 1, policy_version 196277 (0.0008) [2023-12-27 20:38:17,781][106225] Updated weights for policy 1, policy_version 196287 (0.0008) [2023-12-27 20:38:18,022][106226] Updated weights for policy 0, policy_version 196074 (0.0011) [2023-12-27 20:38:18,080][106226] Updated weights for policy 0, policy_version 196084 (0.0010) [2023-12-27 20:38:18,149][106226] Updated weights for policy 0, policy_version 196094 (0.0010) [2023-12-27 20:38:18,469][106225] Updated weights for policy 1, policy_version 196297 (0.0009) [2023-12-27 20:38:18,521][106225] Updated weights for policy 1, policy_version 196307 (0.0008) [2023-12-27 20:38:18,578][106225] Updated weights for policy 1, policy_version 196317 (0.0009) [2023-12-27 20:38:18,739][106226] Updated weights for policy 0, policy_version 196104 (0.0007) [2023-12-27 20:38:18,786][106226] Updated weights for policy 0, policy_version 196114 (0.0010) [2023-12-27 20:38:18,847][106226] Updated weights for policy 0, policy_version 196124 (0.0011) [2023-12-27 20:38:19,355][106225] Updated weights for policy 1, policy_version 196327 (0.0008) [2023-12-27 20:38:19,418][106225] Updated weights for policy 1, policy_version 196337 (0.0006) [2023-12-27 20:38:19,508][106225] Updated weights for policy 1, policy_version 196347 (0.0006) [2023-12-27 20:38:19,589][106226] Updated weights for policy 0, policy_version 196134 (0.0010) [2023-12-27 20:38:19,637][106226] Updated weights for policy 0, policy_version 196144 (0.0010) [2023-12-27 20:38:19,684][106226] Updated weights for policy 0, policy_version 196154 (0.0010) [2023-12-27 20:38:20,193][106225] Updated weights for policy 1, policy_version 196357 (0.0008) [2023-12-27 20:38:20,248][106225] Updated weights for policy 1, policy_version 196367 (0.0008) [2023-12-27 20:38:20,301][106225] Updated weights for policy 1, policy_version 196377 (0.0008) [2023-12-27 20:38:20,388][106226] Updated weights for policy 0, policy_version 196164 (0.0009) [2023-12-27 20:38:20,451][106226] Updated weights for policy 0, policy_version 196174 (0.0011) [2023-12-27 20:38:20,516][106226] Updated weights for policy 0, policy_version 196184 (0.0011) [2023-12-27 20:38:21,135][106225] Updated weights for policy 1, policy_version 196387 (0.0008) [2023-12-27 20:38:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 100515840. Throughput: 0: 9955.4, 1: 9812.0. Samples: 100531892. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:21,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-6.312')] [2023-12-27 20:38:21,191][106226] Updated weights for policy 0, policy_version 196194 (0.0011) [2023-12-27 20:38:21,192][106225] Updated weights for policy 1, policy_version 196397 (0.0009) [2023-12-27 20:38:21,254][106225] Updated weights for policy 1, policy_version 196407 (0.0007) [2023-12-27 20:38:21,259][106226] Updated weights for policy 0, policy_version 196204 (0.0009) [2023-12-27 20:38:21,335][106226] Updated weights for policy 0, policy_version 196215 (0.0008) [2023-12-27 20:38:22,022][106225] Updated weights for policy 1, policy_version 196417 (0.0008) [2023-12-27 20:38:22,077][106225] Updated weights for policy 1, policy_version 196427 (0.0008) [2023-12-27 20:38:22,084][106226] Updated weights for policy 0, policy_version 196225 (0.0010) [2023-12-27 20:38:22,130][106225] Updated weights for policy 1, policy_version 196437 (0.0009) [2023-12-27 20:38:22,136][106226] Updated weights for policy 0, policy_version 196235 (0.0011) [2023-12-27 20:38:22,183][106225] Updated weights for policy 1, policy_version 196447 (0.0006) [2023-12-27 20:38:22,186][106226] Updated weights for policy 0, policy_version 196245 (0.0008) [2023-12-27 20:38:22,233][106226] Updated weights for policy 0, policy_version 196255 (0.0007) [2023-12-27 20:38:22,874][106225] Updated weights for policy 1, policy_version 196457 (0.0005) [2023-12-27 20:38:22,938][106225] Updated weights for policy 1, policy_version 196467 (0.0006) [2023-12-27 20:38:22,983][106226] Updated weights for policy 0, policy_version 196265 (0.0010) [2023-12-27 20:38:22,997][106225] Updated weights for policy 1, policy_version 196477 (0.0006) [2023-12-27 20:38:23,038][106226] Updated weights for policy 0, policy_version 196275 (0.0011) [2023-12-27 20:38:23,086][106226] Updated weights for policy 0, policy_version 196285 (0.0011) [2023-12-27 20:38:23,572][106225] Updated weights for policy 1, policy_version 196487 (0.0007) [2023-12-27 20:38:23,622][106225] Updated weights for policy 1, policy_version 196497 (0.0007) [2023-12-27 20:38:23,684][106225] Updated weights for policy 1, policy_version 196507 (0.0008) [2023-12-27 20:38:23,805][106226] Updated weights for policy 0, policy_version 196295 (0.0007) [2023-12-27 20:38:23,856][106226] Updated weights for policy 0, policy_version 196305 (0.0005) [2023-12-27 20:38:23,911][106226] Updated weights for policy 0, policy_version 196315 (0.0005) [2023-12-27 20:38:24,487][106225] Updated weights for policy 1, policy_version 196517 (0.0007) [2023-12-27 20:38:24,506][106226] Updated weights for policy 0, policy_version 196325 (0.0011) [2023-12-27 20:38:24,540][106225] Updated weights for policy 1, policy_version 196527 (0.0008) [2023-12-27 20:38:24,570][106226] Updated weights for policy 0, policy_version 196335 (0.0011) [2023-12-27 20:38:24,602][106225] Updated weights for policy 1, policy_version 196537 (0.0005) [2023-12-27 20:38:24,630][106226] Updated weights for policy 0, policy_version 196345 (0.0011) [2023-12-27 20:38:25,207][106225] Updated weights for policy 1, policy_version 196547 (0.0005) [2023-12-27 20:38:25,273][106225] Updated weights for policy 1, policy_version 196557 (0.0006) [2023-12-27 20:38:25,333][106226] Updated weights for policy 0, policy_version 196355 (0.0010) [2023-12-27 20:38:25,340][106225] Updated weights for policy 1, policy_version 196567 (0.0008) [2023-12-27 20:38:25,386][106226] Updated weights for policy 0, policy_version 196365 (0.0010) [2023-12-27 20:38:25,446][106226] Updated weights for policy 0, policy_version 196375 (0.0011) [2023-12-27 20:38:25,957][106225] Updated weights for policy 1, policy_version 196577 (0.0008) [2023-12-27 20:38:26,021][106225] Updated weights for policy 1, policy_version 196587 (0.0005) [2023-12-27 20:38:26,071][106225] Updated weights for policy 1, policy_version 196597 (0.0005) [2023-12-27 20:38:26,131][106225] Updated weights for policy 1, policy_version 196607 (0.0005) [2023-12-27 20:38:26,132][106226] Updated weights for policy 0, policy_version 196385 (0.0010) [2023-12-27 20:38:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 100622336. Throughput: 0: 9904.2, 1: 9768.5. Samples: 100590104. Policy #0 lag: (min: 14.0, avg: 26.0, max: 46.0) [2023-12-27 20:38:26,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-6.484')] [2023-12-27 20:38:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000196608_50339840.pth... [2023-12-27 20:38:26,182][106226] Updated weights for policy 0, policy_version 196395 (0.0010) [2023-12-27 20:38:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000195424_50036736.pth [2023-12-27 20:38:26,246][106226] Updated weights for policy 0, policy_version 196405 (0.0011) [2023-12-27 20:38:26,306][106226] Updated weights for policy 0, policy_version 196415 (0.0010) [2023-12-27 20:38:26,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000196416_50290688.pth... [2023-12-27 20:38:26,316][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000195232_49987584.pth [2023-12-27 20:38:26,723][106225] Updated weights for policy 1, policy_version 196617 (0.0005) [2023-12-27 20:38:26,779][106225] Updated weights for policy 1, policy_version 196627 (0.0005) [2023-12-27 20:38:26,836][106225] Updated weights for policy 1, policy_version 196637 (0.0005) [2023-12-27 20:38:27,006][106226] Updated weights for policy 0, policy_version 196425 (0.0010) [2023-12-27 20:38:27,065][106226] Updated weights for policy 0, policy_version 196435 (0.0010) [2023-12-27 20:38:27,121][106226] Updated weights for policy 0, policy_version 196445 (0.0010) [2023-12-27 20:38:27,391][106225] Updated weights for policy 1, policy_version 196647 (0.0007) [2023-12-27 20:38:27,441][106225] Updated weights for policy 1, policy_version 196657 (0.0007) [2023-12-27 20:38:27,488][106225] Updated weights for policy 1, policy_version 196667 (0.0008) [2023-12-27 20:38:27,780][106226] Updated weights for policy 0, policy_version 196455 (0.0008) [2023-12-27 20:38:27,841][106226] Updated weights for policy 0, policy_version 196465 (0.0009) [2023-12-27 20:38:27,901][106226] Updated weights for policy 0, policy_version 196475 (0.0011) [2023-12-27 20:38:28,158][106225] Updated weights for policy 1, policy_version 196677 (0.0010) [2023-12-27 20:38:28,214][106225] Updated weights for policy 1, policy_version 196687 (0.0008) [2023-12-27 20:38:28,275][106225] Updated weights for policy 1, policy_version 196697 (0.0008) [2023-12-27 20:38:28,598][106226] Updated weights for policy 0, policy_version 196485 (0.0009) [2023-12-27 20:38:28,655][106226] Updated weights for policy 0, policy_version 196495 (0.0010) [2023-12-27 20:38:28,713][106226] Updated weights for policy 0, policy_version 196505 (0.0011) [2023-12-27 20:38:28,891][106225] Updated weights for policy 1, policy_version 196707 (0.0008) [2023-12-27 20:38:28,963][106225] Updated weights for policy 1, policy_version 196717 (0.0007) [2023-12-27 20:38:29,025][106225] Updated weights for policy 1, policy_version 196727 (0.0010) [2023-12-27 20:38:29,319][106226] Updated weights for policy 0, policy_version 196515 (0.0007) [2023-12-27 20:38:29,384][106226] Updated weights for policy 0, policy_version 196525 (0.0008) [2023-12-27 20:38:29,448][106226] Updated weights for policy 0, policy_version 196535 (0.0008) [2023-12-27 20:38:29,750][106225] Updated weights for policy 1, policy_version 196737 (0.0010) [2023-12-27 20:38:29,806][106225] Updated weights for policy 1, policy_version 196747 (0.0007) [2023-12-27 20:38:29,874][106225] Updated weights for policy 1, policy_version 196757 (0.0009) [2023-12-27 20:38:29,935][106225] Updated weights for policy 1, policy_version 196767 (0.0008) [2023-12-27 20:38:30,101][106226] Updated weights for policy 0, policy_version 196545 (0.0008) [2023-12-27 20:38:30,163][106226] Updated weights for policy 0, policy_version 196555 (0.0005) [2023-12-27 20:38:30,225][106226] Updated weights for policy 0, policy_version 196565 (0.0005) [2023-12-27 20:38:30,282][106226] Updated weights for policy 0, policy_version 196575 (0.0005) [2023-12-27 20:38:30,699][106225] Updated weights for policy 1, policy_version 196777 (0.0009) [2023-12-27 20:38:30,766][106225] Updated weights for policy 1, policy_version 196787 (0.0010) [2023-12-27 20:38:30,821][106225] Updated weights for policy 1, policy_version 196797 (0.0009) [2023-12-27 20:38:30,857][106226] Updated weights for policy 0, policy_version 196585 (0.0006) [2023-12-27 20:38:30,918][106226] Updated weights for policy 0, policy_version 196595 (0.0008) [2023-12-27 20:38:30,985][106226] Updated weights for policy 0, policy_version 196605 (0.0008) [2023-12-27 20:38:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 100728832. Throughput: 0: 9986.0, 1: 9970.2. Samples: 100715960. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:31,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-6.313')] [2023-12-27 20:38:31,560][106225] Updated weights for policy 1, policy_version 196807 (0.0007) [2023-12-27 20:38:31,625][106225] Updated weights for policy 1, policy_version 196817 (0.0007) [2023-12-27 20:38:31,689][106225] Updated weights for policy 1, policy_version 196827 (0.0007) [2023-12-27 20:38:31,721][106226] Updated weights for policy 0, policy_version 196615 (0.0009) [2023-12-27 20:38:31,789][106226] Updated weights for policy 0, policy_version 196625 (0.0009) [2023-12-27 20:38:31,846][106226] Updated weights for policy 0, policy_version 196635 (0.0005) [2023-12-27 20:38:32,371][106225] Updated weights for policy 1, policy_version 196837 (0.0008) [2023-12-27 20:38:32,432][106225] Updated weights for policy 1, policy_version 196847 (0.0008) [2023-12-27 20:38:32,494][106225] Updated weights for policy 1, policy_version 196857 (0.0008) [2023-12-27 20:38:32,572][106226] Updated weights for policy 0, policy_version 196645 (0.0007) [2023-12-27 20:38:32,628][106226] Updated weights for policy 0, policy_version 196655 (0.0005) [2023-12-27 20:38:32,688][106226] Updated weights for policy 0, policy_version 196665 (0.0006) [2023-12-27 20:38:33,213][106226] Updated weights for policy 0, policy_version 196675 (0.0005) [2023-12-27 20:38:33,268][106226] Updated weights for policy 0, policy_version 196685 (0.0005) [2023-12-27 20:38:33,314][106225] Updated weights for policy 1, policy_version 196867 (0.0008) [2023-12-27 20:38:33,321][106226] Updated weights for policy 0, policy_version 196695 (0.0005) [2023-12-27 20:38:33,359][106225] Updated weights for policy 1, policy_version 196877 (0.0008) [2023-12-27 20:38:33,408][106225] Updated weights for policy 1, policy_version 196887 (0.0008) [2023-12-27 20:38:33,823][106226] Updated weights for policy 0, policy_version 196705 (0.0005) [2023-12-27 20:38:33,883][106226] Updated weights for policy 0, policy_version 196715 (0.0009) [2023-12-27 20:38:33,938][106226] Updated weights for policy 0, policy_version 196725 (0.0007) [2023-12-27 20:38:33,993][106226] Updated weights for policy 0, policy_version 196735 (0.0005) [2023-12-27 20:38:34,207][106225] Updated weights for policy 1, policy_version 196897 (0.0009) [2023-12-27 20:38:34,261][106225] Updated weights for policy 1, policy_version 196907 (0.0010) [2023-12-27 20:38:34,318][106225] Updated weights for policy 1, policy_version 196917 (0.0010) [2023-12-27 20:38:34,379][106225] Updated weights for policy 1, policy_version 196927 (0.0010) [2023-12-27 20:38:34,724][106226] Updated weights for policy 0, policy_version 196745 (0.0008) [2023-12-27 20:38:34,788][106226] Updated weights for policy 0, policy_version 196755 (0.0007) [2023-12-27 20:38:34,851][106226] Updated weights for policy 0, policy_version 196765 (0.0007) [2023-12-27 20:38:35,034][106225] Updated weights for policy 1, policy_version 196937 (0.0006) [2023-12-27 20:38:35,087][106225] Updated weights for policy 1, policy_version 196947 (0.0007) [2023-12-27 20:38:35,137][106225] Updated weights for policy 1, policy_version 196957 (0.0010) [2023-12-27 20:38:35,474][106226] Updated weights for policy 0, policy_version 196775 (0.0007) [2023-12-27 20:38:35,536][106226] Updated weights for policy 0, policy_version 196785 (0.0005) [2023-12-27 20:38:35,586][106226] Updated weights for policy 0, policy_version 196795 (0.0005) [2023-12-27 20:38:35,776][106225] Updated weights for policy 1, policy_version 196967 (0.0010) [2023-12-27 20:38:35,835][106225] Updated weights for policy 1, policy_version 196977 (0.0010) [2023-12-27 20:38:35,885][106225] Updated weights for policy 1, policy_version 196987 (0.0010) [2023-12-27 20:38:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 100827136. Throughput: 0: 9981.0, 1: 10005.3. Samples: 100837420. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:36,175][105115] Avg episode reward: [(0, '-5.396'), (1, '-5.986')] [2023-12-27 20:38:36,305][106226] Updated weights for policy 0, policy_version 196805 (0.0007) [2023-12-27 20:38:36,370][106226] Updated weights for policy 0, policy_version 196815 (0.0007) [2023-12-27 20:38:36,437][106226] Updated weights for policy 0, policy_version 196825 (0.0009) [2023-12-27 20:38:36,654][106225] Updated weights for policy 1, policy_version 196997 (0.0010) [2023-12-27 20:38:36,710][106225] Updated weights for policy 1, policy_version 197007 (0.0007) [2023-12-27 20:38:36,765][106225] Updated weights for policy 1, policy_version 197017 (0.0008) [2023-12-27 20:38:37,167][106226] Updated weights for policy 0, policy_version 196835 (0.0007) [2023-12-27 20:38:37,213][106226] Updated weights for policy 0, policy_version 196845 (0.0009) [2023-12-27 20:38:37,264][106226] Updated weights for policy 0, policy_version 196855 (0.0010) [2023-12-27 20:38:37,422][106225] Updated weights for policy 1, policy_version 197027 (0.0010) [2023-12-27 20:38:37,478][106225] Updated weights for policy 1, policy_version 197037 (0.0010) [2023-12-27 20:38:37,537][106225] Updated weights for policy 1, policy_version 197047 (0.0008) [2023-12-27 20:38:38,010][106226] Updated weights for policy 0, policy_version 196865 (0.0010) [2023-12-27 20:38:38,056][106226] Updated weights for policy 0, policy_version 196875 (0.0010) [2023-12-27 20:38:38,109][106226] Updated weights for policy 0, policy_version 196885 (0.0010) [2023-12-27 20:38:38,169][106226] Updated weights for policy 0, policy_version 196895 (0.0010) [2023-12-27 20:38:38,198][106225] Updated weights for policy 1, policy_version 197057 (0.0007) [2023-12-27 20:38:38,252][106225] Updated weights for policy 1, policy_version 197067 (0.0007) [2023-12-27 20:38:38,311][106225] Updated weights for policy 1, policy_version 197077 (0.0006) [2023-12-27 20:38:38,375][106225] Updated weights for policy 1, policy_version 197087 (0.0008) [2023-12-27 20:38:38,883][106226] Updated weights for policy 0, policy_version 196905 (0.0007) [2023-12-27 20:38:38,930][106226] Updated weights for policy 0, policy_version 196915 (0.0005) [2023-12-27 20:38:38,982][106226] Updated weights for policy 0, policy_version 196925 (0.0005) [2023-12-27 20:38:39,011][106225] Updated weights for policy 1, policy_version 197097 (0.0007) [2023-12-27 20:38:39,063][106225] Updated weights for policy 1, policy_version 197107 (0.0009) [2023-12-27 20:38:39,116][106225] Updated weights for policy 1, policy_version 197117 (0.0010) [2023-12-27 20:38:39,613][106226] Updated weights for policy 0, policy_version 196935 (0.0009) [2023-12-27 20:38:39,678][106226] Updated weights for policy 0, policy_version 196945 (0.0011) [2023-12-27 20:38:39,739][106226] Updated weights for policy 0, policy_version 196955 (0.0010) [2023-12-27 20:38:39,948][106225] Updated weights for policy 1, policy_version 197127 (0.0008) [2023-12-27 20:38:40,008][106225] Updated weights for policy 1, policy_version 197137 (0.0007) [2023-12-27 20:38:40,074][106225] Updated weights for policy 1, policy_version 197147 (0.0008) [2023-12-27 20:38:40,488][106226] Updated weights for policy 0, policy_version 196965 (0.0009) [2023-12-27 20:38:40,541][106226] Updated weights for policy 0, policy_version 196975 (0.0008) [2023-12-27 20:38:40,600][106226] Updated weights for policy 0, policy_version 196985 (0.0006) [2023-12-27 20:38:40,813][106225] Updated weights for policy 1, policy_version 197157 (0.0008) [2023-12-27 20:38:40,871][106225] Updated weights for policy 1, policy_version 197167 (0.0008) [2023-12-27 20:38:40,924][106225] Updated weights for policy 1, policy_version 197177 (0.0009) [2023-12-27 20:38:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 100925440. Throughput: 0: 10002.7, 1: 10031.3. Samples: 100896840. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:41,175][105115] Avg episode reward: [(0, '-5.120'), (1, '-6.227')] [2023-12-27 20:38:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000197184_50487296.pth... [2023-12-27 20:38:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000196992_50438144.pth... [2023-12-27 20:38:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000195808_50135040.pth [2023-12-27 20:38:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000196032_50192384.pth [2023-12-27 20:38:41,280][106226] Updated weights for policy 0, policy_version 196995 (0.0007) [2023-12-27 20:38:41,354][106226] Updated weights for policy 0, policy_version 197005 (0.0008) [2023-12-27 20:38:41,427][106226] Updated weights for policy 0, policy_version 197015 (0.0011) [2023-12-27 20:38:41,793][106225] Updated weights for policy 1, policy_version 197187 (0.0008) [2023-12-27 20:38:41,867][106225] Updated weights for policy 1, policy_version 197197 (0.0009) [2023-12-27 20:38:41,933][106225] Updated weights for policy 1, policy_version 197207 (0.0008) [2023-12-27 20:38:42,107][106226] Updated weights for policy 0, policy_version 197025 (0.0008) [2023-12-27 20:38:42,161][106226] Updated weights for policy 0, policy_version 197035 (0.0008) [2023-12-27 20:38:42,216][106226] Updated weights for policy 0, policy_version 197045 (0.0010) [2023-12-27 20:38:42,277][106226] Updated weights for policy 0, policy_version 197055 (0.0007) [2023-12-27 20:38:42,660][106225] Updated weights for policy 1, policy_version 197217 (0.0008) [2023-12-27 20:38:42,719][106225] Updated weights for policy 1, policy_version 197227 (0.0009) [2023-12-27 20:38:42,777][106225] Updated weights for policy 1, policy_version 197237 (0.0007) [2023-12-27 20:38:42,831][106225] Updated weights for policy 1, policy_version 197247 (0.0005) [2023-12-27 20:38:42,990][106226] Updated weights for policy 0, policy_version 197065 (0.0008) [2023-12-27 20:38:43,042][106226] Updated weights for policy 0, policy_version 197075 (0.0009) [2023-12-27 20:38:43,093][106226] Updated weights for policy 0, policy_version 197085 (0.0008) [2023-12-27 20:38:43,548][106225] Updated weights for policy 1, policy_version 197257 (0.0008) [2023-12-27 20:38:43,604][106225] Updated weights for policy 1, policy_version 197267 (0.0008) [2023-12-27 20:38:43,668][106225] Updated weights for policy 1, policy_version 197277 (0.0008) [2023-12-27 20:38:43,816][106226] Updated weights for policy 0, policy_version 197095 (0.0009) [2023-12-27 20:38:43,876][106226] Updated weights for policy 0, policy_version 197105 (0.0009) [2023-12-27 20:38:43,927][106226] Updated weights for policy 0, policy_version 197115 (0.0008) [2023-12-27 20:38:44,289][106225] Updated weights for policy 1, policy_version 197287 (0.0006) [2023-12-27 20:38:44,360][106225] Updated weights for policy 1, policy_version 197297 (0.0005) [2023-12-27 20:38:44,432][106225] Updated weights for policy 1, policy_version 197307 (0.0005) [2023-12-27 20:38:44,673][106226] Updated weights for policy 0, policy_version 197125 (0.0008) [2023-12-27 20:38:44,735][106226] Updated weights for policy 0, policy_version 197135 (0.0009) [2023-12-27 20:38:44,803][106226] Updated weights for policy 0, policy_version 197145 (0.0008) [2023-12-27 20:38:45,020][106225] Updated weights for policy 1, policy_version 197317 (0.0007) [2023-12-27 20:38:45,087][106225] Updated weights for policy 1, policy_version 197327 (0.0008) [2023-12-27 20:38:45,137][106225] Updated weights for policy 1, policy_version 197337 (0.0008) [2023-12-27 20:38:45,518][106226] Updated weights for policy 0, policy_version 197155 (0.0008) [2023-12-27 20:38:45,580][106226] Updated weights for policy 0, policy_version 197165 (0.0005) [2023-12-27 20:38:45,642][106226] Updated weights for policy 0, policy_version 197175 (0.0005) [2023-12-27 20:38:45,906][106225] Updated weights for policy 1, policy_version 197347 (0.0008) [2023-12-27 20:38:45,961][106225] Updated weights for policy 1, policy_version 197357 (0.0005) [2023-12-27 20:38:46,019][106225] Updated weights for policy 1, policy_version 197367 (0.0005) [2023-12-27 20:38:46,132][106226] Updated weights for policy 0, policy_version 197185 (0.0005) [2023-12-27 20:38:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 101023744. Throughput: 0: 10063.5, 1: 9897.0. Samples: 101012604. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:46,175][105115] Avg episode reward: [(0, '-5.349'), (1, '-6.605')] [2023-12-27 20:38:46,192][106226] Updated weights for policy 0, policy_version 197195 (0.0005) [2023-12-27 20:38:46,242][106226] Updated weights for policy 0, policy_version 197205 (0.0005) [2023-12-27 20:38:46,304][106226] Updated weights for policy 0, policy_version 197215 (0.0006) [2023-12-27 20:38:46,613][106225] Updated weights for policy 1, policy_version 197377 (0.0005) [2023-12-27 20:38:46,661][106225] Updated weights for policy 1, policy_version 197387 (0.0005) [2023-12-27 20:38:46,719][106225] Updated weights for policy 1, policy_version 197397 (0.0006) [2023-12-27 20:38:46,774][106225] Updated weights for policy 1, policy_version 197407 (0.0007) [2023-12-27 20:38:47,024][106226] Updated weights for policy 0, policy_version 197225 (0.0008) [2023-12-27 20:38:47,084][106226] Updated weights for policy 0, policy_version 197235 (0.0007) [2023-12-27 20:38:47,153][106226] Updated weights for policy 0, policy_version 197245 (0.0009) [2023-12-27 20:38:47,442][106225] Updated weights for policy 1, policy_version 197417 (0.0010) [2023-12-27 20:38:47,511][106225] Updated weights for policy 1, policy_version 197427 (0.0010) [2023-12-27 20:38:47,558][106225] Updated weights for policy 1, policy_version 197437 (0.0009) [2023-12-27 20:38:47,913][106226] Updated weights for policy 0, policy_version 197255 (0.0009) [2023-12-27 20:38:47,975][106226] Updated weights for policy 0, policy_version 197265 (0.0009) [2023-12-27 20:38:48,030][106226] Updated weights for policy 0, policy_version 197275 (0.0008) [2023-12-27 20:38:48,127][106225] Updated weights for policy 1, policy_version 197447 (0.0008) [2023-12-27 20:38:48,183][106225] Updated weights for policy 1, policy_version 197457 (0.0010) [2023-12-27 20:38:48,236][106225] Updated weights for policy 1, policy_version 197467 (0.0010) [2023-12-27 20:38:48,659][106226] Updated weights for policy 0, policy_version 197285 (0.0005) [2023-12-27 20:38:48,722][106226] Updated weights for policy 0, policy_version 197295 (0.0007) [2023-12-27 20:38:48,785][106226] Updated weights for policy 0, policy_version 197305 (0.0006) [2023-12-27 20:38:48,978][106225] Updated weights for policy 1, policy_version 197477 (0.0010) [2023-12-27 20:38:49,040][106225] Updated weights for policy 1, policy_version 197487 (0.0010) [2023-12-27 20:38:49,102][106225] Updated weights for policy 1, policy_version 197497 (0.0009) [2023-12-27 20:38:49,465][106226] Updated weights for policy 0, policy_version 197315 (0.0005) [2023-12-27 20:38:49,525][106226] Updated weights for policy 0, policy_version 197325 (0.0006) [2023-12-27 20:38:49,588][106226] Updated weights for policy 0, policy_version 197335 (0.0006) [2023-12-27 20:38:49,837][106225] Updated weights for policy 1, policy_version 197507 (0.0010) [2023-12-27 20:38:49,905][106225] Updated weights for policy 1, policy_version 197517 (0.0009) [2023-12-27 20:38:49,971][106225] Updated weights for policy 1, policy_version 197527 (0.0008) [2023-12-27 20:38:50,224][106226] Updated weights for policy 0, policy_version 197345 (0.0005) [2023-12-27 20:38:50,288][106226] Updated weights for policy 0, policy_version 197355 (0.0008) [2023-12-27 20:38:50,349][106226] Updated weights for policy 0, policy_version 197365 (0.0009) [2023-12-27 20:38:50,407][106226] Updated weights for policy 0, policy_version 197375 (0.0009) [2023-12-27 20:38:50,745][106225] Updated weights for policy 1, policy_version 197537 (0.0008) [2023-12-27 20:38:50,809][106225] Updated weights for policy 1, policy_version 197547 (0.0009) [2023-12-27 20:38:50,867][106225] Updated weights for policy 1, policy_version 197557 (0.0008) [2023-12-27 20:38:50,924][106225] Updated weights for policy 1, policy_version 197567 (0.0008) [2023-12-27 20:38:51,111][106226] Updated weights for policy 0, policy_version 197385 (0.0008) [2023-12-27 20:38:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 101122048. Throughput: 0: 10170.2, 1: 9827.2. Samples: 101134712. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:51,175][106226] Updated weights for policy 0, policy_version 197395 (0.0007) [2023-12-27 20:38:51,175][105115] Avg episode reward: [(0, '-5.109'), (1, '-6.377')] [2023-12-27 20:38:51,235][106226] Updated weights for policy 0, policy_version 197406 (0.0008) [2023-12-27 20:38:51,695][106225] Updated weights for policy 1, policy_version 197577 (0.0009) [2023-12-27 20:38:51,755][106225] Updated weights for policy 1, policy_version 197587 (0.0007) [2023-12-27 20:38:51,810][106225] Updated weights for policy 1, policy_version 197597 (0.0006) [2023-12-27 20:38:52,030][106226] Updated weights for policy 0, policy_version 197416 (0.0009) [2023-12-27 20:38:52,093][106226] Updated weights for policy 0, policy_version 197426 (0.0008) [2023-12-27 20:38:52,144][106226] Updated weights for policy 0, policy_version 197436 (0.0009) [2023-12-27 20:38:52,405][106225] Updated weights for policy 1, policy_version 197607 (0.0008) [2023-12-27 20:38:52,471][106225] Updated weights for policy 1, policy_version 197617 (0.0006) [2023-12-27 20:38:52,537][106225] Updated weights for policy 1, policy_version 197627 (0.0008) [2023-12-27 20:38:52,961][106226] Updated weights for policy 0, policy_version 197446 (0.0009) [2023-12-27 20:38:53,018][106226] Updated weights for policy 0, policy_version 197456 (0.0009) [2023-12-27 20:38:53,074][106226] Updated weights for policy 0, policy_version 197466 (0.0009) [2023-12-27 20:38:53,193][106225] Updated weights for policy 1, policy_version 197637 (0.0007) [2023-12-27 20:38:53,249][106225] Updated weights for policy 1, policy_version 197647 (0.0010) [2023-12-27 20:38:53,307][106225] Updated weights for policy 1, policy_version 197657 (0.0010) [2023-12-27 20:38:53,817][106226] Updated weights for policy 0, policy_version 197476 (0.0008) [2023-12-27 20:38:53,880][106226] Updated weights for policy 0, policy_version 197486 (0.0007) [2023-12-27 20:38:53,939][106226] Updated weights for policy 0, policy_version 197496 (0.0005) [2023-12-27 20:38:53,941][106225] Updated weights for policy 1, policy_version 197667 (0.0009) [2023-12-27 20:38:54,003][106225] Updated weights for policy 1, policy_version 197677 (0.0009) [2023-12-27 20:38:54,052][106225] Updated weights for policy 1, policy_version 197687 (0.0009) [2023-12-27 20:38:54,563][106226] Updated weights for policy 0, policy_version 197506 (0.0005) [2023-12-27 20:38:54,625][106226] Updated weights for policy 0, policy_version 197516 (0.0005) [2023-12-27 20:38:54,684][106226] Updated weights for policy 0, policy_version 197526 (0.0005) [2023-12-27 20:38:54,745][106226] Updated weights for policy 0, policy_version 197536 (0.0005) [2023-12-27 20:38:54,787][106225] Updated weights for policy 1, policy_version 197697 (0.0008) [2023-12-27 20:38:54,845][106225] Updated weights for policy 1, policy_version 197707 (0.0007) [2023-12-27 20:38:54,905][106225] Updated weights for policy 1, policy_version 197717 (0.0008) [2023-12-27 20:38:54,965][106225] Updated weights for policy 1, policy_version 197727 (0.0007) [2023-12-27 20:38:55,368][106226] Updated weights for policy 0, policy_version 197546 (0.0010) [2023-12-27 20:38:55,427][106226] Updated weights for policy 0, policy_version 197556 (0.0010) [2023-12-27 20:38:55,483][106226] Updated weights for policy 0, policy_version 197566 (0.0010) [2023-12-27 20:38:55,688][106225] Updated weights for policy 1, policy_version 197737 (0.0008) [2023-12-27 20:38:55,744][106225] Updated weights for policy 1, policy_version 197747 (0.0007) [2023-12-27 20:38:55,796][106225] Updated weights for policy 1, policy_version 197757 (0.0008) [2023-12-27 20:38:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 101220352. Throughput: 0: 10047.4, 1: 9840.2. Samples: 101192784. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:38:56,175][105115] Avg episode reward: [(0, '-5.014'), (1, '-6.113')] [2023-12-27 20:38:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000197760_50634752.pth... [2023-12-27 20:38:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000196608_50339840.pth [2023-12-27 20:38:56,187][106226] Updated weights for policy 0, policy_version 197576 (0.0010) [2023-12-27 20:38:56,249][106226] Updated weights for policy 0, policy_version 197586 (0.0009) [2023-12-27 20:38:56,306][106226] Updated weights for policy 0, policy_version 197596 (0.0010) [2023-12-27 20:38:56,324][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000197600_50593792.pth... [2023-12-27 20:38:56,327][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000196416_50290688.pth [2023-12-27 20:38:56,465][106225] Updated weights for policy 1, policy_version 197767 (0.0006) [2023-12-27 20:38:56,518][106225] Updated weights for policy 1, policy_version 197777 (0.0005) [2023-12-27 20:38:56,583][106225] Updated weights for policy 1, policy_version 197787 (0.0005) [2023-12-27 20:38:56,997][106226] Updated weights for policy 0, policy_version 197606 (0.0010) [2023-12-27 20:38:57,064][106226] Updated weights for policy 0, policy_version 197616 (0.0010) [2023-12-27 20:38:57,114][106226] Updated weights for policy 0, policy_version 197626 (0.0007) [2023-12-27 20:38:57,248][106225] Updated weights for policy 1, policy_version 197797 (0.0007) [2023-12-27 20:38:57,304][106225] Updated weights for policy 1, policy_version 197807 (0.0008) [2023-12-27 20:38:57,360][106225] Updated weights for policy 1, policy_version 197817 (0.0009) [2023-12-27 20:38:57,739][106226] Updated weights for policy 0, policy_version 197636 (0.0009) [2023-12-27 20:38:57,799][106226] Updated weights for policy 0, policy_version 197646 (0.0010) [2023-12-27 20:38:57,858][106226] Updated weights for policy 0, policy_version 197656 (0.0010) [2023-12-27 20:38:58,107][106225] Updated weights for policy 1, policy_version 197827 (0.0007) [2023-12-27 20:38:58,163][106225] Updated weights for policy 1, policy_version 197837 (0.0009) [2023-12-27 20:38:58,237][106225] Updated weights for policy 1, policy_version 197847 (0.0009) [2023-12-27 20:38:58,604][106226] Updated weights for policy 0, policy_version 197666 (0.0010) [2023-12-27 20:38:58,682][106226] Updated weights for policy 0, policy_version 197676 (0.0009) [2023-12-27 20:38:58,770][106226] Updated weights for policy 0, policy_version 197686 (0.0008) [2023-12-27 20:38:58,848][106226] Updated weights for policy 0, policy_version 197696 (0.0007) [2023-12-27 20:38:59,077][106225] Updated weights for policy 1, policy_version 197857 (0.0008) [2023-12-27 20:38:59,145][106225] Updated weights for policy 1, policy_version 197867 (0.0008) [2023-12-27 20:38:59,206][106225] Updated weights for policy 1, policy_version 197877 (0.0008) [2023-12-27 20:38:59,277][106225] Updated weights for policy 1, policy_version 197887 (0.0009) [2023-12-27 20:38:59,618][106226] Updated weights for policy 0, policy_version 197706 (0.0008) [2023-12-27 20:38:59,676][106226] Updated weights for policy 0, policy_version 197716 (0.0005) [2023-12-27 20:38:59,732][106226] Updated weights for policy 0, policy_version 197726 (0.0007) [2023-12-27 20:39:00,046][106225] Updated weights for policy 1, policy_version 197897 (0.0006) [2023-12-27 20:39:00,094][106225] Updated weights for policy 1, policy_version 197907 (0.0008) [2023-12-27 20:39:00,150][106225] Updated weights for policy 1, policy_version 197917 (0.0007) [2023-12-27 20:39:00,433][106226] Updated weights for policy 0, policy_version 197736 (0.0010) [2023-12-27 20:39:00,495][106226] Updated weights for policy 0, policy_version 197746 (0.0010) [2023-12-27 20:39:00,561][106226] Updated weights for policy 0, policy_version 197756 (0.0010) [2023-12-27 20:39:00,866][106225] Updated weights for policy 1, policy_version 197927 (0.0007) [2023-12-27 20:39:00,911][106225] Updated weights for policy 1, policy_version 197937 (0.0006) [2023-12-27 20:39:00,954][106225] Updated weights for policy 1, policy_version 197947 (0.0006) [2023-12-27 20:39:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 101318656. Throughput: 0: 10066.3, 1: 9861.9. Samples: 101309060. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:01,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-6.349')] [2023-12-27 20:39:01,295][106226] Updated weights for policy 0, policy_version 197766 (0.0011) [2023-12-27 20:39:01,362][106226] Updated weights for policy 0, policy_version 197776 (0.0010) [2023-12-27 20:39:01,430][106226] Updated weights for policy 0, policy_version 197786 (0.0009) [2023-12-27 20:39:01,751][106225] Updated weights for policy 1, policy_version 197957 (0.0008) [2023-12-27 20:39:01,802][106225] Updated weights for policy 1, policy_version 197967 (0.0009) [2023-12-27 20:39:01,860][106225] Updated weights for policy 1, policy_version 197977 (0.0007) [2023-12-27 20:39:02,129][106226] Updated weights for policy 0, policy_version 197796 (0.0008) [2023-12-27 20:39:02,189][106226] Updated weights for policy 0, policy_version 197806 (0.0005) [2023-12-27 20:39:02,257][106226] Updated weights for policy 0, policy_version 197816 (0.0006) [2023-12-27 20:39:02,657][106225] Updated weights for policy 1, policy_version 197987 (0.0009) [2023-12-27 20:39:02,712][106225] Updated weights for policy 1, policy_version 197997 (0.0006) [2023-12-27 20:39:02,770][106225] Updated weights for policy 1, policy_version 198007 (0.0006) [2023-12-27 20:39:02,836][106226] Updated weights for policy 0, policy_version 197826 (0.0008) [2023-12-27 20:39:02,896][106226] Updated weights for policy 0, policy_version 197836 (0.0008) [2023-12-27 20:39:02,953][106226] Updated weights for policy 0, policy_version 197846 (0.0007) [2023-12-27 20:39:03,009][106226] Updated weights for policy 0, policy_version 197856 (0.0008) [2023-12-27 20:39:03,447][106225] Updated weights for policy 1, policy_version 198017 (0.0008) [2023-12-27 20:39:03,493][106225] Updated weights for policy 1, policy_version 198027 (0.0005) [2023-12-27 20:39:03,539][106225] Updated weights for policy 1, policy_version 198037 (0.0005) [2023-12-27 20:39:03,587][106225] Updated weights for policy 1, policy_version 198047 (0.0007) [2023-12-27 20:39:03,742][106226] Updated weights for policy 0, policy_version 197866 (0.0005) [2023-12-27 20:39:03,802][106226] Updated weights for policy 0, policy_version 197876 (0.0007) [2023-12-27 20:39:03,869][106226] Updated weights for policy 0, policy_version 197886 (0.0009) [2023-12-27 20:39:04,299][106225] Updated weights for policy 1, policy_version 198057 (0.0006) [2023-12-27 20:39:04,364][106225] Updated weights for policy 1, policy_version 198067 (0.0007) [2023-12-27 20:39:04,433][106225] Updated weights for policy 1, policy_version 198077 (0.0007) [2023-12-27 20:39:04,629][106226] Updated weights for policy 0, policy_version 197896 (0.0008) [2023-12-27 20:39:04,684][106226] Updated weights for policy 0, policy_version 197906 (0.0008) [2023-12-27 20:39:04,741][106226] Updated weights for policy 0, policy_version 197916 (0.0009) [2023-12-27 20:39:04,978][106225] Updated weights for policy 1, policy_version 198087 (0.0008) [2023-12-27 20:39:05,031][106225] Updated weights for policy 1, policy_version 198097 (0.0007) [2023-12-27 20:39:05,080][106225] Updated weights for policy 1, policy_version 198107 (0.0008) [2023-12-27 20:39:05,466][106226] Updated weights for policy 0, policy_version 197926 (0.0006) [2023-12-27 20:39:05,521][106226] Updated weights for policy 0, policy_version 197936 (0.0006) [2023-12-27 20:39:05,581][106226] Updated weights for policy 0, policy_version 197946 (0.0009) [2023-12-27 20:39:05,855][106225] Updated weights for policy 1, policy_version 198117 (0.0008) [2023-12-27 20:39:05,912][106225] Updated weights for policy 1, policy_version 198127 (0.0007) [2023-12-27 20:39:05,966][106225] Updated weights for policy 1, policy_version 198137 (0.0008) [2023-12-27 20:39:06,131][106226] Updated weights for policy 0, policy_version 197956 (0.0009) [2023-12-27 20:39:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 101416960. Throughput: 0: 10043.5, 1: 9890.6. Samples: 101428924. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:06,175][105115] Avg episode reward: [(0, '-5.009'), (1, '-6.034')] [2023-12-27 20:39:06,195][106226] Updated weights for policy 0, policy_version 197966 (0.0008) [2023-12-27 20:39:06,253][106226] Updated weights for policy 0, policy_version 197976 (0.0010) [2023-12-27 20:39:06,671][106225] Updated weights for policy 1, policy_version 198147 (0.0008) [2023-12-27 20:39:06,740][106225] Updated weights for policy 1, policy_version 198157 (0.0006) [2023-12-27 20:39:06,814][106225] Updated weights for policy 1, policy_version 198167 (0.0006) [2023-12-27 20:39:06,960][106226] Updated weights for policy 0, policy_version 197986 (0.0009) [2023-12-27 20:39:07,029][106226] Updated weights for policy 0, policy_version 197996 (0.0008) [2023-12-27 20:39:07,096][106226] Updated weights for policy 0, policy_version 198006 (0.0009) [2023-12-27 20:39:07,157][106226] Updated weights for policy 0, policy_version 198016 (0.0009) [2023-12-27 20:39:07,423][106225] Updated weights for policy 1, policy_version 198177 (0.0007) [2023-12-27 20:39:07,473][106225] Updated weights for policy 1, policy_version 198187 (0.0008) [2023-12-27 20:39:07,538][106225] Updated weights for policy 1, policy_version 198197 (0.0009) [2023-12-27 20:39:07,599][106225] Updated weights for policy 1, policy_version 198207 (0.0008) [2023-12-27 20:39:07,810][106226] Updated weights for policy 0, policy_version 198026 (0.0009) [2023-12-27 20:39:07,870][106226] Updated weights for policy 0, policy_version 198036 (0.0009) [2023-12-27 20:39:07,927][106226] Updated weights for policy 0, policy_version 198046 (0.0008) [2023-12-27 20:39:08,320][106225] Updated weights for policy 1, policy_version 198217 (0.0007) [2023-12-27 20:39:08,379][106225] Updated weights for policy 1, policy_version 198227 (0.0007) [2023-12-27 20:39:08,448][106225] Updated weights for policy 1, policy_version 198237 (0.0007) [2023-12-27 20:39:08,619][106226] Updated weights for policy 0, policy_version 198056 (0.0006) [2023-12-27 20:39:08,689][106226] Updated weights for policy 0, policy_version 198066 (0.0007) [2023-12-27 20:39:08,755][106226] Updated weights for policy 0, policy_version 198076 (0.0005) [2023-12-27 20:39:09,158][106225] Updated weights for policy 1, policy_version 198247 (0.0008) [2023-12-27 20:39:09,223][106225] Updated weights for policy 1, policy_version 198257 (0.0009) [2023-12-27 20:39:09,286][106225] Updated weights for policy 1, policy_version 198267 (0.0009) [2023-12-27 20:39:09,339][106226] Updated weights for policy 0, policy_version 198086 (0.0006) [2023-12-27 20:39:09,414][106226] Updated weights for policy 0, policy_version 198096 (0.0008) [2023-12-27 20:39:09,476][106226] Updated weights for policy 0, policy_version 198106 (0.0007) [2023-12-27 20:39:10,062][106225] Updated weights for policy 1, policy_version 198277 (0.0008) [2023-12-27 20:39:10,121][106225] Updated weights for policy 1, policy_version 198287 (0.0008) [2023-12-27 20:39:10,157][106226] Updated weights for policy 0, policy_version 198116 (0.0009) [2023-12-27 20:39:10,183][106225] Updated weights for policy 1, policy_version 198297 (0.0007) [2023-12-27 20:39:10,219][106226] Updated weights for policy 0, policy_version 198126 (0.0007) [2023-12-27 20:39:10,281][106226] Updated weights for policy 0, policy_version 198136 (0.0007) [2023-12-27 20:39:10,932][106225] Updated weights for policy 1, policy_version 198307 (0.0007) [2023-12-27 20:39:10,970][106226] Updated weights for policy 0, policy_version 198146 (0.0007) [2023-12-27 20:39:10,984][106225] Updated weights for policy 1, policy_version 198317 (0.0006) [2023-12-27 20:39:11,024][106226] Updated weights for policy 0, policy_version 198156 (0.0008) [2023-12-27 20:39:11,050][106225] Updated weights for policy 1, policy_version 198327 (0.0006) [2023-12-27 20:39:11,094][106226] Updated weights for policy 0, policy_version 198166 (0.0008) [2023-12-27 20:39:11,160][106226] Updated weights for policy 0, policy_version 198176 (0.0009) [2023-12-27 20:39:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 101523456. Throughput: 0: 10089.9, 1: 9897.9. Samples: 101489552. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:11,175][105115] Avg episode reward: [(0, '-5.233'), (1, '-6.201')] [2023-12-27 20:39:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000198336_50782208.pth... [2023-12-27 20:39:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000198176_50741248.pth... [2023-12-27 20:39:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000197184_50487296.pth [2023-12-27 20:39:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000196992_50438144.pth [2023-12-27 20:39:11,805][106225] Updated weights for policy 1, policy_version 198337 (0.0008) [2023-12-27 20:39:11,869][106225] Updated weights for policy 1, policy_version 198347 (0.0008) [2023-12-27 20:39:11,938][106225] Updated weights for policy 1, policy_version 198357 (0.0010) [2023-12-27 20:39:11,947][106226] Updated weights for policy 0, policy_version 198186 (0.0006) [2023-12-27 20:39:11,996][106225] Updated weights for policy 1, policy_version 198367 (0.0010) [2023-12-27 20:39:12,011][106226] Updated weights for policy 0, policy_version 198196 (0.0008) [2023-12-27 20:39:12,080][106226] Updated weights for policy 0, policy_version 198206 (0.0007) [2023-12-27 20:39:12,743][106225] Updated weights for policy 1, policy_version 198377 (0.0010) [2023-12-27 20:39:12,748][106226] Updated weights for policy 0, policy_version 198216 (0.0009) [2023-12-27 20:39:12,798][106225] Updated weights for policy 1, policy_version 198387 (0.0011) [2023-12-27 20:39:12,810][106226] Updated weights for policy 0, policy_version 198226 (0.0011) [2023-12-27 20:39:12,853][106225] Updated weights for policy 1, policy_version 198397 (0.0010) [2023-12-27 20:39:12,869][106226] Updated weights for policy 0, policy_version 198236 (0.0011) [2023-12-27 20:39:13,541][106225] Updated weights for policy 1, policy_version 198407 (0.0010) [2023-12-27 20:39:13,544][106226] Updated weights for policy 0, policy_version 198246 (0.0008) [2023-12-27 20:39:13,600][106225] Updated weights for policy 1, policy_version 198417 (0.0006) [2023-12-27 20:39:13,604][106226] Updated weights for policy 0, policy_version 198256 (0.0007) [2023-12-27 20:39:13,655][106225] Updated weights for policy 1, policy_version 198427 (0.0005) [2023-12-27 20:39:13,660][106226] Updated weights for policy 0, policy_version 198266 (0.0008) [2023-12-27 20:39:14,222][106225] Updated weights for policy 1, policy_version 198437 (0.0007) [2023-12-27 20:39:14,286][106225] Updated weights for policy 1, policy_version 198447 (0.0010) [2023-12-27 20:39:14,350][106225] Updated weights for policy 1, policy_version 198457 (0.0010) [2023-12-27 20:39:14,403][106226] Updated weights for policy 0, policy_version 198276 (0.0007) [2023-12-27 20:39:14,471][106226] Updated weights for policy 0, policy_version 198286 (0.0006) [2023-12-27 20:39:14,532][106226] Updated weights for policy 0, policy_version 198296 (0.0008) [2023-12-27 20:39:15,029][106225] Updated weights for policy 1, policy_version 198467 (0.0009) [2023-12-27 20:39:15,091][106225] Updated weights for policy 1, policy_version 198477 (0.0009) [2023-12-27 20:39:15,149][106225] Updated weights for policy 1, policy_version 198487 (0.0011) [2023-12-27 20:39:15,239][106226] Updated weights for policy 0, policy_version 198306 (0.0009) [2023-12-27 20:39:15,308][106226] Updated weights for policy 0, policy_version 198316 (0.0010) [2023-12-27 20:39:15,366][106226] Updated weights for policy 0, policy_version 198326 (0.0009) [2023-12-27 20:39:15,419][106226] Updated weights for policy 0, policy_version 198336 (0.0008) [2023-12-27 20:39:15,775][106225] Updated weights for policy 1, policy_version 198497 (0.0009) [2023-12-27 20:39:15,840][106225] Updated weights for policy 1, policy_version 198507 (0.0007) [2023-12-27 20:39:15,903][106225] Updated weights for policy 1, policy_version 198517 (0.0008) [2023-12-27 20:39:15,956][106225] Updated weights for policy 1, policy_version 198527 (0.0007) [2023-12-27 20:39:16,051][106226] Updated weights for policy 0, policy_version 198346 (0.0010) [2023-12-27 20:39:16,103][106226] Updated weights for policy 0, policy_version 198356 (0.0010) [2023-12-27 20:39:16,152][106226] Updated weights for policy 0, policy_version 198366 (0.0010) [2023-12-27 20:39:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 101621760. Throughput: 0: 9990.1, 1: 9766.4. Samples: 101605004. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:16,175][105115] Avg episode reward: [(0, '-5.058'), (1, '-6.294')] [2023-12-27 20:39:16,591][106225] Updated weights for policy 1, policy_version 198537 (0.0006) [2023-12-27 20:39:16,640][106225] Updated weights for policy 1, policy_version 198547 (0.0008) [2023-12-27 20:39:16,692][106225] Updated weights for policy 1, policy_version 198557 (0.0005) [2023-12-27 20:39:16,782][106226] Updated weights for policy 0, policy_version 198376 (0.0008) [2023-12-27 20:39:16,851][106226] Updated weights for policy 0, policy_version 198386 (0.0008) [2023-12-27 20:39:16,906][106226] Updated weights for policy 0, policy_version 198396 (0.0008) [2023-12-27 20:39:17,234][106225] Updated weights for policy 1, policy_version 198567 (0.0006) [2023-12-27 20:39:17,288][106225] Updated weights for policy 1, policy_version 198577 (0.0005) [2023-12-27 20:39:17,345][106225] Updated weights for policy 1, policy_version 198587 (0.0005) [2023-12-27 20:39:17,550][106226] Updated weights for policy 0, policy_version 198406 (0.0005) [2023-12-27 20:39:17,603][106226] Updated weights for policy 0, policy_version 198416 (0.0005) [2023-12-27 20:39:17,659][106226] Updated weights for policy 0, policy_version 198426 (0.0005) [2023-12-27 20:39:17,970][106225] Updated weights for policy 1, policy_version 198597 (0.0007) [2023-12-27 20:39:18,035][106225] Updated weights for policy 1, policy_version 198607 (0.0009) [2023-12-27 20:39:18,092][106225] Updated weights for policy 1, policy_version 198618 (0.0010) [2023-12-27 20:39:18,201][106226] Updated weights for policy 0, policy_version 198436 (0.0005) [2023-12-27 20:39:18,267][106226] Updated weights for policy 0, policy_version 198446 (0.0005) [2023-12-27 20:39:18,331][106226] Updated weights for policy 0, policy_version 198456 (0.0006) [2023-12-27 20:39:18,888][106225] Updated weights for policy 1, policy_version 198628 (0.0008) [2023-12-27 20:39:18,915][106226] Updated weights for policy 0, policy_version 198466 (0.0009) [2023-12-27 20:39:18,944][106225] Updated weights for policy 1, policy_version 198638 (0.0006) [2023-12-27 20:39:18,968][106226] Updated weights for policy 0, policy_version 198476 (0.0010) [2023-12-27 20:39:19,006][106225] Updated weights for policy 1, policy_version 198648 (0.0005) [2023-12-27 20:39:19,030][106226] Updated weights for policy 0, policy_version 198486 (0.0008) [2023-12-27 20:39:19,093][106226] Updated weights for policy 0, policy_version 198496 (0.0008) [2023-12-27 20:39:19,758][106226] Updated weights for policy 0, policy_version 198506 (0.0006) [2023-12-27 20:39:19,794][106225] Updated weights for policy 1, policy_version 198658 (0.0006) [2023-12-27 20:39:19,826][106226] Updated weights for policy 0, policy_version 198516 (0.0007) [2023-12-27 20:39:19,863][106225] Updated weights for policy 1, policy_version 198668 (0.0007) [2023-12-27 20:39:19,890][106226] Updated weights for policy 0, policy_version 198526 (0.0007) [2023-12-27 20:39:19,929][106225] Updated weights for policy 1, policy_version 198678 (0.0006) [2023-12-27 20:39:19,995][106225] Updated weights for policy 1, policy_version 198688 (0.0007) [2023-12-27 20:39:20,608][106225] Updated weights for policy 1, policy_version 198698 (0.0009) [2023-12-27 20:39:20,648][106226] Updated weights for policy 0, policy_version 198536 (0.0008) [2023-12-27 20:39:20,671][106225] Updated weights for policy 1, policy_version 198708 (0.0009) [2023-12-27 20:39:20,705][106226] Updated weights for policy 0, policy_version 198546 (0.0008) [2023-12-27 20:39:20,727][106225] Updated weights for policy 1, policy_version 198718 (0.0006) [2023-12-27 20:39:20,770][106226] Updated weights for policy 0, policy_version 198556 (0.0008) [2023-12-27 20:39:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 101720064. Throughput: 0: 9975.2, 1: 9852.9. Samples: 101729684. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:21,175][105115] Avg episode reward: [(0, '-4.874'), (1, '-6.263')] [2023-12-27 20:39:21,499][106225] Updated weights for policy 1, policy_version 198728 (0.0008) [2023-12-27 20:39:21,553][106225] Updated weights for policy 1, policy_version 198738 (0.0008) [2023-12-27 20:39:21,593][106226] Updated weights for policy 0, policy_version 198566 (0.0007) [2023-12-27 20:39:21,618][106225] Updated weights for policy 1, policy_version 198748 (0.0007) [2023-12-27 20:39:21,661][106226] Updated weights for policy 0, policy_version 198576 (0.0008) [2023-12-27 20:39:21,734][106226] Updated weights for policy 0, policy_version 198586 (0.0009) [2023-12-27 20:39:22,283][106225] Updated weights for policy 1, policy_version 198758 (0.0008) [2023-12-27 20:39:22,352][106225] Updated weights for policy 1, policy_version 198768 (0.0007) [2023-12-27 20:39:22,425][106225] Updated weights for policy 1, policy_version 198778 (0.0008) [2023-12-27 20:39:22,557][106226] Updated weights for policy 0, policy_version 198596 (0.0010) [2023-12-27 20:39:22,621][106226] Updated weights for policy 0, policy_version 198606 (0.0008) [2023-12-27 20:39:22,683][106226] Updated weights for policy 0, policy_version 198616 (0.0009) [2023-12-27 20:39:23,064][106225] Updated weights for policy 1, policy_version 198788 (0.0006) [2023-12-27 20:39:23,116][106225] Updated weights for policy 1, policy_version 198798 (0.0006) [2023-12-27 20:39:23,170][106225] Updated weights for policy 1, policy_version 198808 (0.0005) [2023-12-27 20:39:23,398][106226] Updated weights for policy 0, policy_version 198626 (0.0008) [2023-12-27 20:39:23,450][106226] Updated weights for policy 0, policy_version 198636 (0.0005) [2023-12-27 20:39:23,509][106226] Updated weights for policy 0, policy_version 198646 (0.0006) [2023-12-27 20:39:23,575][106226] Updated weights for policy 0, policy_version 198656 (0.0005) [2023-12-27 20:39:23,793][106225] Updated weights for policy 1, policy_version 198818 (0.0005) [2023-12-27 20:39:23,859][106225] Updated weights for policy 1, policy_version 198828 (0.0005) [2023-12-27 20:39:23,913][106225] Updated weights for policy 1, policy_version 198838 (0.0005) [2023-12-27 20:39:23,961][106225] Updated weights for policy 1, policy_version 198848 (0.0006) [2023-12-27 20:39:24,229][106226] Updated weights for policy 0, policy_version 198666 (0.0008) [2023-12-27 20:39:24,291][106226] Updated weights for policy 0, policy_version 198676 (0.0006) [2023-12-27 20:39:24,350][106226] Updated weights for policy 0, policy_version 198686 (0.0005) [2023-12-27 20:39:24,604][106225] Updated weights for policy 1, policy_version 198858 (0.0008) [2023-12-27 20:39:24,660][106225] Updated weights for policy 1, policy_version 198868 (0.0007) [2023-12-27 20:39:24,719][106225] Updated weights for policy 1, policy_version 198878 (0.0005) [2023-12-27 20:39:24,874][106226] Updated weights for policy 0, policy_version 198696 (0.0007) [2023-12-27 20:39:24,931][106226] Updated weights for policy 0, policy_version 198706 (0.0010) [2023-12-27 20:39:24,991][106226] Updated weights for policy 0, policy_version 198716 (0.0010) [2023-12-27 20:39:25,380][106225] Updated weights for policy 1, policy_version 198888 (0.0007) [2023-12-27 20:39:25,438][106225] Updated weights for policy 1, policy_version 198898 (0.0008) [2023-12-27 20:39:25,498][106225] Updated weights for policy 1, policy_version 198908 (0.0008) [2023-12-27 20:39:25,691][106226] Updated weights for policy 0, policy_version 198726 (0.0011) [2023-12-27 20:39:25,743][106226] Updated weights for policy 0, policy_version 198736 (0.0010) [2023-12-27 20:39:25,807][106226] Updated weights for policy 0, policy_version 198746 (0.0007) [2023-12-27 20:39:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 101818368. Throughput: 0: 9952.0, 1: 9862.9. Samples: 101788512. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:26,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-6.102')] [2023-12-27 20:39:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000198752_50888704.pth... [2023-12-27 20:39:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000197600_50593792.pth [2023-12-27 20:39:26,216][106225] Updated weights for policy 1, policy_version 198918 (0.0006) [2023-12-27 20:39:26,278][106225] Updated weights for policy 1, policy_version 198928 (0.0009) [2023-12-27 20:39:26,334][106225] Updated weights for policy 1, policy_version 198938 (0.0010) [2023-12-27 20:39:26,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000198944_50937856.pth... [2023-12-27 20:39:26,365][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000197760_50634752.pth [2023-12-27 20:39:26,523][106226] Updated weights for policy 0, policy_version 198756 (0.0006) [2023-12-27 20:39:26,573][106226] Updated weights for policy 0, policy_version 198766 (0.0009) [2023-12-27 20:39:26,628][106226] Updated weights for policy 0, policy_version 198776 (0.0008) [2023-12-27 20:39:26,915][106225] Updated weights for policy 1, policy_version 198948 (0.0008) [2023-12-27 20:39:26,965][106225] Updated weights for policy 1, policy_version 198958 (0.0010) [2023-12-27 20:39:27,012][106225] Updated weights for policy 1, policy_version 198968 (0.0009) [2023-12-27 20:39:27,384][106226] Updated weights for policy 0, policy_version 198786 (0.0006) [2023-12-27 20:39:27,430][106226] Updated weights for policy 0, policy_version 198796 (0.0010) [2023-12-27 20:39:27,483][106226] Updated weights for policy 0, policy_version 198806 (0.0010) [2023-12-27 20:39:27,540][106226] Updated weights for policy 0, policy_version 198816 (0.0011) [2023-12-27 20:39:27,576][106225] Updated weights for policy 1, policy_version 198978 (0.0009) [2023-12-27 20:39:27,629][106225] Updated weights for policy 1, policy_version 198988 (0.0005) [2023-12-27 20:39:27,682][106225] Updated weights for policy 1, policy_version 198998 (0.0005) [2023-12-27 20:39:27,732][106225] Updated weights for policy 1, policy_version 199008 (0.0005) [2023-12-27 20:39:28,268][106226] Updated weights for policy 0, policy_version 198826 (0.0005) [2023-12-27 20:39:28,316][106226] Updated weights for policy 0, policy_version 198836 (0.0006) [2023-12-27 20:39:28,317][106225] Updated weights for policy 1, policy_version 199018 (0.0010) [2023-12-27 20:39:28,376][106226] Updated weights for policy 0, policy_version 198846 (0.0008) [2023-12-27 20:39:28,378][106225] Updated weights for policy 1, policy_version 199028 (0.0008) [2023-12-27 20:39:28,433][106225] Updated weights for policy 1, policy_version 199038 (0.0008) [2023-12-27 20:39:29,072][106225] Updated weights for policy 1, policy_version 199048 (0.0007) [2023-12-27 20:39:29,102][106226] Updated weights for policy 0, policy_version 198856 (0.0006) [2023-12-27 20:39:29,129][106225] Updated weights for policy 1, policy_version 199058 (0.0008) [2023-12-27 20:39:29,160][106226] Updated weights for policy 0, policy_version 198866 (0.0007) [2023-12-27 20:39:29,182][106225] Updated weights for policy 1, policy_version 199068 (0.0007) [2023-12-27 20:39:29,225][106226] Updated weights for policy 0, policy_version 198876 (0.0007) [2023-12-27 20:39:29,902][106226] Updated weights for policy 0, policy_version 198886 (0.0007) [2023-12-27 20:39:29,969][106225] Updated weights for policy 1, policy_version 199078 (0.0007) [2023-12-27 20:39:29,976][106226] Updated weights for policy 0, policy_version 198896 (0.0007) [2023-12-27 20:39:30,027][106225] Updated weights for policy 1, policy_version 199088 (0.0007) [2023-12-27 20:39:30,037][106226] Updated weights for policy 0, policy_version 198906 (0.0006) [2023-12-27 20:39:30,090][106225] Updated weights for policy 1, policy_version 199098 (0.0007) [2023-12-27 20:39:30,667][106226] Updated weights for policy 0, policy_version 198916 (0.0007) [2023-12-27 20:39:30,720][106226] Updated weights for policy 0, policy_version 198926 (0.0007) [2023-12-27 20:39:30,771][106226] Updated weights for policy 0, policy_version 198936 (0.0008) [2023-12-27 20:39:30,878][106225] Updated weights for policy 1, policy_version 199108 (0.0009) [2023-12-27 20:39:30,939][106225] Updated weights for policy 1, policy_version 199118 (0.0008) [2023-12-27 20:39:31,000][106225] Updated weights for policy 1, policy_version 199128 (0.0005) [2023-12-27 20:39:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 101924864. Throughput: 0: 9987.7, 1: 10016.3. Samples: 101912780. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:31,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-6.299')] [2023-12-27 20:39:31,413][106226] Updated weights for policy 0, policy_version 198946 (0.0008) [2023-12-27 20:39:31,474][106226] Updated weights for policy 0, policy_version 198956 (0.0006) [2023-12-27 20:39:31,537][106226] Updated weights for policy 0, policy_version 198966 (0.0006) [2023-12-27 20:39:31,591][106226] Updated weights for policy 0, policy_version 198976 (0.0005) [2023-12-27 20:39:31,750][106225] Updated weights for policy 1, policy_version 199138 (0.0006) [2023-12-27 20:39:31,809][106225] Updated weights for policy 1, policy_version 199148 (0.0008) [2023-12-27 20:39:31,869][106225] Updated weights for policy 1, policy_version 199158 (0.0008) [2023-12-27 20:39:31,930][106225] Updated weights for policy 1, policy_version 199168 (0.0008) [2023-12-27 20:39:32,234][106226] Updated weights for policy 0, policy_version 198987 (0.0010) [2023-12-27 20:39:32,293][106226] Updated weights for policy 0, policy_version 198997 (0.0008) [2023-12-27 20:39:32,353][106226] Updated weights for policy 0, policy_version 199007 (0.0008) [2023-12-27 20:39:32,631][106225] Updated weights for policy 1, policy_version 199178 (0.0009) [2023-12-27 20:39:32,678][106225] Updated weights for policy 1, policy_version 199188 (0.0010) [2023-12-27 20:39:32,728][106225] Updated weights for policy 1, policy_version 199198 (0.0010) [2023-12-27 20:39:33,105][106226] Updated weights for policy 0, policy_version 199017 (0.0006) [2023-12-27 20:39:33,156][106226] Updated weights for policy 0, policy_version 199027 (0.0007) [2023-12-27 20:39:33,214][106226] Updated weights for policy 0, policy_version 199037 (0.0006) [2023-12-27 20:39:33,334][106225] Updated weights for policy 1, policy_version 199208 (0.0008) [2023-12-27 20:39:33,384][106225] Updated weights for policy 1, policy_version 199218 (0.0010) [2023-12-27 20:39:33,446][106225] Updated weights for policy 1, policy_version 199228 (0.0010) [2023-12-27 20:39:33,904][106226] Updated weights for policy 0, policy_version 199047 (0.0007) [2023-12-27 20:39:33,957][106226] Updated weights for policy 0, policy_version 199057 (0.0008) [2023-12-27 20:39:34,006][106226] Updated weights for policy 0, policy_version 199067 (0.0007) [2023-12-27 20:39:34,130][106225] Updated weights for policy 1, policy_version 199238 (0.0010) [2023-12-27 20:39:34,191][106225] Updated weights for policy 1, policy_version 199248 (0.0010) [2023-12-27 20:39:34,248][106225] Updated weights for policy 1, policy_version 199258 (0.0009) [2023-12-27 20:39:34,757][106226] Updated weights for policy 0, policy_version 199077 (0.0007) [2023-12-27 20:39:34,816][106226] Updated weights for policy 0, policy_version 199087 (0.0007) [2023-12-27 20:39:34,865][106226] Updated weights for policy 0, policy_version 199097 (0.0008) [2023-12-27 20:39:34,992][106225] Updated weights for policy 1, policy_version 199268 (0.0011) [2023-12-27 20:39:35,042][106225] Updated weights for policy 1, policy_version 199278 (0.0010) [2023-12-27 20:39:35,122][106225] Updated weights for policy 1, policy_version 199288 (0.0010) [2023-12-27 20:39:35,601][106226] Updated weights for policy 0, policy_version 199107 (0.0008) [2023-12-27 20:39:35,650][106226] Updated weights for policy 0, policy_version 199117 (0.0008) [2023-12-27 20:39:35,695][106226] Updated weights for policy 0, policy_version 199127 (0.0007) [2023-12-27 20:39:35,816][106225] Updated weights for policy 1, policy_version 199298 (0.0010) [2023-12-27 20:39:35,869][106225] Updated weights for policy 1, policy_version 199308 (0.0010) [2023-12-27 20:39:35,928][106225] Updated weights for policy 1, policy_version 199318 (0.0010) [2023-12-27 20:39:35,984][106225] Updated weights for policy 1, policy_version 199328 (0.0010) [2023-12-27 20:39:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 102023168. Throughput: 0: 9942.5, 1: 9980.1. Samples: 102031228. Policy #0 lag: (min: 15.0, avg: 20.6, max: 47.0) [2023-12-27 20:39:36,175][105115] Avg episode reward: [(0, '-5.286'), (1, '-6.470')] [2023-12-27 20:39:36,419][106226] Updated weights for policy 0, policy_version 199137 (0.0007) [2023-12-27 20:39:36,474][106226] Updated weights for policy 0, policy_version 199147 (0.0007) [2023-12-27 20:39:36,530][106226] Updated weights for policy 0, policy_version 199157 (0.0006) [2023-12-27 20:39:36,590][106226] Updated weights for policy 0, policy_version 199167 (0.0007) [2023-12-27 20:39:36,759][106225] Updated weights for policy 1, policy_version 199338 (0.0008) [2023-12-27 20:39:36,825][106225] Updated weights for policy 1, policy_version 199348 (0.0008) [2023-12-27 20:39:36,894][106225] Updated weights for policy 1, policy_version 199358 (0.0008) [2023-12-27 20:39:37,226][106226] Updated weights for policy 0, policy_version 199177 (0.0010) [2023-12-27 20:39:37,277][106226] Updated weights for policy 0, policy_version 199187 (0.0011) [2023-12-27 20:39:37,334][106226] Updated weights for policy 0, policy_version 199197 (0.0010) [2023-12-27 20:39:37,643][106225] Updated weights for policy 1, policy_version 199368 (0.0007) [2023-12-27 20:39:37,692][106225] Updated weights for policy 1, policy_version 199378 (0.0008) [2023-12-27 20:39:37,747][106225] Updated weights for policy 1, policy_version 199388 (0.0008) [2023-12-27 20:39:38,070][106226] Updated weights for policy 0, policy_version 199207 (0.0006) [2023-12-27 20:39:38,134][106226] Updated weights for policy 0, policy_version 199217 (0.0010) [2023-12-27 20:39:38,198][106226] Updated weights for policy 0, policy_version 199227 (0.0009) [2023-12-27 20:39:38,374][106225] Updated weights for policy 1, policy_version 199398 (0.0008) [2023-12-27 20:39:38,437][106225] Updated weights for policy 1, policy_version 199408 (0.0009) [2023-12-27 20:39:38,503][106225] Updated weights for policy 1, policy_version 199418 (0.0010) [2023-12-27 20:39:38,779][106226] Updated weights for policy 0, policy_version 199237 (0.0006) [2023-12-27 20:39:38,842][106226] Updated weights for policy 0, policy_version 199247 (0.0005) [2023-12-27 20:39:38,899][106226] Updated weights for policy 0, policy_version 199257 (0.0005) [2023-12-27 20:39:39,286][106225] Updated weights for policy 1, policy_version 199428 (0.0008) [2023-12-27 20:39:39,350][106225] Updated weights for policy 1, policy_version 199438 (0.0009) [2023-12-27 20:39:39,424][106225] Updated weights for policy 1, policy_version 199448 (0.0008) [2023-12-27 20:39:39,571][106226] Updated weights for policy 0, policy_version 199267 (0.0008) [2023-12-27 20:39:39,636][106226] Updated weights for policy 0, policy_version 199277 (0.0008) [2023-12-27 20:39:39,697][106226] Updated weights for policy 0, policy_version 199287 (0.0009) [2023-12-27 20:39:40,273][106225] Updated weights for policy 1, policy_version 199458 (0.0008) [2023-12-27 20:39:40,343][106225] Updated weights for policy 1, policy_version 199468 (0.0009) [2023-12-27 20:39:40,385][106226] Updated weights for policy 0, policy_version 199297 (0.0009) [2023-12-27 20:39:40,409][106225] Updated weights for policy 1, policy_version 199478 (0.0008) [2023-12-27 20:39:40,439][106226] Updated weights for policy 0, policy_version 199307 (0.0006) [2023-12-27 20:39:40,470][106225] Updated weights for policy 1, policy_version 199488 (0.0007) [2023-12-27 20:39:40,494][106226] Updated weights for policy 0, policy_version 199317 (0.0006) [2023-12-27 20:39:40,548][106226] Updated weights for policy 0, policy_version 199327 (0.0005) [2023-12-27 20:39:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 102113280. Throughput: 0: 10027.7, 1: 9936.9. Samples: 102091192. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:39:41,175][105115] Avg episode reward: [(0, '-5.323'), (1, '-6.239')] [2023-12-27 20:39:41,238][106225] Updated weights for policy 1, policy_version 199498 (0.0006) [2023-12-27 20:39:41,239][106226] Updated weights for policy 0, policy_version 199337 (0.0007) [2023-12-27 20:39:41,304][106226] Updated weights for policy 0, policy_version 199347 (0.0009) [2023-12-27 20:39:41,304][106225] Updated weights for policy 1, policy_version 199508 (0.0007) [2023-12-27 20:39:41,366][106225] Updated weights for policy 1, policy_version 199518 (0.0007) [2023-12-27 20:39:41,369][106226] Updated weights for policy 0, policy_version 199357 (0.0008) [2023-12-27 20:39:41,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000199520_51085312.pth... [2023-12-27 20:39:41,384][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000198336_50782208.pth [2023-12-27 20:39:41,391][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000199360_51044352.pth... [2023-12-27 20:39:41,396][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000198176_50741248.pth [2023-12-27 20:39:42,035][106225] Updated weights for policy 1, policy_version 199528 (0.0009) [2023-12-27 20:39:42,098][106225] Updated weights for policy 1, policy_version 199538 (0.0008) [2023-12-27 20:39:42,156][106225] Updated weights for policy 1, policy_version 199548 (0.0008) [2023-12-27 20:39:42,176][106226] Updated weights for policy 0, policy_version 199367 (0.0010) [2023-12-27 20:39:42,234][106226] Updated weights for policy 0, policy_version 199377 (0.0011) [2023-12-27 20:39:42,303][106226] Updated weights for policy 0, policy_version 199387 (0.0009) [2023-12-27 20:39:42,805][106225] Updated weights for policy 1, policy_version 199558 (0.0007) [2023-12-27 20:39:42,864][106225] Updated weights for policy 1, policy_version 199568 (0.0007) [2023-12-27 20:39:42,932][106225] Updated weights for policy 1, policy_version 199578 (0.0005) [2023-12-27 20:39:43,067][106226] Updated weights for policy 0, policy_version 199397 (0.0009) [2023-12-27 20:39:43,118][106226] Updated weights for policy 0, policy_version 199407 (0.0007) [2023-12-27 20:39:43,169][106226] Updated weights for policy 0, policy_version 199417 (0.0005) [2023-12-27 20:39:43,577][106225] Updated weights for policy 1, policy_version 199588 (0.0007) [2023-12-27 20:39:43,636][106225] Updated weights for policy 1, policy_version 199598 (0.0008) [2023-12-27 20:39:43,690][106225] Updated weights for policy 1, policy_version 199608 (0.0008) [2023-12-27 20:39:43,904][106226] Updated weights for policy 0, policy_version 199427 (0.0007) [2023-12-27 20:39:43,964][106226] Updated weights for policy 0, policy_version 199437 (0.0008) [2023-12-27 20:39:44,020][106226] Updated weights for policy 0, policy_version 199447 (0.0007) [2023-12-27 20:39:44,344][106225] Updated weights for policy 1, policy_version 199618 (0.0006) [2023-12-27 20:39:44,408][106225] Updated weights for policy 1, policy_version 199628 (0.0007) [2023-12-27 20:39:44,479][106225] Updated weights for policy 1, policy_version 199638 (0.0006) [2023-12-27 20:39:44,539][106225] Updated weights for policy 1, policy_version 199648 (0.0010) [2023-12-27 20:39:44,741][106226] Updated weights for policy 0, policy_version 199457 (0.0008) [2023-12-27 20:39:44,800][106226] Updated weights for policy 0, policy_version 199467 (0.0007) [2023-12-27 20:39:44,868][106226] Updated weights for policy 0, policy_version 199477 (0.0006) [2023-12-27 20:39:44,932][106226] Updated weights for policy 0, policy_version 199487 (0.0009) [2023-12-27 20:39:45,258][106225] Updated weights for policy 1, policy_version 199658 (0.0009) [2023-12-27 20:39:45,328][106225] Updated weights for policy 1, policy_version 199668 (0.0009) [2023-12-27 20:39:45,399][106225] Updated weights for policy 1, policy_version 199678 (0.0009) [2023-12-27 20:39:45,621][106226] Updated weights for policy 0, policy_version 199497 (0.0011) [2023-12-27 20:39:45,681][106226] Updated weights for policy 0, policy_version 199507 (0.0008) [2023-12-27 20:39:45,739][106226] Updated weights for policy 0, policy_version 199517 (0.0009) [2023-12-27 20:39:46,055][106225] Updated weights for policy 1, policy_version 199688 (0.0010) [2023-12-27 20:39:46,108][106225] Updated weights for policy 1, policy_version 199698 (0.0010) [2023-12-27 20:39:46,169][106225] Updated weights for policy 1, policy_version 199708 (0.0007) [2023-12-27 20:39:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 102211584. Throughput: 0: 9970.9, 1: 9972.8. Samples: 102206524. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:39:46,175][105115] Avg episode reward: [(0, '-4.965'), (1, '-6.361')] [2023-12-27 20:39:46,484][106226] Updated weights for policy 0, policy_version 199527 (0.0009) [2023-12-27 20:39:46,543][106226] Updated weights for policy 0, policy_version 199537 (0.0009) [2023-12-27 20:39:46,601][106226] Updated weights for policy 0, policy_version 199547 (0.0008) [2023-12-27 20:39:46,792][106225] Updated weights for policy 1, policy_version 199718 (0.0005) [2023-12-27 20:39:46,843][106225] Updated weights for policy 1, policy_version 199728 (0.0005) [2023-12-27 20:39:46,894][106225] Updated weights for policy 1, policy_version 199738 (0.0005) [2023-12-27 20:39:47,432][106226] Updated weights for policy 0, policy_version 199557 (0.0008) [2023-12-27 20:39:47,433][106225] Updated weights for policy 1, policy_version 199748 (0.0005) [2023-12-27 20:39:47,490][106225] Updated weights for policy 1, policy_version 199758 (0.0005) [2023-12-27 20:39:47,498][106226] Updated weights for policy 0, policy_version 199567 (0.0007) [2023-12-27 20:39:47,551][106225] Updated weights for policy 1, policy_version 199768 (0.0006) [2023-12-27 20:39:47,564][106226] Updated weights for policy 0, policy_version 199577 (0.0008) [2023-12-27 20:39:48,228][106225] Updated weights for policy 1, policy_version 199778 (0.0009) [2023-12-27 20:39:48,233][106226] Updated weights for policy 0, policy_version 199587 (0.0007) [2023-12-27 20:39:48,292][106225] Updated weights for policy 1, policy_version 199788 (0.0008) [2023-12-27 20:39:48,293][106226] Updated weights for policy 0, policy_version 199597 (0.0006) [2023-12-27 20:39:48,357][106225] Updated weights for policy 1, policy_version 199798 (0.0009) [2023-12-27 20:39:48,358][106226] Updated weights for policy 0, policy_version 199607 (0.0009) [2023-12-27 20:39:48,412][106225] Updated weights for policy 1, policy_version 199808 (0.0007) [2023-12-27 20:39:49,037][106225] Updated weights for policy 1, policy_version 199818 (0.0006) [2023-12-27 20:39:49,088][106225] Updated weights for policy 1, policy_version 199828 (0.0005) [2023-12-27 20:39:49,136][106226] Updated weights for policy 0, policy_version 199617 (0.0007) [2023-12-27 20:39:49,139][106225] Updated weights for policy 1, policy_version 199838 (0.0005) [2023-12-27 20:39:49,187][106226] Updated weights for policy 0, policy_version 199627 (0.0007) [2023-12-27 20:39:49,251][106226] Updated weights for policy 0, policy_version 199637 (0.0008) [2023-12-27 20:39:49,307][106226] Updated weights for policy 0, policy_version 199647 (0.0008) [2023-12-27 20:39:49,822][106225] Updated weights for policy 1, policy_version 199848 (0.0008) [2023-12-27 20:39:49,890][106225] Updated weights for policy 1, policy_version 199858 (0.0009) [2023-12-27 20:39:49,954][106225] Updated weights for policy 1, policy_version 199868 (0.0008) [2023-12-27 20:39:50,055][106226] Updated weights for policy 0, policy_version 199657 (0.0007) [2023-12-27 20:39:50,116][106226] Updated weights for policy 0, policy_version 199667 (0.0008) [2023-12-27 20:39:50,183][106226] Updated weights for policy 0, policy_version 199677 (0.0007) [2023-12-27 20:39:50,709][106225] Updated weights for policy 1, policy_version 199878 (0.0007) [2023-12-27 20:39:50,773][106225] Updated weights for policy 1, policy_version 199888 (0.0007) [2023-12-27 20:39:50,837][106225] Updated weights for policy 1, policy_version 199898 (0.0009) [2023-12-27 20:39:50,904][106226] Updated weights for policy 0, policy_version 199687 (0.0008) [2023-12-27 20:39:50,969][106226] Updated weights for policy 0, policy_version 199697 (0.0008) [2023-12-27 20:39:51,034][106226] Updated weights for policy 0, policy_version 199707 (0.0009) [2023-12-27 20:39:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 102318080. Throughput: 0: 9877.3, 1: 10029.8. Samples: 102324748. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:39:51,175][105115] Avg episode reward: [(0, '-5.363'), (1, '-6.148')] [2023-12-27 20:39:51,505][106225] Updated weights for policy 1, policy_version 199908 (0.0008) [2023-12-27 20:39:51,567][106225] Updated weights for policy 1, policy_version 199918 (0.0008) [2023-12-27 20:39:51,624][106225] Updated weights for policy 1, policy_version 199928 (0.0009) [2023-12-27 20:39:51,685][106226] Updated weights for policy 0, policy_version 199717 (0.0007) [2023-12-27 20:39:51,757][106226] Updated weights for policy 0, policy_version 199727 (0.0010) [2023-12-27 20:39:51,823][106226] Updated weights for policy 0, policy_version 199737 (0.0009) [2023-12-27 20:39:52,352][106225] Updated weights for policy 1, policy_version 199938 (0.0008) [2023-12-27 20:39:52,422][106225] Updated weights for policy 1, policy_version 199948 (0.0007) [2023-12-27 20:39:52,491][106225] Updated weights for policy 1, policy_version 199958 (0.0007) [2023-12-27 20:39:52,544][106225] Updated weights for policy 1, policy_version 199968 (0.0006) [2023-12-27 20:39:52,583][106226] Updated weights for policy 0, policy_version 199747 (0.0008) [2023-12-27 20:39:52,643][106226] Updated weights for policy 0, policy_version 199757 (0.0008) [2023-12-27 20:39:52,701][106226] Updated weights for policy 0, policy_version 199767 (0.0008) [2023-12-27 20:39:53,234][106225] Updated weights for policy 1, policy_version 199978 (0.0008) [2023-12-27 20:39:53,285][106226] Updated weights for policy 0, policy_version 199777 (0.0009) [2023-12-27 20:39:53,290][106225] Updated weights for policy 1, policy_version 199988 (0.0005) [2023-12-27 20:39:53,336][106226] Updated weights for policy 0, policy_version 199787 (0.0005) [2023-12-27 20:39:53,344][106225] Updated weights for policy 1, policy_version 199998 (0.0008) [2023-12-27 20:39:53,391][106226] Updated weights for policy 0, policy_version 199797 (0.0005) [2023-12-27 20:39:53,456][106226] Updated weights for policy 0, policy_version 199807 (0.0009) [2023-12-27 20:39:54,057][106226] Updated weights for policy 0, policy_version 199817 (0.0010) [2023-12-27 20:39:54,106][106225] Updated weights for policy 1, policy_version 200008 (0.0007) [2023-12-27 20:39:54,118][106226] Updated weights for policy 0, policy_version 199827 (0.0011) [2023-12-27 20:39:54,151][106225] Updated weights for policy 1, policy_version 200018 (0.0007) [2023-12-27 20:39:54,181][106226] Updated weights for policy 0, policy_version 199837 (0.0011) [2023-12-27 20:39:54,214][106225] Updated weights for policy 1, policy_version 200028 (0.0006) [2023-12-27 20:39:54,759][106226] Updated weights for policy 0, policy_version 199847 (0.0011) [2023-12-27 20:39:54,820][106226] Updated weights for policy 0, policy_version 199857 (0.0011) [2023-12-27 20:39:54,881][106226] Updated weights for policy 0, policy_version 199867 (0.0011) [2023-12-27 20:39:54,960][106225] Updated weights for policy 1, policy_version 200038 (0.0008) [2023-12-27 20:39:55,014][106225] Updated weights for policy 1, policy_version 200048 (0.0007) [2023-12-27 20:39:55,069][106225] Updated weights for policy 1, policy_version 200058 (0.0009) [2023-12-27 20:39:55,454][106226] Updated weights for policy 0, policy_version 199877 (0.0007) [2023-12-27 20:39:55,513][106226] Updated weights for policy 0, policy_version 199887 (0.0005) [2023-12-27 20:39:55,575][106226] Updated weights for policy 0, policy_version 199897 (0.0005) [2023-12-27 20:39:55,828][106225] Updated weights for policy 1, policy_version 200068 (0.0009) [2023-12-27 20:39:55,894][106225] Updated weights for policy 1, policy_version 200078 (0.0010) [2023-12-27 20:39:55,959][106225] Updated weights for policy 1, policy_version 200088 (0.0011) [2023-12-27 20:39:56,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 102416384. Throughput: 0: 9887.7, 1: 10015.9. Samples: 102385208. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:39:56,175][105115] Avg episode reward: [(0, '-5.248'), (1, '-6.219')] [2023-12-27 20:39:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000200096_51232768.pth... [2023-12-27 20:39:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000198944_50937856.pth [2023-12-27 20:39:56,186][106226] Updated weights for policy 0, policy_version 199907 (0.0008) [2023-12-27 20:39:56,242][106226] Updated weights for policy 0, policy_version 199917 (0.0010) [2023-12-27 20:39:56,295][106226] Updated weights for policy 0, policy_version 199927 (0.0010) [2023-12-27 20:39:56,332][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000199936_51191808.pth... [2023-12-27 20:39:56,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000198752_50888704.pth [2023-12-27 20:39:56,655][106225] Updated weights for policy 1, policy_version 200098 (0.0010) [2023-12-27 20:39:56,711][106225] Updated weights for policy 1, policy_version 200108 (0.0010) [2023-12-27 20:39:56,765][106225] Updated weights for policy 1, policy_version 200118 (0.0005) [2023-12-27 20:39:56,823][106225] Updated weights for policy 1, policy_version 200128 (0.0005) [2023-12-27 20:39:56,994][106226] Updated weights for policy 0, policy_version 199937 (0.0010) [2023-12-27 20:39:57,043][106226] Updated weights for policy 0, policy_version 199947 (0.0010) [2023-12-27 20:39:57,086][106226] Updated weights for policy 0, policy_version 199957 (0.0010) [2023-12-27 20:39:57,132][106226] Updated weights for policy 0, policy_version 199967 (0.0010) [2023-12-27 20:39:57,431][106225] Updated weights for policy 1, policy_version 200138 (0.0005) [2023-12-27 20:39:57,483][106225] Updated weights for policy 1, policy_version 200148 (0.0005) [2023-12-27 20:39:57,542][106225] Updated weights for policy 1, policy_version 200158 (0.0005) [2023-12-27 20:39:57,845][106226] Updated weights for policy 0, policy_version 199977 (0.0010) [2023-12-27 20:39:57,897][106226] Updated weights for policy 0, policy_version 199987 (0.0010) [2023-12-27 20:39:57,945][106226] Updated weights for policy 0, policy_version 199997 (0.0006) [2023-12-27 20:39:58,129][106225] Updated weights for policy 1, policy_version 200168 (0.0009) [2023-12-27 20:39:58,182][106225] Updated weights for policy 1, policy_version 200178 (0.0009) [2023-12-27 20:39:58,238][106225] Updated weights for policy 1, policy_version 200188 (0.0008) [2023-12-27 20:39:58,596][106226] Updated weights for policy 0, policy_version 200007 (0.0007) [2023-12-27 20:39:58,671][106226] Updated weights for policy 0, policy_version 200017 (0.0009) [2023-12-27 20:39:58,742][106226] Updated weights for policy 0, policy_version 200027 (0.0008) [2023-12-27 20:39:59,122][106225] Updated weights for policy 1, policy_version 200198 (0.0009) [2023-12-27 20:39:59,177][106225] Updated weights for policy 1, policy_version 200208 (0.0010) [2023-12-27 20:39:59,234][106225] Updated weights for policy 1, policy_version 200218 (0.0010) [2023-12-27 20:39:59,515][106226] Updated weights for policy 0, policy_version 200037 (0.0006) [2023-12-27 20:39:59,581][106226] Updated weights for policy 0, policy_version 200047 (0.0010) [2023-12-27 20:39:59,643][106226] Updated weights for policy 0, policy_version 200057 (0.0009) [2023-12-27 20:39:59,934][106225] Updated weights for policy 1, policy_version 200228 (0.0010) [2023-12-27 20:39:59,997][106225] Updated weights for policy 1, policy_version 200238 (0.0010) [2023-12-27 20:40:00,062][106225] Updated weights for policy 1, policy_version 200248 (0.0010) [2023-12-27 20:40:00,285][106226] Updated weights for policy 0, policy_version 200067 (0.0009) [2023-12-27 20:40:00,347][106226] Updated weights for policy 0, policy_version 200077 (0.0005) [2023-12-27 20:40:00,401][106226] Updated weights for policy 0, policy_version 200087 (0.0009) [2023-12-27 20:40:00,651][106225] Updated weights for policy 1, policy_version 200258 (0.0007) [2023-12-27 20:40:00,717][106225] Updated weights for policy 1, policy_version 200268 (0.0006) [2023-12-27 20:40:00,779][106225] Updated weights for policy 1, policy_version 200278 (0.0007) [2023-12-27 20:40:00,834][106225] Updated weights for policy 1, policy_version 200288 (0.0009) [2023-12-27 20:40:01,038][106226] Updated weights for policy 0, policy_version 200097 (0.0010) [2023-12-27 20:40:01,104][106226] Updated weights for policy 0, policy_version 200107 (0.0011) [2023-12-27 20:40:01,168][106226] Updated weights for policy 0, policy_version 200117 (0.0010) [2023-12-27 20:40:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 102514688. Throughput: 0: 9996.4, 1: 10035.0. Samples: 102506416. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:01,175][105115] Avg episode reward: [(0, '-5.541'), (1, '-6.382')] [2023-12-27 20:40:01,238][106226] Updated weights for policy 0, policy_version 200127 (0.0011) [2023-12-27 20:40:01,506][106225] Updated weights for policy 1, policy_version 200298 (0.0008) [2023-12-27 20:40:01,569][106225] Updated weights for policy 1, policy_version 200308 (0.0009) [2023-12-27 20:40:01,628][106225] Updated weights for policy 1, policy_version 200318 (0.0006) [2023-12-27 20:40:01,963][106226] Updated weights for policy 0, policy_version 200137 (0.0006) [2023-12-27 20:40:02,019][106226] Updated weights for policy 0, policy_version 200147 (0.0005) [2023-12-27 20:40:02,074][106226] Updated weights for policy 0, policy_version 200157 (0.0008) [2023-12-27 20:40:02,352][106225] Updated weights for policy 1, policy_version 200328 (0.0008) [2023-12-27 20:40:02,421][106225] Updated weights for policy 1, policy_version 200338 (0.0008) [2023-12-27 20:40:02,483][106225] Updated weights for policy 1, policy_version 200348 (0.0008) [2023-12-27 20:40:02,748][106226] Updated weights for policy 0, policy_version 200167 (0.0006) [2023-12-27 20:40:02,802][106226] Updated weights for policy 0, policy_version 200177 (0.0005) [2023-12-27 20:40:02,863][106226] Updated weights for policy 0, policy_version 200187 (0.0005) [2023-12-27 20:40:03,197][106225] Updated weights for policy 1, policy_version 200358 (0.0007) [2023-12-27 20:40:03,262][106225] Updated weights for policy 1, policy_version 200368 (0.0008) [2023-12-27 20:40:03,329][106225] Updated weights for policy 1, policy_version 200378 (0.0008) [2023-12-27 20:40:03,449][106226] Updated weights for policy 0, policy_version 200197 (0.0010) [2023-12-27 20:40:03,499][106226] Updated weights for policy 0, policy_version 200207 (0.0009) [2023-12-27 20:40:03,546][106226] Updated weights for policy 0, policy_version 200217 (0.0005) [2023-12-27 20:40:03,866][106225] Updated weights for policy 1, policy_version 200388 (0.0008) [2023-12-27 20:40:03,932][106225] Updated weights for policy 1, policy_version 200398 (0.0010) [2023-12-27 20:40:03,990][106225] Updated weights for policy 1, policy_version 200408 (0.0010) [2023-12-27 20:40:04,183][106226] Updated weights for policy 0, policy_version 200227 (0.0007) [2023-12-27 20:40:04,236][106226] Updated weights for policy 0, policy_version 200237 (0.0011) [2023-12-27 20:40:04,291][106226] Updated weights for policy 0, policy_version 200247 (0.0010) [2023-12-27 20:40:04,686][106225] Updated weights for policy 1, policy_version 200418 (0.0009) [2023-12-27 20:40:04,744][106225] Updated weights for policy 1, policy_version 200428 (0.0005) [2023-12-27 20:40:04,802][106225] Updated weights for policy 1, policy_version 200438 (0.0005) [2023-12-27 20:40:04,857][106225] Updated weights for policy 1, policy_version 200448 (0.0005) [2023-12-27 20:40:05,053][106226] Updated weights for policy 0, policy_version 200257 (0.0011) [2023-12-27 20:40:05,107][106226] Updated weights for policy 0, policy_version 200267 (0.0007) [2023-12-27 20:40:05,153][106226] Updated weights for policy 0, policy_version 200277 (0.0008) [2023-12-27 20:40:05,202][106226] Updated weights for policy 0, policy_version 200287 (0.0007) [2023-12-27 20:40:05,464][106225] Updated weights for policy 1, policy_version 200458 (0.0005) [2023-12-27 20:40:05,514][106225] Updated weights for policy 1, policy_version 200468 (0.0007) [2023-12-27 20:40:05,564][106225] Updated weights for policy 1, policy_version 200478 (0.0010) [2023-12-27 20:40:05,990][106226] Updated weights for policy 0, policy_version 200297 (0.0008) [2023-12-27 20:40:06,050][106226] Updated weights for policy 0, policy_version 200307 (0.0008) [2023-12-27 20:40:06,110][106226] Updated weights for policy 0, policy_version 200317 (0.0008) [2023-12-27 20:40:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 102621184. Throughput: 0: 9935.2, 1: 10057.1. Samples: 102629332. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:06,175][105115] Avg episode reward: [(0, '-4.942'), (1, '-6.423')] [2023-12-27 20:40:06,285][106225] Updated weights for policy 1, policy_version 200488 (0.0010) [2023-12-27 20:40:06,346][106225] Updated weights for policy 1, policy_version 200498 (0.0010) [2023-12-27 20:40:06,410][106225] Updated weights for policy 1, policy_version 200508 (0.0010) [2023-12-27 20:40:06,904][106226] Updated weights for policy 0, policy_version 200327 (0.0008) [2023-12-27 20:40:06,969][106226] Updated weights for policy 0, policy_version 200337 (0.0007) [2023-12-27 20:40:07,033][106226] Updated weights for policy 0, policy_version 200347 (0.0007) [2023-12-27 20:40:07,098][106225] Updated weights for policy 1, policy_version 200518 (0.0011) [2023-12-27 20:40:07,163][106225] Updated weights for policy 1, policy_version 200528 (0.0010) [2023-12-27 20:40:07,231][106225] Updated weights for policy 1, policy_version 200538 (0.0009) [2023-12-27 20:40:07,765][106226] Updated weights for policy 0, policy_version 200357 (0.0006) [2023-12-27 20:40:07,818][106226] Updated weights for policy 0, policy_version 200367 (0.0005) [2023-12-27 20:40:07,875][106226] Updated weights for policy 0, policy_version 200377 (0.0008) [2023-12-27 20:40:07,876][106225] Updated weights for policy 1, policy_version 200548 (0.0007) [2023-12-27 20:40:07,932][106225] Updated weights for policy 1, policy_version 200558 (0.0010) [2023-12-27 20:40:07,995][106225] Updated weights for policy 1, policy_version 200568 (0.0010) [2023-12-27 20:40:08,514][106226] Updated weights for policy 0, policy_version 200387 (0.0007) [2023-12-27 20:40:08,571][106226] Updated weights for policy 0, policy_version 200397 (0.0005) [2023-12-27 20:40:08,626][106226] Updated weights for policy 0, policy_version 200407 (0.0005) [2023-12-27 20:40:08,714][106225] Updated weights for policy 1, policy_version 200578 (0.0010) [2023-12-27 20:40:08,789][106225] Updated weights for policy 1, policy_version 200588 (0.0011) [2023-12-27 20:40:08,853][106225] Updated weights for policy 1, policy_version 200598 (0.0010) [2023-12-27 20:40:08,917][106225] Updated weights for policy 1, policy_version 200608 (0.0010) [2023-12-27 20:40:09,235][106226] Updated weights for policy 0, policy_version 200417 (0.0006) [2023-12-27 20:40:09,306][106226] Updated weights for policy 0, policy_version 200427 (0.0011) [2023-12-27 20:40:09,374][106226] Updated weights for policy 0, policy_version 200437 (0.0010) [2023-12-27 20:40:09,440][106226] Updated weights for policy 0, policy_version 200447 (0.0010) [2023-12-27 20:40:09,580][106225] Updated weights for policy 1, policy_version 200618 (0.0007) [2023-12-27 20:40:09,651][106225] Updated weights for policy 1, policy_version 200628 (0.0005) [2023-12-27 20:40:09,715][106225] Updated weights for policy 1, policy_version 200638 (0.0009) [2023-12-27 20:40:10,113][106226] Updated weights for policy 0, policy_version 200457 (0.0006) [2023-12-27 20:40:10,166][106226] Updated weights for policy 0, policy_version 200467 (0.0008) [2023-12-27 20:40:10,225][106226] Updated weights for policy 0, policy_version 200477 (0.0006) [2023-12-27 20:40:10,467][106225] Updated weights for policy 1, policy_version 200648 (0.0008) [2023-12-27 20:40:10,519][106225] Updated weights for policy 1, policy_version 200658 (0.0009) [2023-12-27 20:40:10,565][106225] Updated weights for policy 1, policy_version 200668 (0.0008) [2023-12-27 20:40:10,797][106226] Updated weights for policy 0, policy_version 200487 (0.0006) [2023-12-27 20:40:10,845][106226] Updated weights for policy 0, policy_version 200497 (0.0005) [2023-12-27 20:40:10,900][106226] Updated weights for policy 0, policy_version 200507 (0.0007) [2023-12-27 20:40:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.8). Total num frames: 102719488. Throughput: 0: 9975.1, 1: 10041.0. Samples: 102689236. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:11,175][105115] Avg episode reward: [(0, '-5.192'), (1, '-6.078')] [2023-12-27 20:40:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000200512_51339264.pth... [2023-12-27 20:40:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000200672_51380224.pth... [2023-12-27 20:40:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000199360_51044352.pth [2023-12-27 20:40:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000199520_51085312.pth [2023-12-27 20:40:11,460][106225] Updated weights for policy 1, policy_version 200678 (0.0009) [2023-12-27 20:40:11,530][106225] Updated weights for policy 1, policy_version 200688 (0.0011) [2023-12-27 20:40:11,595][106225] Updated weights for policy 1, policy_version 200698 (0.0010) [2023-12-27 20:40:11,616][106226] Updated weights for policy 0, policy_version 200517 (0.0008) [2023-12-27 20:40:11,690][106226] Updated weights for policy 0, policy_version 200527 (0.0008) [2023-12-27 20:40:11,760][106226] Updated weights for policy 0, policy_version 200537 (0.0008) [2023-12-27 20:40:12,261][106225] Updated weights for policy 1, policy_version 200708 (0.0007) [2023-12-27 20:40:12,321][106225] Updated weights for policy 1, policy_version 200718 (0.0011) [2023-12-27 20:40:12,390][106225] Updated weights for policy 1, policy_version 200728 (0.0009) [2023-12-27 20:40:12,488][106226] Updated weights for policy 0, policy_version 200547 (0.0009) [2023-12-27 20:40:12,548][106226] Updated weights for policy 0, policy_version 200557 (0.0007) [2023-12-27 20:40:12,610][106226] Updated weights for policy 0, policy_version 200567 (0.0008) [2023-12-27 20:40:13,104][106225] Updated weights for policy 1, policy_version 200738 (0.0009) [2023-12-27 20:40:13,167][106225] Updated weights for policy 1, policy_version 200748 (0.0010) [2023-12-27 20:40:13,235][106225] Updated weights for policy 1, policy_version 200758 (0.0011) [2023-12-27 20:40:13,295][106226] Updated weights for policy 0, policy_version 200577 (0.0010) [2023-12-27 20:40:13,297][106225] Updated weights for policy 1, policy_version 200768 (0.0010) [2023-12-27 20:40:13,351][106226] Updated weights for policy 0, policy_version 200587 (0.0010) [2023-12-27 20:40:13,408][106226] Updated weights for policy 0, policy_version 200597 (0.0010) [2023-12-27 20:40:13,466][106226] Updated weights for policy 0, policy_version 200607 (0.0010) [2023-12-27 20:40:13,944][106225] Updated weights for policy 1, policy_version 200778 (0.0006) [2023-12-27 20:40:14,011][106225] Updated weights for policy 1, policy_version 200788 (0.0007) [2023-12-27 20:40:14,067][106225] Updated weights for policy 1, policy_version 200798 (0.0008) [2023-12-27 20:40:14,174][106226] Updated weights for policy 0, policy_version 200617 (0.0011) [2023-12-27 20:40:14,221][106226] Updated weights for policy 0, policy_version 200627 (0.0010) [2023-12-27 20:40:14,278][106226] Updated weights for policy 0, policy_version 200637 (0.0011) [2023-12-27 20:40:14,765][106225] Updated weights for policy 1, policy_version 200808 (0.0008) [2023-12-27 20:40:14,826][106225] Updated weights for policy 1, policy_version 200818 (0.0007) [2023-12-27 20:40:14,880][106225] Updated weights for policy 1, policy_version 200828 (0.0008) [2023-12-27 20:40:15,042][106226] Updated weights for policy 0, policy_version 200647 (0.0009) [2023-12-27 20:40:15,104][106226] Updated weights for policy 0, policy_version 200657 (0.0008) [2023-12-27 20:40:15,169][106226] Updated weights for policy 0, policy_version 200667 (0.0011) [2023-12-27 20:40:15,589][106225] Updated weights for policy 1, policy_version 200838 (0.0009) [2023-12-27 20:40:15,649][106225] Updated weights for policy 1, policy_version 200848 (0.0009) [2023-12-27 20:40:15,709][106225] Updated weights for policy 1, policy_version 200858 (0.0006) [2023-12-27 20:40:15,795][106226] Updated weights for policy 0, policy_version 200677 (0.0009) [2023-12-27 20:40:15,852][106226] Updated weights for policy 0, policy_version 200687 (0.0010) [2023-12-27 20:40:15,854][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000003 [2023-12-27 20:40:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 102817792. Throughput: 0: 9974.8, 1: 9875.2. Samples: 102806028. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:16,175][105115] Avg episode reward: [(0, '-5.328'), (1, '-6.083')] [2023-12-27 20:40:16,333][106225] Updated weights for policy 1, policy_version 200868 (0.0010) [2023-12-27 20:40:16,392][106225] Updated weights for policy 1, policy_version 200878 (0.0010) [2023-12-27 20:40:16,443][106225] Updated weights for policy 1, policy_version 200888 (0.0010) [2023-12-27 20:40:16,617][106226] Updated weights for policy 0, policy_version 200697 (0.0011) [2023-12-27 20:40:16,685][106226] Updated weights for policy 0, policy_version 200707 (0.0009) [2023-12-27 20:40:16,747][106226] Updated weights for policy 0, policy_version 200717 (0.0006) [2023-12-27 20:40:17,172][106225] Updated weights for policy 1, policy_version 200898 (0.0010) [2023-12-27 20:40:17,219][106225] Updated weights for policy 1, policy_version 200908 (0.0010) [2023-12-27 20:40:17,266][106225] Updated weights for policy 1, policy_version 200918 (0.0010) [2023-12-27 20:40:17,312][106225] Updated weights for policy 1, policy_version 200928 (0.0010) [2023-12-27 20:40:17,393][106226] Updated weights for policy 0, policy_version 200727 (0.0009) [2023-12-27 20:40:17,456][106226] Updated weights for policy 0, policy_version 200737 (0.0010) [2023-12-27 20:40:17,522][106226] Updated weights for policy 0, policy_version 200747 (0.0010) [2023-12-27 20:40:17,977][106225] Updated weights for policy 1, policy_version 200938 (0.0008) [2023-12-27 20:40:18,032][106225] Updated weights for policy 1, policy_version 200948 (0.0007) [2023-12-27 20:40:18,088][106225] Updated weights for policy 1, policy_version 200958 (0.0006) [2023-12-27 20:40:18,216][106226] Updated weights for policy 0, policy_version 200757 (0.0011) [2023-12-27 20:40:18,278][106226] Updated weights for policy 0, policy_version 200767 (0.0010) [2023-12-27 20:40:18,344][106226] Updated weights for policy 0, policy_version 200777 (0.0010) [2023-12-27 20:40:18,796][106225] Updated weights for policy 1, policy_version 200968 (0.0006) [2023-12-27 20:40:18,862][106225] Updated weights for policy 1, policy_version 200978 (0.0006) [2023-12-27 20:40:18,924][106225] Updated weights for policy 1, policy_version 200988 (0.0010) [2023-12-27 20:40:19,035][106226] Updated weights for policy 0, policy_version 200787 (0.0009) [2023-12-27 20:40:19,101][106226] Updated weights for policy 0, policy_version 200797 (0.0005) [2023-12-27 20:40:19,169][106226] Updated weights for policy 0, policy_version 200807 (0.0005) [2023-12-27 20:40:19,618][106225] Updated weights for policy 1, policy_version 200998 (0.0010) [2023-12-27 20:40:19,665][106225] Updated weights for policy 1, policy_version 201008 (0.0010) [2023-12-27 20:40:19,719][106225] Updated weights for policy 1, policy_version 201018 (0.0010) [2023-12-27 20:40:19,838][106226] Updated weights for policy 0, policy_version 200817 (0.0007) [2023-12-27 20:40:19,905][106226] Updated weights for policy 0, policy_version 200827 (0.0009) [2023-12-27 20:40:19,976][106226] Updated weights for policy 0, policy_version 200837 (0.0008) [2023-12-27 20:40:20,041][106226] Updated weights for policy 0, policy_version 200847 (0.0008) [2023-12-27 20:40:20,493][106225] Updated weights for policy 1, policy_version 201028 (0.0010) [2023-12-27 20:40:20,561][106225] Updated weights for policy 1, policy_version 201038 (0.0006) [2023-12-27 20:40:20,634][106225] Updated weights for policy 1, policy_version 201048 (0.0009) [2023-12-27 20:40:20,732][106226] Updated weights for policy 0, policy_version 200857 (0.0009) [2023-12-27 20:40:20,794][106226] Updated weights for policy 0, policy_version 200867 (0.0007) [2023-12-27 20:40:20,845][106226] Updated weights for policy 0, policy_version 200877 (0.0007) [2023-12-27 20:40:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 102916096. Throughput: 0: 9967.3, 1: 9904.0. Samples: 102925436. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:21,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-6.244')] [2023-12-27 20:40:21,302][106225] Updated weights for policy 1, policy_version 201058 (0.0008) [2023-12-27 20:40:21,372][106225] Updated weights for policy 1, policy_version 201068 (0.0010) [2023-12-27 20:40:21,441][106225] Updated weights for policy 1, policy_version 201078 (0.0011) [2023-12-27 20:40:21,503][106225] Updated weights for policy 1, policy_version 201088 (0.0011) [2023-12-27 20:40:21,628][106226] Updated weights for policy 0, policy_version 200887 (0.0009) [2023-12-27 20:40:21,696][106226] Updated weights for policy 0, policy_version 200897 (0.0008) [2023-12-27 20:40:21,758][106226] Updated weights for policy 0, policy_version 200907 (0.0009) [2023-12-27 20:40:22,250][106225] Updated weights for policy 1, policy_version 201098 (0.0007) [2023-12-27 20:40:22,315][106225] Updated weights for policy 1, policy_version 201108 (0.0008) [2023-12-27 20:40:22,387][106225] Updated weights for policy 1, policy_version 201118 (0.0009) [2023-12-27 20:40:22,494][106226] Updated weights for policy 0, policy_version 200917 (0.0007) [2023-12-27 20:40:22,557][106226] Updated weights for policy 0, policy_version 200927 (0.0007) [2023-12-27 20:40:22,611][106226] Updated weights for policy 0, policy_version 200937 (0.0007) [2023-12-27 20:40:23,070][106225] Updated weights for policy 1, policy_version 201128 (0.0006) [2023-12-27 20:40:23,127][106225] Updated weights for policy 1, policy_version 201138 (0.0008) [2023-12-27 20:40:23,188][106225] Updated weights for policy 1, policy_version 201148 (0.0010) [2023-12-27 20:40:23,334][106226] Updated weights for policy 0, policy_version 200947 (0.0009) [2023-12-27 20:40:23,395][106226] Updated weights for policy 0, policy_version 200957 (0.0010) [2023-12-27 20:40:23,455][106226] Updated weights for policy 0, policy_version 200967 (0.0010) [2023-12-27 20:40:23,826][106225] Updated weights for policy 1, policy_version 201158 (0.0008) [2023-12-27 20:40:23,876][106225] Updated weights for policy 1, policy_version 201168 (0.0005) [2023-12-27 20:40:23,949][106225] Updated weights for policy 1, policy_version 201178 (0.0006) [2023-12-27 20:40:24,029][106226] Updated weights for policy 0, policy_version 200977 (0.0010) [2023-12-27 20:40:24,089][106226] Updated weights for policy 0, policy_version 200987 (0.0009) [2023-12-27 20:40:24,159][106226] Updated weights for policy 0, policy_version 200997 (0.0007) [2023-12-27 20:40:24,223][106226] Updated weights for policy 0, policy_version 201007 (0.0008) [2023-12-27 20:40:24,571][106225] Updated weights for policy 1, policy_version 201188 (0.0010) [2023-12-27 20:40:24,624][106225] Updated weights for policy 1, policy_version 201198 (0.0009) [2023-12-27 20:40:24,674][106225] Updated weights for policy 1, policy_version 201208 (0.0005) [2023-12-27 20:40:24,920][106226] Updated weights for policy 0, policy_version 201017 (0.0007) [2023-12-27 20:40:24,976][106226] Updated weights for policy 0, policy_version 201027 (0.0006) [2023-12-27 20:40:25,032][106226] Updated weights for policy 0, policy_version 201037 (0.0006) [2023-12-27 20:40:25,285][106225] Updated weights for policy 1, policy_version 201218 (0.0006) [2023-12-27 20:40:25,345][106225] Updated weights for policy 1, policy_version 201228 (0.0010) [2023-12-27 20:40:25,401][106225] Updated weights for policy 1, policy_version 201238 (0.0010) [2023-12-27 20:40:25,457][106225] Updated weights for policy 1, policy_version 201248 (0.0010) [2023-12-27 20:40:25,764][106226] Updated weights for policy 0, policy_version 201047 (0.0007) [2023-12-27 20:40:25,820][106226] Updated weights for policy 0, policy_version 201057 (0.0007) [2023-12-27 20:40:25,877][106226] Updated weights for policy 0, policy_version 201067 (0.0008) [2023-12-27 20:40:26,168][106225] Updated weights for policy 1, policy_version 201258 (0.0006) [2023-12-27 20:40:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 103014400. Throughput: 0: 9925.5, 1: 9928.2. Samples: 102984608. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:26,175][105115] Avg episode reward: [(0, '-5.145'), (1, '-6.280')] [2023-12-27 20:40:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000201072_51486720.pth... [2023-12-27 20:40:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000199936_51191808.pth [2023-12-27 20:40:26,221][106225] Updated weights for policy 1, policy_version 201268 (0.0005) [2023-12-27 20:40:26,281][106225] Updated weights for policy 1, policy_version 201278 (0.0005) [2023-12-27 20:40:26,294][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000201280_51535872.pth... [2023-12-27 20:40:26,299][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000200096_51232768.pth [2023-12-27 20:40:26,626][106226] Updated weights for policy 0, policy_version 201077 (0.0008) [2023-12-27 20:40:26,680][106226] Updated weights for policy 0, policy_version 201087 (0.0008) [2023-12-27 20:40:26,728][106226] Updated weights for policy 0, policy_version 201097 (0.0008) [2023-12-27 20:40:26,940][106225] Updated weights for policy 1, policy_version 201288 (0.0009) [2023-12-27 20:40:27,000][106225] Updated weights for policy 1, policy_version 201298 (0.0010) [2023-12-27 20:40:27,050][106225] Updated weights for policy 1, policy_version 201308 (0.0010) [2023-12-27 20:40:27,445][106226] Updated weights for policy 0, policy_version 201107 (0.0008) [2023-12-27 20:40:27,503][106226] Updated weights for policy 0, policy_version 201117 (0.0010) [2023-12-27 20:40:27,555][106226] Updated weights for policy 0, policy_version 201127 (0.0010) [2023-12-27 20:40:27,769][106225] Updated weights for policy 1, policy_version 201318 (0.0010) [2023-12-27 20:40:27,824][106225] Updated weights for policy 1, policy_version 201328 (0.0010) [2023-12-27 20:40:27,877][106225] Updated weights for policy 1, policy_version 201338 (0.0010) [2023-12-27 20:40:28,222][106226] Updated weights for policy 0, policy_version 201137 (0.0010) [2023-12-27 20:40:28,270][106226] Updated weights for policy 0, policy_version 201147 (0.0008) [2023-12-27 20:40:28,315][106226] Updated weights for policy 0, policy_version 201157 (0.0008) [2023-12-27 20:40:28,377][106226] Updated weights for policy 0, policy_version 201167 (0.0007) [2023-12-27 20:40:28,597][106225] Updated weights for policy 1, policy_version 201348 (0.0009) [2023-12-27 20:40:28,661][106225] Updated weights for policy 1, policy_version 201358 (0.0008) [2023-12-27 20:40:28,717][106225] Updated weights for policy 1, policy_version 201368 (0.0008) [2023-12-27 20:40:29,174][106226] Updated weights for policy 0, policy_version 201177 (0.0009) [2023-12-27 20:40:29,257][106226] Updated weights for policy 0, policy_version 201187 (0.0009) [2023-12-27 20:40:29,292][106225] Updated weights for policy 1, policy_version 201378 (0.0009) [2023-12-27 20:40:29,325][106226] Updated weights for policy 0, policy_version 201197 (0.0007) [2023-12-27 20:40:29,354][106225] Updated weights for policy 1, policy_version 201388 (0.0007) [2023-12-27 20:40:29,422][106225] Updated weights for policy 1, policy_version 201398 (0.0008) [2023-12-27 20:40:29,482][106225] Updated weights for policy 1, policy_version 201408 (0.0007) [2023-12-27 20:40:30,057][106226] Updated weights for policy 0, policy_version 201207 (0.0006) [2023-12-27 20:40:30,123][106226] Updated weights for policy 0, policy_version 201217 (0.0006) [2023-12-27 20:40:30,185][106226] Updated weights for policy 0, policy_version 201227 (0.0008) [2023-12-27 20:40:30,211][106225] Updated weights for policy 1, policy_version 201418 (0.0006) [2023-12-27 20:40:30,280][106225] Updated weights for policy 1, policy_version 201428 (0.0008) [2023-12-27 20:40:30,337][106225] Updated weights for policy 1, policy_version 201438 (0.0009) [2023-12-27 20:40:30,899][106226] Updated weights for policy 0, policy_version 201237 (0.0006) [2023-12-27 20:40:30,922][106225] Updated weights for policy 1, policy_version 201448 (0.0007) [2023-12-27 20:40:30,959][106226] Updated weights for policy 0, policy_version 201247 (0.0009) [2023-12-27 20:40:30,982][106225] Updated weights for policy 1, policy_version 201458 (0.0008) [2023-12-27 20:40:31,020][106226] Updated weights for policy 0, policy_version 201257 (0.0009) [2023-12-27 20:40:31,047][106225] Updated weights for policy 1, policy_version 201468 (0.0007) [2023-12-27 20:40:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 103120896. Throughput: 0: 9930.4, 1: 10023.5. Samples: 103104452. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:31,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.926')] [2023-12-27 20:40:31,797][106226] Updated weights for policy 0, policy_version 201267 (0.0008) [2023-12-27 20:40:31,814][106225] Updated weights for policy 1, policy_version 201478 (0.0009) [2023-12-27 20:40:31,855][106226] Updated weights for policy 0, policy_version 201277 (0.0006) [2023-12-27 20:40:31,877][106225] Updated weights for policy 1, policy_version 201488 (0.0005) [2023-12-27 20:40:31,913][106226] Updated weights for policy 0, policy_version 201287 (0.0007) [2023-12-27 20:40:31,940][106225] Updated weights for policy 1, policy_version 201498 (0.0007) [2023-12-27 20:40:32,490][106226] Updated weights for policy 0, policy_version 201297 (0.0007) [2023-12-27 20:40:32,553][106226] Updated weights for policy 0, policy_version 201307 (0.0007) [2023-12-27 20:40:32,612][106226] Updated weights for policy 0, policy_version 201317 (0.0006) [2023-12-27 20:40:32,658][106225] Updated weights for policy 1, policy_version 201508 (0.0006) [2023-12-27 20:40:32,672][106226] Updated weights for policy 0, policy_version 201327 (0.0007) [2023-12-27 20:40:32,713][106225] Updated weights for policy 1, policy_version 201518 (0.0007) [2023-12-27 20:40:32,759][106225] Updated weights for policy 1, policy_version 201528 (0.0008) [2023-12-27 20:40:33,261][106226] Updated weights for policy 0, policy_version 201337 (0.0006) [2023-12-27 20:40:33,317][106226] Updated weights for policy 0, policy_version 201347 (0.0005) [2023-12-27 20:40:33,378][106226] Updated weights for policy 0, policy_version 201357 (0.0005) [2023-12-27 20:40:33,468][106225] Updated weights for policy 1, policy_version 201538 (0.0009) [2023-12-27 20:40:33,528][106225] Updated weights for policy 1, policy_version 201548 (0.0008) [2023-12-27 20:40:33,585][106225] Updated weights for policy 1, policy_version 201558 (0.0008) [2023-12-27 20:40:33,646][106225] Updated weights for policy 1, policy_version 201568 (0.0008) [2023-12-27 20:40:34,059][106226] Updated weights for policy 0, policy_version 201367 (0.0008) [2023-12-27 20:40:34,111][106226] Updated weights for policy 0, policy_version 201377 (0.0008) [2023-12-27 20:40:34,171][106226] Updated weights for policy 0, policy_version 201387 (0.0009) [2023-12-27 20:40:34,308][106225] Updated weights for policy 1, policy_version 201578 (0.0008) [2023-12-27 20:40:34,367][106225] Updated weights for policy 1, policy_version 201588 (0.0008) [2023-12-27 20:40:34,425][106225] Updated weights for policy 1, policy_version 201598 (0.0008) [2023-12-27 20:40:34,899][106226] Updated weights for policy 0, policy_version 201397 (0.0007) [2023-12-27 20:40:34,945][106226] Updated weights for policy 0, policy_version 201407 (0.0009) [2023-12-27 20:40:34,994][106226] Updated weights for policy 0, policy_version 201417 (0.0008) [2023-12-27 20:40:35,155][106225] Updated weights for policy 1, policy_version 201608 (0.0008) [2023-12-27 20:40:35,214][106225] Updated weights for policy 1, policy_version 201618 (0.0008) [2023-12-27 20:40:35,275][106225] Updated weights for policy 1, policy_version 201628 (0.0008) [2023-12-27 20:40:35,752][106226] Updated weights for policy 0, policy_version 201427 (0.0009) [2023-12-27 20:40:35,803][106226] Updated weights for policy 0, policy_version 201437 (0.0009) [2023-12-27 20:40:35,852][106226] Updated weights for policy 0, policy_version 201447 (0.0008) [2023-12-27 20:40:35,924][106225] Updated weights for policy 1, policy_version 201638 (0.0008) [2023-12-27 20:40:35,973][106225] Updated weights for policy 1, policy_version 201648 (0.0009) [2023-12-27 20:40:36,030][106225] Updated weights for policy 1, policy_version 201658 (0.0007) [2023-12-27 20:40:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 103219200. Throughput: 0: 10004.4, 1: 9959.6. Samples: 103223132. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:36,175][105115] Avg episode reward: [(0, '-5.060'), (1, '-5.658')] [2023-12-27 20:40:36,176][106141] Saving new best policy, reward=-5.658! [2023-12-27 20:40:36,605][106226] Updated weights for policy 0, policy_version 201457 (0.0008) [2023-12-27 20:40:36,673][106226] Updated weights for policy 0, policy_version 201467 (0.0009) [2023-12-27 20:40:36,732][106226] Updated weights for policy 0, policy_version 201477 (0.0008) [2023-12-27 20:40:36,771][106225] Updated weights for policy 1, policy_version 201668 (0.0007) [2023-12-27 20:40:36,791][106226] Updated weights for policy 0, policy_version 201487 (0.0009) [2023-12-27 20:40:36,816][106225] Updated weights for policy 1, policy_version 201678 (0.0009) [2023-12-27 20:40:36,863][106225] Updated weights for policy 1, policy_version 201688 (0.0008) [2023-12-27 20:40:37,576][106226] Updated weights for policy 0, policy_version 201497 (0.0008) [2023-12-27 20:40:37,579][106225] Updated weights for policy 1, policy_version 201698 (0.0008) [2023-12-27 20:40:37,638][106225] Updated weights for policy 1, policy_version 201708 (0.0006) [2023-12-27 20:40:37,640][106226] Updated weights for policy 0, policy_version 201507 (0.0008) [2023-12-27 20:40:37,697][106225] Updated weights for policy 1, policy_version 201718 (0.0006) [2023-12-27 20:40:37,703][106226] Updated weights for policy 0, policy_version 201517 (0.0007) [2023-12-27 20:40:37,763][106225] Updated weights for policy 1, policy_version 201728 (0.0008) [2023-12-27 20:40:38,455][106225] Updated weights for policy 1, policy_version 201738 (0.0007) [2023-12-27 20:40:38,473][106226] Updated weights for policy 0, policy_version 201527 (0.0007) [2023-12-27 20:40:38,523][106225] Updated weights for policy 1, policy_version 201748 (0.0006) [2023-12-27 20:40:38,529][106226] Updated weights for policy 0, policy_version 201537 (0.0007) [2023-12-27 20:40:38,587][106225] Updated weights for policy 1, policy_version 201758 (0.0008) [2023-12-27 20:40:38,589][106226] Updated weights for policy 0, policy_version 201547 (0.0006) [2023-12-27 20:40:39,308][106226] Updated weights for policy 0, policy_version 201557 (0.0008) [2023-12-27 20:40:39,356][106225] Updated weights for policy 1, policy_version 201768 (0.0007) [2023-12-27 20:40:39,376][106226] Updated weights for policy 0, policy_version 201567 (0.0007) [2023-12-27 20:40:39,427][106225] Updated weights for policy 1, policy_version 201778 (0.0008) [2023-12-27 20:40:39,441][106226] Updated weights for policy 0, policy_version 201577 (0.0008) [2023-12-27 20:40:39,489][106225] Updated weights for policy 1, policy_version 201788 (0.0008) [2023-12-27 20:40:40,088][106226] Updated weights for policy 0, policy_version 201587 (0.0006) [2023-12-27 20:40:40,149][106226] Updated weights for policy 0, policy_version 201597 (0.0006) [2023-12-27 20:40:40,218][106226] Updated weights for policy 0, policy_version 201607 (0.0007) [2023-12-27 20:40:40,302][106225] Updated weights for policy 1, policy_version 201798 (0.0010) [2023-12-27 20:40:40,366][106225] Updated weights for policy 1, policy_version 201808 (0.0009) [2023-12-27 20:40:40,440][106225] Updated weights for policy 1, policy_version 201818 (0.0010) [2023-12-27 20:40:40,824][106226] Updated weights for policy 0, policy_version 201617 (0.0007) [2023-12-27 20:40:40,870][106226] Updated weights for policy 0, policy_version 201627 (0.0008) [2023-12-27 20:40:40,927][106226] Updated weights for policy 0, policy_version 201637 (0.0008) [2023-12-27 20:40:40,977][106226] Updated weights for policy 0, policy_version 201647 (0.0008) [2023-12-27 20:40:41,081][106225] Updated weights for policy 1, policy_version 201828 (0.0008) [2023-12-27 20:40:41,162][106225] Updated weights for policy 1, policy_version 201838 (0.0010) [2023-12-27 20:40:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 103309312. Throughput: 0: 9927.6, 1: 9966.5. Samples: 103280444. Policy #0 lag: (min: 21.0, avg: 29.1, max: 53.0) [2023-12-27 20:40:41,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-6.133')] [2023-12-27 20:40:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000201648_51634176.pth... [2023-12-27 20:40:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000200512_51339264.pth [2023-12-27 20:40:41,228][106225] Updated weights for policy 1, policy_version 201848 (0.0010) [2023-12-27 20:40:41,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000201856_51683328.pth... [2023-12-27 20:40:41,284][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000200672_51380224.pth [2023-12-27 20:40:41,805][106226] Updated weights for policy 0, policy_version 201657 (0.0008) [2023-12-27 20:40:41,871][106226] Updated weights for policy 0, policy_version 201667 (0.0008) [2023-12-27 20:40:41,930][106226] Updated weights for policy 0, policy_version 201677 (0.0008) [2023-12-27 20:40:41,961][106225] Updated weights for policy 1, policy_version 201858 (0.0010) [2023-12-27 20:40:42,026][106225] Updated weights for policy 1, policy_version 201868 (0.0008) [2023-12-27 20:40:42,087][106225] Updated weights for policy 1, policy_version 201878 (0.0007) [2023-12-27 20:40:42,144][106225] Updated weights for policy 1, policy_version 201888 (0.0008) [2023-12-27 20:40:42,692][106226] Updated weights for policy 0, policy_version 201687 (0.0009) [2023-12-27 20:40:42,754][106226] Updated weights for policy 0, policy_version 201697 (0.0008) [2023-12-27 20:40:42,813][106226] Updated weights for policy 0, policy_version 201707 (0.0009) [2023-12-27 20:40:42,928][106225] Updated weights for policy 1, policy_version 201898 (0.0008) [2023-12-27 20:40:42,994][106225] Updated weights for policy 1, policy_version 201908 (0.0009) [2023-12-27 20:40:43,050][106225] Updated weights for policy 1, policy_version 201918 (0.0009) [2023-12-27 20:40:43,480][106226] Updated weights for policy 0, policy_version 201717 (0.0007) [2023-12-27 20:40:43,530][106226] Updated weights for policy 0, policy_version 201727 (0.0005) [2023-12-27 20:40:43,578][106226] Updated weights for policy 0, policy_version 201737 (0.0008) [2023-12-27 20:40:43,798][106225] Updated weights for policy 1, policy_version 201928 (0.0009) [2023-12-27 20:40:43,866][106225] Updated weights for policy 1, policy_version 201938 (0.0009) [2023-12-27 20:40:43,920][106225] Updated weights for policy 1, policy_version 201948 (0.0009) [2023-12-27 20:40:44,176][106226] Updated weights for policy 0, policy_version 201747 (0.0008) [2023-12-27 20:40:44,231][106226] Updated weights for policy 0, policy_version 201757 (0.0006) [2023-12-27 20:40:44,291][106226] Updated weights for policy 0, policy_version 201767 (0.0006) [2023-12-27 20:40:44,615][106225] Updated weights for policy 1, policy_version 201958 (0.0008) [2023-12-27 20:40:44,680][106225] Updated weights for policy 1, policy_version 201968 (0.0008) [2023-12-27 20:40:44,745][106225] Updated weights for policy 1, policy_version 201978 (0.0008) [2023-12-27 20:40:44,863][106226] Updated weights for policy 0, policy_version 201777 (0.0008) [2023-12-27 20:40:44,927][106226] Updated weights for policy 0, policy_version 201787 (0.0009) [2023-12-27 20:40:44,992][106226] Updated weights for policy 0, policy_version 201797 (0.0007) [2023-12-27 20:40:45,063][106226] Updated weights for policy 0, policy_version 201807 (0.0009) [2023-12-27 20:40:45,453][106225] Updated weights for policy 1, policy_version 201988 (0.0009) [2023-12-27 20:40:45,510][106225] Updated weights for policy 1, policy_version 201998 (0.0010) [2023-12-27 20:40:45,566][106225] Updated weights for policy 1, policy_version 202008 (0.0010) [2023-12-27 20:40:45,674][106226] Updated weights for policy 0, policy_version 201817 (0.0005) [2023-12-27 20:40:45,740][106226] Updated weights for policy 0, policy_version 201827 (0.0005) [2023-12-27 20:40:45,810][106226] Updated weights for policy 0, policy_version 201837 (0.0005) [2023-12-27 20:40:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 103407616. Throughput: 0: 9904.5, 1: 9906.6. Samples: 103397916. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:40:46,175][105115] Avg episode reward: [(0, '-5.371'), (1, '-5.918')] [2023-12-27 20:40:46,254][106225] Updated weights for policy 1, policy_version 202018 (0.0010) [2023-12-27 20:40:46,306][106225] Updated weights for policy 1, policy_version 202028 (0.0007) [2023-12-27 20:40:46,358][106225] Updated weights for policy 1, policy_version 202038 (0.0007) [2023-12-27 20:40:46,411][106225] Updated weights for policy 1, policy_version 202048 (0.0010) [2023-12-27 20:40:46,439][106226] Updated weights for policy 0, policy_version 201847 (0.0007) [2023-12-27 20:40:46,491][106226] Updated weights for policy 0, policy_version 201857 (0.0005) [2023-12-27 20:40:46,545][106226] Updated weights for policy 0, policy_version 201867 (0.0005) [2023-12-27 20:40:47,098][106225] Updated weights for policy 1, policy_version 202058 (0.0005) [2023-12-27 20:40:47,153][106225] Updated weights for policy 1, policy_version 202068 (0.0007) [2023-12-27 20:40:47,157][106226] Updated weights for policy 0, policy_version 201877 (0.0005) [2023-12-27 20:40:47,209][106225] Updated weights for policy 1, policy_version 202078 (0.0010) [2023-12-27 20:40:47,226][106226] Updated weights for policy 0, policy_version 201887 (0.0005) [2023-12-27 20:40:47,283][106226] Updated weights for policy 0, policy_version 201897 (0.0008) [2023-12-27 20:40:47,843][106225] Updated weights for policy 1, policy_version 202088 (0.0008) [2023-12-27 20:40:47,903][106225] Updated weights for policy 1, policy_version 202098 (0.0007) [2023-12-27 20:40:47,967][106225] Updated weights for policy 1, policy_version 202108 (0.0010) [2023-12-27 20:40:47,993][106226] Updated weights for policy 0, policy_version 201907 (0.0008) [2023-12-27 20:40:48,044][106226] Updated weights for policy 0, policy_version 201917 (0.0008) [2023-12-27 20:40:48,095][106226] Updated weights for policy 0, policy_version 201927 (0.0008) [2023-12-27 20:40:48,683][106225] Updated weights for policy 1, policy_version 202118 (0.0010) [2023-12-27 20:40:48,730][106225] Updated weights for policy 1, policy_version 202128 (0.0010) [2023-12-27 20:40:48,781][106225] Updated weights for policy 1, policy_version 202138 (0.0010) [2023-12-27 20:40:48,848][106226] Updated weights for policy 0, policy_version 201937 (0.0008) [2023-12-27 20:40:48,912][106226] Updated weights for policy 0, policy_version 201947 (0.0007) [2023-12-27 20:40:48,970][106226] Updated weights for policy 0, policy_version 201957 (0.0007) [2023-12-27 20:40:49,035][106226] Updated weights for policy 0, policy_version 201967 (0.0007) [2023-12-27 20:40:49,480][106225] Updated weights for policy 1, policy_version 202148 (0.0010) [2023-12-27 20:40:49,536][106225] Updated weights for policy 1, policy_version 202158 (0.0006) [2023-12-27 20:40:49,594][106225] Updated weights for policy 1, policy_version 202168 (0.0005) [2023-12-27 20:40:49,709][106226] Updated weights for policy 0, policy_version 201977 (0.0010) [2023-12-27 20:40:49,763][106226] Updated weights for policy 0, policy_version 201987 (0.0010) [2023-12-27 20:40:49,829][106226] Updated weights for policy 0, policy_version 201997 (0.0011) [2023-12-27 20:40:50,259][106225] Updated weights for policy 1, policy_version 202178 (0.0007) [2023-12-27 20:40:50,312][106225] Updated weights for policy 1, policy_version 202188 (0.0009) [2023-12-27 20:40:50,371][106225] Updated weights for policy 1, policy_version 202198 (0.0008) [2023-12-27 20:40:50,430][106225] Updated weights for policy 1, policy_version 202208 (0.0008) [2023-12-27 20:40:50,609][106226] Updated weights for policy 0, policy_version 202007 (0.0008) [2023-12-27 20:40:50,677][106226] Updated weights for policy 0, policy_version 202017 (0.0009) [2023-12-27 20:40:50,732][106226] Updated weights for policy 0, policy_version 202027 (0.0010) [2023-12-27 20:40:51,170][106225] Updated weights for policy 1, policy_version 202218 (0.0008) [2023-12-27 20:40:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 103505920. Throughput: 0: 9904.0, 1: 9853.3. Samples: 103518412. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:40:51,175][105115] Avg episode reward: [(0, '-5.125'), (1, '-5.940')] [2023-12-27 20:40:51,218][106225] Updated weights for policy 1, policy_version 202228 (0.0008) [2023-12-27 20:40:51,270][106225] Updated weights for policy 1, policy_version 202238 (0.0006) [2023-12-27 20:40:51,429][106226] Updated weights for policy 0, policy_version 202037 (0.0008) [2023-12-27 20:40:51,485][106226] Updated weights for policy 0, policy_version 202047 (0.0008) [2023-12-27 20:40:51,555][106226] Updated weights for policy 0, policy_version 202057 (0.0010) [2023-12-27 20:40:52,037][106225] Updated weights for policy 1, policy_version 202248 (0.0008) [2023-12-27 20:40:52,091][106225] Updated weights for policy 1, policy_version 202258 (0.0008) [2023-12-27 20:40:52,135][106225] Updated weights for policy 1, policy_version 202268 (0.0008) [2023-12-27 20:40:52,264][106226] Updated weights for policy 0, policy_version 202067 (0.0008) [2023-12-27 20:40:52,327][106226] Updated weights for policy 0, policy_version 202077 (0.0010) [2023-12-27 20:40:52,399][106226] Updated weights for policy 0, policy_version 202087 (0.0010) [2023-12-27 20:40:52,895][106225] Updated weights for policy 1, policy_version 202278 (0.0010) [2023-12-27 20:40:52,958][106225] Updated weights for policy 1, policy_version 202288 (0.0010) [2023-12-27 20:40:53,021][106225] Updated weights for policy 1, policy_version 202298 (0.0010) [2023-12-27 20:40:53,079][106226] Updated weights for policy 0, policy_version 202097 (0.0010) [2023-12-27 20:40:53,139][106226] Updated weights for policy 0, policy_version 202107 (0.0006) [2023-12-27 20:40:53,200][106226] Updated weights for policy 0, policy_version 202117 (0.0005) [2023-12-27 20:40:53,257][106226] Updated weights for policy 0, policy_version 202127 (0.0005) [2023-12-27 20:40:53,717][106225] Updated weights for policy 1, policy_version 202308 (0.0010) [2023-12-27 20:40:53,777][106225] Updated weights for policy 1, policy_version 202318 (0.0006) [2023-12-27 20:40:53,845][106225] Updated weights for policy 1, policy_version 202328 (0.0005) [2023-12-27 20:40:53,902][106226] Updated weights for policy 0, policy_version 202137 (0.0010) [2023-12-27 20:40:53,951][106226] Updated weights for policy 0, policy_version 202147 (0.0010) [2023-12-27 20:40:54,001][106226] Updated weights for policy 0, policy_version 202157 (0.0010) [2023-12-27 20:40:54,508][106225] Updated weights for policy 1, policy_version 202338 (0.0006) [2023-12-27 20:40:54,558][106225] Updated weights for policy 1, policy_version 202348 (0.0007) [2023-12-27 20:40:54,613][106225] Updated weights for policy 1, policy_version 202358 (0.0010) [2023-12-27 20:40:54,637][106226] Updated weights for policy 0, policy_version 202167 (0.0009) [2023-12-27 20:40:54,675][106225] Updated weights for policy 1, policy_version 202368 (0.0007) [2023-12-27 20:40:54,687][106226] Updated weights for policy 0, policy_version 202177 (0.0008) [2023-12-27 20:40:54,747][106226] Updated weights for policy 0, policy_version 202187 (0.0005) [2023-12-27 20:40:55,266][106225] Updated weights for policy 1, policy_version 202378 (0.0010) [2023-12-27 20:40:55,316][106225] Updated weights for policy 1, policy_version 202388 (0.0010) [2023-12-27 20:40:55,363][106225] Updated weights for policy 1, policy_version 202398 (0.0010) [2023-12-27 20:40:55,400][106226] Updated weights for policy 0, policy_version 202197 (0.0006) [2023-12-27 20:40:55,460][106226] Updated weights for policy 0, policy_version 202207 (0.0008) [2023-12-27 20:40:55,516][106226] Updated weights for policy 0, policy_version 202217 (0.0008) [2023-12-27 20:40:56,069][106225] Updated weights for policy 1, policy_version 202408 (0.0010) [2023-12-27 20:40:56,126][106225] Updated weights for policy 1, policy_version 202418 (0.0010) [2023-12-27 20:40:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 103604224. Throughput: 0: 9900.2, 1: 9815.1. Samples: 103576428. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:40:56,175][105115] Avg episode reward: [(0, '-5.265'), (1, '-6.421')] [2023-12-27 20:40:56,176][106225] Updated weights for policy 1, policy_version 202428 (0.0010) [2023-12-27 20:40:56,179][106226] Updated weights for policy 0, policy_version 202227 (0.0007) [2023-12-27 20:40:56,192][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000202432_51830784.pth... [2023-12-27 20:40:56,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000201280_51535872.pth [2023-12-27 20:40:56,240][106226] Updated weights for policy 0, policy_version 202237 (0.0005) [2023-12-27 20:40:56,295][106226] Updated weights for policy 0, policy_version 202247 (0.0005) [2023-12-27 20:40:56,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000202256_51789824.pth... [2023-12-27 20:40:56,350][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000201072_51486720.pth [2023-12-27 20:40:56,806][106225] Updated weights for policy 1, policy_version 202438 (0.0010) [2023-12-27 20:40:56,834][106226] Updated weights for policy 0, policy_version 202257 (0.0006) [2023-12-27 20:40:56,858][106225] Updated weights for policy 1, policy_version 202448 (0.0010) [2023-12-27 20:40:56,885][106226] Updated weights for policy 0, policy_version 202267 (0.0010) [2023-12-27 20:40:56,914][106225] Updated weights for policy 1, policy_version 202458 (0.0010) [2023-12-27 20:40:56,942][106226] Updated weights for policy 0, policy_version 202277 (0.0009) [2023-12-27 20:40:57,001][106226] Updated weights for policy 0, policy_version 202287 (0.0005) [2023-12-27 20:40:57,602][106226] Updated weights for policy 0, policy_version 202297 (0.0005) [2023-12-27 20:40:57,642][106225] Updated weights for policy 1, policy_version 202468 (0.0010) [2023-12-27 20:40:57,657][106226] Updated weights for policy 0, policy_version 202307 (0.0005) [2023-12-27 20:40:57,688][106225] Updated weights for policy 1, policy_version 202478 (0.0010) [2023-12-27 20:40:57,720][106226] Updated weights for policy 0, policy_version 202317 (0.0005) [2023-12-27 20:40:57,747][106225] Updated weights for policy 1, policy_version 202488 (0.0010) [2023-12-27 20:40:58,278][106226] Updated weights for policy 0, policy_version 202327 (0.0005) [2023-12-27 20:40:58,343][106226] Updated weights for policy 0, policy_version 202337 (0.0007) [2023-12-27 20:40:58,409][106226] Updated weights for policy 0, policy_version 202347 (0.0008) [2023-12-27 20:40:58,543][106225] Updated weights for policy 1, policy_version 202498 (0.0010) [2023-12-27 20:40:58,607][106225] Updated weights for policy 1, policy_version 202508 (0.0007) [2023-12-27 20:40:58,665][106225] Updated weights for policy 1, policy_version 202518 (0.0008) [2023-12-27 20:40:58,730][106225] Updated weights for policy 1, policy_version 202528 (0.0008) [2023-12-27 20:40:59,256][106226] Updated weights for policy 0, policy_version 202357 (0.0008) [2023-12-27 20:40:59,314][106226] Updated weights for policy 0, policy_version 202367 (0.0009) [2023-12-27 20:40:59,382][106226] Updated weights for policy 0, policy_version 202377 (0.0011) [2023-12-27 20:40:59,431][106225] Updated weights for policy 1, policy_version 202538 (0.0010) [2023-12-27 20:40:59,480][106225] Updated weights for policy 1, policy_version 202548 (0.0009) [2023-12-27 20:40:59,535][106225] Updated weights for policy 1, policy_version 202558 (0.0007) [2023-12-27 20:41:00,049][106226] Updated weights for policy 0, policy_version 202387 (0.0009) [2023-12-27 20:41:00,099][106226] Updated weights for policy 0, policy_version 202397 (0.0005) [2023-12-27 20:41:00,157][106226] Updated weights for policy 0, policy_version 202407 (0.0006) [2023-12-27 20:41:00,209][106225] Updated weights for policy 1, policy_version 202568 (0.0008) [2023-12-27 20:41:00,271][106225] Updated weights for policy 1, policy_version 202578 (0.0005) [2023-12-27 20:41:00,330][106225] Updated weights for policy 1, policy_version 202588 (0.0005) [2023-12-27 20:41:00,772][106226] Updated weights for policy 0, policy_version 202417 (0.0010) [2023-12-27 20:41:00,838][106226] Updated weights for policy 0, policy_version 202427 (0.0006) [2023-12-27 20:41:00,899][106226] Updated weights for policy 0, policy_version 202437 (0.0008) [2023-12-27 20:41:00,954][106225] Updated weights for policy 1, policy_version 202598 (0.0006) [2023-12-27 20:41:00,967][106226] Updated weights for policy 0, policy_version 202447 (0.0011) [2023-12-27 20:41:01,017][106225] Updated weights for policy 1, policy_version 202608 (0.0006) [2023-12-27 20:41:01,082][106225] Updated weights for policy 1, policy_version 202618 (0.0008) [2023-12-27 20:41:01,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 103718912. Throughput: 0: 9993.6, 1: 9882.2. Samples: 103700440. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:01,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-6.252')] [2023-12-27 20:41:01,700][106226] Updated weights for policy 0, policy_version 202457 (0.0009) [2023-12-27 20:41:01,763][106226] Updated weights for policy 0, policy_version 202467 (0.0008) [2023-12-27 20:41:01,819][106226] Updated weights for policy 0, policy_version 202477 (0.0009) [2023-12-27 20:41:01,833][106225] Updated weights for policy 1, policy_version 202628 (0.0006) [2023-12-27 20:41:01,887][106225] Updated weights for policy 1, policy_version 202638 (0.0008) [2023-12-27 20:41:01,939][106225] Updated weights for policy 1, policy_version 202648 (0.0008) [2023-12-27 20:41:02,557][106226] Updated weights for policy 0, policy_version 202487 (0.0008) [2023-12-27 20:41:02,567][106225] Updated weights for policy 1, policy_version 202658 (0.0009) [2023-12-27 20:41:02,612][106226] Updated weights for policy 0, policy_version 202497 (0.0008) [2023-12-27 20:41:02,615][106225] Updated weights for policy 1, policy_version 202668 (0.0005) [2023-12-27 20:41:02,667][106226] Updated weights for policy 0, policy_version 202507 (0.0008) [2023-12-27 20:41:02,673][106225] Updated weights for policy 1, policy_version 202678 (0.0006) [2023-12-27 20:41:02,730][106225] Updated weights for policy 1, policy_version 202688 (0.0007) [2023-12-27 20:41:03,361][106225] Updated weights for policy 1, policy_version 202698 (0.0006) [2023-12-27 20:41:03,411][106225] Updated weights for policy 1, policy_version 202708 (0.0006) [2023-12-27 20:41:03,454][106226] Updated weights for policy 0, policy_version 202517 (0.0008) [2023-12-27 20:41:03,465][106225] Updated weights for policy 1, policy_version 202718 (0.0010) [2023-12-27 20:41:03,504][106226] Updated weights for policy 0, policy_version 202527 (0.0008) [2023-12-27 20:41:03,558][106226] Updated weights for policy 0, policy_version 202537 (0.0008) [2023-12-27 20:41:04,176][106225] Updated weights for policy 1, policy_version 202728 (0.0010) [2023-12-27 20:41:04,244][106225] Updated weights for policy 1, policy_version 202738 (0.0010) [2023-12-27 20:41:04,269][106226] Updated weights for policy 0, policy_version 202547 (0.0008) [2023-12-27 20:41:04,310][106225] Updated weights for policy 1, policy_version 202748 (0.0011) [2023-12-27 20:41:04,337][106226] Updated weights for policy 0, policy_version 202557 (0.0008) [2023-12-27 20:41:04,402][106226] Updated weights for policy 0, policy_version 202567 (0.0009) [2023-12-27 20:41:04,945][106225] Updated weights for policy 1, policy_version 202758 (0.0007) [2023-12-27 20:41:05,011][106225] Updated weights for policy 1, policy_version 202768 (0.0005) [2023-12-27 20:41:05,066][106225] Updated weights for policy 1, policy_version 202778 (0.0008) [2023-12-27 20:41:05,183][106226] Updated weights for policy 0, policy_version 202577 (0.0008) [2023-12-27 20:41:05,235][106226] Updated weights for policy 0, policy_version 202587 (0.0007) [2023-12-27 20:41:05,285][106226] Updated weights for policy 0, policy_version 202597 (0.0008) [2023-12-27 20:41:05,331][106226] Updated weights for policy 0, policy_version 202607 (0.0008) [2023-12-27 20:41:05,721][106225] Updated weights for policy 1, policy_version 202788 (0.0010) [2023-12-27 20:41:05,771][106225] Updated weights for policy 1, policy_version 202798 (0.0010) [2023-12-27 20:41:05,823][106225] Updated weights for policy 1, policy_version 202808 (0.0010) [2023-12-27 20:41:06,073][106226] Updated weights for policy 0, policy_version 202617 (0.0008) [2023-12-27 20:41:06,129][106226] Updated weights for policy 0, policy_version 202627 (0.0008) [2023-12-27 20:41:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 103809024. Throughput: 0: 9935.5, 1: 9943.5. Samples: 103819996. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:06,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.779')] [2023-12-27 20:41:06,185][106226] Updated weights for policy 0, policy_version 202637 (0.0010) [2023-12-27 20:41:06,545][106225] Updated weights for policy 1, policy_version 202818 (0.0009) [2023-12-27 20:41:06,610][106225] Updated weights for policy 1, policy_version 202828 (0.0007) [2023-12-27 20:41:06,673][106225] Updated weights for policy 1, policy_version 202838 (0.0008) [2023-12-27 20:41:06,737][106225] Updated weights for policy 1, policy_version 202848 (0.0009) [2023-12-27 20:41:06,991][106226] Updated weights for policy 0, policy_version 202647 (0.0008) [2023-12-27 20:41:07,055][106226] Updated weights for policy 0, policy_version 202657 (0.0009) [2023-12-27 20:41:07,118][106226] Updated weights for policy 0, policy_version 202667 (0.0010) [2023-12-27 20:41:07,404][106225] Updated weights for policy 1, policy_version 202858 (0.0007) [2023-12-27 20:41:07,471][106225] Updated weights for policy 1, policy_version 202868 (0.0012) [2023-12-27 20:41:07,535][106225] Updated weights for policy 1, policy_version 202878 (0.0008) [2023-12-27 20:41:07,888][106226] Updated weights for policy 0, policy_version 202677 (0.0009) [2023-12-27 20:41:07,943][106226] Updated weights for policy 0, policy_version 202687 (0.0010) [2023-12-27 20:41:07,994][106226] Updated weights for policy 0, policy_version 202697 (0.0011) [2023-12-27 20:41:08,200][106225] Updated weights for policy 1, policy_version 202888 (0.0009) [2023-12-27 20:41:08,249][106225] Updated weights for policy 1, policy_version 202898 (0.0008) [2023-12-27 20:41:08,305][106225] Updated weights for policy 1, policy_version 202908 (0.0008) [2023-12-27 20:41:08,732][106226] Updated weights for policy 0, policy_version 202707 (0.0010) [2023-12-27 20:41:08,797][106226] Updated weights for policy 0, policy_version 202717 (0.0009) [2023-12-27 20:41:08,862][106226] Updated weights for policy 0, policy_version 202727 (0.0009) [2023-12-27 20:41:09,074][106225] Updated weights for policy 1, policy_version 202918 (0.0008) [2023-12-27 20:41:09,136][106225] Updated weights for policy 1, policy_version 202928 (0.0008) [2023-12-27 20:41:09,191][106225] Updated weights for policy 1, policy_version 202938 (0.0008) [2023-12-27 20:41:09,664][106226] Updated weights for policy 0, policy_version 202737 (0.0009) [2023-12-27 20:41:09,717][106226] Updated weights for policy 0, policy_version 202747 (0.0007) [2023-12-27 20:41:09,781][106226] Updated weights for policy 0, policy_version 202757 (0.0008) [2023-12-27 20:41:09,852][106226] Updated weights for policy 0, policy_version 202767 (0.0011) [2023-12-27 20:41:09,989][106225] Updated weights for policy 1, policy_version 202948 (0.0008) [2023-12-27 20:41:10,050][106225] Updated weights for policy 1, policy_version 202958 (0.0007) [2023-12-27 20:41:10,115][106225] Updated weights for policy 1, policy_version 202968 (0.0008) [2023-12-27 20:41:10,532][106226] Updated weights for policy 0, policy_version 202777 (0.0010) [2023-12-27 20:41:10,586][106226] Updated weights for policy 0, policy_version 202787 (0.0010) [2023-12-27 20:41:10,636][106226] Updated weights for policy 0, policy_version 202797 (0.0010) [2023-12-27 20:41:10,791][106225] Updated weights for policy 1, policy_version 202978 (0.0007) [2023-12-27 20:41:10,853][106225] Updated weights for policy 1, policy_version 202988 (0.0009) [2023-12-27 20:41:10,914][106225] Updated weights for policy 1, policy_version 202998 (0.0009) [2023-12-27 20:41:10,972][106225] Updated weights for policy 1, policy_version 203008 (0.0008) [2023-12-27 20:41:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 103907328. Throughput: 0: 9882.9, 1: 9945.2. Samples: 103876876. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:11,175][105115] Avg episode reward: [(0, '-5.332'), (1, '-6.063')] [2023-12-27 20:41:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000203008_51978240.pth... [2023-12-27 20:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000202800_51929088.pth... [2023-12-27 20:41:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000201648_51634176.pth [2023-12-27 20:41:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000201856_51683328.pth [2023-12-27 20:41:11,338][106226] Updated weights for policy 0, policy_version 202807 (0.0009) [2023-12-27 20:41:11,401][106226] Updated weights for policy 0, policy_version 202817 (0.0007) [2023-12-27 20:41:11,462][106226] Updated weights for policy 0, policy_version 202827 (0.0008) [2023-12-27 20:41:11,715][106225] Updated weights for policy 1, policy_version 203018 (0.0008) [2023-12-27 20:41:11,781][106225] Updated weights for policy 1, policy_version 203028 (0.0007) [2023-12-27 20:41:11,847][106225] Updated weights for policy 1, policy_version 203038 (0.0010) [2023-12-27 20:41:12,233][106226] Updated weights for policy 0, policy_version 202837 (0.0007) [2023-12-27 20:41:12,296][106226] Updated weights for policy 0, policy_version 202847 (0.0008) [2023-12-27 20:41:12,369][106226] Updated weights for policy 0, policy_version 202857 (0.0008) [2023-12-27 20:41:12,655][106225] Updated weights for policy 1, policy_version 203048 (0.0008) [2023-12-27 20:41:12,720][106225] Updated weights for policy 1, policy_version 203058 (0.0007) [2023-12-27 20:41:12,792][106225] Updated weights for policy 1, policy_version 203068 (0.0009) [2023-12-27 20:41:13,043][106226] Updated weights for policy 0, policy_version 202867 (0.0009) [2023-12-27 20:41:13,093][106226] Updated weights for policy 0, policy_version 202877 (0.0010) [2023-12-27 20:41:13,149][106226] Updated weights for policy 0, policy_version 202887 (0.0009) [2023-12-27 20:41:13,448][106225] Updated weights for policy 1, policy_version 203078 (0.0009) [2023-12-27 20:41:13,510][106225] Updated weights for policy 1, policy_version 203088 (0.0010) [2023-12-27 20:41:13,564][106225] Updated weights for policy 1, policy_version 203098 (0.0008) [2023-12-27 20:41:13,730][106226] Updated weights for policy 0, policy_version 202897 (0.0005) [2023-12-27 20:41:13,784][106226] Updated weights for policy 0, policy_version 202907 (0.0006) [2023-12-27 20:41:13,839][106226] Updated weights for policy 0, policy_version 202917 (0.0005) [2023-12-27 20:41:13,893][106226] Updated weights for policy 0, policy_version 202927 (0.0007) [2023-12-27 20:41:14,318][106225] Updated weights for policy 1, policy_version 203108 (0.0007) [2023-12-27 20:41:14,374][106225] Updated weights for policy 1, policy_version 203118 (0.0005) [2023-12-27 20:41:14,433][106225] Updated weights for policy 1, policy_version 203128 (0.0005) [2023-12-27 20:41:14,539][106226] Updated weights for policy 0, policy_version 202937 (0.0008) [2023-12-27 20:41:14,594][106226] Updated weights for policy 0, policy_version 202947 (0.0008) [2023-12-27 20:41:14,653][106226] Updated weights for policy 0, policy_version 202957 (0.0008) [2023-12-27 20:41:15,055][106225] Updated weights for policy 1, policy_version 203138 (0.0008) [2023-12-27 20:41:15,121][106225] Updated weights for policy 1, policy_version 203148 (0.0008) [2023-12-27 20:41:15,186][106225] Updated weights for policy 1, policy_version 203158 (0.0009) [2023-12-27 20:41:15,250][106225] Updated weights for policy 1, policy_version 203168 (0.0008) [2023-12-27 20:41:15,418][106226] Updated weights for policy 0, policy_version 202967 (0.0010) [2023-12-27 20:41:15,471][106226] Updated weights for policy 0, policy_version 202977 (0.0008) [2023-12-27 20:41:15,518][106226] Updated weights for policy 0, policy_version 202987 (0.0009) [2023-12-27 20:41:15,962][106225] Updated weights for policy 1, policy_version 203178 (0.0007) [2023-12-27 20:41:16,024][106225] Updated weights for policy 1, policy_version 203188 (0.0008) [2023-12-27 20:41:16,079][106225] Updated weights for policy 1, policy_version 203198 (0.0008) [2023-12-27 20:41:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 104005632. Throughput: 0: 9931.8, 1: 9838.7. Samples: 103994124. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:16,175][105115] Avg episode reward: [(0, '-5.364'), (1, '-6.111')] [2023-12-27 20:41:16,189][106226] Updated weights for policy 0, policy_version 202997 (0.0009) [2023-12-27 20:41:16,242][106226] Updated weights for policy 0, policy_version 203007 (0.0008) [2023-12-27 20:41:16,300][106226] Updated weights for policy 0, policy_version 203017 (0.0008) [2023-12-27 20:41:16,877][106226] Updated weights for policy 0, policy_version 203027 (0.0008) [2023-12-27 20:41:16,880][106225] Updated weights for policy 1, policy_version 203208 (0.0008) [2023-12-27 20:41:16,930][106225] Updated weights for policy 1, policy_version 203218 (0.0009) [2023-12-27 20:41:16,945][106226] Updated weights for policy 0, policy_version 203037 (0.0005) [2023-12-27 20:41:16,991][106225] Updated weights for policy 1, policy_version 203228 (0.0007) [2023-12-27 20:41:17,003][106226] Updated weights for policy 0, policy_version 203047 (0.0006) [2023-12-27 20:41:17,542][106226] Updated weights for policy 0, policy_version 203057 (0.0008) [2023-12-27 20:41:17,594][106226] Updated weights for policy 0, policy_version 203067 (0.0005) [2023-12-27 20:41:17,642][106226] Updated weights for policy 0, policy_version 203077 (0.0005) [2023-12-27 20:41:17,692][106226] Updated weights for policy 0, policy_version 203087 (0.0005) [2023-12-27 20:41:17,789][106225] Updated weights for policy 1, policy_version 203238 (0.0008) [2023-12-27 20:41:17,837][106225] Updated weights for policy 1, policy_version 203248 (0.0008) [2023-12-27 20:41:17,895][106225] Updated weights for policy 1, policy_version 203258 (0.0008) [2023-12-27 20:41:18,273][106226] Updated weights for policy 0, policy_version 203097 (0.0005) [2023-12-27 20:41:18,321][106226] Updated weights for policy 0, policy_version 203107 (0.0005) [2023-12-27 20:41:18,385][106226] Updated weights for policy 0, policy_version 203117 (0.0007) [2023-12-27 20:41:18,705][106225] Updated weights for policy 1, policy_version 203268 (0.0009) [2023-12-27 20:41:18,767][106225] Updated weights for policy 1, policy_version 203278 (0.0011) [2023-12-27 20:41:18,834][106225] Updated weights for policy 1, policy_version 203288 (0.0008) [2023-12-27 20:41:19,143][106226] Updated weights for policy 0, policy_version 203127 (0.0007) [2023-12-27 20:41:19,199][106226] Updated weights for policy 0, policy_version 203137 (0.0005) [2023-12-27 20:41:19,268][106226] Updated weights for policy 0, policy_version 203147 (0.0007) [2023-12-27 20:41:19,549][106225] Updated weights for policy 1, policy_version 203298 (0.0009) [2023-12-27 20:41:19,604][106225] Updated weights for policy 1, policy_version 203308 (0.0006) [2023-12-27 20:41:19,657][106225] Updated weights for policy 1, policy_version 203318 (0.0008) [2023-12-27 20:41:19,711][106225] Updated weights for policy 1, policy_version 203328 (0.0010) [2023-12-27 20:41:19,996][106226] Updated weights for policy 0, policy_version 203157 (0.0010) [2023-12-27 20:41:20,060][106226] Updated weights for policy 0, policy_version 203167 (0.0010) [2023-12-27 20:41:20,126][106226] Updated weights for policy 0, policy_version 203177 (0.0009) [2023-12-27 20:41:20,432][106225] Updated weights for policy 1, policy_version 203338 (0.0008) [2023-12-27 20:41:20,487][106225] Updated weights for policy 1, policy_version 203348 (0.0009) [2023-12-27 20:41:20,536][106225] Updated weights for policy 1, policy_version 203358 (0.0008) [2023-12-27 20:41:20,877][106226] Updated weights for policy 0, policy_version 203187 (0.0008) [2023-12-27 20:41:20,937][106226] Updated weights for policy 0, policy_version 203197 (0.0007) [2023-12-27 20:41:20,986][106226] Updated weights for policy 0, policy_version 203207 (0.0008) [2023-12-27 20:41:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 104103936. Throughput: 0: 9988.7, 1: 9764.7. Samples: 104112036. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:21,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-6.126')] [2023-12-27 20:41:21,371][106225] Updated weights for policy 1, policy_version 203368 (0.0009) [2023-12-27 20:41:21,434][106225] Updated weights for policy 1, policy_version 203378 (0.0008) [2023-12-27 20:41:21,497][106225] Updated weights for policy 1, policy_version 203388 (0.0008) [2023-12-27 20:41:21,753][106226] Updated weights for policy 0, policy_version 203217 (0.0008) [2023-12-27 20:41:21,819][106226] Updated weights for policy 0, policy_version 203227 (0.0009) [2023-12-27 20:41:21,874][106226] Updated weights for policy 0, policy_version 203237 (0.0008) [2023-12-27 20:41:21,933][106226] Updated weights for policy 0, policy_version 203247 (0.0007) [2023-12-27 20:41:22,285][106225] Updated weights for policy 1, policy_version 203398 (0.0008) [2023-12-27 20:41:22,348][106225] Updated weights for policy 1, policy_version 203408 (0.0008) [2023-12-27 20:41:22,417][106225] Updated weights for policy 1, policy_version 203418 (0.0007) [2023-12-27 20:41:22,698][106226] Updated weights for policy 0, policy_version 203257 (0.0007) [2023-12-27 20:41:22,760][106226] Updated weights for policy 0, policy_version 203267 (0.0011) [2023-12-27 20:41:22,825][106226] Updated weights for policy 0, policy_version 203277 (0.0011) [2023-12-27 20:41:23,107][106225] Updated weights for policy 1, policy_version 203428 (0.0008) [2023-12-27 20:41:23,168][106225] Updated weights for policy 1, policy_version 203438 (0.0007) [2023-12-27 20:41:23,230][106225] Updated weights for policy 1, policy_version 203448 (0.0008) [2023-12-27 20:41:23,502][106226] Updated weights for policy 0, policy_version 203287 (0.0009) [2023-12-27 20:41:23,559][106226] Updated weights for policy 0, policy_version 203297 (0.0010) [2023-12-27 20:41:23,615][106226] Updated weights for policy 0, policy_version 203307 (0.0010) [2023-12-27 20:41:23,776][106225] Updated weights for policy 1, policy_version 203458 (0.0006) [2023-12-27 20:41:23,844][106225] Updated weights for policy 1, policy_version 203468 (0.0006) [2023-12-27 20:41:23,912][106225] Updated weights for policy 1, policy_version 203478 (0.0005) [2023-12-27 20:41:23,979][106225] Updated weights for policy 1, policy_version 203488 (0.0006) [2023-12-27 20:41:24,279][106226] Updated weights for policy 0, policy_version 203317 (0.0008) [2023-12-27 20:41:24,340][106226] Updated weights for policy 0, policy_version 203327 (0.0007) [2023-12-27 20:41:24,392][106226] Updated weights for policy 0, policy_version 203337 (0.0008) [2023-12-27 20:41:24,561][106225] Updated weights for policy 1, policy_version 203498 (0.0008) [2023-12-27 20:41:24,620][106225] Updated weights for policy 1, policy_version 203508 (0.0008) [2023-12-27 20:41:24,675][106225] Updated weights for policy 1, policy_version 203518 (0.0008) [2023-12-27 20:41:25,102][106226] Updated weights for policy 0, policy_version 203348 (0.0009) [2023-12-27 20:41:25,154][106226] Updated weights for policy 0, policy_version 203358 (0.0005) [2023-12-27 20:41:25,206][106226] Updated weights for policy 0, policy_version 203368 (0.0005) [2023-12-27 20:41:25,381][106225] Updated weights for policy 1, policy_version 203528 (0.0010) [2023-12-27 20:41:25,433][106225] Updated weights for policy 1, policy_version 203538 (0.0006) [2023-12-27 20:41:25,490][106225] Updated weights for policy 1, policy_version 203548 (0.0006) [2023-12-27 20:41:25,780][106226] Updated weights for policy 0, policy_version 203378 (0.0006) [2023-12-27 20:41:25,835][106226] Updated weights for policy 0, policy_version 203388 (0.0005) [2023-12-27 20:41:25,889][106226] Updated weights for policy 0, policy_version 203398 (0.0009) [2023-12-27 20:41:25,948][106226] Updated weights for policy 0, policy_version 203408 (0.0010) [2023-12-27 20:41:26,127][106225] Updated weights for policy 1, policy_version 203558 (0.0010) [2023-12-27 20:41:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 104202240. Throughput: 0: 10014.7, 1: 9769.1. Samples: 104170712. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:26,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-6.190')] [2023-12-27 20:41:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000203408_52084736.pth... [2023-12-27 20:41:26,181][106225] Updated weights for policy 1, policy_version 203568 (0.0010) [2023-12-27 20:41:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000202256_51789824.pth [2023-12-27 20:41:26,235][106225] Updated weights for policy 1, policy_version 203578 (0.0010) [2023-12-27 20:41:26,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000203584_52125696.pth... [2023-12-27 20:41:26,268][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000202432_51830784.pth [2023-12-27 20:41:26,632][106226] Updated weights for policy 0, policy_version 203418 (0.0011) [2023-12-27 20:41:26,689][106226] Updated weights for policy 0, policy_version 203428 (0.0007) [2023-12-27 20:41:26,747][106226] Updated weights for policy 0, policy_version 203438 (0.0006) [2023-12-27 20:41:26,914][106225] Updated weights for policy 1, policy_version 203588 (0.0010) [2023-12-27 20:41:26,960][106225] Updated weights for policy 1, policy_version 203598 (0.0010) [2023-12-27 20:41:27,013][106225] Updated weights for policy 1, policy_version 203608 (0.0010) [2023-12-27 20:41:27,332][106226] Updated weights for policy 0, policy_version 203448 (0.0009) [2023-12-27 20:41:27,383][106226] Updated weights for policy 0, policy_version 203458 (0.0009) [2023-12-27 20:41:27,436][106226] Updated weights for policy 0, policy_version 203468 (0.0005) [2023-12-27 20:41:27,741][106225] Updated weights for policy 1, policy_version 203618 (0.0010) [2023-12-27 20:41:27,793][106225] Updated weights for policy 1, policy_version 203628 (0.0010) [2023-12-27 20:41:27,848][106225] Updated weights for policy 1, policy_version 203638 (0.0010) [2023-12-27 20:41:27,904][106225] Updated weights for policy 1, policy_version 203648 (0.0009) [2023-12-27 20:41:28,077][106226] Updated weights for policy 0, policy_version 203478 (0.0010) [2023-12-27 20:41:28,126][106226] Updated weights for policy 0, policy_version 203488 (0.0006) [2023-12-27 20:41:28,177][106226] Updated weights for policy 0, policy_version 203498 (0.0005) [2023-12-27 20:41:28,552][106225] Updated weights for policy 1, policy_version 203658 (0.0010) [2023-12-27 20:41:28,612][106225] Updated weights for policy 1, policy_version 203668 (0.0008) [2023-12-27 20:41:28,664][106225] Updated weights for policy 1, policy_version 203678 (0.0008) [2023-12-27 20:41:28,776][106226] Updated weights for policy 0, policy_version 203508 (0.0007) [2023-12-27 20:41:28,824][106226] Updated weights for policy 0, policy_version 203518 (0.0008) [2023-12-27 20:41:28,873][106226] Updated weights for policy 0, policy_version 203528 (0.0009) [2023-12-27 20:41:29,389][106225] Updated weights for policy 1, policy_version 203688 (0.0008) [2023-12-27 20:41:29,439][106225] Updated weights for policy 1, policy_version 203698 (0.0008) [2023-12-27 20:41:29,484][106225] Updated weights for policy 1, policy_version 203708 (0.0007) [2023-12-27 20:41:29,611][106226] Updated weights for policy 0, policy_version 203538 (0.0010) [2023-12-27 20:41:29,675][106226] Updated weights for policy 0, policy_version 203548 (0.0010) [2023-12-27 20:41:29,742][106226] Updated weights for policy 0, policy_version 203558 (0.0011) [2023-12-27 20:41:29,815][106226] Updated weights for policy 0, policy_version 203568 (0.0011) [2023-12-27 20:41:30,146][106225] Updated weights for policy 1, policy_version 203718 (0.0006) [2023-12-27 20:41:30,206][106225] Updated weights for policy 1, policy_version 203728 (0.0006) [2023-12-27 20:41:30,259][106225] Updated weights for policy 1, policy_version 203738 (0.0008) [2023-12-27 20:41:30,514][106226] Updated weights for policy 0, policy_version 203578 (0.0011) [2023-12-27 20:41:30,565][106226] Updated weights for policy 0, policy_version 203588 (0.0010) [2023-12-27 20:41:30,615][106226] Updated weights for policy 0, policy_version 203598 (0.0011) [2023-12-27 20:41:30,956][106225] Updated weights for policy 1, policy_version 203748 (0.0009) [2023-12-27 20:41:31,019][106225] Updated weights for policy 1, policy_version 203758 (0.0010) [2023-12-27 20:41:31,084][106225] Updated weights for policy 1, policy_version 203768 (0.0010) [2023-12-27 20:41:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 104308736. Throughput: 0: 10063.4, 1: 9894.7. Samples: 104296028. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:31,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-5.798')] [2023-12-27 20:41:31,348][106226] Updated weights for policy 0, policy_version 203608 (0.0007) [2023-12-27 20:41:31,411][106226] Updated weights for policy 0, policy_version 203618 (0.0008) [2023-12-27 20:41:31,475][106226] Updated weights for policy 0, policy_version 203628 (0.0005) [2023-12-27 20:41:31,843][106225] Updated weights for policy 1, policy_version 203778 (0.0009) [2023-12-27 20:41:31,898][106225] Updated weights for policy 1, policy_version 203788 (0.0009) [2023-12-27 20:41:31,963][106225] Updated weights for policy 1, policy_version 203798 (0.0008) [2023-12-27 20:41:32,029][106225] Updated weights for policy 1, policy_version 203808 (0.0009) [2023-12-27 20:41:32,157][106226] Updated weights for policy 0, policy_version 203638 (0.0006) [2023-12-27 20:41:32,229][106226] Updated weights for policy 0, policy_version 203648 (0.0007) [2023-12-27 20:41:32,302][106226] Updated weights for policy 0, policy_version 203658 (0.0009) [2023-12-27 20:41:32,765][106225] Updated weights for policy 1, policy_version 203818 (0.0008) [2023-12-27 20:41:32,823][106225] Updated weights for policy 1, policy_version 203828 (0.0008) [2023-12-27 20:41:32,871][106225] Updated weights for policy 1, policy_version 203838 (0.0006) [2023-12-27 20:41:33,003][106226] Updated weights for policy 0, policy_version 203668 (0.0007) [2023-12-27 20:41:33,048][106226] Updated weights for policy 0, policy_version 203678 (0.0009) [2023-12-27 20:41:33,095][106226] Updated weights for policy 0, policy_version 203688 (0.0007) [2023-12-27 20:41:33,473][106225] Updated weights for policy 1, policy_version 203848 (0.0008) [2023-12-27 20:41:33,522][106225] Updated weights for policy 1, policy_version 203858 (0.0008) [2023-12-27 20:41:33,570][106225] Updated weights for policy 1, policy_version 203868 (0.0009) [2023-12-27 20:41:33,809][106226] Updated weights for policy 0, policy_version 203698 (0.0009) [2023-12-27 20:41:33,875][106226] Updated weights for policy 0, policy_version 203708 (0.0005) [2023-12-27 20:41:33,938][106226] Updated weights for policy 0, policy_version 203718 (0.0006) [2023-12-27 20:41:33,992][106226] Updated weights for policy 0, policy_version 203728 (0.0010) [2023-12-27 20:41:34,280][106225] Updated weights for policy 1, policy_version 203878 (0.0008) [2023-12-27 20:41:34,341][106225] Updated weights for policy 1, policy_version 203888 (0.0007) [2023-12-27 20:41:34,405][106225] Updated weights for policy 1, policy_version 203898 (0.0008) [2023-12-27 20:41:34,719][106226] Updated weights for policy 0, policy_version 203738 (0.0010) [2023-12-27 20:41:34,775][106226] Updated weights for policy 0, policy_version 203748 (0.0010) [2023-12-27 20:41:34,828][106226] Updated weights for policy 0, policy_version 203758 (0.0010) [2023-12-27 20:41:35,073][106225] Updated weights for policy 1, policy_version 203908 (0.0009) [2023-12-27 20:41:35,124][106225] Updated weights for policy 1, policy_version 203918 (0.0010) [2023-12-27 20:41:35,189][106225] Updated weights for policy 1, policy_version 203928 (0.0008) [2023-12-27 20:41:35,463][106226] Updated weights for policy 0, policy_version 203768 (0.0008) [2023-12-27 20:41:35,527][106226] Updated weights for policy 0, policy_version 203778 (0.0008) [2023-12-27 20:41:35,595][106226] Updated weights for policy 0, policy_version 203788 (0.0008) [2023-12-27 20:41:35,819][106225] Updated weights for policy 1, policy_version 203938 (0.0007) [2023-12-27 20:41:35,883][106225] Updated weights for policy 1, policy_version 203948 (0.0005) [2023-12-27 20:41:35,945][106225] Updated weights for policy 1, policy_version 203958 (0.0005) [2023-12-27 20:41:36,007][106225] Updated weights for policy 1, policy_version 203968 (0.0006) [2023-12-27 20:41:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 104407040. Throughput: 0: 10052.3, 1: 9909.4. Samples: 104416688. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:36,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-6.185')] [2023-12-27 20:41:36,267][106226] Updated weights for policy 0, policy_version 203798 (0.0008) [2023-12-27 20:41:36,322][106226] Updated weights for policy 0, policy_version 203808 (0.0008) [2023-12-27 20:41:36,385][106226] Updated weights for policy 0, policy_version 203818 (0.0008) [2023-12-27 20:41:36,635][106225] Updated weights for policy 1, policy_version 203978 (0.0008) [2023-12-27 20:41:36,690][106225] Updated weights for policy 1, policy_version 203988 (0.0008) [2023-12-27 20:41:36,747][106225] Updated weights for policy 1, policy_version 203998 (0.0008) [2023-12-27 20:41:37,073][106226] Updated weights for policy 0, policy_version 203828 (0.0008) [2023-12-27 20:41:37,134][106226] Updated weights for policy 0, policy_version 203838 (0.0007) [2023-12-27 20:41:37,191][106226] Updated weights for policy 0, policy_version 203848 (0.0010) [2023-12-27 20:41:37,420][106225] Updated weights for policy 1, policy_version 204008 (0.0006) [2023-12-27 20:41:37,491][106225] Updated weights for policy 1, policy_version 204018 (0.0005) [2023-12-27 20:41:37,552][106225] Updated weights for policy 1, policy_version 204028 (0.0008) [2023-12-27 20:41:37,870][106226] Updated weights for policy 0, policy_version 203858 (0.0009) [2023-12-27 20:41:37,936][106226] Updated weights for policy 0, policy_version 203868 (0.0008) [2023-12-27 20:41:38,002][106226] Updated weights for policy 0, policy_version 203878 (0.0008) [2023-12-27 20:41:38,064][106226] Updated weights for policy 0, policy_version 203888 (0.0007) [2023-12-27 20:41:38,168][106225] Updated weights for policy 1, policy_version 204038 (0.0008) [2023-12-27 20:41:38,223][106225] Updated weights for policy 1, policy_version 204048 (0.0009) [2023-12-27 20:41:38,286][106225] Updated weights for policy 1, policy_version 204058 (0.0009) [2023-12-27 20:41:38,748][106226] Updated weights for policy 0, policy_version 203898 (0.0009) [2023-12-27 20:41:38,799][106226] Updated weights for policy 0, policy_version 203908 (0.0010) [2023-12-27 20:41:38,855][106226] Updated weights for policy 0, policy_version 203918 (0.0010) [2023-12-27 20:41:38,958][106225] Updated weights for policy 1, policy_version 204068 (0.0007) [2023-12-27 20:41:39,030][106225] Updated weights for policy 1, policy_version 204078 (0.0006) [2023-12-27 20:41:39,088][106225] Updated weights for policy 1, policy_version 204088 (0.0008) [2023-12-27 20:41:39,606][106226] Updated weights for policy 0, policy_version 203928 (0.0009) [2023-12-27 20:41:39,669][106226] Updated weights for policy 0, policy_version 203938 (0.0009) [2023-12-27 20:41:39,731][106226] Updated weights for policy 0, policy_version 203948 (0.0009) [2023-12-27 20:41:39,842][106225] Updated weights for policy 1, policy_version 204098 (0.0009) [2023-12-27 20:41:39,908][106225] Updated weights for policy 1, policy_version 204108 (0.0008) [2023-12-27 20:41:39,979][106225] Updated weights for policy 1, policy_version 204118 (0.0007) [2023-12-27 20:41:40,046][106225] Updated weights for policy 1, policy_version 204128 (0.0009) [2023-12-27 20:41:40,461][106226] Updated weights for policy 0, policy_version 203958 (0.0007) [2023-12-27 20:41:40,517][106226] Updated weights for policy 0, policy_version 203968 (0.0007) [2023-12-27 20:41:40,588][106226] Updated weights for policy 0, policy_version 203978 (0.0010) [2023-12-27 20:41:40,702][106225] Updated weights for policy 1, policy_version 204138 (0.0008) [2023-12-27 20:41:40,754][106225] Updated weights for policy 1, policy_version 204148 (0.0006) [2023-12-27 20:41:40,803][106225] Updated weights for policy 1, policy_version 204158 (0.0009) [2023-12-27 20:41:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 104505344. Throughput: 0: 10043.4, 1: 9977.2. Samples: 104477352. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:41,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-5.901')] [2023-12-27 20:41:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000204160_52273152.pth... [2023-12-27 20:41:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000203984_52232192.pth... [2023-12-27 20:41:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000202800_51929088.pth [2023-12-27 20:41:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000203008_51978240.pth [2023-12-27 20:41:41,324][106226] Updated weights for policy 0, policy_version 203988 (0.0009) [2023-12-27 20:41:41,399][106226] Updated weights for policy 0, policy_version 203998 (0.0010) [2023-12-27 20:41:41,457][106226] Updated weights for policy 0, policy_version 204008 (0.0006) [2023-12-27 20:41:41,559][106225] Updated weights for policy 1, policy_version 204168 (0.0007) [2023-12-27 20:41:41,624][106225] Updated weights for policy 1, policy_version 204178 (0.0010) [2023-12-27 20:41:41,688][106225] Updated weights for policy 1, policy_version 204188 (0.0009) [2023-12-27 20:41:42,191][106226] Updated weights for policy 0, policy_version 204018 (0.0008) [2023-12-27 20:41:42,258][106226] Updated weights for policy 0, policy_version 204028 (0.0010) [2023-12-27 20:41:42,329][106226] Updated weights for policy 0, policy_version 204038 (0.0011) [2023-12-27 20:41:42,398][106226] Updated weights for policy 0, policy_version 204048 (0.0010) [2023-12-27 20:41:42,487][106225] Updated weights for policy 1, policy_version 204198 (0.0010) [2023-12-27 20:41:42,546][106225] Updated weights for policy 1, policy_version 204208 (0.0008) [2023-12-27 20:41:42,611][106225] Updated weights for policy 1, policy_version 204218 (0.0008) [2023-12-27 20:41:43,019][106226] Updated weights for policy 0, policy_version 204058 (0.0010) [2023-12-27 20:41:43,081][106226] Updated weights for policy 0, policy_version 204068 (0.0010) [2023-12-27 20:41:43,141][106226] Updated weights for policy 0, policy_version 204078 (0.0011) [2023-12-27 20:41:43,290][106225] Updated weights for policy 1, policy_version 204228 (0.0008) [2023-12-27 20:41:43,345][106225] Updated weights for policy 1, policy_version 204238 (0.0008) [2023-12-27 20:41:43,405][106225] Updated weights for policy 1, policy_version 204248 (0.0008) [2023-12-27 20:41:43,859][106226] Updated weights for policy 0, policy_version 204088 (0.0011) [2023-12-27 20:41:43,912][106226] Updated weights for policy 0, policy_version 204098 (0.0010) [2023-12-27 20:41:43,959][106226] Updated weights for policy 0, policy_version 204108 (0.0010) [2023-12-27 20:41:44,088][106225] Updated weights for policy 1, policy_version 204258 (0.0007) [2023-12-27 20:41:44,140][106225] Updated weights for policy 1, policy_version 204268 (0.0008) [2023-12-27 20:41:44,192][106225] Updated weights for policy 1, policy_version 204278 (0.0007) [2023-12-27 20:41:44,245][106225] Updated weights for policy 1, policy_version 204288 (0.0007) [2023-12-27 20:41:44,669][106226] Updated weights for policy 0, policy_version 204118 (0.0010) [2023-12-27 20:41:44,721][106226] Updated weights for policy 0, policy_version 204128 (0.0010) [2023-12-27 20:41:44,787][106226] Updated weights for policy 0, policy_version 204138 (0.0011) [2023-12-27 20:41:44,958][106225] Updated weights for policy 1, policy_version 204298 (0.0008) [2023-12-27 20:41:45,021][106225] Updated weights for policy 1, policy_version 204308 (0.0008) [2023-12-27 20:41:45,086][106225] Updated weights for policy 1, policy_version 204318 (0.0009) [2023-12-27 20:41:45,508][106226] Updated weights for policy 0, policy_version 204148 (0.0010) [2023-12-27 20:41:45,574][106226] Updated weights for policy 0, policy_version 204158 (0.0010) [2023-12-27 20:41:45,633][106226] Updated weights for policy 0, policy_version 204168 (0.0007) [2023-12-27 20:41:45,799][106225] Updated weights for policy 1, policy_version 204328 (0.0008) [2023-12-27 20:41:45,849][106225] Updated weights for policy 1, policy_version 204338 (0.0007) [2023-12-27 20:41:45,907][106225] Updated weights for policy 1, policy_version 204348 (0.0008) [2023-12-27 20:41:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 104603648. Throughput: 0: 9920.7, 1: 9937.0. Samples: 104594040. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:46,176][105115] Avg episode reward: [(0, '-5.100'), (1, '-6.512')] [2023-12-27 20:41:46,241][106226] Updated weights for policy 0, policy_version 204178 (0.0005) [2023-12-27 20:41:46,302][106226] Updated weights for policy 0, policy_version 204188 (0.0010) [2023-12-27 20:41:46,361][106226] Updated weights for policy 0, policy_version 204198 (0.0010) [2023-12-27 20:41:46,421][106226] Updated weights for policy 0, policy_version 204208 (0.0010) [2023-12-27 20:41:46,677][106225] Updated weights for policy 1, policy_version 204358 (0.0009) [2023-12-27 20:41:46,730][106225] Updated weights for policy 1, policy_version 204368 (0.0010) [2023-12-27 20:41:46,783][106225] Updated weights for policy 1, policy_version 204379 (0.0010) [2023-12-27 20:41:47,023][106226] Updated weights for policy 0, policy_version 204218 (0.0005) [2023-12-27 20:41:47,074][106226] Updated weights for policy 0, policy_version 204228 (0.0008) [2023-12-27 20:41:47,127][106226] Updated weights for policy 0, policy_version 204238 (0.0008) [2023-12-27 20:41:47,522][106225] Updated weights for policy 1, policy_version 204389 (0.0007) [2023-12-27 20:41:47,583][106225] Updated weights for policy 1, policy_version 204399 (0.0008) [2023-12-27 20:41:47,645][106225] Updated weights for policy 1, policy_version 204409 (0.0008) [2023-12-27 20:41:47,723][106226] Updated weights for policy 0, policy_version 204248 (0.0006) [2023-12-27 20:41:47,769][106226] Updated weights for policy 0, policy_version 204258 (0.0008) [2023-12-27 20:41:47,814][106226] Updated weights for policy 0, policy_version 204268 (0.0005) [2023-12-27 20:41:48,293][106225] Updated weights for policy 1, policy_version 204419 (0.0006) [2023-12-27 20:41:48,370][106225] Updated weights for policy 1, policy_version 204429 (0.0007) [2023-12-27 20:41:48,434][106225] Updated weights for policy 1, policy_version 204439 (0.0007) [2023-12-27 20:41:48,552][106226] Updated weights for policy 0, policy_version 204279 (0.0009) [2023-12-27 20:41:48,612][106226] Updated weights for policy 0, policy_version 204289 (0.0008) [2023-12-27 20:41:48,677][106226] Updated weights for policy 0, policy_version 204299 (0.0008) [2023-12-27 20:41:49,078][106225] Updated weights for policy 1, policy_version 204449 (0.0008) [2023-12-27 20:41:49,136][106225] Updated weights for policy 1, policy_version 204459 (0.0008) [2023-12-27 20:41:49,184][106225] Updated weights for policy 1, policy_version 204469 (0.0009) [2023-12-27 20:41:49,252][106225] Updated weights for policy 1, policy_version 204479 (0.0009) [2023-12-27 20:41:49,391][106226] Updated weights for policy 0, policy_version 204309 (0.0008) [2023-12-27 20:41:49,453][106226] Updated weights for policy 0, policy_version 204319 (0.0008) [2023-12-27 20:41:49,516][106226] Updated weights for policy 0, policy_version 204329 (0.0008) [2023-12-27 20:41:50,084][106225] Updated weights for policy 1, policy_version 204489 (0.0007) [2023-12-27 20:41:50,148][106225] Updated weights for policy 1, policy_version 204499 (0.0008) [2023-12-27 20:41:50,209][106225] Updated weights for policy 1, policy_version 204509 (0.0008) [2023-12-27 20:41:50,248][106226] Updated weights for policy 0, policy_version 204339 (0.0009) [2023-12-27 20:41:50,304][106226] Updated weights for policy 0, policy_version 204349 (0.0008) [2023-12-27 20:41:50,370][106226] Updated weights for policy 0, policy_version 204359 (0.0008) [2023-12-27 20:41:50,948][106225] Updated weights for policy 1, policy_version 204519 (0.0008) [2023-12-27 20:41:51,010][106225] Updated weights for policy 1, policy_version 204529 (0.0009) [2023-12-27 20:41:51,072][106225] Updated weights for policy 1, policy_version 204539 (0.0009) [2023-12-27 20:41:51,130][106226] Updated weights for policy 0, policy_version 204369 (0.0008) [2023-12-27 20:41:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 104701952. Throughput: 0: 10002.2, 1: 9825.4. Samples: 104712240. Policy #0 lag: (min: 25.0, avg: 43.2, max: 57.0) [2023-12-27 20:41:51,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.862')] [2023-12-27 20:41:51,194][106226] Updated weights for policy 0, policy_version 204379 (0.0009) [2023-12-27 20:41:51,260][106226] Updated weights for policy 0, policy_version 204389 (0.0008) [2023-12-27 20:41:51,322][106226] Updated weights for policy 0, policy_version 204399 (0.0008) [2023-12-27 20:41:51,856][106225] Updated weights for policy 1, policy_version 204549 (0.0009) [2023-12-27 20:41:51,920][106225] Updated weights for policy 1, policy_version 204559 (0.0010) [2023-12-27 20:41:51,984][106225] Updated weights for policy 1, policy_version 204569 (0.0009) [2023-12-27 20:41:52,058][106226] Updated weights for policy 0, policy_version 204409 (0.0007) [2023-12-27 20:41:52,119][106226] Updated weights for policy 0, policy_version 204419 (0.0009) [2023-12-27 20:41:52,181][106226] Updated weights for policy 0, policy_version 204429 (0.0009) [2023-12-27 20:41:52,647][106225] Updated weights for policy 1, policy_version 204579 (0.0010) [2023-12-27 20:41:52,714][106225] Updated weights for policy 1, policy_version 204589 (0.0010) [2023-12-27 20:41:52,779][106225] Updated weights for policy 1, policy_version 204599 (0.0008) [2023-12-27 20:41:52,967][106226] Updated weights for policy 0, policy_version 204439 (0.0007) [2023-12-27 20:41:53,035][106226] Updated weights for policy 0, policy_version 204449 (0.0006) [2023-12-27 20:41:53,093][106226] Updated weights for policy 0, policy_version 204459 (0.0006) [2023-12-27 20:41:53,457][106225] Updated weights for policy 1, policy_version 204609 (0.0009) [2023-12-27 20:41:53,520][106225] Updated weights for policy 1, policy_version 204619 (0.0006) [2023-12-27 20:41:53,584][106225] Updated weights for policy 1, policy_version 204629 (0.0009) [2023-12-27 20:41:53,634][106225] Updated weights for policy 1, policy_version 204639 (0.0010) [2023-12-27 20:41:53,644][106226] Updated weights for policy 0, policy_version 204469 (0.0006) [2023-12-27 20:41:53,695][106226] Updated weights for policy 0, policy_version 204479 (0.0008) [2023-12-27 20:41:53,753][106226] Updated weights for policy 0, policy_version 204489 (0.0008) [2023-12-27 20:41:54,322][106225] Updated weights for policy 1, policy_version 204649 (0.0010) [2023-12-27 20:41:54,379][106225] Updated weights for policy 1, policy_version 204659 (0.0010) [2023-12-27 20:41:54,437][106226] Updated weights for policy 0, policy_version 204499 (0.0006) [2023-12-27 20:41:54,442][106225] Updated weights for policy 1, policy_version 204669 (0.0010) [2023-12-27 20:41:54,490][106226] Updated weights for policy 0, policy_version 204509 (0.0008) [2023-12-27 20:41:54,538][106226] Updated weights for policy 0, policy_version 204519 (0.0007) [2023-12-27 20:41:55,146][106225] Updated weights for policy 1, policy_version 204679 (0.0008) [2023-12-27 20:41:55,203][106225] Updated weights for policy 1, policy_version 204689 (0.0005) [2023-12-27 20:41:55,256][106225] Updated weights for policy 1, policy_version 204699 (0.0005) [2023-12-27 20:41:55,262][106226] Updated weights for policy 0, policy_version 204529 (0.0006) [2023-12-27 20:41:55,315][106226] Updated weights for policy 0, policy_version 204539 (0.0009) [2023-12-27 20:41:55,366][106226] Updated weights for policy 0, policy_version 204549 (0.0008) [2023-12-27 20:41:55,420][106226] Updated weights for policy 0, policy_version 204559 (0.0008) [2023-12-27 20:41:55,849][106225] Updated weights for policy 1, policy_version 204709 (0.0005) [2023-12-27 20:41:55,904][106225] Updated weights for policy 1, policy_version 204719 (0.0005) [2023-12-27 20:41:55,952][106225] Updated weights for policy 1, policy_version 204729 (0.0008) [2023-12-27 20:41:56,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 104800256. Throughput: 0: 10054.4, 1: 9812.7. Samples: 104770888. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:41:56,175][105115] Avg episode reward: [(0, '-5.024'), (1, '-6.150')] [2023-12-27 20:41:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000204736_52420608.pth... [2023-12-27 20:41:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000203584_52125696.pth [2023-12-27 20:41:56,207][106226] Updated weights for policy 0, policy_version 204569 (0.0008) [2023-12-27 20:41:56,265][106226] Updated weights for policy 0, policy_version 204579 (0.0008) [2023-12-27 20:41:56,315][106226] Updated weights for policy 0, policy_version 204589 (0.0008) [2023-12-27 20:41:56,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000204592_52387840.pth... [2023-12-27 20:41:56,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000203408_52084736.pth [2023-12-27 20:41:56,634][106225] Updated weights for policy 1, policy_version 204739 (0.0009) [2023-12-27 20:41:56,686][106225] Updated weights for policy 1, policy_version 204749 (0.0010) [2023-12-27 20:41:56,732][106225] Updated weights for policy 1, policy_version 204759 (0.0010) [2023-12-27 20:41:57,054][106226] Updated weights for policy 0, policy_version 204599 (0.0008) [2023-12-27 20:41:57,119][106226] Updated weights for policy 0, policy_version 204609 (0.0008) [2023-12-27 20:41:57,173][106226] Updated weights for policy 0, policy_version 204619 (0.0008) [2023-12-27 20:41:57,469][106225] Updated weights for policy 1, policy_version 204769 (0.0010) [2023-12-27 20:41:57,527][106225] Updated weights for policy 1, policy_version 204779 (0.0010) [2023-12-27 20:41:57,583][106225] Updated weights for policy 1, policy_version 204789 (0.0010) [2023-12-27 20:41:57,635][106225] Updated weights for policy 1, policy_version 204799 (0.0010) [2023-12-27 20:41:57,880][106226] Updated weights for policy 0, policy_version 204629 (0.0009) [2023-12-27 20:41:57,926][106226] Updated weights for policy 0, policy_version 204639 (0.0010) [2023-12-27 20:41:57,975][106226] Updated weights for policy 0, policy_version 204649 (0.0010) [2023-12-27 20:41:58,361][106225] Updated weights for policy 1, policy_version 204809 (0.0009) [2023-12-27 20:41:58,426][106225] Updated weights for policy 1, policy_version 204819 (0.0009) [2023-12-27 20:41:58,487][106225] Updated weights for policy 1, policy_version 204829 (0.0010) [2023-12-27 20:41:58,752][106226] Updated weights for policy 0, policy_version 204659 (0.0008) [2023-12-27 20:41:58,818][106226] Updated weights for policy 0, policy_version 204669 (0.0007) [2023-12-27 20:41:58,896][106226] Updated weights for policy 0, policy_version 204679 (0.0008) [2023-12-27 20:41:59,284][106225] Updated weights for policy 1, policy_version 204839 (0.0011) [2023-12-27 20:41:59,353][106225] Updated weights for policy 1, policy_version 204849 (0.0010) [2023-12-27 20:41:59,422][106225] Updated weights for policy 1, policy_version 204859 (0.0010) [2023-12-27 20:41:59,567][106226] Updated weights for policy 0, policy_version 204689 (0.0008) [2023-12-27 20:41:59,634][106226] Updated weights for policy 0, policy_version 204699 (0.0005) [2023-12-27 20:41:59,703][106226] Updated weights for policy 0, policy_version 204709 (0.0006) [2023-12-27 20:41:59,759][106226] Updated weights for policy 0, policy_version 204719 (0.0005) [2023-12-27 20:42:00,240][106225] Updated weights for policy 1, policy_version 204869 (0.0010) [2023-12-27 20:42:00,296][106225] Updated weights for policy 1, policy_version 204879 (0.0008) [2023-12-27 20:42:00,315][106226] Updated weights for policy 0, policy_version 204729 (0.0005) [2023-12-27 20:42:00,355][106225] Updated weights for policy 1, policy_version 204889 (0.0008) [2023-12-27 20:42:00,372][106226] Updated weights for policy 0, policy_version 204739 (0.0007) [2023-12-27 20:42:00,433][106226] Updated weights for policy 0, policy_version 204749 (0.0008) [2023-12-27 20:42:01,057][106225] Updated weights for policy 1, policy_version 204899 (0.0007) [2023-12-27 20:42:01,075][106226] Updated weights for policy 0, policy_version 204759 (0.0008) [2023-12-27 20:42:01,119][106225] Updated weights for policy 1, policy_version 204909 (0.0008) [2023-12-27 20:42:01,145][106226] Updated weights for policy 0, policy_version 204769 (0.0007) [2023-12-27 20:42:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 104890368. Throughput: 0: 10041.6, 1: 9825.5. Samples: 104888144. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:01,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-6.278')] [2023-12-27 20:42:01,187][106225] Updated weights for policy 1, policy_version 204919 (0.0008) [2023-12-27 20:42:01,207][106226] Updated weights for policy 0, policy_version 204779 (0.0008) [2023-12-27 20:42:01,881][106225] Updated weights for policy 1, policy_version 204929 (0.0007) [2023-12-27 20:42:01,942][106226] Updated weights for policy 0, policy_version 204789 (0.0009) [2023-12-27 20:42:01,943][106225] Updated weights for policy 1, policy_version 204939 (0.0008) [2023-12-27 20:42:02,003][106226] Updated weights for policy 0, policy_version 204799 (0.0011) [2023-12-27 20:42:02,006][106225] Updated weights for policy 1, policy_version 204949 (0.0006) [2023-12-27 20:42:02,060][106225] Updated weights for policy 1, policy_version 204959 (0.0005) [2023-12-27 20:42:02,061][106226] Updated weights for policy 0, policy_version 204809 (0.0011) [2023-12-27 20:42:02,761][106225] Updated weights for policy 1, policy_version 204969 (0.0008) [2023-12-27 20:42:02,810][106226] Updated weights for policy 0, policy_version 204819 (0.0009) [2023-12-27 20:42:02,820][106225] Updated weights for policy 1, policy_version 204979 (0.0008) [2023-12-27 20:42:02,861][106226] Updated weights for policy 0, policy_version 204829 (0.0006) [2023-12-27 20:42:02,886][106225] Updated weights for policy 1, policy_version 204989 (0.0007) [2023-12-27 20:42:02,914][106226] Updated weights for policy 0, policy_version 204839 (0.0007) [2023-12-27 20:42:03,590][106226] Updated weights for policy 0, policy_version 204849 (0.0008) [2023-12-27 20:42:03,619][106225] Updated weights for policy 1, policy_version 204999 (0.0007) [2023-12-27 20:42:03,651][106226] Updated weights for policy 0, policy_version 204859 (0.0006) [2023-12-27 20:42:03,680][106225] Updated weights for policy 1, policy_version 205009 (0.0007) [2023-12-27 20:42:03,709][106226] Updated weights for policy 0, policy_version 204869 (0.0008) [2023-12-27 20:42:03,741][106225] Updated weights for policy 1, policy_version 205019 (0.0007) [2023-12-27 20:42:03,758][106226] Updated weights for policy 0, policy_version 204879 (0.0006) [2023-12-27 20:42:04,391][106225] Updated weights for policy 1, policy_version 205029 (0.0009) [2023-12-27 20:42:04,455][106225] Updated weights for policy 1, policy_version 205039 (0.0007) [2023-12-27 20:42:04,502][106226] Updated weights for policy 0, policy_version 204889 (0.0008) [2023-12-27 20:42:04,516][106225] Updated weights for policy 1, policy_version 205049 (0.0007) [2023-12-27 20:42:04,555][106226] Updated weights for policy 0, policy_version 204899 (0.0008) [2023-12-27 20:42:04,608][106226] Updated weights for policy 0, policy_version 204909 (0.0009) [2023-12-27 20:42:05,100][106225] Updated weights for policy 1, policy_version 205059 (0.0005) [2023-12-27 20:42:05,162][106225] Updated weights for policy 1, policy_version 205069 (0.0007) [2023-12-27 20:42:05,222][106225] Updated weights for policy 1, policy_version 205079 (0.0009) [2023-12-27 20:42:05,414][106226] Updated weights for policy 0, policy_version 204919 (0.0009) [2023-12-27 20:42:05,476][106226] Updated weights for policy 0, policy_version 204929 (0.0007) [2023-12-27 20:42:05,544][106226] Updated weights for policy 0, policy_version 204939 (0.0006) [2023-12-27 20:42:05,969][106225] Updated weights for policy 1, policy_version 205089 (0.0008) [2023-12-27 20:42:06,023][106225] Updated weights for policy 1, policy_version 205099 (0.0008) [2023-12-27 20:42:06,074][106225] Updated weights for policy 1, policy_version 205109 (0.0008) [2023-12-27 20:42:06,119][106226] Updated weights for policy 0, policy_version 204949 (0.0007) [2023-12-27 20:42:06,139][106225] Updated weights for policy 1, policy_version 205119 (0.0008) [2023-12-27 20:42:06,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 104996864. Throughput: 0: 9980.2, 1: 9908.0. Samples: 105007008. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:06,176][105115] Avg episode reward: [(0, '-4.845'), (1, '-6.107')] [2023-12-27 20:42:06,182][106226] Updated weights for policy 0, policy_version 204959 (0.0008) [2023-12-27 20:42:06,242][106226] Updated weights for policy 0, policy_version 204969 (0.0009) [2023-12-27 20:42:06,869][106225] Updated weights for policy 1, policy_version 205129 (0.0009) [2023-12-27 20:42:06,930][106225] Updated weights for policy 1, policy_version 205139 (0.0008) [2023-12-27 20:42:06,972][106226] Updated weights for policy 0, policy_version 204979 (0.0008) [2023-12-27 20:42:06,987][106225] Updated weights for policy 1, policy_version 205149 (0.0008) [2023-12-27 20:42:07,036][106226] Updated weights for policy 0, policy_version 204989 (0.0007) [2023-12-27 20:42:07,093][106226] Updated weights for policy 0, policy_version 204999 (0.0007) [2023-12-27 20:42:07,720][106225] Updated weights for policy 1, policy_version 205159 (0.0010) [2023-12-27 20:42:07,777][106225] Updated weights for policy 1, policy_version 205169 (0.0010) [2023-12-27 20:42:07,835][106225] Updated weights for policy 1, policy_version 205179 (0.0010) [2023-12-27 20:42:07,835][106226] Updated weights for policy 0, policy_version 205009 (0.0008) [2023-12-27 20:42:07,893][106226] Updated weights for policy 0, policy_version 205019 (0.0007) [2023-12-27 20:42:07,956][106226] Updated weights for policy 0, policy_version 205029 (0.0008) [2023-12-27 20:42:08,026][106226] Updated weights for policy 0, policy_version 205039 (0.0008) [2023-12-27 20:42:08,589][106225] Updated weights for policy 1, policy_version 205189 (0.0010) [2023-12-27 20:42:08,653][106225] Updated weights for policy 1, policy_version 205199 (0.0010) [2023-12-27 20:42:08,700][106225] Updated weights for policy 1, policy_version 205209 (0.0010) [2023-12-27 20:42:08,781][106226] Updated weights for policy 0, policy_version 205049 (0.0008) [2023-12-27 20:42:08,845][106226] Updated weights for policy 0, policy_version 205059 (0.0008) [2023-12-27 20:42:08,906][106226] Updated weights for policy 0, policy_version 205069 (0.0008) [2023-12-27 20:42:09,447][106225] Updated weights for policy 1, policy_version 205219 (0.0010) [2023-12-27 20:42:09,511][106225] Updated weights for policy 1, policy_version 205229 (0.0010) [2023-12-27 20:42:09,576][106225] Updated weights for policy 1, policy_version 205239 (0.0009) [2023-12-27 20:42:09,697][106226] Updated weights for policy 0, policy_version 205079 (0.0006) [2023-12-27 20:42:09,766][106226] Updated weights for policy 0, policy_version 205089 (0.0010) [2023-12-27 20:42:09,837][106226] Updated weights for policy 0, policy_version 205099 (0.0006) [2023-12-27 20:42:10,232][106225] Updated weights for policy 1, policy_version 205249 (0.0009) [2023-12-27 20:42:10,319][106225] Updated weights for policy 1, policy_version 205259 (0.0010) [2023-12-27 20:42:10,381][106225] Updated weights for policy 1, policy_version 205269 (0.0010) [2023-12-27 20:42:10,444][106225] Updated weights for policy 1, policy_version 205279 (0.0010) [2023-12-27 20:42:10,558][106226] Updated weights for policy 0, policy_version 205109 (0.0009) [2023-12-27 20:42:10,619][106226] Updated weights for policy 0, policy_version 205119 (0.0009) [2023-12-27 20:42:10,683][106226] Updated weights for policy 0, policy_version 205129 (0.0009) [2023-12-27 20:42:11,034][106225] Updated weights for policy 1, policy_version 205289 (0.0010) [2023-12-27 20:42:11,090][106225] Updated weights for policy 1, policy_version 205299 (0.0010) [2023-12-27 20:42:11,158][106225] Updated weights for policy 1, policy_version 205309 (0.0009) [2023-12-27 20:42:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 105095168. Throughput: 0: 9948.5, 1: 9870.9. Samples: 105062588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:11,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.966')] [2023-12-27 20:42:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000205136_52527104.pth... [2023-12-27 20:42:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000205312_52568064.pth... [2023-12-27 20:42:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000203984_52232192.pth [2023-12-27 20:42:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000204160_52273152.pth [2023-12-27 20:42:11,563][106226] Updated weights for policy 0, policy_version 205139 (0.0009) [2023-12-27 20:42:11,629][106226] Updated weights for policy 0, policy_version 205149 (0.0008) [2023-12-27 20:42:11,687][106226] Updated weights for policy 0, policy_version 205159 (0.0008) [2023-12-27 20:42:11,930][106225] Updated weights for policy 1, policy_version 205319 (0.0009) [2023-12-27 20:42:11,984][106225] Updated weights for policy 1, policy_version 205329 (0.0010) [2023-12-27 20:42:12,039][106225] Updated weights for policy 1, policy_version 205339 (0.0010) [2023-12-27 20:42:12,439][106226] Updated weights for policy 0, policy_version 205169 (0.0008) [2023-12-27 20:42:12,486][106226] Updated weights for policy 0, policy_version 205179 (0.0007) [2023-12-27 20:42:12,543][106226] Updated weights for policy 0, policy_version 205189 (0.0006) [2023-12-27 20:42:12,608][106226] Updated weights for policy 0, policy_version 205199 (0.0009) [2023-12-27 20:42:12,840][106225] Updated weights for policy 1, policy_version 205349 (0.0008) [2023-12-27 20:42:12,895][106225] Updated weights for policy 1, policy_version 205359 (0.0008) [2023-12-27 20:42:12,947][106225] Updated weights for policy 1, policy_version 205369 (0.0007) [2023-12-27 20:42:13,298][106226] Updated weights for policy 0, policy_version 205209 (0.0008) [2023-12-27 20:42:13,359][106226] Updated weights for policy 0, policy_version 205219 (0.0007) [2023-12-27 20:42:13,415][106226] Updated weights for policy 0, policy_version 205229 (0.0007) [2023-12-27 20:42:13,658][106225] Updated weights for policy 1, policy_version 205379 (0.0010) [2023-12-27 20:42:13,710][106225] Updated weights for policy 1, policy_version 205389 (0.0006) [2023-12-27 20:42:13,763][106225] Updated weights for policy 1, policy_version 205399 (0.0005) [2023-12-27 20:42:13,971][106226] Updated weights for policy 0, policy_version 205239 (0.0007) [2023-12-27 20:42:14,024][106226] Updated weights for policy 0, policy_version 205249 (0.0008) [2023-12-27 20:42:14,079][106226] Updated weights for policy 0, policy_version 205259 (0.0008) [2023-12-27 20:42:14,363][106225] Updated weights for policy 1, policy_version 205409 (0.0006) [2023-12-27 20:42:14,419][106225] Updated weights for policy 1, policy_version 205419 (0.0009) [2023-12-27 20:42:14,466][106225] Updated weights for policy 1, policy_version 205429 (0.0005) [2023-12-27 20:42:14,525][106225] Updated weights for policy 1, policy_version 205439 (0.0005) [2023-12-27 20:42:14,859][106226] Updated weights for policy 0, policy_version 205269 (0.0009) [2023-12-27 20:42:14,924][106226] Updated weights for policy 0, policy_version 205279 (0.0009) [2023-12-27 20:42:14,987][106226] Updated weights for policy 0, policy_version 205289 (0.0009) [2023-12-27 20:42:15,102][106225] Updated weights for policy 1, policy_version 205449 (0.0009) [2023-12-27 20:42:15,167][106225] Updated weights for policy 1, policy_version 205459 (0.0010) [2023-12-27 20:42:15,222][106225] Updated weights for policy 1, policy_version 205469 (0.0006) [2023-12-27 20:42:15,586][106226] Updated weights for policy 0, policy_version 205299 (0.0007) [2023-12-27 20:42:15,655][106226] Updated weights for policy 0, policy_version 205309 (0.0008) [2023-12-27 20:42:15,717][106226] Updated weights for policy 0, policy_version 205319 (0.0007) [2023-12-27 20:42:15,896][106225] Updated weights for policy 1, policy_version 205479 (0.0009) [2023-12-27 20:42:15,942][106225] Updated weights for policy 1, policy_version 205489 (0.0010) [2023-12-27 20:42:15,989][106225] Updated weights for policy 1, policy_version 205499 (0.0010) [2023-12-27 20:42:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 105193472. Throughput: 0: 9793.1, 1: 9834.4. Samples: 105179264. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:16,175][105115] Avg episode reward: [(0, '-5.309'), (1, '-6.442')] [2023-12-27 20:42:16,245][106226] Updated weights for policy 0, policy_version 205329 (0.0005) [2023-12-27 20:42:16,304][106226] Updated weights for policy 0, policy_version 205339 (0.0008) [2023-12-27 20:42:16,367][106226] Updated weights for policy 0, policy_version 205349 (0.0008) [2023-12-27 20:42:16,433][106226] Updated weights for policy 0, policy_version 205359 (0.0008) [2023-12-27 20:42:16,725][106225] Updated weights for policy 1, policy_version 205509 (0.0010) [2023-12-27 20:42:16,771][106225] Updated weights for policy 1, policy_version 205519 (0.0010) [2023-12-27 20:42:16,815][106225] Updated weights for policy 1, policy_version 205529 (0.0009) [2023-12-27 20:42:17,099][106226] Updated weights for policy 0, policy_version 205369 (0.0007) [2023-12-27 20:42:17,152][106226] Updated weights for policy 0, policy_version 205379 (0.0008) [2023-12-27 20:42:17,211][106226] Updated weights for policy 0, policy_version 205389 (0.0008) [2023-12-27 20:42:17,448][106225] Updated weights for policy 1, policy_version 205539 (0.0005) [2023-12-27 20:42:17,504][106225] Updated weights for policy 1, policy_version 205549 (0.0005) [2023-12-27 20:42:17,555][106225] Updated weights for policy 1, policy_version 205559 (0.0006) [2023-12-27 20:42:18,007][106226] Updated weights for policy 0, policy_version 205399 (0.0009) [2023-12-27 20:42:18,061][106226] Updated weights for policy 0, policy_version 205409 (0.0008) [2023-12-27 20:42:18,125][106226] Updated weights for policy 0, policy_version 205419 (0.0008) [2023-12-27 20:42:18,145][106225] Updated weights for policy 1, policy_version 205569 (0.0006) [2023-12-27 20:42:18,199][106225] Updated weights for policy 1, policy_version 205579 (0.0007) [2023-12-27 20:42:18,254][106225] Updated weights for policy 1, policy_version 205589 (0.0005) [2023-12-27 20:42:18,312][106225] Updated weights for policy 1, policy_version 205599 (0.0006) [2023-12-27 20:42:18,890][106226] Updated weights for policy 0, policy_version 205429 (0.0008) [2023-12-27 20:42:18,958][106226] Updated weights for policy 0, policy_version 205439 (0.0008) [2023-12-27 20:42:19,025][106226] Updated weights for policy 0, policy_version 205449 (0.0008) [2023-12-27 20:42:19,041][106225] Updated weights for policy 1, policy_version 205609 (0.0010) [2023-12-27 20:42:19,102][106225] Updated weights for policy 1, policy_version 205619 (0.0010) [2023-12-27 20:42:19,159][106225] Updated weights for policy 1, policy_version 205629 (0.0010) [2023-12-27 20:42:19,698][106226] Updated weights for policy 0, policy_version 205459 (0.0008) [2023-12-27 20:42:19,763][106226] Updated weights for policy 0, policy_version 205469 (0.0008) [2023-12-27 20:42:19,831][106226] Updated weights for policy 0, policy_version 205479 (0.0009) [2023-12-27 20:42:19,924][106225] Updated weights for policy 1, policy_version 205639 (0.0009) [2023-12-27 20:42:19,985][106225] Updated weights for policy 1, policy_version 205649 (0.0010) [2023-12-27 20:42:20,041][106225] Updated weights for policy 1, policy_version 205659 (0.0010) [2023-12-27 20:42:20,627][106226] Updated weights for policy 0, policy_version 205489 (0.0007) [2023-12-27 20:42:20,685][106226] Updated weights for policy 0, policy_version 205499 (0.0007) [2023-12-27 20:42:20,736][106225] Updated weights for policy 1, policy_version 205669 (0.0010) [2023-12-27 20:42:20,751][106226] Updated weights for policy 0, policy_version 205509 (0.0009) [2023-12-27 20:42:20,795][106225] Updated weights for policy 1, policy_version 205679 (0.0010) [2023-12-27 20:42:20,814][106226] Updated weights for policy 0, policy_version 205519 (0.0007) [2023-12-27 20:42:20,854][106225] Updated weights for policy 1, policy_version 205689 (0.0011) [2023-12-27 20:42:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 105291776. Throughput: 0: 9774.3, 1: 9841.2. Samples: 105299388. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:21,175][105115] Avg episode reward: [(0, '-5.291'), (1, '-5.679')] [2023-12-27 20:42:21,598][106226] Updated weights for policy 0, policy_version 205529 (0.0008) [2023-12-27 20:42:21,627][106225] Updated weights for policy 1, policy_version 205699 (0.0010) [2023-12-27 20:42:21,668][106226] Updated weights for policy 0, policy_version 205539 (0.0009) [2023-12-27 20:42:21,700][106225] Updated weights for policy 1, policy_version 205709 (0.0010) [2023-12-27 20:42:21,728][106226] Updated weights for policy 0, policy_version 205549 (0.0009) [2023-12-27 20:42:21,771][106225] Updated weights for policy 1, policy_version 205719 (0.0011) [2023-12-27 20:42:22,474][106226] Updated weights for policy 0, policy_version 205559 (0.0008) [2023-12-27 20:42:22,532][106226] Updated weights for policy 0, policy_version 205569 (0.0008) [2023-12-27 20:42:22,563][106225] Updated weights for policy 1, policy_version 205729 (0.0010) [2023-12-27 20:42:22,589][106226] Updated weights for policy 0, policy_version 205579 (0.0008) [2023-12-27 20:42:22,620][106225] Updated weights for policy 1, policy_version 205739 (0.0006) [2023-12-27 20:42:22,686][106225] Updated weights for policy 1, policy_version 205749 (0.0008) [2023-12-27 20:42:22,753][106225] Updated weights for policy 1, policy_version 205759 (0.0009) [2023-12-27 20:42:23,261][106226] Updated weights for policy 0, policy_version 205589 (0.0007) [2023-12-27 20:42:23,317][106226] Updated weights for policy 0, policy_version 205599 (0.0008) [2023-12-27 20:42:23,380][106226] Updated weights for policy 0, policy_version 205609 (0.0008) [2023-12-27 20:42:23,512][106225] Updated weights for policy 1, policy_version 205769 (0.0009) [2023-12-27 20:42:23,572][106225] Updated weights for policy 1, policy_version 205779 (0.0008) [2023-12-27 20:42:23,632][106225] Updated weights for policy 1, policy_version 205789 (0.0008) [2023-12-27 20:42:24,046][106226] Updated weights for policy 0, policy_version 205619 (0.0008) [2023-12-27 20:42:24,113][106226] Updated weights for policy 0, policy_version 205629 (0.0007) [2023-12-27 20:42:24,167][106226] Updated weights for policy 0, policy_version 205639 (0.0008) [2023-12-27 20:42:24,362][106225] Updated weights for policy 1, policy_version 205799 (0.0007) [2023-12-27 20:42:24,417][106225] Updated weights for policy 1, policy_version 205809 (0.0008) [2023-12-27 20:42:24,469][106225] Updated weights for policy 1, policy_version 205819 (0.0008) [2023-12-27 20:42:24,868][106226] Updated weights for policy 0, policy_version 205649 (0.0009) [2023-12-27 20:42:24,925][106226] Updated weights for policy 0, policy_version 205659 (0.0008) [2023-12-27 20:42:24,977][106226] Updated weights for policy 0, policy_version 205669 (0.0007) [2023-12-27 20:42:25,044][106226] Updated weights for policy 0, policy_version 205679 (0.0006) [2023-12-27 20:42:25,181][106225] Updated weights for policy 1, policy_version 205829 (0.0009) [2023-12-27 20:42:25,227][106225] Updated weights for policy 1, policy_version 205839 (0.0010) [2023-12-27 20:42:25,284][106225] Updated weights for policy 1, policy_version 205849 (0.0010) [2023-12-27 20:42:25,740][106226] Updated weights for policy 0, policy_version 205689 (0.0008) [2023-12-27 20:42:25,788][106226] Updated weights for policy 0, policy_version 205699 (0.0008) [2023-12-27 20:42:25,846][106226] Updated weights for policy 0, policy_version 205709 (0.0009) [2023-12-27 20:42:25,989][106225] Updated weights for policy 1, policy_version 205859 (0.0009) [2023-12-27 20:42:26,049][106225] Updated weights for policy 1, policy_version 205869 (0.0006) [2023-12-27 20:42:26,106][106225] Updated weights for policy 1, policy_version 205879 (0.0010) [2023-12-27 20:42:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 105390080. Throughput: 0: 9774.0, 1: 9746.5. Samples: 105355772. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:26,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-6.077')] [2023-12-27 20:42:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000205712_52674560.pth... [2023-12-27 20:42:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000205888_52715520.pth... [2023-12-27 20:42:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000204592_52387840.pth [2023-12-27 20:42:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000204736_52420608.pth [2023-12-27 20:42:26,477][106226] Updated weights for policy 0, policy_version 205719 (0.0006) [2023-12-27 20:42:26,542][106226] Updated weights for policy 0, policy_version 205729 (0.0006) [2023-12-27 20:42:26,609][106226] Updated weights for policy 0, policy_version 205739 (0.0010) [2023-12-27 20:42:26,688][106225] Updated weights for policy 1, policy_version 205889 (0.0010) [2023-12-27 20:42:26,742][106225] Updated weights for policy 1, policy_version 205899 (0.0008) [2023-12-27 20:42:26,797][106225] Updated weights for policy 1, policy_version 205909 (0.0007) [2023-12-27 20:42:26,845][106225] Updated weights for policy 1, policy_version 205919 (0.0008) [2023-12-27 20:42:27,315][106226] Updated weights for policy 0, policy_version 205749 (0.0008) [2023-12-27 20:42:27,370][106226] Updated weights for policy 0, policy_version 205759 (0.0005) [2023-12-27 20:42:27,438][106226] Updated weights for policy 0, policy_version 205769 (0.0005) [2023-12-27 20:42:27,449][106225] Updated weights for policy 1, policy_version 205929 (0.0008) [2023-12-27 20:42:27,496][106225] Updated weights for policy 1, policy_version 205939 (0.0008) [2023-12-27 20:42:27,550][106225] Updated weights for policy 1, policy_version 205950 (0.0009) [2023-12-27 20:42:28,069][106226] Updated weights for policy 0, policy_version 205779 (0.0006) [2023-12-27 20:42:28,121][106226] Updated weights for policy 0, policy_version 205789 (0.0008) [2023-12-27 20:42:28,188][106226] Updated weights for policy 0, policy_version 205799 (0.0009) [2023-12-27 20:42:28,291][106225] Updated weights for policy 1, policy_version 205960 (0.0006) [2023-12-27 20:42:28,360][106225] Updated weights for policy 1, policy_version 205970 (0.0008) [2023-12-27 20:42:28,423][106225] Updated weights for policy 1, policy_version 205980 (0.0008) [2023-12-27 20:42:28,947][106226] Updated weights for policy 0, policy_version 205809 (0.0008) [2023-12-27 20:42:29,012][106226] Updated weights for policy 0, policy_version 205819 (0.0005) [2023-12-27 20:42:29,074][106226] Updated weights for policy 0, policy_version 205829 (0.0005) [2023-12-27 20:42:29,094][106225] Updated weights for policy 1, policy_version 205990 (0.0008) [2023-12-27 20:42:29,138][106226] Updated weights for policy 0, policy_version 205839 (0.0008) [2023-12-27 20:42:29,154][106225] Updated weights for policy 1, policy_version 206000 (0.0007) [2023-12-27 20:42:29,202][106225] Updated weights for policy 1, policy_version 206010 (0.0008) [2023-12-27 20:42:29,812][106226] Updated weights for policy 0, policy_version 205849 (0.0009) [2023-12-27 20:42:29,873][106226] Updated weights for policy 0, policy_version 205859 (0.0008) [2023-12-27 20:42:29,926][106226] Updated weights for policy 0, policy_version 205869 (0.0008) [2023-12-27 20:42:29,941][106225] Updated weights for policy 1, policy_version 206020 (0.0009) [2023-12-27 20:42:30,000][106225] Updated weights for policy 1, policy_version 206030 (0.0009) [2023-12-27 20:42:30,052][106225] Updated weights for policy 1, policy_version 206040 (0.0010) [2023-12-27 20:42:30,717][106225] Updated weights for policy 1, policy_version 206050 (0.0010) [2023-12-27 20:42:30,719][106226] Updated weights for policy 0, policy_version 205879 (0.0007) [2023-12-27 20:42:30,766][106226] Updated weights for policy 0, policy_version 205889 (0.0007) [2023-12-27 20:42:30,769][106225] Updated weights for policy 1, policy_version 206060 (0.0010) [2023-12-27 20:42:30,819][106225] Updated weights for policy 1, policy_version 206070 (0.0010) [2023-12-27 20:42:30,823][106226] Updated weights for policy 0, policy_version 205899 (0.0007) [2023-12-27 20:42:30,871][106225] Updated weights for policy 1, policy_version 206080 (0.0010) [2023-12-27 20:42:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 105488384. Throughput: 0: 9795.6, 1: 9807.3. Samples: 105476168. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:31,175][105115] Avg episode reward: [(0, '-5.271'), (1, '-5.622')] [2023-12-27 20:42:31,176][106141] Saving new best policy, reward=-5.622! [2023-12-27 20:42:31,585][106226] Updated weights for policy 0, policy_version 205909 (0.0008) [2023-12-27 20:42:31,591][106225] Updated weights for policy 1, policy_version 206090 (0.0008) [2023-12-27 20:42:31,649][106226] Updated weights for policy 0, policy_version 205919 (0.0008) [2023-12-27 20:42:31,659][106225] Updated weights for policy 1, policy_version 206100 (0.0008) [2023-12-27 20:42:31,702][106226] Updated weights for policy 0, policy_version 205929 (0.0008) [2023-12-27 20:42:31,724][106225] Updated weights for policy 1, policy_version 206110 (0.0006) [2023-12-27 20:42:32,354][106226] Updated weights for policy 0, policy_version 205939 (0.0008) [2023-12-27 20:42:32,419][106226] Updated weights for policy 0, policy_version 205949 (0.0008) [2023-12-27 20:42:32,476][106225] Updated weights for policy 1, policy_version 206120 (0.0009) [2023-12-27 20:42:32,483][106226] Updated weights for policy 0, policy_version 205959 (0.0005) [2023-12-27 20:42:32,537][106225] Updated weights for policy 1, policy_version 206130 (0.0008) [2023-12-27 20:42:32,594][106225] Updated weights for policy 1, policy_version 206140 (0.0009) [2023-12-27 20:42:33,033][106226] Updated weights for policy 0, policy_version 205969 (0.0006) [2023-12-27 20:42:33,084][106226] Updated weights for policy 0, policy_version 205979 (0.0009) [2023-12-27 20:42:33,138][106226] Updated weights for policy 0, policy_version 205989 (0.0006) [2023-12-27 20:42:33,191][106226] Updated weights for policy 0, policy_version 205999 (0.0005) [2023-12-27 20:42:33,417][106225] Updated weights for policy 1, policy_version 206150 (0.0007) [2023-12-27 20:42:33,468][106225] Updated weights for policy 1, policy_version 206160 (0.0008) [2023-12-27 20:42:33,515][106225] Updated weights for policy 1, policy_version 206170 (0.0008) [2023-12-27 20:42:33,740][106226] Updated weights for policy 0, policy_version 206009 (0.0005) [2023-12-27 20:42:33,800][106226] Updated weights for policy 0, policy_version 206019 (0.0005) [2023-12-27 20:42:33,857][106226] Updated weights for policy 0, policy_version 206029 (0.0008) [2023-12-27 20:42:34,340][106225] Updated weights for policy 1, policy_version 206180 (0.0009) [2023-12-27 20:42:34,406][106225] Updated weights for policy 1, policy_version 206190 (0.0011) [2023-12-27 20:42:34,469][106225] Updated weights for policy 1, policy_version 206200 (0.0011) [2023-12-27 20:42:34,566][106226] Updated weights for policy 0, policy_version 206039 (0.0008) [2023-12-27 20:42:34,617][106226] Updated weights for policy 0, policy_version 206049 (0.0008) [2023-12-27 20:42:34,682][106226] Updated weights for policy 0, policy_version 206059 (0.0009) [2023-12-27 20:42:35,181][106225] Updated weights for policy 1, policy_version 206210 (0.0011) [2023-12-27 20:42:35,234][106225] Updated weights for policy 1, policy_version 206220 (0.0010) [2023-12-27 20:42:35,294][106225] Updated weights for policy 1, policy_version 206230 (0.0010) [2023-12-27 20:42:35,353][106225] Updated weights for policy 1, policy_version 206240 (0.0010) [2023-12-27 20:42:35,409][106226] Updated weights for policy 0, policy_version 206069 (0.0007) [2023-12-27 20:42:35,466][106226] Updated weights for policy 0, policy_version 206079 (0.0008) [2023-12-27 20:42:35,511][106226] Updated weights for policy 0, policy_version 206089 (0.0007) [2023-12-27 20:42:36,000][106225] Updated weights for policy 1, policy_version 206250 (0.0010) [2023-12-27 20:42:36,050][106225] Updated weights for policy 1, policy_version 206260 (0.0010) [2023-12-27 20:42:36,122][106225] Updated weights for policy 1, policy_version 206270 (0.0011) [2023-12-27 20:42:36,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 105586688. Throughput: 0: 9803.5, 1: 9784.7. Samples: 105593712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:36,176][105115] Avg episode reward: [(0, '-4.790'), (1, '-6.310')] [2023-12-27 20:42:36,304][106226] Updated weights for policy 0, policy_version 206099 (0.0008) [2023-12-27 20:42:36,368][106226] Updated weights for policy 0, policy_version 206109 (0.0008) [2023-12-27 20:42:36,434][106226] Updated weights for policy 0, policy_version 206119 (0.0011) [2023-12-27 20:42:36,851][106225] Updated weights for policy 1, policy_version 206280 (0.0006) [2023-12-27 20:42:36,918][106225] Updated weights for policy 1, policy_version 206290 (0.0005) [2023-12-27 20:42:36,977][106225] Updated weights for policy 1, policy_version 206300 (0.0006) [2023-12-27 20:42:37,099][106226] Updated weights for policy 0, policy_version 206129 (0.0010) [2023-12-27 20:42:37,153][106226] Updated weights for policy 0, policy_version 206139 (0.0005) [2023-12-27 20:42:37,207][106226] Updated weights for policy 0, policy_version 206149 (0.0005) [2023-12-27 20:42:37,264][106226] Updated weights for policy 0, policy_version 206159 (0.0006) [2023-12-27 20:42:37,635][106225] Updated weights for policy 1, policy_version 206310 (0.0007) [2023-12-27 20:42:37,691][106225] Updated weights for policy 1, policy_version 206320 (0.0007) [2023-12-27 20:42:37,740][106225] Updated weights for policy 1, policy_version 206330 (0.0008) [2023-12-27 20:42:37,945][106226] Updated weights for policy 0, policy_version 206169 (0.0011) [2023-12-27 20:42:38,004][106226] Updated weights for policy 0, policy_version 206179 (0.0011) [2023-12-27 20:42:38,068][106226] Updated weights for policy 0, policy_version 206189 (0.0011) [2023-12-27 20:42:38,422][106225] Updated weights for policy 1, policy_version 206340 (0.0007) [2023-12-27 20:42:38,472][106225] Updated weights for policy 1, policy_version 206350 (0.0007) [2023-12-27 20:42:38,525][106225] Updated weights for policy 1, policy_version 206360 (0.0007) [2023-12-27 20:42:38,796][106226] Updated weights for policy 0, policy_version 206199 (0.0010) [2023-12-27 20:42:38,852][106226] Updated weights for policy 0, policy_version 206209 (0.0009) [2023-12-27 20:42:38,904][106226] Updated weights for policy 0, policy_version 206219 (0.0010) [2023-12-27 20:42:39,233][106225] Updated weights for policy 1, policy_version 206370 (0.0008) [2023-12-27 20:42:39,298][106225] Updated weights for policy 1, policy_version 206380 (0.0008) [2023-12-27 20:42:39,364][106225] Updated weights for policy 1, policy_version 206390 (0.0008) [2023-12-27 20:42:39,440][106225] Updated weights for policy 1, policy_version 206400 (0.0008) [2023-12-27 20:42:39,636][106226] Updated weights for policy 0, policy_version 206229 (0.0010) [2023-12-27 20:42:39,694][106226] Updated weights for policy 0, policy_version 206239 (0.0011) [2023-12-27 20:42:39,745][106226] Updated weights for policy 0, policy_version 206249 (0.0011) [2023-12-27 20:42:40,216][106225] Updated weights for policy 1, policy_version 206410 (0.0007) [2023-12-27 20:42:40,281][106225] Updated weights for policy 1, policy_version 206420 (0.0008) [2023-12-27 20:42:40,347][106225] Updated weights for policy 1, policy_version 206430 (0.0007) [2023-12-27 20:42:40,431][106226] Updated weights for policy 0, policy_version 206259 (0.0011) [2023-12-27 20:42:40,496][106226] Updated weights for policy 0, policy_version 206269 (0.0011) [2023-12-27 20:42:40,563][106226] Updated weights for policy 0, policy_version 206279 (0.0009) [2023-12-27 20:42:41,017][106225] Updated weights for policy 1, policy_version 206440 (0.0008) [2023-12-27 20:42:41,085][106225] Updated weights for policy 1, policy_version 206450 (0.0008) [2023-12-27 20:42:41,153][106225] Updated weights for policy 1, policy_version 206460 (0.0009) [2023-12-27 20:42:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 105676800. Throughput: 0: 9796.7, 1: 9811.3. Samples: 105653248. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:41,175][105115] Avg episode reward: [(0, '-5.108'), (1, '-6.240')] [2023-12-27 20:42:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000206464_52862976.pth... [2023-12-27 20:42:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000206288_52822016.pth... [2023-12-27 20:42:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000205312_52568064.pth [2023-12-27 20:42:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000205136_52527104.pth [2023-12-27 20:42:41,321][106226] Updated weights for policy 0, policy_version 206289 (0.0008) [2023-12-27 20:42:41,398][106226] Updated weights for policy 0, policy_version 206299 (0.0010) [2023-12-27 20:42:41,461][106226] Updated weights for policy 0, policy_version 206309 (0.0009) [2023-12-27 20:42:41,521][106226] Updated weights for policy 0, policy_version 206319 (0.0007) [2023-12-27 20:42:41,908][106225] Updated weights for policy 1, policy_version 206470 (0.0009) [2023-12-27 20:42:41,971][106225] Updated weights for policy 1, policy_version 206480 (0.0008) [2023-12-27 20:42:42,036][106225] Updated weights for policy 1, policy_version 206490 (0.0009) [2023-12-27 20:42:42,248][106226] Updated weights for policy 0, policy_version 206329 (0.0008) [2023-12-27 20:42:42,310][106226] Updated weights for policy 0, policy_version 206339 (0.0008) [2023-12-27 20:42:42,371][106226] Updated weights for policy 0, policy_version 206349 (0.0009) [2023-12-27 20:42:42,769][106225] Updated weights for policy 1, policy_version 206500 (0.0008) [2023-12-27 20:42:42,823][106225] Updated weights for policy 1, policy_version 206510 (0.0009) [2023-12-27 20:42:42,877][106225] Updated weights for policy 1, policy_version 206520 (0.0007) [2023-12-27 20:42:43,115][106226] Updated weights for policy 0, policy_version 206359 (0.0008) [2023-12-27 20:42:43,160][106226] Updated weights for policy 0, policy_version 206369 (0.0008) [2023-12-27 20:42:43,205][106226] Updated weights for policy 0, policy_version 206379 (0.0008) [2023-12-27 20:42:43,604][106225] Updated weights for policy 1, policy_version 206530 (0.0006) [2023-12-27 20:42:43,662][106225] Updated weights for policy 1, policy_version 206540 (0.0008) [2023-12-27 20:42:43,719][106225] Updated weights for policy 1, policy_version 206550 (0.0008) [2023-12-27 20:42:43,774][106225] Updated weights for policy 1, policy_version 206560 (0.0008) [2023-12-27 20:42:43,918][106226] Updated weights for policy 0, policy_version 206389 (0.0009) [2023-12-27 20:42:43,978][106226] Updated weights for policy 0, policy_version 206399 (0.0008) [2023-12-27 20:42:44,034][106226] Updated weights for policy 0, policy_version 206409 (0.0008) [2023-12-27 20:42:44,394][106225] Updated weights for policy 1, policy_version 206570 (0.0008) [2023-12-27 20:42:44,451][106225] Updated weights for policy 1, policy_version 206580 (0.0008) [2023-12-27 20:42:44,503][106225] Updated weights for policy 1, policy_version 206590 (0.0009) [2023-12-27 20:42:44,817][106226] Updated weights for policy 0, policy_version 206419 (0.0009) [2023-12-27 20:42:44,888][106226] Updated weights for policy 0, policy_version 206429 (0.0011) [2023-12-27 20:42:44,959][106226] Updated weights for policy 0, policy_version 206439 (0.0011) [2023-12-27 20:42:45,178][106225] Updated weights for policy 1, policy_version 206600 (0.0006) [2023-12-27 20:42:45,238][106225] Updated weights for policy 1, policy_version 206610 (0.0010) [2023-12-27 20:42:45,301][106225] Updated weights for policy 1, policy_version 206620 (0.0010) [2023-12-27 20:42:45,657][106226] Updated weights for policy 0, policy_version 206449 (0.0009) [2023-12-27 20:42:45,716][106226] Updated weights for policy 0, policy_version 206459 (0.0010) [2023-12-27 20:42:45,773][106226] Updated weights for policy 0, policy_version 206469 (0.0010) [2023-12-27 20:42:45,823][106226] Updated weights for policy 0, policy_version 206479 (0.0010) [2023-12-27 20:42:45,878][106225] Updated weights for policy 1, policy_version 206630 (0.0007) [2023-12-27 20:42:45,936][106225] Updated weights for policy 1, policy_version 206640 (0.0010) [2023-12-27 20:42:45,982][106225] Updated weights for policy 1, policy_version 206650 (0.0010) [2023-12-27 20:42:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 105783296. Throughput: 0: 9757.0, 1: 9796.0. Samples: 105768036. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:46,176][105115] Avg episode reward: [(0, '-4.769'), (1, '-6.329')] [2023-12-27 20:42:46,425][106226] Updated weights for policy 0, policy_version 206489 (0.0006) [2023-12-27 20:42:46,474][106226] Updated weights for policy 0, policy_version 206499 (0.0005) [2023-12-27 20:42:46,527][106226] Updated weights for policy 0, policy_version 206509 (0.0007) [2023-12-27 20:42:46,692][106225] Updated weights for policy 1, policy_version 206660 (0.0010) [2023-12-27 20:42:46,749][106225] Updated weights for policy 1, policy_version 206670 (0.0010) [2023-12-27 20:42:46,807][106225] Updated weights for policy 1, policy_version 206680 (0.0007) [2023-12-27 20:42:47,208][106226] Updated weights for policy 0, policy_version 206519 (0.0009) [2023-12-27 20:42:47,264][106226] Updated weights for policy 0, policy_version 206529 (0.0010) [2023-12-27 20:42:47,323][106226] Updated weights for policy 0, policy_version 206539 (0.0010) [2023-12-27 20:42:47,362][106225] Updated weights for policy 1, policy_version 206690 (0.0008) [2023-12-27 20:42:47,417][106225] Updated weights for policy 1, policy_version 206700 (0.0009) [2023-12-27 20:42:47,474][106225] Updated weights for policy 1, policy_version 206710 (0.0010) [2023-12-27 20:42:47,532][106225] Updated weights for policy 1, policy_version 206720 (0.0009) [2023-12-27 20:42:47,949][106226] Updated weights for policy 0, policy_version 206549 (0.0007) [2023-12-27 20:42:48,014][106226] Updated weights for policy 0, policy_version 206559 (0.0006) [2023-12-27 20:42:48,076][106226] Updated weights for policy 0, policy_version 206569 (0.0010) [2023-12-27 20:42:48,163][106225] Updated weights for policy 1, policy_version 206730 (0.0007) [2023-12-27 20:42:48,220][106225] Updated weights for policy 1, policy_version 206740 (0.0008) [2023-12-27 20:42:48,289][106225] Updated weights for policy 1, policy_version 206750 (0.0010) [2023-12-27 20:42:48,753][106226] Updated weights for policy 0, policy_version 206579 (0.0009) [2023-12-27 20:42:48,813][106226] Updated weights for policy 0, policy_version 206589 (0.0008) [2023-12-27 20:42:48,863][106226] Updated weights for policy 0, policy_version 206599 (0.0007) [2023-12-27 20:42:49,028][106225] Updated weights for policy 1, policy_version 206760 (0.0010) [2023-12-27 20:42:49,082][106225] Updated weights for policy 1, policy_version 206770 (0.0010) [2023-12-27 20:42:49,135][106225] Updated weights for policy 1, policy_version 206780 (0.0010) [2023-12-27 20:42:49,610][106226] Updated weights for policy 0, policy_version 206609 (0.0008) [2023-12-27 20:42:49,673][106226] Updated weights for policy 0, policy_version 206619 (0.0009) [2023-12-27 20:42:49,732][106226] Updated weights for policy 0, policy_version 206629 (0.0009) [2023-12-27 20:42:49,799][106226] Updated weights for policy 0, policy_version 206639 (0.0008) [2023-12-27 20:42:49,852][106225] Updated weights for policy 1, policy_version 206790 (0.0009) [2023-12-27 20:42:49,911][106225] Updated weights for policy 1, policy_version 206800 (0.0008) [2023-12-27 20:42:49,978][106225] Updated weights for policy 1, policy_version 206810 (0.0008) [2023-12-27 20:42:50,546][106226] Updated weights for policy 0, policy_version 206649 (0.0008) [2023-12-27 20:42:50,628][106226] Updated weights for policy 0, policy_version 206659 (0.0009) [2023-12-27 20:42:50,691][106226] Updated weights for policy 0, policy_version 206669 (0.0008) [2023-12-27 20:42:50,741][106225] Updated weights for policy 1, policy_version 206820 (0.0008) [2023-12-27 20:42:50,794][106225] Updated weights for policy 1, policy_version 206830 (0.0008) [2023-12-27 20:42:50,844][106225] Updated weights for policy 1, policy_version 206840 (0.0008) [2023-12-27 20:42:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 105881600. Throughput: 0: 9765.2, 1: 9849.4. Samples: 105889664. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:51,175][105115] Avg episode reward: [(0, '-4.994'), (1, '-6.092')] [2023-12-27 20:42:51,451][106226] Updated weights for policy 0, policy_version 206679 (0.0007) [2023-12-27 20:42:51,516][106226] Updated weights for policy 0, policy_version 206689 (0.0007) [2023-12-27 20:42:51,577][106226] Updated weights for policy 0, policy_version 206699 (0.0010) [2023-12-27 20:42:51,597][106225] Updated weights for policy 1, policy_version 206850 (0.0008) [2023-12-27 20:42:51,678][106225] Updated weights for policy 1, policy_version 206860 (0.0008) [2023-12-27 20:42:51,749][106225] Updated weights for policy 1, policy_version 206870 (0.0007) [2023-12-27 20:42:51,815][106225] Updated weights for policy 1, policy_version 206880 (0.0006) [2023-12-27 20:42:52,331][106226] Updated weights for policy 0, policy_version 206709 (0.0008) [2023-12-27 20:42:52,398][106226] Updated weights for policy 0, policy_version 206719 (0.0009) [2023-12-27 20:42:52,446][106225] Updated weights for policy 1, policy_version 206890 (0.0008) [2023-12-27 20:42:52,455][106226] Updated weights for policy 0, policy_version 206729 (0.0008) [2023-12-27 20:42:52,507][106225] Updated weights for policy 1, policy_version 206900 (0.0007) [2023-12-27 20:42:52,571][106225] Updated weights for policy 1, policy_version 206910 (0.0008) [2023-12-27 20:42:53,121][106226] Updated weights for policy 0, policy_version 206739 (0.0006) [2023-12-27 20:42:53,178][106226] Updated weights for policy 0, policy_version 206749 (0.0006) [2023-12-27 20:42:53,236][106226] Updated weights for policy 0, policy_version 206759 (0.0008) [2023-12-27 20:42:53,309][106225] Updated weights for policy 1, policy_version 206920 (0.0006) [2023-12-27 20:42:53,369][106225] Updated weights for policy 1, policy_version 206930 (0.0005) [2023-12-27 20:42:53,430][106225] Updated weights for policy 1, policy_version 206940 (0.0006) [2023-12-27 20:42:53,871][106226] Updated weights for policy 0, policy_version 206769 (0.0009) [2023-12-27 20:42:53,934][106226] Updated weights for policy 0, policy_version 206779 (0.0008) [2023-12-27 20:42:53,988][106226] Updated weights for policy 0, policy_version 206789 (0.0006) [2023-12-27 20:42:54,052][106226] Updated weights for policy 0, policy_version 206799 (0.0006) [2023-12-27 20:42:54,084][106225] Updated weights for policy 1, policy_version 206950 (0.0009) [2023-12-27 20:42:54,156][106225] Updated weights for policy 1, policy_version 206960 (0.0009) [2023-12-27 20:42:54,225][106225] Updated weights for policy 1, policy_version 206970 (0.0008) [2023-12-27 20:42:54,698][106226] Updated weights for policy 0, policy_version 206809 (0.0010) [2023-12-27 20:42:54,742][106226] Updated weights for policy 0, policy_version 206819 (0.0008) [2023-12-27 20:42:54,787][106226] Updated weights for policy 0, policy_version 206829 (0.0008) [2023-12-27 20:42:54,883][106225] Updated weights for policy 1, policy_version 206980 (0.0008) [2023-12-27 20:42:54,929][106225] Updated weights for policy 1, policy_version 206990 (0.0007) [2023-12-27 20:42:54,986][106225] Updated weights for policy 1, policy_version 207000 (0.0007) [2023-12-27 20:42:55,558][106226] Updated weights for policy 0, policy_version 206839 (0.0008) [2023-12-27 20:42:55,613][106226] Updated weights for policy 0, policy_version 206849 (0.0007) [2023-12-27 20:42:55,668][106226] Updated weights for policy 0, policy_version 206859 (0.0008) [2023-12-27 20:42:55,722][106225] Updated weights for policy 1, policy_version 207010 (0.0009) [2023-12-27 20:42:55,777][106225] Updated weights for policy 1, policy_version 207020 (0.0006) [2023-12-27 20:42:55,837][106225] Updated weights for policy 1, policy_version 207030 (0.0008) [2023-12-27 20:42:55,889][106225] Updated weights for policy 1, policy_version 207040 (0.0009) [2023-12-27 20:42:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.6, 300 sec: 19827.4). Total num frames: 105979904. Throughput: 0: 9813.6, 1: 9886.8. Samples: 105949112. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 20:42:56,176][105115] Avg episode reward: [(0, '-5.167'), (1, '-5.834')] [2023-12-27 20:42:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000207040_53010432.pth... [2023-12-27 20:42:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000206864_52969472.pth... [2023-12-27 20:42:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000205712_52674560.pth [2023-12-27 20:42:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000205888_52715520.pth [2023-12-27 20:42:56,431][106226] Updated weights for policy 0, policy_version 206869 (0.0008) [2023-12-27 20:42:56,480][106226] Updated weights for policy 0, policy_version 206879 (0.0007) [2023-12-27 20:42:56,503][106225] Updated weights for policy 1, policy_version 207050 (0.0008) [2023-12-27 20:42:56,525][106226] Updated weights for policy 0, policy_version 206889 (0.0007) [2023-12-27 20:42:56,560][106225] Updated weights for policy 1, policy_version 207060 (0.0007) [2023-12-27 20:42:56,618][106225] Updated weights for policy 1, policy_version 207070 (0.0008) [2023-12-27 20:42:57,254][106225] Updated weights for policy 1, policy_version 207080 (0.0007) [2023-12-27 20:42:57,298][106226] Updated weights for policy 0, policy_version 206899 (0.0007) [2023-12-27 20:42:57,318][106225] Updated weights for policy 1, policy_version 207090 (0.0007) [2023-12-27 20:42:57,356][106226] Updated weights for policy 0, policy_version 206909 (0.0007) [2023-12-27 20:42:57,373][106225] Updated weights for policy 1, policy_version 207100 (0.0007) [2023-12-27 20:42:57,418][106226] Updated weights for policy 0, policy_version 206919 (0.0009) [2023-12-27 20:42:57,890][106225] Updated weights for policy 1, policy_version 207110 (0.0007) [2023-12-27 20:42:57,940][106225] Updated weights for policy 1, policy_version 207120 (0.0006) [2023-12-27 20:42:57,989][106225] Updated weights for policy 1, policy_version 207130 (0.0008) [2023-12-27 20:42:58,194][106226] Updated weights for policy 0, policy_version 206929 (0.0009) [2023-12-27 20:42:58,254][106226] Updated weights for policy 0, policy_version 206939 (0.0009) [2023-12-27 20:42:58,310][106226] Updated weights for policy 0, policy_version 206949 (0.0008) [2023-12-27 20:42:58,378][106226] Updated weights for policy 0, policy_version 206959 (0.0008) [2023-12-27 20:42:58,757][106225] Updated weights for policy 1, policy_version 207140 (0.0008) [2023-12-27 20:42:58,824][106225] Updated weights for policy 1, policy_version 207150 (0.0008) [2023-12-27 20:42:58,892][106225] Updated weights for policy 1, policy_version 207160 (0.0008) [2023-12-27 20:42:59,231][106226] Updated weights for policy 0, policy_version 206969 (0.0010) [2023-12-27 20:42:59,300][106226] Updated weights for policy 0, policy_version 206979 (0.0009) [2023-12-27 20:42:59,373][106226] Updated weights for policy 0, policy_version 206989 (0.0008) [2023-12-27 20:42:59,648][106225] Updated weights for policy 1, policy_version 207170 (0.0009) [2023-12-27 20:42:59,704][106225] Updated weights for policy 1, policy_version 207180 (0.0008) [2023-12-27 20:42:59,758][106225] Updated weights for policy 1, policy_version 207190 (0.0006) [2023-12-27 20:42:59,818][106225] Updated weights for policy 1, policy_version 207200 (0.0009) [2023-12-27 20:43:00,063][106226] Updated weights for policy 0, policy_version 206999 (0.0006) [2023-12-27 20:43:00,122][106226] Updated weights for policy 0, policy_version 207009 (0.0010) [2023-12-27 20:43:00,184][106226] Updated weights for policy 0, policy_version 207019 (0.0009) [2023-12-27 20:43:00,503][106225] Updated weights for policy 1, policy_version 207210 (0.0008) [2023-12-27 20:43:00,559][106225] Updated weights for policy 1, policy_version 207220 (0.0008) [2023-12-27 20:43:00,620][106225] Updated weights for policy 1, policy_version 207230 (0.0008) [2023-12-27 20:43:00,847][106226] Updated weights for policy 0, policy_version 207029 (0.0007) [2023-12-27 20:43:00,897][106226] Updated weights for policy 0, policy_version 207039 (0.0005) [2023-12-27 20:43:00,963][106226] Updated weights for policy 0, policy_version 207049 (0.0005) [2023-12-27 20:43:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 106078208. Throughput: 0: 9801.0, 1: 9904.2. Samples: 106065996. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:01,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-6.173')] [2023-12-27 20:43:01,449][106225] Updated weights for policy 1, policy_version 207240 (0.0009) [2023-12-27 20:43:01,518][106225] Updated weights for policy 1, policy_version 207250 (0.0009) [2023-12-27 20:43:01,572][106226] Updated weights for policy 0, policy_version 207059 (0.0006) [2023-12-27 20:43:01,575][106225] Updated weights for policy 1, policy_version 207260 (0.0007) [2023-12-27 20:43:01,636][106226] Updated weights for policy 0, policy_version 207069 (0.0007) [2023-12-27 20:43:01,706][106226] Updated weights for policy 0, policy_version 207079 (0.0008) [2023-12-27 20:43:02,245][106225] Updated weights for policy 1, policy_version 207270 (0.0006) [2023-12-27 20:43:02,301][106225] Updated weights for policy 1, policy_version 207280 (0.0007) [2023-12-27 20:43:02,347][106225] Updated weights for policy 1, policy_version 207290 (0.0006) [2023-12-27 20:43:02,354][106226] Updated weights for policy 0, policy_version 207089 (0.0008) [2023-12-27 20:43:02,411][106226] Updated weights for policy 0, policy_version 207099 (0.0008) [2023-12-27 20:43:02,468][106226] Updated weights for policy 0, policy_version 207109 (0.0006) [2023-12-27 20:43:02,525][106226] Updated weights for policy 0, policy_version 207119 (0.0005) [2023-12-27 20:43:03,093][106225] Updated weights for policy 1, policy_version 207300 (0.0008) [2023-12-27 20:43:03,138][106225] Updated weights for policy 1, policy_version 207310 (0.0008) [2023-12-27 20:43:03,185][106225] Updated weights for policy 1, policy_version 207320 (0.0005) [2023-12-27 20:43:03,227][106226] Updated weights for policy 0, policy_version 207129 (0.0007) [2023-12-27 20:43:03,285][106226] Updated weights for policy 0, policy_version 207139 (0.0009) [2023-12-27 20:43:03,343][106226] Updated weights for policy 0, policy_version 207149 (0.0009) [2023-12-27 20:43:03,854][106225] Updated weights for policy 1, policy_version 207330 (0.0006) [2023-12-27 20:43:03,920][106225] Updated weights for policy 1, policy_version 207341 (0.0006) [2023-12-27 20:43:03,966][106226] Updated weights for policy 0, policy_version 207159 (0.0009) [2023-12-27 20:43:03,984][106225] Updated weights for policy 1, policy_version 207351 (0.0006) [2023-12-27 20:43:04,021][106226] Updated weights for policy 0, policy_version 207169 (0.0008) [2023-12-27 20:43:04,083][106226] Updated weights for policy 0, policy_version 207179 (0.0010) [2023-12-27 20:43:04,639][106225] Updated weights for policy 1, policy_version 207361 (0.0006) [2023-12-27 20:43:04,691][106225] Updated weights for policy 1, policy_version 207371 (0.0009) [2023-12-27 20:43:04,742][106225] Updated weights for policy 1, policy_version 207381 (0.0007) [2023-12-27 20:43:04,745][106226] Updated weights for policy 0, policy_version 207189 (0.0007) [2023-12-27 20:43:04,789][106225] Updated weights for policy 1, policy_version 207391 (0.0008) [2023-12-27 20:43:04,793][106226] Updated weights for policy 0, policy_version 207199 (0.0005) [2023-12-27 20:43:04,841][106226] Updated weights for policy 0, policy_version 207209 (0.0007) [2023-12-27 20:43:05,483][106225] Updated weights for policy 1, policy_version 207401 (0.0008) [2023-12-27 20:43:05,498][106226] Updated weights for policy 0, policy_version 207219 (0.0005) [2023-12-27 20:43:05,542][106225] Updated weights for policy 1, policy_version 207411 (0.0008) [2023-12-27 20:43:05,555][106226] Updated weights for policy 0, policy_version 207229 (0.0008) [2023-12-27 20:43:05,593][106225] Updated weights for policy 1, policy_version 207421 (0.0006) [2023-12-27 20:43:05,610][106226] Updated weights for policy 0, policy_version 207239 (0.0008) [2023-12-27 20:43:06,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 106176512. Throughput: 0: 9896.3, 1: 9879.9. Samples: 106189312. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:06,175][105115] Avg episode reward: [(0, '-5.088'), (1, '-6.042')] [2023-12-27 20:43:06,251][106226] Updated weights for policy 0, policy_version 207249 (0.0008) [2023-12-27 20:43:06,321][106226] Updated weights for policy 0, policy_version 207259 (0.0009) [2023-12-27 20:43:06,377][106225] Updated weights for policy 1, policy_version 207431 (0.0007) [2023-12-27 20:43:06,379][106226] Updated weights for policy 0, policy_version 207269 (0.0006) [2023-12-27 20:43:06,433][106225] Updated weights for policy 1, policy_version 207441 (0.0006) [2023-12-27 20:43:06,435][106226] Updated weights for policy 0, policy_version 207279 (0.0006) [2023-12-27 20:43:06,481][106225] Updated weights for policy 1, policy_version 207451 (0.0008) [2023-12-27 20:43:07,068][106226] Updated weights for policy 0, policy_version 207289 (0.0008) [2023-12-27 20:43:07,118][106226] Updated weights for policy 0, policy_version 207299 (0.0009) [2023-12-27 20:43:07,168][106226] Updated weights for policy 0, policy_version 207309 (0.0009) [2023-12-27 20:43:07,262][106225] Updated weights for policy 1, policy_version 207461 (0.0008) [2023-12-27 20:43:07,307][106225] Updated weights for policy 1, policy_version 207471 (0.0008) [2023-12-27 20:43:07,364][106225] Updated weights for policy 1, policy_version 207481 (0.0008) [2023-12-27 20:43:07,951][106226] Updated weights for policy 0, policy_version 207319 (0.0010) [2023-12-27 20:43:08,014][106226] Updated weights for policy 0, policy_version 207329 (0.0008) [2023-12-27 20:43:08,028][106225] Updated weights for policy 1, policy_version 207491 (0.0008) [2023-12-27 20:43:08,069][106226] Updated weights for policy 0, policy_version 207339 (0.0005) [2023-12-27 20:43:08,085][106225] Updated weights for policy 1, policy_version 207501 (0.0008) [2023-12-27 20:43:08,137][106225] Updated weights for policy 1, policy_version 207511 (0.0009) [2023-12-27 20:43:08,624][106226] Updated weights for policy 0, policy_version 207349 (0.0007) [2023-12-27 20:43:08,685][106226] Updated weights for policy 0, policy_version 207359 (0.0009) [2023-12-27 20:43:08,743][106226] Updated weights for policy 0, policy_version 207369 (0.0007) [2023-12-27 20:43:08,981][106225] Updated weights for policy 1, policy_version 207521 (0.0009) [2023-12-27 20:43:09,042][106225] Updated weights for policy 1, policy_version 207531 (0.0009) [2023-12-27 20:43:09,101][106225] Updated weights for policy 1, policy_version 207541 (0.0009) [2023-12-27 20:43:09,159][106225] Updated weights for policy 1, policy_version 207551 (0.0008) [2023-12-27 20:43:09,363][106226] Updated weights for policy 0, policy_version 207379 (0.0007) [2023-12-27 20:43:09,436][106226] Updated weights for policy 0, policy_version 207389 (0.0008) [2023-12-27 20:43:09,503][106226] Updated weights for policy 0, policy_version 207399 (0.0009) [2023-12-27 20:43:09,966][106225] Updated weights for policy 1, policy_version 207561 (0.0008) [2023-12-27 20:43:10,023][106225] Updated weights for policy 1, policy_version 207571 (0.0009) [2023-12-27 20:43:10,090][106225] Updated weights for policy 1, policy_version 207581 (0.0009) [2023-12-27 20:43:10,229][106226] Updated weights for policy 0, policy_version 207409 (0.0008) [2023-12-27 20:43:10,288][106226] Updated weights for policy 0, policy_version 207419 (0.0005) [2023-12-27 20:43:10,350][106226] Updated weights for policy 0, policy_version 207429 (0.0007) [2023-12-27 20:43:10,414][106226] Updated weights for policy 0, policy_version 207439 (0.0009) [2023-12-27 20:43:10,845][106225] Updated weights for policy 1, policy_version 207591 (0.0008) [2023-12-27 20:43:10,905][106225] Updated weights for policy 1, policy_version 207601 (0.0008) [2023-12-27 20:43:10,960][106225] Updated weights for policy 1, policy_version 207611 (0.0009) [2023-12-27 20:43:11,095][106226] Updated weights for policy 0, policy_version 207449 (0.0010) [2023-12-27 20:43:11,162][106226] Updated weights for policy 0, policy_version 207459 (0.0010) [2023-12-27 20:43:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 106274816. Throughput: 0: 9941.4, 1: 9896.6. Samples: 106248484. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:11,175][105115] Avg episode reward: [(0, '-5.050'), (1, '-6.292')] [2023-12-27 20:43:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000207616_53157888.pth... [2023-12-27 20:43:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000206464_52862976.pth [2023-12-27 20:43:11,223][106226] Updated weights for policy 0, policy_version 207469 (0.0007) [2023-12-27 20:43:11,239][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000207472_53125120.pth... [2023-12-27 20:43:11,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000206288_52822016.pth [2023-12-27 20:43:11,815][106225] Updated weights for policy 1, policy_version 207621 (0.0008) [2023-12-27 20:43:11,871][106225] Updated weights for policy 1, policy_version 207631 (0.0008) [2023-12-27 20:43:11,930][106225] Updated weights for policy 1, policy_version 207641 (0.0008) [2023-12-27 20:43:12,053][106226] Updated weights for policy 0, policy_version 207479 (0.0011) [2023-12-27 20:43:12,124][106226] Updated weights for policy 0, policy_version 207489 (0.0011) [2023-12-27 20:43:12,175][106226] Updated weights for policy 0, policy_version 207499 (0.0011) [2023-12-27 20:43:12,616][106225] Updated weights for policy 1, policy_version 207651 (0.0007) [2023-12-27 20:43:12,678][106225] Updated weights for policy 1, policy_version 207661 (0.0008) [2023-12-27 20:43:12,735][106225] Updated weights for policy 1, policy_version 207671 (0.0007) [2023-12-27 20:43:12,883][106226] Updated weights for policy 0, policy_version 207509 (0.0010) [2023-12-27 20:43:12,937][106226] Updated weights for policy 0, policy_version 207519 (0.0010) [2023-12-27 20:43:12,990][106226] Updated weights for policy 0, policy_version 207529 (0.0010) [2023-12-27 20:43:13,461][106225] Updated weights for policy 1, policy_version 207681 (0.0007) [2023-12-27 20:43:13,517][106225] Updated weights for policy 1, policy_version 207691 (0.0008) [2023-12-27 20:43:13,565][106225] Updated weights for policy 1, policy_version 207701 (0.0008) [2023-12-27 20:43:13,613][106225] Updated weights for policy 1, policy_version 207711 (0.0008) [2023-12-27 20:43:13,682][106226] Updated weights for policy 0, policy_version 207539 (0.0010) [2023-12-27 20:43:13,731][106226] Updated weights for policy 0, policy_version 207549 (0.0008) [2023-12-27 20:43:13,781][106226] Updated weights for policy 0, policy_version 207559 (0.0009) [2023-12-27 20:43:14,363][106225] Updated weights for policy 1, policy_version 207721 (0.0008) [2023-12-27 20:43:14,392][106226] Updated weights for policy 0, policy_version 207569 (0.0008) [2023-12-27 20:43:14,426][106225] Updated weights for policy 1, policy_version 207731 (0.0009) [2023-12-27 20:43:14,455][106226] Updated weights for policy 0, policy_version 207579 (0.0006) [2023-12-27 20:43:14,481][106225] Updated weights for policy 1, policy_version 207741 (0.0010) [2023-12-27 20:43:14,507][106226] Updated weights for policy 0, policy_version 207589 (0.0006) [2023-12-27 20:43:14,560][106226] Updated weights for policy 0, policy_version 207599 (0.0007) [2023-12-27 20:43:15,226][106225] Updated weights for policy 1, policy_version 207751 (0.0009) [2023-12-27 20:43:15,262][106226] Updated weights for policy 0, policy_version 207609 (0.0008) [2023-12-27 20:43:15,282][106225] Updated weights for policy 1, policy_version 207761 (0.0005) [2023-12-27 20:43:15,323][106226] Updated weights for policy 0, policy_version 207619 (0.0009) [2023-12-27 20:43:15,338][106225] Updated weights for policy 1, policy_version 207771 (0.0009) [2023-12-27 20:43:15,377][106226] Updated weights for policy 0, policy_version 207629 (0.0008) [2023-12-27 20:43:16,025][106225] Updated weights for policy 1, policy_version 207781 (0.0010) [2023-12-27 20:43:16,068][106226] Updated weights for policy 0, policy_version 207639 (0.0005) [2023-12-27 20:43:16,072][106225] Updated weights for policy 1, policy_version 207791 (0.0010) [2023-12-27 20:43:16,124][106226] Updated weights for policy 0, policy_version 207649 (0.0005) [2023-12-27 20:43:16,129][106225] Updated weights for policy 1, policy_version 207801 (0.0010) [2023-12-27 20:43:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 106373120. Throughput: 0: 9921.8, 1: 9769.3. Samples: 106362264. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:16,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-6.189')] [2023-12-27 20:43:16,177][106226] Updated weights for policy 0, policy_version 207659 (0.0006) [2023-12-27 20:43:16,808][106226] Updated weights for policy 0, policy_version 207669 (0.0006) [2023-12-27 20:43:16,869][106225] Updated weights for policy 1, policy_version 207811 (0.0010) [2023-12-27 20:43:16,875][106226] Updated weights for policy 0, policy_version 207679 (0.0006) [2023-12-27 20:43:16,919][106225] Updated weights for policy 1, policy_version 207821 (0.0010) [2023-12-27 20:43:16,921][106226] Updated weights for policy 0, policy_version 207689 (0.0006) [2023-12-27 20:43:16,970][106225] Updated weights for policy 1, policy_version 207831 (0.0010) [2023-12-27 20:43:17,500][106226] Updated weights for policy 0, policy_version 207699 (0.0007) [2023-12-27 20:43:17,550][106226] Updated weights for policy 0, policy_version 207709 (0.0010) [2023-12-27 20:43:17,600][106226] Updated weights for policy 0, policy_version 207719 (0.0010) [2023-12-27 20:43:17,701][106225] Updated weights for policy 1, policy_version 207841 (0.0010) [2023-12-27 20:43:17,763][106225] Updated weights for policy 1, policy_version 207851 (0.0010) [2023-12-27 20:43:17,819][106225] Updated weights for policy 1, policy_version 207861 (0.0010) [2023-12-27 20:43:17,875][106225] Updated weights for policy 1, policy_version 207871 (0.0010) [2023-12-27 20:43:18,223][106226] Updated weights for policy 0, policy_version 207729 (0.0009) [2023-12-27 20:43:18,306][106226] Updated weights for policy 0, policy_version 207739 (0.0010) [2023-12-27 20:43:18,366][106226] Updated weights for policy 0, policy_version 207749 (0.0008) [2023-12-27 20:43:18,430][106226] Updated weights for policy 0, policy_version 207759 (0.0011) [2023-12-27 20:43:18,502][106225] Updated weights for policy 1, policy_version 207881 (0.0008) [2023-12-27 20:43:18,566][106225] Updated weights for policy 1, policy_version 207891 (0.0008) [2023-12-27 20:43:18,628][106225] Updated weights for policy 1, policy_version 207901 (0.0009) [2023-12-27 20:43:19,028][106226] Updated weights for policy 0, policy_version 207769 (0.0006) [2023-12-27 20:43:19,082][106226] Updated weights for policy 0, policy_version 207779 (0.0006) [2023-12-27 20:43:19,129][106226] Updated weights for policy 0, policy_version 207789 (0.0009) [2023-12-27 20:43:19,345][106225] Updated weights for policy 1, policy_version 207911 (0.0010) [2023-12-27 20:43:19,410][106225] Updated weights for policy 1, policy_version 207921 (0.0007) [2023-12-27 20:43:19,475][106225] Updated weights for policy 1, policy_version 207931 (0.0008) [2023-12-27 20:43:19,800][106226] Updated weights for policy 0, policy_version 207799 (0.0006) [2023-12-27 20:43:19,867][106226] Updated weights for policy 0, policy_version 207809 (0.0011) [2023-12-27 20:43:19,940][106226] Updated weights for policy 0, policy_version 207819 (0.0010) [2023-12-27 20:43:20,140][106225] Updated weights for policy 1, policy_version 207941 (0.0009) [2023-12-27 20:43:20,193][106225] Updated weights for policy 1, policy_version 207951 (0.0009) [2023-12-27 20:43:20,251][106225] Updated weights for policy 1, policy_version 207961 (0.0008) [2023-12-27 20:43:20,584][106226] Updated weights for policy 0, policy_version 207829 (0.0008) [2023-12-27 20:43:20,655][106226] Updated weights for policy 0, policy_version 207839 (0.0008) [2023-12-27 20:43:20,717][106226] Updated weights for policy 0, policy_version 207849 (0.0008) [2023-12-27 20:43:21,076][106225] Updated weights for policy 1, policy_version 207971 (0.0009) [2023-12-27 20:43:21,149][106225] Updated weights for policy 1, policy_version 207981 (0.0010) [2023-12-27 20:43:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 106471424. Throughput: 0: 9967.3, 1: 9817.9. Samples: 106484040. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:21,175][105115] Avg episode reward: [(0, '-5.156'), (1, '-6.235')] [2023-12-27 20:43:21,211][106225] Updated weights for policy 1, policy_version 207991 (0.0010) [2023-12-27 20:43:21,516][106226] Updated weights for policy 0, policy_version 207859 (0.0008) [2023-12-27 20:43:21,581][106226] Updated weights for policy 0, policy_version 207869 (0.0008) [2023-12-27 20:43:21,651][106226] Updated weights for policy 0, policy_version 207879 (0.0009) [2023-12-27 20:43:22,003][106225] Updated weights for policy 1, policy_version 208001 (0.0009) [2023-12-27 20:43:22,063][106225] Updated weights for policy 1, policy_version 208011 (0.0006) [2023-12-27 20:43:22,127][106225] Updated weights for policy 1, policy_version 208021 (0.0006) [2023-12-27 20:43:22,181][106225] Updated weights for policy 1, policy_version 208031 (0.0009) [2023-12-27 20:43:22,426][106226] Updated weights for policy 0, policy_version 207889 (0.0009) [2023-12-27 20:43:22,492][106226] Updated weights for policy 0, policy_version 207899 (0.0009) [2023-12-27 20:43:22,554][106226] Updated weights for policy 0, policy_version 207909 (0.0008) [2023-12-27 20:43:22,609][106226] Updated weights for policy 0, policy_version 207919 (0.0009) [2023-12-27 20:43:22,894][106225] Updated weights for policy 1, policy_version 208041 (0.0006) [2023-12-27 20:43:22,964][106225] Updated weights for policy 1, policy_version 208051 (0.0005) [2023-12-27 20:43:23,027][106225] Updated weights for policy 1, policy_version 208061 (0.0008) [2023-12-27 20:43:23,366][106226] Updated weights for policy 0, policy_version 207929 (0.0009) [2023-12-27 20:43:23,415][106226] Updated weights for policy 0, policy_version 207939 (0.0009) [2023-12-27 20:43:23,473][106226] Updated weights for policy 0, policy_version 207949 (0.0006) [2023-12-27 20:43:23,632][106225] Updated weights for policy 1, policy_version 208071 (0.0007) [2023-12-27 20:43:23,678][106225] Updated weights for policy 1, policy_version 208081 (0.0009) [2023-12-27 20:43:23,725][106225] Updated weights for policy 1, policy_version 208091 (0.0008) [2023-12-27 20:43:24,172][106226] Updated weights for policy 0, policy_version 207959 (0.0007) [2023-12-27 20:43:24,239][106226] Updated weights for policy 0, policy_version 207969 (0.0009) [2023-12-27 20:43:24,311][106226] Updated weights for policy 0, policy_version 207979 (0.0006) [2023-12-27 20:43:24,447][106225] Updated weights for policy 1, policy_version 208101 (0.0008) [2023-12-27 20:43:24,502][106225] Updated weights for policy 1, policy_version 208111 (0.0009) [2023-12-27 20:43:24,557][106225] Updated weights for policy 1, policy_version 208121 (0.0009) [2023-12-27 20:43:24,932][106226] Updated weights for policy 0, policy_version 207989 (0.0007) [2023-12-27 20:43:24,984][106226] Updated weights for policy 0, policy_version 207999 (0.0008) [2023-12-27 20:43:25,033][106226] Updated weights for policy 0, policy_version 208009 (0.0008) [2023-12-27 20:43:25,204][106225] Updated weights for policy 1, policy_version 208131 (0.0007) [2023-12-27 20:43:25,252][106225] Updated weights for policy 1, policy_version 208141 (0.0007) [2023-12-27 20:43:25,296][106225] Updated weights for policy 1, policy_version 208151 (0.0008) [2023-12-27 20:43:25,755][106226] Updated weights for policy 0, policy_version 208019 (0.0008) [2023-12-27 20:43:25,805][106226] Updated weights for policy 0, policy_version 208029 (0.0008) [2023-12-27 20:43:25,857][106226] Updated weights for policy 0, policy_version 208039 (0.0009) [2023-12-27 20:43:26,030][106225] Updated weights for policy 1, policy_version 208161 (0.0008) [2023-12-27 20:43:26,094][106225] Updated weights for policy 1, policy_version 208171 (0.0008) [2023-12-27 20:43:26,156][106225] Updated weights for policy 1, policy_version 208181 (0.0010) [2023-12-27 20:43:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 106569728. Throughput: 0: 9938.1, 1: 9787.5. Samples: 106540904. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:26,176][105115] Avg episode reward: [(0, '-4.452'), (1, '-6.246')] [2023-12-27 20:43:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000208048_53272576.pth... [2023-12-27 20:43:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000206864_52969472.pth [2023-12-27 20:43:26,188][106140] Saving new best policy, reward=-4.452! [2023-12-27 20:43:26,217][106225] Updated weights for policy 1, policy_version 208191 (0.0009) [2023-12-27 20:43:26,222][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000208192_53305344.pth... [2023-12-27 20:43:26,227][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000207040_53010432.pth [2023-12-27 20:43:26,465][106226] Updated weights for policy 0, policy_version 208049 (0.0008) [2023-12-27 20:43:26,515][106226] Updated weights for policy 0, policy_version 208059 (0.0005) [2023-12-27 20:43:26,558][106226] Updated weights for policy 0, policy_version 208069 (0.0005) [2023-12-27 20:43:26,608][106226] Updated weights for policy 0, policy_version 208079 (0.0009) [2023-12-27 20:43:26,998][106225] Updated weights for policy 1, policy_version 208201 (0.0008) [2023-12-27 20:43:27,060][106225] Updated weights for policy 1, policy_version 208211 (0.0008) [2023-12-27 20:43:27,111][106225] Updated weights for policy 1, policy_version 208221 (0.0008) [2023-12-27 20:43:27,260][106226] Updated weights for policy 0, policy_version 208089 (0.0009) [2023-12-27 20:43:27,319][106226] Updated weights for policy 0, policy_version 208099 (0.0009) [2023-12-27 20:43:27,371][106226] Updated weights for policy 0, policy_version 208109 (0.0006) [2023-12-27 20:43:27,760][106225] Updated weights for policy 1, policy_version 208231 (0.0007) [2023-12-27 20:43:27,813][106225] Updated weights for policy 1, policy_version 208241 (0.0008) [2023-12-27 20:43:27,881][106225] Updated weights for policy 1, policy_version 208251 (0.0008) [2023-12-27 20:43:27,957][106226] Updated weights for policy 0, policy_version 208119 (0.0005) [2023-12-27 20:43:28,014][106226] Updated weights for policy 0, policy_version 208129 (0.0005) [2023-12-27 20:43:28,082][106226] Updated weights for policy 0, policy_version 208139 (0.0006) [2023-12-27 20:43:28,592][106225] Updated weights for policy 1, policy_version 208261 (0.0008) [2023-12-27 20:43:28,652][106225] Updated weights for policy 1, policy_version 208271 (0.0010) [2023-12-27 20:43:28,679][106226] Updated weights for policy 0, policy_version 208149 (0.0010) [2023-12-27 20:43:28,712][106225] Updated weights for policy 1, policy_version 208281 (0.0010) [2023-12-27 20:43:28,729][106226] Updated weights for policy 0, policy_version 208159 (0.0011) [2023-12-27 20:43:28,783][106226] Updated weights for policy 0, policy_version 208169 (0.0010) [2023-12-27 20:43:29,352][106225] Updated weights for policy 1, policy_version 208291 (0.0009) [2023-12-27 20:43:29,416][106225] Updated weights for policy 1, policy_version 208301 (0.0007) [2023-12-27 20:43:29,442][106226] Updated weights for policy 0, policy_version 208179 (0.0010) [2023-12-27 20:43:29,474][106225] Updated weights for policy 1, policy_version 208311 (0.0009) [2023-12-27 20:43:29,500][106226] Updated weights for policy 0, policy_version 208189 (0.0007) [2023-12-27 20:43:29,565][106226] Updated weights for policy 0, policy_version 208199 (0.0007) [2023-12-27 20:43:30,253][106225] Updated weights for policy 1, policy_version 208321 (0.0007) [2023-12-27 20:43:30,255][106226] Updated weights for policy 0, policy_version 208209 (0.0008) [2023-12-27 20:43:30,307][106225] Updated weights for policy 1, policy_version 208331 (0.0006) [2023-12-27 20:43:30,316][106226] Updated weights for policy 0, policy_version 208219 (0.0008) [2023-12-27 20:43:30,371][106225] Updated weights for policy 1, policy_version 208341 (0.0006) [2023-12-27 20:43:30,384][106226] Updated weights for policy 0, policy_version 208229 (0.0007) [2023-12-27 20:43:30,429][106225] Updated weights for policy 1, policy_version 208351 (0.0008) [2023-12-27 20:43:30,446][106226] Updated weights for policy 0, policy_version 208239 (0.0006) [2023-12-27 20:43:31,004][106226] Updated weights for policy 0, policy_version 208249 (0.0005) [2023-12-27 20:43:31,065][106226] Updated weights for policy 0, policy_version 208259 (0.0007) [2023-12-27 20:43:31,120][106226] Updated weights for policy 0, policy_version 208269 (0.0008) [2023-12-27 20:43:31,128][106225] Updated weights for policy 1, policy_version 208361 (0.0008) [2023-12-27 20:43:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 106676224. Throughput: 0: 10087.5, 1: 9842.1. Samples: 106664864. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:31,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-6.444')] [2023-12-27 20:43:31,194][106225] Updated weights for policy 1, policy_version 208371 (0.0010) [2023-12-27 20:43:31,260][106225] Updated weights for policy 1, policy_version 208381 (0.0011) [2023-12-27 20:43:31,816][106226] Updated weights for policy 0, policy_version 208279 (0.0008) [2023-12-27 20:43:31,867][106226] Updated weights for policy 0, policy_version 208289 (0.0008) [2023-12-27 20:43:31,917][106226] Updated weights for policy 0, policy_version 208299 (0.0008) [2023-12-27 20:43:31,967][106225] Updated weights for policy 1, policy_version 208391 (0.0010) [2023-12-27 20:43:32,020][106225] Updated weights for policy 1, policy_version 208401 (0.0010) [2023-12-27 20:43:32,069][106225] Updated weights for policy 1, policy_version 208411 (0.0010) [2023-12-27 20:43:32,551][106226] Updated weights for policy 0, policy_version 208309 (0.0007) [2023-12-27 20:43:32,618][106226] Updated weights for policy 0, policy_version 208319 (0.0008) [2023-12-27 20:43:32,678][106226] Updated weights for policy 0, policy_version 208329 (0.0005) [2023-12-27 20:43:32,777][106225] Updated weights for policy 1, policy_version 208421 (0.0010) [2023-12-27 20:43:32,840][106225] Updated weights for policy 1, policy_version 208431 (0.0006) [2023-12-27 20:43:32,894][106225] Updated weights for policy 1, policy_version 208441 (0.0005) [2023-12-27 20:43:33,307][106226] Updated weights for policy 0, policy_version 208339 (0.0005) [2023-12-27 20:43:33,355][106226] Updated weights for policy 0, policy_version 208349 (0.0005) [2023-12-27 20:43:33,400][106226] Updated weights for policy 0, policy_version 208359 (0.0005) [2023-12-27 20:43:33,557][106225] Updated weights for policy 1, policy_version 208451 (0.0007) [2023-12-27 20:43:33,603][106225] Updated weights for policy 1, policy_version 208461 (0.0010) [2023-12-27 20:43:33,649][106225] Updated weights for policy 1, policy_version 208471 (0.0010) [2023-12-27 20:43:34,078][106226] Updated weights for policy 0, policy_version 208369 (0.0006) [2023-12-27 20:43:34,123][106226] Updated weights for policy 0, policy_version 208379 (0.0007) [2023-12-27 20:43:34,189][106226] Updated weights for policy 0, policy_version 208389 (0.0007) [2023-12-27 20:43:34,245][106226] Updated weights for policy 0, policy_version 208399 (0.0006) [2023-12-27 20:43:34,414][106225] Updated weights for policy 1, policy_version 208481 (0.0010) [2023-12-27 20:43:34,477][106225] Updated weights for policy 1, policy_version 208491 (0.0010) [2023-12-27 20:43:34,541][106225] Updated weights for policy 1, policy_version 208501 (0.0010) [2023-12-27 20:43:34,600][106225] Updated weights for policy 1, policy_version 208511 (0.0008) [2023-12-27 20:43:34,888][106226] Updated weights for policy 0, policy_version 208409 (0.0007) [2023-12-27 20:43:34,948][106226] Updated weights for policy 0, policy_version 208419 (0.0008) [2023-12-27 20:43:35,005][106226] Updated weights for policy 0, policy_version 208429 (0.0008) [2023-12-27 20:43:35,288][106225] Updated weights for policy 1, policy_version 208521 (0.0010) [2023-12-27 20:43:35,341][106225] Updated weights for policy 1, policy_version 208531 (0.0010) [2023-12-27 20:43:35,397][106225] Updated weights for policy 1, policy_version 208541 (0.0010) [2023-12-27 20:43:35,717][106226] Updated weights for policy 0, policy_version 208439 (0.0008) [2023-12-27 20:43:35,777][106226] Updated weights for policy 0, policy_version 208449 (0.0008) [2023-12-27 20:43:35,833][106226] Updated weights for policy 0, policy_version 208459 (0.0007) [2023-12-27 20:43:36,156][106225] Updated weights for policy 1, policy_version 208551 (0.0009) [2023-12-27 20:43:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 106774528. Throughput: 0: 10165.0, 1: 9773.5. Samples: 106786896. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:36,175][105115] Avg episode reward: [(0, '-5.174'), (1, '-6.499')] [2023-12-27 20:43:36,216][106225] Updated weights for policy 1, policy_version 208561 (0.0009) [2023-12-27 20:43:36,274][106225] Updated weights for policy 1, policy_version 208571 (0.0009) [2023-12-27 20:43:36,468][106226] Updated weights for policy 0, policy_version 208469 (0.0006) [2023-12-27 20:43:36,539][106226] Updated weights for policy 0, policy_version 208479 (0.0006) [2023-12-27 20:43:36,610][106226] Updated weights for policy 0, policy_version 208489 (0.0008) [2023-12-27 20:43:36,959][106225] Updated weights for policy 1, policy_version 208581 (0.0007) [2023-12-27 20:43:37,008][106225] Updated weights for policy 1, policy_version 208591 (0.0009) [2023-12-27 20:43:37,062][106225] Updated weights for policy 1, policy_version 208601 (0.0008) [2023-12-27 20:43:37,301][106226] Updated weights for policy 0, policy_version 208499 (0.0007) [2023-12-27 20:43:37,355][106226] Updated weights for policy 0, policy_version 208509 (0.0009) [2023-12-27 20:43:37,412][106226] Updated weights for policy 0, policy_version 208519 (0.0008) [2023-12-27 20:43:37,691][106225] Updated weights for policy 1, policy_version 208611 (0.0007) [2023-12-27 20:43:37,750][106225] Updated weights for policy 1, policy_version 208621 (0.0007) [2023-12-27 20:43:37,818][106225] Updated weights for policy 1, policy_version 208631 (0.0006) [2023-12-27 20:43:38,110][106226] Updated weights for policy 0, policy_version 208529 (0.0007) [2023-12-27 20:43:38,158][106226] Updated weights for policy 0, policy_version 208539 (0.0008) [2023-12-27 20:43:38,222][106226] Updated weights for policy 0, policy_version 208549 (0.0009) [2023-12-27 20:43:38,288][106226] Updated weights for policy 0, policy_version 208559 (0.0008) [2023-12-27 20:43:38,530][106225] Updated weights for policy 1, policy_version 208641 (0.0009) [2023-12-27 20:43:38,593][106225] Updated weights for policy 1, policy_version 208651 (0.0009) [2023-12-27 20:43:38,655][106225] Updated weights for policy 1, policy_version 208661 (0.0008) [2023-12-27 20:43:38,715][106225] Updated weights for policy 1, policy_version 208671 (0.0008) [2023-12-27 20:43:39,030][106226] Updated weights for policy 0, policy_version 208569 (0.0009) [2023-12-27 20:43:39,088][106226] Updated weights for policy 0, policy_version 208579 (0.0009) [2023-12-27 20:43:39,145][106226] Updated weights for policy 0, policy_version 208589 (0.0008) [2023-12-27 20:43:39,499][106225] Updated weights for policy 1, policy_version 208681 (0.0010) [2023-12-27 20:43:39,561][106225] Updated weights for policy 1, policy_version 208691 (0.0010) [2023-12-27 20:43:39,614][106225] Updated weights for policy 1, policy_version 208701 (0.0010) [2023-12-27 20:43:39,943][106226] Updated weights for policy 0, policy_version 208599 (0.0009) [2023-12-27 20:43:40,006][106226] Updated weights for policy 0, policy_version 208609 (0.0008) [2023-12-27 20:43:40,064][106226] Updated weights for policy 0, policy_version 208619 (0.0008) [2023-12-27 20:43:40,372][106225] Updated weights for policy 1, policy_version 208711 (0.0010) [2023-12-27 20:43:40,434][106225] Updated weights for policy 1, policy_version 208721 (0.0010) [2023-12-27 20:43:40,487][106225] Updated weights for policy 1, policy_version 208731 (0.0010) [2023-12-27 20:43:40,784][106226] Updated weights for policy 0, policy_version 208629 (0.0009) [2023-12-27 20:43:40,832][106226] Updated weights for policy 0, policy_version 208639 (0.0010) [2023-12-27 20:43:40,891][106226] Updated weights for policy 0, policy_version 208649 (0.0011) [2023-12-27 20:43:41,156][106225] Updated weights for policy 1, policy_version 208741 (0.0012) [2023-12-27 20:43:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 106872832. Throughput: 0: 10153.9, 1: 9772.2. Samples: 106845784. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:41,176][105115] Avg episode reward: [(0, '-5.053'), (1, '-6.252')] [2023-12-27 20:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000208656_53428224.pth... [2023-12-27 20:43:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000207472_53125120.pth [2023-12-27 20:43:41,218][106225] Updated weights for policy 1, policy_version 208751 (0.0010) [2023-12-27 20:43:41,289][106225] Updated weights for policy 1, policy_version 208761 (0.0010) [2023-12-27 20:43:41,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000208768_53452800.pth... [2023-12-27 20:43:41,337][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000207616_53157888.pth [2023-12-27 20:43:41,699][106226] Updated weights for policy 0, policy_version 208659 (0.0009) [2023-12-27 20:43:41,774][106226] Updated weights for policy 0, policy_version 208670 (0.0009) [2023-12-27 20:43:41,837][106226] Updated weights for policy 0, policy_version 208680 (0.0008) [2023-12-27 20:43:42,035][106225] Updated weights for policy 1, policy_version 208771 (0.0009) [2023-12-27 20:43:42,099][106225] Updated weights for policy 1, policy_version 208781 (0.0008) [2023-12-27 20:43:42,161][106225] Updated weights for policy 1, policy_version 208791 (0.0008) [2023-12-27 20:43:42,591][106226] Updated weights for policy 0, policy_version 208690 (0.0008) [2023-12-27 20:43:42,640][106226] Updated weights for policy 0, policy_version 208700 (0.0008) [2023-12-27 20:43:42,689][106226] Updated weights for policy 0, policy_version 208710 (0.0007) [2023-12-27 20:43:42,743][106226] Updated weights for policy 0, policy_version 208720 (0.0007) [2023-12-27 20:43:42,906][106225] Updated weights for policy 1, policy_version 208801 (0.0008) [2023-12-27 20:43:42,963][106225] Updated weights for policy 1, policy_version 208811 (0.0006) [2023-12-27 20:43:43,016][106225] Updated weights for policy 1, policy_version 208821 (0.0006) [2023-12-27 20:43:43,071][106225] Updated weights for policy 1, policy_version 208831 (0.0005) [2023-12-27 20:43:43,506][106226] Updated weights for policy 0, policy_version 208730 (0.0010) [2023-12-27 20:43:43,559][106226] Updated weights for policy 0, policy_version 208741 (0.0010) [2023-12-27 20:43:43,607][106226] Updated weights for policy 0, policy_version 208751 (0.0007) [2023-12-27 20:43:43,611][106225] Updated weights for policy 1, policy_version 208841 (0.0008) [2023-12-27 20:43:43,673][106225] Updated weights for policy 1, policy_version 208851 (0.0007) [2023-12-27 20:43:43,741][106225] Updated weights for policy 1, policy_version 208861 (0.0008) [2023-12-27 20:43:44,288][106225] Updated weights for policy 1, policy_version 208871 (0.0009) [2023-12-27 20:43:44,322][106226] Updated weights for policy 0, policy_version 208761 (0.0010) [2023-12-27 20:43:44,341][106225] Updated weights for policy 1, policy_version 208881 (0.0009) [2023-12-27 20:43:44,387][106226] Updated weights for policy 0, policy_version 208771 (0.0006) [2023-12-27 20:43:44,397][106225] Updated weights for policy 1, policy_version 208891 (0.0007) [2023-12-27 20:43:44,448][106226] Updated weights for policy 0, policy_version 208781 (0.0007) [2023-12-27 20:43:45,020][106225] Updated weights for policy 1, policy_version 208901 (0.0007) [2023-12-27 20:43:45,074][106225] Updated weights for policy 1, policy_version 208911 (0.0005) [2023-12-27 20:43:45,144][106225] Updated weights for policy 1, policy_version 208921 (0.0006) [2023-12-27 20:43:45,201][106226] Updated weights for policy 0, policy_version 208791 (0.0006) [2023-12-27 20:43:45,261][106226] Updated weights for policy 0, policy_version 208801 (0.0005) [2023-12-27 20:43:45,327][106226] Updated weights for policy 0, policy_version 208811 (0.0007) [2023-12-27 20:43:45,812][106225] Updated weights for policy 1, policy_version 208931 (0.0007) [2023-12-27 20:43:45,870][106225] Updated weights for policy 1, policy_version 208941 (0.0006) [2023-12-27 20:43:45,932][106225] Updated weights for policy 1, policy_version 208951 (0.0005) [2023-12-27 20:43:45,953][106226] Updated weights for policy 0, policy_version 208821 (0.0008) [2023-12-27 20:43:46,001][106226] Updated weights for policy 0, policy_version 208831 (0.0008) [2023-12-27 20:43:46,051][106226] Updated weights for policy 0, policy_version 208841 (0.0009) [2023-12-27 20:43:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 106979328. Throughput: 0: 10166.6, 1: 9758.3. Samples: 106962616. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:46,175][105115] Avg episode reward: [(0, '-5.192'), (1, '-6.016')] [2023-12-27 20:43:46,520][106225] Updated weights for policy 1, policy_version 208961 (0.0006) [2023-12-27 20:43:46,567][106225] Updated weights for policy 1, policy_version 208971 (0.0008) [2023-12-27 20:43:46,615][106225] Updated weights for policy 1, policy_version 208981 (0.0008) [2023-12-27 20:43:46,664][106225] Updated weights for policy 1, policy_version 208991 (0.0008) [2023-12-27 20:43:46,778][106226] Updated weights for policy 0, policy_version 208851 (0.0007) [2023-12-27 20:43:46,840][106226] Updated weights for policy 0, policy_version 208861 (0.0010) [2023-12-27 20:43:46,903][106226] Updated weights for policy 0, policy_version 208871 (0.0009) [2023-12-27 20:43:47,342][106225] Updated weights for policy 1, policy_version 209001 (0.0007) [2023-12-27 20:43:47,388][106225] Updated weights for policy 1, policy_version 209011 (0.0007) [2023-12-27 20:43:47,438][106225] Updated weights for policy 1, policy_version 209021 (0.0007) [2023-12-27 20:43:47,602][106226] Updated weights for policy 0, policy_version 208881 (0.0010) [2023-12-27 20:43:47,672][106226] Updated weights for policy 0, policy_version 208891 (0.0008) [2023-12-27 20:43:47,745][106226] Updated weights for policy 0, policy_version 208901 (0.0007) [2023-12-27 20:43:47,806][106226] Updated weights for policy 0, policy_version 208911 (0.0006) [2023-12-27 20:43:48,093][106225] Updated weights for policy 1, policy_version 209031 (0.0007) [2023-12-27 20:43:48,163][106225] Updated weights for policy 1, policy_version 209041 (0.0008) [2023-12-27 20:43:48,222][106225] Updated weights for policy 1, policy_version 209051 (0.0008) [2023-12-27 20:43:48,416][106226] Updated weights for policy 0, policy_version 208921 (0.0008) [2023-12-27 20:43:48,471][106226] Updated weights for policy 0, policy_version 208931 (0.0006) [2023-12-27 20:43:48,533][106226] Updated weights for policy 0, policy_version 208941 (0.0008) [2023-12-27 20:43:48,878][106225] Updated weights for policy 1, policy_version 209061 (0.0008) [2023-12-27 20:43:48,944][106225] Updated weights for policy 1, policy_version 209071 (0.0007) [2023-12-27 20:43:49,001][106225] Updated weights for policy 1, policy_version 209081 (0.0010) [2023-12-27 20:43:49,178][106226] Updated weights for policy 0, policy_version 208951 (0.0010) [2023-12-27 20:43:49,236][106226] Updated weights for policy 0, policy_version 208961 (0.0010) [2023-12-27 20:43:49,307][106226] Updated weights for policy 0, policy_version 208971 (0.0008) [2023-12-27 20:43:49,683][106225] Updated weights for policy 1, policy_version 209091 (0.0010) [2023-12-27 20:43:49,744][106225] Updated weights for policy 1, policy_version 209101 (0.0010) [2023-12-27 20:43:49,799][106225] Updated weights for policy 1, policy_version 209111 (0.0010) [2023-12-27 20:43:50,035][106226] Updated weights for policy 0, policy_version 208981 (0.0008) [2023-12-27 20:43:50,106][106226] Updated weights for policy 0, policy_version 208991 (0.0011) [2023-12-27 20:43:50,163][106226] Updated weights for policy 0, policy_version 209001 (0.0011) [2023-12-27 20:43:50,562][106225] Updated weights for policy 1, policy_version 209121 (0.0009) [2023-12-27 20:43:50,623][106225] Updated weights for policy 1, policy_version 209131 (0.0008) [2023-12-27 20:43:50,673][106225] Updated weights for policy 1, policy_version 209141 (0.0008) [2023-12-27 20:43:50,733][106225] Updated weights for policy 1, policy_version 209151 (0.0008) [2023-12-27 20:43:50,868][106226] Updated weights for policy 0, policy_version 209011 (0.0010) [2023-12-27 20:43:50,936][106226] Updated weights for policy 0, policy_version 209021 (0.0008) [2023-12-27 20:43:51,002][106226] Updated weights for policy 0, policy_version 209031 (0.0008) [2023-12-27 20:43:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 107077632. Throughput: 0: 10085.2, 1: 9811.9. Samples: 107084684. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:51,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.884')] [2023-12-27 20:43:51,489][106225] Updated weights for policy 1, policy_version 209161 (0.0008) [2023-12-27 20:43:51,552][106225] Updated weights for policy 1, policy_version 209171 (0.0009) [2023-12-27 20:43:51,613][106225] Updated weights for policy 1, policy_version 209181 (0.0008) [2023-12-27 20:43:51,768][106226] Updated weights for policy 0, policy_version 209041 (0.0010) [2023-12-27 20:43:51,824][106226] Updated weights for policy 0, policy_version 209051 (0.0007) [2023-12-27 20:43:51,880][106226] Updated weights for policy 0, policy_version 209061 (0.0011) [2023-12-27 20:43:51,934][106226] Updated weights for policy 0, policy_version 209071 (0.0010) [2023-12-27 20:43:52,370][106225] Updated weights for policy 1, policy_version 209191 (0.0007) [2023-12-27 20:43:52,436][106225] Updated weights for policy 1, policy_version 209201 (0.0008) [2023-12-27 20:43:52,495][106225] Updated weights for policy 1, policy_version 209211 (0.0008) [2023-12-27 20:43:52,684][106226] Updated weights for policy 0, policy_version 209081 (0.0008) [2023-12-27 20:43:52,750][106226] Updated weights for policy 0, policy_version 209091 (0.0005) [2023-12-27 20:43:52,816][106226] Updated weights for policy 0, policy_version 209101 (0.0006) [2023-12-27 20:43:53,294][106225] Updated weights for policy 1, policy_version 209221 (0.0009) [2023-12-27 20:43:53,346][106226] Updated weights for policy 0, policy_version 209111 (0.0006) [2023-12-27 20:43:53,348][106225] Updated weights for policy 1, policy_version 209231 (0.0009) [2023-12-27 20:43:53,399][106226] Updated weights for policy 0, policy_version 209121 (0.0005) [2023-12-27 20:43:53,400][106225] Updated weights for policy 1, policy_version 209241 (0.0008) [2023-12-27 20:43:53,464][106226] Updated weights for policy 0, policy_version 209131 (0.0006) [2023-12-27 20:43:54,124][106226] Updated weights for policy 0, policy_version 209141 (0.0008) [2023-12-27 20:43:54,178][106225] Updated weights for policy 1, policy_version 209251 (0.0007) [2023-12-27 20:43:54,184][106226] Updated weights for policy 0, policy_version 209151 (0.0009) [2023-12-27 20:43:54,243][106226] Updated weights for policy 0, policy_version 209161 (0.0008) [2023-12-27 20:43:54,245][106225] Updated weights for policy 1, policy_version 209261 (0.0008) [2023-12-27 20:43:54,306][106225] Updated weights for policy 1, policy_version 209271 (0.0007) [2023-12-27 20:43:54,993][106226] Updated weights for policy 0, policy_version 209171 (0.0008) [2023-12-27 20:43:55,037][106225] Updated weights for policy 1, policy_version 209281 (0.0008) [2023-12-27 20:43:55,055][106226] Updated weights for policy 0, policy_version 209181 (0.0008) [2023-12-27 20:43:55,101][106225] Updated weights for policy 1, policy_version 209291 (0.0007) [2023-12-27 20:43:55,114][106226] Updated weights for policy 0, policy_version 209191 (0.0008) [2023-12-27 20:43:55,163][106225] Updated weights for policy 1, policy_version 209301 (0.0008) [2023-12-27 20:43:55,223][106225] Updated weights for policy 1, policy_version 209311 (0.0008) [2023-12-27 20:43:55,824][106226] Updated weights for policy 0, policy_version 209201 (0.0006) [2023-12-27 20:43:55,878][106226] Updated weights for policy 0, policy_version 209211 (0.0008) [2023-12-27 20:43:55,935][106226] Updated weights for policy 0, policy_version 209221 (0.0005) [2023-12-27 20:43:55,937][106225] Updated weights for policy 1, policy_version 209321 (0.0008) [2023-12-27 20:43:55,984][106226] Updated weights for policy 0, policy_version 209231 (0.0006) [2023-12-27 20:43:55,990][106225] Updated weights for policy 1, policy_version 209331 (0.0008) [2023-12-27 20:43:56,041][106225] Updated weights for policy 1, policy_version 209341 (0.0008) [2023-12-27 20:43:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 107175936. Throughput: 0: 10072.2, 1: 9799.0. Samples: 107142688. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:43:56,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-6.204')] [2023-12-27 20:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000209344_53600256.pth... [2023-12-27 20:43:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000209232_53575680.pth... [2023-12-27 20:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000208048_53272576.pth [2023-12-27 20:43:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000208192_53305344.pth [2023-12-27 20:43:56,694][106226] Updated weights for policy 0, policy_version 209241 (0.0009) [2023-12-27 20:43:56,705][106225] Updated weights for policy 1, policy_version 209351 (0.0009) [2023-12-27 20:43:56,741][106226] Updated weights for policy 0, policy_version 209251 (0.0007) [2023-12-27 20:43:56,767][106225] Updated weights for policy 1, policy_version 209361 (0.0006) [2023-12-27 20:43:56,788][106226] Updated weights for policy 0, policy_version 209261 (0.0007) [2023-12-27 20:43:56,818][106225] Updated weights for policy 1, policy_version 209371 (0.0006) [2023-12-27 20:43:57,454][106226] Updated weights for policy 0, policy_version 209271 (0.0006) [2023-12-27 20:43:57,523][106226] Updated weights for policy 0, policy_version 209281 (0.0006) [2023-12-27 20:43:57,557][106225] Updated weights for policy 1, policy_version 209381 (0.0007) [2023-12-27 20:43:57,588][106226] Updated weights for policy 0, policy_version 209291 (0.0005) [2023-12-27 20:43:57,615][106225] Updated weights for policy 1, policy_version 209391 (0.0005) [2023-12-27 20:43:57,674][106225] Updated weights for policy 1, policy_version 209401 (0.0005) [2023-12-27 20:43:58,111][106226] Updated weights for policy 0, policy_version 209301 (0.0006) [2023-12-27 20:43:58,167][106226] Updated weights for policy 0, policy_version 209311 (0.0005) [2023-12-27 20:43:58,232][106226] Updated weights for policy 0, policy_version 209321 (0.0007) [2023-12-27 20:43:58,282][106225] Updated weights for policy 1, policy_version 209411 (0.0005) [2023-12-27 20:43:58,346][106225] Updated weights for policy 1, policy_version 209421 (0.0009) [2023-12-27 20:43:58,412][106225] Updated weights for policy 1, policy_version 209431 (0.0009) [2023-12-27 20:43:58,933][106226] Updated weights for policy 0, policy_version 209331 (0.0008) [2023-12-27 20:43:58,997][106226] Updated weights for policy 0, policy_version 209341 (0.0007) [2023-12-27 20:43:59,057][106226] Updated weights for policy 0, policy_version 209351 (0.0008) [2023-12-27 20:43:59,247][106225] Updated weights for policy 1, policy_version 209441 (0.0009) [2023-12-27 20:43:59,317][106225] Updated weights for policy 1, policy_version 209451 (0.0008) [2023-12-27 20:43:59,381][106225] Updated weights for policy 1, policy_version 209461 (0.0008) [2023-12-27 20:43:59,446][106225] Updated weights for policy 1, policy_version 209471 (0.0008) [2023-12-27 20:43:59,853][106226] Updated weights for policy 0, policy_version 209361 (0.0008) [2023-12-27 20:43:59,918][106226] Updated weights for policy 0, policy_version 209371 (0.0009) [2023-12-27 20:43:59,986][106226] Updated weights for policy 0, policy_version 209381 (0.0008) [2023-12-27 20:44:00,041][106226] Updated weights for policy 0, policy_version 209391 (0.0009) [2023-12-27 20:44:00,173][106225] Updated weights for policy 1, policy_version 209481 (0.0007) [2023-12-27 20:44:00,231][106225] Updated weights for policy 1, policy_version 209491 (0.0008) [2023-12-27 20:44:00,298][106225] Updated weights for policy 1, policy_version 209501 (0.0007) [2023-12-27 20:44:00,799][106226] Updated weights for policy 0, policy_version 209401 (0.0009) [2023-12-27 20:44:00,848][106226] Updated weights for policy 0, policy_version 209411 (0.0007) [2023-12-27 20:44:00,895][106226] Updated weights for policy 0, policy_version 209421 (0.0007) [2023-12-27 20:44:00,941][106225] Updated weights for policy 1, policy_version 209511 (0.0006) [2023-12-27 20:44:00,995][106225] Updated weights for policy 1, policy_version 209521 (0.0006) [2023-12-27 20:44:01,053][106225] Updated weights for policy 1, policy_version 209531 (0.0008) [2023-12-27 20:44:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 107274240. Throughput: 0: 10076.8, 1: 9844.7. Samples: 107258732. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:44:01,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-6.110')] [2023-12-27 20:44:01,665][106226] Updated weights for policy 0, policy_version 209431 (0.0008) [2023-12-27 20:44:01,726][106226] Updated weights for policy 0, policy_version 209441 (0.0008) [2023-12-27 20:44:01,776][106225] Updated weights for policy 1, policy_version 209541 (0.0008) [2023-12-27 20:44:01,794][106226] Updated weights for policy 0, policy_version 209451 (0.0008) [2023-12-27 20:44:01,840][106225] Updated weights for policy 1, policy_version 209551 (0.0008) [2023-12-27 20:44:01,902][106225] Updated weights for policy 1, policy_version 209561 (0.0008) [2023-12-27 20:44:02,504][106226] Updated weights for policy 0, policy_version 209461 (0.0008) [2023-12-27 20:44:02,561][106226] Updated weights for policy 0, policy_version 209471 (0.0008) [2023-12-27 20:44:02,612][106225] Updated weights for policy 1, policy_version 209571 (0.0007) [2023-12-27 20:44:02,621][106226] Updated weights for policy 0, policy_version 209481 (0.0008) [2023-12-27 20:44:02,670][106225] Updated weights for policy 1, policy_version 209581 (0.0006) [2023-12-27 20:44:02,733][106225] Updated weights for policy 1, policy_version 209591 (0.0008) [2023-12-27 20:44:03,319][106225] Updated weights for policy 1, policy_version 209601 (0.0009) [2023-12-27 20:44:03,324][106226] Updated weights for policy 0, policy_version 209491 (0.0007) [2023-12-27 20:44:03,374][106226] Updated weights for policy 0, policy_version 209501 (0.0007) [2023-12-27 20:44:03,376][106225] Updated weights for policy 1, policy_version 209611 (0.0007) [2023-12-27 20:44:03,423][106225] Updated weights for policy 1, policy_version 209621 (0.0006) [2023-12-27 20:44:03,429][106226] Updated weights for policy 0, policy_version 209511 (0.0008) [2023-12-27 20:44:03,477][106225] Updated weights for policy 1, policy_version 209631 (0.0007) [2023-12-27 20:44:04,165][106226] Updated weights for policy 0, policy_version 209521 (0.0006) [2023-12-27 20:44:04,228][106225] Updated weights for policy 1, policy_version 209641 (0.0007) [2023-12-27 20:44:04,233][106226] Updated weights for policy 0, policy_version 209531 (0.0006) [2023-12-27 20:44:04,291][106225] Updated weights for policy 1, policy_version 209651 (0.0008) [2023-12-27 20:44:04,296][106226] Updated weights for policy 0, policy_version 209541 (0.0009) [2023-12-27 20:44:04,354][106226] Updated weights for policy 0, policy_version 209551 (0.0009) [2023-12-27 20:44:04,355][106225] Updated weights for policy 1, policy_version 209661 (0.0007) [2023-12-27 20:44:05,066][106225] Updated weights for policy 1, policy_version 209671 (0.0009) [2023-12-27 20:44:05,111][106226] Updated weights for policy 0, policy_version 209561 (0.0007) [2023-12-27 20:44:05,124][106225] Updated weights for policy 1, policy_version 209681 (0.0010) [2023-12-27 20:44:05,169][106226] Updated weights for policy 0, policy_version 209571 (0.0009) [2023-12-27 20:44:05,182][106225] Updated weights for policy 1, policy_version 209691 (0.0010) [2023-12-27 20:44:05,230][106226] Updated weights for policy 0, policy_version 209581 (0.0010) [2023-12-27 20:44:05,815][106226] Updated weights for policy 0, policy_version 209591 (0.0008) [2023-12-27 20:44:05,874][106226] Updated weights for policy 0, policy_version 209601 (0.0005) [2023-12-27 20:44:05,911][106225] Updated weights for policy 1, policy_version 209701 (0.0010) [2023-12-27 20:44:05,933][106226] Updated weights for policy 0, policy_version 209611 (0.0005) [2023-12-27 20:44:05,962][106225] Updated weights for policy 1, policy_version 209711 (0.0010) [2023-12-27 20:44:06,012][106225] Updated weights for policy 1, policy_version 209721 (0.0010) [2023-12-27 20:44:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 107372544. Throughput: 0: 9995.3, 1: 9878.7. Samples: 107378368. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-27 20:44:06,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-6.250')] [2023-12-27 20:44:06,532][106226] Updated weights for policy 0, policy_version 209621 (0.0008) [2023-12-27 20:44:06,592][106226] Updated weights for policy 0, policy_version 209631 (0.0006) [2023-12-27 20:44:06,655][106226] Updated weights for policy 0, policy_version 209641 (0.0006) [2023-12-27 20:44:06,780][106225] Updated weights for policy 1, policy_version 209731 (0.0010) [2023-12-27 20:44:06,847][106225] Updated weights for policy 1, policy_version 209741 (0.0010) [2023-12-27 20:44:06,898][106225] Updated weights for policy 1, policy_version 209751 (0.0010) [2023-12-27 20:44:07,306][106226] Updated weights for policy 0, policy_version 209651 (0.0007) [2023-12-27 20:44:07,361][106226] Updated weights for policy 0, policy_version 209661 (0.0011) [2023-12-27 20:44:07,412][106226] Updated weights for policy 0, policy_version 209671 (0.0011) [2023-12-27 20:44:07,561][106225] Updated weights for policy 1, policy_version 209761 (0.0010) [2023-12-27 20:44:07,629][106225] Updated weights for policy 1, policy_version 209771 (0.0005) [2023-12-27 20:44:07,681][106225] Updated weights for policy 1, policy_version 209781 (0.0005) [2023-12-27 20:44:07,741][106225] Updated weights for policy 1, policy_version 209791 (0.0006) [2023-12-27 20:44:08,116][106226] Updated weights for policy 0, policy_version 209681 (0.0010) [2023-12-27 20:44:08,170][106226] Updated weights for policy 0, policy_version 209691 (0.0005) [2023-12-27 20:44:08,223][106226] Updated weights for policy 0, policy_version 209701 (0.0005) [2023-12-27 20:44:08,276][106226] Updated weights for policy 0, policy_version 209711 (0.0005) [2023-12-27 20:44:08,297][106225] Updated weights for policy 1, policy_version 209801 (0.0007) [2023-12-27 20:44:08,362][106225] Updated weights for policy 1, policy_version 209811 (0.0010) [2023-12-27 20:44:08,425][106225] Updated weights for policy 1, policy_version 209821 (0.0007) [2023-12-27 20:44:08,875][106226] Updated weights for policy 0, policy_version 209721 (0.0010) [2023-12-27 20:44:08,945][106226] Updated weights for policy 0, policy_version 209731 (0.0009) [2023-12-27 20:44:09,015][106226] Updated weights for policy 0, policy_version 209741 (0.0009) [2023-12-27 20:44:09,115][106225] Updated weights for policy 1, policy_version 209831 (0.0006) [2023-12-27 20:44:09,165][106225] Updated weights for policy 1, policy_version 209841 (0.0008) [2023-12-27 20:44:09,239][106225] Updated weights for policy 1, policy_version 209851 (0.0009) [2023-12-27 20:44:09,724][106226] Updated weights for policy 0, policy_version 209751 (0.0009) [2023-12-27 20:44:09,785][106226] Updated weights for policy 0, policy_version 209761 (0.0009) [2023-12-27 20:44:09,858][106226] Updated weights for policy 0, policy_version 209771 (0.0009) [2023-12-27 20:44:10,053][106225] Updated weights for policy 1, policy_version 209861 (0.0007) [2023-12-27 20:44:10,120][106225] Updated weights for policy 1, policy_version 209871 (0.0007) [2023-12-27 20:44:10,183][106225] Updated weights for policy 1, policy_version 209881 (0.0008) [2023-12-27 20:44:10,590][106226] Updated weights for policy 0, policy_version 209781 (0.0009) [2023-12-27 20:44:10,647][106226] Updated weights for policy 0, policy_version 209791 (0.0011) [2023-12-27 20:44:10,711][106226] Updated weights for policy 0, policy_version 209801 (0.0010) [2023-12-27 20:44:10,857][106225] Updated weights for policy 1, policy_version 209891 (0.0009) [2023-12-27 20:44:10,916][106225] Updated weights for policy 1, policy_version 209901 (0.0010) [2023-12-27 20:44:10,962][106225] Updated weights for policy 1, policy_version 209911 (0.0010) [2023-12-27 20:44:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 107470848. Throughput: 0: 10073.6, 1: 9900.8. Samples: 107439748. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:11,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-6.239')] [2023-12-27 20:44:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000209808_53723136.pth... [2023-12-27 20:44:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000209920_53747712.pth... [2023-12-27 20:44:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000208656_53428224.pth [2023-12-27 20:44:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000208768_53452800.pth [2023-12-27 20:44:11,453][106226] Updated weights for policy 0, policy_version 209811 (0.0009) [2023-12-27 20:44:11,521][106226] Updated weights for policy 0, policy_version 209821 (0.0006) [2023-12-27 20:44:11,585][106226] Updated weights for policy 0, policy_version 209831 (0.0006) [2023-12-27 20:44:11,780][106225] Updated weights for policy 1, policy_version 209921 (0.0010) [2023-12-27 20:44:11,848][106225] Updated weights for policy 1, policy_version 209931 (0.0011) [2023-12-27 20:44:11,907][106225] Updated weights for policy 1, policy_version 209941 (0.0010) [2023-12-27 20:44:11,965][106225] Updated weights for policy 1, policy_version 209951 (0.0011) [2023-12-27 20:44:12,198][106226] Updated weights for policy 0, policy_version 209841 (0.0008) [2023-12-27 20:44:12,248][106226] Updated weights for policy 0, policy_version 209851 (0.0008) [2023-12-27 20:44:12,309][106226] Updated weights for policy 0, policy_version 209861 (0.0008) [2023-12-27 20:44:12,388][106226] Updated weights for policy 0, policy_version 209871 (0.0008) [2023-12-27 20:44:12,693][106225] Updated weights for policy 1, policy_version 209961 (0.0009) [2023-12-27 20:44:12,751][106225] Updated weights for policy 1, policy_version 209971 (0.0008) [2023-12-27 20:44:12,812][106225] Updated weights for policy 1, policy_version 209981 (0.0010) [2023-12-27 20:44:13,148][106226] Updated weights for policy 0, policy_version 209881 (0.0009) [2023-12-27 20:44:13,208][106226] Updated weights for policy 0, policy_version 209891 (0.0008) [2023-12-27 20:44:13,262][106226] Updated weights for policy 0, policy_version 209901 (0.0009) [2023-12-27 20:44:13,487][106225] Updated weights for policy 1, policy_version 209991 (0.0007) [2023-12-27 20:44:13,538][106225] Updated weights for policy 1, policy_version 210001 (0.0005) [2023-12-27 20:44:13,597][106225] Updated weights for policy 1, policy_version 210011 (0.0008) [2023-12-27 20:44:13,983][106226] Updated weights for policy 0, policy_version 209911 (0.0006) [2023-12-27 20:44:14,042][106226] Updated weights for policy 0, policy_version 209921 (0.0006) [2023-12-27 20:44:14,106][106226] Updated weights for policy 0, policy_version 209931 (0.0009) [2023-12-27 20:44:14,198][106225] Updated weights for policy 1, policy_version 210021 (0.0008) [2023-12-27 20:44:14,263][106225] Updated weights for policy 1, policy_version 210031 (0.0008) [2023-12-27 20:44:14,320][106225] Updated weights for policy 1, policy_version 210041 (0.0008) [2023-12-27 20:44:14,806][106226] Updated weights for policy 0, policy_version 209941 (0.0008) [2023-12-27 20:44:14,868][106226] Updated weights for policy 0, policy_version 209951 (0.0008) [2023-12-27 20:44:14,934][106226] Updated weights for policy 0, policy_version 209961 (0.0007) [2023-12-27 20:44:14,942][106225] Updated weights for policy 1, policy_version 210051 (0.0006) [2023-12-27 20:44:15,005][106225] Updated weights for policy 1, policy_version 210061 (0.0007) [2023-12-27 20:44:15,067][106225] Updated weights for policy 1, policy_version 210071 (0.0008) [2023-12-27 20:44:15,662][106226] Updated weights for policy 0, policy_version 209971 (0.0007) [2023-12-27 20:44:15,720][106226] Updated weights for policy 0, policy_version 209981 (0.0009) [2023-12-27 20:44:15,768][106226] Updated weights for policy 0, policy_version 209991 (0.0008) [2023-12-27 20:44:15,778][106225] Updated weights for policy 1, policy_version 210081 (0.0009) [2023-12-27 20:44:15,829][106225] Updated weights for policy 1, policy_version 210091 (0.0008) [2023-12-27 20:44:15,875][106225] Updated weights for policy 1, policy_version 210101 (0.0007) [2023-12-27 20:44:15,933][106225] Updated weights for policy 1, policy_version 210111 (0.0008) [2023-12-27 20:44:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 107569152. Throughput: 0: 9939.3, 1: 9881.8. Samples: 107556816. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:16,176][105115] Avg episode reward: [(0, '-5.212'), (1, '-6.183')] [2023-12-27 20:44:16,385][106226] Updated weights for policy 0, policy_version 210001 (0.0008) [2023-12-27 20:44:16,448][106226] Updated weights for policy 0, policy_version 210011 (0.0009) [2023-12-27 20:44:16,505][106226] Updated weights for policy 0, policy_version 210021 (0.0010) [2023-12-27 20:44:16,564][106226] Updated weights for policy 0, policy_version 210031 (0.0010) [2023-12-27 20:44:16,576][106225] Updated weights for policy 1, policy_version 210121 (0.0007) [2023-12-27 20:44:16,630][106225] Updated weights for policy 1, policy_version 210131 (0.0010) [2023-12-27 20:44:16,676][106225] Updated weights for policy 1, policy_version 210141 (0.0008) [2023-12-27 20:44:17,240][106225] Updated weights for policy 1, policy_version 210151 (0.0007) [2023-12-27 20:44:17,244][106226] Updated weights for policy 0, policy_version 210041 (0.0007) [2023-12-27 20:44:17,288][106225] Updated weights for policy 1, policy_version 210161 (0.0007) [2023-12-27 20:44:17,294][106226] Updated weights for policy 0, policy_version 210051 (0.0007) [2023-12-27 20:44:17,337][106225] Updated weights for policy 1, policy_version 210171 (0.0007) [2023-12-27 20:44:17,348][106226] Updated weights for policy 0, policy_version 210061 (0.0008) [2023-12-27 20:44:17,994][106225] Updated weights for policy 1, policy_version 210181 (0.0009) [2023-12-27 20:44:18,026][106226] Updated weights for policy 0, policy_version 210071 (0.0006) [2023-12-27 20:44:18,048][106225] Updated weights for policy 1, policy_version 210191 (0.0010) [2023-12-27 20:44:18,085][106226] Updated weights for policy 0, policy_version 210081 (0.0005) [2023-12-27 20:44:18,091][106225] Updated weights for policy 1, policy_version 210201 (0.0010) [2023-12-27 20:44:18,139][106226] Updated weights for policy 0, policy_version 210091 (0.0006) [2023-12-27 20:44:18,765][106225] Updated weights for policy 1, policy_version 210211 (0.0009) [2023-12-27 20:44:18,833][106225] Updated weights for policy 1, policy_version 210221 (0.0006) [2023-12-27 20:44:18,892][106226] Updated weights for policy 0, policy_version 210101 (0.0008) [2023-12-27 20:44:18,900][106225] Updated weights for policy 1, policy_version 210231 (0.0007) [2023-12-27 20:44:18,950][106226] Updated weights for policy 0, policy_version 210111 (0.0008) [2023-12-27 20:44:19,010][106226] Updated weights for policy 0, policy_version 210121 (0.0008) [2023-12-27 20:44:19,576][106225] Updated weights for policy 1, policy_version 210241 (0.0008) [2023-12-27 20:44:19,635][106225] Updated weights for policy 1, policy_version 210251 (0.0006) [2023-12-27 20:44:19,695][106225] Updated weights for policy 1, policy_version 210261 (0.0006) [2023-12-27 20:44:19,697][106226] Updated weights for policy 0, policy_version 210131 (0.0008) [2023-12-27 20:44:19,760][106225] Updated weights for policy 1, policy_version 210271 (0.0006) [2023-12-27 20:44:19,766][106226] Updated weights for policy 0, policy_version 210141 (0.0006) [2023-12-27 20:44:19,838][106226] Updated weights for policy 0, policy_version 210151 (0.0008) [2023-12-27 20:44:20,436][106226] Updated weights for policy 0, policy_version 210161 (0.0010) [2023-12-27 20:44:20,464][106225] Updated weights for policy 1, policy_version 210281 (0.0007) [2023-12-27 20:44:20,501][106226] Updated weights for policy 0, policy_version 210171 (0.0008) [2023-12-27 20:44:20,528][106225] Updated weights for policy 1, policy_version 210291 (0.0006) [2023-12-27 20:44:20,565][106226] Updated weights for policy 0, policy_version 210181 (0.0008) [2023-12-27 20:44:20,599][106225] Updated weights for policy 1, policy_version 210301 (0.0008) [2023-12-27 20:44:20,631][106226] Updated weights for policy 0, policy_version 210191 (0.0008) [2023-12-27 20:44:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 107667456. Throughput: 0: 9872.2, 1: 9955.1. Samples: 107679124. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:21,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-5.905')] [2023-12-27 20:44:21,313][106225] Updated weights for policy 1, policy_version 210311 (0.0008) [2023-12-27 20:44:21,369][106225] Updated weights for policy 1, policy_version 210321 (0.0007) [2023-12-27 20:44:21,370][106226] Updated weights for policy 0, policy_version 210201 (0.0010) [2023-12-27 20:44:21,436][106225] Updated weights for policy 1, policy_version 210331 (0.0009) [2023-12-27 20:44:21,441][106226] Updated weights for policy 0, policy_version 210211 (0.0008) [2023-12-27 20:44:21,503][106226] Updated weights for policy 0, policy_version 210221 (0.0006) [2023-12-27 20:44:22,151][106226] Updated weights for policy 0, policy_version 210231 (0.0008) [2023-12-27 20:44:22,201][106226] Updated weights for policy 0, policy_version 210241 (0.0009) [2023-12-27 20:44:22,215][106225] Updated weights for policy 1, policy_version 210341 (0.0007) [2023-12-27 20:44:22,257][106226] Updated weights for policy 0, policy_version 210251 (0.0007) [2023-12-27 20:44:22,274][106225] Updated weights for policy 1, policy_version 210351 (0.0008) [2023-12-27 20:44:22,336][106225] Updated weights for policy 1, policy_version 210361 (0.0008) [2023-12-27 20:44:22,954][106225] Updated weights for policy 1, policy_version 210371 (0.0008) [2023-12-27 20:44:23,013][106225] Updated weights for policy 1, policy_version 210381 (0.0009) [2023-12-27 20:44:23,075][106225] Updated weights for policy 1, policy_version 210391 (0.0007) [2023-12-27 20:44:23,077][106226] Updated weights for policy 0, policy_version 210261 (0.0008) [2023-12-27 20:44:23,138][106226] Updated weights for policy 0, policy_version 210271 (0.0009) [2023-12-27 20:44:23,194][106226] Updated weights for policy 0, policy_version 210281 (0.0008) [2023-12-27 20:44:23,820][106225] Updated weights for policy 1, policy_version 210401 (0.0007) [2023-12-27 20:44:23,878][106225] Updated weights for policy 1, policy_version 210411 (0.0009) [2023-12-27 20:44:23,879][106226] Updated weights for policy 0, policy_version 210291 (0.0009) [2023-12-27 20:44:23,936][106225] Updated weights for policy 1, policy_version 210421 (0.0008) [2023-12-27 20:44:23,937][106226] Updated weights for policy 0, policy_version 210301 (0.0010) [2023-12-27 20:44:23,994][106225] Updated weights for policy 1, policy_version 210431 (0.0010) [2023-12-27 20:44:23,997][106226] Updated weights for policy 0, policy_version 210311 (0.0010) [2023-12-27 20:44:24,709][106225] Updated weights for policy 1, policy_version 210441 (0.0007) [2023-12-27 20:44:24,741][106226] Updated weights for policy 0, policy_version 210321 (0.0010) [2023-12-27 20:44:24,765][106225] Updated weights for policy 1, policy_version 210451 (0.0009) [2023-12-27 20:44:24,799][106226] Updated weights for policy 0, policy_version 210331 (0.0008) [2023-12-27 20:44:24,828][106225] Updated weights for policy 1, policy_version 210461 (0.0008) [2023-12-27 20:44:24,859][106226] Updated weights for policy 0, policy_version 210341 (0.0007) [2023-12-27 20:44:24,916][106226] Updated weights for policy 0, policy_version 210351 (0.0008) [2023-12-27 20:44:25,530][106225] Updated weights for policy 1, policy_version 210471 (0.0008) [2023-12-27 20:44:25,588][106225] Updated weights for policy 1, policy_version 210481 (0.0007) [2023-12-27 20:44:25,608][106226] Updated weights for policy 0, policy_version 210361 (0.0008) [2023-12-27 20:44:25,638][106225] Updated weights for policy 1, policy_version 210491 (0.0005) [2023-12-27 20:44:25,675][106226] Updated weights for policy 0, policy_version 210371 (0.0009) [2023-12-27 20:44:25,733][106226] Updated weights for policy 0, policy_version 210381 (0.0005) [2023-12-27 20:44:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 107765760. Throughput: 0: 9858.7, 1: 9940.8. Samples: 107736760. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:26,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-6.314')] [2023-12-27 20:44:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000210496_53895168.pth... [2023-12-27 20:44:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000210384_53870592.pth... [2023-12-27 20:44:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000209344_53600256.pth [2023-12-27 20:44:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000209232_53575680.pth [2023-12-27 20:44:26,275][106226] Updated weights for policy 0, policy_version 210391 (0.0007) [2023-12-27 20:44:26,321][106226] Updated weights for policy 0, policy_version 210401 (0.0008) [2023-12-27 20:44:26,367][106226] Updated weights for policy 0, policy_version 210411 (0.0008) [2023-12-27 20:44:26,433][106225] Updated weights for policy 1, policy_version 210501 (0.0009) [2023-12-27 20:44:26,487][106225] Updated weights for policy 1, policy_version 210511 (0.0010) [2023-12-27 20:44:26,541][106225] Updated weights for policy 1, policy_version 210521 (0.0010) [2023-12-27 20:44:27,121][106226] Updated weights for policy 0, policy_version 210421 (0.0007) [2023-12-27 20:44:27,158][106225] Updated weights for policy 1, policy_version 210531 (0.0009) [2023-12-27 20:44:27,177][106226] Updated weights for policy 0, policy_version 210431 (0.0008) [2023-12-27 20:44:27,211][106225] Updated weights for policy 1, policy_version 210541 (0.0005) [2023-12-27 20:44:27,222][106226] Updated weights for policy 0, policy_version 210441 (0.0007) [2023-12-27 20:44:27,267][106225] Updated weights for policy 1, policy_version 210551 (0.0005) [2023-12-27 20:44:27,883][106225] Updated weights for policy 1, policy_version 210561 (0.0005) [2023-12-27 20:44:27,932][106225] Updated weights for policy 1, policy_version 210571 (0.0005) [2023-12-27 20:44:27,967][106226] Updated weights for policy 0, policy_version 210451 (0.0007) [2023-12-27 20:44:27,974][106225] Updated weights for policy 1, policy_version 210581 (0.0010) [2023-12-27 20:44:28,023][106226] Updated weights for policy 0, policy_version 210461 (0.0007) [2023-12-27 20:44:28,024][106225] Updated weights for policy 1, policy_version 210591 (0.0010) [2023-12-27 20:44:28,074][106226] Updated weights for policy 0, policy_version 210471 (0.0007) [2023-12-27 20:44:28,697][106225] Updated weights for policy 1, policy_version 210601 (0.0006) [2023-12-27 20:44:28,763][106225] Updated weights for policy 1, policy_version 210611 (0.0005) [2023-12-27 20:44:28,821][106225] Updated weights for policy 1, policy_version 210621 (0.0007) [2023-12-27 20:44:28,860][106226] Updated weights for policy 0, policy_version 210481 (0.0008) [2023-12-27 20:44:28,912][106226] Updated weights for policy 0, policy_version 210491 (0.0009) [2023-12-27 20:44:28,968][106226] Updated weights for policy 0, policy_version 210501 (0.0008) [2023-12-27 20:44:29,022][106226] Updated weights for policy 0, policy_version 210511 (0.0009) [2023-12-27 20:44:29,418][106225] Updated weights for policy 1, policy_version 210631 (0.0010) [2023-12-27 20:44:29,473][106225] Updated weights for policy 1, policy_version 210641 (0.0008) [2023-12-27 20:44:29,530][106225] Updated weights for policy 1, policy_version 210651 (0.0005) [2023-12-27 20:44:29,825][106226] Updated weights for policy 0, policy_version 210521 (0.0008) [2023-12-27 20:44:29,889][106226] Updated weights for policy 0, policy_version 210531 (0.0009) [2023-12-27 20:44:29,955][106226] Updated weights for policy 0, policy_version 210541 (0.0008) [2023-12-27 20:44:30,156][106225] Updated weights for policy 1, policy_version 210661 (0.0008) [2023-12-27 20:44:30,213][106225] Updated weights for policy 1, policy_version 210671 (0.0010) [2023-12-27 20:44:30,268][106225] Updated weights for policy 1, policy_version 210681 (0.0010) [2023-12-27 20:44:30,679][106226] Updated weights for policy 0, policy_version 210551 (0.0007) [2023-12-27 20:44:30,731][106226] Updated weights for policy 0, policy_version 210561 (0.0005) [2023-12-27 20:44:30,778][106226] Updated weights for policy 0, policy_version 210571 (0.0006) [2023-12-27 20:44:30,938][106225] Updated weights for policy 1, policy_version 210691 (0.0009) [2023-12-27 20:44:31,006][106225] Updated weights for policy 1, policy_version 210701 (0.0005) [2023-12-27 20:44:31,075][106225] Updated weights for policy 1, policy_version 210711 (0.0006) [2023-12-27 20:44:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 107872256. Throughput: 0: 9900.6, 1: 9986.4. Samples: 107857532. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:31,175][105115] Avg episode reward: [(0, '-4.940'), (1, '-6.027')] [2023-12-27 20:44:31,474][106226] Updated weights for policy 0, policy_version 210581 (0.0007) [2023-12-27 20:44:31,538][106226] Updated weights for policy 0, policy_version 210591 (0.0008) [2023-12-27 20:44:31,597][106226] Updated weights for policy 0, policy_version 210601 (0.0008) [2023-12-27 20:44:31,711][106225] Updated weights for policy 1, policy_version 210721 (0.0006) [2023-12-27 20:44:31,776][106225] Updated weights for policy 1, policy_version 210731 (0.0007) [2023-12-27 20:44:31,842][106225] Updated weights for policy 1, policy_version 210741 (0.0006) [2023-12-27 20:44:31,908][106225] Updated weights for policy 1, policy_version 210751 (0.0007) [2023-12-27 20:44:32,201][106226] Updated weights for policy 0, policy_version 210611 (0.0007) [2023-12-27 20:44:32,265][106226] Updated weights for policy 0, policy_version 210621 (0.0007) [2023-12-27 20:44:32,329][106226] Updated weights for policy 0, policy_version 210631 (0.0009) [2023-12-27 20:44:32,648][106225] Updated weights for policy 1, policy_version 210761 (0.0008) [2023-12-27 20:44:32,713][106225] Updated weights for policy 1, policy_version 210771 (0.0005) [2023-12-27 20:44:32,770][106225] Updated weights for policy 1, policy_version 210781 (0.0005) [2023-12-27 20:44:33,128][106226] Updated weights for policy 0, policy_version 210641 (0.0008) [2023-12-27 20:44:33,180][106226] Updated weights for policy 0, policy_version 210651 (0.0009) [2023-12-27 20:44:33,229][106226] Updated weights for policy 0, policy_version 210661 (0.0009) [2023-12-27 20:44:33,283][106226] Updated weights for policy 0, policy_version 210671 (0.0008) [2023-12-27 20:44:33,296][106225] Updated weights for policy 1, policy_version 210791 (0.0005) [2023-12-27 20:44:33,348][106225] Updated weights for policy 1, policy_version 210801 (0.0006) [2023-12-27 20:44:33,396][106225] Updated weights for policy 1, policy_version 210811 (0.0005) [2023-12-27 20:44:33,959][106225] Updated weights for policy 1, policy_version 210821 (0.0007) [2023-12-27 20:44:34,004][106225] Updated weights for policy 1, policy_version 210831 (0.0008) [2023-12-27 20:44:34,051][106225] Updated weights for policy 1, policy_version 210841 (0.0008) [2023-12-27 20:44:34,096][106226] Updated weights for policy 0, policy_version 210681 (0.0009) [2023-12-27 20:44:34,156][106226] Updated weights for policy 0, policy_version 210691 (0.0008) [2023-12-27 20:44:34,220][106226] Updated weights for policy 0, policy_version 210701 (0.0009) [2023-12-27 20:44:34,767][106225] Updated weights for policy 1, policy_version 210851 (0.0006) [2023-12-27 20:44:34,825][106225] Updated weights for policy 1, policy_version 210861 (0.0006) [2023-12-27 20:44:34,883][106225] Updated weights for policy 1, policy_version 210871 (0.0005) [2023-12-27 20:44:35,019][106226] Updated weights for policy 0, policy_version 210711 (0.0008) [2023-12-27 20:44:35,076][106226] Updated weights for policy 0, policy_version 210721 (0.0009) [2023-12-27 20:44:35,138][106226] Updated weights for policy 0, policy_version 210731 (0.0009) [2023-12-27 20:44:35,434][106225] Updated weights for policy 1, policy_version 210881 (0.0005) [2023-12-27 20:44:35,496][106225] Updated weights for policy 1, policy_version 210891 (0.0005) [2023-12-27 20:44:35,553][106225] Updated weights for policy 1, policy_version 210901 (0.0005) [2023-12-27 20:44:35,604][106225] Updated weights for policy 1, policy_version 210911 (0.0005) [2023-12-27 20:44:35,953][106226] Updated weights for policy 0, policy_version 210741 (0.0009) [2023-12-27 20:44:36,012][106226] Updated weights for policy 0, policy_version 210751 (0.0009) [2023-12-27 20:44:36,067][106226] Updated weights for policy 0, policy_version 210761 (0.0008) [2023-12-27 20:44:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 107970560. Throughput: 0: 9814.2, 1: 10052.7. Samples: 107978692. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:36,175][105115] Avg episode reward: [(0, '-4.998'), (1, '-6.377')] [2023-12-27 20:44:36,232][106225] Updated weights for policy 1, policy_version 210921 (0.0008) [2023-12-27 20:44:36,293][106225] Updated weights for policy 1, policy_version 210931 (0.0009) [2023-12-27 20:44:36,361][106225] Updated weights for policy 1, policy_version 210941 (0.0009) [2023-12-27 20:44:36,841][106226] Updated weights for policy 0, policy_version 210771 (0.0008) [2023-12-27 20:44:36,899][106226] Updated weights for policy 0, policy_version 210781 (0.0008) [2023-12-27 20:44:36,959][106226] Updated weights for policy 0, policy_version 210791 (0.0008) [2023-12-27 20:44:37,098][106225] Updated weights for policy 1, policy_version 210951 (0.0011) [2023-12-27 20:44:37,153][106225] Updated weights for policy 1, policy_version 210961 (0.0010) [2023-12-27 20:44:37,217][106225] Updated weights for policy 1, policy_version 210971 (0.0010) [2023-12-27 20:44:37,700][106226] Updated weights for policy 0, policy_version 210801 (0.0009) [2023-12-27 20:44:37,758][106226] Updated weights for policy 0, policy_version 210811 (0.0007) [2023-12-27 20:44:37,817][106226] Updated weights for policy 0, policy_version 210821 (0.0008) [2023-12-27 20:44:37,863][106226] Updated weights for policy 0, policy_version 210831 (0.0008) [2023-12-27 20:44:37,946][106225] Updated weights for policy 1, policy_version 210981 (0.0010) [2023-12-27 20:44:38,006][106225] Updated weights for policy 1, policy_version 210991 (0.0010) [2023-12-27 20:44:38,062][106225] Updated weights for policy 1, policy_version 211001 (0.0010) [2023-12-27 20:44:38,673][106226] Updated weights for policy 0, policy_version 210841 (0.0008) [2023-12-27 20:44:38,737][106226] Updated weights for policy 0, policy_version 210851 (0.0008) [2023-12-27 20:44:38,763][106225] Updated weights for policy 1, policy_version 211011 (0.0010) [2023-12-27 20:44:38,800][106226] Updated weights for policy 0, policy_version 210861 (0.0007) [2023-12-27 20:44:38,825][106225] Updated weights for policy 1, policy_version 211021 (0.0006) [2023-12-27 20:44:38,893][106225] Updated weights for policy 1, policy_version 211031 (0.0009) [2023-12-27 20:44:39,513][106226] Updated weights for policy 0, policy_version 210871 (0.0008) [2023-12-27 20:44:39,572][106226] Updated weights for policy 0, policy_version 210881 (0.0009) [2023-12-27 20:44:39,637][106226] Updated weights for policy 0, policy_version 210891 (0.0009) [2023-12-27 20:44:39,691][106225] Updated weights for policy 1, policy_version 211041 (0.0009) [2023-12-27 20:44:39,757][106225] Updated weights for policy 1, policy_version 211051 (0.0008) [2023-12-27 20:44:39,823][106225] Updated weights for policy 1, policy_version 211061 (0.0009) [2023-12-27 20:44:39,887][106225] Updated weights for policy 1, policy_version 211071 (0.0008) [2023-12-27 20:44:40,401][106226] Updated weights for policy 0, policy_version 210901 (0.0009) [2023-12-27 20:44:40,464][106226] Updated weights for policy 0, policy_version 210911 (0.0010) [2023-12-27 20:44:40,529][106226] Updated weights for policy 0, policy_version 210921 (0.0009) [2023-12-27 20:44:40,573][106225] Updated weights for policy 1, policy_version 211081 (0.0006) [2023-12-27 20:44:40,622][106225] Updated weights for policy 1, policy_version 211091 (0.0005) [2023-12-27 20:44:40,686][106225] Updated weights for policy 1, policy_version 211101 (0.0009) [2023-12-27 20:44:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 108060672. Throughput: 0: 9755.2, 1: 10094.6. Samples: 108035928. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:41,175][105115] Avg episode reward: [(0, '-5.334'), (1, '-6.265')] [2023-12-27 20:44:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000210928_54009856.pth... [2023-12-27 20:44:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000211104_54050816.pth... [2023-12-27 20:44:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000209808_53723136.pth [2023-12-27 20:44:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000209920_53747712.pth [2023-12-27 20:44:41,357][106226] Updated weights for policy 0, policy_version 210931 (0.0008) [2023-12-27 20:44:41,363][106225] Updated weights for policy 1, policy_version 211111 (0.0009) [2023-12-27 20:44:41,430][106226] Updated weights for policy 0, policy_version 210941 (0.0010) [2023-12-27 20:44:41,432][106225] Updated weights for policy 1, policy_version 211121 (0.0008) [2023-12-27 20:44:41,494][106225] Updated weights for policy 1, policy_version 211131 (0.0006) [2023-12-27 20:44:41,496][106226] Updated weights for policy 0, policy_version 210951 (0.0011) [2023-12-27 20:44:42,182][106226] Updated weights for policy 0, policy_version 210961 (0.0010) [2023-12-27 20:44:42,229][106225] Updated weights for policy 1, policy_version 211141 (0.0008) [2023-12-27 20:44:42,243][106226] Updated weights for policy 0, policy_version 210971 (0.0006) [2023-12-27 20:44:42,294][106225] Updated weights for policy 1, policy_version 211151 (0.0009) [2023-12-27 20:44:42,306][106226] Updated weights for policy 0, policy_version 210981 (0.0010) [2023-12-27 20:44:42,359][106225] Updated weights for policy 1, policy_version 211161 (0.0010) [2023-12-27 20:44:42,370][106226] Updated weights for policy 0, policy_version 210991 (0.0009) [2023-12-27 20:44:42,990][106225] Updated weights for policy 1, policy_version 211171 (0.0011) [2023-12-27 20:44:43,040][106225] Updated weights for policy 1, policy_version 211181 (0.0010) [2023-12-27 20:44:43,057][106226] Updated weights for policy 0, policy_version 211001 (0.0010) [2023-12-27 20:44:43,093][106225] Updated weights for policy 1, policy_version 211191 (0.0010) [2023-12-27 20:44:43,116][106226] Updated weights for policy 0, policy_version 211011 (0.0010) [2023-12-27 20:44:43,177][106226] Updated weights for policy 0, policy_version 211021 (0.0010) [2023-12-27 20:44:43,775][106226] Updated weights for policy 0, policy_version 211031 (0.0011) [2023-12-27 20:44:43,835][106226] Updated weights for policy 0, policy_version 211041 (0.0011) [2023-12-27 20:44:43,874][106225] Updated weights for policy 1, policy_version 211201 (0.0010) [2023-12-27 20:44:43,896][106226] Updated weights for policy 0, policy_version 211051 (0.0011) [2023-12-27 20:44:43,921][106225] Updated weights for policy 1, policy_version 211211 (0.0005) [2023-12-27 20:44:43,966][106225] Updated weights for policy 1, policy_version 211221 (0.0008) [2023-12-27 20:44:44,042][106225] Updated weights for policy 1, policy_version 211231 (0.0008) [2023-12-27 20:44:44,566][106226] Updated weights for policy 0, policy_version 211061 (0.0009) [2023-12-27 20:44:44,623][106226] Updated weights for policy 0, policy_version 211071 (0.0007) [2023-12-27 20:44:44,691][106226] Updated weights for policy 0, policy_version 211081 (0.0006) [2023-12-27 20:44:44,708][106225] Updated weights for policy 1, policy_version 211241 (0.0007) [2023-12-27 20:44:44,752][106225] Updated weights for policy 1, policy_version 211251 (0.0010) [2023-12-27 20:44:44,816][106225] Updated weights for policy 1, policy_version 211261 (0.0011) [2023-12-27 20:44:45,395][106226] Updated weights for policy 0, policy_version 211091 (0.0008) [2023-12-27 20:44:45,455][106226] Updated weights for policy 0, policy_version 211101 (0.0009) [2023-12-27 20:44:45,511][106226] Updated weights for policy 0, policy_version 211111 (0.0006) [2023-12-27 20:44:45,542][106225] Updated weights for policy 1, policy_version 211271 (0.0009) [2023-12-27 20:44:45,598][106225] Updated weights for policy 1, policy_version 211281 (0.0007) [2023-12-27 20:44:45,667][106225] Updated weights for policy 1, policy_version 211291 (0.0006) [2023-12-27 20:44:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 108158976. Throughput: 0: 9735.2, 1: 10110.9. Samples: 108151804. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:46,175][105115] Avg episode reward: [(0, '-5.059'), (1, '-6.429')] [2023-12-27 20:44:46,185][106226] Updated weights for policy 0, policy_version 211121 (0.0006) [2023-12-27 20:44:46,233][106226] Updated weights for policy 0, policy_version 211131 (0.0005) [2023-12-27 20:44:46,274][106225] Updated weights for policy 1, policy_version 211301 (0.0005) [2023-12-27 20:44:46,289][106226] Updated weights for policy 0, policy_version 211141 (0.0005) [2023-12-27 20:44:46,328][106225] Updated weights for policy 1, policy_version 211311 (0.0005) [2023-12-27 20:44:46,350][106226] Updated weights for policy 0, policy_version 211151 (0.0005) [2023-12-27 20:44:46,385][106225] Updated weights for policy 1, policy_version 211321 (0.0011) [2023-12-27 20:44:46,949][106225] Updated weights for policy 1, policy_version 211331 (0.0010) [2023-12-27 20:44:46,975][106226] Updated weights for policy 0, policy_version 211161 (0.0008) [2023-12-27 20:44:47,004][106225] Updated weights for policy 1, policy_version 211341 (0.0010) [2023-12-27 20:44:47,034][106226] Updated weights for policy 0, policy_version 211171 (0.0006) [2023-12-27 20:44:47,058][106225] Updated weights for policy 1, policy_version 211351 (0.0010) [2023-12-27 20:44:47,087][106226] Updated weights for policy 0, policy_version 211181 (0.0007) [2023-12-27 20:44:47,784][106225] Updated weights for policy 1, policy_version 211361 (0.0010) [2023-12-27 20:44:47,842][106226] Updated weights for policy 0, policy_version 211191 (0.0006) [2023-12-27 20:44:47,850][106225] Updated weights for policy 1, policy_version 211371 (0.0010) [2023-12-27 20:44:47,901][106226] Updated weights for policy 0, policy_version 211201 (0.0008) [2023-12-27 20:44:47,910][106225] Updated weights for policy 1, policy_version 211381 (0.0010) [2023-12-27 20:44:47,959][106226] Updated weights for policy 0, policy_version 211211 (0.0006) [2023-12-27 20:44:47,964][106225] Updated weights for policy 1, policy_version 211391 (0.0010) [2023-12-27 20:44:48,642][106225] Updated weights for policy 1, policy_version 211401 (0.0008) [2023-12-27 20:44:48,652][106226] Updated weights for policy 0, policy_version 211221 (0.0006) [2023-12-27 20:44:48,696][106225] Updated weights for policy 1, policy_version 211411 (0.0010) [2023-12-27 20:44:48,710][106226] Updated weights for policy 0, policy_version 211231 (0.0006) [2023-12-27 20:44:48,747][106225] Updated weights for policy 1, policy_version 211421 (0.0010) [2023-12-27 20:44:48,772][106226] Updated weights for policy 0, policy_version 211241 (0.0006) [2023-12-27 20:44:49,490][106225] Updated weights for policy 1, policy_version 211431 (0.0010) [2023-12-27 20:44:49,528][106226] Updated weights for policy 0, policy_version 211251 (0.0008) [2023-12-27 20:44:49,547][106225] Updated weights for policy 1, policy_version 211441 (0.0010) [2023-12-27 20:44:49,588][106226] Updated weights for policy 0, policy_version 211261 (0.0010) [2023-12-27 20:44:49,605][106225] Updated weights for policy 1, policy_version 211451 (0.0010) [2023-12-27 20:44:49,646][106226] Updated weights for policy 0, policy_version 211271 (0.0011) [2023-12-27 20:44:50,313][106225] Updated weights for policy 1, policy_version 211461 (0.0008) [2023-12-27 20:44:50,375][106225] Updated weights for policy 1, policy_version 211471 (0.0007) [2023-12-27 20:44:50,386][106226] Updated weights for policy 0, policy_version 211281 (0.0011) [2023-12-27 20:44:50,434][106225] Updated weights for policy 1, policy_version 211481 (0.0005) [2023-12-27 20:44:50,444][106226] Updated weights for policy 0, policy_version 211291 (0.0011) [2023-12-27 20:44:50,505][106226] Updated weights for policy 0, policy_version 211301 (0.0011) [2023-12-27 20:44:50,569][106226] Updated weights for policy 0, policy_version 211311 (0.0006) [2023-12-27 20:44:51,009][106225] Updated weights for policy 1, policy_version 211491 (0.0007) [2023-12-27 20:44:51,076][106225] Updated weights for policy 1, policy_version 211501 (0.0011) [2023-12-27 20:44:51,129][106225] Updated weights for policy 1, policy_version 211511 (0.0008) [2023-12-27 20:44:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 108257280. Throughput: 0: 9720.1, 1: 10142.7. Samples: 108272196. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:51,175][105115] Avg episode reward: [(0, '-4.898'), (1, '-6.271')] [2023-12-27 20:44:51,216][106226] Updated weights for policy 0, policy_version 211321 (0.0006) [2023-12-27 20:44:51,282][106226] Updated weights for policy 0, policy_version 211331 (0.0007) [2023-12-27 20:44:51,348][106226] Updated weights for policy 0, policy_version 211341 (0.0010) [2023-12-27 20:44:51,877][106225] Updated weights for policy 1, policy_version 211521 (0.0011) [2023-12-27 20:44:51,939][106225] Updated weights for policy 1, policy_version 211531 (0.0011) [2023-12-27 20:44:51,991][106225] Updated weights for policy 1, policy_version 211541 (0.0010) [2023-12-27 20:44:52,048][106225] Updated weights for policy 1, policy_version 211551 (0.0010) [2023-12-27 20:44:52,074][106226] Updated weights for policy 0, policy_version 211351 (0.0011) [2023-12-27 20:44:52,142][106226] Updated weights for policy 0, policy_version 211361 (0.0011) [2023-12-27 20:44:52,195][106226] Updated weights for policy 0, policy_version 211371 (0.0010) [2023-12-27 20:44:52,671][106225] Updated weights for policy 1, policy_version 211561 (0.0009) [2023-12-27 20:44:52,718][106225] Updated weights for policy 1, policy_version 211571 (0.0010) [2023-12-27 20:44:52,774][106225] Updated weights for policy 1, policy_version 211581 (0.0005) [2023-12-27 20:44:52,928][106226] Updated weights for policy 0, policy_version 211381 (0.0008) [2023-12-27 20:44:52,988][106226] Updated weights for policy 0, policy_version 211391 (0.0006) [2023-12-27 20:44:53,048][106226] Updated weights for policy 0, policy_version 211401 (0.0006) [2023-12-27 20:44:53,365][106225] Updated weights for policy 1, policy_version 211591 (0.0005) [2023-12-27 20:44:53,412][106225] Updated weights for policy 1, policy_version 211601 (0.0005) [2023-12-27 20:44:53,465][106225] Updated weights for policy 1, policy_version 211611 (0.0005) [2023-12-27 20:44:53,637][106226] Updated weights for policy 0, policy_version 211411 (0.0005) [2023-12-27 20:44:53,698][106226] Updated weights for policy 0, policy_version 211421 (0.0011) [2023-12-27 20:44:53,745][106226] Updated weights for policy 0, policy_version 211431 (0.0010) [2023-12-27 20:44:54,045][106225] Updated weights for policy 1, policy_version 211621 (0.0008) [2023-12-27 20:44:54,095][106225] Updated weights for policy 1, policy_version 211631 (0.0010) [2023-12-27 20:44:54,145][106225] Updated weights for policy 1, policy_version 211641 (0.0010) [2023-12-27 20:44:54,405][106226] Updated weights for policy 0, policy_version 211441 (0.0010) [2023-12-27 20:44:54,462][106226] Updated weights for policy 0, policy_version 211451 (0.0011) [2023-12-27 20:44:54,518][106226] Updated weights for policy 0, policy_version 211461 (0.0010) [2023-12-27 20:44:54,590][106226] Updated weights for policy 0, policy_version 211471 (0.0008) [2023-12-27 20:44:54,820][106225] Updated weights for policy 1, policy_version 211651 (0.0009) [2023-12-27 20:44:54,884][106225] Updated weights for policy 1, policy_version 211661 (0.0009) [2023-12-27 20:44:54,944][106225] Updated weights for policy 1, policy_version 211671 (0.0009) [2023-12-27 20:44:55,235][106226] Updated weights for policy 0, policy_version 211481 (0.0005) [2023-12-27 20:44:55,286][106226] Updated weights for policy 0, policy_version 211491 (0.0005) [2023-12-27 20:44:55,331][106226] Updated weights for policy 0, policy_version 211501 (0.0008) [2023-12-27 20:44:55,493][106225] Updated weights for policy 1, policy_version 211681 (0.0008) [2023-12-27 20:44:55,559][106225] Updated weights for policy 1, policy_version 211691 (0.0005) [2023-12-27 20:44:55,620][106225] Updated weights for policy 1, policy_version 211701 (0.0005) [2023-12-27 20:44:55,688][106225] Updated weights for policy 1, policy_version 211711 (0.0005) [2023-12-27 20:44:55,949][106226] Updated weights for policy 0, policy_version 211511 (0.0008) [2023-12-27 20:44:56,016][106226] Updated weights for policy 0, policy_version 211521 (0.0006) [2023-12-27 20:44:56,082][106226] Updated weights for policy 0, policy_version 211531 (0.0006) [2023-12-27 20:44:56,175][105115] Fps is (10 sec: 21298.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 108371968. Throughput: 0: 9689.0, 1: 10217.5. Samples: 108335544. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:44:56,176][105115] Avg episode reward: [(0, '-5.132'), (1, '-6.481')] [2023-12-27 20:44:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000211712_54206464.pth... [2023-12-27 20:44:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000211536_54165504.pth... [2023-12-27 20:44:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000210496_53895168.pth [2023-12-27 20:44:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000210384_53870592.pth [2023-12-27 20:44:56,284][106225] Updated weights for policy 1, policy_version 211721 (0.0008) [2023-12-27 20:44:56,341][106225] Updated weights for policy 1, policy_version 211731 (0.0009) [2023-12-27 20:44:56,400][106225] Updated weights for policy 1, policy_version 211741 (0.0008) [2023-12-27 20:44:56,692][106226] Updated weights for policy 0, policy_version 211541 (0.0007) [2023-12-27 20:44:56,748][106226] Updated weights for policy 0, policy_version 211551 (0.0007) [2023-12-27 20:44:56,806][106226] Updated weights for policy 0, policy_version 211561 (0.0008) [2023-12-27 20:44:57,140][106225] Updated weights for policy 1, policy_version 211751 (0.0009) [2023-12-27 20:44:57,201][106225] Updated weights for policy 1, policy_version 211761 (0.0009) [2023-12-27 20:44:57,256][106225] Updated weights for policy 1, policy_version 211771 (0.0008) [2023-12-27 20:44:57,491][106226] Updated weights for policy 0, policy_version 211571 (0.0008) [2023-12-27 20:44:57,546][106226] Updated weights for policy 0, policy_version 211581 (0.0005) [2023-12-27 20:44:57,598][106226] Updated weights for policy 0, policy_version 211591 (0.0005) [2023-12-27 20:44:58,071][106225] Updated weights for policy 1, policy_version 211781 (0.0008) [2023-12-27 20:44:58,119][106225] Updated weights for policy 1, policy_version 211791 (0.0008) [2023-12-27 20:44:58,161][106226] Updated weights for policy 0, policy_version 211601 (0.0005) [2023-12-27 20:44:58,171][106225] Updated weights for policy 1, policy_version 211801 (0.0007) [2023-12-27 20:44:58,223][106226] Updated weights for policy 0, policy_version 211611 (0.0009) [2023-12-27 20:44:58,289][106226] Updated weights for policy 0, policy_version 211621 (0.0009) [2023-12-27 20:44:58,365][106226] Updated weights for policy 0, policy_version 211631 (0.0009) [2023-12-27 20:44:59,037][106225] Updated weights for policy 1, policy_version 211811 (0.0009) [2023-12-27 20:44:59,095][106225] Updated weights for policy 1, policy_version 211821 (0.0010) [2023-12-27 20:44:59,148][106225] Updated weights for policy 1, policy_version 211831 (0.0008) [2023-12-27 20:44:59,180][106226] Updated weights for policy 0, policy_version 211641 (0.0006) [2023-12-27 20:44:59,247][106226] Updated weights for policy 0, policy_version 211651 (0.0008) [2023-12-27 20:44:59,312][106226] Updated weights for policy 0, policy_version 211661 (0.0008) [2023-12-27 20:44:59,820][106225] Updated weights for policy 1, policy_version 211841 (0.0008) [2023-12-27 20:44:59,891][106225] Updated weights for policy 1, policy_version 211851 (0.0009) [2023-12-27 20:44:59,957][106225] Updated weights for policy 1, policy_version 211861 (0.0010) [2023-12-27 20:44:59,999][106226] Updated weights for policy 0, policy_version 211671 (0.0010) [2023-12-27 20:45:00,020][106225] Updated weights for policy 1, policy_version 211871 (0.0010) [2023-12-27 20:45:00,055][106226] Updated weights for policy 0, policy_version 211681 (0.0010) [2023-12-27 20:45:00,122][106226] Updated weights for policy 0, policy_version 211691 (0.0011) [2023-12-27 20:45:00,735][106226] Updated weights for policy 0, policy_version 211701 (0.0008) [2023-12-27 20:45:00,751][106225] Updated weights for policy 1, policy_version 211881 (0.0010) [2023-12-27 20:45:00,790][106226] Updated weights for policy 0, policy_version 211711 (0.0005) [2023-12-27 20:45:00,804][106225] Updated weights for policy 1, policy_version 211891 (0.0010) [2023-12-27 20:45:00,851][106226] Updated weights for policy 0, policy_version 211721 (0.0005) [2023-12-27 20:45:00,854][106225] Updated weights for policy 1, policy_version 211901 (0.0010) [2023-12-27 20:45:01,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 108470272. Throughput: 0: 9787.2, 1: 10229.9. Samples: 108457584. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:45:01,175][105115] Avg episode reward: [(0, '-5.648'), (1, '-6.261')] [2023-12-27 20:45:01,564][106225] Updated weights for policy 1, policy_version 211911 (0.0009) [2023-12-27 20:45:01,567][106226] Updated weights for policy 0, policy_version 211731 (0.0008) [2023-12-27 20:45:01,621][106226] Updated weights for policy 0, policy_version 211741 (0.0011) [2023-12-27 20:45:01,630][106225] Updated weights for policy 1, policy_version 211921 (0.0007) [2023-12-27 20:45:01,683][106226] Updated weights for policy 0, policy_version 211751 (0.0006) [2023-12-27 20:45:01,693][106225] Updated weights for policy 1, policy_version 211931 (0.0008) [2023-12-27 20:45:02,417][106225] Updated weights for policy 1, policy_version 211941 (0.0010) [2023-12-27 20:45:02,445][106226] Updated weights for policy 0, policy_version 211761 (0.0009) [2023-12-27 20:45:02,475][106225] Updated weights for policy 1, policy_version 211951 (0.0010) [2023-12-27 20:45:02,508][106226] Updated weights for policy 0, policy_version 211771 (0.0009) [2023-12-27 20:45:02,536][106225] Updated weights for policy 1, policy_version 211961 (0.0010) [2023-12-27 20:45:02,569][106226] Updated weights for policy 0, policy_version 211781 (0.0009) [2023-12-27 20:45:02,625][106226] Updated weights for policy 0, policy_version 211791 (0.0010) [2023-12-27 20:45:03,263][106225] Updated weights for policy 1, policy_version 211971 (0.0010) [2023-12-27 20:45:03,318][106225] Updated weights for policy 1, policy_version 211981 (0.0010) [2023-12-27 20:45:03,353][106226] Updated weights for policy 0, policy_version 211801 (0.0009) [2023-12-27 20:45:03,375][106225] Updated weights for policy 1, policy_version 211991 (0.0010) [2023-12-27 20:45:03,408][106226] Updated weights for policy 0, policy_version 211811 (0.0006) [2023-12-27 20:45:03,475][106226] Updated weights for policy 0, policy_version 211821 (0.0009) [2023-12-27 20:45:04,014][106225] Updated weights for policy 1, policy_version 212001 (0.0007) [2023-12-27 20:45:04,072][106225] Updated weights for policy 1, policy_version 212011 (0.0006) [2023-12-27 20:45:04,088][106226] Updated weights for policy 0, policy_version 211831 (0.0009) [2023-12-27 20:45:04,137][106225] Updated weights for policy 1, policy_version 212021 (0.0006) [2023-12-27 20:45:04,147][106226] Updated weights for policy 0, policy_version 211841 (0.0011) [2023-12-27 20:45:04,199][106225] Updated weights for policy 1, policy_version 212031 (0.0006) [2023-12-27 20:45:04,200][106226] Updated weights for policy 0, policy_version 211851 (0.0010) [2023-12-27 20:45:04,830][106226] Updated weights for policy 0, policy_version 211861 (0.0009) [2023-12-27 20:45:04,877][106226] Updated weights for policy 0, policy_version 211871 (0.0010) [2023-12-27 20:45:04,921][106225] Updated weights for policy 1, policy_version 212041 (0.0005) [2023-12-27 20:45:04,934][106226] Updated weights for policy 0, policy_version 211881 (0.0010) [2023-12-27 20:45:04,977][106225] Updated weights for policy 1, policy_version 212051 (0.0008) [2023-12-27 20:45:05,030][106225] Updated weights for policy 1, policy_version 212061 (0.0008) [2023-12-27 20:45:05,677][106225] Updated weights for policy 1, policy_version 212071 (0.0007) [2023-12-27 20:45:05,703][106226] Updated weights for policy 0, policy_version 211891 (0.0010) [2023-12-27 20:45:05,739][106225] Updated weights for policy 1, policy_version 212081 (0.0006) [2023-12-27 20:45:05,760][106226] Updated weights for policy 0, policy_version 211901 (0.0011) [2023-12-27 20:45:05,794][106225] Updated weights for policy 1, policy_version 212091 (0.0005) [2023-12-27 20:45:05,807][106226] Updated weights for policy 0, policy_version 211911 (0.0010) [2023-12-27 20:45:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 108568576. Throughput: 0: 9780.7, 1: 10170.6. Samples: 108576932. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:45:06,175][105115] Avg episode reward: [(0, '-5.216'), (1, '-6.482')] [2023-12-27 20:45:06,518][106225] Updated weights for policy 1, policy_version 212101 (0.0006) [2023-12-27 20:45:06,540][106226] Updated weights for policy 0, policy_version 211921 (0.0009) [2023-12-27 20:45:06,581][106225] Updated weights for policy 1, policy_version 212111 (0.0008) [2023-12-27 20:45:06,607][106226] Updated weights for policy 0, policy_version 211931 (0.0010) [2023-12-27 20:45:06,640][106225] Updated weights for policy 1, policy_version 212121 (0.0010) [2023-12-27 20:45:06,670][106226] Updated weights for policy 0, policy_version 211941 (0.0010) [2023-12-27 20:45:06,733][106226] Updated weights for policy 0, policy_version 211951 (0.0011) [2023-12-27 20:45:07,325][106225] Updated weights for policy 1, policy_version 212131 (0.0010) [2023-12-27 20:45:07,345][106226] Updated weights for policy 0, policy_version 211961 (0.0006) [2023-12-27 20:45:07,385][106225] Updated weights for policy 1, policy_version 212141 (0.0009) [2023-12-27 20:45:07,412][106226] Updated weights for policy 0, policy_version 211971 (0.0007) [2023-12-27 20:45:07,443][106225] Updated weights for policy 1, policy_version 212151 (0.0007) [2023-12-27 20:45:07,478][106226] Updated weights for policy 0, policy_version 211981 (0.0007) [2023-12-27 20:45:08,073][106226] Updated weights for policy 0, policy_version 211991 (0.0008) [2023-12-27 20:45:08,091][106225] Updated weights for policy 1, policy_version 212161 (0.0007) [2023-12-27 20:45:08,123][106226] Updated weights for policy 0, policy_version 212001 (0.0008) [2023-12-27 20:45:08,139][106225] Updated weights for policy 1, policy_version 212171 (0.0007) [2023-12-27 20:45:08,171][106226] Updated weights for policy 0, policy_version 212011 (0.0008) [2023-12-27 20:45:08,189][106225] Updated weights for policy 1, policy_version 212181 (0.0006) [2023-12-27 20:45:08,245][106225] Updated weights for policy 1, policy_version 212191 (0.0007) [2023-12-27 20:45:08,915][106225] Updated weights for policy 1, policy_version 212201 (0.0008) [2023-12-27 20:45:08,946][106226] Updated weights for policy 0, policy_version 212021 (0.0006) [2023-12-27 20:45:08,973][106225] Updated weights for policy 1, policy_version 212211 (0.0008) [2023-12-27 20:45:08,995][106226] Updated weights for policy 0, policy_version 212031 (0.0008) [2023-12-27 20:45:09,035][106225] Updated weights for policy 1, policy_version 212221 (0.0005) [2023-12-27 20:45:09,045][106226] Updated weights for policy 0, policy_version 212041 (0.0008) [2023-12-27 20:45:09,704][106225] Updated weights for policy 1, policy_version 212231 (0.0007) [2023-12-27 20:45:09,771][106225] Updated weights for policy 1, policy_version 212241 (0.0008) [2023-12-27 20:45:09,839][106225] Updated weights for policy 1, policy_version 212251 (0.0007) [2023-12-27 20:45:09,887][106226] Updated weights for policy 0, policy_version 212051 (0.0009) [2023-12-27 20:45:09,955][106226] Updated weights for policy 0, policy_version 212061 (0.0009) [2023-12-27 20:45:10,012][106226] Updated weights for policy 0, policy_version 212071 (0.0009) [2023-12-27 20:45:10,480][106225] Updated weights for policy 1, policy_version 212261 (0.0008) [2023-12-27 20:45:10,543][106225] Updated weights for policy 1, policy_version 212271 (0.0007) [2023-12-27 20:45:10,606][106225] Updated weights for policy 1, policy_version 212281 (0.0008) [2023-12-27 20:45:10,819][106226] Updated weights for policy 0, policy_version 212081 (0.0008) [2023-12-27 20:45:10,875][106226] Updated weights for policy 0, policy_version 212091 (0.0008) [2023-12-27 20:45:10,941][106226] Updated weights for policy 0, policy_version 212101 (0.0006) [2023-12-27 20:45:11,001][106226] Updated weights for policy 0, policy_version 212111 (0.0009) [2023-12-27 20:45:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 108666880. Throughput: 0: 9816.2, 1: 10209.1. Samples: 108637904. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 20:45:11,176][105115] Avg episode reward: [(0, '-5.116'), (1, '-6.354')] [2023-12-27 20:45:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000212288_54353920.pth... [2023-12-27 20:45:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000212112_54312960.pth... [2023-12-27 20:45:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000211104_54050816.pth [2023-12-27 20:45:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000210928_54009856.pth [2023-12-27 20:45:11,331][106225] Updated weights for policy 1, policy_version 212291 (0.0009) [2023-12-27 20:45:11,407][106225] Updated weights for policy 1, policy_version 212301 (0.0012) [2023-12-27 20:45:11,470][106225] Updated weights for policy 1, policy_version 212311 (0.0010) [2023-12-27 20:45:11,819][106226] Updated weights for policy 0, policy_version 212121 (0.0009) [2023-12-27 20:45:11,887][106226] Updated weights for policy 0, policy_version 212131 (0.0009) [2023-12-27 20:45:11,945][106226] Updated weights for policy 0, policy_version 212141 (0.0009) [2023-12-27 20:45:12,169][106225] Updated weights for policy 1, policy_version 212321 (0.0011) [2023-12-27 20:45:12,226][106225] Updated weights for policy 1, policy_version 212331 (0.0010) [2023-12-27 20:45:12,289][106225] Updated weights for policy 1, policy_version 212341 (0.0008) [2023-12-27 20:45:12,359][106225] Updated weights for policy 1, policy_version 212351 (0.0008) [2023-12-27 20:45:12,710][106226] Updated weights for policy 0, policy_version 212151 (0.0009) [2023-12-27 20:45:12,764][106226] Updated weights for policy 0, policy_version 212161 (0.0009) [2023-12-27 20:45:12,826][106226] Updated weights for policy 0, policy_version 212171 (0.0009) [2023-12-27 20:45:13,030][106225] Updated weights for policy 1, policy_version 212361 (0.0009) [2023-12-27 20:45:13,091][106225] Updated weights for policy 1, policy_version 212371 (0.0009) [2023-12-27 20:45:13,144][106225] Updated weights for policy 1, policy_version 212381 (0.0008) [2023-12-27 20:45:13,533][106226] Updated weights for policy 0, policy_version 212181 (0.0008) [2023-12-27 20:45:13,597][106226] Updated weights for policy 0, policy_version 212191 (0.0008) [2023-12-27 20:45:13,658][106226] Updated weights for policy 0, policy_version 212201 (0.0008) [2023-12-27 20:45:13,779][106225] Updated weights for policy 1, policy_version 212391 (0.0009) [2023-12-27 20:45:13,842][106225] Updated weights for policy 1, policy_version 212401 (0.0010) [2023-12-27 20:45:13,905][106225] Updated weights for policy 1, policy_version 212411 (0.0010) [2023-12-27 20:45:14,321][106226] Updated weights for policy 0, policy_version 212211 (0.0007) [2023-12-27 20:45:14,375][106226] Updated weights for policy 0, policy_version 212221 (0.0005) [2023-12-27 20:45:14,430][106226] Updated weights for policy 0, policy_version 212231 (0.0006) [2023-12-27 20:45:14,523][106225] Updated weights for policy 1, policy_version 212421 (0.0009) [2023-12-27 20:45:14,577][106225] Updated weights for policy 1, policy_version 212432 (0.0008) [2023-12-27 20:45:14,637][106225] Updated weights for policy 1, policy_version 212442 (0.0006) [2023-12-27 20:45:15,123][106226] Updated weights for policy 0, policy_version 212241 (0.0006) [2023-12-27 20:45:15,194][106226] Updated weights for policy 0, policy_version 212251 (0.0010) [2023-12-27 20:45:15,211][106225] Updated weights for policy 1, policy_version 212452 (0.0006) [2023-12-27 20:45:15,268][106225] Updated weights for policy 1, policy_version 212462 (0.0007) [2023-12-27 20:45:15,274][106226] Updated weights for policy 0, policy_version 212261 (0.0008) [2023-12-27 20:45:15,335][106225] Updated weights for policy 1, policy_version 212472 (0.0008) [2023-12-27 20:45:15,337][106226] Updated weights for policy 0, policy_version 212271 (0.0006) [2023-12-27 20:45:15,998][106226] Updated weights for policy 0, policy_version 212281 (0.0005) [2023-12-27 20:45:16,017][106225] Updated weights for policy 1, policy_version 212482 (0.0007) [2023-12-27 20:45:16,057][106226] Updated weights for policy 0, policy_version 212291 (0.0008) [2023-12-27 20:45:16,067][106225] Updated weights for policy 1, policy_version 212492 (0.0006) [2023-12-27 20:45:16,120][106226] Updated weights for policy 0, policy_version 212301 (0.0006) [2023-12-27 20:45:16,124][106225] Updated weights for policy 1, policy_version 212502 (0.0005) [2023-12-27 20:45:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 108765184. Throughput: 0: 9760.6, 1: 10176.8. Samples: 108754720. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:16,176][105115] Avg episode reward: [(0, '-4.726'), (1, '-5.982')] [2023-12-27 20:45:16,180][106225] Updated weights for policy 1, policy_version 212512 (0.0008) [2023-12-27 20:45:16,716][106226] Updated weights for policy 0, policy_version 212311 (0.0006) [2023-12-27 20:45:16,773][106226] Updated weights for policy 0, policy_version 212321 (0.0005) [2023-12-27 20:45:16,837][106226] Updated weights for policy 0, policy_version 212331 (0.0007) [2023-12-27 20:45:16,872][106225] Updated weights for policy 1, policy_version 212522 (0.0006) [2023-12-27 20:45:16,920][106225] Updated weights for policy 1, policy_version 212532 (0.0005) [2023-12-27 20:45:16,977][106225] Updated weights for policy 1, policy_version 212542 (0.0007) [2023-12-27 20:45:17,532][106226] Updated weights for policy 0, policy_version 212341 (0.0008) [2023-12-27 20:45:17,589][106226] Updated weights for policy 0, policy_version 212351 (0.0007) [2023-12-27 20:45:17,641][106226] Updated weights for policy 0, policy_version 212361 (0.0006) [2023-12-27 20:45:17,656][106225] Updated weights for policy 1, policy_version 212552 (0.0006) [2023-12-27 20:45:17,722][106225] Updated weights for policy 1, policy_version 212562 (0.0006) [2023-12-27 20:45:17,790][106225] Updated weights for policy 1, policy_version 212572 (0.0009) [2023-12-27 20:45:18,310][106226] Updated weights for policy 0, policy_version 212371 (0.0006) [2023-12-27 20:45:18,375][106226] Updated weights for policy 0, policy_version 212381 (0.0008) [2023-12-27 20:45:18,418][106225] Updated weights for policy 1, policy_version 212582 (0.0010) [2023-12-27 20:45:18,436][106226] Updated weights for policy 0, policy_version 212391 (0.0008) [2023-12-27 20:45:18,483][106225] Updated weights for policy 1, policy_version 212592 (0.0008) [2023-12-27 20:45:18,546][106225] Updated weights for policy 1, policy_version 212602 (0.0007) [2023-12-27 20:45:19,135][106226] Updated weights for policy 0, policy_version 212401 (0.0006) [2023-12-27 20:45:19,204][106226] Updated weights for policy 0, policy_version 212411 (0.0010) [2023-12-27 20:45:19,269][106226] Updated weights for policy 0, policy_version 212421 (0.0010) [2023-12-27 20:45:19,269][106225] Updated weights for policy 1, policy_version 212612 (0.0009) [2023-12-27 20:45:19,327][106226] Updated weights for policy 0, policy_version 212431 (0.0011) [2023-12-27 20:45:19,331][106225] Updated weights for policy 1, policy_version 212622 (0.0010) [2023-12-27 20:45:19,397][106225] Updated weights for policy 1, policy_version 212632 (0.0008) [2023-12-27 20:45:20,012][106226] Updated weights for policy 0, policy_version 212441 (0.0011) [2023-12-27 20:45:20,066][106225] Updated weights for policy 1, policy_version 212642 (0.0009) [2023-12-27 20:45:20,074][106226] Updated weights for policy 0, policy_version 212451 (0.0011) [2023-12-27 20:45:20,132][106225] Updated weights for policy 1, policy_version 212652 (0.0008) [2023-12-27 20:45:20,143][106226] Updated weights for policy 0, policy_version 212461 (0.0011) [2023-12-27 20:45:20,202][106225] Updated weights for policy 1, policy_version 212662 (0.0008) [2023-12-27 20:45:20,268][106225] Updated weights for policy 1, policy_version 212672 (0.0007) [2023-12-27 20:45:20,796][106226] Updated weights for policy 0, policy_version 212471 (0.0007) [2023-12-27 20:45:20,866][106226] Updated weights for policy 0, policy_version 212481 (0.0008) [2023-12-27 20:45:20,927][106226] Updated weights for policy 0, policy_version 212491 (0.0008) [2023-12-27 20:45:20,993][106225] Updated weights for policy 1, policy_version 212682 (0.0008) [2023-12-27 20:45:21,062][106225] Updated weights for policy 1, policy_version 212692 (0.0008) [2023-12-27 20:45:21,122][106225] Updated weights for policy 1, policy_version 212702 (0.0008) [2023-12-27 20:45:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 108871680. Throughput: 0: 9862.0, 1: 10085.2. Samples: 108876320. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:21,175][105115] Avg episode reward: [(0, '-5.005'), (1, '-6.308')] [2023-12-27 20:45:21,650][106226] Updated weights for policy 0, policy_version 212501 (0.0007) [2023-12-27 20:45:21,705][106226] Updated weights for policy 0, policy_version 212511 (0.0011) [2023-12-27 20:45:21,775][106226] Updated weights for policy 0, policy_version 212521 (0.0011) [2023-12-27 20:45:21,848][106225] Updated weights for policy 1, policy_version 212712 (0.0008) [2023-12-27 20:45:21,914][106225] Updated weights for policy 1, policy_version 212722 (0.0008) [2023-12-27 20:45:21,974][106225] Updated weights for policy 1, policy_version 212732 (0.0007) [2023-12-27 20:45:22,549][106226] Updated weights for policy 0, policy_version 212531 (0.0008) [2023-12-27 20:45:22,618][106226] Updated weights for policy 0, policy_version 212541 (0.0010) [2023-12-27 20:45:22,680][106226] Updated weights for policy 0, policy_version 212551 (0.0007) [2023-12-27 20:45:22,681][106225] Updated weights for policy 1, policy_version 212742 (0.0006) [2023-12-27 20:45:22,741][106225] Updated weights for policy 1, policy_version 212752 (0.0007) [2023-12-27 20:45:22,810][106225] Updated weights for policy 1, policy_version 212762 (0.0009) [2023-12-27 20:45:23,358][106226] Updated weights for policy 0, policy_version 212561 (0.0006) [2023-12-27 20:45:23,424][106226] Updated weights for policy 0, policy_version 212571 (0.0009) [2023-12-27 20:45:23,490][106226] Updated weights for policy 0, policy_version 212581 (0.0008) [2023-12-27 20:45:23,516][106225] Updated weights for policy 1, policy_version 212772 (0.0009) [2023-12-27 20:45:23,561][106226] Updated weights for policy 0, policy_version 212591 (0.0008) [2023-12-27 20:45:23,580][106225] Updated weights for policy 1, policy_version 212782 (0.0007) [2023-12-27 20:45:23,635][106225] Updated weights for policy 1, policy_version 212792 (0.0009) [2023-12-27 20:45:24,212][106226] Updated weights for policy 0, policy_version 212601 (0.0010) [2023-12-27 20:45:24,271][106226] Updated weights for policy 0, policy_version 212611 (0.0010) [2023-12-27 20:45:24,325][106226] Updated weights for policy 0, policy_version 212621 (0.0006) [2023-12-27 20:45:24,391][106225] Updated weights for policy 1, policy_version 212802 (0.0009) [2023-12-27 20:45:24,448][106225] Updated weights for policy 1, policy_version 212812 (0.0009) [2023-12-27 20:45:24,504][106225] Updated weights for policy 1, policy_version 212822 (0.0010) [2023-12-27 20:45:24,560][106225] Updated weights for policy 1, policy_version 212832 (0.0010) [2023-12-27 20:45:25,024][106226] Updated weights for policy 0, policy_version 212631 (0.0006) [2023-12-27 20:45:25,090][106226] Updated weights for policy 0, policy_version 212641 (0.0010) [2023-12-27 20:45:25,154][106226] Updated weights for policy 0, policy_version 212651 (0.0009) [2023-12-27 20:45:25,202][106225] Updated weights for policy 1, policy_version 212842 (0.0007) [2023-12-27 20:45:25,264][106225] Updated weights for policy 1, policy_version 212852 (0.0007) [2023-12-27 20:45:25,323][106225] Updated weights for policy 1, policy_version 212862 (0.0006) [2023-12-27 20:45:25,883][106226] Updated weights for policy 0, policy_version 212661 (0.0006) [2023-12-27 20:45:25,937][106226] Updated weights for policy 0, policy_version 212671 (0.0006) [2023-12-27 20:45:25,967][106225] Updated weights for policy 1, policy_version 212872 (0.0008) [2023-12-27 20:45:25,986][106226] Updated weights for policy 0, policy_version 212681 (0.0006) [2023-12-27 20:45:26,018][106225] Updated weights for policy 1, policy_version 212882 (0.0007) [2023-12-27 20:45:26,078][106225] Updated weights for policy 1, policy_version 212892 (0.0006) [2023-12-27 20:45:26,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 108969984. Throughput: 0: 9879.2, 1: 10071.7. Samples: 108933720. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:26,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-6.594')] [2023-12-27 20:45:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000212896_54509568.pth... [2023-12-27 20:45:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000212688_54460416.pth... [2023-12-27 20:45:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000211712_54206464.pth [2023-12-27 20:45:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000211536_54165504.pth [2023-12-27 20:45:26,685][106226] Updated weights for policy 0, policy_version 212691 (0.0007) [2023-12-27 20:45:26,741][106226] Updated weights for policy 0, policy_version 212701 (0.0007) [2023-12-27 20:45:26,782][106225] Updated weights for policy 1, policy_version 212902 (0.0007) [2023-12-27 20:45:26,792][106226] Updated weights for policy 0, policy_version 212711 (0.0007) [2023-12-27 20:45:26,833][106225] Updated weights for policy 1, policy_version 212912 (0.0007) [2023-12-27 20:45:26,888][106225] Updated weights for policy 1, policy_version 212922 (0.0008) [2023-12-27 20:45:27,506][106226] Updated weights for policy 0, policy_version 212721 (0.0007) [2023-12-27 20:45:27,552][106226] Updated weights for policy 0, policy_version 212731 (0.0008) [2023-12-27 20:45:27,599][106226] Updated weights for policy 0, policy_version 212741 (0.0007) [2023-12-27 20:45:27,611][106225] Updated weights for policy 1, policy_version 212932 (0.0009) [2023-12-27 20:45:27,646][106226] Updated weights for policy 0, policy_version 212751 (0.0007) [2023-12-27 20:45:27,662][106225] Updated weights for policy 1, policy_version 212942 (0.0007) [2023-12-27 20:45:27,710][106225] Updated weights for policy 1, policy_version 212952 (0.0008) [2023-12-27 20:45:28,303][106225] Updated weights for policy 1, policy_version 212962 (0.0007) [2023-12-27 20:45:28,364][106226] Updated weights for policy 0, policy_version 212761 (0.0008) [2023-12-27 20:45:28,369][106225] Updated weights for policy 1, policy_version 212972 (0.0007) [2023-12-27 20:45:28,423][106226] Updated weights for policy 0, policy_version 212771 (0.0008) [2023-12-27 20:45:28,427][106225] Updated weights for policy 1, policy_version 212982 (0.0008) [2023-12-27 20:45:28,448][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000003 [2023-12-27 20:45:28,482][106225] Updated weights for policy 1, policy_version 212992 (0.0007) [2023-12-27 20:45:29,106][106226] Updated weights for policy 0, policy_version 212781 (0.0008) [2023-12-27 20:45:29,167][106226] Updated weights for policy 0, policy_version 212791 (0.0011) [2023-12-27 20:45:29,224][106226] Updated weights for policy 0, policy_version 212801 (0.0009) [2023-12-27 20:45:29,236][106225] Updated weights for policy 1, policy_version 213002 (0.0008) [2023-12-27 20:45:29,296][106225] Updated weights for policy 1, policy_version 213012 (0.0008) [2023-12-27 20:45:29,364][106225] Updated weights for policy 1, policy_version 213022 (0.0008) [2023-12-27 20:45:30,003][106226] Updated weights for policy 0, policy_version 212812 (0.0008) [2023-12-27 20:45:30,057][106226] Updated weights for policy 0, policy_version 212822 (0.0009) [2023-12-27 20:45:30,113][106226] Updated weights for policy 0, policy_version 212832 (0.0010) [2023-12-27 20:45:30,145][106225] Updated weights for policy 1, policy_version 213032 (0.0006) [2023-12-27 20:45:30,206][106225] Updated weights for policy 1, policy_version 213042 (0.0008) [2023-12-27 20:45:30,267][106225] Updated weights for policy 1, policy_version 213052 (0.0008) [2023-12-27 20:45:30,843][106226] Updated weights for policy 0, policy_version 212842 (0.0011) [2023-12-27 20:45:30,889][106226] Updated weights for policy 0, policy_version 212852 (0.0010) [2023-12-27 20:45:30,935][106226] Updated weights for policy 0, policy_version 212862 (0.0010) [2023-12-27 20:45:30,984][106226] Updated weights for policy 0, policy_version 212872 (0.0010) [2023-12-27 20:45:30,992][106225] Updated weights for policy 1, policy_version 213062 (0.0008) [2023-12-27 20:45:31,051][106225] Updated weights for policy 1, policy_version 213072 (0.0008) [2023-12-27 20:45:31,104][106225] Updated weights for policy 1, policy_version 213082 (0.0008) [2023-12-27 20:45:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 109068288. Throughput: 0: 9907.6, 1: 10120.5. Samples: 109053072. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:31,175][105115] Avg episode reward: [(0, '-5.046'), (1, '-6.217')] [2023-12-27 20:45:31,803][106225] Updated weights for policy 1, policy_version 213092 (0.0007) [2023-12-27 20:45:31,830][106226] Updated weights for policy 0, policy_version 212882 (0.0011) [2023-12-27 20:45:31,861][106225] Updated weights for policy 1, policy_version 213102 (0.0007) [2023-12-27 20:45:31,890][106226] Updated weights for policy 0, policy_version 212892 (0.0011) [2023-12-27 20:45:31,907][106225] Updated weights for policy 1, policy_version 213112 (0.0006) [2023-12-27 20:45:31,944][106226] Updated weights for policy 0, policy_version 212902 (0.0010) [2023-12-27 20:45:32,631][106225] Updated weights for policy 1, policy_version 213122 (0.0006) [2023-12-27 20:45:32,687][106225] Updated weights for policy 1, policy_version 213132 (0.0005) [2023-12-27 20:45:32,700][106226] Updated weights for policy 0, policy_version 212912 (0.0009) [2023-12-27 20:45:32,746][106225] Updated weights for policy 1, policy_version 213142 (0.0009) [2023-12-27 20:45:32,761][106226] Updated weights for policy 0, policy_version 212922 (0.0006) [2023-12-27 20:45:32,804][106225] Updated weights for policy 1, policy_version 213152 (0.0010) [2023-12-27 20:45:32,823][106226] Updated weights for policy 0, policy_version 212932 (0.0005) [2023-12-27 20:45:33,398][106226] Updated weights for policy 0, policy_version 212942 (0.0008) [2023-12-27 20:45:33,453][106226] Updated weights for policy 0, policy_version 212952 (0.0010) [2023-12-27 20:45:33,469][106225] Updated weights for policy 1, policy_version 213162 (0.0005) [2023-12-27 20:45:33,507][106226] Updated weights for policy 0, policy_version 212962 (0.0006) [2023-12-27 20:45:33,523][106225] Updated weights for policy 1, policy_version 213172 (0.0005) [2023-12-27 20:45:33,584][106225] Updated weights for policy 1, policy_version 213182 (0.0007) [2023-12-27 20:45:34,188][106225] Updated weights for policy 1, policy_version 213192 (0.0008) [2023-12-27 20:45:34,219][106226] Updated weights for policy 0, policy_version 212972 (0.0009) [2023-12-27 20:45:34,245][106225] Updated weights for policy 1, policy_version 213202 (0.0008) [2023-12-27 20:45:34,283][106226] Updated weights for policy 0, policy_version 212982 (0.0007) [2023-12-27 20:45:34,304][106225] Updated weights for policy 1, policy_version 213212 (0.0010) [2023-12-27 20:45:34,350][106226] Updated weights for policy 0, policy_version 212992 (0.0009) [2023-12-27 20:45:34,935][106225] Updated weights for policy 1, policy_version 213222 (0.0006) [2023-12-27 20:45:35,003][106225] Updated weights for policy 1, policy_version 213232 (0.0008) [2023-12-27 20:45:35,060][106225] Updated weights for policy 1, policy_version 213242 (0.0008) [2023-12-27 20:45:35,065][106226] Updated weights for policy 0, policy_version 213002 (0.0008) [2023-12-27 20:45:35,116][106226] Updated weights for policy 0, policy_version 213012 (0.0005) [2023-12-27 20:45:35,161][106226] Updated weights for policy 0, policy_version 213022 (0.0005) [2023-12-27 20:45:35,211][106226] Updated weights for policy 0, policy_version 213032 (0.0007) [2023-12-27 20:45:35,739][106225] Updated weights for policy 1, policy_version 213252 (0.0007) [2023-12-27 20:45:35,786][106225] Updated weights for policy 1, policy_version 213262 (0.0005) [2023-12-27 20:45:35,830][106225] Updated weights for policy 1, policy_version 213272 (0.0005) [2023-12-27 20:45:35,889][106226] Updated weights for policy 0, policy_version 213042 (0.0005) [2023-12-27 20:45:35,952][106226] Updated weights for policy 0, policy_version 213052 (0.0005) [2023-12-27 20:45:36,003][106226] Updated weights for policy 0, policy_version 213062 (0.0005) [2023-12-27 20:45:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 109166592. Throughput: 0: 9922.6, 1: 10105.1. Samples: 109173440. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:36,175][105115] Avg episode reward: [(0, '-5.130'), (1, '-6.049')] [2023-12-27 20:45:36,570][106225] Updated weights for policy 1, policy_version 213282 (0.0007) [2023-12-27 20:45:36,639][106225] Updated weights for policy 1, policy_version 213292 (0.0010) [2023-12-27 20:45:36,697][106225] Updated weights for policy 1, policy_version 213302 (0.0010) [2023-12-27 20:45:36,710][106226] Updated weights for policy 0, policy_version 213072 (0.0006) [2023-12-27 20:45:36,758][106225] Updated weights for policy 1, policy_version 213312 (0.0010) [2023-12-27 20:45:36,771][106226] Updated weights for policy 0, policy_version 213082 (0.0008) [2023-12-27 20:45:36,824][106226] Updated weights for policy 0, policy_version 213092 (0.0008) [2023-12-27 20:45:37,436][106225] Updated weights for policy 1, policy_version 213322 (0.0010) [2023-12-27 20:45:37,480][106226] Updated weights for policy 0, policy_version 213102 (0.0006) [2023-12-27 20:45:37,493][106225] Updated weights for policy 1, policy_version 213332 (0.0010) [2023-12-27 20:45:37,535][106226] Updated weights for policy 0, policy_version 213112 (0.0005) [2023-12-27 20:45:37,556][106225] Updated weights for policy 1, policy_version 213342 (0.0010) [2023-12-27 20:45:37,600][106226] Updated weights for policy 0, policy_version 213122 (0.0007) [2023-12-27 20:45:38,209][106225] Updated weights for policy 1, policy_version 213352 (0.0010) [2023-12-27 20:45:38,257][106226] Updated weights for policy 0, policy_version 213132 (0.0009) [2023-12-27 20:45:38,268][106225] Updated weights for policy 1, policy_version 213362 (0.0010) [2023-12-27 20:45:38,320][106225] Updated weights for policy 1, policy_version 213372 (0.0010) [2023-12-27 20:45:38,325][106226] Updated weights for policy 0, policy_version 213142 (0.0007) [2023-12-27 20:45:38,388][106226] Updated weights for policy 0, policy_version 213152 (0.0008) [2023-12-27 20:45:38,911][106225] Updated weights for policy 1, policy_version 213382 (0.0009) [2023-12-27 20:45:38,974][106225] Updated weights for policy 1, policy_version 213392 (0.0006) [2023-12-27 20:45:39,032][106225] Updated weights for policy 1, policy_version 213402 (0.0005) [2023-12-27 20:45:39,092][106226] Updated weights for policy 0, policy_version 213162 (0.0007) [2023-12-27 20:45:39,154][106226] Updated weights for policy 0, policy_version 213172 (0.0009) [2023-12-27 20:45:39,210][106226] Updated weights for policy 0, policy_version 213182 (0.0008) [2023-12-27 20:45:39,271][106226] Updated weights for policy 0, policy_version 213192 (0.0007) [2023-12-27 20:45:39,740][106225] Updated weights for policy 1, policy_version 213412 (0.0006) [2023-12-27 20:45:39,805][106225] Updated weights for policy 1, policy_version 213422 (0.0008) [2023-12-27 20:45:39,880][106225] Updated weights for policy 1, policy_version 213432 (0.0008) [2023-12-27 20:45:40,010][106226] Updated weights for policy 0, policy_version 213202 (0.0006) [2023-12-27 20:45:40,072][106226] Updated weights for policy 0, policy_version 213212 (0.0009) [2023-12-27 20:45:40,134][106226] Updated weights for policy 0, policy_version 213222 (0.0007) [2023-12-27 20:45:40,626][106225] Updated weights for policy 1, policy_version 213442 (0.0009) [2023-12-27 20:45:40,685][106225] Updated weights for policy 1, policy_version 213452 (0.0009) [2023-12-27 20:45:40,735][106225] Updated weights for policy 1, policy_version 213462 (0.0009) [2023-12-27 20:45:40,791][106225] Updated weights for policy 1, policy_version 213472 (0.0007) [2023-12-27 20:45:40,806][106226] Updated weights for policy 0, policy_version 213232 (0.0006) [2023-12-27 20:45:40,878][106226] Updated weights for policy 0, policy_version 213242 (0.0006) [2023-12-27 20:45:40,941][106226] Updated weights for policy 0, policy_version 213252 (0.0009) [2023-12-27 20:45:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 109264896. Throughput: 0: 9927.0, 1: 10047.1. Samples: 109234380. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:41,175][105115] Avg episode reward: [(0, '-5.203'), (1, '-5.898')] [2023-12-27 20:45:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000213472_54657024.pth... [2023-12-27 20:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000213256_54607872.pth... [2023-12-27 20:45:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000212112_54312960.pth [2023-12-27 20:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000212288_54353920.pth [2023-12-27 20:45:41,537][106225] Updated weights for policy 1, policy_version 213482 (0.0005) [2023-12-27 20:45:41,606][106225] Updated weights for policy 1, policy_version 213492 (0.0006) [2023-12-27 20:45:41,628][106226] Updated weights for policy 0, policy_version 213262 (0.0010) [2023-12-27 20:45:41,677][106225] Updated weights for policy 1, policy_version 213502 (0.0009) [2023-12-27 20:45:41,696][106226] Updated weights for policy 0, policy_version 213272 (0.0011) [2023-12-27 20:45:41,767][106226] Updated weights for policy 0, policy_version 213282 (0.0010) [2023-12-27 20:45:42,416][106225] Updated weights for policy 1, policy_version 213512 (0.0008) [2023-12-27 20:45:42,476][106225] Updated weights for policy 1, policy_version 213522 (0.0008) [2023-12-27 20:45:42,531][106226] Updated weights for policy 0, policy_version 213292 (0.0009) [2023-12-27 20:45:42,535][106225] Updated weights for policy 1, policy_version 213532 (0.0009) [2023-12-27 20:45:42,585][106226] Updated weights for policy 0, policy_version 213302 (0.0011) [2023-12-27 20:45:42,647][106226] Updated weights for policy 0, policy_version 213312 (0.0011) [2023-12-27 20:45:43,178][106225] Updated weights for policy 1, policy_version 213542 (0.0006) [2023-12-27 20:45:43,236][106225] Updated weights for policy 1, policy_version 213552 (0.0005) [2023-12-27 20:45:43,297][106225] Updated weights for policy 1, policy_version 213562 (0.0005) [2023-12-27 20:45:43,371][106226] Updated weights for policy 0, policy_version 213322 (0.0011) [2023-12-27 20:45:43,438][106226] Updated weights for policy 0, policy_version 213332 (0.0007) [2023-12-27 20:45:43,496][106226] Updated weights for policy 0, policy_version 213342 (0.0005) [2023-12-27 20:45:43,546][106226] Updated weights for policy 0, policy_version 213352 (0.0005) [2023-12-27 20:45:43,892][106225] Updated weights for policy 1, policy_version 213572 (0.0005) [2023-12-27 20:45:43,952][106225] Updated weights for policy 1, policy_version 213582 (0.0006) [2023-12-27 20:45:44,009][106225] Updated weights for policy 1, policy_version 213592 (0.0007) [2023-12-27 20:45:44,093][106226] Updated weights for policy 0, policy_version 213362 (0.0010) [2023-12-27 20:45:44,146][106226] Updated weights for policy 0, policy_version 213372 (0.0010) [2023-12-27 20:45:44,199][106226] Updated weights for policy 0, policy_version 213382 (0.0007) [2023-12-27 20:45:44,728][106225] Updated weights for policy 1, policy_version 213602 (0.0008) [2023-12-27 20:45:44,798][106225] Updated weights for policy 1, policy_version 213612 (0.0009) [2023-12-27 20:45:44,861][106225] Updated weights for policy 1, policy_version 213622 (0.0008) [2023-12-27 20:45:44,910][106226] Updated weights for policy 0, policy_version 213392 (0.0007) [2023-12-27 20:45:44,928][106225] Updated weights for policy 1, policy_version 213632 (0.0008) [2023-12-27 20:45:44,979][106226] Updated weights for policy 0, policy_version 213402 (0.0008) [2023-12-27 20:45:45,039][106226] Updated weights for policy 0, policy_version 213412 (0.0006) [2023-12-27 20:45:45,591][106225] Updated weights for policy 1, policy_version 213642 (0.0008) [2023-12-27 20:45:45,636][106225] Updated weights for policy 1, policy_version 213652 (0.0008) [2023-12-27 20:45:45,695][106225] Updated weights for policy 1, policy_version 213662 (0.0008) [2023-12-27 20:45:45,717][106226] Updated weights for policy 0, policy_version 213422 (0.0007) [2023-12-27 20:45:45,778][106226] Updated weights for policy 0, policy_version 213432 (0.0008) [2023-12-27 20:45:45,844][106226] Updated weights for policy 0, policy_version 213442 (0.0006) [2023-12-27 20:45:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 109363200. Throughput: 0: 9860.0, 1: 10034.3. Samples: 109352828. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:46,175][105115] Avg episode reward: [(0, '-5.138'), (1, '-6.374')] [2023-12-27 20:45:46,442][106226] Updated weights for policy 0, policy_version 213452 (0.0007) [2023-12-27 20:45:46,490][106225] Updated weights for policy 1, policy_version 213672 (0.0008) [2023-12-27 20:45:46,505][106226] Updated weights for policy 0, policy_version 213462 (0.0005) [2023-12-27 20:45:46,550][106225] Updated weights for policy 1, policy_version 213682 (0.0008) [2023-12-27 20:45:46,565][106226] Updated weights for policy 0, policy_version 213472 (0.0005) [2023-12-27 20:45:46,610][106225] Updated weights for policy 1, policy_version 213692 (0.0008) [2023-12-27 20:45:47,162][106226] Updated weights for policy 0, policy_version 213482 (0.0006) [2023-12-27 20:45:47,214][106226] Updated weights for policy 0, policy_version 213492 (0.0009) [2023-12-27 20:45:47,274][106226] Updated weights for policy 0, policy_version 213502 (0.0009) [2023-12-27 20:45:47,337][106226] Updated weights for policy 0, policy_version 213512 (0.0008) [2023-12-27 20:45:47,364][106225] Updated weights for policy 1, policy_version 213702 (0.0009) [2023-12-27 20:45:47,428][106225] Updated weights for policy 1, policy_version 213712 (0.0009) [2023-12-27 20:45:47,490][106225] Updated weights for policy 1, policy_version 213722 (0.0009) [2023-12-27 20:45:48,101][106226] Updated weights for policy 0, policy_version 213522 (0.0008) [2023-12-27 20:45:48,137][106225] Updated weights for policy 1, policy_version 213732 (0.0010) [2023-12-27 20:45:48,158][106226] Updated weights for policy 0, policy_version 213532 (0.0009) [2023-12-27 20:45:48,196][106225] Updated weights for policy 1, policy_version 213742 (0.0006) [2023-12-27 20:45:48,218][106226] Updated weights for policy 0, policy_version 213542 (0.0007) [2023-12-27 20:45:48,258][106225] Updated weights for policy 1, policy_version 213752 (0.0007) [2023-12-27 20:45:48,923][106226] Updated weights for policy 0, policy_version 213552 (0.0007) [2023-12-27 20:45:48,982][106226] Updated weights for policy 0, policy_version 213562 (0.0007) [2023-12-27 20:45:48,989][106225] Updated weights for policy 1, policy_version 213762 (0.0009) [2023-12-27 20:45:49,037][106226] Updated weights for policy 0, policy_version 213572 (0.0005) [2023-12-27 20:45:49,039][106225] Updated weights for policy 1, policy_version 213772 (0.0010) [2023-12-27 20:45:49,095][106225] Updated weights for policy 1, policy_version 213782 (0.0010) [2023-12-27 20:45:49,142][106225] Updated weights for policy 1, policy_version 213792 (0.0010) [2023-12-27 20:45:49,727][106226] Updated weights for policy 0, policy_version 213582 (0.0008) [2023-12-27 20:45:49,788][106226] Updated weights for policy 0, policy_version 213592 (0.0008) [2023-12-27 20:45:49,861][106226] Updated weights for policy 0, policy_version 213602 (0.0009) [2023-12-27 20:45:49,881][106225] Updated weights for policy 1, policy_version 213802 (0.0010) [2023-12-27 20:45:49,951][106225] Updated weights for policy 1, policy_version 213812 (0.0009) [2023-12-27 20:45:50,023][106225] Updated weights for policy 1, policy_version 213822 (0.0009) [2023-12-27 20:45:50,557][106226] Updated weights for policy 0, policy_version 213612 (0.0007) [2023-12-27 20:45:50,627][106226] Updated weights for policy 0, policy_version 213622 (0.0008) [2023-12-27 20:45:50,686][106226] Updated weights for policy 0, policy_version 213632 (0.0008) [2023-12-27 20:45:50,745][106225] Updated weights for policy 1, policy_version 213832 (0.0010) [2023-12-27 20:45:50,809][106225] Updated weights for policy 1, policy_version 213842 (0.0011) [2023-12-27 20:45:50,875][106225] Updated weights for policy 1, policy_version 213852 (0.0009) [2023-12-27 20:45:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 109461504. Throughput: 0: 9866.8, 1: 9987.3. Samples: 109470372. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:51,175][105115] Avg episode reward: [(0, '-5.244'), (1, '-6.028')] [2023-12-27 20:45:51,403][106226] Updated weights for policy 0, policy_version 213642 (0.0007) [2023-12-27 20:45:51,469][106226] Updated weights for policy 0, policy_version 213652 (0.0009) [2023-12-27 20:45:51,531][106226] Updated weights for policy 0, policy_version 213662 (0.0008) [2023-12-27 20:45:51,593][106226] Updated weights for policy 0, policy_version 213672 (0.0008) [2023-12-27 20:45:51,607][106225] Updated weights for policy 1, policy_version 213862 (0.0011) [2023-12-27 20:45:51,678][106225] Updated weights for policy 1, policy_version 213872 (0.0009) [2023-12-27 20:45:51,750][106225] Updated weights for policy 1, policy_version 213882 (0.0010) [2023-12-27 20:45:52,330][106226] Updated weights for policy 0, policy_version 213682 (0.0008) [2023-12-27 20:45:52,403][106226] Updated weights for policy 0, policy_version 213692 (0.0008) [2023-12-27 20:45:52,465][106226] Updated weights for policy 0, policy_version 213702 (0.0008) [2023-12-27 20:45:52,512][106225] Updated weights for policy 1, policy_version 213892 (0.0008) [2023-12-27 20:45:52,567][106225] Updated weights for policy 1, policy_version 213902 (0.0008) [2023-12-27 20:45:52,616][106225] Updated weights for policy 1, policy_version 213912 (0.0008) [2023-12-27 20:45:53,195][106226] Updated weights for policy 0, policy_version 213712 (0.0008) [2023-12-27 20:45:53,250][106226] Updated weights for policy 0, policy_version 213722 (0.0009) [2023-12-27 20:45:53,303][106226] Updated weights for policy 0, policy_version 213732 (0.0009) [2023-12-27 20:45:53,339][106225] Updated weights for policy 1, policy_version 213922 (0.0008) [2023-12-27 20:45:53,398][106225] Updated weights for policy 1, policy_version 213932 (0.0006) [2023-12-27 20:45:53,443][106225] Updated weights for policy 1, policy_version 213942 (0.0008) [2023-12-27 20:45:53,500][106225] Updated weights for policy 1, policy_version 213952 (0.0009) [2023-12-27 20:45:54,014][106226] Updated weights for policy 0, policy_version 213742 (0.0008) [2023-12-27 20:45:54,086][106226] Updated weights for policy 0, policy_version 213752 (0.0007) [2023-12-27 20:45:54,138][106226] Updated weights for policy 0, policy_version 213762 (0.0008) [2023-12-27 20:45:54,192][106225] Updated weights for policy 1, policy_version 213962 (0.0008) [2023-12-27 20:45:54,255][106225] Updated weights for policy 1, policy_version 213972 (0.0009) [2023-12-27 20:45:54,321][106225] Updated weights for policy 1, policy_version 213982 (0.0008) [2023-12-27 20:45:54,910][106226] Updated weights for policy 0, policy_version 213772 (0.0006) [2023-12-27 20:45:54,919][106225] Updated weights for policy 1, policy_version 213992 (0.0008) [2023-12-27 20:45:54,978][106225] Updated weights for policy 1, policy_version 214002 (0.0009) [2023-12-27 20:45:54,978][106226] Updated weights for policy 0, policy_version 213782 (0.0008) [2023-12-27 20:45:55,038][106225] Updated weights for policy 1, policy_version 214012 (0.0011) [2023-12-27 20:45:55,045][106226] Updated weights for policy 0, policy_version 213792 (0.0009) [2023-12-27 20:45:55,766][106225] Updated weights for policy 1, policy_version 214022 (0.0007) [2023-12-27 20:45:55,823][106225] Updated weights for policy 1, policy_version 214032 (0.0006) [2023-12-27 20:45:55,834][106226] Updated weights for policy 0, policy_version 213802 (0.0007) [2023-12-27 20:45:55,885][106225] Updated weights for policy 1, policy_version 214042 (0.0007) [2023-12-27 20:45:55,905][106226] Updated weights for policy 0, policy_version 213812 (0.0009) [2023-12-27 20:45:55,960][106226] Updated weights for policy 0, policy_version 213822 (0.0008) [2023-12-27 20:45:56,018][106226] Updated weights for policy 0, policy_version 213832 (0.0008) [2023-12-27 20:45:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 109559808. Throughput: 0: 9815.7, 1: 9917.3. Samples: 109525892. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:45:56,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.910')] [2023-12-27 20:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000214048_54804480.pth... [2023-12-27 20:45:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000213832_54755328.pth... [2023-12-27 20:45:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000212896_54509568.pth [2023-12-27 20:45:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000212688_54460416.pth [2023-12-27 20:45:56,579][106225] Updated weights for policy 1, policy_version 214052 (0.0006) [2023-12-27 20:45:56,641][106225] Updated weights for policy 1, policy_version 214062 (0.0006) [2023-12-27 20:45:56,698][106226] Updated weights for policy 0, policy_version 213842 (0.0007) [2023-12-27 20:45:56,703][106225] Updated weights for policy 1, policy_version 214072 (0.0006) [2023-12-27 20:45:56,745][106226] Updated weights for policy 0, policy_version 213852 (0.0007) [2023-12-27 20:45:56,805][106226] Updated weights for policy 0, policy_version 213862 (0.0005) [2023-12-27 20:45:57,379][106226] Updated weights for policy 0, policy_version 213872 (0.0007) [2023-12-27 20:45:57,405][106225] Updated weights for policy 1, policy_version 214082 (0.0005) [2023-12-27 20:45:57,433][106226] Updated weights for policy 0, policy_version 213882 (0.0009) [2023-12-27 20:45:57,456][106225] Updated weights for policy 1, policy_version 214092 (0.0005) [2023-12-27 20:45:57,491][106226] Updated weights for policy 0, policy_version 213892 (0.0008) [2023-12-27 20:45:57,505][106225] Updated weights for policy 1, policy_version 214102 (0.0006) [2023-12-27 20:45:57,561][106225] Updated weights for policy 1, policy_version 214112 (0.0008) [2023-12-27 20:45:58,166][106226] Updated weights for policy 0, policy_version 213902 (0.0009) [2023-12-27 20:45:58,213][106225] Updated weights for policy 1, policy_version 214122 (0.0007) [2023-12-27 20:45:58,231][106226] Updated weights for policy 0, policy_version 213912 (0.0009) [2023-12-27 20:45:58,273][106225] Updated weights for policy 1, policy_version 214132 (0.0007) [2023-12-27 20:45:58,298][106226] Updated weights for policy 0, policy_version 213922 (0.0008) [2023-12-27 20:45:58,349][106225] Updated weights for policy 1, policy_version 214142 (0.0007) [2023-12-27 20:45:59,050][106226] Updated weights for policy 0, policy_version 213932 (0.0009) [2023-12-27 20:45:59,103][106226] Updated weights for policy 0, policy_version 213942 (0.0008) [2023-12-27 20:45:59,157][106226] Updated weights for policy 0, policy_version 213952 (0.0008) [2023-12-27 20:45:59,163][106225] Updated weights for policy 1, policy_version 214152 (0.0006) [2023-12-27 20:45:59,217][106225] Updated weights for policy 1, policy_version 214162 (0.0006) [2023-12-27 20:45:59,287][106225] Updated weights for policy 1, policy_version 214172 (0.0009) [2023-12-27 20:45:59,918][106226] Updated weights for policy 0, policy_version 213962 (0.0007) [2023-12-27 20:45:59,984][106226] Updated weights for policy 0, policy_version 213972 (0.0008) [2023-12-27 20:46:00,049][106226] Updated weights for policy 0, policy_version 213982 (0.0008) [2023-12-27 20:46:00,060][106225] Updated weights for policy 1, policy_version 214182 (0.0010) [2023-12-27 20:46:00,105][106226] Updated weights for policy 0, policy_version 213992 (0.0006) [2023-12-27 20:46:00,111][106225] Updated weights for policy 1, policy_version 214192 (0.0010) [2023-12-27 20:46:00,161][106225] Updated weights for policy 1, policy_version 214202 (0.0010) [2023-12-27 20:46:00,818][106225] Updated weights for policy 1, policy_version 214212 (0.0009) [2023-12-27 20:46:00,868][106226] Updated weights for policy 0, policy_version 214002 (0.0007) [2023-12-27 20:46:00,879][106225] Updated weights for policy 1, policy_version 214222 (0.0005) [2023-12-27 20:46:00,928][106226] Updated weights for policy 0, policy_version 214012 (0.0006) [2023-12-27 20:46:00,944][106225] Updated weights for policy 1, policy_version 214232 (0.0005) [2023-12-27 20:46:00,995][106226] Updated weights for policy 0, policy_version 214022 (0.0006) [2023-12-27 20:46:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 109658112. Throughput: 0: 9857.1, 1: 9874.6. Samples: 109642644. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:46:01,175][105115] Avg episode reward: [(0, '-5.297'), (1, '-6.202')] [2023-12-27 20:46:01,604][106225] Updated weights for policy 1, policy_version 214242 (0.0006) [2023-12-27 20:46:01,671][106225] Updated weights for policy 1, policy_version 214252 (0.0008) [2023-12-27 20:46:01,727][106225] Updated weights for policy 1, policy_version 214262 (0.0008) [2023-12-27 20:46:01,765][106226] Updated weights for policy 0, policy_version 214032 (0.0009) [2023-12-27 20:46:01,787][106225] Updated weights for policy 1, policy_version 214272 (0.0007) [2023-12-27 20:46:01,824][106226] Updated weights for policy 0, policy_version 214042 (0.0009) [2023-12-27 20:46:01,883][106226] Updated weights for policy 0, policy_version 214052 (0.0006) [2023-12-27 20:46:02,540][106225] Updated weights for policy 1, policy_version 214282 (0.0011) [2023-12-27 20:46:02,585][106226] Updated weights for policy 0, policy_version 214062 (0.0006) [2023-12-27 20:46:02,609][106225] Updated weights for policy 1, policy_version 214292 (0.0010) [2023-12-27 20:46:02,646][106226] Updated weights for policy 0, policy_version 214072 (0.0006) [2023-12-27 20:46:02,672][106225] Updated weights for policy 1, policy_version 214302 (0.0008) [2023-12-27 20:46:02,700][106226] Updated weights for policy 0, policy_version 214082 (0.0006) [2023-12-27 20:46:03,291][106226] Updated weights for policy 0, policy_version 214092 (0.0008) [2023-12-27 20:46:03,357][106226] Updated weights for policy 0, policy_version 214102 (0.0011) [2023-12-27 20:46:03,367][106225] Updated weights for policy 1, policy_version 214312 (0.0007) [2023-12-27 20:46:03,418][106226] Updated weights for policy 0, policy_version 214112 (0.0011) [2023-12-27 20:46:03,434][106225] Updated weights for policy 1, policy_version 214322 (0.0009) [2023-12-27 20:46:03,492][106225] Updated weights for policy 1, policy_version 214332 (0.0010) [2023-12-27 20:46:04,109][106226] Updated weights for policy 0, policy_version 214122 (0.0010) [2023-12-27 20:46:04,165][106226] Updated weights for policy 0, policy_version 214132 (0.0006) [2023-12-27 20:46:04,228][106225] Updated weights for policy 1, policy_version 214342 (0.0011) [2023-12-27 20:46:04,234][106226] Updated weights for policy 0, policy_version 214142 (0.0007) [2023-12-27 20:46:04,296][106225] Updated weights for policy 1, policy_version 214352 (0.0010) [2023-12-27 20:46:04,297][106226] Updated weights for policy 0, policy_version 214152 (0.0008) [2023-12-27 20:46:04,358][106225] Updated weights for policy 1, policy_version 214362 (0.0011) [2023-12-27 20:46:05,000][106226] Updated weights for policy 0, policy_version 214162 (0.0006) [2023-12-27 20:46:05,022][106225] Updated weights for policy 1, policy_version 214372 (0.0009) [2023-12-27 20:46:05,052][106226] Updated weights for policy 0, policy_version 214172 (0.0006) [2023-12-27 20:46:05,085][106225] Updated weights for policy 1, policy_version 214382 (0.0006) [2023-12-27 20:46:05,101][106226] Updated weights for policy 0, policy_version 214182 (0.0007) [2023-12-27 20:46:05,143][106225] Updated weights for policy 1, policy_version 214392 (0.0005) [2023-12-27 20:46:05,650][106226] Updated weights for policy 0, policy_version 214192 (0.0006) [2023-12-27 20:46:05,696][106226] Updated weights for policy 0, policy_version 214202 (0.0005) [2023-12-27 20:46:05,752][106226] Updated weights for policy 0, policy_version 214212 (0.0006) [2023-12-27 20:46:05,915][106225] Updated weights for policy 1, policy_version 214402 (0.0008) [2023-12-27 20:46:05,966][106225] Updated weights for policy 1, policy_version 214412 (0.0008) [2023-12-27 20:46:06,012][106225] Updated weights for policy 1, policy_version 214422 (0.0007) [2023-12-27 20:46:06,060][106225] Updated weights for policy 1, policy_version 214432 (0.0007) [2023-12-27 20:46:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 109756416. Throughput: 0: 9874.9, 1: 9822.1. Samples: 109762680. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:46:06,175][105115] Avg episode reward: [(0, '-5.201'), (1, '-6.324')] [2023-12-27 20:46:06,431][106226] Updated weights for policy 0, policy_version 214222 (0.0009) [2023-12-27 20:46:06,492][106226] Updated weights for policy 0, policy_version 214232 (0.0011) [2023-12-27 20:46:06,556][106226] Updated weights for policy 0, policy_version 214242 (0.0011) [2023-12-27 20:46:06,728][106225] Updated weights for policy 1, policy_version 214442 (0.0007) [2023-12-27 20:46:06,791][106225] Updated weights for policy 1, policy_version 214452 (0.0008) [2023-12-27 20:46:06,837][106225] Updated weights for policy 1, policy_version 214462 (0.0006) [2023-12-27 20:46:07,280][106226] Updated weights for policy 0, policy_version 214252 (0.0011) [2023-12-27 20:46:07,346][106226] Updated weights for policy 0, policy_version 214262 (0.0008) [2023-12-27 20:46:07,399][106226] Updated weights for policy 0, policy_version 214272 (0.0009) [2023-12-27 20:46:07,492][106225] Updated weights for policy 1, policy_version 214472 (0.0008) [2023-12-27 20:46:07,544][106225] Updated weights for policy 1, policy_version 214482 (0.0006) [2023-12-27 20:46:07,599][106225] Updated weights for policy 1, policy_version 214492 (0.0009) [2023-12-27 20:46:07,974][106226] Updated weights for policy 0, policy_version 214282 (0.0007) [2023-12-27 20:46:08,045][106226] Updated weights for policy 0, policy_version 214292 (0.0009) [2023-12-27 20:46:08,105][106226] Updated weights for policy 0, policy_version 214302 (0.0010) [2023-12-27 20:46:08,154][106226] Updated weights for policy 0, policy_version 214312 (0.0010) [2023-12-27 20:46:08,301][106225] Updated weights for policy 1, policy_version 214502 (0.0007) [2023-12-27 20:46:08,372][106225] Updated weights for policy 1, policy_version 214512 (0.0008) [2023-12-27 20:46:08,437][106225] Updated weights for policy 1, policy_version 214522 (0.0008) [2023-12-27 20:46:08,860][106226] Updated weights for policy 0, policy_version 214322 (0.0011) [2023-12-27 20:46:08,928][106226] Updated weights for policy 0, policy_version 214332 (0.0011) [2023-12-27 20:46:08,989][106226] Updated weights for policy 0, policy_version 214343 (0.0010) [2023-12-27 20:46:09,149][106225] Updated weights for policy 1, policy_version 214532 (0.0009) [2023-12-27 20:46:09,195][106225] Updated weights for policy 1, policy_version 214542 (0.0010) [2023-12-27 20:46:09,257][106225] Updated weights for policy 1, policy_version 214552 (0.0007) [2023-12-27 20:46:09,769][106226] Updated weights for policy 0, policy_version 214353 (0.0009) [2023-12-27 20:46:09,837][106226] Updated weights for policy 0, policy_version 214363 (0.0010) [2023-12-27 20:46:09,901][106226] Updated weights for policy 0, policy_version 214373 (0.0008) [2023-12-27 20:46:10,038][106225] Updated weights for policy 1, policy_version 214562 (0.0008) [2023-12-27 20:46:10,110][106225] Updated weights for policy 1, policy_version 214572 (0.0009) [2023-12-27 20:46:10,179][106225] Updated weights for policy 1, policy_version 214582 (0.0009) [2023-12-27 20:46:10,231][106225] Updated weights for policy 1, policy_version 214592 (0.0009) [2023-12-27 20:46:10,601][106226] Updated weights for policy 0, policy_version 214383 (0.0009) [2023-12-27 20:46:10,655][106226] Updated weights for policy 0, policy_version 214393 (0.0009) [2023-12-27 20:46:10,718][106226] Updated weights for policy 0, policy_version 214403 (0.0005) [2023-12-27 20:46:10,992][106225] Updated weights for policy 1, policy_version 214602 (0.0009) [2023-12-27 20:46:11,064][106225] Updated weights for policy 1, policy_version 214612 (0.0008) [2023-12-27 20:46:11,121][106225] Updated weights for policy 1, policy_version 214622 (0.0007) [2023-12-27 20:46:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 109854720. Throughput: 0: 9898.3, 1: 9856.4. Samples: 109822680. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:46:11,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-5.839')] [2023-12-27 20:46:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000214624_54951936.pth... [2023-12-27 20:46:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000214408_54902784.pth... [2023-12-27 20:46:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000213472_54657024.pth [2023-12-27 20:46:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000213256_54607872.pth [2023-12-27 20:46:11,453][106226] Updated weights for policy 0, policy_version 214413 (0.0008) [2023-12-27 20:46:11,516][106226] Updated weights for policy 0, policy_version 214423 (0.0011) [2023-12-27 20:46:11,585][106226] Updated weights for policy 0, policy_version 214433 (0.0011) [2023-12-27 20:46:11,904][106225] Updated weights for policy 1, policy_version 214632 (0.0009) [2023-12-27 20:46:11,964][106225] Updated weights for policy 1, policy_version 214642 (0.0008) [2023-12-27 20:46:12,030][106225] Updated weights for policy 1, policy_version 214652 (0.0008) [2023-12-27 20:46:12,348][106226] Updated weights for policy 0, policy_version 214443 (0.0009) [2023-12-27 20:46:12,414][106226] Updated weights for policy 0, policy_version 214453 (0.0008) [2023-12-27 20:46:12,463][106226] Updated weights for policy 0, policy_version 214463 (0.0006) [2023-12-27 20:46:12,737][106225] Updated weights for policy 1, policy_version 214662 (0.0008) [2023-12-27 20:46:12,801][106225] Updated weights for policy 1, policy_version 214672 (0.0010) [2023-12-27 20:46:12,860][106225] Updated weights for policy 1, policy_version 214682 (0.0009) [2023-12-27 20:46:13,064][106226] Updated weights for policy 0, policy_version 214473 (0.0005) [2023-12-27 20:46:13,123][106226] Updated weights for policy 0, policy_version 214483 (0.0005) [2023-12-27 20:46:13,179][106226] Updated weights for policy 0, policy_version 214493 (0.0005) [2023-12-27 20:46:13,236][106226] Updated weights for policy 0, policy_version 214503 (0.0008) [2023-12-27 20:46:13,642][106225] Updated weights for policy 1, policy_version 214692 (0.0009) [2023-12-27 20:46:13,693][106225] Updated weights for policy 1, policy_version 214702 (0.0005) [2023-12-27 20:46:13,747][106225] Updated weights for policy 1, policy_version 214712 (0.0008) [2023-12-27 20:46:13,899][106226] Updated weights for policy 0, policy_version 214513 (0.0008) [2023-12-27 20:46:13,957][106226] Updated weights for policy 0, policy_version 214523 (0.0005) [2023-12-27 20:46:14,002][106226] Updated weights for policy 0, policy_version 214533 (0.0005) [2023-12-27 20:46:14,463][106225] Updated weights for policy 1, policy_version 214722 (0.0008) [2023-12-27 20:46:14,514][106225] Updated weights for policy 1, policy_version 214732 (0.0006) [2023-12-27 20:46:14,546][106226] Updated weights for policy 0, policy_version 214543 (0.0009) [2023-12-27 20:46:14,563][106225] Updated weights for policy 1, policy_version 214742 (0.0005) [2023-12-27 20:46:14,607][106226] Updated weights for policy 0, policy_version 214553 (0.0010) [2023-12-27 20:46:14,620][106225] Updated weights for policy 1, policy_version 214752 (0.0005) [2023-12-27 20:46:14,667][106226] Updated weights for policy 0, policy_version 214563 (0.0010) [2023-12-27 20:46:15,234][106225] Updated weights for policy 1, policy_version 214762 (0.0006) [2023-12-27 20:46:15,299][106225] Updated weights for policy 1, policy_version 214772 (0.0006) [2023-12-27 20:46:15,357][106225] Updated weights for policy 1, policy_version 214782 (0.0007) [2023-12-27 20:46:15,369][106226] Updated weights for policy 0, policy_version 214573 (0.0011) [2023-12-27 20:46:15,423][106226] Updated weights for policy 0, policy_version 214583 (0.0011) [2023-12-27 20:46:15,475][106226] Updated weights for policy 0, policy_version 214593 (0.0010) [2023-12-27 20:46:16,000][106225] Updated weights for policy 1, policy_version 214792 (0.0006) [2023-12-27 20:46:16,060][106225] Updated weights for policy 1, policy_version 214802 (0.0008) [2023-12-27 20:46:16,123][106225] Updated weights for policy 1, policy_version 214812 (0.0007) [2023-12-27 20:46:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 109953024. Throughput: 0: 9942.5, 1: 9767.3. Samples: 109940012. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:46:16,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.768')] [2023-12-27 20:46:16,206][106226] Updated weights for policy 0, policy_version 214603 (0.0011) [2023-12-27 20:46:16,264][106226] Updated weights for policy 0, policy_version 214613 (0.0010) [2023-12-27 20:46:16,329][106226] Updated weights for policy 0, policy_version 214623 (0.0008) [2023-12-27 20:46:16,792][106225] Updated weights for policy 1, policy_version 214822 (0.0008) [2023-12-27 20:46:16,849][106225] Updated weights for policy 1, policy_version 214832 (0.0008) [2023-12-27 20:46:16,905][106225] Updated weights for policy 1, policy_version 214842 (0.0007) [2023-12-27 20:46:17,018][106226] Updated weights for policy 0, policy_version 214633 (0.0008) [2023-12-27 20:46:17,068][106226] Updated weights for policy 0, policy_version 214643 (0.0010) [2023-12-27 20:46:17,121][106226] Updated weights for policy 0, policy_version 214653 (0.0010) [2023-12-27 20:46:17,184][106226] Updated weights for policy 0, policy_version 214663 (0.0010) [2023-12-27 20:46:17,591][106225] Updated weights for policy 1, policy_version 214852 (0.0008) [2023-12-27 20:46:17,653][106225] Updated weights for policy 1, policy_version 214862 (0.0007) [2023-12-27 20:46:17,696][106225] Updated weights for policy 1, policy_version 214872 (0.0008) [2023-12-27 20:46:17,881][106226] Updated weights for policy 0, policy_version 214673 (0.0010) [2023-12-27 20:46:17,935][106226] Updated weights for policy 0, policy_version 214683 (0.0010) [2023-12-27 20:46:17,988][106226] Updated weights for policy 0, policy_version 214693 (0.0010) [2023-12-27 20:46:18,426][106225] Updated weights for policy 1, policy_version 214882 (0.0008) [2023-12-27 20:46:18,489][106225] Updated weights for policy 1, policy_version 214892 (0.0005) [2023-12-27 20:46:18,549][106225] Updated weights for policy 1, policy_version 214902 (0.0006) [2023-12-27 20:46:18,606][106225] Updated weights for policy 1, policy_version 214912 (0.0005) [2023-12-27 20:46:18,730][106226] Updated weights for policy 0, policy_version 214703 (0.0011) [2023-12-27 20:46:18,795][106226] Updated weights for policy 0, policy_version 214713 (0.0011) [2023-12-27 20:46:18,860][106226] Updated weights for policy 0, policy_version 214723 (0.0011) [2023-12-27 20:46:19,264][106225] Updated weights for policy 1, policy_version 214922 (0.0008) [2023-12-27 20:46:19,329][106225] Updated weights for policy 1, policy_version 214932 (0.0007) [2023-12-27 20:46:19,398][106225] Updated weights for policy 1, policy_version 214942 (0.0011) [2023-12-27 20:46:19,562][106226] Updated weights for policy 0, policy_version 214733 (0.0009) [2023-12-27 20:46:19,630][106226] Updated weights for policy 0, policy_version 214743 (0.0010) [2023-12-27 20:46:19,694][106226] Updated weights for policy 0, policy_version 214753 (0.0009) [2023-12-27 20:46:20,046][106225] Updated weights for policy 1, policy_version 214952 (0.0008) [2023-12-27 20:46:20,096][106225] Updated weights for policy 1, policy_version 214962 (0.0008) [2023-12-27 20:46:20,157][106225] Updated weights for policy 1, policy_version 214972 (0.0008) [2023-12-27 20:46:20,463][106226] Updated weights for policy 0, policy_version 214763 (0.0011) [2023-12-27 20:46:20,519][106226] Updated weights for policy 0, policy_version 214773 (0.0009) [2023-12-27 20:46:20,568][106226] Updated weights for policy 0, policy_version 214783 (0.0007) [2023-12-27 20:46:20,917][106225] Updated weights for policy 1, policy_version 214982 (0.0011) [2023-12-27 20:46:20,984][106225] Updated weights for policy 1, policy_version 214992 (0.0011) [2023-12-27 20:46:21,051][106225] Updated weights for policy 1, policy_version 215002 (0.0011) [2023-12-27 20:46:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 110051328. Throughput: 0: 9898.8, 1: 9777.2. Samples: 110058864. Policy #0 lag: (min: 17.0, avg: 40.6, max: 49.0) [2023-12-27 20:46:21,175][105115] Avg episode reward: [(0, '-5.174'), (1, '-6.120')] [2023-12-27 20:46:21,398][106226] Updated weights for policy 0, policy_version 214793 (0.0008) [2023-12-27 20:46:21,457][106226] Updated weights for policy 0, policy_version 214803 (0.0009) [2023-12-27 20:46:21,514][106226] Updated weights for policy 0, policy_version 214813 (0.0009) [2023-12-27 20:46:21,565][106226] Updated weights for policy 0, policy_version 214823 (0.0010) [2023-12-27 20:46:21,801][106225] Updated weights for policy 1, policy_version 215012 (0.0009) [2023-12-27 20:46:21,857][106225] Updated weights for policy 1, policy_version 215022 (0.0008) [2023-12-27 20:46:21,913][106225] Updated weights for policy 1, policy_version 215032 (0.0008) [2023-12-27 20:46:22,355][106226] Updated weights for policy 0, policy_version 214833 (0.0008) [2023-12-27 20:46:22,425][106226] Updated weights for policy 0, policy_version 214843 (0.0010) [2023-12-27 20:46:22,490][106226] Updated weights for policy 0, policy_version 214853 (0.0011) [2023-12-27 20:46:22,682][106225] Updated weights for policy 1, policy_version 215042 (0.0008) [2023-12-27 20:46:22,743][106225] Updated weights for policy 1, policy_version 215052 (0.0006) [2023-12-27 20:46:22,813][106225] Updated weights for policy 1, policy_version 215062 (0.0007) [2023-12-27 20:46:22,872][106225] Updated weights for policy 1, policy_version 215072 (0.0008) [2023-12-27 20:46:23,189][106226] Updated weights for policy 0, policy_version 214863 (0.0011) [2023-12-27 20:46:23,242][106226] Updated weights for policy 0, policy_version 214873 (0.0010) [2023-12-27 20:46:23,299][106226] Updated weights for policy 0, policy_version 214883 (0.0010) [2023-12-27 20:46:23,437][106225] Updated weights for policy 1, policy_version 215082 (0.0005) [2023-12-27 20:46:23,490][106225] Updated weights for policy 1, policy_version 215092 (0.0005) [2023-12-27 20:46:23,554][106225] Updated weights for policy 1, policy_version 215102 (0.0005) [2023-12-27 20:46:24,015][106226] Updated weights for policy 0, policy_version 214893 (0.0010) [2023-12-27 20:46:24,049][106225] Updated weights for policy 1, policy_version 215112 (0.0006) [2023-12-27 20:46:24,069][106226] Updated weights for policy 0, policy_version 214903 (0.0010) [2023-12-27 20:46:24,102][106225] Updated weights for policy 1, policy_version 215122 (0.0006) [2023-12-27 20:46:24,119][106226] Updated weights for policy 0, policy_version 214913 (0.0010) [2023-12-27 20:46:24,156][106225] Updated weights for policy 1, policy_version 215132 (0.0007) [2023-12-27 20:46:24,829][106226] Updated weights for policy 0, policy_version 214923 (0.0010) [2023-12-27 20:46:24,872][106225] Updated weights for policy 1, policy_version 215142 (0.0008) [2023-12-27 20:46:24,882][106226] Updated weights for policy 0, policy_version 214933 (0.0010) [2023-12-27 20:46:24,928][106226] Updated weights for policy 0, policy_version 214943 (0.0010) [2023-12-27 20:46:24,934][106225] Updated weights for policy 1, policy_version 215152 (0.0006) [2023-12-27 20:46:24,986][106225] Updated weights for policy 1, policy_version 215162 (0.0005) [2023-12-27 20:46:25,660][106225] Updated weights for policy 1, policy_version 215172 (0.0008) [2023-12-27 20:46:25,668][106226] Updated weights for policy 0, policy_version 214953 (0.0010) [2023-12-27 20:46:25,714][106225] Updated weights for policy 1, policy_version 215182 (0.0010) [2023-12-27 20:46:25,732][106226] Updated weights for policy 0, policy_version 214963 (0.0011) [2023-12-27 20:46:25,765][106225] Updated weights for policy 1, policy_version 215192 (0.0010) [2023-12-27 20:46:25,792][106226] Updated weights for policy 0, policy_version 214973 (0.0010) [2023-12-27 20:46:25,855][106226] Updated weights for policy 0, policy_version 214983 (0.0011) [2023-12-27 20:46:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 110149632. Throughput: 0: 9852.7, 1: 9772.8. Samples: 110117528. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:26,176][105115] Avg episode reward: [(0, '-5.495'), (1, '-6.161')] [2023-12-27 20:46:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000215200_55099392.pth... [2023-12-27 20:46:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000214984_55050240.pth... [2023-12-27 20:46:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000214048_54804480.pth [2023-12-27 20:46:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000213832_54755328.pth [2023-12-27 20:46:26,368][106225] Updated weights for policy 1, policy_version 215202 (0.0009) [2023-12-27 20:46:26,421][106225] Updated weights for policy 1, policy_version 215212 (0.0006) [2023-12-27 20:46:26,475][106225] Updated weights for policy 1, policy_version 215222 (0.0008) [2023-12-27 20:46:26,528][106225] Updated weights for policy 1, policy_version 215232 (0.0007) [2023-12-27 20:46:26,548][106226] Updated weights for policy 0, policy_version 214993 (0.0010) [2023-12-27 20:46:26,597][106226] Updated weights for policy 0, policy_version 215003 (0.0010) [2023-12-27 20:46:26,651][106226] Updated weights for policy 0, policy_version 215013 (0.0010) [2023-12-27 20:46:27,233][106225] Updated weights for policy 1, policy_version 215242 (0.0010) [2023-12-27 20:46:27,284][106225] Updated weights for policy 1, policy_version 215252 (0.0010) [2023-12-27 20:46:27,312][106226] Updated weights for policy 0, policy_version 215023 (0.0007) [2023-12-27 20:46:27,339][106225] Updated weights for policy 1, policy_version 215262 (0.0009) [2023-12-27 20:46:27,370][106226] Updated weights for policy 0, policy_version 215033 (0.0007) [2023-12-27 20:46:27,421][106226] Updated weights for policy 0, policy_version 215043 (0.0007) [2023-12-27 20:46:28,036][106226] Updated weights for policy 0, policy_version 215053 (0.0008) [2023-12-27 20:46:28,073][106225] Updated weights for policy 1, policy_version 215272 (0.0009) [2023-12-27 20:46:28,097][106226] Updated weights for policy 0, policy_version 215063 (0.0006) [2023-12-27 20:46:28,122][106225] Updated weights for policy 1, policy_version 215282 (0.0010) [2023-12-27 20:46:28,139][106226] Updated weights for policy 0, policy_version 215073 (0.0005) [2023-12-27 20:46:28,167][106225] Updated weights for policy 1, policy_version 215292 (0.0010) [2023-12-27 20:46:28,851][106226] Updated weights for policy 0, policy_version 215083 (0.0006) [2023-12-27 20:46:28,917][106226] Updated weights for policy 0, policy_version 215093 (0.0008) [2023-12-27 20:46:28,926][106225] Updated weights for policy 1, policy_version 215302 (0.0010) [2023-12-27 20:46:28,974][106226] Updated weights for policy 0, policy_version 215103 (0.0007) [2023-12-27 20:46:28,979][106225] Updated weights for policy 1, policy_version 215312 (0.0010) [2023-12-27 20:46:29,026][106225] Updated weights for policy 1, policy_version 215322 (0.0010) [2023-12-27 20:46:29,631][106226] Updated weights for policy 0, policy_version 215113 (0.0005) [2023-12-27 20:46:29,692][106226] Updated weights for policy 0, policy_version 215123 (0.0005) [2023-12-27 20:46:29,740][106226] Updated weights for policy 0, policy_version 215133 (0.0006) [2023-12-27 20:46:29,774][106225] Updated weights for policy 1, policy_version 215332 (0.0010) [2023-12-27 20:46:29,796][106226] Updated weights for policy 0, policy_version 215143 (0.0006) [2023-12-27 20:46:29,825][106225] Updated weights for policy 1, policy_version 215342 (0.0010) [2023-12-27 20:46:29,890][106225] Updated weights for policy 1, policy_version 215352 (0.0007) [2023-12-27 20:46:30,433][106226] Updated weights for policy 0, policy_version 215153 (0.0006) [2023-12-27 20:46:30,495][106226] Updated weights for policy 0, policy_version 215163 (0.0005) [2023-12-27 20:46:30,547][106226] Updated weights for policy 0, policy_version 215173 (0.0005) [2023-12-27 20:46:30,548][106225] Updated weights for policy 1, policy_version 215362 (0.0009) [2023-12-27 20:46:30,606][106225] Updated weights for policy 1, policy_version 215372 (0.0006) [2023-12-27 20:46:30,666][106225] Updated weights for policy 1, policy_version 215382 (0.0010) [2023-12-27 20:46:30,726][106225] Updated weights for policy 1, policy_version 215392 (0.0010) [2023-12-27 20:46:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 110247936. Throughput: 0: 9897.9, 1: 9800.5. Samples: 110239252. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:31,175][105115] Avg episode reward: [(0, '-5.152'), (1, '-5.845')] [2023-12-27 20:46:31,187][106226] Updated weights for policy 0, policy_version 215183 (0.0008) [2023-12-27 20:46:31,248][106226] Updated weights for policy 0, policy_version 215193 (0.0008) [2023-12-27 20:46:31,320][106226] Updated weights for policy 0, policy_version 215203 (0.0008) [2023-12-27 20:46:31,456][106225] Updated weights for policy 1, policy_version 215402 (0.0011) [2023-12-27 20:46:31,517][106225] Updated weights for policy 1, policy_version 215412 (0.0010) [2023-12-27 20:46:31,576][106225] Updated weights for policy 1, policy_version 215422 (0.0010) [2023-12-27 20:46:32,054][106226] Updated weights for policy 0, policy_version 215213 (0.0007) [2023-12-27 20:46:32,123][106226] Updated weights for policy 0, policy_version 215223 (0.0005) [2023-12-27 20:46:32,177][106226] Updated weights for policy 0, policy_version 215233 (0.0007) [2023-12-27 20:46:32,270][106225] Updated weights for policy 1, policy_version 215432 (0.0010) [2023-12-27 20:46:32,334][106225] Updated weights for policy 1, policy_version 215442 (0.0010) [2023-12-27 20:46:32,398][106225] Updated weights for policy 1, policy_version 215452 (0.0010) [2023-12-27 20:46:32,854][106226] Updated weights for policy 0, policy_version 215243 (0.0007) [2023-12-27 20:46:32,908][106226] Updated weights for policy 0, policy_version 215253 (0.0009) [2023-12-27 20:46:32,965][106226] Updated weights for policy 0, policy_version 215263 (0.0006) [2023-12-27 20:46:33,077][106225] Updated weights for policy 1, policy_version 215462 (0.0006) [2023-12-27 20:46:33,131][106225] Updated weights for policy 1, policy_version 215472 (0.0009) [2023-12-27 20:46:33,192][106225] Updated weights for policy 1, policy_version 215482 (0.0008) [2023-12-27 20:46:33,545][106226] Updated weights for policy 0, policy_version 215273 (0.0006) [2023-12-27 20:46:33,608][106226] Updated weights for policy 0, policy_version 215283 (0.0010) [2023-12-27 20:46:33,657][106226] Updated weights for policy 0, policy_version 215293 (0.0010) [2023-12-27 20:46:33,706][106226] Updated weights for policy 0, policy_version 215303 (0.0010) [2023-12-27 20:46:33,809][106225] Updated weights for policy 1, policy_version 215492 (0.0010) [2023-12-27 20:46:33,859][106225] Updated weights for policy 1, policy_version 215502 (0.0010) [2023-12-27 20:46:33,912][106225] Updated weights for policy 1, policy_version 215512 (0.0010) [2023-12-27 20:46:34,428][106226] Updated weights for policy 0, policy_version 215313 (0.0010) [2023-12-27 20:46:34,496][106226] Updated weights for policy 0, policy_version 215323 (0.0010) [2023-12-27 20:46:34,563][106226] Updated weights for policy 0, policy_version 215333 (0.0009) [2023-12-27 20:46:34,660][106225] Updated weights for policy 1, policy_version 215522 (0.0010) [2023-12-27 20:46:34,708][106225] Updated weights for policy 1, policy_version 215532 (0.0010) [2023-12-27 20:46:34,758][106225] Updated weights for policy 1, policy_version 215542 (0.0010) [2023-12-27 20:46:34,804][106225] Updated weights for policy 1, policy_version 215552 (0.0010) [2023-12-27 20:46:35,253][106226] Updated weights for policy 0, policy_version 215343 (0.0010) [2023-12-27 20:46:35,299][106226] Updated weights for policy 0, policy_version 215353 (0.0010) [2023-12-27 20:46:35,352][106226] Updated weights for policy 0, policy_version 215363 (0.0010) [2023-12-27 20:46:35,445][106225] Updated weights for policy 1, policy_version 215562 (0.0005) [2023-12-27 20:46:35,497][106225] Updated weights for policy 1, policy_version 215572 (0.0007) [2023-12-27 20:46:35,545][106225] Updated weights for policy 1, policy_version 215582 (0.0005) [2023-12-27 20:46:36,013][106226] Updated weights for policy 0, policy_version 215373 (0.0010) [2023-12-27 20:46:36,070][106226] Updated weights for policy 0, policy_version 215383 (0.0010) [2023-12-27 20:46:36,132][106226] Updated weights for policy 0, policy_version 215393 (0.0008) [2023-12-27 20:46:36,141][106225] Updated weights for policy 1, policy_version 215592 (0.0007) [2023-12-27 20:46:36,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 110346240. Throughput: 0: 9924.5, 1: 9900.9. Samples: 110362512. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:36,175][105115] Avg episode reward: [(0, '-5.091'), (1, '-6.170')] [2023-12-27 20:46:36,199][106225] Updated weights for policy 1, policy_version 215602 (0.0007) [2023-12-27 20:46:36,255][106225] Updated weights for policy 1, policy_version 215612 (0.0008) [2023-12-27 20:46:36,860][106226] Updated weights for policy 0, policy_version 215403 (0.0011) [2023-12-27 20:46:36,927][106226] Updated weights for policy 0, policy_version 215413 (0.0011) [2023-12-27 20:46:36,996][106226] Updated weights for policy 0, policy_version 215423 (0.0011) [2023-12-27 20:46:37,006][106225] Updated weights for policy 1, policy_version 215622 (0.0008) [2023-12-27 20:46:37,065][106225] Updated weights for policy 1, policy_version 215632 (0.0006) [2023-12-27 20:46:37,119][106225] Updated weights for policy 1, policy_version 215642 (0.0008) [2023-12-27 20:46:37,709][106226] Updated weights for policy 0, policy_version 215433 (0.0011) [2023-12-27 20:46:37,774][106226] Updated weights for policy 0, policy_version 215443 (0.0010) [2023-12-27 20:46:37,834][106226] Updated weights for policy 0, policy_version 215453 (0.0009) [2023-12-27 20:46:37,864][106225] Updated weights for policy 1, policy_version 215652 (0.0007) [2023-12-27 20:46:37,897][106226] Updated weights for policy 0, policy_version 215463 (0.0010) [2023-12-27 20:46:37,916][106225] Updated weights for policy 1, policy_version 215662 (0.0007) [2023-12-27 20:46:37,971][106225] Updated weights for policy 1, policy_version 215672 (0.0008) [2023-12-27 20:46:38,524][106226] Updated weights for policy 0, policy_version 215473 (0.0008) [2023-12-27 20:46:38,586][106226] Updated weights for policy 0, policy_version 215483 (0.0008) [2023-12-27 20:46:38,648][106226] Updated weights for policy 0, policy_version 215493 (0.0008) [2023-12-27 20:46:38,746][106225] Updated weights for policy 1, policy_version 215682 (0.0009) [2023-12-27 20:46:38,807][106225] Updated weights for policy 1, policy_version 215692 (0.0010) [2023-12-27 20:46:38,864][106225] Updated weights for policy 1, policy_version 215702 (0.0010) [2023-12-27 20:46:38,926][106225] Updated weights for policy 1, policy_version 215712 (0.0010) [2023-12-27 20:46:39,369][106226] Updated weights for policy 0, policy_version 215503 (0.0009) [2023-12-27 20:46:39,444][106226] Updated weights for policy 0, policy_version 215513 (0.0012) [2023-12-27 20:46:39,505][106226] Updated weights for policy 0, policy_version 215523 (0.0008) [2023-12-27 20:46:39,706][106225] Updated weights for policy 1, policy_version 215722 (0.0011) [2023-12-27 20:46:39,769][106225] Updated weights for policy 1, policy_version 215732 (0.0011) [2023-12-27 20:46:39,837][106225] Updated weights for policy 1, policy_version 215742 (0.0010) [2023-12-27 20:46:40,195][106226] Updated weights for policy 0, policy_version 215533 (0.0008) [2023-12-27 20:46:40,260][106226] Updated weights for policy 0, policy_version 215543 (0.0006) [2023-12-27 20:46:40,328][106226] Updated weights for policy 0, policy_version 215553 (0.0006) [2023-12-27 20:46:40,568][106225] Updated weights for policy 1, policy_version 215752 (0.0009) [2023-12-27 20:46:40,628][106225] Updated weights for policy 1, policy_version 215762 (0.0009) [2023-12-27 20:46:40,691][106225] Updated weights for policy 1, policy_version 215772 (0.0010) [2023-12-27 20:46:40,933][106226] Updated weights for policy 0, policy_version 215563 (0.0007) [2023-12-27 20:46:40,992][106226] Updated weights for policy 0, policy_version 215573 (0.0007) [2023-12-27 20:46:41,061][106226] Updated weights for policy 0, policy_version 215583 (0.0007) [2023-12-27 20:46:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 110452736. Throughput: 0: 9950.4, 1: 9923.6. Samples: 110420220. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:41,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-6.162')] [2023-12-27 20:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000215776_55246848.pth... [2023-12-27 20:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000215592_55205888.pth... [2023-12-27 20:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000214624_54951936.pth [2023-12-27 20:46:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000214408_54902784.pth [2023-12-27 20:46:41,482][106225] Updated weights for policy 1, policy_version 215782 (0.0008) [2023-12-27 20:46:41,544][106225] Updated weights for policy 1, policy_version 215792 (0.0008) [2023-12-27 20:46:41,609][106225] Updated weights for policy 1, policy_version 215802 (0.0008) [2023-12-27 20:46:41,763][106226] Updated weights for policy 0, policy_version 215593 (0.0008) [2023-12-27 20:46:41,826][106226] Updated weights for policy 0, policy_version 215603 (0.0008) [2023-12-27 20:46:41,884][106226] Updated weights for policy 0, policy_version 215613 (0.0008) [2023-12-27 20:46:41,947][106226] Updated weights for policy 0, policy_version 215623 (0.0006) [2023-12-27 20:46:42,312][106225] Updated weights for policy 1, policy_version 215812 (0.0007) [2023-12-27 20:46:42,386][106225] Updated weights for policy 1, policy_version 215822 (0.0008) [2023-12-27 20:46:42,451][106225] Updated weights for policy 1, policy_version 215832 (0.0010) [2023-12-27 20:46:42,663][106226] Updated weights for policy 0, policy_version 215633 (0.0009) [2023-12-27 20:46:42,719][106226] Updated weights for policy 0, policy_version 215643 (0.0008) [2023-12-27 20:46:42,781][106226] Updated weights for policy 0, policy_version 215653 (0.0008) [2023-12-27 20:46:43,186][106225] Updated weights for policy 1, policy_version 215842 (0.0008) [2023-12-27 20:46:43,237][106225] Updated weights for policy 1, policy_version 215852 (0.0008) [2023-12-27 20:46:43,301][106225] Updated weights for policy 1, policy_version 215862 (0.0008) [2023-12-27 20:46:43,357][106225] Updated weights for policy 1, policy_version 215872 (0.0006) [2023-12-27 20:46:43,514][106226] Updated weights for policy 0, policy_version 215663 (0.0008) [2023-12-27 20:46:43,572][106226] Updated weights for policy 0, policy_version 215673 (0.0008) [2023-12-27 20:46:43,633][106226] Updated weights for policy 0, policy_version 215683 (0.0010) [2023-12-27 20:46:43,969][106225] Updated weights for policy 1, policy_version 215882 (0.0005) [2023-12-27 20:46:44,021][106225] Updated weights for policy 1, policy_version 215892 (0.0006) [2023-12-27 20:46:44,071][106225] Updated weights for policy 1, policy_version 215902 (0.0008) [2023-12-27 20:46:44,293][106226] Updated weights for policy 0, policy_version 215693 (0.0008) [2023-12-27 20:46:44,340][106226] Updated weights for policy 0, policy_version 215703 (0.0008) [2023-12-27 20:46:44,399][106226] Updated weights for policy 0, policy_version 215713 (0.0008) [2023-12-27 20:46:44,747][106225] Updated weights for policy 1, policy_version 215912 (0.0006) [2023-12-27 20:46:44,813][106225] Updated weights for policy 1, policy_version 215922 (0.0008) [2023-12-27 20:46:44,877][106225] Updated weights for policy 1, policy_version 215932 (0.0008) [2023-12-27 20:46:45,119][106226] Updated weights for policy 0, policy_version 215723 (0.0008) [2023-12-27 20:46:45,179][106226] Updated weights for policy 0, policy_version 215733 (0.0008) [2023-12-27 20:46:45,240][106226] Updated weights for policy 0, policy_version 215743 (0.0007) [2023-12-27 20:46:45,612][106225] Updated weights for policy 1, policy_version 215942 (0.0009) [2023-12-27 20:46:45,663][106225] Updated weights for policy 1, policy_version 215952 (0.0008) [2023-12-27 20:46:45,723][106225] Updated weights for policy 1, policy_version 215962 (0.0005) [2023-12-27 20:46:45,940][106226] Updated weights for policy 0, policy_version 215753 (0.0008) [2023-12-27 20:46:46,002][106226] Updated weights for policy 0, policy_version 215763 (0.0009) [2023-12-27 20:46:46,064][106226] Updated weights for policy 0, policy_version 215773 (0.0009) [2023-12-27 20:46:46,115][106226] Updated weights for policy 0, policy_version 215783 (0.0008) [2023-12-27 20:46:46,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 110551040. Throughput: 0: 9979.8, 1: 9894.7. Samples: 110537000. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:46,176][105115] Avg episode reward: [(0, '-5.247'), (1, '-5.780')] [2023-12-27 20:46:46,411][106225] Updated weights for policy 1, policy_version 215972 (0.0008) [2023-12-27 20:46:46,457][106225] Updated weights for policy 1, policy_version 215982 (0.0008) [2023-12-27 20:46:46,526][106225] Updated weights for policy 1, policy_version 215992 (0.0009) [2023-12-27 20:46:46,772][106226] Updated weights for policy 0, policy_version 215793 (0.0009) [2023-12-27 20:46:46,821][106226] Updated weights for policy 0, policy_version 215803 (0.0009) [2023-12-27 20:46:46,869][106226] Updated weights for policy 0, policy_version 215813 (0.0008) [2023-12-27 20:46:47,227][106225] Updated weights for policy 1, policy_version 216002 (0.0008) [2023-12-27 20:46:47,289][106225] Updated weights for policy 1, policy_version 216012 (0.0005) [2023-12-27 20:46:47,346][106225] Updated weights for policy 1, policy_version 216022 (0.0006) [2023-12-27 20:46:47,406][106225] Updated weights for policy 1, policy_version 216032 (0.0009) [2023-12-27 20:46:47,649][106226] Updated weights for policy 0, policy_version 215823 (0.0009) [2023-12-27 20:46:47,711][106226] Updated weights for policy 0, policy_version 215833 (0.0008) [2023-12-27 20:46:47,766][106226] Updated weights for policy 0, policy_version 215843 (0.0008) [2023-12-27 20:46:48,084][106225] Updated weights for policy 1, policy_version 216042 (0.0008) [2023-12-27 20:46:48,144][106225] Updated weights for policy 1, policy_version 216052 (0.0008) [2023-12-27 20:46:48,203][106225] Updated weights for policy 1, policy_version 216062 (0.0009) [2023-12-27 20:46:48,449][106226] Updated weights for policy 0, policy_version 215853 (0.0008) [2023-12-27 20:46:48,502][106226] Updated weights for policy 0, policy_version 215863 (0.0008) [2023-12-27 20:46:48,568][106226] Updated weights for policy 0, policy_version 215873 (0.0008) [2023-12-27 20:46:48,867][106225] Updated weights for policy 1, policy_version 216072 (0.0007) [2023-12-27 20:46:48,922][106225] Updated weights for policy 1, policy_version 216082 (0.0010) [2023-12-27 20:46:48,983][106225] Updated weights for policy 1, policy_version 216092 (0.0010) [2023-12-27 20:46:49,205][106226] Updated weights for policy 0, policy_version 215883 (0.0007) [2023-12-27 20:46:49,274][106226] Updated weights for policy 0, policy_version 215893 (0.0008) [2023-12-27 20:46:49,342][106226] Updated weights for policy 0, policy_version 215903 (0.0007) [2023-12-27 20:46:49,674][106225] Updated weights for policy 1, policy_version 216102 (0.0008) [2023-12-27 20:46:49,728][106225] Updated weights for policy 1, policy_version 216112 (0.0009) [2023-12-27 20:46:49,776][106225] Updated weights for policy 1, policy_version 216122 (0.0009) [2023-12-27 20:46:49,980][106226] Updated weights for policy 0, policy_version 215913 (0.0007) [2023-12-27 20:46:50,048][106226] Updated weights for policy 0, policy_version 215923 (0.0010) [2023-12-27 20:46:50,119][106226] Updated weights for policy 0, policy_version 215933 (0.0010) [2023-12-27 20:46:50,184][106226] Updated weights for policy 0, policy_version 215943 (0.0008) [2023-12-27 20:46:50,422][106225] Updated weights for policy 1, policy_version 216132 (0.0008) [2023-12-27 20:46:50,480][106225] Updated weights for policy 1, policy_version 216142 (0.0005) [2023-12-27 20:46:50,537][106225] Updated weights for policy 1, policy_version 216152 (0.0007) [2023-12-27 20:46:50,872][106226] Updated weights for policy 0, policy_version 215953 (0.0006) [2023-12-27 20:46:50,933][106226] Updated weights for policy 0, policy_version 215963 (0.0006) [2023-12-27 20:46:50,983][106226] Updated weights for policy 0, policy_version 215973 (0.0006) [2023-12-27 20:46:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 110649344. Throughput: 0: 9955.1, 1: 9914.2. Samples: 110656800. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:51,175][105115] Avg episode reward: [(0, '-5.120'), (1, '-6.091')] [2023-12-27 20:46:51,251][106225] Updated weights for policy 1, policy_version 216162 (0.0007) [2023-12-27 20:46:51,317][106225] Updated weights for policy 1, policy_version 216172 (0.0009) [2023-12-27 20:46:51,392][106225] Updated weights for policy 1, policy_version 216182 (0.0008) [2023-12-27 20:46:51,459][106225] Updated weights for policy 1, policy_version 216192 (0.0009) [2023-12-27 20:46:51,734][106226] Updated weights for policy 0, policy_version 215983 (0.0008) [2023-12-27 20:46:51,801][106226] Updated weights for policy 0, policy_version 215993 (0.0009) [2023-12-27 20:46:51,860][106226] Updated weights for policy 0, policy_version 216003 (0.0008) [2023-12-27 20:46:52,221][106225] Updated weights for policy 1, policy_version 216202 (0.0006) [2023-12-27 20:46:52,284][106225] Updated weights for policy 1, policy_version 216212 (0.0007) [2023-12-27 20:46:52,354][106225] Updated weights for policy 1, policy_version 216222 (0.0008) [2023-12-27 20:46:52,527][106226] Updated weights for policy 0, policy_version 216013 (0.0009) [2023-12-27 20:46:52,597][106226] Updated weights for policy 0, policy_version 216023 (0.0009) [2023-12-27 20:46:52,663][106226] Updated weights for policy 0, policy_version 216033 (0.0010) [2023-12-27 20:46:52,942][106225] Updated weights for policy 1, policy_version 216232 (0.0008) [2023-12-27 20:46:53,010][106225] Updated weights for policy 1, policy_version 216242 (0.0009) [2023-12-27 20:46:53,072][106225] Updated weights for policy 1, policy_version 216252 (0.0009) [2023-12-27 20:46:53,441][106226] Updated weights for policy 0, policy_version 216043 (0.0010) [2023-12-27 20:46:53,497][106226] Updated weights for policy 0, policy_version 216053 (0.0006) [2023-12-27 20:46:53,561][106226] Updated weights for policy 0, policy_version 216063 (0.0007) [2023-12-27 20:46:53,723][106225] Updated weights for policy 1, policy_version 216262 (0.0009) [2023-12-27 20:46:53,780][106225] Updated weights for policy 1, policy_version 216272 (0.0009) [2023-12-27 20:46:53,835][106225] Updated weights for policy 1, policy_version 216282 (0.0009) [2023-12-27 20:46:54,188][106226] Updated weights for policy 0, policy_version 216073 (0.0008) [2023-12-27 20:46:54,253][106226] Updated weights for policy 0, policy_version 216083 (0.0007) [2023-12-27 20:46:54,304][106226] Updated weights for policy 0, policy_version 216093 (0.0008) [2023-12-27 20:46:54,350][106226] Updated weights for policy 0, policy_version 216103 (0.0006) [2023-12-27 20:46:54,598][106225] Updated weights for policy 1, policy_version 216292 (0.0007) [2023-12-27 20:46:54,660][106225] Updated weights for policy 1, policy_version 216302 (0.0005) [2023-12-27 20:46:54,721][106225] Updated weights for policy 1, policy_version 216312 (0.0005) [2023-12-27 20:46:55,034][106226] Updated weights for policy 0, policy_version 216113 (0.0009) [2023-12-27 20:46:55,080][106226] Updated weights for policy 0, policy_version 216123 (0.0010) [2023-12-27 20:46:55,140][106226] Updated weights for policy 0, policy_version 216133 (0.0010) [2023-12-27 20:46:55,359][106225] Updated weights for policy 1, policy_version 216322 (0.0006) [2023-12-27 20:46:55,406][106225] Updated weights for policy 1, policy_version 216332 (0.0010) [2023-12-27 20:46:55,452][106225] Updated weights for policy 1, policy_version 216342 (0.0010) [2023-12-27 20:46:55,502][106225] Updated weights for policy 1, policy_version 216352 (0.0010) [2023-12-27 20:46:55,762][106226] Updated weights for policy 0, policy_version 216143 (0.0008) [2023-12-27 20:46:55,823][106226] Updated weights for policy 0, policy_version 216153 (0.0008) [2023-12-27 20:46:55,885][106226] Updated weights for policy 0, policy_version 216163 (0.0008) [2023-12-27 20:46:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 110747648. Throughput: 0: 9923.1, 1: 9918.4. Samples: 110715548. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:46:56,175][105115] Avg episode reward: [(0, '-4.936'), (1, '-5.573')] [2023-12-27 20:46:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000216352_55394304.pth... [2023-12-27 20:46:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000216168_55353344.pth... [2023-12-27 20:46:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000215200_55099392.pth [2023-12-27 20:46:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000214984_55050240.pth [2023-12-27 20:46:56,187][106141] Saving new best policy, reward=-5.507! [2023-12-27 20:46:56,271][106225] Updated weights for policy 1, policy_version 216362 (0.0010) [2023-12-27 20:46:56,323][106225] Updated weights for policy 1, policy_version 216372 (0.0010) [2023-12-27 20:46:56,367][106225] Updated weights for policy 1, policy_version 216382 (0.0010) [2023-12-27 20:46:56,461][106226] Updated weights for policy 0, policy_version 216173 (0.0007) [2023-12-27 20:46:56,526][106226] Updated weights for policy 0, policy_version 216183 (0.0008) [2023-12-27 20:46:56,574][106226] Updated weights for policy 0, policy_version 216193 (0.0007) [2023-12-27 20:46:57,074][106225] Updated weights for policy 1, policy_version 216392 (0.0010) [2023-12-27 20:46:57,133][106225] Updated weights for policy 1, policy_version 216402 (0.0009) [2023-12-27 20:46:57,192][106225] Updated weights for policy 1, policy_version 216412 (0.0006) [2023-12-27 20:46:57,274][106226] Updated weights for policy 0, policy_version 216203 (0.0007) [2023-12-27 20:46:57,327][106226] Updated weights for policy 0, policy_version 216213 (0.0005) [2023-12-27 20:46:57,378][106226] Updated weights for policy 0, policy_version 216223 (0.0005) [2023-12-27 20:46:57,873][106225] Updated weights for policy 1, policy_version 216422 (0.0010) [2023-12-27 20:46:57,891][106226] Updated weights for policy 0, policy_version 216233 (0.0005) [2023-12-27 20:46:57,934][106225] Updated weights for policy 1, policy_version 216432 (0.0010) [2023-12-27 20:46:57,947][106226] Updated weights for policy 0, policy_version 216243 (0.0005) [2023-12-27 20:46:57,982][106225] Updated weights for policy 1, policy_version 216442 (0.0009) [2023-12-27 20:46:58,010][106226] Updated weights for policy 0, policy_version 216253 (0.0005) [2023-12-27 20:46:58,069][106226] Updated weights for policy 0, policy_version 216263 (0.0007) [2023-12-27 20:46:58,804][106225] Updated weights for policy 1, policy_version 216452 (0.0010) [2023-12-27 20:46:58,846][106226] Updated weights for policy 0, policy_version 216273 (0.0007) [2023-12-27 20:46:58,873][106225] Updated weights for policy 1, policy_version 216462 (0.0008) [2023-12-27 20:46:58,912][106226] Updated weights for policy 0, policy_version 216283 (0.0009) [2023-12-27 20:46:58,935][106225] Updated weights for policy 1, policy_version 216472 (0.0010) [2023-12-27 20:46:58,969][106226] Updated weights for policy 0, policy_version 216293 (0.0008) [2023-12-27 20:46:59,698][106225] Updated weights for policy 1, policy_version 216482 (0.0010) [2023-12-27 20:46:59,702][106226] Updated weights for policy 0, policy_version 216303 (0.0005) [2023-12-27 20:46:59,749][106225] Updated weights for policy 1, policy_version 216492 (0.0010) [2023-12-27 20:46:59,761][106226] Updated weights for policy 0, policy_version 216313 (0.0005) [2023-12-27 20:46:59,803][106225] Updated weights for policy 1, policy_version 216502 (0.0010) [2023-12-27 20:46:59,817][106226] Updated weights for policy 0, policy_version 216323 (0.0005) [2023-12-27 20:46:59,871][106225] Updated weights for policy 1, policy_version 216512 (0.0010) [2023-12-27 20:47:00,490][106226] Updated weights for policy 0, policy_version 216333 (0.0008) [2023-12-27 20:47:00,551][106226] Updated weights for policy 0, policy_version 216343 (0.0008) [2023-12-27 20:47:00,604][106225] Updated weights for policy 1, policy_version 216522 (0.0008) [2023-12-27 20:47:00,608][106226] Updated weights for policy 0, policy_version 216353 (0.0005) [2023-12-27 20:47:00,662][106225] Updated weights for policy 1, policy_version 216532 (0.0008) [2023-12-27 20:47:00,716][106225] Updated weights for policy 1, policy_version 216542 (0.0008) [2023-12-27 20:47:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 110845952. Throughput: 0: 9964.5, 1: 9949.0. Samples: 110836120. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:01,175][105115] Avg episode reward: [(0, '-5.075'), (1, '-6.169')] [2023-12-27 20:47:01,343][106226] Updated weights for policy 0, policy_version 216363 (0.0007) [2023-12-27 20:47:01,410][106226] Updated weights for policy 0, policy_version 216373 (0.0006) [2023-12-27 20:47:01,420][106225] Updated weights for policy 1, policy_version 216552 (0.0008) [2023-12-27 20:47:01,469][106226] Updated weights for policy 0, policy_version 216383 (0.0006) [2023-12-27 20:47:01,478][106225] Updated weights for policy 1, policy_version 216562 (0.0007) [2023-12-27 20:47:01,535][106225] Updated weights for policy 1, policy_version 216572 (0.0008) [2023-12-27 20:47:02,188][106226] Updated weights for policy 0, policy_version 216393 (0.0007) [2023-12-27 20:47:02,240][106226] Updated weights for policy 0, policy_version 216403 (0.0008) [2023-12-27 20:47:02,261][106225] Updated weights for policy 1, policy_version 216582 (0.0007) [2023-12-27 20:47:02,307][106226] Updated weights for policy 0, policy_version 216413 (0.0008) [2023-12-27 20:47:02,320][106225] Updated weights for policy 1, policy_version 216592 (0.0006) [2023-12-27 20:47:02,370][106226] Updated weights for policy 0, policy_version 216423 (0.0007) [2023-12-27 20:47:02,387][106225] Updated weights for policy 1, policy_version 216602 (0.0009) [2023-12-27 20:47:03,071][106226] Updated weights for policy 0, policy_version 216433 (0.0010) [2023-12-27 20:47:03,118][106225] Updated weights for policy 1, policy_version 216612 (0.0007) [2023-12-27 20:47:03,121][106226] Updated weights for policy 0, policy_version 216443 (0.0010) [2023-12-27 20:47:03,172][106225] Updated weights for policy 1, policy_version 216622 (0.0005) [2023-12-27 20:47:03,177][106226] Updated weights for policy 0, policy_version 216453 (0.0010) [2023-12-27 20:47:03,223][106225] Updated weights for policy 1, policy_version 216632 (0.0008) [2023-12-27 20:47:03,738][106226] Updated weights for policy 0, policy_version 216463 (0.0006) [2023-12-27 20:47:03,796][106226] Updated weights for policy 0, policy_version 216473 (0.0006) [2023-12-27 20:47:03,875][106226] Updated weights for policy 0, policy_version 216484 (0.0024) [2023-12-27 20:47:04,001][106225] Updated weights for policy 1, policy_version 216643 (0.0009) [2023-12-27 20:47:04,068][106225] Updated weights for policy 1, policy_version 216653 (0.0008) [2023-12-27 20:47:04,137][106225] Updated weights for policy 1, policy_version 216663 (0.0008) [2023-12-27 20:47:04,526][106226] Updated weights for policy 0, policy_version 216494 (0.0008) [2023-12-27 20:47:04,586][106226] Updated weights for policy 0, policy_version 216504 (0.0008) [2023-12-27 20:47:04,648][106226] Updated weights for policy 0, policy_version 216514 (0.0009) [2023-12-27 20:47:04,833][106225] Updated weights for policy 1, policy_version 216673 (0.0008) [2023-12-27 20:47:04,885][106225] Updated weights for policy 1, policy_version 216683 (0.0007) [2023-12-27 20:47:04,932][106225] Updated weights for policy 1, policy_version 216693 (0.0007) [2023-12-27 20:47:04,990][106225] Updated weights for policy 1, policy_version 216703 (0.0007) [2023-12-27 20:47:05,305][106226] Updated weights for policy 0, policy_version 216524 (0.0008) [2023-12-27 20:47:05,358][106226] Updated weights for policy 0, policy_version 216534 (0.0008) [2023-12-27 20:47:05,419][106226] Updated weights for policy 0, policy_version 216544 (0.0007) [2023-12-27 20:47:05,716][106225] Updated weights for policy 1, policy_version 216713 (0.0010) [2023-12-27 20:47:05,775][106225] Updated weights for policy 1, policy_version 216723 (0.0010) [2023-12-27 20:47:05,831][106225] Updated weights for policy 1, policy_version 216733 (0.0010) [2023-12-27 20:47:06,160][106226] Updated weights for policy 0, policy_version 216554 (0.0007) [2023-12-27 20:47:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 110944256. Throughput: 0: 10038.3, 1: 9866.5. Samples: 110954580. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:06,175][105115] Avg episode reward: [(0, '-4.972'), (1, '-6.025')] [2023-12-27 20:47:06,225][106226] Updated weights for policy 0, policy_version 216564 (0.0006) [2023-12-27 20:47:06,291][106226] Updated weights for policy 0, policy_version 216574 (0.0006) [2023-12-27 20:47:06,353][106226] Updated weights for policy 0, policy_version 216584 (0.0007) [2023-12-27 20:47:06,487][106225] Updated weights for policy 1, policy_version 216743 (0.0009) [2023-12-27 20:47:06,539][106225] Updated weights for policy 1, policy_version 216753 (0.0007) [2023-12-27 20:47:06,602][106225] Updated weights for policy 1, policy_version 216763 (0.0008) [2023-12-27 20:47:07,015][106226] Updated weights for policy 0, policy_version 216594 (0.0006) [2023-12-27 20:47:07,084][106226] Updated weights for policy 0, policy_version 216604 (0.0006) [2023-12-27 20:47:07,150][106226] Updated weights for policy 0, policy_version 216614 (0.0006) [2023-12-27 20:47:07,231][106225] Updated weights for policy 1, policy_version 216773 (0.0007) [2023-12-27 20:47:07,278][106225] Updated weights for policy 1, policy_version 216783 (0.0006) [2023-12-27 20:47:07,327][106225] Updated weights for policy 1, policy_version 216793 (0.0008) [2023-12-27 20:47:07,852][106226] Updated weights for policy 0, policy_version 216624 (0.0007) [2023-12-27 20:47:07,910][106226] Updated weights for policy 0, policy_version 216634 (0.0008) [2023-12-27 20:47:07,938][106225] Updated weights for policy 1, policy_version 216803 (0.0007) [2023-12-27 20:47:07,968][106226] Updated weights for policy 0, policy_version 216644 (0.0005) [2023-12-27 20:47:07,989][106225] Updated weights for policy 1, policy_version 216813 (0.0007) [2023-12-27 20:47:08,051][106225] Updated weights for policy 1, policy_version 216823 (0.0008) [2023-12-27 20:47:08,701][106225] Updated weights for policy 1, policy_version 216833 (0.0009) [2023-12-27 20:47:08,722][106226] Updated weights for policy 0, policy_version 216654 (0.0009) [2023-12-27 20:47:08,764][106225] Updated weights for policy 1, policy_version 216843 (0.0007) [2023-12-27 20:47:08,782][106226] Updated weights for policy 0, policy_version 216664 (0.0009) [2023-12-27 20:47:08,827][106225] Updated weights for policy 1, policy_version 216853 (0.0005) [2023-12-27 20:47:08,846][106226] Updated weights for policy 0, policy_version 216674 (0.0008) [2023-12-27 20:47:08,893][106225] Updated weights for policy 1, policy_version 216863 (0.0006) [2023-12-27 20:47:09,601][106225] Updated weights for policy 1, policy_version 216873 (0.0008) [2023-12-27 20:47:09,644][106226] Updated weights for policy 0, policy_version 216684 (0.0006) [2023-12-27 20:47:09,667][106225] Updated weights for policy 1, policy_version 216883 (0.0008) [2023-12-27 20:47:09,712][106226] Updated weights for policy 0, policy_version 216694 (0.0006) [2023-12-27 20:47:09,725][106225] Updated weights for policy 1, policy_version 216893 (0.0007) [2023-12-27 20:47:09,785][106226] Updated weights for policy 0, policy_version 216704 (0.0010) [2023-12-27 20:47:10,478][106225] Updated weights for policy 1, policy_version 216903 (0.0008) [2023-12-27 20:47:10,502][106226] Updated weights for policy 0, policy_version 216714 (0.0009) [2023-12-27 20:47:10,534][106225] Updated weights for policy 1, policy_version 216913 (0.0008) [2023-12-27 20:47:10,560][106226] Updated weights for policy 0, policy_version 216724 (0.0006) [2023-12-27 20:47:10,596][106225] Updated weights for policy 1, policy_version 216923 (0.0007) [2023-12-27 20:47:10,619][106226] Updated weights for policy 0, policy_version 216734 (0.0007) [2023-12-27 20:47:10,666][106226] Updated weights for policy 0, policy_version 216744 (0.0008) [2023-12-27 20:47:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 111042560. Throughput: 0: 10053.7, 1: 9907.3. Samples: 111015772. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:11,175][105115] Avg episode reward: [(0, '-5.209'), (1, '-5.819')] [2023-12-27 20:47:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000216928_55541760.pth... [2023-12-27 20:47:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000216744_55500800.pth... [2023-12-27 20:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000215592_55205888.pth [2023-12-27 20:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000215776_55246848.pth [2023-12-27 20:47:11,304][106226] Updated weights for policy 0, policy_version 216754 (0.0008) [2023-12-27 20:47:11,370][106225] Updated weights for policy 1, policy_version 216933 (0.0008) [2023-12-27 20:47:11,376][106226] Updated weights for policy 0, policy_version 216764 (0.0008) [2023-12-27 20:47:11,436][106225] Updated weights for policy 1, policy_version 216943 (0.0009) [2023-12-27 20:47:11,446][106226] Updated weights for policy 0, policy_version 216774 (0.0007) [2023-12-27 20:47:11,503][106225] Updated weights for policy 1, policy_version 216953 (0.0009) [2023-12-27 20:47:12,150][106226] Updated weights for policy 0, policy_version 216784 (0.0008) [2023-12-27 20:47:12,211][106226] Updated weights for policy 0, policy_version 216794 (0.0008) [2023-12-27 20:47:12,280][106226] Updated weights for policy 0, policy_version 216804 (0.0009) [2023-12-27 20:47:12,310][106225] Updated weights for policy 1, policy_version 216963 (0.0010) [2023-12-27 20:47:12,376][106225] Updated weights for policy 1, policy_version 216973 (0.0008) [2023-12-27 20:47:12,438][106225] Updated weights for policy 1, policy_version 216983 (0.0010) [2023-12-27 20:47:12,911][106226] Updated weights for policy 0, policy_version 216814 (0.0007) [2023-12-27 20:47:12,972][106226] Updated weights for policy 0, policy_version 216824 (0.0005) [2023-12-27 20:47:13,020][106226] Updated weights for policy 0, policy_version 216834 (0.0005) [2023-12-27 20:47:13,223][106225] Updated weights for policy 1, policy_version 216993 (0.0007) [2023-12-27 20:47:13,273][106225] Updated weights for policy 1, policy_version 217003 (0.0009) [2023-12-27 20:47:13,322][106225] Updated weights for policy 1, policy_version 217013 (0.0008) [2023-12-27 20:47:13,372][106225] Updated weights for policy 1, policy_version 217023 (0.0009) [2023-12-27 20:47:13,572][106226] Updated weights for policy 0, policy_version 216844 (0.0005) [2023-12-27 20:47:13,631][106226] Updated weights for policy 0, policy_version 216854 (0.0005) [2023-12-27 20:47:13,682][106226] Updated weights for policy 0, policy_version 216864 (0.0009) [2023-12-27 20:47:14,034][106225] Updated weights for policy 1, policy_version 217033 (0.0009) [2023-12-27 20:47:14,084][106225] Updated weights for policy 1, policy_version 217043 (0.0008) [2023-12-27 20:47:14,150][106225] Updated weights for policy 1, policy_version 217053 (0.0010) [2023-12-27 20:47:14,334][106226] Updated weights for policy 0, policy_version 216874 (0.0008) [2023-12-27 20:47:14,396][106226] Updated weights for policy 0, policy_version 216884 (0.0005) [2023-12-27 20:47:14,455][106226] Updated weights for policy 0, policy_version 216894 (0.0005) [2023-12-27 20:47:14,506][106226] Updated weights for policy 0, policy_version 216904 (0.0005) [2023-12-27 20:47:14,949][106225] Updated weights for policy 1, policy_version 217063 (0.0010) [2023-12-27 20:47:15,011][106225] Updated weights for policy 1, policy_version 217073 (0.0007) [2023-12-27 20:47:15,068][106226] Updated weights for policy 0, policy_version 216914 (0.0009) [2023-12-27 20:47:15,077][106225] Updated weights for policy 1, policy_version 217083 (0.0007) [2023-12-27 20:47:15,125][106226] Updated weights for policy 0, policy_version 216924 (0.0007) [2023-12-27 20:47:15,176][106226] Updated weights for policy 0, policy_version 216934 (0.0009) [2023-12-27 20:47:15,791][106225] Updated weights for policy 1, policy_version 217093 (0.0007) [2023-12-27 20:47:15,848][106225] Updated weights for policy 1, policy_version 217103 (0.0005) [2023-12-27 20:47:15,907][106225] Updated weights for policy 1, policy_version 217113 (0.0007) [2023-12-27 20:47:15,915][106226] Updated weights for policy 0, policy_version 216944 (0.0006) [2023-12-27 20:47:15,967][106226] Updated weights for policy 0, policy_version 216954 (0.0005) [2023-12-27 20:47:16,023][106226] Updated weights for policy 0, policy_version 216964 (0.0005) [2023-12-27 20:47:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 111149056. Throughput: 0: 10092.4, 1: 9794.5. Samples: 111134164. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:16,175][105115] Avg episode reward: [(0, '-5.332'), (1, '-6.018')] [2023-12-27 20:47:16,599][106225] Updated weights for policy 1, policy_version 217123 (0.0008) [2023-12-27 20:47:16,652][106225] Updated weights for policy 1, policy_version 217133 (0.0008) [2023-12-27 20:47:16,682][106226] Updated weights for policy 0, policy_version 216974 (0.0007) [2023-12-27 20:47:16,704][106225] Updated weights for policy 1, policy_version 217143 (0.0008) [2023-12-27 20:47:16,741][106226] Updated weights for policy 0, policy_version 216984 (0.0006) [2023-12-27 20:47:16,793][106226] Updated weights for policy 0, policy_version 216994 (0.0005) [2023-12-27 20:47:17,440][106225] Updated weights for policy 1, policy_version 217153 (0.0007) [2023-12-27 20:47:17,447][106226] Updated weights for policy 0, policy_version 217004 (0.0007) [2023-12-27 20:47:17,500][106225] Updated weights for policy 1, policy_version 217163 (0.0008) [2023-12-27 20:47:17,502][106226] Updated weights for policy 0, policy_version 217014 (0.0006) [2023-12-27 20:47:17,550][106225] Updated weights for policy 1, policy_version 217173 (0.0007) [2023-12-27 20:47:17,555][106226] Updated weights for policy 0, policy_version 217024 (0.0006) [2023-12-27 20:47:17,606][106225] Updated weights for policy 1, policy_version 217183 (0.0005) [2023-12-27 20:47:18,113][106226] Updated weights for policy 0, policy_version 217034 (0.0009) [2023-12-27 20:47:18,169][106226] Updated weights for policy 0, policy_version 217044 (0.0008) [2023-12-27 20:47:18,228][106226] Updated weights for policy 0, policy_version 217054 (0.0008) [2023-12-27 20:47:18,283][106226] Updated weights for policy 0, policy_version 217064 (0.0008) [2023-12-27 20:47:18,315][106225] Updated weights for policy 1, policy_version 217193 (0.0008) [2023-12-27 20:47:18,378][106225] Updated weights for policy 1, policy_version 217203 (0.0009) [2023-12-27 20:47:18,468][106225] Updated weights for policy 1, policy_version 217213 (0.0009) [2023-12-27 20:47:19,035][106226] Updated weights for policy 0, policy_version 217074 (0.0006) [2023-12-27 20:47:19,098][106226] Updated weights for policy 0, policy_version 217084 (0.0009) [2023-12-27 20:47:19,152][106226] Updated weights for policy 0, policy_version 217094 (0.0008) [2023-12-27 20:47:19,198][106225] Updated weights for policy 1, policy_version 217223 (0.0008) [2023-12-27 20:47:19,262][106225] Updated weights for policy 1, policy_version 217233 (0.0009) [2023-12-27 20:47:19,325][106225] Updated weights for policy 1, policy_version 217243 (0.0008) [2023-12-27 20:47:19,902][106226] Updated weights for policy 0, policy_version 217104 (0.0008) [2023-12-27 20:47:19,973][106226] Updated weights for policy 0, policy_version 217114 (0.0008) [2023-12-27 20:47:20,037][106226] Updated weights for policy 0, policy_version 217124 (0.0006) [2023-12-27 20:47:20,083][106225] Updated weights for policy 1, policy_version 217253 (0.0007) [2023-12-27 20:47:20,147][106225] Updated weights for policy 1, policy_version 217263 (0.0006) [2023-12-27 20:47:20,211][106225] Updated weights for policy 1, policy_version 217273 (0.0006) [2023-12-27 20:47:20,703][106226] Updated weights for policy 0, policy_version 217134 (0.0008) [2023-12-27 20:47:20,770][106226] Updated weights for policy 0, policy_version 217144 (0.0008) [2023-12-27 20:47:20,837][106226] Updated weights for policy 0, policy_version 217154 (0.0008) [2023-12-27 20:47:20,950][106225] Updated weights for policy 1, policy_version 217283 (0.0008) [2023-12-27 20:47:21,002][106225] Updated weights for policy 1, policy_version 217293 (0.0008) [2023-12-27 20:47:21,073][106225] Updated weights for policy 1, policy_version 217303 (0.0008) [2023-12-27 20:47:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 111247360. Throughput: 0: 10068.7, 1: 9690.9. Samples: 111251696. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:21,175][105115] Avg episode reward: [(0, '-5.402'), (1, '-5.980')] [2023-12-27 20:47:21,558][106226] Updated weights for policy 0, policy_version 217164 (0.0007) [2023-12-27 20:47:21,624][106226] Updated weights for policy 0, policy_version 217174 (0.0009) [2023-12-27 20:47:21,698][106226] Updated weights for policy 0, policy_version 217184 (0.0008) [2023-12-27 20:47:21,883][106225] Updated weights for policy 1, policy_version 217313 (0.0008) [2023-12-27 20:47:21,947][106225] Updated weights for policy 1, policy_version 217323 (0.0009) [2023-12-27 20:47:22,013][106225] Updated weights for policy 1, policy_version 217333 (0.0008) [2023-12-27 20:47:22,068][106225] Updated weights for policy 1, policy_version 217343 (0.0007) [2023-12-27 20:47:22,368][106226] Updated weights for policy 0, policy_version 217194 (0.0008) [2023-12-27 20:47:22,436][106226] Updated weights for policy 0, policy_version 217204 (0.0007) [2023-12-27 20:47:22,499][106226] Updated weights for policy 0, policy_version 217214 (0.0008) [2023-12-27 20:47:22,560][106226] Updated weights for policy 0, policy_version 217224 (0.0008) [2023-12-27 20:47:22,819][106225] Updated weights for policy 1, policy_version 217353 (0.0008) [2023-12-27 20:47:22,871][106225] Updated weights for policy 1, policy_version 217363 (0.0009) [2023-12-27 20:47:22,935][106225] Updated weights for policy 1, policy_version 217373 (0.0009) [2023-12-27 20:47:23,277][106226] Updated weights for policy 0, policy_version 217234 (0.0005) [2023-12-27 20:47:23,335][106226] Updated weights for policy 0, policy_version 217244 (0.0005) [2023-12-27 20:47:23,387][106226] Updated weights for policy 0, policy_version 217254 (0.0006) [2023-12-27 20:47:23,629][106225] Updated weights for policy 1, policy_version 217383 (0.0006) [2023-12-27 20:47:23,682][106225] Updated weights for policy 1, policy_version 217393 (0.0007) [2023-12-27 20:47:23,738][106225] Updated weights for policy 1, policy_version 217403 (0.0008) [2023-12-27 20:47:24,002][106226] Updated weights for policy 0, policy_version 217264 (0.0009) [2023-12-27 20:47:24,059][106226] Updated weights for policy 0, policy_version 217274 (0.0009) [2023-12-27 20:47:24,115][106226] Updated weights for policy 0, policy_version 217284 (0.0008) [2023-12-27 20:47:24,394][106225] Updated weights for policy 1, policy_version 217413 (0.0009) [2023-12-27 20:47:24,441][106225] Updated weights for policy 1, policy_version 217423 (0.0007) [2023-12-27 20:47:24,490][106225] Updated weights for policy 1, policy_version 217433 (0.0008) [2023-12-27 20:47:24,799][106226] Updated weights for policy 0, policy_version 217294 (0.0008) [2023-12-27 20:47:24,846][106226] Updated weights for policy 0, policy_version 217304 (0.0008) [2023-12-27 20:47:24,891][106226] Updated weights for policy 0, policy_version 217314 (0.0008) [2023-12-27 20:47:25,230][106225] Updated weights for policy 1, policy_version 217444 (0.0009) [2023-12-27 20:47:25,282][106225] Updated weights for policy 1, policy_version 217454 (0.0008) [2023-12-27 20:47:25,337][106225] Updated weights for policy 1, policy_version 217464 (0.0008) [2023-12-27 20:47:25,653][106226] Updated weights for policy 0, policy_version 217324 (0.0009) [2023-12-27 20:47:25,701][106226] Updated weights for policy 0, policy_version 217334 (0.0008) [2023-12-27 20:47:25,748][106226] Updated weights for policy 0, policy_version 217344 (0.0008) [2023-12-27 20:47:26,063][106225] Updated weights for policy 1, policy_version 217474 (0.0009) [2023-12-27 20:47:26,126][106225] Updated weights for policy 1, policy_version 217484 (0.0009) [2023-12-27 20:47:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 111337472. Throughput: 0: 10080.6, 1: 9675.4. Samples: 111309240. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:26,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-5.902')] [2023-12-27 20:47:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000217352_55656448.pth... [2023-12-27 20:47:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000216168_55353344.pth [2023-12-27 20:47:26,189][106225] Updated weights for policy 1, policy_version 217494 (0.0008) [2023-12-27 20:47:26,253][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000217504_55689216.pth... [2023-12-27 20:47:26,255][106225] Updated weights for policy 1, policy_version 217504 (0.0008) [2023-12-27 20:47:26,258][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000216352_55394304.pth [2023-12-27 20:47:26,499][106226] Updated weights for policy 0, policy_version 217354 (0.0008) [2023-12-27 20:47:26,547][106226] Updated weights for policy 0, policy_version 217364 (0.0008) [2023-12-27 20:47:26,594][106226] Updated weights for policy 0, policy_version 217374 (0.0008) [2023-12-27 20:47:26,638][106226] Updated weights for policy 0, policy_version 217384 (0.0007) [2023-12-27 20:47:26,955][106225] Updated weights for policy 1, policy_version 217514 (0.0007) [2023-12-27 20:47:27,004][106225] Updated weights for policy 1, policy_version 217524 (0.0007) [2023-12-27 20:47:27,050][106225] Updated weights for policy 1, policy_version 217534 (0.0008) [2023-12-27 20:47:27,400][106226] Updated weights for policy 0, policy_version 217394 (0.0010) [2023-12-27 20:47:27,450][106226] Updated weights for policy 0, policy_version 217404 (0.0010) [2023-12-27 20:47:27,498][106226] Updated weights for policy 0, policy_version 217414 (0.0010) [2023-12-27 20:47:27,804][106225] Updated weights for policy 1, policy_version 217544 (0.0008) [2023-12-27 20:47:27,853][106225] Updated weights for policy 1, policy_version 217554 (0.0008) [2023-12-27 20:47:27,905][106225] Updated weights for policy 1, policy_version 217564 (0.0010) [2023-12-27 20:47:28,110][106226] Updated weights for policy 0, policy_version 217424 (0.0010) [2023-12-27 20:47:28,159][106226] Updated weights for policy 0, policy_version 217434 (0.0010) [2023-12-27 20:47:28,214][106226] Updated weights for policy 0, policy_version 217444 (0.0009) [2023-12-27 20:47:28,648][106225] Updated weights for policy 1, policy_version 217574 (0.0007) [2023-12-27 20:47:28,708][106225] Updated weights for policy 1, policy_version 217584 (0.0010) [2023-12-27 20:47:28,765][106225] Updated weights for policy 1, policy_version 217594 (0.0010) [2023-12-27 20:47:28,863][106226] Updated weights for policy 0, policy_version 217454 (0.0006) [2023-12-27 20:47:28,912][106226] Updated weights for policy 0, policy_version 217464 (0.0005) [2023-12-27 20:47:28,967][106226] Updated weights for policy 0, policy_version 217474 (0.0010) [2023-12-27 20:47:29,444][106225] Updated weights for policy 1, policy_version 217604 (0.0009) [2023-12-27 20:47:29,492][106225] Updated weights for policy 1, policy_version 217614 (0.0008) [2023-12-27 20:47:29,543][106225] Updated weights for policy 1, policy_version 217624 (0.0008) [2023-12-27 20:47:29,715][106226] Updated weights for policy 0, policy_version 217484 (0.0009) [2023-12-27 20:47:29,781][106226] Updated weights for policy 0, policy_version 217494 (0.0006) [2023-12-27 20:47:29,847][106226] Updated weights for policy 0, policy_version 217504 (0.0007) [2023-12-27 20:47:30,251][106225] Updated weights for policy 1, policy_version 217634 (0.0006) [2023-12-27 20:47:30,304][106225] Updated weights for policy 1, policy_version 217644 (0.0010) [2023-12-27 20:47:30,358][106225] Updated weights for policy 1, policy_version 217654 (0.0010) [2023-12-27 20:47:30,421][106225] Updated weights for policy 1, policy_version 217664 (0.0009) [2023-12-27 20:47:30,519][106226] Updated weights for policy 0, policy_version 217514 (0.0008) [2023-12-27 20:47:30,583][106226] Updated weights for policy 0, policy_version 217524 (0.0010) [2023-12-27 20:47:30,647][106226] Updated weights for policy 0, policy_version 217534 (0.0010) [2023-12-27 20:47:30,707][106226] Updated weights for policy 0, policy_version 217544 (0.0011) [2023-12-27 20:47:31,025][106225] Updated weights for policy 1, policy_version 217674 (0.0009) [2023-12-27 20:47:31,087][106225] Updated weights for policy 1, policy_version 217684 (0.0009) [2023-12-27 20:47:31,150][106225] Updated weights for policy 1, policy_version 217694 (0.0010) [2023-12-27 20:47:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 111443968. Throughput: 0: 10099.1, 1: 9704.3. Samples: 111428148. Policy #0 lag: (min: 21.0, avg: 28.7, max: 53.0) [2023-12-27 20:47:31,175][105115] Avg episode reward: [(0, '-5.159'), (1, '-5.700')] [2023-12-27 20:47:31,363][106226] Updated weights for policy 0, policy_version 217554 (0.0008) [2023-12-27 20:47:31,421][106226] Updated weights for policy 0, policy_version 217564 (0.0008) [2023-12-27 20:47:31,488][106226] Updated weights for policy 0, policy_version 217574 (0.0011) [2023-12-27 20:47:31,888][106225] Updated weights for policy 1, policy_version 217704 (0.0008) [2023-12-27 20:47:31,935][106225] Updated weights for policy 1, policy_version 217714 (0.0007) [2023-12-27 20:47:31,992][106225] Updated weights for policy 1, policy_version 217724 (0.0008) [2023-12-27 20:47:32,237][106226] Updated weights for policy 0, policy_version 217584 (0.0011) [2023-12-27 20:47:32,295][106226] Updated weights for policy 0, policy_version 217594 (0.0011) [2023-12-27 20:47:32,355][106226] Updated weights for policy 0, policy_version 217604 (0.0011) [2023-12-27 20:47:32,660][106225] Updated weights for policy 1, policy_version 217734 (0.0006) [2023-12-27 20:47:32,718][106225] Updated weights for policy 1, policy_version 217744 (0.0005) [2023-12-27 20:47:32,777][106225] Updated weights for policy 1, policy_version 217754 (0.0005) [2023-12-27 20:47:33,065][106226] Updated weights for policy 0, policy_version 217614 (0.0009) [2023-12-27 20:47:33,128][106226] Updated weights for policy 0, policy_version 217624 (0.0010) [2023-12-27 20:47:33,187][106226] Updated weights for policy 0, policy_version 217634 (0.0010) [2023-12-27 20:47:33,345][106225] Updated weights for policy 1, policy_version 217764 (0.0008) [2023-12-27 20:47:33,405][106225] Updated weights for policy 1, policy_version 217774 (0.0006) [2023-12-27 20:47:33,451][106225] Updated weights for policy 1, policy_version 217784 (0.0007) [2023-12-27 20:47:33,896][106226] Updated weights for policy 0, policy_version 217644 (0.0011) [2023-12-27 20:47:33,943][106226] Updated weights for policy 0, policy_version 217654 (0.0010) [2023-12-27 20:47:33,985][106225] Updated weights for policy 1, policy_version 217794 (0.0005) [2023-12-27 20:47:33,986][106226] Updated weights for policy 0, policy_version 217664 (0.0010) [2023-12-27 20:47:34,039][106225] Updated weights for policy 1, policy_version 217804 (0.0005) [2023-12-27 20:47:34,093][106225] Updated weights for policy 1, policy_version 217814 (0.0005) [2023-12-27 20:47:34,153][106225] Updated weights for policy 1, policy_version 217824 (0.0007) [2023-12-27 20:47:34,741][106226] Updated weights for policy 0, policy_version 217674 (0.0011) [2023-12-27 20:47:34,791][106226] Updated weights for policy 0, policy_version 217684 (0.0010) [2023-12-27 20:47:34,845][106226] Updated weights for policy 0, policy_version 217694 (0.0011) [2023-12-27 20:47:34,860][106225] Updated weights for policy 1, policy_version 217834 (0.0010) [2023-12-27 20:47:34,900][106226] Updated weights for policy 0, policy_version 217704 (0.0010) [2023-12-27 20:47:34,919][106225] Updated weights for policy 1, policy_version 217844 (0.0010) [2023-12-27 20:47:34,974][106225] Updated weights for policy 1, policy_version 217854 (0.0010) [2023-12-27 20:47:35,637][106226] Updated weights for policy 0, policy_version 217714 (0.0011) [2023-12-27 20:47:35,647][106225] Updated weights for policy 1, policy_version 217864 (0.0010) [2023-12-27 20:47:35,693][106226] Updated weights for policy 0, policy_version 217724 (0.0010) [2023-12-27 20:47:35,701][106225] Updated weights for policy 1, policy_version 217874 (0.0010) [2023-12-27 20:47:35,751][106226] Updated weights for policy 0, policy_version 217734 (0.0011) [2023-12-27 20:47:35,762][106225] Updated weights for policy 1, policy_version 217884 (0.0010) [2023-12-27 20:47:36,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 111542272. Throughput: 0: 10068.1, 1: 9813.4. Samples: 111551468. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:47:36,176][105115] Avg episode reward: [(0, '-4.929'), (1, '-5.900')] [2023-12-27 20:47:36,454][106225] Updated weights for policy 1, policy_version 217894 (0.0009) [2023-12-27 20:47:36,486][106226] Updated weights for policy 0, policy_version 217744 (0.0011) [2023-12-27 20:47:36,518][106225] Updated weights for policy 1, policy_version 217904 (0.0009) [2023-12-27 20:47:36,551][106226] Updated weights for policy 0, policy_version 217754 (0.0009) [2023-12-27 20:47:36,581][106225] Updated weights for policy 1, policy_version 217914 (0.0008) [2023-12-27 20:47:36,619][106226] Updated weights for policy 0, policy_version 217764 (0.0011) [2023-12-27 20:47:37,238][106226] Updated weights for policy 0, policy_version 217774 (0.0008) [2023-12-27 20:47:37,294][106226] Updated weights for policy 0, policy_version 217784 (0.0006) [2023-12-27 20:47:37,312][106225] Updated weights for policy 1, policy_version 217924 (0.0009) [2023-12-27 20:47:37,348][106226] Updated weights for policy 0, policy_version 217794 (0.0005) [2023-12-27 20:47:37,375][106225] Updated weights for policy 1, policy_version 217934 (0.0008) [2023-12-27 20:47:37,440][106225] Updated weights for policy 1, policy_version 217944 (0.0009) [2023-12-27 20:47:37,900][106226] Updated weights for policy 0, policy_version 217804 (0.0006) [2023-12-27 20:47:37,956][106226] Updated weights for policy 0, policy_version 217814 (0.0005) [2023-12-27 20:47:38,017][106226] Updated weights for policy 0, policy_version 217824 (0.0008) [2023-12-27 20:47:38,206][106225] Updated weights for policy 1, policy_version 217954 (0.0008) [2023-12-27 20:47:38,253][106225] Updated weights for policy 1, policy_version 217964 (0.0007) [2023-12-27 20:47:38,306][106225] Updated weights for policy 1, policy_version 217974 (0.0006) [2023-12-27 20:47:38,375][106225] Updated weights for policy 1, policy_version 217984 (0.0008) [2023-12-27 20:47:38,677][106226] Updated weights for policy 0, policy_version 217834 (0.0011) [2023-12-27 20:47:38,738][106226] Updated weights for policy 0, policy_version 217844 (0.0011) [2023-12-27 20:47:38,797][106226] Updated weights for policy 0, policy_version 217854 (0.0011) [2023-12-27 20:47:38,865][106226] Updated weights for policy 0, policy_version 217864 (0.0008) [2023-12-27 20:47:39,081][106225] Updated weights for policy 1, policy_version 217994 (0.0008) [2023-12-27 20:47:39,137][106225] Updated weights for policy 1, policy_version 218004 (0.0008) [2023-12-27 20:47:39,201][106225] Updated weights for policy 1, policy_version 218014 (0.0007) [2023-12-27 20:47:39,598][106226] Updated weights for policy 0, policy_version 217874 (0.0011) [2023-12-27 20:47:39,668][106226] Updated weights for policy 0, policy_version 217884 (0.0010) [2023-12-27 20:47:39,729][106226] Updated weights for policy 0, policy_version 217894 (0.0008) [2023-12-27 20:47:39,968][106225] Updated weights for policy 1, policy_version 218024 (0.0008) [2023-12-27 20:47:40,034][106225] Updated weights for policy 1, policy_version 218034 (0.0008) [2023-12-27 20:47:40,095][106225] Updated weights for policy 1, policy_version 218044 (0.0008) [2023-12-27 20:47:40,346][106226] Updated weights for policy 0, policy_version 217904 (0.0005) [2023-12-27 20:47:40,410][106226] Updated weights for policy 0, policy_version 217914 (0.0006) [2023-12-27 20:47:40,479][106226] Updated weights for policy 0, policy_version 217924 (0.0006) [2023-12-27 20:47:40,812][106225] Updated weights for policy 1, policy_version 218054 (0.0006) [2023-12-27 20:47:40,861][106225] Updated weights for policy 1, policy_version 218064 (0.0005) [2023-12-27 20:47:40,908][106225] Updated weights for policy 1, policy_version 218074 (0.0005) [2023-12-27 20:47:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 111640576. Throughput: 0: 10140.8, 1: 9774.2. Samples: 111611720. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:47:41,175][105115] Avg episode reward: [(0, '-5.057'), (1, '-5.885')] [2023-12-27 20:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000218080_55836672.pth... [2023-12-27 20:47:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000216928_55541760.pth [2023-12-27 20:47:41,198][106226] Updated weights for policy 0, policy_version 217934 (0.0007) [2023-12-27 20:47:41,263][106226] Updated weights for policy 0, policy_version 217944 (0.0007) [2023-12-27 20:47:41,325][106226] Updated weights for policy 0, policy_version 217954 (0.0006) [2023-12-27 20:47:41,371][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000217960_55812096.pth... [2023-12-27 20:47:41,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000216744_55500800.pth [2023-12-27 20:47:41,623][106225] Updated weights for policy 1, policy_version 218084 (0.0007) [2023-12-27 20:47:41,691][106225] Updated weights for policy 1, policy_version 218094 (0.0007) [2023-12-27 20:47:41,764][106225] Updated weights for policy 1, policy_version 218104 (0.0008) [2023-12-27 20:47:42,050][106226] Updated weights for policy 0, policy_version 217964 (0.0007) [2023-12-27 20:47:42,113][106226] Updated weights for policy 0, policy_version 217974 (0.0006) [2023-12-27 20:47:42,180][106226] Updated weights for policy 0, policy_version 217984 (0.0008) [2023-12-27 20:47:42,474][106225] Updated weights for policy 1, policy_version 218114 (0.0009) [2023-12-27 20:47:42,535][106225] Updated weights for policy 1, policy_version 218124 (0.0009) [2023-12-27 20:47:42,595][106225] Updated weights for policy 1, policy_version 218134 (0.0007) [2023-12-27 20:47:42,658][106225] Updated weights for policy 1, policy_version 218144 (0.0006) [2023-12-27 20:47:42,866][106226] Updated weights for policy 0, policy_version 217994 (0.0008) [2023-12-27 20:47:42,923][106226] Updated weights for policy 0, policy_version 218004 (0.0009) [2023-12-27 20:47:42,975][106226] Updated weights for policy 0, policy_version 218014 (0.0008) [2023-12-27 20:47:43,026][106226] Updated weights for policy 0, policy_version 218024 (0.0006) [2023-12-27 20:47:43,346][106225] Updated weights for policy 1, policy_version 218154 (0.0008) [2023-12-27 20:47:43,402][106225] Updated weights for policy 1, policy_version 218164 (0.0008) [2023-12-27 20:47:43,448][106225] Updated weights for policy 1, policy_version 218174 (0.0008) [2023-12-27 20:47:43,746][106226] Updated weights for policy 0, policy_version 218034 (0.0011) [2023-12-27 20:47:43,796][106226] Updated weights for policy 0, policy_version 218044 (0.0010) [2023-12-27 20:47:43,853][106226] Updated weights for policy 0, policy_version 218054 (0.0010) [2023-12-27 20:47:44,021][106225] Updated weights for policy 1, policy_version 218184 (0.0006) [2023-12-27 20:47:44,074][106225] Updated weights for policy 1, policy_version 218194 (0.0005) [2023-12-27 20:47:44,132][106225] Updated weights for policy 1, policy_version 218204 (0.0005) [2023-12-27 20:47:44,473][106226] Updated weights for policy 0, policy_version 218064 (0.0006) [2023-12-27 20:47:44,530][106226] Updated weights for policy 0, policy_version 218074 (0.0008) [2023-12-27 20:47:44,598][106226] Updated weights for policy 0, policy_version 218084 (0.0007) [2023-12-27 20:47:44,766][106225] Updated weights for policy 1, policy_version 218214 (0.0008) [2023-12-27 20:47:44,830][106225] Updated weights for policy 1, policy_version 218224 (0.0009) [2023-12-27 20:47:44,900][106225] Updated weights for policy 1, policy_version 218234 (0.0007) [2023-12-27 20:47:45,226][106226] Updated weights for policy 0, policy_version 218094 (0.0006) [2023-12-27 20:47:45,288][106226] Updated weights for policy 0, policy_version 218104 (0.0007) [2023-12-27 20:47:45,349][106226] Updated weights for policy 0, policy_version 218114 (0.0011) [2023-12-27 20:47:45,668][106225] Updated weights for policy 1, policy_version 218244 (0.0008) [2023-12-27 20:47:45,735][106225] Updated weights for policy 1, policy_version 218254 (0.0008) [2023-12-27 20:47:45,796][106225] Updated weights for policy 1, policy_version 218264 (0.0008) [2023-12-27 20:47:46,024][106226] Updated weights for policy 0, policy_version 218124 (0.0010) [2023-12-27 20:47:46,077][106226] Updated weights for policy 0, policy_version 218134 (0.0010) [2023-12-27 20:47:46,138][106226] Updated weights for policy 0, policy_version 218144 (0.0011) [2023-12-27 20:47:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 111738880. Throughput: 0: 10086.1, 1: 9830.1. Samples: 111732344. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:47:46,175][105115] Avg episode reward: [(0, '-5.162'), (1, '-5.487')] [2023-12-27 20:47:46,176][106141] Saving new best policy, reward=-5.487! [2023-12-27 20:47:46,507][106225] Updated weights for policy 1, policy_version 218274 (0.0005) [2023-12-27 20:47:46,562][106225] Updated weights for policy 1, policy_version 218284 (0.0009) [2023-12-27 20:47:46,621][106225] Updated weights for policy 1, policy_version 218294 (0.0008) [2023-12-27 20:47:46,679][106225] Updated weights for policy 1, policy_version 218304 (0.0008) [2023-12-27 20:47:46,789][106226] Updated weights for policy 0, policy_version 218154 (0.0011) [2023-12-27 20:47:46,842][106226] Updated weights for policy 0, policy_version 218164 (0.0010) [2023-12-27 20:47:46,896][106226] Updated weights for policy 0, policy_version 218174 (0.0011) [2023-12-27 20:47:46,952][106226] Updated weights for policy 0, policy_version 218184 (0.0011) [2023-12-27 20:47:47,414][106225] Updated weights for policy 1, policy_version 218314 (0.0005) [2023-12-27 20:47:47,480][106225] Updated weights for policy 1, policy_version 218324 (0.0006) [2023-12-27 20:47:47,551][106225] Updated weights for policy 1, policy_version 218334 (0.0006) [2023-12-27 20:47:47,577][106226] Updated weights for policy 0, policy_version 218194 (0.0006) [2023-12-27 20:47:47,630][106226] Updated weights for policy 0, policy_version 218204 (0.0007) [2023-12-27 20:47:47,676][106226] Updated weights for policy 0, policy_version 218214 (0.0007) [2023-12-27 20:47:48,155][106225] Updated weights for policy 1, policy_version 218344 (0.0008) [2023-12-27 20:47:48,216][106225] Updated weights for policy 1, policy_version 218354 (0.0006) [2023-12-27 20:47:48,251][106226] Updated weights for policy 0, policy_version 218224 (0.0006) [2023-12-27 20:47:48,273][106225] Updated weights for policy 1, policy_version 218364 (0.0007) [2023-12-27 20:47:48,300][106226] Updated weights for policy 0, policy_version 218234 (0.0006) [2023-12-27 20:47:48,377][106226] Updated weights for policy 0, policy_version 218244 (0.0007) [2023-12-27 20:47:48,931][106226] Updated weights for policy 0, policy_version 218254 (0.0006) [2023-12-27 20:47:48,993][106226] Updated weights for policy 0, policy_version 218264 (0.0005) [2023-12-27 20:47:49,021][106225] Updated weights for policy 1, policy_version 218374 (0.0007) [2023-12-27 20:47:49,054][106226] Updated weights for policy 0, policy_version 218274 (0.0006) [2023-12-27 20:47:49,072][106225] Updated weights for policy 1, policy_version 218384 (0.0005) [2023-12-27 20:47:49,132][106225] Updated weights for policy 1, policy_version 218394 (0.0005) [2023-12-27 20:47:49,695][106226] Updated weights for policy 0, policy_version 218284 (0.0008) [2023-12-27 20:47:49,755][106226] Updated weights for policy 0, policy_version 218294 (0.0009) [2023-12-27 20:47:49,786][106225] Updated weights for policy 1, policy_version 218404 (0.0006) [2023-12-27 20:47:49,820][106226] Updated weights for policy 0, policy_version 218304 (0.0006) [2023-12-27 20:47:49,851][106225] Updated weights for policy 1, policy_version 218414 (0.0009) [2023-12-27 20:47:49,925][106225] Updated weights for policy 1, policy_version 218424 (0.0008) [2023-12-27 20:47:50,498][106225] Updated weights for policy 1, policy_version 218434 (0.0006) [2023-12-27 20:47:50,546][106225] Updated weights for policy 1, policy_version 218444 (0.0005) [2023-12-27 20:47:50,587][106226] Updated weights for policy 0, policy_version 218314 (0.0008) [2023-12-27 20:47:50,605][106225] Updated weights for policy 1, policy_version 218454 (0.0008) [2023-12-27 20:47:50,649][106226] Updated weights for policy 0, policy_version 218324 (0.0011) [2023-12-27 20:47:50,663][106225] Updated weights for policy 1, policy_version 218464 (0.0008) [2023-12-27 20:47:50,708][106226] Updated weights for policy 0, policy_version 218334 (0.0007) [2023-12-27 20:47:50,776][106226] Updated weights for policy 0, policy_version 218344 (0.0008) [2023-12-27 20:47:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 111845376. Throughput: 0: 10130.4, 1: 9870.5. Samples: 111854620. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:47:51,175][105115] Avg episode reward: [(0, '-4.948'), (1, '-5.707')] [2023-12-27 20:47:51,409][106225] Updated weights for policy 1, policy_version 218474 (0.0007) [2023-12-27 20:47:51,468][106225] Updated weights for policy 1, policy_version 218484 (0.0008) [2023-12-27 20:47:51,530][106225] Updated weights for policy 1, policy_version 218494 (0.0009) [2023-12-27 20:47:51,553][106226] Updated weights for policy 0, policy_version 218354 (0.0011) [2023-12-27 20:47:51,617][106226] Updated weights for policy 0, policy_version 218364 (0.0011) [2023-12-27 20:47:51,687][106226] Updated weights for policy 0, policy_version 218374 (0.0010) [2023-12-27 20:47:52,252][106225] Updated weights for policy 1, policy_version 218504 (0.0007) [2023-12-27 20:47:52,305][106225] Updated weights for policy 1, policy_version 218514 (0.0007) [2023-12-27 20:47:52,366][106225] Updated weights for policy 1, policy_version 218524 (0.0007) [2023-12-27 20:47:52,394][106226] Updated weights for policy 0, policy_version 218384 (0.0010) [2023-12-27 20:47:52,445][106226] Updated weights for policy 0, policy_version 218394 (0.0010) [2023-12-27 20:47:52,492][106226] Updated weights for policy 0, policy_version 218404 (0.0010) [2023-12-27 20:47:53,127][106225] Updated weights for policy 1, policy_version 218534 (0.0007) [2023-12-27 20:47:53,192][106225] Updated weights for policy 1, policy_version 218544 (0.0005) [2023-12-27 20:47:53,243][106226] Updated weights for policy 0, policy_version 218414 (0.0010) [2023-12-27 20:47:53,254][106225] Updated weights for policy 1, policy_version 218554 (0.0006) [2023-12-27 20:47:53,305][106226] Updated weights for policy 0, policy_version 218424 (0.0009) [2023-12-27 20:47:53,364][106226] Updated weights for policy 0, policy_version 218434 (0.0009) [2023-12-27 20:47:53,821][106225] Updated weights for policy 1, policy_version 218564 (0.0007) [2023-12-27 20:47:53,879][106225] Updated weights for policy 1, policy_version 218574 (0.0008) [2023-12-27 20:47:53,943][106225] Updated weights for policy 1, policy_version 218584 (0.0006) [2023-12-27 20:47:54,123][106226] Updated weights for policy 0, policy_version 218444 (0.0008) [2023-12-27 20:47:54,174][106226] Updated weights for policy 0, policy_version 218454 (0.0009) [2023-12-27 20:47:54,221][106226] Updated weights for policy 0, policy_version 218464 (0.0008) [2023-12-27 20:47:54,581][106225] Updated weights for policy 1, policy_version 218594 (0.0005) [2023-12-27 20:47:54,641][106225] Updated weights for policy 1, policy_version 218604 (0.0005) [2023-12-27 20:47:54,710][106225] Updated weights for policy 1, policy_version 218614 (0.0005) [2023-12-27 20:47:54,775][106225] Updated weights for policy 1, policy_version 218624 (0.0006) [2023-12-27 20:47:55,011][106226] Updated weights for policy 0, policy_version 218474 (0.0009) [2023-12-27 20:47:55,069][106226] Updated weights for policy 0, policy_version 218484 (0.0008) [2023-12-27 20:47:55,133][106226] Updated weights for policy 0, policy_version 218494 (0.0009) [2023-12-27 20:47:55,181][106226] Updated weights for policy 0, policy_version 218504 (0.0009) [2023-12-27 20:47:55,319][106225] Updated weights for policy 1, policy_version 218634 (0.0007) [2023-12-27 20:47:55,364][106225] Updated weights for policy 1, policy_version 218644 (0.0005) [2023-12-27 20:47:55,419][106225] Updated weights for policy 1, policy_version 218654 (0.0005) [2023-12-27 20:47:55,922][106226] Updated weights for policy 0, policy_version 218514 (0.0009) [2023-12-27 20:47:55,977][106226] Updated weights for policy 0, policy_version 218524 (0.0008) [2023-12-27 20:47:56,012][106225] Updated weights for policy 1, policy_version 218664 (0.0006) [2023-12-27 20:47:56,030][106226] Updated weights for policy 0, policy_version 218534 (0.0008) [2023-12-27 20:47:56,065][106225] Updated weights for policy 1, policy_version 218674 (0.0006) [2023-12-27 20:47:56,124][106225] Updated weights for policy 1, policy_version 218684 (0.0010) [2023-12-27 20:47:56,175][105115] Fps is (10 sec: 21298.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 111951872. Throughput: 0: 10118.3, 1: 9816.8. Samples: 111912852. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:47:56,175][105115] Avg episode reward: [(0, '-4.910'), (1, '-5.760')] [2023-12-27 20:47:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000218688_55992320.pth... [2023-12-27 20:47:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000218536_55959552.pth... [2023-12-27 20:47:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000217504_55689216.pth [2023-12-27 20:47:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000217352_55656448.pth [2023-12-27 20:47:56,813][106225] Updated weights for policy 1, policy_version 218694 (0.0007) [2023-12-27 20:47:56,817][106226] Updated weights for policy 0, policy_version 218544 (0.0007) [2023-12-27 20:47:56,860][106225] Updated weights for policy 1, policy_version 218704 (0.0007) [2023-12-27 20:47:56,876][106226] Updated weights for policy 0, policy_version 218554 (0.0007) [2023-12-27 20:47:56,902][106225] Updated weights for policy 1, policy_version 218714 (0.0008) [2023-12-27 20:47:56,936][106226] Updated weights for policy 0, policy_version 218564 (0.0006) [2023-12-27 20:47:57,605][106226] Updated weights for policy 0, policy_version 218574 (0.0008) [2023-12-27 20:47:57,622][106225] Updated weights for policy 1, policy_version 218724 (0.0007) [2023-12-27 20:47:57,663][106226] Updated weights for policy 0, policy_version 218584 (0.0008) [2023-12-27 20:47:57,680][106225] Updated weights for policy 1, policy_version 218734 (0.0008) [2023-12-27 20:47:57,722][106226] Updated weights for policy 0, policy_version 218594 (0.0007) [2023-12-27 20:47:57,744][106225] Updated weights for policy 1, policy_version 218744 (0.0006) [2023-12-27 20:47:58,397][106226] Updated weights for policy 0, policy_version 218604 (0.0007) [2023-12-27 20:47:58,441][106225] Updated weights for policy 1, policy_version 218754 (0.0007) [2023-12-27 20:47:58,464][106226] Updated weights for policy 0, policy_version 218614 (0.0009) [2023-12-27 20:47:58,505][106225] Updated weights for policy 1, policy_version 218764 (0.0009) [2023-12-27 20:47:58,532][106226] Updated weights for policy 0, policy_version 218624 (0.0012) [2023-12-27 20:47:58,571][106225] Updated weights for policy 1, policy_version 218774 (0.0009) [2023-12-27 20:47:58,638][106225] Updated weights for policy 1, policy_version 218784 (0.0008) [2023-12-27 20:47:59,314][106226] Updated weights for policy 0, policy_version 218634 (0.0010) [2023-12-27 20:47:59,379][106226] Updated weights for policy 0, policy_version 218644 (0.0010) [2023-12-27 20:47:59,449][106226] Updated weights for policy 0, policy_version 218654 (0.0008) [2023-12-27 20:47:59,487][106225] Updated weights for policy 1, policy_version 218794 (0.0010) [2023-12-27 20:47:59,512][106226] Updated weights for policy 0, policy_version 218664 (0.0007) [2023-12-27 20:47:59,539][106225] Updated weights for policy 1, policy_version 218804 (0.0010) [2023-12-27 20:47:59,594][106225] Updated weights for policy 1, policy_version 218814 (0.0010) [2023-12-27 20:48:00,151][106226] Updated weights for policy 0, policy_version 218674 (0.0008) [2023-12-27 20:48:00,214][106226] Updated weights for policy 0, policy_version 218684 (0.0006) [2023-12-27 20:48:00,276][106226] Updated weights for policy 0, policy_version 218694 (0.0009) [2023-12-27 20:48:00,323][106225] Updated weights for policy 1, policy_version 218824 (0.0007) [2023-12-27 20:48:00,384][106225] Updated weights for policy 1, policy_version 218834 (0.0009) [2023-12-27 20:48:00,442][106225] Updated weights for policy 1, policy_version 218844 (0.0006) [2023-12-27 20:48:00,925][106226] Updated weights for policy 0, policy_version 218704 (0.0008) [2023-12-27 20:48:00,971][106226] Updated weights for policy 0, policy_version 218714 (0.0010) [2023-12-27 20:48:01,019][106226] Updated weights for policy 0, policy_version 218724 (0.0010) [2023-12-27 20:48:01,122][106225] Updated weights for policy 1, policy_version 218854 (0.0009) [2023-12-27 20:48:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 112041984. Throughput: 0: 9990.6, 1: 9944.0. Samples: 112031220. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:01,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-5.738')] [2023-12-27 20:48:01,194][106225] Updated weights for policy 1, policy_version 218864 (0.0009) [2023-12-27 20:48:01,242][106225] Updated weights for policy 1, policy_version 218874 (0.0010) [2023-12-27 20:48:01,728][106226] Updated weights for policy 0, policy_version 218734 (0.0009) [2023-12-27 20:48:01,797][106226] Updated weights for policy 0, policy_version 218744 (0.0008) [2023-12-27 20:48:01,853][106226] Updated weights for policy 0, policy_version 218754 (0.0006) [2023-12-27 20:48:01,913][106225] Updated weights for policy 1, policy_version 218884 (0.0008) [2023-12-27 20:48:01,972][106225] Updated weights for policy 1, policy_version 218894 (0.0006) [2023-12-27 20:48:02,038][106225] Updated weights for policy 1, policy_version 218904 (0.0006) [2023-12-27 20:48:02,522][106226] Updated weights for policy 0, policy_version 218764 (0.0005) [2023-12-27 20:48:02,578][106226] Updated weights for policy 0, policy_version 218774 (0.0005) [2023-12-27 20:48:02,638][106226] Updated weights for policy 0, policy_version 218784 (0.0007) [2023-12-27 20:48:02,800][106225] Updated weights for policy 1, policy_version 218914 (0.0009) [2023-12-27 20:48:02,853][106225] Updated weights for policy 1, policy_version 218924 (0.0008) [2023-12-27 20:48:02,911][106225] Updated weights for policy 1, policy_version 218934 (0.0006) [2023-12-27 20:48:02,959][106225] Updated weights for policy 1, policy_version 218944 (0.0008) [2023-12-27 20:48:03,270][106226] Updated weights for policy 0, policy_version 218794 (0.0008) [2023-12-27 20:48:03,319][106226] Updated weights for policy 0, policy_version 218804 (0.0006) [2023-12-27 20:48:03,368][106226] Updated weights for policy 0, policy_version 218814 (0.0008) [2023-12-27 20:48:03,416][106226] Updated weights for policy 0, policy_version 218824 (0.0007) [2023-12-27 20:48:03,679][106225] Updated weights for policy 1, policy_version 218954 (0.0008) [2023-12-27 20:48:03,737][106225] Updated weights for policy 1, policy_version 218964 (0.0008) [2023-12-27 20:48:03,792][106225] Updated weights for policy 1, policy_version 218974 (0.0008) [2023-12-27 20:48:04,135][106226] Updated weights for policy 0, policy_version 218834 (0.0008) [2023-12-27 20:48:04,200][106226] Updated weights for policy 0, policy_version 218844 (0.0008) [2023-12-27 20:48:04,269][106226] Updated weights for policy 0, policy_version 218854 (0.0009) [2023-12-27 20:48:04,488][106225] Updated weights for policy 1, policy_version 218984 (0.0008) [2023-12-27 20:48:04,543][106225] Updated weights for policy 1, policy_version 218994 (0.0008) [2023-12-27 20:48:04,596][106225] Updated weights for policy 1, policy_version 219004 (0.0009) [2023-12-27 20:48:04,998][106226] Updated weights for policy 0, policy_version 218864 (0.0009) [2023-12-27 20:48:05,056][106226] Updated weights for policy 0, policy_version 218874 (0.0008) [2023-12-27 20:48:05,122][106226] Updated weights for policy 0, policy_version 218884 (0.0008) [2023-12-27 20:48:05,317][106225] Updated weights for policy 1, policy_version 219014 (0.0009) [2023-12-27 20:48:05,375][106225] Updated weights for policy 1, policy_version 219024 (0.0008) [2023-12-27 20:48:05,423][106225] Updated weights for policy 1, policy_version 219034 (0.0008) [2023-12-27 20:48:05,795][106226] Updated weights for policy 0, policy_version 218894 (0.0007) [2023-12-27 20:48:05,867][106226] Updated weights for policy 0, policy_version 218904 (0.0009) [2023-12-27 20:48:05,929][106226] Updated weights for policy 0, policy_version 218914 (0.0009) [2023-12-27 20:48:06,079][106225] Updated weights for policy 1, policy_version 219044 (0.0008) [2023-12-27 20:48:06,146][106225] Updated weights for policy 1, policy_version 219054 (0.0008) [2023-12-27 20:48:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 112140288. Throughput: 0: 9975.0, 1: 9984.0. Samples: 112149852. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:06,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-6.118')] [2023-12-27 20:48:06,199][106225] Updated weights for policy 1, policy_version 219064 (0.0009) [2023-12-27 20:48:06,659][106226] Updated weights for policy 0, policy_version 218924 (0.0009) [2023-12-27 20:48:06,721][106226] Updated weights for policy 0, policy_version 218934 (0.0009) [2023-12-27 20:48:06,771][106226] Updated weights for policy 0, policy_version 218944 (0.0010) [2023-12-27 20:48:06,934][106225] Updated weights for policy 1, policy_version 219074 (0.0007) [2023-12-27 20:48:06,992][106225] Updated weights for policy 1, policy_version 219084 (0.0006) [2023-12-27 20:48:07,041][106225] Updated weights for policy 1, policy_version 219094 (0.0005) [2023-12-27 20:48:07,092][106225] Updated weights for policy 1, policy_version 219104 (0.0006) [2023-12-27 20:48:07,374][106226] Updated weights for policy 0, policy_version 218954 (0.0010) [2023-12-27 20:48:07,433][106226] Updated weights for policy 0, policy_version 218964 (0.0011) [2023-12-27 20:48:07,494][106226] Updated weights for policy 0, policy_version 218974 (0.0011) [2023-12-27 20:48:07,557][106226] Updated weights for policy 0, policy_version 218984 (0.0010) [2023-12-27 20:48:07,658][106225] Updated weights for policy 1, policy_version 219114 (0.0010) [2023-12-27 20:48:07,722][106225] Updated weights for policy 1, policy_version 219124 (0.0011) [2023-12-27 20:48:07,787][106225] Updated weights for policy 1, policy_version 219134 (0.0010) [2023-12-27 20:48:08,199][106226] Updated weights for policy 0, policy_version 218994 (0.0010) [2023-12-27 20:48:08,246][106226] Updated weights for policy 0, policy_version 219004 (0.0010) [2023-12-27 20:48:08,292][106226] Updated weights for policy 0, policy_version 219014 (0.0010) [2023-12-27 20:48:08,487][106225] Updated weights for policy 1, policy_version 219144 (0.0006) [2023-12-27 20:48:08,547][106225] Updated weights for policy 1, policy_version 219154 (0.0006) [2023-12-27 20:48:08,609][106225] Updated weights for policy 1, policy_version 219164 (0.0010) [2023-12-27 20:48:09,038][106226] Updated weights for policy 0, policy_version 219024 (0.0006) [2023-12-27 20:48:09,107][106226] Updated weights for policy 0, policy_version 219034 (0.0005) [2023-12-27 20:48:09,158][106226] Updated weights for policy 0, policy_version 219044 (0.0010) [2023-12-27 20:48:09,324][106225] Updated weights for policy 1, policy_version 219174 (0.0011) [2023-12-27 20:48:09,392][106225] Updated weights for policy 1, policy_version 219184 (0.0010) [2023-12-27 20:48:09,461][106225] Updated weights for policy 1, policy_version 219194 (0.0014) [2023-12-27 20:48:09,866][106226] Updated weights for policy 0, policy_version 219054 (0.0009) [2023-12-27 20:48:09,931][106226] Updated weights for policy 0, policy_version 219064 (0.0008) [2023-12-27 20:48:09,996][106226] Updated weights for policy 0, policy_version 219074 (0.0008) [2023-12-27 20:48:10,226][106225] Updated weights for policy 1, policy_version 219204 (0.0010) [2023-12-27 20:48:10,291][106225] Updated weights for policy 1, policy_version 219214 (0.0011) [2023-12-27 20:48:10,354][106225] Updated weights for policy 1, policy_version 219224 (0.0010) [2023-12-27 20:48:10,719][106226] Updated weights for policy 0, policy_version 219084 (0.0007) [2023-12-27 20:48:10,768][106226] Updated weights for policy 0, policy_version 219094 (0.0005) [2023-12-27 20:48:10,817][106226] Updated weights for policy 0, policy_version 219104 (0.0006) [2023-12-27 20:48:11,018][106225] Updated weights for policy 1, policy_version 219234 (0.0009) [2023-12-27 20:48:11,084][106225] Updated weights for policy 1, policy_version 219244 (0.0007) [2023-12-27 20:48:11,149][106225] Updated weights for policy 1, policy_version 219254 (0.0007) [2023-12-27 20:48:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 112238592. Throughput: 0: 10008.8, 1: 10066.0. Samples: 112212604. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:11,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-5.939')] [2023-12-27 20:48:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000219112_56107008.pth... [2023-12-27 20:48:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000217960_55812096.pth [2023-12-27 20:48:11,211][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000219264_56139776.pth... [2023-12-27 20:48:11,212][106225] Updated weights for policy 1, policy_version 219264 (0.0010) [2023-12-27 20:48:11,216][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000218080_55836672.pth [2023-12-27 20:48:11,628][106226] Updated weights for policy 0, policy_version 219114 (0.0008) [2023-12-27 20:48:11,695][106226] Updated weights for policy 0, policy_version 219124 (0.0009) [2023-12-27 20:48:11,764][106226] Updated weights for policy 0, policy_version 219134 (0.0008) [2023-12-27 20:48:11,831][106226] Updated weights for policy 0, policy_version 219144 (0.0008) [2023-12-27 20:48:11,956][106225] Updated weights for policy 1, policy_version 219274 (0.0008) [2023-12-27 20:48:12,009][106225] Updated weights for policy 1, policy_version 219284 (0.0007) [2023-12-27 20:48:12,059][106225] Updated weights for policy 1, policy_version 219294 (0.0009) [2023-12-27 20:48:12,581][106226] Updated weights for policy 0, policy_version 219154 (0.0008) [2023-12-27 20:48:12,634][106226] Updated weights for policy 0, policy_version 219164 (0.0011) [2023-12-27 20:48:12,692][106226] Updated weights for policy 0, policy_version 219174 (0.0011) [2023-12-27 20:48:12,810][106225] Updated weights for policy 1, policy_version 219304 (0.0011) [2023-12-27 20:48:12,868][106225] Updated weights for policy 1, policy_version 219314 (0.0010) [2023-12-27 20:48:12,918][106225] Updated weights for policy 1, policy_version 219324 (0.0010) [2023-12-27 20:48:13,397][106226] Updated weights for policy 0, policy_version 219184 (0.0010) [2023-12-27 20:48:13,453][106226] Updated weights for policy 0, policy_version 219194 (0.0010) [2023-12-27 20:48:13,512][106226] Updated weights for policy 0, policy_version 219204 (0.0010) [2023-12-27 20:48:13,625][106225] Updated weights for policy 1, policy_version 219334 (0.0009) [2023-12-27 20:48:13,673][106225] Updated weights for policy 1, policy_version 219344 (0.0008) [2023-12-27 20:48:13,740][106225] Updated weights for policy 1, policy_version 219354 (0.0005) [2023-12-27 20:48:14,157][106226] Updated weights for policy 0, policy_version 219214 (0.0007) [2023-12-27 20:48:14,210][106226] Updated weights for policy 0, policy_version 219224 (0.0005) [2023-12-27 20:48:14,267][106226] Updated weights for policy 0, policy_version 219234 (0.0005) [2023-12-27 20:48:14,427][106225] Updated weights for policy 1, policy_version 219364 (0.0008) [2023-12-27 20:48:14,499][106225] Updated weights for policy 1, policy_version 219374 (0.0010) [2023-12-27 20:48:14,563][106225] Updated weights for policy 1, policy_version 219384 (0.0010) [2023-12-27 20:48:14,791][106226] Updated weights for policy 0, policy_version 219244 (0.0007) [2023-12-27 20:48:14,853][106226] Updated weights for policy 0, policy_version 219254 (0.0009) [2023-12-27 20:48:14,926][106226] Updated weights for policy 0, policy_version 219264 (0.0006) [2023-12-27 20:48:15,239][106225] Updated weights for policy 1, policy_version 219394 (0.0010) [2023-12-27 20:48:15,302][106225] Updated weights for policy 1, policy_version 219404 (0.0011) [2023-12-27 20:48:15,362][106225] Updated weights for policy 1, policy_version 219414 (0.0010) [2023-12-27 20:48:15,425][106225] Updated weights for policy 1, policy_version 219424 (0.0010) [2023-12-27 20:48:15,606][106226] Updated weights for policy 0, policy_version 219274 (0.0006) [2023-12-27 20:48:15,669][106226] Updated weights for policy 0, policy_version 219284 (0.0007) [2023-12-27 20:48:15,738][106226] Updated weights for policy 0, policy_version 219294 (0.0008) [2023-12-27 20:48:15,782][106226] Updated weights for policy 0, policy_version 219304 (0.0008) [2023-12-27 20:48:16,128][106225] Updated weights for policy 1, policy_version 219434 (0.0011) [2023-12-27 20:48:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 112336896. Throughput: 0: 10004.5, 1: 10036.2. Samples: 112329980. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:16,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.975')] [2023-12-27 20:48:16,183][106225] Updated weights for policy 1, policy_version 219444 (0.0008) [2023-12-27 20:48:16,246][106225] Updated weights for policy 1, policy_version 219454 (0.0010) [2023-12-27 20:48:16,433][106226] Updated weights for policy 0, policy_version 219314 (0.0008) [2023-12-27 20:48:16,483][106226] Updated weights for policy 0, policy_version 219324 (0.0009) [2023-12-27 20:48:16,534][106226] Updated weights for policy 0, policy_version 219334 (0.0009) [2023-12-27 20:48:16,800][106225] Updated weights for policy 1, policy_version 219464 (0.0010) [2023-12-27 20:48:16,866][106225] Updated weights for policy 1, policy_version 219474 (0.0010) [2023-12-27 20:48:16,915][106225] Updated weights for policy 1, policy_version 219484 (0.0007) [2023-12-27 20:48:17,301][106226] Updated weights for policy 0, policy_version 219344 (0.0007) [2023-12-27 20:48:17,358][106226] Updated weights for policy 0, policy_version 219354 (0.0008) [2023-12-27 20:48:17,418][106226] Updated weights for policy 0, policy_version 219364 (0.0008) [2023-12-27 20:48:17,634][106225] Updated weights for policy 1, policy_version 219494 (0.0009) [2023-12-27 20:48:17,681][106225] Updated weights for policy 1, policy_version 219504 (0.0010) [2023-12-27 20:48:17,732][106225] Updated weights for policy 1, policy_version 219514 (0.0010) [2023-12-27 20:48:18,154][106226] Updated weights for policy 0, policy_version 219374 (0.0008) [2023-12-27 20:48:18,209][106226] Updated weights for policy 0, policy_version 219384 (0.0008) [2023-12-27 20:48:18,270][106226] Updated weights for policy 0, policy_version 219394 (0.0008) [2023-12-27 20:48:18,506][106225] Updated weights for policy 1, policy_version 219524 (0.0010) [2023-12-27 20:48:18,567][106225] Updated weights for policy 1, policy_version 219534 (0.0010) [2023-12-27 20:48:18,631][106225] Updated weights for policy 1, policy_version 219544 (0.0011) [2023-12-27 20:48:19,018][106226] Updated weights for policy 0, policy_version 219404 (0.0008) [2023-12-27 20:48:19,081][106226] Updated weights for policy 0, policy_version 219414 (0.0008) [2023-12-27 20:48:19,143][106226] Updated weights for policy 0, policy_version 219424 (0.0008) [2023-12-27 20:48:19,343][106225] Updated weights for policy 1, policy_version 219554 (0.0011) [2023-12-27 20:48:19,403][106225] Updated weights for policy 1, policy_version 219564 (0.0010) [2023-12-27 20:48:19,460][106225] Updated weights for policy 1, policy_version 219574 (0.0010) [2023-12-27 20:48:19,523][106225] Updated weights for policy 1, policy_version 219584 (0.0011) [2023-12-27 20:48:19,904][106226] Updated weights for policy 0, policy_version 219434 (0.0008) [2023-12-27 20:48:19,972][106226] Updated weights for policy 0, policy_version 219444 (0.0009) [2023-12-27 20:48:20,039][106226] Updated weights for policy 0, policy_version 219454 (0.0006) [2023-12-27 20:48:20,104][106226] Updated weights for policy 0, policy_version 219464 (0.0006) [2023-12-27 20:48:20,286][106225] Updated weights for policy 1, policy_version 219594 (0.0011) [2023-12-27 20:48:20,341][106225] Updated weights for policy 1, policy_version 219604 (0.0010) [2023-12-27 20:48:20,397][106225] Updated weights for policy 1, policy_version 219614 (0.0010) [2023-12-27 20:48:20,770][106226] Updated weights for policy 0, policy_version 219474 (0.0008) [2023-12-27 20:48:20,830][106226] Updated weights for policy 0, policy_version 219484 (0.0007) [2023-12-27 20:48:20,887][106226] Updated weights for policy 0, policy_version 219494 (0.0009) [2023-12-27 20:48:21,076][106225] Updated weights for policy 1, policy_version 219624 (0.0009) [2023-12-27 20:48:21,141][106225] Updated weights for policy 1, policy_version 219634 (0.0009) [2023-12-27 20:48:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 112435200. Throughput: 0: 9972.0, 1: 9910.9. Samples: 112446196. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:21,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-5.771')] [2023-12-27 20:48:21,203][106225] Updated weights for policy 1, policy_version 219644 (0.0008) [2023-12-27 20:48:21,610][106226] Updated weights for policy 0, policy_version 219504 (0.0006) [2023-12-27 20:48:21,677][106226] Updated weights for policy 0, policy_version 219514 (0.0007) [2023-12-27 20:48:21,754][106226] Updated weights for policy 0, policy_version 219524 (0.0008) [2023-12-27 20:48:22,065][106225] Updated weights for policy 1, policy_version 219654 (0.0008) [2023-12-27 20:48:22,121][106225] Updated weights for policy 1, policy_version 219664 (0.0008) [2023-12-27 20:48:22,173][106225] Updated weights for policy 1, policy_version 219674 (0.0009) [2023-12-27 20:48:22,386][106226] Updated weights for policy 0, policy_version 219534 (0.0007) [2023-12-27 20:48:22,453][106226] Updated weights for policy 0, policy_version 219544 (0.0007) [2023-12-27 20:48:22,523][106226] Updated weights for policy 0, policy_version 219554 (0.0009) [2023-12-27 20:48:22,900][106225] Updated weights for policy 1, policy_version 219684 (0.0007) [2023-12-27 20:48:22,960][106225] Updated weights for policy 1, policy_version 219694 (0.0005) [2023-12-27 20:48:23,025][106225] Updated weights for policy 1, policy_version 219704 (0.0005) [2023-12-27 20:48:23,256][106226] Updated weights for policy 0, policy_version 219564 (0.0007) [2023-12-27 20:48:23,313][106226] Updated weights for policy 0, policy_version 219574 (0.0005) [2023-12-27 20:48:23,366][106226] Updated weights for policy 0, policy_version 219584 (0.0008) [2023-12-27 20:48:23,621][106225] Updated weights for policy 1, policy_version 219714 (0.0006) [2023-12-27 20:48:23,676][106225] Updated weights for policy 1, policy_version 219724 (0.0008) [2023-12-27 20:48:23,727][106225] Updated weights for policy 1, policy_version 219734 (0.0008) [2023-12-27 20:48:23,782][106225] Updated weights for policy 1, policy_version 219744 (0.0008) [2023-12-27 20:48:24,052][106226] Updated weights for policy 0, policy_version 219594 (0.0008) [2023-12-27 20:48:24,109][106226] Updated weights for policy 0, policy_version 219604 (0.0006) [2023-12-27 20:48:24,159][106226] Updated weights for policy 0, policy_version 219614 (0.0006) [2023-12-27 20:48:24,225][106226] Updated weights for policy 0, policy_version 219624 (0.0005) [2023-12-27 20:48:24,501][106225] Updated weights for policy 1, policy_version 219754 (0.0008) [2023-12-27 20:48:24,552][106225] Updated weights for policy 1, policy_version 219764 (0.0008) [2023-12-27 20:48:24,603][106225] Updated weights for policy 1, policy_version 219774 (0.0008) [2023-12-27 20:48:24,851][106226] Updated weights for policy 0, policy_version 219634 (0.0008) [2023-12-27 20:48:24,907][106226] Updated weights for policy 0, policy_version 219644 (0.0008) [2023-12-27 20:48:24,962][106226] Updated weights for policy 0, policy_version 219654 (0.0009) [2023-12-27 20:48:25,281][106225] Updated weights for policy 1, policy_version 219784 (0.0008) [2023-12-27 20:48:25,327][106225] Updated weights for policy 1, policy_version 219794 (0.0008) [2023-12-27 20:48:25,377][106225] Updated weights for policy 1, policy_version 219804 (0.0007) [2023-12-27 20:48:25,726][106226] Updated weights for policy 0, policy_version 219664 (0.0010) [2023-12-27 20:48:25,787][106226] Updated weights for policy 0, policy_version 219674 (0.0010) [2023-12-27 20:48:25,847][106226] Updated weights for policy 0, policy_version 219684 (0.0010) [2023-12-27 20:48:26,132][106225] Updated weights for policy 1, policy_version 219814 (0.0008) [2023-12-27 20:48:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 112533504. Throughput: 0: 9935.0, 1: 9917.0. Samples: 112505064. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:26,175][105115] Avg episode reward: [(0, '-5.167'), (1, '-5.979')] [2023-12-27 20:48:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000219688_56254464.pth... [2023-12-27 20:48:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000218536_55959552.pth [2023-12-27 20:48:26,185][106225] Updated weights for policy 1, policy_version 219824 (0.0007) [2023-12-27 20:48:26,236][106225] Updated weights for policy 1, policy_version 219834 (0.0007) [2023-12-27 20:48:26,264][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000219840_56287232.pth... [2023-12-27 20:48:26,267][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000218688_55992320.pth [2023-12-27 20:48:26,561][106226] Updated weights for policy 0, policy_version 219694 (0.0010) [2023-12-27 20:48:26,624][106226] Updated weights for policy 0, policy_version 219704 (0.0010) [2023-12-27 20:48:26,691][106226] Updated weights for policy 0, policy_version 219714 (0.0010) [2023-12-27 20:48:26,884][106225] Updated weights for policy 1, policy_version 219844 (0.0009) [2023-12-27 20:48:26,949][106225] Updated weights for policy 1, policy_version 219854 (0.0008) [2023-12-27 20:48:27,007][106225] Updated weights for policy 1, policy_version 219864 (0.0008) [2023-12-27 20:48:27,340][106226] Updated weights for policy 0, policy_version 219724 (0.0010) [2023-12-27 20:48:27,404][106226] Updated weights for policy 0, policy_version 219734 (0.0008) [2023-12-27 20:48:27,452][106226] Updated weights for policy 0, policy_version 219744 (0.0008) [2023-12-27 20:48:27,691][106225] Updated weights for policy 1, policy_version 219874 (0.0008) [2023-12-27 20:48:27,747][106225] Updated weights for policy 1, policy_version 219884 (0.0006) [2023-12-27 20:48:27,801][106225] Updated weights for policy 1, policy_version 219894 (0.0006) [2023-12-27 20:48:27,849][106225] Updated weights for policy 1, policy_version 219904 (0.0005) [2023-12-27 20:48:28,076][106226] Updated weights for policy 0, policy_version 219754 (0.0008) [2023-12-27 20:48:28,126][106226] Updated weights for policy 0, policy_version 219764 (0.0005) [2023-12-27 20:48:28,172][106226] Updated weights for policy 0, policy_version 219774 (0.0005) [2023-12-27 20:48:28,226][106226] Updated weights for policy 0, policy_version 219784 (0.0005) [2023-12-27 20:48:28,464][106225] Updated weights for policy 1, policy_version 219914 (0.0005) [2023-12-27 20:48:28,528][106225] Updated weights for policy 1, policy_version 219924 (0.0005) [2023-12-27 20:48:28,587][106225] Updated weights for policy 1, policy_version 219934 (0.0008) [2023-12-27 20:48:28,854][106226] Updated weights for policy 0, policy_version 219794 (0.0008) [2023-12-27 20:48:28,912][106226] Updated weights for policy 0, policy_version 219804 (0.0009) [2023-12-27 20:48:28,960][106226] Updated weights for policy 0, policy_version 219814 (0.0007) [2023-12-27 20:48:29,196][106225] Updated weights for policy 1, policy_version 219944 (0.0006) [2023-12-27 20:48:29,262][106225] Updated weights for policy 1, policy_version 219954 (0.0008) [2023-12-27 20:48:29,330][106225] Updated weights for policy 1, policy_version 219964 (0.0006) [2023-12-27 20:48:29,692][106226] Updated weights for policy 0, policy_version 219824 (0.0007) [2023-12-27 20:48:29,754][106226] Updated weights for policy 0, policy_version 219834 (0.0008) [2023-12-27 20:48:29,818][106226] Updated weights for policy 0, policy_version 219844 (0.0008) [2023-12-27 20:48:29,965][106225] Updated weights for policy 1, policy_version 219974 (0.0009) [2023-12-27 20:48:30,022][106225] Updated weights for policy 1, policy_version 219984 (0.0008) [2023-12-27 20:48:30,084][106225] Updated weights for policy 1, policy_version 219994 (0.0009) [2023-12-27 20:48:30,466][106226] Updated weights for policy 0, policy_version 219854 (0.0008) [2023-12-27 20:48:30,515][106226] Updated weights for policy 0, policy_version 219864 (0.0010) [2023-12-27 20:48:30,564][106226] Updated weights for policy 0, policy_version 219874 (0.0009) [2023-12-27 20:48:30,811][106225] Updated weights for policy 1, policy_version 220004 (0.0009) [2023-12-27 20:48:30,865][106225] Updated weights for policy 1, policy_version 220015 (0.0009) [2023-12-27 20:48:30,911][106225] Updated weights for policy 1, policy_version 220025 (0.0008) [2023-12-27 20:48:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 112640000. Throughput: 0: 9935.8, 1: 9964.7. Samples: 112627868. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:31,175][105115] Avg episode reward: [(0, '-5.105'), (1, '-5.833')] [2023-12-27 20:48:31,208][106226] Updated weights for policy 0, policy_version 219884 (0.0010) [2023-12-27 20:48:31,281][106226] Updated weights for policy 0, policy_version 219894 (0.0007) [2023-12-27 20:48:31,336][106226] Updated weights for policy 0, policy_version 219904 (0.0008) [2023-12-27 20:48:31,733][106225] Updated weights for policy 1, policy_version 220035 (0.0007) [2023-12-27 20:48:31,795][106225] Updated weights for policy 1, policy_version 220045 (0.0008) [2023-12-27 20:48:31,862][106225] Updated weights for policy 1, policy_version 220055 (0.0008) [2023-12-27 20:48:31,996][106226] Updated weights for policy 0, policy_version 219914 (0.0008) [2023-12-27 20:48:32,045][106226] Updated weights for policy 0, policy_version 219924 (0.0007) [2023-12-27 20:48:32,098][106226] Updated weights for policy 0, policy_version 219934 (0.0008) [2023-12-27 20:48:32,156][106226] Updated weights for policy 0, policy_version 219944 (0.0007) [2023-12-27 20:48:32,599][106225] Updated weights for policy 1, policy_version 220065 (0.0008) [2023-12-27 20:48:32,656][106225] Updated weights for policy 1, policy_version 220075 (0.0009) [2023-12-27 20:48:32,707][106225] Updated weights for policy 1, policy_version 220085 (0.0005) [2023-12-27 20:48:32,763][106225] Updated weights for policy 1, policy_version 220095 (0.0006) [2023-12-27 20:48:32,868][106226] Updated weights for policy 0, policy_version 219954 (0.0010) [2023-12-27 20:48:32,918][106226] Updated weights for policy 0, policy_version 219964 (0.0010) [2023-12-27 20:48:32,969][106226] Updated weights for policy 0, policy_version 219974 (0.0010) [2023-12-27 20:48:33,461][106225] Updated weights for policy 1, policy_version 220105 (0.0008) [2023-12-27 20:48:33,523][106225] Updated weights for policy 1, policy_version 220115 (0.0010) [2023-12-27 20:48:33,531][106226] Updated weights for policy 0, policy_version 219984 (0.0010) [2023-12-27 20:48:33,578][106225] Updated weights for policy 1, policy_version 220125 (0.0010) [2023-12-27 20:48:33,587][106226] Updated weights for policy 0, policy_version 219994 (0.0008) [2023-12-27 20:48:33,652][106226] Updated weights for policy 0, policy_version 220004 (0.0005) [2023-12-27 20:48:34,187][106226] Updated weights for policy 0, policy_version 220014 (0.0007) [2023-12-27 20:48:34,255][106226] Updated weights for policy 0, policy_version 220024 (0.0005) [2023-12-27 20:48:34,325][106226] Updated weights for policy 0, policy_version 220034 (0.0007) [2023-12-27 20:48:34,348][106225] Updated weights for policy 1, policy_version 220135 (0.0010) [2023-12-27 20:48:34,408][106225] Updated weights for policy 1, policy_version 220145 (0.0009) [2023-12-27 20:48:34,464][106225] Updated weights for policy 1, policy_version 220155 (0.0007) [2023-12-27 20:48:34,938][106226] Updated weights for policy 0, policy_version 220044 (0.0007) [2023-12-27 20:48:34,998][106226] Updated weights for policy 0, policy_version 220054 (0.0008) [2023-12-27 20:48:35,043][106226] Updated weights for policy 0, policy_version 220064 (0.0008) [2023-12-27 20:48:35,128][106225] Updated weights for policy 1, policy_version 220165 (0.0006) [2023-12-27 20:48:35,188][106225] Updated weights for policy 1, policy_version 220175 (0.0009) [2023-12-27 20:48:35,237][106225] Updated weights for policy 1, policy_version 220185 (0.0008) [2023-12-27 20:48:35,773][106226] Updated weights for policy 0, policy_version 220074 (0.0007) [2023-12-27 20:48:35,830][106226] Updated weights for policy 0, policy_version 220084 (0.0010) [2023-12-27 20:48:35,868][106225] Updated weights for policy 1, policy_version 220195 (0.0007) [2023-12-27 20:48:35,895][106226] Updated weights for policy 0, policy_version 220094 (0.0009) [2023-12-27 20:48:35,925][106225] Updated weights for policy 1, policy_version 220205 (0.0005) [2023-12-27 20:48:35,950][106226] Updated weights for policy 0, policy_version 220104 (0.0008) [2023-12-27 20:48:35,979][106225] Updated weights for policy 1, policy_version 220215 (0.0006) [2023-12-27 20:48:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 112746496. Throughput: 0: 9956.5, 1: 9933.7. Samples: 112749676. Policy #0 lag: (min: 23.0, avg: 27.4, max: 55.0) [2023-12-27 20:48:36,175][105115] Avg episode reward: [(0, '-5.087'), (1, '-6.110')] [2023-12-27 20:48:36,666][106225] Updated weights for policy 1, policy_version 220225 (0.0006) [2023-12-27 20:48:36,728][106225] Updated weights for policy 1, policy_version 220235 (0.0006) [2023-12-27 20:48:36,780][106225] Updated weights for policy 1, policy_version 220245 (0.0007) [2023-12-27 20:48:36,811][106226] Updated weights for policy 0, policy_version 220114 (0.0009) [2023-12-27 20:48:36,834][106225] Updated weights for policy 1, policy_version 220255 (0.0007) [2023-12-27 20:48:36,869][106226] Updated weights for policy 0, policy_version 220124 (0.0006) [2023-12-27 20:48:36,934][106226] Updated weights for policy 0, policy_version 220134 (0.0009) [2023-12-27 20:48:37,492][106226] Updated weights for policy 0, policy_version 220144 (0.0007) [2023-12-27 20:48:37,553][106226] Updated weights for policy 0, policy_version 220154 (0.0008) [2023-12-27 20:48:37,595][106225] Updated weights for policy 1, policy_version 220265 (0.0006) [2023-12-27 20:48:37,608][106226] Updated weights for policy 0, policy_version 220164 (0.0006) [2023-12-27 20:48:37,646][106225] Updated weights for policy 1, policy_version 220275 (0.0008) [2023-12-27 20:48:37,695][106225] Updated weights for policy 1, policy_version 220285 (0.0008) [2023-12-27 20:48:38,223][106226] Updated weights for policy 0, policy_version 220174 (0.0006) [2023-12-27 20:48:38,288][106226] Updated weights for policy 0, policy_version 220184 (0.0005) [2023-12-27 20:48:38,350][106226] Updated weights for policy 0, policy_version 220194 (0.0007) [2023-12-27 20:48:38,558][106225] Updated weights for policy 1, policy_version 220295 (0.0009) [2023-12-27 20:48:38,614][106225] Updated weights for policy 1, policy_version 220305 (0.0008) [2023-12-27 20:48:38,675][106225] Updated weights for policy 1, policy_version 220315 (0.0008) [2023-12-27 20:48:39,024][106226] Updated weights for policy 0, policy_version 220204 (0.0008) [2023-12-27 20:48:39,083][106226] Updated weights for policy 0, policy_version 220214 (0.0008) [2023-12-27 20:48:39,138][106226] Updated weights for policy 0, policy_version 220224 (0.0006) [2023-12-27 20:48:39,432][106225] Updated weights for policy 1, policy_version 220325 (0.0009) [2023-12-27 20:48:39,494][106225] Updated weights for policy 1, policy_version 220335 (0.0006) [2023-12-27 20:48:39,548][106225] Updated weights for policy 1, policy_version 220345 (0.0009) [2023-12-27 20:48:39,797][106226] Updated weights for policy 0, policy_version 220234 (0.0006) [2023-12-27 20:48:39,864][106226] Updated weights for policy 0, policy_version 220244 (0.0009) [2023-12-27 20:48:39,921][106226] Updated weights for policy 0, policy_version 220254 (0.0007) [2023-12-27 20:48:39,992][106226] Updated weights for policy 0, policy_version 220264 (0.0008) [2023-12-27 20:48:40,321][106225] Updated weights for policy 1, policy_version 220355 (0.0009) [2023-12-27 20:48:40,383][106225] Updated weights for policy 1, policy_version 220365 (0.0008) [2023-12-27 20:48:40,452][106225] Updated weights for policy 1, policy_version 220375 (0.0008) [2023-12-27 20:48:40,757][106226] Updated weights for policy 0, policy_version 220274 (0.0008) [2023-12-27 20:48:40,818][106226] Updated weights for policy 0, policy_version 220284 (0.0006) [2023-12-27 20:48:40,875][106226] Updated weights for policy 0, policy_version 220294 (0.0009) [2023-12-27 20:48:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 112836608. Throughput: 0: 10021.2, 1: 9899.1. Samples: 112809268. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:48:41,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.562')] [2023-12-27 20:48:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000220296_56410112.pth... [2023-12-27 20:48:41,182][106225] Updated weights for policy 1, policy_version 220385 (0.0008) [2023-12-27 20:48:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000219112_56107008.pth [2023-12-27 20:48:41,234][106225] Updated weights for policy 1, policy_version 220395 (0.0008) [2023-12-27 20:48:41,298][106225] Updated weights for policy 1, policy_version 220405 (0.0008) [2023-12-27 20:48:41,347][106225] Updated weights for policy 1, policy_version 220415 (0.0008) [2023-12-27 20:48:41,350][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000220416_56434688.pth... [2023-12-27 20:48:41,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000219264_56139776.pth [2023-12-27 20:48:41,642][106226] Updated weights for policy 0, policy_version 220304 (0.0009) [2023-12-27 20:48:41,724][106226] Updated weights for policy 0, policy_version 220314 (0.0009) [2023-12-27 20:48:41,787][106226] Updated weights for policy 0, policy_version 220324 (0.0008) [2023-12-27 20:48:42,158][106225] Updated weights for policy 1, policy_version 220425 (0.0007) [2023-12-27 20:48:42,215][106225] Updated weights for policy 1, policy_version 220435 (0.0005) [2023-12-27 20:48:42,273][106225] Updated weights for policy 1, policy_version 220445 (0.0008) [2023-12-27 20:48:42,567][106226] Updated weights for policy 0, policy_version 220334 (0.0008) [2023-12-27 20:48:42,622][106226] Updated weights for policy 0, policy_version 220344 (0.0011) [2023-12-27 20:48:42,679][106226] Updated weights for policy 0, policy_version 220354 (0.0006) [2023-12-27 20:48:43,028][106225] Updated weights for policy 1, policy_version 220455 (0.0008) [2023-12-27 20:48:43,089][106225] Updated weights for policy 1, policy_version 220465 (0.0008) [2023-12-27 20:48:43,149][106225] Updated weights for policy 1, policy_version 220475 (0.0008) [2023-12-27 20:48:43,377][106226] Updated weights for policy 0, policy_version 220364 (0.0008) [2023-12-27 20:48:43,426][106226] Updated weights for policy 0, policy_version 220374 (0.0005) [2023-12-27 20:48:43,484][106226] Updated weights for policy 0, policy_version 220384 (0.0006) [2023-12-27 20:48:43,872][106225] Updated weights for policy 1, policy_version 220485 (0.0006) [2023-12-27 20:48:43,938][106225] Updated weights for policy 1, policy_version 220495 (0.0005) [2023-12-27 20:48:44,002][106225] Updated weights for policy 1, policy_version 220505 (0.0006) [2023-12-27 20:48:44,143][106226] Updated weights for policy 0, policy_version 220394 (0.0008) [2023-12-27 20:48:44,196][106226] Updated weights for policy 0, policy_version 220404 (0.0005) [2023-12-27 20:48:44,258][106226] Updated weights for policy 0, policy_version 220414 (0.0007) [2023-12-27 20:48:44,314][106226] Updated weights for policy 0, policy_version 220424 (0.0005) [2023-12-27 20:48:44,706][106225] Updated weights for policy 1, policy_version 220515 (0.0008) [2023-12-27 20:48:44,771][106225] Updated weights for policy 1, policy_version 220525 (0.0008) [2023-12-27 20:48:44,835][106225] Updated weights for policy 1, policy_version 220535 (0.0007) [2023-12-27 20:48:44,971][106226] Updated weights for policy 0, policy_version 220434 (0.0009) [2023-12-27 20:48:45,033][106226] Updated weights for policy 0, policy_version 220444 (0.0008) [2023-12-27 20:48:45,098][106226] Updated weights for policy 0, policy_version 220454 (0.0007) [2023-12-27 20:48:45,452][106225] Updated weights for policy 1, policy_version 220545 (0.0007) [2023-12-27 20:48:45,511][106225] Updated weights for policy 1, policy_version 220555 (0.0008) [2023-12-27 20:48:45,572][106225] Updated weights for policy 1, policy_version 220565 (0.0008) [2023-12-27 20:48:45,640][106225] Updated weights for policy 1, policy_version 220575 (0.0010) [2023-12-27 20:48:45,722][106226] Updated weights for policy 0, policy_version 220464 (0.0006) [2023-12-27 20:48:45,769][106226] Updated weights for policy 0, policy_version 220474 (0.0005) [2023-12-27 20:48:45,816][106226] Updated weights for policy 0, policy_version 220484 (0.0005) [2023-12-27 20:48:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 112934912. Throughput: 0: 10041.3, 1: 9775.1. Samples: 112922960. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:48:46,175][105115] Avg episode reward: [(0, '-4.984'), (1, '-5.673')] [2023-12-27 20:48:46,421][106226] Updated weights for policy 0, policy_version 220494 (0.0007) [2023-12-27 20:48:46,437][106225] Updated weights for policy 1, policy_version 220585 (0.0010) [2023-12-27 20:48:46,478][106226] Updated weights for policy 0, policy_version 220504 (0.0006) [2023-12-27 20:48:46,491][106225] Updated weights for policy 1, policy_version 220595 (0.0010) [2023-12-27 20:48:46,527][106226] Updated weights for policy 0, policy_version 220514 (0.0007) [2023-12-27 20:48:46,554][106225] Updated weights for policy 1, policy_version 220605 (0.0011) [2023-12-27 20:48:47,265][106226] Updated weights for policy 0, policy_version 220524 (0.0006) [2023-12-27 20:48:47,281][106225] Updated weights for policy 1, policy_version 220615 (0.0010) [2023-12-27 20:48:47,311][106226] Updated weights for policy 0, policy_version 220534 (0.0006) [2023-12-27 20:48:47,325][106225] Updated weights for policy 1, policy_version 220625 (0.0010) [2023-12-27 20:48:47,358][106226] Updated weights for policy 0, policy_version 220544 (0.0005) [2023-12-27 20:48:47,378][106225] Updated weights for policy 1, policy_version 220635 (0.0010) [2023-12-27 20:48:48,115][106226] Updated weights for policy 0, policy_version 220554 (0.0006) [2023-12-27 20:48:48,121][106225] Updated weights for policy 1, policy_version 220645 (0.0010) [2023-12-27 20:48:48,168][106226] Updated weights for policy 0, policy_version 220564 (0.0007) [2023-12-27 20:48:48,182][106225] Updated weights for policy 1, policy_version 220655 (0.0010) [2023-12-27 20:48:48,229][106226] Updated weights for policy 0, policy_version 220574 (0.0006) [2023-12-27 20:48:48,238][106225] Updated weights for policy 1, policy_version 220665 (0.0010) [2023-12-27 20:48:48,280][106226] Updated weights for policy 0, policy_version 220584 (0.0006) [2023-12-27 20:48:49,002][106225] Updated weights for policy 1, policy_version 220675 (0.0010) [2023-12-27 20:48:49,063][106226] Updated weights for policy 0, policy_version 220594 (0.0011) [2023-12-27 20:48:49,063][106225] Updated weights for policy 1, policy_version 220685 (0.0010) [2023-12-27 20:48:49,121][106225] Updated weights for policy 1, policy_version 220695 (0.0010) [2023-12-27 20:48:49,127][106226] Updated weights for policy 0, policy_version 220604 (0.0010) [2023-12-27 20:48:49,186][106226] Updated weights for policy 0, policy_version 220614 (0.0010) [2023-12-27 20:48:49,876][106226] Updated weights for policy 0, policy_version 220624 (0.0010) [2023-12-27 20:48:49,894][106225] Updated weights for policy 1, policy_version 220705 (0.0010) [2023-12-27 20:48:49,942][106226] Updated weights for policy 0, policy_version 220634 (0.0010) [2023-12-27 20:48:49,961][106225] Updated weights for policy 1, policy_version 220715 (0.0009) [2023-12-27 20:48:49,995][106226] Updated weights for policy 0, policy_version 220645 (0.0010) [2023-12-27 20:48:50,016][106225] Updated weights for policy 1, policy_version 220725 (0.0007) [2023-12-27 20:48:50,070][106225] Updated weights for policy 1, policy_version 220735 (0.0008) [2023-12-27 20:48:50,776][106226] Updated weights for policy 0, policy_version 220655 (0.0009) [2023-12-27 20:48:50,821][106225] Updated weights for policy 1, policy_version 220745 (0.0008) [2023-12-27 20:48:50,841][106226] Updated weights for policy 0, policy_version 220665 (0.0008) [2023-12-27 20:48:50,868][106225] Updated weights for policy 1, policy_version 220755 (0.0008) [2023-12-27 20:48:50,906][106226] Updated weights for policy 0, policy_version 220675 (0.0008) [2023-12-27 20:48:50,924][106225] Updated weights for policy 1, policy_version 220765 (0.0007) [2023-12-27 20:48:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 113033216. Throughput: 0: 10029.1, 1: 9732.3. Samples: 113039120. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:48:51,175][105115] Avg episode reward: [(0, '-5.136'), (1, '-5.764')] [2023-12-27 20:48:51,644][106225] Updated weights for policy 1, policy_version 220775 (0.0007) [2023-12-27 20:48:51,699][106226] Updated weights for policy 0, policy_version 220685 (0.0008) [2023-12-27 20:48:51,714][106225] Updated weights for policy 1, policy_version 220785 (0.0006) [2023-12-27 20:48:51,766][106226] Updated weights for policy 0, policy_version 220695 (0.0008) [2023-12-27 20:48:51,782][106225] Updated weights for policy 1, policy_version 220795 (0.0008) [2023-12-27 20:48:51,826][106226] Updated weights for policy 0, policy_version 220705 (0.0006) [2023-12-27 20:48:52,392][106225] Updated weights for policy 1, policy_version 220805 (0.0007) [2023-12-27 20:48:52,447][106225] Updated weights for policy 1, policy_version 220815 (0.0006) [2023-12-27 20:48:52,515][106225] Updated weights for policy 1, policy_version 220825 (0.0006) [2023-12-27 20:48:52,618][106226] Updated weights for policy 0, policy_version 220715 (0.0008) [2023-12-27 20:48:52,673][106226] Updated weights for policy 0, policy_version 220725 (0.0011) [2023-12-27 20:48:52,723][106226] Updated weights for policy 0, policy_version 220735 (0.0010) [2023-12-27 20:48:53,172][106225] Updated weights for policy 1, policy_version 220835 (0.0006) [2023-12-27 20:48:53,224][106225] Updated weights for policy 1, policy_version 220845 (0.0007) [2023-12-27 20:48:53,273][106225] Updated weights for policy 1, policy_version 220855 (0.0007) [2023-12-27 20:48:53,427][106226] Updated weights for policy 0, policy_version 220745 (0.0010) [2023-12-27 20:48:53,487][106226] Updated weights for policy 0, policy_version 220755 (0.0005) [2023-12-27 20:48:53,545][106226] Updated weights for policy 0, policy_version 220765 (0.0005) [2023-12-27 20:48:53,603][106226] Updated weights for policy 0, policy_version 220775 (0.0005) [2023-12-27 20:48:53,956][106225] Updated weights for policy 1, policy_version 220865 (0.0009) [2023-12-27 20:48:54,019][106225] Updated weights for policy 1, policy_version 220875 (0.0010) [2023-12-27 20:48:54,079][106225] Updated weights for policy 1, policy_version 220885 (0.0008) [2023-12-27 20:48:54,145][106225] Updated weights for policy 1, policy_version 220895 (0.0008) [2023-12-27 20:48:54,161][106226] Updated weights for policy 0, policy_version 220785 (0.0005) [2023-12-27 20:48:54,218][106226] Updated weights for policy 0, policy_version 220795 (0.0008) [2023-12-27 20:48:54,282][106226] Updated weights for policy 0, policy_version 220805 (0.0010) [2023-12-27 20:48:54,817][106225] Updated weights for policy 1, policy_version 220905 (0.0009) [2023-12-27 20:48:54,871][106225] Updated weights for policy 1, policy_version 220915 (0.0008) [2023-12-27 20:48:54,929][106225] Updated weights for policy 1, policy_version 220925 (0.0009) [2023-12-27 20:48:54,953][106226] Updated weights for policy 0, policy_version 220815 (0.0007) [2023-12-27 20:48:55,017][106226] Updated weights for policy 0, policy_version 220825 (0.0007) [2023-12-27 20:48:55,085][106226] Updated weights for policy 0, policy_version 220835 (0.0008) [2023-12-27 20:48:55,658][106226] Updated weights for policy 0, policy_version 220845 (0.0010) [2023-12-27 20:48:55,672][106225] Updated weights for policy 1, policy_version 220935 (0.0006) [2023-12-27 20:48:55,714][106226] Updated weights for policy 0, policy_version 220855 (0.0007) [2023-12-27 20:48:55,731][106225] Updated weights for policy 1, policy_version 220945 (0.0009) [2023-12-27 20:48:55,775][106226] Updated weights for policy 0, policy_version 220865 (0.0008) [2023-12-27 20:48:55,794][106225] Updated weights for policy 1, policy_version 220955 (0.0009) [2023-12-27 20:48:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 113131520. Throughput: 0: 9986.7, 1: 9704.5. Samples: 113098708. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:48:56,175][105115] Avg episode reward: [(0, '-5.393'), (1, '-5.583')] [2023-12-27 20:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000220960_56573952.pth... [2023-12-27 20:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000220872_56557568.pth... [2023-12-27 20:48:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000219688_56254464.pth [2023-12-27 20:48:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000219840_56287232.pth [2023-12-27 20:48:56,475][106226] Updated weights for policy 0, policy_version 220875 (0.0007) [2023-12-27 20:48:56,488][106225] Updated weights for policy 1, policy_version 220965 (0.0007) [2023-12-27 20:48:56,528][106226] Updated weights for policy 0, policy_version 220885 (0.0007) [2023-12-27 20:48:56,544][106225] Updated weights for policy 1, policy_version 220975 (0.0009) [2023-12-27 20:48:56,582][106226] Updated weights for policy 0, policy_version 220895 (0.0008) [2023-12-27 20:48:56,600][106225] Updated weights for policy 1, policy_version 220985 (0.0007) [2023-12-27 20:48:57,241][106226] Updated weights for policy 0, policy_version 220905 (0.0007) [2023-12-27 20:48:57,303][106226] Updated weights for policy 0, policy_version 220915 (0.0009) [2023-12-27 20:48:57,321][106225] Updated weights for policy 1, policy_version 220995 (0.0006) [2023-12-27 20:48:57,362][106226] Updated weights for policy 0, policy_version 220925 (0.0007) [2023-12-27 20:48:57,377][106225] Updated weights for policy 1, policy_version 221005 (0.0007) [2023-12-27 20:48:57,392][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000007 [2023-12-27 20:48:57,418][106226] Updated weights for policy 0, policy_version 220935 (0.0009) [2023-12-27 20:48:58,101][106226] Updated weights for policy 0, policy_version 220945 (0.0010) [2023-12-27 20:48:58,130][106225] Updated weights for policy 1, policy_version 221015 (0.0007) [2023-12-27 20:48:58,162][106226] Updated weights for policy 0, policy_version 220955 (0.0009) [2023-12-27 20:48:58,188][106225] Updated weights for policy 1, policy_version 221025 (0.0006) [2023-12-27 20:48:58,227][106226] Updated weights for policy 0, policy_version 220965 (0.0007) [2023-12-27 20:48:58,250][106225] Updated weights for policy 1, policy_version 221035 (0.0007) [2023-12-27 20:48:59,054][106226] Updated weights for policy 0, policy_version 220975 (0.0008) [2023-12-27 20:48:59,085][106225] Updated weights for policy 1, policy_version 221045 (0.0009) [2023-12-27 20:48:59,125][106226] Updated weights for policy 0, policy_version 220985 (0.0008) [2023-12-27 20:48:59,151][106225] Updated weights for policy 1, policy_version 221055 (0.0009) [2023-12-27 20:48:59,189][106226] Updated weights for policy 0, policy_version 220995 (0.0006) [2023-12-27 20:48:59,210][106225] Updated weights for policy 1, policy_version 221065 (0.0010) [2023-12-27 20:48:59,923][106226] Updated weights for policy 0, policy_version 221005 (0.0008) [2023-12-27 20:48:59,927][106225] Updated weights for policy 1, policy_version 221075 (0.0009) [2023-12-27 20:48:59,984][106226] Updated weights for policy 0, policy_version 221015 (0.0008) [2023-12-27 20:48:59,990][106225] Updated weights for policy 1, policy_version 221085 (0.0010) [2023-12-27 20:49:00,047][106226] Updated weights for policy 0, policy_version 221025 (0.0008) [2023-12-27 20:49:00,051][106225] Updated weights for policy 1, policy_version 221095 (0.0010) [2023-12-27 20:49:00,711][106225] Updated weights for policy 1, policy_version 221105 (0.0010) [2023-12-27 20:49:00,764][106225] Updated weights for policy 1, policy_version 221115 (0.0005) [2023-12-27 20:49:00,801][106226] Updated weights for policy 0, policy_version 221035 (0.0006) [2023-12-27 20:49:00,817][106225] Updated weights for policy 1, policy_version 221125 (0.0005) [2023-12-27 20:49:00,862][106226] Updated weights for policy 0, policy_version 221045 (0.0005) [2023-12-27 20:49:00,865][106225] Updated weights for policy 1, policy_version 221135 (0.0005) [2023-12-27 20:49:00,929][106226] Updated weights for policy 0, policy_version 221055 (0.0005) [2023-12-27 20:49:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 113229824. Throughput: 0: 9979.3, 1: 9726.7. Samples: 113216748. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:01,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-5.582')] [2023-12-27 20:49:01,495][106225] Updated weights for policy 1, policy_version 221145 (0.0005) [2023-12-27 20:49:01,547][106225] Updated weights for policy 1, policy_version 221155 (0.0005) [2023-12-27 20:49:01,595][106225] Updated weights for policy 1, policy_version 221165 (0.0006) [2023-12-27 20:49:01,603][106226] Updated weights for policy 0, policy_version 221065 (0.0007) [2023-12-27 20:49:01,671][106226] Updated weights for policy 0, policy_version 221075 (0.0009) [2023-12-27 20:49:01,735][106226] Updated weights for policy 0, policy_version 221085 (0.0009) [2023-12-27 20:49:01,798][106226] Updated weights for policy 0, policy_version 221095 (0.0008) [2023-12-27 20:49:02,216][106225] Updated weights for policy 1, policy_version 221175 (0.0009) [2023-12-27 20:49:02,291][106225] Updated weights for policy 1, policy_version 221185 (0.0007) [2023-12-27 20:49:02,364][106225] Updated weights for policy 1, policy_version 221195 (0.0007) [2023-12-27 20:49:02,537][106226] Updated weights for policy 0, policy_version 221105 (0.0008) [2023-12-27 20:49:02,591][106226] Updated weights for policy 0, policy_version 221115 (0.0007) [2023-12-27 20:49:02,646][106226] Updated weights for policy 0, policy_version 221125 (0.0008) [2023-12-27 20:49:03,026][106225] Updated weights for policy 1, policy_version 221205 (0.0009) [2023-12-27 20:49:03,088][106225] Updated weights for policy 1, policy_version 221215 (0.0010) [2023-12-27 20:49:03,137][106225] Updated weights for policy 1, policy_version 221225 (0.0008) [2023-12-27 20:49:03,352][106226] Updated weights for policy 0, policy_version 221135 (0.0007) [2023-12-27 20:49:03,399][106226] Updated weights for policy 0, policy_version 221145 (0.0008) [2023-12-27 20:49:03,451][106226] Updated weights for policy 0, policy_version 221155 (0.0008) [2023-12-27 20:49:03,857][106225] Updated weights for policy 1, policy_version 221235 (0.0010) [2023-12-27 20:49:03,922][106225] Updated weights for policy 1, policy_version 221245 (0.0010) [2023-12-27 20:49:03,986][106225] Updated weights for policy 1, policy_version 221255 (0.0010) [2023-12-27 20:49:04,175][106226] Updated weights for policy 0, policy_version 221165 (0.0010) [2023-12-27 20:49:04,240][106226] Updated weights for policy 0, policy_version 221175 (0.0007) [2023-12-27 20:49:04,302][106226] Updated weights for policy 0, policy_version 221185 (0.0008) [2023-12-27 20:49:04,691][106225] Updated weights for policy 1, policy_version 221265 (0.0010) [2023-12-27 20:49:04,744][106225] Updated weights for policy 1, policy_version 221275 (0.0010) [2023-12-27 20:49:04,794][106225] Updated weights for policy 1, policy_version 221285 (0.0010) [2023-12-27 20:49:04,838][106225] Updated weights for policy 1, policy_version 221295 (0.0010) [2023-12-27 20:49:04,913][106226] Updated weights for policy 0, policy_version 221195 (0.0008) [2023-12-27 20:49:04,958][106226] Updated weights for policy 0, policy_version 221205 (0.0005) [2023-12-27 20:49:05,007][106226] Updated weights for policy 0, policy_version 221215 (0.0005) [2023-12-27 20:49:05,562][106225] Updated weights for policy 1, policy_version 221305 (0.0010) [2023-12-27 20:49:05,605][106226] Updated weights for policy 0, policy_version 221225 (0.0006) [2023-12-27 20:49:05,616][106225] Updated weights for policy 1, policy_version 221315 (0.0010) [2023-12-27 20:49:05,666][106226] Updated weights for policy 0, policy_version 221235 (0.0011) [2023-12-27 20:49:05,670][106225] Updated weights for policy 1, policy_version 221325 (0.0010) [2023-12-27 20:49:05,726][106226] Updated weights for policy 0, policy_version 221245 (0.0010) [2023-12-27 20:49:05,782][106226] Updated weights for policy 0, policy_version 221255 (0.0010) [2023-12-27 20:49:06,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 113328128. Throughput: 0: 10066.0, 1: 9776.1. Samples: 113339096. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:06,176][105115] Avg episode reward: [(0, '-4.890'), (1, '-5.858')] [2023-12-27 20:49:06,395][106225] Updated weights for policy 1, policy_version 221335 (0.0010) [2023-12-27 20:49:06,449][106226] Updated weights for policy 0, policy_version 221265 (0.0011) [2023-12-27 20:49:06,454][106225] Updated weights for policy 1, policy_version 221345 (0.0011) [2023-12-27 20:49:06,509][106225] Updated weights for policy 1, policy_version 221355 (0.0010) [2023-12-27 20:49:06,511][106226] Updated weights for policy 0, policy_version 221275 (0.0011) [2023-12-27 20:49:06,573][106226] Updated weights for policy 0, policy_version 221285 (0.0011) [2023-12-27 20:49:07,207][106226] Updated weights for policy 0, policy_version 221295 (0.0006) [2023-12-27 20:49:07,238][106225] Updated weights for policy 1, policy_version 221365 (0.0010) [2023-12-27 20:49:07,271][106226] Updated weights for policy 0, policy_version 221305 (0.0011) [2023-12-27 20:49:07,290][106225] Updated weights for policy 1, policy_version 221375 (0.0010) [2023-12-27 20:49:07,329][106226] Updated weights for policy 0, policy_version 221315 (0.0011) [2023-12-27 20:49:07,352][106225] Updated weights for policy 1, policy_version 221385 (0.0010) [2023-12-27 20:49:07,993][106226] Updated weights for policy 0, policy_version 221325 (0.0010) [2023-12-27 20:49:08,040][106225] Updated weights for policy 1, policy_version 221395 (0.0010) [2023-12-27 20:49:08,052][106226] Updated weights for policy 0, policy_version 221335 (0.0010) [2023-12-27 20:49:08,097][106225] Updated weights for policy 1, policy_version 221405 (0.0010) [2023-12-27 20:49:08,109][106226] Updated weights for policy 0, policy_version 221345 (0.0010) [2023-12-27 20:49:08,160][106225] Updated weights for policy 1, policy_version 221415 (0.0010) [2023-12-27 20:49:08,823][106226] Updated weights for policy 0, policy_version 221355 (0.0011) [2023-12-27 20:49:08,883][106225] Updated weights for policy 1, policy_version 221425 (0.0010) [2023-12-27 20:49:08,887][106226] Updated weights for policy 0, policy_version 221365 (0.0011) [2023-12-27 20:49:08,938][106225] Updated weights for policy 1, policy_version 221435 (0.0010) [2023-12-27 20:49:08,951][106226] Updated weights for policy 0, policy_version 221375 (0.0010) [2023-12-27 20:49:08,996][106225] Updated weights for policy 1, policy_version 221445 (0.0011) [2023-12-27 20:49:09,050][106225] Updated weights for policy 1, policy_version 221455 (0.0010) [2023-12-27 20:49:09,685][106226] Updated weights for policy 0, policy_version 221385 (0.0011) [2023-12-27 20:49:09,744][106226] Updated weights for policy 0, policy_version 221395 (0.0011) [2023-12-27 20:49:09,775][106225] Updated weights for policy 1, policy_version 221465 (0.0010) [2023-12-27 20:49:09,802][106226] Updated weights for policy 0, policy_version 221405 (0.0011) [2023-12-27 20:49:09,842][106225] Updated weights for policy 1, policy_version 221475 (0.0010) [2023-12-27 20:49:09,877][106226] Updated weights for policy 0, policy_version 221415 (0.0015) [2023-12-27 20:49:09,906][106225] Updated weights for policy 1, policy_version 221485 (0.0010) [2023-12-27 20:49:10,585][106226] Updated weights for policy 0, policy_version 221425 (0.0008) [2023-12-27 20:49:10,634][106226] Updated weights for policy 0, policy_version 221435 (0.0007) [2023-12-27 20:49:10,654][106225] Updated weights for policy 1, policy_version 221495 (0.0010) [2023-12-27 20:49:10,687][106226] Updated weights for policy 0, policy_version 221445 (0.0008) [2023-12-27 20:49:10,711][106225] Updated weights for policy 1, policy_version 221505 (0.0010) [2023-12-27 20:49:10,766][106225] Updated weights for policy 1, policy_version 221515 (0.0010) [2023-12-27 20:49:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 113426432. Throughput: 0: 10063.3, 1: 9788.7. Samples: 113398400. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:11,175][105115] Avg episode reward: [(0, '-4.985'), (1, '-6.026')] [2023-12-27 20:49:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000221520_56721408.pth... [2023-12-27 20:49:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000221448_56705024.pth... [2023-12-27 20:49:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000220416_56434688.pth [2023-12-27 20:49:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000220296_56410112.pth [2023-12-27 20:49:11,498][106226] Updated weights for policy 0, policy_version 221455 (0.0009) [2023-12-27 20:49:11,535][106225] Updated weights for policy 1, policy_version 221525 (0.0009) [2023-12-27 20:49:11,560][106226] Updated weights for policy 0, policy_version 221465 (0.0008) [2023-12-27 20:49:11,597][106225] Updated weights for policy 1, policy_version 221535 (0.0008) [2023-12-27 20:49:11,630][106226] Updated weights for policy 0, policy_version 221475 (0.0008) [2023-12-27 20:49:11,672][106225] Updated weights for policy 1, policy_version 221545 (0.0007) [2023-12-27 20:49:12,304][106226] Updated weights for policy 0, policy_version 221485 (0.0009) [2023-12-27 20:49:12,372][106226] Updated weights for policy 0, policy_version 221495 (0.0010) [2023-12-27 20:49:12,425][106225] Updated weights for policy 1, policy_version 221555 (0.0007) [2023-12-27 20:49:12,433][106226] Updated weights for policy 0, policy_version 221505 (0.0011) [2023-12-27 20:49:12,495][106225] Updated weights for policy 1, policy_version 221565 (0.0006) [2023-12-27 20:49:12,553][106225] Updated weights for policy 1, policy_version 221575 (0.0007) [2023-12-27 20:49:13,118][106225] Updated weights for policy 1, policy_version 221585 (0.0008) [2023-12-27 20:49:13,125][106226] Updated weights for policy 0, policy_version 221515 (0.0011) [2023-12-27 20:49:13,172][106225] Updated weights for policy 1, policy_version 221595 (0.0005) [2023-12-27 20:49:13,185][106226] Updated weights for policy 0, policy_version 221525 (0.0010) [2023-12-27 20:49:13,227][106225] Updated weights for policy 1, policy_version 221605 (0.0007) [2023-12-27 20:49:13,239][106226] Updated weights for policy 0, policy_version 221535 (0.0010) [2023-12-27 20:49:13,280][106225] Updated weights for policy 1, policy_version 221615 (0.0007) [2023-12-27 20:49:13,855][106225] Updated weights for policy 1, policy_version 221625 (0.0005) [2023-12-27 20:49:13,918][106225] Updated weights for policy 1, policy_version 221635 (0.0005) [2023-12-27 20:49:13,960][106226] Updated weights for policy 0, policy_version 221545 (0.0010) [2023-12-27 20:49:13,968][106225] Updated weights for policy 1, policy_version 221645 (0.0006) [2023-12-27 20:49:14,016][106226] Updated weights for policy 0, policy_version 221555 (0.0010) [2023-12-27 20:49:14,066][106226] Updated weights for policy 0, policy_version 221565 (0.0010) [2023-12-27 20:49:14,115][106226] Updated weights for policy 0, policy_version 221575 (0.0010) [2023-12-27 20:49:14,579][106225] Updated weights for policy 1, policy_version 221655 (0.0008) [2023-12-27 20:49:14,637][106225] Updated weights for policy 1, policy_version 221665 (0.0008) [2023-12-27 20:49:14,694][106225] Updated weights for policy 1, policy_version 221675 (0.0008) [2023-12-27 20:49:14,865][106226] Updated weights for policy 0, policy_version 221585 (0.0011) [2023-12-27 20:49:14,920][106226] Updated weights for policy 0, policy_version 221595 (0.0010) [2023-12-27 20:49:14,978][106226] Updated weights for policy 0, policy_version 221605 (0.0011) [2023-12-27 20:49:15,429][106225] Updated weights for policy 1, policy_version 221685 (0.0008) [2023-12-27 20:49:15,490][106225] Updated weights for policy 1, policy_version 221695 (0.0008) [2023-12-27 20:49:15,554][106225] Updated weights for policy 1, policy_version 221705 (0.0006) [2023-12-27 20:49:15,703][106226] Updated weights for policy 0, policy_version 221615 (0.0011) [2023-12-27 20:49:15,757][106226] Updated weights for policy 0, policy_version 221625 (0.0009) [2023-12-27 20:49:15,812][106226] Updated weights for policy 0, policy_version 221635 (0.0005) [2023-12-27 20:49:16,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 113524736. Throughput: 0: 9991.0, 1: 9740.6. Samples: 113515788. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:16,175][105115] Avg episode reward: [(0, '-5.088'), (1, '-5.793')] [2023-12-27 20:49:16,268][106225] Updated weights for policy 1, policy_version 221715 (0.0007) [2023-12-27 20:49:16,328][106225] Updated weights for policy 1, policy_version 221725 (0.0007) [2023-12-27 20:49:16,377][106225] Updated weights for policy 1, policy_version 221735 (0.0008) [2023-12-27 20:49:16,444][106226] Updated weights for policy 0, policy_version 221645 (0.0008) [2023-12-27 20:49:16,501][106226] Updated weights for policy 0, policy_version 221655 (0.0010) [2023-12-27 20:49:16,562][106226] Updated weights for policy 0, policy_version 221665 (0.0010) [2023-12-27 20:49:17,119][106225] Updated weights for policy 1, policy_version 221745 (0.0008) [2023-12-27 20:49:17,169][106226] Updated weights for policy 0, policy_version 221675 (0.0009) [2023-12-27 20:49:17,175][106225] Updated weights for policy 1, policy_version 221755 (0.0010) [2023-12-27 20:49:17,229][106225] Updated weights for policy 1, policy_version 221765 (0.0010) [2023-12-27 20:49:17,232][106226] Updated weights for policy 0, policy_version 221685 (0.0005) [2023-12-27 20:49:17,285][106225] Updated weights for policy 1, policy_version 221775 (0.0010) [2023-12-27 20:49:17,301][106226] Updated weights for policy 0, policy_version 221695 (0.0005) [2023-12-27 20:49:17,805][106226] Updated weights for policy 0, policy_version 221705 (0.0005) [2023-12-27 20:49:17,863][106226] Updated weights for policy 0, policy_version 221715 (0.0005) [2023-12-27 20:49:17,917][106226] Updated weights for policy 0, policy_version 221725 (0.0005) [2023-12-27 20:49:17,973][106226] Updated weights for policy 0, policy_version 221735 (0.0010) [2023-12-27 20:49:17,978][106225] Updated weights for policy 1, policy_version 221785 (0.0006) [2023-12-27 20:49:18,027][106225] Updated weights for policy 1, policy_version 221795 (0.0005) [2023-12-27 20:49:18,076][106225] Updated weights for policy 1, policy_version 221805 (0.0010) [2023-12-27 20:49:18,628][106226] Updated weights for policy 0, policy_version 221745 (0.0007) [2023-12-27 20:49:18,678][106226] Updated weights for policy 0, policy_version 221755 (0.0011) [2023-12-27 20:49:18,736][106226] Updated weights for policy 0, policy_version 221765 (0.0011) [2023-12-27 20:49:18,798][106225] Updated weights for policy 1, policy_version 221815 (0.0010) [2023-12-27 20:49:18,862][106225] Updated weights for policy 1, policy_version 221825 (0.0010) [2023-12-27 20:49:18,926][106225] Updated weights for policy 1, policy_version 221835 (0.0010) [2023-12-27 20:49:19,486][106226] Updated weights for policy 0, policy_version 221775 (0.0010) [2023-12-27 20:49:19,542][106226] Updated weights for policy 0, policy_version 221785 (0.0006) [2023-12-27 20:49:19,580][106225] Updated weights for policy 1, policy_version 221845 (0.0007) [2023-12-27 20:49:19,602][106226] Updated weights for policy 0, policy_version 221795 (0.0012) [2023-12-27 20:49:19,636][106225] Updated weights for policy 1, policy_version 221855 (0.0006) [2023-12-27 20:49:19,696][106225] Updated weights for policy 1, policy_version 221865 (0.0006) [2023-12-27 20:49:20,352][106226] Updated weights for policy 0, policy_version 221805 (0.0011) [2023-12-27 20:49:20,404][106225] Updated weights for policy 1, policy_version 221875 (0.0008) [2023-12-27 20:49:20,418][106226] Updated weights for policy 0, policy_version 221815 (0.0011) [2023-12-27 20:49:20,460][106225] Updated weights for policy 1, policy_version 221885 (0.0006) [2023-12-27 20:49:20,480][106226] Updated weights for policy 0, policy_version 221825 (0.0011) [2023-12-27 20:49:20,521][106225] Updated weights for policy 1, policy_version 221895 (0.0006) [2023-12-27 20:49:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 113623040. Throughput: 0: 9951.6, 1: 9754.9. Samples: 113636472. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:21,175][105115] Avg episode reward: [(0, '-5.039'), (1, '-5.552')] [2023-12-27 20:49:21,217][106226] Updated weights for policy 0, policy_version 221835 (0.0010) [2023-12-27 20:49:21,283][106226] Updated weights for policy 0, policy_version 221845 (0.0010) [2023-12-27 20:49:21,301][106225] Updated weights for policy 1, policy_version 221905 (0.0009) [2023-12-27 20:49:21,356][106226] Updated weights for policy 0, policy_version 221855 (0.0007) [2023-12-27 20:49:21,370][106225] Updated weights for policy 1, policy_version 221915 (0.0007) [2023-12-27 20:49:21,436][106225] Updated weights for policy 1, policy_version 221925 (0.0009) [2023-12-27 20:49:21,499][106225] Updated weights for policy 1, policy_version 221935 (0.0008) [2023-12-27 20:49:22,111][106226] Updated weights for policy 0, policy_version 221865 (0.0009) [2023-12-27 20:49:22,168][106226] Updated weights for policy 0, policy_version 221875 (0.0007) [2023-12-27 20:49:22,214][106226] Updated weights for policy 0, policy_version 221885 (0.0007) [2023-12-27 20:49:22,265][106225] Updated weights for policy 1, policy_version 221945 (0.0010) [2023-12-27 20:49:22,266][106226] Updated weights for policy 0, policy_version 221895 (0.0006) [2023-12-27 20:49:22,317][106225] Updated weights for policy 1, policy_version 221955 (0.0010) [2023-12-27 20:49:22,379][106225] Updated weights for policy 1, policy_version 221965 (0.0011) [2023-12-27 20:49:23,037][106226] Updated weights for policy 0, policy_version 221905 (0.0008) [2023-12-27 20:49:23,099][106226] Updated weights for policy 0, policy_version 221915 (0.0008) [2023-12-27 20:49:23,149][106225] Updated weights for policy 1, policy_version 221975 (0.0007) [2023-12-27 20:49:23,154][106226] Updated weights for policy 0, policy_version 221925 (0.0006) [2023-12-27 20:49:23,205][106225] Updated weights for policy 1, policy_version 221985 (0.0009) [2023-12-27 20:49:23,263][106225] Updated weights for policy 1, policy_version 221995 (0.0009) [2023-12-27 20:49:23,856][106226] Updated weights for policy 0, policy_version 221935 (0.0008) [2023-12-27 20:49:23,905][106226] Updated weights for policy 0, policy_version 221945 (0.0008) [2023-12-27 20:49:23,957][106226] Updated weights for policy 0, policy_version 221955 (0.0009) [2023-12-27 20:49:23,958][106225] Updated weights for policy 1, policy_version 222005 (0.0007) [2023-12-27 20:49:24,015][106225] Updated weights for policy 1, policy_version 222015 (0.0007) [2023-12-27 20:49:24,074][106225] Updated weights for policy 1, policy_version 222025 (0.0009) [2023-12-27 20:49:24,679][106225] Updated weights for policy 1, policy_version 222035 (0.0007) [2023-12-27 20:49:24,729][106226] Updated weights for policy 0, policy_version 221965 (0.0006) [2023-12-27 20:49:24,735][106225] Updated weights for policy 1, policy_version 222045 (0.0005) [2023-12-27 20:49:24,780][106225] Updated weights for policy 1, policy_version 222055 (0.0006) [2023-12-27 20:49:24,781][106226] Updated weights for policy 0, policy_version 221975 (0.0007) [2023-12-27 20:49:24,836][106226] Updated weights for policy 0, policy_version 221985 (0.0008) [2023-12-27 20:49:25,455][106225] Updated weights for policy 1, policy_version 222065 (0.0006) [2023-12-27 20:49:25,514][106225] Updated weights for policy 1, policy_version 222075 (0.0009) [2023-12-27 20:49:25,570][106225] Updated weights for policy 1, policy_version 222085 (0.0006) [2023-12-27 20:49:25,576][106226] Updated weights for policy 0, policy_version 221995 (0.0008) [2023-12-27 20:49:25,628][106225] Updated weights for policy 1, policy_version 222095 (0.0007) [2023-12-27 20:49:25,634][106226] Updated weights for policy 0, policy_version 222005 (0.0007) [2023-12-27 20:49:25,690][106226] Updated weights for policy 0, policy_version 222015 (0.0007) [2023-12-27 20:49:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 113721344. Throughput: 0: 9875.5, 1: 9730.5. Samples: 113691540. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:26,176][105115] Avg episode reward: [(0, '-4.999'), (1, '-5.752')] [2023-12-27 20:49:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000222096_56868864.pth... [2023-12-27 20:49:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000222024_56852480.pth... [2023-12-27 20:49:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000220960_56573952.pth [2023-12-27 20:49:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000220872_56557568.pth [2023-12-27 20:49:26,329][106226] Updated weights for policy 0, policy_version 222025 (0.0008) [2023-12-27 20:49:26,336][106225] Updated weights for policy 1, policy_version 222105 (0.0010) [2023-12-27 20:49:26,386][106225] Updated weights for policy 1, policy_version 222115 (0.0010) [2023-12-27 20:49:26,391][106226] Updated weights for policy 0, policy_version 222035 (0.0006) [2023-12-27 20:49:26,433][106225] Updated weights for policy 1, policy_version 222125 (0.0010) [2023-12-27 20:49:26,446][106226] Updated weights for policy 0, policy_version 222045 (0.0007) [2023-12-27 20:49:26,506][106226] Updated weights for policy 0, policy_version 222055 (0.0008) [2023-12-27 20:49:27,125][106225] Updated weights for policy 1, policy_version 222135 (0.0007) [2023-12-27 20:49:27,181][106225] Updated weights for policy 1, policy_version 222145 (0.0010) [2023-12-27 20:49:27,187][106226] Updated weights for policy 0, policy_version 222065 (0.0005) [2023-12-27 20:49:27,236][106225] Updated weights for policy 1, policy_version 222155 (0.0010) [2023-12-27 20:49:27,242][106226] Updated weights for policy 0, policy_version 222075 (0.0005) [2023-12-27 20:49:27,300][106226] Updated weights for policy 0, policy_version 222085 (0.0009) [2023-12-27 20:49:27,904][106225] Updated weights for policy 1, policy_version 222165 (0.0005) [2023-12-27 20:49:27,962][106225] Updated weights for policy 1, policy_version 222175 (0.0006) [2023-12-27 20:49:28,027][106225] Updated weights for policy 1, policy_version 222185 (0.0008) [2023-12-27 20:49:28,062][106226] Updated weights for policy 0, policy_version 222095 (0.0007) [2023-12-27 20:49:28,112][106226] Updated weights for policy 0, policy_version 222105 (0.0009) [2023-12-27 20:49:28,166][106226] Updated weights for policy 0, policy_version 222116 (0.0007) [2023-12-27 20:49:28,624][106225] Updated weights for policy 1, policy_version 222195 (0.0007) [2023-12-27 20:49:28,687][106225] Updated weights for policy 1, policy_version 222205 (0.0008) [2023-12-27 20:49:28,752][106225] Updated weights for policy 1, policy_version 222215 (0.0008) [2023-12-27 20:49:28,802][106226] Updated weights for policy 0, policy_version 222126 (0.0009) [2023-12-27 20:49:28,868][106226] Updated weights for policy 0, policy_version 222136 (0.0008) [2023-12-27 20:49:28,939][106226] Updated weights for policy 0, policy_version 222146 (0.0005) [2023-12-27 20:49:29,483][106225] Updated weights for policy 1, policy_version 222225 (0.0009) [2023-12-27 20:49:29,542][106225] Updated weights for policy 1, policy_version 222235 (0.0009) [2023-12-27 20:49:29,561][106226] Updated weights for policy 0, policy_version 222156 (0.0005) [2023-12-27 20:49:29,601][106225] Updated weights for policy 1, policy_version 222245 (0.0007) [2023-12-27 20:49:29,617][106226] Updated weights for policy 0, policy_version 222166 (0.0007) [2023-12-27 20:49:29,659][106225] Updated weights for policy 1, policy_version 222255 (0.0008) [2023-12-27 20:49:29,675][106226] Updated weights for policy 0, policy_version 222176 (0.0005) [2023-12-27 20:49:30,290][106226] Updated weights for policy 0, policy_version 222186 (0.0007) [2023-12-27 20:49:30,314][106225] Updated weights for policy 1, policy_version 222265 (0.0006) [2023-12-27 20:49:30,354][106226] Updated weights for policy 0, policy_version 222196 (0.0008) [2023-12-27 20:49:30,381][106225] Updated weights for policy 1, policy_version 222275 (0.0006) [2023-12-27 20:49:30,412][106226] Updated weights for policy 0, policy_version 222206 (0.0009) [2023-12-27 20:49:30,435][106225] Updated weights for policy 1, policy_version 222285 (0.0005) [2023-12-27 20:49:30,477][106226] Updated weights for policy 0, policy_version 222216 (0.0011) [2023-12-27 20:49:31,072][106225] Updated weights for policy 1, policy_version 222295 (0.0007) [2023-12-27 20:49:31,127][106225] Updated weights for policy 1, policy_version 222305 (0.0008) [2023-12-27 20:49:31,135][106226] Updated weights for policy 0, policy_version 222226 (0.0010) [2023-12-27 20:49:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 113819648. Throughput: 0: 9949.2, 1: 9866.6. Samples: 113814668. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:31,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.761')] [2023-12-27 20:49:31,187][106225] Updated weights for policy 1, policy_version 222315 (0.0010) [2023-12-27 20:49:31,199][106226] Updated weights for policy 0, policy_version 222236 (0.0007) [2023-12-27 20:49:31,254][106226] Updated weights for policy 0, policy_version 222246 (0.0010) [2023-12-27 20:49:31,892][106225] Updated weights for policy 1, policy_version 222325 (0.0008) [2023-12-27 20:49:31,950][106225] Updated weights for policy 1, policy_version 222335 (0.0006) [2023-12-27 20:49:31,955][106226] Updated weights for policy 0, policy_version 222256 (0.0011) [2023-12-27 20:49:32,009][106225] Updated weights for policy 1, policy_version 222345 (0.0007) [2023-12-27 20:49:32,018][106226] Updated weights for policy 0, policy_version 222266 (0.0010) [2023-12-27 20:49:32,079][106226] Updated weights for policy 0, policy_version 222276 (0.0006) [2023-12-27 20:49:32,659][106225] Updated weights for policy 1, policy_version 222355 (0.0008) [2023-12-27 20:49:32,711][106225] Updated weights for policy 1, policy_version 222365 (0.0008) [2023-12-27 20:49:32,764][106225] Updated weights for policy 1, policy_version 222375 (0.0007) [2023-12-27 20:49:32,778][106226] Updated weights for policy 0, policy_version 222286 (0.0006) [2023-12-27 20:49:32,839][106226] Updated weights for policy 0, policy_version 222296 (0.0006) [2023-12-27 20:49:32,891][106226] Updated weights for policy 0, policy_version 222306 (0.0008) [2023-12-27 20:49:33,502][106225] Updated weights for policy 1, policy_version 222385 (0.0008) [2023-12-27 20:49:33,525][106226] Updated weights for policy 0, policy_version 222316 (0.0007) [2023-12-27 20:49:33,563][106225] Updated weights for policy 1, policy_version 222395 (0.0006) [2023-12-27 20:49:33,593][106226] Updated weights for policy 0, policy_version 222326 (0.0005) [2023-12-27 20:49:33,613][106225] Updated weights for policy 1, policy_version 222405 (0.0008) [2023-12-27 20:49:33,660][106225] Updated weights for policy 1, policy_version 222415 (0.0008) [2023-12-27 20:49:33,663][106226] Updated weights for policy 0, policy_version 222336 (0.0006) [2023-12-27 20:49:34,283][106225] Updated weights for policy 1, policy_version 222425 (0.0008) [2023-12-27 20:49:34,342][106225] Updated weights for policy 1, policy_version 222435 (0.0009) [2023-12-27 20:49:34,360][106226] Updated weights for policy 0, policy_version 222346 (0.0006) [2023-12-27 20:49:34,401][106225] Updated weights for policy 1, policy_version 222445 (0.0007) [2023-12-27 20:49:34,428][106226] Updated weights for policy 0, policy_version 222356 (0.0009) [2023-12-27 20:49:34,485][106226] Updated weights for policy 0, policy_version 222366 (0.0008) [2023-12-27 20:49:34,548][106226] Updated weights for policy 0, policy_version 222376 (0.0009) [2023-12-27 20:49:35,179][106226] Updated weights for policy 0, policy_version 222386 (0.0007) [2023-12-27 20:49:35,185][106225] Updated weights for policy 1, policy_version 222455 (0.0008) [2023-12-27 20:49:35,240][106226] Updated weights for policy 0, policy_version 222396 (0.0008) [2023-12-27 20:49:35,246][106225] Updated weights for policy 1, policy_version 222465 (0.0007) [2023-12-27 20:49:35,304][106225] Updated weights for policy 1, policy_version 222475 (0.0005) [2023-12-27 20:49:35,306][106226] Updated weights for policy 0, policy_version 222406 (0.0006) [2023-12-27 20:49:35,926][106225] Updated weights for policy 1, policy_version 222485 (0.0006) [2023-12-27 20:49:35,968][106226] Updated weights for policy 0, policy_version 222416 (0.0006) [2023-12-27 20:49:35,981][106225] Updated weights for policy 1, policy_version 222495 (0.0006) [2023-12-27 20:49:36,026][106226] Updated weights for policy 0, policy_version 222426 (0.0005) [2023-12-27 20:49:36,040][106225] Updated weights for policy 1, policy_version 222505 (0.0010) [2023-12-27 20:49:36,093][106226] Updated weights for policy 0, policy_version 222436 (0.0006) [2023-12-27 20:49:36,175][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 113934336. Throughput: 0: 9991.8, 1: 9970.5. Samples: 113937424. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:36,176][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.905')] [2023-12-27 20:49:36,709][106225] Updated weights for policy 1, policy_version 222515 (0.0010) [2023-12-27 20:49:36,768][106225] Updated weights for policy 1, policy_version 222525 (0.0008) [2023-12-27 20:49:36,818][106226] Updated weights for policy 0, policy_version 222446 (0.0008) [2023-12-27 20:49:36,824][106225] Updated weights for policy 1, policy_version 222535 (0.0005) [2023-12-27 20:49:36,884][106226] Updated weights for policy 0, policy_version 222456 (0.0008) [2023-12-27 20:49:36,948][106226] Updated weights for policy 0, policy_version 222466 (0.0010) [2023-12-27 20:49:37,451][106225] Updated weights for policy 1, policy_version 222545 (0.0006) [2023-12-27 20:49:37,506][106225] Updated weights for policy 1, policy_version 222555 (0.0005) [2023-12-27 20:49:37,557][106226] Updated weights for policy 0, policy_version 222476 (0.0007) [2023-12-27 20:49:37,560][106225] Updated weights for policy 1, policy_version 222565 (0.0005) [2023-12-27 20:49:37,612][106226] Updated weights for policy 0, policy_version 222486 (0.0006) [2023-12-27 20:49:37,619][106225] Updated weights for policy 1, policy_version 222575 (0.0010) [2023-12-27 20:49:37,670][106226] Updated weights for policy 0, policy_version 222496 (0.0005) [2023-12-27 20:49:38,234][106226] Updated weights for policy 0, policy_version 222506 (0.0007) [2023-12-27 20:49:38,288][106226] Updated weights for policy 0, policy_version 222516 (0.0007) [2023-12-27 20:49:38,313][106225] Updated weights for policy 1, policy_version 222585 (0.0010) [2023-12-27 20:49:38,353][106226] Updated weights for policy 0, policy_version 222526 (0.0009) [2023-12-27 20:49:38,380][106225] Updated weights for policy 1, policy_version 222595 (0.0008) [2023-12-27 20:49:38,418][106226] Updated weights for policy 0, policy_version 222536 (0.0008) [2023-12-27 20:49:38,445][106225] Updated weights for policy 1, policy_version 222605 (0.0006) [2023-12-27 20:49:39,010][106225] Updated weights for policy 1, policy_version 222615 (0.0009) [2023-12-27 20:49:39,070][106225] Updated weights for policy 1, policy_version 222625 (0.0007) [2023-12-27 20:49:39,129][106225] Updated weights for policy 1, policy_version 222635 (0.0010) [2023-12-27 20:49:39,236][106226] Updated weights for policy 0, policy_version 222546 (0.0008) [2023-12-27 20:49:39,303][106226] Updated weights for policy 0, policy_version 222556 (0.0008) [2023-12-27 20:49:39,373][106226] Updated weights for policy 0, policy_version 222566 (0.0008) [2023-12-27 20:49:39,922][106225] Updated weights for policy 1, policy_version 222645 (0.0009) [2023-12-27 20:49:39,984][106225] Updated weights for policy 1, policy_version 222655 (0.0008) [2023-12-27 20:49:40,042][106225] Updated weights for policy 1, policy_version 222665 (0.0007) [2023-12-27 20:49:40,107][106226] Updated weights for policy 0, policy_version 222576 (0.0010) [2023-12-27 20:49:40,165][106226] Updated weights for policy 0, policy_version 222586 (0.0011) [2023-12-27 20:49:40,224][106226] Updated weights for policy 0, policy_version 222596 (0.0011) [2023-12-27 20:49:40,679][106225] Updated weights for policy 1, policy_version 222675 (0.0006) [2023-12-27 20:49:40,735][106225] Updated weights for policy 1, policy_version 222685 (0.0005) [2023-12-27 20:49:40,800][106225] Updated weights for policy 1, policy_version 222695 (0.0006) [2023-12-27 20:49:40,877][106226] Updated weights for policy 0, policy_version 222606 (0.0009) [2023-12-27 20:49:40,932][106226] Updated weights for policy 0, policy_version 222616 (0.0010) [2023-12-27 20:49:40,985][106226] Updated weights for policy 0, policy_version 222626 (0.0010) [2023-12-27 20:49:41,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 114032640. Throughput: 0: 10014.4, 1: 9997.9. Samples: 113999264. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:41,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.799')] [2023-12-27 20:49:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000222704_57024512.pth... [2023-12-27 20:49:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000222632_57008128.pth... [2023-12-27 20:49:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000221520_56721408.pth [2023-12-27 20:49:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000221448_56705024.pth [2023-12-27 20:49:41,484][106225] Updated weights for policy 1, policy_version 222705 (0.0006) [2023-12-27 20:49:41,546][106225] Updated weights for policy 1, policy_version 222715 (0.0008) [2023-12-27 20:49:41,610][106225] Updated weights for policy 1, policy_version 222725 (0.0008) [2023-12-27 20:49:41,687][106225] Updated weights for policy 1, policy_version 222735 (0.0007) [2023-12-27 20:49:41,800][106226] Updated weights for policy 0, policy_version 222636 (0.0008) [2023-12-27 20:49:41,861][106226] Updated weights for policy 0, policy_version 222646 (0.0008) [2023-12-27 20:49:41,926][106226] Updated weights for policy 0, policy_version 222656 (0.0007) [2023-12-27 20:49:42,460][106225] Updated weights for policy 1, policy_version 222745 (0.0008) [2023-12-27 20:49:42,532][106225] Updated weights for policy 1, policy_version 222755 (0.0009) [2023-12-27 20:49:42,594][106225] Updated weights for policy 1, policy_version 222765 (0.0009) [2023-12-27 20:49:42,668][106226] Updated weights for policy 0, policy_version 222666 (0.0009) [2023-12-27 20:49:42,717][106226] Updated weights for policy 0, policy_version 222676 (0.0008) [2023-12-27 20:49:42,767][106226] Updated weights for policy 0, policy_version 222686 (0.0009) [2023-12-27 20:49:42,827][106226] Updated weights for policy 0, policy_version 222696 (0.0009) [2023-12-27 20:49:43,191][106225] Updated weights for policy 1, policy_version 222775 (0.0009) [2023-12-27 20:49:43,250][106225] Updated weights for policy 1, policy_version 222785 (0.0007) [2023-12-27 20:49:43,301][106225] Updated weights for policy 1, policy_version 222795 (0.0005) [2023-12-27 20:49:43,617][106226] Updated weights for policy 0, policy_version 222706 (0.0009) [2023-12-27 20:49:43,669][106226] Updated weights for policy 0, policy_version 222716 (0.0005) [2023-12-27 20:49:43,719][106226] Updated weights for policy 0, policy_version 222726 (0.0005) [2023-12-27 20:49:44,016][106225] Updated weights for policy 1, policy_version 222805 (0.0006) [2023-12-27 20:49:44,078][106225] Updated weights for policy 1, policy_version 222815 (0.0005) [2023-12-27 20:49:44,142][106225] Updated weights for policy 1, policy_version 222825 (0.0006) [2023-12-27 20:49:44,329][106226] Updated weights for policy 0, policy_version 222736 (0.0008) [2023-12-27 20:49:44,382][106226] Updated weights for policy 0, policy_version 222746 (0.0007) [2023-12-27 20:49:44,440][106226] Updated weights for policy 0, policy_version 222756 (0.0006) [2023-12-27 20:49:44,715][106225] Updated weights for policy 1, policy_version 222835 (0.0009) [2023-12-27 20:49:44,786][106225] Updated weights for policy 1, policy_version 222845 (0.0007) [2023-12-27 20:49:44,852][106225] Updated weights for policy 1, policy_version 222855 (0.0008) [2023-12-27 20:49:45,203][106226] Updated weights for policy 0, policy_version 222766 (0.0005) [2023-12-27 20:49:45,271][106226] Updated weights for policy 0, policy_version 222776 (0.0006) [2023-12-27 20:49:45,340][106226] Updated weights for policy 0, policy_version 222786 (0.0008) [2023-12-27 20:49:45,557][106225] Updated weights for policy 1, policy_version 222865 (0.0006) [2023-12-27 20:49:45,609][106225] Updated weights for policy 1, policy_version 222875 (0.0008) [2023-12-27 20:49:45,658][106225] Updated weights for policy 1, policy_version 222885 (0.0008) [2023-12-27 20:49:45,717][106225] Updated weights for policy 1, policy_version 222895 (0.0009) [2023-12-27 20:49:45,906][106226] Updated weights for policy 0, policy_version 222796 (0.0007) [2023-12-27 20:49:45,954][106226] Updated weights for policy 0, policy_version 222806 (0.0008) [2023-12-27 20:49:46,009][106226] Updated weights for policy 0, policy_version 222816 (0.0007) [2023-12-27 20:49:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 114130944. Throughput: 0: 9969.1, 1: 10058.7. Samples: 114117996. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 20:49:46,176][105115] Avg episode reward: [(0, '-5.117'), (1, '-6.094')] [2023-12-27 20:49:46,405][106225] Updated weights for policy 1, policy_version 222905 (0.0008) [2023-12-27 20:49:46,463][106225] Updated weights for policy 1, policy_version 222915 (0.0007) [2023-12-27 20:49:46,522][106225] Updated weights for policy 1, policy_version 222925 (0.0005) [2023-12-27 20:49:46,655][106226] Updated weights for policy 0, policy_version 222826 (0.0006) [2023-12-27 20:49:46,717][106226] Updated weights for policy 0, policy_version 222836 (0.0009) [2023-12-27 20:49:46,782][106226] Updated weights for policy 0, policy_version 222846 (0.0008) [2023-12-27 20:49:46,844][106226] Updated weights for policy 0, policy_version 222856 (0.0009) [2023-12-27 20:49:47,150][106225] Updated weights for policy 1, policy_version 222935 (0.0007) [2023-12-27 20:49:47,212][106225] Updated weights for policy 1, policy_version 222945 (0.0008) [2023-12-27 20:49:47,273][106225] Updated weights for policy 1, policy_version 222955 (0.0008) [2023-12-27 20:49:47,604][106226] Updated weights for policy 0, policy_version 222866 (0.0009) [2023-12-27 20:49:47,660][106226] Updated weights for policy 0, policy_version 222876 (0.0008) [2023-12-27 20:49:47,718][106226] Updated weights for policy 0, policy_version 222886 (0.0008) [2023-12-27 20:49:47,938][106225] Updated weights for policy 1, policy_version 222965 (0.0009) [2023-12-27 20:49:47,994][106225] Updated weights for policy 1, policy_version 222975 (0.0010) [2023-12-27 20:49:48,050][106225] Updated weights for policy 1, policy_version 222985 (0.0010) [2023-12-27 20:49:48,475][106226] Updated weights for policy 0, policy_version 222896 (0.0008) [2023-12-27 20:49:48,537][106226] Updated weights for policy 0, policy_version 222906 (0.0007) [2023-12-27 20:49:48,597][106226] Updated weights for policy 0, policy_version 222916 (0.0008) [2023-12-27 20:49:48,796][106225] Updated weights for policy 1, policy_version 222995 (0.0010) [2023-12-27 20:49:48,860][106225] Updated weights for policy 1, policy_version 223005 (0.0010) [2023-12-27 20:49:48,917][106225] Updated weights for policy 1, policy_version 223015 (0.0010) [2023-12-27 20:49:49,360][106226] Updated weights for policy 0, policy_version 222926 (0.0008) [2023-12-27 20:49:49,427][106226] Updated weights for policy 0, policy_version 222936 (0.0007) [2023-12-27 20:49:49,496][106226] Updated weights for policy 0, policy_version 222946 (0.0006) [2023-12-27 20:49:49,690][106225] Updated weights for policy 1, policy_version 223025 (0.0010) [2023-12-27 20:49:49,750][106225] Updated weights for policy 1, policy_version 223035 (0.0008) [2023-12-27 20:49:49,808][106225] Updated weights for policy 1, policy_version 223045 (0.0009) [2023-12-27 20:49:49,876][106225] Updated weights for policy 1, policy_version 223055 (0.0009) [2023-12-27 20:49:50,122][106226] Updated weights for policy 0, policy_version 222956 (0.0008) [2023-12-27 20:49:50,179][106226] Updated weights for policy 0, policy_version 222966 (0.0010) [2023-12-27 20:49:50,245][106226] Updated weights for policy 0, policy_version 222976 (0.0010) [2023-12-27 20:49:50,655][106225] Updated weights for policy 1, policy_version 223065 (0.0008) [2023-12-27 20:49:50,715][106225] Updated weights for policy 1, policy_version 223075 (0.0008) [2023-12-27 20:49:50,777][106225] Updated weights for policy 1, policy_version 223085 (0.0008) [2023-12-27 20:49:50,959][106226] Updated weights for policy 0, policy_version 222986 (0.0011) [2023-12-27 20:49:51,021][106226] Updated weights for policy 0, policy_version 222996 (0.0011) [2023-12-27 20:49:51,089][106226] Updated weights for policy 0, policy_version 223006 (0.0008) [2023-12-27 20:49:51,154][106226] Updated weights for policy 0, policy_version 223016 (0.0008) [2023-12-27 20:49:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 114229248. Throughput: 0: 9922.7, 1: 9990.6. Samples: 114235184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:49:51,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.921')] [2023-12-27 20:49:51,523][106225] Updated weights for policy 1, policy_version 223095 (0.0007) [2023-12-27 20:49:51,587][106225] Updated weights for policy 1, policy_version 223105 (0.0008) [2023-12-27 20:49:51,653][106225] Updated weights for policy 1, policy_version 223115 (0.0008) [2023-12-27 20:49:51,910][106226] Updated weights for policy 0, policy_version 223026 (0.0008) [2023-12-27 20:49:51,965][106226] Updated weights for policy 0, policy_version 223036 (0.0008) [2023-12-27 20:49:52,028][106226] Updated weights for policy 0, policy_version 223046 (0.0008) [2023-12-27 20:49:52,345][106225] Updated weights for policy 1, policy_version 223125 (0.0008) [2023-12-27 20:49:52,414][106225] Updated weights for policy 1, policy_version 223135 (0.0009) [2023-12-27 20:49:52,478][106225] Updated weights for policy 1, policy_version 223145 (0.0007) [2023-12-27 20:49:52,865][106226] Updated weights for policy 0, policy_version 223056 (0.0007) [2023-12-27 20:49:52,913][106226] Updated weights for policy 0, policy_version 223066 (0.0005) [2023-12-27 20:49:52,963][106226] Updated weights for policy 0, policy_version 223076 (0.0008) [2023-12-27 20:49:53,040][106225] Updated weights for policy 1, policy_version 223155 (0.0007) [2023-12-27 20:49:53,102][106225] Updated weights for policy 1, policy_version 223165 (0.0008) [2023-12-27 20:49:53,168][106225] Updated weights for policy 1, policy_version 223175 (0.0010) [2023-12-27 20:49:53,535][106226] Updated weights for policy 0, policy_version 223086 (0.0006) [2023-12-27 20:49:53,594][106226] Updated weights for policy 0, policy_version 223096 (0.0008) [2023-12-27 20:49:53,643][106226] Updated weights for policy 0, policy_version 223106 (0.0010) [2023-12-27 20:49:53,810][106225] Updated weights for policy 1, policy_version 223185 (0.0008) [2023-12-27 20:49:53,866][106225] Updated weights for policy 1, policy_version 223195 (0.0005) [2023-12-27 20:49:53,918][106225] Updated weights for policy 1, policy_version 223205 (0.0005) [2023-12-27 20:49:53,974][106225] Updated weights for policy 1, policy_version 223215 (0.0005) [2023-12-27 20:49:54,405][106226] Updated weights for policy 0, policy_version 223116 (0.0007) [2023-12-27 20:49:54,460][106226] Updated weights for policy 0, policy_version 223126 (0.0005) [2023-12-27 20:49:54,527][106226] Updated weights for policy 0, policy_version 223136 (0.0006) [2023-12-27 20:49:54,559][106225] Updated weights for policy 1, policy_version 223225 (0.0010) [2023-12-27 20:49:54,606][106225] Updated weights for policy 1, policy_version 223235 (0.0010) [2023-12-27 20:49:54,653][106225] Updated weights for policy 1, policy_version 223245 (0.0010) [2023-12-27 20:49:55,177][106226] Updated weights for policy 0, policy_version 223146 (0.0009) [2023-12-27 20:49:55,223][106226] Updated weights for policy 0, policy_version 223156 (0.0008) [2023-12-27 20:49:55,285][106225] Updated weights for policy 1, policy_version 223255 (0.0010) [2023-12-27 20:49:55,294][106226] Updated weights for policy 0, policy_version 223166 (0.0008) [2023-12-27 20:49:55,338][106225] Updated weights for policy 1, policy_version 223265 (0.0007) [2023-12-27 20:49:55,345][106226] Updated weights for policy 0, policy_version 223176 (0.0008) [2023-12-27 20:49:55,384][106225] Updated weights for policy 1, policy_version 223275 (0.0007) [2023-12-27 20:49:56,063][106226] Updated weights for policy 0, policy_version 223186 (0.0009) [2023-12-27 20:49:56,089][106225] Updated weights for policy 1, policy_version 223285 (0.0008) [2023-12-27 20:49:56,114][106226] Updated weights for policy 0, policy_version 223196 (0.0009) [2023-12-27 20:49:56,146][106225] Updated weights for policy 1, policy_version 223295 (0.0005) [2023-12-27 20:49:56,173][106226] Updated weights for policy 0, policy_version 223206 (0.0010) [2023-12-27 20:49:56,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 114319360. Throughput: 0: 9908.4, 1: 10019.1. Samples: 114295144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:49:56,176][105115] Avg episode reward: [(0, '-5.091'), (1, '-5.900')] [2023-12-27 20:49:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000223208_57155584.pth... [2023-12-27 20:49:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000222024_56852480.pth [2023-12-27 20:49:56,206][106225] Updated weights for policy 1, policy_version 223305 (0.0008) [2023-12-27 20:49:56,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000223312_57180160.pth... [2023-12-27 20:49:56,250][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000222096_56868864.pth [2023-12-27 20:49:56,795][106226] Updated weights for policy 0, policy_version 223216 (0.0009) [2023-12-27 20:49:56,835][106225] Updated weights for policy 1, policy_version 223315 (0.0007) [2023-12-27 20:49:56,849][106226] Updated weights for policy 0, policy_version 223226 (0.0008) [2023-12-27 20:49:56,883][106225] Updated weights for policy 1, policy_version 223325 (0.0005) [2023-12-27 20:49:56,895][106226] Updated weights for policy 0, policy_version 223236 (0.0007) [2023-12-27 20:49:56,938][106225] Updated weights for policy 1, policy_version 223335 (0.0008) [2023-12-27 20:49:57,631][106225] Updated weights for policy 1, policy_version 223345 (0.0008) [2023-12-27 20:49:57,665][106226] Updated weights for policy 0, policy_version 223246 (0.0008) [2023-12-27 20:49:57,697][106225] Updated weights for policy 1, policy_version 223355 (0.0005) [2023-12-27 20:49:57,733][106226] Updated weights for policy 0, policy_version 223256 (0.0008) [2023-12-27 20:49:57,755][106225] Updated weights for policy 1, policy_version 223365 (0.0006) [2023-12-27 20:49:57,798][106226] Updated weights for policy 0, policy_version 223266 (0.0009) [2023-12-27 20:49:57,807][106225] Updated weights for policy 1, policy_version 223375 (0.0007) [2023-12-27 20:49:58,458][106226] Updated weights for policy 0, policy_version 223276 (0.0008) [2023-12-27 20:49:58,527][106226] Updated weights for policy 0, policy_version 223286 (0.0007) [2023-12-27 20:49:58,536][106225] Updated weights for policy 1, policy_version 223385 (0.0008) [2023-12-27 20:49:58,594][106226] Updated weights for policy 0, policy_version 223296 (0.0006) [2023-12-27 20:49:58,599][106225] Updated weights for policy 1, policy_version 223395 (0.0008) [2023-12-27 20:49:58,668][106225] Updated weights for policy 1, policy_version 223405 (0.0008) [2023-12-27 20:49:59,345][106226] Updated weights for policy 0, policy_version 223306 (0.0007) [2023-12-27 20:49:59,409][106226] Updated weights for policy 0, policy_version 223316 (0.0008) [2023-12-27 20:49:59,464][106226] Updated weights for policy 0, policy_version 223326 (0.0008) [2023-12-27 20:49:59,525][106226] Updated weights for policy 0, policy_version 223336 (0.0009) [2023-12-27 20:49:59,547][106225] Updated weights for policy 1, policy_version 223415 (0.0007) [2023-12-27 20:49:59,611][106225] Updated weights for policy 1, policy_version 223425 (0.0009) [2023-12-27 20:49:59,676][106225] Updated weights for policy 1, policy_version 223435 (0.0006) [2023-12-27 20:50:00,197][106226] Updated weights for policy 0, policy_version 223346 (0.0009) [2023-12-27 20:50:00,258][106226] Updated weights for policy 0, policy_version 223356 (0.0009) [2023-12-27 20:50:00,311][106226] Updated weights for policy 0, policy_version 223366 (0.0008) [2023-12-27 20:50:00,423][106225] Updated weights for policy 1, policy_version 223445 (0.0008) [2023-12-27 20:50:00,471][106225] Updated weights for policy 1, policy_version 223455 (0.0007) [2023-12-27 20:50:00,534][106225] Updated weights for policy 1, policy_version 223465 (0.0008) [2023-12-27 20:50:00,939][106226] Updated weights for policy 0, policy_version 223376 (0.0008) [2023-12-27 20:50:00,991][106226] Updated weights for policy 0, policy_version 223386 (0.0005) [2023-12-27 20:50:01,054][106226] Updated weights for policy 0, policy_version 223396 (0.0006) [2023-12-27 20:50:01,127][106225] Updated weights for policy 1, policy_version 223475 (0.0008) [2023-12-27 20:50:01,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 114425856. Throughput: 0: 9945.2, 1: 10032.8. Samples: 114414804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:01,175][105115] Avg episode reward: [(0, '-5.059'), (1, '-6.038')] [2023-12-27 20:50:01,193][106225] Updated weights for policy 1, policy_version 223485 (0.0006) [2023-12-27 20:50:01,259][106225] Updated weights for policy 1, policy_version 223495 (0.0008) [2023-12-27 20:50:01,775][106226] Updated weights for policy 0, policy_version 223406 (0.0009) [2023-12-27 20:50:01,838][106226] Updated weights for policy 0, policy_version 223416 (0.0007) [2023-12-27 20:50:01,908][106226] Updated weights for policy 0, policy_version 223426 (0.0005) [2023-12-27 20:50:01,994][106225] Updated weights for policy 1, policy_version 223505 (0.0009) [2023-12-27 20:50:02,060][106225] Updated weights for policy 1, policy_version 223515 (0.0008) [2023-12-27 20:50:02,123][106225] Updated weights for policy 1, policy_version 223525 (0.0009) [2023-12-27 20:50:02,184][106225] Updated weights for policy 1, policy_version 223535 (0.0005) [2023-12-27 20:50:02,556][106226] Updated weights for policy 0, policy_version 223436 (0.0006) [2023-12-27 20:50:02,617][106226] Updated weights for policy 0, policy_version 223446 (0.0008) [2023-12-27 20:50:02,671][106226] Updated weights for policy 0, policy_version 223456 (0.0008) [2023-12-27 20:50:02,878][106225] Updated weights for policy 1, policy_version 223545 (0.0008) [2023-12-27 20:50:02,925][106225] Updated weights for policy 1, policy_version 223555 (0.0007) [2023-12-27 20:50:02,979][106225] Updated weights for policy 1, policy_version 223565 (0.0009) [2023-12-27 20:50:03,403][106226] Updated weights for policy 0, policy_version 223466 (0.0009) [2023-12-27 20:50:03,461][106226] Updated weights for policy 0, policy_version 223476 (0.0006) [2023-12-27 20:50:03,513][106226] Updated weights for policy 0, policy_version 223486 (0.0008) [2023-12-27 20:50:03,566][106226] Updated weights for policy 0, policy_version 223496 (0.0011) [2023-12-27 20:50:03,706][106225] Updated weights for policy 1, policy_version 223575 (0.0008) [2023-12-27 20:50:03,761][106225] Updated weights for policy 1, policy_version 223585 (0.0007) [2023-12-27 20:50:03,809][106225] Updated weights for policy 1, policy_version 223595 (0.0006) [2023-12-27 20:50:04,259][106226] Updated weights for policy 0, policy_version 223506 (0.0011) [2023-12-27 20:50:04,326][106226] Updated weights for policy 0, policy_version 223516 (0.0009) [2023-12-27 20:50:04,388][106226] Updated weights for policy 0, policy_version 223526 (0.0009) [2023-12-27 20:50:04,489][106225] Updated weights for policy 1, policy_version 223605 (0.0006) [2023-12-27 20:50:04,555][106225] Updated weights for policy 1, policy_version 223615 (0.0005) [2023-12-27 20:50:04,614][106225] Updated weights for policy 1, policy_version 223625 (0.0008) [2023-12-27 20:50:05,115][106226] Updated weights for policy 0, policy_version 223536 (0.0008) [2023-12-27 20:50:05,164][106226] Updated weights for policy 0, policy_version 223546 (0.0009) [2023-12-27 20:50:05,222][106226] Updated weights for policy 0, policy_version 223556 (0.0009) [2023-12-27 20:50:05,290][106225] Updated weights for policy 1, policy_version 223635 (0.0008) [2023-12-27 20:50:05,352][106225] Updated weights for policy 1, policy_version 223645 (0.0006) [2023-12-27 20:50:05,407][106225] Updated weights for policy 1, policy_version 223655 (0.0005) [2023-12-27 20:50:06,006][106225] Updated weights for policy 1, policy_version 223665 (0.0006) [2023-12-27 20:50:06,021][106226] Updated weights for policy 0, policy_version 223566 (0.0008) [2023-12-27 20:50:06,060][106225] Updated weights for policy 1, policy_version 223675 (0.0008) [2023-12-27 20:50:06,066][106226] Updated weights for policy 0, policy_version 223576 (0.0007) [2023-12-27 20:50:06,131][106226] Updated weights for policy 0, policy_version 223586 (0.0007) [2023-12-27 20:50:06,137][106225] Updated weights for policy 1, policy_version 223685 (0.0008) [2023-12-27 20:50:06,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 114524160. Throughput: 0: 9880.4, 1: 10077.0. Samples: 114534556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:06,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-6.159')] [2023-12-27 20:50:06,200][106225] Updated weights for policy 1, policy_version 223695 (0.0008) [2023-12-27 20:50:06,895][106225] Updated weights for policy 1, policy_version 223705 (0.0005) [2023-12-27 20:50:06,928][106226] Updated weights for policy 0, policy_version 223596 (0.0006) [2023-12-27 20:50:06,950][106225] Updated weights for policy 1, policy_version 223715 (0.0007) [2023-12-27 20:50:06,988][106226] Updated weights for policy 0, policy_version 223606 (0.0007) [2023-12-27 20:50:07,002][106225] Updated weights for policy 1, policy_version 223725 (0.0006) [2023-12-27 20:50:07,039][106226] Updated weights for policy 0, policy_version 223616 (0.0007) [2023-12-27 20:50:07,595][106226] Updated weights for policy 0, policy_version 223626 (0.0007) [2023-12-27 20:50:07,655][106226] Updated weights for policy 0, policy_version 223636 (0.0008) [2023-12-27 20:50:07,715][106226] Updated weights for policy 0, policy_version 223646 (0.0009) [2023-12-27 20:50:07,780][106226] Updated weights for policy 0, policy_version 223656 (0.0007) [2023-12-27 20:50:07,782][106225] Updated weights for policy 1, policy_version 223735 (0.0007) [2023-12-27 20:50:07,837][106225] Updated weights for policy 1, policy_version 223745 (0.0007) [2023-12-27 20:50:07,887][106225] Updated weights for policy 1, policy_version 223755 (0.0008) [2023-12-27 20:50:08,488][106226] Updated weights for policy 0, policy_version 223666 (0.0011) [2023-12-27 20:50:08,547][106226] Updated weights for policy 0, policy_version 223676 (0.0011) [2023-12-27 20:50:08,607][106226] Updated weights for policy 0, policy_version 223686 (0.0010) [2023-12-27 20:50:08,647][106225] Updated weights for policy 1, policy_version 223765 (0.0008) [2023-12-27 20:50:08,698][106225] Updated weights for policy 1, policy_version 223775 (0.0008) [2023-12-27 20:50:08,752][106225] Updated weights for policy 1, policy_version 223785 (0.0008) [2023-12-27 20:50:09,329][106226] Updated weights for policy 0, policy_version 223696 (0.0009) [2023-12-27 20:50:09,410][106226] Updated weights for policy 0, policy_version 223706 (0.0009) [2023-12-27 20:50:09,482][106226] Updated weights for policy 0, policy_version 223716 (0.0008) [2023-12-27 20:50:09,559][106225] Updated weights for policy 1, policy_version 223795 (0.0008) [2023-12-27 20:50:09,615][106225] Updated weights for policy 1, policy_version 223805 (0.0008) [2023-12-27 20:50:09,676][106225] Updated weights for policy 1, policy_version 223815 (0.0008) [2023-12-27 20:50:10,251][106226] Updated weights for policy 0, policy_version 223726 (0.0008) [2023-12-27 20:50:10,312][106226] Updated weights for policy 0, policy_version 223736 (0.0009) [2023-12-27 20:50:10,376][106226] Updated weights for policy 0, policy_version 223746 (0.0008) [2023-12-27 20:50:10,474][106225] Updated weights for policy 1, policy_version 223825 (0.0008) [2023-12-27 20:50:10,541][106225] Updated weights for policy 1, policy_version 223835 (0.0005) [2023-12-27 20:50:10,595][106225] Updated weights for policy 1, policy_version 223845 (0.0007) [2023-12-27 20:50:10,649][106225] Updated weights for policy 1, policy_version 223855 (0.0010) [2023-12-27 20:50:11,083][106226] Updated weights for policy 0, policy_version 223756 (0.0009) [2023-12-27 20:50:11,145][106226] Updated weights for policy 0, policy_version 223766 (0.0009) [2023-12-27 20:50:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 114614272. Throughput: 0: 9925.8, 1: 10110.8. Samples: 114593184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:11,175][105115] Avg episode reward: [(0, '-5.007'), (1, '-5.783')] [2023-12-27 20:50:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000223856_57319424.pth... [2023-12-27 20:50:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000222704_57024512.pth [2023-12-27 20:50:11,216][106226] Updated weights for policy 0, policy_version 223776 (0.0009) [2023-12-27 20:50:11,267][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000223784_57303040.pth... [2023-12-27 20:50:11,269][106225] Updated weights for policy 1, policy_version 223865 (0.0008) [2023-12-27 20:50:11,271][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000222632_57008128.pth [2023-12-27 20:50:11,332][106225] Updated weights for policy 1, policy_version 223875 (0.0008) [2023-12-27 20:50:11,400][106225] Updated weights for policy 1, policy_version 223885 (0.0008) [2023-12-27 20:50:12,028][106226] Updated weights for policy 0, policy_version 223786 (0.0008) [2023-12-27 20:50:12,079][106226] Updated weights for policy 0, policy_version 223796 (0.0008) [2023-12-27 20:50:12,132][106226] Updated weights for policy 0, policy_version 223806 (0.0009) [2023-12-27 20:50:12,177][106225] Updated weights for policy 1, policy_version 223895 (0.0010) [2023-12-27 20:50:12,226][106226] Updated weights for policy 0, policy_version 223816 (0.0009) [2023-12-27 20:50:12,239][106225] Updated weights for policy 1, policy_version 223905 (0.0010) [2023-12-27 20:50:12,305][106225] Updated weights for policy 1, policy_version 223915 (0.0010) [2023-12-27 20:50:12,936][106226] Updated weights for policy 0, policy_version 223826 (0.0009) [2023-12-27 20:50:12,994][106226] Updated weights for policy 0, policy_version 223836 (0.0008) [2023-12-27 20:50:13,008][106225] Updated weights for policy 1, policy_version 223925 (0.0007) [2023-12-27 20:50:13,052][106226] Updated weights for policy 0, policy_version 223846 (0.0006) [2023-12-27 20:50:13,058][106225] Updated weights for policy 1, policy_version 223935 (0.0006) [2023-12-27 20:50:13,119][106225] Updated weights for policy 1, policy_version 223945 (0.0007) [2023-12-27 20:50:13,804][106226] Updated weights for policy 0, policy_version 223856 (0.0010) [2023-12-27 20:50:13,808][106225] Updated weights for policy 1, policy_version 223955 (0.0007) [2023-12-27 20:50:13,860][106226] Updated weights for policy 0, policy_version 223866 (0.0010) [2023-12-27 20:50:13,865][106225] Updated weights for policy 1, policy_version 223965 (0.0006) [2023-12-27 20:50:13,907][106226] Updated weights for policy 0, policy_version 223876 (0.0010) [2023-12-27 20:50:13,921][106225] Updated weights for policy 1, policy_version 223975 (0.0007) [2023-12-27 20:50:14,589][106226] Updated weights for policy 0, policy_version 223886 (0.0011) [2023-12-27 20:50:14,644][106226] Updated weights for policy 0, policy_version 223896 (0.0010) [2023-12-27 20:50:14,657][106225] Updated weights for policy 1, policy_version 223985 (0.0007) [2023-12-27 20:50:14,695][106226] Updated weights for policy 0, policy_version 223906 (0.0010) [2023-12-27 20:50:14,713][106225] Updated weights for policy 1, policy_version 223995 (0.0005) [2023-12-27 20:50:14,772][106225] Updated weights for policy 1, policy_version 224005 (0.0008) [2023-12-27 20:50:14,833][106225] Updated weights for policy 1, policy_version 224015 (0.0008) [2023-12-27 20:50:15,433][106226] Updated weights for policy 0, policy_version 223916 (0.0010) [2023-12-27 20:50:15,484][106226] Updated weights for policy 0, policy_version 223926 (0.0008) [2023-12-27 20:50:15,542][106226] Updated weights for policy 0, policy_version 223936 (0.0008) [2023-12-27 20:50:15,543][106225] Updated weights for policy 1, policy_version 224025 (0.0006) [2023-12-27 20:50:15,601][106225] Updated weights for policy 1, policy_version 224035 (0.0005) [2023-12-27 20:50:15,654][106225] Updated weights for policy 1, policy_version 224045 (0.0005) [2023-12-27 20:50:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 114712576. Throughput: 0: 9810.3, 1: 10006.5. Samples: 114706420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:16,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-5.982')] [2023-12-27 20:50:16,200][106225] Updated weights for policy 1, policy_version 224055 (0.0007) [2023-12-27 20:50:16,252][106225] Updated weights for policy 1, policy_version 224065 (0.0007) [2023-12-27 20:50:16,294][106226] Updated weights for policy 0, policy_version 223946 (0.0008) [2023-12-27 20:50:16,304][106225] Updated weights for policy 1, policy_version 224075 (0.0007) [2023-12-27 20:50:16,353][106226] Updated weights for policy 0, policy_version 223956 (0.0010) [2023-12-27 20:50:16,409][106226] Updated weights for policy 0, policy_version 223966 (0.0007) [2023-12-27 20:50:16,475][106226] Updated weights for policy 0, policy_version 223976 (0.0005) [2023-12-27 20:50:17,078][106225] Updated weights for policy 1, policy_version 224085 (0.0006) [2023-12-27 20:50:17,104][106226] Updated weights for policy 0, policy_version 223986 (0.0006) [2023-12-27 20:50:17,132][106225] Updated weights for policy 1, policy_version 224095 (0.0006) [2023-12-27 20:50:17,155][106226] Updated weights for policy 0, policy_version 223996 (0.0005) [2023-12-27 20:50:17,195][106225] Updated weights for policy 1, policy_version 224105 (0.0010) [2023-12-27 20:50:17,212][106226] Updated weights for policy 0, policy_version 224006 (0.0005) [2023-12-27 20:50:17,834][106225] Updated weights for policy 1, policy_version 224115 (0.0009) [2023-12-27 20:50:17,874][106226] Updated weights for policy 0, policy_version 224016 (0.0008) [2023-12-27 20:50:17,890][106225] Updated weights for policy 1, policy_version 224125 (0.0005) [2023-12-27 20:50:17,924][106226] Updated weights for policy 0, policy_version 224026 (0.0008) [2023-12-27 20:50:17,934][106225] Updated weights for policy 1, policy_version 224135 (0.0009) [2023-12-27 20:50:17,973][106226] Updated weights for policy 0, policy_version 224036 (0.0007) [2023-12-27 20:50:18,536][106225] Updated weights for policy 1, policy_version 224145 (0.0007) [2023-12-27 20:50:18,599][106225] Updated weights for policy 1, policy_version 224155 (0.0011) [2023-12-27 20:50:18,661][106225] Updated weights for policy 1, policy_version 224165 (0.0011) [2023-12-27 20:50:18,718][106225] Updated weights for policy 1, policy_version 224175 (0.0010) [2023-12-27 20:50:18,781][106226] Updated weights for policy 0, policy_version 224046 (0.0009) [2023-12-27 20:50:18,852][106226] Updated weights for policy 0, policy_version 224056 (0.0009) [2023-12-27 20:50:18,911][106226] Updated weights for policy 0, policy_version 224066 (0.0008) [2023-12-27 20:50:19,360][106225] Updated weights for policy 1, policy_version 224185 (0.0007) [2023-12-27 20:50:19,427][106225] Updated weights for policy 1, policy_version 224195 (0.0012) [2023-12-27 20:50:19,483][106225] Updated weights for policy 1, policy_version 224205 (0.0010) [2023-12-27 20:50:19,617][106226] Updated weights for policy 0, policy_version 224076 (0.0008) [2023-12-27 20:50:19,684][106226] Updated weights for policy 0, policy_version 224086 (0.0005) [2023-12-27 20:50:19,754][106226] Updated weights for policy 0, policy_version 224096 (0.0006) [2023-12-27 20:50:20,215][106225] Updated weights for policy 1, policy_version 224215 (0.0007) [2023-12-27 20:50:20,271][106225] Updated weights for policy 1, policy_version 224225 (0.0006) [2023-12-27 20:50:20,333][106225] Updated weights for policy 1, policy_version 224235 (0.0010) [2023-12-27 20:50:20,466][106226] Updated weights for policy 0, policy_version 224106 (0.0007) [2023-12-27 20:50:20,528][106226] Updated weights for policy 0, policy_version 224116 (0.0006) [2023-12-27 20:50:20,595][106226] Updated weights for policy 0, policy_version 224126 (0.0007) [2023-12-27 20:50:20,669][106226] Updated weights for policy 0, policy_version 224136 (0.0009) [2023-12-27 20:50:20,983][106225] Updated weights for policy 1, policy_version 224245 (0.0009) [2023-12-27 20:50:21,047][106225] Updated weights for policy 1, policy_version 224255 (0.0008) [2023-12-27 20:50:21,118][106225] Updated weights for policy 1, policy_version 224265 (0.0008) [2023-12-27 20:50:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 114819072. Throughput: 0: 9733.6, 1: 10016.9. Samples: 114826196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:21,175][105115] Avg episode reward: [(0, '-5.100'), (1, '-5.942')] [2023-12-27 20:50:21,436][106226] Updated weights for policy 0, policy_version 224146 (0.0010) [2023-12-27 20:50:21,499][106226] Updated weights for policy 0, policy_version 224156 (0.0009) [2023-12-27 20:50:21,553][106226] Updated weights for policy 0, policy_version 224166 (0.0008) [2023-12-27 20:50:21,837][106225] Updated weights for policy 1, policy_version 224275 (0.0009) [2023-12-27 20:50:21,901][106225] Updated weights for policy 1, policy_version 224285 (0.0010) [2023-12-27 20:50:21,964][106225] Updated weights for policy 1, policy_version 224295 (0.0009) [2023-12-27 20:50:22,288][106226] Updated weights for policy 0, policy_version 224176 (0.0009) [2023-12-27 20:50:22,348][106226] Updated weights for policy 0, policy_version 224186 (0.0009) [2023-12-27 20:50:22,417][106226] Updated weights for policy 0, policy_version 224196 (0.0009) [2023-12-27 20:50:22,729][106225] Updated weights for policy 1, policy_version 224305 (0.0010) [2023-12-27 20:50:22,788][106225] Updated weights for policy 1, policy_version 224315 (0.0011) [2023-12-27 20:50:22,847][106225] Updated weights for policy 1, policy_version 224325 (0.0010) [2023-12-27 20:50:22,909][106225] Updated weights for policy 1, policy_version 224335 (0.0010) [2023-12-27 20:50:23,152][106226] Updated weights for policy 0, policy_version 224206 (0.0007) [2023-12-27 20:50:23,208][106226] Updated weights for policy 0, policy_version 224216 (0.0005) [2023-12-27 20:50:23,259][106226] Updated weights for policy 0, policy_version 224226 (0.0008) [2023-12-27 20:50:23,541][106225] Updated weights for policy 1, policy_version 224345 (0.0007) [2023-12-27 20:50:23,605][106225] Updated weights for policy 1, policy_version 224355 (0.0008) [2023-12-27 20:50:23,659][106225] Updated weights for policy 1, policy_version 224365 (0.0007) [2023-12-27 20:50:23,924][106226] Updated weights for policy 0, policy_version 224236 (0.0008) [2023-12-27 20:50:23,987][106226] Updated weights for policy 0, policy_version 224246 (0.0008) [2023-12-27 20:50:24,040][106226] Updated weights for policy 0, policy_version 224256 (0.0008) [2023-12-27 20:50:24,237][106225] Updated weights for policy 1, policy_version 224375 (0.0009) [2023-12-27 20:50:24,292][106225] Updated weights for policy 1, policy_version 224385 (0.0007) [2023-12-27 20:50:24,360][106225] Updated weights for policy 1, policy_version 224395 (0.0008) [2023-12-27 20:50:24,653][106226] Updated weights for policy 0, policy_version 224266 (0.0006) [2023-12-27 20:50:24,713][106226] Updated weights for policy 0, policy_version 224276 (0.0006) [2023-12-27 20:50:24,778][106226] Updated weights for policy 0, policy_version 224286 (0.0006) [2023-12-27 20:50:24,838][106226] Updated weights for policy 0, policy_version 224296 (0.0007) [2023-12-27 20:50:25,043][106225] Updated weights for policy 1, policy_version 224405 (0.0010) [2023-12-27 20:50:25,099][106225] Updated weights for policy 1, policy_version 224415 (0.0010) [2023-12-27 20:50:25,158][106225] Updated weights for policy 1, policy_version 224425 (0.0010) [2023-12-27 20:50:25,441][106226] Updated weights for policy 0, policy_version 224306 (0.0008) [2023-12-27 20:50:25,499][106226] Updated weights for policy 0, policy_version 224316 (0.0007) [2023-12-27 20:50:25,564][106226] Updated weights for policy 0, policy_version 224326 (0.0008) [2023-12-27 20:50:25,884][106225] Updated weights for policy 1, policy_version 224435 (0.0010) [2023-12-27 20:50:25,944][106225] Updated weights for policy 1, policy_version 224445 (0.0010) [2023-12-27 20:50:26,008][106225] Updated weights for policy 1, policy_version 224455 (0.0010) [2023-12-27 20:50:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 114917376. Throughput: 0: 9706.1, 1: 9975.7. Samples: 114884940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:26,175][105115] Avg episode reward: [(0, '-5.053'), (1, '-6.203')] [2023-12-27 20:50:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000224328_57442304.pth... [2023-12-27 20:50:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000224464_57475072.pth... [2023-12-27 20:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000223208_57155584.pth [2023-12-27 20:50:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000223312_57180160.pth [2023-12-27 20:50:26,297][106226] Updated weights for policy 0, policy_version 224336 (0.0008) [2023-12-27 20:50:26,363][106226] Updated weights for policy 0, policy_version 224346 (0.0008) [2023-12-27 20:50:26,415][106226] Updated weights for policy 0, policy_version 224356 (0.0007) [2023-12-27 20:50:26,630][106225] Updated weights for policy 1, policy_version 224465 (0.0006) [2023-12-27 20:50:26,683][106225] Updated weights for policy 1, policy_version 224475 (0.0005) [2023-12-27 20:50:26,741][106225] Updated weights for policy 1, policy_version 224485 (0.0007) [2023-12-27 20:50:26,800][106225] Updated weights for policy 1, policy_version 224495 (0.0010) [2023-12-27 20:50:27,191][106226] Updated weights for policy 0, policy_version 224366 (0.0007) [2023-12-27 20:50:27,240][106226] Updated weights for policy 0, policy_version 224376 (0.0007) [2023-12-27 20:50:27,287][106226] Updated weights for policy 0, policy_version 224386 (0.0008) [2023-12-27 20:50:27,370][106225] Updated weights for policy 1, policy_version 224505 (0.0006) [2023-12-27 20:50:27,429][106225] Updated weights for policy 1, policy_version 224515 (0.0006) [2023-12-27 20:50:27,486][106225] Updated weights for policy 1, policy_version 224525 (0.0006) [2023-12-27 20:50:28,053][106226] Updated weights for policy 0, policy_version 224396 (0.0006) [2023-12-27 20:50:28,115][106226] Updated weights for policy 0, policy_version 224406 (0.0005) [2023-12-27 20:50:28,146][106225] Updated weights for policy 1, policy_version 224535 (0.0009) [2023-12-27 20:50:28,174][106226] Updated weights for policy 0, policy_version 224416 (0.0005) [2023-12-27 20:50:28,207][106225] Updated weights for policy 1, policy_version 224545 (0.0009) [2023-12-27 20:50:28,262][106225] Updated weights for policy 1, policy_version 224555 (0.0010) [2023-12-27 20:50:28,878][106226] Updated weights for policy 0, policy_version 224426 (0.0009) [2023-12-27 20:50:28,932][106226] Updated weights for policy 0, policy_version 224436 (0.0010) [2023-12-27 20:50:28,975][106225] Updated weights for policy 1, policy_version 224565 (0.0010) [2023-12-27 20:50:28,985][106226] Updated weights for policy 0, policy_version 224446 (0.0010) [2023-12-27 20:50:29,038][106225] Updated weights for policy 1, policy_version 224575 (0.0010) [2023-12-27 20:50:29,044][106226] Updated weights for policy 0, policy_version 224456 (0.0010) [2023-12-27 20:50:29,090][106225] Updated weights for policy 1, policy_version 224585 (0.0010) [2023-12-27 20:50:29,777][106226] Updated weights for policy 0, policy_version 224466 (0.0008) [2023-12-27 20:50:29,828][106225] Updated weights for policy 1, policy_version 224595 (0.0010) [2023-12-27 20:50:29,839][106226] Updated weights for policy 0, policy_version 224476 (0.0008) [2023-12-27 20:50:29,889][106225] Updated weights for policy 1, policy_version 224605 (0.0010) [2023-12-27 20:50:29,895][106226] Updated weights for policy 0, policy_version 224486 (0.0006) [2023-12-27 20:50:29,955][106225] Updated weights for policy 1, policy_version 224615 (0.0010) [2023-12-27 20:50:30,575][106226] Updated weights for policy 0, policy_version 224496 (0.0007) [2023-12-27 20:50:30,631][106226] Updated weights for policy 0, policy_version 224506 (0.0008) [2023-12-27 20:50:30,658][106225] Updated weights for policy 1, policy_version 224625 (0.0010) [2023-12-27 20:50:30,689][106226] Updated weights for policy 0, policy_version 224516 (0.0006) [2023-12-27 20:50:30,714][106225] Updated weights for policy 1, policy_version 224635 (0.0010) [2023-12-27 20:50:30,782][106225] Updated weights for policy 1, policy_version 224645 (0.0010) [2023-12-27 20:50:30,841][106225] Updated weights for policy 1, policy_version 224655 (0.0010) [2023-12-27 20:50:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 115015680. Throughput: 0: 9751.6, 1: 9993.3. Samples: 115006512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:31,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-6.036')] [2023-12-27 20:50:31,287][106226] Updated weights for policy 0, policy_version 224526 (0.0008) [2023-12-27 20:50:31,357][106226] Updated weights for policy 0, policy_version 224536 (0.0008) [2023-12-27 20:50:31,424][106226] Updated weights for policy 0, policy_version 224546 (0.0010) [2023-12-27 20:50:31,562][106225] Updated weights for policy 1, policy_version 224665 (0.0008) [2023-12-27 20:50:31,628][106225] Updated weights for policy 1, policy_version 224675 (0.0006) [2023-12-27 20:50:31,692][106225] Updated weights for policy 1, policy_version 224685 (0.0006) [2023-12-27 20:50:32,071][106226] Updated weights for policy 0, policy_version 224556 (0.0009) [2023-12-27 20:50:32,132][106226] Updated weights for policy 0, policy_version 224566 (0.0011) [2023-12-27 20:50:32,188][106226] Updated weights for policy 0, policy_version 224576 (0.0008) [2023-12-27 20:50:32,298][106225] Updated weights for policy 1, policy_version 224695 (0.0007) [2023-12-27 20:50:32,361][106225] Updated weights for policy 1, policy_version 224705 (0.0008) [2023-12-27 20:50:32,424][106225] Updated weights for policy 1, policy_version 224715 (0.0008) [2023-12-27 20:50:32,901][106226] Updated weights for policy 0, policy_version 224586 (0.0008) [2023-12-27 20:50:32,955][106226] Updated weights for policy 0, policy_version 224596 (0.0007) [2023-12-27 20:50:33,010][106226] Updated weights for policy 0, policy_version 224606 (0.0005) [2023-12-27 20:50:33,071][106226] Updated weights for policy 0, policy_version 224616 (0.0006) [2023-12-27 20:50:33,136][106225] Updated weights for policy 1, policy_version 224725 (0.0008) [2023-12-27 20:50:33,189][106225] Updated weights for policy 1, policy_version 224735 (0.0009) [2023-12-27 20:50:33,237][106225] Updated weights for policy 1, policy_version 224745 (0.0008) [2023-12-27 20:50:33,720][106226] Updated weights for policy 0, policy_version 224626 (0.0010) [2023-12-27 20:50:33,779][106226] Updated weights for policy 0, policy_version 224636 (0.0010) [2023-12-27 20:50:33,847][106226] Updated weights for policy 0, policy_version 224646 (0.0010) [2023-12-27 20:50:33,954][106225] Updated weights for policy 1, policy_version 224755 (0.0008) [2023-12-27 20:50:34,006][106225] Updated weights for policy 1, policy_version 224765 (0.0005) [2023-12-27 20:50:34,051][106225] Updated weights for policy 1, policy_version 224775 (0.0005) [2023-12-27 20:50:34,552][106226] Updated weights for policy 0, policy_version 224656 (0.0009) [2023-12-27 20:50:34,617][106226] Updated weights for policy 0, policy_version 224666 (0.0008) [2023-12-27 20:50:34,674][106225] Updated weights for policy 1, policy_version 224785 (0.0006) [2023-12-27 20:50:34,678][106226] Updated weights for policy 0, policy_version 224676 (0.0009) [2023-12-27 20:50:34,724][106225] Updated weights for policy 1, policy_version 224795 (0.0010) [2023-12-27 20:50:34,774][106225] Updated weights for policy 1, policy_version 224805 (0.0010) [2023-12-27 20:50:34,824][106225] Updated weights for policy 1, policy_version 224815 (0.0010) [2023-12-27 20:50:35,411][106226] Updated weights for policy 0, policy_version 224686 (0.0011) [2023-12-27 20:50:35,472][106226] Updated weights for policy 0, policy_version 224696 (0.0011) [2023-12-27 20:50:35,522][106226] Updated weights for policy 0, policy_version 224706 (0.0007) [2023-12-27 20:50:35,522][106225] Updated weights for policy 1, policy_version 224825 (0.0010) [2023-12-27 20:50:35,582][106225] Updated weights for policy 1, policy_version 224835 (0.0010) [2023-12-27 20:50:35,652][106225] Updated weights for policy 1, policy_version 224845 (0.0010) [2023-12-27 20:50:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 115113984. Throughput: 0: 9805.9, 1: 10043.4. Samples: 115128408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:36,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-6.123')] [2023-12-27 20:50:36,200][106226] Updated weights for policy 0, policy_version 224716 (0.0005) [2023-12-27 20:50:36,264][106226] Updated weights for policy 0, policy_version 224726 (0.0008) [2023-12-27 20:50:36,330][106226] Updated weights for policy 0, policy_version 224736 (0.0006) [2023-12-27 20:50:36,374][106225] Updated weights for policy 1, policy_version 224855 (0.0009) [2023-12-27 20:50:36,432][106225] Updated weights for policy 1, policy_version 224865 (0.0009) [2023-12-27 20:50:36,497][106225] Updated weights for policy 1, policy_version 224875 (0.0006) [2023-12-27 20:50:36,888][106226] Updated weights for policy 0, policy_version 224746 (0.0006) [2023-12-27 20:50:36,959][106226] Updated weights for policy 0, policy_version 224756 (0.0006) [2023-12-27 20:50:37,024][106226] Updated weights for policy 0, policy_version 224766 (0.0005) [2023-12-27 20:50:37,081][106225] Updated weights for policy 1, policy_version 224885 (0.0005) [2023-12-27 20:50:37,090][106226] Updated weights for policy 0, policy_version 224776 (0.0005) [2023-12-27 20:50:37,139][106225] Updated weights for policy 1, policy_version 224895 (0.0006) [2023-12-27 20:50:37,208][106225] Updated weights for policy 1, policy_version 224905 (0.0005) [2023-12-27 20:50:37,748][106226] Updated weights for policy 0, policy_version 224786 (0.0011) [2023-12-27 20:50:37,819][106226] Updated weights for policy 0, policy_version 224796 (0.0011) [2023-12-27 20:50:37,840][106225] Updated weights for policy 1, policy_version 224915 (0.0005) [2023-12-27 20:50:37,880][106226] Updated weights for policy 0, policy_version 224806 (0.0011) [2023-12-27 20:50:37,897][106225] Updated weights for policy 1, policy_version 224925 (0.0007) [2023-12-27 20:50:37,962][106225] Updated weights for policy 1, policy_version 224935 (0.0008) [2023-12-27 20:50:38,605][106226] Updated weights for policy 0, policy_version 224816 (0.0011) [2023-12-27 20:50:38,664][106226] Updated weights for policy 0, policy_version 224826 (0.0009) [2023-12-27 20:50:38,677][106225] Updated weights for policy 1, policy_version 224945 (0.0008) [2023-12-27 20:50:38,721][106226] Updated weights for policy 0, policy_version 224836 (0.0010) [2023-12-27 20:50:38,739][106225] Updated weights for policy 1, policy_version 224955 (0.0006) [2023-12-27 20:50:38,797][106225] Updated weights for policy 1, policy_version 224965 (0.0008) [2023-12-27 20:50:38,851][106225] Updated weights for policy 1, policy_version 224975 (0.0008) [2023-12-27 20:50:39,432][106226] Updated weights for policy 0, policy_version 224846 (0.0010) [2023-12-27 20:50:39,489][106226] Updated weights for policy 0, policy_version 224856 (0.0009) [2023-12-27 20:50:39,555][106226] Updated weights for policy 0, policy_version 224866 (0.0008) [2023-12-27 20:50:39,597][106225] Updated weights for policy 1, policy_version 224985 (0.0008) [2023-12-27 20:50:39,661][106225] Updated weights for policy 1, policy_version 224995 (0.0008) [2023-12-27 20:50:39,727][106225] Updated weights for policy 1, policy_version 225005 (0.0009) [2023-12-27 20:50:40,236][106226] Updated weights for policy 0, policy_version 224876 (0.0006) [2023-12-27 20:50:40,303][106226] Updated weights for policy 0, policy_version 224886 (0.0007) [2023-12-27 20:50:40,361][106226] Updated weights for policy 0, policy_version 224896 (0.0009) [2023-12-27 20:50:40,507][106225] Updated weights for policy 1, policy_version 225015 (0.0009) [2023-12-27 20:50:40,564][106225] Updated weights for policy 1, policy_version 225025 (0.0009) [2023-12-27 20:50:40,622][106225] Updated weights for policy 1, policy_version 225035 (0.0009) [2023-12-27 20:50:40,986][106226] Updated weights for policy 0, policy_version 224906 (0.0008) [2023-12-27 20:50:41,052][106226] Updated weights for policy 0, policy_version 224916 (0.0008) [2023-12-27 20:50:41,115][106226] Updated weights for policy 0, policy_version 224926 (0.0008) [2023-12-27 20:50:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 115212288. Throughput: 0: 9831.4, 1: 10053.1. Samples: 115189940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:41,175][105115] Avg episode reward: [(0, '-5.165'), (1, '-6.172')] [2023-12-27 20:50:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000225040_57622528.pth... [2023-12-27 20:50:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000224936_57597952.pth... [2023-12-27 20:50:41,184][106226] Updated weights for policy 0, policy_version 224936 (0.0008) [2023-12-27 20:50:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000223856_57319424.pth [2023-12-27 20:50:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000223784_57303040.pth [2023-12-27 20:50:41,389][106225] Updated weights for policy 1, policy_version 225045 (0.0007) [2023-12-27 20:50:41,449][106225] Updated weights for policy 1, policy_version 225055 (0.0008) [2023-12-27 20:50:41,508][106225] Updated weights for policy 1, policy_version 225065 (0.0008) [2023-12-27 20:50:41,963][106226] Updated weights for policy 0, policy_version 224946 (0.0010) [2023-12-27 20:50:42,019][106226] Updated weights for policy 0, policy_version 224956 (0.0008) [2023-12-27 20:50:42,080][106226] Updated weights for policy 0, policy_version 224966 (0.0008) [2023-12-27 20:50:42,254][106225] Updated weights for policy 1, policy_version 225075 (0.0008) [2023-12-27 20:50:42,318][106225] Updated weights for policy 1, policy_version 225085 (0.0009) [2023-12-27 20:50:42,393][106225] Updated weights for policy 1, policy_version 225095 (0.0009) [2023-12-27 20:50:42,872][106226] Updated weights for policy 0, policy_version 224976 (0.0009) [2023-12-27 20:50:42,930][106226] Updated weights for policy 0, policy_version 224986 (0.0009) [2023-12-27 20:50:42,979][106226] Updated weights for policy 0, policy_version 224996 (0.0008) [2023-12-27 20:50:43,084][106225] Updated weights for policy 1, policy_version 225105 (0.0008) [2023-12-27 20:50:43,134][106225] Updated weights for policy 1, policy_version 225115 (0.0009) [2023-12-27 20:50:43,198][106225] Updated weights for policy 1, policy_version 225125 (0.0009) [2023-12-27 20:50:43,251][106225] Updated weights for policy 1, policy_version 225135 (0.0008) [2023-12-27 20:50:43,707][106226] Updated weights for policy 0, policy_version 225006 (0.0006) [2023-12-27 20:50:43,757][106226] Updated weights for policy 0, policy_version 225016 (0.0005) [2023-12-27 20:50:43,812][106225] Updated weights for policy 1, policy_version 225145 (0.0007) [2023-12-27 20:50:43,815][106226] Updated weights for policy 0, policy_version 225026 (0.0006) [2023-12-27 20:50:43,866][106225] Updated weights for policy 1, policy_version 225155 (0.0006) [2023-12-27 20:50:43,922][106225] Updated weights for policy 1, policy_version 225165 (0.0007) [2023-12-27 20:50:44,475][106226] Updated weights for policy 0, policy_version 225036 (0.0006) [2023-12-27 20:50:44,540][106226] Updated weights for policy 0, policy_version 225046 (0.0006) [2023-12-27 20:50:44,602][106226] Updated weights for policy 0, policy_version 225056 (0.0008) [2023-12-27 20:50:44,635][106225] Updated weights for policy 1, policy_version 225175 (0.0007) [2023-12-27 20:50:44,686][106225] Updated weights for policy 1, policy_version 225185 (0.0009) [2023-12-27 20:50:44,731][106225] Updated weights for policy 1, policy_version 225195 (0.0008) [2023-12-27 20:50:45,315][106226] Updated weights for policy 0, policy_version 225066 (0.0007) [2023-12-27 20:50:45,377][106226] Updated weights for policy 0, policy_version 225076 (0.0008) [2023-12-27 20:50:45,440][106226] Updated weights for policy 0, policy_version 225086 (0.0009) [2023-12-27 20:50:45,485][106225] Updated weights for policy 1, policy_version 225205 (0.0007) [2023-12-27 20:50:45,502][106226] Updated weights for policy 0, policy_version 225096 (0.0008) [2023-12-27 20:50:45,542][106225] Updated weights for policy 1, policy_version 225215 (0.0008) [2023-12-27 20:50:45,604][106225] Updated weights for policy 1, policy_version 225225 (0.0007) [2023-12-27 20:50:46,172][106225] Updated weights for policy 1, policy_version 225235 (0.0006) [2023-12-27 20:50:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 115310592. Throughput: 0: 9796.1, 1: 9988.3. Samples: 115305096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:46,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.734')] [2023-12-27 20:50:46,229][106225] Updated weights for policy 1, policy_version 225245 (0.0008) [2023-12-27 20:50:46,260][106226] Updated weights for policy 0, policy_version 225106 (0.0008) [2023-12-27 20:50:46,282][106225] Updated weights for policy 1, policy_version 225255 (0.0007) [2023-12-27 20:50:46,320][106226] Updated weights for policy 0, policy_version 225116 (0.0008) [2023-12-27 20:50:46,373][106226] Updated weights for policy 0, policy_version 225126 (0.0008) [2023-12-27 20:50:46,891][106225] Updated weights for policy 1, policy_version 225265 (0.0007) [2023-12-27 20:50:46,954][106225] Updated weights for policy 1, policy_version 225275 (0.0007) [2023-12-27 20:50:47,012][106225] Updated weights for policy 1, policy_version 225285 (0.0005) [2023-12-27 20:50:47,065][106225] Updated weights for policy 1, policy_version 225295 (0.0005) [2023-12-27 20:50:47,162][106226] Updated weights for policy 0, policy_version 225136 (0.0008) [2023-12-27 20:50:47,220][106226] Updated weights for policy 0, policy_version 225146 (0.0008) [2023-12-27 20:50:47,285][106226] Updated weights for policy 0, policy_version 225156 (0.0008) [2023-12-27 20:50:47,641][106225] Updated weights for policy 1, policy_version 225305 (0.0005) [2023-12-27 20:50:47,712][106225] Updated weights for policy 1, policy_version 225315 (0.0005) [2023-12-27 20:50:47,762][106225] Updated weights for policy 1, policy_version 225325 (0.0005) [2023-12-27 20:50:48,084][106226] Updated weights for policy 0, policy_version 225166 (0.0008) [2023-12-27 20:50:48,136][106226] Updated weights for policy 0, policy_version 225176 (0.0008) [2023-12-27 20:50:48,194][106226] Updated weights for policy 0, policy_version 225186 (0.0008) [2023-12-27 20:50:48,361][106225] Updated weights for policy 1, policy_version 225335 (0.0006) [2023-12-27 20:50:48,426][106225] Updated weights for policy 1, policy_version 225345 (0.0008) [2023-12-27 20:50:48,485][106225] Updated weights for policy 1, policy_version 225355 (0.0007) [2023-12-27 20:50:48,971][106226] Updated weights for policy 0, policy_version 225196 (0.0008) [2023-12-27 20:50:49,019][106226] Updated weights for policy 0, policy_version 225206 (0.0005) [2023-12-27 20:50:49,066][106226] Updated weights for policy 0, policy_version 225216 (0.0005) [2023-12-27 20:50:49,123][106225] Updated weights for policy 1, policy_version 225365 (0.0008) [2023-12-27 20:50:49,180][106225] Updated weights for policy 1, policy_version 225375 (0.0008) [2023-12-27 20:50:49,245][106225] Updated weights for policy 1, policy_version 225385 (0.0008) [2023-12-27 20:50:49,807][106226] Updated weights for policy 0, policy_version 225226 (0.0007) [2023-12-27 20:50:49,877][106226] Updated weights for policy 0, policy_version 225236 (0.0008) [2023-12-27 20:50:49,887][106225] Updated weights for policy 1, policy_version 225395 (0.0008) [2023-12-27 20:50:49,948][106226] Updated weights for policy 0, policy_version 225246 (0.0007) [2023-12-27 20:50:49,950][106225] Updated weights for policy 1, policy_version 225405 (0.0008) [2023-12-27 20:50:50,012][106226] Updated weights for policy 0, policy_version 225256 (0.0007) [2023-12-27 20:50:50,012][106225] Updated weights for policy 1, policy_version 225415 (0.0007) [2023-12-27 20:50:50,670][106226] Updated weights for policy 0, policy_version 225266 (0.0007) [2023-12-27 20:50:50,726][106226] Updated weights for policy 0, policy_version 225276 (0.0008) [2023-12-27 20:50:50,739][106225] Updated weights for policy 1, policy_version 225425 (0.0007) [2023-12-27 20:50:50,782][106226] Updated weights for policy 0, policy_version 225286 (0.0007) [2023-12-27 20:50:50,800][106225] Updated weights for policy 1, policy_version 225435 (0.0006) [2023-12-27 20:50:50,869][106225] Updated weights for policy 1, policy_version 225445 (0.0007) [2023-12-27 20:50:50,933][106225] Updated weights for policy 1, policy_version 225455 (0.0009) [2023-12-27 20:50:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 115417088. Throughput: 0: 9706.8, 1: 10073.1. Samples: 115424648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:51,175][105115] Avg episode reward: [(0, '-4.979'), (1, '-5.618')] [2023-12-27 20:50:51,584][106226] Updated weights for policy 0, policy_version 225296 (0.0006) [2023-12-27 20:50:51,657][106226] Updated weights for policy 0, policy_version 225306 (0.0007) [2023-12-27 20:50:51,720][106226] Updated weights for policy 0, policy_version 225316 (0.0010) [2023-12-27 20:50:51,769][106225] Updated weights for policy 1, policy_version 225465 (0.0009) [2023-12-27 20:50:51,829][106225] Updated weights for policy 1, policy_version 225475 (0.0009) [2023-12-27 20:50:51,884][106225] Updated weights for policy 1, policy_version 225485 (0.0010) [2023-12-27 20:50:52,423][106226] Updated weights for policy 0, policy_version 225326 (0.0007) [2023-12-27 20:50:52,485][106226] Updated weights for policy 0, policy_version 225336 (0.0008) [2023-12-27 20:50:52,546][106226] Updated weights for policy 0, policy_version 225346 (0.0008) [2023-12-27 20:50:52,633][106225] Updated weights for policy 1, policy_version 225495 (0.0010) [2023-12-27 20:50:52,684][106225] Updated weights for policy 1, policy_version 225505 (0.0010) [2023-12-27 20:50:52,741][106225] Updated weights for policy 1, policy_version 225515 (0.0011) [2023-12-27 20:50:53,294][106226] Updated weights for policy 0, policy_version 225356 (0.0008) [2023-12-27 20:50:53,340][106226] Updated weights for policy 0, policy_version 225366 (0.0007) [2023-12-27 20:50:53,391][106226] Updated weights for policy 0, policy_version 225376 (0.0008) [2023-12-27 20:50:53,426][106225] Updated weights for policy 1, policy_version 225525 (0.0011) [2023-12-27 20:50:53,483][106225] Updated weights for policy 1, policy_version 225535 (0.0010) [2023-12-27 20:50:53,529][106225] Updated weights for policy 1, policy_version 225545 (0.0010) [2023-12-27 20:50:54,122][106226] Updated weights for policy 0, policy_version 225386 (0.0009) [2023-12-27 20:50:54,185][106226] Updated weights for policy 0, policy_version 225396 (0.0010) [2023-12-27 20:50:54,249][106226] Updated weights for policy 0, policy_version 225406 (0.0010) [2023-12-27 20:50:54,252][106225] Updated weights for policy 1, policy_version 225555 (0.0009) [2023-12-27 20:50:54,301][106225] Updated weights for policy 1, policy_version 225565 (0.0005) [2023-12-27 20:50:54,314][106226] Updated weights for policy 0, policy_version 225416 (0.0006) [2023-12-27 20:50:54,357][106225] Updated weights for policy 1, policy_version 225575 (0.0006) [2023-12-27 20:50:54,963][106226] Updated weights for policy 0, policy_version 225426 (0.0008) [2023-12-27 20:50:54,993][106225] Updated weights for policy 1, policy_version 225585 (0.0005) [2023-12-27 20:50:55,027][106226] Updated weights for policy 0, policy_version 225436 (0.0007) [2023-12-27 20:50:55,056][106225] Updated weights for policy 1, policy_version 225595 (0.0007) [2023-12-27 20:50:55,090][106226] Updated weights for policy 0, policy_version 225446 (0.0008) [2023-12-27 20:50:55,113][106225] Updated weights for policy 1, policy_version 225605 (0.0006) [2023-12-27 20:50:55,163][106225] Updated weights for policy 1, policy_version 225615 (0.0009) [2023-12-27 20:50:55,717][106226] Updated weights for policy 0, policy_version 225456 (0.0008) [2023-12-27 20:50:55,771][106226] Updated weights for policy 0, policy_version 225466 (0.0008) [2023-12-27 20:50:55,815][106225] Updated weights for policy 1, policy_version 225625 (0.0006) [2023-12-27 20:50:55,836][106226] Updated weights for policy 0, policy_version 225476 (0.0005) [2023-12-27 20:50:55,880][106225] Updated weights for policy 1, policy_version 225635 (0.0008) [2023-12-27 20:50:55,928][106225] Updated weights for policy 1, policy_version 225645 (0.0009) [2023-12-27 20:50:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 115515392. Throughput: 0: 9685.2, 1: 10052.1. Samples: 115481360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:50:56,176][105115] Avg episode reward: [(0, '-5.214'), (1, '-5.794')] [2023-12-27 20:50:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000225648_57778176.pth... [2023-12-27 20:50:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000225480_57737216.pth... [2023-12-27 20:50:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000224464_57475072.pth [2023-12-27 20:50:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000224328_57442304.pth [2023-12-27 20:50:56,495][106226] Updated weights for policy 0, policy_version 225486 (0.0008) [2023-12-27 20:50:56,551][106226] Updated weights for policy 0, policy_version 225496 (0.0009) [2023-12-27 20:50:56,577][106225] Updated weights for policy 1, policy_version 225655 (0.0006) [2023-12-27 20:50:56,599][106226] Updated weights for policy 0, policy_version 225506 (0.0006) [2023-12-27 20:50:56,632][106225] Updated weights for policy 1, policy_version 225665 (0.0006) [2023-12-27 20:50:56,690][106225] Updated weights for policy 1, policy_version 225675 (0.0008) [2023-12-27 20:50:57,274][106226] Updated weights for policy 0, policy_version 225516 (0.0007) [2023-12-27 20:50:57,336][106226] Updated weights for policy 0, policy_version 225526 (0.0008) [2023-12-27 20:50:57,389][106225] Updated weights for policy 1, policy_version 225685 (0.0007) [2023-12-27 20:50:57,394][106226] Updated weights for policy 0, policy_version 225536 (0.0008) [2023-12-27 20:50:57,448][106225] Updated weights for policy 1, policy_version 225695 (0.0007) [2023-12-27 20:50:57,506][106225] Updated weights for policy 1, policy_version 225705 (0.0008) [2023-12-27 20:50:58,098][106226] Updated weights for policy 0, policy_version 225546 (0.0007) [2023-12-27 20:50:58,155][106226] Updated weights for policy 0, policy_version 225556 (0.0010) [2023-12-27 20:50:58,219][106225] Updated weights for policy 1, policy_version 225715 (0.0008) [2023-12-27 20:50:58,236][106226] Updated weights for policy 0, policy_version 225566 (0.0008) [2023-12-27 20:50:58,280][106225] Updated weights for policy 1, policy_version 225725 (0.0008) [2023-12-27 20:50:58,297][106226] Updated weights for policy 0, policy_version 225576 (0.0009) [2023-12-27 20:50:58,348][106225] Updated weights for policy 1, policy_version 225735 (0.0008) [2023-12-27 20:50:59,102][106225] Updated weights for policy 1, policy_version 225745 (0.0008) [2023-12-27 20:50:59,146][106226] Updated weights for policy 0, policy_version 225586 (0.0006) [2023-12-27 20:50:59,167][106225] Updated weights for policy 1, policy_version 225755 (0.0007) [2023-12-27 20:50:59,207][106226] Updated weights for policy 0, policy_version 225596 (0.0006) [2023-12-27 20:50:59,255][106225] Updated weights for policy 1, policy_version 225765 (0.0007) [2023-12-27 20:50:59,279][106226] Updated weights for policy 0, policy_version 225606 (0.0008) [2023-12-27 20:50:59,316][106225] Updated weights for policy 1, policy_version 225775 (0.0007) [2023-12-27 20:50:59,990][106225] Updated weights for policy 1, policy_version 225785 (0.0006) [2023-12-27 20:51:00,053][106225] Updated weights for policy 1, policy_version 225795 (0.0006) [2023-12-27 20:51:00,063][106226] Updated weights for policy 0, policy_version 225616 (0.0008) [2023-12-27 20:51:00,110][106225] Updated weights for policy 1, policy_version 225805 (0.0008) [2023-12-27 20:51:00,127][106226] Updated weights for policy 0, policy_version 225626 (0.0008) [2023-12-27 20:51:00,185][106226] Updated weights for policy 0, policy_version 225636 (0.0008) [2023-12-27 20:51:00,840][106226] Updated weights for policy 0, policy_version 225646 (0.0008) [2023-12-27 20:51:00,842][106225] Updated weights for policy 1, policy_version 225815 (0.0007) [2023-12-27 20:51:00,894][106226] Updated weights for policy 0, policy_version 225656 (0.0006) [2023-12-27 20:51:00,899][106225] Updated weights for policy 1, policy_version 225825 (0.0006) [2023-12-27 20:51:00,950][106226] Updated weights for policy 0, policy_version 225666 (0.0007) [2023-12-27 20:51:00,953][106225] Updated weights for policy 1, policy_version 225835 (0.0007) [2023-12-27 20:51:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 115613696. Throughput: 0: 9727.4, 1: 10123.5. Samples: 115599716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:01,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-6.079')] [2023-12-27 20:51:01,671][106226] Updated weights for policy 0, policy_version 225676 (0.0008) [2023-12-27 20:51:01,716][106225] Updated weights for policy 1, policy_version 225845 (0.0008) [2023-12-27 20:51:01,736][106226] Updated weights for policy 0, policy_version 225686 (0.0007) [2023-12-27 20:51:01,783][106225] Updated weights for policy 1, policy_version 225855 (0.0008) [2023-12-27 20:51:01,800][106226] Updated weights for policy 0, policy_version 225696 (0.0009) [2023-12-27 20:51:01,844][106225] Updated weights for policy 1, policy_version 225865 (0.0008) [2023-12-27 20:51:02,479][106226] Updated weights for policy 0, policy_version 225706 (0.0006) [2023-12-27 20:51:02,530][106226] Updated weights for policy 0, policy_version 225716 (0.0008) [2023-12-27 20:51:02,583][106226] Updated weights for policy 0, policy_version 225726 (0.0007) [2023-12-27 20:51:02,625][106225] Updated weights for policy 1, policy_version 225875 (0.0008) [2023-12-27 20:51:02,637][106226] Updated weights for policy 0, policy_version 225736 (0.0008) [2023-12-27 20:51:02,685][106225] Updated weights for policy 1, policy_version 225885 (0.0009) [2023-12-27 20:51:02,742][106225] Updated weights for policy 1, policy_version 225895 (0.0010) [2023-12-27 20:51:03,357][106225] Updated weights for policy 1, policy_version 225905 (0.0010) [2023-12-27 20:51:03,370][106226] Updated weights for policy 0, policy_version 225746 (0.0008) [2023-12-27 20:51:03,412][106225] Updated weights for policy 1, policy_version 225915 (0.0007) [2023-12-27 20:51:03,428][106226] Updated weights for policy 0, policy_version 225756 (0.0009) [2023-12-27 20:51:03,460][106225] Updated weights for policy 1, policy_version 225925 (0.0008) [2023-12-27 20:51:03,482][106226] Updated weights for policy 0, policy_version 225766 (0.0007) [2023-12-27 20:51:03,510][106225] Updated weights for policy 1, policy_version 225935 (0.0010) [2023-12-27 20:51:04,197][106226] Updated weights for policy 0, policy_version 225776 (0.0006) [2023-12-27 20:51:04,234][106225] Updated weights for policy 1, policy_version 225945 (0.0011) [2023-12-27 20:51:04,266][106226] Updated weights for policy 0, policy_version 225786 (0.0008) [2023-12-27 20:51:04,297][106225] Updated weights for policy 1, policy_version 225955 (0.0010) [2023-12-27 20:51:04,336][106226] Updated weights for policy 0, policy_version 225796 (0.0009) [2023-12-27 20:51:04,363][106225] Updated weights for policy 1, policy_version 225965 (0.0006) [2023-12-27 20:51:04,957][106225] Updated weights for policy 1, policy_version 225975 (0.0006) [2023-12-27 20:51:05,014][106225] Updated weights for policy 1, policy_version 225985 (0.0010) [2023-12-27 20:51:05,032][106226] Updated weights for policy 0, policy_version 225806 (0.0007) [2023-12-27 20:51:05,067][106225] Updated weights for policy 1, policy_version 225995 (0.0010) [2023-12-27 20:51:05,085][106226] Updated weights for policy 0, policy_version 225816 (0.0007) [2023-12-27 20:51:05,137][106226] Updated weights for policy 0, policy_version 225826 (0.0008) [2023-12-27 20:51:05,623][106225] Updated weights for policy 1, policy_version 226005 (0.0006) [2023-12-27 20:51:05,675][106225] Updated weights for policy 1, policy_version 226015 (0.0006) [2023-12-27 20:51:05,719][106225] Updated weights for policy 1, policy_version 226025 (0.0005) [2023-12-27 20:51:05,900][106226] Updated weights for policy 0, policy_version 225836 (0.0008) [2023-12-27 20:51:05,958][106226] Updated weights for policy 0, policy_version 225846 (0.0005) [2023-12-27 20:51:06,028][106226] Updated weights for policy 0, policy_version 225857 (0.0011) [2023-12-27 20:51:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 115712000. Throughput: 0: 9744.4, 1: 10108.3. Samples: 115719572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:06,176][105115] Avg episode reward: [(0, '-4.902'), (1, '-5.968')] [2023-12-27 20:51:06,333][106225] Updated weights for policy 1, policy_version 226035 (0.0007) [2023-12-27 20:51:06,396][106225] Updated weights for policy 1, policy_version 226045 (0.0011) [2023-12-27 20:51:06,458][106225] Updated weights for policy 1, policy_version 226055 (0.0010) [2023-12-27 20:51:06,755][106226] Updated weights for policy 0, policy_version 225867 (0.0007) [2023-12-27 20:51:06,805][106226] Updated weights for policy 0, policy_version 225877 (0.0007) [2023-12-27 20:51:06,858][106226] Updated weights for policy 0, policy_version 225887 (0.0008) [2023-12-27 20:51:07,180][106225] Updated weights for policy 1, policy_version 226065 (0.0010) [2023-12-27 20:51:07,250][106225] Updated weights for policy 1, policy_version 226075 (0.0005) [2023-12-27 20:51:07,315][106225] Updated weights for policy 1, policy_version 226085 (0.0005) [2023-12-27 20:51:07,381][106225] Updated weights for policy 1, policy_version 226095 (0.0005) [2023-12-27 20:51:07,605][106226] Updated weights for policy 0, policy_version 225897 (0.0007) [2023-12-27 20:51:07,662][106226] Updated weights for policy 0, policy_version 225907 (0.0008) [2023-12-27 20:51:07,719][106226] Updated weights for policy 0, policy_version 225917 (0.0008) [2023-12-27 20:51:07,771][106226] Updated weights for policy 0, policy_version 225927 (0.0008) [2023-12-27 20:51:07,939][106225] Updated weights for policy 1, policy_version 226105 (0.0010) [2023-12-27 20:51:07,985][106225] Updated weights for policy 1, policy_version 226115 (0.0010) [2023-12-27 20:51:08,038][106225] Updated weights for policy 1, policy_version 226125 (0.0010) [2023-12-27 20:51:08,531][106226] Updated weights for policy 0, policy_version 225937 (0.0008) [2023-12-27 20:51:08,594][106226] Updated weights for policy 0, policy_version 225947 (0.0008) [2023-12-27 20:51:08,656][106226] Updated weights for policy 0, policy_version 225957 (0.0008) [2023-12-27 20:51:08,798][106225] Updated weights for policy 1, policy_version 226135 (0.0011) [2023-12-27 20:51:08,852][106225] Updated weights for policy 1, policy_version 226145 (0.0010) [2023-12-27 20:51:08,911][106225] Updated weights for policy 1, policy_version 226155 (0.0009) [2023-12-27 20:51:09,397][106226] Updated weights for policy 0, policy_version 225967 (0.0008) [2023-12-27 20:51:09,467][106226] Updated weights for policy 0, policy_version 225977 (0.0008) [2023-12-27 20:51:09,534][106226] Updated weights for policy 0, policy_version 225987 (0.0009) [2023-12-27 20:51:09,678][106225] Updated weights for policy 1, policy_version 226165 (0.0007) [2023-12-27 20:51:09,741][106225] Updated weights for policy 1, policy_version 226175 (0.0008) [2023-12-27 20:51:09,803][106225] Updated weights for policy 1, policy_version 226185 (0.0007) [2023-12-27 20:51:10,267][106226] Updated weights for policy 0, policy_version 225997 (0.0008) [2023-12-27 20:51:10,330][106226] Updated weights for policy 0, policy_version 226007 (0.0008) [2023-12-27 20:51:10,397][106226] Updated weights for policy 0, policy_version 226017 (0.0006) [2023-12-27 20:51:10,604][106225] Updated weights for policy 1, policy_version 226195 (0.0008) [2023-12-27 20:51:10,665][106225] Updated weights for policy 1, policy_version 226205 (0.0008) [2023-12-27 20:51:10,721][106225] Updated weights for policy 1, policy_version 226215 (0.0008) [2023-12-27 20:51:10,986][106226] Updated weights for policy 0, policy_version 226027 (0.0006) [2023-12-27 20:51:11,049][106226] Updated weights for policy 0, policy_version 226037 (0.0007) [2023-12-27 20:51:11,112][106226] Updated weights for policy 0, policy_version 226047 (0.0008) [2023-12-27 20:51:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 115810304. Throughput: 0: 9726.6, 1: 10131.2. Samples: 115778540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:11,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-5.841')] [2023-12-27 20:51:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000226056_57884672.pth... [2023-12-27 20:51:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000226224_57925632.pth... [2023-12-27 20:51:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000224936_57597952.pth [2023-12-27 20:51:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000225040_57622528.pth [2023-12-27 20:51:11,480][106225] Updated weights for policy 1, policy_version 226225 (0.0008) [2023-12-27 20:51:11,549][106225] Updated weights for policy 1, policy_version 226235 (0.0010) [2023-12-27 20:51:11,611][106225] Updated weights for policy 1, policy_version 226245 (0.0009) [2023-12-27 20:51:11,684][106225] Updated weights for policy 1, policy_version 226255 (0.0009) [2023-12-27 20:51:11,807][106226] Updated weights for policy 0, policy_version 226057 (0.0008) [2023-12-27 20:51:11,865][106226] Updated weights for policy 0, policy_version 226067 (0.0009) [2023-12-27 20:51:11,918][106226] Updated weights for policy 0, policy_version 226077 (0.0008) [2023-12-27 20:51:11,984][106226] Updated weights for policy 0, policy_version 226087 (0.0009) [2023-12-27 20:51:12,439][106225] Updated weights for policy 1, policy_version 226265 (0.0009) [2023-12-27 20:51:12,493][106225] Updated weights for policy 1, policy_version 226275 (0.0009) [2023-12-27 20:51:12,553][106225] Updated weights for policy 1, policy_version 226285 (0.0009) [2023-12-27 20:51:12,739][106226] Updated weights for policy 0, policy_version 226097 (0.0008) [2023-12-27 20:51:12,800][106226] Updated weights for policy 0, policy_version 226107 (0.0009) [2023-12-27 20:51:12,872][106226] Updated weights for policy 0, policy_version 226117 (0.0007) [2023-12-27 20:51:13,337][106225] Updated weights for policy 1, policy_version 226295 (0.0009) [2023-12-27 20:51:13,399][106225] Updated weights for policy 1, policy_version 226305 (0.0008) [2023-12-27 20:51:13,455][106225] Updated weights for policy 1, policy_version 226315 (0.0008) [2023-12-27 20:51:13,598][106226] Updated weights for policy 0, policy_version 226127 (0.0008) [2023-12-27 20:51:13,661][106226] Updated weights for policy 0, policy_version 226137 (0.0009) [2023-12-27 20:51:13,717][106226] Updated weights for policy 0, policy_version 226147 (0.0009) [2023-12-27 20:51:14,096][106225] Updated weights for policy 1, policy_version 226325 (0.0008) [2023-12-27 20:51:14,159][106225] Updated weights for policy 1, policy_version 226335 (0.0009) [2023-12-27 20:51:14,226][106225] Updated weights for policy 1, policy_version 226345 (0.0008) [2023-12-27 20:51:14,466][106226] Updated weights for policy 0, policy_version 226157 (0.0008) [2023-12-27 20:51:14,524][106226] Updated weights for policy 0, policy_version 226167 (0.0010) [2023-12-27 20:51:14,572][106226] Updated weights for policy 0, policy_version 226177 (0.0008) [2023-12-27 20:51:14,925][106225] Updated weights for policy 1, policy_version 226355 (0.0007) [2023-12-27 20:51:14,989][106225] Updated weights for policy 1, policy_version 226365 (0.0008) [2023-12-27 20:51:15,053][106225] Updated weights for policy 1, policy_version 226375 (0.0008) [2023-12-27 20:51:15,347][106226] Updated weights for policy 0, policy_version 226187 (0.0009) [2023-12-27 20:51:15,403][106226] Updated weights for policy 0, policy_version 226197 (0.0007) [2023-12-27 20:51:15,461][106226] Updated weights for policy 0, policy_version 226207 (0.0008) [2023-12-27 20:51:15,742][106225] Updated weights for policy 1, policy_version 226385 (0.0007) [2023-12-27 20:51:15,802][106225] Updated weights for policy 1, policy_version 226395 (0.0006) [2023-12-27 20:51:15,856][106225] Updated weights for policy 1, policy_version 226405 (0.0010) [2023-12-27 20:51:15,909][106225] Updated weights for policy 1, policy_version 226415 (0.0010) [2023-12-27 20:51:16,136][106226] Updated weights for policy 0, policy_version 226217 (0.0008) [2023-12-27 20:51:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 115900416. Throughput: 0: 9679.5, 1: 10005.3. Samples: 115892328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:16,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.742')] [2023-12-27 20:51:16,194][106226] Updated weights for policy 0, policy_version 226227 (0.0008) [2023-12-27 20:51:16,243][106226] Updated weights for policy 0, policy_version 226237 (0.0008) [2023-12-27 20:51:16,305][106226] Updated weights for policy 0, policy_version 226247 (0.0008) [2023-12-27 20:51:16,618][106225] Updated weights for policy 1, policy_version 226425 (0.0010) [2023-12-27 20:51:16,679][106225] Updated weights for policy 1, policy_version 226435 (0.0005) [2023-12-27 20:51:16,743][106225] Updated weights for policy 1, policy_version 226445 (0.0005) [2023-12-27 20:51:17,045][106226] Updated weights for policy 0, policy_version 226257 (0.0008) [2023-12-27 20:51:17,093][106226] Updated weights for policy 0, policy_version 226267 (0.0007) [2023-12-27 20:51:17,141][106226] Updated weights for policy 0, policy_version 226277 (0.0007) [2023-12-27 20:51:17,389][106225] Updated weights for policy 1, policy_version 226455 (0.0009) [2023-12-27 20:51:17,451][106225] Updated weights for policy 1, policy_version 226465 (0.0010) [2023-12-27 20:51:17,501][106225] Updated weights for policy 1, policy_version 226475 (0.0005) [2023-12-27 20:51:17,836][106226] Updated weights for policy 0, policy_version 226287 (0.0006) [2023-12-27 20:51:17,905][106226] Updated weights for policy 0, policy_version 226297 (0.0005) [2023-12-27 20:51:17,973][106226] Updated weights for policy 0, policy_version 226307 (0.0005) [2023-12-27 20:51:18,087][106225] Updated weights for policy 1, policy_version 226485 (0.0007) [2023-12-27 20:51:18,152][106225] Updated weights for policy 1, policy_version 226495 (0.0008) [2023-12-27 20:51:18,222][106225] Updated weights for policy 1, policy_version 226505 (0.0008) [2023-12-27 20:51:18,549][106226] Updated weights for policy 0, policy_version 226317 (0.0008) [2023-12-27 20:51:18,601][106226] Updated weights for policy 0, policy_version 226327 (0.0007) [2023-12-27 20:51:18,656][106226] Updated weights for policy 0, policy_version 226337 (0.0010) [2023-12-27 20:51:18,818][106225] Updated weights for policy 1, policy_version 226515 (0.0007) [2023-12-27 20:51:18,871][106225] Updated weights for policy 1, policy_version 226525 (0.0008) [2023-12-27 20:51:18,934][106225] Updated weights for policy 1, policy_version 226535 (0.0009) [2023-12-27 20:51:19,415][106226] Updated weights for policy 0, policy_version 226347 (0.0010) [2023-12-27 20:51:19,465][106226] Updated weights for policy 0, policy_version 226357 (0.0010) [2023-12-27 20:51:19,532][106226] Updated weights for policy 0, policy_version 226367 (0.0011) [2023-12-27 20:51:19,689][106225] Updated weights for policy 1, policy_version 226545 (0.0010) [2023-12-27 20:51:19,755][106225] Updated weights for policy 1, policy_version 226555 (0.0010) [2023-12-27 20:51:19,816][106225] Updated weights for policy 1, policy_version 226565 (0.0010) [2023-12-27 20:51:19,884][106225] Updated weights for policy 1, policy_version 226575 (0.0010) [2023-12-27 20:51:20,198][106226] Updated weights for policy 0, policy_version 226377 (0.0008) [2023-12-27 20:51:20,262][106226] Updated weights for policy 0, policy_version 226387 (0.0011) [2023-12-27 20:51:20,324][106226] Updated weights for policy 0, policy_version 226397 (0.0011) [2023-12-27 20:51:20,388][106226] Updated weights for policy 0, policy_version 226407 (0.0005) [2023-12-27 20:51:20,632][106225] Updated weights for policy 1, policy_version 226585 (0.0010) [2023-12-27 20:51:20,689][106225] Updated weights for policy 1, policy_version 226595 (0.0010) [2023-12-27 20:51:20,753][106225] Updated weights for policy 1, policy_version 226605 (0.0011) [2023-12-27 20:51:21,064][106226] Updated weights for policy 0, policy_version 226417 (0.0009) [2023-12-27 20:51:21,122][106226] Updated weights for policy 0, policy_version 226427 (0.0009) [2023-12-27 20:51:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 115998720. Throughput: 0: 9655.4, 1: 10002.3. Samples: 116013004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:21,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-6.004')] [2023-12-27 20:51:21,186][106226] Updated weights for policy 0, policy_version 226437 (0.0009) [2023-12-27 20:51:21,520][106225] Updated weights for policy 1, policy_version 226615 (0.0009) [2023-12-27 20:51:21,573][106225] Updated weights for policy 1, policy_version 226625 (0.0008) [2023-12-27 20:51:21,637][106225] Updated weights for policy 1, policy_version 226635 (0.0009) [2023-12-27 20:51:22,031][106226] Updated weights for policy 0, policy_version 226447 (0.0009) [2023-12-27 20:51:22,098][106226] Updated weights for policy 0, policy_version 226457 (0.0008) [2023-12-27 20:51:22,157][106226] Updated weights for policy 0, policy_version 226467 (0.0008) [2023-12-27 20:51:22,417][106225] Updated weights for policy 1, policy_version 226645 (0.0010) [2023-12-27 20:51:22,475][106225] Updated weights for policy 1, policy_version 226655 (0.0010) [2023-12-27 20:51:22,545][106225] Updated weights for policy 1, policy_version 226665 (0.0010) [2023-12-27 20:51:22,846][106226] Updated weights for policy 0, policy_version 226477 (0.0007) [2023-12-27 20:51:22,911][106226] Updated weights for policy 0, policy_version 226487 (0.0007) [2023-12-27 20:51:22,967][106226] Updated weights for policy 0, policy_version 226497 (0.0008) [2023-12-27 20:51:23,253][106225] Updated weights for policy 1, policy_version 226675 (0.0010) [2023-12-27 20:51:23,306][106225] Updated weights for policy 1, policy_version 226685 (0.0010) [2023-12-27 20:51:23,356][106225] Updated weights for policy 1, policy_version 226695 (0.0010) [2023-12-27 20:51:23,562][106226] Updated weights for policy 0, policy_version 226507 (0.0008) [2023-12-27 20:51:23,626][106226] Updated weights for policy 0, policy_version 226517 (0.0007) [2023-12-27 20:51:23,691][106226] Updated weights for policy 0, policy_version 226527 (0.0008) [2023-12-27 20:51:23,993][106225] Updated weights for policy 1, policy_version 226705 (0.0010) [2023-12-27 20:51:24,055][106225] Updated weights for policy 1, policy_version 226715 (0.0009) [2023-12-27 20:51:24,112][106225] Updated weights for policy 1, policy_version 226725 (0.0010) [2023-12-27 20:51:24,169][106225] Updated weights for policy 1, policy_version 226735 (0.0010) [2023-12-27 20:51:24,369][106226] Updated weights for policy 0, policy_version 226537 (0.0007) [2023-12-27 20:51:24,428][106226] Updated weights for policy 0, policy_version 226547 (0.0008) [2023-12-27 20:51:24,489][106226] Updated weights for policy 0, policy_version 226557 (0.0007) [2023-12-27 20:51:24,546][106226] Updated weights for policy 0, policy_version 226567 (0.0005) [2023-12-27 20:51:24,756][106225] Updated weights for policy 1, policy_version 226745 (0.0010) [2023-12-27 20:51:24,814][106225] Updated weights for policy 1, policy_version 226755 (0.0010) [2023-12-27 20:51:24,866][106225] Updated weights for policy 1, policy_version 226765 (0.0010) [2023-12-27 20:51:25,244][106226] Updated weights for policy 0, policy_version 226577 (0.0010) [2023-12-27 20:51:25,295][106226] Updated weights for policy 0, policy_version 226587 (0.0010) [2023-12-27 20:51:25,351][106226] Updated weights for policy 0, policy_version 226597 (0.0010) [2023-12-27 20:51:25,466][106225] Updated weights for policy 1, policy_version 226775 (0.0007) [2023-12-27 20:51:25,515][106225] Updated weights for policy 1, policy_version 226785 (0.0006) [2023-12-27 20:51:25,567][106225] Updated weights for policy 1, policy_version 226795 (0.0005) [2023-12-27 20:51:25,995][106226] Updated weights for policy 0, policy_version 226607 (0.0010) [2023-12-27 20:51:26,062][106226] Updated weights for policy 0, policy_version 226617 (0.0011) [2023-12-27 20:51:26,113][106225] Updated weights for policy 1, policy_version 226805 (0.0005) [2023-12-27 20:51:26,129][106226] Updated weights for policy 0, policy_version 226627 (0.0011) [2023-12-27 20:51:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 116105216. Throughput: 0: 9622.4, 1: 9928.7. Samples: 116069740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:26,175][105115] Avg episode reward: [(0, '-5.162'), (1, '-6.235')] [2023-12-27 20:51:26,177][106225] Updated weights for policy 1, policy_version 226815 (0.0005) [2023-12-27 20:51:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000226632_58032128.pth... [2023-12-27 20:51:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000225480_57737216.pth [2023-12-27 20:51:26,249][106225] Updated weights for policy 1, policy_version 226825 (0.0005) [2023-12-27 20:51:26,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000226832_58081280.pth... [2023-12-27 20:51:26,289][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000225648_57778176.pth [2023-12-27 20:51:26,822][106226] Updated weights for policy 0, policy_version 226637 (0.0011) [2023-12-27 20:51:26,824][106225] Updated weights for policy 1, policy_version 226835 (0.0006) [2023-12-27 20:51:26,875][106226] Updated weights for policy 0, policy_version 226647 (0.0010) [2023-12-27 20:51:26,877][106225] Updated weights for policy 1, policy_version 226845 (0.0006) [2023-12-27 20:51:26,924][106226] Updated weights for policy 0, policy_version 226657 (0.0010) [2023-12-27 20:51:26,930][106225] Updated weights for policy 1, policy_version 226855 (0.0005) [2023-12-27 20:51:27,574][106225] Updated weights for policy 1, policy_version 226865 (0.0006) [2023-12-27 20:51:27,579][106226] Updated weights for policy 0, policy_version 226667 (0.0009) [2023-12-27 20:51:27,622][106225] Updated weights for policy 1, policy_version 226875 (0.0005) [2023-12-27 20:51:27,625][106226] Updated weights for policy 0, policy_version 226677 (0.0005) [2023-12-27 20:51:27,671][106226] Updated weights for policy 0, policy_version 226687 (0.0005) [2023-12-27 20:51:27,679][106225] Updated weights for policy 1, policy_version 226885 (0.0005) [2023-12-27 20:51:27,733][106225] Updated weights for policy 1, policy_version 226895 (0.0008) [2023-12-27 20:51:28,343][106226] Updated weights for policy 0, policy_version 226697 (0.0006) [2023-12-27 20:51:28,407][106226] Updated weights for policy 0, policy_version 226707 (0.0009) [2023-12-27 20:51:28,433][106225] Updated weights for policy 1, policy_version 226905 (0.0009) [2023-12-27 20:51:28,465][106226] Updated weights for policy 0, policy_version 226717 (0.0010) [2023-12-27 20:51:28,490][106225] Updated weights for policy 1, policy_version 226915 (0.0010) [2023-12-27 20:51:28,518][106226] Updated weights for policy 0, policy_version 226727 (0.0010) [2023-12-27 20:51:28,548][106225] Updated weights for policy 1, policy_version 226925 (0.0010) [2023-12-27 20:51:29,137][106225] Updated weights for policy 1, policy_version 226935 (0.0007) [2023-12-27 20:51:29,195][106225] Updated weights for policy 1, policy_version 226945 (0.0007) [2023-12-27 20:51:29,208][106226] Updated weights for policy 0, policy_version 226737 (0.0010) [2023-12-27 20:51:29,258][106225] Updated weights for policy 1, policy_version 226955 (0.0010) [2023-12-27 20:51:29,267][106226] Updated weights for policy 0, policy_version 226747 (0.0008) [2023-12-27 20:51:29,321][106226] Updated weights for policy 0, policy_version 226757 (0.0008) [2023-12-27 20:51:29,857][106225] Updated weights for policy 1, policy_version 226965 (0.0009) [2023-12-27 20:51:29,910][106225] Updated weights for policy 1, policy_version 226975 (0.0009) [2023-12-27 20:51:29,973][106225] Updated weights for policy 1, policy_version 226985 (0.0008) [2023-12-27 20:51:30,060][106226] Updated weights for policy 0, policy_version 226767 (0.0010) [2023-12-27 20:51:30,124][106226] Updated weights for policy 0, policy_version 226777 (0.0010) [2023-12-27 20:51:30,188][106226] Updated weights for policy 0, policy_version 226787 (0.0010) [2023-12-27 20:51:30,691][106225] Updated weights for policy 1, policy_version 226995 (0.0007) [2023-12-27 20:51:30,743][106225] Updated weights for policy 1, policy_version 227005 (0.0007) [2023-12-27 20:51:30,797][106225] Updated weights for policy 1, policy_version 227015 (0.0008) [2023-12-27 20:51:30,911][106226] Updated weights for policy 0, policy_version 226797 (0.0010) [2023-12-27 20:51:30,967][106226] Updated weights for policy 0, policy_version 226807 (0.0010) [2023-12-27 20:51:31,017][106226] Updated weights for policy 0, policy_version 226817 (0.0010) [2023-12-27 20:51:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 116211712. Throughput: 0: 9711.9, 1: 10148.7. Samples: 116198824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:31,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-5.994')] [2023-12-27 20:51:31,493][106225] Updated weights for policy 1, policy_version 227025 (0.0007) [2023-12-27 20:51:31,540][106225] Updated weights for policy 1, policy_version 227035 (0.0008) [2023-12-27 20:51:31,594][106225] Updated weights for policy 1, policy_version 227045 (0.0007) [2023-12-27 20:51:31,655][106225] Updated weights for policy 1, policy_version 227055 (0.0007) [2023-12-27 20:51:31,744][106226] Updated weights for policy 0, policy_version 226827 (0.0009) [2023-12-27 20:51:31,806][106226] Updated weights for policy 0, policy_version 226837 (0.0006) [2023-12-27 20:51:31,875][106226] Updated weights for policy 0, policy_version 226847 (0.0008) [2023-12-27 20:51:32,304][106225] Updated weights for policy 1, policy_version 227065 (0.0007) [2023-12-27 20:51:32,363][106225] Updated weights for policy 1, policy_version 227075 (0.0007) [2023-12-27 20:51:32,427][106225] Updated weights for policy 1, policy_version 227085 (0.0007) [2023-12-27 20:51:32,593][106226] Updated weights for policy 0, policy_version 226857 (0.0011) [2023-12-27 20:51:32,646][106226] Updated weights for policy 0, policy_version 226867 (0.0006) [2023-12-27 20:51:32,701][106226] Updated weights for policy 0, policy_version 226877 (0.0006) [2023-12-27 20:51:32,754][106226] Updated weights for policy 0, policy_version 226887 (0.0009) [2023-12-27 20:51:33,188][106225] Updated weights for policy 1, policy_version 227095 (0.0008) [2023-12-27 20:51:33,235][106225] Updated weights for policy 1, policy_version 227105 (0.0008) [2023-12-27 20:51:33,295][106225] Updated weights for policy 1, policy_version 227115 (0.0008) [2023-12-27 20:51:33,361][106226] Updated weights for policy 0, policy_version 226897 (0.0008) [2023-12-27 20:51:33,422][106226] Updated weights for policy 0, policy_version 226907 (0.0006) [2023-12-27 20:51:33,474][106226] Updated weights for policy 0, policy_version 226917 (0.0007) [2023-12-27 20:51:34,031][106226] Updated weights for policy 0, policy_version 226927 (0.0008) [2023-12-27 20:51:34,089][106226] Updated weights for policy 0, policy_version 226937 (0.0008) [2023-12-27 20:51:34,093][106225] Updated weights for policy 1, policy_version 227125 (0.0006) [2023-12-27 20:51:34,152][106226] Updated weights for policy 0, policy_version 226947 (0.0008) [2023-12-27 20:51:34,155][106225] Updated weights for policy 1, policy_version 227135 (0.0009) [2023-12-27 20:51:34,218][106225] Updated weights for policy 1, policy_version 227145 (0.0007) [2023-12-27 20:51:34,884][106226] Updated weights for policy 0, policy_version 226957 (0.0007) [2023-12-27 20:51:34,922][106225] Updated weights for policy 1, policy_version 227155 (0.0007) [2023-12-27 20:51:34,932][106226] Updated weights for policy 0, policy_version 226967 (0.0007) [2023-12-27 20:51:34,992][106226] Updated weights for policy 0, policy_version 226977 (0.0008) [2023-12-27 20:51:34,994][106225] Updated weights for policy 1, policy_version 227165 (0.0008) [2023-12-27 20:51:35,043][106225] Updated weights for policy 1, policy_version 227175 (0.0007) [2023-12-27 20:51:35,648][106225] Updated weights for policy 1, policy_version 227185 (0.0008) [2023-12-27 20:51:35,696][106225] Updated weights for policy 1, policy_version 227195 (0.0005) [2023-12-27 20:51:35,741][106225] Updated weights for policy 1, policy_version 227205 (0.0005) [2023-12-27 20:51:35,787][106226] Updated weights for policy 0, policy_version 226987 (0.0006) [2023-12-27 20:51:35,794][106225] Updated weights for policy 1, policy_version 227215 (0.0005) [2023-12-27 20:51:35,852][106226] Updated weights for policy 0, policy_version 226998 (0.0010) [2023-12-27 20:51:35,903][106226] Updated weights for policy 0, policy_version 227008 (0.0006) [2023-12-27 20:51:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 116310016. Throughput: 0: 9818.3, 1: 10036.0. Samples: 116318092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:36,175][105115] Avg episode reward: [(0, '-5.044'), (1, '-5.986')] [2023-12-27 20:51:36,413][106225] Updated weights for policy 1, policy_version 227225 (0.0009) [2023-12-27 20:51:36,475][106225] Updated weights for policy 1, policy_version 227235 (0.0010) [2023-12-27 20:51:36,535][106225] Updated weights for policy 1, policy_version 227245 (0.0007) [2023-12-27 20:51:36,632][106226] Updated weights for policy 0, policy_version 227018 (0.0010) [2023-12-27 20:51:36,687][106226] Updated weights for policy 0, policy_version 227028 (0.0010) [2023-12-27 20:51:36,738][106226] Updated weights for policy 0, policy_version 227038 (0.0010) [2023-12-27 20:51:36,794][106226] Updated weights for policy 0, policy_version 227048 (0.0005) [2023-12-27 20:51:37,224][106225] Updated weights for policy 1, policy_version 227255 (0.0008) [2023-12-27 20:51:37,274][106225] Updated weights for policy 1, policy_version 227265 (0.0006) [2023-12-27 20:51:37,324][106225] Updated weights for policy 1, policy_version 227275 (0.0007) [2023-12-27 20:51:37,504][106226] Updated weights for policy 0, policy_version 227058 (0.0008) [2023-12-27 20:51:37,564][106226] Updated weights for policy 0, policy_version 227068 (0.0009) [2023-12-27 20:51:37,623][106226] Updated weights for policy 0, policy_version 227078 (0.0007) [2023-12-27 20:51:37,970][106225] Updated weights for policy 1, policy_version 227285 (0.0005) [2023-12-27 20:51:38,026][106225] Updated weights for policy 1, policy_version 227295 (0.0007) [2023-12-27 20:51:38,091][106225] Updated weights for policy 1, policy_version 227305 (0.0008) [2023-12-27 20:51:38,271][106226] Updated weights for policy 0, policy_version 227088 (0.0005) [2023-12-27 20:51:38,346][106226] Updated weights for policy 0, policy_version 227098 (0.0008) [2023-12-27 20:51:38,407][106226] Updated weights for policy 0, policy_version 227108 (0.0009) [2023-12-27 20:51:38,760][106225] Updated weights for policy 1, policy_version 227315 (0.0008) [2023-12-27 20:51:38,825][106225] Updated weights for policy 1, policy_version 227325 (0.0009) [2023-12-27 20:51:38,882][106225] Updated weights for policy 1, policy_version 227335 (0.0009) [2023-12-27 20:51:39,081][106226] Updated weights for policy 0, policy_version 227118 (0.0008) [2023-12-27 20:51:39,147][106226] Updated weights for policy 0, policy_version 227128 (0.0007) [2023-12-27 20:51:39,209][106226] Updated weights for policy 0, policy_version 227138 (0.0010) [2023-12-27 20:51:39,567][106225] Updated weights for policy 1, policy_version 227345 (0.0009) [2023-12-27 20:51:39,636][106225] Updated weights for policy 1, policy_version 227355 (0.0010) [2023-12-27 20:51:39,703][106225] Updated weights for policy 1, policy_version 227365 (0.0011) [2023-12-27 20:51:39,758][106225] Updated weights for policy 1, policy_version 227375 (0.0011) [2023-12-27 20:51:39,958][106226] Updated weights for policy 0, policy_version 227148 (0.0008) [2023-12-27 20:51:40,017][106226] Updated weights for policy 0, policy_version 227158 (0.0006) [2023-12-27 20:51:40,090][106226] Updated weights for policy 0, policy_version 227168 (0.0006) [2023-12-27 20:51:40,397][106225] Updated weights for policy 1, policy_version 227385 (0.0009) [2023-12-27 20:51:40,458][106225] Updated weights for policy 1, policy_version 227395 (0.0010) [2023-12-27 20:51:40,512][106225] Updated weights for policy 1, policy_version 227405 (0.0010) [2023-12-27 20:51:40,755][106226] Updated weights for policy 0, policy_version 227178 (0.0006) [2023-12-27 20:51:40,805][106226] Updated weights for policy 0, policy_version 227188 (0.0008) [2023-12-27 20:51:40,863][106226] Updated weights for policy 0, policy_version 227198 (0.0008) [2023-12-27 20:51:40,923][106226] Updated weights for policy 0, policy_version 227208 (0.0006) [2023-12-27 20:51:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 116408320. Throughput: 0: 9843.3, 1: 10125.5. Samples: 116379956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:41,175][105115] Avg episode reward: [(0, '-5.160'), (1, '-6.103')] [2023-12-27 20:51:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000227408_58228736.pth... [2023-12-27 20:51:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000227208_58179584.pth... [2023-12-27 20:51:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000226056_57884672.pth [2023-12-27 20:51:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000226224_57925632.pth [2023-12-27 20:51:41,256][106225] Updated weights for policy 1, policy_version 227415 (0.0010) [2023-12-27 20:51:41,318][106225] Updated weights for policy 1, policy_version 227425 (0.0010) [2023-12-27 20:51:41,395][106225] Updated weights for policy 1, policy_version 227435 (0.0012) [2023-12-27 20:51:41,680][106226] Updated weights for policy 0, policy_version 227218 (0.0008) [2023-12-27 20:51:41,745][106226] Updated weights for policy 0, policy_version 227228 (0.0008) [2023-12-27 20:51:41,816][106226] Updated weights for policy 0, policy_version 227238 (0.0008) [2023-12-27 20:51:42,113][106225] Updated weights for policy 1, policy_version 227445 (0.0008) [2023-12-27 20:51:42,182][106225] Updated weights for policy 1, policy_version 227455 (0.0008) [2023-12-27 20:51:42,246][106225] Updated weights for policy 1, policy_version 227465 (0.0010) [2023-12-27 20:51:42,556][106226] Updated weights for policy 0, policy_version 227248 (0.0008) [2023-12-27 20:51:42,616][106226] Updated weights for policy 0, policy_version 227258 (0.0009) [2023-12-27 20:51:42,675][106226] Updated weights for policy 0, policy_version 227268 (0.0009) [2023-12-27 20:51:42,942][106225] Updated weights for policy 1, policy_version 227475 (0.0010) [2023-12-27 20:51:43,002][106225] Updated weights for policy 1, policy_version 227485 (0.0008) [2023-12-27 20:51:43,054][106225] Updated weights for policy 1, policy_version 227495 (0.0008) [2023-12-27 20:51:43,397][106226] Updated weights for policy 0, policy_version 227278 (0.0009) [2023-12-27 20:51:43,456][106226] Updated weights for policy 0, policy_version 227288 (0.0008) [2023-12-27 20:51:43,521][106226] Updated weights for policy 0, policy_version 227298 (0.0007) [2023-12-27 20:51:43,733][106225] Updated weights for policy 1, policy_version 227505 (0.0008) [2023-12-27 20:51:43,795][106225] Updated weights for policy 1, policy_version 227515 (0.0011) [2023-12-27 20:51:43,860][106225] Updated weights for policy 1, policy_version 227525 (0.0010) [2023-12-27 20:51:43,918][106225] Updated weights for policy 1, policy_version 227535 (0.0011) [2023-12-27 20:51:44,279][106226] Updated weights for policy 0, policy_version 227308 (0.0009) [2023-12-27 20:51:44,329][106226] Updated weights for policy 0, policy_version 227318 (0.0008) [2023-12-27 20:51:44,388][106226] Updated weights for policy 0, policy_version 227328 (0.0008) [2023-12-27 20:51:44,603][106225] Updated weights for policy 1, policy_version 227545 (0.0006) [2023-12-27 20:51:44,656][106225] Updated weights for policy 1, policy_version 227555 (0.0005) [2023-12-27 20:51:44,715][106225] Updated weights for policy 1, policy_version 227565 (0.0005) [2023-12-27 20:51:45,227][106226] Updated weights for policy 0, policy_version 227338 (0.0008) [2023-12-27 20:51:45,285][106226] Updated weights for policy 0, policy_version 227348 (0.0007) [2023-12-27 20:51:45,352][106226] Updated weights for policy 0, policy_version 227358 (0.0010) [2023-12-27 20:51:45,388][106225] Updated weights for policy 1, policy_version 227575 (0.0005) [2023-12-27 20:51:45,413][106226] Updated weights for policy 0, policy_version 227368 (0.0008) [2023-12-27 20:51:45,446][106225] Updated weights for policy 1, policy_version 227585 (0.0009) [2023-12-27 20:51:45,507][106225] Updated weights for policy 1, policy_version 227595 (0.0010) [2023-12-27 20:51:46,040][106225] Updated weights for policy 1, policy_version 227605 (0.0005) [2023-12-27 20:51:46,102][106225] Updated weights for policy 1, policy_version 227615 (0.0006) [2023-12-27 20:51:46,152][106225] Updated weights for policy 1, policy_version 227625 (0.0010) [2023-12-27 20:51:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 116498432. Throughput: 0: 9790.0, 1: 10095.8. Samples: 116494572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:46,175][105115] Avg episode reward: [(0, '-4.967'), (1, '-6.085')] [2023-12-27 20:51:46,231][106226] Updated weights for policy 0, policy_version 227378 (0.0007) [2023-12-27 20:51:46,285][106226] Updated weights for policy 0, policy_version 227388 (0.0008) [2023-12-27 20:51:46,338][106226] Updated weights for policy 0, policy_version 227398 (0.0008) [2023-12-27 20:51:46,788][106225] Updated weights for policy 1, policy_version 227635 (0.0009) [2023-12-27 20:51:46,845][106225] Updated weights for policy 1, policy_version 227645 (0.0005) [2023-12-27 20:51:46,891][106225] Updated weights for policy 1, policy_version 227655 (0.0005) [2023-12-27 20:51:47,117][106226] Updated weights for policy 0, policy_version 227408 (0.0006) [2023-12-27 20:51:47,178][106226] Updated weights for policy 0, policy_version 227418 (0.0009) [2023-12-27 20:51:47,230][106226] Updated weights for policy 0, policy_version 227428 (0.0008) [2023-12-27 20:51:47,418][106225] Updated weights for policy 1, policy_version 227665 (0.0005) [2023-12-27 20:51:47,469][106225] Updated weights for policy 1, policy_version 227675 (0.0009) [2023-12-27 20:51:47,529][106225] Updated weights for policy 1, policy_version 227685 (0.0010) [2023-12-27 20:51:47,589][106225] Updated weights for policy 1, policy_version 227695 (0.0005) [2023-12-27 20:51:47,867][106226] Updated weights for policy 0, policy_version 227438 (0.0007) [2023-12-27 20:51:47,925][106226] Updated weights for policy 0, policy_version 227448 (0.0005) [2023-12-27 20:51:47,978][106226] Updated weights for policy 0, policy_version 227458 (0.0005) [2023-12-27 20:51:48,267][106225] Updated weights for policy 1, policy_version 227705 (0.0008) [2023-12-27 20:51:48,329][106225] Updated weights for policy 1, policy_version 227715 (0.0008) [2023-12-27 20:51:48,386][106225] Updated weights for policy 1, policy_version 227725 (0.0010) [2023-12-27 20:51:48,637][106226] Updated weights for policy 0, policy_version 227468 (0.0007) [2023-12-27 20:51:48,691][106226] Updated weights for policy 0, policy_version 227478 (0.0008) [2023-12-27 20:51:48,745][106226] Updated weights for policy 0, policy_version 227488 (0.0008) [2023-12-27 20:51:49,076][106225] Updated weights for policy 1, policy_version 227735 (0.0007) [2023-12-27 20:51:49,137][106225] Updated weights for policy 1, policy_version 227745 (0.0010) [2023-12-27 20:51:49,192][106225] Updated weights for policy 1, policy_version 227755 (0.0010) [2023-12-27 20:51:49,534][106226] Updated weights for policy 0, policy_version 227498 (0.0008) [2023-12-27 20:51:49,598][106226] Updated weights for policy 0, policy_version 227508 (0.0008) [2023-12-27 20:51:49,660][106226] Updated weights for policy 0, policy_version 227518 (0.0008) [2023-12-27 20:51:49,711][106226] Updated weights for policy 0, policy_version 227528 (0.0008) [2023-12-27 20:51:49,939][106225] Updated weights for policy 1, policy_version 227765 (0.0008) [2023-12-27 20:51:50,014][106225] Updated weights for policy 1, policy_version 227775 (0.0010) [2023-12-27 20:51:50,060][106225] Updated weights for policy 1, policy_version 227785 (0.0008) [2023-12-27 20:51:50,377][106226] Updated weights for policy 0, policy_version 227538 (0.0009) [2023-12-27 20:51:50,433][106226] Updated weights for policy 0, policy_version 227548 (0.0009) [2023-12-27 20:51:50,489][106226] Updated weights for policy 0, policy_version 227558 (0.0008) [2023-12-27 20:51:50,811][106225] Updated weights for policy 1, policy_version 227795 (0.0008) [2023-12-27 20:51:50,871][106225] Updated weights for policy 1, policy_version 227805 (0.0009) [2023-12-27 20:51:50,926][106225] Updated weights for policy 1, policy_version 227815 (0.0008) [2023-12-27 20:51:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 116604928. Throughput: 0: 9769.2, 1: 10126.5. Samples: 116614876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:51,175][105115] Avg episode reward: [(0, '-4.978'), (1, '-5.971')] [2023-12-27 20:51:51,218][106226] Updated weights for policy 0, policy_version 227568 (0.0008) [2023-12-27 20:51:51,285][106226] Updated weights for policy 0, policy_version 227578 (0.0009) [2023-12-27 20:51:51,358][106226] Updated weights for policy 0, policy_version 227588 (0.0009) [2023-12-27 20:51:51,711][106225] Updated weights for policy 1, policy_version 227825 (0.0008) [2023-12-27 20:51:51,776][106225] Updated weights for policy 1, policy_version 227835 (0.0009) [2023-12-27 20:51:51,830][106225] Updated weights for policy 1, policy_version 227845 (0.0009) [2023-12-27 20:51:51,884][106225] Updated weights for policy 1, policy_version 227855 (0.0008) [2023-12-27 20:51:52,122][106226] Updated weights for policy 0, policy_version 227598 (0.0009) [2023-12-27 20:51:52,183][106226] Updated weights for policy 0, policy_version 227608 (0.0009) [2023-12-27 20:51:52,243][106226] Updated weights for policy 0, policy_version 227618 (0.0008) [2023-12-27 20:51:52,642][106225] Updated weights for policy 1, policy_version 227865 (0.0008) [2023-12-27 20:51:52,711][106225] Updated weights for policy 1, policy_version 227875 (0.0009) [2023-12-27 20:51:52,776][106225] Updated weights for policy 1, policy_version 227885 (0.0010) [2023-12-27 20:51:52,860][106226] Updated weights for policy 0, policy_version 227628 (0.0006) [2023-12-27 20:51:52,913][106226] Updated weights for policy 0, policy_version 227638 (0.0005) [2023-12-27 20:51:52,974][106226] Updated weights for policy 0, policy_version 227648 (0.0008) [2023-12-27 20:51:53,508][106225] Updated weights for policy 1, policy_version 227895 (0.0008) [2023-12-27 20:51:53,556][106225] Updated weights for policy 1, policy_version 227905 (0.0008) [2023-12-27 20:51:53,614][106225] Updated weights for policy 1, policy_version 227915 (0.0008) [2023-12-27 20:51:53,638][106226] Updated weights for policy 0, policy_version 227658 (0.0008) [2023-12-27 20:51:53,702][106226] Updated weights for policy 0, policy_version 227668 (0.0007) [2023-12-27 20:51:53,761][106226] Updated weights for policy 0, policy_version 227678 (0.0005) [2023-12-27 20:51:53,817][106226] Updated weights for policy 0, policy_version 227688 (0.0005) [2023-12-27 20:51:54,301][106225] Updated weights for policy 1, policy_version 227925 (0.0008) [2023-12-27 20:51:54,356][106225] Updated weights for policy 1, policy_version 227935 (0.0006) [2023-12-27 20:51:54,411][106225] Updated weights for policy 1, policy_version 227945 (0.0005) [2023-12-27 20:51:54,443][106226] Updated weights for policy 0, policy_version 227698 (0.0008) [2023-12-27 20:51:54,506][106226] Updated weights for policy 0, policy_version 227708 (0.0007) [2023-12-27 20:51:54,557][106226] Updated weights for policy 0, policy_version 227718 (0.0010) [2023-12-27 20:51:55,093][106225] Updated weights for policy 1, policy_version 227955 (0.0007) [2023-12-27 20:51:55,154][106225] Updated weights for policy 1, policy_version 227965 (0.0010) [2023-12-27 20:51:55,211][106225] Updated weights for policy 1, policy_version 227975 (0.0010) [2023-12-27 20:51:55,284][106226] Updated weights for policy 0, policy_version 227728 (0.0007) [2023-12-27 20:51:55,344][106226] Updated weights for policy 0, policy_version 227738 (0.0010) [2023-12-27 20:51:55,400][106226] Updated weights for policy 0, policy_version 227748 (0.0009) [2023-12-27 20:51:55,793][106225] Updated weights for policy 1, policy_version 227985 (0.0009) [2023-12-27 20:51:55,846][106225] Updated weights for policy 1, policy_version 227995 (0.0005) [2023-12-27 20:51:55,899][106225] Updated weights for policy 1, policy_version 228005 (0.0010) [2023-12-27 20:51:55,949][106225] Updated weights for policy 1, policy_version 228015 (0.0010) [2023-12-27 20:51:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 116703232. Throughput: 0: 9822.9, 1: 10052.1. Samples: 116672920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:51:56,176][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.743')] [2023-12-27 20:51:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000228016_58384384.pth... [2023-12-27 20:51:56,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000226832_58081280.pth [2023-12-27 20:51:56,228][106226] Updated weights for policy 0, policy_version 227758 (0.0007) [2023-12-27 20:51:56,276][106226] Updated weights for policy 0, policy_version 227768 (0.0010) [2023-12-27 20:51:56,328][106226] Updated weights for policy 0, policy_version 227778 (0.0008) [2023-12-27 20:51:56,360][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000227784_58327040.pth... [2023-12-27 20:51:56,365][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000226632_58032128.pth [2023-12-27 20:51:56,584][106225] Updated weights for policy 1, policy_version 228025 (0.0007) [2023-12-27 20:51:56,646][106225] Updated weights for policy 1, policy_version 228035 (0.0010) [2023-12-27 20:51:56,714][106225] Updated weights for policy 1, policy_version 228045 (0.0007) [2023-12-27 20:51:56,897][106226] Updated weights for policy 0, policy_version 227788 (0.0008) [2023-12-27 20:51:56,949][106226] Updated weights for policy 0, policy_version 227798 (0.0005) [2023-12-27 20:51:57,004][106226] Updated weights for policy 0, policy_version 227808 (0.0005) [2023-12-27 20:51:57,368][106225] Updated weights for policy 1, policy_version 228055 (0.0010) [2023-12-27 20:51:57,420][106225] Updated weights for policy 1, policy_version 228065 (0.0006) [2023-12-27 20:51:57,466][106225] Updated weights for policy 1, policy_version 228075 (0.0005) [2023-12-27 20:51:57,595][106226] Updated weights for policy 0, policy_version 227818 (0.0005) [2023-12-27 20:51:57,658][106226] Updated weights for policy 0, policy_version 227828 (0.0005) [2023-12-27 20:51:57,723][106226] Updated weights for policy 0, policy_version 227838 (0.0005) [2023-12-27 20:51:57,771][106226] Updated weights for policy 0, policy_version 227848 (0.0005) [2023-12-27 20:51:58,127][106225] Updated weights for policy 1, policy_version 228085 (0.0005) [2023-12-27 20:51:58,187][106225] Updated weights for policy 1, policy_version 228095 (0.0006) [2023-12-27 20:51:58,254][106225] Updated weights for policy 1, policy_version 228105 (0.0008) [2023-12-27 20:51:58,435][106226] Updated weights for policy 0, policy_version 227858 (0.0008) [2023-12-27 20:51:58,505][106226] Updated weights for policy 0, policy_version 227868 (0.0008) [2023-12-27 20:51:58,571][106226] Updated weights for policy 0, policy_version 227878 (0.0008) [2023-12-27 20:51:59,073][106225] Updated weights for policy 1, policy_version 228116 (0.0009) [2023-12-27 20:51:59,133][106225] Updated weights for policy 1, policy_version 228126 (0.0010) [2023-12-27 20:51:59,195][106225] Updated weights for policy 1, policy_version 228136 (0.0010) [2023-12-27 20:51:59,335][106226] Updated weights for policy 0, policy_version 227888 (0.0009) [2023-12-27 20:51:59,408][106226] Updated weights for policy 0, policy_version 227898 (0.0009) [2023-12-27 20:51:59,466][106226] Updated weights for policy 0, policy_version 227908 (0.0008) [2023-12-27 20:51:59,963][106225] Updated weights for policy 1, policy_version 228146 (0.0009) [2023-12-27 20:52:00,024][106225] Updated weights for policy 1, policy_version 228156 (0.0009) [2023-12-27 20:52:00,086][106225] Updated weights for policy 1, policy_version 228166 (0.0008) [2023-12-27 20:52:00,146][106225] Updated weights for policy 1, policy_version 228176 (0.0008) [2023-12-27 20:52:00,218][106226] Updated weights for policy 0, policy_version 227918 (0.0008) [2023-12-27 20:52:00,272][106226] Updated weights for policy 0, policy_version 227928 (0.0008) [2023-12-27 20:52:00,336][106226] Updated weights for policy 0, policy_version 227938 (0.0009) [2023-12-27 20:52:00,830][106225] Updated weights for policy 1, policy_version 228186 (0.0007) [2023-12-27 20:52:00,879][106225] Updated weights for policy 1, policy_version 228196 (0.0007) [2023-12-27 20:52:00,939][106225] Updated weights for policy 1, policy_version 228206 (0.0007) [2023-12-27 20:52:01,101][106226] Updated weights for policy 0, policy_version 227948 (0.0008) [2023-12-27 20:52:01,168][106226] Updated weights for policy 0, policy_version 227958 (0.0011) [2023-12-27 20:52:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 116801536. Throughput: 0: 9868.2, 1: 10156.5. Samples: 116793440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:52:01,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-5.944')] [2023-12-27 20:52:01,233][106226] Updated weights for policy 0, policy_version 227968 (0.0011) [2023-12-27 20:52:01,681][106225] Updated weights for policy 1, policy_version 228216 (0.0009) [2023-12-27 20:52:01,744][106225] Updated weights for policy 1, policy_version 228226 (0.0009) [2023-12-27 20:52:01,795][106225] Updated weights for policy 1, policy_version 228236 (0.0008) [2023-12-27 20:52:01,923][106226] Updated weights for policy 0, policy_version 227978 (0.0010) [2023-12-27 20:52:01,986][106226] Updated weights for policy 0, policy_version 227988 (0.0007) [2023-12-27 20:52:02,048][106226] Updated weights for policy 0, policy_version 227998 (0.0008) [2023-12-27 20:52:02,108][106226] Updated weights for policy 0, policy_version 228008 (0.0007) [2023-12-27 20:52:02,565][106225] Updated weights for policy 1, policy_version 228246 (0.0008) [2023-12-27 20:52:02,631][106225] Updated weights for policy 1, policy_version 228256 (0.0008) [2023-12-27 20:52:02,684][106225] Updated weights for policy 1, policy_version 228266 (0.0010) [2023-12-27 20:52:02,840][106226] Updated weights for policy 0, policy_version 228018 (0.0008) [2023-12-27 20:52:02,899][106226] Updated weights for policy 0, policy_version 228028 (0.0007) [2023-12-27 20:52:02,961][106226] Updated weights for policy 0, policy_version 228038 (0.0005) [2023-12-27 20:52:03,363][106225] Updated weights for policy 1, policy_version 228276 (0.0008) [2023-12-27 20:52:03,428][106225] Updated weights for policy 1, policy_version 228286 (0.0005) [2023-12-27 20:52:03,477][106225] Updated weights for policy 1, policy_version 228296 (0.0005) [2023-12-27 20:52:03,509][106226] Updated weights for policy 0, policy_version 228048 (0.0006) [2023-12-27 20:52:03,563][106226] Updated weights for policy 0, policy_version 228058 (0.0009) [2023-12-27 20:52:03,607][106226] Updated weights for policy 0, policy_version 228068 (0.0007) [2023-12-27 20:52:04,064][106225] Updated weights for policy 1, policy_version 228306 (0.0006) [2023-12-27 20:52:04,121][106225] Updated weights for policy 1, policy_version 228316 (0.0010) [2023-12-27 20:52:04,176][106225] Updated weights for policy 1, policy_version 228326 (0.0009) [2023-12-27 20:52:04,225][106225] Updated weights for policy 1, policy_version 228336 (0.0006) [2023-12-27 20:52:04,334][106226] Updated weights for policy 0, policy_version 228078 (0.0008) [2023-12-27 20:52:04,395][106226] Updated weights for policy 0, policy_version 228088 (0.0008) [2023-12-27 20:52:04,461][106226] Updated weights for policy 0, policy_version 228098 (0.0007) [2023-12-27 20:52:04,913][106225] Updated weights for policy 1, policy_version 228346 (0.0008) [2023-12-27 20:52:04,971][106225] Updated weights for policy 1, policy_version 228356 (0.0008) [2023-12-27 20:52:05,035][106225] Updated weights for policy 1, policy_version 228366 (0.0006) [2023-12-27 20:52:05,237][106226] Updated weights for policy 0, policy_version 228108 (0.0009) [2023-12-27 20:52:05,304][106226] Updated weights for policy 0, policy_version 228118 (0.0010) [2023-12-27 20:52:05,367][106226] Updated weights for policy 0, policy_version 228128 (0.0008) [2023-12-27 20:52:05,681][106225] Updated weights for policy 1, policy_version 228376 (0.0007) [2023-12-27 20:52:05,744][106225] Updated weights for policy 1, policy_version 228386 (0.0009) [2023-12-27 20:52:05,799][106225] Updated weights for policy 1, policy_version 228396 (0.0009) [2023-12-27 20:52:06,110][106226] Updated weights for policy 0, policy_version 228138 (0.0008) [2023-12-27 20:52:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 116899840. Throughput: 0: 9826.8, 1: 10172.1. Samples: 116912956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 20:52:06,175][106226] Updated weights for policy 0, policy_version 228148 (0.0010) [2023-12-27 20:52:06,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.991')] [2023-12-27 20:52:06,235][106226] Updated weights for policy 0, policy_version 228158 (0.0009) [2023-12-27 20:52:06,297][106226] Updated weights for policy 0, policy_version 228168 (0.0009) [2023-12-27 20:52:06,504][106225] Updated weights for policy 1, policy_version 228406 (0.0009) [2023-12-27 20:52:06,565][106225] Updated weights for policy 1, policy_version 228416 (0.0009) [2023-12-27 20:52:06,619][106225] Updated weights for policy 1, policy_version 228426 (0.0010) [2023-12-27 20:52:06,996][106226] Updated weights for policy 0, policy_version 228178 (0.0008) [2023-12-27 20:52:07,061][106226] Updated weights for policy 0, policy_version 228188 (0.0008) [2023-12-27 20:52:07,118][106226] Updated weights for policy 0, policy_version 228198 (0.0008) [2023-12-27 20:52:07,262][106225] Updated weights for policy 1, policy_version 228436 (0.0009) [2023-12-27 20:52:07,328][106225] Updated weights for policy 1, policy_version 228446 (0.0005) [2023-12-27 20:52:07,397][106225] Updated weights for policy 1, policy_version 228456 (0.0005) [2023-12-27 20:52:07,727][106226] Updated weights for policy 0, policy_version 228208 (0.0006) [2023-12-27 20:52:07,777][106226] Updated weights for policy 0, policy_version 228218 (0.0005) [2023-12-27 20:52:07,835][106226] Updated weights for policy 0, policy_version 228228 (0.0005) [2023-12-27 20:52:07,933][106225] Updated weights for policy 1, policy_version 228466 (0.0007) [2023-12-27 20:52:07,991][106225] Updated weights for policy 1, policy_version 228476 (0.0010) [2023-12-27 20:52:08,038][106225] Updated weights for policy 1, policy_version 228486 (0.0010) [2023-12-27 20:52:08,088][106225] Updated weights for policy 1, policy_version 228496 (0.0007) [2023-12-27 20:52:08,501][106226] Updated weights for policy 0, policy_version 228238 (0.0009) [2023-12-27 20:52:08,571][106226] Updated weights for policy 0, policy_version 228248 (0.0009) [2023-12-27 20:52:08,641][106226] Updated weights for policy 0, policy_version 228258 (0.0009) [2023-12-27 20:52:08,755][106225] Updated weights for policy 1, policy_version 228506 (0.0010) [2023-12-27 20:52:08,814][106225] Updated weights for policy 1, policy_version 228516 (0.0010) [2023-12-27 20:52:08,871][106225] Updated weights for policy 1, policy_version 228526 (0.0010) [2023-12-27 20:52:09,394][106226] Updated weights for policy 0, policy_version 228268 (0.0009) [2023-12-27 20:52:09,457][106226] Updated weights for policy 0, policy_version 228278 (0.0007) [2023-12-27 20:52:09,529][106226] Updated weights for policy 0, policy_version 228288 (0.0009) [2023-12-27 20:52:09,616][106225] Updated weights for policy 1, policy_version 228536 (0.0008) [2023-12-27 20:52:09,680][106225] Updated weights for policy 1, policy_version 228546 (0.0009) [2023-12-27 20:52:09,737][106225] Updated weights for policy 1, policy_version 228556 (0.0009) [2023-12-27 20:52:10,257][106226] Updated weights for policy 0, policy_version 228298 (0.0009) [2023-12-27 20:52:10,317][106226] Updated weights for policy 0, policy_version 228308 (0.0008) [2023-12-27 20:52:10,380][106226] Updated weights for policy 0, policy_version 228318 (0.0009) [2023-12-27 20:52:10,451][106226] Updated weights for policy 0, policy_version 228328 (0.0009) [2023-12-27 20:52:10,468][106225] Updated weights for policy 1, policy_version 228566 (0.0008) [2023-12-27 20:52:10,530][106225] Updated weights for policy 1, policy_version 228576 (0.0008) [2023-12-27 20:52:10,594][106225] Updated weights for policy 1, policy_version 228586 (0.0008) [2023-12-27 20:52:11,125][106226] Updated weights for policy 0, policy_version 228338 (0.0009) [2023-12-27 20:52:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 116998144. Throughput: 0: 9852.3, 1: 10274.3. Samples: 116975440. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:11,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.870')] [2023-12-27 20:52:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000228592_58531840.pth... [2023-12-27 20:52:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000227408_58228736.pth [2023-12-27 20:52:11,189][106226] Updated weights for policy 0, policy_version 228348 (0.0009) [2023-12-27 20:52:11,247][106226] Updated weights for policy 0, policy_version 228358 (0.0008) [2023-12-27 20:52:11,260][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000228360_58474496.pth... [2023-12-27 20:52:11,265][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000227208_58179584.pth [2023-12-27 20:52:11,313][106225] Updated weights for policy 1, policy_version 228596 (0.0009) [2023-12-27 20:52:11,383][106225] Updated weights for policy 1, policy_version 228606 (0.0009) [2023-12-27 20:52:11,451][106225] Updated weights for policy 1, policy_version 228616 (0.0008) [2023-12-27 20:52:12,083][106226] Updated weights for policy 0, policy_version 228368 (0.0010) [2023-12-27 20:52:12,140][106226] Updated weights for policy 0, policy_version 228378 (0.0010) [2023-12-27 20:52:12,148][106225] Updated weights for policy 1, policy_version 228626 (0.0007) [2023-12-27 20:52:12,208][106226] Updated weights for policy 0, policy_version 228388 (0.0011) [2023-12-27 20:52:12,213][106225] Updated weights for policy 1, policy_version 228636 (0.0006) [2023-12-27 20:52:12,279][106225] Updated weights for policy 1, policy_version 228646 (0.0007) [2023-12-27 20:52:12,343][106225] Updated weights for policy 1, policy_version 228656 (0.0009) [2023-12-27 20:52:12,926][106226] Updated weights for policy 0, policy_version 228398 (0.0009) [2023-12-27 20:52:12,979][106226] Updated weights for policy 0, policy_version 228408 (0.0006) [2023-12-27 20:52:13,037][106226] Updated weights for policy 0, policy_version 228418 (0.0005) [2023-12-27 20:52:13,058][106225] Updated weights for policy 1, policy_version 228666 (0.0007) [2023-12-27 20:52:13,105][106225] Updated weights for policy 1, policy_version 228676 (0.0005) [2023-12-27 20:52:13,155][106225] Updated weights for policy 1, policy_version 228686 (0.0005) [2023-12-27 20:52:13,682][106226] Updated weights for policy 0, policy_version 228428 (0.0005) [2023-12-27 20:52:13,750][106226] Updated weights for policy 0, policy_version 228438 (0.0008) [2023-12-27 20:52:13,807][106225] Updated weights for policy 1, policy_version 228696 (0.0006) [2023-12-27 20:52:13,816][106226] Updated weights for policy 0, policy_version 228448 (0.0010) [2023-12-27 20:52:13,868][106225] Updated weights for policy 1, policy_version 228706 (0.0007) [2023-12-27 20:52:13,929][106225] Updated weights for policy 1, policy_version 228716 (0.0006) [2023-12-27 20:52:14,503][106226] Updated weights for policy 0, policy_version 228458 (0.0009) [2023-12-27 20:52:14,544][106225] Updated weights for policy 1, policy_version 228726 (0.0008) [2023-12-27 20:52:14,570][106226] Updated weights for policy 0, policy_version 228468 (0.0007) [2023-12-27 20:52:14,607][106225] Updated weights for policy 1, policy_version 228736 (0.0008) [2023-12-27 20:52:14,629][106226] Updated weights for policy 0, policy_version 228478 (0.0007) [2023-12-27 20:52:14,666][106225] Updated weights for policy 1, policy_version 228746 (0.0009) [2023-12-27 20:52:14,690][106226] Updated weights for policy 0, policy_version 228488 (0.0008) [2023-12-27 20:52:15,427][106225] Updated weights for policy 1, policy_version 228756 (0.0008) [2023-12-27 20:52:15,471][106226] Updated weights for policy 0, policy_version 228498 (0.0009) [2023-12-27 20:52:15,481][106225] Updated weights for policy 1, policy_version 228766 (0.0007) [2023-12-27 20:52:15,534][106226] Updated weights for policy 0, policy_version 228508 (0.0006) [2023-12-27 20:52:15,540][106225] Updated weights for policy 1, policy_version 228776 (0.0006) [2023-12-27 20:52:15,593][106226] Updated weights for policy 0, policy_version 228518 (0.0006) [2023-12-27 20:52:16,159][106225] Updated weights for policy 1, policy_version 228786 (0.0007) [2023-12-27 20:52:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 117096448. Throughput: 0: 9756.2, 1: 10078.7. Samples: 117091392. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:16,175][105115] Avg episode reward: [(0, '-4.998'), (1, '-6.142')] [2023-12-27 20:52:16,225][106225] Updated weights for policy 1, policy_version 228796 (0.0005) [2023-12-27 20:52:16,288][106225] Updated weights for policy 1, policy_version 228806 (0.0006) [2023-12-27 20:52:16,326][106226] Updated weights for policy 0, policy_version 228528 (0.0007) [2023-12-27 20:52:16,352][106225] Updated weights for policy 1, policy_version 228816 (0.0008) [2023-12-27 20:52:16,371][106226] Updated weights for policy 0, policy_version 228538 (0.0008) [2023-12-27 20:52:16,421][106226] Updated weights for policy 0, policy_version 228548 (0.0009) [2023-12-27 20:52:16,906][106225] Updated weights for policy 1, policy_version 228826 (0.0005) [2023-12-27 20:52:16,968][106225] Updated weights for policy 1, policy_version 228836 (0.0006) [2023-12-27 20:52:17,030][106225] Updated weights for policy 1, policy_version 228846 (0.0006) [2023-12-27 20:52:17,254][106226] Updated weights for policy 0, policy_version 228558 (0.0008) [2023-12-27 20:52:17,312][106226] Updated weights for policy 0, policy_version 228568 (0.0008) [2023-12-27 20:52:17,360][106226] Updated weights for policy 0, policy_version 228578 (0.0008) [2023-12-27 20:52:17,617][106225] Updated weights for policy 1, policy_version 228856 (0.0009) [2023-12-27 20:52:17,685][106225] Updated weights for policy 1, policy_version 228866 (0.0008) [2023-12-27 20:52:17,739][106225] Updated weights for policy 1, policy_version 228876 (0.0008) [2023-12-27 20:52:18,118][106226] Updated weights for policy 0, policy_version 228588 (0.0007) [2023-12-27 20:52:18,177][106226] Updated weights for policy 0, policy_version 228598 (0.0007) [2023-12-27 20:52:18,231][106226] Updated weights for policy 0, policy_version 228608 (0.0008) [2023-12-27 20:52:18,410][106225] Updated weights for policy 1, policy_version 228886 (0.0007) [2023-12-27 20:52:18,473][106225] Updated weights for policy 1, policy_version 228896 (0.0006) [2023-12-27 20:52:18,535][106225] Updated weights for policy 1, policy_version 228906 (0.0008) [2023-12-27 20:52:18,960][106226] Updated weights for policy 0, policy_version 228618 (0.0008) [2023-12-27 20:52:19,013][106226] Updated weights for policy 0, policy_version 228628 (0.0005) [2023-12-27 20:52:19,068][106226] Updated weights for policy 0, policy_version 228638 (0.0006) [2023-12-27 20:52:19,121][106226] Updated weights for policy 0, policy_version 228648 (0.0010) [2023-12-27 20:52:19,227][106225] Updated weights for policy 1, policy_version 228916 (0.0008) [2023-12-27 20:52:19,288][106225] Updated weights for policy 1, policy_version 228926 (0.0009) [2023-12-27 20:52:19,354][106225] Updated weights for policy 1, policy_version 228936 (0.0008) [2023-12-27 20:52:19,779][106226] Updated weights for policy 0, policy_version 228658 (0.0011) [2023-12-27 20:52:19,848][106226] Updated weights for policy 0, policy_version 228668 (0.0011) [2023-12-27 20:52:19,916][106226] Updated weights for policy 0, policy_version 228678 (0.0010) [2023-12-27 20:52:20,068][106225] Updated weights for policy 1, policy_version 228946 (0.0007) [2023-12-27 20:52:20,133][106225] Updated weights for policy 1, policy_version 228956 (0.0006) [2023-12-27 20:52:20,200][106225] Updated weights for policy 1, policy_version 228966 (0.0005) [2023-12-27 20:52:20,266][106225] Updated weights for policy 1, policy_version 228976 (0.0006) [2023-12-27 20:52:20,630][106226] Updated weights for policy 0, policy_version 228688 (0.0009) [2023-12-27 20:52:20,687][106226] Updated weights for policy 0, policy_version 228698 (0.0006) [2023-12-27 20:52:20,746][106226] Updated weights for policy 0, policy_version 228708 (0.0008) [2023-12-27 20:52:20,899][106225] Updated weights for policy 1, policy_version 228986 (0.0008) [2023-12-27 20:52:20,950][106225] Updated weights for policy 1, policy_version 228996 (0.0008) [2023-12-27 20:52:21,011][106225] Updated weights for policy 1, policy_version 229006 (0.0008) [2023-12-27 20:52:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 117202944. Throughput: 0: 9690.5, 1: 10143.7. Samples: 117210632. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:21,175][105115] Avg episode reward: [(0, '-4.960'), (1, '-6.248')] [2023-12-27 20:52:21,486][106226] Updated weights for policy 0, policy_version 228718 (0.0008) [2023-12-27 20:52:21,542][106226] Updated weights for policy 0, policy_version 228728 (0.0009) [2023-12-27 20:52:21,591][106226] Updated weights for policy 0, policy_version 228738 (0.0009) [2023-12-27 20:52:21,765][106225] Updated weights for policy 1, policy_version 229016 (0.0007) [2023-12-27 20:52:21,834][106225] Updated weights for policy 1, policy_version 229026 (0.0007) [2023-12-27 20:52:21,904][106225] Updated weights for policy 1, policy_version 229036 (0.0010) [2023-12-27 20:52:22,295][106226] Updated weights for policy 0, policy_version 228748 (0.0007) [2023-12-27 20:52:22,363][106226] Updated weights for policy 0, policy_version 228758 (0.0007) [2023-12-27 20:52:22,427][106226] Updated weights for policy 0, policy_version 228768 (0.0009) [2023-12-27 20:52:22,651][106225] Updated weights for policy 1, policy_version 229046 (0.0007) [2023-12-27 20:52:22,709][106225] Updated weights for policy 1, policy_version 229056 (0.0008) [2023-12-27 20:52:22,769][106225] Updated weights for policy 1, policy_version 229066 (0.0006) [2023-12-27 20:52:23,129][106226] Updated weights for policy 0, policy_version 228778 (0.0007) [2023-12-27 20:52:23,193][106226] Updated weights for policy 0, policy_version 228788 (0.0011) [2023-12-27 20:52:23,260][106226] Updated weights for policy 0, policy_version 228798 (0.0011) [2023-12-27 20:52:23,324][106226] Updated weights for policy 0, policy_version 228808 (0.0010) [2023-12-27 20:52:23,386][106225] Updated weights for policy 1, policy_version 229076 (0.0006) [2023-12-27 20:52:23,432][106225] Updated weights for policy 1, policy_version 229086 (0.0005) [2023-12-27 20:52:23,481][106225] Updated weights for policy 1, policy_version 229096 (0.0010) [2023-12-27 20:52:23,963][106226] Updated weights for policy 0, policy_version 228818 (0.0011) [2023-12-27 20:52:24,010][106226] Updated weights for policy 0, policy_version 228828 (0.0010) [2023-12-27 20:52:24,061][106226] Updated weights for policy 0, policy_version 228838 (0.0010) [2023-12-27 20:52:24,186][106225] Updated weights for policy 1, policy_version 229106 (0.0010) [2023-12-27 20:52:24,246][106225] Updated weights for policy 1, policy_version 229116 (0.0010) [2023-12-27 20:52:24,305][106225] Updated weights for policy 1, policy_version 229126 (0.0010) [2023-12-27 20:52:24,366][106225] Updated weights for policy 1, policy_version 229136 (0.0010) [2023-12-27 20:52:24,796][106226] Updated weights for policy 0, policy_version 228848 (0.0011) [2023-12-27 20:52:24,866][106226] Updated weights for policy 0, policy_version 228858 (0.0010) [2023-12-27 20:52:24,922][106226] Updated weights for policy 0, policy_version 228868 (0.0010) [2023-12-27 20:52:25,051][106225] Updated weights for policy 1, policy_version 229146 (0.0010) [2023-12-27 20:52:25,108][106225] Updated weights for policy 1, policy_version 229156 (0.0010) [2023-12-27 20:52:25,164][106225] Updated weights for policy 1, policy_version 229166 (0.0010) [2023-12-27 20:52:25,518][106226] Updated weights for policy 0, policy_version 228878 (0.0007) [2023-12-27 20:52:25,574][106226] Updated weights for policy 0, policy_version 228888 (0.0010) [2023-12-27 20:52:25,636][106226] Updated weights for policy 0, policy_version 228898 (0.0010) [2023-12-27 20:52:25,770][106225] Updated weights for policy 1, policy_version 229176 (0.0010) [2023-12-27 20:52:25,832][106225] Updated weights for policy 1, policy_version 229186 (0.0009) [2023-12-27 20:52:25,889][106225] Updated weights for policy 1, policy_version 229196 (0.0007) [2023-12-27 20:52:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 117301248. Throughput: 0: 9685.0, 1: 10086.5. Samples: 117269672. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:26,176][105115] Avg episode reward: [(0, '-4.949'), (1, '-6.113')] [2023-12-27 20:52:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000229200_58687488.pth... [2023-12-27 20:52:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000228904_58613760.pth... [2023-12-27 20:52:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000228016_58384384.pth [2023-12-27 20:52:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000227784_58327040.pth [2023-12-27 20:52:26,259][106226] Updated weights for policy 0, policy_version 228908 (0.0007) [2023-12-27 20:52:26,313][106226] Updated weights for policy 0, policy_version 228918 (0.0010) [2023-12-27 20:52:26,364][106226] Updated weights for policy 0, policy_version 228928 (0.0010) [2023-12-27 20:52:26,565][106225] Updated weights for policy 1, policy_version 229206 (0.0007) [2023-12-27 20:52:26,623][106225] Updated weights for policy 1, policy_version 229216 (0.0007) [2023-12-27 20:52:26,688][106225] Updated weights for policy 1, policy_version 229226 (0.0008) [2023-12-27 20:52:27,041][106226] Updated weights for policy 0, policy_version 228938 (0.0011) [2023-12-27 20:52:27,090][106226] Updated weights for policy 0, policy_version 228948 (0.0010) [2023-12-27 20:52:27,140][106226] Updated weights for policy 0, policy_version 228958 (0.0010) [2023-12-27 20:52:27,192][106226] Updated weights for policy 0, policy_version 228968 (0.0010) [2023-12-27 20:52:27,385][106225] Updated weights for policy 1, policy_version 229236 (0.0007) [2023-12-27 20:52:27,435][106225] Updated weights for policy 1, policy_version 229246 (0.0005) [2023-12-27 20:52:27,486][106225] Updated weights for policy 1, policy_version 229256 (0.0005) [2023-12-27 20:52:27,901][106226] Updated weights for policy 0, policy_version 228978 (0.0005) [2023-12-27 20:52:27,959][106226] Updated weights for policy 0, policy_version 228988 (0.0006) [2023-12-27 20:52:28,011][106226] Updated weights for policy 0, policy_version 228998 (0.0006) [2023-12-27 20:52:28,017][106225] Updated weights for policy 1, policy_version 229266 (0.0005) [2023-12-27 20:52:28,085][106225] Updated weights for policy 1, policy_version 229276 (0.0010) [2023-12-27 20:52:28,138][106225] Updated weights for policy 1, policy_version 229286 (0.0009) [2023-12-27 20:52:28,186][106225] Updated weights for policy 1, policy_version 229296 (0.0009) [2023-12-27 20:52:28,617][106226] Updated weights for policy 0, policy_version 229008 (0.0010) [2023-12-27 20:52:28,677][106226] Updated weights for policy 0, policy_version 229018 (0.0010) [2023-12-27 20:52:28,744][106226] Updated weights for policy 0, policy_version 229028 (0.0010) [2023-12-27 20:52:28,942][106225] Updated weights for policy 1, policy_version 229306 (0.0005) [2023-12-27 20:52:28,996][106225] Updated weights for policy 1, policy_version 229316 (0.0006) [2023-12-27 20:52:29,045][106225] Updated weights for policy 1, policy_version 229326 (0.0007) [2023-12-27 20:52:29,454][106226] Updated weights for policy 0, policy_version 229038 (0.0007) [2023-12-27 20:52:29,514][106226] Updated weights for policy 0, policy_version 229048 (0.0005) [2023-12-27 20:52:29,583][106226] Updated weights for policy 0, policy_version 229058 (0.0006) [2023-12-27 20:52:29,778][106225] Updated weights for policy 1, policy_version 229336 (0.0007) [2023-12-27 20:52:29,838][106225] Updated weights for policy 1, policy_version 229347 (0.0007) [2023-12-27 20:52:29,907][106225] Updated weights for policy 1, policy_version 229357 (0.0010) [2023-12-27 20:52:30,205][106226] Updated weights for policy 0, policy_version 229068 (0.0007) [2023-12-27 20:52:30,271][106226] Updated weights for policy 0, policy_version 229078 (0.0010) [2023-12-27 20:52:30,331][106226] Updated weights for policy 0, policy_version 229088 (0.0009) [2023-12-27 20:52:30,566][106225] Updated weights for policy 1, policy_version 229367 (0.0006) [2023-12-27 20:52:30,617][106225] Updated weights for policy 1, policy_version 229377 (0.0005) [2023-12-27 20:52:30,676][106225] Updated weights for policy 1, policy_version 229387 (0.0005) [2023-12-27 20:52:31,028][106226] Updated weights for policy 0, policy_version 229098 (0.0008) [2023-12-27 20:52:31,093][106226] Updated weights for policy 0, policy_version 229108 (0.0007) [2023-12-27 20:52:31,161][106226] Updated weights for policy 0, policy_version 229118 (0.0008) [2023-12-27 20:52:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 117399552. Throughput: 0: 9849.4, 1: 10141.8. Samples: 117394176. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:31,175][105115] Avg episode reward: [(0, '-5.155'), (1, '-5.940')] [2023-12-27 20:52:31,220][106226] Updated weights for policy 0, policy_version 229128 (0.0008) [2023-12-27 20:52:31,291][106225] Updated weights for policy 1, policy_version 229397 (0.0007) [2023-12-27 20:52:31,358][106225] Updated weights for policy 1, policy_version 229407 (0.0009) [2023-12-27 20:52:31,434][106225] Updated weights for policy 1, policy_version 229417 (0.0008) [2023-12-27 20:52:31,925][106226] Updated weights for policy 0, policy_version 229138 (0.0007) [2023-12-27 20:52:31,992][106226] Updated weights for policy 0, policy_version 229148 (0.0010) [2023-12-27 20:52:32,064][106226] Updated weights for policy 0, policy_version 229158 (0.0011) [2023-12-27 20:52:32,206][106225] Updated weights for policy 1, policy_version 229427 (0.0008) [2023-12-27 20:52:32,268][106225] Updated weights for policy 1, policy_version 229437 (0.0009) [2023-12-27 20:52:32,321][106225] Updated weights for policy 1, policy_version 229447 (0.0008) [2023-12-27 20:52:32,654][106226] Updated weights for policy 0, policy_version 229168 (0.0010) [2023-12-27 20:52:32,714][106226] Updated weights for policy 0, policy_version 229178 (0.0008) [2023-12-27 20:52:32,771][106226] Updated weights for policy 0, policy_version 229188 (0.0010) [2023-12-27 20:52:33,037][106225] Updated weights for policy 1, policy_version 229457 (0.0008) [2023-12-27 20:52:33,096][106225] Updated weights for policy 1, policy_version 229467 (0.0005) [2023-12-27 20:52:33,161][106225] Updated weights for policy 1, policy_version 229477 (0.0005) [2023-12-27 20:52:33,210][106225] Updated weights for policy 1, policy_version 229487 (0.0009) [2023-12-27 20:52:33,398][106226] Updated weights for policy 0, policy_version 229198 (0.0008) [2023-12-27 20:52:33,448][106226] Updated weights for policy 0, policy_version 229208 (0.0008) [2023-12-27 20:52:33,493][106226] Updated weights for policy 0, policy_version 229218 (0.0007) [2023-12-27 20:52:33,856][106225] Updated weights for policy 1, policy_version 229497 (0.0010) [2023-12-27 20:52:33,906][106225] Updated weights for policy 1, policy_version 229507 (0.0010) [2023-12-27 20:52:33,960][106225] Updated weights for policy 1, policy_version 229517 (0.0008) [2023-12-27 20:52:34,082][106226] Updated weights for policy 0, policy_version 229228 (0.0008) [2023-12-27 20:52:34,144][106226] Updated weights for policy 0, policy_version 229238 (0.0007) [2023-12-27 20:52:34,202][106226] Updated weights for policy 0, policy_version 229248 (0.0008) [2023-12-27 20:52:34,699][106225] Updated weights for policy 1, policy_version 229527 (0.0008) [2023-12-27 20:52:34,764][106225] Updated weights for policy 1, policy_version 229537 (0.0007) [2023-12-27 20:52:34,827][106225] Updated weights for policy 1, policy_version 229547 (0.0007) [2023-12-27 20:52:34,870][106226] Updated weights for policy 0, policy_version 229258 (0.0008) [2023-12-27 20:52:34,924][106226] Updated weights for policy 0, policy_version 229268 (0.0010) [2023-12-27 20:52:34,977][106226] Updated weights for policy 0, policy_version 229278 (0.0010) [2023-12-27 20:52:35,034][106226] Updated weights for policy 0, policy_version 229288 (0.0010) [2023-12-27 20:52:35,445][106225] Updated weights for policy 1, policy_version 229557 (0.0009) [2023-12-27 20:52:35,500][106225] Updated weights for policy 1, policy_version 229567 (0.0010) [2023-12-27 20:52:35,556][106225] Updated weights for policy 1, policy_version 229577 (0.0010) [2023-12-27 20:52:35,752][106226] Updated weights for policy 0, policy_version 229298 (0.0010) [2023-12-27 20:52:35,805][106226] Updated weights for policy 0, policy_version 229308 (0.0010) [2023-12-27 20:52:35,871][106226] Updated weights for policy 0, policy_version 229318 (0.0010) [2023-12-27 20:52:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 117506048. Throughput: 0: 9946.7, 1: 10086.9. Samples: 117516392. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:36,175][105115] Avg episode reward: [(0, '-5.224'), (1, '-6.249')] [2023-12-27 20:52:36,244][106225] Updated weights for policy 1, policy_version 229587 (0.0009) [2023-12-27 20:52:36,311][106225] Updated weights for policy 1, policy_version 229597 (0.0007) [2023-12-27 20:52:36,376][106225] Updated weights for policy 1, policy_version 229607 (0.0007) [2023-12-27 20:52:36,603][106226] Updated weights for policy 0, policy_version 229328 (0.0011) [2023-12-27 20:52:36,671][106226] Updated weights for policy 0, policy_version 229338 (0.0011) [2023-12-27 20:52:36,728][106226] Updated weights for policy 0, policy_version 229348 (0.0007) [2023-12-27 20:52:36,969][106225] Updated weights for policy 1, policy_version 229617 (0.0007) [2023-12-27 20:52:37,039][106225] Updated weights for policy 1, policy_version 229627 (0.0010) [2023-12-27 20:52:37,109][106225] Updated weights for policy 1, policy_version 229637 (0.0010) [2023-12-27 20:52:37,179][106225] Updated weights for policy 1, policy_version 229647 (0.0009) [2023-12-27 20:52:37,336][106226] Updated weights for policy 0, policy_version 229358 (0.0008) [2023-12-27 20:52:37,386][106226] Updated weights for policy 0, policy_version 229368 (0.0007) [2023-12-27 20:52:37,443][106226] Updated weights for policy 0, policy_version 229378 (0.0008) [2023-12-27 20:52:37,874][106225] Updated weights for policy 1, policy_version 229657 (0.0010) [2023-12-27 20:52:37,923][106225] Updated weights for policy 1, policy_version 229667 (0.0010) [2023-12-27 20:52:37,982][106225] Updated weights for policy 1, policy_version 229677 (0.0010) [2023-12-27 20:52:38,189][106226] Updated weights for policy 0, policy_version 229388 (0.0009) [2023-12-27 20:52:38,254][106226] Updated weights for policy 0, policy_version 229398 (0.0010) [2023-12-27 20:52:38,317][106226] Updated weights for policy 0, policy_version 229408 (0.0010) [2023-12-27 20:52:38,687][106225] Updated weights for policy 1, policy_version 229687 (0.0010) [2023-12-27 20:52:38,745][106225] Updated weights for policy 1, policy_version 229697 (0.0010) [2023-12-27 20:52:38,798][106225] Updated weights for policy 1, policy_version 229707 (0.0010) [2023-12-27 20:52:38,997][106226] Updated weights for policy 0, policy_version 229418 (0.0008) [2023-12-27 20:52:39,050][106226] Updated weights for policy 0, policy_version 229428 (0.0010) [2023-12-27 20:52:39,106][106226] Updated weights for policy 0, policy_version 229438 (0.0010) [2023-12-27 20:52:39,168][106226] Updated weights for policy 0, policy_version 229448 (0.0010) [2023-12-27 20:52:39,548][106225] Updated weights for policy 1, policy_version 229717 (0.0010) [2023-12-27 20:52:39,610][106225] Updated weights for policy 1, policy_version 229727 (0.0012) [2023-12-27 20:52:39,675][106225] Updated weights for policy 1, policy_version 229737 (0.0010) [2023-12-27 20:52:39,922][106226] Updated weights for policy 0, policy_version 229458 (0.0009) [2023-12-27 20:52:39,990][106226] Updated weights for policy 0, policy_version 229468 (0.0010) [2023-12-27 20:52:40,066][106226] Updated weights for policy 0, policy_version 229478 (0.0009) [2023-12-27 20:52:40,381][106225] Updated weights for policy 1, policy_version 229747 (0.0009) [2023-12-27 20:52:40,445][106225] Updated weights for policy 1, policy_version 229757 (0.0009) [2023-12-27 20:52:40,500][106225] Updated weights for policy 1, policy_version 229767 (0.0010) [2023-12-27 20:52:40,772][106226] Updated weights for policy 0, policy_version 229488 (0.0010) [2023-12-27 20:52:40,833][106226] Updated weights for policy 0, policy_version 229498 (0.0010) [2023-12-27 20:52:40,889][106226] Updated weights for policy 0, policy_version 229508 (0.0011) [2023-12-27 20:52:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 117604352. Throughput: 0: 9927.0, 1: 10168.3. Samples: 117577204. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:41,175][105115] Avg episode reward: [(0, '-5.144'), (1, '-6.121')] [2023-12-27 20:52:41,177][106225] Updated weights for policy 1, policy_version 229777 (0.0008) [2023-12-27 20:52:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000229512_58769408.pth... [2023-12-27 20:52:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000228360_58474496.pth [2023-12-27 20:52:41,238][106225] Updated weights for policy 1, policy_version 229787 (0.0009) [2023-12-27 20:52:41,300][106225] Updated weights for policy 1, policy_version 229797 (0.0009) [2023-12-27 20:52:41,382][106225] Updated weights for policy 1, policy_version 229807 (0.0009) [2023-12-27 20:52:41,385][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000229808_58843136.pth... [2023-12-27 20:52:41,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000228592_58531840.pth [2023-12-27 20:52:41,711][106226] Updated weights for policy 0, policy_version 229518 (0.0010) [2023-12-27 20:52:41,784][106226] Updated weights for policy 0, policy_version 229528 (0.0009) [2023-12-27 20:52:41,847][106226] Updated weights for policy 0, policy_version 229538 (0.0007) [2023-12-27 20:52:42,125][106225] Updated weights for policy 1, policy_version 229817 (0.0009) [2023-12-27 20:52:42,189][106225] Updated weights for policy 1, policy_version 229827 (0.0010) [2023-12-27 20:52:42,254][106225] Updated weights for policy 1, policy_version 229837 (0.0010) [2023-12-27 20:52:42,630][106226] Updated weights for policy 0, policy_version 229548 (0.0009) [2023-12-27 20:52:42,687][106226] Updated weights for policy 0, policy_version 229558 (0.0009) [2023-12-27 20:52:42,756][106226] Updated weights for policy 0, policy_version 229568 (0.0006) [2023-12-27 20:52:42,935][106225] Updated weights for policy 1, policy_version 229847 (0.0008) [2023-12-27 20:52:42,995][106225] Updated weights for policy 1, policy_version 229857 (0.0008) [2023-12-27 20:52:43,055][106225] Updated weights for policy 1, policy_version 229867 (0.0009) [2023-12-27 20:52:43,413][106226] Updated weights for policy 0, policy_version 229578 (0.0007) [2023-12-27 20:52:43,481][106226] Updated weights for policy 0, policy_version 229588 (0.0005) [2023-12-27 20:52:43,534][106226] Updated weights for policy 0, policy_version 229598 (0.0006) [2023-12-27 20:52:43,585][106226] Updated weights for policy 0, policy_version 229608 (0.0009) [2023-12-27 20:52:43,765][106225] Updated weights for policy 1, policy_version 229877 (0.0009) [2023-12-27 20:52:43,831][106225] Updated weights for policy 1, policy_version 229887 (0.0008) [2023-12-27 20:52:43,890][106225] Updated weights for policy 1, policy_version 229897 (0.0008) [2023-12-27 20:52:44,202][106226] Updated weights for policy 0, policy_version 229618 (0.0006) [2023-12-27 20:52:44,268][106226] Updated weights for policy 0, policy_version 229628 (0.0006) [2023-12-27 20:52:44,330][106226] Updated weights for policy 0, policy_version 229638 (0.0006) [2023-12-27 20:52:44,616][106225] Updated weights for policy 1, policy_version 229907 (0.0007) [2023-12-27 20:52:44,687][106225] Updated weights for policy 1, policy_version 229917 (0.0006) [2023-12-27 20:52:44,744][106225] Updated weights for policy 1, policy_version 229927 (0.0008) [2023-12-27 20:52:44,972][106226] Updated weights for policy 0, policy_version 229648 (0.0008) [2023-12-27 20:52:45,035][106226] Updated weights for policy 0, policy_version 229658 (0.0009) [2023-12-27 20:52:45,096][106226] Updated weights for policy 0, policy_version 229668 (0.0008) [2023-12-27 20:52:45,387][106225] Updated weights for policy 1, policy_version 229937 (0.0009) [2023-12-27 20:52:45,451][106225] Updated weights for policy 1, policy_version 229947 (0.0006) [2023-12-27 20:52:45,513][106225] Updated weights for policy 1, policy_version 229957 (0.0008) [2023-12-27 20:52:45,573][106225] Updated weights for policy 1, policy_version 229967 (0.0008) [2023-12-27 20:52:45,840][106226] Updated weights for policy 0, policy_version 229678 (0.0009) [2023-12-27 20:52:45,895][106226] Updated weights for policy 0, policy_version 229688 (0.0009) [2023-12-27 20:52:45,954][106226] Updated weights for policy 0, policy_version 229698 (0.0009) [2023-12-27 20:52:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 117702656. Throughput: 0: 9877.0, 1: 10082.2. Samples: 117691608. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:46,176][105115] Avg episode reward: [(0, '-5.000'), (1, '-5.926')] [2023-12-27 20:52:46,232][106225] Updated weights for policy 1, policy_version 229977 (0.0009) [2023-12-27 20:52:46,295][106225] Updated weights for policy 1, policy_version 229987 (0.0008) [2023-12-27 20:52:46,341][106225] Updated weights for policy 1, policy_version 229997 (0.0005) [2023-12-27 20:52:46,701][106226] Updated weights for policy 0, policy_version 229708 (0.0008) [2023-12-27 20:52:46,755][106226] Updated weights for policy 0, policy_version 229718 (0.0008) [2023-12-27 20:52:46,813][106226] Updated weights for policy 0, policy_version 229728 (0.0008) [2023-12-27 20:52:47,035][106225] Updated weights for policy 1, policy_version 230007 (0.0009) [2023-12-27 20:52:47,090][106225] Updated weights for policy 1, policy_version 230017 (0.0010) [2023-12-27 20:52:47,133][106225] Updated weights for policy 1, policy_version 230027 (0.0010) [2023-12-27 20:52:47,566][106226] Updated weights for policy 0, policy_version 229738 (0.0008) [2023-12-27 20:52:47,623][106226] Updated weights for policy 0, policy_version 229748 (0.0009) [2023-12-27 20:52:47,680][106226] Updated weights for policy 0, policy_version 229758 (0.0009) [2023-12-27 20:52:47,728][106226] Updated weights for policy 0, policy_version 229768 (0.0008) [2023-12-27 20:52:47,791][106225] Updated weights for policy 1, policy_version 230037 (0.0010) [2023-12-27 20:52:47,854][106225] Updated weights for policy 1, policy_version 230047 (0.0010) [2023-12-27 20:52:47,916][106225] Updated weights for policy 1, policy_version 230057 (0.0010) [2023-12-27 20:52:48,419][106226] Updated weights for policy 0, policy_version 229778 (0.0008) [2023-12-27 20:52:48,476][106226] Updated weights for policy 0, policy_version 229788 (0.0008) [2023-12-27 20:52:48,562][106226] Updated weights for policy 0, policy_version 229798 (0.0006) [2023-12-27 20:52:48,567][106225] Updated weights for policy 1, policy_version 230067 (0.0010) [2023-12-27 20:52:48,629][106225] Updated weights for policy 1, policy_version 230077 (0.0009) [2023-12-27 20:52:48,702][106225] Updated weights for policy 1, policy_version 230087 (0.0009) [2023-12-27 20:52:49,114][106226] Updated weights for policy 0, policy_version 229808 (0.0007) [2023-12-27 20:52:49,161][106226] Updated weights for policy 0, policy_version 229818 (0.0005) [2023-12-27 20:52:49,223][106226] Updated weights for policy 0, policy_version 229828 (0.0007) [2023-12-27 20:52:49,520][106225] Updated weights for policy 1, policy_version 230097 (0.0010) [2023-12-27 20:52:49,579][106225] Updated weights for policy 1, policy_version 230107 (0.0008) [2023-12-27 20:52:49,628][106225] Updated weights for policy 1, policy_version 230117 (0.0008) [2023-12-27 20:52:49,679][106225] Updated weights for policy 1, policy_version 230127 (0.0008) [2023-12-27 20:52:49,952][106226] Updated weights for policy 0, policy_version 229838 (0.0008) [2023-12-27 20:52:50,023][106226] Updated weights for policy 0, policy_version 229848 (0.0006) [2023-12-27 20:52:50,090][106226] Updated weights for policy 0, policy_version 229858 (0.0009) [2023-12-27 20:52:50,441][106225] Updated weights for policy 1, policy_version 230137 (0.0008) [2023-12-27 20:52:50,498][106225] Updated weights for policy 1, policy_version 230147 (0.0008) [2023-12-27 20:52:50,555][106225] Updated weights for policy 1, policy_version 230157 (0.0008) [2023-12-27 20:52:50,720][106226] Updated weights for policy 0, policy_version 229868 (0.0007) [2023-12-27 20:52:50,784][106226] Updated weights for policy 0, policy_version 229878 (0.0008) [2023-12-27 20:52:50,844][106226] Updated weights for policy 0, policy_version 229888 (0.0009) [2023-12-27 20:52:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 117800960. Throughput: 0: 9906.5, 1: 10032.1. Samples: 117810200. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:51,175][105115] Avg episode reward: [(0, '-5.302'), (1, '-5.958')] [2023-12-27 20:52:51,349][106225] Updated weights for policy 1, policy_version 230167 (0.0007) [2023-12-27 20:52:51,418][106225] Updated weights for policy 1, policy_version 230177 (0.0007) [2023-12-27 20:52:51,479][106225] Updated weights for policy 1, policy_version 230187 (0.0008) [2023-12-27 20:52:51,566][106226] Updated weights for policy 0, policy_version 229898 (0.0008) [2023-12-27 20:52:51,624][106226] Updated weights for policy 0, policy_version 229908 (0.0008) [2023-12-27 20:52:51,693][106226] Updated weights for policy 0, policy_version 229918 (0.0008) [2023-12-27 20:52:51,764][106226] Updated weights for policy 0, policy_version 229928 (0.0007) [2023-12-27 20:52:52,135][106225] Updated weights for policy 1, policy_version 230197 (0.0007) [2023-12-27 20:52:52,194][106225] Updated weights for policy 1, policy_version 230207 (0.0007) [2023-12-27 20:52:52,246][106225] Updated weights for policy 1, policy_version 230217 (0.0008) [2023-12-27 20:52:52,496][106226] Updated weights for policy 0, policy_version 229938 (0.0008) [2023-12-27 20:52:52,554][106226] Updated weights for policy 0, policy_version 229948 (0.0009) [2023-12-27 20:52:52,608][106226] Updated weights for policy 0, policy_version 229958 (0.0011) [2023-12-27 20:52:52,924][106225] Updated weights for policy 1, policy_version 230227 (0.0008) [2023-12-27 20:52:52,985][106225] Updated weights for policy 1, policy_version 230237 (0.0007) [2023-12-27 20:52:53,043][106225] Updated weights for policy 1, policy_version 230247 (0.0008) [2023-12-27 20:52:53,318][106226] Updated weights for policy 0, policy_version 229968 (0.0007) [2023-12-27 20:52:53,373][106226] Updated weights for policy 0, policy_version 229978 (0.0009) [2023-12-27 20:52:53,436][106226] Updated weights for policy 0, policy_version 229988 (0.0011) [2023-12-27 20:52:53,804][106225] Updated weights for policy 1, policy_version 230257 (0.0008) [2023-12-27 20:52:53,861][106225] Updated weights for policy 1, policy_version 230267 (0.0010) [2023-12-27 20:52:53,916][106225] Updated weights for policy 1, policy_version 230277 (0.0008) [2023-12-27 20:52:53,978][106225] Updated weights for policy 1, policy_version 230287 (0.0008) [2023-12-27 20:52:54,007][106226] Updated weights for policy 0, policy_version 229998 (0.0008) [2023-12-27 20:52:54,071][106226] Updated weights for policy 0, policy_version 230008 (0.0006) [2023-12-27 20:52:54,131][106226] Updated weights for policy 0, policy_version 230018 (0.0008) [2023-12-27 20:52:54,681][106225] Updated weights for policy 1, policy_version 230297 (0.0010) [2023-12-27 20:52:54,734][106225] Updated weights for policy 1, policy_version 230307 (0.0010) [2023-12-27 20:52:54,767][106226] Updated weights for policy 0, policy_version 230028 (0.0007) [2023-12-27 20:52:54,781][106225] Updated weights for policy 1, policy_version 230317 (0.0010) [2023-12-27 20:52:54,818][106226] Updated weights for policy 0, policy_version 230038 (0.0005) [2023-12-27 20:52:54,872][106226] Updated weights for policy 0, policy_version 230048 (0.0008) [2023-12-27 20:52:55,412][106225] Updated weights for policy 1, policy_version 230327 (0.0008) [2023-12-27 20:52:55,474][106225] Updated weights for policy 1, policy_version 230337 (0.0010) [2023-12-27 20:52:55,534][106225] Updated weights for policy 1, policy_version 230347 (0.0010) [2023-12-27 20:52:55,639][106226] Updated weights for policy 0, policy_version 230058 (0.0009) [2023-12-27 20:52:55,683][106226] Updated weights for policy 0, policy_version 230068 (0.0008) [2023-12-27 20:52:55,729][106226] Updated weights for policy 0, policy_version 230078 (0.0007) [2023-12-27 20:52:55,772][106226] Updated weights for policy 0, policy_version 230088 (0.0008) [2023-12-27 20:52:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 117899264. Throughput: 0: 9902.0, 1: 9969.9. Samples: 117869672. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:52:56,175][105115] Avg episode reward: [(0, '-4.946'), (1, '-5.987')] [2023-12-27 20:52:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000230088_58916864.pth... [2023-12-27 20:52:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000228904_58613760.pth [2023-12-27 20:52:56,209][106225] Updated weights for policy 1, policy_version 230357 (0.0010) [2023-12-27 20:52:56,262][106225] Updated weights for policy 1, policy_version 230367 (0.0009) [2023-12-27 20:52:56,324][106225] Updated weights for policy 1, policy_version 230377 (0.0008) [2023-12-27 20:52:56,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000230384_58990592.pth... [2023-12-27 20:52:56,358][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000229200_58687488.pth [2023-12-27 20:52:56,537][106226] Updated weights for policy 0, policy_version 230098 (0.0008) [2023-12-27 20:52:56,586][106226] Updated weights for policy 0, policy_version 230108 (0.0009) [2023-12-27 20:52:56,631][106226] Updated weights for policy 0, policy_version 230118 (0.0008) [2023-12-27 20:52:57,038][106225] Updated weights for policy 1, policy_version 230387 (0.0008) [2023-12-27 20:52:57,087][106225] Updated weights for policy 1, policy_version 230398 (0.0008) [2023-12-27 20:52:57,136][106225] Updated weights for policy 1, policy_version 230408 (0.0007) [2023-12-27 20:52:57,304][106226] Updated weights for policy 0, policy_version 230128 (0.0009) [2023-12-27 20:52:57,365][106226] Updated weights for policy 0, policy_version 230138 (0.0009) [2023-12-27 20:52:57,412][106226] Updated weights for policy 0, policy_version 230148 (0.0008) [2023-12-27 20:52:57,787][106225] Updated weights for policy 1, policy_version 230418 (0.0009) [2023-12-27 20:52:57,830][106225] Updated weights for policy 1, policy_version 230428 (0.0010) [2023-12-27 20:52:57,882][106225] Updated weights for policy 1, policy_version 230438 (0.0010) [2023-12-27 20:52:57,931][106225] Updated weights for policy 1, policy_version 230448 (0.0010) [2023-12-27 20:52:58,219][106226] Updated weights for policy 0, policy_version 230158 (0.0008) [2023-12-27 20:52:58,285][106226] Updated weights for policy 0, policy_version 230168 (0.0007) [2023-12-27 20:52:58,350][106226] Updated weights for policy 0, policy_version 230178 (0.0009) [2023-12-27 20:52:58,611][106225] Updated weights for policy 1, policy_version 230458 (0.0008) [2023-12-27 20:52:58,673][106225] Updated weights for policy 1, policy_version 230468 (0.0008) [2023-12-27 20:52:58,741][106225] Updated weights for policy 1, policy_version 230478 (0.0008) [2023-12-27 20:52:59,185][106226] Updated weights for policy 0, policy_version 230188 (0.0008) [2023-12-27 20:52:59,266][106226] Updated weights for policy 0, policy_version 230198 (0.0008) [2023-12-27 20:52:59,339][106226] Updated weights for policy 0, policy_version 230208 (0.0008) [2023-12-27 20:52:59,605][106225] Updated weights for policy 1, policy_version 230488 (0.0006) [2023-12-27 20:52:59,666][106225] Updated weights for policy 1, policy_version 230498 (0.0006) [2023-12-27 20:52:59,727][106225] Updated weights for policy 1, policy_version 230508 (0.0005) [2023-12-27 20:53:00,073][106226] Updated weights for policy 0, policy_version 230218 (0.0007) [2023-12-27 20:53:00,132][106226] Updated weights for policy 0, policy_version 230228 (0.0005) [2023-12-27 20:53:00,198][106226] Updated weights for policy 0, policy_version 230238 (0.0006) [2023-12-27 20:53:00,259][106226] Updated weights for policy 0, policy_version 230248 (0.0006) [2023-12-27 20:53:00,383][106225] Updated weights for policy 1, policy_version 230518 (0.0007) [2023-12-27 20:53:00,445][106225] Updated weights for policy 1, policy_version 230528 (0.0009) [2023-12-27 20:53:00,512][106225] Updated weights for policy 1, policy_version 230538 (0.0010) [2023-12-27 20:53:00,890][106226] Updated weights for policy 0, policy_version 230258 (0.0008) [2023-12-27 20:53:00,949][106226] Updated weights for policy 0, policy_version 230268 (0.0008) [2023-12-27 20:53:01,002][106226] Updated weights for policy 0, policy_version 230278 (0.0007) [2023-12-27 20:53:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 117997568. Throughput: 0: 9886.1, 1: 9995.7. Samples: 117986072. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:53:01,175][105115] Avg episode reward: [(0, '-5.304'), (1, '-5.839')] [2023-12-27 20:53:01,184][106225] Updated weights for policy 1, policy_version 230548 (0.0009) [2023-12-27 20:53:01,248][106225] Updated weights for policy 1, policy_version 230558 (0.0006) [2023-12-27 20:53:01,311][106225] Updated weights for policy 1, policy_version 230568 (0.0007) [2023-12-27 20:53:01,803][106226] Updated weights for policy 0, policy_version 230288 (0.0009) [2023-12-27 20:53:01,868][106226] Updated weights for policy 0, policy_version 230298 (0.0008) [2023-12-27 20:53:01,919][106226] Updated weights for policy 0, policy_version 230308 (0.0005) [2023-12-27 20:53:02,026][106225] Updated weights for policy 1, policy_version 230579 (0.0009) [2023-12-27 20:53:02,093][106225] Updated weights for policy 1, policy_version 230589 (0.0008) [2023-12-27 20:53:02,147][106225] Updated weights for policy 1, policy_version 230599 (0.0008) [2023-12-27 20:53:02,598][106226] Updated weights for policy 0, policy_version 230318 (0.0008) [2023-12-27 20:53:02,658][106226] Updated weights for policy 0, policy_version 230328 (0.0010) [2023-12-27 20:53:02,718][106226] Updated weights for policy 0, policy_version 230338 (0.0010) [2023-12-27 20:53:02,898][106225] Updated weights for policy 1, policy_version 230609 (0.0008) [2023-12-27 20:53:02,945][106225] Updated weights for policy 1, policy_version 230619 (0.0008) [2023-12-27 20:53:02,995][106225] Updated weights for policy 1, policy_version 230629 (0.0007) [2023-12-27 20:53:03,047][106225] Updated weights for policy 1, policy_version 230639 (0.0007) [2023-12-27 20:53:03,422][106226] Updated weights for policy 0, policy_version 230348 (0.0010) [2023-12-27 20:53:03,483][106226] Updated weights for policy 0, policy_version 230358 (0.0010) [2023-12-27 20:53:03,538][106226] Updated weights for policy 0, policy_version 230368 (0.0010) [2023-12-27 20:53:03,795][106225] Updated weights for policy 1, policy_version 230649 (0.0007) [2023-12-27 20:53:03,850][106225] Updated weights for policy 1, policy_version 230659 (0.0008) [2023-12-27 20:53:03,912][106225] Updated weights for policy 1, policy_version 230669 (0.0008) [2023-12-27 20:53:04,252][106226] Updated weights for policy 0, policy_version 230378 (0.0010) [2023-12-27 20:53:04,320][106226] Updated weights for policy 0, policy_version 230388 (0.0011) [2023-12-27 20:53:04,377][106226] Updated weights for policy 0, policy_version 230398 (0.0010) [2023-12-27 20:53:04,437][106226] Updated weights for policy 0, policy_version 230408 (0.0010) [2023-12-27 20:53:04,644][106225] Updated weights for policy 1, policy_version 230679 (0.0008) [2023-12-27 20:53:04,689][106225] Updated weights for policy 1, policy_version 230689 (0.0007) [2023-12-27 20:53:04,739][106225] Updated weights for policy 1, policy_version 230699 (0.0008) [2023-12-27 20:53:05,135][106226] Updated weights for policy 0, policy_version 230418 (0.0010) [2023-12-27 20:53:05,188][106226] Updated weights for policy 0, policy_version 230428 (0.0010) [2023-12-27 20:53:05,247][106226] Updated weights for policy 0, policy_version 230438 (0.0010) [2023-12-27 20:53:05,484][106225] Updated weights for policy 1, policy_version 230709 (0.0007) [2023-12-27 20:53:05,530][106225] Updated weights for policy 1, policy_version 230719 (0.0008) [2023-12-27 20:53:05,577][106225] Updated weights for policy 1, policy_version 230729 (0.0008) [2023-12-27 20:53:05,950][106226] Updated weights for policy 0, policy_version 230448 (0.0010) [2023-12-27 20:53:06,002][106226] Updated weights for policy 0, policy_version 230458 (0.0010) [2023-12-27 20:53:06,060][106226] Updated weights for policy 0, policy_version 230468 (0.0010) [2023-12-27 20:53:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 118095872. Throughput: 0: 9921.4, 1: 9900.5. Samples: 118102616. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:53:06,175][105115] Avg episode reward: [(0, '-5.016'), (1, '-6.039')] [2023-12-27 20:53:06,336][106225] Updated weights for policy 1, policy_version 230739 (0.0008) [2023-12-27 20:53:06,387][106225] Updated weights for policy 1, policy_version 230749 (0.0008) [2023-12-27 20:53:06,445][106225] Updated weights for policy 1, policy_version 230759 (0.0008) [2023-12-27 20:53:06,814][106226] Updated weights for policy 0, policy_version 230478 (0.0010) [2023-12-27 20:53:06,864][106226] Updated weights for policy 0, policy_version 230488 (0.0010) [2023-12-27 20:53:06,927][106226] Updated weights for policy 0, policy_version 230498 (0.0009) [2023-12-27 20:53:07,198][106225] Updated weights for policy 1, policy_version 230769 (0.0008) [2023-12-27 20:53:07,269][106225] Updated weights for policy 1, policy_version 230779 (0.0010) [2023-12-27 20:53:07,329][106225] Updated weights for policy 1, policy_version 230789 (0.0010) [2023-12-27 20:53:07,390][106225] Updated weights for policy 1, policy_version 230799 (0.0010) [2023-12-27 20:53:07,537][106226] Updated weights for policy 0, policy_version 230508 (0.0007) [2023-12-27 20:53:07,596][106226] Updated weights for policy 0, policy_version 230518 (0.0010) [2023-12-27 20:53:07,659][106226] Updated weights for policy 0, policy_version 230528 (0.0008) [2023-12-27 20:53:07,952][106225] Updated weights for policy 1, policy_version 230809 (0.0009) [2023-12-27 20:53:08,006][106225] Updated weights for policy 1, policy_version 230819 (0.0009) [2023-12-27 20:53:08,068][106225] Updated weights for policy 1, policy_version 230829 (0.0010) [2023-12-27 20:53:08,236][106226] Updated weights for policy 0, policy_version 230538 (0.0006) [2023-12-27 20:53:08,295][106226] Updated weights for policy 0, policy_version 230548 (0.0010) [2023-12-27 20:53:08,365][106226] Updated weights for policy 0, policy_version 230558 (0.0011) [2023-12-27 20:53:08,428][106226] Updated weights for policy 0, policy_version 230568 (0.0011) [2023-12-27 20:53:08,786][106225] Updated weights for policy 1, policy_version 230839 (0.0010) [2023-12-27 20:53:08,847][106225] Updated weights for policy 1, policy_version 230849 (0.0010) [2023-12-27 20:53:08,907][106225] Updated weights for policy 1, policy_version 230859 (0.0011) [2023-12-27 20:53:09,103][106226] Updated weights for policy 0, policy_version 230578 (0.0010) [2023-12-27 20:53:09,149][106226] Updated weights for policy 0, policy_version 230588 (0.0007) [2023-12-27 20:53:09,199][106226] Updated weights for policy 0, policy_version 230598 (0.0007) [2023-12-27 20:53:09,735][106225] Updated weights for policy 1, policy_version 230869 (0.0009) [2023-12-27 20:53:09,797][106225] Updated weights for policy 1, policy_version 230879 (0.0008) [2023-12-27 20:53:09,872][106225] Updated weights for policy 1, policy_version 230889 (0.0008) [2023-12-27 20:53:09,934][106226] Updated weights for policy 0, policy_version 230608 (0.0009) [2023-12-27 20:53:10,003][106226] Updated weights for policy 0, policy_version 230618 (0.0008) [2023-12-27 20:53:10,072][106226] Updated weights for policy 0, policy_version 230628 (0.0008) [2023-12-27 20:53:10,483][106225] Updated weights for policy 1, policy_version 230899 (0.0008) [2023-12-27 20:53:10,541][106225] Updated weights for policy 1, policy_version 230909 (0.0008) [2023-12-27 20:53:10,597][106225] Updated weights for policy 1, policy_version 230919 (0.0008) [2023-12-27 20:53:10,747][106226] Updated weights for policy 0, policy_version 230638 (0.0010) [2023-12-27 20:53:10,798][106226] Updated weights for policy 0, policy_version 230648 (0.0010) [2023-12-27 20:53:10,847][106226] Updated weights for policy 0, policy_version 230658 (0.0010) [2023-12-27 20:53:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 118194176. Throughput: 0: 9963.9, 1: 9917.8. Samples: 118164348. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-27 20:53:11,175][105115] Avg episode reward: [(0, '-5.276'), (1, '-6.015')] [2023-12-27 20:53:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000230928_59129856.pth... [2023-12-27 20:53:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000230664_59064320.pth... [2023-12-27 20:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000229512_58769408.pth [2023-12-27 20:53:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000229808_58843136.pth [2023-12-27 20:53:11,331][106225] Updated weights for policy 1, policy_version 230929 (0.0008) [2023-12-27 20:53:11,400][106225] Updated weights for policy 1, policy_version 230939 (0.0008) [2023-12-27 20:53:11,459][106225] Updated weights for policy 1, policy_version 230949 (0.0008) [2023-12-27 20:53:11,522][106225] Updated weights for policy 1, policy_version 230959 (0.0008) [2023-12-27 20:53:11,597][106226] Updated weights for policy 0, policy_version 230668 (0.0011) [2023-12-27 20:53:11,664][106226] Updated weights for policy 0, policy_version 230678 (0.0010) [2023-12-27 20:53:11,730][106226] Updated weights for policy 0, policy_version 230688 (0.0009) [2023-12-27 20:53:12,240][106225] Updated weights for policy 1, policy_version 230969 (0.0007) [2023-12-27 20:53:12,302][106225] Updated weights for policy 1, policy_version 230979 (0.0006) [2023-12-27 20:53:12,370][106225] Updated weights for policy 1, policy_version 230989 (0.0008) [2023-12-27 20:53:12,524][106226] Updated weights for policy 0, policy_version 230698 (0.0008) [2023-12-27 20:53:12,578][106226] Updated weights for policy 0, policy_version 230708 (0.0009) [2023-12-27 20:53:12,635][106226] Updated weights for policy 0, policy_version 230718 (0.0006) [2023-12-27 20:53:12,692][106226] Updated weights for policy 0, policy_version 230728 (0.0010) [2023-12-27 20:53:13,082][106225] Updated weights for policy 1, policy_version 230999 (0.0007) [2023-12-27 20:53:13,140][106225] Updated weights for policy 1, policy_version 231009 (0.0006) [2023-12-27 20:53:13,194][106225] Updated weights for policy 1, policy_version 231019 (0.0007) [2023-12-27 20:53:13,358][106226] Updated weights for policy 0, policy_version 230738 (0.0006) [2023-12-27 20:53:13,423][106226] Updated weights for policy 0, policy_version 230748 (0.0005) [2023-12-27 20:53:13,479][106226] Updated weights for policy 0, policy_version 230758 (0.0005) [2023-12-27 20:53:13,917][106225] Updated weights for policy 1, policy_version 231030 (0.0008) [2023-12-27 20:53:13,980][106225] Updated weights for policy 1, policy_version 231040 (0.0009) [2023-12-27 20:53:14,042][106225] Updated weights for policy 1, policy_version 231050 (0.0009) [2023-12-27 20:53:14,068][106226] Updated weights for policy 0, policy_version 230768 (0.0008) [2023-12-27 20:53:14,136][106226] Updated weights for policy 0, policy_version 230778 (0.0009) [2023-12-27 20:53:14,198][106226] Updated weights for policy 0, policy_version 230788 (0.0009) [2023-12-27 20:53:14,763][106225] Updated weights for policy 1, policy_version 231060 (0.0007) [2023-12-27 20:53:14,821][106225] Updated weights for policy 1, policy_version 231070 (0.0007) [2023-12-27 20:53:14,880][106226] Updated weights for policy 0, policy_version 230798 (0.0010) [2023-12-27 20:53:14,882][106225] Updated weights for policy 1, policy_version 231080 (0.0008) [2023-12-27 20:53:14,932][106226] Updated weights for policy 0, policy_version 230808 (0.0011) [2023-12-27 20:53:14,993][106226] Updated weights for policy 0, policy_version 230818 (0.0011) [2023-12-27 20:53:15,535][106225] Updated weights for policy 1, policy_version 231090 (0.0006) [2023-12-27 20:53:15,584][106225] Updated weights for policy 1, policy_version 231100 (0.0008) [2023-12-27 20:53:15,633][106225] Updated weights for policy 1, policy_version 231110 (0.0006) [2023-12-27 20:53:15,687][106225] Updated weights for policy 1, policy_version 231120 (0.0008) [2023-12-27 20:53:15,710][106226] Updated weights for policy 0, policy_version 230828 (0.0009) [2023-12-27 20:53:15,778][106226] Updated weights for policy 0, policy_version 230838 (0.0005) [2023-12-27 20:53:15,838][106226] Updated weights for policy 0, policy_version 230848 (0.0005) [2023-12-27 20:53:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 118292480. Throughput: 0: 9881.4, 1: 9826.9. Samples: 118281052. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:16,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-6.158')] [2023-12-27 20:53:16,308][106225] Updated weights for policy 1, policy_version 231130 (0.0008) [2023-12-27 20:53:16,368][106225] Updated weights for policy 1, policy_version 231140 (0.0009) [2023-12-27 20:53:16,404][106226] Updated weights for policy 0, policy_version 230858 (0.0006) [2023-12-27 20:53:16,427][106225] Updated weights for policy 1, policy_version 231150 (0.0010) [2023-12-27 20:53:16,461][106226] Updated weights for policy 0, policy_version 230868 (0.0010) [2023-12-27 20:53:16,514][106226] Updated weights for policy 0, policy_version 230878 (0.0007) [2023-12-27 20:53:16,568][106226] Updated weights for policy 0, policy_version 230888 (0.0011) [2023-12-27 20:53:17,093][106225] Updated weights for policy 1, policy_version 231160 (0.0006) [2023-12-27 20:53:17,151][106225] Updated weights for policy 1, policy_version 231170 (0.0008) [2023-12-27 20:53:17,212][106225] Updated weights for policy 1, policy_version 231180 (0.0005) [2023-12-27 20:53:17,261][106226] Updated weights for policy 0, policy_version 230898 (0.0011) [2023-12-27 20:53:17,316][106226] Updated weights for policy 0, policy_version 230908 (0.0007) [2023-12-27 20:53:17,378][106226] Updated weights for policy 0, policy_version 230918 (0.0005) [2023-12-27 20:53:17,847][106225] Updated weights for policy 1, policy_version 231190 (0.0010) [2023-12-27 20:53:17,894][106225] Updated weights for policy 1, policy_version 231200 (0.0010) [2023-12-27 20:53:17,938][106225] Updated weights for policy 1, policy_version 231210 (0.0010) [2023-12-27 20:53:18,028][106226] Updated weights for policy 0, policy_version 230928 (0.0010) [2023-12-27 20:53:18,092][106226] Updated weights for policy 0, policy_version 230938 (0.0010) [2023-12-27 20:53:18,156][106226] Updated weights for policy 0, policy_version 230948 (0.0011) [2023-12-27 20:53:18,613][106225] Updated weights for policy 1, policy_version 231220 (0.0010) [2023-12-27 20:53:18,670][106225] Updated weights for policy 1, policy_version 231230 (0.0010) [2023-12-27 20:53:18,725][106225] Updated weights for policy 1, policy_version 231240 (0.0005) [2023-12-27 20:53:18,831][106226] Updated weights for policy 0, policy_version 230958 (0.0009) [2023-12-27 20:53:18,903][106226] Updated weights for policy 0, policy_version 230968 (0.0008) [2023-12-27 20:53:18,978][106226] Updated weights for policy 0, policy_version 230978 (0.0011) [2023-12-27 20:53:19,399][106225] Updated weights for policy 1, policy_version 231250 (0.0007) [2023-12-27 20:53:19,453][106225] Updated weights for policy 1, policy_version 231260 (0.0010) [2023-12-27 20:53:19,512][106225] Updated weights for policy 1, policy_version 231270 (0.0010) [2023-12-27 20:53:19,573][106225] Updated weights for policy 1, policy_version 231280 (0.0010) [2023-12-27 20:53:19,740][106226] Updated weights for policy 0, policy_version 230988 (0.0009) [2023-12-27 20:53:19,802][106226] Updated weights for policy 0, policy_version 230998 (0.0007) [2023-12-27 20:53:19,871][106226] Updated weights for policy 0, policy_version 231008 (0.0008) [2023-12-27 20:53:20,327][106225] Updated weights for policy 1, policy_version 231290 (0.0008) [2023-12-27 20:53:20,383][106225] Updated weights for policy 1, policy_version 231300 (0.0008) [2023-12-27 20:53:20,440][106225] Updated weights for policy 1, policy_version 231310 (0.0009) [2023-12-27 20:53:20,553][106226] Updated weights for policy 0, policy_version 231018 (0.0007) [2023-12-27 20:53:20,619][106226] Updated weights for policy 0, policy_version 231028 (0.0007) [2023-12-27 20:53:20,679][106226] Updated weights for policy 0, policy_version 231038 (0.0006) [2023-12-27 20:53:20,747][106226] Updated weights for policy 0, policy_version 231048 (0.0006) [2023-12-27 20:53:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 118390784. Throughput: 0: 9846.5, 1: 9848.8. Samples: 118402680. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:21,175][105115] Avg episode reward: [(0, '-5.002'), (1, '-5.684')] [2023-12-27 20:53:21,237][106225] Updated weights for policy 1, policy_version 231320 (0.0008) [2023-12-27 20:53:21,300][106225] Updated weights for policy 1, policy_version 231330 (0.0006) [2023-12-27 20:53:21,368][106225] Updated weights for policy 1, policy_version 231340 (0.0007) [2023-12-27 20:53:21,427][106226] Updated weights for policy 0, policy_version 231058 (0.0009) [2023-12-27 20:53:21,484][106226] Updated weights for policy 0, policy_version 231068 (0.0008) [2023-12-27 20:53:21,534][106226] Updated weights for policy 0, policy_version 231078 (0.0009) [2023-12-27 20:53:22,119][106225] Updated weights for policy 1, policy_version 231350 (0.0007) [2023-12-27 20:53:22,192][106225] Updated weights for policy 1, policy_version 231360 (0.0005) [2023-12-27 20:53:22,252][106225] Updated weights for policy 1, policy_version 231370 (0.0006) [2023-12-27 20:53:22,384][106226] Updated weights for policy 0, policy_version 231088 (0.0009) [2023-12-27 20:53:22,451][106226] Updated weights for policy 0, policy_version 231098 (0.0010) [2023-12-27 20:53:22,510][106226] Updated weights for policy 0, policy_version 231108 (0.0009) [2023-12-27 20:53:22,832][106225] Updated weights for policy 1, policy_version 231380 (0.0008) [2023-12-27 20:53:22,886][106225] Updated weights for policy 1, policy_version 231390 (0.0010) [2023-12-27 20:53:22,947][106225] Updated weights for policy 1, policy_version 231400 (0.0010) [2023-12-27 20:53:23,227][106226] Updated weights for policy 0, policy_version 231118 (0.0007) [2023-12-27 20:53:23,282][106226] Updated weights for policy 0, policy_version 231128 (0.0008) [2023-12-27 20:53:23,338][106226] Updated weights for policy 0, policy_version 231138 (0.0008) [2023-12-27 20:53:23,663][106225] Updated weights for policy 1, policy_version 231410 (0.0011) [2023-12-27 20:53:23,716][106225] Updated weights for policy 1, policy_version 231420 (0.0010) [2023-12-27 20:53:23,769][106225] Updated weights for policy 1, policy_version 231430 (0.0010) [2023-12-27 20:53:23,819][106225] Updated weights for policy 1, policy_version 231440 (0.0010) [2023-12-27 20:53:24,001][106226] Updated weights for policy 0, policy_version 231148 (0.0007) [2023-12-27 20:53:24,054][106226] Updated weights for policy 0, policy_version 231158 (0.0005) [2023-12-27 20:53:24,115][106226] Updated weights for policy 0, policy_version 231168 (0.0007) [2023-12-27 20:53:24,554][106225] Updated weights for policy 1, policy_version 231450 (0.0010) [2023-12-27 20:53:24,612][106225] Updated weights for policy 1, policy_version 231460 (0.0010) [2023-12-27 20:53:24,671][106225] Updated weights for policy 1, policy_version 231470 (0.0010) [2023-12-27 20:53:24,685][106226] Updated weights for policy 0, policy_version 231178 (0.0007) [2023-12-27 20:53:24,743][106226] Updated weights for policy 0, policy_version 231188 (0.0008) [2023-12-27 20:53:24,796][106226] Updated weights for policy 0, policy_version 231198 (0.0009) [2023-12-27 20:53:24,842][106226] Updated weights for policy 0, policy_version 231208 (0.0006) [2023-12-27 20:53:25,364][106225] Updated weights for policy 1, policy_version 231480 (0.0010) [2023-12-27 20:53:25,414][106225] Updated weights for policy 1, policy_version 231490 (0.0008) [2023-12-27 20:53:25,459][106225] Updated weights for policy 1, policy_version 231500 (0.0007) [2023-12-27 20:53:25,475][106226] Updated weights for policy 0, policy_version 231218 (0.0007) [2023-12-27 20:53:25,540][106226] Updated weights for policy 0, policy_version 231228 (0.0009) [2023-12-27 20:53:25,604][106226] Updated weights for policy 0, policy_version 231238 (0.0008) [2023-12-27 20:53:26,168][106225] Updated weights for policy 1, policy_version 231510 (0.0008) [2023-12-27 20:53:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 118489088. Throughput: 0: 9815.1, 1: 9821.6. Samples: 118460864. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:26,176][105115] Avg episode reward: [(0, '-5.019'), (1, '-6.538')] [2023-12-27 20:53:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000231240_59211776.pth... [2023-12-27 20:53:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000230088_58916864.pth [2023-12-27 20:53:26,230][106225] Updated weights for policy 1, policy_version 231520 (0.0010) [2023-12-27 20:53:26,291][106225] Updated weights for policy 1, policy_version 231530 (0.0010) [2023-12-27 20:53:26,309][106226] Updated weights for policy 0, policy_version 231248 (0.0007) [2023-12-27 20:53:26,326][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000231536_59285504.pth... [2023-12-27 20:53:26,329][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000230384_58990592.pth [2023-12-27 20:53:26,358][106226] Updated weights for policy 0, policy_version 231258 (0.0008) [2023-12-27 20:53:26,417][106226] Updated weights for policy 0, policy_version 231268 (0.0008) [2023-12-27 20:53:27,016][106225] Updated weights for policy 1, policy_version 231540 (0.0010) [2023-12-27 20:53:27,075][106225] Updated weights for policy 1, policy_version 231550 (0.0010) [2023-12-27 20:53:27,134][106225] Updated weights for policy 1, policy_version 231560 (0.0010) [2023-12-27 20:53:27,136][106226] Updated weights for policy 0, policy_version 231278 (0.0008) [2023-12-27 20:53:27,178][106226] Updated weights for policy 0, policy_version 231288 (0.0005) [2023-12-27 20:53:27,224][106226] Updated weights for policy 0, policy_version 231298 (0.0005) [2023-12-27 20:53:27,706][106225] Updated weights for policy 1, policy_version 231570 (0.0009) [2023-12-27 20:53:27,764][106225] Updated weights for policy 1, policy_version 231580 (0.0005) [2023-12-27 20:53:27,815][106225] Updated weights for policy 1, policy_version 231590 (0.0005) [2023-12-27 20:53:27,867][106225] Updated weights for policy 1, policy_version 231600 (0.0005) [2023-12-27 20:53:27,886][106226] Updated weights for policy 0, policy_version 231308 (0.0005) [2023-12-27 20:53:27,955][106226] Updated weights for policy 0, policy_version 231318 (0.0006) [2023-12-27 20:53:28,020][106226] Updated weights for policy 0, policy_version 231328 (0.0008) [2023-12-27 20:53:28,508][106225] Updated weights for policy 1, policy_version 231610 (0.0010) [2023-12-27 20:53:28,565][106225] Updated weights for policy 1, policy_version 231620 (0.0010) [2023-12-27 20:53:28,632][106225] Updated weights for policy 1, policy_version 231630 (0.0010) [2023-12-27 20:53:28,694][106226] Updated weights for policy 0, policy_version 231338 (0.0011) [2023-12-27 20:53:28,754][106226] Updated weights for policy 0, policy_version 231348 (0.0010) [2023-12-27 20:53:28,808][106226] Updated weights for policy 0, policy_version 231358 (0.0009) [2023-12-27 20:53:28,855][106226] Updated weights for policy 0, policy_version 231368 (0.0005) [2023-12-27 20:53:29,252][106225] Updated weights for policy 1, policy_version 231640 (0.0009) [2023-12-27 20:53:29,323][106225] Updated weights for policy 1, policy_version 231650 (0.0009) [2023-12-27 20:53:29,384][106225] Updated weights for policy 1, policy_version 231660 (0.0010) [2023-12-27 20:53:29,517][106226] Updated weights for policy 0, policy_version 231378 (0.0010) [2023-12-27 20:53:29,574][106226] Updated weights for policy 0, policy_version 231388 (0.0010) [2023-12-27 20:53:29,627][106226] Updated weights for policy 0, policy_version 231398 (0.0010) [2023-12-27 20:53:30,139][106225] Updated weights for policy 1, policy_version 231670 (0.0007) [2023-12-27 20:53:30,203][106225] Updated weights for policy 1, policy_version 231680 (0.0008) [2023-12-27 20:53:30,267][106225] Updated weights for policy 1, policy_version 231690 (0.0008) [2023-12-27 20:53:30,376][106226] Updated weights for policy 0, policy_version 231408 (0.0010) [2023-12-27 20:53:30,426][106226] Updated weights for policy 0, policy_version 231418 (0.0010) [2023-12-27 20:53:30,471][106226] Updated weights for policy 0, policy_version 231428 (0.0010) [2023-12-27 20:53:30,989][106225] Updated weights for policy 1, policy_version 231700 (0.0008) [2023-12-27 20:53:31,061][106225] Updated weights for policy 1, policy_version 231710 (0.0008) [2023-12-27 20:53:31,147][106225] Updated weights for policy 1, policy_version 231720 (0.0008) [2023-12-27 20:53:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 118587392. Throughput: 0: 9918.2, 1: 9913.6. Samples: 118584032. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:31,175][105115] Avg episode reward: [(0, '-5.248'), (1, '-6.087')] [2023-12-27 20:53:31,198][106226] Updated weights for policy 0, policy_version 231438 (0.0007) [2023-12-27 20:53:31,260][106226] Updated weights for policy 0, policy_version 231448 (0.0007) [2023-12-27 20:53:31,317][106226] Updated weights for policy 0, policy_version 231458 (0.0009) [2023-12-27 20:53:31,849][106225] Updated weights for policy 1, policy_version 231730 (0.0008) [2023-12-27 20:53:31,908][106225] Updated weights for policy 1, policy_version 231740 (0.0009) [2023-12-27 20:53:31,958][106225] Updated weights for policy 1, policy_version 231750 (0.0009) [2023-12-27 20:53:32,003][106226] Updated weights for policy 0, policy_version 231468 (0.0007) [2023-12-27 20:53:32,009][106225] Updated weights for policy 1, policy_version 231760 (0.0008) [2023-12-27 20:53:32,061][106226] Updated weights for policy 0, policy_version 231478 (0.0007) [2023-12-27 20:53:32,118][106226] Updated weights for policy 0, policy_version 231488 (0.0005) [2023-12-27 20:53:32,790][106225] Updated weights for policy 1, policy_version 231770 (0.0008) [2023-12-27 20:53:32,790][106226] Updated weights for policy 0, policy_version 231498 (0.0010) [2023-12-27 20:53:32,848][106226] Updated weights for policy 0, policy_version 231508 (0.0008) [2023-12-27 20:53:32,851][106225] Updated weights for policy 1, policy_version 231780 (0.0008) [2023-12-27 20:53:32,907][106225] Updated weights for policy 1, policy_version 231790 (0.0005) [2023-12-27 20:53:32,908][106226] Updated weights for policy 0, policy_version 231518 (0.0008) [2023-12-27 20:53:32,958][106226] Updated weights for policy 0, policy_version 231528 (0.0008) [2023-12-27 20:53:33,620][106226] Updated weights for policy 0, policy_version 231538 (0.0006) [2023-12-27 20:53:33,630][106225] Updated weights for policy 1, policy_version 231800 (0.0007) [2023-12-27 20:53:33,665][106226] Updated weights for policy 0, policy_version 231548 (0.0006) [2023-12-27 20:53:33,681][106225] Updated weights for policy 1, policy_version 231810 (0.0005) [2023-12-27 20:53:33,720][106226] Updated weights for policy 0, policy_version 231558 (0.0007) [2023-12-27 20:53:33,732][106225] Updated weights for policy 1, policy_version 231820 (0.0006) [2023-12-27 20:53:34,368][106225] Updated weights for policy 1, policy_version 231830 (0.0007) [2023-12-27 20:53:34,394][106226] Updated weights for policy 0, policy_version 231568 (0.0005) [2023-12-27 20:53:34,424][106225] Updated weights for policy 1, policy_version 231840 (0.0007) [2023-12-27 20:53:34,458][106226] Updated weights for policy 0, policy_version 231578 (0.0007) [2023-12-27 20:53:34,483][106225] Updated weights for policy 1, policy_version 231850 (0.0006) [2023-12-27 20:53:34,516][106226] Updated weights for policy 0, policy_version 231588 (0.0008) [2023-12-27 20:53:35,128][106225] Updated weights for policy 1, policy_version 231860 (0.0008) [2023-12-27 20:53:35,145][106226] Updated weights for policy 0, policy_version 231598 (0.0009) [2023-12-27 20:53:35,184][106225] Updated weights for policy 1, policy_version 231870 (0.0009) [2023-12-27 20:53:35,201][106226] Updated weights for policy 0, policy_version 231608 (0.0007) [2023-12-27 20:53:35,240][106225] Updated weights for policy 1, policy_version 231880 (0.0008) [2023-12-27 20:53:35,253][106226] Updated weights for policy 0, policy_version 231618 (0.0009) [2023-12-27 20:53:35,901][106225] Updated weights for policy 1, policy_version 231890 (0.0007) [2023-12-27 20:53:35,948][106225] Updated weights for policy 1, policy_version 231900 (0.0005) [2023-12-27 20:53:35,993][106225] Updated weights for policy 1, policy_version 231910 (0.0005) [2023-12-27 20:53:36,023][106226] Updated weights for policy 0, policy_version 231628 (0.0007) [2023-12-27 20:53:36,041][106225] Updated weights for policy 1, policy_version 231920 (0.0005) [2023-12-27 20:53:36,079][106226] Updated weights for policy 0, policy_version 231638 (0.0009) [2023-12-27 20:53:36,148][106226] Updated weights for policy 0, policy_version 231648 (0.0009) [2023-12-27 20:53:36,174][105115] Fps is (10 sec: 20480.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 118693888. Throughput: 0: 9935.0, 1: 9915.0. Samples: 118703444. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:36,175][105115] Avg episode reward: [(0, '-5.163'), (1, '-6.258')] [2023-12-27 20:53:36,653][106225] Updated weights for policy 1, policy_version 231930 (0.0008) [2023-12-27 20:53:36,711][106225] Updated weights for policy 1, policy_version 231940 (0.0008) [2023-12-27 20:53:36,769][106225] Updated weights for policy 1, policy_version 231950 (0.0008) [2023-12-27 20:53:36,914][106226] Updated weights for policy 0, policy_version 231658 (0.0009) [2023-12-27 20:53:36,965][106226] Updated weights for policy 0, policy_version 231668 (0.0009) [2023-12-27 20:53:37,019][106226] Updated weights for policy 0, policy_version 231678 (0.0006) [2023-12-27 20:53:37,082][106226] Updated weights for policy 0, policy_version 231688 (0.0008) [2023-12-27 20:53:37,476][106225] Updated weights for policy 1, policy_version 231960 (0.0007) [2023-12-27 20:53:37,527][106225] Updated weights for policy 1, policy_version 231970 (0.0009) [2023-12-27 20:53:37,578][106225] Updated weights for policy 1, policy_version 231980 (0.0009) [2023-12-27 20:53:37,764][106226] Updated weights for policy 0, policy_version 231698 (0.0009) [2023-12-27 20:53:37,822][106226] Updated weights for policy 0, policy_version 231708 (0.0009) [2023-12-27 20:53:37,886][106226] Updated weights for policy 0, policy_version 231718 (0.0008) [2023-12-27 20:53:38,252][106225] Updated weights for policy 1, policy_version 231990 (0.0008) [2023-12-27 20:53:38,308][106225] Updated weights for policy 1, policy_version 232000 (0.0006) [2023-12-27 20:53:38,367][106225] Updated weights for policy 1, policy_version 232010 (0.0008) [2023-12-27 20:53:38,653][106226] Updated weights for policy 0, policy_version 231728 (0.0008) [2023-12-27 20:53:38,720][106226] Updated weights for policy 0, policy_version 231738 (0.0005) [2023-12-27 20:53:38,787][106226] Updated weights for policy 0, policy_version 231748 (0.0006) [2023-12-27 20:53:39,169][106225] Updated weights for policy 1, policy_version 232020 (0.0009) [2023-12-27 20:53:39,222][106225] Updated weights for policy 1, policy_version 232030 (0.0009) [2023-12-27 20:53:39,286][106225] Updated weights for policy 1, policy_version 232040 (0.0008) [2023-12-27 20:53:39,403][106226] Updated weights for policy 0, policy_version 231758 (0.0007) [2023-12-27 20:53:39,465][106226] Updated weights for policy 0, policy_version 231768 (0.0008) [2023-12-27 20:53:39,525][106226] Updated weights for policy 0, policy_version 231778 (0.0008) [2023-12-27 20:53:40,129][106225] Updated weights for policy 1, policy_version 232050 (0.0008) [2023-12-27 20:53:40,188][106225] Updated weights for policy 1, policy_version 232060 (0.0008) [2023-12-27 20:53:40,250][106225] Updated weights for policy 1, policy_version 232070 (0.0008) [2023-12-27 20:53:40,268][106226] Updated weights for policy 0, policy_version 231788 (0.0008) [2023-12-27 20:53:40,314][106225] Updated weights for policy 1, policy_version 232080 (0.0007) [2023-12-27 20:53:40,333][106226] Updated weights for policy 0, policy_version 231798 (0.0009) [2023-12-27 20:53:40,398][106226] Updated weights for policy 0, policy_version 231808 (0.0009) [2023-12-27 20:53:40,929][106225] Updated weights for policy 1, policy_version 232090 (0.0008) [2023-12-27 20:53:40,991][106225] Updated weights for policy 1, policy_version 232100 (0.0009) [2023-12-27 20:53:41,061][106225] Updated weights for policy 1, policy_version 232110 (0.0008) [2023-12-27 20:53:41,138][106226] Updated weights for policy 0, policy_version 231818 (0.0009) [2023-12-27 20:53:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 118792192. Throughput: 0: 9906.5, 1: 9941.8. Samples: 118762852. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:41,176][105115] Avg episode reward: [(0, '-4.670'), (1, '-5.888')] [2023-12-27 20:53:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000232112_59432960.pth... [2023-12-27 20:53:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000230928_59129856.pth [2023-12-27 20:53:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000232112_59432960.pth [2023-12-27 20:53:41,203][106226] Updated weights for policy 0, policy_version 231828 (0.0009) [2023-12-27 20:53:41,259][106226] Updated weights for policy 0, policy_version 231838 (0.0009) [2023-12-27 20:53:41,322][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000231848_59367424.pth... [2023-12-27 20:53:41,322][106226] Updated weights for policy 0, policy_version 231848 (0.0009) [2023-12-27 20:53:41,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000230664_59064320.pth [2023-12-27 20:53:41,326][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000231848_59367424.pth [2023-12-27 20:53:41,835][106225] Updated weights for policy 1, policy_version 232120 (0.0008) [2023-12-27 20:53:41,898][106225] Updated weights for policy 1, policy_version 232130 (0.0009) [2023-12-27 20:53:41,961][106225] Updated weights for policy 1, policy_version 232140 (0.0008) [2023-12-27 20:53:42,125][106226] Updated weights for policy 0, policy_version 231858 (0.0007) [2023-12-27 20:53:42,195][106226] Updated weights for policy 0, policy_version 231868 (0.0008) [2023-12-27 20:53:42,256][106226] Updated weights for policy 0, policy_version 231878 (0.0009) [2023-12-27 20:53:42,665][106225] Updated weights for policy 1, policy_version 232150 (0.0009) [2023-12-27 20:53:42,727][106225] Updated weights for policy 1, policy_version 232160 (0.0010) [2023-12-27 20:53:42,777][106225] Updated weights for policy 1, policy_version 232170 (0.0009) [2023-12-27 20:53:42,961][106226] Updated weights for policy 0, policy_version 231888 (0.0006) [2023-12-27 20:53:43,016][106226] Updated weights for policy 0, policy_version 231898 (0.0007) [2023-12-27 20:53:43,069][106226] Updated weights for policy 0, policy_version 231908 (0.0009) [2023-12-27 20:53:43,523][106225] Updated weights for policy 1, policy_version 232180 (0.0008) [2023-12-27 20:53:43,583][106225] Updated weights for policy 1, policy_version 232190 (0.0008) [2023-12-27 20:53:43,649][106225] Updated weights for policy 1, policy_version 232200 (0.0008) [2023-12-27 20:53:43,785][106226] Updated weights for policy 0, policy_version 231918 (0.0009) [2023-12-27 20:53:43,833][106226] Updated weights for policy 0, policy_version 231928 (0.0009) [2023-12-27 20:53:43,886][106226] Updated weights for policy 0, policy_version 231938 (0.0009) [2023-12-27 20:53:44,349][106225] Updated weights for policy 1, policy_version 232210 (0.0008) [2023-12-27 20:53:44,411][106225] Updated weights for policy 1, policy_version 232220 (0.0008) [2023-12-27 20:53:44,475][106225] Updated weights for policy 1, policy_version 232230 (0.0009) [2023-12-27 20:53:44,541][106225] Updated weights for policy 1, policy_version 232240 (0.0008) [2023-12-27 20:53:44,672][106226] Updated weights for policy 0, policy_version 231948 (0.0009) [2023-12-27 20:53:44,733][106226] Updated weights for policy 0, policy_version 231958 (0.0008) [2023-12-27 20:53:44,797][106226] Updated weights for policy 0, policy_version 231968 (0.0008) [2023-12-27 20:53:45,249][106225] Updated weights for policy 1, policy_version 232250 (0.0008) [2023-12-27 20:53:45,311][106225] Updated weights for policy 1, policy_version 232260 (0.0008) [2023-12-27 20:53:45,370][106225] Updated weights for policy 1, policy_version 232270 (0.0008) [2023-12-27 20:53:45,519][106226] Updated weights for policy 0, policy_version 231978 (0.0008) [2023-12-27 20:53:45,574][106226] Updated weights for policy 0, policy_version 231988 (0.0011) [2023-12-27 20:53:45,634][106226] Updated weights for policy 0, policy_version 231998 (0.0009) [2023-12-27 20:53:45,683][106226] Updated weights for policy 0, policy_version 232008 (0.0008) [2023-12-27 20:53:45,992][106225] Updated weights for policy 1, policy_version 232280 (0.0008) [2023-12-27 20:53:46,039][106225] Updated weights for policy 1, policy_version 232290 (0.0007) [2023-12-27 20:53:46,088][106225] Updated weights for policy 1, policy_version 232300 (0.0008) [2023-12-27 20:53:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 118890496. Throughput: 0: 9918.4, 1: 9859.6. Samples: 118876084. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:46,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-6.154')] [2023-12-27 20:53:46,398][106226] Updated weights for policy 0, policy_version 232018 (0.0009) [2023-12-27 20:53:46,449][106226] Updated weights for policy 0, policy_version 232028 (0.0009) [2023-12-27 20:53:46,501][106226] Updated weights for policy 0, policy_version 232038 (0.0009) [2023-12-27 20:53:46,794][106225] Updated weights for policy 1, policy_version 232310 (0.0009) [2023-12-27 20:53:46,849][106225] Updated weights for policy 1, policy_version 232320 (0.0008) [2023-12-27 20:53:46,904][106225] Updated weights for policy 1, policy_version 232330 (0.0008) [2023-12-27 20:53:47,262][106226] Updated weights for policy 0, policy_version 232048 (0.0008) [2023-12-27 20:53:47,321][106226] Updated weights for policy 0, policy_version 232058 (0.0009) [2023-12-27 20:53:47,380][106226] Updated weights for policy 0, policy_version 232068 (0.0009) [2023-12-27 20:53:47,580][106225] Updated weights for policy 1, policy_version 232340 (0.0008) [2023-12-27 20:53:47,635][106225] Updated weights for policy 1, policy_version 232350 (0.0008) [2023-12-27 20:53:47,697][106225] Updated weights for policy 1, policy_version 232360 (0.0008) [2023-12-27 20:53:48,067][106226] Updated weights for policy 0, policy_version 232078 (0.0008) [2023-12-27 20:53:48,129][106226] Updated weights for policy 0, policy_version 232088 (0.0009) [2023-12-27 20:53:48,178][106226] Updated weights for policy 0, policy_version 232098 (0.0009) [2023-12-27 20:53:48,484][106225] Updated weights for policy 1, policy_version 232370 (0.0008) [2023-12-27 20:53:48,547][106225] Updated weights for policy 1, policy_version 232380 (0.0008) [2023-12-27 20:53:48,600][106225] Updated weights for policy 1, policy_version 232390 (0.0009) [2023-12-27 20:53:48,649][106225] Updated weights for policy 1, policy_version 232400 (0.0008) [2023-12-27 20:53:48,877][106226] Updated weights for policy 0, policy_version 232108 (0.0007) [2023-12-27 20:53:48,928][106226] Updated weights for policy 0, policy_version 232118 (0.0009) [2023-12-27 20:53:48,975][106226] Updated weights for policy 0, policy_version 232128 (0.0009) [2023-12-27 20:53:49,437][106225] Updated weights for policy 1, policy_version 232410 (0.0008) [2023-12-27 20:53:49,496][106225] Updated weights for policy 1, policy_version 232420 (0.0008) [2023-12-27 20:53:49,553][106225] Updated weights for policy 1, policy_version 232430 (0.0008) [2023-12-27 20:53:49,797][106226] Updated weights for policy 0, policy_version 232138 (0.0009) [2023-12-27 20:53:49,866][106226] Updated weights for policy 0, policy_version 232148 (0.0009) [2023-12-27 20:53:49,926][106226] Updated weights for policy 0, policy_version 232158 (0.0008) [2023-12-27 20:53:50,004][106226] Updated weights for policy 0, policy_version 232168 (0.0008) [2023-12-27 20:53:50,241][106225] Updated weights for policy 1, policy_version 232440 (0.0008) [2023-12-27 20:53:50,293][106225] Updated weights for policy 1, policy_version 232450 (0.0008) [2023-12-27 20:53:50,356][106225] Updated weights for policy 1, policy_version 232460 (0.0008) [2023-12-27 20:53:50,735][106226] Updated weights for policy 0, policy_version 232178 (0.0007) [2023-12-27 20:53:50,802][106226] Updated weights for policy 0, policy_version 232188 (0.0008) [2023-12-27 20:53:50,863][106226] Updated weights for policy 0, policy_version 232198 (0.0005) [2023-12-27 20:53:51,115][106225] Updated weights for policy 1, policy_version 232470 (0.0008) [2023-12-27 20:53:51,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 118980608. Throughput: 0: 9890.9, 1: 9884.6. Samples: 118992516. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:51,175][105115] Avg episode reward: [(0, '-5.699'), (1, '-5.792')] [2023-12-27 20:53:51,183][106225] Updated weights for policy 1, policy_version 232480 (0.0008) [2023-12-27 20:53:51,249][106225] Updated weights for policy 1, policy_version 232490 (0.0008) [2023-12-27 20:53:51,550][106226] Updated weights for policy 0, policy_version 232208 (0.0010) [2023-12-27 20:53:51,608][106226] Updated weights for policy 0, policy_version 232218 (0.0011) [2023-12-27 20:53:51,675][106226] Updated weights for policy 0, policy_version 232228 (0.0011) [2023-12-27 20:53:51,982][106225] Updated weights for policy 1, policy_version 232500 (0.0009) [2023-12-27 20:53:52,044][106225] Updated weights for policy 1, policy_version 232510 (0.0008) [2023-12-27 20:53:52,107][106225] Updated weights for policy 1, policy_version 232520 (0.0007) [2023-12-27 20:53:52,408][106226] Updated weights for policy 0, policy_version 232238 (0.0009) [2023-12-27 20:53:52,458][106226] Updated weights for policy 0, policy_version 232248 (0.0008) [2023-12-27 20:53:52,522][106226] Updated weights for policy 0, policy_version 232258 (0.0009) [2023-12-27 20:53:52,870][106225] Updated weights for policy 1, policy_version 232530 (0.0006) [2023-12-27 20:53:52,926][106225] Updated weights for policy 1, policy_version 232540 (0.0010) [2023-12-27 20:53:52,986][106225] Updated weights for policy 1, policy_version 232550 (0.0010) [2023-12-27 20:53:53,076][106225] Updated weights for policy 1, policy_version 232560 (0.0009) [2023-12-27 20:53:53,156][106226] Updated weights for policy 0, policy_version 232268 (0.0007) [2023-12-27 20:53:53,212][106226] Updated weights for policy 0, policy_version 232278 (0.0009) [2023-12-27 20:53:53,260][106226] Updated weights for policy 0, policy_version 232288 (0.0008) [2023-12-27 20:53:53,616][106225] Updated weights for policy 1, policy_version 232570 (0.0005) [2023-12-27 20:53:53,681][106225] Updated weights for policy 1, policy_version 232580 (0.0009) [2023-12-27 20:53:53,735][106225] Updated weights for policy 1, policy_version 232590 (0.0010) [2023-12-27 20:53:53,921][106226] Updated weights for policy 0, policy_version 232298 (0.0008) [2023-12-27 20:53:53,975][106226] Updated weights for policy 0, policy_version 232308 (0.0009) [2023-12-27 20:53:54,031][106226] Updated weights for policy 0, policy_version 232318 (0.0009) [2023-12-27 20:53:54,092][106226] Updated weights for policy 0, policy_version 232328 (0.0009) [2023-12-27 20:53:54,313][106225] Updated weights for policy 1, policy_version 232600 (0.0010) [2023-12-27 20:53:54,377][106225] Updated weights for policy 1, policy_version 232610 (0.0010) [2023-12-27 20:53:54,439][106225] Updated weights for policy 1, policy_version 232620 (0.0009) [2023-12-27 20:53:54,806][106226] Updated weights for policy 0, policy_version 232338 (0.0009) [2023-12-27 20:53:54,876][106226] Updated weights for policy 0, policy_version 232348 (0.0007) [2023-12-27 20:53:54,939][106226] Updated weights for policy 0, policy_version 232358 (0.0008) [2023-12-27 20:53:55,029][106225] Updated weights for policy 1, policy_version 232630 (0.0007) [2023-12-27 20:53:55,088][106225] Updated weights for policy 1, policy_version 232640 (0.0006) [2023-12-27 20:53:55,149][106225] Updated weights for policy 1, policy_version 232650 (0.0005) [2023-12-27 20:53:55,695][106226] Updated weights for policy 0, policy_version 232368 (0.0008) [2023-12-27 20:53:55,747][106226] Updated weights for policy 0, policy_version 232378 (0.0005) [2023-12-27 20:53:55,775][106225] Updated weights for policy 1, policy_version 232660 (0.0006) [2023-12-27 20:53:55,807][106226] Updated weights for policy 0, policy_version 232388 (0.0006) [2023-12-27 20:53:55,830][106225] Updated weights for policy 1, policy_version 232670 (0.0005) [2023-12-27 20:53:55,877][106225] Updated weights for policy 1, policy_version 232680 (0.0007) [2023-12-27 20:53:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 119087104. Throughput: 0: 9844.1, 1: 9880.4. Samples: 119051956. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:53:56,176][105115] Avg episode reward: [(0, '-4.846'), (1, '-6.280')] [2023-12-27 20:53:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000232688_59580416.pth... [2023-12-27 20:53:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000232392_59506688.pth... [2023-12-27 20:53:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000231536_59285504.pth [2023-12-27 20:53:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000231240_59211776.pth [2023-12-27 20:53:56,395][106226] Updated weights for policy 0, policy_version 232398 (0.0008) [2023-12-27 20:53:56,449][106226] Updated weights for policy 0, policy_version 232408 (0.0009) [2023-12-27 20:53:56,498][106226] Updated weights for policy 0, policy_version 232418 (0.0008) [2023-12-27 20:53:56,581][106225] Updated weights for policy 1, policy_version 232690 (0.0008) [2023-12-27 20:53:56,634][106225] Updated weights for policy 1, policy_version 232700 (0.0005) [2023-12-27 20:53:56,684][106225] Updated weights for policy 1, policy_version 232710 (0.0008) [2023-12-27 20:53:56,737][106225] Updated weights for policy 1, policy_version 232720 (0.0008) [2023-12-27 20:53:57,302][106226] Updated weights for policy 0, policy_version 232428 (0.0009) [2023-12-27 20:53:57,356][106226] Updated weights for policy 0, policy_version 232438 (0.0009) [2023-12-27 20:53:57,357][106225] Updated weights for policy 1, policy_version 232730 (0.0006) [2023-12-27 20:53:57,406][106225] Updated weights for policy 1, policy_version 232740 (0.0005) [2023-12-27 20:53:57,415][106226] Updated weights for policy 0, policy_version 232448 (0.0007) [2023-12-27 20:53:57,464][106225] Updated weights for policy 1, policy_version 232750 (0.0006) [2023-12-27 20:53:58,138][106226] Updated weights for policy 0, policy_version 232458 (0.0007) [2023-12-27 20:53:58,153][106225] Updated weights for policy 1, policy_version 232760 (0.0007) [2023-12-27 20:53:58,190][106226] Updated weights for policy 0, policy_version 232468 (0.0006) [2023-12-27 20:53:58,216][106225] Updated weights for policy 1, policy_version 232770 (0.0007) [2023-12-27 20:53:58,257][106226] Updated weights for policy 0, policy_version 232478 (0.0008) [2023-12-27 20:53:58,275][106225] Updated weights for policy 1, policy_version 232780 (0.0006) [2023-12-27 20:53:58,321][106226] Updated weights for policy 0, policy_version 232488 (0.0008) [2023-12-27 20:53:59,123][106225] Updated weights for policy 1, policy_version 232790 (0.0010) [2023-12-27 20:53:59,127][106226] Updated weights for policy 0, policy_version 232498 (0.0009) [2023-12-27 20:53:59,185][106225] Updated weights for policy 1, policy_version 232800 (0.0010) [2023-12-27 20:53:59,199][106226] Updated weights for policy 0, policy_version 232508 (0.0008) [2023-12-27 20:53:59,261][106225] Updated weights for policy 1, policy_version 232810 (0.0009) [2023-12-27 20:53:59,269][106226] Updated weights for policy 0, policy_version 232518 (0.0008) [2023-12-27 20:53:59,969][106225] Updated weights for policy 1, policy_version 232820 (0.0008) [2023-12-27 20:54:00,006][106226] Updated weights for policy 0, policy_version 232528 (0.0008) [2023-12-27 20:54:00,021][106225] Updated weights for policy 1, policy_version 232830 (0.0006) [2023-12-27 20:54:00,056][106226] Updated weights for policy 0, policy_version 232538 (0.0008) [2023-12-27 20:54:00,070][106225] Updated weights for policy 1, policy_version 232840 (0.0005) [2023-12-27 20:54:00,109][106226] Updated weights for policy 0, policy_version 232548 (0.0008) [2023-12-27 20:54:00,615][106225] Updated weights for policy 1, policy_version 232850 (0.0005) [2023-12-27 20:54:00,680][106225] Updated weights for policy 1, policy_version 232860 (0.0006) [2023-12-27 20:54:00,732][106225] Updated weights for policy 1, policy_version 232870 (0.0008) [2023-12-27 20:54:00,781][106225] Updated weights for policy 1, policy_version 232880 (0.0007) [2023-12-27 20:54:00,830][106226] Updated weights for policy 0, policy_version 232558 (0.0010) [2023-12-27 20:54:00,888][106226] Updated weights for policy 0, policy_version 232568 (0.0010) [2023-12-27 20:54:00,947][106226] Updated weights for policy 0, policy_version 232578 (0.0010) [2023-12-27 20:54:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 119185408. Throughput: 0: 9782.1, 1: 9977.8. Samples: 119170248. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:54:01,175][105115] Avg episode reward: [(0, '-5.268'), (1, '-6.180')] [2023-12-27 20:54:01,399][106225] Updated weights for policy 1, policy_version 232890 (0.0008) [2023-12-27 20:54:01,460][106225] Updated weights for policy 1, policy_version 232900 (0.0006) [2023-12-27 20:54:01,520][106225] Updated weights for policy 1, policy_version 232910 (0.0006) [2023-12-27 20:54:01,746][106226] Updated weights for policy 0, policy_version 232588 (0.0010) [2023-12-27 20:54:01,815][106226] Updated weights for policy 0, policy_version 232598 (0.0009) [2023-12-27 20:54:01,875][106226] Updated weights for policy 0, policy_version 232608 (0.0010) [2023-12-27 20:54:02,186][106225] Updated weights for policy 1, policy_version 232920 (0.0006) [2023-12-27 20:54:02,248][106225] Updated weights for policy 1, policy_version 232930 (0.0006) [2023-12-27 20:54:02,311][106225] Updated weights for policy 1, policy_version 232940 (0.0007) [2023-12-27 20:54:02,580][106226] Updated weights for policy 0, policy_version 232618 (0.0010) [2023-12-27 20:54:02,634][106226] Updated weights for policy 0, policy_version 232628 (0.0010) [2023-12-27 20:54:02,687][106226] Updated weights for policy 0, policy_version 232638 (0.0010) [2023-12-27 20:54:02,740][106226] Updated weights for policy 0, policy_version 232648 (0.0010) [2023-12-27 20:54:02,998][106225] Updated weights for policy 1, policy_version 232950 (0.0008) [2023-12-27 20:54:03,052][106225] Updated weights for policy 1, policy_version 232960 (0.0008) [2023-12-27 20:54:03,109][106225] Updated weights for policy 1, policy_version 232970 (0.0009) [2023-12-27 20:54:03,398][106226] Updated weights for policy 0, policy_version 232658 (0.0006) [2023-12-27 20:54:03,451][106226] Updated weights for policy 0, policy_version 232668 (0.0008) [2023-12-27 20:54:03,512][106226] Updated weights for policy 0, policy_version 232678 (0.0008) [2023-12-27 20:54:03,704][106225] Updated weights for policy 1, policy_version 232980 (0.0008) [2023-12-27 20:54:03,751][106225] Updated weights for policy 1, policy_version 232990 (0.0008) [2023-12-27 20:54:03,796][106225] Updated weights for policy 1, policy_version 233000 (0.0009) [2023-12-27 20:54:04,228][106226] Updated weights for policy 0, policy_version 232688 (0.0008) [2023-12-27 20:54:04,285][106226] Updated weights for policy 0, policy_version 232698 (0.0008) [2023-12-27 20:54:04,337][106226] Updated weights for policy 0, policy_version 232708 (0.0008) [2023-12-27 20:54:04,558][106225] Updated weights for policy 1, policy_version 233010 (0.0008) [2023-12-27 20:54:04,616][106225] Updated weights for policy 1, policy_version 233020 (0.0009) [2023-12-27 20:54:04,668][106225] Updated weights for policy 1, policy_version 233030 (0.0005) [2023-12-27 20:54:04,716][106225] Updated weights for policy 1, policy_version 233040 (0.0005) [2023-12-27 20:54:05,078][106226] Updated weights for policy 0, policy_version 232718 (0.0009) [2023-12-27 20:54:05,137][106226] Updated weights for policy 0, policy_version 232728 (0.0008) [2023-12-27 20:54:05,196][106226] Updated weights for policy 0, policy_version 232738 (0.0009) [2023-12-27 20:54:05,368][106225] Updated weights for policy 1, policy_version 233050 (0.0006) [2023-12-27 20:54:05,427][106225] Updated weights for policy 1, policy_version 233060 (0.0008) [2023-12-27 20:54:05,482][106225] Updated weights for policy 1, policy_version 233070 (0.0005) [2023-12-27 20:54:05,985][106226] Updated weights for policy 0, policy_version 232748 (0.0008) [2023-12-27 20:54:06,033][106226] Updated weights for policy 0, policy_version 232758 (0.0009) [2023-12-27 20:54:06,044][106225] Updated weights for policy 1, policy_version 233080 (0.0005) [2023-12-27 20:54:06,084][106226] Updated weights for policy 0, policy_version 232768 (0.0009) [2023-12-27 20:54:06,101][106225] Updated weights for policy 1, policy_version 233090 (0.0008) [2023-12-27 20:54:06,161][106225] Updated weights for policy 1, policy_version 233100 (0.0008) [2023-12-27 20:54:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 119283712. Throughput: 0: 9739.5, 1: 10051.5. Samples: 119293272. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:54:06,175][105115] Avg episode reward: [(0, '-5.177'), (1, '-6.058')] [2023-12-27 20:54:06,758][106225] Updated weights for policy 1, policy_version 233110 (0.0009) [2023-12-27 20:54:06,809][106225] Updated weights for policy 1, policy_version 233120 (0.0006) [2023-12-27 20:54:06,867][106225] Updated weights for policy 1, policy_version 233130 (0.0010) [2023-12-27 20:54:06,875][106226] Updated weights for policy 0, policy_version 232778 (0.0007) [2023-12-27 20:54:06,936][106226] Updated weights for policy 0, policy_version 232788 (0.0007) [2023-12-27 20:54:06,995][106226] Updated weights for policy 0, policy_version 232798 (0.0008) [2023-12-27 20:54:07,057][106226] Updated weights for policy 0, policy_version 232808 (0.0008) [2023-12-27 20:54:07,599][106225] Updated weights for policy 1, policy_version 233140 (0.0010) [2023-12-27 20:54:07,640][106226] Updated weights for policy 0, policy_version 232818 (0.0005) [2023-12-27 20:54:07,662][106225] Updated weights for policy 1, policy_version 233150 (0.0010) [2023-12-27 20:54:07,695][106226] Updated weights for policy 0, policy_version 232828 (0.0007) [2023-12-27 20:54:07,723][106225] Updated weights for policy 1, policy_version 233160 (0.0009) [2023-12-27 20:54:07,752][106226] Updated weights for policy 0, policy_version 232838 (0.0006) [2023-12-27 20:54:08,332][106225] Updated weights for policy 1, policy_version 233170 (0.0008) [2023-12-27 20:54:08,362][106226] Updated weights for policy 0, policy_version 232848 (0.0008) [2023-12-27 20:54:08,397][106225] Updated weights for policy 1, policy_version 233180 (0.0010) [2023-12-27 20:54:08,427][106226] Updated weights for policy 0, policy_version 232858 (0.0006) [2023-12-27 20:54:08,458][106225] Updated weights for policy 1, policy_version 233190 (0.0010) [2023-12-27 20:54:08,493][106226] Updated weights for policy 0, policy_version 232868 (0.0008) [2023-12-27 20:54:08,521][106225] Updated weights for policy 1, policy_version 233200 (0.0010) [2023-12-27 20:54:09,201][106225] Updated weights for policy 1, policy_version 233210 (0.0006) [2023-12-27 20:54:09,221][106226] Updated weights for policy 0, policy_version 232878 (0.0006) [2023-12-27 20:54:09,275][106225] Updated weights for policy 1, policy_version 233221 (0.0010) [2023-12-27 20:54:09,286][106226] Updated weights for policy 0, policy_version 232888 (0.0008) [2023-12-27 20:54:09,327][106225] Updated weights for policy 1, policy_version 233231 (0.0008) [2023-12-27 20:54:09,351][106226] Updated weights for policy 0, policy_version 232898 (0.0008) [2023-12-27 20:54:10,009][106225] Updated weights for policy 1, policy_version 233241 (0.0008) [2023-12-27 20:54:10,058][106225] Updated weights for policy 1, policy_version 233251 (0.0008) [2023-12-27 20:54:10,110][106225] Updated weights for policy 1, policy_version 233261 (0.0010) [2023-12-27 20:54:10,179][106226] Updated weights for policy 0, policy_version 232908 (0.0009) [2023-12-27 20:54:10,227][106226] Updated weights for policy 0, policy_version 232918 (0.0007) [2023-12-27 20:54:10,282][106226] Updated weights for policy 0, policy_version 232928 (0.0007) [2023-12-27 20:54:10,781][106225] Updated weights for policy 1, policy_version 233271 (0.0007) [2023-12-27 20:54:10,847][106225] Updated weights for policy 1, policy_version 233281 (0.0005) [2023-12-27 20:54:10,901][106225] Updated weights for policy 1, policy_version 233291 (0.0005) [2023-12-27 20:54:11,038][106226] Updated weights for policy 0, policy_version 232938 (0.0008) [2023-12-27 20:54:11,108][106226] Updated weights for policy 0, policy_version 232948 (0.0010) [2023-12-27 20:54:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 119382016. Throughput: 0: 9786.5, 1: 10094.4. Samples: 119355496. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:54:11,175][105115] Avg episode reward: [(0, '-5.237'), (1, '-6.056')] [2023-12-27 20:54:11,176][106226] Updated weights for policy 0, policy_version 232958 (0.0008) [2023-12-27 20:54:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000233296_59736064.pth... [2023-12-27 20:54:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000232112_59432960.pth [2023-12-27 20:54:11,242][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000232968_59654144.pth... [2023-12-27 20:54:11,242][106226] Updated weights for policy 0, policy_version 232968 (0.0008) [2023-12-27 20:54:11,247][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000231848_59367424.pth [2023-12-27 20:54:11,527][106225] Updated weights for policy 1, policy_version 233301 (0.0008) [2023-12-27 20:54:11,586][106225] Updated weights for policy 1, policy_version 233311 (0.0009) [2023-12-27 20:54:11,653][106225] Updated weights for policy 1, policy_version 233321 (0.0008) [2023-12-27 20:54:11,944][106226] Updated weights for policy 0, policy_version 232978 (0.0009) [2023-12-27 20:54:12,011][106226] Updated weights for policy 0, policy_version 232988 (0.0008) [2023-12-27 20:54:12,067][106226] Updated weights for policy 0, policy_version 232998 (0.0010) [2023-12-27 20:54:12,438][106225] Updated weights for policy 1, policy_version 233331 (0.0009) [2023-12-27 20:54:12,496][106225] Updated weights for policy 1, policy_version 233341 (0.0009) [2023-12-27 20:54:12,544][106225] Updated weights for policy 1, policy_version 233351 (0.0008) [2023-12-27 20:54:12,818][106226] Updated weights for policy 0, policy_version 233008 (0.0007) [2023-12-27 20:54:12,883][106226] Updated weights for policy 0, policy_version 233018 (0.0007) [2023-12-27 20:54:12,938][106226] Updated weights for policy 0, policy_version 233028 (0.0009) [2023-12-27 20:54:13,285][106225] Updated weights for policy 1, policy_version 233361 (0.0006) [2023-12-27 20:54:13,347][106225] Updated weights for policy 1, policy_version 233371 (0.0009) [2023-12-27 20:54:13,392][106225] Updated weights for policy 1, policy_version 233381 (0.0008) [2023-12-27 20:54:13,444][106225] Updated weights for policy 1, policy_version 233391 (0.0008) [2023-12-27 20:54:13,596][106226] Updated weights for policy 0, policy_version 233038 (0.0008) [2023-12-27 20:54:13,652][106226] Updated weights for policy 0, policy_version 233048 (0.0009) [2023-12-27 20:54:13,707][106226] Updated weights for policy 0, policy_version 233058 (0.0008) [2023-12-27 20:54:14,160][106225] Updated weights for policy 1, policy_version 233401 (0.0008) [2023-12-27 20:54:14,218][106225] Updated weights for policy 1, policy_version 233411 (0.0008) [2023-12-27 20:54:14,267][106225] Updated weights for policy 1, policy_version 233421 (0.0008) [2023-12-27 20:54:14,460][106226] Updated weights for policy 0, policy_version 233068 (0.0009) [2023-12-27 20:54:14,524][106226] Updated weights for policy 0, policy_version 233078 (0.0008) [2023-12-27 20:54:14,589][106226] Updated weights for policy 0, policy_version 233088 (0.0008) [2023-12-27 20:54:15,055][106225] Updated weights for policy 1, policy_version 233431 (0.0008) [2023-12-27 20:54:15,118][106225] Updated weights for policy 1, policy_version 233441 (0.0008) [2023-12-27 20:54:15,174][106225] Updated weights for policy 1, policy_version 233451 (0.0008) [2023-12-27 20:54:15,348][106226] Updated weights for policy 0, policy_version 233098 (0.0008) [2023-12-27 20:54:15,409][106226] Updated weights for policy 0, policy_version 233108 (0.0007) [2023-12-27 20:54:15,464][106226] Updated weights for policy 0, policy_version 233118 (0.0005) [2023-12-27 20:54:15,514][106226] Updated weights for policy 0, policy_version 233128 (0.0005) [2023-12-27 20:54:15,907][106225] Updated weights for policy 1, policy_version 233461 (0.0009) [2023-12-27 20:54:15,962][106225] Updated weights for policy 1, policy_version 233471 (0.0007) [2023-12-27 20:54:16,024][106225] Updated weights for policy 1, policy_version 233481 (0.0007) [2023-12-27 20:54:16,162][106226] Updated weights for policy 0, policy_version 233138 (0.0006) [2023-12-27 20:54:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 119480320. Throughput: 0: 9662.4, 1: 10043.8. Samples: 119470808. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:54:16,175][105115] Avg episode reward: [(0, '-5.379'), (1, '-5.904')] [2023-12-27 20:54:16,226][106226] Updated weights for policy 0, policy_version 233148 (0.0009) [2023-12-27 20:54:16,299][106226] Updated weights for policy 0, policy_version 233158 (0.0011) [2023-12-27 20:54:16,613][106225] Updated weights for policy 1, policy_version 233491 (0.0009) [2023-12-27 20:54:16,670][106225] Updated weights for policy 1, policy_version 233501 (0.0005) [2023-12-27 20:54:16,724][106225] Updated weights for policy 1, policy_version 233511 (0.0008) [2023-12-27 20:54:16,892][106226] Updated weights for policy 0, policy_version 233168 (0.0006) [2023-12-27 20:54:16,943][106226] Updated weights for policy 0, policy_version 233178 (0.0005) [2023-12-27 20:54:16,996][106226] Updated weights for policy 0, policy_version 233188 (0.0008) [2023-12-27 20:54:17,367][106225] Updated weights for policy 1, policy_version 233521 (0.0009) [2023-12-27 20:54:17,425][106225] Updated weights for policy 1, policy_version 233531 (0.0007) [2023-12-27 20:54:17,483][106225] Updated weights for policy 1, policy_version 233541 (0.0006) [2023-12-27 20:54:17,538][106225] Updated weights for policy 1, policy_version 233551 (0.0006) [2023-12-27 20:54:17,649][106226] Updated weights for policy 0, policy_version 233198 (0.0007) [2023-12-27 20:54:17,704][106226] Updated weights for policy 0, policy_version 233208 (0.0009) [2023-12-27 20:54:17,774][106226] Updated weights for policy 0, policy_version 233218 (0.0006) [2023-12-27 20:54:18,085][106225] Updated weights for policy 1, policy_version 233561 (0.0005) [2023-12-27 20:54:18,145][106225] Updated weights for policy 1, policy_version 233571 (0.0005) [2023-12-27 20:54:18,202][106225] Updated weights for policy 1, policy_version 233581 (0.0005) [2023-12-27 20:54:18,381][106226] Updated weights for policy 0, policy_version 233228 (0.0008) [2023-12-27 20:54:18,449][106226] Updated weights for policy 0, policy_version 233238 (0.0009) [2023-12-27 20:54:18,510][106226] Updated weights for policy 0, policy_version 233248 (0.0011) [2023-12-27 20:54:18,827][106225] Updated weights for policy 1, policy_version 233591 (0.0008) [2023-12-27 20:54:18,890][106225] Updated weights for policy 1, policy_version 233601 (0.0009) [2023-12-27 20:54:18,952][106225] Updated weights for policy 1, policy_version 233611 (0.0009) [2023-12-27 20:54:19,114][106226] Updated weights for policy 0, policy_version 233258 (0.0009) [2023-12-27 20:54:19,173][106226] Updated weights for policy 0, policy_version 233268 (0.0009) [2023-12-27 20:54:19,228][106226] Updated weights for policy 0, policy_version 233278 (0.0010) [2023-12-27 20:54:19,289][106226] Updated weights for policy 0, policy_version 233288 (0.0009) [2023-12-27 20:54:19,692][106225] Updated weights for policy 1, policy_version 233621 (0.0008) [2023-12-27 20:54:19,754][106225] Updated weights for policy 1, policy_version 233631 (0.0008) [2023-12-27 20:54:19,815][106225] Updated weights for policy 1, policy_version 233641 (0.0006) [2023-12-27 20:54:20,047][106226] Updated weights for policy 0, policy_version 233298 (0.0011) [2023-12-27 20:54:20,120][106226] Updated weights for policy 0, policy_version 233308 (0.0011) [2023-12-27 20:54:20,182][106226] Updated weights for policy 0, policy_version 233318 (0.0011) [2023-12-27 20:54:20,458][106225] Updated weights for policy 1, policy_version 233651 (0.0007) [2023-12-27 20:54:20,517][106225] Updated weights for policy 1, policy_version 233661 (0.0006) [2023-12-27 20:54:20,567][106225] Updated weights for policy 1, policy_version 233671 (0.0007) [2023-12-27 20:54:20,912][106226] Updated weights for policy 0, policy_version 233328 (0.0009) [2023-12-27 20:54:20,964][106226] Updated weights for policy 0, policy_version 233338 (0.0008) [2023-12-27 20:54:21,016][106226] Updated weights for policy 0, policy_version 233348 (0.0008) [2023-12-27 20:54:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 119586816. Throughput: 0: 9673.7, 1: 10128.8. Samples: 119594560. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-27 20:54:21,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-6.208')] [2023-12-27 20:54:21,280][106225] Updated weights for policy 1, policy_version 233681 (0.0007) [2023-12-27 20:54:21,338][106225] Updated weights for policy 1, policy_version 233691 (0.0005) [2023-12-27 20:54:21,410][106225] Updated weights for policy 1, policy_version 233701 (0.0007) [2023-12-27 20:54:21,472][106225] Updated weights for policy 1, policy_version 233711 (0.0006) [2023-12-27 20:54:21,918][106226] Updated weights for policy 0, policy_version 233358 (0.0009) [2023-12-27 20:54:21,974][106226] Updated weights for policy 0, policy_version 233368 (0.0008) [2023-12-27 20:54:22,045][106226] Updated weights for policy 0, policy_version 233378 (0.0006) [2023-12-27 20:54:22,224][106225] Updated weights for policy 1, policy_version 233721 (0.0007) [2023-12-27 20:54:22,292][106225] Updated weights for policy 1, policy_version 233731 (0.0009) [2023-12-27 20:54:22,367][106225] Updated weights for policy 1, policy_version 233741 (0.0009) [2023-12-27 20:54:22,731][106226] Updated weights for policy 0, policy_version 233388 (0.0007) [2023-12-27 20:54:22,796][106226] Updated weights for policy 0, policy_version 233398 (0.0009) [2023-12-27 20:54:22,857][106226] Updated weights for policy 0, policy_version 233408 (0.0009) [2023-12-27 20:54:23,116][106225] Updated weights for policy 1, policy_version 233751 (0.0009) [2023-12-27 20:54:23,174][106225] Updated weights for policy 1, policy_version 233761 (0.0009) [2023-12-27 20:54:23,221][106225] Updated weights for policy 1, policy_version 233771 (0.0009) [2023-12-27 20:54:23,555][106226] Updated weights for policy 0, policy_version 233418 (0.0008) [2023-12-27 20:54:23,613][106226] Updated weights for policy 0, policy_version 233428 (0.0005) [2023-12-27 20:54:23,676][106226] Updated weights for policy 0, policy_version 233438 (0.0006) [2023-12-27 20:54:23,729][106226] Updated weights for policy 0, policy_version 233448 (0.0006) [2023-12-27 20:54:23,992][106225] Updated weights for policy 1, policy_version 233781 (0.0008) [2023-12-27 20:54:24,042][106225] Updated weights for policy 1, policy_version 233791 (0.0009) [2023-12-27 20:54:24,099][106225] Updated weights for policy 1, policy_version 233801 (0.0009) [2023-12-27 20:54:24,302][106226] Updated weights for policy 0, policy_version 233458 (0.0005) [2023-12-27 20:54:24,357][106226] Updated weights for policy 0, policy_version 233468 (0.0008) [2023-12-27 20:54:24,407][106226] Updated weights for policy 0, policy_version 233478 (0.0008) [2023-12-27 20:54:24,812][106225] Updated weights for policy 1, policy_version 233811 (0.0010) [2023-12-27 20:54:24,861][106225] Updated weights for policy 1, policy_version 233821 (0.0005) [2023-12-27 20:54:24,923][106225] Updated weights for policy 1, policy_version 233831 (0.0006) [2023-12-27 20:54:25,133][106226] Updated weights for policy 0, policy_version 233488 (0.0006) [2023-12-27 20:54:25,195][106226] Updated weights for policy 0, policy_version 233498 (0.0007) [2023-12-27 20:54:25,248][106226] Updated weights for policy 0, policy_version 233508 (0.0008) [2023-12-27 20:54:25,559][106225] Updated weights for policy 1, policy_version 233841 (0.0007) [2023-12-27 20:54:25,612][106225] Updated weights for policy 1, policy_version 233851 (0.0010) [2023-12-27 20:54:25,668][106225] Updated weights for policy 1, policy_version 233861 (0.0010) [2023-12-27 20:54:25,734][106225] Updated weights for policy 1, policy_version 233871 (0.0010) [2023-12-27 20:54:25,941][106226] Updated weights for policy 0, policy_version 233518 (0.0008) [2023-12-27 20:54:25,995][106226] Updated weights for policy 0, policy_version 233528 (0.0007) [2023-12-27 20:54:26,050][106226] Updated weights for policy 0, policy_version 233538 (0.0008) [2023-12-27 20:54:26,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 119685120. Throughput: 0: 9688.9, 1: 10065.1. Samples: 119651784. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:26,176][105115] Avg episode reward: [(0, '-5.240'), (1, '-6.214')] [2023-12-27 20:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000233872_59883520.pth... [2023-12-27 20:54:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000233544_59801600.pth... [2023-12-27 20:54:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000232688_59580416.pth [2023-12-27 20:54:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000232392_59506688.pth [2023-12-27 20:54:26,403][106225] Updated weights for policy 1, policy_version 233881 (0.0010) [2023-12-27 20:54:26,456][106225] Updated weights for policy 1, policy_version 233891 (0.0010) [2023-12-27 20:54:26,515][106225] Updated weights for policy 1, policy_version 233901 (0.0010) [2023-12-27 20:54:26,768][106226] Updated weights for policy 0, policy_version 233548 (0.0008) [2023-12-27 20:54:26,816][106226] Updated weights for policy 0, policy_version 233558 (0.0007) [2023-12-27 20:54:26,865][106226] Updated weights for policy 0, policy_version 233568 (0.0007) [2023-12-27 20:54:27,237][106225] Updated weights for policy 1, policy_version 233911 (0.0010) [2023-12-27 20:54:27,297][106225] Updated weights for policy 1, policy_version 233921 (0.0010) [2023-12-27 20:54:27,352][106225] Updated weights for policy 1, policy_version 233931 (0.0010) [2023-12-27 20:54:27,595][106226] Updated weights for policy 0, policy_version 233578 (0.0008) [2023-12-27 20:54:27,654][106226] Updated weights for policy 0, policy_version 233588 (0.0008) [2023-12-27 20:54:27,703][106226] Updated weights for policy 0, policy_version 233598 (0.0008) [2023-12-27 20:54:27,755][106226] Updated weights for policy 0, policy_version 233608 (0.0007) [2023-12-27 20:54:28,056][106225] Updated weights for policy 1, policy_version 233941 (0.0010) [2023-12-27 20:54:28,106][106225] Updated weights for policy 1, policy_version 233951 (0.0010) [2023-12-27 20:54:28,159][106225] Updated weights for policy 1, policy_version 233961 (0.0010) [2023-12-27 20:54:28,493][106226] Updated weights for policy 0, policy_version 233618 (0.0008) [2023-12-27 20:54:28,556][106226] Updated weights for policy 0, policy_version 233628 (0.0010) [2023-12-27 20:54:28,621][106226] Updated weights for policy 0, policy_version 233638 (0.0011) [2023-12-27 20:54:28,901][106225] Updated weights for policy 1, policy_version 233971 (0.0010) [2023-12-27 20:54:28,967][106225] Updated weights for policy 1, policy_version 233981 (0.0010) [2023-12-27 20:54:29,027][106225] Updated weights for policy 1, policy_version 233991 (0.0010) [2023-12-27 20:54:29,217][106226] Updated weights for policy 0, policy_version 233648 (0.0008) [2023-12-27 20:54:29,280][106226] Updated weights for policy 0, policy_version 233658 (0.0008) [2023-12-27 20:54:29,343][106226] Updated weights for policy 0, policy_version 233668 (0.0008) [2023-12-27 20:54:29,707][106225] Updated weights for policy 1, policy_version 234001 (0.0010) [2023-12-27 20:54:29,777][106225] Updated weights for policy 1, policy_version 234011 (0.0008) [2023-12-27 20:54:29,839][106225] Updated weights for policy 1, policy_version 234021 (0.0007) [2023-12-27 20:54:29,910][106225] Updated weights for policy 1, policy_version 234031 (0.0008) [2023-12-27 20:54:30,046][106226] Updated weights for policy 0, policy_version 233678 (0.0009) [2023-12-27 20:54:30,099][106226] Updated weights for policy 0, policy_version 233688 (0.0009) [2023-12-27 20:54:30,152][106226] Updated weights for policy 0, policy_version 233698 (0.0009) [2023-12-27 20:54:30,621][106225] Updated weights for policy 1, policy_version 234041 (0.0008) [2023-12-27 20:54:30,669][106225] Updated weights for policy 1, policy_version 234051 (0.0008) [2023-12-27 20:54:30,713][106225] Updated weights for policy 1, policy_version 234061 (0.0008) [2023-12-27 20:54:30,838][106226] Updated weights for policy 0, policy_version 233708 (0.0009) [2023-12-27 20:54:30,887][106226] Updated weights for policy 0, policy_version 233718 (0.0008) [2023-12-27 20:54:30,939][106226] Updated weights for policy 0, policy_version 233728 (0.0008) [2023-12-27 20:54:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 119783424. Throughput: 0: 9766.3, 1: 10142.5. Samples: 119771980. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:31,175][105115] Avg episode reward: [(0, '-5.080'), (1, '-6.092')] [2023-12-27 20:54:31,461][106225] Updated weights for policy 1, policy_version 234071 (0.0008) [2023-12-27 20:54:31,504][106225] Updated weights for policy 1, policy_version 234081 (0.0008) [2023-12-27 20:54:31,552][106225] Updated weights for policy 1, policy_version 234091 (0.0008) [2023-12-27 20:54:31,622][106226] Updated weights for policy 0, policy_version 233738 (0.0009) [2023-12-27 20:54:31,685][106226] Updated weights for policy 0, policy_version 233748 (0.0008) [2023-12-27 20:54:31,754][106226] Updated weights for policy 0, policy_version 233758 (0.0008) [2023-12-27 20:54:31,821][106226] Updated weights for policy 0, policy_version 233768 (0.0007) [2023-12-27 20:54:32,340][106225] Updated weights for policy 1, policy_version 234101 (0.0009) [2023-12-27 20:54:32,406][106225] Updated weights for policy 1, policy_version 234111 (0.0008) [2023-12-27 20:54:32,462][106225] Updated weights for policy 1, policy_version 234121 (0.0008) [2023-12-27 20:54:32,524][106226] Updated weights for policy 0, policy_version 233778 (0.0007) [2023-12-27 20:54:32,572][106226] Updated weights for policy 0, policy_version 233788 (0.0008) [2023-12-27 20:54:32,619][106226] Updated weights for policy 0, policy_version 233798 (0.0008) [2023-12-27 20:54:33,114][106225] Updated weights for policy 1, policy_version 234131 (0.0006) [2023-12-27 20:54:33,166][106225] Updated weights for policy 1, policy_version 234141 (0.0005) [2023-12-27 20:54:33,223][106225] Updated weights for policy 1, policy_version 234151 (0.0008) [2023-12-27 20:54:33,406][106226] Updated weights for policy 0, policy_version 233808 (0.0009) [2023-12-27 20:54:33,459][106226] Updated weights for policy 0, policy_version 233818 (0.0008) [2023-12-27 20:54:33,513][106226] Updated weights for policy 0, policy_version 233828 (0.0008) [2023-12-27 20:54:33,916][106225] Updated weights for policy 1, policy_version 234161 (0.0008) [2023-12-27 20:54:33,977][106225] Updated weights for policy 1, policy_version 234171 (0.0008) [2023-12-27 20:54:34,035][106225] Updated weights for policy 1, policy_version 234181 (0.0010) [2023-12-27 20:54:34,101][106225] Updated weights for policy 1, policy_version 234191 (0.0010) [2023-12-27 20:54:34,202][106226] Updated weights for policy 0, policy_version 233838 (0.0009) [2023-12-27 20:54:34,262][106226] Updated weights for policy 0, policy_version 233848 (0.0009) [2023-12-27 20:54:34,321][106226] Updated weights for policy 0, policy_version 233858 (0.0009) [2023-12-27 20:54:34,842][106225] Updated weights for policy 1, policy_version 234201 (0.0005) [2023-12-27 20:54:34,904][106225] Updated weights for policy 1, policy_version 234211 (0.0007) [2023-12-27 20:54:34,955][106226] Updated weights for policy 0, policy_version 233868 (0.0007) [2023-12-27 20:54:34,964][106225] Updated weights for policy 1, policy_version 234221 (0.0009) [2023-12-27 20:54:35,010][106226] Updated weights for policy 0, policy_version 233878 (0.0006) [2023-12-27 20:54:35,077][106226] Updated weights for policy 0, policy_version 233888 (0.0005) [2023-12-27 20:54:35,587][106225] Updated weights for policy 1, policy_version 234231 (0.0006) [2023-12-27 20:54:35,645][106225] Updated weights for policy 1, policy_version 234241 (0.0008) [2023-12-27 20:54:35,699][106225] Updated weights for policy 1, policy_version 234251 (0.0010) [2023-12-27 20:54:35,738][106226] Updated weights for policy 0, policy_version 233898 (0.0005) [2023-12-27 20:54:35,783][106226] Updated weights for policy 0, policy_version 233908 (0.0005) [2023-12-27 20:54:35,833][106226] Updated weights for policy 0, policy_version 233918 (0.0005) [2023-12-27 20:54:35,891][106226] Updated weights for policy 0, policy_version 233928 (0.0005) [2023-12-27 20:54:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 119881728. Throughput: 0: 9841.8, 1: 10145.5. Samples: 119891948. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:36,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.951')] [2023-12-27 20:54:36,314][106225] Updated weights for policy 1, policy_version 234261 (0.0010) [2023-12-27 20:54:36,380][106225] Updated weights for policy 1, policy_version 234271 (0.0010) [2023-12-27 20:54:36,439][106225] Updated weights for policy 1, policy_version 234281 (0.0005) [2023-12-27 20:54:36,586][106226] Updated weights for policy 0, policy_version 233938 (0.0005) [2023-12-27 20:54:36,656][106226] Updated weights for policy 0, policy_version 233948 (0.0006) [2023-12-27 20:54:36,723][106226] Updated weights for policy 0, policy_version 233958 (0.0006) [2023-12-27 20:54:37,040][106225] Updated weights for policy 1, policy_version 234291 (0.0007) [2023-12-27 20:54:37,083][106225] Updated weights for policy 1, policy_version 234301 (0.0007) [2023-12-27 20:54:37,138][106225] Updated weights for policy 1, policy_version 234311 (0.0005) [2023-12-27 20:54:37,401][106226] Updated weights for policy 0, policy_version 233968 (0.0008) [2023-12-27 20:54:37,460][106226] Updated weights for policy 0, policy_version 233978 (0.0008) [2023-12-27 20:54:37,525][106226] Updated weights for policy 0, policy_version 233988 (0.0006) [2023-12-27 20:54:37,862][106225] Updated weights for policy 1, policy_version 234321 (0.0009) [2023-12-27 20:54:37,918][106225] Updated weights for policy 1, policy_version 234331 (0.0008) [2023-12-27 20:54:37,970][106225] Updated weights for policy 1, policy_version 234341 (0.0010) [2023-12-27 20:54:38,023][106225] Updated weights for policy 1, policy_version 234351 (0.0010) [2023-12-27 20:54:38,228][106226] Updated weights for policy 0, policy_version 233998 (0.0009) [2023-12-27 20:54:38,282][106226] Updated weights for policy 0, policy_version 234008 (0.0010) [2023-12-27 20:54:38,363][106226] Updated weights for policy 0, policy_version 234018 (0.0009) [2023-12-27 20:54:38,695][106225] Updated weights for policy 1, policy_version 234361 (0.0009) [2023-12-27 20:54:38,758][106225] Updated weights for policy 1, policy_version 234371 (0.0009) [2023-12-27 20:54:38,820][106225] Updated weights for policy 1, policy_version 234381 (0.0009) [2023-12-27 20:54:39,052][106226] Updated weights for policy 0, policy_version 234028 (0.0009) [2023-12-27 20:54:39,118][106226] Updated weights for policy 0, policy_version 234038 (0.0006) [2023-12-27 20:54:39,184][106226] Updated weights for policy 0, policy_version 234048 (0.0005) [2023-12-27 20:54:39,586][106225] Updated weights for policy 1, policy_version 234391 (0.0007) [2023-12-27 20:54:39,646][106225] Updated weights for policy 1, policy_version 234401 (0.0009) [2023-12-27 20:54:39,696][106225] Updated weights for policy 1, policy_version 234411 (0.0008) [2023-12-27 20:54:39,909][106226] Updated weights for policy 0, policy_version 234058 (0.0008) [2023-12-27 20:54:39,986][106226] Updated weights for policy 0, policy_version 234068 (0.0008) [2023-12-27 20:54:40,048][106226] Updated weights for policy 0, policy_version 234078 (0.0009) [2023-12-27 20:54:40,108][106226] Updated weights for policy 0, policy_version 234088 (0.0009) [2023-12-27 20:54:40,505][106225] Updated weights for policy 1, policy_version 234421 (0.0008) [2023-12-27 20:54:40,564][106225] Updated weights for policy 1, policy_version 234431 (0.0009) [2023-12-27 20:54:40,616][106225] Updated weights for policy 1, policy_version 234441 (0.0008) [2023-12-27 20:54:40,763][106226] Updated weights for policy 0, policy_version 234098 (0.0008) [2023-12-27 20:54:40,823][106226] Updated weights for policy 0, policy_version 234108 (0.0009) [2023-12-27 20:54:40,879][106226] Updated weights for policy 0, policy_version 234118 (0.0009) [2023-12-27 20:54:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 119980032. Throughput: 0: 9823.8, 1: 10180.1. Samples: 119952128. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:41,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-6.300')] [2023-12-27 20:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000234448_60030976.pth... [2023-12-27 20:54:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000234120_59949056.pth... [2023-12-27 20:54:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000232968_59654144.pth [2023-12-27 20:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000233296_59736064.pth [2023-12-27 20:54:41,386][106225] Updated weights for policy 1, policy_version 234451 (0.0009) [2023-12-27 20:54:41,447][106225] Updated weights for policy 1, policy_version 234461 (0.0008) [2023-12-27 20:54:41,504][106225] Updated weights for policy 1, policy_version 234471 (0.0007) [2023-12-27 20:54:41,652][106226] Updated weights for policy 0, policy_version 234128 (0.0008) [2023-12-27 20:54:41,714][106226] Updated weights for policy 0, policy_version 234138 (0.0007) [2023-12-27 20:54:41,783][106226] Updated weights for policy 0, policy_version 234148 (0.0008) [2023-12-27 20:54:42,227][106225] Updated weights for policy 1, policy_version 234481 (0.0007) [2023-12-27 20:54:42,291][106225] Updated weights for policy 1, policy_version 234491 (0.0007) [2023-12-27 20:54:42,355][106225] Updated weights for policy 1, policy_version 234501 (0.0008) [2023-12-27 20:54:42,422][106225] Updated weights for policy 1, policy_version 234511 (0.0008) [2023-12-27 20:54:42,458][106226] Updated weights for policy 0, policy_version 234158 (0.0008) [2023-12-27 20:54:42,506][106226] Updated weights for policy 0, policy_version 234168 (0.0008) [2023-12-27 20:54:42,561][106226] Updated weights for policy 0, policy_version 234178 (0.0008) [2023-12-27 20:54:43,202][106226] Updated weights for policy 0, policy_version 234188 (0.0008) [2023-12-27 20:54:43,216][106225] Updated weights for policy 1, policy_version 234521 (0.0008) [2023-12-27 20:54:43,250][106226] Updated weights for policy 0, policy_version 234198 (0.0007) [2023-12-27 20:54:43,270][106225] Updated weights for policy 1, policy_version 234531 (0.0008) [2023-12-27 20:54:43,304][106226] Updated weights for policy 0, policy_version 234208 (0.0007) [2023-12-27 20:54:43,328][106225] Updated weights for policy 1, policy_version 234541 (0.0007) [2023-12-27 20:54:43,981][106225] Updated weights for policy 1, policy_version 234551 (0.0008) [2023-12-27 20:54:44,043][106225] Updated weights for policy 1, policy_version 234561 (0.0009) [2023-12-27 20:54:44,074][106226] Updated weights for policy 0, policy_version 234218 (0.0007) [2023-12-27 20:54:44,102][106225] Updated weights for policy 1, policy_version 234571 (0.0009) [2023-12-27 20:54:44,124][106226] Updated weights for policy 0, policy_version 234228 (0.0005) [2023-12-27 20:54:44,175][106226] Updated weights for policy 0, policy_version 234238 (0.0008) [2023-12-27 20:54:44,237][106226] Updated weights for policy 0, policy_version 234248 (0.0009) [2023-12-27 20:54:44,815][106225] Updated weights for policy 1, policy_version 234581 (0.0008) [2023-12-27 20:54:44,873][106225] Updated weights for policy 1, policy_version 234591 (0.0009) [2023-12-27 20:54:44,941][106225] Updated weights for policy 1, policy_version 234601 (0.0009) [2023-12-27 20:54:44,969][106226] Updated weights for policy 0, policy_version 234258 (0.0009) [2023-12-27 20:54:45,034][106226] Updated weights for policy 0, policy_version 234268 (0.0008) [2023-12-27 20:54:45,103][106226] Updated weights for policy 0, policy_version 234278 (0.0007) [2023-12-27 20:54:45,686][106225] Updated weights for policy 1, policy_version 234611 (0.0008) [2023-12-27 20:54:45,745][106225] Updated weights for policy 1, policy_version 234621 (0.0008) [2023-12-27 20:54:45,779][106226] Updated weights for policy 0, policy_version 234288 (0.0008) [2023-12-27 20:54:45,804][106225] Updated weights for policy 1, policy_version 234631 (0.0007) [2023-12-27 20:54:45,837][106226] Updated weights for policy 0, policy_version 234298 (0.0008) [2023-12-27 20:54:45,896][106226] Updated weights for policy 0, policy_version 234308 (0.0008) [2023-12-27 20:54:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 120078336. Throughput: 0: 9858.3, 1: 10055.0. Samples: 120066348. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:46,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-6.133')] [2023-12-27 20:54:46,479][106225] Updated weights for policy 1, policy_version 234641 (0.0007) [2023-12-27 20:54:46,531][106225] Updated weights for policy 1, policy_version 234651 (0.0008) [2023-12-27 20:54:46,566][106226] Updated weights for policy 0, policy_version 234318 (0.0008) [2023-12-27 20:54:46,580][106225] Updated weights for policy 1, policy_version 234661 (0.0008) [2023-12-27 20:54:46,622][106226] Updated weights for policy 0, policy_version 234328 (0.0006) [2023-12-27 20:54:46,628][106225] Updated weights for policy 1, policy_version 234671 (0.0007) [2023-12-27 20:54:46,683][106226] Updated weights for policy 0, policy_version 234338 (0.0008) [2023-12-27 20:54:47,376][106225] Updated weights for policy 1, policy_version 234681 (0.0008) [2023-12-27 20:54:47,413][106226] Updated weights for policy 0, policy_version 234348 (0.0008) [2023-12-27 20:54:47,426][106225] Updated weights for policy 1, policy_version 234691 (0.0007) [2023-12-27 20:54:47,469][106226] Updated weights for policy 0, policy_version 234358 (0.0006) [2023-12-27 20:54:47,475][106225] Updated weights for policy 1, policy_version 234701 (0.0007) [2023-12-27 20:54:47,520][106226] Updated weights for policy 0, policy_version 234368 (0.0006) [2023-12-27 20:54:48,193][106226] Updated weights for policy 0, policy_version 234378 (0.0009) [2023-12-27 20:54:48,252][106226] Updated weights for policy 0, policy_version 234388 (0.0008) [2023-12-27 20:54:48,255][106225] Updated weights for policy 1, policy_version 234711 (0.0006) [2023-12-27 20:54:48,303][106226] Updated weights for policy 0, policy_version 234398 (0.0007) [2023-12-27 20:54:48,313][106225] Updated weights for policy 1, policy_version 234721 (0.0006) [2023-12-27 20:54:48,371][106226] Updated weights for policy 0, policy_version 234408 (0.0007) [2023-12-27 20:54:48,383][106225] Updated weights for policy 1, policy_version 234731 (0.0008) [2023-12-27 20:54:49,081][106226] Updated weights for policy 0, policy_version 234418 (0.0006) [2023-12-27 20:54:49,147][106226] Updated weights for policy 0, policy_version 234428 (0.0006) [2023-12-27 20:54:49,168][106225] Updated weights for policy 1, policy_version 234741 (0.0008) [2023-12-27 20:54:49,204][106226] Updated weights for policy 0, policy_version 234438 (0.0006) [2023-12-27 20:54:49,229][106225] Updated weights for policy 1, policy_version 234751 (0.0008) [2023-12-27 20:54:49,293][106225] Updated weights for policy 1, policy_version 234761 (0.0010) [2023-12-27 20:54:49,968][106226] Updated weights for policy 0, policy_version 234448 (0.0009) [2023-12-27 20:54:50,021][106226] Updated weights for policy 0, policy_version 234458 (0.0008) [2023-12-27 20:54:50,031][106225] Updated weights for policy 1, policy_version 234771 (0.0007) [2023-12-27 20:54:50,076][106226] Updated weights for policy 0, policy_version 234468 (0.0008) [2023-12-27 20:54:50,082][106225] Updated weights for policy 1, policy_version 234781 (0.0007) [2023-12-27 20:54:50,140][106225] Updated weights for policy 1, policy_version 234791 (0.0007) [2023-12-27 20:54:50,813][106226] Updated weights for policy 0, policy_version 234478 (0.0008) [2023-12-27 20:54:50,871][106226] Updated weights for policy 0, policy_version 234488 (0.0009) [2023-12-27 20:54:50,889][106225] Updated weights for policy 1, policy_version 234801 (0.0009) [2023-12-27 20:54:50,931][106226] Updated weights for policy 0, policy_version 234498 (0.0006) [2023-12-27 20:54:50,952][106225] Updated weights for policy 1, policy_version 234811 (0.0009) [2023-12-27 20:54:51,013][106225] Updated weights for policy 1, policy_version 234821 (0.0009) [2023-12-27 20:54:51,082][106225] Updated weights for policy 1, policy_version 234831 (0.0008) [2023-12-27 20:54:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 120176640. Throughput: 0: 9860.4, 1: 9877.3. Samples: 120181464. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:51,175][105115] Avg episode reward: [(0, '-5.186'), (1, '-5.992')] [2023-12-27 20:54:51,707][106226] Updated weights for policy 0, policy_version 234508 (0.0007) [2023-12-27 20:54:51,777][106226] Updated weights for policy 0, policy_version 234518 (0.0009) [2023-12-27 20:54:51,838][106226] Updated weights for policy 0, policy_version 234528 (0.0009) [2023-12-27 20:54:51,873][106225] Updated weights for policy 1, policy_version 234841 (0.0006) [2023-12-27 20:54:51,935][106225] Updated weights for policy 1, policy_version 234851 (0.0009) [2023-12-27 20:54:52,002][106225] Updated weights for policy 1, policy_version 234861 (0.0009) [2023-12-27 20:54:52,510][106226] Updated weights for policy 0, policy_version 234538 (0.0009) [2023-12-27 20:54:52,574][106226] Updated weights for policy 0, policy_version 234548 (0.0011) [2023-12-27 20:54:52,628][106226] Updated weights for policy 0, policy_version 234558 (0.0010) [2023-12-27 20:54:52,690][106226] Updated weights for policy 0, policy_version 234568 (0.0011) [2023-12-27 20:54:52,770][106225] Updated weights for policy 1, policy_version 234871 (0.0008) [2023-12-27 20:54:52,820][106225] Updated weights for policy 1, policy_version 234881 (0.0008) [2023-12-27 20:54:52,870][106225] Updated weights for policy 1, policy_version 234891 (0.0008) [2023-12-27 20:54:53,295][106226] Updated weights for policy 0, policy_version 234578 (0.0005) [2023-12-27 20:54:53,350][106226] Updated weights for policy 0, policy_version 234588 (0.0005) [2023-12-27 20:54:53,405][106226] Updated weights for policy 0, policy_version 234598 (0.0005) [2023-12-27 20:54:53,658][106225] Updated weights for policy 1, policy_version 234901 (0.0006) [2023-12-27 20:54:53,714][106225] Updated weights for policy 1, policy_version 234911 (0.0008) [2023-12-27 20:54:53,770][106225] Updated weights for policy 1, policy_version 234921 (0.0007) [2023-12-27 20:54:54,025][106226] Updated weights for policy 0, policy_version 234608 (0.0007) [2023-12-27 20:54:54,084][106226] Updated weights for policy 0, policy_version 234618 (0.0005) [2023-12-27 20:54:54,139][106226] Updated weights for policy 0, policy_version 234628 (0.0006) [2023-12-27 20:54:54,385][106225] Updated weights for policy 1, policy_version 234931 (0.0009) [2023-12-27 20:54:54,439][106225] Updated weights for policy 1, policy_version 234941 (0.0010) [2023-12-27 20:54:54,496][106225] Updated weights for policy 1, policy_version 234951 (0.0005) [2023-12-27 20:54:54,846][106226] Updated weights for policy 0, policy_version 234638 (0.0008) [2023-12-27 20:54:54,903][106226] Updated weights for policy 0, policy_version 234648 (0.0009) [2023-12-27 20:54:54,958][106226] Updated weights for policy 0, policy_version 234658 (0.0009) [2023-12-27 20:54:55,041][106225] Updated weights for policy 1, policy_version 234961 (0.0005) [2023-12-27 20:54:55,096][106225] Updated weights for policy 1, policy_version 234971 (0.0005) [2023-12-27 20:54:55,165][106225] Updated weights for policy 1, policy_version 234981 (0.0007) [2023-12-27 20:54:55,229][106225] Updated weights for policy 1, policy_version 234991 (0.0010) [2023-12-27 20:54:55,585][106226] Updated weights for policy 0, policy_version 234668 (0.0008) [2023-12-27 20:54:55,629][106226] Updated weights for policy 0, policy_version 234678 (0.0005) [2023-12-27 20:54:55,682][106226] Updated weights for policy 0, policy_version 234688 (0.0005) [2023-12-27 20:54:55,899][106225] Updated weights for policy 1, policy_version 235001 (0.0010) [2023-12-27 20:54:55,955][106225] Updated weights for policy 1, policy_version 235011 (0.0010) [2023-12-27 20:54:56,009][106225] Updated weights for policy 1, policy_version 235021 (0.0010) [2023-12-27 20:54:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 120274944. Throughput: 0: 9882.1, 1: 9768.9. Samples: 120239792. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:54:56,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-6.323')] [2023-12-27 20:54:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000235024_60178432.pth... [2023-12-27 20:54:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000234696_60096512.pth... [2023-12-27 20:54:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000233872_59883520.pth [2023-12-27 20:54:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000233544_59801600.pth [2023-12-27 20:54:56,279][106226] Updated weights for policy 0, policy_version 234698 (0.0007) [2023-12-27 20:54:56,334][106226] Updated weights for policy 0, policy_version 234708 (0.0005) [2023-12-27 20:54:56,379][106226] Updated weights for policy 0, policy_version 234718 (0.0005) [2023-12-27 20:54:56,429][106226] Updated weights for policy 0, policy_version 234728 (0.0005) [2023-12-27 20:54:56,724][106225] Updated weights for policy 1, policy_version 235031 (0.0010) [2023-12-27 20:54:56,781][106225] Updated weights for policy 1, policy_version 235041 (0.0009) [2023-12-27 20:54:56,841][106225] Updated weights for policy 1, policy_version 235051 (0.0005) [2023-12-27 20:54:57,024][106226] Updated weights for policy 0, policy_version 234738 (0.0007) [2023-12-27 20:54:57,080][106226] Updated weights for policy 0, policy_version 234748 (0.0008) [2023-12-27 20:54:57,139][106226] Updated weights for policy 0, policy_version 234758 (0.0010) [2023-12-27 20:54:57,521][106225] Updated weights for policy 1, policy_version 235061 (0.0010) [2023-12-27 20:54:57,576][106225] Updated weights for policy 1, policy_version 235071 (0.0010) [2023-12-27 20:54:57,635][106225] Updated weights for policy 1, policy_version 235081 (0.0010) [2023-12-27 20:54:57,820][106226] Updated weights for policy 0, policy_version 234768 (0.0008) [2023-12-27 20:54:57,866][106226] Updated weights for policy 0, policy_version 234778 (0.0010) [2023-12-27 20:54:57,919][106226] Updated weights for policy 0, policy_version 234788 (0.0010) [2023-12-27 20:54:58,353][106225] Updated weights for policy 1, policy_version 235091 (0.0010) [2023-12-27 20:54:58,424][106225] Updated weights for policy 1, policy_version 235101 (0.0007) [2023-12-27 20:54:58,485][106225] Updated weights for policy 1, policy_version 235111 (0.0008) [2023-12-27 20:54:58,608][106226] Updated weights for policy 0, policy_version 234798 (0.0011) [2023-12-27 20:54:58,665][106226] Updated weights for policy 0, policy_version 234808 (0.0009) [2023-12-27 20:54:58,730][106226] Updated weights for policy 0, policy_version 234818 (0.0008) [2023-12-27 20:54:59,273][106225] Updated weights for policy 1, policy_version 235121 (0.0008) [2023-12-27 20:54:59,337][106225] Updated weights for policy 1, policy_version 235131 (0.0008) [2023-12-27 20:54:59,401][106225] Updated weights for policy 1, policy_version 235141 (0.0007) [2023-12-27 20:54:59,456][106225] Updated weights for policy 1, policy_version 235151 (0.0005) [2023-12-27 20:54:59,549][106226] Updated weights for policy 0, policy_version 234828 (0.0008) [2023-12-27 20:54:59,613][106226] Updated weights for policy 0, policy_version 234838 (0.0009) [2023-12-27 20:54:59,676][106226] Updated weights for policy 0, policy_version 234848 (0.0008) [2023-12-27 20:55:00,169][106225] Updated weights for policy 1, policy_version 235161 (0.0009) [2023-12-27 20:55:00,228][106225] Updated weights for policy 1, policy_version 235171 (0.0009) [2023-12-27 20:55:00,291][106225] Updated weights for policy 1, policy_version 235181 (0.0007) [2023-12-27 20:55:00,328][106226] Updated weights for policy 0, policy_version 234858 (0.0007) [2023-12-27 20:55:00,388][106226] Updated weights for policy 0, policy_version 234868 (0.0010) [2023-12-27 20:55:00,445][106226] Updated weights for policy 0, policy_version 234878 (0.0008) [2023-12-27 20:55:00,499][106226] Updated weights for policy 0, policy_version 234888 (0.0009) [2023-12-27 20:55:00,944][106225] Updated weights for policy 1, policy_version 235191 (0.0008) [2023-12-27 20:55:01,000][106225] Updated weights for policy 1, policy_version 235201 (0.0008) [2023-12-27 20:55:01,084][106225] Updated weights for policy 1, policy_version 235211 (0.0009) [2023-12-27 20:55:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 120373248. Throughput: 0: 9997.9, 1: 9807.1. Samples: 120362036. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:01,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-5.958')] [2023-12-27 20:55:01,221][106226] Updated weights for policy 0, policy_version 234898 (0.0008) [2023-12-27 20:55:01,283][106226] Updated weights for policy 0, policy_version 234908 (0.0008) [2023-12-27 20:55:01,360][106226] Updated weights for policy 0, policy_version 234918 (0.0008) [2023-12-27 20:55:01,843][106225] Updated weights for policy 1, policy_version 235221 (0.0008) [2023-12-27 20:55:01,900][106225] Updated weights for policy 1, policy_version 235231 (0.0008) [2023-12-27 20:55:01,953][106225] Updated weights for policy 1, policy_version 235241 (0.0009) [2023-12-27 20:55:02,034][106226] Updated weights for policy 0, policy_version 234928 (0.0006) [2023-12-27 20:55:02,100][106226] Updated weights for policy 0, policy_version 234938 (0.0006) [2023-12-27 20:55:02,162][106226] Updated weights for policy 0, policy_version 234948 (0.0007) [2023-12-27 20:55:02,629][106225] Updated weights for policy 1, policy_version 235251 (0.0006) [2023-12-27 20:55:02,683][106225] Updated weights for policy 1, policy_version 235261 (0.0008) [2023-12-27 20:55:02,741][106225] Updated weights for policy 1, policy_version 235271 (0.0008) [2023-12-27 20:55:02,850][106226] Updated weights for policy 0, policy_version 234958 (0.0010) [2023-12-27 20:55:02,906][106226] Updated weights for policy 0, policy_version 234968 (0.0010) [2023-12-27 20:55:02,952][106226] Updated weights for policy 0, policy_version 234978 (0.0010) [2023-12-27 20:55:03,472][106225] Updated weights for policy 1, policy_version 235281 (0.0007) [2023-12-27 20:55:03,529][106225] Updated weights for policy 1, policy_version 235291 (0.0007) [2023-12-27 20:55:03,578][106225] Updated weights for policy 1, policy_version 235301 (0.0007) [2023-12-27 20:55:03,623][106225] Updated weights for policy 1, policy_version 235311 (0.0007) [2023-12-27 20:55:03,675][106226] Updated weights for policy 0, policy_version 234988 (0.0010) [2023-12-27 20:55:03,731][106226] Updated weights for policy 0, policy_version 234998 (0.0010) [2023-12-27 20:55:03,787][106226] Updated weights for policy 0, policy_version 235008 (0.0010) [2023-12-27 20:55:04,372][106225] Updated weights for policy 1, policy_version 235321 (0.0008) [2023-12-27 20:55:04,425][106225] Updated weights for policy 1, policy_version 235331 (0.0007) [2023-12-27 20:55:04,474][106225] Updated weights for policy 1, policy_version 235341 (0.0005) [2023-12-27 20:55:04,509][106226] Updated weights for policy 0, policy_version 235018 (0.0007) [2023-12-27 20:55:04,562][106226] Updated weights for policy 0, policy_version 235028 (0.0010) [2023-12-27 20:55:04,620][106226] Updated weights for policy 0, policy_version 235038 (0.0010) [2023-12-27 20:55:04,680][106226] Updated weights for policy 0, policy_version 235048 (0.0011) [2023-12-27 20:55:05,142][106225] Updated weights for policy 1, policy_version 235351 (0.0008) [2023-12-27 20:55:05,206][106225] Updated weights for policy 1, policy_version 235361 (0.0009) [2023-12-27 20:55:05,261][106225] Updated weights for policy 1, policy_version 235371 (0.0008) [2023-12-27 20:55:05,394][106226] Updated weights for policy 0, policy_version 235058 (0.0008) [2023-12-27 20:55:05,420][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000004 [2023-12-27 20:55:05,982][106225] Updated weights for policy 1, policy_version 235381 (0.0009) [2023-12-27 20:55:06,037][106225] Updated weights for policy 1, policy_version 235391 (0.0008) [2023-12-27 20:55:06,089][106225] Updated weights for policy 1, policy_version 235401 (0.0006) [2023-12-27 20:55:06,129][106226] Updated weights for policy 0, policy_version 235068 (0.0008) [2023-12-27 20:55:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 120471552. Throughput: 0: 9973.2, 1: 9714.3. Samples: 120480500. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:06,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-6.113')] [2023-12-27 20:55:06,194][106226] Updated weights for policy 0, policy_version 235078 (0.0009) [2023-12-27 20:55:06,259][106226] Updated weights for policy 0, policy_version 235088 (0.0009) [2023-12-27 20:55:06,830][106225] Updated weights for policy 1, policy_version 235411 (0.0007) [2023-12-27 20:55:06,887][106225] Updated weights for policy 1, policy_version 235421 (0.0007) [2023-12-27 20:55:06,888][106226] Updated weights for policy 0, policy_version 235098 (0.0008) [2023-12-27 20:55:06,947][106226] Updated weights for policy 0, policy_version 235108 (0.0011) [2023-12-27 20:55:06,950][106225] Updated weights for policy 1, policy_version 235431 (0.0005) [2023-12-27 20:55:07,004][106226] Updated weights for policy 0, policy_version 235118 (0.0011) [2023-12-27 20:55:07,072][106226] Updated weights for policy 0, policy_version 235128 (0.0011) [2023-12-27 20:55:07,649][106226] Updated weights for policy 0, policy_version 235138 (0.0005) [2023-12-27 20:55:07,682][106225] Updated weights for policy 1, policy_version 235441 (0.0006) [2023-12-27 20:55:07,700][106226] Updated weights for policy 0, policy_version 235148 (0.0005) [2023-12-27 20:55:07,743][106225] Updated weights for policy 1, policy_version 235451 (0.0006) [2023-12-27 20:55:07,758][106226] Updated weights for policy 0, policy_version 235158 (0.0010) [2023-12-27 20:55:07,805][106225] Updated weights for policy 1, policy_version 235461 (0.0009) [2023-12-27 20:55:07,861][106225] Updated weights for policy 1, policy_version 235471 (0.0007) [2023-12-27 20:55:08,326][106226] Updated weights for policy 0, policy_version 235168 (0.0007) [2023-12-27 20:55:08,389][106226] Updated weights for policy 0, policy_version 235178 (0.0008) [2023-12-27 20:55:08,448][106226] Updated weights for policy 0, policy_version 235188 (0.0008) [2023-12-27 20:55:08,611][106225] Updated weights for policy 1, policy_version 235481 (0.0009) [2023-12-27 20:55:08,674][106225] Updated weights for policy 1, policy_version 235491 (0.0009) [2023-12-27 20:55:08,745][106225] Updated weights for policy 1, policy_version 235501 (0.0008) [2023-12-27 20:55:09,096][106226] Updated weights for policy 0, policy_version 235198 (0.0007) [2023-12-27 20:55:09,153][106226] Updated weights for policy 0, policy_version 235208 (0.0008) [2023-12-27 20:55:09,212][106226] Updated weights for policy 0, policy_version 235218 (0.0008) [2023-12-27 20:55:09,461][106225] Updated weights for policy 1, policy_version 235511 (0.0008) [2023-12-27 20:55:09,525][106225] Updated weights for policy 1, policy_version 235521 (0.0010) [2023-12-27 20:55:09,587][106225] Updated weights for policy 1, policy_version 235531 (0.0007) [2023-12-27 20:55:09,928][106226] Updated weights for policy 0, policy_version 235228 (0.0008) [2023-12-27 20:55:09,998][106226] Updated weights for policy 0, policy_version 235238 (0.0007) [2023-12-27 20:55:10,065][106226] Updated weights for policy 0, policy_version 235248 (0.0008) [2023-12-27 20:55:10,327][106225] Updated weights for policy 1, policy_version 235541 (0.0008) [2023-12-27 20:55:10,390][106225] Updated weights for policy 1, policy_version 235551 (0.0008) [2023-12-27 20:55:10,453][106225] Updated weights for policy 1, policy_version 235561 (0.0007) [2023-12-27 20:55:10,739][106226] Updated weights for policy 0, policy_version 235258 (0.0008) [2023-12-27 20:55:10,800][106226] Updated weights for policy 0, policy_version 235268 (0.0008) [2023-12-27 20:55:10,855][106226] Updated weights for policy 0, policy_version 235278 (0.0005) [2023-12-27 20:55:10,907][106226] Updated weights for policy 0, policy_version 235288 (0.0005) [2023-12-27 20:55:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 120569856. Throughput: 0: 10055.9, 1: 9724.1. Samples: 120541880. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:11,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-5.825')] [2023-12-27 20:55:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000235288_60252160.pth... [2023-12-27 20:55:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000234120_59949056.pth [2023-12-27 20:55:11,197][106225] Updated weights for policy 1, policy_version 235571 (0.0006) [2023-12-27 20:55:11,261][106225] Updated weights for policy 1, policy_version 235581 (0.0006) [2023-12-27 20:55:11,327][106225] Updated weights for policy 1, policy_version 235591 (0.0008) [2023-12-27 20:55:11,402][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000235600_60325888.pth... [2023-12-27 20:55:11,409][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000234448_60030976.pth [2023-12-27 20:55:11,597][106226] Updated weights for policy 0, policy_version 235298 (0.0008) [2023-12-27 20:55:11,664][106226] Updated weights for policy 0, policy_version 235308 (0.0008) [2023-12-27 20:55:11,732][106226] Updated weights for policy 0, policy_version 235318 (0.0009) [2023-12-27 20:55:12,013][106225] Updated weights for policy 1, policy_version 235601 (0.0008) [2023-12-27 20:55:12,081][106225] Updated weights for policy 1, policy_version 235611 (0.0006) [2023-12-27 20:55:12,141][106225] Updated weights for policy 1, policy_version 235621 (0.0006) [2023-12-27 20:55:12,195][106225] Updated weights for policy 1, policy_version 235631 (0.0006) [2023-12-27 20:55:12,500][106226] Updated weights for policy 0, policy_version 235328 (0.0009) [2023-12-27 20:55:12,550][106226] Updated weights for policy 0, policy_version 235338 (0.0008) [2023-12-27 20:55:12,606][106226] Updated weights for policy 0, policy_version 235348 (0.0008) [2023-12-27 20:55:12,882][106225] Updated weights for policy 1, policy_version 235641 (0.0008) [2023-12-27 20:55:12,937][106225] Updated weights for policy 1, policy_version 235651 (0.0008) [2023-12-27 20:55:12,992][106225] Updated weights for policy 1, policy_version 235661 (0.0008) [2023-12-27 20:55:13,330][106226] Updated weights for policy 0, policy_version 235358 (0.0008) [2023-12-27 20:55:13,390][106226] Updated weights for policy 0, policy_version 235368 (0.0008) [2023-12-27 20:55:13,457][106226] Updated weights for policy 0, policy_version 235378 (0.0009) [2023-12-27 20:55:13,657][106225] Updated weights for policy 1, policy_version 235671 (0.0006) [2023-12-27 20:55:13,717][106225] Updated weights for policy 1, policy_version 235681 (0.0005) [2023-12-27 20:55:13,777][106225] Updated weights for policy 1, policy_version 235691 (0.0005) [2023-12-27 20:55:14,187][106226] Updated weights for policy 0, policy_version 235388 (0.0008) [2023-12-27 20:55:14,232][106226] Updated weights for policy 0, policy_version 235398 (0.0008) [2023-12-27 20:55:14,278][106226] Updated weights for policy 0, policy_version 235408 (0.0007) [2023-12-27 20:55:14,322][106225] Updated weights for policy 1, policy_version 235701 (0.0008) [2023-12-27 20:55:14,379][106225] Updated weights for policy 1, policy_version 235711 (0.0010) [2023-12-27 20:55:14,441][106225] Updated weights for policy 1, policy_version 235721 (0.0006) [2023-12-27 20:55:14,975][106226] Updated weights for policy 0, policy_version 235418 (0.0009) [2023-12-27 20:55:15,040][106226] Updated weights for policy 0, policy_version 235428 (0.0010) [2023-12-27 20:55:15,070][106225] Updated weights for policy 1, policy_version 235731 (0.0006) [2023-12-27 20:55:15,103][106226] Updated weights for policy 0, policy_version 235438 (0.0008) [2023-12-27 20:55:15,135][106225] Updated weights for policy 1, policy_version 235741 (0.0007) [2023-12-27 20:55:15,177][106226] Updated weights for policy 0, policy_version 235448 (0.0007) [2023-12-27 20:55:15,203][106225] Updated weights for policy 1, policy_version 235751 (0.0011) [2023-12-27 20:55:15,916][106225] Updated weights for policy 1, policy_version 235761 (0.0011) [2023-12-27 20:55:15,945][106226] Updated weights for policy 0, policy_version 235458 (0.0007) [2023-12-27 20:55:15,970][106225] Updated weights for policy 1, policy_version 235771 (0.0010) [2023-12-27 20:55:16,007][106226] Updated weights for policy 0, policy_version 235468 (0.0005) [2023-12-27 20:55:16,020][106225] Updated weights for policy 1, policy_version 235781 (0.0010) [2023-12-27 20:55:16,064][106226] Updated weights for policy 0, policy_version 235478 (0.0005) [2023-12-27 20:55:16,070][106225] Updated weights for policy 1, policy_version 235791 (0.0010) [2023-12-27 20:55:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 120676352. Throughput: 0: 10001.7, 1: 9731.5. Samples: 120659972. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:16,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-5.953')] [2023-12-27 20:55:16,759][106226] Updated weights for policy 0, policy_version 235488 (0.0005) [2023-12-27 20:55:16,794][106225] Updated weights for policy 1, policy_version 235801 (0.0010) [2023-12-27 20:55:16,817][106226] Updated weights for policy 0, policy_version 235498 (0.0005) [2023-12-27 20:55:16,851][106225] Updated weights for policy 1, policy_version 235811 (0.0010) [2023-12-27 20:55:16,873][106226] Updated weights for policy 0, policy_version 235508 (0.0005) [2023-12-27 20:55:16,908][106225] Updated weights for policy 1, policy_version 235821 (0.0010) [2023-12-27 20:55:17,528][106226] Updated weights for policy 0, policy_version 235518 (0.0007) [2023-12-27 20:55:17,575][106226] Updated weights for policy 0, policy_version 235528 (0.0008) [2023-12-27 20:55:17,616][106225] Updated weights for policy 1, policy_version 235831 (0.0010) [2023-12-27 20:55:17,637][106226] Updated weights for policy 0, policy_version 235538 (0.0006) [2023-12-27 20:55:17,673][106225] Updated weights for policy 1, policy_version 235841 (0.0010) [2023-12-27 20:55:17,735][106225] Updated weights for policy 1, policy_version 235851 (0.0010) [2023-12-27 20:55:18,309][106226] Updated weights for policy 0, policy_version 235548 (0.0006) [2023-12-27 20:55:18,369][106226] Updated weights for policy 0, policy_version 235558 (0.0008) [2023-12-27 20:55:18,424][106226] Updated weights for policy 0, policy_version 235568 (0.0007) [2023-12-27 20:55:18,485][106225] Updated weights for policy 1, policy_version 235861 (0.0008) [2023-12-27 20:55:18,542][106225] Updated weights for policy 1, policy_version 235871 (0.0008) [2023-12-27 20:55:18,604][106225] Updated weights for policy 1, policy_version 235881 (0.0009) [2023-12-27 20:55:19,202][106226] Updated weights for policy 0, policy_version 235578 (0.0009) [2023-12-27 20:55:19,245][106225] Updated weights for policy 1, policy_version 235891 (0.0008) [2023-12-27 20:55:19,274][106226] Updated weights for policy 0, policy_version 235588 (0.0009) [2023-12-27 20:55:19,309][106225] Updated weights for policy 1, policy_version 235901 (0.0006) [2023-12-27 20:55:19,333][106226] Updated weights for policy 0, policy_version 235598 (0.0009) [2023-12-27 20:55:19,382][106225] Updated weights for policy 1, policy_version 235911 (0.0008) [2023-12-27 20:55:19,395][106226] Updated weights for policy 0, policy_version 235608 (0.0007) [2023-12-27 20:55:20,117][106226] Updated weights for policy 0, policy_version 235618 (0.0008) [2023-12-27 20:55:20,122][106225] Updated weights for policy 1, policy_version 235921 (0.0008) [2023-12-27 20:55:20,171][106226] Updated weights for policy 0, policy_version 235628 (0.0007) [2023-12-27 20:55:20,179][106225] Updated weights for policy 1, policy_version 235931 (0.0008) [2023-12-27 20:55:20,221][106226] Updated weights for policy 0, policy_version 235638 (0.0006) [2023-12-27 20:55:20,246][106225] Updated weights for policy 1, policy_version 235941 (0.0008) [2023-12-27 20:55:20,294][106225] Updated weights for policy 1, policy_version 235951 (0.0008) [2023-12-27 20:55:20,947][106226] Updated weights for policy 0, policy_version 235648 (0.0008) [2023-12-27 20:55:21,014][106226] Updated weights for policy 0, policy_version 235658 (0.0009) [2023-12-27 20:55:21,067][106225] Updated weights for policy 1, policy_version 235961 (0.0009) [2023-12-27 20:55:21,082][106226] Updated weights for policy 0, policy_version 235668 (0.0008) [2023-12-27 20:55:21,138][106225] Updated weights for policy 1, policy_version 235971 (0.0008) [2023-12-27 20:55:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 120766464. Throughput: 0: 9939.8, 1: 9727.7. Samples: 120776980. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:21,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-6.249')] [2023-12-27 20:55:21,205][106225] Updated weights for policy 1, policy_version 235981 (0.0009) [2023-12-27 20:55:21,818][106226] Updated weights for policy 0, policy_version 235678 (0.0009) [2023-12-27 20:55:21,882][106226] Updated weights for policy 0, policy_version 235688 (0.0009) [2023-12-27 20:55:21,943][106226] Updated weights for policy 0, policy_version 235698 (0.0009) [2023-12-27 20:55:21,967][106225] Updated weights for policy 1, policy_version 235991 (0.0009) [2023-12-27 20:55:22,031][106225] Updated weights for policy 1, policy_version 236001 (0.0009) [2023-12-27 20:55:22,088][106225] Updated weights for policy 1, policy_version 236011 (0.0008) [2023-12-27 20:55:22,726][106226] Updated weights for policy 0, policy_version 235708 (0.0007) [2023-12-27 20:55:22,789][106226] Updated weights for policy 0, policy_version 235718 (0.0009) [2023-12-27 20:55:22,807][106225] Updated weights for policy 1, policy_version 236021 (0.0008) [2023-12-27 20:55:22,849][106226] Updated weights for policy 0, policy_version 235728 (0.0008) [2023-12-27 20:55:22,863][106225] Updated weights for policy 1, policy_version 236031 (0.0006) [2023-12-27 20:55:22,917][106225] Updated weights for policy 1, policy_version 236041 (0.0007) [2023-12-27 20:55:23,596][106226] Updated weights for policy 0, policy_version 235738 (0.0008) [2023-12-27 20:55:23,627][106225] Updated weights for policy 1, policy_version 236051 (0.0008) [2023-12-27 20:55:23,645][106226] Updated weights for policy 0, policy_version 235748 (0.0007) [2023-12-27 20:55:23,678][106225] Updated weights for policy 1, policy_version 236061 (0.0006) [2023-12-27 20:55:23,696][106226] Updated weights for policy 0, policy_version 235758 (0.0007) [2023-12-27 20:55:23,740][106225] Updated weights for policy 1, policy_version 236071 (0.0007) [2023-12-27 20:55:23,750][106226] Updated weights for policy 0, policy_version 235768 (0.0007) [2023-12-27 20:55:24,460][106225] Updated weights for policy 1, policy_version 236081 (0.0008) [2023-12-27 20:55:24,499][106226] Updated weights for policy 0, policy_version 235778 (0.0009) [2023-12-27 20:55:24,517][106225] Updated weights for policy 1, policy_version 236091 (0.0009) [2023-12-27 20:55:24,561][106226] Updated weights for policy 0, policy_version 235788 (0.0008) [2023-12-27 20:55:24,568][106225] Updated weights for policy 1, policy_version 236101 (0.0007) [2023-12-27 20:55:24,611][106226] Updated weights for policy 0, policy_version 235798 (0.0008) [2023-12-27 20:55:24,624][106225] Updated weights for policy 1, policy_version 236111 (0.0005) [2023-12-27 20:55:25,327][106226] Updated weights for policy 0, policy_version 235808 (0.0007) [2023-12-27 20:55:25,330][106225] Updated weights for policy 1, policy_version 236121 (0.0007) [2023-12-27 20:55:25,389][106225] Updated weights for policy 1, policy_version 236131 (0.0008) [2023-12-27 20:55:25,399][106226] Updated weights for policy 0, policy_version 235818 (0.0006) [2023-12-27 20:55:25,448][106226] Updated weights for policy 0, policy_version 235828 (0.0006) [2023-12-27 20:55:25,452][106225] Updated weights for policy 1, policy_version 236141 (0.0007) [2023-12-27 20:55:26,073][106226] Updated weights for policy 0, policy_version 235838 (0.0010) [2023-12-27 20:55:26,132][106226] Updated weights for policy 0, policy_version 235848 (0.0010) [2023-12-27 20:55:26,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19524.4, 300 sec: 19799.6). Total num frames: 120856576. Throughput: 0: 9918.1, 1: 9644.3. Samples: 120832432. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:26,175][105115] Avg episode reward: [(0, '-4.974'), (1, '-6.239')] [2023-12-27 20:55:26,188][106226] Updated weights for policy 0, policy_version 235858 (0.0010) [2023-12-27 20:55:26,202][106225] Updated weights for policy 1, policy_version 236151 (0.0006) [2023-12-27 20:55:26,215][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000235864_60399616.pth... [2023-12-27 20:55:26,218][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000234696_60096512.pth [2023-12-27 20:55:26,255][106225] Updated weights for policy 1, policy_version 236161 (0.0007) [2023-12-27 20:55:26,305][106225] Updated weights for policy 1, policy_version 236171 (0.0007) [2023-12-27 20:55:26,329][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000236176_60473344.pth... [2023-12-27 20:55:26,333][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000235024_60178432.pth [2023-12-27 20:55:26,864][106226] Updated weights for policy 0, policy_version 235868 (0.0010) [2023-12-27 20:55:26,916][106226] Updated weights for policy 0, policy_version 235878 (0.0010) [2023-12-27 20:55:26,962][106226] Updated weights for policy 0, policy_version 235888 (0.0010) [2023-12-27 20:55:27,011][106225] Updated weights for policy 1, policy_version 236181 (0.0006) [2023-12-27 20:55:27,068][106225] Updated weights for policy 1, policy_version 236191 (0.0005) [2023-12-27 20:55:27,123][106225] Updated weights for policy 1, policy_version 236201 (0.0005) [2023-12-27 20:55:27,602][106226] Updated weights for policy 0, policy_version 235898 (0.0009) [2023-12-27 20:55:27,653][106226] Updated weights for policy 0, policy_version 235908 (0.0005) [2023-12-27 20:55:27,700][106225] Updated weights for policy 1, policy_version 236211 (0.0007) [2023-12-27 20:55:27,721][106226] Updated weights for policy 0, policy_version 235918 (0.0006) [2023-12-27 20:55:27,751][106225] Updated weights for policy 1, policy_version 236221 (0.0005) [2023-12-27 20:55:27,765][106226] Updated weights for policy 0, policy_version 235928 (0.0006) [2023-12-27 20:55:27,801][106225] Updated weights for policy 1, policy_version 236231 (0.0005) [2023-12-27 20:55:28,316][106226] Updated weights for policy 0, policy_version 235938 (0.0006) [2023-12-27 20:55:28,379][106226] Updated weights for policy 0, policy_version 235948 (0.0007) [2023-12-27 20:55:28,436][106226] Updated weights for policy 0, policy_version 235958 (0.0007) [2023-12-27 20:55:28,540][106225] Updated weights for policy 1, policy_version 236241 (0.0006) [2023-12-27 20:55:28,597][106225] Updated weights for policy 1, policy_version 236251 (0.0008) [2023-12-27 20:55:28,659][106225] Updated weights for policy 1, policy_version 236261 (0.0006) [2023-12-27 20:55:28,719][106225] Updated weights for policy 1, policy_version 236271 (0.0007) [2023-12-27 20:55:29,036][106226] Updated weights for policy 0, policy_version 235968 (0.0006) [2023-12-27 20:55:29,083][106226] Updated weights for policy 0, policy_version 235978 (0.0005) [2023-12-27 20:55:29,134][106226] Updated weights for policy 0, policy_version 235988 (0.0005) [2023-12-27 20:55:29,443][106225] Updated weights for policy 1, policy_version 236281 (0.0009) [2023-12-27 20:55:29,504][106225] Updated weights for policy 1, policy_version 236291 (0.0009) [2023-12-27 20:55:29,564][106225] Updated weights for policy 1, policy_version 236301 (0.0007) [2023-12-27 20:55:29,714][106226] Updated weights for policy 0, policy_version 235998 (0.0007) [2023-12-27 20:55:29,766][106226] Updated weights for policy 0, policy_version 236008 (0.0007) [2023-12-27 20:55:29,825][106226] Updated weights for policy 0, policy_version 236018 (0.0006) [2023-12-27 20:55:30,364][106225] Updated weights for policy 1, policy_version 236311 (0.0007) [2023-12-27 20:55:30,420][106226] Updated weights for policy 0, policy_version 236028 (0.0008) [2023-12-27 20:55:30,423][106225] Updated weights for policy 1, policy_version 236321 (0.0009) [2023-12-27 20:55:30,474][106226] Updated weights for policy 0, policy_version 236038 (0.0008) [2023-12-27 20:55:30,480][106225] Updated weights for policy 1, policy_version 236331 (0.0007) [2023-12-27 20:55:30,536][106226] Updated weights for policy 0, policy_version 236048 (0.0008) [2023-12-27 20:55:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 120963072. Throughput: 0: 10077.8, 1: 9712.1. Samples: 120956892. Policy #0 lag: (min: 31.0, avg: 32.9, max: 62.0) [2023-12-27 20:55:31,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-6.585')] [2023-12-27 20:55:31,212][106225] Updated weights for policy 1, policy_version 236341 (0.0008) [2023-12-27 20:55:31,267][106225] Updated weights for policy 1, policy_version 236351 (0.0009) [2023-12-27 20:55:31,332][106225] Updated weights for policy 1, policy_version 236361 (0.0008) [2023-12-27 20:55:31,338][106226] Updated weights for policy 0, policy_version 236058 (0.0008) [2023-12-27 20:55:31,404][106226] Updated weights for policy 0, policy_version 236068 (0.0008) [2023-12-27 20:55:31,456][106226] Updated weights for policy 0, policy_version 236078 (0.0006) [2023-12-27 20:55:31,511][106226] Updated weights for policy 0, policy_version 236088 (0.0008) [2023-12-27 20:55:32,111][106225] Updated weights for policy 1, policy_version 236371 (0.0008) [2023-12-27 20:55:32,171][106225] Updated weights for policy 1, policy_version 236381 (0.0007) [2023-12-27 20:55:32,188][106226] Updated weights for policy 0, policy_version 236098 (0.0007) [2023-12-27 20:55:32,223][106225] Updated weights for policy 1, policy_version 236391 (0.0006) [2023-12-27 20:55:32,241][106226] Updated weights for policy 0, policy_version 236108 (0.0005) [2023-12-27 20:55:32,297][106226] Updated weights for policy 0, policy_version 236118 (0.0007) [2023-12-27 20:55:32,971][106225] Updated weights for policy 1, policy_version 236401 (0.0008) [2023-12-27 20:55:33,006][106226] Updated weights for policy 0, policy_version 236128 (0.0007) [2023-12-27 20:55:33,026][106225] Updated weights for policy 1, policy_version 236411 (0.0006) [2023-12-27 20:55:33,058][106226] Updated weights for policy 0, policy_version 236138 (0.0007) [2023-12-27 20:55:33,080][106225] Updated weights for policy 1, policy_version 236421 (0.0006) [2023-12-27 20:55:33,116][106226] Updated weights for policy 0, policy_version 236148 (0.0006) [2023-12-27 20:55:33,140][106225] Updated weights for policy 1, policy_version 236431 (0.0007) [2023-12-27 20:55:33,758][106226] Updated weights for policy 0, policy_version 236158 (0.0007) [2023-12-27 20:55:33,809][106226] Updated weights for policy 0, policy_version 236168 (0.0008) [2023-12-27 20:55:33,856][106225] Updated weights for policy 1, policy_version 236441 (0.0005) [2023-12-27 20:55:33,862][106226] Updated weights for policy 0, policy_version 236178 (0.0007) [2023-12-27 20:55:33,902][106225] Updated weights for policy 1, policy_version 236451 (0.0005) [2023-12-27 20:55:33,956][106225] Updated weights for policy 1, policy_version 236461 (0.0005) [2023-12-27 20:55:34,509][106226] Updated weights for policy 0, policy_version 236188 (0.0008) [2023-12-27 20:55:34,573][106226] Updated weights for policy 0, policy_version 236198 (0.0008) [2023-12-27 20:55:34,574][106225] Updated weights for policy 1, policy_version 236471 (0.0007) [2023-12-27 20:55:34,640][106225] Updated weights for policy 1, policy_version 236481 (0.0006) [2023-12-27 20:55:34,641][106226] Updated weights for policy 0, policy_version 236208 (0.0008) [2023-12-27 20:55:34,704][106225] Updated weights for policy 1, policy_version 236491 (0.0008) [2023-12-27 20:55:35,292][106225] Updated weights for policy 1, policy_version 236501 (0.0008) [2023-12-27 20:55:35,345][106225] Updated weights for policy 1, policy_version 236511 (0.0010) [2023-12-27 20:55:35,391][106225] Updated weights for policy 1, policy_version 236521 (0.0010) [2023-12-27 20:55:35,405][106226] Updated weights for policy 0, policy_version 236218 (0.0008) [2023-12-27 20:55:35,458][106226] Updated weights for policy 0, policy_version 236228 (0.0008) [2023-12-27 20:55:35,515][106226] Updated weights for policy 0, policy_version 236238 (0.0007) [2023-12-27 20:55:35,573][106226] Updated weights for policy 0, policy_version 236248 (0.0008) [2023-12-27 20:55:36,137][106225] Updated weights for policy 1, policy_version 236531 (0.0010) [2023-12-27 20:55:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 121061376. Throughput: 0: 10102.4, 1: 9776.2. Samples: 121076000. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:55:36,175][105115] Avg episode reward: [(0, '-5.295'), (1, '-6.135')] [2023-12-27 20:55:36,192][106225] Updated weights for policy 1, policy_version 236541 (0.0010) [2023-12-27 20:55:36,243][106225] Updated weights for policy 1, policy_version 236551 (0.0010) [2023-12-27 20:55:36,321][106226] Updated weights for policy 0, policy_version 236258 (0.0007) [2023-12-27 20:55:36,379][106226] Updated weights for policy 0, policy_version 236268 (0.0008) [2023-12-27 20:55:36,438][106226] Updated weights for policy 0, policy_version 236278 (0.0008) [2023-12-27 20:55:36,979][106225] Updated weights for policy 1, policy_version 236561 (0.0010) [2023-12-27 20:55:37,042][106225] Updated weights for policy 1, policy_version 236571 (0.0009) [2023-12-27 20:55:37,105][106225] Updated weights for policy 1, policy_version 236581 (0.0005) [2023-12-27 20:55:37,155][106225] Updated weights for policy 1, policy_version 236591 (0.0010) [2023-12-27 20:55:37,190][106226] Updated weights for policy 0, policy_version 236288 (0.0008) [2023-12-27 20:55:37,249][106226] Updated weights for policy 0, policy_version 236298 (0.0007) [2023-12-27 20:55:37,311][106226] Updated weights for policy 0, policy_version 236308 (0.0007) [2023-12-27 20:55:37,764][106225] Updated weights for policy 1, policy_version 236601 (0.0010) [2023-12-27 20:55:37,821][106225] Updated weights for policy 1, policy_version 236611 (0.0010) [2023-12-27 20:55:37,873][106225] Updated weights for policy 1, policy_version 236621 (0.0010) [2023-12-27 20:55:37,950][106226] Updated weights for policy 0, policy_version 236318 (0.0010) [2023-12-27 20:55:38,007][106226] Updated weights for policy 0, policy_version 236328 (0.0009) [2023-12-27 20:55:38,061][106226] Updated weights for policy 0, policy_version 236338 (0.0005) [2023-12-27 20:55:38,505][106225] Updated weights for policy 1, policy_version 236631 (0.0010) [2023-12-27 20:55:38,565][106225] Updated weights for policy 1, policy_version 236641 (0.0007) [2023-12-27 20:55:38,630][106225] Updated weights for policy 1, policy_version 236651 (0.0005) [2023-12-27 20:55:38,705][106226] Updated weights for policy 0, policy_version 236348 (0.0006) [2023-12-27 20:55:38,752][106226] Updated weights for policy 0, policy_version 236358 (0.0008) [2023-12-27 20:55:38,807][106226] Updated weights for policy 0, policy_version 236368 (0.0009) [2023-12-27 20:55:39,239][106225] Updated weights for policy 1, policy_version 236662 (0.0009) [2023-12-27 20:55:39,300][106225] Updated weights for policy 1, policy_version 236672 (0.0008) [2023-12-27 20:55:39,371][106225] Updated weights for policy 1, policy_version 236682 (0.0008) [2023-12-27 20:55:39,408][106226] Updated weights for policy 0, policy_version 236378 (0.0010) [2023-12-27 20:55:39,472][106226] Updated weights for policy 0, policy_version 236388 (0.0007) [2023-12-27 20:55:39,529][106226] Updated weights for policy 0, policy_version 236398 (0.0008) [2023-12-27 20:55:39,589][106226] Updated weights for policy 0, policy_version 236408 (0.0009) [2023-12-27 20:55:40,047][106225] Updated weights for policy 1, policy_version 236692 (0.0008) [2023-12-27 20:55:40,110][106225] Updated weights for policy 1, policy_version 236702 (0.0008) [2023-12-27 20:55:40,169][106225] Updated weights for policy 1, policy_version 236712 (0.0008) [2023-12-27 20:55:40,275][106226] Updated weights for policy 0, policy_version 236418 (0.0011) [2023-12-27 20:55:40,336][106226] Updated weights for policy 0, policy_version 236428 (0.0010) [2023-12-27 20:55:40,390][106226] Updated weights for policy 0, policy_version 236438 (0.0011) [2023-12-27 20:55:40,933][106225] Updated weights for policy 1, policy_version 236722 (0.0009) [2023-12-27 20:55:40,992][106225] Updated weights for policy 1, policy_version 236732 (0.0009) [2023-12-27 20:55:41,055][106225] Updated weights for policy 1, policy_version 236742 (0.0010) [2023-12-27 20:55:41,114][106225] Updated weights for policy 1, policy_version 236752 (0.0009) [2023-12-27 20:55:41,120][106226] Updated weights for policy 0, policy_version 236448 (0.0012) [2023-12-27 20:55:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 121167872. Throughput: 0: 10086.7, 1: 9865.3. Samples: 121137636. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:55:41,175][105115] Avg episode reward: [(0, '-5.009'), (1, '-6.084')] [2023-12-27 20:55:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000236752_60620800.pth... [2023-12-27 20:55:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000235600_60325888.pth [2023-12-27 20:55:41,191][106226] Updated weights for policy 0, policy_version 236458 (0.0010) [2023-12-27 20:55:41,265][106226] Updated weights for policy 0, policy_version 236468 (0.0006) [2023-12-27 20:55:41,292][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000236472_60555264.pth... [2023-12-27 20:55:41,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000235288_60252160.pth [2023-12-27 20:55:41,946][106225] Updated weights for policy 1, policy_version 236762 (0.0008) [2023-12-27 20:55:41,978][106226] Updated weights for policy 0, policy_version 236478 (0.0008) [2023-12-27 20:55:42,012][106225] Updated weights for policy 1, policy_version 236772 (0.0007) [2023-12-27 20:55:42,036][106226] Updated weights for policy 0, policy_version 236488 (0.0007) [2023-12-27 20:55:42,075][106225] Updated weights for policy 1, policy_version 236782 (0.0006) [2023-12-27 20:55:42,100][106226] Updated weights for policy 0, policy_version 236498 (0.0009) [2023-12-27 20:55:42,796][106225] Updated weights for policy 1, policy_version 236792 (0.0008) [2023-12-27 20:55:42,805][106226] Updated weights for policy 0, policy_version 236508 (0.0010) [2023-12-27 20:55:42,858][106225] Updated weights for policy 1, policy_version 236802 (0.0008) [2023-12-27 20:55:42,865][106226] Updated weights for policy 0, policy_version 236518 (0.0006) [2023-12-27 20:55:42,909][106225] Updated weights for policy 1, policy_version 236812 (0.0007) [2023-12-27 20:55:42,922][106226] Updated weights for policy 0, policy_version 236528 (0.0005) [2023-12-27 20:55:43,563][106226] Updated weights for policy 0, policy_version 236538 (0.0007) [2023-12-27 20:55:43,585][106225] Updated weights for policy 1, policy_version 236822 (0.0006) [2023-12-27 20:55:43,612][106226] Updated weights for policy 0, policy_version 236548 (0.0008) [2023-12-27 20:55:43,638][106225] Updated weights for policy 1, policy_version 236832 (0.0005) [2023-12-27 20:55:43,665][106226] Updated weights for policy 0, policy_version 236558 (0.0006) [2023-12-27 20:55:43,690][106225] Updated weights for policy 1, policy_version 236842 (0.0005) [2023-12-27 20:55:43,715][106226] Updated weights for policy 0, policy_version 236568 (0.0009) [2023-12-27 20:55:44,207][106225] Updated weights for policy 1, policy_version 236852 (0.0005) [2023-12-27 20:55:44,287][106225] Updated weights for policy 1, policy_version 236862 (0.0006) [2023-12-27 20:55:44,350][106225] Updated weights for policy 1, policy_version 236872 (0.0005) [2023-12-27 20:55:44,516][106226] Updated weights for policy 0, policy_version 236578 (0.0009) [2023-12-27 20:55:44,580][106226] Updated weights for policy 0, policy_version 236588 (0.0009) [2023-12-27 20:55:44,641][106226] Updated weights for policy 0, policy_version 236598 (0.0006) [2023-12-27 20:55:44,960][106225] Updated weights for policy 1, policy_version 236882 (0.0006) [2023-12-27 20:55:45,029][106225] Updated weights for policy 1, policy_version 236892 (0.0007) [2023-12-27 20:55:45,093][106225] Updated weights for policy 1, policy_version 236902 (0.0008) [2023-12-27 20:55:45,156][106225] Updated weights for policy 1, policy_version 236912 (0.0009) [2023-12-27 20:55:45,317][106226] Updated weights for policy 0, policy_version 236608 (0.0008) [2023-12-27 20:55:45,377][106226] Updated weights for policy 0, policy_version 236618 (0.0008) [2023-12-27 20:55:45,443][106226] Updated weights for policy 0, policy_version 236628 (0.0008) [2023-12-27 20:55:45,857][106225] Updated weights for policy 1, policy_version 236922 (0.0005) [2023-12-27 20:55:45,920][106225] Updated weights for policy 1, policy_version 236932 (0.0008) [2023-12-27 20:55:45,984][106225] Updated weights for policy 1, policy_version 236942 (0.0007) [2023-12-27 20:55:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 121266176. Throughput: 0: 10024.6, 1: 9871.3. Samples: 121257352. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:55:46,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-6.382')] [2023-12-27 20:55:46,202][106226] Updated weights for policy 0, policy_version 236638 (0.0007) [2023-12-27 20:55:46,258][106226] Updated weights for policy 0, policy_version 236648 (0.0008) [2023-12-27 20:55:46,310][106226] Updated weights for policy 0, policy_version 236658 (0.0008) [2023-12-27 20:55:46,631][106225] Updated weights for policy 1, policy_version 236952 (0.0009) [2023-12-27 20:55:46,682][106225] Updated weights for policy 1, policy_version 236962 (0.0008) [2023-12-27 20:55:46,737][106225] Updated weights for policy 1, policy_version 236972 (0.0008) [2023-12-27 20:55:47,026][106226] Updated weights for policy 0, policy_version 236668 (0.0009) [2023-12-27 20:55:47,091][106226] Updated weights for policy 0, policy_version 236678 (0.0009) [2023-12-27 20:55:47,146][106226] Updated weights for policy 0, policy_version 236688 (0.0009) [2023-12-27 20:55:47,379][106225] Updated weights for policy 1, policy_version 236982 (0.0007) [2023-12-27 20:55:47,432][106225] Updated weights for policy 1, policy_version 236992 (0.0006) [2023-12-27 20:55:47,487][106225] Updated weights for policy 1, policy_version 237002 (0.0005) [2023-12-27 20:55:47,970][106226] Updated weights for policy 0, policy_version 236698 (0.0009) [2023-12-27 20:55:48,028][106226] Updated weights for policy 0, policy_version 236708 (0.0009) [2023-12-27 20:55:48,091][106226] Updated weights for policy 0, policy_version 236718 (0.0009) [2023-12-27 20:55:48,115][106225] Updated weights for policy 1, policy_version 237012 (0.0006) [2023-12-27 20:55:48,148][106226] Updated weights for policy 0, policy_version 236728 (0.0009) [2023-12-27 20:55:48,175][106225] Updated weights for policy 1, policy_version 237022 (0.0007) [2023-12-27 20:55:48,229][106225] Updated weights for policy 1, policy_version 237032 (0.0007) [2023-12-27 20:55:48,862][106226] Updated weights for policy 0, policy_version 236738 (0.0009) [2023-12-27 20:55:48,922][106226] Updated weights for policy 0, policy_version 236748 (0.0009) [2023-12-27 20:55:48,963][106225] Updated weights for policy 1, policy_version 237042 (0.0008) [2023-12-27 20:55:48,980][106226] Updated weights for policy 0, policy_version 236758 (0.0009) [2023-12-27 20:55:49,016][106225] Updated weights for policy 1, policy_version 237052 (0.0005) [2023-12-27 20:55:49,069][106225] Updated weights for policy 1, policy_version 237062 (0.0005) [2023-12-27 20:55:49,121][106225] Updated weights for policy 1, policy_version 237072 (0.0005) [2023-12-27 20:55:49,726][106226] Updated weights for policy 0, policy_version 236768 (0.0006) [2023-12-27 20:55:49,780][106226] Updated weights for policy 0, policy_version 236778 (0.0006) [2023-12-27 20:55:49,819][106225] Updated weights for policy 1, policy_version 237082 (0.0008) [2023-12-27 20:55:49,837][106226] Updated weights for policy 0, policy_version 236788 (0.0007) [2023-12-27 20:55:49,887][106225] Updated weights for policy 1, policy_version 237092 (0.0009) [2023-12-27 20:55:49,954][106225] Updated weights for policy 1, policy_version 237102 (0.0008) [2023-12-27 20:55:50,395][106226] Updated weights for policy 0, policy_version 236798 (0.0008) [2023-12-27 20:55:50,443][106226] Updated weights for policy 0, policy_version 236808 (0.0010) [2023-12-27 20:55:50,499][106226] Updated weights for policy 0, policy_version 236818 (0.0011) [2023-12-27 20:55:50,681][106225] Updated weights for policy 1, policy_version 237112 (0.0008) [2023-12-27 20:55:50,740][106225] Updated weights for policy 1, policy_version 237122 (0.0008) [2023-12-27 20:55:50,802][106225] Updated weights for policy 1, policy_version 237132 (0.0008) [2023-12-27 20:55:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 121364480. Throughput: 0: 9974.3, 1: 9901.5. Samples: 121374912. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:55:51,175][105115] Avg episode reward: [(0, '-5.017'), (1, '-6.142')] [2023-12-27 20:55:51,295][106226] Updated weights for policy 0, policy_version 236828 (0.0010) [2023-12-27 20:55:51,365][106226] Updated weights for policy 0, policy_version 236838 (0.0009) [2023-12-27 20:55:51,427][106226] Updated weights for policy 0, policy_version 236848 (0.0009) [2023-12-27 20:55:51,526][106225] Updated weights for policy 1, policy_version 237142 (0.0008) [2023-12-27 20:55:51,579][106225] Updated weights for policy 1, policy_version 237152 (0.0009) [2023-12-27 20:55:51,635][106225] Updated weights for policy 1, policy_version 237162 (0.0008) [2023-12-27 20:55:52,209][106226] Updated weights for policy 0, policy_version 236858 (0.0009) [2023-12-27 20:55:52,265][106226] Updated weights for policy 0, policy_version 236868 (0.0009) [2023-12-27 20:55:52,330][106226] Updated weights for policy 0, policy_version 236878 (0.0008) [2023-12-27 20:55:52,381][106225] Updated weights for policy 1, policy_version 237172 (0.0007) [2023-12-27 20:55:52,397][106226] Updated weights for policy 0, policy_version 236888 (0.0009) [2023-12-27 20:55:52,442][106225] Updated weights for policy 1, policy_version 237182 (0.0007) [2023-12-27 20:55:52,507][106225] Updated weights for policy 1, policy_version 237192 (0.0007) [2023-12-27 20:55:53,153][106226] Updated weights for policy 0, policy_version 236898 (0.0009) [2023-12-27 20:55:53,205][106226] Updated weights for policy 0, policy_version 236908 (0.0008) [2023-12-27 20:55:53,210][106225] Updated weights for policy 1, policy_version 237202 (0.0007) [2023-12-27 20:55:53,258][106225] Updated weights for policy 1, policy_version 237212 (0.0008) [2023-12-27 20:55:53,261][106226] Updated weights for policy 0, policy_version 236918 (0.0009) [2023-12-27 20:55:53,307][106225] Updated weights for policy 1, policy_version 237222 (0.0006) [2023-12-27 20:55:53,355][106225] Updated weights for policy 1, policy_version 237232 (0.0008) [2023-12-27 20:55:53,997][106226] Updated weights for policy 0, policy_version 236928 (0.0009) [2023-12-27 20:55:54,056][106226] Updated weights for policy 0, policy_version 236938 (0.0009) [2023-12-27 20:55:54,108][106226] Updated weights for policy 0, policy_version 236948 (0.0008) [2023-12-27 20:55:54,110][106225] Updated weights for policy 1, policy_version 237242 (0.0006) [2023-12-27 20:55:54,163][106225] Updated weights for policy 1, policy_version 237252 (0.0008) [2023-12-27 20:55:54,217][106225] Updated weights for policy 1, policy_version 237262 (0.0010) [2023-12-27 20:55:54,802][106225] Updated weights for policy 1, policy_version 237272 (0.0006) [2023-12-27 20:55:54,860][106225] Updated weights for policy 1, policy_version 237282 (0.0006) [2023-12-27 20:55:54,916][106225] Updated weights for policy 1, policy_version 237292 (0.0006) [2023-12-27 20:55:54,949][106226] Updated weights for policy 0, policy_version 236958 (0.0007) [2023-12-27 20:55:55,002][106226] Updated weights for policy 0, policy_version 236968 (0.0008) [2023-12-27 20:55:55,065][106226] Updated weights for policy 0, policy_version 236978 (0.0008) [2023-12-27 20:55:55,503][106225] Updated weights for policy 1, policy_version 237302 (0.0005) [2023-12-27 20:55:55,551][106225] Updated weights for policy 1, policy_version 237312 (0.0005) [2023-12-27 20:55:55,610][106225] Updated weights for policy 1, policy_version 237322 (0.0005) [2023-12-27 20:55:55,705][106226] Updated weights for policy 0, policy_version 236988 (0.0009) [2023-12-27 20:55:55,761][106226] Updated weights for policy 0, policy_version 236998 (0.0008) [2023-12-27 20:55:55,827][106226] Updated weights for policy 0, policy_version 237008 (0.0009) [2023-12-27 20:55:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 121462784. Throughput: 0: 9840.9, 1: 9916.1. Samples: 121430944. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:55:56,175][105115] Avg episode reward: [(0, '-4.869'), (1, '-5.970')] [2023-12-27 20:55:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000237016_60694528.pth... [2023-12-27 20:55:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000235864_60399616.pth [2023-12-27 20:55:56,204][106225] Updated weights for policy 1, policy_version 237332 (0.0006) [2023-12-27 20:55:56,259][106225] Updated weights for policy 1, policy_version 237342 (0.0007) [2023-12-27 20:55:56,312][106225] Updated weights for policy 1, policy_version 237352 (0.0006) [2023-12-27 20:55:56,348][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000237360_60776448.pth... [2023-12-27 20:55:56,352][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000236176_60473344.pth [2023-12-27 20:55:56,557][106226] Updated weights for policy 0, policy_version 237018 (0.0008) [2023-12-27 20:55:56,616][106226] Updated weights for policy 0, policy_version 237028 (0.0008) [2023-12-27 20:55:56,674][106226] Updated weights for policy 0, policy_version 237038 (0.0008) [2023-12-27 20:55:56,723][106226] Updated weights for policy 0, policy_version 237048 (0.0009) [2023-12-27 20:55:57,018][106225] Updated weights for policy 1, policy_version 237362 (0.0008) [2023-12-27 20:55:57,074][106225] Updated weights for policy 1, policy_version 237372 (0.0008) [2023-12-27 20:55:57,134][106225] Updated weights for policy 1, policy_version 237382 (0.0008) [2023-12-27 20:55:57,191][106225] Updated weights for policy 1, policy_version 237392 (0.0009) [2023-12-27 20:55:57,419][106226] Updated weights for policy 0, policy_version 237058 (0.0009) [2023-12-27 20:55:57,469][106226] Updated weights for policy 0, policy_version 237069 (0.0009) [2023-12-27 20:55:57,524][106226] Updated weights for policy 0, policy_version 237080 (0.0010) [2023-12-27 20:55:57,829][106225] Updated weights for policy 1, policy_version 237402 (0.0006) [2023-12-27 20:55:57,876][106225] Updated weights for policy 1, policy_version 237412 (0.0005) [2023-12-27 20:55:57,933][106225] Updated weights for policy 1, policy_version 237422 (0.0007) [2023-12-27 20:55:58,316][106226] Updated weights for policy 0, policy_version 237090 (0.0008) [2023-12-27 20:55:58,395][106226] Updated weights for policy 0, policy_version 237100 (0.0008) [2023-12-27 20:55:58,460][106226] Updated weights for policy 0, policy_version 237110 (0.0009) [2023-12-27 20:55:58,625][106225] Updated weights for policy 1, policy_version 237432 (0.0007) [2023-12-27 20:55:58,690][106225] Updated weights for policy 1, policy_version 237442 (0.0009) [2023-12-27 20:55:58,759][106225] Updated weights for policy 1, policy_version 237453 (0.0010) [2023-12-27 20:55:59,360][106226] Updated weights for policy 0, policy_version 237120 (0.0008) [2023-12-27 20:55:59,432][106226] Updated weights for policy 0, policy_version 237130 (0.0010) [2023-12-27 20:55:59,495][106226] Updated weights for policy 0, policy_version 237140 (0.0007) [2023-12-27 20:55:59,625][106225] Updated weights for policy 1, policy_version 237463 (0.0011) [2023-12-27 20:55:59,687][106225] Updated weights for policy 1, policy_version 237473 (0.0009) [2023-12-27 20:55:59,745][106225] Updated weights for policy 1, policy_version 237483 (0.0010) [2023-12-27 20:56:00,222][106226] Updated weights for policy 0, policy_version 237150 (0.0008) [2023-12-27 20:56:00,279][106226] Updated weights for policy 0, policy_version 237160 (0.0010) [2023-12-27 20:56:00,335][106226] Updated weights for policy 0, policy_version 237170 (0.0009) [2023-12-27 20:56:00,429][106225] Updated weights for policy 1, policy_version 237493 (0.0009) [2023-12-27 20:56:00,477][106225] Updated weights for policy 1, policy_version 237503 (0.0008) [2023-12-27 20:56:00,525][106225] Updated weights for policy 1, policy_version 237513 (0.0006) [2023-12-27 20:56:01,128][106226] Updated weights for policy 0, policy_version 237180 (0.0009) [2023-12-27 20:56:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 121552896. Throughput: 0: 9805.0, 1: 9955.2. Samples: 121549180. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:01,175][105115] Avg episode reward: [(0, '-5.180'), (1, '-6.014')] [2023-12-27 20:56:01,190][106225] Updated weights for policy 1, policy_version 237523 (0.0006) [2023-12-27 20:56:01,195][106226] Updated weights for policy 0, policy_version 237190 (0.0007) [2023-12-27 20:56:01,250][106225] Updated weights for policy 1, policy_version 237533 (0.0008) [2023-12-27 20:56:01,259][106226] Updated weights for policy 0, policy_version 237200 (0.0006) [2023-12-27 20:56:01,307][106225] Updated weights for policy 1, policy_version 237543 (0.0007) [2023-12-27 20:56:01,969][106226] Updated weights for policy 0, policy_version 237210 (0.0008) [2023-12-27 20:56:02,018][106226] Updated weights for policy 0, policy_version 237220 (0.0008) [2023-12-27 20:56:02,073][106226] Updated weights for policy 0, policy_version 237230 (0.0008) [2023-12-27 20:56:02,081][106225] Updated weights for policy 1, policy_version 237553 (0.0009) [2023-12-27 20:56:02,127][106226] Updated weights for policy 0, policy_version 237240 (0.0008) [2023-12-27 20:56:02,134][106225] Updated weights for policy 1, policy_version 237563 (0.0008) [2023-12-27 20:56:02,185][106225] Updated weights for policy 1, policy_version 237573 (0.0008) [2023-12-27 20:56:02,236][106225] Updated weights for policy 1, policy_version 237583 (0.0006) [2023-12-27 20:56:02,806][106226] Updated weights for policy 0, policy_version 237250 (0.0007) [2023-12-27 20:56:02,862][106226] Updated weights for policy 0, policy_version 237260 (0.0008) [2023-12-27 20:56:02,899][106225] Updated weights for policy 1, policy_version 237593 (0.0007) [2023-12-27 20:56:02,926][106226] Updated weights for policy 0, policy_version 237270 (0.0009) [2023-12-27 20:56:02,948][106225] Updated weights for policy 1, policy_version 237603 (0.0008) [2023-12-27 20:56:03,002][106225] Updated weights for policy 1, policy_version 237613 (0.0008) [2023-12-27 20:56:03,562][106226] Updated weights for policy 0, policy_version 237280 (0.0008) [2023-12-27 20:56:03,618][106226] Updated weights for policy 0, policy_version 237290 (0.0008) [2023-12-27 20:56:03,665][106226] Updated weights for policy 0, policy_version 237300 (0.0009) [2023-12-27 20:56:03,710][106225] Updated weights for policy 1, policy_version 237623 (0.0005) [2023-12-27 20:56:03,758][106225] Updated weights for policy 1, policy_version 237633 (0.0005) [2023-12-27 20:56:03,813][106225] Updated weights for policy 1, policy_version 237643 (0.0005) [2023-12-27 20:56:04,395][106226] Updated weights for policy 0, policy_version 237310 (0.0007) [2023-12-27 20:56:04,453][106226] Updated weights for policy 0, policy_version 237320 (0.0009) [2023-12-27 20:56:04,498][106225] Updated weights for policy 1, policy_version 237653 (0.0008) [2023-12-27 20:56:04,511][106226] Updated weights for policy 0, policy_version 237330 (0.0005) [2023-12-27 20:56:04,553][106225] Updated weights for policy 1, policy_version 237663 (0.0008) [2023-12-27 20:56:04,602][106225] Updated weights for policy 1, policy_version 237673 (0.0008) [2023-12-27 20:56:05,173][106226] Updated weights for policy 0, policy_version 237340 (0.0006) [2023-12-27 20:56:05,232][106226] Updated weights for policy 0, policy_version 237350 (0.0005) [2023-12-27 20:56:05,293][106226] Updated weights for policy 0, policy_version 237360 (0.0005) [2023-12-27 20:56:05,376][106225] Updated weights for policy 1, policy_version 237683 (0.0008) [2023-12-27 20:56:05,425][106225] Updated weights for policy 1, policy_version 237693 (0.0005) [2023-12-27 20:56:05,475][106225] Updated weights for policy 1, policy_version 237703 (0.0005) [2023-12-27 20:56:05,926][106226] Updated weights for policy 0, policy_version 237370 (0.0007) [2023-12-27 20:56:05,986][106226] Updated weights for policy 0, policy_version 237380 (0.0005) [2023-12-27 20:56:06,052][106226] Updated weights for policy 0, policy_version 237390 (0.0005) [2023-12-27 20:56:06,116][106226] Updated weights for policy 0, policy_version 237400 (0.0007) [2023-12-27 20:56:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 121659392. Throughput: 0: 9850.8, 1: 9975.8. Samples: 121669180. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:06,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.691')] [2023-12-27 20:56:06,177][106225] Updated weights for policy 1, policy_version 237713 (0.0005) [2023-12-27 20:56:06,240][106225] Updated weights for policy 1, policy_version 237723 (0.0008) [2023-12-27 20:56:06,303][106225] Updated weights for policy 1, policy_version 237733 (0.0008) [2023-12-27 20:56:06,359][106225] Updated weights for policy 1, policy_version 237743 (0.0008) [2023-12-27 20:56:06,815][106226] Updated weights for policy 0, policy_version 237410 (0.0007) [2023-12-27 20:56:06,878][106226] Updated weights for policy 0, policy_version 237420 (0.0009) [2023-12-27 20:56:06,937][106226] Updated weights for policy 0, policy_version 237430 (0.0008) [2023-12-27 20:56:07,077][106225] Updated weights for policy 1, policy_version 237753 (0.0008) [2023-12-27 20:56:07,131][106225] Updated weights for policy 1, policy_version 237763 (0.0008) [2023-12-27 20:56:07,199][106225] Updated weights for policy 1, policy_version 237773 (0.0007) [2023-12-27 20:56:07,695][106226] Updated weights for policy 0, policy_version 237440 (0.0006) [2023-12-27 20:56:07,755][106226] Updated weights for policy 0, policy_version 237450 (0.0006) [2023-12-27 20:56:07,802][106226] Updated weights for policy 0, policy_version 237460 (0.0008) [2023-12-27 20:56:07,827][106225] Updated weights for policy 1, policy_version 237783 (0.0006) [2023-12-27 20:56:07,876][106225] Updated weights for policy 1, policy_version 237793 (0.0009) [2023-12-27 20:56:07,926][106225] Updated weights for policy 1, policy_version 237804 (0.0007) [2023-12-27 20:56:08,467][106226] Updated weights for policy 0, policy_version 237470 (0.0008) [2023-12-27 20:56:08,523][106226] Updated weights for policy 0, policy_version 237480 (0.0008) [2023-12-27 20:56:08,583][106226] Updated weights for policy 0, policy_version 237490 (0.0009) [2023-12-27 20:56:08,612][106225] Updated weights for policy 1, policy_version 237814 (0.0006) [2023-12-27 20:56:08,670][106225] Updated weights for policy 1, policy_version 237824 (0.0005) [2023-12-27 20:56:08,733][106225] Updated weights for policy 1, policy_version 237834 (0.0005) [2023-12-27 20:56:09,375][106226] Updated weights for policy 0, policy_version 237500 (0.0008) [2023-12-27 20:56:09,430][106225] Updated weights for policy 1, policy_version 237844 (0.0007) [2023-12-27 20:56:09,449][106226] Updated weights for policy 0, policy_version 237510 (0.0008) [2023-12-27 20:56:09,492][106225] Updated weights for policy 1, policy_version 237854 (0.0007) [2023-12-27 20:56:09,506][106226] Updated weights for policy 0, policy_version 237520 (0.0007) [2023-12-27 20:56:09,551][106225] Updated weights for policy 1, policy_version 237864 (0.0007) [2023-12-27 20:56:10,290][106225] Updated weights for policy 1, policy_version 237874 (0.0008) [2023-12-27 20:56:10,303][106226] Updated weights for policy 0, policy_version 237530 (0.0006) [2023-12-27 20:56:10,354][106225] Updated weights for policy 1, policy_version 237884 (0.0010) [2023-12-27 20:56:10,359][106226] Updated weights for policy 0, policy_version 237540 (0.0008) [2023-12-27 20:56:10,416][106225] Updated weights for policy 1, policy_version 237894 (0.0010) [2023-12-27 20:56:10,422][106226] Updated weights for policy 0, policy_version 237550 (0.0006) [2023-12-27 20:56:10,478][106225] Updated weights for policy 1, policy_version 237904 (0.0010) [2023-12-27 20:56:10,485][106226] Updated weights for policy 0, policy_version 237560 (0.0007) [2023-12-27 20:56:11,112][106225] Updated weights for policy 1, policy_version 237914 (0.0009) [2023-12-27 20:56:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 121749504. Throughput: 0: 9869.1, 1: 10040.9. Samples: 121728384. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:11,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-6.292')] [2023-12-27 20:56:11,186][106225] Updated weights for policy 1, policy_version 237924 (0.0008) [2023-12-27 20:56:11,244][106226] Updated weights for policy 0, policy_version 237570 (0.0011) [2023-12-27 20:56:11,246][106225] Updated weights for policy 1, policy_version 237934 (0.0007) [2023-12-27 20:56:11,259][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000237936_60923904.pth... [2023-12-27 20:56:11,263][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000236752_60620800.pth [2023-12-27 20:56:11,304][106226] Updated weights for policy 0, policy_version 237580 (0.0009) [2023-12-27 20:56:11,370][106226] Updated weights for policy 0, policy_version 237590 (0.0009) [2023-12-27 20:56:11,384][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000237592_60841984.pth... [2023-12-27 20:56:11,389][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000236472_60555264.pth [2023-12-27 20:56:12,044][106225] Updated weights for policy 1, policy_version 237944 (0.0008) [2023-12-27 20:56:12,109][106225] Updated weights for policy 1, policy_version 237954 (0.0008) [2023-12-27 20:56:12,147][106226] Updated weights for policy 0, policy_version 237600 (0.0007) [2023-12-27 20:56:12,168][106225] Updated weights for policy 1, policy_version 237964 (0.0007) [2023-12-27 20:56:12,207][106226] Updated weights for policy 0, policy_version 237610 (0.0007) [2023-12-27 20:56:12,268][106226] Updated weights for policy 0, policy_version 237620 (0.0010) [2023-12-27 20:56:12,854][106225] Updated weights for policy 1, policy_version 237974 (0.0007) [2023-12-27 20:56:12,912][106225] Updated weights for policy 1, policy_version 237984 (0.0010) [2023-12-27 20:56:12,979][106225] Updated weights for policy 1, policy_version 237994 (0.0010) [2023-12-27 20:56:13,001][106226] Updated weights for policy 0, policy_version 237630 (0.0008) [2023-12-27 20:56:13,066][106226] Updated weights for policy 0, policy_version 237640 (0.0008) [2023-12-27 20:56:13,127][106226] Updated weights for policy 0, policy_version 237650 (0.0007) [2023-12-27 20:56:13,533][106225] Updated weights for policy 1, policy_version 238004 (0.0007) [2023-12-27 20:56:13,592][106225] Updated weights for policy 1, policy_version 238014 (0.0005) [2023-12-27 20:56:13,655][106225] Updated weights for policy 1, policy_version 238024 (0.0006) [2023-12-27 20:56:13,890][106226] Updated weights for policy 0, policy_version 237660 (0.0006) [2023-12-27 20:56:13,964][106226] Updated weights for policy 0, policy_version 237670 (0.0005) [2023-12-27 20:56:14,029][106226] Updated weights for policy 0, policy_version 237680 (0.0005) [2023-12-27 20:56:14,209][106225] Updated weights for policy 1, policy_version 238034 (0.0007) [2023-12-27 20:56:14,259][106225] Updated weights for policy 1, policy_version 238044 (0.0010) [2023-12-27 20:56:14,318][106225] Updated weights for policy 1, policy_version 238054 (0.0008) [2023-12-27 20:56:14,382][106225] Updated weights for policy 1, policy_version 238064 (0.0010) [2023-12-27 20:56:14,638][106226] Updated weights for policy 0, policy_version 237690 (0.0006) [2023-12-27 20:56:14,691][106226] Updated weights for policy 0, policy_version 237700 (0.0007) [2023-12-27 20:56:14,736][106226] Updated weights for policy 0, policy_version 237710 (0.0007) [2023-12-27 20:56:14,795][106226] Updated weights for policy 0, policy_version 237720 (0.0009) [2023-12-27 20:56:15,127][106225] Updated weights for policy 1, policy_version 238074 (0.0010) [2023-12-27 20:56:15,182][106225] Updated weights for policy 1, policy_version 238084 (0.0010) [2023-12-27 20:56:15,234][106225] Updated weights for policy 1, policy_version 238094 (0.0011) [2023-12-27 20:56:15,514][106226] Updated weights for policy 0, policy_version 237730 (0.0009) [2023-12-27 20:56:15,573][106226] Updated weights for policy 0, policy_version 237740 (0.0009) [2023-12-27 20:56:15,624][106226] Updated weights for policy 0, policy_version 237750 (0.0009) [2023-12-27 20:56:15,885][106225] Updated weights for policy 1, policy_version 238104 (0.0010) [2023-12-27 20:56:15,954][106225] Updated weights for policy 1, policy_version 238114 (0.0008) [2023-12-27 20:56:16,012][106225] Updated weights for policy 1, policy_version 238124 (0.0008) [2023-12-27 20:56:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 121856000. Throughput: 0: 9662.9, 1: 10073.8. Samples: 121845048. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:16,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-6.428')] [2023-12-27 20:56:16,396][106226] Updated weights for policy 0, policy_version 237760 (0.0008) [2023-12-27 20:56:16,459][106226] Updated weights for policy 0, policy_version 237770 (0.0010) [2023-12-27 20:56:16,514][106226] Updated weights for policy 0, policy_version 237780 (0.0009) [2023-12-27 20:56:16,594][106225] Updated weights for policy 1, policy_version 238134 (0.0007) [2023-12-27 20:56:16,648][106225] Updated weights for policy 1, policy_version 238144 (0.0005) [2023-12-27 20:56:16,703][106225] Updated weights for policy 1, policy_version 238154 (0.0008) [2023-12-27 20:56:17,285][106225] Updated weights for policy 1, policy_version 238164 (0.0007) [2023-12-27 20:56:17,333][106226] Updated weights for policy 0, policy_version 237790 (0.0008) [2023-12-27 20:56:17,349][106225] Updated weights for policy 1, policy_version 238174 (0.0010) [2023-12-27 20:56:17,397][106226] Updated weights for policy 0, policy_version 237800 (0.0008) [2023-12-27 20:56:17,403][106225] Updated weights for policy 1, policy_version 238184 (0.0010) [2023-12-27 20:56:17,455][106226] Updated weights for policy 0, policy_version 237810 (0.0006) [2023-12-27 20:56:18,058][106225] Updated weights for policy 1, policy_version 238194 (0.0008) [2023-12-27 20:56:18,122][106225] Updated weights for policy 1, policy_version 238204 (0.0005) [2023-12-27 20:56:18,188][106225] Updated weights for policy 1, policy_version 238214 (0.0005) [2023-12-27 20:56:18,221][106226] Updated weights for policy 0, policy_version 237820 (0.0008) [2023-12-27 20:56:18,239][106225] Updated weights for policy 1, policy_version 238224 (0.0008) [2023-12-27 20:56:18,275][106226] Updated weights for policy 0, policy_version 237830 (0.0007) [2023-12-27 20:56:18,324][106226] Updated weights for policy 0, policy_version 237840 (0.0008) [2023-12-27 20:56:18,911][106225] Updated weights for policy 1, policy_version 238234 (0.0008) [2023-12-27 20:56:18,975][106225] Updated weights for policy 1, policy_version 238244 (0.0008) [2023-12-27 20:56:19,037][106225] Updated weights for policy 1, policy_version 238254 (0.0009) [2023-12-27 20:56:19,104][106226] Updated weights for policy 0, policy_version 237850 (0.0008) [2023-12-27 20:56:19,156][106226] Updated weights for policy 0, policy_version 237860 (0.0008) [2023-12-27 20:56:19,208][106226] Updated weights for policy 0, policy_version 237870 (0.0009) [2023-12-27 20:56:19,284][106226] Updated weights for policy 0, policy_version 237880 (0.0008) [2023-12-27 20:56:19,770][106225] Updated weights for policy 1, policy_version 238264 (0.0009) [2023-12-27 20:56:19,839][106225] Updated weights for policy 1, policy_version 238274 (0.0010) [2023-12-27 20:56:19,900][106225] Updated weights for policy 1, policy_version 238284 (0.0009) [2023-12-27 20:56:20,017][106226] Updated weights for policy 0, policy_version 237890 (0.0007) [2023-12-27 20:56:20,072][106226] Updated weights for policy 0, policy_version 237900 (0.0010) [2023-12-27 20:56:20,137][106226] Updated weights for policy 0, policy_version 237910 (0.0008) [2023-12-27 20:56:20,595][106225] Updated weights for policy 1, policy_version 238294 (0.0009) [2023-12-27 20:56:20,661][106225] Updated weights for policy 1, policy_version 238304 (0.0011) [2023-12-27 20:56:20,727][106225] Updated weights for policy 1, policy_version 238314 (0.0010) [2023-12-27 20:56:20,922][106226] Updated weights for policy 0, policy_version 237920 (0.0007) [2023-12-27 20:56:20,980][106226] Updated weights for policy 0, policy_version 237930 (0.0009) [2023-12-27 20:56:21,047][106226] Updated weights for policy 0, policy_version 237940 (0.0008) [2023-12-27 20:56:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 121954304. Throughput: 0: 9556.4, 1: 10125.3. Samples: 121961680. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:21,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-6.082')] [2023-12-27 20:56:21,537][106225] Updated weights for policy 1, policy_version 238324 (0.0010) [2023-12-27 20:56:21,596][106225] Updated weights for policy 1, policy_version 238334 (0.0011) [2023-12-27 20:56:21,664][106225] Updated weights for policy 1, policy_version 238344 (0.0009) [2023-12-27 20:56:21,853][106226] Updated weights for policy 0, policy_version 237950 (0.0008) [2023-12-27 20:56:21,922][106226] Updated weights for policy 0, policy_version 237960 (0.0008) [2023-12-27 20:56:21,988][106226] Updated weights for policy 0, policy_version 237970 (0.0008) [2023-12-27 20:56:22,432][106225] Updated weights for policy 1, policy_version 238354 (0.0008) [2023-12-27 20:56:22,486][106225] Updated weights for policy 1, policy_version 238364 (0.0008) [2023-12-27 20:56:22,542][106225] Updated weights for policy 1, policy_version 238374 (0.0008) [2023-12-27 20:56:22,599][106225] Updated weights for policy 1, policy_version 238384 (0.0009) [2023-12-27 20:56:22,668][106226] Updated weights for policy 0, policy_version 237980 (0.0009) [2023-12-27 20:56:22,712][106226] Updated weights for policy 0, policy_version 237990 (0.0008) [2023-12-27 20:56:22,760][106226] Updated weights for policy 0, policy_version 238000 (0.0008) [2023-12-27 20:56:23,389][106225] Updated weights for policy 1, policy_version 238394 (0.0008) [2023-12-27 20:56:23,436][106225] Updated weights for policy 1, policy_version 238404 (0.0008) [2023-12-27 20:56:23,464][106226] Updated weights for policy 0, policy_version 238010 (0.0005) [2023-12-27 20:56:23,488][106225] Updated weights for policy 1, policy_version 238414 (0.0008) [2023-12-27 20:56:23,525][106226] Updated weights for policy 0, policy_version 238020 (0.0008) [2023-12-27 20:56:23,584][106226] Updated weights for policy 0, policy_version 238030 (0.0010) [2023-12-27 20:56:23,636][106226] Updated weights for policy 0, policy_version 238040 (0.0010) [2023-12-27 20:56:24,111][106225] Updated weights for policy 1, policy_version 238424 (0.0006) [2023-12-27 20:56:24,166][106225] Updated weights for policy 1, policy_version 238434 (0.0005) [2023-12-27 20:56:24,233][106225] Updated weights for policy 1, policy_version 238444 (0.0007) [2023-12-27 20:56:24,281][106226] Updated weights for policy 0, policy_version 238050 (0.0006) [2023-12-27 20:56:24,335][106226] Updated weights for policy 0, policy_version 238060 (0.0010) [2023-12-27 20:56:24,393][106226] Updated weights for policy 0, policy_version 238070 (0.0011) [2023-12-27 20:56:24,878][106225] Updated weights for policy 1, policy_version 238454 (0.0009) [2023-12-27 20:56:24,933][106225] Updated weights for policy 1, policy_version 238464 (0.0010) [2023-12-27 20:56:24,983][106225] Updated weights for policy 1, policy_version 238474 (0.0010) [2023-12-27 20:56:25,107][106226] Updated weights for policy 0, policy_version 238080 (0.0010) [2023-12-27 20:56:25,166][106226] Updated weights for policy 0, policy_version 238090 (0.0010) [2023-12-27 20:56:25,227][106226] Updated weights for policy 0, policy_version 238100 (0.0011) [2023-12-27 20:56:25,706][106225] Updated weights for policy 1, policy_version 238484 (0.0011) [2023-12-27 20:56:25,766][106225] Updated weights for policy 1, policy_version 238494 (0.0010) [2023-12-27 20:56:25,823][106225] Updated weights for policy 1, policy_version 238504 (0.0010) [2023-12-27 20:56:25,935][106226] Updated weights for policy 0, policy_version 238110 (0.0009) [2023-12-27 20:56:25,998][106226] Updated weights for policy 0, policy_version 238120 (0.0005) [2023-12-27 20:56:26,066][106226] Updated weights for policy 0, policy_version 238130 (0.0005) [2023-12-27 20:56:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 122052608. Throughput: 0: 9518.9, 1: 10037.1. Samples: 122017660. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:26,176][105115] Avg episode reward: [(0, '-5.000'), (1, '-6.125')] [2023-12-27 20:56:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000238512_61071360.pth... [2023-12-27 20:56:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000238136_60981248.pth... [2023-12-27 20:56:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000237360_60776448.pth [2023-12-27 20:56:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000237016_60694528.pth [2023-12-27 20:56:26,474][106225] Updated weights for policy 1, policy_version 238514 (0.0010) [2023-12-27 20:56:26,530][106225] Updated weights for policy 1, policy_version 238524 (0.0010) [2023-12-27 20:56:26,558][106226] Updated weights for policy 0, policy_version 238140 (0.0005) [2023-12-27 20:56:26,587][106225] Updated weights for policy 1, policy_version 238534 (0.0010) [2023-12-27 20:56:26,604][106226] Updated weights for policy 0, policy_version 238150 (0.0005) [2023-12-27 20:56:26,642][106225] Updated weights for policy 1, policy_version 238544 (0.0010) [2023-12-27 20:56:26,652][106226] Updated weights for policy 0, policy_version 238160 (0.0005) [2023-12-27 20:56:27,327][106226] Updated weights for policy 0, policy_version 238170 (0.0009) [2023-12-27 20:56:27,360][106225] Updated weights for policy 1, policy_version 238554 (0.0010) [2023-12-27 20:56:27,377][106226] Updated weights for policy 0, policy_version 238180 (0.0010) [2023-12-27 20:56:27,422][106225] Updated weights for policy 1, policy_version 238564 (0.0010) [2023-12-27 20:56:27,427][106226] Updated weights for policy 0, policy_version 238190 (0.0010) [2023-12-27 20:56:27,476][106226] Updated weights for policy 0, policy_version 238200 (0.0010) [2023-12-27 20:56:27,481][106225] Updated weights for policy 1, policy_version 238574 (0.0010) [2023-12-27 20:56:28,179][106225] Updated weights for policy 1, policy_version 238584 (0.0010) [2023-12-27 20:56:28,186][106226] Updated weights for policy 0, policy_version 238210 (0.0010) [2023-12-27 20:56:28,231][106225] Updated weights for policy 1, policy_version 238594 (0.0010) [2023-12-27 20:56:28,242][106226] Updated weights for policy 0, policy_version 238220 (0.0010) [2023-12-27 20:56:28,287][106225] Updated weights for policy 1, policy_version 238604 (0.0010) [2023-12-27 20:56:28,298][106226] Updated weights for policy 0, policy_version 238230 (0.0010) [2023-12-27 20:56:28,920][106225] Updated weights for policy 1, policy_version 238614 (0.0010) [2023-12-27 20:56:28,980][106225] Updated weights for policy 1, policy_version 238624 (0.0006) [2023-12-27 20:56:29,011][106226] Updated weights for policy 0, policy_version 238240 (0.0010) [2023-12-27 20:56:29,038][106225] Updated weights for policy 1, policy_version 238634 (0.0005) [2023-12-27 20:56:29,067][106226] Updated weights for policy 0, policy_version 238250 (0.0010) [2023-12-27 20:56:29,116][106226] Updated weights for policy 0, policy_version 238260 (0.0010) [2023-12-27 20:56:29,751][106225] Updated weights for policy 1, policy_version 238644 (0.0008) [2023-12-27 20:56:29,812][106225] Updated weights for policy 1, policy_version 238654 (0.0006) [2023-12-27 20:56:29,839][106226] Updated weights for policy 0, policy_version 238270 (0.0010) [2023-12-27 20:56:29,877][106225] Updated weights for policy 1, policy_version 238664 (0.0007) [2023-12-27 20:56:29,906][106226] Updated weights for policy 0, policy_version 238280 (0.0008) [2023-12-27 20:56:29,971][106226] Updated weights for policy 0, policy_version 238290 (0.0010) [2023-12-27 20:56:30,571][106225] Updated weights for policy 1, policy_version 238674 (0.0007) [2023-12-27 20:56:30,617][106225] Updated weights for policy 1, policy_version 238684 (0.0005) [2023-12-27 20:56:30,663][106225] Updated weights for policy 1, policy_version 238694 (0.0006) [2023-12-27 20:56:30,677][106226] Updated weights for policy 0, policy_version 238300 (0.0011) [2023-12-27 20:56:30,722][106225] Updated weights for policy 1, policy_version 238704 (0.0008) [2023-12-27 20:56:30,740][106226] Updated weights for policy 0, policy_version 238310 (0.0010) [2023-12-27 20:56:30,803][106226] Updated weights for policy 0, policy_version 238320 (0.0010) [2023-12-27 20:56:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 122150912. Throughput: 0: 9579.0, 1: 10053.5. Samples: 122140816. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:31,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-5.976')] [2023-12-27 20:56:31,437][106225] Updated weights for policy 1, policy_version 238714 (0.0008) [2023-12-27 20:56:31,505][106225] Updated weights for policy 1, policy_version 238724 (0.0009) [2023-12-27 20:56:31,545][106226] Updated weights for policy 0, policy_version 238330 (0.0010) [2023-12-27 20:56:31,567][106225] Updated weights for policy 1, policy_version 238734 (0.0009) [2023-12-27 20:56:31,602][106226] Updated weights for policy 0, policy_version 238340 (0.0007) [2023-12-27 20:56:31,663][106226] Updated weights for policy 0, policy_version 238350 (0.0009) [2023-12-27 20:56:31,721][106226] Updated weights for policy 0, policy_version 238360 (0.0009) [2023-12-27 20:56:32,260][106225] Updated weights for policy 1, policy_version 238744 (0.0010) [2023-12-27 20:56:32,329][106225] Updated weights for policy 1, policy_version 238754 (0.0007) [2023-12-27 20:56:32,398][106225] Updated weights for policy 1, policy_version 238764 (0.0008) [2023-12-27 20:56:32,458][106226] Updated weights for policy 0, policy_version 238370 (0.0008) [2023-12-27 20:56:32,519][106226] Updated weights for policy 0, policy_version 238380 (0.0008) [2023-12-27 20:56:32,579][106226] Updated weights for policy 0, policy_version 238390 (0.0007) [2023-12-27 20:56:33,081][106225] Updated weights for policy 1, policy_version 238774 (0.0009) [2023-12-27 20:56:33,136][106225] Updated weights for policy 1, policy_version 238784 (0.0007) [2023-12-27 20:56:33,189][106225] Updated weights for policy 1, policy_version 238794 (0.0008) [2023-12-27 20:56:33,282][106226] Updated weights for policy 0, policy_version 238400 (0.0005) [2023-12-27 20:56:33,331][106226] Updated weights for policy 0, policy_version 238410 (0.0005) [2023-12-27 20:56:33,376][106226] Updated weights for policy 0, policy_version 238420 (0.0005) [2023-12-27 20:56:33,856][106225] Updated weights for policy 1, policy_version 238804 (0.0007) [2023-12-27 20:56:33,911][106225] Updated weights for policy 1, policy_version 238814 (0.0005) [2023-12-27 20:56:33,978][106225] Updated weights for policy 1, policy_version 238824 (0.0006) [2023-12-27 20:56:34,057][106226] Updated weights for policy 0, policy_version 238430 (0.0010) [2023-12-27 20:56:34,102][106226] Updated weights for policy 0, policy_version 238440 (0.0010) [2023-12-27 20:56:34,164][106226] Updated weights for policy 0, policy_version 238450 (0.0006) [2023-12-27 20:56:34,613][106225] Updated weights for policy 1, policy_version 238834 (0.0006) [2023-12-27 20:56:34,679][106225] Updated weights for policy 1, policy_version 238844 (0.0008) [2023-12-27 20:56:34,742][106225] Updated weights for policy 1, policy_version 238854 (0.0008) [2023-12-27 20:56:34,796][106225] Updated weights for policy 1, policy_version 238864 (0.0008) [2023-12-27 20:56:34,886][106226] Updated weights for policy 0, policy_version 238460 (0.0008) [2023-12-27 20:56:34,941][106226] Updated weights for policy 0, policy_version 238470 (0.0006) [2023-12-27 20:56:34,990][106226] Updated weights for policy 0, policy_version 238480 (0.0006) [2023-12-27 20:56:35,548][106226] Updated weights for policy 0, policy_version 238490 (0.0011) [2023-12-27 20:56:35,574][106225] Updated weights for policy 1, policy_version 238874 (0.0006) [2023-12-27 20:56:35,594][106226] Updated weights for policy 0, policy_version 238500 (0.0009) [2023-12-27 20:56:35,627][106225] Updated weights for policy 1, policy_version 238884 (0.0005) [2023-12-27 20:56:35,643][106226] Updated weights for policy 0, policy_version 238510 (0.0005) [2023-12-27 20:56:35,681][106225] Updated weights for policy 1, policy_version 238894 (0.0006) [2023-12-27 20:56:35,698][106226] Updated weights for policy 0, policy_version 238520 (0.0010) [2023-12-27 20:56:36,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 122249216. Throughput: 0: 9653.9, 1: 10048.2. Samples: 122261508. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:36,175][105115] Avg episode reward: [(0, '-5.094'), (1, '-5.704')] [2023-12-27 20:56:36,335][106225] Updated weights for policy 1, policy_version 238904 (0.0008) [2023-12-27 20:56:36,341][106226] Updated weights for policy 0, policy_version 238530 (0.0007) [2023-12-27 20:56:36,395][106225] Updated weights for policy 1, policy_version 238914 (0.0008) [2023-12-27 20:56:36,399][106226] Updated weights for policy 0, policy_version 238540 (0.0008) [2023-12-27 20:56:36,455][106225] Updated weights for policy 1, policy_version 238924 (0.0008) [2023-12-27 20:56:36,465][106226] Updated weights for policy 0, policy_version 238550 (0.0006) [2023-12-27 20:56:37,170][106226] Updated weights for policy 0, policy_version 238560 (0.0005) [2023-12-27 20:56:37,203][106225] Updated weights for policy 1, policy_version 238934 (0.0008) [2023-12-27 20:56:37,230][106226] Updated weights for policy 0, policy_version 238570 (0.0007) [2023-12-27 20:56:37,256][106225] Updated weights for policy 1, policy_version 238944 (0.0008) [2023-12-27 20:56:37,293][106226] Updated weights for policy 0, policy_version 238580 (0.0006) [2023-12-27 20:56:37,317][106225] Updated weights for policy 1, policy_version 238954 (0.0008) [2023-12-27 20:56:37,835][106226] Updated weights for policy 0, policy_version 238590 (0.0008) [2023-12-27 20:56:37,885][106226] Updated weights for policy 0, policy_version 238600 (0.0010) [2023-12-27 20:56:37,935][106226] Updated weights for policy 0, policy_version 238610 (0.0006) [2023-12-27 20:56:38,040][106225] Updated weights for policy 1, policy_version 238964 (0.0008) [2023-12-27 20:56:38,096][106225] Updated weights for policy 1, policy_version 238974 (0.0005) [2023-12-27 20:56:38,147][106225] Updated weights for policy 1, policy_version 238984 (0.0005) [2023-12-27 20:56:38,604][106226] Updated weights for policy 0, policy_version 238620 (0.0007) [2023-12-27 20:56:38,656][106226] Updated weights for policy 0, policy_version 238630 (0.0006) [2023-12-27 20:56:38,721][106226] Updated weights for policy 0, policy_version 238640 (0.0005) [2023-12-27 20:56:38,757][106225] Updated weights for policy 1, policy_version 238994 (0.0005) [2023-12-27 20:56:38,814][106225] Updated weights for policy 1, policy_version 239004 (0.0009) [2023-12-27 20:56:38,873][106225] Updated weights for policy 1, policy_version 239014 (0.0010) [2023-12-27 20:56:38,930][106225] Updated weights for policy 1, policy_version 239024 (0.0010) [2023-12-27 20:56:39,480][106226] Updated weights for policy 0, policy_version 238650 (0.0006) [2023-12-27 20:56:39,529][106226] Updated weights for policy 0, policy_version 238660 (0.0008) [2023-12-27 20:56:39,593][106226] Updated weights for policy 0, policy_version 238670 (0.0008) [2023-12-27 20:56:39,654][106226] Updated weights for policy 0, policy_version 238680 (0.0006) [2023-12-27 20:56:39,657][106225] Updated weights for policy 1, policy_version 239034 (0.0011) [2023-12-27 20:56:39,724][106225] Updated weights for policy 1, policy_version 239044 (0.0011) [2023-12-27 20:56:39,788][106225] Updated weights for policy 1, policy_version 239054 (0.0010) [2023-12-27 20:56:40,391][106226] Updated weights for policy 0, policy_version 238690 (0.0008) [2023-12-27 20:56:40,452][106226] Updated weights for policy 0, policy_version 238700 (0.0008) [2023-12-27 20:56:40,515][106226] Updated weights for policy 0, policy_version 238710 (0.0007) [2023-12-27 20:56:40,532][106225] Updated weights for policy 1, policy_version 239064 (0.0010) [2023-12-27 20:56:40,586][106225] Updated weights for policy 1, policy_version 239074 (0.0010) [2023-12-27 20:56:40,650][106225] Updated weights for policy 1, policy_version 239084 (0.0010) [2023-12-27 20:56:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 122347520. Throughput: 0: 9750.5, 1: 10080.9. Samples: 122323356. Policy #0 lag: (min: 21.0, avg: 25.6, max: 53.0) [2023-12-27 20:56:41,175][105115] Avg episode reward: [(0, '-5.125'), (1, '-6.376')] [2023-12-27 20:56:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000239088_61218816.pth... [2023-12-27 20:56:41,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000238712_61128704.pth... [2023-12-27 20:56:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000237592_60841984.pth [2023-12-27 20:56:41,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000237936_60923904.pth [2023-12-27 20:56:41,284][106226] Updated weights for policy 0, policy_version 238720 (0.0007) [2023-12-27 20:56:41,340][106225] Updated weights for policy 1, policy_version 239094 (0.0009) [2023-12-27 20:56:41,340][106226] Updated weights for policy 0, policy_version 238730 (0.0007) [2023-12-27 20:56:41,414][106225] Updated weights for policy 1, policy_version 239104 (0.0009) [2023-12-27 20:56:41,420][106226] Updated weights for policy 0, policy_version 238740 (0.0008) [2023-12-27 20:56:41,482][106225] Updated weights for policy 1, policy_version 239114 (0.0009) [2023-12-27 20:56:42,145][106226] Updated weights for policy 0, policy_version 238750 (0.0008) [2023-12-27 20:56:42,203][106226] Updated weights for policy 0, policy_version 238760 (0.0009) [2023-12-27 20:56:42,266][106226] Updated weights for policy 0, policy_version 238770 (0.0008) [2023-12-27 20:56:42,269][106225] Updated weights for policy 1, policy_version 239124 (0.0008) [2023-12-27 20:56:42,332][106225] Updated weights for policy 1, policy_version 239134 (0.0008) [2023-12-27 20:56:42,400][106225] Updated weights for policy 1, policy_version 239144 (0.0008) [2023-12-27 20:56:43,067][106226] Updated weights for policy 0, policy_version 238780 (0.0009) [2023-12-27 20:56:43,084][106225] Updated weights for policy 1, policy_version 239154 (0.0006) [2023-12-27 20:56:43,120][106226] Updated weights for policy 0, policy_version 238790 (0.0008) [2023-12-27 20:56:43,142][106225] Updated weights for policy 1, policy_version 239164 (0.0007) [2023-12-27 20:56:43,169][106226] Updated weights for policy 0, policy_version 238800 (0.0007) [2023-12-27 20:56:43,191][106225] Updated weights for policy 1, policy_version 239174 (0.0006) [2023-12-27 20:56:43,241][106225] Updated weights for policy 1, policy_version 239184 (0.0005) [2023-12-27 20:56:43,837][106225] Updated weights for policy 1, policy_version 239194 (0.0010) [2023-12-27 20:56:43,846][106226] Updated weights for policy 0, policy_version 238810 (0.0006) [2023-12-27 20:56:43,888][106225] Updated weights for policy 1, policy_version 239204 (0.0010) [2023-12-27 20:56:43,903][106226] Updated weights for policy 0, policy_version 238820 (0.0006) [2023-12-27 20:56:43,938][106225] Updated weights for policy 1, policy_version 239214 (0.0010) [2023-12-27 20:56:43,965][106226] Updated weights for policy 0, policy_version 238830 (0.0005) [2023-12-27 20:56:44,030][106226] Updated weights for policy 0, policy_version 238840 (0.0005) [2023-12-27 20:56:44,548][106226] Updated weights for policy 0, policy_version 238850 (0.0008) [2023-12-27 20:56:44,609][106226] Updated weights for policy 0, policy_version 238860 (0.0008) [2023-12-27 20:56:44,639][106225] Updated weights for policy 1, policy_version 239224 (0.0010) [2023-12-27 20:56:44,672][106226] Updated weights for policy 0, policy_version 238870 (0.0007) [2023-12-27 20:56:44,699][106225] Updated weights for policy 1, policy_version 239234 (0.0010) [2023-12-27 20:56:44,749][106225] Updated weights for policy 1, policy_version 239244 (0.0010) [2023-12-27 20:56:45,388][106226] Updated weights for policy 0, policy_version 238880 (0.0010) [2023-12-27 20:56:45,452][106226] Updated weights for policy 0, policy_version 238890 (0.0011) [2023-12-27 20:56:45,512][106226] Updated weights for policy 0, policy_version 238900 (0.0009) [2023-12-27 20:56:45,550][106225] Updated weights for policy 1, policy_version 239254 (0.0008) [2023-12-27 20:56:45,597][106225] Updated weights for policy 1, policy_version 239264 (0.0008) [2023-12-27 20:56:45,658][106225] Updated weights for policy 1, policy_version 239274 (0.0008) [2023-12-27 20:56:46,126][106226] Updated weights for policy 0, policy_version 238910 (0.0007) [2023-12-27 20:56:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 122445824. Throughput: 0: 9798.2, 1: 10003.8. Samples: 122440272. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:56:46,176][105115] Avg episode reward: [(0, '-5.183'), (1, '-6.211')] [2023-12-27 20:56:46,178][106226] Updated weights for policy 0, policy_version 238920 (0.0009) [2023-12-27 20:56:46,231][106226] Updated weights for policy 0, policy_version 238930 (0.0008) [2023-12-27 20:56:46,455][106225] Updated weights for policy 1, policy_version 239284 (0.0008) [2023-12-27 20:56:46,521][106225] Updated weights for policy 1, policy_version 239294 (0.0008) [2023-12-27 20:56:46,588][106225] Updated weights for policy 1, policy_version 239304 (0.0009) [2023-12-27 20:56:46,839][106226] Updated weights for policy 0, policy_version 238940 (0.0007) [2023-12-27 20:56:46,888][106226] Updated weights for policy 0, policy_version 238950 (0.0008) [2023-12-27 20:56:46,938][106226] Updated weights for policy 0, policy_version 238960 (0.0008) [2023-12-27 20:56:47,381][106225] Updated weights for policy 1, policy_version 239314 (0.0009) [2023-12-27 20:56:47,451][106225] Updated weights for policy 1, policy_version 239324 (0.0010) [2023-12-27 20:56:47,511][106225] Updated weights for policy 1, policy_version 239334 (0.0008) [2023-12-27 20:56:47,517][106226] Updated weights for policy 0, policy_version 238970 (0.0006) [2023-12-27 20:56:47,573][106225] Updated weights for policy 1, policy_version 239344 (0.0008) [2023-12-27 20:56:47,575][106226] Updated weights for policy 0, policy_version 238980 (0.0006) [2023-12-27 20:56:47,627][106226] Updated weights for policy 0, policy_version 238990 (0.0008) [2023-12-27 20:56:47,671][106226] Updated weights for policy 0, policy_version 239000 (0.0008) [2023-12-27 20:56:48,294][106225] Updated weights for policy 1, policy_version 239354 (0.0006) [2023-12-27 20:56:48,374][106225] Updated weights for policy 1, policy_version 239364 (0.0008) [2023-12-27 20:56:48,388][106226] Updated weights for policy 0, policy_version 239010 (0.0008) [2023-12-27 20:56:48,445][106225] Updated weights for policy 1, policy_version 239374 (0.0007) [2023-12-27 20:56:48,456][106226] Updated weights for policy 0, policy_version 239020 (0.0007) [2023-12-27 20:56:48,529][106226] Updated weights for policy 0, policy_version 239030 (0.0007) [2023-12-27 20:56:49,078][106225] Updated weights for policy 1, policy_version 239384 (0.0005) [2023-12-27 20:56:49,133][106225] Updated weights for policy 1, policy_version 239394 (0.0005) [2023-12-27 20:56:49,190][106225] Updated weights for policy 1, policy_version 239404 (0.0005) [2023-12-27 20:56:49,269][106226] Updated weights for policy 0, policy_version 239040 (0.0009) [2023-12-27 20:56:49,318][106226] Updated weights for policy 0, policy_version 239050 (0.0010) [2023-12-27 20:56:49,375][106226] Updated weights for policy 0, policy_version 239060 (0.0009) [2023-12-27 20:56:49,884][106225] Updated weights for policy 1, policy_version 239414 (0.0008) [2023-12-27 20:56:49,955][106225] Updated weights for policy 1, policy_version 239424 (0.0008) [2023-12-27 20:56:50,022][106225] Updated weights for policy 1, policy_version 239434 (0.0008) [2023-12-27 20:56:50,166][106226] Updated weights for policy 0, policy_version 239070 (0.0008) [2023-12-27 20:56:50,235][106226] Updated weights for policy 0, policy_version 239080 (0.0008) [2023-12-27 20:56:50,296][106226] Updated weights for policy 0, policy_version 239090 (0.0006) [2023-12-27 20:56:50,799][106225] Updated weights for policy 1, policy_version 239444 (0.0008) [2023-12-27 20:56:50,864][106225] Updated weights for policy 1, policy_version 239454 (0.0008) [2023-12-27 20:56:50,927][106225] Updated weights for policy 1, policy_version 239464 (0.0008) [2023-12-27 20:56:50,967][106226] Updated weights for policy 0, policy_version 239100 (0.0006) [2023-12-27 20:56:51,031][106226] Updated weights for policy 0, policy_version 239110 (0.0008) [2023-12-27 20:56:51,096][106226] Updated weights for policy 0, policy_version 239120 (0.0008) [2023-12-27 20:56:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 122552320. Throughput: 0: 9813.4, 1: 9907.9. Samples: 122556636. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:56:51,175][105115] Avg episode reward: [(0, '-5.213'), (1, '-6.065')] [2023-12-27 20:56:51,580][106225] Updated weights for policy 1, policy_version 239474 (0.0007) [2023-12-27 20:56:51,644][106225] Updated weights for policy 1, policy_version 239484 (0.0009) [2023-12-27 20:56:51,696][106225] Updated weights for policy 1, policy_version 239494 (0.0008) [2023-12-27 20:56:51,760][106225] Updated weights for policy 1, policy_version 239504 (0.0009) [2023-12-27 20:56:51,913][106226] Updated weights for policy 0, policy_version 239130 (0.0008) [2023-12-27 20:56:51,978][106226] Updated weights for policy 0, policy_version 239140 (0.0007) [2023-12-27 20:56:52,040][106226] Updated weights for policy 0, policy_version 239150 (0.0009) [2023-12-27 20:56:52,108][106226] Updated weights for policy 0, policy_version 239160 (0.0009) [2023-12-27 20:56:52,463][106225] Updated weights for policy 1, policy_version 239514 (0.0009) [2023-12-27 20:56:52,513][106225] Updated weights for policy 1, policy_version 239524 (0.0008) [2023-12-27 20:56:52,569][106225] Updated weights for policy 1, policy_version 239534 (0.0007) [2023-12-27 20:56:52,850][106226] Updated weights for policy 0, policy_version 239170 (0.0009) [2023-12-27 20:56:52,904][106226] Updated weights for policy 0, policy_version 239180 (0.0008) [2023-12-27 20:56:52,960][106226] Updated weights for policy 0, policy_version 239190 (0.0009) [2023-12-27 20:56:53,270][106225] Updated weights for policy 1, policy_version 239544 (0.0009) [2023-12-27 20:56:53,327][106225] Updated weights for policy 1, policy_version 239554 (0.0008) [2023-12-27 20:56:53,374][106225] Updated weights for policy 1, policy_version 239564 (0.0009) [2023-12-27 20:56:53,675][106226] Updated weights for policy 0, policy_version 239200 (0.0009) [2023-12-27 20:56:53,741][106226] Updated weights for policy 0, policy_version 239210 (0.0009) [2023-12-27 20:56:53,799][106226] Updated weights for policy 0, policy_version 239220 (0.0008) [2023-12-27 20:56:54,100][106225] Updated weights for policy 1, policy_version 239574 (0.0008) [2023-12-27 20:56:54,159][106225] Updated weights for policy 1, policy_version 239584 (0.0008) [2023-12-27 20:56:54,226][106225] Updated weights for policy 1, policy_version 239594 (0.0008) [2023-12-27 20:56:54,535][106226] Updated weights for policy 0, policy_version 239230 (0.0008) [2023-12-27 20:56:54,591][106226] Updated weights for policy 0, policy_version 239240 (0.0008) [2023-12-27 20:56:54,650][106226] Updated weights for policy 0, policy_version 239250 (0.0009) [2023-12-27 20:56:54,922][106225] Updated weights for policy 1, policy_version 239604 (0.0008) [2023-12-27 20:56:54,972][106225] Updated weights for policy 1, policy_version 239614 (0.0007) [2023-12-27 20:56:55,026][106225] Updated weights for policy 1, policy_version 239624 (0.0008) [2023-12-27 20:56:55,379][106226] Updated weights for policy 0, policy_version 239260 (0.0008) [2023-12-27 20:56:55,438][106226] Updated weights for policy 0, policy_version 239270 (0.0008) [2023-12-27 20:56:55,495][106226] Updated weights for policy 0, policy_version 239280 (0.0008) [2023-12-27 20:56:55,759][106225] Updated weights for policy 1, policy_version 239634 (0.0009) [2023-12-27 20:56:55,813][106225] Updated weights for policy 1, policy_version 239644 (0.0008) [2023-12-27 20:56:55,869][106225] Updated weights for policy 1, policy_version 239654 (0.0008) [2023-12-27 20:56:55,920][106225] Updated weights for policy 1, policy_version 239664 (0.0008) [2023-12-27 20:56:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 122642432. Throughput: 0: 9787.1, 1: 9883.5. Samples: 122613560. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:56:56,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-6.304')] [2023-12-27 20:56:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000239288_61276160.pth... [2023-12-27 20:56:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000239664_61366272.pth... [2023-12-27 20:56:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000238136_60981248.pth [2023-12-27 20:56:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000238512_61071360.pth [2023-12-27 20:56:56,227][106226] Updated weights for policy 0, policy_version 239290 (0.0009) [2023-12-27 20:56:56,280][106226] Updated weights for policy 0, policy_version 239300 (0.0008) [2023-12-27 20:56:56,337][106226] Updated weights for policy 0, policy_version 239310 (0.0009) [2023-12-27 20:56:56,397][106226] Updated weights for policy 0, policy_version 239320 (0.0009) [2023-12-27 20:56:56,644][106225] Updated weights for policy 1, policy_version 239674 (0.0008) [2023-12-27 20:56:56,706][106225] Updated weights for policy 1, policy_version 239684 (0.0008) [2023-12-27 20:56:56,770][106225] Updated weights for policy 1, policy_version 239694 (0.0007) [2023-12-27 20:56:57,132][106226] Updated weights for policy 0, policy_version 239330 (0.0008) [2023-12-27 20:56:57,186][106226] Updated weights for policy 0, policy_version 239340 (0.0009) [2023-12-27 20:56:57,236][106226] Updated weights for policy 0, policy_version 239350 (0.0008) [2023-12-27 20:56:57,493][106225] Updated weights for policy 1, policy_version 239704 (0.0010) [2023-12-27 20:56:57,559][106225] Updated weights for policy 1, policy_version 239714 (0.0010) [2023-12-27 20:56:57,613][106225] Updated weights for policy 1, policy_version 239724 (0.0010) [2023-12-27 20:56:57,831][106226] Updated weights for policy 0, policy_version 239360 (0.0008) [2023-12-27 20:56:57,896][106226] Updated weights for policy 0, policy_version 239370 (0.0009) [2023-12-27 20:56:57,956][106226] Updated weights for policy 0, policy_version 239380 (0.0009) [2023-12-27 20:56:58,234][106225] Updated weights for policy 1, policy_version 239734 (0.0010) [2023-12-27 20:56:58,297][106225] Updated weights for policy 1, policy_version 239744 (0.0009) [2023-12-27 20:56:58,365][106225] Updated weights for policy 1, policy_version 239754 (0.0009) [2023-12-27 20:56:58,717][106226] Updated weights for policy 0, policy_version 239390 (0.0009) [2023-12-27 20:56:58,782][106226] Updated weights for policy 0, policy_version 239400 (0.0009) [2023-12-27 20:56:58,861][106226] Updated weights for policy 0, policy_version 239410 (0.0008) [2023-12-27 20:56:59,193][106225] Updated weights for policy 1, policy_version 239764 (0.0007) [2023-12-27 20:56:59,262][106225] Updated weights for policy 1, policy_version 239774 (0.0007) [2023-12-27 20:56:59,323][106225] Updated weights for policy 1, policy_version 239784 (0.0009) [2023-12-27 20:56:59,631][106226] Updated weights for policy 0, policy_version 239420 (0.0008) [2023-12-27 20:56:59,685][106226] Updated weights for policy 0, policy_version 239430 (0.0007) [2023-12-27 20:56:59,740][106226] Updated weights for policy 0, policy_version 239440 (0.0006) [2023-12-27 20:57:00,031][106225] Updated weights for policy 1, policy_version 239794 (0.0008) [2023-12-27 20:57:00,093][106225] Updated weights for policy 1, policy_version 239804 (0.0008) [2023-12-27 20:57:00,153][106225] Updated weights for policy 1, policy_version 239814 (0.0007) [2023-12-27 20:57:00,216][106225] Updated weights for policy 1, policy_version 239824 (0.0005) [2023-12-27 20:57:00,385][106226] Updated weights for policy 0, policy_version 239450 (0.0006) [2023-12-27 20:57:00,444][106226] Updated weights for policy 0, policy_version 239460 (0.0009) [2023-12-27 20:57:00,507][106226] Updated weights for policy 0, policy_version 239470 (0.0008) [2023-12-27 20:57:00,554][106226] Updated weights for policy 0, policy_version 239480 (0.0008) [2023-12-27 20:57:00,849][106225] Updated weights for policy 1, policy_version 239834 (0.0006) [2023-12-27 20:57:00,899][106225] Updated weights for policy 1, policy_version 239844 (0.0009) [2023-12-27 20:57:00,967][106225] Updated weights for policy 1, policy_version 239854 (0.0011) [2023-12-27 20:57:01,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 122740736. Throughput: 0: 9838.9, 1: 9822.4. Samples: 122729808. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:01,175][105115] Avg episode reward: [(0, '-5.136'), (1, '-6.137')] [2023-12-27 20:57:01,310][106226] Updated weights for policy 0, policy_version 239490 (0.0007) [2023-12-27 20:57:01,382][106226] Updated weights for policy 0, policy_version 239500 (0.0008) [2023-12-27 20:57:01,435][106226] Updated weights for policy 0, policy_version 239510 (0.0010) [2023-12-27 20:57:01,765][106225] Updated weights for policy 1, policy_version 239864 (0.0009) [2023-12-27 20:57:01,817][106225] Updated weights for policy 1, policy_version 239874 (0.0008) [2023-12-27 20:57:01,866][106225] Updated weights for policy 1, policy_version 239884 (0.0009) [2023-12-27 20:57:02,114][106226] Updated weights for policy 0, policy_version 239520 (0.0008) [2023-12-27 20:57:02,169][106226] Updated weights for policy 0, policy_version 239530 (0.0008) [2023-12-27 20:57:02,223][106226] Updated weights for policy 0, policy_version 239540 (0.0008) [2023-12-27 20:57:02,629][106225] Updated weights for policy 1, policy_version 239894 (0.0009) [2023-12-27 20:57:02,684][106225] Updated weights for policy 1, policy_version 239904 (0.0008) [2023-12-27 20:57:02,750][106225] Updated weights for policy 1, policy_version 239914 (0.0006) [2023-12-27 20:57:02,922][106226] Updated weights for policy 0, policy_version 239550 (0.0009) [2023-12-27 20:57:02,981][106226] Updated weights for policy 0, policy_version 239560 (0.0010) [2023-12-27 20:57:03,044][106226] Updated weights for policy 0, policy_version 239570 (0.0007) [2023-12-27 20:57:03,403][106225] Updated weights for policy 1, policy_version 239924 (0.0006) [2023-12-27 20:57:03,460][106225] Updated weights for policy 1, policy_version 239934 (0.0008) [2023-12-27 20:57:03,524][106225] Updated weights for policy 1, policy_version 239944 (0.0006) [2023-12-27 20:57:03,743][106226] Updated weights for policy 0, policy_version 239580 (0.0009) [2023-12-27 20:57:03,800][106226] Updated weights for policy 0, policy_version 239590 (0.0010) [2023-12-27 20:57:03,861][106226] Updated weights for policy 0, policy_version 239600 (0.0009) [2023-12-27 20:57:04,155][106225] Updated weights for policy 1, policy_version 239954 (0.0006) [2023-12-27 20:57:04,216][106225] Updated weights for policy 1, policy_version 239964 (0.0008) [2023-12-27 20:57:04,268][106225] Updated weights for policy 1, policy_version 239974 (0.0009) [2023-12-27 20:57:04,328][106225] Updated weights for policy 1, policy_version 239984 (0.0009) [2023-12-27 20:57:04,545][106226] Updated weights for policy 0, policy_version 239610 (0.0009) [2023-12-27 20:57:04,608][106226] Updated weights for policy 0, policy_version 239620 (0.0008) [2023-12-27 20:57:04,663][106226] Updated weights for policy 0, policy_version 239630 (0.0008) [2023-12-27 20:57:04,715][106226] Updated weights for policy 0, policy_version 239640 (0.0009) [2023-12-27 20:57:05,120][106225] Updated weights for policy 1, policy_version 239994 (0.0009) [2023-12-27 20:57:05,170][106225] Updated weights for policy 1, policy_version 240004 (0.0008) [2023-12-27 20:57:05,224][106225] Updated weights for policy 1, policy_version 240014 (0.0008) [2023-12-27 20:57:05,299][106226] Updated weights for policy 0, policy_version 239650 (0.0005) [2023-12-27 20:57:05,354][106226] Updated weights for policy 0, policy_version 239660 (0.0005) [2023-12-27 20:57:05,410][106226] Updated weights for policy 0, policy_version 239670 (0.0005) [2023-12-27 20:57:05,949][106226] Updated weights for policy 0, policy_version 239680 (0.0008) [2023-12-27 20:57:06,008][106226] Updated weights for policy 0, policy_version 239690 (0.0006) [2023-12-27 20:57:06,010][106225] Updated weights for policy 1, policy_version 240024 (0.0007) [2023-12-27 20:57:06,056][106226] Updated weights for policy 0, policy_version 239700 (0.0005) [2023-12-27 20:57:06,061][106225] Updated weights for policy 1, policy_version 240034 (0.0007) [2023-12-27 20:57:06,118][106225] Updated weights for policy 1, policy_version 240044 (0.0007) [2023-12-27 20:57:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 122847232. Throughput: 0: 10002.8, 1: 9748.2. Samples: 122850476. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:06,175][105115] Avg episode reward: [(0, '-4.964'), (1, '-6.004')] [2023-12-27 20:57:06,763][106226] Updated weights for policy 0, policy_version 239710 (0.0006) [2023-12-27 20:57:06,830][106226] Updated weights for policy 0, policy_version 239720 (0.0007) [2023-12-27 20:57:06,886][106226] Updated weights for policy 0, policy_version 239730 (0.0007) [2023-12-27 20:57:06,913][106225] Updated weights for policy 1, policy_version 240054 (0.0009) [2023-12-27 20:57:06,965][106225] Updated weights for policy 1, policy_version 240064 (0.0008) [2023-12-27 20:57:07,016][106225] Updated weights for policy 1, policy_version 240074 (0.0008) [2023-12-27 20:57:07,531][106226] Updated weights for policy 0, policy_version 239740 (0.0009) [2023-12-27 20:57:07,596][106226] Updated weights for policy 0, policy_version 239750 (0.0008) [2023-12-27 20:57:07,658][106226] Updated weights for policy 0, policy_version 239760 (0.0005) [2023-12-27 20:57:07,678][106225] Updated weights for policy 1, policy_version 240084 (0.0008) [2023-12-27 20:57:07,731][106225] Updated weights for policy 1, policy_version 240094 (0.0008) [2023-12-27 20:57:07,788][106225] Updated weights for policy 1, policy_version 240104 (0.0008) [2023-12-27 20:57:08,220][106226] Updated weights for policy 0, policy_version 239770 (0.0006) [2023-12-27 20:57:08,277][106226] Updated weights for policy 0, policy_version 239780 (0.0010) [2023-12-27 20:57:08,331][106226] Updated weights for policy 0, policy_version 239790 (0.0006) [2023-12-27 20:57:08,399][106226] Updated weights for policy 0, policy_version 239800 (0.0009) [2023-12-27 20:57:08,547][106225] Updated weights for policy 1, policy_version 240114 (0.0008) [2023-12-27 20:57:08,609][106225] Updated weights for policy 1, policy_version 240124 (0.0007) [2023-12-27 20:57:08,667][106225] Updated weights for policy 1, policy_version 240134 (0.0006) [2023-12-27 20:57:08,737][106225] Updated weights for policy 1, policy_version 240144 (0.0006) [2023-12-27 20:57:09,184][106226] Updated weights for policy 0, policy_version 239810 (0.0009) [2023-12-27 20:57:09,237][106226] Updated weights for policy 0, policy_version 239820 (0.0009) [2023-12-27 20:57:09,296][106226] Updated weights for policy 0, policy_version 239830 (0.0008) [2023-12-27 20:57:09,331][106225] Updated weights for policy 1, policy_version 240154 (0.0009) [2023-12-27 20:57:09,405][106225] Updated weights for policy 1, policy_version 240164 (0.0012) [2023-12-27 20:57:09,470][106225] Updated weights for policy 1, policy_version 240174 (0.0009) [2023-12-27 20:57:10,008][106226] Updated weights for policy 0, policy_version 239840 (0.0006) [2023-12-27 20:57:10,069][106226] Updated weights for policy 0, policy_version 239850 (0.0006) [2023-12-27 20:57:10,137][106226] Updated weights for policy 0, policy_version 239860 (0.0009) [2023-12-27 20:57:10,203][106225] Updated weights for policy 1, policy_version 240184 (0.0008) [2023-12-27 20:57:10,268][106225] Updated weights for policy 1, policy_version 240194 (0.0010) [2023-12-27 20:57:10,333][106225] Updated weights for policy 1, policy_version 240204 (0.0009) [2023-12-27 20:57:10,827][106226] Updated weights for policy 0, policy_version 239870 (0.0009) [2023-12-27 20:57:10,887][106226] Updated weights for policy 0, policy_version 239880 (0.0008) [2023-12-27 20:57:10,948][106226] Updated weights for policy 0, policy_version 239890 (0.0008) [2023-12-27 20:57:11,027][106225] Updated weights for policy 1, policy_version 240214 (0.0010) [2023-12-27 20:57:11,091][106225] Updated weights for policy 1, policy_version 240224 (0.0008) [2023-12-27 20:57:11,166][106225] Updated weights for policy 1, policy_version 240234 (0.0008) [2023-12-27 20:57:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 122937344. Throughput: 0: 10042.4, 1: 9794.0. Samples: 122910296. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:11,175][105115] Avg episode reward: [(0, '-5.434'), (1, '-6.050')] [2023-12-27 20:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000239896_61431808.pth... [2023-12-27 20:57:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000238712_61128704.pth [2023-12-27 20:57:11,202][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000240240_61513728.pth... [2023-12-27 20:57:11,207][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000239088_61218816.pth [2023-12-27 20:57:11,727][106226] Updated weights for policy 0, policy_version 239900 (0.0008) [2023-12-27 20:57:11,796][106226] Updated weights for policy 0, policy_version 239910 (0.0006) [2023-12-27 20:57:11,863][106226] Updated weights for policy 0, policy_version 239920 (0.0008) [2023-12-27 20:57:11,885][106225] Updated weights for policy 1, policy_version 240244 (0.0007) [2023-12-27 20:57:11,953][106225] Updated weights for policy 1, policy_version 240254 (0.0008) [2023-12-27 20:57:12,018][106225] Updated weights for policy 1, policy_version 240264 (0.0009) [2023-12-27 20:57:12,523][106226] Updated weights for policy 0, policy_version 239930 (0.0008) [2023-12-27 20:57:12,580][106226] Updated weights for policy 0, policy_version 239940 (0.0010) [2023-12-27 20:57:12,638][106226] Updated weights for policy 0, policy_version 239950 (0.0011) [2023-12-27 20:57:12,698][106226] Updated weights for policy 0, policy_version 239960 (0.0010) [2023-12-27 20:57:12,771][106225] Updated weights for policy 1, policy_version 240274 (0.0008) [2023-12-27 20:57:12,840][106225] Updated weights for policy 1, policy_version 240284 (0.0008) [2023-12-27 20:57:12,898][106225] Updated weights for policy 1, policy_version 240294 (0.0008) [2023-12-27 20:57:12,959][106225] Updated weights for policy 1, policy_version 240304 (0.0008) [2023-12-27 20:57:13,414][106226] Updated weights for policy 0, policy_version 239970 (0.0007) [2023-12-27 20:57:13,472][106226] Updated weights for policy 0, policy_version 239980 (0.0007) [2023-12-27 20:57:13,547][106226] Updated weights for policy 0, policy_version 239990 (0.0006) [2023-12-27 20:57:13,704][106225] Updated weights for policy 1, policy_version 240314 (0.0010) [2023-12-27 20:57:13,750][106225] Updated weights for policy 1, policy_version 240324 (0.0005) [2023-12-27 20:57:13,800][106225] Updated weights for policy 1, policy_version 240334 (0.0005) [2023-12-27 20:57:14,168][106226] Updated weights for policy 0, policy_version 240000 (0.0010) [2023-12-27 20:57:14,223][106226] Updated weights for policy 0, policy_version 240010 (0.0010) [2023-12-27 20:57:14,277][106226] Updated weights for policy 0, policy_version 240020 (0.0010) [2023-12-27 20:57:14,351][106225] Updated weights for policy 1, policy_version 240344 (0.0005) [2023-12-27 20:57:14,408][106225] Updated weights for policy 1, policy_version 240354 (0.0005) [2023-12-27 20:57:14,460][106225] Updated weights for policy 1, policy_version 240364 (0.0005) [2023-12-27 20:57:15,005][106226] Updated weights for policy 0, policy_version 240030 (0.0009) [2023-12-27 20:57:15,061][106225] Updated weights for policy 1, policy_version 240374 (0.0008) [2023-12-27 20:57:15,075][106226] Updated weights for policy 0, policy_version 240040 (0.0009) [2023-12-27 20:57:15,127][106225] Updated weights for policy 1, policy_version 240384 (0.0006) [2023-12-27 20:57:15,139][106226] Updated weights for policy 0, policy_version 240050 (0.0010) [2023-12-27 20:57:15,193][106225] Updated weights for policy 1, policy_version 240394 (0.0009) [2023-12-27 20:57:15,796][106226] Updated weights for policy 0, policy_version 240060 (0.0008) [2023-12-27 20:57:15,846][106226] Updated weights for policy 0, policy_version 240070 (0.0010) [2023-12-27 20:57:15,899][106226] Updated weights for policy 0, policy_version 240080 (0.0011) [2023-12-27 20:57:15,939][106225] Updated weights for policy 1, policy_version 240404 (0.0008) [2023-12-27 20:57:16,000][106225] Updated weights for policy 1, policy_version 240414 (0.0005) [2023-12-27 20:57:16,068][106225] Updated weights for policy 1, policy_version 240424 (0.0005) [2023-12-27 20:57:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 123043840. Throughput: 0: 9979.4, 1: 9759.6. Samples: 123029072. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:16,175][105115] Avg episode reward: [(0, '-4.946'), (1, '-6.275')] [2023-12-27 20:57:16,583][106226] Updated weights for policy 0, policy_version 240090 (0.0011) [2023-12-27 20:57:16,614][106225] Updated weights for policy 1, policy_version 240434 (0.0005) [2023-12-27 20:57:16,647][106226] Updated weights for policy 0, policy_version 240100 (0.0011) [2023-12-27 20:57:16,673][106225] Updated weights for policy 1, policy_version 240444 (0.0006) [2023-12-27 20:57:16,701][106226] Updated weights for policy 0, policy_version 240110 (0.0010) [2023-12-27 20:57:16,727][106225] Updated weights for policy 1, policy_version 240454 (0.0006) [2023-12-27 20:57:16,762][106226] Updated weights for policy 0, policy_version 240120 (0.0011) [2023-12-27 20:57:16,777][106225] Updated weights for policy 1, policy_version 240464 (0.0007) [2023-12-27 20:57:17,434][106226] Updated weights for policy 0, policy_version 240130 (0.0010) [2023-12-27 20:57:17,492][106225] Updated weights for policy 1, policy_version 240474 (0.0010) [2023-12-27 20:57:17,493][106226] Updated weights for policy 0, policy_version 240140 (0.0010) [2023-12-27 20:57:17,548][106225] Updated weights for policy 1, policy_version 240484 (0.0010) [2023-12-27 20:57:17,553][106226] Updated weights for policy 0, policy_version 240150 (0.0010) [2023-12-27 20:57:17,606][106225] Updated weights for policy 1, policy_version 240494 (0.0009) [2023-12-27 20:57:18,196][106226] Updated weights for policy 0, policy_version 240160 (0.0011) [2023-12-27 20:57:18,253][106226] Updated weights for policy 0, policy_version 240170 (0.0010) [2023-12-27 20:57:18,257][106225] Updated weights for policy 1, policy_version 240504 (0.0010) [2023-12-27 20:57:18,306][106226] Updated weights for policy 0, policy_version 240180 (0.0010) [2023-12-27 20:57:18,314][106225] Updated weights for policy 1, policy_version 240514 (0.0010) [2023-12-27 20:57:18,379][106225] Updated weights for policy 1, policy_version 240524 (0.0010) [2023-12-27 20:57:19,025][106225] Updated weights for policy 1, policy_version 240534 (0.0009) [2023-12-27 20:57:19,063][106226] Updated weights for policy 0, policy_version 240190 (0.0010) [2023-12-27 20:57:19,075][106225] Updated weights for policy 1, policy_version 240544 (0.0010) [2023-12-27 20:57:19,125][106226] Updated weights for policy 0, policy_version 240200 (0.0010) [2023-12-27 20:57:19,134][106225] Updated weights for policy 1, policy_version 240554 (0.0010) [2023-12-27 20:57:19,187][106226] Updated weights for policy 0, policy_version 240210 (0.0007) [2023-12-27 20:57:19,903][106225] Updated weights for policy 1, policy_version 240564 (0.0009) [2023-12-27 20:57:19,922][106226] Updated weights for policy 0, policy_version 240221 (0.0007) [2023-12-27 20:57:19,974][106225] Updated weights for policy 1, policy_version 240574 (0.0007) [2023-12-27 20:57:19,991][106226] Updated weights for policy 0, policy_version 240231 (0.0008) [2023-12-27 20:57:20,041][106225] Updated weights for policy 1, policy_version 240584 (0.0006) [2023-12-27 20:57:20,059][106226] Updated weights for policy 0, policy_version 240241 (0.0008) [2023-12-27 20:57:20,760][106226] Updated weights for policy 0, policy_version 240251 (0.0008) [2023-12-27 20:57:20,801][106225] Updated weights for policy 1, policy_version 240594 (0.0006) [2023-12-27 20:57:20,823][106226] Updated weights for policy 0, policy_version 240261 (0.0008) [2023-12-27 20:57:20,863][106225] Updated weights for policy 1, policy_version 240604 (0.0007) [2023-12-27 20:57:20,890][106226] Updated weights for policy 0, policy_version 240271 (0.0008) [2023-12-27 20:57:20,931][106225] Updated weights for policy 1, policy_version 240614 (0.0006) [2023-12-27 20:57:21,003][106225] Updated weights for policy 1, policy_version 240624 (0.0007) [2023-12-27 20:57:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 123142144. Throughput: 0: 9939.6, 1: 9760.5. Samples: 123148012. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:21,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-6.654')] [2023-12-27 20:57:21,669][106226] Updated weights for policy 0, policy_version 240281 (0.0007) [2023-12-27 20:57:21,680][106225] Updated weights for policy 1, policy_version 240634 (0.0008) [2023-12-27 20:57:21,733][106226] Updated weights for policy 0, policy_version 240291 (0.0008) [2023-12-27 20:57:21,738][106225] Updated weights for policy 1, policy_version 240644 (0.0007) [2023-12-27 20:57:21,797][106225] Updated weights for policy 1, policy_version 240654 (0.0008) [2023-12-27 20:57:21,802][106226] Updated weights for policy 0, policy_version 240301 (0.0008) [2023-12-27 20:57:21,865][106226] Updated weights for policy 0, policy_version 240311 (0.0008) [2023-12-27 20:57:22,539][106225] Updated weights for policy 1, policy_version 240664 (0.0009) [2023-12-27 20:57:22,599][106225] Updated weights for policy 1, policy_version 240674 (0.0007) [2023-12-27 20:57:22,636][106226] Updated weights for policy 0, policy_version 240321 (0.0009) [2023-12-27 20:57:22,659][106225] Updated weights for policy 1, policy_version 240684 (0.0006) [2023-12-27 20:57:22,694][106226] Updated weights for policy 0, policy_version 240331 (0.0009) [2023-12-27 20:57:22,748][106226] Updated weights for policy 0, policy_version 240341 (0.0007) [2023-12-27 20:57:23,345][106225] Updated weights for policy 1, policy_version 240694 (0.0007) [2023-12-27 20:57:23,392][106225] Updated weights for policy 1, policy_version 240704 (0.0008) [2023-12-27 20:57:23,437][106225] Updated weights for policy 1, policy_version 240714 (0.0008) [2023-12-27 20:57:23,504][106226] Updated weights for policy 0, policy_version 240351 (0.0010) [2023-12-27 20:57:23,564][106226] Updated weights for policy 0, policy_version 240361 (0.0011) [2023-12-27 20:57:23,624][106226] Updated weights for policy 0, policy_version 240371 (0.0010) [2023-12-27 20:57:24,101][106225] Updated weights for policy 1, policy_version 240724 (0.0007) [2023-12-27 20:57:24,160][106225] Updated weights for policy 1, policy_version 240734 (0.0005) [2023-12-27 20:57:24,173][106226] Updated weights for policy 0, policy_version 240381 (0.0008) [2023-12-27 20:57:24,226][106225] Updated weights for policy 1, policy_version 240744 (0.0005) [2023-12-27 20:57:24,228][106226] Updated weights for policy 0, policy_version 240391 (0.0010) [2023-12-27 20:57:24,282][106226] Updated weights for policy 0, policy_version 240401 (0.0010) [2023-12-27 20:57:24,751][106225] Updated weights for policy 1, policy_version 240754 (0.0005) [2023-12-27 20:57:24,796][106225] Updated weights for policy 1, policy_version 240764 (0.0005) [2023-12-27 20:57:24,842][106225] Updated weights for policy 1, policy_version 240774 (0.0008) [2023-12-27 20:57:24,894][106225] Updated weights for policy 1, policy_version 240784 (0.0007) [2023-12-27 20:57:24,995][106226] Updated weights for policy 0, policy_version 240411 (0.0010) [2023-12-27 20:57:25,051][106226] Updated weights for policy 0, policy_version 240421 (0.0010) [2023-12-27 20:57:25,101][106226] Updated weights for policy 0, policy_version 240431 (0.0010) [2023-12-27 20:57:25,540][106225] Updated weights for policy 1, policy_version 240794 (0.0007) [2023-12-27 20:57:25,607][106225] Updated weights for policy 1, policy_version 240804 (0.0008) [2023-12-27 20:57:25,665][106225] Updated weights for policy 1, policy_version 240814 (0.0007) [2023-12-27 20:57:25,819][106226] Updated weights for policy 0, policy_version 240441 (0.0010) [2023-12-27 20:57:25,876][106226] Updated weights for policy 0, policy_version 240451 (0.0010) [2023-12-27 20:57:25,939][106226] Updated weights for policy 0, policy_version 240461 (0.0011) [2023-12-27 20:57:25,995][106226] Updated weights for policy 0, policy_version 240471 (0.0010) [2023-12-27 20:57:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 123240448. Throughput: 0: 9878.2, 1: 9735.4. Samples: 123205972. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:26,176][105115] Avg episode reward: [(0, '-4.663'), (1, '-6.162')] [2023-12-27 20:57:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000240472_61579264.pth... [2023-12-27 20:57:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000239288_61276160.pth [2023-12-27 20:57:26,230][106225] Updated weights for policy 1, policy_version 240824 (0.0006) [2023-12-27 20:57:26,292][106225] Updated weights for policy 1, policy_version 240834 (0.0005) [2023-12-27 20:57:26,335][106225] Updated weights for policy 1, policy_version 240844 (0.0005) [2023-12-27 20:57:26,352][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000240848_61669376.pth... [2023-12-27 20:57:26,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000239664_61366272.pth [2023-12-27 20:57:26,631][106226] Updated weights for policy 0, policy_version 240481 (0.0006) [2023-12-27 20:57:26,683][106226] Updated weights for policy 0, policy_version 240491 (0.0005) [2023-12-27 20:57:26,730][106226] Updated weights for policy 0, policy_version 240501 (0.0010) [2023-12-27 20:57:26,857][106225] Updated weights for policy 1, policy_version 240854 (0.0005) [2023-12-27 20:57:26,917][106225] Updated weights for policy 1, policy_version 240864 (0.0005) [2023-12-27 20:57:26,975][106225] Updated weights for policy 1, policy_version 240874 (0.0005) [2023-12-27 20:57:27,353][106226] Updated weights for policy 0, policy_version 240511 (0.0008) [2023-12-27 20:57:27,421][106226] Updated weights for policy 0, policy_version 240521 (0.0005) [2023-12-27 20:57:27,489][106226] Updated weights for policy 0, policy_version 240531 (0.0006) [2023-12-27 20:57:27,572][106225] Updated weights for policy 1, policy_version 240884 (0.0008) [2023-12-27 20:57:27,628][106225] Updated weights for policy 1, policy_version 240894 (0.0010) [2023-12-27 20:57:27,679][106225] Updated weights for policy 1, policy_version 240904 (0.0010) [2023-12-27 20:57:28,136][106226] Updated weights for policy 0, policy_version 240541 (0.0009) [2023-12-27 20:57:28,200][106226] Updated weights for policy 0, policy_version 240551 (0.0005) [2023-12-27 20:57:28,252][106226] Updated weights for policy 0, policy_version 240561 (0.0009) [2023-12-27 20:57:28,311][106225] Updated weights for policy 1, policy_version 240914 (0.0010) [2023-12-27 20:57:28,376][106225] Updated weights for policy 1, policy_version 240924 (0.0007) [2023-12-27 20:57:28,434][106225] Updated weights for policy 1, policy_version 240934 (0.0009) [2023-12-27 20:57:28,489][106225] Updated weights for policy 1, policy_version 240944 (0.0009) [2023-12-27 20:57:28,841][106226] Updated weights for policy 0, policy_version 240571 (0.0007) [2023-12-27 20:57:28,897][106226] Updated weights for policy 0, policy_version 240581 (0.0005) [2023-12-27 20:57:28,952][106226] Updated weights for policy 0, policy_version 240591 (0.0006) [2023-12-27 20:57:29,184][106225] Updated weights for policy 1, policy_version 240954 (0.0005) [2023-12-27 20:57:29,239][106225] Updated weights for policy 1, policy_version 240964 (0.0006) [2023-12-27 20:57:29,307][106225] Updated weights for policy 1, policy_version 240974 (0.0009) [2023-12-27 20:57:29,567][106226] Updated weights for policy 0, policy_version 240601 (0.0006) [2023-12-27 20:57:29,614][106226] Updated weights for policy 0, policy_version 240611 (0.0010) [2023-12-27 20:57:29,671][106226] Updated weights for policy 0, policy_version 240621 (0.0011) [2023-12-27 20:57:29,728][106226] Updated weights for policy 0, policy_version 240631 (0.0010) [2023-12-27 20:57:30,018][106225] Updated weights for policy 1, policy_version 240984 (0.0008) [2023-12-27 20:57:30,070][106225] Updated weights for policy 1, policy_version 240994 (0.0008) [2023-12-27 20:57:30,131][106225] Updated weights for policy 1, policy_version 241004 (0.0008) [2023-12-27 20:57:30,514][106226] Updated weights for policy 0, policy_version 240641 (0.0008) [2023-12-27 20:57:30,559][106226] Updated weights for policy 0, policy_version 240651 (0.0007) [2023-12-27 20:57:30,604][106226] Updated weights for policy 0, policy_version 240661 (0.0007) [2023-12-27 20:57:30,861][106225] Updated weights for policy 1, policy_version 241014 (0.0007) [2023-12-27 20:57:30,909][106225] Updated weights for policy 1, policy_version 241024 (0.0006) [2023-12-27 20:57:30,959][106225] Updated weights for policy 1, policy_version 241034 (0.0008) [2023-12-27 20:57:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 123346944. Throughput: 0: 9973.9, 1: 9927.8. Samples: 123335844. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:31,175][105115] Avg episode reward: [(0, '-5.128'), (1, '-6.446')] [2023-12-27 20:57:31,419][106226] Updated weights for policy 0, policy_version 240671 (0.0008) [2023-12-27 20:57:31,470][106226] Updated weights for policy 0, policy_version 240681 (0.0007) [2023-12-27 20:57:31,521][106226] Updated weights for policy 0, policy_version 240691 (0.0008) [2023-12-27 20:57:31,727][106225] Updated weights for policy 1, policy_version 241044 (0.0007) [2023-12-27 20:57:31,794][106225] Updated weights for policy 1, policy_version 241054 (0.0008) [2023-12-27 20:57:31,848][106225] Updated weights for policy 1, policy_version 241064 (0.0007) [2023-12-27 20:57:32,310][106226] Updated weights for policy 0, policy_version 240701 (0.0006) [2023-12-27 20:57:32,375][106226] Updated weights for policy 0, policy_version 240711 (0.0007) [2023-12-27 20:57:32,434][106226] Updated weights for policy 0, policy_version 240721 (0.0009) [2023-12-27 20:57:32,545][106225] Updated weights for policy 1, policy_version 241074 (0.0008) [2023-12-27 20:57:32,600][106225] Updated weights for policy 1, policy_version 241084 (0.0008) [2023-12-27 20:57:32,661][106225] Updated weights for policy 1, policy_version 241094 (0.0008) [2023-12-27 20:57:32,711][106225] Updated weights for policy 1, policy_version 241104 (0.0008) [2023-12-27 20:57:33,145][106226] Updated weights for policy 0, policy_version 240731 (0.0009) [2023-12-27 20:57:33,204][106226] Updated weights for policy 0, policy_version 240741 (0.0008) [2023-12-27 20:57:33,266][106226] Updated weights for policy 0, policy_version 240751 (0.0008) [2023-12-27 20:57:33,435][106225] Updated weights for policy 1, policy_version 241114 (0.0008) [2023-12-27 20:57:33,492][106225] Updated weights for policy 1, policy_version 241124 (0.0009) [2023-12-27 20:57:33,540][106225] Updated weights for policy 1, policy_version 241134 (0.0008) [2023-12-27 20:57:33,972][106226] Updated weights for policy 0, policy_version 240761 (0.0008) [2023-12-27 20:57:34,030][106226] Updated weights for policy 0, policy_version 240771 (0.0008) [2023-12-27 20:57:34,076][106226] Updated weights for policy 0, policy_version 240781 (0.0008) [2023-12-27 20:57:34,129][106226] Updated weights for policy 0, policy_version 240791 (0.0006) [2023-12-27 20:57:34,291][106225] Updated weights for policy 1, policy_version 241144 (0.0006) [2023-12-27 20:57:34,360][106225] Updated weights for policy 1, policy_version 241154 (0.0009) [2023-12-27 20:57:34,416][106225] Updated weights for policy 1, policy_version 241164 (0.0008) [2023-12-27 20:57:34,832][106226] Updated weights for policy 0, policy_version 240801 (0.0006) [2023-12-27 20:57:34,895][106226] Updated weights for policy 0, policy_version 240811 (0.0006) [2023-12-27 20:57:34,952][106226] Updated weights for policy 0, policy_version 240821 (0.0006) [2023-12-27 20:57:35,150][106225] Updated weights for policy 1, policy_version 241174 (0.0008) [2023-12-27 20:57:35,208][106225] Updated weights for policy 1, policy_version 241184 (0.0008) [2023-12-27 20:57:35,252][106225] Updated weights for policy 1, policy_version 241194 (0.0008) [2023-12-27 20:57:35,511][106226] Updated weights for policy 0, policy_version 240831 (0.0005) [2023-12-27 20:57:35,561][106226] Updated weights for policy 0, policy_version 240841 (0.0005) [2023-12-27 20:57:35,621][106226] Updated weights for policy 0, policy_version 240851 (0.0005) [2023-12-27 20:57:36,091][106225] Updated weights for policy 1, policy_version 241204 (0.0008) [2023-12-27 20:57:36,158][106225] Updated weights for policy 1, policy_version 241214 (0.0009) [2023-12-27 20:57:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 123437056. Throughput: 0: 9969.6, 1: 9959.1. Samples: 123453428. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:36,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.954')] [2023-12-27 20:57:36,182][106226] Updated weights for policy 0, policy_version 240861 (0.0007) [2023-12-27 20:57:36,221][106225] Updated weights for policy 1, policy_version 241224 (0.0006) [2023-12-27 20:57:36,246][106226] Updated weights for policy 0, policy_version 240871 (0.0009) [2023-12-27 20:57:36,314][106226] Updated weights for policy 0, policy_version 240881 (0.0009) [2023-12-27 20:57:36,866][106225] Updated weights for policy 1, policy_version 241234 (0.0006) [2023-12-27 20:57:36,931][106225] Updated weights for policy 1, policy_version 241244 (0.0008) [2023-12-27 20:57:36,996][106225] Updated weights for policy 1, policy_version 241254 (0.0008) [2023-12-27 20:57:37,048][106226] Updated weights for policy 0, policy_version 240891 (0.0010) [2023-12-27 20:57:37,054][106225] Updated weights for policy 1, policy_version 241264 (0.0007) [2023-12-27 20:57:37,112][106226] Updated weights for policy 0, policy_version 240901 (0.0009) [2023-12-27 20:57:37,181][106226] Updated weights for policy 0, policy_version 240911 (0.0006) [2023-12-27 20:57:37,711][106225] Updated weights for policy 1, policy_version 241274 (0.0009) [2023-12-27 20:57:37,744][106226] Updated weights for policy 0, policy_version 240921 (0.0006) [2023-12-27 20:57:37,759][106225] Updated weights for policy 1, policy_version 241284 (0.0007) [2023-12-27 20:57:37,804][106226] Updated weights for policy 0, policy_version 240931 (0.0007) [2023-12-27 20:57:37,804][106225] Updated weights for policy 1, policy_version 241294 (0.0007) [2023-12-27 20:57:37,869][106226] Updated weights for policy 0, policy_version 240941 (0.0005) [2023-12-27 20:57:37,928][106226] Updated weights for policy 0, policy_version 240951 (0.0008) [2023-12-27 20:57:38,567][106225] Updated weights for policy 1, policy_version 241304 (0.0008) [2023-12-27 20:57:38,628][106225] Updated weights for policy 1, policy_version 241314 (0.0007) [2023-12-27 20:57:38,639][106226] Updated weights for policy 0, policy_version 240961 (0.0007) [2023-12-27 20:57:38,688][106225] Updated weights for policy 1, policy_version 241324 (0.0007) [2023-12-27 20:57:38,703][106226] Updated weights for policy 0, policy_version 240971 (0.0011) [2023-12-27 20:57:38,768][106226] Updated weights for policy 0, policy_version 240981 (0.0011) [2023-12-27 20:57:39,436][106225] Updated weights for policy 1, policy_version 241334 (0.0008) [2023-12-27 20:57:39,474][106226] Updated weights for policy 0, policy_version 240991 (0.0007) [2023-12-27 20:57:39,500][106225] Updated weights for policy 1, policy_version 241344 (0.0008) [2023-12-27 20:57:39,527][106226] Updated weights for policy 0, policy_version 241001 (0.0006) [2023-12-27 20:57:39,568][106225] Updated weights for policy 1, policy_version 241354 (0.0008) [2023-12-27 20:57:39,581][106226] Updated weights for policy 0, policy_version 241011 (0.0007) [2023-12-27 20:57:40,249][106226] Updated weights for policy 0, policy_version 241021 (0.0010) [2023-12-27 20:57:40,310][106226] Updated weights for policy 0, policy_version 241031 (0.0011) [2023-12-27 20:57:40,343][106225] Updated weights for policy 1, policy_version 241364 (0.0007) [2023-12-27 20:57:40,369][106226] Updated weights for policy 0, policy_version 241041 (0.0011) [2023-12-27 20:57:40,406][106225] Updated weights for policy 1, policy_version 241374 (0.0008) [2023-12-27 20:57:40,463][106225] Updated weights for policy 1, policy_version 241384 (0.0007) [2023-12-27 20:57:41,076][106226] Updated weights for policy 0, policy_version 241051 (0.0011) [2023-12-27 20:57:41,167][106226] Updated weights for policy 0, policy_version 241061 (0.0009) [2023-12-27 20:57:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 123535360. Throughput: 0: 10029.9, 1: 9952.8. Samples: 123512788. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:41,175][105115] Avg episode reward: [(0, '-4.931'), (1, '-5.955')] [2023-12-27 20:57:41,182][106225] Updated weights for policy 1, policy_version 241394 (0.0008) [2023-12-27 20:57:41,226][106226] Updated weights for policy 0, policy_version 241071 (0.0008) [2023-12-27 20:57:41,246][106225] Updated weights for policy 1, policy_version 241404 (0.0008) [2023-12-27 20:57:41,282][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000241080_61734912.pth... [2023-12-27 20:57:41,286][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000239896_61431808.pth [2023-12-27 20:57:41,308][106225] Updated weights for policy 1, policy_version 241414 (0.0008) [2023-12-27 20:57:41,374][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000241424_61816832.pth... [2023-12-27 20:57:41,374][106225] Updated weights for policy 1, policy_version 241424 (0.0008) [2023-12-27 20:57:41,379][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000240240_61513728.pth [2023-12-27 20:57:41,935][106226] Updated weights for policy 0, policy_version 241081 (0.0010) [2023-12-27 20:57:42,004][106226] Updated weights for policy 0, policy_version 241091 (0.0007) [2023-12-27 20:57:42,070][106226] Updated weights for policy 0, policy_version 241101 (0.0008) [2023-12-27 20:57:42,125][106226] Updated weights for policy 0, policy_version 241111 (0.0006) [2023-12-27 20:57:42,149][106225] Updated weights for policy 1, policy_version 241434 (0.0006) [2023-12-27 20:57:42,211][106225] Updated weights for policy 1, policy_version 241444 (0.0009) [2023-12-27 20:57:42,273][106225] Updated weights for policy 1, policy_version 241454 (0.0008) [2023-12-27 20:57:42,809][106226] Updated weights for policy 0, policy_version 241121 (0.0010) [2023-12-27 20:57:42,871][106226] Updated weights for policy 0, policy_version 241131 (0.0010) [2023-12-27 20:57:42,919][106226] Updated weights for policy 0, policy_version 241141 (0.0010) [2023-12-27 20:57:42,992][106225] Updated weights for policy 1, policy_version 241464 (0.0008) [2023-12-27 20:57:43,056][106225] Updated weights for policy 1, policy_version 241474 (0.0008) [2023-12-27 20:57:43,119][106225] Updated weights for policy 1, policy_version 241484 (0.0009) [2023-12-27 20:57:43,512][106226] Updated weights for policy 0, policy_version 241151 (0.0007) [2023-12-27 20:57:43,564][106226] Updated weights for policy 0, policy_version 241161 (0.0008) [2023-12-27 20:57:43,611][106226] Updated weights for policy 0, policy_version 241171 (0.0010) [2023-12-27 20:57:43,882][106225] Updated weights for policy 1, policy_version 241494 (0.0008) [2023-12-27 20:57:43,931][106225] Updated weights for policy 1, policy_version 241504 (0.0007) [2023-12-27 20:57:43,977][106225] Updated weights for policy 1, policy_version 241514 (0.0008) [2023-12-27 20:57:44,321][106226] Updated weights for policy 0, policy_version 241181 (0.0008) [2023-12-27 20:57:44,382][106226] Updated weights for policy 0, policy_version 241191 (0.0005) [2023-12-27 20:57:44,447][106226] Updated weights for policy 0, policy_version 241201 (0.0007) [2023-12-27 20:57:44,782][106225] Updated weights for policy 1, policy_version 241524 (0.0008) [2023-12-27 20:57:44,842][106225] Updated weights for policy 1, policy_version 241534 (0.0009) [2023-12-27 20:57:44,898][106225] Updated weights for policy 1, policy_version 241544 (0.0009) [2023-12-27 20:57:45,029][106226] Updated weights for policy 0, policy_version 241211 (0.0011) [2023-12-27 20:57:45,089][106226] Updated weights for policy 0, policy_version 241221 (0.0010) [2023-12-27 20:57:45,150][106226] Updated weights for policy 0, policy_version 241231 (0.0010) [2023-12-27 20:57:45,653][106225] Updated weights for policy 1, policy_version 241554 (0.0009) [2023-12-27 20:57:45,703][106225] Updated weights for policy 1, policy_version 241564 (0.0008) [2023-12-27 20:57:45,746][106225] Updated weights for policy 1, policy_version 241574 (0.0007) [2023-12-27 20:57:45,818][106225] Updated weights for policy 1, policy_version 241584 (0.0008) [2023-12-27 20:57:45,874][106226] Updated weights for policy 0, policy_version 241241 (0.0011) [2023-12-27 20:57:45,928][106226] Updated weights for policy 0, policy_version 241251 (0.0010) [2023-12-27 20:57:45,978][106226] Updated weights for policy 0, policy_version 241261 (0.0011) [2023-12-27 20:57:46,035][106226] Updated weights for policy 0, policy_version 241271 (0.0010) [2023-12-27 20:57:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 123641856. Throughput: 0: 10097.5, 1: 9893.8. Samples: 123629416. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:46,175][105115] Avg episode reward: [(0, '-5.145'), (1, '-6.609')] [2023-12-27 20:57:46,408][106225] Updated weights for policy 1, policy_version 241594 (0.0007) [2023-12-27 20:57:46,473][106225] Updated weights for policy 1, policy_version 241604 (0.0008) [2023-12-27 20:57:46,532][106225] Updated weights for policy 1, policy_version 241614 (0.0008) [2023-12-27 20:57:46,760][106226] Updated weights for policy 0, policy_version 241281 (0.0010) [2023-12-27 20:57:46,820][106226] Updated weights for policy 0, policy_version 241291 (0.0010) [2023-12-27 20:57:46,882][106226] Updated weights for policy 0, policy_version 241301 (0.0011) [2023-12-27 20:57:47,238][106225] Updated weights for policy 1, policy_version 241624 (0.0006) [2023-12-27 20:57:47,287][106225] Updated weights for policy 1, policy_version 241634 (0.0010) [2023-12-27 20:57:47,353][106225] Updated weights for policy 1, policy_version 241644 (0.0010) [2023-12-27 20:57:47,565][106226] Updated weights for policy 0, policy_version 241311 (0.0009) [2023-12-27 20:57:47,623][106226] Updated weights for policy 0, policy_version 241321 (0.0008) [2023-12-27 20:57:47,680][106226] Updated weights for policy 0, policy_version 241331 (0.0008) [2023-12-27 20:57:48,060][106225] Updated weights for policy 1, policy_version 241654 (0.0008) [2023-12-27 20:57:48,116][106225] Updated weights for policy 1, policy_version 241664 (0.0010) [2023-12-27 20:57:48,162][106225] Updated weights for policy 1, policy_version 241674 (0.0010) [2023-12-27 20:57:48,418][106226] Updated weights for policy 0, policy_version 241341 (0.0009) [2023-12-27 20:57:48,483][106226] Updated weights for policy 0, policy_version 241351 (0.0008) [2023-12-27 20:57:48,545][106226] Updated weights for policy 0, policy_version 241361 (0.0009) [2023-12-27 20:57:48,894][106225] Updated weights for policy 1, policy_version 241684 (0.0009) [2023-12-27 20:57:48,955][106225] Updated weights for policy 1, policy_version 241694 (0.0009) [2023-12-27 20:57:49,014][106225] Updated weights for policy 1, policy_version 241704 (0.0009) [2023-12-27 20:57:49,267][106226] Updated weights for policy 0, policy_version 241371 (0.0008) [2023-12-27 20:57:49,330][106226] Updated weights for policy 0, policy_version 241381 (0.0007) [2023-12-27 20:57:49,394][106226] Updated weights for policy 0, policy_version 241391 (0.0008) [2023-12-27 20:57:49,748][106225] Updated weights for policy 1, policy_version 241714 (0.0009) [2023-12-27 20:57:49,808][106225] Updated weights for policy 1, policy_version 241724 (0.0008) [2023-12-27 20:57:49,876][106225] Updated weights for policy 1, policy_version 241734 (0.0008) [2023-12-27 20:57:49,949][106225] Updated weights for policy 1, policy_version 241744 (0.0008) [2023-12-27 20:57:50,154][106226] Updated weights for policy 0, policy_version 241401 (0.0008) [2023-12-27 20:57:50,218][106226] Updated weights for policy 0, policy_version 241411 (0.0008) [2023-12-27 20:57:50,281][106226] Updated weights for policy 0, policy_version 241421 (0.0008) [2023-12-27 20:57:50,338][106226] Updated weights for policy 0, policy_version 241431 (0.0007) [2023-12-27 20:57:50,713][106225] Updated weights for policy 1, policy_version 241754 (0.0010) [2023-12-27 20:57:50,781][106225] Updated weights for policy 1, policy_version 241764 (0.0011) [2023-12-27 20:57:50,844][106225] Updated weights for policy 1, policy_version 241774 (0.0009) [2023-12-27 20:57:51,057][106226] Updated weights for policy 0, policy_version 241441 (0.0009) [2023-12-27 20:57:51,126][106226] Updated weights for policy 0, policy_version 241451 (0.0007) [2023-12-27 20:57:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 123731968. Throughput: 0: 9986.7, 1: 9893.6. Samples: 123745088. Policy #0 lag: (min: 26.0, avg: 45.2, max: 58.0) [2023-12-27 20:57:51,175][105115] Avg episode reward: [(0, '-5.208'), (1, '-6.093')] [2023-12-27 20:57:51,194][106226] Updated weights for policy 0, policy_version 241461 (0.0008) [2023-12-27 20:57:51,533][106225] Updated weights for policy 1, policy_version 241784 (0.0008) [2023-12-27 20:57:51,591][106225] Updated weights for policy 1, policy_version 241794 (0.0008) [2023-12-27 20:57:51,656][106225] Updated weights for policy 1, policy_version 241804 (0.0008) [2023-12-27 20:57:51,969][106226] Updated weights for policy 0, policy_version 241471 (0.0009) [2023-12-27 20:57:52,026][106226] Updated weights for policy 0, policy_version 241481 (0.0009) [2023-12-27 20:57:52,086][106226] Updated weights for policy 0, policy_version 241491 (0.0009) [2023-12-27 20:57:52,335][106225] Updated weights for policy 1, policy_version 241814 (0.0008) [2023-12-27 20:57:52,403][106225] Updated weights for policy 1, policy_version 241824 (0.0009) [2023-12-27 20:57:52,468][106225] Updated weights for policy 1, policy_version 241834 (0.0008) [2023-12-27 20:57:52,844][106226] Updated weights for policy 0, policy_version 241501 (0.0009) [2023-12-27 20:57:52,897][106226] Updated weights for policy 0, policy_version 241511 (0.0009) [2023-12-27 20:57:52,948][106226] Updated weights for policy 0, policy_version 241521 (0.0008) [2023-12-27 20:57:53,215][106225] Updated weights for policy 1, policy_version 241844 (0.0007) [2023-12-27 20:57:53,262][106225] Updated weights for policy 1, policy_version 241854 (0.0010) [2023-12-27 20:57:53,316][106225] Updated weights for policy 1, policy_version 241864 (0.0010) [2023-12-27 20:57:53,711][106226] Updated weights for policy 0, policy_version 241531 (0.0008) [2023-12-27 20:57:53,775][106226] Updated weights for policy 0, policy_version 241541 (0.0006) [2023-12-27 20:57:53,825][106226] Updated weights for policy 0, policy_version 241551 (0.0005) [2023-12-27 20:57:53,918][106225] Updated weights for policy 1, policy_version 241874 (0.0009) [2023-12-27 20:57:53,967][106225] Updated weights for policy 1, policy_version 241884 (0.0005) [2023-12-27 20:57:54,023][106225] Updated weights for policy 1, policy_version 241894 (0.0005) [2023-12-27 20:57:54,074][106225] Updated weights for policy 1, policy_version 241904 (0.0005) [2023-12-27 20:57:54,511][106226] Updated weights for policy 0, policy_version 241561 (0.0006) [2023-12-27 20:57:54,562][106226] Updated weights for policy 0, policy_version 241571 (0.0010) [2023-12-27 20:57:54,609][106226] Updated weights for policy 0, policy_version 241581 (0.0010) [2023-12-27 20:57:54,668][106226] Updated weights for policy 0, policy_version 241591 (0.0005) [2023-12-27 20:57:54,688][106225] Updated weights for policy 1, policy_version 241914 (0.0005) [2023-12-27 20:57:54,751][106225] Updated weights for policy 1, policy_version 241924 (0.0005) [2023-12-27 20:57:54,810][106225] Updated weights for policy 1, policy_version 241934 (0.0005) [2023-12-27 20:57:55,279][106226] Updated weights for policy 0, policy_version 241601 (0.0005) [2023-12-27 20:57:55,331][106226] Updated weights for policy 0, policy_version 241611 (0.0008) [2023-12-27 20:57:55,390][106226] Updated weights for policy 0, policy_version 241621 (0.0010) [2023-12-27 20:57:55,452][106225] Updated weights for policy 1, policy_version 241944 (0.0007) [2023-12-27 20:57:55,506][106225] Updated weights for policy 1, policy_version 241954 (0.0006) [2023-12-27 20:57:55,553][106225] Updated weights for policy 1, policy_version 241964 (0.0005) [2023-12-27 20:57:55,995][106226] Updated weights for policy 0, policy_version 241631 (0.0007) [2023-12-27 20:57:56,043][106226] Updated weights for policy 0, policy_version 241641 (0.0005) [2023-12-27 20:57:56,102][106226] Updated weights for policy 0, policy_version 241651 (0.0006) [2023-12-27 20:57:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 123838464. Throughput: 0: 9925.0, 1: 9914.4. Samples: 123803076. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:57:56,176][105115] Avg episode reward: [(0, '-5.241'), (1, '-6.150')] [2023-12-27 20:57:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000241656_61882368.pth... [2023-12-27 20:57:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000241968_61956096.pth... [2023-12-27 20:57:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000240472_61579264.pth [2023-12-27 20:57:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000240848_61669376.pth [2023-12-27 20:57:56,286][106225] Updated weights for policy 1, policy_version 241974 (0.0005) [2023-12-27 20:57:56,351][106225] Updated weights for policy 1, policy_version 241984 (0.0005) [2023-12-27 20:57:56,414][106225] Updated weights for policy 1, policy_version 241994 (0.0006) [2023-12-27 20:57:56,754][106226] Updated weights for policy 0, policy_version 241661 (0.0008) [2023-12-27 20:57:56,807][106226] Updated weights for policy 0, policy_version 241671 (0.0010) [2023-12-27 20:57:56,856][106226] Updated weights for policy 0, policy_version 241681 (0.0010) [2023-12-27 20:57:56,946][106225] Updated weights for policy 1, policy_version 242004 (0.0006) [2023-12-27 20:57:56,990][106225] Updated weights for policy 1, policy_version 242014 (0.0005) [2023-12-27 20:57:57,048][106225] Updated weights for policy 1, policy_version 242024 (0.0007) [2023-12-27 20:57:57,581][106226] Updated weights for policy 0, policy_version 241691 (0.0010) [2023-12-27 20:57:57,643][106226] Updated weights for policy 0, policy_version 241701 (0.0010) [2023-12-27 20:57:57,702][106226] Updated weights for policy 0, policy_version 241711 (0.0010) [2023-12-27 20:57:57,724][106225] Updated weights for policy 1, policy_version 242034 (0.0008) [2023-12-27 20:57:57,780][106225] Updated weights for policy 1, policy_version 242044 (0.0010) [2023-12-27 20:57:57,835][106225] Updated weights for policy 1, policy_version 242054 (0.0010) [2023-12-27 20:57:57,890][106225] Updated weights for policy 1, policy_version 242064 (0.0010) [2023-12-27 20:57:58,395][106226] Updated weights for policy 0, policy_version 241721 (0.0010) [2023-12-27 20:57:58,465][106226] Updated weights for policy 0, policy_version 241731 (0.0008) [2023-12-27 20:57:58,524][106226] Updated weights for policy 0, policy_version 241741 (0.0008) [2023-12-27 20:57:58,562][106225] Updated weights for policy 1, policy_version 242074 (0.0007) [2023-12-27 20:57:58,590][106226] Updated weights for policy 0, policy_version 241751 (0.0008) [2023-12-27 20:57:58,632][106225] Updated weights for policy 1, policy_version 242084 (0.0006) [2023-12-27 20:57:58,698][106225] Updated weights for policy 1, policy_version 242094 (0.0008) [2023-12-27 20:57:59,378][106226] Updated weights for policy 0, policy_version 241761 (0.0008) [2023-12-27 20:57:59,439][106226] Updated weights for policy 0, policy_version 241771 (0.0006) [2023-12-27 20:57:59,487][106226] Updated weights for policy 0, policy_version 241781 (0.0005) [2023-12-27 20:57:59,532][106225] Updated weights for policy 1, policy_version 242104 (0.0008) [2023-12-27 20:57:59,592][106225] Updated weights for policy 1, policy_version 242114 (0.0009) [2023-12-27 20:57:59,652][106225] Updated weights for policy 1, policy_version 242124 (0.0009) [2023-12-27 20:58:00,235][106226] Updated weights for policy 0, policy_version 241791 (0.0008) [2023-12-27 20:58:00,318][106226] Updated weights for policy 0, policy_version 241801 (0.0009) [2023-12-27 20:58:00,369][106226] Updated weights for policy 0, policy_version 241811 (0.0008) [2023-12-27 20:58:00,424][106225] Updated weights for policy 1, policy_version 242134 (0.0007) [2023-12-27 20:58:00,478][106225] Updated weights for policy 1, policy_version 242144 (0.0008) [2023-12-27 20:58:00,539][106225] Updated weights for policy 1, policy_version 242154 (0.0008) [2023-12-27 20:58:01,042][106226] Updated weights for policy 0, policy_version 241821 (0.0007) [2023-12-27 20:58:01,095][106226] Updated weights for policy 0, policy_version 241831 (0.0006) [2023-12-27 20:58:01,150][106226] Updated weights for policy 0, policy_version 241841 (0.0006) [2023-12-27 20:58:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 123928576. Throughput: 0: 9968.4, 1: 9930.5. Samples: 123924520. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:01,175][105115] Avg episode reward: [(0, '-5.052'), (1, '-6.309')] [2023-12-27 20:58:01,214][106225] Updated weights for policy 1, policy_version 242164 (0.0010) [2023-12-27 20:58:01,275][106225] Updated weights for policy 1, policy_version 242174 (0.0008) [2023-12-27 20:58:01,344][106225] Updated weights for policy 1, policy_version 242184 (0.0009) [2023-12-27 20:58:01,860][106226] Updated weights for policy 0, policy_version 241851 (0.0008) [2023-12-27 20:58:01,920][106226] Updated weights for policy 0, policy_version 241861 (0.0007) [2023-12-27 20:58:01,981][106226] Updated weights for policy 0, policy_version 241871 (0.0006) [2023-12-27 20:58:02,130][106225] Updated weights for policy 1, policy_version 242194 (0.0010) [2023-12-27 20:58:02,179][106225] Updated weights for policy 1, policy_version 242204 (0.0010) [2023-12-27 20:58:02,231][106225] Updated weights for policy 1, policy_version 242214 (0.0009) [2023-12-27 20:58:02,308][106225] Updated weights for policy 1, policy_version 242224 (0.0008) [2023-12-27 20:58:02,626][106226] Updated weights for policy 0, policy_version 241881 (0.0007) [2023-12-27 20:58:02,692][106226] Updated weights for policy 0, policy_version 241891 (0.0005) [2023-12-27 20:58:02,754][106226] Updated weights for policy 0, policy_version 241901 (0.0005) [2023-12-27 20:58:02,813][106226] Updated weights for policy 0, policy_version 241911 (0.0005) [2023-12-27 20:58:02,982][106225] Updated weights for policy 1, policy_version 242234 (0.0010) [2023-12-27 20:58:03,046][106225] Updated weights for policy 1, policy_version 242244 (0.0010) [2023-12-27 20:58:03,109][106225] Updated weights for policy 1, policy_version 242254 (0.0010) [2023-12-27 20:58:03,408][106226] Updated weights for policy 0, policy_version 241921 (0.0007) [2023-12-27 20:58:03,473][106226] Updated weights for policy 0, policy_version 241931 (0.0006) [2023-12-27 20:58:03,535][106226] Updated weights for policy 0, policy_version 241941 (0.0005) [2023-12-27 20:58:03,797][106225] Updated weights for policy 1, policy_version 242264 (0.0010) [2023-12-27 20:58:03,863][106225] Updated weights for policy 1, policy_version 242274 (0.0010) [2023-12-27 20:58:03,929][106225] Updated weights for policy 1, policy_version 242284 (0.0009) [2023-12-27 20:58:04,135][106226] Updated weights for policy 0, policy_version 241951 (0.0008) [2023-12-27 20:58:04,197][106226] Updated weights for policy 0, policy_version 241961 (0.0008) [2023-12-27 20:58:04,256][106226] Updated weights for policy 0, policy_version 241971 (0.0008) [2023-12-27 20:58:04,631][106225] Updated weights for policy 1, policy_version 242294 (0.0009) [2023-12-27 20:58:04,691][106225] Updated weights for policy 1, policy_version 242304 (0.0007) [2023-12-27 20:58:04,746][106225] Updated weights for policy 1, policy_version 242314 (0.0009) [2023-12-27 20:58:04,989][106226] Updated weights for policy 0, policy_version 241981 (0.0006) [2023-12-27 20:58:05,044][106226] Updated weights for policy 0, policy_version 241991 (0.0007) [2023-12-27 20:58:05,093][106226] Updated weights for policy 0, policy_version 242001 (0.0010) [2023-12-27 20:58:05,489][106225] Updated weights for policy 1, policy_version 242324 (0.0008) [2023-12-27 20:58:05,549][106225] Updated weights for policy 1, policy_version 242334 (0.0008) [2023-12-27 20:58:05,607][106225] Updated weights for policy 1, policy_version 242344 (0.0007) [2023-12-27 20:58:05,737][106226] Updated weights for policy 0, policy_version 242011 (0.0006) [2023-12-27 20:58:05,795][106226] Updated weights for policy 0, policy_version 242021 (0.0011) [2023-12-27 20:58:05,852][106226] Updated weights for policy 0, policy_version 242031 (0.0010) [2023-12-27 20:58:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 124035072. Throughput: 0: 10029.4, 1: 9908.8. Samples: 124045232. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:06,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-6.279')] [2023-12-27 20:58:06,317][106225] Updated weights for policy 1, policy_version 242354 (0.0007) [2023-12-27 20:58:06,365][106225] Updated weights for policy 1, policy_version 242364 (0.0008) [2023-12-27 20:58:06,425][106225] Updated weights for policy 1, policy_version 242374 (0.0007) [2023-12-27 20:58:06,483][106225] Updated weights for policy 1, policy_version 242384 (0.0006) [2023-12-27 20:58:06,534][106226] Updated weights for policy 0, policy_version 242041 (0.0011) [2023-12-27 20:58:06,592][106226] Updated weights for policy 0, policy_version 242051 (0.0011) [2023-12-27 20:58:06,651][106226] Updated weights for policy 0, policy_version 242061 (0.0011) [2023-12-27 20:58:06,702][106226] Updated weights for policy 0, policy_version 242071 (0.0010) [2023-12-27 20:58:07,163][106225] Updated weights for policy 1, policy_version 242394 (0.0009) [2023-12-27 20:58:07,220][106225] Updated weights for policy 1, policy_version 242404 (0.0009) [2023-12-27 20:58:07,303][106225] Updated weights for policy 1, policy_version 242414 (0.0008) [2023-12-27 20:58:07,354][106226] Updated weights for policy 0, policy_version 242081 (0.0010) [2023-12-27 20:58:07,411][106226] Updated weights for policy 0, policy_version 242091 (0.0008) [2023-12-27 20:58:07,472][106226] Updated weights for policy 0, policy_version 242101 (0.0008) [2023-12-27 20:58:07,929][106225] Updated weights for policy 1, policy_version 242424 (0.0007) [2023-12-27 20:58:07,990][106225] Updated weights for policy 1, policy_version 242434 (0.0008) [2023-12-27 20:58:08,038][106225] Updated weights for policy 1, policy_version 242444 (0.0008) [2023-12-27 20:58:08,104][106226] Updated weights for policy 0, policy_version 242111 (0.0009) [2023-12-27 20:58:08,152][106226] Updated weights for policy 0, policy_version 242121 (0.0009) [2023-12-27 20:58:08,199][106226] Updated weights for policy 0, policy_version 242131 (0.0008) [2023-12-27 20:58:08,732][106225] Updated weights for policy 1, policy_version 242454 (0.0007) [2023-12-27 20:58:08,782][106225] Updated weights for policy 1, policy_version 242464 (0.0008) [2023-12-27 20:58:08,843][106225] Updated weights for policy 1, policy_version 242474 (0.0008) [2023-12-27 20:58:08,925][106226] Updated weights for policy 0, policy_version 242141 (0.0006) [2023-12-27 20:58:08,978][106226] Updated weights for policy 0, policy_version 242151 (0.0006) [2023-12-27 20:58:09,040][106226] Updated weights for policy 0, policy_version 242161 (0.0008) [2023-12-27 20:58:09,564][106225] Updated weights for policy 1, policy_version 242484 (0.0008) [2023-12-27 20:58:09,632][106225] Updated weights for policy 1, policy_version 242494 (0.0009) [2023-12-27 20:58:09,692][106225] Updated weights for policy 1, policy_version 242504 (0.0008) [2023-12-27 20:58:09,825][106226] Updated weights for policy 0, policy_version 242171 (0.0008) [2023-12-27 20:58:09,893][106226] Updated weights for policy 0, policy_version 242181 (0.0007) [2023-12-27 20:58:09,960][106226] Updated weights for policy 0, policy_version 242191 (0.0006) [2023-12-27 20:58:10,415][106225] Updated weights for policy 1, policy_version 242514 (0.0008) [2023-12-27 20:58:10,482][106225] Updated weights for policy 1, policy_version 242524 (0.0008) [2023-12-27 20:58:10,548][106225] Updated weights for policy 1, policy_version 242534 (0.0008) [2023-12-27 20:58:10,600][106225] Updated weights for policy 1, policy_version 242544 (0.0008) [2023-12-27 20:58:10,666][106226] Updated weights for policy 0, policy_version 242201 (0.0006) [2023-12-27 20:58:10,716][106226] Updated weights for policy 0, policy_version 242211 (0.0009) [2023-12-27 20:58:10,760][106226] Updated weights for policy 0, policy_version 242221 (0.0008) [2023-12-27 20:58:10,826][106226] Updated weights for policy 0, policy_version 242231 (0.0009) [2023-12-27 20:58:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 124133376. Throughput: 0: 10071.7, 1: 9936.4. Samples: 124106332. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:11,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-6.545')] [2023-12-27 20:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000242544_62103552.pth... [2023-12-27 20:58:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000242232_62029824.pth... [2023-12-27 20:58:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000241424_61816832.pth [2023-12-27 20:58:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000241080_61734912.pth [2023-12-27 20:58:11,317][106225] Updated weights for policy 1, policy_version 242554 (0.0010) [2023-12-27 20:58:11,400][106225] Updated weights for policy 1, policy_version 242564 (0.0010) [2023-12-27 20:58:11,464][106225] Updated weights for policy 1, policy_version 242574 (0.0008) [2023-12-27 20:58:11,588][106226] Updated weights for policy 0, policy_version 242241 (0.0008) [2023-12-27 20:58:11,661][106226] Updated weights for policy 0, policy_version 242251 (0.0009) [2023-12-27 20:58:11,724][106226] Updated weights for policy 0, policy_version 242261 (0.0009) [2023-12-27 20:58:12,246][106225] Updated weights for policy 1, policy_version 242584 (0.0009) [2023-12-27 20:58:12,308][106225] Updated weights for policy 1, policy_version 242594 (0.0008) [2023-12-27 20:58:12,379][106225] Updated weights for policy 1, policy_version 242604 (0.0008) [2023-12-27 20:58:12,482][106226] Updated weights for policy 0, policy_version 242271 (0.0009) [2023-12-27 20:58:12,541][106226] Updated weights for policy 0, policy_version 242281 (0.0009) [2023-12-27 20:58:12,600][106226] Updated weights for policy 0, policy_version 242291 (0.0008) [2023-12-27 20:58:12,994][106225] Updated weights for policy 1, policy_version 242614 (0.0006) [2023-12-27 20:58:13,041][106225] Updated weights for policy 1, policy_version 242624 (0.0006) [2023-12-27 20:58:13,090][106225] Updated weights for policy 1, policy_version 242634 (0.0008) [2023-12-27 20:58:13,225][106226] Updated weights for policy 0, policy_version 242301 (0.0007) [2023-12-27 20:58:13,281][106226] Updated weights for policy 0, policy_version 242311 (0.0005) [2023-12-27 20:58:13,337][106226] Updated weights for policy 0, policy_version 242321 (0.0005) [2023-12-27 20:58:13,719][106225] Updated weights for policy 1, policy_version 242644 (0.0007) [2023-12-27 20:58:13,766][106225] Updated weights for policy 1, policy_version 242654 (0.0005) [2023-12-27 20:58:13,814][106225] Updated weights for policy 1, policy_version 242664 (0.0005) [2023-12-27 20:58:13,847][106226] Updated weights for policy 0, policy_version 242331 (0.0005) [2023-12-27 20:58:13,912][106226] Updated weights for policy 0, policy_version 242341 (0.0005) [2023-12-27 20:58:13,972][106226] Updated weights for policy 0, policy_version 242351 (0.0008) [2023-12-27 20:58:14,370][106225] Updated weights for policy 1, policy_version 242674 (0.0006) [2023-12-27 20:58:14,431][106225] Updated weights for policy 1, policy_version 242684 (0.0008) [2023-12-27 20:58:14,489][106225] Updated weights for policy 1, policy_version 242694 (0.0009) [2023-12-27 20:58:14,551][106225] Updated weights for policy 1, policy_version 242704 (0.0008) [2023-12-27 20:58:14,711][106226] Updated weights for policy 0, policy_version 242361 (0.0007) [2023-12-27 20:58:14,769][106226] Updated weights for policy 0, policy_version 242371 (0.0008) [2023-12-27 20:58:14,831][106226] Updated weights for policy 0, policy_version 242381 (0.0009) [2023-12-27 20:58:14,888][106226] Updated weights for policy 0, policy_version 242391 (0.0006) [2023-12-27 20:58:15,291][106225] Updated weights for policy 1, policy_version 242714 (0.0011) [2023-12-27 20:58:15,349][106225] Updated weights for policy 1, policy_version 242724 (0.0010) [2023-12-27 20:58:15,415][106225] Updated weights for policy 1, policy_version 242734 (0.0007) [2023-12-27 20:58:15,545][106226] Updated weights for policy 0, policy_version 242401 (0.0005) [2023-12-27 20:58:15,603][106226] Updated weights for policy 0, policy_version 242411 (0.0005) [2023-12-27 20:58:15,652][106226] Updated weights for policy 0, policy_version 242421 (0.0005) [2023-12-27 20:58:16,116][106225] Updated weights for policy 1, policy_version 242744 (0.0010) [2023-12-27 20:58:16,167][106225] Updated weights for policy 1, policy_version 242754 (0.0010) [2023-12-27 20:58:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 124231680. Throughput: 0: 9997.4, 1: 9795.1. Samples: 124226508. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:16,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-6.393')] [2023-12-27 20:58:16,199][106226] Updated weights for policy 0, policy_version 242431 (0.0006) [2023-12-27 20:58:16,230][106225] Updated weights for policy 1, policy_version 242764 (0.0006) [2023-12-27 20:58:16,256][106226] Updated weights for policy 0, policy_version 242441 (0.0006) [2023-12-27 20:58:16,309][106226] Updated weights for policy 0, policy_version 242451 (0.0009) [2023-12-27 20:58:16,913][106225] Updated weights for policy 1, policy_version 242774 (0.0009) [2023-12-27 20:58:16,941][106226] Updated weights for policy 0, policy_version 242461 (0.0008) [2023-12-27 20:58:16,973][106225] Updated weights for policy 1, policy_version 242784 (0.0011) [2023-12-27 20:58:17,004][106226] Updated weights for policy 0, policy_version 242471 (0.0009) [2023-12-27 20:58:17,034][106225] Updated weights for policy 1, policy_version 242794 (0.0010) [2023-12-27 20:58:17,060][106226] Updated weights for policy 0, policy_version 242481 (0.0008) [2023-12-27 20:58:17,704][106225] Updated weights for policy 1, policy_version 242804 (0.0008) [2023-12-27 20:58:17,764][106225] Updated weights for policy 1, policy_version 242814 (0.0005) [2023-12-27 20:58:17,812][106225] Updated weights for policy 1, policy_version 242824 (0.0009) [2023-12-27 20:58:17,837][106226] Updated weights for policy 0, policy_version 242491 (0.0008) [2023-12-27 20:58:17,905][106226] Updated weights for policy 0, policy_version 242501 (0.0009) [2023-12-27 20:58:17,958][106226] Updated weights for policy 0, policy_version 242511 (0.0009) [2023-12-27 20:58:18,482][106225] Updated weights for policy 1, policy_version 242834 (0.0008) [2023-12-27 20:58:18,542][106225] Updated weights for policy 1, policy_version 242844 (0.0009) [2023-12-27 20:58:18,594][106225] Updated weights for policy 1, policy_version 242854 (0.0008) [2023-12-27 20:58:18,653][106225] Updated weights for policy 1, policy_version 242864 (0.0008) [2023-12-27 20:58:18,673][106226] Updated weights for policy 0, policy_version 242521 (0.0006) [2023-12-27 20:58:18,740][106226] Updated weights for policy 0, policy_version 242531 (0.0009) [2023-12-27 20:58:18,802][106226] Updated weights for policy 0, policy_version 242541 (0.0008) [2023-12-27 20:58:18,865][106226] Updated weights for policy 0, policy_version 242551 (0.0009) [2023-12-27 20:58:19,397][106225] Updated weights for policy 1, policy_version 242874 (0.0009) [2023-12-27 20:58:19,456][106225] Updated weights for policy 1, policy_version 242884 (0.0008) [2023-12-27 20:58:19,524][106225] Updated weights for policy 1, policy_version 242894 (0.0008) [2023-12-27 20:58:19,608][106226] Updated weights for policy 0, policy_version 242561 (0.0008) [2023-12-27 20:58:19,664][106226] Updated weights for policy 0, policy_version 242571 (0.0006) [2023-12-27 20:58:19,717][106226] Updated weights for policy 0, policy_version 242581 (0.0005) [2023-12-27 20:58:20,320][106225] Updated weights for policy 1, policy_version 242904 (0.0010) [2023-12-27 20:58:20,370][106226] Updated weights for policy 0, policy_version 242591 (0.0008) [2023-12-27 20:58:20,386][106225] Updated weights for policy 1, policy_version 242914 (0.0011) [2023-12-27 20:58:20,437][106226] Updated weights for policy 0, policy_version 242601 (0.0006) [2023-12-27 20:58:20,459][106225] Updated weights for policy 1, policy_version 242924 (0.0009) [2023-12-27 20:58:20,505][106226] Updated weights for policy 0, policy_version 242611 (0.0011) [2023-12-27 20:58:21,166][106225] Updated weights for policy 1, policy_version 242934 (0.0008) [2023-12-27 20:58:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 124329984. Throughput: 0: 10003.9, 1: 9797.1. Samples: 124344472. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:21,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-6.325')] [2023-12-27 20:58:21,219][106226] Updated weights for policy 0, policy_version 242621 (0.0009) [2023-12-27 20:58:21,226][106225] Updated weights for policy 1, policy_version 242944 (0.0007) [2023-12-27 20:58:21,281][106226] Updated weights for policy 0, policy_version 242631 (0.0009) [2023-12-27 20:58:21,294][106225] Updated weights for policy 1, policy_version 242954 (0.0007) [2023-12-27 20:58:21,350][106226] Updated weights for policy 0, policy_version 242641 (0.0007) [2023-12-27 20:58:22,085][106225] Updated weights for policy 1, policy_version 242964 (0.0008) [2023-12-27 20:58:22,135][106225] Updated weights for policy 1, policy_version 242974 (0.0009) [2023-12-27 20:58:22,187][106226] Updated weights for policy 0, policy_version 242651 (0.0009) [2023-12-27 20:58:22,197][106225] Updated weights for policy 1, policy_version 242984 (0.0008) [2023-12-27 20:58:22,249][106226] Updated weights for policy 0, policy_version 242661 (0.0008) [2023-12-27 20:58:22,320][106226] Updated weights for policy 0, policy_version 242671 (0.0009) [2023-12-27 20:58:22,845][106225] Updated weights for policy 1, policy_version 242994 (0.0007) [2023-12-27 20:58:22,911][106225] Updated weights for policy 1, policy_version 243004 (0.0005) [2023-12-27 20:58:22,970][106225] Updated weights for policy 1, policy_version 243014 (0.0007) [2023-12-27 20:58:23,033][106225] Updated weights for policy 1, policy_version 243024 (0.0008) [2023-12-27 20:58:23,157][106226] Updated weights for policy 0, policy_version 242681 (0.0008) [2023-12-27 20:58:23,221][106226] Updated weights for policy 0, policy_version 242691 (0.0009) [2023-12-27 20:58:23,276][106226] Updated weights for policy 0, policy_version 242701 (0.0008) [2023-12-27 20:58:23,347][106226] Updated weights for policy 0, policy_version 242711 (0.0009) [2023-12-27 20:58:23,732][106225] Updated weights for policy 1, policy_version 243034 (0.0009) [2023-12-27 20:58:23,781][106225] Updated weights for policy 1, policy_version 243044 (0.0008) [2023-12-27 20:58:23,833][106225] Updated weights for policy 1, policy_version 243054 (0.0009) [2023-12-27 20:58:23,937][106226] Updated weights for policy 0, policy_version 242721 (0.0009) [2023-12-27 20:58:23,985][106226] Updated weights for policy 0, policy_version 242731 (0.0008) [2023-12-27 20:58:24,041][106226] Updated weights for policy 0, policy_version 242741 (0.0008) [2023-12-27 20:58:24,578][106225] Updated weights for policy 1, policy_version 243064 (0.0009) [2023-12-27 20:58:24,629][106225] Updated weights for policy 1, policy_version 243075 (0.0009) [2023-12-27 20:58:24,682][106225] Updated weights for policy 1, policy_version 243085 (0.0010) [2023-12-27 20:58:24,698][106226] Updated weights for policy 0, policy_version 242751 (0.0007) [2023-12-27 20:58:24,753][106226] Updated weights for policy 0, policy_version 242761 (0.0005) [2023-12-27 20:58:24,820][106226] Updated weights for policy 0, policy_version 242771 (0.0005) [2023-12-27 20:58:25,428][106225] Updated weights for policy 1, policy_version 243095 (0.0009) [2023-12-27 20:58:25,433][106226] Updated weights for policy 0, policy_version 242781 (0.0006) [2023-12-27 20:58:25,474][106225] Updated weights for policy 1, policy_version 243105 (0.0010) [2023-12-27 20:58:25,484][106226] Updated weights for policy 0, policy_version 242791 (0.0006) [2023-12-27 20:58:25,525][106225] Updated weights for policy 1, policy_version 243115 (0.0010) [2023-12-27 20:58:25,542][106226] Updated weights for policy 0, policy_version 242801 (0.0007) [2023-12-27 20:58:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 124428288. Throughput: 0: 9948.3, 1: 9795.8. Samples: 124401268. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:26,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-6.427')] [2023-12-27 20:58:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000242808_62177280.pth... [2023-12-27 20:58:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000241656_61882368.pth [2023-12-27 20:58:26,191][106225] Updated weights for policy 1, policy_version 243125 (0.0008) [2023-12-27 20:58:26,212][106226] Updated weights for policy 0, policy_version 242811 (0.0007) [2023-12-27 20:58:26,252][106225] Updated weights for policy 1, policy_version 243135 (0.0005) [2023-12-27 20:58:26,273][106226] Updated weights for policy 0, policy_version 242821 (0.0008) [2023-12-27 20:58:26,315][106225] Updated weights for policy 1, policy_version 243145 (0.0005) [2023-12-27 20:58:26,324][106226] Updated weights for policy 0, policy_version 242831 (0.0009) [2023-12-27 20:58:26,354][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000243152_62259200.pth... [2023-12-27 20:58:26,358][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000241968_61956096.pth [2023-12-27 20:58:26,955][106225] Updated weights for policy 1, policy_version 243155 (0.0007) [2023-12-27 20:58:26,983][106226] Updated weights for policy 0, policy_version 242841 (0.0010) [2023-12-27 20:58:27,005][106225] Updated weights for policy 1, policy_version 243165 (0.0009) [2023-12-27 20:58:27,038][106226] Updated weights for policy 0, policy_version 242851 (0.0005) [2023-12-27 20:58:27,053][106225] Updated weights for policy 1, policy_version 243175 (0.0007) [2023-12-27 20:58:27,087][106226] Updated weights for policy 0, policy_version 242861 (0.0005) [2023-12-27 20:58:27,143][106226] Updated weights for policy 0, policy_version 242871 (0.0005) [2023-12-27 20:58:27,721][106225] Updated weights for policy 1, policy_version 243185 (0.0008) [2023-12-27 20:58:27,765][106225] Updated weights for policy 1, policy_version 243195 (0.0007) [2023-12-27 20:58:27,771][106226] Updated weights for policy 0, policy_version 242881 (0.0005) [2023-12-27 20:58:27,822][106225] Updated weights for policy 1, policy_version 243205 (0.0005) [2023-12-27 20:58:27,829][106226] Updated weights for policy 0, policy_version 242891 (0.0005) [2023-12-27 20:58:27,880][106226] Updated weights for policy 0, policy_version 242901 (0.0005) [2023-12-27 20:58:27,881][106225] Updated weights for policy 1, policy_version 243215 (0.0006) [2023-12-27 20:58:28,530][106226] Updated weights for policy 0, policy_version 242911 (0.0005) [2023-12-27 20:58:28,558][106225] Updated weights for policy 1, policy_version 243225 (0.0008) [2023-12-27 20:58:28,591][106226] Updated weights for policy 0, policy_version 242921 (0.0007) [2023-12-27 20:58:28,614][106225] Updated weights for policy 1, policy_version 243235 (0.0008) [2023-12-27 20:58:28,646][106226] Updated weights for policy 0, policy_version 242931 (0.0010) [2023-12-27 20:58:28,664][106225] Updated weights for policy 1, policy_version 243245 (0.0008) [2023-12-27 20:58:29,269][106225] Updated weights for policy 1, policy_version 243255 (0.0007) [2023-12-27 20:58:29,334][106225] Updated weights for policy 1, policy_version 243265 (0.0008) [2023-12-27 20:58:29,397][106226] Updated weights for policy 0, policy_version 242941 (0.0007) [2023-12-27 20:58:29,407][106225] Updated weights for policy 1, policy_version 243275 (0.0008) [2023-12-27 20:58:29,458][106226] Updated weights for policy 0, policy_version 242951 (0.0007) [2023-12-27 20:58:29,515][106226] Updated weights for policy 0, policy_version 242961 (0.0007) [2023-12-27 20:58:30,121][106225] Updated weights for policy 1, policy_version 243285 (0.0009) [2023-12-27 20:58:30,172][106225] Updated weights for policy 1, policy_version 243295 (0.0010) [2023-12-27 20:58:30,223][106225] Updated weights for policy 1, policy_version 243305 (0.0010) [2023-12-27 20:58:30,249][106226] Updated weights for policy 0, policy_version 242971 (0.0008) [2023-12-27 20:58:30,305][106226] Updated weights for policy 0, policy_version 242981 (0.0008) [2023-12-27 20:58:30,363][106226] Updated weights for policy 0, policy_version 242991 (0.0008) [2023-12-27 20:58:30,985][106226] Updated weights for policy 0, policy_version 243001 (0.0008) [2023-12-27 20:58:30,990][106225] Updated weights for policy 1, policy_version 243315 (0.0010) [2023-12-27 20:58:31,048][106226] Updated weights for policy 0, policy_version 243011 (0.0007) [2023-12-27 20:58:31,053][106225] Updated weights for policy 1, policy_version 243325 (0.0008) [2023-12-27 20:58:31,113][106226] Updated weights for policy 0, policy_version 243021 (0.0006) [2023-12-27 20:58:31,122][106225] Updated weights for policy 1, policy_version 243335 (0.0008) [2023-12-27 20:58:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 124526592. Throughput: 0: 9963.1, 1: 9932.3. Samples: 124524708. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:31,175][105115] Avg episode reward: [(0, '-4.991'), (1, '-6.193')] [2023-12-27 20:58:31,181][106226] Updated weights for policy 0, policy_version 243031 (0.0007) [2023-12-27 20:58:31,782][106225] Updated weights for policy 1, policy_version 243345 (0.0008) [2023-12-27 20:58:31,846][106225] Updated weights for policy 1, policy_version 243355 (0.0005) [2023-12-27 20:58:31,906][106225] Updated weights for policy 1, policy_version 243365 (0.0007) [2023-12-27 20:58:31,934][106226] Updated weights for policy 0, policy_version 243041 (0.0007) [2023-12-27 20:58:31,968][106225] Updated weights for policy 1, policy_version 243375 (0.0007) [2023-12-27 20:58:31,992][106226] Updated weights for policy 0, policy_version 243051 (0.0008) [2023-12-27 20:58:32,054][106226] Updated weights for policy 0, policy_version 243061 (0.0009) [2023-12-27 20:58:32,612][106225] Updated weights for policy 1, policy_version 243385 (0.0007) [2023-12-27 20:58:32,659][106225] Updated weights for policy 1, policy_version 243395 (0.0008) [2023-12-27 20:58:32,702][106225] Updated weights for policy 1, policy_version 243405 (0.0008) [2023-12-27 20:58:32,797][106226] Updated weights for policy 0, policy_version 243071 (0.0010) [2023-12-27 20:58:32,856][106226] Updated weights for policy 0, policy_version 243081 (0.0010) [2023-12-27 20:58:32,919][106226] Updated weights for policy 0, policy_version 243091 (0.0011) [2023-12-27 20:58:33,375][106225] Updated weights for policy 1, policy_version 243415 (0.0006) [2023-12-27 20:58:33,432][106225] Updated weights for policy 1, policy_version 243425 (0.0005) [2023-12-27 20:58:33,489][106225] Updated weights for policy 1, policy_version 243435 (0.0009) [2023-12-27 20:58:33,509][106226] Updated weights for policy 0, policy_version 243101 (0.0008) [2023-12-27 20:58:33,575][106226] Updated weights for policy 0, policy_version 243111 (0.0006) [2023-12-27 20:58:33,641][106226] Updated weights for policy 0, policy_version 243121 (0.0005) [2023-12-27 20:58:34,042][106225] Updated weights for policy 1, policy_version 243445 (0.0008) [2023-12-27 20:58:34,104][106225] Updated weights for policy 1, policy_version 243455 (0.0010) [2023-12-27 20:58:34,169][106225] Updated weights for policy 1, policy_version 243465 (0.0010) [2023-12-27 20:58:34,236][106226] Updated weights for policy 0, policy_version 243131 (0.0010) [2023-12-27 20:58:34,290][106226] Updated weights for policy 0, policy_version 243141 (0.0006) [2023-12-27 20:58:34,352][106226] Updated weights for policy 0, policy_version 243151 (0.0005) [2023-12-27 20:58:34,828][106225] Updated weights for policy 1, policy_version 243475 (0.0009) [2023-12-27 20:58:34,895][106225] Updated weights for policy 1, policy_version 243485 (0.0006) [2023-12-27 20:58:34,954][106225] Updated weights for policy 1, policy_version 243495 (0.0005) [2023-12-27 20:58:35,035][106226] Updated weights for policy 0, policy_version 243161 (0.0009) [2023-12-27 20:58:35,096][106226] Updated weights for policy 0, policy_version 243171 (0.0011) [2023-12-27 20:58:35,158][106226] Updated weights for policy 0, policy_version 243181 (0.0007) [2023-12-27 20:58:35,225][106226] Updated weights for policy 0, policy_version 243191 (0.0005) [2023-12-27 20:58:35,522][106225] Updated weights for policy 1, policy_version 243505 (0.0008) [2023-12-27 20:58:35,587][106225] Updated weights for policy 1, policy_version 243515 (0.0006) [2023-12-27 20:58:35,649][106225] Updated weights for policy 1, policy_version 243525 (0.0005) [2023-12-27 20:58:35,707][106225] Updated weights for policy 1, policy_version 243535 (0.0009) [2023-12-27 20:58:35,886][106226] Updated weights for policy 0, policy_version 243201 (0.0010) [2023-12-27 20:58:35,938][106226] Updated weights for policy 0, policy_version 243211 (0.0010) [2023-12-27 20:58:35,991][106226] Updated weights for policy 0, policy_version 243221 (0.0010) [2023-12-27 20:58:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 124641280. Throughput: 0: 10046.4, 1: 10046.2. Samples: 124649256. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:36,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-6.217')] [2023-12-27 20:58:36,343][106225] Updated weights for policy 1, policy_version 243545 (0.0009) [2023-12-27 20:58:36,392][106225] Updated weights for policy 1, policy_version 243555 (0.0009) [2023-12-27 20:58:36,454][106225] Updated weights for policy 1, policy_version 243565 (0.0007) [2023-12-27 20:58:36,723][106226] Updated weights for policy 0, policy_version 243231 (0.0009) [2023-12-27 20:58:36,784][106226] Updated weights for policy 0, policy_version 243241 (0.0008) [2023-12-27 20:58:36,833][106226] Updated weights for policy 0, policy_version 243251 (0.0009) [2023-12-27 20:58:37,197][106225] Updated weights for policy 1, policy_version 243575 (0.0009) [2023-12-27 20:58:37,249][106225] Updated weights for policy 1, policy_version 243585 (0.0007) [2023-12-27 20:58:37,305][106225] Updated weights for policy 1, policy_version 243595 (0.0008) [2023-12-27 20:58:37,551][106226] Updated weights for policy 0, policy_version 243261 (0.0009) [2023-12-27 20:58:37,610][106226] Updated weights for policy 0, policy_version 243271 (0.0008) [2023-12-27 20:58:37,663][106226] Updated weights for policy 0, policy_version 243281 (0.0007) [2023-12-27 20:58:38,047][106225] Updated weights for policy 1, policy_version 243605 (0.0008) [2023-12-27 20:58:38,098][106225] Updated weights for policy 1, policy_version 243615 (0.0008) [2023-12-27 20:58:38,159][106225] Updated weights for policy 1, policy_version 243625 (0.0008) [2023-12-27 20:58:38,321][106226] Updated weights for policy 0, policy_version 243291 (0.0008) [2023-12-27 20:58:38,392][106226] Updated weights for policy 0, policy_version 243301 (0.0009) [2023-12-27 20:58:38,452][106226] Updated weights for policy 0, policy_version 243311 (0.0009) [2023-12-27 20:58:38,944][106225] Updated weights for policy 1, policy_version 243635 (0.0009) [2023-12-27 20:58:38,991][106225] Updated weights for policy 1, policy_version 243645 (0.0007) [2023-12-27 20:58:39,040][106225] Updated weights for policy 1, policy_version 243655 (0.0008) [2023-12-27 20:58:39,138][106226] Updated weights for policy 0, policy_version 243321 (0.0009) [2023-12-27 20:58:39,209][106226] Updated weights for policy 0, policy_version 243331 (0.0010) [2023-12-27 20:58:39,284][106226] Updated weights for policy 0, policy_version 243341 (0.0008) [2023-12-27 20:58:39,352][106226] Updated weights for policy 0, policy_version 243351 (0.0008) [2023-12-27 20:58:39,794][106225] Updated weights for policy 1, policy_version 243665 (0.0008) [2023-12-27 20:58:39,858][106225] Updated weights for policy 1, policy_version 243675 (0.0008) [2023-12-27 20:58:39,924][106225] Updated weights for policy 1, policy_version 243685 (0.0008) [2023-12-27 20:58:39,995][106225] Updated weights for policy 1, policy_version 243695 (0.0008) [2023-12-27 20:58:40,093][106226] Updated weights for policy 0, policy_version 243361 (0.0009) [2023-12-27 20:58:40,154][106226] Updated weights for policy 0, policy_version 243371 (0.0009) [2023-12-27 20:58:40,215][106226] Updated weights for policy 0, policy_version 243381 (0.0008) [2023-12-27 20:58:40,682][106225] Updated weights for policy 1, policy_version 243705 (0.0009) [2023-12-27 20:58:40,750][106225] Updated weights for policy 1, policy_version 243715 (0.0008) [2023-12-27 20:58:40,814][106225] Updated weights for policy 1, policy_version 243725 (0.0008) [2023-12-27 20:58:40,972][106226] Updated weights for policy 0, policy_version 243391 (0.0006) [2023-12-27 20:58:41,037][106226] Updated weights for policy 0, policy_version 243401 (0.0009) [2023-12-27 20:58:41,096][106226] Updated weights for policy 0, policy_version 243411 (0.0008) [2023-12-27 20:58:41,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 124739584. Throughput: 0: 10087.4, 1: 10018.0. Samples: 124707812. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:41,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-6.022')] [2023-12-27 20:58:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000243728_62406656.pth... [2023-12-27 20:58:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000243416_62332928.pth... [2023-12-27 20:58:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000242232_62029824.pth [2023-12-27 20:58:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000242544_62103552.pth [2023-12-27 20:58:41,613][106225] Updated weights for policy 1, policy_version 243735 (0.0008) [2023-12-27 20:58:41,668][106225] Updated weights for policy 1, policy_version 243745 (0.0008) [2023-12-27 20:58:41,727][106225] Updated weights for policy 1, policy_version 243755 (0.0008) [2023-12-27 20:58:41,879][106226] Updated weights for policy 0, policy_version 243421 (0.0008) [2023-12-27 20:58:41,938][106226] Updated weights for policy 0, policy_version 243431 (0.0008) [2023-12-27 20:58:42,001][106226] Updated weights for policy 0, policy_version 243441 (0.0008) [2023-12-27 20:58:42,491][106225] Updated weights for policy 1, policy_version 243765 (0.0008) [2023-12-27 20:58:42,554][106225] Updated weights for policy 1, policy_version 243775 (0.0008) [2023-12-27 20:58:42,617][106225] Updated weights for policy 1, policy_version 243785 (0.0008) [2023-12-27 20:58:42,755][106226] Updated weights for policy 0, policy_version 243451 (0.0008) [2023-12-27 20:58:42,819][106226] Updated weights for policy 0, policy_version 243461 (0.0005) [2023-12-27 20:58:42,878][106226] Updated weights for policy 0, policy_version 243471 (0.0005) [2023-12-27 20:58:43,325][106225] Updated weights for policy 1, policy_version 243795 (0.0008) [2023-12-27 20:58:43,396][106225] Updated weights for policy 1, policy_version 243805 (0.0008) [2023-12-27 20:58:43,461][106225] Updated weights for policy 1, policy_version 243815 (0.0008) [2023-12-27 20:58:43,509][106226] Updated weights for policy 0, policy_version 243481 (0.0005) [2023-12-27 20:58:43,565][106226] Updated weights for policy 0, policy_version 243491 (0.0009) [2023-12-27 20:58:43,619][106226] Updated weights for policy 0, policy_version 243501 (0.0008) [2023-12-27 20:58:43,673][106226] Updated weights for policy 0, policy_version 243511 (0.0008) [2023-12-27 20:58:44,136][106225] Updated weights for policy 1, policy_version 243825 (0.0009) [2023-12-27 20:58:44,190][106225] Updated weights for policy 1, policy_version 243835 (0.0010) [2023-12-27 20:58:44,239][106225] Updated weights for policy 1, policy_version 243845 (0.0010) [2023-12-27 20:58:44,293][106225] Updated weights for policy 1, policy_version 243855 (0.0010) [2023-12-27 20:58:44,413][106226] Updated weights for policy 0, policy_version 243521 (0.0008) [2023-12-27 20:58:44,481][106226] Updated weights for policy 0, policy_version 243531 (0.0008) [2023-12-27 20:58:44,538][106226] Updated weights for policy 0, policy_version 243541 (0.0008) [2023-12-27 20:58:45,057][106225] Updated weights for policy 1, policy_version 243865 (0.0007) [2023-12-27 20:58:45,116][106225] Updated weights for policy 1, policy_version 243875 (0.0008) [2023-12-27 20:58:45,178][106225] Updated weights for policy 1, policy_version 243885 (0.0011) [2023-12-27 20:58:45,272][106226] Updated weights for policy 0, policy_version 243551 (0.0007) [2023-12-27 20:58:45,328][106226] Updated weights for policy 0, policy_version 243561 (0.0007) [2023-12-27 20:58:45,384][106226] Updated weights for policy 0, policy_version 243571 (0.0007) [2023-12-27 20:58:45,897][106225] Updated weights for policy 1, policy_version 243895 (0.0007) [2023-12-27 20:58:45,954][106225] Updated weights for policy 1, policy_version 243905 (0.0005) [2023-12-27 20:58:46,005][106225] Updated weights for policy 1, policy_version 243915 (0.0005) [2023-12-27 20:58:46,091][106226] Updated weights for policy 0, policy_version 243581 (0.0009) [2023-12-27 20:58:46,152][106226] Updated weights for policy 0, policy_version 243591 (0.0009) [2023-12-27 20:58:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 124829696. Throughput: 0: 10000.8, 1: 9925.6. Samples: 124821208. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:46,175][105115] Avg episode reward: [(0, '-5.198'), (1, '-6.298')] [2023-12-27 20:58:46,205][106226] Updated weights for policy 0, policy_version 243601 (0.0009) [2023-12-27 20:58:46,583][106225] Updated weights for policy 1, policy_version 243925 (0.0008) [2023-12-27 20:58:46,650][106225] Updated weights for policy 1, policy_version 243935 (0.0011) [2023-12-27 20:58:46,708][106225] Updated weights for policy 1, policy_version 243945 (0.0010) [2023-12-27 20:58:46,957][106226] Updated weights for policy 0, policy_version 243611 (0.0009) [2023-12-27 20:58:47,025][106226] Updated weights for policy 0, policy_version 243621 (0.0007) [2023-12-27 20:58:47,086][106226] Updated weights for policy 0, policy_version 243631 (0.0009) [2023-12-27 20:58:47,282][106225] Updated weights for policy 1, policy_version 243955 (0.0006) [2023-12-27 20:58:47,351][106225] Updated weights for policy 1, policy_version 243965 (0.0005) [2023-12-27 20:58:47,423][106225] Updated weights for policy 1, policy_version 243975 (0.0009) [2023-12-27 20:58:47,684][106226] Updated weights for policy 0, policy_version 243641 (0.0008) [2023-12-27 20:58:47,744][106226] Updated weights for policy 0, policy_version 243651 (0.0006) [2023-12-27 20:58:47,804][106226] Updated weights for policy 0, policy_version 243661 (0.0008) [2023-12-27 20:58:47,861][106226] Updated weights for policy 0, policy_version 243671 (0.0008) [2023-12-27 20:58:47,996][106225] Updated weights for policy 1, policy_version 243985 (0.0010) [2023-12-27 20:58:48,046][106225] Updated weights for policy 1, policy_version 243995 (0.0009) [2023-12-27 20:58:48,096][106225] Updated weights for policy 1, policy_version 244005 (0.0009) [2023-12-27 20:58:48,158][106225] Updated weights for policy 1, policy_version 244015 (0.0010) [2023-12-27 20:58:48,501][106226] Updated weights for policy 0, policy_version 243681 (0.0009) [2023-12-27 20:58:48,564][106226] Updated weights for policy 0, policy_version 243691 (0.0009) [2023-12-27 20:58:48,627][106226] Updated weights for policy 0, policy_version 243701 (0.0009) [2023-12-27 20:58:48,929][106225] Updated weights for policy 1, policy_version 244025 (0.0008) [2023-12-27 20:58:48,988][106225] Updated weights for policy 1, policy_version 244035 (0.0008) [2023-12-27 20:58:49,044][106225] Updated weights for policy 1, policy_version 244045 (0.0008) [2023-12-27 20:58:49,390][106226] Updated weights for policy 0, policy_version 243711 (0.0008) [2023-12-27 20:58:49,441][106226] Updated weights for policy 0, policy_version 243721 (0.0008) [2023-12-27 20:58:49,492][106226] Updated weights for policy 0, policy_version 243731 (0.0008) [2023-12-27 20:58:49,833][106225] Updated weights for policy 1, policy_version 244055 (0.0009) [2023-12-27 20:58:49,895][106225] Updated weights for policy 1, policy_version 244065 (0.0009) [2023-12-27 20:58:49,957][106225] Updated weights for policy 1, policy_version 244075 (0.0008) [2023-12-27 20:58:50,247][106226] Updated weights for policy 0, policy_version 243741 (0.0009) [2023-12-27 20:58:50,299][106226] Updated weights for policy 0, policy_version 243751 (0.0008) [2023-12-27 20:58:50,360][106226] Updated weights for policy 0, policy_version 243761 (0.0008) [2023-12-27 20:58:50,604][106225] Updated weights for policy 1, policy_version 244085 (0.0006) [2023-12-27 20:58:50,667][106225] Updated weights for policy 1, policy_version 244095 (0.0006) [2023-12-27 20:58:50,726][106225] Updated weights for policy 1, policy_version 244105 (0.0009) [2023-12-27 20:58:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 124928000. Throughput: 0: 9910.3, 1: 9987.7. Samples: 124940644. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:51,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-6.323')] [2023-12-27 20:58:51,192][106226] Updated weights for policy 0, policy_version 243771 (0.0009) [2023-12-27 20:58:51,263][106226] Updated weights for policy 0, policy_version 243781 (0.0009) [2023-12-27 20:58:51,330][106226] Updated weights for policy 0, policy_version 243791 (0.0009) [2023-12-27 20:58:51,451][106225] Updated weights for policy 1, policy_version 244115 (0.0008) [2023-12-27 20:58:51,517][106225] Updated weights for policy 1, policy_version 244125 (0.0006) [2023-12-27 20:58:51,584][106225] Updated weights for policy 1, policy_version 244135 (0.0006) [2023-12-27 20:58:52,020][106226] Updated weights for policy 0, policy_version 243801 (0.0009) [2023-12-27 20:58:52,072][106226] Updated weights for policy 0, policy_version 243811 (0.0005) [2023-12-27 20:58:52,129][106226] Updated weights for policy 0, policy_version 243821 (0.0008) [2023-12-27 20:58:52,196][106226] Updated weights for policy 0, policy_version 243831 (0.0008) [2023-12-27 20:58:52,348][106225] Updated weights for policy 1, policy_version 244145 (0.0009) [2023-12-27 20:58:52,419][106225] Updated weights for policy 1, policy_version 244155 (0.0009) [2023-12-27 20:58:52,490][106225] Updated weights for policy 1, policy_version 244165 (0.0009) [2023-12-27 20:58:52,540][106225] Updated weights for policy 1, policy_version 244175 (0.0009) [2023-12-27 20:58:52,866][106226] Updated weights for policy 0, policy_version 243841 (0.0006) [2023-12-27 20:58:52,929][106226] Updated weights for policy 0, policy_version 243851 (0.0006) [2023-12-27 20:58:52,988][106226] Updated weights for policy 0, policy_version 243861 (0.0005) [2023-12-27 20:58:53,303][106225] Updated weights for policy 1, policy_version 244185 (0.0008) [2023-12-27 20:58:53,362][106225] Updated weights for policy 1, policy_version 244195 (0.0009) [2023-12-27 20:58:53,411][106225] Updated weights for policy 1, policy_version 244205 (0.0009) [2023-12-27 20:58:53,593][106226] Updated weights for policy 0, policy_version 243871 (0.0005) [2023-12-27 20:58:53,660][106226] Updated weights for policy 0, policy_version 243881 (0.0005) [2023-12-27 20:58:53,710][106226] Updated weights for policy 0, policy_version 243891 (0.0005) [2023-12-27 20:58:54,230][106225] Updated weights for policy 1, policy_version 244215 (0.0008) [2023-12-27 20:58:54,244][106226] Updated weights for policy 0, policy_version 243901 (0.0006) [2023-12-27 20:58:54,289][106225] Updated weights for policy 1, policy_version 244225 (0.0006) [2023-12-27 20:58:54,306][106226] Updated weights for policy 0, policy_version 243911 (0.0008) [2023-12-27 20:58:54,351][106225] Updated weights for policy 1, policy_version 244235 (0.0007) [2023-12-27 20:58:54,365][106226] Updated weights for policy 0, policy_version 243921 (0.0009) [2023-12-27 20:58:55,015][106226] Updated weights for policy 0, policy_version 243931 (0.0007) [2023-12-27 20:58:55,067][106226] Updated weights for policy 0, policy_version 243941 (0.0008) [2023-12-27 20:58:55,102][106225] Updated weights for policy 1, policy_version 244245 (0.0007) [2023-12-27 20:58:55,120][106226] Updated weights for policy 0, policy_version 243951 (0.0007) [2023-12-27 20:58:55,149][106225] Updated weights for policy 1, policy_version 244255 (0.0006) [2023-12-27 20:58:55,200][106225] Updated weights for policy 1, policy_version 244265 (0.0008) [2023-12-27 20:58:55,859][106226] Updated weights for policy 0, policy_version 243961 (0.0007) [2023-12-27 20:58:55,912][106226] Updated weights for policy 0, policy_version 243971 (0.0006) [2023-12-27 20:58:55,935][106225] Updated weights for policy 1, policy_version 244275 (0.0007) [2023-12-27 20:58:55,962][106226] Updated weights for policy 0, policy_version 243981 (0.0007) [2023-12-27 20:58:56,002][106225] Updated weights for policy 1, policy_version 244285 (0.0006) [2023-12-27 20:58:56,030][106226] Updated weights for policy 0, policy_version 243991 (0.0008) [2023-12-27 20:58:56,068][106225] Updated weights for policy 1, policy_version 244295 (0.0007) [2023-12-27 20:58:56,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 125034496. Throughput: 0: 9942.3, 1: 9908.7. Samples: 124999628. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:58:56,176][105115] Avg episode reward: [(0, '-4.818'), (1, '-6.197')] [2023-12-27 20:58:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000244304_62554112.pth... [2023-12-27 20:58:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000243992_62480384.pth... [2023-12-27 20:58:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000243152_62259200.pth [2023-12-27 20:58:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000242808_62177280.pth [2023-12-27 20:58:56,637][106225] Updated weights for policy 1, policy_version 244305 (0.0007) [2023-12-27 20:58:56,667][106226] Updated weights for policy 0, policy_version 244001 (0.0007) [2023-12-27 20:58:56,696][106225] Updated weights for policy 1, policy_version 244315 (0.0008) [2023-12-27 20:58:56,716][106226] Updated weights for policy 0, policy_version 244011 (0.0010) [2023-12-27 20:58:56,741][106225] Updated weights for policy 1, policy_version 244325 (0.0006) [2023-12-27 20:58:56,765][106226] Updated weights for policy 0, policy_version 244021 (0.0010) [2023-12-27 20:58:56,798][106225] Updated weights for policy 1, policy_version 244335 (0.0006) [2023-12-27 20:58:57,454][106226] Updated weights for policy 0, policy_version 244031 (0.0010) [2023-12-27 20:58:57,510][106226] Updated weights for policy 0, policy_version 244041 (0.0010) [2023-12-27 20:58:57,556][106225] Updated weights for policy 1, policy_version 244345 (0.0007) [2023-12-27 20:58:57,572][106226] Updated weights for policy 0, policy_version 244051 (0.0010) [2023-12-27 20:58:57,608][106225] Updated weights for policy 1, policy_version 244355 (0.0009) [2023-12-27 20:58:57,664][106225] Updated weights for policy 1, policy_version 244366 (0.0008) [2023-12-27 20:58:58,161][106226] Updated weights for policy 0, policy_version 244061 (0.0007) [2023-12-27 20:58:58,220][106226] Updated weights for policy 0, policy_version 244071 (0.0008) [2023-12-27 20:58:58,281][106226] Updated weights for policy 0, policy_version 244081 (0.0009) [2023-12-27 20:58:58,448][106225] Updated weights for policy 1, policy_version 244376 (0.0008) [2023-12-27 20:58:58,508][106225] Updated weights for policy 1, policy_version 244386 (0.0009) [2023-12-27 20:58:58,573][106225] Updated weights for policy 1, policy_version 244396 (0.0009) [2023-12-27 20:58:59,119][106226] Updated weights for policy 0, policy_version 244092 (0.0009) [2023-12-27 20:58:59,176][106226] Updated weights for policy 0, policy_version 244102 (0.0009) [2023-12-27 20:58:59,239][106226] Updated weights for policy 0, policy_version 244112 (0.0008) [2023-12-27 20:58:59,491][106225] Updated weights for policy 1, policy_version 244407 (0.0009) [2023-12-27 20:58:59,551][106225] Updated weights for policy 1, policy_version 244417 (0.0008) [2023-12-27 20:58:59,614][106225] Updated weights for policy 1, policy_version 244427 (0.0008) [2023-12-27 20:58:59,977][106226] Updated weights for policy 0, policy_version 244122 (0.0007) [2023-12-27 20:59:00,031][106226] Updated weights for policy 0, policy_version 244132 (0.0007) [2023-12-27 20:59:00,092][106226] Updated weights for policy 0, policy_version 244142 (0.0006) [2023-12-27 20:59:00,151][106226] Updated weights for policy 0, policy_version 244152 (0.0005) [2023-12-27 20:59:00,346][106225] Updated weights for policy 1, policy_version 244437 (0.0008) [2023-12-27 20:59:00,411][106225] Updated weights for policy 1, policy_version 244447 (0.0005) [2023-12-27 20:59:00,468][106225] Updated weights for policy 1, policy_version 244457 (0.0007) [2023-12-27 20:59:00,832][106226] Updated weights for policy 0, policy_version 244162 (0.0009) [2023-12-27 20:59:00,877][106226] Updated weights for policy 0, policy_version 244172 (0.0008) [2023-12-27 20:59:00,925][106226] Updated weights for policy 0, policy_version 244182 (0.0006) [2023-12-27 20:59:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 125124608. Throughput: 0: 9956.4, 1: 9800.8. Samples: 125115580. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 20:59:01,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-6.111')] [2023-12-27 20:59:01,198][106225] Updated weights for policy 1, policy_version 244467 (0.0009) [2023-12-27 20:59:01,253][106225] Updated weights for policy 1, policy_version 244477 (0.0009) [2023-12-27 20:59:01,318][106225] Updated weights for policy 1, policy_version 244487 (0.0008) [2023-12-27 20:59:01,638][106226] Updated weights for policy 0, policy_version 244192 (0.0008) [2023-12-27 20:59:01,698][106226] Updated weights for policy 0, policy_version 244202 (0.0009) [2023-12-27 20:59:01,766][106226] Updated weights for policy 0, policy_version 244212 (0.0008) [2023-12-27 20:59:02,100][106225] Updated weights for policy 1, policy_version 244497 (0.0009) [2023-12-27 20:59:02,166][106225] Updated weights for policy 1, policy_version 244507 (0.0011) [2023-12-27 20:59:02,227][106225] Updated weights for policy 1, policy_version 244517 (0.0010) [2023-12-27 20:59:02,290][106225] Updated weights for policy 1, policy_version 244527 (0.0011) [2023-12-27 20:59:02,510][106226] Updated weights for policy 0, policy_version 244222 (0.0008) [2023-12-27 20:59:02,575][106226] Updated weights for policy 0, policy_version 244232 (0.0007) [2023-12-27 20:59:02,632][106226] Updated weights for policy 0, policy_version 244242 (0.0007) [2023-12-27 20:59:03,006][106225] Updated weights for policy 1, policy_version 244537 (0.0010) [2023-12-27 20:59:03,057][106225] Updated weights for policy 1, policy_version 244547 (0.0010) [2023-12-27 20:59:03,106][106225] Updated weights for policy 1, policy_version 244557 (0.0010) [2023-12-27 20:59:03,323][106226] Updated weights for policy 0, policy_version 244252 (0.0006) [2023-12-27 20:59:03,377][106226] Updated weights for policy 0, policy_version 244262 (0.0005) [2023-12-27 20:59:03,423][106226] Updated weights for policy 0, policy_version 244272 (0.0005) [2023-12-27 20:59:03,822][106225] Updated weights for policy 1, policy_version 244567 (0.0007) [2023-12-27 20:59:03,885][106225] Updated weights for policy 1, policy_version 244577 (0.0010) [2023-12-27 20:59:03,943][106225] Updated weights for policy 1, policy_version 244587 (0.0010) [2023-12-27 20:59:04,042][106226] Updated weights for policy 0, policy_version 244282 (0.0006) [2023-12-27 20:59:04,104][106226] Updated weights for policy 0, policy_version 244292 (0.0010) [2023-12-27 20:59:04,162][106226] Updated weights for policy 0, policy_version 244302 (0.0006) [2023-12-27 20:59:04,224][106226] Updated weights for policy 0, policy_version 244312 (0.0007) [2023-12-27 20:59:04,554][106225] Updated weights for policy 1, policy_version 244597 (0.0010) [2023-12-27 20:59:04,610][106225] Updated weights for policy 1, policy_version 244607 (0.0008) [2023-12-27 20:59:04,672][106225] Updated weights for policy 1, policy_version 244617 (0.0005) [2023-12-27 20:59:04,797][106226] Updated weights for policy 0, policy_version 244322 (0.0005) [2023-12-27 20:59:04,850][106226] Updated weights for policy 0, policy_version 244332 (0.0005) [2023-12-27 20:59:04,904][106226] Updated weights for policy 0, policy_version 244342 (0.0008) [2023-12-27 20:59:05,213][106225] Updated weights for policy 1, policy_version 244627 (0.0005) [2023-12-27 20:59:05,264][106225] Updated weights for policy 1, policy_version 244637 (0.0005) [2023-12-27 20:59:05,320][106225] Updated weights for policy 1, policy_version 244647 (0.0005) [2023-12-27 20:59:05,551][106226] Updated weights for policy 0, policy_version 244352 (0.0007) [2023-12-27 20:59:05,606][106226] Updated weights for policy 0, policy_version 244362 (0.0006) [2023-12-27 20:59:05,659][106226] Updated weights for policy 0, policy_version 244372 (0.0005) [2023-12-27 20:59:05,907][106225] Updated weights for policy 1, policy_version 244657 (0.0005) [2023-12-27 20:59:05,956][106225] Updated weights for policy 1, policy_version 244667 (0.0009) [2023-12-27 20:59:06,006][106225] Updated weights for policy 1, policy_version 244678 (0.0009) [2023-12-27 20:59:06,064][106225] Updated weights for policy 1, policy_version 244688 (0.0008) [2023-12-27 20:59:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 125231104. Throughput: 0: 9992.0, 1: 9891.5. Samples: 125239228. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:06,175][105115] Avg episode reward: [(0, '-5.151'), (1, '-6.192')] [2023-12-27 20:59:06,282][106226] Updated weights for policy 0, policy_version 244382 (0.0008) [2023-12-27 20:59:06,349][106226] Updated weights for policy 0, policy_version 244392 (0.0009) [2023-12-27 20:59:06,404][106226] Updated weights for policy 0, policy_version 244402 (0.0008) [2023-12-27 20:59:06,847][106225] Updated weights for policy 1, policy_version 244698 (0.0010) [2023-12-27 20:59:06,902][106225] Updated weights for policy 1, policy_version 244708 (0.0010) [2023-12-27 20:59:06,959][106225] Updated weights for policy 1, policy_version 244718 (0.0010) [2023-12-27 20:59:07,130][106226] Updated weights for policy 0, policy_version 244412 (0.0008) [2023-12-27 20:59:07,191][106226] Updated weights for policy 0, policy_version 244422 (0.0008) [2023-12-27 20:59:07,241][106226] Updated weights for policy 0, policy_version 244432 (0.0008) [2023-12-27 20:59:07,648][106225] Updated weights for policy 1, policy_version 244728 (0.0010) [2023-12-27 20:59:07,706][106225] Updated weights for policy 1, policy_version 244738 (0.0011) [2023-12-27 20:59:07,761][106225] Updated weights for policy 1, policy_version 244748 (0.0007) [2023-12-27 20:59:08,017][106226] Updated weights for policy 0, policy_version 244442 (0.0008) [2023-12-27 20:59:08,069][106226] Updated weights for policy 0, policy_version 244452 (0.0007) [2023-12-27 20:59:08,131][106226] Updated weights for policy 0, policy_version 244462 (0.0008) [2023-12-27 20:59:08,198][106226] Updated weights for policy 0, policy_version 244472 (0.0007) [2023-12-27 20:59:08,432][106225] Updated weights for policy 1, policy_version 244758 (0.0008) [2023-12-27 20:59:08,487][106225] Updated weights for policy 1, policy_version 244768 (0.0006) [2023-12-27 20:59:08,560][106225] Updated weights for policy 1, policy_version 244778 (0.0008) [2023-12-27 20:59:08,894][106226] Updated weights for policy 0, policy_version 244482 (0.0008) [2023-12-27 20:59:08,960][106226] Updated weights for policy 0, policy_version 244492 (0.0008) [2023-12-27 20:59:09,023][106226] Updated weights for policy 0, policy_version 244502 (0.0008) [2023-12-27 20:59:09,218][106225] Updated weights for policy 1, policy_version 244788 (0.0009) [2023-12-27 20:59:09,291][106225] Updated weights for policy 1, policy_version 244798 (0.0008) [2023-12-27 20:59:09,352][106225] Updated weights for policy 1, policy_version 244808 (0.0010) [2023-12-27 20:59:09,779][106226] Updated weights for policy 0, policy_version 244512 (0.0006) [2023-12-27 20:59:09,852][106226] Updated weights for policy 0, policy_version 244522 (0.0008) [2023-12-27 20:59:09,919][106226] Updated weights for policy 0, policy_version 244532 (0.0008) [2023-12-27 20:59:10,031][106225] Updated weights for policy 1, policy_version 244818 (0.0010) [2023-12-27 20:59:10,094][106225] Updated weights for policy 1, policy_version 244828 (0.0009) [2023-12-27 20:59:10,154][106225] Updated weights for policy 1, policy_version 244838 (0.0010) [2023-12-27 20:59:10,215][106225] Updated weights for policy 1, policy_version 244848 (0.0008) [2023-12-27 20:59:10,507][106226] Updated weights for policy 0, policy_version 244542 (0.0007) [2023-12-27 20:59:10,571][106226] Updated weights for policy 0, policy_version 244552 (0.0008) [2023-12-27 20:59:10,630][106226] Updated weights for policy 0, policy_version 244562 (0.0009) [2023-12-27 20:59:11,021][106225] Updated weights for policy 1, policy_version 244858 (0.0010) [2023-12-27 20:59:11,088][106225] Updated weights for policy 1, policy_version 244868 (0.0008) [2023-12-27 20:59:11,153][106225] Updated weights for policy 1, policy_version 244878 (0.0009) [2023-12-27 20:59:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 125329408. Throughput: 0: 10003.1, 1: 9902.6. Samples: 125297024. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:11,175][105115] Avg episode reward: [(0, '-5.340'), (1, '-6.505')] [2023-12-27 20:59:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000244568_62627840.pth... [2023-12-27 20:59:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000244880_62701568.pth... [2023-12-27 20:59:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000243416_62332928.pth [2023-12-27 20:59:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000243728_62406656.pth [2023-12-27 20:59:11,362][106226] Updated weights for policy 0, policy_version 244572 (0.0009) [2023-12-27 20:59:11,426][106226] Updated weights for policy 0, policy_version 244582 (0.0008) [2023-12-27 20:59:11,487][106226] Updated weights for policy 0, policy_version 244592 (0.0009) [2023-12-27 20:59:11,934][106225] Updated weights for policy 1, policy_version 244888 (0.0006) [2023-12-27 20:59:11,994][106225] Updated weights for policy 1, policy_version 244898 (0.0006) [2023-12-27 20:59:12,053][106225] Updated weights for policy 1, policy_version 244908 (0.0006) [2023-12-27 20:59:12,194][106226] Updated weights for policy 0, policy_version 244602 (0.0009) [2023-12-27 20:59:12,245][106226] Updated weights for policy 0, policy_version 244612 (0.0010) [2023-12-27 20:59:12,310][106226] Updated weights for policy 0, policy_version 244622 (0.0009) [2023-12-27 20:59:12,382][106226] Updated weights for policy 0, policy_version 244632 (0.0008) [2023-12-27 20:59:12,628][106225] Updated weights for policy 1, policy_version 244918 (0.0006) [2023-12-27 20:59:12,677][106225] Updated weights for policy 1, policy_version 244928 (0.0006) [2023-12-27 20:59:12,724][106225] Updated weights for policy 1, policy_version 244938 (0.0005) [2023-12-27 20:59:13,038][106226] Updated weights for policy 0, policy_version 244642 (0.0005) [2023-12-27 20:59:13,090][106226] Updated weights for policy 0, policy_version 244652 (0.0008) [2023-12-27 20:59:13,144][106226] Updated weights for policy 0, policy_version 244662 (0.0007) [2023-12-27 20:59:13,413][106225] Updated weights for policy 1, policy_version 244948 (0.0007) [2023-12-27 20:59:13,463][106225] Updated weights for policy 1, policy_version 244958 (0.0007) [2023-12-27 20:59:13,523][106225] Updated weights for policy 1, policy_version 244968 (0.0006) [2023-12-27 20:59:13,704][106226] Updated weights for policy 0, policy_version 244672 (0.0008) [2023-12-27 20:59:13,750][106226] Updated weights for policy 0, policy_version 244682 (0.0008) [2023-12-27 20:59:13,795][106226] Updated weights for policy 0, policy_version 244692 (0.0008) [2023-12-27 20:59:14,157][106225] Updated weights for policy 1, policy_version 244978 (0.0007) [2023-12-27 20:59:14,210][106225] Updated weights for policy 1, policy_version 244988 (0.0008) [2023-12-27 20:59:14,276][106225] Updated weights for policy 1, policy_version 244998 (0.0006) [2023-12-27 20:59:14,334][106225] Updated weights for policy 1, policy_version 245008 (0.0007) [2023-12-27 20:59:14,534][106226] Updated weights for policy 0, policy_version 244702 (0.0009) [2023-12-27 20:59:14,585][106226] Updated weights for policy 0, policy_version 244713 (0.0009) [2023-12-27 20:59:14,638][106226] Updated weights for policy 0, policy_version 244723 (0.0009) [2023-12-27 20:59:15,008][106225] Updated weights for policy 1, policy_version 245018 (0.0008) [2023-12-27 20:59:15,056][106225] Updated weights for policy 1, policy_version 245028 (0.0008) [2023-12-27 20:59:15,118][106225] Updated weights for policy 1, policy_version 245038 (0.0008) [2023-12-27 20:59:15,413][106226] Updated weights for policy 0, policy_version 244733 (0.0009) [2023-12-27 20:59:15,476][106226] Updated weights for policy 0, policy_version 244743 (0.0009) [2023-12-27 20:59:15,536][106226] Updated weights for policy 0, policy_version 244753 (0.0009) [2023-12-27 20:59:15,783][106225] Updated weights for policy 1, policy_version 245048 (0.0006) [2023-12-27 20:59:15,832][106225] Updated weights for policy 1, policy_version 245058 (0.0005) [2023-12-27 20:59:15,879][106225] Updated weights for policy 1, policy_version 245068 (0.0008) [2023-12-27 20:59:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 125427712. Throughput: 0: 9959.6, 1: 9879.4. Samples: 125417464. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:16,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-6.259')] [2023-12-27 20:59:16,258][106226] Updated weights for policy 0, policy_version 244763 (0.0008) [2023-12-27 20:59:16,311][106226] Updated weights for policy 0, policy_version 244773 (0.0005) [2023-12-27 20:59:16,356][106226] Updated weights for policy 0, policy_version 244783 (0.0006) [2023-12-27 20:59:16,530][106225] Updated weights for policy 1, policy_version 245078 (0.0008) [2023-12-27 20:59:16,591][106225] Updated weights for policy 1, policy_version 245088 (0.0010) [2023-12-27 20:59:16,651][106225] Updated weights for policy 1, policy_version 245098 (0.0010) [2023-12-27 20:59:16,960][106226] Updated weights for policy 0, policy_version 244793 (0.0006) [2023-12-27 20:59:17,009][106226] Updated weights for policy 0, policy_version 244803 (0.0005) [2023-12-27 20:59:17,057][106226] Updated weights for policy 0, policy_version 244813 (0.0005) [2023-12-27 20:59:17,114][106226] Updated weights for policy 0, policy_version 244823 (0.0006) [2023-12-27 20:59:17,210][106225] Updated weights for policy 1, policy_version 245108 (0.0008) [2023-12-27 20:59:17,272][106225] Updated weights for policy 1, policy_version 245118 (0.0009) [2023-12-27 20:59:17,339][106225] Updated weights for policy 1, policy_version 245128 (0.0008) [2023-12-27 20:59:17,768][106226] Updated weights for policy 0, policy_version 244833 (0.0008) [2023-12-27 20:59:17,826][106226] Updated weights for policy 0, policy_version 244843 (0.0006) [2023-12-27 20:59:17,886][106226] Updated weights for policy 0, policy_version 244853 (0.0006) [2023-12-27 20:59:18,080][106225] Updated weights for policy 1, policy_version 245138 (0.0008) [2023-12-27 20:59:18,145][106225] Updated weights for policy 1, policy_version 245148 (0.0008) [2023-12-27 20:59:18,205][106225] Updated weights for policy 1, policy_version 245158 (0.0008) [2023-12-27 20:59:18,258][106225] Updated weights for policy 1, policy_version 245168 (0.0006) [2023-12-27 20:59:18,596][106226] Updated weights for policy 0, policy_version 244863 (0.0008) [2023-12-27 20:59:18,653][106226] Updated weights for policy 0, policy_version 244873 (0.0009) [2023-12-27 20:59:18,713][106226] Updated weights for policy 0, policy_version 244883 (0.0008) [2023-12-27 20:59:18,940][106225] Updated weights for policy 1, policy_version 245178 (0.0008) [2023-12-27 20:59:18,999][106225] Updated weights for policy 1, policy_version 245188 (0.0005) [2023-12-27 20:59:19,055][106225] Updated weights for policy 1, policy_version 245198 (0.0010) [2023-12-27 20:59:19,440][106226] Updated weights for policy 0, policy_version 244893 (0.0008) [2023-12-27 20:59:19,509][106226] Updated weights for policy 0, policy_version 244903 (0.0009) [2023-12-27 20:59:19,568][106226] Updated weights for policy 0, policy_version 244913 (0.0008) [2023-12-27 20:59:19,760][106225] Updated weights for policy 1, policy_version 245208 (0.0009) [2023-12-27 20:59:19,826][106225] Updated weights for policy 1, policy_version 245218 (0.0008) [2023-12-27 20:59:19,896][106225] Updated weights for policy 1, policy_version 245228 (0.0009) [2023-12-27 20:59:20,242][106226] Updated weights for policy 0, policy_version 244923 (0.0007) [2023-12-27 20:59:20,306][106226] Updated weights for policy 0, policy_version 244933 (0.0008) [2023-12-27 20:59:20,373][106226] Updated weights for policy 0, policy_version 244943 (0.0008) [2023-12-27 20:59:20,683][106225] Updated weights for policy 1, policy_version 245238 (0.0010) [2023-12-27 20:59:20,747][106225] Updated weights for policy 1, policy_version 245248 (0.0011) [2023-12-27 20:59:20,810][106225] Updated weights for policy 1, policy_version 245258 (0.0011) [2023-12-27 20:59:21,038][106226] Updated weights for policy 0, policy_version 244953 (0.0006) [2023-12-27 20:59:21,104][106226] Updated weights for policy 0, policy_version 244963 (0.0009) [2023-12-27 20:59:21,169][106226] Updated weights for policy 0, policy_version 244973 (0.0008) [2023-12-27 20:59:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 125526016. Throughput: 0: 9957.6, 1: 9798.7. Samples: 125538292. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:21,175][105115] Avg episode reward: [(0, '-4.961'), (1, '-6.336')] [2023-12-27 20:59:21,239][106226] Updated weights for policy 0, policy_version 244983 (0.0008) [2023-12-27 20:59:21,582][106225] Updated weights for policy 1, policy_version 245268 (0.0009) [2023-12-27 20:59:21,649][106225] Updated weights for policy 1, policy_version 245278 (0.0008) [2023-12-27 20:59:21,720][106225] Updated weights for policy 1, policy_version 245288 (0.0009) [2023-12-27 20:59:22,039][106226] Updated weights for policy 0, policy_version 244993 (0.0008) [2023-12-27 20:59:22,106][106226] Updated weights for policy 0, policy_version 245003 (0.0007) [2023-12-27 20:59:22,175][106226] Updated weights for policy 0, policy_version 245013 (0.0007) [2023-12-27 20:59:22,454][106225] Updated weights for policy 1, policy_version 245298 (0.0011) [2023-12-27 20:59:22,512][106225] Updated weights for policy 1, policy_version 245308 (0.0010) [2023-12-27 20:59:22,575][106225] Updated weights for policy 1, policy_version 245318 (0.0010) [2023-12-27 20:59:22,635][106225] Updated weights for policy 1, policy_version 245328 (0.0009) [2023-12-27 20:59:22,845][106226] Updated weights for policy 0, policy_version 245023 (0.0010) [2023-12-27 20:59:22,915][106226] Updated weights for policy 0, policy_version 245033 (0.0010) [2023-12-27 20:59:22,974][106226] Updated weights for policy 0, policy_version 245043 (0.0011) [2023-12-27 20:59:23,358][106225] Updated weights for policy 1, policy_version 245338 (0.0008) [2023-12-27 20:59:23,422][106225] Updated weights for policy 1, policy_version 245348 (0.0008) [2023-12-27 20:59:23,485][106225] Updated weights for policy 1, policy_version 245358 (0.0008) [2023-12-27 20:59:23,684][106226] Updated weights for policy 0, policy_version 245053 (0.0011) [2023-12-27 20:59:23,740][106226] Updated weights for policy 0, policy_version 245063 (0.0010) [2023-12-27 20:59:23,797][106226] Updated weights for policy 0, policy_version 245073 (0.0010) [2023-12-27 20:59:24,130][106225] Updated weights for policy 1, policy_version 245368 (0.0007) [2023-12-27 20:59:24,192][106225] Updated weights for policy 1, policy_version 245378 (0.0007) [2023-12-27 20:59:24,255][106225] Updated weights for policy 1, policy_version 245388 (0.0007) [2023-12-27 20:59:24,519][106226] Updated weights for policy 0, policy_version 245083 (0.0009) [2023-12-27 20:59:24,567][106226] Updated weights for policy 0, policy_version 245093 (0.0006) [2023-12-27 20:59:24,619][106226] Updated weights for policy 0, policy_version 245103 (0.0008) [2023-12-27 20:59:24,890][106225] Updated weights for policy 1, policy_version 245398 (0.0009) [2023-12-27 20:59:24,947][106225] Updated weights for policy 1, policy_version 245408 (0.0009) [2023-12-27 20:59:25,009][106225] Updated weights for policy 1, policy_version 245418 (0.0006) [2023-12-27 20:59:25,290][106226] Updated weights for policy 0, policy_version 245113 (0.0010) [2023-12-27 20:59:25,352][106226] Updated weights for policy 0, policy_version 245123 (0.0010) [2023-12-27 20:59:25,407][106226] Updated weights for policy 0, policy_version 245133 (0.0009) [2023-12-27 20:59:25,462][106226] Updated weights for policy 0, policy_version 245143 (0.0008) [2023-12-27 20:59:25,590][106225] Updated weights for policy 1, policy_version 245428 (0.0007) [2023-12-27 20:59:25,648][106225] Updated weights for policy 1, policy_version 245438 (0.0010) [2023-12-27 20:59:25,705][106225] Updated weights for policy 1, policy_version 245448 (0.0006) [2023-12-27 20:59:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 125624320. Throughput: 0: 9924.1, 1: 9785.4. Samples: 125594740. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:26,176][105115] Avg episode reward: [(0, '-4.546'), (1, '-6.371')] [2023-12-27 20:59:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000245456_62849024.pth... [2023-12-27 20:59:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000244304_62554112.pth [2023-12-27 20:59:26,238][106226] Updated weights for policy 0, policy_version 245153 (0.0005) [2023-12-27 20:59:26,265][106225] Updated weights for policy 1, policy_version 245458 (0.0006) [2023-12-27 20:59:26,295][106226] Updated weights for policy 0, policy_version 245163 (0.0005) [2023-12-27 20:59:26,319][106225] Updated weights for policy 1, policy_version 245468 (0.0010) [2023-12-27 20:59:26,359][106226] Updated weights for policy 0, policy_version 245173 (0.0005) [2023-12-27 20:59:26,375][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000245176_62783488.pth... [2023-12-27 20:59:26,377][106225] Updated weights for policy 1, policy_version 245478 (0.0010) [2023-12-27 20:59:26,379][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000243992_62480384.pth [2023-12-27 20:59:26,439][106225] Updated weights for policy 1, policy_version 245488 (0.0010) [2023-12-27 20:59:26,868][106226] Updated weights for policy 0, policy_version 245183 (0.0008) [2023-12-27 20:59:26,919][106226] Updated weights for policy 0, policy_version 245193 (0.0009) [2023-12-27 20:59:26,975][106226] Updated weights for policy 0, policy_version 245203 (0.0009) [2023-12-27 20:59:27,067][106225] Updated weights for policy 1, policy_version 245498 (0.0008) [2023-12-27 20:59:27,124][106225] Updated weights for policy 1, policy_version 245508 (0.0008) [2023-12-27 20:59:27,175][106225] Updated weights for policy 1, policy_version 245518 (0.0009) [2023-12-27 20:59:27,701][106226] Updated weights for policy 0, policy_version 245213 (0.0008) [2023-12-27 20:59:27,755][106226] Updated weights for policy 0, policy_version 245223 (0.0005) [2023-12-27 20:59:27,806][106226] Updated weights for policy 0, policy_version 245233 (0.0005) [2023-12-27 20:59:27,881][106225] Updated weights for policy 1, policy_version 245528 (0.0008) [2023-12-27 20:59:27,935][106225] Updated weights for policy 1, policy_version 245538 (0.0007) [2023-12-27 20:59:27,984][106225] Updated weights for policy 1, policy_version 245548 (0.0008) [2023-12-27 20:59:28,434][106226] Updated weights for policy 0, policy_version 245243 (0.0007) [2023-12-27 20:59:28,484][106226] Updated weights for policy 0, policy_version 245253 (0.0008) [2023-12-27 20:59:28,549][106226] Updated weights for policy 0, policy_version 245263 (0.0008) [2023-12-27 20:59:28,643][106225] Updated weights for policy 1, policy_version 245558 (0.0006) [2023-12-27 20:59:28,705][106225] Updated weights for policy 1, policy_version 245568 (0.0007) [2023-12-27 20:59:28,766][106225] Updated weights for policy 1, policy_version 245578 (0.0010) [2023-12-27 20:59:29,275][106226] Updated weights for policy 0, policy_version 245273 (0.0008) [2023-12-27 20:59:29,343][106226] Updated weights for policy 0, policy_version 245283 (0.0006) [2023-12-27 20:59:29,415][106226] Updated weights for policy 0, policy_version 245293 (0.0006) [2023-12-27 20:59:29,452][106225] Updated weights for policy 1, policy_version 245588 (0.0010) [2023-12-27 20:59:29,483][106226] Updated weights for policy 0, policy_version 245303 (0.0006) [2023-12-27 20:59:29,509][106225] Updated weights for policy 1, policy_version 245598 (0.0005) [2023-12-27 20:59:29,573][106225] Updated weights for policy 1, policy_version 245608 (0.0008) [2023-12-27 20:59:30,139][106226] Updated weights for policy 0, policy_version 245313 (0.0008) [2023-12-27 20:59:30,181][106225] Updated weights for policy 1, policy_version 245618 (0.0006) [2023-12-27 20:59:30,196][106226] Updated weights for policy 0, policy_version 245323 (0.0008) [2023-12-27 20:59:30,244][106225] Updated weights for policy 1, policy_version 245628 (0.0008) [2023-12-27 20:59:30,257][106226] Updated weights for policy 0, policy_version 245333 (0.0006) [2023-12-27 20:59:30,309][106225] Updated weights for policy 1, policy_version 245638 (0.0008) [2023-12-27 20:59:30,370][106225] Updated weights for policy 1, policy_version 245648 (0.0008) [2023-12-27 20:59:30,814][106226] Updated weights for policy 0, policy_version 245343 (0.0006) [2023-12-27 20:59:30,867][106226] Updated weights for policy 0, policy_version 245353 (0.0005) [2023-12-27 20:59:30,920][106226] Updated weights for policy 0, policy_version 245363 (0.0007) [2023-12-27 20:59:30,942][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000007 [2023-12-27 20:59:31,018][106225] Updated weights for policy 1, policy_version 245658 (0.0008) [2023-12-27 20:59:31,080][106225] Updated weights for policy 1, policy_version 245668 (0.0007) [2023-12-27 20:59:31,149][106225] Updated weights for policy 1, policy_version 245678 (0.0009) [2023-12-27 20:59:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 125739008. Throughput: 0: 10040.2, 1: 9962.1. Samples: 125721308. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:31,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-6.404')] [2023-12-27 20:59:31,657][106226] Updated weights for policy 0, policy_version 245373 (0.0009) [2023-12-27 20:59:31,724][106226] Updated weights for policy 0, policy_version 245383 (0.0007) [2023-12-27 20:59:31,795][106226] Updated weights for policy 0, policy_version 245393 (0.0008) [2023-12-27 20:59:31,875][106225] Updated weights for policy 1, policy_version 245688 (0.0007) [2023-12-27 20:59:31,935][106225] Updated weights for policy 1, policy_version 245698 (0.0008) [2023-12-27 20:59:31,996][106225] Updated weights for policy 1, policy_version 245708 (0.0008) [2023-12-27 20:59:32,504][106226] Updated weights for policy 0, policy_version 245403 (0.0007) [2023-12-27 20:59:32,571][106226] Updated weights for policy 0, policy_version 245413 (0.0005) [2023-12-27 20:59:32,633][106226] Updated weights for policy 0, policy_version 245423 (0.0006) [2023-12-27 20:59:32,745][106225] Updated weights for policy 1, policy_version 245718 (0.0009) [2023-12-27 20:59:32,807][106225] Updated weights for policy 1, policy_version 245728 (0.0009) [2023-12-27 20:59:32,870][106225] Updated weights for policy 1, policy_version 245738 (0.0008) [2023-12-27 20:59:33,289][106226] Updated weights for policy 0, policy_version 245433 (0.0009) [2023-12-27 20:59:33,343][106226] Updated weights for policy 0, policy_version 245443 (0.0007) [2023-12-27 20:59:33,396][106226] Updated weights for policy 0, policy_version 245453 (0.0009) [2023-12-27 20:59:33,455][106226] Updated weights for policy 0, policy_version 245463 (0.0009) [2023-12-27 20:59:33,607][106225] Updated weights for policy 1, policy_version 245748 (0.0009) [2023-12-27 20:59:33,655][106225] Updated weights for policy 1, policy_version 245758 (0.0008) [2023-12-27 20:59:33,699][106225] Updated weights for policy 1, policy_version 245768 (0.0008) [2023-12-27 20:59:34,188][106226] Updated weights for policy 0, policy_version 245473 (0.0008) [2023-12-27 20:59:34,244][106226] Updated weights for policy 0, policy_version 245483 (0.0008) [2023-12-27 20:59:34,302][106226] Updated weights for policy 0, policy_version 245493 (0.0009) [2023-12-27 20:59:34,408][106225] Updated weights for policy 1, policy_version 245778 (0.0008) [2023-12-27 20:59:34,468][106225] Updated weights for policy 1, policy_version 245788 (0.0008) [2023-12-27 20:59:34,526][106225] Updated weights for policy 1, policy_version 245798 (0.0008) [2023-12-27 20:59:34,585][106225] Updated weights for policy 1, policy_version 245808 (0.0008) [2023-12-27 20:59:35,036][106226] Updated weights for policy 0, policy_version 245503 (0.0006) [2023-12-27 20:59:35,087][106226] Updated weights for policy 0, policy_version 245513 (0.0006) [2023-12-27 20:59:35,136][106226] Updated weights for policy 0, policy_version 245523 (0.0005) [2023-12-27 20:59:35,327][106225] Updated weights for policy 1, policy_version 245818 (0.0009) [2023-12-27 20:59:35,377][106225] Updated weights for policy 1, policy_version 245829 (0.0009) [2023-12-27 20:59:35,443][106225] Updated weights for policy 1, policy_version 245839 (0.0010) [2023-12-27 20:59:35,662][106226] Updated weights for policy 0, policy_version 245533 (0.0008) [2023-12-27 20:59:35,714][106226] Updated weights for policy 0, policy_version 245543 (0.0008) [2023-12-27 20:59:35,779][106226] Updated weights for policy 0, policy_version 245553 (0.0005) [2023-12-27 20:59:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 125829120. Throughput: 0: 10121.0, 1: 9889.7. Samples: 125841124. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:36,175][105115] Avg episode reward: [(0, '-4.944'), (1, '-6.135')] [2023-12-27 20:59:36,251][106225] Updated weights for policy 1, policy_version 245849 (0.0006) [2023-12-27 20:59:36,311][106225] Updated weights for policy 1, policy_version 245859 (0.0005) [2023-12-27 20:59:36,380][106225] Updated weights for policy 1, policy_version 245869 (0.0005) [2023-12-27 20:59:36,554][106226] Updated weights for policy 0, policy_version 245563 (0.0008) [2023-12-27 20:59:36,608][106226] Updated weights for policy 0, policy_version 245573 (0.0009) [2023-12-27 20:59:36,680][106226] Updated weights for policy 0, policy_version 245583 (0.0009) [2023-12-27 20:59:37,031][106225] Updated weights for policy 1, policy_version 245879 (0.0007) [2023-12-27 20:59:37,098][106225] Updated weights for policy 1, policy_version 245889 (0.0005) [2023-12-27 20:59:37,159][106225] Updated weights for policy 1, policy_version 245899 (0.0005) [2023-12-27 20:59:37,459][106226] Updated weights for policy 0, policy_version 245593 (0.0009) [2023-12-27 20:59:37,516][106226] Updated weights for policy 0, policy_version 245603 (0.0008) [2023-12-27 20:59:37,570][106226] Updated weights for policy 0, policy_version 245613 (0.0005) [2023-12-27 20:59:37,624][106226] Updated weights for policy 0, policy_version 245623 (0.0007) [2023-12-27 20:59:37,657][106225] Updated weights for policy 1, policy_version 245909 (0.0007) [2023-12-27 20:59:37,722][106225] Updated weights for policy 1, policy_version 245919 (0.0008) [2023-12-27 20:59:37,779][106225] Updated weights for policy 1, policy_version 245929 (0.0006) [2023-12-27 20:59:38,368][106226] Updated weights for policy 0, policy_version 245633 (0.0008) [2023-12-27 20:59:38,404][106225] Updated weights for policy 1, policy_version 245939 (0.0006) [2023-12-27 20:59:38,428][106226] Updated weights for policy 0, policy_version 245643 (0.0006) [2023-12-27 20:59:38,465][106225] Updated weights for policy 1, policy_version 245949 (0.0008) [2023-12-27 20:59:38,492][106226] Updated weights for policy 0, policy_version 245653 (0.0006) [2023-12-27 20:59:38,527][106225] Updated weights for policy 1, policy_version 245959 (0.0008) [2023-12-27 20:59:39,210][106225] Updated weights for policy 1, policy_version 245969 (0.0010) [2023-12-27 20:59:39,227][106226] Updated weights for policy 0, policy_version 245663 (0.0008) [2023-12-27 20:59:39,274][106225] Updated weights for policy 1, policy_version 245979 (0.0010) [2023-12-27 20:59:39,290][106226] Updated weights for policy 0, policy_version 245673 (0.0008) [2023-12-27 20:59:39,343][106225] Updated weights for policy 1, policy_version 245989 (0.0012) [2023-12-27 20:59:39,358][106226] Updated weights for policy 0, policy_version 245683 (0.0008) [2023-12-27 20:59:39,413][106225] Updated weights for policy 1, policy_version 245999 (0.0009) [2023-12-27 20:59:40,153][106225] Updated weights for policy 1, policy_version 246009 (0.0008) [2023-12-27 20:59:40,179][106226] Updated weights for policy 0, policy_version 245693 (0.0008) [2023-12-27 20:59:40,215][106225] Updated weights for policy 1, policy_version 246019 (0.0006) [2023-12-27 20:59:40,245][106226] Updated weights for policy 0, policy_version 245703 (0.0007) [2023-12-27 20:59:40,278][106225] Updated weights for policy 1, policy_version 246029 (0.0009) [2023-12-27 20:59:40,305][106226] Updated weights for policy 0, policy_version 245713 (0.0007) [2023-12-27 20:59:40,998][106225] Updated weights for policy 1, policy_version 246039 (0.0008) [2023-12-27 20:59:41,015][106226] Updated weights for policy 0, policy_version 245723 (0.0008) [2023-12-27 20:59:41,075][106225] Updated weights for policy 1, policy_version 246049 (0.0007) [2023-12-27 20:59:41,088][106226] Updated weights for policy 0, policy_version 245733 (0.0008) [2023-12-27 20:59:41,144][106225] Updated weights for policy 1, policy_version 246059 (0.0008) [2023-12-27 20:59:41,156][106226] Updated weights for policy 0, policy_version 245743 (0.0009) [2023-12-27 20:59:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 125927424. Throughput: 0: 10023.8, 1: 10001.8. Samples: 125900776. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:41,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-6.200')] [2023-12-27 20:59:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000246064_63004672.pth... [2023-12-27 20:59:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000244880_62701568.pth [2023-12-27 20:59:41,209][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000245752_62930944.pth... [2023-12-27 20:59:41,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000244568_62627840.pth [2023-12-27 20:59:41,874][106225] Updated weights for policy 1, policy_version 246069 (0.0007) [2023-12-27 20:59:41,877][106226] Updated weights for policy 0, policy_version 245753 (0.0008) [2023-12-27 20:59:41,939][106226] Updated weights for policy 0, policy_version 245763 (0.0007) [2023-12-27 20:59:41,942][106225] Updated weights for policy 1, policy_version 246079 (0.0008) [2023-12-27 20:59:42,002][106226] Updated weights for policy 0, policy_version 245773 (0.0007) [2023-12-27 20:59:42,004][106225] Updated weights for policy 1, policy_version 246089 (0.0006) [2023-12-27 20:59:42,060][106226] Updated weights for policy 0, policy_version 245783 (0.0008) [2023-12-27 20:59:42,715][106225] Updated weights for policy 1, policy_version 246099 (0.0007) [2023-12-27 20:59:42,721][106226] Updated weights for policy 0, policy_version 245793 (0.0007) [2023-12-27 20:59:42,775][106226] Updated weights for policy 0, policy_version 245803 (0.0007) [2023-12-27 20:59:42,787][106225] Updated weights for policy 1, policy_version 246109 (0.0005) [2023-12-27 20:59:42,830][106226] Updated weights for policy 0, policy_version 245813 (0.0007) [2023-12-27 20:59:42,845][106225] Updated weights for policy 1, policy_version 246119 (0.0006) [2023-12-27 20:59:43,396][106225] Updated weights for policy 1, policy_version 246129 (0.0005) [2023-12-27 20:59:43,452][106225] Updated weights for policy 1, policy_version 246139 (0.0005) [2023-12-27 20:59:43,490][106226] Updated weights for policy 0, policy_version 245823 (0.0007) [2023-12-27 20:59:43,512][106225] Updated weights for policy 1, policy_version 246149 (0.0007) [2023-12-27 20:59:43,537][106226] Updated weights for policy 0, policy_version 245833 (0.0010) [2023-12-27 20:59:43,559][106225] Updated weights for policy 1, policy_version 246159 (0.0005) [2023-12-27 20:59:43,584][106226] Updated weights for policy 0, policy_version 245843 (0.0010) [2023-12-27 20:59:44,214][106225] Updated weights for policy 1, policy_version 246169 (0.0010) [2023-12-27 20:59:44,260][106226] Updated weights for policy 0, policy_version 245853 (0.0010) [2023-12-27 20:59:44,269][106225] Updated weights for policy 1, policy_version 246179 (0.0010) [2023-12-27 20:59:44,321][106226] Updated weights for policy 0, policy_version 245863 (0.0010) [2023-12-27 20:59:44,322][106225] Updated weights for policy 1, policy_version 246189 (0.0010) [2023-12-27 20:59:44,381][106226] Updated weights for policy 0, policy_version 245873 (0.0010) [2023-12-27 20:59:45,016][106225] Updated weights for policy 1, policy_version 246199 (0.0008) [2023-12-27 20:59:45,083][106225] Updated weights for policy 1, policy_version 246209 (0.0010) [2023-12-27 20:59:45,103][106226] Updated weights for policy 0, policy_version 245883 (0.0009) [2023-12-27 20:59:45,149][106225] Updated weights for policy 1, policy_version 246219 (0.0010) [2023-12-27 20:59:45,167][106226] Updated weights for policy 0, policy_version 245893 (0.0008) [2023-12-27 20:59:45,220][106226] Updated weights for policy 0, policy_version 245903 (0.0008) [2023-12-27 20:59:45,828][106226] Updated weights for policy 0, policy_version 245913 (0.0008) [2023-12-27 20:59:45,852][106225] Updated weights for policy 1, policy_version 246229 (0.0010) [2023-12-27 20:59:45,879][106226] Updated weights for policy 0, policy_version 245923 (0.0005) [2023-12-27 20:59:45,915][106225] Updated weights for policy 1, policy_version 246239 (0.0010) [2023-12-27 20:59:45,940][106226] Updated weights for policy 0, policy_version 245933 (0.0005) [2023-12-27 20:59:45,972][106225] Updated weights for policy 1, policy_version 246249 (0.0010) [2023-12-27 20:59:46,001][106226] Updated weights for policy 0, policy_version 245943 (0.0005) [2023-12-27 20:59:46,175][105115] Fps is (10 sec: 20479.2, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 126033920. Throughput: 0: 9989.4, 1: 10065.8. Samples: 126018072. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:46,176][105115] Avg episode reward: [(0, '-4.801'), (1, '-6.387')] [2023-12-27 20:59:46,601][106225] Updated weights for policy 1, policy_version 246259 (0.0010) [2023-12-27 20:59:46,651][106225] Updated weights for policy 1, policy_version 246269 (0.0010) [2023-12-27 20:59:46,674][106226] Updated weights for policy 0, policy_version 245953 (0.0005) [2023-12-27 20:59:46,698][106225] Updated weights for policy 1, policy_version 246279 (0.0010) [2023-12-27 20:59:46,728][106226] Updated weights for policy 0, policy_version 245963 (0.0006) [2023-12-27 20:59:46,781][106226] Updated weights for policy 0, policy_version 245973 (0.0008) [2023-12-27 20:59:47,337][106225] Updated weights for policy 1, policy_version 246289 (0.0010) [2023-12-27 20:59:47,385][106225] Updated weights for policy 1, policy_version 246299 (0.0005) [2023-12-27 20:59:47,432][106225] Updated weights for policy 1, policy_version 246309 (0.0006) [2023-12-27 20:59:47,492][106225] Updated weights for policy 1, policy_version 246319 (0.0008) [2023-12-27 20:59:47,580][106226] Updated weights for policy 0, policy_version 245983 (0.0009) [2023-12-27 20:59:47,639][106226] Updated weights for policy 0, policy_version 245993 (0.0008) [2023-12-27 20:59:47,698][106226] Updated weights for policy 0, policy_version 246003 (0.0009) [2023-12-27 20:59:48,229][106225] Updated weights for policy 1, policy_version 246329 (0.0008) [2023-12-27 20:59:48,283][106225] Updated weights for policy 1, policy_version 246339 (0.0008) [2023-12-27 20:59:48,365][106225] Updated weights for policy 1, policy_version 246349 (0.0008) [2023-12-27 20:59:48,387][106226] Updated weights for policy 0, policy_version 246013 (0.0008) [2023-12-27 20:59:48,448][106226] Updated weights for policy 0, policy_version 246023 (0.0008) [2023-12-27 20:59:48,509][106226] Updated weights for policy 0, policy_version 246033 (0.0009) [2023-12-27 20:59:49,057][106225] Updated weights for policy 1, policy_version 246359 (0.0010) [2023-12-27 20:59:49,115][106225] Updated weights for policy 1, policy_version 246369 (0.0010) [2023-12-27 20:59:49,177][106225] Updated weights for policy 1, policy_version 246379 (0.0010) [2023-12-27 20:59:49,183][106226] Updated weights for policy 0, policy_version 246043 (0.0007) [2023-12-27 20:59:49,242][106226] Updated weights for policy 0, policy_version 246053 (0.0007) [2023-12-27 20:59:49,312][106226] Updated weights for policy 0, policy_version 246063 (0.0009) [2023-12-27 20:59:50,033][106225] Updated weights for policy 1, policy_version 246389 (0.0011) [2023-12-27 20:59:50,086][106226] Updated weights for policy 0, policy_version 246073 (0.0008) [2023-12-27 20:59:50,096][106225] Updated weights for policy 1, policy_version 246399 (0.0011) [2023-12-27 20:59:50,150][106226] Updated weights for policy 0, policy_version 246083 (0.0006) [2023-12-27 20:59:50,152][106225] Updated weights for policy 1, policy_version 246409 (0.0010) [2023-12-27 20:59:50,217][106226] Updated weights for policy 0, policy_version 246093 (0.0010) [2023-12-27 20:59:50,271][106226] Updated weights for policy 0, policy_version 246103 (0.0008) [2023-12-27 20:59:50,891][106225] Updated weights for policy 1, policy_version 246419 (0.0010) [2023-12-27 20:59:50,952][106225] Updated weights for policy 1, policy_version 246429 (0.0005) [2023-12-27 20:59:51,009][106226] Updated weights for policy 0, policy_version 246113 (0.0007) [2023-12-27 20:59:51,015][106225] Updated weights for policy 1, policy_version 246439 (0.0007) [2023-12-27 20:59:51,074][106226] Updated weights for policy 0, policy_version 246123 (0.0010) [2023-12-27 20:59:51,142][106226] Updated weights for policy 0, policy_version 246133 (0.0009) [2023-12-27 20:59:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 126132224. Throughput: 0: 9902.3, 1: 10021.3. Samples: 126135788. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:51,175][105115] Avg episode reward: [(0, '-4.980'), (1, '-6.236')] [2023-12-27 20:59:51,794][106225] Updated weights for policy 1, policy_version 246449 (0.0009) [2023-12-27 20:59:51,853][106225] Updated weights for policy 1, policy_version 246459 (0.0008) [2023-12-27 20:59:51,856][106226] Updated weights for policy 0, policy_version 246143 (0.0008) [2023-12-27 20:59:51,908][106225] Updated weights for policy 1, policy_version 246469 (0.0008) [2023-12-27 20:59:51,910][106226] Updated weights for policy 0, policy_version 246153 (0.0007) [2023-12-27 20:59:51,967][106225] Updated weights for policy 1, policy_version 246479 (0.0008) [2023-12-27 20:59:51,969][106226] Updated weights for policy 0, policy_version 246163 (0.0007) [2023-12-27 20:59:52,727][106226] Updated weights for policy 0, policy_version 246173 (0.0008) [2023-12-27 20:59:52,728][106225] Updated weights for policy 1, policy_version 246489 (0.0009) [2023-12-27 20:59:52,784][106226] Updated weights for policy 0, policy_version 246183 (0.0009) [2023-12-27 20:59:52,786][106225] Updated weights for policy 1, policy_version 246499 (0.0008) [2023-12-27 20:59:52,842][106226] Updated weights for policy 0, policy_version 246193 (0.0006) [2023-12-27 20:59:52,844][106225] Updated weights for policy 1, policy_version 246509 (0.0006) [2023-12-27 20:59:53,554][106225] Updated weights for policy 1, policy_version 246519 (0.0008) [2023-12-27 20:59:53,568][106226] Updated weights for policy 0, policy_version 246203 (0.0007) [2023-12-27 20:59:53,612][106225] Updated weights for policy 1, policy_version 246529 (0.0007) [2023-12-27 20:59:53,615][106226] Updated weights for policy 0, policy_version 246213 (0.0005) [2023-12-27 20:59:53,667][106225] Updated weights for policy 1, policy_version 246539 (0.0007) [2023-12-27 20:59:53,671][106226] Updated weights for policy 0, policy_version 246223 (0.0006) [2023-12-27 20:59:54,343][106226] Updated weights for policy 0, policy_version 246233 (0.0008) [2023-12-27 20:59:54,375][106225] Updated weights for policy 1, policy_version 246549 (0.0009) [2023-12-27 20:59:54,399][106226] Updated weights for policy 0, policy_version 246243 (0.0007) [2023-12-27 20:59:54,428][106225] Updated weights for policy 1, policy_version 246559 (0.0008) [2023-12-27 20:59:54,450][106226] Updated weights for policy 0, policy_version 246253 (0.0007) [2023-12-27 20:59:54,483][106225] Updated weights for policy 1, policy_version 246569 (0.0008) [2023-12-27 20:59:54,501][106226] Updated weights for policy 0, policy_version 246263 (0.0006) [2023-12-27 20:59:55,119][106226] Updated weights for policy 0, policy_version 246273 (0.0006) [2023-12-27 20:59:55,173][106226] Updated weights for policy 0, policy_version 246283 (0.0005) [2023-12-27 20:59:55,227][106226] Updated weights for policy 0, policy_version 246293 (0.0005) [2023-12-27 20:59:55,282][106225] Updated weights for policy 1, policy_version 246579 (0.0007) [2023-12-27 20:59:55,336][106225] Updated weights for policy 1, policy_version 246589 (0.0008) [2023-12-27 20:59:55,387][106225] Updated weights for policy 1, policy_version 246599 (0.0008) [2023-12-27 20:59:55,838][106226] Updated weights for policy 0, policy_version 246303 (0.0007) [2023-12-27 20:59:55,891][106226] Updated weights for policy 0, policy_version 246313 (0.0008) [2023-12-27 20:59:55,943][106226] Updated weights for policy 0, policy_version 246323 (0.0005) [2023-12-27 20:59:56,107][106225] Updated weights for policy 1, policy_version 246609 (0.0008) [2023-12-27 20:59:56,167][106225] Updated weights for policy 1, policy_version 246619 (0.0006) [2023-12-27 20:59:56,175][105115] Fps is (10 sec: 18842.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 126222336. Throughput: 0: 9921.6, 1: 9972.0. Samples: 126192236. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 20:59:56,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-6.503')] [2023-12-27 20:59:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000246328_63078400.pth... [2023-12-27 20:59:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000245176_62783488.pth [2023-12-27 20:59:56,216][106225] Updated weights for policy 1, policy_version 246629 (0.0006) [2023-12-27 20:59:56,275][106225] Updated weights for policy 1, policy_version 246639 (0.0010) [2023-12-27 20:59:56,281][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000246640_63152128.pth... [2023-12-27 20:59:56,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000245456_62849024.pth [2023-12-27 20:59:56,612][106226] Updated weights for policy 0, policy_version 246333 (0.0007) [2023-12-27 20:59:56,658][106226] Updated weights for policy 0, policy_version 246343 (0.0008) [2023-12-27 20:59:56,703][106226] Updated weights for policy 0, policy_version 246353 (0.0009) [2023-12-27 20:59:56,933][106225] Updated weights for policy 1, policy_version 246649 (0.0006) [2023-12-27 20:59:56,997][106225] Updated weights for policy 1, policy_version 246659 (0.0005) [2023-12-27 20:59:57,057][106225] Updated weights for policy 1, policy_version 246669 (0.0005) [2023-12-27 20:59:57,507][106226] Updated weights for policy 0, policy_version 246363 (0.0008) [2023-12-27 20:59:57,565][106226] Updated weights for policy 0, policy_version 246373 (0.0009) [2023-12-27 20:59:57,617][106225] Updated weights for policy 1, policy_version 246679 (0.0005) [2023-12-27 20:59:57,619][106226] Updated weights for policy 0, policy_version 246383 (0.0007) [2023-12-27 20:59:57,672][106225] Updated weights for policy 1, policy_version 246689 (0.0005) [2023-12-27 20:59:57,723][106225] Updated weights for policy 1, policy_version 246699 (0.0006) [2023-12-27 20:59:58,257][106226] Updated weights for policy 0, policy_version 246393 (0.0008) [2023-12-27 20:59:58,320][106226] Updated weights for policy 0, policy_version 246403 (0.0009) [2023-12-27 20:59:58,360][106225] Updated weights for policy 1, policy_version 246709 (0.0006) [2023-12-27 20:59:58,389][106226] Updated weights for policy 0, policy_version 246413 (0.0008) [2023-12-27 20:59:58,422][106225] Updated weights for policy 1, policy_version 246719 (0.0008) [2023-12-27 20:59:58,447][106226] Updated weights for policy 0, policy_version 246423 (0.0008) [2023-12-27 20:59:58,486][106225] Updated weights for policy 1, policy_version 246729 (0.0008) [2023-12-27 20:59:59,262][106226] Updated weights for policy 0, policy_version 246433 (0.0008) [2023-12-27 20:59:59,329][106225] Updated weights for policy 1, policy_version 246739 (0.0008) [2023-12-27 20:59:59,334][106226] Updated weights for policy 0, policy_version 246444 (0.0008) [2023-12-27 20:59:59,400][106225] Updated weights for policy 1, policy_version 246749 (0.0009) [2023-12-27 20:59:59,407][106226] Updated weights for policy 0, policy_version 246454 (0.0008) [2023-12-27 20:59:59,466][106225] Updated weights for policy 1, policy_version 246759 (0.0008) [2023-12-27 21:00:00,144][106226] Updated weights for policy 0, policy_version 246464 (0.0008) [2023-12-27 21:00:00,201][106226] Updated weights for policy 0, policy_version 246474 (0.0009) [2023-12-27 21:00:00,206][106225] Updated weights for policy 1, policy_version 246769 (0.0008) [2023-12-27 21:00:00,261][106226] Updated weights for policy 0, policy_version 246484 (0.0008) [2023-12-27 21:00:00,266][106225] Updated weights for policy 1, policy_version 246779 (0.0009) [2023-12-27 21:00:00,324][106225] Updated weights for policy 1, policy_version 246789 (0.0008) [2023-12-27 21:00:00,381][106225] Updated weights for policy 1, policy_version 246799 (0.0005) [2023-12-27 21:00:00,978][106226] Updated weights for policy 0, policy_version 246494 (0.0010) [2023-12-27 21:00:01,015][106225] Updated weights for policy 1, policy_version 246809 (0.0008) [2023-12-27 21:00:01,030][106226] Updated weights for policy 0, policy_version 246504 (0.0007) [2023-12-27 21:00:01,078][106225] Updated weights for policy 1, policy_version 246819 (0.0008) [2023-12-27 21:00:01,092][106226] Updated weights for policy 0, policy_version 246514 (0.0008) [2023-12-27 21:00:01,140][106225] Updated weights for policy 1, policy_version 246829 (0.0007) [2023-12-27 21:00:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 126328832. Throughput: 0: 9920.5, 1: 9938.9. Samples: 126311132. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 21:00:01,175][105115] Avg episode reward: [(0, '-5.067'), (1, '-6.047')] [2023-12-27 21:00:01,793][106226] Updated weights for policy 0, policy_version 246524 (0.0008) [2023-12-27 21:00:01,846][106226] Updated weights for policy 0, policy_version 246534 (0.0008) [2023-12-27 21:00:01,902][106226] Updated weights for policy 0, policy_version 246544 (0.0009) [2023-12-27 21:00:01,967][106225] Updated weights for policy 1, policy_version 246839 (0.0008) [2023-12-27 21:00:02,029][106225] Updated weights for policy 1, policy_version 246849 (0.0010) [2023-12-27 21:00:02,081][106225] Updated weights for policy 1, policy_version 246859 (0.0009) [2023-12-27 21:00:02,597][106226] Updated weights for policy 0, policy_version 246554 (0.0006) [2023-12-27 21:00:02,660][106226] Updated weights for policy 0, policy_version 246564 (0.0007) [2023-12-27 21:00:02,718][106226] Updated weights for policy 0, policy_version 246574 (0.0005) [2023-12-27 21:00:02,779][106226] Updated weights for policy 0, policy_version 246584 (0.0005) [2023-12-27 21:00:02,806][106225] Updated weights for policy 1, policy_version 246869 (0.0007) [2023-12-27 21:00:02,866][106225] Updated weights for policy 1, policy_version 246879 (0.0008) [2023-12-27 21:00:02,921][106225] Updated weights for policy 1, policy_version 246889 (0.0009) [2023-12-27 21:00:03,492][106226] Updated weights for policy 0, policy_version 246594 (0.0008) [2023-12-27 21:00:03,532][106225] Updated weights for policy 1, policy_version 246899 (0.0008) [2023-12-27 21:00:03,538][106226] Updated weights for policy 0, policy_version 246604 (0.0007) [2023-12-27 21:00:03,579][106225] Updated weights for policy 1, policy_version 246909 (0.0006) [2023-12-27 21:00:03,596][106226] Updated weights for policy 0, policy_version 246614 (0.0007) [2023-12-27 21:00:03,628][106225] Updated weights for policy 1, policy_version 246919 (0.0007) [2023-12-27 21:00:04,387][106225] Updated weights for policy 1, policy_version 246929 (0.0008) [2023-12-27 21:00:04,412][106226] Updated weights for policy 0, policy_version 246624 (0.0008) [2023-12-27 21:00:04,452][106225] Updated weights for policy 1, policy_version 246939 (0.0007) [2023-12-27 21:00:04,481][106226] Updated weights for policy 0, policy_version 246634 (0.0009) [2023-12-27 21:00:04,521][106225] Updated weights for policy 1, policy_version 246949 (0.0007) [2023-12-27 21:00:04,542][106226] Updated weights for policy 0, policy_version 246644 (0.0006) [2023-12-27 21:00:04,580][106225] Updated weights for policy 1, policy_version 246959 (0.0008) [2023-12-27 21:00:05,160][106225] Updated weights for policy 1, policy_version 246969 (0.0010) [2023-12-27 21:00:05,210][106225] Updated weights for policy 1, policy_version 246979 (0.0010) [2023-12-27 21:00:05,264][106225] Updated weights for policy 1, policy_version 246989 (0.0010) [2023-12-27 21:00:05,281][106226] Updated weights for policy 0, policy_version 246654 (0.0006) [2023-12-27 21:00:05,327][106226] Updated weights for policy 0, policy_version 246664 (0.0007) [2023-12-27 21:00:05,383][106226] Updated weights for policy 0, policy_version 246674 (0.0008) [2023-12-27 21:00:05,944][106225] Updated weights for policy 1, policy_version 246999 (0.0007) [2023-12-27 21:00:06,002][106225] Updated weights for policy 1, policy_version 247009 (0.0009) [2023-12-27 21:00:06,052][106225] Updated weights for policy 1, policy_version 247019 (0.0008) [2023-12-27 21:00:06,149][106226] Updated weights for policy 0, policy_version 246684 (0.0008) [2023-12-27 21:00:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 126418944. Throughput: 0: 9839.6, 1: 9946.6. Samples: 126428668. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 21:00:06,175][105115] Avg episode reward: [(0, '-4.973'), (1, '-5.780')] [2023-12-27 21:00:06,216][106226] Updated weights for policy 0, policy_version 246694 (0.0009) [2023-12-27 21:00:06,275][106226] Updated weights for policy 0, policy_version 246704 (0.0010) [2023-12-27 21:00:06,756][106225] Updated weights for policy 1, policy_version 247029 (0.0009) [2023-12-27 21:00:06,810][106225] Updated weights for policy 1, policy_version 247039 (0.0009) [2023-12-27 21:00:06,869][106225] Updated weights for policy 1, policy_version 247049 (0.0008) [2023-12-27 21:00:06,937][106226] Updated weights for policy 0, policy_version 246714 (0.0006) [2023-12-27 21:00:06,992][106226] Updated weights for policy 0, policy_version 246724 (0.0007) [2023-12-27 21:00:07,048][106226] Updated weights for policy 0, policy_version 246734 (0.0009) [2023-12-27 21:00:07,108][106226] Updated weights for policy 0, policy_version 246744 (0.0009) [2023-12-27 21:00:07,642][106225] Updated weights for policy 1, policy_version 247059 (0.0009) [2023-12-27 21:00:07,701][106225] Updated weights for policy 1, policy_version 247069 (0.0010) [2023-12-27 21:00:07,738][106226] Updated weights for policy 0, policy_version 246754 (0.0007) [2023-12-27 21:00:07,756][106225] Updated weights for policy 1, policy_version 247079 (0.0006) [2023-12-27 21:00:07,798][106226] Updated weights for policy 0, policy_version 246764 (0.0007) [2023-12-27 21:00:07,857][106226] Updated weights for policy 0, policy_version 246774 (0.0009) [2023-12-27 21:00:08,464][106226] Updated weights for policy 0, policy_version 246784 (0.0008) [2023-12-27 21:00:08,524][106226] Updated weights for policy 0, policy_version 246794 (0.0008) [2023-12-27 21:00:08,528][106225] Updated weights for policy 1, policy_version 247089 (0.0007) [2023-12-27 21:00:08,585][106225] Updated weights for policy 1, policy_version 247099 (0.0006) [2023-12-27 21:00:08,587][106226] Updated weights for policy 0, policy_version 246804 (0.0006) [2023-12-27 21:00:08,653][106225] Updated weights for policy 1, policy_version 247109 (0.0007) [2023-12-27 21:00:08,725][106225] Updated weights for policy 1, policy_version 247119 (0.0006) [2023-12-27 21:00:09,172][106226] Updated weights for policy 0, policy_version 246814 (0.0008) [2023-12-27 21:00:09,245][106226] Updated weights for policy 0, policy_version 246824 (0.0010) [2023-12-27 21:00:09,290][106225] Updated weights for policy 1, policy_version 247129 (0.0008) [2023-12-27 21:00:09,301][106226] Updated weights for policy 0, policy_version 246834 (0.0007) [2023-12-27 21:00:09,351][106225] Updated weights for policy 1, policy_version 247139 (0.0009) [2023-12-27 21:00:09,422][106225] Updated weights for policy 1, policy_version 247149 (0.0008) [2023-12-27 21:00:10,101][106226] Updated weights for policy 0, policy_version 246844 (0.0008) [2023-12-27 21:00:10,170][106226] Updated weights for policy 0, policy_version 246854 (0.0009) [2023-12-27 21:00:10,176][106225] Updated weights for policy 1, policy_version 247159 (0.0008) [2023-12-27 21:00:10,232][106226] Updated weights for policy 0, policy_version 246864 (0.0006) [2023-12-27 21:00:10,238][106225] Updated weights for policy 1, policy_version 247169 (0.0007) [2023-12-27 21:00:10,294][106225] Updated weights for policy 1, policy_version 247179 (0.0007) [2023-12-27 21:00:10,944][106226] Updated weights for policy 0, policy_version 246874 (0.0008) [2023-12-27 21:00:10,992][106225] Updated weights for policy 1, policy_version 247189 (0.0009) [2023-12-27 21:00:11,003][106226] Updated weights for policy 0, policy_version 246884 (0.0008) [2023-12-27 21:00:11,064][106225] Updated weights for policy 1, policy_version 247199 (0.0008) [2023-12-27 21:00:11,082][106226] Updated weights for policy 0, policy_version 246894 (0.0008) [2023-12-27 21:00:11,130][106225] Updated weights for policy 1, policy_version 247209 (0.0007) [2023-12-27 21:00:11,149][106226] Updated weights for policy 0, policy_version 246904 (0.0008) [2023-12-27 21:00:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 126517248. Throughput: 0: 9916.8, 1: 9958.0. Samples: 126489104. Policy #0 lag: (min: 15.0, avg: 19.3, max: 47.0) [2023-12-27 21:00:11,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-6.332')] [2023-12-27 21:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000246904_63225856.pth... [2023-12-27 21:00:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000247216_63299584.pth... [2023-12-27 21:00:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000245752_62930944.pth [2023-12-27 21:00:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000246064_63004672.pth [2023-12-27 21:00:11,939][106226] Updated weights for policy 0, policy_version 246914 (0.0009) [2023-12-27 21:00:11,947][106225] Updated weights for policy 1, policy_version 247219 (0.0007) [2023-12-27 21:00:12,000][106226] Updated weights for policy 0, policy_version 246924 (0.0007) [2023-12-27 21:00:12,002][106225] Updated weights for policy 1, policy_version 247229 (0.0006) [2023-12-27 21:00:12,054][106226] Updated weights for policy 0, policy_version 246934 (0.0006) [2023-12-27 21:00:12,061][106225] Updated weights for policy 1, policy_version 247239 (0.0006) [2023-12-27 21:00:12,686][106225] Updated weights for policy 1, policy_version 247249 (0.0005) [2023-12-27 21:00:12,750][106225] Updated weights for policy 1, policy_version 247259 (0.0006) [2023-12-27 21:00:12,810][106226] Updated weights for policy 0, policy_version 246944 (0.0007) [2023-12-27 21:00:12,816][106225] Updated weights for policy 1, policy_version 247269 (0.0008) [2023-12-27 21:00:12,868][106226] Updated weights for policy 0, policy_version 246954 (0.0007) [2023-12-27 21:00:12,875][106225] Updated weights for policy 1, policy_version 247279 (0.0008) [2023-12-27 21:00:12,935][106226] Updated weights for policy 0, policy_version 246964 (0.0010) [2023-12-27 21:00:13,498][106225] Updated weights for policy 1, policy_version 247289 (0.0006) [2023-12-27 21:00:13,549][106225] Updated weights for policy 1, policy_version 247299 (0.0005) [2023-12-27 21:00:13,549][106226] Updated weights for policy 0, policy_version 246974 (0.0009) [2023-12-27 21:00:13,602][106225] Updated weights for policy 1, policy_version 247309 (0.0005) [2023-12-27 21:00:13,605][106226] Updated weights for policy 0, policy_version 246984 (0.0010) [2023-12-27 21:00:13,661][106226] Updated weights for policy 0, policy_version 246994 (0.0008) [2023-12-27 21:00:14,277][106225] Updated weights for policy 1, policy_version 247319 (0.0009) [2023-12-27 21:00:14,336][106225] Updated weights for policy 1, policy_version 247329 (0.0010) [2023-12-27 21:00:14,377][106226] Updated weights for policy 0, policy_version 247004 (0.0011) [2023-12-27 21:00:14,393][106225] Updated weights for policy 1, policy_version 247339 (0.0010) [2023-12-27 21:00:14,436][106226] Updated weights for policy 0, policy_version 247014 (0.0010) [2023-12-27 21:00:14,492][106226] Updated weights for policy 0, policy_version 247024 (0.0010) [2023-12-27 21:00:15,120][106225] Updated weights for policy 1, policy_version 247349 (0.0009) [2023-12-27 21:00:15,182][106225] Updated weights for policy 1, policy_version 247359 (0.0010) [2023-12-27 21:00:15,205][106226] Updated weights for policy 0, policy_version 247034 (0.0010) [2023-12-27 21:00:15,241][106225] Updated weights for policy 1, policy_version 247369 (0.0010) [2023-12-27 21:00:15,270][106226] Updated weights for policy 0, policy_version 247044 (0.0011) [2023-12-27 21:00:15,335][106226] Updated weights for policy 0, policy_version 247054 (0.0006) [2023-12-27 21:00:15,401][106226] Updated weights for policy 0, policy_version 247064 (0.0008) [2023-12-27 21:00:15,947][106225] Updated weights for policy 1, policy_version 247379 (0.0010) [2023-12-27 21:00:16,007][106225] Updated weights for policy 1, policy_version 247389 (0.0010) [2023-12-27 21:00:16,052][106226] Updated weights for policy 0, policy_version 247074 (0.0005) [2023-12-27 21:00:16,067][106225] Updated weights for policy 1, policy_version 247399 (0.0010) [2023-12-27 21:00:16,107][106226] Updated weights for policy 0, policy_version 247084 (0.0009) [2023-12-27 21:00:16,156][106226] Updated weights for policy 0, policy_version 247094 (0.0010) [2023-12-27 21:00:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 126623744. Throughput: 0: 9812.5, 1: 9869.9. Samples: 126607020. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:16,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-6.048')] [2023-12-27 21:00:16,739][106225] Updated weights for policy 1, policy_version 247409 (0.0010) [2023-12-27 21:00:16,800][106225] Updated weights for policy 1, policy_version 247419 (0.0008) [2023-12-27 21:00:16,860][106225] Updated weights for policy 1, policy_version 247429 (0.0010) [2023-12-27 21:00:16,862][106226] Updated weights for policy 0, policy_version 247104 (0.0009) [2023-12-27 21:00:16,915][106226] Updated weights for policy 0, policy_version 247114 (0.0007) [2023-12-27 21:00:16,919][106225] Updated weights for policy 1, policy_version 247439 (0.0010) [2023-12-27 21:00:16,965][106226] Updated weights for policy 0, policy_version 247124 (0.0007) [2023-12-27 21:00:17,589][106225] Updated weights for policy 1, policy_version 247449 (0.0008) [2023-12-27 21:00:17,638][106225] Updated weights for policy 1, policy_version 247459 (0.0006) [2023-12-27 21:00:17,692][106225] Updated weights for policy 1, policy_version 247469 (0.0006) [2023-12-27 21:00:17,710][106226] Updated weights for policy 0, policy_version 247134 (0.0007) [2023-12-27 21:00:17,771][106226] Updated weights for policy 0, policy_version 247144 (0.0009) [2023-12-27 21:00:17,831][106226] Updated weights for policy 0, policy_version 247154 (0.0008) [2023-12-27 21:00:18,387][106225] Updated weights for policy 1, policy_version 247479 (0.0008) [2023-12-27 21:00:18,450][106225] Updated weights for policy 1, policy_version 247489 (0.0009) [2023-12-27 21:00:18,507][106225] Updated weights for policy 1, policy_version 247499 (0.0009) [2023-12-27 21:00:18,628][106226] Updated weights for policy 0, policy_version 247164 (0.0008) [2023-12-27 21:00:18,681][106226] Updated weights for policy 0, policy_version 247174 (0.0008) [2023-12-27 21:00:18,739][106226] Updated weights for policy 0, policy_version 247184 (0.0008) [2023-12-27 21:00:19,165][106225] Updated weights for policy 1, policy_version 247509 (0.0009) [2023-12-27 21:00:19,221][106225] Updated weights for policy 1, policy_version 247519 (0.0007) [2023-12-27 21:00:19,284][106225] Updated weights for policy 1, policy_version 247529 (0.0007) [2023-12-27 21:00:19,561][106226] Updated weights for policy 0, policy_version 247194 (0.0009) [2023-12-27 21:00:19,618][106226] Updated weights for policy 0, policy_version 247204 (0.0010) [2023-12-27 21:00:19,676][106226] Updated weights for policy 0, policy_version 247214 (0.0009) [2023-12-27 21:00:19,743][106226] Updated weights for policy 0, policy_version 247224 (0.0009) [2023-12-27 21:00:19,949][106225] Updated weights for policy 1, policy_version 247539 (0.0007) [2023-12-27 21:00:20,012][106225] Updated weights for policy 1, policy_version 247549 (0.0009) [2023-12-27 21:00:20,072][106225] Updated weights for policy 1, policy_version 247559 (0.0009) [2023-12-27 21:00:20,527][106226] Updated weights for policy 0, policy_version 247234 (0.0009) [2023-12-27 21:00:20,596][106226] Updated weights for policy 0, policy_version 247244 (0.0008) [2023-12-27 21:00:20,663][106226] Updated weights for policy 0, policy_version 247254 (0.0008) [2023-12-27 21:00:20,771][106225] Updated weights for policy 1, policy_version 247569 (0.0008) [2023-12-27 21:00:20,829][106225] Updated weights for policy 1, policy_version 247579 (0.0008) [2023-12-27 21:00:20,881][106225] Updated weights for policy 1, policy_version 247589 (0.0008) [2023-12-27 21:00:20,944][106225] Updated weights for policy 1, policy_version 247599 (0.0008) [2023-12-27 21:00:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 126713856. Throughput: 0: 9682.4, 1: 9921.8. Samples: 126723312. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:21,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-6.610')] [2023-12-27 21:00:21,479][106226] Updated weights for policy 0, policy_version 247264 (0.0008) [2023-12-27 21:00:21,550][106226] Updated weights for policy 0, policy_version 247274 (0.0008) [2023-12-27 21:00:21,616][106226] Updated weights for policy 0, policy_version 247284 (0.0008) [2023-12-27 21:00:21,753][106225] Updated weights for policy 1, policy_version 247609 (0.0009) [2023-12-27 21:00:21,822][106225] Updated weights for policy 1, policy_version 247619 (0.0007) [2023-12-27 21:00:21,884][106225] Updated weights for policy 1, policy_version 247629 (0.0007) [2023-12-27 21:00:22,385][106226] Updated weights for policy 0, policy_version 247294 (0.0009) [2023-12-27 21:00:22,450][106226] Updated weights for policy 0, policy_version 247304 (0.0009) [2023-12-27 21:00:22,512][106226] Updated weights for policy 0, policy_version 247314 (0.0009) [2023-12-27 21:00:22,624][106225] Updated weights for policy 1, policy_version 247639 (0.0008) [2023-12-27 21:00:22,686][106225] Updated weights for policy 1, policy_version 247649 (0.0009) [2023-12-27 21:00:22,743][106225] Updated weights for policy 1, policy_version 247659 (0.0009) [2023-12-27 21:00:23,313][106226] Updated weights for policy 0, policy_version 247324 (0.0008) [2023-12-27 21:00:23,370][106226] Updated weights for policy 0, policy_version 247334 (0.0008) [2023-12-27 21:00:23,429][106226] Updated weights for policy 0, policy_version 247344 (0.0008) [2023-12-27 21:00:23,432][106225] Updated weights for policy 1, policy_version 247669 (0.0010) [2023-12-27 21:00:23,492][106225] Updated weights for policy 1, policy_version 247679 (0.0010) [2023-12-27 21:00:23,548][106225] Updated weights for policy 1, policy_version 247689 (0.0010) [2023-12-27 21:00:24,096][106225] Updated weights for policy 1, policy_version 247699 (0.0007) [2023-12-27 21:00:24,156][106225] Updated weights for policy 1, policy_version 247709 (0.0006) [2023-12-27 21:00:24,182][106226] Updated weights for policy 0, policy_version 247354 (0.0009) [2023-12-27 21:00:24,210][106225] Updated weights for policy 1, policy_version 247719 (0.0006) [2023-12-27 21:00:24,251][106226] Updated weights for policy 0, policy_version 247364 (0.0007) [2023-12-27 21:00:24,317][106226] Updated weights for policy 0, policy_version 247374 (0.0008) [2023-12-27 21:00:24,375][106226] Updated weights for policy 0, policy_version 247384 (0.0007) [2023-12-27 21:00:24,824][106225] Updated weights for policy 1, policy_version 247729 (0.0007) [2023-12-27 21:00:24,889][106225] Updated weights for policy 1, policy_version 247739 (0.0006) [2023-12-27 21:00:24,956][106225] Updated weights for policy 1, policy_version 247749 (0.0006) [2023-12-27 21:00:25,007][106226] Updated weights for policy 0, policy_version 247394 (0.0006) [2023-12-27 21:00:25,016][106225] Updated weights for policy 1, policy_version 247759 (0.0010) [2023-12-27 21:00:25,066][106226] Updated weights for policy 0, policy_version 247404 (0.0008) [2023-12-27 21:00:25,129][106226] Updated weights for policy 0, policy_version 247414 (0.0007) [2023-12-27 21:00:25,640][106225] Updated weights for policy 1, policy_version 247769 (0.0010) [2023-12-27 21:00:25,700][106225] Updated weights for policy 1, policy_version 247779 (0.0010) [2023-12-27 21:00:25,760][106225] Updated weights for policy 1, policy_version 247789 (0.0010) [2023-12-27 21:00:25,831][106226] Updated weights for policy 0, policy_version 247424 (0.0007) [2023-12-27 21:00:25,893][106226] Updated weights for policy 0, policy_version 247434 (0.0008) [2023-12-27 21:00:25,959][106226] Updated weights for policy 0, policy_version 247444 (0.0008) [2023-12-27 21:00:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 126812160. Throughput: 0: 9661.6, 1: 9842.2. Samples: 126778448. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:26,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-6.429')] [2023-12-27 21:00:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000247792_63447040.pth... [2023-12-27 21:00:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000247448_63365120.pth... [2023-12-27 21:00:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000246640_63152128.pth [2023-12-27 21:00:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000246328_63078400.pth [2023-12-27 21:00:26,471][106225] Updated weights for policy 1, policy_version 247799 (0.0010) [2023-12-27 21:00:26,514][106225] Updated weights for policy 1, policy_version 247809 (0.0010) [2023-12-27 21:00:26,560][106225] Updated weights for policy 1, policy_version 247819 (0.0010) [2023-12-27 21:00:26,626][106226] Updated weights for policy 0, policy_version 247454 (0.0007) [2023-12-27 21:00:26,682][106226] Updated weights for policy 0, policy_version 247464 (0.0005) [2023-12-27 21:00:26,735][106226] Updated weights for policy 0, policy_version 247474 (0.0006) [2023-12-27 21:00:27,262][106226] Updated weights for policy 0, policy_version 247484 (0.0006) [2023-12-27 21:00:27,309][106225] Updated weights for policy 1, policy_version 247829 (0.0010) [2023-12-27 21:00:27,325][106226] Updated weights for policy 0, policy_version 247494 (0.0007) [2023-12-27 21:00:27,369][106225] Updated weights for policy 1, policy_version 247839 (0.0010) [2023-12-27 21:00:27,385][106226] Updated weights for policy 0, policy_version 247504 (0.0010) [2023-12-27 21:00:27,428][106225] Updated weights for policy 1, policy_version 247849 (0.0006) [2023-12-27 21:00:27,991][106225] Updated weights for policy 1, policy_version 247859 (0.0009) [2023-12-27 21:00:28,038][106226] Updated weights for policy 0, policy_version 247514 (0.0010) [2023-12-27 21:00:28,040][106225] Updated weights for policy 1, policy_version 247869 (0.0007) [2023-12-27 21:00:28,091][106226] Updated weights for policy 0, policy_version 247524 (0.0005) [2023-12-27 21:00:28,092][106225] Updated weights for policy 1, policy_version 247879 (0.0008) [2023-12-27 21:00:28,153][106226] Updated weights for policy 0, policy_version 247534 (0.0005) [2023-12-27 21:00:28,218][106226] Updated weights for policy 0, policy_version 247544 (0.0005) [2023-12-27 21:00:28,736][106225] Updated weights for policy 1, policy_version 247889 (0.0009) [2023-12-27 21:00:28,757][106226] Updated weights for policy 0, policy_version 247554 (0.0006) [2023-12-27 21:00:28,797][106225] Updated weights for policy 1, policy_version 247899 (0.0007) [2023-12-27 21:00:28,814][106226] Updated weights for policy 0, policy_version 247564 (0.0008) [2023-12-27 21:00:28,857][106225] Updated weights for policy 1, policy_version 247909 (0.0007) [2023-12-27 21:00:28,875][106226] Updated weights for policy 0, policy_version 247574 (0.0008) [2023-12-27 21:00:28,918][106225] Updated weights for policy 1, policy_version 247919 (0.0007) [2023-12-27 21:00:29,598][106226] Updated weights for policy 0, policy_version 247584 (0.0007) [2023-12-27 21:00:29,643][106225] Updated weights for policy 1, policy_version 247929 (0.0008) [2023-12-27 21:00:29,653][106226] Updated weights for policy 0, policy_version 247594 (0.0006) [2023-12-27 21:00:29,703][106225] Updated weights for policy 1, policy_version 247939 (0.0007) [2023-12-27 21:00:29,714][106226] Updated weights for policy 0, policy_version 247604 (0.0007) [2023-12-27 21:00:29,766][106225] Updated weights for policy 1, policy_version 247949 (0.0009) [2023-12-27 21:00:30,380][106226] Updated weights for policy 0, policy_version 247614 (0.0006) [2023-12-27 21:00:30,425][106225] Updated weights for policy 1, policy_version 247959 (0.0008) [2023-12-27 21:00:30,446][106226] Updated weights for policy 0, policy_version 247624 (0.0006) [2023-12-27 21:00:30,481][106225] Updated weights for policy 1, policy_version 247969 (0.0010) [2023-12-27 21:00:30,505][106226] Updated weights for policy 0, policy_version 247634 (0.0005) [2023-12-27 21:00:30,537][106225] Updated weights for policy 1, policy_version 247979 (0.0010) [2023-12-27 21:00:31,019][106226] Updated weights for policy 0, policy_version 247644 (0.0006) [2023-12-27 21:00:31,080][106226] Updated weights for policy 0, policy_version 247654 (0.0007) [2023-12-27 21:00:31,148][106226] Updated weights for policy 0, policy_version 247664 (0.0008) [2023-12-27 21:00:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 126910464. Throughput: 0: 9769.4, 1: 9936.5. Samples: 126904832. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:31,175][105115] Avg episode reward: [(0, '-5.076'), (1, '-6.422')] [2023-12-27 21:00:31,176][106225] Updated weights for policy 1, policy_version 247989 (0.0010) [2023-12-27 21:00:31,227][106225] Updated weights for policy 1, policy_version 247999 (0.0007) [2023-12-27 21:00:31,292][106225] Updated weights for policy 1, policy_version 248009 (0.0011) [2023-12-27 21:00:31,933][106226] Updated weights for policy 0, policy_version 247674 (0.0008) [2023-12-27 21:00:31,991][106226] Updated weights for policy 0, policy_version 247684 (0.0010) [2023-12-27 21:00:32,046][106225] Updated weights for policy 1, policy_version 248019 (0.0010) [2023-12-27 21:00:32,048][106226] Updated weights for policy 0, policy_version 247694 (0.0010) [2023-12-27 21:00:32,105][106226] Updated weights for policy 0, policy_version 247704 (0.0010) [2023-12-27 21:00:32,107][106225] Updated weights for policy 1, policy_version 248029 (0.0010) [2023-12-27 21:00:32,164][106225] Updated weights for policy 1, policy_version 248039 (0.0010) [2023-12-27 21:00:32,834][106225] Updated weights for policy 1, policy_version 248049 (0.0010) [2023-12-27 21:00:32,841][106226] Updated weights for policy 0, policy_version 247714 (0.0010) [2023-12-27 21:00:32,897][106225] Updated weights for policy 1, policy_version 248059 (0.0011) [2023-12-27 21:00:32,901][106226] Updated weights for policy 0, policy_version 247724 (0.0008) [2023-12-27 21:00:32,952][106225] Updated weights for policy 1, policy_version 248069 (0.0010) [2023-12-27 21:00:32,964][106226] Updated weights for policy 0, policy_version 247734 (0.0008) [2023-12-27 21:00:33,015][106225] Updated weights for policy 1, policy_version 248079 (0.0010) [2023-12-27 21:00:33,640][106225] Updated weights for policy 1, policy_version 248089 (0.0008) [2023-12-27 21:00:33,645][106226] Updated weights for policy 0, policy_version 247744 (0.0010) [2023-12-27 21:00:33,696][106225] Updated weights for policy 1, policy_version 248099 (0.0006) [2023-12-27 21:00:33,702][106226] Updated weights for policy 0, policy_version 247754 (0.0010) [2023-12-27 21:00:33,750][106226] Updated weights for policy 0, policy_version 247764 (0.0008) [2023-12-27 21:00:33,765][106225] Updated weights for policy 1, policy_version 248109 (0.0005) [2023-12-27 21:00:34,372][106225] Updated weights for policy 1, policy_version 248119 (0.0009) [2023-12-27 21:00:34,436][106225] Updated weights for policy 1, policy_version 248129 (0.0010) [2023-12-27 21:00:34,464][106226] Updated weights for policy 0, policy_version 247774 (0.0007) [2023-12-27 21:00:34,493][106225] Updated weights for policy 1, policy_version 248139 (0.0010) [2023-12-27 21:00:34,538][106226] Updated weights for policy 0, policy_version 247784 (0.0008) [2023-12-27 21:00:34,595][106226] Updated weights for policy 0, policy_version 247794 (0.0008) [2023-12-27 21:00:35,165][106225] Updated weights for policy 1, policy_version 248149 (0.0011) [2023-12-27 21:00:35,225][106225] Updated weights for policy 1, policy_version 248159 (0.0010) [2023-12-27 21:00:35,254][106226] Updated weights for policy 0, policy_version 247804 (0.0009) [2023-12-27 21:00:35,282][106225] Updated weights for policy 1, policy_version 248169 (0.0010) [2023-12-27 21:00:35,302][106226] Updated weights for policy 0, policy_version 247814 (0.0010) [2023-12-27 21:00:35,348][106226] Updated weights for policy 0, policy_version 247824 (0.0010) [2023-12-27 21:00:35,946][106225] Updated weights for policy 1, policy_version 248179 (0.0009) [2023-12-27 21:00:36,004][106225] Updated weights for policy 1, policy_version 248189 (0.0007) [2023-12-27 21:00:36,008][106226] Updated weights for policy 0, policy_version 247834 (0.0009) [2023-12-27 21:00:36,054][106225] Updated weights for policy 1, policy_version 248199 (0.0008) [2023-12-27 21:00:36,074][106226] Updated weights for policy 0, policy_version 247844 (0.0006) [2023-12-27 21:00:36,148][106226] Updated weights for policy 0, policy_version 247854 (0.0009) [2023-12-27 21:00:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 127016960. Throughput: 0: 9826.8, 1: 9993.7. Samples: 127027708. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:36,175][105115] Avg episode reward: [(0, '-4.921'), (1, '-6.515')] [2023-12-27 21:00:36,218][106226] Updated weights for policy 0, policy_version 247864 (0.0009) [2023-12-27 21:00:36,720][106225] Updated weights for policy 1, policy_version 248209 (0.0006) [2023-12-27 21:00:36,789][106225] Updated weights for policy 1, policy_version 248219 (0.0008) [2023-12-27 21:00:36,854][106225] Updated weights for policy 1, policy_version 248229 (0.0007) [2023-12-27 21:00:36,877][106226] Updated weights for policy 0, policy_version 247874 (0.0006) [2023-12-27 21:00:36,918][106225] Updated weights for policy 1, policy_version 248239 (0.0006) [2023-12-27 21:00:36,940][106226] Updated weights for policy 0, policy_version 247884 (0.0006) [2023-12-27 21:00:36,998][106226] Updated weights for policy 0, policy_version 247894 (0.0006) [2023-12-27 21:00:37,610][106226] Updated weights for policy 0, policy_version 247904 (0.0009) [2023-12-27 21:00:37,661][106226] Updated weights for policy 0, policy_version 247914 (0.0006) [2023-12-27 21:00:37,679][106225] Updated weights for policy 1, policy_version 248249 (0.0009) [2023-12-27 21:00:37,721][106226] Updated weights for policy 0, policy_version 247924 (0.0006) [2023-12-27 21:00:37,738][106225] Updated weights for policy 1, policy_version 248259 (0.0007) [2023-12-27 21:00:37,797][106225] Updated weights for policy 1, policy_version 248269 (0.0008) [2023-12-27 21:00:38,427][106225] Updated weights for policy 1, policy_version 248279 (0.0009) [2023-12-27 21:00:38,488][106225] Updated weights for policy 1, policy_version 248289 (0.0006) [2023-12-27 21:00:38,506][106226] Updated weights for policy 0, policy_version 247934 (0.0007) [2023-12-27 21:00:38,548][106225] Updated weights for policy 1, policy_version 248299 (0.0007) [2023-12-27 21:00:38,568][106226] Updated weights for policy 0, policy_version 247944 (0.0007) [2023-12-27 21:00:38,629][106226] Updated weights for policy 0, policy_version 247954 (0.0008) [2023-12-27 21:00:39,293][106226] Updated weights for policy 0, policy_version 247964 (0.0008) [2023-12-27 21:00:39,319][106225] Updated weights for policy 1, policy_version 248309 (0.0008) [2023-12-27 21:00:39,356][106226] Updated weights for policy 0, policy_version 247974 (0.0007) [2023-12-27 21:00:39,385][106225] Updated weights for policy 1, policy_version 248319 (0.0008) [2023-12-27 21:00:39,426][106226] Updated weights for policy 0, policy_version 247984 (0.0009) [2023-12-27 21:00:39,457][106225] Updated weights for policy 1, policy_version 248329 (0.0007) [2023-12-27 21:00:40,154][106225] Updated weights for policy 1, policy_version 248339 (0.0009) [2023-12-27 21:00:40,180][106226] Updated weights for policy 0, policy_version 247994 (0.0009) [2023-12-27 21:00:40,221][106225] Updated weights for policy 1, policy_version 248349 (0.0010) [2023-12-27 21:00:40,247][106226] Updated weights for policy 0, policy_version 248004 (0.0010) [2023-12-27 21:00:40,285][106225] Updated weights for policy 1, policy_version 248359 (0.0010) [2023-12-27 21:00:40,309][106226] Updated weights for policy 0, policy_version 248014 (0.0010) [2023-12-27 21:00:40,368][106226] Updated weights for policy 0, policy_version 248024 (0.0009) [2023-12-27 21:00:41,022][106225] Updated weights for policy 1, policy_version 248369 (0.0010) [2023-12-27 21:00:41,075][106226] Updated weights for policy 0, policy_version 248034 (0.0010) [2023-12-27 21:00:41,086][106225] Updated weights for policy 1, policy_version 248379 (0.0009) [2023-12-27 21:00:41,138][106226] Updated weights for policy 0, policy_version 248044 (0.0007) [2023-12-27 21:00:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 127107072. Throughput: 0: 9848.3, 1: 10049.3. Samples: 127087632. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:41,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.973')] [2023-12-27 21:00:41,184][106225] Updated weights for policy 1, policy_version 248389 (0.0009) [2023-12-27 21:00:41,200][106226] Updated weights for policy 0, policy_version 248054 (0.0008) [2023-12-27 21:00:41,211][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000248056_63520768.pth... [2023-12-27 21:00:41,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000246904_63225856.pth [2023-12-27 21:00:41,247][106225] Updated weights for policy 1, policy_version 248399 (0.0008) [2023-12-27 21:00:41,253][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000248400_63602688.pth... [2023-12-27 21:00:41,258][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000247216_63299584.pth [2023-12-27 21:00:41,962][106226] Updated weights for policy 0, policy_version 248064 (0.0008) [2023-12-27 21:00:41,992][106225] Updated weights for policy 1, policy_version 248409 (0.0006) [2023-12-27 21:00:42,025][106226] Updated weights for policy 0, policy_version 248074 (0.0010) [2023-12-27 21:00:42,056][106225] Updated weights for policy 1, policy_version 248419 (0.0007) [2023-12-27 21:00:42,086][106226] Updated weights for policy 0, policy_version 248084 (0.0008) [2023-12-27 21:00:42,112][106225] Updated weights for policy 1, policy_version 248429 (0.0006) [2023-12-27 21:00:42,826][106226] Updated weights for policy 0, policy_version 248094 (0.0008) [2023-12-27 21:00:42,865][106225] Updated weights for policy 1, policy_version 248439 (0.0007) [2023-12-27 21:00:42,888][106226] Updated weights for policy 0, policy_version 248104 (0.0010) [2023-12-27 21:00:42,920][106225] Updated weights for policy 1, policy_version 248449 (0.0008) [2023-12-27 21:00:42,949][106226] Updated weights for policy 0, policy_version 248114 (0.0006) [2023-12-27 21:00:42,979][106225] Updated weights for policy 1, policy_version 248459 (0.0006) [2023-12-27 21:00:43,622][106225] Updated weights for policy 1, policy_version 248469 (0.0009) [2023-12-27 21:00:43,682][106225] Updated weights for policy 1, policy_version 248479 (0.0008) [2023-12-27 21:00:43,693][106226] Updated weights for policy 0, policy_version 248124 (0.0009) [2023-12-27 21:00:43,743][106225] Updated weights for policy 1, policy_version 248489 (0.0005) [2023-12-27 21:00:43,759][106226] Updated weights for policy 0, policy_version 248134 (0.0008) [2023-12-27 21:00:43,835][106226] Updated weights for policy 0, policy_version 248144 (0.0008) [2023-12-27 21:00:44,287][106225] Updated weights for policy 1, policy_version 248499 (0.0005) [2023-12-27 21:00:44,349][106225] Updated weights for policy 1, policy_version 248509 (0.0005) [2023-12-27 21:00:44,410][106225] Updated weights for policy 1, policy_version 248519 (0.0007) [2023-12-27 21:00:44,589][106226] Updated weights for policy 0, policy_version 248154 (0.0008) [2023-12-27 21:00:44,651][106226] Updated weights for policy 0, policy_version 248164 (0.0008) [2023-12-27 21:00:44,717][106226] Updated weights for policy 0, policy_version 248174 (0.0007) [2023-12-27 21:00:44,789][106226] Updated weights for policy 0, policy_version 248184 (0.0008) [2023-12-27 21:00:45,079][106225] Updated weights for policy 1, policy_version 248529 (0.0008) [2023-12-27 21:00:45,141][106225] Updated weights for policy 1, policy_version 248539 (0.0006) [2023-12-27 21:00:45,204][106225] Updated weights for policy 1, policy_version 248549 (0.0008) [2023-12-27 21:00:45,263][106225] Updated weights for policy 1, policy_version 248559 (0.0006) [2023-12-27 21:00:45,539][106226] Updated weights for policy 0, policy_version 248194 (0.0009) [2023-12-27 21:00:45,599][106226] Updated weights for policy 0, policy_version 248204 (0.0008) [2023-12-27 21:00:45,666][106226] Updated weights for policy 0, policy_version 248214 (0.0009) [2023-12-27 21:00:45,933][106225] Updated weights for policy 1, policy_version 248569 (0.0007) [2023-12-27 21:00:45,991][106225] Updated weights for policy 1, policy_version 248579 (0.0008) [2023-12-27 21:00:46,045][106225] Updated weights for policy 1, policy_version 248589 (0.0008) [2023-12-27 21:00:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 127213568. Throughput: 0: 9744.1, 1: 10051.1. Samples: 127201916. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:46,176][105115] Avg episode reward: [(0, '-4.936'), (1, '-6.246')] [2023-12-27 21:00:46,405][106226] Updated weights for policy 0, policy_version 248224 (0.0006) [2023-12-27 21:00:46,466][106226] Updated weights for policy 0, policy_version 248234 (0.0005) [2023-12-27 21:00:46,522][106226] Updated weights for policy 0, policy_version 248244 (0.0005) [2023-12-27 21:00:46,777][106225] Updated weights for policy 1, policy_version 248599 (0.0009) [2023-12-27 21:00:46,838][106225] Updated weights for policy 1, policy_version 248609 (0.0010) [2023-12-27 21:00:46,895][106225] Updated weights for policy 1, policy_version 248619 (0.0010) [2023-12-27 21:00:47,173][106226] Updated weights for policy 0, policy_version 248254 (0.0008) [2023-12-27 21:00:47,229][106226] Updated weights for policy 0, policy_version 248264 (0.0008) [2023-12-27 21:00:47,280][106226] Updated weights for policy 0, policy_version 248274 (0.0006) [2023-12-27 21:00:47,582][106225] Updated weights for policy 1, policy_version 248629 (0.0009) [2023-12-27 21:00:47,640][106225] Updated weights for policy 1, policy_version 248639 (0.0006) [2023-12-27 21:00:47,709][106225] Updated weights for policy 1, policy_version 248649 (0.0007) [2023-12-27 21:00:48,064][106226] Updated weights for policy 0, policy_version 248284 (0.0009) [2023-12-27 21:00:48,126][106226] Updated weights for policy 0, policy_version 248294 (0.0008) [2023-12-27 21:00:48,187][106226] Updated weights for policy 0, policy_version 248304 (0.0008) [2023-12-27 21:00:48,347][106225] Updated weights for policy 1, policy_version 248659 (0.0008) [2023-12-27 21:00:48,406][106225] Updated weights for policy 1, policy_version 248669 (0.0011) [2023-12-27 21:00:48,455][106225] Updated weights for policy 1, policy_version 248679 (0.0010) [2023-12-27 21:00:48,876][106226] Updated weights for policy 0, policy_version 248314 (0.0008) [2023-12-27 21:00:48,938][106226] Updated weights for policy 0, policy_version 248324 (0.0010) [2023-12-27 21:00:48,997][106226] Updated weights for policy 0, policy_version 248334 (0.0009) [2023-12-27 21:00:49,062][106226] Updated weights for policy 0, policy_version 248344 (0.0008) [2023-12-27 21:00:49,149][106225] Updated weights for policy 1, policy_version 248689 (0.0010) [2023-12-27 21:00:49,206][106225] Updated weights for policy 1, policy_version 248699 (0.0010) [2023-12-27 21:00:49,275][106225] Updated weights for policy 1, policy_version 248709 (0.0010) [2023-12-27 21:00:49,346][106225] Updated weights for policy 1, policy_version 248719 (0.0010) [2023-12-27 21:00:49,765][106226] Updated weights for policy 0, policy_version 248354 (0.0007) [2023-12-27 21:00:49,823][106226] Updated weights for policy 0, policy_version 248364 (0.0008) [2023-12-27 21:00:49,888][106226] Updated weights for policy 0, policy_version 248374 (0.0010) [2023-12-27 21:00:50,083][106225] Updated weights for policy 1, policy_version 248729 (0.0007) [2023-12-27 21:00:50,145][106225] Updated weights for policy 1, policy_version 248739 (0.0008) [2023-12-27 21:00:50,214][106225] Updated weights for policy 1, policy_version 248749 (0.0008) [2023-12-27 21:00:50,651][106226] Updated weights for policy 0, policy_version 248384 (0.0006) [2023-12-27 21:00:50,708][106226] Updated weights for policy 0, policy_version 248394 (0.0008) [2023-12-27 21:00:50,770][106226] Updated weights for policy 0, policy_version 248404 (0.0008) [2023-12-27 21:00:50,895][106225] Updated weights for policy 1, policy_version 248759 (0.0010) [2023-12-27 21:00:50,957][106225] Updated weights for policy 1, policy_version 248769 (0.0009) [2023-12-27 21:00:51,015][106225] Updated weights for policy 1, policy_version 248779 (0.0010) [2023-12-27 21:00:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 127311872. Throughput: 0: 9738.7, 1: 10038.7. Samples: 127318656. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:51,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-6.286')] [2023-12-27 21:00:51,535][106226] Updated weights for policy 0, policy_version 248414 (0.0008) [2023-12-27 21:00:51,600][106226] Updated weights for policy 0, policy_version 248424 (0.0008) [2023-12-27 21:00:51,663][106226] Updated weights for policy 0, policy_version 248434 (0.0009) [2023-12-27 21:00:51,833][106225] Updated weights for policy 1, policy_version 248789 (0.0009) [2023-12-27 21:00:51,897][106225] Updated weights for policy 1, policy_version 248799 (0.0008) [2023-12-27 21:00:51,963][106225] Updated weights for policy 1, policy_version 248809 (0.0009) [2023-12-27 21:00:52,456][106226] Updated weights for policy 0, policy_version 248444 (0.0008) [2023-12-27 21:00:52,523][106226] Updated weights for policy 0, policy_version 248454 (0.0006) [2023-12-27 21:00:52,586][106226] Updated weights for policy 0, policy_version 248464 (0.0007) [2023-12-27 21:00:52,674][106225] Updated weights for policy 1, policy_version 248819 (0.0009) [2023-12-27 21:00:52,740][106225] Updated weights for policy 1, policy_version 248829 (0.0011) [2023-12-27 21:00:52,803][106225] Updated weights for policy 1, policy_version 248839 (0.0007) [2023-12-27 21:00:53,320][106226] Updated weights for policy 0, policy_version 248474 (0.0007) [2023-12-27 21:00:53,383][106226] Updated weights for policy 0, policy_version 248484 (0.0008) [2023-12-27 21:00:53,448][106226] Updated weights for policy 0, policy_version 248494 (0.0007) [2023-12-27 21:00:53,505][106226] Updated weights for policy 0, policy_version 248504 (0.0009) [2023-12-27 21:00:53,506][106225] Updated weights for policy 1, policy_version 248849 (0.0007) [2023-12-27 21:00:53,566][106225] Updated weights for policy 1, policy_version 248859 (0.0009) [2023-12-27 21:00:53,619][106225] Updated weights for policy 1, policy_version 248869 (0.0008) [2023-12-27 21:00:53,679][106225] Updated weights for policy 1, policy_version 248879 (0.0008) [2023-12-27 21:00:54,220][106226] Updated weights for policy 0, policy_version 248514 (0.0008) [2023-12-27 21:00:54,279][106226] Updated weights for policy 0, policy_version 248524 (0.0008) [2023-12-27 21:00:54,334][106226] Updated weights for policy 0, policy_version 248534 (0.0010) [2023-12-27 21:00:54,418][106225] Updated weights for policy 1, policy_version 248889 (0.0005) [2023-12-27 21:00:54,475][106225] Updated weights for policy 1, policy_version 248899 (0.0009) [2023-12-27 21:00:54,536][106225] Updated weights for policy 1, policy_version 248909 (0.0010) [2023-12-27 21:00:55,089][106226] Updated weights for policy 0, policy_version 248544 (0.0009) [2023-12-27 21:00:55,154][106226] Updated weights for policy 0, policy_version 248554 (0.0008) [2023-12-27 21:00:55,195][106225] Updated weights for policy 1, policy_version 248919 (0.0010) [2023-12-27 21:00:55,216][106226] Updated weights for policy 0, policy_version 248564 (0.0008) [2023-12-27 21:00:55,245][106225] Updated weights for policy 1, policy_version 248929 (0.0010) [2023-12-27 21:00:55,316][106225] Updated weights for policy 1, policy_version 248940 (0.0008) [2023-12-27 21:00:55,945][106226] Updated weights for policy 0, policy_version 248574 (0.0009) [2023-12-27 21:00:56,003][106226] Updated weights for policy 0, policy_version 248584 (0.0010) [2023-12-27 21:00:56,034][106225] Updated weights for policy 1, policy_version 248950 (0.0008) [2023-12-27 21:00:56,064][106226] Updated weights for policy 0, policy_version 248594 (0.0009) [2023-12-27 21:00:56,094][106225] Updated weights for policy 1, policy_version 248960 (0.0010) [2023-12-27 21:00:56,154][106225] Updated weights for policy 1, policy_version 248970 (0.0010) [2023-12-27 21:00:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 127401984. Throughput: 0: 9641.8, 1: 10017.2. Samples: 127373756. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:00:56,175][105115] Avg episode reward: [(0, '-5.031'), (1, '-6.161')] [2023-12-27 21:00:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000248600_63660032.pth... [2023-12-27 21:00:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000247448_63365120.pth [2023-12-27 21:00:56,191][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000248976_63750144.pth... [2023-12-27 21:00:56,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000247792_63447040.pth [2023-12-27 21:00:56,753][106226] Updated weights for policy 0, policy_version 248604 (0.0008) [2023-12-27 21:00:56,815][106226] Updated weights for policy 0, policy_version 248614 (0.0005) [2023-12-27 21:00:56,823][106225] Updated weights for policy 1, policy_version 248980 (0.0009) [2023-12-27 21:00:56,876][106226] Updated weights for policy 0, policy_version 248624 (0.0005) [2023-12-27 21:00:56,884][106225] Updated weights for policy 1, policy_version 248990 (0.0005) [2023-12-27 21:00:56,943][106225] Updated weights for policy 1, policy_version 249000 (0.0006) [2023-12-27 21:00:57,491][106226] Updated weights for policy 0, policy_version 248634 (0.0007) [2023-12-27 21:00:57,545][106225] Updated weights for policy 1, policy_version 249010 (0.0007) [2023-12-27 21:00:57,547][106226] Updated weights for policy 0, policy_version 248644 (0.0010) [2023-12-27 21:00:57,598][106225] Updated weights for policy 1, policy_version 249020 (0.0010) [2023-12-27 21:00:57,605][106226] Updated weights for policy 0, policy_version 248654 (0.0010) [2023-12-27 21:00:57,655][106225] Updated weights for policy 1, policy_version 249030 (0.0006) [2023-12-27 21:00:57,661][106226] Updated weights for policy 0, policy_version 248664 (0.0010) [2023-12-27 21:00:57,714][106225] Updated weights for policy 1, policy_version 249040 (0.0008) [2023-12-27 21:00:58,369][106225] Updated weights for policy 1, policy_version 249050 (0.0008) [2023-12-27 21:00:58,428][106226] Updated weights for policy 0, policy_version 248674 (0.0008) [2023-12-27 21:00:58,444][106225] Updated weights for policy 1, policy_version 249060 (0.0010) [2023-12-27 21:00:58,497][106226] Updated weights for policy 0, policy_version 248684 (0.0008) [2023-12-27 21:00:58,511][106225] Updated weights for policy 1, policy_version 249070 (0.0009) [2023-12-27 21:00:58,560][106226] Updated weights for policy 0, policy_version 248694 (0.0008) [2023-12-27 21:00:59,351][106225] Updated weights for policy 1, policy_version 249080 (0.0008) [2023-12-27 21:00:59,398][106226] Updated weights for policy 0, policy_version 248704 (0.0009) [2023-12-27 21:00:59,410][106225] Updated weights for policy 1, policy_version 249090 (0.0007) [2023-12-27 21:00:59,459][106226] Updated weights for policy 0, policy_version 248714 (0.0006) [2023-12-27 21:00:59,470][106225] Updated weights for policy 1, policy_version 249100 (0.0007) [2023-12-27 21:00:59,515][106226] Updated weights for policy 0, policy_version 248724 (0.0006) [2023-12-27 21:01:00,126][106226] Updated weights for policy 0, policy_version 248734 (0.0007) [2023-12-27 21:01:00,182][106226] Updated weights for policy 0, policy_version 248744 (0.0007) [2023-12-27 21:01:00,240][106226] Updated weights for policy 0, policy_version 248754 (0.0006) [2023-12-27 21:01:00,275][106225] Updated weights for policy 1, policy_version 249110 (0.0006) [2023-12-27 21:01:00,328][106225] Updated weights for policy 1, policy_version 249120 (0.0008) [2023-12-27 21:01:00,387][106225] Updated weights for policy 1, policy_version 249130 (0.0009) [2023-12-27 21:01:00,896][106226] Updated weights for policy 0, policy_version 248764 (0.0007) [2023-12-27 21:01:00,953][106226] Updated weights for policy 0, policy_version 248774 (0.0008) [2023-12-27 21:01:01,008][106225] Updated weights for policy 1, policy_version 249140 (0.0009) [2023-12-27 21:01:01,013][106226] Updated weights for policy 0, policy_version 248784 (0.0008) [2023-12-27 21:01:01,065][106225] Updated weights for policy 1, policy_version 249150 (0.0007) [2023-12-27 21:01:01,130][106225] Updated weights for policy 1, policy_version 249160 (0.0007) [2023-12-27 21:01:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 127500288. Throughput: 0: 9670.6, 1: 9976.2. Samples: 127491124. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:01:01,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-6.042')] [2023-12-27 21:01:01,794][106226] Updated weights for policy 0, policy_version 248794 (0.0008) [2023-12-27 21:01:01,855][106226] Updated weights for policy 0, policy_version 248804 (0.0011) [2023-12-27 21:01:01,886][106225] Updated weights for policy 1, policy_version 249170 (0.0007) [2023-12-27 21:01:01,915][106226] Updated weights for policy 0, policy_version 248814 (0.0011) [2023-12-27 21:01:01,937][106225] Updated weights for policy 1, policy_version 249180 (0.0006) [2023-12-27 21:01:01,972][106226] Updated weights for policy 0, policy_version 248824 (0.0011) [2023-12-27 21:01:01,986][106225] Updated weights for policy 1, policy_version 249190 (0.0008) [2023-12-27 21:01:02,043][106225] Updated weights for policy 1, policy_version 249200 (0.0008) [2023-12-27 21:01:02,636][106226] Updated weights for policy 0, policy_version 248834 (0.0005) [2023-12-27 21:01:02,694][106226] Updated weights for policy 0, policy_version 248844 (0.0007) [2023-12-27 21:01:02,757][106226] Updated weights for policy 0, policy_version 248854 (0.0009) [2023-12-27 21:01:02,845][106225] Updated weights for policy 1, policy_version 249210 (0.0008) [2023-12-27 21:01:02,902][106225] Updated weights for policy 1, policy_version 249220 (0.0009) [2023-12-27 21:01:02,963][106225] Updated weights for policy 1, policy_version 249230 (0.0008) [2023-12-27 21:01:03,386][106226] Updated weights for policy 0, policy_version 248864 (0.0011) [2023-12-27 21:01:03,445][106226] Updated weights for policy 0, policy_version 248874 (0.0011) [2023-12-27 21:01:03,505][106226] Updated weights for policy 0, policy_version 248884 (0.0011) [2023-12-27 21:01:03,741][106225] Updated weights for policy 1, policy_version 249240 (0.0008) [2023-12-27 21:01:03,797][106225] Updated weights for policy 1, policy_version 249250 (0.0005) [2023-12-27 21:01:03,862][106225] Updated weights for policy 1, policy_version 249260 (0.0008) [2023-12-27 21:01:04,208][106226] Updated weights for policy 0, policy_version 248894 (0.0011) [2023-12-27 21:01:04,263][106226] Updated weights for policy 0, policy_version 248904 (0.0011) [2023-12-27 21:01:04,328][106226] Updated weights for policy 0, policy_version 248914 (0.0010) [2023-12-27 21:01:04,604][106225] Updated weights for policy 1, policy_version 249270 (0.0008) [2023-12-27 21:01:04,657][106225] Updated weights for policy 1, policy_version 249280 (0.0008) [2023-12-27 21:01:04,713][106225] Updated weights for policy 1, policy_version 249290 (0.0009) [2023-12-27 21:01:05,041][106226] Updated weights for policy 0, policy_version 248924 (0.0007) [2023-12-27 21:01:05,095][106226] Updated weights for policy 0, policy_version 248934 (0.0006) [2023-12-27 21:01:05,159][106226] Updated weights for policy 0, policy_version 248944 (0.0008) [2023-12-27 21:01:05,436][106225] Updated weights for policy 1, policy_version 249300 (0.0007) [2023-12-27 21:01:05,485][106225] Updated weights for policy 1, policy_version 249310 (0.0008) [2023-12-27 21:01:05,536][106225] Updated weights for policy 1, policy_version 249320 (0.0008) [2023-12-27 21:01:05,838][106226] Updated weights for policy 0, policy_version 248954 (0.0008) [2023-12-27 21:01:05,888][106226] Updated weights for policy 0, policy_version 248964 (0.0006) [2023-12-27 21:01:05,939][106226] Updated weights for policy 0, policy_version 248974 (0.0009) [2023-12-27 21:01:05,987][106226] Updated weights for policy 0, policy_version 248984 (0.0008) [2023-12-27 21:01:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 127598592. Throughput: 0: 9761.4, 1: 9892.0. Samples: 127607716. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:01:06,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-5.907')] [2023-12-27 21:01:06,238][106225] Updated weights for policy 1, policy_version 249330 (0.0009) [2023-12-27 21:01:06,302][106225] Updated weights for policy 1, policy_version 249340 (0.0009) [2023-12-27 21:01:06,361][106225] Updated weights for policy 1, policy_version 249350 (0.0008) [2023-12-27 21:01:06,427][106225] Updated weights for policy 1, policy_version 249360 (0.0008) [2023-12-27 21:01:06,796][106226] Updated weights for policy 0, policy_version 248994 (0.0009) [2023-12-27 21:01:06,850][106226] Updated weights for policy 0, policy_version 249004 (0.0008) [2023-12-27 21:01:06,914][106226] Updated weights for policy 0, policy_version 249014 (0.0009) [2023-12-27 21:01:07,116][106225] Updated weights for policy 1, policy_version 249370 (0.0005) [2023-12-27 21:01:07,167][106225] Updated weights for policy 1, policy_version 249380 (0.0006) [2023-12-27 21:01:07,223][106225] Updated weights for policy 1, policy_version 249390 (0.0010) [2023-12-27 21:01:07,579][106226] Updated weights for policy 0, policy_version 249024 (0.0008) [2023-12-27 21:01:07,638][106226] Updated weights for policy 0, policy_version 249034 (0.0008) [2023-12-27 21:01:07,695][106226] Updated weights for policy 0, policy_version 249044 (0.0008) [2023-12-27 21:01:07,893][106225] Updated weights for policy 1, policy_version 249400 (0.0010) [2023-12-27 21:01:07,950][106225] Updated weights for policy 1, policy_version 249410 (0.0010) [2023-12-27 21:01:08,010][106225] Updated weights for policy 1, policy_version 249420 (0.0010) [2023-12-27 21:01:08,364][106226] Updated weights for policy 0, policy_version 249054 (0.0007) [2023-12-27 21:01:08,431][106226] Updated weights for policy 0, policy_version 249064 (0.0006) [2023-12-27 21:01:08,494][106226] Updated weights for policy 0, policy_version 249074 (0.0010) [2023-12-27 21:01:08,704][106225] Updated weights for policy 1, policy_version 249430 (0.0010) [2023-12-27 21:01:08,770][106225] Updated weights for policy 1, policy_version 249440 (0.0010) [2023-12-27 21:01:08,833][106225] Updated weights for policy 1, policy_version 249450 (0.0010) [2023-12-27 21:01:09,184][106226] Updated weights for policy 0, policy_version 249084 (0.0008) [2023-12-27 21:01:09,258][106226] Updated weights for policy 0, policy_version 249094 (0.0012) [2023-12-27 21:01:09,321][106226] Updated weights for policy 0, policy_version 249104 (0.0010) [2023-12-27 21:01:09,581][106225] Updated weights for policy 1, policy_version 249460 (0.0010) [2023-12-27 21:01:09,628][106225] Updated weights for policy 1, policy_version 249470 (0.0008) [2023-12-27 21:01:09,685][106225] Updated weights for policy 1, policy_version 249480 (0.0009) [2023-12-27 21:01:10,053][106226] Updated weights for policy 0, policy_version 249114 (0.0010) [2023-12-27 21:01:10,117][106226] Updated weights for policy 0, policy_version 249124 (0.0009) [2023-12-27 21:01:10,178][106226] Updated weights for policy 0, policy_version 249134 (0.0010) [2023-12-27 21:01:10,237][106226] Updated weights for policy 0, policy_version 249144 (0.0011) [2023-12-27 21:01:10,463][106225] Updated weights for policy 1, policy_version 249490 (0.0007) [2023-12-27 21:01:10,527][106225] Updated weights for policy 1, policy_version 249500 (0.0006) [2023-12-27 21:01:10,581][106225] Updated weights for policy 1, policy_version 249510 (0.0006) [2023-12-27 21:01:10,636][106225] Updated weights for policy 1, policy_version 249520 (0.0006) [2023-12-27 21:01:10,889][106226] Updated weights for policy 0, policy_version 249154 (0.0011) [2023-12-27 21:01:10,946][106226] Updated weights for policy 0, policy_version 249164 (0.0011) [2023-12-27 21:01:10,998][106226] Updated weights for policy 0, policy_version 249174 (0.0010) [2023-12-27 21:01:11,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 127696896. Throughput: 0: 9828.6, 1: 9933.3. Samples: 127667732. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:01:11,175][105115] Avg episode reward: [(0, '-5.104'), (1, '-5.932')] [2023-12-27 21:01:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000249520_63889408.pth... [2023-12-27 21:01:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000249176_63807488.pth... [2023-12-27 21:01:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000248400_63602688.pth [2023-12-27 21:01:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000248056_63520768.pth [2023-12-27 21:01:11,261][106225] Updated weights for policy 1, policy_version 249530 (0.0008) [2023-12-27 21:01:11,332][106225] Updated weights for policy 1, policy_version 249540 (0.0008) [2023-12-27 21:01:11,404][106225] Updated weights for policy 1, policy_version 249550 (0.0008) [2023-12-27 21:01:11,764][106226] Updated weights for policy 0, policy_version 249184 (0.0009) [2023-12-27 21:01:11,824][106226] Updated weights for policy 0, policy_version 249194 (0.0011) [2023-12-27 21:01:11,894][106226] Updated weights for policy 0, policy_version 249204 (0.0011) [2023-12-27 21:01:12,117][106225] Updated weights for policy 1, policy_version 249560 (0.0007) [2023-12-27 21:01:12,174][106225] Updated weights for policy 1, policy_version 249570 (0.0008) [2023-12-27 21:01:12,234][106225] Updated weights for policy 1, policy_version 249580 (0.0007) [2023-12-27 21:01:12,646][106226] Updated weights for policy 0, policy_version 249214 (0.0011) [2023-12-27 21:01:12,711][106226] Updated weights for policy 0, policy_version 249224 (0.0011) [2023-12-27 21:01:12,780][106226] Updated weights for policy 0, policy_version 249234 (0.0011) [2023-12-27 21:01:12,959][106225] Updated weights for policy 1, policy_version 249590 (0.0009) [2023-12-27 21:01:13,019][106225] Updated weights for policy 1, policy_version 249600 (0.0008) [2023-12-27 21:01:13,073][106225] Updated weights for policy 1, policy_version 249610 (0.0008) [2023-12-27 21:01:13,422][106226] Updated weights for policy 0, policy_version 249244 (0.0009) [2023-12-27 21:01:13,477][106226] Updated weights for policy 0, policy_version 249254 (0.0009) [2023-12-27 21:01:13,535][106226] Updated weights for policy 0, policy_version 249264 (0.0008) [2023-12-27 21:01:13,793][106225] Updated weights for policy 1, policy_version 249620 (0.0007) [2023-12-27 21:01:13,848][106225] Updated weights for policy 1, policy_version 249630 (0.0008) [2023-12-27 21:01:13,892][106225] Updated weights for policy 1, policy_version 249640 (0.0008) [2023-12-27 21:01:14,270][106226] Updated weights for policy 0, policy_version 249274 (0.0008) [2023-12-27 21:01:14,322][106226] Updated weights for policy 0, policy_version 249284 (0.0008) [2023-12-27 21:01:14,378][106226] Updated weights for policy 0, policy_version 249294 (0.0009) [2023-12-27 21:01:14,429][106226] Updated weights for policy 0, policy_version 249304 (0.0009) [2023-12-27 21:01:14,617][106225] Updated weights for policy 1, policy_version 249650 (0.0008) [2023-12-27 21:01:14,671][106225] Updated weights for policy 1, policy_version 249660 (0.0008) [2023-12-27 21:01:14,721][106225] Updated weights for policy 1, policy_version 249670 (0.0008) [2023-12-27 21:01:14,776][106225] Updated weights for policy 1, policy_version 249680 (0.0007) [2023-12-27 21:01:15,152][106226] Updated weights for policy 0, policy_version 249314 (0.0009) [2023-12-27 21:01:15,213][106226] Updated weights for policy 0, policy_version 249324 (0.0008) [2023-12-27 21:01:15,273][106226] Updated weights for policy 0, policy_version 249334 (0.0008) [2023-12-27 21:01:15,513][106225] Updated weights for policy 1, policy_version 249690 (0.0008) [2023-12-27 21:01:15,571][106225] Updated weights for policy 1, policy_version 249700 (0.0008) [2023-12-27 21:01:15,626][106225] Updated weights for policy 1, policy_version 249710 (0.0008) [2023-12-27 21:01:15,993][106226] Updated weights for policy 0, policy_version 249344 (0.0008) [2023-12-27 21:01:16,044][106226] Updated weights for policy 0, policy_version 249354 (0.0008) [2023-12-27 21:01:16,095][106226] Updated weights for policy 0, policy_version 249364 (0.0008) [2023-12-27 21:01:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 127795200. Throughput: 0: 9703.7, 1: 9810.6. Samples: 127782976. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:01:16,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-6.070')] [2023-12-27 21:01:16,343][106225] Updated weights for policy 1, policy_version 249720 (0.0008) [2023-12-27 21:01:16,401][106225] Updated weights for policy 1, policy_version 249730 (0.0008) [2023-12-27 21:01:16,457][106225] Updated weights for policy 1, policy_version 249740 (0.0008) [2023-12-27 21:01:16,823][106226] Updated weights for policy 0, policy_version 249374 (0.0008) [2023-12-27 21:01:16,883][106226] Updated weights for policy 0, policy_version 249384 (0.0009) [2023-12-27 21:01:16,937][106226] Updated weights for policy 0, policy_version 249394 (0.0009) [2023-12-27 21:01:17,172][106225] Updated weights for policy 1, policy_version 249750 (0.0008) [2023-12-27 21:01:17,236][106225] Updated weights for policy 1, policy_version 249760 (0.0008) [2023-12-27 21:01:17,309][106225] Updated weights for policy 1, policy_version 249770 (0.0008) [2023-12-27 21:01:17,668][106226] Updated weights for policy 0, policy_version 249404 (0.0007) [2023-12-27 21:01:17,724][106226] Updated weights for policy 0, policy_version 249414 (0.0006) [2023-12-27 21:01:17,784][106226] Updated weights for policy 0, policy_version 249424 (0.0008) [2023-12-27 21:01:18,010][106225] Updated weights for policy 1, policy_version 249780 (0.0008) [2023-12-27 21:01:18,068][106225] Updated weights for policy 1, policy_version 249790 (0.0008) [2023-12-27 21:01:18,112][106225] Updated weights for policy 1, policy_version 249800 (0.0008) [2023-12-27 21:01:18,480][106226] Updated weights for policy 0, policy_version 249434 (0.0008) [2023-12-27 21:01:18,538][106226] Updated weights for policy 0, policy_version 249444 (0.0006) [2023-12-27 21:01:18,605][106226] Updated weights for policy 0, policy_version 249454 (0.0006) [2023-12-27 21:01:18,671][106226] Updated weights for policy 0, policy_version 249464 (0.0006) [2023-12-27 21:01:18,843][106225] Updated weights for policy 1, policy_version 249810 (0.0007) [2023-12-27 21:01:18,909][106225] Updated weights for policy 1, policy_version 249820 (0.0005) [2023-12-27 21:01:18,968][106225] Updated weights for policy 1, policy_version 249830 (0.0005) [2023-12-27 21:01:19,013][106225] Updated weights for policy 1, policy_version 249840 (0.0005) [2023-12-27 21:01:19,328][106226] Updated weights for policy 0, policy_version 249474 (0.0011) [2023-12-27 21:01:19,393][106226] Updated weights for policy 0, policy_version 249484 (0.0009) [2023-12-27 21:01:19,453][106226] Updated weights for policy 0, policy_version 249494 (0.0008) [2023-12-27 21:01:19,675][106225] Updated weights for policy 1, policy_version 249850 (0.0011) [2023-12-27 21:01:19,743][106225] Updated weights for policy 1, policy_version 249860 (0.0009) [2023-12-27 21:01:19,811][106225] Updated weights for policy 1, policy_version 249870 (0.0009) [2023-12-27 21:01:20,196][106226] Updated weights for policy 0, policy_version 249504 (0.0008) [2023-12-27 21:01:20,261][106226] Updated weights for policy 0, policy_version 249514 (0.0008) [2023-12-27 21:01:20,327][106226] Updated weights for policy 0, policy_version 249524 (0.0006) [2023-12-27 21:01:20,512][106225] Updated weights for policy 1, policy_version 249880 (0.0008) [2023-12-27 21:01:20,573][106225] Updated weights for policy 1, policy_version 249890 (0.0006) [2023-12-27 21:01:20,638][106225] Updated weights for policy 1, policy_version 249900 (0.0010) [2023-12-27 21:01:21,036][106226] Updated weights for policy 0, policy_version 249534 (0.0008) [2023-12-27 21:01:21,101][106226] Updated weights for policy 0, policy_version 249544 (0.0008) [2023-12-27 21:01:21,168][106226] Updated weights for policy 0, policy_version 249554 (0.0008) [2023-12-27 21:01:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 127885312. Throughput: 0: 9630.2, 1: 9744.0. Samples: 127899548. Policy #0 lag: (min: 31.0, avg: 31.8, max: 53.0) [2023-12-27 21:01:21,175][105115] Avg episode reward: [(0, '-5.132'), (1, '-6.151')] [2023-12-27 21:01:21,346][106225] Updated weights for policy 1, policy_version 249910 (0.0009) [2023-12-27 21:01:21,419][106225] Updated weights for policy 1, policy_version 249920 (0.0008) [2023-12-27 21:01:21,486][106225] Updated weights for policy 1, policy_version 249930 (0.0006) [2023-12-27 21:01:21,979][106226] Updated weights for policy 0, policy_version 249564 (0.0009) [2023-12-27 21:01:22,047][106226] Updated weights for policy 0, policy_version 249574 (0.0009) [2023-12-27 21:01:22,111][106226] Updated weights for policy 0, policy_version 249584 (0.0009) [2023-12-27 21:01:22,197][106225] Updated weights for policy 1, policy_version 249940 (0.0008) [2023-12-27 21:01:22,250][106225] Updated weights for policy 1, policy_version 249950 (0.0007) [2023-12-27 21:01:22,316][106225] Updated weights for policy 1, policy_version 249960 (0.0008) [2023-12-27 21:01:22,841][106226] Updated weights for policy 0, policy_version 249594 (0.0009) [2023-12-27 21:01:22,892][106226] Updated weights for policy 0, policy_version 249604 (0.0010) [2023-12-27 21:01:22,949][106226] Updated weights for policy 0, policy_version 249614 (0.0009) [2023-12-27 21:01:22,992][106225] Updated weights for policy 1, policy_version 249970 (0.0008) [2023-12-27 21:01:23,010][106226] Updated weights for policy 0, policy_version 249624 (0.0009) [2023-12-27 21:01:23,054][106225] Updated weights for policy 1, policy_version 249980 (0.0010) [2023-12-27 21:01:23,113][106225] Updated weights for policy 1, policy_version 249990 (0.0009) [2023-12-27 21:01:23,167][106225] Updated weights for policy 1, policy_version 250000 (0.0009) [2023-12-27 21:01:23,678][106226] Updated weights for policy 0, policy_version 249634 (0.0007) [2023-12-27 21:01:23,746][106226] Updated weights for policy 0, policy_version 249644 (0.0006) [2023-12-27 21:01:23,808][106226] Updated weights for policy 0, policy_version 249654 (0.0005) [2023-12-27 21:01:23,889][106225] Updated weights for policy 1, policy_version 250010 (0.0008) [2023-12-27 21:01:23,939][106225] Updated weights for policy 1, policy_version 250020 (0.0008) [2023-12-27 21:01:23,998][106225] Updated weights for policy 1, policy_version 250030 (0.0007) [2023-12-27 21:01:24,518][106226] Updated weights for policy 0, policy_version 249664 (0.0008) [2023-12-27 21:01:24,568][106226] Updated weights for policy 0, policy_version 249674 (0.0006) [2023-12-27 21:01:24,576][106225] Updated weights for policy 1, policy_version 250040 (0.0008) [2023-12-27 21:01:24,617][106226] Updated weights for policy 0, policy_version 249684 (0.0006) [2023-12-27 21:01:24,639][106225] Updated weights for policy 1, policy_version 250050 (0.0008) [2023-12-27 21:01:24,707][106225] Updated weights for policy 1, policy_version 250060 (0.0005) [2023-12-27 21:01:25,260][106225] Updated weights for policy 1, policy_version 250070 (0.0007) [2023-12-27 21:01:25,282][106226] Updated weights for policy 0, policy_version 249694 (0.0007) [2023-12-27 21:01:25,321][106225] Updated weights for policy 1, policy_version 250080 (0.0006) [2023-12-27 21:01:25,342][106226] Updated weights for policy 0, policy_version 249704 (0.0007) [2023-12-27 21:01:25,380][106225] Updated weights for policy 1, policy_version 250090 (0.0007) [2023-12-27 21:01:25,408][106226] Updated weights for policy 0, policy_version 249714 (0.0006) [2023-12-27 21:01:26,014][106226] Updated weights for policy 0, policy_version 249724 (0.0007) [2023-12-27 21:01:26,070][106226] Updated weights for policy 0, policy_version 249734 (0.0009) [2023-12-27 21:01:26,127][106226] Updated weights for policy 0, policy_version 249744 (0.0007) [2023-12-27 21:01:26,128][106225] Updated weights for policy 1, policy_version 250100 (0.0007) [2023-12-27 21:01:26,176][105115] Fps is (10 sec: 19657.2, 60 sec: 19660.2, 300 sec: 19799.5). Total num frames: 127991808. Throughput: 0: 9608.7, 1: 9715.2. Samples: 127957240. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:26,177][105115] Avg episode reward: [(0, '-4.634'), (1, '-6.444')] [2023-12-27 21:01:26,183][106225] Updated weights for policy 1, policy_version 250110 (0.0009) [2023-12-27 21:01:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000249752_63954944.pth... [2023-12-27 21:01:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000248600_63660032.pth [2023-12-27 21:01:26,246][106225] Updated weights for policy 1, policy_version 250120 (0.0009) [2023-12-27 21:01:26,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000250128_64045056.pth... [2023-12-27 21:01:26,295][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000248976_63750144.pth [2023-12-27 21:01:26,743][106226] Updated weights for policy 0, policy_version 249754 (0.0006) [2023-12-27 21:01:26,802][106226] Updated weights for policy 0, policy_version 249764 (0.0008) [2023-12-27 21:01:26,864][106226] Updated weights for policy 0, policy_version 249774 (0.0006) [2023-12-27 21:01:26,916][106226] Updated weights for policy 0, policy_version 249784 (0.0005) [2023-12-27 21:01:26,978][106225] Updated weights for policy 1, policy_version 250130 (0.0007) [2023-12-27 21:01:27,034][106225] Updated weights for policy 1, policy_version 250140 (0.0010) [2023-12-27 21:01:27,089][106225] Updated weights for policy 1, policy_version 250150 (0.0010) [2023-12-27 21:01:27,141][106225] Updated weights for policy 1, policy_version 250160 (0.0010) [2023-12-27 21:01:27,528][106226] Updated weights for policy 0, policy_version 249794 (0.0008) [2023-12-27 21:01:27,583][106226] Updated weights for policy 0, policy_version 249804 (0.0009) [2023-12-27 21:01:27,639][106226] Updated weights for policy 0, policy_version 249814 (0.0007) [2023-12-27 21:01:27,805][106225] Updated weights for policy 1, policy_version 250170 (0.0009) [2023-12-27 21:01:27,863][106225] Updated weights for policy 1, policy_version 250180 (0.0008) [2023-12-27 21:01:27,932][106225] Updated weights for policy 1, policy_version 250190 (0.0005) [2023-12-27 21:01:28,469][106226] Updated weights for policy 0, policy_version 249824 (0.0008) [2023-12-27 21:01:28,487][106225] Updated weights for policy 1, policy_version 250200 (0.0007) [2023-12-27 21:01:28,525][106226] Updated weights for policy 0, policy_version 249834 (0.0008) [2023-12-27 21:01:28,541][106225] Updated weights for policy 1, policy_version 250210 (0.0007) [2023-12-27 21:01:28,582][106226] Updated weights for policy 0, policy_version 249844 (0.0006) [2023-12-27 21:01:28,602][106225] Updated weights for policy 1, policy_version 250220 (0.0008) [2023-12-27 21:01:29,264][106226] Updated weights for policy 0, policy_version 249854 (0.0007) [2023-12-27 21:01:29,339][106226] Updated weights for policy 0, policy_version 249864 (0.0009) [2023-12-27 21:01:29,376][106225] Updated weights for policy 1, policy_version 250230 (0.0007) [2023-12-27 21:01:29,403][106226] Updated weights for policy 0, policy_version 249874 (0.0007) [2023-12-27 21:01:29,433][106225] Updated weights for policy 1, policy_version 250240 (0.0007) [2023-12-27 21:01:29,497][106225] Updated weights for policy 1, policy_version 250250 (0.0008) [2023-12-27 21:01:30,080][106226] Updated weights for policy 0, policy_version 249884 (0.0007) [2023-12-27 21:01:30,141][106226] Updated weights for policy 0, policy_version 249894 (0.0009) [2023-12-27 21:01:30,205][106226] Updated weights for policy 0, policy_version 249904 (0.0008) [2023-12-27 21:01:30,265][106225] Updated weights for policy 1, policy_version 250260 (0.0009) [2023-12-27 21:01:30,320][106225] Updated weights for policy 1, policy_version 250270 (0.0008) [2023-12-27 21:01:30,378][106225] Updated weights for policy 1, policy_version 250280 (0.0009) [2023-12-27 21:01:30,898][106226] Updated weights for policy 0, policy_version 249914 (0.0008) [2023-12-27 21:01:30,951][106226] Updated weights for policy 0, policy_version 249924 (0.0008) [2023-12-27 21:01:31,002][106226] Updated weights for policy 0, policy_version 249934 (0.0008) [2023-12-27 21:01:31,067][106226] Updated weights for policy 0, policy_version 249944 (0.0008) [2023-12-27 21:01:31,105][106225] Updated weights for policy 1, policy_version 250290 (0.0009) [2023-12-27 21:01:31,169][106225] Updated weights for policy 1, policy_version 250300 (0.0008) [2023-12-27 21:01:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 128090112. Throughput: 0: 9735.0, 1: 9787.0. Samples: 128080404. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:31,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.949')] [2023-12-27 21:01:31,234][106225] Updated weights for policy 1, policy_version 250310 (0.0007) [2023-12-27 21:01:31,296][106225] Updated weights for policy 1, policy_version 250320 (0.0008) [2023-12-27 21:01:31,799][106226] Updated weights for policy 0, policy_version 249954 (0.0008) [2023-12-27 21:01:31,859][106226] Updated weights for policy 0, policy_version 249964 (0.0008) [2023-12-27 21:01:31,915][106226] Updated weights for policy 0, policy_version 249974 (0.0008) [2023-12-27 21:01:32,013][106225] Updated weights for policy 1, policy_version 250330 (0.0008) [2023-12-27 21:01:32,073][106225] Updated weights for policy 1, policy_version 250340 (0.0008) [2023-12-27 21:01:32,131][106225] Updated weights for policy 1, policy_version 250350 (0.0008) [2023-12-27 21:01:32,651][106226] Updated weights for policy 0, policy_version 249984 (0.0008) [2023-12-27 21:01:32,708][106226] Updated weights for policy 0, policy_version 249994 (0.0005) [2023-12-27 21:01:32,764][106226] Updated weights for policy 0, policy_version 250004 (0.0005) [2023-12-27 21:01:32,887][106225] Updated weights for policy 1, policy_version 250360 (0.0008) [2023-12-27 21:01:32,939][106225] Updated weights for policy 1, policy_version 250370 (0.0007) [2023-12-27 21:01:32,993][106225] Updated weights for policy 1, policy_version 250380 (0.0005) [2023-12-27 21:01:33,447][106226] Updated weights for policy 0, policy_version 250014 (0.0009) [2023-12-27 21:01:33,497][106226] Updated weights for policy 0, policy_version 250024 (0.0010) [2023-12-27 21:01:33,557][106226] Updated weights for policy 0, policy_version 250034 (0.0010) [2023-12-27 21:01:33,718][106225] Updated weights for policy 1, policy_version 250390 (0.0007) [2023-12-27 21:01:33,772][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000006 [2023-12-27 21:01:33,776][106225] Updated weights for policy 1, policy_version 250400 (0.0008) [2023-12-27 21:01:34,289][106226] Updated weights for policy 0, policy_version 250044 (0.0008) [2023-12-27 21:01:34,355][106226] Updated weights for policy 0, policy_version 250054 (0.0008) [2023-12-27 21:01:34,424][106226] Updated weights for policy 0, policy_version 250064 (0.0008) [2023-12-27 21:01:34,570][106225] Updated weights for policy 1, policy_version 250410 (0.0009) [2023-12-27 21:01:34,630][106225] Updated weights for policy 1, policy_version 250420 (0.0009) [2023-12-27 21:01:34,692][106225] Updated weights for policy 1, policy_version 250430 (0.0007) [2023-12-27 21:01:35,150][106226] Updated weights for policy 0, policy_version 250074 (0.0007) [2023-12-27 21:01:35,201][106226] Updated weights for policy 0, policy_version 250084 (0.0008) [2023-12-27 21:01:35,254][106226] Updated weights for policy 0, policy_version 250094 (0.0008) [2023-12-27 21:01:35,302][106225] Updated weights for policy 1, policy_version 250440 (0.0005) [2023-12-27 21:01:35,308][106226] Updated weights for policy 0, policy_version 250104 (0.0007) [2023-12-27 21:01:35,362][106225] Updated weights for policy 1, policy_version 250450 (0.0007) [2023-12-27 21:01:35,420][106225] Updated weights for policy 1, policy_version 250460 (0.0008) [2023-12-27 21:01:36,013][106226] Updated weights for policy 0, policy_version 250114 (0.0007) [2023-12-27 21:01:36,055][106225] Updated weights for policy 1, policy_version 250470 (0.0007) [2023-12-27 21:01:36,064][106226] Updated weights for policy 0, policy_version 250124 (0.0005) [2023-12-27 21:01:36,115][106226] Updated weights for policy 0, policy_version 250134 (0.0007) [2023-12-27 21:01:36,115][106225] Updated weights for policy 1, policy_version 250480 (0.0006) [2023-12-27 21:01:36,174][105115] Fps is (10 sec: 19664.5, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 128188416. Throughput: 0: 9770.9, 1: 9770.0. Samples: 128197992. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:36,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-6.297')] [2023-12-27 21:01:36,183][106225] Updated weights for policy 1, policy_version 250490 (0.0007) [2023-12-27 21:01:36,777][106225] Updated weights for policy 1, policy_version 250500 (0.0006) [2023-12-27 21:01:36,835][106225] Updated weights for policy 1, policy_version 250510 (0.0008) [2023-12-27 21:01:36,838][106226] Updated weights for policy 0, policy_version 250144 (0.0007) [2023-12-27 21:01:36,880][106225] Updated weights for policy 1, policy_version 250520 (0.0009) [2023-12-27 21:01:36,886][106226] Updated weights for policy 0, policy_version 250154 (0.0007) [2023-12-27 21:01:36,934][106226] Updated weights for policy 0, policy_version 250164 (0.0007) [2023-12-27 21:01:37,526][106225] Updated weights for policy 1, policy_version 250530 (0.0006) [2023-12-27 21:01:37,587][106225] Updated weights for policy 1, policy_version 250540 (0.0007) [2023-12-27 21:01:37,640][106225] Updated weights for policy 1, policy_version 250550 (0.0009) [2023-12-27 21:01:37,674][106226] Updated weights for policy 0, policy_version 250174 (0.0009) [2023-12-27 21:01:37,702][106225] Updated weights for policy 1, policy_version 250560 (0.0007) [2023-12-27 21:01:37,733][106226] Updated weights for policy 0, policy_version 250184 (0.0006) [2023-12-27 21:01:37,786][106226] Updated weights for policy 0, policy_version 250194 (0.0005) [2023-12-27 21:01:38,406][106226] Updated weights for policy 0, policy_version 250204 (0.0007) [2023-12-27 21:01:38,465][106226] Updated weights for policy 0, policy_version 250214 (0.0007) [2023-12-27 21:01:38,484][106225] Updated weights for policy 1, policy_version 250570 (0.0009) [2023-12-27 21:01:38,528][106226] Updated weights for policy 0, policy_version 250224 (0.0008) [2023-12-27 21:01:38,544][106225] Updated weights for policy 1, policy_version 250580 (0.0007) [2023-12-27 21:01:38,610][106225] Updated weights for policy 1, policy_version 250590 (0.0011) [2023-12-27 21:01:39,125][106226] Updated weights for policy 0, policy_version 250234 (0.0007) [2023-12-27 21:01:39,183][106226] Updated weights for policy 0, policy_version 250244 (0.0005) [2023-12-27 21:01:39,257][106226] Updated weights for policy 0, policy_version 250254 (0.0006) [2023-12-27 21:01:39,325][106226] Updated weights for policy 0, policy_version 250264 (0.0006) [2023-12-27 21:01:39,426][106225] Updated weights for policy 1, policy_version 250600 (0.0009) [2023-12-27 21:01:39,490][106225] Updated weights for policy 1, policy_version 250610 (0.0010) [2023-12-27 21:01:39,562][106225] Updated weights for policy 1, policy_version 250620 (0.0010) [2023-12-27 21:01:40,001][106226] Updated weights for policy 0, policy_version 250274 (0.0010) [2023-12-27 21:01:40,059][106226] Updated weights for policy 0, policy_version 250284 (0.0008) [2023-12-27 21:01:40,114][106226] Updated weights for policy 0, policy_version 250294 (0.0008) [2023-12-27 21:01:40,290][106225] Updated weights for policy 1, policy_version 250630 (0.0007) [2023-12-27 21:01:40,353][106225] Updated weights for policy 1, policy_version 250640 (0.0009) [2023-12-27 21:01:40,416][106225] Updated weights for policy 1, policy_version 250650 (0.0008) [2023-12-27 21:01:40,906][106226] Updated weights for policy 0, policy_version 250304 (0.0008) [2023-12-27 21:01:40,959][106226] Updated weights for policy 0, policy_version 250314 (0.0008) [2023-12-27 21:01:41,017][106226] Updated weights for policy 0, policy_version 250324 (0.0008) [2023-12-27 21:01:41,040][106225] Updated weights for policy 1, policy_version 250660 (0.0010) [2023-12-27 21:01:41,113][106225] Updated weights for policy 1, policy_version 250670 (0.0009) [2023-12-27 21:01:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 128286720. Throughput: 0: 9842.0, 1: 9832.9. Samples: 128259128. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:41,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-6.059')] [2023-12-27 21:01:41,180][106225] Updated weights for policy 1, policy_version 250680 (0.0009) [2023-12-27 21:01:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000250328_64102400.pth... [2023-12-27 21:01:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000249176_63807488.pth [2023-12-27 21:01:41,231][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000250688_64192512.pth... [2023-12-27 21:01:41,235][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000249520_63889408.pth [2023-12-27 21:01:41,903][106226] Updated weights for policy 0, policy_version 250334 (0.0008) [2023-12-27 21:01:41,944][106225] Updated weights for policy 1, policy_version 250690 (0.0009) [2023-12-27 21:01:41,971][106226] Updated weights for policy 0, policy_version 250344 (0.0006) [2023-12-27 21:01:42,003][106225] Updated weights for policy 1, policy_version 250700 (0.0010) [2023-12-27 21:01:42,021][106226] Updated weights for policy 0, policy_version 250354 (0.0006) [2023-12-27 21:01:42,062][106225] Updated weights for policy 1, policy_version 250710 (0.0007) [2023-12-27 21:01:42,116][106225] Updated weights for policy 1, policy_version 250720 (0.0005) [2023-12-27 21:01:42,753][106226] Updated weights for policy 0, policy_version 250364 (0.0008) [2023-12-27 21:01:42,813][106226] Updated weights for policy 0, policy_version 250374 (0.0006) [2023-12-27 21:01:42,818][106225] Updated weights for policy 1, policy_version 250730 (0.0010) [2023-12-27 21:01:42,861][106226] Updated weights for policy 0, policy_version 250384 (0.0006) [2023-12-27 21:01:42,867][106225] Updated weights for policy 1, policy_version 250740 (0.0009) [2023-12-27 21:01:42,915][106225] Updated weights for policy 1, policy_version 250750 (0.0007) [2023-12-27 21:01:43,509][106226] Updated weights for policy 0, policy_version 250394 (0.0007) [2023-12-27 21:01:43,576][106226] Updated weights for policy 0, policy_version 250404 (0.0010) [2023-12-27 21:01:43,627][106226] Updated weights for policy 0, policy_version 250414 (0.0010) [2023-12-27 21:01:43,633][106225] Updated weights for policy 1, policy_version 250760 (0.0006) [2023-12-27 21:01:43,677][106226] Updated weights for policy 0, policy_version 250424 (0.0011) [2023-12-27 21:01:43,695][106225] Updated weights for policy 1, policy_version 250770 (0.0006) [2023-12-27 21:01:43,759][106225] Updated weights for policy 1, policy_version 250780 (0.0008) [2023-12-27 21:01:44,357][106226] Updated weights for policy 0, policy_version 250434 (0.0009) [2023-12-27 21:01:44,371][106225] Updated weights for policy 1, policy_version 250790 (0.0007) [2023-12-27 21:01:44,410][106226] Updated weights for policy 0, policy_version 250444 (0.0010) [2023-12-27 21:01:44,435][106225] Updated weights for policy 1, policy_version 250800 (0.0005) [2023-12-27 21:01:44,468][106226] Updated weights for policy 0, policy_version 250454 (0.0010) [2023-12-27 21:01:44,490][106225] Updated weights for policy 1, policy_version 250810 (0.0005) [2023-12-27 21:01:45,109][106225] Updated weights for policy 1, policy_version 250820 (0.0006) [2023-12-27 21:01:45,177][106225] Updated weights for policy 1, policy_version 250830 (0.0008) [2023-12-27 21:01:45,199][106226] Updated weights for policy 0, policy_version 250464 (0.0008) [2023-12-27 21:01:45,242][106225] Updated weights for policy 1, policy_version 250840 (0.0006) [2023-12-27 21:01:45,266][106226] Updated weights for policy 0, policy_version 250474 (0.0007) [2023-12-27 21:01:45,330][106226] Updated weights for policy 0, policy_version 250484 (0.0007) [2023-12-27 21:01:45,857][106225] Updated weights for policy 1, policy_version 250850 (0.0007) [2023-12-27 21:01:45,917][106225] Updated weights for policy 1, policy_version 250860 (0.0007) [2023-12-27 21:01:45,939][106226] Updated weights for policy 0, policy_version 250494 (0.0009) [2023-12-27 21:01:45,972][106225] Updated weights for policy 1, policy_version 250870 (0.0006) [2023-12-27 21:01:46,000][106226] Updated weights for policy 0, policy_version 250504 (0.0010) [2023-12-27 21:01:46,032][106225] Updated weights for policy 1, policy_version 250880 (0.0006) [2023-12-27 21:01:46,057][106226] Updated weights for policy 0, policy_version 250514 (0.0011) [2023-12-27 21:01:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 128393216. Throughput: 0: 9819.5, 1: 9841.1. Samples: 128375848. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:46,175][105115] Avg episode reward: [(0, '-4.831'), (1, '-5.885')] [2023-12-27 21:01:46,752][106225] Updated weights for policy 1, policy_version 250890 (0.0006) [2023-12-27 21:01:46,772][106226] Updated weights for policy 0, policy_version 250524 (0.0010) [2023-12-27 21:01:46,816][106225] Updated weights for policy 1, policy_version 250900 (0.0005) [2023-12-27 21:01:46,832][106226] Updated weights for policy 0, policy_version 250534 (0.0011) [2023-12-27 21:01:46,872][106225] Updated weights for policy 1, policy_version 250910 (0.0005) [2023-12-27 21:01:46,880][106226] Updated weights for policy 0, policy_version 250544 (0.0009) [2023-12-27 21:01:47,474][106226] Updated weights for policy 0, policy_version 250554 (0.0006) [2023-12-27 21:01:47,477][106225] Updated weights for policy 1, policy_version 250920 (0.0006) [2023-12-27 21:01:47,522][106226] Updated weights for policy 0, policy_version 250564 (0.0008) [2023-12-27 21:01:47,522][106225] Updated weights for policy 1, policy_version 250930 (0.0005) [2023-12-27 21:01:47,578][106226] Updated weights for policy 0, policy_version 250574 (0.0008) [2023-12-27 21:01:47,592][106225] Updated weights for policy 1, policy_version 250940 (0.0005) [2023-12-27 21:01:47,647][106226] Updated weights for policy 0, policy_version 250584 (0.0005) [2023-12-27 21:01:48,203][106226] Updated weights for policy 0, policy_version 250594 (0.0010) [2023-12-27 21:01:48,240][106225] Updated weights for policy 1, policy_version 250950 (0.0007) [2023-12-27 21:01:48,263][106226] Updated weights for policy 0, policy_version 250604 (0.0010) [2023-12-27 21:01:48,303][106225] Updated weights for policy 1, policy_version 250960 (0.0008) [2023-12-27 21:01:48,324][106226] Updated weights for policy 0, policy_version 250614 (0.0006) [2023-12-27 21:01:48,364][106225] Updated weights for policy 1, policy_version 250970 (0.0008) [2023-12-27 21:01:49,046][106226] Updated weights for policy 0, policy_version 250624 (0.0006) [2023-12-27 21:01:49,071][106225] Updated weights for policy 1, policy_version 250980 (0.0007) [2023-12-27 21:01:49,101][106226] Updated weights for policy 0, policy_version 250634 (0.0006) [2023-12-27 21:01:49,118][106225] Updated weights for policy 1, policy_version 250990 (0.0007) [2023-12-27 21:01:49,153][106226] Updated weights for policy 0, policy_version 250644 (0.0005) [2023-12-27 21:01:49,164][106225] Updated weights for policy 1, policy_version 251000 (0.0008) [2023-12-27 21:01:49,866][106226] Updated weights for policy 0, policy_version 250654 (0.0007) [2023-12-27 21:01:49,877][106225] Updated weights for policy 1, policy_version 251010 (0.0008) [2023-12-27 21:01:49,925][106226] Updated weights for policy 0, policy_version 250664 (0.0008) [2023-12-27 21:01:49,940][106225] Updated weights for policy 1, policy_version 251020 (0.0007) [2023-12-27 21:01:49,991][106226] Updated weights for policy 0, policy_version 250674 (0.0007) [2023-12-27 21:01:50,004][106225] Updated weights for policy 1, policy_version 251030 (0.0008) [2023-12-27 21:01:50,067][106225] Updated weights for policy 1, policy_version 251040 (0.0010) [2023-12-27 21:01:50,626][106226] Updated weights for policy 0, policy_version 250684 (0.0006) [2023-12-27 21:01:50,692][106226] Updated weights for policy 0, policy_version 250694 (0.0008) [2023-12-27 21:01:50,763][106226] Updated weights for policy 0, policy_version 250704 (0.0007) [2023-12-27 21:01:50,816][106225] Updated weights for policy 1, policy_version 251050 (0.0006) [2023-12-27 21:01:50,864][106225] Updated weights for policy 1, policy_version 251060 (0.0008) [2023-12-27 21:01:50,924][106225] Updated weights for policy 1, policy_version 251070 (0.0008) [2023-12-27 21:01:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 128491520. Throughput: 0: 9869.0, 1: 9928.7. Samples: 128498612. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:51,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-6.017')] [2023-12-27 21:01:51,487][106226] Updated weights for policy 0, policy_version 250714 (0.0008) [2023-12-27 21:01:51,548][106226] Updated weights for policy 0, policy_version 250724 (0.0011) [2023-12-27 21:01:51,612][106226] Updated weights for policy 0, policy_version 250734 (0.0010) [2023-12-27 21:01:51,678][106226] Updated weights for policy 0, policy_version 250744 (0.0009) [2023-12-27 21:01:51,721][106225] Updated weights for policy 1, policy_version 251080 (0.0007) [2023-12-27 21:01:51,794][106225] Updated weights for policy 1, policy_version 251090 (0.0008) [2023-12-27 21:01:51,855][106225] Updated weights for policy 1, policy_version 251100 (0.0006) [2023-12-27 21:01:52,489][106226] Updated weights for policy 0, policy_version 250754 (0.0008) [2023-12-27 21:01:52,554][106226] Updated weights for policy 0, policy_version 250764 (0.0010) [2023-12-27 21:01:52,563][106225] Updated weights for policy 1, policy_version 251110 (0.0006) [2023-12-27 21:01:52,615][106226] Updated weights for policy 0, policy_version 250774 (0.0011) [2023-12-27 21:01:52,621][106225] Updated weights for policy 1, policy_version 251120 (0.0005) [2023-12-27 21:01:52,676][106225] Updated weights for policy 1, policy_version 251130 (0.0009) [2023-12-27 21:01:53,307][106226] Updated weights for policy 0, policy_version 250784 (0.0010) [2023-12-27 21:01:53,362][106226] Updated weights for policy 0, policy_version 250794 (0.0009) [2023-12-27 21:01:53,387][106225] Updated weights for policy 1, policy_version 251140 (0.0008) [2023-12-27 21:01:53,413][106226] Updated weights for policy 0, policy_version 250804 (0.0005) [2023-12-27 21:01:53,437][106225] Updated weights for policy 1, policy_version 251150 (0.0008) [2023-12-27 21:01:53,501][106225] Updated weights for policy 1, policy_version 251160 (0.0010) [2023-12-27 21:01:53,970][106226] Updated weights for policy 0, policy_version 250814 (0.0005) [2023-12-27 21:01:54,034][106226] Updated weights for policy 0, policy_version 250824 (0.0005) [2023-12-27 21:01:54,090][106226] Updated weights for policy 0, policy_version 250834 (0.0005) [2023-12-27 21:01:54,172][106225] Updated weights for policy 1, policy_version 251170 (0.0010) [2023-12-27 21:01:54,222][106225] Updated weights for policy 1, policy_version 251180 (0.0007) [2023-12-27 21:01:54,282][106225] Updated weights for policy 1, policy_version 251190 (0.0008) [2023-12-27 21:01:54,332][106225] Updated weights for policy 1, policy_version 251200 (0.0009) [2023-12-27 21:01:54,624][106226] Updated weights for policy 0, policy_version 250844 (0.0006) [2023-12-27 21:01:54,689][106226] Updated weights for policy 0, policy_version 250854 (0.0005) [2023-12-27 21:01:54,741][106226] Updated weights for policy 0, policy_version 250864 (0.0005) [2023-12-27 21:01:54,999][106225] Updated weights for policy 1, policy_version 251210 (0.0005) [2023-12-27 21:01:55,063][106225] Updated weights for policy 1, policy_version 251220 (0.0007) [2023-12-27 21:01:55,119][106225] Updated weights for policy 1, policy_version 251230 (0.0008) [2023-12-27 21:01:55,297][106226] Updated weights for policy 0, policy_version 250874 (0.0006) [2023-12-27 21:01:55,363][106226] Updated weights for policy 0, policy_version 250884 (0.0009) [2023-12-27 21:01:55,432][106226] Updated weights for policy 0, policy_version 250894 (0.0010) [2023-12-27 21:01:55,502][106226] Updated weights for policy 0, policy_version 250904 (0.0010) [2023-12-27 21:01:55,751][106225] Updated weights for policy 1, policy_version 251240 (0.0006) [2023-12-27 21:01:55,823][106225] Updated weights for policy 1, policy_version 251250 (0.0005) [2023-12-27 21:01:55,877][106225] Updated weights for policy 1, policy_version 251260 (0.0007) [2023-12-27 21:01:56,136][106226] Updated weights for policy 0, policy_version 250914 (0.0010) [2023-12-27 21:01:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 128589824. Throughput: 0: 9892.2, 1: 9884.8. Samples: 128557700. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:01:56,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-6.110')] [2023-12-27 21:01:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000251264_64339968.pth... [2023-12-27 21:01:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000250128_64045056.pth [2023-12-27 21:01:56,199][106226] Updated weights for policy 0, policy_version 250924 (0.0011) [2023-12-27 21:01:56,252][106226] Updated weights for policy 0, policy_version 250934 (0.0005) [2023-12-27 21:01:56,262][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000250936_64258048.pth... [2023-12-27 21:01:56,265][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000249752_63954944.pth [2023-12-27 21:01:56,529][106225] Updated weights for policy 1, policy_version 251270 (0.0008) [2023-12-27 21:01:56,584][106225] Updated weights for policy 1, policy_version 251280 (0.0008) [2023-12-27 21:01:56,637][106225] Updated weights for policy 1, policy_version 251290 (0.0007) [2023-12-27 21:01:56,885][106226] Updated weights for policy 0, policy_version 250944 (0.0005) [2023-12-27 21:01:56,944][106226] Updated weights for policy 0, policy_version 250954 (0.0005) [2023-12-27 21:01:57,001][106226] Updated weights for policy 0, policy_version 250964 (0.0007) [2023-12-27 21:01:57,405][106225] Updated weights for policy 1, policy_version 251300 (0.0008) [2023-12-27 21:01:57,460][106225] Updated weights for policy 1, policy_version 251310 (0.0008) [2023-12-27 21:01:57,509][106225] Updated weights for policy 1, policy_version 251320 (0.0007) [2023-12-27 21:01:57,611][106226] Updated weights for policy 0, policy_version 250974 (0.0007) [2023-12-27 21:01:57,657][106226] Updated weights for policy 0, policy_version 250984 (0.0008) [2023-12-27 21:01:57,701][106226] Updated weights for policy 0, policy_version 250994 (0.0008) [2023-12-27 21:01:58,253][106225] Updated weights for policy 1, policy_version 251330 (0.0009) [2023-12-27 21:01:58,310][106225] Updated weights for policy 1, policy_version 251340 (0.0008) [2023-12-27 21:01:58,380][106225] Updated weights for policy 1, policy_version 251350 (0.0008) [2023-12-27 21:01:58,446][106225] Updated weights for policy 1, policy_version 251360 (0.0007) [2023-12-27 21:01:58,465][106226] Updated weights for policy 0, policy_version 251004 (0.0009) [2023-12-27 21:01:58,532][106226] Updated weights for policy 0, policy_version 251014 (0.0007) [2023-12-27 21:01:58,596][106226] Updated weights for policy 0, policy_version 251024 (0.0008) [2023-12-27 21:01:59,223][106225] Updated weights for policy 1, policy_version 251370 (0.0008) [2023-12-27 21:01:59,295][106225] Updated weights for policy 1, policy_version 251380 (0.0008) [2023-12-27 21:01:59,358][106225] Updated weights for policy 1, policy_version 251390 (0.0007) [2023-12-27 21:01:59,450][106226] Updated weights for policy 0, policy_version 251034 (0.0008) [2023-12-27 21:01:59,502][106226] Updated weights for policy 0, policy_version 251044 (0.0009) [2023-12-27 21:01:59,551][106226] Updated weights for policy 0, policy_version 251054 (0.0008) [2023-12-27 21:01:59,610][106226] Updated weights for policy 0, policy_version 251064 (0.0009) [2023-12-27 21:01:59,987][106225] Updated weights for policy 1, policy_version 251400 (0.0008) [2023-12-27 21:02:00,052][106225] Updated weights for policy 1, policy_version 251410 (0.0006) [2023-12-27 21:02:00,112][106225] Updated weights for policy 1, policy_version 251420 (0.0010) [2023-12-27 21:02:00,437][106226] Updated weights for policy 0, policy_version 251074 (0.0007) [2023-12-27 21:02:00,491][106226] Updated weights for policy 0, policy_version 251084 (0.0008) [2023-12-27 21:02:00,548][106226] Updated weights for policy 0, policy_version 251094 (0.0007) [2023-12-27 21:02:00,805][106225] Updated weights for policy 1, policy_version 251430 (0.0010) [2023-12-27 21:02:00,858][106225] Updated weights for policy 1, policy_version 251440 (0.0010) [2023-12-27 21:02:00,911][106225] Updated weights for policy 1, policy_version 251450 (0.0010) [2023-12-27 21:02:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 128688128. Throughput: 0: 9952.2, 1: 9934.3. Samples: 128677872. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:01,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-6.086')] [2023-12-27 21:02:01,310][106226] Updated weights for policy 0, policy_version 251104 (0.0008) [2023-12-27 21:02:01,376][106226] Updated weights for policy 0, policy_version 251114 (0.0008) [2023-12-27 21:02:01,441][106226] Updated weights for policy 0, policy_version 251124 (0.0008) [2023-12-27 21:02:01,597][106225] Updated weights for policy 1, policy_version 251460 (0.0009) [2023-12-27 21:02:01,671][106225] Updated weights for policy 1, policy_version 251470 (0.0008) [2023-12-27 21:02:01,739][106225] Updated weights for policy 1, policy_version 251480 (0.0009) [2023-12-27 21:02:02,145][106226] Updated weights for policy 0, policy_version 251134 (0.0008) [2023-12-27 21:02:02,197][106226] Updated weights for policy 0, policy_version 251144 (0.0009) [2023-12-27 21:02:02,258][106226] Updated weights for policy 0, policy_version 251154 (0.0007) [2023-12-27 21:02:02,490][106225] Updated weights for policy 1, policy_version 251490 (0.0009) [2023-12-27 21:02:02,546][106225] Updated weights for policy 1, policy_version 251500 (0.0009) [2023-12-27 21:02:02,602][106225] Updated weights for policy 1, policy_version 251510 (0.0008) [2023-12-27 21:02:02,662][106225] Updated weights for policy 1, policy_version 251520 (0.0008) [2023-12-27 21:02:02,888][106226] Updated weights for policy 0, policy_version 251164 (0.0009) [2023-12-27 21:02:02,945][106226] Updated weights for policy 0, policy_version 251174 (0.0005) [2023-12-27 21:02:03,015][106226] Updated weights for policy 0, policy_version 251184 (0.0005) [2023-12-27 21:02:03,483][106225] Updated weights for policy 1, policy_version 251530 (0.0008) [2023-12-27 21:02:03,514][106226] Updated weights for policy 0, policy_version 251194 (0.0005) [2023-12-27 21:02:03,537][106225] Updated weights for policy 1, policy_version 251540 (0.0008) [2023-12-27 21:02:03,567][106226] Updated weights for policy 0, policy_version 251204 (0.0005) [2023-12-27 21:02:03,593][106225] Updated weights for policy 1, policy_version 251550 (0.0009) [2023-12-27 21:02:03,632][106226] Updated weights for policy 0, policy_version 251214 (0.0006) [2023-12-27 21:02:03,689][106226] Updated weights for policy 0, policy_version 251224 (0.0005) [2023-12-27 21:02:04,266][106226] Updated weights for policy 0, policy_version 251234 (0.0011) [2023-12-27 21:02:04,333][106226] Updated weights for policy 0, policy_version 251244 (0.0007) [2023-12-27 21:02:04,392][106225] Updated weights for policy 1, policy_version 251560 (0.0007) [2023-12-27 21:02:04,394][106226] Updated weights for policy 0, policy_version 251254 (0.0010) [2023-12-27 21:02:04,444][106225] Updated weights for policy 1, policy_version 251570 (0.0008) [2023-12-27 21:02:04,498][106225] Updated weights for policy 1, policy_version 251580 (0.0008) [2023-12-27 21:02:04,927][106226] Updated weights for policy 0, policy_version 251264 (0.0006) [2023-12-27 21:02:04,972][106226] Updated weights for policy 0, policy_version 251274 (0.0005) [2023-12-27 21:02:05,023][106226] Updated weights for policy 0, policy_version 251284 (0.0005) [2023-12-27 21:02:05,153][106225] Updated weights for policy 1, policy_version 251590 (0.0010) [2023-12-27 21:02:05,199][106225] Updated weights for policy 1, policy_version 251600 (0.0010) [2023-12-27 21:02:05,272][106225] Updated weights for policy 1, policy_version 251610 (0.0009) [2023-12-27 21:02:05,620][106226] Updated weights for policy 0, policy_version 251294 (0.0008) [2023-12-27 21:02:05,665][106226] Updated weights for policy 0, policy_version 251304 (0.0010) [2023-12-27 21:02:05,725][106226] Updated weights for policy 0, policy_version 251314 (0.0010) [2023-12-27 21:02:05,908][106225] Updated weights for policy 1, policy_version 251620 (0.0009) [2023-12-27 21:02:05,967][106225] Updated weights for policy 1, policy_version 251630 (0.0006) [2023-12-27 21:02:06,023][106225] Updated weights for policy 1, policy_version 251640 (0.0006) [2023-12-27 21:02:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 128794624. Throughput: 0: 10110.3, 1: 9908.9. Samples: 128800412. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:06,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-6.325')] [2023-12-27 21:02:06,420][106226] Updated weights for policy 0, policy_version 251324 (0.0009) [2023-12-27 21:02:06,484][106226] Updated weights for policy 0, policy_version 251334 (0.0008) [2023-12-27 21:02:06,554][106226] Updated weights for policy 0, policy_version 251344 (0.0008) [2023-12-27 21:02:06,692][106225] Updated weights for policy 1, policy_version 251650 (0.0006) [2023-12-27 21:02:06,746][106225] Updated weights for policy 1, policy_version 251660 (0.0009) [2023-12-27 21:02:06,800][106225] Updated weights for policy 1, policy_version 251670 (0.0008) [2023-12-27 21:02:06,861][106225] Updated weights for policy 1, policy_version 251680 (0.0011) [2023-12-27 21:02:07,264][106226] Updated weights for policy 0, policy_version 251354 (0.0007) [2023-12-27 21:02:07,317][106226] Updated weights for policy 0, policy_version 251364 (0.0006) [2023-12-27 21:02:07,378][106226] Updated weights for policy 0, policy_version 251374 (0.0008) [2023-12-27 21:02:07,437][106226] Updated weights for policy 0, policy_version 251384 (0.0008) [2023-12-27 21:02:07,562][106225] Updated weights for policy 1, policy_version 251690 (0.0008) [2023-12-27 21:02:07,614][106225] Updated weights for policy 1, policy_version 251700 (0.0008) [2023-12-27 21:02:07,671][106225] Updated weights for policy 1, policy_version 251710 (0.0007) [2023-12-27 21:02:08,132][106226] Updated weights for policy 0, policy_version 251394 (0.0009) [2023-12-27 21:02:08,177][106226] Updated weights for policy 0, policy_version 251404 (0.0008) [2023-12-27 21:02:08,223][106226] Updated weights for policy 0, policy_version 251414 (0.0009) [2023-12-27 21:02:08,359][106225] Updated weights for policy 1, policy_version 251720 (0.0007) [2023-12-27 21:02:08,417][106225] Updated weights for policy 1, policy_version 251730 (0.0008) [2023-12-27 21:02:08,475][106225] Updated weights for policy 1, policy_version 251740 (0.0009) [2023-12-27 21:02:09,033][106226] Updated weights for policy 0, policy_version 251424 (0.0008) [2023-12-27 21:02:09,091][106226] Updated weights for policy 0, policy_version 251434 (0.0008) [2023-12-27 21:02:09,152][106226] Updated weights for policy 0, policy_version 251444 (0.0008) [2023-12-27 21:02:09,181][106225] Updated weights for policy 1, policy_version 251750 (0.0010) [2023-12-27 21:02:09,248][106225] Updated weights for policy 1, policy_version 251760 (0.0009) [2023-12-27 21:02:09,309][106225] Updated weights for policy 1, policy_version 251770 (0.0010) [2023-12-27 21:02:09,983][106226] Updated weights for policy 0, policy_version 251454 (0.0008) [2023-12-27 21:02:10,050][106226] Updated weights for policy 0, policy_version 251464 (0.0009) [2023-12-27 21:02:10,087][106225] Updated weights for policy 1, policy_version 251780 (0.0012) [2023-12-27 21:02:10,105][106226] Updated weights for policy 0, policy_version 251474 (0.0006) [2023-12-27 21:02:10,151][106225] Updated weights for policy 1, policy_version 251790 (0.0009) [2023-12-27 21:02:10,213][106225] Updated weights for policy 1, policy_version 251800 (0.0008) [2023-12-27 21:02:10,871][106225] Updated weights for policy 1, policy_version 251810 (0.0006) [2023-12-27 21:02:10,896][106226] Updated weights for policy 0, policy_version 251484 (0.0009) [2023-12-27 21:02:10,928][106225] Updated weights for policy 1, policy_version 251820 (0.0007) [2023-12-27 21:02:10,961][106226] Updated weights for policy 0, policy_version 251494 (0.0008) [2023-12-27 21:02:10,980][106225] Updated weights for policy 1, policy_version 251830 (0.0005) [2023-12-27 21:02:11,016][106226] Updated weights for policy 0, policy_version 251504 (0.0008) [2023-12-27 21:02:11,031][106225] Updated weights for policy 1, policy_version 251840 (0.0008) [2023-12-27 21:02:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 128892928. Throughput: 0: 10104.9, 1: 9944.8. Samples: 128859440. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:11,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-6.200')] [2023-12-27 21:02:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000251840_64487424.pth... [2023-12-27 21:02:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000251512_64405504.pth... [2023-12-27 21:02:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000250688_64192512.pth [2023-12-27 21:02:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000250328_64102400.pth [2023-12-27 21:02:11,770][106225] Updated weights for policy 1, policy_version 251850 (0.0008) [2023-12-27 21:02:11,836][106225] Updated weights for policy 1, policy_version 251860 (0.0007) [2023-12-27 21:02:11,884][106226] Updated weights for policy 0, policy_version 251514 (0.0009) [2023-12-27 21:02:11,897][106225] Updated weights for policy 1, policy_version 251870 (0.0006) [2023-12-27 21:02:11,941][106226] Updated weights for policy 0, policy_version 251524 (0.0009) [2023-12-27 21:02:12,002][106226] Updated weights for policy 0, policy_version 251534 (0.0009) [2023-12-27 21:02:12,086][106226] Updated weights for policy 0, policy_version 251544 (0.0008) [2023-12-27 21:02:12,576][106225] Updated weights for policy 1, policy_version 251880 (0.0008) [2023-12-27 21:02:12,631][106225] Updated weights for policy 1, policy_version 251890 (0.0008) [2023-12-27 21:02:12,690][106225] Updated weights for policy 1, policy_version 251900 (0.0008) [2023-12-27 21:02:12,820][106226] Updated weights for policy 0, policy_version 251554 (0.0008) [2023-12-27 21:02:12,894][106226] Updated weights for policy 0, policy_version 251564 (0.0008) [2023-12-27 21:02:12,952][106226] Updated weights for policy 0, policy_version 251574 (0.0006) [2023-12-27 21:02:13,403][106225] Updated weights for policy 1, policy_version 251911 (0.0009) [2023-12-27 21:02:13,458][106225] Updated weights for policy 1, policy_version 251921 (0.0009) [2023-12-27 21:02:13,477][106226] Updated weights for policy 0, policy_version 251584 (0.0006) [2023-12-27 21:02:13,523][106225] Updated weights for policy 1, policy_version 251931 (0.0007) [2023-12-27 21:02:13,536][106226] Updated weights for policy 0, policy_version 251594 (0.0005) [2023-12-27 21:02:13,594][106226] Updated weights for policy 0, policy_version 251604 (0.0005) [2023-12-27 21:02:14,131][106226] Updated weights for policy 0, policy_version 251614 (0.0005) [2023-12-27 21:02:14,181][106226] Updated weights for policy 0, policy_version 251624 (0.0006) [2023-12-27 21:02:14,231][106226] Updated weights for policy 0, policy_version 251634 (0.0007) [2023-12-27 21:02:14,238][106225] Updated weights for policy 1, policy_version 251941 (0.0006) [2023-12-27 21:02:14,291][106225] Updated weights for policy 1, policy_version 251951 (0.0008) [2023-12-27 21:02:14,339][106225] Updated weights for policy 1, policy_version 251961 (0.0008) [2023-12-27 21:02:14,962][106226] Updated weights for policy 0, policy_version 251644 (0.0008) [2023-12-27 21:02:15,000][106225] Updated weights for policy 1, policy_version 251971 (0.0008) [2023-12-27 21:02:15,017][106226] Updated weights for policy 0, policy_version 251654 (0.0007) [2023-12-27 21:02:15,068][106225] Updated weights for policy 1, policy_version 251981 (0.0008) [2023-12-27 21:02:15,083][106226] Updated weights for policy 0, policy_version 251664 (0.0006) [2023-12-27 21:02:15,128][106225] Updated weights for policy 1, policy_version 251991 (0.0007) [2023-12-27 21:02:15,794][106226] Updated weights for policy 0, policy_version 251674 (0.0008) [2023-12-27 21:02:15,841][106226] Updated weights for policy 0, policy_version 251684 (0.0008) [2023-12-27 21:02:15,857][106225] Updated weights for policy 1, policy_version 252001 (0.0008) [2023-12-27 21:02:15,891][106226] Updated weights for policy 0, policy_version 251694 (0.0009) [2023-12-27 21:02:15,910][106225] Updated weights for policy 1, policy_version 252011 (0.0010) [2023-12-27 21:02:15,948][106226] Updated weights for policy 0, policy_version 251704 (0.0006) [2023-12-27 21:02:15,968][106225] Updated weights for policy 1, policy_version 252021 (0.0010) [2023-12-27 21:02:16,019][106225] Updated weights for policy 1, policy_version 252031 (0.0010) [2023-12-27 21:02:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 128991232. Throughput: 0: 10031.3, 1: 9883.6. Samples: 128976576. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:16,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-6.108')] [2023-12-27 21:02:16,591][106226] Updated weights for policy 0, policy_version 251714 (0.0006) [2023-12-27 21:02:16,654][106226] Updated weights for policy 0, policy_version 251724 (0.0007) [2023-12-27 21:02:16,713][106225] Updated weights for policy 1, policy_version 252041 (0.0010) [2023-12-27 21:02:16,716][106226] Updated weights for policy 0, policy_version 251734 (0.0008) [2023-12-27 21:02:16,763][106225] Updated weights for policy 1, policy_version 252051 (0.0010) [2023-12-27 21:02:16,813][106225] Updated weights for policy 1, policy_version 252061 (0.0010) [2023-12-27 21:02:17,410][106226] Updated weights for policy 0, policy_version 251744 (0.0007) [2023-12-27 21:02:17,456][106226] Updated weights for policy 0, policy_version 251754 (0.0007) [2023-12-27 21:02:17,515][106226] Updated weights for policy 0, policy_version 251764 (0.0008) [2023-12-27 21:02:17,528][106225] Updated weights for policy 1, policy_version 252071 (0.0010) [2023-12-27 21:02:17,575][106225] Updated weights for policy 1, policy_version 252081 (0.0010) [2023-12-27 21:02:17,628][106225] Updated weights for policy 1, policy_version 252091 (0.0010) [2023-12-27 21:02:18,190][106226] Updated weights for policy 0, policy_version 251774 (0.0007) [2023-12-27 21:02:18,242][106226] Updated weights for policy 0, policy_version 251784 (0.0008) [2023-12-27 21:02:18,300][106226] Updated weights for policy 0, policy_version 251794 (0.0008) [2023-12-27 21:02:18,318][106225] Updated weights for policy 1, policy_version 252101 (0.0009) [2023-12-27 21:02:18,380][106225] Updated weights for policy 1, policy_version 252111 (0.0010) [2023-12-27 21:02:18,438][106225] Updated weights for policy 1, policy_version 252121 (0.0010) [2023-12-27 21:02:19,112][106226] Updated weights for policy 0, policy_version 251804 (0.0008) [2023-12-27 21:02:19,159][106225] Updated weights for policy 1, policy_version 252131 (0.0008) [2023-12-27 21:02:19,169][106226] Updated weights for policy 0, policy_version 251814 (0.0007) [2023-12-27 21:02:19,219][106225] Updated weights for policy 1, policy_version 252141 (0.0010) [2023-12-27 21:02:19,231][106226] Updated weights for policy 0, policy_version 251824 (0.0007) [2023-12-27 21:02:19,279][106225] Updated weights for policy 1, policy_version 252151 (0.0009) [2023-12-27 21:02:19,964][106226] Updated weights for policy 0, policy_version 251834 (0.0007) [2023-12-27 21:02:19,986][106225] Updated weights for policy 1, policy_version 252161 (0.0011) [2023-12-27 21:02:20,028][106226] Updated weights for policy 0, policy_version 251844 (0.0011) [2023-12-27 21:02:20,046][106225] Updated weights for policy 1, policy_version 252171 (0.0005) [2023-12-27 21:02:20,094][106226] Updated weights for policy 0, policy_version 251854 (0.0011) [2023-12-27 21:02:20,108][106225] Updated weights for policy 1, policy_version 252181 (0.0006) [2023-12-27 21:02:20,157][106226] Updated weights for policy 0, policy_version 251864 (0.0011) [2023-12-27 21:02:20,168][106225] Updated weights for policy 1, policy_version 252191 (0.0006) [2023-12-27 21:02:20,925][106226] Updated weights for policy 0, policy_version 251874 (0.0011) [2023-12-27 21:02:20,935][106225] Updated weights for policy 1, policy_version 252201 (0.0006) [2023-12-27 21:02:20,984][106226] Updated weights for policy 0, policy_version 251884 (0.0011) [2023-12-27 21:02:20,991][106225] Updated weights for policy 1, policy_version 252211 (0.0006) [2023-12-27 21:02:21,047][106226] Updated weights for policy 0, policy_version 251894 (0.0011) [2023-12-27 21:02:21,073][106225] Updated weights for policy 1, policy_version 252221 (0.0007) [2023-12-27 21:02:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 129089536. Throughput: 0: 10019.1, 1: 9871.4. Samples: 129093068. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:21,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-5.821')] [2023-12-27 21:02:21,860][106226] Updated weights for policy 0, policy_version 251904 (0.0010) [2023-12-27 21:02:21,886][106225] Updated weights for policy 1, policy_version 252231 (0.0006) [2023-12-27 21:02:21,919][106226] Updated weights for policy 0, policy_version 251914 (0.0011) [2023-12-27 21:02:21,941][106225] Updated weights for policy 1, policy_version 252241 (0.0006) [2023-12-27 21:02:21,980][106226] Updated weights for policy 0, policy_version 251924 (0.0011) [2023-12-27 21:02:22,006][106225] Updated weights for policy 1, policy_version 252251 (0.0006) [2023-12-27 21:02:22,676][106226] Updated weights for policy 0, policy_version 251934 (0.0011) [2023-12-27 21:02:22,737][106226] Updated weights for policy 0, policy_version 251944 (0.0011) [2023-12-27 21:02:22,799][106226] Updated weights for policy 0, policy_version 251954 (0.0011) [2023-12-27 21:02:22,801][106225] Updated weights for policy 1, policy_version 252261 (0.0007) [2023-12-27 21:02:22,866][106225] Updated weights for policy 1, policy_version 252271 (0.0007) [2023-12-27 21:02:22,927][106225] Updated weights for policy 1, policy_version 252281 (0.0007) [2023-12-27 21:02:23,521][106226] Updated weights for policy 0, policy_version 251964 (0.0011) [2023-12-27 21:02:23,575][106226] Updated weights for policy 0, policy_version 251974 (0.0010) [2023-12-27 21:02:23,629][106226] Updated weights for policy 0, policy_version 251984 (0.0010) [2023-12-27 21:02:23,668][106225] Updated weights for policy 1, policy_version 252291 (0.0008) [2023-12-27 21:02:23,726][106225] Updated weights for policy 1, policy_version 252301 (0.0008) [2023-12-27 21:02:23,787][106225] Updated weights for policy 1, policy_version 252311 (0.0008) [2023-12-27 21:02:24,355][106226] Updated weights for policy 0, policy_version 251994 (0.0010) [2023-12-27 21:02:24,409][106226] Updated weights for policy 0, policy_version 252004 (0.0010) [2023-12-27 21:02:24,465][106226] Updated weights for policy 0, policy_version 252014 (0.0010) [2023-12-27 21:02:24,512][106225] Updated weights for policy 1, policy_version 252321 (0.0008) [2023-12-27 21:02:24,522][106226] Updated weights for policy 0, policy_version 252024 (0.0011) [2023-12-27 21:02:24,564][106225] Updated weights for policy 1, policy_version 252331 (0.0007) [2023-12-27 21:02:24,626][106225] Updated weights for policy 1, policy_version 252341 (0.0008) [2023-12-27 21:02:24,685][106225] Updated weights for policy 1, policy_version 252351 (0.0008) [2023-12-27 21:02:25,150][106226] Updated weights for policy 0, policy_version 252034 (0.0011) [2023-12-27 21:02:25,209][106226] Updated weights for policy 0, policy_version 252044 (0.0005) [2023-12-27 21:02:25,264][106226] Updated weights for policy 0, policy_version 252054 (0.0005) [2023-12-27 21:02:25,477][106225] Updated weights for policy 1, policy_version 252361 (0.0009) [2023-12-27 21:02:25,530][106225] Updated weights for policy 1, policy_version 252371 (0.0008) [2023-12-27 21:02:25,583][106225] Updated weights for policy 1, policy_version 252381 (0.0007) [2023-12-27 21:02:25,841][106226] Updated weights for policy 0, policy_version 252064 (0.0009) [2023-12-27 21:02:25,891][106226] Updated weights for policy 0, policy_version 252074 (0.0010) [2023-12-27 21:02:25,950][106226] Updated weights for policy 0, policy_version 252084 (0.0010) [2023-12-27 21:02:26,175][105115] Fps is (10 sec: 18840.7, 60 sec: 19797.8, 300 sec: 19771.8). Total num frames: 129179648. Throughput: 0: 9966.9, 1: 9795.6. Samples: 129148452. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:26,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-6.000')] [2023-12-27 21:02:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000252088_64552960.pth... [2023-12-27 21:02:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000252384_64626688.pth... [2023-12-27 21:02:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000251264_64339968.pth [2023-12-27 21:02:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000250936_64258048.pth [2023-12-27 21:02:26,266][106225] Updated weights for policy 1, policy_version 252391 (0.0007) [2023-12-27 21:02:26,331][106225] Updated weights for policy 1, policy_version 252401 (0.0005) [2023-12-27 21:02:26,391][106225] Updated weights for policy 1, policy_version 252411 (0.0005) [2023-12-27 21:02:26,663][106226] Updated weights for policy 0, policy_version 252094 (0.0007) [2023-12-27 21:02:26,710][106226] Updated weights for policy 0, policy_version 252104 (0.0005) [2023-12-27 21:02:26,762][106226] Updated weights for policy 0, policy_version 252114 (0.0005) [2023-12-27 21:02:27,063][106225] Updated weights for policy 1, policy_version 252421 (0.0007) [2023-12-27 21:02:27,112][106225] Updated weights for policy 1, policy_version 252431 (0.0008) [2023-12-27 21:02:27,161][106225] Updated weights for policy 1, policy_version 252441 (0.0009) [2023-12-27 21:02:27,350][106226] Updated weights for policy 0, policy_version 252124 (0.0005) [2023-12-27 21:02:27,411][106226] Updated weights for policy 0, policy_version 252134 (0.0009) [2023-12-27 21:02:27,457][106226] Updated weights for policy 0, policy_version 252144 (0.0010) [2023-12-27 21:02:27,903][106225] Updated weights for policy 1, policy_version 252451 (0.0007) [2023-12-27 21:02:27,968][106225] Updated weights for policy 1, policy_version 252461 (0.0005) [2023-12-27 21:02:28,028][106225] Updated weights for policy 1, policy_version 252471 (0.0008) [2023-12-27 21:02:28,098][106226] Updated weights for policy 0, policy_version 252154 (0.0009) [2023-12-27 21:02:28,145][106226] Updated weights for policy 0, policy_version 252164 (0.0005) [2023-12-27 21:02:28,191][106226] Updated weights for policy 0, policy_version 252174 (0.0006) [2023-12-27 21:02:28,236][106226] Updated weights for policy 0, policy_version 252184 (0.0007) [2023-12-27 21:02:28,705][106225] Updated weights for policy 1, policy_version 252481 (0.0010) [2023-12-27 21:02:28,757][106225] Updated weights for policy 1, policy_version 252491 (0.0010) [2023-12-27 21:02:28,815][106225] Updated weights for policy 1, policy_version 252501 (0.0010) [2023-12-27 21:02:28,879][106225] Updated weights for policy 1, policy_version 252511 (0.0010) [2023-12-27 21:02:28,939][106226] Updated weights for policy 0, policy_version 252194 (0.0005) [2023-12-27 21:02:28,995][106226] Updated weights for policy 0, policy_version 252204 (0.0005) [2023-12-27 21:02:29,059][106226] Updated weights for policy 0, policy_version 252214 (0.0008) [2023-12-27 21:02:29,608][106225] Updated weights for policy 1, policy_version 252521 (0.0010) [2023-12-27 21:02:29,665][106225] Updated weights for policy 1, policy_version 252531 (0.0010) [2023-12-27 21:02:29,711][106226] Updated weights for policy 0, policy_version 252224 (0.0009) [2023-12-27 21:02:29,728][106225] Updated weights for policy 1, policy_version 252541 (0.0011) [2023-12-27 21:02:29,765][106226] Updated weights for policy 0, policy_version 252234 (0.0009) [2023-12-27 21:02:29,820][106226] Updated weights for policy 0, policy_version 252244 (0.0008) [2023-12-27 21:02:30,476][106225] Updated weights for policy 1, policy_version 252551 (0.0010) [2023-12-27 21:02:30,531][106225] Updated weights for policy 1, policy_version 252561 (0.0010) [2023-12-27 21:02:30,585][106226] Updated weights for policy 0, policy_version 252254 (0.0007) [2023-12-27 21:02:30,590][106225] Updated weights for policy 1, policy_version 252571 (0.0010) [2023-12-27 21:02:30,645][106226] Updated weights for policy 0, policy_version 252264 (0.0006) [2023-12-27 21:02:30,697][106226] Updated weights for policy 0, policy_version 252274 (0.0007) [2023-12-27 21:02:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 129277952. Throughput: 0: 10105.8, 1: 9765.4. Samples: 129270052. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:31,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-6.289')] [2023-12-27 21:02:31,240][106225] Updated weights for policy 1, policy_version 252581 (0.0010) [2023-12-27 21:02:31,305][106225] Updated weights for policy 1, policy_version 252591 (0.0009) [2023-12-27 21:02:31,367][106225] Updated weights for policy 1, policy_version 252601 (0.0010) [2023-12-27 21:02:31,426][106226] Updated weights for policy 0, policy_version 252284 (0.0008) [2023-12-27 21:02:31,484][106226] Updated weights for policy 0, policy_version 252294 (0.0008) [2023-12-27 21:02:31,540][106226] Updated weights for policy 0, policy_version 252304 (0.0008) [2023-12-27 21:02:32,142][106225] Updated weights for policy 1, policy_version 252611 (0.0007) [2023-12-27 21:02:32,194][106225] Updated weights for policy 1, policy_version 252621 (0.0009) [2023-12-27 21:02:32,246][106225] Updated weights for policy 1, policy_version 252631 (0.0008) [2023-12-27 21:02:32,269][106226] Updated weights for policy 0, policy_version 252314 (0.0008) [2023-12-27 21:02:32,331][106226] Updated weights for policy 0, policy_version 252324 (0.0008) [2023-12-27 21:02:32,394][106226] Updated weights for policy 0, policy_version 252334 (0.0008) [2023-12-27 21:02:32,456][106226] Updated weights for policy 0, policy_version 252344 (0.0009) [2023-12-27 21:02:32,843][106225] Updated weights for policy 1, policy_version 252641 (0.0009) [2023-12-27 21:02:32,903][106225] Updated weights for policy 1, policy_version 252651 (0.0005) [2023-12-27 21:02:32,964][106225] Updated weights for policy 1, policy_version 252661 (0.0008) [2023-12-27 21:02:33,012][106225] Updated weights for policy 1, policy_version 252671 (0.0006) [2023-12-27 21:02:33,142][106226] Updated weights for policy 0, policy_version 252354 (0.0005) [2023-12-27 21:02:33,191][106226] Updated weights for policy 0, policy_version 252364 (0.0005) [2023-12-27 21:02:33,250][106226] Updated weights for policy 0, policy_version 252374 (0.0005) [2023-12-27 21:02:33,685][106225] Updated weights for policy 1, policy_version 252681 (0.0005) [2023-12-27 21:02:33,734][106225] Updated weights for policy 1, policy_version 252691 (0.0010) [2023-12-27 21:02:33,786][106226] Updated weights for policy 0, policy_version 252384 (0.0007) [2023-12-27 21:02:33,788][106225] Updated weights for policy 1, policy_version 252701 (0.0009) [2023-12-27 21:02:33,832][106226] Updated weights for policy 0, policy_version 252394 (0.0007) [2023-12-27 21:02:33,886][106226] Updated weights for policy 0, policy_version 252404 (0.0008) [2023-12-27 21:02:34,491][106225] Updated weights for policy 1, policy_version 252711 (0.0010) [2023-12-27 21:02:34,549][106225] Updated weights for policy 1, policy_version 252721 (0.0010) [2023-12-27 21:02:34,614][106225] Updated weights for policy 1, policy_version 252731 (0.0010) [2023-12-27 21:02:34,679][106226] Updated weights for policy 0, policy_version 252414 (0.0008) [2023-12-27 21:02:34,729][106226] Updated weights for policy 0, policy_version 252424 (0.0007) [2023-12-27 21:02:34,774][106226] Updated weights for policy 0, policy_version 252434 (0.0005) [2023-12-27 21:02:35,314][106225] Updated weights for policy 1, policy_version 252741 (0.0010) [2023-12-27 21:02:35,370][106225] Updated weights for policy 1, policy_version 252751 (0.0008) [2023-12-27 21:02:35,428][106225] Updated weights for policy 1, policy_version 252761 (0.0009) [2023-12-27 21:02:35,484][106226] Updated weights for policy 0, policy_version 252444 (0.0007) [2023-12-27 21:02:35,542][106226] Updated weights for policy 0, policy_version 252454 (0.0005) [2023-12-27 21:02:35,611][106226] Updated weights for policy 0, policy_version 252464 (0.0007) [2023-12-27 21:02:36,175][105115] Fps is (10 sec: 19661.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 129376256. Throughput: 0: 10082.1, 1: 9746.7. Samples: 129390908. Policy #0 lag: (min: 30.0, avg: 30.3, max: 40.0) [2023-12-27 21:02:36,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-6.206')] [2023-12-27 21:02:36,177][106226] Updated weights for policy 0, policy_version 252474 (0.0005) [2023-12-27 21:02:36,184][106225] Updated weights for policy 1, policy_version 252771 (0.0009) [2023-12-27 21:02:36,239][106226] Updated weights for policy 0, policy_version 252484 (0.0007) [2023-12-27 21:02:36,246][106225] Updated weights for policy 1, policy_version 252781 (0.0007) [2023-12-27 21:02:36,302][106226] Updated weights for policy 0, policy_version 252494 (0.0008) [2023-12-27 21:02:36,304][106225] Updated weights for policy 1, policy_version 252791 (0.0006) [2023-12-27 21:02:36,362][106226] Updated weights for policy 0, policy_version 252504 (0.0008) [2023-12-27 21:02:37,021][106225] Updated weights for policy 1, policy_version 252801 (0.0006) [2023-12-27 21:02:37,080][106225] Updated weights for policy 1, policy_version 252811 (0.0006) [2023-12-27 21:02:37,086][106226] Updated weights for policy 0, policy_version 252514 (0.0008) [2023-12-27 21:02:37,136][106226] Updated weights for policy 0, policy_version 252524 (0.0006) [2023-12-27 21:02:37,138][106225] Updated weights for policy 1, policy_version 252821 (0.0010) [2023-12-27 21:02:37,184][106226] Updated weights for policy 0, policy_version 252534 (0.0007) [2023-12-27 21:02:37,195][106225] Updated weights for policy 1, policy_version 252831 (0.0010) [2023-12-27 21:02:37,814][106225] Updated weights for policy 1, policy_version 252841 (0.0011) [2023-12-27 21:02:37,876][106225] Updated weights for policy 1, policy_version 252851 (0.0011) [2023-12-27 21:02:37,940][106225] Updated weights for policy 1, policy_version 252861 (0.0010) [2023-12-27 21:02:37,950][106226] Updated weights for policy 0, policy_version 252544 (0.0006) [2023-12-27 21:02:38,009][106226] Updated weights for policy 0, policy_version 252554 (0.0007) [2023-12-27 21:02:38,062][106226] Updated weights for policy 0, policy_version 252564 (0.0008) [2023-12-27 21:02:38,608][106225] Updated weights for policy 1, policy_version 252871 (0.0009) [2023-12-27 21:02:38,659][106225] Updated weights for policy 1, policy_version 252881 (0.0008) [2023-12-27 21:02:38,712][106225] Updated weights for policy 1, policy_version 252891 (0.0006) [2023-12-27 21:02:38,749][106226] Updated weights for policy 0, policy_version 252574 (0.0007) [2023-12-27 21:02:38,815][106226] Updated weights for policy 0, policy_version 252584 (0.0010) [2023-12-27 21:02:38,875][106226] Updated weights for policy 0, policy_version 252594 (0.0009) [2023-12-27 21:02:39,324][106225] Updated weights for policy 1, policy_version 252901 (0.0006) [2023-12-27 21:02:39,394][106225] Updated weights for policy 1, policy_version 252911 (0.0008) [2023-12-27 21:02:39,463][106225] Updated weights for policy 1, policy_version 252921 (0.0008) [2023-12-27 21:02:39,650][106226] Updated weights for policy 0, policy_version 252604 (0.0007) [2023-12-27 21:02:39,715][106226] Updated weights for policy 0, policy_version 252614 (0.0008) [2023-12-27 21:02:39,772][106226] Updated weights for policy 0, policy_version 252624 (0.0007) [2023-12-27 21:02:40,222][106225] Updated weights for policy 1, policy_version 252931 (0.0009) [2023-12-27 21:02:40,276][106225] Updated weights for policy 1, policy_version 252941 (0.0007) [2023-12-27 21:02:40,327][106225] Updated weights for policy 1, policy_version 252951 (0.0007) [2023-12-27 21:02:40,512][106226] Updated weights for policy 0, policy_version 252634 (0.0007) [2023-12-27 21:02:40,579][106226] Updated weights for policy 0, policy_version 252644 (0.0011) [2023-12-27 21:02:40,640][106226] Updated weights for policy 0, policy_version 252654 (0.0011) [2023-12-27 21:02:40,709][106226] Updated weights for policy 0, policy_version 252664 (0.0010) [2023-12-27 21:02:41,010][106225] Updated weights for policy 1, policy_version 252961 (0.0008) [2023-12-27 21:02:41,075][106225] Updated weights for policy 1, policy_version 252971 (0.0008) [2023-12-27 21:02:41,143][106225] Updated weights for policy 1, policy_version 252981 (0.0008) [2023-12-27 21:02:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 129474560. Throughput: 0: 10036.2, 1: 9787.4. Samples: 129449760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:02:41,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-6.132')] [2023-12-27 21:02:41,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000252664_64700416.pth... [2023-12-27 21:02:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000251512_64405504.pth [2023-12-27 21:02:41,209][106225] Updated weights for policy 1, policy_version 252991 (0.0008) [2023-12-27 21:02:41,215][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000252992_64782336.pth... [2023-12-27 21:02:41,218][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000251840_64487424.pth [2023-12-27 21:02:41,507][106226] Updated weights for policy 0, policy_version 252674 (0.0011) [2023-12-27 21:02:41,569][106226] Updated weights for policy 0, policy_version 252684 (0.0011) [2023-12-27 21:02:41,634][106226] Updated weights for policy 0, policy_version 252694 (0.0010) [2023-12-27 21:02:42,026][106225] Updated weights for policy 1, policy_version 253001 (0.0008) [2023-12-27 21:02:42,089][106225] Updated weights for policy 1, policy_version 253011 (0.0007) [2023-12-27 21:02:42,154][106225] Updated weights for policy 1, policy_version 253021 (0.0008) [2023-12-27 21:02:42,360][106226] Updated weights for policy 0, policy_version 252704 (0.0009) [2023-12-27 21:02:42,427][106226] Updated weights for policy 0, policy_version 252714 (0.0010) [2023-12-27 21:02:42,487][106226] Updated weights for policy 0, policy_version 252724 (0.0011) [2023-12-27 21:02:42,879][106225] Updated weights for policy 1, policy_version 253031 (0.0008) [2023-12-27 21:02:42,934][106225] Updated weights for policy 1, policy_version 253041 (0.0008) [2023-12-27 21:02:42,992][106225] Updated weights for policy 1, policy_version 253051 (0.0009) [2023-12-27 21:02:43,214][106226] Updated weights for policy 0, policy_version 252734 (0.0009) [2023-12-27 21:02:43,274][106226] Updated weights for policy 0, policy_version 252744 (0.0009) [2023-12-27 21:02:43,327][106226] Updated weights for policy 0, policy_version 252754 (0.0009) [2023-12-27 21:02:43,629][106225] Updated weights for policy 1, policy_version 253061 (0.0007) [2023-12-27 21:02:43,680][106225] Updated weights for policy 1, policy_version 253071 (0.0005) [2023-12-27 21:02:43,728][106225] Updated weights for policy 1, policy_version 253081 (0.0005) [2023-12-27 21:02:43,983][106226] Updated weights for policy 0, policy_version 252764 (0.0010) [2023-12-27 21:02:44,032][106226] Updated weights for policy 0, policy_version 252774 (0.0008) [2023-12-27 21:02:44,088][106226] Updated weights for policy 0, policy_version 252784 (0.0006) [2023-12-27 21:02:44,281][106225] Updated weights for policy 1, policy_version 253091 (0.0006) [2023-12-27 21:02:44,347][106225] Updated weights for policy 1, policy_version 253101 (0.0009) [2023-12-27 21:02:44,412][106225] Updated weights for policy 1, policy_version 253111 (0.0008) [2023-12-27 21:02:44,690][106226] Updated weights for policy 0, policy_version 252794 (0.0006) [2023-12-27 21:02:44,739][106226] Updated weights for policy 0, policy_version 252804 (0.0006) [2023-12-27 21:02:44,802][106226] Updated weights for policy 0, policy_version 252814 (0.0007) [2023-12-27 21:02:44,872][106226] Updated weights for policy 0, policy_version 252824 (0.0009) [2023-12-27 21:02:45,172][106225] Updated weights for policy 1, policy_version 253121 (0.0008) [2023-12-27 21:02:45,240][106225] Updated weights for policy 1, policy_version 253131 (0.0008) [2023-12-27 21:02:45,303][106225] Updated weights for policy 1, policy_version 253141 (0.0009) [2023-12-27 21:02:45,362][106225] Updated weights for policy 1, policy_version 253151 (0.0008) [2023-12-27 21:02:45,593][106226] Updated weights for policy 0, policy_version 252834 (0.0005) [2023-12-27 21:02:45,648][106226] Updated weights for policy 0, policy_version 252844 (0.0007) [2023-12-27 21:02:45,694][106226] Updated weights for policy 0, policy_version 252854 (0.0008) [2023-12-27 21:02:46,056][106225] Updated weights for policy 1, policy_version 253161 (0.0008) [2023-12-27 21:02:46,114][106225] Updated weights for policy 1, policy_version 253171 (0.0007) [2023-12-27 21:02:46,167][106225] Updated weights for policy 1, policy_version 253181 (0.0009) [2023-12-27 21:02:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 129572864. Throughput: 0: 9974.6, 1: 9795.5. Samples: 129567524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:02:46,176][105115] Avg episode reward: [(0, '-4.771'), (1, '-6.210')] [2023-12-27 21:02:46,340][106226] Updated weights for policy 0, policy_version 252864 (0.0007) [2023-12-27 21:02:46,387][106226] Updated weights for policy 0, policy_version 252874 (0.0007) [2023-12-27 21:02:46,430][106226] Updated weights for policy 0, policy_version 252884 (0.0005) [2023-12-27 21:02:46,990][106225] Updated weights for policy 1, policy_version 253191 (0.0008) [2023-12-27 21:02:46,998][106226] Updated weights for policy 0, policy_version 252894 (0.0006) [2023-12-27 21:02:47,051][106225] Updated weights for policy 1, policy_version 253201 (0.0008) [2023-12-27 21:02:47,061][106226] Updated weights for policy 0, policy_version 252904 (0.0005) [2023-12-27 21:02:47,111][106225] Updated weights for policy 1, policy_version 253211 (0.0008) [2023-12-27 21:02:47,121][106226] Updated weights for policy 0, policy_version 252914 (0.0007) [2023-12-27 21:02:47,802][106226] Updated weights for policy 0, policy_version 252924 (0.0011) [2023-12-27 21:02:47,844][106225] Updated weights for policy 1, policy_version 253221 (0.0008) [2023-12-27 21:02:47,853][106226] Updated weights for policy 0, policy_version 252934 (0.0011) [2023-12-27 21:02:47,902][106225] Updated weights for policy 1, policy_version 253231 (0.0006) [2023-12-27 21:02:47,903][106226] Updated weights for policy 0, policy_version 252944 (0.0010) [2023-12-27 21:02:47,962][106225] Updated weights for policy 1, policy_version 253241 (0.0006) [2023-12-27 21:02:48,571][106226] Updated weights for policy 0, policy_version 252954 (0.0008) [2023-12-27 21:02:48,632][106226] Updated weights for policy 0, policy_version 252964 (0.0011) [2023-12-27 21:02:48,696][106226] Updated weights for policy 0, policy_version 252974 (0.0011) [2023-12-27 21:02:48,726][106225] Updated weights for policy 1, policy_version 253251 (0.0008) [2023-12-27 21:02:48,756][106226] Updated weights for policy 0, policy_version 252984 (0.0007) [2023-12-27 21:02:48,782][106225] Updated weights for policy 1, policy_version 253261 (0.0008) [2023-12-27 21:02:48,842][106225] Updated weights for policy 1, policy_version 253271 (0.0008) [2023-12-27 21:02:49,376][106226] Updated weights for policy 0, policy_version 252994 (0.0011) [2023-12-27 21:02:49,436][106226] Updated weights for policy 0, policy_version 253004 (0.0011) [2023-12-27 21:02:49,496][106226] Updated weights for policy 0, policy_version 253014 (0.0010) [2023-12-27 21:02:49,571][106225] Updated weights for policy 1, policy_version 253281 (0.0008) [2023-12-27 21:02:49,626][106225] Updated weights for policy 1, policy_version 253291 (0.0007) [2023-12-27 21:02:49,674][106225] Updated weights for policy 1, policy_version 253301 (0.0007) [2023-12-27 21:02:49,724][106225] Updated weights for policy 1, policy_version 253311 (0.0007) [2023-12-27 21:02:50,232][106226] Updated weights for policy 0, policy_version 253024 (0.0009) [2023-12-27 21:02:50,290][106226] Updated weights for policy 0, policy_version 253034 (0.0008) [2023-12-27 21:02:50,341][106226] Updated weights for policy 0, policy_version 253044 (0.0008) [2023-12-27 21:02:50,453][106225] Updated weights for policy 1, policy_version 253321 (0.0008) [2023-12-27 21:02:50,520][106225] Updated weights for policy 1, policy_version 253331 (0.0008) [2023-12-27 21:02:50,575][106225] Updated weights for policy 1, policy_version 253341 (0.0009) [2023-12-27 21:02:51,113][106226] Updated weights for policy 0, policy_version 253054 (0.0009) [2023-12-27 21:02:51,174][106226] Updated weights for policy 0, policy_version 253064 (0.0007) [2023-12-27 21:02:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 129671168. Throughput: 0: 9902.4, 1: 9764.1. Samples: 129685404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:02:51,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-6.331')] [2023-12-27 21:02:51,233][106226] Updated weights for policy 0, policy_version 253074 (0.0008) [2023-12-27 21:02:51,287][106225] Updated weights for policy 1, policy_version 253351 (0.0009) [2023-12-27 21:02:51,347][106225] Updated weights for policy 1, policy_version 253361 (0.0008) [2023-12-27 21:02:51,407][106225] Updated weights for policy 1, policy_version 253371 (0.0008) [2023-12-27 21:02:51,951][106226] Updated weights for policy 0, policy_version 253084 (0.0006) [2023-12-27 21:02:52,013][106226] Updated weights for policy 0, policy_version 253094 (0.0009) [2023-12-27 21:02:52,074][106226] Updated weights for policy 0, policy_version 253104 (0.0010) [2023-12-27 21:02:52,210][106225] Updated weights for policy 1, policy_version 253381 (0.0007) [2023-12-27 21:02:52,280][106225] Updated weights for policy 1, policy_version 253391 (0.0008) [2023-12-27 21:02:52,345][106225] Updated weights for policy 1, policy_version 253401 (0.0010) [2023-12-27 21:02:52,717][106226] Updated weights for policy 0, policy_version 253114 (0.0007) [2023-12-27 21:02:52,764][106226] Updated weights for policy 0, policy_version 253124 (0.0010) [2023-12-27 21:02:52,814][106226] Updated weights for policy 0, policy_version 253134 (0.0010) [2023-12-27 21:02:52,865][106226] Updated weights for policy 0, policy_version 253144 (0.0011) [2023-12-27 21:02:52,977][106225] Updated weights for policy 1, policy_version 253411 (0.0008) [2023-12-27 21:02:53,035][106225] Updated weights for policy 1, policy_version 253421 (0.0008) [2023-12-27 21:02:53,081][106225] Updated weights for policy 1, policy_version 253431 (0.0007) [2023-12-27 21:02:53,482][106226] Updated weights for policy 0, policy_version 253154 (0.0005) [2023-12-27 21:02:53,536][106226] Updated weights for policy 0, policy_version 253164 (0.0005) [2023-12-27 21:02:53,581][106226] Updated weights for policy 0, policy_version 253174 (0.0005) [2023-12-27 21:02:53,901][106225] Updated weights for policy 1, policy_version 253441 (0.0008) [2023-12-27 21:02:53,967][106225] Updated weights for policy 1, policy_version 253451 (0.0010) [2023-12-27 21:02:54,026][106225] Updated weights for policy 1, policy_version 253461 (0.0009) [2023-12-27 21:02:54,085][106225] Updated weights for policy 1, policy_version 253471 (0.0009) [2023-12-27 21:02:54,105][106226] Updated weights for policy 0, policy_version 253184 (0.0008) [2023-12-27 21:02:54,158][106226] Updated weights for policy 0, policy_version 253194 (0.0010) [2023-12-27 21:02:54,209][106226] Updated weights for policy 0, policy_version 253204 (0.0010) [2023-12-27 21:02:54,833][106225] Updated weights for policy 1, policy_version 253481 (0.0008) [2023-12-27 21:02:54,887][106225] Updated weights for policy 1, policy_version 253491 (0.0008) [2023-12-27 21:02:54,890][106226] Updated weights for policy 0, policy_version 253214 (0.0007) [2023-12-27 21:02:54,938][106226] Updated weights for policy 0, policy_version 253224 (0.0005) [2023-12-27 21:02:54,955][106225] Updated weights for policy 1, policy_version 253501 (0.0008) [2023-12-27 21:02:54,997][106226] Updated weights for policy 0, policy_version 253234 (0.0006) [2023-12-27 21:02:55,624][106226] Updated weights for policy 0, policy_version 253244 (0.0007) [2023-12-27 21:02:55,677][106226] Updated weights for policy 0, policy_version 253254 (0.0010) [2023-12-27 21:02:55,719][106225] Updated weights for policy 1, policy_version 253511 (0.0010) [2023-12-27 21:02:55,733][106226] Updated weights for policy 0, policy_version 253264 (0.0010) [2023-12-27 21:02:55,763][106225] Updated weights for policy 1, policy_version 253521 (0.0007) [2023-12-27 21:02:55,809][106225] Updated weights for policy 1, policy_version 253531 (0.0005) [2023-12-27 21:02:56,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 129777664. Throughput: 0: 9997.9, 1: 9723.6. Samples: 129746908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:02:56,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.993')] [2023-12-27 21:02:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000253536_64921600.pth... [2023-12-27 21:02:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000253272_64856064.pth... [2023-12-27 21:02:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000252384_64626688.pth [2023-12-27 21:02:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000252088_64552960.pth [2023-12-27 21:02:56,336][106226] Updated weights for policy 0, policy_version 253274 (0.0009) [2023-12-27 21:02:56,389][106226] Updated weights for policy 0, policy_version 253284 (0.0006) [2023-12-27 21:02:56,444][106226] Updated weights for policy 0, policy_version 253294 (0.0009) [2023-12-27 21:02:56,500][106226] Updated weights for policy 0, policy_version 253304 (0.0010) [2023-12-27 21:02:56,514][106225] Updated weights for policy 1, policy_version 253541 (0.0006) [2023-12-27 21:02:56,556][106225] Updated weights for policy 1, policy_version 253551 (0.0007) [2023-12-27 21:02:56,599][106225] Updated weights for policy 1, policy_version 253561 (0.0007) [2023-12-27 21:02:57,182][106226] Updated weights for policy 0, policy_version 253314 (0.0005) [2023-12-27 21:02:57,236][106226] Updated weights for policy 0, policy_version 253324 (0.0005) [2023-12-27 21:02:57,291][106226] Updated weights for policy 0, policy_version 253334 (0.0005) [2023-12-27 21:02:57,379][106225] Updated weights for policy 1, policy_version 253571 (0.0007) [2023-12-27 21:02:57,427][106225] Updated weights for policy 1, policy_version 253581 (0.0008) [2023-12-27 21:02:57,484][106225] Updated weights for policy 1, policy_version 253591 (0.0008) [2023-12-27 21:02:57,867][106226] Updated weights for policy 0, policy_version 253344 (0.0006) [2023-12-27 21:02:57,913][106226] Updated weights for policy 0, policy_version 253354 (0.0005) [2023-12-27 21:02:57,975][106226] Updated weights for policy 0, policy_version 253364 (0.0005) [2023-12-27 21:02:58,077][106225] Updated weights for policy 1, policy_version 253601 (0.0007) [2023-12-27 21:02:58,135][106225] Updated weights for policy 1, policy_version 253611 (0.0005) [2023-12-27 21:02:58,191][106225] Updated weights for policy 1, policy_version 253621 (0.0008) [2023-12-27 21:02:58,251][106225] Updated weights for policy 1, policy_version 253631 (0.0008) [2023-12-27 21:02:58,640][106226] Updated weights for policy 0, policy_version 253374 (0.0007) [2023-12-27 21:02:58,697][106226] Updated weights for policy 0, policy_version 253384 (0.0008) [2023-12-27 21:02:58,764][106226] Updated weights for policy 0, policy_version 253394 (0.0008) [2023-12-27 21:02:59,021][106225] Updated weights for policy 1, policy_version 253641 (0.0009) [2023-12-27 21:02:59,081][106225] Updated weights for policy 1, policy_version 253651 (0.0009) [2023-12-27 21:02:59,142][106225] Updated weights for policy 1, policy_version 253661 (0.0009) [2023-12-27 21:02:59,667][106226] Updated weights for policy 0, policy_version 253404 (0.0009) [2023-12-27 21:02:59,727][106226] Updated weights for policy 0, policy_version 253414 (0.0010) [2023-12-27 21:02:59,794][106226] Updated weights for policy 0, policy_version 253424 (0.0010) [2023-12-27 21:02:59,820][106225] Updated weights for policy 1, policy_version 253671 (0.0007) [2023-12-27 21:02:59,892][106225] Updated weights for policy 1, policy_version 253681 (0.0007) [2023-12-27 21:02:59,956][106225] Updated weights for policy 1, policy_version 253691 (0.0007) [2023-12-27 21:03:00,490][106226] Updated weights for policy 0, policy_version 253434 (0.0010) [2023-12-27 21:03:00,558][106226] Updated weights for policy 0, policy_version 253444 (0.0008) [2023-12-27 21:03:00,630][106226] Updated weights for policy 0, policy_version 253454 (0.0009) [2023-12-27 21:03:00,657][106225] Updated weights for policy 1, policy_version 253701 (0.0007) [2023-12-27 21:03:00,684][106226] Updated weights for policy 0, policy_version 253464 (0.0010) [2023-12-27 21:03:00,706][106225] Updated weights for policy 1, policy_version 253711 (0.0007) [2023-12-27 21:03:00,766][106225] Updated weights for policy 1, policy_version 253721 (0.0010) [2023-12-27 21:03:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 129875968. Throughput: 0: 10085.2, 1: 9687.7. Samples: 129866352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:01,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-6.136')] [2023-12-27 21:03:01,370][106225] Updated weights for policy 1, policy_version 253731 (0.0007) [2023-12-27 21:03:01,395][106226] Updated weights for policy 0, policy_version 253474 (0.0008) [2023-12-27 21:03:01,432][106225] Updated weights for policy 1, policy_version 253741 (0.0007) [2023-12-27 21:03:01,451][106226] Updated weights for policy 0, policy_version 253484 (0.0008) [2023-12-27 21:03:01,489][106225] Updated weights for policy 1, policy_version 253751 (0.0007) [2023-12-27 21:03:01,513][106226] Updated weights for policy 0, policy_version 253494 (0.0008) [2023-12-27 21:03:02,238][106225] Updated weights for policy 1, policy_version 253761 (0.0007) [2023-12-27 21:03:02,260][106226] Updated weights for policy 0, policy_version 253504 (0.0008) [2023-12-27 21:03:02,303][106225] Updated weights for policy 1, policy_version 253771 (0.0008) [2023-12-27 21:03:02,324][106226] Updated weights for policy 0, policy_version 253514 (0.0009) [2023-12-27 21:03:02,365][106225] Updated weights for policy 1, policy_version 253781 (0.0008) [2023-12-27 21:03:02,388][106226] Updated weights for policy 0, policy_version 253524 (0.0007) [2023-12-27 21:03:02,422][106225] Updated weights for policy 1, policy_version 253791 (0.0008) [2023-12-27 21:03:03,064][106226] Updated weights for policy 0, policy_version 253534 (0.0006) [2023-12-27 21:03:03,129][106226] Updated weights for policy 0, policy_version 253544 (0.0005) [2023-12-27 21:03:03,136][106225] Updated weights for policy 1, policy_version 253801 (0.0006) [2023-12-27 21:03:03,190][106226] Updated weights for policy 0, policy_version 253554 (0.0006) [2023-12-27 21:03:03,196][106225] Updated weights for policy 1, policy_version 253811 (0.0007) [2023-12-27 21:03:03,242][106225] Updated weights for policy 1, policy_version 253821 (0.0005) [2023-12-27 21:03:03,685][106226] Updated weights for policy 0, policy_version 253564 (0.0006) [2023-12-27 21:03:03,736][106225] Updated weights for policy 1, policy_version 253831 (0.0005) [2023-12-27 21:03:03,737][106226] Updated weights for policy 0, policy_version 253574 (0.0005) [2023-12-27 21:03:03,790][106225] Updated weights for policy 1, policy_version 253841 (0.0005) [2023-12-27 21:03:03,807][106226] Updated weights for policy 0, policy_version 253584 (0.0005) [2023-12-27 21:03:03,854][106225] Updated weights for policy 1, policy_version 253851 (0.0007) [2023-12-27 21:03:04,460][106226] Updated weights for policy 0, policy_version 253594 (0.0007) [2023-12-27 21:03:04,523][106225] Updated weights for policy 1, policy_version 253861 (0.0008) [2023-12-27 21:03:04,526][106226] Updated weights for policy 0, policy_version 253604 (0.0008) [2023-12-27 21:03:04,579][106225] Updated weights for policy 1, policy_version 253871 (0.0006) [2023-12-27 21:03:04,597][106226] Updated weights for policy 0, policy_version 253614 (0.0008) [2023-12-27 21:03:04,638][106225] Updated weights for policy 1, policy_version 253881 (0.0008) [2023-12-27 21:03:04,662][106226] Updated weights for policy 0, policy_version 253624 (0.0008) [2023-12-27 21:03:05,362][106225] Updated weights for policy 1, policy_version 253891 (0.0009) [2023-12-27 21:03:05,368][106226] Updated weights for policy 0, policy_version 253634 (0.0007) [2023-12-27 21:03:05,412][106225] Updated weights for policy 1, policy_version 253901 (0.0010) [2023-12-27 21:03:05,419][106226] Updated weights for policy 0, policy_version 253644 (0.0005) [2023-12-27 21:03:05,469][106225] Updated weights for policy 1, policy_version 253911 (0.0010) [2023-12-27 21:03:05,480][106226] Updated weights for policy 0, policy_version 253654 (0.0006) [2023-12-27 21:03:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 129974272. Throughput: 0: 10130.0, 1: 9755.6. Samples: 129987916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:06,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.897')] [2023-12-27 21:03:06,203][106225] Updated weights for policy 1, policy_version 253921 (0.0010) [2023-12-27 21:03:06,224][106226] Updated weights for policy 0, policy_version 253664 (0.0008) [2023-12-27 21:03:06,266][106225] Updated weights for policy 1, policy_version 253931 (0.0007) [2023-12-27 21:03:06,284][106226] Updated weights for policy 0, policy_version 253674 (0.0007) [2023-12-27 21:03:06,325][106225] Updated weights for policy 1, policy_version 253941 (0.0007) [2023-12-27 21:03:06,344][106226] Updated weights for policy 0, policy_version 253684 (0.0007) [2023-12-27 21:03:06,389][106225] Updated weights for policy 1, policy_version 253951 (0.0008) [2023-12-27 21:03:07,052][106225] Updated weights for policy 1, policy_version 253961 (0.0009) [2023-12-27 21:03:07,089][106226] Updated weights for policy 0, policy_version 253694 (0.0008) [2023-12-27 21:03:07,117][106225] Updated weights for policy 1, policy_version 253971 (0.0010) [2023-12-27 21:03:07,147][106226] Updated weights for policy 0, policy_version 253704 (0.0006) [2023-12-27 21:03:07,178][106225] Updated weights for policy 1, policy_version 253981 (0.0010) [2023-12-27 21:03:07,199][106226] Updated weights for policy 0, policy_version 253714 (0.0008) [2023-12-27 21:03:07,791][106226] Updated weights for policy 0, policy_version 253724 (0.0009) [2023-12-27 21:03:07,840][106226] Updated weights for policy 0, policy_version 253734 (0.0008) [2023-12-27 21:03:07,894][106226] Updated weights for policy 0, policy_version 253744 (0.0007) [2023-12-27 21:03:07,911][106225] Updated weights for policy 1, policy_version 253991 (0.0008) [2023-12-27 21:03:07,960][106225] Updated weights for policy 1, policy_version 254001 (0.0006) [2023-12-27 21:03:08,005][106225] Updated weights for policy 1, policy_version 254011 (0.0009) [2023-12-27 21:03:08,656][106226] Updated weights for policy 0, policy_version 253754 (0.0006) [2023-12-27 21:03:08,718][106226] Updated weights for policy 0, policy_version 253764 (0.0006) [2023-12-27 21:03:08,759][106225] Updated weights for policy 1, policy_version 254021 (0.0007) [2023-12-27 21:03:08,772][106226] Updated weights for policy 0, policy_version 253774 (0.0008) [2023-12-27 21:03:08,817][106225] Updated weights for policy 1, policy_version 254031 (0.0007) [2023-12-27 21:03:08,827][106226] Updated weights for policy 0, policy_version 253784 (0.0006) [2023-12-27 21:03:08,877][106225] Updated weights for policy 1, policy_version 254041 (0.0007) [2023-12-27 21:03:09,468][106226] Updated weights for policy 0, policy_version 253794 (0.0009) [2023-12-27 21:03:09,531][106226] Updated weights for policy 0, policy_version 253804 (0.0007) [2023-12-27 21:03:09,599][106226] Updated weights for policy 0, policy_version 253814 (0.0007) [2023-12-27 21:03:09,665][106225] Updated weights for policy 1, policy_version 254051 (0.0009) [2023-12-27 21:03:09,730][106225] Updated weights for policy 1, policy_version 254061 (0.0008) [2023-12-27 21:03:09,798][106225] Updated weights for policy 1, policy_version 254071 (0.0008) [2023-12-27 21:03:10,310][106226] Updated weights for policy 0, policy_version 253824 (0.0009) [2023-12-27 21:03:10,371][106226] Updated weights for policy 0, policy_version 253834 (0.0009) [2023-12-27 21:03:10,428][106226] Updated weights for policy 0, policy_version 253844 (0.0009) [2023-12-27 21:03:10,525][106225] Updated weights for policy 1, policy_version 254081 (0.0008) [2023-12-27 21:03:10,584][106225] Updated weights for policy 1, policy_version 254091 (0.0009) [2023-12-27 21:03:10,645][106225] Updated weights for policy 1, policy_version 254101 (0.0008) [2023-12-27 21:03:10,705][106225] Updated weights for policy 1, policy_version 254111 (0.0009) [2023-12-27 21:03:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 130072576. Throughput: 0: 10166.1, 1: 9802.5. Samples: 130047028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:11,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-6.244')] [2023-12-27 21:03:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000254112_65069056.pth... [2023-12-27 21:03:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000252992_64782336.pth [2023-12-27 21:03:11,191][106226] Updated weights for policy 0, policy_version 253854 (0.0010) [2023-12-27 21:03:11,251][106226] Updated weights for policy 0, policy_version 253864 (0.0009) [2023-12-27 21:03:11,318][106226] Updated weights for policy 0, policy_version 253874 (0.0008) [2023-12-27 21:03:11,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000253880_65011712.pth... [2023-12-27 21:03:11,363][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000252664_64700416.pth [2023-12-27 21:03:11,528][106225] Updated weights for policy 1, policy_version 254121 (0.0008) [2023-12-27 21:03:11,596][106225] Updated weights for policy 1, policy_version 254131 (0.0009) [2023-12-27 21:03:11,665][106225] Updated weights for policy 1, policy_version 254141 (0.0008) [2023-12-27 21:03:12,074][106226] Updated weights for policy 0, policy_version 253884 (0.0009) [2023-12-27 21:03:12,136][106226] Updated weights for policy 0, policy_version 253894 (0.0009) [2023-12-27 21:03:12,181][106226] Updated weights for policy 0, policy_version 253904 (0.0008) [2023-12-27 21:03:12,465][106225] Updated weights for policy 1, policy_version 254151 (0.0008) [2023-12-27 21:03:12,528][106225] Updated weights for policy 1, policy_version 254161 (0.0008) [2023-12-27 21:03:12,581][106225] Updated weights for policy 1, policy_version 254171 (0.0009) [2023-12-27 21:03:12,971][106226] Updated weights for policy 0, policy_version 253914 (0.0008) [2023-12-27 21:03:13,029][106226] Updated weights for policy 0, policy_version 253924 (0.0009) [2023-12-27 21:03:13,076][106226] Updated weights for policy 0, policy_version 253934 (0.0008) [2023-12-27 21:03:13,124][106226] Updated weights for policy 0, policy_version 253944 (0.0009) [2023-12-27 21:03:13,311][106225] Updated weights for policy 1, policy_version 254181 (0.0008) [2023-12-27 21:03:13,360][106225] Updated weights for policy 1, policy_version 254191 (0.0008) [2023-12-27 21:03:13,413][106225] Updated weights for policy 1, policy_version 254201 (0.0009) [2023-12-27 21:03:13,889][106226] Updated weights for policy 0, policy_version 253954 (0.0008) [2023-12-27 21:03:13,936][106226] Updated weights for policy 0, policy_version 253964 (0.0007) [2023-12-27 21:03:13,979][106226] Updated weights for policy 0, policy_version 253974 (0.0008) [2023-12-27 21:03:14,095][106225] Updated weights for policy 1, policy_version 254211 (0.0008) [2023-12-27 21:03:14,140][106225] Updated weights for policy 1, policy_version 254221 (0.0008) [2023-12-27 21:03:14,196][106225] Updated weights for policy 1, policy_version 254231 (0.0009) [2023-12-27 21:03:14,660][106226] Updated weights for policy 0, policy_version 253984 (0.0008) [2023-12-27 21:03:14,717][106226] Updated weights for policy 0, policy_version 253994 (0.0008) [2023-12-27 21:03:14,772][106226] Updated weights for policy 0, policy_version 254004 (0.0009) [2023-12-27 21:03:14,974][106225] Updated weights for policy 1, policy_version 254241 (0.0008) [2023-12-27 21:03:15,036][106225] Updated weights for policy 1, policy_version 254251 (0.0008) [2023-12-27 21:03:15,102][106225] Updated weights for policy 1, policy_version 254261 (0.0010) [2023-12-27 21:03:15,165][106225] Updated weights for policy 1, policy_version 254271 (0.0010) [2023-12-27 21:03:15,494][106226] Updated weights for policy 0, policy_version 254014 (0.0007) [2023-12-27 21:03:15,542][106226] Updated weights for policy 0, policy_version 254024 (0.0008) [2023-12-27 21:03:15,588][106226] Updated weights for policy 0, policy_version 254034 (0.0007) [2023-12-27 21:03:15,885][106225] Updated weights for policy 1, policy_version 254281 (0.0007) [2023-12-27 21:03:15,946][106225] Updated weights for policy 1, policy_version 254291 (0.0007) [2023-12-27 21:03:16,001][106225] Updated weights for policy 1, policy_version 254301 (0.0006) [2023-12-27 21:03:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 130170880. Throughput: 0: 10023.0, 1: 9736.8. Samples: 130159244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:16,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-6.519')] [2023-12-27 21:03:16,214][106226] Updated weights for policy 0, policy_version 254044 (0.0007) [2023-12-27 21:03:16,272][106226] Updated weights for policy 0, policy_version 254054 (0.0006) [2023-12-27 21:03:16,338][106226] Updated weights for policy 0, policy_version 254064 (0.0006) [2023-12-27 21:03:16,554][106225] Updated weights for policy 1, policy_version 254311 (0.0009) [2023-12-27 21:03:16,605][106225] Updated weights for policy 1, policy_version 254321 (0.0010) [2023-12-27 21:03:16,652][106225] Updated weights for policy 1, policy_version 254331 (0.0010) [2023-12-27 21:03:16,948][106226] Updated weights for policy 0, policy_version 254074 (0.0010) [2023-12-27 21:03:17,007][106226] Updated weights for policy 0, policy_version 254084 (0.0010) [2023-12-27 21:03:17,064][106226] Updated weights for policy 0, policy_version 254094 (0.0010) [2023-12-27 21:03:17,114][106226] Updated weights for policy 0, policy_version 254104 (0.0010) [2023-12-27 21:03:17,309][106225] Updated weights for policy 1, policy_version 254341 (0.0008) [2023-12-27 21:03:17,371][106225] Updated weights for policy 1, policy_version 254351 (0.0005) [2023-12-27 21:03:17,458][106225] Updated weights for policy 1, policy_version 254361 (0.0006) [2023-12-27 21:03:17,825][106226] Updated weights for policy 0, policy_version 254114 (0.0010) [2023-12-27 21:03:17,872][106226] Updated weights for policy 0, policy_version 254124 (0.0006) [2023-12-27 21:03:17,929][106226] Updated weights for policy 0, policy_version 254134 (0.0005) [2023-12-27 21:03:18,016][106225] Updated weights for policy 1, policy_version 254371 (0.0009) [2023-12-27 21:03:18,077][106225] Updated weights for policy 1, policy_version 254381 (0.0007) [2023-12-27 21:03:18,129][106225] Updated weights for policy 1, policy_version 254392 (0.0009) [2023-12-27 21:03:18,520][106226] Updated weights for policy 0, policy_version 254144 (0.0006) [2023-12-27 21:03:18,586][106226] Updated weights for policy 0, policy_version 254154 (0.0006) [2023-12-27 21:03:18,653][106226] Updated weights for policy 0, policy_version 254164 (0.0007) [2023-12-27 21:03:18,868][106225] Updated weights for policy 1, policy_version 254402 (0.0008) [2023-12-27 21:03:18,926][106225] Updated weights for policy 1, policy_version 254412 (0.0006) [2023-12-27 21:03:18,979][106225] Updated weights for policy 1, policy_version 254422 (0.0010) [2023-12-27 21:03:19,043][106225] Updated weights for policy 1, policy_version 254432 (0.0009) [2023-12-27 21:03:19,302][106226] Updated weights for policy 0, policy_version 254174 (0.0006) [2023-12-27 21:03:19,365][106226] Updated weights for policy 0, policy_version 254184 (0.0008) [2023-12-27 21:03:19,437][106226] Updated weights for policy 0, policy_version 254194 (0.0008) [2023-12-27 21:03:19,758][106225] Updated weights for policy 1, policy_version 254442 (0.0010) [2023-12-27 21:03:19,827][106225] Updated weights for policy 1, policy_version 254452 (0.0006) [2023-12-27 21:03:19,891][106225] Updated weights for policy 1, policy_version 254462 (0.0010) [2023-12-27 21:03:20,134][106226] Updated weights for policy 0, policy_version 254204 (0.0008) [2023-12-27 21:03:20,203][106226] Updated weights for policy 0, policy_version 254214 (0.0008) [2023-12-27 21:03:20,276][106226] Updated weights for policy 0, policy_version 254224 (0.0008) [2023-12-27 21:03:20,572][106225] Updated weights for policy 1, policy_version 254472 (0.0008) [2023-12-27 21:03:20,634][106225] Updated weights for policy 1, policy_version 254482 (0.0008) [2023-12-27 21:03:20,696][106225] Updated weights for policy 1, policy_version 254492 (0.0007) [2023-12-27 21:03:20,976][106226] Updated weights for policy 0, policy_version 254234 (0.0008) [2023-12-27 21:03:21,031][106226] Updated weights for policy 0, policy_version 254244 (0.0008) [2023-12-27 21:03:21,098][106226] Updated weights for policy 0, policy_version 254254 (0.0007) [2023-12-27 21:03:21,168][106226] Updated weights for policy 0, policy_version 254264 (0.0008) [2023-12-27 21:03:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 130277376. Throughput: 0: 10048.2, 1: 9763.7. Samples: 130282440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:21,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-6.434')] [2023-12-27 21:03:21,451][106225] Updated weights for policy 1, policy_version 254502 (0.0009) [2023-12-27 21:03:21,510][106225] Updated weights for policy 1, policy_version 254512 (0.0010) [2023-12-27 21:03:21,567][106225] Updated weights for policy 1, policy_version 254522 (0.0010) [2023-12-27 21:03:21,970][106226] Updated weights for policy 0, policy_version 254274 (0.0007) [2023-12-27 21:03:22,039][106226] Updated weights for policy 0, policy_version 254284 (0.0008) [2023-12-27 21:03:22,110][106226] Updated weights for policy 0, policy_version 254294 (0.0008) [2023-12-27 21:03:22,261][106225] Updated weights for policy 1, policy_version 254532 (0.0009) [2023-12-27 21:03:22,343][106225] Updated weights for policy 1, policy_version 254542 (0.0008) [2023-12-27 21:03:22,410][106225] Updated weights for policy 1, policy_version 254552 (0.0008) [2023-12-27 21:03:22,806][106226] Updated weights for policy 0, policy_version 254304 (0.0008) [2023-12-27 21:03:22,872][106226] Updated weights for policy 0, policy_version 254314 (0.0009) [2023-12-27 21:03:22,938][106226] Updated weights for policy 0, policy_version 254324 (0.0009) [2023-12-27 21:03:23,063][106225] Updated weights for policy 1, policy_version 254562 (0.0008) [2023-12-27 21:03:23,111][106225] Updated weights for policy 1, policy_version 254572 (0.0009) [2023-12-27 21:03:23,170][106225] Updated weights for policy 1, policy_version 254582 (0.0008) [2023-12-27 21:03:23,231][106225] Updated weights for policy 1, policy_version 254592 (0.0009) [2023-12-27 21:03:23,623][106226] Updated weights for policy 0, policy_version 254334 (0.0009) [2023-12-27 21:03:23,687][106226] Updated weights for policy 0, policy_version 254344 (0.0009) [2023-12-27 21:03:23,733][106226] Updated weights for policy 0, policy_version 254354 (0.0009) [2023-12-27 21:03:23,968][106225] Updated weights for policy 1, policy_version 254602 (0.0008) [2023-12-27 21:03:24,020][106225] Updated weights for policy 1, policy_version 254612 (0.0006) [2023-12-27 21:03:24,075][106225] Updated weights for policy 1, policy_version 254622 (0.0005) [2023-12-27 21:03:24,417][106226] Updated weights for policy 0, policy_version 254364 (0.0008) [2023-12-27 21:03:24,476][106226] Updated weights for policy 0, policy_version 254374 (0.0009) [2023-12-27 21:03:24,538][106226] Updated weights for policy 0, policy_version 254384 (0.0008) [2023-12-27 21:03:24,759][106225] Updated weights for policy 1, policy_version 254632 (0.0008) [2023-12-27 21:03:24,810][106225] Updated weights for policy 1, policy_version 254642 (0.0010) [2023-12-27 21:03:24,859][106225] Updated weights for policy 1, policy_version 254652 (0.0010) [2023-12-27 21:03:25,247][106226] Updated weights for policy 0, policy_version 254394 (0.0009) [2023-12-27 21:03:25,307][106226] Updated weights for policy 0, policy_version 254404 (0.0008) [2023-12-27 21:03:25,367][106226] Updated weights for policy 0, policy_version 254414 (0.0008) [2023-12-27 21:03:25,426][106226] Updated weights for policy 0, policy_version 254424 (0.0007) [2023-12-27 21:03:25,589][106225] Updated weights for policy 1, policy_version 254662 (0.0007) [2023-12-27 21:03:25,654][106225] Updated weights for policy 1, policy_version 254672 (0.0005) [2023-12-27 21:03:25,711][106225] Updated weights for policy 1, policy_version 254682 (0.0006) [2023-12-27 21:03:26,171][106226] Updated weights for policy 0, policy_version 254434 (0.0006) [2023-12-27 21:03:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.5, 300 sec: 19799.6). Total num frames: 130367488. Throughput: 0: 10051.3, 1: 9745.9. Samples: 130340632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:26,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-6.217')] [2023-12-27 21:03:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000254688_65216512.pth... [2023-12-27 21:03:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000253536_64921600.pth [2023-12-27 21:03:26,219][106226] Updated weights for policy 0, policy_version 254444 (0.0005) [2023-12-27 21:03:26,269][106226] Updated weights for policy 0, policy_version 254454 (0.0006) [2023-12-27 21:03:26,279][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000254456_65159168.pth... [2023-12-27 21:03:26,283][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000253272_64856064.pth [2023-12-27 21:03:26,318][106225] Updated weights for policy 1, policy_version 254692 (0.0007) [2023-12-27 21:03:26,363][106225] Updated weights for policy 1, policy_version 254702 (0.0008) [2023-12-27 21:03:26,419][106225] Updated weights for policy 1, policy_version 254712 (0.0009) [2023-12-27 21:03:26,846][106226] Updated weights for policy 0, policy_version 254464 (0.0008) [2023-12-27 21:03:26,894][106226] Updated weights for policy 0, policy_version 254474 (0.0008) [2023-12-27 21:03:26,947][106226] Updated weights for policy 0, policy_version 254484 (0.0008) [2023-12-27 21:03:27,122][106225] Updated weights for policy 1, policy_version 254722 (0.0009) [2023-12-27 21:03:27,185][106225] Updated weights for policy 1, policy_version 254732 (0.0005) [2023-12-27 21:03:27,248][106225] Updated weights for policy 1, policy_version 254742 (0.0005) [2023-12-27 21:03:27,306][106225] Updated weights for policy 1, policy_version 254752 (0.0007) [2023-12-27 21:03:27,681][106226] Updated weights for policy 0, policy_version 254494 (0.0009) [2023-12-27 21:03:27,730][106226] Updated weights for policy 0, policy_version 254504 (0.0010) [2023-12-27 21:03:27,782][106226] Updated weights for policy 0, policy_version 254514 (0.0010) [2023-12-27 21:03:27,865][106225] Updated weights for policy 1, policy_version 254762 (0.0010) [2023-12-27 21:03:27,910][106225] Updated weights for policy 1, policy_version 254772 (0.0007) [2023-12-27 21:03:27,962][106225] Updated weights for policy 1, policy_version 254782 (0.0005) [2023-12-27 21:03:28,438][106226] Updated weights for policy 0, policy_version 254524 (0.0010) [2023-12-27 21:03:28,491][106226] Updated weights for policy 0, policy_version 254534 (0.0011) [2023-12-27 21:03:28,543][106226] Updated weights for policy 0, policy_version 254544 (0.0007) [2023-12-27 21:03:28,564][106225] Updated weights for policy 1, policy_version 254792 (0.0006) [2023-12-27 21:03:28,627][106225] Updated weights for policy 1, policy_version 254802 (0.0008) [2023-12-27 21:03:28,685][106225] Updated weights for policy 1, policy_version 254812 (0.0008) [2023-12-27 21:03:29,256][106226] Updated weights for policy 0, policy_version 254554 (0.0008) [2023-12-27 21:03:29,313][106226] Updated weights for policy 0, policy_version 254564 (0.0007) [2023-12-27 21:03:29,381][106226] Updated weights for policy 0, policy_version 254574 (0.0008) [2023-12-27 21:03:29,432][106225] Updated weights for policy 1, policy_version 254822 (0.0007) [2023-12-27 21:03:29,449][106226] Updated weights for policy 0, policy_version 254584 (0.0008) [2023-12-27 21:03:29,489][106225] Updated weights for policy 1, policy_version 254832 (0.0005) [2023-12-27 21:03:29,550][106225] Updated weights for policy 1, policy_version 254842 (0.0007) [2023-12-27 21:03:30,030][106226] Updated weights for policy 0, policy_version 254594 (0.0008) [2023-12-27 21:03:30,080][106226] Updated weights for policy 0, policy_version 254604 (0.0007) [2023-12-27 21:03:30,137][106226] Updated weights for policy 0, policy_version 254614 (0.0005) [2023-12-27 21:03:30,202][106225] Updated weights for policy 1, policy_version 254852 (0.0007) [2023-12-27 21:03:30,265][106225] Updated weights for policy 1, policy_version 254862 (0.0009) [2023-12-27 21:03:30,326][106225] Updated weights for policy 1, policy_version 254872 (0.0009) [2023-12-27 21:03:30,765][106226] Updated weights for policy 0, policy_version 254624 (0.0009) [2023-12-27 21:03:30,817][106226] Updated weights for policy 0, policy_version 254635 (0.0009) [2023-12-27 21:03:30,868][106226] Updated weights for policy 0, policy_version 254645 (0.0008) [2023-12-27 21:03:31,062][106225] Updated weights for policy 1, policy_version 254882 (0.0007) [2023-12-27 21:03:31,122][106225] Updated weights for policy 1, policy_version 254892 (0.0009) [2023-12-27 21:03:31,175][105115] Fps is (10 sec: 19659.7, 60 sec: 19933.7, 300 sec: 19771.8). Total num frames: 130473984. Throughput: 0: 10128.5, 1: 9809.5. Samples: 130464740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:31,176][105115] Avg episode reward: [(0, '-5.008'), (1, '-6.106')] [2023-12-27 21:03:31,189][106225] Updated weights for policy 1, policy_version 254902 (0.0008) [2023-12-27 21:03:31,247][106225] Updated weights for policy 1, policy_version 254912 (0.0009) [2023-12-27 21:03:31,579][106226] Updated weights for policy 0, policy_version 254655 (0.0006) [2023-12-27 21:03:31,648][106226] Updated weights for policy 0, policy_version 254665 (0.0007) [2023-12-27 21:03:31,706][106226] Updated weights for policy 0, policy_version 254675 (0.0008) [2023-12-27 21:03:32,011][106225] Updated weights for policy 1, policy_version 254922 (0.0009) [2023-12-27 21:03:32,077][106225] Updated weights for policy 1, policy_version 254932 (0.0008) [2023-12-27 21:03:32,134][106225] Updated weights for policy 1, policy_version 254942 (0.0007) [2023-12-27 21:03:32,438][106226] Updated weights for policy 0, policy_version 254685 (0.0009) [2023-12-27 21:03:32,502][106226] Updated weights for policy 0, policy_version 254695 (0.0009) [2023-12-27 21:03:32,574][106226] Updated weights for policy 0, policy_version 254705 (0.0008) [2023-12-27 21:03:32,815][106225] Updated weights for policy 1, policy_version 254952 (0.0009) [2023-12-27 21:03:32,875][106225] Updated weights for policy 1, policy_version 254962 (0.0008) [2023-12-27 21:03:32,930][106225] Updated weights for policy 1, policy_version 254972 (0.0008) [2023-12-27 21:03:33,340][106226] Updated weights for policy 0, policy_version 254715 (0.0009) [2023-12-27 21:03:33,403][106226] Updated weights for policy 0, policy_version 254725 (0.0008) [2023-12-27 21:03:33,455][106226] Updated weights for policy 0, policy_version 254735 (0.0008) [2023-12-27 21:03:33,543][106225] Updated weights for policy 1, policy_version 254982 (0.0008) [2023-12-27 21:03:33,601][106225] Updated weights for policy 1, policy_version 254992 (0.0009) [2023-12-27 21:03:33,651][106225] Updated weights for policy 1, policy_version 255002 (0.0008) [2023-12-27 21:03:34,056][106226] Updated weights for policy 0, policy_version 254745 (0.0007) [2023-12-27 21:03:34,118][106226] Updated weights for policy 0, policy_version 254755 (0.0005) [2023-12-27 21:03:34,188][106226] Updated weights for policy 0, policy_version 254765 (0.0007) [2023-12-27 21:03:34,250][106226] Updated weights for policy 0, policy_version 254775 (0.0007) [2023-12-27 21:03:34,358][106225] Updated weights for policy 1, policy_version 255012 (0.0008) [2023-12-27 21:03:34,412][106225] Updated weights for policy 1, policy_version 255022 (0.0010) [2023-12-27 21:03:34,474][106225] Updated weights for policy 1, policy_version 255032 (0.0010) [2023-12-27 21:03:34,923][106226] Updated weights for policy 0, policy_version 254785 (0.0009) [2023-12-27 21:03:34,984][106226] Updated weights for policy 0, policy_version 254795 (0.0008) [2023-12-27 21:03:35,038][106226] Updated weights for policy 0, policy_version 254805 (0.0008) [2023-12-27 21:03:35,161][106225] Updated weights for policy 1, policy_version 255042 (0.0009) [2023-12-27 21:03:35,212][106225] Updated weights for policy 1, policy_version 255052 (0.0005) [2023-12-27 21:03:35,262][106225] Updated weights for policy 1, policy_version 255062 (0.0005) [2023-12-27 21:03:35,318][106225] Updated weights for policy 1, policy_version 255072 (0.0005) [2023-12-27 21:03:35,663][106226] Updated weights for policy 0, policy_version 254815 (0.0007) [2023-12-27 21:03:35,715][106226] Updated weights for policy 0, policy_version 254825 (0.0005) [2023-12-27 21:03:35,767][106226] Updated weights for policy 0, policy_version 254835 (0.0006) [2023-12-27 21:03:35,933][106225] Updated weights for policy 1, policy_version 255082 (0.0010) [2023-12-27 21:03:35,989][106225] Updated weights for policy 1, policy_version 255092 (0.0010) [2023-12-27 21:03:36,052][106225] Updated weights for policy 1, policy_version 255102 (0.0010) [2023-12-27 21:03:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 130580480. Throughput: 0: 10124.6, 1: 9897.6. Samples: 130586404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:36,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-6.044')] [2023-12-27 21:03:36,490][106226] Updated weights for policy 0, policy_version 254845 (0.0007) [2023-12-27 21:03:36,550][106226] Updated weights for policy 0, policy_version 254855 (0.0009) [2023-12-27 21:03:36,623][106226] Updated weights for policy 0, policy_version 254865 (0.0008) [2023-12-27 21:03:36,728][106225] Updated weights for policy 1, policy_version 255112 (0.0008) [2023-12-27 21:03:36,792][106225] Updated weights for policy 1, policy_version 255122 (0.0006) [2023-12-27 21:03:36,848][106225] Updated weights for policy 1, policy_version 255132 (0.0006) [2023-12-27 21:03:37,378][106226] Updated weights for policy 0, policy_version 254875 (0.0008) [2023-12-27 21:03:37,423][106226] Updated weights for policy 0, policy_version 254885 (0.0008) [2023-12-27 21:03:37,477][106226] Updated weights for policy 0, policy_version 254895 (0.0008) [2023-12-27 21:03:37,507][106225] Updated weights for policy 1, policy_version 255142 (0.0009) [2023-12-27 21:03:37,572][106225] Updated weights for policy 1, policy_version 255152 (0.0007) [2023-12-27 21:03:37,632][106225] Updated weights for policy 1, policy_version 255162 (0.0009) [2023-12-27 21:03:38,227][106226] Updated weights for policy 0, policy_version 254905 (0.0008) [2023-12-27 21:03:38,281][106226] Updated weights for policy 0, policy_version 254915 (0.0008) [2023-12-27 21:03:38,350][106226] Updated weights for policy 0, policy_version 254925 (0.0007) [2023-12-27 21:03:38,355][106225] Updated weights for policy 1, policy_version 255172 (0.0008) [2023-12-27 21:03:38,414][106226] Updated weights for policy 0, policy_version 254935 (0.0007) [2023-12-27 21:03:38,417][106225] Updated weights for policy 1, policy_version 255182 (0.0008) [2023-12-27 21:03:38,482][106225] Updated weights for policy 1, policy_version 255192 (0.0007) [2023-12-27 21:03:39,106][106225] Updated weights for policy 1, policy_version 255202 (0.0006) [2023-12-27 21:03:39,157][106225] Updated weights for policy 1, policy_version 255212 (0.0007) [2023-12-27 21:03:39,180][106226] Updated weights for policy 0, policy_version 254945 (0.0008) [2023-12-27 21:03:39,211][106225] Updated weights for policy 1, policy_version 255222 (0.0006) [2023-12-27 21:03:39,245][106226] Updated weights for policy 0, policy_version 254955 (0.0008) [2023-12-27 21:03:39,277][106225] Updated weights for policy 1, policy_version 255232 (0.0007) [2023-12-27 21:03:39,306][106226] Updated weights for policy 0, policy_version 254965 (0.0008) [2023-12-27 21:03:40,015][106226] Updated weights for policy 0, policy_version 254975 (0.0007) [2023-12-27 21:03:40,077][106226] Updated weights for policy 0, policy_version 254985 (0.0006) [2023-12-27 21:03:40,081][106225] Updated weights for policy 1, policy_version 255242 (0.0009) [2023-12-27 21:03:40,143][106226] Updated weights for policy 0, policy_version 254995 (0.0007) [2023-12-27 21:03:40,148][106225] Updated weights for policy 1, policy_version 255252 (0.0007) [2023-12-27 21:03:40,203][106225] Updated weights for policy 1, policy_version 255262 (0.0005) [2023-12-27 21:03:40,850][106225] Updated weights for policy 1, policy_version 255272 (0.0007) [2023-12-27 21:03:40,881][106226] Updated weights for policy 0, policy_version 255005 (0.0010) [2023-12-27 21:03:40,912][106225] Updated weights for policy 1, policy_version 255282 (0.0009) [2023-12-27 21:03:40,939][106226] Updated weights for policy 0, policy_version 255015 (0.0011) [2023-12-27 21:03:40,966][106225] Updated weights for policy 1, policy_version 255292 (0.0010) [2023-12-27 21:03:40,995][106226] Updated weights for policy 0, policy_version 255025 (0.0010) [2023-12-27 21:03:41,174][105115] Fps is (10 sec: 20481.0, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 130678784. Throughput: 0: 10003.7, 1: 9936.8. Samples: 130644232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:41,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-6.140')] [2023-12-27 21:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000255296_65372160.pth... [2023-12-27 21:03:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000255032_65306624.pth... [2023-12-27 21:03:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000254112_65069056.pth [2023-12-27 21:03:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000253880_65011712.pth [2023-12-27 21:03:41,187][106140] Saving new best policy, reward=-4.421! [2023-12-27 21:03:41,713][106225] Updated weights for policy 1, policy_version 255302 (0.0006) [2023-12-27 21:03:41,724][106226] Updated weights for policy 0, policy_version 255035 (0.0010) [2023-12-27 21:03:41,784][106225] Updated weights for policy 1, policy_version 255312 (0.0006) [2023-12-27 21:03:41,790][106226] Updated weights for policy 0, policy_version 255045 (0.0010) [2023-12-27 21:03:41,849][106225] Updated weights for policy 1, policy_version 255322 (0.0008) [2023-12-27 21:03:41,854][106226] Updated weights for policy 0, policy_version 255055 (0.0011) [2023-12-27 21:03:42,567][106225] Updated weights for policy 1, policy_version 255332 (0.0008) [2023-12-27 21:03:42,595][106226] Updated weights for policy 0, policy_version 255065 (0.0011) [2023-12-27 21:03:42,625][106225] Updated weights for policy 1, policy_version 255342 (0.0011) [2023-12-27 21:03:42,659][106226] Updated weights for policy 0, policy_version 255075 (0.0011) [2023-12-27 21:03:42,686][106225] Updated weights for policy 1, policy_version 255352 (0.0009) [2023-12-27 21:03:42,728][106226] Updated weights for policy 0, policy_version 255085 (0.0010) [2023-12-27 21:03:42,792][106226] Updated weights for policy 0, policy_version 255095 (0.0011) [2023-12-27 21:03:43,398][106225] Updated weights for policy 1, policy_version 255362 (0.0009) [2023-12-27 21:03:43,470][106225] Updated weights for policy 1, policy_version 255372 (0.0007) [2023-12-27 21:03:43,499][106226] Updated weights for policy 0, policy_version 255105 (0.0011) [2023-12-27 21:03:43,524][106225] Updated weights for policy 1, policy_version 255382 (0.0006) [2023-12-27 21:03:43,559][106226] Updated weights for policy 0, policy_version 255115 (0.0010) [2023-12-27 21:03:43,572][106225] Updated weights for policy 1, policy_version 255392 (0.0007) [2023-12-27 21:03:43,625][106226] Updated weights for policy 0, policy_version 255125 (0.0011) [2023-12-27 21:03:44,272][106225] Updated weights for policy 1, policy_version 255402 (0.0007) [2023-12-27 21:03:44,313][106226] Updated weights for policy 0, policy_version 255135 (0.0010) [2023-12-27 21:03:44,328][106225] Updated weights for policy 1, policy_version 255412 (0.0005) [2023-12-27 21:03:44,360][106226] Updated weights for policy 0, policy_version 255145 (0.0010) [2023-12-27 21:03:44,390][106225] Updated weights for policy 1, policy_version 255422 (0.0005) [2023-12-27 21:03:44,407][106226] Updated weights for policy 0, policy_version 255155 (0.0010) [2023-12-27 21:03:45,090][106226] Updated weights for policy 0, policy_version 255165 (0.0010) [2023-12-27 21:03:45,119][106225] Updated weights for policy 1, policy_version 255432 (0.0007) [2023-12-27 21:03:45,155][106226] Updated weights for policy 0, policy_version 255175 (0.0011) [2023-12-27 21:03:45,182][106225] Updated weights for policy 1, policy_version 255442 (0.0006) [2023-12-27 21:03:45,220][106226] Updated weights for policy 0, policy_version 255185 (0.0011) [2023-12-27 21:03:45,240][106225] Updated weights for policy 1, policy_version 255452 (0.0005) [2023-12-27 21:03:45,896][106225] Updated weights for policy 1, policy_version 255462 (0.0005) [2023-12-27 21:03:45,913][106226] Updated weights for policy 0, policy_version 255195 (0.0007) [2023-12-27 21:03:45,959][106225] Updated weights for policy 1, policy_version 255472 (0.0005) [2023-12-27 21:03:45,968][106226] Updated weights for policy 0, policy_version 255205 (0.0009) [2023-12-27 21:03:46,027][106225] Updated weights for policy 1, policy_version 255482 (0.0005) [2023-12-27 21:03:46,027][106226] Updated weights for policy 0, policy_version 255215 (0.0009) [2023-12-27 21:03:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 130777088. Throughput: 0: 9919.1, 1: 9950.8. Samples: 130760496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:03:46,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-6.171')] [2023-12-27 21:03:46,517][106225] Updated weights for policy 1, policy_version 255492 (0.0005) [2023-12-27 21:03:46,563][106225] Updated weights for policy 1, policy_version 255502 (0.0005) [2023-12-27 21:03:46,611][106225] Updated weights for policy 1, policy_version 255512 (0.0005) [2023-12-27 21:03:46,717][106226] Updated weights for policy 0, policy_version 255225 (0.0008) [2023-12-27 21:03:46,783][106226] Updated weights for policy 0, policy_version 255235 (0.0005) [2023-12-27 21:03:46,850][106226] Updated weights for policy 0, policy_version 255245 (0.0008) [2023-12-27 21:03:46,910][106226] Updated weights for policy 0, policy_version 255255 (0.0005) [2023-12-27 21:03:47,175][106225] Updated weights for policy 1, policy_version 255522 (0.0006) [2023-12-27 21:03:47,234][106225] Updated weights for policy 1, policy_version 255532 (0.0008) [2023-12-27 21:03:47,291][106225] Updated weights for policy 1, policy_version 255542 (0.0008) [2023-12-27 21:03:47,351][106225] Updated weights for policy 1, policy_version 255552 (0.0008) [2023-12-27 21:03:47,524][106226] Updated weights for policy 0, policy_version 255265 (0.0005) [2023-12-27 21:03:47,587][106226] Updated weights for policy 0, policy_version 255275 (0.0006) [2023-12-27 21:03:47,646][106226] Updated weights for policy 0, policy_version 255285 (0.0009) [2023-12-27 21:03:48,006][106225] Updated weights for policy 1, policy_version 255562 (0.0006) [2023-12-27 21:03:48,070][106225] Updated weights for policy 1, policy_version 255572 (0.0008) [2023-12-27 21:03:48,132][106225] Updated weights for policy 1, policy_version 255582 (0.0007) [2023-12-27 21:03:48,321][106226] Updated weights for policy 0, policy_version 255295 (0.0007) [2023-12-27 21:03:48,382][106226] Updated weights for policy 0, policy_version 255305 (0.0008) [2023-12-27 21:03:48,438][106226] Updated weights for policy 0, policy_version 255315 (0.0008) [2023-12-27 21:03:48,812][106225] Updated weights for policy 1, policy_version 255592 (0.0009) [2023-12-27 21:03:48,874][106225] Updated weights for policy 1, policy_version 255602 (0.0007) [2023-12-27 21:03:48,931][106225] Updated weights for policy 1, policy_version 255612 (0.0008) [2023-12-27 21:03:49,151][106226] Updated weights for policy 0, policy_version 255325 (0.0009) [2023-12-27 21:03:49,198][106226] Updated weights for policy 0, policy_version 255335 (0.0010) [2023-12-27 21:03:49,260][106226] Updated weights for policy 0, policy_version 255345 (0.0011) [2023-12-27 21:03:49,627][106225] Updated weights for policy 1, policy_version 255622 (0.0008) [2023-12-27 21:03:49,687][106225] Updated weights for policy 1, policy_version 255632 (0.0006) [2023-12-27 21:03:49,743][106225] Updated weights for policy 1, policy_version 255642 (0.0007) [2023-12-27 21:03:50,018][106226] Updated weights for policy 0, policy_version 255355 (0.0010) [2023-12-27 21:03:50,086][106226] Updated weights for policy 0, policy_version 255365 (0.0011) [2023-12-27 21:03:50,147][106226] Updated weights for policy 0, policy_version 255375 (0.0011) [2023-12-27 21:03:50,500][106225] Updated weights for policy 1, policy_version 255652 (0.0009) [2023-12-27 21:03:50,546][106225] Updated weights for policy 1, policy_version 255662 (0.0010) [2023-12-27 21:03:50,612][106225] Updated weights for policy 1, policy_version 255672 (0.0010) [2023-12-27 21:03:50,826][106226] Updated weights for policy 0, policy_version 255385 (0.0010) [2023-12-27 21:03:50,887][106226] Updated weights for policy 0, policy_version 255395 (0.0009) [2023-12-27 21:03:50,952][106226] Updated weights for policy 0, policy_version 255405 (0.0007) [2023-12-27 21:03:51,018][106226] Updated weights for policy 0, policy_version 255415 (0.0006) [2023-12-27 21:03:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 130875392. Throughput: 0: 9907.0, 1: 9977.5. Samples: 130882720. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:03:51,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-6.212')] [2023-12-27 21:03:51,387][106225] Updated weights for policy 1, policy_version 255682 (0.0010) [2023-12-27 21:03:51,455][106225] Updated weights for policy 1, policy_version 255692 (0.0008) [2023-12-27 21:03:51,521][106225] Updated weights for policy 1, policy_version 255702 (0.0007) [2023-12-27 21:03:51,578][106225] Updated weights for policy 1, policy_version 255712 (0.0009) [2023-12-27 21:03:51,746][106226] Updated weights for policy 0, policy_version 255425 (0.0008) [2023-12-27 21:03:51,808][106226] Updated weights for policy 0, policy_version 255435 (0.0009) [2023-12-27 21:03:51,867][106226] Updated weights for policy 0, policy_version 255445 (0.0008) [2023-12-27 21:03:52,295][106225] Updated weights for policy 1, policy_version 255722 (0.0008) [2023-12-27 21:03:52,346][106225] Updated weights for policy 1, policy_version 255732 (0.0009) [2023-12-27 21:03:52,409][106225] Updated weights for policy 1, policy_version 255742 (0.0009) [2023-12-27 21:03:52,593][106226] Updated weights for policy 0, policy_version 255455 (0.0006) [2023-12-27 21:03:52,654][106226] Updated weights for policy 0, policy_version 255465 (0.0006) [2023-12-27 21:03:52,716][106226] Updated weights for policy 0, policy_version 255475 (0.0006) [2023-12-27 21:03:53,047][106225] Updated weights for policy 1, policy_version 255752 (0.0006) [2023-12-27 21:03:53,098][106225] Updated weights for policy 1, policy_version 255762 (0.0010) [2023-12-27 21:03:53,148][106225] Updated weights for policy 1, policy_version 255772 (0.0010) [2023-12-27 21:03:53,305][106226] Updated weights for policy 0, policy_version 255485 (0.0009) [2023-12-27 21:03:53,363][106226] Updated weights for policy 0, policy_version 255495 (0.0011) [2023-12-27 21:03:53,430][106226] Updated weights for policy 0, policy_version 255505 (0.0010) [2023-12-27 21:03:53,844][106225] Updated weights for policy 1, policy_version 255782 (0.0010) [2023-12-27 21:03:53,898][106225] Updated weights for policy 1, policy_version 255792 (0.0009) [2023-12-27 21:03:53,952][106225] Updated weights for policy 1, policy_version 255802 (0.0008) [2023-12-27 21:03:54,079][106226] Updated weights for policy 0, policy_version 255515 (0.0010) [2023-12-27 21:03:54,139][106226] Updated weights for policy 0, policy_version 255525 (0.0008) [2023-12-27 21:03:54,195][106226] Updated weights for policy 0, policy_version 255535 (0.0007) [2023-12-27 21:03:54,624][106225] Updated weights for policy 1, policy_version 255812 (0.0005) [2023-12-27 21:03:54,673][106225] Updated weights for policy 1, policy_version 255822 (0.0005) [2023-12-27 21:03:54,722][106225] Updated weights for policy 1, policy_version 255832 (0.0007) [2023-12-27 21:03:54,851][106226] Updated weights for policy 0, policy_version 255545 (0.0008) [2023-12-27 21:03:54,904][106226] Updated weights for policy 0, policy_version 255555 (0.0005) [2023-12-27 21:03:54,956][106226] Updated weights for policy 0, policy_version 255565 (0.0005) [2023-12-27 21:03:55,024][106226] Updated weights for policy 0, policy_version 255575 (0.0006) [2023-12-27 21:03:55,388][106225] Updated weights for policy 1, policy_version 255842 (0.0010) [2023-12-27 21:03:55,444][106225] Updated weights for policy 1, policy_version 255852 (0.0010) [2023-12-27 21:03:55,503][106225] Updated weights for policy 1, policy_version 255862 (0.0010) [2023-12-27 21:03:55,562][106225] Updated weights for policy 1, policy_version 255872 (0.0010) [2023-12-27 21:03:55,700][106226] Updated weights for policy 0, policy_version 255585 (0.0005) [2023-12-27 21:03:55,763][106226] Updated weights for policy 0, policy_version 255595 (0.0005) [2023-12-27 21:03:55,816][106226] Updated weights for policy 0, policy_version 255605 (0.0005) [2023-12-27 21:03:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 130973696. Throughput: 0: 9924.1, 1: 10001.8. Samples: 130943692. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:03:56,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-6.213')] [2023-12-27 21:03:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000255608_65454080.pth... [2023-12-27 21:03:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000255872_65519616.pth... [2023-12-27 21:03:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000254456_65159168.pth [2023-12-27 21:03:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000254688_65216512.pth [2023-12-27 21:03:56,273][106225] Updated weights for policy 1, policy_version 255882 (0.0010) [2023-12-27 21:03:56,333][106225] Updated weights for policy 1, policy_version 255892 (0.0010) [2023-12-27 21:03:56,400][106225] Updated weights for policy 1, policy_version 255902 (0.0010) [2023-12-27 21:03:56,453][106226] Updated weights for policy 0, policy_version 255615 (0.0008) [2023-12-27 21:03:56,498][106226] Updated weights for policy 0, policy_version 255625 (0.0007) [2023-12-27 21:03:56,553][106226] Updated weights for policy 0, policy_version 255635 (0.0007) [2023-12-27 21:03:57,013][106225] Updated weights for policy 1, policy_version 255912 (0.0009) [2023-12-27 21:03:57,058][106225] Updated weights for policy 1, policy_version 255922 (0.0008) [2023-12-27 21:03:57,115][106225] Updated weights for policy 1, policy_version 255932 (0.0008) [2023-12-27 21:03:57,346][106226] Updated weights for policy 0, policy_version 255645 (0.0007) [2023-12-27 21:03:57,407][106226] Updated weights for policy 0, policy_version 255655 (0.0008) [2023-12-27 21:03:57,460][106226] Updated weights for policy 0, policy_version 255665 (0.0009) [2023-12-27 21:03:57,837][106225] Updated weights for policy 1, policy_version 255942 (0.0007) [2023-12-27 21:03:57,879][106225] Updated weights for policy 1, policy_version 255952 (0.0008) [2023-12-27 21:03:57,929][106225] Updated weights for policy 1, policy_version 255962 (0.0008) [2023-12-27 21:03:58,073][106226] Updated weights for policy 0, policy_version 255675 (0.0007) [2023-12-27 21:03:58,137][106226] Updated weights for policy 0, policy_version 255685 (0.0006) [2023-12-27 21:03:58,198][106226] Updated weights for policy 0, policy_version 255695 (0.0006) [2023-12-27 21:03:58,664][106225] Updated weights for policy 1, policy_version 255972 (0.0009) [2023-12-27 21:03:58,728][106225] Updated weights for policy 1, policy_version 255982 (0.0009) [2023-12-27 21:03:58,791][106225] Updated weights for policy 1, policy_version 255992 (0.0007) [2023-12-27 21:03:59,051][106226] Updated weights for policy 0, policy_version 255705 (0.0008) [2023-12-27 21:03:59,108][106226] Updated weights for policy 0, policy_version 255715 (0.0005) [2023-12-27 21:03:59,173][106226] Updated weights for policy 0, policy_version 255725 (0.0009) [2023-12-27 21:03:59,243][106226] Updated weights for policy 0, policy_version 255735 (0.0010) [2023-12-27 21:03:59,651][106225] Updated weights for policy 1, policy_version 256002 (0.0009) [2023-12-27 21:03:59,706][106225] Updated weights for policy 1, policy_version 256012 (0.0008) [2023-12-27 21:03:59,770][106225] Updated weights for policy 1, policy_version 256022 (0.0007) [2023-12-27 21:03:59,831][106225] Updated weights for policy 1, policy_version 256032 (0.0008) [2023-12-27 21:03:59,978][106226] Updated weights for policy 0, policy_version 255745 (0.0006) [2023-12-27 21:04:00,038][106226] Updated weights for policy 0, policy_version 255755 (0.0006) [2023-12-27 21:04:00,086][106226] Updated weights for policy 0, policy_version 255765 (0.0005) [2023-12-27 21:04:00,603][106225] Updated weights for policy 1, policy_version 256042 (0.0010) [2023-12-27 21:04:00,656][106225] Updated weights for policy 1, policy_version 256052 (0.0010) [2023-12-27 21:04:00,713][106226] Updated weights for policy 0, policy_version 255775 (0.0009) [2023-12-27 21:04:00,713][106225] Updated weights for policy 1, policy_version 256062 (0.0010) [2023-12-27 21:04:00,773][106226] Updated weights for policy 0, policy_version 255785 (0.0010) [2023-12-27 21:04:00,826][106226] Updated weights for policy 0, policy_version 255795 (0.0009) [2023-12-27 21:04:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 131072000. Throughput: 0: 9961.4, 1: 10084.8. Samples: 131061324. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:01,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-6.224')] [2023-12-27 21:04:01,385][106225] Updated weights for policy 1, policy_version 256072 (0.0009) [2023-12-27 21:04:01,448][106225] Updated weights for policy 1, policy_version 256082 (0.0008) [2023-12-27 21:04:01,456][106226] Updated weights for policy 0, policy_version 255805 (0.0006) [2023-12-27 21:04:01,501][106225] Updated weights for policy 1, policy_version 256092 (0.0009) [2023-12-27 21:04:01,515][106226] Updated weights for policy 0, policy_version 255815 (0.0009) [2023-12-27 21:04:01,574][106226] Updated weights for policy 0, policy_version 255825 (0.0010) [2023-12-27 21:04:02,218][106225] Updated weights for policy 1, policy_version 256102 (0.0011) [2023-12-27 21:04:02,227][106226] Updated weights for policy 0, policy_version 255835 (0.0009) [2023-12-27 21:04:02,283][106225] Updated weights for policy 1, policy_version 256112 (0.0007) [2023-12-27 21:04:02,290][106226] Updated weights for policy 0, policy_version 255845 (0.0007) [2023-12-27 21:04:02,353][106225] Updated weights for policy 1, policy_version 256122 (0.0006) [2023-12-27 21:04:02,353][106226] Updated weights for policy 0, policy_version 255855 (0.0008) [2023-12-27 21:04:02,977][106226] Updated weights for policy 0, policy_version 255865 (0.0010) [2023-12-27 21:04:03,012][106225] Updated weights for policy 1, policy_version 256132 (0.0006) [2023-12-27 21:04:03,043][106226] Updated weights for policy 0, policy_version 255875 (0.0005) [2023-12-27 21:04:03,076][106225] Updated weights for policy 1, policy_version 256142 (0.0007) [2023-12-27 21:04:03,100][106226] Updated weights for policy 0, policy_version 255885 (0.0010) [2023-12-27 21:04:03,128][106225] Updated weights for policy 1, policy_version 256152 (0.0006) [2023-12-27 21:04:03,161][106226] Updated weights for policy 0, policy_version 255895 (0.0010) [2023-12-27 21:04:03,742][106225] Updated weights for policy 1, policy_version 256162 (0.0007) [2023-12-27 21:04:03,760][106226] Updated weights for policy 0, policy_version 255905 (0.0006) [2023-12-27 21:04:03,793][106225] Updated weights for policy 1, policy_version 256172 (0.0005) [2023-12-27 21:04:03,822][106226] Updated weights for policy 0, policy_version 255915 (0.0005) [2023-12-27 21:04:03,845][106225] Updated weights for policy 1, policy_version 256182 (0.0009) [2023-12-27 21:04:03,886][106226] Updated weights for policy 0, policy_version 255925 (0.0008) [2023-12-27 21:04:03,904][106225] Updated weights for policy 1, policy_version 256192 (0.0009) [2023-12-27 21:04:04,515][106225] Updated weights for policy 1, policy_version 256202 (0.0010) [2023-12-27 21:04:04,577][106225] Updated weights for policy 1, policy_version 256212 (0.0008) [2023-12-27 21:04:04,624][106226] Updated weights for policy 0, policy_version 255935 (0.0007) [2023-12-27 21:04:04,632][106225] Updated weights for policy 1, policy_version 256222 (0.0007) [2023-12-27 21:04:04,691][106226] Updated weights for policy 0, policy_version 255945 (0.0006) [2023-12-27 21:04:04,757][106226] Updated weights for policy 0, policy_version 255955 (0.0008) [2023-12-27 21:04:05,349][106225] Updated weights for policy 1, policy_version 256232 (0.0009) [2023-12-27 21:04:05,396][106225] Updated weights for policy 1, policy_version 256242 (0.0010) [2023-12-27 21:04:05,445][106225] Updated weights for policy 1, policy_version 256252 (0.0010) [2023-12-27 21:04:05,464][106226] Updated weights for policy 0, policy_version 255965 (0.0009) [2023-12-27 21:04:05,512][106226] Updated weights for policy 0, policy_version 255975 (0.0009) [2023-12-27 21:04:05,568][106226] Updated weights for policy 0, policy_version 255985 (0.0008) [2023-12-27 21:04:06,167][106225] Updated weights for policy 1, policy_version 256262 (0.0010) [2023-12-27 21:04:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 131170304. Throughput: 0: 9961.8, 1: 10076.7. Samples: 131184176. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:06,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-6.053')] [2023-12-27 21:04:06,236][106225] Updated weights for policy 1, policy_version 256272 (0.0010) [2023-12-27 21:04:06,266][106226] Updated weights for policy 0, policy_version 255995 (0.0007) [2023-12-27 21:04:06,305][106225] Updated weights for policy 1, policy_version 256282 (0.0011) [2023-12-27 21:04:06,325][106226] Updated weights for policy 0, policy_version 256005 (0.0007) [2023-12-27 21:04:06,377][106226] Updated weights for policy 0, policy_version 256015 (0.0006) [2023-12-27 21:04:06,928][106226] Updated weights for policy 0, policy_version 256025 (0.0005) [2023-12-27 21:04:06,982][106226] Updated weights for policy 0, policy_version 256035 (0.0005) [2023-12-27 21:04:07,020][106225] Updated weights for policy 1, policy_version 256292 (0.0011) [2023-12-27 21:04:07,050][106226] Updated weights for policy 0, policy_version 256045 (0.0006) [2023-12-27 21:04:07,075][106225] Updated weights for policy 1, policy_version 256302 (0.0010) [2023-12-27 21:04:07,112][106226] Updated weights for policy 0, policy_version 256055 (0.0006) [2023-12-27 21:04:07,126][106225] Updated weights for policy 1, policy_version 256312 (0.0010) [2023-12-27 21:04:07,670][106226] Updated weights for policy 0, policy_version 256065 (0.0006) [2023-12-27 21:04:07,726][106226] Updated weights for policy 0, policy_version 256075 (0.0008) [2023-12-27 21:04:07,780][106226] Updated weights for policy 0, policy_version 256085 (0.0008) [2023-12-27 21:04:07,850][106225] Updated weights for policy 1, policy_version 256322 (0.0010) [2023-12-27 21:04:07,916][106225] Updated weights for policy 1, policy_version 256332 (0.0010) [2023-12-27 21:04:07,978][106225] Updated weights for policy 1, policy_version 256342 (0.0010) [2023-12-27 21:04:08,035][106225] Updated weights for policy 1, policy_version 256352 (0.0008) [2023-12-27 21:04:08,464][106226] Updated weights for policy 0, policy_version 256095 (0.0008) [2023-12-27 21:04:08,525][106226] Updated weights for policy 0, policy_version 256105 (0.0008) [2023-12-27 21:04:08,595][106226] Updated weights for policy 0, policy_version 256115 (0.0009) [2023-12-27 21:04:08,734][106225] Updated weights for policy 1, policy_version 256362 (0.0010) [2023-12-27 21:04:08,787][106225] Updated weights for policy 1, policy_version 256372 (0.0010) [2023-12-27 21:04:08,840][106225] Updated weights for policy 1, policy_version 256382 (0.0009) [2023-12-27 21:04:09,387][106226] Updated weights for policy 0, policy_version 256125 (0.0009) [2023-12-27 21:04:09,453][106226] Updated weights for policy 0, policy_version 256135 (0.0009) [2023-12-27 21:04:09,477][106225] Updated weights for policy 1, policy_version 256392 (0.0009) [2023-12-27 21:04:09,510][106226] Updated weights for policy 0, policy_version 256145 (0.0009) [2023-12-27 21:04:09,538][106225] Updated weights for policy 1, policy_version 256402 (0.0009) [2023-12-27 21:04:09,600][106225] Updated weights for policy 1, policy_version 256412 (0.0009) [2023-12-27 21:04:10,323][106226] Updated weights for policy 0, policy_version 256155 (0.0008) [2023-12-27 21:04:10,342][106225] Updated weights for policy 1, policy_version 256422 (0.0010) [2023-12-27 21:04:10,384][106226] Updated weights for policy 0, policy_version 256165 (0.0008) [2023-12-27 21:04:10,410][106225] Updated weights for policy 1, policy_version 256432 (0.0011) [2023-12-27 21:04:10,441][106226] Updated weights for policy 0, policy_version 256175 (0.0008) [2023-12-27 21:04:10,465][106225] Updated weights for policy 1, policy_version 256442 (0.0008) [2023-12-27 21:04:11,053][106225] Updated weights for policy 1, policy_version 256452 (0.0007) [2023-12-27 21:04:11,114][106225] Updated weights for policy 1, policy_version 256462 (0.0009) [2023-12-27 21:04:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 131268608. Throughput: 0: 10035.7, 1: 10078.0. Samples: 131245744. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:11,175][105115] Avg episode reward: [(0, '-4.830'), (1, '-5.817')] [2023-12-27 21:04:11,180][106225] Updated weights for policy 1, policy_version 256472 (0.0009) [2023-12-27 21:04:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000256184_65601536.pth... [2023-12-27 21:04:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000255032_65306624.pth [2023-12-27 21:04:11,233][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000256480_65675264.pth... [2023-12-27 21:04:11,238][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000255296_65372160.pth [2023-12-27 21:04:11,240][106226] Updated weights for policy 0, policy_version 256185 (0.0008) [2023-12-27 21:04:11,332][106226] Updated weights for policy 0, policy_version 256195 (0.0007) [2023-12-27 21:04:11,406][106226] Updated weights for policy 0, policy_version 256205 (0.0008) [2023-12-27 21:04:11,469][106226] Updated weights for policy 0, policy_version 256215 (0.0008) [2023-12-27 21:04:11,970][106225] Updated weights for policy 1, policy_version 256482 (0.0010) [2023-12-27 21:04:12,031][106225] Updated weights for policy 1, policy_version 256492 (0.0008) [2023-12-27 21:04:12,096][106225] Updated weights for policy 1, policy_version 256502 (0.0007) [2023-12-27 21:04:12,154][106225] Updated weights for policy 1, policy_version 256512 (0.0008) [2023-12-27 21:04:12,165][106226] Updated weights for policy 0, policy_version 256225 (0.0006) [2023-12-27 21:04:12,230][106226] Updated weights for policy 0, policy_version 256235 (0.0007) [2023-12-27 21:04:12,295][106226] Updated weights for policy 0, policy_version 256245 (0.0008) [2023-12-27 21:04:12,788][106225] Updated weights for policy 1, policy_version 256522 (0.0006) [2023-12-27 21:04:12,845][106225] Updated weights for policy 1, policy_version 256532 (0.0005) [2023-12-27 21:04:12,906][106225] Updated weights for policy 1, policy_version 256542 (0.0009) [2023-12-27 21:04:13,031][106226] Updated weights for policy 0, policy_version 256255 (0.0007) [2023-12-27 21:04:13,094][106226] Updated weights for policy 0, policy_version 256265 (0.0010) [2023-12-27 21:04:13,143][106226] Updated weights for policy 0, policy_version 256275 (0.0007) [2023-12-27 21:04:13,591][106225] Updated weights for policy 1, policy_version 256552 (0.0010) [2023-12-27 21:04:13,660][106225] Updated weights for policy 1, policy_version 256562 (0.0010) [2023-12-27 21:04:13,706][106226] Updated weights for policy 0, policy_version 256285 (0.0008) [2023-12-27 21:04:13,723][106225] Updated weights for policy 1, policy_version 256572 (0.0006) [2023-12-27 21:04:13,765][106226] Updated weights for policy 0, policy_version 256295 (0.0010) [2023-12-27 21:04:13,829][106226] Updated weights for policy 0, policy_version 256305 (0.0011) [2023-12-27 21:04:14,446][106225] Updated weights for policy 1, policy_version 256582 (0.0007) [2023-12-27 21:04:14,501][106226] Updated weights for policy 0, policy_version 256315 (0.0009) [2023-12-27 21:04:14,506][106225] Updated weights for policy 1, policy_version 256592 (0.0009) [2023-12-27 21:04:14,563][106226] Updated weights for policy 0, policy_version 256325 (0.0008) [2023-12-27 21:04:14,572][106225] Updated weights for policy 1, policy_version 256602 (0.0008) [2023-12-27 21:04:14,623][106226] Updated weights for policy 0, policy_version 256335 (0.0007) [2023-12-27 21:04:15,296][106226] Updated weights for policy 0, policy_version 256345 (0.0008) [2023-12-27 21:04:15,322][106225] Updated weights for policy 1, policy_version 256612 (0.0008) [2023-12-27 21:04:15,360][106226] Updated weights for policy 0, policy_version 256355 (0.0008) [2023-12-27 21:04:15,371][106225] Updated weights for policy 1, policy_version 256622 (0.0005) [2023-12-27 21:04:15,413][106226] Updated weights for policy 0, policy_version 256365 (0.0006) [2023-12-27 21:04:15,424][106225] Updated weights for policy 1, policy_version 256632 (0.0007) [2023-12-27 21:04:15,471][106226] Updated weights for policy 0, policy_version 256375 (0.0009) [2023-12-27 21:04:16,029][106225] Updated weights for policy 1, policy_version 256642 (0.0006) [2023-12-27 21:04:16,085][106225] Updated weights for policy 1, policy_version 256652 (0.0005) [2023-12-27 21:04:16,130][106225] Updated weights for policy 1, policy_version 256662 (0.0006) [2023-12-27 21:04:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 131366912. Throughput: 0: 9950.3, 1: 10004.0. Samples: 131362676. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:16,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.980')] [2023-12-27 21:04:16,179][106225] Updated weights for policy 1, policy_version 256672 (0.0009) [2023-12-27 21:04:16,270][106226] Updated weights for policy 0, policy_version 256385 (0.0009) [2023-12-27 21:04:16,322][106226] Updated weights for policy 0, policy_version 256395 (0.0009) [2023-12-27 21:04:16,377][106226] Updated weights for policy 0, policy_version 256405 (0.0009) [2023-12-27 21:04:16,854][106225] Updated weights for policy 1, policy_version 256682 (0.0010) [2023-12-27 21:04:16,912][106225] Updated weights for policy 1, policy_version 256692 (0.0007) [2023-12-27 21:04:16,963][106225] Updated weights for policy 1, policy_version 256702 (0.0005) [2023-12-27 21:04:17,071][106226] Updated weights for policy 0, policy_version 256415 (0.0009) [2023-12-27 21:04:17,125][106226] Updated weights for policy 0, policy_version 256425 (0.0008) [2023-12-27 21:04:17,179][106226] Updated weights for policy 0, policy_version 256435 (0.0008) [2023-12-27 21:04:17,601][106225] Updated weights for policy 1, policy_version 256712 (0.0009) [2023-12-27 21:04:17,657][106225] Updated weights for policy 1, policy_version 256722 (0.0010) [2023-12-27 21:04:17,713][106225] Updated weights for policy 1, policy_version 256732 (0.0007) [2023-12-27 21:04:17,900][106226] Updated weights for policy 0, policy_version 256445 (0.0008) [2023-12-27 21:04:17,950][106226] Updated weights for policy 0, policy_version 256455 (0.0008) [2023-12-27 21:04:18,009][106226] Updated weights for policy 0, policy_version 256465 (0.0008) [2023-12-27 21:04:18,352][106225] Updated weights for policy 1, policy_version 256742 (0.0008) [2023-12-27 21:04:18,411][106225] Updated weights for policy 1, policy_version 256752 (0.0007) [2023-12-27 21:04:18,466][106225] Updated weights for policy 1, policy_version 256762 (0.0007) [2023-12-27 21:04:18,795][106226] Updated weights for policy 0, policy_version 256475 (0.0009) [2023-12-27 21:04:18,861][106226] Updated weights for policy 0, policy_version 256485 (0.0008) [2023-12-27 21:04:18,923][106226] Updated weights for policy 0, policy_version 256495 (0.0008) [2023-12-27 21:04:19,167][106225] Updated weights for policy 1, policy_version 256772 (0.0008) [2023-12-27 21:04:19,230][106225] Updated weights for policy 1, policy_version 256782 (0.0010) [2023-12-27 21:04:19,294][106225] Updated weights for policy 1, policy_version 256792 (0.0010) [2023-12-27 21:04:19,620][106226] Updated weights for policy 0, policy_version 256505 (0.0007) [2023-12-27 21:04:19,667][106226] Updated weights for policy 0, policy_version 256515 (0.0008) [2023-12-27 21:04:19,724][106226] Updated weights for policy 0, policy_version 256525 (0.0007) [2023-12-27 21:04:19,786][106226] Updated weights for policy 0, policy_version 256535 (0.0008) [2023-12-27 21:04:20,065][106225] Updated weights for policy 1, policy_version 256802 (0.0010) [2023-12-27 21:04:20,135][106225] Updated weights for policy 1, policy_version 256812 (0.0008) [2023-12-27 21:04:20,205][106225] Updated weights for policy 1, policy_version 256822 (0.0006) [2023-12-27 21:04:20,271][106225] Updated weights for policy 1, policy_version 256832 (0.0008) [2023-12-27 21:04:20,588][106226] Updated weights for policy 0, policy_version 256545 (0.0009) [2023-12-27 21:04:20,650][106226] Updated weights for policy 0, policy_version 256555 (0.0010) [2023-12-27 21:04:20,711][106226] Updated weights for policy 0, policy_version 256565 (0.0010) [2023-12-27 21:04:20,947][106225] Updated weights for policy 1, policy_version 256842 (0.0008) [2023-12-27 21:04:21,009][106225] Updated weights for policy 1, policy_version 256852 (0.0008) [2023-12-27 21:04:21,082][106225] Updated weights for policy 1, policy_version 256862 (0.0009) [2023-12-27 21:04:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 131473408. Throughput: 0: 9833.1, 1: 10025.1. Samples: 131480028. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:21,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-6.237')] [2023-12-27 21:04:21,482][106226] Updated weights for policy 0, policy_version 256575 (0.0009) [2023-12-27 21:04:21,549][106226] Updated weights for policy 0, policy_version 256585 (0.0009) [2023-12-27 21:04:21,609][106226] Updated weights for policy 0, policy_version 256595 (0.0008) [2023-12-27 21:04:21,861][106225] Updated weights for policy 1, policy_version 256872 (0.0009) [2023-12-27 21:04:21,924][106225] Updated weights for policy 1, policy_version 256882 (0.0008) [2023-12-27 21:04:21,992][106225] Updated weights for policy 1, policy_version 256892 (0.0007) [2023-12-27 21:04:22,328][106226] Updated weights for policy 0, policy_version 256605 (0.0008) [2023-12-27 21:04:22,390][106226] Updated weights for policy 0, policy_version 256615 (0.0008) [2023-12-27 21:04:22,464][106226] Updated weights for policy 0, policy_version 256625 (0.0008) [2023-12-27 21:04:22,650][106225] Updated weights for policy 1, policy_version 256902 (0.0007) [2023-12-27 21:04:22,709][106225] Updated weights for policy 1, policy_version 256912 (0.0010) [2023-12-27 21:04:22,771][106225] Updated weights for policy 1, policy_version 256922 (0.0008) [2023-12-27 21:04:23,210][106226] Updated weights for policy 0, policy_version 256635 (0.0009) [2023-12-27 21:04:23,255][106226] Updated weights for policy 0, policy_version 256645 (0.0009) [2023-12-27 21:04:23,316][106226] Updated weights for policy 0, policy_version 256655 (0.0005) [2023-12-27 21:04:23,385][106225] Updated weights for policy 1, policy_version 256932 (0.0007) [2023-12-27 21:04:23,432][106225] Updated weights for policy 1, policy_version 256942 (0.0008) [2023-12-27 21:04:23,478][106225] Updated weights for policy 1, policy_version 256952 (0.0005) [2023-12-27 21:04:23,946][106226] Updated weights for policy 0, policy_version 256665 (0.0005) [2023-12-27 21:04:24,008][106226] Updated weights for policy 0, policy_version 256675 (0.0005) [2023-12-27 21:04:24,066][106226] Updated weights for policy 0, policy_version 256685 (0.0007) [2023-12-27 21:04:24,084][106225] Updated weights for policy 1, policy_version 256962 (0.0006) [2023-12-27 21:04:24,125][106226] Updated weights for policy 0, policy_version 256695 (0.0008) [2023-12-27 21:04:24,136][106225] Updated weights for policy 1, policy_version 256972 (0.0006) [2023-12-27 21:04:24,199][106225] Updated weights for policy 1, policy_version 256982 (0.0006) [2023-12-27 21:04:24,270][106225] Updated weights for policy 1, policy_version 256992 (0.0005) [2023-12-27 21:04:24,753][106226] Updated weights for policy 0, policy_version 256705 (0.0006) [2023-12-27 21:04:24,815][106226] Updated weights for policy 0, policy_version 256715 (0.0006) [2023-12-27 21:04:24,820][106225] Updated weights for policy 1, policy_version 257002 (0.0008) [2023-12-27 21:04:24,870][106225] Updated weights for policy 1, policy_version 257012 (0.0008) [2023-12-27 21:04:24,879][106226] Updated weights for policy 0, policy_version 256725 (0.0006) [2023-12-27 21:04:24,927][106225] Updated weights for policy 1, policy_version 257022 (0.0009) [2023-12-27 21:04:25,492][106226] Updated weights for policy 0, policy_version 256735 (0.0009) [2023-12-27 21:04:25,551][106226] Updated weights for policy 0, policy_version 256745 (0.0010) [2023-12-27 21:04:25,610][106226] Updated weights for policy 0, policy_version 256755 (0.0009) [2023-12-27 21:04:25,642][106225] Updated weights for policy 1, policy_version 257032 (0.0008) [2023-12-27 21:04:25,691][106225] Updated weights for policy 1, policy_version 257042 (0.0009) [2023-12-27 21:04:25,740][106225] Updated weights for policy 1, policy_version 257052 (0.0009) [2023-12-27 21:04:26,167][106226] Updated weights for policy 0, policy_version 256765 (0.0008) [2023-12-27 21:04:26,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 131571712. Throughput: 0: 9879.6, 1: 10021.8. Samples: 131539796. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:26,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-6.265')] [2023-12-27 21:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000257056_65822720.pth... [2023-12-27 21:04:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000255872_65519616.pth [2023-12-27 21:04:26,225][106226] Updated weights for policy 0, policy_version 256775 (0.0008) [2023-12-27 21:04:26,277][106226] Updated weights for policy 0, policy_version 256785 (0.0005) [2023-12-27 21:04:26,315][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000256792_65757184.pth... [2023-12-27 21:04:26,318][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000255608_65454080.pth [2023-12-27 21:04:26,508][106225] Updated weights for policy 1, policy_version 257062 (0.0006) [2023-12-27 21:04:26,560][106225] Updated weights for policy 1, policy_version 257072 (0.0005) [2023-12-27 21:04:26,607][106225] Updated weights for policy 1, policy_version 257082 (0.0006) [2023-12-27 21:04:26,799][106226] Updated weights for policy 0, policy_version 256795 (0.0005) [2023-12-27 21:04:26,846][106226] Updated weights for policy 0, policy_version 256805 (0.0005) [2023-12-27 21:04:26,892][106226] Updated weights for policy 0, policy_version 256815 (0.0005) [2023-12-27 21:04:27,200][106225] Updated weights for policy 1, policy_version 257092 (0.0005) [2023-12-27 21:04:27,262][106225] Updated weights for policy 1, policy_version 257102 (0.0005) [2023-12-27 21:04:27,321][106225] Updated weights for policy 1, policy_version 257112 (0.0007) [2023-12-27 21:04:27,455][106226] Updated weights for policy 0, policy_version 256825 (0.0006) [2023-12-27 21:04:27,511][106226] Updated weights for policy 0, policy_version 256835 (0.0010) [2023-12-27 21:04:27,558][106226] Updated weights for policy 0, policy_version 256845 (0.0010) [2023-12-27 21:04:27,609][106226] Updated weights for policy 0, policy_version 256855 (0.0010) [2023-12-27 21:04:27,955][106225] Updated weights for policy 1, policy_version 257122 (0.0009) [2023-12-27 21:04:28,012][106225] Updated weights for policy 1, policy_version 257132 (0.0007) [2023-12-27 21:04:28,058][106225] Updated weights for policy 1, policy_version 257142 (0.0010) [2023-12-27 21:04:28,108][106225] Updated weights for policy 1, policy_version 257152 (0.0010) [2023-12-27 21:04:28,377][106226] Updated weights for policy 0, policy_version 256865 (0.0009) [2023-12-27 21:04:28,447][106226] Updated weights for policy 0, policy_version 256875 (0.0006) [2023-12-27 21:04:28,507][106226] Updated weights for policy 0, policy_version 256885 (0.0011) [2023-12-27 21:04:28,776][106225] Updated weights for policy 1, policy_version 257162 (0.0011) [2023-12-27 21:04:28,837][106225] Updated weights for policy 1, policy_version 257172 (0.0006) [2023-12-27 21:04:28,895][106225] Updated weights for policy 1, policy_version 257182 (0.0005) [2023-12-27 21:04:29,155][106226] Updated weights for policy 0, policy_version 256895 (0.0010) [2023-12-27 21:04:29,220][106226] Updated weights for policy 0, policy_version 256905 (0.0010) [2023-12-27 21:04:29,288][106226] Updated weights for policy 0, policy_version 256915 (0.0009) [2023-12-27 21:04:29,605][106225] Updated weights for policy 1, policy_version 257192 (0.0007) [2023-12-27 21:04:29,668][106225] Updated weights for policy 1, policy_version 257202 (0.0008) [2023-12-27 21:04:29,742][106225] Updated weights for policy 1, policy_version 257213 (0.0007) [2023-12-27 21:04:29,959][106226] Updated weights for policy 0, policy_version 256925 (0.0009) [2023-12-27 21:04:30,023][106226] Updated weights for policy 0, policy_version 256935 (0.0007) [2023-12-27 21:04:30,080][106226] Updated weights for policy 0, policy_version 256945 (0.0005) [2023-12-27 21:04:30,424][106225] Updated weights for policy 1, policy_version 257223 (0.0009) [2023-12-27 21:04:30,478][106225] Updated weights for policy 1, policy_version 257233 (0.0010) [2023-12-27 21:04:30,535][106225] Updated weights for policy 1, policy_version 257243 (0.0010) [2023-12-27 21:04:30,740][106226] Updated weights for policy 0, policy_version 256955 (0.0006) [2023-12-27 21:04:30,789][106226] Updated weights for policy 0, policy_version 256965 (0.0008) [2023-12-27 21:04:30,838][106226] Updated weights for policy 0, policy_version 256975 (0.0007) [2023-12-27 21:04:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.6, 300 sec: 19827.4). Total num frames: 131678208. Throughput: 0: 10051.3, 1: 10121.2. Samples: 131668256. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:31,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-6.122')] [2023-12-27 21:04:31,283][106225] Updated weights for policy 1, policy_version 257253 (0.0008) [2023-12-27 21:04:31,340][106225] Updated weights for policy 1, policy_version 257263 (0.0008) [2023-12-27 21:04:31,405][106225] Updated weights for policy 1, policy_version 257273 (0.0009) [2023-12-27 21:04:31,613][106226] Updated weights for policy 0, policy_version 256985 (0.0008) [2023-12-27 21:04:31,679][106226] Updated weights for policy 0, policy_version 256995 (0.0009) [2023-12-27 21:04:31,743][106226] Updated weights for policy 0, policy_version 257005 (0.0007) [2023-12-27 21:04:31,799][106226] Updated weights for policy 0, policy_version 257015 (0.0007) [2023-12-27 21:04:32,184][106225] Updated weights for policy 1, policy_version 257283 (0.0008) [2023-12-27 21:04:32,232][106225] Updated weights for policy 1, policy_version 257293 (0.0007) [2023-12-27 21:04:32,293][106225] Updated weights for policy 1, policy_version 257303 (0.0008) [2023-12-27 21:04:32,449][106226] Updated weights for policy 0, policy_version 257025 (0.0010) [2023-12-27 21:04:32,508][106226] Updated weights for policy 0, policy_version 257035 (0.0010) [2023-12-27 21:04:32,564][106226] Updated weights for policy 0, policy_version 257045 (0.0008) [2023-12-27 21:04:32,966][106225] Updated weights for policy 1, policy_version 257313 (0.0007) [2023-12-27 21:04:33,033][106225] Updated weights for policy 1, policy_version 257323 (0.0010) [2023-12-27 21:04:33,086][106225] Updated weights for policy 1, policy_version 257333 (0.0008) [2023-12-27 21:04:33,148][106225] Updated weights for policy 1, policy_version 257343 (0.0010) [2023-12-27 21:04:33,349][106226] Updated weights for policy 0, policy_version 257055 (0.0007) [2023-12-27 21:04:33,399][106226] Updated weights for policy 0, policy_version 257065 (0.0007) [2023-12-27 21:04:33,453][106226] Updated weights for policy 0, policy_version 257075 (0.0008) [2023-12-27 21:04:33,762][106225] Updated weights for policy 1, policy_version 257353 (0.0008) [2023-12-27 21:04:33,806][106225] Updated weights for policy 1, policy_version 257363 (0.0008) [2023-12-27 21:04:33,854][106225] Updated weights for policy 1, policy_version 257373 (0.0008) [2023-12-27 21:04:34,186][106226] Updated weights for policy 0, policy_version 257085 (0.0007) [2023-12-27 21:04:34,253][106226] Updated weights for policy 0, policy_version 257095 (0.0006) [2023-12-27 21:04:34,325][106226] Updated weights for policy 0, policy_version 257105 (0.0006) [2023-12-27 21:04:34,648][106225] Updated weights for policy 1, policy_version 257383 (0.0009) [2023-12-27 21:04:34,710][106225] Updated weights for policy 1, policy_version 257393 (0.0008) [2023-12-27 21:04:34,773][106225] Updated weights for policy 1, policy_version 257403 (0.0009) [2023-12-27 21:04:35,012][106226] Updated weights for policy 0, policy_version 257115 (0.0009) [2023-12-27 21:04:35,067][106226] Updated weights for policy 0, policy_version 257125 (0.0009) [2023-12-27 21:04:35,121][106226] Updated weights for policy 0, policy_version 257135 (0.0010) [2023-12-27 21:04:35,443][106225] Updated weights for policy 1, policy_version 257413 (0.0008) [2023-12-27 21:04:35,502][106225] Updated weights for policy 1, policy_version 257423 (0.0008) [2023-12-27 21:04:35,558][106225] Updated weights for policy 1, policy_version 257433 (0.0009) [2023-12-27 21:04:35,876][106226] Updated weights for policy 0, policy_version 257145 (0.0009) [2023-12-27 21:04:35,936][106226] Updated weights for policy 0, policy_version 257155 (0.0009) [2023-12-27 21:04:35,998][106226] Updated weights for policy 0, policy_version 257165 (0.0006) [2023-12-27 21:04:36,063][106226] Updated weights for policy 0, policy_version 257175 (0.0008) [2023-12-27 21:04:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 131776512. Throughput: 0: 10010.5, 1: 10033.5. Samples: 131784700. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:36,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-6.354')] [2023-12-27 21:04:36,267][106225] Updated weights for policy 1, policy_version 257443 (0.0008) [2023-12-27 21:04:36,333][106225] Updated weights for policy 1, policy_version 257453 (0.0007) [2023-12-27 21:04:36,395][106225] Updated weights for policy 1, policy_version 257463 (0.0009) [2023-12-27 21:04:36,804][106226] Updated weights for policy 0, policy_version 257185 (0.0010) [2023-12-27 21:04:36,861][106226] Updated weights for policy 0, policy_version 257195 (0.0009) [2023-12-27 21:04:36,920][106226] Updated weights for policy 0, policy_version 257205 (0.0006) [2023-12-27 21:04:37,118][106225] Updated weights for policy 1, policy_version 257473 (0.0009) [2023-12-27 21:04:37,176][106225] Updated weights for policy 1, policy_version 257483 (0.0008) [2023-12-27 21:04:37,233][106225] Updated weights for policy 1, policy_version 257493 (0.0008) [2023-12-27 21:04:37,278][106225] Updated weights for policy 1, policy_version 257503 (0.0008) [2023-12-27 21:04:37,574][106226] Updated weights for policy 0, policy_version 257215 (0.0007) [2023-12-27 21:04:37,636][106226] Updated weights for policy 0, policy_version 257225 (0.0009) [2023-12-27 21:04:37,698][106226] Updated weights for policy 0, policy_version 257235 (0.0008) [2023-12-27 21:04:38,007][106225] Updated weights for policy 1, policy_version 257513 (0.0008) [2023-12-27 21:04:38,066][106225] Updated weights for policy 1, policy_version 257523 (0.0009) [2023-12-27 21:04:38,122][106225] Updated weights for policy 1, policy_version 257533 (0.0008) [2023-12-27 21:04:38,339][106226] Updated weights for policy 0, policy_version 257245 (0.0007) [2023-12-27 21:04:38,404][106226] Updated weights for policy 0, policy_version 257255 (0.0008) [2023-12-27 21:04:38,467][106226] Updated weights for policy 0, policy_version 257265 (0.0009) [2023-12-27 21:04:38,888][106225] Updated weights for policy 1, policy_version 257543 (0.0009) [2023-12-27 21:04:38,940][106225] Updated weights for policy 1, policy_version 257553 (0.0007) [2023-12-27 21:04:38,994][106225] Updated weights for policy 1, policy_version 257563 (0.0008) [2023-12-27 21:04:39,101][106226] Updated weights for policy 0, policy_version 257275 (0.0008) [2023-12-27 21:04:39,159][106226] Updated weights for policy 0, policy_version 257285 (0.0005) [2023-12-27 21:04:39,218][106226] Updated weights for policy 0, policy_version 257295 (0.0006) [2023-12-27 21:04:39,834][106225] Updated weights for policy 1, policy_version 257573 (0.0009) [2023-12-27 21:04:39,899][106225] Updated weights for policy 1, policy_version 257583 (0.0009) [2023-12-27 21:04:39,962][106225] Updated weights for policy 1, policy_version 257593 (0.0007) [2023-12-27 21:04:39,969][106226] Updated weights for policy 0, policy_version 257305 (0.0008) [2023-12-27 21:04:40,027][106226] Updated weights for policy 0, policy_version 257315 (0.0009) [2023-12-27 21:04:40,084][106226] Updated weights for policy 0, policy_version 257325 (0.0008) [2023-12-27 21:04:40,145][106226] Updated weights for policy 0, policy_version 257335 (0.0009) [2023-12-27 21:04:40,632][106225] Updated weights for policy 1, policy_version 257603 (0.0007) [2023-12-27 21:04:40,691][106225] Updated weights for policy 1, policy_version 257613 (0.0008) [2023-12-27 21:04:40,753][106225] Updated weights for policy 1, policy_version 257623 (0.0008) [2023-12-27 21:04:40,912][106226] Updated weights for policy 0, policy_version 257345 (0.0008) [2023-12-27 21:04:40,975][106226] Updated weights for policy 0, policy_version 257355 (0.0008) [2023-12-27 21:04:41,040][106226] Updated weights for policy 0, policy_version 257365 (0.0009) [2023-12-27 21:04:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 131874816. Throughput: 0: 10008.2, 1: 10007.1. Samples: 131844380. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:41,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-6.125')] [2023-12-27 21:04:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000257632_65970176.pth... [2023-12-27 21:04:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000257368_65904640.pth... [2023-12-27 21:04:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000256480_65675264.pth [2023-12-27 21:04:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000256184_65601536.pth [2023-12-27 21:04:41,530][106225] Updated weights for policy 1, policy_version 257633 (0.0009) [2023-12-27 21:04:41,590][106225] Updated weights for policy 1, policy_version 257643 (0.0009) [2023-12-27 21:04:41,660][106225] Updated weights for policy 1, policy_version 257653 (0.0008) [2023-12-27 21:04:41,714][106225] Updated weights for policy 1, policy_version 257663 (0.0007) [2023-12-27 21:04:41,845][106226] Updated weights for policy 0, policy_version 257375 (0.0008) [2023-12-27 21:04:41,907][106226] Updated weights for policy 0, policy_version 257385 (0.0009) [2023-12-27 21:04:41,964][106226] Updated weights for policy 0, policy_version 257395 (0.0008) [2023-12-27 21:04:42,393][106225] Updated weights for policy 1, policy_version 257673 (0.0008) [2023-12-27 21:04:42,448][106225] Updated weights for policy 1, policy_version 257683 (0.0009) [2023-12-27 21:04:42,512][106225] Updated weights for policy 1, policy_version 257693 (0.0008) [2023-12-27 21:04:42,737][106226] Updated weights for policy 0, policy_version 257405 (0.0007) [2023-12-27 21:04:42,788][106226] Updated weights for policy 0, policy_version 257415 (0.0005) [2023-12-27 21:04:42,836][106226] Updated weights for policy 0, policy_version 257425 (0.0005) [2023-12-27 21:04:43,190][106225] Updated weights for policy 1, policy_version 257703 (0.0007) [2023-12-27 21:04:43,234][106225] Updated weights for policy 1, policy_version 257713 (0.0007) [2023-12-27 21:04:43,292][106225] Updated weights for policy 1, policy_version 257723 (0.0005) [2023-12-27 21:04:43,399][106226] Updated weights for policy 0, policy_version 257435 (0.0007) [2023-12-27 21:04:43,468][106226] Updated weights for policy 0, policy_version 257445 (0.0009) [2023-12-27 21:04:43,529][106226] Updated weights for policy 0, policy_version 257455 (0.0008) [2023-12-27 21:04:43,994][106225] Updated weights for policy 1, policy_version 257733 (0.0006) [2023-12-27 21:04:44,042][106225] Updated weights for policy 1, policy_version 257743 (0.0005) [2023-12-27 21:04:44,091][106225] Updated weights for policy 1, policy_version 257753 (0.0006) [2023-12-27 21:04:44,124][106226] Updated weights for policy 0, policy_version 257465 (0.0008) [2023-12-27 21:04:44,182][106226] Updated weights for policy 0, policy_version 257475 (0.0008) [2023-12-27 21:04:44,229][106226] Updated weights for policy 0, policy_version 257485 (0.0009) [2023-12-27 21:04:44,277][106226] Updated weights for policy 0, policy_version 257495 (0.0008) [2023-12-27 21:04:44,725][106225] Updated weights for policy 1, policy_version 257763 (0.0005) [2023-12-27 21:04:44,806][106225] Updated weights for policy 1, policy_version 257776 (0.0007) [2023-12-27 21:04:44,862][106225] Updated weights for policy 1, policy_version 257786 (0.0006) [2023-12-27 21:04:45,091][106226] Updated weights for policy 0, policy_version 257505 (0.0009) [2023-12-27 21:04:45,156][106226] Updated weights for policy 0, policy_version 257515 (0.0008) [2023-12-27 21:04:45,252][106226] Updated weights for policy 0, policy_version 257525 (0.0009) [2023-12-27 21:04:45,510][106225] Updated weights for policy 1, policy_version 257796 (0.0007) [2023-12-27 21:04:45,565][106225] Updated weights for policy 1, policy_version 257806 (0.0008) [2023-12-27 21:04:45,621][106225] Updated weights for policy 1, policy_version 257816 (0.0008) [2023-12-27 21:04:45,957][106226] Updated weights for policy 0, policy_version 257535 (0.0008) [2023-12-27 21:04:46,012][106226] Updated weights for policy 0, policy_version 257545 (0.0008) [2023-12-27 21:04:46,072][106226] Updated weights for policy 0, policy_version 257555 (0.0008) [2023-12-27 21:04:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 131973120. Throughput: 0: 9985.1, 1: 10003.6. Samples: 131960820. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:46,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-6.159')] [2023-12-27 21:04:46,308][106225] Updated weights for policy 1, policy_version 257826 (0.0006) [2023-12-27 21:04:46,360][106225] Updated weights for policy 1, policy_version 257836 (0.0008) [2023-12-27 21:04:46,416][106225] Updated weights for policy 1, policy_version 257846 (0.0009) [2023-12-27 21:04:46,471][106225] Updated weights for policy 1, policy_version 257856 (0.0007) [2023-12-27 21:04:46,820][106226] Updated weights for policy 0, policy_version 257565 (0.0008) [2023-12-27 21:04:46,876][106226] Updated weights for policy 0, policy_version 257575 (0.0007) [2023-12-27 21:04:46,937][106226] Updated weights for policy 0, policy_version 257585 (0.0008) [2023-12-27 21:04:47,222][106225] Updated weights for policy 1, policy_version 257866 (0.0010) [2023-12-27 21:04:47,275][106225] Updated weights for policy 1, policy_version 257876 (0.0010) [2023-12-27 21:04:47,327][106225] Updated weights for policy 1, policy_version 257886 (0.0010) [2023-12-27 21:04:47,623][106226] Updated weights for policy 0, policy_version 257595 (0.0007) [2023-12-27 21:04:47,687][106226] Updated weights for policy 0, policy_version 257605 (0.0005) [2023-12-27 21:04:47,750][106226] Updated weights for policy 0, policy_version 257615 (0.0008) [2023-12-27 21:04:47,932][106225] Updated weights for policy 1, policy_version 257896 (0.0006) [2023-12-27 21:04:47,991][106225] Updated weights for policy 1, policy_version 257906 (0.0006) [2023-12-27 21:04:48,048][106225] Updated weights for policy 1, policy_version 257916 (0.0010) [2023-12-27 21:04:48,338][106226] Updated weights for policy 0, policy_version 257625 (0.0008) [2023-12-27 21:04:48,402][106226] Updated weights for policy 0, policy_version 257635 (0.0007) [2023-12-27 21:04:48,464][106226] Updated weights for policy 0, policy_version 257645 (0.0008) [2023-12-27 21:04:48,519][106226] Updated weights for policy 0, policy_version 257655 (0.0008) [2023-12-27 21:04:48,666][106225] Updated weights for policy 1, policy_version 257926 (0.0010) [2023-12-27 21:04:48,726][106225] Updated weights for policy 1, policy_version 257936 (0.0010) [2023-12-27 21:04:48,787][106225] Updated weights for policy 1, policy_version 257946 (0.0010) [2023-12-27 21:04:49,233][106226] Updated weights for policy 0, policy_version 257665 (0.0008) [2023-12-27 21:04:49,298][106226] Updated weights for policy 0, policy_version 257675 (0.0006) [2023-12-27 21:04:49,368][106226] Updated weights for policy 0, policy_version 257685 (0.0007) [2023-12-27 21:04:49,468][106225] Updated weights for policy 1, policy_version 257956 (0.0011) [2023-12-27 21:04:49,531][106225] Updated weights for policy 1, policy_version 257966 (0.0010) [2023-12-27 21:04:49,592][106225] Updated weights for policy 1, policy_version 257976 (0.0010) [2023-12-27 21:04:50,102][106226] Updated weights for policy 0, policy_version 257695 (0.0006) [2023-12-27 21:04:50,169][106226] Updated weights for policy 0, policy_version 257705 (0.0008) [2023-12-27 21:04:50,234][106226] Updated weights for policy 0, policy_version 257715 (0.0008) [2023-12-27 21:04:50,322][106225] Updated weights for policy 1, policy_version 257986 (0.0009) [2023-12-27 21:04:50,386][106225] Updated weights for policy 1, policy_version 257996 (0.0006) [2023-12-27 21:04:50,447][106225] Updated weights for policy 1, policy_version 258006 (0.0010) [2023-12-27 21:04:50,497][106225] Updated weights for policy 1, policy_version 258016 (0.0010) [2023-12-27 21:04:50,914][106226] Updated weights for policy 0, policy_version 257725 (0.0008) [2023-12-27 21:04:50,980][106226] Updated weights for policy 0, policy_version 257735 (0.0008) [2023-12-27 21:04:51,060][106226] Updated weights for policy 0, policy_version 257745 (0.0008) [2023-12-27 21:04:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 132071424. Throughput: 0: 9897.9, 1: 10012.5. Samples: 132080144. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:51,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-5.935')] [2023-12-27 21:04:51,199][106225] Updated weights for policy 1, policy_version 258026 (0.0009) [2023-12-27 21:04:51,261][106225] Updated weights for policy 1, policy_version 258036 (0.0009) [2023-12-27 21:04:51,324][106225] Updated weights for policy 1, policy_version 258046 (0.0008) [2023-12-27 21:04:51,841][106226] Updated weights for policy 0, policy_version 257755 (0.0008) [2023-12-27 21:04:51,914][106226] Updated weights for policy 0, policy_version 257765 (0.0007) [2023-12-27 21:04:51,980][106226] Updated weights for policy 0, policy_version 257775 (0.0009) [2023-12-27 21:04:52,089][106225] Updated weights for policy 1, policy_version 258056 (0.0007) [2023-12-27 21:04:52,155][106225] Updated weights for policy 1, policy_version 258066 (0.0007) [2023-12-27 21:04:52,209][106225] Updated weights for policy 1, policy_version 258076 (0.0008) [2023-12-27 21:04:52,648][106226] Updated weights for policy 0, policy_version 257785 (0.0008) [2023-12-27 21:04:52,700][106226] Updated weights for policy 0, policy_version 257795 (0.0008) [2023-12-27 21:04:52,757][106226] Updated weights for policy 0, policy_version 257805 (0.0008) [2023-12-27 21:04:52,810][106226] Updated weights for policy 0, policy_version 257815 (0.0008) [2023-12-27 21:04:52,961][106225] Updated weights for policy 1, policy_version 258086 (0.0010) [2023-12-27 21:04:53,015][106225] Updated weights for policy 1, policy_version 258096 (0.0010) [2023-12-27 21:04:53,079][106225] Updated weights for policy 1, policy_version 258106 (0.0010) [2023-12-27 21:04:53,431][106226] Updated weights for policy 0, policy_version 257825 (0.0005) [2023-12-27 21:04:53,494][106226] Updated weights for policy 0, policy_version 257835 (0.0005) [2023-12-27 21:04:53,548][106226] Updated weights for policy 0, policy_version 257845 (0.0005) [2023-12-27 21:04:53,751][106225] Updated weights for policy 1, policy_version 258116 (0.0008) [2023-12-27 21:04:53,814][106225] Updated weights for policy 1, policy_version 258126 (0.0005) [2023-12-27 21:04:53,870][106225] Updated weights for policy 1, policy_version 258136 (0.0005) [2023-12-27 21:04:54,192][106226] Updated weights for policy 0, policy_version 257855 (0.0006) [2023-12-27 21:04:54,249][106226] Updated weights for policy 0, policy_version 257865 (0.0010) [2023-12-27 21:04:54,314][106226] Updated weights for policy 0, policy_version 257875 (0.0010) [2023-12-27 21:04:54,546][106225] Updated weights for policy 1, policy_version 258146 (0.0007) [2023-12-27 21:04:54,597][106225] Updated weights for policy 1, policy_version 258156 (0.0006) [2023-12-27 21:04:54,645][106225] Updated weights for policy 1, policy_version 258166 (0.0009) [2023-12-27 21:04:54,691][106225] Updated weights for policy 1, policy_version 258176 (0.0009) [2023-12-27 21:04:54,969][106226] Updated weights for policy 0, policy_version 257885 (0.0011) [2023-12-27 21:04:55,020][106226] Updated weights for policy 0, policy_version 257895 (0.0010) [2023-12-27 21:04:55,084][106226] Updated weights for policy 0, policy_version 257905 (0.0011) [2023-12-27 21:04:55,354][106225] Updated weights for policy 1, policy_version 258186 (0.0005) [2023-12-27 21:04:55,411][106225] Updated weights for policy 1, policy_version 258196 (0.0005) [2023-12-27 21:04:55,462][106225] Updated weights for policy 1, policy_version 258206 (0.0005) [2023-12-27 21:04:55,797][106226] Updated weights for policy 0, policy_version 257915 (0.0011) [2023-12-27 21:04:55,854][106226] Updated weights for policy 0, policy_version 257925 (0.0010) [2023-12-27 21:04:55,908][106226] Updated weights for policy 0, policy_version 257935 (0.0010) [2023-12-27 21:04:56,057][106225] Updated weights for policy 1, policy_version 258216 (0.0009) [2023-12-27 21:04:56,122][106225] Updated weights for policy 1, policy_version 258226 (0.0010) [2023-12-27 21:04:56,170][106225] Updated weights for policy 1, policy_version 258236 (0.0010) [2023-12-27 21:04:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 132169728. Throughput: 0: 9864.0, 1: 9988.7. Samples: 132139116. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:04:56,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.875')] [2023-12-27 21:04:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000257944_66052096.pth... [2023-12-27 21:04:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000256792_65757184.pth [2023-12-27 21:04:56,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000258240_66125824.pth... [2023-12-27 21:04:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000257056_65822720.pth [2023-12-27 21:04:56,530][106226] Updated weights for policy 0, policy_version 257945 (0.0008) [2023-12-27 21:04:56,592][106226] Updated weights for policy 0, policy_version 257955 (0.0010) [2023-12-27 21:04:56,653][106226] Updated weights for policy 0, policy_version 257965 (0.0010) [2023-12-27 21:04:56,712][106226] Updated weights for policy 0, policy_version 257975 (0.0010) [2023-12-27 21:04:56,855][106225] Updated weights for policy 1, policy_version 258246 (0.0007) [2023-12-27 21:04:56,920][106225] Updated weights for policy 1, policy_version 258256 (0.0005) [2023-12-27 21:04:56,976][106225] Updated weights for policy 1, policy_version 258266 (0.0005) [2023-12-27 21:04:57,369][106226] Updated weights for policy 0, policy_version 257985 (0.0008) [2023-12-27 21:04:57,420][106226] Updated weights for policy 0, policy_version 257995 (0.0008) [2023-12-27 21:04:57,469][106226] Updated weights for policy 0, policy_version 258005 (0.0007) [2023-12-27 21:04:57,605][106225] Updated weights for policy 1, policy_version 258276 (0.0007) [2023-12-27 21:04:57,663][106225] Updated weights for policy 1, policy_version 258286 (0.0010) [2023-12-27 21:04:57,722][106225] Updated weights for policy 1, policy_version 258296 (0.0010) [2023-12-27 21:04:58,211][106226] Updated weights for policy 0, policy_version 258015 (0.0007) [2023-12-27 21:04:58,271][106226] Updated weights for policy 0, policy_version 258025 (0.0008) [2023-12-27 21:04:58,340][106226] Updated weights for policy 0, policy_version 258035 (0.0009) [2023-12-27 21:04:58,446][106225] Updated weights for policy 1, policy_version 258306 (0.0010) [2023-12-27 21:04:58,514][106225] Updated weights for policy 1, policy_version 258316 (0.0008) [2023-12-27 21:04:58,577][106225] Updated weights for policy 1, policy_version 258326 (0.0008) [2023-12-27 21:04:58,641][106225] Updated weights for policy 1, policy_version 258336 (0.0007) [2023-12-27 21:04:59,157][106226] Updated weights for policy 0, policy_version 258045 (0.0009) [2023-12-27 21:04:59,220][106226] Updated weights for policy 0, policy_version 258055 (0.0009) [2023-12-27 21:04:59,287][106226] Updated weights for policy 0, policy_version 258065 (0.0008) [2023-12-27 21:04:59,479][106225] Updated weights for policy 1, policy_version 258346 (0.0008) [2023-12-27 21:04:59,540][106225] Updated weights for policy 1, policy_version 258356 (0.0006) [2023-12-27 21:04:59,593][106225] Updated weights for policy 1, policy_version 258366 (0.0007) [2023-12-27 21:05:00,077][106226] Updated weights for policy 0, policy_version 258075 (0.0008) [2023-12-27 21:05:00,144][106226] Updated weights for policy 0, policy_version 258085 (0.0009) [2023-12-27 21:05:00,200][106226] Updated weights for policy 0, policy_version 258095 (0.0009) [2023-12-27 21:05:00,287][106225] Updated weights for policy 1, policy_version 258376 (0.0006) [2023-12-27 21:05:00,360][106225] Updated weights for policy 1, policy_version 258386 (0.0006) [2023-12-27 21:05:00,424][106225] Updated weights for policy 1, policy_version 258396 (0.0008) [2023-12-27 21:05:00,773][106226] Updated weights for policy 0, policy_version 258105 (0.0008) [2023-12-27 21:05:00,837][106226] Updated weights for policy 0, policy_version 258115 (0.0008) [2023-12-27 21:05:00,888][106226] Updated weights for policy 0, policy_version 258125 (0.0009) [2023-12-27 21:05:00,938][106226] Updated weights for policy 0, policy_version 258135 (0.0007) [2023-12-27 21:05:01,055][106225] Updated weights for policy 1, policy_version 258406 (0.0007) [2023-12-27 21:05:01,121][106225] Updated weights for policy 1, policy_version 258416 (0.0006) [2023-12-27 21:05:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 132268032. Throughput: 0: 9891.5, 1: 10006.1. Samples: 132258068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:01,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-6.372')] [2023-12-27 21:05:01,197][106225] Updated weights for policy 1, policy_version 258426 (0.0007) [2023-12-27 21:05:01,746][106226] Updated weights for policy 0, policy_version 258145 (0.0008) [2023-12-27 21:05:01,809][106226] Updated weights for policy 0, policy_version 258155 (0.0007) [2023-12-27 21:05:01,871][106226] Updated weights for policy 0, policy_version 258165 (0.0007) [2023-12-27 21:05:01,936][106225] Updated weights for policy 1, policy_version 258436 (0.0007) [2023-12-27 21:05:02,000][106225] Updated weights for policy 1, policy_version 258446 (0.0005) [2023-12-27 21:05:02,062][106225] Updated weights for policy 1, policy_version 258456 (0.0006) [2023-12-27 21:05:02,671][106226] Updated weights for policy 0, policy_version 258175 (0.0008) [2023-12-27 21:05:02,678][106225] Updated weights for policy 1, policy_version 258466 (0.0009) [2023-12-27 21:05:02,724][106226] Updated weights for policy 0, policy_version 258185 (0.0008) [2023-12-27 21:05:02,738][106225] Updated weights for policy 1, policy_version 258476 (0.0008) [2023-12-27 21:05:02,779][106226] Updated weights for policy 0, policy_version 258195 (0.0006) [2023-12-27 21:05:02,793][106225] Updated weights for policy 1, policy_version 258486 (0.0006) [2023-12-27 21:05:02,850][106225] Updated weights for policy 1, policy_version 258496 (0.0007) [2023-12-27 21:05:03,479][106226] Updated weights for policy 0, policy_version 258205 (0.0006) [2023-12-27 21:05:03,528][106226] Updated weights for policy 0, policy_version 258215 (0.0005) [2023-12-27 21:05:03,573][106226] Updated weights for policy 0, policy_version 258225 (0.0005) [2023-12-27 21:05:03,583][106225] Updated weights for policy 1, policy_version 258506 (0.0007) [2023-12-27 21:05:03,625][106225] Updated weights for policy 1, policy_version 258516 (0.0007) [2023-12-27 21:05:03,669][106225] Updated weights for policy 1, policy_version 258526 (0.0008) [2023-12-27 21:05:04,137][106226] Updated weights for policy 0, policy_version 258235 (0.0007) [2023-12-27 21:05:04,200][106226] Updated weights for policy 0, policy_version 258245 (0.0008) [2023-12-27 21:05:04,262][106226] Updated weights for policy 0, policy_version 258255 (0.0008) [2023-12-27 21:05:04,505][106225] Updated weights for policy 1, policy_version 258536 (0.0008) [2023-12-27 21:05:04,561][106225] Updated weights for policy 1, policy_version 258546 (0.0009) [2023-12-27 21:05:04,621][106225] Updated weights for policy 1, policy_version 258556 (0.0009) [2023-12-27 21:05:04,989][106226] Updated weights for policy 0, policy_version 258265 (0.0008) [2023-12-27 21:05:05,048][106226] Updated weights for policy 0, policy_version 258275 (0.0007) [2023-12-27 21:05:05,110][106226] Updated weights for policy 0, policy_version 258285 (0.0007) [2023-12-27 21:05:05,179][106226] Updated weights for policy 0, policy_version 258295 (0.0008) [2023-12-27 21:05:05,378][106225] Updated weights for policy 1, policy_version 258566 (0.0007) [2023-12-27 21:05:05,439][106225] Updated weights for policy 1, policy_version 258576 (0.0006) [2023-12-27 21:05:05,486][106225] Updated weights for policy 1, policy_version 258586 (0.0008) [2023-12-27 21:05:05,873][106226] Updated weights for policy 0, policy_version 258305 (0.0011) [2023-12-27 21:05:05,931][106226] Updated weights for policy 0, policy_version 258315 (0.0011) [2023-12-27 21:05:05,995][106226] Updated weights for policy 0, policy_version 258325 (0.0011) [2023-12-27 21:05:06,146][106225] Updated weights for policy 1, policy_version 258596 (0.0007) [2023-12-27 21:05:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 132366336. Throughput: 0: 9966.8, 1: 9941.3. Samples: 132375888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:06,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-6.084')] [2023-12-27 21:05:06,215][106225] Updated weights for policy 1, policy_version 258606 (0.0007) [2023-12-27 21:05:06,277][106225] Updated weights for policy 1, policy_version 258616 (0.0008) [2023-12-27 21:05:06,722][106226] Updated weights for policy 0, policy_version 258335 (0.0009) [2023-12-27 21:05:06,779][106226] Updated weights for policy 0, policy_version 258345 (0.0006) [2023-12-27 21:05:06,836][106226] Updated weights for policy 0, policy_version 258355 (0.0005) [2023-12-27 21:05:06,993][106225] Updated weights for policy 1, policy_version 258626 (0.0008) [2023-12-27 21:05:07,049][106225] Updated weights for policy 1, policy_version 258636 (0.0010) [2023-12-27 21:05:07,101][106225] Updated weights for policy 1, policy_version 258646 (0.0006) [2023-12-27 21:05:07,164][106225] Updated weights for policy 1, policy_version 258656 (0.0006) [2023-12-27 21:05:07,448][106226] Updated weights for policy 0, policy_version 258365 (0.0008) [2023-12-27 21:05:07,510][106226] Updated weights for policy 0, policy_version 258375 (0.0010) [2023-12-27 21:05:07,580][106226] Updated weights for policy 0, policy_version 258385 (0.0011) [2023-12-27 21:05:07,786][106225] Updated weights for policy 1, policy_version 258666 (0.0008) [2023-12-27 21:05:07,840][106225] Updated weights for policy 1, policy_version 258676 (0.0007) [2023-12-27 21:05:07,894][106225] Updated weights for policy 1, policy_version 258686 (0.0008) [2023-12-27 21:05:08,267][106226] Updated weights for policy 0, policy_version 258395 (0.0010) [2023-12-27 21:05:08,318][106226] Updated weights for policy 0, policy_version 258405 (0.0010) [2023-12-27 21:05:08,381][106226] Updated weights for policy 0, policy_version 258415 (0.0010) [2023-12-27 21:05:08,658][106225] Updated weights for policy 1, policy_version 258696 (0.0008) [2023-12-27 21:05:08,713][106225] Updated weights for policy 1, policy_version 258706 (0.0008) [2023-12-27 21:05:08,767][106225] Updated weights for policy 1, policy_version 258716 (0.0008) [2023-12-27 21:05:09,101][106226] Updated weights for policy 0, policy_version 258425 (0.0006) [2023-12-27 21:05:09,161][106226] Updated weights for policy 0, policy_version 258435 (0.0009) [2023-12-27 21:05:09,225][106226] Updated weights for policy 0, policy_version 258445 (0.0009) [2023-12-27 21:05:09,287][106226] Updated weights for policy 0, policy_version 258455 (0.0009) [2023-12-27 21:05:09,557][106225] Updated weights for policy 1, policy_version 258726 (0.0008) [2023-12-27 21:05:09,616][106225] Updated weights for policy 1, policy_version 258736 (0.0008) [2023-12-27 21:05:09,672][106225] Updated weights for policy 1, policy_version 258746 (0.0005) [2023-12-27 21:05:10,105][106226] Updated weights for policy 0, policy_version 258465 (0.0007) [2023-12-27 21:05:10,169][106226] Updated weights for policy 0, policy_version 258475 (0.0009) [2023-12-27 21:05:10,229][106226] Updated weights for policy 0, policy_version 258485 (0.0008) [2023-12-27 21:05:10,360][106225] Updated weights for policy 1, policy_version 258756 (0.0007) [2023-12-27 21:05:10,419][106225] Updated weights for policy 1, policy_version 258766 (0.0008) [2023-12-27 21:05:10,482][106225] Updated weights for policy 1, policy_version 258776 (0.0008) [2023-12-27 21:05:10,966][106226] Updated weights for policy 0, policy_version 258495 (0.0008) [2023-12-27 21:05:11,031][106226] Updated weights for policy 0, policy_version 258505 (0.0007) [2023-12-27 21:05:11,075][106225] Updated weights for policy 1, policy_version 258786 (0.0009) [2023-12-27 21:05:11,098][106226] Updated weights for policy 0, policy_version 258515 (0.0009) [2023-12-27 21:05:11,141][106225] Updated weights for policy 1, policy_version 258796 (0.0008) [2023-12-27 21:05:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 132464640. Throughput: 0: 9981.9, 1: 9934.7. Samples: 132436040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:11,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.937')] [2023-12-27 21:05:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000258520_66199552.pth... [2023-12-27 21:05:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000257368_65904640.pth [2023-12-27 21:05:11,195][106225] Updated weights for policy 1, policy_version 258806 (0.0008) [2023-12-27 21:05:11,254][106225] Updated weights for policy 1, policy_version 258816 (0.0007) [2023-12-27 21:05:11,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000258816_66273280.pth... [2023-12-27 21:05:11,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000257632_65970176.pth [2023-12-27 21:05:11,838][106226] Updated weights for policy 0, policy_version 258525 (0.0009) [2023-12-27 21:05:11,897][106226] Updated weights for policy 0, policy_version 258535 (0.0008) [2023-12-27 21:05:11,955][106226] Updated weights for policy 0, policy_version 258545 (0.0005) [2023-12-27 21:05:12,107][106225] Updated weights for policy 1, policy_version 258826 (0.0006) [2023-12-27 21:05:12,161][106225] Updated weights for policy 1, policy_version 258836 (0.0007) [2023-12-27 21:05:12,223][106225] Updated weights for policy 1, policy_version 258846 (0.0005) [2023-12-27 21:05:12,661][106226] Updated weights for policy 0, policy_version 258555 (0.0007) [2023-12-27 21:05:12,721][106226] Updated weights for policy 0, policy_version 258565 (0.0009) [2023-12-27 21:05:12,783][106226] Updated weights for policy 0, policy_version 258575 (0.0009) [2023-12-27 21:05:12,860][106225] Updated weights for policy 1, policy_version 258856 (0.0006) [2023-12-27 21:05:12,922][106225] Updated weights for policy 1, policy_version 258866 (0.0005) [2023-12-27 21:05:12,989][106225] Updated weights for policy 1, policy_version 258876 (0.0006) [2023-12-27 21:05:13,519][106226] Updated weights for policy 0, policy_version 258585 (0.0009) [2023-12-27 21:05:13,571][106226] Updated weights for policy 0, policy_version 258595 (0.0008) [2023-12-27 21:05:13,632][106226] Updated weights for policy 0, policy_version 258605 (0.0008) [2023-12-27 21:05:13,653][106225] Updated weights for policy 1, policy_version 258886 (0.0008) [2023-12-27 21:05:13,682][106226] Updated weights for policy 0, policy_version 258615 (0.0006) [2023-12-27 21:05:13,700][106225] Updated weights for policy 1, policy_version 258896 (0.0007) [2023-12-27 21:05:13,759][106225] Updated weights for policy 1, policy_version 258906 (0.0006) [2023-12-27 21:05:14,403][106225] Updated weights for policy 1, policy_version 258916 (0.0007) [2023-12-27 21:05:14,417][106226] Updated weights for policy 0, policy_version 258625 (0.0005) [2023-12-27 21:05:14,461][106225] Updated weights for policy 1, policy_version 258926 (0.0010) [2023-12-27 21:05:14,478][106226] Updated weights for policy 0, policy_version 258635 (0.0008) [2023-12-27 21:05:14,515][106225] Updated weights for policy 1, policy_version 258936 (0.0010) [2023-12-27 21:05:14,537][106226] Updated weights for policy 0, policy_version 258645 (0.0006) [2023-12-27 21:05:15,186][106225] Updated weights for policy 1, policy_version 258946 (0.0010) [2023-12-27 21:05:15,234][106225] Updated weights for policy 1, policy_version 258956 (0.0010) [2023-12-27 21:05:15,274][106226] Updated weights for policy 0, policy_version 258655 (0.0005) [2023-12-27 21:05:15,295][106225] Updated weights for policy 1, policy_version 258966 (0.0010) [2023-12-27 21:05:15,340][106226] Updated weights for policy 0, policy_version 258665 (0.0006) [2023-12-27 21:05:15,349][106225] Updated weights for policy 1, policy_version 258976 (0.0010) [2023-12-27 21:05:15,400][106226] Updated weights for policy 0, policy_version 258675 (0.0008) [2023-12-27 21:05:15,936][106225] Updated weights for policy 1, policy_version 258986 (0.0005) [2023-12-27 21:05:15,984][106225] Updated weights for policy 1, policy_version 258996 (0.0005) [2023-12-27 21:05:16,038][106225] Updated weights for policy 1, policy_version 259006 (0.0009) [2023-12-27 21:05:16,167][106226] Updated weights for policy 0, policy_version 258685 (0.0009) [2023-12-27 21:05:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 132562944. Throughput: 0: 9771.2, 1: 9862.4. Samples: 132551768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:16,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.897')] [2023-12-27 21:05:16,218][106226] Updated weights for policy 0, policy_version 258695 (0.0009) [2023-12-27 21:05:16,270][106226] Updated weights for policy 0, policy_version 258705 (0.0009) [2023-12-27 21:05:16,604][106225] Updated weights for policy 1, policy_version 259016 (0.0006) [2023-12-27 21:05:16,655][106225] Updated weights for policy 1, policy_version 259026 (0.0005) [2023-12-27 21:05:16,707][106225] Updated weights for policy 1, policy_version 259036 (0.0005) [2023-12-27 21:05:17,122][106226] Updated weights for policy 0, policy_version 258715 (0.0008) [2023-12-27 21:05:17,169][106226] Updated weights for policy 0, policy_version 258725 (0.0008) [2023-12-27 21:05:17,219][106226] Updated weights for policy 0, policy_version 258735 (0.0008) [2023-12-27 21:05:17,323][106225] Updated weights for policy 1, policy_version 259046 (0.0008) [2023-12-27 21:05:17,377][106225] Updated weights for policy 1, policy_version 259056 (0.0010) [2023-12-27 21:05:17,436][106225] Updated weights for policy 1, policy_version 259066 (0.0010) [2023-12-27 21:05:17,977][106226] Updated weights for policy 0, policy_version 258745 (0.0008) [2023-12-27 21:05:18,024][106226] Updated weights for policy 0, policy_version 258755 (0.0007) [2023-12-27 21:05:18,072][106226] Updated weights for policy 0, policy_version 258765 (0.0007) [2023-12-27 21:05:18,123][106226] Updated weights for policy 0, policy_version 258775 (0.0008) [2023-12-27 21:05:18,156][106225] Updated weights for policy 1, policy_version 259076 (0.0010) [2023-12-27 21:05:18,215][106225] Updated weights for policy 1, policy_version 259086 (0.0010) [2023-12-27 21:05:18,273][106225] Updated weights for policy 1, policy_version 259096 (0.0010) [2023-12-27 21:05:18,883][106226] Updated weights for policy 0, policy_version 258785 (0.0008) [2023-12-27 21:05:18,945][106226] Updated weights for policy 0, policy_version 258795 (0.0008) [2023-12-27 21:05:19,010][106225] Updated weights for policy 1, policy_version 259106 (0.0009) [2023-12-27 21:05:19,014][106226] Updated weights for policy 0, policy_version 258805 (0.0009) [2023-12-27 21:05:19,069][106225] Updated weights for policy 1, policy_version 259116 (0.0008) [2023-12-27 21:05:19,129][106225] Updated weights for policy 1, policy_version 259126 (0.0010) [2023-12-27 21:05:19,187][106225] Updated weights for policy 1, policy_version 259136 (0.0009) [2023-12-27 21:05:19,792][106226] Updated weights for policy 0, policy_version 258815 (0.0009) [2023-12-27 21:05:19,856][106226] Updated weights for policy 0, policy_version 258825 (0.0008) [2023-12-27 21:05:19,922][106226] Updated weights for policy 0, policy_version 258835 (0.0009) [2023-12-27 21:05:19,980][106225] Updated weights for policy 1, policy_version 259146 (0.0008) [2023-12-27 21:05:20,033][106225] Updated weights for policy 1, policy_version 259156 (0.0008) [2023-12-27 21:05:20,087][106225] Updated weights for policy 1, policy_version 259166 (0.0008) [2023-12-27 21:05:20,655][106226] Updated weights for policy 0, policy_version 258845 (0.0007) [2023-12-27 21:05:20,721][106226] Updated weights for policy 0, policy_version 258855 (0.0006) [2023-12-27 21:05:20,791][106226] Updated weights for policy 0, policy_version 258865 (0.0006) [2023-12-27 21:05:20,901][106225] Updated weights for policy 1, policy_version 259176 (0.0010) [2023-12-27 21:05:20,951][106225] Updated weights for policy 1, policy_version 259186 (0.0010) [2023-12-27 21:05:21,014][106225] Updated weights for policy 1, policy_version 259196 (0.0009) [2023-12-27 21:05:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 132661248. Throughput: 0: 9717.1, 1: 9920.8. Samples: 132668404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:21,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-6.059')] [2023-12-27 21:05:21,474][106226] Updated weights for policy 0, policy_version 258875 (0.0007) [2023-12-27 21:05:21,538][106226] Updated weights for policy 0, policy_version 258885 (0.0009) [2023-12-27 21:05:21,602][106226] Updated weights for policy 0, policy_version 258895 (0.0008) [2023-12-27 21:05:21,860][106225] Updated weights for policy 1, policy_version 259206 (0.0008) [2023-12-27 21:05:21,913][106225] Updated weights for policy 1, policy_version 259216 (0.0008) [2023-12-27 21:05:21,967][106225] Updated weights for policy 1, policy_version 259226 (0.0006) [2023-12-27 21:05:22,351][106226] Updated weights for policy 0, policy_version 258905 (0.0009) [2023-12-27 21:05:22,419][106226] Updated weights for policy 0, policy_version 258915 (0.0008) [2023-12-27 21:05:22,482][106226] Updated weights for policy 0, policy_version 258925 (0.0008) [2023-12-27 21:05:22,546][106226] Updated weights for policy 0, policy_version 258935 (0.0008) [2023-12-27 21:05:22,709][106225] Updated weights for policy 1, policy_version 259236 (0.0007) [2023-12-27 21:05:22,770][106225] Updated weights for policy 1, policy_version 259246 (0.0008) [2023-12-27 21:05:22,839][106225] Updated weights for policy 1, policy_version 259256 (0.0007) [2023-12-27 21:05:23,311][106226] Updated weights for policy 0, policy_version 258945 (0.0006) [2023-12-27 21:05:23,368][106226] Updated weights for policy 0, policy_version 258955 (0.0006) [2023-12-27 21:05:23,426][106226] Updated weights for policy 0, policy_version 258965 (0.0006) [2023-12-27 21:05:23,438][106225] Updated weights for policy 1, policy_version 259266 (0.0006) [2023-12-27 21:05:23,495][106225] Updated weights for policy 1, policy_version 259276 (0.0010) [2023-12-27 21:05:23,547][106225] Updated weights for policy 1, policy_version 259286 (0.0010) [2023-12-27 21:05:23,597][106225] Updated weights for policy 1, policy_version 259296 (0.0010) [2023-12-27 21:05:24,148][106226] Updated weights for policy 0, policy_version 258975 (0.0009) [2023-12-27 21:05:24,198][106226] Updated weights for policy 0, policy_version 258985 (0.0005) [2023-12-27 21:05:24,248][106226] Updated weights for policy 0, policy_version 258995 (0.0007) [2023-12-27 21:05:24,325][106225] Updated weights for policy 1, policy_version 259306 (0.0010) [2023-12-27 21:05:24,371][106225] Updated weights for policy 1, policy_version 259316 (0.0010) [2023-12-27 21:05:24,418][106225] Updated weights for policy 1, policy_version 259326 (0.0010) [2023-12-27 21:05:24,921][106226] Updated weights for policy 0, policy_version 259005 (0.0010) [2023-12-27 21:05:24,980][106226] Updated weights for policy 0, policy_version 259015 (0.0010) [2023-12-27 21:05:25,041][106226] Updated weights for policy 0, policy_version 259025 (0.0009) [2023-12-27 21:05:25,147][106225] Updated weights for policy 1, policy_version 259336 (0.0010) [2023-12-27 21:05:25,201][106225] Updated weights for policy 1, policy_version 259346 (0.0007) [2023-12-27 21:05:25,267][106225] Updated weights for policy 1, policy_version 259356 (0.0005) [2023-12-27 21:05:25,700][106226] Updated weights for policy 0, policy_version 259035 (0.0010) [2023-12-27 21:05:25,757][106226] Updated weights for policy 0, policy_version 259045 (0.0011) [2023-12-27 21:05:25,803][106226] Updated weights for policy 0, policy_version 259055 (0.0010) [2023-12-27 21:05:25,849][106225] Updated weights for policy 1, policy_version 259366 (0.0006) [2023-12-27 21:05:25,899][106225] Updated weights for policy 1, policy_version 259376 (0.0005) [2023-12-27 21:05:25,969][106225] Updated weights for policy 1, policy_version 259386 (0.0005) [2023-12-27 21:05:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 132759552. Throughput: 0: 9657.9, 1: 9920.4. Samples: 132725400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:26,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.905')] [2023-12-27 21:05:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000259064_66338816.pth... [2023-12-27 21:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000259392_66420736.pth... [2023-12-27 21:05:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000257944_66052096.pth [2023-12-27 21:05:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000258240_66125824.pth [2023-12-27 21:05:26,484][106226] Updated weights for policy 0, policy_version 259065 (0.0010) [2023-12-27 21:05:26,546][106226] Updated weights for policy 0, policy_version 259075 (0.0005) [2023-12-27 21:05:26,567][106225] Updated weights for policy 1, policy_version 259396 (0.0007) [2023-12-27 21:05:26,606][106226] Updated weights for policy 0, policy_version 259085 (0.0005) [2023-12-27 21:05:26,616][106225] Updated weights for policy 1, policy_version 259406 (0.0010) [2023-12-27 21:05:26,668][106226] Updated weights for policy 0, policy_version 259095 (0.0005) [2023-12-27 21:05:26,672][106225] Updated weights for policy 1, policy_version 259416 (0.0010) [2023-12-27 21:05:27,279][106225] Updated weights for policy 1, policy_version 259426 (0.0009) [2023-12-27 21:05:27,302][106226] Updated weights for policy 0, policy_version 259105 (0.0009) [2023-12-27 21:05:27,332][106225] Updated weights for policy 1, policy_version 259436 (0.0008) [2023-12-27 21:05:27,362][106226] Updated weights for policy 0, policy_version 259115 (0.0008) [2023-12-27 21:05:27,388][106225] Updated weights for policy 1, policy_version 259446 (0.0005) [2023-12-27 21:05:27,413][106226] Updated weights for policy 0, policy_version 259125 (0.0008) [2023-12-27 21:05:27,448][106225] Updated weights for policy 1, policy_version 259456 (0.0005) [2023-12-27 21:05:27,961][106225] Updated weights for policy 1, policy_version 259466 (0.0007) [2023-12-27 21:05:28,005][106225] Updated weights for policy 1, policy_version 259476 (0.0008) [2023-12-27 21:05:28,049][106225] Updated weights for policy 1, policy_version 259486 (0.0008) [2023-12-27 21:05:28,198][106226] Updated weights for policy 0, policy_version 259135 (0.0008) [2023-12-27 21:05:28,257][106226] Updated weights for policy 0, policy_version 259145 (0.0008) [2023-12-27 21:05:28,315][106226] Updated weights for policy 0, policy_version 259155 (0.0008) [2023-12-27 21:05:28,769][106225] Updated weights for policy 1, policy_version 259496 (0.0006) [2023-12-27 21:05:28,833][106225] Updated weights for policy 1, policy_version 259506 (0.0008) [2023-12-27 21:05:28,896][106225] Updated weights for policy 1, policy_version 259516 (0.0007) [2023-12-27 21:05:29,076][106226] Updated weights for policy 0, policy_version 259165 (0.0007) [2023-12-27 21:05:29,137][106226] Updated weights for policy 0, policy_version 259175 (0.0005) [2023-12-27 21:05:29,186][106226] Updated weights for policy 0, policy_version 259185 (0.0008) [2023-12-27 21:05:29,637][106225] Updated weights for policy 1, policy_version 259526 (0.0007) [2023-12-27 21:05:29,701][106225] Updated weights for policy 1, policy_version 259536 (0.0008) [2023-12-27 21:05:29,767][106225] Updated weights for policy 1, policy_version 259546 (0.0006) [2023-12-27 21:05:29,840][106226] Updated weights for policy 0, policy_version 259195 (0.0010) [2023-12-27 21:05:29,896][106226] Updated weights for policy 0, policy_version 259205 (0.0008) [2023-12-27 21:05:29,963][106226] Updated weights for policy 0, policy_version 259215 (0.0008) [2023-12-27 21:05:30,458][106225] Updated weights for policy 1, policy_version 259556 (0.0008) [2023-12-27 21:05:30,510][106225] Updated weights for policy 1, policy_version 259566 (0.0008) [2023-12-27 21:05:30,558][106225] Updated weights for policy 1, policy_version 259576 (0.0008) [2023-12-27 21:05:30,704][106226] Updated weights for policy 0, policy_version 259225 (0.0008) [2023-12-27 21:05:30,763][106226] Updated weights for policy 0, policy_version 259235 (0.0010) [2023-12-27 21:05:30,819][106226] Updated weights for policy 0, policy_version 259245 (0.0007) [2023-12-27 21:05:30,878][106226] Updated weights for policy 0, policy_version 259255 (0.0006) [2023-12-27 21:05:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 132857856. Throughput: 0: 9694.5, 1: 10041.7. Samples: 132848948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:31,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-6.208')] [2023-12-27 21:05:31,299][106225] Updated weights for policy 1, policy_version 259586 (0.0007) [2023-12-27 21:05:31,367][106225] Updated weights for policy 1, policy_version 259596 (0.0008) [2023-12-27 21:05:31,436][106225] Updated weights for policy 1, policy_version 259606 (0.0006) [2023-12-27 21:05:31,497][106225] Updated weights for policy 1, policy_version 259616 (0.0006) [2023-12-27 21:05:31,638][106226] Updated weights for policy 0, policy_version 259265 (0.0009) [2023-12-27 21:05:31,700][106226] Updated weights for policy 0, policy_version 259275 (0.0008) [2023-12-27 21:05:31,772][106226] Updated weights for policy 0, policy_version 259285 (0.0009) [2023-12-27 21:05:32,092][106225] Updated weights for policy 1, policy_version 259626 (0.0007) [2023-12-27 21:05:32,155][106225] Updated weights for policy 1, policy_version 259636 (0.0006) [2023-12-27 21:05:32,216][106225] Updated weights for policy 1, policy_version 259646 (0.0005) [2023-12-27 21:05:32,541][106226] Updated weights for policy 0, policy_version 259295 (0.0009) [2023-12-27 21:05:32,604][106226] Updated weights for policy 0, policy_version 259305 (0.0009) [2023-12-27 21:05:32,667][106226] Updated weights for policy 0, policy_version 259315 (0.0009) [2023-12-27 21:05:32,867][106225] Updated weights for policy 1, policy_version 259656 (0.0008) [2023-12-27 21:05:32,915][106225] Updated weights for policy 1, policy_version 259666 (0.0008) [2023-12-27 21:05:32,959][106225] Updated weights for policy 1, policy_version 259676 (0.0008) [2023-12-27 21:05:33,407][106226] Updated weights for policy 0, policy_version 259325 (0.0009) [2023-12-27 21:05:33,463][106226] Updated weights for policy 0, policy_version 259335 (0.0008) [2023-12-27 21:05:33,513][106226] Updated weights for policy 0, policy_version 259346 (0.0009) [2023-12-27 21:05:33,590][106225] Updated weights for policy 1, policy_version 259686 (0.0007) [2023-12-27 21:05:33,646][106225] Updated weights for policy 1, policy_version 259696 (0.0005) [2023-12-27 21:05:33,699][106225] Updated weights for policy 1, policy_version 259706 (0.0005) [2023-12-27 21:05:34,310][106226] Updated weights for policy 0, policy_version 259357 (0.0010) [2023-12-27 21:05:34,333][106225] Updated weights for policy 1, policy_version 259716 (0.0008) [2023-12-27 21:05:34,371][106226] Updated weights for policy 0, policy_version 259367 (0.0008) [2023-12-27 21:05:34,396][106225] Updated weights for policy 1, policy_version 259726 (0.0009) [2023-12-27 21:05:34,423][106226] Updated weights for policy 0, policy_version 259377 (0.0007) [2023-12-27 21:05:34,460][106225] Updated weights for policy 1, policy_version 259736 (0.0010) [2023-12-27 21:05:35,083][106225] Updated weights for policy 1, policy_version 259746 (0.0009) [2023-12-27 21:05:35,132][106225] Updated weights for policy 1, policy_version 259756 (0.0007) [2023-12-27 21:05:35,181][106225] Updated weights for policy 1, policy_version 259766 (0.0010) [2023-12-27 21:05:35,192][106226] Updated weights for policy 0, policy_version 259387 (0.0008) [2023-12-27 21:05:35,239][106225] Updated weights for policy 1, policy_version 259776 (0.0010) [2023-12-27 21:05:35,251][106226] Updated weights for policy 0, policy_version 259397 (0.0007) [2023-12-27 21:05:35,301][106226] Updated weights for policy 0, policy_version 259407 (0.0008) [2023-12-27 21:05:35,935][106225] Updated weights for policy 1, policy_version 259786 (0.0010) [2023-12-27 21:05:35,991][106225] Updated weights for policy 1, policy_version 259796 (0.0010) [2023-12-27 21:05:36,052][106225] Updated weights for policy 1, policy_version 259806 (0.0010) [2023-12-27 21:05:36,064][106226] Updated weights for policy 0, policy_version 259417 (0.0008) [2023-12-27 21:05:36,129][106226] Updated weights for policy 0, policy_version 259427 (0.0008) [2023-12-27 21:05:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 132956160. Throughput: 0: 9631.3, 1: 10068.1. Samples: 132966616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:36,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-6.279')] [2023-12-27 21:05:36,194][106226] Updated weights for policy 0, policy_version 259437 (0.0008) [2023-12-27 21:05:36,257][106226] Updated weights for policy 0, policy_version 259447 (0.0008) [2023-12-27 21:05:36,771][106225] Updated weights for policy 1, policy_version 259816 (0.0007) [2023-12-27 21:05:36,833][106225] Updated weights for policy 1, policy_version 259826 (0.0006) [2023-12-27 21:05:36,897][106225] Updated weights for policy 1, policy_version 259836 (0.0006) [2023-12-27 21:05:37,005][106226] Updated weights for policy 0, policy_version 259457 (0.0008) [2023-12-27 21:05:37,065][106226] Updated weights for policy 0, policy_version 259467 (0.0008) [2023-12-27 21:05:37,122][106226] Updated weights for policy 0, policy_version 259477 (0.0009) [2023-12-27 21:05:37,471][106225] Updated weights for policy 1, policy_version 259846 (0.0005) [2023-12-27 21:05:37,526][106225] Updated weights for policy 1, policy_version 259856 (0.0005) [2023-12-27 21:05:37,580][106225] Updated weights for policy 1, policy_version 259866 (0.0005) [2023-12-27 21:05:37,967][106226] Updated weights for policy 0, policy_version 259487 (0.0008) [2023-12-27 21:05:38,021][106226] Updated weights for policy 0, policy_version 259497 (0.0009) [2023-12-27 21:05:38,075][106226] Updated weights for policy 0, policy_version 259507 (0.0007) [2023-12-27 21:05:38,107][106225] Updated weights for policy 1, policy_version 259876 (0.0007) [2023-12-27 21:05:38,154][106225] Updated weights for policy 1, policy_version 259886 (0.0010) [2023-12-27 21:05:38,211][106225] Updated weights for policy 1, policy_version 259896 (0.0009) [2023-12-27 21:05:38,877][106225] Updated weights for policy 1, policy_version 259906 (0.0006) [2023-12-27 21:05:38,903][106226] Updated weights for policy 0, policy_version 259517 (0.0008) [2023-12-27 21:05:38,936][106225] Updated weights for policy 1, policy_version 259916 (0.0007) [2023-12-27 21:05:38,965][106226] Updated weights for policy 0, policy_version 259527 (0.0006) [2023-12-27 21:05:38,998][106225] Updated weights for policy 1, policy_version 259926 (0.0008) [2023-12-27 21:05:39,023][106226] Updated weights for policy 0, policy_version 259537 (0.0006) [2023-12-27 21:05:39,059][106225] Updated weights for policy 1, policy_version 259936 (0.0007) [2023-12-27 21:05:39,721][106226] Updated weights for policy 0, policy_version 259547 (0.0006) [2023-12-27 21:05:39,789][106226] Updated weights for policy 0, policy_version 259557 (0.0009) [2023-12-27 21:05:39,855][106226] Updated weights for policy 0, policy_version 259567 (0.0010) [2023-12-27 21:05:39,861][106225] Updated weights for policy 1, policy_version 259946 (0.0009) [2023-12-27 21:05:39,928][106225] Updated weights for policy 1, policy_version 259956 (0.0008) [2023-12-27 21:05:39,987][106225] Updated weights for policy 1, policy_version 259966 (0.0008) [2023-12-27 21:05:40,613][106226] Updated weights for policy 0, policy_version 259577 (0.0009) [2023-12-27 21:05:40,668][106226] Updated weights for policy 0, policy_version 259587 (0.0009) [2023-12-27 21:05:40,719][106225] Updated weights for policy 1, policy_version 259976 (0.0007) [2023-12-27 21:05:40,725][106226] Updated weights for policy 0, policy_version 259597 (0.0008) [2023-12-27 21:05:40,783][106226] Updated weights for policy 0, policy_version 259607 (0.0005) [2023-12-27 21:05:40,784][106225] Updated weights for policy 1, policy_version 259986 (0.0008) [2023-12-27 21:05:40,842][106225] Updated weights for policy 1, policy_version 259996 (0.0008) [2023-12-27 21:05:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 133054464. Throughput: 0: 9522.2, 1: 10165.9. Samples: 133025080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:41,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-5.923')] [2023-12-27 21:05:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000260000_66576384.pth... [2023-12-27 21:05:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000259608_66478080.pth... [2023-12-27 21:05:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000258520_66199552.pth [2023-12-27 21:05:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000258816_66273280.pth [2023-12-27 21:05:41,525][106226] Updated weights for policy 0, policy_version 259617 (0.0008) [2023-12-27 21:05:41,580][106226] Updated weights for policy 0, policy_version 259627 (0.0008) [2023-12-27 21:05:41,580][106225] Updated weights for policy 1, policy_version 260006 (0.0008) [2023-12-27 21:05:41,650][106225] Updated weights for policy 1, policy_version 260016 (0.0009) [2023-12-27 21:05:41,658][106226] Updated weights for policy 0, policy_version 259637 (0.0008) [2023-12-27 21:05:41,717][106225] Updated weights for policy 1, policy_version 260026 (0.0009) [2023-12-27 21:05:42,360][106226] Updated weights for policy 0, policy_version 259647 (0.0008) [2023-12-27 21:05:42,432][106226] Updated weights for policy 0, policy_version 259657 (0.0011) [2023-12-27 21:05:42,498][106226] Updated weights for policy 0, policy_version 259667 (0.0010) [2023-12-27 21:05:42,534][106225] Updated weights for policy 1, policy_version 260036 (0.0007) [2023-12-27 21:05:42,597][106225] Updated weights for policy 1, policy_version 260046 (0.0005) [2023-12-27 21:05:42,653][106225] Updated weights for policy 1, policy_version 260056 (0.0007) [2023-12-27 21:05:43,162][106226] Updated weights for policy 0, policy_version 259677 (0.0009) [2023-12-27 21:05:43,219][106226] Updated weights for policy 0, policy_version 259687 (0.0010) [2023-12-27 21:05:43,282][106226] Updated weights for policy 0, policy_version 259697 (0.0010) [2023-12-27 21:05:43,365][106225] Updated weights for policy 1, policy_version 260066 (0.0008) [2023-12-27 21:05:43,418][106225] Updated weights for policy 1, policy_version 260076 (0.0010) [2023-12-27 21:05:43,471][106225] Updated weights for policy 1, policy_version 260086 (0.0009) [2023-12-27 21:05:43,519][106225] Updated weights for policy 1, policy_version 260096 (0.0008) [2023-12-27 21:05:43,915][106226] Updated weights for policy 0, policy_version 259707 (0.0010) [2023-12-27 21:05:43,972][106226] Updated weights for policy 0, policy_version 259717 (0.0010) [2023-12-27 21:05:44,028][106226] Updated weights for policy 0, policy_version 259727 (0.0010) [2023-12-27 21:05:44,288][106225] Updated weights for policy 1, policy_version 260106 (0.0009) [2023-12-27 21:05:44,350][106225] Updated weights for policy 1, policy_version 260116 (0.0008) [2023-12-27 21:05:44,405][106225] Updated weights for policy 1, policy_version 260126 (0.0008) [2023-12-27 21:05:44,652][106226] Updated weights for policy 0, policy_version 259737 (0.0010) [2023-12-27 21:05:44,706][106226] Updated weights for policy 0, policy_version 259747 (0.0007) [2023-12-27 21:05:44,759][106226] Updated weights for policy 0, policy_version 259757 (0.0008) [2023-12-27 21:05:44,827][106226] Updated weights for policy 0, policy_version 259767 (0.0008) [2023-12-27 21:05:45,152][106225] Updated weights for policy 1, policy_version 260136 (0.0008) [2023-12-27 21:05:45,219][106225] Updated weights for policy 1, policy_version 260146 (0.0010) [2023-12-27 21:05:45,285][106225] Updated weights for policy 1, policy_version 260156 (0.0008) [2023-12-27 21:05:45,479][106226] Updated weights for policy 0, policy_version 259777 (0.0008) [2023-12-27 21:05:45,539][106226] Updated weights for policy 0, policy_version 259787 (0.0008) [2023-12-27 21:05:45,605][106226] Updated weights for policy 0, policy_version 259797 (0.0008) [2023-12-27 21:05:46,019][106225] Updated weights for policy 1, policy_version 260166 (0.0009) [2023-12-27 21:05:46,072][106225] Updated weights for policy 1, policy_version 260176 (0.0008) [2023-12-27 21:05:46,134][106225] Updated weights for policy 1, policy_version 260186 (0.0008) [2023-12-27 21:05:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 133152768. Throughput: 0: 9543.5, 1: 10050.2. Samples: 133139784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:46,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-6.209')] [2023-12-27 21:05:46,329][106226] Updated weights for policy 0, policy_version 259807 (0.0008) [2023-12-27 21:05:46,385][106226] Updated weights for policy 0, policy_version 259817 (0.0009) [2023-12-27 21:05:46,441][106226] Updated weights for policy 0, policy_version 259827 (0.0007) [2023-12-27 21:05:46,867][106225] Updated weights for policy 1, policy_version 260196 (0.0008) [2023-12-27 21:05:46,928][106225] Updated weights for policy 1, policy_version 260206 (0.0009) [2023-12-27 21:05:46,985][106225] Updated weights for policy 1, policy_version 260216 (0.0008) [2023-12-27 21:05:47,100][106226] Updated weights for policy 0, policy_version 259837 (0.0007) [2023-12-27 21:05:47,159][106226] Updated weights for policy 0, policy_version 259847 (0.0008) [2023-12-27 21:05:47,217][106226] Updated weights for policy 0, policy_version 259857 (0.0009) [2023-12-27 21:05:47,600][106225] Updated weights for policy 1, policy_version 260226 (0.0007) [2023-12-27 21:05:47,650][106225] Updated weights for policy 1, policy_version 260236 (0.0005) [2023-12-27 21:05:47,704][106225] Updated weights for policy 1, policy_version 260246 (0.0005) [2023-12-27 21:05:47,758][106225] Updated weights for policy 1, policy_version 260256 (0.0009) [2023-12-27 21:05:47,947][106226] Updated weights for policy 0, policy_version 259867 (0.0008) [2023-12-27 21:05:47,994][106226] Updated weights for policy 0, policy_version 259877 (0.0008) [2023-12-27 21:05:48,046][106226] Updated weights for policy 0, policy_version 259887 (0.0008) [2023-12-27 21:05:48,499][106225] Updated weights for policy 1, policy_version 260266 (0.0010) [2023-12-27 21:05:48,565][106225] Updated weights for policy 1, policy_version 260276 (0.0010) [2023-12-27 21:05:48,627][106225] Updated weights for policy 1, policy_version 260286 (0.0010) [2023-12-27 21:05:48,735][106226] Updated weights for policy 0, policy_version 259897 (0.0009) [2023-12-27 21:05:48,798][106226] Updated weights for policy 0, policy_version 259907 (0.0008) [2023-12-27 21:05:48,854][106226] Updated weights for policy 0, policy_version 259917 (0.0008) [2023-12-27 21:05:48,910][106226] Updated weights for policy 0, policy_version 259927 (0.0009) [2023-12-27 21:05:49,267][106225] Updated weights for policy 1, policy_version 260296 (0.0007) [2023-12-27 21:05:49,328][106225] Updated weights for policy 1, policy_version 260306 (0.0008) [2023-12-27 21:05:49,393][106225] Updated weights for policy 1, policy_version 260316 (0.0009) [2023-12-27 21:05:49,676][106226] Updated weights for policy 0, policy_version 259937 (0.0006) [2023-12-27 21:05:49,745][106226] Updated weights for policy 0, policy_version 259947 (0.0007) [2023-12-27 21:05:49,814][106226] Updated weights for policy 0, policy_version 259957 (0.0008) [2023-12-27 21:05:50,114][106225] Updated weights for policy 1, policy_version 260326 (0.0007) [2023-12-27 21:05:50,183][106225] Updated weights for policy 1, policy_version 260336 (0.0006) [2023-12-27 21:05:50,278][106225] Updated weights for policy 1, policy_version 260346 (0.0008) [2023-12-27 21:05:50,531][106226] Updated weights for policy 0, policy_version 259967 (0.0007) [2023-12-27 21:05:50,600][106226] Updated weights for policy 0, policy_version 259977 (0.0007) [2023-12-27 21:05:50,665][106226] Updated weights for policy 0, policy_version 259987 (0.0007) [2023-12-27 21:05:50,888][106225] Updated weights for policy 1, policy_version 260356 (0.0005) [2023-12-27 21:05:50,950][106225] Updated weights for policy 1, policy_version 260366 (0.0008) [2023-12-27 21:05:51,011][106225] Updated weights for policy 1, policy_version 260376 (0.0010) [2023-12-27 21:05:51,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 133251072. Throughput: 0: 9541.0, 1: 10084.9. Samples: 133259052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:51,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-5.952')] [2023-12-27 21:05:51,317][106226] Updated weights for policy 0, policy_version 259997 (0.0007) [2023-12-27 21:05:51,387][106226] Updated weights for policy 0, policy_version 260007 (0.0009) [2023-12-27 21:05:51,440][106226] Updated weights for policy 0, policy_version 260017 (0.0009) [2023-12-27 21:05:51,796][106225] Updated weights for policy 1, policy_version 260386 (0.0010) [2023-12-27 21:05:51,853][106225] Updated weights for policy 1, policy_version 260396 (0.0009) [2023-12-27 21:05:51,915][106225] Updated weights for policy 1, policy_version 260406 (0.0009) [2023-12-27 21:05:51,972][106225] Updated weights for policy 1, policy_version 260416 (0.0008) [2023-12-27 21:05:52,194][106226] Updated weights for policy 0, policy_version 260027 (0.0007) [2023-12-27 21:05:52,263][106226] Updated weights for policy 0, policy_version 260037 (0.0006) [2023-12-27 21:05:52,319][106226] Updated weights for policy 0, policy_version 260047 (0.0010) [2023-12-27 21:05:52,713][106225] Updated weights for policy 1, policy_version 260426 (0.0006) [2023-12-27 21:05:52,769][106225] Updated weights for policy 1, policy_version 260436 (0.0008) [2023-12-27 21:05:52,823][106225] Updated weights for policy 1, policy_version 260446 (0.0008) [2023-12-27 21:05:53,022][106226] Updated weights for policy 0, policy_version 260057 (0.0010) [2023-12-27 21:05:53,070][106226] Updated weights for policy 0, policy_version 260067 (0.0006) [2023-12-27 21:05:53,126][106226] Updated weights for policy 0, policy_version 260077 (0.0006) [2023-12-27 21:05:53,181][106226] Updated weights for policy 0, policy_version 260087 (0.0007) [2023-12-27 21:05:53,571][106225] Updated weights for policy 1, policy_version 260456 (0.0006) [2023-12-27 21:05:53,628][106225] Updated weights for policy 1, policy_version 260466 (0.0005) [2023-12-27 21:05:53,691][106225] Updated weights for policy 1, policy_version 260476 (0.0006) [2023-12-27 21:05:53,698][106226] Updated weights for policy 0, policy_version 260097 (0.0005) [2023-12-27 21:05:53,747][106226] Updated weights for policy 0, policy_version 260107 (0.0006) [2023-12-27 21:05:53,799][106226] Updated weights for policy 0, policy_version 260117 (0.0009) [2023-12-27 21:05:54,372][106225] Updated weights for policy 1, policy_version 260486 (0.0008) [2023-12-27 21:05:54,423][106225] Updated weights for policy 1, policy_version 260496 (0.0007) [2023-12-27 21:05:54,435][106226] Updated weights for policy 0, policy_version 260127 (0.0009) [2023-12-27 21:05:54,479][106225] Updated weights for policy 1, policy_version 260506 (0.0008) [2023-12-27 21:05:54,482][106226] Updated weights for policy 0, policy_version 260137 (0.0005) [2023-12-27 21:05:54,530][106226] Updated weights for policy 0, policy_version 260147 (0.0006) [2023-12-27 21:05:55,216][106225] Updated weights for policy 1, policy_version 260516 (0.0008) [2023-12-27 21:05:55,217][106226] Updated weights for policy 0, policy_version 260157 (0.0011) [2023-12-27 21:05:55,273][106225] Updated weights for policy 1, policy_version 260526 (0.0006) [2023-12-27 21:05:55,275][106226] Updated weights for policy 0, policy_version 260167 (0.0010) [2023-12-27 21:05:55,330][106225] Updated weights for policy 1, policy_version 260536 (0.0008) [2023-12-27 21:05:55,333][106226] Updated weights for policy 0, policy_version 260177 (0.0009) [2023-12-27 21:05:55,898][106226] Updated weights for policy 0, policy_version 260187 (0.0009) [2023-12-27 21:05:55,961][106226] Updated weights for policy 0, policy_version 260197 (0.0007) [2023-12-27 21:05:56,009][106225] Updated weights for policy 1, policy_version 260546 (0.0007) [2023-12-27 21:05:56,014][106226] Updated weights for policy 0, policy_version 260207 (0.0010) [2023-12-27 21:05:56,067][106225] Updated weights for policy 1, policy_version 260556 (0.0008) [2023-12-27 21:05:56,127][106225] Updated weights for policy 1, policy_version 260566 (0.0010) [2023-12-27 21:05:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 133349376. Throughput: 0: 9563.8, 1: 10062.4. Samples: 133319220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:05:56,175][105115] Avg episode reward: [(0, '-4.894'), (1, '-6.128')] [2023-12-27 21:05:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000260216_66633728.pth... [2023-12-27 21:05:56,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000260576_66723840.pth... [2023-12-27 21:05:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000259064_66338816.pth [2023-12-27 21:05:56,190][106225] Updated weights for policy 1, policy_version 260576 (0.0010) [2023-12-27 21:05:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000259392_66420736.pth [2023-12-27 21:05:56,690][106226] Updated weights for policy 0, policy_version 260217 (0.0010) [2023-12-27 21:05:56,759][106226] Updated weights for policy 0, policy_version 260227 (0.0009) [2023-12-27 21:05:56,821][106226] Updated weights for policy 0, policy_version 260237 (0.0010) [2023-12-27 21:05:56,833][106225] Updated weights for policy 1, policy_version 260586 (0.0010) [2023-12-27 21:05:56,873][106226] Updated weights for policy 0, policy_version 260247 (0.0010) [2023-12-27 21:05:56,886][106225] Updated weights for policy 1, policy_version 260596 (0.0010) [2023-12-27 21:05:56,948][106225] Updated weights for policy 1, policy_version 260606 (0.0009) [2023-12-27 21:05:57,519][106225] Updated weights for policy 1, policy_version 260616 (0.0009) [2023-12-27 21:05:57,556][106226] Updated weights for policy 0, policy_version 260257 (0.0010) [2023-12-27 21:05:57,578][106225] Updated weights for policy 1, policy_version 260626 (0.0010) [2023-12-27 21:05:57,605][106226] Updated weights for policy 0, policy_version 260267 (0.0010) [2023-12-27 21:05:57,627][106225] Updated weights for policy 1, policy_version 260636 (0.0010) [2023-12-27 21:05:57,654][106226] Updated weights for policy 0, policy_version 260277 (0.0010) [2023-12-27 21:05:58,290][106226] Updated weights for policy 0, policy_version 260287 (0.0011) [2023-12-27 21:05:58,351][106226] Updated weights for policy 0, policy_version 260297 (0.0011) [2023-12-27 21:05:58,360][106225] Updated weights for policy 1, policy_version 260646 (0.0009) [2023-12-27 21:05:58,419][106226] Updated weights for policy 0, policy_version 260307 (0.0010) [2023-12-27 21:05:58,424][106225] Updated weights for policy 1, policy_version 260656 (0.0007) [2023-12-27 21:05:58,489][106225] Updated weights for policy 1, policy_version 260666 (0.0006) [2023-12-27 21:05:59,276][106225] Updated weights for policy 1, policy_version 260676 (0.0008) [2023-12-27 21:05:59,311][106226] Updated weights for policy 0, policy_version 260317 (0.0008) [2023-12-27 21:05:59,341][106225] Updated weights for policy 1, policy_version 260686 (0.0007) [2023-12-27 21:05:59,379][106226] Updated weights for policy 0, policy_version 260327 (0.0008) [2023-12-27 21:05:59,403][106225] Updated weights for policy 1, policy_version 260696 (0.0008) [2023-12-27 21:05:59,440][106226] Updated weights for policy 0, policy_version 260337 (0.0008) [2023-12-27 21:06:00,180][106225] Updated weights for policy 1, policy_version 260706 (0.0007) [2023-12-27 21:06:00,218][106226] Updated weights for policy 0, policy_version 260347 (0.0007) [2023-12-27 21:06:00,235][106225] Updated weights for policy 1, policy_version 260716 (0.0008) [2023-12-27 21:06:00,284][106226] Updated weights for policy 0, policy_version 260357 (0.0007) [2023-12-27 21:06:00,298][106225] Updated weights for policy 1, policy_version 260726 (0.0010) [2023-12-27 21:06:00,335][106226] Updated weights for policy 0, policy_version 260367 (0.0006) [2023-12-27 21:06:00,359][106225] Updated weights for policy 1, policy_version 260736 (0.0010) [2023-12-27 21:06:01,023][106225] Updated weights for policy 1, policy_version 260746 (0.0010) [2023-12-27 21:06:01,056][106226] Updated weights for policy 0, policy_version 260377 (0.0007) [2023-12-27 21:06:01,091][106225] Updated weights for policy 1, policy_version 260756 (0.0008) [2023-12-27 21:06:01,127][106226] Updated weights for policy 0, policy_version 260387 (0.0008) [2023-12-27 21:06:01,149][106225] Updated weights for policy 1, policy_version 260766 (0.0008) [2023-12-27 21:06:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 133447680. Throughput: 0: 9656.4, 1: 10038.1. Samples: 133438024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:06:01,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-6.225')] [2023-12-27 21:06:01,194][106226] Updated weights for policy 0, policy_version 260397 (0.0007) [2023-12-27 21:06:01,258][106226] Updated weights for policy 0, policy_version 260407 (0.0007) [2023-12-27 21:06:01,917][106225] Updated weights for policy 1, policy_version 260776 (0.0010) [2023-12-27 21:06:01,973][106226] Updated weights for policy 0, policy_version 260417 (0.0009) [2023-12-27 21:06:01,978][106225] Updated weights for policy 1, policy_version 260786 (0.0010) [2023-12-27 21:06:02,036][106226] Updated weights for policy 0, policy_version 260427 (0.0006) [2023-12-27 21:06:02,040][106225] Updated weights for policy 1, policy_version 260796 (0.0010) [2023-12-27 21:06:02,102][106226] Updated weights for policy 0, policy_version 260437 (0.0008) [2023-12-27 21:06:02,679][106225] Updated weights for policy 1, policy_version 260806 (0.0008) [2023-12-27 21:06:02,739][106225] Updated weights for policy 1, policy_version 260816 (0.0007) [2023-12-27 21:06:02,803][106225] Updated weights for policy 1, policy_version 260826 (0.0010) [2023-12-27 21:06:02,857][106226] Updated weights for policy 0, policy_version 260447 (0.0007) [2023-12-27 21:06:02,913][106226] Updated weights for policy 0, policy_version 260457 (0.0009) [2023-12-27 21:06:02,969][106226] Updated weights for policy 0, policy_version 260467 (0.0007) [2023-12-27 21:06:03,482][106225] Updated weights for policy 1, policy_version 260836 (0.0009) [2023-12-27 21:06:03,538][106225] Updated weights for policy 1, policy_version 260846 (0.0009) [2023-12-27 21:06:03,588][106225] Updated weights for policy 1, policy_version 260856 (0.0010) [2023-12-27 21:06:03,595][106226] Updated weights for policy 0, policy_version 260477 (0.0007) [2023-12-27 21:06:03,652][106226] Updated weights for policy 0, policy_version 260487 (0.0005) [2023-12-27 21:06:03,715][106226] Updated weights for policy 0, policy_version 260497 (0.0006) [2023-12-27 21:06:04,256][106225] Updated weights for policy 1, policy_version 260866 (0.0006) [2023-12-27 21:06:04,307][106225] Updated weights for policy 1, policy_version 260876 (0.0006) [2023-12-27 21:06:04,371][106225] Updated weights for policy 1, policy_version 260886 (0.0009) [2023-12-27 21:06:04,434][106226] Updated weights for policy 0, policy_version 260507 (0.0009) [2023-12-27 21:06:04,435][106225] Updated weights for policy 1, policy_version 260896 (0.0009) [2023-12-27 21:06:04,501][106226] Updated weights for policy 0, policy_version 260517 (0.0006) [2023-12-27 21:06:04,570][106226] Updated weights for policy 0, policy_version 260527 (0.0006) [2023-12-27 21:06:05,155][106225] Updated weights for policy 1, policy_version 260906 (0.0008) [2023-12-27 21:06:05,219][106225] Updated weights for policy 1, policy_version 260916 (0.0007) [2023-12-27 21:06:05,259][106226] Updated weights for policy 0, policy_version 260537 (0.0006) [2023-12-27 21:06:05,288][106225] Updated weights for policy 1, policy_version 260926 (0.0005) [2023-12-27 21:06:05,310][106226] Updated weights for policy 0, policy_version 260547 (0.0007) [2023-12-27 21:06:05,367][106226] Updated weights for policy 0, policy_version 260557 (0.0009) [2023-12-27 21:06:05,427][106226] Updated weights for policy 0, policy_version 260567 (0.0008) [2023-12-27 21:06:05,937][106225] Updated weights for policy 1, policy_version 260936 (0.0009) [2023-12-27 21:06:05,996][106225] Updated weights for policy 1, policy_version 260946 (0.0008) [2023-12-27 21:06:06,054][106225] Updated weights for policy 1, policy_version 260956 (0.0007) [2023-12-27 21:06:06,151][106226] Updated weights for policy 0, policy_version 260577 (0.0008) [2023-12-27 21:06:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 133545984. Throughput: 0: 9712.2, 1: 10015.8. Samples: 133556164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:06:06,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.941')] [2023-12-27 21:06:06,213][106226] Updated weights for policy 0, policy_version 260587 (0.0008) [2023-12-27 21:06:06,275][106226] Updated weights for policy 0, policy_version 260597 (0.0008) [2023-12-27 21:06:06,721][106225] Updated weights for policy 1, policy_version 260966 (0.0007) [2023-12-27 21:06:06,768][106225] Updated weights for policy 1, policy_version 260976 (0.0007) [2023-12-27 21:06:06,827][106225] Updated weights for policy 1, policy_version 260986 (0.0006) [2023-12-27 21:06:07,069][106226] Updated weights for policy 0, policy_version 260607 (0.0008) [2023-12-27 21:06:07,131][106226] Updated weights for policy 0, policy_version 260617 (0.0009) [2023-12-27 21:06:07,180][106226] Updated weights for policy 0, policy_version 260627 (0.0008) [2023-12-27 21:06:07,523][106225] Updated weights for policy 1, policy_version 260996 (0.0008) [2023-12-27 21:06:07,585][106225] Updated weights for policy 1, policy_version 261006 (0.0010) [2023-12-27 21:06:07,636][106225] Updated weights for policy 1, policy_version 261016 (0.0010) [2023-12-27 21:06:07,887][106226] Updated weights for policy 0, policy_version 260637 (0.0006) [2023-12-27 21:06:07,958][106226] Updated weights for policy 0, policy_version 260647 (0.0009) [2023-12-27 21:06:08,015][106226] Updated weights for policy 0, policy_version 260657 (0.0006) [2023-12-27 21:06:08,249][106225] Updated weights for policy 1, policy_version 261026 (0.0009) [2023-12-27 21:06:08,303][106225] Updated weights for policy 1, policy_version 261036 (0.0005) [2023-12-27 21:06:08,372][106225] Updated weights for policy 1, policy_version 261046 (0.0009) [2023-12-27 21:06:08,424][106225] Updated weights for policy 1, policy_version 261056 (0.0008) [2023-12-27 21:06:08,636][106226] Updated weights for policy 0, policy_version 260667 (0.0007) [2023-12-27 21:06:08,707][106226] Updated weights for policy 0, policy_version 260677 (0.0009) [2023-12-27 21:06:08,770][106226] Updated weights for policy 0, policy_version 260687 (0.0009) [2023-12-27 21:06:09,164][106225] Updated weights for policy 1, policy_version 261066 (0.0008) [2023-12-27 21:06:09,227][106225] Updated weights for policy 1, policy_version 261076 (0.0008) [2023-12-27 21:06:09,288][106225] Updated weights for policy 1, policy_version 261086 (0.0009) [2023-12-27 21:06:09,559][106226] Updated weights for policy 0, policy_version 260697 (0.0009) [2023-12-27 21:06:09,620][106226] Updated weights for policy 0, policy_version 260707 (0.0010) [2023-12-27 21:06:09,679][106226] Updated weights for policy 0, policy_version 260717 (0.0010) [2023-12-27 21:06:09,741][106226] Updated weights for policy 0, policy_version 260727 (0.0009) [2023-12-27 21:06:09,992][106225] Updated weights for policy 1, policy_version 261096 (0.0009) [2023-12-27 21:06:10,053][106225] Updated weights for policy 1, policy_version 261106 (0.0010) [2023-12-27 21:06:10,112][106225] Updated weights for policy 1, policy_version 261116 (0.0010) [2023-12-27 21:06:10,516][106226] Updated weights for policy 0, policy_version 260737 (0.0009) [2023-12-27 21:06:10,574][106226] Updated weights for policy 0, policy_version 260747 (0.0008) [2023-12-27 21:06:10,637][106226] Updated weights for policy 0, policy_version 260757 (0.0008) [2023-12-27 21:06:10,847][106225] Updated weights for policy 1, policy_version 261126 (0.0007) [2023-12-27 21:06:10,918][106225] Updated weights for policy 1, policy_version 261136 (0.0006) [2023-12-27 21:06:10,989][106225] Updated weights for policy 1, policy_version 261146 (0.0005) [2023-12-27 21:06:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 133644288. Throughput: 0: 9725.4, 1: 10060.2. Samples: 133615752. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:11,175][105115] Avg episode reward: [(0, '-5.025'), (1, '-5.873')] [2023-12-27 21:06:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000261152_66871296.pth... [2023-12-27 21:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000260760_66772992.pth... [2023-12-27 21:06:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000260000_66576384.pth [2023-12-27 21:06:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000259608_66478080.pth [2023-12-27 21:06:11,461][106226] Updated weights for policy 0, policy_version 260767 (0.0007) [2023-12-27 21:06:11,521][106226] Updated weights for policy 0, policy_version 260777 (0.0008) [2023-12-27 21:06:11,583][106226] Updated weights for policy 0, policy_version 260787 (0.0007) [2023-12-27 21:06:11,668][106225] Updated weights for policy 1, policy_version 261156 (0.0007) [2023-12-27 21:06:11,739][106225] Updated weights for policy 1, policy_version 261166 (0.0008) [2023-12-27 21:06:11,803][106225] Updated weights for policy 1, policy_version 261176 (0.0006) [2023-12-27 21:06:12,334][106226] Updated weights for policy 0, policy_version 260797 (0.0008) [2023-12-27 21:06:12,408][106226] Updated weights for policy 0, policy_version 260807 (0.0008) [2023-12-27 21:06:12,447][106225] Updated weights for policy 1, policy_version 261186 (0.0006) [2023-12-27 21:06:12,473][106226] Updated weights for policy 0, policy_version 260817 (0.0007) [2023-12-27 21:06:12,511][106225] Updated weights for policy 1, policy_version 261196 (0.0007) [2023-12-27 21:06:12,569][106225] Updated weights for policy 1, policy_version 261206 (0.0008) [2023-12-27 21:06:12,621][106225] Updated weights for policy 1, policy_version 261216 (0.0009) [2023-12-27 21:06:13,025][106226] Updated weights for policy 0, policy_version 260827 (0.0007) [2023-12-27 21:06:13,077][106226] Updated weights for policy 0, policy_version 260837 (0.0008) [2023-12-27 21:06:13,121][106226] Updated weights for policy 0, policy_version 260847 (0.0008) [2023-12-27 21:06:13,430][106225] Updated weights for policy 1, policy_version 261226 (0.0006) [2023-12-27 21:06:13,495][106225] Updated weights for policy 1, policy_version 261236 (0.0005) [2023-12-27 21:06:13,556][106225] Updated weights for policy 1, policy_version 261246 (0.0005) [2023-12-27 21:06:13,828][106226] Updated weights for policy 0, policy_version 260857 (0.0008) [2023-12-27 21:06:13,887][106226] Updated weights for policy 0, policy_version 260867 (0.0005) [2023-12-27 21:06:13,951][106226] Updated weights for policy 0, policy_version 260877 (0.0005) [2023-12-27 21:06:14,015][106226] Updated weights for policy 0, policy_version 260887 (0.0006) [2023-12-27 21:06:14,090][106225] Updated weights for policy 1, policy_version 261256 (0.0009) [2023-12-27 21:06:14,138][106225] Updated weights for policy 1, policy_version 261266 (0.0010) [2023-12-27 21:06:14,187][106225] Updated weights for policy 1, policy_version 261276 (0.0005) [2023-12-27 21:06:14,648][106226] Updated weights for policy 0, policy_version 260897 (0.0010) [2023-12-27 21:06:14,712][106226] Updated weights for policy 0, policy_version 260907 (0.0010) [2023-12-27 21:06:14,776][106226] Updated weights for policy 0, policy_version 260917 (0.0007) [2023-12-27 21:06:14,920][106225] Updated weights for policy 1, policy_version 261286 (0.0007) [2023-12-27 21:06:14,991][106225] Updated weights for policy 1, policy_version 261296 (0.0006) [2023-12-27 21:06:15,052][106225] Updated weights for policy 1, policy_version 261306 (0.0006) [2023-12-27 21:06:15,512][106226] Updated weights for policy 0, policy_version 260927 (0.0009) [2023-12-27 21:06:15,581][106226] Updated weights for policy 0, policy_version 260937 (0.0009) [2023-12-27 21:06:15,645][106226] Updated weights for policy 0, policy_version 260947 (0.0006) [2023-12-27 21:06:15,673][106225] Updated weights for policy 1, policy_version 261316 (0.0006) [2023-12-27 21:06:15,739][106225] Updated weights for policy 1, policy_version 261326 (0.0010) [2023-12-27 21:06:15,804][106225] Updated weights for policy 1, policy_version 261336 (0.0009) [2023-12-27 21:06:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 133742592. Throughput: 0: 9692.4, 1: 9952.1. Samples: 133732948. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:16,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-6.536')] [2023-12-27 21:06:16,190][106226] Updated weights for policy 0, policy_version 260957 (0.0006) [2023-12-27 21:06:16,250][106226] Updated weights for policy 0, policy_version 260967 (0.0005) [2023-12-27 21:06:16,311][106226] Updated weights for policy 0, policy_version 260977 (0.0005) [2023-12-27 21:06:16,439][106225] Updated weights for policy 1, policy_version 261346 (0.0009) [2023-12-27 21:06:16,501][106225] Updated weights for policy 1, policy_version 261356 (0.0010) [2023-12-27 21:06:16,554][106225] Updated weights for policy 1, policy_version 261366 (0.0010) [2023-12-27 21:06:16,603][106225] Updated weights for policy 1, policy_version 261376 (0.0006) [2023-12-27 21:06:16,867][106226] Updated weights for policy 0, policy_version 260987 (0.0006) [2023-12-27 21:06:16,920][106226] Updated weights for policy 0, policy_version 260997 (0.0006) [2023-12-27 21:06:16,969][106226] Updated weights for policy 0, policy_version 261007 (0.0005) [2023-12-27 21:06:17,237][106225] Updated weights for policy 1, policy_version 261386 (0.0006) [2023-12-27 21:06:17,295][106225] Updated weights for policy 1, policy_version 261396 (0.0008) [2023-12-27 21:06:17,350][106225] Updated weights for policy 1, policy_version 261406 (0.0008) [2023-12-27 21:06:17,612][106226] Updated weights for policy 0, policy_version 261017 (0.0006) [2023-12-27 21:06:17,662][106226] Updated weights for policy 0, policy_version 261027 (0.0008) [2023-12-27 21:06:17,719][106226] Updated weights for policy 0, policy_version 261037 (0.0010) [2023-12-27 21:06:17,767][106226] Updated weights for policy 0, policy_version 261047 (0.0008) [2023-12-27 21:06:17,936][106225] Updated weights for policy 1, policy_version 261416 (0.0007) [2023-12-27 21:06:17,989][106225] Updated weights for policy 1, policy_version 261426 (0.0005) [2023-12-27 21:06:18,042][106225] Updated weights for policy 1, policy_version 261436 (0.0006) [2023-12-27 21:06:18,629][106226] Updated weights for policy 0, policy_version 261057 (0.0009) [2023-12-27 21:06:18,653][106225] Updated weights for policy 1, policy_version 261446 (0.0006) [2023-12-27 21:06:18,697][106226] Updated weights for policy 0, policy_version 261067 (0.0007) [2023-12-27 21:06:18,718][106225] Updated weights for policy 1, policy_version 261456 (0.0006) [2023-12-27 21:06:18,764][106226] Updated weights for policy 0, policy_version 261077 (0.0009) [2023-12-27 21:06:18,777][106225] Updated weights for policy 1, policy_version 261466 (0.0005) [2023-12-27 21:06:19,443][106225] Updated weights for policy 1, policy_version 261476 (0.0006) [2023-12-27 21:06:19,519][106225] Updated weights for policy 1, policy_version 261486 (0.0007) [2023-12-27 21:06:19,542][106226] Updated weights for policy 0, policy_version 261087 (0.0007) [2023-12-27 21:06:19,585][106225] Updated weights for policy 1, policy_version 261496 (0.0008) [2023-12-27 21:06:19,605][106226] Updated weights for policy 0, policy_version 261097 (0.0008) [2023-12-27 21:06:19,667][106226] Updated weights for policy 0, policy_version 261107 (0.0007) [2023-12-27 21:06:20,249][106225] Updated weights for policy 1, policy_version 261506 (0.0007) [2023-12-27 21:06:20,310][106225] Updated weights for policy 1, policy_version 261516 (0.0005) [2023-12-27 21:06:20,382][106225] Updated weights for policy 1, policy_version 261526 (0.0007) [2023-12-27 21:06:20,439][106225] Updated weights for policy 1, policy_version 261536 (0.0009) [2023-12-27 21:06:20,470][106226] Updated weights for policy 0, policy_version 261117 (0.0007) [2023-12-27 21:06:20,520][106226] Updated weights for policy 0, policy_version 261127 (0.0009) [2023-12-27 21:06:20,571][106226] Updated weights for policy 0, policy_version 261137 (0.0008) [2023-12-27 21:06:21,135][106225] Updated weights for policy 1, policy_version 261546 (0.0009) [2023-12-27 21:06:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.5). Total num frames: 133840896. Throughput: 0: 9754.1, 1: 9990.6. Samples: 133855128. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:21,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-6.007')] [2023-12-27 21:06:21,188][106225] Updated weights for policy 1, policy_version 261556 (0.0009) [2023-12-27 21:06:21,252][106225] Updated weights for policy 1, policy_version 261566 (0.0007) [2023-12-27 21:06:21,369][106226] Updated weights for policy 0, policy_version 261147 (0.0008) [2023-12-27 21:06:21,444][106226] Updated weights for policy 0, policy_version 261157 (0.0010) [2023-12-27 21:06:21,515][106226] Updated weights for policy 0, policy_version 261167 (0.0011) [2023-12-27 21:06:22,043][106225] Updated weights for policy 1, policy_version 261576 (0.0007) [2023-12-27 21:06:22,103][106225] Updated weights for policy 1, policy_version 261586 (0.0005) [2023-12-27 21:06:22,169][106225] Updated weights for policy 1, policy_version 261596 (0.0005) [2023-12-27 21:06:22,254][106226] Updated weights for policy 0, policy_version 261177 (0.0011) [2023-12-27 21:06:22,316][106226] Updated weights for policy 0, policy_version 261187 (0.0009) [2023-12-27 21:06:22,392][106226] Updated weights for policy 0, policy_version 261197 (0.0008) [2023-12-27 21:06:22,453][106226] Updated weights for policy 0, policy_version 261207 (0.0009) [2023-12-27 21:06:22,840][106225] Updated weights for policy 1, policy_version 261606 (0.0007) [2023-12-27 21:06:22,905][106225] Updated weights for policy 1, policy_version 261616 (0.0009) [2023-12-27 21:06:22,954][106225] Updated weights for policy 1, policy_version 261626 (0.0009) [2023-12-27 21:06:23,147][106226] Updated weights for policy 0, policy_version 261217 (0.0008) [2023-12-27 21:06:23,204][106226] Updated weights for policy 0, policy_version 261227 (0.0009) [2023-12-27 21:06:23,258][106226] Updated weights for policy 0, policy_version 261237 (0.0009) [2023-12-27 21:06:23,674][106225] Updated weights for policy 1, policy_version 261636 (0.0008) [2023-12-27 21:06:23,739][106225] Updated weights for policy 1, policy_version 261646 (0.0005) [2023-12-27 21:06:23,791][106225] Updated weights for policy 1, policy_version 261656 (0.0008) [2023-12-27 21:06:24,012][106226] Updated weights for policy 0, policy_version 261247 (0.0009) [2023-12-27 21:06:24,064][106226] Updated weights for policy 0, policy_version 261258 (0.0010) [2023-12-27 21:06:24,121][106226] Updated weights for policy 0, policy_version 261268 (0.0010) [2023-12-27 21:06:24,404][106225] Updated weights for policy 1, policy_version 261666 (0.0009) [2023-12-27 21:06:24,460][106225] Updated weights for policy 1, policy_version 261676 (0.0008) [2023-12-27 21:06:24,520][106225] Updated weights for policy 1, policy_version 261686 (0.0008) [2023-12-27 21:06:24,579][106225] Updated weights for policy 1, policy_version 261696 (0.0008) [2023-12-27 21:06:24,842][106226] Updated weights for policy 0, policy_version 261278 (0.0007) [2023-12-27 21:06:24,889][106226] Updated weights for policy 0, policy_version 261288 (0.0008) [2023-12-27 21:06:24,941][106226] Updated weights for policy 0, policy_version 261298 (0.0008) [2023-12-27 21:06:25,236][106225] Updated weights for policy 1, policy_version 261706 (0.0010) [2023-12-27 21:06:25,295][106225] Updated weights for policy 1, policy_version 261716 (0.0009) [2023-12-27 21:06:25,360][106225] Updated weights for policy 1, policy_version 261726 (0.0005) [2023-12-27 21:06:25,598][106226] Updated weights for policy 0, policy_version 261308 (0.0008) [2023-12-27 21:06:25,651][106226] Updated weights for policy 0, policy_version 261318 (0.0006) [2023-12-27 21:06:25,708][106226] Updated weights for policy 0, policy_version 261328 (0.0011) [2023-12-27 21:06:25,941][106225] Updated weights for policy 1, policy_version 261736 (0.0009) [2023-12-27 21:06:26,002][106225] Updated weights for policy 1, policy_version 261746 (0.0008) [2023-12-27 21:06:26,073][106225] Updated weights for policy 1, policy_version 261756 (0.0009) [2023-12-27 21:06:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 133947392. Throughput: 0: 9816.5, 1: 9899.7. Samples: 133912312. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:26,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-6.074')] [2023-12-27 21:06:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000261336_66920448.pth... [2023-12-27 21:06:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000261760_67026944.pth... [2023-12-27 21:06:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000260216_66633728.pth [2023-12-27 21:06:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000260576_66723840.pth [2023-12-27 21:06:26,340][106226] Updated weights for policy 0, policy_version 261338 (0.0010) [2023-12-27 21:06:26,402][106226] Updated weights for policy 0, policy_version 261348 (0.0011) [2023-12-27 21:06:26,467][106226] Updated weights for policy 0, policy_version 261358 (0.0011) [2023-12-27 21:06:26,519][106226] Updated weights for policy 0, policy_version 261368 (0.0007) [2023-12-27 21:06:26,773][106225] Updated weights for policy 1, policy_version 261766 (0.0010) [2023-12-27 21:06:26,815][106225] Updated weights for policy 1, policy_version 261776 (0.0010) [2023-12-27 21:06:26,862][106225] Updated weights for policy 1, policy_version 261786 (0.0010) [2023-12-27 21:06:27,139][106226] Updated weights for policy 0, policy_version 261378 (0.0008) [2023-12-27 21:06:27,206][106226] Updated weights for policy 0, policy_version 261388 (0.0006) [2023-12-27 21:06:27,272][106226] Updated weights for policy 0, policy_version 261398 (0.0005) [2023-12-27 21:06:27,532][106225] Updated weights for policy 1, policy_version 261796 (0.0008) [2023-12-27 21:06:27,582][106225] Updated weights for policy 1, policy_version 261806 (0.0009) [2023-12-27 21:06:27,628][106225] Updated weights for policy 1, policy_version 261816 (0.0010) [2023-12-27 21:06:27,889][106226] Updated weights for policy 0, policy_version 261408 (0.0005) [2023-12-27 21:06:27,942][106226] Updated weights for policy 0, policy_version 261418 (0.0007) [2023-12-27 21:06:27,996][106226] Updated weights for policy 0, policy_version 261428 (0.0008) [2023-12-27 21:06:28,309][106225] Updated weights for policy 1, policy_version 261826 (0.0010) [2023-12-27 21:06:28,377][106225] Updated weights for policy 1, policy_version 261836 (0.0009) [2023-12-27 21:06:28,438][106225] Updated weights for policy 1, policy_version 261846 (0.0008) [2023-12-27 21:06:28,493][106225] Updated weights for policy 1, policy_version 261856 (0.0008) [2023-12-27 21:06:28,700][106226] Updated weights for policy 0, policy_version 261438 (0.0008) [2023-12-27 21:06:28,756][106226] Updated weights for policy 0, policy_version 261448 (0.0009) [2023-12-27 21:06:28,822][106226] Updated weights for policy 0, policy_version 261458 (0.0009) [2023-12-27 21:06:29,252][106225] Updated weights for policy 1, policy_version 261866 (0.0009) [2023-12-27 21:06:29,311][106225] Updated weights for policy 1, policy_version 261876 (0.0006) [2023-12-27 21:06:29,379][106225] Updated weights for policy 1, policy_version 261886 (0.0008) [2023-12-27 21:06:29,511][106226] Updated weights for policy 0, policy_version 261468 (0.0009) [2023-12-27 21:06:29,571][106226] Updated weights for policy 0, policy_version 261478 (0.0006) [2023-12-27 21:06:29,635][106226] Updated weights for policy 0, policy_version 261488 (0.0006) [2023-12-27 21:06:30,088][106225] Updated weights for policy 1, policy_version 261896 (0.0008) [2023-12-27 21:06:30,144][106225] Updated weights for policy 1, policy_version 261906 (0.0008) [2023-12-27 21:06:30,209][106225] Updated weights for policy 1, policy_version 261916 (0.0009) [2023-12-27 21:06:30,281][106226] Updated weights for policy 0, policy_version 261498 (0.0006) [2023-12-27 21:06:30,345][106226] Updated weights for policy 0, policy_version 261508 (0.0008) [2023-12-27 21:06:30,411][106226] Updated weights for policy 0, policy_version 261518 (0.0008) [2023-12-27 21:06:30,475][106226] Updated weights for policy 0, policy_version 261528 (0.0009) [2023-12-27 21:06:30,870][106225] Updated weights for policy 1, policy_version 261926 (0.0007) [2023-12-27 21:06:30,926][106225] Updated weights for policy 1, policy_version 261936 (0.0010) [2023-12-27 21:06:30,988][106225] Updated weights for policy 1, policy_version 261946 (0.0010) [2023-12-27 21:06:31,123][106226] Updated weights for policy 0, policy_version 261538 (0.0007) [2023-12-27 21:06:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 134045696. Throughput: 0: 9888.8, 1: 10045.3. Samples: 134036820. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:31,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.923')] [2023-12-27 21:06:31,199][106226] Updated weights for policy 0, policy_version 261548 (0.0007) [2023-12-27 21:06:31,268][106226] Updated weights for policy 0, policy_version 261558 (0.0008) [2023-12-27 21:06:31,723][106225] Updated weights for policy 1, policy_version 261956 (0.0010) [2023-12-27 21:06:31,782][106225] Updated weights for policy 1, policy_version 261966 (0.0008) [2023-12-27 21:06:31,832][106225] Updated weights for policy 1, policy_version 261976 (0.0008) [2023-12-27 21:06:31,980][106226] Updated weights for policy 0, policy_version 261568 (0.0011) [2023-12-27 21:06:32,038][106226] Updated weights for policy 0, policy_version 261578 (0.0011) [2023-12-27 21:06:32,095][106226] Updated weights for policy 0, policy_version 261588 (0.0010) [2023-12-27 21:06:32,471][106225] Updated weights for policy 1, policy_version 261986 (0.0007) [2023-12-27 21:06:32,535][106225] Updated weights for policy 1, policy_version 261996 (0.0009) [2023-12-27 21:06:32,602][106225] Updated weights for policy 1, policy_version 262006 (0.0010) [2023-12-27 21:06:32,666][106225] Updated weights for policy 1, policy_version 262016 (0.0010) [2023-12-27 21:06:32,860][106226] Updated weights for policy 0, policy_version 261598 (0.0011) [2023-12-27 21:06:32,917][106226] Updated weights for policy 0, policy_version 261608 (0.0010) [2023-12-27 21:06:32,965][106226] Updated weights for policy 0, policy_version 261618 (0.0010) [2023-12-27 21:06:33,325][106225] Updated weights for policy 1, policy_version 262026 (0.0010) [2023-12-27 21:06:33,388][106225] Updated weights for policy 1, policy_version 262036 (0.0010) [2023-12-27 21:06:33,445][106225] Updated weights for policy 1, policy_version 262046 (0.0009) [2023-12-27 21:06:33,607][106226] Updated weights for policy 0, policy_version 261628 (0.0010) [2023-12-27 21:06:33,670][106226] Updated weights for policy 0, policy_version 261638 (0.0005) [2023-12-27 21:06:33,724][106226] Updated weights for policy 0, policy_version 261648 (0.0005) [2023-12-27 21:06:34,108][106225] Updated weights for policy 1, policy_version 262056 (0.0007) [2023-12-27 21:06:34,167][106225] Updated weights for policy 1, policy_version 262066 (0.0008) [2023-12-27 21:06:34,230][106225] Updated weights for policy 1, policy_version 262076 (0.0008) [2023-12-27 21:06:34,308][106226] Updated weights for policy 0, policy_version 261658 (0.0006) [2023-12-27 21:06:34,360][106226] Updated weights for policy 0, policy_version 261668 (0.0008) [2023-12-27 21:06:34,419][106226] Updated weights for policy 0, policy_version 261678 (0.0008) [2023-12-27 21:06:34,475][106226] Updated weights for policy 0, policy_version 261688 (0.0008) [2023-12-27 21:06:34,992][106225] Updated weights for policy 1, policy_version 262086 (0.0009) [2023-12-27 21:06:35,047][106225] Updated weights for policy 1, policy_version 262096 (0.0009) [2023-12-27 21:06:35,094][106226] Updated weights for policy 0, policy_version 261698 (0.0005) [2023-12-27 21:06:35,109][106225] Updated weights for policy 1, policy_version 262106 (0.0009) [2023-12-27 21:06:35,162][106226] Updated weights for policy 0, policy_version 261708 (0.0005) [2023-12-27 21:06:35,224][106226] Updated weights for policy 0, policy_version 261718 (0.0006) [2023-12-27 21:06:35,821][106225] Updated weights for policy 1, policy_version 262116 (0.0009) [2023-12-27 21:06:35,854][106226] Updated weights for policy 0, policy_version 261728 (0.0007) [2023-12-27 21:06:35,868][106225] Updated weights for policy 1, policy_version 262126 (0.0006) [2023-12-27 21:06:35,909][106226] Updated weights for policy 0, policy_version 261738 (0.0007) [2023-12-27 21:06:35,923][106225] Updated weights for policy 1, policy_version 262136 (0.0005) [2023-12-27 21:06:35,966][106226] Updated weights for policy 0, policy_version 261748 (0.0007) [2023-12-27 21:06:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 134152192. Throughput: 0: 9926.3, 1: 10038.1. Samples: 134157452. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:36,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-5.904')] [2023-12-27 21:06:36,570][106225] Updated weights for policy 1, policy_version 262146 (0.0007) [2023-12-27 21:06:36,633][106225] Updated weights for policy 1, policy_version 262156 (0.0008) [2023-12-27 21:06:36,694][106225] Updated weights for policy 1, policy_version 262166 (0.0008) [2023-12-27 21:06:36,754][106225] Updated weights for policy 1, policy_version 262176 (0.0007) [2023-12-27 21:06:36,755][106226] Updated weights for policy 0, policy_version 261758 (0.0010) [2023-12-27 21:06:36,810][106226] Updated weights for policy 0, policy_version 261768 (0.0011) [2023-12-27 21:06:36,873][106226] Updated weights for policy 0, policy_version 261778 (0.0011) [2023-12-27 21:06:37,494][106226] Updated weights for policy 0, policy_version 261788 (0.0009) [2023-12-27 21:06:37,495][106225] Updated weights for policy 1, policy_version 262186 (0.0009) [2023-12-27 21:06:37,538][106225] Updated weights for policy 1, policy_version 262196 (0.0007) [2023-12-27 21:06:37,548][106226] Updated weights for policy 0, policy_version 261798 (0.0006) [2023-12-27 21:06:37,598][106225] Updated weights for policy 1, policy_version 262206 (0.0005) [2023-12-27 21:06:37,614][106226] Updated weights for policy 0, policy_version 261808 (0.0009) [2023-12-27 21:06:38,331][106226] Updated weights for policy 0, policy_version 261818 (0.0009) [2023-12-27 21:06:38,349][106225] Updated weights for policy 1, policy_version 262216 (0.0008) [2023-12-27 21:06:38,395][106226] Updated weights for policy 0, policy_version 261828 (0.0007) [2023-12-27 21:06:38,413][106225] Updated weights for policy 1, policy_version 262226 (0.0007) [2023-12-27 21:06:38,456][106226] Updated weights for policy 0, policy_version 261838 (0.0007) [2023-12-27 21:06:38,478][106225] Updated weights for policy 1, policy_version 262236 (0.0008) [2023-12-27 21:06:38,520][106226] Updated weights for policy 0, policy_version 261848 (0.0005) [2023-12-27 21:06:39,190][106226] Updated weights for policy 0, policy_version 261858 (0.0007) [2023-12-27 21:06:39,249][106225] Updated weights for policy 1, policy_version 262246 (0.0008) [2023-12-27 21:06:39,262][106226] Updated weights for policy 0, policy_version 261868 (0.0007) [2023-12-27 21:06:39,312][106225] Updated weights for policy 1, policy_version 262256 (0.0006) [2023-12-27 21:06:39,317][106226] Updated weights for policy 0, policy_version 261878 (0.0008) [2023-12-27 21:06:39,380][106225] Updated weights for policy 1, policy_version 262266 (0.0007) [2023-12-27 21:06:40,099][106225] Updated weights for policy 1, policy_version 262276 (0.0007) [2023-12-27 21:06:40,127][106226] Updated weights for policy 0, policy_version 261888 (0.0008) [2023-12-27 21:06:40,161][106225] Updated weights for policy 1, policy_version 262286 (0.0008) [2023-12-27 21:06:40,188][106226] Updated weights for policy 0, policy_version 261898 (0.0008) [2023-12-27 21:06:40,221][106225] Updated weights for policy 1, policy_version 262296 (0.0007) [2023-12-27 21:06:40,243][106226] Updated weights for policy 0, policy_version 261908 (0.0008) [2023-12-27 21:06:40,907][106225] Updated weights for policy 1, policy_version 262306 (0.0006) [2023-12-27 21:06:40,964][106226] Updated weights for policy 0, policy_version 261918 (0.0008) [2023-12-27 21:06:40,969][106225] Updated weights for policy 1, policy_version 262316 (0.0006) [2023-12-27 21:06:41,020][106226] Updated weights for policy 0, policy_version 261928 (0.0008) [2023-12-27 21:06:41,031][106225] Updated weights for policy 1, policy_version 262326 (0.0006) [2023-12-27 21:06:41,093][106225] Updated weights for policy 1, policy_version 262336 (0.0008) [2023-12-27 21:06:41,107][106226] Updated weights for policy 0, policy_version 261938 (0.0009) [2023-12-27 21:06:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 134250496. Throughput: 0: 9884.5, 1: 10042.7. Samples: 134215948. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:41,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-6.320')] [2023-12-27 21:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000262336_67174400.pth... [2023-12-27 21:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000261944_67076096.pth... [2023-12-27 21:06:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000261152_66871296.pth [2023-12-27 21:06:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000260760_66772992.pth [2023-12-27 21:06:41,738][106225] Updated weights for policy 1, policy_version 262346 (0.0008) [2023-12-27 21:06:41,805][106225] Updated weights for policy 1, policy_version 262356 (0.0007) [2023-12-27 21:06:41,861][106226] Updated weights for policy 0, policy_version 261948 (0.0008) [2023-12-27 21:06:41,863][106225] Updated weights for policy 1, policy_version 262366 (0.0005) [2023-12-27 21:06:41,922][106226] Updated weights for policy 0, policy_version 261958 (0.0009) [2023-12-27 21:06:41,989][106226] Updated weights for policy 0, policy_version 261968 (0.0010) [2023-12-27 21:06:42,542][106225] Updated weights for policy 1, policy_version 262376 (0.0008) [2023-12-27 21:06:42,588][106225] Updated weights for policy 1, policy_version 262386 (0.0008) [2023-12-27 21:06:42,649][106225] Updated weights for policy 1, policy_version 262396 (0.0009) [2023-12-27 21:06:42,683][106226] Updated weights for policy 0, policy_version 261978 (0.0008) [2023-12-27 21:06:42,740][106226] Updated weights for policy 0, policy_version 261988 (0.0009) [2023-12-27 21:06:42,802][106226] Updated weights for policy 0, policy_version 261998 (0.0008) [2023-12-27 21:06:42,863][106226] Updated weights for policy 0, policy_version 262008 (0.0009) [2023-12-27 21:06:43,315][106225] Updated weights for policy 1, policy_version 262406 (0.0009) [2023-12-27 21:06:43,366][106225] Updated weights for policy 1, policy_version 262416 (0.0008) [2023-12-27 21:06:43,424][106225] Updated weights for policy 1, policy_version 262426 (0.0007) [2023-12-27 21:06:43,566][106226] Updated weights for policy 0, policy_version 262018 (0.0005) [2023-12-27 21:06:43,627][106226] Updated weights for policy 0, policy_version 262028 (0.0005) [2023-12-27 21:06:43,690][106226] Updated weights for policy 0, policy_version 262038 (0.0005) [2023-12-27 21:06:44,125][106225] Updated weights for policy 1, policy_version 262436 (0.0008) [2023-12-27 21:06:44,184][106225] Updated weights for policy 1, policy_version 262446 (0.0010) [2023-12-27 21:06:44,234][106225] Updated weights for policy 1, policy_version 262456 (0.0010) [2023-12-27 21:06:44,249][106226] Updated weights for policy 0, policy_version 262048 (0.0007) [2023-12-27 21:06:44,303][106226] Updated weights for policy 0, policy_version 262058 (0.0006) [2023-12-27 21:06:44,356][106226] Updated weights for policy 0, policy_version 262068 (0.0008) [2023-12-27 21:06:44,924][106225] Updated weights for policy 1, policy_version 262466 (0.0010) [2023-12-27 21:06:44,982][106226] Updated weights for policy 0, policy_version 262078 (0.0009) [2023-12-27 21:06:44,982][106225] Updated weights for policy 1, policy_version 262476 (0.0010) [2023-12-27 21:06:45,043][106226] Updated weights for policy 0, policy_version 262088 (0.0010) [2023-12-27 21:06:45,046][106225] Updated weights for policy 1, policy_version 262486 (0.0010) [2023-12-27 21:06:45,106][106226] Updated weights for policy 0, policy_version 262098 (0.0010) [2023-12-27 21:06:45,108][106225] Updated weights for policy 1, policy_version 262496 (0.0010) [2023-12-27 21:06:45,803][106225] Updated weights for policy 1, policy_version 262506 (0.0010) [2023-12-27 21:06:45,822][106226] Updated weights for policy 0, policy_version 262108 (0.0006) [2023-12-27 21:06:45,851][106225] Updated weights for policy 1, policy_version 262516 (0.0010) [2023-12-27 21:06:45,885][106226] Updated weights for policy 0, policy_version 262118 (0.0005) [2023-12-27 21:06:45,897][106225] Updated weights for policy 1, policy_version 262526 (0.0010) [2023-12-27 21:06:45,949][106226] Updated weights for policy 0, policy_version 262128 (0.0006) [2023-12-27 21:06:46,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.7, 300 sec: 19855.2). Total num frames: 134348800. Throughput: 0: 9867.4, 1: 10062.2. Samples: 134334864. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:46,176][105115] Avg episode reward: [(0, '-4.652'), (1, '-5.834')] [2023-12-27 21:06:46,479][106226] Updated weights for policy 0, policy_version 262138 (0.0008) [2023-12-27 21:06:46,538][106226] Updated weights for policy 0, policy_version 262148 (0.0005) [2023-12-27 21:06:46,554][106225] Updated weights for policy 1, policy_version 262536 (0.0010) [2023-12-27 21:06:46,601][106226] Updated weights for policy 0, policy_version 262158 (0.0006) [2023-12-27 21:06:46,604][106225] Updated weights for policy 1, policy_version 262546 (0.0010) [2023-12-27 21:06:46,657][106225] Updated weights for policy 1, policy_version 262556 (0.0010) [2023-12-27 21:06:46,662][106226] Updated weights for policy 0, policy_version 262168 (0.0010) [2023-12-27 21:06:47,237][106225] Updated weights for policy 1, policy_version 262566 (0.0007) [2023-12-27 21:06:47,293][106225] Updated weights for policy 1, policy_version 262576 (0.0008) [2023-12-27 21:06:47,327][106226] Updated weights for policy 0, policy_version 262178 (0.0007) [2023-12-27 21:06:47,339][106225] Updated weights for policy 1, policy_version 262586 (0.0008) [2023-12-27 21:06:47,376][106226] Updated weights for policy 0, policy_version 262188 (0.0006) [2023-12-27 21:06:47,422][106226] Updated weights for policy 0, policy_version 262198 (0.0007) [2023-12-27 21:06:47,987][106225] Updated weights for policy 1, policy_version 262596 (0.0007) [2023-12-27 21:06:48,044][106225] Updated weights for policy 1, policy_version 262606 (0.0009) [2023-12-27 21:06:48,098][106225] Updated weights for policy 1, policy_version 262616 (0.0007) [2023-12-27 21:06:48,126][106226] Updated weights for policy 0, policy_version 262208 (0.0007) [2023-12-27 21:06:48,180][106226] Updated weights for policy 0, policy_version 262218 (0.0008) [2023-12-27 21:06:48,233][106226] Updated weights for policy 0, policy_version 262228 (0.0009) [2023-12-27 21:06:48,815][106225] Updated weights for policy 1, policy_version 262626 (0.0008) [2023-12-27 21:06:48,869][106225] Updated weights for policy 1, policy_version 262636 (0.0009) [2023-12-27 21:06:48,922][106225] Updated weights for policy 1, policy_version 262646 (0.0009) [2023-12-27 21:06:48,958][106226] Updated weights for policy 0, policy_version 262238 (0.0007) [2023-12-27 21:06:48,972][106225] Updated weights for policy 1, policy_version 262656 (0.0007) [2023-12-27 21:06:49,016][106226] Updated weights for policy 0, policy_version 262248 (0.0008) [2023-12-27 21:06:49,065][106226] Updated weights for policy 0, policy_version 262258 (0.0009) [2023-12-27 21:06:49,687][106225] Updated weights for policy 1, policy_version 262666 (0.0009) [2023-12-27 21:06:49,750][106225] Updated weights for policy 1, policy_version 262676 (0.0008) [2023-12-27 21:06:49,802][106226] Updated weights for policy 0, policy_version 262268 (0.0008) [2023-12-27 21:06:49,814][106225] Updated weights for policy 1, policy_version 262686 (0.0009) [2023-12-27 21:06:49,869][106226] Updated weights for policy 0, policy_version 262278 (0.0009) [2023-12-27 21:06:49,941][106226] Updated weights for policy 0, policy_version 262288 (0.0008) [2023-12-27 21:06:50,573][106225] Updated weights for policy 1, policy_version 262696 (0.0008) [2023-12-27 21:06:50,641][106225] Updated weights for policy 1, policy_version 262706 (0.0007) [2023-12-27 21:06:50,673][106226] Updated weights for policy 0, policy_version 262298 (0.0007) [2023-12-27 21:06:50,700][106225] Updated weights for policy 1, policy_version 262716 (0.0007) [2023-12-27 21:06:50,737][106226] Updated weights for policy 0, policy_version 262308 (0.0007) [2023-12-27 21:06:50,795][106226] Updated weights for policy 0, policy_version 262318 (0.0009) [2023-12-27 21:06:50,861][106226] Updated weights for policy 0, policy_version 262328 (0.0007) [2023-12-27 21:06:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 134447104. Throughput: 0: 9919.5, 1: 10071.5. Samples: 134455760. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:51,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-6.180')] [2023-12-27 21:06:51,499][106226] Updated weights for policy 0, policy_version 262338 (0.0009) [2023-12-27 21:06:51,525][106225] Updated weights for policy 1, policy_version 262726 (0.0007) [2023-12-27 21:06:51,563][106226] Updated weights for policy 0, policy_version 262348 (0.0006) [2023-12-27 21:06:51,581][106225] Updated weights for policy 1, policy_version 262736 (0.0007) [2023-12-27 21:06:51,627][106226] Updated weights for policy 0, policy_version 262358 (0.0008) [2023-12-27 21:06:51,641][106225] Updated weights for policy 1, policy_version 262746 (0.0006) [2023-12-27 21:06:52,382][106225] Updated weights for policy 1, policy_version 262756 (0.0009) [2023-12-27 21:06:52,390][106226] Updated weights for policy 0, policy_version 262368 (0.0009) [2023-12-27 21:06:52,442][106226] Updated weights for policy 0, policy_version 262378 (0.0009) [2023-12-27 21:06:52,443][106225] Updated weights for policy 1, policy_version 262766 (0.0009) [2023-12-27 21:06:52,494][106226] Updated weights for policy 0, policy_version 262388 (0.0006) [2023-12-27 21:06:52,503][106225] Updated weights for policy 1, policy_version 262776 (0.0008) [2023-12-27 21:06:53,142][106226] Updated weights for policy 0, policy_version 262398 (0.0005) [2023-12-27 21:06:53,187][106226] Updated weights for policy 0, policy_version 262408 (0.0005) [2023-12-27 21:06:53,233][106226] Updated weights for policy 0, policy_version 262418 (0.0008) [2023-12-27 21:06:53,255][106225] Updated weights for policy 1, policy_version 262786 (0.0008) [2023-12-27 21:06:53,315][106225] Updated weights for policy 1, policy_version 262796 (0.0008) [2023-12-27 21:06:53,371][106225] Updated weights for policy 1, policy_version 262806 (0.0009) [2023-12-27 21:06:53,425][106225] Updated weights for policy 1, policy_version 262816 (0.0008) [2023-12-27 21:06:53,888][106226] Updated weights for policy 0, policy_version 262428 (0.0009) [2023-12-27 21:06:53,945][106226] Updated weights for policy 0, policy_version 262438 (0.0005) [2023-12-27 21:06:54,013][106226] Updated weights for policy 0, policy_version 262448 (0.0005) [2023-12-27 21:06:54,219][106225] Updated weights for policy 1, policy_version 262826 (0.0009) [2023-12-27 21:06:54,282][106225] Updated weights for policy 1, policy_version 262836 (0.0007) [2023-12-27 21:06:54,343][106225] Updated weights for policy 1, policy_version 262846 (0.0009) [2023-12-27 21:06:54,620][106226] Updated weights for policy 0, policy_version 262458 (0.0005) [2023-12-27 21:06:54,674][106226] Updated weights for policy 0, policy_version 262468 (0.0005) [2023-12-27 21:06:54,720][106226] Updated weights for policy 0, policy_version 262478 (0.0005) [2023-12-27 21:06:54,769][106226] Updated weights for policy 0, policy_version 262488 (0.0005) [2023-12-27 21:06:55,096][106225] Updated weights for policy 1, policy_version 262856 (0.0008) [2023-12-27 21:06:55,154][106225] Updated weights for policy 1, policy_version 262866 (0.0008) [2023-12-27 21:06:55,212][106225] Updated weights for policy 1, policy_version 262876 (0.0008) [2023-12-27 21:06:55,449][106226] Updated weights for policy 0, policy_version 262498 (0.0005) [2023-12-27 21:06:55,510][106226] Updated weights for policy 0, policy_version 262508 (0.0005) [2023-12-27 21:06:55,576][106226] Updated weights for policy 0, policy_version 262518 (0.0005) [2023-12-27 21:06:55,993][106225] Updated weights for policy 1, policy_version 262886 (0.0006) [2023-12-27 21:06:56,051][106225] Updated weights for policy 1, policy_version 262896 (0.0005) [2023-12-27 21:06:56,097][106226] Updated weights for policy 0, policy_version 262528 (0.0008) [2023-12-27 21:06:56,112][106225] Updated weights for policy 1, policy_version 262906 (0.0005) [2023-12-27 21:06:56,159][106226] Updated weights for policy 0, policy_version 262538 (0.0009) [2023-12-27 21:06:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 134545408. Throughput: 0: 9965.8, 1: 9987.6. Samples: 134513656. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:06:56,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-6.063')] [2023-12-27 21:06:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000262912_67321856.pth... [2023-12-27 21:06:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000261760_67026944.pth [2023-12-27 21:06:56,210][106226] Updated weights for policy 0, policy_version 262548 (0.0009) [2023-12-27 21:06:56,228][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000262552_67231744.pth... [2023-12-27 21:06:56,231][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000261336_66920448.pth [2023-12-27 21:06:56,638][106225] Updated weights for policy 1, policy_version 262916 (0.0005) [2023-12-27 21:06:56,698][106225] Updated weights for policy 1, policy_version 262926 (0.0007) [2023-12-27 21:06:56,757][106225] Updated weights for policy 1, policy_version 262936 (0.0009) [2023-12-27 21:06:57,041][106226] Updated weights for policy 0, policy_version 262558 (0.0008) [2023-12-27 21:06:57,090][106226] Updated weights for policy 0, policy_version 262568 (0.0007) [2023-12-27 21:06:57,138][106226] Updated weights for policy 0, policy_version 262578 (0.0008) [2023-12-27 21:06:57,335][106225] Updated weights for policy 1, policy_version 262946 (0.0008) [2023-12-27 21:06:57,389][106225] Updated weights for policy 1, policy_version 262956 (0.0009) [2023-12-27 21:06:57,440][106225] Updated weights for policy 1, policy_version 262966 (0.0008) [2023-12-27 21:06:57,495][106225] Updated weights for policy 1, policy_version 262976 (0.0008) [2023-12-27 21:06:57,855][106226] Updated weights for policy 0, policy_version 262588 (0.0008) [2023-12-27 21:06:57,908][106226] Updated weights for policy 0, policy_version 262598 (0.0008) [2023-12-27 21:06:57,969][106226] Updated weights for policy 0, policy_version 262608 (0.0008) [2023-12-27 21:06:58,250][106225] Updated weights for policy 1, policy_version 262986 (0.0009) [2023-12-27 21:06:58,309][106225] Updated weights for policy 1, policy_version 262996 (0.0008) [2023-12-27 21:06:58,380][106225] Updated weights for policy 1, policy_version 263006 (0.0008) [2023-12-27 21:06:58,736][106226] Updated weights for policy 0, policy_version 262618 (0.0009) [2023-12-27 21:06:58,813][106226] Updated weights for policy 0, policy_version 262628 (0.0009) [2023-12-27 21:06:58,881][106226] Updated weights for policy 0, policy_version 262638 (0.0010) [2023-12-27 21:06:58,948][106226] Updated weights for policy 0, policy_version 262648 (0.0009) [2023-12-27 21:06:59,176][106225] Updated weights for policy 1, policy_version 263016 (0.0008) [2023-12-27 21:06:59,245][106225] Updated weights for policy 1, policy_version 263026 (0.0008) [2023-12-27 21:06:59,300][106225] Updated weights for policy 1, policy_version 263036 (0.0008) [2023-12-27 21:06:59,649][106226] Updated weights for policy 0, policy_version 262658 (0.0006) [2023-12-27 21:06:59,703][106226] Updated weights for policy 0, policy_version 262668 (0.0005) [2023-12-27 21:06:59,754][106226] Updated weights for policy 0, policy_version 262678 (0.0007) [2023-12-27 21:07:00,041][106225] Updated weights for policy 1, policy_version 263046 (0.0009) [2023-12-27 21:07:00,105][106225] Updated weights for policy 1, policy_version 263056 (0.0009) [2023-12-27 21:07:00,158][106225] Updated weights for policy 1, policy_version 263066 (0.0008) [2023-12-27 21:07:00,416][106226] Updated weights for policy 0, policy_version 262688 (0.0009) [2023-12-27 21:07:00,472][106226] Updated weights for policy 0, policy_version 262698 (0.0009) [2023-12-27 21:07:00,529][106226] Updated weights for policy 0, policy_version 262708 (0.0008) [2023-12-27 21:07:00,940][106225] Updated weights for policy 1, policy_version 263076 (0.0009) [2023-12-27 21:07:00,997][106225] Updated weights for policy 1, policy_version 263086 (0.0008) [2023-12-27 21:07:01,061][106225] Updated weights for policy 1, policy_version 263096 (0.0007) [2023-12-27 21:07:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 134643712. Throughput: 0: 10021.4, 1: 9986.3. Samples: 134633296. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:07:01,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-6.293')] [2023-12-27 21:07:01,196][106226] Updated weights for policy 0, policy_version 262718 (0.0009) [2023-12-27 21:07:01,259][106226] Updated weights for policy 0, policy_version 262728 (0.0008) [2023-12-27 21:07:01,312][106226] Updated weights for policy 0, policy_version 262738 (0.0008) [2023-12-27 21:07:01,787][106225] Updated weights for policy 1, policy_version 263106 (0.0009) [2023-12-27 21:07:01,854][106225] Updated weights for policy 1, policy_version 263116 (0.0009) [2023-12-27 21:07:01,920][106225] Updated weights for policy 1, policy_version 263126 (0.0010) [2023-12-27 21:07:01,985][106225] Updated weights for policy 1, policy_version 263136 (0.0009) [2023-12-27 21:07:02,049][106226] Updated weights for policy 0, policy_version 262748 (0.0008) [2023-12-27 21:07:02,102][106226] Updated weights for policy 0, policy_version 262758 (0.0009) [2023-12-27 21:07:02,160][106226] Updated weights for policy 0, policy_version 262768 (0.0009) [2023-12-27 21:07:02,680][106225] Updated weights for policy 1, policy_version 263146 (0.0008) [2023-12-27 21:07:02,731][106225] Updated weights for policy 1, policy_version 263156 (0.0008) [2023-12-27 21:07:02,806][106225] Updated weights for policy 1, policy_version 263166 (0.0008) [2023-12-27 21:07:02,942][106226] Updated weights for policy 0, policy_version 262778 (0.0009) [2023-12-27 21:07:03,005][106226] Updated weights for policy 0, policy_version 262788 (0.0009) [2023-12-27 21:07:03,061][106226] Updated weights for policy 0, policy_version 262798 (0.0008) [2023-12-27 21:07:03,114][106226] Updated weights for policy 0, policy_version 262808 (0.0008) [2023-12-27 21:07:03,390][106225] Updated weights for policy 1, policy_version 263176 (0.0008) [2023-12-27 21:07:03,439][106225] Updated weights for policy 1, policy_version 263186 (0.0008) [2023-12-27 21:07:03,492][106225] Updated weights for policy 1, policy_version 263196 (0.0005) [2023-12-27 21:07:03,771][106226] Updated weights for policy 0, policy_version 262818 (0.0009) [2023-12-27 21:07:03,820][106226] Updated weights for policy 0, policy_version 262828 (0.0010) [2023-12-27 21:07:03,883][106226] Updated weights for policy 0, policy_version 262838 (0.0009) [2023-12-27 21:07:04,101][106225] Updated weights for policy 1, policy_version 263206 (0.0007) [2023-12-27 21:07:04,168][106225] Updated weights for policy 1, policy_version 263216 (0.0008) [2023-12-27 21:07:04,230][106225] Updated weights for policy 1, policy_version 263226 (0.0009) [2023-12-27 21:07:04,585][106226] Updated weights for policy 0, policy_version 262848 (0.0007) [2023-12-27 21:07:04,629][106226] Updated weights for policy 0, policy_version 262858 (0.0008) [2023-12-27 21:07:04,679][106226] Updated weights for policy 0, policy_version 262868 (0.0008) [2023-12-27 21:07:04,974][106225] Updated weights for policy 1, policy_version 263236 (0.0008) [2023-12-27 21:07:05,033][106225] Updated weights for policy 1, policy_version 263246 (0.0007) [2023-12-27 21:07:05,098][106225] Updated weights for policy 1, policy_version 263256 (0.0007) [2023-12-27 21:07:05,347][106226] Updated weights for policy 0, policy_version 262878 (0.0009) [2023-12-27 21:07:05,404][106226] Updated weights for policy 0, policy_version 262888 (0.0007) [2023-12-27 21:07:05,459][106226] Updated weights for policy 0, policy_version 262898 (0.0007) [2023-12-27 21:07:05,710][106225] Updated weights for policy 1, policy_version 263266 (0.0008) [2023-12-27 21:07:05,763][106225] Updated weights for policy 1, policy_version 263276 (0.0007) [2023-12-27 21:07:05,808][106225] Updated weights for policy 1, policy_version 263286 (0.0005) [2023-12-27 21:07:05,857][106225] Updated weights for policy 1, policy_version 263296 (0.0008) [2023-12-27 21:07:06,150][106226] Updated weights for policy 0, policy_version 262908 (0.0010) [2023-12-27 21:07:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 134742016. Throughput: 0: 10064.5, 1: 9896.9. Samples: 134753392. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:07:06,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-6.046')] [2023-12-27 21:07:06,201][106226] Updated weights for policy 0, policy_version 262918 (0.0010) [2023-12-27 21:07:06,275][106226] Updated weights for policy 0, policy_version 262928 (0.0011) [2023-12-27 21:07:06,529][106225] Updated weights for policy 1, policy_version 263306 (0.0011) [2023-12-27 21:07:06,594][106225] Updated weights for policy 1, policy_version 263316 (0.0009) [2023-12-27 21:07:06,658][106225] Updated weights for policy 1, policy_version 263326 (0.0008) [2023-12-27 21:07:07,002][106226] Updated weights for policy 0, policy_version 262938 (0.0009) [2023-12-27 21:07:07,067][106226] Updated weights for policy 0, policy_version 262948 (0.0010) [2023-12-27 21:07:07,141][106226] Updated weights for policy 0, policy_version 262958 (0.0009) [2023-12-27 21:07:07,212][106226] Updated weights for policy 0, policy_version 262968 (0.0009) [2023-12-27 21:07:07,240][106225] Updated weights for policy 1, policy_version 263336 (0.0009) [2023-12-27 21:07:07,301][106225] Updated weights for policy 1, policy_version 263346 (0.0010) [2023-12-27 21:07:07,362][106225] Updated weights for policy 1, policy_version 263356 (0.0010) [2023-12-27 21:07:07,925][106226] Updated weights for policy 0, policy_version 262978 (0.0008) [2023-12-27 21:07:07,964][106225] Updated weights for policy 1, policy_version 263366 (0.0007) [2023-12-27 21:07:07,990][106226] Updated weights for policy 0, policy_version 262988 (0.0009) [2023-12-27 21:07:08,024][106225] Updated weights for policy 1, policy_version 263376 (0.0009) [2023-12-27 21:07:08,044][106226] Updated weights for policy 0, policy_version 262998 (0.0007) [2023-12-27 21:07:08,075][106225] Updated weights for policy 1, policy_version 263386 (0.0010) [2023-12-27 21:07:08,663][106225] Updated weights for policy 1, policy_version 263396 (0.0009) [2023-12-27 21:07:08,725][106225] Updated weights for policy 1, policy_version 263406 (0.0010) [2023-12-27 21:07:08,789][106225] Updated weights for policy 1, policy_version 263416 (0.0009) [2023-12-27 21:07:08,837][106226] Updated weights for policy 0, policy_version 263008 (0.0006) [2023-12-27 21:07:08,899][106226] Updated weights for policy 0, policy_version 263018 (0.0008) [2023-12-27 21:07:08,964][106226] Updated weights for policy 0, policy_version 263028 (0.0008) [2023-12-27 21:07:09,530][106225] Updated weights for policy 1, policy_version 263426 (0.0009) [2023-12-27 21:07:09,599][106225] Updated weights for policy 1, policy_version 263436 (0.0011) [2023-12-27 21:07:09,660][106225] Updated weights for policy 1, policy_version 263446 (0.0010) [2023-12-27 21:07:09,722][106225] Updated weights for policy 1, policy_version 263456 (0.0011) [2023-12-27 21:07:09,770][106226] Updated weights for policy 0, policy_version 263038 (0.0008) [2023-12-27 21:07:09,839][106226] Updated weights for policy 0, policy_version 263048 (0.0008) [2023-12-27 21:07:09,902][106226] Updated weights for policy 0, policy_version 263058 (0.0008) [2023-12-27 21:07:10,453][106225] Updated weights for policy 1, policy_version 263466 (0.0010) [2023-12-27 21:07:10,514][106225] Updated weights for policy 1, policy_version 263476 (0.0010) [2023-12-27 21:07:10,577][106225] Updated weights for policy 1, policy_version 263486 (0.0010) [2023-12-27 21:07:10,664][106226] Updated weights for policy 0, policy_version 263068 (0.0008) [2023-12-27 21:07:10,721][106226] Updated weights for policy 0, policy_version 263078 (0.0010) [2023-12-27 21:07:10,782][106226] Updated weights for policy 0, policy_version 263088 (0.0011) [2023-12-27 21:07:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 134840320. Throughput: 0: 10039.9, 1: 10000.0. Samples: 134814108. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:07:11,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-5.911')] [2023-12-27 21:07:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000263488_67469312.pth... [2023-12-27 21:07:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000263096_67371008.pth... [2023-12-27 21:07:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000261944_67076096.pth [2023-12-27 21:07:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000262336_67174400.pth [2023-12-27 21:07:11,339][106225] Updated weights for policy 1, policy_version 263496 (0.0011) [2023-12-27 21:07:11,411][106225] Updated weights for policy 1, policy_version 263506 (0.0008) [2023-12-27 21:07:11,481][106225] Updated weights for policy 1, policy_version 263516 (0.0010) [2023-12-27 21:07:11,497][106226] Updated weights for policy 0, policy_version 263098 (0.0010) [2023-12-27 21:07:11,546][106226] Updated weights for policy 0, policy_version 263108 (0.0005) [2023-12-27 21:07:11,609][106226] Updated weights for policy 0, policy_version 263118 (0.0006) [2023-12-27 21:07:11,678][106226] Updated weights for policy 0, policy_version 263128 (0.0010) [2023-12-27 21:07:12,282][106225] Updated weights for policy 1, policy_version 263526 (0.0011) [2023-12-27 21:07:12,320][106226] Updated weights for policy 0, policy_version 263138 (0.0011) [2023-12-27 21:07:12,348][106225] Updated weights for policy 1, policy_version 263536 (0.0010) [2023-12-27 21:07:12,388][106226] Updated weights for policy 0, policy_version 263148 (0.0010) [2023-12-27 21:07:12,403][106225] Updated weights for policy 1, policy_version 263546 (0.0009) [2023-12-27 21:07:12,445][106226] Updated weights for policy 0, policy_version 263158 (0.0010) [2023-12-27 21:07:12,992][106225] Updated weights for policy 1, policy_version 263556 (0.0008) [2023-12-27 21:07:13,046][106225] Updated weights for policy 1, policy_version 263566 (0.0010) [2023-12-27 21:07:13,059][106226] Updated weights for policy 0, policy_version 263168 (0.0006) [2023-12-27 21:07:13,093][106225] Updated weights for policy 1, policy_version 263576 (0.0010) [2023-12-27 21:07:13,115][106226] Updated weights for policy 0, policy_version 263178 (0.0005) [2023-12-27 21:07:13,171][106226] Updated weights for policy 0, policy_version 263188 (0.0006) [2023-12-27 21:07:13,700][106226] Updated weights for policy 0, policy_version 263198 (0.0006) [2023-12-27 21:07:13,735][106225] Updated weights for policy 1, policy_version 263586 (0.0010) [2023-12-27 21:07:13,753][106226] Updated weights for policy 0, policy_version 263208 (0.0005) [2023-12-27 21:07:13,800][106225] Updated weights for policy 1, policy_version 263596 (0.0007) [2023-12-27 21:07:13,804][106226] Updated weights for policy 0, policy_version 263218 (0.0005) [2023-12-27 21:07:13,865][106225] Updated weights for policy 1, policy_version 263606 (0.0005) [2023-12-27 21:07:13,930][106225] Updated weights for policy 1, policy_version 263616 (0.0005) [2023-12-27 21:07:14,433][106225] Updated weights for policy 1, policy_version 263626 (0.0005) [2023-12-27 21:07:14,480][106226] Updated weights for policy 0, policy_version 263228 (0.0009) [2023-12-27 21:07:14,491][106225] Updated weights for policy 1, policy_version 263636 (0.0009) [2023-12-27 21:07:14,541][106226] Updated weights for policy 0, policy_version 263238 (0.0010) [2023-12-27 21:07:14,548][106225] Updated weights for policy 1, policy_version 263646 (0.0010) [2023-12-27 21:07:14,593][106226] Updated weights for policy 0, policy_version 263248 (0.0010) [2023-12-27 21:07:15,263][106225] Updated weights for policy 1, policy_version 263656 (0.0010) [2023-12-27 21:07:15,286][106226] Updated weights for policy 0, policy_version 263258 (0.0010) [2023-12-27 21:07:15,315][106225] Updated weights for policy 1, policy_version 263666 (0.0010) [2023-12-27 21:07:15,343][106226] Updated weights for policy 0, policy_version 263268 (0.0010) [2023-12-27 21:07:15,372][106225] Updated weights for policy 1, policy_version 263676 (0.0009) [2023-12-27 21:07:15,403][106226] Updated weights for policy 0, policy_version 263278 (0.0010) [2023-12-27 21:07:15,452][106226] Updated weights for policy 0, policy_version 263288 (0.0010) [2023-12-27 21:07:16,082][106226] Updated weights for policy 0, policy_version 263298 (0.0007) [2023-12-27 21:07:16,096][106225] Updated weights for policy 1, policy_version 263686 (0.0010) [2023-12-27 21:07:16,138][106226] Updated weights for policy 0, policy_version 263308 (0.0010) [2023-12-27 21:07:16,153][106225] Updated weights for policy 1, policy_version 263696 (0.0010) [2023-12-27 21:07:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 134938624. Throughput: 0: 9987.4, 1: 9961.4. Samples: 134934516. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:07:16,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-6.282')] [2023-12-27 21:07:16,199][106226] Updated weights for policy 0, policy_version 263318 (0.0011) [2023-12-27 21:07:16,211][106225] Updated weights for policy 1, policy_version 263706 (0.0010) [2023-12-27 21:07:16,872][106225] Updated weights for policy 1, policy_version 263716 (0.0008) [2023-12-27 21:07:16,884][106226] Updated weights for policy 0, policy_version 263328 (0.0011) [2023-12-27 21:07:16,929][106225] Updated weights for policy 1, policy_version 263726 (0.0005) [2023-12-27 21:07:16,939][106226] Updated weights for policy 0, policy_version 263338 (0.0010) [2023-12-27 21:07:16,984][106225] Updated weights for policy 1, policy_version 263736 (0.0005) [2023-12-27 21:07:16,992][106226] Updated weights for policy 0, policy_version 263348 (0.0008) [2023-12-27 21:07:17,645][106226] Updated weights for policy 0, policy_version 263358 (0.0005) [2023-12-27 21:07:17,650][106225] Updated weights for policy 1, policy_version 263746 (0.0009) [2023-12-27 21:07:17,703][106226] Updated weights for policy 0, policy_version 263368 (0.0005) [2023-12-27 21:07:17,717][106225] Updated weights for policy 1, policy_version 263756 (0.0010) [2023-12-27 21:07:17,760][106226] Updated weights for policy 0, policy_version 263378 (0.0007) [2023-12-27 21:07:17,772][106225] Updated weights for policy 1, policy_version 263766 (0.0010) [2023-12-27 21:07:17,821][106225] Updated weights for policy 1, policy_version 263776 (0.0010) [2023-12-27 21:07:18,352][106226] Updated weights for policy 0, policy_version 263388 (0.0010) [2023-12-27 21:07:18,417][106226] Updated weights for policy 0, policy_version 263398 (0.0011) [2023-12-27 21:07:18,477][106226] Updated weights for policy 0, policy_version 263408 (0.0010) [2023-12-27 21:07:18,531][106225] Updated weights for policy 1, policy_version 263786 (0.0010) [2023-12-27 21:07:18,580][106225] Updated weights for policy 1, policy_version 263796 (0.0010) [2023-12-27 21:07:18,640][106225] Updated weights for policy 1, policy_version 263806 (0.0010) [2023-12-27 21:07:19,213][106226] Updated weights for policy 0, policy_version 263418 (0.0010) [2023-12-27 21:07:19,282][106226] Updated weights for policy 0, policy_version 263428 (0.0008) [2023-12-27 21:07:19,347][106225] Updated weights for policy 1, policy_version 263816 (0.0010) [2023-12-27 21:07:19,349][106226] Updated weights for policy 0, policy_version 263438 (0.0008) [2023-12-27 21:07:19,409][106225] Updated weights for policy 1, policy_version 263826 (0.0007) [2023-12-27 21:07:19,410][106226] Updated weights for policy 0, policy_version 263448 (0.0007) [2023-12-27 21:07:19,460][106225] Updated weights for policy 1, policy_version 263836 (0.0008) [2023-12-27 21:07:20,023][106226] Updated weights for policy 0, policy_version 263458 (0.0008) [2023-12-27 21:07:20,092][106226] Updated weights for policy 0, policy_version 263468 (0.0007) [2023-12-27 21:07:20,159][106226] Updated weights for policy 0, policy_version 263478 (0.0006) [2023-12-27 21:07:20,265][106225] Updated weights for policy 1, policy_version 263846 (0.0008) [2023-12-27 21:07:20,332][106225] Updated weights for policy 1, policy_version 263856 (0.0008) [2023-12-27 21:07:20,392][106225] Updated weights for policy 1, policy_version 263866 (0.0009) [2023-12-27 21:07:20,834][106226] Updated weights for policy 0, policy_version 263488 (0.0009) [2023-12-27 21:07:20,901][106226] Updated weights for policy 0, policy_version 263498 (0.0010) [2023-12-27 21:07:20,968][106226] Updated weights for policy 0, policy_version 263508 (0.0010) [2023-12-27 21:07:21,001][106225] Updated weights for policy 1, policy_version 263876 (0.0010) [2023-12-27 21:07:21,079][106225] Updated weights for policy 1, policy_version 263886 (0.0008) [2023-12-27 21:07:21,153][106225] Updated weights for policy 1, policy_version 263896 (0.0008) [2023-12-27 21:07:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 135045120. Throughput: 0: 10006.7, 1: 9934.9. Samples: 135054824. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 21:07:21,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.878')] [2023-12-27 21:07:21,786][106226] Updated weights for policy 0, policy_version 263518 (0.0007) [2023-12-27 21:07:21,839][106226] Updated weights for policy 0, policy_version 263528 (0.0007) [2023-12-27 21:07:21,896][106226] Updated weights for policy 0, policy_version 263538 (0.0009) [2023-12-27 21:07:21,977][106225] Updated weights for policy 1, policy_version 263906 (0.0009) [2023-12-27 21:07:22,040][106225] Updated weights for policy 1, policy_version 263916 (0.0006) [2023-12-27 21:07:22,104][106225] Updated weights for policy 1, policy_version 263926 (0.0010) [2023-12-27 21:07:22,162][106225] Updated weights for policy 1, policy_version 263936 (0.0010) [2023-12-27 21:07:22,710][106226] Updated weights for policy 0, policy_version 263548 (0.0008) [2023-12-27 21:07:22,769][106226] Updated weights for policy 0, policy_version 263558 (0.0008) [2023-12-27 21:07:22,833][106226] Updated weights for policy 0, policy_version 263568 (0.0006) [2023-12-27 21:07:22,853][106225] Updated weights for policy 1, policy_version 263946 (0.0010) [2023-12-27 21:07:22,915][106225] Updated weights for policy 1, policy_version 263956 (0.0010) [2023-12-27 21:07:22,972][106225] Updated weights for policy 1, policy_version 263966 (0.0010) [2023-12-27 21:07:23,563][106226] Updated weights for policy 0, policy_version 263578 (0.0006) [2023-12-27 21:07:23,612][106226] Updated weights for policy 0, policy_version 263588 (0.0006) [2023-12-27 21:07:23,614][106225] Updated weights for policy 1, policy_version 263976 (0.0009) [2023-12-27 21:07:23,665][106225] Updated weights for policy 1, policy_version 263986 (0.0007) [2023-12-27 21:07:23,670][106226] Updated weights for policy 0, policy_version 263598 (0.0005) [2023-12-27 21:07:23,719][106225] Updated weights for policy 1, policy_version 263996 (0.0008) [2023-12-27 21:07:23,724][106226] Updated weights for policy 0, policy_version 263608 (0.0006) [2023-12-27 21:07:24,282][106226] Updated weights for policy 0, policy_version 263618 (0.0005) [2023-12-27 21:07:24,312][106225] Updated weights for policy 1, policy_version 264006 (0.0007) [2023-12-27 21:07:24,350][106226] Updated weights for policy 0, policy_version 263628 (0.0007) [2023-12-27 21:07:24,372][106225] Updated weights for policy 1, policy_version 264016 (0.0008) [2023-12-27 21:07:24,407][106226] Updated weights for policy 0, policy_version 263638 (0.0009) [2023-12-27 21:07:24,426][106225] Updated weights for policy 1, policy_version 264026 (0.0005) [2023-12-27 21:07:24,942][106226] Updated weights for policy 0, policy_version 263648 (0.0007) [2023-12-27 21:07:24,957][106225] Updated weights for policy 1, policy_version 264036 (0.0007) [2023-12-27 21:07:24,998][106226] Updated weights for policy 0, policy_version 263658 (0.0007) [2023-12-27 21:07:25,016][106225] Updated weights for policy 1, policy_version 264046 (0.0008) [2023-12-27 21:07:25,054][106226] Updated weights for policy 0, policy_version 263668 (0.0007) [2023-12-27 21:07:25,071][106225] Updated weights for policy 1, policy_version 264056 (0.0006) [2023-12-27 21:07:25,763][106226] Updated weights for policy 0, policy_version 263678 (0.0006) [2023-12-27 21:07:25,777][106225] Updated weights for policy 1, policy_version 264066 (0.0008) [2023-12-27 21:07:25,825][106226] Updated weights for policy 0, policy_version 263688 (0.0006) [2023-12-27 21:07:25,837][106225] Updated weights for policy 1, policy_version 264076 (0.0008) [2023-12-27 21:07:25,888][106226] Updated weights for policy 0, policy_version 263698 (0.0007) [2023-12-27 21:07:25,896][106225] Updated weights for policy 1, policy_version 264086 (0.0007) [2023-12-27 21:07:25,947][106225] Updated weights for policy 1, policy_version 264096 (0.0007) [2023-12-27 21:07:26,175][105115] Fps is (10 sec: 21298.7, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 135151616. Throughput: 0: 9987.5, 1: 9944.2. Samples: 135112872. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:26,176][105115] Avg episode reward: [(0, '-4.534'), (1, '-6.149')] [2023-12-27 21:07:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000264096_67624960.pth... [2023-12-27 21:07:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000263704_67526656.pth... [2023-12-27 21:07:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000262912_67321856.pth [2023-12-27 21:07:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000262552_67231744.pth [2023-12-27 21:07:26,508][106226] Updated weights for policy 0, policy_version 263708 (0.0006) [2023-12-27 21:07:26,563][106226] Updated weights for policy 0, policy_version 263718 (0.0005) [2023-12-27 21:07:26,575][106225] Updated weights for policy 1, policy_version 264106 (0.0009) [2023-12-27 21:07:26,624][106226] Updated weights for policy 0, policy_version 263728 (0.0006) [2023-12-27 21:07:26,628][106225] Updated weights for policy 1, policy_version 264116 (0.0008) [2023-12-27 21:07:26,686][106225] Updated weights for policy 1, policy_version 264126 (0.0005) [2023-12-27 21:07:27,214][106225] Updated weights for policy 1, policy_version 264136 (0.0005) [2023-12-27 21:07:27,228][106226] Updated weights for policy 0, policy_version 263738 (0.0009) [2023-12-27 21:07:27,264][106225] Updated weights for policy 1, policy_version 264146 (0.0006) [2023-12-27 21:07:27,284][106226] Updated weights for policy 0, policy_version 263748 (0.0010) [2023-12-27 21:07:27,318][106225] Updated weights for policy 1, policy_version 264156 (0.0008) [2023-12-27 21:07:27,338][106226] Updated weights for policy 0, policy_version 263758 (0.0010) [2023-12-27 21:07:27,386][106226] Updated weights for policy 0, policy_version 263768 (0.0010) [2023-12-27 21:07:27,905][106225] Updated weights for policy 1, policy_version 264166 (0.0008) [2023-12-27 21:07:27,954][106225] Updated weights for policy 1, policy_version 264176 (0.0010) [2023-12-27 21:07:28,004][106225] Updated weights for policy 1, policy_version 264186 (0.0009) [2023-12-27 21:07:28,041][106226] Updated weights for policy 0, policy_version 263778 (0.0010) [2023-12-27 21:07:28,086][106226] Updated weights for policy 0, policy_version 263788 (0.0010) [2023-12-27 21:07:28,140][106226] Updated weights for policy 0, policy_version 263798 (0.0010) [2023-12-27 21:07:28,730][106225] Updated weights for policy 1, policy_version 264196 (0.0008) [2023-12-27 21:07:28,790][106225] Updated weights for policy 1, policy_version 264206 (0.0010) [2023-12-27 21:07:28,845][106225] Updated weights for policy 1, policy_version 264216 (0.0010) [2023-12-27 21:07:28,855][106226] Updated weights for policy 0, policy_version 263808 (0.0008) [2023-12-27 21:07:28,902][106226] Updated weights for policy 0, policy_version 263818 (0.0006) [2023-12-27 21:07:28,951][106226] Updated weights for policy 0, policy_version 263828 (0.0007) [2023-12-27 21:07:29,563][106225] Updated weights for policy 1, policy_version 264226 (0.0010) [2023-12-27 21:07:29,619][106225] Updated weights for policy 1, policy_version 264236 (0.0008) [2023-12-27 21:07:29,674][106225] Updated weights for policy 1, policy_version 264246 (0.0008) [2023-12-27 21:07:29,703][106226] Updated weights for policy 0, policy_version 263838 (0.0008) [2023-12-27 21:07:29,730][106225] Updated weights for policy 1, policy_version 264256 (0.0007) [2023-12-27 21:07:29,761][106226] Updated weights for policy 0, policy_version 263848 (0.0007) [2023-12-27 21:07:29,828][106226] Updated weights for policy 0, policy_version 263858 (0.0008) [2023-12-27 21:07:30,434][106225] Updated weights for policy 1, policy_version 264266 (0.0005) [2023-12-27 21:07:30,493][106225] Updated weights for policy 1, policy_version 264276 (0.0006) [2023-12-27 21:07:30,544][106225] Updated weights for policy 1, policy_version 264286 (0.0009) [2023-12-27 21:07:30,616][106226] Updated weights for policy 0, policy_version 263868 (0.0007) [2023-12-27 21:07:30,675][106226] Updated weights for policy 0, policy_version 263878 (0.0009) [2023-12-27 21:07:30,725][106226] Updated weights for policy 0, policy_version 263888 (0.0008) [2023-12-27 21:07:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 135249920. Throughput: 0: 10050.4, 1: 10072.1. Samples: 135240368. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:31,175][105115] Avg episode reward: [(0, '-4.964'), (1, '-6.058')] [2023-12-27 21:07:31,269][106225] Updated weights for policy 1, policy_version 264296 (0.0009) [2023-12-27 21:07:31,321][106225] Updated weights for policy 1, policy_version 264306 (0.0008) [2023-12-27 21:07:31,388][106225] Updated weights for policy 1, policy_version 264316 (0.0009) [2023-12-27 21:07:31,546][106226] Updated weights for policy 0, policy_version 263898 (0.0008) [2023-12-27 21:07:31,606][106226] Updated weights for policy 0, policy_version 263908 (0.0009) [2023-12-27 21:07:31,664][106226] Updated weights for policy 0, policy_version 263918 (0.0008) [2023-12-27 21:07:31,731][106226] Updated weights for policy 0, policy_version 263928 (0.0009) [2023-12-27 21:07:32,142][106225] Updated weights for policy 1, policy_version 264326 (0.0008) [2023-12-27 21:07:32,201][106225] Updated weights for policy 1, policy_version 264336 (0.0008) [2023-12-27 21:07:32,266][106225] Updated weights for policy 1, policy_version 264346 (0.0008) [2023-12-27 21:07:32,485][106226] Updated weights for policy 0, policy_version 263938 (0.0006) [2023-12-27 21:07:32,551][106226] Updated weights for policy 0, policy_version 263948 (0.0008) [2023-12-27 21:07:32,615][106226] Updated weights for policy 0, policy_version 263958 (0.0009) [2023-12-27 21:07:33,018][106225] Updated weights for policy 1, policy_version 264356 (0.0008) [2023-12-27 21:07:33,077][106225] Updated weights for policy 1, policy_version 264366 (0.0007) [2023-12-27 21:07:33,139][106225] Updated weights for policy 1, policy_version 264376 (0.0008) [2023-12-27 21:07:33,332][106226] Updated weights for policy 0, policy_version 263968 (0.0008) [2023-12-27 21:07:33,390][106226] Updated weights for policy 0, policy_version 263978 (0.0009) [2023-12-27 21:07:33,448][106226] Updated weights for policy 0, policy_version 263988 (0.0008) [2023-12-27 21:07:33,806][106225] Updated weights for policy 1, policy_version 264386 (0.0008) [2023-12-27 21:07:33,869][106225] Updated weights for policy 1, policy_version 264396 (0.0007) [2023-12-27 21:07:33,936][106225] Updated weights for policy 1, policy_version 264406 (0.0007) [2023-12-27 21:07:33,991][106225] Updated weights for policy 1, policy_version 264416 (0.0007) [2023-12-27 21:07:34,090][106226] Updated weights for policy 0, policy_version 263998 (0.0006) [2023-12-27 21:07:34,146][106226] Updated weights for policy 0, policy_version 264008 (0.0006) [2023-12-27 21:07:34,200][106226] Updated weights for policy 0, policy_version 264018 (0.0008) [2023-12-27 21:07:34,664][106225] Updated weights for policy 1, policy_version 264426 (0.0007) [2023-12-27 21:07:34,721][106225] Updated weights for policy 1, policy_version 264436 (0.0006) [2023-12-27 21:07:34,782][106225] Updated weights for policy 1, policy_version 264446 (0.0006) [2023-12-27 21:07:34,902][106226] Updated weights for policy 0, policy_version 264028 (0.0009) [2023-12-27 21:07:34,958][106226] Updated weights for policy 0, policy_version 264038 (0.0005) [2023-12-27 21:07:35,010][106226] Updated weights for policy 0, policy_version 264048 (0.0005) [2023-12-27 21:07:35,473][106225] Updated weights for policy 1, policy_version 264456 (0.0006) [2023-12-27 21:07:35,527][106225] Updated weights for policy 1, policy_version 264466 (0.0005) [2023-12-27 21:07:35,584][106226] Updated weights for policy 0, policy_version 264058 (0.0005) [2023-12-27 21:07:35,591][106225] Updated weights for policy 1, policy_version 264476 (0.0005) [2023-12-27 21:07:35,648][106226] Updated weights for policy 0, policy_version 264068 (0.0005) [2023-12-27 21:07:35,717][106226] Updated weights for policy 0, policy_version 264078 (0.0007) [2023-12-27 21:07:35,784][106226] Updated weights for policy 0, policy_version 264088 (0.0006) [2023-12-27 21:07:36,140][106225] Updated weights for policy 1, policy_version 264486 (0.0007) [2023-12-27 21:07:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 135348224. Throughput: 0: 10050.2, 1: 10047.8. Samples: 135360172. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:36,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.974')] [2023-12-27 21:07:36,198][106225] Updated weights for policy 1, policy_version 264496 (0.0010) [2023-12-27 21:07:36,253][106225] Updated weights for policy 1, policy_version 264506 (0.0010) [2023-12-27 21:07:36,392][106226] Updated weights for policy 0, policy_version 264098 (0.0008) [2023-12-27 21:07:36,460][106226] Updated weights for policy 0, policy_version 264108 (0.0008) [2023-12-27 21:07:36,527][106226] Updated weights for policy 0, policy_version 264118 (0.0008) [2023-12-27 21:07:36,997][106225] Updated weights for policy 1, policy_version 264516 (0.0010) [2023-12-27 21:07:37,053][106225] Updated weights for policy 1, policy_version 264526 (0.0010) [2023-12-27 21:07:37,103][106225] Updated weights for policy 1, policy_version 264536 (0.0010) [2023-12-27 21:07:37,186][106226] Updated weights for policy 0, policy_version 264128 (0.0006) [2023-12-27 21:07:37,254][106226] Updated weights for policy 0, policy_version 264138 (0.0008) [2023-12-27 21:07:37,312][106226] Updated weights for policy 0, policy_version 264148 (0.0006) [2023-12-27 21:07:37,732][106225] Updated weights for policy 1, policy_version 264546 (0.0009) [2023-12-27 21:07:37,786][106225] Updated weights for policy 1, policy_version 264556 (0.0009) [2023-12-27 21:07:37,839][106225] Updated weights for policy 1, policy_version 264566 (0.0005) [2023-12-27 21:07:37,867][106226] Updated weights for policy 0, policy_version 264158 (0.0007) [2023-12-27 21:07:37,890][106225] Updated weights for policy 1, policy_version 264576 (0.0006) [2023-12-27 21:07:37,929][106226] Updated weights for policy 0, policy_version 264168 (0.0009) [2023-12-27 21:07:37,988][106226] Updated weights for policy 0, policy_version 264178 (0.0009) [2023-12-27 21:07:38,589][106225] Updated weights for policy 1, policy_version 264586 (0.0009) [2023-12-27 21:07:38,650][106225] Updated weights for policy 1, policy_version 264596 (0.0009) [2023-12-27 21:07:38,707][106225] Updated weights for policy 1, policy_version 264606 (0.0008) [2023-12-27 21:07:38,738][106226] Updated weights for policy 0, policy_version 264188 (0.0008) [2023-12-27 21:07:38,794][106226] Updated weights for policy 0, policy_version 264198 (0.0009) [2023-12-27 21:07:38,854][106226] Updated weights for policy 0, policy_version 264208 (0.0009) [2023-12-27 21:07:39,477][106225] Updated weights for policy 1, policy_version 264616 (0.0009) [2023-12-27 21:07:39,537][106225] Updated weights for policy 1, policy_version 264626 (0.0009) [2023-12-27 21:07:39,573][106226] Updated weights for policy 0, policy_version 264218 (0.0008) [2023-12-27 21:07:39,595][106225] Updated weights for policy 1, policy_version 264636 (0.0006) [2023-12-27 21:07:39,641][106226] Updated weights for policy 0, policy_version 264228 (0.0009) [2023-12-27 21:07:39,698][106226] Updated weights for policy 0, policy_version 264238 (0.0008) [2023-12-27 21:07:39,759][106226] Updated weights for policy 0, policy_version 264248 (0.0009) [2023-12-27 21:07:40,300][106225] Updated weights for policy 1, policy_version 264646 (0.0006) [2023-12-27 21:07:40,361][106225] Updated weights for policy 1, policy_version 264656 (0.0007) [2023-12-27 21:07:40,421][106225] Updated weights for policy 1, policy_version 264666 (0.0009) [2023-12-27 21:07:40,573][106226] Updated weights for policy 0, policy_version 264258 (0.0009) [2023-12-27 21:07:40,640][106226] Updated weights for policy 0, policy_version 264268 (0.0009) [2023-12-27 21:07:40,704][106226] Updated weights for policy 0, policy_version 264278 (0.0009) [2023-12-27 21:07:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 135446528. Throughput: 0: 10047.2, 1: 10121.0. Samples: 135421224. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:41,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.875')] [2023-12-27 21:07:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000264280_67674112.pth... [2023-12-27 21:07:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000263096_67371008.pth [2023-12-27 21:07:41,200][106225] Updated weights for policy 1, policy_version 264676 (0.0008) [2023-12-27 21:07:41,266][106225] Updated weights for policy 1, policy_version 264686 (0.0008) [2023-12-27 21:07:41,334][106225] Updated weights for policy 1, policy_version 264696 (0.0008) [2023-12-27 21:07:41,391][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000264704_67780608.pth... [2023-12-27 21:07:41,395][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000263488_67469312.pth [2023-12-27 21:07:41,410][106226] Updated weights for policy 0, policy_version 264288 (0.0007) [2023-12-27 21:07:41,472][106226] Updated weights for policy 0, policy_version 264298 (0.0008) [2023-12-27 21:07:41,531][106226] Updated weights for policy 0, policy_version 264308 (0.0007) [2023-12-27 21:07:42,079][106225] Updated weights for policy 1, policy_version 264708 (0.0009) [2023-12-27 21:07:42,148][106225] Updated weights for policy 1, policy_version 264718 (0.0006) [2023-12-27 21:07:42,211][106225] Updated weights for policy 1, policy_version 264728 (0.0006) [2023-12-27 21:07:42,229][106226] Updated weights for policy 0, policy_version 264318 (0.0005) [2023-12-27 21:07:42,289][106226] Updated weights for policy 0, policy_version 264328 (0.0009) [2023-12-27 21:07:42,359][106226] Updated weights for policy 0, policy_version 264338 (0.0008) [2023-12-27 21:07:42,915][106225] Updated weights for policy 1, policy_version 264738 (0.0009) [2023-12-27 21:07:42,974][106225] Updated weights for policy 1, policy_version 264748 (0.0009) [2023-12-27 21:07:43,005][106226] Updated weights for policy 0, policy_version 264348 (0.0007) [2023-12-27 21:07:43,024][106225] Updated weights for policy 1, policy_version 264758 (0.0007) [2023-12-27 21:07:43,054][106226] Updated weights for policy 0, policy_version 264358 (0.0006) [2023-12-27 21:07:43,079][106225] Updated weights for policy 1, policy_version 264768 (0.0008) [2023-12-27 21:07:43,109][106226] Updated weights for policy 0, policy_version 264368 (0.0006) [2023-12-27 21:07:43,744][106225] Updated weights for policy 1, policy_version 264778 (0.0008) [2023-12-27 21:07:43,780][106226] Updated weights for policy 0, policy_version 264378 (0.0008) [2023-12-27 21:07:43,802][106225] Updated weights for policy 1, policy_version 264788 (0.0007) [2023-12-27 21:07:43,834][106226] Updated weights for policy 0, policy_version 264388 (0.0006) [2023-12-27 21:07:43,863][106225] Updated weights for policy 1, policy_version 264798 (0.0006) [2023-12-27 21:07:43,898][106226] Updated weights for policy 0, policy_version 264398 (0.0008) [2023-12-27 21:07:43,957][106226] Updated weights for policy 0, policy_version 264408 (0.0007) [2023-12-27 21:07:44,581][106225] Updated weights for policy 1, policy_version 264808 (0.0005) [2023-12-27 21:07:44,631][106226] Updated weights for policy 0, policy_version 264418 (0.0007) [2023-12-27 21:07:44,639][106225] Updated weights for policy 1, policy_version 264818 (0.0008) [2023-12-27 21:07:44,695][106226] Updated weights for policy 0, policy_version 264428 (0.0006) [2023-12-27 21:07:44,702][106225] Updated weights for policy 1, policy_version 264828 (0.0010) [2023-12-27 21:07:44,758][106226] Updated weights for policy 0, policy_version 264438 (0.0006) [2023-12-27 21:07:45,389][106226] Updated weights for policy 0, policy_version 264448 (0.0008) [2023-12-27 21:07:45,395][106225] Updated weights for policy 1, policy_version 264838 (0.0007) [2023-12-27 21:07:45,442][106226] Updated weights for policy 0, policy_version 264458 (0.0009) [2023-12-27 21:07:45,454][106225] Updated weights for policy 1, policy_version 264848 (0.0005) [2023-12-27 21:07:45,491][106226] Updated weights for policy 0, policy_version 264468 (0.0008) [2023-12-27 21:07:45,514][106225] Updated weights for policy 1, policy_version 264858 (0.0005) [2023-12-27 21:07:46,031][106225] Updated weights for policy 1, policy_version 264868 (0.0007) [2023-12-27 21:07:46,101][106225] Updated weights for policy 1, policy_version 264878 (0.0010) [2023-12-27 21:07:46,161][106225] Updated weights for policy 1, policy_version 264888 (0.0010) [2023-12-27 21:07:46,165][106226] Updated weights for policy 0, policy_version 264478 (0.0006) [2023-12-27 21:07:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19910.7). Total num frames: 135544832. Throughput: 0: 10031.2, 1: 10091.0. Samples: 135538796. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:46,175][105115] Avg episode reward: [(0, '-4.872'), (1, '-6.127')] [2023-12-27 21:07:46,216][106226] Updated weights for policy 0, policy_version 264488 (0.0005) [2023-12-27 21:07:46,275][106226] Updated weights for policy 0, policy_version 264498 (0.0005) [2023-12-27 21:07:46,782][106225] Updated weights for policy 1, policy_version 264898 (0.0010) [2023-12-27 21:07:46,840][106225] Updated weights for policy 1, policy_version 264908 (0.0007) [2023-12-27 21:07:46,873][106226] Updated weights for policy 0, policy_version 264508 (0.0006) [2023-12-27 21:07:46,904][106225] Updated weights for policy 1, policy_version 264918 (0.0005) [2023-12-27 21:07:46,936][106226] Updated weights for policy 0, policy_version 264518 (0.0005) [2023-12-27 21:07:46,968][106225] Updated weights for policy 1, policy_version 264928 (0.0005) [2023-12-27 21:07:46,993][106226] Updated weights for policy 0, policy_version 264528 (0.0005) [2023-12-27 21:07:47,567][106225] Updated weights for policy 1, policy_version 264938 (0.0010) [2023-12-27 21:07:47,624][106225] Updated weights for policy 1, policy_version 264948 (0.0008) [2023-12-27 21:07:47,646][106226] Updated weights for policy 0, policy_version 264538 (0.0008) [2023-12-27 21:07:47,682][106225] Updated weights for policy 1, policy_version 264958 (0.0006) [2023-12-27 21:07:47,699][106226] Updated weights for policy 0, policy_version 264548 (0.0010) [2023-12-27 21:07:47,747][106226] Updated weights for policy 0, policy_version 264558 (0.0009) [2023-12-27 21:07:47,797][106226] Updated weights for policy 0, policy_version 264568 (0.0005) [2023-12-27 21:07:48,244][106225] Updated weights for policy 1, policy_version 264968 (0.0005) [2023-12-27 21:07:48,300][106225] Updated weights for policy 1, policy_version 264978 (0.0005) [2023-12-27 21:07:48,366][106225] Updated weights for policy 1, policy_version 264988 (0.0007) [2023-12-27 21:07:48,434][106226] Updated weights for policy 0, policy_version 264578 (0.0011) [2023-12-27 21:07:48,497][106226] Updated weights for policy 0, policy_version 264588 (0.0010) [2023-12-27 21:07:48,560][106226] Updated weights for policy 0, policy_version 264598 (0.0011) [2023-12-27 21:07:49,058][106225] Updated weights for policy 1, policy_version 264998 (0.0007) [2023-12-27 21:07:49,122][106225] Updated weights for policy 1, policy_version 265008 (0.0007) [2023-12-27 21:07:49,183][106225] Updated weights for policy 1, policy_version 265018 (0.0010) [2023-12-27 21:07:49,260][106226] Updated weights for policy 0, policy_version 264608 (0.0011) [2023-12-27 21:07:49,325][106226] Updated weights for policy 0, policy_version 264618 (0.0011) [2023-12-27 21:07:49,396][106226] Updated weights for policy 0, policy_version 264628 (0.0008) [2023-12-27 21:07:49,789][106225] Updated weights for policy 1, policy_version 265028 (0.0010) [2023-12-27 21:07:49,858][106225] Updated weights for policy 1, policy_version 265038 (0.0008) [2023-12-27 21:07:49,925][106225] Updated weights for policy 1, policy_version 265048 (0.0007) [2023-12-27 21:07:50,115][106226] Updated weights for policy 0, policy_version 264638 (0.0010) [2023-12-27 21:07:50,187][106226] Updated weights for policy 0, policy_version 264648 (0.0008) [2023-12-27 21:07:50,254][106226] Updated weights for policy 0, policy_version 264658 (0.0009) [2023-12-27 21:07:50,551][106225] Updated weights for policy 1, policy_version 265058 (0.0010) [2023-12-27 21:07:50,615][106225] Updated weights for policy 1, policy_version 265068 (0.0009) [2023-12-27 21:07:50,679][106225] Updated weights for policy 1, policy_version 265078 (0.0010) [2023-12-27 21:07:50,740][106225] Updated weights for policy 1, policy_version 265088 (0.0010) [2023-12-27 21:07:50,967][106226] Updated weights for policy 0, policy_version 264668 (0.0009) [2023-12-27 21:07:51,031][106226] Updated weights for policy 0, policy_version 264678 (0.0006) [2023-12-27 21:07:51,097][106226] Updated weights for policy 0, policy_version 264688 (0.0007) [2023-12-27 21:07:51,175][105115] Fps is (10 sec: 21299.5, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 135659520. Throughput: 0: 10058.9, 1: 10209.7. Samples: 135665480. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:51,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-6.149')] [2023-12-27 21:07:51,176][106140] Saving new best policy, reward=-4.393! [2023-12-27 21:07:51,452][106225] Updated weights for policy 1, policy_version 265098 (0.0007) [2023-12-27 21:07:51,508][106225] Updated weights for policy 1, policy_version 265108 (0.0008) [2023-12-27 21:07:51,571][106225] Updated weights for policy 1, policy_version 265118 (0.0008) [2023-12-27 21:07:51,817][106226] Updated weights for policy 0, policy_version 264698 (0.0009) [2023-12-27 21:07:51,867][106226] Updated weights for policy 0, policy_version 264708 (0.0009) [2023-12-27 21:07:51,920][106226] Updated weights for policy 0, policy_version 264718 (0.0009) [2023-12-27 21:07:51,975][106226] Updated weights for policy 0, policy_version 264728 (0.0005) [2023-12-27 21:07:52,229][106225] Updated weights for policy 1, policy_version 265128 (0.0008) [2023-12-27 21:07:52,296][106225] Updated weights for policy 1, policy_version 265138 (0.0007) [2023-12-27 21:07:52,365][106225] Updated weights for policy 1, policy_version 265148 (0.0008) [2023-12-27 21:07:52,729][106226] Updated weights for policy 0, policy_version 264738 (0.0008) [2023-12-27 21:07:52,795][106226] Updated weights for policy 0, policy_version 264748 (0.0009) [2023-12-27 21:07:52,854][106226] Updated weights for policy 0, policy_version 264758 (0.0008) [2023-12-27 21:07:53,017][106225] Updated weights for policy 1, policy_version 265158 (0.0008) [2023-12-27 21:07:53,081][106225] Updated weights for policy 1, policy_version 265168 (0.0008) [2023-12-27 21:07:53,138][106225] Updated weights for policy 1, policy_version 265178 (0.0009) [2023-12-27 21:07:53,632][106226] Updated weights for policy 0, policy_version 264768 (0.0007) [2023-12-27 21:07:53,674][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000001 [2023-12-27 21:07:53,776][106225] Updated weights for policy 1, policy_version 265188 (0.0006) [2023-12-27 21:07:53,827][106225] Updated weights for policy 1, policy_version 265198 (0.0010) [2023-12-27 21:07:53,884][106225] Updated weights for policy 1, policy_version 265208 (0.0010) [2023-12-27 21:07:54,475][106226] Updated weights for policy 0, policy_version 264778 (0.0008) [2023-12-27 21:07:54,531][106225] Updated weights for policy 1, policy_version 265218 (0.0009) [2023-12-27 21:07:54,536][106226] Updated weights for policy 0, policy_version 264788 (0.0008) [2023-12-27 21:07:54,582][106225] Updated weights for policy 1, policy_version 265228 (0.0006) [2023-12-27 21:07:54,595][106226] Updated weights for policy 0, policy_version 264798 (0.0007) [2023-12-27 21:07:54,629][106225] Updated weights for policy 1, policy_version 265238 (0.0005) [2023-12-27 21:07:54,651][106226] Updated weights for policy 0, policy_version 264808 (0.0008) [2023-12-27 21:07:54,675][106225] Updated weights for policy 1, policy_version 265248 (0.0005) [2023-12-27 21:07:55,374][106226] Updated weights for policy 0, policy_version 264818 (0.0007) [2023-12-27 21:07:55,380][106225] Updated weights for policy 1, policy_version 265258 (0.0006) [2023-12-27 21:07:55,434][106226] Updated weights for policy 0, policy_version 264828 (0.0005) [2023-12-27 21:07:55,439][106225] Updated weights for policy 1, policy_version 265268 (0.0010) [2023-12-27 21:07:55,487][106225] Updated weights for policy 1, policy_version 265278 (0.0010) [2023-12-27 21:07:55,492][106226] Updated weights for policy 0, policy_version 264838 (0.0005) [2023-12-27 21:07:56,024][106226] Updated weights for policy 0, policy_version 264848 (0.0005) [2023-12-27 21:07:56,090][106226] Updated weights for policy 0, policy_version 264858 (0.0005) [2023-12-27 21:07:56,156][106226] Updated weights for policy 0, policy_version 264868 (0.0006) [2023-12-27 21:07:56,170][106225] Updated weights for policy 1, policy_version 265288 (0.0007) [2023-12-27 21:07:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 135749632. Throughput: 0: 10069.1, 1: 10154.4. Samples: 135724164. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:07:56,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-6.043')] [2023-12-27 21:07:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000264872_67829760.pth... [2023-12-27 21:07:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000263704_67526656.pth [2023-12-27 21:07:56,228][106225] Updated weights for policy 1, policy_version 265298 (0.0007) [2023-12-27 21:07:56,286][106225] Updated weights for policy 1, policy_version 265308 (0.0008) [2023-12-27 21:07:56,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000265312_67936256.pth... [2023-12-27 21:07:56,319][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000264096_67624960.pth [2023-12-27 21:07:56,795][106226] Updated weights for policy 0, policy_version 264878 (0.0008) [2023-12-27 21:07:56,851][106226] Updated weights for policy 0, policy_version 264888 (0.0009) [2023-12-27 21:07:56,896][106226] Updated weights for policy 0, policy_version 264898 (0.0008) [2023-12-27 21:07:56,971][106225] Updated weights for policy 1, policy_version 265318 (0.0008) [2023-12-27 21:07:57,024][106225] Updated weights for policy 1, policy_version 265328 (0.0009) [2023-12-27 21:07:57,072][106225] Updated weights for policy 1, policy_version 265338 (0.0008) [2023-12-27 21:07:57,529][106226] Updated weights for policy 0, policy_version 264908 (0.0008) [2023-12-27 21:07:57,587][106226] Updated weights for policy 0, policy_version 264918 (0.0008) [2023-12-27 21:07:57,641][106226] Updated weights for policy 0, policy_version 264928 (0.0008) [2023-12-27 21:07:57,864][106225] Updated weights for policy 1, policy_version 265348 (0.0009) [2023-12-27 21:07:57,920][106225] Updated weights for policy 1, policy_version 265358 (0.0010) [2023-12-27 21:07:57,965][106225] Updated weights for policy 1, policy_version 265368 (0.0010) [2023-12-27 21:07:58,362][106226] Updated weights for policy 0, policy_version 264938 (0.0008) [2023-12-27 21:07:58,435][106226] Updated weights for policy 0, policy_version 264948 (0.0008) [2023-12-27 21:07:58,501][106226] Updated weights for policy 0, policy_version 264958 (0.0010) [2023-12-27 21:07:58,567][106226] Updated weights for policy 0, policy_version 264968 (0.0008) [2023-12-27 21:07:58,729][106225] Updated weights for policy 1, policy_version 265378 (0.0009) [2023-12-27 21:07:58,803][106225] Updated weights for policy 1, policy_version 265388 (0.0009) [2023-12-27 21:07:58,871][106225] Updated weights for policy 1, policy_version 265398 (0.0009) [2023-12-27 21:07:58,938][106225] Updated weights for policy 1, policy_version 265408 (0.0015) [2023-12-27 21:07:59,344][106226] Updated weights for policy 0, policy_version 264978 (0.0009) [2023-12-27 21:07:59,410][106226] Updated weights for policy 0, policy_version 264988 (0.0009) [2023-12-27 21:07:59,460][106226] Updated weights for policy 0, policy_version 264998 (0.0009) [2023-12-27 21:07:59,658][106225] Updated weights for policy 1, policy_version 265418 (0.0010) [2023-12-27 21:07:59,718][106225] Updated weights for policy 1, policy_version 265428 (0.0007) [2023-12-27 21:07:59,775][106225] Updated weights for policy 1, policy_version 265438 (0.0005) [2023-12-27 21:08:00,290][106226] Updated weights for policy 0, policy_version 265008 (0.0007) [2023-12-27 21:08:00,352][106226] Updated weights for policy 0, policy_version 265018 (0.0006) [2023-12-27 21:08:00,409][106226] Updated weights for policy 0, policy_version 265028 (0.0006) [2023-12-27 21:08:00,457][106225] Updated weights for policy 1, policy_version 265448 (0.0007) [2023-12-27 21:08:00,518][106225] Updated weights for policy 1, policy_version 265458 (0.0006) [2023-12-27 21:08:00,578][106225] Updated weights for policy 1, policy_version 265468 (0.0008) [2023-12-27 21:08:01,077][106226] Updated weights for policy 0, policy_version 265038 (0.0009) [2023-12-27 21:08:01,141][106226] Updated weights for policy 0, policy_version 265048 (0.0010) [2023-12-27 21:08:01,166][106225] Updated weights for policy 1, policy_version 265478 (0.0008) [2023-12-27 21:08:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 135847936. Throughput: 0: 10042.7, 1: 10136.2. Samples: 135842572. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:01,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.996')] [2023-12-27 21:08:01,203][106226] Updated weights for policy 0, policy_version 265058 (0.0009) [2023-12-27 21:08:01,224][106225] Updated weights for policy 1, policy_version 265488 (0.0007) [2023-12-27 21:08:01,290][106225] Updated weights for policy 1, policy_version 265498 (0.0009) [2023-12-27 21:08:01,974][106226] Updated weights for policy 0, policy_version 265068 (0.0007) [2023-12-27 21:08:02,031][106226] Updated weights for policy 0, policy_version 265078 (0.0008) [2023-12-27 21:08:02,046][106225] Updated weights for policy 1, policy_version 265508 (0.0007) [2023-12-27 21:08:02,087][106226] Updated weights for policy 0, policy_version 265088 (0.0008) [2023-12-27 21:08:02,097][106225] Updated weights for policy 1, policy_version 265518 (0.0007) [2023-12-27 21:08:02,155][106225] Updated weights for policy 1, policy_version 265528 (0.0008) [2023-12-27 21:08:02,836][106226] Updated weights for policy 0, policy_version 265098 (0.0006) [2023-12-27 21:08:02,895][106225] Updated weights for policy 1, policy_version 265538 (0.0008) [2023-12-27 21:08:02,897][106226] Updated weights for policy 0, policy_version 265108 (0.0006) [2023-12-27 21:08:02,942][106225] Updated weights for policy 1, policy_version 265548 (0.0006) [2023-12-27 21:08:02,956][106226] Updated weights for policy 0, policy_version 265118 (0.0007) [2023-12-27 21:08:02,997][106225] Updated weights for policy 1, policy_version 265558 (0.0008) [2023-12-27 21:08:03,007][106226] Updated weights for policy 0, policy_version 265128 (0.0006) [2023-12-27 21:08:03,051][106225] Updated weights for policy 1, policy_version 265568 (0.0010) [2023-12-27 21:08:03,666][106226] Updated weights for policy 0, policy_version 265138 (0.0006) [2023-12-27 21:08:03,733][106226] Updated weights for policy 0, policy_version 265148 (0.0005) [2023-12-27 21:08:03,769][106225] Updated weights for policy 1, policy_version 265578 (0.0005) [2023-12-27 21:08:03,790][106226] Updated weights for policy 0, policy_version 265158 (0.0007) [2023-12-27 21:08:03,817][106225] Updated weights for policy 1, policy_version 265588 (0.0006) [2023-12-27 21:08:03,875][106225] Updated weights for policy 1, policy_version 265598 (0.0007) [2023-12-27 21:08:04,452][106226] Updated weights for policy 0, policy_version 265168 (0.0009) [2023-12-27 21:08:04,512][106226] Updated weights for policy 0, policy_version 265178 (0.0009) [2023-12-27 21:08:04,534][106225] Updated weights for policy 1, policy_version 265608 (0.0006) [2023-12-27 21:08:04,570][106226] Updated weights for policy 0, policy_version 265188 (0.0009) [2023-12-27 21:08:04,591][106225] Updated weights for policy 1, policy_version 265618 (0.0005) [2023-12-27 21:08:04,647][106225] Updated weights for policy 1, policy_version 265628 (0.0009) [2023-12-27 21:08:05,232][106225] Updated weights for policy 1, policy_version 265638 (0.0007) [2023-12-27 21:08:05,289][106226] Updated weights for policy 0, policy_version 265198 (0.0008) [2023-12-27 21:08:05,291][106225] Updated weights for policy 1, policy_version 265648 (0.0007) [2023-12-27 21:08:05,334][106226] Updated weights for policy 0, policy_version 265208 (0.0007) [2023-12-27 21:08:05,353][106225] Updated weights for policy 1, policy_version 265658 (0.0008) [2023-12-27 21:08:05,378][106226] Updated weights for policy 0, policy_version 265218 (0.0007) [2023-12-27 21:08:06,068][106226] Updated weights for policy 0, policy_version 265228 (0.0009) [2023-12-27 21:08:06,091][106225] Updated weights for policy 1, policy_version 265668 (0.0009) [2023-12-27 21:08:06,131][106226] Updated weights for policy 0, policy_version 265238 (0.0008) [2023-12-27 21:08:06,155][106225] Updated weights for policy 1, policy_version 265678 (0.0012) [2023-12-27 21:08:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 135946240. Throughput: 0: 9976.1, 1: 10195.6. Samples: 135962548. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:06,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-5.855')] [2023-12-27 21:08:06,189][106226] Updated weights for policy 0, policy_version 265248 (0.0009) [2023-12-27 21:08:06,216][106225] Updated weights for policy 1, policy_version 265688 (0.0010) [2023-12-27 21:08:06,952][106226] Updated weights for policy 0, policy_version 265258 (0.0007) [2023-12-27 21:08:06,985][106225] Updated weights for policy 1, policy_version 265698 (0.0010) [2023-12-27 21:08:07,021][106226] Updated weights for policy 0, policy_version 265268 (0.0009) [2023-12-27 21:08:07,047][106225] Updated weights for policy 1, policy_version 265708 (0.0006) [2023-12-27 21:08:07,081][106226] Updated weights for policy 0, policy_version 265278 (0.0008) [2023-12-27 21:08:07,099][106225] Updated weights for policy 1, policy_version 265718 (0.0007) [2023-12-27 21:08:07,145][106226] Updated weights for policy 0, policy_version 265288 (0.0008) [2023-12-27 21:08:07,151][106225] Updated weights for policy 1, policy_version 265728 (0.0007) [2023-12-27 21:08:07,806][106226] Updated weights for policy 0, policy_version 265298 (0.0009) [2023-12-27 21:08:07,820][106225] Updated weights for policy 1, policy_version 265738 (0.0005) [2023-12-27 21:08:07,852][106226] Updated weights for policy 0, policy_version 265308 (0.0009) [2023-12-27 21:08:07,879][106225] Updated weights for policy 1, policy_version 265748 (0.0005) [2023-12-27 21:08:07,905][106226] Updated weights for policy 0, policy_version 265318 (0.0006) [2023-12-27 21:08:07,940][106225] Updated weights for policy 1, policy_version 265758 (0.0007) [2023-12-27 21:08:08,607][106225] Updated weights for policy 1, policy_version 265768 (0.0008) [2023-12-27 21:08:08,656][106226] Updated weights for policy 0, policy_version 265328 (0.0006) [2023-12-27 21:08:08,670][106225] Updated weights for policy 1, policy_version 265778 (0.0009) [2023-12-27 21:08:08,715][106226] Updated weights for policy 0, policy_version 265338 (0.0007) [2023-12-27 21:08:08,732][106225] Updated weights for policy 1, policy_version 265788 (0.0009) [2023-12-27 21:08:08,772][106226] Updated weights for policy 0, policy_version 265348 (0.0007) [2023-12-27 21:08:09,388][106225] Updated weights for policy 1, policy_version 265798 (0.0008) [2023-12-27 21:08:09,457][106225] Updated weights for policy 1, policy_version 265808 (0.0006) [2023-12-27 21:08:09,508][106226] Updated weights for policy 0, policy_version 265358 (0.0009) [2023-12-27 21:08:09,519][106225] Updated weights for policy 1, policy_version 265818 (0.0008) [2023-12-27 21:08:09,571][106226] Updated weights for policy 0, policy_version 265368 (0.0009) [2023-12-27 21:08:09,634][106226] Updated weights for policy 0, policy_version 265378 (0.0008) [2023-12-27 21:08:10,297][106225] Updated weights for policy 1, policy_version 265828 (0.0006) [2023-12-27 21:08:10,303][106226] Updated weights for policy 0, policy_version 265388 (0.0008) [2023-12-27 21:08:10,360][106225] Updated weights for policy 1, policy_version 265838 (0.0007) [2023-12-27 21:08:10,365][106226] Updated weights for policy 0, policy_version 265398 (0.0007) [2023-12-27 21:08:10,417][106225] Updated weights for policy 1, policy_version 265848 (0.0010) [2023-12-27 21:08:10,427][106226] Updated weights for policy 0, policy_version 265408 (0.0007) [2023-12-27 21:08:10,991][106226] Updated weights for policy 0, policy_version 265418 (0.0006) [2023-12-27 21:08:11,053][106226] Updated weights for policy 0, policy_version 265428 (0.0007) [2023-12-27 21:08:11,102][106225] Updated weights for policy 1, policy_version 265858 (0.0008) [2023-12-27 21:08:11,127][106226] Updated weights for policy 0, policy_version 265438 (0.0008) [2023-12-27 21:08:11,168][106225] Updated weights for policy 1, policy_version 265868 (0.0008) [2023-12-27 21:08:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 136044544. Throughput: 0: 9973.1, 1: 10200.2. Samples: 136020668. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:11,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-6.078')] [2023-12-27 21:08:11,197][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000265448_67977216.pth... [2023-12-27 21:08:11,197][106226] Updated weights for policy 0, policy_version 265448 (0.0009) [2023-12-27 21:08:11,201][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000264280_67674112.pth [2023-12-27 21:08:11,228][106225] Updated weights for policy 1, policy_version 265878 (0.0008) [2023-12-27 21:08:11,294][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000265888_68083712.pth... [2023-12-27 21:08:11,295][106225] Updated weights for policy 1, policy_version 265888 (0.0008) [2023-12-27 21:08:11,298][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000264704_67780608.pth [2023-12-27 21:08:11,911][106226] Updated weights for policy 0, policy_version 265458 (0.0006) [2023-12-27 21:08:11,968][106226] Updated weights for policy 0, policy_version 265468 (0.0009) [2023-12-27 21:08:12,018][106226] Updated weights for policy 0, policy_version 265478 (0.0006) [2023-12-27 21:08:12,029][106225] Updated weights for policy 1, policy_version 265898 (0.0008) [2023-12-27 21:08:12,090][106225] Updated weights for policy 1, policy_version 265908 (0.0006) [2023-12-27 21:08:12,148][106225] Updated weights for policy 1, policy_version 265918 (0.0005) [2023-12-27 21:08:12,693][106226] Updated weights for policy 0, policy_version 265488 (0.0008) [2023-12-27 21:08:12,754][106226] Updated weights for policy 0, policy_version 265498 (0.0008) [2023-12-27 21:08:12,811][106226] Updated weights for policy 0, policy_version 265508 (0.0008) [2023-12-27 21:08:12,882][106225] Updated weights for policy 1, policy_version 265928 (0.0008) [2023-12-27 21:08:12,940][106225] Updated weights for policy 1, policy_version 265938 (0.0009) [2023-12-27 21:08:12,999][106225] Updated weights for policy 1, policy_version 265948 (0.0008) [2023-12-27 21:08:13,456][106226] Updated weights for policy 0, policy_version 265518 (0.0007) [2023-12-27 21:08:13,519][106226] Updated weights for policy 0, policy_version 265528 (0.0005) [2023-12-27 21:08:13,576][106226] Updated weights for policy 0, policy_version 265538 (0.0008) [2023-12-27 21:08:13,657][106225] Updated weights for policy 1, policy_version 265958 (0.0008) [2023-12-27 21:08:13,702][106225] Updated weights for policy 1, policy_version 265968 (0.0008) [2023-12-27 21:08:13,753][106225] Updated weights for policy 1, policy_version 265978 (0.0008) [2023-12-27 21:08:14,169][106226] Updated weights for policy 0, policy_version 265548 (0.0008) [2023-12-27 21:08:14,224][106226] Updated weights for policy 0, policy_version 265558 (0.0008) [2023-12-27 21:08:14,280][106226] Updated weights for policy 0, policy_version 265568 (0.0009) [2023-12-27 21:08:14,561][106225] Updated weights for policy 1, policy_version 265988 (0.0008) [2023-12-27 21:08:14,616][106225] Updated weights for policy 1, policy_version 265998 (0.0009) [2023-12-27 21:08:14,682][106225] Updated weights for policy 1, policy_version 266008 (0.0010) [2023-12-27 21:08:14,887][106226] Updated weights for policy 0, policy_version 265578 (0.0005) [2023-12-27 21:08:14,946][106226] Updated weights for policy 0, policy_version 265588 (0.0006) [2023-12-27 21:08:15,006][106226] Updated weights for policy 0, policy_version 265598 (0.0007) [2023-12-27 21:08:15,058][106226] Updated weights for policy 0, policy_version 265608 (0.0006) [2023-12-27 21:08:15,481][106225] Updated weights for policy 1, policy_version 266018 (0.0009) [2023-12-27 21:08:15,539][106225] Updated weights for policy 1, policy_version 266028 (0.0008) [2023-12-27 21:08:15,590][106225] Updated weights for policy 1, policy_version 266038 (0.0008) [2023-12-27 21:08:15,648][106225] Updated weights for policy 1, policy_version 266048 (0.0005) [2023-12-27 21:08:15,782][106226] Updated weights for policy 0, policy_version 265618 (0.0006) [2023-12-27 21:08:15,836][106226] Updated weights for policy 0, policy_version 265628 (0.0009) [2023-12-27 21:08:15,885][106226] Updated weights for policy 0, policy_version 265638 (0.0009) [2023-12-27 21:08:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 136151040. Throughput: 0: 9989.9, 1: 10022.0. Samples: 136140904. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:16,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-5.863')] [2023-12-27 21:08:16,276][106225] Updated weights for policy 1, policy_version 266058 (0.0005) [2023-12-27 21:08:16,342][106225] Updated weights for policy 1, policy_version 266068 (0.0008) [2023-12-27 21:08:16,409][106225] Updated weights for policy 1, policy_version 266078 (0.0008) [2023-12-27 21:08:16,587][106226] Updated weights for policy 0, policy_version 265648 (0.0005) [2023-12-27 21:08:16,652][106226] Updated weights for policy 0, policy_version 265658 (0.0008) [2023-12-27 21:08:16,702][106226] Updated weights for policy 0, policy_version 265668 (0.0006) [2023-12-27 21:08:17,051][106225] Updated weights for policy 1, policy_version 266088 (0.0010) [2023-12-27 21:08:17,110][106225] Updated weights for policy 1, policy_version 266098 (0.0010) [2023-12-27 21:08:17,163][106225] Updated weights for policy 1, policy_version 266108 (0.0010) [2023-12-27 21:08:17,329][106226] Updated weights for policy 0, policy_version 265678 (0.0007) [2023-12-27 21:08:17,387][106226] Updated weights for policy 0, policy_version 265688 (0.0009) [2023-12-27 21:08:17,452][106226] Updated weights for policy 0, policy_version 265698 (0.0010) [2023-12-27 21:08:17,837][106225] Updated weights for policy 1, policy_version 266118 (0.0007) [2023-12-27 21:08:17,896][106225] Updated weights for policy 1, policy_version 266128 (0.0009) [2023-12-27 21:08:17,952][106225] Updated weights for policy 1, policy_version 266138 (0.0006) [2023-12-27 21:08:18,071][106226] Updated weights for policy 0, policy_version 265708 (0.0011) [2023-12-27 21:08:18,134][106226] Updated weights for policy 0, policy_version 265718 (0.0011) [2023-12-27 21:08:18,189][106226] Updated weights for policy 0, policy_version 265728 (0.0010) [2023-12-27 21:08:18,535][106225] Updated weights for policy 1, policy_version 266148 (0.0009) [2023-12-27 21:08:18,589][106225] Updated weights for policy 1, policy_version 266158 (0.0010) [2023-12-27 21:08:18,646][106225] Updated weights for policy 1, policy_version 266168 (0.0010) [2023-12-27 21:08:18,935][106226] Updated weights for policy 0, policy_version 265738 (0.0011) [2023-12-27 21:08:19,001][106226] Updated weights for policy 0, policy_version 265748 (0.0011) [2023-12-27 21:08:19,054][106226] Updated weights for policy 0, policy_version 265758 (0.0011) [2023-12-27 21:08:19,104][106226] Updated weights for policy 0, policy_version 265768 (0.0010) [2023-12-27 21:08:19,219][106225] Updated weights for policy 1, policy_version 266178 (0.0010) [2023-12-27 21:08:19,288][106225] Updated weights for policy 1, policy_version 266188 (0.0010) [2023-12-27 21:08:19,354][106225] Updated weights for policy 1, policy_version 266198 (0.0009) [2023-12-27 21:08:19,418][106225] Updated weights for policy 1, policy_version 266208 (0.0010) [2023-12-27 21:08:19,818][106226] Updated weights for policy 0, policy_version 265778 (0.0007) [2023-12-27 21:08:19,912][106226] Updated weights for policy 0, policy_version 265788 (0.0008) [2023-12-27 21:08:19,972][106226] Updated weights for policy 0, policy_version 265798 (0.0008) [2023-12-27 21:08:20,156][106225] Updated weights for policy 1, policy_version 266218 (0.0010) [2023-12-27 21:08:20,218][106225] Updated weights for policy 1, policy_version 266228 (0.0010) [2023-12-27 21:08:20,275][106225] Updated weights for policy 1, policy_version 266238 (0.0008) [2023-12-27 21:08:20,658][106226] Updated weights for policy 0, policy_version 265808 (0.0009) [2023-12-27 21:08:20,725][106226] Updated weights for policy 0, policy_version 265818 (0.0008) [2023-12-27 21:08:20,789][106226] Updated weights for policy 0, policy_version 265828 (0.0008) [2023-12-27 21:08:20,962][106225] Updated weights for policy 1, policy_version 266248 (0.0010) [2023-12-27 21:08:21,026][106225] Updated weights for policy 1, policy_version 266258 (0.0010) [2023-12-27 21:08:21,097][106225] Updated weights for policy 1, policy_version 266268 (0.0007) [2023-12-27 21:08:21,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 136257536. Throughput: 0: 9971.2, 1: 10085.2. Samples: 136262712. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:21,175][105115] Avg episode reward: [(0, '-4.952'), (1, '-5.908')] [2023-12-27 21:08:21,599][106226] Updated weights for policy 0, policy_version 265838 (0.0008) [2023-12-27 21:08:21,664][106226] Updated weights for policy 0, policy_version 265848 (0.0008) [2023-12-27 21:08:21,726][106226] Updated weights for policy 0, policy_version 265858 (0.0008) [2023-12-27 21:08:21,828][106225] Updated weights for policy 1, policy_version 266278 (0.0010) [2023-12-27 21:08:21,899][106225] Updated weights for policy 1, policy_version 266288 (0.0009) [2023-12-27 21:08:21,957][106225] Updated weights for policy 1, policy_version 266298 (0.0010) [2023-12-27 21:08:22,434][106226] Updated weights for policy 0, policy_version 265868 (0.0008) [2023-12-27 21:08:22,505][106226] Updated weights for policy 0, policy_version 265878 (0.0008) [2023-12-27 21:08:22,570][106226] Updated weights for policy 0, policy_version 265888 (0.0006) [2023-12-27 21:08:22,669][106225] Updated weights for policy 1, policy_version 266308 (0.0010) [2023-12-27 21:08:22,754][106225] Updated weights for policy 1, policy_version 266318 (0.0010) [2023-12-27 21:08:22,805][106225] Updated weights for policy 1, policy_version 266328 (0.0010) [2023-12-27 21:08:23,183][106226] Updated weights for policy 0, policy_version 265898 (0.0007) [2023-12-27 21:08:23,234][106226] Updated weights for policy 0, policy_version 265908 (0.0008) [2023-12-27 21:08:23,286][106226] Updated weights for policy 0, policy_version 265918 (0.0008) [2023-12-27 21:08:23,345][106226] Updated weights for policy 0, policy_version 265928 (0.0007) [2023-12-27 21:08:23,445][106225] Updated weights for policy 1, policy_version 266338 (0.0010) [2023-12-27 21:08:23,502][106225] Updated weights for policy 1, policy_version 266348 (0.0010) [2023-12-27 21:08:23,555][106225] Updated weights for policy 1, policy_version 266358 (0.0010) [2023-12-27 21:08:23,616][106225] Updated weights for policy 1, policy_version 266368 (0.0010) [2023-12-27 21:08:24,089][106226] Updated weights for policy 0, policy_version 265938 (0.0008) [2023-12-27 21:08:24,155][106226] Updated weights for policy 0, policy_version 265948 (0.0009) [2023-12-27 21:08:24,212][106226] Updated weights for policy 0, policy_version 265958 (0.0007) [2023-12-27 21:08:24,228][106225] Updated weights for policy 1, policy_version 266378 (0.0007) [2023-12-27 21:08:24,282][106225] Updated weights for policy 1, policy_version 266388 (0.0010) [2023-12-27 21:08:24,335][106225] Updated weights for policy 1, policy_version 266398 (0.0010) [2023-12-27 21:08:24,933][106226] Updated weights for policy 0, policy_version 265968 (0.0009) [2023-12-27 21:08:24,985][106226] Updated weights for policy 0, policy_version 265978 (0.0008) [2023-12-27 21:08:25,041][106226] Updated weights for policy 0, policy_version 265988 (0.0006) [2023-12-27 21:08:25,050][106225] Updated weights for policy 1, policy_version 266408 (0.0010) [2023-12-27 21:08:25,096][106225] Updated weights for policy 1, policy_version 266418 (0.0010) [2023-12-27 21:08:25,146][106225] Updated weights for policy 1, policy_version 266428 (0.0010) [2023-12-27 21:08:25,798][106226] Updated weights for policy 0, policy_version 265998 (0.0007) [2023-12-27 21:08:25,855][106226] Updated weights for policy 0, policy_version 266008 (0.0008) [2023-12-27 21:08:25,878][106225] Updated weights for policy 1, policy_version 266438 (0.0010) [2023-12-27 21:08:25,902][106226] Updated weights for policy 0, policy_version 266018 (0.0009) [2023-12-27 21:08:25,931][106225] Updated weights for policy 1, policy_version 266448 (0.0010) [2023-12-27 21:08:25,990][106225] Updated weights for policy 1, policy_version 266458 (0.0010) [2023-12-27 21:08:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.5, 300 sec: 19938.5). Total num frames: 136355840. Throughput: 0: 9938.0, 1: 10066.0. Samples: 136321400. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:26,175][105115] Avg episode reward: [(0, '-5.006'), (1, '-5.831')] [2023-12-27 21:08:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000266024_68124672.pth... [2023-12-27 21:08:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000266464_68231168.pth... [2023-12-27 21:08:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000264872_67829760.pth [2023-12-27 21:08:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000265312_67936256.pth [2023-12-27 21:08:26,624][106226] Updated weights for policy 0, policy_version 266028 (0.0006) [2023-12-27 21:08:26,686][106226] Updated weights for policy 0, policy_version 266038 (0.0007) [2023-12-27 21:08:26,713][106225] Updated weights for policy 1, policy_version 266468 (0.0010) [2023-12-27 21:08:26,745][106226] Updated weights for policy 0, policy_version 266048 (0.0008) [2023-12-27 21:08:26,775][106225] Updated weights for policy 1, policy_version 266478 (0.0010) [2023-12-27 21:08:26,837][106225] Updated weights for policy 1, policy_version 266488 (0.0010) [2023-12-27 21:08:27,337][106226] Updated weights for policy 0, policy_version 266058 (0.0010) [2023-12-27 21:08:27,403][106226] Updated weights for policy 0, policy_version 266068 (0.0009) [2023-12-27 21:08:27,462][106226] Updated weights for policy 0, policy_version 266078 (0.0007) [2023-12-27 21:08:27,473][106225] Updated weights for policy 1, policy_version 266498 (0.0010) [2023-12-27 21:08:27,519][106226] Updated weights for policy 0, policy_version 266088 (0.0007) [2023-12-27 21:08:27,529][106225] Updated weights for policy 1, policy_version 266508 (0.0010) [2023-12-27 21:08:27,574][106225] Updated weights for policy 1, policy_version 266518 (0.0010) [2023-12-27 21:08:27,633][106225] Updated weights for policy 1, policy_version 266528 (0.0007) [2023-12-27 21:08:28,112][106226] Updated weights for policy 0, policy_version 266098 (0.0007) [2023-12-27 21:08:28,170][106226] Updated weights for policy 0, policy_version 266108 (0.0005) [2023-12-27 21:08:28,196][106225] Updated weights for policy 1, policy_version 266538 (0.0010) [2023-12-27 21:08:28,225][106226] Updated weights for policy 0, policy_version 266118 (0.0006) [2023-12-27 21:08:28,252][106225] Updated weights for policy 1, policy_version 266548 (0.0010) [2023-12-27 21:08:28,299][106225] Updated weights for policy 1, policy_version 266558 (0.0010) [2023-12-27 21:08:28,918][106226] Updated weights for policy 0, policy_version 266128 (0.0007) [2023-12-27 21:08:28,973][106226] Updated weights for policy 0, policy_version 266138 (0.0007) [2023-12-27 21:08:29,028][106226] Updated weights for policy 0, policy_version 266148 (0.0007) [2023-12-27 21:08:29,040][106225] Updated weights for policy 1, policy_version 266568 (0.0010) [2023-12-27 21:08:29,102][106225] Updated weights for policy 1, policy_version 266578 (0.0010) [2023-12-27 21:08:29,155][106225] Updated weights for policy 1, policy_version 266588 (0.0010) [2023-12-27 21:08:29,734][106226] Updated weights for policy 0, policy_version 266158 (0.0007) [2023-12-27 21:08:29,795][106226] Updated weights for policy 0, policy_version 266168 (0.0009) [2023-12-27 21:08:29,808][106225] Updated weights for policy 1, policy_version 266598 (0.0010) [2023-12-27 21:08:29,858][106226] Updated weights for policy 0, policy_version 266178 (0.0011) [2023-12-27 21:08:29,871][106225] Updated weights for policy 1, policy_version 266608 (0.0009) [2023-12-27 21:08:29,939][106225] Updated weights for policy 1, policy_version 266618 (0.0010) [2023-12-27 21:08:30,515][106226] Updated weights for policy 0, policy_version 266188 (0.0008) [2023-12-27 21:08:30,577][106226] Updated weights for policy 0, policy_version 266198 (0.0008) [2023-12-27 21:08:30,630][106226] Updated weights for policy 0, policy_version 266208 (0.0008) [2023-12-27 21:08:30,672][106225] Updated weights for policy 1, policy_version 266628 (0.0010) [2023-12-27 21:08:30,729][106225] Updated weights for policy 1, policy_version 266638 (0.0010) [2023-12-27 21:08:30,787][106225] Updated weights for policy 1, policy_version 266648 (0.0010) [2023-12-27 21:08:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 136454144. Throughput: 0: 9958.0, 1: 10159.2. Samples: 136444068. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-27 21:08:31,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.846')] [2023-12-27 21:08:31,384][106226] Updated weights for policy 0, policy_version 266218 (0.0008) [2023-12-27 21:08:31,450][106226] Updated weights for policy 0, policy_version 266228 (0.0006) [2023-12-27 21:08:31,518][106226] Updated weights for policy 0, policy_version 266238 (0.0008) [2023-12-27 21:08:31,551][106225] Updated weights for policy 1, policy_version 266658 (0.0010) [2023-12-27 21:08:31,575][106226] Updated weights for policy 0, policy_version 266248 (0.0007) [2023-12-27 21:08:31,609][106225] Updated weights for policy 1, policy_version 266668 (0.0009) [2023-12-27 21:08:31,675][106225] Updated weights for policy 1, policy_version 266678 (0.0011) [2023-12-27 21:08:31,749][106225] Updated weights for policy 1, policy_version 266688 (0.0011) [2023-12-27 21:08:32,294][106226] Updated weights for policy 0, policy_version 266258 (0.0010) [2023-12-27 21:08:32,361][106226] Updated weights for policy 0, policy_version 266268 (0.0010) [2023-12-27 21:08:32,430][106226] Updated weights for policy 0, policy_version 266278 (0.0010) [2023-12-27 21:08:32,481][106225] Updated weights for policy 1, policy_version 266698 (0.0007) [2023-12-27 21:08:32,535][106225] Updated weights for policy 1, policy_version 266708 (0.0007) [2023-12-27 21:08:32,589][106225] Updated weights for policy 1, policy_version 266718 (0.0008) [2023-12-27 21:08:33,098][106226] Updated weights for policy 0, policy_version 266288 (0.0010) [2023-12-27 21:08:33,158][106226] Updated weights for policy 0, policy_version 266298 (0.0007) [2023-12-27 21:08:33,214][106226] Updated weights for policy 0, policy_version 266308 (0.0005) [2023-12-27 21:08:33,263][106225] Updated weights for policy 1, policy_version 266728 (0.0006) [2023-12-27 21:08:33,326][106225] Updated weights for policy 1, policy_version 266738 (0.0005) [2023-12-27 21:08:33,394][106225] Updated weights for policy 1, policy_version 266748 (0.0005) [2023-12-27 21:08:33,780][106226] Updated weights for policy 0, policy_version 266318 (0.0008) [2023-12-27 21:08:33,834][106226] Updated weights for policy 0, policy_version 266328 (0.0011) [2023-12-27 21:08:33,881][106226] Updated weights for policy 0, policy_version 266338 (0.0010) [2023-12-27 21:08:33,985][106225] Updated weights for policy 1, policy_version 266758 (0.0007) [2023-12-27 21:08:34,042][106225] Updated weights for policy 1, policy_version 266768 (0.0008) [2023-12-27 21:08:34,107][106225] Updated weights for policy 1, policy_version 266778 (0.0008) [2023-12-27 21:08:34,664][106226] Updated weights for policy 0, policy_version 266348 (0.0010) [2023-12-27 21:08:34,713][106225] Updated weights for policy 1, policy_version 266788 (0.0007) [2023-12-27 21:08:34,718][106226] Updated weights for policy 0, policy_version 266358 (0.0008) [2023-12-27 21:08:34,759][106225] Updated weights for policy 1, policy_version 266798 (0.0007) [2023-12-27 21:08:34,774][106226] Updated weights for policy 0, policy_version 266368 (0.0008) [2023-12-27 21:08:34,809][106225] Updated weights for policy 1, policy_version 266808 (0.0007) [2023-12-27 21:08:35,526][106226] Updated weights for policy 0, policy_version 266378 (0.0010) [2023-12-27 21:08:35,573][106225] Updated weights for policy 1, policy_version 266818 (0.0008) [2023-12-27 21:08:35,592][106226] Updated weights for policy 0, policy_version 266388 (0.0011) [2023-12-27 21:08:35,627][106225] Updated weights for policy 1, policy_version 266828 (0.0008) [2023-12-27 21:08:35,655][106226] Updated weights for policy 0, policy_version 266398 (0.0011) [2023-12-27 21:08:35,671][106225] Updated weights for policy 1, policy_version 266838 (0.0008) [2023-12-27 21:08:35,718][106226] Updated weights for policy 0, policy_version 266408 (0.0011) [2023-12-27 21:08:35,727][106225] Updated weights for policy 1, policy_version 266848 (0.0007) [2023-12-27 21:08:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 136552448. Throughput: 0: 9907.6, 1: 10033.3. Samples: 136562824. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:08:36,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-5.999')] [2023-12-27 21:08:36,176][106140] Saving new best policy, reward=-4.349! [2023-12-27 21:08:36,424][106226] Updated weights for policy 0, policy_version 266418 (0.0011) [2023-12-27 21:08:36,458][106225] Updated weights for policy 1, policy_version 266858 (0.0006) [2023-12-27 21:08:36,479][106226] Updated weights for policy 0, policy_version 266428 (0.0011) [2023-12-27 21:08:36,507][106225] Updated weights for policy 1, policy_version 266868 (0.0009) [2023-12-27 21:08:36,542][106226] Updated weights for policy 0, policy_version 266438 (0.0011) [2023-12-27 21:08:36,565][106225] Updated weights for policy 1, policy_version 266878 (0.0007) [2023-12-27 21:08:37,284][106225] Updated weights for policy 1, policy_version 266888 (0.0009) [2023-12-27 21:08:37,306][106226] Updated weights for policy 0, policy_version 266448 (0.0007) [2023-12-27 21:08:37,347][106225] Updated weights for policy 1, policy_version 266898 (0.0010) [2023-12-27 21:08:37,372][106226] Updated weights for policy 0, policy_version 266458 (0.0006) [2023-12-27 21:08:37,409][106225] Updated weights for policy 1, policy_version 266908 (0.0010) [2023-12-27 21:08:37,431][106226] Updated weights for policy 0, policy_version 266468 (0.0006) [2023-12-27 21:08:38,099][106225] Updated weights for policy 1, policy_version 266918 (0.0011) [2023-12-27 21:08:38,141][106226] Updated weights for policy 0, policy_version 266478 (0.0010) [2023-12-27 21:08:38,159][106225] Updated weights for policy 1, policy_version 266928 (0.0010) [2023-12-27 21:08:38,204][106226] Updated weights for policy 0, policy_version 266488 (0.0010) [2023-12-27 21:08:38,220][106225] Updated weights for policy 1, policy_version 266938 (0.0010) [2023-12-27 21:08:38,269][106226] Updated weights for policy 0, policy_version 266498 (0.0008) [2023-12-27 21:08:38,790][106225] Updated weights for policy 1, policy_version 266948 (0.0008) [2023-12-27 21:08:38,846][106225] Updated weights for policy 1, policy_version 266958 (0.0006) [2023-12-27 21:08:38,893][106225] Updated weights for policy 1, policy_version 266968 (0.0005) [2023-12-27 21:08:38,993][106226] Updated weights for policy 0, policy_version 266508 (0.0008) [2023-12-27 21:08:39,048][106226] Updated weights for policy 0, policy_version 266518 (0.0006) [2023-12-27 21:08:39,113][106226] Updated weights for policy 0, policy_version 266528 (0.0006) [2023-12-27 21:08:39,664][106225] Updated weights for policy 1, policy_version 266978 (0.0009) [2023-12-27 21:08:39,729][106225] Updated weights for policy 1, policy_version 266988 (0.0005) [2023-12-27 21:08:39,786][106225] Updated weights for policy 1, policy_version 266998 (0.0006) [2023-12-27 21:08:39,826][106226] Updated weights for policy 0, policy_version 266538 (0.0010) [2023-12-27 21:08:39,860][106225] Updated weights for policy 1, policy_version 267008 (0.0008) [2023-12-27 21:08:39,895][106226] Updated weights for policy 0, policy_version 266548 (0.0008) [2023-12-27 21:08:39,966][106226] Updated weights for policy 0, policy_version 266558 (0.0009) [2023-12-27 21:08:40,032][106226] Updated weights for policy 0, policy_version 266568 (0.0010) [2023-12-27 21:08:40,433][106225] Updated weights for policy 1, policy_version 267018 (0.0007) [2023-12-27 21:08:40,482][106225] Updated weights for policy 1, policy_version 267028 (0.0009) [2023-12-27 21:08:40,541][106225] Updated weights for policy 1, policy_version 267038 (0.0008) [2023-12-27 21:08:40,855][106226] Updated weights for policy 0, policy_version 266578 (0.0008) [2023-12-27 21:08:40,905][106226] Updated weights for policy 0, policy_version 266588 (0.0009) [2023-12-27 21:08:40,951][106226] Updated weights for policy 0, policy_version 266598 (0.0008) [2023-12-27 21:08:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 136650752. Throughput: 0: 9922.7, 1: 10022.5. Samples: 136621696. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:08:41,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-5.978')] [2023-12-27 21:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000266600_68272128.pth... [2023-12-27 21:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000265448_67977216.pth [2023-12-27 21:08:41,232][106225] Updated weights for policy 1, policy_version 267048 (0.0008) [2023-12-27 21:08:41,298][106225] Updated weights for policy 1, policy_version 267058 (0.0008) [2023-12-27 21:08:41,361][106225] Updated weights for policy 1, policy_version 267068 (0.0007) [2023-12-27 21:08:41,389][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000267072_68386816.pth... [2023-12-27 21:08:41,394][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000265888_68083712.pth [2023-12-27 21:08:41,745][106226] Updated weights for policy 0, policy_version 266608 (0.0011) [2023-12-27 21:08:41,811][106226] Updated weights for policy 0, policy_version 266618 (0.0011) [2023-12-27 21:08:41,871][106226] Updated weights for policy 0, policy_version 266628 (0.0011) [2023-12-27 21:08:42,129][106225] Updated weights for policy 1, policy_version 267078 (0.0008) [2023-12-27 21:08:42,192][106225] Updated weights for policy 1, policy_version 267088 (0.0009) [2023-12-27 21:08:42,256][106225] Updated weights for policy 1, policy_version 267098 (0.0009) [2023-12-27 21:08:42,578][106226] Updated weights for policy 0, policy_version 266638 (0.0011) [2023-12-27 21:08:42,643][106226] Updated weights for policy 0, policy_version 266648 (0.0010) [2023-12-27 21:08:42,702][106226] Updated weights for policy 0, policy_version 266658 (0.0009) [2023-12-27 21:08:42,900][106225] Updated weights for policy 1, policy_version 267108 (0.0009) [2023-12-27 21:08:42,947][106225] Updated weights for policy 1, policy_version 267118 (0.0010) [2023-12-27 21:08:43,002][106225] Updated weights for policy 1, policy_version 267128 (0.0010) [2023-12-27 21:08:43,376][106226] Updated weights for policy 0, policy_version 266668 (0.0010) [2023-12-27 21:08:43,433][106226] Updated weights for policy 0, policy_version 266678 (0.0010) [2023-12-27 21:08:43,504][106226] Updated weights for policy 0, policy_version 266688 (0.0007) [2023-12-27 21:08:43,701][106225] Updated weights for policy 1, policy_version 267138 (0.0010) [2023-12-27 21:08:43,752][106225] Updated weights for policy 1, policy_version 267148 (0.0006) [2023-12-27 21:08:43,808][106225] Updated weights for policy 1, policy_version 267158 (0.0006) [2023-12-27 21:08:43,867][106225] Updated weights for policy 1, policy_version 267168 (0.0006) [2023-12-27 21:08:44,110][106226] Updated weights for policy 0, policy_version 266698 (0.0006) [2023-12-27 21:08:44,169][106226] Updated weights for policy 0, policy_version 266708 (0.0006) [2023-12-27 21:08:44,236][106226] Updated weights for policy 0, policy_version 266718 (0.0005) [2023-12-27 21:08:44,300][106226] Updated weights for policy 0, policy_version 266728 (0.0006) [2023-12-27 21:08:44,470][106225] Updated weights for policy 1, policy_version 267178 (0.0007) [2023-12-27 21:08:44,532][106225] Updated weights for policy 1, policy_version 267188 (0.0006) [2023-12-27 21:08:44,601][106225] Updated weights for policy 1, policy_version 267198 (0.0009) [2023-12-27 21:08:44,917][106226] Updated weights for policy 0, policy_version 266738 (0.0006) [2023-12-27 21:08:44,974][106226] Updated weights for policy 0, policy_version 266748 (0.0006) [2023-12-27 21:08:45,035][106226] Updated weights for policy 0, policy_version 266758 (0.0009) [2023-12-27 21:08:45,310][106225] Updated weights for policy 1, policy_version 267208 (0.0008) [2023-12-27 21:08:45,370][106225] Updated weights for policy 1, policy_version 267218 (0.0010) [2023-12-27 21:08:45,427][106225] Updated weights for policy 1, policy_version 267228 (0.0010) [2023-12-27 21:08:45,708][106226] Updated weights for policy 0, policy_version 266768 (0.0008) [2023-12-27 21:08:45,761][106226] Updated weights for policy 0, policy_version 266778 (0.0006) [2023-12-27 21:08:45,814][106226] Updated weights for policy 0, policy_version 266788 (0.0008) [2023-12-27 21:08:46,138][106225] Updated weights for policy 1, policy_version 267238 (0.0010) [2023-12-27 21:08:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 136749056. Throughput: 0: 9902.9, 1: 10051.5. Samples: 136740520. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:08:46,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.930')] [2023-12-27 21:08:46,201][106225] Updated weights for policy 1, policy_version 267248 (0.0010) [2023-12-27 21:08:46,264][106225] Updated weights for policy 1, policy_version 267258 (0.0010) [2023-12-27 21:08:46,347][106226] Updated weights for policy 0, policy_version 266798 (0.0005) [2023-12-27 21:08:46,400][106226] Updated weights for policy 0, policy_version 266808 (0.0005) [2023-12-27 21:08:46,448][106226] Updated weights for policy 0, policy_version 266818 (0.0005) [2023-12-27 21:08:46,951][106225] Updated weights for policy 1, policy_version 267268 (0.0008) [2023-12-27 21:08:47,006][106225] Updated weights for policy 1, policy_version 267278 (0.0010) [2023-12-27 21:08:47,061][106225] Updated weights for policy 1, policy_version 267288 (0.0009) [2023-12-27 21:08:47,071][106226] Updated weights for policy 0, policy_version 266828 (0.0007) [2023-12-27 21:08:47,127][106226] Updated weights for policy 0, policy_version 266838 (0.0010) [2023-12-27 21:08:47,190][106226] Updated weights for policy 0, policy_version 266848 (0.0010) [2023-12-27 21:08:47,674][106225] Updated weights for policy 1, policy_version 267298 (0.0010) [2023-12-27 21:08:47,725][106225] Updated weights for policy 1, policy_version 267308 (0.0010) [2023-12-27 21:08:47,740][106226] Updated weights for policy 0, policy_version 266858 (0.0009) [2023-12-27 21:08:47,782][106225] Updated weights for policy 1, policy_version 267318 (0.0007) [2023-12-27 21:08:47,799][106226] Updated weights for policy 0, policy_version 266868 (0.0005) [2023-12-27 21:08:47,846][106225] Updated weights for policy 1, policy_version 267328 (0.0005) [2023-12-27 21:08:47,854][106226] Updated weights for policy 0, policy_version 266878 (0.0005) [2023-12-27 21:08:47,914][106226] Updated weights for policy 0, policy_version 266888 (0.0005) [2023-12-27 21:08:48,391][106225] Updated weights for policy 1, policy_version 267338 (0.0010) [2023-12-27 21:08:48,441][106226] Updated weights for policy 0, policy_version 266898 (0.0006) [2023-12-27 21:08:48,449][106225] Updated weights for policy 1, policy_version 267348 (0.0010) [2023-12-27 21:08:48,500][106226] Updated weights for policy 0, policy_version 266908 (0.0010) [2023-12-27 21:08:48,503][106225] Updated weights for policy 1, policy_version 267358 (0.0005) [2023-12-27 21:08:48,555][106226] Updated weights for policy 0, policy_version 266918 (0.0011) [2023-12-27 21:08:49,125][106225] Updated weights for policy 1, policy_version 267368 (0.0009) [2023-12-27 21:08:49,175][106225] Updated weights for policy 1, policy_version 267378 (0.0010) [2023-12-27 21:08:49,234][106225] Updated weights for policy 1, policy_version 267388 (0.0010) [2023-12-27 21:08:49,261][106226] Updated weights for policy 0, policy_version 266928 (0.0010) [2023-12-27 21:08:49,330][106226] Updated weights for policy 0, policy_version 266938 (0.0011) [2023-12-27 21:08:49,399][106226] Updated weights for policy 0, policy_version 266948 (0.0009) [2023-12-27 21:08:50,000][106225] Updated weights for policy 1, policy_version 267398 (0.0009) [2023-12-27 21:08:50,026][106226] Updated weights for policy 0, policy_version 266958 (0.0009) [2023-12-27 21:08:50,051][106225] Updated weights for policy 1, policy_version 267408 (0.0010) [2023-12-27 21:08:50,090][106226] Updated weights for policy 0, policy_version 266968 (0.0011) [2023-12-27 21:08:50,101][106225] Updated weights for policy 1, policy_version 267418 (0.0010) [2023-12-27 21:08:50,156][106226] Updated weights for policy 0, policy_version 266978 (0.0011) [2023-12-27 21:08:50,750][106226] Updated weights for policy 0, policy_version 266988 (0.0006) [2023-12-27 21:08:50,804][106226] Updated weights for policy 0, policy_version 266998 (0.0005) [2023-12-27 21:08:50,858][106226] Updated weights for policy 0, policy_version 267008 (0.0010) [2023-12-27 21:08:50,914][106225] Updated weights for policy 1, policy_version 267428 (0.0008) [2023-12-27 21:08:50,975][106225] Updated weights for policy 1, policy_version 267438 (0.0008) [2023-12-27 21:08:51,032][106225] Updated weights for policy 1, policy_version 267448 (0.0007) [2023-12-27 21:08:51,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 136863744. Throughput: 0: 10076.6, 1: 10052.2. Samples: 136868348. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:08:51,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-6.105')] [2023-12-27 21:08:51,616][106226] Updated weights for policy 0, policy_version 267018 (0.0010) [2023-12-27 21:08:51,683][106226] Updated weights for policy 0, policy_version 267028 (0.0009) [2023-12-27 21:08:51,695][106225] Updated weights for policy 1, policy_version 267458 (0.0007) [2023-12-27 21:08:51,753][106226] Updated weights for policy 0, policy_version 267038 (0.0008) [2023-12-27 21:08:51,762][106225] Updated weights for policy 1, policy_version 267468 (0.0007) [2023-12-27 21:08:51,822][106226] Updated weights for policy 0, policy_version 267048 (0.0008) [2023-12-27 21:08:51,831][106225] Updated weights for policy 1, policy_version 267478 (0.0006) [2023-12-27 21:08:51,883][106225] Updated weights for policy 1, policy_version 267488 (0.0007) [2023-12-27 21:08:52,621][106225] Updated weights for policy 1, policy_version 267498 (0.0007) [2023-12-27 21:08:52,621][106226] Updated weights for policy 0, policy_version 267058 (0.0008) [2023-12-27 21:08:52,677][106226] Updated weights for policy 0, policy_version 267068 (0.0006) [2023-12-27 21:08:52,680][106225] Updated weights for policy 1, policy_version 267508 (0.0009) [2023-12-27 21:08:52,733][106225] Updated weights for policy 1, policy_version 267518 (0.0008) [2023-12-27 21:08:52,739][106226] Updated weights for policy 0, policy_version 267078 (0.0006) [2023-12-27 21:08:53,408][106226] Updated weights for policy 0, policy_version 267088 (0.0006) [2023-12-27 21:08:53,429][106225] Updated weights for policy 1, policy_version 267528 (0.0006) [2023-12-27 21:08:53,454][106226] Updated weights for policy 0, policy_version 267098 (0.0006) [2023-12-27 21:08:53,488][106225] Updated weights for policy 1, policy_version 267538 (0.0005) [2023-12-27 21:08:53,500][106226] Updated weights for policy 0, policy_version 267108 (0.0005) [2023-12-27 21:08:53,551][106225] Updated weights for policy 1, policy_version 267548 (0.0005) [2023-12-27 21:08:54,059][106226] Updated weights for policy 0, policy_version 267118 (0.0007) [2023-12-27 21:08:54,117][106226] Updated weights for policy 0, policy_version 267128 (0.0008) [2023-12-27 21:08:54,175][106226] Updated weights for policy 0, policy_version 267138 (0.0008) [2023-12-27 21:08:54,193][106225] Updated weights for policy 1, policy_version 267558 (0.0006) [2023-12-27 21:08:54,240][106225] Updated weights for policy 1, policy_version 267568 (0.0007) [2023-12-27 21:08:54,291][106225] Updated weights for policy 1, policy_version 267578 (0.0009) [2023-12-27 21:08:54,791][106226] Updated weights for policy 0, policy_version 267148 (0.0005) [2023-12-27 21:08:54,854][106226] Updated weights for policy 0, policy_version 267158 (0.0005) [2023-12-27 21:08:54,904][106226] Updated weights for policy 0, policy_version 267168 (0.0005) [2023-12-27 21:08:55,122][106225] Updated weights for policy 1, policy_version 267588 (0.0007) [2023-12-27 21:08:55,186][106225] Updated weights for policy 1, policy_version 267598 (0.0009) [2023-12-27 21:08:55,250][106225] Updated weights for policy 1, policy_version 267608 (0.0008) [2023-12-27 21:08:55,538][106226] Updated weights for policy 0, policy_version 267178 (0.0007) [2023-12-27 21:08:55,597][106226] Updated weights for policy 0, policy_version 267188 (0.0010) [2023-12-27 21:08:55,657][106226] Updated weights for policy 0, policy_version 267198 (0.0010) [2023-12-27 21:08:55,716][106226] Updated weights for policy 0, policy_version 267208 (0.0010) [2023-12-27 21:08:56,011][106225] Updated weights for policy 1, policy_version 267618 (0.0008) [2023-12-27 21:08:56,072][106225] Updated weights for policy 1, policy_version 267628 (0.0008) [2023-12-27 21:08:56,131][106225] Updated weights for policy 1, policy_version 267638 (0.0008) [2023-12-27 21:08:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 136953856. Throughput: 0: 10114.2, 1: 10072.6. Samples: 136929076. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:08:56,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.572')] [2023-12-27 21:08:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000267208_68427776.pth... [2023-12-27 21:08:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000266024_68124672.pth [2023-12-27 21:08:56,188][106225] Updated weights for policy 1, policy_version 267648 (0.0008) [2023-12-27 21:08:56,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000267648_68534272.pth... [2023-12-27 21:08:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000266464_68231168.pth [2023-12-27 21:08:56,367][106226] Updated weights for policy 0, policy_version 267218 (0.0009) [2023-12-27 21:08:56,430][106226] Updated weights for policy 0, policy_version 267228 (0.0009) [2023-12-27 21:08:56,492][106226] Updated weights for policy 0, policy_version 267238 (0.0008) [2023-12-27 21:08:56,877][106225] Updated weights for policy 1, policy_version 267658 (0.0008) [2023-12-27 21:08:56,931][106225] Updated weights for policy 1, policy_version 267668 (0.0008) [2023-12-27 21:08:56,989][106225] Updated weights for policy 1, policy_version 267678 (0.0008) [2023-12-27 21:08:57,114][106226] Updated weights for policy 0, policy_version 267248 (0.0009) [2023-12-27 21:08:57,170][106226] Updated weights for policy 0, policy_version 267258 (0.0010) [2023-12-27 21:08:57,228][106226] Updated weights for policy 0, policy_version 267268 (0.0010) [2023-12-27 21:08:57,695][106225] Updated weights for policy 1, policy_version 267688 (0.0009) [2023-12-27 21:08:57,757][106225] Updated weights for policy 1, policy_version 267698 (0.0008) [2023-12-27 21:08:57,806][106225] Updated weights for policy 1, policy_version 267708 (0.0009) [2023-12-27 21:08:57,862][106226] Updated weights for policy 0, policy_version 267278 (0.0005) [2023-12-27 21:08:57,926][106226] Updated weights for policy 0, policy_version 267288 (0.0006) [2023-12-27 21:08:57,977][106226] Updated weights for policy 0, policy_version 267298 (0.0008) [2023-12-27 21:08:58,593][106225] Updated weights for policy 1, policy_version 267718 (0.0009) [2023-12-27 21:08:58,659][106225] Updated weights for policy 1, policy_version 267728 (0.0007) [2023-12-27 21:08:58,738][106226] Updated weights for policy 0, policy_version 267308 (0.0008) [2023-12-27 21:08:58,740][106225] Updated weights for policy 1, policy_version 267738 (0.0008) [2023-12-27 21:08:58,810][106226] Updated weights for policy 0, policy_version 267318 (0.0010) [2023-12-27 21:08:58,873][106226] Updated weights for policy 0, policy_version 267328 (0.0008) [2023-12-27 21:08:59,458][106225] Updated weights for policy 1, policy_version 267748 (0.0007) [2023-12-27 21:08:59,515][106225] Updated weights for policy 1, policy_version 267758 (0.0009) [2023-12-27 21:08:59,571][106225] Updated weights for policy 1, policy_version 267768 (0.0008) [2023-12-27 21:08:59,719][106226] Updated weights for policy 0, policy_version 267338 (0.0007) [2023-12-27 21:08:59,787][106226] Updated weights for policy 0, policy_version 267348 (0.0007) [2023-12-27 21:08:59,856][106226] Updated weights for policy 0, policy_version 267358 (0.0008) [2023-12-27 21:08:59,921][106226] Updated weights for policy 0, policy_version 267368 (0.0007) [2023-12-27 21:09:00,315][106225] Updated weights for policy 1, policy_version 267778 (0.0009) [2023-12-27 21:09:00,377][106225] Updated weights for policy 1, policy_version 267788 (0.0010) [2023-12-27 21:09:00,431][106225] Updated weights for policy 1, policy_version 267798 (0.0010) [2023-12-27 21:09:00,479][106225] Updated weights for policy 1, policy_version 267808 (0.0010) [2023-12-27 21:09:00,523][106226] Updated weights for policy 0, policy_version 267378 (0.0007) [2023-12-27 21:09:00,579][106226] Updated weights for policy 0, policy_version 267388 (0.0008) [2023-12-27 21:09:00,633][106226] Updated weights for policy 0, policy_version 267398 (0.0009) [2023-12-27 21:09:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137052160. Throughput: 0: 10066.2, 1: 10037.5. Samples: 137045572. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:01,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.993')] [2023-12-27 21:09:01,185][106225] Updated weights for policy 1, policy_version 267818 (0.0009) [2023-12-27 21:09:01,246][106225] Updated weights for policy 1, policy_version 267828 (0.0010) [2023-12-27 21:09:01,312][106225] Updated weights for policy 1, policy_version 267838 (0.0011) [2023-12-27 21:09:01,344][106226] Updated weights for policy 0, policy_version 267408 (0.0009) [2023-12-27 21:09:01,416][106226] Updated weights for policy 0, policy_version 267418 (0.0008) [2023-12-27 21:09:01,479][106226] Updated weights for policy 0, policy_version 267428 (0.0008) [2023-12-27 21:09:02,101][106225] Updated weights for policy 1, policy_version 267848 (0.0007) [2023-12-27 21:09:02,151][106225] Updated weights for policy 1, policy_version 267858 (0.0009) [2023-12-27 21:09:02,191][106226] Updated weights for policy 0, policy_version 267438 (0.0007) [2023-12-27 21:09:02,211][106225] Updated weights for policy 1, policy_version 267868 (0.0006) [2023-12-27 21:09:02,252][106226] Updated weights for policy 0, policy_version 267448 (0.0008) [2023-12-27 21:09:02,309][106226] Updated weights for policy 0, policy_version 267458 (0.0010) [2023-12-27 21:09:02,903][106225] Updated weights for policy 1, policy_version 267878 (0.0007) [2023-12-27 21:09:02,956][106225] Updated weights for policy 1, policy_version 267888 (0.0008) [2023-12-27 21:09:02,958][106226] Updated weights for policy 0, policy_version 267468 (0.0009) [2023-12-27 21:09:03,016][106225] Updated weights for policy 1, policy_version 267898 (0.0008) [2023-12-27 21:09:03,019][106226] Updated weights for policy 0, policy_version 267478 (0.0006) [2023-12-27 21:09:03,063][106226] Updated weights for policy 0, policy_version 267488 (0.0005) [2023-12-27 21:09:03,724][106225] Updated weights for policy 1, policy_version 267908 (0.0006) [2023-12-27 21:09:03,749][106226] Updated weights for policy 0, policy_version 267498 (0.0009) [2023-12-27 21:09:03,784][106225] Updated weights for policy 1, policy_version 267918 (0.0008) [2023-12-27 21:09:03,798][106226] Updated weights for policy 0, policy_version 267508 (0.0007) [2023-12-27 21:09:03,842][106225] Updated weights for policy 1, policy_version 267928 (0.0007) [2023-12-27 21:09:03,849][106226] Updated weights for policy 0, policy_version 267518 (0.0008) [2023-12-27 21:09:03,908][106226] Updated weights for policy 0, policy_version 267528 (0.0007) [2023-12-27 21:09:04,490][106225] Updated weights for policy 1, policy_version 267938 (0.0008) [2023-12-27 21:09:04,550][106225] Updated weights for policy 1, policy_version 267948 (0.0007) [2023-12-27 21:09:04,611][106225] Updated weights for policy 1, policy_version 267958 (0.0009) [2023-12-27 21:09:04,663][106225] Updated weights for policy 1, policy_version 267968 (0.0008) [2023-12-27 21:09:04,690][106226] Updated weights for policy 0, policy_version 267538 (0.0006) [2023-12-27 21:09:04,746][106226] Updated weights for policy 0, policy_version 267548 (0.0008) [2023-12-27 21:09:04,801][106226] Updated weights for policy 0, policy_version 267558 (0.0008) [2023-12-27 21:09:05,360][106225] Updated weights for policy 1, policy_version 267978 (0.0005) [2023-12-27 21:09:05,420][106225] Updated weights for policy 1, policy_version 267988 (0.0005) [2023-12-27 21:09:05,474][106225] Updated weights for policy 1, policy_version 267998 (0.0006) [2023-12-27 21:09:05,560][106226] Updated weights for policy 0, policy_version 267568 (0.0010) [2023-12-27 21:09:05,620][106226] Updated weights for policy 0, policy_version 267578 (0.0011) [2023-12-27 21:09:05,687][106226] Updated weights for policy 0, policy_version 267588 (0.0011) [2023-12-27 21:09:06,144][106225] Updated weights for policy 1, policy_version 268008 (0.0009) [2023-12-27 21:09:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137150464. Throughput: 0: 10059.9, 1: 9981.3. Samples: 137164564. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:06,175][105115] Avg episode reward: [(0, '-4.858'), (1, '-5.667')] [2023-12-27 21:09:06,203][106225] Updated weights for policy 1, policy_version 268018 (0.0009) [2023-12-27 21:09:06,255][106225] Updated weights for policy 1, policy_version 268028 (0.0008) [2023-12-27 21:09:06,387][106226] Updated weights for policy 0, policy_version 267598 (0.0007) [2023-12-27 21:09:06,448][106226] Updated weights for policy 0, policy_version 267608 (0.0009) [2023-12-27 21:09:06,516][106226] Updated weights for policy 0, policy_version 267618 (0.0008) [2023-12-27 21:09:06,975][106225] Updated weights for policy 1, policy_version 268038 (0.0006) [2023-12-27 21:09:07,026][106225] Updated weights for policy 1, policy_version 268048 (0.0006) [2023-12-27 21:09:07,079][106225] Updated weights for policy 1, policy_version 268058 (0.0010) [2023-12-27 21:09:07,202][106226] Updated weights for policy 0, policy_version 267628 (0.0008) [2023-12-27 21:09:07,276][106226] Updated weights for policy 0, policy_version 267638 (0.0007) [2023-12-27 21:09:07,336][106226] Updated weights for policy 0, policy_version 267648 (0.0008) [2023-12-27 21:09:07,817][106225] Updated weights for policy 1, policy_version 268068 (0.0009) [2023-12-27 21:09:07,879][106225] Updated weights for policy 1, policy_version 268078 (0.0009) [2023-12-27 21:09:07,927][106225] Updated weights for policy 1, policy_version 268088 (0.0010) [2023-12-27 21:09:07,985][106226] Updated weights for policy 0, policy_version 267658 (0.0008) [2023-12-27 21:09:08,042][106226] Updated weights for policy 0, policy_version 267668 (0.0006) [2023-12-27 21:09:08,088][106226] Updated weights for policy 0, policy_version 267678 (0.0005) [2023-12-27 21:09:08,137][106226] Updated weights for policy 0, policy_version 267688 (0.0008) [2023-12-27 21:09:08,588][106225] Updated weights for policy 1, policy_version 268098 (0.0007) [2023-12-27 21:09:08,653][106225] Updated weights for policy 1, policy_version 268108 (0.0008) [2023-12-27 21:09:08,716][106225] Updated weights for policy 1, policy_version 268118 (0.0007) [2023-12-27 21:09:08,784][106225] Updated weights for policy 1, policy_version 268128 (0.0009) [2023-12-27 21:09:08,950][106226] Updated weights for policy 0, policy_version 267698 (0.0009) [2023-12-27 21:09:09,010][106226] Updated weights for policy 0, policy_version 267708 (0.0009) [2023-12-27 21:09:09,068][106226] Updated weights for policy 0, policy_version 267718 (0.0007) [2023-12-27 21:09:09,574][106225] Updated weights for policy 1, policy_version 268138 (0.0008) [2023-12-27 21:09:09,637][106225] Updated weights for policy 1, policy_version 268148 (0.0008) [2023-12-27 21:09:09,696][106225] Updated weights for policy 1, policy_version 268158 (0.0008) [2023-12-27 21:09:09,721][106226] Updated weights for policy 0, policy_version 267728 (0.0006) [2023-12-27 21:09:09,788][106226] Updated weights for policy 0, policy_version 267738 (0.0009) [2023-12-27 21:09:09,858][106226] Updated weights for policy 0, policy_version 267748 (0.0009) [2023-12-27 21:09:10,452][106225] Updated weights for policy 1, policy_version 268168 (0.0009) [2023-12-27 21:09:10,518][106225] Updated weights for policy 1, policy_version 268178 (0.0009) [2023-12-27 21:09:10,574][106225] Updated weights for policy 1, policy_version 268188 (0.0008) [2023-12-27 21:09:10,584][106226] Updated weights for policy 0, policy_version 267758 (0.0007) [2023-12-27 21:09:10,634][106226] Updated weights for policy 0, policy_version 267768 (0.0008) [2023-12-27 21:09:10,688][106226] Updated weights for policy 0, policy_version 267778 (0.0009) [2023-12-27 21:09:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.5, 300 sec: 19938.5). Total num frames: 137248768. Throughput: 0: 10056.0, 1: 9974.9. Samples: 137222792. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:11,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.818')] [2023-12-27 21:09:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000268192_68673536.pth... [2023-12-27 21:09:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000267784_68575232.pth... [2023-12-27 21:09:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000267072_68386816.pth [2023-12-27 21:09:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000266600_68272128.pth [2023-12-27 21:09:11,258][106225] Updated weights for policy 1, policy_version 268198 (0.0008) [2023-12-27 21:09:11,311][106225] Updated weights for policy 1, policy_version 268208 (0.0007) [2023-12-27 21:09:11,373][106225] Updated weights for policy 1, policy_version 268218 (0.0008) [2023-12-27 21:09:11,563][106226] Updated weights for policy 0, policy_version 267788 (0.0008) [2023-12-27 21:09:11,622][106226] Updated weights for policy 0, policy_version 267798 (0.0008) [2023-12-27 21:09:11,693][106226] Updated weights for policy 0, policy_version 267808 (0.0008) [2023-12-27 21:09:12,076][106225] Updated weights for policy 1, policy_version 268228 (0.0007) [2023-12-27 21:09:12,135][106225] Updated weights for policy 1, policy_version 268238 (0.0005) [2023-12-27 21:09:12,190][106225] Updated weights for policy 1, policy_version 268248 (0.0005) [2023-12-27 21:09:12,398][106226] Updated weights for policy 0, policy_version 267818 (0.0007) [2023-12-27 21:09:12,459][106226] Updated weights for policy 0, policy_version 267828 (0.0007) [2023-12-27 21:09:12,516][106226] Updated weights for policy 0, policy_version 267838 (0.0007) [2023-12-27 21:09:12,568][106226] Updated weights for policy 0, policy_version 267848 (0.0007) [2023-12-27 21:09:12,846][106225] Updated weights for policy 1, policy_version 268258 (0.0006) [2023-12-27 21:09:12,898][106225] Updated weights for policy 1, policy_version 268268 (0.0005) [2023-12-27 21:09:12,958][106225] Updated weights for policy 1, policy_version 268278 (0.0006) [2023-12-27 21:09:13,013][106225] Updated weights for policy 1, policy_version 268288 (0.0005) [2023-12-27 21:09:13,251][106226] Updated weights for policy 0, policy_version 267858 (0.0010) [2023-12-27 21:09:13,303][106226] Updated weights for policy 0, policy_version 267868 (0.0010) [2023-12-27 21:09:13,363][106226] Updated weights for policy 0, policy_version 267878 (0.0011) [2023-12-27 21:09:13,575][106225] Updated weights for policy 1, policy_version 268298 (0.0007) [2023-12-27 21:09:13,630][106225] Updated weights for policy 1, policy_version 268308 (0.0008) [2023-12-27 21:09:13,694][106225] Updated weights for policy 1, policy_version 268318 (0.0010) [2023-12-27 21:09:14,048][106226] Updated weights for policy 0, policy_version 267888 (0.0011) [2023-12-27 21:09:14,101][106226] Updated weights for policy 0, policy_version 267898 (0.0010) [2023-12-27 21:09:14,155][106226] Updated weights for policy 0, policy_version 267908 (0.0009) [2023-12-27 21:09:14,425][106225] Updated weights for policy 1, policy_version 268328 (0.0006) [2023-12-27 21:09:14,483][106225] Updated weights for policy 1, policy_version 268338 (0.0006) [2023-12-27 21:09:14,537][106225] Updated weights for policy 1, policy_version 268348 (0.0005) [2023-12-27 21:09:14,821][106226] Updated weights for policy 0, policy_version 267918 (0.0009) [2023-12-27 21:09:14,885][106226] Updated weights for policy 0, policy_version 267928 (0.0011) [2023-12-27 21:09:14,947][106226] Updated weights for policy 0, policy_version 267938 (0.0011) [2023-12-27 21:09:15,211][106225] Updated weights for policy 1, policy_version 268358 (0.0007) [2023-12-27 21:09:15,266][106225] Updated weights for policy 1, policy_version 268368 (0.0008) [2023-12-27 21:09:15,333][106225] Updated weights for policy 1, policy_version 268378 (0.0008) [2023-12-27 21:09:15,602][106226] Updated weights for policy 0, policy_version 267948 (0.0009) [2023-12-27 21:09:15,650][106226] Updated weights for policy 0, policy_version 267958 (0.0005) [2023-12-27 21:09:15,712][106226] Updated weights for policy 0, policy_version 267968 (0.0005) [2023-12-27 21:09:15,895][106225] Updated weights for policy 1, policy_version 268388 (0.0007) [2023-12-27 21:09:15,958][106225] Updated weights for policy 1, policy_version 268398 (0.0006) [2023-12-27 21:09:16,023][106225] Updated weights for policy 1, policy_version 268408 (0.0006) [2023-12-27 21:09:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137355264. Throughput: 0: 10005.6, 1: 9921.3. Samples: 137340780. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:16,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.756')] [2023-12-27 21:09:16,263][106226] Updated weights for policy 0, policy_version 267978 (0.0006) [2023-12-27 21:09:16,329][106226] Updated weights for policy 0, policy_version 267988 (0.0011) [2023-12-27 21:09:16,391][106226] Updated weights for policy 0, policy_version 267998 (0.0010) [2023-12-27 21:09:16,457][106226] Updated weights for policy 0, policy_version 268008 (0.0011) [2023-12-27 21:09:16,690][106225] Updated weights for policy 1, policy_version 268418 (0.0008) [2023-12-27 21:09:16,750][106225] Updated weights for policy 1, policy_version 268428 (0.0008) [2023-12-27 21:09:16,808][106225] Updated weights for policy 1, policy_version 268438 (0.0008) [2023-12-27 21:09:16,866][106225] Updated weights for policy 1, policy_version 268448 (0.0008) [2023-12-27 21:09:17,079][106226] Updated weights for policy 0, policy_version 268018 (0.0005) [2023-12-27 21:09:17,135][106226] Updated weights for policy 0, policy_version 268028 (0.0006) [2023-12-27 21:09:17,204][106226] Updated weights for policy 0, policy_version 268038 (0.0011) [2023-12-27 21:09:17,637][106225] Updated weights for policy 1, policy_version 268458 (0.0008) [2023-12-27 21:09:17,690][106225] Updated weights for policy 1, policy_version 268468 (0.0007) [2023-12-27 21:09:17,742][106225] Updated weights for policy 1, policy_version 268478 (0.0008) [2023-12-27 21:09:17,878][106226] Updated weights for policy 0, policy_version 268048 (0.0011) [2023-12-27 21:09:17,928][106226] Updated weights for policy 0, policy_version 268058 (0.0010) [2023-12-27 21:09:17,980][106226] Updated weights for policy 0, policy_version 268068 (0.0010) [2023-12-27 21:09:18,391][106225] Updated weights for policy 1, policy_version 268488 (0.0008) [2023-12-27 21:09:18,442][106225] Updated weights for policy 1, policy_version 268498 (0.0008) [2023-12-27 21:09:18,504][106225] Updated weights for policy 1, policy_version 268508 (0.0008) [2023-12-27 21:09:18,711][106226] Updated weights for policy 0, policy_version 268078 (0.0010) [2023-12-27 21:09:18,768][106226] Updated weights for policy 0, policy_version 268088 (0.0011) [2023-12-27 21:09:18,823][106226] Updated weights for policy 0, policy_version 268098 (0.0009) [2023-12-27 21:09:19,250][106225] Updated weights for policy 1, policy_version 268518 (0.0010) [2023-12-27 21:09:19,314][106225] Updated weights for policy 1, policy_version 268528 (0.0010) [2023-12-27 21:09:19,382][106225] Updated weights for policy 1, policy_version 268538 (0.0008) [2023-12-27 21:09:19,540][106226] Updated weights for policy 0, policy_version 268108 (0.0008) [2023-12-27 21:09:19,604][106226] Updated weights for policy 0, policy_version 268118 (0.0009) [2023-12-27 21:09:19,665][106226] Updated weights for policy 0, policy_version 268128 (0.0007) [2023-12-27 21:09:20,084][106225] Updated weights for policy 1, policy_version 268548 (0.0010) [2023-12-27 21:09:20,144][106225] Updated weights for policy 1, policy_version 268558 (0.0009) [2023-12-27 21:09:20,208][106225] Updated weights for policy 1, policy_version 268568 (0.0009) [2023-12-27 21:09:20,454][106226] Updated weights for policy 0, policy_version 268138 (0.0007) [2023-12-27 21:09:20,516][106226] Updated weights for policy 0, policy_version 268148 (0.0009) [2023-12-27 21:09:20,579][106226] Updated weights for policy 0, policy_version 268158 (0.0009) [2023-12-27 21:09:20,644][106226] Updated weights for policy 0, policy_version 268168 (0.0009) [2023-12-27 21:09:20,851][106225] Updated weights for policy 1, policy_version 268578 (0.0008) [2023-12-27 21:09:20,915][106225] Updated weights for policy 1, policy_version 268588 (0.0009) [2023-12-27 21:09:20,976][106225] Updated weights for policy 1, policy_version 268598 (0.0006) [2023-12-27 21:09:21,044][106225] Updated weights for policy 1, policy_version 268608 (0.0007) [2023-12-27 21:09:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 137453568. Throughput: 0: 10020.6, 1: 9938.9. Samples: 137460996. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:21,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-5.913')] [2023-12-27 21:09:21,507][106226] Updated weights for policy 0, policy_version 268178 (0.0009) [2023-12-27 21:09:21,564][106226] Updated weights for policy 0, policy_version 268188 (0.0008) [2023-12-27 21:09:21,628][106226] Updated weights for policy 0, policy_version 268198 (0.0010) [2023-12-27 21:09:21,788][106225] Updated weights for policy 1, policy_version 268618 (0.0008) [2023-12-27 21:09:21,850][106225] Updated weights for policy 1, policy_version 268628 (0.0007) [2023-12-27 21:09:21,920][106225] Updated weights for policy 1, policy_version 268638 (0.0007) [2023-12-27 21:09:22,366][106226] Updated weights for policy 0, policy_version 268208 (0.0008) [2023-12-27 21:09:22,435][106226] Updated weights for policy 0, policy_version 268218 (0.0008) [2023-12-27 21:09:22,483][106226] Updated weights for policy 0, policy_version 268228 (0.0008) [2023-12-27 21:09:22,667][106225] Updated weights for policy 1, policy_version 268648 (0.0008) [2023-12-27 21:09:22,727][106225] Updated weights for policy 1, policy_version 268658 (0.0008) [2023-12-27 21:09:22,786][106225] Updated weights for policy 1, policy_version 268668 (0.0009) [2023-12-27 21:09:23,278][106226] Updated weights for policy 0, policy_version 268238 (0.0008) [2023-12-27 21:09:23,329][106226] Updated weights for policy 0, policy_version 268248 (0.0008) [2023-12-27 21:09:23,381][106226] Updated weights for policy 0, policy_version 268258 (0.0008) [2023-12-27 21:09:23,450][106225] Updated weights for policy 1, policy_version 268678 (0.0009) [2023-12-27 21:09:23,506][106225] Updated weights for policy 1, policy_version 268688 (0.0009) [2023-12-27 21:09:23,562][106225] Updated weights for policy 1, policy_version 268698 (0.0010) [2023-12-27 21:09:24,019][106226] Updated weights for policy 0, policy_version 268268 (0.0008) [2023-12-27 21:09:24,072][106226] Updated weights for policy 0, policy_version 268278 (0.0007) [2023-12-27 21:09:24,134][106226] Updated weights for policy 0, policy_version 268288 (0.0008) [2023-12-27 21:09:24,266][106225] Updated weights for policy 1, policy_version 268708 (0.0010) [2023-12-27 21:09:24,315][106225] Updated weights for policy 1, policy_version 268718 (0.0010) [2023-12-27 21:09:24,366][106225] Updated weights for policy 1, policy_version 268728 (0.0008) [2023-12-27 21:09:24,773][106226] Updated weights for policy 0, policy_version 268298 (0.0009) [2023-12-27 21:09:24,831][106226] Updated weights for policy 0, policy_version 268308 (0.0006) [2023-12-27 21:09:24,886][106226] Updated weights for policy 0, policy_version 268318 (0.0005) [2023-12-27 21:09:24,946][106226] Updated weights for policy 0, policy_version 268328 (0.0006) [2023-12-27 21:09:25,023][106225] Updated weights for policy 1, policy_version 268738 (0.0009) [2023-12-27 21:09:25,078][106225] Updated weights for policy 1, policy_version 268748 (0.0007) [2023-12-27 21:09:25,140][106225] Updated weights for policy 1, policy_version 268758 (0.0007) [2023-12-27 21:09:25,199][106225] Updated weights for policy 1, policy_version 268768 (0.0006) [2023-12-27 21:09:25,535][106226] Updated weights for policy 0, policy_version 268338 (0.0005) [2023-12-27 21:09:25,590][106226] Updated weights for policy 0, policy_version 268348 (0.0009) [2023-12-27 21:09:25,636][106226] Updated weights for policy 0, policy_version 268358 (0.0008) [2023-12-27 21:09:25,864][106225] Updated weights for policy 1, policy_version 268778 (0.0008) [2023-12-27 21:09:25,928][106225] Updated weights for policy 1, policy_version 268788 (0.0008) [2023-12-27 21:09:25,984][106225] Updated weights for policy 1, policy_version 268798 (0.0008) [2023-12-27 21:09:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 137551872. Throughput: 0: 10016.1, 1: 9902.7. Samples: 137518040. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:26,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.966')] [2023-12-27 21:09:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000268360_68722688.pth... [2023-12-27 21:09:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000268800_68829184.pth... [2023-12-27 21:09:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000267208_68427776.pth [2023-12-27 21:09:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000267648_68534272.pth [2023-12-27 21:09:26,249][106226] Updated weights for policy 0, policy_version 268368 (0.0008) [2023-12-27 21:09:26,294][106226] Updated weights for policy 0, policy_version 268378 (0.0008) [2023-12-27 21:09:26,342][106226] Updated weights for policy 0, policy_version 268388 (0.0008) [2023-12-27 21:09:26,666][106225] Updated weights for policy 1, policy_version 268808 (0.0009) [2023-12-27 21:09:26,721][106225] Updated weights for policy 1, policy_version 268818 (0.0010) [2023-12-27 21:09:26,775][106225] Updated weights for policy 1, policy_version 268828 (0.0009) [2023-12-27 21:09:26,974][106226] Updated weights for policy 0, policy_version 268398 (0.0008) [2023-12-27 21:09:27,037][106226] Updated weights for policy 0, policy_version 268408 (0.0010) [2023-12-27 21:09:27,098][106226] Updated weights for policy 0, policy_version 268418 (0.0010) [2023-12-27 21:09:27,459][106225] Updated weights for policy 1, policy_version 268838 (0.0008) [2023-12-27 21:09:27,518][106225] Updated weights for policy 1, policy_version 268848 (0.0010) [2023-12-27 21:09:27,580][106225] Updated weights for policy 1, policy_version 268858 (0.0010) [2023-12-27 21:09:27,655][106226] Updated weights for policy 0, policy_version 268428 (0.0008) [2023-12-27 21:09:27,713][106226] Updated weights for policy 0, policy_version 268438 (0.0010) [2023-12-27 21:09:27,766][106226] Updated weights for policy 0, policy_version 268448 (0.0010) [2023-12-27 21:09:28,276][106225] Updated weights for policy 1, policy_version 268868 (0.0010) [2023-12-27 21:09:28,318][106225] Updated weights for policy 1, policy_version 268878 (0.0010) [2023-12-27 21:09:28,378][106225] Updated weights for policy 1, policy_version 268888 (0.0010) [2023-12-27 21:09:28,466][106226] Updated weights for policy 0, policy_version 268458 (0.0010) [2023-12-27 21:09:28,525][106226] Updated weights for policy 0, policy_version 268468 (0.0010) [2023-12-27 21:09:28,578][106226] Updated weights for policy 0, policy_version 268478 (0.0011) [2023-12-27 21:09:28,631][106226] Updated weights for policy 0, policy_version 268488 (0.0008) [2023-12-27 21:09:29,093][106225] Updated weights for policy 1, policy_version 268898 (0.0010) [2023-12-27 21:09:29,154][106225] Updated weights for policy 1, policy_version 268908 (0.0010) [2023-12-27 21:09:29,222][106225] Updated weights for policy 1, policy_version 268918 (0.0010) [2023-12-27 21:09:29,286][106225] Updated weights for policy 1, policy_version 268928 (0.0010) [2023-12-27 21:09:29,344][106226] Updated weights for policy 0, policy_version 268498 (0.0010) [2023-12-27 21:09:29,411][106226] Updated weights for policy 0, policy_version 268508 (0.0008) [2023-12-27 21:09:29,467][106226] Updated weights for policy 0, policy_version 268518 (0.0007) [2023-12-27 21:09:29,976][106225] Updated weights for policy 1, policy_version 268938 (0.0008) [2023-12-27 21:09:30,042][106225] Updated weights for policy 1, policy_version 268948 (0.0009) [2023-12-27 21:09:30,104][106225] Updated weights for policy 1, policy_version 268958 (0.0009) [2023-12-27 21:09:30,191][106226] Updated weights for policy 0, policy_version 268528 (0.0008) [2023-12-27 21:09:30,250][106226] Updated weights for policy 0, policy_version 268538 (0.0008) [2023-12-27 21:09:30,309][106226] Updated weights for policy 0, policy_version 268548 (0.0008) [2023-12-27 21:09:30,848][106225] Updated weights for policy 1, policy_version 268968 (0.0008) [2023-12-27 21:09:30,916][106225] Updated weights for policy 1, policy_version 268978 (0.0007) [2023-12-27 21:09:30,918][106226] Updated weights for policy 0, policy_version 268558 (0.0007) [2023-12-27 21:09:30,974][106225] Updated weights for policy 1, policy_version 268988 (0.0005) [2023-12-27 21:09:30,976][106226] Updated weights for policy 0, policy_version 268568 (0.0006) [2023-12-27 21:09:31,027][106226] Updated weights for policy 0, policy_version 268578 (0.0008) [2023-12-27 21:09:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137658368. Throughput: 0: 10143.8, 1: 9904.9. Samples: 137642708. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:31,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-5.654')] [2023-12-27 21:09:31,653][106225] Updated weights for policy 1, policy_version 268998 (0.0007) [2023-12-27 21:09:31,707][106225] Updated weights for policy 1, policy_version 269008 (0.0009) [2023-12-27 21:09:31,728][106226] Updated weights for policy 0, policy_version 268588 (0.0008) [2023-12-27 21:09:31,771][106225] Updated weights for policy 1, policy_version 269018 (0.0008) [2023-12-27 21:09:31,796][106226] Updated weights for policy 0, policy_version 268598 (0.0008) [2023-12-27 21:09:31,850][106226] Updated weights for policy 0, policy_version 268608 (0.0008) [2023-12-27 21:09:32,496][106225] Updated weights for policy 1, policy_version 269028 (0.0007) [2023-12-27 21:09:32,549][106225] Updated weights for policy 1, policy_version 269038 (0.0008) [2023-12-27 21:09:32,605][106225] Updated weights for policy 1, policy_version 269048 (0.0009) [2023-12-27 21:09:32,653][106226] Updated weights for policy 0, policy_version 268618 (0.0008) [2023-12-27 21:09:32,705][106226] Updated weights for policy 0, policy_version 268628 (0.0009) [2023-12-27 21:09:32,763][106226] Updated weights for policy 0, policy_version 268638 (0.0008) [2023-12-27 21:09:32,817][106226] Updated weights for policy 0, policy_version 268648 (0.0008) [2023-12-27 21:09:33,363][106225] Updated weights for policy 1, policy_version 269058 (0.0008) [2023-12-27 21:09:33,411][106225] Updated weights for policy 1, policy_version 269068 (0.0006) [2023-12-27 21:09:33,419][106226] Updated weights for policy 0, policy_version 268658 (0.0007) [2023-12-27 21:09:33,467][106225] Updated weights for policy 1, policy_version 269078 (0.0005) [2023-12-27 21:09:33,469][106226] Updated weights for policy 0, policy_version 268668 (0.0008) [2023-12-27 21:09:33,525][106225] Updated weights for policy 1, policy_version 269088 (0.0006) [2023-12-27 21:09:33,529][106226] Updated weights for policy 0, policy_version 268678 (0.0007) [2023-12-27 21:09:34,116][106225] Updated weights for policy 1, policy_version 269098 (0.0010) [2023-12-27 21:09:34,181][106226] Updated weights for policy 0, policy_version 268688 (0.0011) [2023-12-27 21:09:34,198][106225] Updated weights for policy 1, policy_version 269108 (0.0008) [2023-12-27 21:09:34,236][106226] Updated weights for policy 0, policy_version 268698 (0.0010) [2023-12-27 21:09:34,258][106225] Updated weights for policy 1, policy_version 269118 (0.0007) [2023-12-27 21:09:34,302][106226] Updated weights for policy 0, policy_version 268708 (0.0010) [2023-12-27 21:09:34,966][106225] Updated weights for policy 1, policy_version 269128 (0.0009) [2023-12-27 21:09:35,023][106225] Updated weights for policy 1, policy_version 269138 (0.0008) [2023-12-27 21:09:35,045][106226] Updated weights for policy 0, policy_version 268718 (0.0007) [2023-12-27 21:09:35,082][106225] Updated weights for policy 1, policy_version 269148 (0.0007) [2023-12-27 21:09:35,116][106226] Updated weights for policy 0, policy_version 268728 (0.0007) [2023-12-27 21:09:35,187][106226] Updated weights for policy 0, policy_version 268738 (0.0008) [2023-12-27 21:09:35,810][106225] Updated weights for policy 1, policy_version 269158 (0.0010) [2023-12-27 21:09:35,876][106225] Updated weights for policy 1, policy_version 269168 (0.0010) [2023-12-27 21:09:35,889][106226] Updated weights for policy 0, policy_version 268748 (0.0007) [2023-12-27 21:09:35,927][106225] Updated weights for policy 1, policy_version 269178 (0.0010) [2023-12-27 21:09:35,948][106226] Updated weights for policy 0, policy_version 268758 (0.0005) [2023-12-27 21:09:36,004][106226] Updated weights for policy 0, policy_version 268768 (0.0008) [2023-12-27 21:09:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137756672. Throughput: 0: 9990.2, 1: 9856.2. Samples: 137761436. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:36,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.885')] [2023-12-27 21:09:36,664][106226] Updated weights for policy 0, policy_version 268778 (0.0008) [2023-12-27 21:09:36,722][106226] Updated weights for policy 0, policy_version 268788 (0.0008) [2023-12-27 21:09:36,722][106225] Updated weights for policy 1, policy_version 269188 (0.0010) [2023-12-27 21:09:36,774][106226] Updated weights for policy 0, policy_version 268798 (0.0009) [2023-12-27 21:09:36,776][106225] Updated weights for policy 1, policy_version 269198 (0.0006) [2023-12-27 21:09:36,820][106226] Updated weights for policy 0, policy_version 268808 (0.0007) [2023-12-27 21:09:36,843][106225] Updated weights for policy 1, policy_version 269208 (0.0009) [2023-12-27 21:09:37,408][106225] Updated weights for policy 1, policy_version 269218 (0.0007) [2023-12-27 21:09:37,479][106225] Updated weights for policy 1, policy_version 269228 (0.0008) [2023-12-27 21:09:37,544][106225] Updated weights for policy 1, policy_version 269238 (0.0008) [2023-12-27 21:09:37,603][106225] Updated weights for policy 1, policy_version 269248 (0.0008) [2023-12-27 21:09:37,664][106226] Updated weights for policy 0, policy_version 268818 (0.0007) [2023-12-27 21:09:37,731][106226] Updated weights for policy 0, policy_version 268828 (0.0008) [2023-12-27 21:09:37,795][106226] Updated weights for policy 0, policy_version 268838 (0.0006) [2023-12-27 21:09:38,357][106225] Updated weights for policy 1, policy_version 269258 (0.0008) [2023-12-27 21:09:38,416][106225] Updated weights for policy 1, policy_version 269268 (0.0008) [2023-12-27 21:09:38,417][106226] Updated weights for policy 0, policy_version 268848 (0.0007) [2023-12-27 21:09:38,473][106225] Updated weights for policy 1, policy_version 269278 (0.0008) [2023-12-27 21:09:38,478][106226] Updated weights for policy 0, policy_version 268858 (0.0006) [2023-12-27 21:09:38,543][106226] Updated weights for policy 0, policy_version 268868 (0.0009) [2023-12-27 21:09:39,135][106226] Updated weights for policy 0, policy_version 268878 (0.0007) [2023-12-27 21:09:39,194][106225] Updated weights for policy 1, policy_version 269288 (0.0008) [2023-12-27 21:09:39,199][106226] Updated weights for policy 0, policy_version 268888 (0.0005) [2023-12-27 21:09:39,263][106225] Updated weights for policy 1, policy_version 269298 (0.0009) [2023-12-27 21:09:39,268][106226] Updated weights for policy 0, policy_version 268898 (0.0010) [2023-12-27 21:09:39,323][106225] Updated weights for policy 1, policy_version 269308 (0.0008) [2023-12-27 21:09:40,012][106226] Updated weights for policy 0, policy_version 268908 (0.0007) [2023-12-27 21:09:40,074][106226] Updated weights for policy 0, policy_version 268918 (0.0009) [2023-12-27 21:09:40,126][106226] Updated weights for policy 0, policy_version 268928 (0.0007) [2023-12-27 21:09:40,139][106225] Updated weights for policy 1, policy_version 269318 (0.0010) [2023-12-27 21:09:40,202][106225] Updated weights for policy 1, policy_version 269328 (0.0006) [2023-12-27 21:09:40,270][106225] Updated weights for policy 1, policy_version 269338 (0.0006) [2023-12-27 21:09:40,874][106225] Updated weights for policy 1, policy_version 269348 (0.0006) [2023-12-27 21:09:40,915][106226] Updated weights for policy 0, policy_version 268938 (0.0008) [2023-12-27 21:09:40,935][106225] Updated weights for policy 1, policy_version 269358 (0.0005) [2023-12-27 21:09:40,971][106226] Updated weights for policy 0, policy_version 268948 (0.0010) [2023-12-27 21:09:40,992][106225] Updated weights for policy 1, policy_version 269368 (0.0005) [2023-12-27 21:09:41,025][106226] Updated weights for policy 0, policy_version 268958 (0.0010) [2023-12-27 21:09:41,090][106226] Updated weights for policy 0, policy_version 268968 (0.0011) [2023-12-27 21:09:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 137854976. Throughput: 0: 9996.8, 1: 9826.9. Samples: 137821140. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-27 21:09:41,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-5.638')] [2023-12-27 21:09:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000269376_68976640.pth... [2023-12-27 21:09:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000268968_68878336.pth... [2023-12-27 21:09:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000267784_68575232.pth [2023-12-27 21:09:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000268192_68673536.pth [2023-12-27 21:09:41,679][106225] Updated weights for policy 1, policy_version 269378 (0.0008) [2023-12-27 21:09:41,750][106225] Updated weights for policy 1, policy_version 269388 (0.0009) [2023-12-27 21:09:41,813][106225] Updated weights for policy 1, policy_version 269398 (0.0009) [2023-12-27 21:09:41,840][106226] Updated weights for policy 0, policy_version 268978 (0.0008) [2023-12-27 21:09:41,871][106225] Updated weights for policy 1, policy_version 269408 (0.0008) [2023-12-27 21:09:41,894][106226] Updated weights for policy 0, policy_version 268988 (0.0008) [2023-12-27 21:09:41,952][106226] Updated weights for policy 0, policy_version 268998 (0.0008) [2023-12-27 21:09:42,630][106225] Updated weights for policy 1, policy_version 269418 (0.0008) [2023-12-27 21:09:42,692][106225] Updated weights for policy 1, policy_version 269428 (0.0007) [2023-12-27 21:09:42,698][106226] Updated weights for policy 0, policy_version 269008 (0.0009) [2023-12-27 21:09:42,756][106225] Updated weights for policy 1, policy_version 269438 (0.0007) [2023-12-27 21:09:42,767][106226] Updated weights for policy 0, policy_version 269018 (0.0008) [2023-12-27 21:09:42,822][106226] Updated weights for policy 0, policy_version 269028 (0.0008) [2023-12-27 21:09:43,478][106226] Updated weights for policy 0, policy_version 269038 (0.0009) [2023-12-27 21:09:43,504][106225] Updated weights for policy 1, policy_version 269448 (0.0006) [2023-12-27 21:09:43,525][106226] Updated weights for policy 0, policy_version 269048 (0.0007) [2023-12-27 21:09:43,547][106225] Updated weights for policy 1, policy_version 269458 (0.0006) [2023-12-27 21:09:43,576][106226] Updated weights for policy 0, policy_version 269058 (0.0008) [2023-12-27 21:09:43,597][106225] Updated weights for policy 1, policy_version 269468 (0.0008) [2023-12-27 21:09:44,296][106226] Updated weights for policy 0, policy_version 269068 (0.0009) [2023-12-27 21:09:44,354][106226] Updated weights for policy 0, policy_version 269078 (0.0005) [2023-12-27 21:09:44,360][106225] Updated weights for policy 1, policy_version 269478 (0.0008) [2023-12-27 21:09:44,417][106225] Updated weights for policy 1, policy_version 269488 (0.0007) [2023-12-27 21:09:44,418][106226] Updated weights for policy 0, policy_version 269088 (0.0006) [2023-12-27 21:09:44,477][106225] Updated weights for policy 1, policy_version 269498 (0.0007) [2023-12-27 21:09:45,000][106226] Updated weights for policy 0, policy_version 269098 (0.0006) [2023-12-27 21:09:45,060][106226] Updated weights for policy 0, policy_version 269108 (0.0008) [2023-12-27 21:09:45,111][106226] Updated weights for policy 0, policy_version 269118 (0.0006) [2023-12-27 21:09:45,172][106226] Updated weights for policy 0, policy_version 269128 (0.0006) [2023-12-27 21:09:45,320][106225] Updated weights for policy 1, policy_version 269508 (0.0009) [2023-12-27 21:09:45,380][106225] Updated weights for policy 1, policy_version 269518 (0.0008) [2023-12-27 21:09:45,443][106225] Updated weights for policy 1, policy_version 269528 (0.0009) [2023-12-27 21:09:45,824][106226] Updated weights for policy 0, policy_version 269138 (0.0006) [2023-12-27 21:09:45,887][106226] Updated weights for policy 0, policy_version 269148 (0.0007) [2023-12-27 21:09:45,950][106226] Updated weights for policy 0, policy_version 269158 (0.0009) [2023-12-27 21:09:46,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 137945088. Throughput: 0: 9938.2, 1: 9841.8. Samples: 137935672. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:09:46,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-5.788')] [2023-12-27 21:09:46,184][106225] Updated weights for policy 1, policy_version 269538 (0.0009) [2023-12-27 21:09:46,238][106225] Updated weights for policy 1, policy_version 269548 (0.0009) [2023-12-27 21:09:46,287][106225] Updated weights for policy 1, policy_version 269558 (0.0008) [2023-12-27 21:09:46,343][106225] Updated weights for policy 1, policy_version 269568 (0.0008) [2023-12-27 21:09:46,616][106226] Updated weights for policy 0, policy_version 269168 (0.0009) [2023-12-27 21:09:46,671][106226] Updated weights for policy 0, policy_version 269178 (0.0008) [2023-12-27 21:09:46,729][106226] Updated weights for policy 0, policy_version 269188 (0.0009) [2023-12-27 21:09:47,087][106225] Updated weights for policy 1, policy_version 269578 (0.0008) [2023-12-27 21:09:47,132][106225] Updated weights for policy 1, policy_version 269588 (0.0009) [2023-12-27 21:09:47,177][106225] Updated weights for policy 1, policy_version 269598 (0.0008) [2023-12-27 21:09:47,447][106226] Updated weights for policy 0, policy_version 269198 (0.0007) [2023-12-27 21:09:47,507][106226] Updated weights for policy 0, policy_version 269208 (0.0009) [2023-12-27 21:09:47,562][106226] Updated weights for policy 0, policy_version 269218 (0.0008) [2023-12-27 21:09:47,953][106225] Updated weights for policy 1, policy_version 269608 (0.0009) [2023-12-27 21:09:48,014][106225] Updated weights for policy 1, policy_version 269618 (0.0008) [2023-12-27 21:09:48,076][106225] Updated weights for policy 1, policy_version 269628 (0.0009) [2023-12-27 21:09:48,283][106226] Updated weights for policy 0, policy_version 269228 (0.0009) [2023-12-27 21:09:48,348][106226] Updated weights for policy 0, policy_version 269238 (0.0008) [2023-12-27 21:09:48,410][106226] Updated weights for policy 0, policy_version 269248 (0.0008) [2023-12-27 21:09:48,856][106225] Updated weights for policy 1, policy_version 269638 (0.0008) [2023-12-27 21:09:48,902][106225] Updated weights for policy 1, policy_version 269648 (0.0008) [2023-12-27 21:09:48,961][106225] Updated weights for policy 1, policy_version 269658 (0.0009) [2023-12-27 21:09:49,125][106226] Updated weights for policy 0, policy_version 269258 (0.0009) [2023-12-27 21:09:49,174][106226] Updated weights for policy 0, policy_version 269268 (0.0008) [2023-12-27 21:09:49,235][106226] Updated weights for policy 0, policy_version 269278 (0.0008) [2023-12-27 21:09:49,296][106226] Updated weights for policy 0, policy_version 269288 (0.0009) [2023-12-27 21:09:49,728][106225] Updated weights for policy 1, policy_version 269668 (0.0009) [2023-12-27 21:09:49,781][106225] Updated weights for policy 1, policy_version 269678 (0.0008) [2023-12-27 21:09:49,841][106225] Updated weights for policy 1, policy_version 269688 (0.0009) [2023-12-27 21:09:50,017][106226] Updated weights for policy 0, policy_version 269298 (0.0009) [2023-12-27 21:09:50,092][106226] Updated weights for policy 0, policy_version 269308 (0.0009) [2023-12-27 21:09:50,162][106226] Updated weights for policy 0, policy_version 269318 (0.0009) [2023-12-27 21:09:50,587][106225] Updated weights for policy 1, policy_version 269698 (0.0009) [2023-12-27 21:09:50,648][106225] Updated weights for policy 1, policy_version 269708 (0.0006) [2023-12-27 21:09:50,705][106225] Updated weights for policy 1, policy_version 269718 (0.0005) [2023-12-27 21:09:50,764][106225] Updated weights for policy 1, policy_version 269728 (0.0005) [2023-12-27 21:09:50,982][106226] Updated weights for policy 0, policy_version 269328 (0.0009) [2023-12-27 21:09:51,049][106226] Updated weights for policy 0, policy_version 269338 (0.0008) [2023-12-27 21:09:51,116][106226] Updated weights for policy 0, policy_version 269348 (0.0008) [2023-12-27 21:09:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 138043392. Throughput: 0: 9909.2, 1: 9756.8. Samples: 138049536. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:09:51,175][105115] Avg episode reward: [(0, '-4.681'), (1, '-5.880')] [2023-12-27 21:09:51,376][106225] Updated weights for policy 1, policy_version 269738 (0.0008) [2023-12-27 21:09:51,439][106225] Updated weights for policy 1, policy_version 269748 (0.0008) [2023-12-27 21:09:51,497][106225] Updated weights for policy 1, policy_version 269758 (0.0008) [2023-12-27 21:09:51,864][106226] Updated weights for policy 0, policy_version 269358 (0.0008) [2023-12-27 21:09:51,913][106226] Updated weights for policy 0, policy_version 269368 (0.0008) [2023-12-27 21:09:51,972][106226] Updated weights for policy 0, policy_version 269378 (0.0009) [2023-12-27 21:09:52,235][106225] Updated weights for policy 1, policy_version 269768 (0.0009) [2023-12-27 21:09:52,293][106225] Updated weights for policy 1, policy_version 269778 (0.0008) [2023-12-27 21:09:52,373][106225] Updated weights for policy 1, policy_version 269788 (0.0007) [2023-12-27 21:09:52,764][106226] Updated weights for policy 0, policy_version 269388 (0.0009) [2023-12-27 21:09:52,820][106226] Updated weights for policy 0, policy_version 269398 (0.0009) [2023-12-27 21:09:52,876][106226] Updated weights for policy 0, policy_version 269408 (0.0008) [2023-12-27 21:09:53,079][106225] Updated weights for policy 1, policy_version 269798 (0.0009) [2023-12-27 21:09:53,142][106225] Updated weights for policy 1, policy_version 269808 (0.0009) [2023-12-27 21:09:53,187][106225] Updated weights for policy 1, policy_version 269818 (0.0008) [2023-12-27 21:09:53,625][106226] Updated weights for policy 0, policy_version 269418 (0.0008) [2023-12-27 21:09:53,684][106226] Updated weights for policy 0, policy_version 269428 (0.0009) [2023-12-27 21:09:53,752][106226] Updated weights for policy 0, policy_version 269438 (0.0008) [2023-12-27 21:09:53,809][106226] Updated weights for policy 0, policy_version 269448 (0.0008) [2023-12-27 21:09:53,922][106225] Updated weights for policy 1, policy_version 269828 (0.0008) [2023-12-27 21:09:53,978][106225] Updated weights for policy 1, policy_version 269838 (0.0008) [2023-12-27 21:09:54,043][106225] Updated weights for policy 1, policy_version 269848 (0.0009) [2023-12-27 21:09:54,540][106226] Updated weights for policy 0, policy_version 269458 (0.0009) [2023-12-27 21:09:54,600][106226] Updated weights for policy 0, policy_version 269468 (0.0008) [2023-12-27 21:09:54,662][106226] Updated weights for policy 0, policy_version 269478 (0.0008) [2023-12-27 21:09:54,748][106225] Updated weights for policy 1, policy_version 269858 (0.0009) [2023-12-27 21:09:54,811][106225] Updated weights for policy 1, policy_version 269868 (0.0008) [2023-12-27 21:09:54,871][106225] Updated weights for policy 1, policy_version 269878 (0.0008) [2023-12-27 21:09:54,929][106225] Updated weights for policy 1, policy_version 269888 (0.0009) [2023-12-27 21:09:55,346][106226] Updated weights for policy 0, policy_version 269488 (0.0009) [2023-12-27 21:09:55,397][106226] Updated weights for policy 0, policy_version 269498 (0.0008) [2023-12-27 21:09:55,455][106226] Updated weights for policy 0, policy_version 269508 (0.0008) [2023-12-27 21:09:55,673][106225] Updated weights for policy 1, policy_version 269898 (0.0009) [2023-12-27 21:09:55,733][106225] Updated weights for policy 1, policy_version 269908 (0.0009) [2023-12-27 21:09:55,798][106225] Updated weights for policy 1, policy_version 269918 (0.0007) [2023-12-27 21:09:56,128][106226] Updated weights for policy 0, policy_version 269518 (0.0008) [2023-12-27 21:09:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 138133504. Throughput: 0: 9889.9, 1: 9750.4. Samples: 138106604. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:09:56,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-5.585')] [2023-12-27 21:09:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000269920_69115904.pth... [2023-12-27 21:09:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000268800_68829184.pth [2023-12-27 21:09:56,187][106226] Updated weights for policy 0, policy_version 269528 (0.0008) [2023-12-27 21:09:56,240][106226] Updated weights for policy 0, policy_version 269538 (0.0007) [2023-12-27 21:09:56,270][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000269544_69025792.pth... [2023-12-27 21:09:56,273][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000268360_68722688.pth [2023-12-27 21:09:56,546][106225] Updated weights for policy 1, policy_version 269928 (0.0008) [2023-12-27 21:09:56,594][106225] Updated weights for policy 1, policy_version 269938 (0.0008) [2023-12-27 21:09:56,649][106225] Updated weights for policy 1, policy_version 269948 (0.0008) [2023-12-27 21:09:56,910][106226] Updated weights for policy 0, policy_version 269548 (0.0005) [2023-12-27 21:09:56,963][106226] Updated weights for policy 0, policy_version 269558 (0.0008) [2023-12-27 21:09:57,006][106226] Updated weights for policy 0, policy_version 269568 (0.0008) [2023-12-27 21:09:57,379][106225] Updated weights for policy 1, policy_version 269958 (0.0008) [2023-12-27 21:09:57,424][106225] Updated weights for policy 1, policy_version 269968 (0.0005) [2023-12-27 21:09:57,485][106225] Updated weights for policy 1, policy_version 269978 (0.0005) [2023-12-27 21:09:57,751][106226] Updated weights for policy 0, policy_version 269578 (0.0009) [2023-12-27 21:09:57,815][106226] Updated weights for policy 0, policy_version 269588 (0.0009) [2023-12-27 21:09:57,867][106226] Updated weights for policy 0, policy_version 269598 (0.0008) [2023-12-27 21:09:57,918][106226] Updated weights for policy 0, policy_version 269608 (0.0008) [2023-12-27 21:09:58,123][106225] Updated weights for policy 1, policy_version 269988 (0.0006) [2023-12-27 21:09:58,176][106225] Updated weights for policy 1, policy_version 269998 (0.0007) [2023-12-27 21:09:58,241][106225] Updated weights for policy 1, policy_version 270008 (0.0008) [2023-12-27 21:09:58,678][106226] Updated weights for policy 0, policy_version 269618 (0.0007) [2023-12-27 21:09:58,740][106226] Updated weights for policy 0, policy_version 269628 (0.0008) [2023-12-27 21:09:58,813][106226] Updated weights for policy 0, policy_version 269638 (0.0006) [2023-12-27 21:09:59,035][106225] Updated weights for policy 1, policy_version 270018 (0.0008) [2023-12-27 21:09:59,086][106225] Updated weights for policy 1, policy_version 270028 (0.0009) [2023-12-27 21:09:59,145][106225] Updated weights for policy 1, policy_version 270038 (0.0008) [2023-12-27 21:09:59,203][106225] Updated weights for policy 1, policy_version 270048 (0.0008) [2023-12-27 21:09:59,594][106226] Updated weights for policy 0, policy_version 269648 (0.0008) [2023-12-27 21:09:59,658][106226] Updated weights for policy 0, policy_version 269658 (0.0009) [2023-12-27 21:09:59,714][106226] Updated weights for policy 0, policy_version 269668 (0.0009) [2023-12-27 21:10:00,021][106225] Updated weights for policy 1, policy_version 270058 (0.0008) [2023-12-27 21:10:00,069][106225] Updated weights for policy 1, policy_version 270068 (0.0008) [2023-12-27 21:10:00,118][106225] Updated weights for policy 1, policy_version 270078 (0.0008) [2023-12-27 21:10:00,465][106226] Updated weights for policy 0, policy_version 269678 (0.0009) [2023-12-27 21:10:00,522][106226] Updated weights for policy 0, policy_version 269688 (0.0008) [2023-12-27 21:10:00,586][106226] Updated weights for policy 0, policy_version 269698 (0.0007) [2023-12-27 21:10:00,836][106225] Updated weights for policy 1, policy_version 270088 (0.0008) [2023-12-27 21:10:00,888][106225] Updated weights for policy 1, policy_version 270098 (0.0006) [2023-12-27 21:10:00,942][106225] Updated weights for policy 1, policy_version 270108 (0.0006) [2023-12-27 21:10:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 138231808. Throughput: 0: 9872.9, 1: 9690.1. Samples: 138221116. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:01,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-5.561')] [2023-12-27 21:10:01,285][106226] Updated weights for policy 0, policy_version 269708 (0.0007) [2023-12-27 21:10:01,345][106226] Updated weights for policy 0, policy_version 269718 (0.0008) [2023-12-27 21:10:01,405][106226] Updated weights for policy 0, policy_version 269728 (0.0008) [2023-12-27 21:10:01,651][106225] Updated weights for policy 1, policy_version 270118 (0.0008) [2023-12-27 21:10:01,722][106225] Updated weights for policy 1, policy_version 270128 (0.0010) [2023-12-27 21:10:01,795][106225] Updated weights for policy 1, policy_version 270138 (0.0014) [2023-12-27 21:10:02,131][106226] Updated weights for policy 0, policy_version 269738 (0.0009) [2023-12-27 21:10:02,181][106226] Updated weights for policy 0, policy_version 269748 (0.0005) [2023-12-27 21:10:02,229][106226] Updated weights for policy 0, policy_version 269758 (0.0006) [2023-12-27 21:10:02,288][106226] Updated weights for policy 0, policy_version 269768 (0.0008) [2023-12-27 21:10:02,494][106225] Updated weights for policy 1, policy_version 270148 (0.0006) [2023-12-27 21:10:02,553][106225] Updated weights for policy 1, policy_version 270158 (0.0007) [2023-12-27 21:10:02,610][106225] Updated weights for policy 1, policy_version 270168 (0.0010) [2023-12-27 21:10:02,926][106226] Updated weights for policy 0, policy_version 269778 (0.0009) [2023-12-27 21:10:02,990][106226] Updated weights for policy 0, policy_version 269788 (0.0006) [2023-12-27 21:10:03,050][106226] Updated weights for policy 0, policy_version 269798 (0.0010) [2023-12-27 21:10:03,196][106225] Updated weights for policy 1, policy_version 270178 (0.0010) [2023-12-27 21:10:03,249][106225] Updated weights for policy 1, policy_version 270188 (0.0010) [2023-12-27 21:10:03,307][106225] Updated weights for policy 1, policy_version 270198 (0.0010) [2023-12-27 21:10:03,363][106225] Updated weights for policy 1, policy_version 270208 (0.0009) [2023-12-27 21:10:03,709][106226] Updated weights for policy 0, policy_version 269808 (0.0010) [2023-12-27 21:10:03,764][106226] Updated weights for policy 0, policy_version 269818 (0.0011) [2023-12-27 21:10:03,825][106226] Updated weights for policy 0, policy_version 269828 (0.0010) [2023-12-27 21:10:04,102][106225] Updated weights for policy 1, policy_version 270218 (0.0009) [2023-12-27 21:10:04,162][106225] Updated weights for policy 1, policy_version 270228 (0.0008) [2023-12-27 21:10:04,228][106225] Updated weights for policy 1, policy_version 270238 (0.0008) [2023-12-27 21:10:04,494][106226] Updated weights for policy 0, policy_version 269838 (0.0008) [2023-12-27 21:10:04,551][106226] Updated weights for policy 0, policy_version 269848 (0.0009) [2023-12-27 21:10:04,604][106226] Updated weights for policy 0, policy_version 269858 (0.0010) [2023-12-27 21:10:04,983][106225] Updated weights for policy 1, policy_version 270248 (0.0010) [2023-12-27 21:10:05,044][106225] Updated weights for policy 1, policy_version 270258 (0.0010) [2023-12-27 21:10:05,111][106225] Updated weights for policy 1, policy_version 270268 (0.0011) [2023-12-27 21:10:05,252][106226] Updated weights for policy 0, policy_version 269868 (0.0010) [2023-12-27 21:10:05,313][106226] Updated weights for policy 0, policy_version 269878 (0.0011) [2023-12-27 21:10:05,379][106226] Updated weights for policy 0, policy_version 269888 (0.0006) [2023-12-27 21:10:05,789][106225] Updated weights for policy 1, policy_version 270278 (0.0008) [2023-12-27 21:10:05,842][106225] Updated weights for policy 1, policy_version 270288 (0.0005) [2023-12-27 21:10:05,893][106225] Updated weights for policy 1, policy_version 270298 (0.0006) [2023-12-27 21:10:06,052][106226] Updated weights for policy 0, policy_version 269898 (0.0009) [2023-12-27 21:10:06,105][106226] Updated weights for policy 0, policy_version 269908 (0.0010) [2023-12-27 21:10:06,167][106226] Updated weights for policy 0, policy_version 269918 (0.0008) [2023-12-27 21:10:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 138330112. Throughput: 0: 9899.3, 1: 9675.7. Samples: 138341872. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:06,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-5.801')] [2023-12-27 21:10:06,230][106226] Updated weights for policy 0, policy_version 269928 (0.0007) [2023-12-27 21:10:06,515][106225] Updated weights for policy 1, policy_version 270308 (0.0007) [2023-12-27 21:10:06,570][106225] Updated weights for policy 1, policy_version 270318 (0.0007) [2023-12-27 21:10:06,619][106225] Updated weights for policy 1, policy_version 270328 (0.0006) [2023-12-27 21:10:06,873][106226] Updated weights for policy 0, policy_version 269938 (0.0007) [2023-12-27 21:10:06,928][106226] Updated weights for policy 0, policy_version 269948 (0.0011) [2023-12-27 21:10:06,978][106226] Updated weights for policy 0, policy_version 269958 (0.0010) [2023-12-27 21:10:07,219][106225] Updated weights for policy 1, policy_version 270338 (0.0006) [2023-12-27 21:10:07,265][106225] Updated weights for policy 1, policy_version 270348 (0.0007) [2023-12-27 21:10:07,324][106225] Updated weights for policy 1, policy_version 270358 (0.0005) [2023-12-27 21:10:07,388][106225] Updated weights for policy 1, policy_version 270368 (0.0007) [2023-12-27 21:10:07,655][106226] Updated weights for policy 0, policy_version 269968 (0.0010) [2023-12-27 21:10:07,701][106226] Updated weights for policy 0, policy_version 269978 (0.0007) [2023-12-27 21:10:07,759][106226] Updated weights for policy 0, policy_version 269988 (0.0007) [2023-12-27 21:10:08,006][106225] Updated weights for policy 1, policy_version 270378 (0.0008) [2023-12-27 21:10:08,063][106225] Updated weights for policy 1, policy_version 270388 (0.0008) [2023-12-27 21:10:08,120][106225] Updated weights for policy 1, policy_version 270398 (0.0008) [2023-12-27 21:10:08,515][106226] Updated weights for policy 0, policy_version 269998 (0.0009) [2023-12-27 21:10:08,569][106226] Updated weights for policy 0, policy_version 270008 (0.0011) [2023-12-27 21:10:08,626][106226] Updated weights for policy 0, policy_version 270018 (0.0011) [2023-12-27 21:10:08,821][106225] Updated weights for policy 1, policy_version 270408 (0.0007) [2023-12-27 21:10:08,879][106225] Updated weights for policy 1, policy_version 270418 (0.0007) [2023-12-27 21:10:08,938][106225] Updated weights for policy 1, policy_version 270428 (0.0008) [2023-12-27 21:10:09,371][106226] Updated weights for policy 0, policy_version 270028 (0.0011) [2023-12-27 21:10:09,444][106226] Updated weights for policy 0, policy_version 270038 (0.0011) [2023-12-27 21:10:09,504][106226] Updated weights for policy 0, policy_version 270048 (0.0010) [2023-12-27 21:10:09,710][106225] Updated weights for policy 1, policy_version 270438 (0.0008) [2023-12-27 21:10:09,772][106225] Updated weights for policy 1, policy_version 270448 (0.0008) [2023-12-27 21:10:09,838][106225] Updated weights for policy 1, policy_version 270458 (0.0008) [2023-12-27 21:10:10,251][106226] Updated weights for policy 0, policy_version 270058 (0.0011) [2023-12-27 21:10:10,312][106226] Updated weights for policy 0, policy_version 270068 (0.0011) [2023-12-27 21:10:10,374][106226] Updated weights for policy 0, policy_version 270078 (0.0011) [2023-12-27 21:10:10,442][106226] Updated weights for policy 0, policy_version 270088 (0.0011) [2023-12-27 21:10:10,598][106225] Updated weights for policy 1, policy_version 270468 (0.0009) [2023-12-27 21:10:10,661][106225] Updated weights for policy 1, policy_version 270479 (0.0007) [2023-12-27 21:10:10,724][106225] Updated weights for policy 1, policy_version 270489 (0.0008) [2023-12-27 21:10:11,164][106226] Updated weights for policy 0, policy_version 270098 (0.0008) [2023-12-27 21:10:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 138428416. Throughput: 0: 9932.8, 1: 9766.0. Samples: 138404484. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:11,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-5.842')] [2023-12-27 21:10:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000270496_69263360.pth... [2023-12-27 21:10:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000269376_68976640.pth [2023-12-27 21:10:11,226][106226] Updated weights for policy 0, policy_version 270108 (0.0009) [2023-12-27 21:10:11,294][106226] Updated weights for policy 0, policy_version 270118 (0.0010) [2023-12-27 21:10:11,304][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000270120_69173248.pth... [2023-12-27 21:10:11,308][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000268968_68878336.pth [2023-12-27 21:10:11,416][106225] Updated weights for policy 1, policy_version 270499 (0.0008) [2023-12-27 21:10:11,475][106225] Updated weights for policy 1, policy_version 270509 (0.0008) [2023-12-27 21:10:11,525][106225] Updated weights for policy 1, policy_version 270519 (0.0009) [2023-12-27 21:10:12,032][106226] Updated weights for policy 0, policy_version 270128 (0.0008) [2023-12-27 21:10:12,095][106226] Updated weights for policy 0, policy_version 270138 (0.0009) [2023-12-27 21:10:12,154][106226] Updated weights for policy 0, policy_version 270148 (0.0008) [2023-12-27 21:10:12,395][106225] Updated weights for policy 1, policy_version 270529 (0.0009) [2023-12-27 21:10:12,450][106225] Updated weights for policy 1, policy_version 270539 (0.0008) [2023-12-27 21:10:12,500][106225] Updated weights for policy 1, policy_version 270549 (0.0006) [2023-12-27 21:10:12,560][106225] Updated weights for policy 1, policy_version 270559 (0.0009) [2023-12-27 21:10:12,898][106226] Updated weights for policy 0, policy_version 270158 (0.0010) [2023-12-27 21:10:12,956][106226] Updated weights for policy 0, policy_version 270168 (0.0008) [2023-12-27 21:10:13,011][106226] Updated weights for policy 0, policy_version 270178 (0.0009) [2023-12-27 21:10:13,199][106225] Updated weights for policy 1, policy_version 270569 (0.0005) [2023-12-27 21:10:13,246][106225] Updated weights for policy 1, policy_version 270579 (0.0005) [2023-12-27 21:10:13,291][106225] Updated weights for policy 1, policy_version 270589 (0.0005) [2023-12-27 21:10:13,693][106226] Updated weights for policy 0, policy_version 270188 (0.0009) [2023-12-27 21:10:13,759][106226] Updated weights for policy 0, policy_version 270198 (0.0008) [2023-12-27 21:10:13,812][106226] Updated weights for policy 0, policy_version 270208 (0.0009) [2023-12-27 21:10:13,906][106225] Updated weights for policy 1, policy_version 270599 (0.0006) [2023-12-27 21:10:13,964][106225] Updated weights for policy 1, policy_version 270609 (0.0006) [2023-12-27 21:10:14,016][106225] Updated weights for policy 1, policy_version 270619 (0.0006) [2023-12-27 21:10:14,595][106226] Updated weights for policy 0, policy_version 270218 (0.0009) [2023-12-27 21:10:14,657][106226] Updated weights for policy 0, policy_version 270228 (0.0009) [2023-12-27 21:10:14,663][106225] Updated weights for policy 1, policy_version 270629 (0.0009) [2023-12-27 21:10:14,711][106225] Updated weights for policy 1, policy_version 270639 (0.0010) [2023-12-27 21:10:14,711][106226] Updated weights for policy 0, policy_version 270238 (0.0007) [2023-12-27 21:10:14,758][106225] Updated weights for policy 1, policy_version 270649 (0.0010) [2023-12-27 21:10:14,773][106226] Updated weights for policy 0, policy_version 270248 (0.0007) [2023-12-27 21:10:15,482][106226] Updated weights for policy 0, policy_version 270258 (0.0006) [2023-12-27 21:10:15,517][106225] Updated weights for policy 1, policy_version 270659 (0.0010) [2023-12-27 21:10:15,532][106226] Updated weights for policy 0, policy_version 270268 (0.0010) [2023-12-27 21:10:15,568][106225] Updated weights for policy 1, policy_version 270669 (0.0006) [2023-12-27 21:10:15,582][106226] Updated weights for policy 0, policy_version 270278 (0.0011) [2023-12-27 21:10:15,613][106225] Updated weights for policy 1, policy_version 270679 (0.0007) [2023-12-27 21:10:16,172][106226] Updated weights for policy 0, policy_version 270288 (0.0009) [2023-12-27 21:10:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19883.0). Total num frames: 138526720. Throughput: 0: 9758.8, 1: 9729.7. Samples: 138519688. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:16,176][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.912')] [2023-12-27 21:10:16,225][106226] Updated weights for policy 0, policy_version 270298 (0.0011) [2023-12-27 21:10:16,268][106226] Updated weights for policy 0, policy_version 270308 (0.0010) [2023-12-27 21:10:16,296][106225] Updated weights for policy 1, policy_version 270689 (0.0007) [2023-12-27 21:10:16,342][106225] Updated weights for policy 1, policy_version 270699 (0.0010) [2023-12-27 21:10:16,389][106225] Updated weights for policy 1, policy_version 270709 (0.0010) [2023-12-27 21:10:16,432][106225] Updated weights for policy 1, policy_version 270719 (0.0010) [2023-12-27 21:10:16,943][106226] Updated weights for policy 0, policy_version 270318 (0.0007) [2023-12-27 21:10:16,993][106226] Updated weights for policy 0, policy_version 270328 (0.0011) [2023-12-27 21:10:17,053][106226] Updated weights for policy 0, policy_version 270338 (0.0011) [2023-12-27 21:10:17,059][106225] Updated weights for policy 1, policy_version 270729 (0.0006) [2023-12-27 21:10:17,113][106225] Updated weights for policy 1, policy_version 270739 (0.0006) [2023-12-27 21:10:17,162][106225] Updated weights for policy 1, policy_version 270749 (0.0010) [2023-12-27 21:10:17,626][106226] Updated weights for policy 0, policy_version 270348 (0.0009) [2023-12-27 21:10:17,674][106226] Updated weights for policy 0, policy_version 270358 (0.0005) [2023-12-27 21:10:17,723][106226] Updated weights for policy 0, policy_version 270368 (0.0010) [2023-12-27 21:10:17,808][106225] Updated weights for policy 1, policy_version 270759 (0.0010) [2023-12-27 21:10:17,861][106225] Updated weights for policy 1, policy_version 270769 (0.0010) [2023-12-27 21:10:17,905][106225] Updated weights for policy 1, policy_version 270779 (0.0008) [2023-12-27 21:10:18,416][106226] Updated weights for policy 0, policy_version 270378 (0.0010) [2023-12-27 21:10:18,483][106226] Updated weights for policy 0, policy_version 270388 (0.0008) [2023-12-27 21:10:18,531][106225] Updated weights for policy 1, policy_version 270789 (0.0006) [2023-12-27 21:10:18,549][106226] Updated weights for policy 0, policy_version 270398 (0.0009) [2023-12-27 21:10:18,591][106225] Updated weights for policy 1, policy_version 270799 (0.0006) [2023-12-27 21:10:18,616][106226] Updated weights for policy 0, policy_version 270408 (0.0009) [2023-12-27 21:10:18,644][106225] Updated weights for policy 1, policy_version 270809 (0.0007) [2023-12-27 21:10:19,226][106226] Updated weights for policy 0, policy_version 270418 (0.0006) [2023-12-27 21:10:19,287][106226] Updated weights for policy 0, policy_version 270428 (0.0007) [2023-12-27 21:10:19,337][106225] Updated weights for policy 1, policy_version 270819 (0.0008) [2023-12-27 21:10:19,349][106226] Updated weights for policy 0, policy_version 270438 (0.0006) [2023-12-27 21:10:19,407][106225] Updated weights for policy 1, policy_version 270829 (0.0009) [2023-12-27 21:10:19,466][106225] Updated weights for policy 1, policy_version 270839 (0.0009) [2023-12-27 21:10:20,108][106226] Updated weights for policy 0, policy_version 270448 (0.0008) [2023-12-27 21:10:20,175][106226] Updated weights for policy 0, policy_version 270458 (0.0009) [2023-12-27 21:10:20,184][106225] Updated weights for policy 1, policy_version 270849 (0.0010) [2023-12-27 21:10:20,236][106226] Updated weights for policy 0, policy_version 270468 (0.0007) [2023-12-27 21:10:20,237][106225] Updated weights for policy 1, policy_version 270859 (0.0008) [2023-12-27 21:10:20,300][106225] Updated weights for policy 1, policy_version 270869 (0.0008) [2023-12-27 21:10:20,363][106225] Updated weights for policy 1, policy_version 270879 (0.0008) [2023-12-27 21:10:20,866][106226] Updated weights for policy 0, policy_version 270478 (0.0006) [2023-12-27 21:10:20,928][106226] Updated weights for policy 0, policy_version 270488 (0.0008) [2023-12-27 21:10:20,982][106226] Updated weights for policy 0, policy_version 270498 (0.0009) [2023-12-27 21:10:21,124][106225] Updated weights for policy 1, policy_version 270889 (0.0008) [2023-12-27 21:10:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 138633216. Throughput: 0: 9833.2, 1: 9781.3. Samples: 138644084. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:21,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.996')] [2023-12-27 21:10:21,190][106225] Updated weights for policy 1, policy_version 270899 (0.0009) [2023-12-27 21:10:21,260][106225] Updated weights for policy 1, policy_version 270909 (0.0009) [2023-12-27 21:10:21,759][106226] Updated weights for policy 0, policy_version 270508 (0.0008) [2023-12-27 21:10:21,824][106226] Updated weights for policy 0, policy_version 270518 (0.0009) [2023-12-27 21:10:21,892][106226] Updated weights for policy 0, policy_version 270528 (0.0009) [2023-12-27 21:10:22,029][106225] Updated weights for policy 1, policy_version 270919 (0.0007) [2023-12-27 21:10:22,089][106225] Updated weights for policy 1, policy_version 270929 (0.0006) [2023-12-27 21:10:22,143][106225] Updated weights for policy 1, policy_version 270939 (0.0006) [2023-12-27 21:10:22,700][106226] Updated weights for policy 0, policy_version 270538 (0.0008) [2023-12-27 21:10:22,762][106226] Updated weights for policy 0, policy_version 270548 (0.0009) [2023-12-27 21:10:22,776][106225] Updated weights for policy 1, policy_version 270949 (0.0007) [2023-12-27 21:10:22,829][106226] Updated weights for policy 0, policy_version 270558 (0.0008) [2023-12-27 21:10:22,840][106225] Updated weights for policy 1, policy_version 270959 (0.0007) [2023-12-27 21:10:22,893][106226] Updated weights for policy 0, policy_version 270568 (0.0008) [2023-12-27 21:10:22,906][106225] Updated weights for policy 1, policy_version 270969 (0.0008) [2023-12-27 21:10:23,510][106225] Updated weights for policy 1, policy_version 270979 (0.0008) [2023-12-27 21:10:23,556][106225] Updated weights for policy 1, policy_version 270989 (0.0007) [2023-12-27 21:10:23,601][106225] Updated weights for policy 1, policy_version 270999 (0.0007) [2023-12-27 21:10:23,678][106226] Updated weights for policy 0, policy_version 270578 (0.0011) [2023-12-27 21:10:23,742][106226] Updated weights for policy 0, policy_version 270588 (0.0011) [2023-12-27 21:10:23,788][106226] Updated weights for policy 0, policy_version 270598 (0.0010) [2023-12-27 21:10:24,289][106225] Updated weights for policy 1, policy_version 271009 (0.0008) [2023-12-27 21:10:24,356][106225] Updated weights for policy 1, policy_version 271019 (0.0008) [2023-12-27 21:10:24,423][106225] Updated weights for policy 1, policy_version 271029 (0.0008) [2023-12-27 21:10:24,446][106226] Updated weights for policy 0, policy_version 270608 (0.0010) [2023-12-27 21:10:24,483][106225] Updated weights for policy 1, policy_version 271039 (0.0008) [2023-12-27 21:10:24,502][106226] Updated weights for policy 0, policy_version 270618 (0.0007) [2023-12-27 21:10:24,552][106226] Updated weights for policy 0, policy_version 270628 (0.0008) [2023-12-27 21:10:25,107][106225] Updated weights for policy 1, policy_version 271049 (0.0009) [2023-12-27 21:10:25,163][106225] Updated weights for policy 1, policy_version 271059 (0.0010) [2023-12-27 21:10:25,167][106226] Updated weights for policy 0, policy_version 270638 (0.0009) [2023-12-27 21:10:25,225][106225] Updated weights for policy 1, policy_version 271069 (0.0010) [2023-12-27 21:10:25,228][106226] Updated weights for policy 0, policy_version 270648 (0.0009) [2023-12-27 21:10:25,277][106226] Updated weights for policy 0, policy_version 270658 (0.0008) [2023-12-27 21:10:25,842][106226] Updated weights for policy 0, policy_version 270668 (0.0008) [2023-12-27 21:10:25,890][106225] Updated weights for policy 1, policy_version 271079 (0.0009) [2023-12-27 21:10:25,892][106226] Updated weights for policy 0, policy_version 270678 (0.0007) [2023-12-27 21:10:25,942][106226] Updated weights for policy 0, policy_version 270688 (0.0006) [2023-12-27 21:10:25,946][106225] Updated weights for policy 1, policy_version 271089 (0.0010) [2023-12-27 21:10:25,996][106225] Updated weights for policy 1, policy_version 271099 (0.0010) [2023-12-27 21:10:26,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 138739712. Throughput: 0: 9759.9, 1: 9796.4. Samples: 138701176. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:26,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-5.922')] [2023-12-27 21:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000270696_69320704.pth... [2023-12-27 21:10:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000271104_69419008.pth... [2023-12-27 21:10:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000269544_69025792.pth [2023-12-27 21:10:26,186][106140] Saving new best policy, reward=-4.256! [2023-12-27 21:10:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000269920_69115904.pth [2023-12-27 21:10:26,578][106226] Updated weights for policy 0, policy_version 270698 (0.0008) [2023-12-27 21:10:26,637][106226] Updated weights for policy 0, policy_version 270708 (0.0007) [2023-12-27 21:10:26,690][106226] Updated weights for policy 0, policy_version 270718 (0.0007) [2023-12-27 21:10:26,718][106225] Updated weights for policy 1, policy_version 271109 (0.0010) [2023-12-27 21:10:26,744][106226] Updated weights for policy 0, policy_version 270728 (0.0005) [2023-12-27 21:10:26,774][106225] Updated weights for policy 1, policy_version 271119 (0.0010) [2023-12-27 21:10:26,836][106225] Updated weights for policy 1, policy_version 271129 (0.0010) [2023-12-27 21:10:27,378][106226] Updated weights for policy 0, policy_version 270738 (0.0006) [2023-12-27 21:10:27,431][106226] Updated weights for policy 0, policy_version 270748 (0.0007) [2023-12-27 21:10:27,477][106226] Updated weights for policy 0, policy_version 270758 (0.0007) [2023-12-27 21:10:27,527][106225] Updated weights for policy 1, policy_version 271139 (0.0010) [2023-12-27 21:10:27,576][106225] Updated weights for policy 1, policy_version 271149 (0.0010) [2023-12-27 21:10:27,636][106225] Updated weights for policy 1, policy_version 271159 (0.0010) [2023-12-27 21:10:28,151][106226] Updated weights for policy 0, policy_version 270768 (0.0005) [2023-12-27 21:10:28,202][106226] Updated weights for policy 0, policy_version 270778 (0.0005) [2023-12-27 21:10:28,258][106226] Updated weights for policy 0, policy_version 270788 (0.0005) [2023-12-27 21:10:28,354][106225] Updated weights for policy 1, policy_version 271169 (0.0010) [2023-12-27 21:10:28,407][106225] Updated weights for policy 1, policy_version 271179 (0.0010) [2023-12-27 21:10:28,466][106225] Updated weights for policy 1, policy_version 271189 (0.0011) [2023-12-27 21:10:28,524][106225] Updated weights for policy 1, policy_version 271199 (0.0010) [2023-12-27 21:10:28,896][106226] Updated weights for policy 0, policy_version 270798 (0.0006) [2023-12-27 21:10:28,958][106226] Updated weights for policy 0, policy_version 270808 (0.0008) [2023-12-27 21:10:29,016][106226] Updated weights for policy 0, policy_version 270818 (0.0008) [2023-12-27 21:10:29,187][106225] Updated weights for policy 1, policy_version 271209 (0.0010) [2023-12-27 21:10:29,255][106225] Updated weights for policy 1, policy_version 271219 (0.0009) [2023-12-27 21:10:29,320][106225] Updated weights for policy 1, policy_version 271229 (0.0008) [2023-12-27 21:10:29,723][106226] Updated weights for policy 0, policy_version 270828 (0.0007) [2023-12-27 21:10:29,784][106226] Updated weights for policy 0, policy_version 270838 (0.0005) [2023-12-27 21:10:29,850][106226] Updated weights for policy 0, policy_version 270848 (0.0007) [2023-12-27 21:10:30,052][106225] Updated weights for policy 1, policy_version 271239 (0.0008) [2023-12-27 21:10:30,115][106225] Updated weights for policy 1, policy_version 271249 (0.0008) [2023-12-27 21:10:30,179][106225] Updated weights for policy 1, policy_version 271259 (0.0008) [2023-12-27 21:10:30,543][106226] Updated weights for policy 0, policy_version 270858 (0.0010) [2023-12-27 21:10:30,600][106226] Updated weights for policy 0, policy_version 270868 (0.0008) [2023-12-27 21:10:30,658][106226] Updated weights for policy 0, policy_version 270878 (0.0008) [2023-12-27 21:10:30,708][106226] Updated weights for policy 0, policy_version 270888 (0.0008) [2023-12-27 21:10:30,839][106225] Updated weights for policy 1, policy_version 271269 (0.0007) [2023-12-27 21:10:30,885][106225] Updated weights for policy 1, policy_version 271279 (0.0007) [2023-12-27 21:10:30,938][106225] Updated weights for policy 1, policy_version 271289 (0.0007) [2023-12-27 21:10:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 138838016. Throughput: 0: 9895.6, 1: 9895.7. Samples: 138826280. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:31,175][105115] Avg episode reward: [(0, '-4.966'), (1, '-5.715')] [2023-12-27 21:10:31,496][106226] Updated weights for policy 0, policy_version 270898 (0.0006) [2023-12-27 21:10:31,556][106226] Updated weights for policy 0, policy_version 270908 (0.0006) [2023-12-27 21:10:31,618][106226] Updated weights for policy 0, policy_version 270918 (0.0006) [2023-12-27 21:10:31,645][106225] Updated weights for policy 1, policy_version 271299 (0.0006) [2023-12-27 21:10:31,712][106225] Updated weights for policy 1, policy_version 271309 (0.0007) [2023-12-27 21:10:31,782][106225] Updated weights for policy 1, policy_version 271319 (0.0008) [2023-12-27 21:10:32,309][106226] Updated weights for policy 0, policy_version 270928 (0.0007) [2023-12-27 21:10:32,379][106226] Updated weights for policy 0, policy_version 270938 (0.0007) [2023-12-27 21:10:32,447][106226] Updated weights for policy 0, policy_version 270948 (0.0005) [2023-12-27 21:10:32,556][106225] Updated weights for policy 1, policy_version 271329 (0.0009) [2023-12-27 21:10:32,612][106225] Updated weights for policy 1, policy_version 271339 (0.0008) [2023-12-27 21:10:32,672][106225] Updated weights for policy 1, policy_version 271349 (0.0009) [2023-12-27 21:10:32,728][106225] Updated weights for policy 1, policy_version 271359 (0.0008) [2023-12-27 21:10:33,086][106226] Updated weights for policy 0, policy_version 270958 (0.0008) [2023-12-27 21:10:33,153][106226] Updated weights for policy 0, policy_version 270968 (0.0006) [2023-12-27 21:10:33,214][106226] Updated weights for policy 0, policy_version 270978 (0.0005) [2023-12-27 21:10:33,475][106225] Updated weights for policy 1, policy_version 271369 (0.0008) [2023-12-27 21:10:33,533][106225] Updated weights for policy 1, policy_version 271379 (0.0007) [2023-12-27 21:10:33,593][106225] Updated weights for policy 1, policy_version 271389 (0.0005) [2023-12-27 21:10:33,839][106226] Updated weights for policy 0, policy_version 270988 (0.0007) [2023-12-27 21:10:33,893][106226] Updated weights for policy 0, policy_version 270998 (0.0008) [2023-12-27 21:10:33,951][106226] Updated weights for policy 0, policy_version 271008 (0.0008) [2023-12-27 21:10:34,109][106225] Updated weights for policy 1, policy_version 271399 (0.0005) [2023-12-27 21:10:34,172][106225] Updated weights for policy 1, policy_version 271409 (0.0008) [2023-12-27 21:10:34,242][106225] Updated weights for policy 1, policy_version 271419 (0.0007) [2023-12-27 21:10:34,794][106226] Updated weights for policy 0, policy_version 271018 (0.0008) [2023-12-27 21:10:34,861][106226] Updated weights for policy 0, policy_version 271028 (0.0008) [2023-12-27 21:10:34,909][106226] Updated weights for policy 0, policy_version 271038 (0.0008) [2023-12-27 21:10:34,959][106226] Updated weights for policy 0, policy_version 271048 (0.0008) [2023-12-27 21:10:34,973][106225] Updated weights for policy 1, policy_version 271429 (0.0008) [2023-12-27 21:10:35,031][106225] Updated weights for policy 1, policy_version 271439 (0.0008) [2023-12-27 21:10:35,084][106225] Updated weights for policy 1, policy_version 271449 (0.0007) [2023-12-27 21:10:35,729][106226] Updated weights for policy 0, policy_version 271058 (0.0009) [2023-12-27 21:10:35,779][106225] Updated weights for policy 1, policy_version 271459 (0.0007) [2023-12-27 21:10:35,789][106226] Updated weights for policy 0, policy_version 271068 (0.0008) [2023-12-27 21:10:35,835][106225] Updated weights for policy 1, policy_version 271469 (0.0008) [2023-12-27 21:10:35,849][106226] Updated weights for policy 0, policy_version 271078 (0.0006) [2023-12-27 21:10:35,891][106225] Updated weights for policy 1, policy_version 271479 (0.0007) [2023-12-27 21:10:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 138936320. Throughput: 0: 9893.4, 1: 9973.8. Samples: 138943564. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:36,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.566')] [2023-12-27 21:10:36,581][106225] Updated weights for policy 1, policy_version 271489 (0.0008) [2023-12-27 21:10:36,599][106226] Updated weights for policy 0, policy_version 271088 (0.0008) [2023-12-27 21:10:36,639][106225] Updated weights for policy 1, policy_version 271499 (0.0006) [2023-12-27 21:10:36,659][106226] Updated weights for policy 0, policy_version 271098 (0.0006) [2023-12-27 21:10:36,702][106225] Updated weights for policy 1, policy_version 271509 (0.0006) [2023-12-27 21:10:36,718][106226] Updated weights for policy 0, policy_version 271108 (0.0006) [2023-12-27 21:10:36,764][106225] Updated weights for policy 1, policy_version 271519 (0.0006) [2023-12-27 21:10:37,283][106226] Updated weights for policy 0, policy_version 271118 (0.0006) [2023-12-27 21:10:37,305][106225] Updated weights for policy 1, policy_version 271529 (0.0006) [2023-12-27 21:10:37,339][106226] Updated weights for policy 0, policy_version 271128 (0.0005) [2023-12-27 21:10:37,353][106225] Updated weights for policy 1, policy_version 271539 (0.0008) [2023-12-27 21:10:37,393][106226] Updated weights for policy 0, policy_version 271138 (0.0005) [2023-12-27 21:10:37,411][106225] Updated weights for policy 1, policy_version 271549 (0.0008) [2023-12-27 21:10:37,984][106226] Updated weights for policy 0, policy_version 271148 (0.0006) [2023-12-27 21:10:38,054][106226] Updated weights for policy 0, policy_version 271158 (0.0009) [2023-12-27 21:10:38,119][106226] Updated weights for policy 0, policy_version 271168 (0.0006) [2023-12-27 21:10:38,125][106225] Updated weights for policy 1, policy_version 271559 (0.0007) [2023-12-27 21:10:38,183][106225] Updated weights for policy 1, policy_version 271569 (0.0008) [2023-12-27 21:10:38,252][106225] Updated weights for policy 1, policy_version 271579 (0.0010) [2023-12-27 21:10:38,748][106226] Updated weights for policy 0, policy_version 271178 (0.0006) [2023-12-27 21:10:38,811][106226] Updated weights for policy 0, policy_version 271188 (0.0009) [2023-12-27 21:10:38,873][106226] Updated weights for policy 0, policy_version 271198 (0.0009) [2023-12-27 21:10:38,927][106226] Updated weights for policy 0, policy_version 271208 (0.0007) [2023-12-27 21:10:38,996][106225] Updated weights for policy 1, policy_version 271589 (0.0009) [2023-12-27 21:10:39,060][106225] Updated weights for policy 1, policy_version 271599 (0.0009) [2023-12-27 21:10:39,116][106225] Updated weights for policy 1, policy_version 271609 (0.0008) [2023-12-27 21:10:39,623][106226] Updated weights for policy 0, policy_version 271218 (0.0005) [2023-12-27 21:10:39,672][106226] Updated weights for policy 0, policy_version 271228 (0.0005) [2023-12-27 21:10:39,727][106226] Updated weights for policy 0, policy_version 271238 (0.0005) [2023-12-27 21:10:39,938][106225] Updated weights for policy 1, policy_version 271619 (0.0009) [2023-12-27 21:10:40,000][106225] Updated weights for policy 1, policy_version 271629 (0.0008) [2023-12-27 21:10:40,061][106225] Updated weights for policy 1, policy_version 271639 (0.0008) [2023-12-27 21:10:40,448][106226] Updated weights for policy 0, policy_version 271248 (0.0006) [2023-12-27 21:10:40,504][106226] Updated weights for policy 0, policy_version 271258 (0.0008) [2023-12-27 21:10:40,564][106226] Updated weights for policy 0, policy_version 271268 (0.0009) [2023-12-27 21:10:40,811][106225] Updated weights for policy 1, policy_version 271649 (0.0008) [2023-12-27 21:10:40,877][106225] Updated weights for policy 1, policy_version 271659 (0.0010) [2023-12-27 21:10:40,938][106225] Updated weights for policy 1, policy_version 271669 (0.0006) [2023-12-27 21:10:41,000][106225] Updated weights for policy 1, policy_version 271679 (0.0006) [2023-12-27 21:10:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 139034624. Throughput: 0: 9984.4, 1: 10010.0. Samples: 139006356. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:41,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.784')] [2023-12-27 21:10:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000271680_69566464.pth... [2023-12-27 21:10:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000271272_69468160.pth... [2023-12-27 21:10:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000270496_69263360.pth [2023-12-27 21:10:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000270120_69173248.pth [2023-12-27 21:10:41,292][106226] Updated weights for policy 0, policy_version 271278 (0.0009) [2023-12-27 21:10:41,361][106226] Updated weights for policy 0, policy_version 271288 (0.0010) [2023-12-27 21:10:41,435][106226] Updated weights for policy 0, policy_version 271298 (0.0007) [2023-12-27 21:10:41,704][106225] Updated weights for policy 1, policy_version 271689 (0.0008) [2023-12-27 21:10:41,771][106225] Updated weights for policy 1, policy_version 271699 (0.0009) [2023-12-27 21:10:41,837][106225] Updated weights for policy 1, policy_version 271709 (0.0008) [2023-12-27 21:10:42,169][106226] Updated weights for policy 0, policy_version 271308 (0.0007) [2023-12-27 21:10:42,232][106226] Updated weights for policy 0, policy_version 271318 (0.0008) [2023-12-27 21:10:42,300][106226] Updated weights for policy 0, policy_version 271328 (0.0009) [2023-12-27 21:10:42,543][106225] Updated weights for policy 1, policy_version 271719 (0.0007) [2023-12-27 21:10:42,602][106225] Updated weights for policy 1, policy_version 271729 (0.0006) [2023-12-27 21:10:42,655][106225] Updated weights for policy 1, policy_version 271739 (0.0005) [2023-12-27 21:10:43,049][106226] Updated weights for policy 0, policy_version 271338 (0.0007) [2023-12-27 21:10:43,103][106226] Updated weights for policy 0, policy_version 271348 (0.0008) [2023-12-27 21:10:43,161][106226] Updated weights for policy 0, policy_version 271358 (0.0009) [2023-12-27 21:10:43,220][106226] Updated weights for policy 0, policy_version 271368 (0.0008) [2023-12-27 21:10:43,272][106225] Updated weights for policy 1, policy_version 271749 (0.0007) [2023-12-27 21:10:43,332][106225] Updated weights for policy 1, policy_version 271759 (0.0007) [2023-12-27 21:10:43,403][106225] Updated weights for policy 1, policy_version 271769 (0.0006) [2023-12-27 21:10:43,944][106226] Updated weights for policy 0, policy_version 271378 (0.0009) [2023-12-27 21:10:43,991][106226] Updated weights for policy 0, policy_version 271388 (0.0008) [2023-12-27 21:10:44,030][106225] Updated weights for policy 1, policy_version 271779 (0.0005) [2023-12-27 21:10:44,051][106226] Updated weights for policy 0, policy_version 271398 (0.0008) [2023-12-27 21:10:44,086][106225] Updated weights for policy 1, policy_version 271789 (0.0007) [2023-12-27 21:10:44,138][106225] Updated weights for policy 1, policy_version 271799 (0.0007) [2023-12-27 21:10:44,753][106226] Updated weights for policy 0, policy_version 271408 (0.0007) [2023-12-27 21:10:44,768][106225] Updated weights for policy 1, policy_version 271809 (0.0009) [2023-12-27 21:10:44,826][106226] Updated weights for policy 0, policy_version 271418 (0.0011) [2023-12-27 21:10:44,835][106225] Updated weights for policy 1, policy_version 271819 (0.0007) [2023-12-27 21:10:44,880][106226] Updated weights for policy 0, policy_version 271428 (0.0006) [2023-12-27 21:10:44,897][106225] Updated weights for policy 1, policy_version 271829 (0.0009) [2023-12-27 21:10:44,970][106225] Updated weights for policy 1, policy_version 271839 (0.0006) [2023-12-27 21:10:45,563][106225] Updated weights for policy 1, policy_version 271849 (0.0006) [2023-12-27 21:10:45,589][106226] Updated weights for policy 0, policy_version 271438 (0.0007) [2023-12-27 21:10:45,620][106225] Updated weights for policy 1, policy_version 271859 (0.0005) [2023-12-27 21:10:45,650][106226] Updated weights for policy 0, policy_version 271448 (0.0010) [2023-12-27 21:10:45,677][106225] Updated weights for policy 1, policy_version 271869 (0.0006) [2023-12-27 21:10:45,710][106226] Updated weights for policy 0, policy_version 271458 (0.0007) [2023-12-27 21:10:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 139132928. Throughput: 0: 9988.5, 1: 10072.6. Samples: 139123864. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:46,175][105115] Avg episode reward: [(0, '-4.863'), (1, '-5.989')] [2023-12-27 21:10:46,221][106225] Updated weights for policy 1, policy_version 271879 (0.0007) [2023-12-27 21:10:46,276][106225] Updated weights for policy 1, policy_version 271889 (0.0007) [2023-12-27 21:10:46,334][106225] Updated weights for policy 1, policy_version 271899 (0.0009) [2023-12-27 21:10:46,425][106226] Updated weights for policy 0, policy_version 271468 (0.0006) [2023-12-27 21:10:46,477][106226] Updated weights for policy 0, policy_version 271478 (0.0007) [2023-12-27 21:10:46,524][106226] Updated weights for policy 0, policy_version 271488 (0.0008) [2023-12-27 21:10:47,109][106225] Updated weights for policy 1, policy_version 271909 (0.0008) [2023-12-27 21:10:47,169][106225] Updated weights for policy 1, policy_version 271919 (0.0009) [2023-12-27 21:10:47,178][106226] Updated weights for policy 0, policy_version 271498 (0.0008) [2023-12-27 21:10:47,230][106225] Updated weights for policy 1, policy_version 271929 (0.0006) [2023-12-27 21:10:47,236][106226] Updated weights for policy 0, policy_version 271508 (0.0008) [2023-12-27 21:10:47,288][106226] Updated weights for policy 0, policy_version 271518 (0.0008) [2023-12-27 21:10:47,333][106226] Updated weights for policy 0, policy_version 271528 (0.0008) [2023-12-27 21:10:47,920][106225] Updated weights for policy 1, policy_version 271939 (0.0006) [2023-12-27 21:10:47,935][106226] Updated weights for policy 0, policy_version 271538 (0.0007) [2023-12-27 21:10:47,982][106225] Updated weights for policy 1, policy_version 271949 (0.0005) [2023-12-27 21:10:47,993][106226] Updated weights for policy 0, policy_version 271548 (0.0006) [2023-12-27 21:10:48,049][106225] Updated weights for policy 1, policy_version 271959 (0.0008) [2023-12-27 21:10:48,051][106226] Updated weights for policy 0, policy_version 271558 (0.0005) [2023-12-27 21:10:48,715][106225] Updated weights for policy 1, policy_version 271969 (0.0009) [2023-12-27 21:10:48,757][106226] Updated weights for policy 0, policy_version 271568 (0.0006) [2023-12-27 21:10:48,776][106225] Updated weights for policy 1, policy_version 271979 (0.0007) [2023-12-27 21:10:48,816][106226] Updated weights for policy 0, policy_version 271578 (0.0008) [2023-12-27 21:10:48,835][106225] Updated weights for policy 1, policy_version 271989 (0.0006) [2023-12-27 21:10:48,876][106226] Updated weights for policy 0, policy_version 271588 (0.0007) [2023-12-27 21:10:48,895][106225] Updated weights for policy 1, policy_version 271999 (0.0006) [2023-12-27 21:10:49,625][106225] Updated weights for policy 1, policy_version 272009 (0.0010) [2023-12-27 21:10:49,649][106226] Updated weights for policy 0, policy_version 271598 (0.0008) [2023-12-27 21:10:49,692][106225] Updated weights for policy 1, policy_version 272019 (0.0010) [2023-12-27 21:10:49,703][106226] Updated weights for policy 0, policy_version 271608 (0.0007) [2023-12-27 21:10:49,749][106225] Updated weights for policy 1, policy_version 272029 (0.0010) [2023-12-27 21:10:49,757][106226] Updated weights for policy 0, policy_version 271618 (0.0007) [2023-12-27 21:10:50,471][106225] Updated weights for policy 1, policy_version 272039 (0.0011) [2023-12-27 21:10:50,525][106226] Updated weights for policy 0, policy_version 271628 (0.0007) [2023-12-27 21:10:50,528][106225] Updated weights for policy 1, policy_version 272049 (0.0010) [2023-12-27 21:10:50,582][106226] Updated weights for policy 0, policy_version 271638 (0.0007) [2023-12-27 21:10:50,593][106225] Updated weights for policy 1, policy_version 272059 (0.0010) [2023-12-27 21:10:50,644][106226] Updated weights for policy 0, policy_version 271648 (0.0008) [2023-12-27 21:10:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 139231232. Throughput: 0: 9935.3, 1: 10079.8. Samples: 139242548. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:51,175][105115] Avg episode reward: [(0, '-4.853'), (1, '-5.813')] [2023-12-27 21:10:51,318][106225] Updated weights for policy 1, policy_version 272069 (0.0011) [2023-12-27 21:10:51,388][106225] Updated weights for policy 1, policy_version 272079 (0.0009) [2023-12-27 21:10:51,428][106226] Updated weights for policy 0, policy_version 271658 (0.0008) [2023-12-27 21:10:51,445][106225] Updated weights for policy 1, policy_version 272089 (0.0009) [2023-12-27 21:10:51,487][106226] Updated weights for policy 0, policy_version 271668 (0.0006) [2023-12-27 21:10:51,549][106226] Updated weights for policy 0, policy_version 271678 (0.0008) [2023-12-27 21:10:51,615][106226] Updated weights for policy 0, policy_version 271688 (0.0008) [2023-12-27 21:10:52,157][106225] Updated weights for policy 1, policy_version 272099 (0.0010) [2023-12-27 21:10:52,215][106225] Updated weights for policy 1, policy_version 272109 (0.0009) [2023-12-27 21:10:52,274][106225] Updated weights for policy 1, policy_version 272119 (0.0009) [2023-12-27 21:10:52,326][106226] Updated weights for policy 0, policy_version 271698 (0.0009) [2023-12-27 21:10:52,388][106226] Updated weights for policy 0, policy_version 271708 (0.0007) [2023-12-27 21:10:52,459][106226] Updated weights for policy 0, policy_version 271718 (0.0005) [2023-12-27 21:10:52,967][106225] Updated weights for policy 1, policy_version 272129 (0.0006) [2023-12-27 21:10:53,026][106225] Updated weights for policy 1, policy_version 272139 (0.0008) [2023-12-27 21:10:53,044][106226] Updated weights for policy 0, policy_version 271728 (0.0008) [2023-12-27 21:10:53,078][106225] Updated weights for policy 1, policy_version 272149 (0.0008) [2023-12-27 21:10:53,103][106226] Updated weights for policy 0, policy_version 271738 (0.0009) [2023-12-27 21:10:53,125][106225] Updated weights for policy 1, policy_version 272159 (0.0006) [2023-12-27 21:10:53,160][106226] Updated weights for policy 0, policy_version 271748 (0.0008) [2023-12-27 21:10:53,853][106225] Updated weights for policy 1, policy_version 272169 (0.0008) [2023-12-27 21:10:53,908][106226] Updated weights for policy 0, policy_version 271758 (0.0008) [2023-12-27 21:10:53,910][106225] Updated weights for policy 1, policy_version 272179 (0.0006) [2023-12-27 21:10:53,966][106225] Updated weights for policy 1, policy_version 272189 (0.0008) [2023-12-27 21:10:53,980][106226] Updated weights for policy 0, policy_version 271768 (0.0006) [2023-12-27 21:10:54,039][106226] Updated weights for policy 0, policy_version 271778 (0.0009) [2023-12-27 21:10:54,583][106225] Updated weights for policy 1, policy_version 272199 (0.0009) [2023-12-27 21:10:54,636][106225] Updated weights for policy 1, policy_version 272209 (0.0008) [2023-12-27 21:10:54,698][106225] Updated weights for policy 1, policy_version 272219 (0.0007) [2023-12-27 21:10:54,756][106226] Updated weights for policy 0, policy_version 271788 (0.0009) [2023-12-27 21:10:54,815][106226] Updated weights for policy 0, policy_version 271798 (0.0010) [2023-12-27 21:10:54,861][106226] Updated weights for policy 0, policy_version 271808 (0.0010) [2023-12-27 21:10:55,438][106225] Updated weights for policy 1, policy_version 272229 (0.0008) [2023-12-27 21:10:55,495][106225] Updated weights for policy 1, policy_version 272239 (0.0008) [2023-12-27 21:10:55,550][106225] Updated weights for policy 1, policy_version 272249 (0.0007) [2023-12-27 21:10:55,588][106226] Updated weights for policy 0, policy_version 271818 (0.0010) [2023-12-27 21:10:55,641][106226] Updated weights for policy 0, policy_version 271828 (0.0010) [2023-12-27 21:10:55,690][106226] Updated weights for policy 0, policy_version 271838 (0.0010) [2023-12-27 21:10:55,746][106226] Updated weights for policy 0, policy_version 271848 (0.0010) [2023-12-27 21:10:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 139329536. Throughput: 0: 9921.1, 1: 10003.8. Samples: 139301108. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-27 21:10:56,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-5.775')] [2023-12-27 21:10:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000272256_69713920.pth... [2023-12-27 21:10:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000271848_69615616.pth... [2023-12-27 21:10:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000270696_69320704.pth [2023-12-27 21:10:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000271104_69419008.pth [2023-12-27 21:10:56,268][106225] Updated weights for policy 1, policy_version 272259 (0.0007) [2023-12-27 21:10:56,323][106225] Updated weights for policy 1, policy_version 272269 (0.0008) [2023-12-27 21:10:56,374][106225] Updated weights for policy 1, policy_version 272279 (0.0008) [2023-12-27 21:10:56,480][106226] Updated weights for policy 0, policy_version 271858 (0.0011) [2023-12-27 21:10:56,537][106226] Updated weights for policy 0, policy_version 271868 (0.0010) [2023-12-27 21:10:56,593][106226] Updated weights for policy 0, policy_version 271878 (0.0010) [2023-12-27 21:10:57,123][106225] Updated weights for policy 1, policy_version 272289 (0.0008) [2023-12-27 21:10:57,168][106225] Updated weights for policy 1, policy_version 272299 (0.0007) [2023-12-27 21:10:57,212][106225] Updated weights for policy 1, policy_version 272309 (0.0008) [2023-12-27 21:10:57,254][106225] Updated weights for policy 1, policy_version 272319 (0.0007) [2023-12-27 21:10:57,286][106226] Updated weights for policy 0, policy_version 271888 (0.0010) [2023-12-27 21:10:57,349][106226] Updated weights for policy 0, policy_version 271898 (0.0009) [2023-12-27 21:10:57,407][106226] Updated weights for policy 0, policy_version 271908 (0.0010) [2023-12-27 21:10:57,991][106225] Updated weights for policy 1, policy_version 272329 (0.0007) [2023-12-27 21:10:58,043][106225] Updated weights for policy 1, policy_version 272339 (0.0008) [2023-12-27 21:10:58,095][106225] Updated weights for policy 1, policy_version 272349 (0.0006) [2023-12-27 21:10:58,108][106226] Updated weights for policy 0, policy_version 271918 (0.0010) [2023-12-27 21:10:58,161][106226] Updated weights for policy 0, policy_version 271928 (0.0010) [2023-12-27 21:10:58,216][106226] Updated weights for policy 0, policy_version 271938 (0.0010) [2023-12-27 21:10:58,968][106225] Updated weights for policy 1, policy_version 272359 (0.0009) [2023-12-27 21:10:59,036][106225] Updated weights for policy 1, policy_version 272369 (0.0010) [2023-12-27 21:10:59,070][106226] Updated weights for policy 0, policy_version 271948 (0.0010) [2023-12-27 21:10:59,099][106225] Updated weights for policy 1, policy_version 272379 (0.0010) [2023-12-27 21:10:59,134][106226] Updated weights for policy 0, policy_version 271958 (0.0009) [2023-12-27 21:10:59,197][106226] Updated weights for policy 0, policy_version 271968 (0.0011) [2023-12-27 21:10:59,791][106225] Updated weights for policy 1, policy_version 272389 (0.0008) [2023-12-27 21:10:59,865][106225] Updated weights for policy 1, policy_version 272399 (0.0008) [2023-12-27 21:10:59,922][106225] Updated weights for policy 1, policy_version 272409 (0.0005) [2023-12-27 21:10:59,936][106226] Updated weights for policy 0, policy_version 271978 (0.0009) [2023-12-27 21:11:00,005][106226] Updated weights for policy 0, policy_version 271988 (0.0009) [2023-12-27 21:11:00,070][106226] Updated weights for policy 0, policy_version 271998 (0.0008) [2023-12-27 21:11:00,137][106226] Updated weights for policy 0, policy_version 272008 (0.0009) [2023-12-27 21:11:00,588][106225] Updated weights for policy 1, policy_version 272419 (0.0007) [2023-12-27 21:11:00,653][106225] Updated weights for policy 1, policy_version 272429 (0.0007) [2023-12-27 21:11:00,704][106225] Updated weights for policy 1, policy_version 272439 (0.0005) [2023-12-27 21:11:00,774][106226] Updated weights for policy 0, policy_version 272018 (0.0008) [2023-12-27 21:11:00,838][106226] Updated weights for policy 0, policy_version 272028 (0.0008) [2023-12-27 21:11:00,899][106226] Updated weights for policy 0, policy_version 272038 (0.0008) [2023-12-27 21:11:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 139427840. Throughput: 0: 9935.3, 1: 9976.0. Samples: 139415696. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:01,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-5.757')] [2023-12-27 21:11:01,419][106225] Updated weights for policy 1, policy_version 272449 (0.0006) [2023-12-27 21:11:01,478][106225] Updated weights for policy 1, policy_version 272459 (0.0009) [2023-12-27 21:11:01,529][106225] Updated weights for policy 1, policy_version 272469 (0.0009) [2023-12-27 21:11:01,587][106225] Updated weights for policy 1, policy_version 272479 (0.0008) [2023-12-27 21:11:01,624][106226] Updated weights for policy 0, policy_version 272048 (0.0009) [2023-12-27 21:11:01,688][106226] Updated weights for policy 0, policy_version 272058 (0.0008) [2023-12-27 21:11:01,755][106226] Updated weights for policy 0, policy_version 272068 (0.0008) [2023-12-27 21:11:02,264][106225] Updated weights for policy 1, policy_version 272489 (0.0007) [2023-12-27 21:11:02,326][106225] Updated weights for policy 1, policy_version 272499 (0.0010) [2023-12-27 21:11:02,393][106225] Updated weights for policy 1, policy_version 272509 (0.0011) [2023-12-27 21:11:02,494][106226] Updated weights for policy 0, policy_version 272078 (0.0007) [2023-12-27 21:11:02,557][106226] Updated weights for policy 0, policy_version 272088 (0.0007) [2023-12-27 21:11:02,625][106226] Updated weights for policy 0, policy_version 272098 (0.0008) [2023-12-27 21:11:03,106][106225] Updated weights for policy 1, policy_version 272519 (0.0008) [2023-12-27 21:11:03,160][106225] Updated weights for policy 1, policy_version 272529 (0.0008) [2023-12-27 21:11:03,206][106226] Updated weights for policy 0, policy_version 272108 (0.0009) [2023-12-27 21:11:03,216][106225] Updated weights for policy 1, policy_version 272539 (0.0007) [2023-12-27 21:11:03,259][106226] Updated weights for policy 0, policy_version 272118 (0.0006) [2023-12-27 21:11:03,317][106226] Updated weights for policy 0, policy_version 272128 (0.0008) [2023-12-27 21:11:03,985][106225] Updated weights for policy 1, policy_version 272549 (0.0007) [2023-12-27 21:11:04,029][106226] Updated weights for policy 0, policy_version 272138 (0.0006) [2023-12-27 21:11:04,049][106225] Updated weights for policy 1, policy_version 272559 (0.0007) [2023-12-27 21:11:04,087][106226] Updated weights for policy 0, policy_version 272148 (0.0008) [2023-12-27 21:11:04,110][106225] Updated weights for policy 1, policy_version 272569 (0.0007) [2023-12-27 21:11:04,143][106226] Updated weights for policy 0, policy_version 272158 (0.0011) [2023-12-27 21:11:04,195][106226] Updated weights for policy 0, policy_version 272168 (0.0011) [2023-12-27 21:11:04,819][106226] Updated weights for policy 0, policy_version 272178 (0.0006) [2023-12-27 21:11:04,877][106226] Updated weights for policy 0, policy_version 272188 (0.0009) [2023-12-27 21:11:04,913][106225] Updated weights for policy 1, policy_version 272579 (0.0006) [2023-12-27 21:11:04,937][106226] Updated weights for policy 0, policy_version 272198 (0.0011) [2023-12-27 21:11:04,968][106225] Updated weights for policy 1, policy_version 272589 (0.0008) [2023-12-27 21:11:05,023][106225] Updated weights for policy 1, policy_version 272599 (0.0008) [2023-12-27 21:11:05,564][106226] Updated weights for policy 0, policy_version 272208 (0.0006) [2023-12-27 21:11:05,614][106226] Updated weights for policy 0, policy_version 272218 (0.0005) [2023-12-27 21:11:05,661][106226] Updated weights for policy 0, policy_version 272228 (0.0006) [2023-12-27 21:11:05,766][106225] Updated weights for policy 1, policy_version 272609 (0.0008) [2023-12-27 21:11:05,828][106225] Updated weights for policy 1, policy_version 272619 (0.0009) [2023-12-27 21:11:05,888][106225] Updated weights for policy 1, policy_version 272629 (0.0009) [2023-12-27 21:11:05,948][106225] Updated weights for policy 1, policy_version 272639 (0.0008) [2023-12-27 21:11:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 139526144. Throughput: 0: 9906.5, 1: 9891.1. Samples: 139534976. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:06,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-6.215')] [2023-12-27 21:11:06,332][106226] Updated weights for policy 0, policy_version 272238 (0.0009) [2023-12-27 21:11:06,394][106226] Updated weights for policy 0, policy_version 272248 (0.0008) [2023-12-27 21:11:06,457][106226] Updated weights for policy 0, policy_version 272258 (0.0009) [2023-12-27 21:11:06,701][106225] Updated weights for policy 1, policy_version 272649 (0.0007) [2023-12-27 21:11:06,760][106225] Updated weights for policy 1, policy_version 272659 (0.0008) [2023-12-27 21:11:06,811][106225] Updated weights for policy 1, policy_version 272669 (0.0008) [2023-12-27 21:11:07,251][106226] Updated weights for policy 0, policy_version 272268 (0.0008) [2023-12-27 21:11:07,297][106226] Updated weights for policy 0, policy_version 272278 (0.0005) [2023-12-27 21:11:07,365][106226] Updated weights for policy 0, policy_version 272288 (0.0005) [2023-12-27 21:11:07,606][106225] Updated weights for policy 1, policy_version 272679 (0.0008) [2023-12-27 21:11:07,659][106225] Updated weights for policy 1, policy_version 272689 (0.0008) [2023-12-27 21:11:07,718][106225] Updated weights for policy 1, policy_version 272699 (0.0008) [2023-12-27 21:11:07,939][106226] Updated weights for policy 0, policy_version 272298 (0.0005) [2023-12-27 21:11:07,994][106226] Updated weights for policy 0, policy_version 272308 (0.0006) [2023-12-27 21:11:08,050][106226] Updated weights for policy 0, policy_version 272318 (0.0005) [2023-12-27 21:11:08,101][106226] Updated weights for policy 0, policy_version 272328 (0.0005) [2023-12-27 21:11:08,397][106225] Updated weights for policy 1, policy_version 272709 (0.0008) [2023-12-27 21:11:08,460][106225] Updated weights for policy 1, policy_version 272719 (0.0009) [2023-12-27 21:11:08,515][106225] Updated weights for policy 1, policy_version 272729 (0.0009) [2023-12-27 21:11:08,731][106226] Updated weights for policy 0, policy_version 272338 (0.0006) [2023-12-27 21:11:08,789][106226] Updated weights for policy 0, policy_version 272348 (0.0006) [2023-12-27 21:11:08,847][106226] Updated weights for policy 0, policy_version 272358 (0.0008) [2023-12-27 21:11:09,280][106225] Updated weights for policy 1, policy_version 272739 (0.0008) [2023-12-27 21:11:09,343][106225] Updated weights for policy 1, policy_version 272749 (0.0008) [2023-12-27 21:11:09,410][106225] Updated weights for policy 1, policy_version 272759 (0.0008) [2023-12-27 21:11:09,565][106226] Updated weights for policy 0, policy_version 272368 (0.0008) [2023-12-27 21:11:09,621][106226] Updated weights for policy 0, policy_version 272378 (0.0008) [2023-12-27 21:11:09,676][106226] Updated weights for policy 0, policy_version 272388 (0.0008) [2023-12-27 21:11:10,169][106225] Updated weights for policy 1, policy_version 272769 (0.0008) [2023-12-27 21:11:10,231][106225] Updated weights for policy 1, policy_version 272779 (0.0008) [2023-12-27 21:11:10,301][106225] Updated weights for policy 1, policy_version 272789 (0.0006) [2023-12-27 21:11:10,373][106225] Updated weights for policy 1, policy_version 272799 (0.0007) [2023-12-27 21:11:10,465][106226] Updated weights for policy 0, policy_version 272398 (0.0010) [2023-12-27 21:11:10,516][106226] Updated weights for policy 0, policy_version 272408 (0.0010) [2023-12-27 21:11:10,565][106226] Updated weights for policy 0, policy_version 272418 (0.0005) [2023-12-27 21:11:10,964][106225] Updated weights for policy 1, policy_version 272809 (0.0005) [2023-12-27 21:11:11,033][106225] Updated weights for policy 1, policy_version 272819 (0.0006) [2023-12-27 21:11:11,104][106225] Updated weights for policy 1, policy_version 272829 (0.0007) [2023-12-27 21:11:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 139624448. Throughput: 0: 9992.9, 1: 9846.9. Samples: 139593964. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:11,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-5.812')] [2023-12-27 21:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000272424_69763072.pth... [2023-12-27 21:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000272832_69861376.pth... [2023-12-27 21:11:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000271272_69468160.pth [2023-12-27 21:11:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000271680_69566464.pth [2023-12-27 21:11:11,340][106226] Updated weights for policy 0, policy_version 272428 (0.0007) [2023-12-27 21:11:11,424][106226] Updated weights for policy 0, policy_version 272438 (0.0008) [2023-12-27 21:11:11,487][106226] Updated weights for policy 0, policy_version 272448 (0.0008) [2023-12-27 21:11:11,841][106225] Updated weights for policy 1, policy_version 272839 (0.0008) [2023-12-27 21:11:11,907][106225] Updated weights for policy 1, policy_version 272849 (0.0011) [2023-12-27 21:11:11,966][106225] Updated weights for policy 1, policy_version 272859 (0.0010) [2023-12-27 21:11:12,232][106226] Updated weights for policy 0, policy_version 272458 (0.0007) [2023-12-27 21:11:12,301][106226] Updated weights for policy 0, policy_version 272468 (0.0009) [2023-12-27 21:11:12,373][106226] Updated weights for policy 0, policy_version 272478 (0.0010) [2023-12-27 21:11:12,429][106226] Updated weights for policy 0, policy_version 272488 (0.0008) [2023-12-27 21:11:12,749][106225] Updated weights for policy 1, policy_version 272869 (0.0009) [2023-12-27 21:11:12,808][106225] Updated weights for policy 1, policy_version 272879 (0.0010) [2023-12-27 21:11:12,862][106225] Updated weights for policy 1, policy_version 272889 (0.0009) [2023-12-27 21:11:13,098][106226] Updated weights for policy 0, policy_version 272498 (0.0005) [2023-12-27 21:11:13,158][106226] Updated weights for policy 0, policy_version 272508 (0.0005) [2023-12-27 21:11:13,212][106226] Updated weights for policy 0, policy_version 272518 (0.0005) [2023-12-27 21:11:13,672][106225] Updated weights for policy 1, policy_version 272899 (0.0009) [2023-12-27 21:11:13,725][106225] Updated weights for policy 1, policy_version 272909 (0.0009) [2023-12-27 21:11:13,783][106225] Updated weights for policy 1, policy_version 272919 (0.0009) [2023-12-27 21:11:13,816][106226] Updated weights for policy 0, policy_version 272528 (0.0007) [2023-12-27 21:11:13,870][106226] Updated weights for policy 0, policy_version 272538 (0.0008) [2023-12-27 21:11:13,922][106226] Updated weights for policy 0, policy_version 272548 (0.0009) [2023-12-27 21:11:14,465][106225] Updated weights for policy 1, policy_version 272929 (0.0006) [2023-12-27 21:11:14,521][106225] Updated weights for policy 1, policy_version 272939 (0.0009) [2023-12-27 21:11:14,579][106225] Updated weights for policy 1, policy_version 272949 (0.0008) [2023-12-27 21:11:14,634][106225] Updated weights for policy 1, policy_version 272959 (0.0009) [2023-12-27 21:11:14,670][106226] Updated weights for policy 0, policy_version 272558 (0.0007) [2023-12-27 21:11:14,725][106226] Updated weights for policy 0, policy_version 272568 (0.0005) [2023-12-27 21:11:14,785][106226] Updated weights for policy 0, policy_version 272578 (0.0009) [2023-12-27 21:11:15,393][106225] Updated weights for policy 1, policy_version 272969 (0.0009) [2023-12-27 21:11:15,448][106225] Updated weights for policy 1, policy_version 272979 (0.0008) [2023-12-27 21:11:15,479][106226] Updated weights for policy 0, policy_version 272588 (0.0008) [2023-12-27 21:11:15,497][106225] Updated weights for policy 1, policy_version 272989 (0.0007) [2023-12-27 21:11:15,537][106226] Updated weights for policy 0, policy_version 272598 (0.0007) [2023-12-27 21:11:15,597][106226] Updated weights for policy 0, policy_version 272608 (0.0009) [2023-12-27 21:11:16,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 139714560. Throughput: 0: 9842.0, 1: 9751.8. Samples: 139708004. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:16,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.897')] [2023-12-27 21:11:16,207][106226] Updated weights for policy 0, policy_version 272618 (0.0008) [2023-12-27 21:11:16,218][106225] Updated weights for policy 1, policy_version 272999 (0.0009) [2023-12-27 21:11:16,265][106226] Updated weights for policy 0, policy_version 272628 (0.0005) [2023-12-27 21:11:16,279][106225] Updated weights for policy 1, policy_version 273009 (0.0008) [2023-12-27 21:11:16,324][106226] Updated weights for policy 0, policy_version 272638 (0.0005) [2023-12-27 21:11:16,336][106225] Updated weights for policy 1, policy_version 273019 (0.0007) [2023-12-27 21:11:16,375][106226] Updated weights for policy 0, policy_version 272648 (0.0006) [2023-12-27 21:11:16,962][106226] Updated weights for policy 0, policy_version 272658 (0.0008) [2023-12-27 21:11:17,011][106225] Updated weights for policy 1, policy_version 273029 (0.0009) [2023-12-27 21:11:17,025][106226] Updated weights for policy 0, policy_version 272668 (0.0005) [2023-12-27 21:11:17,061][106225] Updated weights for policy 1, policy_version 273039 (0.0010) [2023-12-27 21:11:17,072][106226] Updated weights for policy 0, policy_version 272678 (0.0006) [2023-12-27 21:11:17,114][106225] Updated weights for policy 1, policy_version 273049 (0.0010) [2023-12-27 21:11:17,697][106226] Updated weights for policy 0, policy_version 272688 (0.0010) [2023-12-27 21:11:17,760][106226] Updated weights for policy 0, policy_version 272698 (0.0006) [2023-12-27 21:11:17,814][106226] Updated weights for policy 0, policy_version 272708 (0.0009) [2023-12-27 21:11:17,847][106225] Updated weights for policy 1, policy_version 273059 (0.0009) [2023-12-27 21:11:17,918][106225] Updated weights for policy 1, policy_version 273069 (0.0006) [2023-12-27 21:11:17,986][106225] Updated weights for policy 1, policy_version 273079 (0.0006) [2023-12-27 21:11:18,457][106226] Updated weights for policy 0, policy_version 272718 (0.0010) [2023-12-27 21:11:18,517][106226] Updated weights for policy 0, policy_version 272728 (0.0009) [2023-12-27 21:11:18,561][106225] Updated weights for policy 1, policy_version 273089 (0.0006) [2023-12-27 21:11:18,578][106226] Updated weights for policy 0, policy_version 272738 (0.0009) [2023-12-27 21:11:18,620][106225] Updated weights for policy 1, policy_version 273099 (0.0006) [2023-12-27 21:11:18,669][106225] Updated weights for policy 1, policy_version 273109 (0.0008) [2023-12-27 21:11:18,721][106225] Updated weights for policy 1, policy_version 273119 (0.0009) [2023-12-27 21:11:19,318][106226] Updated weights for policy 0, policy_version 272748 (0.0008) [2023-12-27 21:11:19,392][106226] Updated weights for policy 0, policy_version 272758 (0.0009) [2023-12-27 21:11:19,450][106225] Updated weights for policy 1, policy_version 273129 (0.0007) [2023-12-27 21:11:19,451][106226] Updated weights for policy 0, policy_version 272768 (0.0008) [2023-12-27 21:11:19,523][106225] Updated weights for policy 1, policy_version 273139 (0.0008) [2023-12-27 21:11:19,587][106225] Updated weights for policy 1, policy_version 273149 (0.0008) [2023-12-27 21:11:20,212][106225] Updated weights for policy 1, policy_version 273159 (0.0006) [2023-12-27 21:11:20,259][106226] Updated weights for policy 0, policy_version 272778 (0.0008) [2023-12-27 21:11:20,278][106225] Updated weights for policy 1, policy_version 273169 (0.0007) [2023-12-27 21:11:20,321][106226] Updated weights for policy 0, policy_version 272788 (0.0009) [2023-12-27 21:11:20,335][106225] Updated weights for policy 1, policy_version 273179 (0.0009) [2023-12-27 21:11:20,384][106226] Updated weights for policy 0, policy_version 272798 (0.0007) [2023-12-27 21:11:20,458][106226] Updated weights for policy 0, policy_version 272808 (0.0006) [2023-12-27 21:11:20,976][106225] Updated weights for policy 1, policy_version 273189 (0.0007) [2023-12-27 21:11:21,044][106225] Updated weights for policy 1, policy_version 273199 (0.0007) [2023-12-27 21:11:21,111][106225] Updated weights for policy 1, policy_version 273209 (0.0007) [2023-12-27 21:11:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 139821056. Throughput: 0: 9911.1, 1: 9773.5. Samples: 139829368. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:21,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-5.775')] [2023-12-27 21:11:21,179][106226] Updated weights for policy 0, policy_version 272818 (0.0007) [2023-12-27 21:11:21,247][106226] Updated weights for policy 0, policy_version 272828 (0.0008) [2023-12-27 21:11:21,308][106226] Updated weights for policy 0, policy_version 272838 (0.0008) [2023-12-27 21:11:21,791][106225] Updated weights for policy 1, policy_version 273219 (0.0007) [2023-12-27 21:11:21,854][106225] Updated weights for policy 1, policy_version 273229 (0.0008) [2023-12-27 21:11:21,915][106225] Updated weights for policy 1, policy_version 273239 (0.0008) [2023-12-27 21:11:22,059][106226] Updated weights for policy 0, policy_version 272848 (0.0008) [2023-12-27 21:11:22,117][106226] Updated weights for policy 0, policy_version 272858 (0.0008) [2023-12-27 21:11:22,176][106226] Updated weights for policy 0, policy_version 272868 (0.0007) [2023-12-27 21:11:22,583][106225] Updated weights for policy 1, policy_version 273249 (0.0008) [2023-12-27 21:11:22,644][106225] Updated weights for policy 1, policy_version 273259 (0.0011) [2023-12-27 21:11:22,711][106225] Updated weights for policy 1, policy_version 273269 (0.0009) [2023-12-27 21:11:22,770][106225] Updated weights for policy 1, policy_version 273279 (0.0011) [2023-12-27 21:11:22,961][106226] Updated weights for policy 0, policy_version 272878 (0.0007) [2023-12-27 21:11:23,026][106226] Updated weights for policy 0, policy_version 272888 (0.0008) [2023-12-27 21:11:23,084][106226] Updated weights for policy 0, policy_version 272898 (0.0008) [2023-12-27 21:11:23,453][106225] Updated weights for policy 1, policy_version 273289 (0.0006) [2023-12-27 21:11:23,522][106225] Updated weights for policy 1, policy_version 273299 (0.0009) [2023-12-27 21:11:23,579][106225] Updated weights for policy 1, policy_version 273309 (0.0008) [2023-12-27 21:11:23,858][106226] Updated weights for policy 0, policy_version 272908 (0.0008) [2023-12-27 21:11:23,923][106226] Updated weights for policy 0, policy_version 272918 (0.0008) [2023-12-27 21:11:23,981][106226] Updated weights for policy 0, policy_version 272928 (0.0008) [2023-12-27 21:11:24,271][106225] Updated weights for policy 1, policy_version 273319 (0.0010) [2023-12-27 21:11:24,327][106225] Updated weights for policy 1, policy_version 273329 (0.0010) [2023-12-27 21:11:24,381][106225] Updated weights for policy 1, policy_version 273339 (0.0010) [2023-12-27 21:11:24,656][106226] Updated weights for policy 0, policy_version 272938 (0.0008) [2023-12-27 21:11:24,703][106226] Updated weights for policy 0, policy_version 272948 (0.0005) [2023-12-27 21:11:24,751][106226] Updated weights for policy 0, policy_version 272958 (0.0005) [2023-12-27 21:11:24,801][106226] Updated weights for policy 0, policy_version 272968 (0.0005) [2023-12-27 21:11:25,052][106225] Updated weights for policy 1, policy_version 273349 (0.0008) [2023-12-27 21:11:25,107][106225] Updated weights for policy 1, policy_version 273359 (0.0005) [2023-12-27 21:11:25,159][106225] Updated weights for policy 1, policy_version 273369 (0.0009) [2023-12-27 21:11:25,419][106226] Updated weights for policy 0, policy_version 272978 (0.0011) [2023-12-27 21:11:25,474][106226] Updated weights for policy 0, policy_version 272988 (0.0010) [2023-12-27 21:11:25,524][106226] Updated weights for policy 0, policy_version 272998 (0.0010) [2023-12-27 21:11:25,852][106225] Updated weights for policy 1, policy_version 273379 (0.0009) [2023-12-27 21:11:25,913][106225] Updated weights for policy 1, policy_version 273389 (0.0008) [2023-12-27 21:11:25,969][106225] Updated weights for policy 1, policy_version 273399 (0.0006) [2023-12-27 21:11:26,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.9, 300 sec: 19910.7). Total num frames: 139919360. Throughput: 0: 9791.5, 1: 9765.2. Samples: 139886404. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:26,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-5.353')] [2023-12-27 21:11:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000273408_70008832.pth... [2023-12-27 21:11:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000273000_69910528.pth... [2023-12-27 21:11:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000272256_69713920.pth [2023-12-27 21:11:26,186][106141] Saving new best policy, reward=-5.353! [2023-12-27 21:11:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000271848_69615616.pth [2023-12-27 21:11:26,244][106226] Updated weights for policy 0, policy_version 273008 (0.0011) [2023-12-27 21:11:26,301][106226] Updated weights for policy 0, policy_version 273018 (0.0011) [2023-12-27 21:11:26,351][106226] Updated weights for policy 0, policy_version 273028 (0.0011) [2023-12-27 21:11:26,571][106225] Updated weights for policy 1, policy_version 273409 (0.0005) [2023-12-27 21:11:26,632][106225] Updated weights for policy 1, policy_version 273419 (0.0005) [2023-12-27 21:11:26,689][106225] Updated weights for policy 1, policy_version 273429 (0.0005) [2023-12-27 21:11:26,737][106225] Updated weights for policy 1, policy_version 273439 (0.0005) [2023-12-27 21:11:26,941][106226] Updated weights for policy 0, policy_version 273038 (0.0010) [2023-12-27 21:11:26,987][106226] Updated weights for policy 0, policy_version 273048 (0.0010) [2023-12-27 21:11:27,034][106226] Updated weights for policy 0, policy_version 273058 (0.0007) [2023-12-27 21:11:27,302][106225] Updated weights for policy 1, policy_version 273449 (0.0005) [2023-12-27 21:11:27,361][106225] Updated weights for policy 1, policy_version 273459 (0.0010) [2023-12-27 21:11:27,406][106225] Updated weights for policy 1, policy_version 273469 (0.0010) [2023-12-27 21:11:27,631][106226] Updated weights for policy 0, policy_version 273068 (0.0005) [2023-12-27 21:11:27,690][106226] Updated weights for policy 0, policy_version 273078 (0.0005) [2023-12-27 21:11:27,744][106226] Updated weights for policy 0, policy_version 273088 (0.0005) [2023-12-27 21:11:28,075][106225] Updated weights for policy 1, policy_version 273479 (0.0010) [2023-12-27 21:11:28,125][106225] Updated weights for policy 1, policy_version 273489 (0.0010) [2023-12-27 21:11:28,172][106225] Updated weights for policy 1, policy_version 273499 (0.0010) [2023-12-27 21:11:28,331][106226] Updated weights for policy 0, policy_version 273098 (0.0006) [2023-12-27 21:11:28,394][106226] Updated weights for policy 0, policy_version 273108 (0.0010) [2023-12-27 21:11:28,451][106226] Updated weights for policy 0, policy_version 273118 (0.0011) [2023-12-27 21:11:28,510][106226] Updated weights for policy 0, policy_version 273128 (0.0008) [2023-12-27 21:11:28,878][106225] Updated weights for policy 1, policy_version 273509 (0.0009) [2023-12-27 21:11:28,927][106225] Updated weights for policy 1, policy_version 273519 (0.0010) [2023-12-27 21:11:28,970][106225] Updated weights for policy 1, policy_version 273529 (0.0010) [2023-12-27 21:11:29,203][106226] Updated weights for policy 0, policy_version 273138 (0.0008) [2023-12-27 21:11:29,267][106226] Updated weights for policy 0, policy_version 273148 (0.0008) [2023-12-27 21:11:29,322][106226] Updated weights for policy 0, policy_version 273158 (0.0008) [2023-12-27 21:11:29,636][106225] Updated weights for policy 1, policy_version 273539 (0.0010) [2023-12-27 21:11:29,699][106225] Updated weights for policy 1, policy_version 273549 (0.0007) [2023-12-27 21:11:29,759][106225] Updated weights for policy 1, policy_version 273559 (0.0010) [2023-12-27 21:11:30,128][106226] Updated weights for policy 0, policy_version 273168 (0.0007) [2023-12-27 21:11:30,192][106226] Updated weights for policy 0, policy_version 273178 (0.0007) [2023-12-27 21:11:30,249][106226] Updated weights for policy 0, policy_version 273188 (0.0007) [2023-12-27 21:11:30,454][106225] Updated weights for policy 1, policy_version 273569 (0.0010) [2023-12-27 21:11:30,508][106225] Updated weights for policy 1, policy_version 273579 (0.0005) [2023-12-27 21:11:30,558][106225] Updated weights for policy 1, policy_version 273589 (0.0005) [2023-12-27 21:11:30,610][106225] Updated weights for policy 1, policy_version 273599 (0.0005) [2023-12-27 21:11:30,914][106226] Updated weights for policy 0, policy_version 273198 (0.0007) [2023-12-27 21:11:30,960][106226] Updated weights for policy 0, policy_version 273208 (0.0005) [2023-12-27 21:11:31,010][106226] Updated weights for policy 0, policy_version 273218 (0.0008) [2023-12-27 21:11:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 140025856. Throughput: 0: 9921.1, 1: 9841.3. Samples: 140013172. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:31,175][105115] Avg episode reward: [(0, '-4.299'), (1, '-6.151')] [2023-12-27 21:11:31,195][106225] Updated weights for policy 1, policy_version 273609 (0.0006) [2023-12-27 21:11:31,253][106225] Updated weights for policy 1, policy_version 273619 (0.0008) [2023-12-27 21:11:31,316][106225] Updated weights for policy 1, policy_version 273629 (0.0008) [2023-12-27 21:11:31,780][106226] Updated weights for policy 0, policy_version 273228 (0.0009) [2023-12-27 21:11:31,832][106226] Updated weights for policy 0, policy_version 273238 (0.0009) [2023-12-27 21:11:31,878][106226] Updated weights for policy 0, policy_version 273248 (0.0008) [2023-12-27 21:11:32,092][106225] Updated weights for policy 1, policy_version 273639 (0.0009) [2023-12-27 21:11:32,150][106225] Updated weights for policy 1, policy_version 273649 (0.0008) [2023-12-27 21:11:32,212][106225] Updated weights for policy 1, policy_version 273659 (0.0010) [2023-12-27 21:11:32,640][106226] Updated weights for policy 0, policy_version 273258 (0.0009) [2023-12-27 21:11:32,694][106226] Updated weights for policy 0, policy_version 273268 (0.0010) [2023-12-27 21:11:32,754][106226] Updated weights for policy 0, policy_version 273278 (0.0011) [2023-12-27 21:11:32,806][106226] Updated weights for policy 0, policy_version 273288 (0.0009) [2023-12-27 21:11:32,878][106225] Updated weights for policy 1, policy_version 273669 (0.0009) [2023-12-27 21:11:32,938][106225] Updated weights for policy 1, policy_version 273679 (0.0010) [2023-12-27 21:11:32,992][106225] Updated weights for policy 1, policy_version 273689 (0.0010) [2023-12-27 21:11:33,476][106226] Updated weights for policy 0, policy_version 273298 (0.0007) [2023-12-27 21:11:33,531][106226] Updated weights for policy 0, policy_version 273308 (0.0005) [2023-12-27 21:11:33,594][106226] Updated weights for policy 0, policy_version 273318 (0.0005) [2023-12-27 21:11:33,729][106225] Updated weights for policy 1, policy_version 273699 (0.0010) [2023-12-27 21:11:33,791][106225] Updated weights for policy 1, policy_version 273709 (0.0010) [2023-12-27 21:11:33,853][106225] Updated weights for policy 1, policy_version 273719 (0.0010) [2023-12-27 21:11:34,183][106226] Updated weights for policy 0, policy_version 273328 (0.0010) [2023-12-27 21:11:34,246][106226] Updated weights for policy 0, policy_version 273338 (0.0010) [2023-12-27 21:11:34,305][106226] Updated weights for policy 0, policy_version 273348 (0.0008) [2023-12-27 21:11:34,594][106225] Updated weights for policy 1, policy_version 273729 (0.0010) [2023-12-27 21:11:34,652][106225] Updated weights for policy 1, policy_version 273739 (0.0010) [2023-12-27 21:11:34,714][106225] Updated weights for policy 1, policy_version 273749 (0.0010) [2023-12-27 21:11:34,779][106225] Updated weights for policy 1, policy_version 273759 (0.0011) [2023-12-27 21:11:34,992][106226] Updated weights for policy 0, policy_version 273358 (0.0010) [2023-12-27 21:11:35,047][106226] Updated weights for policy 0, policy_version 273368 (0.0006) [2023-12-27 21:11:35,100][106226] Updated weights for policy 0, policy_version 273378 (0.0007) [2023-12-27 21:11:35,486][106225] Updated weights for policy 1, policy_version 273769 (0.0010) [2023-12-27 21:11:35,536][106225] Updated weights for policy 1, policy_version 273779 (0.0010) [2023-12-27 21:11:35,589][106225] Updated weights for policy 1, policy_version 273789 (0.0010) [2023-12-27 21:11:35,783][106226] Updated weights for policy 0, policy_version 273388 (0.0011) [2023-12-27 21:11:35,853][106226] Updated weights for policy 0, policy_version 273398 (0.0010) [2023-12-27 21:11:35,913][106226] Updated weights for policy 0, policy_version 273408 (0.0007) [2023-12-27 21:11:36,174][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 140124160. Throughput: 0: 9959.5, 1: 9831.3. Samples: 140133132. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:36,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.886')] [2023-12-27 21:11:36,264][106225] Updated weights for policy 1, policy_version 273799 (0.0007) [2023-12-27 21:11:36,332][106225] Updated weights for policy 1, policy_version 273809 (0.0005) [2023-12-27 21:11:36,405][106225] Updated weights for policy 1, policy_version 273819 (0.0005) [2023-12-27 21:11:36,662][106226] Updated weights for policy 0, policy_version 273418 (0.0011) [2023-12-27 21:11:36,716][106226] Updated weights for policy 0, policy_version 273428 (0.0010) [2023-12-27 21:11:36,763][106226] Updated weights for policy 0, policy_version 273438 (0.0010) [2023-12-27 21:11:36,820][106226] Updated weights for policy 0, policy_version 273448 (0.0010) [2023-12-27 21:11:37,002][106225] Updated weights for policy 1, policy_version 273829 (0.0008) [2023-12-27 21:11:37,046][106225] Updated weights for policy 1, policy_version 273839 (0.0010) [2023-12-27 21:11:37,093][106225] Updated weights for policy 1, policy_version 273849 (0.0010) [2023-12-27 21:11:37,542][106226] Updated weights for policy 0, policy_version 273458 (0.0011) [2023-12-27 21:11:37,607][106226] Updated weights for policy 0, policy_version 273468 (0.0011) [2023-12-27 21:11:37,666][106226] Updated weights for policy 0, policy_version 273478 (0.0011) [2023-12-27 21:11:37,724][106225] Updated weights for policy 1, policy_version 273859 (0.0009) [2023-12-27 21:11:37,786][106225] Updated weights for policy 1, policy_version 273869 (0.0009) [2023-12-27 21:11:37,849][106225] Updated weights for policy 1, policy_version 273879 (0.0009) [2023-12-27 21:11:38,395][106226] Updated weights for policy 0, policy_version 273488 (0.0011) [2023-12-27 21:11:38,464][106226] Updated weights for policy 0, policy_version 273498 (0.0011) [2023-12-27 21:11:38,522][106226] Updated weights for policy 0, policy_version 273508 (0.0011) [2023-12-27 21:11:38,551][106225] Updated weights for policy 1, policy_version 273889 (0.0007) [2023-12-27 21:11:38,611][106225] Updated weights for policy 1, policy_version 273899 (0.0008) [2023-12-27 21:11:38,668][106225] Updated weights for policy 1, policy_version 273909 (0.0009) [2023-12-27 21:11:38,720][106225] Updated weights for policy 1, policy_version 273919 (0.0008) [2023-12-27 21:11:39,231][106226] Updated weights for policy 0, policy_version 273518 (0.0010) [2023-12-27 21:11:39,303][106226] Updated weights for policy 0, policy_version 273528 (0.0010) [2023-12-27 21:11:39,374][106226] Updated weights for policy 0, policy_version 273538 (0.0010) [2023-12-27 21:11:39,461][106225] Updated weights for policy 1, policy_version 273929 (0.0008) [2023-12-27 21:11:39,522][106225] Updated weights for policy 1, policy_version 273939 (0.0010) [2023-12-27 21:11:39,583][106225] Updated weights for policy 1, policy_version 273949 (0.0009) [2023-12-27 21:11:40,050][106226] Updated weights for policy 0, policy_version 273548 (0.0008) [2023-12-27 21:11:40,113][106226] Updated weights for policy 0, policy_version 273558 (0.0006) [2023-12-27 21:11:40,182][106226] Updated weights for policy 0, policy_version 273568 (0.0009) [2023-12-27 21:11:40,312][106225] Updated weights for policy 1, policy_version 273959 (0.0010) [2023-12-27 21:11:40,379][106225] Updated weights for policy 1, policy_version 273969 (0.0011) [2023-12-27 21:11:40,443][106225] Updated weights for policy 1, policy_version 273979 (0.0010) [2023-12-27 21:11:40,846][106226] Updated weights for policy 0, policy_version 273578 (0.0011) [2023-12-27 21:11:40,909][106226] Updated weights for policy 0, policy_version 273588 (0.0011) [2023-12-27 21:11:40,969][106226] Updated weights for policy 0, policy_version 273598 (0.0011) [2023-12-27 21:11:41,043][106225] Updated weights for policy 1, policy_version 273989 (0.0008) [2023-12-27 21:11:41,115][106225] Updated weights for policy 1, policy_version 273999 (0.0006) [2023-12-27 21:11:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 140222464. Throughput: 0: 9951.1, 1: 9870.0. Samples: 140193056. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:41,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-6.114')] [2023-12-27 21:11:41,179][106225] Updated weights for policy 1, policy_version 274009 (0.0012) [2023-12-27 21:11:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000273608_70066176.pth... [2023-12-27 21:11:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000272424_69763072.pth [2023-12-27 21:11:41,224][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000274016_70164480.pth... [2023-12-27 21:11:41,229][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000272832_69861376.pth [2023-12-27 21:11:41,739][106226] Updated weights for policy 0, policy_version 273609 (0.0010) [2023-12-27 21:11:41,798][106226] Updated weights for policy 0, policy_version 273619 (0.0010) [2023-12-27 21:11:41,853][106226] Updated weights for policy 0, policy_version 273629 (0.0010) [2023-12-27 21:11:41,914][106226] Updated weights for policy 0, policy_version 273639 (0.0011) [2023-12-27 21:11:41,925][106225] Updated weights for policy 1, policy_version 274019 (0.0006) [2023-12-27 21:11:41,986][106225] Updated weights for policy 1, policy_version 274029 (0.0008) [2023-12-27 21:11:42,048][106225] Updated weights for policy 1, policy_version 274039 (0.0008) [2023-12-27 21:11:42,663][106226] Updated weights for policy 0, policy_version 273649 (0.0009) [2023-12-27 21:11:42,727][106226] Updated weights for policy 0, policy_version 273659 (0.0009) [2023-12-27 21:11:42,787][106226] Updated weights for policy 0, policy_version 273669 (0.0009) [2023-12-27 21:11:42,808][106225] Updated weights for policy 1, policy_version 274049 (0.0008) [2023-12-27 21:11:42,859][106225] Updated weights for policy 1, policy_version 274059 (0.0009) [2023-12-27 21:11:42,912][106225] Updated weights for policy 1, policy_version 274069 (0.0006) [2023-12-27 21:11:42,967][106225] Updated weights for policy 1, policy_version 274079 (0.0008) [2023-12-27 21:11:43,509][106226] Updated weights for policy 0, policy_version 273679 (0.0010) [2023-12-27 21:11:43,577][106226] Updated weights for policy 0, policy_version 273689 (0.0011) [2023-12-27 21:11:43,625][106226] Updated weights for policy 0, policy_version 273699 (0.0007) [2023-12-27 21:11:43,657][106225] Updated weights for policy 1, policy_version 274089 (0.0006) [2023-12-27 21:11:43,709][106225] Updated weights for policy 1, policy_version 274099 (0.0005) [2023-12-27 21:11:43,765][106225] Updated weights for policy 1, policy_version 274109 (0.0006) [2023-12-27 21:11:44,356][106226] Updated weights for policy 0, policy_version 273709 (0.0008) [2023-12-27 21:11:44,422][106226] Updated weights for policy 0, policy_version 273719 (0.0008) [2023-12-27 21:11:44,440][106225] Updated weights for policy 1, policy_version 274119 (0.0007) [2023-12-27 21:11:44,485][106226] Updated weights for policy 0, policy_version 273729 (0.0006) [2023-12-27 21:11:44,504][106225] Updated weights for policy 1, policy_version 274129 (0.0006) [2023-12-27 21:11:44,574][106225] Updated weights for policy 1, policy_version 274139 (0.0006) [2023-12-27 21:11:45,142][106226] Updated weights for policy 0, policy_version 273739 (0.0007) [2023-12-27 21:11:45,201][106226] Updated weights for policy 0, policy_version 273749 (0.0008) [2023-12-27 21:11:45,222][106225] Updated weights for policy 1, policy_version 274149 (0.0010) [2023-12-27 21:11:45,257][106226] Updated weights for policy 0, policy_version 273759 (0.0006) [2023-12-27 21:11:45,285][106225] Updated weights for policy 1, policy_version 274159 (0.0011) [2023-12-27 21:11:45,348][106225] Updated weights for policy 1, policy_version 274169 (0.0010) [2023-12-27 21:11:45,998][106226] Updated weights for policy 0, policy_version 273769 (0.0006) [2023-12-27 21:11:46,060][106226] Updated weights for policy 0, policy_version 273779 (0.0007) [2023-12-27 21:11:46,065][106225] Updated weights for policy 1, policy_version 274179 (0.0010) [2023-12-27 21:11:46,121][106225] Updated weights for policy 1, policy_version 274189 (0.0010) [2023-12-27 21:11:46,123][106226] Updated weights for policy 0, policy_version 273789 (0.0007) [2023-12-27 21:11:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 140312576. Throughput: 0: 9975.9, 1: 9908.9. Samples: 140310512. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:46,175][106225] Updated weights for policy 1, policy_version 274199 (0.0007) [2023-12-27 21:11:46,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-5.750')] [2023-12-27 21:11:46,181][106226] Updated weights for policy 0, policy_version 273799 (0.0007) [2023-12-27 21:11:46,887][106226] Updated weights for policy 0, policy_version 273809 (0.0008) [2023-12-27 21:11:46,890][106225] Updated weights for policy 1, policy_version 274209 (0.0009) [2023-12-27 21:11:46,946][106225] Updated weights for policy 1, policy_version 274219 (0.0010) [2023-12-27 21:11:46,952][106226] Updated weights for policy 0, policy_version 273819 (0.0005) [2023-12-27 21:11:46,997][106225] Updated weights for policy 1, policy_version 274229 (0.0010) [2023-12-27 21:11:47,007][106226] Updated weights for policy 0, policy_version 273829 (0.0006) [2023-12-27 21:11:47,060][106225] Updated weights for policy 1, policy_version 274239 (0.0010) [2023-12-27 21:11:47,644][106226] Updated weights for policy 0, policy_version 273839 (0.0008) [2023-12-27 21:11:47,696][106226] Updated weights for policy 0, policy_version 273849 (0.0008) [2023-12-27 21:11:47,751][106226] Updated weights for policy 0, policy_version 273859 (0.0008) [2023-12-27 21:11:47,766][106225] Updated weights for policy 1, policy_version 274249 (0.0006) [2023-12-27 21:11:47,817][106225] Updated weights for policy 1, policy_version 274259 (0.0005) [2023-12-27 21:11:47,883][106225] Updated weights for policy 1, policy_version 274269 (0.0005) [2023-12-27 21:11:48,423][106225] Updated weights for policy 1, policy_version 274279 (0.0006) [2023-12-27 21:11:48,482][106225] Updated weights for policy 1, policy_version 274289 (0.0009) [2023-12-27 21:11:48,542][106225] Updated weights for policy 1, policy_version 274299 (0.0008) [2023-12-27 21:11:48,573][106226] Updated weights for policy 0, policy_version 273869 (0.0006) [2023-12-27 21:11:48,628][106226] Updated weights for policy 0, policy_version 273879 (0.0006) [2023-12-27 21:11:48,684][106226] Updated weights for policy 0, policy_version 273889 (0.0006) [2023-12-27 21:11:49,142][106225] Updated weights for policy 1, policy_version 274309 (0.0007) [2023-12-27 21:11:49,208][106225] Updated weights for policy 1, policy_version 274319 (0.0008) [2023-12-27 21:11:49,275][106225] Updated weights for policy 1, policy_version 274329 (0.0010) [2023-12-27 21:11:49,413][106226] Updated weights for policy 0, policy_version 273899 (0.0010) [2023-12-27 21:11:49,459][106226] Updated weights for policy 0, policy_version 273909 (0.0006) [2023-12-27 21:11:49,511][106226] Updated weights for policy 0, policy_version 273919 (0.0007) [2023-12-27 21:11:50,069][106225] Updated weights for policy 1, policy_version 274339 (0.0010) [2023-12-27 21:11:50,127][106225] Updated weights for policy 1, policy_version 274349 (0.0010) [2023-12-27 21:11:50,192][106225] Updated weights for policy 1, policy_version 274359 (0.0011) [2023-12-27 21:11:50,296][106226] Updated weights for policy 0, policy_version 273929 (0.0008) [2023-12-27 21:11:50,360][106226] Updated weights for policy 0, policy_version 273939 (0.0008) [2023-12-27 21:11:50,423][106226] Updated weights for policy 0, policy_version 273949 (0.0008) [2023-12-27 21:11:50,483][106226] Updated weights for policy 0, policy_version 273959 (0.0008) [2023-12-27 21:11:50,943][106225] Updated weights for policy 1, policy_version 274369 (0.0010) [2023-12-27 21:11:51,010][106225] Updated weights for policy 1, policy_version 274379 (0.0011) [2023-12-27 21:11:51,088][106225] Updated weights for policy 1, policy_version 274389 (0.0010) [2023-12-27 21:11:51,155][106225] Updated weights for policy 1, policy_version 274399 (0.0009) [2023-12-27 21:11:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 140419072. Throughput: 0: 9856.6, 1: 9979.8. Samples: 140427612. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:51,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-6.036')] [2023-12-27 21:11:51,248][106226] Updated weights for policy 0, policy_version 273969 (0.0006) [2023-12-27 21:11:51,302][106226] Updated weights for policy 0, policy_version 273979 (0.0008) [2023-12-27 21:11:51,367][106226] Updated weights for policy 0, policy_version 273989 (0.0009) [2023-12-27 21:11:51,845][106225] Updated weights for policy 1, policy_version 274409 (0.0008) [2023-12-27 21:11:51,901][106225] Updated weights for policy 1, policy_version 274419 (0.0008) [2023-12-27 21:11:51,965][106225] Updated weights for policy 1, policy_version 274429 (0.0008) [2023-12-27 21:11:52,089][106226] Updated weights for policy 0, policy_version 273999 (0.0007) [2023-12-27 21:11:52,154][106226] Updated weights for policy 0, policy_version 274009 (0.0006) [2023-12-27 21:11:52,214][106226] Updated weights for policy 0, policy_version 274019 (0.0009) [2023-12-27 21:11:52,644][106225] Updated weights for policy 1, policy_version 274439 (0.0006) [2023-12-27 21:11:52,705][106225] Updated weights for policy 1, policy_version 274449 (0.0006) [2023-12-27 21:11:52,768][106225] Updated weights for policy 1, policy_version 274459 (0.0006) [2023-12-27 21:11:53,003][106226] Updated weights for policy 0, policy_version 274029 (0.0009) [2023-12-27 21:11:53,060][106226] Updated weights for policy 0, policy_version 274039 (0.0008) [2023-12-27 21:11:53,111][106226] Updated weights for policy 0, policy_version 274049 (0.0008) [2023-12-27 21:11:53,405][106225] Updated weights for policy 1, policy_version 274469 (0.0005) [2023-12-27 21:11:53,461][106225] Updated weights for policy 1, policy_version 274479 (0.0005) [2023-12-27 21:11:53,521][106225] Updated weights for policy 1, policy_version 274489 (0.0007) [2023-12-27 21:11:53,910][106226] Updated weights for policy 0, policy_version 274059 (0.0008) [2023-12-27 21:11:53,973][106226] Updated weights for policy 0, policy_version 274069 (0.0009) [2023-12-27 21:11:54,030][106226] Updated weights for policy 0, policy_version 274079 (0.0008) [2023-12-27 21:11:54,173][106225] Updated weights for policy 1, policy_version 274499 (0.0010) [2023-12-27 21:11:54,236][106225] Updated weights for policy 1, policy_version 274509 (0.0008) [2023-12-27 21:11:54,299][106225] Updated weights for policy 1, policy_version 274519 (0.0009) [2023-12-27 21:11:54,788][106226] Updated weights for policy 0, policy_version 274089 (0.0008) [2023-12-27 21:11:54,852][106226] Updated weights for policy 0, policy_version 274099 (0.0009) [2023-12-27 21:11:54,904][106226] Updated weights for policy 0, policy_version 274109 (0.0009) [2023-12-27 21:11:54,955][106226] Updated weights for policy 0, policy_version 274119 (0.0009) [2023-12-27 21:11:54,974][106225] Updated weights for policy 1, policy_version 274529 (0.0009) [2023-12-27 21:11:55,038][106225] Updated weights for policy 1, policy_version 274539 (0.0009) [2023-12-27 21:11:55,101][106225] Updated weights for policy 1, policy_version 274549 (0.0008) [2023-12-27 21:11:55,158][106225] Updated weights for policy 1, policy_version 274559 (0.0009) [2023-12-27 21:11:55,710][106226] Updated weights for policy 0, policy_version 274129 (0.0009) [2023-12-27 21:11:55,766][106226] Updated weights for policy 0, policy_version 274139 (0.0007) [2023-12-27 21:11:55,789][106225] Updated weights for policy 1, policy_version 274569 (0.0010) [2023-12-27 21:11:55,820][106226] Updated weights for policy 0, policy_version 274149 (0.0005) [2023-12-27 21:11:55,840][106225] Updated weights for policy 1, policy_version 274579 (0.0010) [2023-12-27 21:11:55,893][106225] Updated weights for policy 1, policy_version 274589 (0.0010) [2023-12-27 21:11:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 140517376. Throughput: 0: 9774.2, 1: 10036.6. Samples: 140485452. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:11:56,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-5.826')] [2023-12-27 21:11:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000274592_70311936.pth... [2023-12-27 21:11:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000274152_70205440.pth... [2023-12-27 21:11:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000273408_70008832.pth [2023-12-27 21:11:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000273000_69910528.pth [2023-12-27 21:11:56,420][106226] Updated weights for policy 0, policy_version 274159 (0.0007) [2023-12-27 21:11:56,480][106226] Updated weights for policy 0, policy_version 274169 (0.0008) [2023-12-27 21:11:56,526][106226] Updated weights for policy 0, policy_version 274179 (0.0008) [2023-12-27 21:11:56,576][106225] Updated weights for policy 1, policy_version 274599 (0.0010) [2023-12-27 21:11:56,635][106225] Updated weights for policy 1, policy_version 274609 (0.0010) [2023-12-27 21:11:56,688][106225] Updated weights for policy 1, policy_version 274619 (0.0010) [2023-12-27 21:11:57,216][106226] Updated weights for policy 0, policy_version 274189 (0.0006) [2023-12-27 21:11:57,268][106226] Updated weights for policy 0, policy_version 274199 (0.0005) [2023-12-27 21:11:57,325][106226] Updated weights for policy 0, policy_version 274209 (0.0008) [2023-12-27 21:11:57,385][106225] Updated weights for policy 1, policy_version 274629 (0.0008) [2023-12-27 21:11:57,442][106225] Updated weights for policy 1, policy_version 274639 (0.0005) [2023-12-27 21:11:57,512][106225] Updated weights for policy 1, policy_version 274649 (0.0005) [2023-12-27 21:11:57,928][106226] Updated weights for policy 0, policy_version 274219 (0.0008) [2023-12-27 21:11:57,981][106226] Updated weights for policy 0, policy_version 274229 (0.0005) [2023-12-27 21:11:58,035][106226] Updated weights for policy 0, policy_version 274239 (0.0006) [2023-12-27 21:11:58,036][106225] Updated weights for policy 1, policy_version 274659 (0.0007) [2023-12-27 21:11:58,090][106225] Updated weights for policy 1, policy_version 274669 (0.0007) [2023-12-27 21:11:58,138][106225] Updated weights for policy 1, policy_version 274679 (0.0008) [2023-12-27 21:11:58,764][106226] Updated weights for policy 0, policy_version 274249 (0.0006) [2023-12-27 21:11:58,829][106226] Updated weights for policy 0, policy_version 274259 (0.0007) [2023-12-27 21:11:58,908][106226] Updated weights for policy 0, policy_version 274269 (0.0008) [2023-12-27 21:11:58,934][106225] Updated weights for policy 1, policy_version 274689 (0.0005) [2023-12-27 21:11:58,968][106226] Updated weights for policy 0, policy_version 274279 (0.0006) [2023-12-27 21:11:58,999][106225] Updated weights for policy 1, policy_version 274699 (0.0009) [2023-12-27 21:11:59,059][106225] Updated weights for policy 1, policy_version 274709 (0.0009) [2023-12-27 21:11:59,122][106225] Updated weights for policy 1, policy_version 274719 (0.0008) [2023-12-27 21:11:59,702][106226] Updated weights for policy 0, policy_version 274289 (0.0009) [2023-12-27 21:11:59,755][106226] Updated weights for policy 0, policy_version 274299 (0.0008) [2023-12-27 21:11:59,816][106226] Updated weights for policy 0, policy_version 274309 (0.0008) [2023-12-27 21:11:59,882][106225] Updated weights for policy 1, policy_version 274729 (0.0008) [2023-12-27 21:11:59,950][106225] Updated weights for policy 1, policy_version 274739 (0.0007) [2023-12-27 21:12:00,010][106225] Updated weights for policy 1, policy_version 274749 (0.0006) [2023-12-27 21:12:00,503][106226] Updated weights for policy 0, policy_version 274319 (0.0008) [2023-12-27 21:12:00,562][106226] Updated weights for policy 0, policy_version 274329 (0.0007) [2023-12-27 21:12:00,621][106226] Updated weights for policy 0, policy_version 274339 (0.0007) [2023-12-27 21:12:00,706][106225] Updated weights for policy 1, policy_version 274759 (0.0006) [2023-12-27 21:12:00,767][106225] Updated weights for policy 1, policy_version 274769 (0.0010) [2023-12-27 21:12:00,830][106225] Updated weights for policy 1, policy_version 274779 (0.0010) [2023-12-27 21:12:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 140615680. Throughput: 0: 9822.5, 1: 10129.2. Samples: 140605832. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:12:01,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-6.151')] [2023-12-27 21:12:01,306][106226] Updated weights for policy 0, policy_version 274349 (0.0008) [2023-12-27 21:12:01,372][106226] Updated weights for policy 0, policy_version 274359 (0.0008) [2023-12-27 21:12:01,433][106226] Updated weights for policy 0, policy_version 274369 (0.0008) [2023-12-27 21:12:01,499][106225] Updated weights for policy 1, policy_version 274789 (0.0007) [2023-12-27 21:12:01,562][106225] Updated weights for policy 1, policy_version 274799 (0.0008) [2023-12-27 21:12:01,627][106225] Updated weights for policy 1, policy_version 274809 (0.0006) [2023-12-27 21:12:02,219][106226] Updated weights for policy 0, policy_version 274379 (0.0007) [2023-12-27 21:12:02,278][106226] Updated weights for policy 0, policy_version 274389 (0.0008) [2023-12-27 21:12:02,317][106225] Updated weights for policy 1, policy_version 274819 (0.0007) [2023-12-27 21:12:02,345][106226] Updated weights for policy 0, policy_version 274399 (0.0008) [2023-12-27 21:12:02,380][106225] Updated weights for policy 1, policy_version 274829 (0.0009) [2023-12-27 21:12:02,437][106225] Updated weights for policy 1, policy_version 274839 (0.0006) [2023-12-27 21:12:03,061][106226] Updated weights for policy 0, policy_version 274409 (0.0008) [2023-12-27 21:12:03,119][106225] Updated weights for policy 1, policy_version 274849 (0.0007) [2023-12-27 21:12:03,125][106226] Updated weights for policy 0, policy_version 274419 (0.0005) [2023-12-27 21:12:03,176][106225] Updated weights for policy 1, policy_version 274859 (0.0006) [2023-12-27 21:12:03,187][106226] Updated weights for policy 0, policy_version 274429 (0.0005) [2023-12-27 21:12:03,227][106225] Updated weights for policy 1, policy_version 274869 (0.0010) [2023-12-27 21:12:03,250][106226] Updated weights for policy 0, policy_version 274439 (0.0006) [2023-12-27 21:12:03,279][106225] Updated weights for policy 1, policy_version 274879 (0.0010) [2023-12-27 21:12:03,845][106226] Updated weights for policy 0, policy_version 274449 (0.0010) [2023-12-27 21:12:03,897][106225] Updated weights for policy 1, policy_version 274889 (0.0010) [2023-12-27 21:12:03,910][106226] Updated weights for policy 0, policy_version 274459 (0.0007) [2023-12-27 21:12:03,954][106225] Updated weights for policy 1, policy_version 274899 (0.0010) [2023-12-27 21:12:03,965][106226] Updated weights for policy 0, policy_version 274469 (0.0006) [2023-12-27 21:12:04,013][106225] Updated weights for policy 1, policy_version 274909 (0.0008) [2023-12-27 21:12:04,649][106226] Updated weights for policy 0, policy_version 274479 (0.0008) [2023-12-27 21:12:04,693][106225] Updated weights for policy 1, policy_version 274919 (0.0009) [2023-12-27 21:12:04,710][106226] Updated weights for policy 0, policy_version 274489 (0.0008) [2023-12-27 21:12:04,759][106225] Updated weights for policy 1, policy_version 274929 (0.0010) [2023-12-27 21:12:04,765][106226] Updated weights for policy 0, policy_version 274499 (0.0006) [2023-12-27 21:12:04,814][106225] Updated weights for policy 1, policy_version 274939 (0.0010) [2023-12-27 21:12:05,482][106226] Updated weights for policy 0, policy_version 274509 (0.0009) [2023-12-27 21:12:05,530][106225] Updated weights for policy 1, policy_version 274949 (0.0010) [2023-12-27 21:12:05,540][106226] Updated weights for policy 0, policy_version 274519 (0.0006) [2023-12-27 21:12:05,581][106225] Updated weights for policy 1, policy_version 274959 (0.0010) [2023-12-27 21:12:05,598][106226] Updated weights for policy 0, policy_version 274529 (0.0007) [2023-12-27 21:12:05,639][106225] Updated weights for policy 1, policy_version 274969 (0.0005) [2023-12-27 21:12:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 140713984. Throughput: 0: 9790.6, 1: 10129.9. Samples: 140725788. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:12:06,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-5.879')] [2023-12-27 21:12:06,207][106225] Updated weights for policy 1, policy_version 274979 (0.0006) [2023-12-27 21:12:06,268][106225] Updated weights for policy 1, policy_version 274989 (0.0006) [2023-12-27 21:12:06,318][106226] Updated weights for policy 0, policy_version 274539 (0.0008) [2023-12-27 21:12:06,331][106225] Updated weights for policy 1, policy_version 274999 (0.0006) [2023-12-27 21:12:06,381][106226] Updated weights for policy 0, policy_version 274549 (0.0007) [2023-12-27 21:12:06,436][106226] Updated weights for policy 0, policy_version 274559 (0.0008) [2023-12-27 21:12:06,987][106225] Updated weights for policy 1, policy_version 275009 (0.0008) [2023-12-27 21:12:07,048][106225] Updated weights for policy 1, policy_version 275019 (0.0008) [2023-12-27 21:12:07,098][106225] Updated weights for policy 1, policy_version 275029 (0.0008) [2023-12-27 21:12:07,156][106225] Updated weights for policy 1, policy_version 275039 (0.0008) [2023-12-27 21:12:07,160][106226] Updated weights for policy 0, policy_version 274569 (0.0008) [2023-12-27 21:12:07,223][106226] Updated weights for policy 0, policy_version 274579 (0.0005) [2023-12-27 21:12:07,287][106226] Updated weights for policy 0, policy_version 274589 (0.0008) [2023-12-27 21:12:07,337][106226] Updated weights for policy 0, policy_version 274599 (0.0007) [2023-12-27 21:12:07,891][106225] Updated weights for policy 1, policy_version 275049 (0.0006) [2023-12-27 21:12:07,951][106225] Updated weights for policy 1, policy_version 275059 (0.0005) [2023-12-27 21:12:08,006][106226] Updated weights for policy 0, policy_version 274609 (0.0008) [2023-12-27 21:12:08,010][106225] Updated weights for policy 1, policy_version 275069 (0.0005) [2023-12-27 21:12:08,070][106226] Updated weights for policy 0, policy_version 274619 (0.0010) [2023-12-27 21:12:08,132][106226] Updated weights for policy 0, policy_version 274629 (0.0009) [2023-12-27 21:12:08,679][106225] Updated weights for policy 1, policy_version 275079 (0.0007) [2023-12-27 21:12:08,736][106225] Updated weights for policy 1, policy_version 275089 (0.0008) [2023-12-27 21:12:08,798][106225] Updated weights for policy 1, policy_version 275099 (0.0008) [2023-12-27 21:12:08,829][106226] Updated weights for policy 0, policy_version 274639 (0.0008) [2023-12-27 21:12:08,895][106226] Updated weights for policy 0, policy_version 274649 (0.0008) [2023-12-27 21:12:08,954][106226] Updated weights for policy 0, policy_version 274659 (0.0008) [2023-12-27 21:12:09,609][106225] Updated weights for policy 1, policy_version 275109 (0.0008) [2023-12-27 21:12:09,678][106225] Updated weights for policy 1, policy_version 275119 (0.0009) [2023-12-27 21:12:09,717][106226] Updated weights for policy 0, policy_version 274669 (0.0008) [2023-12-27 21:12:09,741][106225] Updated weights for policy 1, policy_version 275129 (0.0010) [2023-12-27 21:12:09,783][106226] Updated weights for policy 0, policy_version 274679 (0.0008) [2023-12-27 21:12:09,848][106226] Updated weights for policy 0, policy_version 274689 (0.0009) [2023-12-27 21:12:10,373][106225] Updated weights for policy 1, policy_version 275139 (0.0007) [2023-12-27 21:12:10,429][106225] Updated weights for policy 1, policy_version 275149 (0.0007) [2023-12-27 21:12:10,484][106225] Updated weights for policy 1, policy_version 275159 (0.0008) [2023-12-27 21:12:10,581][106226] Updated weights for policy 0, policy_version 274699 (0.0010) [2023-12-27 21:12:10,635][106226] Updated weights for policy 0, policy_version 274709 (0.0010) [2023-12-27 21:12:10,688][106226] Updated weights for policy 0, policy_version 274719 (0.0010) [2023-12-27 21:12:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 140812288. Throughput: 0: 9849.4, 1: 10150.8. Samples: 140786416. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:11,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-6.002')] [2023-12-27 21:12:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000275168_70459392.pth... [2023-12-27 21:12:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000274728_70352896.pth... [2023-12-27 21:12:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000274016_70164480.pth [2023-12-27 21:12:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000273608_70066176.pth [2023-12-27 21:12:11,241][106225] Updated weights for policy 1, policy_version 275169 (0.0009) [2023-12-27 21:12:11,308][106225] Updated weights for policy 1, policy_version 275179 (0.0006) [2023-12-27 21:12:11,379][106225] Updated weights for policy 1, policy_version 275189 (0.0008) [2023-12-27 21:12:11,439][106226] Updated weights for policy 0, policy_version 274729 (0.0009) [2023-12-27 21:12:11,442][106225] Updated weights for policy 1, policy_version 275199 (0.0008) [2023-12-27 21:12:11,507][106226] Updated weights for policy 0, policy_version 274739 (0.0009) [2023-12-27 21:12:11,565][106226] Updated weights for policy 0, policy_version 274749 (0.0010) [2023-12-27 21:12:11,626][106226] Updated weights for policy 0, policy_version 274759 (0.0009) [2023-12-27 21:12:12,193][106225] Updated weights for policy 1, policy_version 275209 (0.0006) [2023-12-27 21:12:12,256][106225] Updated weights for policy 1, policy_version 275219 (0.0009) [2023-12-27 21:12:12,267][106226] Updated weights for policy 0, policy_version 274769 (0.0007) [2023-12-27 21:12:12,316][106225] Updated weights for policy 1, policy_version 275229 (0.0008) [2023-12-27 21:12:12,332][106226] Updated weights for policy 0, policy_version 274779 (0.0006) [2023-12-27 21:12:12,403][106226] Updated weights for policy 0, policy_version 274789 (0.0007) [2023-12-27 21:12:13,045][106225] Updated weights for policy 1, policy_version 275239 (0.0010) [2023-12-27 21:12:13,079][106226] Updated weights for policy 0, policy_version 274799 (0.0008) [2023-12-27 21:12:13,111][106225] Updated weights for policy 1, policy_version 275249 (0.0007) [2023-12-27 21:12:13,148][106226] Updated weights for policy 0, policy_version 274809 (0.0010) [2023-12-27 21:12:13,169][106225] Updated weights for policy 1, policy_version 275259 (0.0008) [2023-12-27 21:12:13,215][106226] Updated weights for policy 0, policy_version 274819 (0.0011) [2023-12-27 21:12:13,807][106225] Updated weights for policy 1, policy_version 275269 (0.0009) [2023-12-27 21:12:13,875][106225] Updated weights for policy 1, policy_version 275279 (0.0009) [2023-12-27 21:12:13,904][106226] Updated weights for policy 0, policy_version 274829 (0.0008) [2023-12-27 21:12:13,935][106225] Updated weights for policy 1, policy_version 275289 (0.0007) [2023-12-27 21:12:13,961][106226] Updated weights for policy 0, policy_version 274839 (0.0007) [2023-12-27 21:12:14,023][106226] Updated weights for policy 0, policy_version 274849 (0.0006) [2023-12-27 21:12:14,605][106225] Updated weights for policy 1, policy_version 275299 (0.0007) [2023-12-27 21:12:14,663][106225] Updated weights for policy 1, policy_version 275309 (0.0007) [2023-12-27 21:12:14,688][106226] Updated weights for policy 0, policy_version 274859 (0.0011) [2023-12-27 21:12:14,718][106225] Updated weights for policy 1, policy_version 275319 (0.0006) [2023-12-27 21:12:14,742][106226] Updated weights for policy 0, policy_version 274869 (0.0010) [2023-12-27 21:12:14,807][106226] Updated weights for policy 0, policy_version 274879 (0.0010) [2023-12-27 21:12:15,488][106225] Updated weights for policy 1, policy_version 275329 (0.0006) [2023-12-27 21:12:15,510][106226] Updated weights for policy 0, policy_version 274889 (0.0006) [2023-12-27 21:12:15,545][106225] Updated weights for policy 1, policy_version 275339 (0.0007) [2023-12-27 21:12:15,582][106226] Updated weights for policy 0, policy_version 274899 (0.0009) [2023-12-27 21:12:15,605][106225] Updated weights for policy 1, policy_version 275349 (0.0006) [2023-12-27 21:12:15,650][106226] Updated weights for policy 0, policy_version 274909 (0.0009) [2023-12-27 21:12:15,669][106225] Updated weights for policy 1, policy_version 275359 (0.0007) [2023-12-27 21:12:15,716][106226] Updated weights for policy 0, policy_version 274919 (0.0007) [2023-12-27 21:12:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 140910592. Throughput: 0: 9746.2, 1: 10030.5. Samples: 140903128. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:16,176][105115] Avg episode reward: [(0, '-4.563'), (1, '-6.080')] [2023-12-27 21:12:16,354][106225] Updated weights for policy 1, policy_version 275369 (0.0008) [2023-12-27 21:12:16,410][106226] Updated weights for policy 0, policy_version 274929 (0.0007) [2023-12-27 21:12:16,414][106225] Updated weights for policy 1, policy_version 275379 (0.0006) [2023-12-27 21:12:16,461][106226] Updated weights for policy 0, policy_version 274939 (0.0008) [2023-12-27 21:12:16,473][106225] Updated weights for policy 1, policy_version 275389 (0.0005) [2023-12-27 21:12:16,521][106226] Updated weights for policy 0, policy_version 274949 (0.0008) [2023-12-27 21:12:17,108][106225] Updated weights for policy 1, policy_version 275399 (0.0007) [2023-12-27 21:12:17,169][106225] Updated weights for policy 1, policy_version 275409 (0.0008) [2023-12-27 21:12:17,227][106225] Updated weights for policy 1, policy_version 275419 (0.0008) [2023-12-27 21:12:17,272][106226] Updated weights for policy 0, policy_version 274959 (0.0008) [2023-12-27 21:12:17,333][106226] Updated weights for policy 0, policy_version 274969 (0.0005) [2023-12-27 21:12:17,390][106226] Updated weights for policy 0, policy_version 274979 (0.0007) [2023-12-27 21:12:17,958][106225] Updated weights for policy 1, policy_version 275429 (0.0007) [2023-12-27 21:12:18,006][106225] Updated weights for policy 1, policy_version 275439 (0.0008) [2023-12-27 21:12:18,068][106225] Updated weights for policy 1, policy_version 275449 (0.0008) [2023-12-27 21:12:18,077][106226] Updated weights for policy 0, policy_version 274989 (0.0008) [2023-12-27 21:12:18,133][106226] Updated weights for policy 0, policy_version 274999 (0.0007) [2023-12-27 21:12:18,185][106226] Updated weights for policy 0, policy_version 275009 (0.0009) [2023-12-27 21:12:18,788][106225] Updated weights for policy 1, policy_version 275459 (0.0008) [2023-12-27 21:12:18,850][106225] Updated weights for policy 1, policy_version 275469 (0.0009) [2023-12-27 21:12:18,909][106225] Updated weights for policy 1, policy_version 275479 (0.0008) [2023-12-27 21:12:18,945][106226] Updated weights for policy 0, policy_version 275019 (0.0007) [2023-12-27 21:12:19,003][106226] Updated weights for policy 0, policy_version 275029 (0.0007) [2023-12-27 21:12:19,060][106226] Updated weights for policy 0, policy_version 275039 (0.0009) [2023-12-27 21:12:19,650][106225] Updated weights for policy 1, policy_version 275489 (0.0008) [2023-12-27 21:12:19,710][106225] Updated weights for policy 1, policy_version 275499 (0.0009) [2023-12-27 21:12:19,773][106225] Updated weights for policy 1, policy_version 275509 (0.0008) [2023-12-27 21:12:19,788][106226] Updated weights for policy 0, policy_version 275049 (0.0009) [2023-12-27 21:12:19,852][106225] Updated weights for policy 1, policy_version 275519 (0.0007) [2023-12-27 21:12:19,855][106226] Updated weights for policy 0, policy_version 275059 (0.0007) [2023-12-27 21:12:19,911][106226] Updated weights for policy 0, policy_version 275069 (0.0008) [2023-12-27 21:12:19,978][106226] Updated weights for policy 0, policy_version 275079 (0.0007) [2023-12-27 21:12:20,633][106226] Updated weights for policy 0, policy_version 275089 (0.0010) [2023-12-27 21:12:20,653][106225] Updated weights for policy 1, policy_version 275529 (0.0008) [2023-12-27 21:12:20,696][106226] Updated weights for policy 0, policy_version 275099 (0.0012) [2023-12-27 21:12:20,714][106225] Updated weights for policy 1, policy_version 275539 (0.0008) [2023-12-27 21:12:20,762][106226] Updated weights for policy 0, policy_version 275109 (0.0011) [2023-12-27 21:12:20,782][106225] Updated weights for policy 1, policy_version 275549 (0.0008) [2023-12-27 21:12:21,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 141008896. Throughput: 0: 9684.5, 1: 9976.6. Samples: 141017884. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:21,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.817')] [2023-12-27 21:12:21,509][106225] Updated weights for policy 1, policy_version 275559 (0.0008) [2023-12-27 21:12:21,553][106226] Updated weights for policy 0, policy_version 275119 (0.0009) [2023-12-27 21:12:21,576][106225] Updated weights for policy 1, policy_version 275569 (0.0008) [2023-12-27 21:12:21,622][106226] Updated weights for policy 0, policy_version 275129 (0.0008) [2023-12-27 21:12:21,631][106225] Updated weights for policy 1, policy_version 275579 (0.0008) [2023-12-27 21:12:21,685][106226] Updated weights for policy 0, policy_version 275139 (0.0008) [2023-12-27 21:12:22,282][106225] Updated weights for policy 1, policy_version 275589 (0.0008) [2023-12-27 21:12:22,342][106225] Updated weights for policy 1, policy_version 275599 (0.0008) [2023-12-27 21:12:22,408][106225] Updated weights for policy 1, policy_version 275609 (0.0008) [2023-12-27 21:12:22,452][106226] Updated weights for policy 0, policy_version 275149 (0.0007) [2023-12-27 21:12:22,523][106226] Updated weights for policy 0, policy_version 275159 (0.0006) [2023-12-27 21:12:22,594][106226] Updated weights for policy 0, policy_version 275169 (0.0006) [2023-12-27 21:12:23,143][106225] Updated weights for policy 1, policy_version 275619 (0.0007) [2023-12-27 21:12:23,202][106225] Updated weights for policy 1, policy_version 275629 (0.0008) [2023-12-27 21:12:23,241][106226] Updated weights for policy 0, policy_version 275179 (0.0009) [2023-12-27 21:12:23,259][106225] Updated weights for policy 1, policy_version 275639 (0.0007) [2023-12-27 21:12:23,296][106226] Updated weights for policy 0, policy_version 275189 (0.0006) [2023-12-27 21:12:23,354][106226] Updated weights for policy 0, policy_version 275199 (0.0008) [2023-12-27 21:12:23,958][106226] Updated weights for policy 0, policy_version 275209 (0.0008) [2023-12-27 21:12:24,022][106226] Updated weights for policy 0, policy_version 275219 (0.0008) [2023-12-27 21:12:24,043][106225] Updated weights for policy 1, policy_version 275649 (0.0007) [2023-12-27 21:12:24,088][106226] Updated weights for policy 0, policy_version 275229 (0.0008) [2023-12-27 21:12:24,109][106225] Updated weights for policy 1, policy_version 275659 (0.0008) [2023-12-27 21:12:24,146][106226] Updated weights for policy 0, policy_version 275239 (0.0006) [2023-12-27 21:12:24,172][106225] Updated weights for policy 1, policy_version 275669 (0.0008) [2023-12-27 21:12:24,232][106225] Updated weights for policy 1, policy_version 275679 (0.0008) [2023-12-27 21:12:24,829][106226] Updated weights for policy 0, policy_version 275249 (0.0005) [2023-12-27 21:12:24,876][106226] Updated weights for policy 0, policy_version 275259 (0.0008) [2023-12-27 21:12:24,924][106226] Updated weights for policy 0, policy_version 275269 (0.0008) [2023-12-27 21:12:24,958][106225] Updated weights for policy 1, policy_version 275689 (0.0008) [2023-12-27 21:12:25,016][106225] Updated weights for policy 1, policy_version 275699 (0.0008) [2023-12-27 21:12:25,073][106225] Updated weights for policy 1, policy_version 275709 (0.0008) [2023-12-27 21:12:25,617][106226] Updated weights for policy 0, policy_version 275279 (0.0008) [2023-12-27 21:12:25,662][106226] Updated weights for policy 0, policy_version 275289 (0.0008) [2023-12-27 21:12:25,725][106226] Updated weights for policy 0, policy_version 275299 (0.0009) [2023-12-27 21:12:25,796][106225] Updated weights for policy 1, policy_version 275719 (0.0006) [2023-12-27 21:12:25,847][106225] Updated weights for policy 1, policy_version 275729 (0.0007) [2023-12-27 21:12:25,895][106225] Updated weights for policy 1, policy_version 275739 (0.0008) [2023-12-27 21:12:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 141107200. Throughput: 0: 9692.0, 1: 9921.3. Samples: 141075660. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:26,176][105115] Avg episode reward: [(0, '-4.630'), (1, '-5.786')] [2023-12-27 21:12:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000275744_70606848.pth... [2023-12-27 21:12:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000275304_70500352.pth... [2023-12-27 21:12:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000274152_70205440.pth [2023-12-27 21:12:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000274592_70311936.pth [2023-12-27 21:12:26,389][106226] Updated weights for policy 0, policy_version 275309 (0.0007) [2023-12-27 21:12:26,435][106226] Updated weights for policy 0, policy_version 275319 (0.0008) [2023-12-27 21:12:26,481][106226] Updated weights for policy 0, policy_version 275329 (0.0008) [2023-12-27 21:12:26,668][106225] Updated weights for policy 1, policy_version 275749 (0.0009) [2023-12-27 21:12:26,713][106225] Updated weights for policy 1, policy_version 275759 (0.0008) [2023-12-27 21:12:26,760][106225] Updated weights for policy 1, policy_version 275769 (0.0008) [2023-12-27 21:12:27,098][106226] Updated weights for policy 0, policy_version 275339 (0.0008) [2023-12-27 21:12:27,159][106226] Updated weights for policy 0, policy_version 275349 (0.0008) [2023-12-27 21:12:27,220][106226] Updated weights for policy 0, policy_version 275359 (0.0005) [2023-12-27 21:12:27,565][106225] Updated weights for policy 1, policy_version 275779 (0.0009) [2023-12-27 21:12:27,614][106225] Updated weights for policy 1, policy_version 275789 (0.0008) [2023-12-27 21:12:27,670][106225] Updated weights for policy 1, policy_version 275799 (0.0007) [2023-12-27 21:12:27,843][106226] Updated weights for policy 0, policy_version 275369 (0.0006) [2023-12-27 21:12:27,903][106226] Updated weights for policy 0, policy_version 275379 (0.0009) [2023-12-27 21:12:27,963][106226] Updated weights for policy 0, policy_version 275389 (0.0009) [2023-12-27 21:12:28,015][106226] Updated weights for policy 0, policy_version 275399 (0.0008) [2023-12-27 21:12:28,380][106225] Updated weights for policy 1, policy_version 275809 (0.0008) [2023-12-27 21:12:28,428][106225] Updated weights for policy 1, policy_version 275819 (0.0008) [2023-12-27 21:12:28,475][106225] Updated weights for policy 1, policy_version 275829 (0.0008) [2023-12-27 21:12:28,524][106225] Updated weights for policy 1, policy_version 275839 (0.0008) [2023-12-27 21:12:28,724][106226] Updated weights for policy 0, policy_version 275409 (0.0009) [2023-12-27 21:12:28,783][106226] Updated weights for policy 0, policy_version 275419 (0.0007) [2023-12-27 21:12:28,841][106226] Updated weights for policy 0, policy_version 275429 (0.0008) [2023-12-27 21:12:29,314][106225] Updated weights for policy 1, policy_version 275849 (0.0008) [2023-12-27 21:12:29,382][106225] Updated weights for policy 1, policy_version 275859 (0.0008) [2023-12-27 21:12:29,433][106225] Updated weights for policy 1, policy_version 275869 (0.0009) [2023-12-27 21:12:29,512][106226] Updated weights for policy 0, policy_version 275439 (0.0009) [2023-12-27 21:12:29,568][106226] Updated weights for policy 0, policy_version 275449 (0.0008) [2023-12-27 21:12:29,634][106226] Updated weights for policy 0, policy_version 275459 (0.0008) [2023-12-27 21:12:30,173][106225] Updated weights for policy 1, policy_version 275879 (0.0006) [2023-12-27 21:12:30,227][106225] Updated weights for policy 1, policy_version 275889 (0.0006) [2023-12-27 21:12:30,285][106225] Updated weights for policy 1, policy_version 275899 (0.0006) [2023-12-27 21:12:30,378][106226] Updated weights for policy 0, policy_version 275469 (0.0008) [2023-12-27 21:12:30,434][106226] Updated weights for policy 0, policy_version 275479 (0.0009) [2023-12-27 21:12:30,487][106226] Updated weights for policy 0, policy_version 275489 (0.0009) [2023-12-27 21:12:30,950][106225] Updated weights for policy 1, policy_version 275909 (0.0006) [2023-12-27 21:12:31,003][106225] Updated weights for policy 1, policy_version 275919 (0.0007) [2023-12-27 21:12:31,062][106225] Updated weights for policy 1, policy_version 275929 (0.0008) [2023-12-27 21:12:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 141205504. Throughput: 0: 9781.6, 1: 9840.2. Samples: 141193492. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:31,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.629')] [2023-12-27 21:12:31,287][106226] Updated weights for policy 0, policy_version 275499 (0.0008) [2023-12-27 21:12:31,352][106226] Updated weights for policy 0, policy_version 275509 (0.0007) [2023-12-27 21:12:31,423][106226] Updated weights for policy 0, policy_version 275519 (0.0008) [2023-12-27 21:12:31,813][106225] Updated weights for policy 1, policy_version 275939 (0.0008) [2023-12-27 21:12:31,873][106225] Updated weights for policy 1, policy_version 275949 (0.0007) [2023-12-27 21:12:31,928][106225] Updated weights for policy 1, policy_version 275959 (0.0009) [2023-12-27 21:12:32,124][106226] Updated weights for policy 0, policy_version 275529 (0.0008) [2023-12-27 21:12:32,178][106226] Updated weights for policy 0, policy_version 275539 (0.0009) [2023-12-27 21:12:32,235][106226] Updated weights for policy 0, policy_version 275549 (0.0009) [2023-12-27 21:12:32,299][106226] Updated weights for policy 0, policy_version 275559 (0.0006) [2023-12-27 21:12:32,668][106225] Updated weights for policy 1, policy_version 275969 (0.0009) [2023-12-27 21:12:32,728][106225] Updated weights for policy 1, policy_version 275979 (0.0008) [2023-12-27 21:12:32,787][106225] Updated weights for policy 1, policy_version 275989 (0.0006) [2023-12-27 21:12:32,853][106225] Updated weights for policy 1, policy_version 275999 (0.0005) [2023-12-27 21:12:32,974][106226] Updated weights for policy 0, policy_version 275569 (0.0008) [2023-12-27 21:12:33,039][106226] Updated weights for policy 0, policy_version 275579 (0.0009) [2023-12-27 21:12:33,104][106226] Updated weights for policy 0, policy_version 275589 (0.0008) [2023-12-27 21:12:33,439][106225] Updated weights for policy 1, policy_version 276009 (0.0009) [2023-12-27 21:12:33,482][106225] Updated weights for policy 1, policy_version 276019 (0.0010) [2023-12-27 21:12:33,542][106225] Updated weights for policy 1, policy_version 276029 (0.0010) [2023-12-27 21:12:33,836][106226] Updated weights for policy 0, policy_version 275599 (0.0006) [2023-12-27 21:12:33,896][106226] Updated weights for policy 0, policy_version 275609 (0.0005) [2023-12-27 21:12:33,959][106226] Updated weights for policy 0, policy_version 275619 (0.0005) [2023-12-27 21:12:34,219][106225] Updated weights for policy 1, policy_version 276039 (0.0009) [2023-12-27 21:12:34,278][106225] Updated weights for policy 1, policy_version 276049 (0.0008) [2023-12-27 21:12:34,333][106225] Updated weights for policy 1, policy_version 276059 (0.0008) [2023-12-27 21:12:34,601][106226] Updated weights for policy 0, policy_version 275629 (0.0007) [2023-12-27 21:12:34,661][106226] Updated weights for policy 0, policy_version 275639 (0.0008) [2023-12-27 21:12:34,713][106226] Updated weights for policy 0, policy_version 275649 (0.0009) [2023-12-27 21:12:35,070][106225] Updated weights for policy 1, policy_version 276069 (0.0007) [2023-12-27 21:12:35,126][106225] Updated weights for policy 1, policy_version 276079 (0.0005) [2023-12-27 21:12:35,176][106225] Updated weights for policy 1, policy_version 276089 (0.0005) [2023-12-27 21:12:35,430][106226] Updated weights for policy 0, policy_version 275659 (0.0009) [2023-12-27 21:12:35,481][106226] Updated weights for policy 0, policy_version 275669 (0.0010) [2023-12-27 21:12:35,532][106226] Updated weights for policy 0, policy_version 275679 (0.0009) [2023-12-27 21:12:35,690][106225] Updated weights for policy 1, policy_version 276099 (0.0005) [2023-12-27 21:12:35,752][106225] Updated weights for policy 1, policy_version 276109 (0.0005) [2023-12-27 21:12:35,800][106225] Updated weights for policy 1, policy_version 276119 (0.0005) [2023-12-27 21:12:36,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 141303808. Throughput: 0: 9801.1, 1: 9882.0. Samples: 141313352. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:36,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.759')] [2023-12-27 21:12:36,359][106226] Updated weights for policy 0, policy_version 275689 (0.0009) [2023-12-27 21:12:36,408][106226] Updated weights for policy 0, policy_version 275699 (0.0009) [2023-12-27 21:12:36,417][106225] Updated weights for policy 1, policy_version 276129 (0.0006) [2023-12-27 21:12:36,430][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000006 [2023-12-27 21:12:36,477][106225] Updated weights for policy 1, policy_version 276139 (0.0008) [2023-12-27 21:12:36,536][106225] Updated weights for policy 1, policy_version 276149 (0.0008) [2023-12-27 21:12:36,597][106225] Updated weights for policy 1, policy_version 276159 (0.0009) [2023-12-27 21:12:37,216][106226] Updated weights for policy 0, policy_version 275709 (0.0008) [2023-12-27 21:12:37,272][106226] Updated weights for policy 0, policy_version 275719 (0.0009) [2023-12-27 21:12:37,315][106225] Updated weights for policy 1, policy_version 276169 (0.0007) [2023-12-27 21:12:37,318][106226] Updated weights for policy 0, policy_version 275729 (0.0007) [2023-12-27 21:12:37,374][106225] Updated weights for policy 1, policy_version 276179 (0.0009) [2023-12-27 21:12:37,441][106225] Updated weights for policy 1, policy_version 276189 (0.0008) [2023-12-27 21:12:38,063][106225] Updated weights for policy 1, policy_version 276199 (0.0009) [2023-12-27 21:12:38,083][106226] Updated weights for policy 0, policy_version 275739 (0.0007) [2023-12-27 21:12:38,120][106225] Updated weights for policy 1, policy_version 276209 (0.0006) [2023-12-27 21:12:38,146][106226] Updated weights for policy 0, policy_version 275749 (0.0008) [2023-12-27 21:12:38,178][106225] Updated weights for policy 1, policy_version 276219 (0.0005) [2023-12-27 21:12:38,204][106226] Updated weights for policy 0, policy_version 275759 (0.0008) [2023-12-27 21:12:38,837][106225] Updated weights for policy 1, policy_version 276229 (0.0005) [2023-12-27 21:12:38,869][106226] Updated weights for policy 0, policy_version 275769 (0.0008) [2023-12-27 21:12:38,902][106225] Updated weights for policy 1, policy_version 276239 (0.0006) [2023-12-27 21:12:38,933][106226] Updated weights for policy 0, policy_version 275779 (0.0008) [2023-12-27 21:12:38,957][106225] Updated weights for policy 1, policy_version 276249 (0.0006) [2023-12-27 21:12:38,995][106226] Updated weights for policy 0, policy_version 275789 (0.0005) [2023-12-27 21:12:39,061][106226] Updated weights for policy 0, policy_version 275799 (0.0007) [2023-12-27 21:12:39,667][106225] Updated weights for policy 1, policy_version 276259 (0.0008) [2023-12-27 21:12:39,727][106225] Updated weights for policy 1, policy_version 276269 (0.0009) [2023-12-27 21:12:39,790][106225] Updated weights for policy 1, policy_version 276279 (0.0009) [2023-12-27 21:12:39,840][106226] Updated weights for policy 0, policy_version 275809 (0.0008) [2023-12-27 21:12:39,913][106226] Updated weights for policy 0, policy_version 275819 (0.0010) [2023-12-27 21:12:39,978][106226] Updated weights for policy 0, policy_version 275829 (0.0009) [2023-12-27 21:12:40,594][106225] Updated weights for policy 1, policy_version 276289 (0.0007) [2023-12-27 21:12:40,658][106225] Updated weights for policy 1, policy_version 276299 (0.0006) [2023-12-27 21:12:40,720][106225] Updated weights for policy 1, policy_version 276309 (0.0008) [2023-12-27 21:12:40,741][106226] Updated weights for policy 0, policy_version 275839 (0.0010) [2023-12-27 21:12:40,775][106225] Updated weights for policy 1, policy_version 276319 (0.0006) [2023-12-27 21:12:40,794][106226] Updated weights for policy 0, policy_version 275849 (0.0007) [2023-12-27 21:12:40,857][106226] Updated weights for policy 0, policy_version 275859 (0.0008) [2023-12-27 21:12:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 141402112. Throughput: 0: 9840.2, 1: 9903.4. Samples: 141373912. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:41,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.760')] [2023-12-27 21:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000275864_70647808.pth... [2023-12-27 21:12:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000276320_70754304.pth... [2023-12-27 21:12:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000274728_70352896.pth [2023-12-27 21:12:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000275168_70459392.pth [2023-12-27 21:12:41,526][106225] Updated weights for policy 1, policy_version 276329 (0.0008) [2023-12-27 21:12:41,586][106225] Updated weights for policy 1, policy_version 276339 (0.0008) [2023-12-27 21:12:41,639][106226] Updated weights for policy 0, policy_version 275869 (0.0009) [2023-12-27 21:12:41,654][106225] Updated weights for policy 1, policy_version 276349 (0.0008) [2023-12-27 21:12:41,704][106226] Updated weights for policy 0, policy_version 275879 (0.0008) [2023-12-27 21:12:41,767][106226] Updated weights for policy 0, policy_version 275889 (0.0008) [2023-12-27 21:12:42,390][106225] Updated weights for policy 1, policy_version 276359 (0.0008) [2023-12-27 21:12:42,445][106225] Updated weights for policy 1, policy_version 276369 (0.0008) [2023-12-27 21:12:42,508][106225] Updated weights for policy 1, policy_version 276379 (0.0008) [2023-12-27 21:12:42,578][106226] Updated weights for policy 0, policy_version 275899 (0.0008) [2023-12-27 21:12:42,633][106226] Updated weights for policy 0, policy_version 275909 (0.0008) [2023-12-27 21:12:42,685][106226] Updated weights for policy 0, policy_version 275919 (0.0008) [2023-12-27 21:12:43,191][106225] Updated weights for policy 1, policy_version 276389 (0.0008) [2023-12-27 21:12:43,250][106225] Updated weights for policy 1, policy_version 276399 (0.0008) [2023-12-27 21:12:43,306][106225] Updated weights for policy 1, policy_version 276409 (0.0006) [2023-12-27 21:12:43,477][106226] Updated weights for policy 0, policy_version 275929 (0.0009) [2023-12-27 21:12:43,530][106226] Updated weights for policy 0, policy_version 275939 (0.0008) [2023-12-27 21:12:43,591][106226] Updated weights for policy 0, policy_version 275949 (0.0009) [2023-12-27 21:12:43,640][106226] Updated weights for policy 0, policy_version 275959 (0.0008) [2023-12-27 21:12:43,867][106225] Updated weights for policy 1, policy_version 276419 (0.0007) [2023-12-27 21:12:43,924][106225] Updated weights for policy 1, policy_version 276429 (0.0010) [2023-12-27 21:12:43,985][106225] Updated weights for policy 1, policy_version 276439 (0.0010) [2023-12-27 21:12:44,392][106226] Updated weights for policy 0, policy_version 275969 (0.0007) [2023-12-27 21:12:44,450][106226] Updated weights for policy 0, policy_version 275979 (0.0006) [2023-12-27 21:12:44,511][106226] Updated weights for policy 0, policy_version 275989 (0.0005) [2023-12-27 21:12:44,699][106225] Updated weights for policy 1, policy_version 276449 (0.0008) [2023-12-27 21:12:44,750][106225] Updated weights for policy 1, policy_version 276459 (0.0010) [2023-12-27 21:12:44,818][106225] Updated weights for policy 1, policy_version 276469 (0.0009) [2023-12-27 21:12:44,890][106225] Updated weights for policy 1, policy_version 276479 (0.0011) [2023-12-27 21:12:45,144][106226] Updated weights for policy 0, policy_version 275999 (0.0007) [2023-12-27 21:12:45,201][106226] Updated weights for policy 0, policy_version 276009 (0.0008) [2023-12-27 21:12:45,260][106226] Updated weights for policy 0, policy_version 276019 (0.0008) [2023-12-27 21:12:45,598][106225] Updated weights for policy 1, policy_version 276489 (0.0010) [2023-12-27 21:12:45,644][106225] Updated weights for policy 1, policy_version 276499 (0.0010) [2023-12-27 21:12:45,691][106225] Updated weights for policy 1, policy_version 276509 (0.0010) [2023-12-27 21:12:45,981][106226] Updated weights for policy 0, policy_version 276029 (0.0007) [2023-12-27 21:12:46,035][106226] Updated weights for policy 0, policy_version 276039 (0.0005) [2023-12-27 21:12:46,100][106226] Updated weights for policy 0, policy_version 276049 (0.0006) [2023-12-27 21:12:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 141500416. Throughput: 0: 9754.1, 1: 9858.1. Samples: 141488376. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:46,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.980')] [2023-12-27 21:12:46,387][106225] Updated weights for policy 1, policy_version 276519 (0.0010) [2023-12-27 21:12:46,440][106225] Updated weights for policy 1, policy_version 276529 (0.0010) [2023-12-27 21:12:46,494][106225] Updated weights for policy 1, policy_version 276539 (0.0010) [2023-12-27 21:12:46,635][106226] Updated weights for policy 0, policy_version 276059 (0.0005) [2023-12-27 21:12:46,681][106226] Updated weights for policy 0, policy_version 276069 (0.0005) [2023-12-27 21:12:46,734][106226] Updated weights for policy 0, policy_version 276079 (0.0005) [2023-12-27 21:12:47,171][106225] Updated weights for policy 1, policy_version 276549 (0.0011) [2023-12-27 21:12:47,229][106225] Updated weights for policy 1, policy_version 276559 (0.0011) [2023-12-27 21:12:47,290][106225] Updated weights for policy 1, policy_version 276569 (0.0010) [2023-12-27 21:12:47,395][106226] Updated weights for policy 0, policy_version 276089 (0.0007) [2023-12-27 21:12:47,454][106226] Updated weights for policy 0, policy_version 276099 (0.0005) [2023-12-27 21:12:47,505][106226] Updated weights for policy 0, policy_version 276109 (0.0005) [2023-12-27 21:12:47,569][106226] Updated weights for policy 0, policy_version 276119 (0.0005) [2023-12-27 21:12:47,868][106225] Updated weights for policy 1, policy_version 276579 (0.0010) [2023-12-27 21:12:47,921][106225] Updated weights for policy 1, policy_version 276589 (0.0010) [2023-12-27 21:12:47,977][106225] Updated weights for policy 1, policy_version 276599 (0.0010) [2023-12-27 21:12:48,190][106226] Updated weights for policy 0, policy_version 276129 (0.0008) [2023-12-27 21:12:48,246][106226] Updated weights for policy 0, policy_version 276139 (0.0008) [2023-12-27 21:12:48,302][106226] Updated weights for policy 0, policy_version 276149 (0.0008) [2023-12-27 21:12:48,693][106225] Updated weights for policy 1, policy_version 276609 (0.0010) [2023-12-27 21:12:48,750][106225] Updated weights for policy 1, policy_version 276619 (0.0009) [2023-12-27 21:12:48,809][106225] Updated weights for policy 1, policy_version 276629 (0.0008) [2023-12-27 21:12:48,873][106225] Updated weights for policy 1, policy_version 276639 (0.0008) [2023-12-27 21:12:49,054][106226] Updated weights for policy 0, policy_version 276159 (0.0009) [2023-12-27 21:12:49,105][106226] Updated weights for policy 0, policy_version 276169 (0.0010) [2023-12-27 21:12:49,160][106226] Updated weights for policy 0, policy_version 276180 (0.0009) [2023-12-27 21:12:49,584][106225] Updated weights for policy 1, policy_version 276649 (0.0010) [2023-12-27 21:12:49,641][106225] Updated weights for policy 1, policy_version 276659 (0.0010) [2023-12-27 21:12:49,695][106225] Updated weights for policy 1, policy_version 276669 (0.0010) [2023-12-27 21:12:49,946][106226] Updated weights for policy 0, policy_version 276190 (0.0009) [2023-12-27 21:12:50,015][106226] Updated weights for policy 0, policy_version 276200 (0.0009) [2023-12-27 21:12:50,085][106226] Updated weights for policy 0, policy_version 276210 (0.0009) [2023-12-27 21:12:50,421][106225] Updated weights for policy 1, policy_version 276679 (0.0009) [2023-12-27 21:12:50,478][106225] Updated weights for policy 1, policy_version 276689 (0.0008) [2023-12-27 21:12:50,537][106225] Updated weights for policy 1, policy_version 276699 (0.0008) [2023-12-27 21:12:50,833][106226] Updated weights for policy 0, policy_version 276220 (0.0008) [2023-12-27 21:12:50,898][106226] Updated weights for policy 0, policy_version 276230 (0.0009) [2023-12-27 21:12:50,958][106226] Updated weights for policy 0, policy_version 276240 (0.0008) [2023-12-27 21:12:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 141598720. Throughput: 0: 9755.6, 1: 9847.2. Samples: 141607916. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:51,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-5.890')] [2023-12-27 21:12:51,316][106225] Updated weights for policy 1, policy_version 276709 (0.0008) [2023-12-27 21:12:51,386][106225] Updated weights for policy 1, policy_version 276719 (0.0008) [2023-12-27 21:12:51,452][106225] Updated weights for policy 1, policy_version 276729 (0.0007) [2023-12-27 21:12:51,739][106226] Updated weights for policy 0, policy_version 276250 (0.0007) [2023-12-27 21:12:51,798][106226] Updated weights for policy 0, policy_version 276260 (0.0008) [2023-12-27 21:12:51,849][106226] Updated weights for policy 0, policy_version 276270 (0.0008) [2023-12-27 21:12:51,906][106226] Updated weights for policy 0, policy_version 276280 (0.0007) [2023-12-27 21:12:52,203][106225] Updated weights for policy 1, policy_version 276739 (0.0007) [2023-12-27 21:12:52,259][106225] Updated weights for policy 1, policy_version 276749 (0.0009) [2023-12-27 21:12:52,324][106225] Updated weights for policy 1, policy_version 276759 (0.0009) [2023-12-27 21:12:52,621][106226] Updated weights for policy 0, policy_version 276290 (0.0008) [2023-12-27 21:12:52,678][106226] Updated weights for policy 0, policy_version 276300 (0.0007) [2023-12-27 21:12:52,743][106226] Updated weights for policy 0, policy_version 276310 (0.0006) [2023-12-27 21:12:53,064][106225] Updated weights for policy 1, policy_version 276769 (0.0008) [2023-12-27 21:12:53,118][106225] Updated weights for policy 1, policy_version 276779 (0.0006) [2023-12-27 21:12:53,173][106225] Updated weights for policy 1, policy_version 276789 (0.0006) [2023-12-27 21:12:53,222][106225] Updated weights for policy 1, policy_version 276799 (0.0007) [2023-12-27 21:12:53,301][106226] Updated weights for policy 0, policy_version 276320 (0.0006) [2023-12-27 21:12:53,345][106226] Updated weights for policy 0, policy_version 276330 (0.0005) [2023-12-27 21:12:53,391][106226] Updated weights for policy 0, policy_version 276340 (0.0008) [2023-12-27 21:12:53,957][106225] Updated weights for policy 1, policy_version 276809 (0.0007) [2023-12-27 21:12:54,014][106225] Updated weights for policy 1, policy_version 276819 (0.0009) [2023-12-27 21:12:54,077][106225] Updated weights for policy 1, policy_version 276829 (0.0007) [2023-12-27 21:12:54,086][106226] Updated weights for policy 0, policy_version 276350 (0.0008) [2023-12-27 21:12:54,140][106226] Updated weights for policy 0, policy_version 276360 (0.0008) [2023-12-27 21:12:54,195][106226] Updated weights for policy 0, policy_version 276370 (0.0009) [2023-12-27 21:12:54,739][106225] Updated weights for policy 1, policy_version 276839 (0.0008) [2023-12-27 21:12:54,804][106225] Updated weights for policy 1, policy_version 276849 (0.0008) [2023-12-27 21:12:54,870][106225] Updated weights for policy 1, policy_version 276859 (0.0009) [2023-12-27 21:12:54,959][106226] Updated weights for policy 0, policy_version 276380 (0.0010) [2023-12-27 21:12:55,026][106226] Updated weights for policy 0, policy_version 276390 (0.0007) [2023-12-27 21:12:55,075][106226] Updated weights for policy 0, policy_version 276400 (0.0005) [2023-12-27 21:12:55,529][106225] Updated weights for policy 1, policy_version 276869 (0.0008) [2023-12-27 21:12:55,591][106225] Updated weights for policy 1, policy_version 276879 (0.0009) [2023-12-27 21:12:55,651][106225] Updated weights for policy 1, policy_version 276889 (0.0008) [2023-12-27 21:12:55,658][106226] Updated weights for policy 0, policy_version 276410 (0.0005) [2023-12-27 21:12:55,710][106226] Updated weights for policy 0, policy_version 276420 (0.0007) [2023-12-27 21:12:55,762][106226] Updated weights for policy 0, policy_version 276430 (0.0008) [2023-12-27 21:12:55,816][106226] Updated weights for policy 0, policy_version 276440 (0.0008) [2023-12-27 21:12:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 141697024. Throughput: 0: 9788.9, 1: 9777.9. Samples: 141666928. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:12:56,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.532')] [2023-12-27 21:12:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000276440_70795264.pth... [2023-12-27 21:12:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000276896_70901760.pth... [2023-12-27 21:12:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000275744_70606848.pth [2023-12-27 21:12:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000275304_70500352.pth [2023-12-27 21:12:56,288][106225] Updated weights for policy 1, policy_version 276899 (0.0008) [2023-12-27 21:12:56,347][106225] Updated weights for policy 1, policy_version 276909 (0.0005) [2023-12-27 21:12:56,409][106225] Updated weights for policy 1, policy_version 276919 (0.0005) [2023-12-27 21:12:56,479][106226] Updated weights for policy 0, policy_version 276450 (0.0005) [2023-12-27 21:12:56,542][106226] Updated weights for policy 0, policy_version 276460 (0.0005) [2023-12-27 21:12:56,596][106226] Updated weights for policy 0, policy_version 276470 (0.0005) [2023-12-27 21:12:56,977][106225] Updated weights for policy 1, policy_version 276929 (0.0005) [2023-12-27 21:12:57,030][106225] Updated weights for policy 1, policy_version 276939 (0.0005) [2023-12-27 21:12:57,086][106225] Updated weights for policy 1, policy_version 276949 (0.0005) [2023-12-27 21:12:57,138][106225] Updated weights for policy 1, policy_version 276959 (0.0005) [2023-12-27 21:12:57,173][106226] Updated weights for policy 0, policy_version 276480 (0.0007) [2023-12-27 21:12:57,216][106226] Updated weights for policy 0, policy_version 276490 (0.0008) [2023-12-27 21:12:57,269][106226] Updated weights for policy 0, policy_version 276500 (0.0008) [2023-12-27 21:12:57,765][106225] Updated weights for policy 1, policy_version 276969 (0.0010) [2023-12-27 21:12:57,815][106225] Updated weights for policy 1, policy_version 276979 (0.0010) [2023-12-27 21:12:57,865][106225] Updated weights for policy 1, policy_version 276989 (0.0010) [2023-12-27 21:12:57,910][106226] Updated weights for policy 0, policy_version 276510 (0.0009) [2023-12-27 21:12:57,962][106226] Updated weights for policy 0, policy_version 276520 (0.0010) [2023-12-27 21:12:58,027][106226] Updated weights for policy 0, policy_version 276530 (0.0010) [2023-12-27 21:12:58,615][106225] Updated weights for policy 1, policy_version 276999 (0.0009) [2023-12-27 21:12:58,676][106225] Updated weights for policy 1, policy_version 277009 (0.0009) [2023-12-27 21:12:58,744][106225] Updated weights for policy 1, policy_version 277019 (0.0009) [2023-12-27 21:12:58,791][106226] Updated weights for policy 0, policy_version 276540 (0.0009) [2023-12-27 21:12:58,859][106226] Updated weights for policy 0, policy_version 276550 (0.0009) [2023-12-27 21:12:58,924][106226] Updated weights for policy 0, policy_version 276560 (0.0010) [2023-12-27 21:12:59,527][106225] Updated weights for policy 1, policy_version 277029 (0.0009) [2023-12-27 21:12:59,573][106225] Updated weights for policy 1, policy_version 277039 (0.0010) [2023-12-27 21:12:59,620][106225] Updated weights for policy 1, policy_version 277049 (0.0010) [2023-12-27 21:12:59,660][106226] Updated weights for policy 0, policy_version 276570 (0.0009) [2023-12-27 21:12:59,711][106226] Updated weights for policy 0, policy_version 276580 (0.0008) [2023-12-27 21:12:59,762][106226] Updated weights for policy 0, policy_version 276590 (0.0008) [2023-12-27 21:12:59,819][106226] Updated weights for policy 0, policy_version 276600 (0.0008) [2023-12-27 21:13:00,338][106225] Updated weights for policy 1, policy_version 277059 (0.0009) [2023-12-27 21:13:00,402][106225] Updated weights for policy 1, policy_version 277069 (0.0011) [2023-12-27 21:13:00,458][106225] Updated weights for policy 1, policy_version 277079 (0.0010) [2023-12-27 21:13:00,544][106226] Updated weights for policy 0, policy_version 276610 (0.0005) [2023-12-27 21:13:00,602][106226] Updated weights for policy 0, policy_version 276620 (0.0006) [2023-12-27 21:13:00,654][106226] Updated weights for policy 0, policy_version 276630 (0.0008) [2023-12-27 21:13:01,014][106225] Updated weights for policy 1, policy_version 277089 (0.0010) [2023-12-27 21:13:01,078][106225] Updated weights for policy 1, policy_version 277099 (0.0006) [2023-12-27 21:13:01,154][106225] Updated weights for policy 1, policy_version 277109 (0.0007) [2023-12-27 21:13:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 141795328. Throughput: 0: 9820.8, 1: 9842.9. Samples: 141787992. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:13:01,175][105115] Avg episode reward: [(0, '-4.737'), (1, '-5.927')] [2023-12-27 21:13:01,215][106225] Updated weights for policy 1, policy_version 277119 (0.0006) [2023-12-27 21:13:01,431][106226] Updated weights for policy 0, policy_version 276640 (0.0006) [2023-12-27 21:13:01,485][106226] Updated weights for policy 0, policy_version 276650 (0.0005) [2023-12-27 21:13:01,546][106226] Updated weights for policy 0, policy_version 276660 (0.0009) [2023-12-27 21:13:01,912][106225] Updated weights for policy 1, policy_version 277129 (0.0009) [2023-12-27 21:13:01,969][106225] Updated weights for policy 1, policy_version 277139 (0.0007) [2023-12-27 21:13:02,033][106225] Updated weights for policy 1, policy_version 277149 (0.0010) [2023-12-27 21:13:02,208][106226] Updated weights for policy 0, policy_version 276670 (0.0008) [2023-12-27 21:13:02,269][106226] Updated weights for policy 0, policy_version 276680 (0.0008) [2023-12-27 21:13:02,329][106226] Updated weights for policy 0, policy_version 276690 (0.0007) [2023-12-27 21:13:02,737][106225] Updated weights for policy 1, policy_version 277159 (0.0009) [2023-12-27 21:13:02,791][106225] Updated weights for policy 1, policy_version 277169 (0.0010) [2023-12-27 21:13:02,854][106225] Updated weights for policy 1, policy_version 277179 (0.0010) [2023-12-27 21:13:02,939][106226] Updated weights for policy 0, policy_version 276700 (0.0009) [2023-12-27 21:13:02,993][106226] Updated weights for policy 0, policy_version 276710 (0.0005) [2023-12-27 21:13:03,041][106226] Updated weights for policy 0, policy_version 276720 (0.0007) [2023-12-27 21:13:03,448][106225] Updated weights for policy 1, policy_version 277189 (0.0008) [2023-12-27 21:13:03,507][106225] Updated weights for policy 1, policy_version 277199 (0.0005) [2023-12-27 21:13:03,567][106225] Updated weights for policy 1, policy_version 277209 (0.0005) [2023-12-27 21:13:03,701][106226] Updated weights for policy 0, policy_version 276730 (0.0007) [2023-12-27 21:13:03,753][106226] Updated weights for policy 0, policy_version 276741 (0.0009) [2023-12-27 21:13:03,801][106226] Updated weights for policy 0, policy_version 276751 (0.0006) [2023-12-27 21:13:04,109][106225] Updated weights for policy 1, policy_version 277219 (0.0005) [2023-12-27 21:13:04,169][106225] Updated weights for policy 1, policy_version 277229 (0.0010) [2023-12-27 21:13:04,240][106225] Updated weights for policy 1, policy_version 277239 (0.0009) [2023-12-27 21:13:04,522][106226] Updated weights for policy 0, policy_version 276761 (0.0007) [2023-12-27 21:13:04,575][106226] Updated weights for policy 0, policy_version 276771 (0.0009) [2023-12-27 21:13:04,635][106226] Updated weights for policy 0, policy_version 276781 (0.0009) [2023-12-27 21:13:04,692][106226] Updated weights for policy 0, policy_version 276791 (0.0008) [2023-12-27 21:13:04,902][106225] Updated weights for policy 1, policy_version 277249 (0.0009) [2023-12-27 21:13:04,958][106225] Updated weights for policy 1, policy_version 277259 (0.0008) [2023-12-27 21:13:05,016][106225] Updated weights for policy 1, policy_version 277269 (0.0008) [2023-12-27 21:13:05,073][106225] Updated weights for policy 1, policy_version 277280 (0.0009) [2023-12-27 21:13:05,280][106226] Updated weights for policy 0, policy_version 276801 (0.0010) [2023-12-27 21:13:05,340][106226] Updated weights for policy 0, policy_version 276811 (0.0011) [2023-12-27 21:13:05,406][106226] Updated weights for policy 0, policy_version 276821 (0.0011) [2023-12-27 21:13:05,876][106225] Updated weights for policy 1, policy_version 277290 (0.0009) [2023-12-27 21:13:05,936][106225] Updated weights for policy 1, policy_version 277300 (0.0008) [2023-12-27 21:13:05,993][106226] Updated weights for policy 0, policy_version 276831 (0.0011) [2023-12-27 21:13:05,995][106225] Updated weights for policy 1, policy_version 277310 (0.0006) [2023-12-27 21:13:06,044][106226] Updated weights for policy 0, policy_version 276841 (0.0010) [2023-12-27 21:13:06,111][106226] Updated weights for policy 0, policy_version 276851 (0.0010) [2023-12-27 21:13:06,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 141910016. Throughput: 0: 9920.5, 1: 9974.8. Samples: 141913176. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:13:06,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-5.809')] [2023-12-27 21:13:06,728][106225] Updated weights for policy 1, policy_version 277320 (0.0008) [2023-12-27 21:13:06,780][106225] Updated weights for policy 1, policy_version 277330 (0.0008) [2023-12-27 21:13:06,840][106225] Updated weights for policy 1, policy_version 277340 (0.0008) [2023-12-27 21:13:06,859][106226] Updated weights for policy 0, policy_version 276861 (0.0009) [2023-12-27 21:13:06,916][106226] Updated weights for policy 0, policy_version 276871 (0.0009) [2023-12-27 21:13:06,978][106226] Updated weights for policy 0, policy_version 276881 (0.0010) [2023-12-27 21:13:07,483][106225] Updated weights for policy 1, policy_version 277350 (0.0009) [2023-12-27 21:13:07,531][106225] Updated weights for policy 1, policy_version 277360 (0.0008) [2023-12-27 21:13:07,578][106225] Updated weights for policy 1, policy_version 277370 (0.0008) [2023-12-27 21:13:07,741][106226] Updated weights for policy 0, policy_version 276891 (0.0009) [2023-12-27 21:13:07,791][106226] Updated weights for policy 0, policy_version 276901 (0.0009) [2023-12-27 21:13:07,842][106226] Updated weights for policy 0, policy_version 276911 (0.0009) [2023-12-27 21:13:08,218][106225] Updated weights for policy 1, policy_version 277380 (0.0008) [2023-12-27 21:13:08,280][106225] Updated weights for policy 1, policy_version 277390 (0.0007) [2023-12-27 21:13:08,346][106225] Updated weights for policy 1, policy_version 277400 (0.0007) [2023-12-27 21:13:08,697][106226] Updated weights for policy 0, policy_version 276921 (0.0008) [2023-12-27 21:13:08,761][106226] Updated weights for policy 0, policy_version 276931 (0.0006) [2023-12-27 21:13:08,826][106226] Updated weights for policy 0, policy_version 276941 (0.0008) [2023-12-27 21:13:08,889][106226] Updated weights for policy 0, policy_version 276951 (0.0008) [2023-12-27 21:13:09,023][106225] Updated weights for policy 1, policy_version 277410 (0.0007) [2023-12-27 21:13:09,087][106225] Updated weights for policy 1, policy_version 277420 (0.0006) [2023-12-27 21:13:09,156][106225] Updated weights for policy 1, policy_version 277430 (0.0006) [2023-12-27 21:13:09,215][106225] Updated weights for policy 1, policy_version 277440 (0.0006) [2023-12-27 21:13:09,624][106226] Updated weights for policy 0, policy_version 276961 (0.0006) [2023-12-27 21:13:09,685][106226] Updated weights for policy 0, policy_version 276971 (0.0006) [2023-12-27 21:13:09,741][106226] Updated weights for policy 0, policy_version 276981 (0.0007) [2023-12-27 21:13:09,935][106225] Updated weights for policy 1, policy_version 277450 (0.0009) [2023-12-27 21:13:10,000][106225] Updated weights for policy 1, policy_version 277460 (0.0008) [2023-12-27 21:13:10,062][106225] Updated weights for policy 1, policy_version 277470 (0.0009) [2023-12-27 21:13:10,545][106226] Updated weights for policy 0, policy_version 276991 (0.0008) [2023-12-27 21:13:10,604][106226] Updated weights for policy 0, policy_version 277001 (0.0009) [2023-12-27 21:13:10,665][106226] Updated weights for policy 0, policy_version 277011 (0.0008) [2023-12-27 21:13:10,778][106225] Updated weights for policy 1, policy_version 277480 (0.0009) [2023-12-27 21:13:10,838][106225] Updated weights for policy 1, policy_version 277490 (0.0007) [2023-12-27 21:13:10,900][106225] Updated weights for policy 1, policy_version 277500 (0.0007) [2023-12-27 21:13:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 142000128. Throughput: 0: 9872.1, 1: 10012.1. Samples: 141970444. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:13:11,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.914')] [2023-12-27 21:13:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000277504_71057408.pth... [2023-12-27 21:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000277016_70942720.pth... [2023-12-27 21:13:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000276320_70754304.pth [2023-12-27 21:13:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000275864_70647808.pth [2023-12-27 21:13:11,419][106226] Updated weights for policy 0, policy_version 277021 (0.0009) [2023-12-27 21:13:11,481][106226] Updated weights for policy 0, policy_version 277031 (0.0010) [2023-12-27 21:13:11,548][106226] Updated weights for policy 0, policy_version 277041 (0.0010) [2023-12-27 21:13:11,629][106225] Updated weights for policy 1, policy_version 277510 (0.0009) [2023-12-27 21:13:11,694][106225] Updated weights for policy 1, policy_version 277520 (0.0008) [2023-12-27 21:13:11,769][106225] Updated weights for policy 1, policy_version 277530 (0.0008) [2023-12-27 21:13:12,340][106226] Updated weights for policy 0, policy_version 277051 (0.0009) [2023-12-27 21:13:12,410][106226] Updated weights for policy 0, policy_version 277061 (0.0008) [2023-12-27 21:13:12,461][106225] Updated weights for policy 1, policy_version 277540 (0.0008) [2023-12-27 21:13:12,477][106226] Updated weights for policy 0, policy_version 277071 (0.0008) [2023-12-27 21:13:12,523][106225] Updated weights for policy 1, policy_version 277550 (0.0008) [2023-12-27 21:13:12,579][106225] Updated weights for policy 1, policy_version 277560 (0.0008) [2023-12-27 21:13:13,143][106226] Updated weights for policy 0, policy_version 277081 (0.0006) [2023-12-27 21:13:13,196][106226] Updated weights for policy 0, policy_version 277091 (0.0010) [2023-12-27 21:13:13,259][106226] Updated weights for policy 0, policy_version 277101 (0.0010) [2023-12-27 21:13:13,308][106225] Updated weights for policy 1, policy_version 277570 (0.0008) [2023-12-27 21:13:13,320][106226] Updated weights for policy 0, policy_version 277111 (0.0011) [2023-12-27 21:13:13,363][106225] Updated weights for policy 1, policy_version 277580 (0.0008) [2023-12-27 21:13:13,414][106225] Updated weights for policy 1, policy_version 277590 (0.0008) [2023-12-27 21:13:13,463][106225] Updated weights for policy 1, policy_version 277600 (0.0007) [2023-12-27 21:13:14,034][106226] Updated weights for policy 0, policy_version 277121 (0.0010) [2023-12-27 21:13:14,094][106226] Updated weights for policy 0, policy_version 277131 (0.0010) [2023-12-27 21:13:14,148][106226] Updated weights for policy 0, policy_version 277141 (0.0011) [2023-12-27 21:13:14,228][106225] Updated weights for policy 1, policy_version 277610 (0.0008) [2023-12-27 21:13:14,288][106225] Updated weights for policy 1, policy_version 277620 (0.0008) [2023-12-27 21:13:14,339][106225] Updated weights for policy 1, policy_version 277630 (0.0008) [2023-12-27 21:13:14,879][106226] Updated weights for policy 0, policy_version 277151 (0.0011) [2023-12-27 21:13:14,943][106226] Updated weights for policy 0, policy_version 277161 (0.0011) [2023-12-27 21:13:15,005][106226] Updated weights for policy 0, policy_version 277171 (0.0011) [2023-12-27 21:13:15,119][106225] Updated weights for policy 1, policy_version 277640 (0.0008) [2023-12-27 21:13:15,174][106225] Updated weights for policy 1, policy_version 277650 (0.0008) [2023-12-27 21:13:15,230][106225] Updated weights for policy 1, policy_version 277660 (0.0008) [2023-12-27 21:13:15,727][106226] Updated weights for policy 0, policy_version 277181 (0.0011) [2023-12-27 21:13:15,790][106226] Updated weights for policy 0, policy_version 277191 (0.0011) [2023-12-27 21:13:15,853][106226] Updated weights for policy 0, policy_version 277201 (0.0011) [2023-12-27 21:13:15,961][106225] Updated weights for policy 1, policy_version 277670 (0.0008) [2023-12-27 21:13:16,010][106225] Updated weights for policy 1, policy_version 277680 (0.0008) [2023-12-27 21:13:16,066][106225] Updated weights for policy 1, policy_version 277690 (0.0009) [2023-12-27 21:13:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 142098432. Throughput: 0: 9734.5, 1: 10044.1. Samples: 142083528. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:13:16,175][105115] Avg episode reward: [(0, '-4.237'), (1, '-5.693')] [2023-12-27 21:13:16,176][106140] Saving new best policy, reward=-4.237! [2023-12-27 21:13:16,549][106226] Updated weights for policy 0, policy_version 277211 (0.0009) [2023-12-27 21:13:16,615][106226] Updated weights for policy 0, policy_version 277221 (0.0005) [2023-12-27 21:13:16,688][106226] Updated weights for policy 0, policy_version 277231 (0.0006) [2023-12-27 21:13:16,709][106225] Updated weights for policy 1, policy_version 277700 (0.0006) [2023-12-27 21:13:16,754][106225] Updated weights for policy 1, policy_version 277710 (0.0005) [2023-12-27 21:13:16,810][106225] Updated weights for policy 1, policy_version 277720 (0.0005) [2023-12-27 21:13:17,202][106226] Updated weights for policy 0, policy_version 277241 (0.0005) [2023-12-27 21:13:17,270][106226] Updated weights for policy 0, policy_version 277251 (0.0006) [2023-12-27 21:13:17,328][106226] Updated weights for policy 0, policy_version 277261 (0.0006) [2023-12-27 21:13:17,383][106226] Updated weights for policy 0, policy_version 277271 (0.0005) [2023-12-27 21:13:17,480][106225] Updated weights for policy 1, policy_version 277730 (0.0005) [2023-12-27 21:13:17,534][106225] Updated weights for policy 1, policy_version 277740 (0.0005) [2023-12-27 21:13:17,597][106225] Updated weights for policy 1, policy_version 277750 (0.0007) [2023-12-27 21:13:17,655][106225] Updated weights for policy 1, policy_version 277760 (0.0008) [2023-12-27 21:13:18,058][106226] Updated weights for policy 0, policy_version 277282 (0.0008) [2023-12-27 21:13:18,110][106226] Updated weights for policy 0, policy_version 277292 (0.0009) [2023-12-27 21:13:18,161][106226] Updated weights for policy 0, policy_version 277302 (0.0008) [2023-12-27 21:13:18,235][106225] Updated weights for policy 1, policy_version 277770 (0.0010) [2023-12-27 21:13:18,296][106225] Updated weights for policy 1, policy_version 277780 (0.0010) [2023-12-27 21:13:18,365][106225] Updated weights for policy 1, policy_version 277790 (0.0009) [2023-12-27 21:13:18,939][106226] Updated weights for policy 0, policy_version 277312 (0.0007) [2023-12-27 21:13:19,000][106226] Updated weights for policy 0, policy_version 277322 (0.0007) [2023-12-27 21:13:19,053][106226] Updated weights for policy 0, policy_version 277332 (0.0008) [2023-12-27 21:13:19,081][106225] Updated weights for policy 1, policy_version 277800 (0.0010) [2023-12-27 21:13:19,131][106225] Updated weights for policy 1, policy_version 277810 (0.0010) [2023-12-27 21:13:19,185][106225] Updated weights for policy 1, policy_version 277820 (0.0010) [2023-12-27 21:13:19,842][106225] Updated weights for policy 1, policy_version 277830 (0.0008) [2023-12-27 21:13:19,900][106226] Updated weights for policy 0, policy_version 277342 (0.0008) [2023-12-27 21:13:19,908][106225] Updated weights for policy 1, policy_version 277840 (0.0009) [2023-12-27 21:13:19,972][106226] Updated weights for policy 0, policy_version 277352 (0.0008) [2023-12-27 21:13:19,973][106225] Updated weights for policy 1, policy_version 277850 (0.0007) [2023-12-27 21:13:20,035][106226] Updated weights for policy 0, policy_version 277362 (0.0009) [2023-12-27 21:13:20,607][106225] Updated weights for policy 1, policy_version 277860 (0.0006) [2023-12-27 21:13:20,660][106225] Updated weights for policy 1, policy_version 277870 (0.0008) [2023-12-27 21:13:20,725][106225] Updated weights for policy 1, policy_version 277880 (0.0009) [2023-12-27 21:13:20,840][106226] Updated weights for policy 0, policy_version 277372 (0.0009) [2023-12-27 21:13:20,892][106226] Updated weights for policy 0, policy_version 277382 (0.0008) [2023-12-27 21:13:20,950][106226] Updated weights for policy 0, policy_version 277392 (0.0009) [2023-12-27 21:13:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 142196736. Throughput: 0: 9742.8, 1: 10017.1. Samples: 142202544. Policy #0 lag: (min: 10.0, avg: 23.9, max: 42.0) [2023-12-27 21:13:21,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-5.604')] [2023-12-27 21:13:21,473][106225] Updated weights for policy 1, policy_version 277890 (0.0008) [2023-12-27 21:13:21,531][106225] Updated weights for policy 1, policy_version 277900 (0.0007) [2023-12-27 21:13:21,585][106225] Updated weights for policy 1, policy_version 277910 (0.0006) [2023-12-27 21:13:21,656][106225] Updated weights for policy 1, policy_version 277920 (0.0008) [2023-12-27 21:13:21,712][106226] Updated weights for policy 0, policy_version 277402 (0.0009) [2023-12-27 21:13:21,781][106226] Updated weights for policy 0, policy_version 277412 (0.0010) [2023-12-27 21:13:21,846][106226] Updated weights for policy 0, policy_version 277422 (0.0008) [2023-12-27 21:13:21,912][106226] Updated weights for policy 0, policy_version 277432 (0.0008) [2023-12-27 21:13:22,415][106225] Updated weights for policy 1, policy_version 277930 (0.0008) [2023-12-27 21:13:22,479][106225] Updated weights for policy 1, policy_version 277940 (0.0009) [2023-12-27 21:13:22,544][106225] Updated weights for policy 1, policy_version 277950 (0.0009) [2023-12-27 21:13:22,744][106226] Updated weights for policy 0, policy_version 277442 (0.0009) [2023-12-27 21:13:22,812][106226] Updated weights for policy 0, policy_version 277452 (0.0009) [2023-12-27 21:13:22,883][106226] Updated weights for policy 0, policy_version 277462 (0.0009) [2023-12-27 21:13:23,163][106225] Updated weights for policy 1, policy_version 277960 (0.0007) [2023-12-27 21:13:23,216][106225] Updated weights for policy 1, policy_version 277970 (0.0006) [2023-12-27 21:13:23,271][106225] Updated weights for policy 1, policy_version 277980 (0.0005) [2023-12-27 21:13:23,666][106226] Updated weights for policy 0, policy_version 277472 (0.0008) [2023-12-27 21:13:23,715][106226] Updated weights for policy 0, policy_version 277482 (0.0007) [2023-12-27 21:13:23,761][106226] Updated weights for policy 0, policy_version 277492 (0.0007) [2023-12-27 21:13:23,925][106225] Updated weights for policy 1, policy_version 277990 (0.0008) [2023-12-27 21:13:23,981][106225] Updated weights for policy 1, policy_version 278000 (0.0010) [2023-12-27 21:13:24,027][106225] Updated weights for policy 1, policy_version 278010 (0.0010) [2023-12-27 21:13:24,431][106226] Updated weights for policy 0, policy_version 277502 (0.0007) [2023-12-27 21:13:24,499][106226] Updated weights for policy 0, policy_version 277512 (0.0008) [2023-12-27 21:13:24,552][106226] Updated weights for policy 0, policy_version 277522 (0.0008) [2023-12-27 21:13:24,774][106225] Updated weights for policy 1, policy_version 278020 (0.0010) [2023-12-27 21:13:24,835][106225] Updated weights for policy 1, policy_version 278030 (0.0010) [2023-12-27 21:13:24,894][106225] Updated weights for policy 1, policy_version 278040 (0.0010) [2023-12-27 21:13:25,310][106226] Updated weights for policy 0, policy_version 277532 (0.0009) [2023-12-27 21:13:25,367][106226] Updated weights for policy 0, policy_version 277542 (0.0007) [2023-12-27 21:13:25,427][106226] Updated weights for policy 0, policy_version 277552 (0.0007) [2023-12-27 21:13:25,507][106225] Updated weights for policy 1, policy_version 278050 (0.0010) [2023-12-27 21:13:25,564][106225] Updated weights for policy 1, policy_version 278060 (0.0005) [2023-12-27 21:13:25,618][106225] Updated weights for policy 1, policy_version 278070 (0.0006) [2023-12-27 21:13:25,668][106225] Updated weights for policy 1, policy_version 278080 (0.0010) [2023-12-27 21:13:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 142286848. Throughput: 0: 9708.7, 1: 9973.1. Samples: 142259592. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:26,175][106226] Updated weights for policy 0, policy_version 277562 (0.0007) [2023-12-27 21:13:26,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.633')] [2023-12-27 21:13:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000278080_71204864.pth... [2023-12-27 21:13:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000276896_70901760.pth [2023-12-27 21:13:26,244][106226] Updated weights for policy 0, policy_version 277572 (0.0007) [2023-12-27 21:13:26,305][106226] Updated weights for policy 0, policy_version 277582 (0.0008) [2023-12-27 21:13:26,312][106225] Updated weights for policy 1, policy_version 278090 (0.0006) [2023-12-27 21:13:26,349][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000277592_71090176.pth... [2023-12-27 21:13:26,350][106226] Updated weights for policy 0, policy_version 277592 (0.0007) [2023-12-27 21:13:26,352][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000276440_70795264.pth [2023-12-27 21:13:26,364][106225] Updated weights for policy 1, policy_version 278100 (0.0005) [2023-12-27 21:13:26,423][106225] Updated weights for policy 1, policy_version 278110 (0.0007) [2023-12-27 21:13:26,995][106226] Updated weights for policy 0, policy_version 277602 (0.0008) [2023-12-27 21:13:27,043][106226] Updated weights for policy 0, policy_version 277612 (0.0008) [2023-12-27 21:13:27,097][106226] Updated weights for policy 0, policy_version 277622 (0.0007) [2023-12-27 21:13:27,128][106225] Updated weights for policy 1, policy_version 278120 (0.0009) [2023-12-27 21:13:27,179][106225] Updated weights for policy 1, policy_version 278130 (0.0010) [2023-12-27 21:13:27,228][106225] Updated weights for policy 1, policy_version 278140 (0.0010) [2023-12-27 21:13:27,814][106225] Updated weights for policy 1, policy_version 278150 (0.0007) [2023-12-27 21:13:27,850][106226] Updated weights for policy 0, policy_version 277632 (0.0006) [2023-12-27 21:13:27,869][106225] Updated weights for policy 1, policy_version 278160 (0.0010) [2023-12-27 21:13:27,904][106226] Updated weights for policy 0, policy_version 277642 (0.0006) [2023-12-27 21:13:27,915][106225] Updated weights for policy 1, policy_version 278170 (0.0010) [2023-12-27 21:13:27,955][106226] Updated weights for policy 0, policy_version 277652 (0.0006) [2023-12-27 21:13:28,631][106225] Updated weights for policy 1, policy_version 278180 (0.0009) [2023-12-27 21:13:28,645][106226] Updated weights for policy 0, policy_version 277662 (0.0009) [2023-12-27 21:13:28,682][106225] Updated weights for policy 1, policy_version 278190 (0.0005) [2023-12-27 21:13:28,706][106226] Updated weights for policy 0, policy_version 277672 (0.0011) [2023-12-27 21:13:28,740][106225] Updated weights for policy 1, policy_version 278200 (0.0008) [2023-12-27 21:13:28,767][106226] Updated weights for policy 0, policy_version 277682 (0.0011) [2023-12-27 21:13:29,505][106225] Updated weights for policy 1, policy_version 278210 (0.0007) [2023-12-27 21:13:29,521][106226] Updated weights for policy 0, policy_version 277692 (0.0010) [2023-12-27 21:13:29,569][106225] Updated weights for policy 1, policy_version 278220 (0.0010) [2023-12-27 21:13:29,578][106226] Updated weights for policy 0, policy_version 277702 (0.0011) [2023-12-27 21:13:29,626][106225] Updated weights for policy 1, policy_version 278230 (0.0010) [2023-12-27 21:13:29,632][106226] Updated weights for policy 0, policy_version 277712 (0.0010) [2023-12-27 21:13:29,683][106225] Updated weights for policy 1, policy_version 278240 (0.0010) [2023-12-27 21:13:30,345][106226] Updated weights for policy 0, policy_version 277722 (0.0010) [2023-12-27 21:13:30,399][106225] Updated weights for policy 1, policy_version 278250 (0.0005) [2023-12-27 21:13:30,403][106226] Updated weights for policy 0, policy_version 277732 (0.0010) [2023-12-27 21:13:30,457][106225] Updated weights for policy 1, policy_version 278260 (0.0005) [2023-12-27 21:13:30,462][106226] Updated weights for policy 0, policy_version 277742 (0.0008) [2023-12-27 21:13:30,521][106226] Updated weights for policy 0, policy_version 277752 (0.0005) [2023-12-27 21:13:30,541][106225] Updated weights for policy 1, policy_version 278270 (0.0005) [2023-12-27 21:13:31,075][106225] Updated weights for policy 1, policy_version 278280 (0.0006) [2023-12-27 21:13:31,138][106225] Updated weights for policy 1, policy_version 278290 (0.0007) [2023-12-27 21:13:31,163][106226] Updated weights for policy 0, policy_version 277762 (0.0007) [2023-12-27 21:13:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 142385152. Throughput: 0: 9769.2, 1: 10027.7. Samples: 142379236. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:31,175][105115] Avg episode reward: [(0, '-4.392'), (1, '-5.834')] [2023-12-27 21:13:31,198][106225] Updated weights for policy 1, policy_version 278300 (0.0009) [2023-12-27 21:13:31,219][106226] Updated weights for policy 0, policy_version 277772 (0.0006) [2023-12-27 21:13:31,286][106226] Updated weights for policy 0, policy_version 277782 (0.0006) [2023-12-27 21:13:31,874][106225] Updated weights for policy 1, policy_version 278310 (0.0007) [2023-12-27 21:13:31,940][106225] Updated weights for policy 1, policy_version 278320 (0.0007) [2023-12-27 21:13:31,981][106226] Updated weights for policy 0, policy_version 277792 (0.0009) [2023-12-27 21:13:32,002][106225] Updated weights for policy 1, policy_version 278330 (0.0005) [2023-12-27 21:13:32,035][106226] Updated weights for policy 0, policy_version 277802 (0.0010) [2023-12-27 21:13:32,089][106226] Updated weights for policy 0, policy_version 277812 (0.0010) [2023-12-27 21:13:32,697][106225] Updated weights for policy 1, policy_version 278340 (0.0006) [2023-12-27 21:13:32,753][106225] Updated weights for policy 1, policy_version 278350 (0.0008) [2023-12-27 21:13:32,762][106226] Updated weights for policy 0, policy_version 277822 (0.0008) [2023-12-27 21:13:32,813][106226] Updated weights for policy 0, policy_version 277832 (0.0005) [2023-12-27 21:13:32,814][106225] Updated weights for policy 1, policy_version 278360 (0.0008) [2023-12-27 21:13:32,871][106226] Updated weights for policy 0, policy_version 277842 (0.0006) [2023-12-27 21:13:33,560][106226] Updated weights for policy 0, policy_version 277852 (0.0008) [2023-12-27 21:13:33,571][106225] Updated weights for policy 1, policy_version 278370 (0.0007) [2023-12-27 21:13:33,613][106226] Updated weights for policy 0, policy_version 277862 (0.0010) [2023-12-27 21:13:33,617][106225] Updated weights for policy 1, policy_version 278380 (0.0010) [2023-12-27 21:13:33,665][106226] Updated weights for policy 0, policy_version 277872 (0.0007) [2023-12-27 21:13:33,677][106225] Updated weights for policy 1, policy_version 278390 (0.0010) [2023-12-27 21:13:33,725][106225] Updated weights for policy 1, policy_version 278400 (0.0009) [2023-12-27 21:13:34,351][106226] Updated weights for policy 0, policy_version 277882 (0.0007) [2023-12-27 21:13:34,405][106226] Updated weights for policy 0, policy_version 277892 (0.0011) [2023-12-27 21:13:34,463][106226] Updated weights for policy 0, policy_version 277902 (0.0010) [2023-12-27 21:13:34,476][106225] Updated weights for policy 1, policy_version 278410 (0.0007) [2023-12-27 21:13:34,526][106226] Updated weights for policy 0, policy_version 277912 (0.0009) [2023-12-27 21:13:34,538][106225] Updated weights for policy 1, policy_version 278420 (0.0009) [2023-12-27 21:13:34,603][106225] Updated weights for policy 1, policy_version 278430 (0.0008) [2023-12-27 21:13:35,199][106226] Updated weights for policy 0, policy_version 277922 (0.0005) [2023-12-27 21:13:35,257][106226] Updated weights for policy 0, policy_version 277932 (0.0005) [2023-12-27 21:13:35,313][106226] Updated weights for policy 0, policy_version 277942 (0.0006) [2023-12-27 21:13:35,388][106225] Updated weights for policy 1, policy_version 278440 (0.0006) [2023-12-27 21:13:35,445][106225] Updated weights for policy 1, policy_version 278450 (0.0007) [2023-12-27 21:13:35,497][106225] Updated weights for policy 1, policy_version 278460 (0.0007) [2023-12-27 21:13:36,016][106226] Updated weights for policy 0, policy_version 277952 (0.0006) [2023-12-27 21:13:36,090][106225] Updated weights for policy 1, policy_version 278470 (0.0008) [2023-12-27 21:13:36,090][106226] Updated weights for policy 0, policy_version 277962 (0.0008) [2023-12-27 21:13:36,159][106225] Updated weights for policy 1, policy_version 278480 (0.0009) [2023-12-27 21:13:36,162][106226] Updated weights for policy 0, policy_version 277972 (0.0007) [2023-12-27 21:13:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 142483456. Throughput: 0: 9812.5, 1: 10026.7. Samples: 142500684. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:36,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-5.576')] [2023-12-27 21:13:36,215][106225] Updated weights for policy 1, policy_version 278490 (0.0007) [2023-12-27 21:13:36,867][106225] Updated weights for policy 1, policy_version 278500 (0.0008) [2023-12-27 21:13:36,878][106226] Updated weights for policy 0, policy_version 277982 (0.0008) [2023-12-27 21:13:36,930][106225] Updated weights for policy 1, policy_version 278510 (0.0008) [2023-12-27 21:13:36,935][106226] Updated weights for policy 0, policy_version 277992 (0.0006) [2023-12-27 21:13:36,990][106225] Updated weights for policy 1, policy_version 278520 (0.0007) [2023-12-27 21:13:36,991][106226] Updated weights for policy 0, policy_version 278002 (0.0006) [2023-12-27 21:13:37,560][106226] Updated weights for policy 0, policy_version 278012 (0.0007) [2023-12-27 21:13:37,607][106225] Updated weights for policy 1, policy_version 278530 (0.0007) [2023-12-27 21:13:37,617][106226] Updated weights for policy 0, policy_version 278022 (0.0008) [2023-12-27 21:13:37,664][106225] Updated weights for policy 1, policy_version 278540 (0.0007) [2023-12-27 21:13:37,682][106226] Updated weights for policy 0, policy_version 278032 (0.0006) [2023-12-27 21:13:37,723][106225] Updated weights for policy 1, policy_version 278550 (0.0010) [2023-12-27 21:13:37,788][106225] Updated weights for policy 1, policy_version 278560 (0.0011) [2023-12-27 21:13:38,384][106226] Updated weights for policy 0, policy_version 278042 (0.0007) [2023-12-27 21:13:38,427][106225] Updated weights for policy 1, policy_version 278570 (0.0009) [2023-12-27 21:13:38,445][106226] Updated weights for policy 0, policy_version 278052 (0.0011) [2023-12-27 21:13:38,477][106225] Updated weights for policy 1, policy_version 278580 (0.0010) [2023-12-27 21:13:38,510][106226] Updated weights for policy 0, policy_version 278062 (0.0011) [2023-12-27 21:13:38,527][106225] Updated weights for policy 1, policy_version 278590 (0.0010) [2023-12-27 21:13:38,577][106226] Updated weights for policy 0, policy_version 278072 (0.0011) [2023-12-27 21:13:39,257][106226] Updated weights for policy 0, policy_version 278082 (0.0006) [2023-12-27 21:13:39,262][106225] Updated weights for policy 1, policy_version 278600 (0.0010) [2023-12-27 21:13:39,318][106226] Updated weights for policy 0, policy_version 278092 (0.0008) [2023-12-27 21:13:39,325][106225] Updated weights for policy 1, policy_version 278610 (0.0008) [2023-12-27 21:13:39,387][106226] Updated weights for policy 0, policy_version 278102 (0.0007) [2023-12-27 21:13:39,396][106225] Updated weights for policy 1, policy_version 278620 (0.0011) [2023-12-27 21:13:40,119][106225] Updated weights for policy 1, policy_version 278630 (0.0007) [2023-12-27 21:13:40,185][106225] Updated weights for policy 1, policy_version 278640 (0.0006) [2023-12-27 21:13:40,232][106226] Updated weights for policy 0, policy_version 278112 (0.0008) [2023-12-27 21:13:40,244][106225] Updated weights for policy 1, policy_version 278650 (0.0010) [2023-12-27 21:13:40,292][106226] Updated weights for policy 0, policy_version 278122 (0.0008) [2023-12-27 21:13:40,365][106226] Updated weights for policy 0, policy_version 278132 (0.0006) [2023-12-27 21:13:40,978][106225] Updated weights for policy 1, policy_version 278660 (0.0010) [2023-12-27 21:13:40,986][106226] Updated weights for policy 0, policy_version 278142 (0.0008) [2023-12-27 21:13:41,035][106225] Updated weights for policy 1, policy_version 278670 (0.0009) [2023-12-27 21:13:41,050][106226] Updated weights for policy 0, policy_version 278152 (0.0008) [2023-12-27 21:13:41,099][106225] Updated weights for policy 1, policy_version 278680 (0.0008) [2023-12-27 21:13:41,112][106226] Updated weights for policy 0, policy_version 278162 (0.0008) [2023-12-27 21:13:41,175][105115] Fps is (10 sec: 21298.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 142598144. Throughput: 0: 9801.8, 1: 10098.6. Samples: 142562444. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:41,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.811')] [2023-12-27 21:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000278688_71360512.pth... [2023-12-27 21:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000278168_71237632.pth... [2023-12-27 21:13:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000277504_71057408.pth [2023-12-27 21:13:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000278688_71360512.pth [2023-12-27 21:13:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000277016_70942720.pth [2023-12-27 21:13:41,188][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000278168_71237632.pth [2023-12-27 21:13:41,873][106225] Updated weights for policy 1, policy_version 278690 (0.0007) [2023-12-27 21:13:41,875][106226] Updated weights for policy 0, policy_version 278172 (0.0009) [2023-12-27 21:13:41,924][106226] Updated weights for policy 0, policy_version 278182 (0.0011) [2023-12-27 21:13:41,925][106225] Updated weights for policy 1, policy_version 278700 (0.0005) [2023-12-27 21:13:41,972][106226] Updated weights for policy 0, policy_version 278192 (0.0010) [2023-12-27 21:13:41,987][106225] Updated weights for policy 1, policy_version 278710 (0.0006) [2023-12-27 21:13:42,051][106225] Updated weights for policy 1, policy_version 278720 (0.0007) [2023-12-27 21:13:42,685][106226] Updated weights for policy 0, policy_version 278202 (0.0010) [2023-12-27 21:13:42,740][106226] Updated weights for policy 0, policy_version 278212 (0.0011) [2023-12-27 21:13:42,765][106225] Updated weights for policy 1, policy_version 278730 (0.0007) [2023-12-27 21:13:42,798][106226] Updated weights for policy 0, policy_version 278222 (0.0008) [2023-12-27 21:13:42,829][106225] Updated weights for policy 1, policy_version 278740 (0.0007) [2023-12-27 21:13:42,859][106226] Updated weights for policy 0, policy_version 278232 (0.0008) [2023-12-27 21:13:42,886][106225] Updated weights for policy 1, policy_version 278750 (0.0007) [2023-12-27 21:13:43,529][106225] Updated weights for policy 1, policy_version 278760 (0.0006) [2023-12-27 21:13:43,550][106226] Updated weights for policy 0, policy_version 278242 (0.0011) [2023-12-27 21:13:43,582][106225] Updated weights for policy 1, policy_version 278770 (0.0006) [2023-12-27 21:13:43,599][106226] Updated weights for policy 0, policy_version 278252 (0.0007) [2023-12-27 21:13:43,637][106225] Updated weights for policy 1, policy_version 278780 (0.0009) [2023-12-27 21:13:43,658][106226] Updated weights for policy 0, policy_version 278262 (0.0006) [2023-12-27 21:13:44,333][106226] Updated weights for policy 0, policy_version 278272 (0.0007) [2023-12-27 21:13:44,352][106225] Updated weights for policy 1, policy_version 278790 (0.0009) [2023-12-27 21:13:44,394][106226] Updated weights for policy 0, policy_version 278282 (0.0005) [2023-12-27 21:13:44,411][106225] Updated weights for policy 1, policy_version 278800 (0.0010) [2023-12-27 21:13:44,455][106226] Updated weights for policy 0, policy_version 278292 (0.0005) [2023-12-27 21:13:44,477][106225] Updated weights for policy 1, policy_version 278810 (0.0010) [2023-12-27 21:13:45,070][106226] Updated weights for policy 0, policy_version 278302 (0.0007) [2023-12-27 21:13:45,128][106226] Updated weights for policy 0, policy_version 278312 (0.0008) [2023-12-27 21:13:45,136][106225] Updated weights for policy 1, policy_version 278820 (0.0009) [2023-12-27 21:13:45,195][106226] Updated weights for policy 0, policy_version 278322 (0.0008) [2023-12-27 21:13:45,199][106225] Updated weights for policy 1, policy_version 278830 (0.0009) [2023-12-27 21:13:45,270][106225] Updated weights for policy 1, policy_version 278840 (0.0009) [2023-12-27 21:13:45,919][106226] Updated weights for policy 0, policy_version 278332 (0.0009) [2023-12-27 21:13:45,945][106225] Updated weights for policy 1, policy_version 278850 (0.0011) [2023-12-27 21:13:45,969][106226] Updated weights for policy 0, policy_version 278342 (0.0010) [2023-12-27 21:13:45,999][106225] Updated weights for policy 1, policy_version 278860 (0.0010) [2023-12-27 21:13:46,032][106226] Updated weights for policy 0, policy_version 278352 (0.0006) [2023-12-27 21:13:46,049][106225] Updated weights for policy 1, policy_version 278870 (0.0010) [2023-12-27 21:13:46,102][106225] Updated weights for policy 1, policy_version 278880 (0.0010) [2023-12-27 21:13:46,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 142696448. Throughput: 0: 9760.7, 1: 10043.7. Samples: 142679188. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:46,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.664')] [2023-12-27 21:13:46,654][106226] Updated weights for policy 0, policy_version 278362 (0.0007) [2023-12-27 21:13:46,709][106226] Updated weights for policy 0, policy_version 278372 (0.0010) [2023-12-27 21:13:46,730][106225] Updated weights for policy 1, policy_version 278890 (0.0006) [2023-12-27 21:13:46,772][106226] Updated weights for policy 0, policy_version 278382 (0.0011) [2023-12-27 21:13:46,790][106225] Updated weights for policy 1, policy_version 278900 (0.0006) [2023-12-27 21:13:46,829][106226] Updated weights for policy 0, policy_version 278392 (0.0010) [2023-12-27 21:13:46,851][106225] Updated weights for policy 1, policy_version 278910 (0.0007) [2023-12-27 21:13:47,413][106226] Updated weights for policy 0, policy_version 278402 (0.0009) [2023-12-27 21:13:47,471][106226] Updated weights for policy 0, policy_version 278412 (0.0005) [2023-12-27 21:13:47,535][106226] Updated weights for policy 0, policy_version 278422 (0.0005) [2023-12-27 21:13:47,562][106225] Updated weights for policy 1, policy_version 278920 (0.0007) [2023-12-27 21:13:47,607][106225] Updated weights for policy 1, policy_version 278930 (0.0005) [2023-12-27 21:13:47,655][106225] Updated weights for policy 1, policy_version 278940 (0.0007) [2023-12-27 21:13:48,056][106226] Updated weights for policy 0, policy_version 278432 (0.0009) [2023-12-27 21:13:48,116][106226] Updated weights for policy 0, policy_version 278442 (0.0011) [2023-12-27 21:13:48,178][106226] Updated weights for policy 0, policy_version 278452 (0.0010) [2023-12-27 21:13:48,241][106225] Updated weights for policy 1, policy_version 278950 (0.0007) [2023-12-27 21:13:48,292][106225] Updated weights for policy 1, policy_version 278960 (0.0005) [2023-12-27 21:13:48,356][106225] Updated weights for policy 1, policy_version 278970 (0.0007) [2023-12-27 21:13:48,872][106226] Updated weights for policy 0, policy_version 278462 (0.0010) [2023-12-27 21:13:48,930][106226] Updated weights for policy 0, policy_version 278472 (0.0010) [2023-12-27 21:13:48,996][106226] Updated weights for policy 0, policy_version 278482 (0.0010) [2023-12-27 21:13:49,019][106225] Updated weights for policy 1, policy_version 278980 (0.0006) [2023-12-27 21:13:49,067][106225] Updated weights for policy 1, policy_version 278990 (0.0005) [2023-12-27 21:13:49,124][106225] Updated weights for policy 1, policy_version 279000 (0.0005) [2023-12-27 21:13:49,758][106226] Updated weights for policy 0, policy_version 278492 (0.0009) [2023-12-27 21:13:49,823][106226] Updated weights for policy 0, policy_version 278502 (0.0008) [2023-12-27 21:13:49,838][106225] Updated weights for policy 1, policy_version 279010 (0.0006) [2023-12-27 21:13:49,888][106226] Updated weights for policy 0, policy_version 278512 (0.0008) [2023-12-27 21:13:49,899][106225] Updated weights for policy 1, policy_version 279020 (0.0008) [2023-12-27 21:13:49,962][106225] Updated weights for policy 1, policy_version 279030 (0.0008) [2023-12-27 21:13:50,028][106225] Updated weights for policy 1, policy_version 279040 (0.0006) [2023-12-27 21:13:50,580][106226] Updated weights for policy 0, policy_version 278522 (0.0010) [2023-12-27 21:13:50,649][106226] Updated weights for policy 0, policy_version 278532 (0.0009) [2023-12-27 21:13:50,712][106226] Updated weights for policy 0, policy_version 278542 (0.0011) [2023-12-27 21:13:50,744][106225] Updated weights for policy 1, policy_version 279050 (0.0007) [2023-12-27 21:13:50,770][106226] Updated weights for policy 0, policy_version 278552 (0.0011) [2023-12-27 21:13:50,806][106225] Updated weights for policy 1, policy_version 279060 (0.0007) [2023-12-27 21:13:50,864][106225] Updated weights for policy 1, policy_version 279070 (0.0008) [2023-12-27 21:13:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 142794752. Throughput: 0: 9740.3, 1: 10029.2. Samples: 142802808. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.914')] [2023-12-27 21:13:51,496][106226] Updated weights for policy 0, policy_version 278562 (0.0011) [2023-12-27 21:13:51,560][106226] Updated weights for policy 0, policy_version 278572 (0.0011) [2023-12-27 21:13:51,610][106226] Updated weights for policy 0, policy_version 278582 (0.0010) [2023-12-27 21:13:51,667][106225] Updated weights for policy 1, policy_version 279080 (0.0008) [2023-12-27 21:13:51,739][106225] Updated weights for policy 1, policy_version 279090 (0.0009) [2023-12-27 21:13:51,804][106225] Updated weights for policy 1, policy_version 279100 (0.0010) [2023-12-27 21:13:52,306][106226] Updated weights for policy 0, policy_version 278592 (0.0008) [2023-12-27 21:13:52,371][106226] Updated weights for policy 0, policy_version 278602 (0.0008) [2023-12-27 21:13:52,416][106226] Updated weights for policy 0, policy_version 278612 (0.0008) [2023-12-27 21:13:52,605][106225] Updated weights for policy 1, policy_version 279110 (0.0008) [2023-12-27 21:13:52,668][106225] Updated weights for policy 1, policy_version 279120 (0.0009) [2023-12-27 21:13:52,724][106225] Updated weights for policy 1, policy_version 279130 (0.0008) [2023-12-27 21:13:53,181][106226] Updated weights for policy 0, policy_version 278622 (0.0009) [2023-12-27 21:13:53,235][106226] Updated weights for policy 0, policy_version 278632 (0.0009) [2023-12-27 21:13:53,291][106226] Updated weights for policy 0, policy_version 278642 (0.0008) [2023-12-27 21:13:53,384][106225] Updated weights for policy 1, policy_version 279140 (0.0008) [2023-12-27 21:13:53,445][106225] Updated weights for policy 1, policy_version 279150 (0.0009) [2023-12-27 21:13:53,501][106225] Updated weights for policy 1, policy_version 279160 (0.0009) [2023-12-27 21:13:53,988][106226] Updated weights for policy 0, policy_version 278652 (0.0008) [2023-12-27 21:13:54,040][106226] Updated weights for policy 0, policy_version 278662 (0.0008) [2023-12-27 21:13:54,092][106226] Updated weights for policy 0, policy_version 278672 (0.0008) [2023-12-27 21:13:54,249][106225] Updated weights for policy 1, policy_version 279170 (0.0008) [2023-12-27 21:13:54,304][106225] Updated weights for policy 1, policy_version 279180 (0.0008) [2023-12-27 21:13:54,359][106225] Updated weights for policy 1, policy_version 279190 (0.0009) [2023-12-27 21:13:54,420][106225] Updated weights for policy 1, policy_version 279200 (0.0008) [2023-12-27 21:13:54,843][106226] Updated weights for policy 0, policy_version 278682 (0.0008) [2023-12-27 21:13:54,907][106226] Updated weights for policy 0, policy_version 278692 (0.0006) [2023-12-27 21:13:54,972][106226] Updated weights for policy 0, policy_version 278702 (0.0006) [2023-12-27 21:13:55,038][106226] Updated weights for policy 0, policy_version 278712 (0.0010) [2023-12-27 21:13:55,180][106225] Updated weights for policy 1, policy_version 279210 (0.0007) [2023-12-27 21:13:55,227][106225] Updated weights for policy 1, policy_version 279220 (0.0007) [2023-12-27 21:13:55,277][106225] Updated weights for policy 1, policy_version 279230 (0.0008) [2023-12-27 21:13:55,689][106226] Updated weights for policy 0, policy_version 278723 (0.0007) [2023-12-27 21:13:55,740][106226] Updated weights for policy 0, policy_version 278733 (0.0005) [2023-12-27 21:13:55,797][106226] Updated weights for policy 0, policy_version 278743 (0.0008) [2023-12-27 21:13:55,997][106225] Updated weights for policy 1, policy_version 279240 (0.0008) [2023-12-27 21:13:56,052][106225] Updated weights for policy 1, policy_version 279250 (0.0005) [2023-12-27 21:13:56,104][106225] Updated weights for policy 1, policy_version 279260 (0.0007) [2023-12-27 21:13:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 142893056. Throughput: 0: 9785.1, 1: 9974.3. Samples: 142859616. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:13:56,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.851')] [2023-12-27 21:13:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000278744_71385088.pth... [2023-12-27 21:13:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000279264_71507968.pth... [2023-12-27 21:13:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000277592_71090176.pth [2023-12-27 21:13:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000278080_71204864.pth [2023-12-27 21:13:56,450][106226] Updated weights for policy 0, policy_version 278753 (0.0006) [2023-12-27 21:13:56,503][106226] Updated weights for policy 0, policy_version 278763 (0.0005) [2023-12-27 21:13:56,557][106226] Updated weights for policy 0, policy_version 278773 (0.0007) [2023-12-27 21:13:56,835][106225] Updated weights for policy 1, policy_version 279270 (0.0009) [2023-12-27 21:13:56,890][106225] Updated weights for policy 1, policy_version 279280 (0.0008) [2023-12-27 21:13:56,939][106225] Updated weights for policy 1, policy_version 279290 (0.0007) [2023-12-27 21:13:57,130][106226] Updated weights for policy 0, policy_version 278783 (0.0007) [2023-12-27 21:13:57,190][106226] Updated weights for policy 0, policy_version 278793 (0.0005) [2023-12-27 21:13:57,244][106226] Updated weights for policy 0, policy_version 278803 (0.0005) [2023-12-27 21:13:57,660][106225] Updated weights for policy 1, policy_version 279300 (0.0007) [2023-12-27 21:13:57,717][106225] Updated weights for policy 1, policy_version 279310 (0.0005) [2023-12-27 21:13:57,761][106226] Updated weights for policy 0, policy_version 278813 (0.0008) [2023-12-27 21:13:57,776][106225] Updated weights for policy 1, policy_version 279320 (0.0006) [2023-12-27 21:13:57,814][106226] Updated weights for policy 0, policy_version 278823 (0.0007) [2023-12-27 21:13:57,873][106226] Updated weights for policy 0, policy_version 278833 (0.0008) [2023-12-27 21:13:58,333][106225] Updated weights for policy 1, policy_version 279330 (0.0006) [2023-12-27 21:13:58,395][106225] Updated weights for policy 1, policy_version 279340 (0.0008) [2023-12-27 21:13:58,457][106225] Updated weights for policy 1, policy_version 279350 (0.0010) [2023-12-27 21:13:58,525][106225] Updated weights for policy 1, policy_version 279360 (0.0010) [2023-12-27 21:13:58,603][106226] Updated weights for policy 0, policy_version 278843 (0.0009) [2023-12-27 21:13:58,674][106226] Updated weights for policy 0, policy_version 278853 (0.0010) [2023-12-27 21:13:58,744][106226] Updated weights for policy 0, policy_version 278863 (0.0007) [2023-12-27 21:13:59,344][106225] Updated weights for policy 1, policy_version 279370 (0.0007) [2023-12-27 21:13:59,411][106225] Updated weights for policy 1, policy_version 279380 (0.0008) [2023-12-27 21:13:59,471][106225] Updated weights for policy 1, policy_version 279390 (0.0007) [2023-12-27 21:13:59,592][106226] Updated weights for policy 0, policy_version 278873 (0.0008) [2023-12-27 21:13:59,656][106226] Updated weights for policy 0, policy_version 278883 (0.0009) [2023-12-27 21:13:59,721][106226] Updated weights for policy 0, policy_version 278893 (0.0011) [2023-12-27 21:13:59,786][106226] Updated weights for policy 0, policy_version 278903 (0.0008) [2023-12-27 21:14:00,187][106225] Updated weights for policy 1, policy_version 279400 (0.0009) [2023-12-27 21:14:00,249][106225] Updated weights for policy 1, policy_version 279410 (0.0008) [2023-12-27 21:14:00,307][106225] Updated weights for policy 1, policy_version 279420 (0.0009) [2023-12-27 21:14:00,415][106226] Updated weights for policy 0, policy_version 278913 (0.0006) [2023-12-27 21:14:00,464][106226] Updated weights for policy 0, policy_version 278923 (0.0007) [2023-12-27 21:14:00,509][106226] Updated weights for policy 0, policy_version 278933 (0.0006) [2023-12-27 21:14:00,908][106225] Updated weights for policy 1, policy_version 279430 (0.0007) [2023-12-27 21:14:00,961][106225] Updated weights for policy 1, policy_version 279440 (0.0008) [2023-12-27 21:14:01,010][106225] Updated weights for policy 1, policy_version 279450 (0.0007) [2023-12-27 21:14:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 142991360. Throughput: 0: 9934.6, 1: 9999.2. Samples: 142980548. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:01,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.799')] [2023-12-27 21:14:01,188][106226] Updated weights for policy 0, policy_version 278943 (0.0007) [2023-12-27 21:14:01,256][106226] Updated weights for policy 0, policy_version 278953 (0.0007) [2023-12-27 21:14:01,314][106226] Updated weights for policy 0, policy_version 278963 (0.0008) [2023-12-27 21:14:01,747][106225] Updated weights for policy 1, policy_version 279460 (0.0008) [2023-12-27 21:14:01,814][106225] Updated weights for policy 1, policy_version 279470 (0.0009) [2023-12-27 21:14:01,881][106225] Updated weights for policy 1, policy_version 279480 (0.0009) [2023-12-27 21:14:02,006][106226] Updated weights for policy 0, policy_version 278973 (0.0007) [2023-12-27 21:14:02,074][106226] Updated weights for policy 0, policy_version 278983 (0.0008) [2023-12-27 21:14:02,140][106226] Updated weights for policy 0, policy_version 278993 (0.0008) [2023-12-27 21:14:02,561][106225] Updated weights for policy 1, policy_version 279490 (0.0008) [2023-12-27 21:14:02,615][106225] Updated weights for policy 1, policy_version 279500 (0.0008) [2023-12-27 21:14:02,668][106225] Updated weights for policy 1, policy_version 279510 (0.0008) [2023-12-27 21:14:02,722][106225] Updated weights for policy 1, policy_version 279520 (0.0007) [2023-12-27 21:14:02,834][106226] Updated weights for policy 0, policy_version 279003 (0.0009) [2023-12-27 21:14:02,889][106226] Updated weights for policy 0, policy_version 279013 (0.0011) [2023-12-27 21:14:02,942][106226] Updated weights for policy 0, policy_version 279023 (0.0010) [2023-12-27 21:14:03,449][106225] Updated weights for policy 1, policy_version 279530 (0.0007) [2023-12-27 21:14:03,494][106225] Updated weights for policy 1, policy_version 279540 (0.0007) [2023-12-27 21:14:03,543][106225] Updated weights for policy 1, policy_version 279550 (0.0007) [2023-12-27 21:14:03,660][106226] Updated weights for policy 0, policy_version 279033 (0.0010) [2023-12-27 21:14:03,706][106226] Updated weights for policy 0, policy_version 279043 (0.0010) [2023-12-27 21:14:03,752][106226] Updated weights for policy 0, policy_version 279053 (0.0010) [2023-12-27 21:14:03,800][106226] Updated weights for policy 0, policy_version 279063 (0.0010) [2023-12-27 21:14:04,338][106225] Updated weights for policy 1, policy_version 279560 (0.0008) [2023-12-27 21:14:04,389][106225] Updated weights for policy 1, policy_version 279570 (0.0008) [2023-12-27 21:14:04,446][106225] Updated weights for policy 1, policy_version 279580 (0.0007) [2023-12-27 21:14:04,557][106226] Updated weights for policy 0, policy_version 279073 (0.0010) [2023-12-27 21:14:04,614][106226] Updated weights for policy 0, policy_version 279083 (0.0010) [2023-12-27 21:14:04,668][106226] Updated weights for policy 0, policy_version 279093 (0.0011) [2023-12-27 21:14:05,170][106225] Updated weights for policy 1, policy_version 279590 (0.0008) [2023-12-27 21:14:05,229][106225] Updated weights for policy 1, policy_version 279600 (0.0008) [2023-12-27 21:14:05,280][106225] Updated weights for policy 1, policy_version 279610 (0.0008) [2023-12-27 21:14:05,390][106226] Updated weights for policy 0, policy_version 279103 (0.0011) [2023-12-27 21:14:05,441][106226] Updated weights for policy 0, policy_version 279113 (0.0010) [2023-12-27 21:14:05,488][106226] Updated weights for policy 0, policy_version 279123 (0.0010) [2023-12-27 21:14:06,025][106225] Updated weights for policy 1, policy_version 279620 (0.0007) [2023-12-27 21:14:06,081][106225] Updated weights for policy 1, policy_version 279630 (0.0008) [2023-12-27 21:14:06,146][106225] Updated weights for policy 1, policy_version 279640 (0.0008) [2023-12-27 21:14:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 143081472. Throughput: 0: 9965.1, 1: 9948.9. Samples: 143098676. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:06,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.857')] [2023-12-27 21:14:06,225][106226] Updated weights for policy 0, policy_version 279133 (0.0011) [2023-12-27 21:14:06,291][106226] Updated weights for policy 0, policy_version 279143 (0.0011) [2023-12-27 21:14:06,349][106226] Updated weights for policy 0, policy_version 279153 (0.0011) [2023-12-27 21:14:06,875][106225] Updated weights for policy 1, policy_version 279650 (0.0007) [2023-12-27 21:14:06,935][106225] Updated weights for policy 1, policy_version 279660 (0.0008) [2023-12-27 21:14:06,993][106225] Updated weights for policy 1, policy_version 279670 (0.0008) [2023-12-27 21:14:07,050][106225] Updated weights for policy 1, policy_version 279680 (0.0008) [2023-12-27 21:14:07,080][106226] Updated weights for policy 0, policy_version 279163 (0.0011) [2023-12-27 21:14:07,142][106226] Updated weights for policy 0, policy_version 279173 (0.0011) [2023-12-27 21:14:07,207][106226] Updated weights for policy 0, policy_version 279183 (0.0011) [2023-12-27 21:14:07,783][106225] Updated weights for policy 1, policy_version 279690 (0.0008) [2023-12-27 21:14:07,832][106225] Updated weights for policy 1, policy_version 279700 (0.0008) [2023-12-27 21:14:07,892][106225] Updated weights for policy 1, policy_version 279710 (0.0010) [2023-12-27 21:14:07,922][106226] Updated weights for policy 0, policy_version 279193 (0.0011) [2023-12-27 21:14:07,970][106226] Updated weights for policy 0, policy_version 279203 (0.0010) [2023-12-27 21:14:08,017][106226] Updated weights for policy 0, policy_version 279213 (0.0011) [2023-12-27 21:14:08,071][106226] Updated weights for policy 0, policy_version 279223 (0.0010) [2023-12-27 21:14:08,604][106225] Updated weights for policy 1, policy_version 279720 (0.0006) [2023-12-27 21:14:08,667][106225] Updated weights for policy 1, policy_version 279730 (0.0007) [2023-12-27 21:14:08,725][106225] Updated weights for policy 1, policy_version 279740 (0.0010) [2023-12-27 21:14:08,835][106226] Updated weights for policy 0, policy_version 279233 (0.0011) [2023-12-27 21:14:08,899][106226] Updated weights for policy 0, policy_version 279243 (0.0011) [2023-12-27 21:14:08,959][106226] Updated weights for policy 0, policy_version 279253 (0.0011) [2023-12-27 21:14:09,437][106225] Updated weights for policy 1, policy_version 279750 (0.0009) [2023-12-27 21:14:09,499][106225] Updated weights for policy 1, policy_version 279760 (0.0007) [2023-12-27 21:14:09,563][106225] Updated weights for policy 1, policy_version 279770 (0.0009) [2023-12-27 21:14:09,747][106226] Updated weights for policy 0, policy_version 279263 (0.0009) [2023-12-27 21:14:09,810][106226] Updated weights for policy 0, policy_version 279273 (0.0009) [2023-12-27 21:14:09,877][106226] Updated weights for policy 0, policy_version 279283 (0.0008) [2023-12-27 21:14:10,360][106225] Updated weights for policy 1, policy_version 279780 (0.0008) [2023-12-27 21:14:10,416][106225] Updated weights for policy 1, policy_version 279790 (0.0008) [2023-12-27 21:14:10,478][106225] Updated weights for policy 1, policy_version 279800 (0.0008) [2023-12-27 21:14:10,629][106226] Updated weights for policy 0, policy_version 279293 (0.0008) [2023-12-27 21:14:10,693][106226] Updated weights for policy 0, policy_version 279303 (0.0009) [2023-12-27 21:14:10,759][106226] Updated weights for policy 0, policy_version 279313 (0.0009) [2023-12-27 21:14:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 143179776. Throughput: 0: 9978.4, 1: 9931.8. Samples: 143155548. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:11,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.488')] [2023-12-27 21:14:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000279808_71647232.pth... [2023-12-27 21:14:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000279320_71532544.pth... [2023-12-27 21:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000278688_71360512.pth [2023-12-27 21:14:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000278168_71237632.pth [2023-12-27 21:14:11,220][106225] Updated weights for policy 1, policy_version 279810 (0.0008) [2023-12-27 21:14:11,288][106225] Updated weights for policy 1, policy_version 279820 (0.0008) [2023-12-27 21:14:11,350][106225] Updated weights for policy 1, policy_version 279830 (0.0008) [2023-12-27 21:14:11,425][106225] Updated weights for policy 1, policy_version 279840 (0.0008) [2023-12-27 21:14:11,497][106226] Updated weights for policy 0, policy_version 279323 (0.0008) [2023-12-27 21:14:11,557][106226] Updated weights for policy 0, policy_version 279333 (0.0008) [2023-12-27 21:14:11,622][106226] Updated weights for policy 0, policy_version 279343 (0.0010) [2023-12-27 21:14:12,229][106225] Updated weights for policy 1, policy_version 279850 (0.0010) [2023-12-27 21:14:12,283][106226] Updated weights for policy 0, policy_version 279353 (0.0008) [2023-12-27 21:14:12,295][106225] Updated weights for policy 1, policy_version 279860 (0.0011) [2023-12-27 21:14:12,342][106226] Updated weights for policy 0, policy_version 279363 (0.0009) [2023-12-27 21:14:12,360][106225] Updated weights for policy 1, policy_version 279870 (0.0008) [2023-12-27 21:14:12,409][106226] Updated weights for policy 0, policy_version 279373 (0.0009) [2023-12-27 21:14:12,478][106226] Updated weights for policy 0, policy_version 279383 (0.0006) [2023-12-27 21:14:13,089][106225] Updated weights for policy 1, policy_version 279880 (0.0008) [2023-12-27 21:14:13,143][106225] Updated weights for policy 1, policy_version 279890 (0.0007) [2023-12-27 21:14:13,164][106226] Updated weights for policy 0, policy_version 279393 (0.0008) [2023-12-27 21:14:13,201][106225] Updated weights for policy 1, policy_version 279900 (0.0006) [2023-12-27 21:14:13,224][106226] Updated weights for policy 0, policy_version 279403 (0.0007) [2023-12-27 21:14:13,282][106226] Updated weights for policy 0, policy_version 279413 (0.0008) [2023-12-27 21:14:13,771][106225] Updated weights for policy 1, policy_version 279910 (0.0007) [2023-12-27 21:14:13,816][106225] Updated weights for policy 1, policy_version 279920 (0.0008) [2023-12-27 21:14:13,880][106225] Updated weights for policy 1, policy_version 279930 (0.0010) [2023-12-27 21:14:13,921][106226] Updated weights for policy 0, policy_version 279423 (0.0008) [2023-12-27 21:14:13,975][106226] Updated weights for policy 0, policy_version 279433 (0.0006) [2023-12-27 21:14:14,041][106226] Updated weights for policy 0, policy_version 279443 (0.0006) [2023-12-27 21:14:14,599][106226] Updated weights for policy 0, policy_version 279453 (0.0005) [2023-12-27 21:14:14,650][106226] Updated weights for policy 0, policy_version 279463 (0.0005) [2023-12-27 21:14:14,650][106225] Updated weights for policy 1, policy_version 279940 (0.0007) [2023-12-27 21:14:14,703][106225] Updated weights for policy 1, policy_version 279950 (0.0008) [2023-12-27 21:14:14,705][106226] Updated weights for policy 0, policy_version 279473 (0.0005) [2023-12-27 21:14:14,762][106225] Updated weights for policy 1, policy_version 279960 (0.0008) [2023-12-27 21:14:15,393][106225] Updated weights for policy 1, policy_version 279970 (0.0008) [2023-12-27 21:14:15,455][106225] Updated weights for policy 1, policy_version 279980 (0.0005) [2023-12-27 21:14:15,458][106226] Updated weights for policy 0, policy_version 279483 (0.0007) [2023-12-27 21:14:15,514][106225] Updated weights for policy 1, policy_version 279990 (0.0007) [2023-12-27 21:14:15,516][106226] Updated weights for policy 0, policy_version 279493 (0.0008) [2023-12-27 21:14:15,566][106225] Updated weights for policy 1, policy_version 280000 (0.0008) [2023-12-27 21:14:15,575][106226] Updated weights for policy 0, policy_version 279503 (0.0006) [2023-12-27 21:14:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 143278080. Throughput: 0: 9992.0, 1: 9825.5. Samples: 143271024. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:16,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.794')] [2023-12-27 21:14:16,248][106225] Updated weights for policy 1, policy_version 280010 (0.0005) [2023-12-27 21:14:16,288][106226] Updated weights for policy 0, policy_version 279513 (0.0009) [2023-12-27 21:14:16,310][106225] Updated weights for policy 1, policy_version 280020 (0.0009) [2023-12-27 21:14:16,343][106226] Updated weights for policy 0, policy_version 279523 (0.0005) [2023-12-27 21:14:16,362][106225] Updated weights for policy 1, policy_version 280030 (0.0009) [2023-12-27 21:14:16,408][106226] Updated weights for policy 0, policy_version 279533 (0.0009) [2023-12-27 21:14:16,462][106226] Updated weights for policy 0, policy_version 279543 (0.0009) [2023-12-27 21:14:16,976][106225] Updated weights for policy 1, policy_version 280040 (0.0010) [2023-12-27 21:14:17,034][106225] Updated weights for policy 1, policy_version 280050 (0.0010) [2023-12-27 21:14:17,091][106225] Updated weights for policy 1, policy_version 280060 (0.0010) [2023-12-27 21:14:17,196][106226] Updated weights for policy 0, policy_version 279553 (0.0008) [2023-12-27 21:14:17,256][106226] Updated weights for policy 0, policy_version 279563 (0.0008) [2023-12-27 21:14:17,302][106226] Updated weights for policy 0, policy_version 279573 (0.0007) [2023-12-27 21:14:17,808][106225] Updated weights for policy 1, policy_version 280070 (0.0010) [2023-12-27 21:14:17,854][106225] Updated weights for policy 1, policy_version 280080 (0.0010) [2023-12-27 21:14:17,897][106225] Updated weights for policy 1, policy_version 280090 (0.0010) [2023-12-27 21:14:18,013][106226] Updated weights for policy 0, policy_version 279583 (0.0009) [2023-12-27 21:14:18,074][106226] Updated weights for policy 0, policy_version 279593 (0.0009) [2023-12-27 21:14:18,140][106226] Updated weights for policy 0, policy_version 279603 (0.0006) [2023-12-27 21:14:18,559][106225] Updated weights for policy 1, policy_version 280100 (0.0008) [2023-12-27 21:14:18,618][106225] Updated weights for policy 1, policy_version 280110 (0.0007) [2023-12-27 21:14:18,675][106225] Updated weights for policy 1, policy_version 280120 (0.0008) [2023-12-27 21:14:18,870][106226] Updated weights for policy 0, policy_version 279613 (0.0008) [2023-12-27 21:14:18,919][106226] Updated weights for policy 0, policy_version 279623 (0.0009) [2023-12-27 21:14:18,968][106226] Updated weights for policy 0, policy_version 279633 (0.0009) [2023-12-27 21:14:19,331][106225] Updated weights for policy 1, policy_version 280130 (0.0009) [2023-12-27 21:14:19,400][106225] Updated weights for policy 1, policy_version 280140 (0.0008) [2023-12-27 21:14:19,451][106225] Updated weights for policy 1, policy_version 280150 (0.0006) [2023-12-27 21:14:19,517][106225] Updated weights for policy 1, policy_version 280160 (0.0007) [2023-12-27 21:14:19,821][106226] Updated weights for policy 0, policy_version 279643 (0.0009) [2023-12-27 21:14:19,894][106226] Updated weights for policy 0, policy_version 279653 (0.0009) [2023-12-27 21:14:19,965][106226] Updated weights for policy 0, policy_version 279663 (0.0009) [2023-12-27 21:14:20,218][106225] Updated weights for policy 1, policy_version 280170 (0.0009) [2023-12-27 21:14:20,281][106225] Updated weights for policy 1, policy_version 280180 (0.0008) [2023-12-27 21:14:20,341][106225] Updated weights for policy 1, policy_version 280190 (0.0008) [2023-12-27 21:14:20,710][106226] Updated weights for policy 0, policy_version 279673 (0.0008) [2023-12-27 21:14:20,773][106226] Updated weights for policy 0, policy_version 279683 (0.0011) [2023-12-27 21:14:20,837][106226] Updated weights for policy 0, policy_version 279693 (0.0011) [2023-12-27 21:14:20,899][106226] Updated weights for policy 0, policy_version 279703 (0.0011) [2023-12-27 21:14:21,121][106225] Updated weights for policy 1, policy_version 280200 (0.0008) [2023-12-27 21:14:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 143376384. Throughput: 0: 9865.9, 1: 9853.8. Samples: 143388068. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:21,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.727')] [2023-12-27 21:14:21,185][106225] Updated weights for policy 1, policy_version 280210 (0.0008) [2023-12-27 21:14:21,244][106225] Updated weights for policy 1, policy_version 280220 (0.0007) [2023-12-27 21:14:21,748][106226] Updated weights for policy 0, policy_version 279713 (0.0011) [2023-12-27 21:14:21,811][106226] Updated weights for policy 0, policy_version 279723 (0.0010) [2023-12-27 21:14:21,873][106226] Updated weights for policy 0, policy_version 279733 (0.0011) [2023-12-27 21:14:22,009][106225] Updated weights for policy 1, policy_version 280230 (0.0009) [2023-12-27 21:14:22,069][106225] Updated weights for policy 1, policy_version 280240 (0.0010) [2023-12-27 21:14:22,123][106225] Updated weights for policy 1, policy_version 280250 (0.0010) [2023-12-27 21:14:22,632][106226] Updated weights for policy 0, policy_version 279743 (0.0011) [2023-12-27 21:14:22,687][106226] Updated weights for policy 0, policy_version 279753 (0.0010) [2023-12-27 21:14:22,741][106226] Updated weights for policy 0, policy_version 279763 (0.0011) [2023-12-27 21:14:22,890][106225] Updated weights for policy 1, policy_version 280260 (0.0011) [2023-12-27 21:14:22,943][106225] Updated weights for policy 1, policy_version 280270 (0.0010) [2023-12-27 21:14:22,995][106225] Updated weights for policy 1, policy_version 280280 (0.0010) [2023-12-27 21:14:23,477][106226] Updated weights for policy 0, policy_version 279773 (0.0010) [2023-12-27 21:14:23,530][106226] Updated weights for policy 0, policy_version 279783 (0.0009) [2023-12-27 21:14:23,597][106226] Updated weights for policy 0, policy_version 279793 (0.0005) [2023-12-27 21:14:23,727][106225] Updated weights for policy 1, policy_version 280290 (0.0010) [2023-12-27 21:14:23,783][106225] Updated weights for policy 1, policy_version 280300 (0.0010) [2023-12-27 21:14:23,843][106225] Updated weights for policy 1, policy_version 280310 (0.0010) [2023-12-27 21:14:23,914][106225] Updated weights for policy 1, policy_version 280320 (0.0008) [2023-12-27 21:14:24,193][106226] Updated weights for policy 0, policy_version 279803 (0.0007) [2023-12-27 21:14:24,256][106226] Updated weights for policy 0, policy_version 279813 (0.0009) [2023-12-27 21:14:24,318][106226] Updated weights for policy 0, policy_version 279823 (0.0008) [2023-12-27 21:14:24,584][106225] Updated weights for policy 1, policy_version 280330 (0.0005) [2023-12-27 21:14:24,650][106225] Updated weights for policy 1, policy_version 280340 (0.0005) [2023-12-27 21:14:24,718][106225] Updated weights for policy 1, policy_version 280350 (0.0009) [2023-12-27 21:14:25,078][106226] Updated weights for policy 0, policy_version 279833 (0.0009) [2023-12-27 21:14:25,142][106226] Updated weights for policy 0, policy_version 279843 (0.0011) [2023-12-27 21:14:25,203][106226] Updated weights for policy 0, policy_version 279853 (0.0011) [2023-12-27 21:14:25,270][106226] Updated weights for policy 0, policy_version 279863 (0.0010) [2023-12-27 21:14:25,401][106225] Updated weights for policy 1, policy_version 280360 (0.0007) [2023-12-27 21:14:25,456][106225] Updated weights for policy 1, policy_version 280370 (0.0007) [2023-12-27 21:14:25,504][106225] Updated weights for policy 1, policy_version 280380 (0.0008) [2023-12-27 21:14:25,973][106226] Updated weights for policy 0, policy_version 279873 (0.0010) [2023-12-27 21:14:26,033][106226] Updated weights for policy 0, policy_version 279883 (0.0010) [2023-12-27 21:14:26,079][106226] Updated weights for policy 0, policy_version 279893 (0.0010) [2023-12-27 21:14:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 143474688. Throughput: 0: 9843.8, 1: 9776.0. Samples: 143445336. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:26,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-5.962')] [2023-12-27 21:14:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000279896_71680000.pth... [2023-12-27 21:14:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000278744_71385088.pth [2023-12-27 21:14:26,206][106225] Updated weights for policy 1, policy_version 280390 (0.0007) [2023-12-27 21:14:26,259][106225] Updated weights for policy 1, policy_version 280400 (0.0008) [2023-12-27 21:14:26,302][106225] Updated weights for policy 1, policy_version 280410 (0.0007) [2023-12-27 21:14:26,333][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000280416_71802880.pth... [2023-12-27 21:14:26,336][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000279264_71507968.pth [2023-12-27 21:14:26,754][106226] Updated weights for policy 0, policy_version 279903 (0.0007) [2023-12-27 21:14:26,819][106226] Updated weights for policy 0, policy_version 279913 (0.0008) [2023-12-27 21:14:26,879][106226] Updated weights for policy 0, policy_version 279923 (0.0011) [2023-12-27 21:14:26,994][106225] Updated weights for policy 1, policy_version 280420 (0.0007) [2023-12-27 21:14:27,046][106225] Updated weights for policy 1, policy_version 280430 (0.0005) [2023-12-27 21:14:27,096][106225] Updated weights for policy 1, policy_version 280440 (0.0005) [2023-12-27 21:14:27,528][106226] Updated weights for policy 0, policy_version 279933 (0.0010) [2023-12-27 21:14:27,588][106226] Updated weights for policy 0, policy_version 279943 (0.0010) [2023-12-27 21:14:27,642][106226] Updated weights for policy 0, policy_version 279953 (0.0006) [2023-12-27 21:14:27,783][106225] Updated weights for policy 1, policy_version 280450 (0.0006) [2023-12-27 21:14:27,831][106225] Updated weights for policy 1, policy_version 280460 (0.0008) [2023-12-27 21:14:27,883][106225] Updated weights for policy 1, policy_version 280470 (0.0007) [2023-12-27 21:14:27,930][106225] Updated weights for policy 1, policy_version 280480 (0.0008) [2023-12-27 21:14:28,185][106226] Updated weights for policy 0, policy_version 279963 (0.0005) [2023-12-27 21:14:28,236][106226] Updated weights for policy 0, policy_version 279973 (0.0005) [2023-12-27 21:14:28,281][106226] Updated weights for policy 0, policy_version 279983 (0.0005) [2023-12-27 21:14:28,713][106225] Updated weights for policy 1, policy_version 280490 (0.0006) [2023-12-27 21:14:28,779][106225] Updated weights for policy 1, policy_version 280500 (0.0005) [2023-12-27 21:14:28,845][106225] Updated weights for policy 1, policy_version 280510 (0.0006) [2023-12-27 21:14:28,953][106226] Updated weights for policy 0, policy_version 279993 (0.0006) [2023-12-27 21:14:29,013][106226] Updated weights for policy 0, policy_version 280003 (0.0009) [2023-12-27 21:14:29,070][106226] Updated weights for policy 0, policy_version 280013 (0.0008) [2023-12-27 21:14:29,122][106226] Updated weights for policy 0, policy_version 280023 (0.0005) [2023-12-27 21:14:29,474][106225] Updated weights for policy 1, policy_version 280520 (0.0010) [2023-12-27 21:14:29,530][106225] Updated weights for policy 1, policy_version 280530 (0.0010) [2023-12-27 21:14:29,586][106225] Updated weights for policy 1, policy_version 280540 (0.0010) [2023-12-27 21:14:29,806][106226] Updated weights for policy 0, policy_version 280033 (0.0010) [2023-12-27 21:14:29,872][106226] Updated weights for policy 0, policy_version 280043 (0.0010) [2023-12-27 21:14:29,936][106226] Updated weights for policy 0, policy_version 280053 (0.0008) [2023-12-27 21:14:30,302][106225] Updated weights for policy 1, policy_version 280550 (0.0010) [2023-12-27 21:14:30,362][106225] Updated weights for policy 1, policy_version 280560 (0.0010) [2023-12-27 21:14:30,415][106225] Updated weights for policy 1, policy_version 280570 (0.0007) [2023-12-27 21:14:30,546][106226] Updated weights for policy 0, policy_version 280063 (0.0006) [2023-12-27 21:14:30,597][106226] Updated weights for policy 0, policy_version 280073 (0.0007) [2023-12-27 21:14:30,650][106226] Updated weights for policy 0, policy_version 280083 (0.0010) [2023-12-27 21:14:31,168][106225] Updated weights for policy 1, policy_version 280580 (0.0009) [2023-12-27 21:14:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 143572992. Throughput: 0: 9902.4, 1: 9811.0. Samples: 143566292. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-27 21:14:31,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.803')] [2023-12-27 21:14:31,223][106225] Updated weights for policy 1, policy_version 280590 (0.0007) [2023-12-27 21:14:31,286][106225] Updated weights for policy 1, policy_version 280600 (0.0008) [2023-12-27 21:14:31,340][106226] Updated weights for policy 0, policy_version 280093 (0.0010) [2023-12-27 21:14:31,405][106226] Updated weights for policy 0, policy_version 280103 (0.0008) [2023-12-27 21:14:31,459][106226] Updated weights for policy 0, policy_version 280113 (0.0008) [2023-12-27 21:14:32,090][106226] Updated weights for policy 0, policy_version 280123 (0.0008) [2023-12-27 21:14:32,118][106225] Updated weights for policy 1, policy_version 280610 (0.0008) [2023-12-27 21:14:32,143][106226] Updated weights for policy 0, policy_version 280133 (0.0008) [2023-12-27 21:14:32,173][106225] Updated weights for policy 1, policy_version 280620 (0.0006) [2023-12-27 21:14:32,199][106226] Updated weights for policy 0, policy_version 280143 (0.0007) [2023-12-27 21:14:32,229][106225] Updated weights for policy 1, policy_version 280630 (0.0007) [2023-12-27 21:14:32,288][106225] Updated weights for policy 1, policy_version 280640 (0.0008) [2023-12-27 21:14:32,918][106226] Updated weights for policy 0, policy_version 280153 (0.0006) [2023-12-27 21:14:32,967][106226] Updated weights for policy 0, policy_version 280163 (0.0008) [2023-12-27 21:14:33,035][106226] Updated weights for policy 0, policy_version 280173 (0.0007) [2023-12-27 21:14:33,056][106225] Updated weights for policy 1, policy_version 280650 (0.0007) [2023-12-27 21:14:33,086][106226] Updated weights for policy 0, policy_version 280183 (0.0006) [2023-12-27 21:14:33,100][106225] Updated weights for policy 1, policy_version 280660 (0.0007) [2023-12-27 21:14:33,150][106225] Updated weights for policy 1, policy_version 280670 (0.0008) [2023-12-27 21:14:33,701][106226] Updated weights for policy 0, policy_version 280193 (0.0008) [2023-12-27 21:14:33,749][106226] Updated weights for policy 0, policy_version 280203 (0.0009) [2023-12-27 21:14:33,807][106226] Updated weights for policy 0, policy_version 280213 (0.0010) [2023-12-27 21:14:33,905][106225] Updated weights for policy 1, policy_version 280680 (0.0006) [2023-12-27 21:14:33,956][106225] Updated weights for policy 1, policy_version 280690 (0.0008) [2023-12-27 21:14:34,003][106225] Updated weights for policy 1, policy_version 280700 (0.0008) [2023-12-27 21:14:34,480][106226] Updated weights for policy 0, policy_version 280223 (0.0007) [2023-12-27 21:14:34,542][106226] Updated weights for policy 0, policy_version 280233 (0.0008) [2023-12-27 21:14:34,602][106226] Updated weights for policy 0, policy_version 280243 (0.0009) [2023-12-27 21:14:34,725][106225] Updated weights for policy 1, policy_version 280711 (0.0008) [2023-12-27 21:14:34,781][106225] Updated weights for policy 1, policy_version 280721 (0.0008) [2023-12-27 21:14:34,826][106225] Updated weights for policy 1, policy_version 280731 (0.0008) [2023-12-27 21:14:35,309][106226] Updated weights for policy 0, policy_version 280253 (0.0006) [2023-12-27 21:14:35,371][106226] Updated weights for policy 0, policy_version 280263 (0.0006) [2023-12-27 21:14:35,436][106226] Updated weights for policy 0, policy_version 280273 (0.0005) [2023-12-27 21:14:35,610][106225] Updated weights for policy 1, policy_version 280741 (0.0008) [2023-12-27 21:14:35,663][106225] Updated weights for policy 1, policy_version 280751 (0.0008) [2023-12-27 21:14:35,719][106225] Updated weights for policy 1, policy_version 280761 (0.0009) [2023-12-27 21:14:36,006][106226] Updated weights for policy 0, policy_version 280283 (0.0009) [2023-12-27 21:14:36,055][106226] Updated weights for policy 0, policy_version 280293 (0.0007) [2023-12-27 21:14:36,119][106226] Updated weights for policy 0, policy_version 280303 (0.0010) [2023-12-27 21:14:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 143671296. Throughput: 0: 9947.6, 1: 9669.4. Samples: 143685568. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:14:36,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-5.716')] [2023-12-27 21:14:36,471][106225] Updated weights for policy 1, policy_version 280771 (0.0007) [2023-12-27 21:14:36,531][106225] Updated weights for policy 1, policy_version 280781 (0.0010) [2023-12-27 21:14:36,593][106225] Updated weights for policy 1, policy_version 280791 (0.0011) [2023-12-27 21:14:36,803][106226] Updated weights for policy 0, policy_version 280313 (0.0007) [2023-12-27 21:14:36,867][106226] Updated weights for policy 0, policy_version 280323 (0.0006) [2023-12-27 21:14:36,931][106226] Updated weights for policy 0, policy_version 280333 (0.0006) [2023-12-27 21:14:36,993][106226] Updated weights for policy 0, policy_version 280343 (0.0009) [2023-12-27 21:14:37,273][106225] Updated weights for policy 1, policy_version 280801 (0.0010) [2023-12-27 21:14:37,330][106225] Updated weights for policy 1, policy_version 280811 (0.0010) [2023-12-27 21:14:37,390][106225] Updated weights for policy 1, policy_version 280821 (0.0010) [2023-12-27 21:14:37,450][106225] Updated weights for policy 1, policy_version 280831 (0.0010) [2023-12-27 21:14:37,670][106226] Updated weights for policy 0, policy_version 280353 (0.0011) [2023-12-27 21:14:37,735][106226] Updated weights for policy 0, policy_version 280363 (0.0011) [2023-12-27 21:14:37,799][106226] Updated weights for policy 0, policy_version 280373 (0.0011) [2023-12-27 21:14:38,127][106225] Updated weights for policy 1, policy_version 280841 (0.0006) [2023-12-27 21:14:38,185][106225] Updated weights for policy 1, policy_version 280851 (0.0005) [2023-12-27 21:14:38,241][106225] Updated weights for policy 1, policy_version 280861 (0.0005) [2023-12-27 21:14:38,512][106226] Updated weights for policy 0, policy_version 280383 (0.0011) [2023-12-27 21:14:38,579][106226] Updated weights for policy 0, policy_version 280393 (0.0010) [2023-12-27 21:14:38,641][106226] Updated weights for policy 0, policy_version 280403 (0.0011) [2023-12-27 21:14:38,860][106225] Updated weights for policy 1, policy_version 280871 (0.0007) [2023-12-27 21:14:38,922][106225] Updated weights for policy 1, policy_version 280881 (0.0008) [2023-12-27 21:14:38,979][106225] Updated weights for policy 1, policy_version 280891 (0.0005) [2023-12-27 21:14:39,347][106226] Updated weights for policy 0, policy_version 280413 (0.0010) [2023-12-27 21:14:39,419][106226] Updated weights for policy 0, policy_version 280423 (0.0009) [2023-12-27 21:14:39,480][106226] Updated weights for policy 0, policy_version 280433 (0.0006) [2023-12-27 21:14:39,719][106225] Updated weights for policy 1, policy_version 280901 (0.0007) [2023-12-27 21:14:39,786][106225] Updated weights for policy 1, policy_version 280911 (0.0009) [2023-12-27 21:14:39,858][106225] Updated weights for policy 1, policy_version 280921 (0.0009) [2023-12-27 21:14:40,132][106226] Updated weights for policy 0, policy_version 280443 (0.0006) [2023-12-27 21:14:40,203][106226] Updated weights for policy 0, policy_version 280453 (0.0009) [2023-12-27 21:14:40,267][106226] Updated weights for policy 0, policy_version 280463 (0.0007) [2023-12-27 21:14:40,628][106225] Updated weights for policy 1, policy_version 280931 (0.0008) [2023-12-27 21:14:40,685][106225] Updated weights for policy 1, policy_version 280941 (0.0005) [2023-12-27 21:14:40,744][106225] Updated weights for policy 1, policy_version 280951 (0.0009) [2023-12-27 21:14:41,040][106226] Updated weights for policy 0, policy_version 280473 (0.0009) [2023-12-27 21:14:41,104][106226] Updated weights for policy 0, policy_version 280483 (0.0008) [2023-12-27 21:14:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 143769600. Throughput: 0: 9950.2, 1: 9729.1. Samples: 143745184. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:14:41,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.838')] [2023-12-27 21:14:41,178][106226] Updated weights for policy 0, policy_version 280493 (0.0008) [2023-12-27 21:14:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000280960_71942144.pth... [2023-12-27 21:14:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000279808_71647232.pth [2023-12-27 21:14:41,248][106226] Updated weights for policy 0, policy_version 280503 (0.0006) [2023-12-27 21:14:41,254][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000280504_71835648.pth... [2023-12-27 21:14:41,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000279320_71532544.pth [2023-12-27 21:14:41,449][106225] Updated weights for policy 1, policy_version 280961 (0.0007) [2023-12-27 21:14:41,516][106225] Updated weights for policy 1, policy_version 280971 (0.0008) [2023-12-27 21:14:41,585][106225] Updated weights for policy 1, policy_version 280981 (0.0009) [2023-12-27 21:14:41,656][106225] Updated weights for policy 1, policy_version 280991 (0.0008) [2023-12-27 21:14:42,066][106226] Updated weights for policy 0, policy_version 280513 (0.0009) [2023-12-27 21:14:42,129][106226] Updated weights for policy 0, policy_version 280523 (0.0009) [2023-12-27 21:14:42,189][106226] Updated weights for policy 0, policy_version 280533 (0.0009) [2023-12-27 21:14:42,399][106225] Updated weights for policy 1, policy_version 281001 (0.0008) [2023-12-27 21:14:42,463][106225] Updated weights for policy 1, policy_version 281011 (0.0008) [2023-12-27 21:14:42,528][106225] Updated weights for policy 1, policy_version 281021 (0.0009) [2023-12-27 21:14:42,868][106226] Updated weights for policy 0, policy_version 280543 (0.0009) [2023-12-27 21:14:42,932][106226] Updated weights for policy 0, policy_version 280553 (0.0008) [2023-12-27 21:14:42,991][106226] Updated weights for policy 0, policy_version 280563 (0.0008) [2023-12-27 21:14:43,289][106225] Updated weights for policy 1, policy_version 281031 (0.0009) [2023-12-27 21:14:43,339][106225] Updated weights for policy 1, policy_version 281041 (0.0008) [2023-12-27 21:14:43,394][106225] Updated weights for policy 1, policy_version 281051 (0.0008) [2023-12-27 21:14:43,659][106226] Updated weights for policy 0, policy_version 280573 (0.0008) [2023-12-27 21:14:43,712][106226] Updated weights for policy 0, policy_version 280584 (0.0009) [2023-12-27 21:14:43,774][106226] Updated weights for policy 0, policy_version 280594 (0.0010) [2023-12-27 21:14:44,048][106225] Updated weights for policy 1, policy_version 281061 (0.0007) [2023-12-27 21:14:44,099][106225] Updated weights for policy 1, policy_version 281071 (0.0007) [2023-12-27 21:14:44,168][106225] Updated weights for policy 1, policy_version 281081 (0.0008) [2023-12-27 21:14:44,463][106226] Updated weights for policy 0, policy_version 280604 (0.0007) [2023-12-27 21:14:44,514][106226] Updated weights for policy 0, policy_version 280614 (0.0005) [2023-12-27 21:14:44,563][106226] Updated weights for policy 0, policy_version 280624 (0.0005) [2023-12-27 21:14:44,871][106225] Updated weights for policy 1, policy_version 281091 (0.0008) [2023-12-27 21:14:44,936][106225] Updated weights for policy 1, policy_version 281101 (0.0008) [2023-12-27 21:14:45,002][106225] Updated weights for policy 1, policy_version 281111 (0.0010) [2023-12-27 21:14:45,226][106226] Updated weights for policy 0, policy_version 280634 (0.0006) [2023-12-27 21:14:45,293][106226] Updated weights for policy 0, policy_version 280644 (0.0010) [2023-12-27 21:14:45,355][106226] Updated weights for policy 0, policy_version 280654 (0.0011) [2023-12-27 21:14:45,409][106226] Updated weights for policy 0, policy_version 280664 (0.0011) [2023-12-27 21:14:45,712][106225] Updated weights for policy 1, policy_version 281121 (0.0010) [2023-12-27 21:14:45,765][106225] Updated weights for policy 1, policy_version 281131 (0.0010) [2023-12-27 21:14:45,822][106225] Updated weights for policy 1, policy_version 281141 (0.0008) [2023-12-27 21:14:45,881][106225] Updated weights for policy 1, policy_version 281151 (0.0009) [2023-12-27 21:14:46,082][106226] Updated weights for policy 0, policy_version 280674 (0.0006) [2023-12-27 21:14:46,148][106226] Updated weights for policy 0, policy_version 280684 (0.0006) [2023-12-27 21:14:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 143867904. Throughput: 0: 9853.6, 1: 9696.7. Samples: 143860312. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:14:46,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.341')] [2023-12-27 21:14:46,176][106141] Saving new best policy, reward=-5.341! [2023-12-27 21:14:46,208][106226] Updated weights for policy 0, policy_version 280694 (0.0008) [2023-12-27 21:14:46,571][106225] Updated weights for policy 1, policy_version 281161 (0.0010) [2023-12-27 21:14:46,624][106225] Updated weights for policy 1, policy_version 281171 (0.0010) [2023-12-27 21:14:46,674][106225] Updated weights for policy 1, policy_version 281181 (0.0010) [2023-12-27 21:14:46,812][106226] Updated weights for policy 0, policy_version 280704 (0.0007) [2023-12-27 21:14:46,860][106226] Updated weights for policy 0, policy_version 280715 (0.0008) [2023-12-27 21:14:46,910][106226] Updated weights for policy 0, policy_version 280725 (0.0008) [2023-12-27 21:14:47,316][106225] Updated weights for policy 1, policy_version 281191 (0.0007) [2023-12-27 21:14:47,369][106225] Updated weights for policy 1, policy_version 281201 (0.0010) [2023-12-27 21:14:47,418][106225] Updated weights for policy 1, policy_version 281211 (0.0010) [2023-12-27 21:14:47,710][106226] Updated weights for policy 0, policy_version 280735 (0.0010) [2023-12-27 21:14:47,767][106226] Updated weights for policy 0, policy_version 280745 (0.0010) [2023-12-27 21:14:47,819][106226] Updated weights for policy 0, policy_version 280755 (0.0010) [2023-12-27 21:14:48,070][106225] Updated weights for policy 1, policy_version 281221 (0.0008) [2023-12-27 21:14:48,129][106225] Updated weights for policy 1, policy_version 281231 (0.0009) [2023-12-27 21:14:48,196][106225] Updated weights for policy 1, policy_version 281241 (0.0008) [2023-12-27 21:14:48,509][106226] Updated weights for policy 0, policy_version 280765 (0.0008) [2023-12-27 21:14:48,565][106226] Updated weights for policy 0, policy_version 280775 (0.0006) [2023-12-27 21:14:48,616][106226] Updated weights for policy 0, policy_version 280785 (0.0008) [2023-12-27 21:14:48,894][106225] Updated weights for policy 1, policy_version 281251 (0.0006) [2023-12-27 21:14:48,950][106225] Updated weights for policy 1, policy_version 281261 (0.0008) [2023-12-27 21:14:48,998][106225] Updated weights for policy 1, policy_version 281271 (0.0007) [2023-12-27 21:14:49,339][106226] Updated weights for policy 0, policy_version 280795 (0.0010) [2023-12-27 21:14:49,409][106226] Updated weights for policy 0, policy_version 280805 (0.0009) [2023-12-27 21:14:49,476][106226] Updated weights for policy 0, policy_version 280815 (0.0011) [2023-12-27 21:14:49,687][106225] Updated weights for policy 1, policy_version 281281 (0.0008) [2023-12-27 21:14:49,750][106225] Updated weights for policy 1, policy_version 281291 (0.0010) [2023-12-27 21:14:49,808][106225] Updated weights for policy 1, policy_version 281301 (0.0010) [2023-12-27 21:14:49,872][106225] Updated weights for policy 1, policy_version 281311 (0.0009) [2023-12-27 21:14:50,189][106226] Updated weights for policy 0, policy_version 280825 (0.0010) [2023-12-27 21:14:50,254][106226] Updated weights for policy 0, policy_version 280835 (0.0008) [2023-12-27 21:14:50,317][106226] Updated weights for policy 0, policy_version 280845 (0.0008) [2023-12-27 21:14:50,381][106226] Updated weights for policy 0, policy_version 280855 (0.0008) [2023-12-27 21:14:50,566][106225] Updated weights for policy 1, policy_version 281321 (0.0009) [2023-12-27 21:14:50,638][106225] Updated weights for policy 1, policy_version 281331 (0.0008) [2023-12-27 21:14:50,696][106225] Updated weights for policy 1, policy_version 281341 (0.0008) [2023-12-27 21:14:51,109][106226] Updated weights for policy 0, policy_version 280865 (0.0006) [2023-12-27 21:14:51,172][106226] Updated weights for policy 0, policy_version 280875 (0.0007) [2023-12-27 21:14:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 143966208. Throughput: 0: 9843.0, 1: 9729.9. Samples: 143979452. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:14:51,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.860')] [2023-12-27 21:14:51,230][106226] Updated weights for policy 0, policy_version 280885 (0.0005) [2023-12-27 21:14:51,429][106225] Updated weights for policy 1, policy_version 281351 (0.0008) [2023-12-27 21:14:51,499][106225] Updated weights for policy 1, policy_version 281361 (0.0008) [2023-12-27 21:14:51,557][106225] Updated weights for policy 1, policy_version 281371 (0.0008) [2023-12-27 21:14:51,941][106226] Updated weights for policy 0, policy_version 280895 (0.0008) [2023-12-27 21:14:51,998][106226] Updated weights for policy 0, policy_version 280905 (0.0008) [2023-12-27 21:14:52,052][106226] Updated weights for policy 0, policy_version 280915 (0.0008) [2023-12-27 21:14:52,355][106225] Updated weights for policy 1, policy_version 281381 (0.0009) [2023-12-27 21:14:52,410][106225] Updated weights for policy 1, policy_version 281391 (0.0008) [2023-12-27 21:14:52,472][106225] Updated weights for policy 1, policy_version 281401 (0.0007) [2023-12-27 21:14:52,799][106226] Updated weights for policy 0, policy_version 280925 (0.0009) [2023-12-27 21:14:52,856][106226] Updated weights for policy 0, policy_version 280935 (0.0009) [2023-12-27 21:14:52,911][106226] Updated weights for policy 0, policy_version 280945 (0.0010) [2023-12-27 21:14:53,037][106225] Updated weights for policy 1, policy_version 281411 (0.0006) [2023-12-27 21:14:53,101][106225] Updated weights for policy 1, policy_version 281421 (0.0008) [2023-12-27 21:14:53,164][106225] Updated weights for policy 1, policy_version 281431 (0.0007) [2023-12-27 21:14:53,735][106226] Updated weights for policy 0, policy_version 280955 (0.0007) [2023-12-27 21:14:53,744][106225] Updated weights for policy 1, policy_version 281441 (0.0007) [2023-12-27 21:14:53,792][106226] Updated weights for policy 0, policy_version 280965 (0.0008) [2023-12-27 21:14:53,807][106225] Updated weights for policy 1, policy_version 281451 (0.0010) [2023-12-27 21:14:53,847][106226] Updated weights for policy 0, policy_version 280975 (0.0006) [2023-12-27 21:14:53,861][106225] Updated weights for policy 1, policy_version 281461 (0.0009) [2023-12-27 21:14:53,905][106225] Updated weights for policy 1, policy_version 281471 (0.0007) [2023-12-27 21:14:54,548][106225] Updated weights for policy 1, policy_version 281481 (0.0008) [2023-12-27 21:14:54,603][106225] Updated weights for policy 1, policy_version 281491 (0.0009) [2023-12-27 21:14:54,612][106226] Updated weights for policy 0, policy_version 280985 (0.0007) [2023-12-27 21:14:54,665][106225] Updated weights for policy 1, policy_version 281501 (0.0007) [2023-12-27 21:14:54,673][106226] Updated weights for policy 0, policy_version 280995 (0.0007) [2023-12-27 21:14:54,735][106226] Updated weights for policy 0, policy_version 281005 (0.0008) [2023-12-27 21:14:54,796][106226] Updated weights for policy 0, policy_version 281015 (0.0008) [2023-12-27 21:14:55,335][106225] Updated weights for policy 1, policy_version 281511 (0.0008) [2023-12-27 21:14:55,383][106225] Updated weights for policy 1, policy_version 281521 (0.0008) [2023-12-27 21:14:55,438][106225] Updated weights for policy 1, policy_version 281531 (0.0007) [2023-12-27 21:14:55,563][106226] Updated weights for policy 0, policy_version 281025 (0.0008) [2023-12-27 21:14:55,623][106226] Updated weights for policy 0, policy_version 281035 (0.0008) [2023-12-27 21:14:55,688][106226] Updated weights for policy 0, policy_version 281045 (0.0009) [2023-12-27 21:14:56,081][106225] Updated weights for policy 1, policy_version 281541 (0.0007) [2023-12-27 21:14:56,141][106225] Updated weights for policy 1, policy_version 281551 (0.0009) [2023-12-27 21:14:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 144064512. Throughput: 0: 9833.0, 1: 9780.2. Samples: 144038140. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:14:56,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.760')] [2023-12-27 21:14:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000281048_71974912.pth... [2023-12-27 21:14:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000279896_71680000.pth [2023-12-27 21:14:56,201][106225] Updated weights for policy 1, policy_version 281561 (0.0008) [2023-12-27 21:14:56,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000281568_72097792.pth... [2023-12-27 21:14:56,241][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000280416_71802880.pth [2023-12-27 21:14:56,437][106226] Updated weights for policy 0, policy_version 281055 (0.0007) [2023-12-27 21:14:56,483][106226] Updated weights for policy 0, policy_version 281065 (0.0005) [2023-12-27 21:14:56,531][106226] Updated weights for policy 0, policy_version 281075 (0.0005) [2023-12-27 21:14:56,909][106225] Updated weights for policy 1, policy_version 281571 (0.0008) [2023-12-27 21:14:56,952][106225] Updated weights for policy 1, policy_version 281581 (0.0010) [2023-12-27 21:14:56,998][106225] Updated weights for policy 1, policy_version 281591 (0.0010) [2023-12-27 21:14:57,063][106226] Updated weights for policy 0, policy_version 281085 (0.0005) [2023-12-27 21:14:57,108][106226] Updated weights for policy 0, policy_version 281095 (0.0005) [2023-12-27 21:14:57,152][106226] Updated weights for policy 0, policy_version 281105 (0.0007) [2023-12-27 21:14:57,584][106225] Updated weights for policy 1, policy_version 281601 (0.0010) [2023-12-27 21:14:57,634][106225] Updated weights for policy 1, policy_version 281611 (0.0007) [2023-12-27 21:14:57,686][106225] Updated weights for policy 1, policy_version 281621 (0.0010) [2023-12-27 21:14:57,732][106225] Updated weights for policy 1, policy_version 281631 (0.0010) [2023-12-27 21:14:57,939][106226] Updated weights for policy 0, policy_version 281115 (0.0009) [2023-12-27 21:14:58,001][106226] Updated weights for policy 0, policy_version 281125 (0.0009) [2023-12-27 21:14:58,069][106226] Updated weights for policy 0, policy_version 281135 (0.0009) [2023-12-27 21:14:58,360][106225] Updated weights for policy 1, policy_version 281641 (0.0010) [2023-12-27 21:14:58,429][106225] Updated weights for policy 1, policy_version 281651 (0.0008) [2023-12-27 21:14:58,489][106225] Updated weights for policy 1, policy_version 281661 (0.0008) [2023-12-27 21:14:58,876][106226] Updated weights for policy 0, policy_version 281145 (0.0008) [2023-12-27 21:14:58,939][106226] Updated weights for policy 0, policy_version 281155 (0.0009) [2023-12-27 21:14:59,003][106226] Updated weights for policy 0, policy_version 281165 (0.0007) [2023-12-27 21:14:59,065][106226] Updated weights for policy 0, policy_version 281175 (0.0008) [2023-12-27 21:14:59,316][106225] Updated weights for policy 1, policy_version 281671 (0.0007) [2023-12-27 21:14:59,384][106225] Updated weights for policy 1, policy_version 281681 (0.0010) [2023-12-27 21:14:59,443][106225] Updated weights for policy 1, policy_version 281691 (0.0009) [2023-12-27 21:14:59,855][106226] Updated weights for policy 0, policy_version 281185 (0.0010) [2023-12-27 21:14:59,917][106226] Updated weights for policy 0, policy_version 281195 (0.0010) [2023-12-27 21:14:59,978][106226] Updated weights for policy 0, policy_version 281205 (0.0012) [2023-12-27 21:15:00,109][106225] Updated weights for policy 1, policy_version 281701 (0.0005) [2023-12-27 21:15:00,158][106225] Updated weights for policy 1, policy_version 281711 (0.0006) [2023-12-27 21:15:00,208][106225] Updated weights for policy 1, policy_version 281721 (0.0008) [2023-12-27 21:15:00,686][106226] Updated weights for policy 0, policy_version 281215 (0.0009) [2023-12-27 21:15:00,739][106226] Updated weights for policy 0, policy_version 281225 (0.0008) [2023-12-27 21:15:00,795][106226] Updated weights for policy 0, policy_version 281235 (0.0008) [2023-12-27 21:15:00,918][106225] Updated weights for policy 1, policy_version 281731 (0.0008) [2023-12-27 21:15:00,966][106225] Updated weights for policy 1, policy_version 281741 (0.0008) [2023-12-27 21:15:01,017][106225] Updated weights for policy 1, policy_version 281751 (0.0008) [2023-12-27 21:15:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 144171008. Throughput: 0: 9773.1, 1: 9905.2. Samples: 144156552. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:01,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.605')] [2023-12-27 21:15:01,519][106226] Updated weights for policy 0, policy_version 281245 (0.0008) [2023-12-27 21:15:01,565][106226] Updated weights for policy 0, policy_version 281255 (0.0007) [2023-12-27 21:15:01,627][106226] Updated weights for policy 0, policy_version 281265 (0.0007) [2023-12-27 21:15:01,776][106225] Updated weights for policy 1, policy_version 281761 (0.0008) [2023-12-27 21:15:01,841][106225] Updated weights for policy 1, policy_version 281771 (0.0008) [2023-12-27 21:15:01,901][106225] Updated weights for policy 1, policy_version 281781 (0.0007) [2023-12-27 21:15:01,959][106225] Updated weights for policy 1, policy_version 281791 (0.0009) [2023-12-27 21:15:02,318][106226] Updated weights for policy 0, policy_version 281275 (0.0008) [2023-12-27 21:15:02,381][106226] Updated weights for policy 0, policy_version 281285 (0.0008) [2023-12-27 21:15:02,443][106226] Updated weights for policy 0, policy_version 281295 (0.0009) [2023-12-27 21:15:02,702][106225] Updated weights for policy 1, policy_version 281801 (0.0008) [2023-12-27 21:15:02,762][106225] Updated weights for policy 1, policy_version 281811 (0.0008) [2023-12-27 21:15:02,823][106225] Updated weights for policy 1, policy_version 281821 (0.0009) [2023-12-27 21:15:03,128][106226] Updated weights for policy 0, policy_version 281305 (0.0008) [2023-12-27 21:15:03,194][106226] Updated weights for policy 0, policy_version 281315 (0.0009) [2023-12-27 21:15:03,258][106226] Updated weights for policy 0, policy_version 281325 (0.0009) [2023-12-27 21:15:03,323][106226] Updated weights for policy 0, policy_version 281335 (0.0010) [2023-12-27 21:15:03,401][106225] Updated weights for policy 1, policy_version 281831 (0.0008) [2023-12-27 21:15:03,448][106225] Updated weights for policy 1, policy_version 281841 (0.0008) [2023-12-27 21:15:03,497][106225] Updated weights for policy 1, policy_version 281851 (0.0007) [2023-12-27 21:15:04,061][106226] Updated weights for policy 0, policy_version 281345 (0.0008) [2023-12-27 21:15:04,130][106226] Updated weights for policy 0, policy_version 281355 (0.0009) [2023-12-27 21:15:04,190][106226] Updated weights for policy 0, policy_version 281365 (0.0009) [2023-12-27 21:15:04,272][106225] Updated weights for policy 1, policy_version 281861 (0.0009) [2023-12-27 21:15:04,338][106225] Updated weights for policy 1, policy_version 281871 (0.0008) [2023-12-27 21:15:04,394][106225] Updated weights for policy 1, policy_version 281881 (0.0008) [2023-12-27 21:15:04,933][106226] Updated weights for policy 0, policy_version 281375 (0.0008) [2023-12-27 21:15:04,992][106226] Updated weights for policy 0, policy_version 281385 (0.0006) [2023-12-27 21:15:05,058][106226] Updated weights for policy 0, policy_version 281395 (0.0008) [2023-12-27 21:15:05,133][106225] Updated weights for policy 1, policy_version 281891 (0.0009) [2023-12-27 21:15:05,195][106225] Updated weights for policy 1, policy_version 281901 (0.0008) [2023-12-27 21:15:05,250][106225] Updated weights for policy 1, policy_version 281911 (0.0009) [2023-12-27 21:15:05,714][106226] Updated weights for policy 0, policy_version 281405 (0.0008) [2023-12-27 21:15:05,765][106226] Updated weights for policy 0, policy_version 281415 (0.0008) [2023-12-27 21:15:05,820][106226] Updated weights for policy 0, policy_version 281425 (0.0007) [2023-12-27 21:15:05,992][106225] Updated weights for policy 1, policy_version 281921 (0.0008) [2023-12-27 21:15:06,046][106225] Updated weights for policy 1, policy_version 281931 (0.0008) [2023-12-27 21:15:06,103][106225] Updated weights for policy 1, policy_version 281941 (0.0007) [2023-12-27 21:15:06,166][106225] Updated weights for policy 1, policy_version 281951 (0.0008) [2023-12-27 21:15:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 144269312. Throughput: 0: 9847.7, 1: 9840.2. Samples: 144274024. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:06,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.535')] [2023-12-27 21:15:06,540][106226] Updated weights for policy 0, policy_version 281435 (0.0007) [2023-12-27 21:15:06,598][106226] Updated weights for policy 0, policy_version 281445 (0.0011) [2023-12-27 21:15:06,657][106226] Updated weights for policy 0, policy_version 281455 (0.0009) [2023-12-27 21:15:06,846][106225] Updated weights for policy 1, policy_version 281961 (0.0008) [2023-12-27 21:15:06,906][106225] Updated weights for policy 1, policy_version 281971 (0.0006) [2023-12-27 21:15:06,967][106225] Updated weights for policy 1, policy_version 281981 (0.0005) [2023-12-27 21:15:07,295][106226] Updated weights for policy 0, policy_version 281465 (0.0010) [2023-12-27 21:15:07,348][106226] Updated weights for policy 0, policy_version 281475 (0.0006) [2023-12-27 21:15:07,407][106226] Updated weights for policy 0, policy_version 281485 (0.0008) [2023-12-27 21:15:07,456][106226] Updated weights for policy 0, policy_version 281495 (0.0007) [2023-12-27 21:15:07,565][106225] Updated weights for policy 1, policy_version 281991 (0.0005) [2023-12-27 21:15:07,622][106225] Updated weights for policy 1, policy_version 282001 (0.0005) [2023-12-27 21:15:07,667][106225] Updated weights for policy 1, policy_version 282011 (0.0008) [2023-12-27 21:15:08,017][106226] Updated weights for policy 0, policy_version 281505 (0.0005) [2023-12-27 21:15:08,067][106226] Updated weights for policy 0, policy_version 281515 (0.0008) [2023-12-27 21:15:08,130][106226] Updated weights for policy 0, policy_version 281525 (0.0007) [2023-12-27 21:15:08,276][106225] Updated weights for policy 1, policy_version 282021 (0.0008) [2023-12-27 21:15:08,343][106225] Updated weights for policy 1, policy_version 282031 (0.0007) [2023-12-27 21:15:08,400][106225] Updated weights for policy 1, policy_version 282041 (0.0009) [2023-12-27 21:15:08,827][106226] Updated weights for policy 0, policy_version 281535 (0.0008) [2023-12-27 21:15:08,884][106226] Updated weights for policy 0, policy_version 281545 (0.0010) [2023-12-27 21:15:08,946][106226] Updated weights for policy 0, policy_version 281555 (0.0011) [2023-12-27 21:15:09,122][106225] Updated weights for policy 1, policy_version 282051 (0.0007) [2023-12-27 21:15:09,171][106225] Updated weights for policy 1, policy_version 282061 (0.0005) [2023-12-27 21:15:09,234][106225] Updated weights for policy 1, policy_version 282071 (0.0007) [2023-12-27 21:15:09,676][106226] Updated weights for policy 0, policy_version 281565 (0.0008) [2023-12-27 21:15:09,741][106226] Updated weights for policy 0, policy_version 281575 (0.0010) [2023-12-27 21:15:09,803][106226] Updated weights for policy 0, policy_version 281585 (0.0011) [2023-12-27 21:15:09,991][106225] Updated weights for policy 1, policy_version 282081 (0.0009) [2023-12-27 21:15:10,064][106225] Updated weights for policy 1, policy_version 282091 (0.0009) [2023-12-27 21:15:10,129][106225] Updated weights for policy 1, policy_version 282101 (0.0010) [2023-12-27 21:15:10,191][106225] Updated weights for policy 1, policy_version 282111 (0.0010) [2023-12-27 21:15:10,483][106226] Updated weights for policy 0, policy_version 281595 (0.0012) [2023-12-27 21:15:10,550][106226] Updated weights for policy 0, policy_version 281605 (0.0009) [2023-12-27 21:15:10,613][106226] Updated weights for policy 0, policy_version 281615 (0.0008) [2023-12-27 21:15:10,887][106225] Updated weights for policy 1, policy_version 282121 (0.0007) [2023-12-27 21:15:10,938][106225] Updated weights for policy 1, policy_version 282131 (0.0006) [2023-12-27 21:15:10,996][106225] Updated weights for policy 1, policy_version 282141 (0.0007) [2023-12-27 21:15:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 144367616. Throughput: 0: 9891.0, 1: 9917.6. Samples: 144336724. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:11,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.855')] [2023-12-27 21:15:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000282144_72245248.pth... [2023-12-27 21:15:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000281624_72122368.pth... [2023-12-27 21:15:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000280960_71942144.pth [2023-12-27 21:15:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000280504_71835648.pth [2023-12-27 21:15:11,424][106226] Updated weights for policy 0, policy_version 281625 (0.0009) [2023-12-27 21:15:11,490][106226] Updated weights for policy 0, policy_version 281635 (0.0010) [2023-12-27 21:15:11,545][106226] Updated weights for policy 0, policy_version 281645 (0.0009) [2023-12-27 21:15:11,591][106226] Updated weights for policy 0, policy_version 281655 (0.0009) [2023-12-27 21:15:11,713][106225] Updated weights for policy 1, policy_version 282151 (0.0008) [2023-12-27 21:15:11,780][106225] Updated weights for policy 1, policy_version 282161 (0.0009) [2023-12-27 21:15:11,839][106225] Updated weights for policy 1, policy_version 282171 (0.0009) [2023-12-27 21:15:12,456][106226] Updated weights for policy 0, policy_version 281665 (0.0008) [2023-12-27 21:15:12,521][106226] Updated weights for policy 0, policy_version 281675 (0.0006) [2023-12-27 21:15:12,541][106225] Updated weights for policy 1, policy_version 282181 (0.0007) [2023-12-27 21:15:12,582][106226] Updated weights for policy 0, policy_version 281685 (0.0009) [2023-12-27 21:15:12,603][106225] Updated weights for policy 1, policy_version 282191 (0.0007) [2023-12-27 21:15:12,655][106225] Updated weights for policy 1, policy_version 282201 (0.0005) [2023-12-27 21:15:13,340][106226] Updated weights for policy 0, policy_version 281695 (0.0006) [2023-12-27 21:15:13,365][106225] Updated weights for policy 1, policy_version 282211 (0.0008) [2023-12-27 21:15:13,396][106226] Updated weights for policy 0, policy_version 281705 (0.0005) [2023-12-27 21:15:13,426][106225] Updated weights for policy 1, policy_version 282221 (0.0008) [2023-12-27 21:15:13,444][106226] Updated weights for policy 0, policy_version 281715 (0.0006) [2023-12-27 21:15:13,482][106225] Updated weights for policy 1, policy_version 282231 (0.0010) [2023-12-27 21:15:14,022][106226] Updated weights for policy 0, policy_version 281725 (0.0005) [2023-12-27 21:15:14,094][106226] Updated weights for policy 0, policy_version 281735 (0.0006) [2023-12-27 21:15:14,151][106226] Updated weights for policy 0, policy_version 281745 (0.0008) [2023-12-27 21:15:14,173][106225] Updated weights for policy 1, policy_version 282241 (0.0010) [2023-12-27 21:15:14,240][106225] Updated weights for policy 1, policy_version 282251 (0.0007) [2023-12-27 21:15:14,298][106225] Updated weights for policy 1, policy_version 282261 (0.0007) [2023-12-27 21:15:14,359][106225] Updated weights for policy 1, policy_version 282271 (0.0008) [2023-12-27 21:15:14,818][106226] Updated weights for policy 0, policy_version 281755 (0.0010) [2023-12-27 21:15:14,878][106226] Updated weights for policy 0, policy_version 281765 (0.0008) [2023-12-27 21:15:14,935][106226] Updated weights for policy 0, policy_version 281775 (0.0009) [2023-12-27 21:15:15,039][106225] Updated weights for policy 1, policy_version 282281 (0.0009) [2023-12-27 21:15:15,101][106225] Updated weights for policy 1, policy_version 282291 (0.0009) [2023-12-27 21:15:15,160][106225] Updated weights for policy 1, policy_version 282301 (0.0008) [2023-12-27 21:15:15,733][106226] Updated weights for policy 0, policy_version 281785 (0.0008) [2023-12-27 21:15:15,764][106225] Updated weights for policy 1, policy_version 282311 (0.0008) [2023-12-27 21:15:15,797][106226] Updated weights for policy 0, policy_version 281795 (0.0009) [2023-12-27 21:15:15,816][106225] Updated weights for policy 1, policy_version 282321 (0.0006) [2023-12-27 21:15:15,854][106226] Updated weights for policy 0, policy_version 281805 (0.0007) [2023-12-27 21:15:15,861][106225] Updated weights for policy 1, policy_version 282331 (0.0007) [2023-12-27 21:15:15,906][106226] Updated weights for policy 0, policy_version 281815 (0.0006) [2023-12-27 21:15:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 144465920. Throughput: 0: 9801.1, 1: 9888.3. Samples: 144452312. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:16,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-5.856')] [2023-12-27 21:15:16,536][106225] Updated weights for policy 1, policy_version 282341 (0.0008) [2023-12-27 21:15:16,597][106225] Updated weights for policy 1, policy_version 282351 (0.0010) [2023-12-27 21:15:16,646][106226] Updated weights for policy 0, policy_version 281825 (0.0006) [2023-12-27 21:15:16,652][106225] Updated weights for policy 1, policy_version 282361 (0.0010) [2023-12-27 21:15:16,697][106226] Updated weights for policy 0, policy_version 281835 (0.0006) [2023-12-27 21:15:16,746][106226] Updated weights for policy 0, policy_version 281845 (0.0008) [2023-12-27 21:15:17,396][106225] Updated weights for policy 1, policy_version 282371 (0.0010) [2023-12-27 21:15:17,407][106226] Updated weights for policy 0, policy_version 281855 (0.0007) [2023-12-27 21:15:17,456][106226] Updated weights for policy 0, policy_version 281865 (0.0006) [2023-12-27 21:15:17,457][106225] Updated weights for policy 1, policy_version 282381 (0.0008) [2023-12-27 21:15:17,506][106226] Updated weights for policy 0, policy_version 281875 (0.0007) [2023-12-27 21:15:17,508][106225] Updated weights for policy 1, policy_version 282391 (0.0007) [2023-12-27 21:15:18,059][106225] Updated weights for policy 1, policy_version 282401 (0.0007) [2023-12-27 21:15:18,116][106225] Updated weights for policy 1, policy_version 282411 (0.0005) [2023-12-27 21:15:18,178][106226] Updated weights for policy 0, policy_version 281885 (0.0007) [2023-12-27 21:15:18,178][106225] Updated weights for policy 1, policy_version 282421 (0.0006) [2023-12-27 21:15:18,230][106225] Updated weights for policy 1, policy_version 282431 (0.0010) [2023-12-27 21:15:18,243][106226] Updated weights for policy 0, policy_version 281895 (0.0005) [2023-12-27 21:15:18,306][106226] Updated weights for policy 0, policy_version 281905 (0.0005) [2023-12-27 21:15:18,950][106226] Updated weights for policy 0, policy_version 281915 (0.0007) [2023-12-27 21:15:18,960][106225] Updated weights for policy 1, policy_version 282441 (0.0010) [2023-12-27 21:15:19,003][106226] Updated weights for policy 0, policy_version 281925 (0.0008) [2023-12-27 21:15:19,014][106225] Updated weights for policy 1, policy_version 282451 (0.0010) [2023-12-27 21:15:19,059][106226] Updated weights for policy 0, policy_version 281935 (0.0006) [2023-12-27 21:15:19,068][106225] Updated weights for policy 1, policy_version 282461 (0.0010) [2023-12-27 21:15:19,786][106226] Updated weights for policy 0, policy_version 281945 (0.0008) [2023-12-27 21:15:19,817][106225] Updated weights for policy 1, policy_version 282471 (0.0010) [2023-12-27 21:15:19,853][106226] Updated weights for policy 0, policy_version 281955 (0.0008) [2023-12-27 21:15:19,880][106225] Updated weights for policy 1, policy_version 282481 (0.0009) [2023-12-27 21:15:19,920][106226] Updated weights for policy 0, policy_version 281965 (0.0011) [2023-12-27 21:15:19,950][106225] Updated weights for policy 1, policy_version 282491 (0.0008) [2023-12-27 21:15:19,980][106226] Updated weights for policy 0, policy_version 281975 (0.0008) [2023-12-27 21:15:20,722][106225] Updated weights for policy 1, policy_version 282501 (0.0008) [2023-12-27 21:15:20,740][106226] Updated weights for policy 0, policy_version 281985 (0.0006) [2023-12-27 21:15:20,780][106225] Updated weights for policy 1, policy_version 282511 (0.0011) [2023-12-27 21:15:20,803][106226] Updated weights for policy 0, policy_version 281995 (0.0006) [2023-12-27 21:15:20,842][106225] Updated weights for policy 1, policy_version 282521 (0.0011) [2023-12-27 21:15:20,864][106226] Updated weights for policy 0, policy_version 282005 (0.0007) [2023-12-27 21:15:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 144564224. Throughput: 0: 9695.8, 1: 9996.2. Samples: 144571708. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:21,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.561')] [2023-12-27 21:15:21,557][106225] Updated weights for policy 1, policy_version 282531 (0.0010) [2023-12-27 21:15:21,624][106225] Updated weights for policy 1, policy_version 282541 (0.0012) [2023-12-27 21:15:21,653][106226] Updated weights for policy 0, policy_version 282015 (0.0008) [2023-12-27 21:15:21,688][106225] Updated weights for policy 1, policy_version 282551 (0.0011) [2023-12-27 21:15:21,721][106226] Updated weights for policy 0, policy_version 282025 (0.0010) [2023-12-27 21:15:21,786][106226] Updated weights for policy 0, policy_version 282035 (0.0010) [2023-12-27 21:15:22,394][106225] Updated weights for policy 1, policy_version 282561 (0.0010) [2023-12-27 21:15:22,459][106225] Updated weights for policy 1, policy_version 282571 (0.0010) [2023-12-27 21:15:22,487][106226] Updated weights for policy 0, policy_version 282045 (0.0006) [2023-12-27 21:15:22,522][106225] Updated weights for policy 1, policy_version 282581 (0.0008) [2023-12-27 21:15:22,556][106226] Updated weights for policy 0, policy_version 282055 (0.0006) [2023-12-27 21:15:22,582][106225] Updated weights for policy 1, policy_version 282591 (0.0008) [2023-12-27 21:15:22,631][106226] Updated weights for policy 0, policy_version 282065 (0.0009) [2023-12-27 21:15:23,246][106225] Updated weights for policy 1, policy_version 282601 (0.0008) [2023-12-27 21:15:23,297][106225] Updated weights for policy 1, policy_version 282611 (0.0008) [2023-12-27 21:15:23,331][106226] Updated weights for policy 0, policy_version 282075 (0.0008) [2023-12-27 21:15:23,345][106225] Updated weights for policy 1, policy_version 282621 (0.0008) [2023-12-27 21:15:23,378][106226] Updated weights for policy 0, policy_version 282085 (0.0007) [2023-12-27 21:15:23,428][106226] Updated weights for policy 0, policy_version 282095 (0.0008) [2023-12-27 21:15:24,109][106225] Updated weights for policy 1, policy_version 282631 (0.0008) [2023-12-27 21:15:24,122][106226] Updated weights for policy 0, policy_version 282105 (0.0008) [2023-12-27 21:15:24,167][106225] Updated weights for policy 1, policy_version 282641 (0.0007) [2023-12-27 21:15:24,176][106226] Updated weights for policy 0, policy_version 282115 (0.0005) [2023-12-27 21:15:24,229][106225] Updated weights for policy 1, policy_version 282651 (0.0006) [2023-12-27 21:15:24,234][106226] Updated weights for policy 0, policy_version 282125 (0.0007) [2023-12-27 21:15:24,282][106226] Updated weights for policy 0, policy_version 282135 (0.0009) [2023-12-27 21:15:24,887][106225] Updated weights for policy 1, policy_version 282661 (0.0006) [2023-12-27 21:15:24,936][106225] Updated weights for policy 1, policy_version 282671 (0.0008) [2023-12-27 21:15:24,986][106225] Updated weights for policy 1, policy_version 282681 (0.0007) [2023-12-27 21:15:24,996][106226] Updated weights for policy 0, policy_version 282145 (0.0010) [2023-12-27 21:15:25,047][106226] Updated weights for policy 0, policy_version 282155 (0.0010) [2023-12-27 21:15:25,094][106226] Updated weights for policy 0, policy_version 282165 (0.0010) [2023-12-27 21:15:25,726][106225] Updated weights for policy 1, policy_version 282691 (0.0007) [2023-12-27 21:15:25,783][106225] Updated weights for policy 1, policy_version 282701 (0.0008) [2023-12-27 21:15:25,842][106225] Updated weights for policy 1, policy_version 282711 (0.0007) [2023-12-27 21:15:25,843][106226] Updated weights for policy 0, policy_version 282175 (0.0011) [2023-12-27 21:15:25,904][106226] Updated weights for policy 0, policy_version 282185 (0.0011) [2023-12-27 21:15:25,958][106226] Updated weights for policy 0, policy_version 282195 (0.0011) [2023-12-27 21:15:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 144662528. Throughput: 0: 9699.5, 1: 9973.1. Samples: 144630448. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:26,175][105115] Avg episode reward: [(0, '-4.187'), (1, '-5.886')] [2023-12-27 21:15:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000282720_72392704.pth... [2023-12-27 21:15:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000282200_72269824.pth... [2023-12-27 21:15:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000281048_71974912.pth [2023-12-27 21:15:26,183][106140] Saving new best policy, reward=-4.187! [2023-12-27 21:15:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000281568_72097792.pth [2023-12-27 21:15:26,597][106225] Updated weights for policy 1, policy_version 282721 (0.0008) [2023-12-27 21:15:26,644][106225] Updated weights for policy 1, policy_version 282731 (0.0008) [2023-12-27 21:15:26,685][106226] Updated weights for policy 0, policy_version 282205 (0.0011) [2023-12-27 21:15:26,707][106225] Updated weights for policy 1, policy_version 282741 (0.0007) [2023-12-27 21:15:26,741][106226] Updated weights for policy 0, policy_version 282215 (0.0010) [2023-12-27 21:15:26,752][106225] Updated weights for policy 1, policy_version 282751 (0.0006) [2023-12-27 21:15:26,798][106226] Updated weights for policy 0, policy_version 282225 (0.0010) [2023-12-27 21:15:27,498][106226] Updated weights for policy 0, policy_version 282235 (0.0010) [2023-12-27 21:15:27,511][106225] Updated weights for policy 1, policy_version 282761 (0.0007) [2023-12-27 21:15:27,556][106225] Updated weights for policy 1, policy_version 282771 (0.0007) [2023-12-27 21:15:27,560][106226] Updated weights for policy 0, policy_version 282245 (0.0010) [2023-12-27 21:15:27,602][106225] Updated weights for policy 1, policy_version 282781 (0.0008) [2023-12-27 21:15:27,610][106226] Updated weights for policy 0, policy_version 282255 (0.0010) [2023-12-27 21:15:28,320][106226] Updated weights for policy 0, policy_version 282265 (0.0011) [2023-12-27 21:15:28,361][106225] Updated weights for policy 1, policy_version 282791 (0.0009) [2023-12-27 21:15:28,379][106226] Updated weights for policy 0, policy_version 282275 (0.0011) [2023-12-27 21:15:28,417][106225] Updated weights for policy 1, policy_version 282801 (0.0006) [2023-12-27 21:15:28,434][106226] Updated weights for policy 0, policy_version 282285 (0.0011) [2023-12-27 21:15:28,474][106225] Updated weights for policy 1, policy_version 282811 (0.0005) [2023-12-27 21:15:28,491][106226] Updated weights for policy 0, policy_version 282295 (0.0010) [2023-12-27 21:15:29,200][106225] Updated weights for policy 1, policy_version 282821 (0.0006) [2023-12-27 21:15:29,202][106226] Updated weights for policy 0, policy_version 282305 (0.0010) [2023-12-27 21:15:29,260][106225] Updated weights for policy 1, policy_version 282831 (0.0008) [2023-12-27 21:15:29,267][106226] Updated weights for policy 0, policy_version 282315 (0.0011) [2023-12-27 21:15:29,319][106225] Updated weights for policy 1, policy_version 282841 (0.0005) [2023-12-27 21:15:29,324][106226] Updated weights for policy 0, policy_version 282325 (0.0011) [2023-12-27 21:15:30,076][106225] Updated weights for policy 1, policy_version 282851 (0.0007) [2023-12-27 21:15:30,103][106226] Updated weights for policy 0, policy_version 282335 (0.0010) [2023-12-27 21:15:30,132][106225] Updated weights for policy 1, policy_version 282861 (0.0005) [2023-12-27 21:15:30,156][106226] Updated weights for policy 0, policy_version 282345 (0.0010) [2023-12-27 21:15:30,182][106225] Updated weights for policy 1, policy_version 282871 (0.0006) [2023-12-27 21:15:30,206][106226] Updated weights for policy 0, policy_version 282355 (0.0010) [2023-12-27 21:15:30,917][106225] Updated weights for policy 1, policy_version 282881 (0.0006) [2023-12-27 21:15:30,937][106226] Updated weights for policy 0, policy_version 282365 (0.0011) [2023-12-27 21:15:30,973][106225] Updated weights for policy 1, policy_version 282891 (0.0008) [2023-12-27 21:15:30,998][106226] Updated weights for policy 0, policy_version 282375 (0.0011) [2023-12-27 21:15:31,032][106225] Updated weights for policy 1, policy_version 282901 (0.0006) [2023-12-27 21:15:31,068][106226] Updated weights for policy 0, policy_version 282386 (0.0009) [2023-12-27 21:15:31,095][106225] Updated weights for policy 1, policy_version 282911 (0.0007) [2023-12-27 21:15:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 144760832. Throughput: 0: 9694.9, 1: 9983.0. Samples: 144745820. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:31,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.539')] [2023-12-27 21:15:31,799][106226] Updated weights for policy 0, policy_version 282396 (0.0008) [2023-12-27 21:15:31,853][106226] Updated weights for policy 0, policy_version 282406 (0.0006) [2023-12-27 21:15:31,884][106225] Updated weights for policy 1, policy_version 282921 (0.0008) [2023-12-27 21:15:31,906][106226] Updated weights for policy 0, policy_version 282416 (0.0008) [2023-12-27 21:15:31,935][106225] Updated weights for policy 1, policy_version 282931 (0.0008) [2023-12-27 21:15:31,997][106225] Updated weights for policy 1, policy_version 282941 (0.0008) [2023-12-27 21:15:32,565][106226] Updated weights for policy 0, policy_version 282426 (0.0007) [2023-12-27 21:15:32,628][106226] Updated weights for policy 0, policy_version 282436 (0.0010) [2023-12-27 21:15:32,671][106225] Updated weights for policy 1, policy_version 282951 (0.0006) [2023-12-27 21:15:32,689][106226] Updated weights for policy 0, policy_version 282446 (0.0009) [2023-12-27 21:15:32,722][106225] Updated weights for policy 1, policy_version 282961 (0.0005) [2023-12-27 21:15:32,756][106226] Updated weights for policy 0, policy_version 282456 (0.0009) [2023-12-27 21:15:32,776][106225] Updated weights for policy 1, policy_version 282971 (0.0006) [2023-12-27 21:15:33,447][106225] Updated weights for policy 1, policy_version 282981 (0.0007) [2023-12-27 21:15:33,462][106226] Updated weights for policy 0, policy_version 282466 (0.0006) [2023-12-27 21:15:33,502][106225] Updated weights for policy 1, policy_version 282991 (0.0009) [2023-12-27 21:15:33,515][106226] Updated weights for policy 0, policy_version 282476 (0.0010) [2023-12-27 21:15:33,558][106225] Updated weights for policy 1, policy_version 283001 (0.0010) [2023-12-27 21:15:33,564][106226] Updated weights for policy 0, policy_version 282486 (0.0010) [2023-12-27 21:15:34,203][106225] Updated weights for policy 1, policy_version 283011 (0.0010) [2023-12-27 21:15:34,260][106226] Updated weights for policy 0, policy_version 282496 (0.0007) [2023-12-27 21:15:34,265][106225] Updated weights for policy 1, policy_version 283021 (0.0010) [2023-12-27 21:15:34,319][106226] Updated weights for policy 0, policy_version 282506 (0.0008) [2023-12-27 21:15:34,332][106225] Updated weights for policy 1, policy_version 283031 (0.0010) [2023-12-27 21:15:34,381][106226] Updated weights for policy 0, policy_version 282516 (0.0007) [2023-12-27 21:15:35,091][106225] Updated weights for policy 1, policy_version 283041 (0.0010) [2023-12-27 21:15:35,152][106226] Updated weights for policy 0, policy_version 282526 (0.0007) [2023-12-27 21:15:35,156][106225] Updated weights for policy 1, policy_version 283051 (0.0008) [2023-12-27 21:15:35,205][106226] Updated weights for policy 0, policy_version 282536 (0.0005) [2023-12-27 21:15:35,218][106225] Updated weights for policy 1, policy_version 283061 (0.0008) [2023-12-27 21:15:35,257][106226] Updated weights for policy 0, policy_version 282546 (0.0005) [2023-12-27 21:15:35,281][106225] Updated weights for policy 1, policy_version 283071 (0.0008) [2023-12-27 21:15:35,777][106226] Updated weights for policy 0, policy_version 282556 (0.0005) [2023-12-27 21:15:35,833][106226] Updated weights for policy 0, policy_version 282566 (0.0005) [2023-12-27 21:15:35,882][106226] Updated weights for policy 0, policy_version 282576 (0.0006) [2023-12-27 21:15:35,961][106225] Updated weights for policy 1, policy_version 283081 (0.0008) [2023-12-27 21:15:36,017][106225] Updated weights for policy 1, policy_version 283091 (0.0006) [2023-12-27 21:15:36,070][106225] Updated weights for policy 1, policy_version 283101 (0.0007) [2023-12-27 21:15:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 144859136. Throughput: 0: 9731.7, 1: 9928.4. Samples: 144864156. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:36,175][105115] Avg episode reward: [(0, '-4.896'), (1, '-5.636')] [2023-12-27 21:15:36,586][106226] Updated weights for policy 0, policy_version 282586 (0.0010) [2023-12-27 21:15:36,646][106226] Updated weights for policy 0, policy_version 282596 (0.0008) [2023-12-27 21:15:36,715][106226] Updated weights for policy 0, policy_version 282606 (0.0006) [2023-12-27 21:15:36,782][106226] Updated weights for policy 0, policy_version 282616 (0.0006) [2023-12-27 21:15:36,798][106225] Updated weights for policy 1, policy_version 283111 (0.0008) [2023-12-27 21:15:36,856][106225] Updated weights for policy 1, policy_version 283121 (0.0005) [2023-12-27 21:15:36,919][106225] Updated weights for policy 1, policy_version 283131 (0.0006) [2023-12-27 21:15:37,501][106225] Updated weights for policy 1, policy_version 283141 (0.0006) [2023-12-27 21:15:37,536][106226] Updated weights for policy 0, policy_version 282626 (0.0005) [2023-12-27 21:15:37,569][106225] Updated weights for policy 1, policy_version 283151 (0.0005) [2023-12-27 21:15:37,598][106226] Updated weights for policy 0, policy_version 282636 (0.0005) [2023-12-27 21:15:37,630][106225] Updated weights for policy 1, policy_version 283161 (0.0007) [2023-12-27 21:15:37,661][106226] Updated weights for policy 0, policy_version 282646 (0.0008) [2023-12-27 21:15:38,216][106226] Updated weights for policy 0, policy_version 282656 (0.0008) [2023-12-27 21:15:38,273][106226] Updated weights for policy 0, policy_version 282666 (0.0008) [2023-12-27 21:15:38,333][106226] Updated weights for policy 0, policy_version 282676 (0.0006) [2023-12-27 21:15:38,386][106225] Updated weights for policy 1, policy_version 283171 (0.0008) [2023-12-27 21:15:38,434][106225] Updated weights for policy 1, policy_version 283181 (0.0009) [2023-12-27 21:15:38,493][106225] Updated weights for policy 1, policy_version 283191 (0.0006) [2023-12-27 21:15:39,007][106226] Updated weights for policy 0, policy_version 282686 (0.0008) [2023-12-27 21:15:39,071][106226] Updated weights for policy 0, policy_version 282696 (0.0006) [2023-12-27 21:15:39,131][106226] Updated weights for policy 0, policy_version 282706 (0.0008) [2023-12-27 21:15:39,222][106225] Updated weights for policy 1, policy_version 283201 (0.0008) [2023-12-27 21:15:39,295][106225] Updated weights for policy 1, policy_version 283211 (0.0007) [2023-12-27 21:15:39,360][106225] Updated weights for policy 1, policy_version 283221 (0.0008) [2023-12-27 21:15:39,429][106225] Updated weights for policy 1, policy_version 283231 (0.0007) [2023-12-27 21:15:39,853][106226] Updated weights for policy 0, policy_version 282716 (0.0009) [2023-12-27 21:15:39,919][106226] Updated weights for policy 0, policy_version 282726 (0.0009) [2023-12-27 21:15:39,984][106226] Updated weights for policy 0, policy_version 282736 (0.0009) [2023-12-27 21:15:40,115][106225] Updated weights for policy 1, policy_version 283241 (0.0008) [2023-12-27 21:15:40,170][106225] Updated weights for policy 1, policy_version 283251 (0.0009) [2023-12-27 21:15:40,230][106225] Updated weights for policy 1, policy_version 283261 (0.0009) [2023-12-27 21:15:40,727][106226] Updated weights for policy 0, policy_version 282746 (0.0008) [2023-12-27 21:15:40,789][106226] Updated weights for policy 0, policy_version 282756 (0.0009) [2023-12-27 21:15:40,860][106226] Updated weights for policy 0, policy_version 282766 (0.0008) [2023-12-27 21:15:40,927][106226] Updated weights for policy 0, policy_version 282776 (0.0009) [2023-12-27 21:15:40,970][106225] Updated weights for policy 1, policy_version 283271 (0.0009) [2023-12-27 21:15:41,030][106225] Updated weights for policy 1, policy_version 283281 (0.0010) [2023-12-27 21:15:41,098][106225] Updated weights for policy 1, policy_version 283291 (0.0009) [2023-12-27 21:15:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 144957440. Throughput: 0: 9791.0, 1: 9917.7. Samples: 144925032. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:41,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-5.492')] [2023-12-27 21:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000283296_72540160.pth... [2023-12-27 21:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000282776_72417280.pth... [2023-12-27 21:15:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000282144_72245248.pth [2023-12-27 21:15:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000281624_72122368.pth [2023-12-27 21:15:41,730][106226] Updated weights for policy 0, policy_version 282786 (0.0007) [2023-12-27 21:15:41,802][106226] Updated weights for policy 0, policy_version 282796 (0.0007) [2023-12-27 21:15:41,871][106226] Updated weights for policy 0, policy_version 282806 (0.0008) [2023-12-27 21:15:41,918][106225] Updated weights for policy 1, policy_version 283301 (0.0008) [2023-12-27 21:15:41,982][106225] Updated weights for policy 1, policy_version 283311 (0.0008) [2023-12-27 21:15:42,061][106225] Updated weights for policy 1, policy_version 283321 (0.0008) [2023-12-27 21:15:42,552][106226] Updated weights for policy 0, policy_version 282816 (0.0007) [2023-12-27 21:15:42,602][106226] Updated weights for policy 0, policy_version 282826 (0.0009) [2023-12-27 21:15:42,651][106226] Updated weights for policy 0, policy_version 282836 (0.0009) [2023-12-27 21:15:42,745][106225] Updated weights for policy 1, policy_version 283331 (0.0007) [2023-12-27 21:15:42,797][106225] Updated weights for policy 1, policy_version 283341 (0.0006) [2023-12-27 21:15:42,854][106225] Updated weights for policy 1, policy_version 283351 (0.0005) [2023-12-27 21:15:43,405][106226] Updated weights for policy 0, policy_version 282846 (0.0008) [2023-12-27 21:15:43,463][106226] Updated weights for policy 0, policy_version 282856 (0.0010) [2023-12-27 21:15:43,475][106225] Updated weights for policy 1, policy_version 283361 (0.0005) [2023-12-27 21:15:43,517][106226] Updated weights for policy 0, policy_version 282866 (0.0008) [2023-12-27 21:15:43,535][106225] Updated weights for policy 1, policy_version 283371 (0.0005) [2023-12-27 21:15:43,593][106225] Updated weights for policy 1, policy_version 283381 (0.0006) [2023-12-27 21:15:43,657][106225] Updated weights for policy 1, policy_version 283391 (0.0010) [2023-12-27 21:15:44,260][106226] Updated weights for policy 0, policy_version 282876 (0.0009) [2023-12-27 21:15:44,285][106225] Updated weights for policy 1, policy_version 283401 (0.0008) [2023-12-27 21:15:44,313][106226] Updated weights for policy 0, policy_version 282886 (0.0008) [2023-12-27 21:15:44,338][106225] Updated weights for policy 1, policy_version 283411 (0.0006) [2023-12-27 21:15:44,374][106226] Updated weights for policy 0, policy_version 282896 (0.0005) [2023-12-27 21:15:44,394][106225] Updated weights for policy 1, policy_version 283421 (0.0009) [2023-12-27 21:15:45,024][106226] Updated weights for policy 0, policy_version 282906 (0.0006) [2023-12-27 21:15:45,085][106226] Updated weights for policy 0, policy_version 282916 (0.0007) [2023-12-27 21:15:45,118][106225] Updated weights for policy 1, policy_version 283431 (0.0008) [2023-12-27 21:15:45,154][106226] Updated weights for policy 0, policy_version 282926 (0.0007) [2023-12-27 21:15:45,178][106225] Updated weights for policy 1, policy_version 283441 (0.0007) [2023-12-27 21:15:45,220][106226] Updated weights for policy 0, policy_version 282936 (0.0008) [2023-12-27 21:15:45,249][106225] Updated weights for policy 1, policy_version 283451 (0.0007) [2023-12-27 21:15:45,908][106225] Updated weights for policy 1, policy_version 283461 (0.0007) [2023-12-27 21:15:45,967][106225] Updated weights for policy 1, policy_version 283471 (0.0006) [2023-12-27 21:15:46,018][106225] Updated weights for policy 1, policy_version 283481 (0.0009) [2023-12-27 21:15:46,026][106226] Updated weights for policy 0, policy_version 282946 (0.0010) [2023-12-27 21:15:46,080][106226] Updated weights for policy 0, policy_version 282956 (0.0010) [2023-12-27 21:15:46,142][106226] Updated weights for policy 0, policy_version 282966 (0.0009) [2023-12-27 21:15:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 145055744. Throughput: 0: 9792.8, 1: 9831.0. Samples: 145039624. Policy #0 lag: (min: 3.0, avg: 9.8, max: 35.0) [2023-12-27 21:15:46,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.388')] [2023-12-27 21:15:46,690][106225] Updated weights for policy 1, policy_version 283491 (0.0008) [2023-12-27 21:15:46,744][106226] Updated weights for policy 0, policy_version 282976 (0.0006) [2023-12-27 21:15:46,756][106225] Updated weights for policy 1, policy_version 283501 (0.0006) [2023-12-27 21:15:46,799][106226] Updated weights for policy 0, policy_version 282986 (0.0006) [2023-12-27 21:15:46,832][106225] Updated weights for policy 1, policy_version 283511 (0.0007) [2023-12-27 21:15:46,857][106226] Updated weights for policy 0, policy_version 282996 (0.0007) [2023-12-27 21:15:47,450][106225] Updated weights for policy 1, policy_version 283521 (0.0010) [2023-12-27 21:15:47,476][106226] Updated weights for policy 0, policy_version 283006 (0.0007) [2023-12-27 21:15:47,509][106225] Updated weights for policy 1, policy_version 283531 (0.0011) [2023-12-27 21:15:47,534][106226] Updated weights for policy 0, policy_version 283016 (0.0006) [2023-12-27 21:15:47,572][106225] Updated weights for policy 1, policy_version 283541 (0.0010) [2023-12-27 21:15:47,590][106226] Updated weights for policy 0, policy_version 283026 (0.0007) [2023-12-27 21:15:47,635][106225] Updated weights for policy 1, policy_version 283551 (0.0009) [2023-12-27 21:15:48,271][106225] Updated weights for policy 1, policy_version 283561 (0.0010) [2023-12-27 21:15:48,309][106226] Updated weights for policy 0, policy_version 283036 (0.0005) [2023-12-27 21:15:48,329][106225] Updated weights for policy 1, policy_version 283571 (0.0010) [2023-12-27 21:15:48,378][106226] Updated weights for policy 0, policy_version 283046 (0.0008) [2023-12-27 21:15:48,390][106225] Updated weights for policy 1, policy_version 283581 (0.0008) [2023-12-27 21:15:48,436][106226] Updated weights for policy 0, policy_version 283056 (0.0007) [2023-12-27 21:15:49,125][106226] Updated weights for policy 0, policy_version 283066 (0.0008) [2023-12-27 21:15:49,178][106225] Updated weights for policy 1, policy_version 283591 (0.0006) [2023-12-27 21:15:49,179][106226] Updated weights for policy 0, policy_version 283076 (0.0007) [2023-12-27 21:15:49,241][106226] Updated weights for policy 0, policy_version 283086 (0.0009) [2023-12-27 21:15:49,249][106225] Updated weights for policy 1, policy_version 283601 (0.0007) [2023-12-27 21:15:49,301][106226] Updated weights for policy 0, policy_version 283096 (0.0008) [2023-12-27 21:15:49,317][106225] Updated weights for policy 1, policy_version 283611 (0.0008) [2023-12-27 21:15:50,067][106226] Updated weights for policy 0, policy_version 283106 (0.0007) [2023-12-27 21:15:50,098][106225] Updated weights for policy 1, policy_version 283621 (0.0009) [2023-12-27 21:15:50,128][106226] Updated weights for policy 0, policy_version 283116 (0.0010) [2023-12-27 21:15:50,146][106225] Updated weights for policy 1, policy_version 283631 (0.0011) [2023-12-27 21:15:50,187][106226] Updated weights for policy 0, policy_version 283126 (0.0005) [2023-12-27 21:15:50,200][106225] Updated weights for policy 1, policy_version 283641 (0.0010) [2023-12-27 21:15:50,958][106226] Updated weights for policy 0, policy_version 283136 (0.0008) [2023-12-27 21:15:50,984][106225] Updated weights for policy 1, policy_version 283651 (0.0010) [2023-12-27 21:15:51,022][106226] Updated weights for policy 0, policy_version 283146 (0.0008) [2023-12-27 21:15:51,046][106225] Updated weights for policy 1, policy_version 283661 (0.0010) [2023-12-27 21:15:51,092][106226] Updated weights for policy 0, policy_version 283156 (0.0008) [2023-12-27 21:15:51,113][106225] Updated weights for policy 1, policy_version 283671 (0.0009) [2023-12-27 21:15:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 145154048. Throughput: 0: 9776.1, 1: 9847.4. Samples: 145157080. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:15:51,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.609')] [2023-12-27 21:15:51,842][106226] Updated weights for policy 0, policy_version 283166 (0.0006) [2023-12-27 21:15:51,903][106226] Updated weights for policy 0, policy_version 283176 (0.0006) [2023-12-27 21:15:51,945][106225] Updated weights for policy 1, policy_version 283681 (0.0010) [2023-12-27 21:15:51,970][106226] Updated weights for policy 0, policy_version 283186 (0.0006) [2023-12-27 21:15:52,013][106225] Updated weights for policy 1, policy_version 283691 (0.0008) [2023-12-27 21:15:52,075][106225] Updated weights for policy 1, policy_version 283701 (0.0008) [2023-12-27 21:15:52,138][106225] Updated weights for policy 1, policy_version 283711 (0.0009) [2023-12-27 21:15:52,559][106226] Updated weights for policy 0, policy_version 283196 (0.0006) [2023-12-27 21:15:52,623][106226] Updated weights for policy 0, policy_version 283206 (0.0006) [2023-12-27 21:15:52,681][106226] Updated weights for policy 0, policy_version 283216 (0.0009) [2023-12-27 21:15:52,917][106225] Updated weights for policy 1, policy_version 283721 (0.0008) [2023-12-27 21:15:52,976][106225] Updated weights for policy 1, policy_version 283731 (0.0008) [2023-12-27 21:15:53,028][106225] Updated weights for policy 1, policy_version 283741 (0.0008) [2023-12-27 21:15:53,313][106226] Updated weights for policy 0, policy_version 283226 (0.0008) [2023-12-27 21:15:53,371][106226] Updated weights for policy 0, policy_version 283236 (0.0006) [2023-12-27 21:15:53,428][106226] Updated weights for policy 0, policy_version 283246 (0.0008) [2023-12-27 21:15:53,491][106226] Updated weights for policy 0, policy_version 283256 (0.0008) [2023-12-27 21:15:53,805][106225] Updated weights for policy 1, policy_version 283751 (0.0010) [2023-12-27 21:15:53,879][106225] Updated weights for policy 1, policy_version 283761 (0.0008) [2023-12-27 21:15:53,942][106225] Updated weights for policy 1, policy_version 283771 (0.0008) [2023-12-27 21:15:54,071][106226] Updated weights for policy 0, policy_version 283266 (0.0008) [2023-12-27 21:15:54,133][106226] Updated weights for policy 0, policy_version 283276 (0.0006) [2023-12-27 21:15:54,193][106226] Updated weights for policy 0, policy_version 283286 (0.0009) [2023-12-27 21:15:54,709][106225] Updated weights for policy 1, policy_version 283781 (0.0009) [2023-12-27 21:15:54,772][106225] Updated weights for policy 1, policy_version 283791 (0.0008) [2023-12-27 21:15:54,784][106226] Updated weights for policy 0, policy_version 283296 (0.0007) [2023-12-27 21:15:54,832][106225] Updated weights for policy 1, policy_version 283801 (0.0006) [2023-12-27 21:15:54,847][106226] Updated weights for policy 0, policy_version 283306 (0.0006) [2023-12-27 21:15:54,916][106226] Updated weights for policy 0, policy_version 283316 (0.0006) [2023-12-27 21:15:55,555][106226] Updated weights for policy 0, policy_version 283326 (0.0009) [2023-12-27 21:15:55,598][106225] Updated weights for policy 1, policy_version 283811 (0.0007) [2023-12-27 21:15:55,612][106226] Updated weights for policy 0, policy_version 283336 (0.0011) [2023-12-27 21:15:55,656][106225] Updated weights for policy 1, policy_version 283821 (0.0006) [2023-12-27 21:15:55,677][106226] Updated weights for policy 0, policy_version 283346 (0.0011) [2023-12-27 21:15:55,713][106225] Updated weights for policy 1, policy_version 283831 (0.0006) [2023-12-27 21:15:56,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 145244160. Throughput: 0: 9788.3, 1: 9745.5. Samples: 145215744. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:15:56,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.928')] [2023-12-27 21:15:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000283352_72564736.pth... [2023-12-27 21:15:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000283840_72679424.pth... [2023-12-27 21:15:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000282200_72269824.pth [2023-12-27 21:15:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000282720_72392704.pth [2023-12-27 21:15:56,504][106226] Updated weights for policy 0, policy_version 283356 (0.0009) [2023-12-27 21:15:56,533][106225] Updated weights for policy 1, policy_version 283841 (0.0006) [2023-12-27 21:15:56,557][106226] Updated weights for policy 0, policy_version 283366 (0.0006) [2023-12-27 21:15:56,595][106225] Updated weights for policy 1, policy_version 283851 (0.0008) [2023-12-27 21:15:56,609][106226] Updated weights for policy 0, policy_version 283376 (0.0006) [2023-12-27 21:15:56,651][106225] Updated weights for policy 1, policy_version 283861 (0.0008) [2023-12-27 21:15:56,713][106225] Updated weights for policy 1, policy_version 283871 (0.0008) [2023-12-27 21:15:57,243][106226] Updated weights for policy 0, policy_version 283386 (0.0006) [2023-12-27 21:15:57,294][106226] Updated weights for policy 0, policy_version 283396 (0.0008) [2023-12-27 21:15:57,351][106226] Updated weights for policy 0, policy_version 283406 (0.0009) [2023-12-27 21:15:57,400][106226] Updated weights for policy 0, policy_version 283416 (0.0008) [2023-12-27 21:15:57,444][106225] Updated weights for policy 1, policy_version 283881 (0.0009) [2023-12-27 21:15:57,498][106225] Updated weights for policy 1, policy_version 283891 (0.0008) [2023-12-27 21:15:57,554][106225] Updated weights for policy 1, policy_version 283901 (0.0008) [2023-12-27 21:15:58,131][106226] Updated weights for policy 0, policy_version 283426 (0.0009) [2023-12-27 21:15:58,190][106226] Updated weights for policy 0, policy_version 283436 (0.0010) [2023-12-27 21:15:58,259][106226] Updated weights for policy 0, policy_version 283446 (0.0008) [2023-12-27 21:15:58,288][106225] Updated weights for policy 1, policy_version 283911 (0.0006) [2023-12-27 21:15:58,357][106225] Updated weights for policy 1, policy_version 283921 (0.0007) [2023-12-27 21:15:58,423][106225] Updated weights for policy 1, policy_version 283931 (0.0007) [2023-12-27 21:15:59,120][106226] Updated weights for policy 0, policy_version 283456 (0.0006) [2023-12-27 21:15:59,185][106226] Updated weights for policy 0, policy_version 283466 (0.0007) [2023-12-27 21:15:59,201][106225] Updated weights for policy 1, policy_version 283941 (0.0009) [2023-12-27 21:15:59,250][106226] Updated weights for policy 0, policy_version 283476 (0.0008) [2023-12-27 21:15:59,271][106225] Updated weights for policy 1, policy_version 283951 (0.0012) [2023-12-27 21:15:59,337][106225] Updated weights for policy 1, policy_version 283961 (0.0008) [2023-12-27 21:15:59,982][106226] Updated weights for policy 0, policy_version 283486 (0.0009) [2023-12-27 21:16:00,043][106225] Updated weights for policy 1, policy_version 283971 (0.0008) [2023-12-27 21:16:00,044][106226] Updated weights for policy 0, policy_version 283496 (0.0009) [2023-12-27 21:16:00,102][106225] Updated weights for policy 1, policy_version 283981 (0.0006) [2023-12-27 21:16:00,113][106226] Updated weights for policy 0, policy_version 283506 (0.0007) [2023-12-27 21:16:00,160][106225] Updated weights for policy 1, policy_version 283991 (0.0009) [2023-12-27 21:16:00,787][106225] Updated weights for policy 1, policy_version 284001 (0.0008) [2023-12-27 21:16:00,823][106226] Updated weights for policy 0, policy_version 283516 (0.0005) [2023-12-27 21:16:00,836][106225] Updated weights for policy 1, policy_version 284011 (0.0005) [2023-12-27 21:16:00,873][106226] Updated weights for policy 0, policy_version 283526 (0.0005) [2023-12-27 21:16:00,883][106225] Updated weights for policy 1, policy_version 284021 (0.0005) [2023-12-27 21:16:00,932][106226] Updated weights for policy 0, policy_version 283536 (0.0005) [2023-12-27 21:16:00,936][106225] Updated weights for policy 1, policy_version 284031 (0.0008) [2023-12-27 21:16:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 145342464. Throughput: 0: 9804.2, 1: 9650.3. Samples: 145327764. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:01,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.581')] [2023-12-27 21:16:01,557][106226] Updated weights for policy 0, policy_version 283546 (0.0006) [2023-12-27 21:16:01,613][106226] Updated weights for policy 0, policy_version 283556 (0.0009) [2023-12-27 21:16:01,617][106225] Updated weights for policy 1, policy_version 284041 (0.0007) [2023-12-27 21:16:01,683][106226] Updated weights for policy 0, policy_version 283566 (0.0007) [2023-12-27 21:16:01,684][106225] Updated weights for policy 1, policy_version 284051 (0.0008) [2023-12-27 21:16:01,751][106225] Updated weights for policy 1, policy_version 284061 (0.0010) [2023-12-27 21:16:01,755][106226] Updated weights for policy 0, policy_version 283576 (0.0008) [2023-12-27 21:16:02,360][106225] Updated weights for policy 1, policy_version 284071 (0.0009) [2023-12-27 21:16:02,416][106225] Updated weights for policy 1, policy_version 284081 (0.0009) [2023-12-27 21:16:02,456][106226] Updated weights for policy 0, policy_version 283586 (0.0010) [2023-12-27 21:16:02,473][106225] Updated weights for policy 1, policy_version 284091 (0.0010) [2023-12-27 21:16:02,516][106226] Updated weights for policy 0, policy_version 283596 (0.0007) [2023-12-27 21:16:02,584][106226] Updated weights for policy 0, policy_version 283606 (0.0010) [2023-12-27 21:16:03,093][106225] Updated weights for policy 1, policy_version 284101 (0.0008) [2023-12-27 21:16:03,151][106225] Updated weights for policy 1, policy_version 284111 (0.0006) [2023-12-27 21:16:03,216][106225] Updated weights for policy 1, policy_version 284121 (0.0010) [2023-12-27 21:16:03,261][106226] Updated weights for policy 0, policy_version 283616 (0.0010) [2023-12-27 21:16:03,309][106226] Updated weights for policy 0, policy_version 283626 (0.0010) [2023-12-27 21:16:03,368][106226] Updated weights for policy 0, policy_version 283636 (0.0010) [2023-12-27 21:16:03,860][106225] Updated weights for policy 1, policy_version 284131 (0.0010) [2023-12-27 21:16:03,911][106225] Updated weights for policy 1, policy_version 284141 (0.0008) [2023-12-27 21:16:03,959][106225] Updated weights for policy 1, policy_version 284151 (0.0008) [2023-12-27 21:16:04,061][106226] Updated weights for policy 0, policy_version 283646 (0.0011) [2023-12-27 21:16:04,118][106226] Updated weights for policy 0, policy_version 283656 (0.0011) [2023-12-27 21:16:04,182][106226] Updated weights for policy 0, policy_version 283666 (0.0009) [2023-12-27 21:16:04,743][106225] Updated weights for policy 1, policy_version 284161 (0.0008) [2023-12-27 21:16:04,800][106225] Updated weights for policy 1, policy_version 284171 (0.0008) [2023-12-27 21:16:04,854][106225] Updated weights for policy 1, policy_version 284181 (0.0007) [2023-12-27 21:16:04,876][106226] Updated weights for policy 0, policy_version 283676 (0.0007) [2023-12-27 21:16:04,902][106225] Updated weights for policy 1, policy_version 284191 (0.0006) [2023-12-27 21:16:04,932][106226] Updated weights for policy 0, policy_version 283686 (0.0007) [2023-12-27 21:16:04,987][106226] Updated weights for policy 0, policy_version 283696 (0.0009) [2023-12-27 21:16:05,631][106225] Updated weights for policy 1, policy_version 284201 (0.0007) [2023-12-27 21:16:05,682][106225] Updated weights for policy 1, policy_version 284211 (0.0006) [2023-12-27 21:16:05,721][106226] Updated weights for policy 0, policy_version 283706 (0.0008) [2023-12-27 21:16:05,740][106225] Updated weights for policy 1, policy_version 284221 (0.0010) [2023-12-27 21:16:05,773][106226] Updated weights for policy 0, policy_version 283716 (0.0006) [2023-12-27 21:16:05,819][106226] Updated weights for policy 0, policy_version 283726 (0.0008) [2023-12-27 21:16:05,868][106226] Updated weights for policy 0, policy_version 283736 (0.0008) [2023-12-27 21:16:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 145440768. Throughput: 0: 9833.3, 1: 9678.0. Samples: 145449716. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:06,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.684')] [2023-12-27 21:16:06,435][106225] Updated weights for policy 1, policy_version 284231 (0.0010) [2023-12-27 21:16:06,516][106225] Updated weights for policy 1, policy_version 284241 (0.0010) [2023-12-27 21:16:06,567][106225] Updated weights for policy 1, policy_version 284251 (0.0010) [2023-12-27 21:16:06,641][106226] Updated weights for policy 0, policy_version 283746 (0.0007) [2023-12-27 21:16:06,696][106226] Updated weights for policy 0, policy_version 283756 (0.0008) [2023-12-27 21:16:06,747][106226] Updated weights for policy 0, policy_version 283766 (0.0008) [2023-12-27 21:16:07,252][106225] Updated weights for policy 1, policy_version 284261 (0.0008) [2023-12-27 21:16:07,306][106225] Updated weights for policy 1, policy_version 284271 (0.0006) [2023-12-27 21:16:07,359][106225] Updated weights for policy 1, policy_version 284281 (0.0010) [2023-12-27 21:16:07,544][106226] Updated weights for policy 0, policy_version 283776 (0.0008) [2023-12-27 21:16:07,593][106226] Updated weights for policy 0, policy_version 283786 (0.0008) [2023-12-27 21:16:07,646][106226] Updated weights for policy 0, policy_version 283796 (0.0009) [2023-12-27 21:16:07,980][106225] Updated weights for policy 1, policy_version 284291 (0.0010) [2023-12-27 21:16:08,031][106225] Updated weights for policy 1, policy_version 284301 (0.0010) [2023-12-27 21:16:08,082][106225] Updated weights for policy 1, policy_version 284311 (0.0010) [2023-12-27 21:16:08,457][106226] Updated weights for policy 0, policy_version 283806 (0.0008) [2023-12-27 21:16:08,526][106226] Updated weights for policy 0, policy_version 283816 (0.0008) [2023-12-27 21:16:08,588][106226] Updated weights for policy 0, policy_version 283826 (0.0008) [2023-12-27 21:16:08,740][106225] Updated weights for policy 1, policy_version 284321 (0.0006) [2023-12-27 21:16:08,807][106225] Updated weights for policy 1, policy_version 284331 (0.0010) [2023-12-27 21:16:08,870][106225] Updated weights for policy 1, policy_version 284341 (0.0010) [2023-12-27 21:16:08,931][106225] Updated weights for policy 1, policy_version 284351 (0.0010) [2023-12-27 21:16:09,363][106226] Updated weights for policy 0, policy_version 283836 (0.0011) [2023-12-27 21:16:09,432][106226] Updated weights for policy 0, policy_version 283846 (0.0010) [2023-12-27 21:16:09,491][106226] Updated weights for policy 0, policy_version 283856 (0.0008) [2023-12-27 21:16:09,581][106225] Updated weights for policy 1, policy_version 284361 (0.0010) [2023-12-27 21:16:09,635][106225] Updated weights for policy 1, policy_version 284371 (0.0010) [2023-12-27 21:16:09,686][106225] Updated weights for policy 1, policy_version 284381 (0.0010) [2023-12-27 21:16:10,237][106226] Updated weights for policy 0, policy_version 283866 (0.0008) [2023-12-27 21:16:10,301][106226] Updated weights for policy 0, policy_version 283876 (0.0009) [2023-12-27 21:16:10,366][106226] Updated weights for policy 0, policy_version 283886 (0.0009) [2023-12-27 21:16:10,427][106226] Updated weights for policy 0, policy_version 283896 (0.0009) [2023-12-27 21:16:10,458][106225] Updated weights for policy 1, policy_version 284391 (0.0008) [2023-12-27 21:16:10,516][106225] Updated weights for policy 1, policy_version 284401 (0.0009) [2023-12-27 21:16:10,568][106225] Updated weights for policy 1, policy_version 284411 (0.0009) [2023-12-27 21:16:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 145530880. Throughput: 0: 9790.3, 1: 9720.2. Samples: 145508420. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:11,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-5.573')] [2023-12-27 21:16:11,182][106226] Updated weights for policy 0, policy_version 283906 (0.0008) [2023-12-27 21:16:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000284416_72826880.pth... [2023-12-27 21:16:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000283296_72540160.pth [2023-12-27 21:16:11,234][106226] Updated weights for policy 0, policy_version 283916 (0.0008) [2023-12-27 21:16:11,290][106225] Updated weights for policy 1, policy_version 284421 (0.0008) [2023-12-27 21:16:11,300][106226] Updated weights for policy 0, policy_version 283926 (0.0008) [2023-12-27 21:16:11,311][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000283928_72712192.pth... [2023-12-27 21:16:11,315][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000282776_72417280.pth [2023-12-27 21:16:11,355][106225] Updated weights for policy 1, policy_version 284431 (0.0006) [2023-12-27 21:16:11,425][106225] Updated weights for policy 1, policy_version 284441 (0.0008) [2023-12-27 21:16:12,112][106225] Updated weights for policy 1, policy_version 284451 (0.0007) [2023-12-27 21:16:12,174][106226] Updated weights for policy 0, policy_version 283936 (0.0008) [2023-12-27 21:16:12,182][106225] Updated weights for policy 1, policy_version 284461 (0.0006) [2023-12-27 21:16:12,239][106226] Updated weights for policy 0, policy_version 283946 (0.0008) [2023-12-27 21:16:12,247][106225] Updated weights for policy 1, policy_version 284471 (0.0007) [2023-12-27 21:16:12,311][106226] Updated weights for policy 0, policy_version 283956 (0.0009) [2023-12-27 21:16:12,987][106225] Updated weights for policy 1, policy_version 284481 (0.0009) [2023-12-27 21:16:13,048][106225] Updated weights for policy 1, policy_version 284491 (0.0006) [2023-12-27 21:16:13,050][106226] Updated weights for policy 0, policy_version 283966 (0.0008) [2023-12-27 21:16:13,099][106226] Updated weights for policy 0, policy_version 283976 (0.0008) [2023-12-27 21:16:13,106][106225] Updated weights for policy 1, policy_version 284501 (0.0007) [2023-12-27 21:16:13,162][106226] Updated weights for policy 0, policy_version 283986 (0.0008) [2023-12-27 21:16:13,168][106225] Updated weights for policy 1, policy_version 284511 (0.0006) [2023-12-27 21:16:13,811][106225] Updated weights for policy 1, policy_version 284521 (0.0008) [2023-12-27 21:16:13,863][106225] Updated weights for policy 1, policy_version 284531 (0.0007) [2023-12-27 21:16:13,920][106225] Updated weights for policy 1, policy_version 284541 (0.0009) [2023-12-27 21:16:13,946][106226] Updated weights for policy 0, policy_version 283996 (0.0008) [2023-12-27 21:16:14,009][106226] Updated weights for policy 0, policy_version 284006 (0.0009) [2023-12-27 21:16:14,055][106226] Updated weights for policy 0, policy_version 284016 (0.0007) [2023-12-27 21:16:14,586][106225] Updated weights for policy 1, policy_version 284551 (0.0006) [2023-12-27 21:16:14,639][106225] Updated weights for policy 1, policy_version 284561 (0.0005) [2023-12-27 21:16:14,699][106225] Updated weights for policy 1, policy_version 284571 (0.0008) [2023-12-27 21:16:14,765][106226] Updated weights for policy 0, policy_version 284026 (0.0008) [2023-12-27 21:16:14,830][106226] Updated weights for policy 0, policy_version 284036 (0.0008) [2023-12-27 21:16:14,891][106226] Updated weights for policy 0, policy_version 284046 (0.0008) [2023-12-27 21:16:14,954][106226] Updated weights for policy 0, policy_version 284056 (0.0008) [2023-12-27 21:16:15,325][106225] Updated weights for policy 1, policy_version 284581 (0.0010) [2023-12-27 21:16:15,386][106225] Updated weights for policy 1, policy_version 284591 (0.0010) [2023-12-27 21:16:15,442][106225] Updated weights for policy 1, policy_version 284601 (0.0010) [2023-12-27 21:16:15,624][106226] Updated weights for policy 0, policy_version 284066 (0.0005) [2023-12-27 21:16:15,682][106226] Updated weights for policy 0, policy_version 284076 (0.0005) [2023-12-27 21:16:15,740][106226] Updated weights for policy 0, policy_version 284086 (0.0006) [2023-12-27 21:16:16,053][106225] Updated weights for policy 1, policy_version 284611 (0.0009) [2023-12-27 21:16:16,114][106225] Updated weights for policy 1, policy_version 284621 (0.0008) [2023-12-27 21:16:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 145629184. Throughput: 0: 9704.3, 1: 9763.9. Samples: 145621888. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:16,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.966')] [2023-12-27 21:16:16,181][106225] Updated weights for policy 1, policy_version 284631 (0.0008) [2023-12-27 21:16:16,259][106226] Updated weights for policy 0, policy_version 284096 (0.0006) [2023-12-27 21:16:16,306][106226] Updated weights for policy 0, policy_version 284106 (0.0006) [2023-12-27 21:16:16,370][106226] Updated weights for policy 0, policy_version 284116 (0.0008) [2023-12-27 21:16:16,781][106225] Updated weights for policy 1, policy_version 284641 (0.0007) [2023-12-27 21:16:16,841][106225] Updated weights for policy 1, policy_version 284651 (0.0005) [2023-12-27 21:16:16,898][106225] Updated weights for policy 1, policy_version 284661 (0.0005) [2023-12-27 21:16:16,951][106225] Updated weights for policy 1, policy_version 284671 (0.0005) [2023-12-27 21:16:17,017][106226] Updated weights for policy 0, policy_version 284126 (0.0007) [2023-12-27 21:16:17,075][106226] Updated weights for policy 0, policy_version 284136 (0.0005) [2023-12-27 21:16:17,139][106226] Updated weights for policy 0, policy_version 284146 (0.0005) [2023-12-27 21:16:17,622][106225] Updated weights for policy 1, policy_version 284681 (0.0008) [2023-12-27 21:16:17,672][106225] Updated weights for policy 1, policy_version 284691 (0.0008) [2023-12-27 21:16:17,729][106226] Updated weights for policy 0, policy_version 284156 (0.0007) [2023-12-27 21:16:17,731][106225] Updated weights for policy 1, policy_version 284701 (0.0007) [2023-12-27 21:16:17,789][106226] Updated weights for policy 0, policy_version 284166 (0.0008) [2023-12-27 21:16:17,855][106226] Updated weights for policy 0, policy_version 284176 (0.0008) [2023-12-27 21:16:18,487][106225] Updated weights for policy 1, policy_version 284711 (0.0008) [2023-12-27 21:16:18,518][106226] Updated weights for policy 0, policy_version 284186 (0.0008) [2023-12-27 21:16:18,548][106225] Updated weights for policy 1, policy_version 284721 (0.0007) [2023-12-27 21:16:18,579][106226] Updated weights for policy 0, policy_version 284196 (0.0006) [2023-12-27 21:16:18,612][106225] Updated weights for policy 1, policy_version 284731 (0.0006) [2023-12-27 21:16:18,643][106226] Updated weights for policy 0, policy_version 284206 (0.0007) [2023-12-27 21:16:18,711][106226] Updated weights for policy 0, policy_version 284216 (0.0010) [2023-12-27 21:16:19,174][106225] Updated weights for policy 1, policy_version 284741 (0.0006) [2023-12-27 21:16:19,240][106225] Updated weights for policy 1, policy_version 284751 (0.0006) [2023-12-27 21:16:19,297][106225] Updated weights for policy 1, policy_version 284761 (0.0008) [2023-12-27 21:16:19,475][106226] Updated weights for policy 0, policy_version 284226 (0.0009) [2023-12-27 21:16:19,538][106226] Updated weights for policy 0, policy_version 284236 (0.0009) [2023-12-27 21:16:19,602][106226] Updated weights for policy 0, policy_version 284246 (0.0011) [2023-12-27 21:16:20,035][106225] Updated weights for policy 1, policy_version 284771 (0.0009) [2023-12-27 21:16:20,092][106225] Updated weights for policy 1, policy_version 284781 (0.0008) [2023-12-27 21:16:20,159][106225] Updated weights for policy 1, policy_version 284791 (0.0007) [2023-12-27 21:16:20,339][106226] Updated weights for policy 0, policy_version 284256 (0.0008) [2023-12-27 21:16:20,406][106226] Updated weights for policy 0, policy_version 284266 (0.0007) [2023-12-27 21:16:20,471][106226] Updated weights for policy 0, policy_version 284276 (0.0006) [2023-12-27 21:16:20,847][106225] Updated weights for policy 1, policy_version 284801 (0.0008) [2023-12-27 21:16:20,909][106225] Updated weights for policy 1, policy_version 284811 (0.0006) [2023-12-27 21:16:20,976][106225] Updated weights for policy 1, policy_version 284821 (0.0006) [2023-12-27 21:16:21,046][106225] Updated weights for policy 1, policy_version 284831 (0.0008) [2023-12-27 21:16:21,151][106226] Updated weights for policy 0, policy_version 284286 (0.0007) [2023-12-27 21:16:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 145735680. Throughput: 0: 9748.0, 1: 9864.0. Samples: 145746696. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:21,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-5.810')] [2023-12-27 21:16:21,218][106226] Updated weights for policy 0, policy_version 284296 (0.0010) [2023-12-27 21:16:21,286][106226] Updated weights for policy 0, policy_version 284306 (0.0007) [2023-12-27 21:16:21,840][106225] Updated weights for policy 1, policy_version 284841 (0.0006) [2023-12-27 21:16:21,902][106225] Updated weights for policy 1, policy_version 284851 (0.0008) [2023-12-27 21:16:21,969][106225] Updated weights for policy 1, policy_version 284861 (0.0008) [2023-12-27 21:16:22,021][106226] Updated weights for policy 0, policy_version 284316 (0.0008) [2023-12-27 21:16:22,090][106226] Updated weights for policy 0, policy_version 284326 (0.0011) [2023-12-27 21:16:22,158][106226] Updated weights for policy 0, policy_version 284336 (0.0008) [2023-12-27 21:16:22,680][106225] Updated weights for policy 1, policy_version 284871 (0.0009) [2023-12-27 21:16:22,733][106225] Updated weights for policy 1, policy_version 284881 (0.0008) [2023-12-27 21:16:22,788][106225] Updated weights for policy 1, policy_version 284891 (0.0009) [2023-12-27 21:16:22,828][106226] Updated weights for policy 0, policy_version 284346 (0.0010) [2023-12-27 21:16:22,880][106226] Updated weights for policy 0, policy_version 284356 (0.0008) [2023-12-27 21:16:22,929][106226] Updated weights for policy 0, policy_version 284366 (0.0008) [2023-12-27 21:16:22,981][106226] Updated weights for policy 0, policy_version 284376 (0.0009) [2023-12-27 21:16:23,491][106225] Updated weights for policy 1, policy_version 284901 (0.0007) [2023-12-27 21:16:23,545][106225] Updated weights for policy 1, policy_version 284911 (0.0009) [2023-12-27 21:16:23,590][106225] Updated weights for policy 1, policy_version 284921 (0.0007) [2023-12-27 21:16:23,622][106226] Updated weights for policy 0, policy_version 284386 (0.0009) [2023-12-27 21:16:23,675][106226] Updated weights for policy 0, policy_version 284396 (0.0009) [2023-12-27 21:16:23,737][106226] Updated weights for policy 0, policy_version 284406 (0.0008) [2023-12-27 21:16:24,180][106225] Updated weights for policy 1, policy_version 284931 (0.0005) [2023-12-27 21:16:24,242][106225] Updated weights for policy 1, policy_version 284941 (0.0008) [2023-12-27 21:16:24,297][106225] Updated weights for policy 1, policy_version 284951 (0.0008) [2023-12-27 21:16:24,501][106226] Updated weights for policy 0, policy_version 284416 (0.0009) [2023-12-27 21:16:24,553][106226] Updated weights for policy 0, policy_version 284426 (0.0008) [2023-12-27 21:16:24,608][106226] Updated weights for policy 0, policy_version 284436 (0.0009) [2023-12-27 21:16:24,979][106225] Updated weights for policy 1, policy_version 284961 (0.0008) [2023-12-27 21:16:25,028][106225] Updated weights for policy 1, policy_version 284971 (0.0006) [2023-12-27 21:16:25,079][106225] Updated weights for policy 1, policy_version 284981 (0.0006) [2023-12-27 21:16:25,131][106225] Updated weights for policy 1, policy_version 284991 (0.0008) [2023-12-27 21:16:25,370][106226] Updated weights for policy 0, policy_version 284446 (0.0009) [2023-12-27 21:16:25,436][106226] Updated weights for policy 0, policy_version 284456 (0.0009) [2023-12-27 21:16:25,504][106226] Updated weights for policy 0, policy_version 284466 (0.0008) [2023-12-27 21:16:25,699][106225] Updated weights for policy 1, policy_version 285001 (0.0006) [2023-12-27 21:16:25,747][106225] Updated weights for policy 1, policy_version 285011 (0.0005) [2023-12-27 21:16:25,803][106225] Updated weights for policy 1, policy_version 285021 (0.0005) [2023-12-27 21:16:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 145833984. Throughput: 0: 9720.4, 1: 9829.9. Samples: 145804800. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:26,175][105115] Avg episode reward: [(0, '-4.991'), (1, '-5.462')] [2023-12-27 21:16:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000285024_72982528.pth... [2023-12-27 21:16:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000284472_72851456.pth... [2023-12-27 21:16:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000283840_72679424.pth [2023-12-27 21:16:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000283352_72564736.pth [2023-12-27 21:16:26,292][106226] Updated weights for policy 0, policy_version 284476 (0.0010) [2023-12-27 21:16:26,357][106226] Updated weights for policy 0, policy_version 284486 (0.0009) [2023-12-27 21:16:26,419][106226] Updated weights for policy 0, policy_version 284496 (0.0009) [2023-12-27 21:16:26,429][106225] Updated weights for policy 1, policy_version 285031 (0.0008) [2023-12-27 21:16:26,482][106225] Updated weights for policy 1, policy_version 285041 (0.0009) [2023-12-27 21:16:26,542][106225] Updated weights for policy 1, policy_version 285051 (0.0006) [2023-12-27 21:16:27,145][106226] Updated weights for policy 0, policy_version 284506 (0.0007) [2023-12-27 21:16:27,202][106226] Updated weights for policy 0, policy_version 284516 (0.0008) [2023-12-27 21:16:27,257][106225] Updated weights for policy 1, policy_version 285061 (0.0008) [2023-12-27 21:16:27,258][106226] Updated weights for policy 0, policy_version 284526 (0.0009) [2023-12-27 21:16:27,315][106225] Updated weights for policy 1, policy_version 285071 (0.0007) [2023-12-27 21:16:27,316][106226] Updated weights for policy 0, policy_version 284536 (0.0007) [2023-12-27 21:16:27,372][106225] Updated weights for policy 1, policy_version 285081 (0.0007) [2023-12-27 21:16:28,006][106225] Updated weights for policy 1, policy_version 285091 (0.0005) [2023-12-27 21:16:28,052][106226] Updated weights for policy 0, policy_version 284546 (0.0008) [2023-12-27 21:16:28,063][106225] Updated weights for policy 1, policy_version 285101 (0.0005) [2023-12-27 21:16:28,105][106226] Updated weights for policy 0, policy_version 284556 (0.0008) [2023-12-27 21:16:28,117][106225] Updated weights for policy 1, policy_version 285111 (0.0005) [2023-12-27 21:16:28,157][106226] Updated weights for policy 0, policy_version 284566 (0.0008) [2023-12-27 21:16:28,645][106225] Updated weights for policy 1, policy_version 285121 (0.0005) [2023-12-27 21:16:28,712][106225] Updated weights for policy 1, policy_version 285131 (0.0007) [2023-12-27 21:16:28,767][106225] Updated weights for policy 1, policy_version 285141 (0.0008) [2023-12-27 21:16:28,820][106225] Updated weights for policy 1, policy_version 285151 (0.0008) [2023-12-27 21:16:28,880][106226] Updated weights for policy 0, policy_version 284576 (0.0008) [2023-12-27 21:16:28,939][106226] Updated weights for policy 0, policy_version 284586 (0.0009) [2023-12-27 21:16:28,998][106226] Updated weights for policy 0, policy_version 284596 (0.0008) [2023-12-27 21:16:29,564][106225] Updated weights for policy 1, policy_version 285161 (0.0009) [2023-12-27 21:16:29,630][106225] Updated weights for policy 1, policy_version 285171 (0.0010) [2023-12-27 21:16:29,674][106226] Updated weights for policy 0, policy_version 284606 (0.0008) [2023-12-27 21:16:29,692][106225] Updated weights for policy 1, policy_version 285181 (0.0006) [2023-12-27 21:16:29,733][106226] Updated weights for policy 0, policy_version 284616 (0.0007) [2023-12-27 21:16:29,790][106226] Updated weights for policy 0, policy_version 284626 (0.0009) [2023-12-27 21:16:30,335][106225] Updated weights for policy 1, policy_version 285191 (0.0008) [2023-12-27 21:16:30,393][106225] Updated weights for policy 1, policy_version 285201 (0.0006) [2023-12-27 21:16:30,426][106226] Updated weights for policy 0, policy_version 284636 (0.0008) [2023-12-27 21:16:30,453][106225] Updated weights for policy 1, policy_version 285211 (0.0007) [2023-12-27 21:16:30,478][106226] Updated weights for policy 0, policy_version 284646 (0.0007) [2023-12-27 21:16:30,531][106226] Updated weights for policy 0, policy_version 284656 (0.0008) [2023-12-27 21:16:31,051][106225] Updated weights for policy 1, policy_version 285221 (0.0007) [2023-12-27 21:16:31,118][106225] Updated weights for policy 1, policy_version 285231 (0.0007) [2023-12-27 21:16:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 145932288. Throughput: 0: 9738.8, 1: 9973.7. Samples: 145926688. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:31,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-5.864')] [2023-12-27 21:16:31,185][106225] Updated weights for policy 1, policy_version 285241 (0.0009) [2023-12-27 21:16:31,269][106226] Updated weights for policy 0, policy_version 284666 (0.0006) [2023-12-27 21:16:31,336][106226] Updated weights for policy 0, policy_version 284676 (0.0007) [2023-12-27 21:16:31,406][106226] Updated weights for policy 0, policy_version 284686 (0.0009) [2023-12-27 21:16:31,463][106226] Updated weights for policy 0, policy_version 284696 (0.0008) [2023-12-27 21:16:31,928][106225] Updated weights for policy 1, policy_version 285251 (0.0008) [2023-12-27 21:16:31,992][106225] Updated weights for policy 1, policy_version 285261 (0.0006) [2023-12-27 21:16:32,053][106225] Updated weights for policy 1, policy_version 285271 (0.0008) [2023-12-27 21:16:32,146][106226] Updated weights for policy 0, policy_version 284706 (0.0005) [2023-12-27 21:16:32,196][106226] Updated weights for policy 0, policy_version 284716 (0.0006) [2023-12-27 21:16:32,252][106226] Updated weights for policy 0, policy_version 284726 (0.0007) [2023-12-27 21:16:32,779][106225] Updated weights for policy 1, policy_version 285281 (0.0009) [2023-12-27 21:16:32,835][106226] Updated weights for policy 0, policy_version 284736 (0.0006) [2023-12-27 21:16:32,839][106225] Updated weights for policy 1, policy_version 285291 (0.0010) [2023-12-27 21:16:32,892][106226] Updated weights for policy 0, policy_version 284746 (0.0005) [2023-12-27 21:16:32,896][106225] Updated weights for policy 1, policy_version 285301 (0.0010) [2023-12-27 21:16:32,942][106225] Updated weights for policy 1, policy_version 285311 (0.0010) [2023-12-27 21:16:32,946][106226] Updated weights for policy 0, policy_version 284756 (0.0005) [2023-12-27 21:16:33,505][106226] Updated weights for policy 0, policy_version 284766 (0.0005) [2023-12-27 21:16:33,556][106226] Updated weights for policy 0, policy_version 284776 (0.0005) [2023-12-27 21:16:33,608][106226] Updated weights for policy 0, policy_version 284786 (0.0005) [2023-12-27 21:16:33,681][106225] Updated weights for policy 1, policy_version 285321 (0.0009) [2023-12-27 21:16:33,740][106225] Updated weights for policy 1, policy_version 285331 (0.0009) [2023-12-27 21:16:33,803][106225] Updated weights for policy 1, policy_version 285341 (0.0008) [2023-12-27 21:16:34,276][106226] Updated weights for policy 0, policy_version 284796 (0.0008) [2023-12-27 21:16:34,341][106226] Updated weights for policy 0, policy_version 284806 (0.0011) [2023-12-27 21:16:34,402][106226] Updated weights for policy 0, policy_version 284816 (0.0010) [2023-12-27 21:16:34,488][106225] Updated weights for policy 1, policy_version 285351 (0.0006) [2023-12-27 21:16:34,543][106225] Updated weights for policy 1, policy_version 285361 (0.0007) [2023-12-27 21:16:34,597][106225] Updated weights for policy 1, policy_version 285371 (0.0007) [2023-12-27 21:16:35,136][106226] Updated weights for policy 0, policy_version 284826 (0.0011) [2023-12-27 21:16:35,195][106226] Updated weights for policy 0, policy_version 284836 (0.0010) [2023-12-27 21:16:35,254][106226] Updated weights for policy 0, policy_version 284846 (0.0010) [2023-12-27 21:16:35,259][106225] Updated weights for policy 1, policy_version 285381 (0.0008) [2023-12-27 21:16:35,311][106225] Updated weights for policy 1, policy_version 285391 (0.0008) [2023-12-27 21:16:35,316][106226] Updated weights for policy 0, policy_version 284856 (0.0010) [2023-12-27 21:16:35,363][106225] Updated weights for policy 1, policy_version 285401 (0.0007) [2023-12-27 21:16:35,960][106226] Updated weights for policy 0, policy_version 284866 (0.0008) [2023-12-27 21:16:36,006][106226] Updated weights for policy 0, policy_version 284876 (0.0008) [2023-12-27 21:16:36,060][106226] Updated weights for policy 0, policy_version 284886 (0.0008) [2023-12-27 21:16:36,104][106225] Updated weights for policy 1, policy_version 285411 (0.0008) [2023-12-27 21:16:36,175][106225] Updated weights for policy 1, policy_version 285421 (0.0006) [2023-12-27 21:16:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 146038784. Throughput: 0: 9823.8, 1: 9993.8. Samples: 146048872. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:36,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-5.881')] [2023-12-27 21:16:36,238][106225] Updated weights for policy 1, policy_version 285431 (0.0008) [2023-12-27 21:16:36,727][106226] Updated weights for policy 0, policy_version 284896 (0.0008) [2023-12-27 21:16:36,782][106226] Updated weights for policy 0, policy_version 284906 (0.0006) [2023-12-27 21:16:36,841][106226] Updated weights for policy 0, policy_version 284916 (0.0005) [2023-12-27 21:16:36,964][106225] Updated weights for policy 1, policy_version 285441 (0.0008) [2023-12-27 21:16:37,012][106225] Updated weights for policy 1, policy_version 285451 (0.0008) [2023-12-27 21:16:37,060][106225] Updated weights for policy 1, policy_version 285461 (0.0009) [2023-12-27 21:16:37,118][106225] Updated weights for policy 1, policy_version 285471 (0.0008) [2023-12-27 21:16:37,499][106226] Updated weights for policy 0, policy_version 284926 (0.0007) [2023-12-27 21:16:37,565][106226] Updated weights for policy 0, policy_version 284936 (0.0008) [2023-12-27 21:16:37,623][106226] Updated weights for policy 0, policy_version 284946 (0.0008) [2023-12-27 21:16:37,862][106225] Updated weights for policy 1, policy_version 285481 (0.0006) [2023-12-27 21:16:37,916][106225] Updated weights for policy 1, policy_version 285491 (0.0005) [2023-12-27 21:16:37,969][106225] Updated weights for policy 1, policy_version 285501 (0.0008) [2023-12-27 21:16:38,229][106226] Updated weights for policy 0, policy_version 284956 (0.0005) [2023-12-27 21:16:38,280][106226] Updated weights for policy 0, policy_version 284966 (0.0006) [2023-12-27 21:16:38,341][106226] Updated weights for policy 0, policy_version 284976 (0.0007) [2023-12-27 21:16:38,626][106225] Updated weights for policy 1, policy_version 285511 (0.0009) [2023-12-27 21:16:38,686][106225] Updated weights for policy 1, policy_version 285521 (0.0009) [2023-12-27 21:16:38,750][106225] Updated weights for policy 1, policy_version 285531 (0.0009) [2023-12-27 21:16:39,023][106226] Updated weights for policy 0, policy_version 284986 (0.0007) [2023-12-27 21:16:39,082][106226] Updated weights for policy 0, policy_version 284996 (0.0006) [2023-12-27 21:16:39,152][106226] Updated weights for policy 0, policy_version 285006 (0.0006) [2023-12-27 21:16:39,214][106226] Updated weights for policy 0, policy_version 285016 (0.0006) [2023-12-27 21:16:39,428][106225] Updated weights for policy 1, policy_version 285541 (0.0008) [2023-12-27 21:16:39,496][106225] Updated weights for policy 1, policy_version 285551 (0.0006) [2023-12-27 21:16:39,556][106225] Updated weights for policy 1, policy_version 285561 (0.0008) [2023-12-27 21:16:40,026][106226] Updated weights for policy 0, policy_version 285026 (0.0009) [2023-12-27 21:16:40,094][106226] Updated weights for policy 0, policy_version 285036 (0.0008) [2023-12-27 21:16:40,158][106226] Updated weights for policy 0, policy_version 285046 (0.0009) [2023-12-27 21:16:40,217][106225] Updated weights for policy 1, policy_version 285571 (0.0009) [2023-12-27 21:16:40,282][106225] Updated weights for policy 1, policy_version 285581 (0.0008) [2023-12-27 21:16:40,343][106225] Updated weights for policy 1, policy_version 285591 (0.0008) [2023-12-27 21:16:40,922][106226] Updated weights for policy 0, policy_version 285056 (0.0008) [2023-12-27 21:16:40,985][106226] Updated weights for policy 0, policy_version 285066 (0.0009) [2023-12-27 21:16:41,042][106226] Updated weights for policy 0, policy_version 285076 (0.0007) [2023-12-27 21:16:41,092][106225] Updated weights for policy 1, policy_version 285601 (0.0008) [2023-12-27 21:16:41,164][106225] Updated weights for policy 1, policy_version 285611 (0.0007) [2023-12-27 21:16:41,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 146137088. Throughput: 0: 9827.6, 1: 10042.8. Samples: 146109916. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:41,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-5.715')] [2023-12-27 21:16:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000285080_73007104.pth... [2023-12-27 21:16:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000283928_72712192.pth [2023-12-27 21:16:41,223][106225] Updated weights for policy 1, policy_version 285621 (0.0008) [2023-12-27 21:16:41,292][106225] Updated weights for policy 1, policy_version 285631 (0.0008) [2023-12-27 21:16:41,296][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000285632_73138176.pth... [2023-12-27 21:16:41,301][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000284416_72826880.pth [2023-12-27 21:16:41,806][106226] Updated weights for policy 0, policy_version 285086 (0.0008) [2023-12-27 21:16:41,873][106226] Updated weights for policy 0, policy_version 285096 (0.0008) [2023-12-27 21:16:41,931][106226] Updated weights for policy 0, policy_version 285106 (0.0009) [2023-12-27 21:16:42,070][106225] Updated weights for policy 1, policy_version 285641 (0.0008) [2023-12-27 21:16:42,132][106225] Updated weights for policy 1, policy_version 285651 (0.0009) [2023-12-27 21:16:42,198][106225] Updated weights for policy 1, policy_version 285661 (0.0008) [2023-12-27 21:16:42,606][106226] Updated weights for policy 0, policy_version 285116 (0.0008) [2023-12-27 21:16:42,670][106226] Updated weights for policy 0, policy_version 285126 (0.0009) [2023-12-27 21:16:42,730][106226] Updated weights for policy 0, policy_version 285136 (0.0008) [2023-12-27 21:16:43,000][106225] Updated weights for policy 1, policy_version 285671 (0.0008) [2023-12-27 21:16:43,048][106225] Updated weights for policy 1, policy_version 285681 (0.0008) [2023-12-27 21:16:43,104][106225] Updated weights for policy 1, policy_version 285691 (0.0008) [2023-12-27 21:16:43,369][106226] Updated weights for policy 0, policy_version 285146 (0.0009) [2023-12-27 21:16:43,422][106226] Updated weights for policy 0, policy_version 285156 (0.0008) [2023-12-27 21:16:43,481][106226] Updated weights for policy 0, policy_version 285166 (0.0008) [2023-12-27 21:16:43,537][106226] Updated weights for policy 0, policy_version 285176 (0.0007) [2023-12-27 21:16:43,904][106225] Updated weights for policy 1, policy_version 285701 (0.0009) [2023-12-27 21:16:43,956][106225] Updated weights for policy 1, policy_version 285711 (0.0008) [2023-12-27 21:16:44,010][106225] Updated weights for policy 1, policy_version 285721 (0.0007) [2023-12-27 21:16:44,169][106226] Updated weights for policy 0, policy_version 285186 (0.0011) [2023-12-27 21:16:44,223][106226] Updated weights for policy 0, policy_version 285196 (0.0011) [2023-12-27 21:16:44,276][106226] Updated weights for policy 0, policy_version 285206 (0.0011) [2023-12-27 21:16:44,716][106225] Updated weights for policy 1, policy_version 285731 (0.0006) [2023-12-27 21:16:44,787][106225] Updated weights for policy 1, policy_version 285741 (0.0008) [2023-12-27 21:16:44,853][106225] Updated weights for policy 1, policy_version 285751 (0.0008) [2023-12-27 21:16:44,987][106226] Updated weights for policy 0, policy_version 285216 (0.0008) [2023-12-27 21:16:45,045][106226] Updated weights for policy 0, policy_version 285226 (0.0006) [2023-12-27 21:16:45,098][106226] Updated weights for policy 0, policy_version 285236 (0.0008) [2023-12-27 21:16:45,581][106225] Updated weights for policy 1, policy_version 285761 (0.0008) [2023-12-27 21:16:45,639][106225] Updated weights for policy 1, policy_version 285771 (0.0006) [2023-12-27 21:16:45,684][106225] Updated weights for policy 1, policy_version 285781 (0.0008) [2023-12-27 21:16:45,730][106225] Updated weights for policy 1, policy_version 285791 (0.0008) [2023-12-27 21:16:45,845][106226] Updated weights for policy 0, policy_version 285246 (0.0009) [2023-12-27 21:16:45,889][106226] Updated weights for policy 0, policy_version 285256 (0.0009) [2023-12-27 21:16:45,947][106226] Updated weights for policy 0, policy_version 285266 (0.0008) [2023-12-27 21:16:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 146235392. Throughput: 0: 9840.0, 1: 10094.1. Samples: 146224800. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:46,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-5.902')] [2023-12-27 21:16:46,424][106225] Updated weights for policy 1, policy_version 285801 (0.0008) [2023-12-27 21:16:46,479][106225] Updated weights for policy 1, policy_version 285811 (0.0008) [2023-12-27 21:16:46,527][106225] Updated weights for policy 1, policy_version 285821 (0.0007) [2023-12-27 21:16:46,686][106226] Updated weights for policy 0, policy_version 285276 (0.0009) [2023-12-27 21:16:46,736][106226] Updated weights for policy 0, policy_version 285286 (0.0009) [2023-12-27 21:16:46,791][106226] Updated weights for policy 0, policy_version 285296 (0.0008) [2023-12-27 21:16:47,158][106225] Updated weights for policy 1, policy_version 285831 (0.0005) [2023-12-27 21:16:47,219][106225] Updated weights for policy 1, policy_version 285841 (0.0005) [2023-12-27 21:16:47,278][106225] Updated weights for policy 1, policy_version 285851 (0.0008) [2023-12-27 21:16:47,449][106226] Updated weights for policy 0, policy_version 285306 (0.0009) [2023-12-27 21:16:47,506][106226] Updated weights for policy 0, policy_version 285316 (0.0008) [2023-12-27 21:16:47,557][106226] Updated weights for policy 0, policy_version 285326 (0.0008) [2023-12-27 21:16:47,613][106226] Updated weights for policy 0, policy_version 285336 (0.0009) [2023-12-27 21:16:47,948][106225] Updated weights for policy 1, policy_version 285861 (0.0008) [2023-12-27 21:16:48,015][106225] Updated weights for policy 1, policy_version 285871 (0.0010) [2023-12-27 21:16:48,083][106225] Updated weights for policy 1, policy_version 285881 (0.0008) [2023-12-27 21:16:48,231][106226] Updated weights for policy 0, policy_version 285346 (0.0005) [2023-12-27 21:16:48,294][106226] Updated weights for policy 0, policy_version 285356 (0.0005) [2023-12-27 21:16:48,364][106226] Updated weights for policy 0, policy_version 285366 (0.0007) [2023-12-27 21:16:48,860][106225] Updated weights for policy 1, policy_version 285891 (0.0009) [2023-12-27 21:16:48,918][106225] Updated weights for policy 1, policy_version 285902 (0.0011) [2023-12-27 21:16:48,970][106225] Updated weights for policy 1, policy_version 285912 (0.0009) [2023-12-27 21:16:48,990][106226] Updated weights for policy 0, policy_version 285376 (0.0006) [2023-12-27 21:16:49,065][106226] Updated weights for policy 0, policy_version 285386 (0.0006) [2023-12-27 21:16:49,131][106226] Updated weights for policy 0, policy_version 285396 (0.0009) [2023-12-27 21:16:49,690][106225] Updated weights for policy 1, policy_version 285922 (0.0007) [2023-12-27 21:16:49,752][106225] Updated weights for policy 1, policy_version 285932 (0.0009) [2023-12-27 21:16:49,806][106225] Updated weights for policy 1, policy_version 285942 (0.0008) [2023-12-27 21:16:49,817][106226] Updated weights for policy 0, policy_version 285406 (0.0007) [2023-12-27 21:16:49,867][106225] Updated weights for policy 1, policy_version 285952 (0.0009) [2023-12-27 21:16:49,880][106226] Updated weights for policy 0, policy_version 285416 (0.0009) [2023-12-27 21:16:49,940][106226] Updated weights for policy 0, policy_version 285426 (0.0009) [2023-12-27 21:16:50,638][106225] Updated weights for policy 1, policy_version 285962 (0.0010) [2023-12-27 21:16:50,691][106225] Updated weights for policy 1, policy_version 285972 (0.0008) [2023-12-27 21:16:50,716][106226] Updated weights for policy 0, policy_version 285436 (0.0008) [2023-12-27 21:16:50,747][106225] Updated weights for policy 1, policy_version 285982 (0.0008) [2023-12-27 21:16:50,772][106226] Updated weights for policy 0, policy_version 285446 (0.0010) [2023-12-27 21:16:50,825][106226] Updated weights for policy 0, policy_version 285456 (0.0009) [2023-12-27 21:16:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 146333696. Throughput: 0: 9829.4, 1: 10005.5. Samples: 146342288. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:51,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.899')] [2023-12-27 21:16:51,481][106225] Updated weights for policy 1, policy_version 285992 (0.0008) [2023-12-27 21:16:51,542][106225] Updated weights for policy 1, policy_version 286002 (0.0009) [2023-12-27 21:16:51,590][106226] Updated weights for policy 0, policy_version 285466 (0.0008) [2023-12-27 21:16:51,605][106225] Updated weights for policy 1, policy_version 286012 (0.0008) [2023-12-27 21:16:51,664][106226] Updated weights for policy 0, policy_version 285476 (0.0008) [2023-12-27 21:16:51,716][106226] Updated weights for policy 0, policy_version 285486 (0.0008) [2023-12-27 21:16:51,786][106226] Updated weights for policy 0, policy_version 285496 (0.0008) [2023-12-27 21:16:52,359][106225] Updated weights for policy 1, policy_version 286022 (0.0008) [2023-12-27 21:16:52,418][106225] Updated weights for policy 1, policy_version 286032 (0.0009) [2023-12-27 21:16:52,479][106225] Updated weights for policy 1, policy_version 286042 (0.0008) [2023-12-27 21:16:52,533][106226] Updated weights for policy 0, policy_version 285506 (0.0009) [2023-12-27 21:16:52,590][106226] Updated weights for policy 0, policy_version 285516 (0.0009) [2023-12-27 21:16:52,652][106226] Updated weights for policy 0, policy_version 285526 (0.0008) [2023-12-27 21:16:53,211][106225] Updated weights for policy 1, policy_version 286052 (0.0008) [2023-12-27 21:16:53,272][106225] Updated weights for policy 1, policy_version 286062 (0.0009) [2023-12-27 21:16:53,328][106225] Updated weights for policy 1, policy_version 286072 (0.0008) [2023-12-27 21:16:53,358][106226] Updated weights for policy 0, policy_version 285536 (0.0007) [2023-12-27 21:16:53,414][106226] Updated weights for policy 0, policy_version 285546 (0.0007) [2023-12-27 21:16:53,472][106226] Updated weights for policy 0, policy_version 285556 (0.0008) [2023-12-27 21:16:54,041][106225] Updated weights for policy 1, policy_version 286082 (0.0007) [2023-12-27 21:16:54,099][106225] Updated weights for policy 1, policy_version 286092 (0.0010) [2023-12-27 21:16:54,163][106225] Updated weights for policy 1, policy_version 286102 (0.0008) [2023-12-27 21:16:54,201][106226] Updated weights for policy 0, policy_version 285566 (0.0008) [2023-12-27 21:16:54,212][106225] Updated weights for policy 1, policy_version 286112 (0.0006) [2023-12-27 21:16:54,256][106226] Updated weights for policy 0, policy_version 285576 (0.0008) [2023-12-27 21:16:54,312][106226] Updated weights for policy 0, policy_version 285586 (0.0008) [2023-12-27 21:16:54,852][106225] Updated weights for policy 1, policy_version 286122 (0.0008) [2023-12-27 21:16:54,899][106225] Updated weights for policy 1, policy_version 286132 (0.0009) [2023-12-27 21:16:54,952][106225] Updated weights for policy 1, policy_version 286142 (0.0005) [2023-12-27 21:16:55,019][106226] Updated weights for policy 0, policy_version 285596 (0.0008) [2023-12-27 21:16:55,071][106226] Updated weights for policy 0, policy_version 285606 (0.0005) [2023-12-27 21:16:55,128][106226] Updated weights for policy 0, policy_version 285616 (0.0006) [2023-12-27 21:16:55,689][106225] Updated weights for policy 1, policy_version 286152 (0.0008) [2023-12-27 21:16:55,748][106225] Updated weights for policy 1, policy_version 286162 (0.0008) [2023-12-27 21:16:55,805][106225] Updated weights for policy 1, policy_version 286172 (0.0008) [2023-12-27 21:16:55,820][106226] Updated weights for policy 0, policy_version 285626 (0.0008) [2023-12-27 21:16:55,881][106226] Updated weights for policy 0, policy_version 285636 (0.0009) [2023-12-27 21:16:55,935][106226] Updated weights for policy 0, policy_version 285646 (0.0007) [2023-12-27 21:16:56,013][106226] Updated weights for policy 0, policy_version 285656 (0.0006) [2023-12-27 21:16:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19716.3). Total num frames: 146432000. Throughput: 0: 9851.3, 1: 9933.5. Samples: 146398744. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 21:16:56,176][105115] Avg episode reward: [(0, '-4.692'), (1, '-5.969')] [2023-12-27 21:16:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000286176_73277440.pth... [2023-12-27 21:16:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000285656_73154560.pth... [2023-12-27 21:16:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000285024_72982528.pth [2023-12-27 21:16:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000284472_72851456.pth [2023-12-27 21:16:56,490][106225] Updated weights for policy 1, policy_version 286182 (0.0008) [2023-12-27 21:16:56,551][106225] Updated weights for policy 1, policy_version 286192 (0.0009) [2023-12-27 21:16:56,608][106225] Updated weights for policy 1, policy_version 286202 (0.0007) [2023-12-27 21:16:56,699][106226] Updated weights for policy 0, policy_version 285666 (0.0006) [2023-12-27 21:16:56,763][106226] Updated weights for policy 0, policy_version 285676 (0.0005) [2023-12-27 21:16:56,831][106226] Updated weights for policy 0, policy_version 285686 (0.0006) [2023-12-27 21:16:57,361][106225] Updated weights for policy 1, policy_version 286212 (0.0009) [2023-12-27 21:16:57,403][106225] Updated weights for policy 1, policy_version 286222 (0.0008) [2023-12-27 21:16:57,447][106225] Updated weights for policy 1, policy_version 286232 (0.0007) [2023-12-27 21:16:57,451][106226] Updated weights for policy 0, policy_version 285696 (0.0010) [2023-12-27 21:16:57,504][106226] Updated weights for policy 0, policy_version 285706 (0.0010) [2023-12-27 21:16:57,562][106226] Updated weights for policy 0, policy_version 285716 (0.0010) [2023-12-27 21:16:58,154][106225] Updated weights for policy 1, policy_version 286242 (0.0008) [2023-12-27 21:16:58,215][106225] Updated weights for policy 1, policy_version 286252 (0.0008) [2023-12-27 21:16:58,275][106225] Updated weights for policy 1, policy_version 286262 (0.0008) [2023-12-27 21:16:58,276][106226] Updated weights for policy 0, policy_version 285726 (0.0010) [2023-12-27 21:16:58,338][106225] Updated weights for policy 1, policy_version 286272 (0.0007) [2023-12-27 21:16:58,339][106226] Updated weights for policy 0, policy_version 285736 (0.0006) [2023-12-27 21:16:58,408][106226] Updated weights for policy 0, policy_version 285746 (0.0009) [2023-12-27 21:16:59,120][106225] Updated weights for policy 1, policy_version 286282 (0.0007) [2023-12-27 21:16:59,172][106225] Updated weights for policy 1, policy_version 286292 (0.0008) [2023-12-27 21:16:59,187][106226] Updated weights for policy 0, policy_version 285756 (0.0010) [2023-12-27 21:16:59,233][106225] Updated weights for policy 1, policy_version 286302 (0.0008) [2023-12-27 21:16:59,257][106226] Updated weights for policy 0, policy_version 285766 (0.0008) [2023-12-27 21:16:59,313][106226] Updated weights for policy 0, policy_version 285776 (0.0008) [2023-12-27 21:17:00,030][106226] Updated weights for policy 0, policy_version 285786 (0.0009) [2023-12-27 21:17:00,037][106225] Updated weights for policy 1, policy_version 286312 (0.0008) [2023-12-27 21:17:00,092][106226] Updated weights for policy 0, policy_version 285796 (0.0006) [2023-12-27 21:17:00,097][106225] Updated weights for policy 1, policy_version 286322 (0.0008) [2023-12-27 21:17:00,155][106225] Updated weights for policy 1, policy_version 286332 (0.0008) [2023-12-27 21:17:00,165][106226] Updated weights for policy 0, policy_version 285806 (0.0006) [2023-12-27 21:17:00,219][106226] Updated weights for policy 0, policy_version 285816 (0.0005) [2023-12-27 21:17:00,764][106226] Updated weights for policy 0, policy_version 285826 (0.0008) [2023-12-27 21:17:00,828][106226] Updated weights for policy 0, policy_version 285836 (0.0009) [2023-12-27 21:17:00,879][106226] Updated weights for policy 0, policy_version 285846 (0.0008) [2023-12-27 21:17:00,892][106225] Updated weights for policy 1, policy_version 286342 (0.0007) [2023-12-27 21:17:00,953][106225] Updated weights for policy 1, policy_version 286352 (0.0008) [2023-12-27 21:17:01,009][106225] Updated weights for policy 1, policy_version 286362 (0.0008) [2023-12-27 21:17:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 146530304. Throughput: 0: 9939.1, 1: 9909.5. Samples: 146515076. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:01,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-5.824')] [2023-12-27 21:17:01,642][106226] Updated weights for policy 0, policy_version 285856 (0.0008) [2023-12-27 21:17:01,693][106226] Updated weights for policy 0, policy_version 285866 (0.0008) [2023-12-27 21:17:01,762][106226] Updated weights for policy 0, policy_version 285876 (0.0008) [2023-12-27 21:17:01,803][106225] Updated weights for policy 1, policy_version 286372 (0.0009) [2023-12-27 21:17:01,856][106225] Updated weights for policy 1, policy_version 286382 (0.0008) [2023-12-27 21:17:01,917][106225] Updated weights for policy 1, policy_version 286392 (0.0010) [2023-12-27 21:17:02,474][106226] Updated weights for policy 0, policy_version 285886 (0.0009) [2023-12-27 21:17:02,531][106226] Updated weights for policy 0, policy_version 285896 (0.0010) [2023-12-27 21:17:02,574][106225] Updated weights for policy 1, policy_version 286402 (0.0010) [2023-12-27 21:17:02,588][106226] Updated weights for policy 0, policy_version 285906 (0.0006) [2023-12-27 21:17:02,637][106225] Updated weights for policy 1, policy_version 286412 (0.0010) [2023-12-27 21:17:02,693][106225] Updated weights for policy 1, policy_version 286422 (0.0010) [2023-12-27 21:17:02,757][106225] Updated weights for policy 1, policy_version 286432 (0.0008) [2023-12-27 21:17:03,216][106226] Updated weights for policy 0, policy_version 285916 (0.0008) [2023-12-27 21:17:03,269][106226] Updated weights for policy 0, policy_version 285926 (0.0010) [2023-12-27 21:17:03,318][106226] Updated weights for policy 0, policy_version 285936 (0.0010) [2023-12-27 21:17:03,427][106225] Updated weights for policy 1, policy_version 286442 (0.0010) [2023-12-27 21:17:03,479][106225] Updated weights for policy 1, policy_version 286452 (0.0010) [2023-12-27 21:17:03,534][106225] Updated weights for policy 1, policy_version 286462 (0.0010) [2023-12-27 21:17:03,898][106226] Updated weights for policy 0, policy_version 285946 (0.0009) [2023-12-27 21:17:03,959][106226] Updated weights for policy 0, policy_version 285956 (0.0005) [2023-12-27 21:17:04,021][106226] Updated weights for policy 0, policy_version 285966 (0.0006) [2023-12-27 21:17:04,077][106226] Updated weights for policy 0, policy_version 285976 (0.0005) [2023-12-27 21:17:04,229][106225] Updated weights for policy 1, policy_version 286472 (0.0010) [2023-12-27 21:17:04,290][106225] Updated weights for policy 1, policy_version 286482 (0.0010) [2023-12-27 21:17:04,345][106225] Updated weights for policy 1, policy_version 286492 (0.0010) [2023-12-27 21:17:04,688][106226] Updated weights for policy 0, policy_version 285986 (0.0005) [2023-12-27 21:17:04,758][106226] Updated weights for policy 0, policy_version 285996 (0.0006) [2023-12-27 21:17:04,814][106226] Updated weights for policy 0, policy_version 286006 (0.0008) [2023-12-27 21:17:05,053][106225] Updated weights for policy 1, policy_version 286502 (0.0007) [2023-12-27 21:17:05,105][106225] Updated weights for policy 1, policy_version 286512 (0.0005) [2023-12-27 21:17:05,152][106225] Updated weights for policy 1, policy_version 286522 (0.0005) [2023-12-27 21:17:05,458][106226] Updated weights for policy 0, policy_version 286016 (0.0006) [2023-12-27 21:17:05,509][106226] Updated weights for policy 0, policy_version 286026 (0.0005) [2023-12-27 21:17:05,558][106226] Updated weights for policy 0, policy_version 286036 (0.0005) [2023-12-27 21:17:05,758][106225] Updated weights for policy 1, policy_version 286532 (0.0007) [2023-12-27 21:17:05,812][106225] Updated weights for policy 1, policy_version 286542 (0.0009) [2023-12-27 21:17:05,863][106225] Updated weights for policy 1, policy_version 286552 (0.0010) [2023-12-27 21:17:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 146628608. Throughput: 0: 9963.4, 1: 9848.6. Samples: 146638240. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:06,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.584')] [2023-12-27 21:17:06,280][106226] Updated weights for policy 0, policy_version 286046 (0.0005) [2023-12-27 21:17:06,346][106226] Updated weights for policy 0, policy_version 286056 (0.0006) [2023-12-27 21:17:06,409][106226] Updated weights for policy 0, policy_version 286066 (0.0008) [2023-12-27 21:17:06,536][106225] Updated weights for policy 1, policy_version 286562 (0.0010) [2023-12-27 21:17:06,594][106225] Updated weights for policy 1, policy_version 286572 (0.0010) [2023-12-27 21:17:06,649][106225] Updated weights for policy 1, policy_version 286582 (0.0009) [2023-12-27 21:17:06,700][106225] Updated weights for policy 1, policy_version 286592 (0.0008) [2023-12-27 21:17:07,033][106226] Updated weights for policy 0, policy_version 286076 (0.0008) [2023-12-27 21:17:07,089][106226] Updated weights for policy 0, policy_version 286086 (0.0010) [2023-12-27 21:17:07,155][106226] Updated weights for policy 0, policy_version 286096 (0.0010) [2023-12-27 21:17:07,483][106225] Updated weights for policy 1, policy_version 286602 (0.0007) [2023-12-27 21:17:07,545][106225] Updated weights for policy 1, policy_version 286612 (0.0009) [2023-12-27 21:17:07,605][106225] Updated weights for policy 1, policy_version 286622 (0.0010) [2023-12-27 21:17:07,778][106226] Updated weights for policy 0, policy_version 286106 (0.0007) [2023-12-27 21:17:07,833][106226] Updated weights for policy 0, policy_version 286116 (0.0008) [2023-12-27 21:17:07,886][106226] Updated weights for policy 0, policy_version 286126 (0.0009) [2023-12-27 21:17:07,936][106226] Updated weights for policy 0, policy_version 286136 (0.0009) [2023-12-27 21:17:08,222][106225] Updated weights for policy 1, policy_version 286632 (0.0006) [2023-12-27 21:17:08,276][106225] Updated weights for policy 1, policy_version 286642 (0.0005) [2023-12-27 21:17:08,328][106225] Updated weights for policy 1, policy_version 286652 (0.0005) [2023-12-27 21:17:08,766][106226] Updated weights for policy 0, policy_version 286146 (0.0009) [2023-12-27 21:17:08,831][106226] Updated weights for policy 0, policy_version 286156 (0.0009) [2023-12-27 21:17:08,895][106226] Updated weights for policy 0, policy_version 286166 (0.0008) [2023-12-27 21:17:08,950][106225] Updated weights for policy 1, policy_version 286662 (0.0007) [2023-12-27 21:17:09,009][106225] Updated weights for policy 1, policy_version 286672 (0.0008) [2023-12-27 21:17:09,081][106225] Updated weights for policy 1, policy_version 286682 (0.0010) [2023-12-27 21:17:09,696][106226] Updated weights for policy 0, policy_version 286176 (0.0006) [2023-12-27 21:17:09,759][106226] Updated weights for policy 0, policy_version 286186 (0.0006) [2023-12-27 21:17:09,829][106226] Updated weights for policy 0, policy_version 286196 (0.0007) [2023-12-27 21:17:09,861][106225] Updated weights for policy 1, policy_version 286692 (0.0009) [2023-12-27 21:17:09,923][106225] Updated weights for policy 1, policy_version 286702 (0.0011) [2023-12-27 21:17:09,992][106225] Updated weights for policy 1, policy_version 286712 (0.0011) [2023-12-27 21:17:10,470][106226] Updated weights for policy 0, policy_version 286206 (0.0007) [2023-12-27 21:17:10,527][106226] Updated weights for policy 0, policy_version 286216 (0.0007) [2023-12-27 21:17:10,581][106226] Updated weights for policy 0, policy_version 286226 (0.0008) [2023-12-27 21:17:10,714][106225] Updated weights for policy 1, policy_version 286722 (0.0010) [2023-12-27 21:17:10,772][106225] Updated weights for policy 1, policy_version 286732 (0.0008) [2023-12-27 21:17:10,823][106225] Updated weights for policy 1, policy_version 286742 (0.0008) [2023-12-27 21:17:10,876][106225] Updated weights for policy 1, policy_version 286752 (0.0007) [2023-12-27 21:17:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 146726912. Throughput: 0: 9962.5, 1: 9893.2. Samples: 146698304. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:11,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-5.456')] [2023-12-27 21:17:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000286752_73424896.pth... [2023-12-27 21:17:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000286232_73302016.pth... [2023-12-27 21:17:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000285632_73138176.pth [2023-12-27 21:17:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000285080_73007104.pth [2023-12-27 21:17:11,349][106226] Updated weights for policy 0, policy_version 286236 (0.0008) [2023-12-27 21:17:11,417][106226] Updated weights for policy 0, policy_version 286246 (0.0008) [2023-12-27 21:17:11,481][106226] Updated weights for policy 0, policy_version 286256 (0.0008) [2023-12-27 21:17:11,652][106225] Updated weights for policy 1, policy_version 286762 (0.0009) [2023-12-27 21:17:11,723][106225] Updated weights for policy 1, policy_version 286772 (0.0007) [2023-12-27 21:17:11,788][106225] Updated weights for policy 1, policy_version 286782 (0.0009) [2023-12-27 21:17:12,229][106226] Updated weights for policy 0, policy_version 286266 (0.0008) [2023-12-27 21:17:12,293][106226] Updated weights for policy 0, policy_version 286276 (0.0008) [2023-12-27 21:17:12,351][106226] Updated weights for policy 0, policy_version 286286 (0.0010) [2023-12-27 21:17:12,426][106226] Updated weights for policy 0, policy_version 286296 (0.0010) [2023-12-27 21:17:12,518][106225] Updated weights for policy 1, policy_version 286792 (0.0008) [2023-12-27 21:17:12,578][106225] Updated weights for policy 1, policy_version 286802 (0.0009) [2023-12-27 21:17:12,628][106225] Updated weights for policy 1, policy_version 286812 (0.0008) [2023-12-27 21:17:13,091][106226] Updated weights for policy 0, policy_version 286306 (0.0009) [2023-12-27 21:17:13,154][106226] Updated weights for policy 0, policy_version 286316 (0.0009) [2023-12-27 21:17:13,218][106226] Updated weights for policy 0, policy_version 286326 (0.0007) [2023-12-27 21:17:13,270][106225] Updated weights for policy 1, policy_version 286822 (0.0007) [2023-12-27 21:17:13,314][106225] Updated weights for policy 1, policy_version 286832 (0.0007) [2023-12-27 21:17:13,372][106225] Updated weights for policy 1, policy_version 286842 (0.0009) [2023-12-27 21:17:13,826][106226] Updated weights for policy 0, policy_version 286336 (0.0006) [2023-12-27 21:17:13,876][106226] Updated weights for policy 0, policy_version 286346 (0.0006) [2023-12-27 21:17:13,926][106226] Updated weights for policy 0, policy_version 286356 (0.0008) [2023-12-27 21:17:14,011][106225] Updated weights for policy 1, policy_version 286852 (0.0007) [2023-12-27 21:17:14,076][106225] Updated weights for policy 1, policy_version 286862 (0.0010) [2023-12-27 21:17:14,124][106225] Updated weights for policy 1, policy_version 286872 (0.0008) [2023-12-27 21:17:14,530][106226] Updated weights for policy 0, policy_version 286366 (0.0008) [2023-12-27 21:17:14,583][106226] Updated weights for policy 0, policy_version 286376 (0.0009) [2023-12-27 21:17:14,648][106226] Updated weights for policy 0, policy_version 286386 (0.0010) [2023-12-27 21:17:14,820][106225] Updated weights for policy 1, policy_version 286882 (0.0008) [2023-12-27 21:17:14,881][106225] Updated weights for policy 1, policy_version 286892 (0.0009) [2023-12-27 21:17:14,940][106225] Updated weights for policy 1, policy_version 286902 (0.0009) [2023-12-27 21:17:15,010][106225] Updated weights for policy 1, policy_version 286912 (0.0009) [2023-12-27 21:17:15,421][106226] Updated weights for policy 0, policy_version 286396 (0.0009) [2023-12-27 21:17:15,471][106226] Updated weights for policy 0, policy_version 286406 (0.0007) [2023-12-27 21:17:15,520][106226] Updated weights for policy 0, policy_version 286416 (0.0009) [2023-12-27 21:17:15,778][106225] Updated weights for policy 1, policy_version 286922 (0.0008) [2023-12-27 21:17:15,833][106225] Updated weights for policy 1, policy_version 286932 (0.0006) [2023-12-27 21:17:15,890][106225] Updated weights for policy 1, policy_version 286942 (0.0006) [2023-12-27 21:17:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 146825216. Throughput: 0: 10016.5, 1: 9747.9. Samples: 146816084. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:16,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-6.012')] [2023-12-27 21:17:16,240][106226] Updated weights for policy 0, policy_version 286426 (0.0008) [2023-12-27 21:17:16,288][106226] Updated weights for policy 0, policy_version 286436 (0.0007) [2023-12-27 21:17:16,355][106226] Updated weights for policy 0, policy_version 286446 (0.0006) [2023-12-27 21:17:16,411][106226] Updated weights for policy 0, policy_version 286456 (0.0009) [2023-12-27 21:17:16,593][106225] Updated weights for policy 1, policy_version 286952 (0.0006) [2023-12-27 21:17:16,658][106225] Updated weights for policy 1, policy_version 286962 (0.0007) [2023-12-27 21:17:16,721][106225] Updated weights for policy 1, policy_version 286972 (0.0008) [2023-12-27 21:17:17,173][106226] Updated weights for policy 0, policy_version 286466 (0.0007) [2023-12-27 21:17:17,223][106226] Updated weights for policy 0, policy_version 286476 (0.0009) [2023-12-27 21:17:17,279][106226] Updated weights for policy 0, policy_version 286486 (0.0008) [2023-12-27 21:17:17,283][106225] Updated weights for policy 1, policy_version 286982 (0.0006) [2023-12-27 21:17:17,339][106225] Updated weights for policy 1, policy_version 286992 (0.0005) [2023-12-27 21:17:17,391][106225] Updated weights for policy 1, policy_version 287002 (0.0006) [2023-12-27 21:17:18,015][106225] Updated weights for policy 1, policy_version 287012 (0.0007) [2023-12-27 21:17:18,068][106225] Updated weights for policy 1, policy_version 287022 (0.0007) [2023-12-27 21:17:18,078][106226] Updated weights for policy 0, policy_version 286496 (0.0007) [2023-12-27 21:17:18,119][106225] Updated weights for policy 1, policy_version 287032 (0.0007) [2023-12-27 21:17:18,136][106226] Updated weights for policy 0, policy_version 286506 (0.0007) [2023-12-27 21:17:18,190][106226] Updated weights for policy 0, policy_version 286516 (0.0007) [2023-12-27 21:17:18,823][106225] Updated weights for policy 1, policy_version 287042 (0.0005) [2023-12-27 21:17:18,877][106225] Updated weights for policy 1, policy_version 287052 (0.0005) [2023-12-27 21:17:18,933][106226] Updated weights for policy 0, policy_version 286526 (0.0009) [2023-12-27 21:17:18,940][106225] Updated weights for policy 1, policy_version 287062 (0.0005) [2023-12-27 21:17:18,990][106226] Updated weights for policy 0, policy_version 286536 (0.0007) [2023-12-27 21:17:18,996][106225] Updated weights for policy 1, policy_version 287072 (0.0005) [2023-12-27 21:17:19,048][106226] Updated weights for policy 0, policy_version 286546 (0.0009) [2023-12-27 21:17:19,656][106225] Updated weights for policy 1, policy_version 287082 (0.0008) [2023-12-27 21:17:19,705][106225] Updated weights for policy 1, policy_version 287092 (0.0008) [2023-12-27 21:17:19,763][106225] Updated weights for policy 1, policy_version 287102 (0.0010) [2023-12-27 21:17:19,870][106226] Updated weights for policy 0, policy_version 286556 (0.0008) [2023-12-27 21:17:19,933][106226] Updated weights for policy 0, policy_version 286566 (0.0008) [2023-12-27 21:17:19,996][106226] Updated weights for policy 0, policy_version 286576 (0.0008) [2023-12-27 21:17:20,521][106225] Updated weights for policy 1, policy_version 287112 (0.0008) [2023-12-27 21:17:20,580][106225] Updated weights for policy 1, policy_version 287122 (0.0007) [2023-12-27 21:17:20,648][106225] Updated weights for policy 1, policy_version 287132 (0.0008) [2023-12-27 21:17:20,738][106226] Updated weights for policy 0, policy_version 286586 (0.0008) [2023-12-27 21:17:20,795][106226] Updated weights for policy 0, policy_version 286596 (0.0009) [2023-12-27 21:17:20,852][106226] Updated weights for policy 0, policy_version 286606 (0.0009) [2023-12-27 21:17:20,910][106226] Updated weights for policy 0, policy_version 286616 (0.0009) [2023-12-27 21:17:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 146923520. Throughput: 0: 9859.4, 1: 9753.3. Samples: 146931440. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:21,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-5.711')] [2023-12-27 21:17:21,465][106225] Updated weights for policy 1, policy_version 287142 (0.0009) [2023-12-27 21:17:21,526][106225] Updated weights for policy 1, policy_version 287152 (0.0009) [2023-12-27 21:17:21,586][106225] Updated weights for policy 1, policy_version 287162 (0.0008) [2023-12-27 21:17:21,730][106226] Updated weights for policy 0, policy_version 286626 (0.0009) [2023-12-27 21:17:21,801][106226] Updated weights for policy 0, policy_version 286636 (0.0007) [2023-12-27 21:17:21,862][106226] Updated weights for policy 0, policy_version 286646 (0.0009) [2023-12-27 21:17:22,358][106225] Updated weights for policy 1, policy_version 287172 (0.0009) [2023-12-27 21:17:22,419][106225] Updated weights for policy 1, policy_version 287182 (0.0009) [2023-12-27 21:17:22,471][106225] Updated weights for policy 1, policy_version 287192 (0.0009) [2023-12-27 21:17:22,576][106226] Updated weights for policy 0, policy_version 286656 (0.0007) [2023-12-27 21:17:22,637][106226] Updated weights for policy 0, policy_version 286666 (0.0008) [2023-12-27 21:17:22,697][106226] Updated weights for policy 0, policy_version 286676 (0.0009) [2023-12-27 21:17:23,135][106225] Updated weights for policy 1, policy_version 287202 (0.0010) [2023-12-27 21:17:23,194][106225] Updated weights for policy 1, policy_version 287212 (0.0008) [2023-12-27 21:17:23,247][106225] Updated weights for policy 1, policy_version 287222 (0.0005) [2023-12-27 21:17:23,307][106225] Updated weights for policy 1, policy_version 287232 (0.0005) [2023-12-27 21:17:23,503][106226] Updated weights for policy 0, policy_version 286686 (0.0008) [2023-12-27 21:17:23,559][106226] Updated weights for policy 0, policy_version 286696 (0.0008) [2023-12-27 21:17:23,604][106226] Updated weights for policy 0, policy_version 286706 (0.0008) [2023-12-27 21:17:23,984][106225] Updated weights for policy 1, policy_version 287242 (0.0008) [2023-12-27 21:17:24,042][106225] Updated weights for policy 1, policy_version 287252 (0.0008) [2023-12-27 21:17:24,103][106225] Updated weights for policy 1, policy_version 287262 (0.0008) [2023-12-27 21:17:24,359][106226] Updated weights for policy 0, policy_version 286716 (0.0008) [2023-12-27 21:17:24,414][106226] Updated weights for policy 0, policy_version 286726 (0.0005) [2023-12-27 21:17:24,476][106226] Updated weights for policy 0, policy_version 286736 (0.0005) [2023-12-27 21:17:24,752][106225] Updated weights for policy 1, policy_version 287272 (0.0006) [2023-12-27 21:17:24,818][106225] Updated weights for policy 1, policy_version 287282 (0.0005) [2023-12-27 21:17:24,885][106225] Updated weights for policy 1, policy_version 287292 (0.0006) [2023-12-27 21:17:25,190][106226] Updated weights for policy 0, policy_version 286746 (0.0007) [2023-12-27 21:17:25,248][106226] Updated weights for policy 0, policy_version 286756 (0.0009) [2023-12-27 21:17:25,317][106226] Updated weights for policy 0, policy_version 286766 (0.0008) [2023-12-27 21:17:25,372][106226] Updated weights for policy 0, policy_version 286776 (0.0008) [2023-12-27 21:17:25,421][106225] Updated weights for policy 1, policy_version 287302 (0.0009) [2023-12-27 21:17:25,472][106225] Updated weights for policy 1, policy_version 287312 (0.0006) [2023-12-27 21:17:25,517][106225] Updated weights for policy 1, policy_version 287322 (0.0005) [2023-12-27 21:17:26,096][106225] Updated weights for policy 1, policy_version 287332 (0.0005) [2023-12-27 21:17:26,153][106225] Updated weights for policy 1, policy_version 287342 (0.0005) [2023-12-27 21:17:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 147013632. Throughput: 0: 9763.6, 1: 9752.9. Samples: 146988156. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:26,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-5.882')] [2023-12-27 21:17:26,178][106226] Updated weights for policy 0, policy_version 286786 (0.0008) [2023-12-27 21:17:26,210][106225] Updated weights for policy 1, policy_version 287352 (0.0005) [2023-12-27 21:17:26,240][106226] Updated weights for policy 0, policy_version 286796 (0.0008) [2023-12-27 21:17:26,249][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000287360_73580544.pth... [2023-12-27 21:17:26,252][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000286176_73277440.pth [2023-12-27 21:17:26,294][106226] Updated weights for policy 0, policy_version 286807 (0.0010) [2023-12-27 21:17:26,296][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000286808_73449472.pth... [2023-12-27 21:17:26,299][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000285656_73154560.pth [2023-12-27 21:17:26,768][106225] Updated weights for policy 1, policy_version 287362 (0.0005) [2023-12-27 21:17:26,839][106225] Updated weights for policy 1, policy_version 287372 (0.0006) [2023-12-27 21:17:26,903][106225] Updated weights for policy 1, policy_version 287382 (0.0005) [2023-12-27 21:17:26,962][106225] Updated weights for policy 1, policy_version 287392 (0.0009) [2023-12-27 21:17:27,124][106226] Updated weights for policy 0, policy_version 286817 (0.0009) [2023-12-27 21:17:27,181][106226] Updated weights for policy 0, policy_version 286827 (0.0008) [2023-12-27 21:17:27,244][106226] Updated weights for policy 0, policy_version 286837 (0.0009) [2023-12-27 21:17:27,631][106225] Updated weights for policy 1, policy_version 287402 (0.0008) [2023-12-27 21:17:27,678][106225] Updated weights for policy 1, policy_version 287412 (0.0006) [2023-12-27 21:17:27,734][106225] Updated weights for policy 1, policy_version 287422 (0.0005) [2023-12-27 21:17:27,939][106226] Updated weights for policy 0, policy_version 286847 (0.0010) [2023-12-27 21:17:27,987][106226] Updated weights for policy 0, policy_version 286857 (0.0010) [2023-12-27 21:17:28,037][106226] Updated weights for policy 0, policy_version 286867 (0.0010) [2023-12-27 21:17:28,359][106225] Updated weights for policy 1, policy_version 287432 (0.0007) [2023-12-27 21:17:28,407][106225] Updated weights for policy 1, policy_version 287442 (0.0005) [2023-12-27 21:17:28,463][106225] Updated weights for policy 1, policy_version 287452 (0.0007) [2023-12-27 21:17:28,764][106226] Updated weights for policy 0, policy_version 286877 (0.0010) [2023-12-27 21:17:28,826][106226] Updated weights for policy 0, policy_version 286887 (0.0010) [2023-12-27 21:17:28,876][106226] Updated weights for policy 0, policy_version 286897 (0.0010) [2023-12-27 21:17:29,188][106225] Updated weights for policy 1, policy_version 287462 (0.0006) [2023-12-27 21:17:29,243][106225] Updated weights for policy 1, policy_version 287472 (0.0007) [2023-12-27 21:17:29,304][106225] Updated weights for policy 1, policy_version 287482 (0.0008) [2023-12-27 21:17:29,601][106226] Updated weights for policy 0, policy_version 286907 (0.0010) [2023-12-27 21:17:29,671][106226] Updated weights for policy 0, policy_version 286917 (0.0010) [2023-12-27 21:17:29,741][106226] Updated weights for policy 0, policy_version 286927 (0.0011) [2023-12-27 21:17:29,893][106225] Updated weights for policy 1, policy_version 287492 (0.0008) [2023-12-27 21:17:29,957][106225] Updated weights for policy 1, policy_version 287502 (0.0008) [2023-12-27 21:17:30,008][106225] Updated weights for policy 1, policy_version 287512 (0.0008) [2023-12-27 21:17:30,452][106226] Updated weights for policy 0, policy_version 286937 (0.0011) [2023-12-27 21:17:30,505][106226] Updated weights for policy 0, policy_version 286947 (0.0010) [2023-12-27 21:17:30,551][106226] Updated weights for policy 0, policy_version 286957 (0.0010) [2023-12-27 21:17:30,597][106226] Updated weights for policy 0, policy_version 286967 (0.0010) [2023-12-27 21:17:30,758][106225] Updated weights for policy 1, policy_version 287522 (0.0008) [2023-12-27 21:17:30,801][106225] Updated weights for policy 1, policy_version 287532 (0.0007) [2023-12-27 21:17:30,850][106225] Updated weights for policy 1, policy_version 287542 (0.0008) [2023-12-27 21:17:30,900][106225] Updated weights for policy 1, policy_version 287552 (0.0007) [2023-12-27 21:17:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 147120128. Throughput: 0: 9702.4, 1: 9957.7. Samples: 147109504. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:31,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.956')] [2023-12-27 21:17:31,316][106226] Updated weights for policy 0, policy_version 286977 (0.0010) [2023-12-27 21:17:31,362][106226] Updated weights for policy 0, policy_version 286987 (0.0007) [2023-12-27 21:17:31,432][106226] Updated weights for policy 0, policy_version 286997 (0.0007) [2023-12-27 21:17:31,758][106225] Updated weights for policy 1, policy_version 287562 (0.0008) [2023-12-27 21:17:31,816][106225] Updated weights for policy 1, policy_version 287572 (0.0006) [2023-12-27 21:17:31,876][106225] Updated weights for policy 1, policy_version 287582 (0.0007) [2023-12-27 21:17:32,109][106226] Updated weights for policy 0, policy_version 287007 (0.0005) [2023-12-27 21:17:32,162][106226] Updated weights for policy 0, policy_version 287017 (0.0005) [2023-12-27 21:17:32,214][106226] Updated weights for policy 0, policy_version 287027 (0.0008) [2023-12-27 21:17:32,581][106225] Updated weights for policy 1, policy_version 287592 (0.0008) [2023-12-27 21:17:32,635][106225] Updated weights for policy 1, policy_version 287602 (0.0007) [2023-12-27 21:17:32,680][106225] Updated weights for policy 1, policy_version 287612 (0.0005) [2023-12-27 21:17:32,880][106226] Updated weights for policy 0, policy_version 287037 (0.0010) [2023-12-27 21:17:32,937][106226] Updated weights for policy 0, policy_version 287047 (0.0006) [2023-12-27 21:17:33,001][106226] Updated weights for policy 0, policy_version 287057 (0.0005) [2023-12-27 21:17:33,289][106225] Updated weights for policy 1, policy_version 287622 (0.0005) [2023-12-27 21:17:33,334][106225] Updated weights for policy 1, policy_version 287632 (0.0005) [2023-12-27 21:17:33,384][106225] Updated weights for policy 1, policy_version 287642 (0.0005) [2023-12-27 21:17:33,590][106226] Updated weights for policy 0, policy_version 287067 (0.0007) [2023-12-27 21:17:33,645][106226] Updated weights for policy 0, policy_version 287077 (0.0006) [2023-12-27 21:17:33,691][106226] Updated weights for policy 0, policy_version 287087 (0.0005) [2023-12-27 21:17:33,976][106225] Updated weights for policy 1, policy_version 287652 (0.0005) [2023-12-27 21:17:34,027][106225] Updated weights for policy 1, policy_version 287662 (0.0006) [2023-12-27 21:17:34,080][106225] Updated weights for policy 1, policy_version 287672 (0.0008) [2023-12-27 21:17:34,314][106226] Updated weights for policy 0, policy_version 287097 (0.0006) [2023-12-27 21:17:34,382][106226] Updated weights for policy 0, policy_version 287107 (0.0007) [2023-12-27 21:17:34,444][106226] Updated weights for policy 0, policy_version 287117 (0.0009) [2023-12-27 21:17:34,513][106226] Updated weights for policy 0, policy_version 287127 (0.0006) [2023-12-27 21:17:34,899][106225] Updated weights for policy 1, policy_version 287682 (0.0010) [2023-12-27 21:17:34,960][106225] Updated weights for policy 1, policy_version 287692 (0.0009) [2023-12-27 21:17:35,015][106225] Updated weights for policy 1, policy_version 287702 (0.0008) [2023-12-27 21:17:35,068][106225] Updated weights for policy 1, policy_version 287712 (0.0008) [2023-12-27 21:17:35,074][106226] Updated weights for policy 0, policy_version 287137 (0.0006) [2023-12-27 21:17:35,119][106226] Updated weights for policy 0, policy_version 287147 (0.0008) [2023-12-27 21:17:35,167][106226] Updated weights for policy 0, policy_version 287157 (0.0008) [2023-12-27 21:17:35,774][106225] Updated weights for policy 1, policy_version 287722 (0.0008) [2023-12-27 21:17:35,821][106225] Updated weights for policy 1, policy_version 287733 (0.0009) [2023-12-27 21:17:35,882][106225] Updated weights for policy 1, policy_version 287743 (0.0008) [2023-12-27 21:17:35,913][106226] Updated weights for policy 0, policy_version 287167 (0.0008) [2023-12-27 21:17:35,971][106226] Updated weights for policy 0, policy_version 287177 (0.0009) [2023-12-27 21:17:36,034][106226] Updated weights for policy 0, policy_version 287187 (0.0009) [2023-12-27 21:17:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 147226624. Throughput: 0: 9778.4, 1: 9984.7. Samples: 147231628. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:36,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.697')] [2023-12-27 21:17:36,646][106225] Updated weights for policy 1, policy_version 287753 (0.0008) [2023-12-27 21:17:36,706][106225] Updated weights for policy 1, policy_version 287763 (0.0008) [2023-12-27 21:17:36,758][106225] Updated weights for policy 1, policy_version 287773 (0.0008) [2023-12-27 21:17:36,804][106226] Updated weights for policy 0, policy_version 287197 (0.0008) [2023-12-27 21:17:36,868][106226] Updated weights for policy 0, policy_version 287207 (0.0009) [2023-12-27 21:17:36,931][106226] Updated weights for policy 0, policy_version 287217 (0.0008) [2023-12-27 21:17:37,544][106225] Updated weights for policy 1, policy_version 287783 (0.0008) [2023-12-27 21:17:37,550][106226] Updated weights for policy 0, policy_version 287227 (0.0008) [2023-12-27 21:17:37,592][106225] Updated weights for policy 1, policy_version 287793 (0.0006) [2023-12-27 21:17:37,612][106226] Updated weights for policy 0, policy_version 287237 (0.0010) [2023-12-27 21:17:37,642][106225] Updated weights for policy 1, policy_version 287803 (0.0008) [2023-12-27 21:17:37,676][106226] Updated weights for policy 0, policy_version 287247 (0.0010) [2023-12-27 21:17:38,329][106226] Updated weights for policy 0, policy_version 287257 (0.0011) [2023-12-27 21:17:38,334][106225] Updated weights for policy 1, policy_version 287813 (0.0007) [2023-12-27 21:17:38,392][106225] Updated weights for policy 1, policy_version 287823 (0.0008) [2023-12-27 21:17:38,393][106226] Updated weights for policy 0, policy_version 287267 (0.0009) [2023-12-27 21:17:38,451][106225] Updated weights for policy 1, policy_version 287833 (0.0009) [2023-12-27 21:17:38,454][106226] Updated weights for policy 0, policy_version 287277 (0.0007) [2023-12-27 21:17:38,508][106226] Updated weights for policy 0, policy_version 287287 (0.0008) [2023-12-27 21:17:39,185][106225] Updated weights for policy 1, policy_version 287843 (0.0009) [2023-12-27 21:17:39,209][106226] Updated weights for policy 0, policy_version 287297 (0.0011) [2023-12-27 21:17:39,247][106225] Updated weights for policy 1, policy_version 287853 (0.0008) [2023-12-27 21:17:39,278][106226] Updated weights for policy 0, policy_version 287307 (0.0009) [2023-12-27 21:17:39,301][106225] Updated weights for policy 1, policy_version 287863 (0.0006) [2023-12-27 21:17:39,343][106226] Updated weights for policy 0, policy_version 287317 (0.0011) [2023-12-27 21:17:39,991][106226] Updated weights for policy 0, policy_version 287327 (0.0009) [2023-12-27 21:17:40,052][106226] Updated weights for policy 0, policy_version 287337 (0.0008) [2023-12-27 21:17:40,113][106226] Updated weights for policy 0, policy_version 287347 (0.0008) [2023-12-27 21:17:40,118][106225] Updated weights for policy 1, policy_version 287873 (0.0008) [2023-12-27 21:17:40,166][106225] Updated weights for policy 1, policy_version 287883 (0.0009) [2023-12-27 21:17:40,218][106225] Updated weights for policy 1, policy_version 287893 (0.0008) [2023-12-27 21:17:40,269][106225] Updated weights for policy 1, policy_version 287903 (0.0005) [2023-12-27 21:17:40,812][106226] Updated weights for policy 0, policy_version 287357 (0.0008) [2023-12-27 21:17:40,862][106226] Updated weights for policy 0, policy_version 287367 (0.0009) [2023-12-27 21:17:40,915][106226] Updated weights for policy 0, policy_version 287377 (0.0008) [2023-12-27 21:17:41,015][106225] Updated weights for policy 1, policy_version 287913 (0.0009) [2023-12-27 21:17:41,082][106225] Updated weights for policy 1, policy_version 287923 (0.0009) [2023-12-27 21:17:41,152][106225] Updated weights for policy 1, policy_version 287933 (0.0008) [2023-12-27 21:17:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 147324928. Throughput: 0: 9820.8, 1: 9987.6. Samples: 147290116. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:41,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-5.961')] [2023-12-27 21:17:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000287936_73728000.pth... [2023-12-27 21:17:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000287384_73596928.pth... [2023-12-27 21:17:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000286752_73424896.pth [2023-12-27 21:17:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000286232_73302016.pth [2023-12-27 21:17:41,714][106226] Updated weights for policy 0, policy_version 287387 (0.0009) [2023-12-27 21:17:41,791][106226] Updated weights for policy 0, policy_version 287397 (0.0010) [2023-12-27 21:17:41,860][106226] Updated weights for policy 0, policy_version 287407 (0.0009) [2023-12-27 21:17:41,993][106225] Updated weights for policy 1, policy_version 287943 (0.0006) [2023-12-27 21:17:42,056][106225] Updated weights for policy 1, policy_version 287953 (0.0007) [2023-12-27 21:17:42,124][106225] Updated weights for policy 1, policy_version 287963 (0.0006) [2023-12-27 21:17:42,601][106226] Updated weights for policy 0, policy_version 287417 (0.0009) [2023-12-27 21:17:42,661][106226] Updated weights for policy 0, policy_version 287427 (0.0005) [2023-12-27 21:17:42,730][106226] Updated weights for policy 0, policy_version 287437 (0.0009) [2023-12-27 21:17:42,793][106226] Updated weights for policy 0, policy_version 287447 (0.0010) [2023-12-27 21:17:42,831][106225] Updated weights for policy 1, policy_version 287973 (0.0006) [2023-12-27 21:17:42,901][106225] Updated weights for policy 1, policy_version 287983 (0.0007) [2023-12-27 21:17:42,961][106225] Updated weights for policy 1, policy_version 287993 (0.0008) [2023-12-27 21:17:43,503][106226] Updated weights for policy 0, policy_version 287457 (0.0008) [2023-12-27 21:17:43,557][106226] Updated weights for policy 0, policy_version 287467 (0.0007) [2023-12-27 21:17:43,602][106226] Updated weights for policy 0, policy_version 287477 (0.0005) [2023-12-27 21:17:43,663][106225] Updated weights for policy 1, policy_version 288003 (0.0009) [2023-12-27 21:17:43,722][106225] Updated weights for policy 1, policy_version 288013 (0.0010) [2023-12-27 21:17:43,779][106225] Updated weights for policy 1, policy_version 288023 (0.0010) [2023-12-27 21:17:44,246][106226] Updated weights for policy 0, policy_version 287487 (0.0007) [2023-12-27 21:17:44,305][106226] Updated weights for policy 0, policy_version 287497 (0.0008) [2023-12-27 21:17:44,360][106226] Updated weights for policy 0, policy_version 287507 (0.0009) [2023-12-27 21:17:44,532][106225] Updated weights for policy 1, policy_version 288033 (0.0010) [2023-12-27 21:17:44,587][106225] Updated weights for policy 1, policy_version 288043 (0.0008) [2023-12-27 21:17:44,640][106225] Updated weights for policy 1, policy_version 288053 (0.0009) [2023-12-27 21:17:44,693][106225] Updated weights for policy 1, policy_version 288063 (0.0008) [2023-12-27 21:17:45,032][106226] Updated weights for policy 0, policy_version 287517 (0.0009) [2023-12-27 21:17:45,094][106226] Updated weights for policy 0, policy_version 287527 (0.0010) [2023-12-27 21:17:45,156][106226] Updated weights for policy 0, policy_version 287537 (0.0011) [2023-12-27 21:17:45,487][106225] Updated weights for policy 1, policy_version 288073 (0.0008) [2023-12-27 21:17:45,537][106225] Updated weights for policy 1, policy_version 288083 (0.0007) [2023-12-27 21:17:45,588][106225] Updated weights for policy 1, policy_version 288093 (0.0007) [2023-12-27 21:17:45,881][106226] Updated weights for policy 0, policy_version 287547 (0.0011) [2023-12-27 21:17:45,931][106226] Updated weights for policy 0, policy_version 287557 (0.0010) [2023-12-27 21:17:45,981][106226] Updated weights for policy 0, policy_version 287567 (0.0011) [2023-12-27 21:17:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 147415040. Throughput: 0: 9834.2, 1: 9923.0. Samples: 147404144. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:46,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-6.001')] [2023-12-27 21:17:46,348][106225] Updated weights for policy 1, policy_version 288103 (0.0008) [2023-12-27 21:17:46,401][106225] Updated weights for policy 1, policy_version 288113 (0.0008) [2023-12-27 21:17:46,458][106225] Updated weights for policy 1, policy_version 288123 (0.0009) [2023-12-27 21:17:46,677][106226] Updated weights for policy 0, policy_version 287577 (0.0011) [2023-12-27 21:17:46,740][106226] Updated weights for policy 0, policy_version 287587 (0.0010) [2023-12-27 21:17:46,800][106226] Updated weights for policy 0, policy_version 287597 (0.0010) [2023-12-27 21:17:46,866][106226] Updated weights for policy 0, policy_version 287607 (0.0011) [2023-12-27 21:17:47,108][106225] Updated weights for policy 1, policy_version 288133 (0.0010) [2023-12-27 21:17:47,176][106225] Updated weights for policy 1, policy_version 288143 (0.0010) [2023-12-27 21:17:47,230][106225] Updated weights for policy 1, policy_version 288153 (0.0010) [2023-12-27 21:17:47,492][106226] Updated weights for policy 0, policy_version 287617 (0.0011) [2023-12-27 21:17:47,565][106226] Updated weights for policy 0, policy_version 287627 (0.0011) [2023-12-27 21:17:47,622][106226] Updated weights for policy 0, policy_version 287637 (0.0010) [2023-12-27 21:17:47,859][106225] Updated weights for policy 1, policy_version 288163 (0.0010) [2023-12-27 21:17:47,911][106225] Updated weights for policy 1, policy_version 288173 (0.0009) [2023-12-27 21:17:47,972][106225] Updated weights for policy 1, policy_version 288183 (0.0007) [2023-12-27 21:17:48,334][106226] Updated weights for policy 0, policy_version 287647 (0.0011) [2023-12-27 21:17:48,395][106226] Updated weights for policy 0, policy_version 287657 (0.0011) [2023-12-27 21:17:48,457][106226] Updated weights for policy 0, policy_version 287667 (0.0011) [2023-12-27 21:17:48,707][106225] Updated weights for policy 1, policy_version 288193 (0.0010) [2023-12-27 21:17:48,765][106225] Updated weights for policy 1, policy_version 288203 (0.0006) [2023-12-27 21:17:48,827][106225] Updated weights for policy 1, policy_version 288213 (0.0005) [2023-12-27 21:17:48,888][106225] Updated weights for policy 1, policy_version 288223 (0.0006) [2023-12-27 21:17:49,183][106226] Updated weights for policy 0, policy_version 287677 (0.0009) [2023-12-27 21:17:49,249][106226] Updated weights for policy 0, policy_version 287687 (0.0009) [2023-12-27 21:17:49,307][106226] Updated weights for policy 0, policy_version 287697 (0.0006) [2023-12-27 21:17:49,563][106225] Updated weights for policy 1, policy_version 288233 (0.0010) [2023-12-27 21:17:49,623][106225] Updated weights for policy 1, policy_version 288243 (0.0010) [2023-12-27 21:17:49,683][106225] Updated weights for policy 1, policy_version 288253 (0.0010) [2023-12-27 21:17:50,032][106226] Updated weights for policy 0, policy_version 287707 (0.0009) [2023-12-27 21:17:50,089][106226] Updated weights for policy 0, policy_version 287717 (0.0007) [2023-12-27 21:17:50,145][106226] Updated weights for policy 0, policy_version 287727 (0.0008) [2023-12-27 21:17:50,413][106225] Updated weights for policy 1, policy_version 288263 (0.0010) [2023-12-27 21:17:50,470][106225] Updated weights for policy 1, policy_version 288273 (0.0010) [2023-12-27 21:17:50,528][106225] Updated weights for policy 1, policy_version 288283 (0.0010) [2023-12-27 21:17:50,858][106226] Updated weights for policy 0, policy_version 287737 (0.0008) [2023-12-27 21:17:50,919][106226] Updated weights for policy 0, policy_version 287747 (0.0007) [2023-12-27 21:17:50,980][106226] Updated weights for policy 0, policy_version 287757 (0.0009) [2023-12-27 21:17:51,042][106226] Updated weights for policy 0, policy_version 287767 (0.0008) [2023-12-27 21:17:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 147513344. Throughput: 0: 9730.3, 1: 9911.1. Samples: 147522104. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:51,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-5.808')] [2023-12-27 21:17:51,285][106225] Updated weights for policy 1, policy_version 288293 (0.0009) [2023-12-27 21:17:51,348][106225] Updated weights for policy 1, policy_version 288303 (0.0008) [2023-12-27 21:17:51,422][106225] Updated weights for policy 1, policy_version 288313 (0.0008) [2023-12-27 21:17:51,720][106226] Updated weights for policy 0, policy_version 287777 (0.0007) [2023-12-27 21:17:51,793][106226] Updated weights for policy 0, policy_version 287787 (0.0008) [2023-12-27 21:17:51,848][106226] Updated weights for policy 0, policy_version 287797 (0.0008) [2023-12-27 21:17:52,148][106225] Updated weights for policy 1, policy_version 288323 (0.0008) [2023-12-27 21:17:52,218][106225] Updated weights for policy 1, policy_version 288333 (0.0008) [2023-12-27 21:17:52,279][106225] Updated weights for policy 1, policy_version 288343 (0.0009) [2023-12-27 21:17:52,524][106226] Updated weights for policy 0, policy_version 287807 (0.0007) [2023-12-27 21:17:52,579][106226] Updated weights for policy 0, policy_version 287817 (0.0006) [2023-12-27 21:17:52,638][106226] Updated weights for policy 0, policy_version 287827 (0.0009) [2023-12-27 21:17:52,979][106225] Updated weights for policy 1, policy_version 288353 (0.0009) [2023-12-27 21:17:53,030][106225] Updated weights for policy 1, policy_version 288363 (0.0007) [2023-12-27 21:17:53,089][106225] Updated weights for policy 1, policy_version 288373 (0.0008) [2023-12-27 21:17:53,151][106225] Updated weights for policy 1, policy_version 288383 (0.0008) [2023-12-27 21:17:53,363][106226] Updated weights for policy 0, policy_version 287837 (0.0008) [2023-12-27 21:17:53,411][106226] Updated weights for policy 0, policy_version 287847 (0.0009) [2023-12-27 21:17:53,461][106226] Updated weights for policy 0, policy_version 287857 (0.0008) [2023-12-27 21:17:53,790][106225] Updated weights for policy 1, policy_version 288393 (0.0006) [2023-12-27 21:17:53,839][106225] Updated weights for policy 1, policy_version 288403 (0.0007) [2023-12-27 21:17:53,905][106225] Updated weights for policy 1, policy_version 288413 (0.0005) [2023-12-27 21:17:54,198][106226] Updated weights for policy 0, policy_version 287867 (0.0010) [2023-12-27 21:17:54,253][106226] Updated weights for policy 0, policy_version 287877 (0.0006) [2023-12-27 21:17:54,311][106226] Updated weights for policy 0, policy_version 287887 (0.0005) [2023-12-27 21:17:54,463][106225] Updated weights for policy 1, policy_version 288423 (0.0005) [2023-12-27 21:17:54,512][106225] Updated weights for policy 1, policy_version 288433 (0.0005) [2023-12-27 21:17:54,567][106225] Updated weights for policy 1, policy_version 288443 (0.0007) [2023-12-27 21:17:54,979][106226] Updated weights for policy 0, policy_version 287897 (0.0006) [2023-12-27 21:17:55,043][106226] Updated weights for policy 0, policy_version 287907 (0.0006) [2023-12-27 21:17:55,095][106226] Updated weights for policy 0, policy_version 287917 (0.0005) [2023-12-27 21:17:55,147][106226] Updated weights for policy 0, policy_version 287927 (0.0005) [2023-12-27 21:17:55,284][106225] Updated weights for policy 1, policy_version 288453 (0.0008) [2023-12-27 21:17:55,332][106225] Updated weights for policy 1, policy_version 288463 (0.0008) [2023-12-27 21:17:55,389][106225] Updated weights for policy 1, policy_version 288473 (0.0008) [2023-12-27 21:17:55,815][106226] Updated weights for policy 0, policy_version 287937 (0.0008) [2023-12-27 21:17:55,880][106226] Updated weights for policy 0, policy_version 287947 (0.0009) [2023-12-27 21:17:55,950][106226] Updated weights for policy 0, policy_version 287957 (0.0009) [2023-12-27 21:17:56,048][106225] Updated weights for policy 1, policy_version 288483 (0.0008) [2023-12-27 21:17:56,103][106225] Updated weights for policy 1, policy_version 288493 (0.0008) [2023-12-27 21:17:56,151][106225] Updated weights for policy 1, policy_version 288503 (0.0008) [2023-12-27 21:17:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 147611648. Throughput: 0: 9751.3, 1: 9871.2. Samples: 147581316. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:17:56,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-5.962')] [2023-12-27 21:17:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000287960_73744384.pth... [2023-12-27 21:17:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000286808_73449472.pth [2023-12-27 21:17:56,203][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000288512_73875456.pth... [2023-12-27 21:17:56,207][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000287360_73580544.pth [2023-12-27 21:17:56,625][106226] Updated weights for policy 0, policy_version 287967 (0.0008) [2023-12-27 21:17:56,676][106226] Updated weights for policy 0, policy_version 287977 (0.0008) [2023-12-27 21:17:56,730][106226] Updated weights for policy 0, policy_version 287987 (0.0009) [2023-12-27 21:17:56,758][106225] Updated weights for policy 1, policy_version 288513 (0.0008) [2023-12-27 21:17:56,808][106225] Updated weights for policy 1, policy_version 288523 (0.0008) [2023-12-27 21:17:56,859][106225] Updated weights for policy 1, policy_version 288533 (0.0008) [2023-12-27 21:17:56,910][106225] Updated weights for policy 1, policy_version 288543 (0.0008) [2023-12-27 21:17:57,395][106226] Updated weights for policy 0, policy_version 287997 (0.0007) [2023-12-27 21:17:57,443][106226] Updated weights for policy 0, policy_version 288007 (0.0005) [2023-12-27 21:17:57,491][106226] Updated weights for policy 0, policy_version 288017 (0.0007) [2023-12-27 21:17:57,584][106225] Updated weights for policy 1, policy_version 288553 (0.0009) [2023-12-27 21:17:57,649][106225] Updated weights for policy 1, policy_version 288563 (0.0008) [2023-12-27 21:17:57,706][106225] Updated weights for policy 1, policy_version 288573 (0.0009) [2023-12-27 21:17:58,121][106226] Updated weights for policy 0, policy_version 288027 (0.0008) [2023-12-27 21:17:58,177][106226] Updated weights for policy 0, policy_version 288037 (0.0008) [2023-12-27 21:17:58,248][106226] Updated weights for policy 0, policy_version 288047 (0.0008) [2023-12-27 21:17:58,520][106225] Updated weights for policy 1, policy_version 288583 (0.0008) [2023-12-27 21:17:58,576][106225] Updated weights for policy 1, policy_version 288593 (0.0008) [2023-12-27 21:17:58,642][106225] Updated weights for policy 1, policy_version 288603 (0.0007) [2023-12-27 21:17:59,061][106226] Updated weights for policy 0, policy_version 288057 (0.0007) [2023-12-27 21:17:59,122][106226] Updated weights for policy 0, policy_version 288067 (0.0007) [2023-12-27 21:17:59,173][106226] Updated weights for policy 0, policy_version 288077 (0.0010) [2023-12-27 21:17:59,245][106226] Updated weights for policy 0, policy_version 288087 (0.0008) [2023-12-27 21:17:59,450][106225] Updated weights for policy 1, policy_version 288613 (0.0007) [2023-12-27 21:17:59,503][106225] Updated weights for policy 1, policy_version 288623 (0.0005) [2023-12-27 21:17:59,549][106225] Updated weights for policy 1, policy_version 288633 (0.0005) [2023-12-27 21:17:59,945][106226] Updated weights for policy 0, policy_version 288097 (0.0007) [2023-12-27 21:18:00,015][106226] Updated weights for policy 0, policy_version 288107 (0.0006) [2023-12-27 21:18:00,080][106226] Updated weights for policy 0, policy_version 288117 (0.0005) [2023-12-27 21:18:00,266][106225] Updated weights for policy 1, policy_version 288643 (0.0006) [2023-12-27 21:18:00,326][106225] Updated weights for policy 1, policy_version 288653 (0.0007) [2023-12-27 21:18:00,380][106225] Updated weights for policy 1, policy_version 288663 (0.0008) [2023-12-27 21:18:00,712][106226] Updated weights for policy 0, policy_version 288127 (0.0009) [2023-12-27 21:18:00,768][106226] Updated weights for policy 0, policy_version 288137 (0.0010) [2023-12-27 21:18:00,825][106226] Updated weights for policy 0, policy_version 288147 (0.0010) [2023-12-27 21:18:01,081][106225] Updated weights for policy 1, policy_version 288673 (0.0007) [2023-12-27 21:18:01,147][106225] Updated weights for policy 1, policy_version 288683 (0.0008) [2023-12-27 21:18:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 147709952. Throughput: 0: 9758.3, 1: 9935.7. Samples: 147702312. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:18:01,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-5.869')] [2023-12-27 21:18:01,210][106225] Updated weights for policy 1, policy_version 288693 (0.0008) [2023-12-27 21:18:01,271][106225] Updated weights for policy 1, policy_version 288703 (0.0007) [2023-12-27 21:18:01,589][106226] Updated weights for policy 0, policy_version 288157 (0.0010) [2023-12-27 21:18:01,659][106226] Updated weights for policy 0, policy_version 288167 (0.0010) [2023-12-27 21:18:01,722][106226] Updated weights for policy 0, policy_version 288177 (0.0007) [2023-12-27 21:18:01,973][106225] Updated weights for policy 1, policy_version 288713 (0.0009) [2023-12-27 21:18:02,031][106225] Updated weights for policy 1, policy_version 288723 (0.0008) [2023-12-27 21:18:02,083][106225] Updated weights for policy 1, policy_version 288733 (0.0008) [2023-12-27 21:18:02,462][106226] Updated weights for policy 0, policy_version 288187 (0.0008) [2023-12-27 21:18:02,519][106226] Updated weights for policy 0, policy_version 288197 (0.0009) [2023-12-27 21:18:02,579][106226] Updated weights for policy 0, policy_version 288207 (0.0009) [2023-12-27 21:18:02,819][106225] Updated weights for policy 1, policy_version 288743 (0.0006) [2023-12-27 21:18:02,883][106225] Updated weights for policy 1, policy_version 288753 (0.0005) [2023-12-27 21:18:02,939][106225] Updated weights for policy 1, policy_version 288763 (0.0007) [2023-12-27 21:18:03,345][106226] Updated weights for policy 0, policy_version 288217 (0.0009) [2023-12-27 21:18:03,396][106226] Updated weights for policy 0, policy_version 288227 (0.0009) [2023-12-27 21:18:03,447][106226] Updated weights for policy 0, policy_version 288237 (0.0009) [2023-12-27 21:18:03,506][106226] Updated weights for policy 0, policy_version 288247 (0.0006) [2023-12-27 21:18:03,539][106225] Updated weights for policy 1, policy_version 288773 (0.0008) [2023-12-27 21:18:03,602][106225] Updated weights for policy 1, policy_version 288783 (0.0009) [2023-12-27 21:18:03,659][106225] Updated weights for policy 1, policy_version 288793 (0.0008) [2023-12-27 21:18:04,222][106226] Updated weights for policy 0, policy_version 288257 (0.0008) [2023-12-27 21:18:04,284][106226] Updated weights for policy 0, policy_version 288267 (0.0009) [2023-12-27 21:18:04,322][106225] Updated weights for policy 1, policy_version 288803 (0.0007) [2023-12-27 21:18:04,354][106226] Updated weights for policy 0, policy_version 288277 (0.0009) [2023-12-27 21:18:04,377][106225] Updated weights for policy 1, policy_version 288813 (0.0005) [2023-12-27 21:18:04,437][106225] Updated weights for policy 1, policy_version 288823 (0.0005) [2023-12-27 21:18:05,061][106225] Updated weights for policy 1, policy_version 288833 (0.0006) [2023-12-27 21:18:05,115][106226] Updated weights for policy 0, policy_version 288287 (0.0007) [2023-12-27 21:18:05,122][106225] Updated weights for policy 1, policy_version 288843 (0.0007) [2023-12-27 21:18:05,167][106226] Updated weights for policy 0, policy_version 288297 (0.0007) [2023-12-27 21:18:05,177][106225] Updated weights for policy 1, policy_version 288853 (0.0006) [2023-12-27 21:18:05,224][106226] Updated weights for policy 0, policy_version 288307 (0.0005) [2023-12-27 21:18:05,241][106225] Updated weights for policy 1, policy_version 288863 (0.0007) [2023-12-27 21:18:05,825][106225] Updated weights for policy 1, policy_version 288873 (0.0009) [2023-12-27 21:18:05,865][106226] Updated weights for policy 0, policy_version 288317 (0.0007) [2023-12-27 21:18:05,888][106225] Updated weights for policy 1, policy_version 288883 (0.0008) [2023-12-27 21:18:05,918][106226] Updated weights for policy 0, policy_version 288327 (0.0007) [2023-12-27 21:18:05,941][106225] Updated weights for policy 1, policy_version 288893 (0.0007) [2023-12-27 21:18:05,974][106226] Updated weights for policy 0, policy_version 288337 (0.0009) [2023-12-27 21:18:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 147816448. Throughput: 0: 9815.7, 1: 9963.4. Samples: 147821500. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:18:06,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.646')] [2023-12-27 21:18:06,625][106225] Updated weights for policy 1, policy_version 288903 (0.0007) [2023-12-27 21:18:06,681][106225] Updated weights for policy 1, policy_version 288913 (0.0009) [2023-12-27 21:18:06,745][106225] Updated weights for policy 1, policy_version 288923 (0.0008) [2023-12-27 21:18:06,805][106226] Updated weights for policy 0, policy_version 288347 (0.0009) [2023-12-27 21:18:06,868][106226] Updated weights for policy 0, policy_version 288357 (0.0009) [2023-12-27 21:18:06,937][106226] Updated weights for policy 0, policy_version 288367 (0.0009) [2023-12-27 21:18:07,313][106225] Updated weights for policy 1, policy_version 288933 (0.0008) [2023-12-27 21:18:07,366][106225] Updated weights for policy 1, policy_version 288943 (0.0008) [2023-12-27 21:18:07,417][106225] Updated weights for policy 1, policy_version 288953 (0.0008) [2023-12-27 21:18:07,708][106226] Updated weights for policy 0, policy_version 288377 (0.0009) [2023-12-27 21:18:07,766][106226] Updated weights for policy 0, policy_version 288387 (0.0009) [2023-12-27 21:18:07,816][106226] Updated weights for policy 0, policy_version 288397 (0.0008) [2023-12-27 21:18:07,868][106226] Updated weights for policy 0, policy_version 288407 (0.0008) [2023-12-27 21:18:08,119][106225] Updated weights for policy 1, policy_version 288963 (0.0008) [2023-12-27 21:18:08,180][106225] Updated weights for policy 1, policy_version 288973 (0.0008) [2023-12-27 21:18:08,232][106225] Updated weights for policy 1, policy_version 288983 (0.0008) [2023-12-27 21:18:08,619][106226] Updated weights for policy 0, policy_version 288417 (0.0009) [2023-12-27 21:18:08,680][106226] Updated weights for policy 0, policy_version 288427 (0.0009) [2023-12-27 21:18:08,740][106226] Updated weights for policy 0, policy_version 288437 (0.0008) [2023-12-27 21:18:08,947][106225] Updated weights for policy 1, policy_version 288993 (0.0006) [2023-12-27 21:18:09,001][106225] Updated weights for policy 1, policy_version 289003 (0.0008) [2023-12-27 21:18:09,056][106225] Updated weights for policy 1, policy_version 289013 (0.0008) [2023-12-27 21:18:09,119][106225] Updated weights for policy 1, policy_version 289023 (0.0008) [2023-12-27 21:18:09,482][106226] Updated weights for policy 0, policy_version 288447 (0.0010) [2023-12-27 21:18:09,544][106226] Updated weights for policy 0, policy_version 288457 (0.0011) [2023-12-27 21:18:09,607][106226] Updated weights for policy 0, policy_version 288467 (0.0008) [2023-12-27 21:18:09,960][106225] Updated weights for policy 1, policy_version 289033 (0.0008) [2023-12-27 21:18:10,013][106225] Updated weights for policy 1, policy_version 289043 (0.0008) [2023-12-27 21:18:10,071][106225] Updated weights for policy 1, policy_version 289053 (0.0008) [2023-12-27 21:18:10,335][106226] Updated weights for policy 0, policy_version 288477 (0.0007) [2023-12-27 21:18:10,390][106226] Updated weights for policy 0, policy_version 288487 (0.0009) [2023-12-27 21:18:10,448][106226] Updated weights for policy 0, policy_version 288497 (0.0009) [2023-12-27 21:18:10,811][106225] Updated weights for policy 1, policy_version 289063 (0.0006) [2023-12-27 21:18:10,874][106225] Updated weights for policy 1, policy_version 289073 (0.0006) [2023-12-27 21:18:10,932][106225] Updated weights for policy 1, policy_version 289083 (0.0009) [2023-12-27 21:18:11,138][106226] Updated weights for policy 0, policy_version 288507 (0.0007) [2023-12-27 21:18:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 147906560. Throughput: 0: 9808.4, 1: 10011.6. Samples: 147880056. Policy #0 lag: (min: 15.0, avg: 19.2, max: 47.0) [2023-12-27 21:18:11,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-5.638')] [2023-12-27 21:18:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000289088_74022912.pth... [2023-12-27 21:18:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000287936_73728000.pth [2023-12-27 21:18:11,201][106226] Updated weights for policy 0, policy_version 288517 (0.0006) [2023-12-27 21:18:11,263][106226] Updated weights for policy 0, policy_version 288527 (0.0009) [2023-12-27 21:18:11,326][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000288536_73891840.pth... [2023-12-27 21:18:11,333][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000287384_73596928.pth [2023-12-27 21:18:11,666][106225] Updated weights for policy 1, policy_version 289093 (0.0009) [2023-12-27 21:18:11,733][106225] Updated weights for policy 1, policy_version 289103 (0.0009) [2023-12-27 21:18:11,802][106225] Updated weights for policy 1, policy_version 289113 (0.0008) [2023-12-27 21:18:11,986][106226] Updated weights for policy 0, policy_version 288537 (0.0010) [2023-12-27 21:18:12,044][106226] Updated weights for policy 0, policy_version 288547 (0.0009) [2023-12-27 21:18:12,098][106226] Updated weights for policy 0, policy_version 288557 (0.0008) [2023-12-27 21:18:12,151][106226] Updated weights for policy 0, policy_version 288567 (0.0007) [2023-12-27 21:18:12,571][106225] Updated weights for policy 1, policy_version 289123 (0.0008) [2023-12-27 21:18:12,632][106225] Updated weights for policy 1, policy_version 289133 (0.0011) [2023-12-27 21:18:12,693][106225] Updated weights for policy 1, policy_version 289143 (0.0010) [2023-12-27 21:18:12,933][106226] Updated weights for policy 0, policy_version 288577 (0.0009) [2023-12-27 21:18:12,990][106226] Updated weights for policy 0, policy_version 288587 (0.0009) [2023-12-27 21:18:13,060][106226] Updated weights for policy 0, policy_version 288597 (0.0010) [2023-12-27 21:18:13,291][106225] Updated weights for policy 1, policy_version 289153 (0.0010) [2023-12-27 21:18:13,344][106225] Updated weights for policy 1, policy_version 289163 (0.0010) [2023-12-27 21:18:13,404][106225] Updated weights for policy 1, policy_version 289173 (0.0010) [2023-12-27 21:18:13,449][106225] Updated weights for policy 1, policy_version 289183 (0.0010) [2023-12-27 21:18:13,675][106226] Updated weights for policy 0, policy_version 288607 (0.0008) [2023-12-27 21:18:13,737][106226] Updated weights for policy 0, policy_version 288617 (0.0006) [2023-12-27 21:18:13,796][106226] Updated weights for policy 0, policy_version 288627 (0.0005) [2023-12-27 21:18:14,150][106225] Updated weights for policy 1, policy_version 289193 (0.0008) [2023-12-27 21:18:14,215][106225] Updated weights for policy 1, policy_version 289203 (0.0010) [2023-12-27 21:18:14,284][106225] Updated weights for policy 1, policy_version 289213 (0.0010) [2023-12-27 21:18:14,315][106226] Updated weights for policy 0, policy_version 288637 (0.0007) [2023-12-27 21:18:14,370][106226] Updated weights for policy 0, policy_version 288647 (0.0008) [2023-12-27 21:18:14,425][106226] Updated weights for policy 0, policy_version 288657 (0.0008) [2023-12-27 21:18:14,991][106225] Updated weights for policy 1, policy_version 289223 (0.0009) [2023-12-27 21:18:15,053][106225] Updated weights for policy 1, policy_version 289233 (0.0007) [2023-12-27 21:18:15,119][106225] Updated weights for policy 1, policy_version 289243 (0.0008) [2023-12-27 21:18:15,158][106226] Updated weights for policy 0, policy_version 288667 (0.0011) [2023-12-27 21:18:15,217][106226] Updated weights for policy 0, policy_version 288677 (0.0010) [2023-12-27 21:18:15,272][106226] Updated weights for policy 0, policy_version 288687 (0.0005) [2023-12-27 21:18:15,845][106226] Updated weights for policy 0, policy_version 288697 (0.0006) [2023-12-27 21:18:15,904][106226] Updated weights for policy 0, policy_version 288707 (0.0010) [2023-12-27 21:18:15,928][106225] Updated weights for policy 1, policy_version 289253 (0.0008) [2023-12-27 21:18:15,966][106226] Updated weights for policy 0, policy_version 288717 (0.0007) [2023-12-27 21:18:15,989][106225] Updated weights for policy 1, policy_version 289263 (0.0008) [2023-12-27 21:18:16,026][106226] Updated weights for policy 0, policy_version 288727 (0.0010) [2023-12-27 21:18:16,051][106225] Updated weights for policy 1, policy_version 289273 (0.0006) [2023-12-27 21:18:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 148013056. Throughput: 0: 9901.6, 1: 9834.7. Samples: 147997636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:16,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.924')] [2023-12-27 21:18:16,611][106226] Updated weights for policy 0, policy_version 288737 (0.0009) [2023-12-27 21:18:16,659][106226] Updated weights for policy 0, policy_version 288747 (0.0007) [2023-12-27 21:18:16,715][106226] Updated weights for policy 0, policy_version 288757 (0.0005) [2023-12-27 21:18:16,752][106225] Updated weights for policy 1, policy_version 289283 (0.0008) [2023-12-27 21:18:16,800][106225] Updated weights for policy 1, policy_version 289293 (0.0005) [2023-12-27 21:18:16,859][106225] Updated weights for policy 1, policy_version 289303 (0.0005) [2023-12-27 21:18:17,371][106225] Updated weights for policy 1, policy_version 289313 (0.0005) [2023-12-27 21:18:17,390][106226] Updated weights for policy 0, policy_version 288767 (0.0009) [2023-12-27 21:18:17,432][106225] Updated weights for policy 1, policy_version 289323 (0.0005) [2023-12-27 21:18:17,440][106226] Updated weights for policy 0, policy_version 288777 (0.0011) [2023-12-27 21:18:17,491][106226] Updated weights for policy 0, policy_version 288787 (0.0010) [2023-12-27 21:18:17,493][106225] Updated weights for policy 1, policy_version 289333 (0.0006) [2023-12-27 21:18:17,546][106225] Updated weights for policy 1, policy_version 289343 (0.0007) [2023-12-27 21:18:18,206][106226] Updated weights for policy 0, policy_version 288797 (0.0011) [2023-12-27 21:18:18,262][106225] Updated weights for policy 1, policy_version 289353 (0.0006) [2023-12-27 21:18:18,271][106226] Updated weights for policy 0, policy_version 288807 (0.0011) [2023-12-27 21:18:18,324][106225] Updated weights for policy 1, policy_version 289363 (0.0006) [2023-12-27 21:18:18,342][106226] Updated weights for policy 0, policy_version 288817 (0.0010) [2023-12-27 21:18:18,392][106225] Updated weights for policy 1, policy_version 289373 (0.0008) [2023-12-27 21:18:19,002][106226] Updated weights for policy 0, policy_version 288827 (0.0007) [2023-12-27 21:18:19,063][106226] Updated weights for policy 0, policy_version 288837 (0.0008) [2023-12-27 21:18:19,063][106225] Updated weights for policy 1, policy_version 289383 (0.0009) [2023-12-27 21:18:19,123][106225] Updated weights for policy 1, policy_version 289393 (0.0005) [2023-12-27 21:18:19,125][106226] Updated weights for policy 0, policy_version 288847 (0.0007) [2023-12-27 21:18:19,171][106225] Updated weights for policy 1, policy_version 289403 (0.0006) [2023-12-27 21:18:19,812][106226] Updated weights for policy 0, policy_version 288857 (0.0008) [2023-12-27 21:18:19,857][106225] Updated weights for policy 1, policy_version 289413 (0.0008) [2023-12-27 21:18:19,881][106226] Updated weights for policy 0, policy_version 288867 (0.0009) [2023-12-27 21:18:19,925][106225] Updated weights for policy 1, policy_version 289423 (0.0010) [2023-12-27 21:18:19,947][106226] Updated weights for policy 0, policy_version 288877 (0.0007) [2023-12-27 21:18:19,993][106225] Updated weights for policy 1, policy_version 289433 (0.0008) [2023-12-27 21:18:20,018][106226] Updated weights for policy 0, policy_version 288887 (0.0007) [2023-12-27 21:18:20,627][106226] Updated weights for policy 0, policy_version 288897 (0.0008) [2023-12-27 21:18:20,693][106226] Updated weights for policy 0, policy_version 288907 (0.0008) [2023-12-27 21:18:20,753][106226] Updated weights for policy 0, policy_version 288917 (0.0009) [2023-12-27 21:18:20,763][106225] Updated weights for policy 1, policy_version 289443 (0.0007) [2023-12-27 21:18:20,826][106225] Updated weights for policy 1, policy_version 289453 (0.0007) [2023-12-27 21:18:20,894][106225] Updated weights for policy 1, policy_version 289463 (0.0008) [2023-12-27 21:18:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 148111360. Throughput: 0: 9893.8, 1: 9825.0. Samples: 148118980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:21,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.642')] [2023-12-27 21:18:21,526][106226] Updated weights for policy 0, policy_version 288927 (0.0008) [2023-12-27 21:18:21,582][106226] Updated weights for policy 0, policy_version 288937 (0.0008) [2023-12-27 21:18:21,599][106225] Updated weights for policy 1, policy_version 289473 (0.0008) [2023-12-27 21:18:21,641][106226] Updated weights for policy 0, policy_version 288947 (0.0008) [2023-12-27 21:18:21,665][106225] Updated weights for policy 1, policy_version 289483 (0.0008) [2023-12-27 21:18:21,725][106225] Updated weights for policy 1, policy_version 289493 (0.0007) [2023-12-27 21:18:21,793][106225] Updated weights for policy 1, policy_version 289503 (0.0009) [2023-12-27 21:18:22,374][106226] Updated weights for policy 0, policy_version 288957 (0.0008) [2023-12-27 21:18:22,445][106226] Updated weights for policy 0, policy_version 288967 (0.0009) [2023-12-27 21:18:22,482][106225] Updated weights for policy 1, policy_version 289513 (0.0006) [2023-12-27 21:18:22,514][106226] Updated weights for policy 0, policy_version 288977 (0.0009) [2023-12-27 21:18:22,547][106225] Updated weights for policy 1, policy_version 289523 (0.0006) [2023-12-27 21:18:22,611][106225] Updated weights for policy 1, policy_version 289533 (0.0008) [2023-12-27 21:18:23,190][106226] Updated weights for policy 0, policy_version 288987 (0.0008) [2023-12-27 21:18:23,244][106226] Updated weights for policy 0, policy_version 288997 (0.0009) [2023-12-27 21:18:23,297][106226] Updated weights for policy 0, policy_version 289007 (0.0008) [2023-12-27 21:18:23,338][106225] Updated weights for policy 1, policy_version 289543 (0.0008) [2023-12-27 21:18:23,394][106225] Updated weights for policy 1, policy_version 289553 (0.0010) [2023-12-27 21:18:23,450][106225] Updated weights for policy 1, policy_version 289563 (0.0009) [2023-12-27 21:18:23,902][106226] Updated weights for policy 0, policy_version 289017 (0.0007) [2023-12-27 21:18:23,950][106226] Updated weights for policy 0, policy_version 289027 (0.0006) [2023-12-27 21:18:23,996][106226] Updated weights for policy 0, policy_version 289037 (0.0005) [2023-12-27 21:18:24,052][106226] Updated weights for policy 0, policy_version 289047 (0.0005) [2023-12-27 21:18:24,257][106225] Updated weights for policy 1, policy_version 289573 (0.0010) [2023-12-27 21:18:24,316][106225] Updated weights for policy 1, policy_version 289583 (0.0007) [2023-12-27 21:18:24,370][106225] Updated weights for policy 1, policy_version 289593 (0.0010) [2023-12-27 21:18:24,598][106226] Updated weights for policy 0, policy_version 289057 (0.0010) [2023-12-27 21:18:24,652][106226] Updated weights for policy 0, policy_version 289067 (0.0011) [2023-12-27 21:18:24,703][106226] Updated weights for policy 0, policy_version 289077 (0.0010) [2023-12-27 21:18:25,049][106225] Updated weights for policy 1, policy_version 289603 (0.0008) [2023-12-27 21:18:25,109][106225] Updated weights for policy 1, policy_version 289613 (0.0010) [2023-12-27 21:18:25,168][106225] Updated weights for policy 1, policy_version 289623 (0.0010) [2023-12-27 21:18:25,253][106226] Updated weights for policy 0, policy_version 289087 (0.0010) [2023-12-27 21:18:25,312][106226] Updated weights for policy 0, policy_version 289097 (0.0007) [2023-12-27 21:18:25,365][106226] Updated weights for policy 0, policy_version 289107 (0.0005) [2023-12-27 21:18:25,879][106225] Updated weights for policy 1, policy_version 289633 (0.0010) [2023-12-27 21:18:25,923][106226] Updated weights for policy 0, policy_version 289117 (0.0008) [2023-12-27 21:18:25,929][106225] Updated weights for policy 1, policy_version 289643 (0.0010) [2023-12-27 21:18:25,966][106226] Updated weights for policy 0, policy_version 289127 (0.0010) [2023-12-27 21:18:25,982][106225] Updated weights for policy 1, policy_version 289653 (0.0010) [2023-12-27 21:18:26,016][106226] Updated weights for policy 0, policy_version 289137 (0.0010) [2023-12-27 21:18:26,035][106225] Updated weights for policy 1, policy_version 289663 (0.0010) [2023-12-27 21:18:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 148217856. Throughput: 0: 9889.6, 1: 9824.2. Samples: 148177236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:26,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-5.817')] [2023-12-27 21:18:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000289144_74047488.pth... [2023-12-27 21:18:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000289664_74170368.pth... [2023-12-27 21:18:26,182][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000287960_73744384.pth [2023-12-27 21:18:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000288512_73875456.pth [2023-12-27 21:18:26,625][106226] Updated weights for policy 0, policy_version 289147 (0.0007) [2023-12-27 21:18:26,684][106226] Updated weights for policy 0, policy_version 289157 (0.0010) [2023-12-27 21:18:26,743][106226] Updated weights for policy 0, policy_version 289167 (0.0009) [2023-12-27 21:18:26,810][106225] Updated weights for policy 1, policy_version 289673 (0.0006) [2023-12-27 21:18:26,865][106225] Updated weights for policy 1, policy_version 289683 (0.0009) [2023-12-27 21:18:26,919][106225] Updated weights for policy 1, policy_version 289693 (0.0008) [2023-12-27 21:18:27,423][106226] Updated weights for policy 0, policy_version 289177 (0.0007) [2023-12-27 21:18:27,490][106226] Updated weights for policy 0, policy_version 289187 (0.0010) [2023-12-27 21:18:27,553][106226] Updated weights for policy 0, policy_version 289197 (0.0010) [2023-12-27 21:18:27,609][106225] Updated weights for policy 1, policy_version 289703 (0.0006) [2023-12-27 21:18:27,610][106226] Updated weights for policy 0, policy_version 289207 (0.0010) [2023-12-27 21:18:27,659][106225] Updated weights for policy 1, policy_version 289713 (0.0007) [2023-12-27 21:18:27,709][106225] Updated weights for policy 1, policy_version 289723 (0.0008) [2023-12-27 21:18:28,302][106226] Updated weights for policy 0, policy_version 289217 (0.0006) [2023-12-27 21:18:28,346][106225] Updated weights for policy 1, policy_version 289733 (0.0008) [2023-12-27 21:18:28,370][106226] Updated weights for policy 0, policy_version 289227 (0.0008) [2023-12-27 21:18:28,408][106225] Updated weights for policy 1, policy_version 289743 (0.0008) [2023-12-27 21:18:28,437][106226] Updated weights for policy 0, policy_version 289237 (0.0005) [2023-12-27 21:18:28,465][106225] Updated weights for policy 1, policy_version 289753 (0.0008) [2023-12-27 21:18:28,962][106226] Updated weights for policy 0, policy_version 289247 (0.0006) [2023-12-27 21:18:29,018][106226] Updated weights for policy 0, policy_version 289257 (0.0005) [2023-12-27 21:18:29,074][106226] Updated weights for policy 0, policy_version 289267 (0.0005) [2023-12-27 21:18:29,303][106225] Updated weights for policy 1, policy_version 289763 (0.0010) [2023-12-27 21:18:29,382][106225] Updated weights for policy 1, policy_version 289773 (0.0009) [2023-12-27 21:18:29,450][106225] Updated weights for policy 1, policy_version 289783 (0.0006) [2023-12-27 21:18:29,707][106226] Updated weights for policy 0, policy_version 289277 (0.0005) [2023-12-27 21:18:29,768][106226] Updated weights for policy 0, policy_version 289287 (0.0005) [2023-12-27 21:18:29,833][106226] Updated weights for policy 0, policy_version 289297 (0.0006) [2023-12-27 21:18:30,080][106225] Updated weights for policy 1, policy_version 289793 (0.0007) [2023-12-27 21:18:30,130][106225] Updated weights for policy 1, policy_version 289803 (0.0010) [2023-12-27 21:18:30,177][106225] Updated weights for policy 1, policy_version 289813 (0.0010) [2023-12-27 21:18:30,232][106225] Updated weights for policy 1, policy_version 289823 (0.0007) [2023-12-27 21:18:30,407][106226] Updated weights for policy 0, policy_version 289307 (0.0008) [2023-12-27 21:18:30,475][106226] Updated weights for policy 0, policy_version 289317 (0.0007) [2023-12-27 21:18:30,536][106226] Updated weights for policy 0, policy_version 289327 (0.0009) [2023-12-27 21:18:30,805][106225] Updated weights for policy 1, policy_version 289833 (0.0005) [2023-12-27 21:18:30,863][106225] Updated weights for policy 1, policy_version 289843 (0.0005) [2023-12-27 21:18:30,918][106225] Updated weights for policy 1, policy_version 289853 (0.0005) [2023-12-27 21:18:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 148316160. Throughput: 0: 10098.1, 1: 9894.1. Samples: 148303796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:31,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-5.879')] [2023-12-27 21:18:31,249][106226] Updated weights for policy 0, policy_version 289337 (0.0009) [2023-12-27 21:18:31,311][106226] Updated weights for policy 0, policy_version 289347 (0.0008) [2023-12-27 21:18:31,378][106226] Updated weights for policy 0, policy_version 289357 (0.0009) [2023-12-27 21:18:31,442][106226] Updated weights for policy 0, policy_version 289367 (0.0008) [2023-12-27 21:18:31,560][106225] Updated weights for policy 1, policy_version 289863 (0.0007) [2023-12-27 21:18:31,625][106225] Updated weights for policy 1, policy_version 289873 (0.0008) [2023-12-27 21:18:31,682][106225] Updated weights for policy 1, policy_version 289883 (0.0008) [2023-12-27 21:18:32,199][106226] Updated weights for policy 0, policy_version 289377 (0.0009) [2023-12-27 21:18:32,257][106226] Updated weights for policy 0, policy_version 289387 (0.0007) [2023-12-27 21:18:32,313][106226] Updated weights for policy 0, policy_version 289397 (0.0008) [2023-12-27 21:18:32,346][106225] Updated weights for policy 1, policy_version 289893 (0.0008) [2023-12-27 21:18:32,409][106225] Updated weights for policy 1, policy_version 289903 (0.0009) [2023-12-27 21:18:32,468][106225] Updated weights for policy 1, policy_version 289913 (0.0010) [2023-12-27 21:18:33,056][106226] Updated weights for policy 0, policy_version 289407 (0.0008) [2023-12-27 21:18:33,115][106226] Updated weights for policy 0, policy_version 289417 (0.0008) [2023-12-27 21:18:33,174][106226] Updated weights for policy 0, policy_version 289427 (0.0008) [2023-12-27 21:18:33,203][106225] Updated weights for policy 1, policy_version 289923 (0.0008) [2023-12-27 21:18:33,261][106225] Updated weights for policy 1, policy_version 289933 (0.0005) [2023-12-27 21:18:33,307][106225] Updated weights for policy 1, policy_version 289943 (0.0005) [2023-12-27 21:18:33,831][106225] Updated weights for policy 1, policy_version 289953 (0.0008) [2023-12-27 21:18:33,883][106225] Updated weights for policy 1, policy_version 289963 (0.0005) [2023-12-27 21:18:33,906][106226] Updated weights for policy 0, policy_version 289437 (0.0009) [2023-12-27 21:18:33,934][106225] Updated weights for policy 1, policy_version 289973 (0.0005) [2023-12-27 21:18:33,972][106226] Updated weights for policy 0, policy_version 289447 (0.0011) [2023-12-27 21:18:33,986][106225] Updated weights for policy 1, policy_version 289983 (0.0005) [2023-12-27 21:18:34,025][106226] Updated weights for policy 0, policy_version 289457 (0.0010) [2023-12-27 21:18:34,658][106226] Updated weights for policy 0, policy_version 289467 (0.0011) [2023-12-27 21:18:34,709][106226] Updated weights for policy 0, policy_version 289477 (0.0011) [2023-12-27 21:18:34,724][106225] Updated weights for policy 1, policy_version 289993 (0.0008) [2023-12-27 21:18:34,764][106226] Updated weights for policy 0, policy_version 289487 (0.0010) [2023-12-27 21:18:34,778][106225] Updated weights for policy 1, policy_version 290003 (0.0006) [2023-12-27 21:18:34,827][106225] Updated weights for policy 1, policy_version 290013 (0.0008) [2023-12-27 21:18:35,426][106226] Updated weights for policy 0, policy_version 289497 (0.0010) [2023-12-27 21:18:35,463][106225] Updated weights for policy 1, policy_version 290023 (0.0005) [2023-12-27 21:18:35,495][106226] Updated weights for policy 0, policy_version 289507 (0.0006) [2023-12-27 21:18:35,516][106225] Updated weights for policy 1, policy_version 290033 (0.0005) [2023-12-27 21:18:35,560][106226] Updated weights for policy 0, policy_version 289517 (0.0009) [2023-12-27 21:18:35,573][106225] Updated weights for policy 1, policy_version 290043 (0.0006) [2023-12-27 21:18:35,617][106226] Updated weights for policy 0, policy_version 289527 (0.0010) [2023-12-27 21:18:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 148414464. Throughput: 0: 10127.7, 1: 9994.3. Samples: 148427596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:36,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.660')] [2023-12-27 21:18:36,212][106225] Updated weights for policy 1, policy_version 290053 (0.0009) [2023-12-27 21:18:36,275][106226] Updated weights for policy 0, policy_version 289537 (0.0007) [2023-12-27 21:18:36,275][106225] Updated weights for policy 1, policy_version 290063 (0.0009) [2023-12-27 21:18:36,338][106226] Updated weights for policy 0, policy_version 289547 (0.0008) [2023-12-27 21:18:36,340][106225] Updated weights for policy 1, policy_version 290073 (0.0008) [2023-12-27 21:18:36,387][106226] Updated weights for policy 0, policy_version 289557 (0.0006) [2023-12-27 21:18:37,027][106226] Updated weights for policy 0, policy_version 289567 (0.0008) [2023-12-27 21:18:37,046][106225] Updated weights for policy 1, policy_version 290083 (0.0009) [2023-12-27 21:18:37,073][106226] Updated weights for policy 0, policy_version 289577 (0.0007) [2023-12-27 21:18:37,098][106225] Updated weights for policy 1, policy_version 290093 (0.0008) [2023-12-27 21:18:37,134][106226] Updated weights for policy 0, policy_version 289587 (0.0006) [2023-12-27 21:18:37,155][106225] Updated weights for policy 1, policy_version 290103 (0.0010) [2023-12-27 21:18:37,731][106225] Updated weights for policy 1, policy_version 290113 (0.0006) [2023-12-27 21:18:37,782][106225] Updated weights for policy 1, policy_version 290123 (0.0010) [2023-12-27 21:18:37,839][106225] Updated weights for policy 1, policy_version 290133 (0.0010) [2023-12-27 21:18:37,879][106226] Updated weights for policy 0, policy_version 289597 (0.0006) [2023-12-27 21:18:37,901][106225] Updated weights for policy 1, policy_version 290143 (0.0008) [2023-12-27 21:18:37,936][106226] Updated weights for policy 0, policy_version 289607 (0.0008) [2023-12-27 21:18:37,998][106226] Updated weights for policy 0, policy_version 289617 (0.0010) [2023-12-27 21:18:38,633][106225] Updated weights for policy 1, policy_version 290153 (0.0007) [2023-12-27 21:18:38,694][106225] Updated weights for policy 1, policy_version 290163 (0.0008) [2023-12-27 21:18:38,715][106226] Updated weights for policy 0, policy_version 289627 (0.0010) [2023-12-27 21:18:38,752][106225] Updated weights for policy 1, policy_version 290173 (0.0006) [2023-12-27 21:18:38,773][106226] Updated weights for policy 0, policy_version 289637 (0.0010) [2023-12-27 21:18:38,835][106226] Updated weights for policy 0, policy_version 289647 (0.0010) [2023-12-27 21:18:39,562][106225] Updated weights for policy 1, policy_version 290183 (0.0008) [2023-12-27 21:18:39,581][106226] Updated weights for policy 0, policy_version 289657 (0.0008) [2023-12-27 21:18:39,622][106225] Updated weights for policy 1, policy_version 290193 (0.0008) [2023-12-27 21:18:39,639][106226] Updated weights for policy 0, policy_version 289667 (0.0009) [2023-12-27 21:18:39,682][106225] Updated weights for policy 1, policy_version 290203 (0.0008) [2023-12-27 21:18:39,701][106226] Updated weights for policy 0, policy_version 289677 (0.0006) [2023-12-27 21:18:39,769][106226] Updated weights for policy 0, policy_version 289687 (0.0006) [2023-12-27 21:18:40,458][106226] Updated weights for policy 0, policy_version 289697 (0.0010) [2023-12-27 21:18:40,464][106225] Updated weights for policy 1, policy_version 290213 (0.0007) [2023-12-27 21:18:40,513][106226] Updated weights for policy 0, policy_version 289707 (0.0011) [2023-12-27 21:18:40,547][106225] Updated weights for policy 1, policy_version 290223 (0.0006) [2023-12-27 21:18:40,564][106226] Updated weights for policy 0, policy_version 289717 (0.0010) [2023-12-27 21:18:40,599][106225] Updated weights for policy 1, policy_version 290233 (0.0008) [2023-12-27 21:18:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 148512768. Throughput: 0: 10113.8, 1: 10028.0. Samples: 148487696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:41,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-5.678')] [2023-12-27 21:18:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000290240_74317824.pth... [2023-12-27 21:18:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000289720_74194944.pth... [2023-12-27 21:18:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000288536_73891840.pth [2023-12-27 21:18:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000289088_74022912.pth [2023-12-27 21:18:41,304][106225] Updated weights for policy 1, policy_version 290243 (0.0010) [2023-12-27 21:18:41,326][106226] Updated weights for policy 0, policy_version 289727 (0.0011) [2023-12-27 21:18:41,367][106225] Updated weights for policy 1, policy_version 290253 (0.0010) [2023-12-27 21:18:41,396][106226] Updated weights for policy 0, policy_version 289737 (0.0010) [2023-12-27 21:18:41,426][106225] Updated weights for policy 1, policy_version 290263 (0.0008) [2023-12-27 21:18:41,460][106226] Updated weights for policy 0, policy_version 289747 (0.0008) [2023-12-27 21:18:42,207][106225] Updated weights for policy 1, policy_version 290273 (0.0007) [2023-12-27 21:18:42,233][106226] Updated weights for policy 0, policy_version 289757 (0.0009) [2023-12-27 21:18:42,269][106225] Updated weights for policy 1, policy_version 290283 (0.0010) [2023-12-27 21:18:42,301][106226] Updated weights for policy 0, policy_version 289767 (0.0009) [2023-12-27 21:18:42,333][106225] Updated weights for policy 1, policy_version 290293 (0.0010) [2023-12-27 21:18:42,371][106226] Updated weights for policy 0, policy_version 289777 (0.0009) [2023-12-27 21:18:42,403][106225] Updated weights for policy 1, policy_version 290303 (0.0007) [2023-12-27 21:18:43,047][106225] Updated weights for policy 1, policy_version 290313 (0.0007) [2023-12-27 21:18:43,081][106226] Updated weights for policy 0, policy_version 289787 (0.0009) [2023-12-27 21:18:43,101][106225] Updated weights for policy 1, policy_version 290323 (0.0009) [2023-12-27 21:18:43,133][106226] Updated weights for policy 0, policy_version 289797 (0.0006) [2023-12-27 21:18:43,163][106225] Updated weights for policy 1, policy_version 290333 (0.0008) [2023-12-27 21:18:43,185][106226] Updated weights for policy 0, policy_version 289807 (0.0008) [2023-12-27 21:18:43,793][106225] Updated weights for policy 1, policy_version 290343 (0.0006) [2023-12-27 21:18:43,845][106225] Updated weights for policy 1, policy_version 290353 (0.0009) [2023-12-27 21:18:43,861][106226] Updated weights for policy 0, policy_version 289817 (0.0007) [2023-12-27 21:18:43,899][106225] Updated weights for policy 1, policy_version 290363 (0.0008) [2023-12-27 21:18:43,907][106226] Updated weights for policy 0, policy_version 289827 (0.0010) [2023-12-27 21:18:43,953][106226] Updated weights for policy 0, policy_version 289837 (0.0010) [2023-12-27 21:18:44,006][106226] Updated weights for policy 0, policy_version 289847 (0.0010) [2023-12-27 21:18:44,629][106225] Updated weights for policy 1, policy_version 290373 (0.0009) [2023-12-27 21:18:44,657][106226] Updated weights for policy 0, policy_version 289857 (0.0010) [2023-12-27 21:18:44,687][106225] Updated weights for policy 1, policy_version 290384 (0.0009) [2023-12-27 21:18:44,710][106226] Updated weights for policy 0, policy_version 289867 (0.0010) [2023-12-27 21:18:44,746][106225] Updated weights for policy 1, policy_version 290394 (0.0010) [2023-12-27 21:18:44,761][106226] Updated weights for policy 0, policy_version 289877 (0.0010) [2023-12-27 21:18:45,480][106225] Updated weights for policy 1, policy_version 290404 (0.0007) [2023-12-27 21:18:45,503][106226] Updated weights for policy 0, policy_version 289887 (0.0010) [2023-12-27 21:18:45,540][106225] Updated weights for policy 1, policy_version 290414 (0.0006) [2023-12-27 21:18:45,566][106226] Updated weights for policy 0, policy_version 289897 (0.0010) [2023-12-27 21:18:45,594][106225] Updated weights for policy 1, policy_version 290424 (0.0006) [2023-12-27 21:18:45,623][106226] Updated weights for policy 0, policy_version 289907 (0.0010) [2023-12-27 21:18:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 148611072. Throughput: 0: 10082.0, 1: 9953.0. Samples: 148603888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:46,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-5.903')] [2023-12-27 21:18:46,177][106225] Updated weights for policy 1, policy_version 290434 (0.0006) [2023-12-27 21:18:46,237][106225] Updated weights for policy 1, policy_version 290444 (0.0010) [2023-12-27 21:18:46,254][106226] Updated weights for policy 0, policy_version 289917 (0.0009) [2023-12-27 21:18:46,284][106225] Updated weights for policy 1, policy_version 290454 (0.0010) [2023-12-27 21:18:46,315][106226] Updated weights for policy 0, policy_version 289927 (0.0010) [2023-12-27 21:18:46,336][106225] Updated weights for policy 1, policy_version 290464 (0.0010) [2023-12-27 21:18:46,376][106226] Updated weights for policy 0, policy_version 289937 (0.0007) [2023-12-27 21:18:47,044][106226] Updated weights for policy 0, policy_version 289947 (0.0008) [2023-12-27 21:18:47,089][106225] Updated weights for policy 1, policy_version 290474 (0.0010) [2023-12-27 21:18:47,104][106226] Updated weights for policy 0, policy_version 289957 (0.0011) [2023-12-27 21:18:47,148][106225] Updated weights for policy 1, policy_version 290484 (0.0010) [2023-12-27 21:18:47,167][106226] Updated weights for policy 0, policy_version 289967 (0.0011) [2023-12-27 21:18:47,211][106225] Updated weights for policy 1, policy_version 290494 (0.0010) [2023-12-27 21:18:47,804][106226] Updated weights for policy 0, policy_version 289977 (0.0010) [2023-12-27 21:18:47,866][106226] Updated weights for policy 0, policy_version 289987 (0.0006) [2023-12-27 21:18:47,899][106225] Updated weights for policy 1, policy_version 290504 (0.0010) [2023-12-27 21:18:47,924][106226] Updated weights for policy 0, policy_version 289997 (0.0005) [2023-12-27 21:18:47,955][106225] Updated weights for policy 1, policy_version 290514 (0.0009) [2023-12-27 21:18:47,973][106226] Updated weights for policy 0, policy_version 290007 (0.0005) [2023-12-27 21:18:48,013][106225] Updated weights for policy 1, policy_version 290524 (0.0009) [2023-12-27 21:18:48,525][106226] Updated weights for policy 0, policy_version 290017 (0.0007) [2023-12-27 21:18:48,583][106226] Updated weights for policy 0, policy_version 290027 (0.0009) [2023-12-27 21:18:48,651][106226] Updated weights for policy 0, policy_version 290037 (0.0007) [2023-12-27 21:18:48,753][106225] Updated weights for policy 1, policy_version 290534 (0.0007) [2023-12-27 21:18:48,803][106225] Updated weights for policy 1, policy_version 290544 (0.0010) [2023-12-27 21:18:48,853][106225] Updated weights for policy 1, policy_version 290554 (0.0007) [2023-12-27 21:18:49,348][106226] Updated weights for policy 0, policy_version 290047 (0.0007) [2023-12-27 21:18:49,418][106226] Updated weights for policy 0, policy_version 290057 (0.0008) [2023-12-27 21:18:49,487][106226] Updated weights for policy 0, policy_version 290067 (0.0008) [2023-12-27 21:18:49,557][106225] Updated weights for policy 1, policy_version 290564 (0.0005) [2023-12-27 21:18:49,624][106225] Updated weights for policy 1, policy_version 290574 (0.0006) [2023-12-27 21:18:49,689][106225] Updated weights for policy 1, policy_version 290584 (0.0010) [2023-12-27 21:18:50,247][106226] Updated weights for policy 0, policy_version 290077 (0.0010) [2023-12-27 21:18:50,307][106226] Updated weights for policy 0, policy_version 290087 (0.0011) [2023-12-27 21:18:50,365][106226] Updated weights for policy 0, policy_version 290097 (0.0011) [2023-12-27 21:18:50,425][106225] Updated weights for policy 1, policy_version 290594 (0.0011) [2023-12-27 21:18:50,473][106225] Updated weights for policy 1, policy_version 290604 (0.0010) [2023-12-27 21:18:50,523][106225] Updated weights for policy 1, policy_version 290614 (0.0010) [2023-12-27 21:18:50,580][106225] Updated weights for policy 1, policy_version 290624 (0.0009) [2023-12-27 21:18:51,097][106226] Updated weights for policy 0, policy_version 290107 (0.0010) [2023-12-27 21:18:51,170][106226] Updated weights for policy 0, policy_version 290118 (0.0009) [2023-12-27 21:18:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 148709376. Throughput: 0: 10145.4, 1: 9897.1. Samples: 148723412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:51,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.856')] [2023-12-27 21:18:51,238][106226] Updated weights for policy 0, policy_version 290128 (0.0008) [2023-12-27 21:18:51,268][106225] Updated weights for policy 1, policy_version 290634 (0.0010) [2023-12-27 21:18:51,335][106225] Updated weights for policy 1, policy_version 290644 (0.0010) [2023-12-27 21:18:51,400][106225] Updated weights for policy 1, policy_version 290654 (0.0009) [2023-12-27 21:18:52,002][106226] Updated weights for policy 0, policy_version 290138 (0.0007) [2023-12-27 21:18:52,062][106226] Updated weights for policy 0, policy_version 290148 (0.0007) [2023-12-27 21:18:52,122][106226] Updated weights for policy 0, policy_version 290158 (0.0006) [2023-12-27 21:18:52,128][106225] Updated weights for policy 1, policy_version 290664 (0.0008) [2023-12-27 21:18:52,174][106226] Updated weights for policy 0, policy_version 290168 (0.0006) [2023-12-27 21:18:52,180][106225] Updated weights for policy 1, policy_version 290674 (0.0006) [2023-12-27 21:18:52,231][106225] Updated weights for policy 1, policy_version 290684 (0.0008) [2023-12-27 21:18:52,852][106226] Updated weights for policy 0, policy_version 290178 (0.0009) [2023-12-27 21:18:52,916][106226] Updated weights for policy 0, policy_version 290188 (0.0009) [2023-12-27 21:18:52,952][106225] Updated weights for policy 1, policy_version 290694 (0.0009) [2023-12-27 21:18:52,970][106226] Updated weights for policy 0, policy_version 290198 (0.0006) [2023-12-27 21:18:53,014][106225] Updated weights for policy 1, policy_version 290704 (0.0008) [2023-12-27 21:18:53,074][106225] Updated weights for policy 1, policy_version 290714 (0.0009) [2023-12-27 21:18:53,598][106226] Updated weights for policy 0, policy_version 290208 (0.0005) [2023-12-27 21:18:53,649][106226] Updated weights for policy 0, policy_version 290218 (0.0005) [2023-12-27 21:18:53,699][106226] Updated weights for policy 0, policy_version 290228 (0.0007) [2023-12-27 21:18:53,831][106225] Updated weights for policy 1, policy_version 290724 (0.0008) [2023-12-27 21:18:53,892][106225] Updated weights for policy 1, policy_version 290734 (0.0007) [2023-12-27 21:18:53,949][106225] Updated weights for policy 1, policy_version 290744 (0.0008) [2023-12-27 21:18:54,377][106226] Updated weights for policy 0, policy_version 290238 (0.0011) [2023-12-27 21:18:54,437][106226] Updated weights for policy 0, policy_version 290248 (0.0010) [2023-12-27 21:18:54,487][106226] Updated weights for policy 0, policy_version 290258 (0.0010) [2023-12-27 21:18:54,625][106225] Updated weights for policy 1, policy_version 290754 (0.0008) [2023-12-27 21:18:54,683][106225] Updated weights for policy 1, policy_version 290764 (0.0008) [2023-12-27 21:18:54,735][106225] Updated weights for policy 1, policy_version 290774 (0.0006) [2023-12-27 21:18:54,793][106225] Updated weights for policy 1, policy_version 290784 (0.0006) [2023-12-27 21:18:55,195][106226] Updated weights for policy 0, policy_version 290268 (0.0010) [2023-12-27 21:18:55,251][106226] Updated weights for policy 0, policy_version 290278 (0.0010) [2023-12-27 21:18:55,297][106226] Updated weights for policy 0, policy_version 290288 (0.0010) [2023-12-27 21:18:55,499][106225] Updated weights for policy 1, policy_version 290794 (0.0008) [2023-12-27 21:18:55,556][106225] Updated weights for policy 1, policy_version 290804 (0.0007) [2023-12-27 21:18:55,616][106225] Updated weights for policy 1, policy_version 290814 (0.0008) [2023-12-27 21:18:55,993][106226] Updated weights for policy 0, policy_version 290298 (0.0009) [2023-12-27 21:18:56,064][106226] Updated weights for policy 0, policy_version 290308 (0.0005) [2023-12-27 21:18:56,127][106226] Updated weights for policy 0, policy_version 290318 (0.0005) [2023-12-27 21:18:56,173][106226] Updated weights for policy 0, policy_version 290328 (0.0005) [2023-12-27 21:18:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 148815872. Throughput: 0: 10213.1, 1: 9848.5. Samples: 148782832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:18:56,176][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.784')] [2023-12-27 21:18:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000290328_74350592.pth... [2023-12-27 21:18:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000290816_74465280.pth... [2023-12-27 21:18:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000289144_74047488.pth [2023-12-27 21:18:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000289664_74170368.pth [2023-12-27 21:18:56,242][106225] Updated weights for policy 1, policy_version 290824 (0.0006) [2023-12-27 21:18:56,294][106225] Updated weights for policy 1, policy_version 290834 (0.0005) [2023-12-27 21:18:56,344][106225] Updated weights for policy 1, policy_version 290844 (0.0006) [2023-12-27 21:18:56,714][106226] Updated weights for policy 0, policy_version 290338 (0.0010) [2023-12-27 21:18:56,764][106226] Updated weights for policy 0, policy_version 290348 (0.0008) [2023-12-27 21:18:56,808][106226] Updated weights for policy 0, policy_version 290358 (0.0005) [2023-12-27 21:18:56,881][106225] Updated weights for policy 1, policy_version 290854 (0.0007) [2023-12-27 21:18:56,942][106225] Updated weights for policy 1, policy_version 290864 (0.0008) [2023-12-27 21:18:56,999][106225] Updated weights for policy 1, policy_version 290874 (0.0009) [2023-12-27 21:18:57,386][106226] Updated weights for policy 0, policy_version 290368 (0.0006) [2023-12-27 21:18:57,459][106226] Updated weights for policy 0, policy_version 290378 (0.0008) [2023-12-27 21:18:57,518][106226] Updated weights for policy 0, policy_version 290388 (0.0006) [2023-12-27 21:18:57,816][106225] Updated weights for policy 1, policy_version 290884 (0.0009) [2023-12-27 21:18:57,869][106225] Updated weights for policy 1, policy_version 290894 (0.0007) [2023-12-27 21:18:57,919][106225] Updated weights for policy 1, policy_version 290904 (0.0008) [2023-12-27 21:18:58,113][106226] Updated weights for policy 0, policy_version 290398 (0.0009) [2023-12-27 21:18:58,163][106226] Updated weights for policy 0, policy_version 290408 (0.0010) [2023-12-27 21:18:58,217][106226] Updated weights for policy 0, policy_version 290418 (0.0009) [2023-12-27 21:18:58,730][106225] Updated weights for policy 1, policy_version 290914 (0.0008) [2023-12-27 21:18:58,796][106225] Updated weights for policy 1, policy_version 290924 (0.0007) [2023-12-27 21:18:58,865][106225] Updated weights for policy 1, policy_version 290934 (0.0008) [2023-12-27 21:18:58,920][106225] Updated weights for policy 1, policy_version 290944 (0.0008) [2023-12-27 21:18:59,029][106226] Updated weights for policy 0, policy_version 290428 (0.0008) [2023-12-27 21:18:59,089][106226] Updated weights for policy 0, policy_version 290438 (0.0007) [2023-12-27 21:18:59,155][106226] Updated weights for policy 0, policy_version 290448 (0.0006) [2023-12-27 21:18:59,709][106225] Updated weights for policy 1, policy_version 290954 (0.0006) [2023-12-27 21:18:59,761][106225] Updated weights for policy 1, policy_version 290964 (0.0006) [2023-12-27 21:18:59,817][106226] Updated weights for policy 0, policy_version 290458 (0.0006) [2023-12-27 21:18:59,822][106225] Updated weights for policy 1, policy_version 290974 (0.0006) [2023-12-27 21:18:59,883][106226] Updated weights for policy 0, policy_version 290468 (0.0008) [2023-12-27 21:18:59,957][106226] Updated weights for policy 0, policy_version 290478 (0.0009) [2023-12-27 21:19:00,015][106226] Updated weights for policy 0, policy_version 290488 (0.0007) [2023-12-27 21:19:00,463][106225] Updated weights for policy 1, policy_version 290984 (0.0006) [2023-12-27 21:19:00,524][106225] Updated weights for policy 1, policy_version 290994 (0.0005) [2023-12-27 21:19:00,578][106225] Updated weights for policy 1, policy_version 291004 (0.0009) [2023-12-27 21:19:00,741][106226] Updated weights for policy 0, policy_version 290498 (0.0008) [2023-12-27 21:19:00,810][106226] Updated weights for policy 0, policy_version 290508 (0.0008) [2023-12-27 21:19:00,874][106226] Updated weights for policy 0, policy_version 290518 (0.0010) [2023-12-27 21:19:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 148914176. Throughput: 0: 10257.7, 1: 9872.9. Samples: 148903512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:01,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.659')] [2023-12-27 21:19:01,213][106225] Updated weights for policy 1, policy_version 291014 (0.0008) [2023-12-27 21:19:01,280][106225] Updated weights for policy 1, policy_version 291024 (0.0009) [2023-12-27 21:19:01,344][106225] Updated weights for policy 1, policy_version 291034 (0.0007) [2023-12-27 21:19:01,627][106226] Updated weights for policy 0, policy_version 290528 (0.0009) [2023-12-27 21:19:01,677][106226] Updated weights for policy 0, policy_version 290538 (0.0009) [2023-12-27 21:19:01,735][106226] Updated weights for policy 0, policy_version 290548 (0.0011) [2023-12-27 21:19:02,007][106225] Updated weights for policy 1, policy_version 291044 (0.0007) [2023-12-27 21:19:02,053][106225] Updated weights for policy 1, policy_version 291054 (0.0009) [2023-12-27 21:19:02,098][106225] Updated weights for policy 1, policy_version 291064 (0.0008) [2023-12-27 21:19:02,476][106226] Updated weights for policy 0, policy_version 290558 (0.0009) [2023-12-27 21:19:02,542][106226] Updated weights for policy 0, policy_version 290568 (0.0008) [2023-12-27 21:19:02,606][106226] Updated weights for policy 0, policy_version 290578 (0.0008) [2023-12-27 21:19:02,837][106225] Updated weights for policy 1, policy_version 291074 (0.0008) [2023-12-27 21:19:02,903][106225] Updated weights for policy 1, policy_version 291084 (0.0010) [2023-12-27 21:19:02,963][106225] Updated weights for policy 1, policy_version 291094 (0.0008) [2023-12-27 21:19:03,018][106225] Updated weights for policy 1, policy_version 291104 (0.0006) [2023-12-27 21:19:03,327][106226] Updated weights for policy 0, policy_version 290588 (0.0008) [2023-12-27 21:19:03,379][106226] Updated weights for policy 0, policy_version 290598 (0.0008) [2023-12-27 21:19:03,428][106226] Updated weights for policy 0, policy_version 290608 (0.0008) [2023-12-27 21:19:03,606][106225] Updated weights for policy 1, policy_version 291114 (0.0006) [2023-12-27 21:19:03,668][106225] Updated weights for policy 1, policy_version 291124 (0.0008) [2023-12-27 21:19:03,727][106225] Updated weights for policy 1, policy_version 291134 (0.0008) [2023-12-27 21:19:04,150][106226] Updated weights for policy 0, policy_version 290618 (0.0008) [2023-12-27 21:19:04,216][106226] Updated weights for policy 0, policy_version 290628 (0.0007) [2023-12-27 21:19:04,279][106226] Updated weights for policy 0, policy_version 290638 (0.0010) [2023-12-27 21:19:04,347][106226] Updated weights for policy 0, policy_version 290648 (0.0008) [2023-12-27 21:19:04,479][106225] Updated weights for policy 1, policy_version 291144 (0.0008) [2023-12-27 21:19:04,533][106225] Updated weights for policy 1, policy_version 291154 (0.0009) [2023-12-27 21:19:04,590][106225] Updated weights for policy 1, policy_version 291164 (0.0009) [2023-12-27 21:19:04,921][106226] Updated weights for policy 0, policy_version 290658 (0.0009) [2023-12-27 21:19:04,987][106226] Updated weights for policy 0, policy_version 290668 (0.0009) [2023-12-27 21:19:05,050][106226] Updated weights for policy 0, policy_version 290678 (0.0007) [2023-12-27 21:19:05,299][106225] Updated weights for policy 1, policy_version 291174 (0.0007) [2023-12-27 21:19:05,354][106225] Updated weights for policy 1, policy_version 291184 (0.0007) [2023-12-27 21:19:05,423][106225] Updated weights for policy 1, policy_version 291194 (0.0010) [2023-12-27 21:19:05,591][106226] Updated weights for policy 0, policy_version 290688 (0.0009) [2023-12-27 21:19:05,650][106226] Updated weights for policy 0, policy_version 290698 (0.0007) [2023-12-27 21:19:05,712][106226] Updated weights for policy 0, policy_version 290708 (0.0009) [2023-12-27 21:19:06,040][106225] Updated weights for policy 1, policy_version 291204 (0.0007) [2023-12-27 21:19:06,107][106225] Updated weights for policy 1, policy_version 291214 (0.0007) [2023-12-27 21:19:06,174][106225] Updated weights for policy 1, policy_version 291224 (0.0008) [2023-12-27 21:19:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 149012480. Throughput: 0: 10211.4, 1: 9922.0. Samples: 149024984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:06,175][105115] Avg episode reward: [(0, '-5.059'), (1, '-5.631')] [2023-12-27 21:19:06,426][106226] Updated weights for policy 0, policy_version 290718 (0.0009) [2023-12-27 21:19:06,482][106226] Updated weights for policy 0, policy_version 290728 (0.0008) [2023-12-27 21:19:06,539][106226] Updated weights for policy 0, policy_version 290738 (0.0009) [2023-12-27 21:19:06,876][106225] Updated weights for policy 1, policy_version 291234 (0.0008) [2023-12-27 21:19:06,933][106225] Updated weights for policy 1, policy_version 291244 (0.0005) [2023-12-27 21:19:06,987][106225] Updated weights for policy 1, policy_version 291254 (0.0005) [2023-12-27 21:19:07,049][106225] Updated weights for policy 1, policy_version 291264 (0.0006) [2023-12-27 21:19:07,246][106226] Updated weights for policy 0, policy_version 290748 (0.0008) [2023-12-27 21:19:07,305][106226] Updated weights for policy 0, policy_version 290758 (0.0008) [2023-12-27 21:19:07,363][106226] Updated weights for policy 0, policy_version 290768 (0.0008) [2023-12-27 21:19:07,679][106225] Updated weights for policy 1, policy_version 291274 (0.0006) [2023-12-27 21:19:07,728][106225] Updated weights for policy 1, policy_version 291284 (0.0005) [2023-12-27 21:19:07,777][106225] Updated weights for policy 1, policy_version 291294 (0.0005) [2023-12-27 21:19:08,100][106226] Updated weights for policy 0, policy_version 290778 (0.0007) [2023-12-27 21:19:08,162][106226] Updated weights for policy 0, policy_version 290788 (0.0006) [2023-12-27 21:19:08,221][106226] Updated weights for policy 0, policy_version 290798 (0.0005) [2023-12-27 21:19:08,284][106226] Updated weights for policy 0, policy_version 290808 (0.0005) [2023-12-27 21:19:08,370][106225] Updated weights for policy 1, policy_version 291304 (0.0009) [2023-12-27 21:19:08,435][106225] Updated weights for policy 1, policy_version 291314 (0.0010) [2023-12-27 21:19:08,496][106225] Updated weights for policy 1, policy_version 291324 (0.0007) [2023-12-27 21:19:09,033][106226] Updated weights for policy 0, policy_version 290818 (0.0010) [2023-12-27 21:19:09,059][106225] Updated weights for policy 1, policy_version 291334 (0.0006) [2023-12-27 21:19:09,096][106226] Updated weights for policy 0, policy_version 290828 (0.0007) [2023-12-27 21:19:09,121][106225] Updated weights for policy 1, policy_version 291344 (0.0009) [2023-12-27 21:19:09,156][106226] Updated weights for policy 0, policy_version 290838 (0.0009) [2023-12-27 21:19:09,180][106225] Updated weights for policy 1, policy_version 291354 (0.0008) [2023-12-27 21:19:09,926][106226] Updated weights for policy 0, policy_version 290848 (0.0008) [2023-12-27 21:19:09,951][106225] Updated weights for policy 1, policy_version 291364 (0.0010) [2023-12-27 21:19:09,985][106226] Updated weights for policy 0, policy_version 290858 (0.0009) [2023-12-27 21:19:10,009][106225] Updated weights for policy 1, policy_version 291374 (0.0010) [2023-12-27 21:19:10,041][106226] Updated weights for policy 0, policy_version 290868 (0.0009) [2023-12-27 21:19:10,067][106225] Updated weights for policy 1, policy_version 291384 (0.0010) [2023-12-27 21:19:10,753][106225] Updated weights for policy 1, policy_version 291394 (0.0010) [2023-12-27 21:19:10,808][106225] Updated weights for policy 1, policy_version 291404 (0.0008) [2023-12-27 21:19:10,856][106226] Updated weights for policy 0, policy_version 290878 (0.0009) [2023-12-27 21:19:10,860][106225] Updated weights for policy 1, policy_version 291414 (0.0007) [2023-12-27 21:19:10,912][106226] Updated weights for policy 0, policy_version 290888 (0.0006) [2023-12-27 21:19:10,917][106225] Updated weights for policy 1, policy_version 291424 (0.0010) [2023-12-27 21:19:10,967][106226] Updated weights for policy 0, policy_version 290898 (0.0006) [2023-12-27 21:19:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19799.6). Total num frames: 149118976. Throughput: 0: 10177.7, 1: 10026.1. Samples: 149086408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:11,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.716')] [2023-12-27 21:19:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000291424_74620928.pth... [2023-12-27 21:19:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000290904_74498048.pth... [2023-12-27 21:19:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000289720_74194944.pth [2023-12-27 21:19:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000290240_74317824.pth [2023-12-27 21:19:11,599][106225] Updated weights for policy 1, policy_version 291434 (0.0008) [2023-12-27 21:19:11,665][106225] Updated weights for policy 1, policy_version 291444 (0.0008) [2023-12-27 21:19:11,731][106225] Updated weights for policy 1, policy_version 291454 (0.0007) [2023-12-27 21:19:11,802][106226] Updated weights for policy 0, policy_version 290908 (0.0007) [2023-12-27 21:19:11,860][106226] Updated weights for policy 0, policy_version 290918 (0.0006) [2023-12-27 21:19:11,914][106226] Updated weights for policy 0, policy_version 290928 (0.0006) [2023-12-27 21:19:12,499][106225] Updated weights for policy 1, policy_version 291464 (0.0008) [2023-12-27 21:19:12,563][106225] Updated weights for policy 1, policy_version 291474 (0.0009) [2023-12-27 21:19:12,605][106226] Updated weights for policy 0, policy_version 290938 (0.0008) [2023-12-27 21:19:12,624][106225] Updated weights for policy 1, policy_version 291484 (0.0007) [2023-12-27 21:19:12,663][106226] Updated weights for policy 0, policy_version 290948 (0.0007) [2023-12-27 21:19:12,721][106226] Updated weights for policy 0, policy_version 290958 (0.0009) [2023-12-27 21:19:12,779][106226] Updated weights for policy 0, policy_version 290968 (0.0009) [2023-12-27 21:19:13,348][106225] Updated weights for policy 1, policy_version 291494 (0.0008) [2023-12-27 21:19:13,405][106225] Updated weights for policy 1, policy_version 291504 (0.0010) [2023-12-27 21:19:13,467][106225] Updated weights for policy 1, policy_version 291514 (0.0006) [2023-12-27 21:19:13,552][106226] Updated weights for policy 0, policy_version 290978 (0.0010) [2023-12-27 21:19:13,597][106226] Updated weights for policy 0, policy_version 290988 (0.0008) [2023-12-27 21:19:13,645][106226] Updated weights for policy 0, policy_version 290998 (0.0005) [2023-12-27 21:19:14,133][106225] Updated weights for policy 1, policy_version 291524 (0.0007) [2023-12-27 21:19:14,186][106225] Updated weights for policy 1, policy_version 291534 (0.0010) [2023-12-27 21:19:14,243][106225] Updated weights for policy 1, policy_version 291544 (0.0010) [2023-12-27 21:19:14,247][106226] Updated weights for policy 0, policy_version 291008 (0.0010) [2023-12-27 21:19:14,307][106226] Updated weights for policy 0, policy_version 291018 (0.0010) [2023-12-27 21:19:14,370][106226] Updated weights for policy 0, policy_version 291028 (0.0010) [2023-12-27 21:19:14,958][106225] Updated weights for policy 1, policy_version 291554 (0.0010) [2023-12-27 21:19:14,978][106226] Updated weights for policy 0, policy_version 291038 (0.0009) [2023-12-27 21:19:15,019][106225] Updated weights for policy 1, policy_version 291564 (0.0010) [2023-12-27 21:19:15,037][106226] Updated weights for policy 0, policy_version 291048 (0.0007) [2023-12-27 21:19:15,077][106225] Updated weights for policy 1, policy_version 291574 (0.0010) [2023-12-27 21:19:15,098][106226] Updated weights for policy 0, policy_version 291058 (0.0009) [2023-12-27 21:19:15,144][106225] Updated weights for policy 1, policy_version 291584 (0.0010) [2023-12-27 21:19:15,713][106226] Updated weights for policy 0, policy_version 291068 (0.0011) [2023-12-27 21:19:15,768][106226] Updated weights for policy 0, policy_version 291078 (0.0010) [2023-12-27 21:19:15,826][106226] Updated weights for policy 0, policy_version 291088 (0.0011) [2023-12-27 21:19:15,832][106225] Updated weights for policy 1, policy_version 291594 (0.0010) [2023-12-27 21:19:15,889][106225] Updated weights for policy 1, policy_version 291604 (0.0010) [2023-12-27 21:19:15,944][106225] Updated weights for policy 1, policy_version 291614 (0.0010) [2023-12-27 21:19:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 149217280. Throughput: 0: 9948.7, 1: 10029.3. Samples: 149202808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:16,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.685')] [2023-12-27 21:19:16,532][106226] Updated weights for policy 0, policy_version 291098 (0.0009) [2023-12-27 21:19:16,582][106226] Updated weights for policy 0, policy_version 291108 (0.0005) [2023-12-27 21:19:16,632][106226] Updated weights for policy 0, policy_version 291118 (0.0008) [2023-12-27 21:19:16,649][106225] Updated weights for policy 1, policy_version 291624 (0.0006) [2023-12-27 21:19:16,684][106226] Updated weights for policy 0, policy_version 291128 (0.0008) [2023-12-27 21:19:16,698][106225] Updated weights for policy 1, policy_version 291634 (0.0005) [2023-12-27 21:19:16,757][106225] Updated weights for policy 1, policy_version 291644 (0.0005) [2023-12-27 21:19:17,277][106226] Updated weights for policy 0, policy_version 291138 (0.0006) [2023-12-27 21:19:17,328][106226] Updated weights for policy 0, policy_version 291148 (0.0006) [2023-12-27 21:19:17,381][106226] Updated weights for policy 0, policy_version 291158 (0.0007) [2023-12-27 21:19:17,449][106225] Updated weights for policy 1, policy_version 291654 (0.0008) [2023-12-27 21:19:17,497][106225] Updated weights for policy 1, policy_version 291664 (0.0008) [2023-12-27 21:19:17,549][106225] Updated weights for policy 1, policy_version 291674 (0.0008) [2023-12-27 21:19:18,014][106226] Updated weights for policy 0, policy_version 291168 (0.0006) [2023-12-27 21:19:18,072][106226] Updated weights for policy 0, policy_version 291178 (0.0005) [2023-12-27 21:19:18,137][106226] Updated weights for policy 0, policy_version 291188 (0.0008) [2023-12-27 21:19:18,219][106225] Updated weights for policy 1, policy_version 291684 (0.0007) [2023-12-27 21:19:18,277][106225] Updated weights for policy 1, policy_version 291694 (0.0009) [2023-12-27 21:19:18,345][106225] Updated weights for policy 1, policy_version 291704 (0.0008) [2023-12-27 21:19:18,798][106226] Updated weights for policy 0, policy_version 291198 (0.0008) [2023-12-27 21:19:18,860][106226] Updated weights for policy 0, policy_version 291208 (0.0009) [2023-12-27 21:19:18,920][106226] Updated weights for policy 0, policy_version 291218 (0.0006) [2023-12-27 21:19:19,119][106225] Updated weights for policy 1, policy_version 291714 (0.0008) [2023-12-27 21:19:19,175][106225] Updated weights for policy 1, policy_version 291724 (0.0008) [2023-12-27 21:19:19,233][106225] Updated weights for policy 1, policy_version 291734 (0.0009) [2023-12-27 21:19:19,300][106225] Updated weights for policy 1, policy_version 291744 (0.0008) [2023-12-27 21:19:19,519][106226] Updated weights for policy 0, policy_version 291228 (0.0006) [2023-12-27 21:19:19,584][106226] Updated weights for policy 0, policy_version 291238 (0.0008) [2023-12-27 21:19:19,643][106226] Updated weights for policy 0, policy_version 291248 (0.0008) [2023-12-27 21:19:20,143][106225] Updated weights for policy 1, policy_version 291754 (0.0008) [2023-12-27 21:19:20,208][106225] Updated weights for policy 1, policy_version 291764 (0.0008) [2023-12-27 21:19:20,271][106225] Updated weights for policy 1, policy_version 291774 (0.0008) [2023-12-27 21:19:20,374][106226] Updated weights for policy 0, policy_version 291258 (0.0008) [2023-12-27 21:19:20,429][106226] Updated weights for policy 0, policy_version 291268 (0.0006) [2023-12-27 21:19:20,493][106226] Updated weights for policy 0, policy_version 291278 (0.0007) [2023-12-27 21:19:20,544][106226] Updated weights for policy 0, policy_version 291288 (0.0006) [2023-12-27 21:19:21,028][106225] Updated weights for policy 1, policy_version 291784 (0.0010) [2023-12-27 21:19:21,098][106225] Updated weights for policy 1, policy_version 291794 (0.0008) [2023-12-27 21:19:21,175][106225] Updated weights for policy 1, policy_version 291804 (0.0009) [2023-12-27 21:19:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 149307392. Throughput: 0: 10004.8, 1: 9884.3. Samples: 149322604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:21,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.501')] [2023-12-27 21:19:21,290][106226] Updated weights for policy 0, policy_version 291298 (0.0008) [2023-12-27 21:19:21,358][106226] Updated weights for policy 0, policy_version 291308 (0.0009) [2023-12-27 21:19:21,434][106226] Updated weights for policy 0, policy_version 291318 (0.0008) [2023-12-27 21:19:22,003][106225] Updated weights for policy 1, policy_version 291814 (0.0009) [2023-12-27 21:19:22,068][106225] Updated weights for policy 1, policy_version 291824 (0.0008) [2023-12-27 21:19:22,089][106226] Updated weights for policy 0, policy_version 291328 (0.0008) [2023-12-27 21:19:22,132][106225] Updated weights for policy 1, policy_version 291834 (0.0006) [2023-12-27 21:19:22,149][106226] Updated weights for policy 0, policy_version 291338 (0.0009) [2023-12-27 21:19:22,204][106226] Updated weights for policy 0, policy_version 291348 (0.0009) [2023-12-27 21:19:22,889][106225] Updated weights for policy 1, policy_version 291844 (0.0007) [2023-12-27 21:19:22,941][106225] Updated weights for policy 1, policy_version 291854 (0.0006) [2023-12-27 21:19:22,948][106226] Updated weights for policy 0, policy_version 291358 (0.0008) [2023-12-27 21:19:22,991][106225] Updated weights for policy 1, policy_version 291864 (0.0006) [2023-12-27 21:19:22,999][106226] Updated weights for policy 0, policy_version 291368 (0.0006) [2023-12-27 21:19:23,050][106226] Updated weights for policy 0, policy_version 291378 (0.0010) [2023-12-27 21:19:23,622][106225] Updated weights for policy 1, policy_version 291874 (0.0010) [2023-12-27 21:19:23,683][106225] Updated weights for policy 1, policy_version 291884 (0.0007) [2023-12-27 21:19:23,737][106225] Updated weights for policy 1, policy_version 291894 (0.0006) [2023-12-27 21:19:23,764][106226] Updated weights for policy 0, policy_version 291388 (0.0007) [2023-12-27 21:19:23,787][106225] Updated weights for policy 1, policy_version 291904 (0.0005) [2023-12-27 21:19:23,810][106226] Updated weights for policy 0, policy_version 291398 (0.0010) [2023-12-27 21:19:23,867][106226] Updated weights for policy 0, policy_version 291408 (0.0009) [2023-12-27 21:19:24,411][106225] Updated weights for policy 1, policy_version 291914 (0.0010) [2023-12-27 21:19:24,461][106225] Updated weights for policy 1, policy_version 291924 (0.0010) [2023-12-27 21:19:24,513][106225] Updated weights for policy 1, policy_version 291934 (0.0006) [2023-12-27 21:19:24,541][106226] Updated weights for policy 0, policy_version 291418 (0.0009) [2023-12-27 21:19:24,595][106226] Updated weights for policy 0, policy_version 291428 (0.0010) [2023-12-27 21:19:24,649][106226] Updated weights for policy 0, policy_version 291438 (0.0010) [2023-12-27 21:19:24,705][106226] Updated weights for policy 0, policy_version 291448 (0.0010) [2023-12-27 21:19:25,143][106225] Updated weights for policy 1, policy_version 291944 (0.0007) [2023-12-27 21:19:25,190][106225] Updated weights for policy 1, policy_version 291954 (0.0008) [2023-12-27 21:19:25,247][106225] Updated weights for policy 1, policy_version 291964 (0.0007) [2023-12-27 21:19:25,420][106226] Updated weights for policy 0, policy_version 291458 (0.0011) [2023-12-27 21:19:25,482][106226] Updated weights for policy 0, policy_version 291468 (0.0010) [2023-12-27 21:19:25,542][106226] Updated weights for policy 0, policy_version 291478 (0.0011) [2023-12-27 21:19:25,891][106225] Updated weights for policy 1, policy_version 291974 (0.0007) [2023-12-27 21:19:25,954][106225] Updated weights for policy 1, policy_version 291984 (0.0006) [2023-12-27 21:19:26,017][106225] Updated weights for policy 1, policy_version 291994 (0.0005) [2023-12-27 21:19:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 149413888. Throughput: 0: 10000.8, 1: 9834.2. Samples: 149380272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:19:26,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-5.579')] [2023-12-27 21:19:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000292000_74768384.pth... [2023-12-27 21:19:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000290816_74465280.pth [2023-12-27 21:19:26,216][106226] Updated weights for policy 0, policy_version 291488 (0.0011) [2023-12-27 21:19:26,262][106226] Updated weights for policy 0, policy_version 291498 (0.0010) [2023-12-27 21:19:26,315][106226] Updated weights for policy 0, policy_version 291508 (0.0010) [2023-12-27 21:19:26,335][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000291512_74653696.pth... [2023-12-27 21:19:26,338][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000290328_74350592.pth [2023-12-27 21:19:26,674][106225] Updated weights for policy 1, policy_version 292004 (0.0006) [2023-12-27 21:19:26,720][106225] Updated weights for policy 1, policy_version 292014 (0.0007) [2023-12-27 21:19:26,786][106225] Updated weights for policy 1, policy_version 292024 (0.0007) [2023-12-27 21:19:27,009][106226] Updated weights for policy 0, policy_version 291518 (0.0010) [2023-12-27 21:19:27,059][106226] Updated weights for policy 0, policy_version 291528 (0.0010) [2023-12-27 21:19:27,104][106226] Updated weights for policy 0, policy_version 291538 (0.0010) [2023-12-27 21:19:27,381][106225] Updated weights for policy 1, policy_version 292034 (0.0007) [2023-12-27 21:19:27,431][106225] Updated weights for policy 1, policy_version 292044 (0.0005) [2023-12-27 21:19:27,479][106225] Updated weights for policy 1, policy_version 292054 (0.0008) [2023-12-27 21:19:27,530][106225] Updated weights for policy 1, policy_version 292064 (0.0009) [2023-12-27 21:19:27,810][106226] Updated weights for policy 0, policy_version 291548 (0.0010) [2023-12-27 21:19:27,883][106226] Updated weights for policy 0, policy_version 291558 (0.0011) [2023-12-27 21:19:27,952][106226] Updated weights for policy 0, policy_version 291568 (0.0011) [2023-12-27 21:19:28,156][106225] Updated weights for policy 1, policy_version 292074 (0.0007) [2023-12-27 21:19:28,214][106225] Updated weights for policy 1, policy_version 292084 (0.0007) [2023-12-27 21:19:28,268][106225] Updated weights for policy 1, policy_version 292094 (0.0005) [2023-12-27 21:19:28,653][106226] Updated weights for policy 0, policy_version 291578 (0.0011) [2023-12-27 21:19:28,716][106226] Updated weights for policy 0, policy_version 291588 (0.0010) [2023-12-27 21:19:28,773][106226] Updated weights for policy 0, policy_version 291598 (0.0010) [2023-12-27 21:19:28,833][106226] Updated weights for policy 0, policy_version 291608 (0.0010) [2023-12-27 21:19:28,899][106225] Updated weights for policy 1, policy_version 292104 (0.0009) [2023-12-27 21:19:28,953][106225] Updated weights for policy 1, policy_version 292114 (0.0007) [2023-12-27 21:19:29,019][106225] Updated weights for policy 1, policy_version 292124 (0.0007) [2023-12-27 21:19:29,515][106226] Updated weights for policy 0, policy_version 291618 (0.0008) [2023-12-27 21:19:29,573][106226] Updated weights for policy 0, policy_version 291628 (0.0006) [2023-12-27 21:19:29,624][106226] Updated weights for policy 0, policy_version 291638 (0.0006) [2023-12-27 21:19:29,686][106225] Updated weights for policy 1, policy_version 292134 (0.0009) [2023-12-27 21:19:29,740][106225] Updated weights for policy 1, policy_version 292144 (0.0010) [2023-12-27 21:19:29,803][106225] Updated weights for policy 1, policy_version 292154 (0.0010) [2023-12-27 21:19:30,390][106226] Updated weights for policy 0, policy_version 291648 (0.0008) [2023-12-27 21:19:30,452][106226] Updated weights for policy 0, policy_version 291658 (0.0008) [2023-12-27 21:19:30,471][106225] Updated weights for policy 1, policy_version 292164 (0.0010) [2023-12-27 21:19:30,504][106226] Updated weights for policy 0, policy_version 291668 (0.0006) [2023-12-27 21:19:30,522][106225] Updated weights for policy 1, policy_version 292174 (0.0010) [2023-12-27 21:19:30,569][106225] Updated weights for policy 1, policy_version 292184 (0.0008) [2023-12-27 21:19:31,144][106226] Updated weights for policy 0, policy_version 291678 (0.0006) [2023-12-27 21:19:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 149512192. Throughput: 0: 10031.7, 1: 10003.8. Samples: 149505488. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:31,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-5.670')] [2023-12-27 21:19:31,197][106226] Updated weights for policy 0, policy_version 291688 (0.0008) [2023-12-27 21:19:31,256][106226] Updated weights for policy 0, policy_version 291698 (0.0009) [2023-12-27 21:19:31,295][106225] Updated weights for policy 1, policy_version 292194 (0.0009) [2023-12-27 21:19:31,354][106225] Updated weights for policy 1, policy_version 292204 (0.0007) [2023-12-27 21:19:31,425][106225] Updated weights for policy 1, policy_version 292214 (0.0008) [2023-12-27 21:19:31,490][106225] Updated weights for policy 1, policy_version 292224 (0.0008) [2023-12-27 21:19:31,975][106226] Updated weights for policy 0, policy_version 291708 (0.0008) [2023-12-27 21:19:32,039][106226] Updated weights for policy 0, policy_version 291718 (0.0006) [2023-12-27 21:19:32,099][106226] Updated weights for policy 0, policy_version 291728 (0.0005) [2023-12-27 21:19:32,161][106225] Updated weights for policy 1, policy_version 292234 (0.0007) [2023-12-27 21:19:32,222][106225] Updated weights for policy 1, policy_version 292244 (0.0005) [2023-12-27 21:19:32,286][106225] Updated weights for policy 1, policy_version 292254 (0.0008) [2023-12-27 21:19:32,789][106226] Updated weights for policy 0, policy_version 291738 (0.0006) [2023-12-27 21:19:32,848][106226] Updated weights for policy 0, policy_version 291748 (0.0009) [2023-12-27 21:19:32,904][106226] Updated weights for policy 0, policy_version 291758 (0.0009) [2023-12-27 21:19:32,961][106226] Updated weights for policy 0, policy_version 291768 (0.0007) [2023-12-27 21:19:32,970][106225] Updated weights for policy 1, policy_version 292264 (0.0007) [2023-12-27 21:19:33,018][106225] Updated weights for policy 1, policy_version 292274 (0.0008) [2023-12-27 21:19:33,063][106225] Updated weights for policy 1, policy_version 292284 (0.0007) [2023-12-27 21:19:33,636][106225] Updated weights for policy 1, policy_version 292294 (0.0005) [2023-12-27 21:19:33,638][106226] Updated weights for policy 0, policy_version 291778 (0.0007) [2023-12-27 21:19:33,682][106225] Updated weights for policy 1, policy_version 292304 (0.0007) [2023-12-27 21:19:33,715][106226] Updated weights for policy 0, policy_version 291788 (0.0007) [2023-12-27 21:19:33,732][106225] Updated weights for policy 1, policy_version 292314 (0.0007) [2023-12-27 21:19:33,775][106226] Updated weights for policy 0, policy_version 291798 (0.0009) [2023-12-27 21:19:34,392][106225] Updated weights for policy 1, policy_version 292324 (0.0007) [2023-12-27 21:19:34,450][106225] Updated weights for policy 1, policy_version 292334 (0.0006) [2023-12-27 21:19:34,464][106226] Updated weights for policy 0, policy_version 291808 (0.0008) [2023-12-27 21:19:34,512][106225] Updated weights for policy 1, policy_version 292344 (0.0007) [2023-12-27 21:19:34,527][106226] Updated weights for policy 0, policy_version 291818 (0.0007) [2023-12-27 21:19:34,587][106226] Updated weights for policy 0, policy_version 291828 (0.0007) [2023-12-27 21:19:35,126][106225] Updated weights for policy 1, policy_version 292354 (0.0008) [2023-12-27 21:19:35,181][106225] Updated weights for policy 1, policy_version 292364 (0.0007) [2023-12-27 21:19:35,240][106225] Updated weights for policy 1, policy_version 292374 (0.0006) [2023-12-27 21:19:35,269][106226] Updated weights for policy 0, policy_version 291838 (0.0008) [2023-12-27 21:19:35,293][106225] Updated weights for policy 1, policy_version 292384 (0.0005) [2023-12-27 21:19:35,321][106226] Updated weights for policy 0, policy_version 291848 (0.0009) [2023-12-27 21:19:35,371][106226] Updated weights for policy 0, policy_version 291858 (0.0008) [2023-12-27 21:19:35,832][106225] Updated weights for policy 1, policy_version 292394 (0.0006) [2023-12-27 21:19:35,893][106225] Updated weights for policy 1, policy_version 292404 (0.0009) [2023-12-27 21:19:35,943][106225] Updated weights for policy 1, policy_version 292414 (0.0007) [2023-12-27 21:19:36,080][106226] Updated weights for policy 0, policy_version 291868 (0.0008) [2023-12-27 21:19:36,151][106226] Updated weights for policy 0, policy_version 291878 (0.0007) [2023-12-27 21:19:36,174][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 149618688. Throughput: 0: 10017.5, 1: 10123.0. Samples: 149629736. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:36,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.500')] [2023-12-27 21:19:36,224][106226] Updated weights for policy 0, policy_version 291888 (0.0008) [2023-12-27 21:19:36,589][106225] Updated weights for policy 1, policy_version 292424 (0.0010) [2023-12-27 21:19:36,641][106225] Updated weights for policy 1, policy_version 292434 (0.0010) [2023-12-27 21:19:36,697][106225] Updated weights for policy 1, policy_version 292444 (0.0010) [2023-12-27 21:19:36,841][106226] Updated weights for policy 0, policy_version 291898 (0.0009) [2023-12-27 21:19:36,900][106226] Updated weights for policy 0, policy_version 291908 (0.0008) [2023-12-27 21:19:36,952][106226] Updated weights for policy 0, policy_version 291918 (0.0007) [2023-12-27 21:19:37,015][106226] Updated weights for policy 0, policy_version 291928 (0.0009) [2023-12-27 21:19:37,329][106225] Updated weights for policy 1, policy_version 292454 (0.0007) [2023-12-27 21:19:37,393][106225] Updated weights for policy 1, policy_version 292464 (0.0008) [2023-12-27 21:19:37,447][106225] Updated weights for policy 1, policy_version 292474 (0.0010) [2023-12-27 21:19:37,758][106226] Updated weights for policy 0, policy_version 291938 (0.0008) [2023-12-27 21:19:37,809][106226] Updated weights for policy 0, policy_version 291948 (0.0008) [2023-12-27 21:19:37,856][106226] Updated weights for policy 0, policy_version 291958 (0.0007) [2023-12-27 21:19:38,140][106225] Updated weights for policy 1, policy_version 292484 (0.0010) [2023-12-27 21:19:38,193][106225] Updated weights for policy 1, policy_version 292494 (0.0010) [2023-12-27 21:19:38,252][106225] Updated weights for policy 1, policy_version 292504 (0.0010) [2023-12-27 21:19:38,617][106226] Updated weights for policy 0, policy_version 291968 (0.0009) [2023-12-27 21:19:38,682][106226] Updated weights for policy 0, policy_version 291978 (0.0008) [2023-12-27 21:19:38,743][106226] Updated weights for policy 0, policy_version 291988 (0.0008) [2023-12-27 21:19:39,013][106225] Updated weights for policy 1, policy_version 292514 (0.0010) [2023-12-27 21:19:39,075][106225] Updated weights for policy 1, policy_version 292524 (0.0011) [2023-12-27 21:19:39,140][106225] Updated weights for policy 1, policy_version 292534 (0.0011) [2023-12-27 21:19:39,203][106225] Updated weights for policy 1, policy_version 292544 (0.0011) [2023-12-27 21:19:39,481][106226] Updated weights for policy 0, policy_version 291998 (0.0008) [2023-12-27 21:19:39,528][106226] Updated weights for policy 0, policy_version 292008 (0.0008) [2023-12-27 21:19:39,582][106226] Updated weights for policy 0, policy_version 292018 (0.0007) [2023-12-27 21:19:39,959][106225] Updated weights for policy 1, policy_version 292554 (0.0006) [2023-12-27 21:19:40,018][106225] Updated weights for policy 1, policy_version 292564 (0.0007) [2023-12-27 21:19:40,095][106225] Updated weights for policy 1, policy_version 292574 (0.0007) [2023-12-27 21:19:40,322][106226] Updated weights for policy 0, policy_version 292028 (0.0007) [2023-12-27 21:19:40,387][106226] Updated weights for policy 0, policy_version 292038 (0.0011) [2023-12-27 21:19:40,451][106226] Updated weights for policy 0, policy_version 292048 (0.0011) [2023-12-27 21:19:40,776][106225] Updated weights for policy 1, policy_version 292584 (0.0010) [2023-12-27 21:19:40,833][106225] Updated weights for policy 1, policy_version 292594 (0.0010) [2023-12-27 21:19:40,883][106225] Updated weights for policy 1, policy_version 292604 (0.0010) [2023-12-27 21:19:41,139][106226] Updated weights for policy 0, policy_version 292058 (0.0011) [2023-12-27 21:19:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 149716992. Throughput: 0: 9980.6, 1: 10155.9. Samples: 149688968. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:41,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.674')] [2023-12-27 21:19:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000292608_74924032.pth... [2023-12-27 21:19:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000291424_74620928.pth [2023-12-27 21:19:41,197][106226] Updated weights for policy 0, policy_version 292068 (0.0009) [2023-12-27 21:19:41,254][106226] Updated weights for policy 0, policy_version 292078 (0.0008) [2023-12-27 21:19:41,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000292088_74801152.pth... [2023-12-27 21:19:41,323][106226] Updated weights for policy 0, policy_version 292088 (0.0008) [2023-12-27 21:19:41,328][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000290904_74498048.pth [2023-12-27 21:19:41,620][106225] Updated weights for policy 1, policy_version 292614 (0.0009) [2023-12-27 21:19:41,677][106225] Updated weights for policy 1, policy_version 292624 (0.0008) [2023-12-27 21:19:41,743][106225] Updated weights for policy 1, policy_version 292634 (0.0008) [2023-12-27 21:19:42,071][106226] Updated weights for policy 0, policy_version 292098 (0.0010) [2023-12-27 21:19:42,137][106226] Updated weights for policy 0, policy_version 292108 (0.0006) [2023-12-27 21:19:42,197][106226] Updated weights for policy 0, policy_version 292118 (0.0008) [2023-12-27 21:19:42,478][106225] Updated weights for policy 1, policy_version 292644 (0.0008) [2023-12-27 21:19:42,540][106225] Updated weights for policy 1, policy_version 292654 (0.0009) [2023-12-27 21:19:42,600][106225] Updated weights for policy 1, policy_version 292664 (0.0007) [2023-12-27 21:19:42,977][106226] Updated weights for policy 0, policy_version 292128 (0.0010) [2023-12-27 21:19:43,034][106226] Updated weights for policy 0, policy_version 292138 (0.0011) [2023-12-27 21:19:43,090][106226] Updated weights for policy 0, policy_version 292148 (0.0005) [2023-12-27 21:19:43,250][106225] Updated weights for policy 1, policy_version 292674 (0.0006) [2023-12-27 21:19:43,312][106225] Updated weights for policy 1, policy_version 292684 (0.0006) [2023-12-27 21:19:43,367][106225] Updated weights for policy 1, policy_version 292694 (0.0005) [2023-12-27 21:19:43,428][106225] Updated weights for policy 1, policy_version 292704 (0.0006) [2023-12-27 21:19:43,698][106226] Updated weights for policy 0, policy_version 292158 (0.0005) [2023-12-27 21:19:43,744][106226] Updated weights for policy 0, policy_version 292168 (0.0008) [2023-12-27 21:19:43,800][106226] Updated weights for policy 0, policy_version 292178 (0.0006) [2023-12-27 21:19:44,003][106225] Updated weights for policy 1, policy_version 292714 (0.0010) [2023-12-27 21:19:44,062][106225] Updated weights for policy 1, policy_version 292724 (0.0010) [2023-12-27 21:19:44,119][106225] Updated weights for policy 1, policy_version 292734 (0.0010) [2023-12-27 21:19:44,369][106226] Updated weights for policy 0, policy_version 292188 (0.0006) [2023-12-27 21:19:44,425][106226] Updated weights for policy 0, policy_version 292198 (0.0008) [2023-12-27 21:19:44,476][106226] Updated weights for policy 0, policy_version 292208 (0.0008) [2023-12-27 21:19:44,842][106225] Updated weights for policy 1, policy_version 292744 (0.0009) [2023-12-27 21:19:44,890][106225] Updated weights for policy 1, policy_version 292754 (0.0010) [2023-12-27 21:19:44,938][106225] Updated weights for policy 1, policy_version 292764 (0.0010) [2023-12-27 21:19:45,218][106226] Updated weights for policy 0, policy_version 292218 (0.0008) [2023-12-27 21:19:45,286][106226] Updated weights for policy 0, policy_version 292228 (0.0009) [2023-12-27 21:19:45,354][106226] Updated weights for policy 0, policy_version 292238 (0.0008) [2023-12-27 21:19:45,425][106226] Updated weights for policy 0, policy_version 292248 (0.0006) [2023-12-27 21:19:45,663][106225] Updated weights for policy 1, policy_version 292774 (0.0010) [2023-12-27 21:19:45,723][106225] Updated weights for policy 1, policy_version 292784 (0.0008) [2023-12-27 21:19:45,772][106225] Updated weights for policy 1, policy_version 292794 (0.0006) [2023-12-27 21:19:45,993][106226] Updated weights for policy 0, policy_version 292258 (0.0008) [2023-12-27 21:19:46,055][106226] Updated weights for policy 0, policy_version 292268 (0.0008) [2023-12-27 21:19:46,115][106226] Updated weights for policy 0, policy_version 292278 (0.0009) [2023-12-27 21:19:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 149823488. Throughput: 0: 9953.8, 1: 10167.4. Samples: 149808968. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:46,176][105115] Avg episode reward: [(0, '-4.618'), (1, '-5.503')] [2023-12-27 21:19:46,481][106225] Updated weights for policy 1, policy_version 292804 (0.0009) [2023-12-27 21:19:46,535][106225] Updated weights for policy 1, policy_version 292814 (0.0008) [2023-12-27 21:19:46,591][106225] Updated weights for policy 1, policy_version 292824 (0.0008) [2023-12-27 21:19:46,851][106226] Updated weights for policy 0, policy_version 292288 (0.0010) [2023-12-27 21:19:46,910][106226] Updated weights for policy 0, policy_version 292298 (0.0010) [2023-12-27 21:19:46,976][106226] Updated weights for policy 0, policy_version 292308 (0.0010) [2023-12-27 21:19:47,303][106225] Updated weights for policy 1, policy_version 292834 (0.0008) [2023-12-27 21:19:47,360][106225] Updated weights for policy 1, policy_version 292844 (0.0005) [2023-12-27 21:19:47,411][106225] Updated weights for policy 1, policy_version 292854 (0.0005) [2023-12-27 21:19:47,468][106225] Updated weights for policy 1, policy_version 292864 (0.0005) [2023-12-27 21:19:47,637][106226] Updated weights for policy 0, policy_version 292318 (0.0007) [2023-12-27 21:19:47,704][106226] Updated weights for policy 0, policy_version 292328 (0.0006) [2023-12-27 21:19:47,776][106226] Updated weights for policy 0, policy_version 292338 (0.0009) [2023-12-27 21:19:48,032][106225] Updated weights for policy 1, policy_version 292874 (0.0009) [2023-12-27 21:19:48,102][106225] Updated weights for policy 1, policy_version 292884 (0.0011) [2023-12-27 21:19:48,173][106225] Updated weights for policy 1, policy_version 292894 (0.0010) [2023-12-27 21:19:48,390][106226] Updated weights for policy 0, policy_version 292348 (0.0011) [2023-12-27 21:19:48,458][106226] Updated weights for policy 0, policy_version 292358 (0.0009) [2023-12-27 21:19:48,525][106226] Updated weights for policy 0, policy_version 292368 (0.0005) [2023-12-27 21:19:48,900][106225] Updated weights for policy 1, policy_version 292904 (0.0011) [2023-12-27 21:19:48,962][106225] Updated weights for policy 1, policy_version 292914 (0.0010) [2023-12-27 21:19:49,025][106225] Updated weights for policy 1, policy_version 292924 (0.0009) [2023-12-27 21:19:49,227][106226] Updated weights for policy 0, policy_version 292378 (0.0007) [2023-12-27 21:19:49,293][106226] Updated weights for policy 0, policy_version 292388 (0.0009) [2023-12-27 21:19:49,357][106226] Updated weights for policy 0, policy_version 292398 (0.0010) [2023-12-27 21:19:49,419][106226] Updated weights for policy 0, policy_version 292408 (0.0007) [2023-12-27 21:19:49,666][106225] Updated weights for policy 1, policy_version 292934 (0.0009) [2023-12-27 21:19:49,728][106225] Updated weights for policy 1, policy_version 292944 (0.0011) [2023-12-27 21:19:49,788][106225] Updated weights for policy 1, policy_version 292954 (0.0010) [2023-12-27 21:19:50,087][106226] Updated weights for policy 0, policy_version 292418 (0.0005) [2023-12-27 21:19:50,153][106226] Updated weights for policy 0, policy_version 292428 (0.0005) [2023-12-27 21:19:50,214][106226] Updated weights for policy 0, policy_version 292438 (0.0005) [2023-12-27 21:19:50,531][106225] Updated weights for policy 1, policy_version 292964 (0.0010) [2023-12-27 21:19:50,602][106225] Updated weights for policy 1, policy_version 292974 (0.0010) [2023-12-27 21:19:50,659][106225] Updated weights for policy 1, policy_version 292984 (0.0010) [2023-12-27 21:19:50,882][106226] Updated weights for policy 0, policy_version 292448 (0.0006) [2023-12-27 21:19:50,944][106226] Updated weights for policy 0, policy_version 292458 (0.0007) [2023-12-27 21:19:51,002][106226] Updated weights for policy 0, policy_version 292468 (0.0011) [2023-12-27 21:19:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 149921792. Throughput: 0: 9955.8, 1: 10132.8. Samples: 149928972. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:51,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.445')] [2023-12-27 21:19:51,417][106225] Updated weights for policy 1, policy_version 292994 (0.0010) [2023-12-27 21:19:51,479][106225] Updated weights for policy 1, policy_version 293004 (0.0008) [2023-12-27 21:19:51,538][106225] Updated weights for policy 1, policy_version 293014 (0.0008) [2023-12-27 21:19:51,599][106225] Updated weights for policy 1, policy_version 293024 (0.0006) [2023-12-27 21:19:51,700][106226] Updated weights for policy 0, policy_version 292478 (0.0011) [2023-12-27 21:19:51,774][106226] Updated weights for policy 0, policy_version 292488 (0.0010) [2023-12-27 21:19:51,838][106226] Updated weights for policy 0, policy_version 292498 (0.0011) [2023-12-27 21:19:52,377][106225] Updated weights for policy 1, policy_version 293034 (0.0008) [2023-12-27 21:19:52,436][106225] Updated weights for policy 1, policy_version 293044 (0.0008) [2023-12-27 21:19:52,491][106225] Updated weights for policy 1, policy_version 293054 (0.0008) [2023-12-27 21:19:52,566][106226] Updated weights for policy 0, policy_version 292508 (0.0009) [2023-12-27 21:19:52,630][106226] Updated weights for policy 0, policy_version 292518 (0.0009) [2023-12-27 21:19:52,690][106226] Updated weights for policy 0, policy_version 292528 (0.0008) [2023-12-27 21:19:53,199][106225] Updated weights for policy 1, policy_version 293064 (0.0006) [2023-12-27 21:19:53,244][106225] Updated weights for policy 1, policy_version 293074 (0.0006) [2023-12-27 21:19:53,294][106225] Updated weights for policy 1, policy_version 293084 (0.0008) [2023-12-27 21:19:53,367][106226] Updated weights for policy 0, policy_version 292538 (0.0009) [2023-12-27 21:19:53,423][106226] Updated weights for policy 0, policy_version 292548 (0.0010) [2023-12-27 21:19:53,479][106226] Updated weights for policy 0, policy_version 292558 (0.0010) [2023-12-27 21:19:53,533][106226] Updated weights for policy 0, policy_version 292568 (0.0010) [2023-12-27 21:19:53,975][106225] Updated weights for policy 1, policy_version 293094 (0.0009) [2023-12-27 21:19:54,023][106225] Updated weights for policy 1, policy_version 293104 (0.0010) [2023-12-27 21:19:54,088][106225] Updated weights for policy 1, policy_version 293114 (0.0010) [2023-12-27 21:19:54,254][106226] Updated weights for policy 0, policy_version 292578 (0.0010) [2023-12-27 21:19:54,310][106226] Updated weights for policy 0, policy_version 292588 (0.0010) [2023-12-27 21:19:54,360][106226] Updated weights for policy 0, policy_version 292598 (0.0010) [2023-12-27 21:19:54,676][106225] Updated weights for policy 1, policy_version 293124 (0.0008) [2023-12-27 21:19:54,722][106225] Updated weights for policy 1, policy_version 293134 (0.0005) [2023-12-27 21:19:54,768][106225] Updated weights for policy 1, policy_version 293144 (0.0005) [2023-12-27 21:19:54,984][106226] Updated weights for policy 0, policy_version 292608 (0.0007) [2023-12-27 21:19:55,047][106226] Updated weights for policy 0, policy_version 292618 (0.0008) [2023-12-27 21:19:55,111][106226] Updated weights for policy 0, policy_version 292628 (0.0005) [2023-12-27 21:19:55,460][106225] Updated weights for policy 1, policy_version 293154 (0.0007) [2023-12-27 21:19:55,518][106225] Updated weights for policy 1, policy_version 293164 (0.0005) [2023-12-27 21:19:55,569][106225] Updated weights for policy 1, policy_version 293174 (0.0005) [2023-12-27 21:19:55,624][106225] Updated weights for policy 1, policy_version 293184 (0.0005) [2023-12-27 21:19:55,655][106226] Updated weights for policy 0, policy_version 292638 (0.0006) [2023-12-27 21:19:55,711][106226] Updated weights for policy 0, policy_version 292648 (0.0006) [2023-12-27 21:19:55,767][106226] Updated weights for policy 0, policy_version 292658 (0.0005) [2023-12-27 21:19:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 150020096. Throughput: 0: 9976.2, 1: 10034.7. Samples: 149986896. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:19:56,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.778')] [2023-12-27 21:19:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000293184_75071488.pth... [2023-12-27 21:19:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000292664_74948608.pth... [2023-12-27 21:19:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000292000_74768384.pth [2023-12-27 21:19:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000291512_74653696.pth [2023-12-27 21:19:56,296][106225] Updated weights for policy 1, policy_version 293194 (0.0010) [2023-12-27 21:19:56,343][106226] Updated weights for policy 0, policy_version 292668 (0.0006) [2023-12-27 21:19:56,346][106225] Updated weights for policy 1, policy_version 293204 (0.0010) [2023-12-27 21:19:56,401][106226] Updated weights for policy 0, policy_version 292678 (0.0007) [2023-12-27 21:19:56,409][106225] Updated weights for policy 1, policy_version 293214 (0.0010) [2023-12-27 21:19:56,465][106226] Updated weights for policy 0, policy_version 292688 (0.0009) [2023-12-27 21:19:57,052][106225] Updated weights for policy 1, policy_version 293224 (0.0008) [2023-12-27 21:19:57,101][106225] Updated weights for policy 1, policy_version 293234 (0.0007) [2023-12-27 21:19:57,128][106226] Updated weights for policy 0, policy_version 292698 (0.0007) [2023-12-27 21:19:57,153][106225] Updated weights for policy 1, policy_version 293244 (0.0009) [2023-12-27 21:19:57,178][106226] Updated weights for policy 0, policy_version 292708 (0.0005) [2023-12-27 21:19:57,229][106226] Updated weights for policy 0, policy_version 292718 (0.0008) [2023-12-27 21:19:57,282][106226] Updated weights for policy 0, policy_version 292728 (0.0008) [2023-12-27 21:19:57,824][106225] Updated weights for policy 1, policy_version 293254 (0.0010) [2023-12-27 21:19:57,876][106225] Updated weights for policy 1, policy_version 293264 (0.0010) [2023-12-27 21:19:57,926][106225] Updated weights for policy 1, policy_version 293274 (0.0010) [2023-12-27 21:19:57,986][106226] Updated weights for policy 0, policy_version 292738 (0.0007) [2023-12-27 21:19:58,044][106226] Updated weights for policy 0, policy_version 292748 (0.0006) [2023-12-27 21:19:58,104][106226] Updated weights for policy 0, policy_version 292758 (0.0008) [2023-12-27 21:19:58,699][106225] Updated weights for policy 1, policy_version 293284 (0.0010) [2023-12-27 21:19:58,766][106225] Updated weights for policy 1, policy_version 293294 (0.0008) [2023-12-27 21:19:58,836][106225] Updated weights for policy 1, policy_version 293304 (0.0009) [2023-12-27 21:19:58,876][106226] Updated weights for policy 0, policy_version 292768 (0.0012) [2023-12-27 21:19:58,935][106226] Updated weights for policy 0, policy_version 292778 (0.0008) [2023-12-27 21:19:58,999][106226] Updated weights for policy 0, policy_version 292788 (0.0009) [2023-12-27 21:19:59,603][106225] Updated weights for policy 1, policy_version 293314 (0.0007) [2023-12-27 21:19:59,661][106225] Updated weights for policy 1, policy_version 293324 (0.0008) [2023-12-27 21:19:59,720][106225] Updated weights for policy 1, policy_version 293334 (0.0008) [2023-12-27 21:19:59,777][106225] Updated weights for policy 1, policy_version 293344 (0.0007) [2023-12-27 21:19:59,786][106226] Updated weights for policy 0, policy_version 292798 (0.0009) [2023-12-27 21:19:59,857][106226] Updated weights for policy 0, policy_version 292808 (0.0009) [2023-12-27 21:19:59,915][106226] Updated weights for policy 0, policy_version 292818 (0.0008) [2023-12-27 21:20:00,474][106225] Updated weights for policy 1, policy_version 293354 (0.0005) [2023-12-27 21:20:00,530][106225] Updated weights for policy 1, policy_version 293364 (0.0005) [2023-12-27 21:20:00,585][106225] Updated weights for policy 1, policy_version 293374 (0.0006) [2023-12-27 21:20:00,675][106226] Updated weights for policy 0, policy_version 292828 (0.0007) [2023-12-27 21:20:00,739][106226] Updated weights for policy 0, policy_version 292838 (0.0006) [2023-12-27 21:20:00,799][106226] Updated weights for policy 0, policy_version 292848 (0.0005) [2023-12-27 21:20:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 150118400. Throughput: 0: 10039.7, 1: 10087.4. Samples: 150108528. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:01,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.721')] [2023-12-27 21:20:01,243][106225] Updated weights for policy 1, policy_version 293384 (0.0008) [2023-12-27 21:20:01,332][106225] Updated weights for policy 1, policy_version 293394 (0.0008) [2023-12-27 21:20:01,403][106225] Updated weights for policy 1, policy_version 293404 (0.0008) [2023-12-27 21:20:01,424][106226] Updated weights for policy 0, policy_version 292858 (0.0006) [2023-12-27 21:20:01,488][106226] Updated weights for policy 0, policy_version 292868 (0.0010) [2023-12-27 21:20:01,553][106226] Updated weights for policy 0, policy_version 292878 (0.0005) [2023-12-27 21:20:01,621][106226] Updated weights for policy 0, policy_version 292888 (0.0007) [2023-12-27 21:20:02,205][106225] Updated weights for policy 1, policy_version 293414 (0.0007) [2023-12-27 21:20:02,256][106225] Updated weights for policy 1, policy_version 293424 (0.0006) [2023-12-27 21:20:02,279][106226] Updated weights for policy 0, policy_version 292898 (0.0009) [2023-12-27 21:20:02,315][106225] Updated weights for policy 1, policy_version 293434 (0.0008) [2023-12-27 21:20:02,342][106226] Updated weights for policy 0, policy_version 292908 (0.0009) [2023-12-27 21:20:02,407][106226] Updated weights for policy 0, policy_version 292918 (0.0008) [2023-12-27 21:20:03,027][106226] Updated weights for policy 0, policy_version 292928 (0.0009) [2023-12-27 21:20:03,077][106226] Updated weights for policy 0, policy_version 292938 (0.0010) [2023-12-27 21:20:03,100][106225] Updated weights for policy 1, policy_version 293444 (0.0009) [2023-12-27 21:20:03,123][106226] Updated weights for policy 0, policy_version 292948 (0.0010) [2023-12-27 21:20:03,151][106225] Updated weights for policy 1, policy_version 293454 (0.0008) [2023-12-27 21:20:03,203][106225] Updated weights for policy 1, policy_version 293464 (0.0008) [2023-12-27 21:20:03,699][106226] Updated weights for policy 0, policy_version 292958 (0.0007) [2023-12-27 21:20:03,756][106226] Updated weights for policy 0, policy_version 292968 (0.0006) [2023-12-27 21:20:03,803][106226] Updated weights for policy 0, policy_version 292978 (0.0008) [2023-12-27 21:20:04,025][106225] Updated weights for policy 1, policy_version 293474 (0.0009) [2023-12-27 21:20:04,086][106225] Updated weights for policy 1, policy_version 293484 (0.0009) [2023-12-27 21:20:04,153][106225] Updated weights for policy 1, policy_version 293494 (0.0008) [2023-12-27 21:20:04,162][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000000 [2023-12-27 21:20:04,489][106226] Updated weights for policy 0, policy_version 292988 (0.0009) [2023-12-27 21:20:04,549][106226] Updated weights for policy 0, policy_version 292998 (0.0009) [2023-12-27 21:20:04,609][106226] Updated weights for policy 0, policy_version 293008 (0.0009) [2023-12-27 21:20:04,967][106225] Updated weights for policy 1, policy_version 293504 (0.0009) [2023-12-27 21:20:05,031][106225] Updated weights for policy 1, policy_version 293514 (0.0009) [2023-12-27 21:20:05,091][106225] Updated weights for policy 1, policy_version 293524 (0.0008) [2023-12-27 21:20:05,287][106226] Updated weights for policy 0, policy_version 293018 (0.0009) [2023-12-27 21:20:05,348][106226] Updated weights for policy 0, policy_version 293028 (0.0009) [2023-12-27 21:20:05,402][106226] Updated weights for policy 0, policy_version 293038 (0.0009) [2023-12-27 21:20:05,452][106226] Updated weights for policy 0, policy_version 293048 (0.0009) [2023-12-27 21:20:05,815][106225] Updated weights for policy 1, policy_version 293534 (0.0008) [2023-12-27 21:20:05,868][106225] Updated weights for policy 1, policy_version 293544 (0.0008) [2023-12-27 21:20:05,923][106225] Updated weights for policy 1, policy_version 293554 (0.0008) [2023-12-27 21:20:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 150216704. Throughput: 0: 10034.8, 1: 10065.7. Samples: 150227124. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:06,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.664')] [2023-12-27 21:20:06,183][106226] Updated weights for policy 0, policy_version 293058 (0.0010) [2023-12-27 21:20:06,245][106226] Updated weights for policy 0, policy_version 293068 (0.0009) [2023-12-27 21:20:06,309][106226] Updated weights for policy 0, policy_version 293078 (0.0008) [2023-12-27 21:20:06,658][106225] Updated weights for policy 1, policy_version 293564 (0.0008) [2023-12-27 21:20:06,716][106225] Updated weights for policy 1, policy_version 293574 (0.0009) [2023-12-27 21:20:06,771][106225] Updated weights for policy 1, policy_version 293584 (0.0010) [2023-12-27 21:20:07,058][106226] Updated weights for policy 0, policy_version 293088 (0.0006) [2023-12-27 21:20:07,110][106226] Updated weights for policy 0, policy_version 293098 (0.0007) [2023-12-27 21:20:07,180][106226] Updated weights for policy 0, policy_version 293108 (0.0005) [2023-12-27 21:20:07,521][106225] Updated weights for policy 1, policy_version 293594 (0.0009) [2023-12-27 21:20:07,583][106225] Updated weights for policy 1, policy_version 293604 (0.0005) [2023-12-27 21:20:07,634][106225] Updated weights for policy 1, policy_version 293614 (0.0005) [2023-12-27 21:20:07,687][106225] Updated weights for policy 1, policy_version 293624 (0.0005) [2023-12-27 21:20:07,864][106226] Updated weights for policy 0, policy_version 293118 (0.0010) [2023-12-27 21:20:07,926][106226] Updated weights for policy 0, policy_version 293128 (0.0007) [2023-12-27 21:20:07,989][106226] Updated weights for policy 0, policy_version 293138 (0.0010) [2023-12-27 21:20:08,225][106225] Updated weights for policy 1, policy_version 293634 (0.0009) [2023-12-27 21:20:08,283][106225] Updated weights for policy 1, policy_version 293644 (0.0005) [2023-12-27 21:20:08,355][106225] Updated weights for policy 1, policy_version 293654 (0.0006) [2023-12-27 21:20:08,651][106226] Updated weights for policy 0, policy_version 293148 (0.0011) [2023-12-27 21:20:08,713][106226] Updated weights for policy 0, policy_version 293158 (0.0011) [2023-12-27 21:20:08,772][106226] Updated weights for policy 0, policy_version 293168 (0.0010) [2023-12-27 21:20:09,001][106225] Updated weights for policy 1, policy_version 293664 (0.0010) [2023-12-27 21:20:09,057][106225] Updated weights for policy 1, policy_version 293674 (0.0010) [2023-12-27 21:20:09,117][106225] Updated weights for policy 1, policy_version 293684 (0.0010) [2023-12-27 21:20:09,512][106226] Updated weights for policy 0, policy_version 293178 (0.0008) [2023-12-27 21:20:09,575][106226] Updated weights for policy 0, policy_version 293188 (0.0006) [2023-12-27 21:20:09,628][106226] Updated weights for policy 0, policy_version 293198 (0.0008) [2023-12-27 21:20:09,687][106226] Updated weights for policy 0, policy_version 293208 (0.0008) [2023-12-27 21:20:09,805][106225] Updated weights for policy 1, policy_version 293694 (0.0010) [2023-12-27 21:20:09,874][106225] Updated weights for policy 1, policy_version 293704 (0.0008) [2023-12-27 21:20:09,941][106225] Updated weights for policy 1, policy_version 293714 (0.0008) [2023-12-27 21:20:10,464][106226] Updated weights for policy 0, policy_version 293218 (0.0008) [2023-12-27 21:20:10,522][106226] Updated weights for policy 0, policy_version 293228 (0.0008) [2023-12-27 21:20:10,579][106226] Updated weights for policy 0, policy_version 293238 (0.0006) [2023-12-27 21:20:10,660][106225] Updated weights for policy 1, policy_version 293724 (0.0007) [2023-12-27 21:20:10,722][106225] Updated weights for policy 1, policy_version 293734 (0.0009) [2023-12-27 21:20:10,784][106225] Updated weights for policy 1, policy_version 293744 (0.0009) [2023-12-27 21:20:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 150315008. Throughput: 0: 10031.4, 1: 10110.1. Samples: 150286640. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:11,175][105115] Avg episode reward: [(0, '-4.670'), (1, '-5.439')] [2023-12-27 21:20:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000293752_75218944.pth... [2023-12-27 21:20:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000292608_74924032.pth [2023-12-27 21:20:11,202][106226] Updated weights for policy 0, policy_version 293248 (0.0009) [2023-12-27 21:20:11,270][106226] Updated weights for policy 0, policy_version 293258 (0.0010) [2023-12-27 21:20:11,330][106226] Updated weights for policy 0, policy_version 293268 (0.0008) [2023-12-27 21:20:11,382][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000293272_75104256.pth... [2023-12-27 21:20:11,387][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000292088_74801152.pth [2023-12-27 21:20:11,621][106225] Updated weights for policy 1, policy_version 293754 (0.0007) [2023-12-27 21:20:11,680][106225] Updated weights for policy 1, policy_version 293764 (0.0008) [2023-12-27 21:20:11,752][106225] Updated weights for policy 1, policy_version 293774 (0.0007) [2023-12-27 21:20:11,818][106225] Updated weights for policy 1, policy_version 293784 (0.0010) [2023-12-27 21:20:11,996][106226] Updated weights for policy 0, policy_version 293278 (0.0008) [2023-12-27 21:20:12,054][106226] Updated weights for policy 0, policy_version 293288 (0.0009) [2023-12-27 21:20:12,112][106226] Updated weights for policy 0, policy_version 293298 (0.0009) [2023-12-27 21:20:12,526][106225] Updated weights for policy 1, policy_version 293794 (0.0007) [2023-12-27 21:20:12,590][106225] Updated weights for policy 1, policy_version 293804 (0.0007) [2023-12-27 21:20:12,651][106225] Updated weights for policy 1, policy_version 293814 (0.0006) [2023-12-27 21:20:12,865][106226] Updated weights for policy 0, policy_version 293308 (0.0009) [2023-12-27 21:20:12,924][106226] Updated weights for policy 0, policy_version 293318 (0.0008) [2023-12-27 21:20:12,974][106226] Updated weights for policy 0, policy_version 293328 (0.0005) [2023-12-27 21:20:13,355][106225] Updated weights for policy 1, policy_version 293824 (0.0008) [2023-12-27 21:20:13,416][106225] Updated weights for policy 1, policy_version 293834 (0.0008) [2023-12-27 21:20:13,468][106225] Updated weights for policy 1, policy_version 293844 (0.0009) [2023-12-27 21:20:13,643][106226] Updated weights for policy 0, policy_version 293338 (0.0006) [2023-12-27 21:20:13,704][106226] Updated weights for policy 0, policy_version 293348 (0.0009) [2023-12-27 21:20:13,752][106226] Updated weights for policy 0, policy_version 293358 (0.0008) [2023-12-27 21:20:13,804][106226] Updated weights for policy 0, policy_version 293368 (0.0008) [2023-12-27 21:20:14,143][106225] Updated weights for policy 1, policy_version 293854 (0.0007) [2023-12-27 21:20:14,193][106225] Updated weights for policy 1, policy_version 293864 (0.0005) [2023-12-27 21:20:14,249][106225] Updated weights for policy 1, policy_version 293874 (0.0006) [2023-12-27 21:20:14,580][106226] Updated weights for policy 0, policy_version 293378 (0.0009) [2023-12-27 21:20:14,628][106226] Updated weights for policy 0, policy_version 293388 (0.0008) [2023-12-27 21:20:14,676][106226] Updated weights for policy 0, policy_version 293398 (0.0008) [2023-12-27 21:20:14,921][106225] Updated weights for policy 1, policy_version 293884 (0.0009) [2023-12-27 21:20:14,974][106225] Updated weights for policy 1, policy_version 293894 (0.0008) [2023-12-27 21:20:15,031][106225] Updated weights for policy 1, policy_version 293904 (0.0009) [2023-12-27 21:20:15,404][106226] Updated weights for policy 0, policy_version 293408 (0.0009) [2023-12-27 21:20:15,459][106226] Updated weights for policy 0, policy_version 293418 (0.0008) [2023-12-27 21:20:15,511][106226] Updated weights for policy 0, policy_version 293428 (0.0008) [2023-12-27 21:20:15,793][106225] Updated weights for policy 1, policy_version 293914 (0.0008) [2023-12-27 21:20:15,850][106225] Updated weights for policy 1, policy_version 293924 (0.0009) [2023-12-27 21:20:15,900][106225] Updated weights for policy 1, policy_version 293934 (0.0009) [2023-12-27 21:20:15,962][106225] Updated weights for policy 1, policy_version 293944 (0.0010) [2023-12-27 21:20:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 150413312. Throughput: 0: 9995.5, 1: 9943.1. Samples: 150402724. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:16,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-5.729')] [2023-12-27 21:20:16,233][106226] Updated weights for policy 0, policy_version 293438 (0.0009) [2023-12-27 21:20:16,288][106226] Updated weights for policy 0, policy_version 293448 (0.0009) [2023-12-27 21:20:16,347][106226] Updated weights for policy 0, policy_version 293458 (0.0009) [2023-12-27 21:20:16,700][106225] Updated weights for policy 1, policy_version 293954 (0.0009) [2023-12-27 21:20:16,744][106225] Updated weights for policy 1, policy_version 293964 (0.0008) [2023-12-27 21:20:16,789][106225] Updated weights for policy 1, policy_version 293974 (0.0008) [2023-12-27 21:20:17,044][106226] Updated weights for policy 0, policy_version 293468 (0.0007) [2023-12-27 21:20:17,092][106226] Updated weights for policy 0, policy_version 293478 (0.0009) [2023-12-27 21:20:17,149][106226] Updated weights for policy 0, policy_version 293488 (0.0009) [2023-12-27 21:20:17,558][106225] Updated weights for policy 1, policy_version 293984 (0.0010) [2023-12-27 21:20:17,607][106225] Updated weights for policy 1, policy_version 293994 (0.0009) [2023-12-27 21:20:17,650][106225] Updated weights for policy 1, policy_version 294004 (0.0007) [2023-12-27 21:20:17,825][106226] Updated weights for policy 0, policy_version 293498 (0.0009) [2023-12-27 21:20:17,881][106226] Updated weights for policy 0, policy_version 293508 (0.0009) [2023-12-27 21:20:17,942][106226] Updated weights for policy 0, policy_version 293518 (0.0007) [2023-12-27 21:20:18,012][106226] Updated weights for policy 0, policy_version 293528 (0.0008) [2023-12-27 21:20:18,475][106225] Updated weights for policy 1, policy_version 294014 (0.0008) [2023-12-27 21:20:18,545][106225] Updated weights for policy 1, policy_version 294024 (0.0009) [2023-12-27 21:20:18,610][106225] Updated weights for policy 1, policy_version 294034 (0.0009) [2023-12-27 21:20:18,646][106226] Updated weights for policy 0, policy_version 293538 (0.0007) [2023-12-27 21:20:18,713][106226] Updated weights for policy 0, policy_version 293548 (0.0007) [2023-12-27 21:20:18,781][106226] Updated weights for policy 0, policy_version 293558 (0.0008) [2023-12-27 21:20:19,293][106225] Updated weights for policy 1, policy_version 294044 (0.0006) [2023-12-27 21:20:19,369][106225] Updated weights for policy 1, policy_version 294055 (0.0010) [2023-12-27 21:20:19,437][106225] Updated weights for policy 1, policy_version 294065 (0.0006) [2023-12-27 21:20:19,486][106226] Updated weights for policy 0, policy_version 293568 (0.0007) [2023-12-27 21:20:19,550][106226] Updated weights for policy 0, policy_version 293578 (0.0007) [2023-12-27 21:20:19,612][106226] Updated weights for policy 0, policy_version 293588 (0.0008) [2023-12-27 21:20:20,201][106225] Updated weights for policy 1, policy_version 294075 (0.0008) [2023-12-27 21:20:20,260][106225] Updated weights for policy 1, policy_version 294085 (0.0008) [2023-12-27 21:20:20,285][106226] Updated weights for policy 0, policy_version 293598 (0.0009) [2023-12-27 21:20:20,322][106225] Updated weights for policy 1, policy_version 294095 (0.0009) [2023-12-27 21:20:20,345][106226] Updated weights for policy 0, policy_version 293608 (0.0006) [2023-12-27 21:20:20,408][106226] Updated weights for policy 0, policy_version 293618 (0.0008) [2023-12-27 21:20:21,010][106225] Updated weights for policy 1, policy_version 294105 (0.0007) [2023-12-27 21:20:21,080][106225] Updated weights for policy 1, policy_version 294115 (0.0007) [2023-12-27 21:20:21,144][106225] Updated weights for policy 1, policy_version 294125 (0.0008) [2023-12-27 21:20:21,152][106226] Updated weights for policy 0, policy_version 293628 (0.0010) [2023-12-27 21:20:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 150503424. Throughput: 0: 9988.7, 1: 9764.1. Samples: 150518616. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:21,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.579')] [2023-12-27 21:20:21,212][106225] Updated weights for policy 1, policy_version 294135 (0.0008) [2023-12-27 21:20:21,218][106226] Updated weights for policy 0, policy_version 293638 (0.0011) [2023-12-27 21:20:21,293][106226] Updated weights for policy 0, policy_version 293648 (0.0011) [2023-12-27 21:20:22,017][106225] Updated weights for policy 1, policy_version 294145 (0.0007) [2023-12-27 21:20:22,054][106226] Updated weights for policy 0, policy_version 293658 (0.0009) [2023-12-27 21:20:22,077][106225] Updated weights for policy 1, policy_version 294155 (0.0008) [2023-12-27 21:20:22,106][106226] Updated weights for policy 0, policy_version 293668 (0.0007) [2023-12-27 21:20:22,133][106225] Updated weights for policy 1, policy_version 294165 (0.0007) [2023-12-27 21:20:22,166][106226] Updated weights for policy 0, policy_version 293678 (0.0007) [2023-12-27 21:20:22,232][106226] Updated weights for policy 0, policy_version 293688 (0.0007) [2023-12-27 21:20:22,890][106226] Updated weights for policy 0, policy_version 293698 (0.0011) [2023-12-27 21:20:22,914][106225] Updated weights for policy 1, policy_version 294175 (0.0008) [2023-12-27 21:20:22,954][106226] Updated weights for policy 0, policy_version 293708 (0.0011) [2023-12-27 21:20:22,972][106225] Updated weights for policy 1, policy_version 294185 (0.0009) [2023-12-27 21:20:23,017][106226] Updated weights for policy 0, policy_version 293718 (0.0011) [2023-12-27 21:20:23,027][106225] Updated weights for policy 1, policy_version 294195 (0.0009) [2023-12-27 21:20:23,736][106226] Updated weights for policy 0, policy_version 293728 (0.0007) [2023-12-27 21:20:23,791][106225] Updated weights for policy 1, policy_version 294205 (0.0008) [2023-12-27 21:20:23,795][106226] Updated weights for policy 0, policy_version 293738 (0.0006) [2023-12-27 21:20:23,846][106226] Updated weights for policy 0, policy_version 293748 (0.0005) [2023-12-27 21:20:23,848][106225] Updated weights for policy 1, policy_version 294215 (0.0008) [2023-12-27 21:20:23,909][106225] Updated weights for policy 1, policy_version 294225 (0.0008) [2023-12-27 21:20:24,517][106225] Updated weights for policy 1, policy_version 294235 (0.0006) [2023-12-27 21:20:24,563][106226] Updated weights for policy 0, policy_version 293758 (0.0007) [2023-12-27 21:20:24,569][106225] Updated weights for policy 1, policy_version 294245 (0.0009) [2023-12-27 21:20:24,612][106226] Updated weights for policy 0, policy_version 293768 (0.0007) [2023-12-27 21:20:24,617][106225] Updated weights for policy 1, policy_version 294255 (0.0008) [2023-12-27 21:20:24,660][106226] Updated weights for policy 0, policy_version 293778 (0.0006) [2023-12-27 21:20:25,337][106225] Updated weights for policy 1, policy_version 294265 (0.0006) [2023-12-27 21:20:25,391][106225] Updated weights for policy 1, policy_version 294275 (0.0008) [2023-12-27 21:20:25,401][106226] Updated weights for policy 0, policy_version 293788 (0.0008) [2023-12-27 21:20:25,445][106225] Updated weights for policy 1, policy_version 294285 (0.0006) [2023-12-27 21:20:25,460][106226] Updated weights for policy 0, policy_version 293798 (0.0007) [2023-12-27 21:20:25,502][106225] Updated weights for policy 1, policy_version 294295 (0.0007) [2023-12-27 21:20:25,512][106226] Updated weights for policy 0, policy_version 293808 (0.0005) [2023-12-27 21:20:26,094][106226] Updated weights for policy 0, policy_version 293818 (0.0006) [2023-12-27 21:20:26,147][106226] Updated weights for policy 0, policy_version 293828 (0.0009) [2023-12-27 21:20:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 150601728. Throughput: 0: 9987.5, 1: 9691.0. Samples: 150574504. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:26,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.851')] [2023-12-27 21:20:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000294296_75358208.pth... [2023-12-27 21:20:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000293184_75071488.pth [2023-12-27 21:20:26,200][106226] Updated weights for policy 0, policy_version 293838 (0.0009) [2023-12-27 21:20:26,248][106226] Updated weights for policy 0, policy_version 293848 (0.0008) [2023-12-27 21:20:26,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000293848_75251712.pth... [2023-12-27 21:20:26,251][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000292664_74948608.pth [2023-12-27 21:20:26,299][106225] Updated weights for policy 1, policy_version 294305 (0.0009) [2023-12-27 21:20:26,364][106225] Updated weights for policy 1, policy_version 294315 (0.0008) [2023-12-27 21:20:26,427][106225] Updated weights for policy 1, policy_version 294325 (0.0008) [2023-12-27 21:20:26,956][106226] Updated weights for policy 0, policy_version 293858 (0.0009) [2023-12-27 21:20:27,008][106226] Updated weights for policy 0, policy_version 293868 (0.0009) [2023-12-27 21:20:27,070][106226] Updated weights for policy 0, policy_version 293878 (0.0009) [2023-12-27 21:20:27,144][106225] Updated weights for policy 1, policy_version 294335 (0.0008) [2023-12-27 21:20:27,193][106225] Updated weights for policy 1, policy_version 294345 (0.0009) [2023-12-27 21:20:27,249][106225] Updated weights for policy 1, policy_version 294355 (0.0009) [2023-12-27 21:20:27,670][106226] Updated weights for policy 0, policy_version 293888 (0.0006) [2023-12-27 21:20:27,729][106226] Updated weights for policy 0, policy_version 293898 (0.0005) [2023-12-27 21:20:27,789][106226] Updated weights for policy 0, policy_version 293908 (0.0006) [2023-12-27 21:20:28,077][106225] Updated weights for policy 1, policy_version 294365 (0.0007) [2023-12-27 21:20:28,127][106225] Updated weights for policy 1, policy_version 294375 (0.0009) [2023-12-27 21:20:28,178][106225] Updated weights for policy 1, policy_version 294385 (0.0008) [2023-12-27 21:20:28,428][106226] Updated weights for policy 0, policy_version 293918 (0.0007) [2023-12-27 21:20:28,490][106226] Updated weights for policy 0, policy_version 293928 (0.0009) [2023-12-27 21:20:28,548][106226] Updated weights for policy 0, policy_version 293938 (0.0008) [2023-12-27 21:20:28,899][106225] Updated weights for policy 1, policy_version 294395 (0.0009) [2023-12-27 21:20:28,963][106225] Updated weights for policy 1, policy_version 294405 (0.0009) [2023-12-27 21:20:29,012][106225] Updated weights for policy 1, policy_version 294415 (0.0009) [2023-12-27 21:20:29,181][106226] Updated weights for policy 0, policy_version 293948 (0.0008) [2023-12-27 21:20:29,253][106226] Updated weights for policy 0, policy_version 293958 (0.0008) [2023-12-27 21:20:29,310][106226] Updated weights for policy 0, policy_version 293968 (0.0010) [2023-12-27 21:20:29,645][106225] Updated weights for policy 1, policy_version 294425 (0.0007) [2023-12-27 21:20:29,709][106225] Updated weights for policy 1, policy_version 294435 (0.0010) [2023-12-27 21:20:29,769][106225] Updated weights for policy 1, policy_version 294445 (0.0010) [2023-12-27 21:20:29,837][106225] Updated weights for policy 1, policy_version 294455 (0.0010) [2023-12-27 21:20:30,006][106226] Updated weights for policy 0, policy_version 293978 (0.0010) [2023-12-27 21:20:30,067][106226] Updated weights for policy 0, policy_version 293988 (0.0010) [2023-12-27 21:20:30,128][106226] Updated weights for policy 0, policy_version 293998 (0.0011) [2023-12-27 21:20:30,189][106226] Updated weights for policy 0, policy_version 294008 (0.0010) [2023-12-27 21:20:30,472][106225] Updated weights for policy 1, policy_version 294465 (0.0008) [2023-12-27 21:20:30,517][106225] Updated weights for policy 1, policy_version 294475 (0.0007) [2023-12-27 21:20:30,562][106225] Updated weights for policy 1, policy_version 294485 (0.0007) [2023-12-27 21:20:30,870][106226] Updated weights for policy 0, policy_version 294018 (0.0005) [2023-12-27 21:20:30,924][106226] Updated weights for policy 0, policy_version 294028 (0.0006) [2023-12-27 21:20:30,970][106226] Updated weights for policy 0, policy_version 294038 (0.0010) [2023-12-27 21:20:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 150708224. Throughput: 0: 10034.2, 1: 9676.9. Samples: 150695964. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:31,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.543')] [2023-12-27 21:20:31,334][106225] Updated weights for policy 1, policy_version 294495 (0.0008) [2023-12-27 21:20:31,396][106225] Updated weights for policy 1, policy_version 294505 (0.0007) [2023-12-27 21:20:31,446][106225] Updated weights for policy 1, policy_version 294515 (0.0008) [2023-12-27 21:20:31,681][106226] Updated weights for policy 0, policy_version 294048 (0.0009) [2023-12-27 21:20:31,748][106226] Updated weights for policy 0, policy_version 294058 (0.0009) [2023-12-27 21:20:31,807][106226] Updated weights for policy 0, policy_version 294068 (0.0008) [2023-12-27 21:20:32,193][106225] Updated weights for policy 1, policy_version 294525 (0.0006) [2023-12-27 21:20:32,263][106225] Updated weights for policy 1, policy_version 294535 (0.0006) [2023-12-27 21:20:32,331][106225] Updated weights for policy 1, policy_version 294545 (0.0006) [2023-12-27 21:20:32,553][106226] Updated weights for policy 0, policy_version 294078 (0.0007) [2023-12-27 21:20:32,607][106226] Updated weights for policy 0, policy_version 294088 (0.0005) [2023-12-27 21:20:32,660][106226] Updated weights for policy 0, policy_version 294098 (0.0005) [2023-12-27 21:20:33,045][106225] Updated weights for policy 1, policy_version 294555 (0.0008) [2023-12-27 21:20:33,094][106225] Updated weights for policy 1, policy_version 294565 (0.0008) [2023-12-27 21:20:33,152][106225] Updated weights for policy 1, policy_version 294575 (0.0008) [2023-12-27 21:20:33,271][106226] Updated weights for policy 0, policy_version 294108 (0.0007) [2023-12-27 21:20:33,322][106226] Updated weights for policy 0, policy_version 294118 (0.0010) [2023-12-27 21:20:33,374][106226] Updated weights for policy 0, policy_version 294128 (0.0010) [2023-12-27 21:20:33,791][106225] Updated weights for policy 1, policy_version 294585 (0.0007) [2023-12-27 21:20:33,848][106225] Updated weights for policy 1, policy_version 294595 (0.0005) [2023-12-27 21:20:33,896][106225] Updated weights for policy 1, policy_version 294605 (0.0005) [2023-12-27 21:20:33,944][106225] Updated weights for policy 1, policy_version 294615 (0.0007) [2023-12-27 21:20:34,079][106226] Updated weights for policy 0, policy_version 294138 (0.0009) [2023-12-27 21:20:34,144][106226] Updated weights for policy 0, policy_version 294148 (0.0009) [2023-12-27 21:20:34,209][106226] Updated weights for policy 0, policy_version 294158 (0.0011) [2023-12-27 21:20:34,275][106226] Updated weights for policy 0, policy_version 294168 (0.0010) [2023-12-27 21:20:34,537][106225] Updated weights for policy 1, policy_version 294625 (0.0006) [2023-12-27 21:20:34,596][106225] Updated weights for policy 1, policy_version 294635 (0.0006) [2023-12-27 21:20:34,650][106225] Updated weights for policy 1, policy_version 294645 (0.0007) [2023-12-27 21:20:34,961][106226] Updated weights for policy 0, policy_version 294178 (0.0011) [2023-12-27 21:20:35,028][106226] Updated weights for policy 0, policy_version 294188 (0.0010) [2023-12-27 21:20:35,091][106226] Updated weights for policy 0, policy_version 294198 (0.0010) [2023-12-27 21:20:35,233][106225] Updated weights for policy 1, policy_version 294655 (0.0006) [2023-12-27 21:20:35,287][106225] Updated weights for policy 1, policy_version 294665 (0.0008) [2023-12-27 21:20:35,342][106225] Updated weights for policy 1, policy_version 294675 (0.0006) [2023-12-27 21:20:35,741][106226] Updated weights for policy 0, policy_version 294208 (0.0011) [2023-12-27 21:20:35,797][106226] Updated weights for policy 0, policy_version 294218 (0.0010) [2023-12-27 21:20:35,864][106226] Updated weights for policy 0, policy_version 294228 (0.0007) [2023-12-27 21:20:35,992][106225] Updated weights for policy 1, policy_version 294685 (0.0006) [2023-12-27 21:20:36,044][106225] Updated weights for policy 1, policy_version 294695 (0.0005) [2023-12-27 21:20:36,091][106225] Updated weights for policy 1, policy_version 294705 (0.0006) [2023-12-27 21:20:36,174][105115] Fps is (10 sec: 21299.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 150814720. Throughput: 0: 10046.1, 1: 9725.1. Samples: 150818672. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-27 21:20:36,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.836')] [2023-12-27 21:20:36,443][106226] Updated weights for policy 0, policy_version 294238 (0.0007) [2023-12-27 21:20:36,512][106226] Updated weights for policy 0, policy_version 294248 (0.0006) [2023-12-27 21:20:36,582][106226] Updated weights for policy 0, policy_version 294258 (0.0009) [2023-12-27 21:20:36,796][106225] Updated weights for policy 1, policy_version 294715 (0.0008) [2023-12-27 21:20:36,860][106225] Updated weights for policy 1, policy_version 294725 (0.0005) [2023-12-27 21:20:36,913][106225] Updated weights for policy 1, policy_version 294735 (0.0006) [2023-12-27 21:20:37,221][106226] Updated weights for policy 0, policy_version 294268 (0.0010) [2023-12-27 21:20:37,279][106226] Updated weights for policy 0, policy_version 294278 (0.0009) [2023-12-27 21:20:37,343][106226] Updated weights for policy 0, policy_version 294288 (0.0009) [2023-12-27 21:20:37,580][106225] Updated weights for policy 1, policy_version 294745 (0.0007) [2023-12-27 21:20:37,649][106225] Updated weights for policy 1, policy_version 294755 (0.0009) [2023-12-27 21:20:37,712][106225] Updated weights for policy 1, policy_version 294765 (0.0009) [2023-12-27 21:20:37,779][106225] Updated weights for policy 1, policy_version 294775 (0.0009) [2023-12-27 21:20:37,948][106226] Updated weights for policy 0, policy_version 294298 (0.0006) [2023-12-27 21:20:38,001][106226] Updated weights for policy 0, policy_version 294308 (0.0006) [2023-12-27 21:20:38,065][106226] Updated weights for policy 0, policy_version 294318 (0.0007) [2023-12-27 21:20:38,127][106226] Updated weights for policy 0, policy_version 294328 (0.0009) [2023-12-27 21:20:38,440][106225] Updated weights for policy 1, policy_version 294785 (0.0006) [2023-12-27 21:20:38,503][106225] Updated weights for policy 1, policy_version 294795 (0.0005) [2023-12-27 21:20:38,565][106225] Updated weights for policy 1, policy_version 294805 (0.0008) [2023-12-27 21:20:38,925][106226] Updated weights for policy 0, policy_version 294338 (0.0006) [2023-12-27 21:20:38,976][106226] Updated weights for policy 0, policy_version 294348 (0.0007) [2023-12-27 21:20:39,030][106226] Updated weights for policy 0, policy_version 294358 (0.0008) [2023-12-27 21:20:39,272][106225] Updated weights for policy 1, policy_version 294815 (0.0009) [2023-12-27 21:20:39,333][106225] Updated weights for policy 1, policy_version 294825 (0.0009) [2023-12-27 21:20:39,403][106225] Updated weights for policy 1, policy_version 294835 (0.0009) [2023-12-27 21:20:39,759][106226] Updated weights for policy 0, policy_version 294368 (0.0008) [2023-12-27 21:20:39,822][106226] Updated weights for policy 0, policy_version 294378 (0.0008) [2023-12-27 21:20:39,889][106226] Updated weights for policy 0, policy_version 294388 (0.0010) [2023-12-27 21:20:40,227][106225] Updated weights for policy 1, policy_version 294845 (0.0009) [2023-12-27 21:20:40,286][106225] Updated weights for policy 1, policy_version 294855 (0.0008) [2023-12-27 21:20:40,346][106225] Updated weights for policy 1, policy_version 294865 (0.0009) [2023-12-27 21:20:40,603][106226] Updated weights for policy 0, policy_version 294398 (0.0009) [2023-12-27 21:20:40,662][106226] Updated weights for policy 0, policy_version 294408 (0.0008) [2023-12-27 21:20:40,726][106226] Updated weights for policy 0, policy_version 294418 (0.0009) [2023-12-27 21:20:40,936][106225] Updated weights for policy 1, policy_version 294875 (0.0006) [2023-12-27 21:20:40,991][106225] Updated weights for policy 1, policy_version 294885 (0.0006) [2023-12-27 21:20:41,054][106225] Updated weights for policy 1, policy_version 294895 (0.0007) [2023-12-27 21:20:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 150913024. Throughput: 0: 10067.8, 1: 9776.7. Samples: 150879900. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:20:41,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-5.483')] [2023-12-27 21:20:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000294904_75513856.pth... [2023-12-27 21:20:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000294424_75399168.pth... [2023-12-27 21:20:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000293272_75104256.pth [2023-12-27 21:20:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000293752_75218944.pth [2023-12-27 21:20:41,438][106226] Updated weights for policy 0, policy_version 294428 (0.0007) [2023-12-27 21:20:41,502][106226] Updated weights for policy 0, policy_version 294438 (0.0009) [2023-12-27 21:20:41,573][106226] Updated weights for policy 0, policy_version 294448 (0.0008) [2023-12-27 21:20:41,788][106225] Updated weights for policy 1, policy_version 294905 (0.0007) [2023-12-27 21:20:41,851][106225] Updated weights for policy 1, policy_version 294915 (0.0009) [2023-12-27 21:20:41,916][106225] Updated weights for policy 1, policy_version 294925 (0.0010) [2023-12-27 21:20:41,974][106225] Updated weights for policy 1, policy_version 294935 (0.0008) [2023-12-27 21:20:42,327][106226] Updated weights for policy 0, policy_version 294458 (0.0009) [2023-12-27 21:20:42,399][106226] Updated weights for policy 0, policy_version 294468 (0.0008) [2023-12-27 21:20:42,460][106226] Updated weights for policy 0, policy_version 294478 (0.0008) [2023-12-27 21:20:42,527][106226] Updated weights for policy 0, policy_version 294488 (0.0009) [2023-12-27 21:20:42,714][106225] Updated weights for policy 1, policy_version 294945 (0.0007) [2023-12-27 21:20:42,775][106225] Updated weights for policy 1, policy_version 294955 (0.0006) [2023-12-27 21:20:42,845][106225] Updated weights for policy 1, policy_version 294965 (0.0005) [2023-12-27 21:20:43,255][106226] Updated weights for policy 0, policy_version 294498 (0.0008) [2023-12-27 21:20:43,316][106226] Updated weights for policy 0, policy_version 294508 (0.0008) [2023-12-27 21:20:43,378][106226] Updated weights for policy 0, policy_version 294518 (0.0008) [2023-12-27 21:20:43,450][106225] Updated weights for policy 1, policy_version 294975 (0.0009) [2023-12-27 21:20:43,512][106225] Updated weights for policy 1, policy_version 294985 (0.0010) [2023-12-27 21:20:43,575][106225] Updated weights for policy 1, policy_version 294995 (0.0010) [2023-12-27 21:20:44,081][106226] Updated weights for policy 0, policy_version 294528 (0.0010) [2023-12-27 21:20:44,130][106226] Updated weights for policy 0, policy_version 294538 (0.0008) [2023-12-27 21:20:44,188][106226] Updated weights for policy 0, policy_version 294548 (0.0005) [2023-12-27 21:20:44,288][106225] Updated weights for policy 1, policy_version 295005 (0.0010) [2023-12-27 21:20:44,353][106225] Updated weights for policy 1, policy_version 295015 (0.0009) [2023-12-27 21:20:44,414][106225] Updated weights for policy 1, policy_version 295025 (0.0005) [2023-12-27 21:20:44,767][106226] Updated weights for policy 0, policy_version 294558 (0.0006) [2023-12-27 21:20:44,835][106226] Updated weights for policy 0, policy_version 294568 (0.0008) [2023-12-27 21:20:44,901][106226] Updated weights for policy 0, policy_version 294578 (0.0008) [2023-12-27 21:20:45,061][106225] Updated weights for policy 1, policy_version 295035 (0.0007) [2023-12-27 21:20:45,124][106225] Updated weights for policy 1, policy_version 295045 (0.0005) [2023-12-27 21:20:45,189][106225] Updated weights for policy 1, policy_version 295055 (0.0010) [2023-12-27 21:20:45,568][106226] Updated weights for policy 0, policy_version 294588 (0.0008) [2023-12-27 21:20:45,626][106226] Updated weights for policy 0, policy_version 294598 (0.0008) [2023-12-27 21:20:45,674][106226] Updated weights for policy 0, policy_version 294608 (0.0008) [2023-12-27 21:20:45,887][106225] Updated weights for policy 1, policy_version 295065 (0.0011) [2023-12-27 21:20:45,946][106225] Updated weights for policy 1, policy_version 295075 (0.0010) [2023-12-27 21:20:45,999][106225] Updated weights for policy 1, policy_version 295085 (0.0010) [2023-12-27 21:20:46,057][106225] Updated weights for policy 1, policy_version 295095 (0.0010) [2023-12-27 21:20:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 151011328. Throughput: 0: 10018.6, 1: 9723.1. Samples: 150996908. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:20:46,176][105115] Avg episode reward: [(0, '-4.569'), (1, '-5.626')] [2023-12-27 21:20:46,416][106226] Updated weights for policy 0, policy_version 294618 (0.0007) [2023-12-27 21:20:46,476][106226] Updated weights for policy 0, policy_version 294628 (0.0007) [2023-12-27 21:20:46,533][106226] Updated weights for policy 0, policy_version 294638 (0.0008) [2023-12-27 21:20:46,582][106226] Updated weights for policy 0, policy_version 294648 (0.0008) [2023-12-27 21:20:46,758][106225] Updated weights for policy 1, policy_version 295105 (0.0010) [2023-12-27 21:20:46,801][106225] Updated weights for policy 1, policy_version 295115 (0.0010) [2023-12-27 21:20:46,863][106225] Updated weights for policy 1, policy_version 295125 (0.0010) [2023-12-27 21:20:47,300][106226] Updated weights for policy 0, policy_version 294658 (0.0005) [2023-12-27 21:20:47,367][106226] Updated weights for policy 0, policy_version 294668 (0.0005) [2023-12-27 21:20:47,439][106226] Updated weights for policy 0, policy_version 294678 (0.0005) [2023-12-27 21:20:47,565][106225] Updated weights for policy 1, policy_version 295135 (0.0009) [2023-12-27 21:20:47,622][106225] Updated weights for policy 1, policy_version 295145 (0.0008) [2023-12-27 21:20:47,690][106225] Updated weights for policy 1, policy_version 295155 (0.0009) [2023-12-27 21:20:48,031][106226] Updated weights for policy 0, policy_version 294688 (0.0008) [2023-12-27 21:20:48,086][106226] Updated weights for policy 0, policy_version 294698 (0.0009) [2023-12-27 21:20:48,137][106226] Updated weights for policy 0, policy_version 294708 (0.0009) [2023-12-27 21:20:48,350][106225] Updated weights for policy 1, policy_version 295165 (0.0009) [2023-12-27 21:20:48,418][106225] Updated weights for policy 1, policy_version 295175 (0.0007) [2023-12-27 21:20:48,479][106225] Updated weights for policy 1, policy_version 295185 (0.0008) [2023-12-27 21:20:48,917][106226] Updated weights for policy 0, policy_version 294718 (0.0009) [2023-12-27 21:20:48,972][106226] Updated weights for policy 0, policy_version 294728 (0.0009) [2023-12-27 21:20:49,022][106226] Updated weights for policy 0, policy_version 294739 (0.0009) [2023-12-27 21:20:49,125][106225] Updated weights for policy 1, policy_version 295195 (0.0007) [2023-12-27 21:20:49,184][106225] Updated weights for policy 1, policy_version 295205 (0.0005) [2023-12-27 21:20:49,247][106225] Updated weights for policy 1, policy_version 295215 (0.0007) [2023-12-27 21:20:49,800][106226] Updated weights for policy 0, policy_version 294749 (0.0007) [2023-12-27 21:20:49,871][106226] Updated weights for policy 0, policy_version 294759 (0.0008) [2023-12-27 21:20:49,954][106226] Updated weights for policy 0, policy_version 294769 (0.0008) [2023-12-27 21:20:49,970][106225] Updated weights for policy 1, policy_version 295225 (0.0008) [2023-12-27 21:20:50,039][106225] Updated weights for policy 1, policy_version 295235 (0.0006) [2023-12-27 21:20:50,102][106225] Updated weights for policy 1, policy_version 295245 (0.0006) [2023-12-27 21:20:50,161][106225] Updated weights for policy 1, policy_version 295255 (0.0005) [2023-12-27 21:20:50,710][106225] Updated weights for policy 1, policy_version 295265 (0.0007) [2023-12-27 21:20:50,725][106226] Updated weights for policy 0, policy_version 294779 (0.0006) [2023-12-27 21:20:50,768][106225] Updated weights for policy 1, policy_version 295275 (0.0006) [2023-12-27 21:20:50,788][106226] Updated weights for policy 0, policy_version 294789 (0.0007) [2023-12-27 21:20:50,825][106225] Updated weights for policy 1, policy_version 295285 (0.0008) [2023-12-27 21:20:50,848][106226] Updated weights for policy 0, policy_version 294799 (0.0006) [2023-12-27 21:20:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 151109632. Throughput: 0: 9902.6, 1: 9852.1. Samples: 151116088. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:20:51,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.621')] [2023-12-27 21:20:51,527][106225] Updated weights for policy 1, policy_version 295295 (0.0007) [2023-12-27 21:20:51,587][106225] Updated weights for policy 1, policy_version 295305 (0.0006) [2023-12-27 21:20:51,647][106226] Updated weights for policy 0, policy_version 294809 (0.0009) [2023-12-27 21:20:51,653][106225] Updated weights for policy 1, policy_version 295315 (0.0008) [2023-12-27 21:20:51,713][106226] Updated weights for policy 0, policy_version 294819 (0.0008) [2023-12-27 21:20:51,780][106226] Updated weights for policy 0, policy_version 294829 (0.0008) [2023-12-27 21:20:51,835][106226] Updated weights for policy 0, policy_version 294839 (0.0008) [2023-12-27 21:20:52,408][106225] Updated weights for policy 1, policy_version 295325 (0.0007) [2023-12-27 21:20:52,463][106225] Updated weights for policy 1, policy_version 295335 (0.0008) [2023-12-27 21:20:52,521][106225] Updated weights for policy 1, policy_version 295345 (0.0008) [2023-12-27 21:20:52,612][106226] Updated weights for policy 0, policy_version 294849 (0.0008) [2023-12-27 21:20:52,666][106226] Updated weights for policy 0, policy_version 294859 (0.0008) [2023-12-27 21:20:52,731][106226] Updated weights for policy 0, policy_version 294869 (0.0008) [2023-12-27 21:20:53,276][106225] Updated weights for policy 1, policy_version 295355 (0.0008) [2023-12-27 21:20:53,331][106225] Updated weights for policy 1, policy_version 295365 (0.0008) [2023-12-27 21:20:53,398][106225] Updated weights for policy 1, policy_version 295375 (0.0009) [2023-12-27 21:20:53,452][106226] Updated weights for policy 0, policy_version 294879 (0.0006) [2023-12-27 21:20:53,507][106226] Updated weights for policy 0, policy_version 294889 (0.0005) [2023-12-27 21:20:53,562][106226] Updated weights for policy 0, policy_version 294899 (0.0007) [2023-12-27 21:20:54,120][106225] Updated weights for policy 1, policy_version 295385 (0.0008) [2023-12-27 21:20:54,183][106225] Updated weights for policy 1, policy_version 295395 (0.0008) [2023-12-27 21:20:54,249][106225] Updated weights for policy 1, policy_version 295405 (0.0008) [2023-12-27 21:20:54,255][106226] Updated weights for policy 0, policy_version 294909 (0.0009) [2023-12-27 21:20:54,309][106226] Updated weights for policy 0, policy_version 294919 (0.0006) [2023-12-27 21:20:54,312][106225] Updated weights for policy 1, policy_version 295415 (0.0008) [2023-12-27 21:20:54,374][106226] Updated weights for policy 0, policy_version 294929 (0.0008) [2023-12-27 21:20:55,039][106225] Updated weights for policy 1, policy_version 295425 (0.0006) [2023-12-27 21:20:55,049][106226] Updated weights for policy 0, policy_version 294939 (0.0009) [2023-12-27 21:20:55,089][106225] Updated weights for policy 1, policy_version 295435 (0.0008) [2023-12-27 21:20:55,107][106226] Updated weights for policy 0, policy_version 294949 (0.0008) [2023-12-27 21:20:55,137][106225] Updated weights for policy 1, policy_version 295445 (0.0009) [2023-12-27 21:20:55,164][106226] Updated weights for policy 0, policy_version 294959 (0.0005) [2023-12-27 21:20:55,802][106226] Updated weights for policy 0, policy_version 294969 (0.0006) [2023-12-27 21:20:55,802][106225] Updated weights for policy 1, policy_version 295455 (0.0006) [2023-12-27 21:20:55,853][106226] Updated weights for policy 0, policy_version 294979 (0.0007) [2023-12-27 21:20:55,862][106225] Updated weights for policy 1, policy_version 295465 (0.0005) [2023-12-27 21:20:55,905][106226] Updated weights for policy 0, policy_version 294989 (0.0008) [2023-12-27 21:20:55,927][106225] Updated weights for policy 1, policy_version 295475 (0.0006) [2023-12-27 21:20:55,961][106226] Updated weights for policy 0, policy_version 294999 (0.0007) [2023-12-27 21:20:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 151207936. Throughput: 0: 9879.5, 1: 9801.4. Samples: 151172280. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:20:56,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.486')] [2023-12-27 21:20:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000295000_75546624.pth... [2023-12-27 21:20:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000295480_75661312.pth... [2023-12-27 21:20:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000293848_75251712.pth [2023-12-27 21:20:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000294296_75358208.pth [2023-12-27 21:20:56,568][106226] Updated weights for policy 0, policy_version 295009 (0.0005) [2023-12-27 21:20:56,621][106226] Updated weights for policy 0, policy_version 295019 (0.0009) [2023-12-27 21:20:56,662][106225] Updated weights for policy 1, policy_version 295485 (0.0007) [2023-12-27 21:20:56,686][106226] Updated weights for policy 0, policy_version 295029 (0.0010) [2023-12-27 21:20:56,726][106225] Updated weights for policy 1, policy_version 295495 (0.0006) [2023-12-27 21:20:56,784][106225] Updated weights for policy 1, policy_version 295505 (0.0008) [2023-12-27 21:20:57,284][106226] Updated weights for policy 0, policy_version 295039 (0.0010) [2023-12-27 21:20:57,334][106226] Updated weights for policy 0, policy_version 295049 (0.0010) [2023-12-27 21:20:57,386][106226] Updated weights for policy 0, policy_version 295059 (0.0010) [2023-12-27 21:20:57,495][106225] Updated weights for policy 1, policy_version 295515 (0.0007) [2023-12-27 21:20:57,549][106225] Updated weights for policy 1, policy_version 295525 (0.0007) [2023-12-27 21:20:57,605][106225] Updated weights for policy 1, policy_version 295535 (0.0007) [2023-12-27 21:20:58,088][106226] Updated weights for policy 0, policy_version 295069 (0.0010) [2023-12-27 21:20:58,148][106226] Updated weights for policy 0, policy_version 295079 (0.0010) [2023-12-27 21:20:58,212][106226] Updated weights for policy 0, policy_version 295089 (0.0010) [2023-12-27 21:20:58,407][106225] Updated weights for policy 1, policy_version 295545 (0.0008) [2023-12-27 21:20:58,472][106225] Updated weights for policy 1, policy_version 295555 (0.0007) [2023-12-27 21:20:58,537][106225] Updated weights for policy 1, policy_version 295565 (0.0007) [2023-12-27 21:20:58,609][106225] Updated weights for policy 1, policy_version 295575 (0.0008) [2023-12-27 21:20:59,076][106226] Updated weights for policy 0, policy_version 295099 (0.0010) [2023-12-27 21:20:59,133][106226] Updated weights for policy 0, policy_version 295109 (0.0011) [2023-12-27 21:20:59,197][106226] Updated weights for policy 0, policy_version 295119 (0.0011) [2023-12-27 21:20:59,402][106225] Updated weights for policy 1, policy_version 295585 (0.0008) [2023-12-27 21:20:59,457][106225] Updated weights for policy 1, policy_version 295595 (0.0008) [2023-12-27 21:20:59,523][106225] Updated weights for policy 1, policy_version 295605 (0.0009) [2023-12-27 21:20:59,978][106226] Updated weights for policy 0, policy_version 295130 (0.0010) [2023-12-27 21:21:00,031][106226] Updated weights for policy 0, policy_version 295140 (0.0008) [2023-12-27 21:21:00,079][106226] Updated weights for policy 0, policy_version 295150 (0.0008) [2023-12-27 21:21:00,128][106226] Updated weights for policy 0, policy_version 295160 (0.0008) [2023-12-27 21:21:00,215][106225] Updated weights for policy 1, policy_version 295615 (0.0009) [2023-12-27 21:21:00,263][106225] Updated weights for policy 1, policy_version 295625 (0.0008) [2023-12-27 21:21:00,311][106225] Updated weights for policy 1, policy_version 295635 (0.0008) [2023-12-27 21:21:00,869][106226] Updated weights for policy 0, policy_version 295170 (0.0010) [2023-12-27 21:21:00,924][106226] Updated weights for policy 0, policy_version 295180 (0.0010) [2023-12-27 21:21:00,973][106226] Updated weights for policy 0, policy_version 295190 (0.0010) [2023-12-27 21:21:01,067][106225] Updated weights for policy 1, policy_version 295645 (0.0008) [2023-12-27 21:21:01,130][106225] Updated weights for policy 1, policy_version 295656 (0.0009) [2023-12-27 21:21:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 151298048. Throughput: 0: 9923.0, 1: 9776.7. Samples: 151289212. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:01,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-5.215')] [2023-12-27 21:21:01,192][106225] Updated weights for policy 1, policy_version 295666 (0.0009) [2023-12-27 21:21:01,219][106141] Saving new best policy, reward=-5.215! [2023-12-27 21:21:01,611][106226] Updated weights for policy 0, policy_version 295200 (0.0010) [2023-12-27 21:21:01,673][106226] Updated weights for policy 0, policy_version 295210 (0.0011) [2023-12-27 21:21:01,741][106226] Updated weights for policy 0, policy_version 295220 (0.0010) [2023-12-27 21:21:02,010][106225] Updated weights for policy 1, policy_version 295676 (0.0008) [2023-12-27 21:21:02,058][106225] Updated weights for policy 1, policy_version 295686 (0.0008) [2023-12-27 21:21:02,103][106225] Updated weights for policy 1, policy_version 295696 (0.0008) [2023-12-27 21:21:02,496][106226] Updated weights for policy 0, policy_version 295230 (0.0009) [2023-12-27 21:21:02,552][106226] Updated weights for policy 0, policy_version 295240 (0.0008) [2023-12-27 21:21:02,611][106226] Updated weights for policy 0, policy_version 295250 (0.0009) [2023-12-27 21:21:02,827][106225] Updated weights for policy 1, policy_version 295706 (0.0008) [2023-12-27 21:21:02,887][106225] Updated weights for policy 1, policy_version 295716 (0.0009) [2023-12-27 21:21:02,947][106225] Updated weights for policy 1, policy_version 295726 (0.0009) [2023-12-27 21:21:03,014][106225] Updated weights for policy 1, policy_version 295736 (0.0009) [2023-12-27 21:21:03,267][106226] Updated weights for policy 0, policy_version 295260 (0.0008) [2023-12-27 21:21:03,325][106226] Updated weights for policy 0, policy_version 295270 (0.0008) [2023-12-27 21:21:03,380][106226] Updated weights for policy 0, policy_version 295280 (0.0005) [2023-12-27 21:21:03,771][106225] Updated weights for policy 1, policy_version 295746 (0.0008) [2023-12-27 21:21:03,825][106225] Updated weights for policy 1, policy_version 295756 (0.0008) [2023-12-27 21:21:03,904][106225] Updated weights for policy 1, policy_version 295766 (0.0008) [2023-12-27 21:21:04,092][106226] Updated weights for policy 0, policy_version 295290 (0.0008) [2023-12-27 21:21:04,157][106226] Updated weights for policy 0, policy_version 295300 (0.0008) [2023-12-27 21:21:04,222][106226] Updated weights for policy 0, policy_version 295310 (0.0007) [2023-12-27 21:21:04,293][106226] Updated weights for policy 0, policy_version 295320 (0.0006) [2023-12-27 21:21:04,624][106225] Updated weights for policy 1, policy_version 295776 (0.0006) [2023-12-27 21:21:04,680][106225] Updated weights for policy 1, policy_version 295786 (0.0006) [2023-12-27 21:21:04,743][106225] Updated weights for policy 1, policy_version 295796 (0.0006) [2023-12-27 21:21:05,004][106226] Updated weights for policy 0, policy_version 295330 (0.0009) [2023-12-27 21:21:05,061][106226] Updated weights for policy 0, policy_version 295340 (0.0008) [2023-12-27 21:21:05,123][106226] Updated weights for policy 0, policy_version 295350 (0.0009) [2023-12-27 21:21:05,348][106225] Updated weights for policy 1, policy_version 295806 (0.0009) [2023-12-27 21:21:05,406][106225] Updated weights for policy 1, policy_version 295816 (0.0008) [2023-12-27 21:21:05,462][106225] Updated weights for policy 1, policy_version 295826 (0.0010) [2023-12-27 21:21:05,854][106226] Updated weights for policy 0, policy_version 295360 (0.0008) [2023-12-27 21:21:05,912][106226] Updated weights for policy 0, policy_version 295370 (0.0008) [2023-12-27 21:21:05,961][106226] Updated weights for policy 0, policy_version 295380 (0.0006) [2023-12-27 21:21:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 151396352. Throughput: 0: 9908.7, 1: 9809.3. Samples: 151405920. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:06,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.492')] [2023-12-27 21:21:06,189][106225] Updated weights for policy 1, policy_version 295836 (0.0010) [2023-12-27 21:21:06,251][106225] Updated weights for policy 1, policy_version 295846 (0.0011) [2023-12-27 21:21:06,316][106225] Updated weights for policy 1, policy_version 295856 (0.0010) [2023-12-27 21:21:06,621][106226] Updated weights for policy 0, policy_version 295390 (0.0010) [2023-12-27 21:21:06,690][106226] Updated weights for policy 0, policy_version 295400 (0.0011) [2023-12-27 21:21:06,747][106226] Updated weights for policy 0, policy_version 295410 (0.0011) [2023-12-27 21:21:07,034][106225] Updated weights for policy 1, policy_version 295866 (0.0011) [2023-12-27 21:21:07,098][106225] Updated weights for policy 1, policy_version 295876 (0.0010) [2023-12-27 21:21:07,165][106225] Updated weights for policy 1, policy_version 295886 (0.0010) [2023-12-27 21:21:07,238][106225] Updated weights for policy 1, policy_version 295896 (0.0007) [2023-12-27 21:21:07,470][106226] Updated weights for policy 0, policy_version 295420 (0.0011) [2023-12-27 21:21:07,531][106226] Updated weights for policy 0, policy_version 295430 (0.0007) [2023-12-27 21:21:07,592][106226] Updated weights for policy 0, policy_version 295440 (0.0005) [2023-12-27 21:21:07,803][106225] Updated weights for policy 1, policy_version 295906 (0.0005) [2023-12-27 21:21:07,853][106225] Updated weights for policy 1, policy_version 295916 (0.0005) [2023-12-27 21:21:07,903][106225] Updated weights for policy 1, policy_version 295926 (0.0005) [2023-12-27 21:21:08,216][106226] Updated weights for policy 0, policy_version 295450 (0.0006) [2023-12-27 21:21:08,277][106226] Updated weights for policy 0, policy_version 295460 (0.0011) [2023-12-27 21:21:08,334][106226] Updated weights for policy 0, policy_version 295470 (0.0011) [2023-12-27 21:21:08,403][106226] Updated weights for policy 0, policy_version 295480 (0.0012) [2023-12-27 21:21:08,530][106225] Updated weights for policy 1, policy_version 295936 (0.0006) [2023-12-27 21:21:08,596][106225] Updated weights for policy 1, policy_version 295946 (0.0007) [2023-12-27 21:21:08,657][106225] Updated weights for policy 1, policy_version 295956 (0.0010) [2023-12-27 21:21:09,112][106226] Updated weights for policy 0, policy_version 295490 (0.0005) [2023-12-27 21:21:09,181][106226] Updated weights for policy 0, policy_version 295500 (0.0005) [2023-12-27 21:21:09,253][106226] Updated weights for policy 0, policy_version 295510 (0.0009) [2023-12-27 21:21:09,300][106225] Updated weights for policy 1, policy_version 295966 (0.0008) [2023-12-27 21:21:09,372][106225] Updated weights for policy 1, policy_version 295976 (0.0008) [2023-12-27 21:21:09,446][106225] Updated weights for policy 1, policy_version 295986 (0.0008) [2023-12-27 21:21:09,971][106226] Updated weights for policy 0, policy_version 295520 (0.0008) [2023-12-27 21:21:10,039][106226] Updated weights for policy 0, policy_version 295530 (0.0007) [2023-12-27 21:21:10,103][106226] Updated weights for policy 0, policy_version 295540 (0.0011) [2023-12-27 21:21:10,222][106225] Updated weights for policy 1, policy_version 295996 (0.0007) [2023-12-27 21:21:10,286][106225] Updated weights for policy 1, policy_version 296006 (0.0008) [2023-12-27 21:21:10,354][106225] Updated weights for policy 1, policy_version 296016 (0.0006) [2023-12-27 21:21:10,810][106226] Updated weights for policy 0, policy_version 295550 (0.0011) [2023-12-27 21:21:10,874][106226] Updated weights for policy 0, policy_version 295560 (0.0011) [2023-12-27 21:21:10,935][106226] Updated weights for policy 0, policy_version 295570 (0.0011) [2023-12-27 21:21:10,997][106225] Updated weights for policy 1, policy_version 296026 (0.0006) [2023-12-27 21:21:11,080][106225] Updated weights for policy 1, policy_version 296036 (0.0008) [2023-12-27 21:21:11,144][106225] Updated weights for policy 1, policy_version 296046 (0.0008) [2023-12-27 21:21:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 151494656. Throughput: 0: 9949.0, 1: 9897.0. Samples: 151467572. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:11,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-5.568')] [2023-12-27 21:21:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000295576_75694080.pth... [2023-12-27 21:21:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000294424_75399168.pth [2023-12-27 21:21:11,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000296056_75808768.pth... [2023-12-27 21:21:11,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000294904_75513856.pth [2023-12-27 21:21:11,202][106225] Updated weights for policy 1, policy_version 296056 (0.0008) [2023-12-27 21:21:11,641][106226] Updated weights for policy 0, policy_version 295580 (0.0009) [2023-12-27 21:21:11,709][106226] Updated weights for policy 0, policy_version 295590 (0.0008) [2023-12-27 21:21:11,779][106226] Updated weights for policy 0, policy_version 295600 (0.0007) [2023-12-27 21:21:12,079][106225] Updated weights for policy 1, policy_version 296066 (0.0008) [2023-12-27 21:21:12,133][106225] Updated weights for policy 1, policy_version 296076 (0.0007) [2023-12-27 21:21:12,189][106225] Updated weights for policy 1, policy_version 296086 (0.0005) [2023-12-27 21:21:12,477][106226] Updated weights for policy 0, policy_version 295610 (0.0007) [2023-12-27 21:21:12,530][106226] Updated weights for policy 0, policy_version 295620 (0.0008) [2023-12-27 21:21:12,583][106226] Updated weights for policy 0, policy_version 295630 (0.0007) [2023-12-27 21:21:12,637][106226] Updated weights for policy 0, policy_version 295640 (0.0008) [2023-12-27 21:21:12,880][106225] Updated weights for policy 1, policy_version 296096 (0.0010) [2023-12-27 21:21:12,941][106225] Updated weights for policy 1, policy_version 296106 (0.0008) [2023-12-27 21:21:12,993][106225] Updated weights for policy 1, policy_version 296116 (0.0005) [2023-12-27 21:21:13,417][106226] Updated weights for policy 0, policy_version 295650 (0.0007) [2023-12-27 21:21:13,475][106226] Updated weights for policy 0, policy_version 295660 (0.0009) [2023-12-27 21:21:13,534][106226] Updated weights for policy 0, policy_version 295670 (0.0009) [2023-12-27 21:21:13,616][106225] Updated weights for policy 1, policy_version 296126 (0.0005) [2023-12-27 21:21:13,674][106225] Updated weights for policy 1, policy_version 296136 (0.0006) [2023-12-27 21:21:13,745][106225] Updated weights for policy 1, policy_version 296146 (0.0008) [2023-12-27 21:21:14,250][106226] Updated weights for policy 0, policy_version 295680 (0.0007) [2023-12-27 21:21:14,298][106226] Updated weights for policy 0, policy_version 295690 (0.0008) [2023-12-27 21:21:14,348][106226] Updated weights for policy 0, policy_version 295700 (0.0009) [2023-12-27 21:21:14,412][106225] Updated weights for policy 1, policy_version 296156 (0.0007) [2023-12-27 21:21:14,456][106225] Updated weights for policy 1, policy_version 296166 (0.0007) [2023-12-27 21:21:14,508][106225] Updated weights for policy 1, policy_version 296176 (0.0008) [2023-12-27 21:21:15,025][106226] Updated weights for policy 0, policy_version 295710 (0.0010) [2023-12-27 21:21:15,089][106226] Updated weights for policy 0, policy_version 295720 (0.0008) [2023-12-27 21:21:15,146][106226] Updated weights for policy 0, policy_version 295730 (0.0009) [2023-12-27 21:21:15,261][106225] Updated weights for policy 1, policy_version 296186 (0.0008) [2023-12-27 21:21:15,351][106225] Updated weights for policy 1, policy_version 296196 (0.0008) [2023-12-27 21:21:15,413][106225] Updated weights for policy 1, policy_version 296206 (0.0008) [2023-12-27 21:21:15,479][106225] Updated weights for policy 1, policy_version 296216 (0.0008) [2023-12-27 21:21:15,819][106226] Updated weights for policy 0, policy_version 295740 (0.0006) [2023-12-27 21:21:15,867][106226] Updated weights for policy 0, policy_version 295750 (0.0008) [2023-12-27 21:21:15,916][106226] Updated weights for policy 0, policy_version 295760 (0.0007) [2023-12-27 21:21:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 151592960. Throughput: 0: 9829.4, 1: 9888.0. Samples: 151583248. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:16,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.623')] [2023-12-27 21:21:16,195][106225] Updated weights for policy 1, policy_version 296226 (0.0008) [2023-12-27 21:21:16,248][106225] Updated weights for policy 1, policy_version 296236 (0.0008) [2023-12-27 21:21:16,295][106225] Updated weights for policy 1, policy_version 296246 (0.0007) [2023-12-27 21:21:16,595][106226] Updated weights for policy 0, policy_version 295770 (0.0006) [2023-12-27 21:21:16,640][106226] Updated weights for policy 0, policy_version 295780 (0.0008) [2023-12-27 21:21:16,688][106226] Updated weights for policy 0, policy_version 295790 (0.0008) [2023-12-27 21:21:16,737][106226] Updated weights for policy 0, policy_version 295800 (0.0006) [2023-12-27 21:21:17,052][106225] Updated weights for policy 1, policy_version 296256 (0.0008) [2023-12-27 21:21:17,114][106225] Updated weights for policy 1, policy_version 296266 (0.0008) [2023-12-27 21:21:17,179][106225] Updated weights for policy 1, policy_version 296276 (0.0009) [2023-12-27 21:21:17,424][106226] Updated weights for policy 0, policy_version 295810 (0.0005) [2023-12-27 21:21:17,472][106226] Updated weights for policy 0, policy_version 295820 (0.0005) [2023-12-27 21:21:17,517][106226] Updated weights for policy 0, policy_version 295830 (0.0005) [2023-12-27 21:21:17,916][106225] Updated weights for policy 1, policy_version 296286 (0.0008) [2023-12-27 21:21:17,983][106225] Updated weights for policy 1, policy_version 296296 (0.0006) [2023-12-27 21:21:18,039][106225] Updated weights for policy 1, policy_version 296306 (0.0008) [2023-12-27 21:21:18,135][106226] Updated weights for policy 0, policy_version 295840 (0.0008) [2023-12-27 21:21:18,193][106226] Updated weights for policy 0, policy_version 295850 (0.0008) [2023-12-27 21:21:18,251][106226] Updated weights for policy 0, policy_version 295860 (0.0008) [2023-12-27 21:21:18,859][106226] Updated weights for policy 0, policy_version 295870 (0.0007) [2023-12-27 21:21:18,867][106225] Updated weights for policy 1, policy_version 296316 (0.0008) [2023-12-27 21:21:18,915][106226] Updated weights for policy 0, policy_version 295880 (0.0006) [2023-12-27 21:21:18,935][106225] Updated weights for policy 1, policy_version 296326 (0.0008) [2023-12-27 21:21:18,972][106226] Updated weights for policy 0, policy_version 295890 (0.0008) [2023-12-27 21:21:18,990][106225] Updated weights for policy 1, policy_version 296336 (0.0006) [2023-12-27 21:21:19,681][106226] Updated weights for policy 0, policy_version 295900 (0.0007) [2023-12-27 21:21:19,711][106225] Updated weights for policy 1, policy_version 296346 (0.0007) [2023-12-27 21:21:19,749][106226] Updated weights for policy 0, policy_version 295910 (0.0009) [2023-12-27 21:21:19,772][106225] Updated weights for policy 1, policy_version 296356 (0.0007) [2023-12-27 21:21:19,810][106226] Updated weights for policy 0, policy_version 295920 (0.0008) [2023-12-27 21:21:19,838][106225] Updated weights for policy 1, policy_version 296366 (0.0007) [2023-12-27 21:21:19,903][106225] Updated weights for policy 1, policy_version 296376 (0.0009) [2023-12-27 21:21:20,572][106226] Updated weights for policy 0, policy_version 295930 (0.0008) [2023-12-27 21:21:20,640][106226] Updated weights for policy 0, policy_version 295940 (0.0007) [2023-12-27 21:21:20,684][106225] Updated weights for policy 1, policy_version 296386 (0.0008) [2023-12-27 21:21:20,706][106226] Updated weights for policy 0, policy_version 295950 (0.0008) [2023-12-27 21:21:20,743][106225] Updated weights for policy 1, policy_version 296396 (0.0008) [2023-12-27 21:21:20,768][106226] Updated weights for policy 0, policy_version 295960 (0.0008) [2023-12-27 21:21:20,801][106225] Updated weights for policy 1, policy_version 296406 (0.0008) [2023-12-27 21:21:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 151691264. Throughput: 0: 9843.1, 1: 9767.9. Samples: 151701168. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:21,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.340')] [2023-12-27 21:21:21,509][106226] Updated weights for policy 0, policy_version 295970 (0.0006) [2023-12-27 21:21:21,545][106225] Updated weights for policy 1, policy_version 296416 (0.0011) [2023-12-27 21:21:21,577][106226] Updated weights for policy 0, policy_version 295980 (0.0006) [2023-12-27 21:21:21,608][106225] Updated weights for policy 1, policy_version 296426 (0.0010) [2023-12-27 21:21:21,640][106226] Updated weights for policy 0, policy_version 295990 (0.0008) [2023-12-27 21:21:21,674][106225] Updated weights for policy 1, policy_version 296436 (0.0009) [2023-12-27 21:21:22,340][106226] Updated weights for policy 0, policy_version 296000 (0.0008) [2023-12-27 21:21:22,380][106225] Updated weights for policy 1, policy_version 296446 (0.0009) [2023-12-27 21:21:22,412][106226] Updated weights for policy 0, policy_version 296010 (0.0007) [2023-12-27 21:21:22,441][106225] Updated weights for policy 1, policy_version 296456 (0.0008) [2023-12-27 21:21:22,468][106226] Updated weights for policy 0, policy_version 296020 (0.0007) [2023-12-27 21:21:22,500][106225] Updated weights for policy 1, policy_version 296466 (0.0008) [2023-12-27 21:21:23,075][106226] Updated weights for policy 0, policy_version 296030 (0.0007) [2023-12-27 21:21:23,131][106226] Updated weights for policy 0, policy_version 296040 (0.0008) [2023-12-27 21:21:23,185][106226] Updated weights for policy 0, policy_version 296050 (0.0008) [2023-12-27 21:21:23,266][106225] Updated weights for policy 1, policy_version 296476 (0.0008) [2023-12-27 21:21:23,316][106225] Updated weights for policy 1, policy_version 296486 (0.0008) [2023-12-27 21:21:23,363][106225] Updated weights for policy 1, policy_version 296496 (0.0008) [2023-12-27 21:21:23,841][106226] Updated weights for policy 0, policy_version 296060 (0.0010) [2023-12-27 21:21:23,888][106226] Updated weights for policy 0, policy_version 296070 (0.0008) [2023-12-27 21:21:23,943][106226] Updated weights for policy 0, policy_version 296080 (0.0008) [2023-12-27 21:21:24,126][106225] Updated weights for policy 1, policy_version 296506 (0.0009) [2023-12-27 21:21:24,187][106225] Updated weights for policy 1, policy_version 296516 (0.0010) [2023-12-27 21:21:24,248][106225] Updated weights for policy 1, policy_version 296526 (0.0010) [2023-12-27 21:21:24,311][106225] Updated weights for policy 1, policy_version 296536 (0.0010) [2023-12-27 21:21:24,710][106226] Updated weights for policy 0, policy_version 296090 (0.0008) [2023-12-27 21:21:24,781][106226] Updated weights for policy 0, policy_version 296100 (0.0006) [2023-12-27 21:21:24,853][106226] Updated weights for policy 0, policy_version 296110 (0.0008) [2023-12-27 21:21:24,917][106226] Updated weights for policy 0, policy_version 296120 (0.0010) [2023-12-27 21:21:24,959][106225] Updated weights for policy 1, policy_version 296546 (0.0009) [2023-12-27 21:21:25,006][106225] Updated weights for policy 1, policy_version 296556 (0.0010) [2023-12-27 21:21:25,062][106225] Updated weights for policy 1, policy_version 296566 (0.0010) [2023-12-27 21:21:25,568][106226] Updated weights for policy 0, policy_version 296130 (0.0011) [2023-12-27 21:21:25,637][106226] Updated weights for policy 0, policy_version 296140 (0.0009) [2023-12-27 21:21:25,700][106226] Updated weights for policy 0, policy_version 296150 (0.0006) [2023-12-27 21:21:25,765][106225] Updated weights for policy 1, policy_version 296576 (0.0008) [2023-12-27 21:21:25,818][106225] Updated weights for policy 1, policy_version 296586 (0.0005) [2023-12-27 21:21:25,870][106225] Updated weights for policy 1, policy_version 296596 (0.0007) [2023-12-27 21:21:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 151789568. Throughput: 0: 9825.7, 1: 9692.8. Samples: 151758232. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:26,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.730')] [2023-12-27 21:21:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000296600_75948032.pth... [2023-12-27 21:21:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000296152_75841536.pth... [2023-12-27 21:21:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000295480_75661312.pth [2023-12-27 21:21:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000295000_75546624.pth [2023-12-27 21:21:26,448][106226] Updated weights for policy 0, policy_version 296160 (0.0009) [2023-12-27 21:21:26,495][106225] Updated weights for policy 1, policy_version 296606 (0.0009) [2023-12-27 21:21:26,501][106226] Updated weights for policy 0, policy_version 296170 (0.0010) [2023-12-27 21:21:26,554][106225] Updated weights for policy 1, policy_version 296616 (0.0006) [2023-12-27 21:21:26,560][106226] Updated weights for policy 0, policy_version 296180 (0.0011) [2023-12-27 21:21:26,605][106225] Updated weights for policy 1, policy_version 296626 (0.0007) [2023-12-27 21:21:27,169][106226] Updated weights for policy 0, policy_version 296190 (0.0010) [2023-12-27 21:21:27,219][106226] Updated weights for policy 0, policy_version 296201 (0.0008) [2023-12-27 21:21:27,271][106226] Updated weights for policy 0, policy_version 296211 (0.0008) [2023-12-27 21:21:27,303][106225] Updated weights for policy 1, policy_version 296636 (0.0007) [2023-12-27 21:21:27,368][106225] Updated weights for policy 1, policy_version 296646 (0.0006) [2023-12-27 21:21:27,433][106225] Updated weights for policy 1, policy_version 296656 (0.0005) [2023-12-27 21:21:27,974][106226] Updated weights for policy 0, policy_version 296221 (0.0007) [2023-12-27 21:21:28,031][106226] Updated weights for policy 0, policy_version 296231 (0.0005) [2023-12-27 21:21:28,090][106226] Updated weights for policy 0, policy_version 296241 (0.0005) [2023-12-27 21:21:28,098][106225] Updated weights for policy 1, policy_version 296666 (0.0006) [2023-12-27 21:21:28,154][106225] Updated weights for policy 1, policy_version 296676 (0.0008) [2023-12-27 21:21:28,209][106225] Updated weights for policy 1, policy_version 296686 (0.0008) [2023-12-27 21:21:28,265][106225] Updated weights for policy 1, policy_version 296696 (0.0008) [2023-12-27 21:21:28,713][106226] Updated weights for policy 0, policy_version 296251 (0.0007) [2023-12-27 21:21:28,777][106226] Updated weights for policy 0, policy_version 296261 (0.0010) [2023-12-27 21:21:28,842][106226] Updated weights for policy 0, policy_version 296271 (0.0009) [2023-12-27 21:21:28,990][106225] Updated weights for policy 1, policy_version 296706 (0.0009) [2023-12-27 21:21:29,048][106225] Updated weights for policy 1, policy_version 296716 (0.0009) [2023-12-27 21:21:29,120][106225] Updated weights for policy 1, policy_version 296726 (0.0008) [2023-12-27 21:21:29,543][106226] Updated weights for policy 0, policy_version 296281 (0.0011) [2023-12-27 21:21:29,603][106226] Updated weights for policy 0, policy_version 296291 (0.0011) [2023-12-27 21:21:29,663][106226] Updated weights for policy 0, policy_version 296301 (0.0010) [2023-12-27 21:21:29,723][106226] Updated weights for policy 0, policy_version 296311 (0.0011) [2023-12-27 21:21:29,851][106225] Updated weights for policy 1, policy_version 296736 (0.0007) [2023-12-27 21:21:29,913][106225] Updated weights for policy 1, policy_version 296746 (0.0008) [2023-12-27 21:21:29,979][106225] Updated weights for policy 1, policy_version 296756 (0.0008) [2023-12-27 21:21:30,390][106226] Updated weights for policy 0, policy_version 296321 (0.0010) [2023-12-27 21:21:30,442][106226] Updated weights for policy 0, policy_version 296331 (0.0010) [2023-12-27 21:21:30,488][106226] Updated weights for policy 0, policy_version 296341 (0.0010) [2023-12-27 21:21:30,693][106225] Updated weights for policy 1, policy_version 296766 (0.0006) [2023-12-27 21:21:30,739][106225] Updated weights for policy 1, policy_version 296776 (0.0005) [2023-12-27 21:21:30,797][106225] Updated weights for policy 1, policy_version 296786 (0.0005) [2023-12-27 21:21:31,127][106226] Updated weights for policy 0, policy_version 296351 (0.0007) [2023-12-27 21:21:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 151887872. Throughput: 0: 9868.7, 1: 9733.2. Samples: 151878992. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:31,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-5.760')] [2023-12-27 21:21:31,195][106226] Updated weights for policy 0, policy_version 296361 (0.0008) [2023-12-27 21:21:31,264][106226] Updated weights for policy 0, policy_version 296371 (0.0006) [2023-12-27 21:21:31,395][106225] Updated weights for policy 1, policy_version 296796 (0.0006) [2023-12-27 21:21:31,457][106225] Updated weights for policy 1, policy_version 296806 (0.0008) [2023-12-27 21:21:31,516][106225] Updated weights for policy 1, policy_version 296816 (0.0007) [2023-12-27 21:21:31,877][106226] Updated weights for policy 0, policy_version 296381 (0.0006) [2023-12-27 21:21:31,940][106226] Updated weights for policy 0, policy_version 296391 (0.0009) [2023-12-27 21:21:31,995][106226] Updated weights for policy 0, policy_version 296401 (0.0010) [2023-12-27 21:21:32,244][106225] Updated weights for policy 1, policy_version 296826 (0.0008) [2023-12-27 21:21:32,311][106225] Updated weights for policy 1, policy_version 296836 (0.0007) [2023-12-27 21:21:32,367][106225] Updated weights for policy 1, policy_version 296846 (0.0008) [2023-12-27 21:21:32,434][106225] Updated weights for policy 1, policy_version 296856 (0.0008) [2023-12-27 21:21:32,620][106226] Updated weights for policy 0, policy_version 296411 (0.0009) [2023-12-27 21:21:32,681][106226] Updated weights for policy 0, policy_version 296421 (0.0010) [2023-12-27 21:21:32,733][106226] Updated weights for policy 0, policy_version 296431 (0.0010) [2023-12-27 21:21:33,180][106225] Updated weights for policy 1, policy_version 296866 (0.0005) [2023-12-27 21:21:33,242][106225] Updated weights for policy 1, policy_version 296876 (0.0007) [2023-12-27 21:21:33,303][106225] Updated weights for policy 1, policy_version 296886 (0.0005) [2023-12-27 21:21:33,421][106226] Updated weights for policy 0, policy_version 296441 (0.0010) [2023-12-27 21:21:33,479][106226] Updated weights for policy 0, policy_version 296451 (0.0010) [2023-12-27 21:21:33,534][106226] Updated weights for policy 0, policy_version 296461 (0.0010) [2023-12-27 21:21:33,601][106226] Updated weights for policy 0, policy_version 296471 (0.0009) [2023-12-27 21:21:33,914][106225] Updated weights for policy 1, policy_version 296896 (0.0008) [2023-12-27 21:21:33,965][106225] Updated weights for policy 1, policy_version 296906 (0.0008) [2023-12-27 21:21:34,024][106225] Updated weights for policy 1, policy_version 296916 (0.0008) [2023-12-27 21:21:34,250][106226] Updated weights for policy 0, policy_version 296481 (0.0008) [2023-12-27 21:21:34,312][106226] Updated weights for policy 0, policy_version 296491 (0.0008) [2023-12-27 21:21:34,375][106226] Updated weights for policy 0, policy_version 296501 (0.0008) [2023-12-27 21:21:34,809][106225] Updated weights for policy 1, policy_version 296926 (0.0007) [2023-12-27 21:21:34,855][106225] Updated weights for policy 1, policy_version 296936 (0.0007) [2023-12-27 21:21:34,904][106225] Updated weights for policy 1, policy_version 296946 (0.0007) [2023-12-27 21:21:35,113][106226] Updated weights for policy 0, policy_version 296511 (0.0010) [2023-12-27 21:21:35,190][106226] Updated weights for policy 0, policy_version 296521 (0.0011) [2023-12-27 21:21:35,247][106226] Updated weights for policy 0, policy_version 296531 (0.0011) [2023-12-27 21:21:35,592][106225] Updated weights for policy 1, policy_version 296956 (0.0008) [2023-12-27 21:21:35,651][106225] Updated weights for policy 1, policy_version 296966 (0.0008) [2023-12-27 21:21:35,707][106225] Updated weights for policy 1, policy_version 296976 (0.0009) [2023-12-27 21:21:35,930][106226] Updated weights for policy 0, policy_version 296541 (0.0008) [2023-12-27 21:21:35,981][106226] Updated weights for policy 0, policy_version 296551 (0.0006) [2023-12-27 21:21:36,035][106226] Updated weights for policy 0, policy_version 296561 (0.0010) [2023-12-27 21:21:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 151994368. Throughput: 0: 9979.2, 1: 9677.9. Samples: 152000656. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:36,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.556')] [2023-12-27 21:21:36,382][106225] Updated weights for policy 1, policy_version 296986 (0.0010) [2023-12-27 21:21:36,447][106225] Updated weights for policy 1, policy_version 296996 (0.0008) [2023-12-27 21:21:36,512][106225] Updated weights for policy 1, policy_version 297006 (0.0008) [2023-12-27 21:21:36,576][106225] Updated weights for policy 1, policy_version 297016 (0.0011) [2023-12-27 21:21:36,764][106226] Updated weights for policy 0, policy_version 296571 (0.0010) [2023-12-27 21:21:36,828][106226] Updated weights for policy 0, policy_version 296581 (0.0009) [2023-12-27 21:21:36,899][106226] Updated weights for policy 0, policy_version 296591 (0.0006) [2023-12-27 21:21:37,137][106225] Updated weights for policy 1, policy_version 297026 (0.0008) [2023-12-27 21:21:37,209][106225] Updated weights for policy 1, policy_version 297036 (0.0006) [2023-12-27 21:21:37,271][106225] Updated weights for policy 1, policy_version 297046 (0.0005) [2023-12-27 21:21:37,475][106226] Updated weights for policy 0, policy_version 296601 (0.0006) [2023-12-27 21:21:37,532][106226] Updated weights for policy 0, policy_version 296611 (0.0010) [2023-12-27 21:21:37,596][106226] Updated weights for policy 0, policy_version 296621 (0.0011) [2023-12-27 21:21:37,646][106226] Updated weights for policy 0, policy_version 296631 (0.0011) [2023-12-27 21:21:37,858][106225] Updated weights for policy 1, policy_version 297056 (0.0009) [2023-12-27 21:21:37,921][106225] Updated weights for policy 1, policy_version 297066 (0.0010) [2023-12-27 21:21:37,984][106225] Updated weights for policy 1, policy_version 297076 (0.0010) [2023-12-27 21:21:38,385][106226] Updated weights for policy 0, policy_version 296641 (0.0008) [2023-12-27 21:21:38,452][106226] Updated weights for policy 0, policy_version 296651 (0.0008) [2023-12-27 21:21:38,504][106226] Updated weights for policy 0, policy_version 296661 (0.0008) [2023-12-27 21:21:38,667][106225] Updated weights for policy 1, policy_version 297086 (0.0009) [2023-12-27 21:21:38,735][106225] Updated weights for policy 1, policy_version 297096 (0.0007) [2023-12-27 21:21:38,792][106225] Updated weights for policy 1, policy_version 297106 (0.0010) [2023-12-27 21:21:39,186][106226] Updated weights for policy 0, policy_version 296671 (0.0006) [2023-12-27 21:21:39,246][106226] Updated weights for policy 0, policy_version 296681 (0.0008) [2023-12-27 21:21:39,306][106226] Updated weights for policy 0, policy_version 296691 (0.0010) [2023-12-27 21:21:39,390][106225] Updated weights for policy 1, policy_version 297116 (0.0007) [2023-12-27 21:21:39,465][106225] Updated weights for policy 1, policy_version 297126 (0.0009) [2023-12-27 21:21:39,526][106225] Updated weights for policy 1, policy_version 297136 (0.0008) [2023-12-27 21:21:40,074][106226] Updated weights for policy 0, policy_version 296701 (0.0008) [2023-12-27 21:21:40,141][106226] Updated weights for policy 0, policy_version 296711 (0.0009) [2023-12-27 21:21:40,207][106226] Updated weights for policy 0, policy_version 296721 (0.0009) [2023-12-27 21:21:40,212][106225] Updated weights for policy 1, policy_version 297146 (0.0009) [2023-12-27 21:21:40,267][106225] Updated weights for policy 1, policy_version 297156 (0.0006) [2023-12-27 21:21:40,322][106225] Updated weights for policy 1, policy_version 297166 (0.0007) [2023-12-27 21:21:40,386][106225] Updated weights for policy 1, policy_version 297176 (0.0008) [2023-12-27 21:21:40,968][106226] Updated weights for policy 0, policy_version 296731 (0.0009) [2023-12-27 21:21:41,031][106226] Updated weights for policy 0, policy_version 296741 (0.0009) [2023-12-27 21:21:41,093][106226] Updated weights for policy 0, policy_version 296751 (0.0009) [2023-12-27 21:21:41,119][106225] Updated weights for policy 1, policy_version 297186 (0.0007) [2023-12-27 21:21:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 152092672. Throughput: 0: 10022.7, 1: 9780.4. Samples: 152063424. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:41,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.587')] [2023-12-27 21:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000296760_75997184.pth... [2023-12-27 21:21:41,186][106225] Updated weights for policy 1, policy_version 297196 (0.0008) [2023-12-27 21:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000295576_75694080.pth [2023-12-27 21:21:41,252][106225] Updated weights for policy 1, policy_version 297206 (0.0009) [2023-12-27 21:21:41,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000297208_76103680.pth... [2023-12-27 21:21:41,270][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000296056_75808768.pth [2023-12-27 21:21:41,902][106226] Updated weights for policy 0, policy_version 296761 (0.0008) [2023-12-27 21:21:41,967][106226] Updated weights for policy 0, policy_version 296771 (0.0008) [2023-12-27 21:21:42,013][106225] Updated weights for policy 1, policy_version 297216 (0.0008) [2023-12-27 21:21:42,030][106226] Updated weights for policy 0, policy_version 296781 (0.0008) [2023-12-27 21:21:42,079][106225] Updated weights for policy 1, policy_version 297226 (0.0008) [2023-12-27 21:21:42,094][106226] Updated weights for policy 0, policy_version 296791 (0.0006) [2023-12-27 21:21:42,145][106225] Updated weights for policy 1, policy_version 297236 (0.0008) [2023-12-27 21:21:42,762][106226] Updated weights for policy 0, policy_version 296801 (0.0005) [2023-12-27 21:21:42,831][106226] Updated weights for policy 0, policy_version 296811 (0.0010) [2023-12-27 21:21:42,885][106225] Updated weights for policy 1, policy_version 297246 (0.0009) [2023-12-27 21:21:42,896][106226] Updated weights for policy 0, policy_version 296821 (0.0011) [2023-12-27 21:21:42,932][106225] Updated weights for policy 1, policy_version 297256 (0.0010) [2023-12-27 21:21:42,978][106225] Updated weights for policy 1, policy_version 297266 (0.0010) [2023-12-27 21:21:43,531][106226] Updated weights for policy 0, policy_version 296831 (0.0010) [2023-12-27 21:21:43,585][106226] Updated weights for policy 0, policy_version 296841 (0.0007) [2023-12-27 21:21:43,638][106226] Updated weights for policy 0, policy_version 296851 (0.0008) [2023-12-27 21:21:43,724][106225] Updated weights for policy 1, policy_version 297276 (0.0010) [2023-12-27 21:21:43,779][106225] Updated weights for policy 1, policy_version 297286 (0.0008) [2023-12-27 21:21:43,835][106225] Updated weights for policy 1, policy_version 297296 (0.0010) [2023-12-27 21:21:44,234][106226] Updated weights for policy 0, policy_version 296861 (0.0007) [2023-12-27 21:21:44,292][106226] Updated weights for policy 0, policy_version 296871 (0.0008) [2023-12-27 21:21:44,353][106226] Updated weights for policy 0, policy_version 296881 (0.0008) [2023-12-27 21:21:44,572][106225] Updated weights for policy 1, policy_version 297306 (0.0009) [2023-12-27 21:21:44,632][106225] Updated weights for policy 1, policy_version 297316 (0.0006) [2023-12-27 21:21:44,685][106225] Updated weights for policy 1, policy_version 297326 (0.0010) [2023-12-27 21:21:44,736][106225] Updated weights for policy 1, policy_version 297336 (0.0010) [2023-12-27 21:21:45,121][106226] Updated weights for policy 0, policy_version 296891 (0.0009) [2023-12-27 21:21:45,187][106226] Updated weights for policy 0, policy_version 296901 (0.0011) [2023-12-27 21:21:45,249][106226] Updated weights for policy 0, policy_version 296911 (0.0011) [2023-12-27 21:21:45,445][106225] Updated weights for policy 1, policy_version 297346 (0.0007) [2023-12-27 21:21:45,498][106225] Updated weights for policy 1, policy_version 297356 (0.0007) [2023-12-27 21:21:45,555][106225] Updated weights for policy 1, policy_version 297366 (0.0008) [2023-12-27 21:21:45,974][106226] Updated weights for policy 0, policy_version 296921 (0.0010) [2023-12-27 21:21:46,035][106226] Updated weights for policy 0, policy_version 296931 (0.0008) [2023-12-27 21:21:46,101][106226] Updated weights for policy 0, policy_version 296941 (0.0010) [2023-12-27 21:21:46,164][106226] Updated weights for policy 0, policy_version 296951 (0.0010) [2023-12-27 21:21:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 152190976. Throughput: 0: 9987.2, 1: 9805.9. Samples: 152179900. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:46,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.815')] [2023-12-27 21:21:46,284][106225] Updated weights for policy 1, policy_version 297376 (0.0007) [2023-12-27 21:21:46,341][106225] Updated weights for policy 1, policy_version 297386 (0.0007) [2023-12-27 21:21:46,403][106225] Updated weights for policy 1, policy_version 297396 (0.0007) [2023-12-27 21:21:46,764][106226] Updated weights for policy 0, policy_version 296961 (0.0006) [2023-12-27 21:21:46,816][106226] Updated weights for policy 0, policy_version 296971 (0.0005) [2023-12-27 21:21:46,878][106226] Updated weights for policy 0, policy_version 296981 (0.0006) [2023-12-27 21:21:47,157][106225] Updated weights for policy 1, policy_version 297406 (0.0009) [2023-12-27 21:21:47,221][106225] Updated weights for policy 1, policy_version 297416 (0.0006) [2023-12-27 21:21:47,275][106225] Updated weights for policy 1, policy_version 297426 (0.0005) [2023-12-27 21:21:47,514][106226] Updated weights for policy 0, policy_version 296991 (0.0008) [2023-12-27 21:21:47,574][106226] Updated weights for policy 0, policy_version 297001 (0.0007) [2023-12-27 21:21:47,622][106226] Updated weights for policy 0, policy_version 297011 (0.0007) [2023-12-27 21:21:47,866][106225] Updated weights for policy 1, policy_version 297436 (0.0006) [2023-12-27 21:21:47,924][106225] Updated weights for policy 1, policy_version 297446 (0.0008) [2023-12-27 21:21:47,983][106225] Updated weights for policy 1, policy_version 297456 (0.0007) [2023-12-27 21:21:48,282][106226] Updated weights for policy 0, policy_version 297021 (0.0007) [2023-12-27 21:21:48,345][106226] Updated weights for policy 0, policy_version 297031 (0.0008) [2023-12-27 21:21:48,415][106226] Updated weights for policy 0, policy_version 297041 (0.0007) [2023-12-27 21:21:48,662][106225] Updated weights for policy 1, policy_version 297466 (0.0006) [2023-12-27 21:21:48,728][106225] Updated weights for policy 1, policy_version 297476 (0.0009) [2023-12-27 21:21:48,789][106225] Updated weights for policy 1, policy_version 297486 (0.0010) [2023-12-27 21:21:48,845][106225] Updated weights for policy 1, policy_version 297496 (0.0009) [2023-12-27 21:21:49,018][106226] Updated weights for policy 0, policy_version 297051 (0.0007) [2023-12-27 21:21:49,072][106226] Updated weights for policy 0, policy_version 297061 (0.0009) [2023-12-27 21:21:49,122][106226] Updated weights for policy 0, policy_version 297071 (0.0008) [2023-12-27 21:21:49,525][106225] Updated weights for policy 1, policy_version 297506 (0.0006) [2023-12-27 21:21:49,590][106225] Updated weights for policy 1, policy_version 297516 (0.0006) [2023-12-27 21:21:49,644][106225] Updated weights for policy 1, policy_version 297526 (0.0006) [2023-12-27 21:21:49,857][106226] Updated weights for policy 0, policy_version 297081 (0.0009) [2023-12-27 21:21:49,909][106226] Updated weights for policy 0, policy_version 297091 (0.0008) [2023-12-27 21:21:49,976][106226] Updated weights for policy 0, policy_version 297101 (0.0009) [2023-12-27 21:21:50,041][106226] Updated weights for policy 0, policy_version 297111 (0.0010) [2023-12-27 21:21:50,274][106225] Updated weights for policy 1, policy_version 297536 (0.0008) [2023-12-27 21:21:50,337][106225] Updated weights for policy 1, policy_version 297546 (0.0006) [2023-12-27 21:21:50,403][106225] Updated weights for policy 1, policy_version 297556 (0.0007) [2023-12-27 21:21:50,858][106226] Updated weights for policy 0, policy_version 297121 (0.0009) [2023-12-27 21:21:50,906][106226] Updated weights for policy 0, policy_version 297131 (0.0008) [2023-12-27 21:21:50,956][106226] Updated weights for policy 0, policy_version 297141 (0.0008) [2023-12-27 21:21:51,084][106225] Updated weights for policy 1, policy_version 297566 (0.0008) [2023-12-27 21:21:51,144][106225] Updated weights for policy 1, policy_version 297576 (0.0009) [2023-12-27 21:21:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 152289280. Throughput: 0: 10003.2, 1: 9853.6. Samples: 152299476. Policy #0 lag: (min: 5.0, avg: 17.8, max: 37.0) [2023-12-27 21:21:51,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-5.794')] [2023-12-27 21:21:51,200][106225] Updated weights for policy 1, policy_version 297586 (0.0010) [2023-12-27 21:21:51,773][106226] Updated weights for policy 0, policy_version 297151 (0.0008) [2023-12-27 21:21:51,841][106226] Updated weights for policy 0, policy_version 297161 (0.0005) [2023-12-27 21:21:51,904][106226] Updated weights for policy 0, policy_version 297171 (0.0006) [2023-12-27 21:21:52,005][106225] Updated weights for policy 1, policy_version 297596 (0.0011) [2023-12-27 21:21:52,059][106225] Updated weights for policy 1, policy_version 297606 (0.0010) [2023-12-27 21:21:52,118][106225] Updated weights for policy 1, policy_version 297616 (0.0010) [2023-12-27 21:21:52,523][106226] Updated weights for policy 0, policy_version 297181 (0.0007) [2023-12-27 21:21:52,588][106226] Updated weights for policy 0, policy_version 297191 (0.0008) [2023-12-27 21:21:52,653][106226] Updated weights for policy 0, policy_version 297201 (0.0008) [2023-12-27 21:21:52,847][106225] Updated weights for policy 1, policy_version 297626 (0.0010) [2023-12-27 21:21:52,909][106225] Updated weights for policy 1, policy_version 297636 (0.0010) [2023-12-27 21:21:52,959][106225] Updated weights for policy 1, policy_version 297646 (0.0010) [2023-12-27 21:21:53,009][106225] Updated weights for policy 1, policy_version 297656 (0.0010) [2023-12-27 21:21:53,337][106226] Updated weights for policy 0, policy_version 297211 (0.0008) [2023-12-27 21:21:53,391][106226] Updated weights for policy 0, policy_version 297221 (0.0007) [2023-12-27 21:21:53,447][106226] Updated weights for policy 0, policy_version 297231 (0.0008) [2023-12-27 21:21:53,684][106225] Updated weights for policy 1, policy_version 297666 (0.0005) [2023-12-27 21:21:53,742][106225] Updated weights for policy 1, policy_version 297676 (0.0005) [2023-12-27 21:21:53,792][106225] Updated weights for policy 1, policy_version 297686 (0.0005) [2023-12-27 21:21:54,044][106226] Updated weights for policy 0, policy_version 297241 (0.0006) [2023-12-27 21:21:54,113][106226] Updated weights for policy 0, policy_version 297251 (0.0007) [2023-12-27 21:21:54,171][106226] Updated weights for policy 0, policy_version 297261 (0.0006) [2023-12-27 21:21:54,231][106226] Updated weights for policy 0, policy_version 297271 (0.0005) [2023-12-27 21:21:54,423][106225] Updated weights for policy 1, policy_version 297696 (0.0005) [2023-12-27 21:21:54,472][106225] Updated weights for policy 1, policy_version 297706 (0.0005) [2023-12-27 21:21:54,520][106225] Updated weights for policy 1, policy_version 297716 (0.0005) [2023-12-27 21:21:54,817][106226] Updated weights for policy 0, policy_version 297281 (0.0008) [2023-12-27 21:21:54,876][106226] Updated weights for policy 0, policy_version 297291 (0.0008) [2023-12-27 21:21:54,932][106226] Updated weights for policy 0, policy_version 297301 (0.0009) [2023-12-27 21:21:55,108][106225] Updated weights for policy 1, policy_version 297726 (0.0005) [2023-12-27 21:21:55,168][106225] Updated weights for policy 1, policy_version 297736 (0.0005) [2023-12-27 21:21:55,227][106225] Updated weights for policy 1, policy_version 297746 (0.0005) [2023-12-27 21:21:55,594][106226] Updated weights for policy 0, policy_version 297311 (0.0008) [2023-12-27 21:21:55,648][106226] Updated weights for policy 0, policy_version 297321 (0.0009) [2023-12-27 21:21:55,709][106226] Updated weights for policy 0, policy_version 297331 (0.0009) [2023-12-27 21:21:55,890][106225] Updated weights for policy 1, policy_version 297756 (0.0007) [2023-12-27 21:21:55,943][106225] Updated weights for policy 1, policy_version 297766 (0.0008) [2023-12-27 21:21:55,989][106225] Updated weights for policy 1, policy_version 297776 (0.0005) [2023-12-27 21:21:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 152395776. Throughput: 0: 10019.1, 1: 9804.8. Samples: 152359648. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:21:56,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-5.692')] [2023-12-27 21:21:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000297784_76251136.pth... [2023-12-27 21:21:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000297336_76144640.pth... [2023-12-27 21:21:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000296600_75948032.pth [2023-12-27 21:21:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000296152_75841536.pth [2023-12-27 21:21:56,333][106226] Updated weights for policy 0, policy_version 297341 (0.0009) [2023-12-27 21:21:56,387][106226] Updated weights for policy 0, policy_version 297351 (0.0010) [2023-12-27 21:21:56,450][106226] Updated weights for policy 0, policy_version 297361 (0.0011) [2023-12-27 21:21:56,551][106225] Updated weights for policy 1, policy_version 297786 (0.0005) [2023-12-27 21:21:56,606][106225] Updated weights for policy 1, policy_version 297796 (0.0005) [2023-12-27 21:21:56,663][106225] Updated weights for policy 1, policy_version 297806 (0.0005) [2023-12-27 21:21:56,725][106225] Updated weights for policy 1, policy_version 297816 (0.0005) [2023-12-27 21:21:57,111][106226] Updated weights for policy 0, policy_version 297371 (0.0010) [2023-12-27 21:21:57,171][106226] Updated weights for policy 0, policy_version 297381 (0.0009) [2023-12-27 21:21:57,233][106226] Updated weights for policy 0, policy_version 297391 (0.0009) [2023-12-27 21:21:57,369][106225] Updated weights for policy 1, policy_version 297826 (0.0009) [2023-12-27 21:21:57,419][106225] Updated weights for policy 1, policy_version 297836 (0.0008) [2023-12-27 21:21:57,463][106225] Updated weights for policy 1, policy_version 297846 (0.0008) [2023-12-27 21:21:57,880][106226] Updated weights for policy 0, policy_version 297401 (0.0009) [2023-12-27 21:21:57,943][106226] Updated weights for policy 0, policy_version 297411 (0.0009) [2023-12-27 21:21:58,007][106226] Updated weights for policy 0, policy_version 297421 (0.0010) [2023-12-27 21:21:58,074][106226] Updated weights for policy 0, policy_version 297431 (0.0005) [2023-12-27 21:21:58,223][106225] Updated weights for policy 1, policy_version 297856 (0.0008) [2023-12-27 21:21:58,283][106225] Updated weights for policy 1, policy_version 297866 (0.0008) [2023-12-27 21:21:58,358][106225] Updated weights for policy 1, policy_version 297878 (0.0008) [2023-12-27 21:21:58,746][106226] Updated weights for policy 0, policy_version 297441 (0.0008) [2023-12-27 21:21:58,815][106226] Updated weights for policy 0, policy_version 297452 (0.0007) [2023-12-27 21:21:58,881][106226] Updated weights for policy 0, policy_version 297462 (0.0010) [2023-12-27 21:21:59,246][106225] Updated weights for policy 1, policy_version 297888 (0.0008) [2023-12-27 21:21:59,318][106225] Updated weights for policy 1, policy_version 297898 (0.0008) [2023-12-27 21:21:59,381][106225] Updated weights for policy 1, policy_version 297908 (0.0009) [2023-12-27 21:21:59,662][106226] Updated weights for policy 0, policy_version 297472 (0.0006) [2023-12-27 21:21:59,729][106226] Updated weights for policy 0, policy_version 297482 (0.0007) [2023-12-27 21:21:59,785][106226] Updated weights for policy 0, policy_version 297492 (0.0009) [2023-12-27 21:22:00,128][106225] Updated weights for policy 1, policy_version 297918 (0.0008) [2023-12-27 21:22:00,190][106225] Updated weights for policy 1, policy_version 297928 (0.0005) [2023-12-27 21:22:00,258][106225] Updated weights for policy 1, policy_version 297938 (0.0008) [2023-12-27 21:22:00,400][106226] Updated weights for policy 0, policy_version 297502 (0.0007) [2023-12-27 21:22:00,456][106226] Updated weights for policy 0, policy_version 297512 (0.0006) [2023-12-27 21:22:00,505][106226] Updated weights for policy 0, policy_version 297522 (0.0005) [2023-12-27 21:22:00,931][106225] Updated weights for policy 1, policy_version 297948 (0.0008) [2023-12-27 21:22:00,978][106225] Updated weights for policy 1, policy_version 297958 (0.0008) [2023-12-27 21:22:01,026][106225] Updated weights for policy 1, policy_version 297968 (0.0008) [2023-12-27 21:22:01,113][106226] Updated weights for policy 0, policy_version 297532 (0.0007) [2023-12-27 21:22:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 152494080. Throughput: 0: 10109.9, 1: 9862.8. Samples: 152482016. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:01,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-5.909')] [2023-12-27 21:22:01,181][106226] Updated weights for policy 0, policy_version 297542 (0.0009) [2023-12-27 21:22:01,245][106226] Updated weights for policy 0, policy_version 297552 (0.0007) [2023-12-27 21:22:01,816][106225] Updated weights for policy 1, policy_version 297978 (0.0008) [2023-12-27 21:22:01,876][106225] Updated weights for policy 1, policy_version 297988 (0.0009) [2023-12-27 21:22:01,939][106225] Updated weights for policy 1, policy_version 297998 (0.0009) [2023-12-27 21:22:01,997][106226] Updated weights for policy 0, policy_version 297562 (0.0009) [2023-12-27 21:22:02,000][106225] Updated weights for policy 1, policy_version 298008 (0.0008) [2023-12-27 21:22:02,054][106226] Updated weights for policy 0, policy_version 297572 (0.0010) [2023-12-27 21:22:02,119][106226] Updated weights for policy 0, policy_version 297582 (0.0008) [2023-12-27 21:22:02,184][106226] Updated weights for policy 0, policy_version 297592 (0.0009) [2023-12-27 21:22:02,732][106225] Updated weights for policy 1, policy_version 298018 (0.0009) [2023-12-27 21:22:02,793][106225] Updated weights for policy 1, policy_version 298028 (0.0009) [2023-12-27 21:22:02,851][106225] Updated weights for policy 1, policy_version 298038 (0.0007) [2023-12-27 21:22:02,857][106226] Updated weights for policy 0, policy_version 297602 (0.0006) [2023-12-27 21:22:02,911][106226] Updated weights for policy 0, policy_version 297612 (0.0005) [2023-12-27 21:22:02,972][106226] Updated weights for policy 0, policy_version 297622 (0.0008) [2023-12-27 21:22:03,599][106225] Updated weights for policy 1, policy_version 298048 (0.0008) [2023-12-27 21:22:03,644][106225] Updated weights for policy 1, policy_version 298058 (0.0007) [2023-12-27 21:22:03,666][106226] Updated weights for policy 0, policy_version 297632 (0.0008) [2023-12-27 21:22:03,703][106225] Updated weights for policy 1, policy_version 298068 (0.0006) [2023-12-27 21:22:03,720][106226] Updated weights for policy 0, policy_version 297642 (0.0007) [2023-12-27 21:22:03,769][106226] Updated weights for policy 0, policy_version 297652 (0.0007) [2023-12-27 21:22:04,459][106225] Updated weights for policy 1, policy_version 298078 (0.0007) [2023-12-27 21:22:04,509][106225] Updated weights for policy 1, policy_version 298088 (0.0008) [2023-12-27 21:22:04,535][106226] Updated weights for policy 0, policy_version 297662 (0.0008) [2023-12-27 21:22:04,560][106225] Updated weights for policy 1, policy_version 298098 (0.0006) [2023-12-27 21:22:04,596][106226] Updated weights for policy 0, policy_version 297672 (0.0007) [2023-12-27 21:22:04,660][106226] Updated weights for policy 0, policy_version 297682 (0.0008) [2023-12-27 21:22:05,230][106225] Updated weights for policy 1, policy_version 298108 (0.0007) [2023-12-27 21:22:05,303][106225] Updated weights for policy 1, policy_version 298119 (0.0009) [2023-12-27 21:22:05,371][106226] Updated weights for policy 0, policy_version 297692 (0.0007) [2023-12-27 21:22:05,372][106225] Updated weights for policy 1, policy_version 298129 (0.0009) [2023-12-27 21:22:05,425][106226] Updated weights for policy 0, policy_version 297702 (0.0006) [2023-12-27 21:22:05,479][106226] Updated weights for policy 0, policy_version 297712 (0.0008) [2023-12-27 21:22:06,086][106225] Updated weights for policy 1, policy_version 298139 (0.0007) [2023-12-27 21:22:06,154][106225] Updated weights for policy 1, policy_version 298149 (0.0007) [2023-12-27 21:22:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 152584192. Throughput: 0: 10073.3, 1: 9898.0. Samples: 152599880. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:06,175][105115] Avg episode reward: [(0, '-4.894'), (1, '-5.165')] [2023-12-27 21:22:06,199][106226] Updated weights for policy 0, policy_version 297722 (0.0008) [2023-12-27 21:22:06,217][106225] Updated weights for policy 1, policy_version 298159 (0.0007) [2023-12-27 21:22:06,262][106226] Updated weights for policy 0, policy_version 297732 (0.0007) [2023-12-27 21:22:06,268][106141] Saving new best policy, reward=-5.165! [2023-12-27 21:22:06,327][106226] Updated weights for policy 0, policy_version 297742 (0.0007) [2023-12-27 21:22:06,393][106226] Updated weights for policy 0, policy_version 297752 (0.0006) [2023-12-27 21:22:06,937][106225] Updated weights for policy 1, policy_version 298169 (0.0006) [2023-12-27 21:22:06,997][106225] Updated weights for policy 1, policy_version 298179 (0.0007) [2023-12-27 21:22:07,062][106225] Updated weights for policy 1, policy_version 298189 (0.0007) [2023-12-27 21:22:07,085][106226] Updated weights for policy 0, policy_version 297762 (0.0006) [2023-12-27 21:22:07,122][106225] Updated weights for policy 1, policy_version 298199 (0.0010) [2023-12-27 21:22:07,141][106226] Updated weights for policy 0, policy_version 297772 (0.0007) [2023-12-27 21:22:07,199][106226] Updated weights for policy 0, policy_version 297782 (0.0008) [2023-12-27 21:22:07,765][106226] Updated weights for policy 0, policy_version 297792 (0.0007) [2023-12-27 21:22:07,796][106225] Updated weights for policy 1, policy_version 298209 (0.0010) [2023-12-27 21:22:07,817][106226] Updated weights for policy 0, policy_version 297802 (0.0010) [2023-12-27 21:22:07,850][106225] Updated weights for policy 1, policy_version 298219 (0.0011) [2023-12-27 21:22:07,870][106226] Updated weights for policy 0, policy_version 297812 (0.0006) [2023-12-27 21:22:07,902][106225] Updated weights for policy 1, policy_version 298229 (0.0005) [2023-12-27 21:22:08,533][106226] Updated weights for policy 0, policy_version 297822 (0.0008) [2023-12-27 21:22:08,590][106225] Updated weights for policy 1, policy_version 298239 (0.0007) [2023-12-27 21:22:08,596][106226] Updated weights for policy 0, policy_version 297832 (0.0007) [2023-12-27 21:22:08,655][106225] Updated weights for policy 1, policy_version 298249 (0.0008) [2023-12-27 21:22:08,659][106226] Updated weights for policy 0, policy_version 297842 (0.0006) [2023-12-27 21:22:08,716][106225] Updated weights for policy 1, policy_version 298259 (0.0009) [2023-12-27 21:22:09,274][106226] Updated weights for policy 0, policy_version 297852 (0.0006) [2023-12-27 21:22:09,344][106226] Updated weights for policy 0, policy_version 297862 (0.0007) [2023-12-27 21:22:09,416][106226] Updated weights for policy 0, policy_version 297872 (0.0008) [2023-12-27 21:22:09,515][106225] Updated weights for policy 1, policy_version 298269 (0.0009) [2023-12-27 21:22:09,584][106225] Updated weights for policy 1, policy_version 298279 (0.0009) [2023-12-27 21:22:09,637][106225] Updated weights for policy 1, policy_version 298289 (0.0008) [2023-12-27 21:22:10,093][106226] Updated weights for policy 0, policy_version 297882 (0.0009) [2023-12-27 21:22:10,153][106226] Updated weights for policy 0, policy_version 297892 (0.0010) [2023-12-27 21:22:10,215][106226] Updated weights for policy 0, policy_version 297902 (0.0009) [2023-12-27 21:22:10,273][106226] Updated weights for policy 0, policy_version 297912 (0.0005) [2023-12-27 21:22:10,404][106225] Updated weights for policy 1, policy_version 298299 (0.0010) [2023-12-27 21:22:10,471][106225] Updated weights for policy 1, policy_version 298309 (0.0011) [2023-12-27 21:22:10,542][106225] Updated weights for policy 1, policy_version 298319 (0.0010) [2023-12-27 21:22:10,935][106226] Updated weights for policy 0, policy_version 297922 (0.0011) [2023-12-27 21:22:10,987][106226] Updated weights for policy 0, policy_version 297932 (0.0010) [2023-12-27 21:22:11,038][106226] Updated weights for policy 0, policy_version 297942 (0.0010) [2023-12-27 21:22:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 152690688. Throughput: 0: 10114.4, 1: 9940.4. Samples: 152660700. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:11,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.558')] [2023-12-27 21:22:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000298328_76390400.pth... [2023-12-27 21:22:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000297944_76300288.pth... [2023-12-27 21:22:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000297208_76103680.pth [2023-12-27 21:22:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000296760_75997184.pth [2023-12-27 21:22:11,284][106225] Updated weights for policy 1, policy_version 298329 (0.0010) [2023-12-27 21:22:11,352][106225] Updated weights for policy 1, policy_version 298339 (0.0010) [2023-12-27 21:22:11,420][106225] Updated weights for policy 1, policy_version 298349 (0.0010) [2023-12-27 21:22:11,485][106225] Updated weights for policy 1, policy_version 298359 (0.0010) [2023-12-27 21:22:11,839][106226] Updated weights for policy 0, policy_version 297952 (0.0011) [2023-12-27 21:22:11,894][106226] Updated weights for policy 0, policy_version 297962 (0.0008) [2023-12-27 21:22:11,948][106226] Updated weights for policy 0, policy_version 297972 (0.0009) [2023-12-27 21:22:12,172][106225] Updated weights for policy 1, policy_version 298369 (0.0009) [2023-12-27 21:22:12,238][106225] Updated weights for policy 1, policy_version 298379 (0.0008) [2023-12-27 21:22:12,303][106225] Updated weights for policy 1, policy_version 298389 (0.0008) [2023-12-27 21:22:12,848][106226] Updated weights for policy 0, policy_version 297982 (0.0009) [2023-12-27 21:22:12,885][106225] Updated weights for policy 1, policy_version 298399 (0.0008) [2023-12-27 21:22:12,908][106226] Updated weights for policy 0, policy_version 297992 (0.0006) [2023-12-27 21:22:12,943][106225] Updated weights for policy 1, policy_version 298409 (0.0008) [2023-12-27 21:22:12,973][106226] Updated weights for policy 0, policy_version 298002 (0.0007) [2023-12-27 21:22:13,008][106225] Updated weights for policy 1, policy_version 298419 (0.0005) [2023-12-27 21:22:13,663][106226] Updated weights for policy 0, policy_version 298012 (0.0009) [2023-12-27 21:22:13,666][106225] Updated weights for policy 1, policy_version 298429 (0.0007) [2023-12-27 21:22:13,722][106225] Updated weights for policy 1, policy_version 298439 (0.0006) [2023-12-27 21:22:13,723][106226] Updated weights for policy 0, policy_version 298022 (0.0010) [2023-12-27 21:22:13,774][106225] Updated weights for policy 1, policy_version 298449 (0.0006) [2023-12-27 21:22:13,783][106226] Updated weights for policy 0, policy_version 298032 (0.0011) [2023-12-27 21:22:14,426][106225] Updated weights for policy 1, policy_version 298459 (0.0005) [2023-12-27 21:22:14,465][106226] Updated weights for policy 0, policy_version 298042 (0.0010) [2023-12-27 21:22:14,489][106225] Updated weights for policy 1, policy_version 298469 (0.0008) [2023-12-27 21:22:14,537][106226] Updated weights for policy 0, policy_version 298052 (0.0009) [2023-12-27 21:22:14,547][106225] Updated weights for policy 1, policy_version 298479 (0.0006) [2023-12-27 21:22:14,604][106226] Updated weights for policy 0, policy_version 298062 (0.0011) [2023-12-27 21:22:14,674][106226] Updated weights for policy 0, policy_version 298072 (0.0011) [2023-12-27 21:22:15,173][106225] Updated weights for policy 1, policy_version 298489 (0.0006) [2023-12-27 21:22:15,235][106225] Updated weights for policy 1, policy_version 298499 (0.0008) [2023-12-27 21:22:15,294][106225] Updated weights for policy 1, policy_version 298509 (0.0006) [2023-12-27 21:22:15,353][106225] Updated weights for policy 1, policy_version 298519 (0.0006) [2023-12-27 21:22:15,387][106226] Updated weights for policy 0, policy_version 298082 (0.0011) [2023-12-27 21:22:15,444][106226] Updated weights for policy 0, policy_version 298092 (0.0010) [2023-12-27 21:22:15,491][106226] Updated weights for policy 0, policy_version 298102 (0.0010) [2023-12-27 21:22:15,986][106225] Updated weights for policy 1, policy_version 298529 (0.0008) [2023-12-27 21:22:16,034][106225] Updated weights for policy 1, policy_version 298539 (0.0010) [2023-12-27 21:22:16,086][106225] Updated weights for policy 1, policy_version 298549 (0.0010) [2023-12-27 21:22:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 152788992. Throughput: 0: 10041.0, 1: 9903.0. Samples: 152776468. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:16,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-6.060')] [2023-12-27 21:22:16,214][106226] Updated weights for policy 0, policy_version 298112 (0.0011) [2023-12-27 21:22:16,279][106226] Updated weights for policy 0, policy_version 298122 (0.0010) [2023-12-27 21:22:16,341][106226] Updated weights for policy 0, policy_version 298132 (0.0011) [2023-12-27 21:22:16,812][106225] Updated weights for policy 1, policy_version 298559 (0.0010) [2023-12-27 21:22:16,878][106225] Updated weights for policy 1, policy_version 298569 (0.0010) [2023-12-27 21:22:16,931][106225] Updated weights for policy 1, policy_version 298579 (0.0010) [2023-12-27 21:22:16,950][106226] Updated weights for policy 0, policy_version 298142 (0.0007) [2023-12-27 21:22:17,006][106226] Updated weights for policy 0, policy_version 298152 (0.0006) [2023-12-27 21:22:17,067][106226] Updated weights for policy 0, policy_version 298162 (0.0008) [2023-12-27 21:22:17,645][106225] Updated weights for policy 1, policy_version 298589 (0.0010) [2023-12-27 21:22:17,696][106225] Updated weights for policy 1, policy_version 298599 (0.0010) [2023-12-27 21:22:17,746][106226] Updated weights for policy 0, policy_version 298172 (0.0007) [2023-12-27 21:22:17,754][106225] Updated weights for policy 1, policy_version 298609 (0.0010) [2023-12-27 21:22:17,791][106226] Updated weights for policy 0, policy_version 298182 (0.0007) [2023-12-27 21:22:17,846][106226] Updated weights for policy 0, policy_version 298192 (0.0005) [2023-12-27 21:22:18,515][106225] Updated weights for policy 1, policy_version 298619 (0.0010) [2023-12-27 21:22:18,530][106226] Updated weights for policy 0, policy_version 298202 (0.0006) [2023-12-27 21:22:18,573][106225] Updated weights for policy 1, policy_version 298629 (0.0010) [2023-12-27 21:22:18,595][106226] Updated weights for policy 0, policy_version 298212 (0.0010) [2023-12-27 21:22:18,634][106225] Updated weights for policy 1, policy_version 298639 (0.0011) [2023-12-27 21:22:18,652][106226] Updated weights for policy 0, policy_version 298222 (0.0011) [2023-12-27 21:22:18,715][106226] Updated weights for policy 0, policy_version 298232 (0.0010) [2023-12-27 21:22:19,444][106226] Updated weights for policy 0, policy_version 298242 (0.0006) [2023-12-27 21:22:19,446][106225] Updated weights for policy 1, policy_version 298649 (0.0010) [2023-12-27 21:22:19,504][106226] Updated weights for policy 0, policy_version 298252 (0.0007) [2023-12-27 21:22:19,512][106225] Updated weights for policy 1, policy_version 298659 (0.0008) [2023-12-27 21:22:19,566][106226] Updated weights for policy 0, policy_version 298262 (0.0007) [2023-12-27 21:22:19,576][106225] Updated weights for policy 1, policy_version 298669 (0.0008) [2023-12-27 21:22:19,636][106225] Updated weights for policy 1, policy_version 298679 (0.0008) [2023-12-27 21:22:20,331][106226] Updated weights for policy 0, policy_version 298272 (0.0008) [2023-12-27 21:22:20,364][106225] Updated weights for policy 1, policy_version 298689 (0.0006) [2023-12-27 21:22:20,394][106226] Updated weights for policy 0, policy_version 298282 (0.0008) [2023-12-27 21:22:20,424][106225] Updated weights for policy 1, policy_version 298699 (0.0006) [2023-12-27 21:22:20,451][106226] Updated weights for policy 0, policy_version 298292 (0.0006) [2023-12-27 21:22:20,485][106225] Updated weights for policy 1, policy_version 298709 (0.0007) [2023-12-27 21:22:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 152879104. Throughput: 0: 9964.7, 1: 9890.1. Samples: 152894124. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:21,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.389')] [2023-12-27 21:22:21,200][106226] Updated weights for policy 0, policy_version 298302 (0.0007) [2023-12-27 21:22:21,268][106226] Updated weights for policy 0, policy_version 298312 (0.0008) [2023-12-27 21:22:21,270][106225] Updated weights for policy 1, policy_version 298719 (0.0007) [2023-12-27 21:22:21,324][106226] Updated weights for policy 0, policy_version 298322 (0.0008) [2023-12-27 21:22:21,335][106225] Updated weights for policy 1, policy_version 298729 (0.0007) [2023-12-27 21:22:21,405][106225] Updated weights for policy 1, policy_version 298739 (0.0009) [2023-12-27 21:22:22,133][106226] Updated weights for policy 0, policy_version 298332 (0.0009) [2023-12-27 21:22:22,183][106225] Updated weights for policy 1, policy_version 298749 (0.0011) [2023-12-27 21:22:22,195][106226] Updated weights for policy 0, policy_version 298342 (0.0011) [2023-12-27 21:22:22,242][106225] Updated weights for policy 1, policy_version 298759 (0.0011) [2023-12-27 21:22:22,261][106226] Updated weights for policy 0, policy_version 298352 (0.0010) [2023-12-27 21:22:22,309][106225] Updated weights for policy 1, policy_version 298769 (0.0011) [2023-12-27 21:22:22,989][106226] Updated weights for policy 0, policy_version 298362 (0.0011) [2023-12-27 21:22:23,037][106225] Updated weights for policy 1, policy_version 298779 (0.0008) [2023-12-27 21:22:23,043][106226] Updated weights for policy 0, policy_version 298372 (0.0008) [2023-12-27 21:22:23,093][106225] Updated weights for policy 1, policy_version 298789 (0.0007) [2023-12-27 21:22:23,104][106226] Updated weights for policy 0, policy_version 298382 (0.0006) [2023-12-27 21:22:23,147][106225] Updated weights for policy 1, policy_version 298799 (0.0007) [2023-12-27 21:22:23,160][106226] Updated weights for policy 0, policy_version 298392 (0.0007) [2023-12-27 21:22:23,866][106226] Updated weights for policy 0, policy_version 298402 (0.0009) [2023-12-27 21:22:23,877][106225] Updated weights for policy 1, policy_version 298809 (0.0008) [2023-12-27 21:22:23,919][106226] Updated weights for policy 0, policy_version 298412 (0.0006) [2023-12-27 21:22:23,928][106225] Updated weights for policy 1, policy_version 298819 (0.0007) [2023-12-27 21:22:23,974][106225] Updated weights for policy 1, policy_version 298829 (0.0006) [2023-12-27 21:22:23,976][106226] Updated weights for policy 0, policy_version 298422 (0.0009) [2023-12-27 21:22:24,019][106225] Updated weights for policy 1, policy_version 298839 (0.0005) [2023-12-27 21:22:24,615][106225] Updated weights for policy 1, policy_version 298849 (0.0009) [2023-12-27 21:22:24,680][106225] Updated weights for policy 1, policy_version 298859 (0.0008) [2023-12-27 21:22:24,737][106225] Updated weights for policy 1, policy_version 298869 (0.0008) [2023-12-27 21:22:24,764][106226] Updated weights for policy 0, policy_version 298432 (0.0008) [2023-12-27 21:22:24,822][106226] Updated weights for policy 0, policy_version 298442 (0.0009) [2023-12-27 21:22:24,881][106226] Updated weights for policy 0, policy_version 298452 (0.0009) [2023-12-27 21:22:25,310][106225] Updated weights for policy 1, policy_version 298879 (0.0007) [2023-12-27 21:22:25,368][106225] Updated weights for policy 1, policy_version 298889 (0.0007) [2023-12-27 21:22:25,427][106225] Updated weights for policy 1, policy_version 298899 (0.0005) [2023-12-27 21:22:25,697][106226] Updated weights for policy 0, policy_version 298462 (0.0008) [2023-12-27 21:22:25,757][106226] Updated weights for policy 0, policy_version 298472 (0.0008) [2023-12-27 21:22:25,823][106226] Updated weights for policy 0, policy_version 298482 (0.0010) [2023-12-27 21:22:26,044][106225] Updated weights for policy 1, policy_version 298909 (0.0007) [2023-12-27 21:22:26,091][106225] Updated weights for policy 1, policy_version 298919 (0.0009) [2023-12-27 21:22:26,150][106225] Updated weights for policy 1, policy_version 298929 (0.0008) [2023-12-27 21:22:26,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 152977408. Throughput: 0: 9912.0, 1: 9777.4. Samples: 152949440. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:26,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.631')] [2023-12-27 21:22:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000298488_76439552.pth... [2023-12-27 21:22:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000298936_76546048.pth... [2023-12-27 21:22:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000297336_76144640.pth [2023-12-27 21:22:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000297784_76251136.pth [2023-12-27 21:22:26,576][106226] Updated weights for policy 0, policy_version 298492 (0.0008) [2023-12-27 21:22:26,638][106226] Updated weights for policy 0, policy_version 298502 (0.0008) [2023-12-27 21:22:26,681][106226] Updated weights for policy 0, policy_version 298512 (0.0008) [2023-12-27 21:22:26,842][106225] Updated weights for policy 1, policy_version 298939 (0.0009) [2023-12-27 21:22:26,890][106225] Updated weights for policy 1, policy_version 298949 (0.0008) [2023-12-27 21:22:26,944][106225] Updated weights for policy 1, policy_version 298959 (0.0008) [2023-12-27 21:22:27,403][106226] Updated weights for policy 0, policy_version 298522 (0.0007) [2023-12-27 21:22:27,454][106226] Updated weights for policy 0, policy_version 298532 (0.0009) [2023-12-27 21:22:27,507][106226] Updated weights for policy 0, policy_version 298542 (0.0008) [2023-12-27 21:22:27,565][106226] Updated weights for policy 0, policy_version 298552 (0.0009) [2023-12-27 21:22:27,580][106225] Updated weights for policy 1, policy_version 298969 (0.0008) [2023-12-27 21:22:27,634][106225] Updated weights for policy 1, policy_version 298979 (0.0005) [2023-12-27 21:22:27,686][106225] Updated weights for policy 1, policy_version 298989 (0.0006) [2023-12-27 21:22:27,742][106225] Updated weights for policy 1, policy_version 298999 (0.0006) [2023-12-27 21:22:28,354][106225] Updated weights for policy 1, policy_version 299009 (0.0008) [2023-12-27 21:22:28,372][106226] Updated weights for policy 0, policy_version 298562 (0.0008) [2023-12-27 21:22:28,405][106225] Updated weights for policy 1, policy_version 299019 (0.0010) [2023-12-27 21:22:28,431][106226] Updated weights for policy 0, policy_version 298572 (0.0006) [2023-12-27 21:22:28,470][106225] Updated weights for policy 1, policy_version 299029 (0.0010) [2023-12-27 21:22:28,488][106226] Updated weights for policy 0, policy_version 298582 (0.0006) [2023-12-27 21:22:29,101][106225] Updated weights for policy 1, policy_version 299039 (0.0007) [2023-12-27 21:22:29,162][106226] Updated weights for policy 0, policy_version 298592 (0.0007) [2023-12-27 21:22:29,162][106225] Updated weights for policy 1, policy_version 299049 (0.0007) [2023-12-27 21:22:29,213][106225] Updated weights for policy 1, policy_version 299059 (0.0008) [2023-12-27 21:22:29,223][106226] Updated weights for policy 0, policy_version 298602 (0.0007) [2023-12-27 21:22:29,297][106226] Updated weights for policy 0, policy_version 298612 (0.0007) [2023-12-27 21:22:29,878][106225] Updated weights for policy 1, policy_version 299069 (0.0007) [2023-12-27 21:22:29,943][106225] Updated weights for policy 1, policy_version 299079 (0.0007) [2023-12-27 21:22:29,945][106226] Updated weights for policy 0, policy_version 298622 (0.0007) [2023-12-27 21:22:30,001][106225] Updated weights for policy 1, policy_version 299089 (0.0006) [2023-12-27 21:22:30,003][106226] Updated weights for policy 0, policy_version 298632 (0.0008) [2023-12-27 21:22:30,063][106226] Updated weights for policy 0, policy_version 298642 (0.0008) [2023-12-27 21:22:30,661][106225] Updated weights for policy 1, policy_version 299099 (0.0007) [2023-12-27 21:22:30,720][106225] Updated weights for policy 1, policy_version 299109 (0.0008) [2023-12-27 21:22:30,747][106226] Updated weights for policy 0, policy_version 298652 (0.0008) [2023-12-27 21:22:30,776][106225] Updated weights for policy 1, policy_version 299119 (0.0006) [2023-12-27 21:22:30,808][106226] Updated weights for policy 0, policy_version 298662 (0.0008) [2023-12-27 21:22:30,871][106226] Updated weights for policy 0, policy_version 298672 (0.0007) [2023-12-27 21:22:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 153083904. Throughput: 0: 9855.4, 1: 9948.4. Samples: 153071072. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:31,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.880')] [2023-12-27 21:22:31,521][106225] Updated weights for policy 1, policy_version 299129 (0.0006) [2023-12-27 21:22:31,574][106226] Updated weights for policy 0, policy_version 298682 (0.0008) [2023-12-27 21:22:31,580][106225] Updated weights for policy 1, policy_version 299139 (0.0007) [2023-12-27 21:22:31,627][106226] Updated weights for policy 0, policy_version 298692 (0.0010) [2023-12-27 21:22:31,640][106225] Updated weights for policy 1, policy_version 299149 (0.0007) [2023-12-27 21:22:31,687][106226] Updated weights for policy 0, policy_version 298702 (0.0009) [2023-12-27 21:22:31,700][106225] Updated weights for policy 1, policy_version 299159 (0.0007) [2023-12-27 21:22:31,755][106226] Updated weights for policy 0, policy_version 298712 (0.0008) [2023-12-27 21:22:32,402][106225] Updated weights for policy 1, policy_version 299169 (0.0009) [2023-12-27 21:22:32,466][106225] Updated weights for policy 1, policy_version 299179 (0.0007) [2023-12-27 21:22:32,472][106226] Updated weights for policy 0, policy_version 298722 (0.0008) [2023-12-27 21:22:32,525][106225] Updated weights for policy 1, policy_version 299189 (0.0006) [2023-12-27 21:22:32,527][106226] Updated weights for policy 0, policy_version 298732 (0.0007) [2023-12-27 21:22:32,582][106226] Updated weights for policy 0, policy_version 298742 (0.0008) [2023-12-27 21:22:33,110][106225] Updated weights for policy 1, policy_version 299199 (0.0008) [2023-12-27 21:22:33,165][106225] Updated weights for policy 1, policy_version 299209 (0.0009) [2023-12-27 21:22:33,223][106225] Updated weights for policy 1, policy_version 299219 (0.0009) [2023-12-27 21:22:33,368][106226] Updated weights for policy 0, policy_version 298752 (0.0008) [2023-12-27 21:22:33,424][106226] Updated weights for policy 0, policy_version 298762 (0.0009) [2023-12-27 21:22:33,475][106226] Updated weights for policy 0, policy_version 298772 (0.0006) [2023-12-27 21:22:33,950][106225] Updated weights for policy 1, policy_version 299229 (0.0009) [2023-12-27 21:22:34,001][106225] Updated weights for policy 1, policy_version 299239 (0.0008) [2023-12-27 21:22:34,055][106225] Updated weights for policy 1, policy_version 299249 (0.0009) [2023-12-27 21:22:34,160][106226] Updated weights for policy 0, policy_version 298782 (0.0008) [2023-12-27 21:22:34,223][106226] Updated weights for policy 0, policy_version 298792 (0.0009) [2023-12-27 21:22:34,280][106226] Updated weights for policy 0, policy_version 298802 (0.0009) [2023-12-27 21:22:34,856][106225] Updated weights for policy 1, policy_version 299259 (0.0008) [2023-12-27 21:22:34,916][106225] Updated weights for policy 1, policy_version 299269 (0.0008) [2023-12-27 21:22:34,952][106226] Updated weights for policy 0, policy_version 298812 (0.0008) [2023-12-27 21:22:34,975][106225] Updated weights for policy 1, policy_version 299279 (0.0007) [2023-12-27 21:22:35,014][106226] Updated weights for policy 0, policy_version 298822 (0.0007) [2023-12-27 21:22:35,071][106226] Updated weights for policy 0, policy_version 298832 (0.0006) [2023-12-27 21:22:35,720][106225] Updated weights for policy 1, policy_version 299289 (0.0008) [2023-12-27 21:22:35,740][106226] Updated weights for policy 0, policy_version 298842 (0.0007) [2023-12-27 21:22:35,787][106225] Updated weights for policy 1, policy_version 299299 (0.0007) [2023-12-27 21:22:35,796][106226] Updated weights for policy 0, policy_version 298852 (0.0007) [2023-12-27 21:22:35,842][106226] Updated weights for policy 0, policy_version 298862 (0.0007) [2023-12-27 21:22:35,853][106225] Updated weights for policy 1, policy_version 299309 (0.0006) [2023-12-27 21:22:35,894][106226] Updated weights for policy 0, policy_version 298872 (0.0008) [2023-12-27 21:22:35,916][106225] Updated weights for policy 1, policy_version 299319 (0.0007) [2023-12-27 21:22:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 153182208. Throughput: 0: 9859.8, 1: 9920.7. Samples: 153189600. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:36,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.709')] [2023-12-27 21:22:36,615][106226] Updated weights for policy 0, policy_version 298882 (0.0008) [2023-12-27 21:22:36,664][106225] Updated weights for policy 1, policy_version 299329 (0.0011) [2023-12-27 21:22:36,670][106226] Updated weights for policy 0, policy_version 298892 (0.0006) [2023-12-27 21:22:36,725][106225] Updated weights for policy 1, policy_version 299339 (0.0010) [2023-12-27 21:22:36,731][106226] Updated weights for policy 0, policy_version 298902 (0.0006) [2023-12-27 21:22:36,776][106225] Updated weights for policy 1, policy_version 299349 (0.0010) [2023-12-27 21:22:37,433][106225] Updated weights for policy 1, policy_version 299359 (0.0007) [2023-12-27 21:22:37,484][106225] Updated weights for policy 1, policy_version 299369 (0.0005) [2023-12-27 21:22:37,491][106226] Updated weights for policy 0, policy_version 298912 (0.0008) [2023-12-27 21:22:37,545][106225] Updated weights for policy 1, policy_version 299379 (0.0005) [2023-12-27 21:22:37,552][106226] Updated weights for policy 0, policy_version 298922 (0.0008) [2023-12-27 21:22:37,609][106226] Updated weights for policy 0, policy_version 298932 (0.0009) [2023-12-27 21:22:38,052][106225] Updated weights for policy 1, policy_version 299389 (0.0007) [2023-12-27 21:22:38,103][106225] Updated weights for policy 1, policy_version 299399 (0.0005) [2023-12-27 21:22:38,160][106225] Updated weights for policy 1, policy_version 299409 (0.0009) [2023-12-27 21:22:38,391][106226] Updated weights for policy 0, policy_version 298942 (0.0008) [2023-12-27 21:22:38,453][106226] Updated weights for policy 0, policy_version 298952 (0.0008) [2023-12-27 21:22:38,512][106226] Updated weights for policy 0, policy_version 298962 (0.0007) [2023-12-27 21:22:38,882][106225] Updated weights for policy 1, policy_version 299419 (0.0010) [2023-12-27 21:22:38,946][106225] Updated weights for policy 1, policy_version 299429 (0.0009) [2023-12-27 21:22:39,002][106225] Updated weights for policy 1, policy_version 299439 (0.0009) [2023-12-27 21:22:39,297][106226] Updated weights for policy 0, policy_version 298972 (0.0008) [2023-12-27 21:22:39,366][106226] Updated weights for policy 0, policy_version 298982 (0.0009) [2023-12-27 21:22:39,440][106226] Updated weights for policy 0, policy_version 298992 (0.0007) [2023-12-27 21:22:39,691][106225] Updated weights for policy 1, policy_version 299449 (0.0008) [2023-12-27 21:22:39,762][106225] Updated weights for policy 1, policy_version 299459 (0.0007) [2023-12-27 21:22:39,829][106225] Updated weights for policy 1, policy_version 299469 (0.0008) [2023-12-27 21:22:39,886][106225] Updated weights for policy 1, policy_version 299479 (0.0008) [2023-12-27 21:22:40,189][106226] Updated weights for policy 0, policy_version 299002 (0.0009) [2023-12-27 21:22:40,254][106226] Updated weights for policy 0, policy_version 299012 (0.0008) [2023-12-27 21:22:40,318][106226] Updated weights for policy 0, policy_version 299022 (0.0008) [2023-12-27 21:22:40,380][106226] Updated weights for policy 0, policy_version 299032 (0.0007) [2023-12-27 21:22:40,553][106225] Updated weights for policy 1, policy_version 299489 (0.0008) [2023-12-27 21:22:40,622][106225] Updated weights for policy 1, policy_version 299499 (0.0007) [2023-12-27 21:22:40,679][106225] Updated weights for policy 1, policy_version 299509 (0.0008) [2023-12-27 21:22:41,080][106226] Updated weights for policy 0, policy_version 299042 (0.0007) [2023-12-27 21:22:41,145][106226] Updated weights for policy 0, policy_version 299052 (0.0008) [2023-12-27 21:22:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 153272320. Throughput: 0: 9784.0, 1: 9970.0. Samples: 153248576. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:41,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.558')] [2023-12-27 21:22:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000299512_76693504.pth... [2023-12-27 21:22:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000298328_76390400.pth [2023-12-27 21:22:41,213][106226] Updated weights for policy 0, policy_version 299062 (0.0008) [2023-12-27 21:22:41,223][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000299064_76587008.pth... [2023-12-27 21:22:41,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000297944_76300288.pth [2023-12-27 21:22:41,386][106225] Updated weights for policy 1, policy_version 299519 (0.0008) [2023-12-27 21:22:41,453][106225] Updated weights for policy 1, policy_version 299529 (0.0009) [2023-12-27 21:22:41,510][106225] Updated weights for policy 1, policy_version 299539 (0.0008) [2023-12-27 21:22:41,933][106226] Updated weights for policy 0, policy_version 299072 (0.0008) [2023-12-27 21:22:41,995][106226] Updated weights for policy 0, policy_version 299082 (0.0009) [2023-12-27 21:22:42,057][106226] Updated weights for policy 0, policy_version 299092 (0.0009) [2023-12-27 21:22:42,327][106225] Updated weights for policy 1, policy_version 299549 (0.0008) [2023-12-27 21:22:42,398][106225] Updated weights for policy 1, policy_version 299559 (0.0009) [2023-12-27 21:22:42,468][106225] Updated weights for policy 1, policy_version 299569 (0.0009) [2023-12-27 21:22:42,827][106226] Updated weights for policy 0, policy_version 299102 (0.0009) [2023-12-27 21:22:42,896][106226] Updated weights for policy 0, policy_version 299112 (0.0007) [2023-12-27 21:22:42,968][106226] Updated weights for policy 0, policy_version 299122 (0.0006) [2023-12-27 21:22:43,119][106225] Updated weights for policy 1, policy_version 299579 (0.0008) [2023-12-27 21:22:43,178][106225] Updated weights for policy 1, policy_version 299589 (0.0005) [2023-12-27 21:22:43,234][106225] Updated weights for policy 1, policy_version 299599 (0.0007) [2023-12-27 21:22:43,608][106226] Updated weights for policy 0, policy_version 299132 (0.0009) [2023-12-27 21:22:43,654][106226] Updated weights for policy 0, policy_version 299142 (0.0010) [2023-12-27 21:22:43,714][106226] Updated weights for policy 0, policy_version 299152 (0.0010) [2023-12-27 21:22:43,794][106225] Updated weights for policy 1, policy_version 299609 (0.0008) [2023-12-27 21:22:43,858][106225] Updated weights for policy 1, policy_version 299619 (0.0010) [2023-12-27 21:22:43,909][106225] Updated weights for policy 1, policy_version 299629 (0.0010) [2023-12-27 21:22:43,966][106225] Updated weights for policy 1, policy_version 299639 (0.0010) [2023-12-27 21:22:44,382][106226] Updated weights for policy 0, policy_version 299162 (0.0011) [2023-12-27 21:22:44,443][106226] Updated weights for policy 0, policy_version 299172 (0.0011) [2023-12-27 21:22:44,503][106226] Updated weights for policy 0, policy_version 299182 (0.0010) [2023-12-27 21:22:44,567][106226] Updated weights for policy 0, policy_version 299192 (0.0010) [2023-12-27 21:22:44,664][106225] Updated weights for policy 1, policy_version 299649 (0.0010) [2023-12-27 21:22:44,726][106225] Updated weights for policy 1, policy_version 299659 (0.0010) [2023-12-27 21:22:44,788][106225] Updated weights for policy 1, policy_version 299669 (0.0010) [2023-12-27 21:22:45,281][106226] Updated weights for policy 0, policy_version 299202 (0.0005) [2023-12-27 21:22:45,345][106226] Updated weights for policy 0, policy_version 299212 (0.0005) [2023-12-27 21:22:45,403][106226] Updated weights for policy 0, policy_version 299222 (0.0005) [2023-12-27 21:22:45,495][106225] Updated weights for policy 1, policy_version 299679 (0.0009) [2023-12-27 21:22:45,549][106225] Updated weights for policy 1, policy_version 299689 (0.0010) [2023-12-27 21:22:45,599][106225] Updated weights for policy 1, policy_version 299699 (0.0010) [2023-12-27 21:22:45,914][106226] Updated weights for policy 0, policy_version 299232 (0.0005) [2023-12-27 21:22:45,973][106226] Updated weights for policy 0, policy_version 299242 (0.0005) [2023-12-27 21:22:46,029][106226] Updated weights for policy 0, policy_version 299252 (0.0005) [2023-12-27 21:22:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 153378816. Throughput: 0: 9694.1, 1: 9946.8. Samples: 153365860. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:46,176][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.620')] [2023-12-27 21:22:46,324][106225] Updated weights for policy 1, policy_version 299709 (0.0010) [2023-12-27 21:22:46,378][106225] Updated weights for policy 1, policy_version 299719 (0.0010) [2023-12-27 21:22:46,434][106225] Updated weights for policy 1, policy_version 299729 (0.0010) [2023-12-27 21:22:46,583][106226] Updated weights for policy 0, policy_version 299262 (0.0009) [2023-12-27 21:22:46,642][106226] Updated weights for policy 0, policy_version 299272 (0.0010) [2023-12-27 21:22:46,708][106226] Updated weights for policy 0, policy_version 299282 (0.0010) [2023-12-27 21:22:47,145][106225] Updated weights for policy 1, policy_version 299739 (0.0010) [2023-12-27 21:22:47,204][106225] Updated weights for policy 1, policy_version 299749 (0.0010) [2023-12-27 21:22:47,269][106225] Updated weights for policy 1, policy_version 299759 (0.0010) [2023-12-27 21:22:47,404][106226] Updated weights for policy 0, policy_version 299292 (0.0010) [2023-12-27 21:22:47,468][106226] Updated weights for policy 0, policy_version 299302 (0.0011) [2023-12-27 21:22:47,514][106226] Updated weights for policy 0, policy_version 299312 (0.0010) [2023-12-27 21:22:47,942][106225] Updated weights for policy 1, policy_version 299769 (0.0009) [2023-12-27 21:22:47,991][106225] Updated weights for policy 1, policy_version 299779 (0.0005) [2023-12-27 21:22:48,047][106225] Updated weights for policy 1, policy_version 299789 (0.0005) [2023-12-27 21:22:48,098][106225] Updated weights for policy 1, policy_version 299799 (0.0005) [2023-12-27 21:22:48,210][106226] Updated weights for policy 0, policy_version 299322 (0.0009) [2023-12-27 21:22:48,266][106226] Updated weights for policy 0, policy_version 299332 (0.0010) [2023-12-27 21:22:48,319][106226] Updated weights for policy 0, policy_version 299342 (0.0010) [2023-12-27 21:22:48,386][106226] Updated weights for policy 0, policy_version 299352 (0.0009) [2023-12-27 21:22:48,767][106225] Updated weights for policy 1, policy_version 299809 (0.0010) [2023-12-27 21:22:48,821][106225] Updated weights for policy 1, policy_version 299819 (0.0010) [2023-12-27 21:22:48,878][106225] Updated weights for policy 1, policy_version 299829 (0.0010) [2023-12-27 21:22:49,027][106226] Updated weights for policy 0, policy_version 299362 (0.0008) [2023-12-27 21:22:49,088][106226] Updated weights for policy 0, policy_version 299372 (0.0008) [2023-12-27 21:22:49,150][106226] Updated weights for policy 0, policy_version 299382 (0.0008) [2023-12-27 21:22:49,581][106225] Updated weights for policy 1, policy_version 299839 (0.0010) [2023-12-27 21:22:49,642][106225] Updated weights for policy 1, policy_version 299849 (0.0010) [2023-12-27 21:22:49,705][106225] Updated weights for policy 1, policy_version 299859 (0.0009) [2023-12-27 21:22:49,970][106226] Updated weights for policy 0, policy_version 299392 (0.0009) [2023-12-27 21:22:50,034][106226] Updated weights for policy 0, policy_version 299402 (0.0008) [2023-12-27 21:22:50,099][106226] Updated weights for policy 0, policy_version 299412 (0.0008) [2023-12-27 21:22:50,389][106225] Updated weights for policy 1, policy_version 299869 (0.0008) [2023-12-27 21:22:50,456][106225] Updated weights for policy 1, policy_version 299879 (0.0009) [2023-12-27 21:22:50,505][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000008 [2023-12-27 21:22:50,763][106226] Updated weights for policy 0, policy_version 299422 (0.0008) [2023-12-27 21:22:50,834][106226] Updated weights for policy 0, policy_version 299432 (0.0006) [2023-12-27 21:22:50,902][106226] Updated weights for policy 0, policy_version 299442 (0.0009) [2023-12-27 21:22:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 153477120. Throughput: 0: 9738.0, 1: 9989.6. Samples: 153487620. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:51,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-5.847')] [2023-12-27 21:22:51,182][106225] Updated weights for policy 1, policy_version 299889 (0.0010) [2023-12-27 21:22:51,251][106225] Updated weights for policy 1, policy_version 299899 (0.0008) [2023-12-27 21:22:51,321][106225] Updated weights for policy 1, policy_version 299909 (0.0008) [2023-12-27 21:22:51,389][106225] Updated weights for policy 1, policy_version 299919 (0.0008) [2023-12-27 21:22:51,591][106226] Updated weights for policy 0, policy_version 299452 (0.0008) [2023-12-27 21:22:51,663][106226] Updated weights for policy 0, policy_version 299462 (0.0009) [2023-12-27 21:22:51,734][106226] Updated weights for policy 0, policy_version 299472 (0.0008) [2023-12-27 21:22:52,153][106225] Updated weights for policy 1, policy_version 299929 (0.0008) [2023-12-27 21:22:52,198][106225] Updated weights for policy 1, policy_version 299939 (0.0008) [2023-12-27 21:22:52,242][106225] Updated weights for policy 1, policy_version 299949 (0.0007) [2023-12-27 21:22:52,386][106226] Updated weights for policy 0, policy_version 299482 (0.0007) [2023-12-27 21:22:52,451][106226] Updated weights for policy 0, policy_version 299492 (0.0006) [2023-12-27 21:22:52,505][106226] Updated weights for policy 0, policy_version 299502 (0.0009) [2023-12-27 21:22:52,567][106226] Updated weights for policy 0, policy_version 299512 (0.0009) [2023-12-27 21:22:52,952][106225] Updated weights for policy 1, policy_version 299959 (0.0008) [2023-12-27 21:22:53,010][106225] Updated weights for policy 1, policy_version 299969 (0.0011) [2023-12-27 21:22:53,067][106225] Updated weights for policy 1, policy_version 299979 (0.0009) [2023-12-27 21:22:53,214][106226] Updated weights for policy 0, policy_version 299522 (0.0005) [2023-12-27 21:22:53,262][106226] Updated weights for policy 0, policy_version 299532 (0.0005) [2023-12-27 21:22:53,306][106226] Updated weights for policy 0, policy_version 299542 (0.0005) [2023-12-27 21:22:53,793][106225] Updated weights for policy 1, policy_version 299989 (0.0008) [2023-12-27 21:22:53,857][106225] Updated weights for policy 1, policy_version 299999 (0.0008) [2023-12-27 21:22:53,906][106226] Updated weights for policy 0, policy_version 299552 (0.0007) [2023-12-27 21:22:53,923][106225] Updated weights for policy 1, policy_version 300009 (0.0008) [2023-12-27 21:22:53,949][106226] Updated weights for policy 0, policy_version 299562 (0.0005) [2023-12-27 21:22:54,000][106226] Updated weights for policy 0, policy_version 299572 (0.0007) [2023-12-27 21:22:54,544][106225] Updated weights for policy 1, policy_version 300019 (0.0007) [2023-12-27 21:22:54,608][106225] Updated weights for policy 1, policy_version 300029 (0.0007) [2023-12-27 21:22:54,666][106225] Updated weights for policy 1, policy_version 300039 (0.0006) [2023-12-27 21:22:54,767][106226] Updated weights for policy 0, policy_version 299582 (0.0010) [2023-12-27 21:22:54,815][106226] Updated weights for policy 0, policy_version 299592 (0.0007) [2023-12-27 21:22:54,865][106226] Updated weights for policy 0, policy_version 299602 (0.0007) [2023-12-27 21:22:55,249][106225] Updated weights for policy 1, policy_version 300049 (0.0005) [2023-12-27 21:22:55,305][106225] Updated weights for policy 1, policy_version 300059 (0.0005) [2023-12-27 21:22:55,362][106225] Updated weights for policy 1, policy_version 300069 (0.0005) [2023-12-27 21:22:55,415][106225] Updated weights for policy 1, policy_version 300079 (0.0005) [2023-12-27 21:22:55,679][106226] Updated weights for policy 0, policy_version 299612 (0.0008) [2023-12-27 21:22:55,727][106226] Updated weights for policy 0, policy_version 299622 (0.0009) [2023-12-27 21:22:55,782][106226] Updated weights for policy 0, policy_version 299632 (0.0009) [2023-12-27 21:22:56,015][106225] Updated weights for policy 1, policy_version 300089 (0.0005) [2023-12-27 21:22:56,072][106225] Updated weights for policy 1, policy_version 300099 (0.0005) [2023-12-27 21:22:56,124][106225] Updated weights for policy 1, policy_version 300109 (0.0006) [2023-12-27 21:22:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 153583616. Throughput: 0: 9736.1, 1: 9968.3. Samples: 153547396. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:22:56,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-5.252')] [2023-12-27 21:22:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000300112_76849152.pth... [2023-12-27 21:22:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000299640_76734464.pth... [2023-12-27 21:22:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000298936_76546048.pth [2023-12-27 21:22:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000298488_76439552.pth [2023-12-27 21:22:56,572][106226] Updated weights for policy 0, policy_version 299642 (0.0009) [2023-12-27 21:22:56,639][106226] Updated weights for policy 0, policy_version 299652 (0.0010) [2023-12-27 21:22:56,689][106226] Updated weights for policy 0, policy_version 299662 (0.0007) [2023-12-27 21:22:56,708][106225] Updated weights for policy 1, policy_version 300119 (0.0006) [2023-12-27 21:22:56,733][106226] Updated weights for policy 0, policy_version 299672 (0.0007) [2023-12-27 21:22:56,759][106225] Updated weights for policy 1, policy_version 300129 (0.0005) [2023-12-27 21:22:56,813][106225] Updated weights for policy 1, policy_version 300139 (0.0005) [2023-12-27 21:22:57,469][106225] Updated weights for policy 1, policy_version 300149 (0.0008) [2023-12-27 21:22:57,482][106226] Updated weights for policy 0, policy_version 299682 (0.0007) [2023-12-27 21:22:57,525][106225] Updated weights for policy 1, policy_version 300159 (0.0010) [2023-12-27 21:22:57,539][106226] Updated weights for policy 0, policy_version 299692 (0.0005) [2023-12-27 21:22:57,586][106225] Updated weights for policy 1, policy_version 300169 (0.0009) [2023-12-27 21:22:57,595][106226] Updated weights for policy 0, policy_version 299702 (0.0007) [2023-12-27 21:22:58,271][106226] Updated weights for policy 0, policy_version 299712 (0.0008) [2023-12-27 21:22:58,338][106226] Updated weights for policy 0, policy_version 299722 (0.0006) [2023-12-27 21:22:58,351][106225] Updated weights for policy 1, policy_version 300179 (0.0007) [2023-12-27 21:22:58,404][106226] Updated weights for policy 0, policy_version 299732 (0.0008) [2023-12-27 21:22:58,414][106225] Updated weights for policy 1, policy_version 300189 (0.0007) [2023-12-27 21:22:58,475][106225] Updated weights for policy 1, policy_version 300199 (0.0007) [2023-12-27 21:22:59,157][106226] Updated weights for policy 0, policy_version 299742 (0.0007) [2023-12-27 21:22:59,225][106226] Updated weights for policy 0, policy_version 299753 (0.0007) [2023-12-27 21:22:59,296][106226] Updated weights for policy 0, policy_version 299763 (0.0009) [2023-12-27 21:22:59,299][106225] Updated weights for policy 1, policy_version 300209 (0.0008) [2023-12-27 21:22:59,362][106225] Updated weights for policy 1, policy_version 300219 (0.0008) [2023-12-27 21:22:59,423][106225] Updated weights for policy 1, policy_version 300229 (0.0007) [2023-12-27 21:22:59,488][106225] Updated weights for policy 1, policy_version 300239 (0.0008) [2023-12-27 21:23:00,117][106226] Updated weights for policy 0, policy_version 299773 (0.0008) [2023-12-27 21:23:00,177][106226] Updated weights for policy 0, policy_version 299783 (0.0010) [2023-12-27 21:23:00,198][106225] Updated weights for policy 1, policy_version 300249 (0.0006) [2023-12-27 21:23:00,245][106226] Updated weights for policy 0, policy_version 299793 (0.0007) [2023-12-27 21:23:00,258][106225] Updated weights for policy 1, policy_version 300259 (0.0007) [2023-12-27 21:23:00,323][106225] Updated weights for policy 1, policy_version 300269 (0.0008) [2023-12-27 21:23:00,959][106226] Updated weights for policy 0, policy_version 299803 (0.0006) [2023-12-27 21:23:01,004][106226] Updated weights for policy 0, policy_version 299813 (0.0009) [2023-12-27 21:23:01,010][106225] Updated weights for policy 1, policy_version 300279 (0.0008) [2023-12-27 21:23:01,067][106226] Updated weights for policy 0, policy_version 299823 (0.0009) [2023-12-27 21:23:01,073][106225] Updated weights for policy 1, policy_version 300289 (0.0008) [2023-12-27 21:23:01,133][106225] Updated weights for policy 1, policy_version 300299 (0.0006) [2023-12-27 21:23:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 153681920. Throughput: 0: 9704.1, 1: 10038.9. Samples: 153664904. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:23:01,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-5.314')] [2023-12-27 21:23:01,846][106226] Updated weights for policy 0, policy_version 299833 (0.0006) [2023-12-27 21:23:01,885][106225] Updated weights for policy 1, policy_version 300309 (0.0009) [2023-12-27 21:23:01,904][106226] Updated weights for policy 0, policy_version 299843 (0.0009) [2023-12-27 21:23:01,939][106225] Updated weights for policy 1, policy_version 300319 (0.0010) [2023-12-27 21:23:01,960][106226] Updated weights for policy 0, policy_version 299853 (0.0007) [2023-12-27 21:23:01,997][106225] Updated weights for policy 1, policy_version 300329 (0.0007) [2023-12-27 21:23:02,018][106226] Updated weights for policy 0, policy_version 299863 (0.0005) [2023-12-27 21:23:02,638][106225] Updated weights for policy 1, policy_version 300339 (0.0006) [2023-12-27 21:23:02,693][106225] Updated weights for policy 1, policy_version 300349 (0.0005) [2023-12-27 21:23:02,755][106225] Updated weights for policy 1, policy_version 300359 (0.0005) [2023-12-27 21:23:02,778][106226] Updated weights for policy 0, policy_version 299873 (0.0007) [2023-12-27 21:23:02,823][106226] Updated weights for policy 0, policy_version 299883 (0.0008) [2023-12-27 21:23:02,878][106226] Updated weights for policy 0, policy_version 299893 (0.0007) [2023-12-27 21:23:03,419][106225] Updated weights for policy 1, policy_version 300369 (0.0006) [2023-12-27 21:23:03,477][106225] Updated weights for policy 1, policy_version 300379 (0.0008) [2023-12-27 21:23:03,533][106225] Updated weights for policy 1, policy_version 300389 (0.0007) [2023-12-27 21:23:03,585][106225] Updated weights for policy 1, policy_version 300399 (0.0007) [2023-12-27 21:23:03,625][106226] Updated weights for policy 0, policy_version 299903 (0.0009) [2023-12-27 21:23:03,684][106226] Updated weights for policy 0, policy_version 299913 (0.0010) [2023-12-27 21:23:03,740][106226] Updated weights for policy 0, policy_version 299923 (0.0010) [2023-12-27 21:23:04,364][106225] Updated weights for policy 1, policy_version 300409 (0.0008) [2023-12-27 21:23:04,422][106225] Updated weights for policy 1, policy_version 300419 (0.0008) [2023-12-27 21:23:04,466][106226] Updated weights for policy 0, policy_version 299933 (0.0010) [2023-12-27 21:23:04,476][106225] Updated weights for policy 1, policy_version 300429 (0.0006) [2023-12-27 21:23:04,527][106226] Updated weights for policy 0, policy_version 299943 (0.0010) [2023-12-27 21:23:04,590][106226] Updated weights for policy 0, policy_version 299953 (0.0010) [2023-12-27 21:23:05,206][106225] Updated weights for policy 1, policy_version 300439 (0.0007) [2023-12-27 21:23:05,263][106225] Updated weights for policy 1, policy_version 300449 (0.0008) [2023-12-27 21:23:05,302][106226] Updated weights for policy 0, policy_version 299963 (0.0010) [2023-12-27 21:23:05,323][106225] Updated weights for policy 1, policy_version 300459 (0.0006) [2023-12-27 21:23:05,349][106226] Updated weights for policy 0, policy_version 299973 (0.0010) [2023-12-27 21:23:05,398][106226] Updated weights for policy 0, policy_version 299983 (0.0010) [2023-12-27 21:23:06,055][106225] Updated weights for policy 1, policy_version 300469 (0.0007) [2023-12-27 21:23:06,102][106225] Updated weights for policy 1, policy_version 300479 (0.0008) [2023-12-27 21:23:06,137][106226] Updated weights for policy 0, policy_version 299993 (0.0010) [2023-12-27 21:23:06,169][106225] Updated weights for policy 1, policy_version 300489 (0.0007) [2023-12-27 21:23:06,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 153763840. Throughput: 0: 9661.0, 1: 10022.8. Samples: 153779892. Policy #0 lag: (min: 1.0, avg: 22.0, max: 33.0) [2023-12-27 21:23:06,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-5.445')] [2023-12-27 21:23:06,199][106226] Updated weights for policy 0, policy_version 300003 (0.0011) [2023-12-27 21:23:06,264][106226] Updated weights for policy 0, policy_version 300013 (0.0011) [2023-12-27 21:23:06,326][106226] Updated weights for policy 0, policy_version 300023 (0.0010) [2023-12-27 21:23:06,849][106225] Updated weights for policy 1, policy_version 300499 (0.0006) [2023-12-27 21:23:06,911][106225] Updated weights for policy 1, policy_version 300509 (0.0008) [2023-12-27 21:23:06,959][106225] Updated weights for policy 1, policy_version 300519 (0.0010) [2023-12-27 21:23:06,975][106226] Updated weights for policy 0, policy_version 300033 (0.0006) [2023-12-27 21:23:07,043][106226] Updated weights for policy 0, policy_version 300043 (0.0006) [2023-12-27 21:23:07,101][106226] Updated weights for policy 0, policy_version 300053 (0.0006) [2023-12-27 21:23:07,632][106225] Updated weights for policy 1, policy_version 300529 (0.0010) [2023-12-27 21:23:07,694][106225] Updated weights for policy 1, policy_version 300539 (0.0008) [2023-12-27 21:23:07,748][106225] Updated weights for policy 1, policy_version 300549 (0.0010) [2023-12-27 21:23:07,765][106226] Updated weights for policy 0, policy_version 300063 (0.0006) [2023-12-27 21:23:07,806][106225] Updated weights for policy 1, policy_version 300559 (0.0010) [2023-12-27 21:23:07,826][106226] Updated weights for policy 0, policy_version 300073 (0.0010) [2023-12-27 21:23:07,882][106226] Updated weights for policy 0, policy_version 300083 (0.0010) [2023-12-27 21:23:08,477][106225] Updated weights for policy 1, policy_version 300569 (0.0008) [2023-12-27 21:23:08,483][106226] Updated weights for policy 0, policy_version 300093 (0.0008) [2023-12-27 21:23:08,537][106225] Updated weights for policy 1, policy_version 300579 (0.0008) [2023-12-27 21:23:08,541][106226] Updated weights for policy 0, policy_version 300103 (0.0010) [2023-12-27 21:23:08,595][106225] Updated weights for policy 1, policy_version 300589 (0.0008) [2023-12-27 21:23:08,599][106226] Updated weights for policy 0, policy_version 300113 (0.0011) [2023-12-27 21:23:09,319][106226] Updated weights for policy 0, policy_version 300123 (0.0012) [2023-12-27 21:23:09,326][106225] Updated weights for policy 1, policy_version 300599 (0.0008) [2023-12-27 21:23:09,388][106226] Updated weights for policy 0, policy_version 300133 (0.0010) [2023-12-27 21:23:09,406][106225] Updated weights for policy 1, policy_version 300609 (0.0008) [2023-12-27 21:23:09,459][106226] Updated weights for policy 0, policy_version 300143 (0.0009) [2023-12-27 21:23:09,466][106225] Updated weights for policy 1, policy_version 300619 (0.0006) [2023-12-27 21:23:10,204][106226] Updated weights for policy 0, policy_version 300153 (0.0007) [2023-12-27 21:23:10,216][106225] Updated weights for policy 1, policy_version 300629 (0.0008) [2023-12-27 21:23:10,260][106226] Updated weights for policy 0, policy_version 300163 (0.0008) [2023-12-27 21:23:10,272][106225] Updated weights for policy 1, policy_version 300639 (0.0008) [2023-12-27 21:23:10,320][106226] Updated weights for policy 0, policy_version 300173 (0.0009) [2023-12-27 21:23:10,326][106225] Updated weights for policy 1, policy_version 300649 (0.0007) [2023-12-27 21:23:10,382][106226] Updated weights for policy 0, policy_version 300183 (0.0008) [2023-12-27 21:23:10,979][106225] Updated weights for policy 1, policy_version 300659 (0.0006) [2023-12-27 21:23:11,045][106225] Updated weights for policy 1, policy_version 300669 (0.0007) [2023-12-27 21:23:11,103][106226] Updated weights for policy 0, policy_version 300193 (0.0008) [2023-12-27 21:23:11,108][106225] Updated weights for policy 1, policy_version 300679 (0.0009) [2023-12-27 21:23:11,174][106226] Updated weights for policy 0, policy_version 300203 (0.0008) [2023-12-27 21:23:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 153870336. Throughput: 0: 9733.6, 1: 10072.6. Samples: 153840720. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:11,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.594')] [2023-12-27 21:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000300688_76996608.pth... [2023-12-27 21:23:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000299512_76693504.pth [2023-12-27 21:23:11,237][106226] Updated weights for policy 0, policy_version 300213 (0.0009) [2023-12-27 21:23:11,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000300216_76881920.pth... [2023-12-27 21:23:11,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000299064_76587008.pth [2023-12-27 21:23:11,920][106225] Updated weights for policy 1, policy_version 300689 (0.0009) [2023-12-27 21:23:11,992][106225] Updated weights for policy 1, policy_version 300699 (0.0010) [2023-12-27 21:23:12,059][106226] Updated weights for policy 0, policy_version 300223 (0.0007) [2023-12-27 21:23:12,061][106225] Updated weights for policy 1, policy_version 300709 (0.0011) [2023-12-27 21:23:12,119][106226] Updated weights for policy 0, policy_version 300233 (0.0006) [2023-12-27 21:23:12,128][106225] Updated weights for policy 1, policy_version 300719 (0.0010) [2023-12-27 21:23:12,184][106226] Updated weights for policy 0, policy_version 300243 (0.0006) [2023-12-27 21:23:12,826][106225] Updated weights for policy 1, policy_version 300729 (0.0009) [2023-12-27 21:23:12,886][106226] Updated weights for policy 0, policy_version 300253 (0.0008) [2023-12-27 21:23:12,890][106225] Updated weights for policy 1, policy_version 300739 (0.0009) [2023-12-27 21:23:12,945][106226] Updated weights for policy 0, policy_version 300263 (0.0009) [2023-12-27 21:23:12,953][106225] Updated weights for policy 1, policy_version 300749 (0.0007) [2023-12-27 21:23:13,006][106226] Updated weights for policy 0, policy_version 300273 (0.0005) [2023-12-27 21:23:13,618][106225] Updated weights for policy 1, policy_version 300759 (0.0008) [2023-12-27 21:23:13,638][106226] Updated weights for policy 0, policy_version 300283 (0.0007) [2023-12-27 21:23:13,677][106225] Updated weights for policy 1, policy_version 300769 (0.0009) [2023-12-27 21:23:13,696][106226] Updated weights for policy 0, policy_version 300293 (0.0010) [2023-12-27 21:23:13,739][106225] Updated weights for policy 1, policy_version 300779 (0.0007) [2023-12-27 21:23:13,753][106226] Updated weights for policy 0, policy_version 300303 (0.0010) [2023-12-27 21:23:14,453][106226] Updated weights for policy 0, policy_version 300313 (0.0010) [2023-12-27 21:23:14,484][106225] Updated weights for policy 1, policy_version 300789 (0.0005) [2023-12-27 21:23:14,500][106226] Updated weights for policy 0, policy_version 300323 (0.0006) [2023-12-27 21:23:14,557][106226] Updated weights for policy 0, policy_version 300333 (0.0007) [2023-12-27 21:23:14,559][106225] Updated weights for policy 1, policy_version 300799 (0.0006) [2023-12-27 21:23:14,613][106226] Updated weights for policy 0, policy_version 300343 (0.0007) [2023-12-27 21:23:14,625][106225] Updated weights for policy 1, policy_version 300809 (0.0007) [2023-12-27 21:23:15,309][106225] Updated weights for policy 1, policy_version 300819 (0.0008) [2023-12-27 21:23:15,324][106226] Updated weights for policy 0, policy_version 300353 (0.0011) [2023-12-27 21:23:15,362][106225] Updated weights for policy 1, policy_version 300829 (0.0006) [2023-12-27 21:23:15,382][106226] Updated weights for policy 0, policy_version 300363 (0.0011) [2023-12-27 21:23:15,410][106225] Updated weights for policy 1, policy_version 300839 (0.0009) [2023-12-27 21:23:15,439][106226] Updated weights for policy 0, policy_version 300373 (0.0011) [2023-12-27 21:23:16,115][106226] Updated weights for policy 0, policy_version 300383 (0.0010) [2023-12-27 21:23:16,162][106225] Updated weights for policy 1, policy_version 300849 (0.0006) [2023-12-27 21:23:16,171][106226] Updated weights for policy 0, policy_version 300393 (0.0010) [2023-12-27 21:23:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 153960448. Throughput: 0: 9772.4, 1: 9911.6. Samples: 153956848. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:16,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.598')] [2023-12-27 21:23:16,211][106225] Updated weights for policy 1, policy_version 300859 (0.0008) [2023-12-27 21:23:16,231][106226] Updated weights for policy 0, policy_version 300403 (0.0010) [2023-12-27 21:23:16,258][106225] Updated weights for policy 1, policy_version 300869 (0.0007) [2023-12-27 21:23:16,306][106225] Updated weights for policy 1, policy_version 300879 (0.0007) [2023-12-27 21:23:16,912][106226] Updated weights for policy 0, policy_version 300413 (0.0008) [2023-12-27 21:23:16,962][106226] Updated weights for policy 0, policy_version 300423 (0.0006) [2023-12-27 21:23:16,991][106225] Updated weights for policy 1, policy_version 300889 (0.0007) [2023-12-27 21:23:17,016][106226] Updated weights for policy 0, policy_version 300433 (0.0006) [2023-12-27 21:23:17,045][106225] Updated weights for policy 1, policy_version 300899 (0.0007) [2023-12-27 21:23:17,111][106225] Updated weights for policy 1, policy_version 300909 (0.0008) [2023-12-27 21:23:17,567][106226] Updated weights for policy 0, policy_version 300443 (0.0007) [2023-12-27 21:23:17,614][106226] Updated weights for policy 0, policy_version 300453 (0.0006) [2023-12-27 21:23:17,661][106226] Updated weights for policy 0, policy_version 300463 (0.0006) [2023-12-27 21:23:17,879][106225] Updated weights for policy 1, policy_version 300919 (0.0008) [2023-12-27 21:23:17,946][106225] Updated weights for policy 1, policy_version 300929 (0.0009) [2023-12-27 21:23:18,003][106225] Updated weights for policy 1, policy_version 300939 (0.0008) [2023-12-27 21:23:18,372][106226] Updated weights for policy 0, policy_version 300473 (0.0009) [2023-12-27 21:23:18,433][106226] Updated weights for policy 0, policy_version 300483 (0.0011) [2023-12-27 21:23:18,486][106226] Updated weights for policy 0, policy_version 300493 (0.0010) [2023-12-27 21:23:18,544][106226] Updated weights for policy 0, policy_version 300503 (0.0010) [2023-12-27 21:23:18,742][106225] Updated weights for policy 1, policy_version 300949 (0.0007) [2023-12-27 21:23:18,802][106225] Updated weights for policy 1, policy_version 300959 (0.0005) [2023-12-27 21:23:18,849][106225] Updated weights for policy 1, policy_version 300969 (0.0007) [2023-12-27 21:23:19,227][106226] Updated weights for policy 0, policy_version 300513 (0.0008) [2023-12-27 21:23:19,286][106226] Updated weights for policy 0, policy_version 300523 (0.0008) [2023-12-27 21:23:19,344][106226] Updated weights for policy 0, policy_version 300533 (0.0008) [2023-12-27 21:23:19,510][106225] Updated weights for policy 1, policy_version 300979 (0.0008) [2023-12-27 21:23:19,581][106225] Updated weights for policy 1, policy_version 300989 (0.0006) [2023-12-27 21:23:19,641][106225] Updated weights for policy 1, policy_version 300999 (0.0006) [2023-12-27 21:23:19,983][106226] Updated weights for policy 0, policy_version 300543 (0.0008) [2023-12-27 21:23:20,047][106226] Updated weights for policy 0, policy_version 300553 (0.0009) [2023-12-27 21:23:20,110][106226] Updated weights for policy 0, policy_version 300563 (0.0009) [2023-12-27 21:23:20,297][106225] Updated weights for policy 1, policy_version 301009 (0.0006) [2023-12-27 21:23:20,363][106225] Updated weights for policy 1, policy_version 301019 (0.0010) [2023-12-27 21:23:20,430][106225] Updated weights for policy 1, policy_version 301029 (0.0009) [2023-12-27 21:23:20,492][106225] Updated weights for policy 1, policy_version 301039 (0.0008) [2023-12-27 21:23:20,863][106226] Updated weights for policy 0, policy_version 300573 (0.0008) [2023-12-27 21:23:20,930][106226] Updated weights for policy 0, policy_version 300583 (0.0008) [2023-12-27 21:23:20,984][106226] Updated weights for policy 0, policy_version 300593 (0.0009) [2023-12-27 21:23:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 154066944. Throughput: 0: 9793.0, 1: 9897.6. Samples: 154075676. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:21,175][105115] Avg episode reward: [(0, '-4.910'), (1, '-5.592')] [2023-12-27 21:23:21,324][106225] Updated weights for policy 1, policy_version 301049 (0.0007) [2023-12-27 21:23:21,405][106225] Updated weights for policy 1, policy_version 301059 (0.0008) [2023-12-27 21:23:21,468][106225] Updated weights for policy 1, policy_version 301069 (0.0008) [2023-12-27 21:23:21,653][106226] Updated weights for policy 0, policy_version 300603 (0.0009) [2023-12-27 21:23:21,732][106226] Updated weights for policy 0, policy_version 300613 (0.0009) [2023-12-27 21:23:21,802][106226] Updated weights for policy 0, policy_version 300623 (0.0006) [2023-12-27 21:23:22,229][106225] Updated weights for policy 1, policy_version 301079 (0.0008) [2023-12-27 21:23:22,291][106225] Updated weights for policy 1, policy_version 301089 (0.0008) [2023-12-27 21:23:22,363][106225] Updated weights for policy 1, policy_version 301099 (0.0007) [2023-12-27 21:23:22,557][106226] Updated weights for policy 0, policy_version 300633 (0.0006) [2023-12-27 21:23:22,620][106226] Updated weights for policy 0, policy_version 300643 (0.0008) [2023-12-27 21:23:22,684][106226] Updated weights for policy 0, policy_version 300653 (0.0008) [2023-12-27 21:23:22,750][106226] Updated weights for policy 0, policy_version 300663 (0.0008) [2023-12-27 21:23:23,107][106225] Updated weights for policy 1, policy_version 301109 (0.0009) [2023-12-27 21:23:23,157][106225] Updated weights for policy 1, policy_version 301119 (0.0009) [2023-12-27 21:23:23,206][106225] Updated weights for policy 1, policy_version 301129 (0.0008) [2023-12-27 21:23:23,474][106226] Updated weights for policy 0, policy_version 300673 (0.0009) [2023-12-27 21:23:23,528][106226] Updated weights for policy 0, policy_version 300683 (0.0009) [2023-12-27 21:23:23,583][106226] Updated weights for policy 0, policy_version 300693 (0.0008) [2023-12-27 21:23:23,895][106225] Updated weights for policy 1, policy_version 301139 (0.0006) [2023-12-27 21:23:23,945][106225] Updated weights for policy 1, policy_version 301149 (0.0008) [2023-12-27 21:23:23,997][106225] Updated weights for policy 1, policy_version 301159 (0.0008) [2023-12-27 21:23:24,318][106226] Updated weights for policy 0, policy_version 300703 (0.0008) [2023-12-27 21:23:24,368][106226] Updated weights for policy 0, policy_version 300713 (0.0008) [2023-12-27 21:23:24,425][106226] Updated weights for policy 0, policy_version 300723 (0.0009) [2023-12-27 21:23:24,736][106225] Updated weights for policy 1, policy_version 301169 (0.0009) [2023-12-27 21:23:24,797][106225] Updated weights for policy 1, policy_version 301179 (0.0008) [2023-12-27 21:23:24,855][106225] Updated weights for policy 1, policy_version 301189 (0.0009) [2023-12-27 21:23:24,913][106225] Updated weights for policy 1, policy_version 301199 (0.0008) [2023-12-27 21:23:25,169][106226] Updated weights for policy 0, policy_version 300733 (0.0008) [2023-12-27 21:23:25,233][106226] Updated weights for policy 0, policy_version 300743 (0.0007) [2023-12-27 21:23:25,299][106226] Updated weights for policy 0, policy_version 300753 (0.0007) [2023-12-27 21:23:25,528][106225] Updated weights for policy 1, policy_version 301209 (0.0006) [2023-12-27 21:23:25,589][106225] Updated weights for policy 1, policy_version 301219 (0.0005) [2023-12-27 21:23:25,650][106225] Updated weights for policy 1, policy_version 301229 (0.0005) [2023-12-27 21:23:26,095][106226] Updated weights for policy 0, policy_version 300763 (0.0009) [2023-12-27 21:23:26,160][106226] Updated weights for policy 0, policy_version 300773 (0.0009) [2023-12-27 21:23:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 154157056. Throughput: 0: 9808.9, 1: 9830.9. Samples: 154132368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:26,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-5.163')] [2023-12-27 21:23:26,180][106225] Updated weights for policy 1, policy_version 301239 (0.0008) [2023-12-27 21:23:26,221][106226] Updated weights for policy 0, policy_version 300783 (0.0007) [2023-12-27 21:23:26,234][106225] Updated weights for policy 1, policy_version 301249 (0.0006) [2023-12-27 21:23:26,277][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000300792_77029376.pth... [2023-12-27 21:23:26,280][106225] Updated weights for policy 1, policy_version 301259 (0.0007) [2023-12-27 21:23:26,281][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000299640_76734464.pth [2023-12-27 21:23:26,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000301264_77144064.pth... [2023-12-27 21:23:26,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000300112_76849152.pth [2023-12-27 21:23:26,307][106141] Saving new best policy, reward=-5.163! [2023-12-27 21:23:26,897][106225] Updated weights for policy 1, policy_version 301269 (0.0007) [2023-12-27 21:23:26,946][106225] Updated weights for policy 1, policy_version 301279 (0.0005) [2023-12-27 21:23:26,980][106226] Updated weights for policy 0, policy_version 300793 (0.0008) [2023-12-27 21:23:26,992][106225] Updated weights for policy 1, policy_version 301289 (0.0005) [2023-12-27 21:23:27,037][106226] Updated weights for policy 0, policy_version 300803 (0.0009) [2023-12-27 21:23:27,099][106226] Updated weights for policy 0, policy_version 300813 (0.0008) [2023-12-27 21:23:27,159][106226] Updated weights for policy 0, policy_version 300823 (0.0008) [2023-12-27 21:23:27,535][106225] Updated weights for policy 1, policy_version 301299 (0.0005) [2023-12-27 21:23:27,581][106225] Updated weights for policy 1, policy_version 301309 (0.0005) [2023-12-27 21:23:27,634][106225] Updated weights for policy 1, policy_version 301319 (0.0007) [2023-12-27 21:23:27,948][106226] Updated weights for policy 0, policy_version 300833 (0.0008) [2023-12-27 21:23:28,011][106226] Updated weights for policy 0, policy_version 300843 (0.0008) [2023-12-27 21:23:28,077][106226] Updated weights for policy 0, policy_version 300853 (0.0009) [2023-12-27 21:23:28,320][106225] Updated weights for policy 1, policy_version 301329 (0.0008) [2023-12-27 21:23:28,385][106225] Updated weights for policy 1, policy_version 301339 (0.0006) [2023-12-27 21:23:28,443][106225] Updated weights for policy 1, policy_version 301349 (0.0006) [2023-12-27 21:23:28,498][106225] Updated weights for policy 1, policy_version 301359 (0.0006) [2023-12-27 21:23:28,857][106226] Updated weights for policy 0, policy_version 300863 (0.0009) [2023-12-27 21:23:28,903][106226] Updated weights for policy 0, policy_version 300873 (0.0009) [2023-12-27 21:23:28,957][106226] Updated weights for policy 0, policy_version 300883 (0.0008) [2023-12-27 21:23:29,068][106225] Updated weights for policy 1, policy_version 301369 (0.0008) [2023-12-27 21:23:29,129][106225] Updated weights for policy 1, policy_version 301379 (0.0007) [2023-12-27 21:23:29,197][106225] Updated weights for policy 1, policy_version 301389 (0.0005) [2023-12-27 21:23:29,679][106226] Updated weights for policy 0, policy_version 300893 (0.0008) [2023-12-27 21:23:29,746][106226] Updated weights for policy 0, policy_version 300903 (0.0009) [2023-12-27 21:23:29,804][106226] Updated weights for policy 0, policy_version 300913 (0.0008) [2023-12-27 21:23:29,902][106225] Updated weights for policy 1, policy_version 301399 (0.0009) [2023-12-27 21:23:29,965][106225] Updated weights for policy 1, policy_version 301409 (0.0008) [2023-12-27 21:23:30,020][106225] Updated weights for policy 1, policy_version 301419 (0.0008) [2023-12-27 21:23:30,551][106226] Updated weights for policy 0, policy_version 300923 (0.0009) [2023-12-27 21:23:30,605][106226] Updated weights for policy 0, policy_version 300933 (0.0007) [2023-12-27 21:23:30,659][106226] Updated weights for policy 0, policy_version 300943 (0.0006) [2023-12-27 21:23:30,745][106225] Updated weights for policy 1, policy_version 301429 (0.0008) [2023-12-27 21:23:30,790][106225] Updated weights for policy 1, policy_version 301439 (0.0008) [2023-12-27 21:23:30,841][106225] Updated weights for policy 1, policy_version 301449 (0.0008) [2023-12-27 21:23:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 154263552. Throughput: 0: 9756.3, 1: 9962.2. Samples: 154253192. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:31,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.746')] [2023-12-27 21:23:31,395][106226] Updated weights for policy 0, policy_version 300953 (0.0008) [2023-12-27 21:23:31,457][106226] Updated weights for policy 0, policy_version 300963 (0.0008) [2023-12-27 21:23:31,525][106226] Updated weights for policy 0, policy_version 300973 (0.0008) [2023-12-27 21:23:31,592][106226] Updated weights for policy 0, policy_version 300983 (0.0009) [2023-12-27 21:23:31,602][106225] Updated weights for policy 1, policy_version 301459 (0.0008) [2023-12-27 21:23:31,665][106225] Updated weights for policy 1, policy_version 301469 (0.0008) [2023-12-27 21:23:31,728][106225] Updated weights for policy 1, policy_version 301479 (0.0008) [2023-12-27 21:23:32,264][106226] Updated weights for policy 0, policy_version 300993 (0.0008) [2023-12-27 21:23:32,322][106226] Updated weights for policy 0, policy_version 301003 (0.0007) [2023-12-27 21:23:32,379][106226] Updated weights for policy 0, policy_version 301013 (0.0006) [2023-12-27 21:23:32,489][106225] Updated weights for policy 1, policy_version 301489 (0.0007) [2023-12-27 21:23:32,556][106225] Updated weights for policy 1, policy_version 301499 (0.0005) [2023-12-27 21:23:32,623][106225] Updated weights for policy 1, policy_version 301509 (0.0005) [2023-12-27 21:23:32,695][106225] Updated weights for policy 1, policy_version 301519 (0.0006) [2023-12-27 21:23:33,059][106226] Updated weights for policy 0, policy_version 301023 (0.0006) [2023-12-27 21:23:33,121][106226] Updated weights for policy 0, policy_version 301033 (0.0007) [2023-12-27 21:23:33,178][106226] Updated weights for policy 0, policy_version 301043 (0.0008) [2023-12-27 21:23:33,334][106225] Updated weights for policy 1, policy_version 301529 (0.0008) [2023-12-27 21:23:33,395][106225] Updated weights for policy 1, policy_version 301539 (0.0005) [2023-12-27 21:23:33,460][106225] Updated weights for policy 1, policy_version 301549 (0.0005) [2023-12-27 21:23:33,844][106226] Updated weights for policy 0, policy_version 301053 (0.0007) [2023-12-27 21:23:33,904][106226] Updated weights for policy 0, policy_version 301063 (0.0005) [2023-12-27 21:23:33,953][106226] Updated weights for policy 0, policy_version 301073 (0.0008) [2023-12-27 21:23:33,995][106225] Updated weights for policy 1, policy_version 301559 (0.0005) [2023-12-27 21:23:34,038][106225] Updated weights for policy 1, policy_version 301569 (0.0005) [2023-12-27 21:23:34,092][106225] Updated weights for policy 1, policy_version 301579 (0.0005) [2023-12-27 21:23:34,648][106226] Updated weights for policy 0, policy_version 301083 (0.0009) [2023-12-27 21:23:34,704][106226] Updated weights for policy 0, policy_version 301093 (0.0005) [2023-12-27 21:23:34,752][106225] Updated weights for policy 1, policy_version 301589 (0.0008) [2023-12-27 21:23:34,768][106226] Updated weights for policy 0, policy_version 301103 (0.0009) [2023-12-27 21:23:34,803][106225] Updated weights for policy 1, policy_version 301599 (0.0010) [2023-12-27 21:23:34,857][106225] Updated weights for policy 1, policy_version 301609 (0.0010) [2023-12-27 21:23:35,433][106226] Updated weights for policy 0, policy_version 301113 (0.0010) [2023-12-27 21:23:35,489][106226] Updated weights for policy 0, policy_version 301123 (0.0010) [2023-12-27 21:23:35,541][106226] Updated weights for policy 0, policy_version 301133 (0.0010) [2023-12-27 21:23:35,580][106225] Updated weights for policy 1, policy_version 301619 (0.0010) [2023-12-27 21:23:35,601][106226] Updated weights for policy 0, policy_version 301143 (0.0010) [2023-12-27 21:23:35,637][106225] Updated weights for policy 1, policy_version 301629 (0.0010) [2023-12-27 21:23:35,690][106225] Updated weights for policy 1, policy_version 301639 (0.0010) [2023-12-27 21:23:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 154361856. Throughput: 0: 9718.7, 1: 9962.0. Samples: 154373252. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:36,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-5.451')] [2023-12-27 21:23:36,348][106226] Updated weights for policy 0, policy_version 301153 (0.0010) [2023-12-27 21:23:36,352][106225] Updated weights for policy 1, policy_version 301649 (0.0010) [2023-12-27 21:23:36,407][106225] Updated weights for policy 1, policy_version 301659 (0.0010) [2023-12-27 21:23:36,412][106226] Updated weights for policy 0, policy_version 301163 (0.0010) [2023-12-27 21:23:36,467][106226] Updated weights for policy 0, policy_version 301173 (0.0010) [2023-12-27 21:23:36,467][106225] Updated weights for policy 1, policy_version 301669 (0.0010) [2023-12-27 21:23:36,526][106225] Updated weights for policy 1, policy_version 301679 (0.0009) [2023-12-27 21:23:37,052][106226] Updated weights for policy 0, policy_version 301183 (0.0005) [2023-12-27 21:23:37,106][106226] Updated weights for policy 0, policy_version 301193 (0.0005) [2023-12-27 21:23:37,121][106225] Updated weights for policy 1, policy_version 301689 (0.0005) [2023-12-27 21:23:37,166][106226] Updated weights for policy 0, policy_version 301203 (0.0006) [2023-12-27 21:23:37,170][106225] Updated weights for policy 1, policy_version 301699 (0.0005) [2023-12-27 21:23:37,234][106225] Updated weights for policy 1, policy_version 301709 (0.0011) [2023-12-27 21:23:37,737][106226] Updated weights for policy 0, policy_version 301213 (0.0008) [2023-12-27 21:23:37,790][106226] Updated weights for policy 0, policy_version 301223 (0.0010) [2023-12-27 21:23:37,838][106226] Updated weights for policy 0, policy_version 301233 (0.0010) [2023-12-27 21:23:37,895][106225] Updated weights for policy 1, policy_version 301719 (0.0010) [2023-12-27 21:23:37,947][106225] Updated weights for policy 1, policy_version 301729 (0.0009) [2023-12-27 21:23:37,998][106225] Updated weights for policy 1, policy_version 301739 (0.0005) [2023-12-27 21:23:38,523][106226] Updated weights for policy 0, policy_version 301243 (0.0010) [2023-12-27 21:23:38,586][106226] Updated weights for policy 0, policy_version 301253 (0.0008) [2023-12-27 21:23:38,645][106226] Updated weights for policy 0, policy_version 301263 (0.0008) [2023-12-27 21:23:38,647][106225] Updated weights for policy 1, policy_version 301749 (0.0008) [2023-12-27 21:23:38,704][106225] Updated weights for policy 1, policy_version 301759 (0.0010) [2023-12-27 21:23:38,765][106225] Updated weights for policy 1, policy_version 301769 (0.0010) [2023-12-27 21:23:39,398][106226] Updated weights for policy 0, policy_version 301273 (0.0008) [2023-12-27 21:23:39,468][106226] Updated weights for policy 0, policy_version 301283 (0.0011) [2023-12-27 21:23:39,519][106226] Updated weights for policy 0, policy_version 301293 (0.0011) [2023-12-27 21:23:39,519][106225] Updated weights for policy 1, policy_version 301779 (0.0010) [2023-12-27 21:23:39,578][106225] Updated weights for policy 1, policy_version 301789 (0.0011) [2023-12-27 21:23:39,582][106226] Updated weights for policy 0, policy_version 301303 (0.0007) [2023-12-27 21:23:39,636][106225] Updated weights for policy 1, policy_version 301799 (0.0010) [2023-12-27 21:23:40,320][106225] Updated weights for policy 1, policy_version 301809 (0.0010) [2023-12-27 21:23:40,349][106226] Updated weights for policy 0, policy_version 301313 (0.0007) [2023-12-27 21:23:40,382][106225] Updated weights for policy 1, policy_version 301819 (0.0008) [2023-12-27 21:23:40,405][106226] Updated weights for policy 0, policy_version 301323 (0.0006) [2023-12-27 21:23:40,439][106225] Updated weights for policy 1, policy_version 301829 (0.0007) [2023-12-27 21:23:40,463][106226] Updated weights for policy 0, policy_version 301333 (0.0006) [2023-12-27 21:23:40,485][106225] Updated weights for policy 1, policy_version 301839 (0.0007) [2023-12-27 21:23:41,093][106226] Updated weights for policy 0, policy_version 301343 (0.0007) [2023-12-27 21:23:41,167][106226] Updated weights for policy 0, policy_version 301353 (0.0009) [2023-12-27 21:23:41,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 154460160. Throughput: 0: 9728.7, 1: 10047.7. Samples: 154437336. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:41,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-5.357')] [2023-12-27 21:23:41,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000301840_77291520.pth... [2023-12-27 21:23:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000300688_76996608.pth [2023-12-27 21:23:41,232][106226] Updated weights for policy 0, policy_version 301363 (0.0007) [2023-12-27 21:23:41,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000301368_77176832.pth... [2023-12-27 21:23:41,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000300216_76881920.pth [2023-12-27 21:23:41,342][106225] Updated weights for policy 1, policy_version 301849 (0.0009) [2023-12-27 21:23:41,410][106225] Updated weights for policy 1, policy_version 301859 (0.0007) [2023-12-27 21:23:41,467][106225] Updated weights for policy 1, policy_version 301869 (0.0008) [2023-12-27 21:23:41,909][106226] Updated weights for policy 0, policy_version 301373 (0.0009) [2023-12-27 21:23:41,962][106226] Updated weights for policy 0, policy_version 301383 (0.0006) [2023-12-27 21:23:42,021][106226] Updated weights for policy 0, policy_version 301393 (0.0009) [2023-12-27 21:23:42,287][106225] Updated weights for policy 1, policy_version 301879 (0.0009) [2023-12-27 21:23:42,348][106225] Updated weights for policy 1, policy_version 301889 (0.0009) [2023-12-27 21:23:42,413][106225] Updated weights for policy 1, policy_version 301899 (0.0008) [2023-12-27 21:23:42,792][106226] Updated weights for policy 0, policy_version 301403 (0.0009) [2023-12-27 21:23:42,853][106226] Updated weights for policy 0, policy_version 301413 (0.0011) [2023-12-27 21:23:42,909][106226] Updated weights for policy 0, policy_version 301423 (0.0010) [2023-12-27 21:23:43,199][106225] Updated weights for policy 1, policy_version 301909 (0.0009) [2023-12-27 21:23:43,271][106225] Updated weights for policy 1, policy_version 301919 (0.0009) [2023-12-27 21:23:43,332][106225] Updated weights for policy 1, policy_version 301929 (0.0008) [2023-12-27 21:23:43,471][106226] Updated weights for policy 0, policy_version 301433 (0.0005) [2023-12-27 21:23:43,525][106226] Updated weights for policy 0, policy_version 301443 (0.0005) [2023-12-27 21:23:43,579][106226] Updated weights for policy 0, policy_version 301453 (0.0005) [2023-12-27 21:23:43,640][106226] Updated weights for policy 0, policy_version 301463 (0.0005) [2023-12-27 21:23:44,121][106225] Updated weights for policy 1, policy_version 301939 (0.0009) [2023-12-27 21:23:44,179][106225] Updated weights for policy 1, policy_version 301949 (0.0008) [2023-12-27 21:23:44,236][106225] Updated weights for policy 1, policy_version 301959 (0.0008) [2023-12-27 21:23:44,281][106226] Updated weights for policy 0, policy_version 301473 (0.0010) [2023-12-27 21:23:44,338][106226] Updated weights for policy 0, policy_version 301483 (0.0010) [2023-12-27 21:23:44,400][106226] Updated weights for policy 0, policy_version 301493 (0.0011) [2023-12-27 21:23:44,985][106225] Updated weights for policy 1, policy_version 301969 (0.0009) [2023-12-27 21:23:45,066][106225] Updated weights for policy 1, policy_version 301981 (0.0007) [2023-12-27 21:23:45,120][106226] Updated weights for policy 0, policy_version 301503 (0.0010) [2023-12-27 21:23:45,123][106225] Updated weights for policy 1, policy_version 301991 (0.0007) [2023-12-27 21:23:45,187][106226] Updated weights for policy 0, policy_version 301513 (0.0007) [2023-12-27 21:23:45,247][106226] Updated weights for policy 0, policy_version 301523 (0.0008) [2023-12-27 21:23:45,878][106226] Updated weights for policy 0, policy_version 301533 (0.0009) [2023-12-27 21:23:45,915][106225] Updated weights for policy 1, policy_version 302001 (0.0006) [2023-12-27 21:23:45,943][106226] Updated weights for policy 0, policy_version 301543 (0.0008) [2023-12-27 21:23:45,965][106225] Updated weights for policy 1, policy_version 302011 (0.0008) [2023-12-27 21:23:46,006][106226] Updated weights for policy 0, policy_version 301553 (0.0008) [2023-12-27 21:23:46,020][106225] Updated weights for policy 1, policy_version 302021 (0.0007) [2023-12-27 21:23:46,078][106225] Updated weights for policy 1, policy_version 302031 (0.0005) [2023-12-27 21:23:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 154566656. Throughput: 0: 9835.4, 1: 9872.2. Samples: 154551752. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:46,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.543')] [2023-12-27 21:23:46,625][106226] Updated weights for policy 0, policy_version 301563 (0.0007) [2023-12-27 21:23:46,680][106226] Updated weights for policy 0, policy_version 301573 (0.0007) [2023-12-27 21:23:46,699][106225] Updated weights for policy 1, policy_version 302041 (0.0005) [2023-12-27 21:23:46,739][106226] Updated weights for policy 0, policy_version 301583 (0.0008) [2023-12-27 21:23:46,755][106225] Updated weights for policy 1, policy_version 302051 (0.0005) [2023-12-27 21:23:46,815][106225] Updated weights for policy 1, policy_version 302061 (0.0005) [2023-12-27 21:23:47,435][106225] Updated weights for policy 1, policy_version 302071 (0.0006) [2023-12-27 21:23:47,474][106226] Updated weights for policy 0, policy_version 301593 (0.0007) [2023-12-27 21:23:47,495][106225] Updated weights for policy 1, policy_version 302081 (0.0006) [2023-12-27 21:23:47,529][106226] Updated weights for policy 0, policy_version 301603 (0.0006) [2023-12-27 21:23:47,563][106225] Updated weights for policy 1, policy_version 302091 (0.0005) [2023-12-27 21:23:47,588][106226] Updated weights for policy 0, policy_version 301613 (0.0007) [2023-12-27 21:23:47,644][106226] Updated weights for policy 0, policy_version 301623 (0.0006) [2023-12-27 21:23:48,106][106225] Updated weights for policy 1, policy_version 302101 (0.0006) [2023-12-27 21:23:48,162][106225] Updated weights for policy 1, policy_version 302111 (0.0005) [2023-12-27 21:23:48,223][106225] Updated weights for policy 1, policy_version 302121 (0.0005) [2023-12-27 21:23:48,360][106226] Updated weights for policy 0, policy_version 301633 (0.0009) [2023-12-27 21:23:48,420][106226] Updated weights for policy 0, policy_version 301643 (0.0010) [2023-12-27 21:23:48,485][106226] Updated weights for policy 0, policy_version 301653 (0.0011) [2023-12-27 21:23:48,855][106225] Updated weights for policy 1, policy_version 302131 (0.0007) [2023-12-27 21:23:48,909][106225] Updated weights for policy 1, policy_version 302141 (0.0010) [2023-12-27 21:23:48,959][106225] Updated weights for policy 1, policy_version 302151 (0.0010) [2023-12-27 21:23:49,207][106226] Updated weights for policy 0, policy_version 301663 (0.0010) [2023-12-27 21:23:49,276][106226] Updated weights for policy 0, policy_version 301673 (0.0006) [2023-12-27 21:23:49,344][106226] Updated weights for policy 0, policy_version 301683 (0.0009) [2023-12-27 21:23:49,727][106225] Updated weights for policy 1, policy_version 302161 (0.0010) [2023-12-27 21:23:49,812][106225] Updated weights for policy 1, policy_version 302171 (0.0008) [2023-12-27 21:23:49,882][106225] Updated weights for policy 1, policy_version 302181 (0.0008) [2023-12-27 21:23:49,943][106225] Updated weights for policy 1, policy_version 302191 (0.0008) [2023-12-27 21:23:50,006][106226] Updated weights for policy 0, policy_version 301693 (0.0010) [2023-12-27 21:23:50,067][106226] Updated weights for policy 0, policy_version 301703 (0.0011) [2023-12-27 21:23:50,121][106226] Updated weights for policy 0, policy_version 301713 (0.0010) [2023-12-27 21:23:50,682][106225] Updated weights for policy 1, policy_version 302201 (0.0009) [2023-12-27 21:23:50,744][106225] Updated weights for policy 1, policy_version 302211 (0.0010) [2023-12-27 21:23:50,805][106225] Updated weights for policy 1, policy_version 302221 (0.0011) [2023-12-27 21:23:50,814][106226] Updated weights for policy 0, policy_version 301723 (0.0009) [2023-12-27 21:23:50,866][106226] Updated weights for policy 0, policy_version 301733 (0.0006) [2023-12-27 21:23:50,933][106226] Updated weights for policy 0, policy_version 301743 (0.0006) [2023-12-27 21:23:51,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 154664960. Throughput: 0: 9914.5, 1: 9921.0. Samples: 154672488. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:51,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.701')] [2023-12-27 21:23:51,509][106225] Updated weights for policy 1, policy_version 302231 (0.0007) [2023-12-27 21:23:51,578][106225] Updated weights for policy 1, policy_version 302241 (0.0005) [2023-12-27 21:23:51,649][106225] Updated weights for policy 1, policy_version 302251 (0.0007) [2023-12-27 21:23:51,673][106226] Updated weights for policy 0, policy_version 301753 (0.0006) [2023-12-27 21:23:51,757][106226] Updated weights for policy 0, policy_version 301763 (0.0007) [2023-12-27 21:23:51,826][106226] Updated weights for policy 0, policy_version 301773 (0.0008) [2023-12-27 21:23:51,896][106226] Updated weights for policy 0, policy_version 301783 (0.0007) [2023-12-27 21:23:52,295][106225] Updated weights for policy 1, policy_version 302261 (0.0007) [2023-12-27 21:23:52,359][106225] Updated weights for policy 1, policy_version 302271 (0.0008) [2023-12-27 21:23:52,431][106225] Updated weights for policy 1, policy_version 302281 (0.0008) [2023-12-27 21:23:52,612][106226] Updated weights for policy 0, policy_version 301793 (0.0010) [2023-12-27 21:23:52,677][106226] Updated weights for policy 0, policy_version 301803 (0.0009) [2023-12-27 21:23:52,741][106226] Updated weights for policy 0, policy_version 301813 (0.0009) [2023-12-27 21:23:53,061][106225] Updated weights for policy 1, policy_version 302291 (0.0008) [2023-12-27 21:23:53,114][106225] Updated weights for policy 1, policy_version 302301 (0.0005) [2023-12-27 21:23:53,165][106225] Updated weights for policy 1, policy_version 302311 (0.0006) [2023-12-27 21:23:53,529][106226] Updated weights for policy 0, policy_version 301823 (0.0008) [2023-12-27 21:23:53,579][106226] Updated weights for policy 0, policy_version 301833 (0.0009) [2023-12-27 21:23:53,628][106226] Updated weights for policy 0, policy_version 301843 (0.0009) [2023-12-27 21:23:53,734][106225] Updated weights for policy 1, policy_version 302321 (0.0006) [2023-12-27 21:23:53,797][106225] Updated weights for policy 1, policy_version 302331 (0.0008) [2023-12-27 21:23:53,853][106225] Updated weights for policy 1, policy_version 302341 (0.0009) [2023-12-27 21:23:53,912][106225] Updated weights for policy 1, policy_version 302351 (0.0007) [2023-12-27 21:23:54,434][106226] Updated weights for policy 0, policy_version 301853 (0.0006) [2023-12-27 21:23:54,492][106226] Updated weights for policy 0, policy_version 301863 (0.0007) [2023-12-27 21:23:54,541][106226] Updated weights for policy 0, policy_version 301873 (0.0007) [2023-12-27 21:23:54,570][106225] Updated weights for policy 1, policy_version 302361 (0.0008) [2023-12-27 21:23:54,632][106225] Updated weights for policy 1, policy_version 302371 (0.0008) [2023-12-27 21:23:54,694][106225] Updated weights for policy 1, policy_version 302381 (0.0009) [2023-12-27 21:23:55,119][106226] Updated weights for policy 0, policy_version 301883 (0.0006) [2023-12-27 21:23:55,167][106226] Updated weights for policy 0, policy_version 301893 (0.0008) [2023-12-27 21:23:55,215][106226] Updated weights for policy 0, policy_version 301903 (0.0008) [2023-12-27 21:23:55,469][106225] Updated weights for policy 1, policy_version 302391 (0.0008) [2023-12-27 21:23:55,521][106225] Updated weights for policy 1, policy_version 302401 (0.0008) [2023-12-27 21:23:55,568][106225] Updated weights for policy 1, policy_version 302411 (0.0009) [2023-12-27 21:23:55,946][106226] Updated weights for policy 0, policy_version 301913 (0.0008) [2023-12-27 21:23:56,009][106226] Updated weights for policy 0, policy_version 301923 (0.0006) [2023-12-27 21:23:56,069][106226] Updated weights for policy 0, policy_version 301933 (0.0007) [2023-12-27 21:23:56,130][106226] Updated weights for policy 0, policy_version 301943 (0.0009) [2023-12-27 21:23:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 154763264. Throughput: 0: 9816.6, 1: 9958.9. Samples: 154730616. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:23:56,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.372')] [2023-12-27 21:23:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000302416_77438976.pth... [2023-12-27 21:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000301944_77324288.pth... [2023-12-27 21:23:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000300792_77029376.pth [2023-12-27 21:23:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000301264_77144064.pth [2023-12-27 21:23:56,322][106225] Updated weights for policy 1, policy_version 302421 (0.0009) [2023-12-27 21:23:56,379][106225] Updated weights for policy 1, policy_version 302431 (0.0008) [2023-12-27 21:23:56,444][106225] Updated weights for policy 1, policy_version 302441 (0.0008) [2023-12-27 21:23:56,821][106226] Updated weights for policy 0, policy_version 301953 (0.0009) [2023-12-27 21:23:56,884][106226] Updated weights for policy 0, policy_version 301963 (0.0008) [2023-12-27 21:23:56,941][106226] Updated weights for policy 0, policy_version 301973 (0.0008) [2023-12-27 21:23:57,144][106225] Updated weights for policy 1, policy_version 302451 (0.0007) [2023-12-27 21:23:57,199][106225] Updated weights for policy 1, policy_version 302461 (0.0005) [2023-12-27 21:23:57,250][106225] Updated weights for policy 1, policy_version 302471 (0.0005) [2023-12-27 21:23:57,675][106226] Updated weights for policy 0, policy_version 301983 (0.0009) [2023-12-27 21:23:57,729][106226] Updated weights for policy 0, policy_version 301993 (0.0008) [2023-12-27 21:23:57,784][106226] Updated weights for policy 0, policy_version 302003 (0.0009) [2023-12-27 21:23:57,898][106225] Updated weights for policy 1, policy_version 302481 (0.0006) [2023-12-27 21:23:57,950][106225] Updated weights for policy 1, policy_version 302491 (0.0008) [2023-12-27 21:23:57,999][106225] Updated weights for policy 1, policy_version 302501 (0.0005) [2023-12-27 21:23:58,067][106225] Updated weights for policy 1, policy_version 302511 (0.0006) [2023-12-27 21:23:58,561][106226] Updated weights for policy 0, policy_version 302013 (0.0010) [2023-12-27 21:23:58,627][106226] Updated weights for policy 0, policy_version 302023 (0.0010) [2023-12-27 21:23:58,688][106226] Updated weights for policy 0, policy_version 302033 (0.0009) [2023-12-27 21:23:58,773][106225] Updated weights for policy 1, policy_version 302521 (0.0008) [2023-12-27 21:23:58,839][106225] Updated weights for policy 1, policy_version 302531 (0.0008) [2023-12-27 21:23:58,915][106225] Updated weights for policy 1, policy_version 302541 (0.0008) [2023-12-27 21:23:59,539][106226] Updated weights for policy 0, policy_version 302043 (0.0011) [2023-12-27 21:23:59,599][106226] Updated weights for policy 0, policy_version 302053 (0.0010) [2023-12-27 21:23:59,657][106226] Updated weights for policy 0, policy_version 302063 (0.0011) [2023-12-27 21:23:59,665][106225] Updated weights for policy 1, policy_version 302551 (0.0008) [2023-12-27 21:23:59,717][106225] Updated weights for policy 1, policy_version 302561 (0.0010) [2023-12-27 21:23:59,764][106225] Updated weights for policy 1, policy_version 302571 (0.0010) [2023-12-27 21:24:00,349][106226] Updated weights for policy 0, policy_version 302073 (0.0008) [2023-12-27 21:24:00,406][106226] Updated weights for policy 0, policy_version 302083 (0.0005) [2023-12-27 21:24:00,456][106225] Updated weights for policy 1, policy_version 302581 (0.0010) [2023-12-27 21:24:00,469][106226] Updated weights for policy 0, policy_version 302093 (0.0005) [2023-12-27 21:24:00,520][106225] Updated weights for policy 1, policy_version 302591 (0.0008) [2023-12-27 21:24:00,532][106226] Updated weights for policy 0, policy_version 302103 (0.0005) [2023-12-27 21:24:00,576][106225] Updated weights for policy 1, policy_version 302601 (0.0010) [2023-12-27 21:24:01,136][106226] Updated weights for policy 0, policy_version 302113 (0.0007) [2023-12-27 21:24:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 154853376. Throughput: 0: 9816.8, 1: 9967.0. Samples: 154847120. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:24:01,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.687')] [2023-12-27 21:24:01,205][106226] Updated weights for policy 0, policy_version 302123 (0.0008) [2023-12-27 21:24:01,251][106225] Updated weights for policy 1, policy_version 302611 (0.0009) [2023-12-27 21:24:01,273][106226] Updated weights for policy 0, policy_version 302133 (0.0007) [2023-12-27 21:24:01,312][106225] Updated weights for policy 1, policy_version 302621 (0.0008) [2023-12-27 21:24:01,384][106225] Updated weights for policy 1, policy_version 302631 (0.0008) [2023-12-27 21:24:01,971][106226] Updated weights for policy 0, policy_version 302143 (0.0008) [2023-12-27 21:24:02,036][106226] Updated weights for policy 0, policy_version 302153 (0.0010) [2023-12-27 21:24:02,096][106226] Updated weights for policy 0, policy_version 302163 (0.0010) [2023-12-27 21:24:02,152][106225] Updated weights for policy 1, policy_version 302641 (0.0008) [2023-12-27 21:24:02,210][106225] Updated weights for policy 1, policy_version 302651 (0.0007) [2023-12-27 21:24:02,270][106225] Updated weights for policy 1, policy_version 302661 (0.0008) [2023-12-27 21:24:02,324][106225] Updated weights for policy 1, policy_version 302671 (0.0008) [2023-12-27 21:24:02,816][106226] Updated weights for policy 0, policy_version 302173 (0.0010) [2023-12-27 21:24:02,869][106226] Updated weights for policy 0, policy_version 302183 (0.0010) [2023-12-27 21:24:02,929][106226] Updated weights for policy 0, policy_version 302193 (0.0010) [2023-12-27 21:24:03,021][106225] Updated weights for policy 1, policy_version 302681 (0.0007) [2023-12-27 21:24:03,070][106225] Updated weights for policy 1, policy_version 302691 (0.0007) [2023-12-27 21:24:03,125][106225] Updated weights for policy 1, policy_version 302701 (0.0006) [2023-12-27 21:24:03,641][106226] Updated weights for policy 0, policy_version 302203 (0.0010) [2023-12-27 21:24:03,691][106226] Updated weights for policy 0, policy_version 302213 (0.0010) [2023-12-27 21:24:03,737][106226] Updated weights for policy 0, policy_version 302223 (0.0010) [2023-12-27 21:24:03,757][106225] Updated weights for policy 1, policy_version 302711 (0.0006) [2023-12-27 21:24:03,819][106225] Updated weights for policy 1, policy_version 302721 (0.0008) [2023-12-27 21:24:03,884][106225] Updated weights for policy 1, policy_version 302731 (0.0009) [2023-12-27 21:24:04,475][106226] Updated weights for policy 0, policy_version 302233 (0.0010) [2023-12-27 21:24:04,539][106226] Updated weights for policy 0, policy_version 302243 (0.0010) [2023-12-27 21:24:04,596][106226] Updated weights for policy 0, policy_version 302253 (0.0010) [2023-12-27 21:24:04,641][106225] Updated weights for policy 1, policy_version 302741 (0.0007) [2023-12-27 21:24:04,648][106226] Updated weights for policy 0, policy_version 302263 (0.0010) [2023-12-27 21:24:04,686][106225] Updated weights for policy 1, policy_version 302751 (0.0006) [2023-12-27 21:24:04,732][106225] Updated weights for policy 1, policy_version 302761 (0.0008) [2023-12-27 21:24:05,357][106226] Updated weights for policy 0, policy_version 302273 (0.0010) [2023-12-27 21:24:05,400][106226] Updated weights for policy 0, policy_version 302283 (0.0010) [2023-12-27 21:24:05,458][106226] Updated weights for policy 0, policy_version 302293 (0.0010) [2023-12-27 21:24:05,481][106225] Updated weights for policy 1, policy_version 302771 (0.0008) [2023-12-27 21:24:05,527][106225] Updated weights for policy 1, policy_version 302781 (0.0008) [2023-12-27 21:24:05,580][106225] Updated weights for policy 1, policy_version 302791 (0.0007) [2023-12-27 21:24:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 154951680. Throughput: 0: 9772.1, 1: 9989.8. Samples: 154964960. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:24:06,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-5.471')] [2023-12-27 21:24:06,189][106226] Updated weights for policy 0, policy_version 302303 (0.0010) [2023-12-27 21:24:06,256][106226] Updated weights for policy 0, policy_version 302313 (0.0011) [2023-12-27 21:24:06,322][106226] Updated weights for policy 0, policy_version 302323 (0.0011) [2023-12-27 21:24:06,340][106225] Updated weights for policy 1, policy_version 302801 (0.0008) [2023-12-27 21:24:06,403][106225] Updated weights for policy 1, policy_version 302811 (0.0007) [2023-12-27 21:24:06,464][106225] Updated weights for policy 1, policy_version 302821 (0.0007) [2023-12-27 21:24:06,533][106225] Updated weights for policy 1, policy_version 302831 (0.0008) [2023-12-27 21:24:07,039][106226] Updated weights for policy 0, policy_version 302333 (0.0010) [2023-12-27 21:24:07,094][106226] Updated weights for policy 0, policy_version 302343 (0.0006) [2023-12-27 21:24:07,125][106225] Updated weights for policy 1, policy_version 302841 (0.0006) [2023-12-27 21:24:07,153][106226] Updated weights for policy 0, policy_version 302353 (0.0007) [2023-12-27 21:24:07,181][106225] Updated weights for policy 1, policy_version 302851 (0.0009) [2023-12-27 21:24:07,231][106225] Updated weights for policy 1, policy_version 302861 (0.0010) [2023-12-27 21:24:07,697][106226] Updated weights for policy 0, policy_version 302363 (0.0005) [2023-12-27 21:24:07,758][106226] Updated weights for policy 0, policy_version 302373 (0.0006) [2023-12-27 21:24:07,813][106226] Updated weights for policy 0, policy_version 302383 (0.0008) [2023-12-27 21:24:07,872][106225] Updated weights for policy 1, policy_version 302871 (0.0010) [2023-12-27 21:24:07,928][106225] Updated weights for policy 1, policy_version 302881 (0.0010) [2023-12-27 21:24:07,984][106225] Updated weights for policy 1, policy_version 302891 (0.0010) [2023-12-27 21:24:08,480][106226] Updated weights for policy 0, policy_version 302393 (0.0010) [2023-12-27 21:24:08,539][106226] Updated weights for policy 0, policy_version 302403 (0.0008) [2023-12-27 21:24:08,598][106226] Updated weights for policy 0, policy_version 302413 (0.0006) [2023-12-27 21:24:08,666][106226] Updated weights for policy 0, policy_version 302423 (0.0009) [2023-12-27 21:24:08,711][106225] Updated weights for policy 1, policy_version 302901 (0.0008) [2023-12-27 21:24:08,768][106225] Updated weights for policy 1, policy_version 302911 (0.0007) [2023-12-27 21:24:08,826][106225] Updated weights for policy 1, policy_version 302921 (0.0007) [2023-12-27 21:24:09,426][106226] Updated weights for policy 0, policy_version 302433 (0.0009) [2023-12-27 21:24:09,485][106226] Updated weights for policy 0, policy_version 302443 (0.0009) [2023-12-27 21:24:09,537][106226] Updated weights for policy 0, policy_version 302453 (0.0011) [2023-12-27 21:24:09,583][106225] Updated weights for policy 1, policy_version 302931 (0.0009) [2023-12-27 21:24:09,645][106225] Updated weights for policy 1, policy_version 302941 (0.0008) [2023-12-27 21:24:09,702][106225] Updated weights for policy 1, policy_version 302951 (0.0008) [2023-12-27 21:24:10,322][106226] Updated weights for policy 0, policy_version 302463 (0.0009) [2023-12-27 21:24:10,395][106226] Updated weights for policy 0, policy_version 302473 (0.0009) [2023-12-27 21:24:10,455][106226] Updated weights for policy 0, policy_version 302483 (0.0008) [2023-12-27 21:24:10,469][106225] Updated weights for policy 1, policy_version 302961 (0.0010) [2023-12-27 21:24:10,528][106225] Updated weights for policy 1, policy_version 302971 (0.0008) [2023-12-27 21:24:10,590][106225] Updated weights for policy 1, policy_version 302981 (0.0008) [2023-12-27 21:24:10,650][106225] Updated weights for policy 1, policy_version 302991 (0.0009) [2023-12-27 21:24:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 155049984. Throughput: 0: 9821.3, 1: 10048.5. Samples: 155026512. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:24:11,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.529')] [2023-12-27 21:24:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000302992_77586432.pth... [2023-12-27 21:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000301840_77291520.pth [2023-12-27 21:24:11,201][106226] Updated weights for policy 0, policy_version 302493 (0.0008) [2023-12-27 21:24:11,266][106226] Updated weights for policy 0, policy_version 302503 (0.0011) [2023-12-27 21:24:11,323][106226] Updated weights for policy 0, policy_version 302513 (0.0011) [2023-12-27 21:24:11,355][106225] Updated weights for policy 1, policy_version 303001 (0.0007) [2023-12-27 21:24:11,370][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000302520_77471744.pth... [2023-12-27 21:24:11,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000301368_77176832.pth [2023-12-27 21:24:11,413][106225] Updated weights for policy 1, policy_version 303011 (0.0007) [2023-12-27 21:24:11,474][106225] Updated weights for policy 1, policy_version 303021 (0.0008) [2023-12-27 21:24:12,124][106226] Updated weights for policy 0, policy_version 302523 (0.0009) [2023-12-27 21:24:12,188][106226] Updated weights for policy 0, policy_version 302533 (0.0009) [2023-12-27 21:24:12,248][106226] Updated weights for policy 0, policy_version 302543 (0.0006) [2023-12-27 21:24:12,253][106225] Updated weights for policy 1, policy_version 303031 (0.0009) [2023-12-27 21:24:12,321][106225] Updated weights for policy 1, policy_version 303041 (0.0007) [2023-12-27 21:24:12,393][106225] Updated weights for policy 1, policy_version 303051 (0.0009) [2023-12-27 21:24:13,044][106226] Updated weights for policy 0, policy_version 302553 (0.0007) [2023-12-27 21:24:13,090][106226] Updated weights for policy 0, policy_version 302563 (0.0008) [2023-12-27 21:24:13,097][106225] Updated weights for policy 1, policy_version 303061 (0.0008) [2023-12-27 21:24:13,140][106226] Updated weights for policy 0, policy_version 302573 (0.0007) [2023-12-27 21:24:13,160][106225] Updated weights for policy 1, policy_version 303071 (0.0008) [2023-12-27 21:24:13,192][106226] Updated weights for policy 0, policy_version 302583 (0.0008) [2023-12-27 21:24:13,218][106225] Updated weights for policy 1, policy_version 303081 (0.0008) [2023-12-27 21:24:13,820][106225] Updated weights for policy 1, policy_version 303091 (0.0008) [2023-12-27 21:24:13,868][106225] Updated weights for policy 1, policy_version 303101 (0.0008) [2023-12-27 21:24:13,921][106225] Updated weights for policy 1, policy_version 303111 (0.0009) [2023-12-27 21:24:13,986][106226] Updated weights for policy 0, policy_version 302593 (0.0011) [2023-12-27 21:24:14,044][106226] Updated weights for policy 0, policy_version 302603 (0.0008) [2023-12-27 21:24:14,106][106226] Updated weights for policy 0, policy_version 302613 (0.0009) [2023-12-27 21:24:14,552][106225] Updated weights for policy 1, policy_version 303121 (0.0008) [2023-12-27 21:24:14,614][106225] Updated weights for policy 1, policy_version 303131 (0.0006) [2023-12-27 21:24:14,667][106225] Updated weights for policy 1, policy_version 303141 (0.0009) [2023-12-27 21:24:14,718][106225] Updated weights for policy 1, policy_version 303151 (0.0010) [2023-12-27 21:24:14,943][106226] Updated weights for policy 0, policy_version 302623 (0.0009) [2023-12-27 21:24:15,005][106226] Updated weights for policy 0, policy_version 302633 (0.0008) [2023-12-27 21:24:15,066][106226] Updated weights for policy 0, policy_version 302643 (0.0008) [2023-12-27 21:24:15,504][106225] Updated weights for policy 1, policy_version 303161 (0.0011) [2023-12-27 21:24:15,572][106225] Updated weights for policy 1, policy_version 303171 (0.0007) [2023-12-27 21:24:15,636][106225] Updated weights for policy 1, policy_version 303181 (0.0009) [2023-12-27 21:24:15,852][106226] Updated weights for policy 0, policy_version 302653 (0.0008) [2023-12-27 21:24:15,917][106226] Updated weights for policy 0, policy_version 302663 (0.0008) [2023-12-27 21:24:15,970][106226] Updated weights for policy 0, policy_version 302673 (0.0008) [2023-12-27 21:24:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 155148288. Throughput: 0: 9788.0, 1: 9903.1. Samples: 155139292. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:24:16,176][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.671')] [2023-12-27 21:24:16,295][106225] Updated weights for policy 1, policy_version 303191 (0.0007) [2023-12-27 21:24:16,348][106225] Updated weights for policy 1, policy_version 303201 (0.0009) [2023-12-27 21:24:16,394][106225] Updated weights for policy 1, policy_version 303211 (0.0010) [2023-12-27 21:24:16,732][106226] Updated weights for policy 0, policy_version 302683 (0.0009) [2023-12-27 21:24:16,791][106226] Updated weights for policy 0, policy_version 302693 (0.0009) [2023-12-27 21:24:16,840][106226] Updated weights for policy 0, policy_version 302703 (0.0008) [2023-12-27 21:24:17,013][106225] Updated weights for policy 1, policy_version 303221 (0.0008) [2023-12-27 21:24:17,069][106225] Updated weights for policy 1, policy_version 303231 (0.0005) [2023-12-27 21:24:17,125][106225] Updated weights for policy 1, policy_version 303241 (0.0005) [2023-12-27 21:24:17,545][106226] Updated weights for policy 0, policy_version 302713 (0.0006) [2023-12-27 21:24:17,605][106226] Updated weights for policy 0, policy_version 302723 (0.0010) [2023-12-27 21:24:17,636][106225] Updated weights for policy 1, policy_version 303251 (0.0005) [2023-12-27 21:24:17,666][106226] Updated weights for policy 0, policy_version 302733 (0.0011) [2023-12-27 21:24:17,692][106225] Updated weights for policy 1, policy_version 303261 (0.0005) [2023-12-27 21:24:17,716][106226] Updated weights for policy 0, policy_version 302743 (0.0010) [2023-12-27 21:24:17,750][106225] Updated weights for policy 1, policy_version 303271 (0.0009) [2023-12-27 21:24:18,322][106225] Updated weights for policy 1, policy_version 303281 (0.0010) [2023-12-27 21:24:18,389][106225] Updated weights for policy 1, policy_version 303291 (0.0011) [2023-12-27 21:24:18,440][106226] Updated weights for policy 0, policy_version 302753 (0.0011) [2023-12-27 21:24:18,441][106225] Updated weights for policy 1, policy_version 303301 (0.0010) [2023-12-27 21:24:18,492][106225] Updated weights for policy 1, policy_version 303311 (0.0010) [2023-12-27 21:24:18,500][106226] Updated weights for policy 0, policy_version 302763 (0.0011) [2023-12-27 21:24:18,557][106226] Updated weights for policy 0, policy_version 302773 (0.0010) [2023-12-27 21:24:19,161][106225] Updated weights for policy 1, policy_version 303321 (0.0006) [2023-12-27 21:24:19,223][106226] Updated weights for policy 0, policy_version 302783 (0.0010) [2023-12-27 21:24:19,226][106225] Updated weights for policy 1, policy_version 303331 (0.0007) [2023-12-27 21:24:19,288][106225] Updated weights for policy 1, policy_version 303341 (0.0008) [2023-12-27 21:24:19,289][106226] Updated weights for policy 0, policy_version 302793 (0.0008) [2023-12-27 21:24:19,352][106226] Updated weights for policy 0, policy_version 302803 (0.0008) [2023-12-27 21:24:20,005][106225] Updated weights for policy 1, policy_version 303351 (0.0006) [2023-12-27 21:24:20,072][106225] Updated weights for policy 1, policy_version 303361 (0.0006) [2023-12-27 21:24:20,089][106226] Updated weights for policy 0, policy_version 302813 (0.0009) [2023-12-27 21:24:20,134][106225] Updated weights for policy 1, policy_version 303371 (0.0006) [2023-12-27 21:24:20,151][106226] Updated weights for policy 0, policy_version 302823 (0.0009) [2023-12-27 21:24:20,210][106226] Updated weights for policy 0, policy_version 302833 (0.0007) [2023-12-27 21:24:20,857][106225] Updated weights for policy 1, policy_version 303381 (0.0007) [2023-12-27 21:24:20,922][106225] Updated weights for policy 1, policy_version 303391 (0.0008) [2023-12-27 21:24:20,947][106226] Updated weights for policy 0, policy_version 302843 (0.0009) [2023-12-27 21:24:20,986][106225] Updated weights for policy 1, policy_version 303401 (0.0006) [2023-12-27 21:24:21,009][106226] Updated weights for policy 0, policy_version 302853 (0.0011) [2023-12-27 21:24:21,080][106226] Updated weights for policy 0, policy_version 302863 (0.0010) [2023-12-27 21:24:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 155254784. Throughput: 0: 9715.0, 1: 9963.3. Samples: 155258772. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:21,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.567')] [2023-12-27 21:24:21,749][106225] Updated weights for policy 1, policy_version 303411 (0.0008) [2023-12-27 21:24:21,820][106225] Updated weights for policy 1, policy_version 303421 (0.0008) [2023-12-27 21:24:21,885][106226] Updated weights for policy 0, policy_version 302873 (0.0009) [2023-12-27 21:24:21,889][106225] Updated weights for policy 1, policy_version 303431 (0.0008) [2023-12-27 21:24:21,948][106226] Updated weights for policy 0, policy_version 302883 (0.0011) [2023-12-27 21:24:22,010][106226] Updated weights for policy 0, policy_version 302893 (0.0010) [2023-12-27 21:24:22,072][106226] Updated weights for policy 0, policy_version 302903 (0.0011) [2023-12-27 21:24:22,610][106225] Updated weights for policy 1, policy_version 303441 (0.0008) [2023-12-27 21:24:22,666][106225] Updated weights for policy 1, policy_version 303451 (0.0007) [2023-12-27 21:24:22,720][106225] Updated weights for policy 1, policy_version 303461 (0.0007) [2023-12-27 21:24:22,780][106225] Updated weights for policy 1, policy_version 303471 (0.0006) [2023-12-27 21:24:22,802][106226] Updated weights for policy 0, policy_version 302913 (0.0011) [2023-12-27 21:24:22,860][106226] Updated weights for policy 0, policy_version 302923 (0.0011) [2023-12-27 21:24:22,915][106226] Updated weights for policy 0, policy_version 302933 (0.0007) [2023-12-27 21:24:23,408][106225] Updated weights for policy 1, policy_version 303481 (0.0009) [2023-12-27 21:24:23,474][106225] Updated weights for policy 1, policy_version 303491 (0.0008) [2023-12-27 21:24:23,538][106225] Updated weights for policy 1, policy_version 303501 (0.0008) [2023-12-27 21:24:23,576][106226] Updated weights for policy 0, policy_version 302943 (0.0007) [2023-12-27 21:24:23,633][106226] Updated weights for policy 0, policy_version 302953 (0.0006) [2023-12-27 21:24:23,693][106226] Updated weights for policy 0, policy_version 302963 (0.0005) [2023-12-27 21:24:24,275][106225] Updated weights for policy 1, policy_version 303511 (0.0008) [2023-12-27 21:24:24,334][106226] Updated weights for policy 0, policy_version 302973 (0.0007) [2023-12-27 21:24:24,337][106225] Updated weights for policy 1, policy_version 303521 (0.0007) [2023-12-27 21:24:24,393][106226] Updated weights for policy 0, policy_version 302983 (0.0007) [2023-12-27 21:24:24,400][106225] Updated weights for policy 1, policy_version 303531 (0.0006) [2023-12-27 21:24:24,453][106226] Updated weights for policy 0, policy_version 302993 (0.0007) [2023-12-27 21:24:25,074][106226] Updated weights for policy 0, policy_version 303003 (0.0008) [2023-12-27 21:24:25,138][106226] Updated weights for policy 0, policy_version 303013 (0.0010) [2023-12-27 21:24:25,167][106225] Updated weights for policy 1, policy_version 303541 (0.0009) [2023-12-27 21:24:25,187][106226] Updated weights for policy 0, policy_version 303023 (0.0010) [2023-12-27 21:24:25,213][106225] Updated weights for policy 1, policy_version 303551 (0.0007) [2023-12-27 21:24:25,261][106225] Updated weights for policy 1, policy_version 303561 (0.0007) [2023-12-27 21:24:25,888][106226] Updated weights for policy 0, policy_version 303033 (0.0010) [2023-12-27 21:24:25,958][106226] Updated weights for policy 0, policy_version 303043 (0.0007) [2023-12-27 21:24:25,971][106225] Updated weights for policy 1, policy_version 303571 (0.0007) [2023-12-27 21:24:26,006][106226] Updated weights for policy 0, policy_version 303053 (0.0006) [2023-12-27 21:24:26,019][106225] Updated weights for policy 1, policy_version 303581 (0.0006) [2023-12-27 21:24:26,062][106226] Updated weights for policy 0, policy_version 303063 (0.0006) [2023-12-27 21:24:26,071][106225] Updated weights for policy 1, policy_version 303591 (0.0008) [2023-12-27 21:24:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 155353088. Throughput: 0: 9649.3, 1: 9894.6. Samples: 155316812. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:26,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.398')] [2023-12-27 21:24:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000303600_77742080.pth... [2023-12-27 21:24:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000303064_77611008.pth... [2023-12-27 21:24:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000301944_77324288.pth [2023-12-27 21:24:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000302416_77438976.pth [2023-12-27 21:24:26,651][106226] Updated weights for policy 0, policy_version 303073 (0.0009) [2023-12-27 21:24:26,698][106226] Updated weights for policy 0, policy_version 303083 (0.0005) [2023-12-27 21:24:26,759][106226] Updated weights for policy 0, policy_version 303093 (0.0007) [2023-12-27 21:24:26,760][106225] Updated weights for policy 1, policy_version 303601 (0.0006) [2023-12-27 21:24:26,813][106225] Updated weights for policy 1, policy_version 303611 (0.0008) [2023-12-27 21:24:26,863][106225] Updated weights for policy 1, policy_version 303621 (0.0008) [2023-12-27 21:24:26,911][106225] Updated weights for policy 1, policy_version 303631 (0.0005) [2023-12-27 21:24:27,456][106226] Updated weights for policy 0, policy_version 303103 (0.0006) [2023-12-27 21:24:27,505][106226] Updated weights for policy 0, policy_version 303113 (0.0005) [2023-12-27 21:24:27,509][106225] Updated weights for policy 1, policy_version 303641 (0.0008) [2023-12-27 21:24:27,553][106225] Updated weights for policy 1, policy_version 303651 (0.0008) [2023-12-27 21:24:27,556][106226] Updated weights for policy 0, policy_version 303123 (0.0005) [2023-12-27 21:24:27,600][106225] Updated weights for policy 1, policy_version 303661 (0.0008) [2023-12-27 21:24:28,252][106226] Updated weights for policy 0, policy_version 303133 (0.0005) [2023-12-27 21:24:28,303][106226] Updated weights for policy 0, policy_version 303143 (0.0006) [2023-12-27 21:24:28,351][106225] Updated weights for policy 1, policy_version 303671 (0.0008) [2023-12-27 21:24:28,362][106226] Updated weights for policy 0, policy_version 303153 (0.0009) [2023-12-27 21:24:28,411][106225] Updated weights for policy 1, policy_version 303681 (0.0007) [2023-12-27 21:24:28,468][106225] Updated weights for policy 1, policy_version 303691 (0.0008) [2023-12-27 21:24:29,078][106226] Updated weights for policy 0, policy_version 303163 (0.0010) [2023-12-27 21:24:29,127][106226] Updated weights for policy 0, policy_version 303173 (0.0010) [2023-12-27 21:24:29,180][106226] Updated weights for policy 0, policy_version 303183 (0.0010) [2023-12-27 21:24:29,192][106225] Updated weights for policy 1, policy_version 303701 (0.0008) [2023-12-27 21:24:29,256][106225] Updated weights for policy 1, policy_version 303711 (0.0008) [2023-12-27 21:24:29,321][106225] Updated weights for policy 1, policy_version 303721 (0.0007) [2023-12-27 21:24:29,891][106226] Updated weights for policy 0, policy_version 303193 (0.0010) [2023-12-27 21:24:29,956][106226] Updated weights for policy 0, policy_version 303203 (0.0008) [2023-12-27 21:24:30,025][106226] Updated weights for policy 0, policy_version 303213 (0.0006) [2023-12-27 21:24:30,087][106225] Updated weights for policy 1, policy_version 303731 (0.0007) [2023-12-27 21:24:30,094][106226] Updated weights for policy 0, policy_version 303223 (0.0007) [2023-12-27 21:24:30,146][106225] Updated weights for policy 1, policy_version 303741 (0.0006) [2023-12-27 21:24:30,213][106225] Updated weights for policy 1, policy_version 303751 (0.0005) [2023-12-27 21:24:30,798][106225] Updated weights for policy 1, policy_version 303761 (0.0006) [2023-12-27 21:24:30,850][106226] Updated weights for policy 0, policy_version 303233 (0.0006) [2023-12-27 21:24:30,852][106225] Updated weights for policy 1, policy_version 303771 (0.0010) [2023-12-27 21:24:30,905][106225] Updated weights for policy 1, policy_version 303781 (0.0010) [2023-12-27 21:24:30,911][106226] Updated weights for policy 0, policy_version 303243 (0.0005) [2023-12-27 21:24:30,961][106225] Updated weights for policy 1, policy_version 303791 (0.0010) [2023-12-27 21:24:30,966][106226] Updated weights for policy 0, policy_version 303253 (0.0007) [2023-12-27 21:24:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 155451392. Throughput: 0: 9676.8, 1: 9998.9. Samples: 155437156. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:31,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-5.683')] [2023-12-27 21:24:31,672][106225] Updated weights for policy 1, policy_version 303801 (0.0010) [2023-12-27 21:24:31,735][106225] Updated weights for policy 1, policy_version 303811 (0.0009) [2023-12-27 21:24:31,770][106226] Updated weights for policy 0, policy_version 303263 (0.0008) [2023-12-27 21:24:31,789][106225] Updated weights for policy 1, policy_version 303821 (0.0008) [2023-12-27 21:24:31,831][106226] Updated weights for policy 0, policy_version 303273 (0.0009) [2023-12-27 21:24:31,896][106226] Updated weights for policy 0, policy_version 303283 (0.0008) [2023-12-27 21:24:32,509][106225] Updated weights for policy 1, policy_version 303831 (0.0009) [2023-12-27 21:24:32,569][106225] Updated weights for policy 1, policy_version 303841 (0.0010) [2023-12-27 21:24:32,629][106225] Updated weights for policy 1, policy_version 303851 (0.0010) [2023-12-27 21:24:32,650][106226] Updated weights for policy 0, policy_version 303293 (0.0007) [2023-12-27 21:24:32,710][106226] Updated weights for policy 0, policy_version 303303 (0.0008) [2023-12-27 21:24:32,759][106226] Updated weights for policy 0, policy_version 303313 (0.0007) [2023-12-27 21:24:33,325][106225] Updated weights for policy 1, policy_version 303861 (0.0010) [2023-12-27 21:24:33,381][106225] Updated weights for policy 1, policy_version 303871 (0.0010) [2023-12-27 21:24:33,387][106226] Updated weights for policy 0, policy_version 303323 (0.0008) [2023-12-27 21:24:33,434][106225] Updated weights for policy 1, policy_version 303881 (0.0010) [2023-12-27 21:24:33,437][106226] Updated weights for policy 0, policy_version 303333 (0.0011) [2023-12-27 21:24:33,487][106226] Updated weights for policy 0, policy_version 303343 (0.0010) [2023-12-27 21:24:34,113][106226] Updated weights for policy 0, policy_version 303353 (0.0010) [2023-12-27 21:24:34,158][106225] Updated weights for policy 1, policy_version 303891 (0.0014) [2023-12-27 21:24:34,183][106226] Updated weights for policy 0, policy_version 303363 (0.0009) [2023-12-27 21:24:34,218][106225] Updated weights for policy 1, policy_version 303901 (0.0009) [2023-12-27 21:24:34,236][106226] Updated weights for policy 0, policy_version 303373 (0.0006) [2023-12-27 21:24:34,280][106225] Updated weights for policy 1, policy_version 303911 (0.0010) [2023-12-27 21:24:34,290][106226] Updated weights for policy 0, policy_version 303383 (0.0006) [2023-12-27 21:24:34,927][106225] Updated weights for policy 1, policy_version 303921 (0.0005) [2023-12-27 21:24:34,990][106225] Updated weights for policy 1, policy_version 303931 (0.0006) [2023-12-27 21:24:35,042][106225] Updated weights for policy 1, policy_version 303941 (0.0006) [2023-12-27 21:24:35,061][106226] Updated weights for policy 0, policy_version 303393 (0.0008) [2023-12-27 21:24:35,094][106225] Updated weights for policy 1, policy_version 303951 (0.0006) [2023-12-27 21:24:35,121][106226] Updated weights for policy 0, policy_version 303403 (0.0008) [2023-12-27 21:24:35,181][106226] Updated weights for policy 0, policy_version 303413 (0.0008) [2023-12-27 21:24:35,793][106225] Updated weights for policy 1, policy_version 303961 (0.0006) [2023-12-27 21:24:35,809][106226] Updated weights for policy 0, policy_version 303423 (0.0008) [2023-12-27 21:24:35,849][106225] Updated weights for policy 1, policy_version 303971 (0.0006) [2023-12-27 21:24:35,871][106226] Updated weights for policy 0, policy_version 303433 (0.0008) [2023-12-27 21:24:35,911][106225] Updated weights for policy 1, policy_version 303981 (0.0006) [2023-12-27 21:24:35,928][106226] Updated weights for policy 0, policy_version 303443 (0.0007) [2023-12-27 21:24:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 155549696. Throughput: 0: 9642.7, 1: 10008.7. Samples: 155556804. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:36,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.413')] [2023-12-27 21:24:36,486][106225] Updated weights for policy 1, policy_version 303991 (0.0008) [2023-12-27 21:24:36,542][106225] Updated weights for policy 1, policy_version 304001 (0.0006) [2023-12-27 21:24:36,610][106225] Updated weights for policy 1, policy_version 304011 (0.0007) [2023-12-27 21:24:36,734][106226] Updated weights for policy 0, policy_version 303453 (0.0009) [2023-12-27 21:24:36,800][106226] Updated weights for policy 0, policy_version 303463 (0.0009) [2023-12-27 21:24:36,867][106226] Updated weights for policy 0, policy_version 303473 (0.0009) [2023-12-27 21:24:37,202][106225] Updated weights for policy 1, policy_version 304021 (0.0007) [2023-12-27 21:24:37,250][106225] Updated weights for policy 1, policy_version 304031 (0.0005) [2023-12-27 21:24:37,303][106225] Updated weights for policy 1, policy_version 304041 (0.0009) [2023-12-27 21:24:37,605][106226] Updated weights for policy 0, policy_version 303483 (0.0009) [2023-12-27 21:24:37,670][106226] Updated weights for policy 0, policy_version 303493 (0.0006) [2023-12-27 21:24:37,739][106226] Updated weights for policy 0, policy_version 303503 (0.0010) [2023-12-27 21:24:37,965][106225] Updated weights for policy 1, policy_version 304051 (0.0007) [2023-12-27 21:24:38,025][106225] Updated weights for policy 1, policy_version 304061 (0.0006) [2023-12-27 21:24:38,071][106225] Updated weights for policy 1, policy_version 304071 (0.0007) [2023-12-27 21:24:38,391][106226] Updated weights for policy 0, policy_version 303513 (0.0011) [2023-12-27 21:24:38,455][106226] Updated weights for policy 0, policy_version 303523 (0.0011) [2023-12-27 21:24:38,516][106226] Updated weights for policy 0, policy_version 303533 (0.0010) [2023-12-27 21:24:38,583][106226] Updated weights for policy 0, policy_version 303543 (0.0011) [2023-12-27 21:24:38,811][106225] Updated weights for policy 1, policy_version 304081 (0.0007) [2023-12-27 21:24:38,869][106225] Updated weights for policy 1, policy_version 304091 (0.0008) [2023-12-27 21:24:38,931][106225] Updated weights for policy 1, policy_version 304101 (0.0008) [2023-12-27 21:24:38,988][106225] Updated weights for policy 1, policy_version 304111 (0.0009) [2023-12-27 21:24:39,224][106226] Updated weights for policy 0, policy_version 303553 (0.0007) [2023-12-27 21:24:39,289][106226] Updated weights for policy 0, policy_version 303563 (0.0011) [2023-12-27 21:24:39,348][106226] Updated weights for policy 0, policy_version 303573 (0.0010) [2023-12-27 21:24:39,750][106225] Updated weights for policy 1, policy_version 304121 (0.0007) [2023-12-27 21:24:39,816][106225] Updated weights for policy 1, policy_version 304131 (0.0010) [2023-12-27 21:24:39,878][106225] Updated weights for policy 1, policy_version 304141 (0.0007) [2023-12-27 21:24:40,056][106226] Updated weights for policy 0, policy_version 303583 (0.0008) [2023-12-27 21:24:40,114][106226] Updated weights for policy 0, policy_version 303593 (0.0009) [2023-12-27 21:24:40,178][106226] Updated weights for policy 0, policy_version 303603 (0.0008) [2023-12-27 21:24:40,639][106225] Updated weights for policy 1, policy_version 304151 (0.0007) [2023-12-27 21:24:40,691][106225] Updated weights for policy 1, policy_version 304161 (0.0005) [2023-12-27 21:24:40,754][106225] Updated weights for policy 1, policy_version 304171 (0.0005) [2023-12-27 21:24:40,846][106226] Updated weights for policy 0, policy_version 303613 (0.0007) [2023-12-27 21:24:40,906][106226] Updated weights for policy 0, policy_version 303623 (0.0005) [2023-12-27 21:24:40,969][106226] Updated weights for policy 0, policy_version 303633 (0.0005) [2023-12-27 21:24:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 155648000. Throughput: 0: 9697.5, 1: 10018.1. Samples: 155617820. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:41,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.642')] [2023-12-27 21:24:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000304176_77889536.pth... [2023-12-27 21:24:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000303640_77758464.pth... [2023-12-27 21:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000302520_77471744.pth [2023-12-27 21:24:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000302992_77586432.pth [2023-12-27 21:24:41,416][106225] Updated weights for policy 1, policy_version 304181 (0.0007) [2023-12-27 21:24:41,472][106225] Updated weights for policy 1, policy_version 304191 (0.0008) [2023-12-27 21:24:41,524][106225] Updated weights for policy 1, policy_version 304201 (0.0008) [2023-12-27 21:24:41,658][106226] Updated weights for policy 0, policy_version 303643 (0.0007) [2023-12-27 21:24:41,733][106226] Updated weights for policy 0, policy_version 303653 (0.0010) [2023-12-27 21:24:41,796][106226] Updated weights for policy 0, policy_version 303663 (0.0008) [2023-12-27 21:24:42,313][106225] Updated weights for policy 1, policy_version 304211 (0.0008) [2023-12-27 21:24:42,380][106225] Updated weights for policy 1, policy_version 304221 (0.0008) [2023-12-27 21:24:42,438][106225] Updated weights for policy 1, policy_version 304231 (0.0006) [2023-12-27 21:24:42,586][106226] Updated weights for policy 0, policy_version 303673 (0.0008) [2023-12-27 21:24:42,646][106226] Updated weights for policy 0, policy_version 303683 (0.0009) [2023-12-27 21:24:42,704][106226] Updated weights for policy 0, policy_version 303693 (0.0009) [2023-12-27 21:24:42,765][106226] Updated weights for policy 0, policy_version 303703 (0.0009) [2023-12-27 21:24:43,162][106225] Updated weights for policy 1, policy_version 304241 (0.0007) [2023-12-27 21:24:43,227][106225] Updated weights for policy 1, policy_version 304251 (0.0008) [2023-12-27 21:24:43,291][106225] Updated weights for policy 1, policy_version 304261 (0.0008) [2023-12-27 21:24:43,339][106225] Updated weights for policy 1, policy_version 304271 (0.0008) [2023-12-27 21:24:43,444][106226] Updated weights for policy 0, policy_version 303713 (0.0008) [2023-12-27 21:24:43,507][106226] Updated weights for policy 0, policy_version 303723 (0.0009) [2023-12-27 21:24:43,560][106226] Updated weights for policy 0, policy_version 303733 (0.0009) [2023-12-27 21:24:44,045][106225] Updated weights for policy 1, policy_version 304281 (0.0009) [2023-12-27 21:24:44,110][106225] Updated weights for policy 1, policy_version 304291 (0.0008) [2023-12-27 21:24:44,164][106225] Updated weights for policy 1, policy_version 304301 (0.0009) [2023-12-27 21:24:44,289][106226] Updated weights for policy 0, policy_version 303743 (0.0008) [2023-12-27 21:24:44,338][106226] Updated weights for policy 0, policy_version 303753 (0.0008) [2023-12-27 21:24:44,405][106226] Updated weights for policy 0, policy_version 303763 (0.0010) [2023-12-27 21:24:44,946][106225] Updated weights for policy 1, policy_version 304311 (0.0008) [2023-12-27 21:24:45,005][106225] Updated weights for policy 1, policy_version 304321 (0.0008) [2023-12-27 21:24:45,066][106225] Updated weights for policy 1, policy_version 304331 (0.0008) [2023-12-27 21:24:45,083][106226] Updated weights for policy 0, policy_version 303773 (0.0009) [2023-12-27 21:24:45,146][106226] Updated weights for policy 0, policy_version 303783 (0.0008) [2023-12-27 21:24:45,216][106226] Updated weights for policy 0, policy_version 303793 (0.0009) [2023-12-27 21:24:45,809][106225] Updated weights for policy 1, policy_version 304341 (0.0008) [2023-12-27 21:24:45,870][106225] Updated weights for policy 1, policy_version 304351 (0.0008) [2023-12-27 21:24:45,936][106225] Updated weights for policy 1, policy_version 304361 (0.0009) [2023-12-27 21:24:45,987][106226] Updated weights for policy 0, policy_version 303803 (0.0009) [2023-12-27 21:24:46,045][106226] Updated weights for policy 0, policy_version 303813 (0.0009) [2023-12-27 21:24:46,106][106226] Updated weights for policy 0, policy_version 303823 (0.0009) [2023-12-27 21:24:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 155746304. Throughput: 0: 9714.1, 1: 9982.7. Samples: 155733480. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:46,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-5.558')] [2023-12-27 21:24:46,668][106225] Updated weights for policy 1, policy_version 304371 (0.0009) [2023-12-27 21:24:46,721][106225] Updated weights for policy 1, policy_version 304381 (0.0008) [2023-12-27 21:24:46,776][106225] Updated weights for policy 1, policy_version 304391 (0.0009) [2023-12-27 21:24:46,795][106226] Updated weights for policy 0, policy_version 303833 (0.0008) [2023-12-27 21:24:46,845][106226] Updated weights for policy 0, policy_version 303843 (0.0007) [2023-12-27 21:24:46,893][106226] Updated weights for policy 0, policy_version 303853 (0.0008) [2023-12-27 21:24:46,946][106226] Updated weights for policy 0, policy_version 303863 (0.0009) [2023-12-27 21:24:47,511][106225] Updated weights for policy 1, policy_version 304401 (0.0008) [2023-12-27 21:24:47,572][106225] Updated weights for policy 1, policy_version 304411 (0.0008) [2023-12-27 21:24:47,627][106225] Updated weights for policy 1, policy_version 304421 (0.0008) [2023-12-27 21:24:47,667][106226] Updated weights for policy 0, policy_version 303873 (0.0007) [2023-12-27 21:24:47,680][106225] Updated weights for policy 1, policy_version 304431 (0.0007) [2023-12-27 21:24:47,712][106226] Updated weights for policy 0, policy_version 303883 (0.0007) [2023-12-27 21:24:47,766][106226] Updated weights for policy 0, policy_version 303893 (0.0008) [2023-12-27 21:24:48,394][106225] Updated weights for policy 1, policy_version 304441 (0.0007) [2023-12-27 21:24:48,457][106225] Updated weights for policy 1, policy_version 304451 (0.0009) [2023-12-27 21:24:48,517][106226] Updated weights for policy 0, policy_version 303903 (0.0011) [2023-12-27 21:24:48,518][106225] Updated weights for policy 1, policy_version 304461 (0.0008) [2023-12-27 21:24:48,567][106226] Updated weights for policy 0, policy_version 303913 (0.0010) [2023-12-27 21:24:48,627][106226] Updated weights for policy 0, policy_version 303923 (0.0011) [2023-12-27 21:24:49,295][106225] Updated weights for policy 1, policy_version 304471 (0.0008) [2023-12-27 21:24:49,329][106226] Updated weights for policy 0, policy_version 303933 (0.0008) [2023-12-27 21:24:49,359][106225] Updated weights for policy 1, policy_version 304481 (0.0009) [2023-12-27 21:24:49,399][106226] Updated weights for policy 0, policy_version 303943 (0.0008) [2023-12-27 21:24:49,424][106225] Updated weights for policy 1, policy_version 304491 (0.0007) [2023-12-27 21:24:49,453][106226] Updated weights for policy 0, policy_version 303953 (0.0009) [2023-12-27 21:24:50,094][106225] Updated weights for policy 1, policy_version 304501 (0.0006) [2023-12-27 21:24:50,157][106225] Updated weights for policy 1, policy_version 304511 (0.0007) [2023-12-27 21:24:50,186][106226] Updated weights for policy 0, policy_version 303963 (0.0010) [2023-12-27 21:24:50,219][106225] Updated weights for policy 1, policy_version 304521 (0.0007) [2023-12-27 21:24:50,247][106226] Updated weights for policy 0, policy_version 303973 (0.0009) [2023-12-27 21:24:50,314][106226] Updated weights for policy 0, policy_version 303983 (0.0010) [2023-12-27 21:24:50,928][106226] Updated weights for policy 0, policy_version 303993 (0.0010) [2023-12-27 21:24:50,935][106225] Updated weights for policy 1, policy_version 304531 (0.0007) [2023-12-27 21:24:50,988][106226] Updated weights for policy 0, policy_version 304003 (0.0009) [2023-12-27 21:24:50,993][106225] Updated weights for policy 1, policy_version 304541 (0.0008) [2023-12-27 21:24:51,051][106226] Updated weights for policy 0, policy_version 304013 (0.0010) [2023-12-27 21:24:51,062][106225] Updated weights for policy 1, policy_version 304551 (0.0008) [2023-12-27 21:24:51,111][106226] Updated weights for policy 0, policy_version 304023 (0.0007) [2023-12-27 21:24:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 155844608. Throughput: 0: 9714.1, 1: 9932.9. Samples: 155849076. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:51,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-5.535')] [2023-12-27 21:24:51,760][106225] Updated weights for policy 1, policy_version 304561 (0.0008) [2023-12-27 21:24:51,822][106225] Updated weights for policy 1, policy_version 304571 (0.0006) [2023-12-27 21:24:51,888][106225] Updated weights for policy 1, policy_version 304581 (0.0006) [2023-12-27 21:24:51,898][106226] Updated weights for policy 0, policy_version 304033 (0.0008) [2023-12-27 21:24:51,949][106225] Updated weights for policy 1, policy_version 304591 (0.0006) [2023-12-27 21:24:51,958][106226] Updated weights for policy 0, policy_version 304043 (0.0008) [2023-12-27 21:24:52,021][106226] Updated weights for policy 0, policy_version 304053 (0.0008) [2023-12-27 21:24:52,612][106225] Updated weights for policy 1, policy_version 304601 (0.0009) [2023-12-27 21:24:52,672][106225] Updated weights for policy 1, policy_version 304611 (0.0009) [2023-12-27 21:24:52,729][106225] Updated weights for policy 1, policy_version 304621 (0.0008) [2023-12-27 21:24:52,785][106226] Updated weights for policy 0, policy_version 304063 (0.0008) [2023-12-27 21:24:52,838][106226] Updated weights for policy 0, policy_version 304073 (0.0009) [2023-12-27 21:24:52,899][106226] Updated weights for policy 0, policy_version 304083 (0.0009) [2023-12-27 21:24:53,464][106225] Updated weights for policy 1, policy_version 304631 (0.0008) [2023-12-27 21:24:53,520][106225] Updated weights for policy 1, policy_version 304641 (0.0008) [2023-12-27 21:24:53,586][106225] Updated weights for policy 1, policy_version 304651 (0.0008) [2023-12-27 21:24:53,617][106226] Updated weights for policy 0, policy_version 304093 (0.0010) [2023-12-27 21:24:53,673][106226] Updated weights for policy 0, policy_version 304103 (0.0010) [2023-12-27 21:24:53,731][106226] Updated weights for policy 0, policy_version 304113 (0.0010) [2023-12-27 21:24:54,249][106225] Updated weights for policy 1, policy_version 304661 (0.0008) [2023-12-27 21:24:54,302][106225] Updated weights for policy 1, policy_version 304671 (0.0010) [2023-12-27 21:24:54,345][106226] Updated weights for policy 0, policy_version 304123 (0.0011) [2023-12-27 21:24:54,362][106225] Updated weights for policy 1, policy_version 304681 (0.0010) [2023-12-27 21:24:54,398][106226] Updated weights for policy 0, policy_version 304133 (0.0010) [2023-12-27 21:24:54,458][106226] Updated weights for policy 0, policy_version 304143 (0.0008) [2023-12-27 21:24:55,018][106226] Updated weights for policy 0, policy_version 304153 (0.0006) [2023-12-27 21:24:55,066][106225] Updated weights for policy 1, policy_version 304691 (0.0011) [2023-12-27 21:24:55,084][106226] Updated weights for policy 0, policy_version 304163 (0.0007) [2023-12-27 21:24:55,133][106225] Updated weights for policy 1, policy_version 304701 (0.0011) [2023-12-27 21:24:55,149][106226] Updated weights for policy 0, policy_version 304173 (0.0010) [2023-12-27 21:24:55,190][106225] Updated weights for policy 1, policy_version 304711 (0.0010) [2023-12-27 21:24:55,208][106226] Updated weights for policy 0, policy_version 304183 (0.0010) [2023-12-27 21:24:55,825][106225] Updated weights for policy 1, policy_version 304721 (0.0010) [2023-12-27 21:24:55,853][106226] Updated weights for policy 0, policy_version 304193 (0.0006) [2023-12-27 21:24:55,888][106225] Updated weights for policy 1, policy_version 304731 (0.0008) [2023-12-27 21:24:55,911][106226] Updated weights for policy 0, policy_version 304203 (0.0005) [2023-12-27 21:24:55,948][106225] Updated weights for policy 1, policy_version 304741 (0.0005) [2023-12-27 21:24:55,972][106226] Updated weights for policy 0, policy_version 304213 (0.0008) [2023-12-27 21:24:56,001][106225] Updated weights for policy 1, policy_version 304751 (0.0006) [2023-12-27 21:24:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 155942912. Throughput: 0: 9656.4, 1: 9900.8. Samples: 155906584. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:24:56,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-5.308')] [2023-12-27 21:24:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000304752_78036992.pth... [2023-12-27 21:24:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000304216_77905920.pth... [2023-12-27 21:24:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000303600_77742080.pth [2023-12-27 21:24:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000303064_77611008.pth [2023-12-27 21:24:56,608][106225] Updated weights for policy 1, policy_version 304761 (0.0010) [2023-12-27 21:24:56,657][106225] Updated weights for policy 1, policy_version 304771 (0.0010) [2023-12-27 21:24:56,671][106226] Updated weights for policy 0, policy_version 304223 (0.0007) [2023-12-27 21:24:56,707][106225] Updated weights for policy 1, policy_version 304781 (0.0010) [2023-12-27 21:24:56,719][106226] Updated weights for policy 0, policy_version 304233 (0.0005) [2023-12-27 21:24:56,770][106226] Updated weights for policy 0, policy_version 304243 (0.0007) [2023-12-27 21:24:57,369][106225] Updated weights for policy 1, policy_version 304791 (0.0010) [2023-12-27 21:24:57,427][106225] Updated weights for policy 1, policy_version 304801 (0.0008) [2023-12-27 21:24:57,484][106225] Updated weights for policy 1, policy_version 304811 (0.0005) [2023-12-27 21:24:57,499][106226] Updated weights for policy 0, policy_version 304253 (0.0007) [2023-12-27 21:24:57,548][106226] Updated weights for policy 0, policy_version 304263 (0.0006) [2023-12-27 21:24:57,599][106226] Updated weights for policy 0, policy_version 304273 (0.0005) [2023-12-27 21:24:58,015][106225] Updated weights for policy 1, policy_version 304821 (0.0007) [2023-12-27 21:24:58,074][106225] Updated weights for policy 1, policy_version 304831 (0.0010) [2023-12-27 21:24:58,127][106225] Updated weights for policy 1, policy_version 304841 (0.0008) [2023-12-27 21:24:58,227][106226] Updated weights for policy 0, policy_version 304283 (0.0006) [2023-12-27 21:24:58,283][106226] Updated weights for policy 0, policy_version 304293 (0.0008) [2023-12-27 21:24:58,360][106226] Updated weights for policy 0, policy_version 304303 (0.0007) [2023-12-27 21:24:58,810][106225] Updated weights for policy 1, policy_version 304851 (0.0007) [2023-12-27 21:24:58,880][106225] Updated weights for policy 1, policy_version 304861 (0.0009) [2023-12-27 21:24:58,948][106225] Updated weights for policy 1, policy_version 304871 (0.0009) [2023-12-27 21:24:59,177][106226] Updated weights for policy 0, policy_version 304313 (0.0008) [2023-12-27 21:24:59,253][106226] Updated weights for policy 0, policy_version 304323 (0.0008) [2023-12-27 21:24:59,320][106226] Updated weights for policy 0, policy_version 304333 (0.0008) [2023-12-27 21:24:59,391][106226] Updated weights for policy 0, policy_version 304343 (0.0008) [2023-12-27 21:24:59,724][106225] Updated weights for policy 1, policy_version 304881 (0.0007) [2023-12-27 21:24:59,781][106225] Updated weights for policy 1, policy_version 304891 (0.0007) [2023-12-27 21:24:59,837][106225] Updated weights for policy 1, policy_version 304901 (0.0009) [2023-12-27 21:24:59,897][106225] Updated weights for policy 1, policy_version 304911 (0.0007) [2023-12-27 21:25:00,128][106226] Updated weights for policy 0, policy_version 304353 (0.0006) [2023-12-27 21:25:00,188][106226] Updated weights for policy 0, policy_version 304363 (0.0005) [2023-12-27 21:25:00,244][106226] Updated weights for policy 0, policy_version 304373 (0.0005) [2023-12-27 21:25:00,636][106225] Updated weights for policy 1, policy_version 304921 (0.0008) [2023-12-27 21:25:00,695][106225] Updated weights for policy 1, policy_version 304931 (0.0008) [2023-12-27 21:25:00,758][106225] Updated weights for policy 1, policy_version 304941 (0.0009) [2023-12-27 21:25:00,806][106226] Updated weights for policy 0, policy_version 304383 (0.0005) [2023-12-27 21:25:00,860][106226] Updated weights for policy 0, policy_version 304393 (0.0007) [2023-12-27 21:25:00,907][106226] Updated weights for policy 0, policy_version 304403 (0.0009) [2023-12-27 21:25:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 156041216. Throughput: 0: 9801.6, 1: 9980.2. Samples: 156029472. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:01,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.471')] [2023-12-27 21:25:01,445][106225] Updated weights for policy 1, policy_version 304951 (0.0008) [2023-12-27 21:25:01,500][106225] Updated weights for policy 1, policy_version 304961 (0.0008) [2023-12-27 21:25:01,553][106225] Updated weights for policy 1, policy_version 304971 (0.0008) [2023-12-27 21:25:01,737][106226] Updated weights for policy 0, policy_version 304413 (0.0007) [2023-12-27 21:25:01,798][106226] Updated weights for policy 0, policy_version 304423 (0.0008) [2023-12-27 21:25:01,858][106226] Updated weights for policy 0, policy_version 304433 (0.0007) [2023-12-27 21:25:02,262][106225] Updated weights for policy 1, policy_version 304981 (0.0008) [2023-12-27 21:25:02,314][106225] Updated weights for policy 1, policy_version 304991 (0.0008) [2023-12-27 21:25:02,375][106225] Updated weights for policy 1, policy_version 305001 (0.0008) [2023-12-27 21:25:02,574][106226] Updated weights for policy 0, policy_version 304443 (0.0006) [2023-12-27 21:25:02,635][106226] Updated weights for policy 0, policy_version 304453 (0.0009) [2023-12-27 21:25:02,691][106226] Updated weights for policy 0, policy_version 304463 (0.0009) [2023-12-27 21:25:03,123][106225] Updated weights for policy 1, policy_version 305011 (0.0008) [2023-12-27 21:25:03,173][106225] Updated weights for policy 1, policy_version 305021 (0.0008) [2023-12-27 21:25:03,222][106225] Updated weights for policy 1, policy_version 305031 (0.0008) [2023-12-27 21:25:03,393][106226] Updated weights for policy 0, policy_version 304473 (0.0009) [2023-12-27 21:25:03,453][106226] Updated weights for policy 0, policy_version 304483 (0.0008) [2023-12-27 21:25:03,514][106226] Updated weights for policy 0, policy_version 304493 (0.0009) [2023-12-27 21:25:03,564][106226] Updated weights for policy 0, policy_version 304503 (0.0009) [2023-12-27 21:25:03,940][106225] Updated weights for policy 1, policy_version 305041 (0.0008) [2023-12-27 21:25:04,000][106225] Updated weights for policy 1, policy_version 305051 (0.0008) [2023-12-27 21:25:04,059][106225] Updated weights for policy 1, policy_version 305061 (0.0008) [2023-12-27 21:25:04,118][106225] Updated weights for policy 1, policy_version 305071 (0.0008) [2023-12-27 21:25:04,312][106226] Updated weights for policy 0, policy_version 304513 (0.0010) [2023-12-27 21:25:04,366][106226] Updated weights for policy 0, policy_version 304523 (0.0011) [2023-12-27 21:25:04,421][106226] Updated weights for policy 0, policy_version 304533 (0.0011) [2023-12-27 21:25:04,877][106225] Updated weights for policy 1, policy_version 305081 (0.0008) [2023-12-27 21:25:04,934][106225] Updated weights for policy 1, policy_version 305091 (0.0008) [2023-12-27 21:25:04,989][106225] Updated weights for policy 1, policy_version 305101 (0.0007) [2023-12-27 21:25:05,157][106226] Updated weights for policy 0, policy_version 304543 (0.0010) [2023-12-27 21:25:05,211][106226] Updated weights for policy 0, policy_version 304553 (0.0010) [2023-12-27 21:25:05,268][106226] Updated weights for policy 0, policy_version 304563 (0.0010) [2023-12-27 21:25:05,694][106225] Updated weights for policy 1, policy_version 305111 (0.0008) [2023-12-27 21:25:05,745][106225] Updated weights for policy 1, policy_version 305121 (0.0007) [2023-12-27 21:25:05,793][106225] Updated weights for policy 1, policy_version 305131 (0.0008) [2023-12-27 21:25:05,999][106226] Updated weights for policy 0, policy_version 304573 (0.0009) [2023-12-27 21:25:06,052][106226] Updated weights for policy 0, policy_version 304583 (0.0009) [2023-12-27 21:25:06,126][106226] Updated weights for policy 0, policy_version 304593 (0.0008) [2023-12-27 21:25:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 156139520. Throughput: 0: 9835.0, 1: 9874.2. Samples: 156145688. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:06,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.582')] [2023-12-27 21:25:06,561][106225] Updated weights for policy 1, policy_version 305141 (0.0009) [2023-12-27 21:25:06,627][106225] Updated weights for policy 1, policy_version 305151 (0.0008) [2023-12-27 21:25:06,691][106225] Updated weights for policy 1, policy_version 305161 (0.0008) [2023-12-27 21:25:06,807][106226] Updated weights for policy 0, policy_version 304603 (0.0009) [2023-12-27 21:25:06,864][106226] Updated weights for policy 0, policy_version 304613 (0.0009) [2023-12-27 21:25:06,921][106226] Updated weights for policy 0, policy_version 304623 (0.0009) [2023-12-27 21:25:07,366][106225] Updated weights for policy 1, policy_version 305171 (0.0007) [2023-12-27 21:25:07,417][106225] Updated weights for policy 1, policy_version 305181 (0.0005) [2023-12-27 21:25:07,467][106225] Updated weights for policy 1, policy_version 305191 (0.0005) [2023-12-27 21:25:07,665][106226] Updated weights for policy 0, policy_version 304633 (0.0008) [2023-12-27 21:25:07,722][106226] Updated weights for policy 0, policy_version 304643 (0.0008) [2023-12-27 21:25:07,785][106226] Updated weights for policy 0, policy_version 304653 (0.0009) [2023-12-27 21:25:07,840][106226] Updated weights for policy 0, policy_version 304663 (0.0009) [2023-12-27 21:25:08,068][106225] Updated weights for policy 1, policy_version 305201 (0.0006) [2023-12-27 21:25:08,127][106225] Updated weights for policy 1, policy_version 305211 (0.0009) [2023-12-27 21:25:08,175][106225] Updated weights for policy 1, policy_version 305221 (0.0005) [2023-12-27 21:25:08,228][106225] Updated weights for policy 1, policy_version 305231 (0.0006) [2023-12-27 21:25:08,574][106226] Updated weights for policy 0, policy_version 304673 (0.0008) [2023-12-27 21:25:08,642][106226] Updated weights for policy 0, policy_version 304683 (0.0009) [2023-12-27 21:25:08,706][106226] Updated weights for policy 0, policy_version 304693 (0.0009) [2023-12-27 21:25:08,931][106225] Updated weights for policy 1, policy_version 305241 (0.0008) [2023-12-27 21:25:08,980][106225] Updated weights for policy 1, policy_version 305251 (0.0007) [2023-12-27 21:25:09,034][106225] Updated weights for policy 1, policy_version 305261 (0.0005) [2023-12-27 21:25:09,378][106226] Updated weights for policy 0, policy_version 304703 (0.0009) [2023-12-27 21:25:09,439][106226] Updated weights for policy 0, policy_version 304713 (0.0008) [2023-12-27 21:25:09,490][106226] Updated weights for policy 0, policy_version 304723 (0.0007) [2023-12-27 21:25:09,732][106225] Updated weights for policy 1, policy_version 305271 (0.0008) [2023-12-27 21:25:09,790][106225] Updated weights for policy 1, policy_version 305281 (0.0007) [2023-12-27 21:25:09,859][106225] Updated weights for policy 1, policy_version 305291 (0.0007) [2023-12-27 21:25:10,294][106226] Updated weights for policy 0, policy_version 304733 (0.0007) [2023-12-27 21:25:10,363][106226] Updated weights for policy 0, policy_version 304743 (0.0007) [2023-12-27 21:25:10,438][106226] Updated weights for policy 0, policy_version 304753 (0.0007) [2023-12-27 21:25:10,516][106225] Updated weights for policy 1, policy_version 305301 (0.0007) [2023-12-27 21:25:10,580][106225] Updated weights for policy 1, policy_version 305311 (0.0008) [2023-12-27 21:25:10,644][106225] Updated weights for policy 1, policy_version 305321 (0.0007) [2023-12-27 21:25:11,156][106226] Updated weights for policy 0, policy_version 304763 (0.0007) [2023-12-27 21:25:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 156229632. Throughput: 0: 9826.6, 1: 9905.1. Samples: 156204736. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:11,175][105115] Avg episode reward: [(0, '-5.033'), (1, '-5.375')] [2023-12-27 21:25:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000305328_78184448.pth... [2023-12-27 21:25:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000304176_77889536.pth [2023-12-27 21:25:11,211][106226] Updated weights for policy 0, policy_version 304773 (0.0009) [2023-12-27 21:25:11,277][106226] Updated weights for policy 0, policy_version 304783 (0.0008) [2023-12-27 21:25:11,335][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000304792_78053376.pth... [2023-12-27 21:25:11,340][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000303640_77758464.pth [2023-12-27 21:25:11,360][106225] Updated weights for policy 1, policy_version 305331 (0.0007) [2023-12-27 21:25:11,419][106225] Updated weights for policy 1, policy_version 305341 (0.0008) [2023-12-27 21:25:11,476][106225] Updated weights for policy 1, policy_version 305351 (0.0008) [2023-12-27 21:25:12,033][106226] Updated weights for policy 0, policy_version 304793 (0.0008) [2023-12-27 21:25:12,093][106226] Updated weights for policy 0, policy_version 304803 (0.0008) [2023-12-27 21:25:12,144][106226] Updated weights for policy 0, policy_version 304813 (0.0008) [2023-12-27 21:25:12,192][106226] Updated weights for policy 0, policy_version 304823 (0.0008) [2023-12-27 21:25:12,284][106225] Updated weights for policy 1, policy_version 305361 (0.0007) [2023-12-27 21:25:12,354][106225] Updated weights for policy 1, policy_version 305371 (0.0007) [2023-12-27 21:25:12,417][106225] Updated weights for policy 1, policy_version 305381 (0.0008) [2023-12-27 21:25:12,467][106225] Updated weights for policy 1, policy_version 305391 (0.0007) [2023-12-27 21:25:12,977][106226] Updated weights for policy 0, policy_version 304833 (0.0006) [2023-12-27 21:25:13,041][106226] Updated weights for policy 0, policy_version 304844 (0.0008) [2023-12-27 21:25:13,087][106226] Updated weights for policy 0, policy_version 304854 (0.0006) [2023-12-27 21:25:13,192][106225] Updated weights for policy 1, policy_version 305401 (0.0007) [2023-12-27 21:25:13,237][106225] Updated weights for policy 1, policy_version 305411 (0.0006) [2023-12-27 21:25:13,283][106225] Updated weights for policy 1, policy_version 305421 (0.0005) [2023-12-27 21:25:13,789][106226] Updated weights for policy 0, policy_version 304864 (0.0005) [2023-12-27 21:25:13,854][106226] Updated weights for policy 0, policy_version 304874 (0.0006) [2023-12-27 21:25:13,858][106225] Updated weights for policy 1, policy_version 305431 (0.0009) [2023-12-27 21:25:13,910][106225] Updated weights for policy 1, policy_version 305441 (0.0010) [2023-12-27 21:25:13,913][106226] Updated weights for policy 0, policy_version 304884 (0.0010) [2023-12-27 21:25:13,963][106225] Updated weights for policy 1, policy_version 305451 (0.0010) [2023-12-27 21:25:14,591][106226] Updated weights for policy 0, policy_version 304894 (0.0010) [2023-12-27 21:25:14,653][106226] Updated weights for policy 0, policy_version 304904 (0.0011) [2023-12-27 21:25:14,661][106225] Updated weights for policy 1, policy_version 305461 (0.0010) [2023-12-27 21:25:14,713][106226] Updated weights for policy 0, policy_version 304914 (0.0010) [2023-12-27 21:25:14,717][106225] Updated weights for policy 1, policy_version 305471 (0.0010) [2023-12-27 21:25:14,780][106225] Updated weights for policy 1, policy_version 305481 (0.0010) [2023-12-27 21:25:15,369][106226] Updated weights for policy 0, policy_version 304924 (0.0011) [2023-12-27 21:25:15,422][106226] Updated weights for policy 0, policy_version 304934 (0.0011) [2023-12-27 21:25:15,488][106226] Updated weights for policy 0, policy_version 304944 (0.0011) [2023-12-27 21:25:15,504][106225] Updated weights for policy 1, policy_version 305491 (0.0010) [2023-12-27 21:25:15,554][106225] Updated weights for policy 1, policy_version 305501 (0.0010) [2023-12-27 21:25:15,604][106225] Updated weights for policy 1, policy_version 305511 (0.0010) [2023-12-27 21:25:16,137][106226] Updated weights for policy 0, policy_version 304954 (0.0006) [2023-12-27 21:25:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 156327936. Throughput: 0: 9734.2, 1: 9933.2. Samples: 156322192. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:16,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-5.760')] [2023-12-27 21:25:16,198][106226] Updated weights for policy 0, policy_version 304964 (0.0008) [2023-12-27 21:25:16,262][106226] Updated weights for policy 0, policy_version 304974 (0.0008) [2023-12-27 21:25:16,318][106226] Updated weights for policy 0, policy_version 304984 (0.0008) [2023-12-27 21:25:16,328][106225] Updated weights for policy 1, policy_version 305521 (0.0010) [2023-12-27 21:25:16,390][106225] Updated weights for policy 1, policy_version 305531 (0.0010) [2023-12-27 21:25:16,450][106225] Updated weights for policy 1, policy_version 305541 (0.0010) [2023-12-27 21:25:16,514][106225] Updated weights for policy 1, policy_version 305551 (0.0010) [2023-12-27 21:25:17,019][106226] Updated weights for policy 0, policy_version 304994 (0.0007) [2023-12-27 21:25:17,079][106226] Updated weights for policy 0, policy_version 305004 (0.0006) [2023-12-27 21:25:17,139][106226] Updated weights for policy 0, policy_version 305014 (0.0007) [2023-12-27 21:25:17,166][106225] Updated weights for policy 1, policy_version 305561 (0.0010) [2023-12-27 21:25:17,217][106225] Updated weights for policy 1, policy_version 305571 (0.0010) [2023-12-27 21:25:17,272][106225] Updated weights for policy 1, policy_version 305581 (0.0010) [2023-12-27 21:25:17,760][106226] Updated weights for policy 0, policy_version 305024 (0.0007) [2023-12-27 21:25:17,810][106226] Updated weights for policy 0, policy_version 305034 (0.0008) [2023-12-27 21:25:17,860][106226] Updated weights for policy 0, policy_version 305044 (0.0009) [2023-12-27 21:25:17,970][106225] Updated weights for policy 1, policy_version 305591 (0.0010) [2023-12-27 21:25:18,034][106225] Updated weights for policy 1, policy_version 305601 (0.0010) [2023-12-27 21:25:18,090][106225] Updated weights for policy 1, policy_version 305611 (0.0010) [2023-12-27 21:25:18,626][106226] Updated weights for policy 0, policy_version 305054 (0.0008) [2023-12-27 21:25:18,684][106226] Updated weights for policy 0, policy_version 305064 (0.0008) [2023-12-27 21:25:18,739][106226] Updated weights for policy 0, policy_version 305074 (0.0008) [2023-12-27 21:25:18,822][106225] Updated weights for policy 1, policy_version 305621 (0.0010) [2023-12-27 21:25:18,883][106225] Updated weights for policy 1, policy_version 305631 (0.0010) [2023-12-27 21:25:18,934][106225] Updated weights for policy 1, policy_version 305641 (0.0010) [2023-12-27 21:25:19,541][106226] Updated weights for policy 0, policy_version 305084 (0.0007) [2023-12-27 21:25:19,598][106226] Updated weights for policy 0, policy_version 305094 (0.0005) [2023-12-27 21:25:19,646][106225] Updated weights for policy 1, policy_version 305651 (0.0009) [2023-12-27 21:25:19,663][106226] Updated weights for policy 0, policy_version 305104 (0.0007) [2023-12-27 21:25:19,709][106225] Updated weights for policy 1, policy_version 305661 (0.0009) [2023-12-27 21:25:19,771][106225] Updated weights for policy 1, policy_version 305671 (0.0011) [2023-12-27 21:25:20,372][106226] Updated weights for policy 0, policy_version 305114 (0.0006) [2023-12-27 21:25:20,429][106226] Updated weights for policy 0, policy_version 305124 (0.0008) [2023-12-27 21:25:20,457][106225] Updated weights for policy 1, policy_version 305681 (0.0010) [2023-12-27 21:25:20,492][106226] Updated weights for policy 0, policy_version 305134 (0.0007) [2023-12-27 21:25:20,510][106225] Updated weights for policy 1, policy_version 305691 (0.0007) [2023-12-27 21:25:20,552][106226] Updated weights for policy 0, policy_version 305144 (0.0006) [2023-12-27 21:25:20,563][106225] Updated weights for policy 1, policy_version 305701 (0.0007) [2023-12-27 21:25:20,624][106225] Updated weights for policy 1, policy_version 305711 (0.0008) [2023-12-27 21:25:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 156426240. Throughput: 0: 9725.9, 1: 9888.6. Samples: 156439456. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:21,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-5.575')] [2023-12-27 21:25:21,406][106226] Updated weights for policy 0, policy_version 305154 (0.0008) [2023-12-27 21:25:21,416][106225] Updated weights for policy 1, policy_version 305721 (0.0010) [2023-12-27 21:25:21,462][106226] Updated weights for policy 0, policy_version 305164 (0.0008) [2023-12-27 21:25:21,479][106225] Updated weights for policy 1, policy_version 305731 (0.0011) [2023-12-27 21:25:21,513][106226] Updated weights for policy 0, policy_version 305174 (0.0008) [2023-12-27 21:25:21,537][106225] Updated weights for policy 1, policy_version 305741 (0.0010) [2023-12-27 21:25:22,283][106226] Updated weights for policy 0, policy_version 305184 (0.0008) [2023-12-27 21:25:22,335][106225] Updated weights for policy 1, policy_version 305751 (0.0009) [2023-12-27 21:25:22,347][106226] Updated weights for policy 0, policy_version 305194 (0.0007) [2023-12-27 21:25:22,413][106226] Updated weights for policy 0, policy_version 305204 (0.0008) [2023-12-27 21:25:22,414][106225] Updated weights for policy 1, policy_version 305761 (0.0009) [2023-12-27 21:25:22,478][106225] Updated weights for policy 1, policy_version 305771 (0.0008) [2023-12-27 21:25:23,123][106226] Updated weights for policy 0, policy_version 305214 (0.0008) [2023-12-27 21:25:23,185][106226] Updated weights for policy 0, policy_version 305224 (0.0009) [2023-12-27 21:25:23,194][106225] Updated weights for policy 1, policy_version 305781 (0.0008) [2023-12-27 21:25:23,249][106226] Updated weights for policy 0, policy_version 305234 (0.0006) [2023-12-27 21:25:23,254][106225] Updated weights for policy 1, policy_version 305791 (0.0007) [2023-12-27 21:25:23,308][106225] Updated weights for policy 1, policy_version 305801 (0.0008) [2023-12-27 21:25:23,961][106226] Updated weights for policy 0, policy_version 305244 (0.0007) [2023-12-27 21:25:23,978][106225] Updated weights for policy 1, policy_version 305811 (0.0009) [2023-12-27 21:25:24,012][106226] Updated weights for policy 0, policy_version 305254 (0.0006) [2023-12-27 21:25:24,036][106225] Updated weights for policy 1, policy_version 305821 (0.0010) [2023-12-27 21:25:24,072][106226] Updated weights for policy 0, policy_version 305264 (0.0006) [2023-12-27 21:25:24,090][106225] Updated weights for policy 1, policy_version 305831 (0.0010) [2023-12-27 21:25:24,803][106226] Updated weights for policy 0, policy_version 305274 (0.0006) [2023-12-27 21:25:24,818][106225] Updated weights for policy 1, policy_version 305841 (0.0010) [2023-12-27 21:25:24,856][106226] Updated weights for policy 0, policy_version 305284 (0.0008) [2023-12-27 21:25:24,872][106225] Updated weights for policy 1, policy_version 305851 (0.0008) [2023-12-27 21:25:24,906][106226] Updated weights for policy 0, policy_version 305294 (0.0007) [2023-12-27 21:25:24,931][106225] Updated weights for policy 1, policy_version 305861 (0.0005) [2023-12-27 21:25:24,956][106226] Updated weights for policy 0, policy_version 305304 (0.0006) [2023-12-27 21:25:24,991][106225] Updated weights for policy 1, policy_version 305871 (0.0007) [2023-12-27 21:25:25,632][106225] Updated weights for policy 1, policy_version 305881 (0.0006) [2023-12-27 21:25:25,634][106226] Updated weights for policy 0, policy_version 305314 (0.0008) [2023-12-27 21:25:25,687][106225] Updated weights for policy 1, policy_version 305891 (0.0005) [2023-12-27 21:25:25,700][106226] Updated weights for policy 0, policy_version 305324 (0.0009) [2023-12-27 21:25:25,745][106225] Updated weights for policy 1, policy_version 305901 (0.0005) [2023-12-27 21:25:25,759][106226] Updated weights for policy 0, policy_version 305335 (0.0007) [2023-12-27 21:25:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 156524544. Throughput: 0: 9707.2, 1: 9798.8. Samples: 156495588. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:26,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-5.646')] [2023-12-27 21:25:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000305336_78192640.pth... [2023-12-27 21:25:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000305904_78331904.pth... [2023-12-27 21:25:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000304752_78036992.pth [2023-12-27 21:25:26,208][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000304216_77905920.pth [2023-12-27 21:25:26,320][106225] Updated weights for policy 1, policy_version 305911 (0.0005) [2023-12-27 21:25:26,373][106225] Updated weights for policy 1, policy_version 305921 (0.0005) [2023-12-27 21:25:26,420][106225] Updated weights for policy 1, policy_version 305931 (0.0005) [2023-12-27 21:25:26,527][106226] Updated weights for policy 0, policy_version 305345 (0.0009) [2023-12-27 21:25:26,583][106226] Updated weights for policy 0, policy_version 305355 (0.0008) [2023-12-27 21:25:26,646][106226] Updated weights for policy 0, policy_version 305365 (0.0008) [2023-12-27 21:25:27,084][106225] Updated weights for policy 1, policy_version 305941 (0.0008) [2023-12-27 21:25:27,144][106225] Updated weights for policy 1, policy_version 305951 (0.0009) [2023-12-27 21:25:27,203][106225] Updated weights for policy 1, policy_version 305961 (0.0006) [2023-12-27 21:25:27,314][106226] Updated weights for policy 0, policy_version 305375 (0.0006) [2023-12-27 21:25:27,378][106226] Updated weights for policy 0, policy_version 305385 (0.0007) [2023-12-27 21:25:27,438][106226] Updated weights for policy 0, policy_version 305395 (0.0009) [2023-12-27 21:25:27,839][106225] Updated weights for policy 1, policy_version 305971 (0.0006) [2023-12-27 21:25:27,890][106225] Updated weights for policy 1, policy_version 305981 (0.0009) [2023-12-27 21:25:27,954][106225] Updated weights for policy 1, policy_version 305991 (0.0008) [2023-12-27 21:25:28,132][106226] Updated weights for policy 0, policy_version 305405 (0.0008) [2023-12-27 21:25:28,183][106226] Updated weights for policy 0, policy_version 305415 (0.0008) [2023-12-27 21:25:28,230][106226] Updated weights for policy 0, policy_version 305425 (0.0008) [2023-12-27 21:25:28,611][106225] Updated weights for policy 1, policy_version 306001 (0.0008) [2023-12-27 21:25:28,672][106225] Updated weights for policy 1, policy_version 306011 (0.0007) [2023-12-27 21:25:28,730][106225] Updated weights for policy 1, policy_version 306021 (0.0008) [2023-12-27 21:25:28,792][106225] Updated weights for policy 1, policy_version 306031 (0.0006) [2023-12-27 21:25:29,028][106226] Updated weights for policy 0, policy_version 305435 (0.0007) [2023-12-27 21:25:29,083][106226] Updated weights for policy 0, policy_version 305445 (0.0005) [2023-12-27 21:25:29,137][106226] Updated weights for policy 0, policy_version 305455 (0.0005) [2023-12-27 21:25:29,390][106225] Updated weights for policy 1, policy_version 306041 (0.0008) [2023-12-27 21:25:29,458][106225] Updated weights for policy 1, policy_version 306051 (0.0006) [2023-12-27 21:25:29,525][106225] Updated weights for policy 1, policy_version 306061 (0.0006) [2023-12-27 21:25:29,861][106226] Updated weights for policy 0, policy_version 305465 (0.0008) [2023-12-27 21:25:29,923][106226] Updated weights for policy 0, policy_version 305475 (0.0008) [2023-12-27 21:25:29,981][106226] Updated weights for policy 0, policy_version 305485 (0.0009) [2023-12-27 21:25:30,031][106226] Updated weights for policy 0, policy_version 305495 (0.0009) [2023-12-27 21:25:30,108][106225] Updated weights for policy 1, policy_version 306071 (0.0007) [2023-12-27 21:25:30,170][106225] Updated weights for policy 1, policy_version 306081 (0.0005) [2023-12-27 21:25:30,226][106225] Updated weights for policy 1, policy_version 306091 (0.0007) [2023-12-27 21:25:30,813][106226] Updated weights for policy 0, policy_version 305505 (0.0010) [2023-12-27 21:25:30,847][106225] Updated weights for policy 1, policy_version 306101 (0.0009) [2023-12-27 21:25:30,863][106226] Updated weights for policy 0, policy_version 305515 (0.0010) [2023-12-27 21:25:30,896][106225] Updated weights for policy 1, policy_version 306111 (0.0009) [2023-12-27 21:25:30,919][106226] Updated weights for policy 0, policy_version 305525 (0.0008) [2023-12-27 21:25:30,953][106225] Updated weights for policy 1, policy_version 306121 (0.0007) [2023-12-27 21:25:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 156631040. Throughput: 0: 9676.6, 1: 9958.8. Samples: 156617076. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 21:25:31,176][105115] Avg episode reward: [(0, '-4.609'), (1, '-5.767')] [2023-12-27 21:25:31,646][106225] Updated weights for policy 1, policy_version 306131 (0.0008) [2023-12-27 21:25:31,671][106226] Updated weights for policy 0, policy_version 305535 (0.0008) [2023-12-27 21:25:31,710][106225] Updated weights for policy 1, policy_version 306141 (0.0007) [2023-12-27 21:25:31,737][106226] Updated weights for policy 0, policy_version 305545 (0.0007) [2023-12-27 21:25:31,772][106225] Updated weights for policy 1, policy_version 306151 (0.0007) [2023-12-27 21:25:31,797][106226] Updated weights for policy 0, policy_version 305555 (0.0009) [2023-12-27 21:25:32,449][106226] Updated weights for policy 0, policy_version 305565 (0.0008) [2023-12-27 21:25:32,505][106226] Updated weights for policy 0, policy_version 305575 (0.0007) [2023-12-27 21:25:32,542][106225] Updated weights for policy 1, policy_version 306161 (0.0008) [2023-12-27 21:25:32,561][106226] Updated weights for policy 0, policy_version 305585 (0.0006) [2023-12-27 21:25:32,606][106225] Updated weights for policy 1, policy_version 306171 (0.0008) [2023-12-27 21:25:32,666][106225] Updated weights for policy 1, policy_version 306181 (0.0009) [2023-12-27 21:25:32,716][106225] Updated weights for policy 1, policy_version 306191 (0.0008) [2023-12-27 21:25:33,220][106226] Updated weights for policy 0, policy_version 305595 (0.0005) [2023-12-27 21:25:33,279][106226] Updated weights for policy 0, policy_version 305605 (0.0005) [2023-12-27 21:25:33,325][106226] Updated weights for policy 0, policy_version 305615 (0.0005) [2023-12-27 21:25:33,397][106225] Updated weights for policy 1, policy_version 306201 (0.0007) [2023-12-27 21:25:33,459][106225] Updated weights for policy 1, policy_version 306211 (0.0007) [2023-12-27 21:25:33,508][106225] Updated weights for policy 1, policy_version 306221 (0.0010) [2023-12-27 21:25:33,994][106226] Updated weights for policy 0, policy_version 305625 (0.0007) [2023-12-27 21:25:34,058][106226] Updated weights for policy 0, policy_version 305635 (0.0008) [2023-12-27 21:25:34,075][106225] Updated weights for policy 1, policy_version 306231 (0.0009) [2023-12-27 21:25:34,115][106226] Updated weights for policy 0, policy_version 305645 (0.0005) [2023-12-27 21:25:34,131][106225] Updated weights for policy 1, policy_version 306241 (0.0010) [2023-12-27 21:25:34,179][106226] Updated weights for policy 0, policy_version 305655 (0.0007) [2023-12-27 21:25:34,196][106225] Updated weights for policy 1, policy_version 306251 (0.0009) [2023-12-27 21:25:34,900][106226] Updated weights for policy 0, policy_version 305665 (0.0005) [2023-12-27 21:25:34,908][106225] Updated weights for policy 1, policy_version 306261 (0.0008) [2023-12-27 21:25:34,962][106225] Updated weights for policy 1, policy_version 306271 (0.0010) [2023-12-27 21:25:34,966][106226] Updated weights for policy 0, policy_version 305675 (0.0005) [2023-12-27 21:25:35,016][106225] Updated weights for policy 1, policy_version 306281 (0.0009) [2023-12-27 21:25:35,024][106226] Updated weights for policy 0, policy_version 305685 (0.0005) [2023-12-27 21:25:35,512][106226] Updated weights for policy 0, policy_version 305695 (0.0005) [2023-12-27 21:25:35,577][106226] Updated weights for policy 0, policy_version 305705 (0.0005) [2023-12-27 21:25:35,638][106226] Updated weights for policy 0, policy_version 305715 (0.0005) [2023-12-27 21:25:35,741][106225] Updated weights for policy 1, policy_version 306291 (0.0009) [2023-12-27 21:25:35,793][106225] Updated weights for policy 1, policy_version 306301 (0.0009) [2023-12-27 21:25:35,854][106225] Updated weights for policy 1, policy_version 306311 (0.0007) [2023-12-27 21:25:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 156729344. Throughput: 0: 9750.8, 1: 10054.9. Samples: 156740336. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:25:36,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.590')] [2023-12-27 21:25:36,246][106226] Updated weights for policy 0, policy_version 305725 (0.0007) [2023-12-27 21:25:36,305][106226] Updated weights for policy 0, policy_version 305735 (0.0008) [2023-12-27 21:25:36,368][106226] Updated weights for policy 0, policy_version 305745 (0.0008) [2023-12-27 21:25:36,554][106225] Updated weights for policy 1, policy_version 306321 (0.0007) [2023-12-27 21:25:36,608][106225] Updated weights for policy 1, policy_version 306331 (0.0010) [2023-12-27 21:25:36,672][106225] Updated weights for policy 1, policy_version 306341 (0.0010) [2023-12-27 21:25:36,739][106225] Updated weights for policy 1, policy_version 306351 (0.0010) [2023-12-27 21:25:37,087][106226] Updated weights for policy 0, policy_version 305755 (0.0008) [2023-12-27 21:25:37,152][106226] Updated weights for policy 0, policy_version 305765 (0.0008) [2023-12-27 21:25:37,218][106226] Updated weights for policy 0, policy_version 305775 (0.0009) [2023-12-27 21:25:37,444][106225] Updated weights for policy 1, policy_version 306361 (0.0009) [2023-12-27 21:25:37,492][106225] Updated weights for policy 1, policy_version 306371 (0.0010) [2023-12-27 21:25:37,542][106225] Updated weights for policy 1, policy_version 306381 (0.0010) [2023-12-27 21:25:37,818][106226] Updated weights for policy 0, policy_version 305785 (0.0007) [2023-12-27 21:25:37,881][106226] Updated weights for policy 0, policy_version 305795 (0.0005) [2023-12-27 21:25:37,939][106226] Updated weights for policy 0, policy_version 305805 (0.0007) [2023-12-27 21:25:37,989][106226] Updated weights for policy 0, policy_version 305815 (0.0008) [2023-12-27 21:25:38,242][106225] Updated weights for policy 1, policy_version 306391 (0.0008) [2023-12-27 21:25:38,311][106225] Updated weights for policy 1, policy_version 306401 (0.0007) [2023-12-27 21:25:38,380][106225] Updated weights for policy 1, policy_version 306411 (0.0007) [2023-12-27 21:25:38,654][106226] Updated weights for policy 0, policy_version 305825 (0.0008) [2023-12-27 21:25:38,702][106226] Updated weights for policy 0, policy_version 305835 (0.0008) [2023-12-27 21:25:38,753][106226] Updated weights for policy 0, policy_version 305845 (0.0008) [2023-12-27 21:25:39,097][106225] Updated weights for policy 1, policy_version 306421 (0.0007) [2023-12-27 21:25:39,153][106225] Updated weights for policy 1, policy_version 306431 (0.0005) [2023-12-27 21:25:39,207][106225] Updated weights for policy 1, policy_version 306441 (0.0005) [2023-12-27 21:25:39,553][106226] Updated weights for policy 0, policy_version 305855 (0.0008) [2023-12-27 21:25:39,627][106226] Updated weights for policy 0, policy_version 305865 (0.0009) [2023-12-27 21:25:39,687][106226] Updated weights for policy 0, policy_version 305875 (0.0009) [2023-12-27 21:25:39,917][106225] Updated weights for policy 1, policy_version 306451 (0.0008) [2023-12-27 21:25:39,983][106225] Updated weights for policy 1, policy_version 306461 (0.0007) [2023-12-27 21:25:40,048][106225] Updated weights for policy 1, policy_version 306471 (0.0008) [2023-12-27 21:25:40,406][106226] Updated weights for policy 0, policy_version 305885 (0.0009) [2023-12-27 21:25:40,472][106226] Updated weights for policy 0, policy_version 305895 (0.0008) [2023-12-27 21:25:40,531][106226] Updated weights for policy 0, policy_version 305905 (0.0009) [2023-12-27 21:25:40,822][106225] Updated weights for policy 1, policy_version 306481 (0.0008) [2023-12-27 21:25:40,886][106225] Updated weights for policy 1, policy_version 306491 (0.0009) [2023-12-27 21:25:40,951][106225] Updated weights for policy 1, policy_version 306501 (0.0008) [2023-12-27 21:25:41,012][106225] Updated weights for policy 1, policy_version 306511 (0.0009) [2023-12-27 21:25:41,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 156827648. Throughput: 0: 9797.9, 1: 10051.1. Samples: 156799788. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:25:41,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.967')] [2023-12-27 21:25:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000305912_78340096.pth... [2023-12-27 21:25:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000306512_78487552.pth... [2023-12-27 21:25:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000305328_78184448.pth [2023-12-27 21:25:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000304792_78053376.pth [2023-12-27 21:25:41,252][106226] Updated weights for policy 0, policy_version 305915 (0.0009) [2023-12-27 21:25:41,317][106226] Updated weights for policy 0, policy_version 305925 (0.0008) [2023-12-27 21:25:41,387][106226] Updated weights for policy 0, policy_version 305935 (0.0008) [2023-12-27 21:25:41,755][106225] Updated weights for policy 1, policy_version 306521 (0.0009) [2023-12-27 21:25:41,824][106225] Updated weights for policy 1, policy_version 306531 (0.0008) [2023-12-27 21:25:41,896][106225] Updated weights for policy 1, policy_version 306541 (0.0008) [2023-12-27 21:25:42,209][106226] Updated weights for policy 0, policy_version 305945 (0.0010) [2023-12-27 21:25:42,264][106226] Updated weights for policy 0, policy_version 305955 (0.0011) [2023-12-27 21:25:42,330][106226] Updated weights for policy 0, policy_version 305965 (0.0011) [2023-12-27 21:25:42,395][106226] Updated weights for policy 0, policy_version 305975 (0.0011) [2023-12-27 21:25:42,597][106225] Updated weights for policy 1, policy_version 306551 (0.0008) [2023-12-27 21:25:42,660][106225] Updated weights for policy 1, policy_version 306561 (0.0007) [2023-12-27 21:25:42,722][106225] Updated weights for policy 1, policy_version 306571 (0.0008) [2023-12-27 21:25:43,110][106226] Updated weights for policy 0, policy_version 305985 (0.0011) [2023-12-27 21:25:43,170][106226] Updated weights for policy 0, policy_version 305995 (0.0010) [2023-12-27 21:25:43,219][106226] Updated weights for policy 0, policy_version 306005 (0.0010) [2023-12-27 21:25:43,451][106225] Updated weights for policy 1, policy_version 306581 (0.0008) [2023-12-27 21:25:43,505][106225] Updated weights for policy 1, policy_version 306591 (0.0008) [2023-12-27 21:25:43,562][106225] Updated weights for policy 1, policy_version 306601 (0.0007) [2023-12-27 21:25:43,929][106226] Updated weights for policy 0, policy_version 306015 (0.0011) [2023-12-27 21:25:43,985][106226] Updated weights for policy 0, policy_version 306025 (0.0010) [2023-12-27 21:25:44,031][106226] Updated weights for policy 0, policy_version 306035 (0.0010) [2023-12-27 21:25:44,157][106225] Updated weights for policy 1, policy_version 306611 (0.0007) [2023-12-27 21:25:44,221][106225] Updated weights for policy 1, policy_version 306621 (0.0010) [2023-12-27 21:25:44,274][106225] Updated weights for policy 1, policy_version 306631 (0.0010) [2023-12-27 21:25:44,728][106226] Updated weights for policy 0, policy_version 306045 (0.0010) [2023-12-27 21:25:44,793][106226] Updated weights for policy 0, policy_version 306055 (0.0008) [2023-12-27 21:25:44,848][106226] Updated weights for policy 0, policy_version 306065 (0.0008) [2023-12-27 21:25:44,952][106225] Updated weights for policy 1, policy_version 306641 (0.0010) [2023-12-27 21:25:45,009][106225] Updated weights for policy 1, policy_version 306651 (0.0011) [2023-12-27 21:25:45,077][106225] Updated weights for policy 1, policy_version 306661 (0.0011) [2023-12-27 21:25:45,142][106225] Updated weights for policy 1, policy_version 306671 (0.0011) [2023-12-27 21:25:45,581][106226] Updated weights for policy 0, policy_version 306075 (0.0008) [2023-12-27 21:25:45,627][106226] Updated weights for policy 0, policy_version 306085 (0.0005) [2023-12-27 21:25:45,672][106226] Updated weights for policy 0, policy_version 306095 (0.0005) [2023-12-27 21:25:45,860][106225] Updated weights for policy 1, policy_version 306681 (0.0010) [2023-12-27 21:25:45,917][106225] Updated weights for policy 1, policy_version 306691 (0.0010) [2023-12-27 21:25:45,973][106225] Updated weights for policy 1, policy_version 306701 (0.0010) [2023-12-27 21:25:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 156925952. Throughput: 0: 9719.7, 1: 9951.0. Samples: 156914656. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:25:46,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.607')] [2023-12-27 21:25:46,296][106226] Updated weights for policy 0, policy_version 306105 (0.0006) [2023-12-27 21:25:46,356][106226] Updated weights for policy 0, policy_version 306115 (0.0010) [2023-12-27 21:25:46,409][106226] Updated weights for policy 0, policy_version 306125 (0.0010) [2023-12-27 21:25:46,459][106226] Updated weights for policy 0, policy_version 306135 (0.0011) [2023-12-27 21:25:46,675][106225] Updated weights for policy 1, policy_version 306711 (0.0009) [2023-12-27 21:25:46,740][106225] Updated weights for policy 1, policy_version 306721 (0.0008) [2023-12-27 21:25:46,802][106225] Updated weights for policy 1, policy_version 306731 (0.0008) [2023-12-27 21:25:47,200][106226] Updated weights for policy 0, policy_version 306145 (0.0011) [2023-12-27 21:25:47,255][106226] Updated weights for policy 0, policy_version 306155 (0.0011) [2023-12-27 21:25:47,314][106226] Updated weights for policy 0, policy_version 306165 (0.0011) [2023-12-27 21:25:47,428][106225] Updated weights for policy 1, policy_version 306741 (0.0005) [2023-12-27 21:25:47,486][106225] Updated weights for policy 1, policy_version 306751 (0.0005) [2023-12-27 21:25:47,540][106225] Updated weights for policy 1, policy_version 306761 (0.0005) [2023-12-27 21:25:48,011][106226] Updated weights for policy 0, policy_version 306175 (0.0011) [2023-12-27 21:25:48,078][106226] Updated weights for policy 0, policy_version 306185 (0.0010) [2023-12-27 21:25:48,132][106226] Updated weights for policy 0, policy_version 306195 (0.0010) [2023-12-27 21:25:48,178][106225] Updated weights for policy 1, policy_version 306771 (0.0006) [2023-12-27 21:25:48,234][106225] Updated weights for policy 1, policy_version 306781 (0.0008) [2023-12-27 21:25:48,293][106225] Updated weights for policy 1, policy_version 306791 (0.0009) [2023-12-27 21:25:48,837][106226] Updated weights for policy 0, policy_version 306205 (0.0011) [2023-12-27 21:25:48,900][106226] Updated weights for policy 0, policy_version 306215 (0.0011) [2023-12-27 21:25:48,965][106226] Updated weights for policy 0, policy_version 306225 (0.0011) [2023-12-27 21:25:49,070][106225] Updated weights for policy 1, policy_version 306801 (0.0008) [2023-12-27 21:25:49,121][106225] Updated weights for policy 1, policy_version 306811 (0.0009) [2023-12-27 21:25:49,174][106225] Updated weights for policy 1, policy_version 306821 (0.0006) [2023-12-27 21:25:49,247][106225] Updated weights for policy 1, policy_version 306831 (0.0008) [2023-12-27 21:25:49,643][106226] Updated weights for policy 0, policy_version 306235 (0.0006) [2023-12-27 21:25:49,709][106226] Updated weights for policy 0, policy_version 306245 (0.0011) [2023-12-27 21:25:49,785][106226] Updated weights for policy 0, policy_version 306255 (0.0011) [2023-12-27 21:25:49,974][106225] Updated weights for policy 1, policy_version 306841 (0.0008) [2023-12-27 21:25:50,032][106225] Updated weights for policy 1, policy_version 306851 (0.0008) [2023-12-27 21:25:50,094][106225] Updated weights for policy 1, policy_version 306861 (0.0008) [2023-12-27 21:25:50,454][106226] Updated weights for policy 0, policy_version 306265 (0.0011) [2023-12-27 21:25:50,525][106226] Updated weights for policy 0, policy_version 306275 (0.0007) [2023-12-27 21:25:50,599][106226] Updated weights for policy 0, policy_version 306285 (0.0008) [2023-12-27 21:25:50,651][106226] Updated weights for policy 0, policy_version 306295 (0.0008) [2023-12-27 21:25:50,878][106225] Updated weights for policy 1, policy_version 306871 (0.0009) [2023-12-27 21:25:50,939][106225] Updated weights for policy 1, policy_version 306881 (0.0009) [2023-12-27 21:25:50,991][106225] Updated weights for policy 1, policy_version 306891 (0.0008) [2023-12-27 21:25:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 157024256. Throughput: 0: 9767.7, 1: 9963.0. Samples: 157033572. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:25:51,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.423')] [2023-12-27 21:25:51,336][106226] Updated weights for policy 0, policy_version 306305 (0.0008) [2023-12-27 21:25:51,403][106226] Updated weights for policy 0, policy_version 306315 (0.0007) [2023-12-27 21:25:51,468][106226] Updated weights for policy 0, policy_version 306325 (0.0006) [2023-12-27 21:25:51,836][106225] Updated weights for policy 1, policy_version 306901 (0.0009) [2023-12-27 21:25:51,886][106225] Updated weights for policy 1, policy_version 306911 (0.0008) [2023-12-27 21:25:51,943][106225] Updated weights for policy 1, policy_version 306921 (0.0009) [2023-12-27 21:25:52,116][106226] Updated weights for policy 0, policy_version 306335 (0.0007) [2023-12-27 21:25:52,175][106226] Updated weights for policy 0, policy_version 306345 (0.0007) [2023-12-27 21:25:52,231][106226] Updated weights for policy 0, policy_version 306355 (0.0009) [2023-12-27 21:25:52,756][106225] Updated weights for policy 1, policy_version 306931 (0.0007) [2023-12-27 21:25:52,819][106225] Updated weights for policy 1, policy_version 306941 (0.0009) [2023-12-27 21:25:52,868][106225] Updated weights for policy 1, policy_version 306951 (0.0008) [2023-12-27 21:25:52,926][106226] Updated weights for policy 0, policy_version 306365 (0.0008) [2023-12-27 21:25:52,975][106226] Updated weights for policy 0, policy_version 306375 (0.0008) [2023-12-27 21:25:53,025][106226] Updated weights for policy 0, policy_version 306385 (0.0008) [2023-12-27 21:25:53,520][106225] Updated weights for policy 1, policy_version 306961 (0.0007) [2023-12-27 21:25:53,577][106225] Updated weights for policy 1, policy_version 306971 (0.0006) [2023-12-27 21:25:53,627][106225] Updated weights for policy 1, policy_version 306981 (0.0007) [2023-12-27 21:25:53,690][106225] Updated weights for policy 1, policy_version 306991 (0.0006) [2023-12-27 21:25:53,757][106226] Updated weights for policy 0, policy_version 306395 (0.0010) [2023-12-27 21:25:53,821][106226] Updated weights for policy 0, policy_version 306405 (0.0011) [2023-12-27 21:25:53,879][106226] Updated weights for policy 0, policy_version 306415 (0.0010) [2023-12-27 21:25:54,263][106225] Updated weights for policy 1, policy_version 307001 (0.0007) [2023-12-27 21:25:54,325][106225] Updated weights for policy 1, policy_version 307011 (0.0006) [2023-12-27 21:25:54,375][106225] Updated weights for policy 1, policy_version 307021 (0.0008) [2023-12-27 21:25:54,584][106226] Updated weights for policy 0, policy_version 306425 (0.0011) [2023-12-27 21:25:54,633][106226] Updated weights for policy 0, policy_version 306435 (0.0010) [2023-12-27 21:25:54,681][106226] Updated weights for policy 0, policy_version 306445 (0.0010) [2023-12-27 21:25:54,730][106226] Updated weights for policy 0, policy_version 306455 (0.0010) [2023-12-27 21:25:55,056][106225] Updated weights for policy 1, policy_version 307031 (0.0006) [2023-12-27 21:25:55,122][106225] Updated weights for policy 1, policy_version 307041 (0.0008) [2023-12-27 21:25:55,185][106225] Updated weights for policy 1, policy_version 307051 (0.0009) [2023-12-27 21:25:55,445][106226] Updated weights for policy 0, policy_version 306465 (0.0006) [2023-12-27 21:25:55,499][106226] Updated weights for policy 0, policy_version 306475 (0.0005) [2023-12-27 21:25:55,558][106226] Updated weights for policy 0, policy_version 306485 (0.0005) [2023-12-27 21:25:55,885][106225] Updated weights for policy 1, policy_version 307061 (0.0010) [2023-12-27 21:25:55,945][106225] Updated weights for policy 1, policy_version 307071 (0.0010) [2023-12-27 21:25:55,994][106225] Updated weights for policy 1, policy_version 307081 (0.0010) [2023-12-27 21:25:56,137][106226] Updated weights for policy 0, policy_version 306495 (0.0005) [2023-12-27 21:25:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 157122560. Throughput: 0: 9785.5, 1: 9907.2. Samples: 157090912. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:25:56,176][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.738')] [2023-12-27 21:25:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000307088_78635008.pth... [2023-12-27 21:25:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000305904_78331904.pth [2023-12-27 21:25:56,196][106226] Updated weights for policy 0, policy_version 306505 (0.0006) [2023-12-27 21:25:56,250][106226] Updated weights for policy 0, policy_version 306515 (0.0007) [2023-12-27 21:25:56,273][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000306520_78495744.pth... [2023-12-27 21:25:56,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000305336_78192640.pth [2023-12-27 21:25:56,677][106225] Updated weights for policy 1, policy_version 307091 (0.0010) [2023-12-27 21:25:56,728][106225] Updated weights for policy 1, policy_version 307101 (0.0010) [2023-12-27 21:25:56,783][106225] Updated weights for policy 1, policy_version 307111 (0.0007) [2023-12-27 21:25:56,800][106226] Updated weights for policy 0, policy_version 306525 (0.0006) [2023-12-27 21:25:56,851][106226] Updated weights for policy 0, policy_version 306535 (0.0008) [2023-12-27 21:25:56,897][106226] Updated weights for policy 0, policy_version 306545 (0.0006) [2023-12-27 21:25:57,449][106225] Updated weights for policy 1, policy_version 307121 (0.0009) [2023-12-27 21:25:57,483][106226] Updated weights for policy 0, policy_version 306555 (0.0006) [2023-12-27 21:25:57,503][106225] Updated weights for policy 1, policy_version 307131 (0.0010) [2023-12-27 21:25:57,532][106226] Updated weights for policy 0, policy_version 306565 (0.0005) [2023-12-27 21:25:57,552][106225] Updated weights for policy 1, policy_version 307141 (0.0010) [2023-12-27 21:25:57,581][106226] Updated weights for policy 0, policy_version 306575 (0.0005) [2023-12-27 21:25:57,602][106225] Updated weights for policy 1, policy_version 307151 (0.0010) [2023-12-27 21:25:58,245][106226] Updated weights for policy 0, policy_version 306585 (0.0007) [2023-12-27 21:25:58,306][106226] Updated weights for policy 0, policy_version 306595 (0.0008) [2023-12-27 21:25:58,331][106225] Updated weights for policy 1, policy_version 307161 (0.0010) [2023-12-27 21:25:58,381][106226] Updated weights for policy 0, policy_version 306605 (0.0008) [2023-12-27 21:25:58,399][106225] Updated weights for policy 1, policy_version 307171 (0.0008) [2023-12-27 21:25:58,449][106226] Updated weights for policy 0, policy_version 306615 (0.0008) [2023-12-27 21:25:58,462][106225] Updated weights for policy 1, policy_version 307181 (0.0009) [2023-12-27 21:25:59,218][106225] Updated weights for policy 1, policy_version 307191 (0.0009) [2023-12-27 21:25:59,287][106226] Updated weights for policy 0, policy_version 306625 (0.0009) [2023-12-27 21:25:59,298][106225] Updated weights for policy 1, policy_version 307201 (0.0009) [2023-12-27 21:25:59,347][106226] Updated weights for policy 0, policy_version 306635 (0.0009) [2023-12-27 21:25:59,361][106225] Updated weights for policy 1, policy_version 307211 (0.0008) [2023-12-27 21:25:59,413][106226] Updated weights for policy 0, policy_version 306645 (0.0011) [2023-12-27 21:26:00,094][106225] Updated weights for policy 1, policy_version 307221 (0.0008) [2023-12-27 21:26:00,145][106225] Updated weights for policy 1, policy_version 307231 (0.0008) [2023-12-27 21:26:00,147][106226] Updated weights for policy 0, policy_version 306655 (0.0007) [2023-12-27 21:26:00,197][106226] Updated weights for policy 0, policy_version 306665 (0.0007) [2023-12-27 21:26:00,202][106225] Updated weights for policy 1, policy_version 307241 (0.0006) [2023-12-27 21:26:00,257][106226] Updated weights for policy 0, policy_version 306675 (0.0006) [2023-12-27 21:26:00,878][106225] Updated weights for policy 1, policy_version 307251 (0.0008) [2023-12-27 21:26:00,940][106225] Updated weights for policy 1, policy_version 307261 (0.0008) [2023-12-27 21:26:00,964][106226] Updated weights for policy 0, policy_version 306685 (0.0006) [2023-12-27 21:26:00,997][106225] Updated weights for policy 1, policy_version 307271 (0.0007) [2023-12-27 21:26:01,022][106226] Updated weights for policy 0, policy_version 306695 (0.0008) [2023-12-27 21:26:01,084][106226] Updated weights for policy 0, policy_version 306705 (0.0008) [2023-12-27 21:26:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 157229056. Throughput: 0: 9889.4, 1: 9899.5. Samples: 157212696. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:01,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.661')] [2023-12-27 21:26:01,629][106225] Updated weights for policy 1, policy_version 307281 (0.0008) [2023-12-27 21:26:01,690][106225] Updated weights for policy 1, policy_version 307291 (0.0008) [2023-12-27 21:26:01,751][106225] Updated weights for policy 1, policy_version 307301 (0.0008) [2023-12-27 21:26:01,816][106225] Updated weights for policy 1, policy_version 307311 (0.0008) [2023-12-27 21:26:01,820][106226] Updated weights for policy 0, policy_version 306715 (0.0009) [2023-12-27 21:26:01,879][106226] Updated weights for policy 0, policy_version 306725 (0.0008) [2023-12-27 21:26:01,936][106226] Updated weights for policy 0, policy_version 306735 (0.0008) [2023-12-27 21:26:02,546][106225] Updated weights for policy 1, policy_version 307321 (0.0006) [2023-12-27 21:26:02,602][106225] Updated weights for policy 1, policy_version 307331 (0.0005) [2023-12-27 21:26:02,650][106225] Updated weights for policy 1, policy_version 307341 (0.0008) [2023-12-27 21:26:02,717][106226] Updated weights for policy 0, policy_version 306745 (0.0008) [2023-12-27 21:26:02,776][106226] Updated weights for policy 0, policy_version 306755 (0.0008) [2023-12-27 21:26:02,837][106226] Updated weights for policy 0, policy_version 306765 (0.0007) [2023-12-27 21:26:02,901][106226] Updated weights for policy 0, policy_version 306775 (0.0006) [2023-12-27 21:26:03,322][106225] Updated weights for policy 1, policy_version 307351 (0.0006) [2023-12-27 21:26:03,377][106225] Updated weights for policy 1, policy_version 307361 (0.0008) [2023-12-27 21:26:03,435][106225] Updated weights for policy 1, policy_version 307371 (0.0009) [2023-12-27 21:26:03,548][106226] Updated weights for policy 0, policy_version 306785 (0.0007) [2023-12-27 21:26:03,596][106226] Updated weights for policy 0, policy_version 306795 (0.0008) [2023-12-27 21:26:03,643][106226] Updated weights for policy 0, policy_version 306805 (0.0008) [2023-12-27 21:26:04,147][106225] Updated weights for policy 1, policy_version 307381 (0.0008) [2023-12-27 21:26:04,212][106225] Updated weights for policy 1, policy_version 307391 (0.0006) [2023-12-27 21:26:04,276][106225] Updated weights for policy 1, policy_version 307401 (0.0008) [2023-12-27 21:26:04,452][106226] Updated weights for policy 0, policy_version 306815 (0.0008) [2023-12-27 21:26:04,509][106226] Updated weights for policy 0, policy_version 306825 (0.0009) [2023-12-27 21:26:04,563][106226] Updated weights for policy 0, policy_version 306835 (0.0008) [2023-12-27 21:26:04,946][106225] Updated weights for policy 1, policy_version 307411 (0.0008) [2023-12-27 21:26:05,012][106225] Updated weights for policy 1, policy_version 307421 (0.0005) [2023-12-27 21:26:05,061][106225] Updated weights for policy 1, policy_version 307431 (0.0005) [2023-12-27 21:26:05,311][106226] Updated weights for policy 0, policy_version 306845 (0.0008) [2023-12-27 21:26:05,372][106226] Updated weights for policy 0, policy_version 306855 (0.0008) [2023-12-27 21:26:05,430][106226] Updated weights for policy 0, policy_version 306865 (0.0005) [2023-12-27 21:26:05,687][106225] Updated weights for policy 1, policy_version 307441 (0.0008) [2023-12-27 21:26:05,747][106225] Updated weights for policy 1, policy_version 307451 (0.0010) [2023-12-27 21:26:05,810][106225] Updated weights for policy 1, policy_version 307461 (0.0010) [2023-12-27 21:26:05,874][106225] Updated weights for policy 1, policy_version 307471 (0.0010) [2023-12-27 21:26:06,028][106226] Updated weights for policy 0, policy_version 306875 (0.0006) [2023-12-27 21:26:06,086][106226] Updated weights for policy 0, policy_version 306885 (0.0007) [2023-12-27 21:26:06,151][106226] Updated weights for policy 0, policy_version 306895 (0.0009) [2023-12-27 21:26:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 157319168. Throughput: 0: 9883.1, 1: 9952.7. Samples: 157332068. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:06,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-5.508')] [2023-12-27 21:26:06,574][106225] Updated weights for policy 1, policy_version 307481 (0.0010) [2023-12-27 21:26:06,635][106225] Updated weights for policy 1, policy_version 307491 (0.0010) [2023-12-27 21:26:06,694][106225] Updated weights for policy 1, policy_version 307501 (0.0005) [2023-12-27 21:26:06,904][106226] Updated weights for policy 0, policy_version 306905 (0.0010) [2023-12-27 21:26:06,966][106226] Updated weights for policy 0, policy_version 306915 (0.0011) [2023-12-27 21:26:07,024][106226] Updated weights for policy 0, policy_version 306925 (0.0010) [2023-12-27 21:26:07,075][106226] Updated weights for policy 0, policy_version 306935 (0.0011) [2023-12-27 21:26:07,272][106225] Updated weights for policy 1, policy_version 307511 (0.0009) [2023-12-27 21:26:07,331][106225] Updated weights for policy 1, policy_version 307521 (0.0011) [2023-12-27 21:26:07,382][106225] Updated weights for policy 1, policy_version 307531 (0.0010) [2023-12-27 21:26:07,832][106226] Updated weights for policy 0, policy_version 306945 (0.0008) [2023-12-27 21:26:07,879][106226] Updated weights for policy 0, policy_version 306955 (0.0007) [2023-12-27 21:26:07,947][106226] Updated weights for policy 0, policy_version 306965 (0.0005) [2023-12-27 21:26:08,024][106225] Updated weights for policy 1, policy_version 307541 (0.0008) [2023-12-27 21:26:08,094][106225] Updated weights for policy 1, policy_version 307551 (0.0005) [2023-12-27 21:26:08,151][106225] Updated weights for policy 1, policy_version 307561 (0.0005) [2023-12-27 21:26:08,610][106226] Updated weights for policy 0, policy_version 306975 (0.0006) [2023-12-27 21:26:08,675][106226] Updated weights for policy 0, policy_version 306985 (0.0007) [2023-12-27 21:26:08,733][106226] Updated weights for policy 0, policy_version 306995 (0.0005) [2023-12-27 21:26:08,796][106225] Updated weights for policy 1, policy_version 307571 (0.0008) [2023-12-27 21:26:08,864][106225] Updated weights for policy 1, policy_version 307581 (0.0010) [2023-12-27 21:26:08,925][106225] Updated weights for policy 1, policy_version 307591 (0.0010) [2023-12-27 21:26:09,436][106226] Updated weights for policy 0, policy_version 307005 (0.0007) [2023-12-27 21:26:09,493][106226] Updated weights for policy 0, policy_version 307015 (0.0009) [2023-12-27 21:26:09,544][106226] Updated weights for policy 0, policy_version 307025 (0.0008) [2023-12-27 21:26:09,699][106225] Updated weights for policy 1, policy_version 307601 (0.0010) [2023-12-27 21:26:09,753][106225] Updated weights for policy 1, policy_version 307611 (0.0010) [2023-12-27 21:26:09,812][106225] Updated weights for policy 1, policy_version 307621 (0.0011) [2023-12-27 21:26:09,879][106225] Updated weights for policy 1, policy_version 307631 (0.0010) [2023-12-27 21:26:10,328][106226] Updated weights for policy 0, policy_version 307035 (0.0009) [2023-12-27 21:26:10,388][106226] Updated weights for policy 0, policy_version 307045 (0.0009) [2023-12-27 21:26:10,443][106226] Updated weights for policy 0, policy_version 307055 (0.0009) [2023-12-27 21:26:10,619][106225] Updated weights for policy 1, policy_version 307641 (0.0010) [2023-12-27 21:26:10,681][106225] Updated weights for policy 1, policy_version 307651 (0.0009) [2023-12-27 21:26:10,738][106225] Updated weights for policy 1, policy_version 307661 (0.0009) [2023-12-27 21:26:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 157417472. Throughput: 0: 9904.4, 1: 10038.5. Samples: 157393016. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:11,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-5.593')] [2023-12-27 21:26:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000307664_78782464.pth... [2023-12-27 21:26:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000307064_78635008.pth... [2023-12-27 21:26:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000305912_78340096.pth [2023-12-27 21:26:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000306512_78487552.pth [2023-12-27 21:26:11,209][106226] Updated weights for policy 0, policy_version 307065 (0.0008) [2023-12-27 21:26:11,275][106226] Updated weights for policy 0, policy_version 307075 (0.0007) [2023-12-27 21:26:11,342][106226] Updated weights for policy 0, policy_version 307085 (0.0007) [2023-12-27 21:26:11,413][106226] Updated weights for policy 0, policy_version 307095 (0.0009) [2023-12-27 21:26:11,474][106225] Updated weights for policy 1, policy_version 307671 (0.0010) [2023-12-27 21:26:11,539][106225] Updated weights for policy 1, policy_version 307681 (0.0011) [2023-12-27 21:26:11,594][106225] Updated weights for policy 1, policy_version 307691 (0.0007) [2023-12-27 21:26:12,145][106226] Updated weights for policy 0, policy_version 307105 (0.0007) [2023-12-27 21:26:12,207][106226] Updated weights for policy 0, policy_version 307115 (0.0008) [2023-12-27 21:26:12,273][106226] Updated weights for policy 0, policy_version 307125 (0.0008) [2023-12-27 21:26:12,351][106225] Updated weights for policy 1, policy_version 307701 (0.0007) [2023-12-27 21:26:12,417][106225] Updated weights for policy 1, policy_version 307711 (0.0010) [2023-12-27 21:26:12,473][106225] Updated weights for policy 1, policy_version 307721 (0.0007) [2023-12-27 21:26:13,043][106226] Updated weights for policy 0, policy_version 307135 (0.0008) [2023-12-27 21:26:13,103][106226] Updated weights for policy 0, policy_version 307145 (0.0010) [2023-12-27 21:26:13,161][106226] Updated weights for policy 0, policy_version 307155 (0.0008) [2023-12-27 21:26:13,187][106225] Updated weights for policy 1, policy_version 307731 (0.0009) [2023-12-27 21:26:13,240][106225] Updated weights for policy 1, policy_version 307741 (0.0005) [2023-12-27 21:26:13,290][106225] Updated weights for policy 1, policy_version 307751 (0.0005) [2023-12-27 21:26:13,845][106226] Updated weights for policy 0, policy_version 307165 (0.0006) [2023-12-27 21:26:13,910][106225] Updated weights for policy 1, policy_version 307761 (0.0006) [2023-12-27 21:26:13,912][106226] Updated weights for policy 0, policy_version 307175 (0.0006) [2023-12-27 21:26:13,971][106226] Updated weights for policy 0, policy_version 307185 (0.0008) [2023-12-27 21:26:13,972][106225] Updated weights for policy 1, policy_version 307771 (0.0010) [2023-12-27 21:26:14,024][106225] Updated weights for policy 1, policy_version 307781 (0.0010) [2023-12-27 21:26:14,070][106225] Updated weights for policy 1, policy_version 307791 (0.0010) [2023-12-27 21:26:14,646][106226] Updated weights for policy 0, policy_version 307195 (0.0009) [2023-12-27 21:26:14,672][106225] Updated weights for policy 1, policy_version 307801 (0.0007) [2023-12-27 21:26:14,699][106226] Updated weights for policy 0, policy_version 307205 (0.0007) [2023-12-27 21:26:14,718][106225] Updated weights for policy 1, policy_version 307811 (0.0005) [2023-12-27 21:26:14,752][106226] Updated weights for policy 0, policy_version 307215 (0.0008) [2023-12-27 21:26:14,775][106225] Updated weights for policy 1, policy_version 307821 (0.0006) [2023-12-27 21:26:15,340][106225] Updated weights for policy 1, policy_version 307831 (0.0008) [2023-12-27 21:26:15,406][106225] Updated weights for policy 1, policy_version 307841 (0.0010) [2023-12-27 21:26:15,463][106225] Updated weights for policy 1, policy_version 307851 (0.0010) [2023-12-27 21:26:15,607][106226] Updated weights for policy 0, policy_version 307225 (0.0008) [2023-12-27 21:26:15,675][106226] Updated weights for policy 0, policy_version 307235 (0.0009) [2023-12-27 21:26:15,735][106226] Updated weights for policy 0, policy_version 307245 (0.0008) [2023-12-27 21:26:15,780][106226] Updated weights for policy 0, policy_version 307255 (0.0007) [2023-12-27 21:26:16,126][106225] Updated weights for policy 1, policy_version 307861 (0.0010) [2023-12-27 21:26:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 157515776. Throughput: 0: 9866.2, 1: 9932.0. Samples: 157507992. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:16,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-5.468')] [2023-12-27 21:26:16,184][106225] Updated weights for policy 1, policy_version 307871 (0.0007) [2023-12-27 21:26:16,240][106225] Updated weights for policy 1, policy_version 307881 (0.0005) [2023-12-27 21:26:16,538][106226] Updated weights for policy 0, policy_version 307265 (0.0008) [2023-12-27 21:26:16,598][106226] Updated weights for policy 0, policy_version 307275 (0.0006) [2023-12-27 21:26:16,659][106226] Updated weights for policy 0, policy_version 307285 (0.0008) [2023-12-27 21:26:16,937][106225] Updated weights for policy 1, policy_version 307891 (0.0007) [2023-12-27 21:26:16,988][106225] Updated weights for policy 1, policy_version 307901 (0.0010) [2023-12-27 21:26:17,045][106225] Updated weights for policy 1, policy_version 307911 (0.0010) [2023-12-27 21:26:17,381][106226] Updated weights for policy 0, policy_version 307295 (0.0010) [2023-12-27 21:26:17,443][106226] Updated weights for policy 0, policy_version 307305 (0.0010) [2023-12-27 21:26:17,497][106226] Updated weights for policy 0, policy_version 307315 (0.0009) [2023-12-27 21:26:17,770][106225] Updated weights for policy 1, policy_version 307921 (0.0010) [2023-12-27 21:26:17,820][106225] Updated weights for policy 1, policy_version 307931 (0.0010) [2023-12-27 21:26:17,877][106225] Updated weights for policy 1, policy_version 307941 (0.0007) [2023-12-27 21:26:17,930][106225] Updated weights for policy 1, policy_version 307951 (0.0010) [2023-12-27 21:26:18,127][106226] Updated weights for policy 0, policy_version 307325 (0.0007) [2023-12-27 21:26:18,183][106226] Updated weights for policy 0, policy_version 307335 (0.0005) [2023-12-27 21:26:18,246][106226] Updated weights for policy 0, policy_version 307345 (0.0007) [2023-12-27 21:26:18,597][106225] Updated weights for policy 1, policy_version 307961 (0.0010) [2023-12-27 21:26:18,661][106225] Updated weights for policy 1, policy_version 307971 (0.0011) [2023-12-27 21:26:18,727][106225] Updated weights for policy 1, policy_version 307981 (0.0011) [2023-12-27 21:26:19,002][106226] Updated weights for policy 0, policy_version 307355 (0.0009) [2023-12-27 21:26:19,074][106226] Updated weights for policy 0, policy_version 307365 (0.0009) [2023-12-27 21:26:19,124][106226] Updated weights for policy 0, policy_version 307375 (0.0009) [2023-12-27 21:26:19,344][106225] Updated weights for policy 1, policy_version 307991 (0.0008) [2023-12-27 21:26:19,408][106225] Updated weights for policy 1, policy_version 308001 (0.0006) [2023-12-27 21:26:19,465][106225] Updated weights for policy 1, policy_version 308011 (0.0006) [2023-12-27 21:26:19,931][106226] Updated weights for policy 0, policy_version 307385 (0.0010) [2023-12-27 21:26:19,999][106226] Updated weights for policy 0, policy_version 307395 (0.0008) [2023-12-27 21:26:20,064][106226] Updated weights for policy 0, policy_version 307405 (0.0008) [2023-12-27 21:26:20,124][106226] Updated weights for policy 0, policy_version 307415 (0.0008) [2023-12-27 21:26:20,195][106225] Updated weights for policy 1, policy_version 308021 (0.0008) [2023-12-27 21:26:20,258][106225] Updated weights for policy 1, policy_version 308031 (0.0005) [2023-12-27 21:26:20,323][106225] Updated weights for policy 1, policy_version 308041 (0.0010) [2023-12-27 21:26:20,934][106226] Updated weights for policy 0, policy_version 307425 (0.0008) [2023-12-27 21:26:20,984][106225] Updated weights for policy 1, policy_version 308051 (0.0011) [2023-12-27 21:26:20,995][106226] Updated weights for policy 0, policy_version 307435 (0.0007) [2023-12-27 21:26:21,049][106225] Updated weights for policy 1, policy_version 308061 (0.0011) [2023-12-27 21:26:21,065][106226] Updated weights for policy 0, policy_version 307445 (0.0008) [2023-12-27 21:26:21,119][106225] Updated weights for policy 1, policy_version 308071 (0.0011) [2023-12-27 21:26:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 157614080. Throughput: 0: 9730.4, 1: 9932.3. Samples: 157625156. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:21,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-5.453')] [2023-12-27 21:26:21,827][106225] Updated weights for policy 1, policy_version 308081 (0.0011) [2023-12-27 21:26:21,827][106226] Updated weights for policy 0, policy_version 307455 (0.0007) [2023-12-27 21:26:21,886][106226] Updated weights for policy 0, policy_version 307465 (0.0006) [2023-12-27 21:26:21,891][106225] Updated weights for policy 1, policy_version 308091 (0.0009) [2023-12-27 21:26:21,936][106226] Updated weights for policy 0, policy_version 307475 (0.0008) [2023-12-27 21:26:21,946][106225] Updated weights for policy 1, policy_version 308101 (0.0010) [2023-12-27 21:26:22,011][106225] Updated weights for policy 1, policy_version 308111 (0.0011) [2023-12-27 21:26:22,722][106225] Updated weights for policy 1, policy_version 308121 (0.0007) [2023-12-27 21:26:22,730][106226] Updated weights for policy 0, policy_version 307485 (0.0007) [2023-12-27 21:26:22,787][106225] Updated weights for policy 1, policy_version 308131 (0.0006) [2023-12-27 21:26:22,788][106226] Updated weights for policy 0, policy_version 307495 (0.0008) [2023-12-27 21:26:22,850][106225] Updated weights for policy 1, policy_version 308141 (0.0007) [2023-12-27 21:26:22,853][106226] Updated weights for policy 0, policy_version 307505 (0.0008) [2023-12-27 21:26:23,466][106225] Updated weights for policy 1, policy_version 308151 (0.0006) [2023-12-27 21:26:23,524][106225] Updated weights for policy 1, policy_version 308161 (0.0005) [2023-12-27 21:26:23,545][106226] Updated weights for policy 0, policy_version 307515 (0.0008) [2023-12-27 21:26:23,594][106225] Updated weights for policy 1, policy_version 308171 (0.0007) [2023-12-27 21:26:23,605][106226] Updated weights for policy 0, policy_version 307525 (0.0008) [2023-12-27 21:26:23,655][106226] Updated weights for policy 0, policy_version 307535 (0.0008) [2023-12-27 21:26:24,195][106225] Updated weights for policy 1, policy_version 308181 (0.0008) [2023-12-27 21:26:24,248][106225] Updated weights for policy 1, policy_version 308191 (0.0008) [2023-12-27 21:26:24,296][106225] Updated weights for policy 1, policy_version 308201 (0.0008) [2023-12-27 21:26:24,386][106226] Updated weights for policy 0, policy_version 307545 (0.0008) [2023-12-27 21:26:24,435][106226] Updated weights for policy 0, policy_version 307555 (0.0008) [2023-12-27 21:26:24,488][106226] Updated weights for policy 0, policy_version 307565 (0.0009) [2023-12-27 21:26:24,553][106226] Updated weights for policy 0, policy_version 307575 (0.0008) [2023-12-27 21:26:25,020][106225] Updated weights for policy 1, policy_version 308211 (0.0008) [2023-12-27 21:26:25,081][106225] Updated weights for policy 1, policy_version 308221 (0.0008) [2023-12-27 21:26:25,136][106225] Updated weights for policy 1, policy_version 308231 (0.0008) [2023-12-27 21:26:25,302][106226] Updated weights for policy 0, policy_version 307585 (0.0009) [2023-12-27 21:26:25,347][106226] Updated weights for policy 0, policy_version 307595 (0.0008) [2023-12-27 21:26:25,395][106226] Updated weights for policy 0, policy_version 307605 (0.0008) [2023-12-27 21:26:25,799][106225] Updated weights for policy 1, policy_version 308241 (0.0008) [2023-12-27 21:26:25,862][106225] Updated weights for policy 1, policy_version 308251 (0.0009) [2023-12-27 21:26:25,925][106225] Updated weights for policy 1, policy_version 308261 (0.0009) [2023-12-27 21:26:25,987][106225] Updated weights for policy 1, policy_version 308271 (0.0008) [2023-12-27 21:26:26,157][106226] Updated weights for policy 0, policy_version 307615 (0.0009) [2023-12-27 21:26:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 157712384. Throughput: 0: 9678.3, 1: 9968.5. Samples: 157683896. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:26,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.444')] [2023-12-27 21:26:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000308272_78938112.pth... [2023-12-27 21:26:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000307088_78635008.pth [2023-12-27 21:26:26,220][106226] Updated weights for policy 0, policy_version 307625 (0.0008) [2023-12-27 21:26:26,275][106226] Updated weights for policy 0, policy_version 307635 (0.0007) [2023-12-27 21:26:26,304][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000307640_78782464.pth... [2023-12-27 21:26:26,307][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000306520_78495744.pth [2023-12-27 21:26:26,653][106225] Updated weights for policy 1, policy_version 308281 (0.0008) [2023-12-27 21:26:26,712][106225] Updated weights for policy 1, policy_version 308291 (0.0008) [2023-12-27 21:26:26,769][106225] Updated weights for policy 1, policy_version 308301 (0.0008) [2023-12-27 21:26:27,001][106226] Updated weights for policy 0, policy_version 307645 (0.0008) [2023-12-27 21:26:27,057][106226] Updated weights for policy 0, policy_version 307655 (0.0008) [2023-12-27 21:26:27,105][106226] Updated weights for policy 0, policy_version 307665 (0.0008) [2023-12-27 21:26:27,448][106225] Updated weights for policy 1, policy_version 308311 (0.0006) [2023-12-27 21:26:27,511][106225] Updated weights for policy 1, policy_version 308321 (0.0008) [2023-12-27 21:26:27,567][106225] Updated weights for policy 1, policy_version 308331 (0.0008) [2023-12-27 21:26:27,878][106226] Updated weights for policy 0, policy_version 307675 (0.0009) [2023-12-27 21:26:27,929][106226] Updated weights for policy 0, policy_version 307685 (0.0007) [2023-12-27 21:26:27,976][106226] Updated weights for policy 0, policy_version 307695 (0.0005) [2023-12-27 21:26:28,116][106225] Updated weights for policy 1, policy_version 308341 (0.0008) [2023-12-27 21:26:28,180][106225] Updated weights for policy 1, policy_version 308351 (0.0009) [2023-12-27 21:26:28,230][106225] Updated weights for policy 1, policy_version 308361 (0.0008) [2023-12-27 21:26:28,731][106226] Updated weights for policy 0, policy_version 307705 (0.0008) [2023-12-27 21:26:28,798][106226] Updated weights for policy 0, policy_version 307715 (0.0009) [2023-12-27 21:26:28,833][106225] Updated weights for policy 1, policy_version 308371 (0.0007) [2023-12-27 21:26:28,852][106226] Updated weights for policy 0, policy_version 307725 (0.0008) [2023-12-27 21:26:28,890][106225] Updated weights for policy 1, policy_version 308381 (0.0007) [2023-12-27 21:26:28,900][106226] Updated weights for policy 0, policy_version 307735 (0.0008) [2023-12-27 21:26:28,953][106225] Updated weights for policy 1, policy_version 308391 (0.0008) [2023-12-27 21:26:29,549][106226] Updated weights for policy 0, policy_version 307745 (0.0006) [2023-12-27 21:26:29,607][106226] Updated weights for policy 0, policy_version 307755 (0.0009) [2023-12-27 21:26:29,670][106226] Updated weights for policy 0, policy_version 307765 (0.0005) [2023-12-27 21:26:29,741][106225] Updated weights for policy 1, policy_version 308401 (0.0010) [2023-12-27 21:26:29,800][106225] Updated weights for policy 1, policy_version 308411 (0.0009) [2023-12-27 21:26:29,862][106225] Updated weights for policy 1, policy_version 308421 (0.0007) [2023-12-27 21:26:29,914][106225] Updated weights for policy 1, policy_version 308431 (0.0008) [2023-12-27 21:26:30,318][106226] Updated weights for policy 0, policy_version 307775 (0.0007) [2023-12-27 21:26:30,370][106226] Updated weights for policy 0, policy_version 307785 (0.0008) [2023-12-27 21:26:30,422][106226] Updated weights for policy 0, policy_version 307795 (0.0009) [2023-12-27 21:26:30,670][106225] Updated weights for policy 1, policy_version 308441 (0.0008) [2023-12-27 21:26:30,722][106225] Updated weights for policy 1, policy_version 308451 (0.0008) [2023-12-27 21:26:30,772][106225] Updated weights for policy 1, policy_version 308461 (0.0008) [2023-12-27 21:26:31,165][106226] Updated weights for policy 0, policy_version 307805 (0.0009) [2023-12-27 21:26:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 157810688. Throughput: 0: 9713.1, 1: 10053.9. Samples: 157804168. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:31,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-5.148')] [2023-12-27 21:26:31,176][106141] Saving new best policy, reward=-5.148! [2023-12-27 21:26:31,230][106226] Updated weights for policy 0, policy_version 307815 (0.0009) [2023-12-27 21:26:31,295][106226] Updated weights for policy 0, policy_version 307825 (0.0009) [2023-12-27 21:26:31,527][106225] Updated weights for policy 1, policy_version 308471 (0.0009) [2023-12-27 21:26:31,591][106225] Updated weights for policy 1, policy_version 308481 (0.0007) [2023-12-27 21:26:31,657][106225] Updated weights for policy 1, policy_version 308491 (0.0008) [2023-12-27 21:26:32,015][106226] Updated weights for policy 0, policy_version 307835 (0.0007) [2023-12-27 21:26:32,075][106226] Updated weights for policy 0, policy_version 307845 (0.0009) [2023-12-27 21:26:32,129][106226] Updated weights for policy 0, policy_version 307855 (0.0010) [2023-12-27 21:26:32,240][106225] Updated weights for policy 1, policy_version 308501 (0.0006) [2023-12-27 21:26:32,298][106225] Updated weights for policy 1, policy_version 308511 (0.0006) [2023-12-27 21:26:32,359][106225] Updated weights for policy 1, policy_version 308521 (0.0007) [2023-12-27 21:26:32,832][106226] Updated weights for policy 0, policy_version 307865 (0.0007) [2023-12-27 21:26:32,880][106226] Updated weights for policy 0, policy_version 307875 (0.0008) [2023-12-27 21:26:32,930][106226] Updated weights for policy 0, policy_version 307885 (0.0009) [2023-12-27 21:26:32,991][106226] Updated weights for policy 0, policy_version 307895 (0.0008) [2023-12-27 21:26:33,057][106225] Updated weights for policy 1, policy_version 308531 (0.0009) [2023-12-27 21:26:33,111][106225] Updated weights for policy 1, policy_version 308541 (0.0008) [2023-12-27 21:26:33,158][106225] Updated weights for policy 1, policy_version 308551 (0.0008) [2023-12-27 21:26:33,715][106226] Updated weights for policy 0, policy_version 307905 (0.0008) [2023-12-27 21:26:33,779][106226] Updated weights for policy 0, policy_version 307915 (0.0009) [2023-12-27 21:26:33,833][106226] Updated weights for policy 0, policy_version 307925 (0.0008) [2023-12-27 21:26:33,882][106225] Updated weights for policy 1, policy_version 308561 (0.0008) [2023-12-27 21:26:33,939][106225] Updated weights for policy 1, policy_version 308571 (0.0008) [2023-12-27 21:26:33,989][106225] Updated weights for policy 1, policy_version 308581 (0.0008) [2023-12-27 21:26:34,040][106225] Updated weights for policy 1, policy_version 308591 (0.0008) [2023-12-27 21:26:34,567][106226] Updated weights for policy 0, policy_version 307935 (0.0009) [2023-12-27 21:26:34,635][106226] Updated weights for policy 0, policy_version 307945 (0.0009) [2023-12-27 21:26:34,692][106226] Updated weights for policy 0, policy_version 307955 (0.0007) [2023-12-27 21:26:34,787][106225] Updated weights for policy 1, policy_version 308601 (0.0008) [2023-12-27 21:26:34,832][106225] Updated weights for policy 1, policy_version 308611 (0.0008) [2023-12-27 21:26:34,882][106225] Updated weights for policy 1, policy_version 308621 (0.0009) [2023-12-27 21:26:35,276][106226] Updated weights for policy 0, policy_version 307965 (0.0008) [2023-12-27 21:26:35,334][106226] Updated weights for policy 0, policy_version 307975 (0.0008) [2023-12-27 21:26:35,390][106226] Updated weights for policy 0, policy_version 307985 (0.0009) [2023-12-27 21:26:35,702][106225] Updated weights for policy 1, policy_version 308632 (0.0007) [2023-12-27 21:26:35,757][106225] Updated weights for policy 1, policy_version 308642 (0.0005) [2023-12-27 21:26:35,803][106225] Updated weights for policy 1, policy_version 308652 (0.0005) [2023-12-27 21:26:36,066][106226] Updated weights for policy 0, policy_version 307995 (0.0008) [2023-12-27 21:26:36,122][106226] Updated weights for policy 0, policy_version 308005 (0.0007) [2023-12-27 21:26:36,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 157908992. Throughput: 0: 9687.6, 1: 10044.6. Samples: 157921524. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:36,176][105115] Avg episode reward: [(0, '-4.561'), (1, '-5.670')] [2023-12-27 21:26:36,189][106226] Updated weights for policy 0, policy_version 308015 (0.0008) [2023-12-27 21:26:36,434][106225] Updated weights for policy 1, policy_version 308662 (0.0007) [2023-12-27 21:26:36,499][106225] Updated weights for policy 1, policy_version 308672 (0.0009) [2023-12-27 21:26:36,564][106225] Updated weights for policy 1, policy_version 308682 (0.0008) [2023-12-27 21:26:36,890][106226] Updated weights for policy 0, policy_version 308025 (0.0008) [2023-12-27 21:26:36,947][106226] Updated weights for policy 0, policy_version 308035 (0.0007) [2023-12-27 21:26:37,005][106226] Updated weights for policy 0, policy_version 308045 (0.0008) [2023-12-27 21:26:37,064][106226] Updated weights for policy 0, policy_version 308055 (0.0008) [2023-12-27 21:26:37,233][106225] Updated weights for policy 1, policy_version 308692 (0.0006) [2023-12-27 21:26:37,294][106225] Updated weights for policy 1, policy_version 308702 (0.0005) [2023-12-27 21:26:37,353][106225] Updated weights for policy 1, policy_version 308712 (0.0005) [2023-12-27 21:26:37,789][106226] Updated weights for policy 0, policy_version 308065 (0.0006) [2023-12-27 21:26:37,843][106226] Updated weights for policy 0, policy_version 308075 (0.0005) [2023-12-27 21:26:37,891][106226] Updated weights for policy 0, policy_version 308085 (0.0005) [2023-12-27 21:26:37,950][106225] Updated weights for policy 1, policy_version 308722 (0.0007) [2023-12-27 21:26:38,004][106225] Updated weights for policy 1, policy_version 308732 (0.0008) [2023-12-27 21:26:38,060][106225] Updated weights for policy 1, policy_version 308742 (0.0008) [2023-12-27 21:26:38,117][106225] Updated weights for policy 1, policy_version 308752 (0.0009) [2023-12-27 21:26:38,557][106226] Updated weights for policy 0, policy_version 308095 (0.0008) [2023-12-27 21:26:38,621][106226] Updated weights for policy 0, policy_version 308105 (0.0011) [2023-12-27 21:26:38,685][106226] Updated weights for policy 0, policy_version 308115 (0.0011) [2023-12-27 21:26:38,891][106225] Updated weights for policy 1, policy_version 308762 (0.0008) [2023-12-27 21:26:38,939][106225] Updated weights for policy 1, policy_version 308772 (0.0008) [2023-12-27 21:26:38,994][106225] Updated weights for policy 1, policy_version 308782 (0.0007) [2023-12-27 21:26:39,340][106226] Updated weights for policy 0, policy_version 308125 (0.0009) [2023-12-27 21:26:39,416][106226] Updated weights for policy 0, policy_version 308135 (0.0008) [2023-12-27 21:26:39,481][106226] Updated weights for policy 0, policy_version 308145 (0.0007) [2023-12-27 21:26:39,753][106225] Updated weights for policy 1, policy_version 308792 (0.0010) [2023-12-27 21:26:39,814][106225] Updated weights for policy 1, policy_version 308802 (0.0011) [2023-12-27 21:26:39,884][106225] Updated weights for policy 1, policy_version 308812 (0.0007) [2023-12-27 21:26:40,215][106226] Updated weights for policy 0, policy_version 308155 (0.0009) [2023-12-27 21:26:40,279][106226] Updated weights for policy 0, policy_version 308165 (0.0011) [2023-12-27 21:26:40,340][106226] Updated weights for policy 0, policy_version 308175 (0.0009) [2023-12-27 21:26:40,590][106225] Updated weights for policy 1, policy_version 308822 (0.0008) [2023-12-27 21:26:40,651][106225] Updated weights for policy 1, policy_version 308832 (0.0008) [2023-12-27 21:26:40,712][106225] Updated weights for policy 1, policy_version 308842 (0.0008) [2023-12-27 21:26:41,013][106226] Updated weights for policy 0, policy_version 308185 (0.0009) [2023-12-27 21:26:41,071][106226] Updated weights for policy 0, policy_version 308195 (0.0009) [2023-12-27 21:26:41,135][106226] Updated weights for policy 0, policy_version 308205 (0.0008) [2023-12-27 21:26:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 158007296. Throughput: 0: 9694.0, 1: 10109.1. Samples: 157982048. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:41,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-5.165')] [2023-12-27 21:26:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000308848_79085568.pth... [2023-12-27 21:26:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000307664_78782464.pth [2023-12-27 21:26:41,203][106226] Updated weights for policy 0, policy_version 308215 (0.0008) [2023-12-27 21:26:41,207][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000308216_78929920.pth... [2023-12-27 21:26:41,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000307064_78635008.pth [2023-12-27 21:26:41,542][106225] Updated weights for policy 1, policy_version 308852 (0.0009) [2023-12-27 21:26:41,596][106225] Updated weights for policy 1, policy_version 308862 (0.0008) [2023-12-27 21:26:41,662][106225] Updated weights for policy 1, policy_version 308872 (0.0008) [2023-12-27 21:26:41,966][106226] Updated weights for policy 0, policy_version 308225 (0.0008) [2023-12-27 21:26:42,031][106226] Updated weights for policy 0, policy_version 308235 (0.0008) [2023-12-27 21:26:42,090][106226] Updated weights for policy 0, policy_version 308245 (0.0008) [2023-12-27 21:26:42,454][106225] Updated weights for policy 1, policy_version 308882 (0.0008) [2023-12-27 21:26:42,510][106225] Updated weights for policy 1, policy_version 308892 (0.0008) [2023-12-27 21:26:42,561][106225] Updated weights for policy 1, policy_version 308902 (0.0008) [2023-12-27 21:26:42,615][106225] Updated weights for policy 1, policy_version 308912 (0.0008) [2023-12-27 21:26:42,772][106226] Updated weights for policy 0, policy_version 308255 (0.0008) [2023-12-27 21:26:42,833][106226] Updated weights for policy 0, policy_version 308265 (0.0009) [2023-12-27 21:26:42,892][106226] Updated weights for policy 0, policy_version 308275 (0.0008) [2023-12-27 21:26:43,335][106225] Updated weights for policy 1, policy_version 308922 (0.0008) [2023-12-27 21:26:43,398][106225] Updated weights for policy 1, policy_version 308932 (0.0008) [2023-12-27 21:26:43,454][106225] Updated weights for policy 1, policy_version 308942 (0.0007) [2023-12-27 21:26:43,584][106226] Updated weights for policy 0, policy_version 308285 (0.0009) [2023-12-27 21:26:43,633][106226] Updated weights for policy 0, policy_version 308295 (0.0008) [2023-12-27 21:26:43,693][106226] Updated weights for policy 0, policy_version 308305 (0.0009) [2023-12-27 21:26:44,229][106225] Updated weights for policy 1, policy_version 308952 (0.0008) [2023-12-27 21:26:44,297][106225] Updated weights for policy 1, policy_version 308962 (0.0008) [2023-12-27 21:26:44,354][106225] Updated weights for policy 1, policy_version 308972 (0.0008) [2023-12-27 21:26:44,460][106226] Updated weights for policy 0, policy_version 308315 (0.0009) [2023-12-27 21:26:44,507][106226] Updated weights for policy 0, policy_version 308325 (0.0009) [2023-12-27 21:26:44,558][106226] Updated weights for policy 0, policy_version 308335 (0.0007) [2023-12-27 21:26:45,127][106225] Updated weights for policy 1, policy_version 308982 (0.0008) [2023-12-27 21:26:45,175][106225] Updated weights for policy 1, policy_version 308992 (0.0008) [2023-12-27 21:26:45,191][106226] Updated weights for policy 0, policy_version 308345 (0.0006) [2023-12-27 21:26:45,237][106225] Updated weights for policy 1, policy_version 309002 (0.0007) [2023-12-27 21:26:45,243][106226] Updated weights for policy 0, policy_version 308355 (0.0010) [2023-12-27 21:26:45,304][106226] Updated weights for policy 0, policy_version 308365 (0.0011) [2023-12-27 21:26:45,368][106226] Updated weights for policy 0, policy_version 308375 (0.0006) [2023-12-27 21:26:45,994][106226] Updated weights for policy 0, policy_version 308385 (0.0008) [2023-12-27 21:26:46,008][106225] Updated weights for policy 1, policy_version 309012 (0.0006) [2023-12-27 21:26:46,053][106226] Updated weights for policy 0, policy_version 308395 (0.0006) [2023-12-27 21:26:46,070][106225] Updated weights for policy 1, policy_version 309022 (0.0008) [2023-12-27 21:26:46,107][106226] Updated weights for policy 0, policy_version 308405 (0.0006) [2023-12-27 21:26:46,127][106225] Updated weights for policy 1, policy_version 309032 (0.0008) [2023-12-27 21:26:46,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 158113792. Throughput: 0: 9617.6, 1: 10014.4. Samples: 158096136. Policy #0 lag: (min: 31.0, avg: 46.0, max: 63.0) [2023-12-27 21:26:46,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.401')] [2023-12-27 21:26:46,696][106226] Updated weights for policy 0, policy_version 308415 (0.0008) [2023-12-27 21:26:46,759][106226] Updated weights for policy 0, policy_version 308425 (0.0009) [2023-12-27 21:26:46,812][106226] Updated weights for policy 0, policy_version 308435 (0.0010) [2023-12-27 21:26:46,920][106225] Updated weights for policy 1, policy_version 309042 (0.0009) [2023-12-27 21:26:46,986][106225] Updated weights for policy 1, policy_version 309052 (0.0008) [2023-12-27 21:26:47,046][106225] Updated weights for policy 1, policy_version 309062 (0.0008) [2023-12-27 21:26:47,116][106225] Updated weights for policy 1, policy_version 309072 (0.0008) [2023-12-27 21:26:47,475][106226] Updated weights for policy 0, policy_version 308445 (0.0010) [2023-12-27 21:26:47,547][106226] Updated weights for policy 0, policy_version 308455 (0.0005) [2023-12-27 21:26:47,599][106226] Updated weights for policy 0, policy_version 308465 (0.0007) [2023-12-27 21:26:47,885][106225] Updated weights for policy 1, policy_version 309082 (0.0008) [2023-12-27 21:26:47,942][106225] Updated weights for policy 1, policy_version 309092 (0.0007) [2023-12-27 21:26:47,995][106225] Updated weights for policy 1, policy_version 309102 (0.0007) [2023-12-27 21:26:48,232][106226] Updated weights for policy 0, policy_version 308475 (0.0008) [2023-12-27 21:26:48,287][106226] Updated weights for policy 0, policy_version 308485 (0.0010) [2023-12-27 21:26:48,351][106226] Updated weights for policy 0, policy_version 308495 (0.0010) [2023-12-27 21:26:48,752][106225] Updated weights for policy 1, policy_version 309112 (0.0007) [2023-12-27 21:26:48,817][106225] Updated weights for policy 1, policy_version 309122 (0.0008) [2023-12-27 21:26:48,878][106225] Updated weights for policy 1, policy_version 309132 (0.0008) [2023-12-27 21:26:49,059][106226] Updated weights for policy 0, policy_version 308505 (0.0007) [2023-12-27 21:26:49,115][106226] Updated weights for policy 0, policy_version 308515 (0.0009) [2023-12-27 21:26:49,178][106226] Updated weights for policy 0, policy_version 308525 (0.0005) [2023-12-27 21:26:49,252][106226] Updated weights for policy 0, policy_version 308535 (0.0008) [2023-12-27 21:26:49,627][106225] Updated weights for policy 1, policy_version 309142 (0.0008) [2023-12-27 21:26:49,683][106225] Updated weights for policy 1, policy_version 309152 (0.0008) [2023-12-27 21:26:49,744][106225] Updated weights for policy 1, policy_version 309162 (0.0009) [2023-12-27 21:26:49,970][106226] Updated weights for policy 0, policy_version 308545 (0.0008) [2023-12-27 21:26:50,037][106226] Updated weights for policy 0, policy_version 308555 (0.0008) [2023-12-27 21:26:50,087][106226] Updated weights for policy 0, policy_version 308565 (0.0008) [2023-12-27 21:26:50,497][106225] Updated weights for policy 1, policy_version 309172 (0.0008) [2023-12-27 21:26:50,551][106225] Updated weights for policy 1, policy_version 309182 (0.0006) [2023-12-27 21:26:50,622][106225] Updated weights for policy 1, policy_version 309192 (0.0009) [2023-12-27 21:26:50,868][106226] Updated weights for policy 0, policy_version 308575 (0.0008) [2023-12-27 21:26:50,921][106226] Updated weights for policy 0, policy_version 308585 (0.0008) [2023-12-27 21:26:50,978][106226] Updated weights for policy 0, policy_version 308595 (0.0008) [2023-12-27 21:26:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 158203904. Throughput: 0: 9668.5, 1: 9873.0. Samples: 158211436. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:26:51,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.508')] [2023-12-27 21:26:51,319][106225] Updated weights for policy 1, policy_version 309202 (0.0009) [2023-12-27 21:26:51,386][106225] Updated weights for policy 1, policy_version 309212 (0.0009) [2023-12-27 21:26:51,452][106225] Updated weights for policy 1, policy_version 309222 (0.0008) [2023-12-27 21:26:51,520][106225] Updated weights for policy 1, policy_version 309232 (0.0007) [2023-12-27 21:26:51,794][106226] Updated weights for policy 0, policy_version 308605 (0.0008) [2023-12-27 21:26:51,854][106226] Updated weights for policy 0, policy_version 308615 (0.0009) [2023-12-27 21:26:51,921][106226] Updated weights for policy 0, policy_version 308625 (0.0010) [2023-12-27 21:26:52,210][106225] Updated weights for policy 1, policy_version 309242 (0.0009) [2023-12-27 21:26:52,267][106225] Updated weights for policy 1, policy_version 309252 (0.0008) [2023-12-27 21:26:52,335][106225] Updated weights for policy 1, policy_version 309262 (0.0008) [2023-12-27 21:26:52,580][106226] Updated weights for policy 0, policy_version 308635 (0.0006) [2023-12-27 21:26:52,651][106226] Updated weights for policy 0, policy_version 308645 (0.0006) [2023-12-27 21:26:52,717][106226] Updated weights for policy 0, policy_version 308655 (0.0009) [2023-12-27 21:26:53,026][106225] Updated weights for policy 1, policy_version 309272 (0.0007) [2023-12-27 21:26:53,075][106225] Updated weights for policy 1, policy_version 309282 (0.0008) [2023-12-27 21:26:53,133][106225] Updated weights for policy 1, policy_version 309292 (0.0008) [2023-12-27 21:26:53,324][106226] Updated weights for policy 0, policy_version 308665 (0.0010) [2023-12-27 21:26:53,384][106226] Updated weights for policy 0, policy_version 308675 (0.0009) [2023-12-27 21:26:53,442][106226] Updated weights for policy 0, policy_version 308685 (0.0008) [2023-12-27 21:26:53,501][106226] Updated weights for policy 0, policy_version 308695 (0.0007) [2023-12-27 21:26:53,901][106225] Updated weights for policy 1, policy_version 309302 (0.0008) [2023-12-27 21:26:53,947][106225] Updated weights for policy 1, policy_version 309312 (0.0006) [2023-12-27 21:26:54,000][106225] Updated weights for policy 1, policy_version 309322 (0.0006) [2023-12-27 21:26:54,154][106226] Updated weights for policy 0, policy_version 308705 (0.0006) [2023-12-27 21:26:54,219][106226] Updated weights for policy 0, policy_version 308715 (0.0008) [2023-12-27 21:26:54,279][106226] Updated weights for policy 0, policy_version 308725 (0.0010) [2023-12-27 21:26:54,729][106225] Updated weights for policy 1, policy_version 309332 (0.0008) [2023-12-27 21:26:54,782][106225] Updated weights for policy 1, policy_version 309342 (0.0008) [2023-12-27 21:26:54,825][106225] Updated weights for policy 1, policy_version 309352 (0.0007) [2023-12-27 21:26:54,946][106226] Updated weights for policy 0, policy_version 308735 (0.0011) [2023-12-27 21:26:55,004][106226] Updated weights for policy 0, policy_version 308745 (0.0011) [2023-12-27 21:26:55,058][106226] Updated weights for policy 0, policy_version 308755 (0.0010) [2023-12-27 21:26:55,574][106225] Updated weights for policy 1, policy_version 309362 (0.0007) [2023-12-27 21:26:55,631][106225] Updated weights for policy 1, policy_version 309372 (0.0008) [2023-12-27 21:26:55,685][106225] Updated weights for policy 1, policy_version 309382 (0.0007) [2023-12-27 21:26:55,742][106225] Updated weights for policy 1, policy_version 309392 (0.0007) [2023-12-27 21:26:55,791][106226] Updated weights for policy 0, policy_version 308765 (0.0011) [2023-12-27 21:26:55,861][106226] Updated weights for policy 0, policy_version 308775 (0.0010) [2023-12-27 21:26:55,927][106226] Updated weights for policy 0, policy_version 308785 (0.0011) [2023-12-27 21:26:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 158302208. Throughput: 0: 9702.9, 1: 9821.0. Samples: 158271596. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:26:56,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.630')] [2023-12-27 21:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000308792_79077376.pth... [2023-12-27 21:26:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000309392_79224832.pth... [2023-12-27 21:26:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000308272_78938112.pth [2023-12-27 21:26:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000307640_78782464.pth [2023-12-27 21:26:56,451][106225] Updated weights for policy 1, policy_version 309402 (0.0005) [2023-12-27 21:26:56,509][106225] Updated weights for policy 1, policy_version 309412 (0.0005) [2023-12-27 21:26:56,562][106225] Updated weights for policy 1, policy_version 309422 (0.0005) [2023-12-27 21:26:56,623][106226] Updated weights for policy 0, policy_version 308795 (0.0011) [2023-12-27 21:26:56,687][106226] Updated weights for policy 0, policy_version 308805 (0.0011) [2023-12-27 21:26:56,750][106226] Updated weights for policy 0, policy_version 308815 (0.0010) [2023-12-27 21:26:57,156][106225] Updated weights for policy 1, policy_version 309432 (0.0008) [2023-12-27 21:26:57,208][106225] Updated weights for policy 1, policy_version 309442 (0.0008) [2023-12-27 21:26:57,263][106225] Updated weights for policy 1, policy_version 309452 (0.0009) [2023-12-27 21:26:57,409][106226] Updated weights for policy 0, policy_version 308825 (0.0010) [2023-12-27 21:26:57,464][106226] Updated weights for policy 0, policy_version 308835 (0.0008) [2023-12-27 21:26:57,515][106226] Updated weights for policy 0, policy_version 308845 (0.0009) [2023-12-27 21:26:57,562][106226] Updated weights for policy 0, policy_version 308855 (0.0011) [2023-12-27 21:26:57,992][106225] Updated weights for policy 1, policy_version 309462 (0.0008) [2023-12-27 21:26:58,041][106225] Updated weights for policy 1, policy_version 309472 (0.0007) [2023-12-27 21:26:58,087][106225] Updated weights for policy 1, policy_version 309482 (0.0008) [2023-12-27 21:26:58,315][106226] Updated weights for policy 0, policy_version 308865 (0.0011) [2023-12-27 21:26:58,400][106226] Updated weights for policy 0, policy_version 308876 (0.0009) [2023-12-27 21:26:58,473][106226] Updated weights for policy 0, policy_version 308886 (0.0010) [2023-12-27 21:26:58,948][106225] Updated weights for policy 1, policy_version 309492 (0.0008) [2023-12-27 21:26:59,012][106225] Updated weights for policy 1, policy_version 309502 (0.0009) [2023-12-27 21:26:59,074][106225] Updated weights for policy 1, policy_version 309512 (0.0008) [2023-12-27 21:26:59,281][106226] Updated weights for policy 0, policy_version 308896 (0.0009) [2023-12-27 21:26:59,339][106226] Updated weights for policy 0, policy_version 308906 (0.0007) [2023-12-27 21:26:59,406][106226] Updated weights for policy 0, policy_version 308916 (0.0010) [2023-12-27 21:26:59,794][106225] Updated weights for policy 1, policy_version 309522 (0.0007) [2023-12-27 21:26:59,859][106225] Updated weights for policy 1, policy_version 309532 (0.0009) [2023-12-27 21:26:59,922][106225] Updated weights for policy 1, policy_version 309542 (0.0009) [2023-12-27 21:26:59,986][106225] Updated weights for policy 1, policy_version 309552 (0.0008) [2023-12-27 21:27:00,199][106226] Updated weights for policy 0, policy_version 308926 (0.0008) [2023-12-27 21:27:00,257][106226] Updated weights for policy 0, policy_version 308936 (0.0009) [2023-12-27 21:27:00,316][106226] Updated weights for policy 0, policy_version 308946 (0.0008) [2023-12-27 21:27:00,680][106225] Updated weights for policy 1, policy_version 309562 (0.0005) [2023-12-27 21:27:00,745][106225] Updated weights for policy 1, policy_version 309572 (0.0005) [2023-12-27 21:27:00,804][106225] Updated weights for policy 1, policy_version 309582 (0.0005) [2023-12-27 21:27:01,010][106226] Updated weights for policy 0, policy_version 308956 (0.0007) [2023-12-27 21:27:01,076][106226] Updated weights for policy 0, policy_version 308966 (0.0010) [2023-12-27 21:27:01,133][106226] Updated weights for policy 0, policy_version 308976 (0.0011) [2023-12-27 21:27:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19688.6). Total num frames: 158392320. Throughput: 0: 9733.8, 1: 9801.1. Samples: 158387060. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:01,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-5.762')] [2023-12-27 21:27:01,358][106225] Updated weights for policy 1, policy_version 309592 (0.0007) [2023-12-27 21:27:01,428][106225] Updated weights for policy 1, policy_version 309602 (0.0007) [2023-12-27 21:27:01,482][106225] Updated weights for policy 1, policy_version 309612 (0.0006) [2023-12-27 21:27:01,919][106226] Updated weights for policy 0, policy_version 308986 (0.0010) [2023-12-27 21:27:01,979][106226] Updated weights for policy 0, policy_version 308996 (0.0005) [2023-12-27 21:27:02,033][106226] Updated weights for policy 0, policy_version 309006 (0.0005) [2023-12-27 21:27:02,089][106226] Updated weights for policy 0, policy_version 309016 (0.0007) [2023-12-27 21:27:02,139][106225] Updated weights for policy 1, policy_version 309622 (0.0008) [2023-12-27 21:27:02,189][106225] Updated weights for policy 1, policy_version 309632 (0.0008) [2023-12-27 21:27:02,242][106225] Updated weights for policy 1, policy_version 309642 (0.0008) [2023-12-27 21:27:02,742][106226] Updated weights for policy 0, policy_version 309026 (0.0005) [2023-12-27 21:27:02,803][106226] Updated weights for policy 0, policy_version 309036 (0.0005) [2023-12-27 21:27:02,870][106226] Updated weights for policy 0, policy_version 309046 (0.0007) [2023-12-27 21:27:03,065][106225] Updated weights for policy 1, policy_version 309652 (0.0008) [2023-12-27 21:27:03,112][106225] Updated weights for policy 1, policy_version 309662 (0.0008) [2023-12-27 21:27:03,160][106225] Updated weights for policy 1, policy_version 309672 (0.0008) [2023-12-27 21:27:03,498][106226] Updated weights for policy 0, policy_version 309056 (0.0009) [2023-12-27 21:27:03,552][106226] Updated weights for policy 0, policy_version 309066 (0.0008) [2023-12-27 21:27:03,610][106226] Updated weights for policy 0, policy_version 309076 (0.0008) [2023-12-27 21:27:03,905][106225] Updated weights for policy 1, policy_version 309682 (0.0008) [2023-12-27 21:27:03,969][106225] Updated weights for policy 1, policy_version 309692 (0.0008) [2023-12-27 21:27:04,023][106225] Updated weights for policy 1, policy_version 309702 (0.0009) [2023-12-27 21:27:04,073][106225] Updated weights for policy 1, policy_version 309712 (0.0008) [2023-12-27 21:27:04,337][106226] Updated weights for policy 0, policy_version 309086 (0.0009) [2023-12-27 21:27:04,400][106226] Updated weights for policy 0, policy_version 309096 (0.0009) [2023-12-27 21:27:04,466][106226] Updated weights for policy 0, policy_version 309106 (0.0008) [2023-12-27 21:27:04,782][106225] Updated weights for policy 1, policy_version 309722 (0.0008) [2023-12-27 21:27:04,831][106225] Updated weights for policy 1, policy_version 309732 (0.0008) [2023-12-27 21:27:04,879][106225] Updated weights for policy 1, policy_version 309742 (0.0008) [2023-12-27 21:27:05,116][106226] Updated weights for policy 0, policy_version 309116 (0.0008) [2023-12-27 21:27:05,167][106226] Updated weights for policy 0, policy_version 309126 (0.0008) [2023-12-27 21:27:05,223][106226] Updated weights for policy 0, policy_version 309136 (0.0008) [2023-12-27 21:27:05,664][106225] Updated weights for policy 1, policy_version 309752 (0.0008) [2023-12-27 21:27:05,715][106225] Updated weights for policy 1, policy_version 309762 (0.0008) [2023-12-27 21:27:05,765][106225] Updated weights for policy 1, policy_version 309772 (0.0007) [2023-12-27 21:27:05,984][106226] Updated weights for policy 0, policy_version 309146 (0.0009) [2023-12-27 21:27:06,050][106226] Updated weights for policy 0, policy_version 309156 (0.0008) [2023-12-27 21:27:06,125][106226] Updated weights for policy 0, policy_version 309166 (0.0009) [2023-12-27 21:27:06,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 158490624. Throughput: 0: 9799.8, 1: 9745.8. Samples: 158504712. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:06,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.770')] [2023-12-27 21:27:06,185][106226] Updated weights for policy 0, policy_version 309176 (0.0007) [2023-12-27 21:27:06,435][106225] Updated weights for policy 1, policy_version 309782 (0.0009) [2023-12-27 21:27:06,498][106225] Updated weights for policy 1, policy_version 309792 (0.0011) [2023-12-27 21:27:06,562][106225] Updated weights for policy 1, policy_version 309802 (0.0010) [2023-12-27 21:27:06,941][106226] Updated weights for policy 0, policy_version 309186 (0.0008) [2023-12-27 21:27:06,990][106226] Updated weights for policy 0, policy_version 309196 (0.0008) [2023-12-27 21:27:07,050][106226] Updated weights for policy 0, policy_version 309206 (0.0008) [2023-12-27 21:27:07,280][106225] Updated weights for policy 1, policy_version 309812 (0.0011) [2023-12-27 21:27:07,337][106225] Updated weights for policy 1, policy_version 309822 (0.0010) [2023-12-27 21:27:07,396][106225] Updated weights for policy 1, policy_version 309832 (0.0010) [2023-12-27 21:27:07,788][106226] Updated weights for policy 0, policy_version 309216 (0.0008) [2023-12-27 21:27:07,847][106226] Updated weights for policy 0, policy_version 309226 (0.0007) [2023-12-27 21:27:07,907][106226] Updated weights for policy 0, policy_version 309236 (0.0008) [2023-12-27 21:27:08,063][106225] Updated weights for policy 1, policy_version 309842 (0.0010) [2023-12-27 21:27:08,118][106225] Updated weights for policy 1, policy_version 309852 (0.0010) [2023-12-27 21:27:08,186][106225] Updated weights for policy 1, policy_version 309862 (0.0010) [2023-12-27 21:27:08,250][106225] Updated weights for policy 1, policy_version 309872 (0.0010) [2023-12-27 21:27:08,525][106226] Updated weights for policy 0, policy_version 309246 (0.0007) [2023-12-27 21:27:08,591][106226] Updated weights for policy 0, policy_version 309256 (0.0009) [2023-12-27 21:27:08,655][106226] Updated weights for policy 0, policy_version 309266 (0.0009) [2023-12-27 21:27:08,968][106225] Updated weights for policy 1, policy_version 309882 (0.0010) [2023-12-27 21:27:09,032][106225] Updated weights for policy 1, policy_version 309892 (0.0010) [2023-12-27 21:27:09,096][106225] Updated weights for policy 1, policy_version 309902 (0.0010) [2023-12-27 21:27:09,373][106226] Updated weights for policy 0, policy_version 309276 (0.0010) [2023-12-27 21:27:09,440][106226] Updated weights for policy 0, policy_version 309286 (0.0010) [2023-12-27 21:27:09,504][106226] Updated weights for policy 0, policy_version 309296 (0.0009) [2023-12-27 21:27:09,856][106225] Updated weights for policy 1, policy_version 309912 (0.0009) [2023-12-27 21:27:09,915][106225] Updated weights for policy 1, policy_version 309922 (0.0008) [2023-12-27 21:27:09,984][106225] Updated weights for policy 1, policy_version 309932 (0.0008) [2023-12-27 21:27:10,240][106226] Updated weights for policy 0, policy_version 309306 (0.0008) [2023-12-27 21:27:10,304][106226] Updated weights for policy 0, policy_version 309316 (0.0009) [2023-12-27 21:27:10,366][106226] Updated weights for policy 0, policy_version 309326 (0.0010) [2023-12-27 21:27:10,429][106226] Updated weights for policy 0, policy_version 309336 (0.0009) [2023-12-27 21:27:10,565][106225] Updated weights for policy 1, policy_version 309942 (0.0007) [2023-12-27 21:27:10,618][106225] Updated weights for policy 1, policy_version 309952 (0.0008) [2023-12-27 21:27:10,675][106225] Updated weights for policy 1, policy_version 309962 (0.0009) [2023-12-27 21:27:11,118][106226] Updated weights for policy 0, policy_version 309346 (0.0009) [2023-12-27 21:27:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 158588928. Throughput: 0: 9832.5, 1: 9729.5. Samples: 158564188. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:11,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-5.949')] [2023-12-27 21:27:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000309968_79372288.pth... [2023-12-27 21:27:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000308848_79085568.pth [2023-12-27 21:27:11,185][106226] Updated weights for policy 0, policy_version 309356 (0.0010) [2023-12-27 21:27:11,246][106226] Updated weights for policy 0, policy_version 309366 (0.0009) [2023-12-27 21:27:11,258][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000309368_79224832.pth... [2023-12-27 21:27:11,262][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000308216_78929920.pth [2023-12-27 21:27:11,375][106225] Updated weights for policy 1, policy_version 309972 (0.0008) [2023-12-27 21:27:11,440][106225] Updated weights for policy 1, policy_version 309982 (0.0007) [2023-12-27 21:27:11,494][106225] Updated weights for policy 1, policy_version 309992 (0.0006) [2023-12-27 21:27:11,975][106226] Updated weights for policy 0, policy_version 309376 (0.0010) [2023-12-27 21:27:12,039][106226] Updated weights for policy 0, policy_version 309386 (0.0011) [2023-12-27 21:27:12,094][106226] Updated weights for policy 0, policy_version 309396 (0.0011) [2023-12-27 21:27:12,190][106225] Updated weights for policy 1, policy_version 310002 (0.0006) [2023-12-27 21:27:12,254][106225] Updated weights for policy 1, policy_version 310012 (0.0007) [2023-12-27 21:27:12,317][106225] Updated weights for policy 1, policy_version 310022 (0.0007) [2023-12-27 21:27:12,381][106225] Updated weights for policy 1, policy_version 310032 (0.0009) [2023-12-27 21:27:12,752][106226] Updated weights for policy 0, policy_version 309406 (0.0010) [2023-12-27 21:27:12,815][106226] Updated weights for policy 0, policy_version 309416 (0.0009) [2023-12-27 21:27:12,879][106226] Updated weights for policy 0, policy_version 309426 (0.0011) [2023-12-27 21:27:13,109][106225] Updated weights for policy 1, policy_version 310042 (0.0010) [2023-12-27 21:27:13,158][106225] Updated weights for policy 1, policy_version 310052 (0.0010) [2023-12-27 21:27:13,214][106225] Updated weights for policy 1, policy_version 310062 (0.0010) [2023-12-27 21:27:13,523][106226] Updated weights for policy 0, policy_version 309436 (0.0011) [2023-12-27 21:27:13,577][106226] Updated weights for policy 0, policy_version 309446 (0.0010) [2023-12-27 21:27:13,624][106226] Updated weights for policy 0, policy_version 309456 (0.0010) [2023-12-27 21:27:13,830][106225] Updated weights for policy 1, policy_version 310072 (0.0006) [2023-12-27 21:27:13,885][106225] Updated weights for policy 1, policy_version 310082 (0.0005) [2023-12-27 21:27:13,938][106225] Updated weights for policy 1, policy_version 310092 (0.0007) [2023-12-27 21:27:14,300][106226] Updated weights for policy 0, policy_version 309466 (0.0010) [2023-12-27 21:27:14,354][106226] Updated weights for policy 0, policy_version 309476 (0.0010) [2023-12-27 21:27:14,413][106226] Updated weights for policy 0, policy_version 309486 (0.0008) [2023-12-27 21:27:14,470][106226] Updated weights for policy 0, policy_version 309496 (0.0009) [2023-12-27 21:27:14,606][106225] Updated weights for policy 1, policy_version 310102 (0.0010) [2023-12-27 21:27:14,656][106225] Updated weights for policy 1, policy_version 310112 (0.0010) [2023-12-27 21:27:14,706][106225] Updated weights for policy 1, policy_version 310122 (0.0010) [2023-12-27 21:27:15,107][106226] Updated weights for policy 0, policy_version 309506 (0.0007) [2023-12-27 21:27:15,171][106226] Updated weights for policy 0, policy_version 309516 (0.0007) [2023-12-27 21:27:15,242][106226] Updated weights for policy 0, policy_version 309526 (0.0006) [2023-12-27 21:27:15,475][106225] Updated weights for policy 1, policy_version 310132 (0.0010) [2023-12-27 21:27:15,525][106225] Updated weights for policy 1, policy_version 310142 (0.0010) [2023-12-27 21:27:15,586][106225] Updated weights for policy 1, policy_version 310152 (0.0008) [2023-12-27 21:27:15,905][106226] Updated weights for policy 0, policy_version 309536 (0.0009) [2023-12-27 21:27:15,973][106226] Updated weights for policy 0, policy_version 309546 (0.0005) [2023-12-27 21:27:16,040][106226] Updated weights for policy 0, policy_version 309556 (0.0007) [2023-12-27 21:27:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 158695424. Throughput: 0: 9890.5, 1: 9684.5. Samples: 158685044. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:16,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-5.415')] [2023-12-27 21:27:16,221][106225] Updated weights for policy 1, policy_version 310162 (0.0007) [2023-12-27 21:27:16,292][106225] Updated weights for policy 1, policy_version 310172 (0.0005) [2023-12-27 21:27:16,347][106225] Updated weights for policy 1, policy_version 310182 (0.0006) [2023-12-27 21:27:16,400][106225] Updated weights for policy 1, policy_version 310192 (0.0010) [2023-12-27 21:27:16,697][106226] Updated weights for policy 0, policy_version 309566 (0.0010) [2023-12-27 21:27:16,749][106226] Updated weights for policy 0, policy_version 309576 (0.0010) [2023-12-27 21:27:16,806][106226] Updated weights for policy 0, policy_version 309586 (0.0010) [2023-12-27 21:27:16,932][106225] Updated weights for policy 1, policy_version 310202 (0.0005) [2023-12-27 21:27:17,000][106225] Updated weights for policy 1, policy_version 310212 (0.0008) [2023-12-27 21:27:17,065][106225] Updated weights for policy 1, policy_version 310222 (0.0007) [2023-12-27 21:27:17,516][106226] Updated weights for policy 0, policy_version 309596 (0.0008) [2023-12-27 21:27:17,581][106226] Updated weights for policy 0, policy_version 309606 (0.0006) [2023-12-27 21:27:17,637][106226] Updated weights for policy 0, policy_version 309616 (0.0008) [2023-12-27 21:27:17,706][106225] Updated weights for policy 1, policy_version 310232 (0.0010) [2023-12-27 21:27:17,763][106225] Updated weights for policy 1, policy_version 310242 (0.0010) [2023-12-27 21:27:17,814][106225] Updated weights for policy 1, policy_version 310252 (0.0010) [2023-12-27 21:27:18,332][106226] Updated weights for policy 0, policy_version 309626 (0.0010) [2023-12-27 21:27:18,396][106226] Updated weights for policy 0, policy_version 309636 (0.0008) [2023-12-27 21:27:18,460][106226] Updated weights for policy 0, policy_version 309646 (0.0011) [2023-12-27 21:27:18,524][106226] Updated weights for policy 0, policy_version 309656 (0.0010) [2023-12-27 21:27:18,542][106225] Updated weights for policy 1, policy_version 310262 (0.0011) [2023-12-27 21:27:18,600][106225] Updated weights for policy 1, policy_version 310272 (0.0011) [2023-12-27 21:27:18,662][106225] Updated weights for policy 1, policy_version 310282 (0.0010) [2023-12-27 21:27:19,230][106226] Updated weights for policy 0, policy_version 309666 (0.0010) [2023-12-27 21:27:19,293][106226] Updated weights for policy 0, policy_version 309676 (0.0009) [2023-12-27 21:27:19,364][106226] Updated weights for policy 0, policy_version 309686 (0.0008) [2023-12-27 21:27:19,390][106225] Updated weights for policy 1, policy_version 310292 (0.0009) [2023-12-27 21:27:19,455][106225] Updated weights for policy 1, policy_version 310302 (0.0005) [2023-12-27 21:27:19,517][106225] Updated weights for policy 1, policy_version 310312 (0.0008) [2023-12-27 21:27:20,098][106226] Updated weights for policy 0, policy_version 309696 (0.0008) [2023-12-27 21:27:20,162][106226] Updated weights for policy 0, policy_version 309706 (0.0009) [2023-12-27 21:27:20,216][106225] Updated weights for policy 1, policy_version 310322 (0.0007) [2023-12-27 21:27:20,221][106226] Updated weights for policy 0, policy_version 309716 (0.0007) [2023-12-27 21:27:20,284][106225] Updated weights for policy 1, policy_version 310332 (0.0006) [2023-12-27 21:27:20,349][106225] Updated weights for policy 1, policy_version 310342 (0.0011) [2023-12-27 21:27:20,404][106225] Updated weights for policy 1, policy_version 310352 (0.0010) [2023-12-27 21:27:20,894][106226] Updated weights for policy 0, policy_version 309726 (0.0009) [2023-12-27 21:27:20,959][106226] Updated weights for policy 0, policy_version 309736 (0.0011) [2023-12-27 21:27:21,028][106226] Updated weights for policy 0, policy_version 309746 (0.0011) [2023-12-27 21:27:21,141][106225] Updated weights for policy 1, policy_version 310362 (0.0008) [2023-12-27 21:27:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 158793728. Throughput: 0: 9866.9, 1: 9743.0. Samples: 158803964. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:21,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-5.599')] [2023-12-27 21:27:21,209][106225] Updated weights for policy 1, policy_version 310372 (0.0009) [2023-12-27 21:27:21,281][106225] Updated weights for policy 1, policy_version 310382 (0.0006) [2023-12-27 21:27:21,780][106226] Updated weights for policy 0, policy_version 309756 (0.0009) [2023-12-27 21:27:21,834][106226] Updated weights for policy 0, policy_version 309766 (0.0009) [2023-12-27 21:27:21,886][106226] Updated weights for policy 0, policy_version 309776 (0.0011) [2023-12-27 21:27:21,963][106225] Updated weights for policy 1, policy_version 310392 (0.0009) [2023-12-27 21:27:22,019][106225] Updated weights for policy 1, policy_version 310402 (0.0008) [2023-12-27 21:27:22,071][106225] Updated weights for policy 1, policy_version 310412 (0.0008) [2023-12-27 21:27:22,679][106226] Updated weights for policy 0, policy_version 309786 (0.0011) [2023-12-27 21:27:22,737][106226] Updated weights for policy 0, policy_version 309796 (0.0008) [2023-12-27 21:27:22,757][106225] Updated weights for policy 1, policy_version 310422 (0.0008) [2023-12-27 21:27:22,783][106226] Updated weights for policy 0, policy_version 309806 (0.0008) [2023-12-27 21:27:22,802][106225] Updated weights for policy 1, policy_version 310432 (0.0006) [2023-12-27 21:27:22,838][106226] Updated weights for policy 0, policy_version 309816 (0.0008) [2023-12-27 21:27:22,850][106225] Updated weights for policy 1, policy_version 310442 (0.0005) [2023-12-27 21:27:23,534][106225] Updated weights for policy 1, policy_version 310452 (0.0008) [2023-12-27 21:27:23,563][106226] Updated weights for policy 0, policy_version 309826 (0.0009) [2023-12-27 21:27:23,585][106225] Updated weights for policy 1, policy_version 310462 (0.0007) [2023-12-27 21:27:23,621][106226] Updated weights for policy 0, policy_version 309836 (0.0008) [2023-12-27 21:27:23,632][106225] Updated weights for policy 1, policy_version 310472 (0.0006) [2023-12-27 21:27:23,675][106226] Updated weights for policy 0, policy_version 309846 (0.0007) [2023-12-27 21:27:24,333][106226] Updated weights for policy 0, policy_version 309856 (0.0008) [2023-12-27 21:27:24,361][106225] Updated weights for policy 1, policy_version 310482 (0.0006) [2023-12-27 21:27:24,398][106226] Updated weights for policy 0, policy_version 309866 (0.0007) [2023-12-27 21:27:24,424][106225] Updated weights for policy 1, policy_version 310492 (0.0005) [2023-12-27 21:27:24,450][106226] Updated weights for policy 0, policy_version 309876 (0.0005) [2023-12-27 21:27:24,479][106225] Updated weights for policy 1, policy_version 310502 (0.0005) [2023-12-27 21:27:24,533][106225] Updated weights for policy 1, policy_version 310512 (0.0005) [2023-12-27 21:27:25,094][106225] Updated weights for policy 1, policy_version 310522 (0.0005) [2023-12-27 21:27:25,115][106226] Updated weights for policy 0, policy_version 309886 (0.0005) [2023-12-27 21:27:25,142][106225] Updated weights for policy 1, policy_version 310532 (0.0009) [2023-12-27 21:27:25,176][106226] Updated weights for policy 0, policy_version 309896 (0.0005) [2023-12-27 21:27:25,189][106225] Updated weights for policy 1, policy_version 310542 (0.0008) [2023-12-27 21:27:25,237][106226] Updated weights for policy 0, policy_version 309906 (0.0005) [2023-12-27 21:27:25,738][106226] Updated weights for policy 0, policy_version 309916 (0.0007) [2023-12-27 21:27:25,792][106226] Updated weights for policy 0, policy_version 309926 (0.0009) [2023-12-27 21:27:25,848][106225] Updated weights for policy 1, policy_version 310552 (0.0006) [2023-12-27 21:27:25,852][106226] Updated weights for policy 0, policy_version 309936 (0.0008) [2023-12-27 21:27:25,905][106225] Updated weights for policy 1, policy_version 310562 (0.0006) [2023-12-27 21:27:25,961][106225] Updated weights for policy 1, policy_version 310572 (0.0006) [2023-12-27 21:27:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 158900224. Throughput: 0: 9846.6, 1: 9707.2. Samples: 158861968. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:26,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.631')] [2023-12-27 21:27:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000310576_79527936.pth... [2023-12-27 21:27:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000309944_79372288.pth... [2023-12-27 21:27:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000309392_79224832.pth [2023-12-27 21:27:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000308792_79077376.pth [2023-12-27 21:27:26,458][106226] Updated weights for policy 0, policy_version 309946 (0.0007) [2023-12-27 21:27:26,512][106226] Updated weights for policy 0, policy_version 309956 (0.0005) [2023-12-27 21:27:26,567][106226] Updated weights for policy 0, policy_version 309966 (0.0006) [2023-12-27 21:27:26,618][106226] Updated weights for policy 0, policy_version 309976 (0.0008) [2023-12-27 21:27:26,726][106225] Updated weights for policy 1, policy_version 310582 (0.0008) [2023-12-27 21:27:26,785][106225] Updated weights for policy 1, policy_version 310592 (0.0010) [2023-12-27 21:27:26,844][106225] Updated weights for policy 1, policy_version 310602 (0.0010) [2023-12-27 21:27:27,254][106226] Updated weights for policy 0, policy_version 309986 (0.0010) [2023-12-27 21:27:27,309][106226] Updated weights for policy 0, policy_version 309996 (0.0010) [2023-12-27 21:27:27,369][106226] Updated weights for policy 0, policy_version 310006 (0.0010) [2023-12-27 21:27:27,460][106225] Updated weights for policy 1, policy_version 310612 (0.0008) [2023-12-27 21:27:27,514][106225] Updated weights for policy 1, policy_version 310622 (0.0005) [2023-12-27 21:27:27,570][106225] Updated weights for policy 1, policy_version 310632 (0.0010) [2023-12-27 21:27:28,053][106226] Updated weights for policy 0, policy_version 310016 (0.0010) [2023-12-27 21:27:28,106][106226] Updated weights for policy 0, policy_version 310026 (0.0011) [2023-12-27 21:27:28,145][106225] Updated weights for policy 1, policy_version 310642 (0.0009) [2023-12-27 21:27:28,159][106226] Updated weights for policy 0, policy_version 310036 (0.0010) [2023-12-27 21:27:28,199][106225] Updated weights for policy 1, policy_version 310652 (0.0006) [2023-12-27 21:27:28,247][106225] Updated weights for policy 1, policy_version 310662 (0.0008) [2023-12-27 21:27:28,296][106225] Updated weights for policy 1, policy_version 310672 (0.0007) [2023-12-27 21:27:28,878][106226] Updated weights for policy 0, policy_version 310046 (0.0011) [2023-12-27 21:27:28,942][106226] Updated weights for policy 0, policy_version 310056 (0.0010) [2023-12-27 21:27:28,997][106226] Updated weights for policy 0, policy_version 310066 (0.0005) [2023-12-27 21:27:29,044][106225] Updated weights for policy 1, policy_version 310682 (0.0009) [2023-12-27 21:27:29,097][106225] Updated weights for policy 1, policy_version 310692 (0.0008) [2023-12-27 21:27:29,153][106225] Updated weights for policy 1, policy_version 310702 (0.0006) [2023-12-27 21:27:29,656][106226] Updated weights for policy 0, policy_version 310076 (0.0005) [2023-12-27 21:27:29,719][106226] Updated weights for policy 0, policy_version 310086 (0.0007) [2023-12-27 21:27:29,778][106226] Updated weights for policy 0, policy_version 310096 (0.0008) [2023-12-27 21:27:29,884][106225] Updated weights for policy 1, policy_version 310712 (0.0008) [2023-12-27 21:27:29,950][106225] Updated weights for policy 1, policy_version 310722 (0.0009) [2023-12-27 21:27:30,012][106225] Updated weights for policy 1, policy_version 310732 (0.0008) [2023-12-27 21:27:30,547][106226] Updated weights for policy 0, policy_version 310106 (0.0007) [2023-12-27 21:27:30,575][106225] Updated weights for policy 1, policy_version 310742 (0.0007) [2023-12-27 21:27:30,601][106226] Updated weights for policy 0, policy_version 310116 (0.0008) [2023-12-27 21:27:30,632][106225] Updated weights for policy 1, policy_version 310752 (0.0005) [2023-12-27 21:27:30,654][106226] Updated weights for policy 0, policy_version 310126 (0.0006) [2023-12-27 21:27:30,687][106225] Updated weights for policy 1, policy_version 310762 (0.0007) [2023-12-27 21:27:30,715][106226] Updated weights for policy 0, policy_version 310136 (0.0008) [2023-12-27 21:27:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 158998528. Throughput: 0: 9956.3, 1: 9866.0. Samples: 158988144. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:31,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.478')] [2023-12-27 21:27:31,358][106225] Updated weights for policy 1, policy_version 310772 (0.0008) [2023-12-27 21:27:31,431][106225] Updated weights for policy 1, policy_version 310782 (0.0008) [2023-12-27 21:27:31,475][106225] Updated weights for policy 1, policy_version 310792 (0.0007) [2023-12-27 21:27:31,481][106226] Updated weights for policy 0, policy_version 310146 (0.0007) [2023-12-27 21:27:31,540][106226] Updated weights for policy 0, policy_version 310156 (0.0008) [2023-12-27 21:27:31,603][106226] Updated weights for policy 0, policy_version 310166 (0.0009) [2023-12-27 21:27:32,207][106225] Updated weights for policy 1, policy_version 310802 (0.0006) [2023-12-27 21:27:32,264][106225] Updated weights for policy 1, policy_version 310812 (0.0007) [2023-12-27 21:27:32,332][106225] Updated weights for policy 1, policy_version 310822 (0.0007) [2023-12-27 21:27:32,352][106226] Updated weights for policy 0, policy_version 310176 (0.0010) [2023-12-27 21:27:32,386][106225] Updated weights for policy 1, policy_version 310832 (0.0010) [2023-12-27 21:27:32,416][106226] Updated weights for policy 0, policy_version 310186 (0.0011) [2023-12-27 21:27:32,477][106226] Updated weights for policy 0, policy_version 310196 (0.0011) [2023-12-27 21:27:33,110][106226] Updated weights for policy 0, policy_version 310206 (0.0010) [2023-12-27 21:27:33,127][106225] Updated weights for policy 1, policy_version 310842 (0.0007) [2023-12-27 21:27:33,159][106226] Updated weights for policy 0, policy_version 310216 (0.0010) [2023-12-27 21:27:33,186][106225] Updated weights for policy 1, policy_version 310852 (0.0005) [2023-12-27 21:27:33,205][106226] Updated weights for policy 0, policy_version 310226 (0.0010) [2023-12-27 21:27:33,240][106225] Updated weights for policy 1, policy_version 310862 (0.0005) [2023-12-27 21:27:33,786][106225] Updated weights for policy 1, policy_version 310872 (0.0005) [2023-12-27 21:27:33,833][106225] Updated weights for policy 1, policy_version 310882 (0.0007) [2023-12-27 21:27:33,882][106225] Updated weights for policy 1, policy_version 310892 (0.0007) [2023-12-27 21:27:33,932][106226] Updated weights for policy 0, policy_version 310236 (0.0010) [2023-12-27 21:27:33,984][106226] Updated weights for policy 0, policy_version 310246 (0.0010) [2023-12-27 21:27:34,028][106226] Updated weights for policy 0, policy_version 310256 (0.0010) [2023-12-27 21:27:34,689][106226] Updated weights for policy 0, policy_version 310266 (0.0009) [2023-12-27 21:27:34,703][106225] Updated weights for policy 1, policy_version 310902 (0.0008) [2023-12-27 21:27:34,751][106226] Updated weights for policy 0, policy_version 310276 (0.0007) [2023-12-27 21:27:34,754][106225] Updated weights for policy 1, policy_version 310912 (0.0008) [2023-12-27 21:27:34,802][106226] Updated weights for policy 0, policy_version 310286 (0.0011) [2023-12-27 21:27:34,811][106225] Updated weights for policy 1, policy_version 310922 (0.0007) [2023-12-27 21:27:34,870][106226] Updated weights for policy 0, policy_version 310296 (0.0011) [2023-12-27 21:27:35,442][106226] Updated weights for policy 0, policy_version 310306 (0.0005) [2023-12-27 21:27:35,499][106226] Updated weights for policy 0, policy_version 310316 (0.0005) [2023-12-27 21:27:35,549][106226] Updated weights for policy 0, policy_version 310326 (0.0005) [2023-12-27 21:27:35,580][106225] Updated weights for policy 1, policy_version 310932 (0.0007) [2023-12-27 21:27:35,635][106225] Updated weights for policy 1, policy_version 310942 (0.0008) [2023-12-27 21:27:35,682][106225] Updated weights for policy 1, policy_version 310952 (0.0008) [2023-12-27 21:27:36,143][106226] Updated weights for policy 0, policy_version 310336 (0.0007) [2023-12-27 21:27:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 159096832. Throughput: 0: 9975.7, 1: 9976.9. Samples: 159109304. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:36,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.797')] [2023-12-27 21:27:36,209][106226] Updated weights for policy 0, policy_version 310346 (0.0008) [2023-12-27 21:27:36,271][106226] Updated weights for policy 0, policy_version 310356 (0.0008) [2023-12-27 21:27:36,506][106225] Updated weights for policy 1, policy_version 310962 (0.0009) [2023-12-27 21:27:36,563][106225] Updated weights for policy 1, policy_version 310972 (0.0009) [2023-12-27 21:27:36,629][106225] Updated weights for policy 1, policy_version 310982 (0.0008) [2023-12-27 21:27:36,686][106225] Updated weights for policy 1, policy_version 310992 (0.0006) [2023-12-27 21:27:36,996][106226] Updated weights for policy 0, policy_version 310366 (0.0007) [2023-12-27 21:27:37,045][106226] Updated weights for policy 0, policy_version 310376 (0.0005) [2023-12-27 21:27:37,095][106226] Updated weights for policy 0, policy_version 310386 (0.0005) [2023-12-27 21:27:37,352][106225] Updated weights for policy 1, policy_version 311002 (0.0009) [2023-12-27 21:27:37,407][106225] Updated weights for policy 1, policy_version 311012 (0.0008) [2023-12-27 21:27:37,461][106225] Updated weights for policy 1, policy_version 311022 (0.0005) [2023-12-27 21:27:37,790][106226] Updated weights for policy 0, policy_version 310396 (0.0007) [2023-12-27 21:27:37,845][106226] Updated weights for policy 0, policy_version 310406 (0.0008) [2023-12-27 21:27:37,898][106226] Updated weights for policy 0, policy_version 310416 (0.0008) [2023-12-27 21:27:38,101][106225] Updated weights for policy 1, policy_version 311032 (0.0006) [2023-12-27 21:27:38,159][106225] Updated weights for policy 1, policy_version 311042 (0.0008) [2023-12-27 21:27:38,216][106225] Updated weights for policy 1, policy_version 311052 (0.0008) [2023-12-27 21:27:38,670][106226] Updated weights for policy 0, policy_version 310426 (0.0008) [2023-12-27 21:27:38,732][106226] Updated weights for policy 0, policy_version 310436 (0.0008) [2023-12-27 21:27:38,795][106226] Updated weights for policy 0, policy_version 310446 (0.0009) [2023-12-27 21:27:38,862][106226] Updated weights for policy 0, policy_version 310456 (0.0009) [2023-12-27 21:27:38,939][106225] Updated weights for policy 1, policy_version 311062 (0.0009) [2023-12-27 21:27:38,988][106225] Updated weights for policy 1, policy_version 311072 (0.0008) [2023-12-27 21:27:39,037][106225] Updated weights for policy 1, policy_version 311082 (0.0009) [2023-12-27 21:27:39,622][106226] Updated weights for policy 0, policy_version 310466 (0.0009) [2023-12-27 21:27:39,684][106226] Updated weights for policy 0, policy_version 310476 (0.0009) [2023-12-27 21:27:39,752][106226] Updated weights for policy 0, policy_version 310486 (0.0009) [2023-12-27 21:27:39,789][106225] Updated weights for policy 1, policy_version 311092 (0.0009) [2023-12-27 21:27:39,860][106225] Updated weights for policy 1, policy_version 311102 (0.0008) [2023-12-27 21:27:39,934][106225] Updated weights for policy 1, policy_version 311112 (0.0007) [2023-12-27 21:27:40,520][106226] Updated weights for policy 0, policy_version 310496 (0.0009) [2023-12-27 21:27:40,578][106226] Updated weights for policy 0, policy_version 310506 (0.0008) [2023-12-27 21:27:40,586][106225] Updated weights for policy 1, policy_version 311122 (0.0007) [2023-12-27 21:27:40,641][106225] Updated weights for policy 1, policy_version 311132 (0.0009) [2023-12-27 21:27:40,644][106226] Updated weights for policy 0, policy_version 310516 (0.0007) [2023-12-27 21:27:40,696][106225] Updated weights for policy 1, policy_version 311142 (0.0007) [2023-12-27 21:27:40,758][106225] Updated weights for policy 1, policy_version 311152 (0.0006) [2023-12-27 21:27:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 159195136. Throughput: 0: 9928.4, 1: 9990.9. Samples: 159167968. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:41,176][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.546')] [2023-12-27 21:27:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000310520_79519744.pth... [2023-12-27 21:27:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000311152_79675392.pth... [2023-12-27 21:27:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000309968_79372288.pth [2023-12-27 21:27:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000309368_79224832.pth [2023-12-27 21:27:41,306][106226] Updated weights for policy 0, policy_version 310526 (0.0008) [2023-12-27 21:27:41,382][106226] Updated weights for policy 0, policy_version 310536 (0.0009) [2023-12-27 21:27:41,447][106226] Updated weights for policy 0, policy_version 310546 (0.0009) [2023-12-27 21:27:41,467][106225] Updated weights for policy 1, policy_version 311162 (0.0009) [2023-12-27 21:27:41,522][106225] Updated weights for policy 1, policy_version 311172 (0.0009) [2023-12-27 21:27:41,582][106225] Updated weights for policy 1, policy_version 311182 (0.0007) [2023-12-27 21:27:42,236][106226] Updated weights for policy 0, policy_version 310556 (0.0008) [2023-12-27 21:27:42,298][106226] Updated weights for policy 0, policy_version 310566 (0.0008) [2023-12-27 21:27:42,361][106226] Updated weights for policy 0, policy_version 310576 (0.0008) [2023-12-27 21:27:42,402][106225] Updated weights for policy 1, policy_version 311192 (0.0008) [2023-12-27 21:27:42,460][106225] Updated weights for policy 1, policy_version 311202 (0.0008) [2023-12-27 21:27:42,519][106225] Updated weights for policy 1, policy_version 311212 (0.0009) [2023-12-27 21:27:43,092][106226] Updated weights for policy 0, policy_version 310586 (0.0009) [2023-12-27 21:27:43,147][106226] Updated weights for policy 0, policy_version 310596 (0.0009) [2023-12-27 21:27:43,212][106226] Updated weights for policy 0, policy_version 310606 (0.0006) [2023-12-27 21:27:43,240][106225] Updated weights for policy 1, policy_version 311222 (0.0008) [2023-12-27 21:27:43,270][106226] Updated weights for policy 0, policy_version 310616 (0.0006) [2023-12-27 21:27:43,289][106225] Updated weights for policy 1, policy_version 311232 (0.0008) [2023-12-27 21:27:43,350][106225] Updated weights for policy 1, policy_version 311242 (0.0006) [2023-12-27 21:27:43,901][106225] Updated weights for policy 1, policy_version 311252 (0.0005) [2023-12-27 21:27:43,961][106226] Updated weights for policy 0, policy_version 310626 (0.0007) [2023-12-27 21:27:43,962][106225] Updated weights for policy 1, policy_version 311262 (0.0005) [2023-12-27 21:27:44,015][106226] Updated weights for policy 0, policy_version 310636 (0.0005) [2023-12-27 21:27:44,020][106225] Updated weights for policy 1, policy_version 311272 (0.0005) [2023-12-27 21:27:44,067][106226] Updated weights for policy 0, policy_version 310646 (0.0006) [2023-12-27 21:27:44,670][106225] Updated weights for policy 1, policy_version 311282 (0.0006) [2023-12-27 21:27:44,718][106225] Updated weights for policy 1, policy_version 311292 (0.0008) [2023-12-27 21:27:44,762][106226] Updated weights for policy 0, policy_version 310656 (0.0009) [2023-12-27 21:27:44,779][106225] Updated weights for policy 1, policy_version 311302 (0.0008) [2023-12-27 21:27:44,821][106226] Updated weights for policy 0, policy_version 310666 (0.0007) [2023-12-27 21:27:44,835][106225] Updated weights for policy 1, policy_version 311312 (0.0008) [2023-12-27 21:27:44,884][106226] Updated weights for policy 0, policy_version 310676 (0.0008) [2023-12-27 21:27:45,593][106225] Updated weights for policy 1, policy_version 311322 (0.0008) [2023-12-27 21:27:45,643][106225] Updated weights for policy 1, policy_version 311332 (0.0007) [2023-12-27 21:27:45,651][106226] Updated weights for policy 0, policy_version 310686 (0.0008) [2023-12-27 21:27:45,698][106225] Updated weights for policy 1, policy_version 311342 (0.0008) [2023-12-27 21:27:45,708][106226] Updated weights for policy 0, policy_version 310696 (0.0006) [2023-12-27 21:27:45,761][106226] Updated weights for policy 0, policy_version 310706 (0.0008) [2023-12-27 21:27:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 159293440. Throughput: 0: 9923.9, 1: 10028.0. Samples: 159284896. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:46,176][105115] Avg episode reward: [(0, '-4.628'), (1, '-5.322')] [2023-12-27 21:27:46,373][106226] Updated weights for policy 0, policy_version 310716 (0.0007) [2023-12-27 21:27:46,403][106225] Updated weights for policy 1, policy_version 311352 (0.0008) [2023-12-27 21:27:46,436][106226] Updated weights for policy 0, policy_version 310726 (0.0006) [2023-12-27 21:27:46,457][106225] Updated weights for policy 1, policy_version 311362 (0.0009) [2023-12-27 21:27:46,497][106226] Updated weights for policy 0, policy_version 310736 (0.0005) [2023-12-27 21:27:46,506][106225] Updated weights for policy 1, policy_version 311372 (0.0009) [2023-12-27 21:27:47,047][106226] Updated weights for policy 0, policy_version 310746 (0.0006) [2023-12-27 21:27:47,095][106225] Updated weights for policy 1, policy_version 311382 (0.0006) [2023-12-27 21:27:47,110][106226] Updated weights for policy 0, policy_version 310756 (0.0011) [2023-12-27 21:27:47,165][106225] Updated weights for policy 1, policy_version 311392 (0.0008) [2023-12-27 21:27:47,170][106226] Updated weights for policy 0, policy_version 310766 (0.0010) [2023-12-27 21:27:47,219][106225] Updated weights for policy 1, policy_version 311402 (0.0006) [2023-12-27 21:27:47,227][106226] Updated weights for policy 0, policy_version 310776 (0.0011) [2023-12-27 21:27:47,901][106225] Updated weights for policy 1, policy_version 311412 (0.0007) [2023-12-27 21:27:47,907][106226] Updated weights for policy 0, policy_version 310786 (0.0008) [2023-12-27 21:27:47,955][106225] Updated weights for policy 1, policy_version 311422 (0.0008) [2023-12-27 21:27:47,963][106226] Updated weights for policy 0, policy_version 310796 (0.0011) [2023-12-27 21:27:48,019][106225] Updated weights for policy 1, policy_version 311432 (0.0009) [2023-12-27 21:27:48,023][106226] Updated weights for policy 0, policy_version 310806 (0.0008) [2023-12-27 21:27:48,668][106225] Updated weights for policy 1, policy_version 311442 (0.0007) [2023-12-27 21:27:48,703][106226] Updated weights for policy 0, policy_version 310816 (0.0011) [2023-12-27 21:27:48,725][106225] Updated weights for policy 1, policy_version 311452 (0.0006) [2023-12-27 21:27:48,765][106226] Updated weights for policy 0, policy_version 310826 (0.0011) [2023-12-27 21:27:48,783][106225] Updated weights for policy 1, policy_version 311462 (0.0010) [2023-12-27 21:27:48,817][106226] Updated weights for policy 0, policy_version 310836 (0.0008) [2023-12-27 21:27:48,841][106225] Updated weights for policy 1, policy_version 311472 (0.0010) [2023-12-27 21:27:49,559][106226] Updated weights for policy 0, policy_version 310846 (0.0007) [2023-12-27 21:27:49,571][106225] Updated weights for policy 1, policy_version 311482 (0.0007) [2023-12-27 21:27:49,627][106226] Updated weights for policy 0, policy_version 310856 (0.0008) [2023-12-27 21:27:49,629][106225] Updated weights for policy 1, policy_version 311492 (0.0008) [2023-12-27 21:27:49,686][106225] Updated weights for policy 1, policy_version 311502 (0.0008) [2023-12-27 21:27:49,693][106226] Updated weights for policy 0, policy_version 310866 (0.0005) [2023-12-27 21:27:50,347][106226] Updated weights for policy 0, policy_version 310876 (0.0008) [2023-12-27 21:27:50,406][106226] Updated weights for policy 0, policy_version 310886 (0.0008) [2023-12-27 21:27:50,436][106225] Updated weights for policy 1, policy_version 311512 (0.0010) [2023-12-27 21:27:50,462][106226] Updated weights for policy 0, policy_version 310896 (0.0007) [2023-12-27 21:27:50,504][106225] Updated weights for policy 1, policy_version 311522 (0.0010) [2023-12-27 21:27:50,575][106225] Updated weights for policy 1, policy_version 311532 (0.0010) [2023-12-27 21:27:51,175][106226] Updated weights for policy 0, policy_version 310906 (0.0007) [2023-12-27 21:27:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 159391744. Throughput: 0: 9982.7, 1: 10059.5. Samples: 159406612. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:51,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.706')] [2023-12-27 21:27:51,211][106225] Updated weights for policy 1, policy_version 311542 (0.0010) [2023-12-27 21:27:51,236][106226] Updated weights for policy 0, policy_version 310916 (0.0008) [2023-12-27 21:27:51,276][106225] Updated weights for policy 1, policy_version 311552 (0.0011) [2023-12-27 21:27:51,297][106226] Updated weights for policy 0, policy_version 310926 (0.0006) [2023-12-27 21:27:51,337][106225] Updated weights for policy 1, policy_version 311562 (0.0010) [2023-12-27 21:27:51,361][106226] Updated weights for policy 0, policy_version 310936 (0.0006) [2023-12-27 21:27:52,081][106225] Updated weights for policy 1, policy_version 311572 (0.0012) [2023-12-27 21:27:52,141][106225] Updated weights for policy 1, policy_version 311582 (0.0010) [2023-12-27 21:27:52,141][106226] Updated weights for policy 0, policy_version 310946 (0.0009) [2023-12-27 21:27:52,201][106226] Updated weights for policy 0, policy_version 310956 (0.0008) [2023-12-27 21:27:52,203][106225] Updated weights for policy 1, policy_version 311592 (0.0010) [2023-12-27 21:27:52,259][106226] Updated weights for policy 0, policy_version 310966 (0.0006) [2023-12-27 21:27:52,928][106225] Updated weights for policy 1, policy_version 311602 (0.0010) [2023-12-27 21:27:52,981][106225] Updated weights for policy 1, policy_version 311612 (0.0010) [2023-12-27 21:27:53,015][106226] Updated weights for policy 0, policy_version 310976 (0.0008) [2023-12-27 21:27:53,032][106225] Updated weights for policy 1, policy_version 311622 (0.0010) [2023-12-27 21:27:53,065][106226] Updated weights for policy 0, policy_version 310986 (0.0006) [2023-12-27 21:27:53,085][106225] Updated weights for policy 1, policy_version 311632 (0.0010) [2023-12-27 21:27:53,124][106226] Updated weights for policy 0, policy_version 310996 (0.0007) [2023-12-27 21:27:53,813][106226] Updated weights for policy 0, policy_version 311006 (0.0009) [2023-12-27 21:27:53,819][106225] Updated weights for policy 1, policy_version 311642 (0.0005) [2023-12-27 21:27:53,871][106225] Updated weights for policy 1, policy_version 311652 (0.0005) [2023-12-27 21:27:53,873][106226] Updated weights for policy 0, policy_version 311016 (0.0010) [2023-12-27 21:27:53,927][106225] Updated weights for policy 1, policy_version 311662 (0.0005) [2023-12-27 21:27:53,933][106226] Updated weights for policy 0, policy_version 311026 (0.0011) [2023-12-27 21:27:54,510][106226] Updated weights for policy 0, policy_version 311036 (0.0010) [2023-12-27 21:27:54,567][106226] Updated weights for policy 0, policy_version 311046 (0.0010) [2023-12-27 21:27:54,598][106225] Updated weights for policy 1, policy_version 311672 (0.0007) [2023-12-27 21:27:54,628][106226] Updated weights for policy 0, policy_version 311056 (0.0010) [2023-12-27 21:27:54,664][106225] Updated weights for policy 1, policy_version 311682 (0.0007) [2023-12-27 21:27:54,710][106225] Updated weights for policy 1, policy_version 311692 (0.0007) [2023-12-27 21:27:55,234][106226] Updated weights for policy 0, policy_version 311066 (0.0010) [2023-12-27 21:27:55,296][106226] Updated weights for policy 0, policy_version 311076 (0.0010) [2023-12-27 21:27:55,355][106226] Updated weights for policy 0, policy_version 311086 (0.0010) [2023-12-27 21:27:55,414][106226] Updated weights for policy 0, policy_version 311096 (0.0010) [2023-12-27 21:27:55,421][106225] Updated weights for policy 1, policy_version 311702 (0.0009) [2023-12-27 21:27:55,484][106225] Updated weights for policy 1, policy_version 311712 (0.0010) [2023-12-27 21:27:55,541][106225] Updated weights for policy 1, policy_version 311722 (0.0010) [2023-12-27 21:27:56,092][106226] Updated weights for policy 0, policy_version 311106 (0.0009) [2023-12-27 21:27:56,149][106226] Updated weights for policy 0, policy_version 311116 (0.0009) [2023-12-27 21:27:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19688.5). Total num frames: 159490048. Throughput: 0: 9957.2, 1: 10039.5. Samples: 159464052. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:27:56,176][105115] Avg episode reward: [(0, '-4.535'), (1, '-5.497')] [2023-12-27 21:27:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000311728_79822848.pth... [2023-12-27 21:27:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000310576_79527936.pth [2023-12-27 21:27:56,212][106226] Updated weights for policy 0, policy_version 311126 (0.0010) [2023-12-27 21:27:56,222][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000311128_79675392.pth... [2023-12-27 21:27:56,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000309944_79372288.pth [2023-12-27 21:27:56,250][106225] Updated weights for policy 1, policy_version 311732 (0.0010) [2023-12-27 21:27:56,300][106225] Updated weights for policy 1, policy_version 311742 (0.0010) [2023-12-27 21:27:56,349][106225] Updated weights for policy 1, policy_version 311752 (0.0010) [2023-12-27 21:27:56,779][106226] Updated weights for policy 0, policy_version 311136 (0.0006) [2023-12-27 21:27:56,833][106226] Updated weights for policy 0, policy_version 311146 (0.0007) [2023-12-27 21:27:56,899][106226] Updated weights for policy 0, policy_version 311156 (0.0005) [2023-12-27 21:27:57,078][106225] Updated weights for policy 1, policy_version 311762 (0.0010) [2023-12-27 21:27:57,131][106225] Updated weights for policy 1, policy_version 311772 (0.0010) [2023-12-27 21:27:57,186][106225] Updated weights for policy 1, policy_version 311782 (0.0010) [2023-12-27 21:27:57,242][106225] Updated weights for policy 1, policy_version 311792 (0.0010) [2023-12-27 21:27:57,544][106226] Updated weights for policy 0, policy_version 311166 (0.0009) [2023-12-27 21:27:57,602][106226] Updated weights for policy 0, policy_version 311176 (0.0009) [2023-12-27 21:27:57,659][106226] Updated weights for policy 0, policy_version 311186 (0.0007) [2023-12-27 21:27:57,967][106225] Updated weights for policy 1, policy_version 311802 (0.0010) [2023-12-27 21:27:58,013][106225] Updated weights for policy 1, policy_version 311812 (0.0010) [2023-12-27 21:27:58,072][106225] Updated weights for policy 1, policy_version 311822 (0.0010) [2023-12-27 21:27:58,251][106226] Updated weights for policy 0, policy_version 311196 (0.0007) [2023-12-27 21:27:58,314][106226] Updated weights for policy 0, policy_version 311206 (0.0008) [2023-12-27 21:27:58,388][106226] Updated weights for policy 0, policy_version 311216 (0.0009) [2023-12-27 21:27:58,884][106225] Updated weights for policy 1, policy_version 311832 (0.0007) [2023-12-27 21:27:58,955][106225] Updated weights for policy 1, policy_version 311842 (0.0007) [2023-12-27 21:27:59,023][106225] Updated weights for policy 1, policy_version 311852 (0.0006) [2023-12-27 21:27:59,308][106226] Updated weights for policy 0, policy_version 311226 (0.0010) [2023-12-27 21:27:59,375][106226] Updated weights for policy 0, policy_version 311236 (0.0009) [2023-12-27 21:27:59,436][106226] Updated weights for policy 0, policy_version 311246 (0.0006) [2023-12-27 21:27:59,491][106226] Updated weights for policy 0, policy_version 311256 (0.0005) [2023-12-27 21:27:59,775][106225] Updated weights for policy 1, policy_version 311862 (0.0007) [2023-12-27 21:27:59,835][106225] Updated weights for policy 1, policy_version 311872 (0.0009) [2023-12-27 21:27:59,900][106225] Updated weights for policy 1, policy_version 311882 (0.0007) [2023-12-27 21:28:00,184][106226] Updated weights for policy 0, policy_version 311266 (0.0008) [2023-12-27 21:28:00,238][106226] Updated weights for policy 0, policy_version 311276 (0.0009) [2023-12-27 21:28:00,294][106226] Updated weights for policy 0, policy_version 311286 (0.0009) [2023-12-27 21:28:00,627][106225] Updated weights for policy 1, policy_version 311892 (0.0008) [2023-12-27 21:28:00,680][106225] Updated weights for policy 1, policy_version 311902 (0.0010) [2023-12-27 21:28:00,728][106225] Updated weights for policy 1, policy_version 311912 (0.0008) [2023-12-27 21:28:00,993][106226] Updated weights for policy 0, policy_version 311296 (0.0009) [2023-12-27 21:28:01,053][106226] Updated weights for policy 0, policy_version 311306 (0.0008) [2023-12-27 21:28:01,138][106226] Updated weights for policy 0, policy_version 311316 (0.0009) [2023-12-27 21:28:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 159596544. Throughput: 0: 9992.3, 1: 9978.9. Samples: 159583748. Policy #0 lag: (min: 10.0, avg: 26.6, max: 42.0) [2023-12-27 21:28:01,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-5.617')] [2023-12-27 21:28:01,475][106225] Updated weights for policy 1, policy_version 311922 (0.0009) [2023-12-27 21:28:01,528][106225] Updated weights for policy 1, policy_version 311932 (0.0010) [2023-12-27 21:28:01,586][106225] Updated weights for policy 1, policy_version 311942 (0.0010) [2023-12-27 21:28:01,647][106225] Updated weights for policy 1, policy_version 311952 (0.0010) [2023-12-27 21:28:01,886][106226] Updated weights for policy 0, policy_version 311326 (0.0009) [2023-12-27 21:28:01,942][106226] Updated weights for policy 0, policy_version 311336 (0.0007) [2023-12-27 21:28:02,004][106226] Updated weights for policy 0, policy_version 311346 (0.0006) [2023-12-27 21:28:02,342][106225] Updated weights for policy 1, policy_version 311962 (0.0010) [2023-12-27 21:28:02,415][106225] Updated weights for policy 1, policy_version 311972 (0.0011) [2023-12-27 21:28:02,475][106225] Updated weights for policy 1, policy_version 311982 (0.0010) [2023-12-27 21:28:02,664][106226] Updated weights for policy 0, policy_version 311356 (0.0005) [2023-12-27 21:28:02,724][106226] Updated weights for policy 0, policy_version 311366 (0.0007) [2023-12-27 21:28:02,775][106226] Updated weights for policy 0, policy_version 311376 (0.0006) [2023-12-27 21:28:03,172][106225] Updated weights for policy 1, policy_version 311992 (0.0010) [2023-12-27 21:28:03,233][106225] Updated weights for policy 1, policy_version 312002 (0.0008) [2023-12-27 21:28:03,292][106225] Updated weights for policy 1, policy_version 312012 (0.0008) [2023-12-27 21:28:03,494][106226] Updated weights for policy 0, policy_version 311386 (0.0007) [2023-12-27 21:28:03,554][106226] Updated weights for policy 0, policy_version 311396 (0.0008) [2023-12-27 21:28:03,621][106226] Updated weights for policy 0, policy_version 311406 (0.0008) [2023-12-27 21:28:03,675][106226] Updated weights for policy 0, policy_version 311416 (0.0008) [2023-12-27 21:28:03,944][106225] Updated weights for policy 1, policy_version 312022 (0.0008) [2023-12-27 21:28:03,995][106225] Updated weights for policy 1, policy_version 312032 (0.0009) [2023-12-27 21:28:04,044][106225] Updated weights for policy 1, policy_version 312042 (0.0007) [2023-12-27 21:28:04,400][106226] Updated weights for policy 0, policy_version 311426 (0.0011) [2023-12-27 21:28:04,453][106226] Updated weights for policy 0, policy_version 311436 (0.0010) [2023-12-27 21:28:04,511][106226] Updated weights for policy 0, policy_version 311446 (0.0005) [2023-12-27 21:28:04,718][106225] Updated weights for policy 1, policy_version 312052 (0.0010) [2023-12-27 21:28:04,778][106225] Updated weights for policy 1, policy_version 312062 (0.0010) [2023-12-27 21:28:04,835][106225] Updated weights for policy 1, policy_version 312072 (0.0009) [2023-12-27 21:28:05,101][106226] Updated weights for policy 0, policy_version 311456 (0.0005) [2023-12-27 21:28:05,164][106226] Updated weights for policy 0, policy_version 311466 (0.0008) [2023-12-27 21:28:05,230][106226] Updated weights for policy 0, policy_version 311476 (0.0010) [2023-12-27 21:28:05,439][106225] Updated weights for policy 1, policy_version 312082 (0.0008) [2023-12-27 21:28:05,487][106225] Updated weights for policy 1, policy_version 312092 (0.0006) [2023-12-27 21:28:05,533][106225] Updated weights for policy 1, policy_version 312102 (0.0007) [2023-12-27 21:28:05,583][106225] Updated weights for policy 1, policy_version 312112 (0.0008) [2023-12-27 21:28:05,811][106226] Updated weights for policy 0, policy_version 311486 (0.0008) [2023-12-27 21:28:05,872][106226] Updated weights for policy 0, policy_version 311496 (0.0007) [2023-12-27 21:28:05,935][106226] Updated weights for policy 0, policy_version 311506 (0.0005) [2023-12-27 21:28:06,175][105115] Fps is (10 sec: 20480.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 159694848. Throughput: 0: 10041.4, 1: 9968.3. Samples: 159704404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:06,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.623')] [2023-12-27 21:28:06,359][106225] Updated weights for policy 1, policy_version 312122 (0.0008) [2023-12-27 21:28:06,425][106225] Updated weights for policy 1, policy_version 312132 (0.0009) [2023-12-27 21:28:06,495][106225] Updated weights for policy 1, policy_version 312142 (0.0010) [2023-12-27 21:28:06,550][106226] Updated weights for policy 0, policy_version 311516 (0.0006) [2023-12-27 21:28:06,619][106226] Updated weights for policy 0, policy_version 311526 (0.0009) [2023-12-27 21:28:06,693][106226] Updated weights for policy 0, policy_version 311536 (0.0009) [2023-12-27 21:28:07,236][106225] Updated weights for policy 1, policy_version 312152 (0.0009) [2023-12-27 21:28:07,298][106225] Updated weights for policy 1, policy_version 312162 (0.0008) [2023-12-27 21:28:07,346][106226] Updated weights for policy 0, policy_version 311546 (0.0007) [2023-12-27 21:28:07,360][106225] Updated weights for policy 1, policy_version 312172 (0.0008) [2023-12-27 21:28:07,410][106226] Updated weights for policy 0, policy_version 311556 (0.0007) [2023-12-27 21:28:07,477][106226] Updated weights for policy 0, policy_version 311566 (0.0005) [2023-12-27 21:28:07,544][106226] Updated weights for policy 0, policy_version 311576 (0.0005) [2023-12-27 21:28:08,130][106225] Updated weights for policy 1, policy_version 312182 (0.0008) [2023-12-27 21:28:08,135][106226] Updated weights for policy 0, policy_version 311586 (0.0007) [2023-12-27 21:28:08,192][106225] Updated weights for policy 1, policy_version 312192 (0.0007) [2023-12-27 21:28:08,195][106226] Updated weights for policy 0, policy_version 311596 (0.0007) [2023-12-27 21:28:08,258][106225] Updated weights for policy 1, policy_version 312202 (0.0009) [2023-12-27 21:28:08,258][106226] Updated weights for policy 0, policy_version 311606 (0.0008) [2023-12-27 21:28:08,873][106225] Updated weights for policy 1, policy_version 312212 (0.0008) [2023-12-27 21:28:08,932][106225] Updated weights for policy 1, policy_version 312222 (0.0008) [2023-12-27 21:28:08,996][106225] Updated weights for policy 1, policy_version 312232 (0.0009) [2023-12-27 21:28:09,058][106226] Updated weights for policy 0, policy_version 311616 (0.0010) [2023-12-27 21:28:09,122][106226] Updated weights for policy 0, policy_version 311626 (0.0011) [2023-12-27 21:28:09,181][106226] Updated weights for policy 0, policy_version 311636 (0.0010) [2023-12-27 21:28:09,646][106225] Updated weights for policy 1, policy_version 312242 (0.0005) [2023-12-27 21:28:09,711][106225] Updated weights for policy 1, policy_version 312252 (0.0008) [2023-12-27 21:28:09,771][106225] Updated weights for policy 1, policy_version 312262 (0.0008) [2023-12-27 21:28:09,834][106225] Updated weights for policy 1, policy_version 312272 (0.0008) [2023-12-27 21:28:09,894][106226] Updated weights for policy 0, policy_version 311646 (0.0010) [2023-12-27 21:28:09,960][106226] Updated weights for policy 0, policy_version 311656 (0.0008) [2023-12-27 21:28:10,020][106226] Updated weights for policy 0, policy_version 311666 (0.0006) [2023-12-27 21:28:10,585][106225] Updated weights for policy 1, policy_version 312282 (0.0011) [2023-12-27 21:28:10,635][106225] Updated weights for policy 1, policy_version 312292 (0.0010) [2023-12-27 21:28:10,640][106226] Updated weights for policy 0, policy_version 311676 (0.0006) [2023-12-27 21:28:10,691][106225] Updated weights for policy 1, policy_version 312302 (0.0010) [2023-12-27 21:28:10,701][106226] Updated weights for policy 0, policy_version 311686 (0.0006) [2023-12-27 21:28:10,767][106226] Updated weights for policy 0, policy_version 311696 (0.0006) [2023-12-27 21:28:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 159793152. Throughput: 0: 10074.9, 1: 9946.7. Samples: 159762940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:11,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-5.433')] [2023-12-27 21:28:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000312304_79970304.pth... [2023-12-27 21:28:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000311704_79822848.pth... [2023-12-27 21:28:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000310520_79519744.pth [2023-12-27 21:28:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000311152_79675392.pth [2023-12-27 21:28:11,420][106225] Updated weights for policy 1, policy_version 312312 (0.0011) [2023-12-27 21:28:11,486][106225] Updated weights for policy 1, policy_version 312322 (0.0011) [2023-12-27 21:28:11,536][106226] Updated weights for policy 0, policy_version 311706 (0.0009) [2023-12-27 21:28:11,544][106225] Updated weights for policy 1, policy_version 312332 (0.0010) [2023-12-27 21:28:11,601][106226] Updated weights for policy 0, policy_version 311716 (0.0008) [2023-12-27 21:28:11,666][106226] Updated weights for policy 0, policy_version 311726 (0.0008) [2023-12-27 21:28:11,731][106226] Updated weights for policy 0, policy_version 311736 (0.0008) [2023-12-27 21:28:12,305][106225] Updated weights for policy 1, policy_version 312342 (0.0011) [2023-12-27 21:28:12,372][106225] Updated weights for policy 1, policy_version 312352 (0.0012) [2023-12-27 21:28:12,433][106225] Updated weights for policy 1, policy_version 312362 (0.0009) [2023-12-27 21:28:12,468][106226] Updated weights for policy 0, policy_version 311746 (0.0006) [2023-12-27 21:28:12,536][106226] Updated weights for policy 0, policy_version 311756 (0.0008) [2023-12-27 21:28:12,605][106226] Updated weights for policy 0, policy_version 311766 (0.0008) [2023-12-27 21:28:13,160][106225] Updated weights for policy 1, policy_version 312372 (0.0009) [2023-12-27 21:28:13,168][106226] Updated weights for policy 0, policy_version 311776 (0.0006) [2023-12-27 21:28:13,221][106225] Updated weights for policy 1, policy_version 312382 (0.0006) [2023-12-27 21:28:13,234][106226] Updated weights for policy 0, policy_version 311786 (0.0005) [2023-12-27 21:28:13,279][106225] Updated weights for policy 1, policy_version 312392 (0.0009) [2023-12-27 21:28:13,292][106226] Updated weights for policy 0, policy_version 311796 (0.0005) [2023-12-27 21:28:13,859][106226] Updated weights for policy 0, policy_version 311806 (0.0005) [2023-12-27 21:28:13,910][106226] Updated weights for policy 0, policy_version 311816 (0.0008) [2023-12-27 21:28:13,943][106225] Updated weights for policy 1, policy_version 312402 (0.0009) [2023-12-27 21:28:13,959][106226] Updated weights for policy 0, policy_version 311826 (0.0008) [2023-12-27 21:28:13,992][106225] Updated weights for policy 1, policy_version 312412 (0.0007) [2023-12-27 21:28:14,047][106225] Updated weights for policy 1, policy_version 312422 (0.0005) [2023-12-27 21:28:14,104][106225] Updated weights for policy 1, policy_version 312432 (0.0008) [2023-12-27 21:28:14,648][106226] Updated weights for policy 0, policy_version 311836 (0.0008) [2023-12-27 21:28:14,697][106226] Updated weights for policy 0, policy_version 311846 (0.0010) [2023-12-27 21:28:14,737][106225] Updated weights for policy 1, policy_version 312442 (0.0005) [2023-12-27 21:28:14,744][106226] Updated weights for policy 0, policy_version 311856 (0.0010) [2023-12-27 21:28:14,817][106225] Updated weights for policy 1, policy_version 312452 (0.0008) [2023-12-27 21:28:14,875][106225] Updated weights for policy 1, policy_version 312462 (0.0008) [2023-12-27 21:28:15,435][106226] Updated weights for policy 0, policy_version 311866 (0.0011) [2023-12-27 21:28:15,486][106226] Updated weights for policy 0, policy_version 311876 (0.0010) [2023-12-27 21:28:15,521][106225] Updated weights for policy 1, policy_version 312472 (0.0006) [2023-12-27 21:28:15,540][106226] Updated weights for policy 0, policy_version 311886 (0.0010) [2023-12-27 21:28:15,575][106225] Updated weights for policy 1, policy_version 312482 (0.0007) [2023-12-27 21:28:15,593][106226] Updated weights for policy 0, policy_version 311896 (0.0010) [2023-12-27 21:28:15,634][106225] Updated weights for policy 1, policy_version 312492 (0.0005) [2023-12-27 21:28:16,169][106226] Updated weights for policy 0, policy_version 311906 (0.0006) [2023-12-27 21:28:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 159891456. Throughput: 0: 10015.7, 1: 9882.6. Samples: 159883564. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:16,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.476')] [2023-12-27 21:28:16,227][106226] Updated weights for policy 0, policy_version 311916 (0.0008) [2023-12-27 21:28:16,269][106225] Updated weights for policy 1, policy_version 312502 (0.0008) [2023-12-27 21:28:16,275][106226] Updated weights for policy 0, policy_version 311926 (0.0006) [2023-12-27 21:28:16,329][106225] Updated weights for policy 1, policy_version 312512 (0.0010) [2023-12-27 21:28:16,378][106225] Updated weights for policy 1, policy_version 312522 (0.0010) [2023-12-27 21:28:16,977][106226] Updated weights for policy 0, policy_version 311936 (0.0006) [2023-12-27 21:28:17,029][106226] Updated weights for policy 0, policy_version 311946 (0.0009) [2023-12-27 21:28:17,050][106225] Updated weights for policy 1, policy_version 312532 (0.0008) [2023-12-27 21:28:17,078][106226] Updated weights for policy 0, policy_version 311956 (0.0006) [2023-12-27 21:28:17,104][106225] Updated weights for policy 1, policy_version 312542 (0.0005) [2023-12-27 21:28:17,151][106225] Updated weights for policy 1, policy_version 312552 (0.0006) [2023-12-27 21:28:17,793][106225] Updated weights for policy 1, policy_version 312562 (0.0007) [2023-12-27 21:28:17,819][106226] Updated weights for policy 0, policy_version 311966 (0.0006) [2023-12-27 21:28:17,856][106225] Updated weights for policy 1, policy_version 312572 (0.0007) [2023-12-27 21:28:17,874][106226] Updated weights for policy 0, policy_version 311976 (0.0008) [2023-12-27 21:28:17,918][106225] Updated weights for policy 1, policy_version 312582 (0.0005) [2023-12-27 21:28:17,936][106226] Updated weights for policy 0, policy_version 311986 (0.0008) [2023-12-27 21:28:17,976][106225] Updated weights for policy 1, policy_version 312592 (0.0006) [2023-12-27 21:28:18,621][106226] Updated weights for policy 0, policy_version 311996 (0.0008) [2023-12-27 21:28:18,639][106225] Updated weights for policy 1, policy_version 312602 (0.0011) [2023-12-27 21:28:18,672][106226] Updated weights for policy 0, policy_version 312006 (0.0006) [2023-12-27 21:28:18,696][106225] Updated weights for policy 1, policy_version 312612 (0.0010) [2023-12-27 21:28:18,725][106226] Updated weights for policy 0, policy_version 312016 (0.0007) [2023-12-27 21:28:18,753][106225] Updated weights for policy 1, policy_version 312622 (0.0010) [2023-12-27 21:28:19,475][106226] Updated weights for policy 0, policy_version 312026 (0.0006) [2023-12-27 21:28:19,496][106225] Updated weights for policy 1, policy_version 312632 (0.0009) [2023-12-27 21:28:19,531][106226] Updated weights for policy 0, policy_version 312036 (0.0007) [2023-12-27 21:28:19,557][106225] Updated weights for policy 1, policy_version 312642 (0.0008) [2023-12-27 21:28:19,592][106226] Updated weights for policy 0, policy_version 312046 (0.0008) [2023-12-27 21:28:19,616][106225] Updated weights for policy 1, policy_version 312652 (0.0008) [2023-12-27 21:28:19,648][106226] Updated weights for policy 0, policy_version 312056 (0.0006) [2023-12-27 21:28:20,300][106226] Updated weights for policy 0, policy_version 312066 (0.0006) [2023-12-27 21:28:20,336][106225] Updated weights for policy 1, policy_version 312662 (0.0009) [2023-12-27 21:28:20,361][106226] Updated weights for policy 0, policy_version 312076 (0.0007) [2023-12-27 21:28:20,391][106225] Updated weights for policy 1, policy_version 312672 (0.0006) [2023-12-27 21:28:20,421][106226] Updated weights for policy 0, policy_version 312086 (0.0007) [2023-12-27 21:28:20,451][106225] Updated weights for policy 1, policy_version 312682 (0.0008) [2023-12-27 21:28:21,068][106226] Updated weights for policy 0, policy_version 312096 (0.0008) [2023-12-27 21:28:21,132][106226] Updated weights for policy 0, policy_version 312106 (0.0007) [2023-12-27 21:28:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 159989760. Throughput: 0: 10017.5, 1: 9897.8. Samples: 160005492. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:21,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-5.749')] [2023-12-27 21:28:21,200][106226] Updated weights for policy 0, policy_version 312116 (0.0008) [2023-12-27 21:28:21,257][106225] Updated weights for policy 1, policy_version 312692 (0.0008) [2023-12-27 21:28:21,332][106225] Updated weights for policy 1, policy_version 312702 (0.0008) [2023-12-27 21:28:21,410][106225] Updated weights for policy 1, policy_version 312712 (0.0008) [2023-12-27 21:28:21,886][106226] Updated weights for policy 0, policy_version 312126 (0.0008) [2023-12-27 21:28:21,946][106226] Updated weights for policy 0, policy_version 312136 (0.0008) [2023-12-27 21:28:22,008][106226] Updated weights for policy 0, policy_version 312146 (0.0008) [2023-12-27 21:28:22,234][106225] Updated weights for policy 1, policy_version 312722 (0.0009) [2023-12-27 21:28:22,305][106225] Updated weights for policy 1, policy_version 312732 (0.0008) [2023-12-27 21:28:22,367][106225] Updated weights for policy 1, policy_version 312742 (0.0009) [2023-12-27 21:28:22,427][106225] Updated weights for policy 1, policy_version 312752 (0.0008) [2023-12-27 21:28:22,823][106226] Updated weights for policy 0, policy_version 312156 (0.0008) [2023-12-27 21:28:22,891][106226] Updated weights for policy 0, policy_version 312166 (0.0009) [2023-12-27 21:28:22,958][106226] Updated weights for policy 0, policy_version 312176 (0.0009) [2023-12-27 21:28:23,104][106225] Updated weights for policy 1, policy_version 312762 (0.0009) [2023-12-27 21:28:23,161][106225] Updated weights for policy 1, policy_version 312772 (0.0008) [2023-12-27 21:28:23,222][106225] Updated weights for policy 1, policy_version 312782 (0.0008) [2023-12-27 21:28:23,680][106226] Updated weights for policy 0, policy_version 312186 (0.0008) [2023-12-27 21:28:23,736][106226] Updated weights for policy 0, policy_version 312196 (0.0008) [2023-12-27 21:28:23,782][106226] Updated weights for policy 0, policy_version 312206 (0.0008) [2023-12-27 21:28:23,838][106226] Updated weights for policy 0, policy_version 312216 (0.0009) [2023-12-27 21:28:23,955][106225] Updated weights for policy 1, policy_version 312792 (0.0007) [2023-12-27 21:28:24,011][106225] Updated weights for policy 1, policy_version 312802 (0.0005) [2023-12-27 21:28:24,066][106225] Updated weights for policy 1, policy_version 312812 (0.0005) [2023-12-27 21:28:24,597][106226] Updated weights for policy 0, policy_version 312226 (0.0009) [2023-12-27 21:28:24,647][106226] Updated weights for policy 0, policy_version 312236 (0.0008) [2023-12-27 21:28:24,694][106225] Updated weights for policy 1, policy_version 312822 (0.0006) [2023-12-27 21:28:24,695][106226] Updated weights for policy 0, policy_version 312246 (0.0009) [2023-12-27 21:28:24,745][106225] Updated weights for policy 1, policy_version 312832 (0.0005) [2023-12-27 21:28:24,792][106225] Updated weights for policy 1, policy_version 312842 (0.0005) [2023-12-27 21:28:25,342][106225] Updated weights for policy 1, policy_version 312852 (0.0007) [2023-12-27 21:28:25,401][106225] Updated weights for policy 1, policy_version 312862 (0.0010) [2023-12-27 21:28:25,451][106225] Updated weights for policy 1, policy_version 312872 (0.0010) [2023-12-27 21:28:25,548][106226] Updated weights for policy 0, policy_version 312256 (0.0008) [2023-12-27 21:28:25,611][106226] Updated weights for policy 0, policy_version 312266 (0.0008) [2023-12-27 21:28:25,658][106226] Updated weights for policy 0, policy_version 312276 (0.0008) [2023-12-27 21:28:26,139][106225] Updated weights for policy 1, policy_version 312882 (0.0010) [2023-12-27 21:28:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 160088064. Throughput: 0: 9998.9, 1: 9833.0. Samples: 160060400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:26,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.636')] [2023-12-27 21:28:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000312280_79970304.pth... [2023-12-27 21:28:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000311128_79675392.pth [2023-12-27 21:28:26,198][106225] Updated weights for policy 1, policy_version 312892 (0.0010) [2023-12-27 21:28:26,264][106225] Updated weights for policy 1, policy_version 312902 (0.0010) [2023-12-27 21:28:26,320][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000312912_80125952.pth... [2023-12-27 21:28:26,321][106225] Updated weights for policy 1, policy_version 312912 (0.0010) [2023-12-27 21:28:26,324][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000311728_79822848.pth [2023-12-27 21:28:26,337][106226] Updated weights for policy 0, policy_version 312286 (0.0008) [2023-12-27 21:28:26,401][106226] Updated weights for policy 0, policy_version 312296 (0.0005) [2023-12-27 21:28:26,457][106226] Updated weights for policy 0, policy_version 312306 (0.0005) [2023-12-27 21:28:27,050][106225] Updated weights for policy 1, policy_version 312922 (0.0008) [2023-12-27 21:28:27,075][106226] Updated weights for policy 0, policy_version 312316 (0.0006) [2023-12-27 21:28:27,102][106225] Updated weights for policy 1, policy_version 312932 (0.0005) [2023-12-27 21:28:27,126][106226] Updated weights for policy 0, policy_version 312326 (0.0005) [2023-12-27 21:28:27,150][106225] Updated weights for policy 1, policy_version 312942 (0.0005) [2023-12-27 21:28:27,177][106226] Updated weights for policy 0, policy_version 312336 (0.0007) [2023-12-27 21:28:27,709][106225] Updated weights for policy 1, policy_version 312952 (0.0007) [2023-12-27 21:28:27,770][106225] Updated weights for policy 1, policy_version 312962 (0.0009) [2023-12-27 21:28:27,820][106225] Updated weights for policy 1, policy_version 312972 (0.0010) [2023-12-27 21:28:27,827][106226] Updated weights for policy 0, policy_version 312346 (0.0011) [2023-12-27 21:28:27,887][106226] Updated weights for policy 0, policy_version 312356 (0.0011) [2023-12-27 21:28:27,946][106226] Updated weights for policy 0, policy_version 312366 (0.0009) [2023-12-27 21:28:27,999][106226] Updated weights for policy 0, policy_version 312376 (0.0005) [2023-12-27 21:28:28,459][106225] Updated weights for policy 1, policy_version 312982 (0.0010) [2023-12-27 21:28:28,515][106225] Updated weights for policy 1, policy_version 312992 (0.0010) [2023-12-27 21:28:28,581][106225] Updated weights for policy 1, policy_version 313002 (0.0008) [2023-12-27 21:28:28,653][106226] Updated weights for policy 0, policy_version 312386 (0.0006) [2023-12-27 21:28:28,717][106226] Updated weights for policy 0, policy_version 312396 (0.0007) [2023-12-27 21:28:28,785][106226] Updated weights for policy 0, policy_version 312406 (0.0006) [2023-12-27 21:28:29,295][106225] Updated weights for policy 1, policy_version 313012 (0.0010) [2023-12-27 21:28:29,360][106225] Updated weights for policy 1, policy_version 313022 (0.0009) [2023-12-27 21:28:29,411][106226] Updated weights for policy 0, policy_version 312416 (0.0008) [2023-12-27 21:28:29,427][106225] Updated weights for policy 1, policy_version 313032 (0.0009) [2023-12-27 21:28:29,473][106226] Updated weights for policy 0, policy_version 312426 (0.0008) [2023-12-27 21:28:29,530][106226] Updated weights for policy 0, policy_version 312436 (0.0008) [2023-12-27 21:28:30,202][106225] Updated weights for policy 1, policy_version 313042 (0.0010) [2023-12-27 21:28:30,256][106225] Updated weights for policy 1, policy_version 313052 (0.0010) [2023-12-27 21:28:30,264][106226] Updated weights for policy 0, policy_version 312446 (0.0009) [2023-12-27 21:28:30,309][106225] Updated weights for policy 1, policy_version 313062 (0.0010) [2023-12-27 21:28:30,319][106226] Updated weights for policy 0, policy_version 312456 (0.0009) [2023-12-27 21:28:30,363][106225] Updated weights for policy 1, policy_version 313072 (0.0010) [2023-12-27 21:28:30,383][106226] Updated weights for policy 0, policy_version 312466 (0.0007) [2023-12-27 21:28:30,969][106225] Updated weights for policy 1, policy_version 313082 (0.0005) [2023-12-27 21:28:31,019][106225] Updated weights for policy 1, policy_version 313092 (0.0006) [2023-12-27 21:28:31,083][106225] Updated weights for policy 1, policy_version 313102 (0.0007) [2023-12-27 21:28:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 160194560. Throughput: 0: 10079.1, 1: 9898.4. Samples: 160183876. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:31,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.344')] [2023-12-27 21:28:31,190][106226] Updated weights for policy 0, policy_version 312476 (0.0009) [2023-12-27 21:28:31,250][106226] Updated weights for policy 0, policy_version 312486 (0.0009) [2023-12-27 21:28:31,309][106226] Updated weights for policy 0, policy_version 312496 (0.0006) [2023-12-27 21:28:31,759][106225] Updated weights for policy 1, policy_version 313112 (0.0007) [2023-12-27 21:28:31,813][106225] Updated weights for policy 1, policy_version 313122 (0.0005) [2023-12-27 21:28:31,858][106225] Updated weights for policy 1, policy_version 313132 (0.0005) [2023-12-27 21:28:32,003][106226] Updated weights for policy 0, policy_version 312506 (0.0009) [2023-12-27 21:28:32,073][106226] Updated weights for policy 0, policy_version 312516 (0.0006) [2023-12-27 21:28:32,148][106226] Updated weights for policy 0, policy_version 312526 (0.0008) [2023-12-27 21:28:32,218][106226] Updated weights for policy 0, policy_version 312536 (0.0008) [2023-12-27 21:28:32,451][106225] Updated weights for policy 1, policy_version 313142 (0.0006) [2023-12-27 21:28:32,508][106225] Updated weights for policy 1, policy_version 313152 (0.0010) [2023-12-27 21:28:32,576][106225] Updated weights for policy 1, policy_version 313162 (0.0010) [2023-12-27 21:28:32,839][106226] Updated weights for policy 0, policy_version 312546 (0.0008) [2023-12-27 21:28:32,900][106226] Updated weights for policy 0, policy_version 312556 (0.0010) [2023-12-27 21:28:32,956][106226] Updated weights for policy 0, policy_version 312566 (0.0010) [2023-12-27 21:28:33,231][106225] Updated weights for policy 1, policy_version 313172 (0.0010) [2023-12-27 21:28:33,280][106225] Updated weights for policy 1, policy_version 313182 (0.0010) [2023-12-27 21:28:33,333][106225] Updated weights for policy 1, policy_version 313192 (0.0010) [2023-12-27 21:28:33,545][106226] Updated weights for policy 0, policy_version 312576 (0.0006) [2023-12-27 21:28:33,589][106226] Updated weights for policy 0, policy_version 312586 (0.0005) [2023-12-27 21:28:33,639][106226] Updated weights for policy 0, policy_version 312596 (0.0005) [2023-12-27 21:28:34,050][106225] Updated weights for policy 1, policy_version 313202 (0.0009) [2023-12-27 21:28:34,115][106225] Updated weights for policy 1, policy_version 313212 (0.0005) [2023-12-27 21:28:34,179][106225] Updated weights for policy 1, policy_version 313222 (0.0007) [2023-12-27 21:28:34,239][106225] Updated weights for policy 1, policy_version 313232 (0.0009) [2023-12-27 21:28:34,250][106226] Updated weights for policy 0, policy_version 312606 (0.0006) [2023-12-27 21:28:34,314][106226] Updated weights for policy 0, policy_version 312616 (0.0006) [2023-12-27 21:28:34,372][106226] Updated weights for policy 0, policy_version 312626 (0.0006) [2023-12-27 21:28:34,856][106225] Updated weights for policy 1, policy_version 313242 (0.0005) [2023-12-27 21:28:34,917][106225] Updated weights for policy 1, policy_version 313252 (0.0006) [2023-12-27 21:28:34,964][106226] Updated weights for policy 0, policy_version 312636 (0.0010) [2023-12-27 21:28:34,979][106225] Updated weights for policy 1, policy_version 313262 (0.0010) [2023-12-27 21:28:35,025][106226] Updated weights for policy 0, policy_version 312646 (0.0010) [2023-12-27 21:28:35,082][106226] Updated weights for policy 0, policy_version 312656 (0.0010) [2023-12-27 21:28:35,589][106225] Updated weights for policy 1, policy_version 313272 (0.0010) [2023-12-27 21:28:35,639][106225] Updated weights for policy 1, policy_version 313282 (0.0010) [2023-12-27 21:28:35,699][106225] Updated weights for policy 1, policy_version 313292 (0.0010) [2023-12-27 21:28:35,802][106226] Updated weights for policy 0, policy_version 312666 (0.0010) [2023-12-27 21:28:35,861][106226] Updated weights for policy 0, policy_version 312676 (0.0010) [2023-12-27 21:28:35,919][106226] Updated weights for policy 0, policy_version 312686 (0.0007) [2023-12-27 21:28:35,974][106226] Updated weights for policy 0, policy_version 312696 (0.0005) [2023-12-27 21:28:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 160301056. Throughput: 0: 10093.2, 1: 9966.7. Samples: 160309304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:36,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-5.474')] [2023-12-27 21:28:36,414][106225] Updated weights for policy 1, policy_version 313302 (0.0010) [2023-12-27 21:28:36,479][106225] Updated weights for policy 1, policy_version 313312 (0.0011) [2023-12-27 21:28:36,536][106225] Updated weights for policy 1, policy_version 313322 (0.0011) [2023-12-27 21:28:36,669][106226] Updated weights for policy 0, policy_version 312706 (0.0011) [2023-12-27 21:28:36,723][106226] Updated weights for policy 0, policy_version 312716 (0.0010) [2023-12-27 21:28:36,776][106226] Updated weights for policy 0, policy_version 312726 (0.0010) [2023-12-27 21:28:37,219][106225] Updated weights for policy 1, policy_version 313332 (0.0010) [2023-12-27 21:28:37,276][106225] Updated weights for policy 1, policy_version 313342 (0.0010) [2023-12-27 21:28:37,333][106225] Updated weights for policy 1, policy_version 313352 (0.0010) [2023-12-27 21:28:37,489][106226] Updated weights for policy 0, policy_version 312736 (0.0009) [2023-12-27 21:28:37,545][106226] Updated weights for policy 0, policy_version 312746 (0.0008) [2023-12-27 21:28:37,595][106226] Updated weights for policy 0, policy_version 312756 (0.0010) [2023-12-27 21:28:38,063][106225] Updated weights for policy 1, policy_version 313362 (0.0010) [2023-12-27 21:28:38,122][106225] Updated weights for policy 1, policy_version 313372 (0.0010) [2023-12-27 21:28:38,178][106225] Updated weights for policy 1, policy_version 313382 (0.0010) [2023-12-27 21:28:38,241][106225] Updated weights for policy 1, policy_version 313392 (0.0010) [2023-12-27 21:28:38,262][106226] Updated weights for policy 0, policy_version 312766 (0.0007) [2023-12-27 21:28:38,316][106226] Updated weights for policy 0, policy_version 312776 (0.0008) [2023-12-27 21:28:38,403][106226] Updated weights for policy 0, policy_version 312786 (0.0006) [2023-12-27 21:28:38,950][106225] Updated weights for policy 1, policy_version 313402 (0.0011) [2023-12-27 21:28:39,014][106225] Updated weights for policy 1, policy_version 313412 (0.0010) [2023-12-27 21:28:39,034][106226] Updated weights for policy 0, policy_version 312796 (0.0008) [2023-12-27 21:28:39,075][106225] Updated weights for policy 1, policy_version 313422 (0.0010) [2023-12-27 21:28:39,095][106226] Updated weights for policy 0, policy_version 312806 (0.0010) [2023-12-27 21:28:39,158][106226] Updated weights for policy 0, policy_version 312816 (0.0011) [2023-12-27 21:28:39,852][106225] Updated weights for policy 1, policy_version 313432 (0.0009) [2023-12-27 21:28:39,910][106226] Updated weights for policy 0, policy_version 312826 (0.0010) [2023-12-27 21:28:39,917][106225] Updated weights for policy 1, policy_version 313442 (0.0009) [2023-12-27 21:28:39,972][106226] Updated weights for policy 0, policy_version 312836 (0.0006) [2023-12-27 21:28:39,980][106225] Updated weights for policy 1, policy_version 313452 (0.0010) [2023-12-27 21:28:40,030][106226] Updated weights for policy 0, policy_version 312846 (0.0007) [2023-12-27 21:28:40,080][106226] Updated weights for policy 0, policy_version 312856 (0.0008) [2023-12-27 21:28:40,702][106225] Updated weights for policy 1, policy_version 313462 (0.0011) [2023-12-27 21:28:40,763][106225] Updated weights for policy 1, policy_version 313472 (0.0009) [2023-12-27 21:28:40,771][106226] Updated weights for policy 0, policy_version 312866 (0.0006) [2023-12-27 21:28:40,825][106226] Updated weights for policy 0, policy_version 312876 (0.0008) [2023-12-27 21:28:40,829][106225] Updated weights for policy 1, policy_version 313482 (0.0007) [2023-12-27 21:28:40,880][106226] Updated weights for policy 0, policy_version 312886 (0.0007) [2023-12-27 21:28:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 160399360. Throughput: 0: 10136.1, 1: 9967.5. Samples: 160368708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:41,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-5.608')] [2023-12-27 21:28:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000312888_80125952.pth... [2023-12-27 21:28:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000313488_80273408.pth... [2023-12-27 21:28:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000311704_79822848.pth [2023-12-27 21:28:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000312304_79970304.pth [2023-12-27 21:28:41,584][106225] Updated weights for policy 1, policy_version 313492 (0.0009) [2023-12-27 21:28:41,651][106225] Updated weights for policy 1, policy_version 313502 (0.0009) [2023-12-27 21:28:41,677][106226] Updated weights for policy 0, policy_version 312896 (0.0007) [2023-12-27 21:28:41,718][106225] Updated weights for policy 1, policy_version 313512 (0.0010) [2023-12-27 21:28:41,751][106226] Updated weights for policy 0, policy_version 312906 (0.0007) [2023-12-27 21:28:41,816][106226] Updated weights for policy 0, policy_version 312916 (0.0008) [2023-12-27 21:28:42,465][106225] Updated weights for policy 1, policy_version 313522 (0.0010) [2023-12-27 21:28:42,526][106225] Updated weights for policy 1, policy_version 313532 (0.0008) [2023-12-27 21:28:42,544][106226] Updated weights for policy 0, policy_version 312926 (0.0008) [2023-12-27 21:28:42,585][106225] Updated weights for policy 1, policy_version 313542 (0.0007) [2023-12-27 21:28:42,606][106226] Updated weights for policy 0, policy_version 312936 (0.0008) [2023-12-27 21:28:42,643][106225] Updated weights for policy 1, policy_version 313552 (0.0006) [2023-12-27 21:28:42,669][106226] Updated weights for policy 0, policy_version 312946 (0.0008) [2023-12-27 21:28:43,311][106225] Updated weights for policy 1, policy_version 313562 (0.0005) [2023-12-27 21:28:43,366][106225] Updated weights for policy 1, policy_version 313572 (0.0006) [2023-12-27 21:28:43,385][106226] Updated weights for policy 0, policy_version 312956 (0.0009) [2023-12-27 21:28:43,429][106225] Updated weights for policy 1, policy_version 313582 (0.0009) [2023-12-27 21:28:43,435][106226] Updated weights for policy 0, policy_version 312966 (0.0005) [2023-12-27 21:28:43,480][106226] Updated weights for policy 0, policy_version 312976 (0.0008) [2023-12-27 21:28:44,041][106225] Updated weights for policy 1, policy_version 313592 (0.0008) [2023-12-27 21:28:44,099][106225] Updated weights for policy 1, policy_version 313602 (0.0009) [2023-12-27 21:28:44,155][106225] Updated weights for policy 1, policy_version 313612 (0.0008) [2023-12-27 21:28:44,235][106226] Updated weights for policy 0, policy_version 312986 (0.0008) [2023-12-27 21:28:44,302][106226] Updated weights for policy 0, policy_version 312996 (0.0005) [2023-12-27 21:28:44,366][106226] Updated weights for policy 0, policy_version 313006 (0.0010) [2023-12-27 21:28:44,430][106226] Updated weights for policy 0, policy_version 313016 (0.0011) [2023-12-27 21:28:44,926][106225] Updated weights for policy 1, policy_version 313622 (0.0007) [2023-12-27 21:28:44,983][106225] Updated weights for policy 1, policy_version 313632 (0.0008) [2023-12-27 21:28:45,046][106225] Updated weights for policy 1, policy_version 313642 (0.0008) [2023-12-27 21:28:45,105][106226] Updated weights for policy 0, policy_version 313026 (0.0008) [2023-12-27 21:28:45,167][106226] Updated weights for policy 0, policy_version 313036 (0.0011) [2023-12-27 21:28:45,229][106226] Updated weights for policy 0, policy_version 313046 (0.0011) [2023-12-27 21:28:45,711][106225] Updated weights for policy 1, policy_version 313652 (0.0008) [2023-12-27 21:28:45,767][106225] Updated weights for policy 1, policy_version 313662 (0.0007) [2023-12-27 21:28:45,823][106225] Updated weights for policy 1, policy_version 313672 (0.0006) [2023-12-27 21:28:45,943][106226] Updated weights for policy 0, policy_version 313056 (0.0010) [2023-12-27 21:28:45,997][106226] Updated weights for policy 0, policy_version 313066 (0.0010) [2023-12-27 21:28:46,060][106226] Updated weights for policy 0, policy_version 313076 (0.0011) [2023-12-27 21:28:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 160497664. Throughput: 0: 10023.5, 1: 9970.4. Samples: 160483472. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:46,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.307')] [2023-12-27 21:28:46,495][106225] Updated weights for policy 1, policy_version 313682 (0.0008) [2023-12-27 21:28:46,545][106225] Updated weights for policy 1, policy_version 313692 (0.0008) [2023-12-27 21:28:46,598][106225] Updated weights for policy 1, policy_version 313702 (0.0005) [2023-12-27 21:28:46,647][106225] Updated weights for policy 1, policy_version 313712 (0.0005) [2023-12-27 21:28:46,742][106226] Updated weights for policy 0, policy_version 313086 (0.0010) [2023-12-27 21:28:46,797][106226] Updated weights for policy 0, policy_version 313096 (0.0011) [2023-12-27 21:28:46,849][106226] Updated weights for policy 0, policy_version 313106 (0.0010) [2023-12-27 21:28:47,220][106225] Updated weights for policy 1, policy_version 313722 (0.0010) [2023-12-27 21:28:47,275][106225] Updated weights for policy 1, policy_version 313732 (0.0005) [2023-12-27 21:28:47,326][106225] Updated weights for policy 1, policy_version 313742 (0.0005) [2023-12-27 21:28:47,493][106226] Updated weights for policy 0, policy_version 313116 (0.0007) [2023-12-27 21:28:47,549][106226] Updated weights for policy 0, policy_version 313126 (0.0005) [2023-12-27 21:28:47,594][106226] Updated weights for policy 0, policy_version 313136 (0.0005) [2023-12-27 21:28:48,031][106225] Updated weights for policy 1, policy_version 313752 (0.0009) [2023-12-27 21:28:48,097][106225] Updated weights for policy 1, policy_version 313762 (0.0010) [2023-12-27 21:28:48,161][106225] Updated weights for policy 1, policy_version 313772 (0.0010) [2023-12-27 21:28:48,199][106226] Updated weights for policy 0, policy_version 313146 (0.0007) [2023-12-27 21:28:48,264][106226] Updated weights for policy 0, policy_version 313156 (0.0006) [2023-12-27 21:28:48,325][106226] Updated weights for policy 0, policy_version 313166 (0.0007) [2023-12-27 21:28:48,393][106226] Updated weights for policy 0, policy_version 313176 (0.0008) [2023-12-27 21:28:48,832][106225] Updated weights for policy 1, policy_version 313782 (0.0009) [2023-12-27 21:28:48,895][106225] Updated weights for policy 1, policy_version 313792 (0.0005) [2023-12-27 21:28:48,945][106225] Updated weights for policy 1, policy_version 313802 (0.0006) [2023-12-27 21:28:49,164][106226] Updated weights for policy 0, policy_version 313186 (0.0008) [2023-12-27 21:28:49,212][106226] Updated weights for policy 0, policy_version 313196 (0.0008) [2023-12-27 21:28:49,279][106226] Updated weights for policy 0, policy_version 313206 (0.0009) [2023-12-27 21:28:49,568][106225] Updated weights for policy 1, policy_version 313812 (0.0007) [2023-12-27 21:28:49,624][106225] Updated weights for policy 1, policy_version 313822 (0.0008) [2023-12-27 21:28:49,692][106225] Updated weights for policy 1, policy_version 313832 (0.0006) [2023-12-27 21:28:50,072][106226] Updated weights for policy 0, policy_version 313216 (0.0007) [2023-12-27 21:28:50,129][106226] Updated weights for policy 0, policy_version 313226 (0.0008) [2023-12-27 21:28:50,191][106226] Updated weights for policy 0, policy_version 313236 (0.0008) [2023-12-27 21:28:50,427][106225] Updated weights for policy 1, policy_version 313842 (0.0007) [2023-12-27 21:28:50,472][106225] Updated weights for policy 1, policy_version 313852 (0.0008) [2023-12-27 21:28:50,518][106225] Updated weights for policy 1, policy_version 313862 (0.0008) [2023-12-27 21:28:50,568][106225] Updated weights for policy 1, policy_version 313872 (0.0008) [2023-12-27 21:28:50,806][106226] Updated weights for policy 0, policy_version 313246 (0.0008) [2023-12-27 21:28:50,872][106226] Updated weights for policy 0, policy_version 313256 (0.0009) [2023-12-27 21:28:50,923][106226] Updated weights for policy 0, policy_version 313266 (0.0010) [2023-12-27 21:28:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 160595968. Throughput: 0: 9999.9, 1: 9992.3. Samples: 160604052. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:51,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-5.627')] [2023-12-27 21:28:51,436][106225] Updated weights for policy 1, policy_version 313882 (0.0009) [2023-12-27 21:28:51,495][106225] Updated weights for policy 1, policy_version 313892 (0.0008) [2023-12-27 21:28:51,560][106225] Updated weights for policy 1, policy_version 313902 (0.0007) [2023-12-27 21:28:51,683][106226] Updated weights for policy 0, policy_version 313276 (0.0010) [2023-12-27 21:28:51,757][106226] Updated weights for policy 0, policy_version 313286 (0.0009) [2023-12-27 21:28:51,825][106226] Updated weights for policy 0, policy_version 313296 (0.0008) [2023-12-27 21:28:52,289][106225] Updated weights for policy 1, policy_version 313912 (0.0009) [2023-12-27 21:28:52,360][106225] Updated weights for policy 1, policy_version 313922 (0.0008) [2023-12-27 21:28:52,428][106225] Updated weights for policy 1, policy_version 313932 (0.0007) [2023-12-27 21:28:52,507][106226] Updated weights for policy 0, policy_version 313306 (0.0008) [2023-12-27 21:28:52,559][106226] Updated weights for policy 0, policy_version 313316 (0.0006) [2023-12-27 21:28:52,608][106226] Updated weights for policy 0, policy_version 313326 (0.0006) [2023-12-27 21:28:52,671][106226] Updated weights for policy 0, policy_version 313336 (0.0005) [2023-12-27 21:28:53,019][106225] Updated weights for policy 1, policy_version 313942 (0.0009) [2023-12-27 21:28:53,076][106225] Updated weights for policy 1, policy_version 313952 (0.0008) [2023-12-27 21:28:53,126][106225] Updated weights for policy 1, policy_version 313962 (0.0010) [2023-12-27 21:28:53,291][106226] Updated weights for policy 0, policy_version 313346 (0.0005) [2023-12-27 21:28:53,342][106226] Updated weights for policy 0, policy_version 313356 (0.0005) [2023-12-27 21:28:53,395][106226] Updated weights for policy 0, policy_version 313366 (0.0006) [2023-12-27 21:28:53,730][106225] Updated weights for policy 1, policy_version 313972 (0.0010) [2023-12-27 21:28:53,790][106225] Updated weights for policy 1, policy_version 313982 (0.0010) [2023-12-27 21:28:53,838][106225] Updated weights for policy 1, policy_version 313992 (0.0006) [2023-12-27 21:28:54,057][106226] Updated weights for policy 0, policy_version 313376 (0.0006) [2023-12-27 21:28:54,124][106226] Updated weights for policy 0, policy_version 313386 (0.0006) [2023-12-27 21:28:54,191][106226] Updated weights for policy 0, policy_version 313396 (0.0006) [2023-12-27 21:28:54,462][106225] Updated weights for policy 1, policy_version 314002 (0.0006) [2023-12-27 21:28:54,522][106225] Updated weights for policy 1, policy_version 314012 (0.0010) [2023-12-27 21:28:54,585][106225] Updated weights for policy 1, policy_version 314022 (0.0010) [2023-12-27 21:28:54,640][106225] Updated weights for policy 1, policy_version 314032 (0.0010) [2023-12-27 21:28:54,704][106226] Updated weights for policy 0, policy_version 313406 (0.0007) [2023-12-27 21:28:54,755][106226] Updated weights for policy 0, policy_version 313416 (0.0008) [2023-12-27 21:28:54,803][106226] Updated weights for policy 0, policy_version 313426 (0.0008) [2023-12-27 21:28:55,293][106225] Updated weights for policy 1, policy_version 314042 (0.0010) [2023-12-27 21:28:55,342][106225] Updated weights for policy 1, policy_version 314052 (0.0010) [2023-12-27 21:28:55,395][106225] Updated weights for policy 1, policy_version 314062 (0.0010) [2023-12-27 21:28:55,483][106226] Updated weights for policy 0, policy_version 313436 (0.0007) [2023-12-27 21:28:55,534][106226] Updated weights for policy 0, policy_version 313446 (0.0008) [2023-12-27 21:28:55,585][106226] Updated weights for policy 0, policy_version 313456 (0.0006) [2023-12-27 21:28:56,052][106225] Updated weights for policy 1, policy_version 314072 (0.0009) [2023-12-27 21:28:56,103][106225] Updated weights for policy 1, policy_version 314082 (0.0008) [2023-12-27 21:28:56,149][106225] Updated weights for policy 1, policy_version 314092 (0.0007) [2023-12-27 21:28:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20070.5, 300 sec: 19799.6). Total num frames: 160694272. Throughput: 0: 10016.7, 1: 10049.9. Samples: 160665936. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:28:56,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.709')] [2023-12-27 21:28:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000313464_80273408.pth... [2023-12-27 21:28:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000314096_80429056.pth... [2023-12-27 21:28:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000312912_80125952.pth [2023-12-27 21:28:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000312280_79970304.pth [2023-12-27 21:28:56,217][106226] Updated weights for policy 0, policy_version 313466 (0.0006) [2023-12-27 21:28:56,285][106226] Updated weights for policy 0, policy_version 313476 (0.0005) [2023-12-27 21:28:56,341][106226] Updated weights for policy 0, policy_version 313486 (0.0005) [2023-12-27 21:28:56,398][106226] Updated weights for policy 0, policy_version 313496 (0.0005) [2023-12-27 21:28:56,911][106225] Updated weights for policy 1, policy_version 314102 (0.0006) [2023-12-27 21:28:56,963][106225] Updated weights for policy 1, policy_version 314112 (0.0005) [2023-12-27 21:28:57,042][106226] Updated weights for policy 0, policy_version 313506 (0.0008) [2023-12-27 21:28:57,046][106225] Updated weights for policy 1, policy_version 314122 (0.0007) [2023-12-27 21:28:57,087][106226] Updated weights for policy 0, policy_version 313516 (0.0007) [2023-12-27 21:28:57,137][106226] Updated weights for policy 0, policy_version 313526 (0.0008) [2023-12-27 21:28:57,673][106225] Updated weights for policy 1, policy_version 314132 (0.0008) [2023-12-27 21:28:57,726][106225] Updated weights for policy 1, policy_version 314142 (0.0010) [2023-12-27 21:28:57,775][106225] Updated weights for policy 1, policy_version 314152 (0.0010) [2023-12-27 21:28:57,872][106226] Updated weights for policy 0, policy_version 313536 (0.0008) [2023-12-27 21:28:57,921][106226] Updated weights for policy 0, policy_version 313546 (0.0008) [2023-12-27 21:28:57,970][106226] Updated weights for policy 0, policy_version 313557 (0.0008) [2023-12-27 21:28:58,503][106225] Updated weights for policy 1, policy_version 314162 (0.0010) [2023-12-27 21:28:58,567][106225] Updated weights for policy 1, policy_version 314172 (0.0008) [2023-12-27 21:28:58,640][106225] Updated weights for policy 1, policy_version 314182 (0.0008) [2023-12-27 21:28:58,709][106225] Updated weights for policy 1, policy_version 314192 (0.0010) [2023-12-27 21:28:58,758][106226] Updated weights for policy 0, policy_version 313567 (0.0008) [2023-12-27 21:28:58,827][106226] Updated weights for policy 0, policy_version 313577 (0.0008) [2023-12-27 21:28:58,902][106226] Updated weights for policy 0, policy_version 313587 (0.0008) [2023-12-27 21:28:59,469][106225] Updated weights for policy 1, policy_version 314202 (0.0010) [2023-12-27 21:28:59,533][106225] Updated weights for policy 1, policy_version 314212 (0.0010) [2023-12-27 21:28:59,583][106225] Updated weights for policy 1, policy_version 314222 (0.0010) [2023-12-27 21:28:59,646][106226] Updated weights for policy 0, policy_version 313597 (0.0007) [2023-12-27 21:28:59,703][106226] Updated weights for policy 0, policy_version 313607 (0.0005) [2023-12-27 21:28:59,751][106226] Updated weights for policy 0, policy_version 313617 (0.0005) [2023-12-27 21:29:00,349][106225] Updated weights for policy 1, policy_version 314232 (0.0010) [2023-12-27 21:29:00,415][106225] Updated weights for policy 1, policy_version 314242 (0.0011) [2023-12-27 21:29:00,433][106226] Updated weights for policy 0, policy_version 313627 (0.0005) [2023-12-27 21:29:00,469][106225] Updated weights for policy 1, policy_version 314252 (0.0010) [2023-12-27 21:29:00,492][106226] Updated weights for policy 0, policy_version 313637 (0.0005) [2023-12-27 21:29:00,558][106226] Updated weights for policy 0, policy_version 313647 (0.0005) [2023-12-27 21:29:01,084][106225] Updated weights for policy 1, policy_version 314262 (0.0009) [2023-12-27 21:29:01,146][106225] Updated weights for policy 1, policy_version 314272 (0.0007) [2023-12-27 21:29:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 160792576. Throughput: 0: 10023.9, 1: 10048.1. Samples: 160786804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:29:01,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-5.349')] [2023-12-27 21:29:01,210][106225] Updated weights for policy 1, policy_version 314282 (0.0010) [2023-12-27 21:29:01,216][106226] Updated weights for policy 0, policy_version 313657 (0.0006) [2023-12-27 21:29:01,284][106226] Updated weights for policy 0, policy_version 313667 (0.0007) [2023-12-27 21:29:01,349][106226] Updated weights for policy 0, policy_version 313677 (0.0008) [2023-12-27 21:29:01,418][106226] Updated weights for policy 0, policy_version 313687 (0.0008) [2023-12-27 21:29:01,974][106225] Updated weights for policy 1, policy_version 314292 (0.0010) [2023-12-27 21:29:02,033][106225] Updated weights for policy 1, policy_version 314302 (0.0008) [2023-12-27 21:29:02,081][106225] Updated weights for policy 1, policy_version 314312 (0.0009) [2023-12-27 21:29:02,142][106226] Updated weights for policy 0, policy_version 313697 (0.0009) [2023-12-27 21:29:02,201][106226] Updated weights for policy 0, policy_version 313707 (0.0007) [2023-12-27 21:29:02,267][106226] Updated weights for policy 0, policy_version 313717 (0.0009) [2023-12-27 21:29:02,718][106225] Updated weights for policy 1, policy_version 314323 (0.0006) [2023-12-27 21:29:02,778][106225] Updated weights for policy 1, policy_version 314333 (0.0008) [2023-12-27 21:29:02,836][106225] Updated weights for policy 1, policy_version 314343 (0.0008) [2023-12-27 21:29:02,983][106226] Updated weights for policy 0, policy_version 313727 (0.0007) [2023-12-27 21:29:03,037][106226] Updated weights for policy 0, policy_version 313737 (0.0009) [2023-12-27 21:29:03,098][106226] Updated weights for policy 0, policy_version 313747 (0.0009) [2023-12-27 21:29:03,416][106225] Updated weights for policy 1, policy_version 314353 (0.0008) [2023-12-27 21:29:03,480][106225] Updated weights for policy 1, policy_version 314363 (0.0005) [2023-12-27 21:29:03,543][106225] Updated weights for policy 1, policy_version 314373 (0.0005) [2023-12-27 21:29:03,600][106225] Updated weights for policy 1, policy_version 314383 (0.0006) [2023-12-27 21:29:03,946][106226] Updated weights for policy 0, policy_version 313757 (0.0009) [2023-12-27 21:29:04,005][106226] Updated weights for policy 0, policy_version 313767 (0.0008) [2023-12-27 21:29:04,053][106226] Updated weights for policy 0, policy_version 313777 (0.0008) [2023-12-27 21:29:04,184][106225] Updated weights for policy 1, policy_version 314393 (0.0006) [2023-12-27 21:29:04,249][106225] Updated weights for policy 1, policy_version 314403 (0.0007) [2023-12-27 21:29:04,315][106225] Updated weights for policy 1, policy_version 314413 (0.0008) [2023-12-27 21:29:04,799][106226] Updated weights for policy 0, policy_version 313787 (0.0007) [2023-12-27 21:29:04,855][106226] Updated weights for policy 0, policy_version 313797 (0.0005) [2023-12-27 21:29:04,907][106226] Updated weights for policy 0, policy_version 313807 (0.0005) [2023-12-27 21:29:05,014][106225] Updated weights for policy 1, policy_version 314423 (0.0009) [2023-12-27 21:29:05,060][106225] Updated weights for policy 1, policy_version 314433 (0.0008) [2023-12-27 21:29:05,111][106225] Updated weights for policy 1, policy_version 314443 (0.0008) [2023-12-27 21:29:05,598][106226] Updated weights for policy 0, policy_version 313817 (0.0006) [2023-12-27 21:29:05,659][106226] Updated weights for policy 0, policy_version 313827 (0.0009) [2023-12-27 21:29:05,727][106226] Updated weights for policy 0, policy_version 313837 (0.0009) [2023-12-27 21:29:05,761][106225] Updated weights for policy 1, policy_version 314453 (0.0006) [2023-12-27 21:29:05,788][106226] Updated weights for policy 0, policy_version 313847 (0.0009) [2023-12-27 21:29:05,815][106225] Updated weights for policy 1, policy_version 314463 (0.0006) [2023-12-27 21:29:05,873][106225] Updated weights for policy 1, policy_version 314473 (0.0008) [2023-12-27 21:29:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 160899072. Throughput: 0: 9930.0, 1: 10094.2. Samples: 160906580. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:29:06,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.648')] [2023-12-27 21:29:06,452][106226] Updated weights for policy 0, policy_version 313857 (0.0009) [2023-12-27 21:29:06,517][106226] Updated weights for policy 0, policy_version 313867 (0.0008) [2023-12-27 21:29:06,578][106226] Updated weights for policy 0, policy_version 313877 (0.0009) [2023-12-27 21:29:06,587][106225] Updated weights for policy 1, policy_version 314483 (0.0007) [2023-12-27 21:29:06,660][106225] Updated weights for policy 1, policy_version 314493 (0.0006) [2023-12-27 21:29:06,726][106225] Updated weights for policy 1, policy_version 314503 (0.0007) [2023-12-27 21:29:07,336][106226] Updated weights for policy 0, policy_version 313887 (0.0009) [2023-12-27 21:29:07,376][106225] Updated weights for policy 1, policy_version 314513 (0.0007) [2023-12-27 21:29:07,386][106226] Updated weights for policy 0, policy_version 313897 (0.0008) [2023-12-27 21:29:07,427][106225] Updated weights for policy 1, policy_version 314523 (0.0006) [2023-12-27 21:29:07,445][106226] Updated weights for policy 0, policy_version 313907 (0.0007) [2023-12-27 21:29:07,487][106225] Updated weights for policy 1, policy_version 314533 (0.0005) [2023-12-27 21:29:07,541][106225] Updated weights for policy 1, policy_version 314543 (0.0005) [2023-12-27 21:29:08,127][106225] Updated weights for policy 1, policy_version 314553 (0.0005) [2023-12-27 21:29:08,185][106225] Updated weights for policy 1, policy_version 314563 (0.0005) [2023-12-27 21:29:08,237][106225] Updated weights for policy 1, policy_version 314573 (0.0006) [2023-12-27 21:29:08,246][106226] Updated weights for policy 0, policy_version 313917 (0.0009) [2023-12-27 21:29:08,300][106226] Updated weights for policy 0, policy_version 313927 (0.0005) [2023-12-27 21:29:08,367][106226] Updated weights for policy 0, policy_version 313937 (0.0009) [2023-12-27 21:29:08,906][106225] Updated weights for policy 1, policy_version 314583 (0.0005) [2023-12-27 21:29:08,976][106225] Updated weights for policy 1, policy_version 314593 (0.0005) [2023-12-27 21:29:09,043][106225] Updated weights for policy 1, policy_version 314603 (0.0007) [2023-12-27 21:29:09,120][106226] Updated weights for policy 0, policy_version 313947 (0.0009) [2023-12-27 21:29:09,183][106226] Updated weights for policy 0, policy_version 313957 (0.0008) [2023-12-27 21:29:09,244][106226] Updated weights for policy 0, policy_version 313967 (0.0009) [2023-12-27 21:29:09,757][106225] Updated weights for policy 1, policy_version 314613 (0.0009) [2023-12-27 21:29:09,828][106225] Updated weights for policy 1, policy_version 314623 (0.0009) [2023-12-27 21:29:09,893][106225] Updated weights for policy 1, policy_version 314633 (0.0010) [2023-12-27 21:29:10,070][106226] Updated weights for policy 0, policy_version 313977 (0.0008) [2023-12-27 21:29:10,137][106226] Updated weights for policy 0, policy_version 313987 (0.0009) [2023-12-27 21:29:10,203][106226] Updated weights for policy 0, policy_version 313997 (0.0008) [2023-12-27 21:29:10,266][106226] Updated weights for policy 0, policy_version 314007 (0.0009) [2023-12-27 21:29:10,642][106225] Updated weights for policy 1, policy_version 314643 (0.0009) [2023-12-27 21:29:10,712][106225] Updated weights for policy 1, policy_version 314653 (0.0006) [2023-12-27 21:29:10,772][106225] Updated weights for policy 1, policy_version 314663 (0.0006) [2023-12-27 21:29:10,927][106226] Updated weights for policy 0, policy_version 314017 (0.0009) [2023-12-27 21:29:10,985][106226] Updated weights for policy 0, policy_version 314027 (0.0011) [2023-12-27 21:29:11,056][106226] Updated weights for policy 0, policy_version 314037 (0.0010) [2023-12-27 21:29:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 160997376. Throughput: 0: 9934.1, 1: 10186.4. Samples: 160965824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:29:11,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-5.632')] [2023-12-27 21:29:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000314672_80576512.pth... [2023-12-27 21:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000314040_80420864.pth... [2023-12-27 21:29:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000313488_80273408.pth [2023-12-27 21:29:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000312888_80125952.pth [2023-12-27 21:29:11,436][106225] Updated weights for policy 1, policy_version 314673 (0.0006) [2023-12-27 21:29:11,487][106225] Updated weights for policy 1, policy_version 314683 (0.0007) [2023-12-27 21:29:11,534][106225] Updated weights for policy 1, policy_version 314693 (0.0008) [2023-12-27 21:29:11,589][106225] Updated weights for policy 1, policy_version 314703 (0.0008) [2023-12-27 21:29:11,839][106226] Updated weights for policy 0, policy_version 314047 (0.0009) [2023-12-27 21:29:11,893][106226] Updated weights for policy 0, policy_version 314057 (0.0007) [2023-12-27 21:29:11,960][106226] Updated weights for policy 0, policy_version 314067 (0.0010) [2023-12-27 21:29:12,398][106225] Updated weights for policy 1, policy_version 314713 (0.0008) [2023-12-27 21:29:12,451][106225] Updated weights for policy 1, policy_version 314723 (0.0007) [2023-12-27 21:29:12,508][106225] Updated weights for policy 1, policy_version 314733 (0.0008) [2023-12-27 21:29:12,710][106226] Updated weights for policy 0, policy_version 314077 (0.0011) [2023-12-27 21:29:12,778][106226] Updated weights for policy 0, policy_version 314087 (0.0011) [2023-12-27 21:29:12,832][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000005 [2023-12-27 21:29:13,176][106225] Updated weights for policy 1, policy_version 314743 (0.0007) [2023-12-27 21:29:13,250][106225] Updated weights for policy 1, policy_version 314753 (0.0005) [2023-12-27 21:29:13,313][106225] Updated weights for policy 1, policy_version 314763 (0.0005) [2023-12-27 21:29:13,482][106226] Updated weights for policy 0, policy_version 314097 (0.0010) [2023-12-27 21:29:13,545][106226] Updated weights for policy 0, policy_version 314107 (0.0008) [2023-12-27 21:29:13,594][106226] Updated weights for policy 0, policy_version 314117 (0.0005) [2023-12-27 21:29:13,642][106226] Updated weights for policy 0, policy_version 314127 (0.0005) [2023-12-27 21:29:13,896][106225] Updated weights for policy 1, policy_version 314773 (0.0007) [2023-12-27 21:29:13,954][106225] Updated weights for policy 1, policy_version 314783 (0.0007) [2023-12-27 21:29:14,015][106225] Updated weights for policy 1, policy_version 314793 (0.0006) [2023-12-27 21:29:14,255][106226] Updated weights for policy 0, policy_version 314137 (0.0010) [2023-12-27 21:29:14,304][106226] Updated weights for policy 0, policy_version 314147 (0.0009) [2023-12-27 21:29:14,350][106226] Updated weights for policy 0, policy_version 314157 (0.0005) [2023-12-27 21:29:14,691][106225] Updated weights for policy 1, policy_version 314803 (0.0009) [2023-12-27 21:29:14,756][106225] Updated weights for policy 1, policy_version 314813 (0.0009) [2023-12-27 21:29:14,819][106225] Updated weights for policy 1, policy_version 314823 (0.0011) [2023-12-27 21:29:14,973][106226] Updated weights for policy 0, policy_version 314167 (0.0009) [2023-12-27 21:29:15,035][106226] Updated weights for policy 0, policy_version 314177 (0.0009) [2023-12-27 21:29:15,094][106226] Updated weights for policy 0, policy_version 314187 (0.0006) [2023-12-27 21:29:15,534][106225] Updated weights for policy 1, policy_version 314833 (0.0010) [2023-12-27 21:29:15,594][106225] Updated weights for policy 1, policy_version 314843 (0.0010) [2023-12-27 21:29:15,647][106225] Updated weights for policy 1, policy_version 314853 (0.0010) [2023-12-27 21:29:15,704][106225] Updated weights for policy 1, policy_version 314863 (0.0010) [2023-12-27 21:29:15,776][106226] Updated weights for policy 0, policy_version 314197 (0.0006) [2023-12-27 21:29:15,828][106226] Updated weights for policy 0, policy_version 314207 (0.0007) [2023-12-27 21:29:15,881][106226] Updated weights for policy 0, policy_version 314217 (0.0008) [2023-12-27 21:29:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 161095680. Throughput: 0: 9894.9, 1: 10120.5. Samples: 161084572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-27 21:29:16,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-5.322')] [2023-12-27 21:29:16,327][106225] Updated weights for policy 1, policy_version 314873 (0.0006) [2023-12-27 21:29:16,385][106225] Updated weights for policy 1, policy_version 314883 (0.0005) [2023-12-27 21:29:16,442][106225] Updated weights for policy 1, policy_version 314893 (0.0005) [2023-12-27 21:29:16,542][106226] Updated weights for policy 0, policy_version 314227 (0.0009) [2023-12-27 21:29:16,593][106226] Updated weights for policy 0, policy_version 314237 (0.0009) [2023-12-27 21:29:16,646][106226] Updated weights for policy 0, policy_version 314247 (0.0005) [2023-12-27 21:29:16,938][106225] Updated weights for policy 1, policy_version 314903 (0.0005) [2023-12-27 21:29:16,987][106225] Updated weights for policy 1, policy_version 314913 (0.0005) [2023-12-27 21:29:17,039][106225] Updated weights for policy 1, policy_version 314923 (0.0008) [2023-12-27 21:29:17,207][106226] Updated weights for policy 0, policy_version 314257 (0.0006) [2023-12-27 21:29:17,272][106226] Updated weights for policy 0, policy_version 314267 (0.0005) [2023-12-27 21:29:17,331][106226] Updated weights for policy 0, policy_version 314277 (0.0009) [2023-12-27 21:29:17,383][106226] Updated weights for policy 0, policy_version 314287 (0.0010) [2023-12-27 21:29:17,724][106225] Updated weights for policy 1, policy_version 314933 (0.0008) [2023-12-27 21:29:17,775][106225] Updated weights for policy 1, policy_version 314943 (0.0009) [2023-12-27 21:29:17,824][106225] Updated weights for policy 1, policy_version 314953 (0.0008) [2023-12-27 21:29:17,988][106226] Updated weights for policy 0, policy_version 314297 (0.0006) [2023-12-27 21:29:18,043][106226] Updated weights for policy 0, policy_version 314307 (0.0010) [2023-12-27 21:29:18,111][106226] Updated weights for policy 0, policy_version 314317 (0.0010) [2023-12-27 21:29:18,581][106225] Updated weights for policy 1, policy_version 314963 (0.0007) [2023-12-27 21:29:18,644][106225] Updated weights for policy 1, policy_version 314973 (0.0005) [2023-12-27 21:29:18,703][106225] Updated weights for policy 1, policy_version 314983 (0.0007) [2023-12-27 21:29:18,786][106226] Updated weights for policy 0, policy_version 314327 (0.0011) [2023-12-27 21:29:18,846][106226] Updated weights for policy 0, policy_version 314337 (0.0010) [2023-12-27 21:29:18,899][106226] Updated weights for policy 0, policy_version 314347 (0.0010) [2023-12-27 21:29:19,274][106225] Updated weights for policy 1, policy_version 314993 (0.0008) [2023-12-27 21:29:19,327][106225] Updated weights for policy 1, policy_version 315003 (0.0010) [2023-12-27 21:29:19,395][106225] Updated weights for policy 1, policy_version 315013 (0.0007) [2023-12-27 21:29:19,446][106225] Updated weights for policy 1, policy_version 315023 (0.0009) [2023-12-27 21:29:19,610][106226] Updated weights for policy 0, policy_version 314357 (0.0009) [2023-12-27 21:29:19,678][106226] Updated weights for policy 0, policy_version 314367 (0.0009) [2023-12-27 21:29:19,749][106226] Updated weights for policy 0, policy_version 314377 (0.0008) [2023-12-27 21:29:20,205][106225] Updated weights for policy 1, policy_version 315033 (0.0007) [2023-12-27 21:29:20,267][106225] Updated weights for policy 1, policy_version 315043 (0.0008) [2023-12-27 21:29:20,330][106225] Updated weights for policy 1, policy_version 315053 (0.0008) [2023-12-27 21:29:20,500][106226] Updated weights for policy 0, policy_version 314387 (0.0008) [2023-12-27 21:29:20,582][106226] Updated weights for policy 0, policy_version 314397 (0.0006) [2023-12-27 21:29:20,649][106226] Updated weights for policy 0, policy_version 314407 (0.0007) [2023-12-27 21:29:21,065][106225] Updated weights for policy 1, policy_version 315063 (0.0008) [2023-12-27 21:29:21,130][106225] Updated weights for policy 1, policy_version 315073 (0.0009) [2023-12-27 21:29:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 161193984. Throughput: 0: 9884.4, 1: 10091.0. Samples: 161208192. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:21,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.561')] [2023-12-27 21:29:21,197][106225] Updated weights for policy 1, policy_version 315083 (0.0008) [2023-12-27 21:29:21,330][106226] Updated weights for policy 0, policy_version 314417 (0.0008) [2023-12-27 21:29:21,408][106226] Updated weights for policy 0, policy_version 314427 (0.0009) [2023-12-27 21:29:21,474][106226] Updated weights for policy 0, policy_version 314437 (0.0008) [2023-12-27 21:29:21,540][106226] Updated weights for policy 0, policy_version 314447 (0.0005) [2023-12-27 21:29:22,042][106225] Updated weights for policy 1, policy_version 315093 (0.0008) [2023-12-27 21:29:22,094][106225] Updated weights for policy 1, policy_version 315103 (0.0008) [2023-12-27 21:29:22,142][106225] Updated weights for policy 1, policy_version 315113 (0.0008) [2023-12-27 21:29:22,249][106226] Updated weights for policy 0, policy_version 314457 (0.0008) [2023-12-27 21:29:22,320][106226] Updated weights for policy 0, policy_version 314467 (0.0009) [2023-12-27 21:29:22,394][106226] Updated weights for policy 0, policy_version 314477 (0.0009) [2023-12-27 21:29:22,868][106225] Updated weights for policy 1, policy_version 315123 (0.0007) [2023-12-27 21:29:22,927][106225] Updated weights for policy 1, policy_version 315133 (0.0009) [2023-12-27 21:29:22,988][106225] Updated weights for policy 1, policy_version 315143 (0.0008) [2023-12-27 21:29:23,136][106226] Updated weights for policy 0, policy_version 314487 (0.0009) [2023-12-27 21:29:23,200][106226] Updated weights for policy 0, policy_version 314497 (0.0008) [2023-12-27 21:29:23,260][106226] Updated weights for policy 0, policy_version 314507 (0.0007) [2023-12-27 21:29:23,729][106225] Updated weights for policy 1, policy_version 315153 (0.0009) [2023-12-27 21:29:23,785][106225] Updated weights for policy 1, policy_version 315163 (0.0008) [2023-12-27 21:29:23,848][106225] Updated weights for policy 1, policy_version 315173 (0.0010) [2023-12-27 21:29:23,909][106225] Updated weights for policy 1, policy_version 315183 (0.0008) [2023-12-27 21:29:23,913][106226] Updated weights for policy 0, policy_version 314517 (0.0008) [2023-12-27 21:29:23,960][106226] Updated weights for policy 0, policy_version 314527 (0.0005) [2023-12-27 21:29:24,011][106226] Updated weights for policy 0, policy_version 314537 (0.0005) [2023-12-27 21:29:24,629][106226] Updated weights for policy 0, policy_version 314547 (0.0006) [2023-12-27 21:29:24,674][106225] Updated weights for policy 1, policy_version 315193 (0.0007) [2023-12-27 21:29:24,690][106226] Updated weights for policy 0, policy_version 314557 (0.0008) [2023-12-27 21:29:24,723][106225] Updated weights for policy 1, policy_version 315203 (0.0006) [2023-12-27 21:29:24,744][106226] Updated weights for policy 0, policy_version 314567 (0.0009) [2023-12-27 21:29:24,773][106225] Updated weights for policy 1, policy_version 315213 (0.0006) [2023-12-27 21:29:25,444][106226] Updated weights for policy 0, policy_version 314577 (0.0010) [2023-12-27 21:29:25,502][106226] Updated weights for policy 0, policy_version 314587 (0.0009) [2023-12-27 21:29:25,531][106225] Updated weights for policy 1, policy_version 315223 (0.0007) [2023-12-27 21:29:25,552][106226] Updated weights for policy 0, policy_version 314597 (0.0007) [2023-12-27 21:29:25,582][106225] Updated weights for policy 1, policy_version 315233 (0.0007) [2023-12-27 21:29:25,604][106226] Updated weights for policy 0, policy_version 314607 (0.0007) [2023-12-27 21:29:25,642][106225] Updated weights for policy 1, policy_version 315243 (0.0008) [2023-12-27 21:29:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 161292288. Throughput: 0: 9859.9, 1: 10060.3. Samples: 161265120. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:26,176][105115] Avg episode reward: [(0, '-4.323'), (1, '-5.704')] [2023-12-27 21:29:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000315248_80723968.pth... [2023-12-27 21:29:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000314608_80568320.pth... [2023-12-27 21:29:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000314096_80429056.pth [2023-12-27 21:29:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000313464_80273408.pth [2023-12-27 21:29:26,263][106226] Updated weights for policy 0, policy_version 314617 (0.0007) [2023-12-27 21:29:26,327][106226] Updated weights for policy 0, policy_version 314627 (0.0008) [2023-12-27 21:29:26,383][106226] Updated weights for policy 0, policy_version 314637 (0.0009) [2023-12-27 21:29:26,386][106225] Updated weights for policy 1, policy_version 315253 (0.0009) [2023-12-27 21:29:26,438][106225] Updated weights for policy 1, policy_version 315263 (0.0007) [2023-12-27 21:29:26,488][106225] Updated weights for policy 1, policy_version 315273 (0.0008) [2023-12-27 21:29:26,978][106226] Updated weights for policy 0, policy_version 314647 (0.0007) [2023-12-27 21:29:27,045][106226] Updated weights for policy 0, policy_version 314657 (0.0008) [2023-12-27 21:29:27,104][106226] Updated weights for policy 0, policy_version 314667 (0.0008) [2023-12-27 21:29:27,142][106225] Updated weights for policy 1, policy_version 315283 (0.0006) [2023-12-27 21:29:27,204][106225] Updated weights for policy 1, policy_version 315293 (0.0005) [2023-12-27 21:29:27,252][106225] Updated weights for policy 1, policy_version 315303 (0.0005) [2023-12-27 21:29:27,816][106225] Updated weights for policy 1, policy_version 315313 (0.0005) [2023-12-27 21:29:27,841][106226] Updated weights for policy 0, policy_version 314677 (0.0009) [2023-12-27 21:29:27,864][106225] Updated weights for policy 1, policy_version 315323 (0.0005) [2023-12-27 21:29:27,896][106226] Updated weights for policy 0, policy_version 314687 (0.0008) [2023-12-27 21:29:27,920][106225] Updated weights for policy 1, policy_version 315333 (0.0008) [2023-12-27 21:29:27,943][106226] Updated weights for policy 0, policy_version 314697 (0.0009) [2023-12-27 21:29:27,976][106225] Updated weights for policy 1, policy_version 315343 (0.0010) [2023-12-27 21:29:28,654][106225] Updated weights for policy 1, policy_version 315353 (0.0009) [2023-12-27 21:29:28,714][106226] Updated weights for policy 0, policy_version 314707 (0.0007) [2023-12-27 21:29:28,718][106225] Updated weights for policy 1, policy_version 315363 (0.0005) [2023-12-27 21:29:28,761][106226] Updated weights for policy 0, policy_version 314717 (0.0008) [2023-12-27 21:29:28,782][106225] Updated weights for policy 1, policy_version 315373 (0.0009) [2023-12-27 21:29:28,812][106226] Updated weights for policy 0, policy_version 314727 (0.0006) [2023-12-27 21:29:29,447][106225] Updated weights for policy 1, policy_version 315383 (0.0009) [2023-12-27 21:29:29,501][106225] Updated weights for policy 1, policy_version 315393 (0.0008) [2023-12-27 21:29:29,559][106225] Updated weights for policy 1, policy_version 315403 (0.0008) [2023-12-27 21:29:29,564][106226] Updated weights for policy 0, policy_version 314737 (0.0008) [2023-12-27 21:29:29,620][106226] Updated weights for policy 0, policy_version 314747 (0.0007) [2023-12-27 21:29:29,676][106226] Updated weights for policy 0, policy_version 314757 (0.0006) [2023-12-27 21:29:29,734][106226] Updated weights for policy 0, policy_version 314767 (0.0006) [2023-12-27 21:29:30,330][106225] Updated weights for policy 1, policy_version 315413 (0.0009) [2023-12-27 21:29:30,380][106225] Updated weights for policy 1, policy_version 315423 (0.0006) [2023-12-27 21:29:30,394][106226] Updated weights for policy 0, policy_version 314777 (0.0007) [2023-12-27 21:29:30,436][106225] Updated weights for policy 1, policy_version 315433 (0.0006) [2023-12-27 21:29:30,455][106226] Updated weights for policy 0, policy_version 314787 (0.0006) [2023-12-27 21:29:30,517][106226] Updated weights for policy 0, policy_version 314797 (0.0008) [2023-12-27 21:29:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 161390592. Throughput: 0: 9936.2, 1: 10116.1. Samples: 161385828. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:31,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-5.392')] [2023-12-27 21:29:31,183][106226] Updated weights for policy 0, policy_version 314807 (0.0007) [2023-12-27 21:29:31,214][106225] Updated weights for policy 1, policy_version 315443 (0.0007) [2023-12-27 21:29:31,236][106226] Updated weights for policy 0, policy_version 314817 (0.0007) [2023-12-27 21:29:31,272][106225] Updated weights for policy 1, policy_version 315453 (0.0007) [2023-12-27 21:29:31,294][106226] Updated weights for policy 0, policy_version 314827 (0.0007) [2023-12-27 21:29:31,334][106225] Updated weights for policy 1, policy_version 315463 (0.0008) [2023-12-27 21:29:32,041][106226] Updated weights for policy 0, policy_version 314837 (0.0008) [2023-12-27 21:29:32,071][106225] Updated weights for policy 1, policy_version 315473 (0.0008) [2023-12-27 21:29:32,097][106226] Updated weights for policy 0, policy_version 314847 (0.0008) [2023-12-27 21:29:32,119][106225] Updated weights for policy 1, policy_version 315483 (0.0006) [2023-12-27 21:29:32,158][106226] Updated weights for policy 0, policy_version 314857 (0.0007) [2023-12-27 21:29:32,174][106225] Updated weights for policy 1, policy_version 315493 (0.0006) [2023-12-27 21:29:32,225][106225] Updated weights for policy 1, policy_version 315503 (0.0007) [2023-12-27 21:29:32,848][106226] Updated weights for policy 0, policy_version 314867 (0.0009) [2023-12-27 21:29:32,900][106226] Updated weights for policy 0, policy_version 314877 (0.0006) [2023-12-27 21:29:32,955][106226] Updated weights for policy 0, policy_version 314887 (0.0010) [2023-12-27 21:29:33,014][106225] Updated weights for policy 1, policy_version 315513 (0.0007) [2023-12-27 21:29:33,076][106225] Updated weights for policy 1, policy_version 315523 (0.0008) [2023-12-27 21:29:33,138][106225] Updated weights for policy 1, policy_version 315533 (0.0009) [2023-12-27 21:29:33,613][106226] Updated weights for policy 0, policy_version 314897 (0.0010) [2023-12-27 21:29:33,672][106226] Updated weights for policy 0, policy_version 314907 (0.0011) [2023-12-27 21:29:33,730][106226] Updated weights for policy 0, policy_version 314917 (0.0011) [2023-12-27 21:29:33,783][106226] Updated weights for policy 0, policy_version 314927 (0.0010) [2023-12-27 21:29:33,879][106225] Updated weights for policy 1, policy_version 315543 (0.0008) [2023-12-27 21:29:33,942][106225] Updated weights for policy 1, policy_version 315553 (0.0007) [2023-12-27 21:29:33,998][106225] Updated weights for policy 1, policy_version 315563 (0.0008) [2023-12-27 21:29:34,570][106226] Updated weights for policy 0, policy_version 314937 (0.0009) [2023-12-27 21:29:34,633][106226] Updated weights for policy 0, policy_version 314947 (0.0009) [2023-12-27 21:29:34,685][106226] Updated weights for policy 0, policy_version 314957 (0.0008) [2023-12-27 21:29:34,690][106225] Updated weights for policy 1, policy_version 315573 (0.0007) [2023-12-27 21:29:34,739][106225] Updated weights for policy 1, policy_version 315583 (0.0008) [2023-12-27 21:29:34,784][106225] Updated weights for policy 1, policy_version 315593 (0.0008) [2023-12-27 21:29:35,366][106226] Updated weights for policy 0, policy_version 314967 (0.0006) [2023-12-27 21:29:35,412][106226] Updated weights for policy 0, policy_version 314977 (0.0006) [2023-12-27 21:29:35,461][106226] Updated weights for policy 0, policy_version 314987 (0.0007) [2023-12-27 21:29:35,539][106225] Updated weights for policy 1, policy_version 315603 (0.0009) [2023-12-27 21:29:35,591][106225] Updated weights for policy 1, policy_version 315613 (0.0008) [2023-12-27 21:29:35,658][106225] Updated weights for policy 1, policy_version 315623 (0.0007) [2023-12-27 21:29:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 161488896. Throughput: 0: 9951.0, 1: 10012.5. Samples: 161502408. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:36,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.364')] [2023-12-27 21:29:36,177][106226] Updated weights for policy 0, policy_version 314997 (0.0008) [2023-12-27 21:29:36,236][106226] Updated weights for policy 0, policy_version 315007 (0.0008) [2023-12-27 21:29:36,297][106226] Updated weights for policy 0, policy_version 315017 (0.0009) [2023-12-27 21:29:36,398][106225] Updated weights for policy 1, policy_version 315633 (0.0008) [2023-12-27 21:29:36,466][106225] Updated weights for policy 1, policy_version 315643 (0.0009) [2023-12-27 21:29:36,522][106225] Updated weights for policy 1, policy_version 315653 (0.0009) [2023-12-27 21:29:36,576][106225] Updated weights for policy 1, policy_version 315663 (0.0008) [2023-12-27 21:29:36,978][106226] Updated weights for policy 0, policy_version 315027 (0.0006) [2023-12-27 21:29:37,035][106226] Updated weights for policy 0, policy_version 315037 (0.0006) [2023-12-27 21:29:37,104][106226] Updated weights for policy 0, policy_version 315047 (0.0009) [2023-12-27 21:29:37,310][106225] Updated weights for policy 1, policy_version 315673 (0.0008) [2023-12-27 21:29:37,369][106225] Updated weights for policy 1, policy_version 315683 (0.0007) [2023-12-27 21:29:37,423][106225] Updated weights for policy 1, policy_version 315693 (0.0006) [2023-12-27 21:29:37,774][106226] Updated weights for policy 0, policy_version 315057 (0.0009) [2023-12-27 21:29:37,832][106226] Updated weights for policy 0, policy_version 315067 (0.0009) [2023-12-27 21:29:37,888][106226] Updated weights for policy 0, policy_version 315077 (0.0010) [2023-12-27 21:29:37,933][106226] Updated weights for policy 0, policy_version 315087 (0.0010) [2023-12-27 21:29:38,083][106225] Updated weights for policy 1, policy_version 315703 (0.0010) [2023-12-27 21:29:38,132][106225] Updated weights for policy 1, policy_version 315713 (0.0009) [2023-12-27 21:29:38,181][106225] Updated weights for policy 1, policy_version 315723 (0.0007) [2023-12-27 21:29:38,593][106226] Updated weights for policy 0, policy_version 315097 (0.0010) [2023-12-27 21:29:38,661][106226] Updated weights for policy 0, policy_version 315107 (0.0011) [2023-12-27 21:29:38,715][106226] Updated weights for policy 0, policy_version 315117 (0.0011) [2023-12-27 21:29:38,853][106225] Updated weights for policy 1, policy_version 315733 (0.0007) [2023-12-27 21:29:38,913][106225] Updated weights for policy 1, policy_version 315743 (0.0008) [2023-12-27 21:29:38,960][106225] Updated weights for policy 1, policy_version 315753 (0.0009) [2023-12-27 21:29:39,420][106226] Updated weights for policy 0, policy_version 315127 (0.0010) [2023-12-27 21:29:39,486][106226] Updated weights for policy 0, policy_version 315137 (0.0008) [2023-12-27 21:29:39,543][106226] Updated weights for policy 0, policy_version 315147 (0.0009) [2023-12-27 21:29:39,729][106225] Updated weights for policy 1, policy_version 315763 (0.0007) [2023-12-27 21:29:39,781][106225] Updated weights for policy 1, policy_version 315773 (0.0010) [2023-12-27 21:29:39,842][106225] Updated weights for policy 1, policy_version 315783 (0.0010) [2023-12-27 21:29:40,213][106226] Updated weights for policy 0, policy_version 315157 (0.0008) [2023-12-27 21:29:40,275][106226] Updated weights for policy 0, policy_version 315167 (0.0008) [2023-12-27 21:29:40,335][106226] Updated weights for policy 0, policy_version 315177 (0.0009) [2023-12-27 21:29:40,604][106225] Updated weights for policy 1, policy_version 315793 (0.0007) [2023-12-27 21:29:40,675][106225] Updated weights for policy 1, policy_version 315803 (0.0005) [2023-12-27 21:29:40,735][106225] Updated weights for policy 1, policy_version 315813 (0.0006) [2023-12-27 21:29:40,796][106225] Updated weights for policy 1, policy_version 315823 (0.0009) [2023-12-27 21:29:41,039][106226] Updated weights for policy 0, policy_version 315187 (0.0008) [2023-12-27 21:29:41,104][106226] Updated weights for policy 0, policy_version 315197 (0.0008) [2023-12-27 21:29:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 161587200. Throughput: 0: 9937.6, 1: 9994.4. Samples: 161562876. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:41,175][106226] Updated weights for policy 0, policy_version 315207 (0.0009) [2023-12-27 21:29:41,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-5.585')] [2023-12-27 21:29:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000315824_80871424.pth... [2023-12-27 21:29:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000314672_80576512.pth [2023-12-27 21:29:41,230][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000315216_80723968.pth... [2023-12-27 21:29:41,234][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000314040_80420864.pth [2023-12-27 21:29:41,563][106225] Updated weights for policy 1, policy_version 315833 (0.0008) [2023-12-27 21:29:41,629][106225] Updated weights for policy 1, policy_version 315843 (0.0008) [2023-12-27 21:29:41,696][106225] Updated weights for policy 1, policy_version 315853 (0.0008) [2023-12-27 21:29:41,986][106226] Updated weights for policy 0, policy_version 315217 (0.0009) [2023-12-27 21:29:42,052][106226] Updated weights for policy 0, policy_version 315227 (0.0006) [2023-12-27 21:29:42,111][106226] Updated weights for policy 0, policy_version 315237 (0.0007) [2023-12-27 21:29:42,168][106226] Updated weights for policy 0, policy_version 315247 (0.0008) [2023-12-27 21:29:42,418][106225] Updated weights for policy 1, policy_version 315863 (0.0008) [2023-12-27 21:29:42,480][106225] Updated weights for policy 1, policy_version 315873 (0.0009) [2023-12-27 21:29:42,542][106225] Updated weights for policy 1, policy_version 315883 (0.0009) [2023-12-27 21:29:42,894][106226] Updated weights for policy 0, policy_version 315257 (0.0009) [2023-12-27 21:29:42,960][106226] Updated weights for policy 0, policy_version 315267 (0.0009) [2023-12-27 21:29:43,016][106226] Updated weights for policy 0, policy_version 315277 (0.0009) [2023-12-27 21:29:43,255][106225] Updated weights for policy 1, policy_version 315893 (0.0008) [2023-12-27 21:29:43,310][106225] Updated weights for policy 1, policy_version 315903 (0.0008) [2023-12-27 21:29:43,364][106225] Updated weights for policy 1, policy_version 315913 (0.0008) [2023-12-27 21:29:43,746][106226] Updated weights for policy 0, policy_version 315287 (0.0009) [2023-12-27 21:29:43,805][106226] Updated weights for policy 0, policy_version 315297 (0.0008) [2023-12-27 21:29:43,852][106226] Updated weights for policy 0, policy_version 315307 (0.0008) [2023-12-27 21:29:44,094][106225] Updated weights for policy 1, policy_version 315923 (0.0008) [2023-12-27 21:29:44,160][106225] Updated weights for policy 1, policy_version 315933 (0.0008) [2023-12-27 21:29:44,208][106225] Updated weights for policy 1, policy_version 315943 (0.0008) [2023-12-27 21:29:44,575][106226] Updated weights for policy 0, policy_version 315317 (0.0009) [2023-12-27 21:29:44,634][106226] Updated weights for policy 0, policy_version 315327 (0.0009) [2023-12-27 21:29:44,679][106226] Updated weights for policy 0, policy_version 315337 (0.0008) [2023-12-27 21:29:44,950][106225] Updated weights for policy 1, policy_version 315953 (0.0009) [2023-12-27 21:29:45,017][106225] Updated weights for policy 1, policy_version 315963 (0.0009) [2023-12-27 21:29:45,087][106225] Updated weights for policy 1, policy_version 315973 (0.0009) [2023-12-27 21:29:45,150][106225] Updated weights for policy 1, policy_version 315983 (0.0008) [2023-12-27 21:29:45,432][106226] Updated weights for policy 0, policy_version 315347 (0.0007) [2023-12-27 21:29:45,482][106226] Updated weights for policy 0, policy_version 315357 (0.0009) [2023-12-27 21:29:45,541][106226] Updated weights for policy 0, policy_version 315367 (0.0008) [2023-12-27 21:29:45,831][106225] Updated weights for policy 1, policy_version 315993 (0.0006) [2023-12-27 21:29:45,897][106225] Updated weights for policy 1, policy_version 316003 (0.0005) [2023-12-27 21:29:45,952][106225] Updated weights for policy 1, policy_version 316013 (0.0005) [2023-12-27 21:29:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 161685504. Throughput: 0: 9835.1, 1: 9925.7. Samples: 161676040. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:46,176][105115] Avg episode reward: [(0, '-4.511'), (1, '-5.410')] [2023-12-27 21:29:46,281][106226] Updated weights for policy 0, policy_version 315377 (0.0008) [2023-12-27 21:29:46,338][106226] Updated weights for policy 0, policy_version 315387 (0.0009) [2023-12-27 21:29:46,393][106226] Updated weights for policy 0, policy_version 315397 (0.0009) [2023-12-27 21:29:46,450][106226] Updated weights for policy 0, policy_version 315407 (0.0009) [2023-12-27 21:29:46,578][106225] Updated weights for policy 1, policy_version 316023 (0.0010) [2023-12-27 21:29:46,641][106225] Updated weights for policy 1, policy_version 316033 (0.0011) [2023-12-27 21:29:46,708][106225] Updated weights for policy 1, policy_version 316043 (0.0010) [2023-12-27 21:29:47,187][106226] Updated weights for policy 0, policy_version 315417 (0.0005) [2023-12-27 21:29:47,245][106226] Updated weights for policy 0, policy_version 315427 (0.0006) [2023-12-27 21:29:47,307][106226] Updated weights for policy 0, policy_version 315437 (0.0007) [2023-12-27 21:29:47,353][106225] Updated weights for policy 1, policy_version 316053 (0.0008) [2023-12-27 21:29:47,410][106225] Updated weights for policy 1, policy_version 316063 (0.0005) [2023-12-27 21:29:47,465][106225] Updated weights for policy 1, policy_version 316073 (0.0005) [2023-12-27 21:29:48,011][106225] Updated weights for policy 1, policy_version 316083 (0.0006) [2023-12-27 21:29:48,035][106226] Updated weights for policy 0, policy_version 315447 (0.0006) [2023-12-27 21:29:48,061][106225] Updated weights for policy 1, policy_version 316093 (0.0007) [2023-12-27 21:29:48,098][106226] Updated weights for policy 0, policy_version 315457 (0.0008) [2023-12-27 21:29:48,116][106225] Updated weights for policy 1, policy_version 316103 (0.0005) [2023-12-27 21:29:48,146][106226] Updated weights for policy 0, policy_version 315467 (0.0006) [2023-12-27 21:29:48,889][106226] Updated weights for policy 0, policy_version 315477 (0.0007) [2023-12-27 21:29:48,917][106225] Updated weights for policy 1, policy_version 316113 (0.0007) [2023-12-27 21:29:48,950][106226] Updated weights for policy 0, policy_version 315487 (0.0007) [2023-12-27 21:29:48,963][106225] Updated weights for policy 1, policy_version 316123 (0.0008) [2023-12-27 21:29:49,006][106226] Updated weights for policy 0, policy_version 315497 (0.0006) [2023-12-27 21:29:49,008][106225] Updated weights for policy 1, policy_version 316133 (0.0007) [2023-12-27 21:29:49,060][106225] Updated weights for policy 1, policy_version 316143 (0.0006) [2023-12-27 21:29:49,706][106226] Updated weights for policy 0, policy_version 315507 (0.0009) [2023-12-27 21:29:49,765][106226] Updated weights for policy 0, policy_version 315517 (0.0009) [2023-12-27 21:29:49,809][106225] Updated weights for policy 1, policy_version 316153 (0.0008) [2023-12-27 21:29:49,820][106226] Updated weights for policy 0, policy_version 315527 (0.0006) [2023-12-27 21:29:49,873][106225] Updated weights for policy 1, policy_version 316163 (0.0008) [2023-12-27 21:29:49,948][106225] Updated weights for policy 1, policy_version 316173 (0.0009) [2023-12-27 21:29:50,449][106226] Updated weights for policy 0, policy_version 315537 (0.0007) [2023-12-27 21:29:50,502][106226] Updated weights for policy 0, policy_version 315547 (0.0006) [2023-12-27 21:29:50,553][106226] Updated weights for policy 0, policy_version 315557 (0.0005) [2023-12-27 21:29:50,617][106226] Updated weights for policy 0, policy_version 315567 (0.0007) [2023-12-27 21:29:50,679][106225] Updated weights for policy 1, policy_version 316183 (0.0008) [2023-12-27 21:29:50,744][106225] Updated weights for policy 1, policy_version 316193 (0.0009) [2023-12-27 21:29:50,803][106225] Updated weights for policy 1, policy_version 316203 (0.0009) [2023-12-27 21:29:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 161783808. Throughput: 0: 9879.4, 1: 9870.3. Samples: 161795320. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:51,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-5.635')] [2023-12-27 21:29:51,246][106226] Updated weights for policy 0, policy_version 315577 (0.0009) [2023-12-27 21:29:51,317][106226] Updated weights for policy 0, policy_version 315587 (0.0006) [2023-12-27 21:29:51,390][106226] Updated weights for policy 0, policy_version 315597 (0.0008) [2023-12-27 21:29:51,525][106225] Updated weights for policy 1, policy_version 316213 (0.0008) [2023-12-27 21:29:51,592][106225] Updated weights for policy 1, policy_version 316223 (0.0009) [2023-12-27 21:29:51,664][106225] Updated weights for policy 1, policy_version 316233 (0.0009) [2023-12-27 21:29:52,104][106226] Updated weights for policy 0, policy_version 315607 (0.0008) [2023-12-27 21:29:52,169][106226] Updated weights for policy 0, policy_version 315617 (0.0008) [2023-12-27 21:29:52,228][106226] Updated weights for policy 0, policy_version 315627 (0.0008) [2023-12-27 21:29:52,468][106225] Updated weights for policy 1, policy_version 316243 (0.0009) [2023-12-27 21:29:52,533][106225] Updated weights for policy 1, policy_version 316253 (0.0009) [2023-12-27 21:29:52,589][106225] Updated weights for policy 1, policy_version 316263 (0.0007) [2023-12-27 21:29:52,892][106226] Updated weights for policy 0, policy_version 315637 (0.0009) [2023-12-27 21:29:52,948][106226] Updated weights for policy 0, policy_version 315647 (0.0008) [2023-12-27 21:29:53,008][106226] Updated weights for policy 0, policy_version 315657 (0.0009) [2023-12-27 21:29:53,338][106225] Updated weights for policy 1, policy_version 316273 (0.0009) [2023-12-27 21:29:53,391][106225] Updated weights for policy 1, policy_version 316283 (0.0009) [2023-12-27 21:29:53,452][106225] Updated weights for policy 1, policy_version 316293 (0.0009) [2023-12-27 21:29:53,514][106225] Updated weights for policy 1, policy_version 316303 (0.0009) [2023-12-27 21:29:53,688][106226] Updated weights for policy 0, policy_version 315667 (0.0007) [2023-12-27 21:29:53,738][106226] Updated weights for policy 0, policy_version 315677 (0.0005) [2023-12-27 21:29:53,789][106226] Updated weights for policy 0, policy_version 315687 (0.0005) [2023-12-27 21:29:54,308][106225] Updated weights for policy 1, policy_version 316313 (0.0006) [2023-12-27 21:29:54,371][106225] Updated weights for policy 1, policy_version 316323 (0.0005) [2023-12-27 21:29:54,403][106226] Updated weights for policy 0, policy_version 315697 (0.0005) [2023-12-27 21:29:54,431][106225] Updated weights for policy 1, policy_version 316333 (0.0007) [2023-12-27 21:29:54,463][106226] Updated weights for policy 0, policy_version 315707 (0.0007) [2023-12-27 21:29:54,517][106226] Updated weights for policy 0, policy_version 315717 (0.0009) [2023-12-27 21:29:54,571][106226] Updated weights for policy 0, policy_version 315727 (0.0009) [2023-12-27 21:29:54,931][106225] Updated weights for policy 1, policy_version 316343 (0.0008) [2023-12-27 21:29:54,981][106225] Updated weights for policy 1, policy_version 316353 (0.0009) [2023-12-27 21:29:55,034][106225] Updated weights for policy 1, policy_version 316363 (0.0008) [2023-12-27 21:29:55,215][106226] Updated weights for policy 0, policy_version 315737 (0.0009) [2023-12-27 21:29:55,264][106226] Updated weights for policy 0, policy_version 315747 (0.0008) [2023-12-27 21:29:55,314][106226] Updated weights for policy 0, policy_version 315757 (0.0009) [2023-12-27 21:29:55,778][106225] Updated weights for policy 1, policy_version 316373 (0.0008) [2023-12-27 21:29:55,824][106225] Updated weights for policy 1, policy_version 316383 (0.0009) [2023-12-27 21:29:55,873][106225] Updated weights for policy 1, policy_version 316393 (0.0009) [2023-12-27 21:29:56,060][106226] Updated weights for policy 0, policy_version 315767 (0.0009) [2023-12-27 21:29:56,124][106226] Updated weights for policy 0, policy_version 315777 (0.0008) [2023-12-27 21:29:56,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 161882112. Throughput: 0: 9933.4, 1: 9784.6. Samples: 161853132. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:29:56,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.623')] [2023-12-27 21:29:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000316400_81018880.pth... [2023-12-27 21:29:56,184][106226] Updated weights for policy 0, policy_version 315787 (0.0009) [2023-12-27 21:29:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000315248_80723968.pth [2023-12-27 21:29:56,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000315792_80871424.pth... [2023-12-27 21:29:56,217][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000314608_80568320.pth [2023-12-27 21:29:56,622][106225] Updated weights for policy 1, policy_version 316403 (0.0008) [2023-12-27 21:29:56,670][106225] Updated weights for policy 1, policy_version 316413 (0.0008) [2023-12-27 21:29:56,726][106225] Updated weights for policy 1, policy_version 316423 (0.0009) [2023-12-27 21:29:56,922][106226] Updated weights for policy 0, policy_version 315797 (0.0009) [2023-12-27 21:29:56,976][106226] Updated weights for policy 0, policy_version 315807 (0.0008) [2023-12-27 21:29:57,035][106226] Updated weights for policy 0, policy_version 315817 (0.0008) [2023-12-27 21:29:57,392][106225] Updated weights for policy 1, policy_version 316433 (0.0008) [2023-12-27 21:29:57,447][106225] Updated weights for policy 1, policy_version 316443 (0.0008) [2023-12-27 21:29:57,494][106225] Updated weights for policy 1, policy_version 316453 (0.0008) [2023-12-27 21:29:57,552][106225] Updated weights for policy 1, policy_version 316463 (0.0008) [2023-12-27 21:29:57,784][106226] Updated weights for policy 0, policy_version 315827 (0.0009) [2023-12-27 21:29:57,843][106226] Updated weights for policy 0, policy_version 315837 (0.0008) [2023-12-27 21:29:57,904][106226] Updated weights for policy 0, policy_version 315847 (0.0008) [2023-12-27 21:29:58,290][106225] Updated weights for policy 1, policy_version 316473 (0.0008) [2023-12-27 21:29:58,354][106225] Updated weights for policy 1, policy_version 316483 (0.0008) [2023-12-27 21:29:58,420][106225] Updated weights for policy 1, policy_version 316493 (0.0009) [2023-12-27 21:29:58,701][106226] Updated weights for policy 0, policy_version 315857 (0.0008) [2023-12-27 21:29:58,770][106226] Updated weights for policy 0, policy_version 315867 (0.0007) [2023-12-27 21:29:58,846][106226] Updated weights for policy 0, policy_version 315877 (0.0008) [2023-12-27 21:29:58,907][106226] Updated weights for policy 0, policy_version 315887 (0.0008) [2023-12-27 21:29:59,223][106225] Updated weights for policy 1, policy_version 316503 (0.0007) [2023-12-27 21:29:59,295][106225] Updated weights for policy 1, policy_version 316513 (0.0009) [2023-12-27 21:29:59,353][106225] Updated weights for policy 1, policy_version 316523 (0.0010) [2023-12-27 21:29:59,748][106226] Updated weights for policy 0, policy_version 315897 (0.0008) [2023-12-27 21:29:59,798][106226] Updated weights for policy 0, policy_version 315907 (0.0008) [2023-12-27 21:29:59,862][106226] Updated weights for policy 0, policy_version 315917 (0.0008) [2023-12-27 21:30:00,117][106225] Updated weights for policy 1, policy_version 316533 (0.0010) [2023-12-27 21:30:00,177][106225] Updated weights for policy 1, policy_version 316543 (0.0008) [2023-12-27 21:30:00,232][106225] Updated weights for policy 1, policy_version 316553 (0.0008) [2023-12-27 21:30:00,589][106226] Updated weights for policy 0, policy_version 315927 (0.0007) [2023-12-27 21:30:00,654][106226] Updated weights for policy 0, policy_version 315937 (0.0007) [2023-12-27 21:30:00,720][106226] Updated weights for policy 0, policy_version 315947 (0.0005) [2023-12-27 21:30:00,935][106225] Updated weights for policy 1, policy_version 316563 (0.0009) [2023-12-27 21:30:00,991][106225] Updated weights for policy 1, policy_version 316573 (0.0010) [2023-12-27 21:30:01,045][106225] Updated weights for policy 1, policy_version 316583 (0.0010) [2023-12-27 21:30:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 161980416. Throughput: 0: 9882.5, 1: 9749.4. Samples: 161968008. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:01,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.528')] [2023-12-27 21:30:01,350][106226] Updated weights for policy 0, policy_version 315957 (0.0006) [2023-12-27 21:30:01,418][106226] Updated weights for policy 0, policy_version 315967 (0.0008) [2023-12-27 21:30:01,475][106226] Updated weights for policy 0, policy_version 315977 (0.0007) [2023-12-27 21:30:01,731][106225] Updated weights for policy 1, policy_version 316593 (0.0010) [2023-12-27 21:30:01,793][106225] Updated weights for policy 1, policy_version 316603 (0.0008) [2023-12-27 21:30:01,841][106225] Updated weights for policy 1, policy_version 316613 (0.0008) [2023-12-27 21:30:01,900][106225] Updated weights for policy 1, policy_version 316623 (0.0008) [2023-12-27 21:30:02,247][106226] Updated weights for policy 0, policy_version 315987 (0.0008) [2023-12-27 21:30:02,310][106226] Updated weights for policy 0, policy_version 315997 (0.0008) [2023-12-27 21:30:02,373][106226] Updated weights for policy 0, policy_version 316007 (0.0008) [2023-12-27 21:30:02,631][106225] Updated weights for policy 1, policy_version 316633 (0.0009) [2023-12-27 21:30:02,689][106225] Updated weights for policy 1, policy_version 316643 (0.0008) [2023-12-27 21:30:02,746][106225] Updated weights for policy 1, policy_version 316653 (0.0006) [2023-12-27 21:30:03,092][106226] Updated weights for policy 0, policy_version 316017 (0.0008) [2023-12-27 21:30:03,146][106226] Updated weights for policy 0, policy_version 316027 (0.0009) [2023-12-27 21:30:03,207][106226] Updated weights for policy 0, policy_version 316037 (0.0007) [2023-12-27 21:30:03,260][106226] Updated weights for policy 0, policy_version 316047 (0.0009) [2023-12-27 21:30:03,466][106225] Updated weights for policy 1, policy_version 316663 (0.0008) [2023-12-27 21:30:03,527][106225] Updated weights for policy 1, policy_version 316673 (0.0009) [2023-12-27 21:30:03,586][106225] Updated weights for policy 1, policy_version 316683 (0.0008) [2023-12-27 21:30:03,986][106226] Updated weights for policy 0, policy_version 316057 (0.0008) [2023-12-27 21:30:04,052][106226] Updated weights for policy 0, policy_version 316067 (0.0008) [2023-12-27 21:30:04,117][106226] Updated weights for policy 0, policy_version 316077 (0.0010) [2023-12-27 21:30:04,191][106225] Updated weights for policy 1, policy_version 316693 (0.0007) [2023-12-27 21:30:04,256][106225] Updated weights for policy 1, policy_version 316703 (0.0008) [2023-12-27 21:30:04,315][106225] Updated weights for policy 1, policy_version 316713 (0.0008) [2023-12-27 21:30:04,825][106226] Updated weights for policy 0, policy_version 316087 (0.0008) [2023-12-27 21:30:04,879][106226] Updated weights for policy 0, policy_version 316097 (0.0008) [2023-12-27 21:30:04,937][106226] Updated weights for policy 0, policy_version 316107 (0.0008) [2023-12-27 21:30:05,042][106225] Updated weights for policy 1, policy_version 316723 (0.0009) [2023-12-27 21:30:05,097][106225] Updated weights for policy 1, policy_version 316733 (0.0008) [2023-12-27 21:30:05,163][106225] Updated weights for policy 1, policy_version 316743 (0.0009) [2023-12-27 21:30:05,570][106226] Updated weights for policy 0, policy_version 316117 (0.0010) [2023-12-27 21:30:05,626][106226] Updated weights for policy 0, policy_version 316127 (0.0011) [2023-12-27 21:30:05,682][106226] Updated weights for policy 0, policy_version 316137 (0.0010) [2023-12-27 21:30:05,946][106225] Updated weights for policy 1, policy_version 316753 (0.0008) [2023-12-27 21:30:06,001][106225] Updated weights for policy 1, policy_version 316763 (0.0006) [2023-12-27 21:30:06,050][106225] Updated weights for policy 1, policy_version 316773 (0.0009) [2023-12-27 21:30:06,109][106225] Updated weights for policy 1, policy_version 316783 (0.0008) [2023-12-27 21:30:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 162078720. Throughput: 0: 9850.8, 1: 9676.3. Samples: 162086916. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:06,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-5.388')] [2023-12-27 21:30:06,267][106226] Updated weights for policy 0, policy_version 316147 (0.0006) [2023-12-27 21:30:06,326][106226] Updated weights for policy 0, policy_version 316157 (0.0006) [2023-12-27 21:30:06,385][106226] Updated weights for policy 0, policy_version 316167 (0.0006) [2023-12-27 21:30:06,929][106225] Updated weights for policy 1, policy_version 316793 (0.0006) [2023-12-27 21:30:06,987][106225] Updated weights for policy 1, policy_version 316803 (0.0008) [2023-12-27 21:30:07,002][106226] Updated weights for policy 0, policy_version 316177 (0.0007) [2023-12-27 21:30:07,038][106225] Updated weights for policy 1, policy_version 316813 (0.0006) [2023-12-27 21:30:07,060][106226] Updated weights for policy 0, policy_version 316187 (0.0011) [2023-12-27 21:30:07,118][106226] Updated weights for policy 0, policy_version 316197 (0.0011) [2023-12-27 21:30:07,179][106226] Updated weights for policy 0, policy_version 316207 (0.0011) [2023-12-27 21:30:07,725][106225] Updated weights for policy 1, policy_version 316823 (0.0007) [2023-12-27 21:30:07,785][106225] Updated weights for policy 1, policy_version 316833 (0.0008) [2023-12-27 21:30:07,831][106226] Updated weights for policy 0, policy_version 316217 (0.0011) [2023-12-27 21:30:07,848][106225] Updated weights for policy 1, policy_version 316843 (0.0008) [2023-12-27 21:30:07,895][106226] Updated weights for policy 0, policy_version 316227 (0.0007) [2023-12-27 21:30:07,957][106226] Updated weights for policy 0, policy_version 316237 (0.0005) [2023-12-27 21:30:08,553][106225] Updated weights for policy 1, policy_version 316853 (0.0006) [2023-12-27 21:30:08,607][106225] Updated weights for policy 1, policy_version 316863 (0.0006) [2023-12-27 21:30:08,608][106226] Updated weights for policy 0, policy_version 316247 (0.0007) [2023-12-27 21:30:08,661][106225] Updated weights for policy 1, policy_version 316873 (0.0007) [2023-12-27 21:30:08,670][106226] Updated weights for policy 0, policy_version 316257 (0.0008) [2023-12-27 21:30:08,732][106226] Updated weights for policy 0, policy_version 316267 (0.0008) [2023-12-27 21:30:09,431][106225] Updated weights for policy 1, policy_version 316883 (0.0007) [2023-12-27 21:30:09,470][106226] Updated weights for policy 0, policy_version 316277 (0.0007) [2023-12-27 21:30:09,495][106225] Updated weights for policy 1, policy_version 316893 (0.0008) [2023-12-27 21:30:09,533][106226] Updated weights for policy 0, policy_version 316287 (0.0005) [2023-12-27 21:30:09,553][106225] Updated weights for policy 1, policy_version 316903 (0.0008) [2023-12-27 21:30:09,603][106226] Updated weights for policy 0, policy_version 316297 (0.0006) [2023-12-27 21:30:10,274][106225] Updated weights for policy 1, policy_version 316913 (0.0007) [2023-12-27 21:30:10,297][106226] Updated weights for policy 0, policy_version 316307 (0.0007) [2023-12-27 21:30:10,340][106225] Updated weights for policy 1, policy_version 316923 (0.0006) [2023-12-27 21:30:10,363][106226] Updated weights for policy 0, policy_version 316317 (0.0009) [2023-12-27 21:30:10,399][106225] Updated weights for policy 1, policy_version 316933 (0.0008) [2023-12-27 21:30:10,424][106226] Updated weights for policy 0, policy_version 316327 (0.0009) [2023-12-27 21:30:10,463][106225] Updated weights for policy 1, policy_version 316943 (0.0007) [2023-12-27 21:30:11,098][106225] Updated weights for policy 1, policy_version 316953 (0.0010) [2023-12-27 21:30:11,135][106226] Updated weights for policy 0, policy_version 316337 (0.0010) [2023-12-27 21:30:11,168][106225] Updated weights for policy 1, policy_version 316963 (0.0010) [2023-12-27 21:30:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 162168832. Throughput: 0: 9893.6, 1: 9680.2. Samples: 162145936. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:11,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.388')] [2023-12-27 21:30:11,199][106226] Updated weights for policy 0, policy_version 316347 (0.0007) [2023-12-27 21:30:11,217][106225] Updated weights for policy 1, policy_version 316973 (0.0010) [2023-12-27 21:30:11,231][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000316976_81166336.pth... [2023-12-27 21:30:11,234][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000315824_80871424.pth [2023-12-27 21:30:11,267][106226] Updated weights for policy 0, policy_version 316357 (0.0007) [2023-12-27 21:30:11,326][106226] Updated weights for policy 0, policy_version 316367 (0.0008) [2023-12-27 21:30:11,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000316368_81018880.pth... [2023-12-27 21:30:11,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000315216_80723968.pth [2023-12-27 21:30:12,038][106225] Updated weights for policy 1, policy_version 316983 (0.0008) [2023-12-27 21:30:12,083][106226] Updated weights for policy 0, policy_version 316377 (0.0007) [2023-12-27 21:30:12,109][106225] Updated weights for policy 1, policy_version 316993 (0.0006) [2023-12-27 21:30:12,140][106226] Updated weights for policy 0, policy_version 316387 (0.0007) [2023-12-27 21:30:12,167][106225] Updated weights for policy 1, policy_version 317003 (0.0009) [2023-12-27 21:30:12,201][106226] Updated weights for policy 0, policy_version 316397 (0.0007) [2023-12-27 21:30:12,882][106226] Updated weights for policy 0, policy_version 316407 (0.0009) [2023-12-27 21:30:12,887][106225] Updated weights for policy 1, policy_version 317013 (0.0009) [2023-12-27 21:30:12,939][106226] Updated weights for policy 0, policy_version 316417 (0.0009) [2023-12-27 21:30:12,949][106225] Updated weights for policy 1, policy_version 317023 (0.0007) [2023-12-27 21:30:13,001][106225] Updated weights for policy 1, policy_version 317033 (0.0007) [2023-12-27 21:30:13,003][106226] Updated weights for policy 0, policy_version 316427 (0.0006) [2023-12-27 21:30:13,582][106225] Updated weights for policy 1, policy_version 317043 (0.0008) [2023-12-27 21:30:13,634][106225] Updated weights for policy 1, policy_version 317053 (0.0008) [2023-12-27 21:30:13,686][106225] Updated weights for policy 1, policy_version 317063 (0.0007) [2023-12-27 21:30:13,699][106226] Updated weights for policy 0, policy_version 316437 (0.0007) [2023-12-27 21:30:13,759][106226] Updated weights for policy 0, policy_version 316447 (0.0008) [2023-12-27 21:30:13,815][106226] Updated weights for policy 0, policy_version 316457 (0.0008) [2023-12-27 21:30:14,410][106225] Updated weights for policy 1, policy_version 317073 (0.0006) [2023-12-27 21:30:14,462][106225] Updated weights for policy 1, policy_version 317083 (0.0008) [2023-12-27 21:30:14,515][106225] Updated weights for policy 1, policy_version 317093 (0.0007) [2023-12-27 21:30:14,531][106226] Updated weights for policy 0, policy_version 316467 (0.0010) [2023-12-27 21:30:14,569][106225] Updated weights for policy 1, policy_version 317103 (0.0009) [2023-12-27 21:30:14,595][106226] Updated weights for policy 0, policy_version 316477 (0.0010) [2023-12-27 21:30:14,655][106226] Updated weights for policy 0, policy_version 316487 (0.0011) [2023-12-27 21:30:15,337][106225] Updated weights for policy 1, policy_version 317113 (0.0008) [2023-12-27 21:30:15,375][106226] Updated weights for policy 0, policy_version 316497 (0.0010) [2023-12-27 21:30:15,389][106225] Updated weights for policy 1, policy_version 317123 (0.0007) [2023-12-27 21:30:15,436][106226] Updated weights for policy 0, policy_version 316507 (0.0011) [2023-12-27 21:30:15,449][106225] Updated weights for policy 1, policy_version 317133 (0.0005) [2023-12-27 21:30:15,502][106226] Updated weights for policy 0, policy_version 316517 (0.0011) [2023-12-27 21:30:15,563][106226] Updated weights for policy 0, policy_version 316527 (0.0011) [2023-12-27 21:30:16,112][106225] Updated weights for policy 1, policy_version 317143 (0.0005) [2023-12-27 21:30:16,165][106225] Updated weights for policy 1, policy_version 317153 (0.0005) [2023-12-27 21:30:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 162267136. Throughput: 0: 9829.5, 1: 9644.2. Samples: 162262148. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:16,176][105115] Avg episode reward: [(0, '-4.874'), (1, '-5.516')] [2023-12-27 21:30:16,212][106225] Updated weights for policy 1, policy_version 317163 (0.0009) [2023-12-27 21:30:16,272][106226] Updated weights for policy 0, policy_version 316537 (0.0007) [2023-12-27 21:30:16,341][106226] Updated weights for policy 0, policy_version 316547 (0.0005) [2023-12-27 21:30:16,409][106226] Updated weights for policy 0, policy_version 316557 (0.0005) [2023-12-27 21:30:16,904][106225] Updated weights for policy 1, policy_version 317173 (0.0010) [2023-12-27 21:30:16,931][106226] Updated weights for policy 0, policy_version 316567 (0.0006) [2023-12-27 21:30:16,970][106225] Updated weights for policy 1, policy_version 317183 (0.0010) [2023-12-27 21:30:16,979][106226] Updated weights for policy 0, policy_version 316577 (0.0009) [2023-12-27 21:30:17,018][106225] Updated weights for policy 1, policy_version 317193 (0.0010) [2023-12-27 21:30:17,037][106226] Updated weights for policy 0, policy_version 316587 (0.0008) [2023-12-27 21:30:17,639][106225] Updated weights for policy 1, policy_version 317203 (0.0010) [2023-12-27 21:30:17,689][106226] Updated weights for policy 0, policy_version 316597 (0.0005) [2023-12-27 21:30:17,693][106225] Updated weights for policy 1, policy_version 317213 (0.0010) [2023-12-27 21:30:17,748][106226] Updated weights for policy 0, policy_version 316607 (0.0007) [2023-12-27 21:30:17,752][106225] Updated weights for policy 1, policy_version 317223 (0.0009) [2023-12-27 21:30:17,810][106226] Updated weights for policy 0, policy_version 316617 (0.0009) [2023-12-27 21:30:18,458][106225] Updated weights for policy 1, policy_version 317233 (0.0005) [2023-12-27 21:30:18,508][106226] Updated weights for policy 0, policy_version 316627 (0.0009) [2023-12-27 21:30:18,515][106225] Updated weights for policy 1, policy_version 317243 (0.0007) [2023-12-27 21:30:18,570][106226] Updated weights for policy 0, policy_version 316637 (0.0009) [2023-12-27 21:30:18,580][106225] Updated weights for policy 1, policy_version 317253 (0.0006) [2023-12-27 21:30:18,645][106225] Updated weights for policy 1, policy_version 317263 (0.0008) [2023-12-27 21:30:18,652][106226] Updated weights for policy 0, policy_version 316647 (0.0010) [2023-12-27 21:30:19,246][106226] Updated weights for policy 0, policy_version 316657 (0.0009) [2023-12-27 21:30:19,308][106226] Updated weights for policy 0, policy_version 316667 (0.0009) [2023-12-27 21:30:19,313][106225] Updated weights for policy 1, policy_version 317273 (0.0008) [2023-12-27 21:30:19,376][106226] Updated weights for policy 0, policy_version 316677 (0.0009) [2023-12-27 21:30:19,384][106225] Updated weights for policy 1, policy_version 317283 (0.0010) [2023-12-27 21:30:19,428][106226] Updated weights for policy 0, policy_version 316687 (0.0008) [2023-12-27 21:30:19,434][106225] Updated weights for policy 1, policy_version 317293 (0.0010) [2023-12-27 21:30:20,105][106226] Updated weights for policy 0, policy_version 316697 (0.0011) [2023-12-27 21:30:20,142][106225] Updated weights for policy 1, policy_version 317303 (0.0010) [2023-12-27 21:30:20,172][106226] Updated weights for policy 0, policy_version 316707 (0.0008) [2023-12-27 21:30:20,197][106225] Updated weights for policy 1, policy_version 317313 (0.0009) [2023-12-27 21:30:20,237][106226] Updated weights for policy 0, policy_version 316717 (0.0009) [2023-12-27 21:30:20,256][106225] Updated weights for policy 1, policy_version 317323 (0.0006) [2023-12-27 21:30:20,926][106225] Updated weights for policy 1, policy_version 317333 (0.0008) [2023-12-27 21:30:20,972][106226] Updated weights for policy 0, policy_version 316727 (0.0011) [2023-12-27 21:30:20,983][106225] Updated weights for policy 1, policy_version 317343 (0.0008) [2023-12-27 21:30:21,034][106226] Updated weights for policy 0, policy_version 316737 (0.0009) [2023-12-27 21:30:21,044][106225] Updated weights for policy 1, policy_version 317353 (0.0007) [2023-12-27 21:30:21,108][106226] Updated weights for policy 0, policy_version 316747 (0.0008) [2023-12-27 21:30:21,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 162381824. Throughput: 0: 9852.4, 1: 9736.1. Samples: 162383892. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:21,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.345')] [2023-12-27 21:30:21,788][106225] Updated weights for policy 1, policy_version 317363 (0.0008) [2023-12-27 21:30:21,851][106225] Updated weights for policy 1, policy_version 317373 (0.0009) [2023-12-27 21:30:21,890][106226] Updated weights for policy 0, policy_version 316757 (0.0008) [2023-12-27 21:30:21,915][106225] Updated weights for policy 1, policy_version 317383 (0.0007) [2023-12-27 21:30:21,950][106226] Updated weights for policy 0, policy_version 316767 (0.0006) [2023-12-27 21:30:22,015][106226] Updated weights for policy 0, policy_version 316777 (0.0008) [2023-12-27 21:30:22,563][106225] Updated weights for policy 1, policy_version 317393 (0.0007) [2023-12-27 21:30:22,620][106225] Updated weights for policy 1, policy_version 317403 (0.0008) [2023-12-27 21:30:22,679][106225] Updated weights for policy 1, policy_version 317413 (0.0008) [2023-12-27 21:30:22,739][106225] Updated weights for policy 1, policy_version 317423 (0.0009) [2023-12-27 21:30:22,795][106226] Updated weights for policy 0, policy_version 316787 (0.0009) [2023-12-27 21:30:22,852][106226] Updated weights for policy 0, policy_version 316797 (0.0005) [2023-12-27 21:30:22,907][106226] Updated weights for policy 0, policy_version 316807 (0.0005) [2023-12-27 21:30:23,417][106225] Updated weights for policy 1, policy_version 317433 (0.0008) [2023-12-27 21:30:23,465][106226] Updated weights for policy 0, policy_version 316817 (0.0006) [2023-12-27 21:30:23,476][106225] Updated weights for policy 1, policy_version 317443 (0.0007) [2023-12-27 21:30:23,523][106226] Updated weights for policy 0, policy_version 316827 (0.0006) [2023-12-27 21:30:23,537][106225] Updated weights for policy 1, policy_version 317453 (0.0009) [2023-12-27 21:30:23,589][106226] Updated weights for policy 0, policy_version 316837 (0.0006) [2023-12-27 21:30:23,650][106226] Updated weights for policy 0, policy_version 316847 (0.0006) [2023-12-27 21:30:24,296][106225] Updated weights for policy 1, policy_version 317463 (0.0008) [2023-12-27 21:30:24,334][106226] Updated weights for policy 0, policy_version 316857 (0.0007) [2023-12-27 21:30:24,351][106225] Updated weights for policy 1, policy_version 317473 (0.0009) [2023-12-27 21:30:24,390][106226] Updated weights for policy 0, policy_version 316867 (0.0007) [2023-12-27 21:30:24,405][106225] Updated weights for policy 1, policy_version 317483 (0.0007) [2023-12-27 21:30:24,434][106226] Updated weights for policy 0, policy_version 316877 (0.0007) [2023-12-27 21:30:25,066][106226] Updated weights for policy 0, policy_version 316887 (0.0007) [2023-12-27 21:30:25,107][106225] Updated weights for policy 1, policy_version 317493 (0.0006) [2023-12-27 21:30:25,125][106226] Updated weights for policy 0, policy_version 316897 (0.0007) [2023-12-27 21:30:25,168][106225] Updated weights for policy 1, policy_version 317503 (0.0006) [2023-12-27 21:30:25,185][106226] Updated weights for policy 0, policy_version 316907 (0.0010) [2023-12-27 21:30:25,227][106225] Updated weights for policy 1, policy_version 317513 (0.0006) [2023-12-27 21:30:25,814][106225] Updated weights for policy 1, policy_version 317523 (0.0006) [2023-12-27 21:30:25,871][106226] Updated weights for policy 0, policy_version 316917 (0.0008) [2023-12-27 21:30:25,873][106225] Updated weights for policy 1, policy_version 317533 (0.0007) [2023-12-27 21:30:25,922][106226] Updated weights for policy 0, policy_version 316927 (0.0008) [2023-12-27 21:30:25,926][106225] Updated weights for policy 1, policy_version 317543 (0.0007) [2023-12-27 21:30:25,972][106226] Updated weights for policy 0, policy_version 316937 (0.0010) [2023-12-27 21:30:26,175][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 162480128. Throughput: 0: 9837.3, 1: 9719.7. Samples: 162442936. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:26,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.413')] [2023-12-27 21:30:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000316944_81166336.pth... [2023-12-27 21:30:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000317552_81313792.pth... [2023-12-27 21:30:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000315792_80871424.pth [2023-12-27 21:30:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000316400_81018880.pth [2023-12-27 21:30:26,630][106225] Updated weights for policy 1, policy_version 317553 (0.0007) [2023-12-27 21:30:26,663][106226] Updated weights for policy 0, policy_version 316947 (0.0010) [2023-12-27 21:30:26,681][106225] Updated weights for policy 1, policy_version 317563 (0.0005) [2023-12-27 21:30:26,723][106226] Updated weights for policy 0, policy_version 316957 (0.0010) [2023-12-27 21:30:26,735][106225] Updated weights for policy 1, policy_version 317573 (0.0005) [2023-12-27 21:30:26,783][106226] Updated weights for policy 0, policy_version 316967 (0.0010) [2023-12-27 21:30:26,793][106225] Updated weights for policy 1, policy_version 317583 (0.0006) [2023-12-27 21:30:27,408][106225] Updated weights for policy 1, policy_version 317593 (0.0010) [2023-12-27 21:30:27,435][106226] Updated weights for policy 0, policy_version 316977 (0.0010) [2023-12-27 21:30:27,471][106225] Updated weights for policy 1, policy_version 317603 (0.0010) [2023-12-27 21:30:27,492][106226] Updated weights for policy 0, policy_version 316987 (0.0010) [2023-12-27 21:30:27,531][106225] Updated weights for policy 1, policy_version 317613 (0.0010) [2023-12-27 21:30:27,539][106226] Updated weights for policy 0, policy_version 316997 (0.0010) [2023-12-27 21:30:27,591][106226] Updated weights for policy 0, policy_version 317007 (0.0010) [2023-12-27 21:30:28,194][106225] Updated weights for policy 1, policy_version 317623 (0.0008) [2023-12-27 21:30:28,249][106225] Updated weights for policy 1, policy_version 317633 (0.0007) [2023-12-27 21:30:28,258][106226] Updated weights for policy 0, policy_version 317017 (0.0010) [2023-12-27 21:30:28,306][106225] Updated weights for policy 1, policy_version 317643 (0.0006) [2023-12-27 21:30:28,307][106226] Updated weights for policy 0, policy_version 317027 (0.0009) [2023-12-27 21:30:28,367][106226] Updated weights for policy 0, policy_version 317037 (0.0011) [2023-12-27 21:30:29,035][106225] Updated weights for policy 1, policy_version 317653 (0.0009) [2023-12-27 21:30:29,041][106226] Updated weights for policy 0, policy_version 317047 (0.0006) [2023-12-27 21:30:29,091][106226] Updated weights for policy 0, policy_version 317057 (0.0007) [2023-12-27 21:30:29,097][106225] Updated weights for policy 1, policy_version 317663 (0.0010) [2023-12-27 21:30:29,144][106226] Updated weights for policy 0, policy_version 317067 (0.0006) [2023-12-27 21:30:29,154][106225] Updated weights for policy 1, policy_version 317673 (0.0006) [2023-12-27 21:30:29,767][106225] Updated weights for policy 1, policy_version 317683 (0.0007) [2023-12-27 21:30:29,828][106225] Updated weights for policy 1, policy_version 317693 (0.0008) [2023-12-27 21:30:29,898][106225] Updated weights for policy 1, policy_version 317703 (0.0009) [2023-12-27 21:30:29,970][106226] Updated weights for policy 0, policy_version 317077 (0.0008) [2023-12-27 21:30:30,026][106226] Updated weights for policy 0, policy_version 317087 (0.0011) [2023-12-27 21:30:30,083][106226] Updated weights for policy 0, policy_version 317097 (0.0010) [2023-12-27 21:30:30,564][106225] Updated weights for policy 1, policy_version 317713 (0.0007) [2023-12-27 21:30:30,627][106225] Updated weights for policy 1, policy_version 317723 (0.0005) [2023-12-27 21:30:30,693][106225] Updated weights for policy 1, policy_version 317733 (0.0005) [2023-12-27 21:30:30,756][106225] Updated weights for policy 1, policy_version 317743 (0.0005) [2023-12-27 21:30:30,775][106226] Updated weights for policy 0, policy_version 317107 (0.0011) [2023-12-27 21:30:30,825][106226] Updated weights for policy 0, policy_version 317117 (0.0010) [2023-12-27 21:30:30,871][106226] Updated weights for policy 0, policy_version 317127 (0.0010) [2023-12-27 21:30:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 162578432. Throughput: 0: 9923.4, 1: 9851.0. Samples: 162565884. Policy #0 lag: (min: 31.0, avg: 43.5, max: 63.0) [2023-12-27 21:30:31,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.766')] [2023-12-27 21:30:31,315][106225] Updated weights for policy 1, policy_version 317753 (0.0008) [2023-12-27 21:30:31,374][106225] Updated weights for policy 1, policy_version 317763 (0.0008) [2023-12-27 21:30:31,444][106225] Updated weights for policy 1, policy_version 317773 (0.0008) [2023-12-27 21:30:31,612][106226] Updated weights for policy 0, policy_version 317137 (0.0010) [2023-12-27 21:30:31,679][106226] Updated weights for policy 0, policy_version 317147 (0.0007) [2023-12-27 21:30:31,743][106226] Updated weights for policy 0, policy_version 317157 (0.0009) [2023-12-27 21:30:31,796][106226] Updated weights for policy 0, policy_version 317167 (0.0007) [2023-12-27 21:30:32,168][106225] Updated weights for policy 1, policy_version 317783 (0.0007) [2023-12-27 21:30:32,229][106225] Updated weights for policy 1, policy_version 317793 (0.0007) [2023-12-27 21:30:32,291][106225] Updated weights for policy 1, policy_version 317803 (0.0007) [2023-12-27 21:30:32,524][106226] Updated weights for policy 0, policy_version 317177 (0.0011) [2023-12-27 21:30:32,591][106226] Updated weights for policy 0, policy_version 317187 (0.0010) [2023-12-27 21:30:32,652][106226] Updated weights for policy 0, policy_version 317197 (0.0011) [2023-12-27 21:30:32,938][106225] Updated weights for policy 1, policy_version 317813 (0.0009) [2023-12-27 21:30:32,993][106225] Updated weights for policy 1, policy_version 317823 (0.0010) [2023-12-27 21:30:33,043][106225] Updated weights for policy 1, policy_version 317833 (0.0010) [2023-12-27 21:30:33,361][106226] Updated weights for policy 0, policy_version 317207 (0.0011) [2023-12-27 21:30:33,404][106226] Updated weights for policy 0, policy_version 317217 (0.0010) [2023-12-27 21:30:33,452][106226] Updated weights for policy 0, policy_version 317227 (0.0010) [2023-12-27 21:30:33,675][106225] Updated weights for policy 1, policy_version 317843 (0.0009) [2023-12-27 21:30:33,720][106225] Updated weights for policy 1, policy_version 317853 (0.0005) [2023-12-27 21:30:33,777][106225] Updated weights for policy 1, policy_version 317863 (0.0009) [2023-12-27 21:30:34,226][106226] Updated weights for policy 0, policy_version 317237 (0.0010) [2023-12-27 21:30:34,280][106226] Updated weights for policy 0, policy_version 317247 (0.0011) [2023-12-27 21:30:34,338][106226] Updated weights for policy 0, policy_version 317257 (0.0011) [2023-12-27 21:30:34,503][106225] Updated weights for policy 1, policy_version 317873 (0.0010) [2023-12-27 21:30:34,568][106225] Updated weights for policy 1, policy_version 317883 (0.0008) [2023-12-27 21:30:34,626][106225] Updated weights for policy 1, policy_version 317893 (0.0007) [2023-12-27 21:30:34,686][106225] Updated weights for policy 1, policy_version 317903 (0.0008) [2023-12-27 21:30:35,063][106226] Updated weights for policy 0, policy_version 317267 (0.0010) [2023-12-27 21:30:35,128][106226] Updated weights for policy 0, policy_version 317277 (0.0010) [2023-12-27 21:30:35,194][106226] Updated weights for policy 0, policy_version 317287 (0.0010) [2023-12-27 21:30:35,401][106225] Updated weights for policy 1, policy_version 317913 (0.0008) [2023-12-27 21:30:35,453][106225] Updated weights for policy 1, policy_version 317923 (0.0008) [2023-12-27 21:30:35,502][106225] Updated weights for policy 1, policy_version 317933 (0.0007) [2023-12-27 21:30:35,884][106226] Updated weights for policy 0, policy_version 317297 (0.0010) [2023-12-27 21:30:35,938][106226] Updated weights for policy 0, policy_version 317307 (0.0006) [2023-12-27 21:30:35,999][106226] Updated weights for policy 0, policy_version 317317 (0.0008) [2023-12-27 21:30:36,053][106226] Updated weights for policy 0, policy_version 317327 (0.0008) [2023-12-27 21:30:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 162676736. Throughput: 0: 9903.6, 1: 9858.3. Samples: 162684604. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:30:36,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.636')] [2023-12-27 21:30:36,231][106225] Updated weights for policy 1, policy_version 317943 (0.0006) [2023-12-27 21:30:36,284][106225] Updated weights for policy 1, policy_version 317953 (0.0007) [2023-12-27 21:30:36,343][106225] Updated weights for policy 1, policy_version 317963 (0.0010) [2023-12-27 21:30:36,761][106226] Updated weights for policy 0, policy_version 317337 (0.0008) [2023-12-27 21:30:36,826][106226] Updated weights for policy 0, policy_version 317347 (0.0007) [2023-12-27 21:30:36,889][106226] Updated weights for policy 0, policy_version 317357 (0.0006) [2023-12-27 21:30:37,043][106225] Updated weights for policy 1, policy_version 317973 (0.0011) [2023-12-27 21:30:37,104][106225] Updated weights for policy 1, policy_version 317983 (0.0010) [2023-12-27 21:30:37,165][106225] Updated weights for policy 1, policy_version 317993 (0.0010) [2023-12-27 21:30:37,574][106226] Updated weights for policy 0, policy_version 317367 (0.0008) [2023-12-27 21:30:37,628][106226] Updated weights for policy 0, policy_version 317377 (0.0008) [2023-12-27 21:30:37,692][106226] Updated weights for policy 0, policy_version 317387 (0.0009) [2023-12-27 21:30:37,853][106225] Updated weights for policy 1, policy_version 318003 (0.0010) [2023-12-27 21:30:37,907][106225] Updated weights for policy 1, policy_version 318013 (0.0008) [2023-12-27 21:30:37,963][106225] Updated weights for policy 1, policy_version 318023 (0.0008) [2023-12-27 21:30:38,430][106226] Updated weights for policy 0, policy_version 317397 (0.0007) [2023-12-27 21:30:38,496][106226] Updated weights for policy 0, policy_version 317407 (0.0007) [2023-12-27 21:30:38,563][106226] Updated weights for policy 0, policy_version 317417 (0.0009) [2023-12-27 21:30:38,669][106225] Updated weights for policy 1, policy_version 318033 (0.0008) [2023-12-27 21:30:38,734][106225] Updated weights for policy 1, policy_version 318043 (0.0006) [2023-12-27 21:30:38,801][106225] Updated weights for policy 1, policy_version 318053 (0.0007) [2023-12-27 21:30:38,867][106225] Updated weights for policy 1, policy_version 318063 (0.0007) [2023-12-27 21:30:39,341][106226] Updated weights for policy 0, policy_version 317427 (0.0009) [2023-12-27 21:30:39,413][106226] Updated weights for policy 0, policy_version 317437 (0.0010) [2023-12-27 21:30:39,483][106226] Updated weights for policy 0, policy_version 317447 (0.0008) [2023-12-27 21:30:39,488][106225] Updated weights for policy 1, policy_version 318073 (0.0008) [2023-12-27 21:30:39,544][106225] Updated weights for policy 1, policy_version 318083 (0.0008) [2023-12-27 21:30:39,594][106225] Updated weights for policy 1, policy_version 318093 (0.0010) [2023-12-27 21:30:40,162][106226] Updated weights for policy 0, policy_version 317457 (0.0007) [2023-12-27 21:30:40,232][106226] Updated weights for policy 0, policy_version 317467 (0.0005) [2023-12-27 21:30:40,299][106226] Updated weights for policy 0, policy_version 317477 (0.0008) [2023-12-27 21:30:40,348][106226] Updated weights for policy 0, policy_version 317487 (0.0009) [2023-12-27 21:30:40,394][106225] Updated weights for policy 1, policy_version 318103 (0.0007) [2023-12-27 21:30:40,443][106225] Updated weights for policy 1, policy_version 318113 (0.0007) [2023-12-27 21:30:40,496][106225] Updated weights for policy 1, policy_version 318123 (0.0005) [2023-12-27 21:30:41,155][106225] Updated weights for policy 1, policy_version 318133 (0.0008) [2023-12-27 21:30:41,165][106226] Updated weights for policy 0, policy_version 317497 (0.0008) [2023-12-27 21:30:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 162766848. Throughput: 0: 9861.8, 1: 9919.0. Samples: 162743268. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:30:41,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.444')] [2023-12-27 21:30:41,220][106225] Updated weights for policy 1, policy_version 318143 (0.0010) [2023-12-27 21:30:41,227][106226] Updated weights for policy 0, policy_version 317507 (0.0007) [2023-12-27 21:30:41,284][106225] Updated weights for policy 1, policy_version 318153 (0.0010) [2023-12-27 21:30:41,294][106226] Updated weights for policy 0, policy_version 317517 (0.0007) [2023-12-27 21:30:41,311][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000317520_81313792.pth... [2023-12-27 21:30:41,314][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000316368_81018880.pth [2023-12-27 21:30:41,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000318160_81469440.pth... [2023-12-27 21:30:41,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000316976_81166336.pth [2023-12-27 21:30:42,048][106225] Updated weights for policy 1, policy_version 318163 (0.0009) [2023-12-27 21:30:42,108][106225] Updated weights for policy 1, policy_version 318173 (0.0007) [2023-12-27 21:30:42,119][106226] Updated weights for policy 0, policy_version 317527 (0.0008) [2023-12-27 21:30:42,157][106225] Updated weights for policy 1, policy_version 318183 (0.0006) [2023-12-27 21:30:42,182][106226] Updated weights for policy 0, policy_version 317537 (0.0008) [2023-12-27 21:30:42,246][106226] Updated weights for policy 0, policy_version 317547 (0.0009) [2023-12-27 21:30:42,894][106225] Updated weights for policy 1, policy_version 318193 (0.0006) [2023-12-27 21:30:42,909][106226] Updated weights for policy 0, policy_version 317557 (0.0009) [2023-12-27 21:30:42,947][106225] Updated weights for policy 1, policy_version 318203 (0.0006) [2023-12-27 21:30:42,965][106226] Updated weights for policy 0, policy_version 317567 (0.0008) [2023-12-27 21:30:43,010][106225] Updated weights for policy 1, policy_version 318213 (0.0006) [2023-12-27 21:30:43,023][106226] Updated weights for policy 0, policy_version 317577 (0.0008) [2023-12-27 21:30:43,072][106225] Updated weights for policy 1, policy_version 318223 (0.0007) [2023-12-27 21:30:43,717][106226] Updated weights for policy 0, policy_version 317587 (0.0008) [2023-12-27 21:30:43,767][106226] Updated weights for policy 0, policy_version 317597 (0.0009) [2023-12-27 21:30:43,774][106225] Updated weights for policy 1, policy_version 318233 (0.0005) [2023-12-27 21:30:43,818][106226] Updated weights for policy 0, policy_version 317607 (0.0006) [2023-12-27 21:30:43,832][106225] Updated weights for policy 1, policy_version 318243 (0.0006) [2023-12-27 21:30:43,890][106225] Updated weights for policy 1, policy_version 318253 (0.0008) [2023-12-27 21:30:44,514][106226] Updated weights for policy 0, policy_version 317617 (0.0006) [2023-12-27 21:30:44,576][106226] Updated weights for policy 0, policy_version 317627 (0.0009) [2023-12-27 21:30:44,584][106225] Updated weights for policy 1, policy_version 318263 (0.0010) [2023-12-27 21:30:44,632][106226] Updated weights for policy 0, policy_version 317637 (0.0007) [2023-12-27 21:30:44,646][106225] Updated weights for policy 1, policy_version 318273 (0.0011) [2023-12-27 21:30:44,691][106226] Updated weights for policy 0, policy_version 317647 (0.0006) [2023-12-27 21:30:44,704][106225] Updated weights for policy 1, policy_version 318283 (0.0011) [2023-12-27 21:30:45,435][106225] Updated weights for policy 1, policy_version 318293 (0.0010) [2023-12-27 21:30:45,465][106226] Updated weights for policy 0, policy_version 317657 (0.0010) [2023-12-27 21:30:45,495][106225] Updated weights for policy 1, policy_version 318303 (0.0010) [2023-12-27 21:30:45,523][106226] Updated weights for policy 0, policy_version 317667 (0.0006) [2023-12-27 21:30:45,550][106225] Updated weights for policy 1, policy_version 318313 (0.0010) [2023-12-27 21:30:45,580][106226] Updated weights for policy 0, policy_version 317677 (0.0008) [2023-12-27 21:30:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 162865152. Throughput: 0: 9862.0, 1: 9913.2. Samples: 162857892. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:30:46,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.635')] [2023-12-27 21:30:46,280][106225] Updated weights for policy 1, policy_version 318323 (0.0009) [2023-12-27 21:30:46,319][106226] Updated weights for policy 0, policy_version 317687 (0.0009) [2023-12-27 21:30:46,333][106225] Updated weights for policy 1, policy_version 318333 (0.0007) [2023-12-27 21:30:46,378][106226] Updated weights for policy 0, policy_version 317697 (0.0007) [2023-12-27 21:30:46,387][106225] Updated weights for policy 1, policy_version 318343 (0.0007) [2023-12-27 21:30:46,437][106226] Updated weights for policy 0, policy_version 317707 (0.0008) [2023-12-27 21:30:47,131][106225] Updated weights for policy 1, policy_version 318353 (0.0009) [2023-12-27 21:30:47,175][106226] Updated weights for policy 0, policy_version 317717 (0.0007) [2023-12-27 21:30:47,194][106225] Updated weights for policy 1, policy_version 318363 (0.0008) [2023-12-27 21:30:47,240][106226] Updated weights for policy 0, policy_version 317727 (0.0006) [2023-12-27 21:30:47,250][106225] Updated weights for policy 1, policy_version 318373 (0.0006) [2023-12-27 21:30:47,295][106226] Updated weights for policy 0, policy_version 317737 (0.0006) [2023-12-27 21:30:47,309][106225] Updated weights for policy 1, policy_version 318383 (0.0006) [2023-12-27 21:30:48,026][106225] Updated weights for policy 1, policy_version 318393 (0.0008) [2023-12-27 21:30:48,028][106226] Updated weights for policy 0, policy_version 317747 (0.0007) [2023-12-27 21:30:48,068][106225] Updated weights for policy 1, policy_version 318403 (0.0006) [2023-12-27 21:30:48,093][106226] Updated weights for policy 0, policy_version 317757 (0.0007) [2023-12-27 21:30:48,116][106225] Updated weights for policy 1, policy_version 318413 (0.0009) [2023-12-27 21:30:48,151][106226] Updated weights for policy 0, policy_version 317767 (0.0008) [2023-12-27 21:30:48,856][106226] Updated weights for policy 0, policy_version 317777 (0.0009) [2023-12-27 21:30:48,926][106226] Updated weights for policy 0, policy_version 317787 (0.0008) [2023-12-27 21:30:48,989][106226] Updated weights for policy 0, policy_version 317797 (0.0008) [2023-12-27 21:30:49,004][106225] Updated weights for policy 1, policy_version 318423 (0.0006) [2023-12-27 21:30:49,049][106226] Updated weights for policy 0, policy_version 317807 (0.0006) [2023-12-27 21:30:49,070][106225] Updated weights for policy 1, policy_version 318433 (0.0008) [2023-12-27 21:30:49,141][106225] Updated weights for policy 1, policy_version 318443 (0.0009) [2023-12-27 21:30:49,757][106226] Updated weights for policy 0, policy_version 317817 (0.0007) [2023-12-27 21:30:49,818][106226] Updated weights for policy 0, policy_version 317827 (0.0008) [2023-12-27 21:30:49,896][106226] Updated weights for policy 0, policy_version 317838 (0.0008) [2023-12-27 21:30:49,976][106225] Updated weights for policy 1, policy_version 318453 (0.0009) [2023-12-27 21:30:50,045][106225] Updated weights for policy 1, policy_version 318463 (0.0010) [2023-12-27 21:30:50,112][106225] Updated weights for policy 1, policy_version 318473 (0.0009) [2023-12-27 21:30:50,573][106226] Updated weights for policy 0, policy_version 317848 (0.0008) [2023-12-27 21:30:50,643][106226] Updated weights for policy 0, policy_version 317858 (0.0009) [2023-12-27 21:30:50,706][106226] Updated weights for policy 0, policy_version 317868 (0.0009) [2023-12-27 21:30:50,945][106225] Updated weights for policy 1, policy_version 318483 (0.0009) [2023-12-27 21:30:51,003][106225] Updated weights for policy 1, policy_version 318493 (0.0008) [2023-12-27 21:30:51,073][106225] Updated weights for policy 1, policy_version 318503 (0.0008) [2023-12-27 21:30:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 162963456. Throughput: 0: 9793.3, 1: 9832.0. Samples: 162970056. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:30:51,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-5.379')] [2023-12-27 21:30:51,436][106226] Updated weights for policy 0, policy_version 317878 (0.0009) [2023-12-27 21:30:51,498][106226] Updated weights for policy 0, policy_version 317888 (0.0009) [2023-12-27 21:30:51,566][106226] Updated weights for policy 0, policy_version 317898 (0.0007) [2023-12-27 21:30:51,832][106225] Updated weights for policy 1, policy_version 318513 (0.0009) [2023-12-27 21:30:51,901][106225] Updated weights for policy 1, policy_version 318523 (0.0009) [2023-12-27 21:30:51,960][106225] Updated weights for policy 1, policy_version 318533 (0.0008) [2023-12-27 21:30:52,015][106225] Updated weights for policy 1, policy_version 318543 (0.0008) [2023-12-27 21:30:52,269][106226] Updated weights for policy 0, policy_version 317908 (0.0008) [2023-12-27 21:30:52,336][106226] Updated weights for policy 0, policy_version 317918 (0.0010) [2023-12-27 21:30:52,409][106226] Updated weights for policy 0, policy_version 317928 (0.0009) [2023-12-27 21:30:52,773][106225] Updated weights for policy 1, policy_version 318553 (0.0008) [2023-12-27 21:30:52,833][106225] Updated weights for policy 1, policy_version 318563 (0.0009) [2023-12-27 21:30:52,897][106225] Updated weights for policy 1, policy_version 318573 (0.0009) [2023-12-27 21:30:53,102][106226] Updated weights for policy 0, policy_version 317938 (0.0007) [2023-12-27 21:30:53,170][106226] Updated weights for policy 0, policy_version 317948 (0.0006) [2023-12-27 21:30:53,232][106226] Updated weights for policy 0, policy_version 317958 (0.0008) [2023-12-27 21:30:53,281][106226] Updated weights for policy 0, policy_version 317968 (0.0009) [2023-12-27 21:30:53,620][106225] Updated weights for policy 1, policy_version 318583 (0.0008) [2023-12-27 21:30:53,678][106225] Updated weights for policy 1, policy_version 318593 (0.0010) [2023-12-27 21:30:53,731][106225] Updated weights for policy 1, policy_version 318603 (0.0009) [2023-12-27 21:30:53,844][106226] Updated weights for policy 0, policy_version 317978 (0.0009) [2023-12-27 21:30:53,897][106226] Updated weights for policy 0, policy_version 317988 (0.0009) [2023-12-27 21:30:53,960][106226] Updated weights for policy 0, policy_version 317998 (0.0009) [2023-12-27 21:30:54,489][106225] Updated weights for policy 1, policy_version 318613 (0.0008) [2023-12-27 21:30:54,549][106225] Updated weights for policy 1, policy_version 318623 (0.0008) [2023-12-27 21:30:54,607][106225] Updated weights for policy 1, policy_version 318633 (0.0008) [2023-12-27 21:30:54,712][106226] Updated weights for policy 0, policy_version 318008 (0.0010) [2023-12-27 21:30:54,776][106226] Updated weights for policy 0, policy_version 318018 (0.0010) [2023-12-27 21:30:54,841][106226] Updated weights for policy 0, policy_version 318028 (0.0008) [2023-12-27 21:30:55,365][106225] Updated weights for policy 1, policy_version 318643 (0.0008) [2023-12-27 21:30:55,417][106225] Updated weights for policy 1, policy_version 318653 (0.0008) [2023-12-27 21:30:55,465][106225] Updated weights for policy 1, policy_version 318663 (0.0009) [2023-12-27 21:30:55,506][106226] Updated weights for policy 0, policy_version 318038 (0.0009) [2023-12-27 21:30:55,557][106226] Updated weights for policy 0, policy_version 318048 (0.0008) [2023-12-27 21:30:55,620][106226] Updated weights for policy 0, policy_version 318058 (0.0009) [2023-12-27 21:30:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 163053568. Throughput: 0: 9767.2, 1: 9806.9. Samples: 163026772. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:30:56,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-5.629')] [2023-12-27 21:30:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000318672_81600512.pth... [2023-12-27 21:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000318064_81453056.pth... [2023-12-27 21:30:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000317552_81313792.pth [2023-12-27 21:30:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000316944_81166336.pth [2023-12-27 21:30:56,221][106225] Updated weights for policy 1, policy_version 318673 (0.0007) [2023-12-27 21:30:56,273][106225] Updated weights for policy 1, policy_version 318683 (0.0009) [2023-12-27 21:30:56,324][106225] Updated weights for policy 1, policy_version 318693 (0.0007) [2023-12-27 21:30:56,329][106226] Updated weights for policy 0, policy_version 318068 (0.0008) [2023-12-27 21:30:56,379][106225] Updated weights for policy 1, policy_version 318703 (0.0005) [2023-12-27 21:30:56,387][106226] Updated weights for policy 0, policy_version 318078 (0.0007) [2023-12-27 21:30:56,440][106226] Updated weights for policy 0, policy_version 318088 (0.0009) [2023-12-27 21:30:57,081][106225] Updated weights for policy 1, policy_version 318713 (0.0008) [2023-12-27 21:30:57,138][106225] Updated weights for policy 1, policy_version 318723 (0.0005) [2023-12-27 21:30:57,181][106226] Updated weights for policy 0, policy_version 318098 (0.0008) [2023-12-27 21:30:57,205][106225] Updated weights for policy 1, policy_version 318733 (0.0005) [2023-12-27 21:30:57,235][106226] Updated weights for policy 0, policy_version 318108 (0.0009) [2023-12-27 21:30:57,295][106226] Updated weights for policy 0, policy_version 318118 (0.0009) [2023-12-27 21:30:57,354][106226] Updated weights for policy 0, policy_version 318128 (0.0009) [2023-12-27 21:30:57,859][106225] Updated weights for policy 1, policy_version 318743 (0.0009) [2023-12-27 21:30:57,909][106225] Updated weights for policy 1, policy_version 318753 (0.0008) [2023-12-27 21:30:57,957][106225] Updated weights for policy 1, policy_version 318763 (0.0005) [2023-12-27 21:30:58,065][106226] Updated weights for policy 0, policy_version 318138 (0.0008) [2023-12-27 21:30:58,122][106226] Updated weights for policy 0, policy_version 318148 (0.0007) [2023-12-27 21:30:58,183][106226] Updated weights for policy 0, policy_version 318158 (0.0008) [2023-12-27 21:30:58,720][106225] Updated weights for policy 1, policy_version 318773 (0.0007) [2023-12-27 21:30:58,792][106225] Updated weights for policy 1, policy_version 318783 (0.0008) [2023-12-27 21:30:58,861][106225] Updated weights for policy 1, policy_version 318793 (0.0009) [2023-12-27 21:30:59,001][106226] Updated weights for policy 0, policy_version 318168 (0.0009) [2023-12-27 21:30:59,065][106226] Updated weights for policy 0, policy_version 318178 (0.0007) [2023-12-27 21:30:59,126][106226] Updated weights for policy 0, policy_version 318188 (0.0010) [2023-12-27 21:30:59,677][106225] Updated weights for policy 1, policy_version 318803 (0.0008) [2023-12-27 21:30:59,731][106225] Updated weights for policy 1, policy_version 318813 (0.0007) [2023-12-27 21:30:59,793][106225] Updated weights for policy 1, policy_version 318823 (0.0010) [2023-12-27 21:30:59,969][106226] Updated weights for policy 0, policy_version 318198 (0.0009) [2023-12-27 21:31:00,033][106226] Updated weights for policy 0, policy_version 318208 (0.0008) [2023-12-27 21:31:00,092][106226] Updated weights for policy 0, policy_version 318218 (0.0008) [2023-12-27 21:31:00,561][106225] Updated weights for policy 1, policy_version 318833 (0.0009) [2023-12-27 21:31:00,616][106225] Updated weights for policy 1, policy_version 318843 (0.0009) [2023-12-27 21:31:00,667][106225] Updated weights for policy 1, policy_version 318853 (0.0009) [2023-12-27 21:31:00,714][106225] Updated weights for policy 1, policy_version 318863 (0.0008) [2023-12-27 21:31:00,719][106226] Updated weights for policy 0, policy_version 318228 (0.0008) [2023-12-27 21:31:00,772][106226] Updated weights for policy 0, policy_version 318238 (0.0008) [2023-12-27 21:31:00,835][106226] Updated weights for policy 0, policy_version 318248 (0.0005) [2023-12-27 21:31:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 163151872. Throughput: 0: 9731.4, 1: 9776.5. Samples: 163140000. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:01,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.506')] [2023-12-27 21:31:01,472][106226] Updated weights for policy 0, policy_version 318258 (0.0008) [2023-12-27 21:31:01,536][106226] Updated weights for policy 0, policy_version 318268 (0.0007) [2023-12-27 21:31:01,546][106225] Updated weights for policy 1, policy_version 318873 (0.0006) [2023-12-27 21:31:01,599][106226] Updated weights for policy 0, policy_version 318278 (0.0008) [2023-12-27 21:31:01,602][106225] Updated weights for policy 1, policy_version 318883 (0.0006) [2023-12-27 21:31:01,667][106226] Updated weights for policy 0, policy_version 318288 (0.0009) [2023-12-27 21:31:01,667][106225] Updated weights for policy 1, policy_version 318893 (0.0008) [2023-12-27 21:31:02,324][106226] Updated weights for policy 0, policy_version 318298 (0.0007) [2023-12-27 21:31:02,390][106226] Updated weights for policy 0, policy_version 318308 (0.0009) [2023-12-27 21:31:02,412][106225] Updated weights for policy 1, policy_version 318903 (0.0009) [2023-12-27 21:31:02,451][106226] Updated weights for policy 0, policy_version 318318 (0.0006) [2023-12-27 21:31:02,477][106225] Updated weights for policy 1, policy_version 318913 (0.0008) [2023-12-27 21:31:02,546][106225] Updated weights for policy 1, policy_version 318923 (0.0009) [2023-12-27 21:31:03,172][106225] Updated weights for policy 1, policy_version 318933 (0.0006) [2023-12-27 21:31:03,204][106226] Updated weights for policy 0, policy_version 318328 (0.0008) [2023-12-27 21:31:03,237][106225] Updated weights for policy 1, policy_version 318943 (0.0006) [2023-12-27 21:31:03,262][106226] Updated weights for policy 0, policy_version 318338 (0.0006) [2023-12-27 21:31:03,282][106225] Updated weights for policy 1, policy_version 318953 (0.0008) [2023-12-27 21:31:03,319][106226] Updated weights for policy 0, policy_version 318348 (0.0005) [2023-12-27 21:31:03,818][106225] Updated weights for policy 1, policy_version 318963 (0.0006) [2023-12-27 21:31:03,886][106225] Updated weights for policy 1, policy_version 318973 (0.0007) [2023-12-27 21:31:03,937][106225] Updated weights for policy 1, policy_version 318983 (0.0009) [2023-12-27 21:31:03,987][106226] Updated weights for policy 0, policy_version 318358 (0.0009) [2023-12-27 21:31:04,056][106226] Updated weights for policy 0, policy_version 318368 (0.0010) [2023-12-27 21:31:04,120][106226] Updated weights for policy 0, policy_version 318378 (0.0009) [2023-12-27 21:31:04,707][106225] Updated weights for policy 1, policy_version 318993 (0.0008) [2023-12-27 21:31:04,761][106225] Updated weights for policy 1, policy_version 319003 (0.0008) [2023-12-27 21:31:04,808][106225] Updated weights for policy 1, policy_version 319013 (0.0007) [2023-12-27 21:31:04,851][106226] Updated weights for policy 0, policy_version 318388 (0.0007) [2023-12-27 21:31:04,864][106225] Updated weights for policy 1, policy_version 319023 (0.0008) [2023-12-27 21:31:04,914][106226] Updated weights for policy 0, policy_version 318398 (0.0006) [2023-12-27 21:31:04,965][106226] Updated weights for policy 0, policy_version 318408 (0.0006) [2023-12-27 21:31:05,603][106225] Updated weights for policy 1, policy_version 319033 (0.0005) [2023-12-27 21:31:05,627][106226] Updated weights for policy 0, policy_version 318418 (0.0010) [2023-12-27 21:31:05,657][106225] Updated weights for policy 1, policy_version 319043 (0.0006) [2023-12-27 21:31:05,683][106226] Updated weights for policy 0, policy_version 318428 (0.0009) [2023-12-27 21:31:05,702][106225] Updated weights for policy 1, policy_version 319053 (0.0006) [2023-12-27 21:31:05,743][106226] Updated weights for policy 0, policy_version 318438 (0.0008) [2023-12-27 21:31:05,797][106226] Updated weights for policy 0, policy_version 318448 (0.0009) [2023-12-27 21:31:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 163250176. Throughput: 0: 9717.5, 1: 9742.0. Samples: 163259564. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:06,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.719')] [2023-12-27 21:31:06,438][106225] Updated weights for policy 1, policy_version 319063 (0.0007) [2023-12-27 21:31:06,505][106225] Updated weights for policy 1, policy_version 319073 (0.0007) [2023-12-27 21:31:06,515][106226] Updated weights for policy 0, policy_version 318458 (0.0008) [2023-12-27 21:31:06,570][106225] Updated weights for policy 1, policy_version 319083 (0.0006) [2023-12-27 21:31:06,571][106226] Updated weights for policy 0, policy_version 318468 (0.0007) [2023-12-27 21:31:06,628][106226] Updated weights for policy 0, policy_version 318478 (0.0008) [2023-12-27 21:31:07,280][106225] Updated weights for policy 1, policy_version 319093 (0.0007) [2023-12-27 21:31:07,335][106226] Updated weights for policy 0, policy_version 318488 (0.0008) [2023-12-27 21:31:07,341][106225] Updated weights for policy 1, policy_version 319103 (0.0008) [2023-12-27 21:31:07,392][106226] Updated weights for policy 0, policy_version 318498 (0.0006) [2023-12-27 21:31:07,402][106225] Updated weights for policy 1, policy_version 319113 (0.0007) [2023-12-27 21:31:07,450][106226] Updated weights for policy 0, policy_version 318508 (0.0006) [2023-12-27 21:31:08,047][106225] Updated weights for policy 1, policy_version 319123 (0.0007) [2023-12-27 21:31:08,096][106225] Updated weights for policy 1, policy_version 319133 (0.0008) [2023-12-27 21:31:08,145][106225] Updated weights for policy 1, policy_version 319143 (0.0008) [2023-12-27 21:31:08,183][106226] Updated weights for policy 0, policy_version 318518 (0.0007) [2023-12-27 21:31:08,235][106226] Updated weights for policy 0, policy_version 318528 (0.0007) [2023-12-27 21:31:08,279][106226] Updated weights for policy 0, policy_version 318538 (0.0008) [2023-12-27 21:31:08,898][106225] Updated weights for policy 1, policy_version 319153 (0.0008) [2023-12-27 21:31:08,952][106225] Updated weights for policy 1, policy_version 319163 (0.0008) [2023-12-27 21:31:09,009][106226] Updated weights for policy 0, policy_version 318548 (0.0009) [2023-12-27 21:31:09,011][106225] Updated weights for policy 1, policy_version 319173 (0.0007) [2023-12-27 21:31:09,063][106225] Updated weights for policy 1, policy_version 319183 (0.0006) [2023-12-27 21:31:09,064][106226] Updated weights for policy 0, policy_version 318558 (0.0006) [2023-12-27 21:31:09,112][106226] Updated weights for policy 0, policy_version 318568 (0.0005) [2023-12-27 21:31:09,807][106225] Updated weights for policy 1, policy_version 319193 (0.0006) [2023-12-27 21:31:09,848][106226] Updated weights for policy 0, policy_version 318578 (0.0007) [2023-12-27 21:31:09,879][106225] Updated weights for policy 1, policy_version 319203 (0.0007) [2023-12-27 21:31:09,909][106226] Updated weights for policy 0, policy_version 318588 (0.0007) [2023-12-27 21:31:09,939][106225] Updated weights for policy 1, policy_version 319213 (0.0008) [2023-12-27 21:31:09,977][106226] Updated weights for policy 0, policy_version 318598 (0.0008) [2023-12-27 21:31:10,038][106226] Updated weights for policy 0, policy_version 318608 (0.0008) [2023-12-27 21:31:10,616][106225] Updated weights for policy 1, policy_version 319223 (0.0009) [2023-12-27 21:31:10,668][106225] Updated weights for policy 1, policy_version 319233 (0.0008) [2023-12-27 21:31:10,722][106225] Updated weights for policy 1, policy_version 319243 (0.0008) [2023-12-27 21:31:10,812][106226] Updated weights for policy 0, policy_version 318618 (0.0008) [2023-12-27 21:31:10,869][106226] Updated weights for policy 0, policy_version 318628 (0.0011) [2023-12-27 21:31:10,927][106226] Updated weights for policy 0, policy_version 318638 (0.0008) [2023-12-27 21:31:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 163348480. Throughput: 0: 9701.2, 1: 9749.9. Samples: 163318236. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:11,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-5.604')] [2023-12-27 21:31:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000319248_81747968.pth... [2023-12-27 21:31:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000318640_81600512.pth... [2023-12-27 21:31:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000318160_81469440.pth [2023-12-27 21:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000317520_81313792.pth [2023-12-27 21:31:11,508][106225] Updated weights for policy 1, policy_version 319253 (0.0007) [2023-12-27 21:31:11,566][106225] Updated weights for policy 1, policy_version 319263 (0.0008) [2023-12-27 21:31:11,628][106225] Updated weights for policy 1, policy_version 319273 (0.0008) [2023-12-27 21:31:11,705][106226] Updated weights for policy 0, policy_version 318648 (0.0008) [2023-12-27 21:31:11,776][106226] Updated weights for policy 0, policy_version 318658 (0.0008) [2023-12-27 21:31:11,829][106226] Updated weights for policy 0, policy_version 318668 (0.0008) [2023-12-27 21:31:12,374][106225] Updated weights for policy 1, policy_version 319283 (0.0009) [2023-12-27 21:31:12,443][106225] Updated weights for policy 1, policy_version 319293 (0.0008) [2023-12-27 21:31:12,506][106225] Updated weights for policy 1, policy_version 319303 (0.0008) [2023-12-27 21:31:12,548][106226] Updated weights for policy 0, policy_version 318678 (0.0007) [2023-12-27 21:31:12,607][106226] Updated weights for policy 0, policy_version 318688 (0.0008) [2023-12-27 21:31:12,667][106226] Updated weights for policy 0, policy_version 318698 (0.0009) [2023-12-27 21:31:13,198][106225] Updated weights for policy 1, policy_version 319313 (0.0009) [2023-12-27 21:31:13,261][106225] Updated weights for policy 1, policy_version 319323 (0.0005) [2023-12-27 21:31:13,319][106225] Updated weights for policy 1, policy_version 319333 (0.0005) [2023-12-27 21:31:13,376][106225] Updated weights for policy 1, policy_version 319343 (0.0005) [2023-12-27 21:31:13,381][106226] Updated weights for policy 0, policy_version 318708 (0.0008) [2023-12-27 21:31:13,430][106226] Updated weights for policy 0, policy_version 318718 (0.0010) [2023-12-27 21:31:13,491][106226] Updated weights for policy 0, policy_version 318728 (0.0008) [2023-12-27 21:31:13,968][106225] Updated weights for policy 1, policy_version 319353 (0.0008) [2023-12-27 21:31:14,013][106225] Updated weights for policy 1, policy_version 319363 (0.0008) [2023-12-27 21:31:14,065][106225] Updated weights for policy 1, policy_version 319373 (0.0006) [2023-12-27 21:31:14,139][106226] Updated weights for policy 0, policy_version 318738 (0.0009) [2023-12-27 21:31:14,194][106226] Updated weights for policy 0, policy_version 318748 (0.0008) [2023-12-27 21:31:14,261][106226] Updated weights for policy 0, policy_version 318758 (0.0011) [2023-12-27 21:31:14,321][106226] Updated weights for policy 0, policy_version 318768 (0.0009) [2023-12-27 21:31:14,807][106225] Updated weights for policy 1, policy_version 319383 (0.0009) [2023-12-27 21:31:14,868][106225] Updated weights for policy 1, policy_version 319393 (0.0009) [2023-12-27 21:31:14,933][106225] Updated weights for policy 1, policy_version 319403 (0.0008) [2023-12-27 21:31:15,100][106226] Updated weights for policy 0, policy_version 318778 (0.0009) [2023-12-27 21:31:15,168][106226] Updated weights for policy 0, policy_version 318788 (0.0009) [2023-12-27 21:31:15,226][106226] Updated weights for policy 0, policy_version 318798 (0.0008) [2023-12-27 21:31:15,638][106225] Updated weights for policy 1, policy_version 319413 (0.0009) [2023-12-27 21:31:15,709][106225] Updated weights for policy 1, policy_version 319423 (0.0008) [2023-12-27 21:31:15,764][106225] Updated weights for policy 1, policy_version 319433 (0.0009) [2023-12-27 21:31:15,956][106226] Updated weights for policy 0, policy_version 318808 (0.0008) [2023-12-27 21:31:16,008][106226] Updated weights for policy 0, policy_version 318818 (0.0008) [2023-12-27 21:31:16,064][106226] Updated weights for policy 0, policy_version 318828 (0.0008) [2023-12-27 21:31:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 163446784. Throughput: 0: 9633.5, 1: 9657.4. Samples: 163433976. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:16,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.611')] [2023-12-27 21:31:16,420][106225] Updated weights for policy 1, policy_version 319443 (0.0008) [2023-12-27 21:31:16,485][106225] Updated weights for policy 1, policy_version 319453 (0.0010) [2023-12-27 21:31:16,542][106225] Updated weights for policy 1, policy_version 319463 (0.0010) [2023-12-27 21:31:16,806][106226] Updated weights for policy 0, policy_version 318838 (0.0008) [2023-12-27 21:31:16,872][106226] Updated weights for policy 0, policy_version 318848 (0.0008) [2023-12-27 21:31:16,923][106226] Updated weights for policy 0, policy_version 318858 (0.0008) [2023-12-27 21:31:17,151][106225] Updated weights for policy 1, policy_version 319473 (0.0010) [2023-12-27 21:31:17,205][106225] Updated weights for policy 1, policy_version 319483 (0.0010) [2023-12-27 21:31:17,252][106225] Updated weights for policy 1, policy_version 319493 (0.0010) [2023-12-27 21:31:17,302][106225] Updated weights for policy 1, policy_version 319503 (0.0010) [2023-12-27 21:31:17,649][106226] Updated weights for policy 0, policy_version 318868 (0.0009) [2023-12-27 21:31:17,699][106226] Updated weights for policy 0, policy_version 318878 (0.0007) [2023-12-27 21:31:17,748][106226] Updated weights for policy 0, policy_version 318888 (0.0005) [2023-12-27 21:31:18,094][106225] Updated weights for policy 1, policy_version 319513 (0.0008) [2023-12-27 21:31:18,147][106225] Updated weights for policy 1, policy_version 319523 (0.0006) [2023-12-27 21:31:18,206][106225] Updated weights for policy 1, policy_version 319533 (0.0005) [2023-12-27 21:31:18,304][106226] Updated weights for policy 0, policy_version 318898 (0.0005) [2023-12-27 21:31:18,372][106226] Updated weights for policy 0, policy_version 318908 (0.0009) [2023-12-27 21:31:18,436][106226] Updated weights for policy 0, policy_version 318918 (0.0011) [2023-12-27 21:31:18,501][106226] Updated weights for policy 0, policy_version 318928 (0.0010) [2023-12-27 21:31:18,865][106225] Updated weights for policy 1, policy_version 319543 (0.0009) [2023-12-27 21:31:18,931][106225] Updated weights for policy 1, policy_version 319553 (0.0010) [2023-12-27 21:31:18,995][106225] Updated weights for policy 1, policy_version 319563 (0.0010) [2023-12-27 21:31:19,084][106226] Updated weights for policy 0, policy_version 318938 (0.0007) [2023-12-27 21:31:19,145][106226] Updated weights for policy 0, policy_version 318948 (0.0008) [2023-12-27 21:31:19,215][106226] Updated weights for policy 0, policy_version 318958 (0.0008) [2023-12-27 21:31:19,747][106225] Updated weights for policy 1, policy_version 319573 (0.0010) [2023-12-27 21:31:19,806][106225] Updated weights for policy 1, policy_version 319583 (0.0010) [2023-12-27 21:31:19,870][106225] Updated weights for policy 1, policy_version 319593 (0.0008) [2023-12-27 21:31:19,926][106226] Updated weights for policy 0, policy_version 318968 (0.0007) [2023-12-27 21:31:19,991][106226] Updated weights for policy 0, policy_version 318978 (0.0007) [2023-12-27 21:31:20,057][106226] Updated weights for policy 0, policy_version 318988 (0.0006) [2023-12-27 21:31:20,604][106225] Updated weights for policy 1, policy_version 319603 (0.0008) [2023-12-27 21:31:20,676][106225] Updated weights for policy 1, policy_version 319613 (0.0009) [2023-12-27 21:31:20,739][106225] Updated weights for policy 1, policy_version 319623 (0.0010) [2023-12-27 21:31:20,773][106226] Updated weights for policy 0, policy_version 318998 (0.0009) [2023-12-27 21:31:20,844][106226] Updated weights for policy 0, policy_version 319008 (0.0008) [2023-12-27 21:31:20,916][106226] Updated weights for policy 0, policy_version 319018 (0.0008) [2023-12-27 21:31:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19771.9). Total num frames: 163545088. Throughput: 0: 9670.0, 1: 9615.4. Samples: 163552444. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:21,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-5.514')] [2023-12-27 21:31:21,457][106225] Updated weights for policy 1, policy_version 319633 (0.0010) [2023-12-27 21:31:21,513][106225] Updated weights for policy 1, policy_version 319643 (0.0009) [2023-12-27 21:31:21,575][106225] Updated weights for policy 1, policy_version 319653 (0.0010) [2023-12-27 21:31:21,654][106225] Updated weights for policy 1, policy_version 319663 (0.0011) [2023-12-27 21:31:21,716][106226] Updated weights for policy 0, policy_version 319028 (0.0009) [2023-12-27 21:31:21,783][106226] Updated weights for policy 0, policy_version 319038 (0.0008) [2023-12-27 21:31:21,849][106226] Updated weights for policy 0, policy_version 319048 (0.0008) [2023-12-27 21:31:22,396][106225] Updated weights for policy 1, policy_version 319673 (0.0011) [2023-12-27 21:31:22,451][106225] Updated weights for policy 1, policy_version 319683 (0.0010) [2023-12-27 21:31:22,512][106225] Updated weights for policy 1, policy_version 319693 (0.0010) [2023-12-27 21:31:22,602][106226] Updated weights for policy 0, policy_version 319058 (0.0008) [2023-12-27 21:31:22,665][106226] Updated weights for policy 0, policy_version 319068 (0.0008) [2023-12-27 21:31:22,733][106226] Updated weights for policy 0, policy_version 319078 (0.0008) [2023-12-27 21:31:22,791][106226] Updated weights for policy 0, policy_version 319088 (0.0007) [2023-12-27 21:31:23,250][106225] Updated weights for policy 1, policy_version 319703 (0.0011) [2023-12-27 21:31:23,297][106225] Updated weights for policy 1, policy_version 319713 (0.0010) [2023-12-27 21:31:23,361][106225] Updated weights for policy 1, policy_version 319723 (0.0010) [2023-12-27 21:31:23,539][106226] Updated weights for policy 0, policy_version 319098 (0.0007) [2023-12-27 21:31:23,596][106226] Updated weights for policy 0, policy_version 319108 (0.0008) [2023-12-27 21:31:23,651][106226] Updated weights for policy 0, policy_version 319118 (0.0010) [2023-12-27 21:31:23,978][106225] Updated weights for policy 1, policy_version 319733 (0.0008) [2023-12-27 21:31:24,037][106225] Updated weights for policy 1, policy_version 319743 (0.0007) [2023-12-27 21:31:24,097][106225] Updated weights for policy 1, policy_version 319753 (0.0008) [2023-12-27 21:31:24,365][106226] Updated weights for policy 0, policy_version 319128 (0.0011) [2023-12-27 21:31:24,425][106226] Updated weights for policy 0, policy_version 319138 (0.0010) [2023-12-27 21:31:24,494][106226] Updated weights for policy 0, policy_version 319148 (0.0011) [2023-12-27 21:31:24,824][106225] Updated weights for policy 1, policy_version 319763 (0.0007) [2023-12-27 21:31:24,873][106225] Updated weights for policy 1, policy_version 319773 (0.0008) [2023-12-27 21:31:24,917][106225] Updated weights for policy 1, policy_version 319783 (0.0006) [2023-12-27 21:31:25,191][106226] Updated weights for policy 0, policy_version 319158 (0.0011) [2023-12-27 21:31:25,251][106226] Updated weights for policy 0, policy_version 319168 (0.0010) [2023-12-27 21:31:25,310][106226] Updated weights for policy 0, policy_version 319178 (0.0010) [2023-12-27 21:31:25,645][106225] Updated weights for policy 1, policy_version 319793 (0.0006) [2023-12-27 21:31:25,701][106225] Updated weights for policy 1, policy_version 319803 (0.0008) [2023-12-27 21:31:25,759][106225] Updated weights for policy 1, policy_version 319813 (0.0008) [2023-12-27 21:31:25,816][106225] Updated weights for policy 1, policy_version 319823 (0.0007) [2023-12-27 21:31:25,962][106226] Updated weights for policy 0, policy_version 319188 (0.0008) [2023-12-27 21:31:26,015][106226] Updated weights for policy 0, policy_version 319198 (0.0010) [2023-12-27 21:31:26,074][106226] Updated weights for policy 0, policy_version 319208 (0.0006) [2023-12-27 21:31:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 163643392. Throughput: 0: 9650.1, 1: 9590.2. Samples: 163609084. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:26,176][105115] Avg episode reward: [(0, '-4.783'), (1, '-5.593')] [2023-12-27 21:31:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000319824_81895424.pth... [2023-12-27 21:31:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000319216_81747968.pth... [2023-12-27 21:31:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000318064_81453056.pth [2023-12-27 21:31:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000318672_81600512.pth [2023-12-27 21:31:26,573][106225] Updated weights for policy 1, policy_version 319833 (0.0008) [2023-12-27 21:31:26,624][106225] Updated weights for policy 1, policy_version 319843 (0.0007) [2023-12-27 21:31:26,677][106225] Updated weights for policy 1, policy_version 319853 (0.0008) [2023-12-27 21:31:26,721][106226] Updated weights for policy 0, policy_version 319218 (0.0006) [2023-12-27 21:31:26,770][106226] Updated weights for policy 0, policy_version 319228 (0.0006) [2023-12-27 21:31:26,822][106226] Updated weights for policy 0, policy_version 319238 (0.0010) [2023-12-27 21:31:26,877][106226] Updated weights for policy 0, policy_version 319248 (0.0010) [2023-12-27 21:31:27,398][106225] Updated weights for policy 1, policy_version 319863 (0.0006) [2023-12-27 21:31:27,445][106225] Updated weights for policy 1, policy_version 319873 (0.0005) [2023-12-27 21:31:27,487][106225] Updated weights for policy 1, policy_version 319883 (0.0005) [2023-12-27 21:31:27,599][106226] Updated weights for policy 0, policy_version 319258 (0.0011) [2023-12-27 21:31:27,654][106226] Updated weights for policy 0, policy_version 319268 (0.0010) [2023-12-27 21:31:27,709][106226] Updated weights for policy 0, policy_version 319278 (0.0010) [2023-12-27 21:31:28,059][106225] Updated weights for policy 1, policy_version 319893 (0.0008) [2023-12-27 21:31:28,105][106225] Updated weights for policy 1, policy_version 319903 (0.0010) [2023-12-27 21:31:28,147][106225] Updated weights for policy 1, policy_version 319913 (0.0010) [2023-12-27 21:31:28,376][106226] Updated weights for policy 0, policy_version 319288 (0.0009) [2023-12-27 21:31:28,430][106226] Updated weights for policy 0, policy_version 319298 (0.0008) [2023-12-27 21:31:28,485][106226] Updated weights for policy 0, policy_version 319308 (0.0008) [2023-12-27 21:31:28,904][106225] Updated weights for policy 1, policy_version 319923 (0.0010) [2023-12-27 21:31:28,960][106225] Updated weights for policy 1, policy_version 319933 (0.0009) [2023-12-27 21:31:29,008][106225] Updated weights for policy 1, policy_version 319943 (0.0009) [2023-12-27 21:31:29,221][106226] Updated weights for policy 0, policy_version 319318 (0.0009) [2023-12-27 21:31:29,281][106226] Updated weights for policy 0, policy_version 319328 (0.0009) [2023-12-27 21:31:29,333][106226] Updated weights for policy 0, policy_version 319338 (0.0008) [2023-12-27 21:31:29,723][106225] Updated weights for policy 1, policy_version 319953 (0.0008) [2023-12-27 21:31:29,784][106225] Updated weights for policy 1, policy_version 319963 (0.0005) [2023-12-27 21:31:29,853][106225] Updated weights for policy 1, policy_version 319973 (0.0009) [2023-12-27 21:31:29,921][106225] Updated weights for policy 1, policy_version 319983 (0.0009) [2023-12-27 21:31:30,066][106226] Updated weights for policy 0, policy_version 319348 (0.0008) [2023-12-27 21:31:30,129][106226] Updated weights for policy 0, policy_version 319358 (0.0008) [2023-12-27 21:31:30,184][106226] Updated weights for policy 0, policy_version 319368 (0.0008) [2023-12-27 21:31:30,618][106225] Updated weights for policy 1, policy_version 319993 (0.0010) [2023-12-27 21:31:30,668][106225] Updated weights for policy 1, policy_version 320003 (0.0010) [2023-12-27 21:31:30,717][106225] Updated weights for policy 1, policy_version 320013 (0.0010) [2023-12-27 21:31:30,901][106226] Updated weights for policy 0, policy_version 319378 (0.0007) [2023-12-27 21:31:30,964][106226] Updated weights for policy 0, policy_version 319388 (0.0008) [2023-12-27 21:31:31,025][106226] Updated weights for policy 0, policy_version 319398 (0.0009) [2023-12-27 21:31:31,093][106226] Updated weights for policy 0, policy_version 319408 (0.0006) [2023-12-27 21:31:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19771.9). Total num frames: 163741696. Throughput: 0: 9733.6, 1: 9636.9. Samples: 163729564. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:31,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-5.414')] [2023-12-27 21:31:31,459][106225] Updated weights for policy 1, policy_version 320023 (0.0010) [2023-12-27 21:31:31,522][106225] Updated weights for policy 1, policy_version 320033 (0.0010) [2023-12-27 21:31:31,586][106225] Updated weights for policy 1, policy_version 320043 (0.0010) [2023-12-27 21:31:31,769][106226] Updated weights for policy 0, policy_version 319418 (0.0011) [2023-12-27 21:31:31,830][106226] Updated weights for policy 0, policy_version 319428 (0.0010) [2023-12-27 21:31:31,889][106226] Updated weights for policy 0, policy_version 319438 (0.0005) [2023-12-27 21:31:32,328][106225] Updated weights for policy 1, policy_version 320053 (0.0010) [2023-12-27 21:31:32,395][106225] Updated weights for policy 1, policy_version 320063 (0.0010) [2023-12-27 21:31:32,452][106225] Updated weights for policy 1, policy_version 320073 (0.0010) [2023-12-27 21:31:32,607][106226] Updated weights for policy 0, policy_version 319448 (0.0008) [2023-12-27 21:31:32,666][106226] Updated weights for policy 0, policy_version 319458 (0.0008) [2023-12-27 21:31:32,721][106226] Updated weights for policy 0, policy_version 319468 (0.0008) [2023-12-27 21:31:33,163][106225] Updated weights for policy 1, policy_version 320083 (0.0010) [2023-12-27 21:31:33,225][106225] Updated weights for policy 1, policy_version 320093 (0.0010) [2023-12-27 21:31:33,276][106225] Updated weights for policy 1, policy_version 320103 (0.0010) [2023-12-27 21:31:33,450][106226] Updated weights for policy 0, policy_version 319478 (0.0007) [2023-12-27 21:31:33,521][106226] Updated weights for policy 0, policy_version 319488 (0.0006) [2023-12-27 21:31:33,579][106226] Updated weights for policy 0, policy_version 319498 (0.0008) [2023-12-27 21:31:33,906][106225] Updated weights for policy 1, policy_version 320113 (0.0010) [2023-12-27 21:31:33,960][106225] Updated weights for policy 1, policy_version 320123 (0.0008) [2023-12-27 21:31:34,008][106225] Updated weights for policy 1, policy_version 320133 (0.0007) [2023-12-27 21:31:34,056][106225] Updated weights for policy 1, policy_version 320143 (0.0007) [2023-12-27 21:31:34,219][106226] Updated weights for policy 0, policy_version 319508 (0.0009) [2023-12-27 21:31:34,292][106226] Updated weights for policy 0, policy_version 319518 (0.0008) [2023-12-27 21:31:34,353][106226] Updated weights for policy 0, policy_version 319528 (0.0009) [2023-12-27 21:31:34,822][106225] Updated weights for policy 1, policy_version 320153 (0.0009) [2023-12-27 21:31:34,881][106225] Updated weights for policy 1, policy_version 320163 (0.0008) [2023-12-27 21:31:34,945][106225] Updated weights for policy 1, policy_version 320173 (0.0008) [2023-12-27 21:31:35,038][106226] Updated weights for policy 0, policy_version 319538 (0.0008) [2023-12-27 21:31:35,100][106226] Updated weights for policy 0, policy_version 319548 (0.0006) [2023-12-27 21:31:35,165][106226] Updated weights for policy 0, policy_version 319558 (0.0008) [2023-12-27 21:31:35,223][106226] Updated weights for policy 0, policy_version 319568 (0.0006) [2023-12-27 21:31:35,662][106225] Updated weights for policy 1, policy_version 320183 (0.0009) [2023-12-27 21:31:35,723][106225] Updated weights for policy 1, policy_version 320193 (0.0007) [2023-12-27 21:31:35,752][106226] Updated weights for policy 0, policy_version 319578 (0.0007) [2023-12-27 21:31:35,777][106225] Updated weights for policy 1, policy_version 320203 (0.0006) [2023-12-27 21:31:35,812][106226] Updated weights for policy 0, policy_version 319588 (0.0006) [2023-12-27 21:31:35,863][106226] Updated weights for policy 0, policy_version 319598 (0.0009) [2023-12-27 21:31:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 163840000. Throughput: 0: 9800.6, 1: 9700.6. Samples: 163847612. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:36,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-5.283')] [2023-12-27 21:31:36,499][106225] Updated weights for policy 1, policy_version 320213 (0.0009) [2023-12-27 21:31:36,563][106225] Updated weights for policy 1, policy_version 320223 (0.0009) [2023-12-27 21:31:36,628][106225] Updated weights for policy 1, policy_version 320233 (0.0007) [2023-12-27 21:31:36,639][106226] Updated weights for policy 0, policy_version 319608 (0.0006) [2023-12-27 21:31:36,690][106226] Updated weights for policy 0, policy_version 319618 (0.0006) [2023-12-27 21:31:36,738][106226] Updated weights for policy 0, policy_version 319628 (0.0005) [2023-12-27 21:31:37,289][106226] Updated weights for policy 0, policy_version 319638 (0.0007) [2023-12-27 21:31:37,306][106225] Updated weights for policy 1, policy_version 320243 (0.0008) [2023-12-27 21:31:37,355][106226] Updated weights for policy 0, policy_version 319648 (0.0008) [2023-12-27 21:31:37,358][106225] Updated weights for policy 1, policy_version 320253 (0.0005) [2023-12-27 21:31:37,413][106225] Updated weights for policy 1, policy_version 320263 (0.0006) [2023-12-27 21:31:37,414][106226] Updated weights for policy 0, policy_version 319658 (0.0008) [2023-12-27 21:31:38,080][106225] Updated weights for policy 1, policy_version 320273 (0.0007) [2023-12-27 21:31:38,100][106226] Updated weights for policy 0, policy_version 319668 (0.0007) [2023-12-27 21:31:38,137][106225] Updated weights for policy 1, policy_version 320283 (0.0010) [2023-12-27 21:31:38,156][106226] Updated weights for policy 0, policy_version 319678 (0.0008) [2023-12-27 21:31:38,194][106225] Updated weights for policy 1, policy_version 320293 (0.0010) [2023-12-27 21:31:38,210][106226] Updated weights for policy 0, policy_version 319688 (0.0005) [2023-12-27 21:31:38,255][106225] Updated weights for policy 1, policy_version 320303 (0.0010) [2023-12-27 21:31:38,828][106226] Updated weights for policy 0, policy_version 319698 (0.0006) [2023-12-27 21:31:38,887][106226] Updated weights for policy 0, policy_version 319708 (0.0009) [2023-12-27 21:31:38,945][106226] Updated weights for policy 0, policy_version 319718 (0.0007) [2023-12-27 21:31:38,980][106225] Updated weights for policy 1, policy_version 320313 (0.0009) [2023-12-27 21:31:39,009][106226] Updated weights for policy 0, policy_version 319728 (0.0007) [2023-12-27 21:31:39,044][106225] Updated weights for policy 1, policy_version 320323 (0.0010) [2023-12-27 21:31:39,107][106225] Updated weights for policy 1, policy_version 320333 (0.0010) [2023-12-27 21:31:39,734][106226] Updated weights for policy 0, policy_version 319738 (0.0008) [2023-12-27 21:31:39,794][106225] Updated weights for policy 1, policy_version 320343 (0.0010) [2023-12-27 21:31:39,797][106226] Updated weights for policy 0, policy_version 319748 (0.0007) [2023-12-27 21:31:39,864][106226] Updated weights for policy 0, policy_version 319758 (0.0007) [2023-12-27 21:31:39,870][106225] Updated weights for policy 1, policy_version 320353 (0.0009) [2023-12-27 21:31:39,932][106225] Updated weights for policy 1, policy_version 320363 (0.0009) [2023-12-27 21:31:40,487][106226] Updated weights for policy 0, policy_version 319768 (0.0008) [2023-12-27 21:31:40,537][106226] Updated weights for policy 0, policy_version 319778 (0.0009) [2023-12-27 21:31:40,596][106226] Updated weights for policy 0, policy_version 319788 (0.0008) [2023-12-27 21:31:40,749][106225] Updated weights for policy 1, policy_version 320373 (0.0008) [2023-12-27 21:31:40,801][106225] Updated weights for policy 1, policy_version 320383 (0.0008) [2023-12-27 21:31:40,855][106225] Updated weights for policy 1, policy_version 320393 (0.0006) [2023-12-27 21:31:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 163938304. Throughput: 0: 9848.8, 1: 9771.9. Samples: 163909700. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:41,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.526')] [2023-12-27 21:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000320400_82042880.pth... [2023-12-27 21:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000319792_81895424.pth... [2023-12-27 21:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000318640_81600512.pth [2023-12-27 21:31:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000319248_81747968.pth [2023-12-27 21:31:41,374][106226] Updated weights for policy 0, policy_version 319798 (0.0009) [2023-12-27 21:31:41,441][106226] Updated weights for policy 0, policy_version 319808 (0.0008) [2023-12-27 21:31:41,499][106226] Updated weights for policy 0, policy_version 319818 (0.0008) [2023-12-27 21:31:41,634][106225] Updated weights for policy 1, policy_version 320403 (0.0009) [2023-12-27 21:31:41,701][106225] Updated weights for policy 1, policy_version 320413 (0.0009) [2023-12-27 21:31:41,771][106225] Updated weights for policy 1, policy_version 320423 (0.0008) [2023-12-27 21:31:42,184][106226] Updated weights for policy 0, policy_version 319828 (0.0006) [2023-12-27 21:31:42,245][106226] Updated weights for policy 0, policy_version 319838 (0.0006) [2023-12-27 21:31:42,313][106226] Updated weights for policy 0, policy_version 319848 (0.0009) [2023-12-27 21:31:42,577][106225] Updated weights for policy 1, policy_version 320433 (0.0008) [2023-12-27 21:31:42,642][106225] Updated weights for policy 1, policy_version 320443 (0.0006) [2023-12-27 21:31:42,694][106225] Updated weights for policy 1, policy_version 320453 (0.0006) [2023-12-27 21:31:42,752][106225] Updated weights for policy 1, policy_version 320463 (0.0006) [2023-12-27 21:31:43,009][106226] Updated weights for policy 0, policy_version 319858 (0.0008) [2023-12-27 21:31:43,074][106226] Updated weights for policy 0, policy_version 319868 (0.0008) [2023-12-27 21:31:43,124][106226] Updated weights for policy 0, policy_version 319878 (0.0006) [2023-12-27 21:31:43,175][106226] Updated weights for policy 0, policy_version 319888 (0.0010) [2023-12-27 21:31:43,377][106225] Updated weights for policy 1, policy_version 320473 (0.0005) [2023-12-27 21:31:43,448][106225] Updated weights for policy 1, policy_version 320483 (0.0005) [2023-12-27 21:31:43,506][106225] Updated weights for policy 1, policy_version 320493 (0.0008) [2023-12-27 21:31:43,885][106226] Updated weights for policy 0, policy_version 319898 (0.0007) [2023-12-27 21:31:43,942][106226] Updated weights for policy 0, policy_version 319908 (0.0008) [2023-12-27 21:31:43,997][106226] Updated weights for policy 0, policy_version 319918 (0.0007) [2023-12-27 21:31:44,124][106225] Updated weights for policy 1, policy_version 320503 (0.0007) [2023-12-27 21:31:44,185][106225] Updated weights for policy 1, policy_version 320513 (0.0007) [2023-12-27 21:31:44,239][106225] Updated weights for policy 1, policy_version 320523 (0.0005) [2023-12-27 21:31:44,577][106226] Updated weights for policy 0, policy_version 319928 (0.0008) [2023-12-27 21:31:44,625][106226] Updated weights for policy 0, policy_version 319938 (0.0007) [2023-12-27 21:31:44,679][106226] Updated weights for policy 0, policy_version 319948 (0.0008) [2023-12-27 21:31:44,823][106225] Updated weights for policy 1, policy_version 320533 (0.0006) [2023-12-27 21:31:44,891][106225] Updated weights for policy 1, policy_version 320543 (0.0008) [2023-12-27 21:31:44,958][106225] Updated weights for policy 1, policy_version 320553 (0.0008) [2023-12-27 21:31:45,501][106226] Updated weights for policy 0, policy_version 319958 (0.0008) [2023-12-27 21:31:45,562][106226] Updated weights for policy 0, policy_version 319968 (0.0008) [2023-12-27 21:31:45,617][106226] Updated weights for policy 0, policy_version 319978 (0.0008) [2023-12-27 21:31:45,619][106225] Updated weights for policy 1, policy_version 320563 (0.0007) [2023-12-27 21:31:45,676][106225] Updated weights for policy 1, policy_version 320573 (0.0007) [2023-12-27 21:31:45,735][106225] Updated weights for policy 1, policy_version 320583 (0.0008) [2023-12-27 21:31:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 164036608. Throughput: 0: 9935.0, 1: 9811.8. Samples: 164028608. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-27 21:31:46,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-5.540')] [2023-12-27 21:31:46,259][106226] Updated weights for policy 0, policy_version 319988 (0.0006) [2023-12-27 21:31:46,322][106226] Updated weights for policy 0, policy_version 319998 (0.0008) [2023-12-27 21:31:46,389][106226] Updated weights for policy 0, policy_version 320008 (0.0008) [2023-12-27 21:31:46,478][106225] Updated weights for policy 1, policy_version 320593 (0.0008) [2023-12-27 21:31:46,531][106225] Updated weights for policy 1, policy_version 320603 (0.0005) [2023-12-27 21:31:46,585][106225] Updated weights for policy 1, policy_version 320613 (0.0005) [2023-12-27 21:31:46,637][106225] Updated weights for policy 1, policy_version 320623 (0.0006) [2023-12-27 21:31:47,088][106226] Updated weights for policy 0, policy_version 320018 (0.0010) [2023-12-27 21:31:47,136][106226] Updated weights for policy 0, policy_version 320028 (0.0007) [2023-12-27 21:31:47,197][106226] Updated weights for policy 0, policy_version 320038 (0.0009) [2023-12-27 21:31:47,206][106225] Updated weights for policy 1, policy_version 320633 (0.0006) [2023-12-27 21:31:47,257][106226] Updated weights for policy 0, policy_version 320048 (0.0008) [2023-12-27 21:31:47,266][106225] Updated weights for policy 1, policy_version 320643 (0.0006) [2023-12-27 21:31:47,328][106225] Updated weights for policy 1, policy_version 320653 (0.0007) [2023-12-27 21:31:47,889][106225] Updated weights for policy 1, policy_version 320663 (0.0009) [2023-12-27 21:31:47,938][106225] Updated weights for policy 1, policy_version 320673 (0.0006) [2023-12-27 21:31:47,999][106225] Updated weights for policy 1, policy_version 320683 (0.0008) [2023-12-27 21:31:48,055][106226] Updated weights for policy 0, policy_version 320058 (0.0008) [2023-12-27 21:31:48,110][106226] Updated weights for policy 0, policy_version 320068 (0.0008) [2023-12-27 21:31:48,162][106226] Updated weights for policy 0, policy_version 320078 (0.0009) [2023-12-27 21:31:48,650][106225] Updated weights for policy 1, policy_version 320693 (0.0008) [2023-12-27 21:31:48,713][106225] Updated weights for policy 1, policy_version 320703 (0.0008) [2023-12-27 21:31:48,772][106225] Updated weights for policy 1, policy_version 320713 (0.0009) [2023-12-27 21:31:48,958][106226] Updated weights for policy 0, policy_version 320088 (0.0008) [2023-12-27 21:31:49,021][106226] Updated weights for policy 0, policy_version 320098 (0.0008) [2023-12-27 21:31:49,084][106226] Updated weights for policy 0, policy_version 320108 (0.0008) [2023-12-27 21:31:49,569][106225] Updated weights for policy 1, policy_version 320723 (0.0009) [2023-12-27 21:31:49,627][106225] Updated weights for policy 1, policy_version 320733 (0.0006) [2023-12-27 21:31:49,684][106225] Updated weights for policy 1, policy_version 320743 (0.0006) [2023-12-27 21:31:49,822][106226] Updated weights for policy 0, policy_version 320118 (0.0008) [2023-12-27 21:31:49,894][106226] Updated weights for policy 0, policy_version 320128 (0.0009) [2023-12-27 21:31:49,959][106226] Updated weights for policy 0, policy_version 320138 (0.0009) [2023-12-27 21:31:50,331][106225] Updated weights for policy 1, policy_version 320753 (0.0005) [2023-12-27 21:31:50,390][106225] Updated weights for policy 1, policy_version 320763 (0.0006) [2023-12-27 21:31:50,444][106225] Updated weights for policy 1, policy_version 320773 (0.0006) [2023-12-27 21:31:50,492][106225] Updated weights for policy 1, policy_version 320783 (0.0006) [2023-12-27 21:31:50,647][106226] Updated weights for policy 0, policy_version 320148 (0.0009) [2023-12-27 21:31:50,715][106226] Updated weights for policy 0, policy_version 320158 (0.0008) [2023-12-27 21:31:50,782][106226] Updated weights for policy 0, policy_version 320168 (0.0006) [2023-12-27 21:31:51,081][106225] Updated weights for policy 1, policy_version 320793 (0.0007) [2023-12-27 21:31:51,147][106225] Updated weights for policy 1, policy_version 320803 (0.0008) [2023-12-27 21:31:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 164134912. Throughput: 0: 9850.4, 1: 9891.0. Samples: 164147928. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:31:51,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-5.614')] [2023-12-27 21:31:51,211][106225] Updated weights for policy 1, policy_version 320813 (0.0006) [2023-12-27 21:31:51,582][106226] Updated weights for policy 0, policy_version 320178 (0.0010) [2023-12-27 21:31:51,649][106226] Updated weights for policy 0, policy_version 320188 (0.0009) [2023-12-27 21:31:51,713][106226] Updated weights for policy 0, policy_version 320198 (0.0011) [2023-12-27 21:31:51,781][106226] Updated weights for policy 0, policy_version 320208 (0.0010) [2023-12-27 21:31:51,917][106225] Updated weights for policy 1, policy_version 320823 (0.0007) [2023-12-27 21:31:51,985][106225] Updated weights for policy 1, policy_version 320833 (0.0009) [2023-12-27 21:31:52,050][106225] Updated weights for policy 1, policy_version 320843 (0.0008) [2023-12-27 21:31:52,520][106226] Updated weights for policy 0, policy_version 320218 (0.0008) [2023-12-27 21:31:52,584][106226] Updated weights for policy 0, policy_version 320228 (0.0006) [2023-12-27 21:31:52,654][106226] Updated weights for policy 0, policy_version 320238 (0.0006) [2023-12-27 21:31:52,796][106225] Updated weights for policy 1, policy_version 320853 (0.0008) [2023-12-27 21:31:52,848][106225] Updated weights for policy 1, policy_version 320863 (0.0008) [2023-12-27 21:31:52,897][106225] Updated weights for policy 1, policy_version 320873 (0.0008) [2023-12-27 21:31:53,275][106226] Updated weights for policy 0, policy_version 320248 (0.0006) [2023-12-27 21:31:53,338][106226] Updated weights for policy 0, policy_version 320258 (0.0007) [2023-12-27 21:31:53,397][106226] Updated weights for policy 0, policy_version 320268 (0.0006) [2023-12-27 21:31:53,645][106225] Updated weights for policy 1, policy_version 320883 (0.0008) [2023-12-27 21:31:53,691][106225] Updated weights for policy 1, policy_version 320893 (0.0008) [2023-12-27 21:31:53,742][106225] Updated weights for policy 1, policy_version 320903 (0.0009) [2023-12-27 21:31:53,999][106226] Updated weights for policy 0, policy_version 320278 (0.0007) [2023-12-27 21:31:54,065][106226] Updated weights for policy 0, policy_version 320288 (0.0008) [2023-12-27 21:31:54,117][106226] Updated weights for policy 0, policy_version 320298 (0.0009) [2023-12-27 21:31:54,532][106225] Updated weights for policy 1, policy_version 320913 (0.0008) [2023-12-27 21:31:54,589][106225] Updated weights for policy 1, policy_version 320923 (0.0009) [2023-12-27 21:31:54,642][106225] Updated weights for policy 1, policy_version 320933 (0.0008) [2023-12-27 21:31:54,698][106225] Updated weights for policy 1, policy_version 320943 (0.0008) [2023-12-27 21:31:54,747][106226] Updated weights for policy 0, policy_version 320308 (0.0007) [2023-12-27 21:31:54,808][106226] Updated weights for policy 0, policy_version 320318 (0.0007) [2023-12-27 21:31:54,870][106226] Updated weights for policy 0, policy_version 320328 (0.0010) [2023-12-27 21:31:55,335][106225] Updated weights for policy 1, policy_version 320953 (0.0006) [2023-12-27 21:31:55,412][106225] Updated weights for policy 1, policy_version 320963 (0.0009) [2023-12-27 21:31:55,418][106226] Updated weights for policy 0, policy_version 320338 (0.0006) [2023-12-27 21:31:55,476][106225] Updated weights for policy 1, policy_version 320973 (0.0008) [2023-12-27 21:31:55,484][106226] Updated weights for policy 0, policy_version 320348 (0.0005) [2023-12-27 21:31:55,543][106226] Updated weights for policy 0, policy_version 320358 (0.0009) [2023-12-27 21:31:55,599][106226] Updated weights for policy 0, policy_version 320368 (0.0010) [2023-12-27 21:31:55,974][106225] Updated weights for policy 1, policy_version 320983 (0.0008) [2023-12-27 21:31:56,026][106225] Updated weights for policy 1, policy_version 320993 (0.0006) [2023-12-27 21:31:56,088][106225] Updated weights for policy 1, policy_version 321003 (0.0007) [2023-12-27 21:31:56,129][106226] Updated weights for policy 0, policy_version 320378 (0.0006) [2023-12-27 21:31:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 164241408. Throughput: 0: 9867.5, 1: 9882.2. Samples: 164206972. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:31:56,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-5.626')] [2023-12-27 21:31:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000321008_82198528.pth... [2023-12-27 21:31:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000319824_81895424.pth [2023-12-27 21:31:56,194][106226] Updated weights for policy 0, policy_version 320388 (0.0007) [2023-12-27 21:31:56,258][106226] Updated weights for policy 0, policy_version 320398 (0.0009) [2023-12-27 21:31:56,269][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000320400_82051072.pth... [2023-12-27 21:31:56,274][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000319216_81747968.pth [2023-12-27 21:31:56,779][106225] Updated weights for policy 1, policy_version 321013 (0.0009) [2023-12-27 21:31:56,786][106226] Updated weights for policy 0, policy_version 320408 (0.0006) [2023-12-27 21:31:56,833][106226] Updated weights for policy 0, policy_version 320418 (0.0005) [2023-12-27 21:31:56,839][106225] Updated weights for policy 1, policy_version 321023 (0.0005) [2023-12-27 21:31:56,883][106226] Updated weights for policy 0, policy_version 320428 (0.0005) [2023-12-27 21:31:56,902][106225] Updated weights for policy 1, policy_version 321033 (0.0007) [2023-12-27 21:31:57,447][106225] Updated weights for policy 1, policy_version 321043 (0.0006) [2023-12-27 21:31:57,464][106226] Updated weights for policy 0, policy_version 320438 (0.0008) [2023-12-27 21:31:57,497][106225] Updated weights for policy 1, policy_version 321053 (0.0010) [2023-12-27 21:31:57,519][106226] Updated weights for policy 0, policy_version 320448 (0.0010) [2023-12-27 21:31:57,557][106225] Updated weights for policy 1, policy_version 321063 (0.0010) [2023-12-27 21:31:57,571][106226] Updated weights for policy 0, policy_version 320458 (0.0010) [2023-12-27 21:31:58,235][106225] Updated weights for policy 1, policy_version 321073 (0.0010) [2023-12-27 21:31:58,285][106226] Updated weights for policy 0, policy_version 320468 (0.0010) [2023-12-27 21:31:58,292][106225] Updated weights for policy 1, policy_version 321083 (0.0007) [2023-12-27 21:31:58,348][106226] Updated weights for policy 0, policy_version 320478 (0.0010) [2023-12-27 21:31:58,367][106225] Updated weights for policy 1, policy_version 321093 (0.0009) [2023-12-27 21:31:58,407][106226] Updated weights for policy 0, policy_version 320488 (0.0010) [2023-12-27 21:31:58,428][106225] Updated weights for policy 1, policy_version 321103 (0.0009) [2023-12-27 21:31:59,209][106226] Updated weights for policy 0, policy_version 320498 (0.0008) [2023-12-27 21:31:59,210][106225] Updated weights for policy 1, policy_version 321113 (0.0009) [2023-12-27 21:31:59,279][106226] Updated weights for policy 0, policy_version 320508 (0.0008) [2023-12-27 21:31:59,280][106225] Updated weights for policy 1, policy_version 321123 (0.0008) [2023-12-27 21:31:59,339][106225] Updated weights for policy 1, policy_version 321133 (0.0009) [2023-12-27 21:31:59,345][106226] Updated weights for policy 0, policy_version 320518 (0.0008) [2023-12-27 21:31:59,413][106226] Updated weights for policy 0, policy_version 320528 (0.0007) [2023-12-27 21:32:00,026][106225] Updated weights for policy 1, policy_version 321143 (0.0008) [2023-12-27 21:32:00,042][106226] Updated weights for policy 0, policy_version 320538 (0.0008) [2023-12-27 21:32:00,075][106225] Updated weights for policy 1, policy_version 321153 (0.0006) [2023-12-27 21:32:00,099][106226] Updated weights for policy 0, policy_version 320548 (0.0008) [2023-12-27 21:32:00,134][106225] Updated weights for policy 1, policy_version 321163 (0.0005) [2023-12-27 21:32:00,155][106226] Updated weights for policy 0, policy_version 320558 (0.0008) [2023-12-27 21:32:00,833][106225] Updated weights for policy 1, policy_version 321173 (0.0009) [2023-12-27 21:32:00,858][106226] Updated weights for policy 0, policy_version 320568 (0.0006) [2023-12-27 21:32:00,890][106225] Updated weights for policy 1, policy_version 321183 (0.0010) [2023-12-27 21:32:00,920][106226] Updated weights for policy 0, policy_version 320578 (0.0005) [2023-12-27 21:32:00,944][106225] Updated weights for policy 1, policy_version 321193 (0.0010) [2023-12-27 21:32:00,980][106226] Updated weights for policy 0, policy_version 320588 (0.0005) [2023-12-27 21:32:01,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 164347904. Throughput: 0: 10032.4, 1: 9951.3. Samples: 164333244. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:01,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.448')] [2023-12-27 21:32:01,697][106226] Updated weights for policy 0, policy_version 320598 (0.0007) [2023-12-27 21:32:01,748][106225] Updated weights for policy 1, policy_version 321203 (0.0010) [2023-12-27 21:32:01,762][106226] Updated weights for policy 0, policy_version 320608 (0.0008) [2023-12-27 21:32:01,807][106225] Updated weights for policy 1, policy_version 321213 (0.0007) [2023-12-27 21:32:01,824][106226] Updated weights for policy 0, policy_version 320618 (0.0008) [2023-12-27 21:32:01,869][106225] Updated weights for policy 1, policy_version 321223 (0.0006) [2023-12-27 21:32:02,545][106225] Updated weights for policy 1, policy_version 321233 (0.0008) [2023-12-27 21:32:02,584][106226] Updated weights for policy 0, policy_version 320628 (0.0006) [2023-12-27 21:32:02,606][106225] Updated weights for policy 1, policy_version 321243 (0.0005) [2023-12-27 21:32:02,636][106226] Updated weights for policy 0, policy_version 320638 (0.0005) [2023-12-27 21:32:02,668][106225] Updated weights for policy 1, policy_version 321253 (0.0006) [2023-12-27 21:32:02,694][106226] Updated weights for policy 0, policy_version 320648 (0.0009) [2023-12-27 21:32:02,721][106225] Updated weights for policy 1, policy_version 321263 (0.0009) [2023-12-27 21:32:03,258][106225] Updated weights for policy 1, policy_version 321273 (0.0006) [2023-12-27 21:32:03,309][106225] Updated weights for policy 1, policy_version 321283 (0.0005) [2023-12-27 21:32:03,357][106225] Updated weights for policy 1, policy_version 321293 (0.0005) [2023-12-27 21:32:03,471][106226] Updated weights for policy 0, policy_version 320658 (0.0009) [2023-12-27 21:32:03,530][106226] Updated weights for policy 0, policy_version 320668 (0.0009) [2023-12-27 21:32:03,580][106226] Updated weights for policy 0, policy_version 320679 (0.0009) [2023-12-27 21:32:03,891][106225] Updated weights for policy 1, policy_version 321303 (0.0006) [2023-12-27 21:32:03,957][106225] Updated weights for policy 1, policy_version 321313 (0.0007) [2023-12-27 21:32:04,021][106225] Updated weights for policy 1, policy_version 321323 (0.0011) [2023-12-27 21:32:04,405][106226] Updated weights for policy 0, policy_version 320690 (0.0009) [2023-12-27 21:32:04,468][106226] Updated weights for policy 0, policy_version 320700 (0.0008) [2023-12-27 21:32:04,535][106226] Updated weights for policy 0, policy_version 320710 (0.0006) [2023-12-27 21:32:04,598][106226] Updated weights for policy 0, policy_version 320720 (0.0008) [2023-12-27 21:32:04,678][106225] Updated weights for policy 1, policy_version 321333 (0.0010) [2023-12-27 21:32:04,744][106225] Updated weights for policy 1, policy_version 321343 (0.0011) [2023-12-27 21:32:04,803][106225] Updated weights for policy 1, policy_version 321353 (0.0010) [2023-12-27 21:32:05,284][106226] Updated weights for policy 0, policy_version 320730 (0.0006) [2023-12-27 21:32:05,335][106226] Updated weights for policy 0, policy_version 320740 (0.0010) [2023-12-27 21:32:05,384][106226] Updated weights for policy 0, policy_version 320750 (0.0010) [2023-12-27 21:32:05,531][106225] Updated weights for policy 1, policy_version 321363 (0.0010) [2023-12-27 21:32:05,584][106225] Updated weights for policy 1, policy_version 321373 (0.0010) [2023-12-27 21:32:05,638][106225] Updated weights for policy 1, policy_version 321383 (0.0010) [2023-12-27 21:32:05,998][106226] Updated weights for policy 0, policy_version 320760 (0.0010) [2023-12-27 21:32:06,061][106226] Updated weights for policy 0, policy_version 320770 (0.0005) [2023-12-27 21:32:06,122][106226] Updated weights for policy 0, policy_version 320780 (0.0006) [2023-12-27 21:32:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 164446208. Throughput: 0: 9985.1, 1: 10049.9. Samples: 164454024. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:06,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-5.200')] [2023-12-27 21:32:06,389][106225] Updated weights for policy 1, policy_version 321393 (0.0010) [2023-12-27 21:32:06,448][106225] Updated weights for policy 1, policy_version 321403 (0.0010) [2023-12-27 21:32:06,505][106225] Updated weights for policy 1, policy_version 321413 (0.0011) [2023-12-27 21:32:06,566][106225] Updated weights for policy 1, policy_version 321423 (0.0009) [2023-12-27 21:32:06,845][106226] Updated weights for policy 0, policy_version 320790 (0.0009) [2023-12-27 21:32:06,905][106226] Updated weights for policy 0, policy_version 320800 (0.0011) [2023-12-27 21:32:06,956][106226] Updated weights for policy 0, policy_version 320810 (0.0010) [2023-12-27 21:32:07,244][106225] Updated weights for policy 1, policy_version 321433 (0.0007) [2023-12-27 21:32:07,294][106225] Updated weights for policy 1, policy_version 321443 (0.0008) [2023-12-27 21:32:07,360][106225] Updated weights for policy 1, policy_version 321453 (0.0008) [2023-12-27 21:32:07,675][106226] Updated weights for policy 0, policy_version 320820 (0.0010) [2023-12-27 21:32:07,732][106226] Updated weights for policy 0, policy_version 320830 (0.0010) [2023-12-27 21:32:07,784][106226] Updated weights for policy 0, policy_version 320840 (0.0008) [2023-12-27 21:32:08,121][106225] Updated weights for policy 1, policy_version 321463 (0.0009) [2023-12-27 21:32:08,178][106225] Updated weights for policy 1, policy_version 321473 (0.0009) [2023-12-27 21:32:08,235][106225] Updated weights for policy 1, policy_version 321483 (0.0008) [2023-12-27 21:32:08,397][106226] Updated weights for policy 0, policy_version 320850 (0.0009) [2023-12-27 21:32:08,458][106226] Updated weights for policy 0, policy_version 320860 (0.0006) [2023-12-27 21:32:08,523][106226] Updated weights for policy 0, policy_version 320870 (0.0005) [2023-12-27 21:32:08,584][106226] Updated weights for policy 0, policy_version 320880 (0.0011) [2023-12-27 21:32:08,996][106225] Updated weights for policy 1, policy_version 321493 (0.0009) [2023-12-27 21:32:09,047][106225] Updated weights for policy 1, policy_version 321503 (0.0009) [2023-12-27 21:32:09,096][106225] Updated weights for policy 1, policy_version 321513 (0.0009) [2023-12-27 21:32:09,151][106226] Updated weights for policy 0, policy_version 320890 (0.0007) [2023-12-27 21:32:09,211][106226] Updated weights for policy 0, policy_version 320900 (0.0011) [2023-12-27 21:32:09,280][106226] Updated weights for policy 0, policy_version 320910 (0.0011) [2023-12-27 21:32:09,928][106226] Updated weights for policy 0, policy_version 320920 (0.0010) [2023-12-27 21:32:09,982][106225] Updated weights for policy 1, policy_version 321523 (0.0007) [2023-12-27 21:32:09,994][106226] Updated weights for policy 0, policy_version 320930 (0.0011) [2023-12-27 21:32:10,038][106225] Updated weights for policy 1, policy_version 321533 (0.0009) [2023-12-27 21:32:10,057][106226] Updated weights for policy 0, policy_version 320940 (0.0005) [2023-12-27 21:32:10,095][106225] Updated weights for policy 1, policy_version 321543 (0.0008) [2023-12-27 21:32:10,621][106226] Updated weights for policy 0, policy_version 320950 (0.0005) [2023-12-27 21:32:10,676][106226] Updated weights for policy 0, policy_version 320960 (0.0005) [2023-12-27 21:32:10,731][106226] Updated weights for policy 0, policy_version 320970 (0.0006) [2023-12-27 21:32:10,925][106225] Updated weights for policy 1, policy_version 321553 (0.0008) [2023-12-27 21:32:10,979][106225] Updated weights for policy 1, policy_version 321563 (0.0008) [2023-12-27 21:32:11,053][106225] Updated weights for policy 1, policy_version 321573 (0.0007) [2023-12-27 21:32:11,110][106225] Updated weights for policy 1, policy_version 321583 (0.0008) [2023-12-27 21:32:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 164544512. Throughput: 0: 10069.6, 1: 10032.5. Samples: 164513676. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:11,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.387')] [2023-12-27 21:32:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000321584_82345984.pth... [2023-12-27 21:32:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000320976_82198528.pth... [2023-12-27 21:32:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000319792_81895424.pth [2023-12-27 21:32:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000320400_82042880.pth [2023-12-27 21:32:11,482][106226] Updated weights for policy 0, policy_version 320980 (0.0009) [2023-12-27 21:32:11,542][106226] Updated weights for policy 0, policy_version 320990 (0.0009) [2023-12-27 21:32:11,600][106226] Updated weights for policy 0, policy_version 321000 (0.0009) [2023-12-27 21:32:11,851][106225] Updated weights for policy 1, policy_version 321593 (0.0006) [2023-12-27 21:32:11,912][106225] Updated weights for policy 1, policy_version 321603 (0.0006) [2023-12-27 21:32:11,975][106225] Updated weights for policy 1, policy_version 321613 (0.0006) [2023-12-27 21:32:12,438][106226] Updated weights for policy 0, policy_version 321010 (0.0009) [2023-12-27 21:32:12,500][106226] Updated weights for policy 0, policy_version 321020 (0.0008) [2023-12-27 21:32:12,555][106226] Updated weights for policy 0, policy_version 321030 (0.0008) [2023-12-27 21:32:12,564][106225] Updated weights for policy 1, policy_version 321623 (0.0007) [2023-12-27 21:32:12,619][106226] Updated weights for policy 0, policy_version 321040 (0.0007) [2023-12-27 21:32:12,625][106225] Updated weights for policy 1, policy_version 321633 (0.0007) [2023-12-27 21:32:12,679][106225] Updated weights for policy 1, policy_version 321643 (0.0009) [2023-12-27 21:32:13,351][106225] Updated weights for policy 1, policy_version 321653 (0.0007) [2023-12-27 21:32:13,373][106226] Updated weights for policy 0, policy_version 321050 (0.0008) [2023-12-27 21:32:13,402][106225] Updated weights for policy 1, policy_version 321663 (0.0007) [2023-12-27 21:32:13,429][106226] Updated weights for policy 0, policy_version 321060 (0.0006) [2023-12-27 21:32:13,456][106225] Updated weights for policy 1, policy_version 321673 (0.0005) [2023-12-27 21:32:13,483][106226] Updated weights for policy 0, policy_version 321070 (0.0008) [2023-12-27 21:32:14,045][106225] Updated weights for policy 1, policy_version 321683 (0.0006) [2023-12-27 21:32:14,101][106225] Updated weights for policy 1, policy_version 321693 (0.0007) [2023-12-27 21:32:14,162][106225] Updated weights for policy 1, policy_version 321703 (0.0009) [2023-12-27 21:32:14,209][106226] Updated weights for policy 0, policy_version 321080 (0.0009) [2023-12-27 21:32:14,277][106226] Updated weights for policy 0, policy_version 321090 (0.0010) [2023-12-27 21:32:14,332][106226] Updated weights for policy 0, policy_version 321100 (0.0008) [2023-12-27 21:32:14,849][106225] Updated weights for policy 1, policy_version 321713 (0.0006) [2023-12-27 21:32:14,914][106225] Updated weights for policy 1, policy_version 321723 (0.0007) [2023-12-27 21:32:14,984][106225] Updated weights for policy 1, policy_version 321733 (0.0009) [2023-12-27 21:32:15,045][106226] Updated weights for policy 0, policy_version 321110 (0.0007) [2023-12-27 21:32:15,050][106225] Updated weights for policy 1, policy_version 321743 (0.0008) [2023-12-27 21:32:15,104][106226] Updated weights for policy 0, policy_version 321120 (0.0006) [2023-12-27 21:32:15,170][106226] Updated weights for policy 0, policy_version 321130 (0.0005) [2023-12-27 21:32:15,732][106226] Updated weights for policy 0, policy_version 321140 (0.0006) [2023-12-27 21:32:15,782][106226] Updated weights for policy 0, policy_version 321150 (0.0005) [2023-12-27 21:32:15,837][106226] Updated weights for policy 0, policy_version 321160 (0.0005) [2023-12-27 21:32:15,860][106225] Updated weights for policy 1, policy_version 321753 (0.0007) [2023-12-27 21:32:15,918][106225] Updated weights for policy 1, policy_version 321763 (0.0010) [2023-12-27 21:32:15,986][106225] Updated weights for policy 1, policy_version 321773 (0.0010) [2023-12-27 21:32:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 164642816. Throughput: 0: 10020.8, 1: 9999.9. Samples: 164630496. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:16,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-5.202')] [2023-12-27 21:32:16,373][106226] Updated weights for policy 0, policy_version 321170 (0.0006) [2023-12-27 21:32:16,432][106226] Updated weights for policy 0, policy_version 321180 (0.0009) [2023-12-27 21:32:16,491][106226] Updated weights for policy 0, policy_version 321190 (0.0007) [2023-12-27 21:32:16,542][106226] Updated weights for policy 0, policy_version 321200 (0.0005) [2023-12-27 21:32:16,776][106225] Updated weights for policy 1, policy_version 321783 (0.0009) [2023-12-27 21:32:16,843][106225] Updated weights for policy 1, policy_version 321793 (0.0010) [2023-12-27 21:32:16,910][106225] Updated weights for policy 1, policy_version 321803 (0.0008) [2023-12-27 21:32:17,119][106226] Updated weights for policy 0, policy_version 321210 (0.0009) [2023-12-27 21:32:17,177][106226] Updated weights for policy 0, policy_version 321220 (0.0009) [2023-12-27 21:32:17,226][106226] Updated weights for policy 0, policy_version 321230 (0.0009) [2023-12-27 21:32:17,643][106225] Updated weights for policy 1, policy_version 321813 (0.0009) [2023-12-27 21:32:17,707][106225] Updated weights for policy 1, policy_version 321823 (0.0010) [2023-12-27 21:32:17,762][106225] Updated weights for policy 1, policy_version 321833 (0.0009) [2023-12-27 21:32:17,936][106226] Updated weights for policy 0, policy_version 321240 (0.0008) [2023-12-27 21:32:17,984][106226] Updated weights for policy 0, policy_version 321250 (0.0008) [2023-12-27 21:32:18,031][106226] Updated weights for policy 0, policy_version 321260 (0.0005) [2023-12-27 21:32:18,417][106225] Updated weights for policy 1, policy_version 321843 (0.0008) [2023-12-27 21:32:18,482][106225] Updated weights for policy 1, policy_version 321853 (0.0009) [2023-12-27 21:32:18,545][106225] Updated weights for policy 1, policy_version 321863 (0.0008) [2023-12-27 21:32:18,845][106226] Updated weights for policy 0, policy_version 321270 (0.0008) [2023-12-27 21:32:18,918][106226] Updated weights for policy 0, policy_version 321280 (0.0008) [2023-12-27 21:32:18,988][106226] Updated weights for policy 0, policy_version 321290 (0.0008) [2023-12-27 21:32:19,239][106225] Updated weights for policy 1, policy_version 321873 (0.0008) [2023-12-27 21:32:19,309][106225] Updated weights for policy 1, policy_version 321883 (0.0008) [2023-12-27 21:32:19,374][106225] Updated weights for policy 1, policy_version 321893 (0.0008) [2023-12-27 21:32:19,434][106225] Updated weights for policy 1, policy_version 321903 (0.0007) [2023-12-27 21:32:19,724][106226] Updated weights for policy 0, policy_version 321300 (0.0008) [2023-12-27 21:32:19,786][106226] Updated weights for policy 0, policy_version 321310 (0.0008) [2023-12-27 21:32:19,854][106226] Updated weights for policy 0, policy_version 321320 (0.0009) [2023-12-27 21:32:20,194][106225] Updated weights for policy 1, policy_version 321913 (0.0007) [2023-12-27 21:32:20,257][106225] Updated weights for policy 1, policy_version 321923 (0.0008) [2023-12-27 21:32:20,312][106225] Updated weights for policy 1, policy_version 321933 (0.0007) [2023-12-27 21:32:20,593][106226] Updated weights for policy 0, policy_version 321330 (0.0008) [2023-12-27 21:32:20,655][106226] Updated weights for policy 0, policy_version 321340 (0.0008) [2023-12-27 21:32:20,720][106226] Updated weights for policy 0, policy_version 321350 (0.0008) [2023-12-27 21:32:20,788][106226] Updated weights for policy 0, policy_version 321360 (0.0009) [2023-12-27 21:32:21,035][106225] Updated weights for policy 1, policy_version 321943 (0.0008) [2023-12-27 21:32:21,095][106225] Updated weights for policy 1, policy_version 321953 (0.0008) [2023-12-27 21:32:21,163][106225] Updated weights for policy 1, policy_version 321963 (0.0009) [2023-12-27 21:32:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 164732928. Throughput: 0: 10025.8, 1: 9959.6. Samples: 164746956. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:21,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-5.550')] [2023-12-27 21:32:21,636][106226] Updated weights for policy 0, policy_version 321370 (0.0010) [2023-12-27 21:32:21,706][106226] Updated weights for policy 0, policy_version 321380 (0.0009) [2023-12-27 21:32:21,774][106226] Updated weights for policy 0, policy_version 321390 (0.0012) [2023-12-27 21:32:21,975][106225] Updated weights for policy 1, policy_version 321973 (0.0009) [2023-12-27 21:32:22,032][106225] Updated weights for policy 1, policy_version 321983 (0.0009) [2023-12-27 21:32:22,090][106225] Updated weights for policy 1, policy_version 321993 (0.0008) [2023-12-27 21:32:22,499][106226] Updated weights for policy 0, policy_version 321400 (0.0007) [2023-12-27 21:32:22,564][106226] Updated weights for policy 0, policy_version 321410 (0.0006) [2023-12-27 21:32:22,631][106226] Updated weights for policy 0, policy_version 321420 (0.0006) [2023-12-27 21:32:22,897][106225] Updated weights for policy 1, policy_version 322003 (0.0008) [2023-12-27 21:32:22,963][106225] Updated weights for policy 1, policy_version 322013 (0.0008) [2023-12-27 21:32:23,026][106225] Updated weights for policy 1, policy_version 322023 (0.0008) [2023-12-27 21:32:23,238][106226] Updated weights for policy 0, policy_version 321430 (0.0007) [2023-12-27 21:32:23,293][106226] Updated weights for policy 0, policy_version 321440 (0.0010) [2023-12-27 21:32:23,352][106226] Updated weights for policy 0, policy_version 321450 (0.0008) [2023-12-27 21:32:23,641][106225] Updated weights for policy 1, policy_version 322033 (0.0006) [2023-12-27 21:32:23,697][106225] Updated weights for policy 1, policy_version 322043 (0.0005) [2023-12-27 21:32:23,749][106225] Updated weights for policy 1, policy_version 322053 (0.0005) [2023-12-27 21:32:23,795][106225] Updated weights for policy 1, policy_version 322063 (0.0005) [2023-12-27 21:32:24,140][106226] Updated weights for policy 0, policy_version 321460 (0.0008) [2023-12-27 21:32:24,190][106226] Updated weights for policy 0, policy_version 321470 (0.0005) [2023-12-27 21:32:24,248][106226] Updated weights for policy 0, policy_version 321480 (0.0009) [2023-12-27 21:32:24,333][106225] Updated weights for policy 1, policy_version 322073 (0.0010) [2023-12-27 21:32:24,380][106225] Updated weights for policy 1, policy_version 322083 (0.0010) [2023-12-27 21:32:24,440][106225] Updated weights for policy 1, policy_version 322093 (0.0010) [2023-12-27 21:32:25,015][106226] Updated weights for policy 0, policy_version 321490 (0.0008) [2023-12-27 21:32:25,031][106225] Updated weights for policy 1, policy_version 322103 (0.0007) [2023-12-27 21:32:25,064][106226] Updated weights for policy 0, policy_version 321500 (0.0008) [2023-12-27 21:32:25,078][106225] Updated weights for policy 1, policy_version 322113 (0.0006) [2023-12-27 21:32:25,118][106226] Updated weights for policy 0, policy_version 321510 (0.0009) [2023-12-27 21:32:25,137][106225] Updated weights for policy 1, policy_version 322123 (0.0008) [2023-12-27 21:32:25,175][106226] Updated weights for policy 0, policy_version 321520 (0.0007) [2023-12-27 21:32:25,742][106225] Updated weights for policy 1, policy_version 322133 (0.0010) [2023-12-27 21:32:25,795][106225] Updated weights for policy 1, policy_version 322143 (0.0010) [2023-12-27 21:32:25,849][106225] Updated weights for policy 1, policy_version 322153 (0.0010) [2023-12-27 21:32:25,949][106226] Updated weights for policy 0, policy_version 321530 (0.0005) [2023-12-27 21:32:25,998][106226] Updated weights for policy 0, policy_version 321540 (0.0006) [2023-12-27 21:32:26,047][106226] Updated weights for policy 0, policy_version 321550 (0.0009) [2023-12-27 21:32:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19799.7). Total num frames: 164839424. Throughput: 0: 9951.9, 1: 9921.4. Samples: 164804000. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:26,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.715')] [2023-12-27 21:32:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000321552_82345984.pth... [2023-12-27 21:32:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000322160_82493440.pth... [2023-12-27 21:32:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000320400_82051072.pth [2023-12-27 21:32:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000321008_82198528.pth [2023-12-27 21:32:26,486][106225] Updated weights for policy 1, policy_version 322163 (0.0010) [2023-12-27 21:32:26,539][106225] Updated weights for policy 1, policy_version 322173 (0.0010) [2023-12-27 21:32:26,589][106225] Updated weights for policy 1, policy_version 322183 (0.0010) [2023-12-27 21:32:26,801][106226] Updated weights for policy 0, policy_version 321560 (0.0009) [2023-12-27 21:32:26,856][106226] Updated weights for policy 0, policy_version 321570 (0.0007) [2023-12-27 21:32:26,902][106226] Updated weights for policy 0, policy_version 321580 (0.0005) [2023-12-27 21:32:27,290][106225] Updated weights for policy 1, policy_version 322193 (0.0010) [2023-12-27 21:32:27,346][106225] Updated weights for policy 1, policy_version 322203 (0.0010) [2023-12-27 21:32:27,401][106225] Updated weights for policy 1, policy_version 322213 (0.0010) [2023-12-27 21:32:27,449][106225] Updated weights for policy 1, policy_version 322223 (0.0010) [2023-12-27 21:32:27,508][106226] Updated weights for policy 0, policy_version 321590 (0.0007) [2023-12-27 21:32:27,560][106226] Updated weights for policy 0, policy_version 321600 (0.0008) [2023-12-27 21:32:27,612][106226] Updated weights for policy 0, policy_version 321610 (0.0008) [2023-12-27 21:32:28,070][106225] Updated weights for policy 1, policy_version 322233 (0.0006) [2023-12-27 21:32:28,124][106225] Updated weights for policy 1, policy_version 322243 (0.0005) [2023-12-27 21:32:28,178][106225] Updated weights for policy 1, policy_version 322253 (0.0005) [2023-12-27 21:32:28,393][106226] Updated weights for policy 0, policy_version 321620 (0.0007) [2023-12-27 21:32:28,456][106226] Updated weights for policy 0, policy_version 321630 (0.0009) [2023-12-27 21:32:28,510][106226] Updated weights for policy 0, policy_version 321640 (0.0008) [2023-12-27 21:32:28,771][106225] Updated weights for policy 1, policy_version 322263 (0.0009) [2023-12-27 21:32:28,818][106225] Updated weights for policy 1, policy_version 322273 (0.0008) [2023-12-27 21:32:28,878][106225] Updated weights for policy 1, policy_version 322283 (0.0007) [2023-12-27 21:32:29,225][106226] Updated weights for policy 0, policy_version 321650 (0.0008) [2023-12-27 21:32:29,299][106226] Updated weights for policy 0, policy_version 321660 (0.0008) [2023-12-27 21:32:29,361][106226] Updated weights for policy 0, policy_version 321670 (0.0008) [2023-12-27 21:32:29,426][106226] Updated weights for policy 0, policy_version 321680 (0.0009) [2023-12-27 21:32:29,643][106225] Updated weights for policy 1, policy_version 322293 (0.0008) [2023-12-27 21:32:29,708][106225] Updated weights for policy 1, policy_version 322303 (0.0008) [2023-12-27 21:32:29,752][106225] Updated weights for policy 1, policy_version 322313 (0.0007) [2023-12-27 21:32:30,189][106226] Updated weights for policy 0, policy_version 321690 (0.0006) [2023-12-27 21:32:30,244][106226] Updated weights for policy 0, policy_version 321700 (0.0005) [2023-12-27 21:32:30,304][106226] Updated weights for policy 0, policy_version 321710 (0.0006) [2023-12-27 21:32:30,487][106225] Updated weights for policy 1, policy_version 322323 (0.0008) [2023-12-27 21:32:30,550][106225] Updated weights for policy 1, policy_version 322333 (0.0007) [2023-12-27 21:32:30,610][106225] Updated weights for policy 1, policy_version 322343 (0.0005) [2023-12-27 21:32:31,016][106226] Updated weights for policy 0, policy_version 321720 (0.0008) [2023-12-27 21:32:31,083][106226] Updated weights for policy 0, policy_version 321730 (0.0008) [2023-12-27 21:32:31,138][106226] Updated weights for policy 0, policy_version 321740 (0.0007) [2023-12-27 21:32:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 164937728. Throughput: 0: 9880.5, 1: 10063.0. Samples: 164926068. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:31,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.483')] [2023-12-27 21:32:31,240][106225] Updated weights for policy 1, policy_version 322353 (0.0006) [2023-12-27 21:32:31,302][106225] Updated weights for policy 1, policy_version 322363 (0.0010) [2023-12-27 21:32:31,362][106225] Updated weights for policy 1, policy_version 322373 (0.0010) [2023-12-27 21:32:31,428][106225] Updated weights for policy 1, policy_version 322383 (0.0008) [2023-12-27 21:32:31,941][106226] Updated weights for policy 0, policy_version 321750 (0.0008) [2023-12-27 21:32:32,006][106226] Updated weights for policy 0, policy_version 321760 (0.0008) [2023-12-27 21:32:32,064][106225] Updated weights for policy 1, policy_version 322393 (0.0010) [2023-12-27 21:32:32,065][106226] Updated weights for policy 0, policy_version 321770 (0.0008) [2023-12-27 21:32:32,125][106225] Updated weights for policy 1, policy_version 322403 (0.0010) [2023-12-27 21:32:32,189][106225] Updated weights for policy 1, policy_version 322413 (0.0008) [2023-12-27 21:32:32,809][106226] Updated weights for policy 0, policy_version 321780 (0.0007) [2023-12-27 21:32:32,863][106226] Updated weights for policy 0, policy_version 321790 (0.0006) [2023-12-27 21:32:32,913][106225] Updated weights for policy 1, policy_version 322423 (0.0007) [2023-12-27 21:32:32,914][106226] Updated weights for policy 0, policy_version 321800 (0.0005) [2023-12-27 21:32:32,974][106225] Updated weights for policy 1, policy_version 322433 (0.0008) [2023-12-27 21:32:33,024][106225] Updated weights for policy 1, policy_version 322443 (0.0005) [2023-12-27 21:32:33,561][106226] Updated weights for policy 0, policy_version 321810 (0.0006) [2023-12-27 21:32:33,617][106226] Updated weights for policy 0, policy_version 321820 (0.0008) [2023-12-27 21:32:33,670][106226] Updated weights for policy 0, policy_version 321830 (0.0009) [2023-12-27 21:32:33,714][106225] Updated weights for policy 1, policy_version 322453 (0.0007) [2023-12-27 21:32:33,728][106226] Updated weights for policy 0, policy_version 321840 (0.0007) [2023-12-27 21:32:33,764][106225] Updated weights for policy 1, policy_version 322463 (0.0007) [2023-12-27 21:32:33,822][106225] Updated weights for policy 1, policy_version 322473 (0.0010) [2023-12-27 21:32:34,461][106226] Updated weights for policy 0, policy_version 321850 (0.0008) [2023-12-27 21:32:34,525][106226] Updated weights for policy 0, policy_version 321860 (0.0008) [2023-12-27 21:32:34,544][106225] Updated weights for policy 1, policy_version 322483 (0.0009) [2023-12-27 21:32:34,589][106225] Updated weights for policy 1, policy_version 322493 (0.0010) [2023-12-27 21:32:34,591][106226] Updated weights for policy 0, policy_version 321870 (0.0007) [2023-12-27 21:32:34,645][106225] Updated weights for policy 1, policy_version 322503 (0.0011) [2023-12-27 21:32:35,356][106226] Updated weights for policy 0, policy_version 321880 (0.0008) [2023-12-27 21:32:35,407][106225] Updated weights for policy 1, policy_version 322513 (0.0011) [2023-12-27 21:32:35,420][106226] Updated weights for policy 0, policy_version 321890 (0.0007) [2023-12-27 21:32:35,473][106225] Updated weights for policy 1, policy_version 322523 (0.0011) [2023-12-27 21:32:35,484][106226] Updated weights for policy 0, policy_version 321900 (0.0007) [2023-12-27 21:32:35,536][106225] Updated weights for policy 1, policy_version 322533 (0.0010) [2023-12-27 21:32:35,588][106225] Updated weights for policy 1, policy_version 322543 (0.0010) [2023-12-27 21:32:36,091][106226] Updated weights for policy 0, policy_version 321910 (0.0007) [2023-12-27 21:32:36,157][106226] Updated weights for policy 0, policy_version 321920 (0.0011) [2023-12-27 21:32:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 165027840. Throughput: 0: 9916.8, 1: 9975.8. Samples: 165043096. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:36,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.663')] [2023-12-27 21:32:36,220][106226] Updated weights for policy 0, policy_version 321930 (0.0010) [2023-12-27 21:32:36,338][106225] Updated weights for policy 1, policy_version 322553 (0.0010) [2023-12-27 21:32:36,409][106225] Updated weights for policy 1, policy_version 322563 (0.0011) [2023-12-27 21:32:36,473][106225] Updated weights for policy 1, policy_version 322573 (0.0010) [2023-12-27 21:32:36,899][106226] Updated weights for policy 0, policy_version 321940 (0.0010) [2023-12-27 21:32:36,961][106226] Updated weights for policy 0, policy_version 321950 (0.0011) [2023-12-27 21:32:37,021][106226] Updated weights for policy 0, policy_version 321960 (0.0011) [2023-12-27 21:32:37,219][106225] Updated weights for policy 1, policy_version 322583 (0.0009) [2023-12-27 21:32:37,270][106225] Updated weights for policy 1, policy_version 322593 (0.0008) [2023-12-27 21:32:37,321][106225] Updated weights for policy 1, policy_version 322603 (0.0007) [2023-12-27 21:32:37,725][106226] Updated weights for policy 0, policy_version 321970 (0.0011) [2023-12-27 21:32:37,790][106226] Updated weights for policy 0, policy_version 321980 (0.0011) [2023-12-27 21:32:37,850][106226] Updated weights for policy 0, policy_version 321990 (0.0010) [2023-12-27 21:32:37,912][106226] Updated weights for policy 0, policy_version 322000 (0.0010) [2023-12-27 21:32:38,074][106225] Updated weights for policy 1, policy_version 322613 (0.0008) [2023-12-27 21:32:38,141][106225] Updated weights for policy 1, policy_version 322623 (0.0008) [2023-12-27 21:32:38,212][106225] Updated weights for policy 1, policy_version 322633 (0.0007) [2023-12-27 21:32:38,574][106226] Updated weights for policy 0, policy_version 322010 (0.0009) [2023-12-27 21:32:38,634][106226] Updated weights for policy 0, policy_version 322020 (0.0009) [2023-12-27 21:32:38,691][106226] Updated weights for policy 0, policy_version 322030 (0.0009) [2023-12-27 21:32:38,888][106225] Updated weights for policy 1, policy_version 322643 (0.0006) [2023-12-27 21:32:38,946][106225] Updated weights for policy 1, policy_version 322653 (0.0008) [2023-12-27 21:32:39,004][106225] Updated weights for policy 1, policy_version 322663 (0.0008) [2023-12-27 21:32:39,371][106226] Updated weights for policy 0, policy_version 322040 (0.0008) [2023-12-27 21:32:39,441][106226] Updated weights for policy 0, policy_version 322050 (0.0008) [2023-12-27 21:32:39,495][106226] Updated weights for policy 0, policy_version 322060 (0.0009) [2023-12-27 21:32:39,751][106225] Updated weights for policy 1, policy_version 322673 (0.0006) [2023-12-27 21:32:39,813][106225] Updated weights for policy 1, policy_version 322683 (0.0008) [2023-12-27 21:32:39,882][106225] Updated weights for policy 1, policy_version 322693 (0.0009) [2023-12-27 21:32:39,950][106225] Updated weights for policy 1, policy_version 322703 (0.0009) [2023-12-27 21:32:40,247][106226] Updated weights for policy 0, policy_version 322070 (0.0007) [2023-12-27 21:32:40,311][106226] Updated weights for policy 0, policy_version 322080 (0.0006) [2023-12-27 21:32:40,379][106226] Updated weights for policy 0, policy_version 322090 (0.0006) [2023-12-27 21:32:40,745][106225] Updated weights for policy 1, policy_version 322713 (0.0008) [2023-12-27 21:32:40,797][106225] Updated weights for policy 1, policy_version 322723 (0.0008) [2023-12-27 21:32:40,849][106225] Updated weights for policy 1, policy_version 322733 (0.0008) [2023-12-27 21:32:40,981][106226] Updated weights for policy 0, policy_version 322100 (0.0007) [2023-12-27 21:32:41,048][106226] Updated weights for policy 0, policy_version 322110 (0.0007) [2023-12-27 21:32:41,116][106226] Updated weights for policy 0, policy_version 322120 (0.0008) [2023-12-27 21:32:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 165134336. Throughput: 0: 9910.7, 1: 9963.5. Samples: 165101316. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:41,176][105115] Avg episode reward: [(0, '-4.929'), (1, '-5.653')] [2023-12-27 21:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000322736_82640896.pth... [2023-12-27 21:32:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000322128_82493440.pth... [2023-12-27 21:32:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000321584_82345984.pth [2023-12-27 21:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000320976_82198528.pth [2023-12-27 21:32:41,662][106225] Updated weights for policy 1, policy_version 322743 (0.0008) [2023-12-27 21:32:41,730][106225] Updated weights for policy 1, policy_version 322753 (0.0007) [2023-12-27 21:32:41,795][106225] Updated weights for policy 1, policy_version 322763 (0.0007) [2023-12-27 21:32:41,877][106226] Updated weights for policy 0, policy_version 322130 (0.0008) [2023-12-27 21:32:41,938][106226] Updated weights for policy 0, policy_version 322140 (0.0008) [2023-12-27 21:32:41,998][106226] Updated weights for policy 0, policy_version 322150 (0.0008) [2023-12-27 21:32:42,061][106226] Updated weights for policy 0, policy_version 322160 (0.0008) [2023-12-27 21:32:42,519][106225] Updated weights for policy 1, policy_version 322773 (0.0008) [2023-12-27 21:32:42,566][106225] Updated weights for policy 1, policy_version 322783 (0.0007) [2023-12-27 21:32:42,625][106225] Updated weights for policy 1, policy_version 322793 (0.0008) [2023-12-27 21:32:42,734][106226] Updated weights for policy 0, policy_version 322170 (0.0006) [2023-12-27 21:32:42,789][106226] Updated weights for policy 0, policy_version 322180 (0.0006) [2023-12-27 21:32:42,854][106226] Updated weights for policy 0, policy_version 322190 (0.0010) [2023-12-27 21:32:43,283][106225] Updated weights for policy 1, policy_version 322803 (0.0006) [2023-12-27 21:32:43,351][106225] Updated weights for policy 1, policy_version 322813 (0.0006) [2023-12-27 21:32:43,413][106225] Updated weights for policy 1, policy_version 322823 (0.0005) [2023-12-27 21:32:43,517][106226] Updated weights for policy 0, policy_version 322200 (0.0006) [2023-12-27 21:32:43,576][106226] Updated weights for policy 0, policy_version 322210 (0.0005) [2023-12-27 21:32:43,629][106226] Updated weights for policy 0, policy_version 322220 (0.0005) [2023-12-27 21:32:43,965][106225] Updated weights for policy 1, policy_version 322833 (0.0006) [2023-12-27 21:32:44,029][106225] Updated weights for policy 1, policy_version 322843 (0.0005) [2023-12-27 21:32:44,093][106225] Updated weights for policy 1, policy_version 322853 (0.0005) [2023-12-27 21:32:44,152][106225] Updated weights for policy 1, policy_version 322863 (0.0006) [2023-12-27 21:32:44,267][106226] Updated weights for policy 0, policy_version 322230 (0.0007) [2023-12-27 21:32:44,325][106226] Updated weights for policy 0, policy_version 322240 (0.0008) [2023-12-27 21:32:44,389][106226] Updated weights for policy 0, policy_version 322250 (0.0008) [2023-12-27 21:32:44,758][106225] Updated weights for policy 1, policy_version 322873 (0.0006) [2023-12-27 21:32:44,822][106225] Updated weights for policy 1, policy_version 322883 (0.0009) [2023-12-27 21:32:44,877][106225] Updated weights for policy 1, policy_version 322893 (0.0011) [2023-12-27 21:32:45,132][106226] Updated weights for policy 0, policy_version 322260 (0.0008) [2023-12-27 21:32:45,192][106226] Updated weights for policy 0, policy_version 322270 (0.0008) [2023-12-27 21:32:45,254][106226] Updated weights for policy 0, policy_version 322280 (0.0006) [2023-12-27 21:32:45,602][106225] Updated weights for policy 1, policy_version 322903 (0.0009) [2023-12-27 21:32:45,659][106225] Updated weights for policy 1, policy_version 322913 (0.0008) [2023-12-27 21:32:45,717][106225] Updated weights for policy 1, policy_version 322923 (0.0008) [2023-12-27 21:32:45,920][106226] Updated weights for policy 0, policy_version 322290 (0.0006) [2023-12-27 21:32:45,982][106226] Updated weights for policy 0, policy_version 322300 (0.0006) [2023-12-27 21:32:46,042][106226] Updated weights for policy 0, policy_version 322310 (0.0006) [2023-12-27 21:32:46,098][106226] Updated weights for policy 0, policy_version 322320 (0.0009) [2023-12-27 21:32:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 165232640. Throughput: 0: 9799.2, 1: 9902.2. Samples: 165219808. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:46,176][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.513')] [2023-12-27 21:32:46,393][106225] Updated weights for policy 1, policy_version 322933 (0.0009) [2023-12-27 21:32:46,440][106225] Updated weights for policy 1, policy_version 322943 (0.0010) [2023-12-27 21:32:46,496][106225] Updated weights for policy 1, policy_version 322953 (0.0010) [2023-12-27 21:32:46,699][106226] Updated weights for policy 0, policy_version 322330 (0.0006) [2023-12-27 21:32:46,760][106226] Updated weights for policy 0, policy_version 322340 (0.0011) [2023-12-27 21:32:46,823][106226] Updated weights for policy 0, policy_version 322350 (0.0010) [2023-12-27 21:32:47,200][106225] Updated weights for policy 1, policy_version 322963 (0.0010) [2023-12-27 21:32:47,256][106225] Updated weights for policy 1, policy_version 322973 (0.0009) [2023-12-27 21:32:47,308][106225] Updated weights for policy 1, policy_version 322983 (0.0008) [2023-12-27 21:32:47,421][106226] Updated weights for policy 0, policy_version 322360 (0.0005) [2023-12-27 21:32:47,484][106226] Updated weights for policy 0, policy_version 322370 (0.0010) [2023-12-27 21:32:47,548][106226] Updated weights for policy 0, policy_version 322380 (0.0011) [2023-12-27 21:32:47,924][106225] Updated weights for policy 1, policy_version 322993 (0.0007) [2023-12-27 21:32:47,979][106225] Updated weights for policy 1, policy_version 323003 (0.0005) [2023-12-27 21:32:48,033][106225] Updated weights for policy 1, policy_version 323013 (0.0005) [2023-12-27 21:32:48,095][106225] Updated weights for policy 1, policy_version 323023 (0.0007) [2023-12-27 21:32:48,166][106226] Updated weights for policy 0, policy_version 322390 (0.0007) [2023-12-27 21:32:48,222][106226] Updated weights for policy 0, policy_version 322400 (0.0006) [2023-12-27 21:32:48,271][106226] Updated weights for policy 0, policy_version 322410 (0.0009) [2023-12-27 21:32:48,770][106225] Updated weights for policy 1, policy_version 323033 (0.0009) [2023-12-27 21:32:48,827][106225] Updated weights for policy 1, policy_version 323043 (0.0009) [2023-12-27 21:32:48,881][106225] Updated weights for policy 1, policy_version 323053 (0.0008) [2023-12-27 21:32:48,987][106226] Updated weights for policy 0, policy_version 322420 (0.0008) [2023-12-27 21:32:49,047][106226] Updated weights for policy 0, policy_version 322430 (0.0008) [2023-12-27 21:32:49,107][106226] Updated weights for policy 0, policy_version 322440 (0.0007) [2023-12-27 21:32:49,620][106225] Updated weights for policy 1, policy_version 323063 (0.0009) [2023-12-27 21:32:49,682][106225] Updated weights for policy 1, policy_version 323073 (0.0009) [2023-12-27 21:32:49,720][106226] Updated weights for policy 0, policy_version 322450 (0.0006) [2023-12-27 21:32:49,736][106225] Updated weights for policy 1, policy_version 323083 (0.0009) [2023-12-27 21:32:49,776][106226] Updated weights for policy 0, policy_version 322460 (0.0007) [2023-12-27 21:32:49,830][106226] Updated weights for policy 0, policy_version 322470 (0.0008) [2023-12-27 21:32:49,887][106226] Updated weights for policy 0, policy_version 322480 (0.0007) [2023-12-27 21:32:50,516][106225] Updated weights for policy 1, policy_version 323093 (0.0007) [2023-12-27 21:32:50,572][106225] Updated weights for policy 1, policy_version 323103 (0.0006) [2023-12-27 21:32:50,635][106226] Updated weights for policy 0, policy_version 322490 (0.0008) [2023-12-27 21:32:50,637][106225] Updated weights for policy 1, policy_version 323113 (0.0007) [2023-12-27 21:32:50,693][106226] Updated weights for policy 0, policy_version 322500 (0.0010) [2023-12-27 21:32:50,757][106226] Updated weights for policy 0, policy_version 322510 (0.0010) [2023-12-27 21:32:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 165330944. Throughput: 0: 9912.7, 1: 9824.7. Samples: 165342208. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:51,175][105115] Avg episode reward: [(0, '-5.051'), (1, '-5.564')] [2023-12-27 21:32:51,409][106225] Updated weights for policy 1, policy_version 323123 (0.0006) [2023-12-27 21:32:51,465][106226] Updated weights for policy 0, policy_version 322520 (0.0011) [2023-12-27 21:32:51,470][106225] Updated weights for policy 1, policy_version 323133 (0.0007) [2023-12-27 21:32:51,527][106226] Updated weights for policy 0, policy_version 322530 (0.0011) [2023-12-27 21:32:51,530][106225] Updated weights for policy 1, policy_version 323143 (0.0006) [2023-12-27 21:32:51,589][106226] Updated weights for policy 0, policy_version 322540 (0.0011) [2023-12-27 21:32:52,220][106226] Updated weights for policy 0, policy_version 322550 (0.0010) [2023-12-27 21:32:52,288][106226] Updated weights for policy 0, policy_version 322560 (0.0007) [2023-12-27 21:32:52,339][106225] Updated weights for policy 1, policy_version 323153 (0.0010) [2023-12-27 21:32:52,358][106226] Updated weights for policy 0, policy_version 322570 (0.0006) [2023-12-27 21:32:52,405][106225] Updated weights for policy 1, policy_version 323163 (0.0008) [2023-12-27 21:32:52,477][106225] Updated weights for policy 1, policy_version 323173 (0.0010) [2023-12-27 21:32:52,537][106225] Updated weights for policy 1, policy_version 323183 (0.0008) [2023-12-27 21:32:53,005][106226] Updated weights for policy 0, policy_version 322580 (0.0009) [2023-12-27 21:32:53,054][106226] Updated weights for policy 0, policy_version 322590 (0.0006) [2023-12-27 21:32:53,110][106226] Updated weights for policy 0, policy_version 322600 (0.0005) [2023-12-27 21:32:53,248][106225] Updated weights for policy 1, policy_version 323193 (0.0009) [2023-12-27 21:32:53,292][106225] Updated weights for policy 1, policy_version 323203 (0.0007) [2023-12-27 21:32:53,351][106225] Updated weights for policy 1, policy_version 323213 (0.0005) [2023-12-27 21:32:53,773][106226] Updated weights for policy 0, policy_version 322610 (0.0006) [2023-12-27 21:32:53,827][106226] Updated weights for policy 0, policy_version 322620 (0.0005) [2023-12-27 21:32:53,883][106226] Updated weights for policy 0, policy_version 322630 (0.0005) [2023-12-27 21:32:53,936][106226] Updated weights for policy 0, policy_version 322640 (0.0005) [2023-12-27 21:32:54,111][106225] Updated weights for policy 1, policy_version 323223 (0.0008) [2023-12-27 21:32:54,160][106225] Updated weights for policy 1, policy_version 323233 (0.0008) [2023-12-27 21:32:54,205][106225] Updated weights for policy 1, policy_version 323243 (0.0008) [2023-12-27 21:32:54,630][106226] Updated weights for policy 0, policy_version 322650 (0.0008) [2023-12-27 21:32:54,696][106226] Updated weights for policy 0, policy_version 322660 (0.0006) [2023-12-27 21:32:54,768][106226] Updated weights for policy 0, policy_version 322670 (0.0006) [2023-12-27 21:32:54,872][106225] Updated weights for policy 1, policy_version 323253 (0.0007) [2023-12-27 21:32:54,941][106225] Updated weights for policy 1, policy_version 323263 (0.0008) [2023-12-27 21:32:55,004][106225] Updated weights for policy 1, policy_version 323273 (0.0011) [2023-12-27 21:32:55,412][106226] Updated weights for policy 0, policy_version 322680 (0.0006) [2023-12-27 21:32:55,465][106226] Updated weights for policy 0, policy_version 322690 (0.0005) [2023-12-27 21:32:55,518][106226] Updated weights for policy 0, policy_version 322700 (0.0005) [2023-12-27 21:32:55,598][106225] Updated weights for policy 1, policy_version 323283 (0.0009) [2023-12-27 21:32:55,651][106225] Updated weights for policy 1, policy_version 323293 (0.0005) [2023-12-27 21:32:55,700][106225] Updated weights for policy 1, policy_version 323303 (0.0009) [2023-12-27 21:32:56,152][106226] Updated weights for policy 0, policy_version 322710 (0.0008) [2023-12-27 21:32:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 165429248. Throughput: 0: 9915.4, 1: 9818.3. Samples: 165401692. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:32:56,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.751')] [2023-12-27 21:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000323312_82788352.pth... [2023-12-27 21:32:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000322160_82493440.pth [2023-12-27 21:32:56,202][106226] Updated weights for policy 0, policy_version 322720 (0.0011) [2023-12-27 21:32:56,252][106226] Updated weights for policy 0, policy_version 322730 (0.0010) [2023-12-27 21:32:56,282][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000322736_82649088.pth... [2023-12-27 21:32:56,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000321552_82345984.pth [2023-12-27 21:32:56,353][106225] Updated weights for policy 1, policy_version 323313 (0.0009) [2023-12-27 21:32:56,402][106225] Updated weights for policy 1, policy_version 323323 (0.0005) [2023-12-27 21:32:56,447][106225] Updated weights for policy 1, policy_version 323333 (0.0005) [2023-12-27 21:32:56,491][106225] Updated weights for policy 1, policy_version 323343 (0.0005) [2023-12-27 21:32:56,834][106226] Updated weights for policy 0, policy_version 322740 (0.0010) [2023-12-27 21:32:56,891][106226] Updated weights for policy 0, policy_version 322750 (0.0009) [2023-12-27 21:32:56,943][106226] Updated weights for policy 0, policy_version 322760 (0.0008) [2023-12-27 21:32:57,204][106225] Updated weights for policy 1, policy_version 323353 (0.0006) [2023-12-27 21:32:57,254][106225] Updated weights for policy 1, policy_version 323363 (0.0009) [2023-12-27 21:32:57,312][106225] Updated weights for policy 1, policy_version 323373 (0.0009) [2023-12-27 21:32:57,557][106226] Updated weights for policy 0, policy_version 322770 (0.0006) [2023-12-27 21:32:57,605][106226] Updated weights for policy 0, policy_version 322780 (0.0010) [2023-12-27 21:32:57,651][106226] Updated weights for policy 0, policy_version 322790 (0.0010) [2023-12-27 21:32:57,694][106226] Updated weights for policy 0, policy_version 322800 (0.0010) [2023-12-27 21:32:58,029][106225] Updated weights for policy 1, policy_version 323383 (0.0009) [2023-12-27 21:32:58,082][106225] Updated weights for policy 1, policy_version 323393 (0.0008) [2023-12-27 21:32:58,141][106225] Updated weights for policy 1, policy_version 323403 (0.0007) [2023-12-27 21:32:58,434][106226] Updated weights for policy 0, policy_version 322810 (0.0008) [2023-12-27 21:32:58,497][106226] Updated weights for policy 0, policy_version 322820 (0.0008) [2023-12-27 21:32:58,564][106226] Updated weights for policy 0, policy_version 322830 (0.0008) [2023-12-27 21:32:59,003][106225] Updated weights for policy 1, policy_version 323413 (0.0007) [2023-12-27 21:32:59,071][106225] Updated weights for policy 1, policy_version 323423 (0.0006) [2023-12-27 21:32:59,125][106225] Updated weights for policy 1, policy_version 323433 (0.0008) [2023-12-27 21:32:59,383][106226] Updated weights for policy 0, policy_version 322840 (0.0009) [2023-12-27 21:32:59,426][106226] Updated weights for policy 0, policy_version 322850 (0.0006) [2023-12-27 21:32:59,471][106226] Updated weights for policy 0, policy_version 322860 (0.0005) [2023-12-27 21:32:59,841][106225] Updated weights for policy 1, policy_version 323443 (0.0006) [2023-12-27 21:32:59,906][106225] Updated weights for policy 1, policy_version 323453 (0.0008) [2023-12-27 21:32:59,973][106225] Updated weights for policy 1, policy_version 323463 (0.0008) [2023-12-27 21:33:00,174][106226] Updated weights for policy 0, policy_version 322870 (0.0008) [2023-12-27 21:33:00,232][106226] Updated weights for policy 0, policy_version 322880 (0.0010) [2023-12-27 21:33:00,291][106226] Updated weights for policy 0, policy_version 322890 (0.0008) [2023-12-27 21:33:00,617][106225] Updated weights for policy 1, policy_version 323473 (0.0007) [2023-12-27 21:33:00,678][106225] Updated weights for policy 1, policy_version 323483 (0.0005) [2023-12-27 21:33:00,741][106225] Updated weights for policy 1, policy_version 323493 (0.0008) [2023-12-27 21:33:00,788][106225] Updated weights for policy 1, policy_version 323503 (0.0008) [2023-12-27 21:33:00,867][106226] Updated weights for policy 0, policy_version 322900 (0.0011) [2023-12-27 21:33:00,923][106226] Updated weights for policy 0, policy_version 322910 (0.0010) [2023-12-27 21:33:00,978][106226] Updated weights for policy 0, policy_version 322920 (0.0010) [2023-12-27 21:33:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 165535744. Throughput: 0: 9988.7, 1: 9824.6. Samples: 165522092. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:33:01,175][105115] Avg episode reward: [(0, '-4.816'), (1, '-5.426')] [2023-12-27 21:33:01,461][106225] Updated weights for policy 1, policy_version 323513 (0.0006) [2023-12-27 21:33:01,520][106225] Updated weights for policy 1, policy_version 323523 (0.0005) [2023-12-27 21:33:01,583][106225] Updated weights for policy 1, policy_version 323533 (0.0005) [2023-12-27 21:33:01,734][106226] Updated weights for policy 0, policy_version 322930 (0.0010) [2023-12-27 21:33:01,792][106226] Updated weights for policy 0, policy_version 322940 (0.0010) [2023-12-27 21:33:01,856][106226] Updated weights for policy 0, policy_version 322950 (0.0008) [2023-12-27 21:33:01,913][106226] Updated weights for policy 0, policy_version 322960 (0.0009) [2023-12-27 21:33:02,225][106225] Updated weights for policy 1, policy_version 323543 (0.0008) [2023-12-27 21:33:02,291][106225] Updated weights for policy 1, policy_version 323553 (0.0009) [2023-12-27 21:33:02,353][106225] Updated weights for policy 1, policy_version 323563 (0.0009) [2023-12-27 21:33:02,652][106226] Updated weights for policy 0, policy_version 322970 (0.0008) [2023-12-27 21:33:02,715][106226] Updated weights for policy 0, policy_version 322980 (0.0009) [2023-12-27 21:33:02,771][106226] Updated weights for policy 0, policy_version 322990 (0.0008) [2023-12-27 21:33:03,057][106225] Updated weights for policy 1, policy_version 323573 (0.0008) [2023-12-27 21:33:03,112][106225] Updated weights for policy 1, policy_version 323583 (0.0008) [2023-12-27 21:33:03,163][106225] Updated weights for policy 1, policy_version 323593 (0.0005) [2023-12-27 21:33:03,481][106226] Updated weights for policy 0, policy_version 323000 (0.0009) [2023-12-27 21:33:03,542][106226] Updated weights for policy 0, policy_version 323010 (0.0009) [2023-12-27 21:33:03,596][106226] Updated weights for policy 0, policy_version 323020 (0.0008) [2023-12-27 21:33:03,846][106225] Updated weights for policy 1, policy_version 323603 (0.0007) [2023-12-27 21:33:03,909][106225] Updated weights for policy 1, policy_version 323613 (0.0008) [2023-12-27 21:33:03,969][106225] Updated weights for policy 1, policy_version 323623 (0.0009) [2023-12-27 21:33:04,306][106226] Updated weights for policy 0, policy_version 323030 (0.0008) [2023-12-27 21:33:04,366][106226] Updated weights for policy 0, policy_version 323040 (0.0008) [2023-12-27 21:33:04,435][106226] Updated weights for policy 0, policy_version 323050 (0.0006) [2023-12-27 21:33:04,673][106225] Updated weights for policy 1, policy_version 323633 (0.0008) [2023-12-27 21:33:04,736][106225] Updated weights for policy 1, policy_version 323643 (0.0008) [2023-12-27 21:33:04,792][106225] Updated weights for policy 1, policy_version 323653 (0.0006) [2023-12-27 21:33:04,854][106225] Updated weights for policy 1, policy_version 323663 (0.0008) [2023-12-27 21:33:05,120][106226] Updated weights for policy 0, policy_version 323060 (0.0007) [2023-12-27 21:33:05,174][106226] Updated weights for policy 0, policy_version 323070 (0.0009) [2023-12-27 21:33:05,224][106226] Updated weights for policy 0, policy_version 323080 (0.0009) [2023-12-27 21:33:05,569][106225] Updated weights for policy 1, policy_version 323673 (0.0007) [2023-12-27 21:33:05,626][106225] Updated weights for policy 1, policy_version 323683 (0.0008) [2023-12-27 21:33:05,685][106225] Updated weights for policy 1, policy_version 323693 (0.0009) [2023-12-27 21:33:05,978][106226] Updated weights for policy 0, policy_version 323090 (0.0006) [2023-12-27 21:33:06,042][106226] Updated weights for policy 0, policy_version 323100 (0.0008) [2023-12-27 21:33:06,113][106226] Updated weights for policy 0, policy_version 323110 (0.0008) [2023-12-27 21:33:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 165625856. Throughput: 0: 9947.5, 1: 9920.5. Samples: 165641020. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:06,175][105115] Avg episode reward: [(0, '-4.936'), (1, '-5.507')] [2023-12-27 21:33:06,181][106226] Updated weights for policy 0, policy_version 323120 (0.0008) [2023-12-27 21:33:06,348][106225] Updated weights for policy 1, policy_version 323703 (0.0006) [2023-12-27 21:33:06,412][106225] Updated weights for policy 1, policy_version 323713 (0.0010) [2023-12-27 21:33:06,468][106225] Updated weights for policy 1, policy_version 323723 (0.0006) [2023-12-27 21:33:06,806][106226] Updated weights for policy 0, policy_version 323130 (0.0006) [2023-12-27 21:33:06,869][106226] Updated weights for policy 0, policy_version 323140 (0.0008) [2023-12-27 21:33:06,925][106226] Updated weights for policy 0, policy_version 323150 (0.0009) [2023-12-27 21:33:07,058][106225] Updated weights for policy 1, policy_version 323733 (0.0008) [2023-12-27 21:33:07,116][106225] Updated weights for policy 1, policy_version 323743 (0.0005) [2023-12-27 21:33:07,175][106225] Updated weights for policy 1, policy_version 323753 (0.0005) [2023-12-27 21:33:07,501][106226] Updated weights for policy 0, policy_version 323160 (0.0009) [2023-12-27 21:33:07,563][106226] Updated weights for policy 0, policy_version 323170 (0.0011) [2023-12-27 21:33:07,621][106226] Updated weights for policy 0, policy_version 323180 (0.0011) [2023-12-27 21:33:07,786][106225] Updated weights for policy 1, policy_version 323763 (0.0006) [2023-12-27 21:33:07,847][106225] Updated weights for policy 1, policy_version 323773 (0.0008) [2023-12-27 21:33:07,898][106225] Updated weights for policy 1, policy_version 323783 (0.0006) [2023-12-27 21:33:08,325][106226] Updated weights for policy 0, policy_version 323190 (0.0009) [2023-12-27 21:33:08,396][106226] Updated weights for policy 0, policy_version 323200 (0.0009) [2023-12-27 21:33:08,455][106226] Updated weights for policy 0, policy_version 323210 (0.0008) [2023-12-27 21:33:08,593][106225] Updated weights for policy 1, policy_version 323793 (0.0006) [2023-12-27 21:33:08,654][106225] Updated weights for policy 1, policy_version 323803 (0.0008) [2023-12-27 21:33:08,717][106225] Updated weights for policy 1, policy_version 323813 (0.0006) [2023-12-27 21:33:08,771][106225] Updated weights for policy 1, policy_version 323823 (0.0008) [2023-12-27 21:33:09,172][106226] Updated weights for policy 0, policy_version 323220 (0.0007) [2023-12-27 21:33:09,228][106226] Updated weights for policy 0, policy_version 323230 (0.0008) [2023-12-27 21:33:09,290][106226] Updated weights for policy 0, policy_version 323240 (0.0009) [2023-12-27 21:33:09,387][106225] Updated weights for policy 1, policy_version 323833 (0.0008) [2023-12-27 21:33:09,451][106225] Updated weights for policy 1, policy_version 323843 (0.0007) [2023-12-27 21:33:09,508][106225] Updated weights for policy 1, policy_version 323853 (0.0007) [2023-12-27 21:33:09,982][106226] Updated weights for policy 0, policy_version 323250 (0.0011) [2023-12-27 21:33:10,035][106226] Updated weights for policy 0, policy_version 323260 (0.0008) [2023-12-27 21:33:10,084][106226] Updated weights for policy 0, policy_version 323270 (0.0008) [2023-12-27 21:33:10,164][106226] Updated weights for policy 0, policy_version 323280 (0.0009) [2023-12-27 21:33:10,179][106225] Updated weights for policy 1, policy_version 323863 (0.0008) [2023-12-27 21:33:10,244][106225] Updated weights for policy 1, policy_version 323873 (0.0008) [2023-12-27 21:33:10,307][106225] Updated weights for policy 1, policy_version 323883 (0.0008) [2023-12-27 21:33:10,865][106226] Updated weights for policy 0, policy_version 323290 (0.0010) [2023-12-27 21:33:10,911][106226] Updated weights for policy 0, policy_version 323300 (0.0006) [2023-12-27 21:33:10,973][106226] Updated weights for policy 0, policy_version 323310 (0.0007) [2023-12-27 21:33:11,074][106225] Updated weights for policy 1, policy_version 323893 (0.0008) [2023-12-27 21:33:11,141][106225] Updated weights for policy 1, policy_version 323903 (0.0008) [2023-12-27 21:33:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 165732352. Throughput: 0: 9993.6, 1: 10004.2. Samples: 165703904. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:11,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.696')] [2023-12-27 21:33:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000323312_82796544.pth... [2023-12-27 21:33:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000322128_82493440.pth [2023-12-27 21:33:11,193][106225] Updated weights for policy 1, policy_version 323913 (0.0010) [2023-12-27 21:33:11,231][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000323920_82944000.pth... [2023-12-27 21:33:11,235][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000322736_82640896.pth [2023-12-27 21:33:11,689][106226] Updated weights for policy 0, policy_version 323320 (0.0008) [2023-12-27 21:33:11,746][106226] Updated weights for policy 0, policy_version 323330 (0.0008) [2023-12-27 21:33:11,816][106226] Updated weights for policy 0, policy_version 323340 (0.0008) [2023-12-27 21:33:11,988][106225] Updated weights for policy 1, policy_version 323923 (0.0009) [2023-12-27 21:33:12,050][106225] Updated weights for policy 1, policy_version 323933 (0.0010) [2023-12-27 21:33:12,119][106225] Updated weights for policy 1, policy_version 323943 (0.0010) [2023-12-27 21:33:12,487][106226] Updated weights for policy 0, policy_version 323350 (0.0009) [2023-12-27 21:33:12,541][106226] Updated weights for policy 0, policy_version 323360 (0.0010) [2023-12-27 21:33:12,593][106226] Updated weights for policy 0, policy_version 323370 (0.0011) [2023-12-27 21:33:12,904][106225] Updated weights for policy 1, policy_version 323953 (0.0009) [2023-12-27 21:33:12,966][106225] Updated weights for policy 1, policy_version 323963 (0.0008) [2023-12-27 21:33:13,021][106225] Updated weights for policy 1, policy_version 323973 (0.0008) [2023-12-27 21:33:13,072][106225] Updated weights for policy 1, policy_version 323983 (0.0008) [2023-12-27 21:33:13,260][106226] Updated weights for policy 0, policy_version 323380 (0.0010) [2023-12-27 21:33:13,318][106226] Updated weights for policy 0, policy_version 323390 (0.0011) [2023-12-27 21:33:13,367][106226] Updated weights for policy 0, policy_version 323400 (0.0010) [2023-12-27 21:33:13,741][106225] Updated weights for policy 1, policy_version 323993 (0.0006) [2023-12-27 21:33:13,806][106225] Updated weights for policy 1, policy_version 324003 (0.0006) [2023-12-27 21:33:13,861][106225] Updated weights for policy 1, policy_version 324013 (0.0005) [2023-12-27 21:33:14,025][106226] Updated weights for policy 0, policy_version 323410 (0.0009) [2023-12-27 21:33:14,092][106226] Updated weights for policy 0, policy_version 323420 (0.0005) [2023-12-27 21:33:14,151][106226] Updated weights for policy 0, policy_version 323430 (0.0005) [2023-12-27 21:33:14,208][106226] Updated weights for policy 0, policy_version 323440 (0.0005) [2023-12-27 21:33:14,461][106225] Updated weights for policy 1, policy_version 324023 (0.0007) [2023-12-27 21:33:14,520][106225] Updated weights for policy 1, policy_version 324033 (0.0007) [2023-12-27 21:33:14,575][106225] Updated weights for policy 1, policy_version 324043 (0.0008) [2023-12-27 21:33:14,831][106226] Updated weights for policy 0, policy_version 323450 (0.0008) [2023-12-27 21:33:14,899][106226] Updated weights for policy 0, policy_version 323460 (0.0006) [2023-12-27 21:33:14,962][106226] Updated weights for policy 0, policy_version 323470 (0.0009) [2023-12-27 21:33:15,272][106225] Updated weights for policy 1, policy_version 324053 (0.0009) [2023-12-27 21:33:15,335][106225] Updated weights for policy 1, policy_version 324063 (0.0008) [2023-12-27 21:33:15,390][106225] Updated weights for policy 1, policy_version 324073 (0.0008) [2023-12-27 21:33:15,716][106226] Updated weights for policy 0, policy_version 323480 (0.0009) [2023-12-27 21:33:15,772][106226] Updated weights for policy 0, policy_version 323490 (0.0006) [2023-12-27 21:33:15,829][106226] Updated weights for policy 0, policy_version 323500 (0.0005) [2023-12-27 21:33:16,078][106225] Updated weights for policy 1, policy_version 324083 (0.0007) [2023-12-27 21:33:16,127][106225] Updated weights for policy 1, policy_version 324093 (0.0008) [2023-12-27 21:33:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 165830656. Throughput: 0: 10084.1, 1: 9862.8. Samples: 165823676. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:16,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.691')] [2023-12-27 21:33:16,182][106225] Updated weights for policy 1, policy_version 324103 (0.0009) [2023-12-27 21:33:16,408][106226] Updated weights for policy 0, policy_version 323510 (0.0009) [2023-12-27 21:33:16,463][106226] Updated weights for policy 0, policy_version 323520 (0.0008) [2023-12-27 21:33:16,519][106226] Updated weights for policy 0, policy_version 323530 (0.0008) [2023-12-27 21:33:16,874][106225] Updated weights for policy 1, policy_version 324113 (0.0007) [2023-12-27 21:33:16,924][106225] Updated weights for policy 1, policy_version 324123 (0.0009) [2023-12-27 21:33:16,974][106225] Updated weights for policy 1, policy_version 324133 (0.0008) [2023-12-27 21:33:17,030][106225] Updated weights for policy 1, policy_version 324143 (0.0008) [2023-12-27 21:33:17,190][106226] Updated weights for policy 0, policy_version 323540 (0.0008) [2023-12-27 21:33:17,247][106226] Updated weights for policy 0, policy_version 323550 (0.0006) [2023-12-27 21:33:17,298][106226] Updated weights for policy 0, policy_version 323560 (0.0007) [2023-12-27 21:33:17,766][106225] Updated weights for policy 1, policy_version 324153 (0.0009) [2023-12-27 21:33:17,821][106225] Updated weights for policy 1, policy_version 324163 (0.0008) [2023-12-27 21:33:17,857][106226] Updated weights for policy 0, policy_version 323570 (0.0010) [2023-12-27 21:33:17,875][106225] Updated weights for policy 1, policy_version 324173 (0.0007) [2023-12-27 21:33:17,911][106226] Updated weights for policy 0, policy_version 323580 (0.0008) [2023-12-27 21:33:17,968][106226] Updated weights for policy 0, policy_version 323590 (0.0009) [2023-12-27 21:33:18,026][106226] Updated weights for policy 0, policy_version 323600 (0.0008) [2023-12-27 21:33:18,589][106225] Updated weights for policy 1, policy_version 324183 (0.0008) [2023-12-27 21:33:18,645][106225] Updated weights for policy 1, policy_version 324193 (0.0009) [2023-12-27 21:33:18,702][106225] Updated weights for policy 1, policy_version 324203 (0.0008) [2023-12-27 21:33:18,738][106226] Updated weights for policy 0, policy_version 323610 (0.0008) [2023-12-27 21:33:18,797][106226] Updated weights for policy 0, policy_version 323620 (0.0008) [2023-12-27 21:33:18,860][106226] Updated weights for policy 0, policy_version 323630 (0.0009) [2023-12-27 21:33:19,481][106225] Updated weights for policy 1, policy_version 324213 (0.0007) [2023-12-27 21:33:19,549][106225] Updated weights for policy 1, policy_version 324223 (0.0008) [2023-12-27 21:33:19,606][106225] Updated weights for policy 1, policy_version 324233 (0.0007) [2023-12-27 21:33:19,619][106226] Updated weights for policy 0, policy_version 323640 (0.0008) [2023-12-27 21:33:19,674][106226] Updated weights for policy 0, policy_version 323650 (0.0008) [2023-12-27 21:33:19,738][106226] Updated weights for policy 0, policy_version 323660 (0.0008) [2023-12-27 21:33:20,344][106225] Updated weights for policy 1, policy_version 324243 (0.0007) [2023-12-27 21:33:20,412][106225] Updated weights for policy 1, policy_version 324253 (0.0009) [2023-12-27 21:33:20,473][106225] Updated weights for policy 1, policy_version 324263 (0.0007) [2023-12-27 21:33:20,478][106226] Updated weights for policy 0, policy_version 323670 (0.0009) [2023-12-27 21:33:20,548][106226] Updated weights for policy 0, policy_version 323680 (0.0007) [2023-12-27 21:33:20,617][106226] Updated weights for policy 0, policy_version 323690 (0.0008) [2023-12-27 21:33:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 165928960. Throughput: 0: 10146.6, 1: 9846.8. Samples: 165942796. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:21,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-5.744')] [2023-12-27 21:33:21,251][106225] Updated weights for policy 1, policy_version 324273 (0.0009) [2023-12-27 21:33:21,253][106226] Updated weights for policy 0, policy_version 323700 (0.0007) [2023-12-27 21:33:21,316][106225] Updated weights for policy 1, policy_version 324283 (0.0011) [2023-12-27 21:33:21,316][106226] Updated weights for policy 0, policy_version 323710 (0.0008) [2023-12-27 21:33:21,391][106225] Updated weights for policy 1, policy_version 324293 (0.0013) [2023-12-27 21:33:21,394][106226] Updated weights for policy 0, policy_version 323720 (0.0009) [2023-12-27 21:33:21,451][106225] Updated weights for policy 1, policy_version 324303 (0.0009) [2023-12-27 21:33:22,220][106226] Updated weights for policy 0, policy_version 323730 (0.0008) [2023-12-27 21:33:22,276][106226] Updated weights for policy 0, policy_version 323740 (0.0008) [2023-12-27 21:33:22,285][106225] Updated weights for policy 1, policy_version 324313 (0.0008) [2023-12-27 21:33:22,341][106226] Updated weights for policy 0, policy_version 323750 (0.0007) [2023-12-27 21:33:22,344][106225] Updated weights for policy 1, policy_version 324323 (0.0007) [2023-12-27 21:33:22,402][106226] Updated weights for policy 0, policy_version 323760 (0.0008) [2023-12-27 21:33:22,412][106225] Updated weights for policy 1, policy_version 324333 (0.0007) [2023-12-27 21:33:23,096][106225] Updated weights for policy 1, policy_version 324343 (0.0006) [2023-12-27 21:33:23,108][106226] Updated weights for policy 0, policy_version 323770 (0.0009) [2023-12-27 21:33:23,148][106225] Updated weights for policy 1, policy_version 324353 (0.0006) [2023-12-27 21:33:23,163][106226] Updated weights for policy 0, policy_version 323780 (0.0007) [2023-12-27 21:33:23,205][106225] Updated weights for policy 1, policy_version 324363 (0.0008) [2023-12-27 21:33:23,223][106226] Updated weights for policy 0, policy_version 323790 (0.0007) [2023-12-27 21:33:23,921][106225] Updated weights for policy 1, policy_version 324373 (0.0008) [2023-12-27 21:33:23,955][106226] Updated weights for policy 0, policy_version 323800 (0.0007) [2023-12-27 21:33:23,984][106225] Updated weights for policy 1, policy_version 324383 (0.0006) [2023-12-27 21:33:24,017][106226] Updated weights for policy 0, policy_version 323810 (0.0007) [2023-12-27 21:33:24,038][106225] Updated weights for policy 1, policy_version 324393 (0.0006) [2023-12-27 21:33:24,079][106226] Updated weights for policy 0, policy_version 323820 (0.0007) [2023-12-27 21:33:24,715][106225] Updated weights for policy 1, policy_version 324403 (0.0008) [2023-12-27 21:33:24,758][106226] Updated weights for policy 0, policy_version 323830 (0.0008) [2023-12-27 21:33:24,768][106225] Updated weights for policy 1, policy_version 324413 (0.0007) [2023-12-27 21:33:24,813][106226] Updated weights for policy 0, policy_version 323840 (0.0005) [2023-12-27 21:33:24,815][106225] Updated weights for policy 1, policy_version 324423 (0.0008) [2023-12-27 21:33:24,867][106226] Updated weights for policy 0, policy_version 323850 (0.0006) [2023-12-27 21:33:25,475][106225] Updated weights for policy 1, policy_version 324433 (0.0008) [2023-12-27 21:33:25,533][106225] Updated weights for policy 1, policy_version 324443 (0.0005) [2023-12-27 21:33:25,589][106225] Updated weights for policy 1, policy_version 324453 (0.0005) [2023-12-27 21:33:25,610][106226] Updated weights for policy 0, policy_version 323860 (0.0008) [2023-12-27 21:33:25,637][106225] Updated weights for policy 1, policy_version 324463 (0.0005) [2023-12-27 21:33:25,661][106226] Updated weights for policy 0, policy_version 323870 (0.0009) [2023-12-27 21:33:25,722][106226] Updated weights for policy 0, policy_version 323881 (0.0010) [2023-12-27 21:33:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 166027264. Throughput: 0: 10096.7, 1: 9826.0. Samples: 165997832. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:26,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-5.628')] [2023-12-27 21:33:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000323888_82944000.pth... [2023-12-27 21:33:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000324464_83083264.pth... [2023-12-27 21:33:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000323312_82788352.pth [2023-12-27 21:33:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000322736_82649088.pth [2023-12-27 21:33:26,322][106225] Updated weights for policy 1, policy_version 324473 (0.0007) [2023-12-27 21:33:26,380][106226] Updated weights for policy 0, policy_version 323891 (0.0010) [2023-12-27 21:33:26,382][106225] Updated weights for policy 1, policy_version 324483 (0.0007) [2023-12-27 21:33:26,442][106225] Updated weights for policy 1, policy_version 324493 (0.0005) [2023-12-27 21:33:26,444][106226] Updated weights for policy 0, policy_version 323901 (0.0010) [2023-12-27 21:33:26,504][106226] Updated weights for policy 0, policy_version 323911 (0.0010) [2023-12-27 21:33:27,017][106225] Updated weights for policy 1, policy_version 324503 (0.0005) [2023-12-27 21:33:27,070][106225] Updated weights for policy 1, policy_version 324513 (0.0009) [2023-12-27 21:33:27,126][106225] Updated weights for policy 1, policy_version 324523 (0.0010) [2023-12-27 21:33:27,214][106226] Updated weights for policy 0, policy_version 323921 (0.0010) [2023-12-27 21:33:27,276][106226] Updated weights for policy 0, policy_version 323931 (0.0010) [2023-12-27 21:33:27,339][106226] Updated weights for policy 0, policy_version 323941 (0.0010) [2023-12-27 21:33:27,388][106226] Updated weights for policy 0, policy_version 323951 (0.0010) [2023-12-27 21:33:27,727][106225] Updated weights for policy 1, policy_version 324533 (0.0008) [2023-12-27 21:33:27,782][106225] Updated weights for policy 1, policy_version 324543 (0.0005) [2023-12-27 21:33:27,837][106225] Updated weights for policy 1, policy_version 324553 (0.0005) [2023-12-27 21:33:28,086][106226] Updated weights for policy 0, policy_version 323961 (0.0010) [2023-12-27 21:33:28,139][106226] Updated weights for policy 0, policy_version 323971 (0.0010) [2023-12-27 21:33:28,210][106226] Updated weights for policy 0, policy_version 323981 (0.0010) [2023-12-27 21:33:28,389][106225] Updated weights for policy 1, policy_version 324563 (0.0006) [2023-12-27 21:33:28,451][106225] Updated weights for policy 1, policy_version 324573 (0.0008) [2023-12-27 21:33:28,513][106225] Updated weights for policy 1, policy_version 324583 (0.0008) [2023-12-27 21:33:28,912][106226] Updated weights for policy 0, policy_version 323991 (0.0011) [2023-12-27 21:33:28,961][106226] Updated weights for policy 0, policy_version 324001 (0.0011) [2023-12-27 21:33:29,021][106226] Updated weights for policy 0, policy_version 324011 (0.0011) [2023-12-27 21:33:29,154][106225] Updated weights for policy 1, policy_version 324593 (0.0008) [2023-12-27 21:33:29,203][106225] Updated weights for policy 1, policy_version 324603 (0.0010) [2023-12-27 21:33:29,263][106225] Updated weights for policy 1, policy_version 324613 (0.0009) [2023-12-27 21:33:29,319][106225] Updated weights for policy 1, policy_version 324623 (0.0010) [2023-12-27 21:33:29,696][106226] Updated weights for policy 0, policy_version 324021 (0.0011) [2023-12-27 21:33:29,755][106226] Updated weights for policy 0, policy_version 324031 (0.0010) [2023-12-27 21:33:29,805][106226] Updated weights for policy 0, policy_version 324041 (0.0010) [2023-12-27 21:33:30,080][106225] Updated weights for policy 1, policy_version 324633 (0.0008) [2023-12-27 21:33:30,142][106225] Updated weights for policy 1, policy_version 324643 (0.0009) [2023-12-27 21:33:30,205][106225] Updated weights for policy 1, policy_version 324653 (0.0008) [2023-12-27 21:33:30,552][106226] Updated weights for policy 0, policy_version 324051 (0.0010) [2023-12-27 21:33:30,598][106226] Updated weights for policy 0, policy_version 324061 (0.0010) [2023-12-27 21:33:30,643][106226] Updated weights for policy 0, policy_version 324071 (0.0010) [2023-12-27 21:33:30,874][106225] Updated weights for policy 1, policy_version 324663 (0.0007) [2023-12-27 21:33:30,931][106225] Updated weights for policy 1, policy_version 324673 (0.0005) [2023-12-27 21:33:30,993][106225] Updated weights for policy 1, policy_version 324683 (0.0005) [2023-12-27 21:33:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 166133760. Throughput: 0: 10090.1, 1: 9947.4. Samples: 166121492. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:31,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-5.379')] [2023-12-27 21:33:31,411][106226] Updated weights for policy 0, policy_version 324081 (0.0010) [2023-12-27 21:33:31,473][106226] Updated weights for policy 0, policy_version 324091 (0.0005) [2023-12-27 21:33:31,542][106226] Updated weights for policy 0, policy_version 324101 (0.0008) [2023-12-27 21:33:31,604][106226] Updated weights for policy 0, policy_version 324111 (0.0008) [2023-12-27 21:33:31,673][106225] Updated weights for policy 1, policy_version 324693 (0.0006) [2023-12-27 21:33:31,740][106225] Updated weights for policy 1, policy_version 324703 (0.0008) [2023-12-27 21:33:31,793][106225] Updated weights for policy 1, policy_version 324713 (0.0008) [2023-12-27 21:33:32,388][106225] Updated weights for policy 1, policy_version 324723 (0.0008) [2023-12-27 21:33:32,409][106226] Updated weights for policy 0, policy_version 324121 (0.0008) [2023-12-27 21:33:32,446][106225] Updated weights for policy 1, policy_version 324733 (0.0007) [2023-12-27 21:33:32,479][106226] Updated weights for policy 0, policy_version 324131 (0.0008) [2023-12-27 21:33:32,508][106225] Updated weights for policy 1, policy_version 324743 (0.0009) [2023-12-27 21:33:32,544][106226] Updated weights for policy 0, policy_version 324141 (0.0006) [2023-12-27 21:33:33,221][106225] Updated weights for policy 1, policy_version 324753 (0.0010) [2023-12-27 21:33:33,257][106226] Updated weights for policy 0, policy_version 324151 (0.0006) [2023-12-27 21:33:33,281][106225] Updated weights for policy 1, policy_version 324763 (0.0010) [2023-12-27 21:33:33,314][106226] Updated weights for policy 0, policy_version 324161 (0.0006) [2023-12-27 21:33:33,331][106225] Updated weights for policy 1, policy_version 324773 (0.0010) [2023-12-27 21:33:33,367][106226] Updated weights for policy 0, policy_version 324171 (0.0006) [2023-12-27 21:33:33,388][106225] Updated weights for policy 1, policy_version 324783 (0.0010) [2023-12-27 21:33:34,032][106226] Updated weights for policy 0, policy_version 324181 (0.0005) [2023-12-27 21:33:34,102][106226] Updated weights for policy 0, policy_version 324191 (0.0006) [2023-12-27 21:33:34,115][106225] Updated weights for policy 1, policy_version 324793 (0.0010) [2023-12-27 21:33:34,162][106226] Updated weights for policy 0, policy_version 324201 (0.0011) [2023-12-27 21:33:34,178][106225] Updated weights for policy 1, policy_version 324803 (0.0010) [2023-12-27 21:33:34,241][106225] Updated weights for policy 1, policy_version 324813 (0.0009) [2023-12-27 21:33:34,749][106226] Updated weights for policy 0, policy_version 324211 (0.0010) [2023-12-27 21:33:34,810][106226] Updated weights for policy 0, policy_version 324221 (0.0009) [2023-12-27 21:33:34,868][106226] Updated weights for policy 0, policy_version 324231 (0.0009) [2023-12-27 21:33:34,943][106225] Updated weights for policy 1, policy_version 324823 (0.0007) [2023-12-27 21:33:34,991][106225] Updated weights for policy 1, policy_version 324833 (0.0008) [2023-12-27 21:33:35,041][106225] Updated weights for policy 1, policy_version 324843 (0.0010) [2023-12-27 21:33:35,625][106226] Updated weights for policy 0, policy_version 324241 (0.0010) [2023-12-27 21:33:35,685][106226] Updated weights for policy 0, policy_version 324251 (0.0008) [2023-12-27 21:33:35,696][106225] Updated weights for policy 1, policy_version 324853 (0.0010) [2023-12-27 21:33:35,746][106226] Updated weights for policy 0, policy_version 324261 (0.0007) [2023-12-27 21:33:35,759][106225] Updated weights for policy 1, policy_version 324863 (0.0010) [2023-12-27 21:33:35,809][106226] Updated weights for policy 0, policy_version 324271 (0.0008) [2023-12-27 21:33:35,818][106225] Updated weights for policy 1, policy_version 324873 (0.0006) [2023-12-27 21:33:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 166232064. Throughput: 0: 9977.9, 1: 9973.4. Samples: 166240016. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:36,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-5.663')] [2023-12-27 21:33:36,504][106226] Updated weights for policy 0, policy_version 324281 (0.0010) [2023-12-27 21:33:36,521][106225] Updated weights for policy 1, policy_version 324883 (0.0011) [2023-12-27 21:33:36,569][106226] Updated weights for policy 0, policy_version 324291 (0.0011) [2023-12-27 21:33:36,588][106225] Updated weights for policy 1, policy_version 324893 (0.0011) [2023-12-27 21:33:36,631][106226] Updated weights for policy 0, policy_version 324301 (0.0011) [2023-12-27 21:33:36,653][106225] Updated weights for policy 1, policy_version 324903 (0.0011) [2023-12-27 21:33:37,338][106226] Updated weights for policy 0, policy_version 324311 (0.0011) [2023-12-27 21:33:37,348][106225] Updated weights for policy 1, policy_version 324913 (0.0010) [2023-12-27 21:33:37,392][106226] Updated weights for policy 0, policy_version 324321 (0.0011) [2023-12-27 21:33:37,406][106225] Updated weights for policy 1, policy_version 324923 (0.0010) [2023-12-27 21:33:37,450][106226] Updated weights for policy 0, policy_version 324331 (0.0010) [2023-12-27 21:33:37,463][106225] Updated weights for policy 1, policy_version 324933 (0.0006) [2023-12-27 21:33:37,520][106225] Updated weights for policy 1, policy_version 324943 (0.0007) [2023-12-27 21:33:38,066][106226] Updated weights for policy 0, policy_version 324341 (0.0011) [2023-12-27 21:33:38,123][106226] Updated weights for policy 0, policy_version 324351 (0.0010) [2023-12-27 21:33:38,170][106226] Updated weights for policy 0, policy_version 324361 (0.0011) [2023-12-27 21:33:38,200][106225] Updated weights for policy 1, policy_version 324953 (0.0010) [2023-12-27 21:33:38,262][106225] Updated weights for policy 1, policy_version 324963 (0.0010) [2023-12-27 21:33:38,319][106225] Updated weights for policy 1, policy_version 324973 (0.0010) [2023-12-27 21:33:38,918][106226] Updated weights for policy 0, policy_version 324371 (0.0011) [2023-12-27 21:33:38,976][106226] Updated weights for policy 0, policy_version 324381 (0.0010) [2023-12-27 21:33:39,024][106225] Updated weights for policy 1, policy_version 324983 (0.0010) [2023-12-27 21:33:39,039][106226] Updated weights for policy 0, policy_version 324391 (0.0011) [2023-12-27 21:33:39,086][106225] Updated weights for policy 1, policy_version 324993 (0.0011) [2023-12-27 21:33:39,154][106225] Updated weights for policy 1, policy_version 325003 (0.0010) [2023-12-27 21:33:39,821][106226] Updated weights for policy 0, policy_version 324401 (0.0011) [2023-12-27 21:33:39,890][106226] Updated weights for policy 0, policy_version 324411 (0.0009) [2023-12-27 21:33:39,916][106225] Updated weights for policy 1, policy_version 325013 (0.0009) [2023-12-27 21:33:39,950][106226] Updated weights for policy 0, policy_version 324421 (0.0009) [2023-12-27 21:33:39,982][106225] Updated weights for policy 1, policy_version 325023 (0.0008) [2023-12-27 21:33:40,013][106226] Updated weights for policy 0, policy_version 324431 (0.0010) [2023-12-27 21:33:40,044][106225] Updated weights for policy 1, policy_version 325033 (0.0007) [2023-12-27 21:33:40,746][106226] Updated weights for policy 0, policy_version 324441 (0.0011) [2023-12-27 21:33:40,786][106225] Updated weights for policy 1, policy_version 325043 (0.0008) [2023-12-27 21:33:40,800][106226] Updated weights for policy 0, policy_version 324451 (0.0011) [2023-12-27 21:33:40,838][106225] Updated weights for policy 1, policy_version 325053 (0.0006) [2023-12-27 21:33:40,854][106226] Updated weights for policy 0, policy_version 324461 (0.0011) [2023-12-27 21:33:40,892][106225] Updated weights for policy 1, policy_version 325063 (0.0008) [2023-12-27 21:33:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 166330368. Throughput: 0: 9949.2, 1: 10006.6. Samples: 166299700. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:41,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.675')] [2023-12-27 21:33:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000325072_83238912.pth... [2023-12-27 21:33:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000324464_83091456.pth... [2023-12-27 21:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000323920_82944000.pth [2023-12-27 21:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000325072_83238912.pth [2023-12-27 21:33:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000323312_82796544.pth [2023-12-27 21:33:41,189][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000324464_83091456.pth [2023-12-27 21:33:41,629][106226] Updated weights for policy 0, policy_version 324471 (0.0009) [2023-12-27 21:33:41,697][106226] Updated weights for policy 0, policy_version 324481 (0.0008) [2023-12-27 21:33:41,703][106225] Updated weights for policy 1, policy_version 325073 (0.0006) [2023-12-27 21:33:41,760][106226] Updated weights for policy 0, policy_version 324491 (0.0008) [2023-12-27 21:33:41,762][106225] Updated weights for policy 1, policy_version 325083 (0.0008) [2023-12-27 21:33:41,820][106225] Updated weights for policy 1, policy_version 325093 (0.0008) [2023-12-27 21:33:41,883][106225] Updated weights for policy 1, policy_version 325103 (0.0008) [2023-12-27 21:33:42,505][106226] Updated weights for policy 0, policy_version 324501 (0.0010) [2023-12-27 21:33:42,562][106226] Updated weights for policy 0, policy_version 324511 (0.0011) [2023-12-27 21:33:42,623][106226] Updated weights for policy 0, policy_version 324521 (0.0011) [2023-12-27 21:33:42,657][106225] Updated weights for policy 1, policy_version 325113 (0.0006) [2023-12-27 21:33:42,713][106225] Updated weights for policy 1, policy_version 325123 (0.0008) [2023-12-27 21:33:42,778][106225] Updated weights for policy 1, policy_version 325133 (0.0008) [2023-12-27 21:33:43,361][106226] Updated weights for policy 0, policy_version 324531 (0.0011) [2023-12-27 21:33:43,417][106226] Updated weights for policy 0, policy_version 324541 (0.0011) [2023-12-27 21:33:43,471][106226] Updated weights for policy 0, policy_version 324551 (0.0010) [2023-12-27 21:33:43,480][106225] Updated weights for policy 1, policy_version 325143 (0.0006) [2023-12-27 21:33:43,530][106225] Updated weights for policy 1, policy_version 325153 (0.0009) [2023-12-27 21:33:43,573][106225] Updated weights for policy 1, policy_version 325163 (0.0010) [2023-12-27 21:33:44,197][106226] Updated weights for policy 0, policy_version 324561 (0.0010) [2023-12-27 21:33:44,259][106226] Updated weights for policy 0, policy_version 324571 (0.0007) [2023-12-27 21:33:44,261][106225] Updated weights for policy 1, policy_version 325173 (0.0010) [2023-12-27 21:33:44,314][106226] Updated weights for policy 0, policy_version 324581 (0.0006) [2023-12-27 21:33:44,318][106225] Updated weights for policy 1, policy_version 325183 (0.0010) [2023-12-27 21:33:44,366][106225] Updated weights for policy 1, policy_version 325193 (0.0010) [2023-12-27 21:33:44,376][106226] Updated weights for policy 0, policy_version 324591 (0.0007) [2023-12-27 21:33:45,022][106226] Updated weights for policy 0, policy_version 324601 (0.0008) [2023-12-27 21:33:45,044][106225] Updated weights for policy 1, policy_version 325203 (0.0009) [2023-12-27 21:33:45,073][106226] Updated weights for policy 0, policy_version 324611 (0.0008) [2023-12-27 21:33:45,104][106225] Updated weights for policy 1, policy_version 325213 (0.0007) [2023-12-27 21:33:45,131][106226] Updated weights for policy 0, policy_version 324621 (0.0010) [2023-12-27 21:33:45,162][106225] Updated weights for policy 1, policy_version 325223 (0.0006) [2023-12-27 21:33:45,700][106225] Updated weights for policy 1, policy_version 325233 (0.0006) [2023-12-27 21:33:45,756][106225] Updated weights for policy 1, policy_version 325243 (0.0009) [2023-12-27 21:33:45,797][106226] Updated weights for policy 0, policy_version 324631 (0.0006) [2023-12-27 21:33:45,803][106225] Updated weights for policy 1, policy_version 325253 (0.0010) [2023-12-27 21:33:45,841][106226] Updated weights for policy 0, policy_version 324641 (0.0005) [2023-12-27 21:33:45,857][106225] Updated weights for policy 1, policy_version 325263 (0.0010) [2023-12-27 21:33:45,890][106226] Updated weights for policy 0, policy_version 324651 (0.0005) [2023-12-27 21:33:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 166428672. Throughput: 0: 9845.8, 1: 9958.2. Samples: 166413276. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:46,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-5.105')] [2023-12-27 21:33:46,176][106141] Saving new best policy, reward=-5.105! [2023-12-27 21:33:46,486][106225] Updated weights for policy 1, policy_version 325273 (0.0006) [2023-12-27 21:33:46,545][106225] Updated weights for policy 1, policy_version 325283 (0.0005) [2023-12-27 21:33:46,575][106226] Updated weights for policy 0, policy_version 324661 (0.0007) [2023-12-27 21:33:46,599][106225] Updated weights for policy 1, policy_version 325293 (0.0006) [2023-12-27 21:33:46,632][106226] Updated weights for policy 0, policy_version 324671 (0.0011) [2023-12-27 21:33:46,699][106226] Updated weights for policy 0, policy_version 324681 (0.0006) [2023-12-27 21:33:47,154][106225] Updated weights for policy 1, policy_version 325303 (0.0005) [2023-12-27 21:33:47,205][106225] Updated weights for policy 1, policy_version 325313 (0.0006) [2023-12-27 21:33:47,270][106225] Updated weights for policy 1, policy_version 325323 (0.0007) [2023-12-27 21:33:47,338][106226] Updated weights for policy 0, policy_version 324691 (0.0007) [2023-12-27 21:33:47,394][106226] Updated weights for policy 0, policy_version 324701 (0.0011) [2023-12-27 21:33:47,451][106226] Updated weights for policy 0, policy_version 324711 (0.0010) [2023-12-27 21:33:47,924][106225] Updated weights for policy 1, policy_version 325333 (0.0007) [2023-12-27 21:33:47,973][106225] Updated weights for policy 1, policy_version 325343 (0.0008) [2023-12-27 21:33:48,030][106225] Updated weights for policy 1, policy_version 325353 (0.0008) [2023-12-27 21:33:48,101][106226] Updated weights for policy 0, policy_version 324721 (0.0010) [2023-12-27 21:33:48,163][106226] Updated weights for policy 0, policy_version 324731 (0.0005) [2023-12-27 21:33:48,225][106226] Updated weights for policy 0, policy_version 324741 (0.0007) [2023-12-27 21:33:48,284][106226] Updated weights for policy 0, policy_version 324751 (0.0010) [2023-12-27 21:33:48,779][106225] Updated weights for policy 1, policy_version 325363 (0.0008) [2023-12-27 21:33:48,847][106225] Updated weights for policy 1, policy_version 325373 (0.0011) [2023-12-27 21:33:48,877][106226] Updated weights for policy 0, policy_version 324761 (0.0006) [2023-12-27 21:33:48,912][106225] Updated weights for policy 1, policy_version 325383 (0.0010) [2023-12-27 21:33:48,942][106226] Updated weights for policy 0, policy_version 324771 (0.0006) [2023-12-27 21:33:48,991][106226] Updated weights for policy 0, policy_version 324781 (0.0009) [2023-12-27 21:33:49,604][106225] Updated weights for policy 1, policy_version 325393 (0.0010) [2023-12-27 21:33:49,673][106225] Updated weights for policy 1, policy_version 325403 (0.0011) [2023-12-27 21:33:49,719][106226] Updated weights for policy 0, policy_version 324791 (0.0008) [2023-12-27 21:33:49,734][106225] Updated weights for policy 1, policy_version 325413 (0.0010) [2023-12-27 21:33:49,780][106226] Updated weights for policy 0, policy_version 324801 (0.0009) [2023-12-27 21:33:49,800][106225] Updated weights for policy 1, policy_version 325423 (0.0010) [2023-12-27 21:33:49,851][106226] Updated weights for policy 0, policy_version 324811 (0.0008) [2023-12-27 21:33:50,521][106226] Updated weights for policy 0, policy_version 324821 (0.0009) [2023-12-27 21:33:50,539][106225] Updated weights for policy 1, policy_version 325433 (0.0008) [2023-12-27 21:33:50,582][106226] Updated weights for policy 0, policy_version 324831 (0.0008) [2023-12-27 21:33:50,607][106225] Updated weights for policy 1, policy_version 325443 (0.0007) [2023-12-27 21:33:50,646][106226] Updated weights for policy 0, policy_version 324841 (0.0011) [2023-12-27 21:33:50,671][106225] Updated weights for policy 1, policy_version 325453 (0.0006) [2023-12-27 21:33:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 166526976. Throughput: 0: 9907.8, 1: 10003.2. Samples: 166537016. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:51,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-5.723')] [2023-12-27 21:33:51,375][106226] Updated weights for policy 0, policy_version 324851 (0.0010) [2023-12-27 21:33:51,436][106226] Updated weights for policy 0, policy_version 324861 (0.0010) [2023-12-27 21:33:51,469][106225] Updated weights for policy 1, policy_version 325463 (0.0006) [2023-12-27 21:33:51,498][106226] Updated weights for policy 0, policy_version 324871 (0.0010) [2023-12-27 21:33:51,527][106225] Updated weights for policy 1, policy_version 325473 (0.0005) [2023-12-27 21:33:51,594][106225] Updated weights for policy 1, policy_version 325483 (0.0007) [2023-12-27 21:33:52,153][106226] Updated weights for policy 0, policy_version 324881 (0.0011) [2023-12-27 21:33:52,215][106226] Updated weights for policy 0, policy_version 324891 (0.0006) [2023-12-27 21:33:52,283][106226] Updated weights for policy 0, policy_version 324901 (0.0009) [2023-12-27 21:33:52,347][106226] Updated weights for policy 0, policy_version 324911 (0.0007) [2023-12-27 21:33:52,375][106225] Updated weights for policy 1, policy_version 325493 (0.0009) [2023-12-27 21:33:52,429][106225] Updated weights for policy 1, policy_version 325503 (0.0008) [2023-12-27 21:33:52,493][106225] Updated weights for policy 1, policy_version 325513 (0.0008) [2023-12-27 21:33:53,001][106226] Updated weights for policy 0, policy_version 324921 (0.0006) [2023-12-27 21:33:53,071][106226] Updated weights for policy 0, policy_version 324931 (0.0006) [2023-12-27 21:33:53,130][106226] Updated weights for policy 0, policy_version 324941 (0.0009) [2023-12-27 21:33:53,263][106225] Updated weights for policy 1, policy_version 325523 (0.0008) [2023-12-27 21:33:53,323][106225] Updated weights for policy 1, policy_version 325533 (0.0009) [2023-12-27 21:33:53,376][106225] Updated weights for policy 1, policy_version 325543 (0.0008) [2023-12-27 21:33:53,682][106226] Updated weights for policy 0, policy_version 324951 (0.0008) [2023-12-27 21:33:53,726][106226] Updated weights for policy 0, policy_version 324961 (0.0008) [2023-12-27 21:33:53,774][106226] Updated weights for policy 0, policy_version 324971 (0.0008) [2023-12-27 21:33:54,148][106225] Updated weights for policy 1, policy_version 325553 (0.0009) [2023-12-27 21:33:54,196][106225] Updated weights for policy 1, policy_version 325563 (0.0008) [2023-12-27 21:33:54,249][106225] Updated weights for policy 1, policy_version 325573 (0.0009) [2023-12-27 21:33:54,303][106225] Updated weights for policy 1, policy_version 325583 (0.0009) [2023-12-27 21:33:54,473][106226] Updated weights for policy 0, policy_version 324981 (0.0007) [2023-12-27 21:33:54,536][106226] Updated weights for policy 0, policy_version 324991 (0.0005) [2023-12-27 21:33:54,600][106226] Updated weights for policy 0, policy_version 325001 (0.0006) [2023-12-27 21:33:55,065][106225] Updated weights for policy 1, policy_version 325593 (0.0007) [2023-12-27 21:33:55,118][106225] Updated weights for policy 1, policy_version 325603 (0.0009) [2023-12-27 21:33:55,174][106225] Updated weights for policy 1, policy_version 325613 (0.0009) [2023-12-27 21:33:55,182][106226] Updated weights for policy 0, policy_version 325011 (0.0005) [2023-12-27 21:33:55,247][106226] Updated weights for policy 0, policy_version 325021 (0.0005) [2023-12-27 21:33:55,310][106226] Updated weights for policy 0, policy_version 325031 (0.0006) [2023-12-27 21:33:55,831][106225] Updated weights for policy 1, policy_version 325623 (0.0006) [2023-12-27 21:33:55,898][106225] Updated weights for policy 1, policy_version 325633 (0.0005) [2023-12-27 21:33:55,927][106226] Updated weights for policy 0, policy_version 325041 (0.0006) [2023-12-27 21:33:55,961][106225] Updated weights for policy 1, policy_version 325643 (0.0007) [2023-12-27 21:33:55,979][106226] Updated weights for policy 0, policy_version 325051 (0.0006) [2023-12-27 21:33:56,027][106226] Updated weights for policy 0, policy_version 325061 (0.0008) [2023-12-27 21:33:56,079][106226] Updated weights for policy 0, policy_version 325071 (0.0008) [2023-12-27 21:33:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 166633472. Throughput: 0: 9922.9, 1: 9886.1. Samples: 166595304. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:33:56,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-5.445')] [2023-12-27 21:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000325648_83386368.pth... [2023-12-27 21:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000325072_83247104.pth... [2023-12-27 21:33:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000324464_83083264.pth [2023-12-27 21:33:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000323888_82944000.pth [2023-12-27 21:33:56,540][106225] Updated weights for policy 1, policy_version 325653 (0.0008) [2023-12-27 21:33:56,599][106225] Updated weights for policy 1, policy_version 325663 (0.0009) [2023-12-27 21:33:56,657][106225] Updated weights for policy 1, policy_version 325673 (0.0008) [2023-12-27 21:33:56,861][106226] Updated weights for policy 0, policy_version 325081 (0.0009) [2023-12-27 21:33:56,909][106226] Updated weights for policy 0, policy_version 325091 (0.0009) [2023-12-27 21:33:56,958][106226] Updated weights for policy 0, policy_version 325101 (0.0008) [2023-12-27 21:33:57,377][106225] Updated weights for policy 1, policy_version 325683 (0.0010) [2023-12-27 21:33:57,424][106225] Updated weights for policy 1, policy_version 325693 (0.0008) [2023-12-27 21:33:57,475][106225] Updated weights for policy 1, policy_version 325703 (0.0008) [2023-12-27 21:33:57,705][106226] Updated weights for policy 0, policy_version 325111 (0.0008) [2023-12-27 21:33:57,757][106226] Updated weights for policy 0, policy_version 325121 (0.0008) [2023-12-27 21:33:57,812][106226] Updated weights for policy 0, policy_version 325131 (0.0009) [2023-12-27 21:33:58,208][106225] Updated weights for policy 1, policy_version 325713 (0.0008) [2023-12-27 21:33:58,277][106225] Updated weights for policy 1, policy_version 325723 (0.0008) [2023-12-27 21:33:58,358][106225] Updated weights for policy 1, policy_version 325733 (0.0007) [2023-12-27 21:33:58,429][106225] Updated weights for policy 1, policy_version 325743 (0.0009) [2023-12-27 21:33:58,631][106226] Updated weights for policy 0, policy_version 325141 (0.0010) [2023-12-27 21:33:58,688][106226] Updated weights for policy 0, policy_version 325151 (0.0007) [2023-12-27 21:33:58,757][106226] Updated weights for policy 0, policy_version 325161 (0.0008) [2023-12-27 21:33:59,252][106225] Updated weights for policy 1, policy_version 325753 (0.0009) [2023-12-27 21:33:59,323][106225] Updated weights for policy 1, policy_version 325763 (0.0008) [2023-12-27 21:33:59,387][106225] Updated weights for policy 1, policy_version 325773 (0.0009) [2023-12-27 21:33:59,547][106226] Updated weights for policy 0, policy_version 325171 (0.0008) [2023-12-27 21:33:59,601][106226] Updated weights for policy 0, policy_version 325181 (0.0006) [2023-12-27 21:33:59,659][106226] Updated weights for policy 0, policy_version 325191 (0.0005) [2023-12-27 21:34:00,189][106225] Updated weights for policy 1, policy_version 325783 (0.0008) [2023-12-27 21:34:00,248][106225] Updated weights for policy 1, policy_version 325793 (0.0008) [2023-12-27 21:34:00,307][106226] Updated weights for policy 0, policy_version 325201 (0.0006) [2023-12-27 21:34:00,313][106225] Updated weights for policy 1, policy_version 325803 (0.0008) [2023-12-27 21:34:00,378][106226] Updated weights for policy 0, policy_version 325211 (0.0010) [2023-12-27 21:34:00,443][106226] Updated weights for policy 0, policy_version 325221 (0.0007) [2023-12-27 21:34:00,510][106226] Updated weights for policy 0, policy_version 325231 (0.0005) [2023-12-27 21:34:00,912][106225] Updated weights for policy 1, policy_version 325813 (0.0008) [2023-12-27 21:34:00,973][106225] Updated weights for policy 1, policy_version 325823 (0.0007) [2023-12-27 21:34:01,055][106225] Updated weights for policy 1, policy_version 325833 (0.0006) [2023-12-27 21:34:01,104][106226] Updated weights for policy 0, policy_version 325241 (0.0007) [2023-12-27 21:34:01,164][106226] Updated weights for policy 0, policy_version 325251 (0.0008) [2023-12-27 21:34:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 166723584. Throughput: 0: 9901.9, 1: 9860.7. Samples: 166712996. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:34:01,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-5.704')] [2023-12-27 21:34:01,236][106226] Updated weights for policy 0, policy_version 325261 (0.0007) [2023-12-27 21:34:01,733][106225] Updated weights for policy 1, policy_version 325843 (0.0010) [2023-12-27 21:34:01,793][106225] Updated weights for policy 1, policy_version 325853 (0.0010) [2023-12-27 21:34:01,856][106225] Updated weights for policy 1, policy_version 325863 (0.0010) [2023-12-27 21:34:01,913][106226] Updated weights for policy 0, policy_version 325271 (0.0008) [2023-12-27 21:34:01,973][106226] Updated weights for policy 0, policy_version 325281 (0.0007) [2023-12-27 21:34:02,035][106226] Updated weights for policy 0, policy_version 325291 (0.0007) [2023-12-27 21:34:02,589][106225] Updated weights for policy 1, policy_version 325873 (0.0009) [2023-12-27 21:34:02,649][106225] Updated weights for policy 1, policy_version 325883 (0.0010) [2023-12-27 21:34:02,706][106225] Updated weights for policy 1, policy_version 325893 (0.0010) [2023-12-27 21:34:02,731][106226] Updated weights for policy 0, policy_version 325301 (0.0006) [2023-12-27 21:34:02,762][106225] Updated weights for policy 1, policy_version 325903 (0.0010) [2023-12-27 21:34:02,779][106226] Updated weights for policy 0, policy_version 325311 (0.0008) [2023-12-27 21:34:02,823][106226] Updated weights for policy 0, policy_version 325321 (0.0008) [2023-12-27 21:34:03,469][106225] Updated weights for policy 1, policy_version 325913 (0.0010) [2023-12-27 21:34:03,521][106225] Updated weights for policy 1, policy_version 325923 (0.0010) [2023-12-27 21:34:03,577][106226] Updated weights for policy 0, policy_version 325331 (0.0007) [2023-12-27 21:34:03,578][106225] Updated weights for policy 1, policy_version 325933 (0.0007) [2023-12-27 21:34:03,638][106226] Updated weights for policy 0, policy_version 325341 (0.0005) [2023-12-27 21:34:03,696][106226] Updated weights for policy 0, policy_version 325351 (0.0009) [2023-12-27 21:34:04,265][106225] Updated weights for policy 1, policy_version 325943 (0.0009) [2023-12-27 21:34:04,327][106225] Updated weights for policy 1, policy_version 325953 (0.0010) [2023-12-27 21:34:04,388][106225] Updated weights for policy 1, policy_version 325963 (0.0010) [2023-12-27 21:34:04,419][106226] Updated weights for policy 0, policy_version 325361 (0.0010) [2023-12-27 21:34:04,473][106226] Updated weights for policy 0, policy_version 325371 (0.0011) [2023-12-27 21:34:04,538][106226] Updated weights for policy 0, policy_version 325381 (0.0010) [2023-12-27 21:34:04,598][106226] Updated weights for policy 0, policy_version 325391 (0.0008) [2023-12-27 21:34:05,069][106225] Updated weights for policy 1, policy_version 325973 (0.0010) [2023-12-27 21:34:05,119][106225] Updated weights for policy 1, policy_version 325983 (0.0010) [2023-12-27 21:34:05,169][106225] Updated weights for policy 1, policy_version 325993 (0.0010) [2023-12-27 21:34:05,309][106226] Updated weights for policy 0, policy_version 325401 (0.0007) [2023-12-27 21:34:05,375][106226] Updated weights for policy 0, policy_version 325411 (0.0005) [2023-12-27 21:34:05,437][106226] Updated weights for policy 0, policy_version 325421 (0.0006) [2023-12-27 21:34:05,847][106225] Updated weights for policy 1, policy_version 326003 (0.0009) [2023-12-27 21:34:05,905][106225] Updated weights for policy 1, policy_version 326013 (0.0006) [2023-12-27 21:34:05,964][106225] Updated weights for policy 1, policy_version 326023 (0.0006) [2023-12-27 21:34:06,127][106226] Updated weights for policy 0, policy_version 325431 (0.0008) [2023-12-27 21:34:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 166821888. Throughput: 0: 9865.4, 1: 9896.8. Samples: 166832096. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:34:06,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-5.724')] [2023-12-27 21:34:06,188][106226] Updated weights for policy 0, policy_version 325441 (0.0008) [2023-12-27 21:34:06,255][106226] Updated weights for policy 0, policy_version 325451 (0.0008) [2023-12-27 21:34:06,652][106225] Updated weights for policy 1, policy_version 326033 (0.0007) [2023-12-27 21:34:06,712][106225] Updated weights for policy 1, policy_version 326043 (0.0006) [2023-12-27 21:34:06,773][106225] Updated weights for policy 1, policy_version 326053 (0.0005) [2023-12-27 21:34:06,837][106225] Updated weights for policy 1, policy_version 326063 (0.0005) [2023-12-27 21:34:07,008][106226] Updated weights for policy 0, policy_version 325461 (0.0007) [2023-12-27 21:34:07,061][106226] Updated weights for policy 0, policy_version 325471 (0.0008) [2023-12-27 21:34:07,124][106226] Updated weights for policy 0, policy_version 325481 (0.0008) [2023-12-27 21:34:07,433][106225] Updated weights for policy 1, policy_version 326073 (0.0010) [2023-12-27 21:34:07,494][106225] Updated weights for policy 1, policy_version 326083 (0.0010) [2023-12-27 21:34:07,551][106225] Updated weights for policy 1, policy_version 326093 (0.0010) [2023-12-27 21:34:07,868][106226] Updated weights for policy 0, policy_version 325491 (0.0007) [2023-12-27 21:34:07,925][106226] Updated weights for policy 0, policy_version 325501 (0.0005) [2023-12-27 21:34:07,984][106226] Updated weights for policy 0, policy_version 325511 (0.0007) [2023-12-27 21:34:08,279][106225] Updated weights for policy 1, policy_version 326103 (0.0009) [2023-12-27 21:34:08,342][106225] Updated weights for policy 1, policy_version 326113 (0.0009) [2023-12-27 21:34:08,406][106225] Updated weights for policy 1, policy_version 326123 (0.0011) [2023-12-27 21:34:08,637][106226] Updated weights for policy 0, policy_version 325521 (0.0008) [2023-12-27 21:34:08,697][106226] Updated weights for policy 0, policy_version 325531 (0.0008) [2023-12-27 21:34:08,762][106226] Updated weights for policy 0, policy_version 325541 (0.0008) [2023-12-27 21:34:08,820][106226] Updated weights for policy 0, policy_version 325551 (0.0008) [2023-12-27 21:34:09,106][106225] Updated weights for policy 1, policy_version 326133 (0.0008) [2023-12-27 21:34:09,172][106225] Updated weights for policy 1, policy_version 326143 (0.0005) [2023-12-27 21:34:09,242][106225] Updated weights for policy 1, policy_version 326153 (0.0007) [2023-12-27 21:34:09,581][106226] Updated weights for policy 0, policy_version 325561 (0.0009) [2023-12-27 21:34:09,631][106226] Updated weights for policy 0, policy_version 325571 (0.0009) [2023-12-27 21:34:09,691][106226] Updated weights for policy 0, policy_version 325581 (0.0009) [2023-12-27 21:34:09,894][106225] Updated weights for policy 1, policy_version 326163 (0.0008) [2023-12-27 21:34:09,955][106225] Updated weights for policy 1, policy_version 326173 (0.0009) [2023-12-27 21:34:10,014][106225] Updated weights for policy 1, policy_version 326183 (0.0010) [2023-12-27 21:34:10,485][106226] Updated weights for policy 0, policy_version 325591 (0.0008) [2023-12-27 21:34:10,541][106226] Updated weights for policy 0, policy_version 325601 (0.0006) [2023-12-27 21:34:10,599][106226] Updated weights for policy 0, policy_version 325611 (0.0008) [2023-12-27 21:34:10,706][106225] Updated weights for policy 1, policy_version 326193 (0.0010) [2023-12-27 21:34:10,768][106225] Updated weights for policy 1, policy_version 326203 (0.0006) [2023-12-27 21:34:10,826][106225] Updated weights for policy 1, policy_version 326213 (0.0009) [2023-12-27 21:34:10,894][106225] Updated weights for policy 1, policy_version 326223 (0.0005) [2023-12-27 21:34:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 166920192. Throughput: 0: 9887.6, 1: 9958.9. Samples: 166890928. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:34:11,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.449')] [2023-12-27 21:34:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000325616_83386368.pth... [2023-12-27 21:34:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000326224_83533824.pth... [2023-12-27 21:34:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000324464_83091456.pth [2023-12-27 21:34:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000325072_83238912.pth [2023-12-27 21:34:11,232][106226] Updated weights for policy 0, policy_version 325621 (0.0008) [2023-12-27 21:34:11,297][106226] Updated weights for policy 0, policy_version 325631 (0.0008) [2023-12-27 21:34:11,365][106226] Updated weights for policy 0, policy_version 325641 (0.0008) [2023-12-27 21:34:11,580][106225] Updated weights for policy 1, policy_version 326233 (0.0007) [2023-12-27 21:34:11,651][106225] Updated weights for policy 1, policy_version 326243 (0.0007) [2023-12-27 21:34:11,723][106225] Updated weights for policy 1, policy_version 326253 (0.0008) [2023-12-27 21:34:12,109][106226] Updated weights for policy 0, policy_version 325651 (0.0009) [2023-12-27 21:34:12,168][106226] Updated weights for policy 0, policy_version 325661 (0.0009) [2023-12-27 21:34:12,228][106226] Updated weights for policy 0, policy_version 325671 (0.0009) [2023-12-27 21:34:12,444][106225] Updated weights for policy 1, policy_version 326263 (0.0007) [2023-12-27 21:34:12,496][106225] Updated weights for policy 1, policy_version 326273 (0.0006) [2023-12-27 21:34:12,545][106225] Updated weights for policy 1, policy_version 326283 (0.0008) [2023-12-27 21:34:12,963][106226] Updated weights for policy 0, policy_version 325681 (0.0009) [2023-12-27 21:34:13,025][106226] Updated weights for policy 0, policy_version 325691 (0.0007) [2023-12-27 21:34:13,089][106226] Updated weights for policy 0, policy_version 325701 (0.0009) [2023-12-27 21:34:13,142][106226] Updated weights for policy 0, policy_version 325711 (0.0009) [2023-12-27 21:34:13,259][106225] Updated weights for policy 1, policy_version 326293 (0.0009) [2023-12-27 21:34:13,323][106225] Updated weights for policy 1, policy_version 326303 (0.0008) [2023-12-27 21:34:13,385][106225] Updated weights for policy 1, policy_version 326313 (0.0009) [2023-12-27 21:34:13,877][106226] Updated weights for policy 0, policy_version 325721 (0.0008) [2023-12-27 21:34:13,933][106226] Updated weights for policy 0, policy_version 325731 (0.0009) [2023-12-27 21:34:13,991][106226] Updated weights for policy 0, policy_version 325741 (0.0008) [2023-12-27 21:34:14,095][106225] Updated weights for policy 1, policy_version 326323 (0.0009) [2023-12-27 21:34:14,157][106225] Updated weights for policy 1, policy_version 326333 (0.0009) [2023-12-27 21:34:14,220][106225] Updated weights for policy 1, policy_version 326343 (0.0009) [2023-12-27 21:34:14,676][106226] Updated weights for policy 0, policy_version 325751 (0.0008) [2023-12-27 21:34:14,737][106226] Updated weights for policy 0, policy_version 325761 (0.0008) [2023-12-27 21:34:14,804][106226] Updated weights for policy 0, policy_version 325771 (0.0009) [2023-12-27 21:34:14,918][106225] Updated weights for policy 1, policy_version 326353 (0.0008) [2023-12-27 21:34:14,985][106225] Updated weights for policy 1, policy_version 326363 (0.0006) [2023-12-27 21:34:15,049][106225] Updated weights for policy 1, policy_version 326373 (0.0009) [2023-12-27 21:34:15,108][106225] Updated weights for policy 1, policy_version 326383 (0.0008) [2023-12-27 21:34:15,506][106226] Updated weights for policy 0, policy_version 325781 (0.0010) [2023-12-27 21:34:15,562][106226] Updated weights for policy 0, policy_version 325791 (0.0008) [2023-12-27 21:34:15,616][106226] Updated weights for policy 0, policy_version 325801 (0.0009) [2023-12-27 21:34:15,799][106225] Updated weights for policy 1, policy_version 326393 (0.0007) [2023-12-27 21:34:15,852][106225] Updated weights for policy 1, policy_version 326403 (0.0010) [2023-12-27 21:34:15,907][106225] Updated weights for policy 1, policy_version 326413 (0.0005) [2023-12-27 21:34:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 167018496. Throughput: 0: 9837.0, 1: 9842.5. Samples: 167007068. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 21:34:16,176][105115] Avg episode reward: [(0, '-4.687'), (1, '-5.820')] [2023-12-27 21:34:16,453][106225] Updated weights for policy 1, policy_version 326423 (0.0005) [2023-12-27 21:34:16,454][106226] Updated weights for policy 0, policy_version 325811 (0.0008) [2023-12-27 21:34:16,499][106226] Updated weights for policy 0, policy_version 325821 (0.0008) [2023-12-27 21:34:16,502][106225] Updated weights for policy 1, policy_version 326433 (0.0005) [2023-12-27 21:34:16,544][106226] Updated weights for policy 0, policy_version 325831 (0.0008) [2023-12-27 21:34:16,554][106225] Updated weights for policy 1, policy_version 326443 (0.0005) [2023-12-27 21:34:17,203][106225] Updated weights for policy 1, policy_version 326453 (0.0008) [2023-12-27 21:34:17,232][106226] Updated weights for policy 0, policy_version 325841 (0.0009) [2023-12-27 21:34:17,263][106225] Updated weights for policy 1, policy_version 326463 (0.0010) [2023-12-27 21:34:17,288][106226] Updated weights for policy 0, policy_version 325851 (0.0010) [2023-12-27 21:34:17,329][106225] Updated weights for policy 1, policy_version 326473 (0.0010) [2023-12-27 21:34:17,349][106226] Updated weights for policy 0, policy_version 325861 (0.0011) [2023-12-27 21:34:17,403][106226] Updated weights for policy 0, policy_version 325871 (0.0010) [2023-12-27 21:34:17,889][106225] Updated weights for policy 1, policy_version 326483 (0.0005) [2023-12-27 21:34:17,947][106225] Updated weights for policy 1, policy_version 326493 (0.0005) [2023-12-27 21:34:18,002][106225] Updated weights for policy 1, policy_version 326503 (0.0006) [2023-12-27 21:34:18,054][106226] Updated weights for policy 0, policy_version 325881 (0.0006) [2023-12-27 21:34:18,111][106226] Updated weights for policy 0, policy_version 325891 (0.0005) [2023-12-27 21:34:18,161][106226] Updated weights for policy 0, policy_version 325901 (0.0005) [2023-12-27 21:34:18,679][106225] Updated weights for policy 1, policy_version 326513 (0.0010) [2023-12-27 21:34:18,731][106225] Updated weights for policy 1, policy_version 326523 (0.0009) [2023-12-27 21:34:18,784][106226] Updated weights for policy 0, policy_version 325911 (0.0006) [2023-12-27 21:34:18,794][106225] Updated weights for policy 1, policy_version 326533 (0.0007) [2023-12-27 21:34:18,839][106226] Updated weights for policy 0, policy_version 325921 (0.0007) [2023-12-27 21:34:18,852][106225] Updated weights for policy 1, policy_version 326543 (0.0007) [2023-12-27 21:34:18,900][106226] Updated weights for policy 0, policy_version 325931 (0.0008) [2023-12-27 21:34:19,589][106225] Updated weights for policy 1, policy_version 326553 (0.0008) [2023-12-27 21:34:19,643][106225] Updated weights for policy 1, policy_version 326563 (0.0008) [2023-12-27 21:34:19,673][106226] Updated weights for policy 0, policy_version 325941 (0.0008) [2023-12-27 21:34:19,690][106225] Updated weights for policy 1, policy_version 326573 (0.0009) [2023-12-27 21:34:19,732][106226] Updated weights for policy 0, policy_version 325951 (0.0007) [2023-12-27 21:34:19,789][106226] Updated weights for policy 0, policy_version 325961 (0.0008) [2023-12-27 21:34:20,468][106225] Updated weights for policy 1, policy_version 326583 (0.0007) [2023-12-27 21:34:20,511][106226] Updated weights for policy 0, policy_version 325971 (0.0008) [2023-12-27 21:34:20,525][106225] Updated weights for policy 1, policy_version 326593 (0.0007) [2023-12-27 21:34:20,574][106226] Updated weights for policy 0, policy_version 325981 (0.0008) [2023-12-27 21:34:20,589][106225] Updated weights for policy 1, policy_version 326603 (0.0007) [2023-12-27 21:34:20,636][106226] Updated weights for policy 0, policy_version 325991 (0.0007) [2023-12-27 21:34:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 167116800. Throughput: 0: 9858.7, 1: 9863.3. Samples: 167127504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:21,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.588')] [2023-12-27 21:34:21,360][106226] Updated weights for policy 0, policy_version 326001 (0.0008) [2023-12-27 21:34:21,430][106225] Updated weights for policy 1, policy_version 326613 (0.0007) [2023-12-27 21:34:21,436][106226] Updated weights for policy 0, policy_version 326011 (0.0008) [2023-12-27 21:34:21,497][106226] Updated weights for policy 0, policy_version 326021 (0.0006) [2023-12-27 21:34:21,498][106225] Updated weights for policy 1, policy_version 326623 (0.0009) [2023-12-27 21:34:21,557][106226] Updated weights for policy 0, policy_version 326031 (0.0008) [2023-12-27 21:34:21,560][106225] Updated weights for policy 1, policy_version 326633 (0.0005) [2023-12-27 21:34:22,298][106226] Updated weights for policy 0, policy_version 326041 (0.0008) [2023-12-27 21:34:22,340][106225] Updated weights for policy 1, policy_version 326643 (0.0009) [2023-12-27 21:34:22,364][106226] Updated weights for policy 0, policy_version 326051 (0.0009) [2023-12-27 21:34:22,408][106225] Updated weights for policy 1, policy_version 326653 (0.0007) [2023-12-27 21:34:22,429][106226] Updated weights for policy 0, policy_version 326061 (0.0006) [2023-12-27 21:34:22,467][106225] Updated weights for policy 1, policy_version 326663 (0.0006) [2023-12-27 21:34:23,054][106226] Updated weights for policy 0, policy_version 326071 (0.0006) [2023-12-27 21:34:23,121][106226] Updated weights for policy 0, policy_version 326081 (0.0005) [2023-12-27 21:34:23,188][106226] Updated weights for policy 0, policy_version 326091 (0.0005) [2023-12-27 21:34:23,244][106225] Updated weights for policy 1, policy_version 326673 (0.0006) [2023-12-27 21:34:23,304][106225] Updated weights for policy 1, policy_version 326683 (0.0007) [2023-12-27 21:34:23,359][106225] Updated weights for policy 1, policy_version 326693 (0.0007) [2023-12-27 21:34:23,413][106225] Updated weights for policy 1, policy_version 326703 (0.0010) [2023-12-27 21:34:23,779][106226] Updated weights for policy 0, policy_version 326101 (0.0005) [2023-12-27 21:34:23,826][106226] Updated weights for policy 0, policy_version 326111 (0.0005) [2023-12-27 21:34:23,887][106226] Updated weights for policy 0, policy_version 326121 (0.0005) [2023-12-27 21:34:24,009][106225] Updated weights for policy 1, policy_version 326713 (0.0006) [2023-12-27 21:34:24,055][106225] Updated weights for policy 1, policy_version 326723 (0.0005) [2023-12-27 21:34:24,104][106225] Updated weights for policy 1, policy_version 326733 (0.0006) [2023-12-27 21:34:24,510][106226] Updated weights for policy 0, policy_version 326131 (0.0008) [2023-12-27 21:34:24,569][106226] Updated weights for policy 0, policy_version 326141 (0.0005) [2023-12-27 21:34:24,633][106226] Updated weights for policy 0, policy_version 326151 (0.0006) [2023-12-27 21:34:24,812][106225] Updated weights for policy 1, policy_version 326743 (0.0010) [2023-12-27 21:34:24,874][106225] Updated weights for policy 1, policy_version 326753 (0.0010) [2023-12-27 21:34:24,928][106225] Updated weights for policy 1, policy_version 326763 (0.0010) [2023-12-27 21:34:25,148][106226] Updated weights for policy 0, policy_version 326161 (0.0005) [2023-12-27 21:34:25,211][106226] Updated weights for policy 0, policy_version 326171 (0.0005) [2023-12-27 21:34:25,281][106226] Updated weights for policy 0, policy_version 326181 (0.0005) [2023-12-27 21:34:25,334][106226] Updated weights for policy 0, policy_version 326191 (0.0005) [2023-12-27 21:34:25,571][106225] Updated weights for policy 1, policy_version 326773 (0.0010) [2023-12-27 21:34:25,617][106225] Updated weights for policy 1, policy_version 326783 (0.0010) [2023-12-27 21:34:25,674][106225] Updated weights for policy 1, policy_version 326793 (0.0010) [2023-12-27 21:34:25,849][106226] Updated weights for policy 0, policy_version 326201 (0.0008) [2023-12-27 21:34:25,898][106226] Updated weights for policy 0, policy_version 326211 (0.0007) [2023-12-27 21:34:25,961][106226] Updated weights for policy 0, policy_version 326221 (0.0007) [2023-12-27 21:34:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 167223296. Throughput: 0: 9872.8, 1: 9822.8. Samples: 167186000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:26,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-5.622')] [2023-12-27 21:34:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000326800_83681280.pth... [2023-12-27 21:34:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000326224_83542016.pth... [2023-12-27 21:34:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000325072_83247104.pth [2023-12-27 21:34:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000325648_83386368.pth [2023-12-27 21:34:26,380][106225] Updated weights for policy 1, policy_version 326803 (0.0009) [2023-12-27 21:34:26,427][106225] Updated weights for policy 1, policy_version 326813 (0.0010) [2023-12-27 21:34:26,485][106225] Updated weights for policy 1, policy_version 326823 (0.0011) [2023-12-27 21:34:26,667][106226] Updated weights for policy 0, policy_version 326231 (0.0008) [2023-12-27 21:34:26,732][106226] Updated weights for policy 0, policy_version 326241 (0.0008) [2023-12-27 21:34:26,796][106226] Updated weights for policy 0, policy_version 326251 (0.0008) [2023-12-27 21:34:27,127][106225] Updated weights for policy 1, policy_version 326833 (0.0010) [2023-12-27 21:34:27,193][106225] Updated weights for policy 1, policy_version 326843 (0.0008) [2023-12-27 21:34:27,256][106225] Updated weights for policy 1, policy_version 326853 (0.0008) [2023-12-27 21:34:27,317][106225] Updated weights for policy 1, policy_version 326863 (0.0008) [2023-12-27 21:34:27,466][106226] Updated weights for policy 0, policy_version 326261 (0.0008) [2023-12-27 21:34:27,519][106226] Updated weights for policy 0, policy_version 326271 (0.0010) [2023-12-27 21:34:27,565][106226] Updated weights for policy 0, policy_version 326281 (0.0010) [2023-12-27 21:34:27,890][106225] Updated weights for policy 1, policy_version 326873 (0.0006) [2023-12-27 21:34:27,948][106225] Updated weights for policy 1, policy_version 326883 (0.0006) [2023-12-27 21:34:28,014][106225] Updated weights for policy 1, policy_version 326893 (0.0007) [2023-12-27 21:34:28,281][106226] Updated weights for policy 0, policy_version 326291 (0.0010) [2023-12-27 21:34:28,343][106226] Updated weights for policy 0, policy_version 326301 (0.0010) [2023-12-27 21:34:28,411][106226] Updated weights for policy 0, policy_version 326311 (0.0009) [2023-12-27 21:34:28,720][106225] Updated weights for policy 1, policy_version 326904 (0.0009) [2023-12-27 21:34:28,777][106225] Updated weights for policy 1, policy_version 326914 (0.0006) [2023-12-27 21:34:28,836][106225] Updated weights for policy 1, policy_version 326924 (0.0006) [2023-12-27 21:34:29,078][106226] Updated weights for policy 0, policy_version 326321 (0.0007) [2023-12-27 21:34:29,133][106226] Updated weights for policy 0, policy_version 326331 (0.0010) [2023-12-27 21:34:29,182][106226] Updated weights for policy 0, policy_version 326341 (0.0010) [2023-12-27 21:34:29,235][106226] Updated weights for policy 0, policy_version 326351 (0.0010) [2023-12-27 21:34:29,521][106225] Updated weights for policy 1, policy_version 326934 (0.0010) [2023-12-27 21:34:29,579][106225] Updated weights for policy 1, policy_version 326944 (0.0007) [2023-12-27 21:34:29,647][106225] Updated weights for policy 1, policy_version 326954 (0.0008) [2023-12-27 21:34:29,925][106226] Updated weights for policy 0, policy_version 326361 (0.0008) [2023-12-27 21:34:29,979][106226] Updated weights for policy 0, policy_version 326371 (0.0006) [2023-12-27 21:34:30,052][106226] Updated weights for policy 0, policy_version 326381 (0.0005) [2023-12-27 21:34:30,330][106225] Updated weights for policy 1, policy_version 326964 (0.0007) [2023-12-27 21:34:30,389][106225] Updated weights for policy 1, policy_version 326974 (0.0009) [2023-12-27 21:34:30,444][106225] Updated weights for policy 1, policy_version 326984 (0.0010) [2023-12-27 21:34:30,720][106226] Updated weights for policy 0, policy_version 326391 (0.0007) [2023-12-27 21:34:30,783][106226] Updated weights for policy 0, policy_version 326401 (0.0008) [2023-12-27 21:34:30,830][106226] Updated weights for policy 0, policy_version 326411 (0.0008) [2023-12-27 21:34:31,146][106225] Updated weights for policy 1, policy_version 326994 (0.0011) [2023-12-27 21:34:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 167321600. Throughput: 0: 10036.7, 1: 9948.2. Samples: 167312596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:31,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-5.846')] [2023-12-27 21:34:31,211][106225] Updated weights for policy 1, policy_version 327004 (0.0010) [2023-12-27 21:34:31,281][106225] Updated weights for policy 1, policy_version 327014 (0.0011) [2023-12-27 21:34:31,329][106225] Updated weights for policy 1, policy_version 327024 (0.0010) [2023-12-27 21:34:31,638][106226] Updated weights for policy 0, policy_version 326421 (0.0008) [2023-12-27 21:34:31,700][106226] Updated weights for policy 0, policy_version 326431 (0.0008) [2023-12-27 21:34:31,769][106226] Updated weights for policy 0, policy_version 326441 (0.0009) [2023-12-27 21:34:32,048][106225] Updated weights for policy 1, policy_version 327034 (0.0007) [2023-12-27 21:34:32,116][106225] Updated weights for policy 1, policy_version 327044 (0.0008) [2023-12-27 21:34:32,172][106225] Updated weights for policy 1, policy_version 327054 (0.0008) [2023-12-27 21:34:32,448][106226] Updated weights for policy 0, policy_version 326451 (0.0008) [2023-12-27 21:34:32,501][106226] Updated weights for policy 0, policy_version 326461 (0.0007) [2023-12-27 21:34:32,559][106226] Updated weights for policy 0, policy_version 326471 (0.0008) [2023-12-27 21:34:32,906][106225] Updated weights for policy 1, policy_version 327064 (0.0010) [2023-12-27 21:34:32,958][106225] Updated weights for policy 1, policy_version 327074 (0.0010) [2023-12-27 21:34:33,007][106225] Updated weights for policy 1, policy_version 327084 (0.0008) [2023-12-27 21:34:33,153][106226] Updated weights for policy 0, policy_version 326481 (0.0007) [2023-12-27 21:34:33,200][106226] Updated weights for policy 0, policy_version 326491 (0.0005) [2023-12-27 21:34:33,248][106226] Updated weights for policy 0, policy_version 326501 (0.0005) [2023-12-27 21:34:33,298][106226] Updated weights for policy 0, policy_version 326511 (0.0005) [2023-12-27 21:34:33,810][106225] Updated weights for policy 1, policy_version 327094 (0.0007) [2023-12-27 21:34:33,840][106226] Updated weights for policy 0, policy_version 326521 (0.0008) [2023-12-27 21:34:33,869][106225] Updated weights for policy 1, policy_version 327104 (0.0006) [2023-12-27 21:34:33,898][106226] Updated weights for policy 0, policy_version 326531 (0.0008) [2023-12-27 21:34:33,919][106225] Updated weights for policy 1, policy_version 327114 (0.0005) [2023-12-27 21:34:33,954][106226] Updated weights for policy 0, policy_version 326541 (0.0006) [2023-12-27 21:34:34,597][106225] Updated weights for policy 1, policy_version 327124 (0.0008) [2023-12-27 21:34:34,657][106225] Updated weights for policy 1, policy_version 327134 (0.0009) [2023-12-27 21:34:34,703][106226] Updated weights for policy 0, policy_version 326551 (0.0008) [2023-12-27 21:34:34,714][106225] Updated weights for policy 1, policy_version 327144 (0.0007) [2023-12-27 21:34:34,761][106226] Updated weights for policy 0, policy_version 326561 (0.0008) [2023-12-27 21:34:34,812][106226] Updated weights for policy 0, policy_version 326571 (0.0008) [2023-12-27 21:34:35,378][106225] Updated weights for policy 1, policy_version 327154 (0.0006) [2023-12-27 21:34:35,428][106225] Updated weights for policy 1, policy_version 327164 (0.0008) [2023-12-27 21:34:35,458][106226] Updated weights for policy 0, policy_version 326581 (0.0008) [2023-12-27 21:34:35,477][106225] Updated weights for policy 1, policy_version 327174 (0.0007) [2023-12-27 21:34:35,517][106226] Updated weights for policy 0, policy_version 326591 (0.0006) [2023-12-27 21:34:35,527][106225] Updated weights for policy 1, policy_version 327184 (0.0007) [2023-12-27 21:34:35,581][106226] Updated weights for policy 0, policy_version 326601 (0.0006) [2023-12-27 21:34:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 167419904. Throughput: 0: 10051.3, 1: 9864.6. Samples: 167433232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:36,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-5.535')] [2023-12-27 21:34:36,230][106226] Updated weights for policy 0, policy_version 326611 (0.0008) [2023-12-27 21:34:36,293][106226] Updated weights for policy 0, policy_version 326621 (0.0006) [2023-12-27 21:34:36,342][106225] Updated weights for policy 1, policy_version 327194 (0.0008) [2023-12-27 21:34:36,356][106226] Updated weights for policy 0, policy_version 326631 (0.0007) [2023-12-27 21:34:36,403][106225] Updated weights for policy 1, policy_version 327204 (0.0008) [2023-12-27 21:34:36,463][106225] Updated weights for policy 1, policy_version 327214 (0.0008) [2023-12-27 21:34:37,054][106226] Updated weights for policy 0, policy_version 326641 (0.0009) [2023-12-27 21:34:37,122][106226] Updated weights for policy 0, policy_version 326651 (0.0008) [2023-12-27 21:34:37,188][106226] Updated weights for policy 0, policy_version 326661 (0.0008) [2023-12-27 21:34:37,209][106225] Updated weights for policy 1, policy_version 327224 (0.0007) [2023-12-27 21:34:37,248][106226] Updated weights for policy 0, policy_version 326671 (0.0006) [2023-12-27 21:34:37,263][106225] Updated weights for policy 1, policy_version 327234 (0.0008) [2023-12-27 21:34:37,333][106225] Updated weights for policy 1, policy_version 327244 (0.0009) [2023-12-27 21:34:37,823][106226] Updated weights for policy 0, policy_version 326681 (0.0008) [2023-12-27 21:34:37,868][106226] Updated weights for policy 0, policy_version 326691 (0.0008) [2023-12-27 21:34:37,921][106226] Updated weights for policy 0, policy_version 326701 (0.0009) [2023-12-27 21:34:38,142][106225] Updated weights for policy 1, policy_version 327254 (0.0008) [2023-12-27 21:34:38,203][106225] Updated weights for policy 1, policy_version 327264 (0.0009) [2023-12-27 21:34:38,258][106225] Updated weights for policy 1, policy_version 327274 (0.0008) [2023-12-27 21:34:38,702][106226] Updated weights for policy 0, policy_version 326711 (0.0010) [2023-12-27 21:34:38,763][106226] Updated weights for policy 0, policy_version 326721 (0.0010) [2023-12-27 21:34:38,824][106226] Updated weights for policy 0, policy_version 326731 (0.0011) [2023-12-27 21:34:38,986][106225] Updated weights for policy 1, policy_version 327284 (0.0009) [2023-12-27 21:34:39,033][106225] Updated weights for policy 1, policy_version 327294 (0.0010) [2023-12-27 21:34:39,085][106225] Updated weights for policy 1, policy_version 327304 (0.0010) [2023-12-27 21:34:39,583][106226] Updated weights for policy 0, policy_version 326741 (0.0009) [2023-12-27 21:34:39,644][106226] Updated weights for policy 0, policy_version 326751 (0.0011) [2023-12-27 21:34:39,699][106226] Updated weights for policy 0, policy_version 326761 (0.0011) [2023-12-27 21:34:39,837][106225] Updated weights for policy 1, policy_version 327314 (0.0009) [2023-12-27 21:34:39,900][106225] Updated weights for policy 1, policy_version 327324 (0.0009) [2023-12-27 21:34:39,963][106225] Updated weights for policy 1, policy_version 327334 (0.0008) [2023-12-27 21:34:40,025][106225] Updated weights for policy 1, policy_version 327344 (0.0008) [2023-12-27 21:34:40,373][106226] Updated weights for policy 0, policy_version 326771 (0.0010) [2023-12-27 21:34:40,431][106226] Updated weights for policy 0, policy_version 326781 (0.0009) [2023-12-27 21:34:40,489][106226] Updated weights for policy 0, policy_version 326791 (0.0010) [2023-12-27 21:34:40,716][106225] Updated weights for policy 1, policy_version 327354 (0.0008) [2023-12-27 21:34:40,768][106225] Updated weights for policy 1, policy_version 327364 (0.0005) [2023-12-27 21:34:40,821][106225] Updated weights for policy 1, policy_version 327374 (0.0005) [2023-12-27 21:34:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 167518208. Throughput: 0: 10017.8, 1: 9874.4. Samples: 167490456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:41,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.706')] [2023-12-27 21:34:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000326800_83689472.pth... [2023-12-27 21:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000327376_83828736.pth... [2023-12-27 21:34:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000326224_83533824.pth [2023-12-27 21:34:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000325616_83386368.pth [2023-12-27 21:34:41,237][106226] Updated weights for policy 0, policy_version 326801 (0.0008) [2023-12-27 21:34:41,307][106226] Updated weights for policy 0, policy_version 326811 (0.0007) [2023-12-27 21:34:41,378][106226] Updated weights for policy 0, policy_version 326821 (0.0010) [2023-12-27 21:34:41,445][106226] Updated weights for policy 0, policy_version 326831 (0.0010) [2023-12-27 21:34:41,481][106225] Updated weights for policy 1, policy_version 327384 (0.0008) [2023-12-27 21:34:41,541][106225] Updated weights for policy 1, policy_version 327394 (0.0008) [2023-12-27 21:34:41,608][106225] Updated weights for policy 1, policy_version 327404 (0.0008) [2023-12-27 21:34:42,170][106226] Updated weights for policy 0, policy_version 326841 (0.0009) [2023-12-27 21:34:42,235][106226] Updated weights for policy 0, policy_version 326851 (0.0007) [2023-12-27 21:34:42,300][106226] Updated weights for policy 0, policy_version 326861 (0.0009) [2023-12-27 21:34:42,369][106225] Updated weights for policy 1, policy_version 327414 (0.0008) [2023-12-27 21:34:42,431][106225] Updated weights for policy 1, policy_version 327424 (0.0007) [2023-12-27 21:34:42,496][106225] Updated weights for policy 1, policy_version 327434 (0.0007) [2023-12-27 21:34:43,079][106226] Updated weights for policy 0, policy_version 326871 (0.0010) [2023-12-27 21:34:43,145][106226] Updated weights for policy 0, policy_version 326881 (0.0008) [2023-12-27 21:34:43,207][106226] Updated weights for policy 0, policy_version 326891 (0.0005) [2023-12-27 21:34:43,223][106225] Updated weights for policy 1, policy_version 327444 (0.0009) [2023-12-27 21:34:43,278][106225] Updated weights for policy 1, policy_version 327454 (0.0010) [2023-12-27 21:34:43,334][106225] Updated weights for policy 1, policy_version 327464 (0.0010) [2023-12-27 21:34:43,720][106226] Updated weights for policy 0, policy_version 326901 (0.0005) [2023-12-27 21:34:43,776][106226] Updated weights for policy 0, policy_version 326911 (0.0005) [2023-12-27 21:34:43,830][106226] Updated weights for policy 0, policy_version 326921 (0.0005) [2023-12-27 21:34:44,018][106225] Updated weights for policy 1, policy_version 327474 (0.0009) [2023-12-27 21:34:44,071][106225] Updated weights for policy 1, policy_version 327484 (0.0010) [2023-12-27 21:34:44,117][106225] Updated weights for policy 1, policy_version 327494 (0.0010) [2023-12-27 21:34:44,163][106225] Updated weights for policy 1, policy_version 327504 (0.0010) [2023-12-27 21:34:44,446][106226] Updated weights for policy 0, policy_version 326931 (0.0007) [2023-12-27 21:34:44,493][106226] Updated weights for policy 0, policy_version 326941 (0.0008) [2023-12-27 21:34:44,551][106226] Updated weights for policy 0, policy_version 326951 (0.0008) [2023-12-27 21:34:44,847][106225] Updated weights for policy 1, policy_version 327514 (0.0006) [2023-12-27 21:34:44,908][106225] Updated weights for policy 1, policy_version 327524 (0.0008) [2023-12-27 21:34:44,966][106225] Updated weights for policy 1, policy_version 327534 (0.0007) [2023-12-27 21:34:45,296][106226] Updated weights for policy 0, policy_version 326961 (0.0006) [2023-12-27 21:34:45,364][106226] Updated weights for policy 0, policy_version 326971 (0.0009) [2023-12-27 21:34:45,426][106226] Updated weights for policy 0, policy_version 326981 (0.0008) [2023-12-27 21:34:45,482][106226] Updated weights for policy 0, policy_version 326991 (0.0010) [2023-12-27 21:34:45,590][106225] Updated weights for policy 1, policy_version 327544 (0.0008) [2023-12-27 21:34:45,646][106225] Updated weights for policy 1, policy_version 327554 (0.0008) [2023-12-27 21:34:45,700][106225] Updated weights for policy 1, policy_version 327564 (0.0010) [2023-12-27 21:34:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 167616512. Throughput: 0: 10017.5, 1: 9894.0. Samples: 167609012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:46,175][105115] Avg episode reward: [(0, '-5.139'), (1, '-5.622')] [2023-12-27 21:34:46,198][106226] Updated weights for policy 0, policy_version 327001 (0.0010) [2023-12-27 21:34:46,254][106226] Updated weights for policy 0, policy_version 327011 (0.0010) [2023-12-27 21:34:46,315][106226] Updated weights for policy 0, policy_version 327021 (0.0011) [2023-12-27 21:34:46,376][106225] Updated weights for policy 1, policy_version 327574 (0.0007) [2023-12-27 21:34:46,434][106225] Updated weights for policy 1, policy_version 327584 (0.0005) [2023-12-27 21:34:46,499][106225] Updated weights for policy 1, policy_version 327594 (0.0006) [2023-12-27 21:34:46,956][106226] Updated weights for policy 0, policy_version 327031 (0.0007) [2023-12-27 21:34:47,004][106226] Updated weights for policy 0, policy_version 327041 (0.0005) [2023-12-27 21:34:47,057][106226] Updated weights for policy 0, policy_version 327051 (0.0005) [2023-12-27 21:34:47,163][106225] Updated weights for policy 1, policy_version 327604 (0.0010) [2023-12-27 21:34:47,219][106225] Updated weights for policy 1, policy_version 327614 (0.0010) [2023-12-27 21:34:47,279][106225] Updated weights for policy 1, policy_version 327624 (0.0010) [2023-12-27 21:34:47,708][106226] Updated weights for policy 0, policy_version 327061 (0.0008) [2023-12-27 21:34:47,776][106226] Updated weights for policy 0, policy_version 327071 (0.0011) [2023-12-27 21:34:47,834][106226] Updated weights for policy 0, policy_version 327081 (0.0009) [2023-12-27 21:34:47,987][106225] Updated weights for policy 1, policy_version 327634 (0.0010) [2023-12-27 21:34:48,041][106225] Updated weights for policy 1, policy_version 327644 (0.0009) [2023-12-27 21:34:48,103][106225] Updated weights for policy 1, policy_version 327654 (0.0010) [2023-12-27 21:34:48,153][106225] Updated weights for policy 1, policy_version 327664 (0.0010) [2023-12-27 21:34:48,554][106226] Updated weights for policy 0, policy_version 327091 (0.0011) [2023-12-27 21:34:48,608][106226] Updated weights for policy 0, policy_version 327101 (0.0010) [2023-12-27 21:34:48,655][106226] Updated weights for policy 0, policy_version 327111 (0.0009) [2023-12-27 21:34:48,830][106225] Updated weights for policy 1, policy_version 327674 (0.0008) [2023-12-27 21:34:48,894][106225] Updated weights for policy 1, policy_version 327684 (0.0008) [2023-12-27 21:34:48,956][106225] Updated weights for policy 1, policy_version 327694 (0.0008) [2023-12-27 21:34:49,399][106226] Updated weights for policy 0, policy_version 327121 (0.0008) [2023-12-27 21:34:49,466][106226] Updated weights for policy 0, policy_version 327131 (0.0007) [2023-12-27 21:34:49,532][106226] Updated weights for policy 0, policy_version 327141 (0.0008) [2023-12-27 21:34:49,596][106226] Updated weights for policy 0, policy_version 327151 (0.0007) [2023-12-27 21:34:49,604][106225] Updated weights for policy 1, policy_version 327704 (0.0008) [2023-12-27 21:34:49,662][106225] Updated weights for policy 1, policy_version 327714 (0.0008) [2023-12-27 21:34:49,727][106225] Updated weights for policy 1, policy_version 327724 (0.0009) [2023-12-27 21:34:50,261][106226] Updated weights for policy 0, policy_version 327161 (0.0010) [2023-12-27 21:34:50,317][106226] Updated weights for policy 0, policy_version 327171 (0.0010) [2023-12-27 21:34:50,381][106226] Updated weights for policy 0, policy_version 327181 (0.0011) [2023-12-27 21:34:50,407][106225] Updated weights for policy 1, policy_version 327734 (0.0008) [2023-12-27 21:34:50,469][106225] Updated weights for policy 1, policy_version 327744 (0.0009) [2023-12-27 21:34:50,531][106225] Updated weights for policy 1, policy_version 327754 (0.0008) [2023-12-27 21:34:51,069][106226] Updated weights for policy 0, policy_version 327191 (0.0010) [2023-12-27 21:34:51,140][106226] Updated weights for policy 0, policy_version 327201 (0.0010) [2023-12-27 21:34:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 167714816. Throughput: 0: 10015.6, 1: 9930.6. Samples: 167729676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:51,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-5.817')] [2023-12-27 21:34:51,206][106226] Updated weights for policy 0, policy_version 327211 (0.0011) [2023-12-27 21:34:51,306][106225] Updated weights for policy 1, policy_version 327764 (0.0009) [2023-12-27 21:34:51,379][106225] Updated weights for policy 1, policy_version 327774 (0.0008) [2023-12-27 21:34:51,442][106225] Updated weights for policy 1, policy_version 327784 (0.0006) [2023-12-27 21:34:51,974][106226] Updated weights for policy 0, policy_version 327221 (0.0008) [2023-12-27 21:34:52,032][106226] Updated weights for policy 0, policy_version 327231 (0.0011) [2023-12-27 21:34:52,098][106226] Updated weights for policy 0, policy_version 327241 (0.0011) [2023-12-27 21:34:52,213][106225] Updated weights for policy 1, policy_version 327794 (0.0006) [2023-12-27 21:34:52,272][106225] Updated weights for policy 1, policy_version 327804 (0.0008) [2023-12-27 21:34:52,324][106225] Updated weights for policy 1, policy_version 327814 (0.0008) [2023-12-27 21:34:52,389][106225] Updated weights for policy 1, policy_version 327824 (0.0008) [2023-12-27 21:34:52,794][106226] Updated weights for policy 0, policy_version 327251 (0.0009) [2023-12-27 21:34:52,865][106226] Updated weights for policy 0, policy_version 327261 (0.0009) [2023-12-27 21:34:52,930][106226] Updated weights for policy 0, policy_version 327271 (0.0010) [2023-12-27 21:34:52,997][106225] Updated weights for policy 1, policy_version 327834 (0.0006) [2023-12-27 21:34:53,054][106225] Updated weights for policy 1, policy_version 327844 (0.0007) [2023-12-27 21:34:53,110][106225] Updated weights for policy 1, policy_version 327854 (0.0007) [2023-12-27 21:34:53,625][106226] Updated weights for policy 0, policy_version 327281 (0.0010) [2023-12-27 21:34:53,685][106226] Updated weights for policy 0, policy_version 327291 (0.0011) [2023-12-27 21:34:53,718][106225] Updated weights for policy 1, policy_version 327864 (0.0006) [2023-12-27 21:34:53,745][106226] Updated weights for policy 0, policy_version 327301 (0.0010) [2023-12-27 21:34:53,769][106225] Updated weights for policy 1, policy_version 327874 (0.0007) [2023-12-27 21:34:53,806][106226] Updated weights for policy 0, policy_version 327311 (0.0009) [2023-12-27 21:34:53,825][106225] Updated weights for policy 1, policy_version 327884 (0.0008) [2023-12-27 21:34:54,372][106226] Updated weights for policy 0, policy_version 327321 (0.0006) [2023-12-27 21:34:54,434][106226] Updated weights for policy 0, policy_version 327331 (0.0005) [2023-12-27 21:34:54,496][106226] Updated weights for policy 0, policy_version 327341 (0.0009) [2023-12-27 21:34:54,628][106225] Updated weights for policy 1, policy_version 327894 (0.0009) [2023-12-27 21:34:54,692][106225] Updated weights for policy 1, policy_version 327904 (0.0008) [2023-12-27 21:34:54,747][106225] Updated weights for policy 1, policy_version 327914 (0.0009) [2023-12-27 21:34:55,151][106226] Updated weights for policy 0, policy_version 327351 (0.0007) [2023-12-27 21:34:55,215][106226] Updated weights for policy 0, policy_version 327361 (0.0008) [2023-12-27 21:34:55,278][106226] Updated weights for policy 0, policy_version 327371 (0.0007) [2023-12-27 21:34:55,492][106225] Updated weights for policy 1, policy_version 327924 (0.0008) [2023-12-27 21:34:55,555][106225] Updated weights for policy 1, policy_version 327934 (0.0008) [2023-12-27 21:34:55,612][106225] Updated weights for policy 1, policy_version 327944 (0.0008) [2023-12-27 21:34:55,905][106226] Updated weights for policy 0, policy_version 327381 (0.0006) [2023-12-27 21:34:55,958][106226] Updated weights for policy 0, policy_version 327391 (0.0005) [2023-12-27 21:34:56,005][106226] Updated weights for policy 0, policy_version 327401 (0.0007) [2023-12-27 21:34:56,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 167821312. Throughput: 0: 10032.9, 1: 9931.0. Samples: 167789312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:34:56,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.546')] [2023-12-27 21:34:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000327408_83845120.pth... [2023-12-27 21:34:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000327952_83976192.pth... [2023-12-27 21:34:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000326800_83681280.pth [2023-12-27 21:34:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000326224_83542016.pth [2023-12-27 21:34:56,311][106225] Updated weights for policy 1, policy_version 327954 (0.0008) [2023-12-27 21:34:56,367][106225] Updated weights for policy 1, policy_version 327964 (0.0010) [2023-12-27 21:34:56,418][106225] Updated weights for policy 1, policy_version 327974 (0.0010) [2023-12-27 21:34:56,475][106225] Updated weights for policy 1, policy_version 327984 (0.0010) [2023-12-27 21:34:56,577][106226] Updated weights for policy 0, policy_version 327411 (0.0009) [2023-12-27 21:34:56,639][106226] Updated weights for policy 0, policy_version 327421 (0.0005) [2023-12-27 21:34:56,696][106226] Updated weights for policy 0, policy_version 327431 (0.0005) [2023-12-27 21:34:57,117][106225] Updated weights for policy 1, policy_version 327994 (0.0005) [2023-12-27 21:34:57,171][106225] Updated weights for policy 1, policy_version 328004 (0.0005) [2023-12-27 21:34:57,197][106226] Updated weights for policy 0, policy_version 327441 (0.0006) [2023-12-27 21:34:57,223][106225] Updated weights for policy 1, policy_version 328014 (0.0005) [2023-12-27 21:34:57,246][106226] Updated weights for policy 0, policy_version 327451 (0.0010) [2023-12-27 21:34:57,297][106226] Updated weights for policy 0, policy_version 327461 (0.0010) [2023-12-27 21:34:57,344][106226] Updated weights for policy 0, policy_version 327471 (0.0010) [2023-12-27 21:34:57,827][106225] Updated weights for policy 1, policy_version 328024 (0.0007) [2023-12-27 21:34:57,879][106225] Updated weights for policy 1, policy_version 328034 (0.0007) [2023-12-27 21:34:57,936][106225] Updated weights for policy 1, policy_version 328044 (0.0006) [2023-12-27 21:34:58,054][106226] Updated weights for policy 0, policy_version 327481 (0.0010) [2023-12-27 21:34:58,105][106226] Updated weights for policy 0, policy_version 327491 (0.0011) [2023-12-27 21:34:58,155][106226] Updated weights for policy 0, policy_version 327501 (0.0010) [2023-12-27 21:34:58,691][106225] Updated weights for policy 1, policy_version 328054 (0.0008) [2023-12-27 21:34:58,754][106225] Updated weights for policy 1, policy_version 328064 (0.0008) [2023-12-27 21:34:58,825][106225] Updated weights for policy 1, policy_version 328074 (0.0009) [2023-12-27 21:34:59,028][106226] Updated weights for policy 0, policy_version 327511 (0.0007) [2023-12-27 21:34:59,094][106226] Updated weights for policy 0, policy_version 327521 (0.0006) [2023-12-27 21:34:59,162][106226] Updated weights for policy 0, policy_version 327531 (0.0008) [2023-12-27 21:34:59,646][106225] Updated weights for policy 1, policy_version 328084 (0.0009) [2023-12-27 21:34:59,713][106225] Updated weights for policy 1, policy_version 328094 (0.0011) [2023-12-27 21:34:59,764][106225] Updated weights for policy 1, policy_version 328104 (0.0010) [2023-12-27 21:34:59,820][106226] Updated weights for policy 0, policy_version 327541 (0.0009) [2023-12-27 21:34:59,888][106226] Updated weights for policy 0, policy_version 327551 (0.0008) [2023-12-27 21:34:59,953][106226] Updated weights for policy 0, policy_version 327561 (0.0009) [2023-12-27 21:35:00,494][106225] Updated weights for policy 1, policy_version 328114 (0.0010) [2023-12-27 21:35:00,557][106225] Updated weights for policy 1, policy_version 328124 (0.0010) [2023-12-27 21:35:00,610][106225] Updated weights for policy 1, policy_version 328134 (0.0010) [2023-12-27 21:35:00,667][106225] Updated weights for policy 1, policy_version 328144 (0.0010) [2023-12-27 21:35:00,674][106226] Updated weights for policy 0, policy_version 327571 (0.0008) [2023-12-27 21:35:00,723][106226] Updated weights for policy 0, policy_version 327581 (0.0010) [2023-12-27 21:35:00,780][106226] Updated weights for policy 0, policy_version 327591 (0.0010) [2023-12-27 21:35:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 167919616. Throughput: 0: 10161.2, 1: 9906.5. Samples: 167910112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:01,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.657')] [2023-12-27 21:35:01,406][106225] Updated weights for policy 1, policy_version 328154 (0.0010) [2023-12-27 21:35:01,472][106225] Updated weights for policy 1, policy_version 328164 (0.0011) [2023-12-27 21:35:01,524][106225] Updated weights for policy 1, policy_version 328174 (0.0007) [2023-12-27 21:35:01,536][106226] Updated weights for policy 0, policy_version 327601 (0.0010) [2023-12-27 21:35:01,596][106226] Updated weights for policy 0, policy_version 327611 (0.0011) [2023-12-27 21:35:01,666][106226] Updated weights for policy 0, policy_version 327621 (0.0010) [2023-12-27 21:35:01,736][106226] Updated weights for policy 0, policy_version 327631 (0.0010) [2023-12-27 21:35:02,225][106225] Updated weights for policy 1, policy_version 328184 (0.0009) [2023-12-27 21:35:02,286][106225] Updated weights for policy 1, policy_version 328194 (0.0010) [2023-12-27 21:35:02,351][106225] Updated weights for policy 1, policy_version 328204 (0.0010) [2023-12-27 21:35:02,435][106226] Updated weights for policy 0, policy_version 327641 (0.0008) [2023-12-27 21:35:02,479][106226] Updated weights for policy 0, policy_version 327651 (0.0008) [2023-12-27 21:35:02,526][106226] Updated weights for policy 0, policy_version 327661 (0.0008) [2023-12-27 21:35:03,056][106225] Updated weights for policy 1, policy_version 328214 (0.0008) [2023-12-27 21:35:03,110][106225] Updated weights for policy 1, policy_version 328224 (0.0005) [2023-12-27 21:35:03,168][106225] Updated weights for policy 1, policy_version 328234 (0.0005) [2023-12-27 21:35:03,214][106226] Updated weights for policy 0, policy_version 327671 (0.0006) [2023-12-27 21:35:03,276][106226] Updated weights for policy 0, policy_version 327681 (0.0005) [2023-12-27 21:35:03,332][106226] Updated weights for policy 0, policy_version 327691 (0.0005) [2023-12-27 21:35:03,807][106225] Updated weights for policy 1, policy_version 328244 (0.0007) [2023-12-27 21:35:03,867][106225] Updated weights for policy 1, policy_version 328254 (0.0008) [2023-12-27 21:35:03,912][106226] Updated weights for policy 0, policy_version 327701 (0.0006) [2023-12-27 21:35:03,933][106225] Updated weights for policy 1, policy_version 328264 (0.0008) [2023-12-27 21:35:03,970][106226] Updated weights for policy 0, policy_version 327711 (0.0008) [2023-12-27 21:35:04,036][106226] Updated weights for policy 0, policy_version 327721 (0.0006) [2023-12-27 21:35:04,589][106225] Updated weights for policy 1, policy_version 328274 (0.0006) [2023-12-27 21:35:04,648][106226] Updated weights for policy 0, policy_version 327731 (0.0007) [2023-12-27 21:35:04,652][106225] Updated weights for policy 1, policy_version 328284 (0.0006) [2023-12-27 21:35:04,706][106226] Updated weights for policy 0, policy_version 327741 (0.0010) [2023-12-27 21:35:04,707][106225] Updated weights for policy 1, policy_version 328294 (0.0008) [2023-12-27 21:35:04,763][106226] Updated weights for policy 0, policy_version 327751 (0.0008) [2023-12-27 21:35:04,763][106225] Updated weights for policy 1, policy_version 328304 (0.0007) [2023-12-27 21:35:05,399][106226] Updated weights for policy 0, policy_version 327761 (0.0007) [2023-12-27 21:35:05,455][106226] Updated weights for policy 0, policy_version 327771 (0.0010) [2023-12-27 21:35:05,462][106225] Updated weights for policy 1, policy_version 328314 (0.0007) [2023-12-27 21:35:05,509][106226] Updated weights for policy 0, policy_version 327781 (0.0010) [2023-12-27 21:35:05,509][106225] Updated weights for policy 1, policy_version 328324 (0.0006) [2023-12-27 21:35:05,559][106226] Updated weights for policy 0, policy_version 327791 (0.0010) [2023-12-27 21:35:05,560][106225] Updated weights for policy 1, policy_version 328334 (0.0005) [2023-12-27 21:35:06,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 168017920. Throughput: 0: 10215.2, 1: 9862.4. Samples: 168030996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:06,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-5.576')] [2023-12-27 21:35:06,283][106225] Updated weights for policy 1, policy_version 328344 (0.0007) [2023-12-27 21:35:06,333][106226] Updated weights for policy 0, policy_version 327801 (0.0008) [2023-12-27 21:35:06,347][106225] Updated weights for policy 1, policy_version 328354 (0.0007) [2023-12-27 21:35:06,400][106226] Updated weights for policy 0, policy_version 327811 (0.0006) [2023-12-27 21:35:06,407][106225] Updated weights for policy 1, policy_version 328364 (0.0007) [2023-12-27 21:35:06,463][106226] Updated weights for policy 0, policy_version 327821 (0.0009) [2023-12-27 21:35:07,111][106225] Updated weights for policy 1, policy_version 328374 (0.0005) [2023-12-27 21:35:07,168][106225] Updated weights for policy 1, policy_version 328384 (0.0007) [2023-12-27 21:35:07,182][106226] Updated weights for policy 0, policy_version 327831 (0.0008) [2023-12-27 21:35:07,220][106225] Updated weights for policy 1, policy_version 328394 (0.0010) [2023-12-27 21:35:07,240][106226] Updated weights for policy 0, policy_version 327841 (0.0011) [2023-12-27 21:35:07,305][106226] Updated weights for policy 0, policy_version 327851 (0.0011) [2023-12-27 21:35:07,928][106225] Updated weights for policy 1, policy_version 328404 (0.0010) [2023-12-27 21:35:07,950][106226] Updated weights for policy 0, policy_version 327861 (0.0008) [2023-12-27 21:35:07,975][106225] Updated weights for policy 1, policy_version 328414 (0.0010) [2023-12-27 21:35:08,011][106226] Updated weights for policy 0, policy_version 327871 (0.0006) [2023-12-27 21:35:08,032][106225] Updated weights for policy 1, policy_version 328424 (0.0009) [2023-12-27 21:35:08,076][106226] Updated weights for policy 0, policy_version 327881 (0.0006) [2023-12-27 21:35:08,654][106226] Updated weights for policy 0, policy_version 327891 (0.0007) [2023-12-27 21:35:08,716][106226] Updated weights for policy 0, policy_version 327901 (0.0011) [2023-12-27 21:35:08,782][106225] Updated weights for policy 1, policy_version 328434 (0.0010) [2023-12-27 21:35:08,786][106226] Updated weights for policy 0, policy_version 327911 (0.0011) [2023-12-27 21:35:08,842][106225] Updated weights for policy 1, policy_version 328444 (0.0011) [2023-12-27 21:35:08,901][106225] Updated weights for policy 1, policy_version 328454 (0.0011) [2023-12-27 21:35:08,962][106225] Updated weights for policy 1, policy_version 328464 (0.0008) [2023-12-27 21:35:09,561][106226] Updated weights for policy 0, policy_version 327921 (0.0011) [2023-12-27 21:35:09,621][106226] Updated weights for policy 0, policy_version 327931 (0.0009) [2023-12-27 21:35:09,643][106225] Updated weights for policy 1, policy_version 328474 (0.0006) [2023-12-27 21:35:09,681][106226] Updated weights for policy 0, policy_version 327941 (0.0006) [2023-12-27 21:35:09,701][106225] Updated weights for policy 1, policy_version 328484 (0.0007) [2023-12-27 21:35:09,743][106226] Updated weights for policy 0, policy_version 327951 (0.0006) [2023-12-27 21:35:09,754][106225] Updated weights for policy 1, policy_version 328494 (0.0009) [2023-12-27 21:35:10,494][106225] Updated weights for policy 1, policy_version 328504 (0.0009) [2023-12-27 21:35:10,496][106226] Updated weights for policy 0, policy_version 327961 (0.0010) [2023-12-27 21:35:10,544][106225] Updated weights for policy 1, policy_version 328514 (0.0010) [2023-12-27 21:35:10,555][106226] Updated weights for policy 0, policy_version 327971 (0.0011) [2023-12-27 21:35:10,601][106225] Updated weights for policy 1, policy_version 328524 (0.0010) [2023-12-27 21:35:10,613][106226] Updated weights for policy 0, policy_version 327981 (0.0007) [2023-12-27 21:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 168116224. Throughput: 0: 10199.3, 1: 9892.7. Samples: 168090140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:11,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-5.776')] [2023-12-27 21:35:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000328528_84123648.pth... [2023-12-27 21:35:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000327984_83992576.pth... [2023-12-27 21:35:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000326800_83689472.pth [2023-12-27 21:35:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000327376_83828736.pth [2023-12-27 21:35:11,262][106226] Updated weights for policy 0, policy_version 327991 (0.0007) [2023-12-27 21:35:11,324][106226] Updated weights for policy 0, policy_version 328001 (0.0008) [2023-12-27 21:35:11,380][106225] Updated weights for policy 1, policy_version 328534 (0.0014) [2023-12-27 21:35:11,394][106226] Updated weights for policy 0, policy_version 328011 (0.0008) [2023-12-27 21:35:11,442][106225] Updated weights for policy 1, policy_version 328545 (0.0007) [2023-12-27 21:35:11,503][106225] Updated weights for policy 1, policy_version 328555 (0.0007) [2023-12-27 21:35:12,182][106226] Updated weights for policy 0, policy_version 328021 (0.0007) [2023-12-27 21:35:12,208][106225] Updated weights for policy 1, policy_version 328565 (0.0007) [2023-12-27 21:35:12,237][106226] Updated weights for policy 0, policy_version 328031 (0.0009) [2023-12-27 21:35:12,266][106225] Updated weights for policy 1, policy_version 328575 (0.0007) [2023-12-27 21:35:12,304][106226] Updated weights for policy 0, policy_version 328041 (0.0009) [2023-12-27 21:35:12,331][106225] Updated weights for policy 1, policy_version 328585 (0.0008) [2023-12-27 21:35:13,030][106225] Updated weights for policy 1, policy_version 328595 (0.0008) [2023-12-27 21:35:13,058][106226] Updated weights for policy 0, policy_version 328051 (0.0007) [2023-12-27 21:35:13,081][106225] Updated weights for policy 1, policy_version 328605 (0.0008) [2023-12-27 21:35:13,115][106226] Updated weights for policy 0, policy_version 328061 (0.0006) [2023-12-27 21:35:13,141][106225] Updated weights for policy 1, policy_version 328615 (0.0008) [2023-12-27 21:35:13,169][106226] Updated weights for policy 0, policy_version 328071 (0.0007) [2023-12-27 21:35:13,726][106225] Updated weights for policy 1, policy_version 328625 (0.0006) [2023-12-27 21:35:13,784][106225] Updated weights for policy 1, policy_version 328635 (0.0007) [2023-12-27 21:35:13,830][106225] Updated weights for policy 1, policy_version 328645 (0.0009) [2023-12-27 21:35:13,883][106226] Updated weights for policy 0, policy_version 328081 (0.0009) [2023-12-27 21:35:13,891][106225] Updated weights for policy 1, policy_version 328655 (0.0008) [2023-12-27 21:35:13,942][106226] Updated weights for policy 0, policy_version 328091 (0.0006) [2023-12-27 21:35:13,999][106226] Updated weights for policy 0, policy_version 328101 (0.0009) [2023-12-27 21:35:14,050][106226] Updated weights for policy 0, policy_version 328111 (0.0009) [2023-12-27 21:35:14,581][106225] Updated weights for policy 1, policy_version 328665 (0.0009) [2023-12-27 21:35:14,641][106225] Updated weights for policy 1, policy_version 328675 (0.0008) [2023-12-27 21:35:14,697][106225] Updated weights for policy 1, policy_version 328685 (0.0006) [2023-12-27 21:35:14,733][106226] Updated weights for policy 0, policy_version 328121 (0.0009) [2023-12-27 21:35:14,792][106226] Updated weights for policy 0, policy_version 328131 (0.0008) [2023-12-27 21:35:14,856][106226] Updated weights for policy 0, policy_version 328141 (0.0008) [2023-12-27 21:35:15,369][106225] Updated weights for policy 1, policy_version 328695 (0.0007) [2023-12-27 21:35:15,427][106225] Updated weights for policy 1, policy_version 328705 (0.0010) [2023-12-27 21:35:15,482][106225] Updated weights for policy 1, policy_version 328715 (0.0008) [2023-12-27 21:35:15,631][106226] Updated weights for policy 0, policy_version 328151 (0.0009) [2023-12-27 21:35:15,683][106226] Updated weights for policy 0, policy_version 328161 (0.0008) [2023-12-27 21:35:15,735][106226] Updated weights for policy 0, policy_version 328171 (0.0009) [2023-12-27 21:35:16,144][106225] Updated weights for policy 1, policy_version 328725 (0.0005) [2023-12-27 21:35:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 168214528. Throughput: 0: 10048.4, 1: 9819.4. Samples: 168206644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:16,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.737')] [2023-12-27 21:35:16,207][106225] Updated weights for policy 1, policy_version 328735 (0.0009) [2023-12-27 21:35:16,268][106225] Updated weights for policy 1, policy_version 328745 (0.0007) [2023-12-27 21:35:16,457][106226] Updated weights for policy 0, policy_version 328181 (0.0008) [2023-12-27 21:35:16,512][106226] Updated weights for policy 0, policy_version 328191 (0.0009) [2023-12-27 21:35:16,566][106226] Updated weights for policy 0, policy_version 328201 (0.0009) [2023-12-27 21:35:16,798][106225] Updated weights for policy 1, policy_version 328755 (0.0010) [2023-12-27 21:35:16,844][106225] Updated weights for policy 1, policy_version 328765 (0.0010) [2023-12-27 21:35:16,895][106225] Updated weights for policy 1, policy_version 328775 (0.0010) [2023-12-27 21:35:17,354][106226] Updated weights for policy 0, policy_version 328211 (0.0008) [2023-12-27 21:35:17,411][106226] Updated weights for policy 0, policy_version 328221 (0.0008) [2023-12-27 21:35:17,464][106226] Updated weights for policy 0, policy_version 328231 (0.0009) [2023-12-27 21:35:17,602][106225] Updated weights for policy 1, policy_version 328785 (0.0010) [2023-12-27 21:35:17,655][106225] Updated weights for policy 1, policy_version 328795 (0.0005) [2023-12-27 21:35:17,707][106225] Updated weights for policy 1, policy_version 328805 (0.0005) [2023-12-27 21:35:17,768][106225] Updated weights for policy 1, policy_version 328815 (0.0010) [2023-12-27 21:35:18,141][106226] Updated weights for policy 0, policy_version 328241 (0.0009) [2023-12-27 21:35:18,198][106226] Updated weights for policy 0, policy_version 328251 (0.0007) [2023-12-27 21:35:18,250][106226] Updated weights for policy 0, policy_version 328261 (0.0006) [2023-12-27 21:35:18,309][106226] Updated weights for policy 0, policy_version 328271 (0.0006) [2023-12-27 21:35:18,396][106225] Updated weights for policy 1, policy_version 328825 (0.0009) [2023-12-27 21:35:18,461][106225] Updated weights for policy 1, policy_version 328835 (0.0007) [2023-12-27 21:35:18,523][106225] Updated weights for policy 1, policy_version 328845 (0.0007) [2023-12-27 21:35:18,986][106226] Updated weights for policy 0, policy_version 328281 (0.0006) [2023-12-27 21:35:19,036][106226] Updated weights for policy 0, policy_version 328291 (0.0008) [2023-12-27 21:35:19,086][106226] Updated weights for policy 0, policy_version 328301 (0.0008) [2023-12-27 21:35:19,271][106225] Updated weights for policy 1, policy_version 328855 (0.0008) [2023-12-27 21:35:19,337][106225] Updated weights for policy 1, policy_version 328865 (0.0006) [2023-12-27 21:35:19,406][106225] Updated weights for policy 1, policy_version 328875 (0.0008) [2023-12-27 21:35:19,836][106226] Updated weights for policy 0, policy_version 328311 (0.0009) [2023-12-27 21:35:19,904][106226] Updated weights for policy 0, policy_version 328321 (0.0008) [2023-12-27 21:35:19,974][106226] Updated weights for policy 0, policy_version 328331 (0.0007) [2023-12-27 21:35:20,045][106225] Updated weights for policy 1, policy_version 328885 (0.0008) [2023-12-27 21:35:20,102][106225] Updated weights for policy 1, policy_version 328895 (0.0008) [2023-12-27 21:35:20,155][106225] Updated weights for policy 1, policy_version 328905 (0.0008) [2023-12-27 21:35:20,722][106226] Updated weights for policy 0, policy_version 328341 (0.0008) [2023-12-27 21:35:20,774][106226] Updated weights for policy 0, policy_version 328351 (0.0009) [2023-12-27 21:35:20,828][106226] Updated weights for policy 0, policy_version 328361 (0.0008) [2023-12-27 21:35:20,829][106225] Updated weights for policy 1, policy_version 328915 (0.0009) [2023-12-27 21:35:20,884][106225] Updated weights for policy 1, policy_version 328925 (0.0009) [2023-12-27 21:35:20,951][106225] Updated weights for policy 1, policy_version 328935 (0.0009) [2023-12-27 21:35:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 168321024. Throughput: 0: 9945.0, 1: 9912.4. Samples: 168326812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:21,175][105115] Avg episode reward: [(0, '-5.028'), (1, '-5.173')] [2023-12-27 21:35:21,643][106226] Updated weights for policy 0, policy_version 328371 (0.0009) [2023-12-27 21:35:21,706][106225] Updated weights for policy 1, policy_version 328945 (0.0008) [2023-12-27 21:35:21,709][106226] Updated weights for policy 0, policy_version 328381 (0.0008) [2023-12-27 21:35:21,774][106225] Updated weights for policy 1, policy_version 328955 (0.0009) [2023-12-27 21:35:21,778][106226] Updated weights for policy 0, policy_version 328391 (0.0008) [2023-12-27 21:35:21,828][106225] Updated weights for policy 1, policy_version 328965 (0.0007) [2023-12-27 21:35:21,887][106225] Updated weights for policy 1, policy_version 328975 (0.0006) [2023-12-27 21:35:22,489][106226] Updated weights for policy 0, policy_version 328401 (0.0008) [2023-12-27 21:35:22,559][106226] Updated weights for policy 0, policy_version 328411 (0.0010) [2023-12-27 21:35:22,629][106226] Updated weights for policy 0, policy_version 328421 (0.0006) [2023-12-27 21:35:22,642][106225] Updated weights for policy 1, policy_version 328985 (0.0010) [2023-12-27 21:35:22,701][106226] Updated weights for policy 0, policy_version 328431 (0.0008) [2023-12-27 21:35:22,707][106225] Updated weights for policy 1, policy_version 328995 (0.0010) [2023-12-27 21:35:22,772][106225] Updated weights for policy 1, policy_version 329005 (0.0008) [2023-12-27 21:35:23,288][106226] Updated weights for policy 0, policy_version 328441 (0.0010) [2023-12-27 21:35:23,352][106226] Updated weights for policy 0, policy_version 328451 (0.0010) [2023-12-27 21:35:23,394][106225] Updated weights for policy 1, policy_version 329015 (0.0009) [2023-12-27 21:35:23,415][106226] Updated weights for policy 0, policy_version 328461 (0.0010) [2023-12-27 21:35:23,449][106225] Updated weights for policy 1, policy_version 329025 (0.0010) [2023-12-27 21:35:23,510][106225] Updated weights for policy 1, policy_version 329035 (0.0010) [2023-12-27 21:35:24,036][106226] Updated weights for policy 0, policy_version 328471 (0.0010) [2023-12-27 21:35:24,093][106226] Updated weights for policy 0, policy_version 328481 (0.0010) [2023-12-27 21:35:24,154][106226] Updated weights for policy 0, policy_version 328491 (0.0010) [2023-12-27 21:35:24,216][106225] Updated weights for policy 1, policy_version 329045 (0.0010) [2023-12-27 21:35:24,274][106225] Updated weights for policy 1, policy_version 329055 (0.0010) [2023-12-27 21:35:24,323][106225] Updated weights for policy 1, policy_version 329065 (0.0010) [2023-12-27 21:35:24,837][106226] Updated weights for policy 0, policy_version 328501 (0.0010) [2023-12-27 21:35:24,896][106226] Updated weights for policy 0, policy_version 328511 (0.0010) [2023-12-27 21:35:24,956][106226] Updated weights for policy 0, policy_version 328521 (0.0010) [2023-12-27 21:35:25,023][106225] Updated weights for policy 1, policy_version 329075 (0.0011) [2023-12-27 21:35:25,083][106225] Updated weights for policy 1, policy_version 329085 (0.0009) [2023-12-27 21:35:25,145][106225] Updated weights for policy 1, policy_version 329095 (0.0005) [2023-12-27 21:35:25,665][106226] Updated weights for policy 0, policy_version 328531 (0.0010) [2023-12-27 21:35:25,728][106226] Updated weights for policy 0, policy_version 328541 (0.0010) [2023-12-27 21:35:25,783][106226] Updated weights for policy 0, policy_version 328551 (0.0010) [2023-12-27 21:35:25,807][106225] Updated weights for policy 1, policy_version 329105 (0.0010) [2023-12-27 21:35:25,863][106225] Updated weights for policy 1, policy_version 329115 (0.0010) [2023-12-27 21:35:25,923][106225] Updated weights for policy 1, policy_version 329125 (0.0010) [2023-12-27 21:35:25,976][106225] Updated weights for policy 1, policy_version 329135 (0.0010) [2023-12-27 21:35:26,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.7, 300 sec: 19799.6). Total num frames: 168419328. Throughput: 0: 9955.9, 1: 9948.1. Samples: 168386144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:26,176][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.678')] [2023-12-27 21:35:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000329136_84279296.pth... [2023-12-27 21:35:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000328560_84140032.pth... [2023-12-27 21:35:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000327952_83976192.pth [2023-12-27 21:35:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000327408_83845120.pth [2023-12-27 21:35:26,440][106226] Updated weights for policy 0, policy_version 328561 (0.0010) [2023-12-27 21:35:26,502][106226] Updated weights for policy 0, policy_version 328571 (0.0010) [2023-12-27 21:35:26,556][106226] Updated weights for policy 0, policy_version 328581 (0.0010) [2023-12-27 21:35:26,608][106226] Updated weights for policy 0, policy_version 328591 (0.0010) [2023-12-27 21:35:26,702][106225] Updated weights for policy 1, policy_version 329145 (0.0010) [2023-12-27 21:35:26,758][106225] Updated weights for policy 1, policy_version 329155 (0.0010) [2023-12-27 21:35:26,807][106225] Updated weights for policy 1, policy_version 329165 (0.0010) [2023-12-27 21:35:27,302][106226] Updated weights for policy 0, policy_version 328601 (0.0010) [2023-12-27 21:35:27,366][106226] Updated weights for policy 0, policy_version 328611 (0.0005) [2023-12-27 21:35:27,426][106226] Updated weights for policy 0, policy_version 328621 (0.0005) [2023-12-27 21:35:27,508][106225] Updated weights for policy 1, policy_version 329175 (0.0010) [2023-12-27 21:35:27,570][106225] Updated weights for policy 1, policy_version 329185 (0.0010) [2023-12-27 21:35:27,633][106225] Updated weights for policy 1, policy_version 329195 (0.0010) [2023-12-27 21:35:27,936][106226] Updated weights for policy 0, policy_version 328631 (0.0005) [2023-12-27 21:35:27,983][106226] Updated weights for policy 0, policy_version 328641 (0.0008) [2023-12-27 21:35:28,032][106226] Updated weights for policy 0, policy_version 328651 (0.0010) [2023-12-27 21:35:28,344][106225] Updated weights for policy 1, policy_version 329205 (0.0010) [2023-12-27 21:35:28,401][106225] Updated weights for policy 1, policy_version 329215 (0.0010) [2023-12-27 21:35:28,460][106225] Updated weights for policy 1, policy_version 329225 (0.0010) [2023-12-27 21:35:28,649][106226] Updated weights for policy 0, policy_version 328661 (0.0008) [2023-12-27 21:35:28,709][106226] Updated weights for policy 0, policy_version 328671 (0.0010) [2023-12-27 21:35:28,762][106226] Updated weights for policy 0, policy_version 328681 (0.0010) [2023-12-27 21:35:29,187][106225] Updated weights for policy 1, policy_version 329235 (0.0010) [2023-12-27 21:35:29,259][106225] Updated weights for policy 1, policy_version 329245 (0.0010) [2023-12-27 21:35:29,315][106225] Updated weights for policy 1, policy_version 329255 (0.0007) [2023-12-27 21:35:29,512][106226] Updated weights for policy 0, policy_version 328691 (0.0011) [2023-12-27 21:35:29,565][106226] Updated weights for policy 0, policy_version 328701 (0.0011) [2023-12-27 21:35:29,617][106226] Updated weights for policy 0, policy_version 328711 (0.0010) [2023-12-27 21:35:30,027][106225] Updated weights for policy 1, policy_version 329265 (0.0010) [2023-12-27 21:35:30,080][106225] Updated weights for policy 1, policy_version 329275 (0.0007) [2023-12-27 21:35:30,137][106225] Updated weights for policy 1, policy_version 329285 (0.0008) [2023-12-27 21:35:30,199][106225] Updated weights for policy 1, policy_version 329295 (0.0009) [2023-12-27 21:35:30,356][106226] Updated weights for policy 0, policy_version 328721 (0.0011) [2023-12-27 21:35:30,423][106226] Updated weights for policy 0, policy_version 328731 (0.0011) [2023-12-27 21:35:30,483][106226] Updated weights for policy 0, policy_version 328741 (0.0011) [2023-12-27 21:35:30,545][106226] Updated weights for policy 0, policy_version 328751 (0.0011) [2023-12-27 21:35:30,922][106225] Updated weights for policy 1, policy_version 329305 (0.0006) [2023-12-27 21:35:30,984][106225] Updated weights for policy 1, policy_version 329315 (0.0008) [2023-12-27 21:35:31,045][106225] Updated weights for policy 1, policy_version 329325 (0.0010) [2023-12-27 21:35:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 168517632. Throughput: 0: 10010.4, 1: 9965.6. Samples: 168507932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:31,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-5.603')] [2023-12-27 21:35:31,250][106226] Updated weights for policy 0, policy_version 328761 (0.0011) [2023-12-27 21:35:31,311][106226] Updated weights for policy 0, policy_version 328771 (0.0010) [2023-12-27 21:35:31,378][106226] Updated weights for policy 0, policy_version 328781 (0.0009) [2023-12-27 21:35:31,707][106225] Updated weights for policy 1, policy_version 329335 (0.0008) [2023-12-27 21:35:31,767][106225] Updated weights for policy 1, policy_version 329345 (0.0008) [2023-12-27 21:35:31,834][106225] Updated weights for policy 1, policy_version 329355 (0.0007) [2023-12-27 21:35:32,016][106226] Updated weights for policy 0, policy_version 328791 (0.0008) [2023-12-27 21:35:32,080][106226] Updated weights for policy 0, policy_version 328801 (0.0009) [2023-12-27 21:35:32,137][106226] Updated weights for policy 0, policy_version 328811 (0.0007) [2023-12-27 21:35:32,568][106225] Updated weights for policy 1, policy_version 329365 (0.0006) [2023-12-27 21:35:32,624][106225] Updated weights for policy 1, policy_version 329375 (0.0005) [2023-12-27 21:35:32,686][106225] Updated weights for policy 1, policy_version 329385 (0.0007) [2023-12-27 21:35:32,817][106226] Updated weights for policy 0, policy_version 328821 (0.0006) [2023-12-27 21:35:32,868][106226] Updated weights for policy 0, policy_version 328831 (0.0005) [2023-12-27 21:35:32,920][106226] Updated weights for policy 0, policy_version 328841 (0.0008) [2023-12-27 21:35:33,307][106225] Updated weights for policy 1, policy_version 329395 (0.0008) [2023-12-27 21:35:33,356][106225] Updated weights for policy 1, policy_version 329405 (0.0010) [2023-12-27 21:35:33,412][106225] Updated weights for policy 1, policy_version 329415 (0.0007) [2023-12-27 21:35:33,483][106226] Updated weights for policy 0, policy_version 328851 (0.0006) [2023-12-27 21:35:33,546][106226] Updated weights for policy 0, policy_version 328861 (0.0009) [2023-12-27 21:35:33,599][106226] Updated weights for policy 0, policy_version 328871 (0.0009) [2023-12-27 21:35:34,018][106225] Updated weights for policy 1, policy_version 329425 (0.0008) [2023-12-27 21:35:34,080][106225] Updated weights for policy 1, policy_version 329435 (0.0010) [2023-12-27 21:35:34,137][106225] Updated weights for policy 1, policy_version 329445 (0.0011) [2023-12-27 21:35:34,195][106225] Updated weights for policy 1, policy_version 329455 (0.0011) [2023-12-27 21:35:34,338][106226] Updated weights for policy 0, policy_version 328881 (0.0008) [2023-12-27 21:35:34,392][106226] Updated weights for policy 0, policy_version 328891 (0.0009) [2023-12-27 21:35:34,457][106226] Updated weights for policy 0, policy_version 328901 (0.0007) [2023-12-27 21:35:34,512][106226] Updated weights for policy 0, policy_version 328911 (0.0006) [2023-12-27 21:35:34,867][106225] Updated weights for policy 1, policy_version 329465 (0.0007) [2023-12-27 21:35:34,924][106225] Updated weights for policy 1, policy_version 329475 (0.0010) [2023-12-27 21:35:34,986][106225] Updated weights for policy 1, policy_version 329485 (0.0010) [2023-12-27 21:35:35,248][106226] Updated weights for policy 0, policy_version 328921 (0.0007) [2023-12-27 21:35:35,310][106226] Updated weights for policy 0, policy_version 328931 (0.0006) [2023-12-27 21:35:35,366][106226] Updated weights for policy 0, policy_version 328941 (0.0006) [2023-12-27 21:35:35,691][106225] Updated weights for policy 1, policy_version 329495 (0.0009) [2023-12-27 21:35:35,750][106225] Updated weights for policy 1, policy_version 329505 (0.0009) [2023-12-27 21:35:35,800][106225] Updated weights for policy 1, policy_version 329515 (0.0008) [2023-12-27 21:35:35,909][106226] Updated weights for policy 0, policy_version 328951 (0.0008) [2023-12-27 21:35:35,957][106226] Updated weights for policy 0, policy_version 328961 (0.0008) [2023-12-27 21:35:36,019][106226] Updated weights for policy 0, policy_version 328971 (0.0008) [2023-12-27 21:35:36,174][105115] Fps is (10 sec: 20480.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 168624128. Throughput: 0: 10052.2, 1: 9960.7. Samples: 168630256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:35:36,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-5.796')] [2023-12-27 21:35:36,518][106225] Updated weights for policy 1, policy_version 329525 (0.0007) [2023-12-27 21:35:36,577][106225] Updated weights for policy 1, policy_version 329535 (0.0007) [2023-12-27 21:35:36,637][106225] Updated weights for policy 1, policy_version 329545 (0.0008) [2023-12-27 21:35:36,834][106226] Updated weights for policy 0, policy_version 328981 (0.0009) [2023-12-27 21:35:36,901][106226] Updated weights for policy 0, policy_version 328991 (0.0009) [2023-12-27 21:35:36,967][106226] Updated weights for policy 0, policy_version 329001 (0.0009) [2023-12-27 21:35:37,325][106225] Updated weights for policy 1, policy_version 329555 (0.0007) [2023-12-27 21:35:37,379][106225] Updated weights for policy 1, policy_version 329565 (0.0009) [2023-12-27 21:35:37,447][106225] Updated weights for policy 1, policy_version 329575 (0.0008) [2023-12-27 21:35:37,565][106226] Updated weights for policy 0, policy_version 329011 (0.0009) [2023-12-27 21:35:37,623][106226] Updated weights for policy 0, policy_version 329021 (0.0008) [2023-12-27 21:35:37,697][106226] Updated weights for policy 0, policy_version 329031 (0.0010) [2023-12-27 21:35:38,087][106225] Updated weights for policy 1, policy_version 329585 (0.0006) [2023-12-27 21:35:38,140][106225] Updated weights for policy 1, policy_version 329595 (0.0007) [2023-12-27 21:35:38,193][106225] Updated weights for policy 1, policy_version 329605 (0.0006) [2023-12-27 21:35:38,251][106225] Updated weights for policy 1, policy_version 329615 (0.0005) [2023-12-27 21:35:38,464][106226] Updated weights for policy 0, policy_version 329041 (0.0010) [2023-12-27 21:35:38,526][106226] Updated weights for policy 0, policy_version 329051 (0.0010) [2023-12-27 21:35:38,586][106226] Updated weights for policy 0, policy_version 329061 (0.0007) [2023-12-27 21:35:38,657][106226] Updated weights for policy 0, policy_version 329071 (0.0007) [2023-12-27 21:35:38,923][106225] Updated weights for policy 1, policy_version 329625 (0.0006) [2023-12-27 21:35:38,990][106225] Updated weights for policy 1, policy_version 329635 (0.0007) [2023-12-27 21:35:39,050][106225] Updated weights for policy 1, policy_version 329645 (0.0008) [2023-12-27 21:35:39,428][106226] Updated weights for policy 0, policy_version 329081 (0.0009) [2023-12-27 21:35:39,491][106226] Updated weights for policy 0, policy_version 329091 (0.0008) [2023-12-27 21:35:39,553][106226] Updated weights for policy 0, policy_version 329101 (0.0009) [2023-12-27 21:35:39,679][106225] Updated weights for policy 1, policy_version 329655 (0.0007) [2023-12-27 21:35:39,732][106225] Updated weights for policy 1, policy_version 329665 (0.0008) [2023-12-27 21:35:39,794][106225] Updated weights for policy 1, policy_version 329675 (0.0008) [2023-12-27 21:35:40,324][106226] Updated weights for policy 0, policy_version 329111 (0.0008) [2023-12-27 21:35:40,388][106226] Updated weights for policy 0, policy_version 329121 (0.0008) [2023-12-27 21:35:40,438][106226] Updated weights for policy 0, policy_version 329131 (0.0008) [2023-12-27 21:35:40,562][106225] Updated weights for policy 1, policy_version 329685 (0.0007) [2023-12-27 21:35:40,622][106225] Updated weights for policy 1, policy_version 329695 (0.0005) [2023-12-27 21:35:40,679][106225] Updated weights for policy 1, policy_version 329705 (0.0005) [2023-12-27 21:35:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 168714240. Throughput: 0: 10044.9, 1: 9962.8. Samples: 168689656. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:35:41,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.657')] [2023-12-27 21:35:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000329712_84426752.pth... [2023-12-27 21:35:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000329136_84287488.pth... [2023-12-27 21:35:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000327984_83992576.pth [2023-12-27 21:35:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000328528_84123648.pth [2023-12-27 21:35:41,294][106226] Updated weights for policy 0, policy_version 329141 (0.0008) [2023-12-27 21:35:41,363][106226] Updated weights for policy 0, policy_version 329151 (0.0008) [2023-12-27 21:35:41,419][106225] Updated weights for policy 1, policy_version 329715 (0.0007) [2023-12-27 21:35:41,433][106226] Updated weights for policy 0, policy_version 329161 (0.0008) [2023-12-27 21:35:41,484][106225] Updated weights for policy 1, policy_version 329725 (0.0010) [2023-12-27 21:35:41,553][106225] Updated weights for policy 1, policy_version 329735 (0.0010) [2023-12-27 21:35:42,176][106226] Updated weights for policy 0, policy_version 329171 (0.0006) [2023-12-27 21:35:42,228][106226] Updated weights for policy 0, policy_version 329181 (0.0009) [2023-12-27 21:35:42,239][106225] Updated weights for policy 1, policy_version 329745 (0.0008) [2023-12-27 21:35:42,292][106226] Updated weights for policy 0, policy_version 329191 (0.0008) [2023-12-27 21:35:42,306][106225] Updated weights for policy 1, policy_version 329755 (0.0007) [2023-12-27 21:35:42,375][106225] Updated weights for policy 1, policy_version 329765 (0.0007) [2023-12-27 21:35:42,440][106225] Updated weights for policy 1, policy_version 329775 (0.0010) [2023-12-27 21:35:43,024][106226] Updated weights for policy 0, policy_version 329201 (0.0008) [2023-12-27 21:35:43,079][106225] Updated weights for policy 1, policy_version 329785 (0.0007) [2023-12-27 21:35:43,093][106226] Updated weights for policy 0, policy_version 329211 (0.0008) [2023-12-27 21:35:43,138][106225] Updated weights for policy 1, policy_version 329795 (0.0005) [2023-12-27 21:35:43,150][106226] Updated weights for policy 0, policy_version 329221 (0.0007) [2023-12-27 21:35:43,200][106225] Updated weights for policy 1, policy_version 329805 (0.0005) [2023-12-27 21:35:43,205][106226] Updated weights for policy 0, policy_version 329231 (0.0007) [2023-12-27 21:35:43,776][106225] Updated weights for policy 1, policy_version 329815 (0.0005) [2023-12-27 21:35:43,785][106226] Updated weights for policy 0, policy_version 329241 (0.0006) [2023-12-27 21:35:43,840][106225] Updated weights for policy 1, policy_version 329825 (0.0006) [2023-12-27 21:35:43,847][106226] Updated weights for policy 0, policy_version 329251 (0.0007) [2023-12-27 21:35:43,908][106225] Updated weights for policy 1, policy_version 329835 (0.0005) [2023-12-27 21:35:43,935][106226] Updated weights for policy 0, policy_version 329261 (0.0007) [2023-12-27 21:35:44,449][106225] Updated weights for policy 1, policy_version 329845 (0.0006) [2023-12-27 21:35:44,497][106225] Updated weights for policy 1, policy_version 329855 (0.0008) [2023-12-27 21:35:44,550][106225] Updated weights for policy 1, policy_version 329865 (0.0008) [2023-12-27 21:35:44,660][106226] Updated weights for policy 0, policy_version 329271 (0.0010) [2023-12-27 21:35:44,719][106226] Updated weights for policy 0, policy_version 329281 (0.0008) [2023-12-27 21:35:44,783][106226] Updated weights for policy 0, policy_version 329291 (0.0008) [2023-12-27 21:35:45,219][106225] Updated weights for policy 1, policy_version 329875 (0.0006) [2023-12-27 21:35:45,288][106225] Updated weights for policy 1, policy_version 329885 (0.0010) [2023-12-27 21:35:45,347][106225] Updated weights for policy 1, policy_version 329895 (0.0008) [2023-12-27 21:35:45,547][106226] Updated weights for policy 0, policy_version 329301 (0.0009) [2023-12-27 21:35:45,614][106226] Updated weights for policy 0, policy_version 329311 (0.0010) [2023-12-27 21:35:45,689][106226] Updated weights for policy 0, policy_version 329321 (0.0010) [2023-12-27 21:35:45,940][106225] Updated weights for policy 1, policy_version 329905 (0.0008) [2023-12-27 21:35:45,994][106225] Updated weights for policy 1, policy_version 329915 (0.0008) [2023-12-27 21:35:46,054][106225] Updated weights for policy 1, policy_version 329925 (0.0009) [2023-12-27 21:35:46,119][106225] Updated weights for policy 1, policy_version 329935 (0.0009) [2023-12-27 21:35:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 168820736. Throughput: 0: 9878.8, 1: 10043.1. Samples: 168806596. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:35:46,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.672')] [2023-12-27 21:35:46,357][106226] Updated weights for policy 0, policy_version 329331 (0.0009) [2023-12-27 21:35:46,414][106226] Updated weights for policy 0, policy_version 329341 (0.0010) [2023-12-27 21:35:46,465][106226] Updated weights for policy 0, policy_version 329351 (0.0007) [2023-12-27 21:35:46,814][106225] Updated weights for policy 1, policy_version 329945 (0.0005) [2023-12-27 21:35:46,864][106225] Updated weights for policy 1, policy_version 329955 (0.0005) [2023-12-27 21:35:46,910][106225] Updated weights for policy 1, policy_version 329965 (0.0005) [2023-12-27 21:35:47,298][106226] Updated weights for policy 0, policy_version 329361 (0.0008) [2023-12-27 21:35:47,359][106226] Updated weights for policy 0, policy_version 329371 (0.0009) [2023-12-27 21:35:47,410][106226] Updated weights for policy 0, policy_version 329381 (0.0009) [2023-12-27 21:35:47,429][106225] Updated weights for policy 1, policy_version 329975 (0.0005) [2023-12-27 21:35:47,460][106226] Updated weights for policy 0, policy_version 329391 (0.0008) [2023-12-27 21:35:47,488][106225] Updated weights for policy 1, policy_version 329985 (0.0005) [2023-12-27 21:35:47,536][106225] Updated weights for policy 1, policy_version 329995 (0.0005) [2023-12-27 21:35:48,084][106225] Updated weights for policy 1, policy_version 330005 (0.0008) [2023-12-27 21:35:48,140][106225] Updated weights for policy 1, policy_version 330015 (0.0010) [2023-12-27 21:35:48,193][106225] Updated weights for policy 1, policy_version 330025 (0.0010) [2023-12-27 21:35:48,273][106226] Updated weights for policy 0, policy_version 329401 (0.0008) [2023-12-27 21:35:48,335][106226] Updated weights for policy 0, policy_version 329411 (0.0007) [2023-12-27 21:35:48,395][106226] Updated weights for policy 0, policy_version 329421 (0.0008) [2023-12-27 21:35:48,931][106225] Updated weights for policy 1, policy_version 330035 (0.0010) [2023-12-27 21:35:48,992][106225] Updated weights for policy 1, policy_version 330045 (0.0009) [2023-12-27 21:35:49,045][106225] Updated weights for policy 1, policy_version 330055 (0.0008) [2023-12-27 21:35:49,107][106226] Updated weights for policy 0, policy_version 329431 (0.0009) [2023-12-27 21:35:49,169][106226] Updated weights for policy 0, policy_version 329441 (0.0008) [2023-12-27 21:35:49,256][106226] Updated weights for policy 0, policy_version 329451 (0.0009) [2023-12-27 21:35:49,786][106225] Updated weights for policy 1, policy_version 330065 (0.0008) [2023-12-27 21:35:49,844][106225] Updated weights for policy 1, policy_version 330075 (0.0008) [2023-12-27 21:35:49,906][106225] Updated weights for policy 1, policy_version 330085 (0.0008) [2023-12-27 21:35:49,972][106225] Updated weights for policy 1, policy_version 330095 (0.0009) [2023-12-27 21:35:49,983][106226] Updated weights for policy 0, policy_version 329461 (0.0009) [2023-12-27 21:35:50,041][106226] Updated weights for policy 0, policy_version 329471 (0.0007) [2023-12-27 21:35:50,093][106226] Updated weights for policy 0, policy_version 329481 (0.0005) [2023-12-27 21:35:50,738][106225] Updated weights for policy 1, policy_version 330105 (0.0008) [2023-12-27 21:35:50,794][106226] Updated weights for policy 0, policy_version 329491 (0.0006) [2023-12-27 21:35:50,801][106225] Updated weights for policy 1, policy_version 330115 (0.0008) [2023-12-27 21:35:50,858][106226] Updated weights for policy 0, policy_version 329501 (0.0007) [2023-12-27 21:35:50,864][106225] Updated weights for policy 1, policy_version 330125 (0.0008) [2023-12-27 21:35:50,912][106226] Updated weights for policy 0, policy_version 329511 (0.0008) [2023-12-27 21:35:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 168919040. Throughput: 0: 9761.0, 1: 10108.4. Samples: 168925120. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:35:51,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.615')] [2023-12-27 21:35:51,662][106226] Updated weights for policy 0, policy_version 329521 (0.0008) [2023-12-27 21:35:51,699][106225] Updated weights for policy 1, policy_version 330135 (0.0007) [2023-12-27 21:35:51,721][106226] Updated weights for policy 0, policy_version 329531 (0.0008) [2023-12-27 21:35:51,763][106225] Updated weights for policy 1, policy_version 330145 (0.0007) [2023-12-27 21:35:51,785][106226] Updated weights for policy 0, policy_version 329541 (0.0008) [2023-12-27 21:35:51,827][106225] Updated weights for policy 1, policy_version 330155 (0.0006) [2023-12-27 21:35:51,847][106226] Updated weights for policy 0, policy_version 329551 (0.0008) [2023-12-27 21:35:52,484][106225] Updated weights for policy 1, policy_version 330165 (0.0007) [2023-12-27 21:35:52,544][106225] Updated weights for policy 1, policy_version 330175 (0.0010) [2023-12-27 21:35:52,608][106225] Updated weights for policy 1, policy_version 330185 (0.0009) [2023-12-27 21:35:52,616][106226] Updated weights for policy 0, policy_version 329561 (0.0007) [2023-12-27 21:35:52,677][106226] Updated weights for policy 0, policy_version 329571 (0.0007) [2023-12-27 21:35:52,738][106226] Updated weights for policy 0, policy_version 329581 (0.0005) [2023-12-27 21:35:53,236][106225] Updated weights for policy 1, policy_version 330195 (0.0009) [2023-12-27 21:35:53,294][106225] Updated weights for policy 1, policy_version 330205 (0.0008) [2023-12-27 21:35:53,357][106225] Updated weights for policy 1, policy_version 330215 (0.0009) [2023-12-27 21:35:53,432][106226] Updated weights for policy 0, policy_version 329591 (0.0008) [2023-12-27 21:35:53,491][106226] Updated weights for policy 0, policy_version 329601 (0.0009) [2023-12-27 21:35:53,554][106226] Updated weights for policy 0, policy_version 329611 (0.0009) [2023-12-27 21:35:54,050][106225] Updated weights for policy 1, policy_version 330225 (0.0007) [2023-12-27 21:35:54,102][106225] Updated weights for policy 1, policy_version 330235 (0.0008) [2023-12-27 21:35:54,154][106225] Updated weights for policy 1, policy_version 330245 (0.0008) [2023-12-27 21:35:54,206][106225] Updated weights for policy 1, policy_version 330255 (0.0008) [2023-12-27 21:35:54,273][106226] Updated weights for policy 0, policy_version 329621 (0.0009) [2023-12-27 21:35:54,326][106226] Updated weights for policy 0, policy_version 329631 (0.0009) [2023-12-27 21:35:54,383][106226] Updated weights for policy 0, policy_version 329641 (0.0009) [2023-12-27 21:35:54,901][106225] Updated weights for policy 1, policy_version 330265 (0.0006) [2023-12-27 21:35:54,949][106225] Updated weights for policy 1, policy_version 330275 (0.0005) [2023-12-27 21:35:55,002][106225] Updated weights for policy 1, policy_version 330285 (0.0008) [2023-12-27 21:35:55,146][106226] Updated weights for policy 0, policy_version 329651 (0.0009) [2023-12-27 21:35:55,198][106226] Updated weights for policy 0, policy_version 329661 (0.0007) [2023-12-27 21:35:55,252][106226] Updated weights for policy 0, policy_version 329671 (0.0008) [2023-12-27 21:35:55,626][106225] Updated weights for policy 1, policy_version 330295 (0.0007) [2023-12-27 21:35:55,674][106225] Updated weights for policy 1, policy_version 330305 (0.0005) [2023-12-27 21:35:55,733][106225] Updated weights for policy 1, policy_version 330315 (0.0005) [2023-12-27 21:35:55,835][106226] Updated weights for policy 0, policy_version 329681 (0.0007) [2023-12-27 21:35:55,886][106226] Updated weights for policy 0, policy_version 329691 (0.0005) [2023-12-27 21:35:55,935][106226] Updated weights for policy 0, policy_version 329701 (0.0005) [2023-12-27 21:35:55,985][106226] Updated weights for policy 0, policy_version 329711 (0.0005) [2023-12-27 21:35:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 169017344. Throughput: 0: 9717.3, 1: 10112.8. Samples: 168982500. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:35:56,176][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.627')] [2023-12-27 21:35:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000330320_84582400.pth... [2023-12-27 21:35:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000329712_84434944.pth... [2023-12-27 21:35:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000329136_84279296.pth [2023-12-27 21:35:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000328560_84140032.pth [2023-12-27 21:35:56,257][106225] Updated weights for policy 1, policy_version 330325 (0.0005) [2023-12-27 21:35:56,311][106225] Updated weights for policy 1, policy_version 330335 (0.0007) [2023-12-27 21:35:56,356][106225] Updated weights for policy 1, policy_version 330345 (0.0010) [2023-12-27 21:35:56,725][106226] Updated weights for policy 0, policy_version 329721 (0.0005) [2023-12-27 21:35:56,782][106226] Updated weights for policy 0, policy_version 329731 (0.0005) [2023-12-27 21:35:56,849][106226] Updated weights for policy 0, policy_version 329741 (0.0006) [2023-12-27 21:35:56,934][106225] Updated weights for policy 1, policy_version 330355 (0.0009) [2023-12-27 21:35:56,994][106225] Updated weights for policy 1, policy_version 330365 (0.0005) [2023-12-27 21:35:57,050][106225] Updated weights for policy 1, policy_version 330375 (0.0005) [2023-12-27 21:35:57,413][106226] Updated weights for policy 0, policy_version 329751 (0.0008) [2023-12-27 21:35:57,466][106226] Updated weights for policy 0, policy_version 329761 (0.0008) [2023-12-27 21:35:57,522][106226] Updated weights for policy 0, policy_version 329771 (0.0007) [2023-12-27 21:35:57,689][106225] Updated weights for policy 1, policy_version 330385 (0.0006) [2023-12-27 21:35:57,736][106225] Updated weights for policy 1, policy_version 330395 (0.0010) [2023-12-27 21:35:57,784][106225] Updated weights for policy 1, policy_version 330405 (0.0008) [2023-12-27 21:35:57,828][106225] Updated weights for policy 1, policy_version 330415 (0.0009) [2023-12-27 21:35:58,247][106226] Updated weights for policy 0, policy_version 329781 (0.0008) [2023-12-27 21:35:58,310][106226] Updated weights for policy 0, policy_version 329791 (0.0009) [2023-12-27 21:35:58,381][106226] Updated weights for policy 0, policy_version 329801 (0.0009) [2023-12-27 21:35:58,599][106225] Updated weights for policy 1, policy_version 330425 (0.0008) [2023-12-27 21:35:58,670][106225] Updated weights for policy 1, policy_version 330435 (0.0007) [2023-12-27 21:35:58,735][106225] Updated weights for policy 1, policy_version 330445 (0.0008) [2023-12-27 21:35:59,215][106226] Updated weights for policy 0, policy_version 329811 (0.0007) [2023-12-27 21:35:59,293][106226] Updated weights for policy 0, policy_version 329821 (0.0008) [2023-12-27 21:35:59,371][106226] Updated weights for policy 0, policy_version 329831 (0.0007) [2023-12-27 21:35:59,588][106225] Updated weights for policy 1, policy_version 330455 (0.0008) [2023-12-27 21:35:59,648][106225] Updated weights for policy 1, policy_version 330465 (0.0009) [2023-12-27 21:35:59,705][106225] Updated weights for policy 1, policy_version 330475 (0.0008) [2023-12-27 21:36:00,017][106226] Updated weights for policy 0, policy_version 329841 (0.0006) [2023-12-27 21:36:00,083][106226] Updated weights for policy 0, policy_version 329851 (0.0007) [2023-12-27 21:36:00,146][106226] Updated weights for policy 0, policy_version 329861 (0.0008) [2023-12-27 21:36:00,207][106226] Updated weights for policy 0, policy_version 329871 (0.0008) [2023-12-27 21:36:00,467][106225] Updated weights for policy 1, policy_version 330485 (0.0009) [2023-12-27 21:36:00,531][106225] Updated weights for policy 1, policy_version 330495 (0.0010) [2023-12-27 21:36:00,580][106225] Updated weights for policy 1, policy_version 330505 (0.0010) [2023-12-27 21:36:00,902][106226] Updated weights for policy 0, policy_version 329881 (0.0008) [2023-12-27 21:36:00,961][106226] Updated weights for policy 0, policy_version 329891 (0.0007) [2023-12-27 21:36:01,014][106226] Updated weights for policy 0, policy_version 329901 (0.0008) [2023-12-27 21:36:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 169115648. Throughput: 0: 9789.0, 1: 10188.4. Samples: 169105624. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:01,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.773')] [2023-12-27 21:36:01,280][106225] Updated weights for policy 1, policy_version 330515 (0.0009) [2023-12-27 21:36:01,351][106225] Updated weights for policy 1, policy_version 330525 (0.0009) [2023-12-27 21:36:01,425][106225] Updated weights for policy 1, policy_version 330535 (0.0010) [2023-12-27 21:36:01,813][106226] Updated weights for policy 0, policy_version 329911 (0.0008) [2023-12-27 21:36:01,874][106226] Updated weights for policy 0, policy_version 329921 (0.0007) [2023-12-27 21:36:01,921][106226] Updated weights for policy 0, policy_version 329931 (0.0005) [2023-12-27 21:36:02,159][106225] Updated weights for policy 1, policy_version 330545 (0.0010) [2023-12-27 21:36:02,222][106225] Updated weights for policy 1, policy_version 330555 (0.0006) [2023-12-27 21:36:02,284][106225] Updated weights for policy 1, policy_version 330565 (0.0009) [2023-12-27 21:36:02,344][106225] Updated weights for policy 1, policy_version 330575 (0.0010) [2023-12-27 21:36:02,617][106226] Updated weights for policy 0, policy_version 329941 (0.0009) [2023-12-27 21:36:02,677][106226] Updated weights for policy 0, policy_version 329951 (0.0010) [2023-12-27 21:36:02,738][106226] Updated weights for policy 0, policy_version 329961 (0.0009) [2023-12-27 21:36:03,006][106225] Updated weights for policy 1, policy_version 330585 (0.0010) [2023-12-27 21:36:03,063][106225] Updated weights for policy 1, policy_version 330595 (0.0010) [2023-12-27 21:36:03,125][106225] Updated weights for policy 1, policy_version 330605 (0.0010) [2023-12-27 21:36:03,448][106226] Updated weights for policy 0, policy_version 329971 (0.0009) [2023-12-27 21:36:03,498][106226] Updated weights for policy 0, policy_version 329981 (0.0010) [2023-12-27 21:36:03,552][106226] Updated weights for policy 0, policy_version 329991 (0.0010) [2023-12-27 21:36:03,745][106225] Updated weights for policy 1, policy_version 330615 (0.0007) [2023-12-27 21:36:03,798][106225] Updated weights for policy 1, policy_version 330625 (0.0005) [2023-12-27 21:36:03,872][106225] Updated weights for policy 1, policy_version 330635 (0.0007) [2023-12-27 21:36:04,170][106226] Updated weights for policy 0, policy_version 330001 (0.0010) [2023-12-27 21:36:04,232][106226] Updated weights for policy 0, policy_version 330011 (0.0010) [2023-12-27 21:36:04,297][106226] Updated weights for policy 0, policy_version 330021 (0.0009) [2023-12-27 21:36:04,364][106226] Updated weights for policy 0, policy_version 330031 (0.0011) [2023-12-27 21:36:04,495][106225] Updated weights for policy 1, policy_version 330645 (0.0009) [2023-12-27 21:36:04,546][106225] Updated weights for policy 1, policy_version 330655 (0.0010) [2023-12-27 21:36:04,607][106225] Updated weights for policy 1, policy_version 330665 (0.0010) [2023-12-27 21:36:05,088][106226] Updated weights for policy 0, policy_version 330041 (0.0006) [2023-12-27 21:36:05,139][106226] Updated weights for policy 0, policy_version 330051 (0.0005) [2023-12-27 21:36:05,185][106226] Updated weights for policy 0, policy_version 330061 (0.0007) [2023-12-27 21:36:05,313][106225] Updated weights for policy 1, policy_version 330675 (0.0010) [2023-12-27 21:36:05,372][106225] Updated weights for policy 1, policy_version 330685 (0.0010) [2023-12-27 21:36:05,425][106225] Updated weights for policy 1, policy_version 330695 (0.0010) [2023-12-27 21:36:05,784][106226] Updated weights for policy 0, policy_version 330071 (0.0009) [2023-12-27 21:36:05,830][106226] Updated weights for policy 0, policy_version 330081 (0.0010) [2023-12-27 21:36:05,877][106226] Updated weights for policy 0, policy_version 330091 (0.0011) [2023-12-27 21:36:06,159][106225] Updated weights for policy 1, policy_version 330705 (0.0010) [2023-12-27 21:36:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 169213952. Throughput: 0: 9837.1, 1: 10126.8. Samples: 169225188. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:06,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.563')] [2023-12-27 21:36:06,215][106225] Updated weights for policy 1, policy_version 330715 (0.0008) [2023-12-27 21:36:06,277][106225] Updated weights for policy 1, policy_version 330725 (0.0008) [2023-12-27 21:36:06,339][106225] Updated weights for policy 1, policy_version 330735 (0.0008) [2023-12-27 21:36:06,677][106226] Updated weights for policy 0, policy_version 330101 (0.0010) [2023-12-27 21:36:06,743][106226] Updated weights for policy 0, policy_version 330111 (0.0008) [2023-12-27 21:36:06,807][106226] Updated weights for policy 0, policy_version 330121 (0.0009) [2023-12-27 21:36:07,031][106225] Updated weights for policy 1, policy_version 330745 (0.0009) [2023-12-27 21:36:07,097][106225] Updated weights for policy 1, policy_version 330755 (0.0009) [2023-12-27 21:36:07,160][106225] Updated weights for policy 1, policy_version 330765 (0.0009) [2023-12-27 21:36:07,454][106226] Updated weights for policy 0, policy_version 330131 (0.0007) [2023-12-27 21:36:07,509][106226] Updated weights for policy 0, policy_version 330141 (0.0005) [2023-12-27 21:36:07,563][106226] Updated weights for policy 0, policy_version 330151 (0.0008) [2023-12-27 21:36:07,879][106225] Updated weights for policy 1, policy_version 330775 (0.0006) [2023-12-27 21:36:07,952][106225] Updated weights for policy 1, policy_version 330785 (0.0006) [2023-12-27 21:36:08,018][106225] Updated weights for policy 1, policy_version 330795 (0.0006) [2023-12-27 21:36:08,192][106226] Updated weights for policy 0, policy_version 330161 (0.0010) [2023-12-27 21:36:08,251][106226] Updated weights for policy 0, policy_version 330171 (0.0005) [2023-12-27 21:36:08,312][106226] Updated weights for policy 0, policy_version 330181 (0.0005) [2023-12-27 21:36:08,382][106226] Updated weights for policy 0, policy_version 330191 (0.0008) [2023-12-27 21:36:08,673][106225] Updated weights for policy 1, policy_version 330805 (0.0007) [2023-12-27 21:36:08,738][106225] Updated weights for policy 1, policy_version 330815 (0.0008) [2023-12-27 21:36:08,808][106225] Updated weights for policy 1, policy_version 330825 (0.0005) [2023-12-27 21:36:08,994][106226] Updated weights for policy 0, policy_version 330201 (0.0011) [2023-12-27 21:36:09,044][106226] Updated weights for policy 0, policy_version 330211 (0.0011) [2023-12-27 21:36:09,098][106226] Updated weights for policy 0, policy_version 330221 (0.0010) [2023-12-27 21:36:09,503][106225] Updated weights for policy 1, policy_version 330835 (0.0007) [2023-12-27 21:36:09,567][106225] Updated weights for policy 1, policy_version 330845 (0.0008) [2023-12-27 21:36:09,634][106225] Updated weights for policy 1, policy_version 330855 (0.0009) [2023-12-27 21:36:09,833][106226] Updated weights for policy 0, policy_version 330231 (0.0010) [2023-12-27 21:36:09,906][106226] Updated weights for policy 0, policy_version 330241 (0.0008) [2023-12-27 21:36:09,976][106226] Updated weights for policy 0, policy_version 330251 (0.0010) [2023-12-27 21:36:10,458][106225] Updated weights for policy 1, policy_version 330865 (0.0009) [2023-12-27 21:36:10,515][106225] Updated weights for policy 1, policy_version 330875 (0.0008) [2023-12-27 21:36:10,581][106225] Updated weights for policy 1, policy_version 330885 (0.0008) [2023-12-27 21:36:10,649][106225] Updated weights for policy 1, policy_version 330895 (0.0008) [2023-12-27 21:36:10,677][106226] Updated weights for policy 0, policy_version 330261 (0.0011) [2023-12-27 21:36:10,738][106226] Updated weights for policy 0, policy_version 330271 (0.0011) [2023-12-27 21:36:10,801][106226] Updated weights for policy 0, policy_version 330281 (0.0011) [2023-12-27 21:36:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 169312256. Throughput: 0: 9843.3, 1: 10133.3. Samples: 169285084. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:11,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-5.799')] [2023-12-27 21:36:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000330288_84582400.pth... [2023-12-27 21:36:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000330896_84729856.pth... [2023-12-27 21:36:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000329712_84426752.pth [2023-12-27 21:36:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000329136_84287488.pth [2023-12-27 21:36:11,400][106225] Updated weights for policy 1, policy_version 330905 (0.0009) [2023-12-27 21:36:11,457][106225] Updated weights for policy 1, policy_version 330915 (0.0011) [2023-12-27 21:36:11,515][106225] Updated weights for policy 1, policy_version 330925 (0.0009) [2023-12-27 21:36:11,572][106226] Updated weights for policy 0, policy_version 330291 (0.0010) [2023-12-27 21:36:11,640][106226] Updated weights for policy 0, policy_version 330301 (0.0011) [2023-12-27 21:36:11,709][106226] Updated weights for policy 0, policy_version 330311 (0.0011) [2023-12-27 21:36:12,189][106225] Updated weights for policy 1, policy_version 330935 (0.0006) [2023-12-27 21:36:12,248][106225] Updated weights for policy 1, policy_version 330945 (0.0007) [2023-12-27 21:36:12,305][106225] Updated weights for policy 1, policy_version 330955 (0.0008) [2023-12-27 21:36:12,474][106226] Updated weights for policy 0, policy_version 330321 (0.0010) [2023-12-27 21:36:12,535][106226] Updated weights for policy 0, policy_version 330331 (0.0010) [2023-12-27 21:36:12,598][106226] Updated weights for policy 0, policy_version 330341 (0.0008) [2023-12-27 21:36:12,655][106226] Updated weights for policy 0, policy_version 330351 (0.0009) [2023-12-27 21:36:13,007][106225] Updated weights for policy 1, policy_version 330965 (0.0008) [2023-12-27 21:36:13,068][106225] Updated weights for policy 1, policy_version 330975 (0.0006) [2023-12-27 21:36:13,133][106225] Updated weights for policy 1, policy_version 330985 (0.0010) [2023-12-27 21:36:13,311][106226] Updated weights for policy 0, policy_version 330361 (0.0007) [2023-12-27 21:36:13,361][106226] Updated weights for policy 0, policy_version 330371 (0.0005) [2023-12-27 21:36:13,407][106226] Updated weights for policy 0, policy_version 330381 (0.0005) [2023-12-27 21:36:13,790][106225] Updated weights for policy 1, policy_version 330995 (0.0010) [2023-12-27 21:36:13,855][106225] Updated weights for policy 1, policy_version 331005 (0.0010) [2023-12-27 21:36:13,914][106225] Updated weights for policy 1, policy_version 331015 (0.0010) [2023-12-27 21:36:14,031][106226] Updated weights for policy 0, policy_version 330391 (0.0006) [2023-12-27 21:36:14,095][106226] Updated weights for policy 0, policy_version 330401 (0.0007) [2023-12-27 21:36:14,157][106226] Updated weights for policy 0, policy_version 330411 (0.0008) [2023-12-27 21:36:14,587][106225] Updated weights for policy 1, policy_version 331025 (0.0009) [2023-12-27 21:36:14,644][106225] Updated weights for policy 1, policy_version 331035 (0.0010) [2023-12-27 21:36:14,700][106225] Updated weights for policy 1, policy_version 331045 (0.0010) [2023-12-27 21:36:14,757][106225] Updated weights for policy 1, policy_version 331055 (0.0010) [2023-12-27 21:36:14,903][106226] Updated weights for policy 0, policy_version 330421 (0.0008) [2023-12-27 21:36:14,971][106226] Updated weights for policy 0, policy_version 330431 (0.0006) [2023-12-27 21:36:15,040][106226] Updated weights for policy 0, policy_version 330441 (0.0008) [2023-12-27 21:36:15,490][106225] Updated weights for policy 1, policy_version 331065 (0.0010) [2023-12-27 21:36:15,556][106225] Updated weights for policy 1, policy_version 331075 (0.0011) [2023-12-27 21:36:15,607][106225] Updated weights for policy 1, policy_version 331085 (0.0007) [2023-12-27 21:36:15,675][106226] Updated weights for policy 0, policy_version 330451 (0.0009) [2023-12-27 21:36:15,736][106226] Updated weights for policy 0, policy_version 330461 (0.0006) [2023-12-27 21:36:15,789][106226] Updated weights for policy 0, policy_version 330471 (0.0005) [2023-12-27 21:36:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 169410560. Throughput: 0: 9741.2, 1: 10096.6. Samples: 169400632. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:16,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-5.697')] [2023-12-27 21:36:16,230][106225] Updated weights for policy 1, policy_version 331095 (0.0009) [2023-12-27 21:36:16,289][106225] Updated weights for policy 1, policy_version 331105 (0.0010) [2023-12-27 21:36:16,348][106226] Updated weights for policy 0, policy_version 330481 (0.0006) [2023-12-27 21:36:16,349][106225] Updated weights for policy 1, policy_version 331115 (0.0010) [2023-12-27 21:36:16,404][106226] Updated weights for policy 0, policy_version 330491 (0.0010) [2023-12-27 21:36:16,467][106226] Updated weights for policy 0, policy_version 330501 (0.0010) [2023-12-27 21:36:16,527][106226] Updated weights for policy 0, policy_version 330511 (0.0008) [2023-12-27 21:36:17,008][106225] Updated weights for policy 1, policy_version 331125 (0.0008) [2023-12-27 21:36:17,062][106225] Updated weights for policy 1, policy_version 331135 (0.0008) [2023-12-27 21:36:17,116][106225] Updated weights for policy 1, policy_version 331145 (0.0006) [2023-12-27 21:36:17,146][106226] Updated weights for policy 0, policy_version 330521 (0.0007) [2023-12-27 21:36:17,197][106226] Updated weights for policy 0, policy_version 330531 (0.0009) [2023-12-27 21:36:17,256][106226] Updated weights for policy 0, policy_version 330541 (0.0009) [2023-12-27 21:36:17,835][106225] Updated weights for policy 1, policy_version 331155 (0.0007) [2023-12-27 21:36:17,887][106225] Updated weights for policy 1, policy_version 331165 (0.0010) [2023-12-27 21:36:17,922][106226] Updated weights for policy 0, policy_version 330551 (0.0010) [2023-12-27 21:36:17,937][106225] Updated weights for policy 1, policy_version 331175 (0.0010) [2023-12-27 21:36:17,985][106226] Updated weights for policy 0, policy_version 330561 (0.0011) [2023-12-27 21:36:18,048][106226] Updated weights for policy 0, policy_version 330571 (0.0010) [2023-12-27 21:36:18,651][106226] Updated weights for policy 0, policy_version 330581 (0.0010) [2023-12-27 21:36:18,673][106225] Updated weights for policy 1, policy_version 331185 (0.0010) [2023-12-27 21:36:18,710][106226] Updated weights for policy 0, policy_version 330591 (0.0011) [2023-12-27 21:36:18,737][106225] Updated weights for policy 1, policy_version 331195 (0.0007) [2023-12-27 21:36:18,775][106226] Updated weights for policy 0, policy_version 330601 (0.0011) [2023-12-27 21:36:18,804][106225] Updated weights for policy 1, policy_version 331205 (0.0006) [2023-12-27 21:36:18,871][106225] Updated weights for policy 1, policy_version 331215 (0.0010) [2023-12-27 21:36:19,476][106226] Updated weights for policy 0, policy_version 330611 (0.0009) [2023-12-27 21:36:19,526][106225] Updated weights for policy 1, policy_version 331225 (0.0007) [2023-12-27 21:36:19,539][106226] Updated weights for policy 0, policy_version 330621 (0.0011) [2023-12-27 21:36:19,581][106225] Updated weights for policy 1, policy_version 331235 (0.0007) [2023-12-27 21:36:19,601][106226] Updated weights for policy 0, policy_version 330631 (0.0011) [2023-12-27 21:36:19,631][106225] Updated weights for policy 1, policy_version 331245 (0.0007) [2023-12-27 21:36:20,285][106226] Updated weights for policy 0, policy_version 330641 (0.0011) [2023-12-27 21:36:20,333][106226] Updated weights for policy 0, policy_version 330651 (0.0011) [2023-12-27 21:36:20,388][106226] Updated weights for policy 0, policy_version 330661 (0.0011) [2023-12-27 21:36:20,415][106225] Updated weights for policy 1, policy_version 331255 (0.0008) [2023-12-27 21:36:20,446][106226] Updated weights for policy 0, policy_version 330671 (0.0011) [2023-12-27 21:36:20,476][106225] Updated weights for policy 1, policy_version 331265 (0.0007) [2023-12-27 21:36:20,533][106225] Updated weights for policy 1, policy_version 331275 (0.0010) [2023-12-27 21:36:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 169508864. Throughput: 0: 9769.8, 1: 10055.6. Samples: 169522404. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:21,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-5.657')] [2023-12-27 21:36:21,207][106226] Updated weights for policy 0, policy_version 330681 (0.0011) [2023-12-27 21:36:21,275][106226] Updated weights for policy 0, policy_version 330692 (0.0010) [2023-12-27 21:36:21,297][106225] Updated weights for policy 1, policy_version 331285 (0.0011) [2023-12-27 21:36:21,341][106226] Updated weights for policy 0, policy_version 330702 (0.0007) [2023-12-27 21:36:21,355][106225] Updated weights for policy 1, policy_version 331295 (0.0006) [2023-12-27 21:36:21,427][106225] Updated weights for policy 1, policy_version 331305 (0.0009) [2023-12-27 21:36:22,137][106225] Updated weights for policy 1, policy_version 331315 (0.0007) [2023-12-27 21:36:22,144][106226] Updated weights for policy 0, policy_version 330712 (0.0007) [2023-12-27 21:36:22,188][106225] Updated weights for policy 1, policy_version 331325 (0.0007) [2023-12-27 21:36:22,201][106226] Updated weights for policy 0, policy_version 330722 (0.0007) [2023-12-27 21:36:22,243][106225] Updated weights for policy 1, policy_version 331335 (0.0008) [2023-12-27 21:36:22,259][106226] Updated weights for policy 0, policy_version 330732 (0.0009) [2023-12-27 21:36:23,014][106226] Updated weights for policy 0, policy_version 330742 (0.0007) [2023-12-27 21:36:23,020][106225] Updated weights for policy 1, policy_version 331345 (0.0006) [2023-12-27 21:36:23,073][106225] Updated weights for policy 1, policy_version 331355 (0.0007) [2023-12-27 21:36:23,075][106226] Updated weights for policy 0, policy_version 330752 (0.0006) [2023-12-27 21:36:23,135][106226] Updated weights for policy 0, policy_version 330762 (0.0007) [2023-12-27 21:36:23,159][106225] Updated weights for policy 1, policy_version 331365 (0.0006) [2023-12-27 21:36:23,216][106225] Updated weights for policy 1, policy_version 331375 (0.0009) [2023-12-27 21:36:23,795][106226] Updated weights for policy 0, policy_version 330772 (0.0007) [2023-12-27 21:36:23,852][106226] Updated weights for policy 0, policy_version 330782 (0.0006) [2023-12-27 21:36:23,896][106225] Updated weights for policy 1, policy_version 331385 (0.0007) [2023-12-27 21:36:23,908][106226] Updated weights for policy 0, policy_version 330792 (0.0008) [2023-12-27 21:36:23,950][106225] Updated weights for policy 1, policy_version 331395 (0.0006) [2023-12-27 21:36:24,002][106225] Updated weights for policy 1, policy_version 331405 (0.0005) [2023-12-27 21:36:24,567][106226] Updated weights for policy 0, policy_version 330802 (0.0005) [2023-12-27 21:36:24,634][106226] Updated weights for policy 0, policy_version 330812 (0.0005) [2023-12-27 21:36:24,699][106226] Updated weights for policy 0, policy_version 330822 (0.0010) [2023-12-27 21:36:24,747][106225] Updated weights for policy 1, policy_version 331415 (0.0006) [2023-12-27 21:36:24,760][106226] Updated weights for policy 0, policy_version 330832 (0.0009) [2023-12-27 21:36:24,800][106225] Updated weights for policy 1, policy_version 331425 (0.0007) [2023-12-27 21:36:24,849][106225] Updated weights for policy 1, policy_version 331435 (0.0008) [2023-12-27 21:36:25,433][106226] Updated weights for policy 0, policy_version 330842 (0.0011) [2023-12-27 21:36:25,493][106226] Updated weights for policy 0, policy_version 330852 (0.0011) [2023-12-27 21:36:25,546][106226] Updated weights for policy 0, policy_version 330862 (0.0010) [2023-12-27 21:36:25,574][106225] Updated weights for policy 1, policy_version 331445 (0.0009) [2023-12-27 21:36:25,628][106225] Updated weights for policy 1, policy_version 331455 (0.0010) [2023-12-27 21:36:25,671][106225] Updated weights for policy 1, policy_version 331465 (0.0010) [2023-12-27 21:36:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.5, 300 sec: 19883.0). Total num frames: 169607168. Throughput: 0: 9764.3, 1: 10002.3. Samples: 169579152. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:26,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.602')] [2023-12-27 21:36:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000331472_84877312.pth... [2023-12-27 21:36:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000330864_84729856.pth... [2023-12-27 21:36:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000329712_84434944.pth [2023-12-27 21:36:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000330320_84582400.pth [2023-12-27 21:36:26,281][106226] Updated weights for policy 0, policy_version 330872 (0.0007) [2023-12-27 21:36:26,338][106226] Updated weights for policy 0, policy_version 330882 (0.0007) [2023-12-27 21:36:26,339][106225] Updated weights for policy 1, policy_version 331475 (0.0010) [2023-12-27 21:36:26,398][106226] Updated weights for policy 0, policy_version 330892 (0.0005) [2023-12-27 21:36:26,400][106225] Updated weights for policy 1, policy_version 331485 (0.0007) [2023-12-27 21:36:26,461][106225] Updated weights for policy 1, policy_version 331495 (0.0005) [2023-12-27 21:36:26,996][106226] Updated weights for policy 0, policy_version 330902 (0.0005) [2023-12-27 21:36:27,032][106225] Updated weights for policy 1, policy_version 331505 (0.0005) [2023-12-27 21:36:27,058][106226] Updated weights for policy 0, policy_version 330912 (0.0008) [2023-12-27 21:36:27,089][106225] Updated weights for policy 1, policy_version 331515 (0.0005) [2023-12-27 21:36:27,103][106226] Updated weights for policy 0, policy_version 330922 (0.0009) [2023-12-27 21:36:27,142][106225] Updated weights for policy 1, policy_version 331525 (0.0005) [2023-12-27 21:36:27,199][106225] Updated weights for policy 1, policy_version 331535 (0.0005) [2023-12-27 21:36:27,734][106225] Updated weights for policy 1, policy_version 331545 (0.0006) [2023-12-27 21:36:27,783][106225] Updated weights for policy 1, policy_version 331555 (0.0005) [2023-12-27 21:36:27,839][106226] Updated weights for policy 0, policy_version 330932 (0.0007) [2023-12-27 21:36:27,841][106225] Updated weights for policy 1, policy_version 331565 (0.0009) [2023-12-27 21:36:27,891][106226] Updated weights for policy 0, policy_version 330942 (0.0007) [2023-12-27 21:36:27,937][106226] Updated weights for policy 0, policy_version 330952 (0.0008) [2023-12-27 21:36:28,519][106225] Updated weights for policy 1, policy_version 331575 (0.0010) [2023-12-27 21:36:28,568][106225] Updated weights for policy 1, policy_version 331585 (0.0008) [2023-12-27 21:36:28,630][106225] Updated weights for policy 1, policy_version 331595 (0.0008) [2023-12-27 21:36:28,658][106226] Updated weights for policy 0, policy_version 330962 (0.0008) [2023-12-27 21:36:28,720][106226] Updated weights for policy 0, policy_version 330972 (0.0010) [2023-12-27 21:36:28,776][106226] Updated weights for policy 0, policy_version 330982 (0.0008) [2023-12-27 21:36:28,834][106226] Updated weights for policy 0, policy_version 330992 (0.0006) [2023-12-27 21:36:29,304][106225] Updated weights for policy 1, policy_version 331605 (0.0010) [2023-12-27 21:36:29,372][106225] Updated weights for policy 1, policy_version 331615 (0.0010) [2023-12-27 21:36:29,431][106225] Updated weights for policy 1, policy_version 331625 (0.0007) [2023-12-27 21:36:29,498][106226] Updated weights for policy 0, policy_version 331002 (0.0011) [2023-12-27 21:36:29,548][106226] Updated weights for policy 0, policy_version 331012 (0.0010) [2023-12-27 21:36:29,609][106226] Updated weights for policy 0, policy_version 331022 (0.0005) [2023-12-27 21:36:30,097][106225] Updated weights for policy 1, policy_version 331635 (0.0006) [2023-12-27 21:36:30,157][106225] Updated weights for policy 1, policy_version 331645 (0.0005) [2023-12-27 21:36:30,216][106225] Updated weights for policy 1, policy_version 331655 (0.0006) [2023-12-27 21:36:30,286][106226] Updated weights for policy 0, policy_version 331032 (0.0006) [2023-12-27 21:36:30,356][106226] Updated weights for policy 0, policy_version 331042 (0.0006) [2023-12-27 21:36:30,418][106226] Updated weights for policy 0, policy_version 331052 (0.0006) [2023-12-27 21:36:30,810][106225] Updated weights for policy 1, policy_version 331665 (0.0005) [2023-12-27 21:36:30,866][106225] Updated weights for policy 1, policy_version 331675 (0.0005) [2023-12-27 21:36:30,931][106225] Updated weights for policy 1, policy_version 331685 (0.0005) [2023-12-27 21:36:30,957][106226] Updated weights for policy 0, policy_version 331062 (0.0007) [2023-12-27 21:36:30,981][106225] Updated weights for policy 1, policy_version 331695 (0.0006) [2023-12-27 21:36:31,021][106226] Updated weights for policy 0, policy_version 331072 (0.0009) [2023-12-27 21:36:31,089][106226] Updated weights for policy 0, policy_version 331082 (0.0007) [2023-12-27 21:36:31,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 169721856. Throughput: 0: 9882.4, 1: 10043.5. Samples: 169703260. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:31,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.668')] [2023-12-27 21:36:31,659][106225] Updated weights for policy 1, policy_version 331705 (0.0007) [2023-12-27 21:36:31,727][106225] Updated weights for policy 1, policy_version 331715 (0.0008) [2023-12-27 21:36:31,783][106225] Updated weights for policy 1, policy_version 331725 (0.0009) [2023-12-27 21:36:31,809][106226] Updated weights for policy 0, policy_version 331092 (0.0007) [2023-12-27 21:36:31,873][106226] Updated weights for policy 0, policy_version 331102 (0.0010) [2023-12-27 21:36:31,939][106226] Updated weights for policy 0, policy_version 331112 (0.0010) [2023-12-27 21:36:32,439][106225] Updated weights for policy 1, policy_version 331735 (0.0006) [2023-12-27 21:36:32,487][106225] Updated weights for policy 1, policy_version 331745 (0.0006) [2023-12-27 21:36:32,549][106225] Updated weights for policy 1, policy_version 331755 (0.0006) [2023-12-27 21:36:32,627][106226] Updated weights for policy 0, policy_version 331122 (0.0009) [2023-12-27 21:36:32,690][106226] Updated weights for policy 0, policy_version 331132 (0.0006) [2023-12-27 21:36:32,753][106226] Updated weights for policy 0, policy_version 331142 (0.0009) [2023-12-27 21:36:32,818][106226] Updated weights for policy 0, policy_version 331152 (0.0008) [2023-12-27 21:36:33,214][106225] Updated weights for policy 1, policy_version 331765 (0.0007) [2023-12-27 21:36:33,271][106225] Updated weights for policy 1, policy_version 331775 (0.0008) [2023-12-27 21:36:33,324][106225] Updated weights for policy 1, policy_version 331785 (0.0008) [2023-12-27 21:36:33,417][106226] Updated weights for policy 0, policy_version 331162 (0.0007) [2023-12-27 21:36:33,471][106226] Updated weights for policy 0, policy_version 331172 (0.0010) [2023-12-27 21:36:33,522][106226] Updated weights for policy 0, policy_version 331182 (0.0010) [2023-12-27 21:36:34,067][106225] Updated weights for policy 1, policy_version 331795 (0.0010) [2023-12-27 21:36:34,130][106225] Updated weights for policy 1, policy_version 331805 (0.0008) [2023-12-27 21:36:34,197][106225] Updated weights for policy 1, policy_version 331815 (0.0008) [2023-12-27 21:36:34,238][106226] Updated weights for policy 0, policy_version 331192 (0.0010) [2023-12-27 21:36:34,297][106226] Updated weights for policy 0, policy_version 331202 (0.0009) [2023-12-27 21:36:34,358][106226] Updated weights for policy 0, policy_version 331212 (0.0011) [2023-12-27 21:36:34,933][106225] Updated weights for policy 1, policy_version 331825 (0.0006) [2023-12-27 21:36:34,978][106225] Updated weights for policy 1, policy_version 331835 (0.0005) [2023-12-27 21:36:35,030][106225] Updated weights for policy 1, policy_version 331845 (0.0009) [2023-12-27 21:36:35,057][106226] Updated weights for policy 0, policy_version 331222 (0.0008) [2023-12-27 21:36:35,075][106225] Updated weights for policy 1, policy_version 331855 (0.0008) [2023-12-27 21:36:35,106][106226] Updated weights for policy 0, policy_version 331232 (0.0005) [2023-12-27 21:36:35,152][106226] Updated weights for policy 0, policy_version 331242 (0.0005) [2023-12-27 21:36:35,781][106226] Updated weights for policy 0, policy_version 331252 (0.0007) [2023-12-27 21:36:35,838][106226] Updated weights for policy 0, policy_version 331262 (0.0008) [2023-12-27 21:36:35,842][106225] Updated weights for policy 1, policy_version 331865 (0.0005) [2023-12-27 21:36:35,888][106226] Updated weights for policy 0, policy_version 331272 (0.0006) [2023-12-27 21:36:35,907][106225] Updated weights for policy 1, policy_version 331875 (0.0006) [2023-12-27 21:36:35,970][106225] Updated weights for policy 1, policy_version 331885 (0.0007) [2023-12-27 21:36:36,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 169820160. Throughput: 0: 10009.7, 1: 10004.1. Samples: 169825740. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:36,176][105115] Avg episode reward: [(0, '-4.780'), (1, '-5.893')] [2023-12-27 21:36:36,554][106225] Updated weights for policy 1, policy_version 331895 (0.0007) [2023-12-27 21:36:36,605][106226] Updated weights for policy 0, policy_version 331282 (0.0008) [2023-12-27 21:36:36,622][106225] Updated weights for policy 1, policy_version 331905 (0.0007) [2023-12-27 21:36:36,666][106226] Updated weights for policy 0, policy_version 331292 (0.0009) [2023-12-27 21:36:36,684][106225] Updated weights for policy 1, policy_version 331915 (0.0008) [2023-12-27 21:36:36,726][106226] Updated weights for policy 0, policy_version 331302 (0.0005) [2023-12-27 21:36:36,794][106226] Updated weights for policy 0, policy_version 331312 (0.0006) [2023-12-27 21:36:37,383][106225] Updated weights for policy 1, policy_version 331925 (0.0011) [2023-12-27 21:36:37,437][106226] Updated weights for policy 0, policy_version 331322 (0.0006) [2023-12-27 21:36:37,444][106225] Updated weights for policy 1, policy_version 331935 (0.0010) [2023-12-27 21:36:37,500][106226] Updated weights for policy 0, policy_version 331332 (0.0009) [2023-12-27 21:36:37,503][106225] Updated weights for policy 1, policy_version 331945 (0.0010) [2023-12-27 21:36:37,548][106226] Updated weights for policy 0, policy_version 331342 (0.0007) [2023-12-27 21:36:38,221][106225] Updated weights for policy 1, policy_version 331955 (0.0011) [2023-12-27 21:36:38,263][106226] Updated weights for policy 0, policy_version 331352 (0.0010) [2023-12-27 21:36:38,275][106225] Updated weights for policy 1, policy_version 331965 (0.0010) [2023-12-27 21:36:38,328][106226] Updated weights for policy 0, policy_version 331362 (0.0007) [2023-12-27 21:36:38,346][106225] Updated weights for policy 1, policy_version 331975 (0.0010) [2023-12-27 21:36:38,399][106226] Updated weights for policy 0, policy_version 331372 (0.0007) [2023-12-27 21:36:39,050][106225] Updated weights for policy 1, policy_version 331985 (0.0008) [2023-12-27 21:36:39,085][106226] Updated weights for policy 0, policy_version 331382 (0.0006) [2023-12-27 21:36:39,112][106225] Updated weights for policy 1, policy_version 331995 (0.0008) [2023-12-27 21:36:39,143][106226] Updated weights for policy 0, policy_version 331392 (0.0007) [2023-12-27 21:36:39,177][106225] Updated weights for policy 1, policy_version 332005 (0.0010) [2023-12-27 21:36:39,197][106226] Updated weights for policy 0, policy_version 331402 (0.0010) [2023-12-27 21:36:39,229][106225] Updated weights for policy 1, policy_version 332015 (0.0008) [2023-12-27 21:36:39,941][106225] Updated weights for policy 1, policy_version 332025 (0.0009) [2023-12-27 21:36:40,001][106225] Updated weights for policy 1, policy_version 332035 (0.0008) [2023-12-27 21:36:40,019][106226] Updated weights for policy 0, policy_version 331412 (0.0007) [2023-12-27 21:36:40,060][106225] Updated weights for policy 1, policy_version 332045 (0.0009) [2023-12-27 21:36:40,089][106226] Updated weights for policy 0, policy_version 331422 (0.0007) [2023-12-27 21:36:40,151][106226] Updated weights for policy 0, policy_version 331432 (0.0008) [2023-12-27 21:36:40,803][106225] Updated weights for policy 1, policy_version 332055 (0.0009) [2023-12-27 21:36:40,850][106225] Updated weights for policy 1, policy_version 332065 (0.0010) [2023-12-27 21:36:40,866][106226] Updated weights for policy 0, policy_version 331442 (0.0009) [2023-12-27 21:36:40,900][106225] Updated weights for policy 1, policy_version 332075 (0.0010) [2023-12-27 21:36:40,924][106226] Updated weights for policy 0, policy_version 331452 (0.0008) [2023-12-27 21:36:40,976][106226] Updated weights for policy 0, policy_version 331462 (0.0005) [2023-12-27 21:36:41,032][106226] Updated weights for policy 0, policy_version 331472 (0.0006) [2023-12-27 21:36:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 169918464. Throughput: 0: 10048.5, 1: 10022.6. Samples: 169885696. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:41,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.616')] [2023-12-27 21:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000332080_85032960.pth... [2023-12-27 21:36:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000331472_84885504.pth... [2023-12-27 21:36:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000330288_84582400.pth [2023-12-27 21:36:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000330896_84729856.pth [2023-12-27 21:36:41,671][106225] Updated weights for policy 1, policy_version 332085 (0.0009) [2023-12-27 21:36:41,737][106225] Updated weights for policy 1, policy_version 332095 (0.0008) [2023-12-27 21:36:41,806][106225] Updated weights for policy 1, policy_version 332105 (0.0006) [2023-12-27 21:36:41,834][106226] Updated weights for policy 0, policy_version 331482 (0.0007) [2023-12-27 21:36:41,907][106226] Updated weights for policy 0, policy_version 331492 (0.0009) [2023-12-27 21:36:41,968][106226] Updated weights for policy 0, policy_version 331502 (0.0008) [2023-12-27 21:36:42,554][106225] Updated weights for policy 1, policy_version 332115 (0.0008) [2023-12-27 21:36:42,616][106225] Updated weights for policy 1, policy_version 332125 (0.0009) [2023-12-27 21:36:42,675][106225] Updated weights for policy 1, policy_version 332135 (0.0006) [2023-12-27 21:36:42,701][106226] Updated weights for policy 0, policy_version 331512 (0.0009) [2023-12-27 21:36:42,762][106226] Updated weights for policy 0, policy_version 331522 (0.0011) [2023-12-27 21:36:42,810][106226] Updated weights for policy 0, policy_version 331532 (0.0007) [2023-12-27 21:36:43,341][106225] Updated weights for policy 1, policy_version 332145 (0.0006) [2023-12-27 21:36:43,376][106226] Updated weights for policy 0, policy_version 331542 (0.0005) [2023-12-27 21:36:43,404][106225] Updated weights for policy 1, policy_version 332155 (0.0006) [2023-12-27 21:36:43,440][106226] Updated weights for policy 0, policy_version 331552 (0.0005) [2023-12-27 21:36:43,472][106225] Updated weights for policy 1, policy_version 332165 (0.0006) [2023-12-27 21:36:43,512][106226] Updated weights for policy 0, policy_version 331562 (0.0005) [2023-12-27 21:36:43,536][106225] Updated weights for policy 1, policy_version 332175 (0.0008) [2023-12-27 21:36:44,098][106226] Updated weights for policy 0, policy_version 331572 (0.0005) [2023-12-27 21:36:44,099][106225] Updated weights for policy 1, policy_version 332185 (0.0010) [2023-12-27 21:36:44,155][106226] Updated weights for policy 0, policy_version 331582 (0.0007) [2023-12-27 21:36:44,165][106225] Updated weights for policy 1, policy_version 332195 (0.0010) [2023-12-27 21:36:44,211][106226] Updated weights for policy 0, policy_version 331592 (0.0006) [2023-12-27 21:36:44,218][106225] Updated weights for policy 1, policy_version 332205 (0.0010) [2023-12-27 21:36:44,730][106226] Updated weights for policy 0, policy_version 331602 (0.0005) [2023-12-27 21:36:44,792][106226] Updated weights for policy 0, policy_version 331612 (0.0009) [2023-12-27 21:36:44,850][106226] Updated weights for policy 0, policy_version 331622 (0.0011) [2023-12-27 21:36:44,913][106226] Updated weights for policy 0, policy_version 331632 (0.0011) [2023-12-27 21:36:44,931][106225] Updated weights for policy 1, policy_version 332215 (0.0009) [2023-12-27 21:36:44,998][106225] Updated weights for policy 1, policy_version 332225 (0.0008) [2023-12-27 21:36:45,057][106225] Updated weights for policy 1, policy_version 332235 (0.0008) [2023-12-27 21:36:45,644][106226] Updated weights for policy 0, policy_version 331642 (0.0005) [2023-12-27 21:36:45,702][106226] Updated weights for policy 0, policy_version 331652 (0.0005) [2023-12-27 21:36:45,755][106226] Updated weights for policy 0, policy_version 331662 (0.0005) [2023-12-27 21:36:45,773][106225] Updated weights for policy 1, policy_version 332245 (0.0008) [2023-12-27 21:36:45,844][106225] Updated weights for policy 1, policy_version 332255 (0.0010) [2023-12-27 21:36:45,907][106225] Updated weights for policy 1, policy_version 332265 (0.0009) [2023-12-27 21:36:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 170016768. Throughput: 0: 10051.8, 1: 9944.8. Samples: 170005480. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:46,176][105115] Avg episode reward: [(0, '-5.043'), (1, '-5.713')] [2023-12-27 21:36:46,299][106226] Updated weights for policy 0, policy_version 331672 (0.0010) [2023-12-27 21:36:46,353][106226] Updated weights for policy 0, policy_version 331682 (0.0011) [2023-12-27 21:36:46,409][106226] Updated weights for policy 0, policy_version 331692 (0.0010) [2023-12-27 21:36:46,527][106225] Updated weights for policy 1, policy_version 332275 (0.0009) [2023-12-27 21:36:46,581][106225] Updated weights for policy 1, policy_version 332285 (0.0008) [2023-12-27 21:36:46,645][106225] Updated weights for policy 1, policy_version 332295 (0.0008) [2023-12-27 21:36:47,096][106226] Updated weights for policy 0, policy_version 331702 (0.0007) [2023-12-27 21:36:47,157][106226] Updated weights for policy 0, policy_version 331712 (0.0005) [2023-12-27 21:36:47,225][106226] Updated weights for policy 0, policy_version 331722 (0.0005) [2023-12-27 21:36:47,339][106225] Updated weights for policy 1, policy_version 332305 (0.0008) [2023-12-27 21:36:47,396][106225] Updated weights for policy 1, policy_version 332315 (0.0008) [2023-12-27 21:36:47,448][106225] Updated weights for policy 1, policy_version 332325 (0.0008) [2023-12-27 21:36:47,502][106225] Updated weights for policy 1, policy_version 332335 (0.0006) [2023-12-27 21:36:47,805][106226] Updated weights for policy 0, policy_version 331732 (0.0006) [2023-12-27 21:36:47,861][106226] Updated weights for policy 0, policy_version 331742 (0.0006) [2023-12-27 21:36:47,916][106226] Updated weights for policy 0, policy_version 331752 (0.0005) [2023-12-27 21:36:48,110][106225] Updated weights for policy 1, policy_version 332345 (0.0005) [2023-12-27 21:36:48,161][106225] Updated weights for policy 1, policy_version 332355 (0.0005) [2023-12-27 21:36:48,207][106225] Updated weights for policy 1, policy_version 332365 (0.0005) [2023-12-27 21:36:48,535][106226] Updated weights for policy 0, policy_version 331762 (0.0005) [2023-12-27 21:36:48,597][106226] Updated weights for policy 0, policy_version 331772 (0.0005) [2023-12-27 21:36:48,656][106226] Updated weights for policy 0, policy_version 331782 (0.0005) [2023-12-27 21:36:48,725][106226] Updated weights for policy 0, policy_version 331792 (0.0007) [2023-12-27 21:36:48,841][106225] Updated weights for policy 1, policy_version 332375 (0.0008) [2023-12-27 21:36:48,896][106225] Updated weights for policy 1, policy_version 332385 (0.0007) [2023-12-27 21:36:48,959][106225] Updated weights for policy 1, policy_version 332395 (0.0006) [2023-12-27 21:36:49,444][106226] Updated weights for policy 0, policy_version 331802 (0.0008) [2023-12-27 21:36:49,503][106226] Updated weights for policy 0, policy_version 331812 (0.0009) [2023-12-27 21:36:49,563][106226] Updated weights for policy 0, policy_version 331822 (0.0009) [2023-12-27 21:36:49,643][106225] Updated weights for policy 1, policy_version 332405 (0.0007) [2023-12-27 21:36:49,698][106225] Updated weights for policy 1, policy_version 332415 (0.0005) [2023-12-27 21:36:49,750][106225] Updated weights for policy 1, policy_version 332425 (0.0005) [2023-12-27 21:36:50,299][106226] Updated weights for policy 0, policy_version 331832 (0.0011) [2023-12-27 21:36:50,370][106226] Updated weights for policy 0, policy_version 331842 (0.0006) [2023-12-27 21:36:50,430][106226] Updated weights for policy 0, policy_version 331852 (0.0009) [2023-12-27 21:36:50,438][106225] Updated weights for policy 1, policy_version 332435 (0.0008) [2023-12-27 21:36:50,495][106225] Updated weights for policy 1, policy_version 332445 (0.0008) [2023-12-27 21:36:50,546][106225] Updated weights for policy 1, policy_version 332455 (0.0008) [2023-12-27 21:36:51,067][106226] Updated weights for policy 0, policy_version 331862 (0.0010) [2023-12-27 21:36:51,135][106226] Updated weights for policy 0, policy_version 331872 (0.0009) [2023-12-27 21:36:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 170115072. Throughput: 0: 10123.9, 1: 9970.8. Samples: 170129452. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 21:36:51,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.725')] [2023-12-27 21:36:51,199][106226] Updated weights for policy 0, policy_version 331882 (0.0008) [2023-12-27 21:36:51,324][106225] Updated weights for policy 1, policy_version 332465 (0.0008) [2023-12-27 21:36:51,379][106225] Updated weights for policy 1, policy_version 332475 (0.0008) [2023-12-27 21:36:51,432][106225] Updated weights for policy 1, policy_version 332485 (0.0009) [2023-12-27 21:36:51,485][106225] Updated weights for policy 1, policy_version 332495 (0.0009) [2023-12-27 21:36:51,944][106226] Updated weights for policy 0, policy_version 331892 (0.0009) [2023-12-27 21:36:51,996][106226] Updated weights for policy 0, policy_version 331902 (0.0009) [2023-12-27 21:36:52,059][106226] Updated weights for policy 0, policy_version 331912 (0.0009) [2023-12-27 21:36:52,275][106225] Updated weights for policy 1, policy_version 332505 (0.0006) [2023-12-27 21:36:52,336][106225] Updated weights for policy 1, policy_version 332515 (0.0007) [2023-12-27 21:36:52,401][106225] Updated weights for policy 1, policy_version 332525 (0.0009) [2023-12-27 21:36:52,846][106226] Updated weights for policy 0, policy_version 331922 (0.0008) [2023-12-27 21:36:52,916][106226] Updated weights for policy 0, policy_version 331932 (0.0006) [2023-12-27 21:36:52,969][106226] Updated weights for policy 0, policy_version 331942 (0.0009) [2023-12-27 21:36:53,024][106226] Updated weights for policy 0, policy_version 331952 (0.0006) [2023-12-27 21:36:53,045][106225] Updated weights for policy 1, policy_version 332535 (0.0009) [2023-12-27 21:36:53,102][106225] Updated weights for policy 1, policy_version 332545 (0.0010) [2023-12-27 21:36:53,155][106225] Updated weights for policy 1, policy_version 332555 (0.0010) [2023-12-27 21:36:53,583][106226] Updated weights for policy 0, policy_version 331962 (0.0005) [2023-12-27 21:36:53,632][106226] Updated weights for policy 0, policy_version 331972 (0.0005) [2023-12-27 21:36:53,677][106226] Updated weights for policy 0, policy_version 331982 (0.0005) [2023-12-27 21:36:53,927][106225] Updated weights for policy 1, policy_version 332565 (0.0009) [2023-12-27 21:36:53,989][106225] Updated weights for policy 1, policy_version 332575 (0.0007) [2023-12-27 21:36:54,052][106225] Updated weights for policy 1, policy_version 332585 (0.0007) [2023-12-27 21:36:54,326][106226] Updated weights for policy 0, policy_version 331992 (0.0009) [2023-12-27 21:36:54,393][106226] Updated weights for policy 0, policy_version 332002 (0.0011) [2023-12-27 21:36:54,461][106226] Updated weights for policy 0, policy_version 332012 (0.0011) [2023-12-27 21:36:54,797][106225] Updated weights for policy 1, policy_version 332595 (0.0009) [2023-12-27 21:36:54,851][106225] Updated weights for policy 1, policy_version 332605 (0.0009) [2023-12-27 21:36:54,899][106225] Updated weights for policy 1, policy_version 332615 (0.0008) [2023-12-27 21:36:55,056][106226] Updated weights for policy 0, policy_version 332022 (0.0010) [2023-12-27 21:36:55,113][106226] Updated weights for policy 0, policy_version 332032 (0.0009) [2023-12-27 21:36:55,174][106226] Updated weights for policy 0, policy_version 332042 (0.0007) [2023-12-27 21:36:55,616][106225] Updated weights for policy 1, policy_version 332625 (0.0008) [2023-12-27 21:36:55,677][106225] Updated weights for policy 1, policy_version 332635 (0.0008) [2023-12-27 21:36:55,730][106225] Updated weights for policy 1, policy_version 332645 (0.0008) [2023-12-27 21:36:55,775][106225] Updated weights for policy 1, policy_version 332655 (0.0007) [2023-12-27 21:36:55,891][106226] Updated weights for policy 0, policy_version 332052 (0.0011) [2023-12-27 21:36:55,950][106226] Updated weights for policy 0, policy_version 332062 (0.0009) [2023-12-27 21:36:55,999][106226] Updated weights for policy 0, policy_version 332072 (0.0008) [2023-12-27 21:36:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 170221568. Throughput: 0: 10124.3, 1: 9957.8. Samples: 170188776. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:36:56,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.643')] [2023-12-27 21:36:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000332656_85180416.pth... [2023-12-27 21:36:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000332080_85041152.pth... [2023-12-27 21:36:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000330864_84729856.pth [2023-12-27 21:36:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000331472_84877312.pth [2023-12-27 21:36:56,502][106225] Updated weights for policy 1, policy_version 332665 (0.0008) [2023-12-27 21:36:56,562][106225] Updated weights for policy 1, policy_version 332675 (0.0008) [2023-12-27 21:36:56,605][106226] Updated weights for policy 0, policy_version 332082 (0.0005) [2023-12-27 21:36:56,624][106225] Updated weights for policy 1, policy_version 332685 (0.0008) [2023-12-27 21:36:56,656][106226] Updated weights for policy 0, policy_version 332092 (0.0005) [2023-12-27 21:36:56,707][106226] Updated weights for policy 0, policy_version 332102 (0.0005) [2023-12-27 21:36:56,760][106226] Updated weights for policy 0, policy_version 332112 (0.0005) [2023-12-27 21:36:57,322][106225] Updated weights for policy 1, policy_version 332695 (0.0007) [2023-12-27 21:36:57,365][106226] Updated weights for policy 0, policy_version 332122 (0.0006) [2023-12-27 21:36:57,378][106225] Updated weights for policy 1, policy_version 332705 (0.0006) [2023-12-27 21:36:57,424][106226] Updated weights for policy 0, policy_version 332132 (0.0006) [2023-12-27 21:36:57,437][106225] Updated weights for policy 1, policy_version 332715 (0.0005) [2023-12-27 21:36:57,476][106226] Updated weights for policy 0, policy_version 332142 (0.0008) [2023-12-27 21:36:57,970][106225] Updated weights for policy 1, policy_version 332725 (0.0007) [2023-12-27 21:36:58,024][106225] Updated weights for policy 1, policy_version 332735 (0.0008) [2023-12-27 21:36:58,032][106226] Updated weights for policy 0, policy_version 332152 (0.0008) [2023-12-27 21:36:58,083][106225] Updated weights for policy 1, policy_version 332745 (0.0006) [2023-12-27 21:36:58,090][106226] Updated weights for policy 0, policy_version 332162 (0.0007) [2023-12-27 21:36:58,152][106226] Updated weights for policy 0, policy_version 332172 (0.0009) [2023-12-27 21:36:58,857][106225] Updated weights for policy 1, policy_version 332755 (0.0006) [2023-12-27 21:36:58,922][106225] Updated weights for policy 1, policy_version 332765 (0.0009) [2023-12-27 21:36:58,976][106226] Updated weights for policy 0, policy_version 332182 (0.0008) [2023-12-27 21:36:58,996][106225] Updated weights for policy 1, policy_version 332775 (0.0008) [2023-12-27 21:36:59,037][106226] Updated weights for policy 0, policy_version 332192 (0.0006) [2023-12-27 21:36:59,100][106226] Updated weights for policy 0, policy_version 332202 (0.0007) [2023-12-27 21:36:59,778][106225] Updated weights for policy 1, policy_version 332785 (0.0007) [2023-12-27 21:36:59,829][106225] Updated weights for policy 1, policy_version 332795 (0.0008) [2023-12-27 21:36:59,888][106226] Updated weights for policy 0, policy_version 332212 (0.0008) [2023-12-27 21:36:59,893][106225] Updated weights for policy 1, policy_version 332805 (0.0007) [2023-12-27 21:36:59,954][106226] Updated weights for policy 0, policy_version 332222 (0.0011) [2023-12-27 21:36:59,957][106225] Updated weights for policy 1, policy_version 332815 (0.0007) [2023-12-27 21:37:00,018][106226] Updated weights for policy 0, policy_version 332232 (0.0011) [2023-12-27 21:37:00,613][106226] Updated weights for policy 0, policy_version 332242 (0.0009) [2023-12-27 21:37:00,643][106225] Updated weights for policy 1, policy_version 332825 (0.0008) [2023-12-27 21:37:00,667][106226] Updated weights for policy 0, policy_version 332252 (0.0007) [2023-12-27 21:37:00,692][106225] Updated weights for policy 1, policy_version 332835 (0.0007) [2023-12-27 21:37:00,727][106226] Updated weights for policy 0, policy_version 332262 (0.0010) [2023-12-27 21:37:00,755][106225] Updated weights for policy 1, policy_version 332845 (0.0005) [2023-12-27 21:37:00,777][106226] Updated weights for policy 0, policy_version 332272 (0.0010) [2023-12-27 21:37:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 170319872. Throughput: 0: 10211.5, 1: 9973.1. Samples: 170308936. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:01,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-5.522')] [2023-12-27 21:37:01,443][106226] Updated weights for policy 0, policy_version 332282 (0.0008) [2023-12-27 21:37:01,497][106226] Updated weights for policy 0, policy_version 332292 (0.0008) [2023-12-27 21:37:01,543][106225] Updated weights for policy 1, policy_version 332855 (0.0006) [2023-12-27 21:37:01,552][106226] Updated weights for policy 0, policy_version 332302 (0.0008) [2023-12-27 21:37:01,606][106225] Updated weights for policy 1, policy_version 332865 (0.0007) [2023-12-27 21:37:01,672][106225] Updated weights for policy 1, policy_version 332875 (0.0009) [2023-12-27 21:37:02,227][106226] Updated weights for policy 0, policy_version 332312 (0.0008) [2023-12-27 21:37:02,293][106226] Updated weights for policy 0, policy_version 332322 (0.0006) [2023-12-27 21:37:02,362][106226] Updated weights for policy 0, policy_version 332332 (0.0006) [2023-12-27 21:37:02,439][106225] Updated weights for policy 1, policy_version 332885 (0.0009) [2023-12-27 21:37:02,501][106225] Updated weights for policy 1, policy_version 332895 (0.0008) [2023-12-27 21:37:02,566][106225] Updated weights for policy 1, policy_version 332905 (0.0008) [2023-12-27 21:37:02,951][106226] Updated weights for policy 0, policy_version 332342 (0.0006) [2023-12-27 21:37:03,001][106226] Updated weights for policy 0, policy_version 332352 (0.0007) [2023-12-27 21:37:03,054][106226] Updated weights for policy 0, policy_version 332362 (0.0008) [2023-12-27 21:37:03,283][106225] Updated weights for policy 1, policy_version 332915 (0.0009) [2023-12-27 21:37:03,333][106225] Updated weights for policy 1, policy_version 332925 (0.0008) [2023-12-27 21:37:03,388][106225] Updated weights for policy 1, policy_version 332935 (0.0007) [2023-12-27 21:37:03,809][106226] Updated weights for policy 0, policy_version 332372 (0.0008) [2023-12-27 21:37:03,869][106226] Updated weights for policy 0, policy_version 332382 (0.0008) [2023-12-27 21:37:03,934][106226] Updated weights for policy 0, policy_version 332392 (0.0008) [2023-12-27 21:37:04,055][106225] Updated weights for policy 1, policy_version 332945 (0.0006) [2023-12-27 21:37:04,118][106225] Updated weights for policy 1, policy_version 332955 (0.0006) [2023-12-27 21:37:04,199][106225] Updated weights for policy 1, policy_version 332965 (0.0006) [2023-12-27 21:37:04,261][106225] Updated weights for policy 1, policy_version 332975 (0.0007) [2023-12-27 21:37:04,727][106226] Updated weights for policy 0, policy_version 332402 (0.0008) [2023-12-27 21:37:04,790][106226] Updated weights for policy 0, policy_version 332412 (0.0008) [2023-12-27 21:37:04,848][106226] Updated weights for policy 0, policy_version 332422 (0.0008) [2023-12-27 21:37:04,907][106226] Updated weights for policy 0, policy_version 332432 (0.0008) [2023-12-27 21:37:04,922][106225] Updated weights for policy 1, policy_version 332985 (0.0008) [2023-12-27 21:37:04,975][106225] Updated weights for policy 1, policy_version 332995 (0.0007) [2023-12-27 21:37:05,028][106225] Updated weights for policy 1, policy_version 333005 (0.0009) [2023-12-27 21:37:05,603][106226] Updated weights for policy 0, policy_version 332442 (0.0008) [2023-12-27 21:37:05,667][106226] Updated weights for policy 0, policy_version 332452 (0.0006) [2023-12-27 21:37:05,729][106226] Updated weights for policy 0, policy_version 332462 (0.0005) [2023-12-27 21:37:05,741][106225] Updated weights for policy 1, policy_version 333015 (0.0009) [2023-12-27 21:37:05,798][106225] Updated weights for policy 1, policy_version 333025 (0.0010) [2023-12-27 21:37:05,853][106225] Updated weights for policy 1, policy_version 333035 (0.0009) [2023-12-27 21:37:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 170418176. Throughput: 0: 10185.7, 1: 9951.9. Samples: 170428596. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:06,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-5.520')] [2023-12-27 21:37:06,356][106226] Updated weights for policy 0, policy_version 332472 (0.0007) [2023-12-27 21:37:06,418][106226] Updated weights for policy 0, policy_version 332482 (0.0008) [2023-12-27 21:37:06,482][106226] Updated weights for policy 0, policy_version 332492 (0.0006) [2023-12-27 21:37:06,579][106225] Updated weights for policy 1, policy_version 333045 (0.0010) [2023-12-27 21:37:06,637][106225] Updated weights for policy 1, policy_version 333055 (0.0011) [2023-12-27 21:37:06,692][106225] Updated weights for policy 1, policy_version 333065 (0.0010) [2023-12-27 21:37:07,138][106226] Updated weights for policy 0, policy_version 332502 (0.0008) [2023-12-27 21:37:07,205][106226] Updated weights for policy 0, policy_version 332512 (0.0010) [2023-12-27 21:37:07,272][106226] Updated weights for policy 0, policy_version 332522 (0.0010) [2023-12-27 21:37:07,410][106225] Updated weights for policy 1, policy_version 333075 (0.0009) [2023-12-27 21:37:07,474][106225] Updated weights for policy 1, policy_version 333085 (0.0010) [2023-12-27 21:37:07,526][106225] Updated weights for policy 1, policy_version 333095 (0.0009) [2023-12-27 21:37:07,938][106226] Updated weights for policy 0, policy_version 332532 (0.0007) [2023-12-27 21:37:08,000][106226] Updated weights for policy 0, policy_version 332542 (0.0006) [2023-12-27 21:37:08,062][106226] Updated weights for policy 0, policy_version 332552 (0.0008) [2023-12-27 21:37:08,316][106225] Updated weights for policy 1, policy_version 333105 (0.0009) [2023-12-27 21:37:08,383][106225] Updated weights for policy 1, policy_version 333115 (0.0009) [2023-12-27 21:37:08,434][106225] Updated weights for policy 1, policy_version 333125 (0.0008) [2023-12-27 21:37:08,485][106225] Updated weights for policy 1, policy_version 333135 (0.0008) [2023-12-27 21:37:08,700][106226] Updated weights for policy 0, policy_version 332562 (0.0009) [2023-12-27 21:37:08,760][106226] Updated weights for policy 0, policy_version 332572 (0.0011) [2023-12-27 21:37:08,824][106226] Updated weights for policy 0, policy_version 332582 (0.0010) [2023-12-27 21:37:08,879][106226] Updated weights for policy 0, policy_version 332592 (0.0010) [2023-12-27 21:37:09,192][106225] Updated weights for policy 1, policy_version 333145 (0.0008) [2023-12-27 21:37:09,261][106225] Updated weights for policy 1, policy_version 333155 (0.0008) [2023-12-27 21:37:09,324][106225] Updated weights for policy 1, policy_version 333165 (0.0008) [2023-12-27 21:37:09,618][106226] Updated weights for policy 0, policy_version 332602 (0.0011) [2023-12-27 21:37:09,683][106226] Updated weights for policy 0, policy_version 332612 (0.0011) [2023-12-27 21:37:09,748][106226] Updated weights for policy 0, policy_version 332622 (0.0011) [2023-12-27 21:37:10,113][106225] Updated weights for policy 1, policy_version 333175 (0.0008) [2023-12-27 21:37:10,177][106225] Updated weights for policy 1, policy_version 333185 (0.0007) [2023-12-27 21:37:10,238][106225] Updated weights for policy 1, policy_version 333195 (0.0008) [2023-12-27 21:37:10,514][106226] Updated weights for policy 0, policy_version 332632 (0.0011) [2023-12-27 21:37:10,576][106226] Updated weights for policy 0, policy_version 332642 (0.0010) [2023-12-27 21:37:10,635][106226] Updated weights for policy 0, policy_version 332652 (0.0009) [2023-12-27 21:37:10,899][106225] Updated weights for policy 1, policy_version 333205 (0.0008) [2023-12-27 21:37:10,953][106225] Updated weights for policy 1, policy_version 333215 (0.0008) [2023-12-27 21:37:11,012][106225] Updated weights for policy 1, policy_version 333225 (0.0009) [2023-12-27 21:37:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 170516480. Throughput: 0: 10233.5, 1: 9941.6. Samples: 170487032. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:11,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-5.618')] [2023-12-27 21:37:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000332656_85188608.pth... [2023-12-27 21:37:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000333232_85327872.pth... [2023-12-27 21:37:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000331472_84885504.pth [2023-12-27 21:37:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000332080_85032960.pth [2023-12-27 21:37:11,454][106226] Updated weights for policy 0, policy_version 332662 (0.0009) [2023-12-27 21:37:11,518][106226] Updated weights for policy 0, policy_version 332672 (0.0011) [2023-12-27 21:37:11,579][106226] Updated weights for policy 0, policy_version 332682 (0.0007) [2023-12-27 21:37:11,855][106225] Updated weights for policy 1, policy_version 333235 (0.0009) [2023-12-27 21:37:11,908][106225] Updated weights for policy 1, policy_version 333245 (0.0008) [2023-12-27 21:37:11,968][106225] Updated weights for policy 1, policy_version 333255 (0.0008) [2023-12-27 21:37:12,313][106226] Updated weights for policy 0, policy_version 332692 (0.0009) [2023-12-27 21:37:12,394][106226] Updated weights for policy 0, policy_version 332702 (0.0011) [2023-12-27 21:37:12,457][106226] Updated weights for policy 0, policy_version 332712 (0.0011) [2023-12-27 21:37:12,751][106225] Updated weights for policy 1, policy_version 333265 (0.0008) [2023-12-27 21:37:12,817][106225] Updated weights for policy 1, policy_version 333275 (0.0006) [2023-12-27 21:37:12,875][106225] Updated weights for policy 1, policy_version 333285 (0.0006) [2023-12-27 21:37:12,933][106225] Updated weights for policy 1, policy_version 333295 (0.0006) [2023-12-27 21:37:13,162][106226] Updated weights for policy 0, policy_version 332722 (0.0008) [2023-12-27 21:37:13,213][106226] Updated weights for policy 0, policy_version 332732 (0.0010) [2023-12-27 21:37:13,268][106226] Updated weights for policy 0, policy_version 332742 (0.0010) [2023-12-27 21:37:13,320][106226] Updated weights for policy 0, policy_version 332752 (0.0010) [2023-12-27 21:37:13,532][106225] Updated weights for policy 1, policy_version 333305 (0.0009) [2023-12-27 21:37:13,580][106225] Updated weights for policy 1, policy_version 333315 (0.0005) [2023-12-27 21:37:13,632][106225] Updated weights for policy 1, policy_version 333325 (0.0007) [2023-12-27 21:37:14,032][106226] Updated weights for policy 0, policy_version 332762 (0.0010) [2023-12-27 21:37:14,085][106226] Updated weights for policy 0, policy_version 332772 (0.0010) [2023-12-27 21:37:14,152][106226] Updated weights for policy 0, policy_version 332782 (0.0010) [2023-12-27 21:37:14,199][106225] Updated weights for policy 1, policy_version 333335 (0.0006) [2023-12-27 21:37:14,266][106225] Updated weights for policy 1, policy_version 333345 (0.0005) [2023-12-27 21:37:14,325][106225] Updated weights for policy 1, policy_version 333355 (0.0007) [2023-12-27 21:37:14,869][106226] Updated weights for policy 0, policy_version 332792 (0.0011) [2023-12-27 21:37:14,927][106226] Updated weights for policy 0, policy_version 332802 (0.0011) [2023-12-27 21:37:14,932][106225] Updated weights for policy 1, policy_version 333365 (0.0010) [2023-12-27 21:37:14,987][106226] Updated weights for policy 0, policy_version 332812 (0.0008) [2023-12-27 21:37:14,994][106225] Updated weights for policy 1, policy_version 333375 (0.0010) [2023-12-27 21:37:15,055][106225] Updated weights for policy 1, policy_version 333385 (0.0010) [2023-12-27 21:37:15,717][106225] Updated weights for policy 1, policy_version 333395 (0.0011) [2023-12-27 21:37:15,768][106226] Updated weights for policy 0, policy_version 332822 (0.0008) [2023-12-27 21:37:15,771][106225] Updated weights for policy 1, policy_version 333405 (0.0006) [2023-12-27 21:37:15,824][106225] Updated weights for policy 1, policy_version 333415 (0.0005) [2023-12-27 21:37:15,832][106226] Updated weights for policy 0, policy_version 332832 (0.0008) [2023-12-27 21:37:15,882][106226] Updated weights for policy 0, policy_version 332842 (0.0008) [2023-12-27 21:37:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 170614784. Throughput: 0: 10127.5, 1: 9866.2. Samples: 170602976. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:16,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-5.959')] [2023-12-27 21:37:16,425][106225] Updated weights for policy 1, policy_version 333425 (0.0007) [2023-12-27 21:37:16,488][106225] Updated weights for policy 1, policy_version 333435 (0.0009) [2023-12-27 21:37:16,492][106226] Updated weights for policy 0, policy_version 332852 (0.0008) [2023-12-27 21:37:16,542][106225] Updated weights for policy 1, policy_version 333445 (0.0010) [2023-12-27 21:37:16,543][106226] Updated weights for policy 0, policy_version 332862 (0.0005) [2023-12-27 21:37:16,594][106226] Updated weights for policy 0, policy_version 332872 (0.0005) [2023-12-27 21:37:16,610][106225] Updated weights for policy 1, policy_version 333456 (0.0007) [2023-12-27 21:37:17,177][106225] Updated weights for policy 1, policy_version 333466 (0.0008) [2023-12-27 21:37:17,220][106226] Updated weights for policy 0, policy_version 332882 (0.0005) [2023-12-27 21:37:17,237][106225] Updated weights for policy 1, policy_version 333476 (0.0006) [2023-12-27 21:37:17,274][106226] Updated weights for policy 0, policy_version 332892 (0.0006) [2023-12-27 21:37:17,290][106225] Updated weights for policy 1, policy_version 333486 (0.0007) [2023-12-27 21:37:17,330][106226] Updated weights for policy 0, policy_version 332902 (0.0005) [2023-12-27 21:37:17,382][106226] Updated weights for policy 0, policy_version 332912 (0.0007) [2023-12-27 21:37:17,934][106226] Updated weights for policy 0, policy_version 332922 (0.0006) [2023-12-27 21:37:17,985][106226] Updated weights for policy 0, policy_version 332932 (0.0008) [2023-12-27 21:37:17,988][106225] Updated weights for policy 1, policy_version 333496 (0.0006) [2023-12-27 21:37:18,036][106226] Updated weights for policy 0, policy_version 332942 (0.0008) [2023-12-27 21:37:18,047][106225] Updated weights for policy 1, policy_version 333506 (0.0006) [2023-12-27 21:37:18,111][106225] Updated weights for policy 1, policy_version 333516 (0.0010) [2023-12-27 21:37:18,698][106226] Updated weights for policy 0, policy_version 332952 (0.0010) [2023-12-27 21:37:18,758][106226] Updated weights for policy 0, policy_version 332962 (0.0010) [2023-12-27 21:37:18,763][106225] Updated weights for policy 1, policy_version 333526 (0.0010) [2023-12-27 21:37:18,819][106225] Updated weights for policy 1, policy_version 333536 (0.0006) [2023-12-27 21:37:18,821][106226] Updated weights for policy 0, policy_version 332972 (0.0009) [2023-12-27 21:37:18,885][106225] Updated weights for policy 1, policy_version 333546 (0.0006) [2023-12-27 21:37:19,546][106226] Updated weights for policy 0, policy_version 332982 (0.0010) [2023-12-27 21:37:19,582][106225] Updated weights for policy 1, policy_version 333556 (0.0007) [2023-12-27 21:37:19,608][106226] Updated weights for policy 0, policy_version 332992 (0.0007) [2023-12-27 21:37:19,638][106225] Updated weights for policy 1, policy_version 333566 (0.0007) [2023-12-27 21:37:19,674][106226] Updated weights for policy 0, policy_version 333002 (0.0006) [2023-12-27 21:37:19,688][106225] Updated weights for policy 1, policy_version 333576 (0.0008) [2023-12-27 21:37:20,372][106225] Updated weights for policy 1, policy_version 333586 (0.0008) [2023-12-27 21:37:20,393][106226] Updated weights for policy 0, policy_version 333012 (0.0007) [2023-12-27 21:37:20,441][106225] Updated weights for policy 1, policy_version 333596 (0.0007) [2023-12-27 21:37:20,458][106226] Updated weights for policy 0, policy_version 333022 (0.0007) [2023-12-27 21:37:20,505][106225] Updated weights for policy 1, policy_version 333606 (0.0006) [2023-12-27 21:37:20,512][106226] Updated weights for policy 0, policy_version 333032 (0.0006) [2023-12-27 21:37:20,567][106225] Updated weights for policy 1, policy_version 333616 (0.0007) [2023-12-27 21:37:21,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 170713088. Throughput: 0: 10126.5, 1: 9902.2. Samples: 170727032. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:21,176][105115] Avg episode reward: [(0, '-4.792'), (1, '-5.705')] [2023-12-27 21:37:21,207][106226] Updated weights for policy 0, policy_version 333042 (0.0007) [2023-12-27 21:37:21,270][106226] Updated weights for policy 0, policy_version 333052 (0.0007) [2023-12-27 21:37:21,337][106226] Updated weights for policy 0, policy_version 333062 (0.0006) [2023-12-27 21:37:21,362][106225] Updated weights for policy 1, policy_version 333626 (0.0008) [2023-12-27 21:37:21,415][106226] Updated weights for policy 0, policy_version 333072 (0.0008) [2023-12-27 21:37:21,426][106225] Updated weights for policy 1, policy_version 333636 (0.0006) [2023-12-27 21:37:21,494][106225] Updated weights for policy 1, policy_version 333646 (0.0008) [2023-12-27 21:37:22,036][106226] Updated weights for policy 0, policy_version 333082 (0.0006) [2023-12-27 21:37:22,097][106226] Updated weights for policy 0, policy_version 333092 (0.0007) [2023-12-27 21:37:22,159][106226] Updated weights for policy 0, policy_version 333102 (0.0008) [2023-12-27 21:37:22,222][106225] Updated weights for policy 1, policy_version 333656 (0.0011) [2023-12-27 21:37:22,290][106225] Updated weights for policy 1, policy_version 333666 (0.0007) [2023-12-27 21:37:22,356][106225] Updated weights for policy 1, policy_version 333676 (0.0008) [2023-12-27 21:37:22,855][106226] Updated weights for policy 0, policy_version 333112 (0.0009) [2023-12-27 21:37:22,911][106226] Updated weights for policy 0, policy_version 333122 (0.0005) [2023-12-27 21:37:22,965][106226] Updated weights for policy 0, policy_version 333132 (0.0006) [2023-12-27 21:37:22,991][106225] Updated weights for policy 1, policy_version 333686 (0.0009) [2023-12-27 21:37:23,049][106225] Updated weights for policy 1, policy_version 333696 (0.0009) [2023-12-27 21:37:23,096][106225] Updated weights for policy 1, policy_version 333706 (0.0008) [2023-12-27 21:37:23,693][106226] Updated weights for policy 0, policy_version 333142 (0.0006) [2023-12-27 21:37:23,696][106225] Updated weights for policy 1, policy_version 333716 (0.0006) [2023-12-27 21:37:23,753][106225] Updated weights for policy 1, policy_version 333726 (0.0008) [2023-12-27 21:37:23,753][106226] Updated weights for policy 0, policy_version 333152 (0.0007) [2023-12-27 21:37:23,810][106226] Updated weights for policy 0, policy_version 333162 (0.0008) [2023-12-27 21:37:23,821][106225] Updated weights for policy 1, policy_version 333736 (0.0005) [2023-12-27 21:37:24,396][106226] Updated weights for policy 0, policy_version 333172 (0.0007) [2023-12-27 21:37:24,459][106225] Updated weights for policy 1, policy_version 333746 (0.0008) [2023-12-27 21:37:24,462][106226] Updated weights for policy 0, policy_version 333182 (0.0006) [2023-12-27 21:37:24,516][106225] Updated weights for policy 1, policy_version 333756 (0.0009) [2023-12-27 21:37:24,518][106226] Updated weights for policy 0, policy_version 333192 (0.0007) [2023-12-27 21:37:24,569][106225] Updated weights for policy 1, policy_version 333766 (0.0010) [2023-12-27 21:37:24,617][106225] Updated weights for policy 1, policy_version 333776 (0.0010) [2023-12-27 21:37:25,191][106226] Updated weights for policy 0, policy_version 333202 (0.0005) [2023-12-27 21:37:25,218][106225] Updated weights for policy 1, policy_version 333786 (0.0006) [2023-12-27 21:37:25,248][106226] Updated weights for policy 0, policy_version 333212 (0.0006) [2023-12-27 21:37:25,274][106225] Updated weights for policy 1, policy_version 333796 (0.0008) [2023-12-27 21:37:25,312][106226] Updated weights for policy 0, policy_version 333222 (0.0006) [2023-12-27 21:37:25,330][106225] Updated weights for policy 1, policy_version 333806 (0.0008) [2023-12-27 21:37:25,377][106226] Updated weights for policy 0, policy_version 333232 (0.0007) [2023-12-27 21:37:25,876][106225] Updated weights for policy 1, policy_version 333816 (0.0009) [2023-12-27 21:37:25,927][106225] Updated weights for policy 1, policy_version 333826 (0.0008) [2023-12-27 21:37:25,970][106226] Updated weights for policy 0, policy_version 333242 (0.0007) [2023-12-27 21:37:25,978][106225] Updated weights for policy 1, policy_version 333836 (0.0005) [2023-12-27 21:37:26,034][106226] Updated weights for policy 0, policy_version 333252 (0.0008) [2023-12-27 21:37:26,094][106226] Updated weights for policy 0, policy_version 333262 (0.0010) [2023-12-27 21:37:26,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20343.4, 300 sec: 19966.3). Total num frames: 170827776. Throughput: 0: 10122.1, 1: 9912.0. Samples: 170787232. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:26,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-5.627')] [2023-12-27 21:37:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000333840_85483520.pth... [2023-12-27 21:37:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000333264_85344256.pth... [2023-12-27 21:37:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000332656_85180416.pth [2023-12-27 21:37:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000332080_85041152.pth [2023-12-27 21:37:26,586][106225] Updated weights for policy 1, policy_version 333846 (0.0005) [2023-12-27 21:37:26,638][106225] Updated weights for policy 1, policy_version 333856 (0.0005) [2023-12-27 21:37:26,683][106225] Updated weights for policy 1, policy_version 333866 (0.0005) [2023-12-27 21:37:26,770][106226] Updated weights for policy 0, policy_version 333272 (0.0011) [2023-12-27 21:37:26,816][106226] Updated weights for policy 0, policy_version 333282 (0.0010) [2023-12-27 21:37:26,875][106226] Updated weights for policy 0, policy_version 333292 (0.0010) [2023-12-27 21:37:27,204][106225] Updated weights for policy 1, policy_version 333876 (0.0005) [2023-12-27 21:37:27,256][106225] Updated weights for policy 1, policy_version 333886 (0.0008) [2023-12-27 21:37:27,305][106225] Updated weights for policy 1, policy_version 333896 (0.0010) [2023-12-27 21:37:27,616][106226] Updated weights for policy 0, policy_version 333302 (0.0008) [2023-12-27 21:37:27,669][106226] Updated weights for policy 0, policy_version 333312 (0.0005) [2023-12-27 21:37:27,721][106226] Updated weights for policy 0, policy_version 333322 (0.0005) [2023-12-27 21:37:27,875][106225] Updated weights for policy 1, policy_version 333906 (0.0005) [2023-12-27 21:37:27,944][106225] Updated weights for policy 1, policy_version 333916 (0.0005) [2023-12-27 21:37:28,011][106225] Updated weights for policy 1, policy_version 333926 (0.0005) [2023-12-27 21:37:28,069][106225] Updated weights for policy 1, policy_version 333936 (0.0005) [2023-12-27 21:37:28,390][106226] Updated weights for policy 0, policy_version 333332 (0.0008) [2023-12-27 21:37:28,448][106226] Updated weights for policy 0, policy_version 333342 (0.0011) [2023-12-27 21:37:28,504][106226] Updated weights for policy 0, policy_version 333352 (0.0010) [2023-12-27 21:37:28,593][106225] Updated weights for policy 1, policy_version 333946 (0.0010) [2023-12-27 21:37:28,654][106225] Updated weights for policy 1, policy_version 333956 (0.0009) [2023-12-27 21:37:28,710][106225] Updated weights for policy 1, policy_version 333966 (0.0010) [2023-12-27 21:37:29,204][106226] Updated weights for policy 0, policy_version 333362 (0.0010) [2023-12-27 21:37:29,269][106226] Updated weights for policy 0, policy_version 333372 (0.0009) [2023-12-27 21:37:29,330][106226] Updated weights for policy 0, policy_version 333382 (0.0011) [2023-12-27 21:37:29,398][106225] Updated weights for policy 1, policy_version 333976 (0.0010) [2023-12-27 21:37:29,401][106226] Updated weights for policy 0, policy_version 333392 (0.0009) [2023-12-27 21:37:29,460][106225] Updated weights for policy 1, policy_version 333986 (0.0008) [2023-12-27 21:37:29,522][106225] Updated weights for policy 1, policy_version 333996 (0.0010) [2023-12-27 21:37:30,105][106226] Updated weights for policy 0, policy_version 333402 (0.0011) [2023-12-27 21:37:30,168][106226] Updated weights for policy 0, policy_version 333412 (0.0011) [2023-12-27 21:37:30,195][106225] Updated weights for policy 1, policy_version 334006 (0.0010) [2023-12-27 21:37:30,232][106226] Updated weights for policy 0, policy_version 333422 (0.0006) [2023-12-27 21:37:30,252][106225] Updated weights for policy 1, policy_version 334016 (0.0010) [2023-12-27 21:37:30,312][106225] Updated weights for policy 1, policy_version 334026 (0.0010) [2023-12-27 21:37:30,838][106226] Updated weights for policy 0, policy_version 333432 (0.0007) [2023-12-27 21:37:30,880][106226] Updated weights for policy 0, policy_version 333442 (0.0007) [2023-12-27 21:37:30,933][106226] Updated weights for policy 0, policy_version 333452 (0.0007) [2023-12-27 21:37:31,021][106225] Updated weights for policy 1, policy_version 334036 (0.0009) [2023-12-27 21:37:31,088][106225] Updated weights for policy 1, policy_version 334046 (0.0008) [2023-12-27 21:37:31,156][106225] Updated weights for policy 1, policy_version 334056 (0.0009) [2023-12-27 21:37:31,174][105115] Fps is (10 sec: 21299.9, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 170926080. Throughput: 0: 10140.6, 1: 10117.8. Samples: 170917104. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:31,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.920')] [2023-12-27 21:37:31,713][106226] Updated weights for policy 0, policy_version 333462 (0.0009) [2023-12-27 21:37:31,790][106226] Updated weights for policy 0, policy_version 333472 (0.0009) [2023-12-27 21:37:31,850][106226] Updated weights for policy 0, policy_version 333482 (0.0009) [2023-12-27 21:37:31,880][106225] Updated weights for policy 1, policy_version 334066 (0.0009) [2023-12-27 21:37:31,941][106225] Updated weights for policy 1, policy_version 334076 (0.0008) [2023-12-27 21:37:32,007][106225] Updated weights for policy 1, policy_version 334086 (0.0008) [2023-12-27 21:37:32,068][106225] Updated weights for policy 1, policy_version 334096 (0.0007) [2023-12-27 21:37:32,607][106226] Updated weights for policy 0, policy_version 333492 (0.0008) [2023-12-27 21:37:32,665][106226] Updated weights for policy 0, policy_version 333502 (0.0008) [2023-12-27 21:37:32,726][106226] Updated weights for policy 0, policy_version 333512 (0.0006) [2023-12-27 21:37:32,765][106225] Updated weights for policy 1, policy_version 334106 (0.0008) [2023-12-27 21:37:32,827][106225] Updated weights for policy 1, policy_version 334116 (0.0009) [2023-12-27 21:37:32,888][106225] Updated weights for policy 1, policy_version 334126 (0.0008) [2023-12-27 21:37:33,432][106226] Updated weights for policy 0, policy_version 333522 (0.0006) [2023-12-27 21:37:33,483][106226] Updated weights for policy 0, policy_version 333532 (0.0005) [2023-12-27 21:37:33,542][106226] Updated weights for policy 0, policy_version 333542 (0.0007) [2023-12-27 21:37:33,542][106225] Updated weights for policy 1, policy_version 334136 (0.0008) [2023-12-27 21:37:33,586][106225] Updated weights for policy 1, policy_version 334146 (0.0008) [2023-12-27 21:37:33,590][106226] Updated weights for policy 0, policy_version 333552 (0.0005) [2023-12-27 21:37:33,636][106225] Updated weights for policy 1, policy_version 334156 (0.0010) [2023-12-27 21:37:34,125][106226] Updated weights for policy 0, policy_version 333562 (0.0007) [2023-12-27 21:37:34,195][106226] Updated weights for policy 0, policy_version 333572 (0.0008) [2023-12-27 21:37:34,265][106226] Updated weights for policy 0, policy_version 333582 (0.0009) [2023-12-27 21:37:34,288][106225] Updated weights for policy 1, policy_version 334166 (0.0008) [2023-12-27 21:37:34,353][106225] Updated weights for policy 1, policy_version 334176 (0.0007) [2023-12-27 21:37:34,421][106225] Updated weights for policy 1, policy_version 334186 (0.0006) [2023-12-27 21:37:34,992][106226] Updated weights for policy 0, policy_version 333592 (0.0006) [2023-12-27 21:37:35,016][106225] Updated weights for policy 1, policy_version 334196 (0.0007) [2023-12-27 21:37:35,052][106226] Updated weights for policy 0, policy_version 333602 (0.0006) [2023-12-27 21:37:35,080][106225] Updated weights for policy 1, policy_version 334206 (0.0007) [2023-12-27 21:37:35,107][106226] Updated weights for policy 0, policy_version 333612 (0.0006) [2023-12-27 21:37:35,133][106225] Updated weights for policy 1, policy_version 334216 (0.0006) [2023-12-27 21:37:35,682][106226] Updated weights for policy 0, policy_version 333622 (0.0006) [2023-12-27 21:37:35,737][106226] Updated weights for policy 0, policy_version 333632 (0.0006) [2023-12-27 21:37:35,787][106226] Updated weights for policy 0, policy_version 333642 (0.0005) [2023-12-27 21:37:35,944][106225] Updated weights for policy 1, policy_version 334226 (0.0008) [2023-12-27 21:37:35,999][106225] Updated weights for policy 1, policy_version 334236 (0.0008) [2023-12-27 21:37:36,055][106225] Updated weights for policy 1, policy_version 334246 (0.0009) [2023-12-27 21:37:36,113][106225] Updated weights for policy 1, policy_version 334256 (0.0009) [2023-12-27 21:37:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19994.0). Total num frames: 171032576. Throughput: 0: 10114.9, 1: 10093.1. Samples: 171038816. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:36,175][105115] Avg episode reward: [(0, '-4.992'), (1, '-5.791')] [2023-12-27 21:37:36,504][106226] Updated weights for policy 0, policy_version 333652 (0.0007) [2023-12-27 21:37:36,564][106226] Updated weights for policy 0, policy_version 333662 (0.0008) [2023-12-27 21:37:36,624][106226] Updated weights for policy 0, policy_version 333672 (0.0008) [2023-12-27 21:37:36,869][106225] Updated weights for policy 1, policy_version 334266 (0.0009) [2023-12-27 21:37:36,923][106225] Updated weights for policy 1, policy_version 334276 (0.0005) [2023-12-27 21:37:36,991][106225] Updated weights for policy 1, policy_version 334286 (0.0006) [2023-12-27 21:37:37,231][106226] Updated weights for policy 0, policy_version 333682 (0.0008) [2023-12-27 21:37:37,286][106226] Updated weights for policy 0, policy_version 333692 (0.0008) [2023-12-27 21:37:37,358][106226] Updated weights for policy 0, policy_version 333702 (0.0008) [2023-12-27 21:37:37,420][106226] Updated weights for policy 0, policy_version 333712 (0.0008) [2023-12-27 21:37:37,654][106225] Updated weights for policy 1, policy_version 334296 (0.0010) [2023-12-27 21:37:37,716][106225] Updated weights for policy 1, policy_version 334306 (0.0010) [2023-12-27 21:37:37,770][106225] Updated weights for policy 1, policy_version 334316 (0.0010) [2023-12-27 21:37:38,139][106226] Updated weights for policy 0, policy_version 333722 (0.0008) [2023-12-27 21:37:38,199][106226] Updated weights for policy 0, policy_version 333732 (0.0006) [2023-12-27 21:37:38,259][106226] Updated weights for policy 0, policy_version 333742 (0.0007) [2023-12-27 21:37:38,512][106225] Updated weights for policy 1, policy_version 334326 (0.0011) [2023-12-27 21:37:38,576][106225] Updated weights for policy 1, policy_version 334336 (0.0010) [2023-12-27 21:37:38,639][106225] Updated weights for policy 1, policy_version 334346 (0.0010) [2023-12-27 21:37:38,966][106226] Updated weights for policy 0, policy_version 333752 (0.0008) [2023-12-27 21:37:39,024][106226] Updated weights for policy 0, policy_version 333762 (0.0007) [2023-12-27 21:37:39,081][106226] Updated weights for policy 0, policy_version 333772 (0.0008) [2023-12-27 21:37:39,362][106225] Updated weights for policy 1, policy_version 334356 (0.0009) [2023-12-27 21:37:39,433][106225] Updated weights for policy 1, policy_version 334366 (0.0008) [2023-12-27 21:37:39,493][106225] Updated weights for policy 1, policy_version 334376 (0.0008) [2023-12-27 21:37:39,904][106226] Updated weights for policy 0, policy_version 333782 (0.0008) [2023-12-27 21:37:39,973][106226] Updated weights for policy 0, policy_version 333792 (0.0008) [2023-12-27 21:37:40,040][106226] Updated weights for policy 0, policy_version 333802 (0.0008) [2023-12-27 21:37:40,299][106225] Updated weights for policy 1, policy_version 334386 (0.0009) [2023-12-27 21:37:40,360][106225] Updated weights for policy 1, policy_version 334396 (0.0010) [2023-12-27 21:37:40,422][106225] Updated weights for policy 1, policy_version 334406 (0.0011) [2023-12-27 21:37:40,487][106225] Updated weights for policy 1, policy_version 334416 (0.0011) [2023-12-27 21:37:40,785][106226] Updated weights for policy 0, policy_version 333812 (0.0008) [2023-12-27 21:37:40,853][106226] Updated weights for policy 0, policy_version 333822 (0.0008) [2023-12-27 21:37:40,906][106226] Updated weights for policy 0, policy_version 333832 (0.0008) [2023-12-27 21:37:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 171122688. Throughput: 0: 10092.0, 1: 10098.9. Samples: 171097368. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:41,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.902')] [2023-12-27 21:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000333840_85491712.pth... [2023-12-27 21:37:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000332656_85188608.pth [2023-12-27 21:37:41,229][106225] Updated weights for policy 1, policy_version 334426 (0.0007) [2023-12-27 21:37:41,296][106225] Updated weights for policy 1, policy_version 334436 (0.0007) [2023-12-27 21:37:41,371][106225] Updated weights for policy 1, policy_version 334446 (0.0008) [2023-12-27 21:37:41,384][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000334448_85639168.pth... [2023-12-27 21:37:41,390][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000333232_85327872.pth [2023-12-27 21:37:41,656][106226] Updated weights for policy 0, policy_version 333842 (0.0008) [2023-12-27 21:37:41,718][106226] Updated weights for policy 0, policy_version 333852 (0.0008) [2023-12-27 21:37:41,793][106226] Updated weights for policy 0, policy_version 333862 (0.0008) [2023-12-27 21:37:41,863][106226] Updated weights for policy 0, policy_version 333872 (0.0007) [2023-12-27 21:37:42,097][106225] Updated weights for policy 1, policy_version 334456 (0.0008) [2023-12-27 21:37:42,155][106225] Updated weights for policy 1, policy_version 334466 (0.0007) [2023-12-27 21:37:42,220][106225] Updated weights for policy 1, policy_version 334476 (0.0006) [2023-12-27 21:37:42,584][106226] Updated weights for policy 0, policy_version 333882 (0.0008) [2023-12-27 21:37:42,640][106226] Updated weights for policy 0, policy_version 333892 (0.0009) [2023-12-27 21:37:42,695][106226] Updated weights for policy 0, policy_version 333902 (0.0009) [2023-12-27 21:37:42,974][106225] Updated weights for policy 1, policy_version 334486 (0.0009) [2023-12-27 21:37:43,031][106225] Updated weights for policy 1, policy_version 334496 (0.0010) [2023-12-27 21:37:43,082][106225] Updated weights for policy 1, policy_version 334506 (0.0010) [2023-12-27 21:37:43,469][106226] Updated weights for policy 0, policy_version 333912 (0.0009) [2023-12-27 21:37:43,523][106226] Updated weights for policy 0, policy_version 333922 (0.0008) [2023-12-27 21:37:43,574][106226] Updated weights for policy 0, policy_version 333932 (0.0008) [2023-12-27 21:37:43,743][106225] Updated weights for policy 1, policy_version 334516 (0.0009) [2023-12-27 21:37:43,789][106225] Updated weights for policy 1, policy_version 334526 (0.0006) [2023-12-27 21:37:43,836][106225] Updated weights for policy 1, policy_version 334536 (0.0005) [2023-12-27 21:37:44,224][106226] Updated weights for policy 0, policy_version 333942 (0.0006) [2023-12-27 21:37:44,287][106226] Updated weights for policy 0, policy_version 333952 (0.0005) [2023-12-27 21:37:44,344][106226] Updated weights for policy 0, policy_version 333962 (0.0006) [2023-12-27 21:37:44,549][106225] Updated weights for policy 1, policy_version 334546 (0.0006) [2023-12-27 21:37:44,613][106225] Updated weights for policy 1, policy_version 334556 (0.0010) [2023-12-27 21:37:44,662][106225] Updated weights for policy 1, policy_version 334566 (0.0010) [2023-12-27 21:37:44,715][106225] Updated weights for policy 1, policy_version 334576 (0.0010) [2023-12-27 21:37:44,953][106226] Updated weights for policy 0, policy_version 333972 (0.0006) [2023-12-27 21:37:45,012][106226] Updated weights for policy 0, policy_version 333982 (0.0008) [2023-12-27 21:37:45,075][106226] Updated weights for policy 0, policy_version 333992 (0.0008) [2023-12-27 21:37:45,472][106225] Updated weights for policy 1, policy_version 334586 (0.0010) [2023-12-27 21:37:45,530][106225] Updated weights for policy 1, policy_version 334596 (0.0009) [2023-12-27 21:37:45,587][106225] Updated weights for policy 1, policy_version 334606 (0.0005) [2023-12-27 21:37:45,855][106226] Updated weights for policy 0, policy_version 334002 (0.0008) [2023-12-27 21:37:45,922][106226] Updated weights for policy 0, policy_version 334012 (0.0009) [2023-12-27 21:37:45,988][106226] Updated weights for policy 0, policy_version 334022 (0.0009) [2023-12-27 21:37:46,057][106226] Updated weights for policy 0, policy_version 334032 (0.0010) [2023-12-27 21:37:46,120][106225] Updated weights for policy 1, policy_version 334616 (0.0005) [2023-12-27 21:37:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.5, 300 sec: 19966.3). Total num frames: 171220992. Throughput: 0: 9998.7, 1: 10063.2. Samples: 171211720. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:46,176][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.691')] [2023-12-27 21:37:46,177][106225] Updated weights for policy 1, policy_version 334626 (0.0006) [2023-12-27 21:37:46,234][106225] Updated weights for policy 1, policy_version 334636 (0.0011) [2023-12-27 21:37:46,764][106226] Updated weights for policy 0, policy_version 334042 (0.0008) [2023-12-27 21:37:46,815][106226] Updated weights for policy 0, policy_version 334052 (0.0008) [2023-12-27 21:37:46,855][106225] Updated weights for policy 1, policy_version 334646 (0.0010) [2023-12-27 21:37:46,880][106226] Updated weights for policy 0, policy_version 334062 (0.0006) [2023-12-27 21:37:46,908][106225] Updated weights for policy 1, policy_version 334656 (0.0010) [2023-12-27 21:37:46,971][106225] Updated weights for policy 1, policy_version 334666 (0.0010) [2023-12-27 21:37:47,524][106226] Updated weights for policy 0, policy_version 334072 (0.0006) [2023-12-27 21:37:47,570][106226] Updated weights for policy 0, policy_version 334082 (0.0006) [2023-12-27 21:37:47,623][106226] Updated weights for policy 0, policy_version 334092 (0.0006) [2023-12-27 21:37:47,699][106225] Updated weights for policy 1, policy_version 334676 (0.0011) [2023-12-27 21:37:47,756][106225] Updated weights for policy 1, policy_version 334686 (0.0010) [2023-12-27 21:37:47,807][106225] Updated weights for policy 1, policy_version 334696 (0.0008) [2023-12-27 21:37:48,174][106226] Updated weights for policy 0, policy_version 334102 (0.0005) [2023-12-27 21:37:48,225][106226] Updated weights for policy 0, policy_version 334112 (0.0005) [2023-12-27 21:37:48,272][106226] Updated weights for policy 0, policy_version 334122 (0.0006) [2023-12-27 21:37:48,529][106225] Updated weights for policy 1, policy_version 334706 (0.0008) [2023-12-27 21:37:48,586][106225] Updated weights for policy 1, policy_version 334716 (0.0010) [2023-12-27 21:37:48,643][106225] Updated weights for policy 1, policy_version 334726 (0.0010) [2023-12-27 21:37:48,698][106225] Updated weights for policy 1, policy_version 334736 (0.0010) [2023-12-27 21:37:48,991][106226] Updated weights for policy 0, policy_version 334132 (0.0007) [2023-12-27 21:37:49,045][106226] Updated weights for policy 0, policy_version 334142 (0.0008) [2023-12-27 21:37:49,099][106226] Updated weights for policy 0, policy_version 334152 (0.0008) [2023-12-27 21:37:49,423][106225] Updated weights for policy 1, policy_version 334746 (0.0008) [2023-12-27 21:37:49,472][106225] Updated weights for policy 1, policy_version 334756 (0.0009) [2023-12-27 21:37:49,519][106225] Updated weights for policy 1, policy_version 334766 (0.0005) [2023-12-27 21:37:49,805][106226] Updated weights for policy 0, policy_version 334162 (0.0008) [2023-12-27 21:37:49,874][106226] Updated weights for policy 0, policy_version 334172 (0.0012) [2023-12-27 21:37:49,936][106226] Updated weights for policy 0, policy_version 334182 (0.0011) [2023-12-27 21:37:50,002][106226] Updated weights for policy 0, policy_version 334192 (0.0008) [2023-12-27 21:37:50,191][106225] Updated weights for policy 1, policy_version 334776 (0.0005) [2023-12-27 21:37:50,263][106225] Updated weights for policy 1, policy_version 334786 (0.0007) [2023-12-27 21:37:50,329][106225] Updated weights for policy 1, policy_version 334796 (0.0007) [2023-12-27 21:37:50,645][106226] Updated weights for policy 0, policy_version 334202 (0.0011) [2023-12-27 21:37:50,706][106226] Updated weights for policy 0, policy_version 334212 (0.0011) [2023-12-27 21:37:50,764][106226] Updated weights for policy 0, policy_version 334222 (0.0011) [2023-12-27 21:37:50,913][106225] Updated weights for policy 1, policy_version 334806 (0.0008) [2023-12-27 21:37:50,975][106225] Updated weights for policy 1, policy_version 334816 (0.0008) [2023-12-27 21:37:51,039][106225] Updated weights for policy 1, policy_version 334826 (0.0008) [2023-12-27 21:37:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20206.9, 300 sec: 19994.0). Total num frames: 171327488. Throughput: 0: 9971.6, 1: 10152.3. Samples: 171334168. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:51,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.840')] [2023-12-27 21:37:51,505][106226] Updated weights for policy 0, policy_version 334232 (0.0011) [2023-12-27 21:37:51,572][106226] Updated weights for policy 0, policy_version 334242 (0.0010) [2023-12-27 21:37:51,642][106226] Updated weights for policy 0, policy_version 334252 (0.0008) [2023-12-27 21:37:51,735][106225] Updated weights for policy 1, policy_version 334836 (0.0007) [2023-12-27 21:37:51,800][106225] Updated weights for policy 1, policy_version 334846 (0.0006) [2023-12-27 21:37:51,868][106225] Updated weights for policy 1, policy_version 334856 (0.0007) [2023-12-27 21:37:52,369][106226] Updated weights for policy 0, policy_version 334262 (0.0010) [2023-12-27 21:37:52,431][106226] Updated weights for policy 0, policy_version 334272 (0.0011) [2023-12-27 21:37:52,507][106226] Updated weights for policy 0, policy_version 334282 (0.0010) [2023-12-27 21:37:52,549][106225] Updated weights for policy 1, policy_version 334866 (0.0007) [2023-12-27 21:37:52,614][106225] Updated weights for policy 1, policy_version 334876 (0.0005) [2023-12-27 21:37:52,678][106225] Updated weights for policy 1, policy_version 334886 (0.0006) [2023-12-27 21:37:52,743][106225] Updated weights for policy 1, policy_version 334896 (0.0005) [2023-12-27 21:37:53,264][106226] Updated weights for policy 0, policy_version 334292 (0.0008) [2023-12-27 21:37:53,321][106226] Updated weights for policy 0, policy_version 334302 (0.0007) [2023-12-27 21:37:53,345][106225] Updated weights for policy 1, policy_version 334906 (0.0008) [2023-12-27 21:37:53,372][106226] Updated weights for policy 0, policy_version 334312 (0.0007) [2023-12-27 21:37:53,408][106225] Updated weights for policy 1, policy_version 334916 (0.0010) [2023-12-27 21:37:53,455][106225] Updated weights for policy 1, policy_version 334926 (0.0010) [2023-12-27 21:37:54,030][106225] Updated weights for policy 1, policy_version 334936 (0.0006) [2023-12-27 21:37:54,093][106225] Updated weights for policy 1, policy_version 334946 (0.0005) [2023-12-27 21:37:54,115][106226] Updated weights for policy 0, policy_version 334322 (0.0007) [2023-12-27 21:37:54,151][106225] Updated weights for policy 1, policy_version 334956 (0.0005) [2023-12-27 21:37:54,180][106226] Updated weights for policy 0, policy_version 334332 (0.0008) [2023-12-27 21:37:54,247][106226] Updated weights for policy 0, policy_version 334342 (0.0010) [2023-12-27 21:37:54,319][106226] Updated weights for policy 0, policy_version 334352 (0.0009) [2023-12-27 21:37:54,783][106225] Updated weights for policy 1, policy_version 334966 (0.0009) [2023-12-27 21:37:54,836][106225] Updated weights for policy 1, policy_version 334976 (0.0010) [2023-12-27 21:37:54,892][106225] Updated weights for policy 1, policy_version 334986 (0.0010) [2023-12-27 21:37:55,046][106226] Updated weights for policy 0, policy_version 334362 (0.0007) [2023-12-27 21:37:55,095][106226] Updated weights for policy 0, policy_version 334372 (0.0007) [2023-12-27 21:37:55,154][106226] Updated weights for policy 0, policy_version 334382 (0.0008) [2023-12-27 21:37:55,624][106225] Updated weights for policy 1, policy_version 334996 (0.0010) [2023-12-27 21:37:55,679][106225] Updated weights for policy 1, policy_version 335006 (0.0010) [2023-12-27 21:37:55,732][106225] Updated weights for policy 1, policy_version 335016 (0.0010) [2023-12-27 21:37:55,829][106226] Updated weights for policy 0, policy_version 334392 (0.0007) [2023-12-27 21:37:55,887][106226] Updated weights for policy 0, policy_version 334402 (0.0008) [2023-12-27 21:37:55,936][106226] Updated weights for policy 0, policy_version 334412 (0.0007) [2023-12-27 21:37:56,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.5, 300 sec: 19966.3). Total num frames: 171425792. Throughput: 0: 9920.1, 1: 10215.5. Samples: 171393132. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:37:56,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-5.898')] [2023-12-27 21:37:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000334416_85639168.pth... [2023-12-27 21:37:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000335024_85786624.pth... [2023-12-27 21:37:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000333264_85344256.pth [2023-12-27 21:37:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000333840_85483520.pth [2023-12-27 21:37:56,316][106225] Updated weights for policy 1, policy_version 335026 (0.0009) [2023-12-27 21:37:56,364][106225] Updated weights for policy 1, policy_version 335036 (0.0010) [2023-12-27 21:37:56,411][106225] Updated weights for policy 1, policy_version 335046 (0.0010) [2023-12-27 21:37:56,472][106225] Updated weights for policy 1, policy_version 335056 (0.0008) [2023-12-27 21:37:56,582][106226] Updated weights for policy 0, policy_version 334422 (0.0009) [2023-12-27 21:37:56,628][106226] Updated weights for policy 0, policy_version 334432 (0.0008) [2023-12-27 21:37:56,677][106226] Updated weights for policy 0, policy_version 334442 (0.0007) [2023-12-27 21:37:57,169][106225] Updated weights for policy 1, policy_version 335066 (0.0010) [2023-12-27 21:37:57,232][106225] Updated weights for policy 1, policy_version 335076 (0.0010) [2023-12-27 21:37:57,291][106225] Updated weights for policy 1, policy_version 335086 (0.0010) [2023-12-27 21:37:57,427][106226] Updated weights for policy 0, policy_version 334452 (0.0009) [2023-12-27 21:37:57,490][106226] Updated weights for policy 0, policy_version 334462 (0.0011) [2023-12-27 21:37:57,547][106226] Updated weights for policy 0, policy_version 334472 (0.0011) [2023-12-27 21:37:57,929][106225] Updated weights for policy 1, policy_version 335096 (0.0009) [2023-12-27 21:37:57,977][106225] Updated weights for policy 1, policy_version 335106 (0.0008) [2023-12-27 21:37:58,026][106225] Updated weights for policy 1, policy_version 335116 (0.0008) [2023-12-27 21:37:58,217][106226] Updated weights for policy 0, policy_version 334482 (0.0010) [2023-12-27 21:37:58,277][106226] Updated weights for policy 0, policy_version 334492 (0.0008) [2023-12-27 21:37:58,345][106226] Updated weights for policy 0, policy_version 334502 (0.0009) [2023-12-27 21:37:58,414][106226] Updated weights for policy 0, policy_version 334512 (0.0008) [2023-12-27 21:37:58,806][106225] Updated weights for policy 1, policy_version 335126 (0.0009) [2023-12-27 21:37:58,881][106225] Updated weights for policy 1, policy_version 335136 (0.0009) [2023-12-27 21:37:58,936][106225] Updated weights for policy 1, policy_version 335146 (0.0006) [2023-12-27 21:37:59,281][106226] Updated weights for policy 0, policy_version 334522 (0.0008) [2023-12-27 21:37:59,347][106226] Updated weights for policy 0, policy_version 334532 (0.0006) [2023-12-27 21:37:59,418][106226] Updated weights for policy 0, policy_version 334542 (0.0007) [2023-12-27 21:37:59,686][106225] Updated weights for policy 1, policy_version 335156 (0.0008) [2023-12-27 21:37:59,742][106225] Updated weights for policy 1, policy_version 335166 (0.0009) [2023-12-27 21:37:59,800][106225] Updated weights for policy 1, policy_version 335176 (0.0010) [2023-12-27 21:38:00,114][106226] Updated weights for policy 0, policy_version 334552 (0.0007) [2023-12-27 21:38:00,172][106226] Updated weights for policy 0, policy_version 334562 (0.0008) [2023-12-27 21:38:00,233][106226] Updated weights for policy 0, policy_version 334572 (0.0006) [2023-12-27 21:38:00,536][106225] Updated weights for policy 1, policy_version 335186 (0.0009) [2023-12-27 21:38:00,593][106225] Updated weights for policy 1, policy_version 335196 (0.0006) [2023-12-27 21:38:00,655][106225] Updated weights for policy 1, policy_version 335206 (0.0010) [2023-12-27 21:38:00,720][106225] Updated weights for policy 1, policy_version 335216 (0.0005) [2023-12-27 21:38:00,878][106226] Updated weights for policy 0, policy_version 334582 (0.0008) [2023-12-27 21:38:00,933][106226] Updated weights for policy 0, policy_version 334592 (0.0010) [2023-12-27 21:38:00,998][106226] Updated weights for policy 0, policy_version 334602 (0.0010) [2023-12-27 21:38:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 171524096. Throughput: 0: 9963.7, 1: 10258.6. Samples: 171512980. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:38:01,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-5.791')] [2023-12-27 21:38:01,318][106225] Updated weights for policy 1, policy_version 335226 (0.0010) [2023-12-27 21:38:01,378][106225] Updated weights for policy 1, policy_version 335236 (0.0010) [2023-12-27 21:38:01,436][106225] Updated weights for policy 1, policy_version 335246 (0.0009) [2023-12-27 21:38:01,724][106226] Updated weights for policy 0, policy_version 334612 (0.0012) [2023-12-27 21:38:01,790][106226] Updated weights for policy 0, policy_version 334622 (0.0006) [2023-12-27 21:38:01,847][106226] Updated weights for policy 0, policy_version 334632 (0.0007) [2023-12-27 21:38:02,192][106225] Updated weights for policy 1, policy_version 335256 (0.0010) [2023-12-27 21:38:02,260][106225] Updated weights for policy 1, policy_version 335266 (0.0006) [2023-12-27 21:38:02,327][106225] Updated weights for policy 1, policy_version 335276 (0.0007) [2023-12-27 21:38:02,444][106226] Updated weights for policy 0, policy_version 334642 (0.0010) [2023-12-27 21:38:02,505][106226] Updated weights for policy 0, policy_version 334652 (0.0008) [2023-12-27 21:38:02,565][106226] Updated weights for policy 0, policy_version 334662 (0.0008) [2023-12-27 21:38:02,627][106226] Updated weights for policy 0, policy_version 334672 (0.0008) [2023-12-27 21:38:02,971][106225] Updated weights for policy 1, policy_version 335286 (0.0009) [2023-12-27 21:38:03,041][106225] Updated weights for policy 1, policy_version 335296 (0.0010) [2023-12-27 21:38:03,106][106225] Updated weights for policy 1, policy_version 335306 (0.0010) [2023-12-27 21:38:03,306][106226] Updated weights for policy 0, policy_version 334682 (0.0005) [2023-12-27 21:38:03,359][106226] Updated weights for policy 0, policy_version 334692 (0.0005) [2023-12-27 21:38:03,410][106226] Updated weights for policy 0, policy_version 334702 (0.0005) [2023-12-27 21:38:03,776][106225] Updated weights for policy 1, policy_version 335316 (0.0008) [2023-12-27 21:38:03,827][106225] Updated weights for policy 1, policy_version 335326 (0.0005) [2023-12-27 21:38:03,888][106225] Updated weights for policy 1, policy_version 335336 (0.0007) [2023-12-27 21:38:04,058][106226] Updated weights for policy 0, policy_version 334712 (0.0007) [2023-12-27 21:38:04,116][106226] Updated weights for policy 0, policy_version 334722 (0.0006) [2023-12-27 21:38:04,174][106226] Updated weights for policy 0, policy_version 334732 (0.0006) [2023-12-27 21:38:04,521][106225] Updated weights for policy 1, policy_version 335346 (0.0006) [2023-12-27 21:38:04,568][106225] Updated weights for policy 1, policy_version 335356 (0.0008) [2023-12-27 21:38:04,616][106225] Updated weights for policy 1, policy_version 335366 (0.0006) [2023-12-27 21:38:04,669][106225] Updated weights for policy 1, policy_version 335376 (0.0005) [2023-12-27 21:38:04,805][106226] Updated weights for policy 0, policy_version 334742 (0.0009) [2023-12-27 21:38:04,856][106226] Updated weights for policy 0, policy_version 334752 (0.0009) [2023-12-27 21:38:04,911][106226] Updated weights for policy 0, policy_version 334762 (0.0009) [2023-12-27 21:38:05,401][106225] Updated weights for policy 1, policy_version 335386 (0.0005) [2023-12-27 21:38:05,458][106225] Updated weights for policy 1, policy_version 335396 (0.0007) [2023-12-27 21:38:05,521][106225] Updated weights for policy 1, policy_version 335406 (0.0008) [2023-12-27 21:38:05,594][106226] Updated weights for policy 0, policy_version 334772 (0.0010) [2023-12-27 21:38:05,664][106226] Updated weights for policy 0, policy_version 334782 (0.0011) [2023-12-27 21:38:05,724][106226] Updated weights for policy 0, policy_version 334792 (0.0009) [2023-12-27 21:38:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 171622400. Throughput: 0: 9985.9, 1: 10229.0. Samples: 171636700. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-27 21:38:06,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-6.017')] [2023-12-27 21:38:06,217][106225] Updated weights for policy 1, policy_version 335416 (0.0008) [2023-12-27 21:38:06,273][106225] Updated weights for policy 1, policy_version 335426 (0.0007) [2023-12-27 21:38:06,333][106226] Updated weights for policy 0, policy_version 334802 (0.0006) [2023-12-27 21:38:06,339][106225] Updated weights for policy 1, policy_version 335436 (0.0007) [2023-12-27 21:38:06,397][106226] Updated weights for policy 0, policy_version 334812 (0.0009) [2023-12-27 21:38:06,466][106226] Updated weights for policy 0, policy_version 334822 (0.0009) [2023-12-27 21:38:06,533][106226] Updated weights for policy 0, policy_version 334832 (0.0011) [2023-12-27 21:38:07,064][106225] Updated weights for policy 1, policy_version 335446 (0.0007) [2023-12-27 21:38:07,119][106225] Updated weights for policy 1, policy_version 335456 (0.0007) [2023-12-27 21:38:07,180][106225] Updated weights for policy 1, policy_version 335466 (0.0008) [2023-12-27 21:38:07,208][106226] Updated weights for policy 0, policy_version 334842 (0.0011) [2023-12-27 21:38:07,276][106226] Updated weights for policy 0, policy_version 334852 (0.0011) [2023-12-27 21:38:07,337][106226] Updated weights for policy 0, policy_version 334862 (0.0011) [2023-12-27 21:38:07,962][106225] Updated weights for policy 1, policy_version 335476 (0.0008) [2023-12-27 21:38:08,002][106226] Updated weights for policy 0, policy_version 334872 (0.0008) [2023-12-27 21:38:08,025][106225] Updated weights for policy 1, policy_version 335486 (0.0008) [2023-12-27 21:38:08,060][106226] Updated weights for policy 0, policy_version 334882 (0.0010) [2023-12-27 21:38:08,098][106225] Updated weights for policy 1, policy_version 335496 (0.0009) [2023-12-27 21:38:08,123][106226] Updated weights for policy 0, policy_version 334892 (0.0007) [2023-12-27 21:38:08,853][106226] Updated weights for policy 0, policy_version 334902 (0.0008) [2023-12-27 21:38:08,870][106225] Updated weights for policy 1, policy_version 335506 (0.0009) [2023-12-27 21:38:08,908][106226] Updated weights for policy 0, policy_version 334912 (0.0006) [2023-12-27 21:38:08,935][106225] Updated weights for policy 1, policy_version 335516 (0.0008) [2023-12-27 21:38:08,957][106226] Updated weights for policy 0, policy_version 334922 (0.0005) [2023-12-27 21:38:08,995][106225] Updated weights for policy 1, policy_version 335526 (0.0009) [2023-12-27 21:38:09,059][106225] Updated weights for policy 1, policy_version 335536 (0.0009) [2023-12-27 21:38:09,616][106226] Updated weights for policy 0, policy_version 334932 (0.0007) [2023-12-27 21:38:09,686][106226] Updated weights for policy 0, policy_version 334942 (0.0008) [2023-12-27 21:38:09,736][106225] Updated weights for policy 1, policy_version 335546 (0.0008) [2023-12-27 21:38:09,756][106226] Updated weights for policy 0, policy_version 334952 (0.0008) [2023-12-27 21:38:09,804][106225] Updated weights for policy 1, policy_version 335556 (0.0008) [2023-12-27 21:38:09,875][106225] Updated weights for policy 1, policy_version 335566 (0.0007) [2023-12-27 21:38:10,455][106226] Updated weights for policy 0, policy_version 334962 (0.0008) [2023-12-27 21:38:10,518][106226] Updated weights for policy 0, policy_version 334972 (0.0009) [2023-12-27 21:38:10,551][106225] Updated weights for policy 1, policy_version 335576 (0.0006) [2023-12-27 21:38:10,572][106226] Updated weights for policy 0, policy_version 334982 (0.0006) [2023-12-27 21:38:10,611][106225] Updated weights for policy 1, policy_version 335586 (0.0008) [2023-12-27 21:38:10,626][106226] Updated weights for policy 0, policy_version 334992 (0.0006) [2023-12-27 21:38:10,676][106225] Updated weights for policy 1, policy_version 335596 (0.0009) [2023-12-27 21:38:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 171720704. Throughput: 0: 9994.5, 1: 10156.9. Samples: 171694044. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:11,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-6.045')] [2023-12-27 21:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000335600_85934080.pth... [2023-12-27 21:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000334992_85786624.pth... [2023-12-27 21:38:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000334448_85639168.pth [2023-12-27 21:38:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000333840_85491712.pth [2023-12-27 21:38:11,359][106226] Updated weights for policy 0, policy_version 335002 (0.0008) [2023-12-27 21:38:11,429][106226] Updated weights for policy 0, policy_version 335012 (0.0008) [2023-12-27 21:38:11,443][106225] Updated weights for policy 1, policy_version 335606 (0.0008) [2023-12-27 21:38:11,482][106226] Updated weights for policy 0, policy_version 335022 (0.0008) [2023-12-27 21:38:11,504][106225] Updated weights for policy 1, policy_version 335616 (0.0007) [2023-12-27 21:38:11,568][106225] Updated weights for policy 1, policy_version 335626 (0.0008) [2023-12-27 21:38:12,302][106226] Updated weights for policy 0, policy_version 335032 (0.0008) [2023-12-27 21:38:12,337][106225] Updated weights for policy 1, policy_version 335636 (0.0008) [2023-12-27 21:38:12,363][106226] Updated weights for policy 0, policy_version 335042 (0.0007) [2023-12-27 21:38:12,401][106225] Updated weights for policy 1, policy_version 335646 (0.0007) [2023-12-27 21:38:12,431][106226] Updated weights for policy 0, policy_version 335052 (0.0008) [2023-12-27 21:38:12,456][106225] Updated weights for policy 1, policy_version 335656 (0.0007) [2023-12-27 21:38:13,160][106226] Updated weights for policy 0, policy_version 335062 (0.0007) [2023-12-27 21:38:13,199][106225] Updated weights for policy 1, policy_version 335666 (0.0008) [2023-12-27 21:38:13,217][106226] Updated weights for policy 0, policy_version 335072 (0.0006) [2023-12-27 21:38:13,256][106225] Updated weights for policy 1, policy_version 335676 (0.0009) [2023-12-27 21:38:13,283][106226] Updated weights for policy 0, policy_version 335082 (0.0007) [2023-12-27 21:38:13,309][106225] Updated weights for policy 1, policy_version 335686 (0.0007) [2023-12-27 21:38:13,360][106225] Updated weights for policy 1, policy_version 335696 (0.0008) [2023-12-27 21:38:13,900][106226] Updated weights for policy 0, policy_version 335092 (0.0006) [2023-12-27 21:38:13,961][106226] Updated weights for policy 0, policy_version 335102 (0.0009) [2023-12-27 21:38:14,022][106226] Updated weights for policy 0, policy_version 335112 (0.0005) [2023-12-27 21:38:14,163][106225] Updated weights for policy 1, policy_version 335706 (0.0007) [2023-12-27 21:38:14,219][106225] Updated weights for policy 1, policy_version 335716 (0.0008) [2023-12-27 21:38:14,265][106225] Updated weights for policy 1, policy_version 335726 (0.0007) [2023-12-27 21:38:14,607][106226] Updated weights for policy 0, policy_version 335122 (0.0005) [2023-12-27 21:38:14,656][106226] Updated weights for policy 0, policy_version 335132 (0.0010) [2023-12-27 21:38:14,709][106226] Updated weights for policy 0, policy_version 335142 (0.0006) [2023-12-27 21:38:14,778][106226] Updated weights for policy 0, policy_version 335152 (0.0011) [2023-12-27 21:38:14,997][106225] Updated weights for policy 1, policy_version 335736 (0.0008) [2023-12-27 21:38:15,056][106225] Updated weights for policy 1, policy_version 335746 (0.0008) [2023-12-27 21:38:15,116][106225] Updated weights for policy 1, policy_version 335756 (0.0008) [2023-12-27 21:38:15,422][106226] Updated weights for policy 0, policy_version 335162 (0.0006) [2023-12-27 21:38:15,486][106226] Updated weights for policy 0, policy_version 335172 (0.0006) [2023-12-27 21:38:15,556][106226] Updated weights for policy 0, policy_version 335182 (0.0005) [2023-12-27 21:38:15,868][106225] Updated weights for policy 1, policy_version 335766 (0.0008) [2023-12-27 21:38:15,925][106225] Updated weights for policy 1, policy_version 335776 (0.0005) [2023-12-27 21:38:15,987][106225] Updated weights for policy 1, policy_version 335786 (0.0005) [2023-12-27 21:38:16,091][106226] Updated weights for policy 0, policy_version 335192 (0.0006) [2023-12-27 21:38:16,147][106226] Updated weights for policy 0, policy_version 335202 (0.0006) [2023-12-27 21:38:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 171819008. Throughput: 0: 9929.4, 1: 9891.9. Samples: 171809064. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:16,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-5.581')] [2023-12-27 21:38:16,205][106226] Updated weights for policy 0, policy_version 335212 (0.0009) [2023-12-27 21:38:16,630][106225] Updated weights for policy 1, policy_version 335796 (0.0006) [2023-12-27 21:38:16,684][106225] Updated weights for policy 1, policy_version 335806 (0.0008) [2023-12-27 21:38:16,734][106225] Updated weights for policy 1, policy_version 335816 (0.0009) [2023-12-27 21:38:16,846][106226] Updated weights for policy 0, policy_version 335222 (0.0007) [2023-12-27 21:38:16,893][106226] Updated weights for policy 0, policy_version 335232 (0.0008) [2023-12-27 21:38:16,974][106226] Updated weights for policy 0, policy_version 335242 (0.0008) [2023-12-27 21:38:17,399][106225] Updated weights for policy 1, policy_version 335826 (0.0008) [2023-12-27 21:38:17,461][106225] Updated weights for policy 1, policy_version 335836 (0.0007) [2023-12-27 21:38:17,518][106225] Updated weights for policy 1, policy_version 335846 (0.0010) [2023-12-27 21:38:17,574][106225] Updated weights for policy 1, policy_version 335856 (0.0010) [2023-12-27 21:38:17,621][106226] Updated weights for policy 0, policy_version 335252 (0.0009) [2023-12-27 21:38:17,668][106226] Updated weights for policy 0, policy_version 335262 (0.0010) [2023-12-27 21:38:17,713][106226] Updated weights for policy 0, policy_version 335272 (0.0009) [2023-12-27 21:38:18,145][106225] Updated weights for policy 1, policy_version 335866 (0.0007) [2023-12-27 21:38:18,211][106225] Updated weights for policy 1, policy_version 335876 (0.0005) [2023-12-27 21:38:18,274][106225] Updated weights for policy 1, policy_version 335886 (0.0005) [2023-12-27 21:38:18,332][106226] Updated weights for policy 0, policy_version 335282 (0.0006) [2023-12-27 21:38:18,398][106226] Updated weights for policy 0, policy_version 335292 (0.0008) [2023-12-27 21:38:18,467][106226] Updated weights for policy 0, policy_version 335302 (0.0008) [2023-12-27 21:38:18,522][106226] Updated weights for policy 0, policy_version 335312 (0.0008) [2023-12-27 21:38:18,948][106225] Updated weights for policy 1, policy_version 335896 (0.0005) [2023-12-27 21:38:19,012][106225] Updated weights for policy 1, policy_version 335906 (0.0008) [2023-12-27 21:38:19,058][106225] Updated weights for policy 1, policy_version 335916 (0.0010) [2023-12-27 21:38:19,258][106226] Updated weights for policy 0, policy_version 335322 (0.0010) [2023-12-27 21:38:19,314][106226] Updated weights for policy 0, policy_version 335332 (0.0010) [2023-12-27 21:38:19,382][106226] Updated weights for policy 0, policy_version 335342 (0.0010) [2023-12-27 21:38:19,785][106225] Updated weights for policy 1, policy_version 335926 (0.0008) [2023-12-27 21:38:19,846][106225] Updated weights for policy 1, policy_version 335936 (0.0010) [2023-12-27 21:38:19,910][106225] Updated weights for policy 1, policy_version 335946 (0.0008) [2023-12-27 21:38:20,122][106226] Updated weights for policy 0, policy_version 335352 (0.0008) [2023-12-27 21:38:20,175][106226] Updated weights for policy 0, policy_version 335362 (0.0008) [2023-12-27 21:38:20,240][106226] Updated weights for policy 0, policy_version 335372 (0.0007) [2023-12-27 21:38:20,665][106225] Updated weights for policy 1, policy_version 335956 (0.0008) [2023-12-27 21:38:20,727][106225] Updated weights for policy 1, policy_version 335966 (0.0009) [2023-12-27 21:38:20,794][106225] Updated weights for policy 1, policy_version 335976 (0.0008) [2023-12-27 21:38:20,969][106226] Updated weights for policy 0, policy_version 335382 (0.0008) [2023-12-27 21:38:21,034][106226] Updated weights for policy 0, policy_version 335392 (0.0008) [2023-12-27 21:38:21,105][106226] Updated weights for policy 0, policy_version 335402 (0.0007) [2023-12-27 21:38:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19994.0). Total num frames: 171925504. Throughput: 0: 9934.6, 1: 9895.9. Samples: 171931188. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:21,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.808')] [2023-12-27 21:38:21,576][106225] Updated weights for policy 1, policy_version 335986 (0.0009) [2023-12-27 21:38:21,640][106225] Updated weights for policy 1, policy_version 335996 (0.0009) [2023-12-27 21:38:21,703][106225] Updated weights for policy 1, policy_version 336006 (0.0009) [2023-12-27 21:38:21,774][106225] Updated weights for policy 1, policy_version 336016 (0.0008) [2023-12-27 21:38:21,860][106226] Updated weights for policy 0, policy_version 335412 (0.0009) [2023-12-27 21:38:21,916][106226] Updated weights for policy 0, policy_version 335422 (0.0008) [2023-12-27 21:38:21,980][106226] Updated weights for policy 0, policy_version 335432 (0.0009) [2023-12-27 21:38:22,510][106225] Updated weights for policy 1, policy_version 336026 (0.0008) [2023-12-27 21:38:22,572][106225] Updated weights for policy 1, policy_version 336036 (0.0010) [2023-12-27 21:38:22,635][106225] Updated weights for policy 1, policy_version 336046 (0.0008) [2023-12-27 21:38:22,696][106226] Updated weights for policy 0, policy_version 335442 (0.0009) [2023-12-27 21:38:22,757][106226] Updated weights for policy 0, policy_version 335452 (0.0006) [2023-12-27 21:38:22,818][106226] Updated weights for policy 0, policy_version 335462 (0.0007) [2023-12-27 21:38:22,878][106226] Updated weights for policy 0, policy_version 335472 (0.0008) [2023-12-27 21:38:23,396][106225] Updated weights for policy 1, policy_version 336056 (0.0009) [2023-12-27 21:38:23,447][106225] Updated weights for policy 1, policy_version 336066 (0.0009) [2023-12-27 21:38:23,508][106225] Updated weights for policy 1, policy_version 336076 (0.0009) [2023-12-27 21:38:23,568][106226] Updated weights for policy 0, policy_version 335482 (0.0009) [2023-12-27 21:38:23,620][106226] Updated weights for policy 0, policy_version 335492 (0.0008) [2023-12-27 21:38:23,676][106226] Updated weights for policy 0, policy_version 335502 (0.0006) [2023-12-27 21:38:24,145][106225] Updated weights for policy 1, policy_version 336086 (0.0007) [2023-12-27 21:38:24,199][106225] Updated weights for policy 1, policy_version 336096 (0.0008) [2023-12-27 21:38:24,258][106225] Updated weights for policy 1, policy_version 336106 (0.0006) [2023-12-27 21:38:24,340][106226] Updated weights for policy 0, policy_version 335512 (0.0008) [2023-12-27 21:38:24,403][106226] Updated weights for policy 0, policy_version 335522 (0.0006) [2023-12-27 21:38:24,464][106226] Updated weights for policy 0, policy_version 335532 (0.0009) [2023-12-27 21:38:25,019][106225] Updated weights for policy 1, policy_version 336116 (0.0009) [2023-12-27 21:38:25,065][106226] Updated weights for policy 0, policy_version 335542 (0.0010) [2023-12-27 21:38:25,085][106225] Updated weights for policy 1, policy_version 336126 (0.0008) [2023-12-27 21:38:25,116][106226] Updated weights for policy 0, policy_version 335552 (0.0006) [2023-12-27 21:38:25,142][106225] Updated weights for policy 1, policy_version 336136 (0.0007) [2023-12-27 21:38:25,164][106226] Updated weights for policy 0, policy_version 335562 (0.0007) [2023-12-27 21:38:25,820][106225] Updated weights for policy 1, policy_version 336146 (0.0007) [2023-12-27 21:38:25,826][106226] Updated weights for policy 0, policy_version 335572 (0.0009) [2023-12-27 21:38:25,871][106225] Updated weights for policy 1, policy_version 336156 (0.0008) [2023-12-27 21:38:25,875][106226] Updated weights for policy 0, policy_version 335582 (0.0008) [2023-12-27 21:38:25,934][106225] Updated weights for policy 1, policy_version 336166 (0.0008) [2023-12-27 21:38:25,934][106226] Updated weights for policy 0, policy_version 335592 (0.0006) [2023-12-27 21:38:25,995][106225] Updated weights for policy 1, policy_version 336176 (0.0008) [2023-12-27 21:38:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 172023808. Throughput: 0: 9926.9, 1: 9855.8. Samples: 171987592. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:26,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.659')] [2023-12-27 21:38:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000336176_86081536.pth... [2023-12-27 21:38:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000335600_85942272.pth... [2023-12-27 21:38:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000335024_85786624.pth [2023-12-27 21:38:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000334416_85639168.pth [2023-12-27 21:38:26,624][106226] Updated weights for policy 0, policy_version 335602 (0.0011) [2023-12-27 21:38:26,644][106225] Updated weights for policy 1, policy_version 336186 (0.0008) [2023-12-27 21:38:26,680][106226] Updated weights for policy 0, policy_version 335612 (0.0010) [2023-12-27 21:38:26,701][106225] Updated weights for policy 1, policy_version 336196 (0.0008) [2023-12-27 21:38:26,736][106226] Updated weights for policy 0, policy_version 335622 (0.0010) [2023-12-27 21:38:26,764][106225] Updated weights for policy 1, policy_version 336206 (0.0005) [2023-12-27 21:38:26,788][106226] Updated weights for policy 0, policy_version 335632 (0.0010) [2023-12-27 21:38:27,296][106225] Updated weights for policy 1, policy_version 336216 (0.0006) [2023-12-27 21:38:27,355][106225] Updated weights for policy 1, policy_version 336226 (0.0008) [2023-12-27 21:38:27,415][106225] Updated weights for policy 1, policy_version 336236 (0.0007) [2023-12-27 21:38:27,505][106226] Updated weights for policy 0, policy_version 335642 (0.0010) [2023-12-27 21:38:27,568][106226] Updated weights for policy 0, policy_version 335652 (0.0010) [2023-12-27 21:38:27,630][106226] Updated weights for policy 0, policy_version 335662 (0.0010) [2023-12-27 21:38:28,006][106225] Updated weights for policy 1, policy_version 336246 (0.0007) [2023-12-27 21:38:28,053][106225] Updated weights for policy 1, policy_version 336256 (0.0005) [2023-12-27 21:38:28,111][106225] Updated weights for policy 1, policy_version 336266 (0.0005) [2023-12-27 21:38:28,316][106226] Updated weights for policy 0, policy_version 335672 (0.0010) [2023-12-27 21:38:28,381][106226] Updated weights for policy 0, policy_version 335682 (0.0009) [2023-12-27 21:38:28,447][106226] Updated weights for policy 0, policy_version 335692 (0.0010) [2023-12-27 21:38:28,728][106225] Updated weights for policy 1, policy_version 336276 (0.0007) [2023-12-27 21:38:28,795][106225] Updated weights for policy 1, policy_version 336286 (0.0010) [2023-12-27 21:38:28,853][106225] Updated weights for policy 1, policy_version 336296 (0.0010) [2023-12-27 21:38:29,089][106226] Updated weights for policy 0, policy_version 335702 (0.0007) [2023-12-27 21:38:29,146][106226] Updated weights for policy 0, policy_version 335712 (0.0005) [2023-12-27 21:38:29,202][106226] Updated weights for policy 0, policy_version 335722 (0.0005) [2023-12-27 21:38:29,600][106225] Updated weights for policy 1, policy_version 336306 (0.0010) [2023-12-27 21:38:29,671][106225] Updated weights for policy 1, policy_version 336316 (0.0011) [2023-12-27 21:38:29,733][106225] Updated weights for policy 1, policy_version 336326 (0.0010) [2023-12-27 21:38:29,793][106225] Updated weights for policy 1, policy_version 336336 (0.0010) [2023-12-27 21:38:29,860][106226] Updated weights for policy 0, policy_version 335732 (0.0009) [2023-12-27 21:38:29,923][106226] Updated weights for policy 0, policy_version 335742 (0.0010) [2023-12-27 21:38:29,984][106226] Updated weights for policy 0, policy_version 335752 (0.0010) [2023-12-27 21:38:30,528][106225] Updated weights for policy 1, policy_version 336346 (0.0010) [2023-12-27 21:38:30,590][106225] Updated weights for policy 1, policy_version 336356 (0.0010) [2023-12-27 21:38:30,638][106226] Updated weights for policy 0, policy_version 335762 (0.0010) [2023-12-27 21:38:30,645][106225] Updated weights for policy 1, policy_version 336366 (0.0010) [2023-12-27 21:38:30,684][106226] Updated weights for policy 0, policy_version 335772 (0.0006) [2023-12-27 21:38:30,730][106226] Updated weights for policy 0, policy_version 335782 (0.0007) [2023-12-27 21:38:30,786][106226] Updated weights for policy 0, policy_version 335792 (0.0005) [2023-12-27 21:38:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 172122112. Throughput: 0: 10011.1, 1: 10008.2. Samples: 172112584. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:31,175][105115] Avg episode reward: [(0, '-5.033'), (1, '-5.561')] [2023-12-27 21:38:31,368][106225] Updated weights for policy 1, policy_version 336376 (0.0008) [2023-12-27 21:38:31,438][106225] Updated weights for policy 1, policy_version 336386 (0.0011) [2023-12-27 21:38:31,498][106225] Updated weights for policy 1, policy_version 336396 (0.0010) [2023-12-27 21:38:31,556][106226] Updated weights for policy 0, policy_version 335802 (0.0007) [2023-12-27 21:38:31,621][106226] Updated weights for policy 0, policy_version 335812 (0.0007) [2023-12-27 21:38:31,687][106226] Updated weights for policy 0, policy_version 335822 (0.0009) [2023-12-27 21:38:32,175][106225] Updated weights for policy 1, policy_version 336406 (0.0008) [2023-12-27 21:38:32,234][106225] Updated weights for policy 1, policy_version 336416 (0.0008) [2023-12-27 21:38:32,298][106225] Updated weights for policy 1, policy_version 336426 (0.0007) [2023-12-27 21:38:32,350][106226] Updated weights for policy 0, policy_version 335832 (0.0007) [2023-12-27 21:38:32,416][106226] Updated weights for policy 0, policy_version 335842 (0.0008) [2023-12-27 21:38:32,464][106226] Updated weights for policy 0, policy_version 335852 (0.0008) [2023-12-27 21:38:32,874][106225] Updated weights for policy 1, policy_version 336436 (0.0006) [2023-12-27 21:38:32,928][106225] Updated weights for policy 1, policy_version 336446 (0.0008) [2023-12-27 21:38:32,981][106225] Updated weights for policy 1, policy_version 336456 (0.0009) [2023-12-27 21:38:33,128][106226] Updated weights for policy 0, policy_version 335862 (0.0009) [2023-12-27 21:38:33,182][106226] Updated weights for policy 0, policy_version 335872 (0.0010) [2023-12-27 21:38:33,232][106226] Updated weights for policy 0, policy_version 335882 (0.0010) [2023-12-27 21:38:33,607][106225] Updated weights for policy 1, policy_version 336466 (0.0008) [2023-12-27 21:38:33,651][106225] Updated weights for policy 1, policy_version 336476 (0.0005) [2023-12-27 21:38:33,716][106225] Updated weights for policy 1, policy_version 336486 (0.0005) [2023-12-27 21:38:33,783][106225] Updated weights for policy 1, policy_version 336496 (0.0005) [2023-12-27 21:38:33,857][106226] Updated weights for policy 0, policy_version 335892 (0.0008) [2023-12-27 21:38:33,911][106226] Updated weights for policy 0, policy_version 335902 (0.0008) [2023-12-27 21:38:33,961][106226] Updated weights for policy 0, policy_version 335912 (0.0009) [2023-12-27 21:38:34,305][106225] Updated weights for policy 1, policy_version 336506 (0.0008) [2023-12-27 21:38:34,365][106225] Updated weights for policy 1, policy_version 336516 (0.0008) [2023-12-27 21:38:34,427][106225] Updated weights for policy 1, policy_version 336526 (0.0008) [2023-12-27 21:38:34,725][106226] Updated weights for policy 0, policy_version 335922 (0.0008) [2023-12-27 21:38:34,786][106226] Updated weights for policy 0, policy_version 335932 (0.0010) [2023-12-27 21:38:34,850][106226] Updated weights for policy 0, policy_version 335942 (0.0009) [2023-12-27 21:38:34,917][106226] Updated weights for policy 0, policy_version 335952 (0.0009) [2023-12-27 21:38:35,109][106225] Updated weights for policy 1, policy_version 336536 (0.0006) [2023-12-27 21:38:35,173][106225] Updated weights for policy 1, policy_version 336546 (0.0005) [2023-12-27 21:38:35,228][106225] Updated weights for policy 1, policy_version 336556 (0.0006) [2023-12-27 21:38:35,527][106226] Updated weights for policy 0, policy_version 335962 (0.0008) [2023-12-27 21:38:35,577][106226] Updated weights for policy 0, policy_version 335972 (0.0009) [2023-12-27 21:38:35,632][106226] Updated weights for policy 0, policy_version 335982 (0.0008) [2023-12-27 21:38:35,794][106225] Updated weights for policy 1, policy_version 336566 (0.0005) [2023-12-27 21:38:35,849][106225] Updated weights for policy 1, policy_version 336576 (0.0005) [2023-12-27 21:38:35,905][106225] Updated weights for policy 1, policy_version 336586 (0.0006) [2023-12-27 21:38:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 172228608. Throughput: 0: 10032.5, 1: 10039.2. Samples: 172237396. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:36,175][105115] Avg episode reward: [(0, '-5.002'), (1, '-5.656')] [2023-12-27 21:38:36,396][106226] Updated weights for policy 0, policy_version 335992 (0.0008) [2023-12-27 21:38:36,455][106226] Updated weights for policy 0, policy_version 336002 (0.0009) [2023-12-27 21:38:36,516][106226] Updated weights for policy 0, policy_version 336012 (0.0008) [2023-12-27 21:38:36,566][106225] Updated weights for policy 1, policy_version 336596 (0.0009) [2023-12-27 21:38:36,627][106225] Updated weights for policy 1, policy_version 336606 (0.0010) [2023-12-27 21:38:36,692][106225] Updated weights for policy 1, policy_version 336616 (0.0010) [2023-12-27 21:38:37,291][106225] Updated weights for policy 1, policy_version 336626 (0.0010) [2023-12-27 21:38:37,298][106226] Updated weights for policy 0, policy_version 336022 (0.0007) [2023-12-27 21:38:37,350][106225] Updated weights for policy 1, policy_version 336636 (0.0011) [2023-12-27 21:38:37,352][106226] Updated weights for policy 0, policy_version 336032 (0.0005) [2023-12-27 21:38:37,410][106225] Updated weights for policy 1, policy_version 336646 (0.0008) [2023-12-27 21:38:37,421][106226] Updated weights for policy 0, policy_version 336042 (0.0007) [2023-12-27 21:38:37,469][106225] Updated weights for policy 1, policy_version 336656 (0.0005) [2023-12-27 21:38:38,137][106226] Updated weights for policy 0, policy_version 336052 (0.0008) [2023-12-27 21:38:38,167][106225] Updated weights for policy 1, policy_version 336666 (0.0010) [2023-12-27 21:38:38,201][106226] Updated weights for policy 0, policy_version 336062 (0.0007) [2023-12-27 21:38:38,234][106225] Updated weights for policy 1, policy_version 336676 (0.0011) [2023-12-27 21:38:38,264][106226] Updated weights for policy 0, policy_version 336072 (0.0006) [2023-12-27 21:38:38,302][106225] Updated weights for policy 1, policy_version 336686 (0.0010) [2023-12-27 21:38:39,006][106226] Updated weights for policy 0, policy_version 336082 (0.0008) [2023-12-27 21:38:39,022][106225] Updated weights for policy 1, policy_version 336696 (0.0009) [2023-12-27 21:38:39,070][106226] Updated weights for policy 0, policy_version 336092 (0.0005) [2023-12-27 21:38:39,081][106225] Updated weights for policy 1, policy_version 336706 (0.0008) [2023-12-27 21:38:39,132][106226] Updated weights for policy 0, policy_version 336102 (0.0006) [2023-12-27 21:38:39,132][106225] Updated weights for policy 1, policy_version 336716 (0.0008) [2023-12-27 21:38:39,186][106226] Updated weights for policy 0, policy_version 336112 (0.0008) [2023-12-27 21:38:39,841][106225] Updated weights for policy 1, policy_version 336726 (0.0007) [2023-12-27 21:38:39,906][106225] Updated weights for policy 1, policy_version 336736 (0.0008) [2023-12-27 21:38:39,922][106226] Updated weights for policy 0, policy_version 336122 (0.0007) [2023-12-27 21:38:39,980][106225] Updated weights for policy 1, policy_version 336746 (0.0007) [2023-12-27 21:38:39,989][106226] Updated weights for policy 0, policy_version 336132 (0.0008) [2023-12-27 21:38:40,054][106226] Updated weights for policy 0, policy_version 336142 (0.0007) [2023-12-27 21:38:40,720][106225] Updated weights for policy 1, policy_version 336756 (0.0008) [2023-12-27 21:38:40,767][106226] Updated weights for policy 0, policy_version 336152 (0.0007) [2023-12-27 21:38:40,781][106225] Updated weights for policy 1, policy_version 336766 (0.0009) [2023-12-27 21:38:40,825][106226] Updated weights for policy 0, policy_version 336162 (0.0007) [2023-12-27 21:38:40,849][106225] Updated weights for policy 1, policy_version 336776 (0.0009) [2023-12-27 21:38:40,880][106226] Updated weights for policy 0, policy_version 336172 (0.0006) [2023-12-27 21:38:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 172326912. Throughput: 0: 10029.8, 1: 10042.7. Samples: 172296396. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:41,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.970')] [2023-12-27 21:38:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000336784_86237184.pth... [2023-12-27 21:38:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000336176_86089728.pth... [2023-12-27 21:38:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000335600_85934080.pth [2023-12-27 21:38:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000334992_85786624.pth [2023-12-27 21:38:41,603][106225] Updated weights for policy 1, policy_version 336786 (0.0008) [2023-12-27 21:38:41,606][106226] Updated weights for policy 0, policy_version 336182 (0.0008) [2023-12-27 21:38:41,671][106225] Updated weights for policy 1, policy_version 336796 (0.0012) [2023-12-27 21:38:41,673][106226] Updated weights for policy 0, policy_version 336192 (0.0008) [2023-12-27 21:38:41,734][106225] Updated weights for policy 1, policy_version 336806 (0.0008) [2023-12-27 21:38:41,744][106226] Updated weights for policy 0, policy_version 336202 (0.0008) [2023-12-27 21:38:41,798][106225] Updated weights for policy 1, policy_version 336816 (0.0009) [2023-12-27 21:38:42,439][106226] Updated weights for policy 0, policy_version 336212 (0.0007) [2023-12-27 21:38:42,497][106226] Updated weights for policy 0, policy_version 336222 (0.0008) [2023-12-27 21:38:42,551][106226] Updated weights for policy 0, policy_version 336232 (0.0008) [2023-12-27 21:38:42,581][106225] Updated weights for policy 1, policy_version 336826 (0.0008) [2023-12-27 21:38:42,631][106225] Updated weights for policy 1, policy_version 336836 (0.0008) [2023-12-27 21:38:42,700][106225] Updated weights for policy 1, policy_version 336846 (0.0008) [2023-12-27 21:38:43,277][106226] Updated weights for policy 0, policy_version 336242 (0.0007) [2023-12-27 21:38:43,322][106225] Updated weights for policy 1, policy_version 336856 (0.0006) [2023-12-27 21:38:43,328][106226] Updated weights for policy 0, policy_version 336252 (0.0010) [2023-12-27 21:38:43,374][106226] Updated weights for policy 0, policy_version 336262 (0.0010) [2023-12-27 21:38:43,383][106225] Updated weights for policy 1, policy_version 336866 (0.0006) [2023-12-27 21:38:43,431][106226] Updated weights for policy 0, policy_version 336272 (0.0010) [2023-12-27 21:38:43,434][106225] Updated weights for policy 1, policy_version 336876 (0.0006) [2023-12-27 21:38:44,104][106226] Updated weights for policy 0, policy_version 336282 (0.0008) [2023-12-27 21:38:44,144][106225] Updated weights for policy 1, policy_version 336886 (0.0010) [2023-12-27 21:38:44,161][106226] Updated weights for policy 0, policy_version 336292 (0.0011) [2023-12-27 21:38:44,201][106225] Updated weights for policy 1, policy_version 336896 (0.0010) [2023-12-27 21:38:44,208][106226] Updated weights for policy 0, policy_version 336302 (0.0010) [2023-12-27 21:38:44,262][106225] Updated weights for policy 1, policy_version 336906 (0.0009) [2023-12-27 21:38:44,935][106225] Updated weights for policy 1, policy_version 336916 (0.0009) [2023-12-27 21:38:44,940][106226] Updated weights for policy 0, policy_version 336312 (0.0009) [2023-12-27 21:38:44,994][106225] Updated weights for policy 1, policy_version 336926 (0.0010) [2023-12-27 21:38:44,996][106226] Updated weights for policy 0, policy_version 336322 (0.0006) [2023-12-27 21:38:45,054][106225] Updated weights for policy 1, policy_version 336936 (0.0011) [2023-12-27 21:38:45,054][106226] Updated weights for policy 0, policy_version 336332 (0.0006) [2023-12-27 21:38:45,767][106226] Updated weights for policy 0, policy_version 336342 (0.0008) [2023-12-27 21:38:45,772][106225] Updated weights for policy 1, policy_version 336946 (0.0010) [2023-12-27 21:38:45,826][106226] Updated weights for policy 0, policy_version 336352 (0.0007) [2023-12-27 21:38:45,831][106225] Updated weights for policy 1, policy_version 336956 (0.0009) [2023-12-27 21:38:45,881][106225] Updated weights for policy 1, policy_version 336966 (0.0010) [2023-12-27 21:38:45,886][106226] Updated weights for policy 0, policy_version 336362 (0.0006) [2023-12-27 21:38:45,934][106225] Updated weights for policy 1, policy_version 336976 (0.0009) [2023-12-27 21:38:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 172425216. Throughput: 0: 10019.7, 1: 9954.9. Samples: 172411840. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:46,176][105115] Avg episode reward: [(0, '-4.667'), (1, '-5.528')] [2023-12-27 21:38:46,492][106226] Updated weights for policy 0, policy_version 336372 (0.0005) [2023-12-27 21:38:46,553][106226] Updated weights for policy 0, policy_version 336382 (0.0005) [2023-12-27 21:38:46,564][106225] Updated weights for policy 1, policy_version 336986 (0.0010) [2023-12-27 21:38:46,603][106226] Updated weights for policy 0, policy_version 336392 (0.0006) [2023-12-27 21:38:46,624][106225] Updated weights for policy 1, policy_version 336996 (0.0008) [2023-12-27 21:38:46,680][106225] Updated weights for policy 1, policy_version 337007 (0.0008) [2023-12-27 21:38:47,267][106226] Updated weights for policy 0, policy_version 336402 (0.0007) [2023-12-27 21:38:47,328][106226] Updated weights for policy 0, policy_version 336412 (0.0009) [2023-12-27 21:38:47,380][106226] Updated weights for policy 0, policy_version 336422 (0.0008) [2023-12-27 21:38:47,387][106225] Updated weights for policy 1, policy_version 337017 (0.0005) [2023-12-27 21:38:47,434][106226] Updated weights for policy 0, policy_version 336432 (0.0009) [2023-12-27 21:38:47,435][106225] Updated weights for policy 1, policy_version 337027 (0.0005) [2023-12-27 21:38:47,486][106225] Updated weights for policy 1, policy_version 337037 (0.0005) [2023-12-27 21:38:48,148][106225] Updated weights for policy 1, policy_version 337047 (0.0010) [2023-12-27 21:38:48,184][106226] Updated weights for policy 0, policy_version 336442 (0.0006) [2023-12-27 21:38:48,207][106225] Updated weights for policy 1, policy_version 337057 (0.0010) [2023-12-27 21:38:48,248][106226] Updated weights for policy 0, policy_version 336452 (0.0006) [2023-12-27 21:38:48,265][106225] Updated weights for policy 1, policy_version 337067 (0.0010) [2023-12-27 21:38:48,298][106226] Updated weights for policy 0, policy_version 336462 (0.0006) [2023-12-27 21:38:48,972][106225] Updated weights for policy 1, policy_version 337077 (0.0010) [2023-12-27 21:38:48,986][106226] Updated weights for policy 0, policy_version 336472 (0.0007) [2023-12-27 21:38:49,029][106225] Updated weights for policy 1, policy_version 337087 (0.0010) [2023-12-27 21:38:49,036][106226] Updated weights for policy 0, policy_version 336482 (0.0007) [2023-12-27 21:38:49,083][106225] Updated weights for policy 1, policy_version 337097 (0.0010) [2023-12-27 21:38:49,090][106226] Updated weights for policy 0, policy_version 336492 (0.0007) [2023-12-27 21:38:49,779][106226] Updated weights for policy 0, policy_version 336502 (0.0010) [2023-12-27 21:38:49,835][106225] Updated weights for policy 1, policy_version 337107 (0.0008) [2023-12-27 21:38:49,843][106226] Updated weights for policy 0, policy_version 336512 (0.0011) [2023-12-27 21:38:49,901][106225] Updated weights for policy 1, policy_version 337117 (0.0006) [2023-12-27 21:38:49,907][106226] Updated weights for policy 0, policy_version 336522 (0.0010) [2023-12-27 21:38:49,973][106225] Updated weights for policy 1, policy_version 337127 (0.0008) [2023-12-27 21:38:50,610][106226] Updated weights for policy 0, policy_version 336532 (0.0010) [2023-12-27 21:38:50,677][106226] Updated weights for policy 0, policy_version 336542 (0.0008) [2023-12-27 21:38:50,689][106225] Updated weights for policy 1, policy_version 337137 (0.0008) [2023-12-27 21:38:50,744][106226] Updated weights for policy 0, policy_version 336552 (0.0008) [2023-12-27 21:38:50,750][106225] Updated weights for policy 1, policy_version 337147 (0.0010) [2023-12-27 21:38:50,815][106225] Updated weights for policy 1, policy_version 337157 (0.0008) [2023-12-27 21:38:50,882][106225] Updated weights for policy 1, policy_version 337167 (0.0006) [2023-12-27 21:38:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 172523520. Throughput: 0: 9961.2, 1: 9919.4. Samples: 172531328. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:51,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.878')] [2023-12-27 21:38:51,481][106226] Updated weights for policy 0, policy_version 336562 (0.0009) [2023-12-27 21:38:51,536][106226] Updated weights for policy 0, policy_version 336572 (0.0011) [2023-12-27 21:38:51,562][106225] Updated weights for policy 1, policy_version 337177 (0.0007) [2023-12-27 21:38:51,598][106226] Updated weights for policy 0, policy_version 336582 (0.0011) [2023-12-27 21:38:51,623][106225] Updated weights for policy 1, policy_version 337187 (0.0012) [2023-12-27 21:38:51,664][106226] Updated weights for policy 0, policy_version 336592 (0.0009) [2023-12-27 21:38:51,688][106225] Updated weights for policy 1, policy_version 337197 (0.0009) [2023-12-27 21:38:52,309][106226] Updated weights for policy 0, policy_version 336602 (0.0008) [2023-12-27 21:38:52,370][106226] Updated weights for policy 0, policy_version 336612 (0.0008) [2023-12-27 21:38:52,437][106226] Updated weights for policy 0, policy_version 336622 (0.0006) [2023-12-27 21:38:52,463][106225] Updated weights for policy 1, policy_version 337207 (0.0008) [2023-12-27 21:38:52,523][106225] Updated weights for policy 1, policy_version 337217 (0.0005) [2023-12-27 21:38:52,592][106225] Updated weights for policy 1, policy_version 337227 (0.0006) [2023-12-27 21:38:53,061][106226] Updated weights for policy 0, policy_version 336632 (0.0008) [2023-12-27 21:38:53,120][106226] Updated weights for policy 0, policy_version 336642 (0.0009) [2023-12-27 21:38:53,174][106226] Updated weights for policy 0, policy_version 336652 (0.0008) [2023-12-27 21:38:53,259][106225] Updated weights for policy 1, policy_version 337237 (0.0006) [2023-12-27 21:38:53,321][106225] Updated weights for policy 1, policy_version 337247 (0.0007) [2023-12-27 21:38:53,374][106225] Updated weights for policy 1, policy_version 337257 (0.0009) [2023-12-27 21:38:53,877][106226] Updated weights for policy 0, policy_version 336662 (0.0007) [2023-12-27 21:38:53,925][106226] Updated weights for policy 0, policy_version 336672 (0.0005) [2023-12-27 21:38:53,981][106226] Updated weights for policy 0, policy_version 336682 (0.0005) [2023-12-27 21:38:54,140][106225] Updated weights for policy 1, policy_version 337267 (0.0009) [2023-12-27 21:38:54,198][106225] Updated weights for policy 1, policy_version 337277 (0.0010) [2023-12-27 21:38:54,268][106225] Updated weights for policy 1, policy_version 337287 (0.0011) [2023-12-27 21:38:54,520][106226] Updated weights for policy 0, policy_version 336692 (0.0007) [2023-12-27 21:38:54,580][106226] Updated weights for policy 0, policy_version 336702 (0.0006) [2023-12-27 21:38:54,648][106226] Updated weights for policy 0, policy_version 336712 (0.0006) [2023-12-27 21:38:54,956][106225] Updated weights for policy 1, policy_version 337297 (0.0010) [2023-12-27 21:38:55,019][106225] Updated weights for policy 1, policy_version 337307 (0.0007) [2023-12-27 21:38:55,084][106225] Updated weights for policy 1, policy_version 337317 (0.0009) [2023-12-27 21:38:55,156][106225] Updated weights for policy 1, policy_version 337327 (0.0010) [2023-12-27 21:38:55,177][106226] Updated weights for policy 0, policy_version 336722 (0.0007) [2023-12-27 21:38:55,229][106226] Updated weights for policy 0, policy_version 336732 (0.0007) [2023-12-27 21:38:55,298][106226] Updated weights for policy 0, policy_version 336742 (0.0009) [2023-12-27 21:38:55,344][106226] Updated weights for policy 0, policy_version 336752 (0.0008) [2023-12-27 21:38:55,859][106225] Updated weights for policy 1, policy_version 337337 (0.0006) [2023-12-27 21:38:55,938][106225] Updated weights for policy 1, policy_version 337347 (0.0005) [2023-12-27 21:38:55,990][106225] Updated weights for policy 1, policy_version 337357 (0.0007) [2023-12-27 21:38:56,029][106226] Updated weights for policy 0, policy_version 336762 (0.0007) [2023-12-27 21:38:56,089][106226] Updated weights for policy 0, policy_version 336772 (0.0008) [2023-12-27 21:38:56,146][106226] Updated weights for policy 0, policy_version 336782 (0.0008) [2023-12-27 21:38:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.3, 300 sec: 20021.8). Total num frames: 172630016. Throughput: 0: 9974.7, 1: 9952.0. Samples: 172590748. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:38:56,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.970')] [2023-12-27 21:38:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000337360_86384640.pth... [2023-12-27 21:38:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000336784_86245376.pth... [2023-12-27 21:38:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000336176_86081536.pth [2023-12-27 21:38:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000335600_85942272.pth [2023-12-27 21:38:56,602][106225] Updated weights for policy 1, policy_version 337367 (0.0007) [2023-12-27 21:38:56,658][106225] Updated weights for policy 1, policy_version 337377 (0.0010) [2023-12-27 21:38:56,704][106225] Updated weights for policy 1, policy_version 337387 (0.0010) [2023-12-27 21:38:56,895][106226] Updated weights for policy 0, policy_version 336792 (0.0007) [2023-12-27 21:38:56,947][106226] Updated weights for policy 0, policy_version 336802 (0.0009) [2023-12-27 21:38:57,002][106226] Updated weights for policy 0, policy_version 336812 (0.0015) [2023-12-27 21:38:57,300][106225] Updated weights for policy 1, policy_version 337397 (0.0010) [2023-12-27 21:38:57,357][106225] Updated weights for policy 1, policy_version 337407 (0.0010) [2023-12-27 21:38:57,418][106225] Updated weights for policy 1, policy_version 337417 (0.0010) [2023-12-27 21:38:57,656][106226] Updated weights for policy 0, policy_version 336823 (0.0007) [2023-12-27 21:38:57,717][106226] Updated weights for policy 0, policy_version 336833 (0.0005) [2023-12-27 21:38:57,769][106226] Updated weights for policy 0, policy_version 336843 (0.0005) [2023-12-27 21:38:58,131][106225] Updated weights for policy 1, policy_version 337427 (0.0010) [2023-12-27 21:38:58,187][106225] Updated weights for policy 1, policy_version 337437 (0.0010) [2023-12-27 21:38:58,250][106225] Updated weights for policy 1, policy_version 337447 (0.0009) [2023-12-27 21:38:58,405][106226] Updated weights for policy 0, policy_version 336853 (0.0007) [2023-12-27 21:38:58,471][106226] Updated weights for policy 0, policy_version 336863 (0.0008) [2023-12-27 21:38:58,532][106226] Updated weights for policy 0, policy_version 336873 (0.0008) [2023-12-27 21:38:59,015][106225] Updated weights for policy 1, policy_version 337457 (0.0010) [2023-12-27 21:38:59,082][106225] Updated weights for policy 1, policy_version 337467 (0.0006) [2023-12-27 21:38:59,152][106225] Updated weights for policy 1, policy_version 337477 (0.0005) [2023-12-27 21:38:59,221][106225] Updated weights for policy 1, policy_version 337487 (0.0007) [2023-12-27 21:38:59,318][106226] Updated weights for policy 0, policy_version 336883 (0.0008) [2023-12-27 21:38:59,389][106226] Updated weights for policy 0, policy_version 336893 (0.0008) [2023-12-27 21:38:59,443][106226] Updated weights for policy 0, policy_version 336903 (0.0008) [2023-12-27 21:38:59,852][106225] Updated weights for policy 1, policy_version 337497 (0.0007) [2023-12-27 21:38:59,914][106225] Updated weights for policy 1, policy_version 337507 (0.0009) [2023-12-27 21:38:59,979][106225] Updated weights for policy 1, policy_version 337517 (0.0008) [2023-12-27 21:39:00,192][106226] Updated weights for policy 0, policy_version 336913 (0.0008) [2023-12-27 21:39:00,251][106226] Updated weights for policy 0, policy_version 336923 (0.0008) [2023-12-27 21:39:00,317][106226] Updated weights for policy 0, policy_version 336933 (0.0008) [2023-12-27 21:39:00,372][106226] Updated weights for policy 0, policy_version 336943 (0.0008) [2023-12-27 21:39:00,700][106225] Updated weights for policy 1, policy_version 337527 (0.0008) [2023-12-27 21:39:00,748][106225] Updated weights for policy 1, policy_version 337537 (0.0008) [2023-12-27 21:39:00,807][106225] Updated weights for policy 1, policy_version 337547 (0.0008) [2023-12-27 21:39:01,078][106226] Updated weights for policy 0, policy_version 336953 (0.0009) [2023-12-27 21:39:01,137][106226] Updated weights for policy 0, policy_version 336963 (0.0008) [2023-12-27 21:39:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 172720128. Throughput: 0: 10052.4, 1: 10032.2. Samples: 172712876. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:39:01,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-5.910')] [2023-12-27 21:39:01,203][106226] Updated weights for policy 0, policy_version 336973 (0.0009) [2023-12-27 21:39:01,549][106225] Updated weights for policy 1, policy_version 337557 (0.0008) [2023-12-27 21:39:01,600][106225] Updated weights for policy 1, policy_version 337567 (0.0008) [2023-12-27 21:39:01,664][106225] Updated weights for policy 1, policy_version 337577 (0.0009) [2023-12-27 21:39:01,992][106226] Updated weights for policy 0, policy_version 336983 (0.0009) [2023-12-27 21:39:02,041][106226] Updated weights for policy 0, policy_version 336993 (0.0008) [2023-12-27 21:39:02,098][106226] Updated weights for policy 0, policy_version 337003 (0.0008) [2023-12-27 21:39:02,326][106225] Updated weights for policy 1, policy_version 337587 (0.0009) [2023-12-27 21:39:02,396][106225] Updated weights for policy 1, policy_version 337597 (0.0010) [2023-12-27 21:39:02,452][106225] Updated weights for policy 1, policy_version 337607 (0.0009) [2023-12-27 21:39:02,889][106226] Updated weights for policy 0, policy_version 337013 (0.0008) [2023-12-27 21:39:02,943][106226] Updated weights for policy 0, policy_version 337023 (0.0008) [2023-12-27 21:39:02,996][106226] Updated weights for policy 0, policy_version 337033 (0.0006) [2023-12-27 21:39:03,205][106225] Updated weights for policy 1, policy_version 337617 (0.0009) [2023-12-27 21:39:03,261][106225] Updated weights for policy 1, policy_version 337627 (0.0010) [2023-12-27 21:39:03,310][106225] Updated weights for policy 1, policy_version 337637 (0.0010) [2023-12-27 21:39:03,363][106225] Updated weights for policy 1, policy_version 337647 (0.0010) [2023-12-27 21:39:03,540][106226] Updated weights for policy 0, policy_version 337043 (0.0005) [2023-12-27 21:39:03,592][106226] Updated weights for policy 0, policy_version 337053 (0.0005) [2023-12-27 21:39:03,638][106226] Updated weights for policy 0, policy_version 337063 (0.0005) [2023-12-27 21:39:04,070][106225] Updated weights for policy 1, policy_version 337657 (0.0006) [2023-12-27 21:39:04,134][106225] Updated weights for policy 1, policy_version 337667 (0.0008) [2023-12-27 21:39:04,195][106225] Updated weights for policy 1, policy_version 337677 (0.0010) [2023-12-27 21:39:04,229][106226] Updated weights for policy 0, policy_version 337073 (0.0008) [2023-12-27 21:39:04,290][106226] Updated weights for policy 0, policy_version 337083 (0.0008) [2023-12-27 21:39:04,348][106226] Updated weights for policy 0, policy_version 337093 (0.0008) [2023-12-27 21:39:04,413][106226] Updated weights for policy 0, policy_version 337103 (0.0005) [2023-12-27 21:39:04,855][106225] Updated weights for policy 1, policy_version 337687 (0.0007) [2023-12-27 21:39:04,912][106225] Updated weights for policy 1, policy_version 337697 (0.0009) [2023-12-27 21:39:04,966][106225] Updated weights for policy 1, policy_version 337707 (0.0010) [2023-12-27 21:39:05,082][106226] Updated weights for policy 0, policy_version 337113 (0.0007) [2023-12-27 21:39:05,127][106226] Updated weights for policy 0, policy_version 337123 (0.0007) [2023-12-27 21:39:05,176][106226] Updated weights for policy 0, policy_version 337133 (0.0009) [2023-12-27 21:39:05,673][106225] Updated weights for policy 1, policy_version 337717 (0.0009) [2023-12-27 21:39:05,729][106225] Updated weights for policy 1, policy_version 337727 (0.0009) [2023-12-27 21:39:05,773][106225] Updated weights for policy 1, policy_version 337737 (0.0010) [2023-12-27 21:39:05,899][106226] Updated weights for policy 0, policy_version 337143 (0.0008) [2023-12-27 21:39:05,947][106226] Updated weights for policy 0, policy_version 337153 (0.0008) [2023-12-27 21:39:05,995][106226] Updated weights for policy 0, policy_version 337163 (0.0007) [2023-12-27 21:39:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 20021.8). Total num frames: 172826624. Throughput: 0: 10015.9, 1: 10010.1. Samples: 172832360. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:39:06,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.849')] [2023-12-27 21:39:06,535][106225] Updated weights for policy 1, policy_version 337747 (0.0010) [2023-12-27 21:39:06,591][106225] Updated weights for policy 1, policy_version 337757 (0.0010) [2023-12-27 21:39:06,655][106225] Updated weights for policy 1, policy_version 337767 (0.0011) [2023-12-27 21:39:06,796][106226] Updated weights for policy 0, policy_version 337173 (0.0008) [2023-12-27 21:39:06,859][106226] Updated weights for policy 0, policy_version 337183 (0.0008) [2023-12-27 21:39:06,914][106226] Updated weights for policy 0, policy_version 337193 (0.0008) [2023-12-27 21:39:07,370][106225] Updated weights for policy 1, policy_version 337777 (0.0010) [2023-12-27 21:39:07,424][106225] Updated weights for policy 1, policy_version 337787 (0.0010) [2023-12-27 21:39:07,480][106225] Updated weights for policy 1, policy_version 337797 (0.0010) [2023-12-27 21:39:07,534][106225] Updated weights for policy 1, policy_version 337807 (0.0010) [2023-12-27 21:39:07,644][106226] Updated weights for policy 0, policy_version 337203 (0.0009) [2023-12-27 21:39:07,696][106226] Updated weights for policy 0, policy_version 337213 (0.0010) [2023-12-27 21:39:07,753][106226] Updated weights for policy 0, policy_version 337223 (0.0010) [2023-12-27 21:39:08,171][106225] Updated weights for policy 1, policy_version 337817 (0.0010) [2023-12-27 21:39:08,235][106225] Updated weights for policy 1, policy_version 337827 (0.0010) [2023-12-27 21:39:08,283][106225] Updated weights for policy 1, policy_version 337837 (0.0010) [2023-12-27 21:39:08,444][106226] Updated weights for policy 0, policy_version 337233 (0.0011) [2023-12-27 21:39:08,501][106226] Updated weights for policy 0, policy_version 337243 (0.0007) [2023-12-27 21:39:08,553][106226] Updated weights for policy 0, policy_version 337253 (0.0005) [2023-12-27 21:39:08,608][106226] Updated weights for policy 0, policy_version 337263 (0.0005) [2023-12-27 21:39:09,098][106225] Updated weights for policy 1, policy_version 337847 (0.0008) [2023-12-27 21:39:09,154][106225] Updated weights for policy 1, policy_version 337857 (0.0008) [2023-12-27 21:39:09,210][106225] Updated weights for policy 1, policy_version 337867 (0.0009) [2023-12-27 21:39:09,225][106226] Updated weights for policy 0, policy_version 337273 (0.0007) [2023-12-27 21:39:09,290][106226] Updated weights for policy 0, policy_version 337283 (0.0009) [2023-12-27 21:39:09,356][106226] Updated weights for policy 0, policy_version 337293 (0.0008) [2023-12-27 21:39:09,987][106225] Updated weights for policy 1, policy_version 337877 (0.0007) [2023-12-27 21:39:10,047][106225] Updated weights for policy 1, policy_version 337887 (0.0007) [2023-12-27 21:39:10,112][106225] Updated weights for policy 1, policy_version 337897 (0.0006) [2023-12-27 21:39:10,134][106226] Updated weights for policy 0, policy_version 337303 (0.0009) [2023-12-27 21:39:10,198][106226] Updated weights for policy 0, policy_version 337313 (0.0010) [2023-12-27 21:39:10,267][106226] Updated weights for policy 0, policy_version 337323 (0.0010) [2023-12-27 21:39:10,781][106225] Updated weights for policy 1, policy_version 337907 (0.0007) [2023-12-27 21:39:10,847][106225] Updated weights for policy 1, policy_version 337917 (0.0009) [2023-12-27 21:39:10,901][106225] Updated weights for policy 1, policy_version 337927 (0.0008) [2023-12-27 21:39:10,924][106226] Updated weights for policy 0, policy_version 337333 (0.0009) [2023-12-27 21:39:10,993][106226] Updated weights for policy 0, policy_version 337343 (0.0009) [2023-12-27 21:39:11,059][106226] Updated weights for policy 0, policy_version 337353 (0.0008) [2023-12-27 21:39:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 20021.8). Total num frames: 172924928. Throughput: 0: 10038.8, 1: 10065.4. Samples: 172892280. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:39:11,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.364')] [2023-12-27 21:39:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000337936_86532096.pth... [2023-12-27 21:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000337360_86392832.pth... [2023-12-27 21:39:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000336176_86089728.pth [2023-12-27 21:39:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000336784_86237184.pth [2023-12-27 21:39:11,597][106225] Updated weights for policy 1, policy_version 337937 (0.0005) [2023-12-27 21:39:11,668][106225] Updated weights for policy 1, policy_version 337947 (0.0008) [2023-12-27 21:39:11,735][106225] Updated weights for policy 1, policy_version 337957 (0.0008) [2023-12-27 21:39:11,798][106225] Updated weights for policy 1, policy_version 337967 (0.0008) [2023-12-27 21:39:11,910][106226] Updated weights for policy 0, policy_version 337363 (0.0008) [2023-12-27 21:39:11,973][106226] Updated weights for policy 0, policy_version 337373 (0.0008) [2023-12-27 21:39:12,033][106226] Updated weights for policy 0, policy_version 337383 (0.0008) [2023-12-27 21:39:12,526][106225] Updated weights for policy 1, policy_version 337977 (0.0005) [2023-12-27 21:39:12,595][106225] Updated weights for policy 1, policy_version 337987 (0.0008) [2023-12-27 21:39:12,663][106225] Updated weights for policy 1, policy_version 337997 (0.0008) [2023-12-27 21:39:12,705][106226] Updated weights for policy 0, policy_version 337393 (0.0008) [2023-12-27 21:39:12,771][106226] Updated weights for policy 0, policy_version 337403 (0.0006) [2023-12-27 21:39:12,832][106226] Updated weights for policy 0, policy_version 337413 (0.0007) [2023-12-27 21:39:12,888][106226] Updated weights for policy 0, policy_version 337423 (0.0009) [2023-12-27 21:39:13,394][106225] Updated weights for policy 1, policy_version 338007 (0.0008) [2023-12-27 21:39:13,459][106225] Updated weights for policy 1, policy_version 338017 (0.0008) [2023-12-27 21:39:13,502][106226] Updated weights for policy 0, policy_version 337433 (0.0006) [2023-12-27 21:39:13,509][106225] Updated weights for policy 1, policy_version 338027 (0.0006) [2023-12-27 21:39:13,548][106226] Updated weights for policy 0, policy_version 337443 (0.0006) [2023-12-27 21:39:13,597][106226] Updated weights for policy 0, policy_version 337453 (0.0009) [2023-12-27 21:39:14,237][106226] Updated weights for policy 0, policy_version 337463 (0.0007) [2023-12-27 21:39:14,238][106225] Updated weights for policy 1, policy_version 338037 (0.0008) [2023-12-27 21:39:14,285][106226] Updated weights for policy 0, policy_version 337473 (0.0006) [2023-12-27 21:39:14,291][106225] Updated weights for policy 1, policy_version 338047 (0.0007) [2023-12-27 21:39:14,329][106226] Updated weights for policy 0, policy_version 337483 (0.0006) [2023-12-27 21:39:14,344][106225] Updated weights for policy 1, policy_version 338057 (0.0007) [2023-12-27 21:39:15,080][106225] Updated weights for policy 1, policy_version 338067 (0.0007) [2023-12-27 21:39:15,095][106226] Updated weights for policy 0, policy_version 337493 (0.0007) [2023-12-27 21:39:15,142][106225] Updated weights for policy 1, policy_version 338077 (0.0007) [2023-12-27 21:39:15,157][106226] Updated weights for policy 0, policy_version 337503 (0.0008) [2023-12-27 21:39:15,203][106225] Updated weights for policy 1, policy_version 338087 (0.0007) [2023-12-27 21:39:15,212][106226] Updated weights for policy 0, policy_version 337513 (0.0008) [2023-12-27 21:39:15,858][106226] Updated weights for policy 0, policy_version 337523 (0.0007) [2023-12-27 21:39:15,921][106226] Updated weights for policy 0, policy_version 337533 (0.0006) [2023-12-27 21:39:15,969][106226] Updated weights for policy 0, policy_version 337543 (0.0005) [2023-12-27 21:39:16,036][106225] Updated weights for policy 1, policy_version 338097 (0.0006) [2023-12-27 21:39:16,100][106225] Updated weights for policy 1, policy_version 338107 (0.0009) [2023-12-27 21:39:16,168][106225] Updated weights for policy 1, policy_version 338117 (0.0009) [2023-12-27 21:39:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19994.0). Total num frames: 173015040. Throughput: 0: 9970.7, 1: 9924.9. Samples: 173007888. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:39:16,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-5.803')] [2023-12-27 21:39:16,234][106225] Updated weights for policy 1, policy_version 338127 (0.0008) [2023-12-27 21:39:16,593][106226] Updated weights for policy 0, policy_version 337553 (0.0006) [2023-12-27 21:39:16,649][106226] Updated weights for policy 0, policy_version 337563 (0.0008) [2023-12-27 21:39:16,708][106226] Updated weights for policy 0, policy_version 337573 (0.0007) [2023-12-27 21:39:16,767][106226] Updated weights for policy 0, policy_version 337583 (0.0006) [2023-12-27 21:39:16,889][106225] Updated weights for policy 1, policy_version 338137 (0.0006) [2023-12-27 21:39:16,942][106225] Updated weights for policy 1, policy_version 338147 (0.0005) [2023-12-27 21:39:16,998][106225] Updated weights for policy 1, policy_version 338157 (0.0005) [2023-12-27 21:39:17,442][106226] Updated weights for policy 0, policy_version 337593 (0.0009) [2023-12-27 21:39:17,498][106226] Updated weights for policy 0, policy_version 337603 (0.0007) [2023-12-27 21:39:17,548][106226] Updated weights for policy 0, policy_version 337613 (0.0006) [2023-12-27 21:39:17,670][106225] Updated weights for policy 1, policy_version 338167 (0.0007) [2023-12-27 21:39:17,724][106225] Updated weights for policy 1, policy_version 338177 (0.0009) [2023-12-27 21:39:17,781][106225] Updated weights for policy 1, policy_version 338187 (0.0008) [2023-12-27 21:39:18,197][106226] Updated weights for policy 0, policy_version 337623 (0.0008) [2023-12-27 21:39:18,243][106226] Updated weights for policy 0, policy_version 337633 (0.0009) [2023-12-27 21:39:18,293][106226] Updated weights for policy 0, policy_version 337643 (0.0009) [2023-12-27 21:39:18,506][106225] Updated weights for policy 1, policy_version 338197 (0.0009) [2023-12-27 21:39:18,569][106225] Updated weights for policy 1, policy_version 338207 (0.0008) [2023-12-27 21:39:18,623][106225] Updated weights for policy 1, policy_version 338217 (0.0006) [2023-12-27 21:39:19,064][106226] Updated weights for policy 0, policy_version 337653 (0.0009) [2023-12-27 21:39:19,124][106226] Updated weights for policy 0, policy_version 337663 (0.0008) [2023-12-27 21:39:19,174][106226] Updated weights for policy 0, policy_version 337673 (0.0007) [2023-12-27 21:39:19,262][106225] Updated weights for policy 1, policy_version 338227 (0.0008) [2023-12-27 21:39:19,327][106225] Updated weights for policy 1, policy_version 338237 (0.0010) [2023-12-27 21:39:19,392][106225] Updated weights for policy 1, policy_version 338247 (0.0008) [2023-12-27 21:39:19,952][106226] Updated weights for policy 0, policy_version 337683 (0.0007) [2023-12-27 21:39:20,019][106226] Updated weights for policy 0, policy_version 337693 (0.0008) [2023-12-27 21:39:20,080][106226] Updated weights for policy 0, policy_version 337703 (0.0006) [2023-12-27 21:39:20,143][106225] Updated weights for policy 1, policy_version 338257 (0.0008) [2023-12-27 21:39:20,212][106225] Updated weights for policy 1, policy_version 338267 (0.0010) [2023-12-27 21:39:20,276][106225] Updated weights for policy 1, policy_version 338277 (0.0010) [2023-12-27 21:39:20,339][106225] Updated weights for policy 1, policy_version 338287 (0.0009) [2023-12-27 21:39:20,717][106226] Updated weights for policy 0, policy_version 337713 (0.0007) [2023-12-27 21:39:20,785][106226] Updated weights for policy 0, policy_version 337723 (0.0010) [2023-12-27 21:39:20,853][106226] Updated weights for policy 0, policy_version 337733 (0.0011) [2023-12-27 21:39:20,911][106226] Updated weights for policy 0, policy_version 337743 (0.0011) [2023-12-27 21:39:21,019][106225] Updated weights for policy 1, policy_version 338297 (0.0007) [2023-12-27 21:39:21,080][106225] Updated weights for policy 1, policy_version 338307 (0.0007) [2023-12-27 21:39:21,147][106225] Updated weights for policy 1, policy_version 338317 (0.0009) [2023-12-27 21:39:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 173121536. Throughput: 0: 9959.8, 1: 9794.3. Samples: 173126332. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 21:39:21,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-6.266')] [2023-12-27 21:39:21,658][106226] Updated weights for policy 0, policy_version 337753 (0.0011) [2023-12-27 21:39:21,728][106226] Updated weights for policy 0, policy_version 337763 (0.0007) [2023-12-27 21:39:21,786][106226] Updated weights for policy 0, policy_version 337773 (0.0008) [2023-12-27 21:39:21,924][106225] Updated weights for policy 1, policy_version 338327 (0.0010) [2023-12-27 21:39:21,979][106225] Updated weights for policy 1, policy_version 338337 (0.0010) [2023-12-27 21:39:22,042][106225] Updated weights for policy 1, policy_version 338347 (0.0008) [2023-12-27 21:39:22,492][106226] Updated weights for policy 0, policy_version 337783 (0.0008) [2023-12-27 21:39:22,553][106226] Updated weights for policy 0, policy_version 337793 (0.0008) [2023-12-27 21:39:22,618][106226] Updated weights for policy 0, policy_version 337803 (0.0008) [2023-12-27 21:39:22,801][106225] Updated weights for policy 1, policy_version 338357 (0.0008) [2023-12-27 21:39:22,858][106225] Updated weights for policy 1, policy_version 338367 (0.0008) [2023-12-27 21:39:22,918][106225] Updated weights for policy 1, policy_version 338377 (0.0008) [2023-12-27 21:39:23,339][106226] Updated weights for policy 0, policy_version 337813 (0.0009) [2023-12-27 21:39:23,409][106226] Updated weights for policy 0, policy_version 337823 (0.0006) [2023-12-27 21:39:23,473][106226] Updated weights for policy 0, policy_version 337833 (0.0008) [2023-12-27 21:39:23,649][106225] Updated weights for policy 1, policy_version 338387 (0.0008) [2023-12-27 21:39:23,710][106225] Updated weights for policy 1, policy_version 338397 (0.0008) [2023-12-27 21:39:23,771][106225] Updated weights for policy 1, policy_version 338407 (0.0008) [2023-12-27 21:39:24,161][106226] Updated weights for policy 0, policy_version 337843 (0.0008) [2023-12-27 21:39:24,226][106226] Updated weights for policy 0, policy_version 337853 (0.0008) [2023-12-27 21:39:24,282][106226] Updated weights for policy 0, policy_version 337863 (0.0008) [2023-12-27 21:39:24,473][106225] Updated weights for policy 1, policy_version 338417 (0.0008) [2023-12-27 21:39:24,530][106225] Updated weights for policy 1, policy_version 338427 (0.0006) [2023-12-27 21:39:24,592][106225] Updated weights for policy 1, policy_version 338437 (0.0007) [2023-12-27 21:39:24,650][106225] Updated weights for policy 1, policy_version 338447 (0.0008) [2023-12-27 21:39:24,950][106226] Updated weights for policy 0, policy_version 337873 (0.0008) [2023-12-27 21:39:25,004][106226] Updated weights for policy 0, policy_version 337883 (0.0005) [2023-12-27 21:39:25,071][106226] Updated weights for policy 0, policy_version 337893 (0.0005) [2023-12-27 21:39:25,138][106226] Updated weights for policy 0, policy_version 337903 (0.0006) [2023-12-27 21:39:25,411][106225] Updated weights for policy 1, policy_version 338457 (0.0009) [2023-12-27 21:39:25,457][106225] Updated weights for policy 1, policy_version 338467 (0.0008) [2023-12-27 21:39:25,507][106225] Updated weights for policy 1, policy_version 338477 (0.0008) [2023-12-27 21:39:25,716][106226] Updated weights for policy 0, policy_version 337913 (0.0008) [2023-12-27 21:39:25,771][106226] Updated weights for policy 0, policy_version 337923 (0.0008) [2023-12-27 21:39:25,822][106226] Updated weights for policy 0, policy_version 337933 (0.0008) [2023-12-27 21:39:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19966.3). Total num frames: 173211648. Throughput: 0: 9974.0, 1: 9728.9. Samples: 173183028. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:26,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-6.058')] [2023-12-27 21:39:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000338480_86671360.pth... [2023-12-27 21:39:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000337936_86540288.pth... [2023-12-27 21:39:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000336784_86245376.pth [2023-12-27 21:39:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000337360_86384640.pth [2023-12-27 21:39:26,249][106225] Updated weights for policy 1, policy_version 338487 (0.0006) [2023-12-27 21:39:26,292][106225] Updated weights for policy 1, policy_version 338497 (0.0005) [2023-12-27 21:39:26,339][106225] Updated weights for policy 1, policy_version 338507 (0.0008) [2023-12-27 21:39:26,572][106226] Updated weights for policy 0, policy_version 337943 (0.0008) [2023-12-27 21:39:26,630][106226] Updated weights for policy 0, policy_version 337953 (0.0008) [2023-12-27 21:39:26,686][106226] Updated weights for policy 0, policy_version 337963 (0.0008) [2023-12-27 21:39:27,085][106225] Updated weights for policy 1, policy_version 338517 (0.0009) [2023-12-27 21:39:27,140][106225] Updated weights for policy 1, policy_version 338527 (0.0008) [2023-12-27 21:39:27,192][106225] Updated weights for policy 1, policy_version 338537 (0.0008) [2023-12-27 21:39:27,305][106226] Updated weights for policy 0, policy_version 337973 (0.0008) [2023-12-27 21:39:27,361][106226] Updated weights for policy 0, policy_version 337983 (0.0008) [2023-12-27 21:39:27,414][106226] Updated weights for policy 0, policy_version 337993 (0.0009) [2023-12-27 21:39:27,909][106225] Updated weights for policy 1, policy_version 338547 (0.0008) [2023-12-27 21:39:27,961][106225] Updated weights for policy 1, policy_version 338557 (0.0005) [2023-12-27 21:39:28,015][106225] Updated weights for policy 1, policy_version 338567 (0.0008) [2023-12-27 21:39:28,163][106226] Updated weights for policy 0, policy_version 338003 (0.0009) [2023-12-27 21:39:28,211][106226] Updated weights for policy 0, policy_version 338013 (0.0008) [2023-12-27 21:39:28,255][106226] Updated weights for policy 0, policy_version 338023 (0.0008) [2023-12-27 21:39:28,694][106225] Updated weights for policy 1, policy_version 338577 (0.0009) [2023-12-27 21:39:28,754][106225] Updated weights for policy 1, policy_version 338587 (0.0008) [2023-12-27 21:39:28,812][106225] Updated weights for policy 1, policy_version 338597 (0.0008) [2023-12-27 21:39:28,872][106225] Updated weights for policy 1, policy_version 338607 (0.0007) [2023-12-27 21:39:29,007][106226] Updated weights for policy 0, policy_version 338033 (0.0009) [2023-12-27 21:39:29,062][106226] Updated weights for policy 0, policy_version 338043 (0.0008) [2023-12-27 21:39:29,119][106226] Updated weights for policy 0, policy_version 338053 (0.0009) [2023-12-27 21:39:29,175][106226] Updated weights for policy 0, policy_version 338063 (0.0009) [2023-12-27 21:39:29,548][106225] Updated weights for policy 1, policy_version 338617 (0.0008) [2023-12-27 21:39:29,604][106225] Updated weights for policy 1, policy_version 338627 (0.0009) [2023-12-27 21:39:29,663][106225] Updated weights for policy 1, policy_version 338637 (0.0008) [2023-12-27 21:39:30,009][106226] Updated weights for policy 0, policy_version 338073 (0.0010) [2023-12-27 21:39:30,079][106226] Updated weights for policy 0, policy_version 338083 (0.0008) [2023-12-27 21:39:30,144][106226] Updated weights for policy 0, policy_version 338093 (0.0008) [2023-12-27 21:39:30,363][106225] Updated weights for policy 1, policy_version 338647 (0.0010) [2023-12-27 21:39:30,427][106225] Updated weights for policy 1, policy_version 338657 (0.0008) [2023-12-27 21:39:30,497][106225] Updated weights for policy 1, policy_version 338667 (0.0006) [2023-12-27 21:39:30,821][106226] Updated weights for policy 0, policy_version 338103 (0.0009) [2023-12-27 21:39:30,875][106226] Updated weights for policy 0, policy_version 338113 (0.0009) [2023-12-27 21:39:30,930][106226] Updated weights for policy 0, policy_version 338123 (0.0009) [2023-12-27 21:39:31,132][106225] Updated weights for policy 1, policy_version 338677 (0.0009) [2023-12-27 21:39:31,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 173309952. Throughput: 0: 10013.1, 1: 9741.6. Samples: 173300800. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:31,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.972')] [2023-12-27 21:39:31,199][106225] Updated weights for policy 1, policy_version 338687 (0.0010) [2023-12-27 21:39:31,261][106225] Updated weights for policy 1, policy_version 338697 (0.0010) [2023-12-27 21:39:31,651][106226] Updated weights for policy 0, policy_version 338133 (0.0009) [2023-12-27 21:39:31,722][106226] Updated weights for policy 0, policy_version 338143 (0.0009) [2023-12-27 21:39:31,784][106226] Updated weights for policy 0, policy_version 338153 (0.0009) [2023-12-27 21:39:31,922][106225] Updated weights for policy 1, policy_version 338707 (0.0010) [2023-12-27 21:39:31,977][106225] Updated weights for policy 1, policy_version 338717 (0.0008) [2023-12-27 21:39:32,033][106225] Updated weights for policy 1, policy_version 338727 (0.0009) [2023-12-27 21:39:32,555][106226] Updated weights for policy 0, policy_version 338163 (0.0008) [2023-12-27 21:39:32,616][106226] Updated weights for policy 0, policy_version 338173 (0.0008) [2023-12-27 21:39:32,678][106226] Updated weights for policy 0, policy_version 338183 (0.0009) [2023-12-27 21:39:32,722][106225] Updated weights for policy 1, policy_version 338737 (0.0009) [2023-12-27 21:39:32,783][106225] Updated weights for policy 1, policy_version 338747 (0.0008) [2023-12-27 21:39:32,845][106225] Updated weights for policy 1, policy_version 338757 (0.0008) [2023-12-27 21:39:32,904][106225] Updated weights for policy 1, policy_version 338767 (0.0009) [2023-12-27 21:39:33,415][106226] Updated weights for policy 0, policy_version 338193 (0.0008) [2023-12-27 21:39:33,466][106226] Updated weights for policy 0, policy_version 338203 (0.0009) [2023-12-27 21:39:33,521][106226] Updated weights for policy 0, policy_version 338213 (0.0009) [2023-12-27 21:39:33,581][106226] Updated weights for policy 0, policy_version 338223 (0.0009) [2023-12-27 21:39:33,587][106225] Updated weights for policy 1, policy_version 338777 (0.0007) [2023-12-27 21:39:33,639][106225] Updated weights for policy 1, policy_version 338787 (0.0008) [2023-12-27 21:39:33,693][106225] Updated weights for policy 1, policy_version 338797 (0.0008) [2023-12-27 21:39:34,300][106226] Updated weights for policy 0, policy_version 338233 (0.0008) [2023-12-27 21:39:34,361][106226] Updated weights for policy 0, policy_version 338243 (0.0009) [2023-12-27 21:39:34,412][106226] Updated weights for policy 0, policy_version 338253 (0.0009) [2023-12-27 21:39:34,439][106225] Updated weights for policy 1, policy_version 338807 (0.0007) [2023-12-27 21:39:34,497][106225] Updated weights for policy 1, policy_version 338817 (0.0009) [2023-12-27 21:39:34,561][106225] Updated weights for policy 1, policy_version 338827 (0.0009) [2023-12-27 21:39:35,116][106226] Updated weights for policy 0, policy_version 338263 (0.0007) [2023-12-27 21:39:35,179][106226] Updated weights for policy 0, policy_version 338273 (0.0006) [2023-12-27 21:39:35,233][106226] Updated weights for policy 0, policy_version 338283 (0.0008) [2023-12-27 21:39:35,307][106225] Updated weights for policy 1, policy_version 338837 (0.0010) [2023-12-27 21:39:35,366][106225] Updated weights for policy 1, policy_version 338847 (0.0010) [2023-12-27 21:39:35,412][106225] Updated weights for policy 1, policy_version 338857 (0.0010) [2023-12-27 21:39:35,952][106226] Updated weights for policy 0, policy_version 338293 (0.0008) [2023-12-27 21:39:35,999][106226] Updated weights for policy 0, policy_version 338303 (0.0008) [2023-12-27 21:39:36,059][106226] Updated weights for policy 0, policy_version 338313 (0.0006) [2023-12-27 21:39:36,086][106225] Updated weights for policy 1, policy_version 338867 (0.0009) [2023-12-27 21:39:36,145][106225] Updated weights for policy 1, policy_version 338877 (0.0009) [2023-12-27 21:39:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19966.3). Total num frames: 173408256. Throughput: 0: 9957.1, 1: 9747.9. Samples: 173418052. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:36,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-5.606')] [2023-12-27 21:39:36,206][106225] Updated weights for policy 1, policy_version 338887 (0.0008) [2023-12-27 21:39:36,859][106226] Updated weights for policy 0, policy_version 338323 (0.0009) [2023-12-27 21:39:36,874][106225] Updated weights for policy 1, policy_version 338897 (0.0006) [2023-12-27 21:39:36,923][106226] Updated weights for policy 0, policy_version 338333 (0.0008) [2023-12-27 21:39:36,932][106225] Updated weights for policy 1, policy_version 338907 (0.0007) [2023-12-27 21:39:36,975][106226] Updated weights for policy 0, policy_version 338343 (0.0006) [2023-12-27 21:39:36,991][106225] Updated weights for policy 1, policy_version 338917 (0.0008) [2023-12-27 21:39:37,047][106225] Updated weights for policy 1, policy_version 338927 (0.0008) [2023-12-27 21:39:37,565][106226] Updated weights for policy 0, policy_version 338353 (0.0006) [2023-12-27 21:39:37,614][106226] Updated weights for policy 0, policy_version 338363 (0.0008) [2023-12-27 21:39:37,663][106226] Updated weights for policy 0, policy_version 338373 (0.0008) [2023-12-27 21:39:37,702][106225] Updated weights for policy 1, policy_version 338937 (0.0006) [2023-12-27 21:39:37,721][106226] Updated weights for policy 0, policy_version 338383 (0.0008) [2023-12-27 21:39:37,753][106225] Updated weights for policy 1, policy_version 338947 (0.0005) [2023-12-27 21:39:37,810][106225] Updated weights for policy 1, policy_version 338957 (0.0005) [2023-12-27 21:39:38,470][106225] Updated weights for policy 1, policy_version 338967 (0.0007) [2023-12-27 21:39:38,476][106226] Updated weights for policy 0, policy_version 338393 (0.0008) [2023-12-27 21:39:38,531][106226] Updated weights for policy 0, policy_version 338403 (0.0009) [2023-12-27 21:39:38,532][106225] Updated weights for policy 1, policy_version 338977 (0.0005) [2023-12-27 21:39:38,592][106225] Updated weights for policy 1, policy_version 338987 (0.0005) [2023-12-27 21:39:38,596][106226] Updated weights for policy 0, policy_version 338413 (0.0008) [2023-12-27 21:39:39,262][106225] Updated weights for policy 1, policy_version 338997 (0.0008) [2023-12-27 21:39:39,331][106225] Updated weights for policy 1, policy_version 339007 (0.0008) [2023-12-27 21:39:39,342][106226] Updated weights for policy 0, policy_version 338423 (0.0008) [2023-12-27 21:39:39,398][106225] Updated weights for policy 1, policy_version 339017 (0.0007) [2023-12-27 21:39:39,412][106226] Updated weights for policy 0, policy_version 338433 (0.0009) [2023-12-27 21:39:39,477][106226] Updated weights for policy 0, policy_version 338443 (0.0009) [2023-12-27 21:39:40,078][106225] Updated weights for policy 1, policy_version 339027 (0.0007) [2023-12-27 21:39:40,143][106225] Updated weights for policy 1, policy_version 339037 (0.0006) [2023-12-27 21:39:40,211][106225] Updated weights for policy 1, policy_version 339047 (0.0007) [2023-12-27 21:39:40,221][106226] Updated weights for policy 0, policy_version 338453 (0.0008) [2023-12-27 21:39:40,288][106226] Updated weights for policy 0, policy_version 338463 (0.0011) [2023-12-27 21:39:40,353][106226] Updated weights for policy 0, policy_version 338473 (0.0011) [2023-12-27 21:39:40,901][106225] Updated weights for policy 1, policy_version 339057 (0.0008) [2023-12-27 21:39:40,953][106225] Updated weights for policy 1, policy_version 339067 (0.0008) [2023-12-27 21:39:41,021][106225] Updated weights for policy 1, policy_version 339077 (0.0007) [2023-12-27 21:39:41,055][106226] Updated weights for policy 0, policy_version 338483 (0.0010) [2023-12-27 21:39:41,091][106225] Updated weights for policy 1, policy_version 339087 (0.0008) [2023-12-27 21:39:41,119][106226] Updated weights for policy 0, policy_version 338493 (0.0010) [2023-12-27 21:39:41,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19966.2). Total num frames: 173506560. Throughput: 0: 9930.8, 1: 9802.4. Samples: 173478744. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:41,176][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.759')] [2023-12-27 21:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000339088_86827008.pth... [2023-12-27 21:39:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000337936_86532096.pth [2023-12-27 21:39:41,190][106226] Updated weights for policy 0, policy_version 338503 (0.0010) [2023-12-27 21:39:41,236][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000338512_86687744.pth... [2023-12-27 21:39:41,240][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000337360_86392832.pth [2023-12-27 21:39:41,904][106225] Updated weights for policy 1, policy_version 339097 (0.0008) [2023-12-27 21:39:41,940][106226] Updated weights for policy 0, policy_version 338513 (0.0010) [2023-12-27 21:39:41,967][106225] Updated weights for policy 1, policy_version 339107 (0.0008) [2023-12-27 21:39:42,004][106226] Updated weights for policy 0, policy_version 338523 (0.0009) [2023-12-27 21:39:42,031][106225] Updated weights for policy 1, policy_version 339117 (0.0006) [2023-12-27 21:39:42,065][106226] Updated weights for policy 0, policy_version 338533 (0.0009) [2023-12-27 21:39:42,126][106226] Updated weights for policy 0, policy_version 338543 (0.0009) [2023-12-27 21:39:42,784][106225] Updated weights for policy 1, policy_version 339127 (0.0009) [2023-12-27 21:39:42,847][106225] Updated weights for policy 1, policy_version 339137 (0.0009) [2023-12-27 21:39:42,887][106226] Updated weights for policy 0, policy_version 338553 (0.0011) [2023-12-27 21:39:42,894][106225] Updated weights for policy 1, policy_version 339147 (0.0006) [2023-12-27 21:39:42,947][106226] Updated weights for policy 0, policy_version 338563 (0.0011) [2023-12-27 21:39:43,002][106226] Updated weights for policy 0, policy_version 338573 (0.0010) [2023-12-27 21:39:43,614][106225] Updated weights for policy 1, policy_version 339157 (0.0009) [2023-12-27 21:39:43,652][106226] Updated weights for policy 0, policy_version 338583 (0.0010) [2023-12-27 21:39:43,663][106225] Updated weights for policy 1, policy_version 339167 (0.0007) [2023-12-27 21:39:43,709][106226] Updated weights for policy 0, policy_version 338593 (0.0010) [2023-12-27 21:39:43,712][106225] Updated weights for policy 1, policy_version 339177 (0.0007) [2023-12-27 21:39:43,769][106226] Updated weights for policy 0, policy_version 338603 (0.0011) [2023-12-27 21:39:44,470][106226] Updated weights for policy 0, policy_version 338613 (0.0011) [2023-12-27 21:39:44,481][106225] Updated weights for policy 1, policy_version 339187 (0.0008) [2023-12-27 21:39:44,530][106226] Updated weights for policy 0, policy_version 338623 (0.0008) [2023-12-27 21:39:44,532][106225] Updated weights for policy 1, policy_version 339197 (0.0010) [2023-12-27 21:39:44,582][106225] Updated weights for policy 1, policy_version 339207 (0.0010) [2023-12-27 21:39:44,597][106226] Updated weights for policy 0, policy_version 338633 (0.0005) [2023-12-27 21:39:45,262][106226] Updated weights for policy 0, policy_version 338643 (0.0006) [2023-12-27 21:39:45,320][106225] Updated weights for policy 1, policy_version 339217 (0.0010) [2023-12-27 21:39:45,321][106226] Updated weights for policy 0, policy_version 338653 (0.0006) [2023-12-27 21:39:45,373][106226] Updated weights for policy 0, policy_version 338663 (0.0006) [2023-12-27 21:39:45,379][106225] Updated weights for policy 1, policy_version 339227 (0.0010) [2023-12-27 21:39:45,430][106225] Updated weights for policy 1, policy_version 339237 (0.0007) [2023-12-27 21:39:45,482][106225] Updated weights for policy 1, policy_version 339247 (0.0006) [2023-12-27 21:39:45,929][106226] Updated weights for policy 0, policy_version 338673 (0.0007) [2023-12-27 21:39:45,979][106226] Updated weights for policy 0, policy_version 338683 (0.0006) [2023-12-27 21:39:46,034][106226] Updated weights for policy 0, policy_version 338693 (0.0006) [2023-12-27 21:39:46,054][106225] Updated weights for policy 1, policy_version 339257 (0.0009) [2023-12-27 21:39:46,101][106226] Updated weights for policy 0, policy_version 338703 (0.0006) [2023-12-27 21:39:46,106][106225] Updated weights for policy 1, policy_version 339267 (0.0009) [2023-12-27 21:39:46,160][106225] Updated weights for policy 1, policy_version 339277 (0.0007) [2023-12-27 21:39:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19994.0). Total num frames: 173613056. Throughput: 0: 9831.3, 1: 9724.9. Samples: 173592904. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:46,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.444')] [2023-12-27 21:39:46,730][106226] Updated weights for policy 0, policy_version 338713 (0.0008) [2023-12-27 21:39:46,780][106226] Updated weights for policy 0, policy_version 338723 (0.0010) [2023-12-27 21:39:46,836][106226] Updated weights for policy 0, policy_version 338733 (0.0010) [2023-12-27 21:39:46,861][106225] Updated weights for policy 1, policy_version 339287 (0.0008) [2023-12-27 21:39:46,915][106225] Updated weights for policy 1, policy_version 339297 (0.0009) [2023-12-27 21:39:46,966][106225] Updated weights for policy 1, policy_version 339307 (0.0009) [2023-12-27 21:39:47,408][106226] Updated weights for policy 0, policy_version 338743 (0.0006) [2023-12-27 21:39:47,471][106226] Updated weights for policy 0, policy_version 338753 (0.0005) [2023-12-27 21:39:47,525][106226] Updated weights for policy 0, policy_version 338763 (0.0005) [2023-12-27 21:39:47,712][106225] Updated weights for policy 1, policy_version 339317 (0.0009) [2023-12-27 21:39:47,772][106225] Updated weights for policy 1, policy_version 339327 (0.0010) [2023-12-27 21:39:47,828][106225] Updated weights for policy 1, policy_version 339337 (0.0010) [2023-12-27 21:39:48,083][106226] Updated weights for policy 0, policy_version 338773 (0.0007) [2023-12-27 21:39:48,139][106226] Updated weights for policy 0, policy_version 338783 (0.0010) [2023-12-27 21:39:48,197][106226] Updated weights for policy 0, policy_version 338793 (0.0005) [2023-12-27 21:39:48,472][106225] Updated weights for policy 1, policy_version 339347 (0.0010) [2023-12-27 21:39:48,536][106225] Updated weights for policy 1, policy_version 339357 (0.0010) [2023-12-27 21:39:48,606][106225] Updated weights for policy 1, policy_version 339367 (0.0011) [2023-12-27 21:39:48,879][106226] Updated weights for policy 0, policy_version 338803 (0.0006) [2023-12-27 21:39:48,938][106226] Updated weights for policy 0, policy_version 338813 (0.0009) [2023-12-27 21:39:49,001][106226] Updated weights for policy 0, policy_version 338823 (0.0008) [2023-12-27 21:39:49,246][106225] Updated weights for policy 1, policy_version 339377 (0.0010) [2023-12-27 21:39:49,306][106225] Updated weights for policy 1, policy_version 339387 (0.0007) [2023-12-27 21:39:49,369][106225] Updated weights for policy 1, policy_version 339397 (0.0008) [2023-12-27 21:39:49,423][106225] Updated weights for policy 1, policy_version 339407 (0.0007) [2023-12-27 21:39:49,687][106226] Updated weights for policy 0, policy_version 338833 (0.0009) [2023-12-27 21:39:49,751][106226] Updated weights for policy 0, policy_version 338843 (0.0005) [2023-12-27 21:39:49,815][106226] Updated weights for policy 0, policy_version 338853 (0.0006) [2023-12-27 21:39:49,881][106226] Updated weights for policy 0, policy_version 338863 (0.0009) [2023-12-27 21:39:50,201][106225] Updated weights for policy 1, policy_version 339417 (0.0006) [2023-12-27 21:39:50,258][106225] Updated weights for policy 1, policy_version 339427 (0.0006) [2023-12-27 21:39:50,315][106225] Updated weights for policy 1, policy_version 339437 (0.0006) [2023-12-27 21:39:50,627][106226] Updated weights for policy 0, policy_version 338873 (0.0009) [2023-12-27 21:39:50,685][106226] Updated weights for policy 0, policy_version 338883 (0.0011) [2023-12-27 21:39:50,743][106226] Updated weights for policy 0, policy_version 338893 (0.0011) [2023-12-27 21:39:50,938][106225] Updated weights for policy 1, policy_version 339447 (0.0007) [2023-12-27 21:39:50,988][106225] Updated weights for policy 1, policy_version 339457 (0.0007) [2023-12-27 21:39:51,049][106225] Updated weights for policy 1, policy_version 339467 (0.0008) [2023-12-27 21:39:51,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19966.3). Total num frames: 173711360. Throughput: 0: 9900.0, 1: 9776.6. Samples: 173717808. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:51,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.877')] [2023-12-27 21:39:51,504][106226] Updated weights for policy 0, policy_version 338903 (0.0009) [2023-12-27 21:39:51,574][106226] Updated weights for policy 0, policy_version 338913 (0.0008) [2023-12-27 21:39:51,638][106226] Updated weights for policy 0, policy_version 338923 (0.0009) [2023-12-27 21:39:51,846][106225] Updated weights for policy 1, policy_version 339477 (0.0008) [2023-12-27 21:39:51,897][106225] Updated weights for policy 1, policy_version 339487 (0.0008) [2023-12-27 21:39:51,953][106225] Updated weights for policy 1, policy_version 339497 (0.0008) [2023-12-27 21:39:52,332][106226] Updated weights for policy 0, policy_version 338933 (0.0008) [2023-12-27 21:39:52,400][106226] Updated weights for policy 0, policy_version 338943 (0.0007) [2023-12-27 21:39:52,462][106226] Updated weights for policy 0, policy_version 338953 (0.0008) [2023-12-27 21:39:52,708][106225] Updated weights for policy 1, policy_version 339507 (0.0008) [2023-12-27 21:39:52,764][106225] Updated weights for policy 1, policy_version 339517 (0.0009) [2023-12-27 21:39:52,826][106225] Updated weights for policy 1, policy_version 339527 (0.0008) [2023-12-27 21:39:53,150][106226] Updated weights for policy 0, policy_version 338963 (0.0008) [2023-12-27 21:39:53,209][106226] Updated weights for policy 0, policy_version 338973 (0.0008) [2023-12-27 21:39:53,259][106226] Updated weights for policy 0, policy_version 338983 (0.0010) [2023-12-27 21:39:53,548][106225] Updated weights for policy 1, policy_version 339537 (0.0008) [2023-12-27 21:39:53,599][106225] Updated weights for policy 1, policy_version 339547 (0.0007) [2023-12-27 21:39:53,649][106225] Updated weights for policy 1, policy_version 339557 (0.0007) [2023-12-27 21:39:53,708][106225] Updated weights for policy 1, policy_version 339567 (0.0008) [2023-12-27 21:39:53,992][106226] Updated weights for policy 0, policy_version 338993 (0.0011) [2023-12-27 21:39:54,059][106226] Updated weights for policy 0, policy_version 339003 (0.0010) [2023-12-27 21:39:54,118][106226] Updated weights for policy 0, policy_version 339013 (0.0009) [2023-12-27 21:39:54,172][106226] Updated weights for policy 0, policy_version 339023 (0.0005) [2023-12-27 21:39:54,507][106225] Updated weights for policy 1, policy_version 339577 (0.0010) [2023-12-27 21:39:54,555][106225] Updated weights for policy 1, policy_version 339587 (0.0007) [2023-12-27 21:39:54,605][106225] Updated weights for policy 1, policy_version 339597 (0.0009) [2023-12-27 21:39:54,719][106226] Updated weights for policy 0, policy_version 339033 (0.0010) [2023-12-27 21:39:54,769][106226] Updated weights for policy 0, policy_version 339043 (0.0010) [2023-12-27 21:39:54,826][106226] Updated weights for policy 0, policy_version 339053 (0.0010) [2023-12-27 21:39:55,400][106225] Updated weights for policy 1, policy_version 339607 (0.0008) [2023-12-27 21:39:55,463][106225] Updated weights for policy 1, policy_version 339617 (0.0008) [2023-12-27 21:39:55,473][106226] Updated weights for policy 0, policy_version 339063 (0.0011) [2023-12-27 21:39:55,507][106225] Updated weights for policy 1, policy_version 339627 (0.0005) [2023-12-27 21:39:55,524][106226] Updated weights for policy 0, policy_version 339073 (0.0011) [2023-12-27 21:39:55,575][106226] Updated weights for policy 0, policy_version 339083 (0.0010) [2023-12-27 21:39:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 173801472. Throughput: 0: 9868.8, 1: 9733.9. Samples: 173774400. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:39:56,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.943')] [2023-12-27 21:39:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000339088_86835200.pth... [2023-12-27 21:39:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000339632_86966272.pth... [2023-12-27 21:39:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000337936_86540288.pth [2023-12-27 21:39:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000338480_86671360.pth [2023-12-27 21:39:56,240][106225] Updated weights for policy 1, policy_version 339637 (0.0008) [2023-12-27 21:39:56,291][106226] Updated weights for policy 0, policy_version 339093 (0.0010) [2023-12-27 21:39:56,294][106225] Updated weights for policy 1, policy_version 339647 (0.0010) [2023-12-27 21:39:56,340][106226] Updated weights for policy 0, policy_version 339103 (0.0010) [2023-12-27 21:39:56,343][106225] Updated weights for policy 1, policy_version 339657 (0.0010) [2023-12-27 21:39:56,396][106226] Updated weights for policy 0, policy_version 339113 (0.0010) [2023-12-27 21:39:57,043][106225] Updated weights for policy 1, policy_version 339667 (0.0009) [2023-12-27 21:39:57,070][106226] Updated weights for policy 0, policy_version 339123 (0.0008) [2023-12-27 21:39:57,100][106225] Updated weights for policy 1, policy_version 339677 (0.0005) [2023-12-27 21:39:57,132][106226] Updated weights for policy 0, policy_version 339133 (0.0008) [2023-12-27 21:39:57,155][106225] Updated weights for policy 1, policy_version 339687 (0.0005) [2023-12-27 21:39:57,184][106226] Updated weights for policy 0, policy_version 339143 (0.0010) [2023-12-27 21:39:57,666][106225] Updated weights for policy 1, policy_version 339697 (0.0005) [2023-12-27 21:39:57,724][106225] Updated weights for policy 1, policy_version 339707 (0.0008) [2023-12-27 21:39:57,786][106226] Updated weights for policy 0, policy_version 339153 (0.0010) [2023-12-27 21:39:57,787][106225] Updated weights for policy 1, policy_version 339717 (0.0008) [2023-12-27 21:39:57,841][106225] Updated weights for policy 1, policy_version 339727 (0.0006) [2023-12-27 21:39:57,846][106226] Updated weights for policy 0, policy_version 339163 (0.0008) [2023-12-27 21:39:57,898][106226] Updated weights for policy 0, policy_version 339173 (0.0008) [2023-12-27 21:39:57,953][106226] Updated weights for policy 0, policy_version 339183 (0.0005) [2023-12-27 21:39:58,648][106225] Updated weights for policy 1, policy_version 339737 (0.0007) [2023-12-27 21:39:58,685][106226] Updated weights for policy 0, policy_version 339193 (0.0008) [2023-12-27 21:39:58,711][106225] Updated weights for policy 1, policy_version 339747 (0.0007) [2023-12-27 21:39:58,750][106226] Updated weights for policy 0, policy_version 339203 (0.0009) [2023-12-27 21:39:58,776][106225] Updated weights for policy 1, policy_version 339757 (0.0007) [2023-12-27 21:39:58,814][106226] Updated weights for policy 0, policy_version 339213 (0.0008) [2023-12-27 21:39:59,566][106225] Updated weights for policy 1, policy_version 339767 (0.0006) [2023-12-27 21:39:59,589][106226] Updated weights for policy 0, policy_version 339223 (0.0008) [2023-12-27 21:39:59,626][106225] Updated weights for policy 1, policy_version 339777 (0.0005) [2023-12-27 21:39:59,649][106226] Updated weights for policy 0, policy_version 339233 (0.0008) [2023-12-27 21:39:59,677][106225] Updated weights for policy 1, policy_version 339787 (0.0005) [2023-12-27 21:39:59,705][106226] Updated weights for policy 0, policy_version 339243 (0.0008) [2023-12-27 21:40:00,326][106225] Updated weights for policy 1, policy_version 339797 (0.0008) [2023-12-27 21:40:00,386][106225] Updated weights for policy 1, policy_version 339807 (0.0009) [2023-12-27 21:40:00,446][106225] Updated weights for policy 1, policy_version 339817 (0.0009) [2023-12-27 21:40:00,456][106226] Updated weights for policy 0, policy_version 339253 (0.0008) [2023-12-27 21:40:00,516][106226] Updated weights for policy 0, policy_version 339263 (0.0005) [2023-12-27 21:40:00,572][106226] Updated weights for policy 0, policy_version 339273 (0.0005) [2023-12-27 21:40:01,165][106225] Updated weights for policy 1, policy_version 339827 (0.0008) [2023-12-27 21:40:01,171][106226] Updated weights for policy 0, policy_version 339283 (0.0006) [2023-12-27 21:40:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 173899776. Throughput: 0: 9927.4, 1: 9758.9. Samples: 173893772. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:01,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-5.912')] [2023-12-27 21:40:01,223][106225] Updated weights for policy 1, policy_version 339837 (0.0009) [2023-12-27 21:40:01,228][106226] Updated weights for policy 0, policy_version 339293 (0.0009) [2023-12-27 21:40:01,285][106225] Updated weights for policy 1, policy_version 339847 (0.0010) [2023-12-27 21:40:01,290][106226] Updated weights for policy 0, policy_version 339303 (0.0008) [2023-12-27 21:40:02,013][106226] Updated weights for policy 0, policy_version 339313 (0.0009) [2023-12-27 21:40:02,062][106226] Updated weights for policy 0, policy_version 339323 (0.0008) [2023-12-27 21:40:02,082][106225] Updated weights for policy 1, policy_version 339857 (0.0010) [2023-12-27 21:40:02,118][106226] Updated weights for policy 0, policy_version 339333 (0.0009) [2023-12-27 21:40:02,141][106225] Updated weights for policy 1, policy_version 339867 (0.0007) [2023-12-27 21:40:02,167][106226] Updated weights for policy 0, policy_version 339343 (0.0007) [2023-12-27 21:40:02,203][106225] Updated weights for policy 1, policy_version 339877 (0.0008) [2023-12-27 21:40:02,266][106225] Updated weights for policy 1, policy_version 339887 (0.0008) [2023-12-27 21:40:02,865][106226] Updated weights for policy 0, policy_version 339353 (0.0006) [2023-12-27 21:40:02,919][106226] Updated weights for policy 0, policy_version 339363 (0.0005) [2023-12-27 21:40:02,971][106226] Updated weights for policy 0, policy_version 339373 (0.0008) [2023-12-27 21:40:03,025][106225] Updated weights for policy 1, policy_version 339897 (0.0007) [2023-12-27 21:40:03,076][106225] Updated weights for policy 1, policy_version 339907 (0.0008) [2023-12-27 21:40:03,130][106225] Updated weights for policy 1, policy_version 339917 (0.0008) [2023-12-27 21:40:03,621][106226] Updated weights for policy 0, policy_version 339383 (0.0009) [2023-12-27 21:40:03,670][106226] Updated weights for policy 0, policy_version 339393 (0.0009) [2023-12-27 21:40:03,734][106226] Updated weights for policy 0, policy_version 339403 (0.0008) [2023-12-27 21:40:03,789][106225] Updated weights for policy 1, policy_version 339927 (0.0006) [2023-12-27 21:40:03,842][106225] Updated weights for policy 1, policy_version 339937 (0.0006) [2023-12-27 21:40:03,908][106225] Updated weights for policy 1, policy_version 339947 (0.0008) [2023-12-27 21:40:04,542][106226] Updated weights for policy 0, policy_version 339413 (0.0009) [2023-12-27 21:40:04,591][106226] Updated weights for policy 0, policy_version 339423 (0.0007) [2023-12-27 21:40:04,636][106225] Updated weights for policy 1, policy_version 339957 (0.0009) [2023-12-27 21:40:04,650][106226] Updated weights for policy 0, policy_version 339433 (0.0007) [2023-12-27 21:40:04,694][106225] Updated weights for policy 1, policy_version 339967 (0.0007) [2023-12-27 21:40:04,743][106225] Updated weights for policy 1, policy_version 339977 (0.0005) [2023-12-27 21:40:05,360][106225] Updated weights for policy 1, policy_version 339987 (0.0006) [2023-12-27 21:40:05,392][106226] Updated weights for policy 0, policy_version 339443 (0.0007) [2023-12-27 21:40:05,411][106225] Updated weights for policy 1, policy_version 339997 (0.0008) [2023-12-27 21:40:05,440][106226] Updated weights for policy 0, policy_version 339453 (0.0005) [2023-12-27 21:40:05,460][106225] Updated weights for policy 1, policy_version 340007 (0.0008) [2023-12-27 21:40:05,488][106226] Updated weights for policy 0, policy_version 339463 (0.0005) [2023-12-27 21:40:06,121][106226] Updated weights for policy 0, policy_version 339473 (0.0006) [2023-12-27 21:40:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 173998080. Throughput: 0: 9928.9, 1: 9774.3. Samples: 174012976. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:06,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.821')] [2023-12-27 21:40:06,177][106226] Updated weights for policy 0, policy_version 339483 (0.0008) [2023-12-27 21:40:06,231][106225] Updated weights for policy 1, policy_version 340017 (0.0009) [2023-12-27 21:40:06,238][106226] Updated weights for policy 0, policy_version 339493 (0.0008) [2023-12-27 21:40:06,292][106226] Updated weights for policy 0, policy_version 339503 (0.0008) [2023-12-27 21:40:06,295][106225] Updated weights for policy 1, policy_version 340027 (0.0007) [2023-12-27 21:40:06,352][106225] Updated weights for policy 1, policy_version 340037 (0.0006) [2023-12-27 21:40:06,418][106225] Updated weights for policy 1, policy_version 340047 (0.0006) [2023-12-27 21:40:07,000][106226] Updated weights for policy 0, policy_version 339513 (0.0008) [2023-12-27 21:40:07,053][106226] Updated weights for policy 0, policy_version 339523 (0.0008) [2023-12-27 21:40:07,105][106226] Updated weights for policy 0, policy_version 339533 (0.0006) [2023-12-27 21:40:07,129][106225] Updated weights for policy 1, policy_version 340057 (0.0009) [2023-12-27 21:40:07,191][106225] Updated weights for policy 1, policy_version 340067 (0.0008) [2023-12-27 21:40:07,252][106225] Updated weights for policy 1, policy_version 340077 (0.0009) [2023-12-27 21:40:07,748][106226] Updated weights for policy 0, policy_version 339543 (0.0008) [2023-12-27 21:40:07,795][106226] Updated weights for policy 0, policy_version 339553 (0.0009) [2023-12-27 21:40:07,839][106226] Updated weights for policy 0, policy_version 339563 (0.0008) [2023-12-27 21:40:08,028][106225] Updated weights for policy 1, policy_version 340087 (0.0009) [2023-12-27 21:40:08,091][106225] Updated weights for policy 1, policy_version 340097 (0.0008) [2023-12-27 21:40:08,156][106225] Updated weights for policy 1, policy_version 340107 (0.0008) [2023-12-27 21:40:08,544][106226] Updated weights for policy 0, policy_version 339573 (0.0008) [2023-12-27 21:40:08,605][106226] Updated weights for policy 0, policy_version 339583 (0.0011) [2023-12-27 21:40:08,672][106226] Updated weights for policy 0, policy_version 339593 (0.0007) [2023-12-27 21:40:08,794][106225] Updated weights for policy 1, policy_version 340117 (0.0009) [2023-12-27 21:40:08,853][106225] Updated weights for policy 1, policy_version 340127 (0.0007) [2023-12-27 21:40:08,912][106225] Updated weights for policy 1, policy_version 340137 (0.0008) [2023-12-27 21:40:09,380][106226] Updated weights for policy 0, policy_version 339603 (0.0007) [2023-12-27 21:40:09,445][106226] Updated weights for policy 0, policy_version 339613 (0.0010) [2023-12-27 21:40:09,506][106226] Updated weights for policy 0, policy_version 339623 (0.0011) [2023-12-27 21:40:09,679][106225] Updated weights for policy 1, policy_version 340147 (0.0007) [2023-12-27 21:40:09,743][106225] Updated weights for policy 1, policy_version 340157 (0.0009) [2023-12-27 21:40:09,806][106225] Updated weights for policy 1, policy_version 340167 (0.0007) [2023-12-27 21:40:10,254][106226] Updated weights for policy 0, policy_version 339633 (0.0011) [2023-12-27 21:40:10,318][106226] Updated weights for policy 0, policy_version 339643 (0.0008) [2023-12-27 21:40:10,383][106226] Updated weights for policy 0, policy_version 339653 (0.0009) [2023-12-27 21:40:10,443][106226] Updated weights for policy 0, policy_version 339663 (0.0009) [2023-12-27 21:40:10,535][106225] Updated weights for policy 1, policy_version 340177 (0.0008) [2023-12-27 21:40:10,594][106225] Updated weights for policy 1, policy_version 340187 (0.0009) [2023-12-27 21:40:10,652][106225] Updated weights for policy 1, policy_version 340197 (0.0009) [2023-12-27 21:40:10,713][106225] Updated weights for policy 1, policy_version 340207 (0.0007) [2023-12-27 21:40:11,054][106226] Updated weights for policy 0, policy_version 339673 (0.0009) [2023-12-27 21:40:11,113][106226] Updated weights for policy 0, policy_version 339683 (0.0007) [2023-12-27 21:40:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 174096384. Throughput: 0: 9964.9, 1: 9801.8. Samples: 174072528. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:11,175][105115] Avg episode reward: [(0, '-4.948'), (1, '-5.796')] [2023-12-27 21:40:11,180][106226] Updated weights for policy 0, policy_version 339693 (0.0007) [2023-12-27 21:40:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000340208_87113728.pth... [2023-12-27 21:40:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000339088_86827008.pth [2023-12-27 21:40:11,196][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000339696_86990848.pth... [2023-12-27 21:40:11,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000338512_86687744.pth [2023-12-27 21:40:11,540][106225] Updated weights for policy 1, policy_version 340217 (0.0009) [2023-12-27 21:40:11,593][106225] Updated weights for policy 1, policy_version 340227 (0.0009) [2023-12-27 21:40:11,660][106225] Updated weights for policy 1, policy_version 340237 (0.0009) [2023-12-27 21:40:11,930][106226] Updated weights for policy 0, policy_version 339703 (0.0009) [2023-12-27 21:40:11,991][106226] Updated weights for policy 0, policy_version 339713 (0.0009) [2023-12-27 21:40:12,053][106226] Updated weights for policy 0, policy_version 339723 (0.0008) [2023-12-27 21:40:12,484][106225] Updated weights for policy 1, policy_version 340247 (0.0008) [2023-12-27 21:40:12,547][106225] Updated weights for policy 1, policy_version 340257 (0.0008) [2023-12-27 21:40:12,608][106225] Updated weights for policy 1, policy_version 340267 (0.0009) [2023-12-27 21:40:12,812][106226] Updated weights for policy 0, policy_version 339733 (0.0009) [2023-12-27 21:40:12,871][106226] Updated weights for policy 0, policy_version 339743 (0.0009) [2023-12-27 21:40:12,933][106226] Updated weights for policy 0, policy_version 339753 (0.0008) [2023-12-27 21:40:13,273][106225] Updated weights for policy 1, policy_version 340277 (0.0007) [2023-12-27 21:40:13,331][106225] Updated weights for policy 1, policy_version 340287 (0.0006) [2023-12-27 21:40:13,390][106225] Updated weights for policy 1, policy_version 340297 (0.0008) [2023-12-27 21:40:13,672][106226] Updated weights for policy 0, policy_version 339763 (0.0008) [2023-12-27 21:40:13,727][106226] Updated weights for policy 0, policy_version 339773 (0.0008) [2023-12-27 21:40:13,776][106226] Updated weights for policy 0, policy_version 339783 (0.0008) [2023-12-27 21:40:14,014][106225] Updated weights for policy 1, policy_version 340307 (0.0007) [2023-12-27 21:40:14,085][106225] Updated weights for policy 1, policy_version 340317 (0.0005) [2023-12-27 21:40:14,142][106225] Updated weights for policy 1, policy_version 340327 (0.0008) [2023-12-27 21:40:14,559][106226] Updated weights for policy 0, policy_version 339793 (0.0008) [2023-12-27 21:40:14,619][106226] Updated weights for policy 0, policy_version 339803 (0.0009) [2023-12-27 21:40:14,680][106226] Updated weights for policy 0, policy_version 339813 (0.0009) [2023-12-27 21:40:14,742][106226] Updated weights for policy 0, policy_version 339823 (0.0009) [2023-12-27 21:40:14,769][106225] Updated weights for policy 1, policy_version 340337 (0.0008) [2023-12-27 21:40:14,831][106225] Updated weights for policy 1, policy_version 340347 (0.0008) [2023-12-27 21:40:14,887][106225] Updated weights for policy 1, policy_version 340357 (0.0008) [2023-12-27 21:40:14,939][106225] Updated weights for policy 1, policy_version 340367 (0.0008) [2023-12-27 21:40:15,485][106226] Updated weights for policy 0, policy_version 339833 (0.0008) [2023-12-27 21:40:15,546][106226] Updated weights for policy 0, policy_version 339843 (0.0008) [2023-12-27 21:40:15,609][106226] Updated weights for policy 0, policy_version 339853 (0.0008) [2023-12-27 21:40:15,695][106225] Updated weights for policy 1, policy_version 340377 (0.0008) [2023-12-27 21:40:15,746][106225] Updated weights for policy 1, policy_version 340387 (0.0008) [2023-12-27 21:40:15,804][106225] Updated weights for policy 1, policy_version 340397 (0.0008) [2023-12-27 21:40:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 174194688. Throughput: 0: 9893.8, 1: 9774.2. Samples: 174185864. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:16,176][105115] Avg episode reward: [(0, '-4.524'), (1, '-5.395')] [2023-12-27 21:40:16,364][106225] Updated weights for policy 1, policy_version 340407 (0.0006) [2023-12-27 21:40:16,411][106226] Updated weights for policy 0, policy_version 339863 (0.0007) [2023-12-27 21:40:16,421][106225] Updated weights for policy 1, policy_version 340417 (0.0007) [2023-12-27 21:40:16,470][106226] Updated weights for policy 0, policy_version 339873 (0.0005) [2023-12-27 21:40:16,479][106225] Updated weights for policy 1, policy_version 340427 (0.0007) [2023-12-27 21:40:16,525][106226] Updated weights for policy 0, policy_version 339883 (0.0006) [2023-12-27 21:40:17,146][106225] Updated weights for policy 1, policy_version 340437 (0.0007) [2023-12-27 21:40:17,205][106225] Updated weights for policy 1, policy_version 340447 (0.0008) [2023-12-27 21:40:17,252][106226] Updated weights for policy 0, policy_version 339893 (0.0009) [2023-12-27 21:40:17,266][106225] Updated weights for policy 1, policy_version 340457 (0.0006) [2023-12-27 21:40:17,304][106226] Updated weights for policy 0, policy_version 339903 (0.0006) [2023-12-27 21:40:17,363][106226] Updated weights for policy 0, policy_version 339913 (0.0009) [2023-12-27 21:40:17,922][106225] Updated weights for policy 1, policy_version 340467 (0.0006) [2023-12-27 21:40:17,972][106225] Updated weights for policy 1, policy_version 340477 (0.0008) [2023-12-27 21:40:18,025][106225] Updated weights for policy 1, policy_version 340487 (0.0007) [2023-12-27 21:40:18,127][106226] Updated weights for policy 0, policy_version 339923 (0.0009) [2023-12-27 21:40:18,194][106226] Updated weights for policy 0, policy_version 339933 (0.0010) [2023-12-27 21:40:18,244][106226] Updated weights for policy 0, policy_version 339943 (0.0010) [2023-12-27 21:40:18,768][106225] Updated weights for policy 1, policy_version 340497 (0.0008) [2023-12-27 21:40:18,822][106225] Updated weights for policy 1, policy_version 340507 (0.0008) [2023-12-27 21:40:18,873][106225] Updated weights for policy 1, policy_version 340517 (0.0007) [2023-12-27 21:40:18,930][106225] Updated weights for policy 1, policy_version 340527 (0.0008) [2023-12-27 21:40:18,963][106226] Updated weights for policy 0, policy_version 339953 (0.0010) [2023-12-27 21:40:19,029][106226] Updated weights for policy 0, policy_version 339963 (0.0006) [2023-12-27 21:40:19,098][106226] Updated weights for policy 0, policy_version 339973 (0.0008) [2023-12-27 21:40:19,160][106226] Updated weights for policy 0, policy_version 339983 (0.0007) [2023-12-27 21:40:19,771][106225] Updated weights for policy 1, policy_version 340537 (0.0008) [2023-12-27 21:40:19,830][106225] Updated weights for policy 1, policy_version 340547 (0.0008) [2023-12-27 21:40:19,879][106226] Updated weights for policy 0, policy_version 339993 (0.0008) [2023-12-27 21:40:19,896][106225] Updated weights for policy 1, policy_version 340557 (0.0008) [2023-12-27 21:40:19,948][106226] Updated weights for policy 0, policy_version 340003 (0.0008) [2023-12-27 21:40:20,018][106226] Updated weights for policy 0, policy_version 340013 (0.0006) [2023-12-27 21:40:20,650][106225] Updated weights for policy 1, policy_version 340567 (0.0008) [2023-12-27 21:40:20,681][106226] Updated weights for policy 0, policy_version 340023 (0.0008) [2023-12-27 21:40:20,709][106225] Updated weights for policy 1, policy_version 340577 (0.0008) [2023-12-27 21:40:20,742][106226] Updated weights for policy 0, policy_version 340033 (0.0008) [2023-12-27 21:40:20,773][106225] Updated weights for policy 1, policy_version 340587 (0.0008) [2023-12-27 21:40:20,803][106226] Updated weights for policy 0, policy_version 340043 (0.0006) [2023-12-27 21:40:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19910.8). Total num frames: 174292992. Throughput: 0: 9885.8, 1: 9755.0. Samples: 174301888. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:21,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-6.021')] [2023-12-27 21:40:21,535][106226] Updated weights for policy 0, policy_version 340053 (0.0008) [2023-12-27 21:40:21,593][106225] Updated weights for policy 1, policy_version 340597 (0.0007) [2023-12-27 21:40:21,595][106226] Updated weights for policy 0, policy_version 340063 (0.0011) [2023-12-27 21:40:21,664][106225] Updated weights for policy 1, policy_version 340607 (0.0008) [2023-12-27 21:40:21,665][106226] Updated weights for policy 0, policy_version 340073 (0.0011) [2023-12-27 21:40:21,734][106225] Updated weights for policy 1, policy_version 340617 (0.0007) [2023-12-27 21:40:22,422][106226] Updated weights for policy 0, policy_version 340083 (0.0010) [2023-12-27 21:40:22,470][106225] Updated weights for policy 1, policy_version 340627 (0.0008) [2023-12-27 21:40:22,481][106226] Updated weights for policy 0, policy_version 340093 (0.0007) [2023-12-27 21:40:22,530][106225] Updated weights for policy 1, policy_version 340637 (0.0008) [2023-12-27 21:40:22,536][106226] Updated weights for policy 0, policy_version 340103 (0.0006) [2023-12-27 21:40:22,589][106225] Updated weights for policy 1, policy_version 340647 (0.0008) [2023-12-27 21:40:23,289][106226] Updated weights for policy 0, policy_version 340113 (0.0006) [2023-12-27 21:40:23,294][106225] Updated weights for policy 1, policy_version 340657 (0.0008) [2023-12-27 21:40:23,339][106226] Updated weights for policy 0, policy_version 340123 (0.0010) [2023-12-27 21:40:23,345][106225] Updated weights for policy 1, policy_version 340667 (0.0005) [2023-12-27 21:40:23,389][106225] Updated weights for policy 1, policy_version 340677 (0.0005) [2023-12-27 21:40:23,396][106226] Updated weights for policy 0, policy_version 340133 (0.0010) [2023-12-27 21:40:23,444][106225] Updated weights for policy 1, policy_version 340687 (0.0005) [2023-12-27 21:40:23,453][106226] Updated weights for policy 0, policy_version 340143 (0.0010) [2023-12-27 21:40:24,112][106225] Updated weights for policy 1, policy_version 340697 (0.0009) [2023-12-27 21:40:24,165][106226] Updated weights for policy 0, policy_version 340153 (0.0008) [2023-12-27 21:40:24,177][106225] Updated weights for policy 1, policy_version 340707 (0.0008) [2023-12-27 21:40:24,227][106226] Updated weights for policy 0, policy_version 340163 (0.0010) [2023-12-27 21:40:24,236][106225] Updated weights for policy 1, policy_version 340717 (0.0010) [2023-12-27 21:40:24,288][106226] Updated weights for policy 0, policy_version 340173 (0.0010) [2023-12-27 21:40:24,916][106225] Updated weights for policy 1, policy_version 340727 (0.0006) [2023-12-27 21:40:24,947][106226] Updated weights for policy 0, policy_version 340183 (0.0007) [2023-12-27 21:40:24,966][106225] Updated weights for policy 1, policy_version 340737 (0.0005) [2023-12-27 21:40:25,011][106226] Updated weights for policy 0, policy_version 340193 (0.0006) [2023-12-27 21:40:25,023][106225] Updated weights for policy 1, policy_version 340747 (0.0005) [2023-12-27 21:40:25,077][106226] Updated weights for policy 0, policy_version 340203 (0.0005) [2023-12-27 21:40:25,570][106226] Updated weights for policy 0, policy_version 340213 (0.0006) [2023-12-27 21:40:25,571][106225] Updated weights for policy 1, policy_version 340757 (0.0007) [2023-12-27 21:40:25,622][106226] Updated weights for policy 0, policy_version 340223 (0.0005) [2023-12-27 21:40:25,628][106225] Updated weights for policy 1, policy_version 340767 (0.0009) [2023-12-27 21:40:25,678][106226] Updated weights for policy 0, policy_version 340233 (0.0006) [2023-12-27 21:40:25,684][106225] Updated weights for policy 1, policy_version 340777 (0.0008) [2023-12-27 21:40:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19910.7). Total num frames: 174391296. Throughput: 0: 9849.7, 1: 9688.3. Samples: 174357956. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:26,176][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.509')] [2023-12-27 21:40:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000340784_87261184.pth... [2023-12-27 21:40:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000340240_87130112.pth... [2023-12-27 21:40:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000339088_86835200.pth [2023-12-27 21:40:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000339632_86966272.pth [2023-12-27 21:40:26,285][106226] Updated weights for policy 0, policy_version 340243 (0.0008) [2023-12-27 21:40:26,332][106226] Updated weights for policy 0, policy_version 340253 (0.0008) [2023-12-27 21:40:26,351][106225] Updated weights for policy 1, policy_version 340787 (0.0009) [2023-12-27 21:40:26,380][106226] Updated weights for policy 0, policy_version 340263 (0.0007) [2023-12-27 21:40:26,398][106225] Updated weights for policy 1, policy_version 340797 (0.0006) [2023-12-27 21:40:26,459][106225] Updated weights for policy 1, policy_version 340808 (0.0007) [2023-12-27 21:40:26,971][106226] Updated weights for policy 0, policy_version 340273 (0.0007) [2023-12-27 21:40:27,027][106226] Updated weights for policy 0, policy_version 340283 (0.0008) [2023-12-27 21:40:27,050][106225] Updated weights for policy 1, policy_version 340818 (0.0008) [2023-12-27 21:40:27,076][106226] Updated weights for policy 0, policy_version 340293 (0.0007) [2023-12-27 21:40:27,106][106225] Updated weights for policy 1, policy_version 340828 (0.0008) [2023-12-27 21:40:27,132][106226] Updated weights for policy 0, policy_version 340303 (0.0006) [2023-12-27 21:40:27,160][106225] Updated weights for policy 1, policy_version 340838 (0.0009) [2023-12-27 21:40:27,215][106225] Updated weights for policy 1, policy_version 340848 (0.0008) [2023-12-27 21:40:27,785][106226] Updated weights for policy 0, policy_version 340313 (0.0008) [2023-12-27 21:40:27,828][106226] Updated weights for policy 0, policy_version 340323 (0.0008) [2023-12-27 21:40:27,886][106225] Updated weights for policy 1, policy_version 340858 (0.0007) [2023-12-27 21:40:27,886][106226] Updated weights for policy 0, policy_version 340333 (0.0009) [2023-12-27 21:40:27,945][106225] Updated weights for policy 1, policy_version 340868 (0.0008) [2023-12-27 21:40:27,992][106225] Updated weights for policy 1, policy_version 340878 (0.0008) [2023-12-27 21:40:28,565][106226] Updated weights for policy 0, policy_version 340343 (0.0007) [2023-12-27 21:40:28,619][106226] Updated weights for policy 0, policy_version 340353 (0.0005) [2023-12-27 21:40:28,675][106226] Updated weights for policy 0, policy_version 340363 (0.0007) [2023-12-27 21:40:28,713][106225] Updated weights for policy 1, policy_version 340888 (0.0008) [2023-12-27 21:40:28,770][106225] Updated weights for policy 1, policy_version 340898 (0.0009) [2023-12-27 21:40:28,826][106225] Updated weights for policy 1, policy_version 340908 (0.0009) [2023-12-27 21:40:29,239][106226] Updated weights for policy 0, policy_version 340373 (0.0009) [2023-12-27 21:40:29,305][106226] Updated weights for policy 0, policy_version 340383 (0.0006) [2023-12-27 21:40:29,378][106226] Updated weights for policy 0, policy_version 340393 (0.0008) [2023-12-27 21:40:29,583][106225] Updated weights for policy 1, policy_version 340918 (0.0009) [2023-12-27 21:40:29,633][106225] Updated weights for policy 1, policy_version 340928 (0.0009) [2023-12-27 21:40:29,688][106225] Updated weights for policy 1, policy_version 340938 (0.0008) [2023-12-27 21:40:30,033][106226] Updated weights for policy 0, policy_version 340403 (0.0009) [2023-12-27 21:40:30,090][106226] Updated weights for policy 0, policy_version 340413 (0.0009) [2023-12-27 21:40:30,157][106226] Updated weights for policy 0, policy_version 340423 (0.0008) [2023-12-27 21:40:30,395][106225] Updated weights for policy 1, policy_version 340948 (0.0008) [2023-12-27 21:40:30,459][106225] Updated weights for policy 1, policy_version 340958 (0.0008) [2023-12-27 21:40:30,522][106225] Updated weights for policy 1, policy_version 340968 (0.0008) [2023-12-27 21:40:30,805][106226] Updated weights for policy 0, policy_version 340433 (0.0010) [2023-12-27 21:40:30,871][106226] Updated weights for policy 0, policy_version 340443 (0.0005) [2023-12-27 21:40:30,936][106226] Updated weights for policy 0, policy_version 340453 (0.0006) [2023-12-27 21:40:30,994][106226] Updated weights for policy 0, policy_version 340463 (0.0006) [2023-12-27 21:40:31,155][106225] Updated weights for policy 1, policy_version 340978 (0.0007) [2023-12-27 21:40:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 174497792. Throughput: 0: 10043.3, 1: 9809.4. Samples: 174486276. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:31,175][105115] Avg episode reward: [(0, '-4.894'), (1, '-5.586')] [2023-12-27 21:40:31,218][106225] Updated weights for policy 1, policy_version 340988 (0.0010) [2023-12-27 21:40:31,274][106225] Updated weights for policy 1, policy_version 340998 (0.0009) [2023-12-27 21:40:31,323][106225] Updated weights for policy 1, policy_version 341008 (0.0009) [2023-12-27 21:40:31,684][106226] Updated weights for policy 0, policy_version 340473 (0.0007) [2023-12-27 21:40:31,754][106226] Updated weights for policy 0, policy_version 340483 (0.0007) [2023-12-27 21:40:31,813][106226] Updated weights for policy 0, policy_version 340493 (0.0007) [2023-12-27 21:40:32,132][106225] Updated weights for policy 1, policy_version 341018 (0.0010) [2023-12-27 21:40:32,185][106225] Updated weights for policy 1, policy_version 341028 (0.0010) [2023-12-27 21:40:32,247][106225] Updated weights for policy 1, policy_version 341038 (0.0010) [2023-12-27 21:40:32,437][106226] Updated weights for policy 0, policy_version 340503 (0.0006) [2023-12-27 21:40:32,485][106226] Updated weights for policy 0, policy_version 340513 (0.0008) [2023-12-27 21:40:32,543][106226] Updated weights for policy 0, policy_version 340523 (0.0008) [2023-12-27 21:40:32,977][106225] Updated weights for policy 1, policy_version 341048 (0.0010) [2023-12-27 21:40:33,033][106225] Updated weights for policy 1, policy_version 341058 (0.0010) [2023-12-27 21:40:33,082][106225] Updated weights for policy 1, policy_version 341068 (0.0010) [2023-12-27 21:40:33,241][106226] Updated weights for policy 0, policy_version 340533 (0.0007) [2023-12-27 21:40:33,301][106226] Updated weights for policy 0, policy_version 340543 (0.0008) [2023-12-27 21:40:33,351][106226] Updated weights for policy 0, policy_version 340553 (0.0008) [2023-12-27 21:40:33,787][106225] Updated weights for policy 1, policy_version 341078 (0.0010) [2023-12-27 21:40:33,837][106225] Updated weights for policy 1, policy_version 341088 (0.0010) [2023-12-27 21:40:33,880][106225] Updated weights for policy 1, policy_version 341098 (0.0010) [2023-12-27 21:40:33,924][106226] Updated weights for policy 0, policy_version 340563 (0.0006) [2023-12-27 21:40:33,980][106226] Updated weights for policy 0, policy_version 340573 (0.0006) [2023-12-27 21:40:34,039][106226] Updated weights for policy 0, policy_version 340583 (0.0007) [2023-12-27 21:40:34,615][106225] Updated weights for policy 1, policy_version 341108 (0.0010) [2023-12-27 21:40:34,669][106225] Updated weights for policy 1, policy_version 341118 (0.0010) [2023-12-27 21:40:34,727][106225] Updated weights for policy 1, policy_version 341128 (0.0010) [2023-12-27 21:40:34,740][106226] Updated weights for policy 0, policy_version 340593 (0.0008) [2023-12-27 21:40:34,790][106226] Updated weights for policy 0, policy_version 340603 (0.0010) [2023-12-27 21:40:34,842][106226] Updated weights for policy 0, policy_version 340613 (0.0010) [2023-12-27 21:40:34,892][106226] Updated weights for policy 0, policy_version 340623 (0.0010) [2023-12-27 21:40:35,432][106225] Updated weights for policy 1, policy_version 341138 (0.0009) [2023-12-27 21:40:35,477][106225] Updated weights for policy 1, policy_version 341148 (0.0009) [2023-12-27 21:40:35,533][106225] Updated weights for policy 1, policy_version 341158 (0.0010) [2023-12-27 21:40:35,585][106226] Updated weights for policy 0, policy_version 340633 (0.0010) [2023-12-27 21:40:35,586][106225] Updated weights for policy 1, policy_version 341168 (0.0010) [2023-12-27 21:40:35,648][106226] Updated weights for policy 0, policy_version 340643 (0.0010) [2023-12-27 21:40:35,711][106226] Updated weights for policy 0, policy_version 340653 (0.0010) [2023-12-27 21:40:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 174596096. Throughput: 0: 10028.8, 1: 9745.6. Samples: 174607656. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:36,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.997')] [2023-12-27 21:40:36,320][106225] Updated weights for policy 1, policy_version 341178 (0.0008) [2023-12-27 21:40:36,383][106225] Updated weights for policy 1, policy_version 341188 (0.0008) [2023-12-27 21:40:36,427][106226] Updated weights for policy 0, policy_version 340663 (0.0011) [2023-12-27 21:40:36,440][106225] Updated weights for policy 1, policy_version 341198 (0.0008) [2023-12-27 21:40:36,492][106226] Updated weights for policy 0, policy_version 340673 (0.0011) [2023-12-27 21:40:36,556][106226] Updated weights for policy 0, policy_version 340683 (0.0009) [2023-12-27 21:40:37,135][106225] Updated weights for policy 1, policy_version 341208 (0.0008) [2023-12-27 21:40:37,194][106225] Updated weights for policy 1, policy_version 341218 (0.0006) [2023-12-27 21:40:37,249][106226] Updated weights for policy 0, policy_version 340693 (0.0007) [2023-12-27 21:40:37,256][106225] Updated weights for policy 1, policy_version 341228 (0.0005) [2023-12-27 21:40:37,307][106226] Updated weights for policy 0, policy_version 340703 (0.0007) [2023-12-27 21:40:37,377][106226] Updated weights for policy 0, policy_version 340713 (0.0008) [2023-12-27 21:40:37,836][106225] Updated weights for policy 1, policy_version 341238 (0.0009) [2023-12-27 21:40:37,886][106225] Updated weights for policy 1, policy_version 341248 (0.0010) [2023-12-27 21:40:37,936][106225] Updated weights for policy 1, policy_version 341258 (0.0010) [2023-12-27 21:40:38,140][106226] Updated weights for policy 0, policy_version 340723 (0.0008) [2023-12-27 21:40:38,197][106226] Updated weights for policy 0, policy_version 340733 (0.0009) [2023-12-27 21:40:38,256][106226] Updated weights for policy 0, policy_version 340743 (0.0006) [2023-12-27 21:40:38,631][106225] Updated weights for policy 1, policy_version 341268 (0.0010) [2023-12-27 21:40:38,686][106225] Updated weights for policy 1, policy_version 341278 (0.0010) [2023-12-27 21:40:38,737][106225] Updated weights for policy 1, policy_version 341288 (0.0010) [2023-12-27 21:40:38,963][106226] Updated weights for policy 0, policy_version 340753 (0.0006) [2023-12-27 21:40:39,023][106226] Updated weights for policy 0, policy_version 340763 (0.0009) [2023-12-27 21:40:39,081][106226] Updated weights for policy 0, policy_version 340773 (0.0009) [2023-12-27 21:40:39,138][106226] Updated weights for policy 0, policy_version 340783 (0.0009) [2023-12-27 21:40:39,524][106225] Updated weights for policy 1, policy_version 341298 (0.0010) [2023-12-27 21:40:39,585][106225] Updated weights for policy 1, policy_version 341308 (0.0009) [2023-12-27 21:40:39,647][106225] Updated weights for policy 1, policy_version 341318 (0.0009) [2023-12-27 21:40:39,708][106225] Updated weights for policy 1, policy_version 341328 (0.0009) [2023-12-27 21:40:39,914][106226] Updated weights for policy 0, policy_version 340793 (0.0007) [2023-12-27 21:40:39,984][106226] Updated weights for policy 0, policy_version 340803 (0.0008) [2023-12-27 21:40:40,051][106226] Updated weights for policy 0, policy_version 340813 (0.0008) [2023-12-27 21:40:40,379][106225] Updated weights for policy 1, policy_version 341338 (0.0006) [2023-12-27 21:40:40,435][106225] Updated weights for policy 1, policy_version 341348 (0.0007) [2023-12-27 21:40:40,487][106225] Updated weights for policy 1, policy_version 341358 (0.0005) [2023-12-27 21:40:40,826][106226] Updated weights for policy 0, policy_version 340823 (0.0006) [2023-12-27 21:40:40,894][106226] Updated weights for policy 0, policy_version 340833 (0.0005) [2023-12-27 21:40:40,958][106226] Updated weights for policy 0, policy_version 340843 (0.0005) [2023-12-27 21:40:41,116][106225] Updated weights for policy 1, policy_version 341368 (0.0008) [2023-12-27 21:40:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 174694400. Throughput: 0: 10013.9, 1: 9822.5. Samples: 174667040. Policy #0 lag: (min: 0.0, avg: 28.5, max: 32.0) [2023-12-27 21:40:41,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-5.607')] [2023-12-27 21:40:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000340848_87285760.pth... [2023-12-27 21:40:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000339696_86990848.pth [2023-12-27 21:40:41,189][106225] Updated weights for policy 1, policy_version 341378 (0.0008) [2023-12-27 21:40:41,255][106225] Updated weights for policy 1, policy_version 341388 (0.0007) [2023-12-27 21:40:41,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000341392_87416832.pth... [2023-12-27 21:40:41,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000340208_87113728.pth [2023-12-27 21:40:41,646][106226] Updated weights for policy 0, policy_version 340853 (0.0007) [2023-12-27 21:40:41,720][106226] Updated weights for policy 0, policy_version 340863 (0.0009) [2023-12-27 21:40:41,787][106226] Updated weights for policy 0, policy_version 340873 (0.0009) [2023-12-27 21:40:41,960][106225] Updated weights for policy 1, policy_version 341398 (0.0008) [2023-12-27 21:40:42,015][106225] Updated weights for policy 1, policy_version 341408 (0.0007) [2023-12-27 21:40:42,075][106225] Updated weights for policy 1, policy_version 341418 (0.0006) [2023-12-27 21:40:42,663][106226] Updated weights for policy 0, policy_version 340883 (0.0009) [2023-12-27 21:40:42,722][106226] Updated weights for policy 0, policy_version 340893 (0.0009) [2023-12-27 21:40:42,769][106225] Updated weights for policy 1, policy_version 341428 (0.0007) [2023-12-27 21:40:42,788][106226] Updated weights for policy 0, policy_version 340903 (0.0007) [2023-12-27 21:40:42,836][106225] Updated weights for policy 1, policy_version 341438 (0.0008) [2023-12-27 21:40:42,899][106225] Updated weights for policy 1, policy_version 341448 (0.0008) [2023-12-27 21:40:43,404][106226] Updated weights for policy 0, policy_version 340913 (0.0007) [2023-12-27 21:40:43,464][106226] Updated weights for policy 0, policy_version 340923 (0.0008) [2023-12-27 21:40:43,522][106226] Updated weights for policy 0, policy_version 340933 (0.0008) [2023-12-27 21:40:43,581][106226] Updated weights for policy 0, policy_version 340943 (0.0007) [2023-12-27 21:40:43,586][106225] Updated weights for policy 1, policy_version 341458 (0.0010) [2023-12-27 21:40:43,639][106225] Updated weights for policy 1, policy_version 341468 (0.0010) [2023-12-27 21:40:43,696][106225] Updated weights for policy 1, policy_version 341478 (0.0010) [2023-12-27 21:40:43,755][106225] Updated weights for policy 1, policy_version 341488 (0.0010) [2023-12-27 21:40:44,238][106226] Updated weights for policy 0, policy_version 340953 (0.0008) [2023-12-27 21:40:44,291][106226] Updated weights for policy 0, policy_version 340963 (0.0008) [2023-12-27 21:40:44,349][106226] Updated weights for policy 0, policy_version 340973 (0.0008) [2023-12-27 21:40:44,482][106225] Updated weights for policy 1, policy_version 341498 (0.0010) [2023-12-27 21:40:44,541][106225] Updated weights for policy 1, policy_version 341508 (0.0010) [2023-12-27 21:40:44,609][106225] Updated weights for policy 1, policy_version 341518 (0.0010) [2023-12-27 21:40:45,063][106226] Updated weights for policy 0, policy_version 340983 (0.0008) [2023-12-27 21:40:45,131][106226] Updated weights for policy 0, policy_version 340993 (0.0007) [2023-12-27 21:40:45,196][106226] Updated weights for policy 0, policy_version 341003 (0.0008) [2023-12-27 21:40:45,373][106225] Updated weights for policy 1, policy_version 341528 (0.0008) [2023-12-27 21:40:45,442][106225] Updated weights for policy 1, policy_version 341538 (0.0006) [2023-12-27 21:40:45,506][106225] Updated weights for policy 1, policy_version 341548 (0.0007) [2023-12-27 21:40:45,941][106226] Updated weights for policy 0, policy_version 341014 (0.0009) [2023-12-27 21:40:45,990][106226] Updated weights for policy 0, policy_version 341024 (0.0009) [2023-12-27 21:40:46,040][106226] Updated weights for policy 0, policy_version 341034 (0.0008) [2023-12-27 21:40:46,060][106225] Updated weights for policy 1, policy_version 341558 (0.0006) [2023-12-27 21:40:46,113][106225] Updated weights for policy 1, policy_version 341568 (0.0006) [2023-12-27 21:40:46,168][106225] Updated weights for policy 1, policy_version 341578 (0.0010) [2023-12-27 21:40:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 174792704. Throughput: 0: 9937.9, 1: 9832.7. Samples: 174783448. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:40:46,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-5.877')] [2023-12-27 21:40:46,763][106226] Updated weights for policy 0, policy_version 341044 (0.0008) [2023-12-27 21:40:46,784][106225] Updated weights for policy 1, policy_version 341588 (0.0010) [2023-12-27 21:40:46,817][106226] Updated weights for policy 0, policy_version 341054 (0.0008) [2023-12-27 21:40:46,851][106225] Updated weights for policy 1, policy_version 341598 (0.0007) [2023-12-27 21:40:46,878][106226] Updated weights for policy 0, policy_version 341064 (0.0008) [2023-12-27 21:40:46,907][106225] Updated weights for policy 1, policy_version 341608 (0.0008) [2023-12-27 21:40:47,517][106225] Updated weights for policy 1, policy_version 341618 (0.0009) [2023-12-27 21:40:47,575][106225] Updated weights for policy 1, policy_version 341628 (0.0005) [2023-12-27 21:40:47,633][106225] Updated weights for policy 1, policy_version 341638 (0.0007) [2023-12-27 21:40:47,634][106226] Updated weights for policy 0, policy_version 341074 (0.0007) [2023-12-27 21:40:47,690][106225] Updated weights for policy 1, policy_version 341648 (0.0005) [2023-12-27 21:40:47,698][106226] Updated weights for policy 0, policy_version 341084 (0.0008) [2023-12-27 21:40:47,750][106226] Updated weights for policy 0, policy_version 341094 (0.0007) [2023-12-27 21:40:47,807][106226] Updated weights for policy 0, policy_version 341104 (0.0008) [2023-12-27 21:40:48,235][106225] Updated weights for policy 1, policy_version 341658 (0.0006) [2023-12-27 21:40:48,298][106225] Updated weights for policy 1, policy_version 341668 (0.0006) [2023-12-27 21:40:48,360][106225] Updated weights for policy 1, policy_version 341678 (0.0007) [2023-12-27 21:40:48,652][106226] Updated weights for policy 0, policy_version 341114 (0.0007) [2023-12-27 21:40:48,714][106226] Updated weights for policy 0, policy_version 341124 (0.0008) [2023-12-27 21:40:48,780][106226] Updated weights for policy 0, policy_version 341134 (0.0009) [2023-12-27 21:40:49,033][106225] Updated weights for policy 1, policy_version 341688 (0.0007) [2023-12-27 21:40:49,092][106225] Updated weights for policy 1, policy_version 341698 (0.0008) [2023-12-27 21:40:49,151][106225] Updated weights for policy 1, policy_version 341708 (0.0009) [2023-12-27 21:40:49,505][106226] Updated weights for policy 0, policy_version 341144 (0.0009) [2023-12-27 21:40:49,560][106226] Updated weights for policy 0, policy_version 341154 (0.0009) [2023-12-27 21:40:49,620][106226] Updated weights for policy 0, policy_version 341164 (0.0008) [2023-12-27 21:40:49,862][106225] Updated weights for policy 1, policy_version 341718 (0.0008) [2023-12-27 21:40:49,918][106225] Updated weights for policy 1, policy_version 341728 (0.0008) [2023-12-27 21:40:49,988][106225] Updated weights for policy 1, policy_version 341738 (0.0008) [2023-12-27 21:40:50,371][106226] Updated weights for policy 0, policy_version 341174 (0.0009) [2023-12-27 21:40:50,438][106226] Updated weights for policy 0, policy_version 341184 (0.0009) [2023-12-27 21:40:50,490][106226] Updated weights for policy 0, policy_version 341194 (0.0009) [2023-12-27 21:40:50,732][106225] Updated weights for policy 1, policy_version 341748 (0.0009) [2023-12-27 21:40:50,779][106225] Updated weights for policy 1, policy_version 341758 (0.0008) [2023-12-27 21:40:50,831][106225] Updated weights for policy 1, policy_version 341768 (0.0008) [2023-12-27 21:40:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 174891008. Throughput: 0: 9814.8, 1: 9932.2. Samples: 174901588. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:40:51,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.659')] [2023-12-27 21:40:51,241][106226] Updated weights for policy 0, policy_version 341204 (0.0008) [2023-12-27 21:40:51,301][106226] Updated weights for policy 0, policy_version 341214 (0.0008) [2023-12-27 21:40:51,407][106226] Updated weights for policy 0, policy_version 341224 (0.0010) [2023-12-27 21:40:51,625][106225] Updated weights for policy 1, policy_version 341778 (0.0008) [2023-12-27 21:40:51,687][106225] Updated weights for policy 1, policy_version 341788 (0.0009) [2023-12-27 21:40:51,750][106225] Updated weights for policy 1, policy_version 341798 (0.0008) [2023-12-27 21:40:51,809][106225] Updated weights for policy 1, policy_version 341808 (0.0007) [2023-12-27 21:40:52,178][106226] Updated weights for policy 0, policy_version 341234 (0.0008) [2023-12-27 21:40:52,240][106226] Updated weights for policy 0, policy_version 341244 (0.0007) [2023-12-27 21:40:52,307][106226] Updated weights for policy 0, policy_version 341254 (0.0009) [2023-12-27 21:40:52,373][106226] Updated weights for policy 0, policy_version 341264 (0.0009) [2023-12-27 21:40:52,498][106225] Updated weights for policy 1, policy_version 341818 (0.0006) [2023-12-27 21:40:52,561][106225] Updated weights for policy 1, policy_version 341828 (0.0008) [2023-12-27 21:40:52,621][106225] Updated weights for policy 1, policy_version 341838 (0.0009) [2023-12-27 21:40:53,103][106226] Updated weights for policy 0, policy_version 341274 (0.0008) [2023-12-27 21:40:53,163][106226] Updated weights for policy 0, policy_version 341284 (0.0008) [2023-12-27 21:40:53,212][106226] Updated weights for policy 0, policy_version 341294 (0.0008) [2023-12-27 21:40:53,299][106225] Updated weights for policy 1, policy_version 341848 (0.0009) [2023-12-27 21:40:53,360][106225] Updated weights for policy 1, policy_version 341858 (0.0009) [2023-12-27 21:40:53,412][106225] Updated weights for policy 1, policy_version 341868 (0.0008) [2023-12-27 21:40:53,939][106226] Updated weights for policy 0, policy_version 341304 (0.0008) [2023-12-27 21:40:53,995][106226] Updated weights for policy 0, policy_version 341314 (0.0008) [2023-12-27 21:40:54,051][106226] Updated weights for policy 0, policy_version 341324 (0.0009) [2023-12-27 21:40:54,121][106225] Updated weights for policy 1, policy_version 341878 (0.0007) [2023-12-27 21:40:54,186][106225] Updated weights for policy 1, policy_version 341888 (0.0006) [2023-12-27 21:40:54,250][106225] Updated weights for policy 1, policy_version 341898 (0.0006) [2023-12-27 21:40:54,782][106226] Updated weights for policy 0, policy_version 341334 (0.0009) [2023-12-27 21:40:54,836][106226] Updated weights for policy 0, policy_version 341344 (0.0008) [2023-12-27 21:40:54,861][106225] Updated weights for policy 1, policy_version 341908 (0.0007) [2023-12-27 21:40:54,895][106226] Updated weights for policy 0, policy_version 341354 (0.0007) [2023-12-27 21:40:54,916][106225] Updated weights for policy 1, policy_version 341918 (0.0007) [2023-12-27 21:40:54,970][106225] Updated weights for policy 1, policy_version 341928 (0.0007) [2023-12-27 21:40:55,593][106226] Updated weights for policy 0, policy_version 341364 (0.0006) [2023-12-27 21:40:55,644][106226] Updated weights for policy 0, policy_version 341374 (0.0009) [2023-12-27 21:40:55,678][106225] Updated weights for policy 1, policy_version 341938 (0.0006) [2023-12-27 21:40:55,703][106226] Updated weights for policy 0, policy_version 341384 (0.0007) [2023-12-27 21:40:55,727][106225] Updated weights for policy 1, policy_version 341948 (0.0007) [2023-12-27 21:40:55,777][106225] Updated weights for policy 1, policy_version 341958 (0.0009) [2023-12-27 21:40:55,830][106225] Updated weights for policy 1, policy_version 341968 (0.0005) [2023-12-27 21:40:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 174989312. Throughput: 0: 9751.9, 1: 9922.1. Samples: 174957864. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:40:56,176][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.696')] [2023-12-27 21:40:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000341968_87564288.pth... [2023-12-27 21:40:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000341392_87425024.pth... [2023-12-27 21:40:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000340784_87261184.pth [2023-12-27 21:40:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000340240_87130112.pth [2023-12-27 21:40:56,378][106225] Updated weights for policy 1, policy_version 341978 (0.0010) [2023-12-27 21:40:56,427][106225] Updated weights for policy 1, policy_version 341988 (0.0007) [2023-12-27 21:40:56,432][106226] Updated weights for policy 0, policy_version 341394 (0.0007) [2023-12-27 21:40:56,478][106225] Updated weights for policy 1, policy_version 341998 (0.0008) [2023-12-27 21:40:56,481][106226] Updated weights for policy 0, policy_version 341404 (0.0006) [2023-12-27 21:40:56,538][106226] Updated weights for policy 0, policy_version 341414 (0.0007) [2023-12-27 21:40:56,601][106226] Updated weights for policy 0, policy_version 341424 (0.0009) [2023-12-27 21:40:57,028][106225] Updated weights for policy 1, policy_version 342008 (0.0006) [2023-12-27 21:40:57,085][106225] Updated weights for policy 1, policy_version 342018 (0.0005) [2023-12-27 21:40:57,144][106225] Updated weights for policy 1, policy_version 342028 (0.0005) [2023-12-27 21:40:57,417][106226] Updated weights for policy 0, policy_version 341434 (0.0007) [2023-12-27 21:40:57,471][106226] Updated weights for policy 0, policy_version 341444 (0.0010) [2023-12-27 21:40:57,521][106226] Updated weights for policy 0, policy_version 341454 (0.0010) [2023-12-27 21:40:57,729][106225] Updated weights for policy 1, policy_version 342038 (0.0008) [2023-12-27 21:40:57,790][106225] Updated weights for policy 1, policy_version 342048 (0.0007) [2023-12-27 21:40:57,841][106225] Updated weights for policy 1, policy_version 342058 (0.0005) [2023-12-27 21:40:58,164][106226] Updated weights for policy 0, policy_version 341464 (0.0006) [2023-12-27 21:40:58,224][106226] Updated weights for policy 0, policy_version 341474 (0.0008) [2023-12-27 21:40:58,285][106226] Updated weights for policy 0, policy_version 341484 (0.0010) [2023-12-27 21:40:58,557][106225] Updated weights for policy 1, policy_version 342068 (0.0008) [2023-12-27 21:40:58,622][106225] Updated weights for policy 1, policy_version 342078 (0.0011) [2023-12-27 21:40:58,694][106225] Updated weights for policy 1, policy_version 342088 (0.0009) [2023-12-27 21:40:59,003][106226] Updated weights for policy 0, policy_version 341494 (0.0010) [2023-12-27 21:40:59,065][106226] Updated weights for policy 0, policy_version 341504 (0.0009) [2023-12-27 21:40:59,130][106226] Updated weights for policy 0, policy_version 341514 (0.0010) [2023-12-27 21:40:59,454][106225] Updated weights for policy 1, policy_version 342098 (0.0008) [2023-12-27 21:40:59,514][106225] Updated weights for policy 1, policy_version 342108 (0.0010) [2023-12-27 21:40:59,574][106225] Updated weights for policy 1, policy_version 342118 (0.0010) [2023-12-27 21:40:59,638][106225] Updated weights for policy 1, policy_version 342128 (0.0010) [2023-12-27 21:40:59,885][106226] Updated weights for policy 0, policy_version 341524 (0.0007) [2023-12-27 21:40:59,943][106226] Updated weights for policy 0, policy_version 341534 (0.0008) [2023-12-27 21:41:00,000][106226] Updated weights for policy 0, policy_version 341544 (0.0006) [2023-12-27 21:41:00,371][106225] Updated weights for policy 1, policy_version 342138 (0.0009) [2023-12-27 21:41:00,428][106225] Updated weights for policy 1, policy_version 342148 (0.0010) [2023-12-27 21:41:00,490][106225] Updated weights for policy 1, policy_version 342158 (0.0010) [2023-12-27 21:41:00,719][106226] Updated weights for policy 0, policy_version 341554 (0.0008) [2023-12-27 21:41:00,776][106226] Updated weights for policy 0, policy_version 341564 (0.0008) [2023-12-27 21:41:00,836][106226] Updated weights for policy 0, policy_version 341574 (0.0007) [2023-12-27 21:41:00,901][106226] Updated weights for policy 0, policy_version 341584 (0.0008) [2023-12-27 21:41:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 175087616. Throughput: 0: 9770.2, 1: 10066.6. Samples: 175078516. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:01,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.467')] [2023-12-27 21:41:01,218][106225] Updated weights for policy 1, policy_version 342168 (0.0009) [2023-12-27 21:41:01,280][106225] Updated weights for policy 1, policy_version 342178 (0.0010) [2023-12-27 21:41:01,341][106225] Updated weights for policy 1, policy_version 342188 (0.0010) [2023-12-27 21:41:01,603][106226] Updated weights for policy 0, policy_version 341594 (0.0006) [2023-12-27 21:41:01,669][106226] Updated weights for policy 0, policy_version 341604 (0.0008) [2023-12-27 21:41:01,735][106226] Updated weights for policy 0, policy_version 341614 (0.0010) [2023-12-27 21:41:02,101][106225] Updated weights for policy 1, policy_version 342198 (0.0010) [2023-12-27 21:41:02,165][106225] Updated weights for policy 1, policy_version 342208 (0.0010) [2023-12-27 21:41:02,226][106225] Updated weights for policy 1, policy_version 342218 (0.0010) [2023-12-27 21:41:02,335][106226] Updated weights for policy 0, policy_version 341624 (0.0007) [2023-12-27 21:41:02,394][106226] Updated weights for policy 0, policy_version 341634 (0.0008) [2023-12-27 21:41:02,448][106226] Updated weights for policy 0, policy_version 341644 (0.0008) [2023-12-27 21:41:02,965][106225] Updated weights for policy 1, policy_version 342228 (0.0010) [2023-12-27 21:41:03,015][106225] Updated weights for policy 1, policy_version 342238 (0.0010) [2023-12-27 21:41:03,062][106225] Updated weights for policy 1, policy_version 342248 (0.0010) [2023-12-27 21:41:03,179][106226] Updated weights for policy 0, policy_version 341654 (0.0008) [2023-12-27 21:41:03,236][106226] Updated weights for policy 0, policy_version 341664 (0.0008) [2023-12-27 21:41:03,300][106226] Updated weights for policy 0, policy_version 341674 (0.0008) [2023-12-27 21:41:03,703][106225] Updated weights for policy 1, policy_version 342258 (0.0009) [2023-12-27 21:41:03,759][106225] Updated weights for policy 1, policy_version 342268 (0.0005) [2023-12-27 21:41:03,814][106225] Updated weights for policy 1, policy_version 342278 (0.0005) [2023-12-27 21:41:03,879][106225] Updated weights for policy 1, policy_version 342288 (0.0009) [2023-12-27 21:41:04,020][106226] Updated weights for policy 0, policy_version 341684 (0.0007) [2023-12-27 21:41:04,090][106226] Updated weights for policy 0, policy_version 341694 (0.0006) [2023-12-27 21:41:04,164][106226] Updated weights for policy 0, policy_version 341704 (0.0006) [2023-12-27 21:41:04,591][106225] Updated weights for policy 1, policy_version 342298 (0.0008) [2023-12-27 21:41:04,645][106225] Updated weights for policy 1, policy_version 342308 (0.0007) [2023-12-27 21:41:04,704][106225] Updated weights for policy 1, policy_version 342318 (0.0006) [2023-12-27 21:41:04,889][106226] Updated weights for policy 0, policy_version 341714 (0.0006) [2023-12-27 21:41:04,948][106226] Updated weights for policy 0, policy_version 341724 (0.0008) [2023-12-27 21:41:05,008][106226] Updated weights for policy 0, policy_version 341734 (0.0005) [2023-12-27 21:41:05,065][106226] Updated weights for policy 0, policy_version 341744 (0.0007) [2023-12-27 21:41:05,267][106225] Updated weights for policy 1, policy_version 342328 (0.0007) [2023-12-27 21:41:05,335][106225] Updated weights for policy 1, policy_version 342338 (0.0010) [2023-12-27 21:41:05,387][106225] Updated weights for policy 1, policy_version 342348 (0.0010) [2023-12-27 21:41:05,693][106226] Updated weights for policy 0, policy_version 341754 (0.0008) [2023-12-27 21:41:05,739][106226] Updated weights for policy 0, policy_version 341764 (0.0007) [2023-12-27 21:41:05,785][106226] Updated weights for policy 0, policy_version 341774 (0.0008) [2023-12-27 21:41:06,048][106225] Updated weights for policy 1, policy_version 342358 (0.0007) [2023-12-27 21:41:06,114][106225] Updated weights for policy 1, policy_version 342368 (0.0007) [2023-12-27 21:41:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 175185920. Throughput: 0: 9825.3, 1: 10109.4. Samples: 175198952. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:06,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-5.980')] [2023-12-27 21:41:06,182][106225] Updated weights for policy 1, policy_version 342378 (0.0010) [2023-12-27 21:41:06,563][106226] Updated weights for policy 0, policy_version 341784 (0.0009) [2023-12-27 21:41:06,617][106226] Updated weights for policy 0, policy_version 341794 (0.0009) [2023-12-27 21:41:06,673][106226] Updated weights for policy 0, policy_version 341804 (0.0008) [2023-12-27 21:41:06,826][106225] Updated weights for policy 1, policy_version 342388 (0.0008) [2023-12-27 21:41:06,877][106225] Updated weights for policy 1, policy_version 342398 (0.0005) [2023-12-27 21:41:06,932][106225] Updated weights for policy 1, policy_version 342408 (0.0006) [2023-12-27 21:41:07,454][106226] Updated weights for policy 0, policy_version 341814 (0.0008) [2023-12-27 21:41:07,505][106226] Updated weights for policy 0, policy_version 341824 (0.0008) [2023-12-27 21:41:07,562][106226] Updated weights for policy 0, policy_version 341834 (0.0008) [2023-12-27 21:41:07,619][106225] Updated weights for policy 1, policy_version 342418 (0.0010) [2023-12-27 21:41:07,671][106225] Updated weights for policy 1, policy_version 342428 (0.0010) [2023-12-27 21:41:07,728][106225] Updated weights for policy 1, policy_version 342438 (0.0010) [2023-12-27 21:41:07,789][106225] Updated weights for policy 1, policy_version 342448 (0.0007) [2023-12-27 21:41:08,356][106226] Updated weights for policy 0, policy_version 341844 (0.0008) [2023-12-27 21:41:08,425][106226] Updated weights for policy 0, policy_version 341854 (0.0007) [2023-12-27 21:41:08,441][106225] Updated weights for policy 1, policy_version 342458 (0.0008) [2023-12-27 21:41:08,476][106226] Updated weights for policy 0, policy_version 341864 (0.0008) [2023-12-27 21:41:08,493][106225] Updated weights for policy 1, policy_version 342468 (0.0008) [2023-12-27 21:41:08,545][106225] Updated weights for policy 1, policy_version 342478 (0.0008) [2023-12-27 21:41:09,263][106225] Updated weights for policy 1, policy_version 342488 (0.0009) [2023-12-27 21:41:09,266][106226] Updated weights for policy 0, policy_version 341874 (0.0008) [2023-12-27 21:41:09,332][106226] Updated weights for policy 0, policy_version 341884 (0.0009) [2023-12-27 21:41:09,344][106225] Updated weights for policy 1, policy_version 342498 (0.0008) [2023-12-27 21:41:09,402][106226] Updated weights for policy 0, policy_version 341894 (0.0008) [2023-12-27 21:41:09,415][106225] Updated weights for policy 1, policy_version 342508 (0.0008) [2023-12-27 21:41:09,463][106226] Updated weights for policy 0, policy_version 341904 (0.0009) [2023-12-27 21:41:10,214][106225] Updated weights for policy 1, policy_version 342518 (0.0008) [2023-12-27 21:41:10,221][106226] Updated weights for policy 0, policy_version 341914 (0.0006) [2023-12-27 21:41:10,280][106226] Updated weights for policy 0, policy_version 341924 (0.0006) [2023-12-27 21:41:10,281][106225] Updated weights for policy 1, policy_version 342528 (0.0008) [2023-12-27 21:41:10,343][106226] Updated weights for policy 0, policy_version 341934 (0.0007) [2023-12-27 21:41:10,346][106225] Updated weights for policy 1, policy_version 342538 (0.0009) [2023-12-27 21:41:11,029][106226] Updated weights for policy 0, policy_version 341944 (0.0008) [2023-12-27 21:41:11,087][106225] Updated weights for policy 1, policy_version 342548 (0.0007) [2023-12-27 21:41:11,096][106226] Updated weights for policy 0, policy_version 341954 (0.0009) [2023-12-27 21:41:11,151][106225] Updated weights for policy 1, policy_version 342558 (0.0007) [2023-12-27 21:41:11,165][106226] Updated weights for policy 0, policy_version 341964 (0.0008) [2023-12-27 21:41:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 175276032. Throughput: 0: 9817.3, 1: 10154.6. Samples: 175256688. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:11,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.836')] [2023-12-27 21:41:11,189][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000341968_87572480.pth... [2023-12-27 21:41:11,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000340848_87285760.pth [2023-12-27 21:41:11,215][106225] Updated weights for policy 1, policy_version 342568 (0.0008) [2023-12-27 21:41:11,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000342576_87719936.pth... [2023-12-27 21:41:11,272][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000341392_87416832.pth [2023-12-27 21:41:11,953][106226] Updated weights for policy 0, policy_version 341974 (0.0009) [2023-12-27 21:41:12,014][106226] Updated weights for policy 0, policy_version 341984 (0.0011) [2023-12-27 21:41:12,015][106225] Updated weights for policy 1, policy_version 342578 (0.0009) [2023-12-27 21:41:12,065][106226] Updated weights for policy 0, policy_version 341994 (0.0010) [2023-12-27 21:41:12,078][106225] Updated weights for policy 1, policy_version 342588 (0.0006) [2023-12-27 21:41:12,135][106225] Updated weights for policy 1, policy_version 342598 (0.0007) [2023-12-27 21:41:12,197][106225] Updated weights for policy 1, policy_version 342608 (0.0009) [2023-12-27 21:41:12,808][106226] Updated weights for policy 0, policy_version 342004 (0.0009) [2023-12-27 21:41:12,875][106226] Updated weights for policy 0, policy_version 342014 (0.0006) [2023-12-27 21:41:12,931][106226] Updated weights for policy 0, policy_version 342024 (0.0006) [2023-12-27 21:41:12,975][106225] Updated weights for policy 1, policy_version 342618 (0.0008) [2023-12-27 21:41:13,039][106225] Updated weights for policy 1, policy_version 342628 (0.0009) [2023-12-27 21:41:13,096][106225] Updated weights for policy 1, policy_version 342638 (0.0008) [2023-12-27 21:41:13,647][106226] Updated weights for policy 0, policy_version 342034 (0.0006) [2023-12-27 21:41:13,704][106226] Updated weights for policy 0, policy_version 342044 (0.0008) [2023-12-27 21:41:13,743][106225] Updated weights for policy 1, policy_version 342648 (0.0006) [2023-12-27 21:41:13,772][106226] Updated weights for policy 0, policy_version 342054 (0.0009) [2023-12-27 21:41:13,800][106225] Updated weights for policy 1, policy_version 342658 (0.0007) [2023-12-27 21:41:13,832][106226] Updated weights for policy 0, policy_version 342064 (0.0007) [2023-12-27 21:41:13,860][106225] Updated weights for policy 1, policy_version 342668 (0.0009) [2023-12-27 21:41:14,467][106226] Updated weights for policy 0, policy_version 342074 (0.0006) [2023-12-27 21:41:14,522][106226] Updated weights for policy 0, policy_version 342084 (0.0009) [2023-12-27 21:41:14,576][106226] Updated weights for policy 0, policy_version 342094 (0.0010) [2023-12-27 21:41:14,595][106225] Updated weights for policy 1, policy_version 342678 (0.0007) [2023-12-27 21:41:14,652][106225] Updated weights for policy 1, policy_version 342688 (0.0005) [2023-12-27 21:41:14,718][106225] Updated weights for policy 1, policy_version 342698 (0.0005) [2023-12-27 21:41:15,365][106226] Updated weights for policy 0, policy_version 342104 (0.0008) [2023-12-27 21:41:15,386][106225] Updated weights for policy 1, policy_version 342708 (0.0006) [2023-12-27 21:41:15,430][106226] Updated weights for policy 0, policy_version 342114 (0.0008) [2023-12-27 21:41:15,451][106225] Updated weights for policy 1, policy_version 342718 (0.0006) [2023-12-27 21:41:15,489][106226] Updated weights for policy 0, policy_version 342124 (0.0008) [2023-12-27 21:41:15,505][106225] Updated weights for policy 1, policy_version 342728 (0.0006) [2023-12-27 21:41:16,062][106225] Updated weights for policy 1, policy_version 342738 (0.0007) [2023-12-27 21:41:16,113][106225] Updated weights for policy 1, policy_version 342748 (0.0005) [2023-12-27 21:41:16,164][106225] Updated weights for policy 1, policy_version 342758 (0.0006) [2023-12-27 21:41:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 175374336. Throughput: 0: 9606.5, 1: 10030.3. Samples: 175369932. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:16,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-5.773')] [2023-12-27 21:41:16,219][106225] Updated weights for policy 1, policy_version 342768 (0.0006) [2023-12-27 21:41:16,312][106226] Updated weights for policy 0, policy_version 342134 (0.0009) [2023-12-27 21:41:16,378][106226] Updated weights for policy 0, policy_version 342144 (0.0009) [2023-12-27 21:41:16,449][106226] Updated weights for policy 0, policy_version 342154 (0.0010) [2023-12-27 21:41:16,802][106225] Updated weights for policy 1, policy_version 342778 (0.0005) [2023-12-27 21:41:16,851][106225] Updated weights for policy 1, policy_version 342788 (0.0005) [2023-12-27 21:41:16,895][106225] Updated weights for policy 1, policy_version 342798 (0.0006) [2023-12-27 21:41:17,207][106226] Updated weights for policy 0, policy_version 342164 (0.0007) [2023-12-27 21:41:17,266][106226] Updated weights for policy 0, policy_version 342174 (0.0005) [2023-12-27 21:41:17,319][106226] Updated weights for policy 0, policy_version 342184 (0.0005) [2023-12-27 21:41:17,554][106225] Updated weights for policy 1, policy_version 342808 (0.0009) [2023-12-27 21:41:17,607][106225] Updated weights for policy 1, policy_version 342818 (0.0010) [2023-12-27 21:41:17,654][106225] Updated weights for policy 1, policy_version 342828 (0.0010) [2023-12-27 21:41:17,898][106226] Updated weights for policy 0, policy_version 342194 (0.0006) [2023-12-27 21:41:17,961][106226] Updated weights for policy 0, policy_version 342204 (0.0007) [2023-12-27 21:41:18,026][106226] Updated weights for policy 0, policy_version 342214 (0.0008) [2023-12-27 21:41:18,091][106226] Updated weights for policy 0, policy_version 342224 (0.0008) [2023-12-27 21:41:18,370][106225] Updated weights for policy 1, policy_version 342838 (0.0009) [2023-12-27 21:41:18,433][106225] Updated weights for policy 1, policy_version 342848 (0.0008) [2023-12-27 21:41:18,487][106225] Updated weights for policy 1, policy_version 342858 (0.0006) [2023-12-27 21:41:18,862][106226] Updated weights for policy 0, policy_version 342234 (0.0007) [2023-12-27 21:41:18,927][106226] Updated weights for policy 0, policy_version 342244 (0.0008) [2023-12-27 21:41:18,991][106226] Updated weights for policy 0, policy_version 342254 (0.0008) [2023-12-27 21:41:19,096][106225] Updated weights for policy 1, policy_version 342868 (0.0006) [2023-12-27 21:41:19,162][106225] Updated weights for policy 1, policy_version 342878 (0.0006) [2023-12-27 21:41:19,230][106225] Updated weights for policy 1, policy_version 342888 (0.0008) [2023-12-27 21:41:19,710][106226] Updated weights for policy 0, policy_version 342264 (0.0009) [2023-12-27 21:41:19,760][106226] Updated weights for policy 0, policy_version 342274 (0.0008) [2023-12-27 21:41:19,824][106226] Updated weights for policy 0, policy_version 342284 (0.0009) [2023-12-27 21:41:19,933][106225] Updated weights for policy 1, policy_version 342898 (0.0009) [2023-12-27 21:41:19,987][106225] Updated weights for policy 1, policy_version 342908 (0.0008) [2023-12-27 21:41:20,045][106225] Updated weights for policy 1, policy_version 342918 (0.0009) [2023-12-27 21:41:20,091][106225] Updated weights for policy 1, policy_version 342928 (0.0008) [2023-12-27 21:41:20,610][106226] Updated weights for policy 0, policy_version 342294 (0.0010) [2023-12-27 21:41:20,672][106226] Updated weights for policy 0, policy_version 342304 (0.0011) [2023-12-27 21:41:20,737][106226] Updated weights for policy 0, policy_version 342314 (0.0011) [2023-12-27 21:41:20,892][106225] Updated weights for policy 1, policy_version 342938 (0.0006) [2023-12-27 21:41:20,955][106225] Updated weights for policy 1, policy_version 342948 (0.0008) [2023-12-27 21:41:21,014][106225] Updated weights for policy 1, policy_version 342958 (0.0008) [2023-12-27 21:41:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 175480832. Throughput: 0: 9444.8, 1: 10110.0. Samples: 175487624. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:21,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-5.956')] [2023-12-27 21:41:21,473][106226] Updated weights for policy 0, policy_version 342324 (0.0011) [2023-12-27 21:41:21,537][106226] Updated weights for policy 0, policy_version 342334 (0.0007) [2023-12-27 21:41:21,591][106226] Updated weights for policy 0, policy_version 342344 (0.0009) [2023-12-27 21:41:21,780][106225] Updated weights for policy 1, policy_version 342968 (0.0007) [2023-12-27 21:41:21,836][106225] Updated weights for policy 1, policy_version 342978 (0.0008) [2023-12-27 21:41:21,902][106225] Updated weights for policy 1, policy_version 342988 (0.0008) [2023-12-27 21:41:22,334][106226] Updated weights for policy 0, policy_version 342354 (0.0008) [2023-12-27 21:41:22,400][106226] Updated weights for policy 0, policy_version 342364 (0.0008) [2023-12-27 21:41:22,471][106226] Updated weights for policy 0, policy_version 342374 (0.0009) [2023-12-27 21:41:22,544][106226] Updated weights for policy 0, policy_version 342384 (0.0009) [2023-12-27 21:41:22,632][106225] Updated weights for policy 1, policy_version 342998 (0.0007) [2023-12-27 21:41:22,686][106225] Updated weights for policy 1, policy_version 343008 (0.0007) [2023-12-27 21:41:22,745][106225] Updated weights for policy 1, policy_version 343018 (0.0007) [2023-12-27 21:41:23,308][106226] Updated weights for policy 0, policy_version 342394 (0.0007) [2023-12-27 21:41:23,327][106225] Updated weights for policy 1, policy_version 343028 (0.0007) [2023-12-27 21:41:23,365][106226] Updated weights for policy 0, policy_version 342404 (0.0005) [2023-12-27 21:41:23,385][106225] Updated weights for policy 1, policy_version 343038 (0.0009) [2023-12-27 21:41:23,419][106226] Updated weights for policy 0, policy_version 342414 (0.0007) [2023-12-27 21:41:23,444][106225] Updated weights for policy 1, policy_version 343048 (0.0005) [2023-12-27 21:41:23,995][106226] Updated weights for policy 0, policy_version 342424 (0.0005) [2023-12-27 21:41:24,015][106225] Updated weights for policy 1, policy_version 343058 (0.0005) [2023-12-27 21:41:24,055][106226] Updated weights for policy 0, policy_version 342434 (0.0006) [2023-12-27 21:41:24,071][106225] Updated weights for policy 1, policy_version 343068 (0.0005) [2023-12-27 21:41:24,116][106226] Updated weights for policy 0, policy_version 342444 (0.0010) [2023-12-27 21:41:24,120][106225] Updated weights for policy 1, policy_version 343078 (0.0005) [2023-12-27 21:41:24,176][106225] Updated weights for policy 1, policy_version 343088 (0.0005) [2023-12-27 21:41:24,704][106226] Updated weights for policy 0, policy_version 342454 (0.0009) [2023-12-27 21:41:24,764][106226] Updated weights for policy 0, policy_version 342464 (0.0007) [2023-12-27 21:41:24,829][106226] Updated weights for policy 0, policy_version 342474 (0.0007) [2023-12-27 21:41:24,906][106225] Updated weights for policy 1, policy_version 343098 (0.0010) [2023-12-27 21:41:24,959][106225] Updated weights for policy 1, policy_version 343108 (0.0010) [2023-12-27 21:41:25,010][106225] Updated weights for policy 1, policy_version 343118 (0.0010) [2023-12-27 21:41:25,420][106226] Updated weights for policy 0, policy_version 342484 (0.0009) [2023-12-27 21:41:25,478][106226] Updated weights for policy 0, policy_version 342494 (0.0010) [2023-12-27 21:41:25,537][106226] Updated weights for policy 0, policy_version 342504 (0.0009) [2023-12-27 21:41:25,718][106225] Updated weights for policy 1, policy_version 343128 (0.0010) [2023-12-27 21:41:25,775][106225] Updated weights for policy 1, policy_version 343138 (0.0010) [2023-12-27 21:41:25,828][106225] Updated weights for policy 1, policy_version 343148 (0.0010) [2023-12-27 21:41:26,072][106226] Updated weights for policy 0, policy_version 342514 (0.0009) [2023-12-27 21:41:26,135][106226] Updated weights for policy 0, policy_version 342524 (0.0011) [2023-12-27 21:41:26,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 175579136. Throughput: 0: 9464.8, 1: 10098.8. Samples: 175547404. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:26,176][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.776')] [2023-12-27 21:41:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000343152_87867392.pth... [2023-12-27 21:41:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000341968_87564288.pth [2023-12-27 21:41:26,196][106226] Updated weights for policy 0, policy_version 342534 (0.0006) [2023-12-27 21:41:26,254][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000342544_87719936.pth... [2023-12-27 21:41:26,255][106226] Updated weights for policy 0, policy_version 342544 (0.0006) [2023-12-27 21:41:26,258][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000341392_87425024.pth [2023-12-27 21:41:26,552][106225] Updated weights for policy 1, policy_version 343158 (0.0010) [2023-12-27 21:41:26,609][106225] Updated weights for policy 1, policy_version 343168 (0.0010) [2023-12-27 21:41:26,665][106225] Updated weights for policy 1, policy_version 343178 (0.0010) [2023-12-27 21:41:26,842][106226] Updated weights for policy 0, policy_version 342554 (0.0008) [2023-12-27 21:41:26,892][106226] Updated weights for policy 0, policy_version 342564 (0.0007) [2023-12-27 21:41:26,934][106226] Updated weights for policy 0, policy_version 342574 (0.0007) [2023-12-27 21:41:27,363][106225] Updated weights for policy 1, policy_version 343188 (0.0010) [2023-12-27 21:41:27,413][106225] Updated weights for policy 1, policy_version 343198 (0.0010) [2023-12-27 21:41:27,469][106225] Updated weights for policy 1, policy_version 343208 (0.0010) [2023-12-27 21:41:27,569][106226] Updated weights for policy 0, policy_version 342584 (0.0006) [2023-12-27 21:41:27,626][106226] Updated weights for policy 0, policy_version 342594 (0.0005) [2023-12-27 21:41:27,693][106226] Updated weights for policy 0, policy_version 342604 (0.0005) [2023-12-27 21:41:28,185][106225] Updated weights for policy 1, policy_version 343218 (0.0010) [2023-12-27 21:41:28,231][106225] Updated weights for policy 1, policy_version 343228 (0.0010) [2023-12-27 21:41:28,283][106225] Updated weights for policy 1, policy_version 343238 (0.0010) [2023-12-27 21:41:28,347][106225] Updated weights for policy 1, policy_version 343248 (0.0009) [2023-12-27 21:41:28,351][106226] Updated weights for policy 0, policy_version 342614 (0.0008) [2023-12-27 21:41:28,414][106226] Updated weights for policy 0, policy_version 342624 (0.0008) [2023-12-27 21:41:28,475][106226] Updated weights for policy 0, policy_version 342634 (0.0007) [2023-12-27 21:41:29,057][106225] Updated weights for policy 1, policy_version 343258 (0.0010) [2023-12-27 21:41:29,103][106226] Updated weights for policy 0, policy_version 342644 (0.0009) [2023-12-27 21:41:29,104][106225] Updated weights for policy 1, policy_version 343268 (0.0010) [2023-12-27 21:41:29,159][106226] Updated weights for policy 0, policy_version 342654 (0.0010) [2023-12-27 21:41:29,161][106225] Updated weights for policy 1, policy_version 343278 (0.0010) [2023-12-27 21:41:29,220][106226] Updated weights for policy 0, policy_version 342664 (0.0009) [2023-12-27 21:41:29,895][106225] Updated weights for policy 1, policy_version 343288 (0.0011) [2023-12-27 21:41:29,907][106226] Updated weights for policy 0, policy_version 342674 (0.0008) [2023-12-27 21:41:29,963][106225] Updated weights for policy 1, policy_version 343298 (0.0008) [2023-12-27 21:41:29,965][106226] Updated weights for policy 0, policy_version 342684 (0.0007) [2023-12-27 21:41:30,013][106226] Updated weights for policy 0, policy_version 342694 (0.0005) [2023-12-27 21:41:30,015][106225] Updated weights for policy 1, policy_version 343308 (0.0007) [2023-12-27 21:41:30,061][106226] Updated weights for policy 0, policy_version 342704 (0.0005) [2023-12-27 21:41:30,678][106226] Updated weights for policy 0, policy_version 342714 (0.0005) [2023-12-27 21:41:30,686][106225] Updated weights for policy 1, policy_version 343318 (0.0007) [2023-12-27 21:41:30,735][106226] Updated weights for policy 0, policy_version 342724 (0.0005) [2023-12-27 21:41:30,741][106225] Updated weights for policy 1, policy_version 343328 (0.0006) [2023-12-27 21:41:30,798][106226] Updated weights for policy 0, policy_version 342734 (0.0005) [2023-12-27 21:41:30,808][106225] Updated weights for policy 1, policy_version 343338 (0.0006) [2023-12-27 21:41:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 175685632. Throughput: 0: 9645.1, 1: 10122.2. Samples: 175672976. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:31,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-5.687')] [2023-12-27 21:41:31,437][106226] Updated weights for policy 0, policy_version 342744 (0.0008) [2023-12-27 21:41:31,489][106225] Updated weights for policy 1, policy_version 343348 (0.0006) [2023-12-27 21:41:31,499][106226] Updated weights for policy 0, policy_version 342754 (0.0006) [2023-12-27 21:41:31,559][106225] Updated weights for policy 1, policy_version 343358 (0.0006) [2023-12-27 21:41:31,561][106226] Updated weights for policy 0, policy_version 342764 (0.0005) [2023-12-27 21:41:31,623][106225] Updated weights for policy 1, policy_version 343368 (0.0006) [2023-12-27 21:41:32,167][106225] Updated weights for policy 1, policy_version 343378 (0.0007) [2023-12-27 21:41:32,226][106225] Updated weights for policy 1, policy_version 343388 (0.0008) [2023-12-27 21:41:32,261][106226] Updated weights for policy 0, policy_version 342774 (0.0007) [2023-12-27 21:41:32,279][106225] Updated weights for policy 1, policy_version 343398 (0.0006) [2023-12-27 21:41:32,313][106226] Updated weights for policy 0, policy_version 342784 (0.0006) [2023-12-27 21:41:32,332][106225] Updated weights for policy 1, policy_version 343408 (0.0006) [2023-12-27 21:41:32,382][106226] Updated weights for policy 0, policy_version 342794 (0.0009) [2023-12-27 21:41:33,010][106225] Updated weights for policy 1, policy_version 343418 (0.0007) [2023-12-27 21:41:33,038][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000001 [2023-12-27 21:41:33,113][106226] Updated weights for policy 0, policy_version 342804 (0.0009) [2023-12-27 21:41:33,164][106226] Updated weights for policy 0, policy_version 342814 (0.0008) [2023-12-27 21:41:33,209][106226] Updated weights for policy 0, policy_version 342824 (0.0008) [2023-12-27 21:41:33,790][106225] Updated weights for policy 1, policy_version 343428 (0.0009) [2023-12-27 21:41:33,834][106225] Updated weights for policy 1, policy_version 343438 (0.0008) [2023-12-27 21:41:33,885][106225] Updated weights for policy 1, policy_version 343448 (0.0008) [2023-12-27 21:41:33,938][106226] Updated weights for policy 0, policy_version 342834 (0.0008) [2023-12-27 21:41:33,988][106226] Updated weights for policy 0, policy_version 342844 (0.0008) [2023-12-27 21:41:34,033][106226] Updated weights for policy 0, policy_version 342854 (0.0008) [2023-12-27 21:41:34,077][106226] Updated weights for policy 0, policy_version 342864 (0.0008) [2023-12-27 21:41:34,619][106225] Updated weights for policy 1, policy_version 343458 (0.0007) [2023-12-27 21:41:34,675][106225] Updated weights for policy 1, policy_version 343468 (0.0008) [2023-12-27 21:41:34,739][106225] Updated weights for policy 1, policy_version 343478 (0.0009) [2023-12-27 21:41:34,800][106225] Updated weights for policy 1, policy_version 343488 (0.0006) [2023-12-27 21:41:34,832][106226] Updated weights for policy 0, policy_version 342874 (0.0009) [2023-12-27 21:41:34,886][106226] Updated weights for policy 0, policy_version 342884 (0.0008) [2023-12-27 21:41:34,938][106226] Updated weights for policy 0, policy_version 342894 (0.0009) [2023-12-27 21:41:35,525][106225] Updated weights for policy 1, policy_version 343498 (0.0006) [2023-12-27 21:41:35,577][106225] Updated weights for policy 1, policy_version 343508 (0.0009) [2023-12-27 21:41:35,633][106225] Updated weights for policy 1, policy_version 343518 (0.0008) [2023-12-27 21:41:35,695][106226] Updated weights for policy 0, policy_version 342904 (0.0010) [2023-12-27 21:41:35,742][106226] Updated weights for policy 0, policy_version 342914 (0.0010) [2023-12-27 21:41:35,792][106226] Updated weights for policy 0, policy_version 342924 (0.0010) [2023-12-27 21:41:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 175783936. Throughput: 0: 9755.1, 1: 10071.6. Samples: 175793792. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:36,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-5.918')] [2023-12-27 21:41:36,366][106225] Updated weights for policy 1, policy_version 343528 (0.0009) [2023-12-27 21:41:36,419][106225] Updated weights for policy 1, policy_version 343538 (0.0009) [2023-12-27 21:41:36,481][106225] Updated weights for policy 1, policy_version 343548 (0.0008) [2023-12-27 21:41:36,516][106226] Updated weights for policy 0, policy_version 342934 (0.0008) [2023-12-27 21:41:36,580][106226] Updated weights for policy 0, policy_version 342944 (0.0009) [2023-12-27 21:41:36,644][106226] Updated weights for policy 0, policy_version 342954 (0.0009) [2023-12-27 21:41:37,207][106225] Updated weights for policy 1, policy_version 343558 (0.0009) [2023-12-27 21:41:37,252][106225] Updated weights for policy 1, policy_version 343568 (0.0008) [2023-12-27 21:41:37,312][106225] Updated weights for policy 1, policy_version 343578 (0.0008) [2023-12-27 21:41:37,363][106226] Updated weights for policy 0, policy_version 342964 (0.0009) [2023-12-27 21:41:37,430][106226] Updated weights for policy 0, policy_version 342974 (0.0009) [2023-12-27 21:41:37,482][106226] Updated weights for policy 0, policy_version 342984 (0.0009) [2023-12-27 21:41:38,042][106225] Updated weights for policy 1, policy_version 343588 (0.0008) [2023-12-27 21:41:38,091][106225] Updated weights for policy 1, policy_version 343598 (0.0005) [2023-12-27 21:41:38,146][106225] Updated weights for policy 1, policy_version 343608 (0.0008) [2023-12-27 21:41:38,207][106226] Updated weights for policy 0, policy_version 342994 (0.0008) [2023-12-27 21:41:38,256][106226] Updated weights for policy 0, policy_version 343004 (0.0009) [2023-12-27 21:41:38,320][106226] Updated weights for policy 0, policy_version 343014 (0.0009) [2023-12-27 21:41:38,382][106226] Updated weights for policy 0, policy_version 343024 (0.0008) [2023-12-27 21:41:38,889][106225] Updated weights for policy 1, policy_version 343618 (0.0008) [2023-12-27 21:41:38,947][106225] Updated weights for policy 1, policy_version 343628 (0.0008) [2023-12-27 21:41:39,011][106225] Updated weights for policy 1, policy_version 343638 (0.0008) [2023-12-27 21:41:39,069][106225] Updated weights for policy 1, policy_version 343648 (0.0008) [2023-12-27 21:41:39,146][106226] Updated weights for policy 0, policy_version 343034 (0.0009) [2023-12-27 21:41:39,206][106226] Updated weights for policy 0, policy_version 343044 (0.0009) [2023-12-27 21:41:39,277][106226] Updated weights for policy 0, policy_version 343054 (0.0009) [2023-12-27 21:41:39,849][106225] Updated weights for policy 1, policy_version 343658 (0.0008) [2023-12-27 21:41:39,904][106225] Updated weights for policy 1, policy_version 343668 (0.0008) [2023-12-27 21:41:39,968][106225] Updated weights for policy 1, policy_version 343678 (0.0008) [2023-12-27 21:41:40,067][106226] Updated weights for policy 0, policy_version 343064 (0.0010) [2023-12-27 21:41:40,115][106226] Updated weights for policy 0, policy_version 343074 (0.0010) [2023-12-27 21:41:40,166][106226] Updated weights for policy 0, policy_version 343084 (0.0011) [2023-12-27 21:41:40,598][106225] Updated weights for policy 1, policy_version 343688 (0.0008) [2023-12-27 21:41:40,654][106225] Updated weights for policy 1, policy_version 343698 (0.0008) [2023-12-27 21:41:40,701][106225] Updated weights for policy 1, policy_version 343708 (0.0008) [2023-12-27 21:41:40,886][106226] Updated weights for policy 0, policy_version 343094 (0.0009) [2023-12-27 21:41:40,943][106226] Updated weights for policy 0, policy_version 343104 (0.0005) [2023-12-27 21:41:41,004][106226] Updated weights for policy 0, policy_version 343114 (0.0006) [2023-12-27 21:41:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 175882240. Throughput: 0: 9775.0, 1: 10077.4. Samples: 175851220. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:41,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.660')] [2023-12-27 21:41:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000343120_87867392.pth... [2023-12-27 21:41:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000343712_88014848.pth... [2023-12-27 21:41:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000341968_87572480.pth [2023-12-27 21:41:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000342576_87719936.pth [2023-12-27 21:41:41,436][106225] Updated weights for policy 1, policy_version 343718 (0.0009) [2023-12-27 21:41:41,498][106225] Updated weights for policy 1, policy_version 343728 (0.0008) [2023-12-27 21:41:41,562][106225] Updated weights for policy 1, policy_version 343738 (0.0008) [2023-12-27 21:41:41,733][106226] Updated weights for policy 0, policy_version 343124 (0.0009) [2023-12-27 21:41:41,804][106226] Updated weights for policy 0, policy_version 343134 (0.0008) [2023-12-27 21:41:41,861][106226] Updated weights for policy 0, policy_version 343144 (0.0008) [2023-12-27 21:41:42,323][106225] Updated weights for policy 1, policy_version 343748 (0.0009) [2023-12-27 21:41:42,389][106225] Updated weights for policy 1, policy_version 343758 (0.0008) [2023-12-27 21:41:42,449][106225] Updated weights for policy 1, policy_version 343768 (0.0008) [2023-12-27 21:41:42,637][106226] Updated weights for policy 0, policy_version 343154 (0.0008) [2023-12-27 21:41:42,702][106226] Updated weights for policy 0, policy_version 343164 (0.0006) [2023-12-27 21:41:42,768][106226] Updated weights for policy 0, policy_version 343174 (0.0008) [2023-12-27 21:41:42,823][106226] Updated weights for policy 0, policy_version 343184 (0.0008) [2023-12-27 21:41:43,135][106225] Updated weights for policy 1, policy_version 343778 (0.0008) [2023-12-27 21:41:43,195][106225] Updated weights for policy 1, policy_version 343788 (0.0007) [2023-12-27 21:41:43,246][106225] Updated weights for policy 1, policy_version 343798 (0.0005) [2023-12-27 21:41:43,302][106225] Updated weights for policy 1, policy_version 343808 (0.0006) [2023-12-27 21:41:43,448][106226] Updated weights for policy 0, policy_version 343194 (0.0009) [2023-12-27 21:41:43,507][106226] Updated weights for policy 0, policy_version 343204 (0.0010) [2023-12-27 21:41:43,568][106226] Updated weights for policy 0, policy_version 343214 (0.0010) [2023-12-27 21:41:43,883][106225] Updated weights for policy 1, policy_version 343818 (0.0008) [2023-12-27 21:41:43,946][106225] Updated weights for policy 1, policy_version 343828 (0.0008) [2023-12-27 21:41:44,015][106225] Updated weights for policy 1, policy_version 343838 (0.0008) [2023-12-27 21:41:44,354][106226] Updated weights for policy 0, policy_version 343224 (0.0008) [2023-12-27 21:41:44,413][106226] Updated weights for policy 0, policy_version 343234 (0.0008) [2023-12-27 21:41:44,468][106226] Updated weights for policy 0, policy_version 343244 (0.0009) [2023-12-27 21:41:44,688][106225] Updated weights for policy 1, policy_version 343848 (0.0010) [2023-12-27 21:41:44,734][106225] Updated weights for policy 1, policy_version 343858 (0.0010) [2023-12-27 21:41:44,801][106225] Updated weights for policy 1, policy_version 343868 (0.0009) [2023-12-27 21:41:45,180][106226] Updated weights for policy 0, policy_version 343254 (0.0008) [2023-12-27 21:41:45,232][106226] Updated weights for policy 0, policy_version 343264 (0.0008) [2023-12-27 21:41:45,291][106226] Updated weights for policy 0, policy_version 343274 (0.0008) [2023-12-27 21:41:45,548][106225] Updated weights for policy 1, policy_version 343878 (0.0010) [2023-12-27 21:41:45,599][106225] Updated weights for policy 1, policy_version 343888 (0.0010) [2023-12-27 21:41:45,653][106225] Updated weights for policy 1, policy_version 343898 (0.0010) [2023-12-27 21:41:46,054][106226] Updated weights for policy 0, policy_version 343284 (0.0008) [2023-12-27 21:41:46,107][106226] Updated weights for policy 0, policy_version 343294 (0.0009) [2023-12-27 21:41:46,161][106226] Updated weights for policy 0, policy_version 343304 (0.0009) [2023-12-27 21:41:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 175972352. Throughput: 0: 9770.0, 1: 9983.3. Samples: 175967420. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:46,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-5.498')] [2023-12-27 21:41:46,330][106225] Updated weights for policy 1, policy_version 343908 (0.0010) [2023-12-27 21:41:46,391][106225] Updated weights for policy 1, policy_version 343918 (0.0007) [2023-12-27 21:41:46,451][106225] Updated weights for policy 1, policy_version 343928 (0.0005) [2023-12-27 21:41:46,914][106226] Updated weights for policy 0, policy_version 343314 (0.0008) [2023-12-27 21:41:46,973][106226] Updated weights for policy 0, policy_version 343324 (0.0007) [2023-12-27 21:41:47,021][106226] Updated weights for policy 0, policy_version 343334 (0.0009) [2023-12-27 21:41:47,079][106225] Updated weights for policy 1, policy_version 343938 (0.0005) [2023-12-27 21:41:47,092][106226] Updated weights for policy 0, policy_version 343344 (0.0008) [2023-12-27 21:41:47,142][106225] Updated weights for policy 1, policy_version 343948 (0.0006) [2023-12-27 21:41:47,195][106225] Updated weights for policy 1, policy_version 343958 (0.0009) [2023-12-27 21:41:47,256][106225] Updated weights for policy 1, policy_version 343968 (0.0008) [2023-12-27 21:41:47,817][106226] Updated weights for policy 0, policy_version 343354 (0.0009) [2023-12-27 21:41:47,877][106226] Updated weights for policy 0, policy_version 343364 (0.0007) [2023-12-27 21:41:47,882][106225] Updated weights for policy 1, policy_version 343978 (0.0008) [2023-12-27 21:41:47,934][106226] Updated weights for policy 0, policy_version 343374 (0.0006) [2023-12-27 21:41:47,944][106225] Updated weights for policy 1, policy_version 343988 (0.0008) [2023-12-27 21:41:48,011][106225] Updated weights for policy 1, policy_version 343998 (0.0006) [2023-12-27 21:41:48,575][106225] Updated weights for policy 1, policy_version 344008 (0.0005) [2023-12-27 21:41:48,640][106225] Updated weights for policy 1, policy_version 344018 (0.0007) [2023-12-27 21:41:48,699][106225] Updated weights for policy 1, policy_version 344028 (0.0008) [2023-12-27 21:41:48,751][106226] Updated weights for policy 0, policy_version 343384 (0.0009) [2023-12-27 21:41:48,815][106226] Updated weights for policy 0, policy_version 343394 (0.0008) [2023-12-27 21:41:48,875][106226] Updated weights for policy 0, policy_version 343404 (0.0008) [2023-12-27 21:41:49,329][106225] Updated weights for policy 1, policy_version 344038 (0.0009) [2023-12-27 21:41:49,399][106225] Updated weights for policy 1, policy_version 344048 (0.0009) [2023-12-27 21:41:49,457][106225] Updated weights for policy 1, policy_version 344058 (0.0010) [2023-12-27 21:41:49,658][106226] Updated weights for policy 0, policy_version 343414 (0.0009) [2023-12-27 21:41:49,718][106226] Updated weights for policy 0, policy_version 343424 (0.0008) [2023-12-27 21:41:49,776][106226] Updated weights for policy 0, policy_version 343434 (0.0009) [2023-12-27 21:41:50,229][106225] Updated weights for policy 1, policy_version 344068 (0.0010) [2023-12-27 21:41:50,291][106225] Updated weights for policy 1, policy_version 344078 (0.0008) [2023-12-27 21:41:50,354][106225] Updated weights for policy 1, policy_version 344088 (0.0010) [2023-12-27 21:41:50,502][106226] Updated weights for policy 0, policy_version 343444 (0.0008) [2023-12-27 21:41:50,562][106226] Updated weights for policy 0, policy_version 343454 (0.0009) [2023-12-27 21:41:50,631][106226] Updated weights for policy 0, policy_version 343464 (0.0008) [2023-12-27 21:41:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 176070656. Throughput: 0: 9702.5, 1: 9984.0. Samples: 176084844. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:51,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-5.612')] [2023-12-27 21:41:51,185][106225] Updated weights for policy 1, policy_version 344098 (0.0007) [2023-12-27 21:41:51,245][106225] Updated weights for policy 1, policy_version 344108 (0.0006) [2023-12-27 21:41:51,258][106226] Updated weights for policy 0, policy_version 343474 (0.0006) [2023-12-27 21:41:51,305][106225] Updated weights for policy 1, policy_version 344118 (0.0009) [2023-12-27 21:41:51,315][106226] Updated weights for policy 0, policy_version 343484 (0.0008) [2023-12-27 21:41:51,364][106225] Updated weights for policy 1, policy_version 344128 (0.0010) [2023-12-27 21:41:51,388][106226] Updated weights for policy 0, policy_version 343494 (0.0007) [2023-12-27 21:41:51,451][106226] Updated weights for policy 0, policy_version 343504 (0.0008) [2023-12-27 21:41:52,111][106226] Updated weights for policy 0, policy_version 343514 (0.0009) [2023-12-27 21:41:52,165][106225] Updated weights for policy 1, policy_version 344138 (0.0009) [2023-12-27 21:41:52,173][106226] Updated weights for policy 0, policy_version 343524 (0.0008) [2023-12-27 21:41:52,224][106225] Updated weights for policy 1, policy_version 344148 (0.0008) [2023-12-27 21:41:52,241][106226] Updated weights for policy 0, policy_version 343534 (0.0006) [2023-12-27 21:41:52,285][106225] Updated weights for policy 1, policy_version 344158 (0.0008) [2023-12-27 21:41:52,916][106226] Updated weights for policy 0, policy_version 343544 (0.0008) [2023-12-27 21:41:52,931][106225] Updated weights for policy 1, policy_version 344168 (0.0006) [2023-12-27 21:41:52,983][106226] Updated weights for policy 0, policy_version 343554 (0.0008) [2023-12-27 21:41:52,994][106225] Updated weights for policy 1, policy_version 344178 (0.0005) [2023-12-27 21:41:53,035][106226] Updated weights for policy 0, policy_version 343564 (0.0008) [2023-12-27 21:41:53,059][106225] Updated weights for policy 1, policy_version 344188 (0.0009) [2023-12-27 21:41:53,585][106225] Updated weights for policy 1, policy_version 344198 (0.0008) [2023-12-27 21:41:53,620][106226] Updated weights for policy 0, policy_version 343574 (0.0005) [2023-12-27 21:41:53,639][106225] Updated weights for policy 1, policy_version 344208 (0.0008) [2023-12-27 21:41:53,671][106226] Updated weights for policy 0, policy_version 343584 (0.0007) [2023-12-27 21:41:53,691][106225] Updated weights for policy 1, policy_version 344218 (0.0007) [2023-12-27 21:41:53,735][106226] Updated weights for policy 0, policy_version 343594 (0.0009) [2023-12-27 21:41:54,366][106226] Updated weights for policy 0, policy_version 343604 (0.0010) [2023-12-27 21:41:54,380][106225] Updated weights for policy 1, policy_version 344228 (0.0006) [2023-12-27 21:41:54,428][106226] Updated weights for policy 0, policy_version 343614 (0.0006) [2023-12-27 21:41:54,445][106225] Updated weights for policy 1, policy_version 344238 (0.0007) [2023-12-27 21:41:54,486][106226] Updated weights for policy 0, policy_version 343624 (0.0008) [2023-12-27 21:41:54,508][106225] Updated weights for policy 1, policy_version 344248 (0.0008) [2023-12-27 21:41:55,180][106226] Updated weights for policy 0, policy_version 343634 (0.0010) [2023-12-27 21:41:55,247][106226] Updated weights for policy 0, policy_version 343644 (0.0008) [2023-12-27 21:41:55,288][106225] Updated weights for policy 1, policy_version 344258 (0.0007) [2023-12-27 21:41:55,310][106226] Updated weights for policy 0, policy_version 343654 (0.0005) [2023-12-27 21:41:55,341][106225] Updated weights for policy 1, policy_version 344268 (0.0006) [2023-12-27 21:41:55,379][106226] Updated weights for policy 0, policy_version 343664 (0.0005) [2023-12-27 21:41:55,392][106225] Updated weights for policy 1, policy_version 344278 (0.0008) [2023-12-27 21:41:55,442][106225] Updated weights for policy 1, policy_version 344288 (0.0008) [2023-12-27 21:41:55,902][106226] Updated weights for policy 0, policy_version 343674 (0.0010) [2023-12-27 21:41:55,955][106226] Updated weights for policy 0, policy_version 343684 (0.0010) [2023-12-27 21:41:56,005][106226] Updated weights for policy 0, policy_version 343694 (0.0010) [2023-12-27 21:41:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 176177152. Throughput: 0: 9799.0, 1: 9994.7. Samples: 176147404. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 21:41:56,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.558')] [2023-12-27 21:41:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000343696_88014848.pth... [2023-12-27 21:41:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000342544_87719936.pth [2023-12-27 21:41:56,243][106225] Updated weights for policy 1, policy_version 344298 (0.0008) [2023-12-27 21:41:56,297][106225] Updated weights for policy 1, policy_version 344308 (0.0008) [2023-12-27 21:41:56,346][106225] Updated weights for policy 1, policy_version 344318 (0.0009) [2023-12-27 21:41:56,352][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000344320_88170496.pth... [2023-12-27 21:41:56,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000343152_87867392.pth [2023-12-27 21:41:56,628][106226] Updated weights for policy 0, policy_version 343704 (0.0010) [2023-12-27 21:41:56,686][106226] Updated weights for policy 0, policy_version 343714 (0.0008) [2023-12-27 21:41:56,754][106226] Updated weights for policy 0, policy_version 343724 (0.0006) [2023-12-27 21:41:57,134][106225] Updated weights for policy 1, policy_version 344328 (0.0009) [2023-12-27 21:41:57,181][106225] Updated weights for policy 1, policy_version 344338 (0.0008) [2023-12-27 21:41:57,238][106225] Updated weights for policy 1, policy_version 344348 (0.0008) [2023-12-27 21:41:57,415][106226] Updated weights for policy 0, policy_version 343734 (0.0009) [2023-12-27 21:41:57,477][106226] Updated weights for policy 0, policy_version 343744 (0.0010) [2023-12-27 21:41:57,536][106226] Updated weights for policy 0, policy_version 343754 (0.0007) [2023-12-27 21:41:57,941][106225] Updated weights for policy 1, policy_version 344358 (0.0006) [2023-12-27 21:41:57,996][106225] Updated weights for policy 1, policy_version 344368 (0.0009) [2023-12-27 21:41:58,053][106225] Updated weights for policy 1, policy_version 344378 (0.0010) [2023-12-27 21:41:58,109][106226] Updated weights for policy 0, policy_version 343764 (0.0005) [2023-12-27 21:41:58,162][106226] Updated weights for policy 0, policy_version 343774 (0.0005) [2023-12-27 21:41:58,226][106226] Updated weights for policy 0, policy_version 343784 (0.0007) [2023-12-27 21:41:58,821][106225] Updated weights for policy 1, policy_version 344388 (0.0010) [2023-12-27 21:41:58,892][106225] Updated weights for policy 1, policy_version 344398 (0.0010) [2023-12-27 21:41:58,963][106225] Updated weights for policy 1, policy_version 344408 (0.0007) [2023-12-27 21:41:58,977][106226] Updated weights for policy 0, policy_version 343794 (0.0008) [2023-12-27 21:41:59,041][106226] Updated weights for policy 0, policy_version 343804 (0.0008) [2023-12-27 21:41:59,100][106226] Updated weights for policy 0, policy_version 343814 (0.0008) [2023-12-27 21:41:59,156][106226] Updated weights for policy 0, policy_version 343824 (0.0008) [2023-12-27 21:41:59,651][106225] Updated weights for policy 1, policy_version 344418 (0.0008) [2023-12-27 21:41:59,718][106225] Updated weights for policy 1, policy_version 344428 (0.0008) [2023-12-27 21:41:59,778][106225] Updated weights for policy 1, policy_version 344438 (0.0009) [2023-12-27 21:41:59,839][106225] Updated weights for policy 1, policy_version 344448 (0.0009) [2023-12-27 21:41:59,992][106226] Updated weights for policy 0, policy_version 343834 (0.0008) [2023-12-27 21:42:00,041][106226] Updated weights for policy 0, policy_version 343844 (0.0006) [2023-12-27 21:42:00,095][106226] Updated weights for policy 0, policy_version 343854 (0.0006) [2023-12-27 21:42:00,587][106225] Updated weights for policy 1, policy_version 344458 (0.0009) [2023-12-27 21:42:00,635][106225] Updated weights for policy 1, policy_version 344468 (0.0008) [2023-12-27 21:42:00,687][106225] Updated weights for policy 1, policy_version 344478 (0.0008) [2023-12-27 21:42:00,788][106226] Updated weights for policy 0, policy_version 343864 (0.0009) [2023-12-27 21:42:00,849][106226] Updated weights for policy 0, policy_version 343874 (0.0010) [2023-12-27 21:42:00,909][106226] Updated weights for policy 0, policy_version 343884 (0.0008) [2023-12-27 21:42:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 176275456. Throughput: 0: 9905.6, 1: 9990.8. Samples: 176265272. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:01,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.631')] [2023-12-27 21:42:01,303][106225] Updated weights for policy 1, policy_version 344488 (0.0006) [2023-12-27 21:42:01,368][106225] Updated weights for policy 1, policy_version 344498 (0.0006) [2023-12-27 21:42:01,435][106225] Updated weights for policy 1, policy_version 344508 (0.0007) [2023-12-27 21:42:01,647][106226] Updated weights for policy 0, policy_version 343894 (0.0008) [2023-12-27 21:42:01,712][106226] Updated weights for policy 0, policy_version 343904 (0.0007) [2023-12-27 21:42:01,780][106226] Updated weights for policy 0, policy_version 343914 (0.0009) [2023-12-27 21:42:02,220][106225] Updated weights for policy 1, policy_version 344518 (0.0008) [2023-12-27 21:42:02,285][106225] Updated weights for policy 1, policy_version 344528 (0.0008) [2023-12-27 21:42:02,343][106225] Updated weights for policy 1, policy_version 344538 (0.0008) [2023-12-27 21:42:02,387][106226] Updated weights for policy 0, policy_version 343924 (0.0008) [2023-12-27 21:42:02,448][106226] Updated weights for policy 0, policy_version 343934 (0.0005) [2023-12-27 21:42:02,513][106226] Updated weights for policy 0, policy_version 343944 (0.0005) [2023-12-27 21:42:03,080][106225] Updated weights for policy 1, policy_version 344548 (0.0008) [2023-12-27 21:42:03,138][106225] Updated weights for policy 1, policy_version 344558 (0.0008) [2023-12-27 21:42:03,190][106226] Updated weights for policy 0, policy_version 343954 (0.0007) [2023-12-27 21:42:03,196][106225] Updated weights for policy 1, policy_version 344568 (0.0008) [2023-12-27 21:42:03,243][106226] Updated weights for policy 0, policy_version 343964 (0.0005) [2023-12-27 21:42:03,304][106226] Updated weights for policy 0, policy_version 343974 (0.0007) [2023-12-27 21:42:03,359][106226] Updated weights for policy 0, policy_version 343984 (0.0005) [2023-12-27 21:42:03,958][106225] Updated weights for policy 1, policy_version 344578 (0.0008) [2023-12-27 21:42:03,968][106226] Updated weights for policy 0, policy_version 343994 (0.0008) [2023-12-27 21:42:04,018][106225] Updated weights for policy 1, policy_version 344588 (0.0008) [2023-12-27 21:42:04,030][106226] Updated weights for policy 0, policy_version 344004 (0.0008) [2023-12-27 21:42:04,078][106225] Updated weights for policy 1, policy_version 344598 (0.0008) [2023-12-27 21:42:04,092][106226] Updated weights for policy 0, policy_version 344014 (0.0008) [2023-12-27 21:42:04,145][106225] Updated weights for policy 1, policy_version 344608 (0.0009) [2023-12-27 21:42:04,815][106226] Updated weights for policy 0, policy_version 344024 (0.0008) [2023-12-27 21:42:04,860][106225] Updated weights for policy 1, policy_version 344618 (0.0007) [2023-12-27 21:42:04,873][106226] Updated weights for policy 0, policy_version 344034 (0.0006) [2023-12-27 21:42:04,915][106225] Updated weights for policy 1, policy_version 344628 (0.0007) [2023-12-27 21:42:04,925][106226] Updated weights for policy 0, policy_version 344044 (0.0007) [2023-12-27 21:42:04,966][106225] Updated weights for policy 1, policy_version 344638 (0.0007) [2023-12-27 21:42:05,605][106225] Updated weights for policy 1, policy_version 344648 (0.0008) [2023-12-27 21:42:05,652][106225] Updated weights for policy 1, policy_version 344658 (0.0008) [2023-12-27 21:42:05,692][106226] Updated weights for policy 0, policy_version 344054 (0.0006) [2023-12-27 21:42:05,704][106225] Updated weights for policy 1, policy_version 344668 (0.0008) [2023-12-27 21:42:05,747][106226] Updated weights for policy 0, policy_version 344064 (0.0008) [2023-12-27 21:42:05,811][106226] Updated weights for policy 0, policy_version 344074 (0.0008) [2023-12-27 21:42:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 176373760. Throughput: 0: 10018.7, 1: 9901.2. Samples: 176384020. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:06,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-5.272')] [2023-12-27 21:42:06,442][106226] Updated weights for policy 0, policy_version 344084 (0.0008) [2023-12-27 21:42:06,505][106226] Updated weights for policy 0, policy_version 344094 (0.0008) [2023-12-27 21:42:06,535][106225] Updated weights for policy 1, policy_version 344678 (0.0008) [2023-12-27 21:42:06,563][106226] Updated weights for policy 0, policy_version 344104 (0.0005) [2023-12-27 21:42:06,594][106225] Updated weights for policy 1, policy_version 344688 (0.0007) [2023-12-27 21:42:06,650][106225] Updated weights for policy 1, policy_version 344698 (0.0007) [2023-12-27 21:42:07,193][106226] Updated weights for policy 0, policy_version 344114 (0.0009) [2023-12-27 21:42:07,259][106226] Updated weights for policy 0, policy_version 344124 (0.0010) [2023-12-27 21:42:07,316][106226] Updated weights for policy 0, policy_version 344134 (0.0010) [2023-12-27 21:42:07,370][106226] Updated weights for policy 0, policy_version 344144 (0.0010) [2023-12-27 21:42:07,422][106225] Updated weights for policy 1, policy_version 344708 (0.0007) [2023-12-27 21:42:07,474][106225] Updated weights for policy 1, policy_version 344718 (0.0007) [2023-12-27 21:42:07,531][106225] Updated weights for policy 1, policy_version 344728 (0.0010) [2023-12-27 21:42:07,963][106226] Updated weights for policy 0, policy_version 344154 (0.0011) [2023-12-27 21:42:08,024][106226] Updated weights for policy 0, policy_version 344164 (0.0010) [2023-12-27 21:42:08,080][106226] Updated weights for policy 0, policy_version 344174 (0.0010) [2023-12-27 21:42:08,313][106225] Updated weights for policy 1, policy_version 344738 (0.0009) [2023-12-27 21:42:08,381][106225] Updated weights for policy 1, policy_version 344748 (0.0008) [2023-12-27 21:42:08,447][106225] Updated weights for policy 1, policy_version 344758 (0.0007) [2023-12-27 21:42:08,508][106225] Updated weights for policy 1, policy_version 344768 (0.0007) [2023-12-27 21:42:08,756][106226] Updated weights for policy 0, policy_version 344184 (0.0006) [2023-12-27 21:42:08,810][106226] Updated weights for policy 0, policy_version 344194 (0.0010) [2023-12-27 21:42:08,864][106226] Updated weights for policy 0, policy_version 344204 (0.0011) [2023-12-27 21:42:09,219][106225] Updated weights for policy 1, policy_version 344778 (0.0008) [2023-12-27 21:42:09,281][106225] Updated weights for policy 1, policy_version 344788 (0.0008) [2023-12-27 21:42:09,345][106225] Updated weights for policy 1, policy_version 344798 (0.0007) [2023-12-27 21:42:09,533][106226] Updated weights for policy 0, policy_version 344214 (0.0007) [2023-12-27 21:42:09,594][106226] Updated weights for policy 0, policy_version 344224 (0.0006) [2023-12-27 21:42:09,655][106226] Updated weights for policy 0, policy_version 344234 (0.0008) [2023-12-27 21:42:10,115][106225] Updated weights for policy 1, policy_version 344808 (0.0008) [2023-12-27 21:42:10,178][106225] Updated weights for policy 1, policy_version 344818 (0.0009) [2023-12-27 21:42:10,233][106225] Updated weights for policy 1, policy_version 344828 (0.0008) [2023-12-27 21:42:10,332][106226] Updated weights for policy 0, policy_version 344244 (0.0008) [2023-12-27 21:42:10,397][106226] Updated weights for policy 0, policy_version 344254 (0.0009) [2023-12-27 21:42:10,459][106226] Updated weights for policy 0, policy_version 344264 (0.0009) [2023-12-27 21:42:10,990][106225] Updated weights for policy 1, policy_version 344838 (0.0008) [2023-12-27 21:42:11,059][106225] Updated weights for policy 1, policy_version 344849 (0.0009) [2023-12-27 21:42:11,122][106226] Updated weights for policy 0, policy_version 344274 (0.0009) [2023-12-27 21:42:11,132][106225] Updated weights for policy 1, policy_version 344859 (0.0009) [2023-12-27 21:42:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 176472064. Throughput: 0: 10079.9, 1: 9822.3. Samples: 176442996. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:11,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-5.577')] [2023-12-27 21:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000344864_88309760.pth... [2023-12-27 21:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000343712_88014848.pth [2023-12-27 21:42:11,193][106226] Updated weights for policy 0, policy_version 344284 (0.0007) [2023-12-27 21:42:11,261][106226] Updated weights for policy 0, policy_version 344294 (0.0008) [2023-12-27 21:42:11,317][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000344304_88170496.pth... [2023-12-27 21:42:11,319][106226] Updated weights for policy 0, policy_version 344304 (0.0009) [2023-12-27 21:42:11,320][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000343120_87867392.pth [2023-12-27 21:42:11,956][106225] Updated weights for policy 1, policy_version 344869 (0.0009) [2023-12-27 21:42:12,018][106225] Updated weights for policy 1, policy_version 344879 (0.0009) [2023-12-27 21:42:12,072][106226] Updated weights for policy 0, policy_version 344314 (0.0006) [2023-12-27 21:42:12,080][106225] Updated weights for policy 1, policy_version 344889 (0.0006) [2023-12-27 21:42:12,129][106226] Updated weights for policy 0, policy_version 344324 (0.0007) [2023-12-27 21:42:12,189][106226] Updated weights for policy 0, policy_version 344334 (0.0008) [2023-12-27 21:42:12,816][106225] Updated weights for policy 1, policy_version 344899 (0.0008) [2023-12-27 21:42:12,878][106225] Updated weights for policy 1, policy_version 344909 (0.0011) [2023-12-27 21:42:12,882][106226] Updated weights for policy 0, policy_version 344344 (0.0006) [2023-12-27 21:42:12,938][106226] Updated weights for policy 0, policy_version 344354 (0.0007) [2023-12-27 21:42:12,939][106225] Updated weights for policy 1, policy_version 344919 (0.0010) [2023-12-27 21:42:12,995][106226] Updated weights for policy 0, policy_version 344364 (0.0007) [2023-12-27 21:42:13,651][106225] Updated weights for policy 1, policy_version 344929 (0.0010) [2023-12-27 21:42:13,714][106225] Updated weights for policy 1, policy_version 344939 (0.0005) [2023-12-27 21:42:13,718][106226] Updated weights for policy 0, policy_version 344374 (0.0008) [2023-12-27 21:42:13,776][106225] Updated weights for policy 1, policy_version 344949 (0.0005) [2023-12-27 21:42:13,781][106226] Updated weights for policy 0, policy_version 344384 (0.0009) [2023-12-27 21:42:13,830][106225] Updated weights for policy 1, policy_version 344959 (0.0006) [2023-12-27 21:42:13,841][106226] Updated weights for policy 0, policy_version 344394 (0.0006) [2023-12-27 21:42:14,344][106225] Updated weights for policy 1, policy_version 344969 (0.0010) [2023-12-27 21:42:14,401][106225] Updated weights for policy 1, policy_version 344979 (0.0010) [2023-12-27 21:42:14,404][106226] Updated weights for policy 0, policy_version 344404 (0.0006) [2023-12-27 21:42:14,461][106226] Updated weights for policy 0, policy_version 344414 (0.0006) [2023-12-27 21:42:14,466][106225] Updated weights for policy 1, policy_version 344989 (0.0009) [2023-12-27 21:42:14,525][106226] Updated weights for policy 0, policy_version 344424 (0.0005) [2023-12-27 21:42:15,134][106225] Updated weights for policy 1, policy_version 344999 (0.0007) [2023-12-27 21:42:15,199][106225] Updated weights for policy 1, policy_version 345009 (0.0006) [2023-12-27 21:42:15,214][106226] Updated weights for policy 0, policy_version 344434 (0.0006) [2023-12-27 21:42:15,256][106225] Updated weights for policy 1, policy_version 345019 (0.0008) [2023-12-27 21:42:15,283][106226] Updated weights for policy 0, policy_version 344444 (0.0011) [2023-12-27 21:42:15,351][106226] Updated weights for policy 0, policy_version 344454 (0.0010) [2023-12-27 21:42:15,415][106226] Updated weights for policy 0, policy_version 344464 (0.0011) [2023-12-27 21:42:15,905][106225] Updated weights for policy 1, policy_version 345029 (0.0006) [2023-12-27 21:42:15,955][106225] Updated weights for policy 1, policy_version 345039 (0.0005) [2023-12-27 21:42:16,009][106225] Updated weights for policy 1, policy_version 345049 (0.0005) [2023-12-27 21:42:16,081][106226] Updated weights for policy 0, policy_version 344474 (0.0008) [2023-12-27 21:42:16,146][106226] Updated weights for policy 0, policy_version 344484 (0.0005) [2023-12-27 21:42:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 176570368. Throughput: 0: 9957.1, 1: 9770.5. Samples: 176560716. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:16,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-5.710')] [2023-12-27 21:42:16,214][106226] Updated weights for policy 0, policy_version 344494 (0.0005) [2023-12-27 21:42:16,732][106225] Updated weights for policy 1, policy_version 345059 (0.0007) [2023-12-27 21:42:16,783][106225] Updated weights for policy 1, policy_version 345069 (0.0010) [2023-12-27 21:42:16,841][106225] Updated weights for policy 1, policy_version 345079 (0.0010) [2023-12-27 21:42:16,875][106226] Updated weights for policy 0, policy_version 344504 (0.0009) [2023-12-27 21:42:16,935][106226] Updated weights for policy 0, policy_version 344514 (0.0011) [2023-12-27 21:42:16,987][106226] Updated weights for policy 0, policy_version 344524 (0.0007) [2023-12-27 21:42:17,548][106225] Updated weights for policy 1, policy_version 345089 (0.0010) [2023-12-27 21:42:17,609][106225] Updated weights for policy 1, policy_version 345099 (0.0005) [2023-12-27 21:42:17,612][106226] Updated weights for policy 0, policy_version 344534 (0.0008) [2023-12-27 21:42:17,663][106226] Updated weights for policy 0, policy_version 344544 (0.0010) [2023-12-27 21:42:17,668][106225] Updated weights for policy 1, policy_version 345109 (0.0009) [2023-12-27 21:42:17,721][106226] Updated weights for policy 0, policy_version 344554 (0.0011) [2023-12-27 21:42:17,730][106225] Updated weights for policy 1, policy_version 345119 (0.0010) [2023-12-27 21:42:18,338][106226] Updated weights for policy 0, policy_version 344564 (0.0010) [2023-12-27 21:42:18,363][106225] Updated weights for policy 1, policy_version 345129 (0.0008) [2023-12-27 21:42:18,399][106226] Updated weights for policy 0, policy_version 344574 (0.0008) [2023-12-27 21:42:18,426][106225] Updated weights for policy 1, policy_version 345139 (0.0008) [2023-12-27 21:42:18,453][106226] Updated weights for policy 0, policy_version 344584 (0.0006) [2023-12-27 21:42:18,485][106225] Updated weights for policy 1, policy_version 345149 (0.0008) [2023-12-27 21:42:19,178][106226] Updated weights for policy 0, policy_version 344594 (0.0008) [2023-12-27 21:42:19,205][106225] Updated weights for policy 1, policy_version 345159 (0.0006) [2023-12-27 21:42:19,239][106226] Updated weights for policy 0, policy_version 344604 (0.0009) [2023-12-27 21:42:19,271][106225] Updated weights for policy 1, policy_version 345169 (0.0008) [2023-12-27 21:42:19,305][106226] Updated weights for policy 0, policy_version 344614 (0.0009) [2023-12-27 21:42:19,338][106225] Updated weights for policy 1, policy_version 345179 (0.0006) [2023-12-27 21:42:19,371][106226] Updated weights for policy 0, policy_version 344624 (0.0009) [2023-12-27 21:42:20,055][106225] Updated weights for policy 1, policy_version 345189 (0.0009) [2023-12-27 21:42:20,113][106225] Updated weights for policy 1, policy_version 345199 (0.0010) [2023-12-27 21:42:20,146][106226] Updated weights for policy 0, policy_version 344634 (0.0010) [2023-12-27 21:42:20,169][106225] Updated weights for policy 1, policy_version 345209 (0.0010) [2023-12-27 21:42:20,205][106226] Updated weights for policy 0, policy_version 344644 (0.0011) [2023-12-27 21:42:20,269][106226] Updated weights for policy 0, policy_version 344654 (0.0011) [2023-12-27 21:42:20,916][106225] Updated weights for policy 1, policy_version 345219 (0.0011) [2023-12-27 21:42:20,970][106225] Updated weights for policy 1, policy_version 345229 (0.0010) [2023-12-27 21:42:21,034][106225] Updated weights for policy 1, policy_version 345239 (0.0010) [2023-12-27 21:42:21,052][106226] Updated weights for policy 0, policy_version 344664 (0.0008) [2023-12-27 21:42:21,114][106226] Updated weights for policy 0, policy_version 344674 (0.0009) [2023-12-27 21:42:21,168][106226] Updated weights for policy 0, policy_version 344684 (0.0008) [2023-12-27 21:42:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 176668672. Throughput: 0: 9938.7, 1: 9746.8. Samples: 176679644. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:21,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.738')] [2023-12-27 21:42:21,838][106225] Updated weights for policy 1, policy_version 345249 (0.0009) [2023-12-27 21:42:21,898][106225] Updated weights for policy 1, policy_version 345259 (0.0008) [2023-12-27 21:42:21,964][106225] Updated weights for policy 1, policy_version 345269 (0.0008) [2023-12-27 21:42:21,979][106226] Updated weights for policy 0, policy_version 344694 (0.0008) [2023-12-27 21:42:22,027][106225] Updated weights for policy 1, policy_version 345279 (0.0007) [2023-12-27 21:42:22,037][106226] Updated weights for policy 0, policy_version 344704 (0.0007) [2023-12-27 21:42:22,087][106226] Updated weights for policy 0, policy_version 344714 (0.0009) [2023-12-27 21:42:22,799][106225] Updated weights for policy 1, policy_version 345289 (0.0008) [2023-12-27 21:42:22,856][106226] Updated weights for policy 0, policy_version 344724 (0.0009) [2023-12-27 21:42:22,863][106225] Updated weights for policy 1, policy_version 345299 (0.0008) [2023-12-27 21:42:22,908][106226] Updated weights for policy 0, policy_version 344734 (0.0011) [2023-12-27 21:42:22,926][106225] Updated weights for policy 1, policy_version 345309 (0.0006) [2023-12-27 21:42:22,960][106226] Updated weights for policy 0, policy_version 344744 (0.0011) [2023-12-27 21:42:23,526][106225] Updated weights for policy 1, policy_version 345319 (0.0005) [2023-12-27 21:42:23,582][106225] Updated weights for policy 1, policy_version 345329 (0.0005) [2023-12-27 21:42:23,633][106225] Updated weights for policy 1, policy_version 345339 (0.0005) [2023-12-27 21:42:23,689][106226] Updated weights for policy 0, policy_version 344754 (0.0010) [2023-12-27 21:42:23,756][106226] Updated weights for policy 0, policy_version 344764 (0.0007) [2023-12-27 21:42:23,813][106226] Updated weights for policy 0, policy_version 344774 (0.0005) [2023-12-27 21:42:23,869][106226] Updated weights for policy 0, policy_version 344784 (0.0007) [2023-12-27 21:42:24,275][106225] Updated weights for policy 1, policy_version 345349 (0.0005) [2023-12-27 21:42:24,337][106225] Updated weights for policy 1, policy_version 345359 (0.0006) [2023-12-27 21:42:24,394][106225] Updated weights for policy 1, policy_version 345369 (0.0008) [2023-12-27 21:42:24,506][106226] Updated weights for policy 0, policy_version 344794 (0.0008) [2023-12-27 21:42:24,554][106226] Updated weights for policy 0, policy_version 344804 (0.0007) [2023-12-27 21:42:24,605][106226] Updated weights for policy 0, policy_version 344814 (0.0008) [2023-12-27 21:42:25,070][106225] Updated weights for policy 1, policy_version 345379 (0.0008) [2023-12-27 21:42:25,130][106225] Updated weights for policy 1, policy_version 345389 (0.0009) [2023-12-27 21:42:25,182][106225] Updated weights for policy 1, policy_version 345399 (0.0005) [2023-12-27 21:42:25,397][106226] Updated weights for policy 0, policy_version 344824 (0.0010) [2023-12-27 21:42:25,460][106226] Updated weights for policy 0, policy_version 344834 (0.0008) [2023-12-27 21:42:25,515][106226] Updated weights for policy 0, policy_version 344844 (0.0008) [2023-12-27 21:42:25,863][106225] Updated weights for policy 1, policy_version 345409 (0.0006) [2023-12-27 21:42:25,915][106225] Updated weights for policy 1, policy_version 345419 (0.0008) [2023-12-27 21:42:25,966][106225] Updated weights for policy 1, policy_version 345429 (0.0007) [2023-12-27 21:42:26,015][106225] Updated weights for policy 1, policy_version 345439 (0.0008) [2023-12-27 21:42:26,096][106226] Updated weights for policy 0, policy_version 344854 (0.0008) [2023-12-27 21:42:26,156][106226] Updated weights for policy 0, policy_version 344864 (0.0008) [2023-12-27 21:42:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 176766976. Throughput: 0: 9931.9, 1: 9749.3. Samples: 176736868. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:26,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-5.424')] [2023-12-27 21:42:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000345440_88457216.pth... [2023-12-27 21:42:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000344320_88170496.pth [2023-12-27 21:42:26,212][106226] Updated weights for policy 0, policy_version 344874 (0.0009) [2023-12-27 21:42:26,244][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000344880_88317952.pth... [2023-12-27 21:42:26,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000343696_88014848.pth [2023-12-27 21:42:26,712][106225] Updated weights for policy 1, policy_version 345449 (0.0008) [2023-12-27 21:42:26,771][106225] Updated weights for policy 1, policy_version 345459 (0.0007) [2023-12-27 21:42:26,825][106225] Updated weights for policy 1, policy_version 345469 (0.0005) [2023-12-27 21:42:26,936][106226] Updated weights for policy 0, policy_version 344884 (0.0007) [2023-12-27 21:42:26,988][106226] Updated weights for policy 0, policy_version 344894 (0.0008) [2023-12-27 21:42:27,046][106226] Updated weights for policy 0, policy_version 344904 (0.0009) [2023-12-27 21:42:27,406][106225] Updated weights for policy 1, policy_version 345479 (0.0005) [2023-12-27 21:42:27,464][106225] Updated weights for policy 1, policy_version 345489 (0.0005) [2023-12-27 21:42:27,514][106225] Updated weights for policy 1, policy_version 345499 (0.0005) [2023-12-27 21:42:27,770][106226] Updated weights for policy 0, policy_version 344914 (0.0008) [2023-12-27 21:42:27,819][106226] Updated weights for policy 0, policy_version 344924 (0.0007) [2023-12-27 21:42:27,869][106226] Updated weights for policy 0, policy_version 344934 (0.0007) [2023-12-27 21:42:27,924][106226] Updated weights for policy 0, policy_version 344944 (0.0005) [2023-12-27 21:42:28,116][106225] Updated weights for policy 1, policy_version 345509 (0.0007) [2023-12-27 21:42:28,163][106225] Updated weights for policy 1, policy_version 345519 (0.0005) [2023-12-27 21:42:28,219][106225] Updated weights for policy 1, policy_version 345529 (0.0006) [2023-12-27 21:42:28,678][106226] Updated weights for policy 0, policy_version 344954 (0.0010) [2023-12-27 21:42:28,738][106226] Updated weights for policy 0, policy_version 344964 (0.0009) [2023-12-27 21:42:28,803][106226] Updated weights for policy 0, policy_version 344974 (0.0008) [2023-12-27 21:42:28,815][106225] Updated weights for policy 1, policy_version 345539 (0.0010) [2023-12-27 21:42:28,868][106225] Updated weights for policy 1, policy_version 345549 (0.0010) [2023-12-27 21:42:28,927][106225] Updated weights for policy 1, policy_version 345559 (0.0009) [2023-12-27 21:42:29,570][106226] Updated weights for policy 0, policy_version 344984 (0.0009) [2023-12-27 21:42:29,636][106226] Updated weights for policy 0, policy_version 344994 (0.0008) [2023-12-27 21:42:29,648][106225] Updated weights for policy 1, policy_version 345569 (0.0010) [2023-12-27 21:42:29,691][106226] Updated weights for policy 0, policy_version 345004 (0.0007) [2023-12-27 21:42:29,709][106225] Updated weights for policy 1, policy_version 345579 (0.0010) [2023-12-27 21:42:29,763][106225] Updated weights for policy 1, policy_version 345589 (0.0010) [2023-12-27 21:42:29,813][106225] Updated weights for policy 1, policy_version 345599 (0.0010) [2023-12-27 21:42:30,398][106226] Updated weights for policy 0, policy_version 345014 (0.0008) [2023-12-27 21:42:30,464][106226] Updated weights for policy 0, policy_version 345024 (0.0007) [2023-12-27 21:42:30,512][106226] Updated weights for policy 0, policy_version 345034 (0.0005) [2023-12-27 21:42:30,551][106225] Updated weights for policy 1, policy_version 345609 (0.0010) [2023-12-27 21:42:30,607][106225] Updated weights for policy 1, policy_version 345619 (0.0010) [2023-12-27 21:42:30,656][106225] Updated weights for policy 1, policy_version 345629 (0.0010) [2023-12-27 21:42:31,155][106226] Updated weights for policy 0, policy_version 345044 (0.0006) [2023-12-27 21:42:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 176865280. Throughput: 0: 9966.9, 1: 9842.2. Samples: 176858824. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:31,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-5.791')] [2023-12-27 21:42:31,213][106226] Updated weights for policy 0, policy_version 345054 (0.0008) [2023-12-27 21:42:31,277][106226] Updated weights for policy 0, policy_version 345064 (0.0008) [2023-12-27 21:42:31,368][106225] Updated weights for policy 1, policy_version 345639 (0.0010) [2023-12-27 21:42:31,431][106225] Updated weights for policy 1, policy_version 345649 (0.0008) [2023-12-27 21:42:31,485][106225] Updated weights for policy 1, policy_version 345659 (0.0010) [2023-12-27 21:42:32,040][106226] Updated weights for policy 0, policy_version 345074 (0.0007) [2023-12-27 21:42:32,107][106226] Updated weights for policy 0, policy_version 345084 (0.0008) [2023-12-27 21:42:32,165][106225] Updated weights for policy 1, policy_version 345669 (0.0008) [2023-12-27 21:42:32,173][106226] Updated weights for policy 0, policy_version 345094 (0.0008) [2023-12-27 21:42:32,226][106225] Updated weights for policy 1, policy_version 345679 (0.0006) [2023-12-27 21:42:32,232][106226] Updated weights for policy 0, policy_version 345104 (0.0007) [2023-12-27 21:42:32,289][106225] Updated weights for policy 1, policy_version 345689 (0.0008) [2023-12-27 21:42:32,924][106225] Updated weights for policy 1, policy_version 345699 (0.0007) [2023-12-27 21:42:32,979][106225] Updated weights for policy 1, policy_version 345709 (0.0006) [2023-12-27 21:42:33,028][106225] Updated weights for policy 1, policy_version 345719 (0.0005) [2023-12-27 21:42:33,029][106226] Updated weights for policy 0, policy_version 345114 (0.0009) [2023-12-27 21:42:33,085][106226] Updated weights for policy 0, policy_version 345124 (0.0009) [2023-12-27 21:42:33,147][106226] Updated weights for policy 0, policy_version 345134 (0.0009) [2023-12-27 21:42:33,627][106225] Updated weights for policy 1, policy_version 345729 (0.0006) [2023-12-27 21:42:33,679][106225] Updated weights for policy 1, policy_version 345739 (0.0010) [2023-12-27 21:42:33,735][106225] Updated weights for policy 1, policy_version 345749 (0.0010) [2023-12-27 21:42:33,791][106225] Updated weights for policy 1, policy_version 345759 (0.0010) [2023-12-27 21:42:33,910][106226] Updated weights for policy 0, policy_version 345144 (0.0008) [2023-12-27 21:42:33,963][106226] Updated weights for policy 0, policy_version 345154 (0.0007) [2023-12-27 21:42:34,013][106226] Updated weights for policy 0, policy_version 345164 (0.0008) [2023-12-27 21:42:34,526][106225] Updated weights for policy 1, policy_version 345769 (0.0011) [2023-12-27 21:42:34,590][106225] Updated weights for policy 1, policy_version 345779 (0.0010) [2023-12-27 21:42:34,654][106225] Updated weights for policy 1, policy_version 345789 (0.0010) [2023-12-27 21:42:34,712][106226] Updated weights for policy 0, policy_version 345174 (0.0008) [2023-12-27 21:42:34,760][106226] Updated weights for policy 0, policy_version 345184 (0.0008) [2023-12-27 21:42:34,816][106226] Updated weights for policy 0, policy_version 345194 (0.0008) [2023-12-27 21:42:35,316][106225] Updated weights for policy 1, policy_version 345799 (0.0007) [2023-12-27 21:42:35,373][106225] Updated weights for policy 1, policy_version 345809 (0.0008) [2023-12-27 21:42:35,431][106225] Updated weights for policy 1, policy_version 345819 (0.0005) [2023-12-27 21:42:35,605][106226] Updated weights for policy 0, policy_version 345204 (0.0008) [2023-12-27 21:42:35,660][106226] Updated weights for policy 0, policy_version 345214 (0.0007) [2023-12-27 21:42:35,710][106226] Updated weights for policy 0, policy_version 345224 (0.0008) [2023-12-27 21:42:35,996][106225] Updated weights for policy 1, policy_version 345829 (0.0008) [2023-12-27 21:42:36,053][106225] Updated weights for policy 1, policy_version 345839 (0.0010) [2023-12-27 21:42:36,112][106225] Updated weights for policy 1, policy_version 345849 (0.0009) [2023-12-27 21:42:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 176971776. Throughput: 0: 9982.7, 1: 9873.5. Samples: 176978372. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:36,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-5.646')] [2023-12-27 21:42:36,380][106226] Updated weights for policy 0, policy_version 345234 (0.0009) [2023-12-27 21:42:36,435][106226] Updated weights for policy 0, policy_version 345244 (0.0008) [2023-12-27 21:42:36,500][106226] Updated weights for policy 0, policy_version 345254 (0.0007) [2023-12-27 21:42:36,564][106226] Updated weights for policy 0, policy_version 345264 (0.0008) [2023-12-27 21:42:36,862][106225] Updated weights for policy 1, policy_version 345859 (0.0011) [2023-12-27 21:42:36,913][106225] Updated weights for policy 1, policy_version 345869 (0.0010) [2023-12-27 21:42:36,968][106225] Updated weights for policy 1, policy_version 345879 (0.0010) [2023-12-27 21:42:37,161][106226] Updated weights for policy 0, policy_version 345274 (0.0008) [2023-12-27 21:42:37,209][106226] Updated weights for policy 0, policy_version 345284 (0.0008) [2023-12-27 21:42:37,264][106226] Updated weights for policy 0, policy_version 345294 (0.0008) [2023-12-27 21:42:37,693][106225] Updated weights for policy 1, policy_version 345889 (0.0010) [2023-12-27 21:42:37,752][106225] Updated weights for policy 1, policy_version 345899 (0.0006) [2023-12-27 21:42:37,814][106225] Updated weights for policy 1, policy_version 345909 (0.0006) [2023-12-27 21:42:37,879][106225] Updated weights for policy 1, policy_version 345919 (0.0006) [2023-12-27 21:42:38,022][106226] Updated weights for policy 0, policy_version 345304 (0.0009) [2023-12-27 21:42:38,086][106226] Updated weights for policy 0, policy_version 345314 (0.0010) [2023-12-27 21:42:38,145][106226] Updated weights for policy 0, policy_version 345324 (0.0011) [2023-12-27 21:42:38,395][106225] Updated weights for policy 1, policy_version 345929 (0.0007) [2023-12-27 21:42:38,450][106225] Updated weights for policy 1, policy_version 345939 (0.0010) [2023-12-27 21:42:38,511][106225] Updated weights for policy 1, policy_version 345949 (0.0010) [2023-12-27 21:42:38,953][106226] Updated weights for policy 0, policy_version 345334 (0.0010) [2023-12-27 21:42:39,003][106226] Updated weights for policy 0, policy_version 345344 (0.0010) [2023-12-27 21:42:39,050][106226] Updated weights for policy 0, policy_version 345354 (0.0010) [2023-12-27 21:42:39,243][106225] Updated weights for policy 1, policy_version 345959 (0.0012) [2023-12-27 21:42:39,301][106225] Updated weights for policy 1, policy_version 345969 (0.0010) [2023-12-27 21:42:39,364][106225] Updated weights for policy 1, policy_version 345979 (0.0011) [2023-12-27 21:42:39,750][106226] Updated weights for policy 0, policy_version 345364 (0.0010) [2023-12-27 21:42:39,812][106226] Updated weights for policy 0, policy_version 345374 (0.0007) [2023-12-27 21:42:39,877][106226] Updated weights for policy 0, policy_version 345384 (0.0009) [2023-12-27 21:42:40,104][106225] Updated weights for policy 1, policy_version 345989 (0.0009) [2023-12-27 21:42:40,158][106225] Updated weights for policy 1, policy_version 345999 (0.0009) [2023-12-27 21:42:40,220][106225] Updated weights for policy 1, policy_version 346009 (0.0009) [2023-12-27 21:42:40,625][106226] Updated weights for policy 0, policy_version 345394 (0.0009) [2023-12-27 21:42:40,675][106226] Updated weights for policy 0, policy_version 345404 (0.0009) [2023-12-27 21:42:40,729][106226] Updated weights for policy 0, policy_version 345414 (0.0008) [2023-12-27 21:42:40,780][106226] Updated weights for policy 0, policy_version 345424 (0.0009) [2023-12-27 21:42:40,911][106225] Updated weights for policy 1, policy_version 346019 (0.0008) [2023-12-27 21:42:40,969][106225] Updated weights for policy 1, policy_version 346029 (0.0005) [2023-12-27 21:42:41,021][106225] Updated weights for policy 1, policy_version 346039 (0.0006) [2023-12-27 21:42:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 177070080. Throughput: 0: 9918.2, 1: 9881.9. Samples: 177038408. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:41,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.381')] [2023-12-27 21:42:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000346048_88612864.pth... [2023-12-27 21:42:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000345424_88457216.pth... [2023-12-27 21:42:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000344864_88309760.pth [2023-12-27 21:42:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000344304_88170496.pth [2023-12-27 21:42:41,696][106226] Updated weights for policy 0, policy_version 345434 (0.0007) [2023-12-27 21:42:41,751][106225] Updated weights for policy 1, policy_version 346049 (0.0009) [2023-12-27 21:42:41,763][106226] Updated weights for policy 0, policy_version 345444 (0.0007) [2023-12-27 21:42:41,813][106225] Updated weights for policy 1, policy_version 346059 (0.0008) [2023-12-27 21:42:41,824][106226] Updated weights for policy 0, policy_version 345454 (0.0007) [2023-12-27 21:42:41,872][106225] Updated weights for policy 1, policy_version 346069 (0.0008) [2023-12-27 21:42:41,927][106225] Updated weights for policy 1, policy_version 346079 (0.0008) [2023-12-27 21:42:42,549][106226] Updated weights for policy 0, policy_version 345464 (0.0007) [2023-12-27 21:42:42,609][106226] Updated weights for policy 0, policy_version 345474 (0.0010) [2023-12-27 21:42:42,668][106226] Updated weights for policy 0, policy_version 345484 (0.0010) [2023-12-27 21:42:42,716][106225] Updated weights for policy 1, policy_version 346089 (0.0008) [2023-12-27 21:42:42,762][106225] Updated weights for policy 1, policy_version 346099 (0.0009) [2023-12-27 21:42:42,814][106225] Updated weights for policy 1, policy_version 346109 (0.0006) [2023-12-27 21:42:43,384][106226] Updated weights for policy 0, policy_version 345494 (0.0007) [2023-12-27 21:42:43,427][106225] Updated weights for policy 1, policy_version 346119 (0.0005) [2023-12-27 21:42:43,456][106226] Updated weights for policy 0, policy_version 345504 (0.0005) [2023-12-27 21:42:43,473][106225] Updated weights for policy 1, policy_version 346129 (0.0005) [2023-12-27 21:42:43,519][106225] Updated weights for policy 1, policy_version 346139 (0.0005) [2023-12-27 21:42:43,526][106226] Updated weights for policy 0, policy_version 345514 (0.0005) [2023-12-27 21:42:44,104][106226] Updated weights for policy 0, policy_version 345524 (0.0009) [2023-12-27 21:42:44,163][106226] Updated weights for policy 0, policy_version 345534 (0.0008) [2023-12-27 21:42:44,170][106225] Updated weights for policy 1, policy_version 346149 (0.0006) [2023-12-27 21:42:44,223][106226] Updated weights for policy 0, policy_version 345544 (0.0005) [2023-12-27 21:42:44,228][106225] Updated weights for policy 1, policy_version 346159 (0.0007) [2023-12-27 21:42:44,281][106225] Updated weights for policy 1, policy_version 346169 (0.0010) [2023-12-27 21:42:44,863][106226] Updated weights for policy 0, policy_version 345554 (0.0006) [2023-12-27 21:42:44,936][106226] Updated weights for policy 0, policy_version 345564 (0.0011) [2023-12-27 21:42:44,987][106226] Updated weights for policy 0, policy_version 345574 (0.0011) [2023-12-27 21:42:45,032][106225] Updated weights for policy 1, policy_version 346179 (0.0009) [2023-12-27 21:42:45,049][106226] Updated weights for policy 0, policy_version 345584 (0.0011) [2023-12-27 21:42:45,090][106225] Updated weights for policy 1, policy_version 346189 (0.0008) [2023-12-27 21:42:45,156][106225] Updated weights for policy 1, policy_version 346199 (0.0008) [2023-12-27 21:42:45,710][106226] Updated weights for policy 0, policy_version 345594 (0.0010) [2023-12-27 21:42:45,759][106226] Updated weights for policy 0, policy_version 345604 (0.0010) [2023-12-27 21:42:45,791][106225] Updated weights for policy 1, policy_version 346209 (0.0008) [2023-12-27 21:42:45,807][106226] Updated weights for policy 0, policy_version 345614 (0.0008) [2023-12-27 21:42:45,855][106225] Updated weights for policy 1, policy_version 346219 (0.0008) [2023-12-27 21:42:45,907][106225] Updated weights for policy 1, policy_version 346229 (0.0010) [2023-12-27 21:42:45,965][106225] Updated weights for policy 1, policy_version 346239 (0.0011) [2023-12-27 21:42:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 177168384. Throughput: 0: 9840.2, 1: 9947.2. Samples: 177155704. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:46,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-5.724')] [2023-12-27 21:42:46,508][106226] Updated weights for policy 0, policy_version 345624 (0.0009) [2023-12-27 21:42:46,564][106226] Updated weights for policy 0, policy_version 345634 (0.0008) [2023-12-27 21:42:46,615][106225] Updated weights for policy 1, policy_version 346249 (0.0006) [2023-12-27 21:42:46,626][106226] Updated weights for policy 0, policy_version 345644 (0.0006) [2023-12-27 21:42:46,671][106225] Updated weights for policy 1, policy_version 346259 (0.0005) [2023-12-27 21:42:46,721][106225] Updated weights for policy 1, policy_version 346269 (0.0007) [2023-12-27 21:42:47,231][106226] Updated weights for policy 0, policy_version 345654 (0.0006) [2023-12-27 21:42:47,302][106226] Updated weights for policy 0, policy_version 345664 (0.0007) [2023-12-27 21:42:47,332][106225] Updated weights for policy 1, policy_version 346279 (0.0007) [2023-12-27 21:42:47,364][106226] Updated weights for policy 0, policy_version 345674 (0.0009) [2023-12-27 21:42:47,380][106225] Updated weights for policy 1, policy_version 346289 (0.0005) [2023-12-27 21:42:47,431][106225] Updated weights for policy 1, policy_version 346299 (0.0006) [2023-12-27 21:42:47,924][106226] Updated weights for policy 0, policy_version 345684 (0.0008) [2023-12-27 21:42:47,987][106226] Updated weights for policy 0, policy_version 345694 (0.0006) [2023-12-27 21:42:48,051][106226] Updated weights for policy 0, policy_version 345704 (0.0007) [2023-12-27 21:42:48,102][106225] Updated weights for policy 1, policy_version 346309 (0.0006) [2023-12-27 21:42:48,152][106225] Updated weights for policy 1, policy_version 346319 (0.0009) [2023-12-27 21:42:48,214][106225] Updated weights for policy 1, policy_version 346329 (0.0009) [2023-12-27 21:42:48,739][106226] Updated weights for policy 0, policy_version 345714 (0.0009) [2023-12-27 21:42:48,804][106226] Updated weights for policy 0, policy_version 345724 (0.0008) [2023-12-27 21:42:48,869][106226] Updated weights for policy 0, policy_version 345734 (0.0007) [2023-12-27 21:42:48,920][106226] Updated weights for policy 0, policy_version 345744 (0.0008) [2023-12-27 21:42:48,956][106225] Updated weights for policy 1, policy_version 346339 (0.0008) [2023-12-27 21:42:49,018][106225] Updated weights for policy 1, policy_version 346349 (0.0010) [2023-12-27 21:42:49,073][106225] Updated weights for policy 1, policy_version 346359 (0.0010) [2023-12-27 21:42:49,626][106226] Updated weights for policy 0, policy_version 345754 (0.0007) [2023-12-27 21:42:49,681][106226] Updated weights for policy 0, policy_version 345764 (0.0008) [2023-12-27 21:42:49,734][106226] Updated weights for policy 0, policy_version 345774 (0.0008) [2023-12-27 21:42:49,844][106225] Updated weights for policy 1, policy_version 346369 (0.0010) [2023-12-27 21:42:49,910][106225] Updated weights for policy 1, policy_version 346379 (0.0011) [2023-12-27 21:42:49,973][106225] Updated weights for policy 1, policy_version 346389 (0.0010) [2023-12-27 21:42:50,030][106225] Updated weights for policy 1, policy_version 346399 (0.0007) [2023-12-27 21:42:50,551][106226] Updated weights for policy 0, policy_version 345784 (0.0008) [2023-12-27 21:42:50,617][106225] Updated weights for policy 1, policy_version 346409 (0.0008) [2023-12-27 21:42:50,622][106226] Updated weights for policy 0, policy_version 345794 (0.0008) [2023-12-27 21:42:50,679][106225] Updated weights for policy 1, policy_version 346419 (0.0008) [2023-12-27 21:42:50,689][106226] Updated weights for policy 0, policy_version 345804 (0.0008) [2023-12-27 21:42:50,739][106225] Updated weights for policy 1, policy_version 346429 (0.0010) [2023-12-27 21:42:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 177266688. Throughput: 0: 9837.9, 1: 10015.4. Samples: 177277416. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:51,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-5.480')] [2023-12-27 21:42:51,412][106226] Updated weights for policy 0, policy_version 345814 (0.0007) [2023-12-27 21:42:51,459][106225] Updated weights for policy 1, policy_version 346439 (0.0006) [2023-12-27 21:42:51,474][106226] Updated weights for policy 0, policy_version 345824 (0.0008) [2023-12-27 21:42:51,520][106225] Updated weights for policy 1, policy_version 346449 (0.0005) [2023-12-27 21:42:51,530][106226] Updated weights for policy 0, policy_version 345834 (0.0007) [2023-12-27 21:42:51,587][106225] Updated weights for policy 1, policy_version 346459 (0.0007) [2023-12-27 21:42:52,299][106226] Updated weights for policy 0, policy_version 345844 (0.0008) [2023-12-27 21:42:52,317][106225] Updated weights for policy 1, policy_version 346469 (0.0007) [2023-12-27 21:42:52,371][106226] Updated weights for policy 0, policy_version 345854 (0.0007) [2023-12-27 21:42:52,391][106225] Updated weights for policy 1, policy_version 346479 (0.0008) [2023-12-27 21:42:52,432][106226] Updated weights for policy 0, policy_version 345864 (0.0007) [2023-12-27 21:42:52,454][106225] Updated weights for policy 1, policy_version 346489 (0.0006) [2023-12-27 21:42:53,137][106226] Updated weights for policy 0, policy_version 345874 (0.0007) [2023-12-27 21:42:53,170][106225] Updated weights for policy 1, policy_version 346499 (0.0007) [2023-12-27 21:42:53,197][106226] Updated weights for policy 0, policy_version 345884 (0.0011) [2023-12-27 21:42:53,237][106225] Updated weights for policy 1, policy_version 346509 (0.0005) [2023-12-27 21:42:53,254][106226] Updated weights for policy 0, policy_version 345894 (0.0010) [2023-12-27 21:42:53,301][106225] Updated weights for policy 1, policy_version 346519 (0.0006) [2023-12-27 21:42:53,314][106226] Updated weights for policy 0, policy_version 345904 (0.0010) [2023-12-27 21:42:53,934][106225] Updated weights for policy 1, policy_version 346529 (0.0007) [2023-12-27 21:42:53,993][106225] Updated weights for policy 1, policy_version 346539 (0.0005) [2023-12-27 21:42:54,016][106226] Updated weights for policy 0, policy_version 345914 (0.0011) [2023-12-27 21:42:54,045][106225] Updated weights for policy 1, policy_version 346549 (0.0006) [2023-12-27 21:42:54,068][106226] Updated weights for policy 0, policy_version 345924 (0.0010) [2023-12-27 21:42:54,097][106225] Updated weights for policy 1, policy_version 346559 (0.0006) [2023-12-27 21:42:54,122][106226] Updated weights for policy 0, policy_version 345934 (0.0010) [2023-12-27 21:42:54,716][106225] Updated weights for policy 1, policy_version 346569 (0.0010) [2023-12-27 21:42:54,748][106226] Updated weights for policy 0, policy_version 345944 (0.0006) [2023-12-27 21:42:54,773][106225] Updated weights for policy 1, policy_version 346579 (0.0010) [2023-12-27 21:42:54,798][106226] Updated weights for policy 0, policy_version 345954 (0.0005) [2023-12-27 21:42:54,821][106225] Updated weights for policy 1, policy_version 346589 (0.0010) [2023-12-27 21:42:54,855][106226] Updated weights for policy 0, policy_version 345964 (0.0006) [2023-12-27 21:42:55,538][106225] Updated weights for policy 1, policy_version 346599 (0.0010) [2023-12-27 21:42:55,574][106226] Updated weights for policy 0, policy_version 345974 (0.0006) [2023-12-27 21:42:55,594][106225] Updated weights for policy 1, policy_version 346609 (0.0010) [2023-12-27 21:42:55,638][106226] Updated weights for policy 0, policy_version 345984 (0.0006) [2023-12-27 21:42:55,653][106225] Updated weights for policy 1, policy_version 346619 (0.0010) [2023-12-27 21:42:55,704][106226] Updated weights for policy 0, policy_version 345994 (0.0009) [2023-12-27 21:42:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 177364992. Throughput: 0: 9768.6, 1: 10050.5. Samples: 177334856. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:42:56,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-5.601')] [2023-12-27 21:42:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000346624_88760320.pth... [2023-12-27 21:42:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000346000_88604672.pth... [2023-12-27 21:42:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000345440_88457216.pth [2023-12-27 21:42:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000344880_88317952.pth [2023-12-27 21:42:56,283][106225] Updated weights for policy 1, policy_version 346629 (0.0008) [2023-12-27 21:42:56,342][106225] Updated weights for policy 1, policy_version 346639 (0.0010) [2023-12-27 21:42:56,401][106225] Updated weights for policy 1, policy_version 346649 (0.0010) [2023-12-27 21:42:56,443][106226] Updated weights for policy 0, policy_version 346004 (0.0009) [2023-12-27 21:42:56,495][106226] Updated weights for policy 0, policy_version 346014 (0.0008) [2023-12-27 21:42:56,546][106226] Updated weights for policy 0, policy_version 346024 (0.0008) [2023-12-27 21:42:57,028][106225] Updated weights for policy 1, policy_version 346659 (0.0009) [2023-12-27 21:42:57,073][106225] Updated weights for policy 1, policy_version 346669 (0.0005) [2023-12-27 21:42:57,119][106225] Updated weights for policy 1, policy_version 346679 (0.0005) [2023-12-27 21:42:57,313][106226] Updated weights for policy 0, policy_version 346034 (0.0008) [2023-12-27 21:42:57,366][106226] Updated weights for policy 0, policy_version 346044 (0.0008) [2023-12-27 21:42:57,424][106226] Updated weights for policy 0, policy_version 346054 (0.0009) [2023-12-27 21:42:57,484][106226] Updated weights for policy 0, policy_version 346064 (0.0009) [2023-12-27 21:42:57,711][106225] Updated weights for policy 1, policy_version 346689 (0.0007) [2023-12-27 21:42:57,770][106225] Updated weights for policy 1, policy_version 346699 (0.0008) [2023-12-27 21:42:57,826][106225] Updated weights for policy 1, policy_version 346709 (0.0005) [2023-12-27 21:42:57,878][106225] Updated weights for policy 1, policy_version 346719 (0.0005) [2023-12-27 21:42:58,271][106226] Updated weights for policy 0, policy_version 346074 (0.0008) [2023-12-27 21:42:58,341][106226] Updated weights for policy 0, policy_version 346084 (0.0008) [2023-12-27 21:42:58,411][106226] Updated weights for policy 0, policy_version 346094 (0.0007) [2023-12-27 21:42:58,534][106225] Updated weights for policy 1, policy_version 346729 (0.0007) [2023-12-27 21:42:58,610][106225] Updated weights for policy 1, policy_version 346739 (0.0007) [2023-12-27 21:42:58,666][106225] Updated weights for policy 1, policy_version 346749 (0.0008) [2023-12-27 21:42:59,179][106226] Updated weights for policy 0, policy_version 346104 (0.0008) [2023-12-27 21:42:59,259][106226] Updated weights for policy 0, policy_version 346114 (0.0008) [2023-12-27 21:42:59,322][106226] Updated weights for policy 0, policy_version 346124 (0.0008) [2023-12-27 21:42:59,447][106225] Updated weights for policy 1, policy_version 346759 (0.0008) [2023-12-27 21:42:59,498][106225] Updated weights for policy 1, policy_version 346769 (0.0009) [2023-12-27 21:42:59,559][106225] Updated weights for policy 1, policy_version 346779 (0.0009) [2023-12-27 21:42:59,992][106226] Updated weights for policy 0, policy_version 346134 (0.0008) [2023-12-27 21:43:00,052][106226] Updated weights for policy 0, policy_version 346144 (0.0009) [2023-12-27 21:43:00,111][106226] Updated weights for policy 0, policy_version 346154 (0.0008) [2023-12-27 21:43:00,320][106225] Updated weights for policy 1, policy_version 346789 (0.0008) [2023-12-27 21:43:00,380][106225] Updated weights for policy 1, policy_version 346799 (0.0009) [2023-12-27 21:43:00,439][106225] Updated weights for policy 1, policy_version 346809 (0.0008) [2023-12-27 21:43:00,818][106226] Updated weights for policy 0, policy_version 346164 (0.0008) [2023-12-27 21:43:00,874][106226] Updated weights for policy 0, policy_version 346174 (0.0009) [2023-12-27 21:43:00,926][106226] Updated weights for policy 0, policy_version 346184 (0.0009) [2023-12-27 21:43:01,109][106225] Updated weights for policy 1, policy_version 346819 (0.0007) [2023-12-27 21:43:01,175][106225] Updated weights for policy 1, policy_version 346829 (0.0008) [2023-12-27 21:43:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 177463296. Throughput: 0: 9702.2, 1: 10146.7. Samples: 177453920. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:43:01,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-5.797')] [2023-12-27 21:43:01,238][106225] Updated weights for policy 1, policy_version 346839 (0.0007) [2023-12-27 21:43:01,755][106226] Updated weights for policy 0, policy_version 346194 (0.0009) [2023-12-27 21:43:01,812][106226] Updated weights for policy 0, policy_version 346204 (0.0008) [2023-12-27 21:43:01,866][106226] Updated weights for policy 0, policy_version 346215 (0.0008) [2023-12-27 21:43:01,954][106225] Updated weights for policy 1, policy_version 346849 (0.0010) [2023-12-27 21:43:02,008][106225] Updated weights for policy 1, policy_version 346859 (0.0008) [2023-12-27 21:43:02,058][106225] Updated weights for policy 1, policy_version 346869 (0.0008) [2023-12-27 21:43:02,103][106225] Updated weights for policy 1, policy_version 346879 (0.0008) [2023-12-27 21:43:02,617][106226] Updated weights for policy 0, policy_version 346225 (0.0008) [2023-12-27 21:43:02,680][106226] Updated weights for policy 0, policy_version 346235 (0.0010) [2023-12-27 21:43:02,734][106226] Updated weights for policy 0, policy_version 346245 (0.0009) [2023-12-27 21:43:02,777][106225] Updated weights for policy 1, policy_version 346889 (0.0007) [2023-12-27 21:43:02,795][106226] Updated weights for policy 0, policy_version 346255 (0.0006) [2023-12-27 21:43:02,837][106225] Updated weights for policy 1, policy_version 346899 (0.0008) [2023-12-27 21:43:02,890][106225] Updated weights for policy 1, policy_version 346909 (0.0008) [2023-12-27 21:43:03,477][106226] Updated weights for policy 0, policy_version 346265 (0.0008) [2023-12-27 21:43:03,538][106226] Updated weights for policy 0, policy_version 346275 (0.0008) [2023-12-27 21:43:03,596][106225] Updated weights for policy 1, policy_version 346919 (0.0006) [2023-12-27 21:43:03,597][106226] Updated weights for policy 0, policy_version 346285 (0.0008) [2023-12-27 21:43:03,645][106225] Updated weights for policy 1, policy_version 346929 (0.0007) [2023-12-27 21:43:03,697][106225] Updated weights for policy 1, policy_version 346939 (0.0009) [2023-12-27 21:43:04,230][106226] Updated weights for policy 0, policy_version 346295 (0.0008) [2023-12-27 21:43:04,286][106226] Updated weights for policy 0, policy_version 346305 (0.0009) [2023-12-27 21:43:04,348][106226] Updated weights for policy 0, policy_version 346315 (0.0009) [2023-12-27 21:43:04,477][106225] Updated weights for policy 1, policy_version 346949 (0.0008) [2023-12-27 21:43:04,538][106225] Updated weights for policy 1, policy_version 346959 (0.0008) [2023-12-27 21:43:04,598][106225] Updated weights for policy 1, policy_version 346969 (0.0006) [2023-12-27 21:43:05,094][106226] Updated weights for policy 0, policy_version 346325 (0.0009) [2023-12-27 21:43:05,154][106226] Updated weights for policy 0, policy_version 346335 (0.0009) [2023-12-27 21:43:05,219][106226] Updated weights for policy 0, policy_version 346345 (0.0008) [2023-12-27 21:43:05,292][106225] Updated weights for policy 1, policy_version 346979 (0.0007) [2023-12-27 21:43:05,352][106225] Updated weights for policy 1, policy_version 346989 (0.0005) [2023-12-27 21:43:05,405][106225] Updated weights for policy 1, policy_version 346999 (0.0005) [2023-12-27 21:43:05,928][106226] Updated weights for policy 0, policy_version 346355 (0.0008) [2023-12-27 21:43:05,936][106225] Updated weights for policy 1, policy_version 347009 (0.0005) [2023-12-27 21:43:05,988][106225] Updated weights for policy 1, policy_version 347019 (0.0006) [2023-12-27 21:43:05,992][106226] Updated weights for policy 0, policy_version 346365 (0.0007) [2023-12-27 21:43:06,036][106225] Updated weights for policy 1, policy_version 347029 (0.0009) [2023-12-27 21:43:06,053][106226] Updated weights for policy 0, policy_version 346375 (0.0005) [2023-12-27 21:43:06,089][106225] Updated weights for policy 1, policy_version 347039 (0.0009) [2023-12-27 21:43:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 177569792. Throughput: 0: 9673.8, 1: 10169.6. Samples: 177572596. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:43:06,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-5.595')] [2023-12-27 21:43:06,757][106226] Updated weights for policy 0, policy_version 346385 (0.0007) [2023-12-27 21:43:06,818][106226] Updated weights for policy 0, policy_version 346395 (0.0011) [2023-12-27 21:43:06,879][106226] Updated weights for policy 0, policy_version 346405 (0.0010) [2023-12-27 21:43:06,895][106225] Updated weights for policy 1, policy_version 347049 (0.0007) [2023-12-27 21:43:06,946][106226] Updated weights for policy 0, policy_version 346415 (0.0009) [2023-12-27 21:43:06,955][106225] Updated weights for policy 1, policy_version 347059 (0.0009) [2023-12-27 21:43:07,014][106225] Updated weights for policy 1, policy_version 347069 (0.0008) [2023-12-27 21:43:07,579][106226] Updated weights for policy 0, policy_version 346425 (0.0011) [2023-12-27 21:43:07,640][106226] Updated weights for policy 0, policy_version 346435 (0.0010) [2023-12-27 21:43:07,703][106226] Updated weights for policy 0, policy_version 346445 (0.0011) [2023-12-27 21:43:07,800][106225] Updated weights for policy 1, policy_version 347079 (0.0008) [2023-12-27 21:43:07,847][106225] Updated weights for policy 1, policy_version 347089 (0.0007) [2023-12-27 21:43:07,893][106225] Updated weights for policy 1, policy_version 347099 (0.0008) [2023-12-27 21:43:08,381][106226] Updated weights for policy 0, policy_version 346455 (0.0008) [2023-12-27 21:43:08,444][106226] Updated weights for policy 0, policy_version 346465 (0.0011) [2023-12-27 21:43:08,511][106226] Updated weights for policy 0, policy_version 346475 (0.0006) [2023-12-27 21:43:08,699][106225] Updated weights for policy 1, policy_version 347109 (0.0008) [2023-12-27 21:43:08,762][106225] Updated weights for policy 1, policy_version 347119 (0.0008) [2023-12-27 21:43:08,827][106225] Updated weights for policy 1, policy_version 347129 (0.0008) [2023-12-27 21:43:09,119][106226] Updated weights for policy 0, policy_version 346485 (0.0008) [2023-12-27 21:43:09,187][106226] Updated weights for policy 0, policy_version 346495 (0.0010) [2023-12-27 21:43:09,256][106226] Updated weights for policy 0, policy_version 346505 (0.0011) [2023-12-27 21:43:09,668][106225] Updated weights for policy 1, policy_version 347139 (0.0007) [2023-12-27 21:43:09,728][106225] Updated weights for policy 1, policy_version 347149 (0.0006) [2023-12-27 21:43:09,791][106225] Updated weights for policy 1, policy_version 347159 (0.0009) [2023-12-27 21:43:09,965][106226] Updated weights for policy 0, policy_version 346515 (0.0009) [2023-12-27 21:43:10,028][106226] Updated weights for policy 0, policy_version 346525 (0.0008) [2023-12-27 21:43:10,094][106226] Updated weights for policy 0, policy_version 346535 (0.0008) [2023-12-27 21:43:10,596][106225] Updated weights for policy 1, policy_version 347169 (0.0008) [2023-12-27 21:43:10,660][106225] Updated weights for policy 1, policy_version 347179 (0.0008) [2023-12-27 21:43:10,719][106225] Updated weights for policy 1, policy_version 347189 (0.0008) [2023-12-27 21:43:10,753][106226] Updated weights for policy 0, policy_version 346545 (0.0008) [2023-12-27 21:43:10,782][106225] Updated weights for policy 1, policy_version 347199 (0.0008) [2023-12-27 21:43:10,807][106226] Updated weights for policy 0, policy_version 346555 (0.0005) [2023-12-27 21:43:10,866][106226] Updated weights for policy 0, policy_version 346565 (0.0007) [2023-12-27 21:43:10,923][106226] Updated weights for policy 0, policy_version 346575 (0.0007) [2023-12-27 21:43:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 177659904. Throughput: 0: 9739.2, 1: 10134.9. Samples: 177631204. Policy #0 lag: (min: 13.0, avg: 14.1, max: 35.0) [2023-12-27 21:43:11,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.594')] [2023-12-27 21:43:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000347200_88907776.pth... [2023-12-27 21:43:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000346576_88752128.pth... [2023-12-27 21:43:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000346048_88612864.pth [2023-12-27 21:43:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000345424_88457216.pth [2023-12-27 21:43:11,635][106225] Updated weights for policy 1, policy_version 347209 (0.0007) [2023-12-27 21:43:11,663][106226] Updated weights for policy 0, policy_version 346585 (0.0009) [2023-12-27 21:43:11,702][106225] Updated weights for policy 1, policy_version 347219 (0.0007) [2023-12-27 21:43:11,734][106226] Updated weights for policy 0, policy_version 346595 (0.0008) [2023-12-27 21:43:11,763][106225] Updated weights for policy 1, policy_version 347229 (0.0008) [2023-12-27 21:43:11,798][106226] Updated weights for policy 0, policy_version 346605 (0.0007) [2023-12-27 21:43:12,493][106225] Updated weights for policy 1, policy_version 347239 (0.0006) [2023-12-27 21:43:12,558][106225] Updated weights for policy 1, policy_version 347249 (0.0008) [2023-12-27 21:43:12,596][106226] Updated weights for policy 0, policy_version 346615 (0.0008) [2023-12-27 21:43:12,614][106225] Updated weights for policy 1, policy_version 347259 (0.0009) [2023-12-27 21:43:12,656][106226] Updated weights for policy 0, policy_version 346625 (0.0007) [2023-12-27 21:43:12,723][106226] Updated weights for policy 0, policy_version 346635 (0.0010) [2023-12-27 21:43:13,188][106225] Updated weights for policy 1, policy_version 347269 (0.0007) [2023-12-27 21:43:13,237][106225] Updated weights for policy 1, policy_version 347279 (0.0008) [2023-12-27 21:43:13,281][106225] Updated weights for policy 1, policy_version 347289 (0.0008) [2023-12-27 21:43:13,445][106226] Updated weights for policy 0, policy_version 346645 (0.0008) [2023-12-27 21:43:13,498][106226] Updated weights for policy 0, policy_version 346655 (0.0005) [2023-12-27 21:43:13,553][106226] Updated weights for policy 0, policy_version 346665 (0.0005) [2023-12-27 21:43:14,117][106226] Updated weights for policy 0, policy_version 346675 (0.0005) [2023-12-27 21:43:14,128][106225] Updated weights for policy 1, policy_version 347299 (0.0008) [2023-12-27 21:43:14,175][106226] Updated weights for policy 0, policy_version 346685 (0.0006) [2023-12-27 21:43:14,190][106225] Updated weights for policy 1, policy_version 347309 (0.0007) [2023-12-27 21:43:14,235][106226] Updated weights for policy 0, policy_version 346695 (0.0007) [2023-12-27 21:43:14,244][106225] Updated weights for policy 1, policy_version 347319 (0.0006) [2023-12-27 21:43:14,845][106226] Updated weights for policy 0, policy_version 346705 (0.0007) [2023-12-27 21:43:14,909][106226] Updated weights for policy 0, policy_version 346715 (0.0009) [2023-12-27 21:43:14,968][106226] Updated weights for policy 0, policy_version 346725 (0.0009) [2023-12-27 21:43:15,013][106225] Updated weights for policy 1, policy_version 347329 (0.0007) [2023-12-27 21:43:15,028][106226] Updated weights for policy 0, policy_version 346735 (0.0008) [2023-12-27 21:43:15,072][106225] Updated weights for policy 1, policy_version 347339 (0.0008) [2023-12-27 21:43:15,125][106225] Updated weights for policy 1, policy_version 347349 (0.0008) [2023-12-27 21:43:15,185][106225] Updated weights for policy 1, policy_version 347359 (0.0008) [2023-12-27 21:43:15,668][106226] Updated weights for policy 0, policy_version 346745 (0.0005) [2023-12-27 21:43:15,727][106226] Updated weights for policy 0, policy_version 346755 (0.0009) [2023-12-27 21:43:15,782][106226] Updated weights for policy 0, policy_version 346765 (0.0008) [2023-12-27 21:43:15,960][106225] Updated weights for policy 1, policy_version 347369 (0.0006) [2023-12-27 21:43:16,012][106225] Updated weights for policy 1, policy_version 347379 (0.0005) [2023-12-27 21:43:16,075][106225] Updated weights for policy 1, policy_version 347389 (0.0007) [2023-12-27 21:43:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 177758208. Throughput: 0: 9764.5, 1: 9939.1. Samples: 177745488. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:16,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.436')] [2023-12-27 21:43:16,443][106226] Updated weights for policy 0, policy_version 346775 (0.0009) [2023-12-27 21:43:16,499][106226] Updated weights for policy 0, policy_version 346785 (0.0010) [2023-12-27 21:43:16,548][106226] Updated weights for policy 0, policy_version 346795 (0.0010) [2023-12-27 21:43:16,632][106225] Updated weights for policy 1, policy_version 347399 (0.0008) [2023-12-27 21:43:16,687][106225] Updated weights for policy 1, policy_version 347409 (0.0007) [2023-12-27 21:43:16,759][106225] Updated weights for policy 1, policy_version 347419 (0.0006) [2023-12-27 21:43:17,182][106226] Updated weights for policy 0, policy_version 346805 (0.0006) [2023-12-27 21:43:17,242][106226] Updated weights for policy 0, policy_version 346815 (0.0007) [2023-12-27 21:43:17,303][106226] Updated weights for policy 0, policy_version 346825 (0.0009) [2023-12-27 21:43:17,456][106225] Updated weights for policy 1, policy_version 347429 (0.0007) [2023-12-27 21:43:17,507][106225] Updated weights for policy 1, policy_version 347439 (0.0007) [2023-12-27 21:43:17,562][106225] Updated weights for policy 1, policy_version 347449 (0.0010) [2023-12-27 21:43:17,969][106226] Updated weights for policy 0, policy_version 346835 (0.0008) [2023-12-27 21:43:18,036][106226] Updated weights for policy 0, policy_version 346845 (0.0006) [2023-12-27 21:43:18,085][106226] Updated weights for policy 0, policy_version 346855 (0.0008) [2023-12-27 21:43:18,199][106225] Updated weights for policy 1, policy_version 347459 (0.0009) [2023-12-27 21:43:18,259][106225] Updated weights for policy 1, policy_version 347469 (0.0005) [2023-12-27 21:43:18,319][106225] Updated weights for policy 1, policy_version 347479 (0.0006) [2023-12-27 21:43:18,894][106226] Updated weights for policy 0, policy_version 346865 (0.0007) [2023-12-27 21:43:18,944][106225] Updated weights for policy 1, policy_version 347489 (0.0008) [2023-12-27 21:43:18,949][106226] Updated weights for policy 0, policy_version 346875 (0.0006) [2023-12-27 21:43:19,001][106225] Updated weights for policy 1, policy_version 347499 (0.0009) [2023-12-27 21:43:19,003][106226] Updated weights for policy 0, policy_version 346885 (0.0008) [2023-12-27 21:43:19,053][106225] Updated weights for policy 1, policy_version 347509 (0.0008) [2023-12-27 21:43:19,063][106226] Updated weights for policy 0, policy_version 346895 (0.0006) [2023-12-27 21:43:19,113][106225] Updated weights for policy 1, policy_version 347519 (0.0008) [2023-12-27 21:43:19,707][106226] Updated weights for policy 0, policy_version 346905 (0.0010) [2023-12-27 21:43:19,765][106226] Updated weights for policy 0, policy_version 346915 (0.0011) [2023-12-27 21:43:19,833][106226] Updated weights for policy 0, policy_version 346925 (0.0009) [2023-12-27 21:43:19,958][106225] Updated weights for policy 1, policy_version 347529 (0.0008) [2023-12-27 21:43:20,030][106225] Updated weights for policy 1, policy_version 347539 (0.0008) [2023-12-27 21:43:20,093][106225] Updated weights for policy 1, policy_version 347549 (0.0006) [2023-12-27 21:43:20,609][106226] Updated weights for policy 0, policy_version 346935 (0.0010) [2023-12-27 21:43:20,668][106226] Updated weights for policy 0, policy_version 346945 (0.0011) [2023-12-27 21:43:20,670][106225] Updated weights for policy 1, policy_version 347559 (0.0007) [2023-12-27 21:43:20,726][106226] Updated weights for policy 0, policy_version 346955 (0.0011) [2023-12-27 21:43:20,733][106225] Updated weights for policy 1, policy_version 347569 (0.0006) [2023-12-27 21:43:20,791][106225] Updated weights for policy 1, policy_version 347579 (0.0009) [2023-12-27 21:43:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 177856512. Throughput: 0: 9826.5, 1: 9904.8. Samples: 177866280. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:21,175][105115] Avg episode reward: [(0, '-4.816'), (1, '-5.963')] [2023-12-27 21:43:21,494][106226] Updated weights for policy 0, policy_version 346965 (0.0011) [2023-12-27 21:43:21,551][106226] Updated weights for policy 0, policy_version 346975 (0.0011) [2023-12-27 21:43:21,584][106225] Updated weights for policy 1, policy_version 347589 (0.0007) [2023-12-27 21:43:21,616][106226] Updated weights for policy 0, policy_version 346985 (0.0010) [2023-12-27 21:43:21,649][106225] Updated weights for policy 1, policy_version 347599 (0.0008) [2023-12-27 21:43:21,719][106225] Updated weights for policy 1, policy_version 347609 (0.0007) [2023-12-27 21:43:22,387][106226] Updated weights for policy 0, policy_version 346995 (0.0009) [2023-12-27 21:43:22,455][106226] Updated weights for policy 0, policy_version 347005 (0.0008) [2023-12-27 21:43:22,472][106225] Updated weights for policy 1, policy_version 347619 (0.0008) [2023-12-27 21:43:22,523][106226] Updated weights for policy 0, policy_version 347015 (0.0010) [2023-12-27 21:43:22,542][106225] Updated weights for policy 1, policy_version 347629 (0.0010) [2023-12-27 21:43:22,604][106225] Updated weights for policy 1, policy_version 347639 (0.0008) [2023-12-27 21:43:23,192][106225] Updated weights for policy 1, policy_version 347649 (0.0006) [2023-12-27 21:43:23,244][106226] Updated weights for policy 0, policy_version 347025 (0.0011) [2023-12-27 21:43:23,248][106225] Updated weights for policy 1, policy_version 347659 (0.0010) [2023-12-27 21:43:23,300][106226] Updated weights for policy 0, policy_version 347035 (0.0009) [2023-12-27 21:43:23,305][106225] Updated weights for policy 1, policy_version 347669 (0.0010) [2023-12-27 21:43:23,356][106226] Updated weights for policy 0, policy_version 347045 (0.0006) [2023-12-27 21:43:23,365][106225] Updated weights for policy 1, policy_version 347679 (0.0009) [2023-12-27 21:43:23,425][106226] Updated weights for policy 0, policy_version 347055 (0.0010) [2023-12-27 21:43:23,991][106226] Updated weights for policy 0, policy_version 347065 (0.0006) [2023-12-27 21:43:23,997][106225] Updated weights for policy 1, policy_version 347689 (0.0008) [2023-12-27 21:43:24,039][106226] Updated weights for policy 0, policy_version 347075 (0.0006) [2023-12-27 21:43:24,054][106225] Updated weights for policy 1, policy_version 347699 (0.0005) [2023-12-27 21:43:24,096][106226] Updated weights for policy 0, policy_version 347085 (0.0008) [2023-12-27 21:43:24,103][106225] Updated weights for policy 1, policy_version 347709 (0.0005) [2023-12-27 21:43:24,771][106226] Updated weights for policy 0, policy_version 347095 (0.0006) [2023-12-27 21:43:24,773][106225] Updated weights for policy 1, policy_version 347719 (0.0007) [2023-12-27 21:43:24,817][106225] Updated weights for policy 1, policy_version 347729 (0.0008) [2023-12-27 21:43:24,822][106226] Updated weights for policy 0, policy_version 347105 (0.0006) [2023-12-27 21:43:24,863][106225] Updated weights for policy 1, policy_version 347739 (0.0005) [2023-12-27 21:43:24,874][106226] Updated weights for policy 0, policy_version 347115 (0.0007) [2023-12-27 21:43:25,538][106225] Updated weights for policy 1, policy_version 347749 (0.0007) [2023-12-27 21:43:25,577][106226] Updated weights for policy 0, policy_version 347125 (0.0007) [2023-12-27 21:43:25,596][106225] Updated weights for policy 1, policy_version 347759 (0.0008) [2023-12-27 21:43:25,635][106226] Updated weights for policy 0, policy_version 347135 (0.0008) [2023-12-27 21:43:25,657][106225] Updated weights for policy 1, policy_version 347769 (0.0008) [2023-12-27 21:43:25,687][106226] Updated weights for policy 0, policy_version 347145 (0.0006) [2023-12-27 21:43:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 177954816. Throughput: 0: 9840.2, 1: 9873.4. Samples: 177925520. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:26,175][105115] Avg episode reward: [(0, '-4.990'), (1, '-5.796')] [2023-12-27 21:43:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000347776_89055232.pth... [2023-12-27 21:43:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000347152_88899584.pth... [2023-12-27 21:43:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000346000_88604672.pth [2023-12-27 21:43:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000346624_88760320.pth [2023-12-27 21:43:26,385][106225] Updated weights for policy 1, policy_version 347779 (0.0008) [2023-12-27 21:43:26,425][106226] Updated weights for policy 0, policy_version 347155 (0.0006) [2023-12-27 21:43:26,435][106225] Updated weights for policy 1, policy_version 347789 (0.0008) [2023-12-27 21:43:26,476][106226] Updated weights for policy 0, policy_version 347165 (0.0007) [2023-12-27 21:43:26,485][106225] Updated weights for policy 1, policy_version 347799 (0.0006) [2023-12-27 21:43:26,527][106226] Updated weights for policy 0, policy_version 347175 (0.0006) [2023-12-27 21:43:27,146][106225] Updated weights for policy 1, policy_version 347809 (0.0009) [2023-12-27 21:43:27,167][106226] Updated weights for policy 0, policy_version 347185 (0.0008) [2023-12-27 21:43:27,205][106225] Updated weights for policy 1, policy_version 347819 (0.0007) [2023-12-27 21:43:27,227][106226] Updated weights for policy 0, policy_version 347195 (0.0007) [2023-12-27 21:43:27,251][106225] Updated weights for policy 1, policy_version 347829 (0.0005) [2023-12-27 21:43:27,299][106225] Updated weights for policy 1, policy_version 347839 (0.0007) [2023-12-27 21:43:27,314][106226] Updated weights for policy 0, policy_version 347205 (0.0005) [2023-12-27 21:43:27,368][106226] Updated weights for policy 0, policy_version 347215 (0.0008) [2023-12-27 21:43:27,932][106225] Updated weights for policy 1, policy_version 347849 (0.0005) [2023-12-27 21:43:27,963][106226] Updated weights for policy 0, policy_version 347225 (0.0006) [2023-12-27 21:43:27,993][106225] Updated weights for policy 1, policy_version 347859 (0.0005) [2023-12-27 21:43:28,029][106226] Updated weights for policy 0, policy_version 347235 (0.0010) [2023-12-27 21:43:28,050][106225] Updated weights for policy 1, policy_version 347869 (0.0006) [2023-12-27 21:43:28,076][106226] Updated weights for policy 0, policy_version 347245 (0.0010) [2023-12-27 21:43:28,627][106225] Updated weights for policy 1, policy_version 347879 (0.0007) [2023-12-27 21:43:28,675][106225] Updated weights for policy 1, policy_version 347889 (0.0007) [2023-12-27 21:43:28,727][106226] Updated weights for policy 0, policy_version 347255 (0.0010) [2023-12-27 21:43:28,735][106225] Updated weights for policy 1, policy_version 347899 (0.0006) [2023-12-27 21:43:28,783][106226] Updated weights for policy 0, policy_version 347265 (0.0010) [2023-12-27 21:43:28,843][106226] Updated weights for policy 0, policy_version 347275 (0.0010) [2023-12-27 21:43:29,336][106225] Updated weights for policy 1, policy_version 347909 (0.0007) [2023-12-27 21:43:29,402][106225] Updated weights for policy 1, policy_version 347919 (0.0009) [2023-12-27 21:43:29,460][106225] Updated weights for policy 1, policy_version 347929 (0.0008) [2023-12-27 21:43:29,534][106226] Updated weights for policy 0, policy_version 347285 (0.0008) [2023-12-27 21:43:29,593][106226] Updated weights for policy 0, policy_version 347295 (0.0006) [2023-12-27 21:43:29,648][106226] Updated weights for policy 0, policy_version 347305 (0.0010) [2023-12-27 21:43:30,082][106225] Updated weights for policy 1, policy_version 347939 (0.0009) [2023-12-27 21:43:30,152][106225] Updated weights for policy 1, policy_version 347949 (0.0008) [2023-12-27 21:43:30,211][106225] Updated weights for policy 1, policy_version 347959 (0.0009) [2023-12-27 21:43:30,365][106226] Updated weights for policy 0, policy_version 347315 (0.0010) [2023-12-27 21:43:30,417][106226] Updated weights for policy 0, policy_version 347325 (0.0007) [2023-12-27 21:43:30,479][106226] Updated weights for policy 0, policy_version 347335 (0.0008) [2023-12-27 21:43:30,862][106225] Updated weights for policy 1, policy_version 347969 (0.0008) [2023-12-27 21:43:30,918][106225] Updated weights for policy 1, policy_version 347979 (0.0007) [2023-12-27 21:43:30,971][106225] Updated weights for policy 1, policy_version 347989 (0.0008) [2023-12-27 21:43:31,027][106225] Updated weights for policy 1, policy_version 347999 (0.0007) [2023-12-27 21:43:31,124][106226] Updated weights for policy 0, policy_version 347345 (0.0009) [2023-12-27 21:43:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 178061312. Throughput: 0: 9904.0, 1: 9976.4. Samples: 178050324. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:31,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-5.741')] [2023-12-27 21:43:31,193][106226] Updated weights for policy 0, policy_version 347355 (0.0011) [2023-12-27 21:43:31,261][106226] Updated weights for policy 0, policy_version 347365 (0.0010) [2023-12-27 21:43:31,327][106226] Updated weights for policy 0, policy_version 347375 (0.0010) [2023-12-27 21:43:31,692][106225] Updated weights for policy 1, policy_version 348009 (0.0007) [2023-12-27 21:43:31,764][106225] Updated weights for policy 1, policy_version 348019 (0.0008) [2023-12-27 21:43:31,827][106225] Updated weights for policy 1, policy_version 348029 (0.0007) [2023-12-27 21:43:32,061][106226] Updated weights for policy 0, policy_version 347385 (0.0008) [2023-12-27 21:43:32,119][106226] Updated weights for policy 0, policy_version 347395 (0.0009) [2023-12-27 21:43:32,179][106226] Updated weights for policy 0, policy_version 347405 (0.0008) [2023-12-27 21:43:32,564][106225] Updated weights for policy 1, policy_version 348039 (0.0007) [2023-12-27 21:43:32,614][106225] Updated weights for policy 1, policy_version 348049 (0.0007) [2023-12-27 21:43:32,671][106225] Updated weights for policy 1, policy_version 348059 (0.0009) [2023-12-27 21:43:32,921][106226] Updated weights for policy 0, policy_version 347415 (0.0009) [2023-12-27 21:43:32,980][106226] Updated weights for policy 0, policy_version 347425 (0.0008) [2023-12-27 21:43:33,036][106226] Updated weights for policy 0, policy_version 347435 (0.0008) [2023-12-27 21:43:33,364][106225] Updated weights for policy 1, policy_version 348069 (0.0008) [2023-12-27 21:43:33,426][106225] Updated weights for policy 1, policy_version 348079 (0.0007) [2023-12-27 21:43:33,476][106225] Updated weights for policy 1, policy_version 348089 (0.0008) [2023-12-27 21:43:33,713][106226] Updated weights for policy 0, policy_version 347445 (0.0010) [2023-12-27 21:43:33,769][106226] Updated weights for policy 0, policy_version 347455 (0.0010) [2023-12-27 21:43:33,820][106226] Updated weights for policy 0, policy_version 347465 (0.0010) [2023-12-27 21:43:34,164][106225] Updated weights for policy 1, policy_version 348099 (0.0008) [2023-12-27 21:43:34,226][106225] Updated weights for policy 1, policy_version 348109 (0.0009) [2023-12-27 21:43:34,287][106225] Updated weights for policy 1, policy_version 348119 (0.0010) [2023-12-27 21:43:34,554][106226] Updated weights for policy 0, policy_version 347475 (0.0009) [2023-12-27 21:43:34,621][106226] Updated weights for policy 0, policy_version 347485 (0.0011) [2023-12-27 21:43:34,677][106226] Updated weights for policy 0, policy_version 347495 (0.0011) [2023-12-27 21:43:35,028][106225] Updated weights for policy 1, policy_version 348129 (0.0008) [2023-12-27 21:43:35,078][106225] Updated weights for policy 1, policy_version 348139 (0.0010) [2023-12-27 21:43:35,124][106225] Updated weights for policy 1, policy_version 348149 (0.0010) [2023-12-27 21:43:35,180][106225] Updated weights for policy 1, policy_version 348159 (0.0010) [2023-12-27 21:43:35,365][106226] Updated weights for policy 0, policy_version 347505 (0.0010) [2023-12-27 21:43:35,412][106226] Updated weights for policy 0, policy_version 347515 (0.0005) [2023-12-27 21:43:35,468][106226] Updated weights for policy 0, policy_version 347525 (0.0005) [2023-12-27 21:43:35,520][106226] Updated weights for policy 0, policy_version 347535 (0.0005) [2023-12-27 21:43:35,922][106225] Updated weights for policy 1, policy_version 348169 (0.0010) [2023-12-27 21:43:35,980][106225] Updated weights for policy 1, policy_version 348179 (0.0010) [2023-12-27 21:43:36,045][106225] Updated weights for policy 1, policy_version 348189 (0.0010) [2023-12-27 21:43:36,053][106226] Updated weights for policy 0, policy_version 347545 (0.0006) [2023-12-27 21:43:36,112][106226] Updated weights for policy 0, policy_version 347555 (0.0008) [2023-12-27 21:43:36,166][106226] Updated weights for policy 0, policy_version 347565 (0.0011) [2023-12-27 21:43:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 178159616. Throughput: 0: 9913.9, 1: 9946.8. Samples: 178171148. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:36,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-5.698')] [2023-12-27 21:43:36,813][106225] Updated weights for policy 1, policy_version 348199 (0.0010) [2023-12-27 21:43:36,835][106226] Updated weights for policy 0, policy_version 347575 (0.0007) [2023-12-27 21:43:36,863][106225] Updated weights for policy 1, policy_version 348209 (0.0010) [2023-12-27 21:43:36,893][106226] Updated weights for policy 0, policy_version 347585 (0.0005) [2023-12-27 21:43:36,910][106225] Updated weights for policy 1, policy_version 348219 (0.0010) [2023-12-27 21:43:36,950][106226] Updated weights for policy 0, policy_version 347595 (0.0005) [2023-12-27 21:43:37,491][106226] Updated weights for policy 0, policy_version 347605 (0.0007) [2023-12-27 21:43:37,555][106226] Updated weights for policy 0, policy_version 347615 (0.0009) [2023-12-27 21:43:37,608][106226] Updated weights for policy 0, policy_version 347625 (0.0010) [2023-12-27 21:43:37,658][106225] Updated weights for policy 1, policy_version 348229 (0.0010) [2023-12-27 21:43:37,718][106225] Updated weights for policy 1, policy_version 348239 (0.0010) [2023-12-27 21:43:37,783][106225] Updated weights for policy 1, policy_version 348249 (0.0010) [2023-12-27 21:43:38,310][106226] Updated weights for policy 0, policy_version 347635 (0.0009) [2023-12-27 21:43:38,391][106226] Updated weights for policy 0, policy_version 347645 (0.0010) [2023-12-27 21:43:38,451][106226] Updated weights for policy 0, policy_version 347655 (0.0006) [2023-12-27 21:43:38,491][106225] Updated weights for policy 1, policy_version 348259 (0.0010) [2023-12-27 21:43:38,552][106225] Updated weights for policy 1, policy_version 348269 (0.0010) [2023-12-27 21:43:38,616][106225] Updated weights for policy 1, policy_version 348279 (0.0010) [2023-12-27 21:43:39,060][106226] Updated weights for policy 0, policy_version 347665 (0.0009) [2023-12-27 21:43:39,123][106226] Updated weights for policy 0, policy_version 347675 (0.0007) [2023-12-27 21:43:39,186][106226] Updated weights for policy 0, policy_version 347685 (0.0007) [2023-12-27 21:43:39,257][106226] Updated weights for policy 0, policy_version 347695 (0.0009) [2023-12-27 21:43:39,341][106225] Updated weights for policy 1, policy_version 348289 (0.0010) [2023-12-27 21:43:39,414][106225] Updated weights for policy 1, policy_version 348299 (0.0008) [2023-12-27 21:43:39,477][106225] Updated weights for policy 1, policy_version 348309 (0.0010) [2023-12-27 21:43:39,546][106225] Updated weights for policy 1, policy_version 348319 (0.0011) [2023-12-27 21:43:40,055][106226] Updated weights for policy 0, policy_version 347705 (0.0006) [2023-12-27 21:43:40,124][106226] Updated weights for policy 0, policy_version 347715 (0.0008) [2023-12-27 21:43:40,194][106226] Updated weights for policy 0, policy_version 347725 (0.0008) [2023-12-27 21:43:40,245][106225] Updated weights for policy 1, policy_version 348329 (0.0011) [2023-12-27 21:43:40,310][106225] Updated weights for policy 1, policy_version 348339 (0.0011) [2023-12-27 21:43:40,377][106225] Updated weights for policy 1, policy_version 348349 (0.0008) [2023-12-27 21:43:40,932][106226] Updated weights for policy 0, policy_version 347735 (0.0008) [2023-12-27 21:43:40,998][106226] Updated weights for policy 0, policy_version 347745 (0.0009) [2023-12-27 21:43:41,063][106225] Updated weights for policy 1, policy_version 348359 (0.0009) [2023-12-27 21:43:41,068][106226] Updated weights for policy 0, policy_version 347755 (0.0008) [2023-12-27 21:43:41,125][106225] Updated weights for policy 1, policy_version 348369 (0.0010) [2023-12-27 21:43:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 178257920. Throughput: 0: 9989.4, 1: 9939.4. Samples: 178231652. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:41,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.710')] [2023-12-27 21:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000347760_89055232.pth... [2023-12-27 21:43:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000346576_88752128.pth [2023-12-27 21:43:41,194][106225] Updated weights for policy 1, policy_version 348379 (0.0008) [2023-12-27 21:43:41,225][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000348384_89210880.pth... [2023-12-27 21:43:41,228][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000347200_88907776.pth [2023-12-27 21:43:41,885][106225] Updated weights for policy 1, policy_version 348389 (0.0010) [2023-12-27 21:43:41,911][106226] Updated weights for policy 0, policy_version 347765 (0.0006) [2023-12-27 21:43:41,943][106225] Updated weights for policy 1, policy_version 348399 (0.0010) [2023-12-27 21:43:41,965][106226] Updated weights for policy 0, policy_version 347775 (0.0006) [2023-12-27 21:43:42,001][106225] Updated weights for policy 1, policy_version 348409 (0.0011) [2023-12-27 21:43:42,023][106226] Updated weights for policy 0, policy_version 347785 (0.0005) [2023-12-27 21:43:42,692][106225] Updated weights for policy 1, policy_version 348419 (0.0010) [2023-12-27 21:43:42,755][106225] Updated weights for policy 1, policy_version 348429 (0.0008) [2023-12-27 21:43:42,785][106226] Updated weights for policy 0, policy_version 347795 (0.0009) [2023-12-27 21:43:42,818][106225] Updated weights for policy 1, policy_version 348439 (0.0006) [2023-12-27 21:43:42,852][106226] Updated weights for policy 0, policy_version 347805 (0.0008) [2023-12-27 21:43:42,900][106226] Updated weights for policy 0, policy_version 347815 (0.0008) [2023-12-27 21:43:43,459][106225] Updated weights for policy 1, policy_version 348449 (0.0006) [2023-12-27 21:43:43,516][106225] Updated weights for policy 1, policy_version 348459 (0.0008) [2023-12-27 21:43:43,578][106225] Updated weights for policy 1, policy_version 348469 (0.0008) [2023-12-27 21:43:43,635][106225] Updated weights for policy 1, policy_version 348479 (0.0008) [2023-12-27 21:43:43,642][106226] Updated weights for policy 0, policy_version 347825 (0.0008) [2023-12-27 21:43:43,704][106226] Updated weights for policy 0, policy_version 347835 (0.0008) [2023-12-27 21:43:43,759][106226] Updated weights for policy 0, policy_version 347845 (0.0008) [2023-12-27 21:43:43,814][106226] Updated weights for policy 0, policy_version 347855 (0.0009) [2023-12-27 21:43:44,353][106225] Updated weights for policy 1, policy_version 348489 (0.0008) [2023-12-27 21:43:44,411][106225] Updated weights for policy 1, policy_version 348499 (0.0008) [2023-12-27 21:43:44,471][106225] Updated weights for policy 1, policy_version 348509 (0.0008) [2023-12-27 21:43:44,530][106226] Updated weights for policy 0, policy_version 347865 (0.0008) [2023-12-27 21:43:44,589][106226] Updated weights for policy 0, policy_version 347875 (0.0009) [2023-12-27 21:43:44,641][106226] Updated weights for policy 0, policy_version 347885 (0.0009) [2023-12-27 21:43:45,210][106225] Updated weights for policy 1, policy_version 348519 (0.0008) [2023-12-27 21:43:45,276][106225] Updated weights for policy 1, policy_version 348529 (0.0008) [2023-12-27 21:43:45,341][106225] Updated weights for policy 1, policy_version 348539 (0.0008) [2023-12-27 21:43:45,401][106226] Updated weights for policy 0, policy_version 347895 (0.0009) [2023-12-27 21:43:45,452][106226] Updated weights for policy 0, policy_version 347905 (0.0011) [2023-12-27 21:43:45,499][106226] Updated weights for policy 0, policy_version 347915 (0.0010) [2023-12-27 21:43:46,079][106225] Updated weights for policy 1, policy_version 348549 (0.0007) [2023-12-27 21:43:46,146][106225] Updated weights for policy 1, policy_version 348559 (0.0008) [2023-12-27 21:43:46,163][106226] Updated weights for policy 0, policy_version 347925 (0.0010) [2023-12-27 21:43:46,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 178348032. Throughput: 0: 9929.9, 1: 9868.2. Samples: 178344840. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:46,176][105115] Avg episode reward: [(0, '-4.832'), (1, '-5.668')] [2023-12-27 21:43:46,207][106225] Updated weights for policy 1, policy_version 348569 (0.0006) [2023-12-27 21:43:46,231][106226] Updated weights for policy 0, policy_version 347935 (0.0011) [2023-12-27 21:43:46,291][106226] Updated weights for policy 0, policy_version 347945 (0.0011) [2023-12-27 21:43:46,863][106226] Updated weights for policy 0, policy_version 347955 (0.0009) [2023-12-27 21:43:46,916][106226] Updated weights for policy 0, policy_version 347965 (0.0010) [2023-12-27 21:43:46,950][106225] Updated weights for policy 1, policy_version 348579 (0.0009) [2023-12-27 21:43:46,963][106226] Updated weights for policy 0, policy_version 347975 (0.0010) [2023-12-27 21:43:46,999][106225] Updated weights for policy 1, policy_version 348589 (0.0010) [2023-12-27 21:43:47,056][106225] Updated weights for policy 1, policy_version 348599 (0.0010) [2023-12-27 21:43:47,615][106226] Updated weights for policy 0, policy_version 347985 (0.0007) [2023-12-27 21:43:47,676][106226] Updated weights for policy 0, policy_version 347995 (0.0007) [2023-12-27 21:43:47,741][106226] Updated weights for policy 0, policy_version 348005 (0.0005) [2023-12-27 21:43:47,764][106225] Updated weights for policy 1, policy_version 348609 (0.0010) [2023-12-27 21:43:47,794][106226] Updated weights for policy 0, policy_version 348015 (0.0005) [2023-12-27 21:43:47,811][106225] Updated weights for policy 1, policy_version 348619 (0.0010) [2023-12-27 21:43:47,859][106225] Updated weights for policy 1, policy_version 348629 (0.0007) [2023-12-27 21:43:47,912][106225] Updated weights for policy 1, policy_version 348639 (0.0010) [2023-12-27 21:43:48,376][106226] Updated weights for policy 0, policy_version 348025 (0.0007) [2023-12-27 21:43:48,441][106226] Updated weights for policy 0, policy_version 348035 (0.0008) [2023-12-27 21:43:48,503][106226] Updated weights for policy 0, policy_version 348045 (0.0008) [2023-12-27 21:43:48,694][106225] Updated weights for policy 1, policy_version 348649 (0.0008) [2023-12-27 21:43:48,757][106225] Updated weights for policy 1, policy_version 348659 (0.0006) [2023-12-27 21:43:48,821][106225] Updated weights for policy 1, policy_version 348669 (0.0007) [2023-12-27 21:43:49,279][106226] Updated weights for policy 0, policy_version 348055 (0.0008) [2023-12-27 21:43:49,357][106226] Updated weights for policy 0, policy_version 348065 (0.0008) [2023-12-27 21:43:49,421][106226] Updated weights for policy 0, policy_version 348075 (0.0009) [2023-12-27 21:43:49,499][106225] Updated weights for policy 1, policy_version 348679 (0.0007) [2023-12-27 21:43:49,568][106225] Updated weights for policy 1, policy_version 348689 (0.0006) [2023-12-27 21:43:49,633][106225] Updated weights for policy 1, policy_version 348699 (0.0007) [2023-12-27 21:43:50,092][106226] Updated weights for policy 0, policy_version 348085 (0.0007) [2023-12-27 21:43:50,152][106226] Updated weights for policy 0, policy_version 348095 (0.0009) [2023-12-27 21:43:50,208][106226] Updated weights for policy 0, policy_version 348105 (0.0009) [2023-12-27 21:43:50,341][106225] Updated weights for policy 1, policy_version 348709 (0.0008) [2023-12-27 21:43:50,405][106225] Updated weights for policy 1, policy_version 348719 (0.0008) [2023-12-27 21:43:50,481][106225] Updated weights for policy 1, policy_version 348729 (0.0009) [2023-12-27 21:43:50,866][106226] Updated weights for policy 0, policy_version 348115 (0.0007) [2023-12-27 21:43:50,924][106226] Updated weights for policy 0, policy_version 348125 (0.0011) [2023-12-27 21:43:50,978][106226] Updated weights for policy 0, policy_version 348135 (0.0011) [2023-12-27 21:43:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 178454528. Throughput: 0: 10021.0, 1: 9791.2. Samples: 178464144. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:51,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-5.668')] [2023-12-27 21:43:51,211][106225] Updated weights for policy 1, policy_version 348739 (0.0009) [2023-12-27 21:43:51,267][106225] Updated weights for policy 1, policy_version 348749 (0.0008) [2023-12-27 21:43:51,329][106225] Updated weights for policy 1, policy_version 348759 (0.0009) [2023-12-27 21:43:51,776][106226] Updated weights for policy 0, policy_version 348145 (0.0010) [2023-12-27 21:43:51,842][106226] Updated weights for policy 0, policy_version 348155 (0.0010) [2023-12-27 21:43:51,903][106226] Updated weights for policy 0, policy_version 348165 (0.0011) [2023-12-27 21:43:51,968][106226] Updated weights for policy 0, policy_version 348175 (0.0011) [2023-12-27 21:43:52,081][106225] Updated weights for policy 1, policy_version 348769 (0.0008) [2023-12-27 21:43:52,144][106225] Updated weights for policy 1, policy_version 348779 (0.0007) [2023-12-27 21:43:52,195][106225] Updated weights for policy 1, policy_version 348789 (0.0005) [2023-12-27 21:43:52,245][106225] Updated weights for policy 1, policy_version 348799 (0.0005) [2023-12-27 21:43:52,625][106226] Updated weights for policy 0, policy_version 348185 (0.0006) [2023-12-27 21:43:52,698][106226] Updated weights for policy 0, policy_version 348195 (0.0006) [2023-12-27 21:43:52,760][106226] Updated weights for policy 0, policy_version 348205 (0.0007) [2023-12-27 21:43:52,844][106225] Updated weights for policy 1, policy_version 348809 (0.0006) [2023-12-27 21:43:52,898][106225] Updated weights for policy 1, policy_version 348819 (0.0006) [2023-12-27 21:43:52,955][106225] Updated weights for policy 1, policy_version 348829 (0.0006) [2023-12-27 21:43:53,412][106226] Updated weights for policy 0, policy_version 348215 (0.0006) [2023-12-27 21:43:53,465][106226] Updated weights for policy 0, policy_version 348225 (0.0006) [2023-12-27 21:43:53,508][106225] Updated weights for policy 1, policy_version 348839 (0.0006) [2023-12-27 21:43:53,521][106226] Updated weights for policy 0, policy_version 348235 (0.0007) [2023-12-27 21:43:53,563][106225] Updated weights for policy 1, policy_version 348849 (0.0005) [2023-12-27 21:43:53,622][106225] Updated weights for policy 1, policy_version 348859 (0.0005) [2023-12-27 21:43:54,069][106226] Updated weights for policy 0, policy_version 348245 (0.0006) [2023-12-27 21:43:54,133][106226] Updated weights for policy 0, policy_version 348255 (0.0006) [2023-12-27 21:43:54,163][106225] Updated weights for policy 1, policy_version 348869 (0.0006) [2023-12-27 21:43:54,183][106226] Updated weights for policy 0, policy_version 348265 (0.0008) [2023-12-27 21:43:54,226][106225] Updated weights for policy 1, policy_version 348879 (0.0006) [2023-12-27 21:43:54,289][106225] Updated weights for policy 1, policy_version 348889 (0.0008) [2023-12-27 21:43:54,834][106226] Updated weights for policy 0, policy_version 348275 (0.0008) [2023-12-27 21:43:54,891][106226] Updated weights for policy 0, policy_version 348285 (0.0009) [2023-12-27 21:43:54,950][106226] Updated weights for policy 0, policy_version 348295 (0.0009) [2023-12-27 21:43:54,987][106225] Updated weights for policy 1, policy_version 348899 (0.0008) [2023-12-27 21:43:55,052][106225] Updated weights for policy 1, policy_version 348909 (0.0009) [2023-12-27 21:43:55,107][106225] Updated weights for policy 1, policy_version 348919 (0.0007) [2023-12-27 21:43:55,619][106226] Updated weights for policy 0, policy_version 348305 (0.0007) [2023-12-27 21:43:55,674][106226] Updated weights for policy 0, policy_version 348315 (0.0006) [2023-12-27 21:43:55,734][106225] Updated weights for policy 1, policy_version 348929 (0.0005) [2023-12-27 21:43:55,737][106226] Updated weights for policy 0, policy_version 348325 (0.0008) [2023-12-27 21:43:55,803][106226] Updated weights for policy 0, policy_version 348335 (0.0007) [2023-12-27 21:43:55,805][106225] Updated weights for policy 1, policy_version 348940 (0.0010) [2023-12-27 21:43:55,865][106225] Updated weights for policy 1, policy_version 348950 (0.0007) [2023-12-27 21:43:55,916][106225] Updated weights for policy 1, policy_version 348960 (0.0007) [2023-12-27 21:43:56,175][105115] Fps is (10 sec: 21299.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 178561024. Throughput: 0: 10021.4, 1: 9885.5. Samples: 178527016. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:43:56,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-5.713')] [2023-12-27 21:43:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000348960_89358336.pth... [2023-12-27 21:43:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000348336_89202688.pth... [2023-12-27 21:43:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000347152_88899584.pth [2023-12-27 21:43:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000347776_89055232.pth [2023-12-27 21:43:56,507][106226] Updated weights for policy 0, policy_version 348345 (0.0005) [2023-12-27 21:43:56,567][106226] Updated weights for policy 0, policy_version 348355 (0.0006) [2023-12-27 21:43:56,613][106225] Updated weights for policy 1, policy_version 348970 (0.0009) [2023-12-27 21:43:56,619][106226] Updated weights for policy 0, policy_version 348365 (0.0005) [2023-12-27 21:43:56,674][106225] Updated weights for policy 1, policy_version 348980 (0.0008) [2023-12-27 21:43:56,738][106225] Updated weights for policy 1, policy_version 348990 (0.0007) [2023-12-27 21:43:57,253][106226] Updated weights for policy 0, policy_version 348375 (0.0009) [2023-12-27 21:43:57,313][106226] Updated weights for policy 0, policy_version 348385 (0.0010) [2023-12-27 21:43:57,338][106225] Updated weights for policy 1, policy_version 349000 (0.0006) [2023-12-27 21:43:57,372][106226] Updated weights for policy 0, policy_version 348395 (0.0010) [2023-12-27 21:43:57,388][106225] Updated weights for policy 1, policy_version 349010 (0.0008) [2023-12-27 21:43:57,440][106225] Updated weights for policy 1, policy_version 349020 (0.0007) [2023-12-27 21:43:58,011][106225] Updated weights for policy 1, policy_version 349030 (0.0006) [2023-12-27 21:43:58,021][106226] Updated weights for policy 0, policy_version 348405 (0.0010) [2023-12-27 21:43:58,065][106225] Updated weights for policy 1, policy_version 349040 (0.0006) [2023-12-27 21:43:58,074][106226] Updated weights for policy 0, policy_version 348415 (0.0010) [2023-12-27 21:43:58,118][106225] Updated weights for policy 1, policy_version 349050 (0.0006) [2023-12-27 21:43:58,124][106226] Updated weights for policy 0, policy_version 348425 (0.0010) [2023-12-27 21:43:58,838][106226] Updated weights for policy 0, policy_version 348435 (0.0009) [2023-12-27 21:43:58,904][106226] Updated weights for policy 0, policy_version 348445 (0.0007) [2023-12-27 21:43:58,969][106226] Updated weights for policy 0, policy_version 348455 (0.0006) [2023-12-27 21:43:58,994][106225] Updated weights for policy 1, policy_version 349060 (0.0007) [2023-12-27 21:43:59,084][106225] Updated weights for policy 1, policy_version 349070 (0.0007) [2023-12-27 21:43:59,140][106225] Updated weights for policy 1, policy_version 349080 (0.0008) [2023-12-27 21:43:59,637][106226] Updated weights for policy 0, policy_version 348465 (0.0008) [2023-12-27 21:43:59,702][106226] Updated weights for policy 0, policy_version 348475 (0.0006) [2023-12-27 21:43:59,761][106226] Updated weights for policy 0, policy_version 348485 (0.0008) [2023-12-27 21:43:59,815][106226] Updated weights for policy 0, policy_version 348495 (0.0007) [2023-12-27 21:43:59,871][106225] Updated weights for policy 1, policy_version 349090 (0.0008) [2023-12-27 21:43:59,934][106225] Updated weights for policy 1, policy_version 349100 (0.0007) [2023-12-27 21:43:59,990][106225] Updated weights for policy 1, policy_version 349110 (0.0008) [2023-12-27 21:44:00,045][106225] Updated weights for policy 1, policy_version 349120 (0.0008) [2023-12-27 21:44:00,517][106226] Updated weights for policy 0, policy_version 348505 (0.0009) [2023-12-27 21:44:00,574][106226] Updated weights for policy 0, policy_version 348515 (0.0007) [2023-12-27 21:44:00,628][106226] Updated weights for policy 0, policy_version 348525 (0.0005) [2023-12-27 21:44:00,788][106225] Updated weights for policy 1, policy_version 349130 (0.0005) [2023-12-27 21:44:00,839][106225] Updated weights for policy 1, policy_version 349140 (0.0005) [2023-12-27 21:44:00,889][106225] Updated weights for policy 1, policy_version 349150 (0.0005) [2023-12-27 21:44:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 178659328. Throughput: 0: 10055.8, 1: 10027.1. Samples: 178649220. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:01,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.497')] [2023-12-27 21:44:01,261][106226] Updated weights for policy 0, policy_version 348535 (0.0008) [2023-12-27 21:44:01,323][106226] Updated weights for policy 0, policy_version 348545 (0.0008) [2023-12-27 21:44:01,397][106226] Updated weights for policy 0, policy_version 348555 (0.0008) [2023-12-27 21:44:01,493][106225] Updated weights for policy 1, policy_version 349160 (0.0007) [2023-12-27 21:44:01,552][106225] Updated weights for policy 1, policy_version 349170 (0.0007) [2023-12-27 21:44:01,609][106225] Updated weights for policy 1, policy_version 349180 (0.0007) [2023-12-27 21:44:02,169][106226] Updated weights for policy 0, policy_version 348565 (0.0008) [2023-12-27 21:44:02,236][106226] Updated weights for policy 0, policy_version 348575 (0.0008) [2023-12-27 21:44:02,302][106226] Updated weights for policy 0, policy_version 348585 (0.0008) [2023-12-27 21:44:02,305][106225] Updated weights for policy 1, policy_version 349190 (0.0008) [2023-12-27 21:44:02,376][106225] Updated weights for policy 1, policy_version 349200 (0.0007) [2023-12-27 21:44:02,431][106225] Updated weights for policy 1, policy_version 349210 (0.0005) [2023-12-27 21:44:03,002][106225] Updated weights for policy 1, policy_version 349220 (0.0007) [2023-12-27 21:44:03,032][106226] Updated weights for policy 0, policy_version 348595 (0.0008) [2023-12-27 21:44:03,055][106225] Updated weights for policy 1, policy_version 349230 (0.0007) [2023-12-27 21:44:03,091][106226] Updated weights for policy 0, policy_version 348605 (0.0007) [2023-12-27 21:44:03,116][106225] Updated weights for policy 1, policy_version 349240 (0.0007) [2023-12-27 21:44:03,152][106226] Updated weights for policy 0, policy_version 348615 (0.0008) [2023-12-27 21:44:03,702][106225] Updated weights for policy 1, policy_version 349250 (0.0006) [2023-12-27 21:44:03,767][106225] Updated weights for policy 1, policy_version 349260 (0.0005) [2023-12-27 21:44:03,831][106225] Updated weights for policy 1, policy_version 349270 (0.0006) [2023-12-27 21:44:03,901][106225] Updated weights for policy 1, policy_version 349280 (0.0009) [2023-12-27 21:44:03,955][106226] Updated weights for policy 0, policy_version 348625 (0.0009) [2023-12-27 21:44:04,023][106226] Updated weights for policy 0, policy_version 348635 (0.0010) [2023-12-27 21:44:04,079][106226] Updated weights for policy 0, policy_version 348645 (0.0008) [2023-12-27 21:44:04,133][106226] Updated weights for policy 0, policy_version 348655 (0.0009) [2023-12-27 21:44:04,480][106225] Updated weights for policy 1, policy_version 349290 (0.0005) [2023-12-27 21:44:04,528][106225] Updated weights for policy 1, policy_version 349300 (0.0005) [2023-12-27 21:44:04,596][106225] Updated weights for policy 1, policy_version 349310 (0.0005) [2023-12-27 21:44:04,874][106226] Updated weights for policy 0, policy_version 348665 (0.0008) [2023-12-27 21:44:04,920][106226] Updated weights for policy 0, policy_version 348675 (0.0008) [2023-12-27 21:44:04,973][106226] Updated weights for policy 0, policy_version 348685 (0.0010) [2023-12-27 21:44:05,173][106225] Updated weights for policy 1, policy_version 349321 (0.0009) [2023-12-27 21:44:05,226][106225] Updated weights for policy 1, policy_version 349331 (0.0009) [2023-12-27 21:44:05,292][106225] Updated weights for policy 1, policy_version 349341 (0.0009) [2023-12-27 21:44:05,654][106226] Updated weights for policy 0, policy_version 348695 (0.0010) [2023-12-27 21:44:05,704][106226] Updated weights for policy 0, policy_version 348705 (0.0010) [2023-12-27 21:44:05,756][106226] Updated weights for policy 0, policy_version 348715 (0.0010) [2023-12-27 21:44:05,961][106225] Updated weights for policy 1, policy_version 349351 (0.0009) [2023-12-27 21:44:06,023][106225] Updated weights for policy 1, policy_version 349361 (0.0009) [2023-12-27 21:44:06,078][106225] Updated weights for policy 1, policy_version 349371 (0.0009) [2023-12-27 21:44:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 178765824. Throughput: 0: 10005.7, 1: 10100.0. Samples: 178771036. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:06,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.654')] [2023-12-27 21:44:06,402][106226] Updated weights for policy 0, policy_version 348725 (0.0010) [2023-12-27 21:44:06,450][106226] Updated weights for policy 0, policy_version 348735 (0.0007) [2023-12-27 21:44:06,508][106226] Updated weights for policy 0, policy_version 348745 (0.0006) [2023-12-27 21:44:06,900][106225] Updated weights for policy 1, policy_version 349381 (0.0008) [2023-12-27 21:44:06,946][106225] Updated weights for policy 1, policy_version 349391 (0.0007) [2023-12-27 21:44:06,992][106225] Updated weights for policy 1, policy_version 349401 (0.0007) [2023-12-27 21:44:07,216][106226] Updated weights for policy 0, policy_version 348755 (0.0010) [2023-12-27 21:44:07,276][106226] Updated weights for policy 0, policy_version 348765 (0.0010) [2023-12-27 21:44:07,334][106226] Updated weights for policy 0, policy_version 348775 (0.0011) [2023-12-27 21:44:07,753][106225] Updated weights for policy 1, policy_version 349411 (0.0008) [2023-12-27 21:44:07,810][106225] Updated weights for policy 1, policy_version 349421 (0.0009) [2023-12-27 21:44:07,859][106225] Updated weights for policy 1, policy_version 349431 (0.0009) [2023-12-27 21:44:07,968][106226] Updated weights for policy 0, policy_version 348785 (0.0010) [2023-12-27 21:44:08,019][106226] Updated weights for policy 0, policy_version 348795 (0.0008) [2023-12-27 21:44:08,077][106226] Updated weights for policy 0, policy_version 348805 (0.0008) [2023-12-27 21:44:08,140][106226] Updated weights for policy 0, policy_version 348815 (0.0009) [2023-12-27 21:44:08,599][106225] Updated weights for policy 1, policy_version 349441 (0.0007) [2023-12-27 21:44:08,658][106225] Updated weights for policy 1, policy_version 349451 (0.0008) [2023-12-27 21:44:08,714][106225] Updated weights for policy 1, policy_version 349461 (0.0008) [2023-12-27 21:44:08,768][106225] Updated weights for policy 1, policy_version 349471 (0.0008) [2023-12-27 21:44:08,873][106226] Updated weights for policy 0, policy_version 348825 (0.0005) [2023-12-27 21:44:08,935][106226] Updated weights for policy 0, policy_version 348835 (0.0009) [2023-12-27 21:44:08,996][106226] Updated weights for policy 0, policy_version 348845 (0.0005) [2023-12-27 21:44:09,445][106225] Updated weights for policy 1, policy_version 349481 (0.0008) [2023-12-27 21:44:09,509][106225] Updated weights for policy 1, policy_version 349491 (0.0009) [2023-12-27 21:44:09,565][106225] Updated weights for policy 1, policy_version 349501 (0.0009) [2023-12-27 21:44:09,654][106226] Updated weights for policy 0, policy_version 348855 (0.0007) [2023-12-27 21:44:09,721][106226] Updated weights for policy 0, policy_version 348865 (0.0009) [2023-12-27 21:44:09,781][106226] Updated weights for policy 0, policy_version 348875 (0.0009) [2023-12-27 21:44:10,330][106225] Updated weights for policy 1, policy_version 349511 (0.0008) [2023-12-27 21:44:10,389][106225] Updated weights for policy 1, policy_version 349521 (0.0008) [2023-12-27 21:44:10,449][106225] Updated weights for policy 1, policy_version 349531 (0.0008) [2023-12-27 21:44:10,514][106226] Updated weights for policy 0, policy_version 348885 (0.0006) [2023-12-27 21:44:10,568][106226] Updated weights for policy 0, policy_version 348895 (0.0006) [2023-12-27 21:44:10,623][106226] Updated weights for policy 0, policy_version 348905 (0.0005) [2023-12-27 21:44:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 178855936. Throughput: 0: 10023.3, 1: 10078.5. Samples: 178830100. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:11,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.575')] [2023-12-27 21:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000349536_89505792.pth... [2023-12-27 21:44:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000348912_89350144.pth... [2023-12-27 21:44:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000348384_89210880.pth [2023-12-27 21:44:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000347760_89055232.pth [2023-12-27 21:44:11,260][106225] Updated weights for policy 1, policy_version 349541 (0.0007) [2023-12-27 21:44:11,318][106225] Updated weights for policy 1, policy_version 349551 (0.0008) [2023-12-27 21:44:11,321][106226] Updated weights for policy 0, policy_version 348915 (0.0007) [2023-12-27 21:44:11,385][106225] Updated weights for policy 1, policy_version 349561 (0.0008) [2023-12-27 21:44:11,408][106226] Updated weights for policy 0, policy_version 348925 (0.0007) [2023-12-27 21:44:11,471][106226] Updated weights for policy 0, policy_version 348935 (0.0008) [2023-12-27 21:44:12,158][106225] Updated weights for policy 1, policy_version 349571 (0.0008) [2023-12-27 21:44:12,197][106226] Updated weights for policy 0, policy_version 348945 (0.0007) [2023-12-27 21:44:12,216][106225] Updated weights for policy 1, policy_version 349581 (0.0007) [2023-12-27 21:44:12,257][106226] Updated weights for policy 0, policy_version 348955 (0.0007) [2023-12-27 21:44:12,275][106225] Updated weights for policy 1, policy_version 349591 (0.0007) [2023-12-27 21:44:12,319][106226] Updated weights for policy 0, policy_version 348965 (0.0006) [2023-12-27 21:44:12,389][106226] Updated weights for policy 0, policy_version 348975 (0.0009) [2023-12-27 21:44:12,990][106225] Updated weights for policy 1, policy_version 349601 (0.0008) [2023-12-27 21:44:13,046][106225] Updated weights for policy 1, policy_version 349611 (0.0008) [2023-12-27 21:44:13,098][106225] Updated weights for policy 1, policy_version 349621 (0.0007) [2023-12-27 21:44:13,129][106226] Updated weights for policy 0, policy_version 348985 (0.0006) [2023-12-27 21:44:13,162][106225] Updated weights for policy 1, policy_version 349631 (0.0005) [2023-12-27 21:44:13,190][106226] Updated weights for policy 0, policy_version 348995 (0.0009) [2023-12-27 21:44:13,255][106226] Updated weights for policy 0, policy_version 349005 (0.0009) [2023-12-27 21:44:13,828][106225] Updated weights for policy 1, policy_version 349641 (0.0008) [2023-12-27 21:44:13,875][106225] Updated weights for policy 1, policy_version 349651 (0.0008) [2023-12-27 21:44:13,937][106225] Updated weights for policy 1, policy_version 349661 (0.0007) [2023-12-27 21:44:13,957][106226] Updated weights for policy 0, policy_version 349015 (0.0011) [2023-12-27 21:44:14,016][106226] Updated weights for policy 0, policy_version 349025 (0.0008) [2023-12-27 21:44:14,082][106226] Updated weights for policy 0, policy_version 349035 (0.0007) [2023-12-27 21:44:14,624][106225] Updated weights for policy 1, policy_version 349671 (0.0010) [2023-12-27 21:44:14,686][106226] Updated weights for policy 0, policy_version 349045 (0.0008) [2023-12-27 21:44:14,688][106225] Updated weights for policy 1, policy_version 349681 (0.0006) [2023-12-27 21:44:14,743][106226] Updated weights for policy 0, policy_version 349055 (0.0009) [2023-12-27 21:44:14,748][106225] Updated weights for policy 1, policy_version 349691 (0.0009) [2023-12-27 21:44:14,807][106226] Updated weights for policy 0, policy_version 349065 (0.0008) [2023-12-27 21:44:15,405][106225] Updated weights for policy 1, policy_version 349701 (0.0009) [2023-12-27 21:44:15,471][106225] Updated weights for policy 1, policy_version 349711 (0.0008) [2023-12-27 21:44:15,516][106226] Updated weights for policy 0, policy_version 349075 (0.0010) [2023-12-27 21:44:15,525][106225] Updated weights for policy 1, policy_version 349721 (0.0010) [2023-12-27 21:44:15,573][106226] Updated weights for policy 0, policy_version 349085 (0.0011) [2023-12-27 21:44:15,627][106226] Updated weights for policy 0, policy_version 349095 (0.0010) [2023-12-27 21:44:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 178954240. Throughput: 0: 9978.0, 1: 9943.3. Samples: 178946784. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:16,176][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.716')] [2023-12-27 21:44:16,228][106225] Updated weights for policy 1, policy_version 349731 (0.0010) [2023-12-27 21:44:16,289][106225] Updated weights for policy 1, policy_version 349741 (0.0007) [2023-12-27 21:44:16,318][106226] Updated weights for policy 0, policy_version 349105 (0.0010) [2023-12-27 21:44:16,347][106225] Updated weights for policy 1, policy_version 349751 (0.0008) [2023-12-27 21:44:16,372][106226] Updated weights for policy 0, policy_version 349115 (0.0006) [2023-12-27 21:44:16,436][106226] Updated weights for policy 0, policy_version 349125 (0.0006) [2023-12-27 21:44:16,502][106226] Updated weights for policy 0, policy_version 349135 (0.0007) [2023-12-27 21:44:17,028][106225] Updated weights for policy 1, policy_version 349761 (0.0005) [2023-12-27 21:44:17,041][106226] Updated weights for policy 0, policy_version 349145 (0.0006) [2023-12-27 21:44:17,090][106225] Updated weights for policy 1, policy_version 349771 (0.0008) [2023-12-27 21:44:17,101][106226] Updated weights for policy 0, policy_version 349155 (0.0007) [2023-12-27 21:44:17,153][106225] Updated weights for policy 1, policy_version 349781 (0.0010) [2023-12-27 21:44:17,159][106226] Updated weights for policy 0, policy_version 349165 (0.0006) [2023-12-27 21:44:17,210][106225] Updated weights for policy 1, policy_version 349791 (0.0010) [2023-12-27 21:44:17,769][106226] Updated weights for policy 0, policy_version 349175 (0.0008) [2023-12-27 21:44:17,777][106225] Updated weights for policy 1, policy_version 349801 (0.0007) [2023-12-27 21:44:17,822][106226] Updated weights for policy 0, policy_version 349186 (0.0009) [2023-12-27 21:44:17,834][106225] Updated weights for policy 1, policy_version 349811 (0.0008) [2023-12-27 21:44:17,869][106226] Updated weights for policy 0, policy_version 349196 (0.0005) [2023-12-27 21:44:17,892][106225] Updated weights for policy 1, policy_version 349821 (0.0008) [2023-12-27 21:44:18,494][106226] Updated weights for policy 0, policy_version 349206 (0.0007) [2023-12-27 21:44:18,548][106226] Updated weights for policy 0, policy_version 349216 (0.0008) [2023-12-27 21:44:18,582][106225] Updated weights for policy 1, policy_version 349831 (0.0009) [2023-12-27 21:44:18,600][106226] Updated weights for policy 0, policy_version 349226 (0.0008) [2023-12-27 21:44:18,640][106225] Updated weights for policy 1, policy_version 349841 (0.0010) [2023-12-27 21:44:18,702][106225] Updated weights for policy 1, policy_version 349851 (0.0010) [2023-12-27 21:44:19,280][106226] Updated weights for policy 0, policy_version 349236 (0.0008) [2023-12-27 21:44:19,346][106226] Updated weights for policy 0, policy_version 349246 (0.0008) [2023-12-27 21:44:19,418][106226] Updated weights for policy 0, policy_version 349256 (0.0008) [2023-12-27 21:44:19,447][106225] Updated weights for policy 1, policy_version 349861 (0.0010) [2023-12-27 21:44:19,509][106225] Updated weights for policy 1, policy_version 349871 (0.0009) [2023-12-27 21:44:19,577][106225] Updated weights for policy 1, policy_version 349881 (0.0010) [2023-12-27 21:44:20,134][106226] Updated weights for policy 0, policy_version 349266 (0.0008) [2023-12-27 21:44:20,196][106226] Updated weights for policy 0, policy_version 349276 (0.0007) [2023-12-27 21:44:20,221][106225] Updated weights for policy 1, policy_version 349891 (0.0010) [2023-12-27 21:44:20,261][106226] Updated weights for policy 0, policy_version 349286 (0.0009) [2023-12-27 21:44:20,279][106225] Updated weights for policy 1, policy_version 349901 (0.0010) [2023-12-27 21:44:20,328][106226] Updated weights for policy 0, policy_version 349296 (0.0006) [2023-12-27 21:44:20,343][106225] Updated weights for policy 1, policy_version 349911 (0.0010) [2023-12-27 21:44:21,046][106226] Updated weights for policy 0, policy_version 349306 (0.0010) [2023-12-27 21:44:21,089][106225] Updated weights for policy 1, policy_version 349921 (0.0010) [2023-12-27 21:44:21,118][106226] Updated weights for policy 0, policy_version 349316 (0.0008) [2023-12-27 21:44:21,154][106225] Updated weights for policy 1, policy_version 349931 (0.0007) [2023-12-27 21:44:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 179052544. Throughput: 0: 10011.1, 1: 9954.8. Samples: 179069612. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:21,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-5.698')] [2023-12-27 21:44:21,187][106226] Updated weights for policy 0, policy_version 349326 (0.0009) [2023-12-27 21:44:21,220][106225] Updated weights for policy 1, policy_version 349941 (0.0009) [2023-12-27 21:44:21,289][106225] Updated weights for policy 1, policy_version 349951 (0.0008) [2023-12-27 21:44:21,955][106226] Updated weights for policy 0, policy_version 349336 (0.0008) [2023-12-27 21:44:22,022][106226] Updated weights for policy 0, policy_version 349346 (0.0007) [2023-12-27 21:44:22,087][106226] Updated weights for policy 0, policy_version 349356 (0.0008) [2023-12-27 21:44:22,090][106225] Updated weights for policy 1, policy_version 349961 (0.0007) [2023-12-27 21:44:22,156][106225] Updated weights for policy 1, policy_version 349971 (0.0009) [2023-12-27 21:44:22,219][106225] Updated weights for policy 1, policy_version 349981 (0.0008) [2023-12-27 21:44:22,768][106226] Updated weights for policy 0, policy_version 349366 (0.0006) [2023-12-27 21:44:22,837][106226] Updated weights for policy 0, policy_version 349376 (0.0010) [2023-12-27 21:44:22,901][106226] Updated weights for policy 0, policy_version 349386 (0.0008) [2023-12-27 21:44:22,950][106225] Updated weights for policy 1, policy_version 349991 (0.0008) [2023-12-27 21:44:23,009][106225] Updated weights for policy 1, policy_version 350001 (0.0007) [2023-12-27 21:44:23,068][106225] Updated weights for policy 1, policy_version 350011 (0.0008) [2023-12-27 21:44:23,555][106226] Updated weights for policy 0, policy_version 349396 (0.0009) [2023-12-27 21:44:23,610][106226] Updated weights for policy 0, policy_version 349406 (0.0008) [2023-12-27 21:44:23,676][106226] Updated weights for policy 0, policy_version 349416 (0.0009) [2023-12-27 21:44:23,740][106225] Updated weights for policy 1, policy_version 350021 (0.0007) [2023-12-27 21:44:23,791][106225] Updated weights for policy 1, policy_version 350031 (0.0008) [2023-12-27 21:44:23,856][106225] Updated weights for policy 1, policy_version 350041 (0.0008) [2023-12-27 21:44:24,368][106226] Updated weights for policy 0, policy_version 349426 (0.0011) [2023-12-27 21:44:24,424][106226] Updated weights for policy 0, policy_version 349436 (0.0010) [2023-12-27 21:44:24,470][106225] Updated weights for policy 1, policy_version 350051 (0.0007) [2023-12-27 21:44:24,476][106226] Updated weights for policy 0, policy_version 349446 (0.0010) [2023-12-27 21:44:24,527][106225] Updated weights for policy 1, policy_version 350061 (0.0009) [2023-12-27 21:44:24,536][106226] Updated weights for policy 0, policy_version 349456 (0.0011) [2023-12-27 21:44:24,578][106225] Updated weights for policy 1, policy_version 350071 (0.0007) [2023-12-27 21:44:25,162][106226] Updated weights for policy 0, policy_version 349466 (0.0005) [2023-12-27 21:44:25,169][106225] Updated weights for policy 1, policy_version 350081 (0.0008) [2023-12-27 21:44:25,215][106226] Updated weights for policy 0, policy_version 349476 (0.0005) [2023-12-27 21:44:25,222][106225] Updated weights for policy 1, policy_version 350091 (0.0010) [2023-12-27 21:44:25,264][106226] Updated weights for policy 0, policy_version 349486 (0.0006) [2023-12-27 21:44:25,276][106225] Updated weights for policy 1, policy_version 350101 (0.0005) [2023-12-27 21:44:25,326][106225] Updated weights for policy 1, policy_version 350111 (0.0005) [2023-12-27 21:44:25,874][106226] Updated weights for policy 0, policy_version 349496 (0.0010) [2023-12-27 21:44:25,939][106226] Updated weights for policy 0, policy_version 349506 (0.0011) [2023-12-27 21:44:25,943][106225] Updated weights for policy 1, policy_version 350121 (0.0009) [2023-12-27 21:44:25,994][106225] Updated weights for policy 1, policy_version 350131 (0.0007) [2023-12-27 21:44:26,008][106226] Updated weights for policy 0, policy_version 349516 (0.0011) [2023-12-27 21:44:26,052][106225] Updated weights for policy 1, policy_version 350141 (0.0007) [2023-12-27 21:44:26,175][105115] Fps is (10 sec: 21299.5, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 179167232. Throughput: 0: 9942.4, 1: 9951.6. Samples: 179126884. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:26,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-5.604')] [2023-12-27 21:44:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000349520_89505792.pth... [2023-12-27 21:44:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000350144_89661440.pth... [2023-12-27 21:44:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000348960_89358336.pth [2023-12-27 21:44:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000348336_89202688.pth [2023-12-27 21:44:26,671][106226] Updated weights for policy 0, policy_version 349526 (0.0011) [2023-12-27 21:44:26,734][106226] Updated weights for policy 0, policy_version 349536 (0.0010) [2023-12-27 21:44:26,738][106225] Updated weights for policy 1, policy_version 350151 (0.0006) [2023-12-27 21:44:26,791][106226] Updated weights for policy 0, policy_version 349546 (0.0008) [2023-12-27 21:44:26,799][106225] Updated weights for policy 1, policy_version 350161 (0.0005) [2023-12-27 21:44:26,850][106225] Updated weights for policy 1, policy_version 350171 (0.0005) [2023-12-27 21:44:27,445][106225] Updated weights for policy 1, policy_version 350181 (0.0005) [2023-12-27 21:44:27,452][106226] Updated weights for policy 0, policy_version 349556 (0.0005) [2023-12-27 21:44:27,498][106225] Updated weights for policy 1, policy_version 350191 (0.0010) [2023-12-27 21:44:27,515][106226] Updated weights for policy 0, policy_version 349566 (0.0006) [2023-12-27 21:44:27,551][106225] Updated weights for policy 1, policy_version 350201 (0.0010) [2023-12-27 21:44:27,576][106226] Updated weights for policy 0, policy_version 349576 (0.0005) [2023-12-27 21:44:28,118][106226] Updated weights for policy 0, policy_version 349586 (0.0006) [2023-12-27 21:44:28,141][106225] Updated weights for policy 1, policy_version 350211 (0.0006) [2023-12-27 21:44:28,164][106226] Updated weights for policy 0, policy_version 349596 (0.0010) [2023-12-27 21:44:28,205][106225] Updated weights for policy 1, policy_version 350221 (0.0005) [2023-12-27 21:44:28,216][106226] Updated weights for policy 0, policy_version 349606 (0.0010) [2023-12-27 21:44:28,226][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000008 [2023-12-27 21:44:28,264][106225] Updated weights for policy 1, policy_version 350231 (0.0005) [2023-12-27 21:44:28,904][106225] Updated weights for policy 1, policy_version 350241 (0.0008) [2023-12-27 21:44:28,958][106225] Updated weights for policy 1, policy_version 350251 (0.0005) [2023-12-27 21:44:28,975][106226] Updated weights for policy 0, policy_version 349616 (0.0009) [2023-12-27 21:44:29,011][106225] Updated weights for policy 1, policy_version 350261 (0.0005) [2023-12-27 21:44:29,030][106226] Updated weights for policy 0, policy_version 349626 (0.0010) [2023-12-27 21:44:29,057][106225] Updated weights for policy 1, policy_version 350271 (0.0005) [2023-12-27 21:44:29,090][106226] Updated weights for policy 0, policy_version 349636 (0.0010) [2023-12-27 21:44:29,705][106225] Updated weights for policy 1, policy_version 350281 (0.0010) [2023-12-27 21:44:29,768][106225] Updated weights for policy 1, policy_version 350291 (0.0010) [2023-12-27 21:44:29,779][106226] Updated weights for policy 0, policy_version 349646 (0.0007) [2023-12-27 21:44:29,827][106225] Updated weights for policy 1, policy_version 350301 (0.0010) [2023-12-27 21:44:29,836][106226] Updated weights for policy 0, policy_version 349656 (0.0007) [2023-12-27 21:44:29,905][106226] Updated weights for policy 0, policy_version 349666 (0.0009) [2023-12-27 21:44:30,542][106225] Updated weights for policy 1, policy_version 350311 (0.0010) [2023-12-27 21:44:30,594][106225] Updated weights for policy 1, policy_version 350321 (0.0010) [2023-12-27 21:44:30,620][106226] Updated weights for policy 0, policy_version 349676 (0.0009) [2023-12-27 21:44:30,652][106225] Updated weights for policy 1, policy_version 350331 (0.0010) [2023-12-27 21:44:30,673][106226] Updated weights for policy 0, policy_version 349686 (0.0007) [2023-12-27 21:44:30,726][106226] Updated weights for policy 0, policy_version 349696 (0.0008) [2023-12-27 21:44:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 179265536. Throughput: 0: 10143.3, 1: 10116.1. Samples: 179256512. Policy #0 lag: (min: 11.0, avg: 22.4, max: 43.0) [2023-12-27 21:44:31,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-5.689')] [2023-12-27 21:44:31,362][106225] Updated weights for policy 1, policy_version 350341 (0.0012) [2023-12-27 21:44:31,425][106225] Updated weights for policy 1, policy_version 350351 (0.0008) [2023-12-27 21:44:31,481][106226] Updated weights for policy 0, policy_version 349706 (0.0008) [2023-12-27 21:44:31,486][106225] Updated weights for policy 1, policy_version 350361 (0.0005) [2023-12-27 21:44:31,548][106226] Updated weights for policy 0, policy_version 349716 (0.0006) [2023-12-27 21:44:31,603][106226] Updated weights for policy 0, policy_version 349726 (0.0006) [2023-12-27 21:44:31,675][106226] Updated weights for policy 0, policy_version 349736 (0.0007) [2023-12-27 21:44:32,139][106225] Updated weights for policy 1, policy_version 350371 (0.0010) [2023-12-27 21:44:32,199][106225] Updated weights for policy 1, policy_version 350381 (0.0010) [2023-12-27 21:44:32,266][106225] Updated weights for policy 1, policy_version 350391 (0.0008) [2023-12-27 21:44:32,397][106226] Updated weights for policy 0, policy_version 349746 (0.0008) [2023-12-27 21:44:32,454][106226] Updated weights for policy 0, policy_version 349756 (0.0007) [2023-12-27 21:44:32,508][106226] Updated weights for policy 0, policy_version 349766 (0.0005) [2023-12-27 21:44:32,931][106225] Updated weights for policy 1, policy_version 350401 (0.0010) [2023-12-27 21:44:32,991][106225] Updated weights for policy 1, policy_version 350411 (0.0010) [2023-12-27 21:44:33,049][106225] Updated weights for policy 1, policy_version 350421 (0.0007) [2023-12-27 21:44:33,105][106225] Updated weights for policy 1, policy_version 350431 (0.0007) [2023-12-27 21:44:33,179][106226] Updated weights for policy 0, policy_version 349776 (0.0007) [2023-12-27 21:44:33,233][106226] Updated weights for policy 0, policy_version 349786 (0.0008) [2023-12-27 21:44:33,282][106226] Updated weights for policy 0, policy_version 349796 (0.0007) [2023-12-27 21:44:33,765][106225] Updated weights for policy 1, policy_version 350441 (0.0008) [2023-12-27 21:44:33,819][106225] Updated weights for policy 1, policy_version 350451 (0.0005) [2023-12-27 21:44:33,874][106225] Updated weights for policy 1, policy_version 350461 (0.0008) [2023-12-27 21:44:33,964][106226] Updated weights for policy 0, policy_version 349806 (0.0007) [2023-12-27 21:44:34,027][106226] Updated weights for policy 0, policy_version 349816 (0.0006) [2023-12-27 21:44:34,092][106226] Updated weights for policy 0, policy_version 349826 (0.0007) [2023-12-27 21:44:34,445][106225] Updated weights for policy 1, policy_version 350471 (0.0009) [2023-12-27 21:44:34,504][106225] Updated weights for policy 1, policy_version 350481 (0.0007) [2023-12-27 21:44:34,561][106225] Updated weights for policy 1, policy_version 350491 (0.0009) [2023-12-27 21:44:34,786][106226] Updated weights for policy 0, policy_version 349836 (0.0010) [2023-12-27 21:44:34,844][106226] Updated weights for policy 0, policy_version 349846 (0.0009) [2023-12-27 21:44:34,893][106226] Updated weights for policy 0, policy_version 349856 (0.0008) [2023-12-27 21:44:35,145][106225] Updated weights for policy 1, policy_version 350501 (0.0008) [2023-12-27 21:44:35,211][106225] Updated weights for policy 1, policy_version 350511 (0.0006) [2023-12-27 21:44:35,265][106225] Updated weights for policy 1, policy_version 350521 (0.0005) [2023-12-27 21:44:35,617][106226] Updated weights for policy 0, policy_version 349866 (0.0008) [2023-12-27 21:44:35,677][106226] Updated weights for policy 0, policy_version 349876 (0.0011) [2023-12-27 21:44:35,732][106226] Updated weights for policy 0, policy_version 349886 (0.0005) [2023-12-27 21:44:35,790][106226] Updated weights for policy 0, policy_version 349896 (0.0006) [2023-12-27 21:44:35,794][106225] Updated weights for policy 1, policy_version 350531 (0.0007) [2023-12-27 21:44:35,847][106225] Updated weights for policy 1, policy_version 350541 (0.0010) [2023-12-27 21:44:35,891][106225] Updated weights for policy 1, policy_version 350551 (0.0005) [2023-12-27 21:44:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 179372032. Throughput: 0: 10075.0, 1: 10270.0. Samples: 179379672. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:44:36,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.519')] [2023-12-27 21:44:36,466][106226] Updated weights for policy 0, policy_version 349906 (0.0011) [2023-12-27 21:44:36,516][106225] Updated weights for policy 1, policy_version 350561 (0.0006) [2023-12-27 21:44:36,530][106226] Updated weights for policy 0, policy_version 349916 (0.0011) [2023-12-27 21:44:36,581][106225] Updated weights for policy 1, policy_version 350571 (0.0010) [2023-12-27 21:44:36,596][106226] Updated weights for policy 0, policy_version 349926 (0.0010) [2023-12-27 21:44:36,640][106225] Updated weights for policy 1, policy_version 350581 (0.0010) [2023-12-27 21:44:36,695][106225] Updated weights for policy 1, policy_version 350591 (0.0010) [2023-12-27 21:44:37,287][106226] Updated weights for policy 0, policy_version 349936 (0.0010) [2023-12-27 21:44:37,353][106225] Updated weights for policy 1, policy_version 350601 (0.0005) [2023-12-27 21:44:37,354][106226] Updated weights for policy 0, policy_version 349946 (0.0011) [2023-12-27 21:44:37,409][106225] Updated weights for policy 1, policy_version 350611 (0.0005) [2023-12-27 21:44:37,415][106226] Updated weights for policy 0, policy_version 349956 (0.0011) [2023-12-27 21:44:37,472][106225] Updated weights for policy 1, policy_version 350621 (0.0005) [2023-12-27 21:44:38,026][106226] Updated weights for policy 0, policy_version 349966 (0.0010) [2023-12-27 21:44:38,061][106225] Updated weights for policy 1, policy_version 350631 (0.0009) [2023-12-27 21:44:38,081][106226] Updated weights for policy 0, policy_version 349976 (0.0010) [2023-12-27 21:44:38,124][106225] Updated weights for policy 1, policy_version 350641 (0.0010) [2023-12-27 21:44:38,141][106226] Updated weights for policy 0, policy_version 349986 (0.0011) [2023-12-27 21:44:38,186][106225] Updated weights for policy 1, policy_version 350651 (0.0010) [2023-12-27 21:44:38,821][106226] Updated weights for policy 0, policy_version 349996 (0.0009) [2023-12-27 21:44:38,882][106226] Updated weights for policy 0, policy_version 350006 (0.0008) [2023-12-27 21:44:38,898][106225] Updated weights for policy 1, policy_version 350661 (0.0010) [2023-12-27 21:44:38,939][106226] Updated weights for policy 0, policy_version 350016 (0.0008) [2023-12-27 21:44:38,959][106225] Updated weights for policy 1, policy_version 350671 (0.0011) [2023-12-27 21:44:39,022][106225] Updated weights for policy 1, policy_version 350681 (0.0010) [2023-12-27 21:44:39,714][106226] Updated weights for policy 0, policy_version 350026 (0.0008) [2023-12-27 21:44:39,738][106225] Updated weights for policy 1, policy_version 350691 (0.0011) [2023-12-27 21:44:39,779][106226] Updated weights for policy 0, policy_version 350036 (0.0006) [2023-12-27 21:44:39,796][106225] Updated weights for policy 1, policy_version 350701 (0.0010) [2023-12-27 21:44:39,842][106226] Updated weights for policy 0, policy_version 350046 (0.0007) [2023-12-27 21:44:39,864][106225] Updated weights for policy 1, policy_version 350711 (0.0009) [2023-12-27 21:44:39,903][106226] Updated weights for policy 0, policy_version 350056 (0.0007) [2023-12-27 21:44:40,480][106225] Updated weights for policy 1, policy_version 350721 (0.0008) [2023-12-27 21:44:40,537][106225] Updated weights for policy 1, policy_version 350731 (0.0006) [2023-12-27 21:44:40,595][106225] Updated weights for policy 1, policy_version 350741 (0.0006) [2023-12-27 21:44:40,649][106225] Updated weights for policy 1, policy_version 350751 (0.0005) [2023-12-27 21:44:40,747][106226] Updated weights for policy 0, policy_version 350066 (0.0009) [2023-12-27 21:44:40,795][106226] Updated weights for policy 0, policy_version 350076 (0.0008) [2023-12-27 21:44:40,850][106226] Updated weights for policy 0, policy_version 350086 (0.0008) [2023-12-27 21:44:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 179470336. Throughput: 0: 10056.2, 1: 10270.2. Samples: 179441708. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:44:41,176][105115] Avg episode reward: [(0, '-4.873'), (1, '-5.927')] [2023-12-27 21:44:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000350752_89817088.pth... [2023-12-27 21:44:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000350088_89653248.pth... [2023-12-27 21:44:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000348912_89350144.pth [2023-12-27 21:44:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000349536_89505792.pth [2023-12-27 21:44:41,434][106225] Updated weights for policy 1, policy_version 350761 (0.0009) [2023-12-27 21:44:41,489][106225] Updated weights for policy 1, policy_version 350771 (0.0008) [2023-12-27 21:44:41,555][106225] Updated weights for policy 1, policy_version 350781 (0.0006) [2023-12-27 21:44:41,592][106226] Updated weights for policy 0, policy_version 350096 (0.0009) [2023-12-27 21:44:41,655][106226] Updated weights for policy 0, policy_version 350106 (0.0009) [2023-12-27 21:44:41,728][106226] Updated weights for policy 0, policy_version 350116 (0.0009) [2023-12-27 21:44:42,251][106225] Updated weights for policy 1, policy_version 350791 (0.0008) [2023-12-27 21:44:42,317][106225] Updated weights for policy 1, policy_version 350801 (0.0008) [2023-12-27 21:44:42,391][106225] Updated weights for policy 1, policy_version 350811 (0.0009) [2023-12-27 21:44:42,488][106226] Updated weights for policy 0, policy_version 350126 (0.0009) [2023-12-27 21:44:42,549][106226] Updated weights for policy 0, policy_version 350136 (0.0008) [2023-12-27 21:44:42,611][106226] Updated weights for policy 0, policy_version 350146 (0.0008) [2023-12-27 21:44:43,106][106225] Updated weights for policy 1, policy_version 350821 (0.0010) [2023-12-27 21:44:43,169][106225] Updated weights for policy 1, policy_version 350831 (0.0010) [2023-12-27 21:44:43,231][106225] Updated weights for policy 1, policy_version 350841 (0.0010) [2023-12-27 21:44:43,290][106226] Updated weights for policy 0, policy_version 350156 (0.0007) [2023-12-27 21:44:43,343][106226] Updated weights for policy 0, policy_version 350166 (0.0008) [2023-12-27 21:44:43,402][106226] Updated weights for policy 0, policy_version 350177 (0.0010) [2023-12-27 21:44:43,858][106225] Updated weights for policy 1, policy_version 350851 (0.0009) [2023-12-27 21:44:43,929][106225] Updated weights for policy 1, policy_version 350861 (0.0006) [2023-12-27 21:44:43,993][106225] Updated weights for policy 1, policy_version 350871 (0.0005) [2023-12-27 21:44:44,033][106226] Updated weights for policy 0, policy_version 350187 (0.0007) [2023-12-27 21:44:44,090][106226] Updated weights for policy 0, policy_version 350197 (0.0008) [2023-12-27 21:44:44,149][106226] Updated weights for policy 0, policy_version 350207 (0.0008) [2023-12-27 21:44:44,620][106225] Updated weights for policy 1, policy_version 350881 (0.0008) [2023-12-27 21:44:44,678][106225] Updated weights for policy 1, policy_version 350891 (0.0008) [2023-12-27 21:44:44,736][106225] Updated weights for policy 1, policy_version 350901 (0.0009) [2023-12-27 21:44:44,801][106225] Updated weights for policy 1, policy_version 350911 (0.0008) [2023-12-27 21:44:44,816][106226] Updated weights for policy 0, policy_version 350217 (0.0008) [2023-12-27 21:44:44,871][106226] Updated weights for policy 0, policy_version 350227 (0.0008) [2023-12-27 21:44:44,933][106226] Updated weights for policy 0, policy_version 350237 (0.0008) [2023-12-27 21:44:44,991][106226] Updated weights for policy 0, policy_version 350247 (0.0008) [2023-12-27 21:44:45,526][106225] Updated weights for policy 1, policy_version 350921 (0.0008) [2023-12-27 21:44:45,576][106225] Updated weights for policy 1, policy_version 350931 (0.0008) [2023-12-27 21:44:45,622][106225] Updated weights for policy 1, policy_version 350942 (0.0008) [2023-12-27 21:44:45,722][106226] Updated weights for policy 0, policy_version 350257 (0.0010) [2023-12-27 21:44:45,776][106226] Updated weights for policy 0, policy_version 350267 (0.0008) [2023-12-27 21:44:45,828][106226] Updated weights for policy 0, policy_version 350277 (0.0009) [2023-12-27 21:44:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20343.6, 300 sec: 19855.2). Total num frames: 179568640. Throughput: 0: 9965.4, 1: 10238.7. Samples: 179558400. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:44:46,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.617')] [2023-12-27 21:44:46,338][106225] Updated weights for policy 1, policy_version 350952 (0.0007) [2023-12-27 21:44:46,399][106225] Updated weights for policy 1, policy_version 350962 (0.0009) [2023-12-27 21:44:46,455][106225] Updated weights for policy 1, policy_version 350972 (0.0010) [2023-12-27 21:44:46,605][106226] Updated weights for policy 0, policy_version 350287 (0.0009) [2023-12-27 21:44:46,666][106226] Updated weights for policy 0, policy_version 350297 (0.0008) [2023-12-27 21:44:46,728][106226] Updated weights for policy 0, policy_version 350307 (0.0009) [2023-12-27 21:44:47,057][106225] Updated weights for policy 1, policy_version 350982 (0.0009) [2023-12-27 21:44:47,105][106225] Updated weights for policy 1, policy_version 350992 (0.0008) [2023-12-27 21:44:47,166][106225] Updated weights for policy 1, policy_version 351002 (0.0008) [2023-12-27 21:44:47,457][106226] Updated weights for policy 0, policy_version 350317 (0.0009) [2023-12-27 21:44:47,505][106226] Updated weights for policy 0, policy_version 350327 (0.0009) [2023-12-27 21:44:47,555][106226] Updated weights for policy 0, policy_version 350337 (0.0008) [2023-12-27 21:44:47,796][106225] Updated weights for policy 1, policy_version 351012 (0.0007) [2023-12-27 21:44:47,850][106225] Updated weights for policy 1, policy_version 351022 (0.0006) [2023-12-27 21:44:47,901][106225] Updated weights for policy 1, policy_version 351032 (0.0005) [2023-12-27 21:44:48,406][106226] Updated weights for policy 0, policy_version 350347 (0.0009) [2023-12-27 21:44:48,463][106226] Updated weights for policy 0, policy_version 350357 (0.0009) [2023-12-27 21:44:48,505][106225] Updated weights for policy 1, policy_version 351042 (0.0006) [2023-12-27 21:44:48,513][106226] Updated weights for policy 0, policy_version 350367 (0.0008) [2023-12-27 21:44:48,563][106225] Updated weights for policy 1, policy_version 351052 (0.0007) [2023-12-27 21:44:48,627][106225] Updated weights for policy 1, policy_version 351062 (0.0008) [2023-12-27 21:44:48,687][106225] Updated weights for policy 1, policy_version 351072 (0.0008) [2023-12-27 21:44:49,252][106226] Updated weights for policy 0, policy_version 350377 (0.0006) [2023-12-27 21:44:49,315][106226] Updated weights for policy 0, policy_version 350387 (0.0009) [2023-12-27 21:44:49,384][106226] Updated weights for policy 0, policy_version 350397 (0.0008) [2023-12-27 21:44:49,445][106226] Updated weights for policy 0, policy_version 350407 (0.0007) [2023-12-27 21:44:49,471][106225] Updated weights for policy 1, policy_version 351082 (0.0008) [2023-12-27 21:44:49,532][106225] Updated weights for policy 1, policy_version 351092 (0.0009) [2023-12-27 21:44:49,599][106225] Updated weights for policy 1, policy_version 351102 (0.0009) [2023-12-27 21:44:50,190][106226] Updated weights for policy 0, policy_version 350417 (0.0006) [2023-12-27 21:44:50,242][106226] Updated weights for policy 0, policy_version 350427 (0.0008) [2023-12-27 21:44:50,297][106226] Updated weights for policy 0, policy_version 350437 (0.0008) [2023-12-27 21:44:50,373][106225] Updated weights for policy 1, policy_version 351112 (0.0010) [2023-12-27 21:44:50,418][106225] Updated weights for policy 1, policy_version 351122 (0.0010) [2023-12-27 21:44:50,469][106225] Updated weights for policy 1, policy_version 351132 (0.0011) [2023-12-27 21:44:51,054][106226] Updated weights for policy 0, policy_version 350447 (0.0008) [2023-12-27 21:44:51,116][106226] Updated weights for policy 0, policy_version 350457 (0.0007) [2023-12-27 21:44:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 179658752. Throughput: 0: 9923.1, 1: 10156.7. Samples: 179674628. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:44:51,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.846')] [2023-12-27 21:44:51,186][106226] Updated weights for policy 0, policy_version 350467 (0.0006) [2023-12-27 21:44:51,230][106225] Updated weights for policy 1, policy_version 351142 (0.0009) [2023-12-27 21:44:51,299][106225] Updated weights for policy 1, policy_version 351152 (0.0008) [2023-12-27 21:44:51,365][106225] Updated weights for policy 1, policy_version 351162 (0.0008) [2023-12-27 21:44:51,938][106226] Updated weights for policy 0, policy_version 350477 (0.0007) [2023-12-27 21:44:51,997][106226] Updated weights for policy 0, policy_version 350487 (0.0009) [2023-12-27 21:44:52,063][106226] Updated weights for policy 0, policy_version 350497 (0.0006) [2023-12-27 21:44:52,189][106225] Updated weights for policy 1, policy_version 351172 (0.0007) [2023-12-27 21:44:52,238][106225] Updated weights for policy 1, policy_version 351182 (0.0008) [2023-12-27 21:44:52,301][106225] Updated weights for policy 1, policy_version 351192 (0.0007) [2023-12-27 21:44:52,725][106226] Updated weights for policy 0, policy_version 350507 (0.0006) [2023-12-27 21:44:52,778][106226] Updated weights for policy 0, policy_version 350517 (0.0008) [2023-12-27 21:44:52,841][106226] Updated weights for policy 0, policy_version 350527 (0.0009) [2023-12-27 21:44:53,019][106225] Updated weights for policy 1, policy_version 351202 (0.0009) [2023-12-27 21:44:53,078][106225] Updated weights for policy 1, policy_version 351212 (0.0008) [2023-12-27 21:44:53,137][106225] Updated weights for policy 1, policy_version 351222 (0.0008) [2023-12-27 21:44:53,193][106225] Updated weights for policy 1, policy_version 351232 (0.0008) [2023-12-27 21:44:53,509][106226] Updated weights for policy 0, policy_version 350537 (0.0008) [2023-12-27 21:44:53,574][106226] Updated weights for policy 0, policy_version 350547 (0.0008) [2023-12-27 21:44:53,648][106226] Updated weights for policy 0, policy_version 350557 (0.0009) [2023-12-27 21:44:53,713][106226] Updated weights for policy 0, policy_version 350567 (0.0009) [2023-12-27 21:44:53,880][106225] Updated weights for policy 1, policy_version 351242 (0.0008) [2023-12-27 21:44:53,946][106225] Updated weights for policy 1, policy_version 351252 (0.0009) [2023-12-27 21:44:54,011][106225] Updated weights for policy 1, policy_version 351262 (0.0008) [2023-12-27 21:44:54,391][106226] Updated weights for policy 0, policy_version 350577 (0.0010) [2023-12-27 21:44:54,446][106226] Updated weights for policy 0, policy_version 350587 (0.0005) [2023-12-27 21:44:54,505][106226] Updated weights for policy 0, policy_version 350597 (0.0005) [2023-12-27 21:44:54,680][106225] Updated weights for policy 1, policy_version 351272 (0.0007) [2023-12-27 21:44:54,731][106225] Updated weights for policy 1, policy_version 351282 (0.0007) [2023-12-27 21:44:54,790][106225] Updated weights for policy 1, policy_version 351292 (0.0008) [2023-12-27 21:44:55,149][106226] Updated weights for policy 0, policy_version 350607 (0.0009) [2023-12-27 21:44:55,206][106226] Updated weights for policy 0, policy_version 350617 (0.0010) [2023-12-27 21:44:55,258][106226] Updated weights for policy 0, policy_version 350627 (0.0009) [2023-12-27 21:44:55,549][106225] Updated weights for policy 1, policy_version 351302 (0.0008) [2023-12-27 21:44:55,607][106225] Updated weights for policy 1, policy_version 351312 (0.0008) [2023-12-27 21:44:55,662][106225] Updated weights for policy 1, policy_version 351322 (0.0007) [2023-12-27 21:44:55,925][106226] Updated weights for policy 0, policy_version 350637 (0.0009) [2023-12-27 21:44:55,982][106226] Updated weights for policy 0, policy_version 350647 (0.0008) [2023-12-27 21:44:56,040][106226] Updated weights for policy 0, policy_version 350657 (0.0008) [2023-12-27 21:44:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 179765248. Throughput: 0: 9908.1, 1: 10142.4. Samples: 179732372. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:44:56,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.957')] [2023-12-27 21:44:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000351328_89964544.pth... [2023-12-27 21:44:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000350664_89800704.pth... [2023-12-27 21:44:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000350144_89661440.pth [2023-12-27 21:44:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000349520_89505792.pth [2023-12-27 21:44:56,357][106225] Updated weights for policy 1, policy_version 351332 (0.0007) [2023-12-27 21:44:56,415][106225] Updated weights for policy 1, policy_version 351342 (0.0007) [2023-12-27 21:44:56,466][106225] Updated weights for policy 1, policy_version 351352 (0.0010) [2023-12-27 21:44:56,787][106226] Updated weights for policy 0, policy_version 350667 (0.0009) [2023-12-27 21:44:56,840][106226] Updated weights for policy 0, policy_version 350677 (0.0009) [2023-12-27 21:44:56,903][106226] Updated weights for policy 0, policy_version 350687 (0.0010) [2023-12-27 21:44:57,085][106225] Updated weights for policy 1, policy_version 351362 (0.0009) [2023-12-27 21:44:57,139][106225] Updated weights for policy 1, policy_version 351372 (0.0005) [2023-12-27 21:44:57,205][106225] Updated weights for policy 1, policy_version 351382 (0.0005) [2023-12-27 21:44:57,254][106225] Updated weights for policy 1, policy_version 351392 (0.0005) [2023-12-27 21:44:57,559][106226] Updated weights for policy 0, policy_version 350697 (0.0011) [2023-12-27 21:44:57,625][106226] Updated weights for policy 0, policy_version 350707 (0.0009) [2023-12-27 21:44:57,689][106226] Updated weights for policy 0, policy_version 350717 (0.0009) [2023-12-27 21:44:57,746][106226] Updated weights for policy 0, policy_version 350727 (0.0009) [2023-12-27 21:44:57,772][106225] Updated weights for policy 1, policy_version 351402 (0.0005) [2023-12-27 21:44:57,830][106225] Updated weights for policy 1, policy_version 351412 (0.0008) [2023-12-27 21:44:57,890][106225] Updated weights for policy 1, policy_version 351422 (0.0009) [2023-12-27 21:44:58,516][106226] Updated weights for policy 0, policy_version 350737 (0.0010) [2023-12-27 21:44:58,526][106225] Updated weights for policy 1, policy_version 351432 (0.0006) [2023-12-27 21:44:58,582][106226] Updated weights for policy 0, policy_version 350747 (0.0007) [2023-12-27 21:44:58,596][106225] Updated weights for policy 1, policy_version 351442 (0.0006) [2023-12-27 21:44:58,643][106226] Updated weights for policy 0, policy_version 350757 (0.0008) [2023-12-27 21:44:58,658][106225] Updated weights for policy 1, policy_version 351452 (0.0008) [2023-12-27 21:44:59,465][106225] Updated weights for policy 1, policy_version 351462 (0.0009) [2023-12-27 21:44:59,506][106226] Updated weights for policy 0, policy_version 350767 (0.0007) [2023-12-27 21:44:59,527][106225] Updated weights for policy 1, policy_version 351472 (0.0010) [2023-12-27 21:44:59,564][106226] Updated weights for policy 0, policy_version 350777 (0.0007) [2023-12-27 21:44:59,587][106225] Updated weights for policy 1, policy_version 351482 (0.0010) [2023-12-27 21:44:59,625][106226] Updated weights for policy 0, policy_version 350787 (0.0007) [2023-12-27 21:45:00,308][106225] Updated weights for policy 1, policy_version 351492 (0.0010) [2023-12-27 21:45:00,365][106226] Updated weights for policy 0, policy_version 350797 (0.0008) [2023-12-27 21:45:00,368][106225] Updated weights for policy 1, policy_version 351502 (0.0008) [2023-12-27 21:45:00,420][106226] Updated weights for policy 0, policy_version 350807 (0.0006) [2023-12-27 21:45:00,425][106225] Updated weights for policy 1, policy_version 351512 (0.0008) [2023-12-27 21:45:00,483][106226] Updated weights for policy 0, policy_version 350817 (0.0008) [2023-12-27 21:45:01,148][106225] Updated weights for policy 1, policy_version 351522 (0.0006) [2023-12-27 21:45:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 179855360. Throughput: 0: 9884.0, 1: 10218.1. Samples: 179851376. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:01,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-5.497')] [2023-12-27 21:45:01,176][106226] Updated weights for policy 0, policy_version 350827 (0.0010) [2023-12-27 21:45:01,211][106225] Updated weights for policy 1, policy_version 351532 (0.0008) [2023-12-27 21:45:01,235][106226] Updated weights for policy 0, policy_version 350837 (0.0007) [2023-12-27 21:45:01,273][106225] Updated weights for policy 1, policy_version 351542 (0.0007) [2023-12-27 21:45:01,295][106226] Updated weights for policy 0, policy_version 350847 (0.0007) [2023-12-27 21:45:01,343][106225] Updated weights for policy 1, policy_version 351552 (0.0006) [2023-12-27 21:45:02,008][106226] Updated weights for policy 0, policy_version 350857 (0.0007) [2023-12-27 21:45:02,030][106225] Updated weights for policy 1, policy_version 351562 (0.0008) [2023-12-27 21:45:02,077][106226] Updated weights for policy 0, policy_version 350867 (0.0008) [2023-12-27 21:45:02,087][106225] Updated weights for policy 1, policy_version 351572 (0.0008) [2023-12-27 21:45:02,135][106226] Updated weights for policy 0, policy_version 350877 (0.0006) [2023-12-27 21:45:02,145][106225] Updated weights for policy 1, policy_version 351582 (0.0007) [2023-12-27 21:45:02,197][106226] Updated weights for policy 0, policy_version 350887 (0.0007) [2023-12-27 21:45:02,841][106226] Updated weights for policy 0, policy_version 350897 (0.0009) [2023-12-27 21:45:02,867][106225] Updated weights for policy 1, policy_version 351592 (0.0006) [2023-12-27 21:45:02,889][106226] Updated weights for policy 0, policy_version 350907 (0.0008) [2023-12-27 21:45:02,917][106225] Updated weights for policy 1, policy_version 351602 (0.0005) [2023-12-27 21:45:02,937][106226] Updated weights for policy 0, policy_version 350917 (0.0008) [2023-12-27 21:45:02,980][106225] Updated weights for policy 1, policy_version 351612 (0.0005) [2023-12-27 21:45:03,544][106225] Updated weights for policy 1, policy_version 351622 (0.0006) [2023-12-27 21:45:03,612][106225] Updated weights for policy 1, policy_version 351632 (0.0005) [2023-12-27 21:45:03,680][106225] Updated weights for policy 1, policy_version 351642 (0.0007) [2023-12-27 21:45:03,731][106226] Updated weights for policy 0, policy_version 350927 (0.0006) [2023-12-27 21:45:03,783][106226] Updated weights for policy 0, policy_version 350937 (0.0008) [2023-12-27 21:45:03,833][106226] Updated weights for policy 0, policy_version 350947 (0.0009) [2023-12-27 21:45:04,326][106225] Updated weights for policy 1, policy_version 351652 (0.0008) [2023-12-27 21:45:04,383][106225] Updated weights for policy 1, policy_version 351662 (0.0008) [2023-12-27 21:45:04,441][106225] Updated weights for policy 1, policy_version 351672 (0.0008) [2023-12-27 21:45:04,573][106226] Updated weights for policy 0, policy_version 350957 (0.0006) [2023-12-27 21:45:04,627][106226] Updated weights for policy 0, policy_version 350967 (0.0005) [2023-12-27 21:45:04,679][106226] Updated weights for policy 0, policy_version 350977 (0.0005) [2023-12-27 21:45:05,239][106225] Updated weights for policy 1, policy_version 351682 (0.0007) [2023-12-27 21:45:05,240][106226] Updated weights for policy 0, policy_version 350987 (0.0006) [2023-12-27 21:45:05,296][106225] Updated weights for policy 1, policy_version 351692 (0.0006) [2023-12-27 21:45:05,301][106226] Updated weights for policy 0, policy_version 350997 (0.0010) [2023-12-27 21:45:05,319][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000004 [2023-12-27 21:45:05,361][106226] Updated weights for policy 0, policy_version 351007 (0.0011) [2023-12-27 21:45:06,019][106226] Updated weights for policy 0, policy_version 351017 (0.0010) [2023-12-27 21:45:06,062][106225] Updated weights for policy 1, policy_version 351702 (0.0006) [2023-12-27 21:45:06,079][106226] Updated weights for policy 0, policy_version 351027 (0.0010) [2023-12-27 21:45:06,123][106225] Updated weights for policy 1, policy_version 351712 (0.0007) [2023-12-27 21:45:06,141][106226] Updated weights for policy 0, policy_version 351037 (0.0009) [2023-12-27 21:45:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 179953664. Throughput: 0: 9836.9, 1: 10198.1. Samples: 179971188. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:06,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-5.586')] [2023-12-27 21:45:06,177][106225] Updated weights for policy 1, policy_version 351722 (0.0007) [2023-12-27 21:45:06,202][106226] Updated weights for policy 0, policy_version 351047 (0.0011) [2023-12-27 21:45:06,854][106226] Updated weights for policy 0, policy_version 351057 (0.0011) [2023-12-27 21:45:06,915][106226] Updated weights for policy 0, policy_version 351067 (0.0010) [2023-12-27 21:45:06,951][106225] Updated weights for policy 1, policy_version 351732 (0.0006) [2023-12-27 21:45:06,973][106226] Updated weights for policy 0, policy_version 351077 (0.0011) [2023-12-27 21:45:07,007][106225] Updated weights for policy 1, policy_version 351742 (0.0006) [2023-12-27 21:45:07,057][106225] Updated weights for policy 1, policy_version 351752 (0.0008) [2023-12-27 21:45:07,695][106226] Updated weights for policy 0, policy_version 351087 (0.0007) [2023-12-27 21:45:07,746][106226] Updated weights for policy 0, policy_version 351097 (0.0010) [2023-12-27 21:45:07,785][106225] Updated weights for policy 1, policy_version 351762 (0.0008) [2023-12-27 21:45:07,793][106226] Updated weights for policy 0, policy_version 351107 (0.0010) [2023-12-27 21:45:07,839][106225] Updated weights for policy 1, policy_version 351772 (0.0006) [2023-12-27 21:45:07,889][106225] Updated weights for policy 1, policy_version 351782 (0.0007) [2023-12-27 21:45:07,932][106225] Updated weights for policy 1, policy_version 351792 (0.0008) [2023-12-27 21:45:08,464][106226] Updated weights for policy 0, policy_version 351117 (0.0008) [2023-12-27 21:45:08,532][106226] Updated weights for policy 0, policy_version 351127 (0.0006) [2023-12-27 21:45:08,597][106226] Updated weights for policy 0, policy_version 351137 (0.0006) [2023-12-27 21:45:08,745][106225] Updated weights for policy 1, policy_version 351802 (0.0008) [2023-12-27 21:45:08,795][106225] Updated weights for policy 1, policy_version 351812 (0.0008) [2023-12-27 21:45:08,853][106225] Updated weights for policy 1, policy_version 351822 (0.0005) [2023-12-27 21:45:09,237][106226] Updated weights for policy 0, policy_version 351147 (0.0006) [2023-12-27 21:45:09,305][106226] Updated weights for policy 0, policy_version 351157 (0.0010) [2023-12-27 21:45:09,368][106226] Updated weights for policy 0, policy_version 351167 (0.0009) [2023-12-27 21:45:09,572][106225] Updated weights for policy 1, policy_version 351832 (0.0008) [2023-12-27 21:45:09,626][106225] Updated weights for policy 1, policy_version 351842 (0.0007) [2023-12-27 21:45:09,684][106225] Updated weights for policy 1, policy_version 351852 (0.0008) [2023-12-27 21:45:10,125][106226] Updated weights for policy 0, policy_version 351177 (0.0009) [2023-12-27 21:45:10,180][106226] Updated weights for policy 0, policy_version 351187 (0.0009) [2023-12-27 21:45:10,237][106226] Updated weights for policy 0, policy_version 351197 (0.0008) [2023-12-27 21:45:10,291][106226] Updated weights for policy 0, policy_version 351207 (0.0009) [2023-12-27 21:45:10,460][106225] Updated weights for policy 1, policy_version 351862 (0.0009) [2023-12-27 21:45:10,523][106225] Updated weights for policy 1, policy_version 351872 (0.0008) [2023-12-27 21:45:10,589][106225] Updated weights for policy 1, policy_version 351882 (0.0008) [2023-12-27 21:45:11,089][106226] Updated weights for policy 0, policy_version 351217 (0.0009) [2023-12-27 21:45:11,143][106226] Updated weights for policy 0, policy_version 351227 (0.0008) [2023-12-27 21:45:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 180051968. Throughput: 0: 9874.3, 1: 10196.6. Samples: 180030076. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:11,176][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.503')] [2023-12-27 21:45:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000351888_90112000.pth... [2023-12-27 21:45:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000350752_89817088.pth [2023-12-27 21:45:11,207][106226] Updated weights for policy 0, policy_version 351237 (0.0008) [2023-12-27 21:45:11,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000351240_89948160.pth... [2023-12-27 21:45:11,229][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000350088_89653248.pth [2023-12-27 21:45:11,299][106225] Updated weights for policy 1, policy_version 351892 (0.0007) [2023-12-27 21:45:11,368][106225] Updated weights for policy 1, policy_version 351902 (0.0010) [2023-12-27 21:45:11,432][106225] Updated weights for policy 1, policy_version 351912 (0.0010) [2023-12-27 21:45:11,993][106226] Updated weights for policy 0, policy_version 351247 (0.0008) [2023-12-27 21:45:12,054][106226] Updated weights for policy 0, policy_version 351257 (0.0007) [2023-12-27 21:45:12,118][106226] Updated weights for policy 0, policy_version 351267 (0.0007) [2023-12-27 21:45:12,225][106225] Updated weights for policy 1, policy_version 351922 (0.0010) [2023-12-27 21:45:12,290][106225] Updated weights for policy 1, policy_version 351932 (0.0011) [2023-12-27 21:45:12,357][106225] Updated weights for policy 1, policy_version 351942 (0.0008) [2023-12-27 21:45:12,423][106225] Updated weights for policy 1, policy_version 351952 (0.0008) [2023-12-27 21:45:12,875][106226] Updated weights for policy 0, policy_version 351277 (0.0008) [2023-12-27 21:45:12,933][106226] Updated weights for policy 0, policy_version 351287 (0.0008) [2023-12-27 21:45:12,994][106226] Updated weights for policy 0, policy_version 351297 (0.0008) [2023-12-27 21:45:13,111][106225] Updated weights for policy 1, policy_version 351962 (0.0010) [2023-12-27 21:45:13,169][106225] Updated weights for policy 1, policy_version 351972 (0.0010) [2023-12-27 21:45:13,230][106225] Updated weights for policy 1, policy_version 351982 (0.0010) [2023-12-27 21:45:13,705][106226] Updated weights for policy 0, policy_version 351307 (0.0007) [2023-12-27 21:45:13,768][106226] Updated weights for policy 0, policy_version 351317 (0.0008) [2023-12-27 21:45:13,827][106226] Updated weights for policy 0, policy_version 351327 (0.0009) [2023-12-27 21:45:13,959][106225] Updated weights for policy 1, policy_version 351992 (0.0010) [2023-12-27 21:45:14,025][106225] Updated weights for policy 1, policy_version 352002 (0.0010) [2023-12-27 21:45:14,079][106225] Updated weights for policy 1, policy_version 352012 (0.0010) [2023-12-27 21:45:14,421][106226] Updated weights for policy 0, policy_version 351337 (0.0009) [2023-12-27 21:45:14,479][106226] Updated weights for policy 0, policy_version 351347 (0.0009) [2023-12-27 21:45:14,538][106226] Updated weights for policy 0, policy_version 351357 (0.0009) [2023-12-27 21:45:14,587][106226] Updated weights for policy 0, policy_version 351367 (0.0007) [2023-12-27 21:45:14,745][106225] Updated weights for policy 1, policy_version 352022 (0.0007) [2023-12-27 21:45:14,811][106225] Updated weights for policy 1, policy_version 352032 (0.0007) [2023-12-27 21:45:14,875][106225] Updated weights for policy 1, policy_version 352042 (0.0008) [2023-12-27 21:45:15,361][106226] Updated weights for policy 0, policy_version 351377 (0.0009) [2023-12-27 21:45:15,414][106226] Updated weights for policy 0, policy_version 351387 (0.0009) [2023-12-27 21:45:15,473][106226] Updated weights for policy 0, policy_version 351397 (0.0008) [2023-12-27 21:45:15,560][106225] Updated weights for policy 1, policy_version 352052 (0.0008) [2023-12-27 21:45:15,623][106225] Updated weights for policy 1, policy_version 352062 (0.0009) [2023-12-27 21:45:15,679][106225] Updated weights for policy 1, policy_version 352072 (0.0008) [2023-12-27 21:45:16,134][106226] Updated weights for policy 0, policy_version 351407 (0.0008) [2023-12-27 21:45:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 180150272. Throughput: 0: 9711.2, 1: 10002.8. Samples: 180143640. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:16,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.885')] [2023-12-27 21:45:16,192][106226] Updated weights for policy 0, policy_version 351417 (0.0009) [2023-12-27 21:45:16,255][106226] Updated weights for policy 0, policy_version 351427 (0.0009) [2023-12-27 21:45:16,461][106225] Updated weights for policy 1, policy_version 352082 (0.0008) [2023-12-27 21:45:16,519][106225] Updated weights for policy 1, policy_version 352092 (0.0009) [2023-12-27 21:45:16,578][106225] Updated weights for policy 1, policy_version 352102 (0.0008) [2023-12-27 21:45:16,640][106225] Updated weights for policy 1, policy_version 352112 (0.0008) [2023-12-27 21:45:16,896][106226] Updated weights for policy 0, policy_version 351437 (0.0007) [2023-12-27 21:45:16,950][106226] Updated weights for policy 0, policy_version 351447 (0.0007) [2023-12-27 21:45:17,018][106226] Updated weights for policy 0, policy_version 351457 (0.0008) [2023-12-27 21:45:17,430][106225] Updated weights for policy 1, policy_version 352122 (0.0009) [2023-12-27 21:45:17,503][106225] Updated weights for policy 1, policy_version 352132 (0.0008) [2023-12-27 21:45:17,565][106225] Updated weights for policy 1, policy_version 352142 (0.0009) [2023-12-27 21:45:17,605][106226] Updated weights for policy 0, policy_version 351467 (0.0008) [2023-12-27 21:45:17,662][106226] Updated weights for policy 0, policy_version 351477 (0.0006) [2023-12-27 21:45:17,727][106226] Updated weights for policy 0, policy_version 351487 (0.0005) [2023-12-27 21:45:18,324][106226] Updated weights for policy 0, policy_version 351497 (0.0006) [2023-12-27 21:45:18,367][106225] Updated weights for policy 1, policy_version 352153 (0.0008) [2023-12-27 21:45:18,388][106226] Updated weights for policy 0, policy_version 351507 (0.0009) [2023-12-27 21:45:18,433][106225] Updated weights for policy 1, policy_version 352163 (0.0006) [2023-12-27 21:45:18,450][106226] Updated weights for policy 0, policy_version 351517 (0.0009) [2023-12-27 21:45:18,492][106225] Updated weights for policy 1, policy_version 352173 (0.0008) [2023-12-27 21:45:18,506][106226] Updated weights for policy 0, policy_version 351527 (0.0010) [2023-12-27 21:45:19,111][106226] Updated weights for policy 0, policy_version 351537 (0.0010) [2023-12-27 21:45:19,158][106225] Updated weights for policy 1, policy_version 352183 (0.0005) [2023-12-27 21:45:19,161][106226] Updated weights for policy 0, policy_version 351547 (0.0010) [2023-12-27 21:45:19,215][106225] Updated weights for policy 1, policy_version 352193 (0.0006) [2023-12-27 21:45:19,219][106226] Updated weights for policy 0, policy_version 351557 (0.0011) [2023-12-27 21:45:19,280][106225] Updated weights for policy 1, policy_version 352203 (0.0007) [2023-12-27 21:45:20,014][106226] Updated weights for policy 0, policy_version 351567 (0.0009) [2023-12-27 21:45:20,015][106225] Updated weights for policy 1, policy_version 352213 (0.0006) [2023-12-27 21:45:20,073][106226] Updated weights for policy 0, policy_version 351577 (0.0010) [2023-12-27 21:45:20,081][106225] Updated weights for policy 1, policy_version 352223 (0.0006) [2023-12-27 21:45:20,137][106226] Updated weights for policy 0, policy_version 351587 (0.0010) [2023-12-27 21:45:20,144][106225] Updated weights for policy 1, policy_version 352233 (0.0008) [2023-12-27 21:45:20,857][106225] Updated weights for policy 1, policy_version 352243 (0.0008) [2023-12-27 21:45:20,897][106226] Updated weights for policy 0, policy_version 351597 (0.0011) [2023-12-27 21:45:20,920][106225] Updated weights for policy 1, policy_version 352253 (0.0006) [2023-12-27 21:45:20,963][106226] Updated weights for policy 0, policy_version 351607 (0.0009) [2023-12-27 21:45:20,983][106225] Updated weights for policy 1, policy_version 352263 (0.0006) [2023-12-27 21:45:21,031][106226] Updated weights for policy 0, policy_version 351617 (0.0011) [2023-12-27 21:45:21,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 180256768. Throughput: 0: 9765.2, 1: 9830.6. Samples: 180261480. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:21,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-5.829')] [2023-12-27 21:45:21,789][106225] Updated weights for policy 1, policy_version 352273 (0.0008) [2023-12-27 21:45:21,844][106226] Updated weights for policy 0, policy_version 351627 (0.0009) [2023-12-27 21:45:21,849][106225] Updated weights for policy 1, policy_version 352283 (0.0009) [2023-12-27 21:45:21,892][106226] Updated weights for policy 0, policy_version 351637 (0.0008) [2023-12-27 21:45:21,901][106225] Updated weights for policy 1, policy_version 352293 (0.0009) [2023-12-27 21:45:21,949][106226] Updated weights for policy 0, policy_version 351647 (0.0008) [2023-12-27 21:45:21,961][106225] Updated weights for policy 1, policy_version 352303 (0.0009) [2023-12-27 21:45:22,727][106226] Updated weights for policy 0, policy_version 351657 (0.0008) [2023-12-27 21:45:22,760][106225] Updated weights for policy 1, policy_version 352313 (0.0008) [2023-12-27 21:45:22,792][106226] Updated weights for policy 0, policy_version 351667 (0.0008) [2023-12-27 21:45:22,818][106225] Updated weights for policy 1, policy_version 352323 (0.0005) [2023-12-27 21:45:22,850][106226] Updated weights for policy 0, policy_version 351677 (0.0009) [2023-12-27 21:45:22,879][106225] Updated weights for policy 1, policy_version 352333 (0.0005) [2023-12-27 21:45:22,908][106226] Updated weights for policy 0, policy_version 351687 (0.0007) [2023-12-27 21:45:23,453][106225] Updated weights for policy 1, policy_version 352343 (0.0009) [2023-12-27 21:45:23,509][106225] Updated weights for policy 1, policy_version 352353 (0.0008) [2023-12-27 21:45:23,561][106225] Updated weights for policy 1, policy_version 352363 (0.0009) [2023-12-27 21:45:23,633][106226] Updated weights for policy 0, policy_version 351697 (0.0008) [2023-12-27 21:45:23,677][106226] Updated weights for policy 0, policy_version 351707 (0.0008) [2023-12-27 21:45:23,722][106226] Updated weights for policy 0, policy_version 351717 (0.0010) [2023-12-27 21:45:24,222][106225] Updated weights for policy 1, policy_version 352373 (0.0010) [2023-12-27 21:45:24,272][106225] Updated weights for policy 1, policy_version 352383 (0.0010) [2023-12-27 21:45:24,333][106225] Updated weights for policy 1, policy_version 352393 (0.0010) [2023-12-27 21:45:24,471][106226] Updated weights for policy 0, policy_version 351727 (0.0007) [2023-12-27 21:45:24,526][106226] Updated weights for policy 0, policy_version 351737 (0.0005) [2023-12-27 21:45:24,585][106226] Updated weights for policy 0, policy_version 351747 (0.0008) [2023-12-27 21:45:24,913][106225] Updated weights for policy 1, policy_version 352403 (0.0006) [2023-12-27 21:45:24,983][106225] Updated weights for policy 1, policy_version 352413 (0.0006) [2023-12-27 21:45:25,048][106225] Updated weights for policy 1, policy_version 352423 (0.0010) [2023-12-27 21:45:25,221][106226] Updated weights for policy 0, policy_version 351757 (0.0007) [2023-12-27 21:45:25,274][106226] Updated weights for policy 0, policy_version 351767 (0.0005) [2023-12-27 21:45:25,336][106226] Updated weights for policy 0, policy_version 351777 (0.0005) [2023-12-27 21:45:25,710][106225] Updated weights for policy 1, policy_version 352433 (0.0009) [2023-12-27 21:45:25,781][106225] Updated weights for policy 1, policy_version 352443 (0.0005) [2023-12-27 21:45:25,848][106225] Updated weights for policy 1, policy_version 352453 (0.0006) [2023-12-27 21:45:25,883][106226] Updated weights for policy 0, policy_version 351787 (0.0008) [2023-12-27 21:45:25,908][106225] Updated weights for policy 1, policy_version 352463 (0.0010) [2023-12-27 21:45:25,933][106226] Updated weights for policy 0, policy_version 351797 (0.0010) [2023-12-27 21:45:25,996][106226] Updated weights for policy 0, policy_version 351807 (0.0011) [2023-12-27 21:45:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 180355072. Throughput: 0: 9703.7, 1: 9756.8. Samples: 180317432. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:26,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-6.070')] [2023-12-27 21:45:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000352464_90259456.pth... [2023-12-27 21:45:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000351816_90095616.pth... [2023-12-27 21:45:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000351328_89964544.pth [2023-12-27 21:45:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000350664_89800704.pth [2023-12-27 21:45:26,529][106225] Updated weights for policy 1, policy_version 352473 (0.0008) [2023-12-27 21:45:26,595][106225] Updated weights for policy 1, policy_version 352483 (0.0008) [2023-12-27 21:45:26,650][106225] Updated weights for policy 1, policy_version 352493 (0.0008) [2023-12-27 21:45:26,728][106226] Updated weights for policy 0, policy_version 351817 (0.0010) [2023-12-27 21:45:26,787][106226] Updated weights for policy 0, policy_version 351827 (0.0007) [2023-12-27 21:45:26,846][106226] Updated weights for policy 0, policy_version 351837 (0.0008) [2023-12-27 21:45:26,901][106226] Updated weights for policy 0, policy_version 351847 (0.0005) [2023-12-27 21:45:27,365][106225] Updated weights for policy 1, policy_version 352503 (0.0007) [2023-12-27 21:45:27,423][106225] Updated weights for policy 1, policy_version 352513 (0.0005) [2023-12-27 21:45:27,471][106226] Updated weights for policy 0, policy_version 351857 (0.0008) [2023-12-27 21:45:27,481][106225] Updated weights for policy 1, policy_version 352523 (0.0005) [2023-12-27 21:45:27,521][106226] Updated weights for policy 0, policy_version 351867 (0.0008) [2023-12-27 21:45:27,578][106226] Updated weights for policy 0, policy_version 351877 (0.0010) [2023-12-27 21:45:28,075][106225] Updated weights for policy 1, policy_version 352533 (0.0008) [2023-12-27 21:45:28,141][106225] Updated weights for policy 1, policy_version 352543 (0.0010) [2023-12-27 21:45:28,194][106225] Updated weights for policy 1, policy_version 352553 (0.0010) [2023-12-27 21:45:28,312][106226] Updated weights for policy 0, policy_version 351887 (0.0010) [2023-12-27 21:45:28,378][106226] Updated weights for policy 0, policy_version 351897 (0.0011) [2023-12-27 21:45:28,439][106226] Updated weights for policy 0, policy_version 351907 (0.0011) [2023-12-27 21:45:28,872][106225] Updated weights for policy 1, policy_version 352563 (0.0009) [2023-12-27 21:45:28,925][106225] Updated weights for policy 1, policy_version 352573 (0.0005) [2023-12-27 21:45:28,992][106225] Updated weights for policy 1, policy_version 352583 (0.0005) [2023-12-27 21:45:29,117][106226] Updated weights for policy 0, policy_version 351917 (0.0008) [2023-12-27 21:45:29,172][106226] Updated weights for policy 0, policy_version 351927 (0.0005) [2023-12-27 21:45:29,237][106226] Updated weights for policy 0, policy_version 351937 (0.0009) [2023-12-27 21:45:29,704][106225] Updated weights for policy 1, policy_version 352593 (0.0009) [2023-12-27 21:45:29,767][106225] Updated weights for policy 1, policy_version 352603 (0.0007) [2023-12-27 21:45:29,823][106225] Updated weights for policy 1, policy_version 352613 (0.0010) [2023-12-27 21:45:29,893][106225] Updated weights for policy 1, policy_version 352623 (0.0008) [2023-12-27 21:45:29,918][106226] Updated weights for policy 0, policy_version 351947 (0.0010) [2023-12-27 21:45:29,985][106226] Updated weights for policy 0, policy_version 351957 (0.0008) [2023-12-27 21:45:30,039][106226] Updated weights for policy 0, policy_version 351967 (0.0008) [2023-12-27 21:45:30,605][106225] Updated weights for policy 1, policy_version 352633 (0.0006) [2023-12-27 21:45:30,670][106225] Updated weights for policy 1, policy_version 352643 (0.0006) [2023-12-27 21:45:30,675][106226] Updated weights for policy 0, policy_version 351978 (0.0009) [2023-12-27 21:45:30,723][106225] Updated weights for policy 1, policy_version 352653 (0.0009) [2023-12-27 21:45:30,735][106226] Updated weights for policy 0, policy_version 351988 (0.0006) [2023-12-27 21:45:30,790][106226] Updated weights for policy 0, policy_version 351998 (0.0005) [2023-12-27 21:45:30,838][106226] Updated weights for policy 0, policy_version 352008 (0.0005) [2023-12-27 21:45:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 180453376. Throughput: 0: 9821.4, 1: 9828.7. Samples: 180442656. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:31,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-5.855')] [2023-12-27 21:45:31,468][106225] Updated weights for policy 1, policy_version 352663 (0.0010) [2023-12-27 21:45:31,510][106226] Updated weights for policy 0, policy_version 352018 (0.0011) [2023-12-27 21:45:31,530][106225] Updated weights for policy 1, policy_version 352673 (0.0007) [2023-12-27 21:45:31,574][106226] Updated weights for policy 0, policy_version 352028 (0.0010) [2023-12-27 21:45:31,587][106225] Updated weights for policy 1, policy_version 352683 (0.0005) [2023-12-27 21:45:31,638][106226] Updated weights for policy 0, policy_version 352038 (0.0011) [2023-12-27 21:45:32,247][106225] Updated weights for policy 1, policy_version 352693 (0.0008) [2023-12-27 21:45:32,305][106225] Updated weights for policy 1, policy_version 352703 (0.0007) [2023-12-27 21:45:32,363][106225] Updated weights for policy 1, policy_version 352713 (0.0009) [2023-12-27 21:45:32,378][106226] Updated weights for policy 0, policy_version 352048 (0.0008) [2023-12-27 21:45:32,441][106226] Updated weights for policy 0, policy_version 352058 (0.0009) [2023-12-27 21:45:32,502][106226] Updated weights for policy 0, policy_version 352068 (0.0009) [2023-12-27 21:45:32,981][106225] Updated weights for policy 1, policy_version 352723 (0.0011) [2023-12-27 21:45:33,039][106225] Updated weights for policy 1, policy_version 352733 (0.0007) [2023-12-27 21:45:33,087][106225] Updated weights for policy 1, policy_version 352743 (0.0008) [2023-12-27 21:45:33,097][106226] Updated weights for policy 0, policy_version 352078 (0.0007) [2023-12-27 21:45:33,162][106226] Updated weights for policy 0, policy_version 352088 (0.0009) [2023-12-27 21:45:33,214][106226] Updated weights for policy 0, policy_version 352098 (0.0007) [2023-12-27 21:45:33,634][106225] Updated weights for policy 1, policy_version 352753 (0.0005) [2023-12-27 21:45:33,688][106225] Updated weights for policy 1, policy_version 352763 (0.0007) [2023-12-27 21:45:33,743][106225] Updated weights for policy 1, policy_version 352773 (0.0006) [2023-12-27 21:45:33,792][106225] Updated weights for policy 1, policy_version 352783 (0.0007) [2023-12-27 21:45:33,835][106226] Updated weights for policy 0, policy_version 352108 (0.0008) [2023-12-27 21:45:33,887][106226] Updated weights for policy 0, policy_version 352118 (0.0010) [2023-12-27 21:45:33,933][106226] Updated weights for policy 0, policy_version 352128 (0.0010) [2023-12-27 21:45:34,541][106226] Updated weights for policy 0, policy_version 352138 (0.0009) [2023-12-27 21:45:34,574][106225] Updated weights for policy 1, policy_version 352793 (0.0008) [2023-12-27 21:45:34,600][106226] Updated weights for policy 0, policy_version 352148 (0.0006) [2023-12-27 21:45:34,635][106225] Updated weights for policy 1, policy_version 352803 (0.0007) [2023-12-27 21:45:34,661][106226] Updated weights for policy 0, policy_version 352158 (0.0006) [2023-12-27 21:45:34,695][106225] Updated weights for policy 1, policy_version 352813 (0.0007) [2023-12-27 21:45:34,722][106226] Updated weights for policy 0, policy_version 352168 (0.0006) [2023-12-27 21:45:35,398][106225] Updated weights for policy 1, policy_version 352823 (0.0009) [2023-12-27 21:45:35,413][106226] Updated weights for policy 0, policy_version 352178 (0.0008) [2023-12-27 21:45:35,451][106225] Updated weights for policy 1, policy_version 352833 (0.0010) [2023-12-27 21:45:35,463][106226] Updated weights for policy 0, policy_version 352188 (0.0010) [2023-12-27 21:45:35,502][106225] Updated weights for policy 1, policy_version 352843 (0.0010) [2023-12-27 21:45:35,520][106226] Updated weights for policy 0, policy_version 352198 (0.0010) [2023-12-27 21:45:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 180551680. Throughput: 0: 9982.7, 1: 9834.9. Samples: 180566416. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:36,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.912')] [2023-12-27 21:45:36,183][106226] Updated weights for policy 0, policy_version 352208 (0.0007) [2023-12-27 21:45:36,247][106226] Updated weights for policy 0, policy_version 352218 (0.0006) [2023-12-27 21:45:36,274][106225] Updated weights for policy 1, policy_version 352853 (0.0010) [2023-12-27 21:45:36,313][106226] Updated weights for policy 0, policy_version 352228 (0.0009) [2023-12-27 21:45:36,340][106225] Updated weights for policy 1, policy_version 352863 (0.0011) [2023-12-27 21:45:36,404][106225] Updated weights for policy 1, policy_version 352873 (0.0010) [2023-12-27 21:45:37,009][106226] Updated weights for policy 0, policy_version 352238 (0.0009) [2023-12-27 21:45:37,067][106225] Updated weights for policy 1, policy_version 352883 (0.0010) [2023-12-27 21:45:37,070][106226] Updated weights for policy 0, policy_version 352248 (0.0007) [2023-12-27 21:45:37,116][106225] Updated weights for policy 1, policy_version 352893 (0.0010) [2023-12-27 21:45:37,130][106226] Updated weights for policy 0, policy_version 352258 (0.0006) [2023-12-27 21:45:37,176][106225] Updated weights for policy 1, policy_version 352903 (0.0011) [2023-12-27 21:45:37,793][106226] Updated weights for policy 0, policy_version 352268 (0.0006) [2023-12-27 21:45:37,822][106225] Updated weights for policy 1, policy_version 352913 (0.0010) [2023-12-27 21:45:37,852][106226] Updated weights for policy 0, policy_version 352278 (0.0008) [2023-12-27 21:45:37,876][106225] Updated weights for policy 1, policy_version 352923 (0.0005) [2023-12-27 21:45:37,905][106226] Updated weights for policy 0, policy_version 352288 (0.0008) [2023-12-27 21:45:37,921][106225] Updated weights for policy 1, policy_version 352933 (0.0005) [2023-12-27 21:45:37,968][106225] Updated weights for policy 1, policy_version 352943 (0.0005) [2023-12-27 21:45:38,651][106226] Updated weights for policy 0, policy_version 352298 (0.0008) [2023-12-27 21:45:38,657][106225] Updated weights for policy 1, policy_version 352953 (0.0010) [2023-12-27 21:45:38,713][106226] Updated weights for policy 0, policy_version 352308 (0.0006) [2023-12-27 21:45:38,716][106225] Updated weights for policy 1, policy_version 352963 (0.0010) [2023-12-27 21:45:38,771][106226] Updated weights for policy 0, policy_version 352318 (0.0005) [2023-12-27 21:45:38,780][106225] Updated weights for policy 1, policy_version 352973 (0.0010) [2023-12-27 21:45:38,832][106226] Updated weights for policy 0, policy_version 352328 (0.0006) [2023-12-27 21:45:39,489][106225] Updated weights for policy 1, policy_version 352983 (0.0010) [2023-12-27 21:45:39,558][106225] Updated weights for policy 1, policy_version 352993 (0.0010) [2023-12-27 21:45:39,570][106226] Updated weights for policy 0, policy_version 352338 (0.0006) [2023-12-27 21:45:39,617][106225] Updated weights for policy 1, policy_version 353003 (0.0010) [2023-12-27 21:45:39,631][106226] Updated weights for policy 0, policy_version 352348 (0.0006) [2023-12-27 21:45:39,683][106226] Updated weights for policy 0, policy_version 352358 (0.0007) [2023-12-27 21:45:40,329][106225] Updated weights for policy 1, policy_version 353013 (0.0010) [2023-12-27 21:45:40,393][106225] Updated weights for policy 1, policy_version 353023 (0.0010) [2023-12-27 21:45:40,430][106226] Updated weights for policy 0, policy_version 352368 (0.0007) [2023-12-27 21:45:40,452][106225] Updated weights for policy 1, policy_version 353033 (0.0011) [2023-12-27 21:45:40,492][106226] Updated weights for policy 0, policy_version 352378 (0.0007) [2023-12-27 21:45:40,556][106226] Updated weights for policy 0, policy_version 352388 (0.0007) [2023-12-27 21:45:41,167][106225] Updated weights for policy 1, policy_version 353043 (0.0011) [2023-12-27 21:45:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 180649984. Throughput: 0: 9977.4, 1: 9888.7. Samples: 180626348. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:41,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-5.822')] [2023-12-27 21:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000352392_90243072.pth... [2023-12-27 21:45:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000351240_89948160.pth [2023-12-27 21:45:41,239][106225] Updated weights for policy 1, policy_version 353053 (0.0011) [2023-12-27 21:45:41,274][106226] Updated weights for policy 0, policy_version 352398 (0.0008) [2023-12-27 21:45:41,295][106225] Updated weights for policy 1, policy_version 353063 (0.0010) [2023-12-27 21:45:41,330][106226] Updated weights for policy 0, policy_version 352408 (0.0008) [2023-12-27 21:45:41,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000353072_90415104.pth... [2023-12-27 21:45:41,354][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000351888_90112000.pth [2023-12-27 21:45:41,404][106226] Updated weights for policy 0, policy_version 352418 (0.0008) [2023-12-27 21:45:42,041][106225] Updated weights for policy 1, policy_version 353073 (0.0010) [2023-12-27 21:45:42,108][106225] Updated weights for policy 1, policy_version 353083 (0.0005) [2023-12-27 21:45:42,132][106226] Updated weights for policy 0, policy_version 352428 (0.0008) [2023-12-27 21:45:42,167][106225] Updated weights for policy 1, policy_version 353093 (0.0008) [2023-12-27 21:45:42,190][106226] Updated weights for policy 0, policy_version 352438 (0.0010) [2023-12-27 21:45:42,224][106225] Updated weights for policy 1, policy_version 353103 (0.0010) [2023-12-27 21:45:42,247][106226] Updated weights for policy 0, policy_version 352448 (0.0008) [2023-12-27 21:45:42,892][106225] Updated weights for policy 1, policy_version 353113 (0.0010) [2023-12-27 21:45:42,949][106226] Updated weights for policy 0, policy_version 352458 (0.0010) [2023-12-27 21:45:42,959][106225] Updated weights for policy 1, policy_version 353123 (0.0011) [2023-12-27 21:45:43,000][106226] Updated weights for policy 0, policy_version 352468 (0.0005) [2023-12-27 21:45:43,022][106225] Updated weights for policy 1, policy_version 353133 (0.0010) [2023-12-27 21:45:43,059][106226] Updated weights for policy 0, policy_version 352478 (0.0008) [2023-12-27 21:45:43,119][106226] Updated weights for policy 0, policy_version 352488 (0.0010) [2023-12-27 21:45:43,678][106225] Updated weights for policy 1, policy_version 353143 (0.0010) [2023-12-27 21:45:43,738][106225] Updated weights for policy 1, policy_version 353153 (0.0010) [2023-12-27 21:45:43,752][106226] Updated weights for policy 0, policy_version 352498 (0.0006) [2023-12-27 21:45:43,796][106225] Updated weights for policy 1, policy_version 353163 (0.0010) [2023-12-27 21:45:43,812][106226] Updated weights for policy 0, policy_version 352508 (0.0005) [2023-12-27 21:45:43,878][106226] Updated weights for policy 0, policy_version 352518 (0.0005) [2023-12-27 21:45:44,459][106225] Updated weights for policy 1, policy_version 353173 (0.0010) [2023-12-27 21:45:44,504][106226] Updated weights for policy 0, policy_version 352528 (0.0010) [2023-12-27 21:45:44,518][106225] Updated weights for policy 1, policy_version 353183 (0.0010) [2023-12-27 21:45:44,562][106226] Updated weights for policy 0, policy_version 352538 (0.0005) [2023-12-27 21:45:44,571][106225] Updated weights for policy 1, policy_version 353193 (0.0010) [2023-12-27 21:45:44,621][106226] Updated weights for policy 0, policy_version 352548 (0.0010) [2023-12-27 21:45:45,294][106225] Updated weights for policy 1, policy_version 353203 (0.0011) [2023-12-27 21:45:45,301][106226] Updated weights for policy 0, policy_version 352558 (0.0011) [2023-12-27 21:45:45,355][106225] Updated weights for policy 1, policy_version 353213 (0.0010) [2023-12-27 21:45:45,363][106226] Updated weights for policy 0, policy_version 352568 (0.0011) [2023-12-27 21:45:45,416][106225] Updated weights for policy 1, policy_version 353223 (0.0011) [2023-12-27 21:45:45,425][106226] Updated weights for policy 0, policy_version 352578 (0.0009) [2023-12-27 21:45:46,060][106225] Updated weights for policy 1, policy_version 353233 (0.0010) [2023-12-27 21:45:46,118][106225] Updated weights for policy 1, policy_version 353243 (0.0010) [2023-12-27 21:45:46,120][106226] Updated weights for policy 0, policy_version 352588 (0.0010) [2023-12-27 21:45:46,174][106226] Updated weights for policy 0, policy_version 352598 (0.0008) [2023-12-27 21:45:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 180748288. Throughput: 0: 10019.1, 1: 9838.4. Samples: 180744964. Policy #0 lag: (min: 7.0, avg: 9.3, max: 39.0) [2023-12-27 21:45:46,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.495')] [2023-12-27 21:45:46,181][106225] Updated weights for policy 1, policy_version 353253 (0.0010) [2023-12-27 21:45:46,223][106226] Updated weights for policy 0, policy_version 352608 (0.0006) [2023-12-27 21:45:46,245][106225] Updated weights for policy 1, policy_version 353263 (0.0010) [2023-12-27 21:45:46,848][106226] Updated weights for policy 0, policy_version 352618 (0.0007) [2023-12-27 21:45:46,903][106226] Updated weights for policy 0, policy_version 352628 (0.0011) [2023-12-27 21:45:46,917][106225] Updated weights for policy 1, policy_version 353273 (0.0006) [2023-12-27 21:45:46,960][106226] Updated weights for policy 0, policy_version 352638 (0.0010) [2023-12-27 21:45:46,985][106225] Updated weights for policy 1, policy_version 353283 (0.0007) [2023-12-27 21:45:47,024][106226] Updated weights for policy 0, policy_version 352648 (0.0010) [2023-12-27 21:45:47,046][106225] Updated weights for policy 1, policy_version 353293 (0.0008) [2023-12-27 21:45:47,661][106225] Updated weights for policy 1, policy_version 353303 (0.0009) [2023-12-27 21:45:47,682][106226] Updated weights for policy 0, policy_version 352658 (0.0010) [2023-12-27 21:45:47,720][106225] Updated weights for policy 1, policy_version 353313 (0.0010) [2023-12-27 21:45:47,738][106226] Updated weights for policy 0, policy_version 352668 (0.0011) [2023-12-27 21:45:47,784][106225] Updated weights for policy 1, policy_version 353323 (0.0011) [2023-12-27 21:45:47,800][106226] Updated weights for policy 0, policy_version 352678 (0.0011) [2023-12-27 21:45:48,448][106226] Updated weights for policy 0, policy_version 352688 (0.0009) [2023-12-27 21:45:48,507][106226] Updated weights for policy 0, policy_version 352698 (0.0008) [2023-12-27 21:45:48,535][106225] Updated weights for policy 1, policy_version 353333 (0.0010) [2023-12-27 21:45:48,565][106226] Updated weights for policy 0, policy_version 352708 (0.0006) [2023-12-27 21:45:48,598][106225] Updated weights for policy 1, policy_version 353343 (0.0011) [2023-12-27 21:45:48,661][106225] Updated weights for policy 1, policy_version 353353 (0.0010) [2023-12-27 21:45:49,319][106226] Updated weights for policy 0, policy_version 352718 (0.0008) [2023-12-27 21:45:49,385][106226] Updated weights for policy 0, policy_version 352728 (0.0007) [2023-12-27 21:45:49,445][106226] Updated weights for policy 0, policy_version 352738 (0.0008) [2023-12-27 21:45:49,448][106225] Updated weights for policy 1, policy_version 353363 (0.0010) [2023-12-27 21:45:49,511][106225] Updated weights for policy 1, policy_version 353373 (0.0008) [2023-12-27 21:45:49,570][106225] Updated weights for policy 1, policy_version 353383 (0.0007) [2023-12-27 21:45:50,231][106225] Updated weights for policy 1, policy_version 353393 (0.0010) [2023-12-27 21:45:50,247][106226] Updated weights for policy 0, policy_version 352748 (0.0007) [2023-12-27 21:45:50,294][106225] Updated weights for policy 1, policy_version 353403 (0.0010) [2023-12-27 21:45:50,303][106226] Updated weights for policy 0, policy_version 352758 (0.0007) [2023-12-27 21:45:50,357][106225] Updated weights for policy 1, policy_version 353413 (0.0010) [2023-12-27 21:45:50,369][106226] Updated weights for policy 0, policy_version 352768 (0.0007) [2023-12-27 21:45:50,416][106225] Updated weights for policy 1, policy_version 353423 (0.0009) [2023-12-27 21:45:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 180846592. Throughput: 0: 9977.3, 1: 9828.0. Samples: 180862428. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:45:51,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-5.599')] [2023-12-27 21:45:51,234][106226] Updated weights for policy 0, policy_version 352778 (0.0007) [2023-12-27 21:45:51,264][106225] Updated weights for policy 1, policy_version 353433 (0.0010) [2023-12-27 21:45:51,296][106226] Updated weights for policy 0, policy_version 352788 (0.0009) [2023-12-27 21:45:51,326][106225] Updated weights for policy 1, policy_version 353443 (0.0010) [2023-12-27 21:45:51,365][106226] Updated weights for policy 0, policy_version 352798 (0.0010) [2023-12-27 21:45:51,404][106225] Updated weights for policy 1, policy_version 353454 (0.0008) [2023-12-27 21:45:51,430][106226] Updated weights for policy 0, policy_version 352808 (0.0008) [2023-12-27 21:45:52,183][106225] Updated weights for policy 1, policy_version 353464 (0.0007) [2023-12-27 21:45:52,185][106226] Updated weights for policy 0, policy_version 352818 (0.0008) [2023-12-27 21:45:52,249][106226] Updated weights for policy 0, policy_version 352828 (0.0007) [2023-12-27 21:45:52,252][106225] Updated weights for policy 1, policy_version 353474 (0.0008) [2023-12-27 21:45:52,315][106226] Updated weights for policy 0, policy_version 352838 (0.0006) [2023-12-27 21:45:52,317][106225] Updated weights for policy 1, policy_version 353484 (0.0009) [2023-12-27 21:45:53,068][106225] Updated weights for policy 1, policy_version 353494 (0.0007) [2023-12-27 21:45:53,075][106226] Updated weights for policy 0, policy_version 352848 (0.0006) [2023-12-27 21:45:53,127][106225] Updated weights for policy 1, policy_version 353504 (0.0005) [2023-12-27 21:45:53,129][106226] Updated weights for policy 0, policy_version 352858 (0.0007) [2023-12-27 21:45:53,176][106225] Updated weights for policy 1, policy_version 353514 (0.0008) [2023-12-27 21:45:53,191][106226] Updated weights for policy 0, policy_version 352868 (0.0008) [2023-12-27 21:45:53,870][106226] Updated weights for policy 0, policy_version 352878 (0.0008) [2023-12-27 21:45:53,931][106225] Updated weights for policy 1, policy_version 353524 (0.0006) [2023-12-27 21:45:53,933][106226] Updated weights for policy 0, policy_version 352888 (0.0011) [2023-12-27 21:45:53,991][106225] Updated weights for policy 1, policy_version 353534 (0.0005) [2023-12-27 21:45:53,996][106226] Updated weights for policy 0, policy_version 352898 (0.0011) [2023-12-27 21:45:54,049][106225] Updated weights for policy 1, policy_version 353544 (0.0007) [2023-12-27 21:45:54,665][106226] Updated weights for policy 0, policy_version 352908 (0.0009) [2023-12-27 21:45:54,724][106226] Updated weights for policy 0, policy_version 352918 (0.0006) [2023-12-27 21:45:54,784][106226] Updated weights for policy 0, policy_version 352928 (0.0006) [2023-12-27 21:45:54,792][106225] Updated weights for policy 1, policy_version 353554 (0.0008) [2023-12-27 21:45:54,851][106225] Updated weights for policy 1, policy_version 353564 (0.0008) [2023-12-27 21:45:54,905][106225] Updated weights for policy 1, policy_version 353574 (0.0008) [2023-12-27 21:45:54,967][106225] Updated weights for policy 1, policy_version 353584 (0.0009) [2023-12-27 21:45:55,489][106226] Updated weights for policy 0, policy_version 352938 (0.0008) [2023-12-27 21:45:55,539][106226] Updated weights for policy 0, policy_version 352948 (0.0009) [2023-12-27 21:45:55,589][106226] Updated weights for policy 0, policy_version 352958 (0.0009) [2023-12-27 21:45:55,648][106226] Updated weights for policy 0, policy_version 352968 (0.0008) [2023-12-27 21:45:55,690][106225] Updated weights for policy 1, policy_version 353594 (0.0008) [2023-12-27 21:45:55,746][106225] Updated weights for policy 1, policy_version 353604 (0.0008) [2023-12-27 21:45:55,798][106225] Updated weights for policy 1, policy_version 353614 (0.0008) [2023-12-27 21:45:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 180944896. Throughput: 0: 9912.5, 1: 9804.9. Samples: 180917356. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:45:56,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-6.017')] [2023-12-27 21:45:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000352968_90390528.pth... [2023-12-27 21:45:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000353616_90554368.pth... [2023-12-27 21:45:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000352464_90259456.pth [2023-12-27 21:45:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000351816_90095616.pth [2023-12-27 21:45:56,420][106226] Updated weights for policy 0, policy_version 352978 (0.0008) [2023-12-27 21:45:56,484][106226] Updated weights for policy 0, policy_version 352988 (0.0008) [2023-12-27 21:45:56,552][106226] Updated weights for policy 0, policy_version 352998 (0.0006) [2023-12-27 21:45:56,578][106225] Updated weights for policy 1, policy_version 353624 (0.0008) [2023-12-27 21:45:56,640][106225] Updated weights for policy 1, policy_version 353634 (0.0008) [2023-12-27 21:45:56,702][106225] Updated weights for policy 1, policy_version 353644 (0.0008) [2023-12-27 21:45:57,217][106226] Updated weights for policy 0, policy_version 353008 (0.0008) [2023-12-27 21:45:57,284][106226] Updated weights for policy 0, policy_version 353018 (0.0007) [2023-12-27 21:45:57,353][106226] Updated weights for policy 0, policy_version 353028 (0.0008) [2023-12-27 21:45:57,488][106225] Updated weights for policy 1, policy_version 353654 (0.0009) [2023-12-27 21:45:57,541][106225] Updated weights for policy 1, policy_version 353664 (0.0009) [2023-12-27 21:45:57,602][106225] Updated weights for policy 1, policy_version 353674 (0.0009) [2023-12-27 21:45:57,968][106226] Updated weights for policy 0, policy_version 353038 (0.0008) [2023-12-27 21:45:58,022][106226] Updated weights for policy 0, policy_version 353048 (0.0008) [2023-12-27 21:45:58,081][106226] Updated weights for policy 0, policy_version 353058 (0.0006) [2023-12-27 21:45:58,331][106225] Updated weights for policy 1, policy_version 353684 (0.0008) [2023-12-27 21:45:58,394][106225] Updated weights for policy 1, policy_version 353694 (0.0008) [2023-12-27 21:45:58,461][106225] Updated weights for policy 1, policy_version 353704 (0.0008) [2023-12-27 21:45:58,803][106226] Updated weights for policy 0, policy_version 353068 (0.0008) [2023-12-27 21:45:58,878][106226] Updated weights for policy 0, policy_version 353078 (0.0008) [2023-12-27 21:45:58,946][106226] Updated weights for policy 0, policy_version 353088 (0.0007) [2023-12-27 21:45:59,209][106225] Updated weights for policy 1, policy_version 353714 (0.0008) [2023-12-27 21:45:59,274][106225] Updated weights for policy 1, policy_version 353724 (0.0008) [2023-12-27 21:45:59,334][106225] Updated weights for policy 1, policy_version 353734 (0.0008) [2023-12-27 21:45:59,396][106225] Updated weights for policy 1, policy_version 353744 (0.0007) [2023-12-27 21:45:59,707][106226] Updated weights for policy 0, policy_version 353098 (0.0009) [2023-12-27 21:45:59,767][106226] Updated weights for policy 0, policy_version 353108 (0.0010) [2023-12-27 21:45:59,836][106226] Updated weights for policy 0, policy_version 353118 (0.0008) [2023-12-27 21:45:59,901][106226] Updated weights for policy 0, policy_version 353128 (0.0009) [2023-12-27 21:46:00,145][106225] Updated weights for policy 1, policy_version 353754 (0.0005) [2023-12-27 21:46:00,193][106225] Updated weights for policy 1, policy_version 353764 (0.0006) [2023-12-27 21:46:00,244][106225] Updated weights for policy 1, policy_version 353774 (0.0007) [2023-12-27 21:46:00,554][106226] Updated weights for policy 0, policy_version 353138 (0.0005) [2023-12-27 21:46:00,622][106226] Updated weights for policy 0, policy_version 353148 (0.0008) [2023-12-27 21:46:00,683][106226] Updated weights for policy 0, policy_version 353158 (0.0006) [2023-12-27 21:46:00,796][106225] Updated weights for policy 1, policy_version 353784 (0.0006) [2023-12-27 21:46:00,845][106225] Updated weights for policy 1, policy_version 353794 (0.0006) [2023-12-27 21:46:00,895][106225] Updated weights for policy 1, policy_version 353804 (0.0008) [2023-12-27 21:46:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 181043200. Throughput: 0: 9957.7, 1: 9745.9. Samples: 181030300. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:01,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-5.615')] [2023-12-27 21:46:01,275][106226] Updated weights for policy 0, policy_version 353168 (0.0007) [2023-12-27 21:46:01,326][106226] Updated weights for policy 0, policy_version 353178 (0.0005) [2023-12-27 21:46:01,395][106226] Updated weights for policy 0, policy_version 353188 (0.0008) [2023-12-27 21:46:01,609][106225] Updated weights for policy 1, policy_version 353814 (0.0007) [2023-12-27 21:46:01,673][106225] Updated weights for policy 1, policy_version 353824 (0.0008) [2023-12-27 21:46:01,738][106225] Updated weights for policy 1, policy_version 353834 (0.0008) [2023-12-27 21:46:02,073][106226] Updated weights for policy 0, policy_version 353198 (0.0009) [2023-12-27 21:46:02,140][106226] Updated weights for policy 0, policy_version 353208 (0.0009) [2023-12-27 21:46:02,197][106226] Updated weights for policy 0, policy_version 353218 (0.0008) [2023-12-27 21:46:02,481][106225] Updated weights for policy 1, policy_version 353844 (0.0006) [2023-12-27 21:46:02,537][106225] Updated weights for policy 1, policy_version 353854 (0.0008) [2023-12-27 21:46:02,594][106225] Updated weights for policy 1, policy_version 353864 (0.0010) [2023-12-27 21:46:02,978][106226] Updated weights for policy 0, policy_version 353228 (0.0007) [2023-12-27 21:46:03,028][106226] Updated weights for policy 0, policy_version 353238 (0.0009) [2023-12-27 21:46:03,091][106226] Updated weights for policy 0, policy_version 353248 (0.0010) [2023-12-27 21:46:03,157][106225] Updated weights for policy 1, policy_version 353874 (0.0009) [2023-12-27 21:46:03,219][106225] Updated weights for policy 1, policy_version 353884 (0.0010) [2023-12-27 21:46:03,269][106225] Updated weights for policy 1, policy_version 353894 (0.0010) [2023-12-27 21:46:03,322][106225] Updated weights for policy 1, policy_version 353904 (0.0010) [2023-12-27 21:46:03,827][106226] Updated weights for policy 0, policy_version 353258 (0.0008) [2023-12-27 21:46:03,898][106226] Updated weights for policy 0, policy_version 353268 (0.0009) [2023-12-27 21:46:03,958][106226] Updated weights for policy 0, policy_version 353278 (0.0009) [2023-12-27 21:46:04,020][106226] Updated weights for policy 0, policy_version 353288 (0.0011) [2023-12-27 21:46:04,030][106225] Updated weights for policy 1, policy_version 353914 (0.0008) [2023-12-27 21:46:04,088][106225] Updated weights for policy 1, policy_version 353924 (0.0010) [2023-12-27 21:46:04,155][106225] Updated weights for policy 1, policy_version 353934 (0.0009) [2023-12-27 21:46:04,754][106226] Updated weights for policy 0, policy_version 353298 (0.0007) [2023-12-27 21:46:04,819][106226] Updated weights for policy 0, policy_version 353308 (0.0006) [2023-12-27 21:46:04,831][106225] Updated weights for policy 1, policy_version 353944 (0.0008) [2023-12-27 21:46:04,881][106226] Updated weights for policy 0, policy_version 353318 (0.0006) [2023-12-27 21:46:04,894][106225] Updated weights for policy 1, policy_version 353954 (0.0008) [2023-12-27 21:46:04,945][106225] Updated weights for policy 1, policy_version 353964 (0.0007) [2023-12-27 21:46:05,422][106226] Updated weights for policy 0, policy_version 353328 (0.0005) [2023-12-27 21:46:05,475][106226] Updated weights for policy 0, policy_version 353338 (0.0005) [2023-12-27 21:46:05,530][106226] Updated weights for policy 0, policy_version 353348 (0.0005) [2023-12-27 21:46:05,628][106225] Updated weights for policy 1, policy_version 353974 (0.0006) [2023-12-27 21:46:05,679][106225] Updated weights for policy 1, policy_version 353984 (0.0005) [2023-12-27 21:46:05,737][106225] Updated weights for policy 1, policy_version 353994 (0.0007) [2023-12-27 21:46:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 181141504. Throughput: 0: 9954.0, 1: 9888.4. Samples: 181154392. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:06,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-5.735')] [2023-12-27 21:46:06,184][106226] Updated weights for policy 0, policy_version 353358 (0.0007) [2023-12-27 21:46:06,251][106226] Updated weights for policy 0, policy_version 353368 (0.0011) [2023-12-27 21:46:06,316][106226] Updated weights for policy 0, policy_version 353378 (0.0011) [2023-12-27 21:46:06,359][106225] Updated weights for policy 1, policy_version 354004 (0.0009) [2023-12-27 21:46:06,421][106225] Updated weights for policy 1, policy_version 354014 (0.0008) [2023-12-27 21:46:06,483][106225] Updated weights for policy 1, policy_version 354024 (0.0008) [2023-12-27 21:46:06,941][106226] Updated weights for policy 0, policy_version 353388 (0.0011) [2023-12-27 21:46:06,988][106226] Updated weights for policy 0, policy_version 353398 (0.0010) [2023-12-27 21:46:07,044][106226] Updated weights for policy 0, policy_version 353408 (0.0010) [2023-12-27 21:46:07,202][106225] Updated weights for policy 1, policy_version 354034 (0.0007) [2023-12-27 21:46:07,255][106225] Updated weights for policy 1, policy_version 354044 (0.0005) [2023-12-27 21:46:07,302][106225] Updated weights for policy 1, policy_version 354054 (0.0005) [2023-12-27 21:46:07,362][106225] Updated weights for policy 1, policy_version 354064 (0.0005) [2023-12-27 21:46:07,668][106226] Updated weights for policy 0, policy_version 353418 (0.0010) [2023-12-27 21:46:07,724][106226] Updated weights for policy 0, policy_version 353428 (0.0010) [2023-12-27 21:46:07,786][106226] Updated weights for policy 0, policy_version 353438 (0.0007) [2023-12-27 21:46:07,852][106226] Updated weights for policy 0, policy_version 353448 (0.0010) [2023-12-27 21:46:07,977][106225] Updated weights for policy 1, policy_version 354074 (0.0008) [2023-12-27 21:46:08,034][106225] Updated weights for policy 1, policy_version 354084 (0.0010) [2023-12-27 21:46:08,087][106225] Updated weights for policy 1, policy_version 354094 (0.0010) [2023-12-27 21:46:08,541][106226] Updated weights for policy 0, policy_version 353458 (0.0011) [2023-12-27 21:46:08,594][106226] Updated weights for policy 0, policy_version 353468 (0.0010) [2023-12-27 21:46:08,651][106226] Updated weights for policy 0, policy_version 353478 (0.0011) [2023-12-27 21:46:08,737][106225] Updated weights for policy 1, policy_version 354104 (0.0008) [2023-12-27 21:46:08,800][106225] Updated weights for policy 1, policy_version 354114 (0.0010) [2023-12-27 21:46:08,869][106225] Updated weights for policy 1, policy_version 354124 (0.0011) [2023-12-27 21:46:09,344][106226] Updated weights for policy 0, policy_version 353488 (0.0010) [2023-12-27 21:46:09,410][106226] Updated weights for policy 0, policy_version 353498 (0.0010) [2023-12-27 21:46:09,477][106226] Updated weights for policy 0, policy_version 353508 (0.0011) [2023-12-27 21:46:09,603][106225] Updated weights for policy 1, policy_version 354134 (0.0008) [2023-12-27 21:46:09,669][106225] Updated weights for policy 1, policy_version 354144 (0.0006) [2023-12-27 21:46:09,738][106225] Updated weights for policy 1, policy_version 354154 (0.0006) [2023-12-27 21:46:10,273][106226] Updated weights for policy 0, policy_version 353518 (0.0011) [2023-12-27 21:46:10,334][106226] Updated weights for policy 0, policy_version 353528 (0.0011) [2023-12-27 21:46:10,398][106226] Updated weights for policy 0, policy_version 353538 (0.0011) [2023-12-27 21:46:10,498][106225] Updated weights for policy 1, policy_version 354164 (0.0009) [2023-12-27 21:46:10,560][106225] Updated weights for policy 1, policy_version 354174 (0.0010) [2023-12-27 21:46:10,623][106225] Updated weights for policy 1, policy_version 354184 (0.0007) [2023-12-27 21:46:11,088][106226] Updated weights for policy 0, policy_version 353548 (0.0010) [2023-12-27 21:46:11,153][106226] Updated weights for policy 0, policy_version 353558 (0.0007) [2023-12-27 21:46:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 181239808. Throughput: 0: 10039.2, 1: 9957.9. Samples: 181217300. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:11,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.232')] [2023-12-27 21:46:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000354192_90701824.pth... [2023-12-27 21:46:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000353072_90415104.pth [2023-12-27 21:46:11,216][106226] Updated weights for policy 0, policy_version 353568 (0.0008) [2023-12-27 21:46:11,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000353576_90546176.pth... [2023-12-27 21:46:11,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000352392_90243072.pth [2023-12-27 21:46:11,403][106225] Updated weights for policy 1, policy_version 354194 (0.0009) [2023-12-27 21:46:11,464][106225] Updated weights for policy 1, policy_version 354204 (0.0008) [2023-12-27 21:46:11,528][106225] Updated weights for policy 1, policy_version 354214 (0.0010) [2023-12-27 21:46:11,595][106225] Updated weights for policy 1, policy_version 354224 (0.0008) [2023-12-27 21:46:11,978][106226] Updated weights for policy 0, policy_version 353578 (0.0010) [2023-12-27 21:46:12,038][106226] Updated weights for policy 0, policy_version 353588 (0.0009) [2023-12-27 21:46:12,106][106226] Updated weights for policy 0, policy_version 353598 (0.0007) [2023-12-27 21:46:12,176][106226] Updated weights for policy 0, policy_version 353608 (0.0006) [2023-12-27 21:46:12,399][106225] Updated weights for policy 1, policy_version 354234 (0.0008) [2023-12-27 21:46:12,457][106225] Updated weights for policy 1, policy_version 354244 (0.0008) [2023-12-27 21:46:12,506][106225] Updated weights for policy 1, policy_version 354254 (0.0008) [2023-12-27 21:46:12,908][106226] Updated weights for policy 0, policy_version 353618 (0.0009) [2023-12-27 21:46:12,958][106226] Updated weights for policy 0, policy_version 353628 (0.0008) [2023-12-27 21:46:13,007][106226] Updated weights for policy 0, policy_version 353638 (0.0008) [2023-12-27 21:46:13,233][106225] Updated weights for policy 1, policy_version 354264 (0.0008) [2023-12-27 21:46:13,291][106225] Updated weights for policy 1, policy_version 354274 (0.0008) [2023-12-27 21:46:13,342][106225] Updated weights for policy 1, policy_version 354284 (0.0008) [2023-12-27 21:46:13,748][106226] Updated weights for policy 0, policy_version 353648 (0.0008) [2023-12-27 21:46:13,809][106226] Updated weights for policy 0, policy_version 353658 (0.0008) [2023-12-27 21:46:13,868][106226] Updated weights for policy 0, policy_version 353668 (0.0008) [2023-12-27 21:46:14,067][106225] Updated weights for policy 1, policy_version 354294 (0.0006) [2023-12-27 21:46:14,131][106225] Updated weights for policy 1, policy_version 354304 (0.0008) [2023-12-27 21:46:14,183][106225] Updated weights for policy 1, policy_version 354314 (0.0008) [2023-12-27 21:46:14,566][106226] Updated weights for policy 0, policy_version 353678 (0.0008) [2023-12-27 21:46:14,626][106226] Updated weights for policy 0, policy_version 353688 (0.0007) [2023-12-27 21:46:14,691][106226] Updated weights for policy 0, policy_version 353698 (0.0007) [2023-12-27 21:46:14,935][106225] Updated weights for policy 1, policy_version 354324 (0.0009) [2023-12-27 21:46:15,003][106225] Updated weights for policy 1, policy_version 354334 (0.0011) [2023-12-27 21:46:15,069][106225] Updated weights for policy 1, policy_version 354344 (0.0010) [2023-12-27 21:46:15,396][106226] Updated weights for policy 0, policy_version 353708 (0.0008) [2023-12-27 21:46:15,453][106226] Updated weights for policy 0, policy_version 353718 (0.0007) [2023-12-27 21:46:15,503][106226] Updated weights for policy 0, policy_version 353728 (0.0008) [2023-12-27 21:46:15,782][106225] Updated weights for policy 1, policy_version 354354 (0.0011) [2023-12-27 21:46:15,839][106225] Updated weights for policy 1, policy_version 354364 (0.0010) [2023-12-27 21:46:15,898][106225] Updated weights for policy 1, policy_version 354374 (0.0010) [2023-12-27 21:46:15,958][106225] Updated weights for policy 1, policy_version 354384 (0.0010) [2023-12-27 21:46:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 181338112. Throughput: 0: 9930.5, 1: 9797.9. Samples: 181330440. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:16,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-5.741')] [2023-12-27 21:46:16,229][106226] Updated weights for policy 0, policy_version 353738 (0.0008) [2023-12-27 21:46:16,279][106226] Updated weights for policy 0, policy_version 353748 (0.0008) [2023-12-27 21:46:16,324][106226] Updated weights for policy 0, policy_version 353758 (0.0007) [2023-12-27 21:46:16,378][106226] Updated weights for policy 0, policy_version 353768 (0.0008) [2023-12-27 21:46:16,667][106225] Updated weights for policy 1, policy_version 354394 (0.0010) [2023-12-27 21:46:16,716][106225] Updated weights for policy 1, policy_version 354404 (0.0010) [2023-12-27 21:46:16,778][106225] Updated weights for policy 1, policy_version 354414 (0.0010) [2023-12-27 21:46:17,071][106226] Updated weights for policy 0, policy_version 353778 (0.0010) [2023-12-27 21:46:17,118][106226] Updated weights for policy 0, policy_version 353788 (0.0011) [2023-12-27 21:46:17,164][106226] Updated weights for policy 0, policy_version 353798 (0.0008) [2023-12-27 21:46:17,503][106225] Updated weights for policy 1, policy_version 354424 (0.0010) [2023-12-27 21:46:17,569][106225] Updated weights for policy 1, policy_version 354434 (0.0010) [2023-12-27 21:46:17,632][106225] Updated weights for policy 1, policy_version 354444 (0.0010) [2023-12-27 21:46:17,828][106226] Updated weights for policy 0, policy_version 353808 (0.0006) [2023-12-27 21:46:17,882][106226] Updated weights for policy 0, policy_version 353818 (0.0007) [2023-12-27 21:46:17,932][106226] Updated weights for policy 0, policy_version 353828 (0.0005) [2023-12-27 21:46:18,331][106225] Updated weights for policy 1, policy_version 354454 (0.0010) [2023-12-27 21:46:18,387][106225] Updated weights for policy 1, policy_version 354464 (0.0007) [2023-12-27 21:46:18,446][106225] Updated weights for policy 1, policy_version 354474 (0.0008) [2023-12-27 21:46:18,504][106226] Updated weights for policy 0, policy_version 353838 (0.0009) [2023-12-27 21:46:18,567][106226] Updated weights for policy 0, policy_version 353848 (0.0010) [2023-12-27 21:46:18,626][106226] Updated weights for policy 0, policy_version 353858 (0.0006) [2023-12-27 21:46:19,157][106225] Updated weights for policy 1, policy_version 354484 (0.0008) [2023-12-27 21:46:19,183][106226] Updated weights for policy 0, policy_version 353868 (0.0006) [2023-12-27 21:46:19,217][106225] Updated weights for policy 1, policy_version 354494 (0.0010) [2023-12-27 21:46:19,247][106226] Updated weights for policy 0, policy_version 353878 (0.0007) [2023-12-27 21:46:19,279][106225] Updated weights for policy 1, policy_version 354504 (0.0009) [2023-12-27 21:46:19,308][106226] Updated weights for policy 0, policy_version 353888 (0.0008) [2023-12-27 21:46:20,052][106225] Updated weights for policy 1, policy_version 354514 (0.0007) [2023-12-27 21:46:20,099][106226] Updated weights for policy 0, policy_version 353898 (0.0011) [2023-12-27 21:46:20,113][106225] Updated weights for policy 1, policy_version 354524 (0.0010) [2023-12-27 21:46:20,156][106226] Updated weights for policy 0, policy_version 353908 (0.0008) [2023-12-27 21:46:20,172][106225] Updated weights for policy 1, policy_version 354534 (0.0011) [2023-12-27 21:46:20,212][106226] Updated weights for policy 0, policy_version 353918 (0.0008) [2023-12-27 21:46:20,234][106225] Updated weights for policy 1, policy_version 354544 (0.0010) [2023-12-27 21:46:20,260][106226] Updated weights for policy 0, policy_version 353928 (0.0008) [2023-12-27 21:46:20,876][106225] Updated weights for policy 1, policy_version 354554 (0.0007) [2023-12-27 21:46:20,942][106225] Updated weights for policy 1, policy_version 354564 (0.0007) [2023-12-27 21:46:20,997][106226] Updated weights for policy 0, policy_version 353938 (0.0008) [2023-12-27 21:46:21,008][106225] Updated weights for policy 1, policy_version 354574 (0.0010) [2023-12-27 21:46:21,063][106226] Updated weights for policy 0, policy_version 353948 (0.0008) [2023-12-27 21:46:21,119][106226] Updated weights for policy 0, policy_version 353958 (0.0008) [2023-12-27 21:46:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 181444608. Throughput: 0: 9878.8, 1: 9736.3. Samples: 181449092. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:21,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.923')] [2023-12-27 21:46:21,808][106225] Updated weights for policy 1, policy_version 354584 (0.0007) [2023-12-27 21:46:21,862][106226] Updated weights for policy 0, policy_version 353968 (0.0008) [2023-12-27 21:46:21,873][106225] Updated weights for policy 1, policy_version 354594 (0.0006) [2023-12-27 21:46:21,925][106226] Updated weights for policy 0, policy_version 353978 (0.0008) [2023-12-27 21:46:21,937][106225] Updated weights for policy 1, policy_version 354604 (0.0007) [2023-12-27 21:46:21,985][106226] Updated weights for policy 0, policy_version 353988 (0.0008) [2023-12-27 21:46:22,668][106225] Updated weights for policy 1, policy_version 354614 (0.0007) [2023-12-27 21:46:22,735][106225] Updated weights for policy 1, policy_version 354624 (0.0008) [2023-12-27 21:46:22,794][106226] Updated weights for policy 0, policy_version 353998 (0.0008) [2023-12-27 21:46:22,796][106225] Updated weights for policy 1, policy_version 354634 (0.0007) [2023-12-27 21:46:22,855][106226] Updated weights for policy 0, policy_version 354008 (0.0007) [2023-12-27 21:46:22,928][106226] Updated weights for policy 0, policy_version 354019 (0.0007) [2023-12-27 21:46:23,405][106225] Updated weights for policy 1, policy_version 354644 (0.0007) [2023-12-27 21:46:23,453][106225] Updated weights for policy 1, policy_version 354654 (0.0005) [2023-12-27 21:46:23,504][106225] Updated weights for policy 1, policy_version 354664 (0.0006) [2023-12-27 21:46:23,679][106226] Updated weights for policy 0, policy_version 354029 (0.0008) [2023-12-27 21:46:23,738][106226] Updated weights for policy 0, policy_version 354039 (0.0005) [2023-12-27 21:46:23,800][106226] Updated weights for policy 0, policy_version 354049 (0.0007) [2023-12-27 21:46:24,248][106225] Updated weights for policy 1, policy_version 354674 (0.0008) [2023-12-27 21:46:24,301][106225] Updated weights for policy 1, policy_version 354684 (0.0009) [2023-12-27 21:46:24,354][106225] Updated weights for policy 1, policy_version 354694 (0.0008) [2023-12-27 21:46:24,400][106225] Updated weights for policy 1, policy_version 354704 (0.0008) [2023-12-27 21:46:24,462][106226] Updated weights for policy 0, policy_version 354059 (0.0009) [2023-12-27 21:46:24,516][106226] Updated weights for policy 0, policy_version 354069 (0.0009) [2023-12-27 21:46:24,564][106226] Updated weights for policy 0, policy_version 354079 (0.0008) [2023-12-27 21:46:25,134][106225] Updated weights for policy 1, policy_version 354714 (0.0008) [2023-12-27 21:46:25,181][106225] Updated weights for policy 1, policy_version 354724 (0.0009) [2023-12-27 21:46:25,226][106225] Updated weights for policy 1, policy_version 354734 (0.0008) [2023-12-27 21:46:25,304][106226] Updated weights for policy 0, policy_version 354089 (0.0008) [2023-12-27 21:46:25,355][106226] Updated weights for policy 0, policy_version 354099 (0.0008) [2023-12-27 21:46:25,413][106226] Updated weights for policy 0, policy_version 354109 (0.0009) [2023-12-27 21:46:25,462][106226] Updated weights for policy 0, policy_version 354119 (0.0008) [2023-12-27 21:46:25,987][106225] Updated weights for policy 1, policy_version 354744 (0.0008) [2023-12-27 21:46:26,044][106225] Updated weights for policy 1, policy_version 354754 (0.0009) [2023-12-27 21:46:26,099][106225] Updated weights for policy 1, policy_version 354764 (0.0008) [2023-12-27 21:46:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 181534720. Throughput: 0: 9846.0, 1: 9698.8. Samples: 181505864. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:26,175][105115] Avg episode reward: [(0, '-4.947'), (1, '-5.831')] [2023-12-27 21:46:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000354768_90849280.pth... [2023-12-27 21:46:26,185][106226] Updated weights for policy 0, policy_version 354129 (0.0008) [2023-12-27 21:46:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000353616_90554368.pth [2023-12-27 21:46:26,248][106226] Updated weights for policy 0, policy_version 354139 (0.0009) [2023-12-27 21:46:26,309][106226] Updated weights for policy 0, policy_version 354149 (0.0008) [2023-12-27 21:46:26,330][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000354152_90693632.pth... [2023-12-27 21:46:26,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000352968_90390528.pth [2023-12-27 21:46:26,870][106225] Updated weights for policy 1, policy_version 354774 (0.0008) [2023-12-27 21:46:26,915][106225] Updated weights for policy 1, policy_version 354784 (0.0007) [2023-12-27 21:46:26,917][106226] Updated weights for policy 0, policy_version 354159 (0.0009) [2023-12-27 21:46:26,969][106225] Updated weights for policy 1, policy_version 354794 (0.0007) [2023-12-27 21:46:26,975][106226] Updated weights for policy 0, policy_version 354169 (0.0009) [2023-12-27 21:46:27,041][106226] Updated weights for policy 0, policy_version 354179 (0.0008) [2023-12-27 21:46:27,726][106225] Updated weights for policy 1, policy_version 354804 (0.0007) [2023-12-27 21:46:27,777][106225] Updated weights for policy 1, policy_version 354814 (0.0008) [2023-12-27 21:46:27,779][106226] Updated weights for policy 0, policy_version 354189 (0.0007) [2023-12-27 21:46:27,829][106225] Updated weights for policy 1, policy_version 354824 (0.0006) [2023-12-27 21:46:27,831][106226] Updated weights for policy 0, policy_version 354199 (0.0007) [2023-12-27 21:46:27,882][106226] Updated weights for policy 0, policy_version 354209 (0.0006) [2023-12-27 21:46:28,510][106225] Updated weights for policy 1, policy_version 354834 (0.0008) [2023-12-27 21:46:28,564][106225] Updated weights for policy 1, policy_version 354844 (0.0007) [2023-12-27 21:46:28,581][106226] Updated weights for policy 0, policy_version 354219 (0.0009) [2023-12-27 21:46:28,621][106225] Updated weights for policy 1, policy_version 354854 (0.0006) [2023-12-27 21:46:28,635][106226] Updated weights for policy 0, policy_version 354229 (0.0010) [2023-12-27 21:46:28,679][106225] Updated weights for policy 1, policy_version 354864 (0.0006) [2023-12-27 21:46:28,681][106226] Updated weights for policy 0, policy_version 354239 (0.0010) [2023-12-27 21:46:29,368][106226] Updated weights for policy 0, policy_version 354249 (0.0010) [2023-12-27 21:46:29,425][106226] Updated weights for policy 0, policy_version 354259 (0.0008) [2023-12-27 21:46:29,474][106226] Updated weights for policy 0, policy_version 354269 (0.0008) [2023-12-27 21:46:29,482][106225] Updated weights for policy 1, policy_version 354874 (0.0008) [2023-12-27 21:46:29,526][106226] Updated weights for policy 0, policy_version 354279 (0.0008) [2023-12-27 21:46:29,539][106225] Updated weights for policy 1, policy_version 354884 (0.0007) [2023-12-27 21:46:29,602][106225] Updated weights for policy 1, policy_version 354894 (0.0008) [2023-12-27 21:46:30,240][106226] Updated weights for policy 0, policy_version 354289 (0.0010) [2023-12-27 21:46:30,307][106226] Updated weights for policy 0, policy_version 354299 (0.0011) [2023-12-27 21:46:30,353][106225] Updated weights for policy 1, policy_version 354904 (0.0007) [2023-12-27 21:46:30,363][106226] Updated weights for policy 0, policy_version 354309 (0.0011) [2023-12-27 21:46:30,415][106225] Updated weights for policy 1, policy_version 354914 (0.0010) [2023-12-27 21:46:30,480][106225] Updated weights for policy 1, policy_version 354924 (0.0010) [2023-12-27 21:46:30,920][106226] Updated weights for policy 0, policy_version 354319 (0.0007) [2023-12-27 21:46:30,985][106226] Updated weights for policy 0, policy_version 354329 (0.0005) [2023-12-27 21:46:31,044][106226] Updated weights for policy 0, policy_version 354339 (0.0006) [2023-12-27 21:46:31,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 181633024. Throughput: 0: 9846.9, 1: 9649.2. Samples: 181622292. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:31,175][105115] Avg episode reward: [(0, '-4.767'), (1, '-5.443')] [2023-12-27 21:46:31,193][106225] Updated weights for policy 1, policy_version 354934 (0.0007) [2023-12-27 21:46:31,259][106225] Updated weights for policy 1, policy_version 354944 (0.0008) [2023-12-27 21:46:31,328][106225] Updated weights for policy 1, policy_version 354954 (0.0007) [2023-12-27 21:46:31,704][106226] Updated weights for policy 0, policy_version 354349 (0.0009) [2023-12-27 21:46:31,772][106226] Updated weights for policy 0, policy_version 354359 (0.0009) [2023-12-27 21:46:31,836][106226] Updated weights for policy 0, policy_version 354369 (0.0006) [2023-12-27 21:46:31,959][106225] Updated weights for policy 1, policy_version 354964 (0.0008) [2023-12-27 21:46:32,027][106225] Updated weights for policy 1, policy_version 354974 (0.0008) [2023-12-27 21:46:32,089][106225] Updated weights for policy 1, policy_version 354984 (0.0008) [2023-12-27 21:46:32,489][106226] Updated weights for policy 0, policy_version 354379 (0.0007) [2023-12-27 21:46:32,547][106226] Updated weights for policy 0, policy_version 354389 (0.0007) [2023-12-27 21:46:32,610][106226] Updated weights for policy 0, policy_version 354399 (0.0005) [2023-12-27 21:46:32,776][106225] Updated weights for policy 1, policy_version 354994 (0.0008) [2023-12-27 21:46:32,838][106225] Updated weights for policy 1, policy_version 355004 (0.0008) [2023-12-27 21:46:32,892][106225] Updated weights for policy 1, policy_version 355014 (0.0009) [2023-12-27 21:46:32,945][106225] Updated weights for policy 1, policy_version 355024 (0.0006) [2023-12-27 21:46:33,166][106226] Updated weights for policy 0, policy_version 354409 (0.0006) [2023-12-27 21:46:33,229][106226] Updated weights for policy 0, policy_version 354419 (0.0008) [2023-12-27 21:46:33,277][106226] Updated weights for policy 0, policy_version 354429 (0.0008) [2023-12-27 21:46:33,326][106226] Updated weights for policy 0, policy_version 354439 (0.0009) [2023-12-27 21:46:33,619][106225] Updated weights for policy 1, policy_version 355034 (0.0007) [2023-12-27 21:46:33,702][106225] Updated weights for policy 1, policy_version 355044 (0.0006) [2023-12-27 21:46:33,759][106225] Updated weights for policy 1, policy_version 355054 (0.0007) [2023-12-27 21:46:33,960][106226] Updated weights for policy 0, policy_version 354449 (0.0006) [2023-12-27 21:46:34,013][106226] Updated weights for policy 0, policy_version 354459 (0.0008) [2023-12-27 21:46:34,063][106226] Updated weights for policy 0, policy_version 354469 (0.0009) [2023-12-27 21:46:34,322][106225] Updated weights for policy 1, policy_version 355064 (0.0009) [2023-12-27 21:46:34,379][106225] Updated weights for policy 1, policy_version 355074 (0.0009) [2023-12-27 21:46:34,428][106225] Updated weights for policy 1, policy_version 355084 (0.0008) [2023-12-27 21:46:34,696][106226] Updated weights for policy 0, policy_version 354479 (0.0008) [2023-12-27 21:46:34,754][106226] Updated weights for policy 0, policy_version 354489 (0.0009) [2023-12-27 21:46:34,814][106226] Updated weights for policy 0, policy_version 354499 (0.0009) [2023-12-27 21:46:35,114][106225] Updated weights for policy 1, policy_version 355094 (0.0006) [2023-12-27 21:46:35,170][106225] Updated weights for policy 1, policy_version 355104 (0.0007) [2023-12-27 21:46:35,227][106225] Updated weights for policy 1, policy_version 355114 (0.0008) [2023-12-27 21:46:35,565][106226] Updated weights for policy 0, policy_version 354509 (0.0007) [2023-12-27 21:46:35,611][106226] Updated weights for policy 0, policy_version 354519 (0.0005) [2023-12-27 21:46:35,658][106226] Updated weights for policy 0, policy_version 354529 (0.0005) [2023-12-27 21:46:35,815][106225] Updated weights for policy 1, policy_version 355124 (0.0006) [2023-12-27 21:46:35,872][106225] Updated weights for policy 1, policy_version 355134 (0.0010) [2023-12-27 21:46:35,934][106225] Updated weights for policy 1, policy_version 355144 (0.0008) [2023-12-27 21:46:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 181739520. Throughput: 0: 9983.4, 1: 9706.5. Samples: 181748472. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:36,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.533')] [2023-12-27 21:46:36,294][106226] Updated weights for policy 0, policy_version 354539 (0.0006) [2023-12-27 21:46:36,352][106226] Updated weights for policy 0, policy_version 354549 (0.0008) [2023-12-27 21:46:36,415][106226] Updated weights for policy 0, policy_version 354559 (0.0008) [2023-12-27 21:46:36,603][106225] Updated weights for policy 1, policy_version 355154 (0.0006) [2023-12-27 21:46:36,667][106225] Updated weights for policy 1, policy_version 355164 (0.0010) [2023-12-27 21:46:36,728][106225] Updated weights for policy 1, policy_version 355174 (0.0009) [2023-12-27 21:46:36,790][106225] Updated weights for policy 1, policy_version 355184 (0.0009) [2023-12-27 21:46:37,164][106226] Updated weights for policy 0, policy_version 354569 (0.0008) [2023-12-27 21:46:37,218][106226] Updated weights for policy 0, policy_version 354579 (0.0010) [2023-12-27 21:46:37,273][106226] Updated weights for policy 0, policy_version 354589 (0.0009) [2023-12-27 21:46:37,330][106226] Updated weights for policy 0, policy_version 354599 (0.0007) [2023-12-27 21:46:37,507][106225] Updated weights for policy 1, policy_version 355194 (0.0011) [2023-12-27 21:46:37,568][106225] Updated weights for policy 1, policy_version 355204 (0.0011) [2023-12-27 21:46:37,628][106225] Updated weights for policy 1, policy_version 355214 (0.0011) [2023-12-27 21:46:38,003][106226] Updated weights for policy 0, policy_version 354609 (0.0007) [2023-12-27 21:46:38,057][106226] Updated weights for policy 0, policy_version 354619 (0.0005) [2023-12-27 21:46:38,120][106226] Updated weights for policy 0, policy_version 354629 (0.0006) [2023-12-27 21:46:38,337][106225] Updated weights for policy 1, policy_version 355224 (0.0011) [2023-12-27 21:46:38,403][106225] Updated weights for policy 1, policy_version 355234 (0.0007) [2023-12-27 21:46:38,466][106225] Updated weights for policy 1, policy_version 355244 (0.0008) [2023-12-27 21:46:38,733][106226] Updated weights for policy 0, policy_version 354639 (0.0006) [2023-12-27 21:46:38,796][106226] Updated weights for policy 0, policy_version 354649 (0.0006) [2023-12-27 21:46:38,865][106226] Updated weights for policy 0, policy_version 354659 (0.0007) [2023-12-27 21:46:39,255][106225] Updated weights for policy 1, policy_version 355254 (0.0009) [2023-12-27 21:46:39,314][106225] Updated weights for policy 1, policy_version 355264 (0.0008) [2023-12-27 21:46:39,379][106225] Updated weights for policy 1, policy_version 355274 (0.0009) [2023-12-27 21:46:39,499][106226] Updated weights for policy 0, policy_version 354669 (0.0009) [2023-12-27 21:46:39,555][106226] Updated weights for policy 0, policy_version 354679 (0.0008) [2023-12-27 21:46:39,617][106226] Updated weights for policy 0, policy_version 354689 (0.0008) [2023-12-27 21:46:40,090][106225] Updated weights for policy 1, policy_version 355284 (0.0008) [2023-12-27 21:46:40,157][106225] Updated weights for policy 1, policy_version 355294 (0.0006) [2023-12-27 21:46:40,220][106225] Updated weights for policy 1, policy_version 355304 (0.0005) [2023-12-27 21:46:40,422][106226] Updated weights for policy 0, policy_version 354699 (0.0008) [2023-12-27 21:46:40,494][106226] Updated weights for policy 0, policy_version 354709 (0.0008) [2023-12-27 21:46:40,558][106226] Updated weights for policy 0, policy_version 354719 (0.0010) [2023-12-27 21:46:40,781][106225] Updated weights for policy 1, policy_version 355314 (0.0005) [2023-12-27 21:46:40,836][106225] Updated weights for policy 1, policy_version 355324 (0.0005) [2023-12-27 21:46:40,891][106225] Updated weights for policy 1, policy_version 355334 (0.0006) [2023-12-27 21:46:40,941][106225] Updated weights for policy 1, policy_version 355344 (0.0009) [2023-12-27 21:46:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 181837824. Throughput: 0: 10049.8, 1: 9753.6. Samples: 181808508. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:41,176][105115] Avg episode reward: [(0, '-4.846'), (1, '-5.623')] [2023-12-27 21:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000354728_90841088.pth... [2023-12-27 21:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000355344_90996736.pth... [2023-12-27 21:46:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000353576_90546176.pth [2023-12-27 21:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000354192_90701824.pth [2023-12-27 21:46:41,323][106226] Updated weights for policy 0, policy_version 354729 (0.0008) [2023-12-27 21:46:41,399][106226] Updated weights for policy 0, policy_version 354739 (0.0009) [2023-12-27 21:46:41,460][106226] Updated weights for policy 0, policy_version 354749 (0.0007) [2023-12-27 21:46:41,525][106226] Updated weights for policy 0, policy_version 354759 (0.0009) [2023-12-27 21:46:41,699][106225] Updated weights for policy 1, policy_version 355354 (0.0008) [2023-12-27 21:46:41,773][106225] Updated weights for policy 1, policy_version 355364 (0.0008) [2023-12-27 21:46:41,839][106225] Updated weights for policy 1, policy_version 355374 (0.0008) [2023-12-27 21:46:42,299][106226] Updated weights for policy 0, policy_version 354769 (0.0010) [2023-12-27 21:46:42,363][106226] Updated weights for policy 0, policy_version 354779 (0.0007) [2023-12-27 21:46:42,426][106226] Updated weights for policy 0, policy_version 354789 (0.0009) [2023-12-27 21:46:42,587][106225] Updated weights for policy 1, policy_version 355384 (0.0008) [2023-12-27 21:46:42,641][106225] Updated weights for policy 1, policy_version 355394 (0.0007) [2023-12-27 21:46:42,691][106225] Updated weights for policy 1, policy_version 355404 (0.0008) [2023-12-27 21:46:43,123][106226] Updated weights for policy 0, policy_version 354799 (0.0006) [2023-12-27 21:46:43,179][106226] Updated weights for policy 0, policy_version 354809 (0.0005) [2023-12-27 21:46:43,230][106226] Updated weights for policy 0, policy_version 354819 (0.0005) [2023-12-27 21:46:43,397][106225] Updated weights for policy 1, policy_version 355414 (0.0006) [2023-12-27 21:46:43,452][106225] Updated weights for policy 1, policy_version 355424 (0.0007) [2023-12-27 21:46:43,499][106225] Updated weights for policy 1, policy_version 355434 (0.0005) [2023-12-27 21:46:43,748][106226] Updated weights for policy 0, policy_version 354829 (0.0008) [2023-12-27 21:46:43,810][106226] Updated weights for policy 0, policy_version 354839 (0.0010) [2023-12-27 21:46:43,877][106226] Updated weights for policy 0, policy_version 354849 (0.0011) [2023-12-27 21:46:44,049][106225] Updated weights for policy 1, policy_version 355444 (0.0007) [2023-12-27 21:46:44,106][106225] Updated weights for policy 1, policy_version 355454 (0.0008) [2023-12-27 21:46:44,164][106225] Updated weights for policy 1, policy_version 355464 (0.0008) [2023-12-27 21:46:44,485][106226] Updated weights for policy 0, policy_version 354859 (0.0010) [2023-12-27 21:46:44,553][106226] Updated weights for policy 0, policy_version 354869 (0.0008) [2023-12-27 21:46:44,621][106226] Updated weights for policy 0, policy_version 354879 (0.0008) [2023-12-27 21:46:44,846][106225] Updated weights for policy 1, policy_version 355474 (0.0007) [2023-12-27 21:46:44,900][106225] Updated weights for policy 1, policy_version 355484 (0.0008) [2023-12-27 21:46:44,950][106225] Updated weights for policy 1, policy_version 355494 (0.0008) [2023-12-27 21:46:45,001][106225] Updated weights for policy 1, policy_version 355504 (0.0008) [2023-12-27 21:46:45,318][106226] Updated weights for policy 0, policy_version 354889 (0.0008) [2023-12-27 21:46:45,373][106226] Updated weights for policy 0, policy_version 354899 (0.0010) [2023-12-27 21:46:45,420][106226] Updated weights for policy 0, policy_version 354909 (0.0010) [2023-12-27 21:46:45,482][106226] Updated weights for policy 0, policy_version 354919 (0.0011) [2023-12-27 21:46:45,716][106225] Updated weights for policy 1, policy_version 355514 (0.0006) [2023-12-27 21:46:45,767][106225] Updated weights for policy 1, policy_version 355524 (0.0008) [2023-12-27 21:46:45,815][106225] Updated weights for policy 1, policy_version 355534 (0.0008) [2023-12-27 21:46:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 181936128. Throughput: 0: 10075.5, 1: 9888.0. Samples: 181928656. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:46,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.555')] [2023-12-27 21:46:46,190][106226] Updated weights for policy 0, policy_version 354929 (0.0011) [2023-12-27 21:46:46,238][106226] Updated weights for policy 0, policy_version 354939 (0.0011) [2023-12-27 21:46:46,292][106226] Updated weights for policy 0, policy_version 354949 (0.0011) [2023-12-27 21:46:46,456][106225] Updated weights for policy 1, policy_version 355544 (0.0006) [2023-12-27 21:46:46,519][106225] Updated weights for policy 1, policy_version 355554 (0.0008) [2023-12-27 21:46:46,585][106225] Updated weights for policy 1, policy_version 355564 (0.0006) [2023-12-27 21:46:46,897][106226] Updated weights for policy 0, policy_version 354959 (0.0007) [2023-12-27 21:46:46,945][106226] Updated weights for policy 0, policy_version 354969 (0.0005) [2023-12-27 21:46:46,991][106226] Updated weights for policy 0, policy_version 354979 (0.0005) [2023-12-27 21:46:47,147][106225] Updated weights for policy 1, policy_version 355574 (0.0005) [2023-12-27 21:46:47,209][106225] Updated weights for policy 1, policy_version 355584 (0.0005) [2023-12-27 21:46:47,261][106225] Updated weights for policy 1, policy_version 355594 (0.0005) [2023-12-27 21:46:47,527][106226] Updated weights for policy 0, policy_version 354989 (0.0005) [2023-12-27 21:46:47,576][106226] Updated weights for policy 0, policy_version 354999 (0.0005) [2023-12-27 21:46:47,628][106226] Updated weights for policy 0, policy_version 355009 (0.0005) [2023-12-27 21:46:47,867][106225] Updated weights for policy 1, policy_version 355604 (0.0008) [2023-12-27 21:46:47,924][106225] Updated weights for policy 1, policy_version 355614 (0.0010) [2023-12-27 21:46:47,971][106225] Updated weights for policy 1, policy_version 355624 (0.0010) [2023-12-27 21:46:48,281][106226] Updated weights for policy 0, policy_version 355019 (0.0007) [2023-12-27 21:46:48,337][106226] Updated weights for policy 0, policy_version 355029 (0.0011) [2023-12-27 21:46:48,400][106226] Updated weights for policy 0, policy_version 355039 (0.0011) [2023-12-27 21:46:48,582][106225] Updated weights for policy 1, policy_version 355634 (0.0010) [2023-12-27 21:46:48,629][106225] Updated weights for policy 1, policy_version 355644 (0.0010) [2023-12-27 21:46:48,688][106225] Updated weights for policy 1, policy_version 355654 (0.0009) [2023-12-27 21:46:48,754][106225] Updated weights for policy 1, policy_version 355664 (0.0006) [2023-12-27 21:46:49,099][106226] Updated weights for policy 0, policy_version 355049 (0.0010) [2023-12-27 21:46:49,165][106226] Updated weights for policy 0, policy_version 355059 (0.0008) [2023-12-27 21:46:49,238][106226] Updated weights for policy 0, policy_version 355069 (0.0008) [2023-12-27 21:46:49,301][106226] Updated weights for policy 0, policy_version 355079 (0.0007) [2023-12-27 21:46:49,418][106225] Updated weights for policy 1, policy_version 355674 (0.0009) [2023-12-27 21:46:49,469][106225] Updated weights for policy 1, policy_version 355684 (0.0010) [2023-12-27 21:46:49,530][106225] Updated weights for policy 1, policy_version 355694 (0.0011) [2023-12-27 21:46:49,996][106226] Updated weights for policy 0, policy_version 355089 (0.0009) [2023-12-27 21:46:50,052][106226] Updated weights for policy 0, policy_version 355099 (0.0009) [2023-12-27 21:46:50,109][106226] Updated weights for policy 0, policy_version 355109 (0.0009) [2023-12-27 21:46:50,241][106225] Updated weights for policy 1, policy_version 355704 (0.0010) [2023-12-27 21:46:50,311][106225] Updated weights for policy 1, policy_version 355714 (0.0011) [2023-12-27 21:46:50,375][106225] Updated weights for policy 1, policy_version 355724 (0.0010) [2023-12-27 21:46:50,807][106226] Updated weights for policy 0, policy_version 355119 (0.0010) [2023-12-27 21:46:50,865][106226] Updated weights for policy 0, policy_version 355129 (0.0010) [2023-12-27 21:46:50,928][106226] Updated weights for policy 0, policy_version 355139 (0.0011) [2023-12-27 21:46:51,070][106225] Updated weights for policy 1, policy_version 355734 (0.0010) [2023-12-27 21:46:51,136][106225] Updated weights for policy 1, policy_version 355744 (0.0010) [2023-12-27 21:46:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 182042624. Throughput: 0: 10092.7, 1: 9900.5. Samples: 182054088. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:51,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.784')] [2023-12-27 21:46:51,206][106225] Updated weights for policy 1, policy_version 355754 (0.0010) [2023-12-27 21:46:51,638][106226] Updated weights for policy 0, policy_version 355149 (0.0009) [2023-12-27 21:46:51,695][106226] Updated weights for policy 0, policy_version 355159 (0.0010) [2023-12-27 21:46:51,761][106226] Updated weights for policy 0, policy_version 355169 (0.0009) [2023-12-27 21:46:52,027][106225] Updated weights for policy 1, policy_version 355764 (0.0010) [2023-12-27 21:46:52,078][106225] Updated weights for policy 1, policy_version 355774 (0.0010) [2023-12-27 21:46:52,140][106225] Updated weights for policy 1, policy_version 355784 (0.0009) [2023-12-27 21:46:52,535][106226] Updated weights for policy 0, policy_version 355179 (0.0008) [2023-12-27 21:46:52,600][106226] Updated weights for policy 0, policy_version 355189 (0.0006) [2023-12-27 21:46:52,662][106226] Updated weights for policy 0, policy_version 355199 (0.0011) [2023-12-27 21:46:52,856][106225] Updated weights for policy 1, policy_version 355794 (0.0009) [2023-12-27 21:46:52,912][106225] Updated weights for policy 1, policy_version 355804 (0.0010) [2023-12-27 21:46:52,963][106225] Updated weights for policy 1, policy_version 355814 (0.0010) [2023-12-27 21:46:53,017][106225] Updated weights for policy 1, policy_version 355824 (0.0010) [2023-12-27 21:46:53,352][106226] Updated weights for policy 0, policy_version 355209 (0.0010) [2023-12-27 21:46:53,420][106226] Updated weights for policy 0, policy_version 355219 (0.0005) [2023-12-27 21:46:53,478][106226] Updated weights for policy 0, policy_version 355229 (0.0010) [2023-12-27 21:46:53,532][106226] Updated weights for policy 0, policy_version 355239 (0.0011) [2023-12-27 21:46:53,636][106225] Updated weights for policy 1, policy_version 355834 (0.0010) [2023-12-27 21:46:53,689][106225] Updated weights for policy 1, policy_version 355844 (0.0010) [2023-12-27 21:46:53,744][106225] Updated weights for policy 1, policy_version 355854 (0.0010) [2023-12-27 21:46:54,208][106226] Updated weights for policy 0, policy_version 355249 (0.0011) [2023-12-27 21:46:54,260][106226] Updated weights for policy 0, policy_version 355259 (0.0006) [2023-12-27 21:46:54,328][106226] Updated weights for policy 0, policy_version 355269 (0.0005) [2023-12-27 21:46:54,430][106225] Updated weights for policy 1, policy_version 355864 (0.0006) [2023-12-27 21:46:54,489][106225] Updated weights for policy 1, policy_version 355874 (0.0005) [2023-12-27 21:46:54,554][106225] Updated weights for policy 1, policy_version 355884 (0.0007) [2023-12-27 21:46:54,904][106226] Updated weights for policy 0, policy_version 355279 (0.0008) [2023-12-27 21:46:54,972][106226] Updated weights for policy 0, policy_version 355289 (0.0009) [2023-12-27 21:46:55,041][106226] Updated weights for policy 0, policy_version 355299 (0.0008) [2023-12-27 21:46:55,159][106225] Updated weights for policy 1, policy_version 355894 (0.0006) [2023-12-27 21:46:55,212][106225] Updated weights for policy 1, policy_version 355904 (0.0009) [2023-12-27 21:46:55,269][106225] Updated weights for policy 1, policy_version 355914 (0.0010) [2023-12-27 21:46:55,684][106226] Updated weights for policy 0, policy_version 355309 (0.0007) [2023-12-27 21:46:55,741][106226] Updated weights for policy 0, policy_version 355319 (0.0006) [2023-12-27 21:46:55,791][106226] Updated weights for policy 0, policy_version 355329 (0.0006) [2023-12-27 21:46:55,912][106225] Updated weights for policy 1, policy_version 355924 (0.0010) [2023-12-27 21:46:55,962][106225] Updated weights for policy 1, policy_version 355934 (0.0010) [2023-12-27 21:46:56,018][106225] Updated weights for policy 1, policy_version 355944 (0.0010) [2023-12-27 21:46:56,175][105115] Fps is (10 sec: 21298.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 182149120. Throughput: 0: 10047.7, 1: 9850.8. Samples: 182112736. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:46:56,176][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.603')] [2023-12-27 21:46:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000355336_90996736.pth... [2023-12-27 21:46:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000355952_91152384.pth... [2023-12-27 21:46:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000354152_90693632.pth [2023-12-27 21:46:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000354768_90849280.pth [2023-12-27 21:46:56,489][106226] Updated weights for policy 0, policy_version 355339 (0.0006) [2023-12-27 21:46:56,549][106226] Updated weights for policy 0, policy_version 355349 (0.0008) [2023-12-27 21:46:56,610][106226] Updated weights for policy 0, policy_version 355359 (0.0008) [2023-12-27 21:46:56,668][106225] Updated weights for policy 1, policy_version 355954 (0.0010) [2023-12-27 21:46:56,732][106225] Updated weights for policy 1, policy_version 355964 (0.0010) [2023-12-27 21:46:56,795][106225] Updated weights for policy 1, policy_version 355974 (0.0010) [2023-12-27 21:46:56,857][106225] Updated weights for policy 1, policy_version 355984 (0.0010) [2023-12-27 21:46:57,337][106226] Updated weights for policy 0, policy_version 355369 (0.0008) [2023-12-27 21:46:57,397][106226] Updated weights for policy 0, policy_version 355379 (0.0007) [2023-12-27 21:46:57,457][106226] Updated weights for policy 0, policy_version 355389 (0.0008) [2023-12-27 21:46:57,514][106226] Updated weights for policy 0, policy_version 355399 (0.0008) [2023-12-27 21:46:57,582][106225] Updated weights for policy 1, policy_version 355994 (0.0008) [2023-12-27 21:46:57,636][106225] Updated weights for policy 1, policy_version 356004 (0.0008) [2023-12-27 21:46:57,691][106225] Updated weights for policy 1, policy_version 356014 (0.0005) [2023-12-27 21:46:58,196][106226] Updated weights for policy 0, policy_version 355409 (0.0008) [2023-12-27 21:46:58,259][106226] Updated weights for policy 0, policy_version 355419 (0.0008) [2023-12-27 21:46:58,315][106226] Updated weights for policy 0, policy_version 355429 (0.0008) [2023-12-27 21:46:58,417][106225] Updated weights for policy 1, policy_version 356024 (0.0008) [2023-12-27 21:46:58,485][106225] Updated weights for policy 1, policy_version 356034 (0.0007) [2023-12-27 21:46:58,550][106225] Updated weights for policy 1, policy_version 356044 (0.0008) [2023-12-27 21:46:59,107][106226] Updated weights for policy 0, policy_version 355439 (0.0008) [2023-12-27 21:46:59,161][106226] Updated weights for policy 0, policy_version 355449 (0.0009) [2023-12-27 21:46:59,223][106226] Updated weights for policy 0, policy_version 355459 (0.0007) [2023-12-27 21:46:59,383][106225] Updated weights for policy 1, policy_version 356054 (0.0008) [2023-12-27 21:46:59,446][106225] Updated weights for policy 1, policy_version 356064 (0.0008) [2023-12-27 21:46:59,497][106225] Updated weights for policy 1, policy_version 356074 (0.0008) [2023-12-27 21:47:00,036][106226] Updated weights for policy 0, policy_version 355469 (0.0008) [2023-12-27 21:47:00,097][106226] Updated weights for policy 0, policy_version 355479 (0.0009) [2023-12-27 21:47:00,149][106226] Updated weights for policy 0, policy_version 355489 (0.0010) [2023-12-27 21:47:00,174][106225] Updated weights for policy 1, policy_version 356084 (0.0007) [2023-12-27 21:47:00,237][106225] Updated weights for policy 1, policy_version 356094 (0.0006) [2023-12-27 21:47:00,293][106225] Updated weights for policy 1, policy_version 356105 (0.0007) [2023-12-27 21:47:00,841][106226] Updated weights for policy 0, policy_version 355499 (0.0009) [2023-12-27 21:47:00,904][106226] Updated weights for policy 0, policy_version 355509 (0.0011) [2023-12-27 21:47:00,966][106226] Updated weights for policy 0, policy_version 355519 (0.0011) [2023-12-27 21:47:00,968][106225] Updated weights for policy 1, policy_version 356116 (0.0008) [2023-12-27 21:47:01,025][106225] Updated weights for policy 1, policy_version 356126 (0.0006) [2023-12-27 21:47:01,091][106225] Updated weights for policy 1, policy_version 356136 (0.0008) [2023-12-27 21:47:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 182247424. Throughput: 0: 10068.0, 1: 9936.1. Samples: 182230624. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:47:01,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-5.953')] [2023-12-27 21:47:01,680][106226] Updated weights for policy 0, policy_version 355529 (0.0010) [2023-12-27 21:47:01,745][106226] Updated weights for policy 0, policy_version 355539 (0.0009) [2023-12-27 21:47:01,818][106226] Updated weights for policy 0, policy_version 355549 (0.0008) [2023-12-27 21:47:01,870][106225] Updated weights for policy 1, policy_version 356146 (0.0009) [2023-12-27 21:47:01,885][106226] Updated weights for policy 0, policy_version 355559 (0.0008) [2023-12-27 21:47:01,932][106225] Updated weights for policy 1, policy_version 356156 (0.0006) [2023-12-27 21:47:01,998][106225] Updated weights for policy 1, policy_version 356166 (0.0007) [2023-12-27 21:47:02,051][106225] Updated weights for policy 1, policy_version 356176 (0.0008) [2023-12-27 21:47:02,626][106226] Updated weights for policy 0, policy_version 355569 (0.0008) [2023-12-27 21:47:02,680][106226] Updated weights for policy 0, policy_version 355579 (0.0008) [2023-12-27 21:47:02,712][106225] Updated weights for policy 1, policy_version 356186 (0.0006) [2023-12-27 21:47:02,735][106226] Updated weights for policy 0, policy_version 355589 (0.0006) [2023-12-27 21:47:02,761][106225] Updated weights for policy 1, policy_version 356196 (0.0006) [2023-12-27 21:47:02,807][106225] Updated weights for policy 1, policy_version 356206 (0.0007) [2023-12-27 21:47:03,420][106225] Updated weights for policy 1, policy_version 356216 (0.0005) [2023-12-27 21:47:03,484][106225] Updated weights for policy 1, policy_version 356226 (0.0005) [2023-12-27 21:47:03,534][106225] Updated weights for policy 1, policy_version 356236 (0.0005) [2023-12-27 21:47:03,572][106226] Updated weights for policy 0, policy_version 355599 (0.0008) [2023-12-27 21:47:03,632][106226] Updated weights for policy 0, policy_version 355609 (0.0008) [2023-12-27 21:47:03,693][106226] Updated weights for policy 0, policy_version 355619 (0.0005) [2023-12-27 21:47:04,166][106225] Updated weights for policy 1, policy_version 356246 (0.0008) [2023-12-27 21:47:04,235][106225] Updated weights for policy 1, policy_version 356256 (0.0009) [2023-12-27 21:47:04,293][106225] Updated weights for policy 1, policy_version 356266 (0.0011) [2023-12-27 21:47:04,386][106226] Updated weights for policy 0, policy_version 355629 (0.0006) [2023-12-27 21:47:04,451][106226] Updated weights for policy 0, policy_version 355639 (0.0008) [2023-12-27 21:47:04,503][106226] Updated weights for policy 0, policy_version 355649 (0.0008) [2023-12-27 21:47:04,985][106225] Updated weights for policy 1, policy_version 356276 (0.0010) [2023-12-27 21:47:05,034][106225] Updated weights for policy 1, policy_version 356286 (0.0008) [2023-12-27 21:47:05,087][106225] Updated weights for policy 1, policy_version 356296 (0.0005) [2023-12-27 21:47:05,185][106226] Updated weights for policy 0, policy_version 355659 (0.0007) [2023-12-27 21:47:05,237][106226] Updated weights for policy 0, policy_version 355669 (0.0005) [2023-12-27 21:47:05,288][106226] Updated weights for policy 0, policy_version 355679 (0.0005) [2023-12-27 21:47:05,798][106225] Updated weights for policy 1, policy_version 356306 (0.0009) [2023-12-27 21:47:05,857][106225] Updated weights for policy 1, policy_version 356316 (0.0006) [2023-12-27 21:47:05,904][106226] Updated weights for policy 0, policy_version 355689 (0.0006) [2023-12-27 21:47:05,919][106225] Updated weights for policy 1, policy_version 356326 (0.0009) [2023-12-27 21:47:05,962][106226] Updated weights for policy 0, policy_version 355699 (0.0006) [2023-12-27 21:47:05,980][106225] Updated weights for policy 1, policy_version 356336 (0.0010) [2023-12-27 21:47:06,024][106226] Updated weights for policy 0, policy_version 355709 (0.0006) [2023-12-27 21:47:06,091][106226] Updated weights for policy 0, policy_version 355719 (0.0006) [2023-12-27 21:47:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 182345728. Throughput: 0: 10019.5, 1: 10020.9. Samples: 182350908. Policy #0 lag: (min: 31.0, avg: 32.2, max: 59.0) [2023-12-27 21:47:06,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.921')] [2023-12-27 21:47:06,680][106225] Updated weights for policy 1, policy_version 356346 (0.0010) [2023-12-27 21:47:06,731][106225] Updated weights for policy 1, policy_version 356356 (0.0010) [2023-12-27 21:47:06,760][106226] Updated weights for policy 0, policy_version 355729 (0.0011) [2023-12-27 21:47:06,797][106225] Updated weights for policy 1, policy_version 356366 (0.0010) [2023-12-27 21:47:06,818][106226] Updated weights for policy 0, policy_version 355739 (0.0011) [2023-12-27 21:47:06,876][106226] Updated weights for policy 0, policy_version 355749 (0.0011) [2023-12-27 21:47:07,424][106225] Updated weights for policy 1, policy_version 356376 (0.0010) [2023-12-27 21:47:07,478][106225] Updated weights for policy 1, policy_version 356386 (0.0010) [2023-12-27 21:47:07,527][106225] Updated weights for policy 1, policy_version 356396 (0.0010) [2023-12-27 21:47:07,528][106226] Updated weights for policy 0, policy_version 355759 (0.0009) [2023-12-27 21:47:07,585][106226] Updated weights for policy 0, policy_version 355769 (0.0008) [2023-12-27 21:47:07,645][106226] Updated weights for policy 0, policy_version 355779 (0.0009) [2023-12-27 21:47:08,168][106225] Updated weights for policy 1, policy_version 356406 (0.0007) [2023-12-27 21:47:08,219][106225] Updated weights for policy 1, policy_version 356416 (0.0007) [2023-12-27 21:47:08,268][106225] Updated weights for policy 1, policy_version 356426 (0.0006) [2023-12-27 21:47:08,382][106226] Updated weights for policy 0, policy_version 355789 (0.0007) [2023-12-27 21:47:08,441][106226] Updated weights for policy 0, policy_version 355799 (0.0008) [2023-12-27 21:47:08,504][106226] Updated weights for policy 0, policy_version 355809 (0.0008) [2023-12-27 21:47:08,902][106225] Updated weights for policy 1, policy_version 356436 (0.0005) [2023-12-27 21:47:08,960][106225] Updated weights for policy 1, policy_version 356446 (0.0006) [2023-12-27 21:47:09,014][106225] Updated weights for policy 1, policy_version 356456 (0.0007) [2023-12-27 21:47:09,258][106226] Updated weights for policy 0, policy_version 355819 (0.0008) [2023-12-27 21:47:09,316][106226] Updated weights for policy 0, policy_version 355829 (0.0008) [2023-12-27 21:47:09,388][106226] Updated weights for policy 0, policy_version 355839 (0.0008) [2023-12-27 21:47:09,751][106225] Updated weights for policy 1, policy_version 356466 (0.0008) [2023-12-27 21:47:09,806][106225] Updated weights for policy 1, policy_version 356476 (0.0008) [2023-12-27 21:47:09,877][106225] Updated weights for policy 1, policy_version 356486 (0.0008) [2023-12-27 21:47:09,947][106225] Updated weights for policy 1, policy_version 356496 (0.0008) [2023-12-27 21:47:10,132][106226] Updated weights for policy 0, policy_version 355849 (0.0009) [2023-12-27 21:47:10,199][106226] Updated weights for policy 0, policy_version 355859 (0.0009) [2023-12-27 21:47:10,262][106226] Updated weights for policy 0, policy_version 355869 (0.0010) [2023-12-27 21:47:10,319][106226] Updated weights for policy 0, policy_version 355879 (0.0008) [2023-12-27 21:47:10,658][106225] Updated weights for policy 1, policy_version 356506 (0.0008) [2023-12-27 21:47:10,722][106225] Updated weights for policy 1, policy_version 356516 (0.0008) [2023-12-27 21:47:10,780][106225] Updated weights for policy 1, policy_version 356526 (0.0008) [2023-12-27 21:47:11,029][106226] Updated weights for policy 0, policy_version 355889 (0.0010) [2023-12-27 21:47:11,092][106226] Updated weights for policy 0, policy_version 355899 (0.0010) [2023-12-27 21:47:11,162][106226] Updated weights for policy 0, policy_version 355909 (0.0010) [2023-12-27 21:47:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 182435840. Throughput: 0: 10049.4, 1: 10074.6. Samples: 182411444. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:11,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-5.338')] [2023-12-27 21:47:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000356528_91299840.pth... [2023-12-27 21:47:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000355912_91144192.pth... [2023-12-27 21:47:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000355344_90996736.pth [2023-12-27 21:47:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000354728_90841088.pth [2023-12-27 21:47:11,532][106225] Updated weights for policy 1, policy_version 356536 (0.0008) [2023-12-27 21:47:11,592][106225] Updated weights for policy 1, policy_version 356546 (0.0006) [2023-12-27 21:47:11,660][106225] Updated weights for policy 1, policy_version 356556 (0.0007) [2023-12-27 21:47:11,970][106226] Updated weights for policy 0, policy_version 355919 (0.0009) [2023-12-27 21:47:12,031][106226] Updated weights for policy 0, policy_version 355929 (0.0009) [2023-12-27 21:47:12,099][106226] Updated weights for policy 0, policy_version 355939 (0.0009) [2023-12-27 21:47:12,414][106225] Updated weights for policy 1, policy_version 356566 (0.0008) [2023-12-27 21:47:12,480][106225] Updated weights for policy 1, policy_version 356576 (0.0009) [2023-12-27 21:47:12,545][106225] Updated weights for policy 1, policy_version 356586 (0.0008) [2023-12-27 21:47:12,795][106226] Updated weights for policy 0, policy_version 355949 (0.0009) [2023-12-27 21:47:12,854][106226] Updated weights for policy 0, policy_version 355959 (0.0007) [2023-12-27 21:47:12,917][106226] Updated weights for policy 0, policy_version 355969 (0.0009) [2023-12-27 21:47:13,266][106225] Updated weights for policy 1, policy_version 356596 (0.0007) [2023-12-27 21:47:13,326][106225] Updated weights for policy 1, policy_version 356606 (0.0006) [2023-12-27 21:47:13,379][106225] Updated weights for policy 1, policy_version 356616 (0.0007) [2023-12-27 21:47:13,641][106226] Updated weights for policy 0, policy_version 355979 (0.0008) [2023-12-27 21:47:13,690][106226] Updated weights for policy 0, policy_version 355989 (0.0010) [2023-12-27 21:47:13,747][106226] Updated weights for policy 0, policy_version 355999 (0.0010) [2023-12-27 21:47:13,954][106225] Updated weights for policy 1, policy_version 356626 (0.0006) [2023-12-27 21:47:14,018][106225] Updated weights for policy 1, policy_version 356636 (0.0006) [2023-12-27 21:47:14,067][106225] Updated weights for policy 1, policy_version 356646 (0.0007) [2023-12-27 21:47:14,117][106225] Updated weights for policy 1, policy_version 356656 (0.0007) [2023-12-27 21:47:14,448][106226] Updated weights for policy 0, policy_version 356009 (0.0010) [2023-12-27 21:47:14,511][106226] Updated weights for policy 0, policy_version 356019 (0.0009) [2023-12-27 21:47:14,573][106226] Updated weights for policy 0, policy_version 356029 (0.0010) [2023-12-27 21:47:14,630][106226] Updated weights for policy 0, policy_version 356039 (0.0010) [2023-12-27 21:47:14,823][106225] Updated weights for policy 1, policy_version 356666 (0.0007) [2023-12-27 21:47:14,881][106225] Updated weights for policy 1, policy_version 356676 (0.0009) [2023-12-27 21:47:14,946][106225] Updated weights for policy 1, policy_version 356686 (0.0008) [2023-12-27 21:47:15,354][106226] Updated weights for policy 0, policy_version 356049 (0.0009) [2023-12-27 21:47:15,415][106226] Updated weights for policy 0, policy_version 356059 (0.0009) [2023-12-27 21:47:15,480][106226] Updated weights for policy 0, policy_version 356069 (0.0008) [2023-12-27 21:47:15,647][106225] Updated weights for policy 1, policy_version 356696 (0.0008) [2023-12-27 21:47:15,699][106225] Updated weights for policy 1, policy_version 356706 (0.0008) [2023-12-27 21:47:15,754][106225] Updated weights for policy 1, policy_version 356716 (0.0008) [2023-12-27 21:47:16,141][106226] Updated weights for policy 0, policy_version 356079 (0.0007) [2023-12-27 21:47:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 182534144. Throughput: 0: 9987.8, 1: 10128.4. Samples: 182527524. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:16,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.739')] [2023-12-27 21:47:16,198][106226] Updated weights for policy 0, policy_version 356089 (0.0005) [2023-12-27 21:47:16,251][106226] Updated weights for policy 0, policy_version 356099 (0.0006) [2023-12-27 21:47:16,575][106225] Updated weights for policy 1, policy_version 356726 (0.0010) [2023-12-27 21:47:16,644][106225] Updated weights for policy 1, policy_version 356736 (0.0009) [2023-12-27 21:47:16,708][106225] Updated weights for policy 1, policy_version 356746 (0.0008) [2023-12-27 21:47:16,783][106226] Updated weights for policy 0, policy_version 356109 (0.0007) [2023-12-27 21:47:16,833][106226] Updated weights for policy 0, policy_version 356119 (0.0008) [2023-12-27 21:47:16,900][106226] Updated weights for policy 0, policy_version 356129 (0.0009) [2023-12-27 21:47:17,445][106225] Updated weights for policy 1, policy_version 356756 (0.0007) [2023-12-27 21:47:17,495][106225] Updated weights for policy 1, policy_version 356766 (0.0008) [2023-12-27 21:47:17,537][106226] Updated weights for policy 0, policy_version 356139 (0.0008) [2023-12-27 21:47:17,549][106225] Updated weights for policy 1, policy_version 356776 (0.0009) [2023-12-27 21:47:17,593][106226] Updated weights for policy 0, policy_version 356149 (0.0007) [2023-12-27 21:47:17,649][106226] Updated weights for policy 0, policy_version 356159 (0.0008) [2023-12-27 21:47:18,292][106225] Updated weights for policy 1, policy_version 356786 (0.0008) [2023-12-27 21:47:18,310][106226] Updated weights for policy 0, policy_version 356169 (0.0006) [2023-12-27 21:47:18,346][106225] Updated weights for policy 1, policy_version 356796 (0.0009) [2023-12-27 21:47:18,380][106226] Updated weights for policy 0, policy_version 356179 (0.0010) [2023-12-27 21:47:18,401][106225] Updated weights for policy 1, policy_version 356806 (0.0010) [2023-12-27 21:47:18,438][106226] Updated weights for policy 0, policy_version 356189 (0.0011) [2023-12-27 21:47:18,456][106225] Updated weights for policy 1, policy_version 356816 (0.0010) [2023-12-27 21:47:18,500][106226] Updated weights for policy 0, policy_version 356199 (0.0010) [2023-12-27 21:47:19,097][106226] Updated weights for policy 0, policy_version 356209 (0.0006) [2023-12-27 21:47:19,157][106226] Updated weights for policy 0, policy_version 356219 (0.0005) [2023-12-27 21:47:19,208][106226] Updated weights for policy 0, policy_version 356229 (0.0007) [2023-12-27 21:47:19,223][106225] Updated weights for policy 1, policy_version 356826 (0.0011) [2023-12-27 21:47:19,290][106225] Updated weights for policy 1, policy_version 356836 (0.0010) [2023-12-27 21:47:19,360][106225] Updated weights for policy 1, policy_version 356846 (0.0010) [2023-12-27 21:47:19,967][106226] Updated weights for policy 0, policy_version 356239 (0.0009) [2023-12-27 21:47:20,030][106226] Updated weights for policy 0, policy_version 356249 (0.0010) [2023-12-27 21:47:20,074][106225] Updated weights for policy 1, policy_version 356856 (0.0011) [2023-12-27 21:47:20,100][106226] Updated weights for policy 0, policy_version 356259 (0.0010) [2023-12-27 21:47:20,136][106225] Updated weights for policy 1, policy_version 356866 (0.0011) [2023-12-27 21:47:20,192][106225] Updated weights for policy 1, policy_version 356876 (0.0010) [2023-12-27 21:47:20,696][106226] Updated weights for policy 0, policy_version 356269 (0.0008) [2023-12-27 21:47:20,768][106226] Updated weights for policy 0, policy_version 356279 (0.0009) [2023-12-27 21:47:20,829][106226] Updated weights for policy 0, policy_version 356289 (0.0010) [2023-12-27 21:47:20,945][106225] Updated weights for policy 1, policy_version 356886 (0.0010) [2023-12-27 21:47:21,003][106225] Updated weights for policy 1, policy_version 356896 (0.0010) [2023-12-27 21:47:21,069][106225] Updated weights for policy 1, policy_version 356906 (0.0010) [2023-12-27 21:47:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 182640640. Throughput: 0: 9963.9, 1: 9984.0. Samples: 182646128. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:21,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-6.071')] [2023-12-27 21:47:21,559][106226] Updated weights for policy 0, policy_version 356299 (0.0010) [2023-12-27 21:47:21,628][106226] Updated weights for policy 0, policy_version 356309 (0.0006) [2023-12-27 21:47:21,694][106226] Updated weights for policy 0, policy_version 356319 (0.0010) [2023-12-27 21:47:21,875][106225] Updated weights for policy 1, policy_version 356916 (0.0008) [2023-12-27 21:47:21,934][106225] Updated weights for policy 1, policy_version 356926 (0.0007) [2023-12-27 21:47:21,994][106225] Updated weights for policy 1, policy_version 356936 (0.0008) [2023-12-27 21:47:22,413][106226] Updated weights for policy 0, policy_version 356329 (0.0009) [2023-12-27 21:47:22,481][106226] Updated weights for policy 0, policy_version 356339 (0.0009) [2023-12-27 21:47:22,537][106226] Updated weights for policy 0, policy_version 356349 (0.0009) [2023-12-27 21:47:22,604][106226] Updated weights for policy 0, policy_version 356359 (0.0009) [2023-12-27 21:47:22,713][106225] Updated weights for policy 1, policy_version 356946 (0.0007) [2023-12-27 21:47:22,771][106225] Updated weights for policy 1, policy_version 356956 (0.0007) [2023-12-27 21:47:22,836][106225] Updated weights for policy 1, policy_version 356966 (0.0008) [2023-12-27 21:47:22,905][106225] Updated weights for policy 1, policy_version 356976 (0.0009) [2023-12-27 21:47:23,358][106226] Updated weights for policy 0, policy_version 356369 (0.0008) [2023-12-27 21:47:23,420][106226] Updated weights for policy 0, policy_version 356379 (0.0008) [2023-12-27 21:47:23,485][106226] Updated weights for policy 0, policy_version 356389 (0.0010) [2023-12-27 21:47:23,588][106225] Updated weights for policy 1, policy_version 356986 (0.0005) [2023-12-27 21:47:23,650][106225] Updated weights for policy 1, policy_version 356996 (0.0006) [2023-12-27 21:47:23,702][106225] Updated weights for policy 1, policy_version 357006 (0.0006) [2023-12-27 21:47:24,283][106226] Updated weights for policy 0, policy_version 356399 (0.0006) [2023-12-27 21:47:24,307][106225] Updated weights for policy 1, policy_version 357017 (0.0011) [2023-12-27 21:47:24,345][106226] Updated weights for policy 0, policy_version 356409 (0.0006) [2023-12-27 21:47:24,370][106225] Updated weights for policy 1, policy_version 357027 (0.0009) [2023-12-27 21:47:24,406][106226] Updated weights for policy 0, policy_version 356419 (0.0006) [2023-12-27 21:47:24,421][106225] Updated weights for policy 1, policy_version 357037 (0.0007) [2023-12-27 21:47:25,108][106226] Updated weights for policy 0, policy_version 356429 (0.0008) [2023-12-27 21:47:25,144][106225] Updated weights for policy 1, policy_version 357047 (0.0007) [2023-12-27 21:47:25,167][106226] Updated weights for policy 0, policy_version 356439 (0.0007) [2023-12-27 21:47:25,203][106225] Updated weights for policy 1, policy_version 357057 (0.0006) [2023-12-27 21:47:25,222][106226] Updated weights for policy 0, policy_version 356449 (0.0008) [2023-12-27 21:47:25,259][106225] Updated weights for policy 1, policy_version 357067 (0.0007) [2023-12-27 21:47:25,847][106226] Updated weights for policy 0, policy_version 356459 (0.0009) [2023-12-27 21:47:25,848][106225] Updated weights for policy 1, policy_version 357077 (0.0008) [2023-12-27 21:47:25,906][106225] Updated weights for policy 1, policy_version 357087 (0.0010) [2023-12-27 21:47:25,907][106226] Updated weights for policy 0, policy_version 356469 (0.0011) [2023-12-27 21:47:25,964][106226] Updated weights for policy 0, policy_version 356479 (0.0010) [2023-12-27 21:47:25,965][106225] Updated weights for policy 1, policy_version 357097 (0.0010) [2023-12-27 21:47:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 182738944. Throughput: 0: 9888.8, 1: 9969.3. Samples: 182702120. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:26,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-5.631')] [2023-12-27 21:47:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000357104_91447296.pth... [2023-12-27 21:47:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000356488_91291648.pth... [2023-12-27 21:47:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000355952_91152384.pth [2023-12-27 21:47:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000355336_90996736.pth [2023-12-27 21:47:26,569][106226] Updated weights for policy 0, policy_version 356489 (0.0010) [2023-12-27 21:47:26,622][106225] Updated weights for policy 1, policy_version 357107 (0.0010) [2023-12-27 21:47:26,632][106226] Updated weights for policy 0, policy_version 356499 (0.0007) [2023-12-27 21:47:26,665][106225] Updated weights for policy 1, policy_version 357117 (0.0010) [2023-12-27 21:47:26,688][106226] Updated weights for policy 0, policy_version 356509 (0.0005) [2023-12-27 21:47:26,721][106225] Updated weights for policy 1, policy_version 357127 (0.0010) [2023-12-27 21:47:26,749][106226] Updated weights for policy 0, policy_version 356519 (0.0007) [2023-12-27 21:47:27,327][106226] Updated weights for policy 0, policy_version 356529 (0.0005) [2023-12-27 21:47:27,378][106226] Updated weights for policy 0, policy_version 356539 (0.0005) [2023-12-27 21:47:27,429][106226] Updated weights for policy 0, policy_version 356549 (0.0005) [2023-12-27 21:47:27,434][106225] Updated weights for policy 1, policy_version 357137 (0.0010) [2023-12-27 21:47:27,501][106225] Updated weights for policy 1, policy_version 357147 (0.0010) [2023-12-27 21:47:27,550][106225] Updated weights for policy 1, policy_version 357157 (0.0010) [2023-12-27 21:47:27,614][106225] Updated weights for policy 1, policy_version 357167 (0.0010) [2023-12-27 21:47:28,066][106226] Updated weights for policy 0, policy_version 356559 (0.0009) [2023-12-27 21:47:28,122][106226] Updated weights for policy 0, policy_version 356569 (0.0011) [2023-12-27 21:47:28,177][106226] Updated weights for policy 0, policy_version 356579 (0.0011) [2023-12-27 21:47:28,321][106225] Updated weights for policy 1, policy_version 357177 (0.0010) [2023-12-27 21:47:28,380][106225] Updated weights for policy 1, policy_version 357187 (0.0010) [2023-12-27 21:47:28,434][106225] Updated weights for policy 1, policy_version 357197 (0.0010) [2023-12-27 21:47:28,915][106226] Updated weights for policy 0, policy_version 356589 (0.0009) [2023-12-27 21:47:28,967][106226] Updated weights for policy 0, policy_version 356599 (0.0005) [2023-12-27 21:47:29,028][106226] Updated weights for policy 0, policy_version 356609 (0.0008) [2023-12-27 21:47:29,171][106225] Updated weights for policy 1, policy_version 357207 (0.0010) [2023-12-27 21:47:29,244][106225] Updated weights for policy 1, policy_version 357217 (0.0010) [2023-12-27 21:47:29,300][106225] Updated weights for policy 1, policy_version 357227 (0.0008) [2023-12-27 21:47:29,784][106226] Updated weights for policy 0, policy_version 356619 (0.0008) [2023-12-27 21:47:29,850][106226] Updated weights for policy 0, policy_version 356629 (0.0008) [2023-12-27 21:47:29,924][106226] Updated weights for policy 0, policy_version 356639 (0.0010) [2023-12-27 21:47:30,039][106225] Updated weights for policy 1, policy_version 357237 (0.0008) [2023-12-27 21:47:30,092][106225] Updated weights for policy 1, policy_version 357247 (0.0008) [2023-12-27 21:47:30,147][106225] Updated weights for policy 1, policy_version 357257 (0.0007) [2023-12-27 21:47:30,701][106226] Updated weights for policy 0, policy_version 356649 (0.0008) [2023-12-27 21:47:30,744][106225] Updated weights for policy 1, policy_version 357267 (0.0008) [2023-12-27 21:47:30,759][106226] Updated weights for policy 0, policy_version 356659 (0.0008) [2023-12-27 21:47:30,800][106225] Updated weights for policy 1, policy_version 357277 (0.0009) [2023-12-27 21:47:30,814][106226] Updated weights for policy 0, policy_version 356669 (0.0009) [2023-12-27 21:47:30,859][106225] Updated weights for policy 1, policy_version 357287 (0.0008) [2023-12-27 21:47:30,867][106226] Updated weights for policy 0, policy_version 356679 (0.0009) [2023-12-27 21:47:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 182837248. Throughput: 0: 9930.4, 1: 9978.9. Samples: 182824576. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:31,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-5.535')] [2023-12-27 21:47:31,543][106225] Updated weights for policy 1, policy_version 357297 (0.0008) [2023-12-27 21:47:31,578][106226] Updated weights for policy 0, policy_version 356689 (0.0008) [2023-12-27 21:47:31,609][106225] Updated weights for policy 1, policy_version 357307 (0.0008) [2023-12-27 21:47:31,645][106226] Updated weights for policy 0, policy_version 356699 (0.0007) [2023-12-27 21:47:31,666][106225] Updated weights for policy 1, policy_version 357317 (0.0008) [2023-12-27 21:47:31,705][106226] Updated weights for policy 0, policy_version 356709 (0.0009) [2023-12-27 21:47:31,732][106225] Updated weights for policy 1, policy_version 357327 (0.0007) [2023-12-27 21:47:32,340][106226] Updated weights for policy 0, policy_version 356719 (0.0007) [2023-12-27 21:47:32,406][106226] Updated weights for policy 0, policy_version 356729 (0.0008) [2023-12-27 21:47:32,439][106225] Updated weights for policy 1, policy_version 357337 (0.0008) [2023-12-27 21:47:32,469][106226] Updated weights for policy 0, policy_version 356739 (0.0006) [2023-12-27 21:47:32,498][106225] Updated weights for policy 1, policy_version 357347 (0.0006) [2023-12-27 21:47:32,557][106225] Updated weights for policy 1, policy_version 357357 (0.0008) [2023-12-27 21:47:33,123][106226] Updated weights for policy 0, policy_version 356749 (0.0007) [2023-12-27 21:47:33,189][106226] Updated weights for policy 0, policy_version 356759 (0.0005) [2023-12-27 21:47:33,244][106226] Updated weights for policy 0, policy_version 356769 (0.0007) [2023-12-27 21:47:33,334][106225] Updated weights for policy 1, policy_version 357367 (0.0010) [2023-12-27 21:47:33,388][106225] Updated weights for policy 1, policy_version 357377 (0.0010) [2023-12-27 21:47:33,442][106225] Updated weights for policy 1, policy_version 357387 (0.0007) [2023-12-27 21:47:33,905][106226] Updated weights for policy 0, policy_version 356779 (0.0008) [2023-12-27 21:47:33,954][106226] Updated weights for policy 0, policy_version 356789 (0.0008) [2023-12-27 21:47:34,011][106226] Updated weights for policy 0, policy_version 356799 (0.0007) [2023-12-27 21:47:34,156][106225] Updated weights for policy 1, policy_version 357397 (0.0007) [2023-12-27 21:47:34,215][106225] Updated weights for policy 1, policy_version 357407 (0.0009) [2023-12-27 21:47:34,273][106225] Updated weights for policy 1, policy_version 357417 (0.0010) [2023-12-27 21:47:34,814][106226] Updated weights for policy 0, policy_version 356809 (0.0008) [2023-12-27 21:47:34,879][106226] Updated weights for policy 0, policy_version 356819 (0.0005) [2023-12-27 21:47:34,945][106226] Updated weights for policy 0, policy_version 356829 (0.0005) [2023-12-27 21:47:34,947][106225] Updated weights for policy 1, policy_version 357427 (0.0008) [2023-12-27 21:47:35,012][106226] Updated weights for policy 0, policy_version 356839 (0.0005) [2023-12-27 21:47:35,015][106225] Updated weights for policy 1, policy_version 357437 (0.0010) [2023-12-27 21:47:35,078][106225] Updated weights for policy 1, policy_version 357447 (0.0010) [2023-12-27 21:47:35,588][106226] Updated weights for policy 0, policy_version 356849 (0.0010) [2023-12-27 21:47:35,651][106226] Updated weights for policy 0, policy_version 356859 (0.0007) [2023-12-27 21:47:35,654][106225] Updated weights for policy 1, policy_version 357457 (0.0010) [2023-12-27 21:47:35,713][106226] Updated weights for policy 0, policy_version 356869 (0.0005) [2023-12-27 21:47:35,716][106225] Updated weights for policy 1, policy_version 357467 (0.0005) [2023-12-27 21:47:35,778][106225] Updated weights for policy 1, policy_version 357477 (0.0007) [2023-12-27 21:47:35,839][106225] Updated weights for policy 1, policy_version 357487 (0.0008) [2023-12-27 21:47:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 182935552. Throughput: 0: 9900.0, 1: 9927.7. Samples: 182946332. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:36,175][105115] Avg episode reward: [(0, '-5.018'), (1, '-5.877')] [2023-12-27 21:47:36,380][106226] Updated weights for policy 0, policy_version 356879 (0.0007) [2023-12-27 21:47:36,439][106226] Updated weights for policy 0, policy_version 356889 (0.0008) [2023-12-27 21:47:36,452][106225] Updated weights for policy 1, policy_version 357497 (0.0008) [2023-12-27 21:47:36,491][106226] Updated weights for policy 0, policy_version 356899 (0.0008) [2023-12-27 21:47:36,511][106225] Updated weights for policy 1, policy_version 357507 (0.0007) [2023-12-27 21:47:36,575][106225] Updated weights for policy 1, policy_version 357517 (0.0008) [2023-12-27 21:47:37,256][106226] Updated weights for policy 0, policy_version 356909 (0.0008) [2023-12-27 21:47:37,298][106225] Updated weights for policy 1, policy_version 357527 (0.0006) [2023-12-27 21:47:37,310][106226] Updated weights for policy 0, policy_version 356919 (0.0009) [2023-12-27 21:47:37,355][106225] Updated weights for policy 1, policy_version 357537 (0.0008) [2023-12-27 21:47:37,361][106226] Updated weights for policy 0, policy_version 356929 (0.0008) [2023-12-27 21:47:37,417][106225] Updated weights for policy 1, policy_version 357547 (0.0010) [2023-12-27 21:47:38,054][106225] Updated weights for policy 1, policy_version 357557 (0.0008) [2023-12-27 21:47:38,054][106226] Updated weights for policy 0, policy_version 356939 (0.0005) [2023-12-27 21:47:38,109][106226] Updated weights for policy 0, policy_version 356949 (0.0007) [2023-12-27 21:47:38,109][106225] Updated weights for policy 1, policy_version 357567 (0.0006) [2023-12-27 21:47:38,162][106225] Updated weights for policy 1, policy_version 357577 (0.0007) [2023-12-27 21:47:38,173][106226] Updated weights for policy 0, policy_version 356959 (0.0006) [2023-12-27 21:47:38,744][106225] Updated weights for policy 1, policy_version 357587 (0.0007) [2023-12-27 21:47:38,803][106225] Updated weights for policy 1, policy_version 357597 (0.0007) [2023-12-27 21:47:38,862][106225] Updated weights for policy 1, policy_version 357607 (0.0010) [2023-12-27 21:47:38,970][106226] Updated weights for policy 0, policy_version 356969 (0.0008) [2023-12-27 21:47:39,025][106226] Updated weights for policy 0, policy_version 356979 (0.0006) [2023-12-27 21:47:39,089][106226] Updated weights for policy 0, policy_version 356989 (0.0005) [2023-12-27 21:47:39,155][106226] Updated weights for policy 0, policy_version 356999 (0.0005) [2023-12-27 21:47:39,600][106225] Updated weights for policy 1, policy_version 357617 (0.0006) [2023-12-27 21:47:39,665][106225] Updated weights for policy 1, policy_version 357627 (0.0008) [2023-12-27 21:47:39,718][106225] Updated weights for policy 1, policy_version 357637 (0.0008) [2023-12-27 21:47:39,775][106225] Updated weights for policy 1, policy_version 357647 (0.0007) [2023-12-27 21:47:39,849][106226] Updated weights for policy 0, policy_version 357009 (0.0009) [2023-12-27 21:47:39,913][106226] Updated weights for policy 0, policy_version 357019 (0.0009) [2023-12-27 21:47:39,976][106226] Updated weights for policy 0, policy_version 357029 (0.0008) [2023-12-27 21:47:40,553][106225] Updated weights for policy 1, policy_version 357657 (0.0009) [2023-12-27 21:47:40,617][106225] Updated weights for policy 1, policy_version 357667 (0.0008) [2023-12-27 21:47:40,619][106226] Updated weights for policy 0, policy_version 357039 (0.0007) [2023-12-27 21:47:40,674][106226] Updated weights for policy 0, policy_version 357049 (0.0007) [2023-12-27 21:47:40,675][106225] Updated weights for policy 1, policy_version 357677 (0.0007) [2023-12-27 21:47:40,741][106226] Updated weights for policy 0, policy_version 357059 (0.0008) [2023-12-27 21:47:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 183033856. Throughput: 0: 9880.3, 1: 9981.6. Samples: 183006520. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:41,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-5.630')] [2023-12-27 21:47:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000357680_91594752.pth... [2023-12-27 21:47:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000357064_91439104.pth... [2023-12-27 21:47:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000356528_91299840.pth [2023-12-27 21:47:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000355912_91144192.pth [2023-12-27 21:47:41,415][106225] Updated weights for policy 1, policy_version 357687 (0.0010) [2023-12-27 21:47:41,458][106226] Updated weights for policy 0, policy_version 357069 (0.0009) [2023-12-27 21:47:41,480][106225] Updated weights for policy 1, policy_version 357697 (0.0011) [2023-12-27 21:47:41,526][106226] Updated weights for policy 0, policy_version 357079 (0.0008) [2023-12-27 21:47:41,545][106225] Updated weights for policy 1, policy_version 357707 (0.0010) [2023-12-27 21:47:41,587][106226] Updated weights for policy 0, policy_version 357089 (0.0008) [2023-12-27 21:47:42,277][106225] Updated weights for policy 1, policy_version 357717 (0.0010) [2023-12-27 21:47:42,328][106226] Updated weights for policy 0, policy_version 357099 (0.0008) [2023-12-27 21:47:42,338][106225] Updated weights for policy 1, policy_version 357727 (0.0009) [2023-12-27 21:47:42,392][106226] Updated weights for policy 0, policy_version 357109 (0.0007) [2023-12-27 21:47:42,402][106225] Updated weights for policy 1, policy_version 357737 (0.0009) [2023-12-27 21:47:42,449][106226] Updated weights for policy 0, policy_version 357119 (0.0007) [2023-12-27 21:47:43,129][106225] Updated weights for policy 1, policy_version 357747 (0.0008) [2023-12-27 21:47:43,196][106225] Updated weights for policy 1, policy_version 357757 (0.0008) [2023-12-27 21:47:43,238][106226] Updated weights for policy 0, policy_version 357129 (0.0009) [2023-12-27 21:47:43,261][106225] Updated weights for policy 1, policy_version 357767 (0.0008) [2023-12-27 21:47:43,301][106226] Updated weights for policy 0, policy_version 357139 (0.0008) [2023-12-27 21:47:43,349][106226] Updated weights for policy 0, policy_version 357149 (0.0008) [2023-12-27 21:47:43,398][106226] Updated weights for policy 0, policy_version 357159 (0.0009) [2023-12-27 21:47:43,911][106225] Updated weights for policy 1, policy_version 357777 (0.0006) [2023-12-27 21:47:43,979][106225] Updated weights for policy 1, policy_version 357787 (0.0008) [2023-12-27 21:47:44,042][106225] Updated weights for policy 1, policy_version 357797 (0.0008) [2023-12-27 21:47:44,103][106225] Updated weights for policy 1, policy_version 357807 (0.0008) [2023-12-27 21:47:44,141][106226] Updated weights for policy 0, policy_version 357169 (0.0008) [2023-12-27 21:47:44,189][106226] Updated weights for policy 0, policy_version 357179 (0.0010) [2023-12-27 21:47:44,253][106226] Updated weights for policy 0, policy_version 357190 (0.0008) [2023-12-27 21:47:44,696][106225] Updated weights for policy 1, policy_version 357817 (0.0008) [2023-12-27 21:47:44,741][106225] Updated weights for policy 1, policy_version 357827 (0.0007) [2023-12-27 21:47:44,800][106225] Updated weights for policy 1, policy_version 357837 (0.0008) [2023-12-27 21:47:44,991][106226] Updated weights for policy 0, policy_version 357200 (0.0009) [2023-12-27 21:47:45,057][106226] Updated weights for policy 0, policy_version 357210 (0.0009) [2023-12-27 21:47:45,112][106226] Updated weights for policy 0, policy_version 357220 (0.0008) [2023-12-27 21:47:45,475][106225] Updated weights for policy 1, policy_version 357847 (0.0007) [2023-12-27 21:47:45,533][106225] Updated weights for policy 1, policy_version 357857 (0.0008) [2023-12-27 21:47:45,589][106225] Updated weights for policy 1, policy_version 357867 (0.0005) [2023-12-27 21:47:45,845][106226] Updated weights for policy 0, policy_version 357230 (0.0007) [2023-12-27 21:47:45,894][106226] Updated weights for policy 0, policy_version 357240 (0.0005) [2023-12-27 21:47:45,952][106226] Updated weights for policy 0, policy_version 357250 (0.0008) [2023-12-27 21:47:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 183132160. Throughput: 0: 9851.6, 1: 9953.8. Samples: 183121868. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:46,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-5.617')] [2023-12-27 21:47:46,247][106225] Updated weights for policy 1, policy_version 357877 (0.0008) [2023-12-27 21:47:46,308][106225] Updated weights for policy 1, policy_version 357887 (0.0008) [2023-12-27 21:47:46,366][106225] Updated weights for policy 1, policy_version 357897 (0.0005) [2023-12-27 21:47:46,695][106226] Updated weights for policy 0, policy_version 357260 (0.0009) [2023-12-27 21:47:46,756][106226] Updated weights for policy 0, policy_version 357270 (0.0010) [2023-12-27 21:47:46,815][106226] Updated weights for policy 0, policy_version 357280 (0.0008) [2023-12-27 21:47:46,914][106225] Updated weights for policy 1, policy_version 357907 (0.0007) [2023-12-27 21:47:46,975][106225] Updated weights for policy 1, policy_version 357917 (0.0010) [2023-12-27 21:47:47,030][106225] Updated weights for policy 1, policy_version 357927 (0.0007) [2023-12-27 21:47:47,584][106226] Updated weights for policy 0, policy_version 357290 (0.0008) [2023-12-27 21:47:47,602][106225] Updated weights for policy 1, policy_version 357937 (0.0005) [2023-12-27 21:47:47,650][106226] Updated weights for policy 0, policy_version 357300 (0.0009) [2023-12-27 21:47:47,668][106225] Updated weights for policy 1, policy_version 357947 (0.0005) [2023-12-27 21:47:47,703][106226] Updated weights for policy 0, policy_version 357310 (0.0008) [2023-12-27 21:47:47,725][106225] Updated weights for policy 1, policy_version 357957 (0.0006) [2023-12-27 21:47:47,765][106226] Updated weights for policy 0, policy_version 357320 (0.0006) [2023-12-27 21:47:47,786][106225] Updated weights for policy 1, policy_version 357967 (0.0006) [2023-12-27 21:47:48,344][106225] Updated weights for policy 1, policy_version 357977 (0.0007) [2023-12-27 21:47:48,406][106225] Updated weights for policy 1, policy_version 357987 (0.0009) [2023-12-27 21:47:48,469][106225] Updated weights for policy 1, policy_version 357997 (0.0010) [2023-12-27 21:47:48,558][106226] Updated weights for policy 0, policy_version 357330 (0.0008) [2023-12-27 21:47:48,625][106226] Updated weights for policy 0, policy_version 357340 (0.0008) [2023-12-27 21:47:48,686][106226] Updated weights for policy 0, policy_version 357350 (0.0008) [2023-12-27 21:47:49,076][106225] Updated weights for policy 1, policy_version 358007 (0.0007) [2023-12-27 21:47:49,121][106225] Updated weights for policy 1, policy_version 358017 (0.0005) [2023-12-27 21:47:49,171][106225] Updated weights for policy 1, policy_version 358027 (0.0009) [2023-12-27 21:47:49,469][106226] Updated weights for policy 0, policy_version 357360 (0.0008) [2023-12-27 21:47:49,524][106226] Updated weights for policy 0, policy_version 357370 (0.0009) [2023-12-27 21:47:49,598][106226] Updated weights for policy 0, policy_version 357380 (0.0009) [2023-12-27 21:47:49,852][106225] Updated weights for policy 1, policy_version 358037 (0.0009) [2023-12-27 21:47:49,912][106225] Updated weights for policy 1, policy_version 358047 (0.0009) [2023-12-27 21:47:49,977][106225] Updated weights for policy 1, policy_version 358057 (0.0008) [2023-12-27 21:47:50,347][106226] Updated weights for policy 0, policy_version 357390 (0.0008) [2023-12-27 21:47:50,402][106226] Updated weights for policy 0, policy_version 357400 (0.0005) [2023-12-27 21:47:50,461][106226] Updated weights for policy 0, policy_version 357410 (0.0008) [2023-12-27 21:47:50,717][106225] Updated weights for policy 1, policy_version 358067 (0.0009) [2023-12-27 21:47:50,784][106225] Updated weights for policy 1, policy_version 358077 (0.0010) [2023-12-27 21:47:50,850][106225] Updated weights for policy 1, policy_version 358087 (0.0006) [2023-12-27 21:47:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 183230464. Throughput: 0: 9779.8, 1: 10027.5. Samples: 183242240. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:51,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.772')] [2023-12-27 21:47:51,209][106226] Updated weights for policy 0, policy_version 357420 (0.0008) [2023-12-27 21:47:51,277][106226] Updated weights for policy 0, policy_version 357430 (0.0008) [2023-12-27 21:47:51,348][106226] Updated weights for policy 0, policy_version 357440 (0.0008) [2023-12-27 21:47:51,540][106225] Updated weights for policy 1, policy_version 358097 (0.0008) [2023-12-27 21:47:51,597][106225] Updated weights for policy 1, policy_version 358107 (0.0009) [2023-12-27 21:47:51,664][106225] Updated weights for policy 1, policy_version 358117 (0.0008) [2023-12-27 21:47:51,735][106225] Updated weights for policy 1, policy_version 358127 (0.0008) [2023-12-27 21:47:52,081][106226] Updated weights for policy 0, policy_version 357450 (0.0009) [2023-12-27 21:47:52,143][106226] Updated weights for policy 0, policy_version 357460 (0.0008) [2023-12-27 21:47:52,198][106226] Updated weights for policy 0, policy_version 357470 (0.0008) [2023-12-27 21:47:52,250][106226] Updated weights for policy 0, policy_version 357480 (0.0007) [2023-12-27 21:47:52,491][106225] Updated weights for policy 1, policy_version 358137 (0.0009) [2023-12-27 21:47:52,560][106225] Updated weights for policy 1, policy_version 358147 (0.0008) [2023-12-27 21:47:52,616][106225] Updated weights for policy 1, policy_version 358157 (0.0008) [2023-12-27 21:47:52,889][106226] Updated weights for policy 0, policy_version 357490 (0.0009) [2023-12-27 21:47:52,950][106226] Updated weights for policy 0, policy_version 357500 (0.0009) [2023-12-27 21:47:52,998][106226] Updated weights for policy 0, policy_version 357510 (0.0008) [2023-12-27 21:47:53,370][106225] Updated weights for policy 1, policy_version 358167 (0.0008) [2023-12-27 21:47:53,427][106225] Updated weights for policy 1, policy_version 358177 (0.0008) [2023-12-27 21:47:53,486][106225] Updated weights for policy 1, policy_version 358187 (0.0008) [2023-12-27 21:47:53,728][106226] Updated weights for policy 0, policy_version 357520 (0.0009) [2023-12-27 21:47:53,787][106226] Updated weights for policy 0, policy_version 357530 (0.0008) [2023-12-27 21:47:53,846][106226] Updated weights for policy 0, policy_version 357540 (0.0009) [2023-12-27 21:47:54,235][106225] Updated weights for policy 1, policy_version 358197 (0.0009) [2023-12-27 21:47:54,292][106225] Updated weights for policy 1, policy_version 358207 (0.0009) [2023-12-27 21:47:54,347][106225] Updated weights for policy 1, policy_version 358217 (0.0009) [2023-12-27 21:47:54,429][106226] Updated weights for policy 0, policy_version 357550 (0.0009) [2023-12-27 21:47:54,495][106226] Updated weights for policy 0, policy_version 357560 (0.0008) [2023-12-27 21:47:54,563][106226] Updated weights for policy 0, policy_version 357570 (0.0008) [2023-12-27 21:47:55,035][106225] Updated weights for policy 1, policy_version 358228 (0.0008) [2023-12-27 21:47:55,093][106225] Updated weights for policy 1, policy_version 358238 (0.0006) [2023-12-27 21:47:55,154][106225] Updated weights for policy 1, policy_version 358248 (0.0006) [2023-12-27 21:47:55,218][106226] Updated weights for policy 0, policy_version 357580 (0.0007) [2023-12-27 21:47:55,264][106226] Updated weights for policy 0, policy_version 357590 (0.0005) [2023-12-27 21:47:55,319][106226] Updated weights for policy 0, policy_version 357600 (0.0006) [2023-12-27 21:47:55,787][106225] Updated weights for policy 1, policy_version 358258 (0.0006) [2023-12-27 21:47:55,845][106225] Updated weights for policy 1, policy_version 358268 (0.0006) [2023-12-27 21:47:55,901][106225] Updated weights for policy 1, policy_version 358278 (0.0009) [2023-12-27 21:47:55,939][106226] Updated weights for policy 0, policy_version 357610 (0.0008) [2023-12-27 21:47:55,960][106225] Updated weights for policy 1, policy_version 358288 (0.0010) [2023-12-27 21:47:56,006][106226] Updated weights for policy 0, policy_version 357620 (0.0008) [2023-12-27 21:47:56,072][106226] Updated weights for policy 0, policy_version 357630 (0.0008) [2023-12-27 21:47:56,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 183336960. Throughput: 0: 9782.7, 1: 9959.2. Samples: 183299828. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:47:56,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-6.009')] [2023-12-27 21:47:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000358288_91750400.pth... [2023-12-27 21:47:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000357640_91586560.pth... [2023-12-27 21:47:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000357104_91447296.pth [2023-12-27 21:47:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000356488_91291648.pth [2023-12-27 21:47:56,606][106225] Updated weights for policy 1, policy_version 358298 (0.0010) [2023-12-27 21:47:56,666][106225] Updated weights for policy 1, policy_version 358308 (0.0010) [2023-12-27 21:47:56,696][106226] Updated weights for policy 0, policy_version 357641 (0.0010) [2023-12-27 21:47:56,712][106225] Updated weights for policy 1, policy_version 358318 (0.0010) [2023-12-27 21:47:56,752][106226] Updated weights for policy 0, policy_version 357651 (0.0005) [2023-12-27 21:47:56,816][106226] Updated weights for policy 0, policy_version 357661 (0.0006) [2023-12-27 21:47:56,881][106226] Updated weights for policy 0, policy_version 357671 (0.0005) [2023-12-27 21:47:57,376][106226] Updated weights for policy 0, policy_version 357681 (0.0010) [2023-12-27 21:47:57,413][106225] Updated weights for policy 1, policy_version 358328 (0.0006) [2023-12-27 21:47:57,437][106226] Updated weights for policy 0, policy_version 357691 (0.0011) [2023-12-27 21:47:57,470][106225] Updated weights for policy 1, policy_version 358338 (0.0005) [2023-12-27 21:47:57,499][106226] Updated weights for policy 0, policy_version 357701 (0.0010) [2023-12-27 21:47:57,525][106225] Updated weights for policy 1, policy_version 358348 (0.0010) [2023-12-27 21:47:58,116][106226] Updated weights for policy 0, policy_version 357711 (0.0011) [2023-12-27 21:47:58,167][106226] Updated weights for policy 0, policy_version 357721 (0.0010) [2023-12-27 21:47:58,228][106225] Updated weights for policy 1, policy_version 358358 (0.0009) [2023-12-27 21:47:58,231][106226] Updated weights for policy 0, policy_version 357731 (0.0010) [2023-12-27 21:47:58,298][106225] Updated weights for policy 1, policy_version 358368 (0.0007) [2023-12-27 21:47:58,364][106225] Updated weights for policy 1, policy_version 358378 (0.0009) [2023-12-27 21:47:59,074][106226] Updated weights for policy 0, policy_version 357741 (0.0010) [2023-12-27 21:47:59,133][106226] Updated weights for policy 0, policy_version 357751 (0.0009) [2023-12-27 21:47:59,178][106225] Updated weights for policy 1, policy_version 358388 (0.0007) [2023-12-27 21:47:59,186][106226] Updated weights for policy 0, policy_version 357761 (0.0008) [2023-12-27 21:47:59,243][106225] Updated weights for policy 1, policy_version 358398 (0.0009) [2023-12-27 21:47:59,310][106225] Updated weights for policy 1, policy_version 358408 (0.0007) [2023-12-27 21:47:59,851][106226] Updated weights for policy 0, policy_version 357771 (0.0007) [2023-12-27 21:47:59,913][106226] Updated weights for policy 0, policy_version 357781 (0.0010) [2023-12-27 21:47:59,981][106226] Updated weights for policy 0, policy_version 357791 (0.0008) [2023-12-27 21:48:00,150][106225] Updated weights for policy 1, policy_version 358418 (0.0010) [2023-12-27 21:48:00,207][106225] Updated weights for policy 1, policy_version 358428 (0.0009) [2023-12-27 21:48:00,262][106225] Updated weights for policy 1, policy_version 358438 (0.0010) [2023-12-27 21:48:00,322][106225] Updated weights for policy 1, policy_version 358448 (0.0010) [2023-12-27 21:48:00,583][106226] Updated weights for policy 0, policy_version 357801 (0.0006) [2023-12-27 21:48:00,641][106226] Updated weights for policy 0, policy_version 357811 (0.0008) [2023-12-27 21:48:00,704][106226] Updated weights for policy 0, policy_version 357821 (0.0011) [2023-12-27 21:48:00,758][106226] Updated weights for policy 0, policy_version 357831 (0.0010) [2023-12-27 21:48:01,064][106225] Updated weights for policy 1, policy_version 358458 (0.0011) [2023-12-27 21:48:01,127][106225] Updated weights for policy 1, policy_version 358468 (0.0011) [2023-12-27 21:48:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 183427072. Throughput: 0: 9934.2, 1: 9942.2. Samples: 183421960. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:48:01,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-5.754')] [2023-12-27 21:48:01,192][106225] Updated weights for policy 1, policy_version 358478 (0.0007) [2023-12-27 21:48:01,407][106226] Updated weights for policy 0, policy_version 357841 (0.0010) [2023-12-27 21:48:01,475][106226] Updated weights for policy 0, policy_version 357851 (0.0010) [2023-12-27 21:48:01,545][106226] Updated weights for policy 0, policy_version 357861 (0.0011) [2023-12-27 21:48:01,933][106225] Updated weights for policy 1, policy_version 358488 (0.0008) [2023-12-27 21:48:01,996][106225] Updated weights for policy 1, policy_version 358498 (0.0009) [2023-12-27 21:48:02,055][106225] Updated weights for policy 1, policy_version 358508 (0.0009) [2023-12-27 21:48:02,160][106226] Updated weights for policy 0, policy_version 357871 (0.0007) [2023-12-27 21:48:02,213][106226] Updated weights for policy 0, policy_version 357881 (0.0005) [2023-12-27 21:48:02,276][106226] Updated weights for policy 0, policy_version 357891 (0.0008) [2023-12-27 21:48:02,801][106225] Updated weights for policy 1, policy_version 358518 (0.0006) [2023-12-27 21:48:02,859][106225] Updated weights for policy 1, policy_version 358528 (0.0006) [2023-12-27 21:48:02,915][106225] Updated weights for policy 1, policy_version 358538 (0.0007) [2023-12-27 21:48:02,925][106226] Updated weights for policy 0, policy_version 357901 (0.0007) [2023-12-27 21:48:02,978][106226] Updated weights for policy 0, policy_version 357911 (0.0008) [2023-12-27 21:48:03,031][106226] Updated weights for policy 0, policy_version 357921 (0.0007) [2023-12-27 21:48:03,600][106225] Updated weights for policy 1, policy_version 358548 (0.0010) [2023-12-27 21:48:03,652][106225] Updated weights for policy 1, policy_version 358558 (0.0008) [2023-12-27 21:48:03,703][106225] Updated weights for policy 1, policy_version 358568 (0.0005) [2023-12-27 21:48:03,746][106226] Updated weights for policy 0, policy_version 357931 (0.0008) [2023-12-27 21:48:03,802][106226] Updated weights for policy 0, policy_version 357941 (0.0005) [2023-12-27 21:48:03,887][106226] Updated weights for policy 0, policy_version 357951 (0.0007) [2023-12-27 21:48:04,364][106225] Updated weights for policy 1, policy_version 358578 (0.0005) [2023-12-27 21:48:04,430][106225] Updated weights for policy 1, policy_version 358588 (0.0010) [2023-12-27 21:48:04,481][106225] Updated weights for policy 1, policy_version 358598 (0.0008) [2023-12-27 21:48:04,502][106226] Updated weights for policy 0, policy_version 357961 (0.0006) [2023-12-27 21:48:04,536][106225] Updated weights for policy 1, policy_version 358608 (0.0007) [2023-12-27 21:48:04,561][106226] Updated weights for policy 0, policy_version 357971 (0.0009) [2023-12-27 21:48:04,617][106226] Updated weights for policy 0, policy_version 357981 (0.0009) [2023-12-27 21:48:04,663][106226] Updated weights for policy 0, policy_version 357991 (0.0008) [2023-12-27 21:48:05,197][106225] Updated weights for policy 1, policy_version 358618 (0.0007) [2023-12-27 21:48:05,250][106225] Updated weights for policy 1, policy_version 358628 (0.0005) [2023-12-27 21:48:05,315][106225] Updated weights for policy 1, policy_version 358638 (0.0006) [2023-12-27 21:48:05,398][106226] Updated weights for policy 0, policy_version 358001 (0.0009) [2023-12-27 21:48:05,460][106226] Updated weights for policy 0, policy_version 358011 (0.0007) [2023-12-27 21:48:05,508][106226] Updated weights for policy 0, policy_version 358021 (0.0005) [2023-12-27 21:48:05,979][106225] Updated weights for policy 1, policy_version 358648 (0.0007) [2023-12-27 21:48:06,048][106225] Updated weights for policy 1, policy_version 358658 (0.0008) [2023-12-27 21:48:06,112][106225] Updated weights for policy 1, policy_version 358668 (0.0007) [2023-12-27 21:48:06,152][106226] Updated weights for policy 0, policy_version 358031 (0.0006) [2023-12-27 21:48:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 183533568. Throughput: 0: 9911.4, 1: 10021.5. Samples: 183543108. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:48:06,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-5.820')] [2023-12-27 21:48:06,217][106226] Updated weights for policy 0, policy_version 358041 (0.0008) [2023-12-27 21:48:06,283][106226] Updated weights for policy 0, policy_version 358051 (0.0009) [2023-12-27 21:48:06,827][106225] Updated weights for policy 1, policy_version 358678 (0.0010) [2023-12-27 21:48:06,886][106225] Updated weights for policy 1, policy_version 358688 (0.0008) [2023-12-27 21:48:06,946][106225] Updated weights for policy 1, policy_version 358698 (0.0008) [2023-12-27 21:48:06,997][106226] Updated weights for policy 0, policy_version 358061 (0.0009) [2023-12-27 21:48:07,058][106226] Updated weights for policy 0, policy_version 358071 (0.0008) [2023-12-27 21:48:07,119][106226] Updated weights for policy 0, policy_version 358081 (0.0009) [2023-12-27 21:48:07,630][106225] Updated weights for policy 1, policy_version 358708 (0.0007) [2023-12-27 21:48:07,690][106225] Updated weights for policy 1, policy_version 358718 (0.0009) [2023-12-27 21:48:07,741][106225] Updated weights for policy 1, policy_version 358728 (0.0010) [2023-12-27 21:48:07,830][106226] Updated weights for policy 0, policy_version 358091 (0.0008) [2023-12-27 21:48:07,887][106226] Updated weights for policy 0, policy_version 358101 (0.0008) [2023-12-27 21:48:07,943][106226] Updated weights for policy 0, policy_version 358111 (0.0010) [2023-12-27 21:48:08,411][106225] Updated weights for policy 1, policy_version 358738 (0.0010) [2023-12-27 21:48:08,476][106225] Updated weights for policy 1, policy_version 358748 (0.0010) [2023-12-27 21:48:08,537][106225] Updated weights for policy 1, policy_version 358758 (0.0008) [2023-12-27 21:48:08,605][106225] Updated weights for policy 1, policy_version 358768 (0.0006) [2023-12-27 21:48:08,615][106226] Updated weights for policy 0, policy_version 358121 (0.0010) [2023-12-27 21:48:08,678][106226] Updated weights for policy 0, policy_version 358131 (0.0008) [2023-12-27 21:48:08,743][106226] Updated weights for policy 0, policy_version 358141 (0.0007) [2023-12-27 21:48:08,807][106226] Updated weights for policy 0, policy_version 358151 (0.0008) [2023-12-27 21:48:09,270][106225] Updated weights for policy 1, policy_version 358778 (0.0008) [2023-12-27 21:48:09,324][106225] Updated weights for policy 1, policy_version 358788 (0.0008) [2023-12-27 21:48:09,395][106225] Updated weights for policy 1, policy_version 358798 (0.0009) [2023-12-27 21:48:09,482][106226] Updated weights for policy 0, policy_version 358161 (0.0006) [2023-12-27 21:48:09,537][106226] Updated weights for policy 0, policy_version 358171 (0.0009) [2023-12-27 21:48:09,588][106226] Updated weights for policy 0, policy_version 358181 (0.0008) [2023-12-27 21:48:10,139][106225] Updated weights for policy 1, policy_version 358808 (0.0008) [2023-12-27 21:48:10,202][106225] Updated weights for policy 1, policy_version 358818 (0.0008) [2023-12-27 21:48:10,264][106225] Updated weights for policy 1, policy_version 358828 (0.0010) [2023-12-27 21:48:10,343][106226] Updated weights for policy 0, policy_version 358191 (0.0010) [2023-12-27 21:48:10,404][106226] Updated weights for policy 0, policy_version 358201 (0.0010) [2023-12-27 21:48:10,466][106226] Updated weights for policy 0, policy_version 358211 (0.0009) [2023-12-27 21:48:10,900][106225] Updated weights for policy 1, policy_version 358838 (0.0010) [2023-12-27 21:48:10,964][106225] Updated weights for policy 1, policy_version 358848 (0.0011) [2023-12-27 21:48:11,021][106225] Updated weights for policy 1, policy_version 358858 (0.0010) [2023-12-27 21:48:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 183631872. Throughput: 0: 9952.5, 1: 10054.5. Samples: 183602436. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:48:11,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-6.025')] [2023-12-27 21:48:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000358864_91897856.pth... [2023-12-27 21:48:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000357680_91594752.pth [2023-12-27 21:48:11,202][106226] Updated weights for policy 0, policy_version 358221 (0.0010) [2023-12-27 21:48:11,269][106226] Updated weights for policy 0, policy_version 358231 (0.0007) [2023-12-27 21:48:11,338][106226] Updated weights for policy 0, policy_version 358241 (0.0008) [2023-12-27 21:48:11,390][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000358248_91742208.pth... [2023-12-27 21:48:11,395][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000357064_91439104.pth [2023-12-27 21:48:11,798][106225] Updated weights for policy 1, policy_version 358868 (0.0008) [2023-12-27 21:48:11,862][106225] Updated weights for policy 1, policy_version 358878 (0.0007) [2023-12-27 21:48:11,927][106225] Updated weights for policy 1, policy_version 358888 (0.0007) [2023-12-27 21:48:12,094][106226] Updated weights for policy 0, policy_version 358251 (0.0009) [2023-12-27 21:48:12,162][106226] Updated weights for policy 0, policy_version 358261 (0.0010) [2023-12-27 21:48:12,226][106226] Updated weights for policy 0, policy_version 358271 (0.0009) [2023-12-27 21:48:12,596][106225] Updated weights for policy 1, policy_version 358898 (0.0008) [2023-12-27 21:48:12,663][106225] Updated weights for policy 1, policy_version 358908 (0.0008) [2023-12-27 21:48:12,729][106225] Updated weights for policy 1, policy_version 358918 (0.0007) [2023-12-27 21:48:12,795][106225] Updated weights for policy 1, policy_version 358928 (0.0009) [2023-12-27 21:48:12,950][106226] Updated weights for policy 0, policy_version 358281 (0.0009) [2023-12-27 21:48:13,015][106226] Updated weights for policy 0, policy_version 358291 (0.0010) [2023-12-27 21:48:13,083][106226] Updated weights for policy 0, policy_version 358301 (0.0009) [2023-12-27 21:48:13,145][106226] Updated weights for policy 0, policy_version 358311 (0.0009) [2023-12-27 21:48:13,488][106225] Updated weights for policy 1, policy_version 358938 (0.0006) [2023-12-27 21:48:13,548][106225] Updated weights for policy 1, policy_version 358948 (0.0007) [2023-12-27 21:48:13,609][106225] Updated weights for policy 1, policy_version 358958 (0.0008) [2023-12-27 21:48:13,782][106226] Updated weights for policy 0, policy_version 358321 (0.0010) [2023-12-27 21:48:13,842][106226] Updated weights for policy 0, policy_version 358331 (0.0009) [2023-12-27 21:48:13,890][106226] Updated weights for policy 0, policy_version 358341 (0.0005) [2023-12-27 21:48:14,171][106225] Updated weights for policy 1, policy_version 358968 (0.0007) [2023-12-27 21:48:14,220][106225] Updated weights for policy 1, policy_version 358978 (0.0007) [2023-12-27 21:48:14,285][106225] Updated weights for policy 1, policy_version 358988 (0.0005) [2023-12-27 21:48:14,579][106226] Updated weights for policy 0, policy_version 358351 (0.0007) [2023-12-27 21:48:14,637][106226] Updated weights for policy 0, policy_version 358361 (0.0009) [2023-12-27 21:48:14,694][106226] Updated weights for policy 0, policy_version 358371 (0.0009) [2023-12-27 21:48:14,814][106225] Updated weights for policy 1, policy_version 358998 (0.0006) [2023-12-27 21:48:14,877][106225] Updated weights for policy 1, policy_version 359008 (0.0008) [2023-12-27 21:48:14,932][106225] Updated weights for policy 1, policy_version 359018 (0.0009) [2023-12-27 21:48:15,484][106226] Updated weights for policy 0, policy_version 358381 (0.0009) [2023-12-27 21:48:15,550][106226] Updated weights for policy 0, policy_version 358391 (0.0009) [2023-12-27 21:48:15,616][106226] Updated weights for policy 0, policy_version 358401 (0.0008) [2023-12-27 21:48:15,626][106225] Updated weights for policy 1, policy_version 359028 (0.0007) [2023-12-27 21:48:15,683][106225] Updated weights for policy 1, policy_version 359038 (0.0007) [2023-12-27 21:48:15,735][106225] Updated weights for policy 1, policy_version 359048 (0.0009) [2023-12-27 21:48:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 183730176. Throughput: 0: 9855.1, 1: 10064.8. Samples: 183720972. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:48:16,176][105115] Avg episode reward: [(0, '-4.606'), (1, '-5.747')] [2023-12-27 21:48:16,327][106226] Updated weights for policy 0, policy_version 358411 (0.0007) [2023-12-27 21:48:16,377][106226] Updated weights for policy 0, policy_version 358421 (0.0007) [2023-12-27 21:48:16,426][106226] Updated weights for policy 0, policy_version 358431 (0.0008) [2023-12-27 21:48:16,469][106225] Updated weights for policy 1, policy_version 359058 (0.0009) [2023-12-27 21:48:16,525][106225] Updated weights for policy 1, policy_version 359068 (0.0010) [2023-12-27 21:48:16,571][106225] Updated weights for policy 1, policy_version 359078 (0.0010) [2023-12-27 21:48:16,617][106225] Updated weights for policy 1, policy_version 359088 (0.0010) [2023-12-27 21:48:17,186][106226] Updated weights for policy 0, policy_version 358441 (0.0007) [2023-12-27 21:48:17,236][106226] Updated weights for policy 0, policy_version 358451 (0.0009) [2023-12-27 21:48:17,284][106226] Updated weights for policy 0, policy_version 358461 (0.0008) [2023-12-27 21:48:17,297][106225] Updated weights for policy 1, policy_version 359098 (0.0008) [2023-12-27 21:48:17,331][106226] Updated weights for policy 0, policy_version 358471 (0.0005) [2023-12-27 21:48:17,356][106225] Updated weights for policy 1, policy_version 359108 (0.0008) [2023-12-27 21:48:17,408][106225] Updated weights for policy 1, policy_version 359118 (0.0005) [2023-12-27 21:48:18,044][106225] Updated weights for policy 1, policy_version 359128 (0.0007) [2023-12-27 21:48:18,089][106225] Updated weights for policy 1, policy_version 359138 (0.0005) [2023-12-27 21:48:18,136][106226] Updated weights for policy 0, policy_version 358481 (0.0009) [2023-12-27 21:48:18,147][106225] Updated weights for policy 1, policy_version 359148 (0.0005) [2023-12-27 21:48:18,188][106226] Updated weights for policy 0, policy_version 358491 (0.0009) [2023-12-27 21:48:18,239][106226] Updated weights for policy 0, policy_version 358501 (0.0008) [2023-12-27 21:48:18,780][106225] Updated weights for policy 1, policy_version 359158 (0.0007) [2023-12-27 21:48:18,830][106225] Updated weights for policy 1, policy_version 359168 (0.0010) [2023-12-27 21:48:18,894][106225] Updated weights for policy 1, policy_version 359178 (0.0010) [2023-12-27 21:48:19,060][106226] Updated weights for policy 0, policy_version 358511 (0.0007) [2023-12-27 21:48:19,120][106226] Updated weights for policy 0, policy_version 358521 (0.0009) [2023-12-27 21:48:19,172][106226] Updated weights for policy 0, policy_version 358531 (0.0008) [2023-12-27 21:48:19,591][106225] Updated weights for policy 1, policy_version 359188 (0.0009) [2023-12-27 21:48:19,658][106225] Updated weights for policy 1, policy_version 359198 (0.0006) [2023-12-27 21:48:19,729][106225] Updated weights for policy 1, policy_version 359208 (0.0005) [2023-12-27 21:48:20,038][106226] Updated weights for policy 0, policy_version 358541 (0.0009) [2023-12-27 21:48:20,099][106226] Updated weights for policy 0, policy_version 358551 (0.0006) [2023-12-27 21:48:20,163][106226] Updated weights for policy 0, policy_version 358561 (0.0010) [2023-12-27 21:48:20,448][106225] Updated weights for policy 1, policy_version 359218 (0.0009) [2023-12-27 21:48:20,510][106225] Updated weights for policy 1, policy_version 359228 (0.0008) [2023-12-27 21:48:20,572][106225] Updated weights for policy 1, policy_version 359238 (0.0009) [2023-12-27 21:48:20,635][106225] Updated weights for policy 1, policy_version 359248 (0.0008) [2023-12-27 21:48:20,781][106226] Updated weights for policy 0, policy_version 358571 (0.0010) [2023-12-27 21:48:20,845][106226] Updated weights for policy 0, policy_version 358581 (0.0009) [2023-12-27 21:48:20,909][106226] Updated weights for policy 0, policy_version 358591 (0.0009) [2023-12-27 21:48:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 183828480. Throughput: 0: 9748.3, 1: 10047.0. Samples: 183837124. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-27 21:48:21,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-6.142')] [2023-12-27 21:48:21,412][106225] Updated weights for policy 1, policy_version 359258 (0.0010) [2023-12-27 21:48:21,476][106225] Updated weights for policy 1, policy_version 359268 (0.0006) [2023-12-27 21:48:21,545][106225] Updated weights for policy 1, policy_version 359278 (0.0008) [2023-12-27 21:48:21,680][106226] Updated weights for policy 0, policy_version 358601 (0.0008) [2023-12-27 21:48:21,746][106226] Updated weights for policy 0, policy_version 358611 (0.0007) [2023-12-27 21:48:21,804][106226] Updated weights for policy 0, policy_version 358621 (0.0007) [2023-12-27 21:48:21,857][106226] Updated weights for policy 0, policy_version 358631 (0.0006) [2023-12-27 21:48:22,221][106225] Updated weights for policy 1, policy_version 359288 (0.0008) [2023-12-27 21:48:22,289][106225] Updated weights for policy 1, policy_version 359298 (0.0009) [2023-12-27 21:48:22,352][106225] Updated weights for policy 1, policy_version 359308 (0.0010) [2023-12-27 21:48:22,484][106226] Updated weights for policy 0, policy_version 358641 (0.0008) [2023-12-27 21:48:22,548][106226] Updated weights for policy 0, policy_version 358651 (0.0007) [2023-12-27 21:48:22,618][106226] Updated weights for policy 0, policy_version 358661 (0.0006) [2023-12-27 21:48:23,035][106225] Updated weights for policy 1, policy_version 359318 (0.0007) [2023-12-27 21:48:23,103][106225] Updated weights for policy 1, policy_version 359328 (0.0006) [2023-12-27 21:48:23,170][106225] Updated weights for policy 1, policy_version 359338 (0.0006) [2023-12-27 21:48:23,341][106226] Updated weights for policy 0, policy_version 358671 (0.0007) [2023-12-27 21:48:23,391][106226] Updated weights for policy 0, policy_version 358681 (0.0008) [2023-12-27 21:48:23,445][106226] Updated weights for policy 0, policy_version 358691 (0.0009) [2023-12-27 21:48:23,767][106225] Updated weights for policy 1, policy_version 359348 (0.0007) [2023-12-27 21:48:23,825][106225] Updated weights for policy 1, policy_version 359358 (0.0011) [2023-12-27 21:48:23,876][106225] Updated weights for policy 1, policy_version 359368 (0.0010) [2023-12-27 21:48:24,199][106226] Updated weights for policy 0, policy_version 358701 (0.0007) [2023-12-27 21:48:24,247][106226] Updated weights for policy 0, policy_version 358711 (0.0005) [2023-12-27 21:48:24,318][106226] Updated weights for policy 0, policy_version 358721 (0.0008) [2023-12-27 21:48:24,520][106225] Updated weights for policy 1, policy_version 359378 (0.0008) [2023-12-27 21:48:24,569][106225] Updated weights for policy 1, policy_version 359388 (0.0005) [2023-12-27 21:48:24,614][106225] Updated weights for policy 1, policy_version 359398 (0.0005) [2023-12-27 21:48:24,666][106225] Updated weights for policy 1, policy_version 359408 (0.0008) [2023-12-27 21:48:25,066][106226] Updated weights for policy 0, policy_version 358731 (0.0010) [2023-12-27 21:48:25,128][106226] Updated weights for policy 0, policy_version 358741 (0.0009) [2023-12-27 21:48:25,180][106226] Updated weights for policy 0, policy_version 358751 (0.0008) [2023-12-27 21:48:25,255][106225] Updated weights for policy 1, policy_version 359418 (0.0006) [2023-12-27 21:48:25,303][106225] Updated weights for policy 1, policy_version 359428 (0.0008) [2023-12-27 21:48:25,352][106225] Updated weights for policy 1, policy_version 359438 (0.0008) [2023-12-27 21:48:25,919][106226] Updated weights for policy 0, policy_version 358761 (0.0008) [2023-12-27 21:48:25,978][106226] Updated weights for policy 0, policy_version 358771 (0.0005) [2023-12-27 21:48:26,040][106226] Updated weights for policy 0, policy_version 358781 (0.0005) [2023-12-27 21:48:26,092][106225] Updated weights for policy 1, policy_version 359448 (0.0007) [2023-12-27 21:48:26,106][106226] Updated weights for policy 0, policy_version 358791 (0.0005) [2023-12-27 21:48:26,160][106225] Updated weights for policy 1, policy_version 359458 (0.0006) [2023-12-27 21:48:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 183926784. Throughput: 0: 9764.5, 1: 10023.8. Samples: 183896992. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:26,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-5.893')] [2023-12-27 21:48:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000358792_91881472.pth... [2023-12-27 21:48:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000357640_91586560.pth [2023-12-27 21:48:26,221][106225] Updated weights for policy 1, policy_version 359468 (0.0007) [2023-12-27 21:48:26,245][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000359472_92053504.pth... [2023-12-27 21:48:26,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000358288_91750400.pth [2023-12-27 21:48:26,610][106226] Updated weights for policy 0, policy_version 358801 (0.0005) [2023-12-27 21:48:26,655][106226] Updated weights for policy 0, policy_version 358811 (0.0005) [2023-12-27 21:48:26,710][106226] Updated weights for policy 0, policy_version 358821 (0.0005) [2023-12-27 21:48:26,824][106225] Updated weights for policy 1, policy_version 359478 (0.0007) [2023-12-27 21:48:26,878][106225] Updated weights for policy 1, policy_version 359488 (0.0006) [2023-12-27 21:48:26,934][106225] Updated weights for policy 1, policy_version 359498 (0.0006) [2023-12-27 21:48:27,375][106226] Updated weights for policy 0, policy_version 358831 (0.0008) [2023-12-27 21:48:27,428][106226] Updated weights for policy 0, policy_version 358841 (0.0008) [2023-12-27 21:48:27,486][106226] Updated weights for policy 0, policy_version 358851 (0.0009) [2023-12-27 21:48:27,537][106225] Updated weights for policy 1, policy_version 359508 (0.0005) [2023-12-27 21:48:27,582][106225] Updated weights for policy 1, policy_version 359518 (0.0005) [2023-12-27 21:48:27,625][106225] Updated weights for policy 1, policy_version 359528 (0.0005) [2023-12-27 21:48:28,253][106226] Updated weights for policy 0, policy_version 358861 (0.0008) [2023-12-27 21:48:28,272][106225] Updated weights for policy 1, policy_version 359538 (0.0006) [2023-12-27 21:48:28,308][106226] Updated weights for policy 0, policy_version 358871 (0.0007) [2023-12-27 21:48:28,331][106225] Updated weights for policy 1, policy_version 359548 (0.0010) [2023-12-27 21:48:28,366][106226] Updated weights for policy 0, policy_version 358881 (0.0007) [2023-12-27 21:48:28,393][106225] Updated weights for policy 1, policy_version 359558 (0.0010) [2023-12-27 21:48:28,453][106225] Updated weights for policy 1, policy_version 359568 (0.0010) [2023-12-27 21:48:28,982][106226] Updated weights for policy 0, policy_version 358891 (0.0009) [2023-12-27 21:48:29,047][106226] Updated weights for policy 0, policy_version 358901 (0.0008) [2023-12-27 21:48:29,111][106226] Updated weights for policy 0, policy_version 358911 (0.0006) [2023-12-27 21:48:29,216][106225] Updated weights for policy 1, policy_version 359578 (0.0008) [2023-12-27 21:48:29,282][106225] Updated weights for policy 1, policy_version 359588 (0.0010) [2023-12-27 21:48:29,351][106225] Updated weights for policy 1, policy_version 359598 (0.0007) [2023-12-27 21:48:29,706][106226] Updated weights for policy 0, policy_version 358921 (0.0007) [2023-12-27 21:48:29,769][106226] Updated weights for policy 0, policy_version 358931 (0.0011) [2023-12-27 21:48:29,823][106226] Updated weights for policy 0, policy_version 358941 (0.0010) [2023-12-27 21:48:29,886][106226] Updated weights for policy 0, policy_version 358951 (0.0011) [2023-12-27 21:48:30,024][106225] Updated weights for policy 1, policy_version 359608 (0.0008) [2023-12-27 21:48:30,091][106225] Updated weights for policy 1, policy_version 359618 (0.0009) [2023-12-27 21:48:30,151][106225] Updated weights for policy 1, policy_version 359628 (0.0007) [2023-12-27 21:48:30,594][106226] Updated weights for policy 0, policy_version 358961 (0.0006) [2023-12-27 21:48:30,650][106226] Updated weights for policy 0, policy_version 358971 (0.0005) [2023-12-27 21:48:30,702][106226] Updated weights for policy 0, policy_version 358981 (0.0005) [2023-12-27 21:48:30,743][106225] Updated weights for policy 1, policy_version 359638 (0.0005) [2023-12-27 21:48:30,809][106225] Updated weights for policy 1, policy_version 359648 (0.0006) [2023-12-27 21:48:30,866][106225] Updated weights for policy 1, policy_version 359658 (0.0005) [2023-12-27 21:48:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 184033280. Throughput: 0: 9876.4, 1: 10123.3. Samples: 184021856. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:31,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-5.607')] [2023-12-27 21:48:31,348][106226] Updated weights for policy 0, policy_version 358991 (0.0006) [2023-12-27 21:48:31,423][106226] Updated weights for policy 0, policy_version 359001 (0.0008) [2023-12-27 21:48:31,490][106226] Updated weights for policy 0, policy_version 359011 (0.0008) [2023-12-27 21:48:31,545][106225] Updated weights for policy 1, policy_version 359668 (0.0008) [2023-12-27 21:48:31,613][106225] Updated weights for policy 1, policy_version 359678 (0.0006) [2023-12-27 21:48:31,680][106225] Updated weights for policy 1, policy_version 359688 (0.0009) [2023-12-27 21:48:32,290][106225] Updated weights for policy 1, policy_version 359698 (0.0009) [2023-12-27 21:48:32,315][106226] Updated weights for policy 0, policy_version 359021 (0.0007) [2023-12-27 21:48:32,345][106225] Updated weights for policy 1, policy_version 359708 (0.0010) [2023-12-27 21:48:32,371][106226] Updated weights for policy 0, policy_version 359031 (0.0006) [2023-12-27 21:48:32,408][106225] Updated weights for policy 1, policy_version 359718 (0.0009) [2023-12-27 21:48:32,439][106226] Updated weights for policy 0, policy_version 359041 (0.0008) [2023-12-27 21:48:32,476][106225] Updated weights for policy 1, policy_version 359728 (0.0007) [2023-12-27 21:48:33,059][106226] Updated weights for policy 0, policy_version 359051 (0.0010) [2023-12-27 21:48:33,121][106226] Updated weights for policy 0, policy_version 359061 (0.0010) [2023-12-27 21:48:33,183][106226] Updated weights for policy 0, policy_version 359071 (0.0010) [2023-12-27 21:48:33,197][106225] Updated weights for policy 1, policy_version 359738 (0.0007) [2023-12-27 21:48:33,247][106225] Updated weights for policy 1, policy_version 359748 (0.0006) [2023-12-27 21:48:33,296][106225] Updated weights for policy 1, policy_version 359758 (0.0007) [2023-12-27 21:48:33,820][106226] Updated weights for policy 0, policy_version 359081 (0.0010) [2023-12-27 21:48:33,887][106226] Updated weights for policy 0, policy_version 359091 (0.0009) [2023-12-27 21:48:33,939][106226] Updated weights for policy 0, policy_version 359101 (0.0008) [2023-12-27 21:48:34,005][106226] Updated weights for policy 0, policy_version 359111 (0.0008) [2023-12-27 21:48:34,032][106225] Updated weights for policy 1, policy_version 359768 (0.0009) [2023-12-27 21:48:34,086][106225] Updated weights for policy 1, policy_version 359778 (0.0008) [2023-12-27 21:48:34,147][106225] Updated weights for policy 1, policy_version 359788 (0.0008) [2023-12-27 21:48:34,708][106226] Updated weights for policy 0, policy_version 359121 (0.0011) [2023-12-27 21:48:34,773][106226] Updated weights for policy 0, policy_version 359131 (0.0011) [2023-12-27 21:48:34,836][106226] Updated weights for policy 0, policy_version 359141 (0.0007) [2023-12-27 21:48:34,928][106225] Updated weights for policy 1, policy_version 359798 (0.0007) [2023-12-27 21:48:34,985][106225] Updated weights for policy 1, policy_version 359808 (0.0005) [2023-12-27 21:48:35,050][106225] Updated weights for policy 1, policy_version 359818 (0.0005) [2023-12-27 21:48:35,444][106226] Updated weights for policy 0, policy_version 359151 (0.0009) [2023-12-27 21:48:35,493][106226] Updated weights for policy 0, policy_version 359161 (0.0010) [2023-12-27 21:48:35,541][106226] Updated weights for policy 0, policy_version 359171 (0.0005) [2023-12-27 21:48:35,576][106225] Updated weights for policy 1, policy_version 359828 (0.0005) [2023-12-27 21:48:35,635][106225] Updated weights for policy 1, policy_version 359838 (0.0010) [2023-12-27 21:48:35,696][106225] Updated weights for policy 1, policy_version 359848 (0.0007) [2023-12-27 21:48:36,170][106226] Updated weights for policy 0, policy_version 359181 (0.0006) [2023-12-27 21:48:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 184131584. Throughput: 0: 10010.0, 1: 10041.0. Samples: 184144540. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:36,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.714')] [2023-12-27 21:48:36,232][106226] Updated weights for policy 0, policy_version 359191 (0.0008) [2023-12-27 21:48:36,290][106226] Updated weights for policy 0, policy_version 359201 (0.0009) [2023-12-27 21:48:36,368][106225] Updated weights for policy 1, policy_version 359858 (0.0006) [2023-12-27 21:48:36,421][106225] Updated weights for policy 1, policy_version 359868 (0.0010) [2023-12-27 21:48:36,476][106225] Updated weights for policy 1, policy_version 359878 (0.0010) [2023-12-27 21:48:36,527][106225] Updated weights for policy 1, policy_version 359888 (0.0010) [2023-12-27 21:48:37,028][106226] Updated weights for policy 0, policy_version 359211 (0.0008) [2023-12-27 21:48:37,083][106226] Updated weights for policy 0, policy_version 359221 (0.0008) [2023-12-27 21:48:37,148][106226] Updated weights for policy 0, policy_version 359231 (0.0009) [2023-12-27 21:48:37,275][106225] Updated weights for policy 1, policy_version 359898 (0.0008) [2023-12-27 21:48:37,349][106225] Updated weights for policy 1, policy_version 359908 (0.0007) [2023-12-27 21:48:37,409][106225] Updated weights for policy 1, policy_version 359918 (0.0009) [2023-12-27 21:48:37,889][106226] Updated weights for policy 0, policy_version 359241 (0.0009) [2023-12-27 21:48:37,947][106226] Updated weights for policy 0, policy_version 359251 (0.0009) [2023-12-27 21:48:38,006][106226] Updated weights for policy 0, policy_version 359261 (0.0007) [2023-12-27 21:48:38,064][106226] Updated weights for policy 0, policy_version 359271 (0.0005) [2023-12-27 21:48:38,068][106225] Updated weights for policy 1, policy_version 359928 (0.0008) [2023-12-27 21:48:38,121][106225] Updated weights for policy 1, policy_version 359938 (0.0006) [2023-12-27 21:48:38,171][106225] Updated weights for policy 1, policy_version 359948 (0.0008) [2023-12-27 21:48:38,719][106226] Updated weights for policy 0, policy_version 359281 (0.0007) [2023-12-27 21:48:38,784][106226] Updated weights for policy 0, policy_version 359291 (0.0009) [2023-12-27 21:48:38,846][106225] Updated weights for policy 1, policy_version 359958 (0.0008) [2023-12-27 21:48:38,849][106226] Updated weights for policy 0, policy_version 359301 (0.0007) [2023-12-27 21:48:38,907][106225] Updated weights for policy 1, policy_version 359968 (0.0007) [2023-12-27 21:48:38,969][106225] Updated weights for policy 1, policy_version 359978 (0.0008) [2023-12-27 21:48:39,570][106226] Updated weights for policy 0, policy_version 359311 (0.0009) [2023-12-27 21:48:39,626][106226] Updated weights for policy 0, policy_version 359321 (0.0008) [2023-12-27 21:48:39,687][106226] Updated weights for policy 0, policy_version 359331 (0.0009) [2023-12-27 21:48:39,724][106225] Updated weights for policy 1, policy_version 359988 (0.0008) [2023-12-27 21:48:39,791][106225] Updated weights for policy 1, policy_version 359998 (0.0009) [2023-12-27 21:48:39,852][106225] Updated weights for policy 1, policy_version 360008 (0.0008) [2023-12-27 21:48:40,482][106226] Updated weights for policy 0, policy_version 359341 (0.0009) [2023-12-27 21:48:40,533][106226] Updated weights for policy 0, policy_version 359351 (0.0008) [2023-12-27 21:48:40,586][106226] Updated weights for policy 0, policy_version 359361 (0.0008) [2023-12-27 21:48:40,616][106225] Updated weights for policy 1, policy_version 360018 (0.0006) [2023-12-27 21:48:40,667][106225] Updated weights for policy 1, policy_version 360028 (0.0010) [2023-12-27 21:48:40,714][106225] Updated weights for policy 1, policy_version 360038 (0.0010) [2023-12-27 21:48:40,761][106225] Updated weights for policy 1, policy_version 360048 (0.0009) [2023-12-27 21:48:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 184229888. Throughput: 0: 10001.1, 1: 10089.7. Samples: 184203912. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:41,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.920')] [2023-12-27 21:48:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000359368_92028928.pth... [2023-12-27 21:48:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000360048_92200960.pth... [2023-12-27 21:48:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000358248_91742208.pth [2023-12-27 21:48:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000358864_91897856.pth [2023-12-27 21:48:41,323][106226] Updated weights for policy 0, policy_version 359371 (0.0007) [2023-12-27 21:48:41,394][106226] Updated weights for policy 0, policy_version 359381 (0.0008) [2023-12-27 21:48:41,457][106226] Updated weights for policy 0, policy_version 359391 (0.0007) [2023-12-27 21:48:41,584][106225] Updated weights for policy 1, policy_version 360058 (0.0010) [2023-12-27 21:48:41,650][106225] Updated weights for policy 1, policy_version 360068 (0.0009) [2023-12-27 21:48:41,703][106225] Updated weights for policy 1, policy_version 360078 (0.0008) [2023-12-27 21:48:42,203][106226] Updated weights for policy 0, policy_version 359401 (0.0007) [2023-12-27 21:48:42,272][106226] Updated weights for policy 0, policy_version 359411 (0.0009) [2023-12-27 21:48:42,333][106226] Updated weights for policy 0, policy_version 359421 (0.0008) [2023-12-27 21:48:42,405][106226] Updated weights for policy 0, policy_version 359431 (0.0009) [2023-12-27 21:48:42,426][106225] Updated weights for policy 1, policy_version 360088 (0.0007) [2023-12-27 21:48:42,491][106225] Updated weights for policy 1, policy_version 360098 (0.0007) [2023-12-27 21:48:42,554][106225] Updated weights for policy 1, policy_version 360108 (0.0009) [2023-12-27 21:48:43,099][106226] Updated weights for policy 0, policy_version 359441 (0.0010) [2023-12-27 21:48:43,154][106226] Updated weights for policy 0, policy_version 359451 (0.0009) [2023-12-27 21:48:43,206][106226] Updated weights for policy 0, policy_version 359461 (0.0005) [2023-12-27 21:48:43,271][106225] Updated weights for policy 1, policy_version 360118 (0.0007) [2023-12-27 21:48:43,333][106225] Updated weights for policy 1, policy_version 360128 (0.0007) [2023-12-27 21:48:43,392][106225] Updated weights for policy 1, policy_version 360138 (0.0008) [2023-12-27 21:48:43,917][106226] Updated weights for policy 0, policy_version 359471 (0.0007) [2023-12-27 21:48:43,976][106226] Updated weights for policy 0, policy_version 359481 (0.0009) [2023-12-27 21:48:44,036][106226] Updated weights for policy 0, policy_version 359491 (0.0010) [2023-12-27 21:48:44,144][106225] Updated weights for policy 1, policy_version 360148 (0.0008) [2023-12-27 21:48:44,190][106225] Updated weights for policy 1, policy_version 360158 (0.0007) [2023-12-27 21:48:44,235][106225] Updated weights for policy 1, policy_version 360168 (0.0007) [2023-12-27 21:48:44,650][106226] Updated weights for policy 0, policy_version 359501 (0.0010) [2023-12-27 21:48:44,697][106226] Updated weights for policy 0, policy_version 359511 (0.0010) [2023-12-27 21:48:44,747][106226] Updated weights for policy 0, policy_version 359521 (0.0010) [2023-12-27 21:48:44,963][106225] Updated weights for policy 1, policy_version 360178 (0.0007) [2023-12-27 21:48:45,027][106225] Updated weights for policy 1, policy_version 360188 (0.0006) [2023-12-27 21:48:45,094][106225] Updated weights for policy 1, policy_version 360198 (0.0006) [2023-12-27 21:48:45,154][106225] Updated weights for policy 1, policy_version 360208 (0.0007) [2023-12-27 21:48:45,521][106226] Updated weights for policy 0, policy_version 359531 (0.0011) [2023-12-27 21:48:45,590][106226] Updated weights for policy 0, policy_version 359541 (0.0010) [2023-12-27 21:48:45,649][106226] Updated weights for policy 0, policy_version 359551 (0.0010) [2023-12-27 21:48:45,735][106225] Updated weights for policy 1, policy_version 360218 (0.0007) [2023-12-27 21:48:45,792][106225] Updated weights for policy 1, policy_version 360228 (0.0007) [2023-12-27 21:48:45,856][106225] Updated weights for policy 1, policy_version 360238 (0.0008) [2023-12-27 21:48:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 184328192. Throughput: 0: 9857.9, 1: 10038.5. Samples: 184317296. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:46,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.777')] [2023-12-27 21:48:46,336][106226] Updated weights for policy 0, policy_version 359561 (0.0010) [2023-12-27 21:48:46,389][106226] Updated weights for policy 0, policy_version 359571 (0.0010) [2023-12-27 21:48:46,441][106226] Updated weights for policy 0, policy_version 359581 (0.0010) [2023-12-27 21:48:46,490][106226] Updated weights for policy 0, policy_version 359591 (0.0005) [2023-12-27 21:48:46,523][106225] Updated weights for policy 1, policy_version 360248 (0.0006) [2023-12-27 21:48:46,578][106225] Updated weights for policy 1, policy_version 360258 (0.0005) [2023-12-27 21:48:46,641][106225] Updated weights for policy 1, policy_version 360268 (0.0007) [2023-12-27 21:48:47,091][106226] Updated weights for policy 0, policy_version 359601 (0.0005) [2023-12-27 21:48:47,157][106226] Updated weights for policy 0, policy_version 359611 (0.0006) [2023-12-27 21:48:47,222][106226] Updated weights for policy 0, policy_version 359621 (0.0007) [2023-12-27 21:48:47,326][106225] Updated weights for policy 1, policy_version 360278 (0.0007) [2023-12-27 21:48:47,388][106225] Updated weights for policy 1, policy_version 360288 (0.0007) [2023-12-27 21:48:47,447][106225] Updated weights for policy 1, policy_version 360298 (0.0009) [2023-12-27 21:48:47,897][106226] Updated weights for policy 0, policy_version 359631 (0.0008) [2023-12-27 21:48:47,950][106226] Updated weights for policy 0, policy_version 359641 (0.0009) [2023-12-27 21:48:48,003][106226] Updated weights for policy 0, policy_version 359651 (0.0009) [2023-12-27 21:48:48,042][106225] Updated weights for policy 1, policy_version 360308 (0.0007) [2023-12-27 21:48:48,107][106225] Updated weights for policy 1, policy_version 360318 (0.0005) [2023-12-27 21:48:48,170][106225] Updated weights for policy 1, policy_version 360328 (0.0009) [2023-12-27 21:48:48,773][106226] Updated weights for policy 0, policy_version 359661 (0.0008) [2023-12-27 21:48:48,821][106225] Updated weights for policy 1, policy_version 360338 (0.0007) [2023-12-27 21:48:48,823][106226] Updated weights for policy 0, policy_version 359671 (0.0008) [2023-12-27 21:48:48,879][106225] Updated weights for policy 1, policy_version 360348 (0.0006) [2023-12-27 21:48:48,884][106226] Updated weights for policy 0, policy_version 359681 (0.0009) [2023-12-27 21:48:48,931][106225] Updated weights for policy 1, policy_version 360358 (0.0007) [2023-12-27 21:48:48,978][106225] Updated weights for policy 1, policy_version 360368 (0.0010) [2023-12-27 21:48:49,606][106226] Updated weights for policy 0, policy_version 359691 (0.0008) [2023-12-27 21:48:49,668][106226] Updated weights for policy 0, policy_version 359701 (0.0006) [2023-12-27 21:48:49,729][106226] Updated weights for policy 0, policy_version 359711 (0.0005) [2023-12-27 21:48:49,757][106225] Updated weights for policy 1, policy_version 360378 (0.0011) [2023-12-27 21:48:49,825][106225] Updated weights for policy 1, policy_version 360388 (0.0010) [2023-12-27 21:48:49,890][106225] Updated weights for policy 1, policy_version 360398 (0.0007) [2023-12-27 21:48:50,435][106226] Updated weights for policy 0, policy_version 359721 (0.0006) [2023-12-27 21:48:50,495][106226] Updated weights for policy 0, policy_version 359731 (0.0006) [2023-12-27 21:48:50,501][106225] Updated weights for policy 1, policy_version 360408 (0.0006) [2023-12-27 21:48:50,558][106226] Updated weights for policy 0, policy_version 359741 (0.0006) [2023-12-27 21:48:50,563][106225] Updated weights for policy 1, policy_version 360418 (0.0006) [2023-12-27 21:48:50,624][106225] Updated weights for policy 1, policy_version 360428 (0.0007) [2023-12-27 21:48:50,634][106226] Updated weights for policy 0, policy_version 359751 (0.0009) [2023-12-27 21:48:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 184426496. Throughput: 0: 9770.9, 1: 10116.3. Samples: 184438036. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:51,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.673')] [2023-12-27 21:48:51,292][106225] Updated weights for policy 1, policy_version 360438 (0.0006) [2023-12-27 21:48:51,360][106225] Updated weights for policy 1, policy_version 360448 (0.0006) [2023-12-27 21:48:51,380][106226] Updated weights for policy 0, policy_version 359761 (0.0008) [2023-12-27 21:48:51,428][106225] Updated weights for policy 1, policy_version 360458 (0.0006) [2023-12-27 21:48:51,437][106226] Updated weights for policy 0, policy_version 359771 (0.0007) [2023-12-27 21:48:51,490][106226] Updated weights for policy 0, policy_version 359781 (0.0008) [2023-12-27 21:48:52,125][106225] Updated weights for policy 1, policy_version 360468 (0.0007) [2023-12-27 21:48:52,180][106225] Updated weights for policy 1, policy_version 360478 (0.0008) [2023-12-27 21:48:52,238][106226] Updated weights for policy 0, policy_version 359791 (0.0007) [2023-12-27 21:48:52,239][106225] Updated weights for policy 1, policy_version 360488 (0.0007) [2023-12-27 21:48:52,303][106226] Updated weights for policy 0, policy_version 359801 (0.0008) [2023-12-27 21:48:52,356][106226] Updated weights for policy 0, policy_version 359811 (0.0006) [2023-12-27 21:48:53,043][106225] Updated weights for policy 1, policy_version 360498 (0.0009) [2023-12-27 21:48:53,068][106226] Updated weights for policy 0, policy_version 359821 (0.0008) [2023-12-27 21:48:53,090][106225] Updated weights for policy 1, policy_version 360508 (0.0006) [2023-12-27 21:48:53,120][106226] Updated weights for policy 0, policy_version 359831 (0.0007) [2023-12-27 21:48:53,153][106225] Updated weights for policy 1, policy_version 360518 (0.0007) [2023-12-27 21:48:53,175][106226] Updated weights for policy 0, policy_version 359841 (0.0006) [2023-12-27 21:48:53,207][106225] Updated weights for policy 1, policy_version 360528 (0.0010) [2023-12-27 21:48:53,896][106225] Updated weights for policy 1, policy_version 360538 (0.0007) [2023-12-27 21:48:53,930][106226] Updated weights for policy 0, policy_version 359851 (0.0007) [2023-12-27 21:48:53,947][106225] Updated weights for policy 1, policy_version 360548 (0.0007) [2023-12-27 21:48:53,992][106226] Updated weights for policy 0, policy_version 359861 (0.0006) [2023-12-27 21:48:53,998][106225] Updated weights for policy 1, policy_version 360558 (0.0005) [2023-12-27 21:48:54,051][106226] Updated weights for policy 0, policy_version 359871 (0.0006) [2023-12-27 21:48:54,649][106225] Updated weights for policy 1, policy_version 360568 (0.0006) [2023-12-27 21:48:54,713][106225] Updated weights for policy 1, policy_version 360578 (0.0008) [2023-12-27 21:48:54,770][106225] Updated weights for policy 1, policy_version 360588 (0.0009) [2023-12-27 21:48:54,808][106226] Updated weights for policy 0, policy_version 359881 (0.0007) [2023-12-27 21:48:54,873][106226] Updated weights for policy 0, policy_version 359891 (0.0009) [2023-12-27 21:48:54,922][106226] Updated weights for policy 0, policy_version 359901 (0.0009) [2023-12-27 21:48:54,977][106226] Updated weights for policy 0, policy_version 359911 (0.0009) [2023-12-27 21:48:55,389][106225] Updated weights for policy 1, policy_version 360598 (0.0008) [2023-12-27 21:48:55,446][106225] Updated weights for policy 1, policy_version 360608 (0.0008) [2023-12-27 21:48:55,503][106225] Updated weights for policy 1, policy_version 360618 (0.0008) [2023-12-27 21:48:55,705][106226] Updated weights for policy 0, policy_version 359921 (0.0006) [2023-12-27 21:48:55,755][106226] Updated weights for policy 0, policy_version 359931 (0.0009) [2023-12-27 21:48:55,805][106226] Updated weights for policy 0, policy_version 359941 (0.0010) [2023-12-27 21:48:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 184524800. Throughput: 0: 9751.5, 1: 10096.9. Samples: 184495616. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:48:56,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.537')] [2023-12-27 21:48:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000359944_92176384.pth... [2023-12-27 21:48:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000358792_91881472.pth [2023-12-27 21:48:56,189][106225] Updated weights for policy 1, policy_version 360628 (0.0008) [2023-12-27 21:48:56,243][106225] Updated weights for policy 1, policy_version 360638 (0.0008) [2023-12-27 21:48:56,297][106225] Updated weights for policy 1, policy_version 360648 (0.0008) [2023-12-27 21:48:56,333][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000360656_92356608.pth... [2023-12-27 21:48:56,337][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000359472_92053504.pth [2023-12-27 21:48:56,482][106226] Updated weights for policy 0, policy_version 359951 (0.0008) [2023-12-27 21:48:56,538][106226] Updated weights for policy 0, policy_version 359961 (0.0010) [2023-12-27 21:48:56,591][106226] Updated weights for policy 0, policy_version 359971 (0.0010) [2023-12-27 21:48:56,948][106225] Updated weights for policy 1, policy_version 360658 (0.0008) [2023-12-27 21:48:56,998][106225] Updated weights for policy 1, policy_version 360668 (0.0008) [2023-12-27 21:48:57,045][106225] Updated weights for policy 1, policy_version 360678 (0.0009) [2023-12-27 21:48:57,108][106225] Updated weights for policy 1, policy_version 360688 (0.0009) [2023-12-27 21:48:57,201][106226] Updated weights for policy 0, policy_version 359981 (0.0008) [2023-12-27 21:48:57,256][106226] Updated weights for policy 0, policy_version 359991 (0.0005) [2023-12-27 21:48:57,312][106226] Updated weights for policy 0, policy_version 360001 (0.0007) [2023-12-27 21:48:57,875][106225] Updated weights for policy 1, policy_version 360698 (0.0010) [2023-12-27 21:48:57,926][106225] Updated weights for policy 1, policy_version 360708 (0.0010) [2023-12-27 21:48:57,958][106226] Updated weights for policy 0, policy_version 360011 (0.0009) [2023-12-27 21:48:57,980][106225] Updated weights for policy 1, policy_version 360718 (0.0010) [2023-12-27 21:48:58,019][106226] Updated weights for policy 0, policy_version 360021 (0.0006) [2023-12-27 21:48:58,071][106226] Updated weights for policy 0, policy_version 360031 (0.0008) [2023-12-27 21:48:58,763][106225] Updated weights for policy 1, policy_version 360728 (0.0008) [2023-12-27 21:48:58,831][106225] Updated weights for policy 1, policy_version 360738 (0.0007) [2023-12-27 21:48:58,898][106225] Updated weights for policy 1, policy_version 360748 (0.0007) [2023-12-27 21:48:58,963][106226] Updated weights for policy 0, policy_version 360041 (0.0007) [2023-12-27 21:48:59,024][106226] Updated weights for policy 0, policy_version 360051 (0.0011) [2023-12-27 21:48:59,084][106226] Updated weights for policy 0, policy_version 360061 (0.0011) [2023-12-27 21:48:59,146][106226] Updated weights for policy 0, policy_version 360071 (0.0009) [2023-12-27 21:48:59,630][106225] Updated weights for policy 1, policy_version 360758 (0.0006) [2023-12-27 21:48:59,688][106225] Updated weights for policy 1, policy_version 360768 (0.0008) [2023-12-27 21:48:59,752][106225] Updated weights for policy 1, policy_version 360778 (0.0010) [2023-12-27 21:48:59,819][106226] Updated weights for policy 0, policy_version 360081 (0.0010) [2023-12-27 21:48:59,885][106226] Updated weights for policy 0, policy_version 360091 (0.0009) [2023-12-27 21:48:59,953][106226] Updated weights for policy 0, policy_version 360101 (0.0009) [2023-12-27 21:49:00,490][106225] Updated weights for policy 1, policy_version 360788 (0.0009) [2023-12-27 21:49:00,551][106225] Updated weights for policy 1, policy_version 360798 (0.0007) [2023-12-27 21:49:00,601][106225] Updated weights for policy 1, policy_version 360808 (0.0008) [2023-12-27 21:49:00,650][106226] Updated weights for policy 0, policy_version 360111 (0.0007) [2023-12-27 21:49:00,707][106226] Updated weights for policy 0, policy_version 360121 (0.0008) [2023-12-27 21:49:00,760][106226] Updated weights for policy 0, policy_version 360131 (0.0009) [2023-12-27 21:49:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 184623104. Throughput: 0: 9803.7, 1: 10049.0. Samples: 184614340. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:01,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.503')] [2023-12-27 21:49:01,387][106225] Updated weights for policy 1, policy_version 360818 (0.0009) [2023-12-27 21:49:01,446][106225] Updated weights for policy 1, policy_version 360828 (0.0006) [2023-12-27 21:49:01,505][106225] Updated weights for policy 1, policy_version 360838 (0.0006) [2023-12-27 21:49:01,524][106226] Updated weights for policy 0, policy_version 360141 (0.0009) [2023-12-27 21:49:01,565][106225] Updated weights for policy 1, policy_version 360848 (0.0008) [2023-12-27 21:49:01,592][106226] Updated weights for policy 0, policy_version 360151 (0.0008) [2023-12-27 21:49:01,658][106226] Updated weights for policy 0, policy_version 360161 (0.0008) [2023-12-27 21:49:02,320][106225] Updated weights for policy 1, policy_version 360858 (0.0008) [2023-12-27 21:49:02,322][106226] Updated weights for policy 0, policy_version 360171 (0.0007) [2023-12-27 21:49:02,382][106225] Updated weights for policy 1, policy_version 360868 (0.0007) [2023-12-27 21:49:02,386][106226] Updated weights for policy 0, policy_version 360181 (0.0007) [2023-12-27 21:49:02,448][106225] Updated weights for policy 1, policy_version 360878 (0.0008) [2023-12-27 21:49:02,449][106226] Updated weights for policy 0, policy_version 360191 (0.0006) [2023-12-27 21:49:03,068][106226] Updated weights for policy 0, policy_version 360201 (0.0007) [2023-12-27 21:49:03,121][106226] Updated weights for policy 0, policy_version 360211 (0.0007) [2023-12-27 21:49:03,173][106226] Updated weights for policy 0, policy_version 360221 (0.0008) [2023-12-27 21:49:03,194][106225] Updated weights for policy 1, policy_version 360888 (0.0006) [2023-12-27 21:49:03,230][106226] Updated weights for policy 0, policy_version 360231 (0.0008) [2023-12-27 21:49:03,262][106225] Updated weights for policy 1, policy_version 360898 (0.0006) [2023-12-27 21:49:03,330][106225] Updated weights for policy 1, policy_version 360908 (0.0005) [2023-12-27 21:49:03,955][106225] Updated weights for policy 1, policy_version 360918 (0.0007) [2023-12-27 21:49:03,998][106226] Updated weights for policy 0, policy_version 360241 (0.0006) [2023-12-27 21:49:04,016][106225] Updated weights for policy 1, policy_version 360928 (0.0007) [2023-12-27 21:49:04,058][106226] Updated weights for policy 0, policy_version 360251 (0.0007) [2023-12-27 21:49:04,080][106225] Updated weights for policy 1, policy_version 360938 (0.0006) [2023-12-27 21:49:04,121][106226] Updated weights for policy 0, policy_version 360261 (0.0007) [2023-12-27 21:49:04,801][106226] Updated weights for policy 0, policy_version 360271 (0.0006) [2023-12-27 21:49:04,847][106226] Updated weights for policy 0, policy_version 360281 (0.0006) [2023-12-27 21:49:04,857][106225] Updated weights for policy 1, policy_version 360948 (0.0006) [2023-12-27 21:49:04,894][106226] Updated weights for policy 0, policy_version 360291 (0.0007) [2023-12-27 21:49:04,904][106225] Updated weights for policy 1, policy_version 360958 (0.0006) [2023-12-27 21:49:04,956][106225] Updated weights for policy 1, policy_version 360968 (0.0007) [2023-12-27 21:49:05,545][106226] Updated weights for policy 0, policy_version 360301 (0.0006) [2023-12-27 21:49:05,610][106226] Updated weights for policy 0, policy_version 360311 (0.0008) [2023-12-27 21:49:05,612][106225] Updated weights for policy 1, policy_version 360978 (0.0005) [2023-12-27 21:49:05,661][106226] Updated weights for policy 0, policy_version 360321 (0.0006) [2023-12-27 21:49:05,670][106225] Updated weights for policy 1, policy_version 360988 (0.0007) [2023-12-27 21:49:05,729][106225] Updated weights for policy 1, policy_version 360998 (0.0009) [2023-12-27 21:49:05,781][106225] Updated weights for policy 1, policy_version 361008 (0.0008) [2023-12-27 21:49:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 184721408. Throughput: 0: 9886.5, 1: 9985.5. Samples: 184731364. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:06,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-5.607')] [2023-12-27 21:49:06,369][106226] Updated weights for policy 0, policy_version 360331 (0.0007) [2023-12-27 21:49:06,429][106226] Updated weights for policy 0, policy_version 360341 (0.0009) [2023-12-27 21:49:06,490][106226] Updated weights for policy 0, policy_version 360351 (0.0007) [2023-12-27 21:49:06,556][106225] Updated weights for policy 1, policy_version 361018 (0.0009) [2023-12-27 21:49:06,623][106225] Updated weights for policy 1, policy_version 361028 (0.0009) [2023-12-27 21:49:06,689][106225] Updated weights for policy 1, policy_version 361038 (0.0008) [2023-12-27 21:49:07,277][106225] Updated weights for policy 1, policy_version 361048 (0.0006) [2023-12-27 21:49:07,279][106226] Updated weights for policy 0, policy_version 360361 (0.0007) [2023-12-27 21:49:07,341][106226] Updated weights for policy 0, policy_version 360371 (0.0008) [2023-12-27 21:49:07,345][106225] Updated weights for policy 1, policy_version 361058 (0.0005) [2023-12-27 21:49:07,400][106226] Updated weights for policy 0, policy_version 360381 (0.0009) [2023-12-27 21:49:07,416][106225] Updated weights for policy 1, policy_version 361068 (0.0007) [2023-12-27 21:49:07,456][106226] Updated weights for policy 0, policy_version 360391 (0.0010) [2023-12-27 21:49:08,049][106225] Updated weights for policy 1, policy_version 361078 (0.0010) [2023-12-27 21:49:08,100][106225] Updated weights for policy 1, policy_version 361088 (0.0010) [2023-12-27 21:49:08,150][106225] Updated weights for policy 1, policy_version 361098 (0.0010) [2023-12-27 21:49:08,152][106226] Updated weights for policy 0, policy_version 360401 (0.0005) [2023-12-27 21:49:08,216][106226] Updated weights for policy 0, policy_version 360411 (0.0005) [2023-12-27 21:49:08,282][106226] Updated weights for policy 0, policy_version 360421 (0.0006) [2023-12-27 21:49:08,889][106225] Updated weights for policy 1, policy_version 361108 (0.0010) [2023-12-27 21:49:08,921][106226] Updated weights for policy 0, policy_version 360431 (0.0008) [2023-12-27 21:49:08,941][106225] Updated weights for policy 1, policy_version 361118 (0.0005) [2023-12-27 21:49:08,980][106226] Updated weights for policy 0, policy_version 360441 (0.0008) [2023-12-27 21:49:08,993][106225] Updated weights for policy 1, policy_version 361128 (0.0008) [2023-12-27 21:49:09,039][106226] Updated weights for policy 0, policy_version 360451 (0.0005) [2023-12-27 21:49:09,716][106226] Updated weights for policy 0, policy_version 360461 (0.0007) [2023-12-27 21:49:09,740][106225] Updated weights for policy 1, policy_version 361138 (0.0010) [2023-12-27 21:49:09,776][106226] Updated weights for policy 0, policy_version 360471 (0.0007) [2023-12-27 21:49:09,795][106225] Updated weights for policy 1, policy_version 361148 (0.0010) [2023-12-27 21:49:09,839][106226] Updated weights for policy 0, policy_version 360481 (0.0007) [2023-12-27 21:49:09,856][106225] Updated weights for policy 1, policy_version 361158 (0.0009) [2023-12-27 21:49:09,921][106225] Updated weights for policy 1, policy_version 361168 (0.0007) [2023-12-27 21:49:10,454][106226] Updated weights for policy 0, policy_version 360491 (0.0006) [2023-12-27 21:49:10,514][106226] Updated weights for policy 0, policy_version 360501 (0.0008) [2023-12-27 21:49:10,573][106226] Updated weights for policy 0, policy_version 360511 (0.0007) [2023-12-27 21:49:10,751][106225] Updated weights for policy 1, policy_version 361178 (0.0011) [2023-12-27 21:49:10,817][106225] Updated weights for policy 1, policy_version 361188 (0.0007) [2023-12-27 21:49:10,886][106225] Updated weights for policy 1, policy_version 361198 (0.0009) [2023-12-27 21:49:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 184819712. Throughput: 0: 9895.7, 1: 9971.4. Samples: 184791012. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:11,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-5.599')] [2023-12-27 21:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000361200_92495872.pth... [2023-12-27 21:49:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000360520_92323840.pth... [2023-12-27 21:49:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000359368_92028928.pth [2023-12-27 21:49:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000360048_92200960.pth [2023-12-27 21:49:11,301][106226] Updated weights for policy 0, policy_version 360521 (0.0007) [2023-12-27 21:49:11,372][106226] Updated weights for policy 0, policy_version 360531 (0.0011) [2023-12-27 21:49:11,448][106226] Updated weights for policy 0, policy_version 360541 (0.0010) [2023-12-27 21:49:11,512][106226] Updated weights for policy 0, policy_version 360551 (0.0011) [2023-12-27 21:49:11,653][106225] Updated weights for policy 1, policy_version 361208 (0.0009) [2023-12-27 21:49:11,718][106225] Updated weights for policy 1, policy_version 361218 (0.0008) [2023-12-27 21:49:11,784][106225] Updated weights for policy 1, policy_version 361228 (0.0008) [2023-12-27 21:49:12,290][106226] Updated weights for policy 0, policy_version 360561 (0.0007) [2023-12-27 21:49:12,355][106226] Updated weights for policy 0, policy_version 360571 (0.0008) [2023-12-27 21:49:12,426][106226] Updated weights for policy 0, policy_version 360581 (0.0006) [2023-12-27 21:49:12,476][106225] Updated weights for policy 1, policy_version 361238 (0.0008) [2023-12-27 21:49:12,531][106225] Updated weights for policy 1, policy_version 361248 (0.0008) [2023-12-27 21:49:12,585][106225] Updated weights for policy 1, policy_version 361258 (0.0008) [2023-12-27 21:49:13,118][106226] Updated weights for policy 0, policy_version 360591 (0.0009) [2023-12-27 21:49:13,169][106226] Updated weights for policy 0, policy_version 360601 (0.0008) [2023-12-27 21:49:13,218][106226] Updated weights for policy 0, policy_version 360611 (0.0009) [2023-12-27 21:49:13,237][106225] Updated weights for policy 1, policy_version 361268 (0.0007) [2023-12-27 21:49:13,294][106225] Updated weights for policy 1, policy_version 361278 (0.0010) [2023-12-27 21:49:13,343][106225] Updated weights for policy 1, policy_version 361288 (0.0010) [2023-12-27 21:49:14,000][106225] Updated weights for policy 1, policy_version 361298 (0.0010) [2023-12-27 21:49:14,014][106226] Updated weights for policy 0, policy_version 360621 (0.0008) [2023-12-27 21:49:14,059][106225] Updated weights for policy 1, policy_version 361308 (0.0010) [2023-12-27 21:49:14,076][106226] Updated weights for policy 0, policy_version 360631 (0.0006) [2023-12-27 21:49:14,119][106225] Updated weights for policy 1, policy_version 361318 (0.0010) [2023-12-27 21:49:14,133][106226] Updated weights for policy 0, policy_version 360641 (0.0006) [2023-12-27 21:49:14,179][106225] Updated weights for policy 1, policy_version 361328 (0.0010) [2023-12-27 21:49:14,795][106225] Updated weights for policy 1, policy_version 361338 (0.0010) [2023-12-27 21:49:14,859][106225] Updated weights for policy 1, policy_version 361348 (0.0010) [2023-12-27 21:49:14,872][106226] Updated weights for policy 0, policy_version 360651 (0.0006) [2023-12-27 21:49:14,920][106225] Updated weights for policy 1, policy_version 361358 (0.0011) [2023-12-27 21:49:14,926][106226] Updated weights for policy 0, policy_version 360661 (0.0008) [2023-12-27 21:49:14,981][106226] Updated weights for policy 0, policy_version 360671 (0.0008) [2023-12-27 21:49:15,684][106225] Updated weights for policy 1, policy_version 361368 (0.0010) [2023-12-27 21:49:15,693][106226] Updated weights for policy 0, policy_version 360681 (0.0006) [2023-12-27 21:49:15,747][106225] Updated weights for policy 1, policy_version 361378 (0.0010) [2023-12-27 21:49:15,750][106226] Updated weights for policy 0, policy_version 360691 (0.0005) [2023-12-27 21:49:15,813][106226] Updated weights for policy 0, policy_version 360701 (0.0006) [2023-12-27 21:49:15,813][106225] Updated weights for policy 1, policy_version 361388 (0.0010) [2023-12-27 21:49:15,874][106226] Updated weights for policy 0, policy_version 360711 (0.0007) [2023-12-27 21:49:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 184918016. Throughput: 0: 9796.7, 1: 9881.7. Samples: 184907384. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:16,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-6.043')] [2023-12-27 21:49:16,361][106225] Updated weights for policy 1, policy_version 361398 (0.0010) [2023-12-27 21:49:16,417][106225] Updated weights for policy 1, policy_version 361408 (0.0010) [2023-12-27 21:49:16,468][106225] Updated weights for policy 1, policy_version 361418 (0.0010) [2023-12-27 21:49:16,627][106226] Updated weights for policy 0, policy_version 360721 (0.0009) [2023-12-27 21:49:16,697][106226] Updated weights for policy 0, policy_version 360731 (0.0011) [2023-12-27 21:49:16,766][106226] Updated weights for policy 0, policy_version 360741 (0.0010) [2023-12-27 21:49:17,059][106225] Updated weights for policy 1, policy_version 361428 (0.0008) [2023-12-27 21:49:17,109][106225] Updated weights for policy 1, policy_version 361438 (0.0005) [2023-12-27 21:49:17,175][106225] Updated weights for policy 1, policy_version 361448 (0.0005) [2023-12-27 21:49:17,413][106226] Updated weights for policy 0, policy_version 360751 (0.0010) [2023-12-27 21:49:17,475][106226] Updated weights for policy 0, policy_version 360761 (0.0010) [2023-12-27 21:49:17,538][106226] Updated weights for policy 0, policy_version 360771 (0.0011) [2023-12-27 21:49:17,707][106225] Updated weights for policy 1, policy_version 361458 (0.0005) [2023-12-27 21:49:17,766][106225] Updated weights for policy 1, policy_version 361468 (0.0007) [2023-12-27 21:49:17,814][106225] Updated weights for policy 1, policy_version 361478 (0.0010) [2023-12-27 21:49:17,864][106225] Updated weights for policy 1, policy_version 361488 (0.0010) [2023-12-27 21:49:18,245][106226] Updated weights for policy 0, policy_version 360781 (0.0010) [2023-12-27 21:49:18,311][106226] Updated weights for policy 0, policy_version 360791 (0.0010) [2023-12-27 21:49:18,387][106226] Updated weights for policy 0, policy_version 360801 (0.0010) [2023-12-27 21:49:18,557][106225] Updated weights for policy 1, policy_version 361498 (0.0010) [2023-12-27 21:49:18,620][106225] Updated weights for policy 1, policy_version 361508 (0.0010) [2023-12-27 21:49:18,674][106225] Updated weights for policy 1, policy_version 361518 (0.0010) [2023-12-27 21:49:19,067][106226] Updated weights for policy 0, policy_version 360811 (0.0010) [2023-12-27 21:49:19,120][106226] Updated weights for policy 0, policy_version 360821 (0.0010) [2023-12-27 21:49:19,173][106226] Updated weights for policy 0, policy_version 360831 (0.0010) [2023-12-27 21:49:19,403][106225] Updated weights for policy 1, policy_version 361528 (0.0008) [2023-12-27 21:49:19,461][106225] Updated weights for policy 1, policy_version 361538 (0.0006) [2023-12-27 21:49:19,525][106225] Updated weights for policy 1, policy_version 361548 (0.0008) [2023-12-27 21:49:19,982][106226] Updated weights for policy 0, policy_version 360841 (0.0010) [2023-12-27 21:49:20,048][106226] Updated weights for policy 0, policy_version 360851 (0.0008) [2023-12-27 21:49:20,121][106226] Updated weights for policy 0, policy_version 360861 (0.0008) [2023-12-27 21:49:20,183][106226] Updated weights for policy 0, policy_version 360871 (0.0008) [2023-12-27 21:49:20,214][106225] Updated weights for policy 1, policy_version 361558 (0.0007) [2023-12-27 21:49:20,272][106225] Updated weights for policy 1, policy_version 361568 (0.0007) [2023-12-27 21:49:20,341][106225] Updated weights for policy 1, policy_version 361578 (0.0007) [2023-12-27 21:49:20,873][106226] Updated weights for policy 0, policy_version 360881 (0.0009) [2023-12-27 21:49:20,938][106226] Updated weights for policy 0, policy_version 360891 (0.0008) [2023-12-27 21:49:21,002][106226] Updated weights for policy 0, policy_version 360901 (0.0007) [2023-12-27 21:49:21,135][106225] Updated weights for policy 1, policy_version 361588 (0.0008) [2023-12-27 21:49:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 185016320. Throughput: 0: 9713.5, 1: 9911.5. Samples: 185027664. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:21,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-6.142')] [2023-12-27 21:49:21,198][106225] Updated weights for policy 1, policy_version 361598 (0.0010) [2023-12-27 21:49:21,264][106225] Updated weights for policy 1, policy_version 361608 (0.0011) [2023-12-27 21:49:21,793][106226] Updated weights for policy 0, policy_version 360911 (0.0008) [2023-12-27 21:49:21,853][106226] Updated weights for policy 0, policy_version 360921 (0.0008) [2023-12-27 21:49:21,919][106226] Updated weights for policy 0, policy_version 360931 (0.0008) [2023-12-27 21:49:22,039][106225] Updated weights for policy 1, policy_version 361618 (0.0010) [2023-12-27 21:49:22,103][106225] Updated weights for policy 1, policy_version 361628 (0.0008) [2023-12-27 21:49:22,170][106225] Updated weights for policy 1, policy_version 361638 (0.0009) [2023-12-27 21:49:22,227][106225] Updated weights for policy 1, policy_version 361648 (0.0009) [2023-12-27 21:49:22,622][106226] Updated weights for policy 0, policy_version 360941 (0.0008) [2023-12-27 21:49:22,685][106226] Updated weights for policy 0, policy_version 360951 (0.0009) [2023-12-27 21:49:22,744][106226] Updated weights for policy 0, policy_version 360961 (0.0008) [2023-12-27 21:49:22,988][106225] Updated weights for policy 1, policy_version 361658 (0.0005) [2023-12-27 21:49:23,055][106225] Updated weights for policy 1, policy_version 361668 (0.0007) [2023-12-27 21:49:23,112][106225] Updated weights for policy 1, policy_version 361678 (0.0009) [2023-12-27 21:49:23,418][106226] Updated weights for policy 0, policy_version 360971 (0.0007) [2023-12-27 21:49:23,471][106226] Updated weights for policy 0, policy_version 360981 (0.0005) [2023-12-27 21:49:23,531][106226] Updated weights for policy 0, policy_version 360991 (0.0006) [2023-12-27 21:49:23,767][106225] Updated weights for policy 1, policy_version 361688 (0.0006) [2023-12-27 21:49:23,816][106225] Updated weights for policy 1, policy_version 361698 (0.0007) [2023-12-27 21:49:23,867][106225] Updated weights for policy 1, policy_version 361708 (0.0006) [2023-12-27 21:49:24,088][106226] Updated weights for policy 0, policy_version 361001 (0.0005) [2023-12-27 21:49:24,153][106226] Updated weights for policy 0, policy_version 361011 (0.0005) [2023-12-27 21:49:24,219][106226] Updated weights for policy 0, policy_version 361021 (0.0008) [2023-12-27 21:49:24,277][106226] Updated weights for policy 0, policy_version 361031 (0.0006) [2023-12-27 21:49:24,547][106225] Updated weights for policy 1, policy_version 361718 (0.0006) [2023-12-27 21:49:24,610][106225] Updated weights for policy 1, policy_version 361728 (0.0006) [2023-12-27 21:49:24,665][106225] Updated weights for policy 1, policy_version 361738 (0.0005) [2023-12-27 21:49:24,826][106226] Updated weights for policy 0, policy_version 361041 (0.0010) [2023-12-27 21:49:24,873][106226] Updated weights for policy 0, policy_version 361051 (0.0006) [2023-12-27 21:49:24,923][106226] Updated weights for policy 0, policy_version 361061 (0.0005) [2023-12-27 21:49:25,175][106225] Updated weights for policy 1, policy_version 361748 (0.0005) [2023-12-27 21:49:25,236][106225] Updated weights for policy 1, policy_version 361758 (0.0005) [2023-12-27 21:49:25,292][106225] Updated weights for policy 1, policy_version 361768 (0.0009) [2023-12-27 21:49:25,607][106226] Updated weights for policy 0, policy_version 361071 (0.0009) [2023-12-27 21:49:25,663][106226] Updated weights for policy 0, policy_version 361081 (0.0009) [2023-12-27 21:49:25,718][106226] Updated weights for policy 0, policy_version 361091 (0.0006) [2023-12-27 21:49:25,977][106225] Updated weights for policy 1, policy_version 361778 (0.0010) [2023-12-27 21:49:26,034][106225] Updated weights for policy 1, policy_version 361788 (0.0009) [2023-12-27 21:49:26,093][106225] Updated weights for policy 1, policy_version 361798 (0.0010) [2023-12-27 21:49:26,143][106225] Updated weights for policy 1, policy_version 361808 (0.0010) [2023-12-27 21:49:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 185122816. Throughput: 0: 9746.7, 1: 9859.7. Samples: 185086204. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:26,176][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.917')] [2023-12-27 21:49:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000361808_92651520.pth... [2023-12-27 21:49:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000361096_92471296.pth... [2023-12-27 21:49:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000360656_92356608.pth [2023-12-27 21:49:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000359944_92176384.pth [2023-12-27 21:49:26,413][106226] Updated weights for policy 0, policy_version 361101 (0.0008) [2023-12-27 21:49:26,472][106226] Updated weights for policy 0, policy_version 361111 (0.0006) [2023-12-27 21:49:26,527][106226] Updated weights for policy 0, policy_version 361121 (0.0010) [2023-12-27 21:49:26,785][106225] Updated weights for policy 1, policy_version 361818 (0.0006) [2023-12-27 21:49:26,837][106225] Updated weights for policy 1, policy_version 361828 (0.0005) [2023-12-27 21:49:26,892][106225] Updated weights for policy 1, policy_version 361838 (0.0005) [2023-12-27 21:49:27,157][106226] Updated weights for policy 0, policy_version 361131 (0.0009) [2023-12-27 21:49:27,206][106226] Updated weights for policy 0, policy_version 361141 (0.0005) [2023-12-27 21:49:27,256][106226] Updated weights for policy 0, policy_version 361151 (0.0005) [2023-12-27 21:49:27,451][106225] Updated weights for policy 1, policy_version 361848 (0.0008) [2023-12-27 21:49:27,505][106225] Updated weights for policy 1, policy_version 361858 (0.0007) [2023-12-27 21:49:27,551][106225] Updated weights for policy 1, policy_version 361868 (0.0008) [2023-12-27 21:49:27,877][106226] Updated weights for policy 0, policy_version 361161 (0.0006) [2023-12-27 21:49:27,935][106226] Updated weights for policy 0, policy_version 361171 (0.0007) [2023-12-27 21:49:27,992][106226] Updated weights for policy 0, policy_version 361181 (0.0006) [2023-12-27 21:49:28,043][106226] Updated weights for policy 0, policy_version 361191 (0.0005) [2023-12-27 21:49:28,269][106225] Updated weights for policy 1, policy_version 361878 (0.0008) [2023-12-27 21:49:28,326][106225] Updated weights for policy 1, policy_version 361888 (0.0009) [2023-12-27 21:49:28,391][106225] Updated weights for policy 1, policy_version 361898 (0.0006) [2023-12-27 21:49:28,578][106226] Updated weights for policy 0, policy_version 361201 (0.0008) [2023-12-27 21:49:28,639][106226] Updated weights for policy 0, policy_version 361211 (0.0008) [2023-12-27 21:49:28,703][106226] Updated weights for policy 0, policy_version 361221 (0.0008) [2023-12-27 21:49:29,137][106225] Updated weights for policy 1, policy_version 361908 (0.0009) [2023-12-27 21:49:29,186][106225] Updated weights for policy 1, policy_version 361918 (0.0008) [2023-12-27 21:49:29,248][106225] Updated weights for policy 1, policy_version 361928 (0.0007) [2023-12-27 21:49:29,458][106226] Updated weights for policy 0, policy_version 361231 (0.0010) [2023-12-27 21:49:29,513][106226] Updated weights for policy 0, policy_version 361241 (0.0011) [2023-12-27 21:49:29,567][106226] Updated weights for policy 0, policy_version 361251 (0.0010) [2023-12-27 21:49:29,977][106225] Updated weights for policy 1, policy_version 361938 (0.0006) [2023-12-27 21:49:30,041][106225] Updated weights for policy 1, policy_version 361948 (0.0009) [2023-12-27 21:49:30,098][106225] Updated weights for policy 1, policy_version 361958 (0.0010) [2023-12-27 21:49:30,154][106225] Updated weights for policy 1, policy_version 361968 (0.0010) [2023-12-27 21:49:30,300][106226] Updated weights for policy 0, policy_version 361261 (0.0010) [2023-12-27 21:49:30,363][106226] Updated weights for policy 0, policy_version 361271 (0.0010) [2023-12-27 21:49:30,423][106226] Updated weights for policy 0, policy_version 361281 (0.0010) [2023-12-27 21:49:30,862][106225] Updated weights for policy 1, policy_version 361978 (0.0010) [2023-12-27 21:49:30,919][106225] Updated weights for policy 1, policy_version 361988 (0.0008) [2023-12-27 21:49:30,983][106225] Updated weights for policy 1, policy_version 361998 (0.0006) [2023-12-27 21:49:31,140][106226] Updated weights for policy 0, policy_version 361291 (0.0010) [2023-12-27 21:49:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 185221120. Throughput: 0: 9889.9, 1: 10012.3. Samples: 185212892. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:31,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-5.604')] [2023-12-27 21:49:31,207][106226] Updated weights for policy 0, policy_version 361301 (0.0008) [2023-12-27 21:49:31,273][106226] Updated weights for policy 0, policy_version 361311 (0.0010) [2023-12-27 21:49:31,663][106225] Updated weights for policy 1, policy_version 362008 (0.0009) [2023-12-27 21:49:31,719][106225] Updated weights for policy 1, policy_version 362018 (0.0008) [2023-12-27 21:49:31,783][106225] Updated weights for policy 1, policy_version 362028 (0.0009) [2023-12-27 21:49:32,006][106226] Updated weights for policy 0, policy_version 361321 (0.0010) [2023-12-27 21:49:32,068][106226] Updated weights for policy 0, policy_version 361331 (0.0006) [2023-12-27 21:49:32,127][106226] Updated weights for policy 0, policy_version 361341 (0.0007) [2023-12-27 21:49:32,186][106226] Updated weights for policy 0, policy_version 361351 (0.0007) [2023-12-27 21:49:32,518][106225] Updated weights for policy 1, policy_version 362038 (0.0009) [2023-12-27 21:49:32,572][106225] Updated weights for policy 1, policy_version 362048 (0.0008) [2023-12-27 21:49:32,625][106225] Updated weights for policy 1, policy_version 362058 (0.0008) [2023-12-27 21:49:32,844][106226] Updated weights for policy 0, policy_version 361361 (0.0009) [2023-12-27 21:49:32,910][106226] Updated weights for policy 0, policy_version 361371 (0.0008) [2023-12-27 21:49:32,979][106226] Updated weights for policy 0, policy_version 361381 (0.0007) [2023-12-27 21:49:33,267][106225] Updated weights for policy 1, policy_version 362068 (0.0008) [2023-12-27 21:49:33,335][106225] Updated weights for policy 1, policy_version 362078 (0.0009) [2023-12-27 21:49:33,402][106225] Updated weights for policy 1, policy_version 362088 (0.0006) [2023-12-27 21:49:33,526][106226] Updated weights for policy 0, policy_version 361391 (0.0005) [2023-12-27 21:49:33,590][106226] Updated weights for policy 0, policy_version 361401 (0.0005) [2023-12-27 21:49:33,644][106226] Updated weights for policy 0, policy_version 361411 (0.0005) [2023-12-27 21:49:33,935][106225] Updated weights for policy 1, policy_version 362098 (0.0006) [2023-12-27 21:49:33,988][106225] Updated weights for policy 1, policy_version 362108 (0.0009) [2023-12-27 21:49:34,046][106225] Updated weights for policy 1, policy_version 362118 (0.0008) [2023-12-27 21:49:34,104][106225] Updated weights for policy 1, policy_version 362128 (0.0009) [2023-12-27 21:49:34,209][106226] Updated weights for policy 0, policy_version 361421 (0.0006) [2023-12-27 21:49:34,275][106226] Updated weights for policy 0, policy_version 361431 (0.0009) [2023-12-27 21:49:34,345][106226] Updated weights for policy 0, policy_version 361441 (0.0009) [2023-12-27 21:49:34,861][106225] Updated weights for policy 1, policy_version 362138 (0.0009) [2023-12-27 21:49:34,920][106225] Updated weights for policy 1, policy_version 362148 (0.0008) [2023-12-27 21:49:34,975][106225] Updated weights for policy 1, policy_version 362158 (0.0009) [2023-12-27 21:49:35,105][106226] Updated weights for policy 0, policy_version 361451 (0.0009) [2023-12-27 21:49:35,163][106226] Updated weights for policy 0, policy_version 361461 (0.0008) [2023-12-27 21:49:35,226][106226] Updated weights for policy 0, policy_version 361471 (0.0009) [2023-12-27 21:49:35,605][106225] Updated weights for policy 1, policy_version 362168 (0.0006) [2023-12-27 21:49:35,652][106225] Updated weights for policy 1, policy_version 362178 (0.0005) [2023-12-27 21:49:35,698][106225] Updated weights for policy 1, policy_version 362188 (0.0005) [2023-12-27 21:49:36,044][106226] Updated weights for policy 0, policy_version 361481 (0.0008) [2023-12-27 21:49:36,120][106226] Updated weights for policy 0, policy_version 361491 (0.0008) [2023-12-27 21:49:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 185319424. Throughput: 0: 9919.6, 1: 10000.4. Samples: 185334432. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:36,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-5.768')] [2023-12-27 21:49:36,185][106226] Updated weights for policy 0, policy_version 361501 (0.0007) [2023-12-27 21:49:36,246][106226] Updated weights for policy 0, policy_version 361511 (0.0009) [2023-12-27 21:49:36,366][106225] Updated weights for policy 1, policy_version 362198 (0.0007) [2023-12-27 21:49:36,422][106225] Updated weights for policy 1, policy_version 362208 (0.0009) [2023-12-27 21:49:36,479][106225] Updated weights for policy 1, policy_version 362218 (0.0008) [2023-12-27 21:49:36,932][106226] Updated weights for policy 0, policy_version 361521 (0.0008) [2023-12-27 21:49:36,981][106226] Updated weights for policy 0, policy_version 361531 (0.0008) [2023-12-27 21:49:37,032][106226] Updated weights for policy 0, policy_version 361541 (0.0009) [2023-12-27 21:49:37,149][106225] Updated weights for policy 1, policy_version 362228 (0.0008) [2023-12-27 21:49:37,207][106225] Updated weights for policy 1, policy_version 362238 (0.0009) [2023-12-27 21:49:37,255][106225] Updated weights for policy 1, policy_version 362248 (0.0009) [2023-12-27 21:49:37,825][106226] Updated weights for policy 0, policy_version 361551 (0.0007) [2023-12-27 21:49:37,889][106226] Updated weights for policy 0, policy_version 361561 (0.0007) [2023-12-27 21:49:37,946][106226] Updated weights for policy 0, policy_version 361571 (0.0008) [2023-12-27 21:49:37,973][106225] Updated weights for policy 1, policy_version 362258 (0.0010) [2023-12-27 21:49:38,027][106225] Updated weights for policy 1, policy_version 362268 (0.0010) [2023-12-27 21:49:38,078][106225] Updated weights for policy 1, policy_version 362278 (0.0008) [2023-12-27 21:49:38,131][106225] Updated weights for policy 1, policy_version 362288 (0.0010) [2023-12-27 21:49:38,642][106226] Updated weights for policy 0, policy_version 361581 (0.0006) [2023-12-27 21:49:38,706][106226] Updated weights for policy 0, policy_version 361591 (0.0007) [2023-12-27 21:49:38,767][106226] Updated weights for policy 0, policy_version 361601 (0.0008) [2023-12-27 21:49:38,844][106225] Updated weights for policy 1, policy_version 362298 (0.0011) [2023-12-27 21:49:38,901][106225] Updated weights for policy 1, policy_version 362308 (0.0008) [2023-12-27 21:49:38,958][106225] Updated weights for policy 1, policy_version 362318 (0.0010) [2023-12-27 21:49:39,446][106226] Updated weights for policy 0, policy_version 361611 (0.0007) [2023-12-27 21:49:39,503][106226] Updated weights for policy 0, policy_version 361621 (0.0007) [2023-12-27 21:49:39,563][106226] Updated weights for policy 0, policy_version 361631 (0.0008) [2023-12-27 21:49:39,654][106225] Updated weights for policy 1, policy_version 362328 (0.0009) [2023-12-27 21:49:39,715][106225] Updated weights for policy 1, policy_version 362338 (0.0008) [2023-12-27 21:49:39,781][106225] Updated weights for policy 1, policy_version 362348 (0.0008) [2023-12-27 21:49:40,262][106226] Updated weights for policy 0, policy_version 361641 (0.0008) [2023-12-27 21:49:40,328][106226] Updated weights for policy 0, policy_version 361651 (0.0010) [2023-12-27 21:49:40,391][106226] Updated weights for policy 0, policy_version 361661 (0.0009) [2023-12-27 21:49:40,464][106226] Updated weights for policy 0, policy_version 361671 (0.0009) [2023-12-27 21:49:40,596][106225] Updated weights for policy 1, policy_version 362358 (0.0008) [2023-12-27 21:49:40,653][106225] Updated weights for policy 1, policy_version 362368 (0.0008) [2023-12-27 21:49:40,707][106225] Updated weights for policy 1, policy_version 362378 (0.0009) [2023-12-27 21:49:41,144][106226] Updated weights for policy 0, policy_version 361681 (0.0008) [2023-12-27 21:49:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 185417728. Throughput: 0: 9930.2, 1: 10033.1. Samples: 185393964. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-27 21:49:41,175][105115] Avg episode reward: [(0, '-4.950'), (1, '-5.596')] [2023-12-27 21:49:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000362384_92798976.pth... [2023-12-27 21:49:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000361200_92495872.pth [2023-12-27 21:49:41,211][106226] Updated weights for policy 0, policy_version 361691 (0.0008) [2023-12-27 21:49:41,283][106226] Updated weights for policy 0, policy_version 361701 (0.0009) [2023-12-27 21:49:41,302][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000361704_92626944.pth... [2023-12-27 21:49:41,306][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000360520_92323840.pth [2023-12-27 21:49:41,548][106225] Updated weights for policy 1, policy_version 362388 (0.0008) [2023-12-27 21:49:41,619][106225] Updated weights for policy 1, policy_version 362398 (0.0007) [2023-12-27 21:49:41,692][106225] Updated weights for policy 1, policy_version 362408 (0.0008) [2023-12-27 21:49:42,104][106226] Updated weights for policy 0, policy_version 361711 (0.0008) [2023-12-27 21:49:42,166][106226] Updated weights for policy 0, policy_version 361721 (0.0008) [2023-12-27 21:49:42,235][106226] Updated weights for policy 0, policy_version 361731 (0.0008) [2023-12-27 21:49:42,400][106225] Updated weights for policy 1, policy_version 362418 (0.0009) [2023-12-27 21:49:42,456][106225] Updated weights for policy 1, policy_version 362428 (0.0009) [2023-12-27 21:49:42,504][106225] Updated weights for policy 1, policy_version 362438 (0.0008) [2023-12-27 21:49:42,554][106225] Updated weights for policy 1, policy_version 362448 (0.0009) [2023-12-27 21:49:42,959][106226] Updated weights for policy 0, policy_version 361741 (0.0008) [2023-12-27 21:49:43,013][106226] Updated weights for policy 0, policy_version 361751 (0.0009) [2023-12-27 21:49:43,072][106226] Updated weights for policy 0, policy_version 361761 (0.0009) [2023-12-27 21:49:43,264][106225] Updated weights for policy 1, policy_version 362458 (0.0010) [2023-12-27 21:49:43,326][106225] Updated weights for policy 1, policy_version 362468 (0.0010) [2023-12-27 21:49:43,389][106225] Updated weights for policy 1, policy_version 362478 (0.0010) [2023-12-27 21:49:43,872][106226] Updated weights for policy 0, policy_version 361771 (0.0008) [2023-12-27 21:49:43,939][106226] Updated weights for policy 0, policy_version 361781 (0.0006) [2023-12-27 21:49:43,970][106225] Updated weights for policy 1, policy_version 362488 (0.0011) [2023-12-27 21:49:43,999][106226] Updated weights for policy 0, policy_version 361791 (0.0010) [2023-12-27 21:49:44,031][106225] Updated weights for policy 1, policy_version 362498 (0.0010) [2023-12-27 21:49:44,090][106225] Updated weights for policy 1, policy_version 362508 (0.0010) [2023-12-27 21:49:44,699][106226] Updated weights for policy 0, policy_version 361801 (0.0008) [2023-12-27 21:49:44,770][106226] Updated weights for policy 0, policy_version 361811 (0.0009) [2023-12-27 21:49:44,830][106225] Updated weights for policy 1, policy_version 362518 (0.0008) [2023-12-27 21:49:44,838][106226] Updated weights for policy 0, policy_version 361821 (0.0008) [2023-12-27 21:49:44,895][106225] Updated weights for policy 1, policy_version 362528 (0.0007) [2023-12-27 21:49:44,898][106226] Updated weights for policy 0, policy_version 361831 (0.0008) [2023-12-27 21:49:44,959][106225] Updated weights for policy 1, policy_version 362538 (0.0006) [2023-12-27 21:49:45,582][106226] Updated weights for policy 0, policy_version 361841 (0.0005) [2023-12-27 21:49:45,629][106226] Updated weights for policy 0, policy_version 361851 (0.0007) [2023-12-27 21:49:45,632][106225] Updated weights for policy 1, policy_version 362548 (0.0009) [2023-12-27 21:49:45,679][106225] Updated weights for policy 1, policy_version 362558 (0.0010) [2023-12-27 21:49:45,681][106226] Updated weights for policy 0, policy_version 361861 (0.0006) [2023-12-27 21:49:45,735][106225] Updated weights for policy 1, policy_version 362568 (0.0010) [2023-12-27 21:49:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 185516032. Throughput: 0: 9855.1, 1: 9981.2. Samples: 185506976. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:49:46,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.753')] [2023-12-27 21:49:46,217][106226] Updated weights for policy 0, policy_version 361871 (0.0008) [2023-12-27 21:49:46,268][106226] Updated weights for policy 0, policy_version 361881 (0.0009) [2023-12-27 21:49:46,317][106226] Updated weights for policy 0, policy_version 361891 (0.0007) [2023-12-27 21:49:46,365][106225] Updated weights for policy 1, policy_version 362578 (0.0009) [2023-12-27 21:49:46,428][106225] Updated weights for policy 1, policy_version 362588 (0.0006) [2023-12-27 21:49:46,494][106225] Updated weights for policy 1, policy_version 362598 (0.0005) [2023-12-27 21:49:46,560][106225] Updated weights for policy 1, policy_version 362608 (0.0009) [2023-12-27 21:49:46,999][106226] Updated weights for policy 0, policy_version 361901 (0.0006) [2023-12-27 21:49:47,055][106226] Updated weights for policy 0, policy_version 361911 (0.0006) [2023-12-27 21:49:47,101][106226] Updated weights for policy 0, policy_version 361921 (0.0007) [2023-12-27 21:49:47,191][106225] Updated weights for policy 1, policy_version 362618 (0.0005) [2023-12-27 21:49:47,247][106225] Updated weights for policy 1, policy_version 362628 (0.0005) [2023-12-27 21:49:47,306][106225] Updated weights for policy 1, policy_version 362638 (0.0005) [2023-12-27 21:49:47,806][106225] Updated weights for policy 1, policy_version 362648 (0.0009) [2023-12-27 21:49:47,808][106226] Updated weights for policy 0, policy_version 361931 (0.0007) [2023-12-27 21:49:47,861][106226] Updated weights for policy 0, policy_version 361941 (0.0006) [2023-12-27 21:49:47,866][106225] Updated weights for policy 1, policy_version 362658 (0.0010) [2023-12-27 21:49:47,909][106226] Updated weights for policy 0, policy_version 361951 (0.0009) [2023-12-27 21:49:47,920][106225] Updated weights for policy 1, policy_version 362668 (0.0009) [2023-12-27 21:49:48,531][106225] Updated weights for policy 1, policy_version 362678 (0.0006) [2023-12-27 21:49:48,547][106226] Updated weights for policy 0, policy_version 361961 (0.0008) [2023-12-27 21:49:48,592][106225] Updated weights for policy 1, policy_version 362688 (0.0005) [2023-12-27 21:49:48,605][106226] Updated weights for policy 0, policy_version 361971 (0.0009) [2023-12-27 21:49:48,655][106225] Updated weights for policy 1, policy_version 362698 (0.0006) [2023-12-27 21:49:48,658][106226] Updated weights for policy 0, policy_version 361981 (0.0009) [2023-12-27 21:49:48,711][106226] Updated weights for policy 0, policy_version 361991 (0.0008) [2023-12-27 21:49:49,185][106225] Updated weights for policy 1, policy_version 362708 (0.0009) [2023-12-27 21:49:49,241][106225] Updated weights for policy 1, policy_version 362718 (0.0009) [2023-12-27 21:49:49,302][106225] Updated weights for policy 1, policy_version 362728 (0.0009) [2023-12-27 21:49:49,467][106226] Updated weights for policy 0, policy_version 362001 (0.0006) [2023-12-27 21:49:49,533][106226] Updated weights for policy 0, policy_version 362011 (0.0006) [2023-12-27 21:49:49,602][106226] Updated weights for policy 0, policy_version 362021 (0.0006) [2023-12-27 21:49:50,055][106225] Updated weights for policy 1, policy_version 362738 (0.0007) [2023-12-27 21:49:50,117][106225] Updated weights for policy 1, policy_version 362748 (0.0008) [2023-12-27 21:49:50,172][106225] Updated weights for policy 1, policy_version 362758 (0.0008) [2023-12-27 21:49:50,227][106225] Updated weights for policy 1, policy_version 362768 (0.0008) [2023-12-27 21:49:50,243][106226] Updated weights for policy 0, policy_version 362031 (0.0005) [2023-12-27 21:49:50,313][106226] Updated weights for policy 0, policy_version 362041 (0.0005) [2023-12-27 21:49:50,378][106226] Updated weights for policy 0, policy_version 362051 (0.0008) [2023-12-27 21:49:50,946][106225] Updated weights for policy 1, policy_version 362778 (0.0007) [2023-12-27 21:49:51,005][106225] Updated weights for policy 1, policy_version 362788 (0.0008) [2023-12-27 21:49:51,080][106225] Updated weights for policy 1, policy_version 362798 (0.0008) [2023-12-27 21:49:51,095][106226] Updated weights for policy 0, policy_version 362061 (0.0007) [2023-12-27 21:49:51,162][106226] Updated weights for policy 0, policy_version 362071 (0.0009) [2023-12-27 21:49:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 185622528. Throughput: 0: 9916.7, 1: 10138.9. Samples: 185633868. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:49:51,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-5.691')] [2023-12-27 21:49:51,236][106226] Updated weights for policy 0, policy_version 362081 (0.0006) [2023-12-27 21:49:51,780][106225] Updated weights for policy 1, policy_version 362808 (0.0006) [2023-12-27 21:49:51,839][106225] Updated weights for policy 1, policy_version 362818 (0.0009) [2023-12-27 21:49:51,900][106225] Updated weights for policy 1, policy_version 362828 (0.0009) [2023-12-27 21:49:52,012][106226] Updated weights for policy 0, policy_version 362091 (0.0010) [2023-12-27 21:49:52,075][106226] Updated weights for policy 0, policy_version 362101 (0.0009) [2023-12-27 21:49:52,127][106226] Updated weights for policy 0, policy_version 362111 (0.0005) [2023-12-27 21:49:52,628][106225] Updated weights for policy 1, policy_version 362838 (0.0008) [2023-12-27 21:49:52,675][106225] Updated weights for policy 1, policy_version 362848 (0.0005) [2023-12-27 21:49:52,724][106225] Updated weights for policy 1, policy_version 362858 (0.0008) [2023-12-27 21:49:52,893][106226] Updated weights for policy 0, policy_version 362121 (0.0008) [2023-12-27 21:49:52,953][106226] Updated weights for policy 0, policy_version 362131 (0.0008) [2023-12-27 21:49:53,013][106226] Updated weights for policy 0, policy_version 362141 (0.0008) [2023-12-27 21:49:53,060][106226] Updated weights for policy 0, policy_version 362151 (0.0008) [2023-12-27 21:49:53,370][106225] Updated weights for policy 1, policy_version 362868 (0.0008) [2023-12-27 21:49:53,428][106225] Updated weights for policy 1, policy_version 362878 (0.0009) [2023-12-27 21:49:53,476][106225] Updated weights for policy 1, policy_version 362888 (0.0008) [2023-12-27 21:49:53,824][106226] Updated weights for policy 0, policy_version 362161 (0.0009) [2023-12-27 21:49:53,878][106226] Updated weights for policy 0, policy_version 362171 (0.0008) [2023-12-27 21:49:53,938][106226] Updated weights for policy 0, policy_version 362181 (0.0008) [2023-12-27 21:49:54,085][106225] Updated weights for policy 1, policy_version 362898 (0.0008) [2023-12-27 21:49:54,150][106225] Updated weights for policy 1, policy_version 362908 (0.0005) [2023-12-27 21:49:54,212][106225] Updated weights for policy 1, policy_version 362918 (0.0005) [2023-12-27 21:49:54,273][106225] Updated weights for policy 1, policy_version 362928 (0.0005) [2023-12-27 21:49:54,732][106226] Updated weights for policy 0, policy_version 362191 (0.0008) [2023-12-27 21:49:54,796][106226] Updated weights for policy 0, policy_version 362201 (0.0008) [2023-12-27 21:49:54,858][106226] Updated weights for policy 0, policy_version 362211 (0.0006) [2023-12-27 21:49:54,868][106225] Updated weights for policy 1, policy_version 362938 (0.0010) [2023-12-27 21:49:54,926][106225] Updated weights for policy 1, policy_version 362948 (0.0008) [2023-12-27 21:49:54,977][106225] Updated weights for policy 1, policy_version 362958 (0.0009) [2023-12-27 21:49:55,556][106226] Updated weights for policy 0, policy_version 362221 (0.0008) [2023-12-27 21:49:55,624][106226] Updated weights for policy 0, policy_version 362231 (0.0011) [2023-12-27 21:49:55,657][106225] Updated weights for policy 1, policy_version 362968 (0.0006) [2023-12-27 21:49:55,683][106226] Updated weights for policy 0, policy_version 362241 (0.0011) [2023-12-27 21:49:55,717][106225] Updated weights for policy 1, policy_version 362978 (0.0005) [2023-12-27 21:49:55,777][106225] Updated weights for policy 1, policy_version 362988 (0.0006) [2023-12-27 21:49:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 185720832. Throughput: 0: 9859.3, 1: 10136.9. Samples: 185690840. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:49:56,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.897')] [2023-12-27 21:49:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000362992_92954624.pth... [2023-12-27 21:49:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000362248_92766208.pth... [2023-12-27 21:49:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000361808_92651520.pth [2023-12-27 21:49:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000361096_92471296.pth [2023-12-27 21:49:56,342][106226] Updated weights for policy 0, policy_version 362251 (0.0010) [2023-12-27 21:49:56,408][106226] Updated weights for policy 0, policy_version 362261 (0.0010) [2023-12-27 21:49:56,414][106225] Updated weights for policy 1, policy_version 362998 (0.0006) [2023-12-27 21:49:56,457][106226] Updated weights for policy 0, policy_version 362271 (0.0010) [2023-12-27 21:49:56,471][106225] Updated weights for policy 1, policy_version 363008 (0.0005) [2023-12-27 21:49:56,527][106225] Updated weights for policy 1, policy_version 363018 (0.0006) [2023-12-27 21:49:57,067][106226] Updated weights for policy 0, policy_version 362281 (0.0010) [2023-12-27 21:49:57,106][106225] Updated weights for policy 1, policy_version 363028 (0.0007) [2023-12-27 21:49:57,120][106226] Updated weights for policy 0, policy_version 362291 (0.0008) [2023-12-27 21:49:57,156][106225] Updated weights for policy 1, policy_version 363038 (0.0008) [2023-12-27 21:49:57,176][106226] Updated weights for policy 0, policy_version 362301 (0.0008) [2023-12-27 21:49:57,213][106225] Updated weights for policy 1, policy_version 363048 (0.0006) [2023-12-27 21:49:57,235][106226] Updated weights for policy 0, policy_version 362311 (0.0008) [2023-12-27 21:49:57,781][106225] Updated weights for policy 1, policy_version 363058 (0.0008) [2023-12-27 21:49:57,850][106225] Updated weights for policy 1, policy_version 363068 (0.0005) [2023-12-27 21:49:57,909][106225] Updated weights for policy 1, policy_version 363078 (0.0005) [2023-12-27 21:49:57,919][106226] Updated weights for policy 0, policy_version 362321 (0.0008) [2023-12-27 21:49:57,971][106226] Updated weights for policy 0, policy_version 362331 (0.0008) [2023-12-27 21:49:57,977][106225] Updated weights for policy 1, policy_version 363088 (0.0005) [2023-12-27 21:49:58,024][106226] Updated weights for policy 0, policy_version 362341 (0.0009) [2023-12-27 21:49:58,555][106225] Updated weights for policy 1, policy_version 363098 (0.0009) [2023-12-27 21:49:58,626][106225] Updated weights for policy 1, policy_version 363108 (0.0008) [2023-12-27 21:49:58,694][106225] Updated weights for policy 1, policy_version 363118 (0.0011) [2023-12-27 21:49:58,897][106226] Updated weights for policy 0, policy_version 362351 (0.0008) [2023-12-27 21:49:58,966][106226] Updated weights for policy 0, policy_version 362361 (0.0009) [2023-12-27 21:49:59,037][106226] Updated weights for policy 0, policy_version 362371 (0.0007) [2023-12-27 21:49:59,516][106225] Updated weights for policy 1, policy_version 363128 (0.0008) [2023-12-27 21:49:59,575][106225] Updated weights for policy 1, policy_version 363138 (0.0005) [2023-12-27 21:49:59,638][106225] Updated weights for policy 1, policy_version 363148 (0.0009) [2023-12-27 21:49:59,774][106226] Updated weights for policy 0, policy_version 362381 (0.0008) [2023-12-27 21:49:59,836][106226] Updated weights for policy 0, policy_version 362391 (0.0008) [2023-12-27 21:49:59,893][106226] Updated weights for policy 0, policy_version 362401 (0.0006) [2023-12-27 21:50:00,358][106225] Updated weights for policy 1, policy_version 363158 (0.0009) [2023-12-27 21:50:00,422][106225] Updated weights for policy 1, policy_version 363168 (0.0010) [2023-12-27 21:50:00,482][106225] Updated weights for policy 1, policy_version 363178 (0.0008) [2023-12-27 21:50:00,531][106226] Updated weights for policy 0, policy_version 362411 (0.0007) [2023-12-27 21:50:00,595][106226] Updated weights for policy 0, policy_version 362421 (0.0005) [2023-12-27 21:50:00,662][106226] Updated weights for policy 0, policy_version 362431 (0.0005) [2023-12-27 21:50:01,012][106225] Updated weights for policy 1, policy_version 363188 (0.0006) [2023-12-27 21:50:01,079][106225] Updated weights for policy 1, policy_version 363198 (0.0010) [2023-12-27 21:50:01,143][106225] Updated weights for policy 1, policy_version 363208 (0.0010) [2023-12-27 21:50:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 185819136. Throughput: 0: 9866.2, 1: 10253.5. Samples: 185812772. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:01,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.775')] [2023-12-27 21:50:01,393][106226] Updated weights for policy 0, policy_version 362441 (0.0007) [2023-12-27 21:50:01,452][106226] Updated weights for policy 0, policy_version 362451 (0.0007) [2023-12-27 21:50:01,510][106226] Updated weights for policy 0, policy_version 362461 (0.0008) [2023-12-27 21:50:01,570][106226] Updated weights for policy 0, policy_version 362471 (0.0008) [2023-12-27 21:50:01,876][106225] Updated weights for policy 1, policy_version 363218 (0.0008) [2023-12-27 21:50:01,928][106225] Updated weights for policy 1, policy_version 363228 (0.0010) [2023-12-27 21:50:01,989][106225] Updated weights for policy 1, policy_version 363238 (0.0010) [2023-12-27 21:50:02,055][106225] Updated weights for policy 1, policy_version 363248 (0.0010) [2023-12-27 21:50:02,258][106226] Updated weights for policy 0, policy_version 362481 (0.0006) [2023-12-27 21:50:02,325][106226] Updated weights for policy 0, policy_version 362491 (0.0008) [2023-12-27 21:50:02,389][106226] Updated weights for policy 0, policy_version 362501 (0.0007) [2023-12-27 21:50:02,770][106225] Updated weights for policy 1, policy_version 363258 (0.0010) [2023-12-27 21:50:02,820][106225] Updated weights for policy 1, policy_version 363268 (0.0010) [2023-12-27 21:50:02,871][106225] Updated weights for policy 1, policy_version 363278 (0.0010) [2023-12-27 21:50:03,063][106226] Updated weights for policy 0, policy_version 362511 (0.0010) [2023-12-27 21:50:03,125][106226] Updated weights for policy 0, policy_version 362521 (0.0010) [2023-12-27 21:50:03,186][106226] Updated weights for policy 0, policy_version 362531 (0.0005) [2023-12-27 21:50:03,613][106225] Updated weights for policy 1, policy_version 363288 (0.0010) [2023-12-27 21:50:03,670][106225] Updated weights for policy 1, policy_version 363298 (0.0010) [2023-12-27 21:50:03,725][106225] Updated weights for policy 1, policy_version 363308 (0.0010) [2023-12-27 21:50:03,866][106226] Updated weights for policy 0, policy_version 362541 (0.0007) [2023-12-27 21:50:03,930][106226] Updated weights for policy 0, policy_version 362551 (0.0008) [2023-12-27 21:50:03,992][106226] Updated weights for policy 0, policy_version 362561 (0.0008) [2023-12-27 21:50:04,450][106225] Updated weights for policy 1, policy_version 363318 (0.0010) [2023-12-27 21:50:04,514][106225] Updated weights for policy 1, policy_version 363328 (0.0010) [2023-12-27 21:50:04,588][106225] Updated weights for policy 1, policy_version 363338 (0.0010) [2023-12-27 21:50:04,726][106226] Updated weights for policy 0, policy_version 362571 (0.0008) [2023-12-27 21:50:04,773][106226] Updated weights for policy 0, policy_version 362581 (0.0008) [2023-12-27 21:50:04,833][106226] Updated weights for policy 0, policy_version 362591 (0.0008) [2023-12-27 21:50:05,277][106225] Updated weights for policy 1, policy_version 363348 (0.0010) [2023-12-27 21:50:05,328][106225] Updated weights for policy 1, policy_version 363358 (0.0010) [2023-12-27 21:50:05,376][106225] Updated weights for policy 1, policy_version 363368 (0.0006) [2023-12-27 21:50:05,541][106226] Updated weights for policy 0, policy_version 362601 (0.0008) [2023-12-27 21:50:05,591][106226] Updated weights for policy 0, policy_version 362611 (0.0010) [2023-12-27 21:50:05,648][106226] Updated weights for policy 0, policy_version 362621 (0.0011) [2023-12-27 21:50:05,704][106226] Updated weights for policy 0, policy_version 362631 (0.0010) [2023-12-27 21:50:06,096][106225] Updated weights for policy 1, policy_version 363378 (0.0006) [2023-12-27 21:50:06,168][106225] Updated weights for policy 1, policy_version 363388 (0.0009) [2023-12-27 21:50:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 185917440. Throughput: 0: 9909.3, 1: 10184.8. Samples: 185931896. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:06,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.814')] [2023-12-27 21:50:06,232][106225] Updated weights for policy 1, policy_version 363398 (0.0007) [2023-12-27 21:50:06,297][106225] Updated weights for policy 1, policy_version 363408 (0.0011) [2023-12-27 21:50:06,456][106226] Updated weights for policy 0, policy_version 362641 (0.0010) [2023-12-27 21:50:06,527][106226] Updated weights for policy 0, policy_version 362651 (0.0008) [2023-12-27 21:50:06,592][106226] Updated weights for policy 0, policy_version 362661 (0.0008) [2023-12-27 21:50:06,974][106225] Updated weights for policy 1, policy_version 363418 (0.0009) [2023-12-27 21:50:07,042][106225] Updated weights for policy 1, policy_version 363428 (0.0010) [2023-12-27 21:50:07,113][106225] Updated weights for policy 1, policy_version 363438 (0.0011) [2023-12-27 21:50:07,260][106226] Updated weights for policy 0, policy_version 362671 (0.0006) [2023-12-27 21:50:07,314][106226] Updated weights for policy 0, policy_version 362681 (0.0007) [2023-12-27 21:50:07,379][106226] Updated weights for policy 0, policy_version 362691 (0.0006) [2023-12-27 21:50:07,735][106225] Updated weights for policy 1, policy_version 363448 (0.0006) [2023-12-27 21:50:07,793][106225] Updated weights for policy 1, policy_version 363458 (0.0005) [2023-12-27 21:50:07,850][106225] Updated weights for policy 1, policy_version 363468 (0.0008) [2023-12-27 21:50:07,958][106226] Updated weights for policy 0, policy_version 362701 (0.0007) [2023-12-27 21:50:08,019][106226] Updated weights for policy 0, policy_version 362711 (0.0010) [2023-12-27 21:50:08,076][106226] Updated weights for policy 0, policy_version 362721 (0.0010) [2023-12-27 21:50:08,537][106225] Updated weights for policy 1, policy_version 363478 (0.0008) [2023-12-27 21:50:08,603][106225] Updated weights for policy 1, policy_version 363488 (0.0008) [2023-12-27 21:50:08,666][106225] Updated weights for policy 1, policy_version 363498 (0.0008) [2023-12-27 21:50:08,797][106226] Updated weights for policy 0, policy_version 362731 (0.0009) [2023-12-27 21:50:08,863][106226] Updated weights for policy 0, policy_version 362741 (0.0008) [2023-12-27 21:50:08,921][106226] Updated weights for policy 0, policy_version 362751 (0.0006) [2023-12-27 21:50:09,425][106225] Updated weights for policy 1, policy_version 363508 (0.0008) [2023-12-27 21:50:09,493][106225] Updated weights for policy 1, policy_version 363518 (0.0006) [2023-12-27 21:50:09,564][106225] Updated weights for policy 1, policy_version 363528 (0.0006) [2023-12-27 21:50:09,576][106226] Updated weights for policy 0, policy_version 362761 (0.0007) [2023-12-27 21:50:09,636][106226] Updated weights for policy 0, policy_version 362771 (0.0007) [2023-12-27 21:50:09,706][106226] Updated weights for policy 0, policy_version 362781 (0.0007) [2023-12-27 21:50:09,775][106226] Updated weights for policy 0, policy_version 362791 (0.0010) [2023-12-27 21:50:10,202][106225] Updated weights for policy 1, policy_version 363538 (0.0006) [2023-12-27 21:50:10,275][106225] Updated weights for policy 1, policy_version 363548 (0.0009) [2023-12-27 21:50:10,331][106225] Updated weights for policy 1, policy_version 363558 (0.0008) [2023-12-27 21:50:10,394][106225] Updated weights for policy 1, policy_version 363568 (0.0008) [2023-12-27 21:50:10,427][106226] Updated weights for policy 0, policy_version 362801 (0.0009) [2023-12-27 21:50:10,491][106226] Updated weights for policy 0, policy_version 362811 (0.0009) [2023-12-27 21:50:10,555][106226] Updated weights for policy 0, policy_version 362821 (0.0009) [2023-12-27 21:50:11,057][106225] Updated weights for policy 1, policy_version 363578 (0.0008) [2023-12-27 21:50:11,144][106225] Updated weights for policy 1, policy_version 363588 (0.0010) [2023-12-27 21:50:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 186015744. Throughput: 0: 9904.8, 1: 10231.1. Samples: 185992320. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:11,176][105115] Avg episode reward: [(0, '-4.476'), (1, '-5.802')] [2023-12-27 21:50:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000362824_92913664.pth... [2023-12-27 21:50:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000361704_92626944.pth [2023-12-27 21:50:11,206][106225] Updated weights for policy 1, policy_version 363598 (0.0009) [2023-12-27 21:50:11,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000363600_93110272.pth... [2023-12-27 21:50:11,220][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000362384_92798976.pth [2023-12-27 21:50:11,240][106226] Updated weights for policy 0, policy_version 362831 (0.0006) [2023-12-27 21:50:11,308][106226] Updated weights for policy 0, policy_version 362841 (0.0007) [2023-12-27 21:50:11,387][106226] Updated weights for policy 0, policy_version 362851 (0.0007) [2023-12-27 21:50:11,971][106225] Updated weights for policy 1, policy_version 363608 (0.0009) [2023-12-27 21:50:12,029][106225] Updated weights for policy 1, policy_version 363618 (0.0007) [2023-12-27 21:50:12,091][106225] Updated weights for policy 1, policy_version 363628 (0.0007) [2023-12-27 21:50:12,111][106226] Updated weights for policy 0, policy_version 362861 (0.0010) [2023-12-27 21:50:12,178][106226] Updated weights for policy 0, policy_version 362871 (0.0008) [2023-12-27 21:50:12,250][106226] Updated weights for policy 0, policy_version 362881 (0.0006) [2023-12-27 21:50:12,838][106225] Updated weights for policy 1, policy_version 363638 (0.0007) [2023-12-27 21:50:12,857][106226] Updated weights for policy 0, policy_version 362891 (0.0007) [2023-12-27 21:50:12,894][106225] Updated weights for policy 1, policy_version 363648 (0.0007) [2023-12-27 21:50:12,907][106226] Updated weights for policy 0, policy_version 362901 (0.0010) [2023-12-27 21:50:12,948][106225] Updated weights for policy 1, policy_version 363658 (0.0005) [2023-12-27 21:50:12,953][106226] Updated weights for policy 0, policy_version 362911 (0.0010) [2023-12-27 21:50:13,636][106226] Updated weights for policy 0, policy_version 362921 (0.0010) [2023-12-27 21:50:13,644][106225] Updated weights for policy 1, policy_version 363668 (0.0007) [2023-12-27 21:50:13,693][106226] Updated weights for policy 0, policy_version 362931 (0.0010) [2023-12-27 21:50:13,697][106225] Updated weights for policy 1, policy_version 363678 (0.0010) [2023-12-27 21:50:13,745][106225] Updated weights for policy 1, policy_version 363688 (0.0008) [2023-12-27 21:50:13,754][106226] Updated weights for policy 0, policy_version 362941 (0.0010) [2023-12-27 21:50:13,807][106226] Updated weights for policy 0, policy_version 362951 (0.0010) [2023-12-27 21:50:14,482][106225] Updated weights for policy 1, policy_version 363698 (0.0006) [2023-12-27 21:50:14,502][106226] Updated weights for policy 0, policy_version 362961 (0.0010) [2023-12-27 21:50:14,548][106225] Updated weights for policy 1, policy_version 363708 (0.0010) [2023-12-27 21:50:14,563][106226] Updated weights for policy 0, policy_version 362971 (0.0010) [2023-12-27 21:50:14,611][106225] Updated weights for policy 1, policy_version 363718 (0.0010) [2023-12-27 21:50:14,624][106226] Updated weights for policy 0, policy_version 362981 (0.0010) [2023-12-27 21:50:14,669][106225] Updated weights for policy 1, policy_version 363728 (0.0010) [2023-12-27 21:50:15,312][106226] Updated weights for policy 0, policy_version 362991 (0.0010) [2023-12-27 21:50:15,375][106226] Updated weights for policy 0, policy_version 363001 (0.0011) [2023-12-27 21:50:15,383][106225] Updated weights for policy 1, policy_version 363738 (0.0006) [2023-12-27 21:50:15,425][106226] Updated weights for policy 0, policy_version 363011 (0.0010) [2023-12-27 21:50:15,445][106225] Updated weights for policy 1, policy_version 363748 (0.0005) [2023-12-27 21:50:15,502][106225] Updated weights for policy 1, policy_version 363758 (0.0006) [2023-12-27 21:50:16,021][106226] Updated weights for policy 0, policy_version 363021 (0.0010) [2023-12-27 21:50:16,035][106225] Updated weights for policy 1, policy_version 363768 (0.0005) [2023-12-27 21:50:16,078][106226] Updated weights for policy 0, policy_version 363031 (0.0010) [2023-12-27 21:50:16,087][106225] Updated weights for policy 1, policy_version 363778 (0.0007) [2023-12-27 21:50:16,140][106226] Updated weights for policy 0, policy_version 363041 (0.0010) [2023-12-27 21:50:16,141][106225] Updated weights for policy 1, policy_version 363788 (0.0005) [2023-12-27 21:50:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 186122240. Throughput: 0: 9821.1, 1: 10114.2. Samples: 186109984. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:16,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.809')] [2023-12-27 21:50:16,737][106225] Updated weights for policy 1, policy_version 363798 (0.0007) [2023-12-27 21:50:16,791][106225] Updated weights for policy 1, policy_version 363808 (0.0007) [2023-12-27 21:50:16,818][106226] Updated weights for policy 0, policy_version 363051 (0.0010) [2023-12-27 21:50:16,847][106225] Updated weights for policy 1, policy_version 363818 (0.0006) [2023-12-27 21:50:16,874][106226] Updated weights for policy 0, policy_version 363061 (0.0010) [2023-12-27 21:50:16,930][106226] Updated weights for policy 0, policy_version 363071 (0.0010) [2023-12-27 21:50:17,600][106225] Updated weights for policy 1, policy_version 363828 (0.0007) [2023-12-27 21:50:17,615][106226] Updated weights for policy 0, policy_version 363081 (0.0010) [2023-12-27 21:50:17,655][106225] Updated weights for policy 1, policy_version 363838 (0.0009) [2023-12-27 21:50:17,673][106226] Updated weights for policy 0, policy_version 363091 (0.0005) [2023-12-27 21:50:17,717][106225] Updated weights for policy 1, policy_version 363848 (0.0008) [2023-12-27 21:50:17,728][106226] Updated weights for policy 0, policy_version 363101 (0.0006) [2023-12-27 21:50:17,782][106226] Updated weights for policy 0, policy_version 363111 (0.0005) [2023-12-27 21:50:18,314][106226] Updated weights for policy 0, policy_version 363121 (0.0006) [2023-12-27 21:50:18,383][106226] Updated weights for policy 0, policy_version 363131 (0.0008) [2023-12-27 21:50:18,437][106226] Updated weights for policy 0, policy_version 363141 (0.0010) [2023-12-27 21:50:18,529][106225] Updated weights for policy 1, policy_version 363858 (0.0008) [2023-12-27 21:50:18,586][106225] Updated weights for policy 1, policy_version 363868 (0.0010) [2023-12-27 21:50:18,641][106225] Updated weights for policy 1, policy_version 363878 (0.0011) [2023-12-27 21:50:18,692][106225] Updated weights for policy 1, policy_version 363888 (0.0010) [2023-12-27 21:50:19,020][106226] Updated weights for policy 0, policy_version 363151 (0.0008) [2023-12-27 21:50:19,069][106226] Updated weights for policy 0, policy_version 363161 (0.0006) [2023-12-27 21:50:19,115][106226] Updated weights for policy 0, policy_version 363171 (0.0005) [2023-12-27 21:50:19,393][106225] Updated weights for policy 1, policy_version 363898 (0.0008) [2023-12-27 21:50:19,454][106225] Updated weights for policy 1, policy_version 363908 (0.0008) [2023-12-27 21:50:19,516][106225] Updated weights for policy 1, policy_version 363918 (0.0008) [2023-12-27 21:50:19,811][106226] Updated weights for policy 0, policy_version 363181 (0.0009) [2023-12-27 21:50:19,876][106226] Updated weights for policy 0, policy_version 363191 (0.0010) [2023-12-27 21:50:19,941][106226] Updated weights for policy 0, policy_version 363201 (0.0011) [2023-12-27 21:50:20,294][106225] Updated weights for policy 1, policy_version 363928 (0.0008) [2023-12-27 21:50:20,353][106225] Updated weights for policy 1, policy_version 363938 (0.0007) [2023-12-27 21:50:20,411][106225] Updated weights for policy 1, policy_version 363948 (0.0008) [2023-12-27 21:50:20,728][106226] Updated weights for policy 0, policy_version 363211 (0.0011) [2023-12-27 21:50:20,797][106226] Updated weights for policy 0, policy_version 363221 (0.0011) [2023-12-27 21:50:20,864][106226] Updated weights for policy 0, policy_version 363231 (0.0007) [2023-12-27 21:50:21,152][106225] Updated weights for policy 1, policy_version 363958 (0.0008) [2023-12-27 21:50:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 186220544. Throughput: 0: 9891.7, 1: 10046.0. Samples: 186231632. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:21,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-5.504')] [2023-12-27 21:50:21,214][106225] Updated weights for policy 1, policy_version 363968 (0.0009) [2023-12-27 21:50:21,280][106225] Updated weights for policy 1, policy_version 363978 (0.0010) [2023-12-27 21:50:21,549][106226] Updated weights for policy 0, policy_version 363241 (0.0010) [2023-12-27 21:50:21,609][106226] Updated weights for policy 0, policy_version 363251 (0.0007) [2023-12-27 21:50:21,676][106226] Updated weights for policy 0, policy_version 363261 (0.0009) [2023-12-27 21:50:21,749][106226] Updated weights for policy 0, policy_version 363271 (0.0009) [2023-12-27 21:50:22,049][106225] Updated weights for policy 1, policy_version 363988 (0.0010) [2023-12-27 21:50:22,106][106225] Updated weights for policy 1, policy_version 363998 (0.0008) [2023-12-27 21:50:22,165][106225] Updated weights for policy 1, policy_version 364008 (0.0008) [2023-12-27 21:50:22,484][106226] Updated weights for policy 0, policy_version 363281 (0.0011) [2023-12-27 21:50:22,550][106226] Updated weights for policy 0, policy_version 363291 (0.0011) [2023-12-27 21:50:22,612][106226] Updated weights for policy 0, policy_version 363301 (0.0010) [2023-12-27 21:50:22,904][106225] Updated weights for policy 1, policy_version 364018 (0.0008) [2023-12-27 21:50:22,958][106225] Updated weights for policy 1, policy_version 364028 (0.0008) [2023-12-27 21:50:23,016][106225] Updated weights for policy 1, policy_version 364038 (0.0008) [2023-12-27 21:50:23,081][106225] Updated weights for policy 1, policy_version 364048 (0.0006) [2023-12-27 21:50:23,326][106226] Updated weights for policy 0, policy_version 363311 (0.0011) [2023-12-27 21:50:23,376][106226] Updated weights for policy 0, policy_version 363321 (0.0008) [2023-12-27 21:50:23,433][106226] Updated weights for policy 0, policy_version 363331 (0.0005) [2023-12-27 21:50:23,726][106225] Updated weights for policy 1, policy_version 364058 (0.0009) [2023-12-27 21:50:23,776][106225] Updated weights for policy 1, policy_version 364068 (0.0009) [2023-12-27 21:50:23,835][106225] Updated weights for policy 1, policy_version 364078 (0.0007) [2023-12-27 21:50:24,053][106226] Updated weights for policy 0, policy_version 363341 (0.0007) [2023-12-27 21:50:24,112][106226] Updated weights for policy 0, policy_version 363351 (0.0008) [2023-12-27 21:50:24,186][106226] Updated weights for policy 0, policy_version 363361 (0.0010) [2023-12-27 21:50:24,545][106225] Updated weights for policy 1, policy_version 364088 (0.0006) [2023-12-27 21:50:24,617][106225] Updated weights for policy 1, policy_version 364098 (0.0006) [2023-12-27 21:50:24,681][106225] Updated weights for policy 1, policy_version 364108 (0.0005) [2023-12-27 21:50:24,788][106226] Updated weights for policy 0, policy_version 363371 (0.0009) [2023-12-27 21:50:24,842][106226] Updated weights for policy 0, policy_version 363381 (0.0010) [2023-12-27 21:50:24,894][106226] Updated weights for policy 0, policy_version 363391 (0.0010) [2023-12-27 21:50:25,220][106225] Updated weights for policy 1, policy_version 364118 (0.0008) [2023-12-27 21:50:25,290][106225] Updated weights for policy 1, policy_version 364128 (0.0010) [2023-12-27 21:50:25,349][106225] Updated weights for policy 1, policy_version 364138 (0.0010) [2023-12-27 21:50:25,602][106226] Updated weights for policy 0, policy_version 363401 (0.0011) [2023-12-27 21:50:25,671][106226] Updated weights for policy 0, policy_version 363411 (0.0007) [2023-12-27 21:50:25,722][106226] Updated weights for policy 0, policy_version 363421 (0.0005) [2023-12-27 21:50:25,770][106226] Updated weights for policy 0, policy_version 363431 (0.0005) [2023-12-27 21:50:25,930][106225] Updated weights for policy 1, policy_version 364148 (0.0009) [2023-12-27 21:50:25,977][106225] Updated weights for policy 1, policy_version 364158 (0.0010) [2023-12-27 21:50:26,035][106225] Updated weights for policy 1, policy_version 364168 (0.0005) [2023-12-27 21:50:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 186327040. Throughput: 0: 9902.2, 1: 10017.6. Samples: 186290352. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:26,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-6.063')] [2023-12-27 21:50:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000364176_93257728.pth... [2023-12-27 21:50:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000363432_93069312.pth... [2023-12-27 21:50:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000362992_92954624.pth [2023-12-27 21:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000362248_92766208.pth [2023-12-27 21:50:26,418][106226] Updated weights for policy 0, policy_version 363441 (0.0006) [2023-12-27 21:50:26,481][106226] Updated weights for policy 0, policy_version 363451 (0.0010) [2023-12-27 21:50:26,541][106226] Updated weights for policy 0, policy_version 363461 (0.0010) [2023-12-27 21:50:26,660][106225] Updated weights for policy 1, policy_version 364178 (0.0005) [2023-12-27 21:50:26,720][106225] Updated weights for policy 1, policy_version 364188 (0.0009) [2023-12-27 21:50:26,774][106225] Updated weights for policy 1, policy_version 364198 (0.0010) [2023-12-27 21:50:26,824][106225] Updated weights for policy 1, policy_version 364208 (0.0010) [2023-12-27 21:50:27,140][106226] Updated weights for policy 0, policy_version 363471 (0.0011) [2023-12-27 21:50:27,206][106226] Updated weights for policy 0, policy_version 363481 (0.0010) [2023-12-27 21:50:27,251][106226] Updated weights for policy 0, policy_version 363491 (0.0010) [2023-12-27 21:50:27,463][106225] Updated weights for policy 1, policy_version 364218 (0.0005) [2023-12-27 21:50:27,529][106225] Updated weights for policy 1, policy_version 364228 (0.0005) [2023-12-27 21:50:27,580][106225] Updated weights for policy 1, policy_version 364238 (0.0006) [2023-12-27 21:50:27,864][106226] Updated weights for policy 0, policy_version 363501 (0.0010) [2023-12-27 21:50:27,914][106226] Updated weights for policy 0, policy_version 363511 (0.0007) [2023-12-27 21:50:27,971][106226] Updated weights for policy 0, policy_version 363521 (0.0005) [2023-12-27 21:50:28,143][106225] Updated weights for policy 1, policy_version 364248 (0.0005) [2023-12-27 21:50:28,197][106225] Updated weights for policy 1, policy_version 364258 (0.0005) [2023-12-27 21:50:28,250][106225] Updated weights for policy 1, policy_version 364268 (0.0005) [2023-12-27 21:50:28,531][106226] Updated weights for policy 0, policy_version 363531 (0.0007) [2023-12-27 21:50:28,594][106226] Updated weights for policy 0, policy_version 363541 (0.0009) [2023-12-27 21:50:28,648][106226] Updated weights for policy 0, policy_version 363551 (0.0005) [2023-12-27 21:50:28,910][106225] Updated weights for policy 1, policy_version 364278 (0.0006) [2023-12-27 21:50:28,972][106225] Updated weights for policy 1, policy_version 364288 (0.0010) [2023-12-27 21:50:29,045][106225] Updated weights for policy 1, policy_version 364298 (0.0009) [2023-12-27 21:50:29,296][106226] Updated weights for policy 0, policy_version 363561 (0.0005) [2023-12-27 21:50:29,364][106226] Updated weights for policy 0, policy_version 363571 (0.0008) [2023-12-27 21:50:29,427][106226] Updated weights for policy 0, policy_version 363581 (0.0009) [2023-12-27 21:50:29,472][106226] Updated weights for policy 0, policy_version 363591 (0.0008) [2023-12-27 21:50:29,679][106225] Updated weights for policy 1, policy_version 364308 (0.0009) [2023-12-27 21:50:29,735][106225] Updated weights for policy 1, policy_version 364318 (0.0010) [2023-12-27 21:50:29,786][106225] Updated weights for policy 1, policy_version 364328 (0.0008) [2023-12-27 21:50:30,203][106226] Updated weights for policy 0, policy_version 363601 (0.0007) [2023-12-27 21:50:30,263][106226] Updated weights for policy 0, policy_version 363611 (0.0008) [2023-12-27 21:50:30,316][106226] Updated weights for policy 0, policy_version 363621 (0.0007) [2023-12-27 21:50:30,532][106225] Updated weights for policy 1, policy_version 364338 (0.0009) [2023-12-27 21:50:30,599][106225] Updated weights for policy 1, policy_version 364348 (0.0007) [2023-12-27 21:50:30,656][106225] Updated weights for policy 1, policy_version 364358 (0.0005) [2023-12-27 21:50:30,703][106225] Updated weights for policy 1, policy_version 364368 (0.0005) [2023-12-27 21:50:31,010][106226] Updated weights for policy 0, policy_version 363631 (0.0006) [2023-12-27 21:50:31,075][106226] Updated weights for policy 0, policy_version 363641 (0.0009) [2023-12-27 21:50:31,127][106226] Updated weights for policy 0, policy_version 363651 (0.0009) [2023-12-27 21:50:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 186433536. Throughput: 0: 10094.9, 1: 10200.9. Samples: 186420288. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:31,175][105115] Avg episode reward: [(0, '-4.867'), (1, '-5.673')] [2023-12-27 21:50:31,329][106225] Updated weights for policy 1, policy_version 364378 (0.0011) [2023-12-27 21:50:31,391][106225] Updated weights for policy 1, policy_version 364388 (0.0008) [2023-12-27 21:50:31,446][106225] Updated weights for policy 1, policy_version 364398 (0.0006) [2023-12-27 21:50:31,880][106226] Updated weights for policy 0, policy_version 363661 (0.0008) [2023-12-27 21:50:31,943][106226] Updated weights for policy 0, policy_version 363671 (0.0010) [2023-12-27 21:50:31,993][106226] Updated weights for policy 0, policy_version 363681 (0.0010) [2023-12-27 21:50:32,155][106225] Updated weights for policy 1, policy_version 364408 (0.0006) [2023-12-27 21:50:32,213][106225] Updated weights for policy 1, policy_version 364418 (0.0010) [2023-12-27 21:50:32,274][106225] Updated weights for policy 1, policy_version 364428 (0.0007) [2023-12-27 21:50:32,652][106226] Updated weights for policy 0, policy_version 363691 (0.0009) [2023-12-27 21:50:32,715][106226] Updated weights for policy 0, policy_version 363701 (0.0010) [2023-12-27 21:50:32,765][106226] Updated weights for policy 0, policy_version 363711 (0.0008) [2023-12-27 21:50:32,877][106225] Updated weights for policy 1, policy_version 364438 (0.0010) [2023-12-27 21:50:32,934][106225] Updated weights for policy 1, policy_version 364448 (0.0010) [2023-12-27 21:50:32,995][106225] Updated weights for policy 1, policy_version 364458 (0.0010) [2023-12-27 21:50:33,564][106226] Updated weights for policy 0, policy_version 363721 (0.0009) [2023-12-27 21:50:33,571][106225] Updated weights for policy 1, policy_version 364468 (0.0008) [2023-12-27 21:50:33,626][106225] Updated weights for policy 1, policy_version 364478 (0.0005) [2023-12-27 21:50:33,628][106226] Updated weights for policy 0, policy_version 363731 (0.0008) [2023-12-27 21:50:33,677][106226] Updated weights for policy 0, policy_version 363741 (0.0008) [2023-12-27 21:50:33,679][106225] Updated weights for policy 1, policy_version 364488 (0.0005) [2023-12-27 21:50:33,725][106226] Updated weights for policy 0, policy_version 363751 (0.0008) [2023-12-27 21:50:34,300][106225] Updated weights for policy 1, policy_version 364498 (0.0006) [2023-12-27 21:50:34,362][106225] Updated weights for policy 1, policy_version 364508 (0.0007) [2023-12-27 21:50:34,424][106225] Updated weights for policy 1, policy_version 364518 (0.0011) [2023-12-27 21:50:34,478][106225] Updated weights for policy 1, policy_version 364528 (0.0010) [2023-12-27 21:50:34,493][106226] Updated weights for policy 0, policy_version 363761 (0.0007) [2023-12-27 21:50:34,553][106226] Updated weights for policy 0, policy_version 363771 (0.0007) [2023-12-27 21:50:34,625][106226] Updated weights for policy 0, policy_version 363781 (0.0006) [2023-12-27 21:50:35,100][106225] Updated weights for policy 1, policy_version 364538 (0.0008) [2023-12-27 21:50:35,165][106225] Updated weights for policy 1, policy_version 364548 (0.0006) [2023-12-27 21:50:35,221][106225] Updated weights for policy 1, policy_version 364558 (0.0005) [2023-12-27 21:50:35,323][106226] Updated weights for policy 0, policy_version 363791 (0.0005) [2023-12-27 21:50:35,392][106226] Updated weights for policy 0, policy_version 363801 (0.0006) [2023-12-27 21:50:35,448][106226] Updated weights for policy 0, policy_version 363811 (0.0005) [2023-12-27 21:50:35,884][106225] Updated weights for policy 1, policy_version 364568 (0.0007) [2023-12-27 21:50:35,940][106225] Updated weights for policy 1, policy_version 364578 (0.0008) [2023-12-27 21:50:35,994][106225] Updated weights for policy 1, policy_version 364588 (0.0009) [2023-12-27 21:50:36,006][106226] Updated weights for policy 0, policy_version 363821 (0.0005) [2023-12-27 21:50:36,065][106226] Updated weights for policy 0, policy_version 363831 (0.0006) [2023-12-27 21:50:36,133][106226] Updated weights for policy 0, policy_version 363841 (0.0008) [2023-12-27 21:50:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 186531840. Throughput: 0: 10027.0, 1: 10188.6. Samples: 186543572. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:36,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-5.905')] [2023-12-27 21:50:36,676][106225] Updated weights for policy 1, policy_version 364598 (0.0009) [2023-12-27 21:50:36,740][106225] Updated weights for policy 1, policy_version 364608 (0.0008) [2023-12-27 21:50:36,799][106225] Updated weights for policy 1, policy_version 364618 (0.0009) [2023-12-27 21:50:36,809][106226] Updated weights for policy 0, policy_version 363851 (0.0007) [2023-12-27 21:50:36,869][106226] Updated weights for policy 0, policy_version 363861 (0.0007) [2023-12-27 21:50:36,926][106226] Updated weights for policy 0, policy_version 363871 (0.0008) [2023-12-27 21:50:37,524][106226] Updated weights for policy 0, policy_version 363881 (0.0008) [2023-12-27 21:50:37,587][106226] Updated weights for policy 0, policy_version 363891 (0.0005) [2023-12-27 21:50:37,597][106225] Updated weights for policy 1, policy_version 364628 (0.0007) [2023-12-27 21:50:37,644][106226] Updated weights for policy 0, policy_version 363901 (0.0006) [2023-12-27 21:50:37,656][106225] Updated weights for policy 1, policy_version 364638 (0.0009) [2023-12-27 21:50:37,703][106226] Updated weights for policy 0, policy_version 363911 (0.0006) [2023-12-27 21:50:37,713][106225] Updated weights for policy 1, policy_version 364648 (0.0007) [2023-12-27 21:50:38,348][106225] Updated weights for policy 1, policy_version 364658 (0.0009) [2023-12-27 21:50:38,410][106225] Updated weights for policy 1, policy_version 364668 (0.0007) [2023-12-27 21:50:38,443][106226] Updated weights for policy 0, policy_version 363921 (0.0008) [2023-12-27 21:50:38,477][106225] Updated weights for policy 1, policy_version 364678 (0.0006) [2023-12-27 21:50:38,502][106226] Updated weights for policy 0, policy_version 363931 (0.0008) [2023-12-27 21:50:38,540][106225] Updated weights for policy 1, policy_version 364688 (0.0006) [2023-12-27 21:50:38,562][106226] Updated weights for policy 0, policy_version 363941 (0.0008) [2023-12-27 21:50:39,269][106225] Updated weights for policy 1, policy_version 364698 (0.0009) [2023-12-27 21:50:39,304][106226] Updated weights for policy 0, policy_version 363951 (0.0009) [2023-12-27 21:50:39,336][106225] Updated weights for policy 1, policy_version 364708 (0.0007) [2023-12-27 21:50:39,369][106226] Updated weights for policy 0, policy_version 363961 (0.0008) [2023-12-27 21:50:39,396][106225] Updated weights for policy 1, policy_version 364718 (0.0007) [2023-12-27 21:50:39,433][106226] Updated weights for policy 0, policy_version 363971 (0.0008) [2023-12-27 21:50:40,103][106225] Updated weights for policy 1, policy_version 364728 (0.0008) [2023-12-27 21:50:40,157][106225] Updated weights for policy 1, policy_version 364738 (0.0007) [2023-12-27 21:50:40,213][106225] Updated weights for policy 1, policy_version 364748 (0.0006) [2023-12-27 21:50:40,230][106226] Updated weights for policy 0, policy_version 363981 (0.0008) [2023-12-27 21:50:40,287][106226] Updated weights for policy 0, policy_version 363991 (0.0005) [2023-12-27 21:50:40,346][106226] Updated weights for policy 0, policy_version 364001 (0.0006) [2023-12-27 21:50:40,938][106225] Updated weights for policy 1, policy_version 364758 (0.0008) [2023-12-27 21:50:41,008][106225] Updated weights for policy 1, policy_version 364768 (0.0006) [2023-12-27 21:50:41,010][106226] Updated weights for policy 0, policy_version 364011 (0.0005) [2023-12-27 21:50:41,077][106225] Updated weights for policy 1, policy_version 364778 (0.0008) [2023-12-27 21:50:41,090][106226] Updated weights for policy 0, policy_version 364021 (0.0009) [2023-12-27 21:50:41,157][106226] Updated weights for policy 0, policy_version 364031 (0.0009) [2023-12-27 21:50:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 186630144. Throughput: 0: 10086.8, 1: 10167.8. Samples: 186602300. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:41,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-6.065')] [2023-12-27 21:50:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000364784_93413376.pth... [2023-12-27 21:50:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000363600_93110272.pth [2023-12-27 21:50:41,222][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000364040_93224960.pth... [2023-12-27 21:50:41,225][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000362824_92913664.pth [2023-12-27 21:50:41,749][106225] Updated weights for policy 1, policy_version 364788 (0.0008) [2023-12-27 21:50:41,807][106225] Updated weights for policy 1, policy_version 364798 (0.0009) [2023-12-27 21:50:41,870][106225] Updated weights for policy 1, policy_version 364808 (0.0009) [2023-12-27 21:50:41,905][106226] Updated weights for policy 0, policy_version 364041 (0.0008) [2023-12-27 21:50:41,979][106226] Updated weights for policy 0, policy_version 364051 (0.0007) [2023-12-27 21:50:42,042][106226] Updated weights for policy 0, policy_version 364061 (0.0008) [2023-12-27 21:50:42,104][106226] Updated weights for policy 0, policy_version 364071 (0.0008) [2023-12-27 21:50:42,648][106225] Updated weights for policy 1, policy_version 364818 (0.0009) [2023-12-27 21:50:42,705][106225] Updated weights for policy 1, policy_version 364828 (0.0008) [2023-12-27 21:50:42,764][106225] Updated weights for policy 1, policy_version 364838 (0.0008) [2023-12-27 21:50:42,826][106226] Updated weights for policy 0, policy_version 364081 (0.0007) [2023-12-27 21:50:42,828][106225] Updated weights for policy 1, policy_version 364848 (0.0006) [2023-12-27 21:50:42,895][106226] Updated weights for policy 0, policy_version 364091 (0.0006) [2023-12-27 21:50:42,960][106226] Updated weights for policy 0, policy_version 364101 (0.0005) [2023-12-27 21:50:43,535][106225] Updated weights for policy 1, policy_version 364858 (0.0010) [2023-12-27 21:50:43,583][106225] Updated weights for policy 1, policy_version 364868 (0.0010) [2023-12-27 21:50:43,626][106226] Updated weights for policy 0, policy_version 364111 (0.0006) [2023-12-27 21:50:43,639][106225] Updated weights for policy 1, policy_version 364878 (0.0010) [2023-12-27 21:50:43,681][106226] Updated weights for policy 0, policy_version 364121 (0.0006) [2023-12-27 21:50:43,731][106226] Updated weights for policy 0, policy_version 364131 (0.0008) [2023-12-27 21:50:44,384][106225] Updated weights for policy 1, policy_version 364888 (0.0010) [2023-12-27 21:50:44,449][106225] Updated weights for policy 1, policy_version 364898 (0.0010) [2023-12-27 21:50:44,474][106226] Updated weights for policy 0, policy_version 364141 (0.0008) [2023-12-27 21:50:44,510][106225] Updated weights for policy 1, policy_version 364908 (0.0010) [2023-12-27 21:50:44,535][106226] Updated weights for policy 0, policy_version 364151 (0.0006) [2023-12-27 21:50:44,597][106226] Updated weights for policy 0, policy_version 364161 (0.0008) [2023-12-27 21:50:45,259][106225] Updated weights for policy 1, policy_version 364918 (0.0010) [2023-12-27 21:50:45,320][106225] Updated weights for policy 1, policy_version 364928 (0.0011) [2023-12-27 21:50:45,344][106226] Updated weights for policy 0, policy_version 364171 (0.0007) [2023-12-27 21:50:45,382][106225] Updated weights for policy 1, policy_version 364938 (0.0010) [2023-12-27 21:50:45,399][106226] Updated weights for policy 0, policy_version 364181 (0.0010) [2023-12-27 21:50:45,458][106226] Updated weights for policy 0, policy_version 364191 (0.0007) [2023-12-27 21:50:46,062][106226] Updated weights for policy 0, policy_version 364201 (0.0010) [2023-12-27 21:50:46,092][106225] Updated weights for policy 1, policy_version 364948 (0.0010) [2023-12-27 21:50:46,126][106226] Updated weights for policy 0, policy_version 364211 (0.0005) [2023-12-27 21:50:46,145][106225] Updated weights for policy 1, policy_version 364958 (0.0010) [2023-12-27 21:50:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 186720256. Throughput: 0: 10042.5, 1: 10012.5. Samples: 186715248. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:46,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-5.562')] [2023-12-27 21:50:46,181][106226] Updated weights for policy 0, policy_version 364221 (0.0006) [2023-12-27 21:50:46,195][106225] Updated weights for policy 1, policy_version 364968 (0.0010) [2023-12-27 21:50:46,238][106226] Updated weights for policy 0, policy_version 364231 (0.0005) [2023-12-27 21:50:46,818][106226] Updated weights for policy 0, policy_version 364241 (0.0005) [2023-12-27 21:50:46,867][106226] Updated weights for policy 0, policy_version 364251 (0.0005) [2023-12-27 21:50:46,918][106225] Updated weights for policy 1, policy_version 364978 (0.0009) [2023-12-27 21:50:46,929][106226] Updated weights for policy 0, policy_version 364261 (0.0005) [2023-12-27 21:50:46,969][106225] Updated weights for policy 1, policy_version 364988 (0.0005) [2023-12-27 21:50:47,031][106225] Updated weights for policy 1, policy_version 364998 (0.0005) [2023-12-27 21:50:47,091][106225] Updated weights for policy 1, policy_version 365008 (0.0009) [2023-12-27 21:50:47,480][106226] Updated weights for policy 0, policy_version 364271 (0.0007) [2023-12-27 21:50:47,530][106226] Updated weights for policy 0, policy_version 364281 (0.0007) [2023-12-27 21:50:47,584][106226] Updated weights for policy 0, policy_version 364291 (0.0008) [2023-12-27 21:50:47,769][106225] Updated weights for policy 1, policy_version 365018 (0.0011) [2023-12-27 21:50:47,829][106225] Updated weights for policy 1, policy_version 365028 (0.0010) [2023-12-27 21:50:47,879][106225] Updated weights for policy 1, policy_version 365038 (0.0010) [2023-12-27 21:50:48,307][106226] Updated weights for policy 0, policy_version 364301 (0.0010) [2023-12-27 21:50:48,370][106226] Updated weights for policy 0, policy_version 364311 (0.0013) [2023-12-27 21:50:48,430][106226] Updated weights for policy 0, policy_version 364321 (0.0008) [2023-12-27 21:50:48,558][106225] Updated weights for policy 1, policy_version 365048 (0.0010) [2023-12-27 21:50:48,621][106225] Updated weights for policy 1, policy_version 365058 (0.0010) [2023-12-27 21:50:48,679][106225] Updated weights for policy 1, policy_version 365068 (0.0010) [2023-12-27 21:50:49,170][106226] Updated weights for policy 0, policy_version 364331 (0.0008) [2023-12-27 21:50:49,240][106226] Updated weights for policy 0, policy_version 364341 (0.0007) [2023-12-27 21:50:49,299][106226] Updated weights for policy 0, policy_version 364351 (0.0006) [2023-12-27 21:50:49,424][106225] Updated weights for policy 1, policy_version 365078 (0.0010) [2023-12-27 21:50:49,478][106225] Updated weights for policy 1, policy_version 365088 (0.0010) [2023-12-27 21:50:49,529][106225] Updated weights for policy 1, policy_version 365098 (0.0010) [2023-12-27 21:50:50,036][106226] Updated weights for policy 0, policy_version 364361 (0.0008) [2023-12-27 21:50:50,089][106226] Updated weights for policy 0, policy_version 364371 (0.0007) [2023-12-27 21:50:50,155][106226] Updated weights for policy 0, policy_version 364381 (0.0008) [2023-12-27 21:50:50,221][106226] Updated weights for policy 0, policy_version 364391 (0.0008) [2023-12-27 21:50:50,284][106225] Updated weights for policy 1, policy_version 365108 (0.0010) [2023-12-27 21:50:50,338][106225] Updated weights for policy 1, policy_version 365118 (0.0010) [2023-12-27 21:50:50,392][106225] Updated weights for policy 1, policy_version 365128 (0.0010) [2023-12-27 21:50:50,968][106226] Updated weights for policy 0, policy_version 364401 (0.0011) [2023-12-27 21:50:51,033][106226] Updated weights for policy 0, policy_version 364411 (0.0010) [2023-12-27 21:50:51,052][106225] Updated weights for policy 1, policy_version 365138 (0.0009) [2023-12-27 21:50:51,100][106226] Updated weights for policy 0, policy_version 364421 (0.0008) [2023-12-27 21:50:51,109][106225] Updated weights for policy 1, policy_version 365148 (0.0008) [2023-12-27 21:50:51,171][106225] Updated weights for policy 1, policy_version 365158 (0.0008) [2023-12-27 21:50:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 186826752. Throughput: 0: 10082.3, 1: 9995.9. Samples: 186835416. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:51,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.748')] [2023-12-27 21:50:51,221][106225] Updated weights for policy 1, policy_version 365168 (0.0007) [2023-12-27 21:50:51,863][106226] Updated weights for policy 0, policy_version 364431 (0.0008) [2023-12-27 21:50:51,920][106226] Updated weights for policy 0, policy_version 364441 (0.0007) [2023-12-27 21:50:51,934][106225] Updated weights for policy 1, policy_version 365178 (0.0007) [2023-12-27 21:50:51,973][106226] Updated weights for policy 0, policy_version 364451 (0.0006) [2023-12-27 21:50:51,987][106225] Updated weights for policy 1, policy_version 365188 (0.0007) [2023-12-27 21:50:52,038][106225] Updated weights for policy 1, policy_version 365198 (0.0007) [2023-12-27 21:50:52,728][106226] Updated weights for policy 0, policy_version 364461 (0.0008) [2023-12-27 21:50:52,782][106226] Updated weights for policy 0, policy_version 364471 (0.0008) [2023-12-27 21:50:52,805][106225] Updated weights for policy 1, policy_version 365208 (0.0007) [2023-12-27 21:50:52,831][106226] Updated weights for policy 0, policy_version 364481 (0.0008) [2023-12-27 21:50:52,862][106225] Updated weights for policy 1, policy_version 365218 (0.0009) [2023-12-27 21:50:52,920][106225] Updated weights for policy 1, policy_version 365228 (0.0009) [2023-12-27 21:50:53,487][106225] Updated weights for policy 1, policy_version 365238 (0.0009) [2023-12-27 21:50:53,506][106226] Updated weights for policy 0, policy_version 364491 (0.0007) [2023-12-27 21:50:53,544][106225] Updated weights for policy 1, policy_version 365248 (0.0008) [2023-12-27 21:50:53,575][106226] Updated weights for policy 0, policy_version 364501 (0.0007) [2023-12-27 21:50:53,602][106225] Updated weights for policy 1, policy_version 365258 (0.0007) [2023-12-27 21:50:53,635][106226] Updated weights for policy 0, policy_version 364511 (0.0007) [2023-12-27 21:50:54,289][106226] Updated weights for policy 0, policy_version 364521 (0.0006) [2023-12-27 21:50:54,344][106226] Updated weights for policy 0, policy_version 364531 (0.0008) [2023-12-27 21:50:54,374][106225] Updated weights for policy 1, policy_version 365268 (0.0009) [2023-12-27 21:50:54,396][106226] Updated weights for policy 0, policy_version 364541 (0.0007) [2023-12-27 21:50:54,434][106225] Updated weights for policy 1, policy_version 365278 (0.0011) [2023-12-27 21:50:54,448][106226] Updated weights for policy 0, policy_version 364551 (0.0006) [2023-12-27 21:50:54,491][106225] Updated weights for policy 1, policy_version 365288 (0.0010) [2023-12-27 21:50:55,081][106226] Updated weights for policy 0, policy_version 364561 (0.0006) [2023-12-27 21:50:55,143][106226] Updated weights for policy 0, policy_version 364571 (0.0005) [2023-12-27 21:50:55,197][106226] Updated weights for policy 0, policy_version 364581 (0.0005) [2023-12-27 21:50:55,198][106225] Updated weights for policy 1, policy_version 365298 (0.0010) [2023-12-27 21:50:55,259][106225] Updated weights for policy 1, policy_version 365308 (0.0010) [2023-12-27 21:50:55,319][106225] Updated weights for policy 1, policy_version 365318 (0.0010) [2023-12-27 21:50:55,363][106225] Updated weights for policy 1, policy_version 365328 (0.0010) [2023-12-27 21:50:55,801][106226] Updated weights for policy 0, policy_version 364591 (0.0009) [2023-12-27 21:50:55,867][106226] Updated weights for policy 0, policy_version 364601 (0.0011) [2023-12-27 21:50:55,927][106226] Updated weights for policy 0, policy_version 364611 (0.0011) [2023-12-27 21:50:56,087][106225] Updated weights for policy 1, policy_version 365338 (0.0007) [2023-12-27 21:50:56,150][106225] Updated weights for policy 1, policy_version 365348 (0.0008) [2023-12-27 21:50:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 186925056. Throughput: 0: 10066.5, 1: 10004.0. Samples: 186895492. Policy #0 lag: (min: 18.0, avg: 24.8, max: 50.0) [2023-12-27 21:50:56,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.769')] [2023-12-27 21:50:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000364616_93372416.pth... [2023-12-27 21:50:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000363432_93069312.pth [2023-12-27 21:50:56,208][106225] Updated weights for policy 1, policy_version 365358 (0.0008) [2023-12-27 21:50:56,215][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000365360_93560832.pth... [2023-12-27 21:50:56,219][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000364176_93257728.pth [2023-12-27 21:50:56,626][106226] Updated weights for policy 0, policy_version 364621 (0.0010) [2023-12-27 21:50:56,686][106226] Updated weights for policy 0, policy_version 364631 (0.0011) [2023-12-27 21:50:56,743][106226] Updated weights for policy 0, policy_version 364641 (0.0011) [2023-12-27 21:50:56,937][106225] Updated weights for policy 1, policy_version 365368 (0.0008) [2023-12-27 21:50:56,983][106225] Updated weights for policy 1, policy_version 365378 (0.0007) [2023-12-27 21:50:57,029][106225] Updated weights for policy 1, policy_version 365388 (0.0008) [2023-12-27 21:50:57,451][106226] Updated weights for policy 0, policy_version 364651 (0.0011) [2023-12-27 21:50:57,506][106226] Updated weights for policy 0, policy_version 364661 (0.0010) [2023-12-27 21:50:57,562][106226] Updated weights for policy 0, policy_version 364671 (0.0010) [2023-12-27 21:50:57,775][106225] Updated weights for policy 1, policy_version 365398 (0.0008) [2023-12-27 21:50:57,821][106225] Updated weights for policy 1, policy_version 365408 (0.0007) [2023-12-27 21:50:57,869][106225] Updated weights for policy 1, policy_version 365418 (0.0008) [2023-12-27 21:50:58,269][106226] Updated weights for policy 0, policy_version 364681 (0.0010) [2023-12-27 21:50:58,330][106226] Updated weights for policy 0, policy_version 364691 (0.0011) [2023-12-27 21:50:58,402][106226] Updated weights for policy 0, policy_version 364701 (0.0011) [2023-12-27 21:50:58,472][106226] Updated weights for policy 0, policy_version 364711 (0.0009) [2023-12-27 21:50:58,680][106225] Updated weights for policy 1, policy_version 365428 (0.0007) [2023-12-27 21:50:58,743][106225] Updated weights for policy 1, policy_version 365438 (0.0008) [2023-12-27 21:50:58,802][106225] Updated weights for policy 1, policy_version 365448 (0.0008) [2023-12-27 21:50:59,241][106226] Updated weights for policy 0, policy_version 364721 (0.0010) [2023-12-27 21:50:59,309][106226] Updated weights for policy 0, policy_version 364731 (0.0010) [2023-12-27 21:50:59,377][106226] Updated weights for policy 0, policy_version 364741 (0.0010) [2023-12-27 21:50:59,682][106225] Updated weights for policy 1, policy_version 365458 (0.0009) [2023-12-27 21:50:59,748][106225] Updated weights for policy 1, policy_version 365468 (0.0010) [2023-12-27 21:50:59,812][106225] Updated weights for policy 1, policy_version 365478 (0.0008) [2023-12-27 21:50:59,874][106225] Updated weights for policy 1, policy_version 365488 (0.0008) [2023-12-27 21:51:00,099][106226] Updated weights for policy 0, policy_version 364751 (0.0010) [2023-12-27 21:51:00,160][106226] Updated weights for policy 0, policy_version 364761 (0.0010) [2023-12-27 21:51:00,223][106226] Updated weights for policy 0, policy_version 364771 (0.0010) [2023-12-27 21:51:00,614][106225] Updated weights for policy 1, policy_version 365498 (0.0007) [2023-12-27 21:51:00,664][106225] Updated weights for policy 1, policy_version 365508 (0.0007) [2023-12-27 21:51:00,714][106225] Updated weights for policy 1, policy_version 365518 (0.0007) [2023-12-27 21:51:00,935][106226] Updated weights for policy 0, policy_version 364781 (0.0011) [2023-12-27 21:51:00,991][106226] Updated weights for policy 0, policy_version 364791 (0.0010) [2023-12-27 21:51:01,050][106226] Updated weights for policy 0, policy_version 364801 (0.0011) [2023-12-27 21:51:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 187023360. Throughput: 0: 10045.3, 1: 9959.6. Samples: 187010204. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:01,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-5.620')] [2023-12-27 21:51:01,483][106225] Updated weights for policy 1, policy_version 365528 (0.0006) [2023-12-27 21:51:01,545][106225] Updated weights for policy 1, policy_version 365538 (0.0005) [2023-12-27 21:51:01,597][106225] Updated weights for policy 1, policy_version 365548 (0.0009) [2023-12-27 21:51:01,771][106226] Updated weights for policy 0, policy_version 364811 (0.0010) [2023-12-27 21:51:01,829][106226] Updated weights for policy 0, policy_version 364821 (0.0008) [2023-12-27 21:51:01,880][106226] Updated weights for policy 0, policy_version 364831 (0.0008) [2023-12-27 21:51:02,274][106225] Updated weights for policy 1, policy_version 365558 (0.0008) [2023-12-27 21:51:02,333][106225] Updated weights for policy 1, policy_version 365568 (0.0008) [2023-12-27 21:51:02,400][106225] Updated weights for policy 1, policy_version 365578 (0.0009) [2023-12-27 21:51:02,595][106226] Updated weights for policy 0, policy_version 364841 (0.0009) [2023-12-27 21:51:02,651][106226] Updated weights for policy 0, policy_version 364851 (0.0009) [2023-12-27 21:51:02,708][106226] Updated weights for policy 0, policy_version 364861 (0.0007) [2023-12-27 21:51:02,773][106226] Updated weights for policy 0, policy_version 364871 (0.0006) [2023-12-27 21:51:03,129][106225] Updated weights for policy 1, policy_version 365588 (0.0008) [2023-12-27 21:51:03,180][106225] Updated weights for policy 1, policy_version 365598 (0.0007) [2023-12-27 21:51:03,244][106225] Updated weights for policy 1, policy_version 365608 (0.0007) [2023-12-27 21:51:03,431][106226] Updated weights for policy 0, policy_version 364881 (0.0010) [2023-12-27 21:51:03,491][106226] Updated weights for policy 0, policy_version 364891 (0.0010) [2023-12-27 21:51:03,554][106226] Updated weights for policy 0, policy_version 364901 (0.0011) [2023-12-27 21:51:04,028][106225] Updated weights for policy 1, policy_version 365618 (0.0008) [2023-12-27 21:51:04,085][106225] Updated weights for policy 1, policy_version 365628 (0.0008) [2023-12-27 21:51:04,143][106225] Updated weights for policy 1, policy_version 365638 (0.0007) [2023-12-27 21:51:04,195][106226] Updated weights for policy 0, policy_version 364911 (0.0009) [2023-12-27 21:51:04,206][106225] Updated weights for policy 1, policy_version 365648 (0.0007) [2023-12-27 21:51:04,258][106226] Updated weights for policy 0, policy_version 364921 (0.0011) [2023-12-27 21:51:04,318][106226] Updated weights for policy 0, policy_version 364931 (0.0008) [2023-12-27 21:51:04,958][106225] Updated weights for policy 1, policy_version 365658 (0.0008) [2023-12-27 21:51:05,018][106225] Updated weights for policy 1, policy_version 365668 (0.0008) [2023-12-27 21:51:05,027][106226] Updated weights for policy 0, policy_version 364941 (0.0010) [2023-12-27 21:51:05,067][106225] Updated weights for policy 1, policy_version 365678 (0.0006) [2023-12-27 21:51:05,081][106226] Updated weights for policy 0, policy_version 364951 (0.0006) [2023-12-27 21:51:05,137][106226] Updated weights for policy 0, policy_version 364961 (0.0009) [2023-12-27 21:51:05,798][106225] Updated weights for policy 1, policy_version 365688 (0.0010) [2023-12-27 21:51:05,850][106225] Updated weights for policy 1, policy_version 365698 (0.0010) [2023-12-27 21:51:05,886][106226] Updated weights for policy 0, policy_version 364971 (0.0008) [2023-12-27 21:51:05,907][106225] Updated weights for policy 1, policy_version 365708 (0.0010) [2023-12-27 21:51:05,941][106226] Updated weights for policy 0, policy_version 364981 (0.0006) [2023-12-27 21:51:05,992][106226] Updated weights for policy 0, policy_version 364991 (0.0008) [2023-12-27 21:51:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 187121664. Throughput: 0: 9956.0, 1: 9919.8. Samples: 187126044. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:06,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.605')] [2023-12-27 21:51:06,619][106225] Updated weights for policy 1, policy_version 365718 (0.0010) [2023-12-27 21:51:06,677][106225] Updated weights for policy 1, policy_version 365728 (0.0011) [2023-12-27 21:51:06,731][106225] Updated weights for policy 1, policy_version 365738 (0.0010) [2023-12-27 21:51:06,749][106226] Updated weights for policy 0, policy_version 365001 (0.0007) [2023-12-27 21:51:06,809][106226] Updated weights for policy 0, policy_version 365011 (0.0011) [2023-12-27 21:51:06,873][106226] Updated weights for policy 0, policy_version 365021 (0.0011) [2023-12-27 21:51:06,933][106226] Updated weights for policy 0, policy_version 365031 (0.0011) [2023-12-27 21:51:07,435][106225] Updated weights for policy 1, policy_version 365748 (0.0009) [2023-12-27 21:51:07,486][106225] Updated weights for policy 1, policy_version 365758 (0.0008) [2023-12-27 21:51:07,533][106225] Updated weights for policy 1, policy_version 365768 (0.0007) [2023-12-27 21:51:07,667][106226] Updated weights for policy 0, policy_version 365041 (0.0010) [2023-12-27 21:51:07,716][106226] Updated weights for policy 0, policy_version 365051 (0.0010) [2023-12-27 21:51:07,762][106226] Updated weights for policy 0, policy_version 365061 (0.0010) [2023-12-27 21:51:08,256][106225] Updated weights for policy 1, policy_version 365778 (0.0007) [2023-12-27 21:51:08,316][106225] Updated weights for policy 1, policy_version 365788 (0.0005) [2023-12-27 21:51:08,399][106225] Updated weights for policy 1, policy_version 365798 (0.0007) [2023-12-27 21:51:08,464][106225] Updated weights for policy 1, policy_version 365808 (0.0007) [2023-12-27 21:51:08,475][106226] Updated weights for policy 0, policy_version 365071 (0.0008) [2023-12-27 21:51:08,536][106226] Updated weights for policy 0, policy_version 365081 (0.0009) [2023-12-27 21:51:08,596][106226] Updated weights for policy 0, policy_version 365091 (0.0009) [2023-12-27 21:51:09,102][106225] Updated weights for policy 1, policy_version 365818 (0.0008) [2023-12-27 21:51:09,163][106225] Updated weights for policy 1, policy_version 365828 (0.0009) [2023-12-27 21:51:09,226][106225] Updated weights for policy 1, policy_version 365838 (0.0008) [2023-12-27 21:51:09,394][106226] Updated weights for policy 0, policy_version 365101 (0.0009) [2023-12-27 21:51:09,465][106226] Updated weights for policy 0, policy_version 365111 (0.0009) [2023-12-27 21:51:09,530][106226] Updated weights for policy 0, policy_version 365121 (0.0009) [2023-12-27 21:51:10,043][106225] Updated weights for policy 1, policy_version 365848 (0.0009) [2023-12-27 21:51:10,111][106225] Updated weights for policy 1, policy_version 365858 (0.0009) [2023-12-27 21:51:10,177][106225] Updated weights for policy 1, policy_version 365868 (0.0009) [2023-12-27 21:51:10,310][106226] Updated weights for policy 0, policy_version 365131 (0.0009) [2023-12-27 21:51:10,373][106226] Updated weights for policy 0, policy_version 365141 (0.0009) [2023-12-27 21:51:10,438][106226] Updated weights for policy 0, policy_version 365151 (0.0008) [2023-12-27 21:51:10,860][106225] Updated weights for policy 1, policy_version 365878 (0.0008) [2023-12-27 21:51:10,916][106225] Updated weights for policy 1, policy_version 365888 (0.0009) [2023-12-27 21:51:10,967][106225] Updated weights for policy 1, policy_version 365898 (0.0008) [2023-12-27 21:51:11,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 187211776. Throughput: 0: 9937.1, 1: 9926.6. Samples: 187184216. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:11,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.335')] [2023-12-27 21:51:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000365904_93700096.pth... [2023-12-27 21:51:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000365160_93511680.pth... [2023-12-27 21:51:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000364040_93224960.pth [2023-12-27 21:51:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000364784_93413376.pth [2023-12-27 21:51:11,206][106226] Updated weights for policy 0, policy_version 365161 (0.0009) [2023-12-27 21:51:11,270][106226] Updated weights for policy 0, policy_version 365171 (0.0008) [2023-12-27 21:51:11,338][106226] Updated weights for policy 0, policy_version 365181 (0.0009) [2023-12-27 21:51:11,411][106226] Updated weights for policy 0, policy_version 365191 (0.0009) [2023-12-27 21:51:11,763][106225] Updated weights for policy 1, policy_version 365908 (0.0009) [2023-12-27 21:51:11,832][106225] Updated weights for policy 1, policy_version 365918 (0.0009) [2023-12-27 21:51:11,895][106225] Updated weights for policy 1, policy_version 365928 (0.0009) [2023-12-27 21:51:12,168][106226] Updated weights for policy 0, policy_version 365201 (0.0009) [2023-12-27 21:51:12,230][106226] Updated weights for policy 0, policy_version 365211 (0.0009) [2023-12-27 21:51:12,299][106226] Updated weights for policy 0, policy_version 365221 (0.0009) [2023-12-27 21:51:12,667][106225] Updated weights for policy 1, policy_version 365938 (0.0008) [2023-12-27 21:51:12,722][106225] Updated weights for policy 1, policy_version 365948 (0.0009) [2023-12-27 21:51:12,785][106225] Updated weights for policy 1, policy_version 365958 (0.0008) [2023-12-27 21:51:12,843][106225] Updated weights for policy 1, policy_version 365968 (0.0008) [2023-12-27 21:51:12,975][106226] Updated weights for policy 0, policy_version 365231 (0.0008) [2023-12-27 21:51:13,033][106226] Updated weights for policy 0, policy_version 365241 (0.0008) [2023-12-27 21:51:13,090][106226] Updated weights for policy 0, policy_version 365251 (0.0008) [2023-12-27 21:51:13,457][106225] Updated weights for policy 1, policy_version 365978 (0.0005) [2023-12-27 21:51:13,517][106225] Updated weights for policy 1, policy_version 365988 (0.0006) [2023-12-27 21:51:13,569][106225] Updated weights for policy 1, policy_version 365998 (0.0008) [2023-12-27 21:51:13,854][106226] Updated weights for policy 0, policy_version 365261 (0.0008) [2023-12-27 21:51:13,913][106226] Updated weights for policy 0, policy_version 365271 (0.0009) [2023-12-27 21:51:13,961][106226] Updated weights for policy 0, policy_version 365281 (0.0008) [2023-12-27 21:51:14,253][106225] Updated weights for policy 1, policy_version 366008 (0.0009) [2023-12-27 21:51:14,311][106225] Updated weights for policy 1, policy_version 366018 (0.0008) [2023-12-27 21:51:14,366][106225] Updated weights for policy 1, policy_version 366028 (0.0008) [2023-12-27 21:51:14,703][106226] Updated weights for policy 0, policy_version 365291 (0.0008) [2023-12-27 21:51:14,756][106226] Updated weights for policy 0, policy_version 365301 (0.0009) [2023-12-27 21:51:14,832][106226] Updated weights for policy 0, policy_version 365311 (0.0008) [2023-12-27 21:51:15,120][106225] Updated weights for policy 1, policy_version 366038 (0.0008) [2023-12-27 21:51:15,185][106225] Updated weights for policy 1, policy_version 366048 (0.0008) [2023-12-27 21:51:15,236][106225] Updated weights for policy 1, policy_version 366058 (0.0008) [2023-12-27 21:51:15,558][106226] Updated weights for policy 0, policy_version 365321 (0.0006) [2023-12-27 21:51:15,618][106226] Updated weights for policy 0, policy_version 365331 (0.0010) [2023-12-27 21:51:15,680][106226] Updated weights for policy 0, policy_version 365341 (0.0010) [2023-12-27 21:51:15,734][106226] Updated weights for policy 0, policy_version 365351 (0.0006) [2023-12-27 21:51:16,018][106225] Updated weights for policy 1, policy_version 366068 (0.0008) [2023-12-27 21:51:16,077][106225] Updated weights for policy 1, policy_version 366078 (0.0007) [2023-12-27 21:51:16,136][106225] Updated weights for policy 1, policy_version 366088 (0.0007) [2023-12-27 21:51:16,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 187301888. Throughput: 0: 9731.3, 1: 9755.1. Samples: 187297180. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:16,176][105115] Avg episode reward: [(0, '-4.672'), (1, '-5.825')] [2023-12-27 21:51:16,356][106226] Updated weights for policy 0, policy_version 365361 (0.0005) [2023-12-27 21:51:16,414][106226] Updated weights for policy 0, policy_version 365371 (0.0005) [2023-12-27 21:51:16,479][106226] Updated weights for policy 0, policy_version 365381 (0.0005) [2023-12-27 21:51:16,828][106225] Updated weights for policy 1, policy_version 366098 (0.0007) [2023-12-27 21:51:16,883][106225] Updated weights for policy 1, policy_version 366108 (0.0006) [2023-12-27 21:51:16,937][106225] Updated weights for policy 1, policy_version 366118 (0.0009) [2023-12-27 21:51:16,993][106225] Updated weights for policy 1, policy_version 366128 (0.0008) [2023-12-27 21:51:17,069][106226] Updated weights for policy 0, policy_version 365391 (0.0007) [2023-12-27 21:51:17,131][106226] Updated weights for policy 0, policy_version 365401 (0.0005) [2023-12-27 21:51:17,189][106226] Updated weights for policy 0, policy_version 365411 (0.0005) [2023-12-27 21:51:17,721][106225] Updated weights for policy 1, policy_version 366138 (0.0007) [2023-12-27 21:51:17,770][106226] Updated weights for policy 0, policy_version 365421 (0.0007) [2023-12-27 21:51:17,791][106225] Updated weights for policy 1, policy_version 366148 (0.0007) [2023-12-27 21:51:17,830][106226] Updated weights for policy 0, policy_version 365431 (0.0006) [2023-12-27 21:51:17,848][106225] Updated weights for policy 1, policy_version 366158 (0.0006) [2023-12-27 21:51:17,888][106226] Updated weights for policy 0, policy_version 365441 (0.0007) [2023-12-27 21:51:18,489][106225] Updated weights for policy 1, policy_version 366168 (0.0007) [2023-12-27 21:51:18,498][106226] Updated weights for policy 0, policy_version 365451 (0.0006) [2023-12-27 21:51:18,545][106225] Updated weights for policy 1, policy_version 366178 (0.0006) [2023-12-27 21:51:18,550][106226] Updated weights for policy 0, policy_version 365461 (0.0006) [2023-12-27 21:51:18,601][106225] Updated weights for policy 1, policy_version 366188 (0.0006) [2023-12-27 21:51:18,607][106226] Updated weights for policy 0, policy_version 365471 (0.0006) [2023-12-27 21:51:19,336][106226] Updated weights for policy 0, policy_version 365481 (0.0007) [2023-12-27 21:51:19,338][106225] Updated weights for policy 1, policy_version 366198 (0.0008) [2023-12-27 21:51:19,409][106225] Updated weights for policy 1, policy_version 366208 (0.0008) [2023-12-27 21:51:19,410][106226] Updated weights for policy 0, policy_version 365491 (0.0007) [2023-12-27 21:51:19,472][106225] Updated weights for policy 1, policy_version 366218 (0.0007) [2023-12-27 21:51:19,473][106226] Updated weights for policy 0, policy_version 365501 (0.0008) [2023-12-27 21:51:19,539][106226] Updated weights for policy 0, policy_version 365511 (0.0009) [2023-12-27 21:51:20,216][106225] Updated weights for policy 1, policy_version 366228 (0.0007) [2023-12-27 21:51:20,276][106225] Updated weights for policy 1, policy_version 366238 (0.0007) [2023-12-27 21:51:20,301][106226] Updated weights for policy 0, policy_version 365521 (0.0009) [2023-12-27 21:51:20,335][106225] Updated weights for policy 1, policy_version 366248 (0.0006) [2023-12-27 21:51:20,357][106226] Updated weights for policy 0, policy_version 365531 (0.0007) [2023-12-27 21:51:20,420][106226] Updated weights for policy 0, policy_version 365541 (0.0009) [2023-12-27 21:51:21,082][106225] Updated weights for policy 1, policy_version 366258 (0.0007) [2023-12-27 21:51:21,152][106225] Updated weights for policy 1, policy_version 366268 (0.0009) [2023-12-27 21:51:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 187400192. Throughput: 0: 9776.3, 1: 9615.0. Samples: 187416180. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:21,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.882')] [2023-12-27 21:51:21,209][106226] Updated weights for policy 0, policy_version 365551 (0.0007) [2023-12-27 21:51:21,222][106225] Updated weights for policy 1, policy_version 366278 (0.0008) [2023-12-27 21:51:21,269][106226] Updated weights for policy 0, policy_version 365561 (0.0007) [2023-12-27 21:51:21,283][106225] Updated weights for policy 1, policy_version 366288 (0.0008) [2023-12-27 21:51:21,335][106226] Updated weights for policy 0, policy_version 365571 (0.0008) [2023-12-27 21:51:22,049][106226] Updated weights for policy 0, policy_version 365581 (0.0008) [2023-12-27 21:51:22,107][106225] Updated weights for policy 1, policy_version 366298 (0.0006) [2023-12-27 21:51:22,109][106226] Updated weights for policy 0, policy_version 365591 (0.0008) [2023-12-27 21:51:22,164][106226] Updated weights for policy 0, policy_version 365601 (0.0006) [2023-12-27 21:51:22,173][106225] Updated weights for policy 1, policy_version 366308 (0.0008) [2023-12-27 21:51:22,238][106225] Updated weights for policy 1, policy_version 366318 (0.0009) [2023-12-27 21:51:22,805][106226] Updated weights for policy 0, policy_version 365611 (0.0008) [2023-12-27 21:51:22,862][106226] Updated weights for policy 0, policy_version 365621 (0.0008) [2023-12-27 21:51:22,920][106226] Updated weights for policy 0, policy_version 365631 (0.0008) [2023-12-27 21:51:23,016][106225] Updated weights for policy 1, policy_version 366328 (0.0009) [2023-12-27 21:51:23,067][106225] Updated weights for policy 1, policy_version 366338 (0.0010) [2023-12-27 21:51:23,126][106225] Updated weights for policy 1, policy_version 366348 (0.0009) [2023-12-27 21:51:23,558][106226] Updated weights for policy 0, policy_version 365641 (0.0008) [2023-12-27 21:51:23,608][106226] Updated weights for policy 0, policy_version 365651 (0.0010) [2023-12-27 21:51:23,655][106226] Updated weights for policy 0, policy_version 365661 (0.0010) [2023-12-27 21:51:23,708][106226] Updated weights for policy 0, policy_version 365671 (0.0010) [2023-12-27 21:51:23,810][106225] Updated weights for policy 1, policy_version 366358 (0.0008) [2023-12-27 21:51:23,868][106225] Updated weights for policy 1, policy_version 366368 (0.0008) [2023-12-27 21:51:23,923][106225] Updated weights for policy 1, policy_version 366378 (0.0007) [2023-12-27 21:51:24,447][106226] Updated weights for policy 0, policy_version 365681 (0.0011) [2023-12-27 21:51:24,506][106226] Updated weights for policy 0, policy_version 365691 (0.0010) [2023-12-27 21:51:24,567][106226] Updated weights for policy 0, policy_version 365701 (0.0011) [2023-12-27 21:51:24,628][106225] Updated weights for policy 1, policy_version 366388 (0.0008) [2023-12-27 21:51:24,678][106225] Updated weights for policy 1, policy_version 366398 (0.0008) [2023-12-27 21:51:24,729][106225] Updated weights for policy 1, policy_version 366408 (0.0007) [2023-12-27 21:51:25,260][106226] Updated weights for policy 0, policy_version 365711 (0.0007) [2023-12-27 21:51:25,313][106226] Updated weights for policy 0, policy_version 365721 (0.0005) [2023-12-27 21:51:25,363][106226] Updated weights for policy 0, policy_version 365731 (0.0005) [2023-12-27 21:51:25,505][106225] Updated weights for policy 1, policy_version 366418 (0.0008) [2023-12-27 21:51:25,559][106225] Updated weights for policy 1, policy_version 366428 (0.0008) [2023-12-27 21:51:25,611][106225] Updated weights for policy 1, policy_version 366438 (0.0008) [2023-12-27 21:51:25,666][106225] Updated weights for policy 1, policy_version 366448 (0.0008) [2023-12-27 21:51:26,030][106226] Updated weights for policy 0, policy_version 365741 (0.0008) [2023-12-27 21:51:26,093][106226] Updated weights for policy 0, policy_version 365751 (0.0011) [2023-12-27 21:51:26,145][106226] Updated weights for policy 0, policy_version 365761 (0.0010) [2023-12-27 21:51:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19883.0). Total num frames: 187498496. Throughput: 0: 9790.5, 1: 9574.0. Samples: 187473700. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:26,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.619')] [2023-12-27 21:51:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000366448_93839360.pth... [2023-12-27 21:51:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000365360_93560832.pth [2023-12-27 21:51:26,189][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000365768_93667328.pth... [2023-12-27 21:51:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000364616_93372416.pth [2023-12-27 21:51:26,415][106225] Updated weights for policy 1, policy_version 366458 (0.0008) [2023-12-27 21:51:26,483][106225] Updated weights for policy 1, policy_version 366468 (0.0008) [2023-12-27 21:51:26,548][106225] Updated weights for policy 1, policy_version 366478 (0.0010) [2023-12-27 21:51:26,779][106226] Updated weights for policy 0, policy_version 365771 (0.0009) [2023-12-27 21:51:26,840][106226] Updated weights for policy 0, policy_version 365781 (0.0007) [2023-12-27 21:51:26,899][106226] Updated weights for policy 0, policy_version 365791 (0.0007) [2023-12-27 21:51:27,158][106225] Updated weights for policy 1, policy_version 366488 (0.0006) [2023-12-27 21:51:27,209][106225] Updated weights for policy 1, policy_version 366498 (0.0005) [2023-12-27 21:51:27,258][106225] Updated weights for policy 1, policy_version 366508 (0.0005) [2023-12-27 21:51:27,500][106226] Updated weights for policy 0, policy_version 365801 (0.0008) [2023-12-27 21:51:27,556][106226] Updated weights for policy 0, policy_version 365811 (0.0005) [2023-12-27 21:51:27,614][106226] Updated weights for policy 0, policy_version 365821 (0.0006) [2023-12-27 21:51:27,680][106226] Updated weights for policy 0, policy_version 365831 (0.0006) [2023-12-27 21:51:27,908][106225] Updated weights for policy 1, policy_version 366518 (0.0008) [2023-12-27 21:51:27,977][106225] Updated weights for policy 1, policy_version 366528 (0.0010) [2023-12-27 21:51:28,027][106225] Updated weights for policy 1, policy_version 366538 (0.0010) [2023-12-27 21:51:28,206][106226] Updated weights for policy 0, policy_version 365841 (0.0007) [2023-12-27 21:51:28,258][106226] Updated weights for policy 0, policy_version 365851 (0.0010) [2023-12-27 21:51:28,322][106226] Updated weights for policy 0, policy_version 365861 (0.0009) [2023-12-27 21:51:28,732][106225] Updated weights for policy 1, policy_version 366548 (0.0010) [2023-12-27 21:51:28,788][106225] Updated weights for policy 1, policy_version 366558 (0.0010) [2023-12-27 21:51:28,838][106225] Updated weights for policy 1, policy_version 366568 (0.0010) [2023-12-27 21:51:28,968][106226] Updated weights for policy 0, policy_version 365871 (0.0008) [2023-12-27 21:51:29,029][106226] Updated weights for policy 0, policy_version 365881 (0.0008) [2023-12-27 21:51:29,078][106226] Updated weights for policy 0, policy_version 365891 (0.0007) [2023-12-27 21:51:29,568][106225] Updated weights for policy 1, policy_version 366578 (0.0009) [2023-12-27 21:51:29,627][106225] Updated weights for policy 1, policy_version 366588 (0.0005) [2023-12-27 21:51:29,685][106225] Updated weights for policy 1, policy_version 366598 (0.0005) [2023-12-27 21:51:29,740][106225] Updated weights for policy 1, policy_version 366608 (0.0005) [2023-12-27 21:51:29,815][106226] Updated weights for policy 0, policy_version 365901 (0.0009) [2023-12-27 21:51:29,881][106226] Updated weights for policy 0, policy_version 365911 (0.0007) [2023-12-27 21:51:29,947][106226] Updated weights for policy 0, policy_version 365921 (0.0010) [2023-12-27 21:51:30,414][106225] Updated weights for policy 1, policy_version 366618 (0.0010) [2023-12-27 21:51:30,476][106225] Updated weights for policy 1, policy_version 366628 (0.0008) [2023-12-27 21:51:30,537][106225] Updated weights for policy 1, policy_version 366638 (0.0006) [2023-12-27 21:51:30,663][106226] Updated weights for policy 0, policy_version 365931 (0.0008) [2023-12-27 21:51:30,714][106226] Updated weights for policy 0, policy_version 365941 (0.0008) [2023-12-27 21:51:30,771][106226] Updated weights for policy 0, policy_version 365951 (0.0008) [2023-12-27 21:51:31,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.2, 300 sec: 19882.9). Total num frames: 187604992. Throughput: 0: 9946.6, 1: 9632.4. Samples: 187596308. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:31,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.621')] [2023-12-27 21:51:31,255][106225] Updated weights for policy 1, policy_version 366648 (0.0010) [2023-12-27 21:51:31,307][106225] Updated weights for policy 1, policy_version 366658 (0.0008) [2023-12-27 21:51:31,370][106225] Updated weights for policy 1, policy_version 366668 (0.0009) [2023-12-27 21:51:31,518][106226] Updated weights for policy 0, policy_version 365961 (0.0009) [2023-12-27 21:51:31,577][106226] Updated weights for policy 0, policy_version 365971 (0.0006) [2023-12-27 21:51:31,644][106226] Updated weights for policy 0, policy_version 365981 (0.0007) [2023-12-27 21:51:31,711][106226] Updated weights for policy 0, policy_version 365991 (0.0007) [2023-12-27 21:51:32,083][106225] Updated weights for policy 1, policy_version 366678 (0.0010) [2023-12-27 21:51:32,133][106225] Updated weights for policy 1, policy_version 366688 (0.0010) [2023-12-27 21:51:32,194][106225] Updated weights for policy 1, policy_version 366698 (0.0010) [2023-12-27 21:51:32,440][106226] Updated weights for policy 0, policy_version 366001 (0.0008) [2023-12-27 21:51:32,497][106226] Updated weights for policy 0, policy_version 366011 (0.0008) [2023-12-27 21:51:32,555][106226] Updated weights for policy 0, policy_version 366021 (0.0010) [2023-12-27 21:51:32,824][106225] Updated weights for policy 1, policy_version 366708 (0.0008) [2023-12-27 21:51:32,887][106225] Updated weights for policy 1, policy_version 366718 (0.0007) [2023-12-27 21:51:32,945][106225] Updated weights for policy 1, policy_version 366728 (0.0009) [2023-12-27 21:51:33,259][106226] Updated weights for policy 0, policy_version 366031 (0.0006) [2023-12-27 21:51:33,310][106226] Updated weights for policy 0, policy_version 366041 (0.0008) [2023-12-27 21:51:33,372][106226] Updated weights for policy 0, policy_version 366051 (0.0009) [2023-12-27 21:51:33,519][106225] Updated weights for policy 1, policy_version 366738 (0.0009) [2023-12-27 21:51:33,580][106225] Updated weights for policy 1, policy_version 366748 (0.0007) [2023-12-27 21:51:33,639][106225] Updated weights for policy 1, policy_version 366758 (0.0010) [2023-12-27 21:51:33,692][106225] Updated weights for policy 1, policy_version 366768 (0.0010) [2023-12-27 21:51:33,929][106226] Updated weights for policy 0, policy_version 366061 (0.0009) [2023-12-27 21:51:33,988][106226] Updated weights for policy 0, policy_version 366071 (0.0010) [2023-12-27 21:51:34,038][106226] Updated weights for policy 0, policy_version 366081 (0.0010) [2023-12-27 21:51:34,420][106225] Updated weights for policy 1, policy_version 366778 (0.0006) [2023-12-27 21:51:34,483][106225] Updated weights for policy 1, policy_version 366788 (0.0006) [2023-12-27 21:51:34,548][106225] Updated weights for policy 1, policy_version 366798 (0.0008) [2023-12-27 21:51:34,784][106226] Updated weights for policy 0, policy_version 366091 (0.0010) [2023-12-27 21:51:34,834][106226] Updated weights for policy 0, policy_version 366101 (0.0007) [2023-12-27 21:51:34,885][106226] Updated weights for policy 0, policy_version 366111 (0.0007) [2023-12-27 21:51:35,216][106225] Updated weights for policy 1, policy_version 366808 (0.0010) [2023-12-27 21:51:35,276][106225] Updated weights for policy 1, policy_version 366818 (0.0010) [2023-12-27 21:51:35,339][106225] Updated weights for policy 1, policy_version 366828 (0.0010) [2023-12-27 21:51:35,542][106226] Updated weights for policy 0, policy_version 366121 (0.0008) [2023-12-27 21:51:35,603][106226] Updated weights for policy 0, policy_version 366131 (0.0005) [2023-12-27 21:51:35,654][106226] Updated weights for policy 0, policy_version 366141 (0.0005) [2023-12-27 21:51:35,708][106226] Updated weights for policy 0, policy_version 366151 (0.0005) [2023-12-27 21:51:35,990][106225] Updated weights for policy 1, policy_version 366838 (0.0010) [2023-12-27 21:51:36,045][106225] Updated weights for policy 1, policy_version 366848 (0.0007) [2023-12-27 21:51:36,104][106225] Updated weights for policy 1, policy_version 366858 (0.0010) [2023-12-27 21:51:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 187711488. Throughput: 0: 9945.9, 1: 9701.5. Samples: 187719548. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:36,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.532')] [2023-12-27 21:51:36,328][106226] Updated weights for policy 0, policy_version 366161 (0.0010) [2023-12-27 21:51:36,393][106226] Updated weights for policy 0, policy_version 366171 (0.0011) [2023-12-27 21:51:36,459][106226] Updated weights for policy 0, policy_version 366181 (0.0006) [2023-12-27 21:51:36,792][106225] Updated weights for policy 1, policy_version 366868 (0.0008) [2023-12-27 21:51:36,849][106225] Updated weights for policy 1, policy_version 366878 (0.0005) [2023-12-27 21:51:36,910][106225] Updated weights for policy 1, policy_version 366888 (0.0009) [2023-12-27 21:51:37,141][106226] Updated weights for policy 0, policy_version 366191 (0.0005) [2023-12-27 21:51:37,209][106226] Updated weights for policy 0, policy_version 366201 (0.0006) [2023-12-27 21:51:37,280][106226] Updated weights for policy 0, policy_version 366211 (0.0006) [2023-12-27 21:51:37,535][106225] Updated weights for policy 1, policy_version 366898 (0.0007) [2023-12-27 21:51:37,603][106225] Updated weights for policy 1, policy_version 366908 (0.0007) [2023-12-27 21:51:37,668][106225] Updated weights for policy 1, policy_version 366918 (0.0006) [2023-12-27 21:51:37,728][106225] Updated weights for policy 1, policy_version 366928 (0.0005) [2023-12-27 21:51:37,923][106226] Updated weights for policy 0, policy_version 366221 (0.0008) [2023-12-27 21:51:37,979][106226] Updated weights for policy 0, policy_version 366231 (0.0010) [2023-12-27 21:51:38,039][106226] Updated weights for policy 0, policy_version 366241 (0.0006) [2023-12-27 21:51:38,315][106225] Updated weights for policy 1, policy_version 366938 (0.0009) [2023-12-27 21:51:38,382][106225] Updated weights for policy 1, policy_version 366948 (0.0008) [2023-12-27 21:51:38,453][106225] Updated weights for policy 1, policy_version 366958 (0.0007) [2023-12-27 21:51:38,737][106226] Updated weights for policy 0, policy_version 366251 (0.0009) [2023-12-27 21:51:38,787][106226] Updated weights for policy 0, policy_version 366261 (0.0010) [2023-12-27 21:51:38,851][106226] Updated weights for policy 0, policy_version 366271 (0.0011) [2023-12-27 21:51:39,119][106225] Updated weights for policy 1, policy_version 366968 (0.0006) [2023-12-27 21:51:39,171][106225] Updated weights for policy 1, policy_version 366978 (0.0005) [2023-12-27 21:51:39,230][106225] Updated weights for policy 1, policy_version 366988 (0.0006) [2023-12-27 21:51:39,537][106226] Updated weights for policy 0, policy_version 366281 (0.0011) [2023-12-27 21:51:39,598][106226] Updated weights for policy 0, policy_version 366291 (0.0008) [2023-12-27 21:51:39,661][106226] Updated weights for policy 0, policy_version 366301 (0.0008) [2023-12-27 21:51:39,727][106226] Updated weights for policy 0, policy_version 366311 (0.0009) [2023-12-27 21:51:39,984][106225] Updated weights for policy 1, policy_version 366998 (0.0009) [2023-12-27 21:51:40,045][106225] Updated weights for policy 1, policy_version 367008 (0.0008) [2023-12-27 21:51:40,105][106225] Updated weights for policy 1, policy_version 367018 (0.0009) [2023-12-27 21:51:40,502][106226] Updated weights for policy 0, policy_version 366321 (0.0008) [2023-12-27 21:51:40,557][106226] Updated weights for policy 0, policy_version 366331 (0.0008) [2023-12-27 21:51:40,618][106226] Updated weights for policy 0, policy_version 366341 (0.0008) [2023-12-27 21:51:40,837][106225] Updated weights for policy 1, policy_version 367028 (0.0010) [2023-12-27 21:51:40,888][106225] Updated weights for policy 1, policy_version 367038 (0.0010) [2023-12-27 21:51:40,939][106225] Updated weights for policy 1, policy_version 367048 (0.0010) [2023-12-27 21:51:41,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 187809792. Throughput: 0: 9943.7, 1: 9716.6. Samples: 187780208. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:41,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-6.002')] [2023-12-27 21:51:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000367056_93995008.pth... [2023-12-27 21:51:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000366344_93814784.pth... [2023-12-27 21:51:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000365904_93700096.pth [2023-12-27 21:51:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000365160_93511680.pth [2023-12-27 21:51:41,413][106226] Updated weights for policy 0, policy_version 366351 (0.0009) [2023-12-27 21:51:41,477][106226] Updated weights for policy 0, policy_version 366361 (0.0007) [2023-12-27 21:51:41,544][106226] Updated weights for policy 0, policy_version 366371 (0.0011) [2023-12-27 21:51:41,722][106225] Updated weights for policy 1, policy_version 367058 (0.0010) [2023-12-27 21:51:41,794][106225] Updated weights for policy 1, policy_version 367068 (0.0008) [2023-12-27 21:51:41,862][106225] Updated weights for policy 1, policy_version 367078 (0.0008) [2023-12-27 21:51:41,920][106225] Updated weights for policy 1, policy_version 367088 (0.0007) [2023-12-27 21:51:42,299][106226] Updated weights for policy 0, policy_version 366381 (0.0011) [2023-12-27 21:51:42,374][106226] Updated weights for policy 0, policy_version 366392 (0.0010) [2023-12-27 21:51:42,438][106226] Updated weights for policy 0, policy_version 366402 (0.0007) [2023-12-27 21:51:42,660][106225] Updated weights for policy 1, policy_version 367098 (0.0007) [2023-12-27 21:51:42,725][106225] Updated weights for policy 1, policy_version 367108 (0.0008) [2023-12-27 21:51:42,783][106225] Updated weights for policy 1, policy_version 367118 (0.0009) [2023-12-27 21:51:43,146][106226] Updated weights for policy 0, policy_version 366412 (0.0009) [2023-12-27 21:51:43,208][106226] Updated weights for policy 0, policy_version 366422 (0.0008) [2023-12-27 21:51:43,256][106226] Updated weights for policy 0, policy_version 366432 (0.0008) [2023-12-27 21:51:43,482][106225] Updated weights for policy 1, policy_version 367128 (0.0009) [2023-12-27 21:51:43,549][106225] Updated weights for policy 1, policy_version 367139 (0.0011) [2023-12-27 21:51:43,597][106225] Updated weights for policy 1, policy_version 367149 (0.0008) [2023-12-27 21:51:43,877][106226] Updated weights for policy 0, policy_version 366442 (0.0009) [2023-12-27 21:51:43,923][106226] Updated weights for policy 0, policy_version 366452 (0.0010) [2023-12-27 21:51:43,969][106226] Updated weights for policy 0, policy_version 366462 (0.0010) [2023-12-27 21:51:44,018][106226] Updated weights for policy 0, policy_version 366472 (0.0010) [2023-12-27 21:51:44,364][106225] Updated weights for policy 1, policy_version 367159 (0.0009) [2023-12-27 21:51:44,420][106225] Updated weights for policy 1, policy_version 367169 (0.0008) [2023-12-27 21:51:44,486][106225] Updated weights for policy 1, policy_version 367179 (0.0008) [2023-12-27 21:51:44,711][106226] Updated weights for policy 0, policy_version 366482 (0.0009) [2023-12-27 21:51:44,777][106226] Updated weights for policy 0, policy_version 366492 (0.0009) [2023-12-27 21:51:44,842][106226] Updated weights for policy 0, policy_version 366502 (0.0009) [2023-12-27 21:51:45,171][106225] Updated weights for policy 1, policy_version 367189 (0.0009) [2023-12-27 21:51:45,225][106225] Updated weights for policy 1, policy_version 367199 (0.0008) [2023-12-27 21:51:45,279][106225] Updated weights for policy 1, policy_version 367209 (0.0006) [2023-12-27 21:51:45,631][106226] Updated weights for policy 0, policy_version 366512 (0.0008) [2023-12-27 21:51:45,693][106226] Updated weights for policy 0, policy_version 366522 (0.0009) [2023-12-27 21:51:45,758][106226] Updated weights for policy 0, policy_version 366532 (0.0009) [2023-12-27 21:51:45,940][106225] Updated weights for policy 1, policy_version 367219 (0.0005) [2023-12-27 21:51:45,996][106225] Updated weights for policy 1, policy_version 367229 (0.0005) [2023-12-27 21:51:46,057][106225] Updated weights for policy 1, policy_version 367239 (0.0005) [2023-12-27 21:51:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 187908096. Throughput: 0: 9910.8, 1: 9722.5. Samples: 187893700. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:46,175][105115] Avg episode reward: [(0, '-4.876'), (1, '-5.370')] [2023-12-27 21:51:46,537][106226] Updated weights for policy 0, policy_version 366542 (0.0009) [2023-12-27 21:51:46,585][106226] Updated weights for policy 0, policy_version 366552 (0.0007) [2023-12-27 21:51:46,624][106225] Updated weights for policy 1, policy_version 367249 (0.0006) [2023-12-27 21:51:46,634][106226] Updated weights for policy 0, policy_version 366562 (0.0009) [2023-12-27 21:51:46,693][106225] Updated weights for policy 1, policy_version 367259 (0.0009) [2023-12-27 21:51:46,763][106225] Updated weights for policy 1, policy_version 367269 (0.0008) [2023-12-27 21:51:46,825][106225] Updated weights for policy 1, policy_version 367279 (0.0006) [2023-12-27 21:51:47,307][106226] Updated weights for policy 0, policy_version 366572 (0.0007) [2023-12-27 21:51:47,362][106226] Updated weights for policy 0, policy_version 366582 (0.0010) [2023-12-27 21:51:47,411][106226] Updated weights for policy 0, policy_version 366592 (0.0005) [2023-12-27 21:51:47,496][106225] Updated weights for policy 1, policy_version 367289 (0.0006) [2023-12-27 21:51:47,553][106225] Updated weights for policy 1, policy_version 367299 (0.0007) [2023-12-27 21:51:47,610][106225] Updated weights for policy 1, policy_version 367309 (0.0008) [2023-12-27 21:51:48,064][106226] Updated weights for policy 0, policy_version 366602 (0.0008) [2023-12-27 21:51:48,118][106226] Updated weights for policy 0, policy_version 366612 (0.0009) [2023-12-27 21:51:48,166][106226] Updated weights for policy 0, policy_version 366622 (0.0008) [2023-12-27 21:51:48,215][106226] Updated weights for policy 0, policy_version 366632 (0.0008) [2023-12-27 21:51:48,300][106225] Updated weights for policy 1, policy_version 367319 (0.0008) [2023-12-27 21:51:48,360][106225] Updated weights for policy 1, policy_version 367329 (0.0007) [2023-12-27 21:51:48,427][106225] Updated weights for policy 1, policy_version 367339 (0.0007) [2023-12-27 21:51:48,990][106226] Updated weights for policy 0, policy_version 366642 (0.0008) [2023-12-27 21:51:49,048][106226] Updated weights for policy 0, policy_version 366652 (0.0008) [2023-12-27 21:51:49,107][106226] Updated weights for policy 0, policy_version 366662 (0.0008) [2023-12-27 21:51:49,116][106225] Updated weights for policy 1, policy_version 367349 (0.0006) [2023-12-27 21:51:49,181][106225] Updated weights for policy 1, policy_version 367359 (0.0005) [2023-12-27 21:51:49,253][106225] Updated weights for policy 1, policy_version 367369 (0.0007) [2023-12-27 21:51:49,903][106226] Updated weights for policy 0, policy_version 366672 (0.0009) [2023-12-27 21:51:49,923][106225] Updated weights for policy 1, policy_version 367379 (0.0007) [2023-12-27 21:51:49,966][106226] Updated weights for policy 0, policy_version 366682 (0.0008) [2023-12-27 21:51:49,991][106225] Updated weights for policy 1, policy_version 367389 (0.0009) [2023-12-27 21:51:50,029][106226] Updated weights for policy 0, policy_version 366692 (0.0008) [2023-12-27 21:51:50,046][106225] Updated weights for policy 1, policy_version 367399 (0.0010) [2023-12-27 21:51:50,692][106225] Updated weights for policy 1, policy_version 367409 (0.0011) [2023-12-27 21:51:50,714][106226] Updated weights for policy 0, policy_version 366702 (0.0007) [2023-12-27 21:51:50,744][106225] Updated weights for policy 1, policy_version 367419 (0.0006) [2023-12-27 21:51:50,778][106226] Updated weights for policy 0, policy_version 366712 (0.0007) [2023-12-27 21:51:50,799][106225] Updated weights for policy 1, policy_version 367429 (0.0005) [2023-12-27 21:51:50,839][106226] Updated weights for policy 0, policy_version 366722 (0.0008) [2023-12-27 21:51:50,854][106225] Updated weights for policy 1, policy_version 367439 (0.0007) [2023-12-27 21:51:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 188006400. Throughput: 0: 9883.7, 1: 9856.0. Samples: 188014328. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:51,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.466')] [2023-12-27 21:51:51,548][106225] Updated weights for policy 1, policy_version 367449 (0.0006) [2023-12-27 21:51:51,568][106226] Updated weights for policy 0, policy_version 366732 (0.0007) [2023-12-27 21:51:51,610][106225] Updated weights for policy 1, policy_version 367459 (0.0006) [2023-12-27 21:51:51,639][106226] Updated weights for policy 0, policy_version 366742 (0.0008) [2023-12-27 21:51:51,678][106225] Updated weights for policy 1, policy_version 367469 (0.0007) [2023-12-27 21:51:51,700][106226] Updated weights for policy 0, policy_version 366752 (0.0007) [2023-12-27 21:51:52,402][106225] Updated weights for policy 1, policy_version 367479 (0.0008) [2023-12-27 21:51:52,428][106226] Updated weights for policy 0, policy_version 366762 (0.0008) [2023-12-27 21:51:52,463][106225] Updated weights for policy 1, policy_version 367489 (0.0008) [2023-12-27 21:51:52,494][106226] Updated weights for policy 0, policy_version 366772 (0.0005) [2023-12-27 21:51:52,527][106225] Updated weights for policy 1, policy_version 367499 (0.0008) [2023-12-27 21:51:52,554][106226] Updated weights for policy 0, policy_version 366782 (0.0006) [2023-12-27 21:51:52,617][106226] Updated weights for policy 0, policy_version 366792 (0.0005) [2023-12-27 21:51:53,234][106226] Updated weights for policy 0, policy_version 366802 (0.0008) [2023-12-27 21:51:53,306][106225] Updated weights for policy 1, policy_version 367509 (0.0008) [2023-12-27 21:51:53,322][106226] Updated weights for policy 0, policy_version 366812 (0.0008) [2023-12-27 21:51:53,371][106225] Updated weights for policy 1, policy_version 367519 (0.0008) [2023-12-27 21:51:53,384][106226] Updated weights for policy 0, policy_version 366822 (0.0006) [2023-12-27 21:51:53,430][106225] Updated weights for policy 1, policy_version 367529 (0.0007) [2023-12-27 21:51:53,998][106226] Updated weights for policy 0, policy_version 366832 (0.0008) [2023-12-27 21:51:54,058][106226] Updated weights for policy 0, policy_version 366842 (0.0010) [2023-12-27 21:51:54,110][106225] Updated weights for policy 1, policy_version 367539 (0.0008) [2023-12-27 21:51:54,112][106226] Updated weights for policy 0, policy_version 366852 (0.0008) [2023-12-27 21:51:54,171][106225] Updated weights for policy 1, policy_version 367549 (0.0007) [2023-12-27 21:51:54,228][106225] Updated weights for policy 1, policy_version 367559 (0.0008) [2023-12-27 21:51:54,806][106226] Updated weights for policy 0, policy_version 366862 (0.0008) [2023-12-27 21:51:54,861][106226] Updated weights for policy 0, policy_version 366872 (0.0009) [2023-12-27 21:51:54,900][106225] Updated weights for policy 1, policy_version 367569 (0.0008) [2023-12-27 21:51:54,913][106226] Updated weights for policy 0, policy_version 366882 (0.0008) [2023-12-27 21:51:54,957][106225] Updated weights for policy 1, policy_version 367579 (0.0006) [2023-12-27 21:51:55,014][106225] Updated weights for policy 1, policy_version 367589 (0.0007) [2023-12-27 21:51:55,065][106225] Updated weights for policy 1, policy_version 367599 (0.0008) [2023-12-27 21:51:55,653][106226] Updated weights for policy 0, policy_version 366892 (0.0007) [2023-12-27 21:51:55,722][106226] Updated weights for policy 0, policy_version 366902 (0.0005) [2023-12-27 21:51:55,788][106226] Updated weights for policy 0, policy_version 366912 (0.0005) [2023-12-27 21:51:55,814][106225] Updated weights for policy 1, policy_version 367609 (0.0008) [2023-12-27 21:51:55,883][106225] Updated weights for policy 1, policy_version 367619 (0.0008) [2023-12-27 21:51:55,954][106225] Updated weights for policy 1, policy_version 367629 (0.0009) [2023-12-27 21:51:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 188104704. Throughput: 0: 9917.4, 1: 9822.8. Samples: 188072528. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:51:56,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.600')] [2023-12-27 21:51:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000367632_94142464.pth... [2023-12-27 21:51:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000366920_93962240.pth... [2023-12-27 21:51:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000366448_93839360.pth [2023-12-27 21:51:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000365768_93667328.pth [2023-12-27 21:51:56,417][106226] Updated weights for policy 0, policy_version 366922 (0.0006) [2023-12-27 21:51:56,474][106226] Updated weights for policy 0, policy_version 366932 (0.0009) [2023-12-27 21:51:56,527][106226] Updated weights for policy 0, policy_version 366942 (0.0009) [2023-12-27 21:51:56,583][106226] Updated weights for policy 0, policy_version 366952 (0.0009) [2023-12-27 21:51:56,630][106225] Updated weights for policy 1, policy_version 367639 (0.0009) [2023-12-27 21:51:56,679][106225] Updated weights for policy 1, policy_version 367649 (0.0007) [2023-12-27 21:51:56,732][106225] Updated weights for policy 1, policy_version 367659 (0.0005) [2023-12-27 21:51:57,319][106226] Updated weights for policy 0, policy_version 366962 (0.0008) [2023-12-27 21:51:57,384][106226] Updated weights for policy 0, policy_version 366972 (0.0009) [2023-12-27 21:51:57,440][106225] Updated weights for policy 1, policy_version 367669 (0.0006) [2023-12-27 21:51:57,441][106226] Updated weights for policy 0, policy_version 366982 (0.0007) [2023-12-27 21:51:57,496][106225] Updated weights for policy 1, policy_version 367679 (0.0007) [2023-12-27 21:51:57,559][106225] Updated weights for policy 1, policy_version 367689 (0.0007) [2023-12-27 21:51:57,996][106226] Updated weights for policy 0, policy_version 366992 (0.0009) [2023-12-27 21:51:58,048][106226] Updated weights for policy 0, policy_version 367002 (0.0009) [2023-12-27 21:51:58,105][106226] Updated weights for policy 0, policy_version 367012 (0.0009) [2023-12-27 21:51:58,297][106225] Updated weights for policy 1, policy_version 367699 (0.0008) [2023-12-27 21:51:58,373][106225] Updated weights for policy 1, policy_version 367709 (0.0008) [2023-12-27 21:51:58,444][106225] Updated weights for policy 1, policy_version 367719 (0.0009) [2023-12-27 21:51:59,018][106226] Updated weights for policy 0, policy_version 367022 (0.0007) [2023-12-27 21:51:59,084][106226] Updated weights for policy 0, policy_version 367032 (0.0008) [2023-12-27 21:51:59,153][106226] Updated weights for policy 0, policy_version 367042 (0.0009) [2023-12-27 21:51:59,307][106225] Updated weights for policy 1, policy_version 367729 (0.0008) [2023-12-27 21:51:59,376][106225] Updated weights for policy 1, policy_version 367739 (0.0008) [2023-12-27 21:51:59,437][106225] Updated weights for policy 1, policy_version 367749 (0.0006) [2023-12-27 21:51:59,493][106225] Updated weights for policy 1, policy_version 367759 (0.0007) [2023-12-27 21:51:59,896][106226] Updated weights for policy 0, policy_version 367052 (0.0007) [2023-12-27 21:51:59,969][106226] Updated weights for policy 0, policy_version 367062 (0.0008) [2023-12-27 21:52:00,032][106226] Updated weights for policy 0, policy_version 367072 (0.0010) [2023-12-27 21:52:00,199][106225] Updated weights for policy 1, policy_version 367769 (0.0006) [2023-12-27 21:52:00,265][106225] Updated weights for policy 1, policy_version 367779 (0.0006) [2023-12-27 21:52:00,330][106225] Updated weights for policy 1, policy_version 367789 (0.0005) [2023-12-27 21:52:00,800][106226] Updated weights for policy 0, policy_version 367082 (0.0008) [2023-12-27 21:52:00,851][106226] Updated weights for policy 0, policy_version 367092 (0.0008) [2023-12-27 21:52:00,902][106226] Updated weights for policy 0, policy_version 367102 (0.0008) [2023-12-27 21:52:00,953][106226] Updated weights for policy 0, policy_version 367112 (0.0007) [2023-12-27 21:52:00,960][106225] Updated weights for policy 1, policy_version 367799 (0.0007) [2023-12-27 21:52:01,012][106225] Updated weights for policy 1, policy_version 367809 (0.0009) [2023-12-27 21:52:01,071][106225] Updated weights for policy 1, policy_version 367819 (0.0008) [2023-12-27 21:52:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 188203008. Throughput: 0: 9987.6, 1: 9807.7. Samples: 188187964. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:52:01,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.509')] [2023-12-27 21:52:01,652][106226] Updated weights for policy 0, policy_version 367122 (0.0009) [2023-12-27 21:52:01,711][106226] Updated weights for policy 0, policy_version 367132 (0.0008) [2023-12-27 21:52:01,773][106226] Updated weights for policy 0, policy_version 367142 (0.0006) [2023-12-27 21:52:01,805][106225] Updated weights for policy 1, policy_version 367829 (0.0007) [2023-12-27 21:52:01,869][106225] Updated weights for policy 1, policy_version 367839 (0.0008) [2023-12-27 21:52:01,935][106225] Updated weights for policy 1, policy_version 367849 (0.0009) [2023-12-27 21:52:02,381][106226] Updated weights for policy 0, policy_version 367152 (0.0008) [2023-12-27 21:52:02,441][106226] Updated weights for policy 0, policy_version 367162 (0.0008) [2023-12-27 21:52:02,502][106226] Updated weights for policy 0, policy_version 367172 (0.0009) [2023-12-27 21:52:02,676][106225] Updated weights for policy 1, policy_version 367859 (0.0008) [2023-12-27 21:52:02,738][106225] Updated weights for policy 1, policy_version 367869 (0.0008) [2023-12-27 21:52:02,797][106225] Updated weights for policy 1, policy_version 367879 (0.0007) [2023-12-27 21:52:03,163][106226] Updated weights for policy 0, policy_version 367182 (0.0009) [2023-12-27 21:52:03,208][106226] Updated weights for policy 0, policy_version 367192 (0.0010) [2023-12-27 21:52:03,268][106226] Updated weights for policy 0, policy_version 367202 (0.0010) [2023-12-27 21:52:03,534][106225] Updated weights for policy 1, policy_version 367889 (0.0008) [2023-12-27 21:52:03,580][106225] Updated weights for policy 1, policy_version 367899 (0.0009) [2023-12-27 21:52:03,629][106225] Updated weights for policy 1, policy_version 367909 (0.0010) [2023-12-27 21:52:03,675][106225] Updated weights for policy 1, policy_version 367919 (0.0010) [2023-12-27 21:52:03,835][106226] Updated weights for policy 0, policy_version 367212 (0.0010) [2023-12-27 21:52:03,897][106226] Updated weights for policy 0, policy_version 367222 (0.0010) [2023-12-27 21:52:03,960][106226] Updated weights for policy 0, policy_version 367232 (0.0011) [2023-12-27 21:52:04,435][106225] Updated weights for policy 1, policy_version 367929 (0.0010) [2023-12-27 21:52:04,489][106225] Updated weights for policy 1, policy_version 367939 (0.0010) [2023-12-27 21:52:04,536][106225] Updated weights for policy 1, policy_version 367949 (0.0010) [2023-12-27 21:52:04,658][106226] Updated weights for policy 0, policy_version 367242 (0.0010) [2023-12-27 21:52:04,716][106226] Updated weights for policy 0, policy_version 367252 (0.0008) [2023-12-27 21:52:04,789][106226] Updated weights for policy 0, policy_version 367262 (0.0007) [2023-12-27 21:52:04,853][106226] Updated weights for policy 0, policy_version 367272 (0.0006) [2023-12-27 21:52:05,253][106225] Updated weights for policy 1, policy_version 367959 (0.0008) [2023-12-27 21:52:05,312][106225] Updated weights for policy 1, policy_version 367969 (0.0006) [2023-12-27 21:52:05,361][106225] Updated weights for policy 1, policy_version 367979 (0.0005) [2023-12-27 21:52:05,432][106226] Updated weights for policy 0, policy_version 367282 (0.0007) [2023-12-27 21:52:05,486][106226] Updated weights for policy 0, policy_version 367292 (0.0011) [2023-12-27 21:52:05,539][106226] Updated weights for policy 0, policy_version 367302 (0.0010) [2023-12-27 21:52:05,945][106225] Updated weights for policy 1, policy_version 367989 (0.0005) [2023-12-27 21:52:06,004][106225] Updated weights for policy 1, policy_version 367999 (0.0009) [2023-12-27 21:52:06,061][106225] Updated weights for policy 1, policy_version 368009 (0.0008) [2023-12-27 21:52:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 188301312. Throughput: 0: 10013.9, 1: 9852.1. Samples: 188310152. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:52:06,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-5.607')] [2023-12-27 21:52:06,227][106226] Updated weights for policy 0, policy_version 367312 (0.0008) [2023-12-27 21:52:06,291][106226] Updated weights for policy 0, policy_version 367322 (0.0007) [2023-12-27 21:52:06,351][106226] Updated weights for policy 0, policy_version 367332 (0.0009) [2023-12-27 21:52:06,793][106225] Updated weights for policy 1, policy_version 368019 (0.0007) [2023-12-27 21:52:06,855][106225] Updated weights for policy 1, policy_version 368029 (0.0010) [2023-12-27 21:52:06,912][106225] Updated weights for policy 1, policy_version 368039 (0.0010) [2023-12-27 21:52:07,038][106226] Updated weights for policy 0, policy_version 367342 (0.0008) [2023-12-27 21:52:07,088][106226] Updated weights for policy 0, policy_version 367352 (0.0008) [2023-12-27 21:52:07,139][106226] Updated weights for policy 0, policy_version 367362 (0.0008) [2023-12-27 21:52:07,622][106225] Updated weights for policy 1, policy_version 368049 (0.0010) [2023-12-27 21:52:07,680][106225] Updated weights for policy 1, policy_version 368059 (0.0010) [2023-12-27 21:52:07,728][106225] Updated weights for policy 1, policy_version 368069 (0.0010) [2023-12-27 21:52:07,785][106225] Updated weights for policy 1, policy_version 368079 (0.0010) [2023-12-27 21:52:07,812][106226] Updated weights for policy 0, policy_version 367372 (0.0009) [2023-12-27 21:52:07,874][106226] Updated weights for policy 0, policy_version 367382 (0.0010) [2023-12-27 21:52:07,940][106226] Updated weights for policy 0, policy_version 367392 (0.0009) [2023-12-27 21:52:08,506][106225] Updated weights for policy 1, policy_version 368089 (0.0008) [2023-12-27 21:52:08,542][106226] Updated weights for policy 0, policy_version 367402 (0.0006) [2023-12-27 21:52:08,567][106225] Updated weights for policy 1, policy_version 368099 (0.0007) [2023-12-27 21:52:08,603][106226] Updated weights for policy 0, policy_version 367412 (0.0010) [2023-12-27 21:52:08,624][106225] Updated weights for policy 1, policy_version 368109 (0.0006) [2023-12-27 21:52:08,660][106226] Updated weights for policy 0, policy_version 367422 (0.0010) [2023-12-27 21:52:08,721][106226] Updated weights for policy 0, policy_version 367432 (0.0011) [2023-12-27 21:52:09,351][106225] Updated weights for policy 1, policy_version 368119 (0.0009) [2023-12-27 21:52:09,422][106225] Updated weights for policy 1, policy_version 368129 (0.0009) [2023-12-27 21:52:09,469][106226] Updated weights for policy 0, policy_version 367442 (0.0008) [2023-12-27 21:52:09,484][106225] Updated weights for policy 1, policy_version 368139 (0.0008) [2023-12-27 21:52:09,526][106226] Updated weights for policy 0, policy_version 367452 (0.0008) [2023-12-27 21:52:09,587][106226] Updated weights for policy 0, policy_version 367462 (0.0007) [2023-12-27 21:52:10,245][106225] Updated weights for policy 1, policy_version 368149 (0.0008) [2023-12-27 21:52:10,305][106225] Updated weights for policy 1, policy_version 368159 (0.0008) [2023-12-27 21:52:10,335][106226] Updated weights for policy 0, policy_version 367472 (0.0006) [2023-12-27 21:52:10,365][106225] Updated weights for policy 1, policy_version 368169 (0.0008) [2023-12-27 21:52:10,396][106226] Updated weights for policy 0, policy_version 367482 (0.0006) [2023-12-27 21:52:10,463][106226] Updated weights for policy 0, policy_version 367492 (0.0009) [2023-12-27 21:52:11,119][106225] Updated weights for policy 1, policy_version 368179 (0.0008) [2023-12-27 21:52:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 188391424. Throughput: 0: 10024.6, 1: 9897.2. Samples: 188370184. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:52:11,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.805')] [2023-12-27 21:52:11,195][106225] Updated weights for policy 1, policy_version 368189 (0.0008) [2023-12-27 21:52:11,203][106226] Updated weights for policy 0, policy_version 367502 (0.0008) [2023-12-27 21:52:11,261][106225] Updated weights for policy 1, policy_version 368199 (0.0009) [2023-12-27 21:52:11,273][106226] Updated weights for policy 0, policy_version 367512 (0.0007) [2023-12-27 21:52:11,321][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000368208_94289920.pth... [2023-12-27 21:52:11,325][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000367056_93995008.pth [2023-12-27 21:52:11,332][106226] Updated weights for policy 0, policy_version 367522 (0.0007) [2023-12-27 21:52:11,369][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000367528_94117888.pth... [2023-12-27 21:52:11,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000366344_93814784.pth [2023-12-27 21:52:12,084][106225] Updated weights for policy 1, policy_version 368209 (0.0009) [2023-12-27 21:52:12,142][106225] Updated weights for policy 1, policy_version 368219 (0.0009) [2023-12-27 21:52:12,165][106226] Updated weights for policy 0, policy_version 367532 (0.0009) [2023-12-27 21:52:12,194][106225] Updated weights for policy 1, policy_version 368229 (0.0008) [2023-12-27 21:52:12,224][106226] Updated weights for policy 0, policy_version 367542 (0.0007) [2023-12-27 21:52:12,259][106225] Updated weights for policy 1, policy_version 368239 (0.0009) [2023-12-27 21:52:12,289][106226] Updated weights for policy 0, policy_version 367552 (0.0009) [2023-12-27 21:52:12,983][106226] Updated weights for policy 0, policy_version 367562 (0.0009) [2023-12-27 21:52:13,031][106225] Updated weights for policy 1, policy_version 368249 (0.0006) [2023-12-27 21:52:13,042][106226] Updated weights for policy 0, policy_version 367572 (0.0008) [2023-12-27 21:52:13,093][106225] Updated weights for policy 1, policy_version 368259 (0.0006) [2023-12-27 21:52:13,102][106226] Updated weights for policy 0, policy_version 367582 (0.0007) [2023-12-27 21:52:13,153][106225] Updated weights for policy 1, policy_version 368269 (0.0007) [2023-12-27 21:52:13,166][106226] Updated weights for policy 0, policy_version 367592 (0.0009) [2023-12-27 21:52:13,795][106225] Updated weights for policy 1, policy_version 368279 (0.0008) [2023-12-27 21:52:13,846][106225] Updated weights for policy 1, policy_version 368289 (0.0009) [2023-12-27 21:52:13,883][106226] Updated weights for policy 0, policy_version 367602 (0.0006) [2023-12-27 21:52:13,905][106225] Updated weights for policy 1, policy_version 368299 (0.0006) [2023-12-27 21:52:13,927][106226] Updated weights for policy 0, policy_version 367612 (0.0006) [2023-12-27 21:52:13,981][106226] Updated weights for policy 0, policy_version 367623 (0.0009) [2023-12-27 21:52:14,549][106225] Updated weights for policy 1, policy_version 368309 (0.0006) [2023-12-27 21:52:14,599][106225] Updated weights for policy 1, policy_version 368319 (0.0005) [2023-12-27 21:52:14,657][106225] Updated weights for policy 1, policy_version 368329 (0.0005) [2023-12-27 21:52:14,811][106226] Updated weights for policy 0, policy_version 367633 (0.0009) [2023-12-27 21:52:14,865][106226] Updated weights for policy 0, policy_version 367643 (0.0008) [2023-12-27 21:52:14,929][106226] Updated weights for policy 0, policy_version 367653 (0.0008) [2023-12-27 21:52:15,326][106225] Updated weights for policy 1, policy_version 368339 (0.0006) [2023-12-27 21:52:15,382][106225] Updated weights for policy 1, policy_version 368349 (0.0008) [2023-12-27 21:52:15,443][106225] Updated weights for policy 1, policy_version 368359 (0.0008) [2023-12-27 21:52:15,677][106226] Updated weights for policy 0, policy_version 367663 (0.0006) [2023-12-27 21:52:15,736][106226] Updated weights for policy 0, policy_version 367673 (0.0006) [2023-12-27 21:52:15,796][106226] Updated weights for policy 0, policy_version 367683 (0.0009) [2023-12-27 21:52:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 188489728. Throughput: 0: 9846.2, 1: 9845.8. Samples: 188482444. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-27 21:52:16,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.394')] [2023-12-27 21:52:16,234][106225] Updated weights for policy 1, policy_version 368369 (0.0008) [2023-12-27 21:52:16,281][106225] Updated weights for policy 1, policy_version 368379 (0.0008) [2023-12-27 21:52:16,334][106225] Updated weights for policy 1, policy_version 368390 (0.0010) [2023-12-27 21:52:16,375][106226] Updated weights for policy 0, policy_version 367693 (0.0007) [2023-12-27 21:52:16,384][106225] Updated weights for policy 1, policy_version 368400 (0.0009) [2023-12-27 21:52:16,437][106226] Updated weights for policy 0, policy_version 367703 (0.0006) [2023-12-27 21:52:16,493][106226] Updated weights for policy 0, policy_version 367713 (0.0006) [2023-12-27 21:52:17,036][106225] Updated weights for policy 1, policy_version 368410 (0.0010) [2023-12-27 21:52:17,049][106226] Updated weights for policy 0, policy_version 367723 (0.0005) [2023-12-27 21:52:17,099][106225] Updated weights for policy 1, policy_version 368420 (0.0010) [2023-12-27 21:52:17,100][106226] Updated weights for policy 0, policy_version 367733 (0.0009) [2023-12-27 21:52:17,147][106226] Updated weights for policy 0, policy_version 367743 (0.0006) [2023-12-27 21:52:17,152][106225] Updated weights for policy 1, policy_version 368430 (0.0010) [2023-12-27 21:52:17,861][106225] Updated weights for policy 1, policy_version 368440 (0.0008) [2023-12-27 21:52:17,875][106226] Updated weights for policy 0, policy_version 367753 (0.0008) [2023-12-27 21:52:17,922][106225] Updated weights for policy 1, policy_version 368450 (0.0007) [2023-12-27 21:52:17,932][106226] Updated weights for policy 0, policy_version 367763 (0.0008) [2023-12-27 21:52:17,983][106225] Updated weights for policy 1, policy_version 368460 (0.0010) [2023-12-27 21:52:17,989][106226] Updated weights for policy 0, policy_version 367773 (0.0008) [2023-12-27 21:52:18,045][106226] Updated weights for policy 0, policy_version 367783 (0.0007) [2023-12-27 21:52:18,668][106225] Updated weights for policy 1, policy_version 368470 (0.0008) [2023-12-27 21:52:18,733][106225] Updated weights for policy 1, policy_version 368480 (0.0006) [2023-12-27 21:52:18,800][106225] Updated weights for policy 1, policy_version 368490 (0.0006) [2023-12-27 21:52:18,858][106226] Updated weights for policy 0, policy_version 367793 (0.0009) [2023-12-27 21:52:18,931][106226] Updated weights for policy 0, policy_version 367803 (0.0010) [2023-12-27 21:52:18,996][106226] Updated weights for policy 0, policy_version 367813 (0.0007) [2023-12-27 21:52:19,416][106225] Updated weights for policy 1, policy_version 368500 (0.0006) [2023-12-27 21:52:19,481][106225] Updated weights for policy 1, policy_version 368510 (0.0011) [2023-12-27 21:52:19,543][106225] Updated weights for policy 1, policy_version 368520 (0.0010) [2023-12-27 21:52:19,759][106226] Updated weights for policy 0, policy_version 367823 (0.0008) [2023-12-27 21:52:19,829][106226] Updated weights for policy 0, policy_version 367833 (0.0008) [2023-12-27 21:52:19,895][106226] Updated weights for policy 0, policy_version 367843 (0.0009) [2023-12-27 21:52:20,269][106225] Updated weights for policy 1, policy_version 368530 (0.0010) [2023-12-27 21:52:20,322][106225] Updated weights for policy 1, policy_version 368540 (0.0008) [2023-12-27 21:52:20,381][106225] Updated weights for policy 1, policy_version 368550 (0.0008) [2023-12-27 21:52:20,436][106225] Updated weights for policy 1, policy_version 368560 (0.0009) [2023-12-27 21:52:20,579][106226] Updated weights for policy 0, policy_version 367853 (0.0009) [2023-12-27 21:52:20,636][106226] Updated weights for policy 0, policy_version 367863 (0.0009) [2023-12-27 21:52:20,700][106226] Updated weights for policy 0, policy_version 367873 (0.0009) [2023-12-27 21:52:21,161][106225] Updated weights for policy 1, policy_version 368570 (0.0007) [2023-12-27 21:52:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 188588032. Throughput: 0: 9807.7, 1: 9791.7. Samples: 188601524. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:21,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.811')] [2023-12-27 21:52:21,228][106225] Updated weights for policy 1, policy_version 368580 (0.0007) [2023-12-27 21:52:21,287][106225] Updated weights for policy 1, policy_version 368590 (0.0007) [2023-12-27 21:52:21,459][106226] Updated weights for policy 0, policy_version 367883 (0.0009) [2023-12-27 21:52:21,522][106226] Updated weights for policy 0, policy_version 367893 (0.0006) [2023-12-27 21:52:21,589][106226] Updated weights for policy 0, policy_version 367903 (0.0006) [2023-12-27 21:52:22,089][106225] Updated weights for policy 1, policy_version 368600 (0.0008) [2023-12-27 21:52:22,147][106225] Updated weights for policy 1, policy_version 368610 (0.0008) [2023-12-27 21:52:22,202][106225] Updated weights for policy 1, policy_version 368620 (0.0008) [2023-12-27 21:52:22,234][106226] Updated weights for policy 0, policy_version 367913 (0.0008) [2023-12-27 21:52:22,293][106226] Updated weights for policy 0, policy_version 367923 (0.0008) [2023-12-27 21:52:22,352][106226] Updated weights for policy 0, policy_version 367933 (0.0008) [2023-12-27 21:52:22,422][106226] Updated weights for policy 0, policy_version 367943 (0.0008) [2023-12-27 21:52:22,902][106225] Updated weights for policy 1, policy_version 368630 (0.0007) [2023-12-27 21:52:22,970][106225] Updated weights for policy 1, policy_version 368640 (0.0006) [2023-12-27 21:52:23,028][106225] Updated weights for policy 1, policy_version 368650 (0.0005) [2023-12-27 21:52:23,156][106226] Updated weights for policy 0, policy_version 367953 (0.0006) [2023-12-27 21:52:23,220][106226] Updated weights for policy 0, policy_version 367963 (0.0005) [2023-12-27 21:52:23,277][106226] Updated weights for policy 0, policy_version 367973 (0.0010) [2023-12-27 21:52:23,672][106225] Updated weights for policy 1, policy_version 368660 (0.0006) [2023-12-27 21:52:23,723][106225] Updated weights for policy 1, policy_version 368670 (0.0009) [2023-12-27 21:52:23,777][106225] Updated weights for policy 1, policy_version 368680 (0.0005) [2023-12-27 21:52:23,945][106226] Updated weights for policy 0, policy_version 367983 (0.0010) [2023-12-27 21:52:24,002][106226] Updated weights for policy 0, policy_version 367993 (0.0010) [2023-12-27 21:52:24,053][106226] Updated weights for policy 0, policy_version 368003 (0.0010) [2023-12-27 21:52:24,417][106225] Updated weights for policy 1, policy_version 368690 (0.0005) [2023-12-27 21:52:24,467][106225] Updated weights for policy 1, policy_version 368700 (0.0005) [2023-12-27 21:52:24,522][106225] Updated weights for policy 1, policy_version 368710 (0.0006) [2023-12-27 21:52:24,574][106225] Updated weights for policy 1, policy_version 368720 (0.0005) [2023-12-27 21:52:24,759][106226] Updated weights for policy 0, policy_version 368013 (0.0008) [2023-12-27 21:52:24,826][106226] Updated weights for policy 0, policy_version 368023 (0.0008) [2023-12-27 21:52:24,898][106226] Updated weights for policy 0, policy_version 368033 (0.0006) [2023-12-27 21:52:25,115][106225] Updated weights for policy 1, policy_version 368730 (0.0010) [2023-12-27 21:52:25,174][106225] Updated weights for policy 1, policy_version 368740 (0.0010) [2023-12-27 21:52:25,226][106225] Updated weights for policy 1, policy_version 368750 (0.0010) [2023-12-27 21:52:25,490][106226] Updated weights for policy 0, policy_version 368043 (0.0009) [2023-12-27 21:52:25,539][106226] Updated weights for policy 0, policy_version 368053 (0.0005) [2023-12-27 21:52:25,585][106226] Updated weights for policy 0, policy_version 368063 (0.0006) [2023-12-27 21:52:25,842][106225] Updated weights for policy 1, policy_version 368760 (0.0008) [2023-12-27 21:52:25,892][106225] Updated weights for policy 1, policy_version 368770 (0.0007) [2023-12-27 21:52:25,945][106225] Updated weights for policy 1, policy_version 368780 (0.0008) [2023-12-27 21:52:26,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 188694528. Throughput: 0: 9806.9, 1: 9745.5. Samples: 188660064. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:26,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-5.741')] [2023-12-27 21:52:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000368072_94257152.pth... [2023-12-27 21:52:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000368784_94437376.pth... [2023-12-27 21:52:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000366920_93962240.pth [2023-12-27 21:52:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000367632_94142464.pth [2023-12-27 21:52:26,271][106226] Updated weights for policy 0, policy_version 368073 (0.0010) [2023-12-27 21:52:26,316][106226] Updated weights for policy 0, policy_version 368083 (0.0010) [2023-12-27 21:52:26,381][106226] Updated weights for policy 0, policy_version 368093 (0.0010) [2023-12-27 21:52:26,441][106226] Updated weights for policy 0, policy_version 368103 (0.0008) [2023-12-27 21:52:26,678][106225] Updated weights for policy 1, policy_version 368790 (0.0009) [2023-12-27 21:52:26,735][106225] Updated weights for policy 1, policy_version 368800 (0.0007) [2023-12-27 21:52:26,787][106225] Updated weights for policy 1, policy_version 368810 (0.0010) [2023-12-27 21:52:27,120][106226] Updated weights for policy 0, policy_version 368113 (0.0007) [2023-12-27 21:52:27,184][106226] Updated weights for policy 0, policy_version 368123 (0.0008) [2023-12-27 21:52:27,248][106226] Updated weights for policy 0, policy_version 368133 (0.0008) [2023-12-27 21:52:27,509][106225] Updated weights for policy 1, policy_version 368820 (0.0008) [2023-12-27 21:52:27,569][106225] Updated weights for policy 1, policy_version 368830 (0.0005) [2023-12-27 21:52:27,630][106225] Updated weights for policy 1, policy_version 368840 (0.0007) [2023-12-27 21:52:27,809][106226] Updated weights for policy 0, policy_version 368143 (0.0009) [2023-12-27 21:52:27,865][106226] Updated weights for policy 0, policy_version 368153 (0.0005) [2023-12-27 21:52:27,912][106226] Updated weights for policy 0, policy_version 368163 (0.0010) [2023-12-27 21:52:28,185][106225] Updated weights for policy 1, policy_version 368850 (0.0006) [2023-12-27 21:52:28,233][106225] Updated weights for policy 1, policy_version 368860 (0.0008) [2023-12-27 21:52:28,285][106225] Updated weights for policy 1, policy_version 368870 (0.0008) [2023-12-27 21:52:28,340][106225] Updated weights for policy 1, policy_version 368880 (0.0009) [2023-12-27 21:52:28,500][106226] Updated weights for policy 0, policy_version 368173 (0.0010) [2023-12-27 21:52:28,559][106226] Updated weights for policy 0, policy_version 368183 (0.0009) [2023-12-27 21:52:28,620][106226] Updated weights for policy 0, policy_version 368193 (0.0009) [2023-12-27 21:52:29,111][106225] Updated weights for policy 1, policy_version 368890 (0.0008) [2023-12-27 21:52:29,160][106225] Updated weights for policy 1, policy_version 368901 (0.0008) [2023-12-27 21:52:29,221][106225] Updated weights for policy 1, policy_version 368911 (0.0007) [2023-12-27 21:52:29,406][106226] Updated weights for policy 0, policy_version 368203 (0.0009) [2023-12-27 21:52:29,465][106226] Updated weights for policy 0, policy_version 368213 (0.0008) [2023-12-27 21:52:29,530][106226] Updated weights for policy 0, policy_version 368223 (0.0006) [2023-12-27 21:52:29,975][106225] Updated weights for policy 1, policy_version 368921 (0.0009) [2023-12-27 21:52:30,038][106225] Updated weights for policy 1, policy_version 368931 (0.0009) [2023-12-27 21:52:30,092][106225] Updated weights for policy 1, policy_version 368941 (0.0009) [2023-12-27 21:52:30,167][106226] Updated weights for policy 0, policy_version 368233 (0.0009) [2023-12-27 21:52:30,232][106226] Updated weights for policy 0, policy_version 368243 (0.0009) [2023-12-27 21:52:30,300][106226] Updated weights for policy 0, policy_version 368253 (0.0009) [2023-12-27 21:52:30,364][106226] Updated weights for policy 0, policy_version 368263 (0.0009) [2023-12-27 21:52:30,859][106225] Updated weights for policy 1, policy_version 368951 (0.0009) [2023-12-27 21:52:30,926][106225] Updated weights for policy 1, policy_version 368961 (0.0009) [2023-12-27 21:52:30,986][106225] Updated weights for policy 1, policy_version 368971 (0.0007) [2023-12-27 21:52:31,001][106226] Updated weights for policy 0, policy_version 368273 (0.0007) [2023-12-27 21:52:31,068][106226] Updated weights for policy 0, policy_version 368283 (0.0007) [2023-12-27 21:52:31,118][106226] Updated weights for policy 0, policy_version 368293 (0.0009) [2023-12-27 21:52:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 188801024. Throughput: 0: 9930.6, 1: 9901.2. Samples: 188786128. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:31,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.651')] [2023-12-27 21:52:31,807][106226] Updated weights for policy 0, policy_version 368303 (0.0009) [2023-12-27 21:52:31,845][106225] Updated weights for policy 1, policy_version 368981 (0.0010) [2023-12-27 21:52:31,863][106226] Updated weights for policy 0, policy_version 368313 (0.0007) [2023-12-27 21:52:31,904][106225] Updated weights for policy 1, policy_version 368991 (0.0009) [2023-12-27 21:52:31,916][106226] Updated weights for policy 0, policy_version 368323 (0.0007) [2023-12-27 21:52:31,967][106225] Updated weights for policy 1, policy_version 369001 (0.0009) [2023-12-27 21:52:32,631][106225] Updated weights for policy 1, policy_version 369011 (0.0010) [2023-12-27 21:52:32,680][106225] Updated weights for policy 1, policy_version 369021 (0.0010) [2023-12-27 21:52:32,691][106226] Updated weights for policy 0, policy_version 368333 (0.0008) [2023-12-27 21:52:32,737][106225] Updated weights for policy 1, policy_version 369031 (0.0009) [2023-12-27 21:52:32,750][106226] Updated weights for policy 0, policy_version 368343 (0.0008) [2023-12-27 21:52:32,811][106226] Updated weights for policy 0, policy_version 368353 (0.0006) [2023-12-27 21:52:33,366][106226] Updated weights for policy 0, policy_version 368363 (0.0006) [2023-12-27 21:52:33,422][106226] Updated weights for policy 0, policy_version 368373 (0.0006) [2023-12-27 21:52:33,423][106225] Updated weights for policy 1, policy_version 369041 (0.0010) [2023-12-27 21:52:33,476][106225] Updated weights for policy 1, policy_version 369051 (0.0005) [2023-12-27 21:52:33,486][106226] Updated weights for policy 0, policy_version 368383 (0.0010) [2023-12-27 21:52:33,527][106225] Updated weights for policy 1, policy_version 369061 (0.0007) [2023-12-27 21:52:33,590][106225] Updated weights for policy 1, policy_version 369071 (0.0006) [2023-12-27 21:52:34,016][106226] Updated weights for policy 0, policy_version 368393 (0.0007) [2023-12-27 21:52:34,068][106226] Updated weights for policy 0, policy_version 368403 (0.0005) [2023-12-27 21:52:34,123][106226] Updated weights for policy 0, policy_version 368413 (0.0005) [2023-12-27 21:52:34,156][106225] Updated weights for policy 1, policy_version 369081 (0.0008) [2023-12-27 21:52:34,189][106226] Updated weights for policy 0, policy_version 368423 (0.0008) [2023-12-27 21:52:34,212][106225] Updated weights for policy 1, policy_version 369091 (0.0008) [2023-12-27 21:52:34,276][106225] Updated weights for policy 1, policy_version 369101 (0.0007) [2023-12-27 21:52:34,777][106226] Updated weights for policy 0, policy_version 368433 (0.0007) [2023-12-27 21:52:34,836][106226] Updated weights for policy 0, policy_version 368443 (0.0007) [2023-12-27 21:52:34,890][106226] Updated weights for policy 0, policy_version 368453 (0.0011) [2023-12-27 21:52:34,960][106225] Updated weights for policy 1, policy_version 369111 (0.0008) [2023-12-27 21:52:35,021][106225] Updated weights for policy 1, policy_version 369121 (0.0005) [2023-12-27 21:52:35,082][106225] Updated weights for policy 1, policy_version 369131 (0.0005) [2023-12-27 21:52:35,567][106226] Updated weights for policy 0, policy_version 368463 (0.0011) [2023-12-27 21:52:35,619][106226] Updated weights for policy 0, policy_version 368473 (0.0010) [2023-12-27 21:52:35,637][106225] Updated weights for policy 1, policy_version 369141 (0.0005) [2023-12-27 21:52:35,673][106226] Updated weights for policy 0, policy_version 368483 (0.0011) [2023-12-27 21:52:35,695][106225] Updated weights for policy 1, policy_version 369151 (0.0005) [2023-12-27 21:52:35,753][106225] Updated weights for policy 1, policy_version 369161 (0.0008) [2023-12-27 21:52:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 188899328. Throughput: 0: 10076.6, 1: 9840.8. Samples: 188910612. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:36,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-5.674')] [2023-12-27 21:52:36,356][106226] Updated weights for policy 0, policy_version 368493 (0.0011) [2023-12-27 21:52:36,418][106226] Updated weights for policy 0, policy_version 368503 (0.0011) [2023-12-27 21:52:36,482][106226] Updated weights for policy 0, policy_version 368513 (0.0006) [2023-12-27 21:52:36,514][106225] Updated weights for policy 1, policy_version 369171 (0.0007) [2023-12-27 21:52:36,574][106225] Updated weights for policy 1, policy_version 369181 (0.0008) [2023-12-27 21:52:36,635][106225] Updated weights for policy 1, policy_version 369191 (0.0008) [2023-12-27 21:52:37,065][106226] Updated weights for policy 0, policy_version 368523 (0.0006) [2023-12-27 21:52:37,123][106226] Updated weights for policy 0, policy_version 368533 (0.0005) [2023-12-27 21:52:37,185][106226] Updated weights for policy 0, policy_version 368543 (0.0007) [2023-12-27 21:52:37,272][106225] Updated weights for policy 1, policy_version 369201 (0.0007) [2023-12-27 21:52:37,321][106225] Updated weights for policy 1, policy_version 369211 (0.0009) [2023-12-27 21:52:37,371][106225] Updated weights for policy 1, policy_version 369221 (0.0005) [2023-12-27 21:52:37,420][106225] Updated weights for policy 1, policy_version 369231 (0.0006) [2023-12-27 21:52:37,763][106226] Updated weights for policy 0, policy_version 368553 (0.0005) [2023-12-27 21:52:37,826][106226] Updated weights for policy 0, policy_version 368563 (0.0008) [2023-12-27 21:52:37,894][106226] Updated weights for policy 0, policy_version 368573 (0.0008) [2023-12-27 21:52:37,947][106226] Updated weights for policy 0, policy_version 368583 (0.0009) [2023-12-27 21:52:38,151][106225] Updated weights for policy 1, policy_version 369241 (0.0005) [2023-12-27 21:52:38,201][106225] Updated weights for policy 1, policy_version 369251 (0.0005) [2023-12-27 21:52:38,260][106225] Updated weights for policy 1, policy_version 369261 (0.0005) [2023-12-27 21:52:38,656][106226] Updated weights for policy 0, policy_version 368593 (0.0006) [2023-12-27 21:52:38,721][106226] Updated weights for policy 0, policy_version 368603 (0.0006) [2023-12-27 21:52:38,783][106226] Updated weights for policy 0, policy_version 368613 (0.0007) [2023-12-27 21:52:38,863][106225] Updated weights for policy 1, policy_version 369271 (0.0006) [2023-12-27 21:52:38,921][106225] Updated weights for policy 1, policy_version 369281 (0.0007) [2023-12-27 21:52:38,968][106225] Updated weights for policy 1, policy_version 369291 (0.0010) [2023-12-27 21:52:39,389][106226] Updated weights for policy 0, policy_version 368623 (0.0008) [2023-12-27 21:52:39,462][106226] Updated weights for policy 0, policy_version 368633 (0.0008) [2023-12-27 21:52:39,531][106226] Updated weights for policy 0, policy_version 368643 (0.0009) [2023-12-27 21:52:39,711][106225] Updated weights for policy 1, policy_version 369301 (0.0009) [2023-12-27 21:52:39,778][106225] Updated weights for policy 1, policy_version 369311 (0.0008) [2023-12-27 21:52:39,846][106225] Updated weights for policy 1, policy_version 369321 (0.0008) [2023-12-27 21:52:40,205][106226] Updated weights for policy 0, policy_version 368653 (0.0008) [2023-12-27 21:52:40,258][106226] Updated weights for policy 0, policy_version 368663 (0.0007) [2023-12-27 21:52:40,315][106226] Updated weights for policy 0, policy_version 368673 (0.0009) [2023-12-27 21:52:40,585][106225] Updated weights for policy 1, policy_version 369331 (0.0008) [2023-12-27 21:52:40,641][106225] Updated weights for policy 1, policy_version 369341 (0.0006) [2023-12-27 21:52:40,685][106225] Updated weights for policy 1, policy_version 369351 (0.0008) [2023-12-27 21:52:41,008][106226] Updated weights for policy 0, policy_version 368683 (0.0009) [2023-12-27 21:52:41,068][106226] Updated weights for policy 0, policy_version 368693 (0.0009) [2023-12-27 21:52:41,136][106226] Updated weights for policy 0, policy_version 368703 (0.0009) [2023-12-27 21:52:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 188997632. Throughput: 0: 10124.5, 1: 9899.3. Samples: 188973604. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:41,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.646')] [2023-12-27 21:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000369360_94584832.pth... [2023-12-27 21:52:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000368208_94289920.pth [2023-12-27 21:52:41,205][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000368712_94420992.pth... [2023-12-27 21:52:41,209][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000367528_94117888.pth [2023-12-27 21:52:41,436][106225] Updated weights for policy 1, policy_version 369361 (0.0008) [2023-12-27 21:52:41,500][106225] Updated weights for policy 1, policy_version 369371 (0.0006) [2023-12-27 21:52:41,553][106225] Updated weights for policy 1, policy_version 369381 (0.0005) [2023-12-27 21:52:41,620][106225] Updated weights for policy 1, policy_version 369391 (0.0007) [2023-12-27 21:52:41,974][106226] Updated weights for policy 0, policy_version 368713 (0.0009) [2023-12-27 21:52:42,040][106226] Updated weights for policy 0, policy_version 368723 (0.0008) [2023-12-27 21:52:42,101][106226] Updated weights for policy 0, policy_version 368733 (0.0007) [2023-12-27 21:52:42,165][106226] Updated weights for policy 0, policy_version 368743 (0.0007) [2023-12-27 21:52:42,379][106225] Updated weights for policy 1, policy_version 369401 (0.0009) [2023-12-27 21:52:42,440][106225] Updated weights for policy 1, policy_version 369411 (0.0010) [2023-12-27 21:52:42,514][106225] Updated weights for policy 1, policy_version 369421 (0.0010) [2023-12-27 21:52:42,818][106226] Updated weights for policy 0, policy_version 368753 (0.0008) [2023-12-27 21:52:42,867][106226] Updated weights for policy 0, policy_version 368763 (0.0008) [2023-12-27 21:52:42,928][106226] Updated weights for policy 0, policy_version 368773 (0.0007) [2023-12-27 21:52:43,237][106225] Updated weights for policy 1, policy_version 369431 (0.0011) [2023-12-27 21:52:43,299][106225] Updated weights for policy 1, policy_version 369441 (0.0010) [2023-12-27 21:52:43,357][106225] Updated weights for policy 1, policy_version 369451 (0.0010) [2023-12-27 21:52:43,689][106226] Updated weights for policy 0, policy_version 368783 (0.0008) [2023-12-27 21:52:43,746][106226] Updated weights for policy 0, policy_version 368793 (0.0007) [2023-12-27 21:52:43,807][106226] Updated weights for policy 0, policy_version 368803 (0.0008) [2023-12-27 21:52:44,072][106225] Updated weights for policy 1, policy_version 369461 (0.0010) [2023-12-27 21:52:44,137][106225] Updated weights for policy 1, policy_version 369471 (0.0006) [2023-12-27 21:52:44,204][106225] Updated weights for policy 1, policy_version 369481 (0.0006) [2023-12-27 21:52:44,574][106226] Updated weights for policy 0, policy_version 368813 (0.0009) [2023-12-27 21:52:44,630][106226] Updated weights for policy 0, policy_version 368823 (0.0009) [2023-12-27 21:52:44,688][106226] Updated weights for policy 0, policy_version 368833 (0.0008) [2023-12-27 21:52:44,822][106225] Updated weights for policy 1, policy_version 369491 (0.0010) [2023-12-27 21:52:44,889][106225] Updated weights for policy 1, policy_version 369501 (0.0011) [2023-12-27 21:52:44,947][106225] Updated weights for policy 1, policy_version 369511 (0.0010) [2023-12-27 21:52:45,491][106226] Updated weights for policy 0, policy_version 368843 (0.0009) [2023-12-27 21:52:45,555][106226] Updated weights for policy 0, policy_version 368853 (0.0008) [2023-12-27 21:52:45,609][106226] Updated weights for policy 0, policy_version 368863 (0.0008) [2023-12-27 21:52:45,676][106225] Updated weights for policy 1, policy_version 369521 (0.0010) [2023-12-27 21:52:45,742][106225] Updated weights for policy 1, policy_version 369531 (0.0008) [2023-12-27 21:52:45,807][106225] Updated weights for policy 1, policy_version 369541 (0.0010) [2023-12-27 21:52:45,858][106225] Updated weights for policy 1, policy_version 369551 (0.0010) [2023-12-27 21:52:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 189095936. Throughput: 0: 10072.6, 1: 9907.0. Samples: 189087044. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:46,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-5.914')] [2023-12-27 21:52:46,296][106226] Updated weights for policy 0, policy_version 368873 (0.0009) [2023-12-27 21:52:46,360][106226] Updated weights for policy 0, policy_version 368883 (0.0008) [2023-12-27 21:52:46,424][106226] Updated weights for policy 0, policy_version 368893 (0.0009) [2023-12-27 21:52:46,484][106226] Updated weights for policy 0, policy_version 368903 (0.0009) [2023-12-27 21:52:46,555][106225] Updated weights for policy 1, policy_version 369561 (0.0010) [2023-12-27 21:52:46,599][106225] Updated weights for policy 1, policy_version 369571 (0.0007) [2023-12-27 21:52:46,646][106225] Updated weights for policy 1, policy_version 369581 (0.0009) [2023-12-27 21:52:47,080][106226] Updated weights for policy 0, policy_version 368913 (0.0006) [2023-12-27 21:52:47,146][106226] Updated weights for policy 0, policy_version 368923 (0.0005) [2023-12-27 21:52:47,203][106226] Updated weights for policy 0, policy_version 368933 (0.0005) [2023-12-27 21:52:47,359][106225] Updated weights for policy 1, policy_version 369591 (0.0010) [2023-12-27 21:52:47,419][106225] Updated weights for policy 1, policy_version 369601 (0.0010) [2023-12-27 21:52:47,478][106225] Updated weights for policy 1, policy_version 369611 (0.0010) [2023-12-27 21:52:47,834][106226] Updated weights for policy 0, policy_version 368943 (0.0005) [2023-12-27 21:52:47,882][106226] Updated weights for policy 0, policy_version 368953 (0.0005) [2023-12-27 21:52:47,928][106226] Updated weights for policy 0, policy_version 368963 (0.0006) [2023-12-27 21:52:48,123][106225] Updated weights for policy 1, policy_version 369621 (0.0009) [2023-12-27 21:52:48,179][106225] Updated weights for policy 1, policy_version 369631 (0.0010) [2023-12-27 21:52:48,228][106225] Updated weights for policy 1, policy_version 369641 (0.0010) [2023-12-27 21:52:48,580][106226] Updated weights for policy 0, policy_version 368973 (0.0006) [2023-12-27 21:52:48,640][106226] Updated weights for policy 0, policy_version 368983 (0.0006) [2023-12-27 21:52:48,702][106226] Updated weights for policy 0, policy_version 368993 (0.0005) [2023-12-27 21:52:48,946][106225] Updated weights for policy 1, policy_version 369651 (0.0010) [2023-12-27 21:52:49,007][106225] Updated weights for policy 1, policy_version 369661 (0.0006) [2023-12-27 21:52:49,077][106225] Updated weights for policy 1, policy_version 369671 (0.0005) [2023-12-27 21:52:49,380][106226] Updated weights for policy 0, policy_version 369003 (0.0006) [2023-12-27 21:52:49,432][106226] Updated weights for policy 0, policy_version 369013 (0.0008) [2023-12-27 21:52:49,482][106226] Updated weights for policy 0, policy_version 369023 (0.0008) [2023-12-27 21:52:49,682][106225] Updated weights for policy 1, policy_version 369681 (0.0006) [2023-12-27 21:52:49,745][106225] Updated weights for policy 1, policy_version 369691 (0.0009) [2023-12-27 21:52:49,811][106225] Updated weights for policy 1, policy_version 369701 (0.0008) [2023-12-27 21:52:49,876][106225] Updated weights for policy 1, policy_version 369711 (0.0008) [2023-12-27 21:52:50,312][106226] Updated weights for policy 0, policy_version 369033 (0.0008) [2023-12-27 21:52:50,379][106226] Updated weights for policy 0, policy_version 369043 (0.0009) [2023-12-27 21:52:50,443][106226] Updated weights for policy 0, policy_version 369053 (0.0009) [2023-12-27 21:52:50,506][106226] Updated weights for policy 0, policy_version 369063 (0.0008) [2023-12-27 21:52:50,549][106225] Updated weights for policy 1, policy_version 369721 (0.0008) [2023-12-27 21:52:50,620][106225] Updated weights for policy 1, policy_version 369731 (0.0008) [2023-12-27 21:52:50,684][106225] Updated weights for policy 1, policy_version 369741 (0.0009) [2023-12-27 21:52:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 189194240. Throughput: 0: 10009.7, 1: 9907.8. Samples: 189206440. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:51,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.803')] [2023-12-27 21:52:51,234][106226] Updated weights for policy 0, policy_version 369073 (0.0006) [2023-12-27 21:52:51,306][106226] Updated weights for policy 0, policy_version 369083 (0.0007) [2023-12-27 21:52:51,382][106226] Updated weights for policy 0, policy_version 369093 (0.0008) [2023-12-27 21:52:51,448][106225] Updated weights for policy 1, policy_version 369751 (0.0007) [2023-12-27 21:52:51,512][106225] Updated weights for policy 1, policy_version 369761 (0.0007) [2023-12-27 21:52:51,572][106225] Updated weights for policy 1, policy_version 369771 (0.0006) [2023-12-27 21:52:52,115][106226] Updated weights for policy 0, policy_version 369103 (0.0008) [2023-12-27 21:52:52,169][106226] Updated weights for policy 0, policy_version 369113 (0.0008) [2023-12-27 21:52:52,224][106225] Updated weights for policy 1, policy_version 369781 (0.0006) [2023-12-27 21:52:52,228][106226] Updated weights for policy 0, policy_version 369123 (0.0008) [2023-12-27 21:52:52,292][106225] Updated weights for policy 1, policy_version 369791 (0.0006) [2023-12-27 21:52:52,368][106225] Updated weights for policy 1, policy_version 369801 (0.0007) [2023-12-27 21:52:52,949][106226] Updated weights for policy 0, policy_version 369133 (0.0007) [2023-12-27 21:52:53,020][106226] Updated weights for policy 0, policy_version 369143 (0.0006) [2023-12-27 21:52:53,054][106225] Updated weights for policy 1, policy_version 369811 (0.0006) [2023-12-27 21:52:53,088][106226] Updated weights for policy 0, policy_version 369153 (0.0005) [2023-12-27 21:52:53,100][106225] Updated weights for policy 1, policy_version 369821 (0.0005) [2023-12-27 21:52:53,149][106225] Updated weights for policy 1, policy_version 369831 (0.0005) [2023-12-27 21:52:53,680][106226] Updated weights for policy 0, policy_version 369163 (0.0007) [2023-12-27 21:52:53,729][106226] Updated weights for policy 0, policy_version 369173 (0.0009) [2023-12-27 21:52:53,778][106226] Updated weights for policy 0, policy_version 369183 (0.0008) [2023-12-27 21:52:53,788][106225] Updated weights for policy 1, policy_version 369841 (0.0005) [2023-12-27 21:52:53,836][106225] Updated weights for policy 1, policy_version 369851 (0.0005) [2023-12-27 21:52:53,888][106225] Updated weights for policy 1, policy_version 369861 (0.0005) [2023-12-27 21:52:53,948][106225] Updated weights for policy 1, policy_version 369871 (0.0005) [2023-12-27 21:52:54,545][106226] Updated weights for policy 0, policy_version 369193 (0.0007) [2023-12-27 21:52:54,549][106225] Updated weights for policy 1, policy_version 369881 (0.0008) [2023-12-27 21:52:54,595][106226] Updated weights for policy 0, policy_version 369203 (0.0007) [2023-12-27 21:52:54,614][106225] Updated weights for policy 1, policy_version 369891 (0.0007) [2023-12-27 21:52:54,648][106226] Updated weights for policy 0, policy_version 369213 (0.0008) [2023-12-27 21:52:54,675][106225] Updated weights for policy 1, policy_version 369901 (0.0005) [2023-12-27 21:52:54,716][106226] Updated weights for policy 0, policy_version 369223 (0.0009) [2023-12-27 21:52:55,253][106225] Updated weights for policy 1, policy_version 369911 (0.0009) [2023-12-27 21:52:55,310][106225] Updated weights for policy 1, policy_version 369921 (0.0009) [2023-12-27 21:52:55,362][106225] Updated weights for policy 1, policy_version 369931 (0.0007) [2023-12-27 21:52:55,492][106226] Updated weights for policy 0, policy_version 369233 (0.0009) [2023-12-27 21:52:55,552][106226] Updated weights for policy 0, policy_version 369243 (0.0009) [2023-12-27 21:52:55,602][106226] Updated weights for policy 0, policy_version 369253 (0.0009) [2023-12-27 21:52:55,982][106225] Updated weights for policy 1, policy_version 369941 (0.0008) [2023-12-27 21:52:56,029][106225] Updated weights for policy 1, policy_version 369951 (0.0010) [2023-12-27 21:52:56,088][106225] Updated weights for policy 1, policy_version 369961 (0.0007) [2023-12-27 21:52:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 189300736. Throughput: 0: 9984.3, 1: 9937.4. Samples: 189266656. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:52:56,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-5.954')] [2023-12-27 21:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000369256_94560256.pth... [2023-12-27 21:52:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000369968_94740480.pth... [2023-12-27 21:52:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000368784_94437376.pth [2023-12-27 21:52:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000368072_94257152.pth [2023-12-27 21:52:56,402][106226] Updated weights for policy 0, policy_version 369263 (0.0006) [2023-12-27 21:52:56,464][106226] Updated weights for policy 0, policy_version 369273 (0.0007) [2023-12-27 21:52:56,519][106226] Updated weights for policy 0, policy_version 369283 (0.0008) [2023-12-27 21:52:56,765][106225] Updated weights for policy 1, policy_version 369971 (0.0008) [2023-12-27 21:52:56,818][106225] Updated weights for policy 1, policy_version 369981 (0.0007) [2023-12-27 21:52:56,884][106225] Updated weights for policy 1, policy_version 369991 (0.0008) [2023-12-27 21:52:57,241][106226] Updated weights for policy 0, policy_version 369293 (0.0008) [2023-12-27 21:52:57,311][106226] Updated weights for policy 0, policy_version 369303 (0.0009) [2023-12-27 21:52:57,370][106226] Updated weights for policy 0, policy_version 369313 (0.0009) [2023-12-27 21:52:57,464][106225] Updated weights for policy 1, policy_version 370001 (0.0006) [2023-12-27 21:52:57,522][106225] Updated weights for policy 1, policy_version 370011 (0.0005) [2023-12-27 21:52:57,589][106225] Updated weights for policy 1, policy_version 370021 (0.0007) [2023-12-27 21:52:57,636][106225] Updated weights for policy 1, policy_version 370031 (0.0008) [2023-12-27 21:52:58,124][106226] Updated weights for policy 0, policy_version 369323 (0.0009) [2023-12-27 21:52:58,181][106226] Updated weights for policy 0, policy_version 369333 (0.0008) [2023-12-27 21:52:58,245][106226] Updated weights for policy 0, policy_version 369343 (0.0009) [2023-12-27 21:52:58,291][106225] Updated weights for policy 1, policy_version 370041 (0.0008) [2023-12-27 21:52:58,357][106225] Updated weights for policy 1, policy_version 370051 (0.0008) [2023-12-27 21:52:58,428][106225] Updated weights for policy 1, policy_version 370061 (0.0007) [2023-12-27 21:52:59,137][106226] Updated weights for policy 0, policy_version 369353 (0.0009) [2023-12-27 21:52:59,198][106226] Updated weights for policy 0, policy_version 369363 (0.0008) [2023-12-27 21:52:59,269][106226] Updated weights for policy 0, policy_version 369373 (0.0009) [2023-12-27 21:52:59,312][106225] Updated weights for policy 1, policy_version 370071 (0.0007) [2023-12-27 21:52:59,345][106226] Updated weights for policy 0, policy_version 369383 (0.0008) [2023-12-27 21:52:59,400][106225] Updated weights for policy 1, policy_version 370081 (0.0026) [2023-12-27 21:52:59,457][106225] Updated weights for policy 1, policy_version 370091 (0.0008) [2023-12-27 21:53:00,079][106226] Updated weights for policy 0, policy_version 369393 (0.0009) [2023-12-27 21:53:00,124][106226] Updated weights for policy 0, policy_version 369403 (0.0009) [2023-12-27 21:53:00,179][106226] Updated weights for policy 0, policy_version 369413 (0.0008) [2023-12-27 21:53:00,216][106225] Updated weights for policy 1, policy_version 370101 (0.0008) [2023-12-27 21:53:00,278][106225] Updated weights for policy 1, policy_version 370111 (0.0008) [2023-12-27 21:53:00,332][106225] Updated weights for policy 1, policy_version 370121 (0.0008) [2023-12-27 21:53:00,993][106226] Updated weights for policy 0, policy_version 369423 (0.0010) [2023-12-27 21:53:01,060][106226] Updated weights for policy 0, policy_version 369433 (0.0010) [2023-12-27 21:53:01,065][106225] Updated weights for policy 1, policy_version 370131 (0.0009) [2023-12-27 21:53:01,115][106226] Updated weights for policy 0, policy_version 369443 (0.0010) [2023-12-27 21:53:01,125][106225] Updated weights for policy 1, policy_version 370141 (0.0007) [2023-12-27 21:53:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 189390848. Throughput: 0: 9958.8, 1: 10047.7. Samples: 189382740. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:01,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-5.435')] [2023-12-27 21:53:01,182][106225] Updated weights for policy 1, policy_version 370151 (0.0008) [2023-12-27 21:53:01,868][106226] Updated weights for policy 0, policy_version 369453 (0.0009) [2023-12-27 21:53:01,902][106225] Updated weights for policy 1, policy_version 370161 (0.0007) [2023-12-27 21:53:01,929][106226] Updated weights for policy 0, policy_version 369463 (0.0008) [2023-12-27 21:53:01,954][106225] Updated weights for policy 1, policy_version 370171 (0.0005) [2023-12-27 21:53:01,991][106226] Updated weights for policy 0, policy_version 369473 (0.0008) [2023-12-27 21:53:02,014][106225] Updated weights for policy 1, policy_version 370181 (0.0006) [2023-12-27 21:53:02,071][106225] Updated weights for policy 1, policy_version 370191 (0.0006) [2023-12-27 21:53:02,663][106226] Updated weights for policy 0, policy_version 369483 (0.0008) [2023-12-27 21:53:02,721][106226] Updated weights for policy 0, policy_version 369493 (0.0008) [2023-12-27 21:53:02,781][106226] Updated weights for policy 0, policy_version 369503 (0.0007) [2023-12-27 21:53:02,806][106225] Updated weights for policy 1, policy_version 370201 (0.0007) [2023-12-27 21:53:02,865][106225] Updated weights for policy 1, policy_version 370211 (0.0006) [2023-12-27 21:53:02,918][106225] Updated weights for policy 1, policy_version 370221 (0.0008) [2023-12-27 21:53:03,483][106226] Updated weights for policy 0, policy_version 369513 (0.0008) [2023-12-27 21:53:03,537][106225] Updated weights for policy 1, policy_version 370231 (0.0007) [2023-12-27 21:53:03,539][106226] Updated weights for policy 0, policy_version 369523 (0.0007) [2023-12-27 21:53:03,596][106226] Updated weights for policy 0, policy_version 369533 (0.0007) [2023-12-27 21:53:03,598][106225] Updated weights for policy 1, policy_version 370241 (0.0006) [2023-12-27 21:53:03,643][106226] Updated weights for policy 0, policy_version 369543 (0.0006) [2023-12-27 21:53:03,645][106225] Updated weights for policy 1, policy_version 370251 (0.0006) [2023-12-27 21:53:04,339][106226] Updated weights for policy 0, policy_version 369553 (0.0010) [2023-12-27 21:53:04,397][106226] Updated weights for policy 0, policy_version 369563 (0.0010) [2023-12-27 21:53:04,405][106225] Updated weights for policy 1, policy_version 370261 (0.0007) [2023-12-27 21:53:04,460][106226] Updated weights for policy 0, policy_version 369573 (0.0010) [2023-12-27 21:53:04,466][106225] Updated weights for policy 1, policy_version 370271 (0.0008) [2023-12-27 21:53:04,526][106225] Updated weights for policy 1, policy_version 370281 (0.0007) [2023-12-27 21:53:05,079][106226] Updated weights for policy 0, policy_version 369583 (0.0008) [2023-12-27 21:53:05,137][106226] Updated weights for policy 0, policy_version 369593 (0.0005) [2023-12-27 21:53:05,192][106226] Updated weights for policy 0, policy_version 369603 (0.0008) [2023-12-27 21:53:05,270][106225] Updated weights for policy 1, policy_version 370291 (0.0008) [2023-12-27 21:53:05,331][106225] Updated weights for policy 1, policy_version 370301 (0.0008) [2023-12-27 21:53:05,386][106225] Updated weights for policy 1, policy_version 370311 (0.0008) [2023-12-27 21:53:05,779][106226] Updated weights for policy 0, policy_version 369613 (0.0007) [2023-12-27 21:53:05,834][106226] Updated weights for policy 0, policy_version 369623 (0.0005) [2023-12-27 21:53:05,890][106226] Updated weights for policy 0, policy_version 369633 (0.0005) [2023-12-27 21:53:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 189489152. Throughput: 0: 9988.7, 1: 10007.6. Samples: 189501356. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:06,175][105115] Avg episode reward: [(0, '-4.841'), (1, '-5.664')] [2023-12-27 21:53:06,208][106225] Updated weights for policy 1, policy_version 370321 (0.0007) [2023-12-27 21:53:06,272][106225] Updated weights for policy 1, policy_version 370331 (0.0010) [2023-12-27 21:53:06,342][106225] Updated weights for policy 1, policy_version 370341 (0.0009) [2023-12-27 21:53:06,408][106225] Updated weights for policy 1, policy_version 370351 (0.0008) [2023-12-27 21:53:06,472][106226] Updated weights for policy 0, policy_version 369643 (0.0006) [2023-12-27 21:53:06,538][106226] Updated weights for policy 0, policy_version 369653 (0.0008) [2023-12-27 21:53:06,595][106226] Updated weights for policy 0, policy_version 369663 (0.0009) [2023-12-27 21:53:07,140][106225] Updated weights for policy 1, policy_version 370361 (0.0008) [2023-12-27 21:53:07,209][106225] Updated weights for policy 1, policy_version 370371 (0.0010) [2023-12-27 21:53:07,263][106226] Updated weights for policy 0, policy_version 369673 (0.0009) [2023-12-27 21:53:07,279][106225] Updated weights for policy 1, policy_version 370381 (0.0011) [2023-12-27 21:53:07,323][106226] Updated weights for policy 0, policy_version 369683 (0.0006) [2023-12-27 21:53:07,388][106226] Updated weights for policy 0, policy_version 369693 (0.0007) [2023-12-27 21:53:07,448][106226] Updated weights for policy 0, policy_version 369703 (0.0008) [2023-12-27 21:53:07,921][106225] Updated weights for policy 1, policy_version 370391 (0.0010) [2023-12-27 21:53:07,967][106225] Updated weights for policy 1, policy_version 370401 (0.0010) [2023-12-27 21:53:08,021][106225] Updated weights for policy 1, policy_version 370411 (0.0010) [2023-12-27 21:53:08,169][106226] Updated weights for policy 0, policy_version 369713 (0.0007) [2023-12-27 21:53:08,220][106226] Updated weights for policy 0, policy_version 369723 (0.0007) [2023-12-27 21:53:08,273][106226] Updated weights for policy 0, policy_version 369733 (0.0008) [2023-12-27 21:53:08,767][106225] Updated weights for policy 1, policy_version 370421 (0.0010) [2023-12-27 21:53:08,825][106225] Updated weights for policy 1, policy_version 370431 (0.0007) [2023-12-27 21:53:08,879][106225] Updated weights for policy 1, policy_version 370441 (0.0008) [2023-12-27 21:53:09,028][106226] Updated weights for policy 0, policy_version 369743 (0.0010) [2023-12-27 21:53:09,082][106226] Updated weights for policy 0, policy_version 369753 (0.0010) [2023-12-27 21:53:09,132][106226] Updated weights for policy 0, policy_version 369763 (0.0010) [2023-12-27 21:53:09,664][106225] Updated weights for policy 1, policy_version 370451 (0.0008) [2023-12-27 21:53:09,724][106225] Updated weights for policy 1, policy_version 370461 (0.0008) [2023-12-27 21:53:09,782][106225] Updated weights for policy 1, policy_version 370471 (0.0008) [2023-12-27 21:53:09,919][106226] Updated weights for policy 0, policy_version 369773 (0.0011) [2023-12-27 21:53:09,984][106226] Updated weights for policy 0, policy_version 369783 (0.0011) [2023-12-27 21:53:10,046][106226] Updated weights for policy 0, policy_version 369793 (0.0011) [2023-12-27 21:53:10,561][106225] Updated weights for policy 1, policy_version 370481 (0.0008) [2023-12-27 21:53:10,618][106225] Updated weights for policy 1, policy_version 370491 (0.0009) [2023-12-27 21:53:10,667][106225] Updated weights for policy 1, policy_version 370501 (0.0007) [2023-12-27 21:53:10,709][106226] Updated weights for policy 0, policy_version 369803 (0.0011) [2023-12-27 21:53:10,724][106225] Updated weights for policy 1, policy_version 370511 (0.0009) [2023-12-27 21:53:10,769][106226] Updated weights for policy 0, policy_version 369813 (0.0011) [2023-12-27 21:53:10,822][106226] Updated weights for policy 0, policy_version 369823 (0.0010) [2023-12-27 21:53:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 189587456. Throughput: 0: 9991.2, 1: 9994.7. Samples: 189559432. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:11,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.952')] [2023-12-27 21:53:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000369832_94707712.pth... [2023-12-27 21:53:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000370512_94879744.pth... [2023-12-27 21:53:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000368712_94420992.pth [2023-12-27 21:53:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000369360_94584832.pth [2023-12-27 21:53:11,495][106225] Updated weights for policy 1, policy_version 370521 (0.0009) [2023-12-27 21:53:11,548][106225] Updated weights for policy 1, policy_version 370531 (0.0008) [2023-12-27 21:53:11,579][106226] Updated weights for policy 0, policy_version 369833 (0.0010) [2023-12-27 21:53:11,598][106225] Updated weights for policy 1, policy_version 370541 (0.0007) [2023-12-27 21:53:11,639][106226] Updated weights for policy 0, policy_version 369843 (0.0009) [2023-12-27 21:53:11,713][106226] Updated weights for policy 0, policy_version 369853 (0.0007) [2023-12-27 21:53:11,786][106226] Updated weights for policy 0, policy_version 369863 (0.0008) [2023-12-27 21:53:12,402][106225] Updated weights for policy 1, policy_version 370551 (0.0008) [2023-12-27 21:53:12,467][106225] Updated weights for policy 1, policy_version 370561 (0.0006) [2023-12-27 21:53:12,488][106226] Updated weights for policy 0, policy_version 369873 (0.0008) [2023-12-27 21:53:12,535][106225] Updated weights for policy 1, policy_version 370571 (0.0005) [2023-12-27 21:53:12,548][106226] Updated weights for policy 0, policy_version 369883 (0.0009) [2023-12-27 21:53:12,605][106226] Updated weights for policy 0, policy_version 369893 (0.0009) [2023-12-27 21:53:13,080][106225] Updated weights for policy 1, policy_version 370581 (0.0005) [2023-12-27 21:53:13,129][106225] Updated weights for policy 1, policy_version 370591 (0.0006) [2023-12-27 21:53:13,183][106225] Updated weights for policy 1, policy_version 370601 (0.0010) [2023-12-27 21:53:13,371][106226] Updated weights for policy 0, policy_version 369903 (0.0008) [2023-12-27 21:53:13,440][106226] Updated weights for policy 0, policy_version 369913 (0.0006) [2023-12-27 21:53:13,502][106226] Updated weights for policy 0, policy_version 369923 (0.0006) [2023-12-27 21:53:13,831][106225] Updated weights for policy 1, policy_version 370611 (0.0008) [2023-12-27 21:53:13,882][106225] Updated weights for policy 1, policy_version 370621 (0.0009) [2023-12-27 21:53:13,930][106225] Updated weights for policy 1, policy_version 370631 (0.0008) [2023-12-27 21:53:14,161][106226] Updated weights for policy 0, policy_version 369933 (0.0008) [2023-12-27 21:53:14,226][106226] Updated weights for policy 0, policy_version 369943 (0.0009) [2023-12-27 21:53:14,285][106226] Updated weights for policy 0, policy_version 369953 (0.0008) [2023-12-27 21:53:14,687][106225] Updated weights for policy 1, policy_version 370641 (0.0010) [2023-12-27 21:53:14,736][106225] Updated weights for policy 1, policy_version 370651 (0.0008) [2023-12-27 21:53:14,792][106225] Updated weights for policy 1, policy_version 370661 (0.0007) [2023-12-27 21:53:14,854][106225] Updated weights for policy 1, policy_version 370671 (0.0007) [2023-12-27 21:53:15,036][106226] Updated weights for policy 0, policy_version 369963 (0.0009) [2023-12-27 21:53:15,099][106226] Updated weights for policy 0, policy_version 369973 (0.0011) [2023-12-27 21:53:15,154][106226] Updated weights for policy 0, policy_version 369983 (0.0011) [2023-12-27 21:53:15,520][106225] Updated weights for policy 1, policy_version 370681 (0.0007) [2023-12-27 21:53:15,576][106225] Updated weights for policy 1, policy_version 370691 (0.0007) [2023-12-27 21:53:15,640][106225] Updated weights for policy 1, policy_version 370701 (0.0005) [2023-12-27 21:53:15,901][106226] Updated weights for policy 0, policy_version 369993 (0.0011) [2023-12-27 21:53:15,967][106226] Updated weights for policy 0, policy_version 370003 (0.0009) [2023-12-27 21:53:16,028][106226] Updated weights for policy 0, policy_version 370013 (0.0011) [2023-12-27 21:53:16,084][106226] Updated weights for policy 0, policy_version 370023 (0.0010) [2023-12-27 21:53:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 189685760. Throughput: 0: 9846.6, 1: 9882.0. Samples: 189673912. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:16,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.587')] [2023-12-27 21:53:16,260][106225] Updated weights for policy 1, policy_version 370711 (0.0005) [2023-12-27 21:53:16,318][106225] Updated weights for policy 1, policy_version 370721 (0.0006) [2023-12-27 21:53:16,373][106225] Updated weights for policy 1, policy_version 370731 (0.0008) [2023-12-27 21:53:16,769][106226] Updated weights for policy 0, policy_version 370033 (0.0008) [2023-12-27 21:53:16,824][106226] Updated weights for policy 0, policy_version 370043 (0.0009) [2023-12-27 21:53:16,890][106226] Updated weights for policy 0, policy_version 370053 (0.0010) [2023-12-27 21:53:16,984][106225] Updated weights for policy 1, policy_version 370741 (0.0005) [2023-12-27 21:53:17,032][106225] Updated weights for policy 1, policy_version 370751 (0.0005) [2023-12-27 21:53:17,086][106225] Updated weights for policy 1, policy_version 370761 (0.0005) [2023-12-27 21:53:17,673][106226] Updated weights for policy 0, policy_version 370063 (0.0010) [2023-12-27 21:53:17,708][106225] Updated weights for policy 1, policy_version 370771 (0.0007) [2023-12-27 21:53:17,730][106226] Updated weights for policy 0, policy_version 370073 (0.0011) [2023-12-27 21:53:17,768][106225] Updated weights for policy 1, policy_version 370781 (0.0010) [2023-12-27 21:53:17,794][106226] Updated weights for policy 0, policy_version 370083 (0.0011) [2023-12-27 21:53:17,825][106225] Updated weights for policy 1, policy_version 370791 (0.0010) [2023-12-27 21:53:18,450][106225] Updated weights for policy 1, policy_version 370801 (0.0007) [2023-12-27 21:53:18,453][106226] Updated weights for policy 0, policy_version 370093 (0.0009) [2023-12-27 21:53:18,511][106225] Updated weights for policy 1, policy_version 370811 (0.0010) [2023-12-27 21:53:18,515][106226] Updated weights for policy 0, policy_version 370103 (0.0008) [2023-12-27 21:53:18,572][106225] Updated weights for policy 1, policy_version 370821 (0.0010) [2023-12-27 21:53:18,579][106226] Updated weights for policy 0, policy_version 370113 (0.0006) [2023-12-27 21:53:18,638][106225] Updated weights for policy 1, policy_version 370831 (0.0010) [2023-12-27 21:53:19,234][106226] Updated weights for policy 0, policy_version 370123 (0.0007) [2023-12-27 21:53:19,287][106225] Updated weights for policy 1, policy_version 370841 (0.0011) [2023-12-27 21:53:19,297][106226] Updated weights for policy 0, policy_version 370133 (0.0008) [2023-12-27 21:53:19,352][106225] Updated weights for policy 1, policy_version 370851 (0.0010) [2023-12-27 21:53:19,363][106226] Updated weights for policy 0, policy_version 370143 (0.0009) [2023-12-27 21:53:19,415][106225] Updated weights for policy 1, policy_version 370861 (0.0010) [2023-12-27 21:53:20,083][106226] Updated weights for policy 0, policy_version 370153 (0.0010) [2023-12-27 21:53:20,142][106226] Updated weights for policy 0, policy_version 370163 (0.0008) [2023-12-27 21:53:20,192][106225] Updated weights for policy 1, policy_version 370871 (0.0008) [2023-12-27 21:53:20,201][106226] Updated weights for policy 0, policy_version 370173 (0.0011) [2023-12-27 21:53:20,245][106225] Updated weights for policy 1, policy_version 370881 (0.0009) [2023-12-27 21:53:20,260][106226] Updated weights for policy 0, policy_version 370183 (0.0007) [2023-12-27 21:53:20,304][106225] Updated weights for policy 1, policy_version 370891 (0.0008) [2023-12-27 21:53:20,984][106226] Updated weights for policy 0, policy_version 370193 (0.0010) [2023-12-27 21:53:21,042][106226] Updated weights for policy 0, policy_version 370203 (0.0011) [2023-12-27 21:53:21,045][106225] Updated weights for policy 1, policy_version 370901 (0.0007) [2023-12-27 21:53:21,107][106226] Updated weights for policy 0, policy_version 370213 (0.0011) [2023-12-27 21:53:21,109][106225] Updated weights for policy 1, policy_version 370911 (0.0007) [2023-12-27 21:53:21,173][106225] Updated weights for policy 1, policy_version 370921 (0.0009) [2023-12-27 21:53:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 189784064. Throughput: 0: 9706.4, 1: 9928.8. Samples: 189794196. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:21,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-5.789')] [2023-12-27 21:53:21,914][106226] Updated weights for policy 0, policy_version 370223 (0.0009) [2023-12-27 21:53:21,962][106225] Updated weights for policy 1, policy_version 370931 (0.0008) [2023-12-27 21:53:21,979][106226] Updated weights for policy 0, policy_version 370233 (0.0008) [2023-12-27 21:53:22,022][106225] Updated weights for policy 1, policy_version 370941 (0.0008) [2023-12-27 21:53:22,035][106226] Updated weights for policy 0, policy_version 370243 (0.0006) [2023-12-27 21:53:22,079][106225] Updated weights for policy 1, policy_version 370951 (0.0008) [2023-12-27 21:53:22,773][106225] Updated weights for policy 1, policy_version 370961 (0.0008) [2023-12-27 21:53:22,825][106226] Updated weights for policy 0, policy_version 370253 (0.0008) [2023-12-27 21:53:22,836][106225] Updated weights for policy 1, policy_version 370971 (0.0006) [2023-12-27 21:53:22,889][106226] Updated weights for policy 0, policy_version 370263 (0.0009) [2023-12-27 21:53:22,892][106225] Updated weights for policy 1, policy_version 370981 (0.0006) [2023-12-27 21:53:22,949][106226] Updated weights for policy 0, policy_version 370273 (0.0006) [2023-12-27 21:53:22,954][106225] Updated weights for policy 1, policy_version 370991 (0.0008) [2023-12-27 21:53:23,629][106226] Updated weights for policy 0, policy_version 370283 (0.0007) [2023-12-27 21:53:23,679][106225] Updated weights for policy 1, policy_version 371001 (0.0009) [2023-12-27 21:53:23,682][106226] Updated weights for policy 0, policy_version 370293 (0.0006) [2023-12-27 21:53:23,733][106226] Updated weights for policy 0, policy_version 370303 (0.0008) [2023-12-27 21:53:23,737][106225] Updated weights for policy 1, policy_version 371011 (0.0006) [2023-12-27 21:53:23,787][106225] Updated weights for policy 1, policy_version 371021 (0.0007) [2023-12-27 21:53:24,360][106225] Updated weights for policy 1, policy_version 371031 (0.0006) [2023-12-27 21:53:24,419][106225] Updated weights for policy 1, policy_version 371041 (0.0008) [2023-12-27 21:53:24,473][106225] Updated weights for policy 1, policy_version 371051 (0.0008) [2023-12-27 21:53:24,493][106226] Updated weights for policy 0, policy_version 370313 (0.0008) [2023-12-27 21:53:24,552][106226] Updated weights for policy 0, policy_version 370323 (0.0008) [2023-12-27 21:53:24,601][106226] Updated weights for policy 0, policy_version 370333 (0.0005) [2023-12-27 21:53:24,654][106226] Updated weights for policy 0, policy_version 370343 (0.0005) [2023-12-27 21:53:25,163][106225] Updated weights for policy 1, policy_version 371061 (0.0007) [2023-12-27 21:53:25,211][106225] Updated weights for policy 1, policy_version 371071 (0.0005) [2023-12-27 21:53:25,275][106225] Updated weights for policy 1, policy_version 371081 (0.0006) [2023-12-27 21:53:25,355][106226] Updated weights for policy 0, policy_version 370353 (0.0008) [2023-12-27 21:53:25,405][106226] Updated weights for policy 0, policy_version 370363 (0.0009) [2023-12-27 21:53:25,454][106226] Updated weights for policy 0, policy_version 370373 (0.0008) [2023-12-27 21:53:25,848][106225] Updated weights for policy 1, policy_version 371091 (0.0006) [2023-12-27 21:53:25,906][106225] Updated weights for policy 1, policy_version 371101 (0.0006) [2023-12-27 21:53:25,967][106225] Updated weights for policy 1, policy_version 371111 (0.0005) [2023-12-27 21:53:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 189882368. Throughput: 0: 9606.9, 1: 9881.7. Samples: 189850592. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:26,176][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.724')] [2023-12-27 21:53:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000370376_94846976.pth... [2023-12-27 21:53:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000371120_95035392.pth... [2023-12-27 21:53:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000369256_94560256.pth [2023-12-27 21:53:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000369968_94740480.pth [2023-12-27 21:53:26,265][106226] Updated weights for policy 0, policy_version 370383 (0.0008) [2023-12-27 21:53:26,320][106226] Updated weights for policy 0, policy_version 370393 (0.0008) [2023-12-27 21:53:26,376][106226] Updated weights for policy 0, policy_version 370403 (0.0010) [2023-12-27 21:53:26,538][106225] Updated weights for policy 1, policy_version 371121 (0.0006) [2023-12-27 21:53:26,601][106225] Updated weights for policy 1, policy_version 371131 (0.0009) [2023-12-27 21:53:26,656][106225] Updated weights for policy 1, policy_version 371141 (0.0008) [2023-12-27 21:53:26,712][106225] Updated weights for policy 1, policy_version 371151 (0.0009) [2023-12-27 21:53:27,098][106226] Updated weights for policy 0, policy_version 370413 (0.0009) [2023-12-27 21:53:27,155][106226] Updated weights for policy 0, policy_version 370423 (0.0008) [2023-12-27 21:53:27,216][106226] Updated weights for policy 0, policy_version 370433 (0.0008) [2023-12-27 21:53:27,408][106225] Updated weights for policy 1, policy_version 371161 (0.0008) [2023-12-27 21:53:27,453][106225] Updated weights for policy 1, policy_version 371171 (0.0008) [2023-12-27 21:53:27,497][106225] Updated weights for policy 1, policy_version 371181 (0.0006) [2023-12-27 21:53:27,966][106226] Updated weights for policy 0, policy_version 370443 (0.0010) [2023-12-27 21:53:28,020][106226] Updated weights for policy 0, policy_version 370453 (0.0009) [2023-12-27 21:53:28,074][106226] Updated weights for policy 0, policy_version 370463 (0.0008) [2023-12-27 21:53:28,191][106225] Updated weights for policy 1, policy_version 371191 (0.0009) [2023-12-27 21:53:28,240][106225] Updated weights for policy 1, policy_version 371201 (0.0010) [2023-12-27 21:53:28,292][106225] Updated weights for policy 1, policy_version 371211 (0.0010) [2023-12-27 21:53:28,828][106226] Updated weights for policy 0, policy_version 370473 (0.0008) [2023-12-27 21:53:28,882][106226] Updated weights for policy 0, policy_version 370483 (0.0007) [2023-12-27 21:53:28,934][106226] Updated weights for policy 0, policy_version 370493 (0.0007) [2023-12-27 21:53:28,997][106226] Updated weights for policy 0, policy_version 370503 (0.0008) [2023-12-27 21:53:29,012][106225] Updated weights for policy 1, policy_version 371221 (0.0010) [2023-12-27 21:53:29,066][106225] Updated weights for policy 1, policy_version 371231 (0.0009) [2023-12-27 21:53:29,116][106225] Updated weights for policy 1, policy_version 371241 (0.0010) [2023-12-27 21:53:29,762][106226] Updated weights for policy 0, policy_version 370513 (0.0009) [2023-12-27 21:53:29,820][106226] Updated weights for policy 0, policy_version 370523 (0.0008) [2023-12-27 21:53:29,877][106225] Updated weights for policy 1, policy_version 371251 (0.0010) [2023-12-27 21:53:29,891][106226] Updated weights for policy 0, policy_version 370533 (0.0008) [2023-12-27 21:53:29,959][106225] Updated weights for policy 1, policy_version 371261 (0.0010) [2023-12-27 21:53:30,015][106225] Updated weights for policy 1, policy_version 371271 (0.0010) [2023-12-27 21:53:30,660][106225] Updated weights for policy 1, policy_version 371281 (0.0010) [2023-12-27 21:53:30,669][106226] Updated weights for policy 0, policy_version 370543 (0.0008) [2023-12-27 21:53:30,718][106225] Updated weights for policy 1, policy_version 371291 (0.0005) [2023-12-27 21:53:30,726][106226] Updated weights for policy 0, policy_version 370553 (0.0007) [2023-12-27 21:53:30,774][106225] Updated weights for policy 1, policy_version 371301 (0.0005) [2023-12-27 21:53:30,783][106226] Updated weights for policy 0, policy_version 370563 (0.0008) [2023-12-27 21:53:30,828][106225] Updated weights for policy 1, policy_version 371311 (0.0005) [2023-12-27 21:53:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 189980672. Throughput: 0: 9611.6, 1: 10014.2. Samples: 189970208. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:31,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-5.512')] [2023-12-27 21:53:31,489][106225] Updated weights for policy 1, policy_version 371321 (0.0006) [2023-12-27 21:53:31,558][106225] Updated weights for policy 1, policy_version 371331 (0.0008) [2023-12-27 21:53:31,603][106226] Updated weights for policy 0, policy_version 370573 (0.0007) [2023-12-27 21:53:31,629][106225] Updated weights for policy 1, policy_version 371341 (0.0008) [2023-12-27 21:53:31,668][106226] Updated weights for policy 0, policy_version 370583 (0.0008) [2023-12-27 21:53:31,734][106226] Updated weights for policy 0, policy_version 370593 (0.0008) [2023-12-27 21:53:32,316][106225] Updated weights for policy 1, policy_version 371351 (0.0008) [2023-12-27 21:53:32,386][106225] Updated weights for policy 1, policy_version 371361 (0.0008) [2023-12-27 21:53:32,389][106226] Updated weights for policy 0, policy_version 370603 (0.0008) [2023-12-27 21:53:32,452][106225] Updated weights for policy 1, policy_version 371371 (0.0008) [2023-12-27 21:53:32,454][106226] Updated weights for policy 0, policy_version 370613 (0.0007) [2023-12-27 21:53:32,516][106226] Updated weights for policy 0, policy_version 370623 (0.0008) [2023-12-27 21:53:33,138][106226] Updated weights for policy 0, policy_version 370633 (0.0008) [2023-12-27 21:53:33,195][106226] Updated weights for policy 0, policy_version 370643 (0.0006) [2023-12-27 21:53:33,201][106225] Updated weights for policy 1, policy_version 371381 (0.0006) [2023-12-27 21:53:33,248][106226] Updated weights for policy 0, policy_version 370653 (0.0007) [2023-12-27 21:53:33,259][106225] Updated weights for policy 1, policy_version 371391 (0.0009) [2023-12-27 21:53:33,300][106226] Updated weights for policy 0, policy_version 370663 (0.0006) [2023-12-27 21:53:33,314][106225] Updated weights for policy 1, policy_version 371401 (0.0008) [2023-12-27 21:53:33,840][106226] Updated weights for policy 0, policy_version 370673 (0.0007) [2023-12-27 21:53:33,901][106226] Updated weights for policy 0, policy_version 370683 (0.0008) [2023-12-27 21:53:33,955][106226] Updated weights for policy 0, policy_version 370693 (0.0008) [2023-12-27 21:53:34,070][106225] Updated weights for policy 1, policy_version 371411 (0.0008) [2023-12-27 21:53:34,131][106225] Updated weights for policy 1, policy_version 371421 (0.0008) [2023-12-27 21:53:34,194][106225] Updated weights for policy 1, policy_version 371431 (0.0007) [2023-12-27 21:53:34,705][106226] Updated weights for policy 0, policy_version 370703 (0.0008) [2023-12-27 21:53:34,768][106226] Updated weights for policy 0, policy_version 370713 (0.0008) [2023-12-27 21:53:34,823][106226] Updated weights for policy 0, policy_version 370723 (0.0009) [2023-12-27 21:53:34,867][106225] Updated weights for policy 1, policy_version 371441 (0.0006) [2023-12-27 21:53:34,937][106225] Updated weights for policy 1, policy_version 371451 (0.0006) [2023-12-27 21:53:34,998][106225] Updated weights for policy 1, policy_version 371461 (0.0008) [2023-12-27 21:53:35,062][106225] Updated weights for policy 1, policy_version 371471 (0.0008) [2023-12-27 21:53:35,513][106226] Updated weights for policy 0, policy_version 370733 (0.0007) [2023-12-27 21:53:35,569][106226] Updated weights for policy 0, policy_version 370743 (0.0005) [2023-12-27 21:53:35,622][106226] Updated weights for policy 0, policy_version 370753 (0.0005) [2023-12-27 21:53:35,716][106225] Updated weights for policy 1, policy_version 371481 (0.0006) [2023-12-27 21:53:35,783][106225] Updated weights for policy 1, policy_version 371491 (0.0005) [2023-12-27 21:53:35,844][106225] Updated weights for policy 1, policy_version 371501 (0.0008) [2023-12-27 21:53:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 190078976. Throughput: 0: 9637.7, 1: 10003.8. Samples: 190090308. Policy #0 lag: (min: 25.0, avg: 50.7, max: 57.0) [2023-12-27 21:53:36,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.869')] [2023-12-27 21:53:36,215][106226] Updated weights for policy 0, policy_version 370763 (0.0007) [2023-12-27 21:53:36,277][106226] Updated weights for policy 0, policy_version 370773 (0.0008) [2023-12-27 21:53:36,337][106226] Updated weights for policy 0, policy_version 370783 (0.0008) [2023-12-27 21:53:36,450][106225] Updated weights for policy 1, policy_version 371511 (0.0009) [2023-12-27 21:53:36,515][106225] Updated weights for policy 1, policy_version 371521 (0.0009) [2023-12-27 21:53:36,579][106225] Updated weights for policy 1, policy_version 371531 (0.0007) [2023-12-27 21:53:37,071][106226] Updated weights for policy 0, policy_version 370793 (0.0008) [2023-12-27 21:53:37,133][106226] Updated weights for policy 0, policy_version 370803 (0.0008) [2023-12-27 21:53:37,193][106226] Updated weights for policy 0, policy_version 370813 (0.0009) [2023-12-27 21:53:37,232][106225] Updated weights for policy 1, policy_version 371541 (0.0006) [2023-12-27 21:53:37,265][106226] Updated weights for policy 0, policy_version 370823 (0.0007) [2023-12-27 21:53:37,288][106225] Updated weights for policy 1, policy_version 371551 (0.0006) [2023-12-27 21:53:37,337][106225] Updated weights for policy 1, policy_version 371561 (0.0008) [2023-12-27 21:53:37,971][106226] Updated weights for policy 0, policy_version 370833 (0.0009) [2023-12-27 21:53:38,024][106226] Updated weights for policy 0, policy_version 370843 (0.0008) [2023-12-27 21:53:38,064][106225] Updated weights for policy 1, policy_version 371571 (0.0008) [2023-12-27 21:53:38,070][106226] Updated weights for policy 0, policy_version 370853 (0.0007) [2023-12-27 21:53:38,131][106225] Updated weights for policy 1, policy_version 371581 (0.0009) [2023-12-27 21:53:38,184][106225] Updated weights for policy 1, policy_version 371591 (0.0007) [2023-12-27 21:53:38,866][106226] Updated weights for policy 0, policy_version 370863 (0.0008) [2023-12-27 21:53:38,899][106225] Updated weights for policy 1, policy_version 371601 (0.0008) [2023-12-27 21:53:38,917][106226] Updated weights for policy 0, policy_version 370873 (0.0008) [2023-12-27 21:53:38,964][106225] Updated weights for policy 1, policy_version 371611 (0.0010) [2023-12-27 21:53:38,975][106226] Updated weights for policy 0, policy_version 370883 (0.0009) [2023-12-27 21:53:39,021][106225] Updated weights for policy 1, policy_version 371621 (0.0006) [2023-12-27 21:53:39,087][106225] Updated weights for policy 1, policy_version 371631 (0.0008) [2023-12-27 21:53:39,777][106226] Updated weights for policy 0, policy_version 370893 (0.0008) [2023-12-27 21:53:39,840][106226] Updated weights for policy 0, policy_version 370903 (0.0008) [2023-12-27 21:53:39,867][106225] Updated weights for policy 1, policy_version 371641 (0.0008) [2023-12-27 21:53:39,908][106226] Updated weights for policy 0, policy_version 370913 (0.0007) [2023-12-27 21:53:39,937][106225] Updated weights for policy 1, policy_version 371651 (0.0009) [2023-12-27 21:53:39,999][106225] Updated weights for policy 1, policy_version 371661 (0.0008) [2023-12-27 21:53:40,551][106226] Updated weights for policy 0, policy_version 370923 (0.0010) [2023-12-27 21:53:40,604][106226] Updated weights for policy 0, policy_version 370933 (0.0008) [2023-12-27 21:53:40,667][106226] Updated weights for policy 0, policy_version 370943 (0.0008) [2023-12-27 21:53:40,669][106225] Updated weights for policy 1, policy_version 371671 (0.0007) [2023-12-27 21:53:40,725][106225] Updated weights for policy 1, policy_version 371681 (0.0005) [2023-12-27 21:53:40,783][106225] Updated weights for policy 1, policy_version 371691 (0.0005) [2023-12-27 21:53:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 190177280. Throughput: 0: 9602.4, 1: 9991.6. Samples: 190148388. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:53:41,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.784')] [2023-12-27 21:53:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000371696_95182848.pth... [2023-12-27 21:53:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000370952_94994432.pth... [2023-12-27 21:53:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000370512_94879744.pth [2023-12-27 21:53:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000371696_95182848.pth [2023-12-27 21:53:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000369832_94707712.pth [2023-12-27 21:53:41,190][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000370952_94994432.pth [2023-12-27 21:53:41,355][106225] Updated weights for policy 1, policy_version 371701 (0.0007) [2023-12-27 21:53:41,417][106225] Updated weights for policy 1, policy_version 371711 (0.0008) [2023-12-27 21:53:41,430][106226] Updated weights for policy 0, policy_version 370953 (0.0007) [2023-12-27 21:53:41,484][106225] Updated weights for policy 1, policy_version 371721 (0.0008) [2023-12-27 21:53:41,494][106226] Updated weights for policy 0, policy_version 370963 (0.0006) [2023-12-27 21:53:41,553][106226] Updated weights for policy 0, policy_version 370973 (0.0007) [2023-12-27 21:53:41,615][106226] Updated weights for policy 0, policy_version 370983 (0.0008) [2023-12-27 21:53:42,151][106225] Updated weights for policy 1, policy_version 371731 (0.0007) [2023-12-27 21:53:42,216][106225] Updated weights for policy 1, policy_version 371741 (0.0006) [2023-12-27 21:53:42,270][106225] Updated weights for policy 1, policy_version 371751 (0.0009) [2023-12-27 21:53:42,388][106226] Updated weights for policy 0, policy_version 370993 (0.0009) [2023-12-27 21:53:42,444][106226] Updated weights for policy 0, policy_version 371003 (0.0008) [2023-12-27 21:53:42,495][106226] Updated weights for policy 0, policy_version 371013 (0.0008) [2023-12-27 21:53:42,937][106225] Updated weights for policy 1, policy_version 371761 (0.0007) [2023-12-27 21:53:42,989][106225] Updated weights for policy 1, policy_version 371771 (0.0005) [2023-12-27 21:53:43,035][106225] Updated weights for policy 1, policy_version 371781 (0.0005) [2023-12-27 21:53:43,084][106225] Updated weights for policy 1, policy_version 371791 (0.0005) [2023-12-27 21:53:43,297][106226] Updated weights for policy 0, policy_version 371023 (0.0009) [2023-12-27 21:53:43,345][106226] Updated weights for policy 0, policy_version 371033 (0.0008) [2023-12-27 21:53:43,390][106226] Updated weights for policy 0, policy_version 371043 (0.0008) [2023-12-27 21:53:43,701][106225] Updated weights for policy 1, policy_version 371801 (0.0008) [2023-12-27 21:53:43,753][106225] Updated weights for policy 1, policy_version 371811 (0.0009) [2023-12-27 21:53:43,815][106225] Updated weights for policy 1, policy_version 371821 (0.0010) [2023-12-27 21:53:44,103][106226] Updated weights for policy 0, policy_version 371053 (0.0007) [2023-12-27 21:53:44,151][106226] Updated weights for policy 0, policy_version 371063 (0.0007) [2023-12-27 21:53:44,200][106226] Updated weights for policy 0, policy_version 371073 (0.0008) [2023-12-27 21:53:44,507][106225] Updated weights for policy 1, policy_version 371831 (0.0010) [2023-12-27 21:53:44,565][106225] Updated weights for policy 1, policy_version 371841 (0.0010) [2023-12-27 21:53:44,620][106225] Updated weights for policy 1, policy_version 371851 (0.0005) [2023-12-27 21:53:44,967][106226] Updated weights for policy 0, policy_version 371083 (0.0010) [2023-12-27 21:53:45,034][106226] Updated weights for policy 0, policy_version 371093 (0.0009) [2023-12-27 21:53:45,102][106226] Updated weights for policy 0, policy_version 371103 (0.0009) [2023-12-27 21:53:45,326][106225] Updated weights for policy 1, policy_version 371861 (0.0007) [2023-12-27 21:53:45,385][106225] Updated weights for policy 1, policy_version 371871 (0.0010) [2023-12-27 21:53:45,446][106225] Updated weights for policy 1, policy_version 371881 (0.0010) [2023-12-27 21:53:45,871][106226] Updated weights for policy 0, policy_version 371113 (0.0008) [2023-12-27 21:53:45,931][106226] Updated weights for policy 0, policy_version 371123 (0.0006) [2023-12-27 21:53:45,980][106226] Updated weights for policy 0, policy_version 371133 (0.0005) [2023-12-27 21:53:46,049][106225] Updated weights for policy 1, policy_version 371891 (0.0010) [2023-12-27 21:53:46,105][106225] Updated weights for policy 1, policy_version 371901 (0.0010) [2023-12-27 21:53:46,174][106225] Updated weights for policy 1, policy_version 371911 (0.0010) [2023-12-27 21:53:46,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 190275584. Throughput: 0: 9650.3, 1: 9974.0. Samples: 190265844. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:53:46,176][105115] Avg episode reward: [(0, '-4.898'), (1, '-6.110')] [2023-12-27 21:53:46,735][106226] Updated weights for policy 0, policy_version 371148 (0.0008) [2023-12-27 21:53:46,791][106226] Updated weights for policy 0, policy_version 371158 (0.0007) [2023-12-27 21:53:46,823][106225] Updated weights for policy 1, policy_version 371921 (0.0010) [2023-12-27 21:53:46,861][106226] Updated weights for policy 0, policy_version 371168 (0.0006) [2023-12-27 21:53:46,877][106225] Updated weights for policy 1, policy_version 371931 (0.0005) [2023-12-27 21:53:46,936][106225] Updated weights for policy 1, policy_version 371941 (0.0009) [2023-12-27 21:53:47,002][106225] Updated weights for policy 1, policy_version 371951 (0.0010) [2023-12-27 21:53:47,430][106226] Updated weights for policy 0, policy_version 371178 (0.0006) [2023-12-27 21:53:47,479][106226] Updated weights for policy 0, policy_version 371188 (0.0005) [2023-12-27 21:53:47,527][106226] Updated weights for policy 0, policy_version 371198 (0.0005) [2023-12-27 21:53:47,580][106226] Updated weights for policy 0, policy_version 371208 (0.0007) [2023-12-27 21:53:47,692][106225] Updated weights for policy 1, policy_version 371961 (0.0010) [2023-12-27 21:53:47,753][106225] Updated weights for policy 1, policy_version 371971 (0.0010) [2023-12-27 21:53:47,805][106225] Updated weights for policy 1, policy_version 371981 (0.0010) [2023-12-27 21:53:48,210][106226] Updated weights for policy 0, policy_version 371218 (0.0010) [2023-12-27 21:53:48,257][106226] Updated weights for policy 0, policy_version 371228 (0.0010) [2023-12-27 21:53:48,314][106226] Updated weights for policy 0, policy_version 371238 (0.0010) [2023-12-27 21:53:48,562][106225] Updated weights for policy 1, policy_version 371991 (0.0009) [2023-12-27 21:53:48,615][106225] Updated weights for policy 1, policy_version 372001 (0.0008) [2023-12-27 21:53:48,673][106225] Updated weights for policy 1, policy_version 372011 (0.0008) [2023-12-27 21:53:48,995][106226] Updated weights for policy 0, policy_version 371248 (0.0010) [2023-12-27 21:53:49,042][106226] Updated weights for policy 0, policy_version 371258 (0.0010) [2023-12-27 21:53:49,092][106226] Updated weights for policy 0, policy_version 371268 (0.0010) [2023-12-27 21:53:49,428][106225] Updated weights for policy 1, policy_version 372021 (0.0009) [2023-12-27 21:53:49,478][106225] Updated weights for policy 1, policy_version 372031 (0.0009) [2023-12-27 21:53:49,527][106225] Updated weights for policy 1, policy_version 372041 (0.0008) [2023-12-27 21:53:49,759][106226] Updated weights for policy 0, policy_version 371278 (0.0007) [2023-12-27 21:53:49,816][106226] Updated weights for policy 0, policy_version 371288 (0.0008) [2023-12-27 21:53:49,887][106226] Updated weights for policy 0, policy_version 371298 (0.0010) [2023-12-27 21:53:50,296][106225] Updated weights for policy 1, policy_version 372051 (0.0008) [2023-12-27 21:53:50,369][106225] Updated weights for policy 1, policy_version 372061 (0.0006) [2023-12-27 21:53:50,432][106225] Updated weights for policy 1, policy_version 372071 (0.0006) [2023-12-27 21:53:50,513][106226] Updated weights for policy 0, policy_version 371308 (0.0009) [2023-12-27 21:53:50,570][106226] Updated weights for policy 0, policy_version 371318 (0.0006) [2023-12-27 21:53:50,637][106226] Updated weights for policy 0, policy_version 371328 (0.0008) [2023-12-27 21:53:50,997][106225] Updated weights for policy 1, policy_version 372081 (0.0006) [2023-12-27 21:53:51,062][106225] Updated weights for policy 1, policy_version 372091 (0.0008) [2023-12-27 21:53:51,123][106225] Updated weights for policy 1, policy_version 372101 (0.0008) [2023-12-27 21:53:51,173][106225] Updated weights for policy 1, policy_version 372111 (0.0008) [2023-12-27 21:53:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 190382080. Throughput: 0: 9658.7, 1: 10024.3. Samples: 190387088. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:53:51,175][105115] Avg episode reward: [(0, '-5.135'), (1, '-6.089')] [2023-12-27 21:53:51,440][106226] Updated weights for policy 0, policy_version 371339 (0.0009) [2023-12-27 21:53:51,495][106226] Updated weights for policy 0, policy_version 371349 (0.0009) [2023-12-27 21:53:51,548][106226] Updated weights for policy 0, policy_version 371359 (0.0008) [2023-12-27 21:53:51,899][106225] Updated weights for policy 1, policy_version 372121 (0.0008) [2023-12-27 21:53:51,949][106225] Updated weights for policy 1, policy_version 372131 (0.0008) [2023-12-27 21:53:52,000][106225] Updated weights for policy 1, policy_version 372141 (0.0009) [2023-12-27 21:53:52,218][106226] Updated weights for policy 0, policy_version 371369 (0.0009) [2023-12-27 21:53:52,278][106226] Updated weights for policy 0, policy_version 371379 (0.0010) [2023-12-27 21:53:52,345][106226] Updated weights for policy 0, policy_version 371389 (0.0011) [2023-12-27 21:53:52,414][106226] Updated weights for policy 0, policy_version 371399 (0.0009) [2023-12-27 21:53:52,687][106225] Updated weights for policy 1, policy_version 372151 (0.0007) [2023-12-27 21:53:52,739][106225] Updated weights for policy 1, policy_version 372161 (0.0006) [2023-12-27 21:53:52,792][106225] Updated weights for policy 1, policy_version 372171 (0.0008) [2023-12-27 21:53:53,182][106226] Updated weights for policy 0, policy_version 371409 (0.0009) [2023-12-27 21:53:53,236][106226] Updated weights for policy 0, policy_version 371419 (0.0009) [2023-12-27 21:53:53,284][106226] Updated weights for policy 0, policy_version 371429 (0.0008) [2023-12-27 21:53:53,459][106225] Updated weights for policy 1, policy_version 372181 (0.0007) [2023-12-27 21:53:53,514][106225] Updated weights for policy 1, policy_version 372191 (0.0008) [2023-12-27 21:53:53,569][106225] Updated weights for policy 1, policy_version 372201 (0.0009) [2023-12-27 21:53:54,013][106226] Updated weights for policy 0, policy_version 371439 (0.0010) [2023-12-27 21:53:54,069][106226] Updated weights for policy 0, policy_version 371449 (0.0008) [2023-12-27 21:53:54,123][106226] Updated weights for policy 0, policy_version 371459 (0.0010) [2023-12-27 21:53:54,227][106225] Updated weights for policy 1, policy_version 372211 (0.0008) [2023-12-27 21:53:54,274][106225] Updated weights for policy 1, policy_version 372221 (0.0010) [2023-12-27 21:53:54,323][106225] Updated weights for policy 1, policy_version 372231 (0.0010) [2023-12-27 21:53:54,746][106226] Updated weights for policy 0, policy_version 371469 (0.0008) [2023-12-27 21:53:54,804][106226] Updated weights for policy 0, policy_version 371479 (0.0005) [2023-12-27 21:53:54,870][106226] Updated weights for policy 0, policy_version 371489 (0.0005) [2023-12-27 21:53:54,985][106225] Updated weights for policy 1, policy_version 372241 (0.0010) [2023-12-27 21:53:55,043][106225] Updated weights for policy 1, policy_version 372251 (0.0007) [2023-12-27 21:53:55,102][106225] Updated weights for policy 1, policy_version 372261 (0.0005) [2023-12-27 21:53:55,166][106225] Updated weights for policy 1, policy_version 372271 (0.0009) [2023-12-27 21:53:55,497][106226] Updated weights for policy 0, policy_version 371499 (0.0007) [2023-12-27 21:53:55,543][106226] Updated weights for policy 0, policy_version 371509 (0.0010) [2023-12-27 21:53:55,596][106226] Updated weights for policy 0, policy_version 371519 (0.0010) [2023-12-27 21:53:55,845][106225] Updated weights for policy 1, policy_version 372281 (0.0008) [2023-12-27 21:53:55,910][106225] Updated weights for policy 1, policy_version 372291 (0.0008) [2023-12-27 21:53:55,971][106225] Updated weights for policy 1, policy_version 372301 (0.0005) [2023-12-27 21:53:56,163][106226] Updated weights for policy 0, policy_version 371529 (0.0005) [2023-12-27 21:53:56,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 190480384. Throughput: 0: 9641.6, 1: 10055.7. Samples: 190445812. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:53:56,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.720')] [2023-12-27 21:53:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000372304_95338496.pth... [2023-12-27 21:53:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000371120_95035392.pth [2023-12-27 21:53:56,224][106226] Updated weights for policy 0, policy_version 371539 (0.0006) [2023-12-27 21:53:56,287][106226] Updated weights for policy 0, policy_version 371549 (0.0011) [2023-12-27 21:53:56,347][106226] Updated weights for policy 0, policy_version 371559 (0.0010) [2023-12-27 21:53:56,350][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000371560_95150080.pth... [2023-12-27 21:53:56,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000370376_94846976.pth [2023-12-27 21:53:56,659][106225] Updated weights for policy 1, policy_version 372311 (0.0009) [2023-12-27 21:53:56,725][106225] Updated weights for policy 1, policy_version 372321 (0.0010) [2023-12-27 21:53:56,778][106225] Updated weights for policy 1, policy_version 372331 (0.0010) [2023-12-27 21:53:56,981][106226] Updated weights for policy 0, policy_version 371569 (0.0008) [2023-12-27 21:53:57,024][106226] Updated weights for policy 0, policy_version 371579 (0.0005) [2023-12-27 21:53:57,068][106226] Updated weights for policy 0, policy_version 371589 (0.0005) [2023-12-27 21:53:57,332][106225] Updated weights for policy 1, policy_version 372341 (0.0010) [2023-12-27 21:53:57,391][106225] Updated weights for policy 1, policy_version 372351 (0.0010) [2023-12-27 21:53:57,444][106225] Updated weights for policy 1, policy_version 372361 (0.0010) [2023-12-27 21:53:57,716][106226] Updated weights for policy 0, policy_version 371599 (0.0008) [2023-12-27 21:53:57,767][106226] Updated weights for policy 0, policy_version 371609 (0.0005) [2023-12-27 21:53:57,827][106226] Updated weights for policy 0, policy_version 371619 (0.0005) [2023-12-27 21:53:58,074][106225] Updated weights for policy 1, policy_version 372371 (0.0010) [2023-12-27 21:53:58,120][106225] Updated weights for policy 1, policy_version 372381 (0.0010) [2023-12-27 21:53:58,166][106225] Updated weights for policy 1, policy_version 372391 (0.0010) [2023-12-27 21:53:58,504][106226] Updated weights for policy 0, policy_version 371629 (0.0007) [2023-12-27 21:53:58,567][106226] Updated weights for policy 0, policy_version 371639 (0.0007) [2023-12-27 21:53:58,641][106226] Updated weights for policy 0, policy_version 371649 (0.0007) [2023-12-27 21:53:59,035][106225] Updated weights for policy 1, policy_version 372401 (0.0009) [2023-12-27 21:53:59,110][106225] Updated weights for policy 1, policy_version 372411 (0.0008) [2023-12-27 21:53:59,179][106225] Updated weights for policy 1, policy_version 372421 (0.0009) [2023-12-27 21:53:59,245][106225] Updated weights for policy 1, policy_version 372431 (0.0008) [2023-12-27 21:53:59,431][106226] Updated weights for policy 0, policy_version 371659 (0.0007) [2023-12-27 21:53:59,488][106226] Updated weights for policy 0, policy_version 371669 (0.0005) [2023-12-27 21:53:59,544][106226] Updated weights for policy 0, policy_version 371679 (0.0006) [2023-12-27 21:53:59,937][106225] Updated weights for policy 1, policy_version 372441 (0.0008) [2023-12-27 21:53:59,994][106225] Updated weights for policy 1, policy_version 372451 (0.0008) [2023-12-27 21:54:00,048][106225] Updated weights for policy 1, policy_version 372461 (0.0008) [2023-12-27 21:54:00,203][106226] Updated weights for policy 0, policy_version 371689 (0.0006) [2023-12-27 21:54:00,262][106226] Updated weights for policy 0, policy_version 371699 (0.0011) [2023-12-27 21:54:00,321][106226] Updated weights for policy 0, policy_version 371709 (0.0011) [2023-12-27 21:54:00,375][106226] Updated weights for policy 0, policy_version 371719 (0.0010) [2023-12-27 21:54:00,831][106225] Updated weights for policy 1, policy_version 372471 (0.0006) [2023-12-27 21:54:00,888][106225] Updated weights for policy 1, policy_version 372481 (0.0005) [2023-12-27 21:54:00,944][106225] Updated weights for policy 1, policy_version 372491 (0.0007) [2023-12-27 21:54:01,075][106226] Updated weights for policy 0, policy_version 371729 (0.0011) [2023-12-27 21:54:01,144][106226] Updated weights for policy 0, policy_version 371739 (0.0010) [2023-12-27 21:54:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 190578688. Throughput: 0: 9789.9, 1: 10134.3. Samples: 190570500. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:01,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.753')] [2023-12-27 21:54:01,202][106226] Updated weights for policy 0, policy_version 371749 (0.0010) [2023-12-27 21:54:01,713][106225] Updated weights for policy 1, policy_version 372501 (0.0008) [2023-12-27 21:54:01,782][106225] Updated weights for policy 1, policy_version 372511 (0.0006) [2023-12-27 21:54:01,842][106225] Updated weights for policy 1, policy_version 372521 (0.0005) [2023-12-27 21:54:01,893][106226] Updated weights for policy 0, policy_version 371759 (0.0008) [2023-12-27 21:54:01,942][106226] Updated weights for policy 0, policy_version 371769 (0.0008) [2023-12-27 21:54:01,995][106226] Updated weights for policy 0, policy_version 371779 (0.0009) [2023-12-27 21:54:02,592][106225] Updated weights for policy 1, policy_version 372531 (0.0006) [2023-12-27 21:54:02,648][106225] Updated weights for policy 1, policy_version 372541 (0.0007) [2023-12-27 21:54:02,699][106226] Updated weights for policy 0, policy_version 371789 (0.0009) [2023-12-27 21:54:02,704][106225] Updated weights for policy 1, policy_version 372551 (0.0007) [2023-12-27 21:54:02,756][106226] Updated weights for policy 0, policy_version 371799 (0.0010) [2023-12-27 21:54:02,814][106226] Updated weights for policy 0, policy_version 371809 (0.0010) [2023-12-27 21:54:03,463][106225] Updated weights for policy 1, policy_version 372561 (0.0006) [2023-12-27 21:54:03,480][106226] Updated weights for policy 0, policy_version 371819 (0.0009) [2023-12-27 21:54:03,512][106225] Updated weights for policy 1, policy_version 372571 (0.0006) [2023-12-27 21:54:03,537][106226] Updated weights for policy 0, policy_version 371829 (0.0006) [2023-12-27 21:54:03,559][106225] Updated weights for policy 1, policy_version 372581 (0.0006) [2023-12-27 21:54:03,591][106226] Updated weights for policy 0, policy_version 371839 (0.0006) [2023-12-27 21:54:03,607][106225] Updated weights for policy 1, policy_version 372591 (0.0008) [2023-12-27 21:54:04,291][106226] Updated weights for policy 0, policy_version 371849 (0.0006) [2023-12-27 21:54:04,363][106226] Updated weights for policy 0, policy_version 371859 (0.0008) [2023-12-27 21:54:04,400][106225] Updated weights for policy 1, policy_version 372601 (0.0007) [2023-12-27 21:54:04,439][106226] Updated weights for policy 0, policy_version 371869 (0.0008) [2023-12-27 21:54:04,450][106225] Updated weights for policy 1, policy_version 372611 (0.0006) [2023-12-27 21:54:04,494][106226] Updated weights for policy 0, policy_version 371879 (0.0007) [2023-12-27 21:54:04,500][106225] Updated weights for policy 1, policy_version 372621 (0.0006) [2023-12-27 21:54:05,092][106226] Updated weights for policy 0, policy_version 371889 (0.0010) [2023-12-27 21:54:05,148][106226] Updated weights for policy 0, policy_version 371899 (0.0010) [2023-12-27 21:54:05,204][106226] Updated weights for policy 0, policy_version 371909 (0.0010) [2023-12-27 21:54:05,289][106225] Updated weights for policy 1, policy_version 372631 (0.0008) [2023-12-27 21:54:05,353][106225] Updated weights for policy 1, policy_version 372641 (0.0007) [2023-12-27 21:54:05,416][106225] Updated weights for policy 1, policy_version 372651 (0.0008) [2023-12-27 21:54:05,892][106226] Updated weights for policy 0, policy_version 371919 (0.0011) [2023-12-27 21:54:05,953][106226] Updated weights for policy 0, policy_version 371929 (0.0010) [2023-12-27 21:54:06,022][106226] Updated weights for policy 0, policy_version 371939 (0.0010) [2023-12-27 21:54:06,089][106225] Updated weights for policy 1, policy_version 372661 (0.0008) [2023-12-27 21:54:06,155][106225] Updated weights for policy 1, policy_version 372671 (0.0009) [2023-12-27 21:54:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 190676992. Throughput: 0: 9845.3, 1: 9985.3. Samples: 190686576. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:06,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-5.780')] [2023-12-27 21:54:06,209][106225] Updated weights for policy 1, policy_version 372681 (0.0007) [2023-12-27 21:54:06,732][106226] Updated weights for policy 0, policy_version 371949 (0.0010) [2023-12-27 21:54:06,789][106226] Updated weights for policy 0, policy_version 371959 (0.0010) [2023-12-27 21:54:06,835][106226] Updated weights for policy 0, policy_version 371969 (0.0010) [2023-12-27 21:54:06,953][106225] Updated weights for policy 1, policy_version 372691 (0.0008) [2023-12-27 21:54:07,003][106225] Updated weights for policy 1, policy_version 372701 (0.0007) [2023-12-27 21:54:07,050][106225] Updated weights for policy 1, policy_version 372711 (0.0005) [2023-12-27 21:54:07,575][106226] Updated weights for policy 0, policy_version 371979 (0.0009) [2023-12-27 21:54:07,641][106226] Updated weights for policy 0, policy_version 371989 (0.0006) [2023-12-27 21:54:07,705][106226] Updated weights for policy 0, policy_version 371999 (0.0005) [2023-12-27 21:54:07,771][106225] Updated weights for policy 1, policy_version 372721 (0.0006) [2023-12-27 21:54:07,824][106225] Updated weights for policy 1, policy_version 372731 (0.0007) [2023-12-27 21:54:07,878][106225] Updated weights for policy 1, policy_version 372741 (0.0008) [2023-12-27 21:54:07,940][106225] Updated weights for policy 1, policy_version 372751 (0.0008) [2023-12-27 21:54:08,274][106226] Updated weights for policy 0, policy_version 372009 (0.0007) [2023-12-27 21:54:08,323][106226] Updated weights for policy 0, policy_version 372019 (0.0006) [2023-12-27 21:54:08,386][106226] Updated weights for policy 0, policy_version 372029 (0.0007) [2023-12-27 21:54:08,440][106226] Updated weights for policy 0, policy_version 372039 (0.0006) [2023-12-27 21:54:08,762][106225] Updated weights for policy 1, policy_version 372761 (0.0009) [2023-12-27 21:54:08,813][106225] Updated weights for policy 1, policy_version 372771 (0.0009) [2023-12-27 21:54:08,871][106225] Updated weights for policy 1, policy_version 372781 (0.0008) [2023-12-27 21:54:09,043][106226] Updated weights for policy 0, policy_version 372049 (0.0008) [2023-12-27 21:54:09,103][106226] Updated weights for policy 0, policy_version 372059 (0.0010) [2023-12-27 21:54:09,160][106226] Updated weights for policy 0, policy_version 372069 (0.0008) [2023-12-27 21:54:09,603][106225] Updated weights for policy 1, policy_version 372791 (0.0008) [2023-12-27 21:54:09,663][106225] Updated weights for policy 1, policy_version 372801 (0.0006) [2023-12-27 21:54:09,721][106225] Updated weights for policy 1, policy_version 372811 (0.0005) [2023-12-27 21:54:10,011][106226] Updated weights for policy 0, policy_version 372079 (0.0008) [2023-12-27 21:54:10,066][106226] Updated weights for policy 0, policy_version 372089 (0.0009) [2023-12-27 21:54:10,115][106226] Updated weights for policy 0, policy_version 372099 (0.0008) [2023-12-27 21:54:10,441][106225] Updated weights for policy 1, policy_version 372821 (0.0009) [2023-12-27 21:54:10,503][106225] Updated weights for policy 1, policy_version 372831 (0.0009) [2023-12-27 21:54:10,560][106225] Updated weights for policy 1, policy_version 372841 (0.0009) [2023-12-27 21:54:10,838][106226] Updated weights for policy 0, policy_version 372109 (0.0009) [2023-12-27 21:54:10,895][106226] Updated weights for policy 0, policy_version 372119 (0.0009) [2023-12-27 21:54:10,956][106226] Updated weights for policy 0, policy_version 372129 (0.0009) [2023-12-27 21:54:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 190775296. Throughput: 0: 9922.3, 1: 9985.2. Samples: 190746428. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:11,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-5.871')] [2023-12-27 21:54:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000372848_95477760.pth... [2023-12-27 21:54:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000372136_95297536.pth... [2023-12-27 21:54:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000371696_95182848.pth [2023-12-27 21:54:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000370952_94994432.pth [2023-12-27 21:54:11,234][106225] Updated weights for policy 1, policy_version 372851 (0.0008) [2023-12-27 21:54:11,303][106225] Updated weights for policy 1, policy_version 372861 (0.0007) [2023-12-27 21:54:11,391][106225] Updated weights for policy 1, policy_version 372871 (0.0009) [2023-12-27 21:54:11,798][106226] Updated weights for policy 0, policy_version 372139 (0.0009) [2023-12-27 21:54:11,856][106226] Updated weights for policy 0, policy_version 372149 (0.0009) [2023-12-27 21:54:11,920][106226] Updated weights for policy 0, policy_version 372159 (0.0008) [2023-12-27 21:54:12,098][106225] Updated weights for policy 1, policy_version 372881 (0.0008) [2023-12-27 21:54:12,158][106225] Updated weights for policy 1, policy_version 372891 (0.0006) [2023-12-27 21:54:12,223][106225] Updated weights for policy 1, policy_version 372901 (0.0006) [2023-12-27 21:54:12,303][106225] Updated weights for policy 1, policy_version 372911 (0.0008) [2023-12-27 21:54:12,741][106226] Updated weights for policy 0, policy_version 372169 (0.0009) [2023-12-27 21:54:12,792][106226] Updated weights for policy 0, policy_version 372179 (0.0008) [2023-12-27 21:54:12,840][106226] Updated weights for policy 0, policy_version 372189 (0.0008) [2023-12-27 21:54:12,877][106225] Updated weights for policy 1, policy_version 372921 (0.0008) [2023-12-27 21:54:12,889][106226] Updated weights for policy 0, policy_version 372199 (0.0006) [2023-12-27 21:54:12,935][106225] Updated weights for policy 1, policy_version 372931 (0.0007) [2023-12-27 21:54:12,991][106225] Updated weights for policy 1, policy_version 372941 (0.0005) [2023-12-27 21:54:13,536][106226] Updated weights for policy 0, policy_version 372209 (0.0010) [2023-12-27 21:54:13,583][106226] Updated weights for policy 0, policy_version 372219 (0.0010) [2023-12-27 21:54:13,635][106226] Updated weights for policy 0, policy_version 372229 (0.0010) [2023-12-27 21:54:13,642][106225] Updated weights for policy 1, policy_version 372951 (0.0005) [2023-12-27 21:54:13,687][106225] Updated weights for policy 1, policy_version 372961 (0.0005) [2023-12-27 21:54:13,758][106225] Updated weights for policy 1, policy_version 372971 (0.0005) [2023-12-27 21:54:14,281][106226] Updated weights for policy 0, policy_version 372239 (0.0007) [2023-12-27 21:54:14,326][106225] Updated weights for policy 1, policy_version 372981 (0.0005) [2023-12-27 21:54:14,340][106226] Updated weights for policy 0, policy_version 372249 (0.0006) [2023-12-27 21:54:14,393][106225] Updated weights for policy 1, policy_version 372991 (0.0006) [2023-12-27 21:54:14,400][106226] Updated weights for policy 0, policy_version 372259 (0.0007) [2023-12-27 21:54:14,454][106225] Updated weights for policy 1, policy_version 373001 (0.0006) [2023-12-27 21:54:15,010][106226] Updated weights for policy 0, policy_version 372269 (0.0008) [2023-12-27 21:54:15,070][106226] Updated weights for policy 0, policy_version 372279 (0.0010) [2023-12-27 21:54:15,076][106225] Updated weights for policy 1, policy_version 373011 (0.0007) [2023-12-27 21:54:15,135][106226] Updated weights for policy 0, policy_version 372289 (0.0011) [2023-12-27 21:54:15,136][106225] Updated weights for policy 1, policy_version 373021 (0.0007) [2023-12-27 21:54:15,200][106225] Updated weights for policy 1, policy_version 373031 (0.0006) [2023-12-27 21:54:15,850][106226] Updated weights for policy 0, policy_version 372299 (0.0011) [2023-12-27 21:54:15,902][106225] Updated weights for policy 1, policy_version 373041 (0.0008) [2023-12-27 21:54:15,908][106226] Updated weights for policy 0, policy_version 372309 (0.0010) [2023-12-27 21:54:15,962][106225] Updated weights for policy 1, policy_version 373051 (0.0005) [2023-12-27 21:54:15,966][106226] Updated weights for policy 0, policy_version 372319 (0.0011) [2023-12-27 21:54:16,014][106225] Updated weights for policy 1, policy_version 373061 (0.0005) [2023-12-27 21:54:16,063][106225] Updated weights for policy 1, policy_version 373071 (0.0005) [2023-12-27 21:54:16,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 190881792. Throughput: 0: 9958.0, 1: 9943.0. Samples: 190865752. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:16,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.659')] [2023-12-27 21:54:16,686][106226] Updated weights for policy 0, policy_version 372329 (0.0010) [2023-12-27 21:54:16,755][106226] Updated weights for policy 0, policy_version 372339 (0.0007) [2023-12-27 21:54:16,777][106225] Updated weights for policy 1, policy_version 373081 (0.0006) [2023-12-27 21:54:16,822][106226] Updated weights for policy 0, policy_version 372349 (0.0009) [2023-12-27 21:54:16,836][106225] Updated weights for policy 1, policy_version 373091 (0.0006) [2023-12-27 21:54:16,880][106226] Updated weights for policy 0, policy_version 372359 (0.0006) [2023-12-27 21:54:16,899][106225] Updated weights for policy 1, policy_version 373101 (0.0007) [2023-12-27 21:54:17,507][106226] Updated weights for policy 0, policy_version 372369 (0.0005) [2023-12-27 21:54:17,538][106225] Updated weights for policy 1, policy_version 373111 (0.0007) [2023-12-27 21:54:17,561][106226] Updated weights for policy 0, policy_version 372379 (0.0005) [2023-12-27 21:54:17,585][106225] Updated weights for policy 1, policy_version 373121 (0.0007) [2023-12-27 21:54:17,609][106226] Updated weights for policy 0, policy_version 372389 (0.0006) [2023-12-27 21:54:17,635][106225] Updated weights for policy 1, policy_version 373131 (0.0006) [2023-12-27 21:54:18,250][106226] Updated weights for policy 0, policy_version 372399 (0.0006) [2023-12-27 21:54:18,306][106226] Updated weights for policy 0, policy_version 372409 (0.0009) [2023-12-27 21:54:18,353][106225] Updated weights for policy 1, policy_version 373141 (0.0006) [2023-12-27 21:54:18,376][106226] Updated weights for policy 0, policy_version 372419 (0.0008) [2023-12-27 21:54:18,411][106225] Updated weights for policy 1, policy_version 373151 (0.0008) [2023-12-27 21:54:18,457][106225] Updated weights for policy 1, policy_version 373161 (0.0007) [2023-12-27 21:54:19,080][106226] Updated weights for policy 0, policy_version 372429 (0.0007) [2023-12-27 21:54:19,127][106225] Updated weights for policy 1, policy_version 373171 (0.0009) [2023-12-27 21:54:19,138][106226] Updated weights for policy 0, policy_version 372439 (0.0005) [2023-12-27 21:54:19,188][106225] Updated weights for policy 1, policy_version 373181 (0.0010) [2023-12-27 21:54:19,204][106226] Updated weights for policy 0, policy_version 372449 (0.0006) [2023-12-27 21:54:19,249][106225] Updated weights for policy 1, policy_version 373191 (0.0009) [2023-12-27 21:54:19,956][106225] Updated weights for policy 1, policy_version 373201 (0.0008) [2023-12-27 21:54:19,959][106226] Updated weights for policy 0, policy_version 372459 (0.0010) [2023-12-27 21:54:20,020][106225] Updated weights for policy 1, policy_version 373211 (0.0008) [2023-12-27 21:54:20,026][106226] Updated weights for policy 0, policy_version 372469 (0.0006) [2023-12-27 21:54:20,084][106225] Updated weights for policy 1, policy_version 373221 (0.0008) [2023-12-27 21:54:20,092][106226] Updated weights for policy 0, policy_version 372479 (0.0007) [2023-12-27 21:54:20,144][106225] Updated weights for policy 1, policy_version 373231 (0.0008) [2023-12-27 21:54:20,821][106226] Updated weights for policy 0, policy_version 372489 (0.0007) [2023-12-27 21:54:20,869][106225] Updated weights for policy 1, policy_version 373241 (0.0006) [2023-12-27 21:54:20,885][106226] Updated weights for policy 0, policy_version 372499 (0.0008) [2023-12-27 21:54:20,933][106225] Updated weights for policy 1, policy_version 373251 (0.0010) [2023-12-27 21:54:20,945][106226] Updated weights for policy 0, policy_version 372509 (0.0010) [2023-12-27 21:54:20,992][106225] Updated weights for policy 1, policy_version 373261 (0.0008) [2023-12-27 21:54:21,005][106226] Updated weights for policy 0, policy_version 372519 (0.0008) [2023-12-27 21:54:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 190980096. Throughput: 0: 9908.3, 1: 9955.0. Samples: 190984152. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:21,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.968')] [2023-12-27 21:54:21,773][106225] Updated weights for policy 1, policy_version 373271 (0.0006) [2023-12-27 21:54:21,836][106226] Updated weights for policy 0, policy_version 372529 (0.0007) [2023-12-27 21:54:21,838][106225] Updated weights for policy 1, policy_version 373281 (0.0009) [2023-12-27 21:54:21,896][106225] Updated weights for policy 1, policy_version 373291 (0.0010) [2023-12-27 21:54:21,898][106226] Updated weights for policy 0, policy_version 372539 (0.0006) [2023-12-27 21:54:21,959][106226] Updated weights for policy 0, policy_version 372549 (0.0007) [2023-12-27 21:54:22,615][106225] Updated weights for policy 1, policy_version 373301 (0.0010) [2023-12-27 21:54:22,677][106225] Updated weights for policy 1, policy_version 373311 (0.0011) [2023-12-27 21:54:22,706][106226] Updated weights for policy 0, policy_version 372559 (0.0007) [2023-12-27 21:54:22,739][106225] Updated weights for policy 1, policy_version 373321 (0.0010) [2023-12-27 21:54:22,768][106226] Updated weights for policy 0, policy_version 372569 (0.0006) [2023-12-27 21:54:22,825][106226] Updated weights for policy 0, policy_version 372579 (0.0007) [2023-12-27 21:54:23,461][106225] Updated weights for policy 1, policy_version 373331 (0.0010) [2023-12-27 21:54:23,518][106225] Updated weights for policy 1, policy_version 373341 (0.0010) [2023-12-27 21:54:23,561][106226] Updated weights for policy 0, policy_version 372589 (0.0007) [2023-12-27 21:54:23,575][106225] Updated weights for policy 1, policy_version 373351 (0.0007) [2023-12-27 21:54:23,610][106226] Updated weights for policy 0, policy_version 372599 (0.0007) [2023-12-27 21:54:23,661][106226] Updated weights for policy 0, policy_version 372609 (0.0008) [2023-12-27 21:54:24,296][106225] Updated weights for policy 1, policy_version 373361 (0.0008) [2023-12-27 21:54:24,309][106226] Updated weights for policy 0, policy_version 372619 (0.0008) [2023-12-27 21:54:24,350][106225] Updated weights for policy 1, policy_version 373371 (0.0006) [2023-12-27 21:54:24,356][106226] Updated weights for policy 0, policy_version 372629 (0.0007) [2023-12-27 21:54:24,396][106225] Updated weights for policy 1, policy_version 373381 (0.0006) [2023-12-27 21:54:24,406][106226] Updated weights for policy 0, policy_version 372639 (0.0006) [2023-12-27 21:54:24,451][106225] Updated weights for policy 1, policy_version 373391 (0.0008) [2023-12-27 21:54:25,013][106226] Updated weights for policy 0, policy_version 372649 (0.0006) [2023-12-27 21:54:25,063][106226] Updated weights for policy 0, policy_version 372659 (0.0007) [2023-12-27 21:54:25,122][106226] Updated weights for policy 0, policy_version 372669 (0.0005) [2023-12-27 21:54:25,124][106225] Updated weights for policy 1, policy_version 373401 (0.0008) [2023-12-27 21:54:25,180][106225] Updated weights for policy 1, policy_version 373411 (0.0007) [2023-12-27 21:54:25,187][106226] Updated weights for policy 0, policy_version 372679 (0.0005) [2023-12-27 21:54:25,237][106225] Updated weights for policy 1, policy_version 373421 (0.0006) [2023-12-27 21:54:25,742][106226] Updated weights for policy 0, policy_version 372689 (0.0010) [2023-12-27 21:54:25,788][106226] Updated weights for policy 0, policy_version 372699 (0.0010) [2023-12-27 21:54:25,837][106225] Updated weights for policy 1, policy_version 373431 (0.0008) [2023-12-27 21:54:25,842][106226] Updated weights for policy 0, policy_version 372709 (0.0010) [2023-12-27 21:54:25,880][106225] Updated weights for policy 1, policy_version 373441 (0.0010) [2023-12-27 21:54:25,933][106225] Updated weights for policy 1, policy_version 373451 (0.0010) [2023-12-27 21:54:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 191078400. Throughput: 0: 9900.3, 1: 9912.6. Samples: 191039964. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:26,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-5.993')] [2023-12-27 21:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000372712_95444992.pth... [2023-12-27 21:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000373456_95633408.pth... [2023-12-27 21:54:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000371560_95150080.pth [2023-12-27 21:54:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000372304_95338496.pth [2023-12-27 21:54:26,435][106226] Updated weights for policy 0, policy_version 372719 (0.0007) [2023-12-27 21:54:26,501][106226] Updated weights for policy 0, policy_version 372729 (0.0005) [2023-12-27 21:54:26,560][106226] Updated weights for policy 0, policy_version 372739 (0.0005) [2023-12-27 21:54:26,562][106225] Updated weights for policy 1, policy_version 373461 (0.0008) [2023-12-27 21:54:26,617][106225] Updated weights for policy 1, policy_version 373471 (0.0006) [2023-12-27 21:54:26,673][106225] Updated weights for policy 1, policy_version 373481 (0.0010) [2023-12-27 21:54:27,165][106226] Updated weights for policy 0, policy_version 372749 (0.0008) [2023-12-27 21:54:27,215][106226] Updated weights for policy 0, policy_version 372759 (0.0005) [2023-12-27 21:54:27,232][106225] Updated weights for policy 1, policy_version 373491 (0.0010) [2023-12-27 21:54:27,263][106226] Updated weights for policy 0, policy_version 372769 (0.0005) [2023-12-27 21:54:27,289][106225] Updated weights for policy 1, policy_version 373501 (0.0010) [2023-12-27 21:54:27,335][106225] Updated weights for policy 1, policy_version 373511 (0.0008) [2023-12-27 21:54:27,869][106226] Updated weights for policy 0, policy_version 372779 (0.0006) [2023-12-27 21:54:27,938][106226] Updated weights for policy 0, policy_version 372789 (0.0006) [2023-12-27 21:54:27,946][106225] Updated weights for policy 1, policy_version 373521 (0.0007) [2023-12-27 21:54:27,996][106226] Updated weights for policy 0, policy_version 372799 (0.0005) [2023-12-27 21:54:27,998][106225] Updated weights for policy 1, policy_version 373531 (0.0007) [2023-12-27 21:54:28,049][106225] Updated weights for policy 1, policy_version 373541 (0.0007) [2023-12-27 21:54:28,101][106225] Updated weights for policy 1, policy_version 373551 (0.0008) [2023-12-27 21:54:28,561][106226] Updated weights for policy 0, policy_version 372809 (0.0009) [2023-12-27 21:54:28,620][106226] Updated weights for policy 0, policy_version 372819 (0.0005) [2023-12-27 21:54:28,685][106226] Updated weights for policy 0, policy_version 372829 (0.0006) [2023-12-27 21:54:28,720][106225] Updated weights for policy 1, policy_version 373561 (0.0006) [2023-12-27 21:54:28,747][106226] Updated weights for policy 0, policy_version 372839 (0.0011) [2023-12-27 21:54:28,776][106225] Updated weights for policy 1, policy_version 373571 (0.0006) [2023-12-27 21:54:28,826][106225] Updated weights for policy 1, policy_version 373581 (0.0008) [2023-12-27 21:54:29,351][106226] Updated weights for policy 0, policy_version 372849 (0.0011) [2023-12-27 21:54:29,415][106226] Updated weights for policy 0, policy_version 372859 (0.0011) [2023-12-27 21:54:29,479][106226] Updated weights for policy 0, policy_version 372869 (0.0011) [2023-12-27 21:54:29,592][106225] Updated weights for policy 1, policy_version 373591 (0.0008) [2023-12-27 21:54:29,658][106225] Updated weights for policy 1, policy_version 373601 (0.0006) [2023-12-27 21:54:29,719][106225] Updated weights for policy 1, policy_version 373611 (0.0008) [2023-12-27 21:54:30,198][106226] Updated weights for policy 0, policy_version 372879 (0.0011) [2023-12-27 21:54:30,255][106226] Updated weights for policy 0, policy_version 372889 (0.0010) [2023-12-27 21:54:30,312][106226] Updated weights for policy 0, policy_version 372899 (0.0010) [2023-12-27 21:54:30,434][106225] Updated weights for policy 1, policy_version 373621 (0.0009) [2023-12-27 21:54:30,480][106225] Updated weights for policy 1, policy_version 373631 (0.0007) [2023-12-27 21:54:30,529][106225] Updated weights for policy 1, policy_version 373641 (0.0009) [2023-12-27 21:54:30,993][106226] Updated weights for policy 0, policy_version 372909 (0.0008) [2023-12-27 21:54:31,062][106226] Updated weights for policy 0, policy_version 372920 (0.0008) [2023-12-27 21:54:31,132][106226] Updated weights for policy 0, policy_version 372930 (0.0008) [2023-12-27 21:54:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 191184896. Throughput: 0: 10168.2, 1: 9982.2. Samples: 191172604. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:31,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.707')] [2023-12-27 21:54:31,341][106225] Updated weights for policy 1, policy_version 373651 (0.0008) [2023-12-27 21:54:31,408][106225] Updated weights for policy 1, policy_version 373661 (0.0008) [2023-12-27 21:54:31,466][106225] Updated weights for policy 1, policy_version 373671 (0.0008) [2023-12-27 21:54:31,818][106226] Updated weights for policy 0, policy_version 372940 (0.0008) [2023-12-27 21:54:31,871][106226] Updated weights for policy 0, policy_version 372950 (0.0007) [2023-12-27 21:54:31,932][106226] Updated weights for policy 0, policy_version 372960 (0.0008) [2023-12-27 21:54:32,263][106225] Updated weights for policy 1, policy_version 373681 (0.0008) [2023-12-27 21:54:32,334][106225] Updated weights for policy 1, policy_version 373691 (0.0006) [2023-12-27 21:54:32,405][106225] Updated weights for policy 1, policy_version 373701 (0.0007) [2023-12-27 21:54:32,475][106225] Updated weights for policy 1, policy_version 373711 (0.0007) [2023-12-27 21:54:32,614][106226] Updated weights for policy 0, policy_version 372970 (0.0008) [2023-12-27 21:54:32,667][106226] Updated weights for policy 0, policy_version 372980 (0.0008) [2023-12-27 21:54:32,717][106226] Updated weights for policy 0, policy_version 372990 (0.0009) [2023-12-27 21:54:32,773][106226] Updated weights for policy 0, policy_version 373000 (0.0009) [2023-12-27 21:54:33,112][106225] Updated weights for policy 1, policy_version 373721 (0.0008) [2023-12-27 21:54:33,173][106225] Updated weights for policy 1, policy_version 373731 (0.0008) [2023-12-27 21:54:33,226][106225] Updated weights for policy 1, policy_version 373741 (0.0008) [2023-12-27 21:54:33,547][106226] Updated weights for policy 0, policy_version 373010 (0.0007) [2023-12-27 21:54:33,601][106226] Updated weights for policy 0, policy_version 373020 (0.0009) [2023-12-27 21:54:33,653][106226] Updated weights for policy 0, policy_version 373030 (0.0009) [2023-12-27 21:54:33,810][106225] Updated weights for policy 1, policy_version 373751 (0.0007) [2023-12-27 21:54:33,858][106225] Updated weights for policy 1, policy_version 373761 (0.0008) [2023-12-27 21:54:33,902][106225] Updated weights for policy 1, policy_version 373771 (0.0008) [2023-12-27 21:54:34,287][106226] Updated weights for policy 0, policy_version 373040 (0.0006) [2023-12-27 21:54:34,351][106226] Updated weights for policy 0, policy_version 373050 (0.0007) [2023-12-27 21:54:34,419][106226] Updated weights for policy 0, policy_version 373060 (0.0009) [2023-12-27 21:54:34,687][106225] Updated weights for policy 1, policy_version 373781 (0.0008) [2023-12-27 21:54:34,747][106225] Updated weights for policy 1, policy_version 373791 (0.0009) [2023-12-27 21:54:34,804][106225] Updated weights for policy 1, policy_version 373801 (0.0008) [2023-12-27 21:54:35,019][106226] Updated weights for policy 0, policy_version 373070 (0.0006) [2023-12-27 21:54:35,080][106226] Updated weights for policy 0, policy_version 373080 (0.0005) [2023-12-27 21:54:35,139][106226] Updated weights for policy 0, policy_version 373090 (0.0005) [2023-12-27 21:54:35,481][106225] Updated weights for policy 1, policy_version 373811 (0.0008) [2023-12-27 21:54:35,532][106225] Updated weights for policy 1, policy_version 373821 (0.0005) [2023-12-27 21:54:35,592][106225] Updated weights for policy 1, policy_version 373831 (0.0007) [2023-12-27 21:54:35,873][106226] Updated weights for policy 0, policy_version 373100 (0.0006) [2023-12-27 21:54:35,924][106226] Updated weights for policy 0, policy_version 373110 (0.0007) [2023-12-27 21:54:35,973][106226] Updated weights for policy 0, policy_version 373120 (0.0008) [2023-12-27 21:54:36,149][106225] Updated weights for policy 1, policy_version 373841 (0.0005) [2023-12-27 21:54:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 191283200. Throughput: 0: 10141.4, 1: 9961.5. Samples: 191291720. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:36,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.359')] [2023-12-27 21:54:36,204][106225] Updated weights for policy 1, policy_version 373851 (0.0008) [2023-12-27 21:54:36,257][106225] Updated weights for policy 1, policy_version 373861 (0.0008) [2023-12-27 21:54:36,316][106225] Updated weights for policy 1, policy_version 373871 (0.0008) [2023-12-27 21:54:36,755][106226] Updated weights for policy 0, policy_version 373130 (0.0008) [2023-12-27 21:54:36,819][106226] Updated weights for policy 0, policy_version 373140 (0.0008) [2023-12-27 21:54:36,887][106226] Updated weights for policy 0, policy_version 373150 (0.0008) [2023-12-27 21:54:36,938][106226] Updated weights for policy 0, policy_version 373160 (0.0008) [2023-12-27 21:54:37,058][106225] Updated weights for policy 1, policy_version 373881 (0.0009) [2023-12-27 21:54:37,115][106225] Updated weights for policy 1, policy_version 373891 (0.0008) [2023-12-27 21:54:37,167][106225] Updated weights for policy 1, policy_version 373901 (0.0008) [2023-12-27 21:54:37,678][106226] Updated weights for policy 0, policy_version 373170 (0.0009) [2023-12-27 21:54:37,737][106226] Updated weights for policy 0, policy_version 373180 (0.0008) [2023-12-27 21:54:37,794][106226] Updated weights for policy 0, policy_version 373190 (0.0009) [2023-12-27 21:54:37,862][106225] Updated weights for policy 1, policy_version 373911 (0.0010) [2023-12-27 21:54:37,924][106225] Updated weights for policy 1, policy_version 373921 (0.0010) [2023-12-27 21:54:37,992][106225] Updated weights for policy 1, policy_version 373931 (0.0010) [2023-12-27 21:54:38,535][106226] Updated weights for policy 0, policy_version 373200 (0.0008) [2023-12-27 21:54:38,600][106226] Updated weights for policy 0, policy_version 373210 (0.0009) [2023-12-27 21:54:38,658][106226] Updated weights for policy 0, policy_version 373220 (0.0008) [2023-12-27 21:54:38,683][106225] Updated weights for policy 1, policy_version 373941 (0.0009) [2023-12-27 21:54:38,748][106225] Updated weights for policy 1, policy_version 373951 (0.0009) [2023-12-27 21:54:38,805][106225] Updated weights for policy 1, policy_version 373961 (0.0008) [2023-12-27 21:54:39,340][106226] Updated weights for policy 0, policy_version 373230 (0.0009) [2023-12-27 21:54:39,412][106226] Updated weights for policy 0, policy_version 373240 (0.0008) [2023-12-27 21:54:39,477][106226] Updated weights for policy 0, policy_version 373250 (0.0008) [2023-12-27 21:54:39,574][106225] Updated weights for policy 1, policy_version 373971 (0.0007) [2023-12-27 21:54:39,627][106225] Updated weights for policy 1, policy_version 373981 (0.0010) [2023-12-27 21:54:39,689][106225] Updated weights for policy 1, policy_version 373991 (0.0010) [2023-12-27 21:54:40,228][106226] Updated weights for policy 0, policy_version 373260 (0.0007) [2023-12-27 21:54:40,297][106226] Updated weights for policy 0, policy_version 373270 (0.0006) [2023-12-27 21:54:40,368][106226] Updated weights for policy 0, policy_version 373280 (0.0006) [2023-12-27 21:54:40,484][106225] Updated weights for policy 1, policy_version 374001 (0.0010) [2023-12-27 21:54:40,539][106225] Updated weights for policy 1, policy_version 374011 (0.0009) [2023-12-27 21:54:40,601][106225] Updated weights for policy 1, policy_version 374021 (0.0007) [2023-12-27 21:54:40,657][106225] Updated weights for policy 1, policy_version 374031 (0.0008) [2023-12-27 21:54:41,068][106226] Updated weights for policy 0, policy_version 373290 (0.0007) [2023-12-27 21:54:41,139][106226] Updated weights for policy 0, policy_version 373300 (0.0007) [2023-12-27 21:54:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 191373312. Throughput: 0: 10138.8, 1: 9973.3. Samples: 191350860. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:41,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-5.937')] [2023-12-27 21:54:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000374032_95780864.pth... [2023-12-27 21:54:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000372848_95477760.pth [2023-12-27 21:54:41,200][106226] Updated weights for policy 0, policy_version 373310 (0.0008) [2023-12-27 21:54:41,267][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000373320_95600640.pth... [2023-12-27 21:54:41,270][106226] Updated weights for policy 0, policy_version 373320 (0.0008) [2023-12-27 21:54:41,272][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000372136_95297536.pth [2023-12-27 21:54:41,368][106225] Updated weights for policy 1, policy_version 374041 (0.0008) [2023-12-27 21:54:41,435][106225] Updated weights for policy 1, policy_version 374051 (0.0008) [2023-12-27 21:54:41,503][106225] Updated weights for policy 1, policy_version 374061 (0.0009) [2023-12-27 21:54:41,970][106226] Updated weights for policy 0, policy_version 373330 (0.0008) [2023-12-27 21:54:42,037][106226] Updated weights for policy 0, policy_version 373340 (0.0005) [2023-12-27 21:54:42,098][106226] Updated weights for policy 0, policy_version 373350 (0.0007) [2023-12-27 21:54:42,281][106225] Updated weights for policy 1, policy_version 374071 (0.0009) [2023-12-27 21:54:42,342][106225] Updated weights for policy 1, policy_version 374081 (0.0009) [2023-12-27 21:54:42,407][106225] Updated weights for policy 1, policy_version 374091 (0.0008) [2023-12-27 21:54:42,784][106226] Updated weights for policy 0, policy_version 373360 (0.0008) [2023-12-27 21:54:42,843][106226] Updated weights for policy 0, policy_version 373370 (0.0008) [2023-12-27 21:54:42,890][106226] Updated weights for policy 0, policy_version 373380 (0.0008) [2023-12-27 21:54:43,152][106225] Updated weights for policy 1, policy_version 374101 (0.0009) [2023-12-27 21:54:43,209][106225] Updated weights for policy 1, policy_version 374111 (0.0010) [2023-12-27 21:54:43,256][106225] Updated weights for policy 1, policy_version 374121 (0.0010) [2023-12-27 21:54:43,566][106226] Updated weights for policy 0, policy_version 373390 (0.0007) [2023-12-27 21:54:43,612][106226] Updated weights for policy 0, policy_version 373400 (0.0008) [2023-12-27 21:54:43,667][106226] Updated weights for policy 0, policy_version 373410 (0.0008) [2023-12-27 21:54:43,977][106225] Updated weights for policy 1, policy_version 374131 (0.0010) [2023-12-27 21:54:44,027][106225] Updated weights for policy 1, policy_version 374141 (0.0010) [2023-12-27 21:54:44,086][106225] Updated weights for policy 1, policy_version 374151 (0.0010) [2023-12-27 21:54:44,425][106226] Updated weights for policy 0, policy_version 373420 (0.0009) [2023-12-27 21:54:44,484][106226] Updated weights for policy 0, policy_version 373430 (0.0009) [2023-12-27 21:54:44,536][106226] Updated weights for policy 0, policy_version 373440 (0.0006) [2023-12-27 21:54:44,760][106225] Updated weights for policy 1, policy_version 374161 (0.0008) [2023-12-27 21:54:44,834][106225] Updated weights for policy 1, policy_version 374171 (0.0008) [2023-12-27 21:54:44,896][106225] Updated weights for policy 1, policy_version 374181 (0.0009) [2023-12-27 21:54:44,949][106225] Updated weights for policy 1, policy_version 374191 (0.0008) [2023-12-27 21:54:45,266][106226] Updated weights for policy 0, policy_version 373450 (0.0008) [2023-12-27 21:54:45,333][106226] Updated weights for policy 0, policy_version 373460 (0.0009) [2023-12-27 21:54:45,394][106226] Updated weights for policy 0, policy_version 373470 (0.0010) [2023-12-27 21:54:45,460][106226] Updated weights for policy 0, policy_version 373480 (0.0010) [2023-12-27 21:54:45,540][106225] Updated weights for policy 1, policy_version 374201 (0.0008) [2023-12-27 21:54:45,593][106225] Updated weights for policy 1, policy_version 374211 (0.0009) [2023-12-27 21:54:45,640][106225] Updated weights for policy 1, policy_version 374221 (0.0008) [2023-12-27 21:54:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 191471616. Throughput: 0: 10004.2, 1: 9860.5. Samples: 191464416. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:46,176][105115] Avg episode reward: [(0, '-5.007'), (1, '-5.816')] [2023-12-27 21:54:46,248][106226] Updated weights for policy 0, policy_version 373490 (0.0008) [2023-12-27 21:54:46,252][106225] Updated weights for policy 1, policy_version 374231 (0.0005) [2023-12-27 21:54:46,295][106226] Updated weights for policy 0, policy_version 373500 (0.0008) [2023-12-27 21:54:46,307][106225] Updated weights for policy 1, policy_version 374241 (0.0006) [2023-12-27 21:54:46,360][106226] Updated weights for policy 0, policy_version 373510 (0.0009) [2023-12-27 21:54:46,367][106225] Updated weights for policy 1, policy_version 374251 (0.0005) [2023-12-27 21:54:47,034][106225] Updated weights for policy 1, policy_version 374261 (0.0007) [2023-12-27 21:54:47,086][106225] Updated weights for policy 1, policy_version 374271 (0.0006) [2023-12-27 21:54:47,143][106225] Updated weights for policy 1, policy_version 374281 (0.0005) [2023-12-27 21:54:47,167][106226] Updated weights for policy 0, policy_version 373520 (0.0008) [2023-12-27 21:54:47,223][106226] Updated weights for policy 0, policy_version 373530 (0.0008) [2023-12-27 21:54:47,277][106226] Updated weights for policy 0, policy_version 373540 (0.0007) [2023-12-27 21:54:47,849][106225] Updated weights for policy 1, policy_version 374291 (0.0006) [2023-12-27 21:54:47,903][106225] Updated weights for policy 1, policy_version 374301 (0.0009) [2023-12-27 21:54:47,952][106226] Updated weights for policy 0, policy_version 373550 (0.0006) [2023-12-27 21:54:47,970][106225] Updated weights for policy 1, policy_version 374311 (0.0006) [2023-12-27 21:54:48,006][106226] Updated weights for policy 0, policy_version 373560 (0.0008) [2023-12-27 21:54:48,069][106226] Updated weights for policy 0, policy_version 373570 (0.0006) [2023-12-27 21:54:48,725][106225] Updated weights for policy 1, policy_version 374321 (0.0009) [2023-12-27 21:54:48,772][106226] Updated weights for policy 0, policy_version 373580 (0.0008) [2023-12-27 21:54:48,788][106225] Updated weights for policy 1, policy_version 374331 (0.0008) [2023-12-27 21:54:48,830][106226] Updated weights for policy 0, policy_version 373590 (0.0007) [2023-12-27 21:54:48,851][106225] Updated weights for policy 1, policy_version 374341 (0.0008) [2023-12-27 21:54:48,892][106226] Updated weights for policy 0, policy_version 373600 (0.0007) [2023-12-27 21:54:48,906][106225] Updated weights for policy 1, policy_version 374351 (0.0006) [2023-12-27 21:54:49,581][106226] Updated weights for policy 0, policy_version 373610 (0.0006) [2023-12-27 21:54:49,644][106226] Updated weights for policy 0, policy_version 373620 (0.0007) [2023-12-27 21:54:49,648][106225] Updated weights for policy 1, policy_version 374361 (0.0006) [2023-12-27 21:54:49,703][106226] Updated weights for policy 0, policy_version 373630 (0.0007) [2023-12-27 21:54:49,709][106225] Updated weights for policy 1, policy_version 374371 (0.0006) [2023-12-27 21:54:49,758][106226] Updated weights for policy 0, policy_version 373640 (0.0008) [2023-12-27 21:54:49,760][106225] Updated weights for policy 1, policy_version 374381 (0.0006) [2023-12-27 21:54:50,380][106225] Updated weights for policy 1, policy_version 374391 (0.0006) [2023-12-27 21:54:50,441][106225] Updated weights for policy 1, policy_version 374401 (0.0008) [2023-12-27 21:54:50,500][106225] Updated weights for policy 1, policy_version 374411 (0.0005) [2023-12-27 21:54:50,501][106226] Updated weights for policy 0, policy_version 373650 (0.0011) [2023-12-27 21:54:50,558][106226] Updated weights for policy 0, policy_version 373660 (0.0011) [2023-12-27 21:54:50,627][106226] Updated weights for policy 0, policy_version 373670 (0.0010) [2023-12-27 21:54:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 191569920. Throughput: 0: 9932.7, 1: 9991.3. Samples: 191583156. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:51,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.731')] [2023-12-27 21:54:51,256][106225] Updated weights for policy 1, policy_version 374421 (0.0006) [2023-12-27 21:54:51,275][106226] Updated weights for policy 0, policy_version 373680 (0.0009) [2023-12-27 21:54:51,314][106225] Updated weights for policy 1, policy_version 374431 (0.0007) [2023-12-27 21:54:51,328][106226] Updated weights for policy 0, policy_version 373690 (0.0008) [2023-12-27 21:54:51,379][106225] Updated weights for policy 1, policy_version 374441 (0.0007) [2023-12-27 21:54:51,397][106226] Updated weights for policy 0, policy_version 373700 (0.0009) [2023-12-27 21:54:52,097][106225] Updated weights for policy 1, policy_version 374451 (0.0007) [2023-12-27 21:54:52,150][106225] Updated weights for policy 1, policy_version 374461 (0.0007) [2023-12-27 21:54:52,157][106226] Updated weights for policy 0, policy_version 373710 (0.0006) [2023-12-27 21:54:52,198][106225] Updated weights for policy 1, policy_version 374471 (0.0006) [2023-12-27 21:54:52,208][106226] Updated weights for policy 0, policy_version 373720 (0.0006) [2023-12-27 21:54:52,261][106226] Updated weights for policy 0, policy_version 373730 (0.0009) [2023-12-27 21:54:52,983][106226] Updated weights for policy 0, policy_version 373740 (0.0008) [2023-12-27 21:54:53,016][106225] Updated weights for policy 1, policy_version 374481 (0.0007) [2023-12-27 21:54:53,043][106226] Updated weights for policy 0, policy_version 373750 (0.0009) [2023-12-27 21:54:53,065][106225] Updated weights for policy 1, policy_version 374491 (0.0007) [2023-12-27 21:54:53,098][106226] Updated weights for policy 0, policy_version 373760 (0.0006) [2023-12-27 21:54:53,118][106225] Updated weights for policy 1, policy_version 374501 (0.0007) [2023-12-27 21:54:53,178][106225] Updated weights for policy 1, policy_version 374511 (0.0009) [2023-12-27 21:54:53,698][106226] Updated weights for policy 0, policy_version 373770 (0.0006) [2023-12-27 21:54:53,758][106226] Updated weights for policy 0, policy_version 373780 (0.0010) [2023-12-27 21:54:53,810][106226] Updated weights for policy 0, policy_version 373790 (0.0010) [2023-12-27 21:54:53,857][106226] Updated weights for policy 0, policy_version 373800 (0.0010) [2023-12-27 21:54:53,923][106225] Updated weights for policy 1, policy_version 374521 (0.0009) [2023-12-27 21:54:53,974][106225] Updated weights for policy 1, policy_version 374531 (0.0010) [2023-12-27 21:54:54,031][106225] Updated weights for policy 1, policy_version 374541 (0.0010) [2023-12-27 21:54:54,554][106226] Updated weights for policy 0, policy_version 373810 (0.0011) [2023-12-27 21:54:54,609][106226] Updated weights for policy 0, policy_version 373820 (0.0011) [2023-12-27 21:54:54,617][106225] Updated weights for policy 1, policy_version 374551 (0.0007) [2023-12-27 21:54:54,659][106226] Updated weights for policy 0, policy_version 373830 (0.0010) [2023-12-27 21:54:54,677][106225] Updated weights for policy 1, policy_version 374561 (0.0006) [2023-12-27 21:54:54,728][106225] Updated weights for policy 1, policy_version 374571 (0.0008) [2023-12-27 21:54:55,304][106226] Updated weights for policy 0, policy_version 373840 (0.0010) [2023-12-27 21:54:55,368][106226] Updated weights for policy 0, policy_version 373850 (0.0009) [2023-12-27 21:54:55,408][106225] Updated weights for policy 1, policy_version 374581 (0.0007) [2023-12-27 21:54:55,426][106226] Updated weights for policy 0, policy_version 373860 (0.0009) [2023-12-27 21:54:55,469][106225] Updated weights for policy 1, policy_version 374591 (0.0005) [2023-12-27 21:54:55,528][106225] Updated weights for policy 1, policy_version 374601 (0.0006) [2023-12-27 21:54:56,086][106225] Updated weights for policy 1, policy_version 374611 (0.0006) [2023-12-27 21:54:56,137][106225] Updated weights for policy 1, policy_version 374621 (0.0008) [2023-12-27 21:54:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 191668224. Throughput: 0: 9900.1, 1: 9975.2. Samples: 191640816. Policy #0 lag: (min: 28.0, avg: 28.3, max: 41.0) [2023-12-27 21:54:56,176][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.700')] [2023-12-27 21:54:56,190][106225] Updated weights for policy 1, policy_version 374631 (0.0008) [2023-12-27 21:54:56,216][106226] Updated weights for policy 0, policy_version 373870 (0.0006) [2023-12-27 21:54:56,232][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000374640_95936512.pth... [2023-12-27 21:54:56,236][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000373456_95633408.pth [2023-12-27 21:54:56,275][106226] Updated weights for policy 0, policy_version 373880 (0.0005) [2023-12-27 21:54:56,335][106226] Updated weights for policy 0, policy_version 373890 (0.0007) [2023-12-27 21:54:56,366][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000373896_95748096.pth... [2023-12-27 21:54:56,370][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000372712_95444992.pth [2023-12-27 21:54:56,817][106225] Updated weights for policy 1, policy_version 374641 (0.0008) [2023-12-27 21:54:56,872][106225] Updated weights for policy 1, policy_version 374651 (0.0005) [2023-12-27 21:54:56,926][106225] Updated weights for policy 1, policy_version 374661 (0.0005) [2023-12-27 21:54:56,944][106226] Updated weights for policy 0, policy_version 373901 (0.0010) [2023-12-27 21:54:56,981][106225] Updated weights for policy 1, policy_version 374671 (0.0005) [2023-12-27 21:54:57,008][106226] Updated weights for policy 0, policy_version 373911 (0.0009) [2023-12-27 21:54:57,075][106226] Updated weights for policy 0, policy_version 373921 (0.0009) [2023-12-27 21:54:57,614][106225] Updated weights for policy 1, policy_version 374681 (0.0008) [2023-12-27 21:54:57,663][106225] Updated weights for policy 1, policy_version 374691 (0.0008) [2023-12-27 21:54:57,692][106226] Updated weights for policy 0, policy_version 373931 (0.0008) [2023-12-27 21:54:57,713][106225] Updated weights for policy 1, policy_version 374701 (0.0009) [2023-12-27 21:54:57,746][106226] Updated weights for policy 0, policy_version 373941 (0.0005) [2023-12-27 21:54:57,796][106226] Updated weights for policy 0, policy_version 373951 (0.0005) [2023-12-27 21:54:58,414][106226] Updated weights for policy 0, policy_version 373961 (0.0006) [2023-12-27 21:54:58,488][106226] Updated weights for policy 0, policy_version 373971 (0.0010) [2023-12-27 21:54:58,491][106225] Updated weights for policy 1, policy_version 374711 (0.0007) [2023-12-27 21:54:58,548][106226] Updated weights for policy 0, policy_version 373981 (0.0010) [2023-12-27 21:54:58,557][106225] Updated weights for policy 1, policy_version 374721 (0.0011) [2023-12-27 21:54:58,617][106226] Updated weights for policy 0, policy_version 373991 (0.0010) [2023-12-27 21:54:58,618][106225] Updated weights for policy 1, policy_version 374731 (0.0010) [2023-12-27 21:54:59,338][106225] Updated weights for policy 1, policy_version 374741 (0.0009) [2023-12-27 21:54:59,408][106225] Updated weights for policy 1, policy_version 374751 (0.0008) [2023-12-27 21:54:59,468][106225] Updated weights for policy 1, policy_version 374761 (0.0006) [2023-12-27 21:54:59,484][106226] Updated weights for policy 0, policy_version 374001 (0.0007) [2023-12-27 21:54:59,555][106226] Updated weights for policy 0, policy_version 374011 (0.0006) [2023-12-27 21:54:59,620][106226] Updated weights for policy 0, policy_version 374021 (0.0007) [2023-12-27 21:55:00,121][106225] Updated weights for policy 1, policy_version 374771 (0.0007) [2023-12-27 21:55:00,178][106225] Updated weights for policy 1, policy_version 374781 (0.0009) [2023-12-27 21:55:00,233][106225] Updated weights for policy 1, policy_version 374791 (0.0009) [2023-12-27 21:55:00,308][106226] Updated weights for policy 0, policy_version 374031 (0.0009) [2023-12-27 21:55:00,373][106226] Updated weights for policy 0, policy_version 374041 (0.0008) [2023-12-27 21:55:00,424][106226] Updated weights for policy 0, policy_version 374051 (0.0005) [2023-12-27 21:55:01,028][106226] Updated weights for policy 0, policy_version 374061 (0.0008) [2023-12-27 21:55:01,033][106225] Updated weights for policy 1, policy_version 374801 (0.0009) [2023-12-27 21:55:01,093][106226] Updated weights for policy 0, policy_version 374071 (0.0008) [2023-12-27 21:55:01,098][106225] Updated weights for policy 1, policy_version 374811 (0.0008) [2023-12-27 21:55:01,153][106226] Updated weights for policy 0, policy_version 374081 (0.0007) [2023-12-27 21:55:01,161][106225] Updated weights for policy 1, policy_version 374821 (0.0008) [2023-12-27 21:55:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 191766528. Throughput: 0: 9958.6, 1: 10013.6. Samples: 191764500. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:01,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.732')] [2023-12-27 21:55:01,224][106225] Updated weights for policy 1, policy_version 374831 (0.0007) [2023-12-27 21:55:01,904][106226] Updated weights for policy 0, policy_version 374091 (0.0010) [2023-12-27 21:55:01,969][106226] Updated weights for policy 0, policy_version 374101 (0.0009) [2023-12-27 21:55:02,033][106226] Updated weights for policy 0, policy_version 374111 (0.0008) [2023-12-27 21:55:02,056][106225] Updated weights for policy 1, policy_version 374841 (0.0009) [2023-12-27 21:55:02,116][106225] Updated weights for policy 1, policy_version 374851 (0.0007) [2023-12-27 21:55:02,176][106225] Updated weights for policy 1, policy_version 374861 (0.0008) [2023-12-27 21:55:02,700][106226] Updated weights for policy 0, policy_version 374121 (0.0009) [2023-12-27 21:55:02,766][106226] Updated weights for policy 0, policy_version 374131 (0.0006) [2023-12-27 21:55:02,834][106226] Updated weights for policy 0, policy_version 374141 (0.0007) [2023-12-27 21:55:02,895][106226] Updated weights for policy 0, policy_version 374151 (0.0009) [2023-12-27 21:55:02,969][106225] Updated weights for policy 1, policy_version 374871 (0.0008) [2023-12-27 21:55:03,016][106225] Updated weights for policy 1, policy_version 374881 (0.0008) [2023-12-27 21:55:03,067][106225] Updated weights for policy 1, policy_version 374891 (0.0006) [2023-12-27 21:55:03,506][106226] Updated weights for policy 0, policy_version 374161 (0.0010) [2023-12-27 21:55:03,568][106226] Updated weights for policy 0, policy_version 374171 (0.0010) [2023-12-27 21:55:03,623][106226] Updated weights for policy 0, policy_version 374181 (0.0010) [2023-12-27 21:55:03,682][106225] Updated weights for policy 1, policy_version 374901 (0.0009) [2023-12-27 21:55:03,736][106225] Updated weights for policy 1, policy_version 374911 (0.0008) [2023-12-27 21:55:03,792][106225] Updated weights for policy 1, policy_version 374921 (0.0007) [2023-12-27 21:55:04,290][106226] Updated weights for policy 0, policy_version 374191 (0.0009) [2023-12-27 21:55:04,356][106226] Updated weights for policy 0, policy_version 374201 (0.0011) [2023-12-27 21:55:04,419][106226] Updated weights for policy 0, policy_version 374211 (0.0011) [2023-12-27 21:55:04,505][106225] Updated weights for policy 1, policy_version 374931 (0.0008) [2023-12-27 21:55:04,569][106225] Updated weights for policy 1, policy_version 374941 (0.0005) [2023-12-27 21:55:04,622][106225] Updated weights for policy 1, policy_version 374951 (0.0005) [2023-12-27 21:55:05,108][106226] Updated weights for policy 0, policy_version 374221 (0.0011) [2023-12-27 21:55:05,171][106226] Updated weights for policy 0, policy_version 374231 (0.0010) [2023-12-27 21:55:05,231][106226] Updated weights for policy 0, policy_version 374241 (0.0010) [2023-12-27 21:55:05,239][106225] Updated weights for policy 1, policy_version 374961 (0.0005) [2023-12-27 21:55:05,291][106225] Updated weights for policy 1, policy_version 374971 (0.0006) [2023-12-27 21:55:05,351][106225] Updated weights for policy 1, policy_version 374981 (0.0010) [2023-12-27 21:55:05,410][106225] Updated weights for policy 1, policy_version 374991 (0.0010) [2023-12-27 21:55:05,902][106226] Updated weights for policy 0, policy_version 374251 (0.0010) [2023-12-27 21:55:05,962][106226] Updated weights for policy 0, policy_version 374261 (0.0005) [2023-12-27 21:55:06,028][106226] Updated weights for policy 0, policy_version 374271 (0.0005) [2023-12-27 21:55:06,053][106225] Updated weights for policy 1, policy_version 375001 (0.0007) [2023-12-27 21:55:06,121][106225] Updated weights for policy 1, policy_version 375011 (0.0010) [2023-12-27 21:55:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 191873024. Throughput: 0: 10011.3, 1: 9982.3. Samples: 191883864. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:06,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-5.946')] [2023-12-27 21:55:06,184][106225] Updated weights for policy 1, policy_version 375021 (0.0006) [2023-12-27 21:55:06,703][106226] Updated weights for policy 0, policy_version 374281 (0.0005) [2023-12-27 21:55:06,768][106226] Updated weights for policy 0, policy_version 374291 (0.0005) [2023-12-27 21:55:06,823][106225] Updated weights for policy 1, policy_version 375031 (0.0009) [2023-12-27 21:55:06,833][106226] Updated weights for policy 0, policy_version 374301 (0.0008) [2023-12-27 21:55:06,877][106225] Updated weights for policy 1, policy_version 375041 (0.0010) [2023-12-27 21:55:06,888][106226] Updated weights for policy 0, policy_version 374311 (0.0011) [2023-12-27 21:55:06,931][106225] Updated weights for policy 1, policy_version 375051 (0.0010) [2023-12-27 21:55:07,555][106225] Updated weights for policy 1, policy_version 375061 (0.0008) [2023-12-27 21:55:07,570][106226] Updated weights for policy 0, policy_version 374321 (0.0011) [2023-12-27 21:55:07,612][106225] Updated weights for policy 1, policy_version 375071 (0.0009) [2023-12-27 21:55:07,626][106226] Updated weights for policy 0, policy_version 374331 (0.0011) [2023-12-27 21:55:07,667][106225] Updated weights for policy 1, policy_version 375081 (0.0007) [2023-12-27 21:55:07,674][106226] Updated weights for policy 0, policy_version 374341 (0.0011) [2023-12-27 21:55:08,392][106225] Updated weights for policy 1, policy_version 375091 (0.0008) [2023-12-27 21:55:08,447][106225] Updated weights for policy 1, policy_version 375101 (0.0010) [2023-12-27 21:55:08,454][106226] Updated weights for policy 0, policy_version 374351 (0.0011) [2023-12-27 21:55:08,498][106225] Updated weights for policy 1, policy_version 375111 (0.0010) [2023-12-27 21:55:08,505][106226] Updated weights for policy 0, policy_version 374361 (0.0011) [2023-12-27 21:55:08,564][106226] Updated weights for policy 0, policy_version 374371 (0.0011) [2023-12-27 21:55:09,194][106225] Updated weights for policy 1, policy_version 375121 (0.0010) [2023-12-27 21:55:09,285][106225] Updated weights for policy 1, policy_version 375131 (0.0006) [2023-12-27 21:55:09,304][106226] Updated weights for policy 0, policy_version 374381 (0.0011) [2023-12-27 21:55:09,349][106225] Updated weights for policy 1, policy_version 375141 (0.0008) [2023-12-27 21:55:09,371][106226] Updated weights for policy 0, policy_version 374391 (0.0008) [2023-12-27 21:55:09,414][106225] Updated weights for policy 1, policy_version 375151 (0.0007) [2023-12-27 21:55:09,438][106226] Updated weights for policy 0, policy_version 374401 (0.0009) [2023-12-27 21:55:10,096][106225] Updated weights for policy 1, policy_version 375161 (0.0010) [2023-12-27 21:55:10,111][106226] Updated weights for policy 0, policy_version 374411 (0.0009) [2023-12-27 21:55:10,153][106225] Updated weights for policy 1, policy_version 375171 (0.0008) [2023-12-27 21:55:10,172][106226] Updated weights for policy 0, policy_version 374421 (0.0008) [2023-12-27 21:55:10,207][106225] Updated weights for policy 1, policy_version 375181 (0.0006) [2023-12-27 21:55:10,233][106226] Updated weights for policy 0, policy_version 374431 (0.0011) [2023-12-27 21:55:10,924][106225] Updated weights for policy 1, policy_version 375191 (0.0006) [2023-12-27 21:55:10,939][106226] Updated weights for policy 0, policy_version 374441 (0.0011) [2023-12-27 21:55:10,976][106225] Updated weights for policy 1, policy_version 375201 (0.0010) [2023-12-27 21:55:10,996][106226] Updated weights for policy 0, policy_version 374451 (0.0011) [2023-12-27 21:55:11,033][106225] Updated weights for policy 1, policy_version 375211 (0.0010) [2023-12-27 21:55:11,057][106226] Updated weights for policy 0, policy_version 374461 (0.0010) [2023-12-27 21:55:11,124][106226] Updated weights for policy 0, policy_version 374471 (0.0012) [2023-12-27 21:55:11,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 191979520. Throughput: 0: 10044.7, 1: 10044.2. Samples: 191943968. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:11,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.925')] [2023-12-27 21:55:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000374472_95895552.pth... [2023-12-27 21:55:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000375216_96083968.pth... [2023-12-27 21:55:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000373320_95600640.pth [2023-12-27 21:55:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000374032_95780864.pth [2023-12-27 21:55:11,781][106225] Updated weights for policy 1, policy_version 375221 (0.0010) [2023-12-27 21:55:11,842][106225] Updated weights for policy 1, policy_version 375231 (0.0006) [2023-12-27 21:55:11,903][106225] Updated weights for policy 1, policy_version 375241 (0.0006) [2023-12-27 21:55:11,914][106226] Updated weights for policy 0, policy_version 374481 (0.0009) [2023-12-27 21:55:11,969][106226] Updated weights for policy 0, policy_version 374491 (0.0007) [2023-12-27 21:55:12,018][106226] Updated weights for policy 0, policy_version 374501 (0.0008) [2023-12-27 21:55:12,631][106225] Updated weights for policy 1, policy_version 375251 (0.0008) [2023-12-27 21:55:12,688][106225] Updated weights for policy 1, policy_version 375261 (0.0009) [2023-12-27 21:55:12,712][106226] Updated weights for policy 0, policy_version 374511 (0.0007) [2023-12-27 21:55:12,742][106225] Updated weights for policy 1, policy_version 375271 (0.0006) [2023-12-27 21:55:12,773][106226] Updated weights for policy 0, policy_version 374521 (0.0007) [2023-12-27 21:55:12,840][106226] Updated weights for policy 0, policy_version 374531 (0.0006) [2023-12-27 21:55:13,405][106226] Updated weights for policy 0, policy_version 374541 (0.0007) [2023-12-27 21:55:13,467][106226] Updated weights for policy 0, policy_version 374551 (0.0005) [2023-12-27 21:55:13,533][106225] Updated weights for policy 1, policy_version 375281 (0.0007) [2023-12-27 21:55:13,533][106226] Updated weights for policy 0, policy_version 374561 (0.0007) [2023-12-27 21:55:13,594][106225] Updated weights for policy 1, policy_version 375291 (0.0005) [2023-12-27 21:55:13,655][106225] Updated weights for policy 1, policy_version 375301 (0.0005) [2023-12-27 21:55:13,723][106225] Updated weights for policy 1, policy_version 375311 (0.0005) [2023-12-27 21:55:14,190][106226] Updated weights for policy 0, policy_version 374571 (0.0008) [2023-12-27 21:55:14,255][106226] Updated weights for policy 0, policy_version 374581 (0.0007) [2023-12-27 21:55:14,280][106225] Updated weights for policy 1, policy_version 375321 (0.0007) [2023-12-27 21:55:14,322][106226] Updated weights for policy 0, policy_version 374591 (0.0007) [2023-12-27 21:55:14,328][106225] Updated weights for policy 1, policy_version 375331 (0.0007) [2023-12-27 21:55:14,396][106225] Updated weights for policy 1, policy_version 375341 (0.0007) [2023-12-27 21:55:15,004][106226] Updated weights for policy 0, policy_version 374601 (0.0006) [2023-12-27 21:55:15,056][106225] Updated weights for policy 1, policy_version 375351 (0.0006) [2023-12-27 21:55:15,063][106226] Updated weights for policy 0, policy_version 374611 (0.0008) [2023-12-27 21:55:15,122][106225] Updated weights for policy 1, policy_version 375361 (0.0007) [2023-12-27 21:55:15,125][106226] Updated weights for policy 0, policy_version 374621 (0.0006) [2023-12-27 21:55:15,191][106226] Updated weights for policy 0, policy_version 374631 (0.0007) [2023-12-27 21:55:15,194][106225] Updated weights for policy 1, policy_version 375371 (0.0006) [2023-12-27 21:55:15,801][106226] Updated weights for policy 0, policy_version 374641 (0.0009) [2023-12-27 21:55:15,853][106226] Updated weights for policy 0, policy_version 374651 (0.0009) [2023-12-27 21:55:15,869][106225] Updated weights for policy 1, policy_version 375381 (0.0007) [2023-12-27 21:55:15,905][106226] Updated weights for policy 0, policy_version 374661 (0.0008) [2023-12-27 21:55:15,930][106225] Updated weights for policy 1, policy_version 375391 (0.0006) [2023-12-27 21:55:15,983][106225] Updated weights for policy 1, policy_version 375401 (0.0006) [2023-12-27 21:55:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 192077824. Throughput: 0: 9864.5, 1: 9922.5. Samples: 192063020. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:16,175][105115] Avg episode reward: [(0, '-4.966'), (1, '-5.834')] [2023-12-27 21:55:16,632][106225] Updated weights for policy 1, policy_version 375411 (0.0006) [2023-12-27 21:55:16,658][106226] Updated weights for policy 0, policy_version 374671 (0.0009) [2023-12-27 21:55:16,698][106225] Updated weights for policy 1, policy_version 375421 (0.0006) [2023-12-27 21:55:16,723][106226] Updated weights for policy 0, policy_version 374681 (0.0008) [2023-12-27 21:55:16,767][106225] Updated weights for policy 1, policy_version 375431 (0.0006) [2023-12-27 21:55:16,779][106226] Updated weights for policy 0, policy_version 374691 (0.0007) [2023-12-27 21:55:17,454][106225] Updated weights for policy 1, policy_version 375441 (0.0006) [2023-12-27 21:55:17,482][106226] Updated weights for policy 0, policy_version 374701 (0.0006) [2023-12-27 21:55:17,509][106225] Updated weights for policy 1, policy_version 375451 (0.0007) [2023-12-27 21:55:17,539][106226] Updated weights for policy 0, policy_version 374711 (0.0007) [2023-12-27 21:55:17,567][106225] Updated weights for policy 1, policy_version 375461 (0.0009) [2023-12-27 21:55:17,597][106226] Updated weights for policy 0, policy_version 374721 (0.0006) [2023-12-27 21:55:17,625][106225] Updated weights for policy 1, policy_version 375471 (0.0006) [2023-12-27 21:55:18,200][106226] Updated weights for policy 0, policy_version 374731 (0.0007) [2023-12-27 21:55:18,250][106226] Updated weights for policy 0, policy_version 374741 (0.0009) [2023-12-27 21:55:18,305][106226] Updated weights for policy 0, policy_version 374751 (0.0007) [2023-12-27 21:55:18,321][106225] Updated weights for policy 1, policy_version 375481 (0.0010) [2023-12-27 21:55:18,391][106225] Updated weights for policy 1, policy_version 375491 (0.0006) [2023-12-27 21:55:18,444][106225] Updated weights for policy 1, policy_version 375501 (0.0009) [2023-12-27 21:55:19,020][106226] Updated weights for policy 0, policy_version 374761 (0.0010) [2023-12-27 21:55:19,071][106226] Updated weights for policy 0, policy_version 374771 (0.0010) [2023-12-27 21:55:19,122][106226] Updated weights for policy 0, policy_version 374781 (0.0010) [2023-12-27 21:55:19,182][106226] Updated weights for policy 0, policy_version 374791 (0.0011) [2023-12-27 21:55:19,200][106225] Updated weights for policy 1, policy_version 375511 (0.0007) [2023-12-27 21:55:19,268][106225] Updated weights for policy 1, policy_version 375521 (0.0008) [2023-12-27 21:55:19,345][106225] Updated weights for policy 1, policy_version 375531 (0.0007) [2023-12-27 21:55:20,013][106226] Updated weights for policy 0, policy_version 374801 (0.0008) [2023-12-27 21:55:20,015][106225] Updated weights for policy 1, policy_version 375541 (0.0008) [2023-12-27 21:55:20,073][106226] Updated weights for policy 0, policy_version 374811 (0.0006) [2023-12-27 21:55:20,076][106225] Updated weights for policy 1, policy_version 375551 (0.0007) [2023-12-27 21:55:20,135][106226] Updated weights for policy 0, policy_version 374821 (0.0009) [2023-12-27 21:55:20,141][106225] Updated weights for policy 1, policy_version 375561 (0.0008) [2023-12-27 21:55:20,887][106226] Updated weights for policy 0, policy_version 374831 (0.0009) [2023-12-27 21:55:20,902][106225] Updated weights for policy 1, policy_version 375571 (0.0007) [2023-12-27 21:55:20,950][106226] Updated weights for policy 0, policy_version 374841 (0.0009) [2023-12-27 21:55:20,962][106225] Updated weights for policy 1, policy_version 375581 (0.0006) [2023-12-27 21:55:21,014][106226] Updated weights for policy 0, policy_version 374851 (0.0008) [2023-12-27 21:55:21,032][106225] Updated weights for policy 1, policy_version 375591 (0.0006) [2023-12-27 21:55:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 192176128. Throughput: 0: 9826.0, 1: 9921.1. Samples: 192180344. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:21,175][105115] Avg episode reward: [(0, '-5.060'), (1, '-5.855')] [2023-12-27 21:55:21,756][106225] Updated weights for policy 1, policy_version 375601 (0.0008) [2023-12-27 21:55:21,821][106225] Updated weights for policy 1, policy_version 375611 (0.0011) [2023-12-27 21:55:21,824][106226] Updated weights for policy 0, policy_version 374861 (0.0009) [2023-12-27 21:55:21,879][106225] Updated weights for policy 1, policy_version 375621 (0.0011) [2023-12-27 21:55:21,881][106226] Updated weights for policy 0, policy_version 374871 (0.0007) [2023-12-27 21:55:21,941][106225] Updated weights for policy 1, policy_version 375631 (0.0010) [2023-12-27 21:55:21,943][106226] Updated weights for policy 0, policy_version 374881 (0.0006) [2023-12-27 21:55:22,639][106225] Updated weights for policy 1, policy_version 375641 (0.0008) [2023-12-27 21:55:22,700][106225] Updated weights for policy 1, policy_version 375651 (0.0009) [2023-12-27 21:55:22,739][106226] Updated weights for policy 0, policy_version 374891 (0.0007) [2023-12-27 21:55:22,765][106225] Updated weights for policy 1, policy_version 375661 (0.0008) [2023-12-27 21:55:22,803][106226] Updated weights for policy 0, policy_version 374901 (0.0007) [2023-12-27 21:55:22,857][106226] Updated weights for policy 0, policy_version 374911 (0.0009) [2023-12-27 21:55:23,490][106225] Updated weights for policy 1, policy_version 375671 (0.0007) [2023-12-27 21:55:23,555][106225] Updated weights for policy 1, policy_version 375681 (0.0009) [2023-12-27 21:55:23,565][106226] Updated weights for policy 0, policy_version 374921 (0.0009) [2023-12-27 21:55:23,614][106225] Updated weights for policy 1, policy_version 375691 (0.0006) [2023-12-27 21:55:23,623][106226] Updated weights for policy 0, policy_version 374931 (0.0007) [2023-12-27 21:55:23,677][106226] Updated weights for policy 0, policy_version 374941 (0.0008) [2023-12-27 21:55:23,740][106226] Updated weights for policy 0, policy_version 374951 (0.0009) [2023-12-27 21:55:24,354][106225] Updated weights for policy 1, policy_version 375701 (0.0007) [2023-12-27 21:55:24,406][106225] Updated weights for policy 1, policy_version 375711 (0.0008) [2023-12-27 21:55:24,459][106225] Updated weights for policy 1, policy_version 375721 (0.0008) [2023-12-27 21:55:24,474][106226] Updated weights for policy 0, policy_version 374961 (0.0008) [2023-12-27 21:55:24,531][106226] Updated weights for policy 0, policy_version 374971 (0.0008) [2023-12-27 21:55:24,589][106226] Updated weights for policy 0, policy_version 374981 (0.0008) [2023-12-27 21:55:25,227][106225] Updated weights for policy 1, policy_version 375731 (0.0006) [2023-12-27 21:55:25,230][106226] Updated weights for policy 0, policy_version 374991 (0.0008) [2023-12-27 21:55:25,286][106225] Updated weights for policy 1, policy_version 375741 (0.0006) [2023-12-27 21:55:25,296][106226] Updated weights for policy 0, policy_version 375001 (0.0008) [2023-12-27 21:55:25,344][106225] Updated weights for policy 1, policy_version 375751 (0.0007) [2023-12-27 21:55:25,360][106226] Updated weights for policy 0, policy_version 375011 (0.0006) [2023-12-27 21:55:26,038][106226] Updated weights for policy 0, policy_version 375021 (0.0009) [2023-12-27 21:55:26,047][106225] Updated weights for policy 1, policy_version 375761 (0.0007) [2023-12-27 21:55:26,100][106226] Updated weights for policy 0, policy_version 375031 (0.0007) [2023-12-27 21:55:26,107][106225] Updated weights for policy 1, policy_version 375771 (0.0005) [2023-12-27 21:55:26,163][106226] Updated weights for policy 0, policy_version 375041 (0.0005) [2023-12-27 21:55:26,171][106225] Updated weights for policy 1, policy_version 375781 (0.0008) [2023-12-27 21:55:26,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 192258048. Throughput: 0: 9800.6, 1: 9873.8. Samples: 192236208. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:26,176][105115] Avg episode reward: [(0, '-4.819'), (1, '-5.491')] [2023-12-27 21:55:26,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000375048_96043008.pth... [2023-12-27 21:55:26,210][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000373896_95748096.pth [2023-12-27 21:55:26,234][106225] Updated weights for policy 1, policy_version 375791 (0.0010) [2023-12-27 21:55:26,238][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000375792_96231424.pth... [2023-12-27 21:55:26,241][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000374640_95936512.pth [2023-12-27 21:55:26,780][106226] Updated weights for policy 0, policy_version 375051 (0.0005) [2023-12-27 21:55:26,811][106225] Updated weights for policy 1, policy_version 375801 (0.0006) [2023-12-27 21:55:26,840][106226] Updated weights for policy 0, policy_version 375061 (0.0005) [2023-12-27 21:55:26,859][106225] Updated weights for policy 1, policy_version 375811 (0.0005) [2023-12-27 21:55:26,890][106226] Updated weights for policy 0, policy_version 375071 (0.0005) [2023-12-27 21:55:26,923][106225] Updated weights for policy 1, policy_version 375821 (0.0005) [2023-12-27 21:55:27,474][106225] Updated weights for policy 1, policy_version 375831 (0.0005) [2023-12-27 21:55:27,528][106225] Updated weights for policy 1, policy_version 375841 (0.0005) [2023-12-27 21:55:27,585][106226] Updated weights for policy 0, policy_version 375081 (0.0005) [2023-12-27 21:55:27,588][106225] Updated weights for policy 1, policy_version 375851 (0.0005) [2023-12-27 21:55:27,635][106226] Updated weights for policy 0, policy_version 375091 (0.0007) [2023-12-27 21:55:27,690][106226] Updated weights for policy 0, policy_version 375101 (0.0009) [2023-12-27 21:55:27,736][106226] Updated weights for policy 0, policy_version 375111 (0.0008) [2023-12-27 21:55:28,207][106225] Updated weights for policy 1, policy_version 375861 (0.0009) [2023-12-27 21:55:28,253][106225] Updated weights for policy 1, policy_version 375871 (0.0008) [2023-12-27 21:55:28,298][106225] Updated weights for policy 1, policy_version 375881 (0.0007) [2023-12-27 21:55:28,494][106226] Updated weights for policy 0, policy_version 375121 (0.0011) [2023-12-27 21:55:28,554][106226] Updated weights for policy 0, policy_version 375131 (0.0010) [2023-12-27 21:55:28,608][106226] Updated weights for policy 0, policy_version 375141 (0.0008) [2023-12-27 21:55:29,138][106225] Updated weights for policy 1, policy_version 375891 (0.0008) [2023-12-27 21:55:29,168][106226] Updated weights for policy 0, policy_version 375151 (0.0007) [2023-12-27 21:55:29,188][106225] Updated weights for policy 1, policy_version 375901 (0.0007) [2023-12-27 21:55:29,236][106226] Updated weights for policy 0, policy_version 375161 (0.0010) [2023-12-27 21:55:29,254][106225] Updated weights for policy 1, policy_version 375911 (0.0007) [2023-12-27 21:55:29,294][106226] Updated weights for policy 0, policy_version 375171 (0.0008) [2023-12-27 21:55:29,993][106225] Updated weights for policy 1, policy_version 375921 (0.0008) [2023-12-27 21:55:30,044][106226] Updated weights for policy 0, policy_version 375181 (0.0010) [2023-12-27 21:55:30,052][106225] Updated weights for policy 1, policy_version 375931 (0.0008) [2023-12-27 21:55:30,101][106226] Updated weights for policy 0, policy_version 375191 (0.0009) [2023-12-27 21:55:30,111][106225] Updated weights for policy 1, policy_version 375941 (0.0007) [2023-12-27 21:55:30,162][106226] Updated weights for policy 0, policy_version 375201 (0.0011) [2023-12-27 21:55:30,168][106225] Updated weights for policy 1, policy_version 375951 (0.0006) [2023-12-27 21:55:30,834][106226] Updated weights for policy 0, policy_version 375211 (0.0009) [2023-12-27 21:55:30,860][106225] Updated weights for policy 1, policy_version 375961 (0.0005) [2023-12-27 21:55:30,887][106226] Updated weights for policy 0, policy_version 375221 (0.0005) [2023-12-27 21:55:30,916][106225] Updated weights for policy 1, policy_version 375971 (0.0005) [2023-12-27 21:55:30,933][106226] Updated weights for policy 0, policy_version 375231 (0.0005) [2023-12-27 21:55:30,964][106225] Updated weights for policy 1, policy_version 375981 (0.0010) [2023-12-27 21:55:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 192372736. Throughput: 0: 9897.5, 1: 9975.4. Samples: 192358692. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:31,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.673')] [2023-12-27 21:55:31,598][106226] Updated weights for policy 0, policy_version 375241 (0.0006) [2023-12-27 21:55:31,666][106226] Updated weights for policy 0, policy_version 375251 (0.0008) [2023-12-27 21:55:31,666][106225] Updated weights for policy 1, policy_version 375991 (0.0010) [2023-12-27 21:55:31,728][106225] Updated weights for policy 1, policy_version 376001 (0.0013) [2023-12-27 21:55:31,734][106226] Updated weights for policy 0, policy_version 375261 (0.0009) [2023-12-27 21:55:31,793][106225] Updated weights for policy 1, policy_version 376011 (0.0010) [2023-12-27 21:55:31,802][106226] Updated weights for policy 0, policy_version 375271 (0.0009) [2023-12-27 21:55:32,511][106226] Updated weights for policy 0, policy_version 375281 (0.0006) [2023-12-27 21:55:32,544][106225] Updated weights for policy 1, policy_version 376021 (0.0010) [2023-12-27 21:55:32,572][106226] Updated weights for policy 0, policy_version 375291 (0.0006) [2023-12-27 21:55:32,602][106225] Updated weights for policy 1, policy_version 376031 (0.0010) [2023-12-27 21:55:32,638][106226] Updated weights for policy 0, policy_version 375301 (0.0005) [2023-12-27 21:55:32,660][106225] Updated weights for policy 1, policy_version 376041 (0.0010) [2023-12-27 21:55:33,198][106226] Updated weights for policy 0, policy_version 375311 (0.0005) [2023-12-27 21:55:33,248][106226] Updated weights for policy 0, policy_version 375321 (0.0005) [2023-12-27 21:55:33,300][106226] Updated weights for policy 0, policy_version 375331 (0.0005) [2023-12-27 21:55:33,358][106225] Updated weights for policy 1, policy_version 376051 (0.0009) [2023-12-27 21:55:33,416][106225] Updated weights for policy 1, policy_version 376061 (0.0006) [2023-12-27 21:55:33,473][106225] Updated weights for policy 1, policy_version 376071 (0.0010) [2023-12-27 21:55:33,900][106226] Updated weights for policy 0, policy_version 375341 (0.0007) [2023-12-27 21:55:33,952][106226] Updated weights for policy 0, policy_version 375351 (0.0009) [2023-12-27 21:55:34,010][106226] Updated weights for policy 0, policy_version 375361 (0.0008) [2023-12-27 21:55:34,112][106225] Updated weights for policy 1, policy_version 376081 (0.0010) [2023-12-27 21:55:34,180][106225] Updated weights for policy 1, policy_version 376091 (0.0009) [2023-12-27 21:55:34,240][106225] Updated weights for policy 1, policy_version 376101 (0.0008) [2023-12-27 21:55:34,297][106225] Updated weights for policy 1, policy_version 376111 (0.0009) [2023-12-27 21:55:34,817][106226] Updated weights for policy 0, policy_version 375371 (0.0007) [2023-12-27 21:55:34,879][106226] Updated weights for policy 0, policy_version 375381 (0.0008) [2023-12-27 21:55:34,931][106226] Updated weights for policy 0, policy_version 375391 (0.0007) [2023-12-27 21:55:34,940][106225] Updated weights for policy 1, policy_version 376121 (0.0006) [2023-12-27 21:55:35,007][106225] Updated weights for policy 1, policy_version 376131 (0.0006) [2023-12-27 21:55:35,074][106225] Updated weights for policy 1, policy_version 376141 (0.0005) [2023-12-27 21:55:35,670][106225] Updated weights for policy 1, policy_version 376151 (0.0005) [2023-12-27 21:55:35,677][106226] Updated weights for policy 0, policy_version 375401 (0.0009) [2023-12-27 21:55:35,726][106225] Updated weights for policy 1, policy_version 376161 (0.0006) [2023-12-27 21:55:35,728][106226] Updated weights for policy 0, policy_version 375411 (0.0010) [2023-12-27 21:55:35,777][106225] Updated weights for policy 1, policy_version 376171 (0.0006) [2023-12-27 21:55:35,777][106226] Updated weights for policy 0, policy_version 375421 (0.0010) [2023-12-27 21:55:35,826][106226] Updated weights for policy 0, policy_version 375431 (0.0008) [2023-12-27 21:55:36,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 192471040. Throughput: 0: 9974.8, 1: 9970.4. Samples: 192480696. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:36,176][105115] Avg episode reward: [(0, '-4.739'), (1, '-5.701')] [2023-12-27 21:55:36,466][106226] Updated weights for policy 0, policy_version 375441 (0.0010) [2023-12-27 21:55:36,476][106225] Updated weights for policy 1, policy_version 376181 (0.0005) [2023-12-27 21:55:36,525][106226] Updated weights for policy 0, policy_version 375451 (0.0011) [2023-12-27 21:55:36,543][106225] Updated weights for policy 1, policy_version 376191 (0.0006) [2023-12-27 21:55:36,585][106226] Updated weights for policy 0, policy_version 375461 (0.0009) [2023-12-27 21:55:36,602][106225] Updated weights for policy 1, policy_version 376201 (0.0008) [2023-12-27 21:55:37,224][106225] Updated weights for policy 1, policy_version 376211 (0.0009) [2023-12-27 21:55:37,227][106226] Updated weights for policy 0, policy_version 375471 (0.0011) [2023-12-27 21:55:37,276][106225] Updated weights for policy 1, policy_version 376221 (0.0005) [2023-12-27 21:55:37,278][106226] Updated weights for policy 0, policy_version 375481 (0.0010) [2023-12-27 21:55:37,327][106225] Updated weights for policy 1, policy_version 376231 (0.0005) [2023-12-27 21:55:37,329][106226] Updated weights for policy 0, policy_version 375491 (0.0011) [2023-12-27 21:55:38,053][106226] Updated weights for policy 0, policy_version 375501 (0.0010) [2023-12-27 21:55:38,081][106225] Updated weights for policy 1, policy_version 376241 (0.0008) [2023-12-27 21:55:38,103][106226] Updated weights for policy 0, policy_version 375511 (0.0010) [2023-12-27 21:55:38,136][106225] Updated weights for policy 1, policy_version 376251 (0.0005) [2023-12-27 21:55:38,157][106226] Updated weights for policy 0, policy_version 375521 (0.0010) [2023-12-27 21:55:38,186][106225] Updated weights for policy 1, policy_version 376261 (0.0005) [2023-12-27 21:55:38,186][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000002 [2023-12-27 21:55:38,244][106225] Updated weights for policy 1, policy_version 376271 (0.0008) [2023-12-27 21:55:38,887][106226] Updated weights for policy 0, policy_version 375531 (0.0010) [2023-12-27 21:55:38,944][106226] Updated weights for policy 0, policy_version 375541 (0.0010) [2023-12-27 21:55:38,997][106226] Updated weights for policy 0, policy_version 375551 (0.0010) [2023-12-27 21:55:39,030][106225] Updated weights for policy 1, policy_version 376281 (0.0006) [2023-12-27 21:55:39,089][106225] Updated weights for policy 1, policy_version 376292 (0.0007) [2023-12-27 21:55:39,145][106225] Updated weights for policy 1, policy_version 376302 (0.0005) [2023-12-27 21:55:39,716][106226] Updated weights for policy 0, policy_version 375561 (0.0010) [2023-12-27 21:55:39,774][106226] Updated weights for policy 0, policy_version 375571 (0.0007) [2023-12-27 21:55:39,835][106226] Updated weights for policy 0, policy_version 375581 (0.0007) [2023-12-27 21:55:39,855][106225] Updated weights for policy 1, policy_version 376312 (0.0009) [2023-12-27 21:55:39,900][106226] Updated weights for policy 0, policy_version 375591 (0.0006) [2023-12-27 21:55:39,925][106225] Updated weights for policy 1, policy_version 376322 (0.0011) [2023-12-27 21:55:39,991][106225] Updated weights for policy 1, policy_version 376332 (0.0009) [2023-12-27 21:55:40,636][106226] Updated weights for policy 0, policy_version 375601 (0.0007) [2023-12-27 21:55:40,690][106226] Updated weights for policy 0, policy_version 375611 (0.0008) [2023-12-27 21:55:40,728][106225] Updated weights for policy 1, policy_version 376342 (0.0011) [2023-12-27 21:55:40,751][106226] Updated weights for policy 0, policy_version 375621 (0.0006) [2023-12-27 21:55:40,788][106225] Updated weights for policy 1, policy_version 376352 (0.0010) [2023-12-27 21:55:40,848][106225] Updated weights for policy 1, policy_version 376362 (0.0010) [2023-12-27 21:55:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 192569344. Throughput: 0: 9984.7, 1: 10007.2. Samples: 192540448. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:41,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-5.814')] [2023-12-27 21:55:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000376368_96378880.pth... [2023-12-27 21:55:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000375624_96190464.pth... [2023-12-27 21:55:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000374472_95895552.pth [2023-12-27 21:55:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000375216_96083968.pth [2023-12-27 21:55:41,503][106226] Updated weights for policy 0, policy_version 375631 (0.0008) [2023-12-27 21:55:41,566][106226] Updated weights for policy 0, policy_version 375641 (0.0009) [2023-12-27 21:55:41,573][106225] Updated weights for policy 1, policy_version 376372 (0.0006) [2023-12-27 21:55:41,638][106226] Updated weights for policy 0, policy_version 375651 (0.0008) [2023-12-27 21:55:41,638][106225] Updated weights for policy 1, policy_version 376382 (0.0008) [2023-12-27 21:55:41,698][106225] Updated weights for policy 1, policy_version 376392 (0.0007) [2023-12-27 21:55:42,356][106226] Updated weights for policy 0, policy_version 375661 (0.0008) [2023-12-27 21:55:42,383][106225] Updated weights for policy 1, policy_version 376402 (0.0012) [2023-12-27 21:55:42,421][106226] Updated weights for policy 0, policy_version 375671 (0.0008) [2023-12-27 21:55:42,448][106225] Updated weights for policy 1, policy_version 376412 (0.0010) [2023-12-27 21:55:42,477][106226] Updated weights for policy 0, policy_version 375681 (0.0008) [2023-12-27 21:55:42,509][106225] Updated weights for policy 1, policy_version 376422 (0.0010) [2023-12-27 21:55:42,569][106225] Updated weights for policy 1, policy_version 376432 (0.0010) [2023-12-27 21:55:43,233][106226] Updated weights for policy 0, policy_version 375691 (0.0007) [2023-12-27 21:55:43,234][106225] Updated weights for policy 1, policy_version 376442 (0.0009) [2023-12-27 21:55:43,283][106226] Updated weights for policy 0, policy_version 375701 (0.0006) [2023-12-27 21:55:43,290][106225] Updated weights for policy 1, policy_version 376452 (0.0006) [2023-12-27 21:55:43,345][106226] Updated weights for policy 0, policy_version 375711 (0.0007) [2023-12-27 21:55:43,348][106225] Updated weights for policy 1, policy_version 376462 (0.0006) [2023-12-27 21:55:43,915][106226] Updated weights for policy 0, policy_version 375721 (0.0008) [2023-12-27 21:55:43,951][106225] Updated weights for policy 1, policy_version 376472 (0.0007) [2023-12-27 21:55:43,974][106226] Updated weights for policy 0, policy_version 375731 (0.0006) [2023-12-27 21:55:44,009][106225] Updated weights for policy 1, policy_version 376482 (0.0007) [2023-12-27 21:55:44,034][106226] Updated weights for policy 0, policy_version 375741 (0.0007) [2023-12-27 21:55:44,066][106225] Updated weights for policy 1, policy_version 376492 (0.0005) [2023-12-27 21:55:44,090][106226] Updated weights for policy 0, policy_version 375751 (0.0007) [2023-12-27 21:55:44,618][106225] Updated weights for policy 1, policy_version 376502 (0.0008) [2023-12-27 21:55:44,676][106225] Updated weights for policy 1, policy_version 376512 (0.0010) [2023-12-27 21:55:44,735][106225] Updated weights for policy 1, policy_version 376522 (0.0010) [2023-12-27 21:55:44,786][106226] Updated weights for policy 0, policy_version 375761 (0.0008) [2023-12-27 21:55:44,847][106226] Updated weights for policy 0, policy_version 375771 (0.0007) [2023-12-27 21:55:44,912][106226] Updated weights for policy 0, policy_version 375781 (0.0008) [2023-12-27 21:55:45,488][106225] Updated weights for policy 1, policy_version 376532 (0.0008) [2023-12-27 21:55:45,544][106225] Updated weights for policy 1, policy_version 376542 (0.0008) [2023-12-27 21:55:45,580][106226] Updated weights for policy 0, policy_version 375791 (0.0006) [2023-12-27 21:55:45,594][106225] Updated weights for policy 1, policy_version 376552 (0.0008) [2023-12-27 21:55:45,633][106226] Updated weights for policy 0, policy_version 375801 (0.0006) [2023-12-27 21:55:45,695][106226] Updated weights for policy 0, policy_version 375811 (0.0005) [2023-12-27 21:55:46,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 192667648. Throughput: 0: 9936.4, 1: 9941.3. Samples: 192659000. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:46,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.763')] [2023-12-27 21:55:46,271][106225] Updated weights for policy 1, policy_version 376562 (0.0007) [2023-12-27 21:55:46,325][106226] Updated weights for policy 0, policy_version 375821 (0.0007) [2023-12-27 21:55:46,328][106225] Updated weights for policy 1, policy_version 376572 (0.0005) [2023-12-27 21:55:46,382][106226] Updated weights for policy 0, policy_version 375831 (0.0008) [2023-12-27 21:55:46,384][106225] Updated weights for policy 1, policy_version 376582 (0.0005) [2023-12-27 21:55:46,436][106225] Updated weights for policy 1, policy_version 376592 (0.0006) [2023-12-27 21:55:46,443][106226] Updated weights for policy 0, policy_version 375841 (0.0008) [2023-12-27 21:55:47,006][106225] Updated weights for policy 1, policy_version 376602 (0.0010) [2023-12-27 21:55:47,068][106225] Updated weights for policy 1, policy_version 376612 (0.0010) [2023-12-27 21:55:47,130][106225] Updated weights for policy 1, policy_version 376622 (0.0010) [2023-12-27 21:55:47,241][106226] Updated weights for policy 0, policy_version 375851 (0.0007) [2023-12-27 21:55:47,305][106226] Updated weights for policy 0, policy_version 375861 (0.0006) [2023-12-27 21:55:47,366][106226] Updated weights for policy 0, policy_version 375871 (0.0006) [2023-12-27 21:55:47,749][106225] Updated weights for policy 1, policy_version 376632 (0.0009) [2023-12-27 21:55:47,809][106225] Updated weights for policy 1, policy_version 376642 (0.0008) [2023-12-27 21:55:47,873][106225] Updated weights for policy 1, policy_version 376652 (0.0007) [2023-12-27 21:55:48,033][106226] Updated weights for policy 0, policy_version 375881 (0.0006) [2023-12-27 21:55:48,101][106226] Updated weights for policy 0, policy_version 375891 (0.0010) [2023-12-27 21:55:48,167][106226] Updated weights for policy 0, policy_version 375901 (0.0010) [2023-12-27 21:55:48,236][106226] Updated weights for policy 0, policy_version 375911 (0.0011) [2023-12-27 21:55:48,537][106225] Updated weights for policy 1, policy_version 376662 (0.0009) [2023-12-27 21:55:48,594][106225] Updated weights for policy 1, policy_version 376672 (0.0010) [2023-12-27 21:55:48,659][106225] Updated weights for policy 1, policy_version 376682 (0.0010) [2023-12-27 21:55:48,937][106226] Updated weights for policy 0, policy_version 375921 (0.0006) [2023-12-27 21:55:49,004][106226] Updated weights for policy 0, policy_version 375931 (0.0006) [2023-12-27 21:55:49,064][106226] Updated weights for policy 0, policy_version 375941 (0.0005) [2023-12-27 21:55:49,255][106225] Updated weights for policy 1, policy_version 376692 (0.0008) [2023-12-27 21:55:49,322][106225] Updated weights for policy 1, policy_version 376702 (0.0006) [2023-12-27 21:55:49,394][106225] Updated weights for policy 1, policy_version 376712 (0.0009) [2023-12-27 21:55:49,752][106226] Updated weights for policy 0, policy_version 375951 (0.0008) [2023-12-27 21:55:49,818][106226] Updated weights for policy 0, policy_version 375961 (0.0009) [2023-12-27 21:55:49,885][106226] Updated weights for policy 0, policy_version 375971 (0.0008) [2023-12-27 21:55:50,103][106225] Updated weights for policy 1, policy_version 376722 (0.0008) [2023-12-27 21:55:50,173][106225] Updated weights for policy 1, policy_version 376732 (0.0009) [2023-12-27 21:55:50,241][106225] Updated weights for policy 1, policy_version 376742 (0.0010) [2023-12-27 21:55:50,305][106225] Updated weights for policy 1, policy_version 376752 (0.0009) [2023-12-27 21:55:50,581][106226] Updated weights for policy 0, policy_version 375981 (0.0009) [2023-12-27 21:55:50,641][106226] Updated weights for policy 0, policy_version 375991 (0.0007) [2023-12-27 21:55:50,702][106226] Updated weights for policy 0, policy_version 376001 (0.0007) [2023-12-27 21:55:51,083][106225] Updated weights for policy 1, policy_version 376762 (0.0008) [2023-12-27 21:55:51,153][106225] Updated weights for policy 1, policy_version 376772 (0.0008) [2023-12-27 21:55:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 192765952. Throughput: 0: 9899.2, 1: 10011.6. Samples: 192779848. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:51,175][105115] Avg episode reward: [(0, '-4.916'), (1, '-5.853')] [2023-12-27 21:55:51,208][106225] Updated weights for policy 1, policy_version 376782 (0.0008) [2023-12-27 21:55:51,438][106226] Updated weights for policy 0, policy_version 376011 (0.0009) [2023-12-27 21:55:51,502][106226] Updated weights for policy 0, policy_version 376021 (0.0009) [2023-12-27 21:55:51,562][106226] Updated weights for policy 0, policy_version 376031 (0.0008) [2023-12-27 21:55:51,944][106225] Updated weights for policy 1, policy_version 376792 (0.0006) [2023-12-27 21:55:52,000][106225] Updated weights for policy 1, policy_version 376802 (0.0005) [2023-12-27 21:55:52,065][106225] Updated weights for policy 1, policy_version 376812 (0.0007) [2023-12-27 21:55:52,331][106226] Updated weights for policy 0, policy_version 376041 (0.0009) [2023-12-27 21:55:52,396][106226] Updated weights for policy 0, policy_version 376051 (0.0008) [2023-12-27 21:55:52,450][106226] Updated weights for policy 0, policy_version 376061 (0.0008) [2023-12-27 21:55:52,510][106226] Updated weights for policy 0, policy_version 376071 (0.0009) [2023-12-27 21:55:52,717][106225] Updated weights for policy 1, policy_version 376822 (0.0008) [2023-12-27 21:55:52,767][106225] Updated weights for policy 1, policy_version 376832 (0.0008) [2023-12-27 21:55:52,816][106225] Updated weights for policy 1, policy_version 376842 (0.0008) [2023-12-27 21:55:53,183][106226] Updated weights for policy 0, policy_version 376081 (0.0009) [2023-12-27 21:55:53,245][106226] Updated weights for policy 0, policy_version 376091 (0.0009) [2023-12-27 21:55:53,306][106226] Updated weights for policy 0, policy_version 376101 (0.0011) [2023-12-27 21:55:53,461][106225] Updated weights for policy 1, policy_version 376852 (0.0009) [2023-12-27 21:55:53,512][106225] Updated weights for policy 1, policy_version 376862 (0.0010) [2023-12-27 21:55:53,577][106225] Updated weights for policy 1, policy_version 376872 (0.0010) [2023-12-27 21:55:53,906][106226] Updated weights for policy 0, policy_version 376111 (0.0007) [2023-12-27 21:55:53,959][106226] Updated weights for policy 0, policy_version 376121 (0.0006) [2023-12-27 21:55:54,007][106226] Updated weights for policy 0, policy_version 376131 (0.0006) [2023-12-27 21:55:54,248][106225] Updated weights for policy 1, policy_version 376882 (0.0010) [2023-12-27 21:55:54,301][106225] Updated weights for policy 1, policy_version 376892 (0.0010) [2023-12-27 21:55:54,355][106225] Updated weights for policy 1, policy_version 376902 (0.0010) [2023-12-27 21:55:54,408][106225] Updated weights for policy 1, policy_version 376912 (0.0009) [2023-12-27 21:55:54,547][106226] Updated weights for policy 0, policy_version 376141 (0.0005) [2023-12-27 21:55:54,595][106226] Updated weights for policy 0, policy_version 376151 (0.0005) [2023-12-27 21:55:54,661][106226] Updated weights for policy 0, policy_version 376161 (0.0005) [2023-12-27 21:55:55,188][106226] Updated weights for policy 0, policy_version 376171 (0.0006) [2023-12-27 21:55:55,195][106225] Updated weights for policy 1, policy_version 376922 (0.0008) [2023-12-27 21:55:55,244][106225] Updated weights for policy 1, policy_version 376932 (0.0008) [2023-12-27 21:55:55,246][106226] Updated weights for policy 0, policy_version 376181 (0.0006) [2023-12-27 21:55:55,299][106225] Updated weights for policy 1, policy_version 376942 (0.0005) [2023-12-27 21:55:55,308][106226] Updated weights for policy 0, policy_version 376191 (0.0008) [2023-12-27 21:55:55,939][106225] Updated weights for policy 1, policy_version 376952 (0.0006) [2023-12-27 21:55:55,992][106225] Updated weights for policy 1, policy_version 376962 (0.0009) [2023-12-27 21:55:56,051][106226] Updated weights for policy 0, policy_version 376201 (0.0008) [2023-12-27 21:55:56,052][106225] Updated weights for policy 1, policy_version 376972 (0.0009) [2023-12-27 21:55:56,107][106226] Updated weights for policy 0, policy_version 376211 (0.0009) [2023-12-27 21:55:56,160][106226] Updated weights for policy 0, policy_version 376221 (0.0008) [2023-12-27 21:55:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 192872448. Throughput: 0: 9912.6, 1: 9986.4. Samples: 192839424. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:55:56,175][105115] Avg episode reward: [(0, '-5.027'), (1, '-5.668')] [2023-12-27 21:55:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000376976_96534528.pth... [2023-12-27 21:55:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000375792_96231424.pth [2023-12-27 21:55:56,224][106226] Updated weights for policy 0, policy_version 376231 (0.0008) [2023-12-27 21:55:56,230][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000376232_96346112.pth... [2023-12-27 21:55:56,235][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000375048_96043008.pth [2023-12-27 21:55:56,655][106225] Updated weights for policy 1, policy_version 376982 (0.0007) [2023-12-27 21:55:56,700][106225] Updated weights for policy 1, policy_version 376992 (0.0005) [2023-12-27 21:55:56,751][106225] Updated weights for policy 1, policy_version 377002 (0.0005) [2023-12-27 21:55:57,004][106226] Updated weights for policy 0, policy_version 376241 (0.0009) [2023-12-27 21:55:57,060][106226] Updated weights for policy 0, policy_version 376251 (0.0008) [2023-12-27 21:55:57,116][106226] Updated weights for policy 0, policy_version 376261 (0.0008) [2023-12-27 21:55:57,416][106225] Updated weights for policy 1, policy_version 377012 (0.0006) [2023-12-27 21:55:57,470][106225] Updated weights for policy 1, policy_version 377022 (0.0005) [2023-12-27 21:55:57,516][106225] Updated weights for policy 1, policy_version 377032 (0.0005) [2023-12-27 21:55:57,857][106226] Updated weights for policy 0, policy_version 376271 (0.0009) [2023-12-27 21:55:57,919][106226] Updated weights for policy 0, policy_version 376281 (0.0009) [2023-12-27 21:55:57,970][106226] Updated weights for policy 0, policy_version 376291 (0.0008) [2023-12-27 21:55:58,165][106225] Updated weights for policy 1, policy_version 377042 (0.0008) [2023-12-27 21:55:58,226][106225] Updated weights for policy 1, policy_version 377052 (0.0008) [2023-12-27 21:55:58,287][106225] Updated weights for policy 1, policy_version 377062 (0.0008) [2023-12-27 21:55:58,364][106225] Updated weights for policy 1, policy_version 377072 (0.0008) [2023-12-27 21:55:58,825][106226] Updated weights for policy 0, policy_version 376301 (0.0009) [2023-12-27 21:55:58,895][106226] Updated weights for policy 0, policy_version 376311 (0.0008) [2023-12-27 21:55:58,959][106226] Updated weights for policy 0, policy_version 376321 (0.0008) [2023-12-27 21:55:59,110][106225] Updated weights for policy 1, policy_version 377082 (0.0006) [2023-12-27 21:55:59,173][106225] Updated weights for policy 1, policy_version 377092 (0.0007) [2023-12-27 21:55:59,240][106225] Updated weights for policy 1, policy_version 377102 (0.0008) [2023-12-27 21:55:59,643][106226] Updated weights for policy 0, policy_version 376331 (0.0008) [2023-12-27 21:55:59,706][106226] Updated weights for policy 0, policy_version 376341 (0.0009) [2023-12-27 21:55:59,756][106226] Updated weights for policy 0, policy_version 376351 (0.0009) [2023-12-27 21:55:59,855][106225] Updated weights for policy 1, policy_version 377112 (0.0008) [2023-12-27 21:55:59,915][106225] Updated weights for policy 1, policy_version 377122 (0.0010) [2023-12-27 21:55:59,973][106225] Updated weights for policy 1, policy_version 377132 (0.0007) [2023-12-27 21:56:00,453][106226] Updated weights for policy 0, policy_version 376361 (0.0008) [2023-12-27 21:56:00,511][106226] Updated weights for policy 0, policy_version 376371 (0.0009) [2023-12-27 21:56:00,574][106226] Updated weights for policy 0, policy_version 376381 (0.0009) [2023-12-27 21:56:00,629][106226] Updated weights for policy 0, policy_version 376391 (0.0010) [2023-12-27 21:56:00,707][106225] Updated weights for policy 1, policy_version 377142 (0.0009) [2023-12-27 21:56:00,763][106225] Updated weights for policy 1, policy_version 377152 (0.0008) [2023-12-27 21:56:00,824][106225] Updated weights for policy 1, policy_version 377162 (0.0008) [2023-12-27 21:56:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 192970752. Throughput: 0: 9901.0, 1: 10045.4. Samples: 192960608. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:56:01,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.835')] [2023-12-27 21:56:01,426][106226] Updated weights for policy 0, policy_version 376401 (0.0006) [2023-12-27 21:56:01,486][106225] Updated weights for policy 1, policy_version 377172 (0.0007) [2023-12-27 21:56:01,489][106226] Updated weights for policy 0, policy_version 376411 (0.0007) [2023-12-27 21:56:01,543][106226] Updated weights for policy 0, policy_version 376421 (0.0005) [2023-12-27 21:56:01,546][106225] Updated weights for policy 1, policy_version 377182 (0.0010) [2023-12-27 21:56:01,604][106225] Updated weights for policy 1, policy_version 377192 (0.0008) [2023-12-27 21:56:02,236][106226] Updated weights for policy 0, policy_version 376431 (0.0007) [2023-12-27 21:56:02,278][106225] Updated weights for policy 1, policy_version 377202 (0.0009) [2023-12-27 21:56:02,299][106226] Updated weights for policy 0, policy_version 376441 (0.0006) [2023-12-27 21:56:02,335][106225] Updated weights for policy 1, policy_version 377212 (0.0010) [2023-12-27 21:56:02,369][106226] Updated weights for policy 0, policy_version 376451 (0.0008) [2023-12-27 21:56:02,401][106225] Updated weights for policy 1, policy_version 377222 (0.0010) [2023-12-27 21:56:02,458][106225] Updated weights for policy 1, policy_version 377232 (0.0010) [2023-12-27 21:56:03,087][106226] Updated weights for policy 0, policy_version 376461 (0.0008) [2023-12-27 21:56:03,141][106226] Updated weights for policy 0, policy_version 376471 (0.0007) [2023-12-27 21:56:03,142][106225] Updated weights for policy 1, policy_version 377242 (0.0010) [2023-12-27 21:56:03,195][106226] Updated weights for policy 0, policy_version 376481 (0.0007) [2023-12-27 21:56:03,198][106225] Updated weights for policy 1, policy_version 377252 (0.0007) [2023-12-27 21:56:03,248][106225] Updated weights for policy 1, policy_version 377262 (0.0010) [2023-12-27 21:56:03,907][106226] Updated weights for policy 0, policy_version 376491 (0.0007) [2023-12-27 21:56:03,945][106225] Updated weights for policy 1, policy_version 377272 (0.0008) [2023-12-27 21:56:03,961][106226] Updated weights for policy 0, policy_version 376501 (0.0011) [2023-12-27 21:56:03,998][106225] Updated weights for policy 1, policy_version 377282 (0.0008) [2023-12-27 21:56:04,023][106226] Updated weights for policy 0, policy_version 376511 (0.0011) [2023-12-27 21:56:04,050][106225] Updated weights for policy 1, policy_version 377292 (0.0008) [2023-12-27 21:56:04,764][106226] Updated weights for policy 0, policy_version 376521 (0.0011) [2023-12-27 21:56:04,813][106225] Updated weights for policy 1, policy_version 377302 (0.0006) [2023-12-27 21:56:04,822][106226] Updated weights for policy 0, policy_version 376531 (0.0011) [2023-12-27 21:56:04,871][106225] Updated weights for policy 1, policy_version 377312 (0.0005) [2023-12-27 21:56:04,886][106226] Updated weights for policy 0, policy_version 376541 (0.0011) [2023-12-27 21:56:04,935][106225] Updated weights for policy 1, policy_version 377322 (0.0006) [2023-12-27 21:56:04,953][106226] Updated weights for policy 0, policy_version 376551 (0.0011) [2023-12-27 21:56:05,600][106225] Updated weights for policy 1, policy_version 377332 (0.0008) [2023-12-27 21:56:05,647][106226] Updated weights for policy 0, policy_version 376561 (0.0010) [2023-12-27 21:56:05,657][106225] Updated weights for policy 1, policy_version 377342 (0.0007) [2023-12-27 21:56:05,690][106226] Updated weights for policy 0, policy_version 376571 (0.0010) [2023-12-27 21:56:05,719][106225] Updated weights for policy 1, policy_version 377352 (0.0005) [2023-12-27 21:56:05,745][106226] Updated weights for policy 0, policy_version 376581 (0.0009) [2023-12-27 21:56:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 193069056. Throughput: 0: 9876.5, 1: 10058.9. Samples: 193077436. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:56:06,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-5.843')] [2023-12-27 21:56:06,469][106225] Updated weights for policy 1, policy_version 377362 (0.0007) [2023-12-27 21:56:06,510][106226] Updated weights for policy 0, policy_version 376591 (0.0011) [2023-12-27 21:56:06,522][106225] Updated weights for policy 1, policy_version 377372 (0.0009) [2023-12-27 21:56:06,569][106226] Updated weights for policy 0, policy_version 376601 (0.0011) [2023-12-27 21:56:06,576][106225] Updated weights for policy 1, policy_version 377382 (0.0010) [2023-12-27 21:56:06,627][106226] Updated weights for policy 0, policy_version 376611 (0.0011) [2023-12-27 21:56:06,630][106225] Updated weights for policy 1, policy_version 377392 (0.0010) [2023-12-27 21:56:07,345][106226] Updated weights for policy 0, policy_version 376621 (0.0011) [2023-12-27 21:56:07,393][106225] Updated weights for policy 1, policy_version 377402 (0.0006) [2023-12-27 21:56:07,399][106226] Updated weights for policy 0, policy_version 376631 (0.0011) [2023-12-27 21:56:07,450][106226] Updated weights for policy 0, policy_version 376641 (0.0011) [2023-12-27 21:56:07,452][106225] Updated weights for policy 1, policy_version 377412 (0.0006) [2023-12-27 21:56:07,514][106225] Updated weights for policy 1, policy_version 377422 (0.0006) [2023-12-27 21:56:08,173][106226] Updated weights for policy 0, policy_version 376651 (0.0011) [2023-12-27 21:56:08,229][106226] Updated weights for policy 0, policy_version 376661 (0.0011) [2023-12-27 21:56:08,238][106225] Updated weights for policy 1, policy_version 377432 (0.0006) [2023-12-27 21:56:08,282][106226] Updated weights for policy 0, policy_version 376671 (0.0011) [2023-12-27 21:56:08,284][106225] Updated weights for policy 1, policy_version 377442 (0.0005) [2023-12-27 21:56:08,346][106225] Updated weights for policy 1, policy_version 377452 (0.0007) [2023-12-27 21:56:09,010][106226] Updated weights for policy 0, policy_version 376681 (0.0011) [2023-12-27 21:56:09,046][106225] Updated weights for policy 1, policy_version 377462 (0.0006) [2023-12-27 21:56:09,069][106226] Updated weights for policy 0, policy_version 376691 (0.0011) [2023-12-27 21:56:09,108][106225] Updated weights for policy 1, policy_version 377472 (0.0007) [2023-12-27 21:56:09,124][106226] Updated weights for policy 0, policy_version 376701 (0.0008) [2023-12-27 21:56:09,160][106225] Updated weights for policy 1, policy_version 377482 (0.0007) [2023-12-27 21:56:09,182][106226] Updated weights for policy 0, policy_version 376711 (0.0007) [2023-12-27 21:56:09,886][106225] Updated weights for policy 1, policy_version 377492 (0.0007) [2023-12-27 21:56:09,887][106226] Updated weights for policy 0, policy_version 376721 (0.0011) [2023-12-27 21:56:09,944][106226] Updated weights for policy 0, policy_version 376731 (0.0007) [2023-12-27 21:56:09,953][106225] Updated weights for policy 1, policy_version 377502 (0.0008) [2023-12-27 21:56:10,008][106225] Updated weights for policy 1, policy_version 377512 (0.0008) [2023-12-27 21:56:10,010][106226] Updated weights for policy 0, policy_version 376741 (0.0010) [2023-12-27 21:56:10,743][106226] Updated weights for policy 0, policy_version 376751 (0.0011) [2023-12-27 21:56:10,788][106225] Updated weights for policy 1, policy_version 377522 (0.0006) [2023-12-27 21:56:10,794][106226] Updated weights for policy 0, policy_version 376761 (0.0010) [2023-12-27 21:56:10,842][106225] Updated weights for policy 1, policy_version 377532 (0.0006) [2023-12-27 21:56:10,848][106226] Updated weights for policy 0, policy_version 376771 (0.0011) [2023-12-27 21:56:10,891][106225] Updated weights for policy 1, policy_version 377542 (0.0006) [2023-12-27 21:56:10,956][106225] Updated weights for policy 1, policy_version 377552 (0.0009) [2023-12-27 21:56:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 193167360. Throughput: 0: 9906.8, 1: 10071.8. Samples: 193135240. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-27 21:56:11,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-5.742')] [2023-12-27 21:56:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000377552_96681984.pth... [2023-12-27 21:56:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000376776_96485376.pth... [2023-12-27 21:56:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000375624_96190464.pth [2023-12-27 21:56:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000376368_96378880.pth [2023-12-27 21:56:11,585][106226] Updated weights for policy 0, policy_version 376781 (0.0009) [2023-12-27 21:56:11,654][106226] Updated weights for policy 0, policy_version 376791 (0.0008) [2023-12-27 21:56:11,723][106226] Updated weights for policy 0, policy_version 376801 (0.0008) [2023-12-27 21:56:11,783][106225] Updated weights for policy 1, policy_version 377562 (0.0009) [2023-12-27 21:56:11,838][106225] Updated weights for policy 1, policy_version 377572 (0.0005) [2023-12-27 21:56:11,898][106225] Updated weights for policy 1, policy_version 377582 (0.0005) [2023-12-27 21:56:12,367][106226] Updated weights for policy 0, policy_version 376811 (0.0009) [2023-12-27 21:56:12,426][106226] Updated weights for policy 0, policy_version 376821 (0.0009) [2023-12-27 21:56:12,482][106226] Updated weights for policy 0, policy_version 376831 (0.0007) [2023-12-27 21:56:12,506][106225] Updated weights for policy 1, policy_version 377592 (0.0008) [2023-12-27 21:56:12,565][106225] Updated weights for policy 1, policy_version 377602 (0.0007) [2023-12-27 21:56:12,625][106225] Updated weights for policy 1, policy_version 377612 (0.0009) [2023-12-27 21:56:13,212][106225] Updated weights for policy 1, policy_version 377622 (0.0009) [2023-12-27 21:56:13,250][106226] Updated weights for policy 0, policy_version 376841 (0.0007) [2023-12-27 21:56:13,271][106225] Updated weights for policy 1, policy_version 377632 (0.0010) [2023-12-27 21:56:13,304][106226] Updated weights for policy 0, policy_version 376851 (0.0006) [2023-12-27 21:56:13,322][106225] Updated weights for policy 1, policy_version 377642 (0.0010) [2023-12-27 21:56:13,363][106226] Updated weights for policy 0, policy_version 376861 (0.0006) [2023-12-27 21:56:13,420][106226] Updated weights for policy 0, policy_version 376871 (0.0008) [2023-12-27 21:56:13,965][106225] Updated weights for policy 1, policy_version 377652 (0.0008) [2023-12-27 21:56:14,015][106225] Updated weights for policy 1, policy_version 377662 (0.0005) [2023-12-27 21:56:14,061][106226] Updated weights for policy 0, policy_version 376881 (0.0006) [2023-12-27 21:56:14,082][106225] Updated weights for policy 1, policy_version 377672 (0.0005) [2023-12-27 21:56:14,116][106226] Updated weights for policy 0, policy_version 376891 (0.0007) [2023-12-27 21:56:14,179][106226] Updated weights for policy 0, policy_version 376901 (0.0009) [2023-12-27 21:56:14,590][106225] Updated weights for policy 1, policy_version 377682 (0.0007) [2023-12-27 21:56:14,646][106225] Updated weights for policy 1, policy_version 377692 (0.0010) [2023-12-27 21:56:14,702][106225] Updated weights for policy 1, policy_version 377702 (0.0010) [2023-12-27 21:56:14,761][106225] Updated weights for policy 1, policy_version 377712 (0.0010) [2023-12-27 21:56:14,890][106226] Updated weights for policy 0, policy_version 376911 (0.0011) [2023-12-27 21:56:14,959][106226] Updated weights for policy 0, policy_version 376921 (0.0011) [2023-12-27 21:56:15,025][106226] Updated weights for policy 0, policy_version 376931 (0.0011) [2023-12-27 21:56:15,475][106225] Updated weights for policy 1, policy_version 377722 (0.0011) [2023-12-27 21:56:15,529][106225] Updated weights for policy 1, policy_version 377732 (0.0011) [2023-12-27 21:56:15,594][106225] Updated weights for policy 1, policy_version 377742 (0.0008) [2023-12-27 21:56:15,748][106226] Updated weights for policy 0, policy_version 376941 (0.0010) [2023-12-27 21:56:15,815][106226] Updated weights for policy 0, policy_version 376951 (0.0011) [2023-12-27 21:56:15,869][106226] Updated weights for policy 0, policy_version 376961 (0.0010) [2023-12-27 21:56:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 193265664. Throughput: 0: 9838.3, 1: 10079.1. Samples: 193254984. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:16,176][105115] Avg episode reward: [(0, '-4.920'), (1, '-5.813')] [2023-12-27 21:56:16,248][106225] Updated weights for policy 1, policy_version 377752 (0.0010) [2023-12-27 21:56:16,304][106225] Updated weights for policy 1, policy_version 377762 (0.0010) [2023-12-27 21:56:16,371][106225] Updated weights for policy 1, policy_version 377772 (0.0009) [2023-12-27 21:56:16,524][106226] Updated weights for policy 0, policy_version 376971 (0.0010) [2023-12-27 21:56:16,588][106226] Updated weights for policy 0, policy_version 376981 (0.0009) [2023-12-27 21:56:16,653][106226] Updated weights for policy 0, policy_version 376991 (0.0008) [2023-12-27 21:56:17,019][106225] Updated weights for policy 1, policy_version 377782 (0.0008) [2023-12-27 21:56:17,077][106225] Updated weights for policy 1, policy_version 377792 (0.0010) [2023-12-27 21:56:17,132][106225] Updated weights for policy 1, policy_version 377802 (0.0009) [2023-12-27 21:56:17,329][106226] Updated weights for policy 0, policy_version 377001 (0.0010) [2023-12-27 21:56:17,390][106226] Updated weights for policy 0, policy_version 377011 (0.0009) [2023-12-27 21:56:17,449][106226] Updated weights for policy 0, policy_version 377021 (0.0009) [2023-12-27 21:56:17,513][106226] Updated weights for policy 0, policy_version 377031 (0.0010) [2023-12-27 21:56:17,896][106225] Updated weights for policy 1, policy_version 377812 (0.0009) [2023-12-27 21:56:17,945][106225] Updated weights for policy 1, policy_version 377822 (0.0008) [2023-12-27 21:56:17,995][106225] Updated weights for policy 1, policy_version 377832 (0.0008) [2023-12-27 21:56:18,200][106226] Updated weights for policy 0, policy_version 377041 (0.0007) [2023-12-27 21:56:18,256][106226] Updated weights for policy 0, policy_version 377051 (0.0009) [2023-12-27 21:56:18,315][106226] Updated weights for policy 0, policy_version 377061 (0.0008) [2023-12-27 21:56:18,800][106225] Updated weights for policy 1, policy_version 377842 (0.0006) [2023-12-27 21:56:18,861][106225] Updated weights for policy 1, policy_version 377852 (0.0009) [2023-12-27 21:56:18,885][106226] Updated weights for policy 0, policy_version 377071 (0.0007) [2023-12-27 21:56:18,924][106225] Updated weights for policy 1, policy_version 377862 (0.0007) [2023-12-27 21:56:18,949][106226] Updated weights for policy 0, policy_version 377081 (0.0007) [2023-12-27 21:56:18,984][106225] Updated weights for policy 1, policy_version 377872 (0.0006) [2023-12-27 21:56:18,998][106226] Updated weights for policy 0, policy_version 377091 (0.0008) [2023-12-27 21:56:19,722][106225] Updated weights for policy 1, policy_version 377882 (0.0008) [2023-12-27 21:56:19,741][106226] Updated weights for policy 0, policy_version 377101 (0.0009) [2023-12-27 21:56:19,784][106225] Updated weights for policy 1, policy_version 377892 (0.0010) [2023-12-27 21:56:19,802][106226] Updated weights for policy 0, policy_version 377111 (0.0007) [2023-12-27 21:56:19,853][106225] Updated weights for policy 1, policy_version 377902 (0.0007) [2023-12-27 21:56:19,875][106226] Updated weights for policy 0, policy_version 377121 (0.0008) [2023-12-27 21:56:20,593][106225] Updated weights for policy 1, policy_version 377912 (0.0008) [2023-12-27 21:56:20,635][106226] Updated weights for policy 0, policy_version 377131 (0.0009) [2023-12-27 21:56:20,654][106225] Updated weights for policy 1, policy_version 377922 (0.0007) [2023-12-27 21:56:20,700][106226] Updated weights for policy 0, policy_version 377141 (0.0011) [2023-12-27 21:56:20,715][106225] Updated weights for policy 1, policy_version 377932 (0.0007) [2023-12-27 21:56:20,766][106226] Updated weights for policy 0, policy_version 377151 (0.0011) [2023-12-27 21:56:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 193363968. Throughput: 0: 9802.5, 1: 10007.7. Samples: 193372148. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:21,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.773')] [2023-12-27 21:56:21,472][106225] Updated weights for policy 1, policy_version 377942 (0.0007) [2023-12-27 21:56:21,525][106226] Updated weights for policy 0, policy_version 377161 (0.0011) [2023-12-27 21:56:21,536][106225] Updated weights for policy 1, policy_version 377952 (0.0007) [2023-12-27 21:56:21,585][106226] Updated weights for policy 0, policy_version 377171 (0.0010) [2023-12-27 21:56:21,602][106225] Updated weights for policy 1, policy_version 377962 (0.0008) [2023-12-27 21:56:21,655][106226] Updated weights for policy 0, policy_version 377181 (0.0008) [2023-12-27 21:56:21,729][106226] Updated weights for policy 0, policy_version 377191 (0.0008) [2023-12-27 21:56:22,359][106225] Updated weights for policy 1, policy_version 377972 (0.0009) [2023-12-27 21:56:22,427][106225] Updated weights for policy 1, policy_version 377982 (0.0008) [2023-12-27 21:56:22,491][106225] Updated weights for policy 1, policy_version 377992 (0.0007) [2023-12-27 21:56:22,501][106226] Updated weights for policy 0, policy_version 377201 (0.0008) [2023-12-27 21:56:22,560][106226] Updated weights for policy 0, policy_version 377211 (0.0007) [2023-12-27 21:56:22,621][106226] Updated weights for policy 0, policy_version 377221 (0.0008) [2023-12-27 21:56:23,242][106225] Updated weights for policy 1, policy_version 378002 (0.0006) [2023-12-27 21:56:23,290][106225] Updated weights for policy 1, policy_version 378012 (0.0008) [2023-12-27 21:56:23,303][106226] Updated weights for policy 0, policy_version 377231 (0.0008) [2023-12-27 21:56:23,348][106225] Updated weights for policy 1, policy_version 378022 (0.0005) [2023-12-27 21:56:23,366][106226] Updated weights for policy 0, policy_version 377241 (0.0010) [2023-12-27 21:56:23,405][106225] Updated weights for policy 1, policy_version 378032 (0.0006) [2023-12-27 21:56:23,427][106226] Updated weights for policy 0, policy_version 377251 (0.0008) [2023-12-27 21:56:24,083][106226] Updated weights for policy 0, policy_version 377261 (0.0005) [2023-12-27 21:56:24,131][106225] Updated weights for policy 1, policy_version 378042 (0.0006) [2023-12-27 21:56:24,141][106226] Updated weights for policy 0, policy_version 377271 (0.0010) [2023-12-27 21:56:24,189][106225] Updated weights for policy 1, policy_version 378052 (0.0006) [2023-12-27 21:56:24,198][106226] Updated weights for policy 0, policy_version 377281 (0.0011) [2023-12-27 21:56:24,239][106225] Updated weights for policy 1, policy_version 378062 (0.0006) [2023-12-27 21:56:24,839][106226] Updated weights for policy 0, policy_version 377291 (0.0010) [2023-12-27 21:56:24,916][106226] Updated weights for policy 0, policy_version 377301 (0.0010) [2023-12-27 21:56:24,970][106225] Updated weights for policy 1, policy_version 378072 (0.0007) [2023-12-27 21:56:24,973][106226] Updated weights for policy 0, policy_version 377311 (0.0009) [2023-12-27 21:56:25,026][106225] Updated weights for policy 1, policy_version 378082 (0.0007) [2023-12-27 21:56:25,078][106225] Updated weights for policy 1, policy_version 378092 (0.0008) [2023-12-27 21:56:25,562][106226] Updated weights for policy 0, policy_version 377321 (0.0006) [2023-12-27 21:56:25,624][106226] Updated weights for policy 0, policy_version 377331 (0.0005) [2023-12-27 21:56:25,677][106226] Updated weights for policy 0, policy_version 377341 (0.0005) [2023-12-27 21:56:25,728][106226] Updated weights for policy 0, policy_version 377351 (0.0005) [2023-12-27 21:56:25,877][106225] Updated weights for policy 1, policy_version 378102 (0.0009) [2023-12-27 21:56:25,929][106225] Updated weights for policy 1, policy_version 378112 (0.0008) [2023-12-27 21:56:25,998][106225] Updated weights for policy 1, policy_version 378122 (0.0005) [2023-12-27 21:56:26,174][105115] Fps is (10 sec: 19661.4, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 193462272. Throughput: 0: 9779.9, 1: 9970.7. Samples: 193429220. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:26,175][105115] Avg episode reward: [(0, '-5.055'), (1, '-5.637')] [2023-12-27 21:56:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000378128_96829440.pth... [2023-12-27 21:56:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000377352_96632832.pth... [2023-12-27 21:56:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000376976_96534528.pth [2023-12-27 21:56:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000376232_96346112.pth [2023-12-27 21:56:26,300][106226] Updated weights for policy 0, policy_version 377361 (0.0007) [2023-12-27 21:56:26,348][106226] Updated weights for policy 0, policy_version 377371 (0.0008) [2023-12-27 21:56:26,397][106226] Updated weights for policy 0, policy_version 377381 (0.0009) [2023-12-27 21:56:26,601][106225] Updated weights for policy 1, policy_version 378132 (0.0005) [2023-12-27 21:56:26,651][106225] Updated weights for policy 1, policy_version 378142 (0.0005) [2023-12-27 21:56:26,709][106225] Updated weights for policy 1, policy_version 378152 (0.0010) [2023-12-27 21:56:27,132][106226] Updated weights for policy 0, policy_version 377391 (0.0008) [2023-12-27 21:56:27,192][106226] Updated weights for policy 0, policy_version 377401 (0.0008) [2023-12-27 21:56:27,253][106226] Updated weights for policy 0, policy_version 377411 (0.0009) [2023-12-27 21:56:27,328][106225] Updated weights for policy 1, policy_version 378162 (0.0006) [2023-12-27 21:56:27,386][106225] Updated weights for policy 1, policy_version 378172 (0.0009) [2023-12-27 21:56:27,439][106225] Updated weights for policy 1, policy_version 378182 (0.0008) [2023-12-27 21:56:27,500][106225] Updated weights for policy 1, policy_version 378192 (0.0008) [2023-12-27 21:56:27,930][106226] Updated weights for policy 0, policy_version 377422 (0.0007) [2023-12-27 21:56:27,977][106226] Updated weights for policy 0, policy_version 377432 (0.0006) [2023-12-27 21:56:28,044][106226] Updated weights for policy 0, policy_version 377442 (0.0005) [2023-12-27 21:56:28,200][106225] Updated weights for policy 1, policy_version 378202 (0.0005) [2023-12-27 21:56:28,251][106225] Updated weights for policy 1, policy_version 378212 (0.0005) [2023-12-27 21:56:28,295][106225] Updated weights for policy 1, policy_version 378222 (0.0005) [2023-12-27 21:56:28,594][106226] Updated weights for policy 0, policy_version 377452 (0.0005) [2023-12-27 21:56:28,650][106226] Updated weights for policy 0, policy_version 377462 (0.0007) [2023-12-27 21:56:28,702][106226] Updated weights for policy 0, policy_version 377472 (0.0008) [2023-12-27 21:56:29,032][106225] Updated weights for policy 1, policy_version 378232 (0.0008) [2023-12-27 21:56:29,082][106225] Updated weights for policy 1, policy_version 378242 (0.0006) [2023-12-27 21:56:29,137][106225] Updated weights for policy 1, policy_version 378252 (0.0005) [2023-12-27 21:56:29,311][106226] Updated weights for policy 0, policy_version 377482 (0.0008) [2023-12-27 21:56:29,380][106226] Updated weights for policy 0, policy_version 377492 (0.0007) [2023-12-27 21:56:29,426][106226] Updated weights for policy 0, policy_version 377502 (0.0007) [2023-12-27 21:56:29,477][106226] Updated weights for policy 0, policy_version 377512 (0.0006) [2023-12-27 21:56:29,883][106225] Updated weights for policy 1, policy_version 378262 (0.0006) [2023-12-27 21:56:29,948][106225] Updated weights for policy 1, policy_version 378272 (0.0007) [2023-12-27 21:56:30,004][106225] Updated weights for policy 1, policy_version 378282 (0.0006) [2023-12-27 21:56:30,229][106226] Updated weights for policy 0, policy_version 377522 (0.0008) [2023-12-27 21:56:30,278][106226] Updated weights for policy 0, policy_version 377532 (0.0009) [2023-12-27 21:56:30,335][106226] Updated weights for policy 0, policy_version 377542 (0.0008) [2023-12-27 21:56:30,597][106225] Updated weights for policy 1, policy_version 378292 (0.0007) [2023-12-27 21:56:30,646][106225] Updated weights for policy 1, policy_version 378302 (0.0009) [2023-12-27 21:56:30,692][106225] Updated weights for policy 1, policy_version 378312 (0.0008) [2023-12-27 21:56:31,094][106226] Updated weights for policy 0, policy_version 377552 (0.0008) [2023-12-27 21:56:31,157][106226] Updated weights for policy 0, policy_version 377562 (0.0008) [2023-12-27 21:56:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 193560576. Throughput: 0: 9921.6, 1: 9963.0. Samples: 193553804. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:31,175][105115] Avg episode reward: [(0, '-4.872'), (1, '-5.759')] [2023-12-27 21:56:31,212][106226] Updated weights for policy 0, policy_version 377572 (0.0005) [2023-12-27 21:56:31,489][106225] Updated weights for policy 1, policy_version 378322 (0.0008) [2023-12-27 21:56:31,542][106225] Updated weights for policy 1, policy_version 378332 (0.0009) [2023-12-27 21:56:31,611][106225] Updated weights for policy 1, policy_version 378342 (0.0008) [2023-12-27 21:56:31,675][106225] Updated weights for policy 1, policy_version 378352 (0.0008) [2023-12-27 21:56:31,832][106226] Updated weights for policy 0, policy_version 377582 (0.0007) [2023-12-27 21:56:31,889][106226] Updated weights for policy 0, policy_version 377592 (0.0007) [2023-12-27 21:56:31,956][106226] Updated weights for policy 0, policy_version 377602 (0.0010) [2023-12-27 21:56:32,407][106225] Updated weights for policy 1, policy_version 378362 (0.0010) [2023-12-27 21:56:32,471][106225] Updated weights for policy 1, policy_version 378372 (0.0009) [2023-12-27 21:56:32,525][106225] Updated weights for policy 1, policy_version 378382 (0.0009) [2023-12-27 21:56:32,694][106226] Updated weights for policy 0, policy_version 377612 (0.0009) [2023-12-27 21:56:32,754][106226] Updated weights for policy 0, policy_version 377622 (0.0008) [2023-12-27 21:56:32,809][106226] Updated weights for policy 0, policy_version 377632 (0.0008) [2023-12-27 21:56:33,252][106225] Updated weights for policy 1, policy_version 378392 (0.0008) [2023-12-27 21:56:33,303][106225] Updated weights for policy 1, policy_version 378402 (0.0008) [2023-12-27 21:56:33,356][106225] Updated weights for policy 1, policy_version 378412 (0.0009) [2023-12-27 21:56:33,475][106226] Updated weights for policy 0, policy_version 377642 (0.0008) [2023-12-27 21:56:33,533][106226] Updated weights for policy 0, policy_version 377652 (0.0005) [2023-12-27 21:56:33,594][106226] Updated weights for policy 0, policy_version 377662 (0.0005) [2023-12-27 21:56:33,657][106226] Updated weights for policy 0, policy_version 377672 (0.0007) [2023-12-27 21:56:34,040][106225] Updated weights for policy 1, policy_version 378422 (0.0008) [2023-12-27 21:56:34,102][106225] Updated weights for policy 1, policy_version 378432 (0.0008) [2023-12-27 21:56:34,161][106225] Updated weights for policy 1, policy_version 378442 (0.0008) [2023-12-27 21:56:34,212][106226] Updated weights for policy 0, policy_version 377682 (0.0009) [2023-12-27 21:56:34,280][106226] Updated weights for policy 0, policy_version 377692 (0.0011) [2023-12-27 21:56:34,331][106226] Updated weights for policy 0, policy_version 377702 (0.0011) [2023-12-27 21:56:34,869][106225] Updated weights for policy 1, policy_version 378452 (0.0007) [2023-12-27 21:56:34,922][106225] Updated weights for policy 1, policy_version 378462 (0.0009) [2023-12-27 21:56:34,971][106225] Updated weights for policy 1, policy_version 378472 (0.0008) [2023-12-27 21:56:35,035][106226] Updated weights for policy 0, policy_version 377712 (0.0006) [2023-12-27 21:56:35,097][106226] Updated weights for policy 0, policy_version 377722 (0.0005) [2023-12-27 21:56:35,159][106226] Updated weights for policy 0, policy_version 377732 (0.0010) [2023-12-27 21:56:35,755][106225] Updated weights for policy 1, policy_version 378482 (0.0008) [2023-12-27 21:56:35,811][106226] Updated weights for policy 0, policy_version 377742 (0.0011) [2023-12-27 21:56:35,813][106225] Updated weights for policy 1, policy_version 378492 (0.0010) [2023-12-27 21:56:35,873][106226] Updated weights for policy 0, policy_version 377752 (0.0011) [2023-12-27 21:56:35,875][106225] Updated weights for policy 1, policy_version 378502 (0.0010) [2023-12-27 21:56:35,935][106226] Updated weights for policy 0, policy_version 377762 (0.0009) [2023-12-27 21:56:35,936][106225] Updated weights for policy 1, policy_version 378512 (0.0010) [2023-12-27 21:56:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 193667072. Throughput: 0: 9967.6, 1: 9887.5. Samples: 193673324. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:36,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-5.769')] [2023-12-27 21:56:36,626][106226] Updated weights for policy 0, policy_version 377772 (0.0008) [2023-12-27 21:56:36,639][106225] Updated weights for policy 1, policy_version 378522 (0.0010) [2023-12-27 21:56:36,690][106226] Updated weights for policy 0, policy_version 377782 (0.0011) [2023-12-27 21:56:36,697][106225] Updated weights for policy 1, policy_version 378532 (0.0010) [2023-12-27 21:56:36,751][106226] Updated weights for policy 0, policy_version 377792 (0.0011) [2023-12-27 21:56:36,754][106225] Updated weights for policy 1, policy_version 378542 (0.0010) [2023-12-27 21:56:37,367][106226] Updated weights for policy 0, policy_version 377802 (0.0010) [2023-12-27 21:56:37,413][106225] Updated weights for policy 1, policy_version 378552 (0.0006) [2023-12-27 21:56:37,418][106226] Updated weights for policy 0, policy_version 377812 (0.0008) [2023-12-27 21:56:37,470][106226] Updated weights for policy 0, policy_version 377822 (0.0008) [2023-12-27 21:56:37,481][106225] Updated weights for policy 1, policy_version 378562 (0.0005) [2023-12-27 21:56:37,515][106226] Updated weights for policy 0, policy_version 377832 (0.0007) [2023-12-27 21:56:37,547][106225] Updated weights for policy 1, policy_version 378572 (0.0005) [2023-12-27 21:56:38,053][106225] Updated weights for policy 1, policy_version 378582 (0.0008) [2023-12-27 21:56:38,116][106225] Updated weights for policy 1, policy_version 378592 (0.0010) [2023-12-27 21:56:38,183][106225] Updated weights for policy 1, policy_version 378602 (0.0010) [2023-12-27 21:56:38,266][106226] Updated weights for policy 0, policy_version 377842 (0.0009) [2023-12-27 21:56:38,312][106226] Updated weights for policy 0, policy_version 377852 (0.0010) [2023-12-27 21:56:38,374][106226] Updated weights for policy 0, policy_version 377862 (0.0011) [2023-12-27 21:56:38,910][106225] Updated weights for policy 1, policy_version 378612 (0.0010) [2023-12-27 21:56:38,969][106225] Updated weights for policy 1, policy_version 378622 (0.0010) [2023-12-27 21:56:39,019][106225] Updated weights for policy 1, policy_version 378632 (0.0010) [2023-12-27 21:56:39,130][106226] Updated weights for policy 0, policy_version 377872 (0.0008) [2023-12-27 21:56:39,177][106226] Updated weights for policy 0, policy_version 377882 (0.0008) [2023-12-27 21:56:39,233][106226] Updated weights for policy 0, policy_version 377892 (0.0008) [2023-12-27 21:56:39,770][106225] Updated weights for policy 1, policy_version 378642 (0.0010) [2023-12-27 21:56:39,829][106225] Updated weights for policy 1, policy_version 378652 (0.0010) [2023-12-27 21:56:39,894][106225] Updated weights for policy 1, policy_version 378662 (0.0010) [2023-12-27 21:56:39,957][106225] Updated weights for policy 1, policy_version 378672 (0.0009) [2023-12-27 21:56:40,025][106226] Updated weights for policy 0, policy_version 377902 (0.0008) [2023-12-27 21:56:40,086][106226] Updated weights for policy 0, policy_version 377912 (0.0008) [2023-12-27 21:56:40,148][106226] Updated weights for policy 0, policy_version 377922 (0.0008) [2023-12-27 21:56:40,655][106225] Updated weights for policy 1, policy_version 378682 (0.0006) [2023-12-27 21:56:40,714][106225] Updated weights for policy 1, policy_version 378692 (0.0008) [2023-12-27 21:56:40,769][106225] Updated weights for policy 1, policy_version 378702 (0.0006) [2023-12-27 21:56:40,937][106226] Updated weights for policy 0, policy_version 377932 (0.0008) [2023-12-27 21:56:40,985][106226] Updated weights for policy 0, policy_version 377942 (0.0008) [2023-12-27 21:56:41,039][106226] Updated weights for policy 0, policy_version 377952 (0.0008) [2023-12-27 21:56:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 193765376. Throughput: 0: 9959.9, 1: 9926.7. Samples: 193734320. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:41,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-5.463')] [2023-12-27 21:56:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000378704_96976896.pth... [2023-12-27 21:56:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000377960_96788480.pth... [2023-12-27 21:56:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000376776_96485376.pth [2023-12-27 21:56:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000377552_96681984.pth [2023-12-27 21:56:41,442][106225] Updated weights for policy 1, policy_version 378712 (0.0008) [2023-12-27 21:56:41,491][106225] Updated weights for policy 1, policy_version 378722 (0.0009) [2023-12-27 21:56:41,548][106225] Updated weights for policy 1, policy_version 378732 (0.0009) [2023-12-27 21:56:41,931][106226] Updated weights for policy 0, policy_version 377962 (0.0009) [2023-12-27 21:56:41,999][106226] Updated weights for policy 0, policy_version 377972 (0.0010) [2023-12-27 21:56:42,068][106226] Updated weights for policy 0, policy_version 377982 (0.0011) [2023-12-27 21:56:42,136][106226] Updated weights for policy 0, policy_version 377992 (0.0011) [2023-12-27 21:56:42,327][106225] Updated weights for policy 1, policy_version 378742 (0.0008) [2023-12-27 21:56:42,397][106225] Updated weights for policy 1, policy_version 378752 (0.0008) [2023-12-27 21:56:42,464][106225] Updated weights for policy 1, policy_version 378762 (0.0008) [2023-12-27 21:56:42,769][106226] Updated weights for policy 0, policy_version 378002 (0.0006) [2023-12-27 21:56:42,837][106226] Updated weights for policy 0, policy_version 378012 (0.0007) [2023-12-27 21:56:42,909][106226] Updated weights for policy 0, policy_version 378022 (0.0008) [2023-12-27 21:56:43,078][106225] Updated weights for policy 1, policy_version 378772 (0.0008) [2023-12-27 21:56:43,129][106225] Updated weights for policy 1, policy_version 378782 (0.0008) [2023-12-27 21:56:43,177][106225] Updated weights for policy 1, policy_version 378792 (0.0008) [2023-12-27 21:56:43,552][106226] Updated weights for policy 0, policy_version 378032 (0.0006) [2023-12-27 21:56:43,615][106226] Updated weights for policy 0, policy_version 378042 (0.0005) [2023-12-27 21:56:43,679][106226] Updated weights for policy 0, policy_version 378052 (0.0005) [2023-12-27 21:56:43,863][106225] Updated weights for policy 1, policy_version 378802 (0.0007) [2023-12-27 21:56:43,911][106225] Updated weights for policy 1, policy_version 378812 (0.0009) [2023-12-27 21:56:43,976][106225] Updated weights for policy 1, policy_version 378822 (0.0009) [2023-12-27 21:56:44,035][106225] Updated weights for policy 1, policy_version 378832 (0.0008) [2023-12-27 21:56:44,277][106226] Updated weights for policy 0, policy_version 378062 (0.0007) [2023-12-27 21:56:44,330][106226] Updated weights for policy 0, policy_version 378072 (0.0007) [2023-12-27 21:56:44,391][106226] Updated weights for policy 0, policy_version 378082 (0.0008) [2023-12-27 21:56:44,666][106225] Updated weights for policy 1, policy_version 378842 (0.0005) [2023-12-27 21:56:44,721][106225] Updated weights for policy 1, policy_version 378852 (0.0005) [2023-12-27 21:56:44,777][106225] Updated weights for policy 1, policy_version 378862 (0.0009) [2023-12-27 21:56:45,077][106226] Updated weights for policy 0, policy_version 378092 (0.0008) [2023-12-27 21:56:45,137][106226] Updated weights for policy 0, policy_version 378102 (0.0009) [2023-12-27 21:56:45,206][106226] Updated weights for policy 0, policy_version 378112 (0.0007) [2023-12-27 21:56:45,423][106225] Updated weights for policy 1, policy_version 378872 (0.0006) [2023-12-27 21:56:45,479][106225] Updated weights for policy 1, policy_version 378883 (0.0010) [2023-12-27 21:56:45,539][106225] Updated weights for policy 1, policy_version 378893 (0.0009) [2023-12-27 21:56:45,845][106226] Updated weights for policy 0, policy_version 378122 (0.0007) [2023-12-27 21:56:45,908][106226] Updated weights for policy 0, policy_version 378132 (0.0009) [2023-12-27 21:56:45,966][106226] Updated weights for policy 0, policy_version 378142 (0.0008) [2023-12-27 21:56:46,025][106226] Updated weights for policy 0, policy_version 378152 (0.0008) [2023-12-27 21:56:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 193863680. Throughput: 0: 9927.7, 1: 9888.8. Samples: 193852352. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:46,176][105115] Avg episode reward: [(0, '-4.995'), (1, '-5.604')] [2023-12-27 21:56:46,252][106225] Updated weights for policy 1, policy_version 378903 (0.0009) [2023-12-27 21:56:46,306][106225] Updated weights for policy 1, policy_version 378913 (0.0009) [2023-12-27 21:56:46,358][106225] Updated weights for policy 1, policy_version 378923 (0.0008) [2023-12-27 21:56:46,691][106226] Updated weights for policy 0, policy_version 378162 (0.0008) [2023-12-27 21:56:46,737][106226] Updated weights for policy 0, policy_version 378172 (0.0006) [2023-12-27 21:56:46,802][106226] Updated weights for policy 0, policy_version 378182 (0.0005) [2023-12-27 21:56:47,122][106225] Updated weights for policy 1, policy_version 378933 (0.0009) [2023-12-27 21:56:47,166][106225] Updated weights for policy 1, policy_version 378943 (0.0008) [2023-12-27 21:56:47,247][106225] Updated weights for policy 1, policy_version 378953 (0.0008) [2023-12-27 21:56:47,361][106226] Updated weights for policy 0, policy_version 378192 (0.0008) [2023-12-27 21:56:47,419][106226] Updated weights for policy 0, policy_version 378202 (0.0007) [2023-12-27 21:56:47,487][106226] Updated weights for policy 0, policy_version 378212 (0.0008) [2023-12-27 21:56:47,958][106225] Updated weights for policy 1, policy_version 378963 (0.0008) [2023-12-27 21:56:48,022][106225] Updated weights for policy 1, policy_version 378973 (0.0009) [2023-12-27 21:56:48,078][106225] Updated weights for policy 1, policy_version 378983 (0.0009) [2023-12-27 21:56:48,231][106226] Updated weights for policy 0, policy_version 378222 (0.0010) [2023-12-27 21:56:48,295][106226] Updated weights for policy 0, policy_version 378232 (0.0010) [2023-12-27 21:56:48,366][106226] Updated weights for policy 0, policy_version 378242 (0.0009) [2023-12-27 21:56:48,824][106225] Updated weights for policy 1, policy_version 378993 (0.0008) [2023-12-27 21:56:48,883][106225] Updated weights for policy 1, policy_version 379003 (0.0008) [2023-12-27 21:56:48,934][106225] Updated weights for policy 1, policy_version 379013 (0.0008) [2023-12-27 21:56:48,986][106225] Updated weights for policy 1, policy_version 379023 (0.0008) [2023-12-27 21:56:49,048][106226] Updated weights for policy 0, policy_version 378252 (0.0007) [2023-12-27 21:56:49,102][106226] Updated weights for policy 0, policy_version 378262 (0.0005) [2023-12-27 21:56:49,158][106226] Updated weights for policy 0, policy_version 378272 (0.0005) [2023-12-27 21:56:49,678][106225] Updated weights for policy 1, policy_version 379033 (0.0007) [2023-12-27 21:56:49,725][106225] Updated weights for policy 1, policy_version 379043 (0.0008) [2023-12-27 21:56:49,785][106225] Updated weights for policy 1, policy_version 379053 (0.0007) [2023-12-27 21:56:49,851][106226] Updated weights for policy 0, policy_version 378282 (0.0006) [2023-12-27 21:56:49,902][106226] Updated weights for policy 0, policy_version 378292 (0.0011) [2023-12-27 21:56:49,959][106226] Updated weights for policy 0, policy_version 378302 (0.0011) [2023-12-27 21:56:50,007][106226] Updated weights for policy 0, policy_version 378312 (0.0010) [2023-12-27 21:56:50,412][106225] Updated weights for policy 1, policy_version 379063 (0.0008) [2023-12-27 21:56:50,465][106225] Updated weights for policy 1, policy_version 379073 (0.0007) [2023-12-27 21:56:50,516][106225] Updated weights for policy 1, policy_version 379083 (0.0008) [2023-12-27 21:56:50,785][106226] Updated weights for policy 0, policy_version 378322 (0.0008) [2023-12-27 21:56:50,843][106226] Updated weights for policy 0, policy_version 378332 (0.0006) [2023-12-27 21:56:50,904][106226] Updated weights for policy 0, policy_version 378342 (0.0010) [2023-12-27 21:56:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 193961984. Throughput: 0: 9990.1, 1: 9878.7. Samples: 193971536. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:51,175][105115] Avg episode reward: [(0, '-4.865'), (1, '-5.895')] [2023-12-27 21:56:51,328][106225] Updated weights for policy 1, policy_version 379093 (0.0007) [2023-12-27 21:56:51,405][106225] Updated weights for policy 1, policy_version 379103 (0.0008) [2023-12-27 21:56:51,469][106225] Updated weights for policy 1, policy_version 379113 (0.0008) [2023-12-27 21:56:51,640][106226] Updated weights for policy 0, policy_version 378352 (0.0011) [2023-12-27 21:56:51,698][106226] Updated weights for policy 0, policy_version 378362 (0.0009) [2023-12-27 21:56:51,764][106226] Updated weights for policy 0, policy_version 378372 (0.0009) [2023-12-27 21:56:52,313][106225] Updated weights for policy 1, policy_version 379123 (0.0008) [2023-12-27 21:56:52,370][106225] Updated weights for policy 1, policy_version 379133 (0.0008) [2023-12-27 21:56:52,436][106225] Updated weights for policy 1, policy_version 379143 (0.0008) [2023-12-27 21:56:52,569][106226] Updated weights for policy 0, policy_version 378382 (0.0008) [2023-12-27 21:56:52,633][106226] Updated weights for policy 0, policy_version 378392 (0.0006) [2023-12-27 21:56:52,702][106226] Updated weights for policy 0, policy_version 378402 (0.0007) [2023-12-27 21:56:53,145][106225] Updated weights for policy 1, policy_version 379153 (0.0008) [2023-12-27 21:56:53,196][106225] Updated weights for policy 1, policy_version 379163 (0.0005) [2023-12-27 21:56:53,244][106225] Updated weights for policy 1, policy_version 379173 (0.0005) [2023-12-27 21:56:53,311][106225] Updated weights for policy 1, policy_version 379183 (0.0006) [2023-12-27 21:56:53,317][106226] Updated weights for policy 0, policy_version 378412 (0.0011) [2023-12-27 21:56:53,386][106226] Updated weights for policy 0, policy_version 378422 (0.0009) [2023-12-27 21:56:53,452][106226] Updated weights for policy 0, policy_version 378432 (0.0011) [2023-12-27 21:56:53,937][106225] Updated weights for policy 1, policy_version 379193 (0.0009) [2023-12-27 21:56:53,990][106225] Updated weights for policy 1, policy_version 379203 (0.0010) [2023-12-27 21:56:54,033][106225] Updated weights for policy 1, policy_version 379213 (0.0010) [2023-12-27 21:56:54,126][106226] Updated weights for policy 0, policy_version 378442 (0.0011) [2023-12-27 21:56:54,186][106226] Updated weights for policy 0, policy_version 378452 (0.0011) [2023-12-27 21:56:54,246][106226] Updated weights for policy 0, policy_version 378462 (0.0010) [2023-12-27 21:56:54,302][106226] Updated weights for policy 0, policy_version 378472 (0.0010) [2023-12-27 21:56:54,721][106225] Updated weights for policy 1, policy_version 379223 (0.0007) [2023-12-27 21:56:54,780][106225] Updated weights for policy 1, policy_version 379233 (0.0005) [2023-12-27 21:56:54,846][106225] Updated weights for policy 1, policy_version 379243 (0.0007) [2023-12-27 21:56:54,956][106226] Updated weights for policy 0, policy_version 378482 (0.0005) [2023-12-27 21:56:55,019][106226] Updated weights for policy 0, policy_version 378492 (0.0010) [2023-12-27 21:56:55,080][106226] Updated weights for policy 0, policy_version 378502 (0.0011) [2023-12-27 21:56:55,463][106225] Updated weights for policy 1, policy_version 379253 (0.0009) [2023-12-27 21:56:55,514][106225] Updated weights for policy 1, policy_version 379263 (0.0008) [2023-12-27 21:56:55,560][106225] Updated weights for policy 1, policy_version 379273 (0.0008) [2023-12-27 21:56:55,664][106226] Updated weights for policy 0, policy_version 378512 (0.0009) [2023-12-27 21:56:55,723][106226] Updated weights for policy 0, policy_version 378522 (0.0010) [2023-12-27 21:56:55,782][106226] Updated weights for policy 0, policy_version 378532 (0.0011) [2023-12-27 21:56:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 194060288. Throughput: 0: 9987.5, 1: 9858.0. Samples: 194028292. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:56:56,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-5.843')] [2023-12-27 21:56:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000379280_97124352.pth... [2023-12-27 21:56:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000378536_96935936.pth... [2023-12-27 21:56:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000378128_96829440.pth [2023-12-27 21:56:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000377352_96632832.pth [2023-12-27 21:56:56,316][106225] Updated weights for policy 1, policy_version 379283 (0.0008) [2023-12-27 21:56:56,366][106225] Updated weights for policy 1, policy_version 379293 (0.0008) [2023-12-27 21:56:56,421][106225] Updated weights for policy 1, policy_version 379303 (0.0008) [2023-12-27 21:56:56,474][106226] Updated weights for policy 0, policy_version 378542 (0.0009) [2023-12-27 21:56:56,525][106226] Updated weights for policy 0, policy_version 378552 (0.0008) [2023-12-27 21:56:56,584][106226] Updated weights for policy 0, policy_version 378562 (0.0008) [2023-12-27 21:56:57,044][106225] Updated weights for policy 1, policy_version 379313 (0.0008) [2023-12-27 21:56:57,108][106225] Updated weights for policy 1, policy_version 379323 (0.0005) [2023-12-27 21:56:57,172][106225] Updated weights for policy 1, policy_version 379333 (0.0007) [2023-12-27 21:56:57,201][106226] Updated weights for policy 0, policy_version 378572 (0.0006) [2023-12-27 21:56:57,230][106225] Updated weights for policy 1, policy_version 379343 (0.0007) [2023-12-27 21:56:57,261][106226] Updated weights for policy 0, policy_version 378582 (0.0006) [2023-12-27 21:56:57,321][106226] Updated weights for policy 0, policy_version 378592 (0.0007) [2023-12-27 21:56:57,890][106225] Updated weights for policy 1, policy_version 379353 (0.0006) [2023-12-27 21:56:57,907][106226] Updated weights for policy 0, policy_version 378602 (0.0008) [2023-12-27 21:56:57,955][106225] Updated weights for policy 1, policy_version 379363 (0.0005) [2023-12-27 21:56:57,968][106226] Updated weights for policy 0, policy_version 378612 (0.0008) [2023-12-27 21:56:58,012][106225] Updated weights for policy 1, policy_version 379373 (0.0006) [2023-12-27 21:56:58,029][106226] Updated weights for policy 0, policy_version 378622 (0.0007) [2023-12-27 21:56:58,082][106226] Updated weights for policy 0, policy_version 378632 (0.0009) [2023-12-27 21:56:58,611][106225] Updated weights for policy 1, policy_version 379383 (0.0007) [2023-12-27 21:56:58,671][106225] Updated weights for policy 1, policy_version 379393 (0.0008) [2023-12-27 21:56:58,738][106225] Updated weights for policy 1, policy_version 379403 (0.0008) [2023-12-27 21:56:58,975][106226] Updated weights for policy 0, policy_version 378642 (0.0008) [2023-12-27 21:56:59,030][106226] Updated weights for policy 0, policy_version 378652 (0.0008) [2023-12-27 21:56:59,088][106226] Updated weights for policy 0, policy_version 378662 (0.0008) [2023-12-27 21:56:59,537][106225] Updated weights for policy 1, policy_version 379413 (0.0009) [2023-12-27 21:56:59,591][106225] Updated weights for policy 1, policy_version 379423 (0.0010) [2023-12-27 21:56:59,651][106225] Updated weights for policy 1, policy_version 379433 (0.0010) [2023-12-27 21:56:59,818][106226] Updated weights for policy 0, policy_version 378672 (0.0009) [2023-12-27 21:56:59,882][106226] Updated weights for policy 0, policy_version 378682 (0.0009) [2023-12-27 21:56:59,949][106226] Updated weights for policy 0, policy_version 378692 (0.0009) [2023-12-27 21:57:00,359][106225] Updated weights for policy 1, policy_version 379443 (0.0010) [2023-12-27 21:57:00,419][106225] Updated weights for policy 1, policy_version 379453 (0.0009) [2023-12-27 21:57:00,484][106225] Updated weights for policy 1, policy_version 379463 (0.0005) [2023-12-27 21:57:00,682][106226] Updated weights for policy 0, policy_version 378702 (0.0008) [2023-12-27 21:57:00,730][106226] Updated weights for policy 0, policy_version 378712 (0.0008) [2023-12-27 21:57:00,791][106226] Updated weights for policy 0, policy_version 378722 (0.0009) [2023-12-27 21:57:01,059][106225] Updated weights for policy 1, policy_version 379473 (0.0009) [2023-12-27 21:57:01,128][106225] Updated weights for policy 1, policy_version 379483 (0.0006) [2023-12-27 21:57:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 194158592. Throughput: 0: 10023.4, 1: 9847.0. Samples: 194149148. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:01,175][105115] Avg episode reward: [(0, '-5.008'), (1, '-5.324')] [2023-12-27 21:57:01,186][106225] Updated weights for policy 1, policy_version 379493 (0.0007) [2023-12-27 21:57:01,248][106225] Updated weights for policy 1, policy_version 379503 (0.0009) [2023-12-27 21:57:01,528][106226] Updated weights for policy 0, policy_version 378732 (0.0007) [2023-12-27 21:57:01,593][106226] Updated weights for policy 0, policy_version 378742 (0.0008) [2023-12-27 21:57:01,668][106226] Updated weights for policy 0, policy_version 378752 (0.0008) [2023-12-27 21:57:01,929][106225] Updated weights for policy 1, policy_version 379513 (0.0009) [2023-12-27 21:57:01,984][106225] Updated weights for policy 1, policy_version 379523 (0.0008) [2023-12-27 21:57:02,036][106225] Updated weights for policy 1, policy_version 379533 (0.0009) [2023-12-27 21:57:02,355][106226] Updated weights for policy 0, policy_version 378762 (0.0008) [2023-12-27 21:57:02,413][106226] Updated weights for policy 0, policy_version 378772 (0.0009) [2023-12-27 21:57:02,475][106226] Updated weights for policy 0, policy_version 378782 (0.0008) [2023-12-27 21:57:02,537][106226] Updated weights for policy 0, policy_version 378792 (0.0008) [2023-12-27 21:57:02,793][106225] Updated weights for policy 1, policy_version 379543 (0.0008) [2023-12-27 21:57:02,838][106225] Updated weights for policy 1, policy_version 379553 (0.0007) [2023-12-27 21:57:02,895][106225] Updated weights for policy 1, policy_version 379563 (0.0010) [2023-12-27 21:57:03,279][106226] Updated weights for policy 0, policy_version 378802 (0.0007) [2023-12-27 21:57:03,327][106226] Updated weights for policy 0, policy_version 378812 (0.0008) [2023-12-27 21:57:03,390][106226] Updated weights for policy 0, policy_version 378822 (0.0010) [2023-12-27 21:57:03,560][106225] Updated weights for policy 1, policy_version 379573 (0.0008) [2023-12-27 21:57:03,608][106225] Updated weights for policy 1, policy_version 379583 (0.0005) [2023-12-27 21:57:03,658][106225] Updated weights for policy 1, policy_version 379593 (0.0005) [2023-12-27 21:57:04,131][106226] Updated weights for policy 0, policy_version 378832 (0.0009) [2023-12-27 21:57:04,201][106226] Updated weights for policy 0, policy_version 378842 (0.0009) [2023-12-27 21:57:04,266][106226] Updated weights for policy 0, policy_version 378852 (0.0009) [2023-12-27 21:57:04,367][106225] Updated weights for policy 1, policy_version 379603 (0.0008) [2023-12-27 21:57:04,430][106225] Updated weights for policy 1, policy_version 379613 (0.0009) [2023-12-27 21:57:04,494][106225] Updated weights for policy 1, policy_version 379623 (0.0011) [2023-12-27 21:57:05,044][106226] Updated weights for policy 0, policy_version 378862 (0.0010) [2023-12-27 21:57:05,104][106226] Updated weights for policy 0, policy_version 378872 (0.0010) [2023-12-27 21:57:05,160][106226] Updated weights for policy 0, policy_version 378882 (0.0011) [2023-12-27 21:57:05,212][106225] Updated weights for policy 1, policy_version 379633 (0.0010) [2023-12-27 21:57:05,275][106225] Updated weights for policy 1, policy_version 379643 (0.0009) [2023-12-27 21:57:05,331][106225] Updated weights for policy 1, policy_version 379653 (0.0009) [2023-12-27 21:57:05,397][106225] Updated weights for policy 1, policy_version 379663 (0.0009) [2023-12-27 21:57:05,786][106226] Updated weights for policy 0, policy_version 378892 (0.0010) [2023-12-27 21:57:05,849][106226] Updated weights for policy 0, policy_version 378902 (0.0011) [2023-12-27 21:57:05,906][106226] Updated weights for policy 0, policy_version 378912 (0.0010) [2023-12-27 21:57:06,035][106225] Updated weights for policy 1, policy_version 379673 (0.0006) [2023-12-27 21:57:06,089][106225] Updated weights for policy 1, policy_version 379683 (0.0005) [2023-12-27 21:57:06,150][106225] Updated weights for policy 1, policy_version 379693 (0.0008) [2023-12-27 21:57:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 194265088. Throughput: 0: 9991.6, 1: 9893.8. Samples: 194266988. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:06,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-5.606')] [2023-12-27 21:57:06,563][106226] Updated weights for policy 0, policy_version 378922 (0.0009) [2023-12-27 21:57:06,623][106226] Updated weights for policy 0, policy_version 378932 (0.0007) [2023-12-27 21:57:06,692][106226] Updated weights for policy 0, policy_version 378942 (0.0007) [2023-12-27 21:57:06,758][106226] Updated weights for policy 0, policy_version 378952 (0.0008) [2023-12-27 21:57:06,855][106225] Updated weights for policy 1, policy_version 379703 (0.0009) [2023-12-27 21:57:06,916][106225] Updated weights for policy 1, policy_version 379713 (0.0010) [2023-12-27 21:57:06,964][106225] Updated weights for policy 1, policy_version 379723 (0.0010) [2023-12-27 21:57:07,444][106226] Updated weights for policy 0, policy_version 378962 (0.0008) [2023-12-27 21:57:07,491][106226] Updated weights for policy 0, policy_version 378972 (0.0008) [2023-12-27 21:57:07,540][106226] Updated weights for policy 0, policy_version 378982 (0.0007) [2023-12-27 21:57:07,697][106225] Updated weights for policy 1, policy_version 379733 (0.0011) [2023-12-27 21:57:07,769][106225] Updated weights for policy 1, policy_version 379743 (0.0010) [2023-12-27 21:57:07,831][106225] Updated weights for policy 1, policy_version 379753 (0.0010) [2023-12-27 21:57:08,279][106226] Updated weights for policy 0, policy_version 378992 (0.0006) [2023-12-27 21:57:08,338][106226] Updated weights for policy 0, policy_version 379002 (0.0006) [2023-12-27 21:57:08,405][106226] Updated weights for policy 0, policy_version 379012 (0.0007) [2023-12-27 21:57:08,541][106225] Updated weights for policy 1, policy_version 379763 (0.0010) [2023-12-27 21:57:08,602][106225] Updated weights for policy 1, policy_version 379773 (0.0010) [2023-12-27 21:57:08,658][106225] Updated weights for policy 1, policy_version 379783 (0.0010) [2023-12-27 21:57:09,074][106226] Updated weights for policy 0, policy_version 379022 (0.0006) [2023-12-27 21:57:09,141][106226] Updated weights for policy 0, policy_version 379032 (0.0005) [2023-12-27 21:57:09,202][106226] Updated weights for policy 0, policy_version 379042 (0.0006) [2023-12-27 21:57:09,355][106225] Updated weights for policy 1, policy_version 379793 (0.0005) [2023-12-27 21:57:09,425][106225] Updated weights for policy 1, policy_version 379803 (0.0008) [2023-12-27 21:57:09,488][106225] Updated weights for policy 1, policy_version 379813 (0.0009) [2023-12-27 21:57:09,550][106225] Updated weights for policy 1, policy_version 379823 (0.0011) [2023-12-27 21:57:09,913][106226] Updated weights for policy 0, policy_version 379052 (0.0007) [2023-12-27 21:57:09,980][106226] Updated weights for policy 0, policy_version 379062 (0.0007) [2023-12-27 21:57:10,045][106226] Updated weights for policy 0, policy_version 379072 (0.0006) [2023-12-27 21:57:10,300][106225] Updated weights for policy 1, policy_version 379833 (0.0006) [2023-12-27 21:57:10,365][106225] Updated weights for policy 1, policy_version 379843 (0.0006) [2023-12-27 21:57:10,428][106225] Updated weights for policy 1, policy_version 379853 (0.0008) [2023-12-27 21:57:10,701][106226] Updated weights for policy 0, policy_version 379082 (0.0007) [2023-12-27 21:57:10,755][106226] Updated weights for policy 0, policy_version 379092 (0.0008) [2023-12-27 21:57:10,804][106226] Updated weights for policy 0, policy_version 379102 (0.0008) [2023-12-27 21:57:10,874][106226] Updated weights for policy 0, policy_version 379112 (0.0009) [2023-12-27 21:57:11,063][106225] Updated weights for policy 1, policy_version 379863 (0.0008) [2023-12-27 21:57:11,130][106225] Updated weights for policy 1, policy_version 379873 (0.0007) [2023-12-27 21:57:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 194355200. Throughput: 0: 10017.4, 1: 9939.7. Samples: 194327292. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:11,175][105115] Avg episode reward: [(0, '-4.995'), (1, '-5.471')] [2023-12-27 21:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000379112_97083392.pth... [2023-12-27 21:57:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000377960_96788480.pth [2023-12-27 21:57:11,199][106225] Updated weights for policy 1, policy_version 379883 (0.0008) [2023-12-27 21:57:11,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000379888_97280000.pth... [2023-12-27 21:57:11,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000378704_96976896.pth [2023-12-27 21:57:11,642][106226] Updated weights for policy 0, policy_version 379122 (0.0008) [2023-12-27 21:57:11,703][106226] Updated weights for policy 0, policy_version 379132 (0.0009) [2023-12-27 21:57:11,770][106226] Updated weights for policy 0, policy_version 379142 (0.0009) [2023-12-27 21:57:12,019][106225] Updated weights for policy 1, policy_version 379893 (0.0008) [2023-12-27 21:57:12,073][106225] Updated weights for policy 1, policy_version 379903 (0.0007) [2023-12-27 21:57:12,134][106225] Updated weights for policy 1, policy_version 379913 (0.0006) [2023-12-27 21:57:12,505][106226] Updated weights for policy 0, policy_version 379152 (0.0008) [2023-12-27 21:57:12,560][106226] Updated weights for policy 0, policy_version 379162 (0.0008) [2023-12-27 21:57:12,616][106226] Updated weights for policy 0, policy_version 379172 (0.0008) [2023-12-27 21:57:12,886][106225] Updated weights for policy 1, policy_version 379923 (0.0009) [2023-12-27 21:57:12,937][106225] Updated weights for policy 1, policy_version 379933 (0.0008) [2023-12-27 21:57:12,991][106225] Updated weights for policy 1, policy_version 379943 (0.0008) [2023-12-27 21:57:13,239][106226] Updated weights for policy 0, policy_version 379182 (0.0007) [2023-12-27 21:57:13,296][106226] Updated weights for policy 0, policy_version 379192 (0.0009) [2023-12-27 21:57:13,346][106226] Updated weights for policy 0, policy_version 379202 (0.0009) [2023-12-27 21:57:13,656][106225] Updated weights for policy 1, policy_version 379953 (0.0008) [2023-12-27 21:57:13,720][106225] Updated weights for policy 1, policy_version 379963 (0.0008) [2023-12-27 21:57:13,779][106225] Updated weights for policy 1, policy_version 379973 (0.0009) [2023-12-27 21:57:13,825][106225] Updated weights for policy 1, policy_version 379983 (0.0008) [2023-12-27 21:57:14,021][106226] Updated weights for policy 0, policy_version 379212 (0.0009) [2023-12-27 21:57:14,074][106226] Updated weights for policy 0, policy_version 379222 (0.0010) [2023-12-27 21:57:14,131][106226] Updated weights for policy 0, policy_version 379232 (0.0008) [2023-12-27 21:57:14,583][106225] Updated weights for policy 1, policy_version 379993 (0.0007) [2023-12-27 21:57:14,648][106225] Updated weights for policy 1, policy_version 380003 (0.0008) [2023-12-27 21:57:14,710][106225] Updated weights for policy 1, policy_version 380013 (0.0008) [2023-12-27 21:57:14,837][106226] Updated weights for policy 0, policy_version 379242 (0.0011) [2023-12-27 21:57:14,892][106226] Updated weights for policy 0, policy_version 379252 (0.0011) [2023-12-27 21:57:14,950][106226] Updated weights for policy 0, policy_version 379262 (0.0011) [2023-12-27 21:57:15,015][106226] Updated weights for policy 0, policy_version 379272 (0.0011) [2023-12-27 21:57:15,504][106225] Updated weights for policy 1, policy_version 380023 (0.0007) [2023-12-27 21:57:15,558][106225] Updated weights for policy 1, policy_version 380033 (0.0005) [2023-12-27 21:57:15,619][106225] Updated weights for policy 1, policy_version 380043 (0.0005) [2023-12-27 21:57:15,666][106226] Updated weights for policy 0, policy_version 379282 (0.0005) [2023-12-27 21:57:15,729][106226] Updated weights for policy 0, policy_version 379292 (0.0009) [2023-12-27 21:57:15,791][106226] Updated weights for policy 0, policy_version 379302 (0.0009) [2023-12-27 21:57:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 194453504. Throughput: 0: 9892.1, 1: 9867.2. Samples: 194442972. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:16,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.773')] [2023-12-27 21:57:16,290][106225] Updated weights for policy 1, policy_version 380053 (0.0010) [2023-12-27 21:57:16,343][106225] Updated weights for policy 1, policy_version 380063 (0.0010) [2023-12-27 21:57:16,394][106225] Updated weights for policy 1, policy_version 380073 (0.0010) [2023-12-27 21:57:16,408][106226] Updated weights for policy 0, policy_version 379312 (0.0005) [2023-12-27 21:57:16,455][106226] Updated weights for policy 0, policy_version 379322 (0.0005) [2023-12-27 21:57:16,499][106226] Updated weights for policy 0, policy_version 379332 (0.0005) [2023-12-27 21:57:17,107][106225] Updated weights for policy 1, policy_version 380083 (0.0010) [2023-12-27 21:57:17,136][106226] Updated weights for policy 0, policy_version 379342 (0.0005) [2023-12-27 21:57:17,161][106225] Updated weights for policy 1, policy_version 380093 (0.0010) [2023-12-27 21:57:17,190][106226] Updated weights for policy 0, policy_version 379352 (0.0005) [2023-12-27 21:57:17,211][106225] Updated weights for policy 1, policy_version 380103 (0.0010) [2023-12-27 21:57:17,238][106226] Updated weights for policy 0, policy_version 379362 (0.0008) [2023-12-27 21:57:17,920][106226] Updated weights for policy 0, policy_version 379372 (0.0007) [2023-12-27 21:57:17,967][106226] Updated weights for policy 0, policy_version 379382 (0.0008) [2023-12-27 21:57:17,983][106225] Updated weights for policy 1, policy_version 380113 (0.0010) [2023-12-27 21:57:18,031][106226] Updated weights for policy 0, policy_version 379392 (0.0007) [2023-12-27 21:57:18,046][106225] Updated weights for policy 1, policy_version 380123 (0.0008) [2023-12-27 21:57:18,101][106225] Updated weights for policy 1, policy_version 380133 (0.0011) [2023-12-27 21:57:18,162][106225] Updated weights for policy 1, policy_version 380143 (0.0010) [2023-12-27 21:57:18,814][106226] Updated weights for policy 0, policy_version 379402 (0.0008) [2023-12-27 21:57:18,878][106226] Updated weights for policy 0, policy_version 379412 (0.0007) [2023-12-27 21:57:18,899][106225] Updated weights for policy 1, policy_version 380153 (0.0010) [2023-12-27 21:57:18,936][106226] Updated weights for policy 0, policy_version 379422 (0.0006) [2023-12-27 21:57:18,953][106225] Updated weights for policy 1, policy_version 380163 (0.0010) [2023-12-27 21:57:18,990][106226] Updated weights for policy 0, policy_version 379432 (0.0005) [2023-12-27 21:57:19,002][106225] Updated weights for policy 1, policy_version 380173 (0.0010) [2023-12-27 21:57:19,728][106226] Updated weights for policy 0, policy_version 379442 (0.0008) [2023-12-27 21:57:19,763][106225] Updated weights for policy 1, policy_version 380183 (0.0008) [2023-12-27 21:57:19,789][106226] Updated weights for policy 0, policy_version 379452 (0.0007) [2023-12-27 21:57:19,826][106225] Updated weights for policy 1, policy_version 380193 (0.0006) [2023-12-27 21:57:19,854][106226] Updated weights for policy 0, policy_version 379462 (0.0008) [2023-12-27 21:57:19,897][106225] Updated weights for policy 1, policy_version 380203 (0.0007) [2023-12-27 21:57:20,549][106225] Updated weights for policy 1, policy_version 380213 (0.0008) [2023-12-27 21:57:20,611][106225] Updated weights for policy 1, policy_version 380223 (0.0008) [2023-12-27 21:57:20,617][106226] Updated weights for policy 0, policy_version 379472 (0.0008) [2023-12-27 21:57:20,674][106225] Updated weights for policy 1, policy_version 380233 (0.0008) [2023-12-27 21:57:20,675][106226] Updated weights for policy 0, policy_version 379482 (0.0011) [2023-12-27 21:57:20,739][106226] Updated weights for policy 0, policy_version 379492 (0.0011) [2023-12-27 21:57:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 194551808. Throughput: 0: 9849.3, 1: 9859.5. Samples: 194560220. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:21,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.871')] [2023-12-27 21:57:21,416][106225] Updated weights for policy 1, policy_version 380243 (0.0008) [2023-12-27 21:57:21,480][106225] Updated weights for policy 1, policy_version 380253 (0.0008) [2023-12-27 21:57:21,541][106225] Updated weights for policy 1, policy_version 380263 (0.0008) [2023-12-27 21:57:21,560][106226] Updated weights for policy 0, policy_version 379502 (0.0011) [2023-12-27 21:57:21,618][106226] Updated weights for policy 0, policy_version 379512 (0.0011) [2023-12-27 21:57:21,689][106226] Updated weights for policy 0, policy_version 379522 (0.0011) [2023-12-27 21:57:22,334][106225] Updated weights for policy 1, policy_version 380273 (0.0007) [2023-12-27 21:57:22,407][106225] Updated weights for policy 1, policy_version 380283 (0.0008) [2023-12-27 21:57:22,476][106225] Updated weights for policy 1, policy_version 380293 (0.0007) [2023-12-27 21:57:22,494][106226] Updated weights for policy 0, policy_version 379532 (0.0009) [2023-12-27 21:57:22,544][106225] Updated weights for policy 1, policy_version 380303 (0.0007) [2023-12-27 21:57:22,563][106226] Updated weights for policy 0, policy_version 379542 (0.0008) [2023-12-27 21:57:22,629][106226] Updated weights for policy 0, policy_version 379552 (0.0011) [2023-12-27 21:57:23,249][106225] Updated weights for policy 1, policy_version 380313 (0.0008) [2023-12-27 21:57:23,305][106226] Updated weights for policy 0, policy_version 379562 (0.0009) [2023-12-27 21:57:23,307][106225] Updated weights for policy 1, policy_version 380323 (0.0009) [2023-12-27 21:57:23,364][106226] Updated weights for policy 0, policy_version 379572 (0.0006) [2023-12-27 21:57:23,366][106225] Updated weights for policy 1, policy_version 380333 (0.0007) [2023-12-27 21:57:23,422][106226] Updated weights for policy 0, policy_version 379582 (0.0010) [2023-12-27 21:57:23,481][106226] Updated weights for policy 0, policy_version 379592 (0.0010) [2023-12-27 21:57:24,025][106225] Updated weights for policy 1, policy_version 380343 (0.0009) [2023-12-27 21:57:24,084][106225] Updated weights for policy 1, policy_version 380353 (0.0009) [2023-12-27 21:57:24,152][106225] Updated weights for policy 1, policy_version 380363 (0.0010) [2023-12-27 21:57:24,159][106226] Updated weights for policy 0, policy_version 379602 (0.0010) [2023-12-27 21:57:24,215][106226] Updated weights for policy 0, policy_version 379612 (0.0010) [2023-12-27 21:57:24,276][106226] Updated weights for policy 0, policy_version 379622 (0.0009) [2023-12-27 21:57:24,781][106225] Updated weights for policy 1, policy_version 380373 (0.0008) [2023-12-27 21:57:24,833][106225] Updated weights for policy 1, policy_version 380383 (0.0005) [2023-12-27 21:57:24,899][106225] Updated weights for policy 1, policy_version 380393 (0.0009) [2023-12-27 21:57:24,963][106226] Updated weights for policy 0, policy_version 379632 (0.0006) [2023-12-27 21:57:25,013][106226] Updated weights for policy 0, policy_version 379642 (0.0008) [2023-12-27 21:57:25,060][106226] Updated weights for policy 0, policy_version 379652 (0.0008) [2023-12-27 21:57:25,489][106225] Updated weights for policy 1, policy_version 380403 (0.0009) [2023-12-27 21:57:25,549][106225] Updated weights for policy 1, policy_version 380413 (0.0005) [2023-12-27 21:57:25,602][106225] Updated weights for policy 1, policy_version 380423 (0.0005) [2023-12-27 21:57:25,740][106226] Updated weights for policy 0, policy_version 379662 (0.0007) [2023-12-27 21:57:25,802][106226] Updated weights for policy 0, policy_version 379672 (0.0006) [2023-12-27 21:57:25,856][106226] Updated weights for policy 0, policy_version 379682 (0.0005) [2023-12-27 21:57:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 194650112. Throughput: 0: 9829.0, 1: 9793.2. Samples: 194617320. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:26,175][105115] Avg episode reward: [(0, '-4.952'), (1, '-5.637')] [2023-12-27 21:57:26,178][106225] Updated weights for policy 1, policy_version 380433 (0.0006) [2023-12-27 21:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000379688_97230848.pth... [2023-12-27 21:57:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000378536_96935936.pth [2023-12-27 21:57:26,237][106225] Updated weights for policy 1, policy_version 380443 (0.0007) [2023-12-27 21:57:26,303][106225] Updated weights for policy 1, policy_version 380453 (0.0007) [2023-12-27 21:57:26,360][106225] Updated weights for policy 1, policy_version 380463 (0.0010) [2023-12-27 21:57:26,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000380464_97427456.pth... [2023-12-27 21:57:26,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000379280_97124352.pth [2023-12-27 21:57:26,406][106226] Updated weights for policy 0, policy_version 379692 (0.0007) [2023-12-27 21:57:26,460][106226] Updated weights for policy 0, policy_version 379702 (0.0010) [2023-12-27 21:57:26,516][106226] Updated weights for policy 0, policy_version 379712 (0.0010) [2023-12-27 21:57:27,027][106225] Updated weights for policy 1, policy_version 380473 (0.0010) [2023-12-27 21:57:27,080][106225] Updated weights for policy 1, policy_version 380483 (0.0010) [2023-12-27 21:57:27,130][106225] Updated weights for policy 1, policy_version 380493 (0.0010) [2023-12-27 21:57:27,180][106226] Updated weights for policy 0, policy_version 379722 (0.0010) [2023-12-27 21:57:27,236][106226] Updated weights for policy 0, policy_version 379732 (0.0010) [2023-12-27 21:57:27,291][106226] Updated weights for policy 0, policy_version 379742 (0.0010) [2023-12-27 21:57:27,348][106226] Updated weights for policy 0, policy_version 379752 (0.0010) [2023-12-27 21:57:27,854][106225] Updated weights for policy 1, policy_version 380503 (0.0010) [2023-12-27 21:57:27,899][106225] Updated weights for policy 1, policy_version 380513 (0.0010) [2023-12-27 21:57:27,949][106225] Updated weights for policy 1, policy_version 380523 (0.0010) [2023-12-27 21:57:28,043][106226] Updated weights for policy 0, policy_version 379762 (0.0010) [2023-12-27 21:57:28,100][106226] Updated weights for policy 0, policy_version 379772 (0.0010) [2023-12-27 21:57:28,156][106226] Updated weights for policy 0, policy_version 379782 (0.0010) [2023-12-27 21:57:28,673][106225] Updated weights for policy 1, policy_version 380533 (0.0010) [2023-12-27 21:57:28,730][106225] Updated weights for policy 1, policy_version 380543 (0.0010) [2023-12-27 21:57:28,793][106225] Updated weights for policy 1, policy_version 380553 (0.0010) [2023-12-27 21:57:28,867][106226] Updated weights for policy 0, policy_version 379792 (0.0010) [2023-12-27 21:57:28,921][106226] Updated weights for policy 0, policy_version 379802 (0.0008) [2023-12-27 21:57:28,970][106226] Updated weights for policy 0, policy_version 379812 (0.0005) [2023-12-27 21:57:29,385][106225] Updated weights for policy 1, policy_version 380563 (0.0010) [2023-12-27 21:57:29,433][106225] Updated weights for policy 1, policy_version 380573 (0.0008) [2023-12-27 21:57:29,480][106225] Updated weights for policy 1, policy_version 380583 (0.0008) [2023-12-27 21:57:29,557][106226] Updated weights for policy 0, policy_version 379822 (0.0005) [2023-12-27 21:57:29,617][106226] Updated weights for policy 0, policy_version 379832 (0.0008) [2023-12-27 21:57:29,675][106226] Updated weights for policy 0, policy_version 379842 (0.0009) [2023-12-27 21:57:30,144][106225] Updated weights for policy 1, policy_version 380593 (0.0006) [2023-12-27 21:57:30,201][106225] Updated weights for policy 1, policy_version 380603 (0.0010) [2023-12-27 21:57:30,261][106225] Updated weights for policy 1, policy_version 380613 (0.0010) [2023-12-27 21:57:30,307][106226] Updated weights for policy 0, policy_version 379852 (0.0007) [2023-12-27 21:57:30,321][106225] Updated weights for policy 1, policy_version 380623 (0.0010) [2023-12-27 21:57:30,366][106226] Updated weights for policy 0, policy_version 379862 (0.0007) [2023-12-27 21:57:30,426][106226] Updated weights for policy 0, policy_version 379872 (0.0010) [2023-12-27 21:57:30,941][106225] Updated weights for policy 1, policy_version 380633 (0.0006) [2023-12-27 21:57:30,992][106225] Updated weights for policy 1, policy_version 380643 (0.0007) [2023-12-27 21:57:31,054][106225] Updated weights for policy 1, policy_version 380653 (0.0008) [2023-12-27 21:57:31,131][106226] Updated weights for policy 0, policy_version 379882 (0.0009) [2023-12-27 21:57:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 194756608. Throughput: 0: 9940.1, 1: 9875.6. Samples: 194744056. Policy #0 lag: (min: 14.0, avg: 25.7, max: 46.0) [2023-12-27 21:57:31,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-5.625')] [2023-12-27 21:57:31,203][106226] Updated weights for policy 0, policy_version 379892 (0.0009) [2023-12-27 21:57:31,271][106226] Updated weights for policy 0, policy_version 379902 (0.0009) [2023-12-27 21:57:31,332][106226] Updated weights for policy 0, policy_version 379912 (0.0007) [2023-12-27 21:57:31,701][106225] Updated weights for policy 1, policy_version 380663 (0.0009) [2023-12-27 21:57:31,764][106225] Updated weights for policy 1, policy_version 380673 (0.0008) [2023-12-27 21:57:31,831][106225] Updated weights for policy 1, policy_version 380683 (0.0009) [2023-12-27 21:57:32,085][106226] Updated weights for policy 0, policy_version 379922 (0.0008) [2023-12-27 21:57:32,146][106226] Updated weights for policy 0, policy_version 379932 (0.0007) [2023-12-27 21:57:32,200][106226] Updated weights for policy 0, policy_version 379942 (0.0008) [2023-12-27 21:57:32,546][106225] Updated weights for policy 1, policy_version 380693 (0.0009) [2023-12-27 21:57:32,608][106225] Updated weights for policy 1, policy_version 380703 (0.0008) [2023-12-27 21:57:32,665][106225] Updated weights for policy 1, policy_version 380713 (0.0008) [2023-12-27 21:57:32,967][106226] Updated weights for policy 0, policy_version 379952 (0.0009) [2023-12-27 21:57:33,027][106226] Updated weights for policy 0, policy_version 379962 (0.0008) [2023-12-27 21:57:33,092][106226] Updated weights for policy 0, policy_version 379972 (0.0008) [2023-12-27 21:57:33,413][106225] Updated weights for policy 1, policy_version 380723 (0.0008) [2023-12-27 21:57:33,462][106225] Updated weights for policy 1, policy_version 380733 (0.0007) [2023-12-27 21:57:33,525][106225] Updated weights for policy 1, policy_version 380743 (0.0007) [2023-12-27 21:57:33,777][106226] Updated weights for policy 0, policy_version 379982 (0.0009) [2023-12-27 21:57:33,841][106226] Updated weights for policy 0, policy_version 379992 (0.0006) [2023-12-27 21:57:33,898][106226] Updated weights for policy 0, policy_version 380002 (0.0005) [2023-12-27 21:57:34,328][106225] Updated weights for policy 1, policy_version 380753 (0.0008) [2023-12-27 21:57:34,394][106225] Updated weights for policy 1, policy_version 380763 (0.0008) [2023-12-27 21:57:34,459][106225] Updated weights for policy 1, policy_version 380773 (0.0008) [2023-12-27 21:57:34,521][106225] Updated weights for policy 1, policy_version 380783 (0.0007) [2023-12-27 21:57:34,548][106226] Updated weights for policy 0, policy_version 380012 (0.0006) [2023-12-27 21:57:34,605][106226] Updated weights for policy 0, policy_version 380022 (0.0006) [2023-12-27 21:57:34,669][106226] Updated weights for policy 0, policy_version 380032 (0.0010) [2023-12-27 21:57:35,255][106225] Updated weights for policy 1, policy_version 380793 (0.0007) [2023-12-27 21:57:35,320][106225] Updated weights for policy 1, policy_version 380803 (0.0005) [2023-12-27 21:57:35,371][106226] Updated weights for policy 0, policy_version 380042 (0.0011) [2023-12-27 21:57:35,381][106225] Updated weights for policy 1, policy_version 380813 (0.0006) [2023-12-27 21:57:35,428][106226] Updated weights for policy 0, policy_version 380052 (0.0009) [2023-12-27 21:57:35,476][106226] Updated weights for policy 0, policy_version 380062 (0.0007) [2023-12-27 21:57:35,532][106226] Updated weights for policy 0, policy_version 380072 (0.0008) [2023-12-27 21:57:36,023][106225] Updated weights for policy 1, policy_version 380823 (0.0009) [2023-12-27 21:57:36,086][106225] Updated weights for policy 1, policy_version 380833 (0.0009) [2023-12-27 21:57:36,152][106225] Updated weights for policy 1, policy_version 380843 (0.0007) [2023-12-27 21:57:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 194846720. Throughput: 0: 9924.1, 1: 9883.3. Samples: 194862868. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:57:36,176][105115] Avg episode reward: [(0, '-4.839'), (1, '-5.765')] [2023-12-27 21:57:36,190][106226] Updated weights for policy 0, policy_version 380082 (0.0008) [2023-12-27 21:57:36,251][106226] Updated weights for policy 0, policy_version 380092 (0.0009) [2023-12-27 21:57:36,315][106226] Updated weights for policy 0, policy_version 380102 (0.0009) [2023-12-27 21:57:36,880][106225] Updated weights for policy 1, policy_version 380853 (0.0007) [2023-12-27 21:57:36,937][106225] Updated weights for policy 1, policy_version 380863 (0.0008) [2023-12-27 21:57:36,987][106225] Updated weights for policy 1, policy_version 380873 (0.0008) [2023-12-27 21:57:37,065][106226] Updated weights for policy 0, policy_version 380112 (0.0010) [2023-12-27 21:57:37,119][106226] Updated weights for policy 0, policy_version 380122 (0.0010) [2023-12-27 21:57:37,178][106226] Updated weights for policy 0, policy_version 380132 (0.0009) [2023-12-27 21:57:37,620][106225] Updated weights for policy 1, policy_version 380883 (0.0010) [2023-12-27 21:57:37,684][106225] Updated weights for policy 1, policy_version 380893 (0.0009) [2023-12-27 21:57:37,740][106225] Updated weights for policy 1, policy_version 380903 (0.0008) [2023-12-27 21:57:37,851][106226] Updated weights for policy 0, policy_version 380142 (0.0009) [2023-12-27 21:57:37,912][106226] Updated weights for policy 0, policy_version 380152 (0.0008) [2023-12-27 21:57:37,971][106226] Updated weights for policy 0, policy_version 380162 (0.0008) [2023-12-27 21:57:38,376][106225] Updated weights for policy 1, policy_version 380913 (0.0008) [2023-12-27 21:57:38,441][106225] Updated weights for policy 1, policy_version 380923 (0.0007) [2023-12-27 21:57:38,506][106225] Updated weights for policy 1, policy_version 380933 (0.0006) [2023-12-27 21:57:38,569][106225] Updated weights for policy 1, policy_version 380943 (0.0007) [2023-12-27 21:57:38,652][106226] Updated weights for policy 0, policy_version 380172 (0.0006) [2023-12-27 21:57:38,717][106226] Updated weights for policy 0, policy_version 380182 (0.0005) [2023-12-27 21:57:38,784][106226] Updated weights for policy 0, policy_version 380192 (0.0006) [2023-12-27 21:57:39,163][106225] Updated weights for policy 1, policy_version 380953 (0.0008) [2023-12-27 21:57:39,236][106225] Updated weights for policy 1, policy_version 380963 (0.0010) [2023-12-27 21:57:39,304][106225] Updated weights for policy 1, policy_version 380973 (0.0007) [2023-12-27 21:57:39,389][106226] Updated weights for policy 0, policy_version 380202 (0.0006) [2023-12-27 21:57:39,457][106226] Updated weights for policy 0, policy_version 380212 (0.0009) [2023-12-27 21:57:39,520][106226] Updated weights for policy 0, policy_version 380222 (0.0008) [2023-12-27 21:57:39,584][106226] Updated weights for policy 0, policy_version 380232 (0.0008) [2023-12-27 21:57:40,062][106225] Updated weights for policy 1, policy_version 380983 (0.0006) [2023-12-27 21:57:40,124][106225] Updated weights for policy 1, policy_version 380993 (0.0008) [2023-12-27 21:57:40,191][106225] Updated weights for policy 1, policy_version 381003 (0.0007) [2023-12-27 21:57:40,269][106226] Updated weights for policy 0, policy_version 380242 (0.0006) [2023-12-27 21:57:40,333][106226] Updated weights for policy 0, policy_version 380252 (0.0006) [2023-12-27 21:57:40,399][106226] Updated weights for policy 0, policy_version 380262 (0.0009) [2023-12-27 21:57:40,804][106225] Updated weights for policy 1, policy_version 381013 (0.0007) [2023-12-27 21:57:40,860][106225] Updated weights for policy 1, policy_version 381023 (0.0005) [2023-12-27 21:57:40,915][106225] Updated weights for policy 1, policy_version 381033 (0.0006) [2023-12-27 21:57:41,050][106226] Updated weights for policy 0, policy_version 380272 (0.0011) [2023-12-27 21:57:41,116][106226] Updated weights for policy 0, policy_version 380282 (0.0009) [2023-12-27 21:57:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 194953216. Throughput: 0: 9961.7, 1: 9939.0. Samples: 194923824. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:57:41,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.696')] [2023-12-27 21:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000381040_97574912.pth... [2023-12-27 21:57:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000379888_97280000.pth [2023-12-27 21:57:41,190][106226] Updated weights for policy 0, policy_version 380292 (0.0009) [2023-12-27 21:57:41,214][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000380296_97386496.pth... [2023-12-27 21:57:41,217][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000379112_97083392.pth [2023-12-27 21:57:41,672][106225] Updated weights for policy 1, policy_version 381043 (0.0007) [2023-12-27 21:57:41,758][106225] Updated weights for policy 1, policy_version 381056 (0.0008) [2023-12-27 21:57:41,823][106225] Updated weights for policy 1, policy_version 381066 (0.0011) [2023-12-27 21:57:41,974][106226] Updated weights for policy 0, policy_version 380302 (0.0010) [2023-12-27 21:57:42,028][106226] Updated weights for policy 0, policy_version 380312 (0.0011) [2023-12-27 21:57:42,092][106226] Updated weights for policy 0, policy_version 380323 (0.0009) [2023-12-27 21:57:42,547][106225] Updated weights for policy 1, policy_version 381076 (0.0010) [2023-12-27 21:57:42,609][106225] Updated weights for policy 1, policy_version 381086 (0.0010) [2023-12-27 21:57:42,668][106225] Updated weights for policy 1, policy_version 381096 (0.0010) [2023-12-27 21:57:42,906][106226] Updated weights for policy 0, policy_version 380333 (0.0009) [2023-12-27 21:57:42,976][106226] Updated weights for policy 0, policy_version 380343 (0.0011) [2023-12-27 21:57:43,043][106226] Updated weights for policy 0, policy_version 380353 (0.0011) [2023-12-27 21:57:43,340][106225] Updated weights for policy 1, policy_version 381106 (0.0009) [2023-12-27 21:57:43,407][106225] Updated weights for policy 1, policy_version 381116 (0.0005) [2023-12-27 21:57:43,465][106225] Updated weights for policy 1, policy_version 381126 (0.0010) [2023-12-27 21:57:43,515][106225] Updated weights for policy 1, policy_version 381136 (0.0010) [2023-12-27 21:57:43,616][106226] Updated weights for policy 0, policy_version 380363 (0.0011) [2023-12-27 21:57:43,673][106226] Updated weights for policy 0, policy_version 380373 (0.0010) [2023-12-27 21:57:43,734][106226] Updated weights for policy 0, policy_version 380383 (0.0007) [2023-12-27 21:57:44,137][106225] Updated weights for policy 1, policy_version 381146 (0.0009) [2023-12-27 21:57:44,188][106225] Updated weights for policy 1, policy_version 381156 (0.0009) [2023-12-27 21:57:44,242][106225] Updated weights for policy 1, policy_version 381166 (0.0009) [2023-12-27 21:57:44,330][106226] Updated weights for policy 0, policy_version 380393 (0.0009) [2023-12-27 21:57:44,385][106226] Updated weights for policy 0, policy_version 380403 (0.0005) [2023-12-27 21:57:44,450][106226] Updated weights for policy 0, policy_version 380413 (0.0009) [2023-12-27 21:57:44,517][106226] Updated weights for policy 0, policy_version 380423 (0.0007) [2023-12-27 21:57:44,942][106225] Updated weights for policy 1, policy_version 381176 (0.0009) [2023-12-27 21:57:44,992][106225] Updated weights for policy 1, policy_version 381186 (0.0008) [2023-12-27 21:57:45,044][106225] Updated weights for policy 1, policy_version 381196 (0.0009) [2023-12-27 21:57:45,241][106226] Updated weights for policy 0, policy_version 380433 (0.0009) [2023-12-27 21:57:45,294][106226] Updated weights for policy 0, policy_version 380443 (0.0008) [2023-12-27 21:57:45,355][106226] Updated weights for policy 0, policy_version 380453 (0.0009) [2023-12-27 21:57:45,779][106225] Updated weights for policy 1, policy_version 381206 (0.0009) [2023-12-27 21:57:45,842][106225] Updated weights for policy 1, policy_version 381216 (0.0007) [2023-12-27 21:57:45,909][106225] Updated weights for policy 1, policy_version 381226 (0.0008) [2023-12-27 21:57:46,066][106226] Updated weights for policy 0, policy_version 380463 (0.0009) [2023-12-27 21:57:46,117][106226] Updated weights for policy 0, policy_version 380473 (0.0008) [2023-12-27 21:57:46,173][106226] Updated weights for policy 0, policy_version 380483 (0.0009) [2023-12-27 21:57:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 195051520. Throughput: 0: 9935.4, 1: 9958.6. Samples: 195044380. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:57:46,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-5.232')] [2023-12-27 21:57:46,525][106225] Updated weights for policy 1, policy_version 381236 (0.0008) [2023-12-27 21:57:46,586][106225] Updated weights for policy 1, policy_version 381246 (0.0008) [2023-12-27 21:57:46,644][106225] Updated weights for policy 1, policy_version 381256 (0.0009) [2023-12-27 21:57:46,966][106226] Updated weights for policy 0, policy_version 380493 (0.0009) [2023-12-27 21:57:47,021][106226] Updated weights for policy 0, policy_version 380503 (0.0006) [2023-12-27 21:57:47,071][106226] Updated weights for policy 0, policy_version 380513 (0.0005) [2023-12-27 21:57:47,332][106225] Updated weights for policy 1, policy_version 381266 (0.0009) [2023-12-27 21:57:47,392][106225] Updated weights for policy 1, policy_version 381276 (0.0008) [2023-12-27 21:57:47,448][106225] Updated weights for policy 1, policy_version 381286 (0.0008) [2023-12-27 21:57:47,507][106225] Updated weights for policy 1, policy_version 381296 (0.0008) [2023-12-27 21:57:47,659][106226] Updated weights for policy 0, policy_version 380523 (0.0005) [2023-12-27 21:57:47,709][106226] Updated weights for policy 0, policy_version 380533 (0.0005) [2023-12-27 21:57:47,766][106226] Updated weights for policy 0, policy_version 380543 (0.0006) [2023-12-27 21:57:48,244][106225] Updated weights for policy 1, policy_version 381306 (0.0007) [2023-12-27 21:57:48,315][106225] Updated weights for policy 1, policy_version 381316 (0.0007) [2023-12-27 21:57:48,377][106225] Updated weights for policy 1, policy_version 381326 (0.0006) [2023-12-27 21:57:48,492][106226] Updated weights for policy 0, policy_version 380553 (0.0008) [2023-12-27 21:57:48,549][106226] Updated weights for policy 0, policy_version 380563 (0.0009) [2023-12-27 21:57:48,604][106226] Updated weights for policy 0, policy_version 380573 (0.0010) [2023-12-27 21:57:48,658][106226] Updated weights for policy 0, policy_version 380583 (0.0009) [2023-12-27 21:57:48,979][106225] Updated weights for policy 1, policy_version 381336 (0.0008) [2023-12-27 21:57:49,041][106225] Updated weights for policy 1, policy_version 381346 (0.0008) [2023-12-27 21:57:49,100][106225] Updated weights for policy 1, policy_version 381356 (0.0008) [2023-12-27 21:57:49,475][106226] Updated weights for policy 0, policy_version 380593 (0.0009) [2023-12-27 21:57:49,534][106226] Updated weights for policy 0, policy_version 380603 (0.0007) [2023-12-27 21:57:49,597][106226] Updated weights for policy 0, policy_version 380613 (0.0005) [2023-12-27 21:57:49,775][106225] Updated weights for policy 1, policy_version 381366 (0.0005) [2023-12-27 21:57:49,845][106225] Updated weights for policy 1, policy_version 381376 (0.0008) [2023-12-27 21:57:49,908][106225] Updated weights for policy 1, policy_version 381386 (0.0010) [2023-12-27 21:57:50,240][106226] Updated weights for policy 0, policy_version 380623 (0.0007) [2023-12-27 21:57:50,304][106226] Updated weights for policy 0, policy_version 380633 (0.0008) [2023-12-27 21:57:50,366][106226] Updated weights for policy 0, policy_version 380643 (0.0008) [2023-12-27 21:57:50,643][106225] Updated weights for policy 1, policy_version 381396 (0.0009) [2023-12-27 21:57:50,702][106225] Updated weights for policy 1, policy_version 381406 (0.0007) [2023-12-27 21:57:50,773][106225] Updated weights for policy 1, policy_version 381416 (0.0009) [2023-12-27 21:57:51,081][106226] Updated weights for policy 0, policy_version 380653 (0.0008) [2023-12-27 21:57:51,138][106226] Updated weights for policy 0, policy_version 380663 (0.0010) [2023-12-27 21:57:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 195149824. Throughput: 0: 9949.0, 1: 9953.9. Samples: 195162624. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:57:51,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-5.659')] [2023-12-27 21:57:51,190][106226] Updated weights for policy 0, policy_version 380673 (0.0009) [2023-12-27 21:57:51,469][106225] Updated weights for policy 1, policy_version 381426 (0.0009) [2023-12-27 21:57:51,529][106225] Updated weights for policy 1, policy_version 381436 (0.0009) [2023-12-27 21:57:51,590][106225] Updated weights for policy 1, policy_version 381446 (0.0009) [2023-12-27 21:57:51,656][106225] Updated weights for policy 1, policy_version 381456 (0.0009) [2023-12-27 21:57:51,971][106226] Updated weights for policy 0, policy_version 380683 (0.0008) [2023-12-27 21:57:52,020][106226] Updated weights for policy 0, policy_version 380693 (0.0005) [2023-12-27 21:57:52,069][106226] Updated weights for policy 0, policy_version 380703 (0.0005) [2023-12-27 21:57:52,513][106225] Updated weights for policy 1, policy_version 381466 (0.0007) [2023-12-27 21:57:52,568][106225] Updated weights for policy 1, policy_version 381476 (0.0007) [2023-12-27 21:57:52,631][106225] Updated weights for policy 1, policy_version 381486 (0.0007) [2023-12-27 21:57:52,801][106226] Updated weights for policy 0, policy_version 380713 (0.0005) [2023-12-27 21:57:52,867][106226] Updated weights for policy 0, policy_version 380723 (0.0008) [2023-12-27 21:57:52,938][106226] Updated weights for policy 0, policy_version 380733 (0.0008) [2023-12-27 21:57:53,001][106226] Updated weights for policy 0, policy_version 380743 (0.0010) [2023-12-27 21:57:53,256][106225] Updated weights for policy 1, policy_version 381496 (0.0006) [2023-12-27 21:57:53,307][106225] Updated weights for policy 1, policy_version 381506 (0.0006) [2023-12-27 21:57:53,355][106225] Updated weights for policy 1, policy_version 381516 (0.0008) [2023-12-27 21:57:53,783][106226] Updated weights for policy 0, policy_version 380753 (0.0008) [2023-12-27 21:57:53,844][106226] Updated weights for policy 0, policy_version 380763 (0.0008) [2023-12-27 21:57:53,902][106226] Updated weights for policy 0, policy_version 380773 (0.0010) [2023-12-27 21:57:53,996][106225] Updated weights for policy 1, policy_version 381526 (0.0007) [2023-12-27 21:57:54,051][106225] Updated weights for policy 1, policy_version 381536 (0.0005) [2023-12-27 21:57:54,096][106225] Updated weights for policy 1, policy_version 381546 (0.0005) [2023-12-27 21:57:54,688][106226] Updated weights for policy 0, policy_version 380783 (0.0007) [2023-12-27 21:57:54,693][106225] Updated weights for policy 1, policy_version 381556 (0.0006) [2023-12-27 21:57:54,741][106225] Updated weights for policy 1, policy_version 381566 (0.0007) [2023-12-27 21:57:54,744][106226] Updated weights for policy 0, policy_version 380793 (0.0008) [2023-12-27 21:57:54,801][106226] Updated weights for policy 0, policy_version 380803 (0.0005) [2023-12-27 21:57:54,809][106225] Updated weights for policy 1, policy_version 381576 (0.0009) [2023-12-27 21:57:55,428][106225] Updated weights for policy 1, policy_version 381586 (0.0007) [2023-12-27 21:57:55,474][106225] Updated weights for policy 1, policy_version 381596 (0.0005) [2023-12-27 21:57:55,519][106225] Updated weights for policy 1, policy_version 381606 (0.0005) [2023-12-27 21:57:55,568][106226] Updated weights for policy 0, policy_version 380813 (0.0006) [2023-12-27 21:57:55,574][106225] Updated weights for policy 1, policy_version 381616 (0.0007) [2023-12-27 21:57:55,614][106226] Updated weights for policy 0, policy_version 380823 (0.0008) [2023-12-27 21:57:55,662][106226] Updated weights for policy 0, policy_version 380833 (0.0008) [2023-12-27 21:57:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 195248128. Throughput: 0: 9891.2, 1: 9934.0. Samples: 195219424. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:57:56,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.714')] [2023-12-27 21:57:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000380840_97525760.pth... [2023-12-27 21:57:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000379688_97230848.pth [2023-12-27 21:57:56,196][106225] Updated weights for policy 1, policy_version 381626 (0.0007) [2023-12-27 21:57:56,252][106225] Updated weights for policy 1, policy_version 381636 (0.0007) [2023-12-27 21:57:56,313][106225] Updated weights for policy 1, policy_version 381646 (0.0006) [2023-12-27 21:57:56,322][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000381648_97730560.pth... [2023-12-27 21:57:56,325][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000380464_97427456.pth [2023-12-27 21:57:56,479][106226] Updated weights for policy 0, policy_version 380843 (0.0007) [2023-12-27 21:57:56,529][106226] Updated weights for policy 0, policy_version 380853 (0.0007) [2023-12-27 21:57:56,577][106226] Updated weights for policy 0, policy_version 380863 (0.0008) [2023-12-27 21:57:56,881][106225] Updated weights for policy 1, policy_version 381656 (0.0006) [2023-12-27 21:57:56,928][106225] Updated weights for policy 1, policy_version 381666 (0.0006) [2023-12-27 21:57:56,977][106225] Updated weights for policy 1, policy_version 381676 (0.0008) [2023-12-27 21:57:57,281][106226] Updated weights for policy 0, policy_version 380874 (0.0008) [2023-12-27 21:57:57,337][106226] Updated weights for policy 0, policy_version 380884 (0.0006) [2023-12-27 21:57:57,392][106226] Updated weights for policy 0, policy_version 380894 (0.0008) [2023-12-27 21:57:57,444][106226] Updated weights for policy 0, policy_version 380904 (0.0009) [2023-12-27 21:57:57,594][106225] Updated weights for policy 1, policy_version 381686 (0.0007) [2023-12-27 21:57:57,651][106225] Updated weights for policy 1, policy_version 381696 (0.0006) [2023-12-27 21:57:57,712][106225] Updated weights for policy 1, policy_version 381706 (0.0008) [2023-12-27 21:57:58,145][106226] Updated weights for policy 0, policy_version 380914 (0.0005) [2023-12-27 21:57:58,197][106226] Updated weights for policy 0, policy_version 380924 (0.0006) [2023-12-27 21:57:58,263][106226] Updated weights for policy 0, policy_version 380934 (0.0008) [2023-12-27 21:57:58,398][106225] Updated weights for policy 1, policy_version 381716 (0.0008) [2023-12-27 21:57:58,470][106225] Updated weights for policy 1, policy_version 381726 (0.0008) [2023-12-27 21:57:58,533][106225] Updated weights for policy 1, policy_version 381736 (0.0008) [2023-12-27 21:57:59,089][106226] Updated weights for policy 0, policy_version 380944 (0.0007) [2023-12-27 21:57:59,142][106226] Updated weights for policy 0, policy_version 380954 (0.0007) [2023-12-27 21:57:59,199][106226] Updated weights for policy 0, policy_version 380964 (0.0007) [2023-12-27 21:57:59,295][106225] Updated weights for policy 1, policy_version 381746 (0.0008) [2023-12-27 21:57:59,364][106225] Updated weights for policy 1, policy_version 381756 (0.0008) [2023-12-27 21:57:59,425][106225] Updated weights for policy 1, policy_version 381766 (0.0008) [2023-12-27 21:57:59,476][106225] Updated weights for policy 1, policy_version 381776 (0.0008) [2023-12-27 21:57:59,889][106226] Updated weights for policy 0, policy_version 380974 (0.0010) [2023-12-27 21:57:59,952][106226] Updated weights for policy 0, policy_version 380984 (0.0012) [2023-12-27 21:58:00,013][106226] Updated weights for policy 0, policy_version 380994 (0.0011) [2023-12-27 21:58:00,236][106225] Updated weights for policy 1, policy_version 381786 (0.0010) [2023-12-27 21:58:00,295][106225] Updated weights for policy 1, policy_version 381796 (0.0010) [2023-12-27 21:58:00,359][106225] Updated weights for policy 1, policy_version 381806 (0.0010) [2023-12-27 21:58:00,695][106226] Updated weights for policy 0, policy_version 381004 (0.0010) [2023-12-27 21:58:00,749][106226] Updated weights for policy 0, policy_version 381014 (0.0009) [2023-12-27 21:58:00,798][106226] Updated weights for policy 0, policy_version 381024 (0.0010) [2023-12-27 21:58:01,050][106225] Updated weights for policy 1, policy_version 381816 (0.0010) [2023-12-27 21:58:01,112][106225] Updated weights for policy 1, policy_version 381826 (0.0010) [2023-12-27 21:58:01,170][106225] Updated weights for policy 1, policy_version 381836 (0.0008) [2023-12-27 21:58:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 195346432. Throughput: 0: 9834.7, 1: 10101.3. Samples: 195340092. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:01,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.578')] [2023-12-27 21:58:01,567][106226] Updated weights for policy 0, policy_version 381034 (0.0010) [2023-12-27 21:58:01,629][106226] Updated weights for policy 0, policy_version 381044 (0.0014) [2023-12-27 21:58:01,685][106226] Updated weights for policy 0, policy_version 381054 (0.0011) [2023-12-27 21:58:01,751][106226] Updated weights for policy 0, policy_version 381064 (0.0012) [2023-12-27 21:58:01,885][106225] Updated weights for policy 1, policy_version 381846 (0.0010) [2023-12-27 21:58:01,940][106225] Updated weights for policy 1, policy_version 381856 (0.0010) [2023-12-27 21:58:02,011][106225] Updated weights for policy 1, policy_version 381866 (0.0010) [2023-12-27 21:58:02,487][106226] Updated weights for policy 0, policy_version 381074 (0.0008) [2023-12-27 21:58:02,546][106226] Updated weights for policy 0, policy_version 381084 (0.0008) [2023-12-27 21:58:02,606][106226] Updated weights for policy 0, policy_version 381094 (0.0008) [2023-12-27 21:58:02,765][106225] Updated weights for policy 1, policy_version 381876 (0.0009) [2023-12-27 21:58:02,814][106225] Updated weights for policy 1, policy_version 381886 (0.0010) [2023-12-27 21:58:02,860][106225] Updated weights for policy 1, policy_version 381896 (0.0008) [2023-12-27 21:58:03,198][106226] Updated weights for policy 0, policy_version 381104 (0.0007) [2023-12-27 21:58:03,266][106226] Updated weights for policy 0, policy_version 381114 (0.0006) [2023-12-27 21:58:03,337][106226] Updated weights for policy 0, policy_version 381124 (0.0008) [2023-12-27 21:58:03,509][106225] Updated weights for policy 1, policy_version 381906 (0.0009) [2023-12-27 21:58:03,572][106225] Updated weights for policy 1, policy_version 381916 (0.0007) [2023-12-27 21:58:03,634][106225] Updated weights for policy 1, policy_version 381926 (0.0010) [2023-12-27 21:58:03,695][106225] Updated weights for policy 1, policy_version 381936 (0.0010) [2023-12-27 21:58:04,003][106226] Updated weights for policy 0, policy_version 381134 (0.0009) [2023-12-27 21:58:04,054][106226] Updated weights for policy 0, policy_version 381144 (0.0008) [2023-12-27 21:58:04,115][106226] Updated weights for policy 0, policy_version 381154 (0.0008) [2023-12-27 21:58:04,404][106225] Updated weights for policy 1, policy_version 381946 (0.0011) [2023-12-27 21:58:04,469][106225] Updated weights for policy 1, policy_version 381956 (0.0010) [2023-12-27 21:58:04,533][106225] Updated weights for policy 1, policy_version 381966 (0.0010) [2023-12-27 21:58:04,897][106226] Updated weights for policy 0, policy_version 381164 (0.0008) [2023-12-27 21:58:04,961][106226] Updated weights for policy 0, policy_version 381174 (0.0009) [2023-12-27 21:58:05,017][106226] Updated weights for policy 0, policy_version 381184 (0.0009) [2023-12-27 21:58:05,192][106225] Updated weights for policy 1, policy_version 381976 (0.0007) [2023-12-27 21:58:05,249][106225] Updated weights for policy 1, policy_version 381986 (0.0005) [2023-12-27 21:58:05,311][106225] Updated weights for policy 1, policy_version 381996 (0.0005) [2023-12-27 21:58:05,763][106226] Updated weights for policy 0, policy_version 381194 (0.0008) [2023-12-27 21:58:05,822][106226] Updated weights for policy 0, policy_version 381204 (0.0005) [2023-12-27 21:58:05,879][106226] Updated weights for policy 0, policy_version 381214 (0.0008) [2023-12-27 21:58:05,892][106225] Updated weights for policy 1, policy_version 382006 (0.0006) [2023-12-27 21:58:05,936][106226] Updated weights for policy 0, policy_version 381224 (0.0009) [2023-12-27 21:58:05,947][106225] Updated weights for policy 1, policy_version 382016 (0.0007) [2023-12-27 21:58:06,017][106225] Updated weights for policy 1, policy_version 382026 (0.0008) [2023-12-27 21:58:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 195452928. Throughput: 0: 9826.9, 1: 10158.7. Samples: 195459572. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:06,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.730')] [2023-12-27 21:58:06,671][106226] Updated weights for policy 0, policy_version 381234 (0.0010) [2023-12-27 21:58:06,721][106225] Updated weights for policy 1, policy_version 382036 (0.0007) [2023-12-27 21:58:06,729][106226] Updated weights for policy 0, policy_version 381244 (0.0008) [2023-12-27 21:58:06,783][106225] Updated weights for policy 1, policy_version 382046 (0.0006) [2023-12-27 21:58:06,792][106226] Updated weights for policy 0, policy_version 381254 (0.0010) [2023-12-27 21:58:06,839][106225] Updated weights for policy 1, policy_version 382056 (0.0010) [2023-12-27 21:58:07,442][106226] Updated weights for policy 0, policy_version 381264 (0.0009) [2023-12-27 21:58:07,496][106226] Updated weights for policy 0, policy_version 381274 (0.0008) [2023-12-27 21:58:07,554][106226] Updated weights for policy 0, policy_version 381284 (0.0009) [2023-12-27 21:58:07,593][106225] Updated weights for policy 1, policy_version 382066 (0.0009) [2023-12-27 21:58:07,642][106225] Updated weights for policy 1, policy_version 382076 (0.0008) [2023-12-27 21:58:07,688][106225] Updated weights for policy 1, policy_version 382086 (0.0009) [2023-12-27 21:58:07,746][106225] Updated weights for policy 1, policy_version 382096 (0.0008) [2023-12-27 21:58:08,165][106226] Updated weights for policy 0, policy_version 381294 (0.0007) [2023-12-27 21:58:08,224][106226] Updated weights for policy 0, policy_version 381304 (0.0005) [2023-12-27 21:58:08,292][106226] Updated weights for policy 0, policy_version 381314 (0.0005) [2023-12-27 21:58:08,535][106225] Updated weights for policy 1, policy_version 382106 (0.0007) [2023-12-27 21:58:08,599][106225] Updated weights for policy 1, policy_version 382116 (0.0006) [2023-12-27 21:58:08,666][106225] Updated weights for policy 1, policy_version 382126 (0.0008) [2023-12-27 21:58:08,964][106226] Updated weights for policy 0, policy_version 381324 (0.0006) [2023-12-27 21:58:09,021][106226] Updated weights for policy 0, policy_version 381334 (0.0005) [2023-12-27 21:58:09,090][106226] Updated weights for policy 0, policy_version 381344 (0.0010) [2023-12-27 21:58:09,397][106225] Updated weights for policy 1, policy_version 382136 (0.0008) [2023-12-27 21:58:09,461][106225] Updated weights for policy 1, policy_version 382146 (0.0009) [2023-12-27 21:58:09,530][106225] Updated weights for policy 1, policy_version 382156 (0.0009) [2023-12-27 21:58:09,745][106226] Updated weights for policy 0, policy_version 381354 (0.0010) [2023-12-27 21:58:09,813][106226] Updated weights for policy 0, policy_version 381364 (0.0010) [2023-12-27 21:58:09,880][106226] Updated weights for policy 0, policy_version 381374 (0.0007) [2023-12-27 21:58:09,944][106226] Updated weights for policy 0, policy_version 381384 (0.0009) [2023-12-27 21:58:10,324][106225] Updated weights for policy 1, policy_version 382166 (0.0010) [2023-12-27 21:58:10,382][106225] Updated weights for policy 1, policy_version 382176 (0.0010) [2023-12-27 21:58:10,445][106225] Updated weights for policy 1, policy_version 382186 (0.0011) [2023-12-27 21:58:10,661][106226] Updated weights for policy 0, policy_version 381394 (0.0011) [2023-12-27 21:58:10,726][106226] Updated weights for policy 0, policy_version 381404 (0.0011) [2023-12-27 21:58:10,794][106226] Updated weights for policy 0, policy_version 381414 (0.0009) [2023-12-27 21:58:11,095][106225] Updated weights for policy 1, policy_version 382196 (0.0009) [2023-12-27 21:58:11,169][106225] Updated weights for policy 1, policy_version 382206 (0.0008) [2023-12-27 21:58:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 195543040. Throughput: 0: 9883.3, 1: 10150.2. Samples: 195518828. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:11,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-5.523')] [2023-12-27 21:58:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000381416_97673216.pth... [2023-12-27 21:58:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000380296_97386496.pth [2023-12-27 21:58:11,236][106225] Updated weights for policy 1, policy_version 382216 (0.0006) [2023-12-27 21:58:11,289][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000382224_97878016.pth... [2023-12-27 21:58:11,293][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000381040_97574912.pth [2023-12-27 21:58:11,571][106226] Updated weights for policy 0, policy_version 381424 (0.0008) [2023-12-27 21:58:11,642][106226] Updated weights for policy 0, policy_version 381434 (0.0009) [2023-12-27 21:58:11,705][106226] Updated weights for policy 0, policy_version 381444 (0.0009) [2023-12-27 21:58:11,959][106225] Updated weights for policy 1, policy_version 382226 (0.0007) [2023-12-27 21:58:12,025][106225] Updated weights for policy 1, policy_version 382236 (0.0006) [2023-12-27 21:58:12,087][106225] Updated weights for policy 1, policy_version 382246 (0.0006) [2023-12-27 21:58:12,148][106225] Updated weights for policy 1, policy_version 382256 (0.0006) [2023-12-27 21:58:12,452][106226] Updated weights for policy 0, policy_version 381454 (0.0009) [2023-12-27 21:58:12,513][106226] Updated weights for policy 0, policy_version 381464 (0.0008) [2023-12-27 21:58:12,570][106226] Updated weights for policy 0, policy_version 381474 (0.0009) [2023-12-27 21:58:12,774][106225] Updated weights for policy 1, policy_version 382266 (0.0008) [2023-12-27 21:58:12,837][106225] Updated weights for policy 1, policy_version 382276 (0.0006) [2023-12-27 21:58:12,898][106225] Updated weights for policy 1, policy_version 382286 (0.0006) [2023-12-27 21:58:13,350][106226] Updated weights for policy 0, policy_version 381484 (0.0009) [2023-12-27 21:58:13,398][106226] Updated weights for policy 0, policy_version 381494 (0.0009) [2023-12-27 21:58:13,447][106225] Updated weights for policy 1, policy_version 382296 (0.0007) [2023-12-27 21:58:13,455][106226] Updated weights for policy 0, policy_version 381504 (0.0008) [2023-12-27 21:58:13,502][106225] Updated weights for policy 1, policy_version 382306 (0.0006) [2023-12-27 21:58:13,564][106225] Updated weights for policy 1, policy_version 382316 (0.0005) [2023-12-27 21:58:14,154][106225] Updated weights for policy 1, policy_version 382326 (0.0006) [2023-12-27 21:58:14,203][106225] Updated weights for policy 1, policy_version 382336 (0.0005) [2023-12-27 21:58:14,257][106225] Updated weights for policy 1, policy_version 382346 (0.0006) [2023-12-27 21:58:14,267][106226] Updated weights for policy 0, policy_version 381514 (0.0008) [2023-12-27 21:58:14,325][106226] Updated weights for policy 0, policy_version 381524 (0.0008) [2023-12-27 21:58:14,388][106226] Updated weights for policy 0, policy_version 381534 (0.0009) [2023-12-27 21:58:14,436][106226] Updated weights for policy 0, policy_version 381544 (0.0008) [2023-12-27 21:58:14,927][106225] Updated weights for policy 1, policy_version 382356 (0.0007) [2023-12-27 21:58:14,995][106225] Updated weights for policy 1, policy_version 382366 (0.0006) [2023-12-27 21:58:15,062][106225] Updated weights for policy 1, policy_version 382376 (0.0006) [2023-12-27 21:58:15,218][106226] Updated weights for policy 0, policy_version 381554 (0.0006) [2023-12-27 21:58:15,287][106226] Updated weights for policy 0, policy_version 381564 (0.0006) [2023-12-27 21:58:15,350][106226] Updated weights for policy 0, policy_version 381574 (0.0007) [2023-12-27 21:58:15,679][106225] Updated weights for policy 1, policy_version 382386 (0.0006) [2023-12-27 21:58:15,744][106225] Updated weights for policy 1, policy_version 382396 (0.0005) [2023-12-27 21:58:15,807][106225] Updated weights for policy 1, policy_version 382406 (0.0008) [2023-12-27 21:58:15,871][106225] Updated weights for policy 1, policy_version 382416 (0.0005) [2023-12-27 21:58:16,047][106226] Updated weights for policy 0, policy_version 381584 (0.0010) [2023-12-27 21:58:16,107][106226] Updated weights for policy 0, policy_version 381594 (0.0009) [2023-12-27 21:58:16,170][106226] Updated weights for policy 0, policy_version 381604 (0.0008) [2023-12-27 21:58:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 195641344. Throughput: 0: 9722.7, 1: 10093.1. Samples: 195635772. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:16,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-5.866')] [2023-12-27 21:58:16,388][106225] Updated weights for policy 1, policy_version 382426 (0.0008) [2023-12-27 21:58:16,437][106225] Updated weights for policy 1, policy_version 382436 (0.0008) [2023-12-27 21:58:16,488][106225] Updated weights for policy 1, policy_version 382446 (0.0007) [2023-12-27 21:58:16,882][106226] Updated weights for policy 0, policy_version 381614 (0.0009) [2023-12-27 21:58:16,934][106226] Updated weights for policy 0, policy_version 381624 (0.0010) [2023-12-27 21:58:16,991][106226] Updated weights for policy 0, policy_version 381634 (0.0010) [2023-12-27 21:58:17,182][106225] Updated weights for policy 1, policy_version 382456 (0.0007) [2023-12-27 21:58:17,240][106225] Updated weights for policy 1, policy_version 382466 (0.0008) [2023-12-27 21:58:17,296][106225] Updated weights for policy 1, policy_version 382476 (0.0008) [2023-12-27 21:58:17,709][106226] Updated weights for policy 0, policy_version 381644 (0.0010) [2023-12-27 21:58:17,762][106226] Updated weights for policy 0, policy_version 381654 (0.0011) [2023-12-27 21:58:17,815][106226] Updated weights for policy 0, policy_version 381664 (0.0010) [2023-12-27 21:58:18,025][106225] Updated weights for policy 1, policy_version 382486 (0.0008) [2023-12-27 21:58:18,079][106225] Updated weights for policy 1, policy_version 382496 (0.0008) [2023-12-27 21:58:18,145][106225] Updated weights for policy 1, policy_version 382506 (0.0008) [2023-12-27 21:58:18,562][106226] Updated weights for policy 0, policy_version 381674 (0.0011) [2023-12-27 21:58:18,616][106226] Updated weights for policy 0, policy_version 381684 (0.0010) [2023-12-27 21:58:18,684][106226] Updated weights for policy 0, policy_version 381694 (0.0011) [2023-12-27 21:58:18,745][106226] Updated weights for policy 0, policy_version 381704 (0.0011) [2023-12-27 21:58:18,878][106225] Updated weights for policy 1, policy_version 382516 (0.0007) [2023-12-27 21:58:18,938][106225] Updated weights for policy 1, policy_version 382526 (0.0005) [2023-12-27 21:58:18,986][106225] Updated weights for policy 1, policy_version 382536 (0.0005) [2023-12-27 21:58:19,427][106226] Updated weights for policy 0, policy_version 381714 (0.0011) [2023-12-27 21:58:19,490][106226] Updated weights for policy 0, policy_version 381724 (0.0011) [2023-12-27 21:58:19,561][106226] Updated weights for policy 0, policy_version 381734 (0.0011) [2023-12-27 21:58:19,640][106225] Updated weights for policy 1, policy_version 382546 (0.0006) [2023-12-27 21:58:19,707][106225] Updated weights for policy 1, policy_version 382556 (0.0008) [2023-12-27 21:58:19,768][106225] Updated weights for policy 1, policy_version 382566 (0.0008) [2023-12-27 21:58:19,831][106225] Updated weights for policy 1, policy_version 382576 (0.0008) [2023-12-27 21:58:20,298][106226] Updated weights for policy 0, policy_version 381744 (0.0011) [2023-12-27 21:58:20,366][106226] Updated weights for policy 0, policy_version 381754 (0.0011) [2023-12-27 21:58:20,432][106226] Updated weights for policy 0, policy_version 381764 (0.0011) [2023-12-27 21:58:20,497][106225] Updated weights for policy 1, policy_version 382586 (0.0007) [2023-12-27 21:58:20,564][106225] Updated weights for policy 1, policy_version 382596 (0.0008) [2023-12-27 21:58:20,634][106225] Updated weights for policy 1, policy_version 382606 (0.0008) [2023-12-27 21:58:21,153][106226] Updated weights for policy 0, policy_version 381774 (0.0011) [2023-12-27 21:58:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 195739648. Throughput: 0: 9689.0, 1: 10136.4. Samples: 195755008. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:21,175][105115] Avg episode reward: [(0, '-5.065'), (1, '-5.556')] [2023-12-27 21:58:21,215][106226] Updated weights for policy 0, policy_version 381784 (0.0011) [2023-12-27 21:58:21,283][106226] Updated weights for policy 0, policy_version 381794 (0.0011) [2023-12-27 21:58:21,365][106225] Updated weights for policy 1, policy_version 382616 (0.0008) [2023-12-27 21:58:21,433][106225] Updated weights for policy 1, policy_version 382626 (0.0008) [2023-12-27 21:58:21,497][106225] Updated weights for policy 1, policy_version 382636 (0.0006) [2023-12-27 21:58:22,048][106226] Updated weights for policy 0, policy_version 381804 (0.0008) [2023-12-27 21:58:22,107][106226] Updated weights for policy 0, policy_version 381814 (0.0009) [2023-12-27 21:58:22,131][106225] Updated weights for policy 1, policy_version 382646 (0.0006) [2023-12-27 21:58:22,172][106226] Updated weights for policy 0, policy_version 381824 (0.0006) [2023-12-27 21:58:22,189][106225] Updated weights for policy 1, policy_version 382656 (0.0008) [2023-12-27 21:58:22,250][106225] Updated weights for policy 1, policy_version 382666 (0.0008) [2023-12-27 21:58:22,904][106226] Updated weights for policy 0, policy_version 381834 (0.0006) [2023-12-27 21:58:22,949][106226] Updated weights for policy 0, policy_version 381844 (0.0008) [2023-12-27 21:58:23,000][106226] Updated weights for policy 0, policy_version 381854 (0.0008) [2023-12-27 21:58:23,006][106225] Updated weights for policy 1, policy_version 382676 (0.0006) [2023-12-27 21:58:23,053][106226] Updated weights for policy 0, policy_version 381864 (0.0008) [2023-12-27 21:58:23,062][106225] Updated weights for policy 1, policy_version 382686 (0.0008) [2023-12-27 21:58:23,111][106225] Updated weights for policy 1, policy_version 382696 (0.0007) [2023-12-27 21:58:23,786][106225] Updated weights for policy 1, policy_version 382706 (0.0008) [2023-12-27 21:58:23,829][106226] Updated weights for policy 0, policy_version 381874 (0.0008) [2023-12-27 21:58:23,836][106225] Updated weights for policy 1, policy_version 382716 (0.0006) [2023-12-27 21:58:23,874][106226] Updated weights for policy 0, policy_version 381884 (0.0008) [2023-12-27 21:58:23,885][106225] Updated weights for policy 1, policy_version 382726 (0.0009) [2023-12-27 21:58:23,920][106226] Updated weights for policy 0, policy_version 381894 (0.0006) [2023-12-27 21:58:23,932][106225] Updated weights for policy 1, policy_version 382736 (0.0005) [2023-12-27 21:58:24,608][106226] Updated weights for policy 0, policy_version 381904 (0.0006) [2023-12-27 21:58:24,677][106226] Updated weights for policy 0, policy_version 381914 (0.0006) [2023-12-27 21:58:24,706][106225] Updated weights for policy 1, policy_version 382746 (0.0009) [2023-12-27 21:58:24,738][106226] Updated weights for policy 0, policy_version 381924 (0.0007) [2023-12-27 21:58:24,764][106225] Updated weights for policy 1, policy_version 382756 (0.0007) [2023-12-27 21:58:24,816][106225] Updated weights for policy 1, policy_version 382766 (0.0007) [2023-12-27 21:58:25,313][106226] Updated weights for policy 0, policy_version 381934 (0.0007) [2023-12-27 21:58:25,372][106226] Updated weights for policy 0, policy_version 381944 (0.0005) [2023-12-27 21:58:25,441][106226] Updated weights for policy 0, policy_version 381954 (0.0006) [2023-12-27 21:58:25,480][106225] Updated weights for policy 1, policy_version 382776 (0.0007) [2023-12-27 21:58:25,528][106225] Updated weights for policy 1, policy_version 382786 (0.0009) [2023-12-27 21:58:25,578][106225] Updated weights for policy 1, policy_version 382796 (0.0005) [2023-12-27 21:58:26,068][106226] Updated weights for policy 0, policy_version 381964 (0.0005) [2023-12-27 21:58:26,131][106226] Updated weights for policy 0, policy_version 381974 (0.0006) [2023-12-27 21:58:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 195837952. Throughput: 0: 9612.3, 1: 10124.0. Samples: 195811956. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:26,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.509')] [2023-12-27 21:58:26,188][106225] Updated weights for policy 1, policy_version 382806 (0.0006) [2023-12-27 21:58:26,195][106226] Updated weights for policy 0, policy_version 381984 (0.0009) [2023-12-27 21:58:26,245][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000381992_97820672.pth... [2023-12-27 21:58:26,247][106225] Updated weights for policy 1, policy_version 382816 (0.0005) [2023-12-27 21:58:26,250][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000380840_97525760.pth [2023-12-27 21:58:26,313][106225] Updated weights for policy 1, policy_version 382826 (0.0005) [2023-12-27 21:58:26,353][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000382832_98033664.pth... [2023-12-27 21:58:26,358][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000381648_97730560.pth [2023-12-27 21:58:26,782][106226] Updated weights for policy 0, policy_version 381994 (0.0007) [2023-12-27 21:58:26,835][106226] Updated weights for policy 0, policy_version 382004 (0.0010) [2023-12-27 21:58:26,864][106225] Updated weights for policy 1, policy_version 382836 (0.0006) [2023-12-27 21:58:26,891][106226] Updated weights for policy 0, policy_version 382014 (0.0011) [2023-12-27 21:58:26,914][106225] Updated weights for policy 1, policy_version 382846 (0.0008) [2023-12-27 21:58:26,945][106226] Updated weights for policy 0, policy_version 382024 (0.0011) [2023-12-27 21:58:26,974][106225] Updated weights for policy 1, policy_version 382856 (0.0009) [2023-12-27 21:58:27,660][106226] Updated weights for policy 0, policy_version 382034 (0.0010) [2023-12-27 21:58:27,664][106225] Updated weights for policy 1, policy_version 382866 (0.0007) [2023-12-27 21:58:27,710][106225] Updated weights for policy 1, policy_version 382876 (0.0005) [2023-12-27 21:58:27,721][106226] Updated weights for policy 0, policy_version 382044 (0.0011) [2023-12-27 21:58:27,772][106225] Updated weights for policy 1, policy_version 382886 (0.0007) [2023-12-27 21:58:27,778][106226] Updated weights for policy 0, policy_version 382054 (0.0007) [2023-12-27 21:58:27,819][106225] Updated weights for policy 1, policy_version 382896 (0.0007) [2023-12-27 21:58:28,393][106226] Updated weights for policy 0, policy_version 382064 (0.0009) [2023-12-27 21:58:28,459][106226] Updated weights for policy 0, policy_version 382074 (0.0009) [2023-12-27 21:58:28,519][106226] Updated weights for policy 0, policy_version 382084 (0.0008) [2023-12-27 21:58:28,609][106225] Updated weights for policy 1, policy_version 382906 (0.0008) [2023-12-27 21:58:28,666][106225] Updated weights for policy 1, policy_version 382916 (0.0008) [2023-12-27 21:58:28,720][106225] Updated weights for policy 1, policy_version 382926 (0.0006) [2023-12-27 21:58:29,259][106226] Updated weights for policy 0, policy_version 382094 (0.0008) [2023-12-27 21:58:29,316][106226] Updated weights for policy 0, policy_version 382104 (0.0009) [2023-12-27 21:58:29,386][106226] Updated weights for policy 0, policy_version 382114 (0.0008) [2023-12-27 21:58:29,426][106225] Updated weights for policy 1, policy_version 382936 (0.0006) [2023-12-27 21:58:29,487][106225] Updated weights for policy 1, policy_version 382946 (0.0005) [2023-12-27 21:58:29,539][106225] Updated weights for policy 1, policy_version 382956 (0.0005) [2023-12-27 21:58:30,152][106225] Updated weights for policy 1, policy_version 382966 (0.0008) [2023-12-27 21:58:30,182][106226] Updated weights for policy 0, policy_version 382124 (0.0009) [2023-12-27 21:58:30,209][106225] Updated weights for policy 1, policy_version 382976 (0.0010) [2023-12-27 21:58:30,234][106226] Updated weights for policy 0, policy_version 382134 (0.0006) [2023-12-27 21:58:30,262][106225] Updated weights for policy 1, policy_version 382986 (0.0010) [2023-12-27 21:58:30,293][106226] Updated weights for policy 0, policy_version 382144 (0.0006) [2023-12-27 21:58:30,972][106225] Updated weights for policy 1, policy_version 382996 (0.0010) [2023-12-27 21:58:30,983][106226] Updated weights for policy 0, policy_version 382154 (0.0008) [2023-12-27 21:58:31,039][106225] Updated weights for policy 1, policy_version 383006 (0.0007) [2023-12-27 21:58:31,045][106226] Updated weights for policy 0, policy_version 382164 (0.0008) [2023-12-27 21:58:31,100][106225] Updated weights for policy 1, policy_version 383016 (0.0008) [2023-12-27 21:58:31,110][106226] Updated weights for policy 0, policy_version 382174 (0.0007) [2023-12-27 21:58:31,174][106226] Updated weights for policy 0, policy_version 382184 (0.0007) [2023-12-27 21:58:31,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 195952640. Throughput: 0: 9680.9, 1: 10129.4. Samples: 195935844. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:31,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-6.034')] [2023-12-27 21:58:31,770][106225] Updated weights for policy 1, policy_version 383026 (0.0009) [2023-12-27 21:58:31,829][106225] Updated weights for policy 1, policy_version 383036 (0.0009) [2023-12-27 21:58:31,876][106226] Updated weights for policy 0, policy_version 382194 (0.0008) [2023-12-27 21:58:31,885][106225] Updated weights for policy 1, policy_version 383046 (0.0010) [2023-12-27 21:58:31,928][106226] Updated weights for policy 0, policy_version 382204 (0.0008) [2023-12-27 21:58:31,943][106225] Updated weights for policy 1, policy_version 383056 (0.0010) [2023-12-27 21:58:31,990][106226] Updated weights for policy 0, policy_version 382214 (0.0008) [2023-12-27 21:58:32,640][106225] Updated weights for policy 1, policy_version 383066 (0.0006) [2023-12-27 21:58:32,697][106225] Updated weights for policy 1, policy_version 383076 (0.0010) [2023-12-27 21:58:32,750][106226] Updated weights for policy 0, policy_version 382224 (0.0007) [2023-12-27 21:58:32,755][106225] Updated weights for policy 1, policy_version 383086 (0.0010) [2023-12-27 21:58:32,803][106226] Updated weights for policy 0, policy_version 382234 (0.0008) [2023-12-27 21:58:32,852][106226] Updated weights for policy 0, policy_version 382244 (0.0008) [2023-12-27 21:58:33,379][106225] Updated weights for policy 1, policy_version 383096 (0.0010) [2023-12-27 21:58:33,433][106225] Updated weights for policy 1, policy_version 383106 (0.0007) [2023-12-27 21:58:33,500][106225] Updated weights for policy 1, policy_version 383116 (0.0007) [2023-12-27 21:58:33,586][106226] Updated weights for policy 0, policy_version 382254 (0.0007) [2023-12-27 21:58:33,648][106226] Updated weights for policy 0, policy_version 382264 (0.0005) [2023-12-27 21:58:33,720][106226] Updated weights for policy 0, policy_version 382274 (0.0010) [2023-12-27 21:58:34,138][106225] Updated weights for policy 1, policy_version 383126 (0.0010) [2023-12-27 21:58:34,202][106225] Updated weights for policy 1, policy_version 383136 (0.0009) [2023-12-27 21:58:34,260][106225] Updated weights for policy 1, policy_version 383146 (0.0007) [2023-12-27 21:58:34,338][106226] Updated weights for policy 0, policy_version 382284 (0.0008) [2023-12-27 21:58:34,408][106226] Updated weights for policy 0, policy_version 382294 (0.0005) [2023-12-27 21:58:34,474][106226] Updated weights for policy 0, policy_version 382304 (0.0006) [2023-12-27 21:58:35,014][106225] Updated weights for policy 1, policy_version 383156 (0.0009) [2023-12-27 21:58:35,062][106225] Updated weights for policy 1, policy_version 383166 (0.0006) [2023-12-27 21:58:35,101][106226] Updated weights for policy 0, policy_version 382314 (0.0007) [2023-12-27 21:58:35,113][106225] Updated weights for policy 1, policy_version 383176 (0.0005) [2023-12-27 21:58:35,148][106226] Updated weights for policy 0, policy_version 382324 (0.0010) [2023-12-27 21:58:35,197][106226] Updated weights for policy 0, policy_version 382334 (0.0010) [2023-12-27 21:58:35,248][106226] Updated weights for policy 0, policy_version 382344 (0.0010) [2023-12-27 21:58:35,719][106225] Updated weights for policy 1, policy_version 383186 (0.0005) [2023-12-27 21:58:35,780][106225] Updated weights for policy 1, policy_version 383196 (0.0008) [2023-12-27 21:58:35,845][106225] Updated weights for policy 1, policy_version 383206 (0.0010) [2023-12-27 21:58:35,906][106225] Updated weights for policy 1, policy_version 383216 (0.0008) [2023-12-27 21:58:35,934][106226] Updated weights for policy 0, policy_version 382354 (0.0011) [2023-12-27 21:58:36,002][106226] Updated weights for policy 0, policy_version 382364 (0.0010) [2023-12-27 21:58:36,059][106226] Updated weights for policy 0, policy_version 382374 (0.0010) [2023-12-27 21:58:36,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 196050944. Throughput: 0: 9707.1, 1: 10158.7. Samples: 196056580. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:36,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-5.723')] [2023-12-27 21:58:36,591][106225] Updated weights for policy 1, policy_version 383226 (0.0008) [2023-12-27 21:58:36,654][106225] Updated weights for policy 1, policy_version 383236 (0.0009) [2023-12-27 21:58:36,724][106225] Updated weights for policy 1, policy_version 383246 (0.0010) [2023-12-27 21:58:36,790][106226] Updated weights for policy 0, policy_version 382384 (0.0008) [2023-12-27 21:58:36,859][106226] Updated weights for policy 0, policy_version 382394 (0.0011) [2023-12-27 21:58:36,922][106226] Updated weights for policy 0, policy_version 382404 (0.0008) [2023-12-27 21:58:37,453][106225] Updated weights for policy 1, policy_version 383256 (0.0006) [2023-12-27 21:58:37,514][106225] Updated weights for policy 1, policy_version 383266 (0.0005) [2023-12-27 21:58:37,584][106225] Updated weights for policy 1, policy_version 383276 (0.0005) [2023-12-27 21:58:37,601][106226] Updated weights for policy 0, policy_version 382414 (0.0009) [2023-12-27 21:58:37,658][106226] Updated weights for policy 0, policy_version 382424 (0.0005) [2023-12-27 21:58:37,722][106226] Updated weights for policy 0, policy_version 382434 (0.0009) [2023-12-27 21:58:38,145][106225] Updated weights for policy 1, policy_version 383286 (0.0008) [2023-12-27 21:58:38,195][106225] Updated weights for policy 1, policy_version 383296 (0.0010) [2023-12-27 21:58:38,245][106225] Updated weights for policy 1, policy_version 383306 (0.0010) [2023-12-27 21:58:38,329][106226] Updated weights for policy 0, policy_version 382444 (0.0010) [2023-12-27 21:58:38,393][106226] Updated weights for policy 0, policy_version 382454 (0.0010) [2023-12-27 21:58:38,448][106226] Updated weights for policy 0, policy_version 382464 (0.0009) [2023-12-27 21:58:39,012][106225] Updated weights for policy 1, policy_version 383316 (0.0009) [2023-12-27 21:58:39,079][106225] Updated weights for policy 1, policy_version 383326 (0.0007) [2023-12-27 21:58:39,101][106226] Updated weights for policy 0, policy_version 382474 (0.0010) [2023-12-27 21:58:39,142][106225] Updated weights for policy 1, policy_version 383336 (0.0008) [2023-12-27 21:58:39,153][106226] Updated weights for policy 0, policy_version 382484 (0.0007) [2023-12-27 21:58:39,205][106226] Updated weights for policy 0, policy_version 382494 (0.0007) [2023-12-27 21:58:39,273][106226] Updated weights for policy 0, policy_version 382504 (0.0008) [2023-12-27 21:58:39,926][106225] Updated weights for policy 1, policy_version 383346 (0.0008) [2023-12-27 21:58:39,992][106225] Updated weights for policy 1, policy_version 383356 (0.0008) [2023-12-27 21:58:40,057][106225] Updated weights for policy 1, policy_version 383366 (0.0007) [2023-12-27 21:58:40,063][106226] Updated weights for policy 0, policy_version 382514 (0.0010) [2023-12-27 21:58:40,116][106225] Updated weights for policy 1, policy_version 383376 (0.0006) [2023-12-27 21:58:40,128][106226] Updated weights for policy 0, policy_version 382524 (0.0009) [2023-12-27 21:58:40,190][106226] Updated weights for policy 0, policy_version 382534 (0.0011) [2023-12-27 21:58:40,839][106225] Updated weights for policy 1, policy_version 383386 (0.0008) [2023-12-27 21:58:40,887][106226] Updated weights for policy 0, policy_version 382544 (0.0008) [2023-12-27 21:58:40,899][106225] Updated weights for policy 1, policy_version 383396 (0.0006) [2023-12-27 21:58:40,941][106226] Updated weights for policy 0, policy_version 382554 (0.0006) [2023-12-27 21:58:40,953][106225] Updated weights for policy 1, policy_version 383406 (0.0006) [2023-12-27 21:58:40,999][106226] Updated weights for policy 0, policy_version 382564 (0.0006) [2023-12-27 21:58:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 196149248. Throughput: 0: 9774.0, 1: 10179.5. Samples: 196117332. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:41,175][105115] Avg episode reward: [(0, '-5.158'), (1, '-5.413')] [2023-12-27 21:58:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000383408_98181120.pth... [2023-12-27 21:58:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000382568_97968128.pth... [2023-12-27 21:58:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000382224_97878016.pth [2023-12-27 21:58:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000381416_97673216.pth [2023-12-27 21:58:41,736][106225] Updated weights for policy 1, policy_version 383416 (0.0009) [2023-12-27 21:58:41,808][106225] Updated weights for policy 1, policy_version 383426 (0.0009) [2023-12-27 21:58:41,834][106226] Updated weights for policy 0, policy_version 382574 (0.0006) [2023-12-27 21:58:41,871][106225] Updated weights for policy 1, policy_version 383436 (0.0010) [2023-12-27 21:58:41,898][106226] Updated weights for policy 0, policy_version 382584 (0.0006) [2023-12-27 21:58:41,962][106226] Updated weights for policy 0, policy_version 382594 (0.0007) [2023-12-27 21:58:42,589][106225] Updated weights for policy 1, policy_version 383446 (0.0010) [2023-12-27 21:58:42,646][106226] Updated weights for policy 0, policy_version 382604 (0.0007) [2023-12-27 21:58:42,647][106225] Updated weights for policy 1, policy_version 383456 (0.0008) [2023-12-27 21:58:42,702][106225] Updated weights for policy 1, policy_version 383466 (0.0008) [2023-12-27 21:58:42,708][106226] Updated weights for policy 0, policy_version 382614 (0.0008) [2023-12-27 21:58:42,775][106226] Updated weights for policy 0, policy_version 382624 (0.0009) [2023-12-27 21:58:43,388][106226] Updated weights for policy 0, policy_version 382634 (0.0008) [2023-12-27 21:58:43,418][106225] Updated weights for policy 1, policy_version 383476 (0.0009) [2023-12-27 21:58:43,443][106226] Updated weights for policy 0, policy_version 382644 (0.0008) [2023-12-27 21:58:43,477][106225] Updated weights for policy 1, policy_version 383486 (0.0010) [2023-12-27 21:58:43,492][106226] Updated weights for policy 0, policy_version 382654 (0.0006) [2023-12-27 21:58:43,537][106225] Updated weights for policy 1, policy_version 383496 (0.0010) [2023-12-27 21:58:43,543][106226] Updated weights for policy 0, policy_version 382664 (0.0006) [2023-12-27 21:58:44,213][106225] Updated weights for policy 1, policy_version 383506 (0.0010) [2023-12-27 21:58:44,269][106225] Updated weights for policy 1, policy_version 383516 (0.0006) [2023-12-27 21:58:44,285][106226] Updated weights for policy 0, policy_version 382674 (0.0008) [2023-12-27 21:58:44,327][106225] Updated weights for policy 1, policy_version 383526 (0.0006) [2023-12-27 21:58:44,342][106226] Updated weights for policy 0, policy_version 382684 (0.0007) [2023-12-27 21:58:44,383][106225] Updated weights for policy 1, policy_version 383536 (0.0006) [2023-12-27 21:58:44,397][106226] Updated weights for policy 0, policy_version 382694 (0.0006) [2023-12-27 21:58:45,060][106225] Updated weights for policy 1, policy_version 383546 (0.0008) [2023-12-27 21:58:45,118][106225] Updated weights for policy 1, policy_version 383556 (0.0008) [2023-12-27 21:58:45,143][106226] Updated weights for policy 0, policy_version 382704 (0.0008) [2023-12-27 21:58:45,177][106225] Updated weights for policy 1, policy_version 383566 (0.0008) [2023-12-27 21:58:45,204][106226] Updated weights for policy 0, policy_version 382714 (0.0007) [2023-12-27 21:58:45,273][106226] Updated weights for policy 0, policy_version 382724 (0.0008) [2023-12-27 21:58:45,883][106225] Updated weights for policy 1, policy_version 383576 (0.0006) [2023-12-27 21:58:45,942][106225] Updated weights for policy 1, policy_version 383586 (0.0007) [2023-12-27 21:58:46,000][106225] Updated weights for policy 1, policy_version 383596 (0.0008) [2023-12-27 21:58:46,040][106226] Updated weights for policy 0, policy_version 382734 (0.0008) [2023-12-27 21:58:46,093][106226] Updated weights for policy 0, policy_version 382744 (0.0008) [2023-12-27 21:58:46,155][106226] Updated weights for policy 0, policy_version 382754 (0.0009) [2023-12-27 21:58:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 196239360. Throughput: 0: 9794.7, 1: 10041.8. Samples: 196232732. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:46,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.572')] [2023-12-27 21:58:46,606][106225] Updated weights for policy 1, policy_version 383606 (0.0008) [2023-12-27 21:58:46,673][106225] Updated weights for policy 1, policy_version 383616 (0.0006) [2023-12-27 21:58:46,735][106225] Updated weights for policy 1, policy_version 383626 (0.0005) [2023-12-27 21:58:46,872][106226] Updated weights for policy 0, policy_version 382764 (0.0008) [2023-12-27 21:58:46,926][106226] Updated weights for policy 0, policy_version 382774 (0.0009) [2023-12-27 21:58:46,974][106226] Updated weights for policy 0, policy_version 382784 (0.0008) [2023-12-27 21:58:47,372][106225] Updated weights for policy 1, policy_version 383636 (0.0006) [2023-12-27 21:58:47,430][106225] Updated weights for policy 1, policy_version 383646 (0.0008) [2023-12-27 21:58:47,482][106225] Updated weights for policy 1, policy_version 383656 (0.0009) [2023-12-27 21:58:47,610][106226] Updated weights for policy 0, policy_version 382794 (0.0008) [2023-12-27 21:58:47,663][106226] Updated weights for policy 0, policy_version 382804 (0.0010) [2023-12-27 21:58:47,714][106226] Updated weights for policy 0, policy_version 382814 (0.0010) [2023-12-27 21:58:47,785][106226] Updated weights for policy 0, policy_version 382824 (0.0009) [2023-12-27 21:58:48,089][106225] Updated weights for policy 1, policy_version 383666 (0.0008) [2023-12-27 21:58:48,143][106225] Updated weights for policy 1, policy_version 383676 (0.0008) [2023-12-27 21:58:48,189][106225] Updated weights for policy 1, policy_version 383686 (0.0008) [2023-12-27 21:58:48,238][106225] Updated weights for policy 1, policy_version 383696 (0.0007) [2023-12-27 21:58:48,485][106226] Updated weights for policy 0, policy_version 382834 (0.0011) [2023-12-27 21:58:48,549][106226] Updated weights for policy 0, policy_version 382844 (0.0010) [2023-12-27 21:58:48,610][106226] Updated weights for policy 0, policy_version 382854 (0.0007) [2023-12-27 21:58:48,918][106225] Updated weights for policy 1, policy_version 383706 (0.0005) [2023-12-27 21:58:48,986][106225] Updated weights for policy 1, policy_version 383716 (0.0008) [2023-12-27 21:58:49,051][106225] Updated weights for policy 1, policy_version 383726 (0.0010) [2023-12-27 21:58:49,289][106226] Updated weights for policy 0, policy_version 382864 (0.0011) [2023-12-27 21:58:49,352][106226] Updated weights for policy 0, policy_version 382874 (0.0009) [2023-12-27 21:58:49,418][106226] Updated weights for policy 0, policy_version 382884 (0.0011) [2023-12-27 21:58:49,759][106225] Updated weights for policy 1, policy_version 383736 (0.0008) [2023-12-27 21:58:49,815][106225] Updated weights for policy 1, policy_version 383746 (0.0009) [2023-12-27 21:58:49,884][106225] Updated weights for policy 1, policy_version 383756 (0.0007) [2023-12-27 21:58:50,147][106226] Updated weights for policy 0, policy_version 382894 (0.0010) [2023-12-27 21:58:50,201][106226] Updated weights for policy 0, policy_version 382904 (0.0009) [2023-12-27 21:58:50,248][106226] Updated weights for policy 0, policy_version 382914 (0.0009) [2023-12-27 21:58:50,647][106225] Updated weights for policy 1, policy_version 383766 (0.0009) [2023-12-27 21:58:50,709][106225] Updated weights for policy 1, policy_version 383776 (0.0009) [2023-12-27 21:58:50,774][106225] Updated weights for policy 1, policy_version 383786 (0.0008) [2023-12-27 21:58:51,045][106226] Updated weights for policy 0, policy_version 382924 (0.0009) [2023-12-27 21:58:51,114][106226] Updated weights for policy 0, policy_version 382934 (0.0008) [2023-12-27 21:58:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 196337664. Throughput: 0: 9770.4, 1: 10051.7. Samples: 196351568. Policy #0 lag: (min: 4.0, avg: 4.1, max: 11.0) [2023-12-27 21:58:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.693')] [2023-12-27 21:58:51,181][106226] Updated weights for policy 0, policy_version 382944 (0.0008) [2023-12-27 21:58:51,554][106225] Updated weights for policy 1, policy_version 383796 (0.0009) [2023-12-27 21:58:51,607][106225] Updated weights for policy 1, policy_version 383806 (0.0009) [2023-12-27 21:58:51,667][106225] Updated weights for policy 1, policy_version 383816 (0.0009) [2023-12-27 21:58:52,016][106226] Updated weights for policy 0, policy_version 382954 (0.0009) [2023-12-27 21:58:52,073][106226] Updated weights for policy 0, policy_version 382964 (0.0011) [2023-12-27 21:58:52,133][106226] Updated weights for policy 0, policy_version 382974 (0.0011) [2023-12-27 21:58:52,196][106226] Updated weights for policy 0, policy_version 382984 (0.0010) [2023-12-27 21:58:52,476][106225] Updated weights for policy 1, policy_version 383826 (0.0009) [2023-12-27 21:58:52,523][106225] Updated weights for policy 1, policy_version 383836 (0.0008) [2023-12-27 21:58:52,571][106225] Updated weights for policy 1, policy_version 383846 (0.0008) [2023-12-27 21:58:52,615][106225] Updated weights for policy 1, policy_version 383856 (0.0008) [2023-12-27 21:58:52,969][106226] Updated weights for policy 0, policy_version 382994 (0.0011) [2023-12-27 21:58:53,032][106226] Updated weights for policy 0, policy_version 383004 (0.0010) [2023-12-27 21:58:53,093][106226] Updated weights for policy 0, policy_version 383014 (0.0010) [2023-12-27 21:58:53,329][106225] Updated weights for policy 1, policy_version 383866 (0.0007) [2023-12-27 21:58:53,389][106225] Updated weights for policy 1, policy_version 383876 (0.0008) [2023-12-27 21:58:53,454][106225] Updated weights for policy 1, policy_version 383886 (0.0005) [2023-12-27 21:58:53,685][106226] Updated weights for policy 0, policy_version 383024 (0.0006) [2023-12-27 21:58:53,734][106226] Updated weights for policy 0, policy_version 383034 (0.0005) [2023-12-27 21:58:53,780][106226] Updated weights for policy 0, policy_version 383044 (0.0008) [2023-12-27 21:58:54,123][106225] Updated weights for policy 1, policy_version 383896 (0.0008) [2023-12-27 21:58:54,180][106225] Updated weights for policy 1, policy_version 383906 (0.0008) [2023-12-27 21:58:54,239][106225] Updated weights for policy 1, policy_version 383916 (0.0006) [2023-12-27 21:58:54,393][106226] Updated weights for policy 0, policy_version 383054 (0.0005) [2023-12-27 21:58:54,460][106226] Updated weights for policy 0, policy_version 383064 (0.0006) [2023-12-27 21:58:54,522][106226] Updated weights for policy 0, policy_version 383074 (0.0008) [2023-12-27 21:58:54,958][106225] Updated weights for policy 1, policy_version 383926 (0.0007) [2023-12-27 21:58:55,018][106225] Updated weights for policy 1, policy_version 383936 (0.0009) [2023-12-27 21:58:55,080][106225] Updated weights for policy 1, policy_version 383946 (0.0009) [2023-12-27 21:58:55,189][106226] Updated weights for policy 0, policy_version 383084 (0.0008) [2023-12-27 21:58:55,251][106226] Updated weights for policy 0, policy_version 383094 (0.0009) [2023-12-27 21:58:55,313][106226] Updated weights for policy 0, policy_version 383104 (0.0005) [2023-12-27 21:58:55,742][106225] Updated weights for policy 1, policy_version 383956 (0.0007) [2023-12-27 21:58:55,790][106225] Updated weights for policy 1, policy_version 383966 (0.0005) [2023-12-27 21:58:55,846][106225] Updated weights for policy 1, policy_version 383976 (0.0005) [2023-12-27 21:58:56,018][106226] Updated weights for policy 0, policy_version 383114 (0.0006) [2023-12-27 21:58:56,082][106226] Updated weights for policy 0, policy_version 383124 (0.0009) [2023-12-27 21:58:56,145][106226] Updated weights for policy 0, policy_version 383134 (0.0008) [2023-12-27 21:58:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 196435968. Throughput: 0: 9737.9, 1: 10061.5. Samples: 196409800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:58:56,175][105115] Avg episode reward: [(0, '-5.179'), (1, '-5.957')] [2023-12-27 21:58:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000383984_98328576.pth... [2023-12-27 21:58:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000382832_98033664.pth [2023-12-27 21:58:56,201][106226] Updated weights for policy 0, policy_version 383144 (0.0008) [2023-12-27 21:58:56,201][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000383144_98115584.pth... [2023-12-27 21:58:56,205][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000381992_97820672.pth [2023-12-27 21:58:56,495][106225] Updated weights for policy 1, policy_version 383986 (0.0008) [2023-12-27 21:58:56,543][106225] Updated weights for policy 1, policy_version 383996 (0.0008) [2023-12-27 21:58:56,611][106225] Updated weights for policy 1, policy_version 384006 (0.0005) [2023-12-27 21:58:56,679][106225] Updated weights for policy 1, policy_version 384016 (0.0005) [2023-12-27 21:58:56,866][106226] Updated weights for policy 0, policy_version 383154 (0.0005) [2023-12-27 21:58:56,917][106226] Updated weights for policy 0, policy_version 383164 (0.0005) [2023-12-27 21:58:56,973][106226] Updated weights for policy 0, policy_version 383174 (0.0005) [2023-12-27 21:58:57,212][106225] Updated weights for policy 1, policy_version 384026 (0.0010) [2023-12-27 21:58:57,264][106225] Updated weights for policy 1, policy_version 384036 (0.0010) [2023-12-27 21:58:57,324][106225] Updated weights for policy 1, policy_version 384046 (0.0009) [2023-12-27 21:58:57,555][106226] Updated weights for policy 0, policy_version 383184 (0.0007) [2023-12-27 21:58:57,607][106226] Updated weights for policy 0, policy_version 383194 (0.0009) [2023-12-27 21:58:57,666][106226] Updated weights for policy 0, policy_version 383204 (0.0008) [2023-12-27 21:58:57,951][106225] Updated weights for policy 1, policy_version 384056 (0.0007) [2023-12-27 21:58:58,006][106225] Updated weights for policy 1, policy_version 384066 (0.0007) [2023-12-27 21:58:58,065][106225] Updated weights for policy 1, policy_version 384076 (0.0007) [2023-12-27 21:58:58,346][106226] Updated weights for policy 0, policy_version 383214 (0.0009) [2023-12-27 21:58:58,414][106226] Updated weights for policy 0, policy_version 383224 (0.0007) [2023-12-27 21:58:58,482][106226] Updated weights for policy 0, policy_version 383234 (0.0008) [2023-12-27 21:58:58,811][106225] Updated weights for policy 1, policy_version 384086 (0.0007) [2023-12-27 21:58:58,879][106225] Updated weights for policy 1, policy_version 384096 (0.0007) [2023-12-27 21:58:58,952][106225] Updated weights for policy 1, policy_version 384106 (0.0008) [2023-12-27 21:58:59,255][106226] Updated weights for policy 0, policy_version 383244 (0.0008) [2023-12-27 21:58:59,331][106226] Updated weights for policy 0, policy_version 383254 (0.0008) [2023-12-27 21:58:59,401][106226] Updated weights for policy 0, policy_version 383264 (0.0009) [2023-12-27 21:58:59,709][106225] Updated weights for policy 1, policy_version 384116 (0.0007) [2023-12-27 21:58:59,765][106225] Updated weights for policy 1, policy_version 384126 (0.0006) [2023-12-27 21:58:59,830][106225] Updated weights for policy 1, policy_version 384136 (0.0008) [2023-12-27 21:59:00,133][106226] Updated weights for policy 0, policy_version 383274 (0.0008) [2023-12-27 21:59:00,204][106226] Updated weights for policy 0, policy_version 383284 (0.0006) [2023-12-27 21:59:00,272][106226] Updated weights for policy 0, policy_version 383294 (0.0010) [2023-12-27 21:59:00,331][106226] Updated weights for policy 0, policy_version 383304 (0.0009) [2023-12-27 21:59:00,479][106225] Updated weights for policy 1, policy_version 384146 (0.0009) [2023-12-27 21:59:00,542][106225] Updated weights for policy 1, policy_version 384156 (0.0005) [2023-12-27 21:59:00,601][106225] Updated weights for policy 1, policy_version 384166 (0.0007) [2023-12-27 21:59:00,656][106225] Updated weights for policy 1, policy_version 384176 (0.0005) [2023-12-27 21:59:01,149][106226] Updated weights for policy 0, policy_version 383314 (0.0008) [2023-12-27 21:59:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 196534272. Throughput: 0: 9826.7, 1: 10054.4. Samples: 196530420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:01,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.651')] [2023-12-27 21:59:01,190][106225] Updated weights for policy 1, policy_version 384186 (0.0009) [2023-12-27 21:59:01,210][106226] Updated weights for policy 0, policy_version 383324 (0.0006) [2023-12-27 21:59:01,250][106225] Updated weights for policy 1, policy_version 384196 (0.0008) [2023-12-27 21:59:01,271][106226] Updated weights for policy 0, policy_version 383334 (0.0006) [2023-12-27 21:59:01,313][106225] Updated weights for policy 1, policy_version 384206 (0.0008) [2023-12-27 21:59:01,920][106226] Updated weights for policy 0, policy_version 383344 (0.0008) [2023-12-27 21:59:01,973][106226] Updated weights for policy 0, policy_version 383354 (0.0008) [2023-12-27 21:59:02,032][106226] Updated weights for policy 0, policy_version 383364 (0.0007) [2023-12-27 21:59:02,042][106225] Updated weights for policy 1, policy_version 384216 (0.0008) [2023-12-27 21:59:02,103][106225] Updated weights for policy 1, policy_version 384226 (0.0008) [2023-12-27 21:59:02,160][106225] Updated weights for policy 1, policy_version 384236 (0.0008) [2023-12-27 21:59:02,694][106226] Updated weights for policy 0, policy_version 383374 (0.0008) [2023-12-27 21:59:02,744][106226] Updated weights for policy 0, policy_version 383384 (0.0009) [2023-12-27 21:59:02,792][106226] Updated weights for policy 0, policy_version 383394 (0.0008) [2023-12-27 21:59:02,873][106225] Updated weights for policy 1, policy_version 384246 (0.0007) [2023-12-27 21:59:02,929][106225] Updated weights for policy 1, policy_version 384256 (0.0008) [2023-12-27 21:59:02,984][106225] Updated weights for policy 1, policy_version 384266 (0.0009) [2023-12-27 21:59:03,555][106226] Updated weights for policy 0, policy_version 383404 (0.0010) [2023-12-27 21:59:03,620][106226] Updated weights for policy 0, policy_version 383414 (0.0008) [2023-12-27 21:59:03,643][106225] Updated weights for policy 1, policy_version 384276 (0.0008) [2023-12-27 21:59:03,679][106226] Updated weights for policy 0, policy_version 383424 (0.0007) [2023-12-27 21:59:03,705][106225] Updated weights for policy 1, policy_version 384286 (0.0008) [2023-12-27 21:59:03,756][106225] Updated weights for policy 1, policy_version 384296 (0.0008) [2023-12-27 21:59:04,414][106226] Updated weights for policy 0, policy_version 383434 (0.0006) [2023-12-27 21:59:04,464][106226] Updated weights for policy 0, policy_version 383444 (0.0009) [2023-12-27 21:59:04,477][106225] Updated weights for policy 1, policy_version 384306 (0.0007) [2023-12-27 21:59:04,525][106226] Updated weights for policy 0, policy_version 383454 (0.0008) [2023-12-27 21:59:04,544][106225] Updated weights for policy 1, policy_version 384316 (0.0005) [2023-12-27 21:59:04,591][106226] Updated weights for policy 0, policy_version 383464 (0.0008) [2023-12-27 21:59:04,606][106225] Updated weights for policy 1, policy_version 384326 (0.0007) [2023-12-27 21:59:04,667][106225] Updated weights for policy 1, policy_version 384336 (0.0009) [2023-12-27 21:59:05,202][106226] Updated weights for policy 0, policy_version 383474 (0.0008) [2023-12-27 21:59:05,250][106226] Updated weights for policy 0, policy_version 383484 (0.0008) [2023-12-27 21:59:05,274][106225] Updated weights for policy 1, policy_version 384346 (0.0007) [2023-12-27 21:59:05,302][106226] Updated weights for policy 0, policy_version 383494 (0.0006) [2023-12-27 21:59:05,327][106225] Updated weights for policy 1, policy_version 384356 (0.0008) [2023-12-27 21:59:05,388][106225] Updated weights for policy 1, policy_version 384366 (0.0009) [2023-12-27 21:59:05,969][106225] Updated weights for policy 1, policy_version 384376 (0.0006) [2023-12-27 21:59:06,004][106226] Updated weights for policy 0, policy_version 383504 (0.0006) [2023-12-27 21:59:06,028][106225] Updated weights for policy 1, policy_version 384386 (0.0010) [2023-12-27 21:59:06,065][106226] Updated weights for policy 0, policy_version 383514 (0.0006) [2023-12-27 21:59:06,082][106225] Updated weights for policy 1, policy_version 384396 (0.0010) [2023-12-27 21:59:06,125][106226] Updated weights for policy 0, policy_version 383524 (0.0007) [2023-12-27 21:59:06,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 196648960. Throughput: 0: 9832.7, 1: 10071.4. Samples: 196650696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:06,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-5.407')] [2023-12-27 21:59:06,785][106225] Updated weights for policy 1, policy_version 384406 (0.0010) [2023-12-27 21:59:06,791][106226] Updated weights for policy 0, policy_version 383534 (0.0007) [2023-12-27 21:59:06,844][106225] Updated weights for policy 1, policy_version 384416 (0.0010) [2023-12-27 21:59:06,850][106226] Updated weights for policy 0, policy_version 383544 (0.0006) [2023-12-27 21:59:06,895][106225] Updated weights for policy 1, policy_version 384426 (0.0010) [2023-12-27 21:59:06,914][106226] Updated weights for policy 0, policy_version 383554 (0.0006) [2023-12-27 21:59:07,590][106226] Updated weights for policy 0, policy_version 383564 (0.0007) [2023-12-27 21:59:07,622][106225] Updated weights for policy 1, policy_version 384436 (0.0010) [2023-12-27 21:59:07,640][106226] Updated weights for policy 0, policy_version 383574 (0.0008) [2023-12-27 21:59:07,672][106225] Updated weights for policy 1, policy_version 384446 (0.0010) [2023-12-27 21:59:07,690][106226] Updated weights for policy 0, policy_version 383584 (0.0005) [2023-12-27 21:59:07,729][106225] Updated weights for policy 1, policy_version 384456 (0.0010) [2023-12-27 21:59:08,401][106225] Updated weights for policy 1, policy_version 384466 (0.0009) [2023-12-27 21:59:08,437][106226] Updated weights for policy 0, policy_version 383594 (0.0007) [2023-12-27 21:59:08,457][106225] Updated weights for policy 1, policy_version 384476 (0.0006) [2023-12-27 21:59:08,494][106226] Updated weights for policy 0, policy_version 383604 (0.0007) [2023-12-27 21:59:08,507][106225] Updated weights for policy 1, policy_version 384486 (0.0010) [2023-12-27 21:59:08,552][106226] Updated weights for policy 0, policy_version 383614 (0.0006) [2023-12-27 21:59:08,557][106225] Updated weights for policy 1, policy_version 384496 (0.0010) [2023-12-27 21:59:08,613][106226] Updated weights for policy 0, policy_version 383624 (0.0008) [2023-12-27 21:59:09,129][106225] Updated weights for policy 1, policy_version 384506 (0.0005) [2023-12-27 21:59:09,192][106225] Updated weights for policy 1, policy_version 384516 (0.0005) [2023-12-27 21:59:09,252][106225] Updated weights for policy 1, policy_version 384526 (0.0010) [2023-12-27 21:59:09,456][106226] Updated weights for policy 0, policy_version 383634 (0.0011) [2023-12-27 21:59:09,516][106226] Updated weights for policy 0, policy_version 383644 (0.0011) [2023-12-27 21:59:09,581][106226] Updated weights for policy 0, policy_version 383654 (0.0011) [2023-12-27 21:59:09,984][106225] Updated weights for policy 1, policy_version 384536 (0.0009) [2023-12-27 21:59:10,051][106225] Updated weights for policy 1, policy_version 384546 (0.0010) [2023-12-27 21:59:10,115][106225] Updated weights for policy 1, policy_version 384556 (0.0010) [2023-12-27 21:59:10,305][106226] Updated weights for policy 0, policy_version 383664 (0.0010) [2023-12-27 21:59:10,370][106226] Updated weights for policy 0, policy_version 383674 (0.0010) [2023-12-27 21:59:10,441][106226] Updated weights for policy 0, policy_version 383684 (0.0006) [2023-12-27 21:59:10,805][106225] Updated weights for policy 1, policy_version 384566 (0.0010) [2023-12-27 21:59:10,862][106225] Updated weights for policy 1, policy_version 384576 (0.0010) [2023-12-27 21:59:10,914][106225] Updated weights for policy 1, policy_version 384586 (0.0010) [2023-12-27 21:59:11,164][106226] Updated weights for policy 0, policy_version 383694 (0.0008) [2023-12-27 21:59:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 196739072. Throughput: 0: 9867.7, 1: 10092.6. Samples: 196710172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:11,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-5.826')] [2023-12-27 21:59:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000384592_98484224.pth... [2023-12-27 21:59:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000383408_98181120.pth [2023-12-27 21:59:11,233][106226] Updated weights for policy 0, policy_version 383704 (0.0008) [2023-12-27 21:59:11,298][106226] Updated weights for policy 0, policy_version 383714 (0.0008) [2023-12-27 21:59:11,326][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000383720_98263040.pth... [2023-12-27 21:59:11,329][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000382568_97968128.pth [2023-12-27 21:59:11,670][106225] Updated weights for policy 1, policy_version 384596 (0.0010) [2023-12-27 21:59:11,734][106225] Updated weights for policy 1, policy_version 384606 (0.0011) [2023-12-27 21:59:11,804][106225] Updated weights for policy 1, policy_version 384616 (0.0011) [2023-12-27 21:59:12,036][106226] Updated weights for policy 0, policy_version 383724 (0.0008) [2023-12-27 21:59:12,103][106226] Updated weights for policy 0, policy_version 383734 (0.0008) [2023-12-27 21:59:12,158][106226] Updated weights for policy 0, policy_version 383744 (0.0008) [2023-12-27 21:59:12,553][106225] Updated weights for policy 1, policy_version 384626 (0.0010) [2023-12-27 21:59:12,600][106225] Updated weights for policy 1, policy_version 384636 (0.0005) [2023-12-27 21:59:12,654][106225] Updated weights for policy 1, policy_version 384646 (0.0007) [2023-12-27 21:59:12,704][106225] Updated weights for policy 1, policy_version 384656 (0.0009) [2023-12-27 21:59:12,952][106226] Updated weights for policy 0, policy_version 383754 (0.0008) [2023-12-27 21:59:13,000][106226] Updated weights for policy 0, policy_version 383764 (0.0008) [2023-12-27 21:59:13,049][106226] Updated weights for policy 0, policy_version 383774 (0.0006) [2023-12-27 21:59:13,399][106225] Updated weights for policy 1, policy_version 384666 (0.0007) [2023-12-27 21:59:13,462][106225] Updated weights for policy 1, policy_version 384676 (0.0006) [2023-12-27 21:59:13,525][106225] Updated weights for policy 1, policy_version 384686 (0.0005) [2023-12-27 21:59:13,761][106226] Updated weights for policy 0, policy_version 383785 (0.0009) [2023-12-27 21:59:13,820][106226] Updated weights for policy 0, policy_version 383795 (0.0005) [2023-12-27 21:59:13,881][106226] Updated weights for policy 0, policy_version 383805 (0.0008) [2023-12-27 21:59:13,932][106226] Updated weights for policy 0, policy_version 383815 (0.0007) [2023-12-27 21:59:14,073][106225] Updated weights for policy 1, policy_version 384696 (0.0007) [2023-12-27 21:59:14,137][106225] Updated weights for policy 1, policy_version 384706 (0.0006) [2023-12-27 21:59:14,193][106225] Updated weights for policy 1, policy_version 384716 (0.0005) [2023-12-27 21:59:14,616][106226] Updated weights for policy 0, policy_version 383825 (0.0009) [2023-12-27 21:59:14,678][106226] Updated weights for policy 0, policy_version 383835 (0.0008) [2023-12-27 21:59:14,732][106226] Updated weights for policy 0, policy_version 383845 (0.0007) [2023-12-27 21:59:14,877][106225] Updated weights for policy 1, policy_version 384726 (0.0008) [2023-12-27 21:59:14,936][106225] Updated weights for policy 1, policy_version 384736 (0.0008) [2023-12-27 21:59:14,999][106225] Updated weights for policy 1, policy_version 384746 (0.0009) [2023-12-27 21:59:15,485][106226] Updated weights for policy 0, policy_version 383855 (0.0008) [2023-12-27 21:59:15,550][106226] Updated weights for policy 0, policy_version 383865 (0.0009) [2023-12-27 21:59:15,613][106226] Updated weights for policy 0, policy_version 383875 (0.0009) [2023-12-27 21:59:15,698][106225] Updated weights for policy 1, policy_version 384756 (0.0009) [2023-12-27 21:59:15,754][106225] Updated weights for policy 1, policy_version 384766 (0.0008) [2023-12-27 21:59:15,815][106225] Updated weights for policy 1, policy_version 384776 (0.0009) [2023-12-27 21:59:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 196837376. Throughput: 0: 9757.0, 1: 10075.1. Samples: 196828292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:16,176][105115] Avg episode reward: [(0, '-4.765'), (1, '-5.802')] [2023-12-27 21:59:16,338][106226] Updated weights for policy 0, policy_version 383885 (0.0009) [2023-12-27 21:59:16,393][106226] Updated weights for policy 0, policy_version 383895 (0.0008) [2023-12-27 21:59:16,446][106226] Updated weights for policy 0, policy_version 383905 (0.0008) [2023-12-27 21:59:16,533][106225] Updated weights for policy 1, policy_version 384786 (0.0008) [2023-12-27 21:59:16,579][106225] Updated weights for policy 1, policy_version 384796 (0.0008) [2023-12-27 21:59:16,623][106225] Updated weights for policy 1, policy_version 384806 (0.0008) [2023-12-27 21:59:16,668][106225] Updated weights for policy 1, policy_version 384816 (0.0008) [2023-12-27 21:59:17,181][106226] Updated weights for policy 0, policy_version 383915 (0.0009) [2023-12-27 21:59:17,233][106226] Updated weights for policy 0, policy_version 383925 (0.0009) [2023-12-27 21:59:17,285][106226] Updated weights for policy 0, policy_version 383935 (0.0008) [2023-12-27 21:59:17,427][106225] Updated weights for policy 1, policy_version 384826 (0.0009) [2023-12-27 21:59:17,471][106225] Updated weights for policy 1, policy_version 384836 (0.0008) [2023-12-27 21:59:17,518][106225] Updated weights for policy 1, policy_version 384846 (0.0008) [2023-12-27 21:59:18,094][106226] Updated weights for policy 0, policy_version 383945 (0.0008) [2023-12-27 21:59:18,107][106225] Updated weights for policy 1, policy_version 384856 (0.0007) [2023-12-27 21:59:18,157][106226] Updated weights for policy 0, policy_version 383955 (0.0006) [2023-12-27 21:59:18,159][106225] Updated weights for policy 1, policy_version 384866 (0.0007) [2023-12-27 21:59:18,211][106226] Updated weights for policy 0, policy_version 383965 (0.0006) [2023-12-27 21:59:18,213][106225] Updated weights for policy 1, policy_version 384876 (0.0006) [2023-12-27 21:59:18,273][106226] Updated weights for policy 0, policy_version 383975 (0.0009) [2023-12-27 21:59:18,953][106225] Updated weights for policy 1, policy_version 384886 (0.0007) [2023-12-27 21:59:19,005][106225] Updated weights for policy 1, policy_version 384896 (0.0006) [2023-12-27 21:59:19,031][106226] Updated weights for policy 0, policy_version 383985 (0.0007) [2023-12-27 21:59:19,065][106225] Updated weights for policy 1, policy_version 384906 (0.0006) [2023-12-27 21:59:19,087][106226] Updated weights for policy 0, policy_version 383995 (0.0006) [2023-12-27 21:59:19,147][106226] Updated weights for policy 0, policy_version 384005 (0.0008) [2023-12-27 21:59:19,877][106225] Updated weights for policy 1, policy_version 384916 (0.0007) [2023-12-27 21:59:19,902][106226] Updated weights for policy 0, policy_version 384015 (0.0010) [2023-12-27 21:59:19,969][106226] Updated weights for policy 0, policy_version 384025 (0.0011) [2023-12-27 21:59:19,973][106225] Updated weights for policy 1, policy_version 384926 (0.0008) [2023-12-27 21:59:20,025][106226] Updated weights for policy 0, policy_version 384035 (0.0011) [2023-12-27 21:59:20,035][106225] Updated weights for policy 1, policy_version 384936 (0.0008) [2023-12-27 21:59:20,763][106226] Updated weights for policy 0, policy_version 384045 (0.0009) [2023-12-27 21:59:20,778][106225] Updated weights for policy 1, policy_version 384946 (0.0007) [2023-12-27 21:59:20,829][106226] Updated weights for policy 0, policy_version 384055 (0.0008) [2023-12-27 21:59:20,839][106225] Updated weights for policy 1, policy_version 384956 (0.0007) [2023-12-27 21:59:20,895][106226] Updated weights for policy 0, policy_version 384065 (0.0007) [2023-12-27 21:59:20,901][106225] Updated weights for policy 1, policy_version 384966 (0.0007) [2023-12-27 21:59:20,962][106225] Updated weights for policy 1, policy_version 384976 (0.0007) [2023-12-27 21:59:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 196935680. Throughput: 0: 9664.2, 1: 10010.2. Samples: 196941928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:21,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-5.804')] [2023-12-27 21:59:21,625][106226] Updated weights for policy 0, policy_version 384075 (0.0009) [2023-12-27 21:59:21,692][106226] Updated weights for policy 0, policy_version 384085 (0.0008) [2023-12-27 21:59:21,726][106225] Updated weights for policy 1, policy_version 384986 (0.0009) [2023-12-27 21:59:21,760][106226] Updated weights for policy 0, policy_version 384095 (0.0008) [2023-12-27 21:59:21,797][106225] Updated weights for policy 1, policy_version 384996 (0.0009) [2023-12-27 21:59:21,867][106225] Updated weights for policy 1, policy_version 385006 (0.0009) [2023-12-27 21:59:22,457][106226] Updated weights for policy 0, policy_version 384105 (0.0006) [2023-12-27 21:59:22,519][106226] Updated weights for policy 0, policy_version 384115 (0.0011) [2023-12-27 21:59:22,573][106226] Updated weights for policy 0, policy_version 384125 (0.0011) [2023-12-27 21:59:22,601][106225] Updated weights for policy 1, policy_version 385016 (0.0007) [2023-12-27 21:59:22,639][106226] Updated weights for policy 0, policy_version 384135 (0.0010) [2023-12-27 21:59:22,660][106225] Updated weights for policy 1, policy_version 385026 (0.0006) [2023-12-27 21:59:22,729][106225] Updated weights for policy 1, policy_version 385036 (0.0006) [2023-12-27 21:59:23,239][106226] Updated weights for policy 0, policy_version 384145 (0.0010) [2023-12-27 21:59:23,292][106226] Updated weights for policy 0, policy_version 384155 (0.0010) [2023-12-27 21:59:23,358][106226] Updated weights for policy 0, policy_version 384165 (0.0010) [2023-12-27 21:59:23,395][106225] Updated weights for policy 1, policy_version 385046 (0.0006) [2023-12-27 21:59:23,452][106225] Updated weights for policy 1, policy_version 385056 (0.0005) [2023-12-27 21:59:23,512][106225] Updated weights for policy 1, policy_version 385066 (0.0005) [2023-12-27 21:59:24,006][106225] Updated weights for policy 1, policy_version 385076 (0.0005) [2023-12-27 21:59:24,031][106226] Updated weights for policy 0, policy_version 384175 (0.0010) [2023-12-27 21:59:24,070][106225] Updated weights for policy 1, policy_version 385086 (0.0005) [2023-12-27 21:59:24,083][106226] Updated weights for policy 0, policy_version 384185 (0.0010) [2023-12-27 21:59:24,128][106225] Updated weights for policy 1, policy_version 385096 (0.0007) [2023-12-27 21:59:24,137][106226] Updated weights for policy 0, policy_version 384195 (0.0011) [2023-12-27 21:59:24,743][106225] Updated weights for policy 1, policy_version 385106 (0.0009) [2023-12-27 21:59:24,789][106225] Updated weights for policy 1, policy_version 385116 (0.0008) [2023-12-27 21:59:24,831][106225] Updated weights for policy 1, policy_version 385126 (0.0007) [2023-12-27 21:59:24,835][106226] Updated weights for policy 0, policy_version 384205 (0.0010) [2023-12-27 21:59:24,882][106225] Updated weights for policy 1, policy_version 385136 (0.0006) [2023-12-27 21:59:24,898][106226] Updated weights for policy 0, policy_version 384215 (0.0011) [2023-12-27 21:59:24,962][106226] Updated weights for policy 0, policy_version 384225 (0.0011) [2023-12-27 21:59:25,546][106225] Updated weights for policy 1, policy_version 385146 (0.0006) [2023-12-27 21:59:25,609][106225] Updated weights for policy 1, policy_version 385156 (0.0005) [2023-12-27 21:59:25,644][106226] Updated weights for policy 0, policy_version 384235 (0.0011) [2023-12-27 21:59:25,670][106225] Updated weights for policy 1, policy_version 385166 (0.0005) [2023-12-27 21:59:25,701][106226] Updated weights for policy 0, policy_version 384245 (0.0010) [2023-12-27 21:59:25,765][106226] Updated weights for policy 0, policy_version 384255 (0.0011) [2023-12-27 21:59:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 197033984. Throughput: 0: 9658.8, 1: 10003.8. Samples: 197002148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:26,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.641')] [2023-12-27 21:59:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000384264_98402304.pth... [2023-12-27 21:59:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000383144_98115584.pth [2023-12-27 21:59:26,234][106225] Updated weights for policy 1, policy_version 385176 (0.0010) [2023-12-27 21:59:26,297][106225] Updated weights for policy 1, policy_version 385186 (0.0010) [2023-12-27 21:59:26,343][106226] Updated weights for policy 0, policy_version 384265 (0.0006) [2023-12-27 21:59:26,365][106225] Updated weights for policy 1, policy_version 385196 (0.0011) [2023-12-27 21:59:26,386][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000385200_98639872.pth... [2023-12-27 21:59:26,390][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000383984_98328576.pth [2023-12-27 21:59:26,408][106226] Updated weights for policy 0, policy_version 384275 (0.0006) [2023-12-27 21:59:26,458][106226] Updated weights for policy 0, policy_version 384285 (0.0009) [2023-12-27 21:59:26,526][106226] Updated weights for policy 0, policy_version 384295 (0.0011) [2023-12-27 21:59:27,014][106225] Updated weights for policy 1, policy_version 385206 (0.0009) [2023-12-27 21:59:27,070][106225] Updated weights for policy 1, policy_version 385216 (0.0010) [2023-12-27 21:59:27,119][106225] Updated weights for policy 1, policy_version 385226 (0.0008) [2023-12-27 21:59:27,145][106226] Updated weights for policy 0, policy_version 384305 (0.0008) [2023-12-27 21:59:27,212][106226] Updated weights for policy 0, policy_version 384315 (0.0007) [2023-12-27 21:59:27,273][106226] Updated weights for policy 0, policy_version 384325 (0.0005) [2023-12-27 21:59:27,677][106225] Updated weights for policy 1, policy_version 385236 (0.0007) [2023-12-27 21:59:27,735][106225] Updated weights for policy 1, policy_version 385246 (0.0008) [2023-12-27 21:59:27,782][106225] Updated weights for policy 1, policy_version 385256 (0.0006) [2023-12-27 21:59:27,978][106226] Updated weights for policy 0, policy_version 384335 (0.0008) [2023-12-27 21:59:28,033][106226] Updated weights for policy 0, policy_version 384345 (0.0009) [2023-12-27 21:59:28,087][106226] Updated weights for policy 0, policy_version 384355 (0.0009) [2023-12-27 21:59:28,346][106225] Updated weights for policy 1, policy_version 385266 (0.0006) [2023-12-27 21:59:28,405][106225] Updated weights for policy 1, policy_version 385276 (0.0006) [2023-12-27 21:59:28,460][106225] Updated weights for policy 1, policy_version 385286 (0.0006) [2023-12-27 21:59:28,509][106225] Updated weights for policy 1, policy_version 385296 (0.0005) [2023-12-27 21:59:28,936][106226] Updated weights for policy 0, policy_version 384365 (0.0007) [2023-12-27 21:59:28,996][106226] Updated weights for policy 0, policy_version 384375 (0.0009) [2023-12-27 21:59:29,047][106226] Updated weights for policy 0, policy_version 384385 (0.0008) [2023-12-27 21:59:29,073][106225] Updated weights for policy 1, policy_version 385306 (0.0007) [2023-12-27 21:59:29,122][106225] Updated weights for policy 1, policy_version 385316 (0.0007) [2023-12-27 21:59:29,175][106225] Updated weights for policy 1, policy_version 385326 (0.0009) [2023-12-27 21:59:29,837][106226] Updated weights for policy 0, policy_version 384395 (0.0007) [2023-12-27 21:59:29,905][106226] Updated weights for policy 0, policy_version 384405 (0.0006) [2023-12-27 21:59:29,911][106225] Updated weights for policy 1, policy_version 385336 (0.0007) [2023-12-27 21:59:29,975][106226] Updated weights for policy 0, policy_version 384415 (0.0007) [2023-12-27 21:59:29,976][106225] Updated weights for policy 1, policy_version 385346 (0.0008) [2023-12-27 21:59:30,040][106225] Updated weights for policy 1, policy_version 385356 (0.0007) [2023-12-27 21:59:30,664][106226] Updated weights for policy 0, policy_version 384425 (0.0007) [2023-12-27 21:59:30,719][106226] Updated weights for policy 0, policy_version 384435 (0.0006) [2023-12-27 21:59:30,764][106225] Updated weights for policy 1, policy_version 385366 (0.0007) [2023-12-27 21:59:30,782][106226] Updated weights for policy 0, policy_version 384445 (0.0007) [2023-12-27 21:59:30,830][106225] Updated weights for policy 1, policy_version 385376 (0.0008) [2023-12-27 21:59:30,838][106226] Updated weights for policy 0, policy_version 384455 (0.0005) [2023-12-27 21:59:30,888][106225] Updated weights for policy 1, policy_version 385386 (0.0008) [2023-12-27 21:59:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 197140480. Throughput: 0: 9695.7, 1: 10220.3. Samples: 197128952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:31,175][105115] Avg episode reward: [(0, '-5.073'), (1, '-5.704')] [2023-12-27 21:59:31,500][106226] Updated weights for policy 0, policy_version 384465 (0.0010) [2023-12-27 21:59:31,554][106226] Updated weights for policy 0, policy_version 384475 (0.0008) [2023-12-27 21:59:31,555][106225] Updated weights for policy 1, policy_version 385396 (0.0008) [2023-12-27 21:59:31,606][106226] Updated weights for policy 0, policy_version 384485 (0.0006) [2023-12-27 21:59:31,618][106225] Updated weights for policy 1, policy_version 385406 (0.0006) [2023-12-27 21:59:31,685][106225] Updated weights for policy 1, policy_version 385416 (0.0008) [2023-12-27 21:59:32,290][106226] Updated weights for policy 0, policy_version 384495 (0.0010) [2023-12-27 21:59:32,362][106226] Updated weights for policy 0, policy_version 384505 (0.0007) [2023-12-27 21:59:32,426][106226] Updated weights for policy 0, policy_version 384515 (0.0009) [2023-12-27 21:59:32,432][106225] Updated weights for policy 1, policy_version 385426 (0.0008) [2023-12-27 21:59:32,491][106225] Updated weights for policy 1, policy_version 385436 (0.0006) [2023-12-27 21:59:32,550][106225] Updated weights for policy 1, policy_version 385446 (0.0008) [2023-12-27 21:59:32,614][106225] Updated weights for policy 1, policy_version 385456 (0.0007) [2023-12-27 21:59:33,030][106226] Updated weights for policy 0, policy_version 384525 (0.0006) [2023-12-27 21:59:33,094][106226] Updated weights for policy 0, policy_version 384535 (0.0006) [2023-12-27 21:59:33,146][106226] Updated weights for policy 0, policy_version 384545 (0.0008) [2023-12-27 21:59:33,212][106225] Updated weights for policy 1, policy_version 385466 (0.0006) [2023-12-27 21:59:33,278][106225] Updated weights for policy 1, policy_version 385476 (0.0005) [2023-12-27 21:59:33,340][106225] Updated weights for policy 1, policy_version 385486 (0.0005) [2023-12-27 21:59:33,804][106226] Updated weights for policy 0, policy_version 384555 (0.0008) [2023-12-27 21:59:33,876][106226] Updated weights for policy 0, policy_version 384565 (0.0009) [2023-12-27 21:59:33,913][106225] Updated weights for policy 1, policy_version 385496 (0.0007) [2023-12-27 21:59:33,944][106226] Updated weights for policy 0, policy_version 384575 (0.0008) [2023-12-27 21:59:33,979][106225] Updated weights for policy 1, policy_version 385506 (0.0007) [2023-12-27 21:59:34,036][106225] Updated weights for policy 1, policy_version 385516 (0.0006) [2023-12-27 21:59:34,687][106226] Updated weights for policy 0, policy_version 384585 (0.0009) [2023-12-27 21:59:34,749][106225] Updated weights for policy 1, policy_version 385526 (0.0007) [2023-12-27 21:59:34,751][106226] Updated weights for policy 0, policy_version 384595 (0.0007) [2023-12-27 21:59:34,808][106225] Updated weights for policy 1, policy_version 385536 (0.0008) [2023-12-27 21:59:34,809][106226] Updated weights for policy 0, policy_version 384605 (0.0009) [2023-12-27 21:59:34,864][106226] Updated weights for policy 0, policy_version 384615 (0.0008) [2023-12-27 21:59:34,871][106225] Updated weights for policy 1, policy_version 385546 (0.0008) [2023-12-27 21:59:35,469][106225] Updated weights for policy 1, policy_version 385556 (0.0007) [2023-12-27 21:59:35,521][106225] Updated weights for policy 1, policy_version 385566 (0.0005) [2023-12-27 21:59:35,580][106225] Updated weights for policy 1, policy_version 385576 (0.0007) [2023-12-27 21:59:35,638][106226] Updated weights for policy 0, policy_version 384625 (0.0010) [2023-12-27 21:59:35,696][106226] Updated weights for policy 0, policy_version 384635 (0.0010) [2023-12-27 21:59:35,756][106226] Updated weights for policy 0, policy_version 384645 (0.0010) [2023-12-27 21:59:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 197238784. Throughput: 0: 9742.9, 1: 10237.2. Samples: 197250672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:36,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.187')] [2023-12-27 21:59:36,206][106225] Updated weights for policy 1, policy_version 385586 (0.0008) [2023-12-27 21:59:36,275][106225] Updated weights for policy 1, policy_version 385596 (0.0009) [2023-12-27 21:59:36,338][106225] Updated weights for policy 1, policy_version 385606 (0.0008) [2023-12-27 21:59:36,379][106226] Updated weights for policy 0, policy_version 384655 (0.0008) [2023-12-27 21:59:36,408][106225] Updated weights for policy 1, policy_version 385616 (0.0009) [2023-12-27 21:59:36,430][106226] Updated weights for policy 0, policy_version 384665 (0.0011) [2023-12-27 21:59:36,485][106226] Updated weights for policy 0, policy_version 384675 (0.0010) [2023-12-27 21:59:37,127][106225] Updated weights for policy 1, policy_version 385626 (0.0008) [2023-12-27 21:59:37,191][106225] Updated weights for policy 1, policy_version 385636 (0.0007) [2023-12-27 21:59:37,204][106226] Updated weights for policy 0, policy_version 384685 (0.0009) [2023-12-27 21:59:37,240][106225] Updated weights for policy 1, policy_version 385646 (0.0007) [2023-12-27 21:59:37,274][106226] Updated weights for policy 0, policy_version 384695 (0.0009) [2023-12-27 21:59:37,336][106226] Updated weights for policy 0, policy_version 384705 (0.0007) [2023-12-27 21:59:37,981][106225] Updated weights for policy 1, policy_version 385656 (0.0008) [2023-12-27 21:59:38,019][106226] Updated weights for policy 0, policy_version 384715 (0.0006) [2023-12-27 21:59:38,046][106225] Updated weights for policy 1, policy_version 385666 (0.0007) [2023-12-27 21:59:38,076][106226] Updated weights for policy 0, policy_version 384725 (0.0006) [2023-12-27 21:59:38,107][106225] Updated weights for policy 1, policy_version 385676 (0.0009) [2023-12-27 21:59:38,139][106226] Updated weights for policy 0, policy_version 384735 (0.0008) [2023-12-27 21:59:38,830][106226] Updated weights for policy 0, policy_version 384745 (0.0009) [2023-12-27 21:59:38,868][106225] Updated weights for policy 1, policy_version 385686 (0.0008) [2023-12-27 21:59:38,891][106226] Updated weights for policy 0, policy_version 384755 (0.0007) [2023-12-27 21:59:38,928][106225] Updated weights for policy 1, policy_version 385696 (0.0007) [2023-12-27 21:59:38,954][106226] Updated weights for policy 0, policy_version 384765 (0.0006) [2023-12-27 21:59:38,983][106225] Updated weights for policy 1, policy_version 385706 (0.0007) [2023-12-27 21:59:39,008][106226] Updated weights for policy 0, policy_version 384775 (0.0006) [2023-12-27 21:59:39,679][106225] Updated weights for policy 1, policy_version 385716 (0.0009) [2023-12-27 21:59:39,714][106226] Updated weights for policy 0, policy_version 384785 (0.0008) [2023-12-27 21:59:39,734][106225] Updated weights for policy 1, policy_version 385726 (0.0010) [2023-12-27 21:59:39,773][106226] Updated weights for policy 0, policy_version 384795 (0.0008) [2023-12-27 21:59:39,795][106225] Updated weights for policy 1, policy_version 385736 (0.0010) [2023-12-27 21:59:39,836][106226] Updated weights for policy 0, policy_version 384805 (0.0009) [2023-12-27 21:59:40,502][106225] Updated weights for policy 1, policy_version 385746 (0.0010) [2023-12-27 21:59:40,568][106225] Updated weights for policy 1, policy_version 385756 (0.0008) [2023-12-27 21:59:40,603][106226] Updated weights for policy 0, policy_version 384815 (0.0007) [2023-12-27 21:59:40,630][106225] Updated weights for policy 1, policy_version 385766 (0.0008) [2023-12-27 21:59:40,665][106226] Updated weights for policy 0, policy_version 384825 (0.0005) [2023-12-27 21:59:40,686][106225] Updated weights for policy 1, policy_version 385776 (0.0007) [2023-12-27 21:59:40,728][106226] Updated weights for policy 0, policy_version 384835 (0.0005) [2023-12-27 21:59:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 197337088. Throughput: 0: 9738.5, 1: 10245.4. Samples: 197309076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:41,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.721')] [2023-12-27 21:59:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000385776_98787328.pth... [2023-12-27 21:59:41,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000384840_98549760.pth... [2023-12-27 21:59:41,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000384592_98484224.pth [2023-12-27 21:59:41,196][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000383720_98263040.pth [2023-12-27 21:59:41,414][106225] Updated weights for policy 1, policy_version 385786 (0.0010) [2023-12-27 21:59:41,461][106226] Updated weights for policy 0, policy_version 384845 (0.0007) [2023-12-27 21:59:41,481][106225] Updated weights for policy 1, policy_version 385796 (0.0008) [2023-12-27 21:59:41,517][106226] Updated weights for policy 0, policy_version 384855 (0.0008) [2023-12-27 21:59:41,546][106225] Updated weights for policy 1, policy_version 385806 (0.0010) [2023-12-27 21:59:41,569][106226] Updated weights for policy 0, policy_version 384865 (0.0008) [2023-12-27 21:59:42,213][106225] Updated weights for policy 1, policy_version 385816 (0.0011) [2023-12-27 21:59:42,281][106225] Updated weights for policy 1, policy_version 385826 (0.0012) [2023-12-27 21:59:42,349][106225] Updated weights for policy 1, policy_version 385836 (0.0009) [2023-12-27 21:59:42,377][106226] Updated weights for policy 0, policy_version 384875 (0.0009) [2023-12-27 21:59:42,439][106226] Updated weights for policy 0, policy_version 384885 (0.0008) [2023-12-27 21:59:42,502][106226] Updated weights for policy 0, policy_version 384895 (0.0008) [2023-12-27 21:59:43,089][106225] Updated weights for policy 1, policy_version 385846 (0.0010) [2023-12-27 21:59:43,152][106225] Updated weights for policy 1, policy_version 385856 (0.0010) [2023-12-27 21:59:43,201][106225] Updated weights for policy 1, policy_version 385866 (0.0010) [2023-12-27 21:59:43,249][106226] Updated weights for policy 0, policy_version 384905 (0.0008) [2023-12-27 21:59:43,303][106226] Updated weights for policy 0, policy_version 384915 (0.0007) [2023-12-27 21:59:43,356][106226] Updated weights for policy 0, policy_version 384925 (0.0008) [2023-12-27 21:59:43,412][106226] Updated weights for policy 0, policy_version 384935 (0.0008) [2023-12-27 21:59:43,872][106225] Updated weights for policy 1, policy_version 385876 (0.0008) [2023-12-27 21:59:43,937][106225] Updated weights for policy 1, policy_version 385886 (0.0005) [2023-12-27 21:59:43,985][106225] Updated weights for policy 1, policy_version 385896 (0.0005) [2023-12-27 21:59:44,011][106226] Updated weights for policy 0, policy_version 384945 (0.0008) [2023-12-27 21:59:44,068][106226] Updated weights for policy 0, policy_version 384955 (0.0009) [2023-12-27 21:59:44,122][106226] Updated weights for policy 0, policy_version 384965 (0.0009) [2023-12-27 21:59:44,508][106225] Updated weights for policy 1, policy_version 385906 (0.0005) [2023-12-27 21:59:44,564][106225] Updated weights for policy 1, policy_version 385916 (0.0005) [2023-12-27 21:59:44,625][106225] Updated weights for policy 1, policy_version 385926 (0.0006) [2023-12-27 21:59:44,691][106225] Updated weights for policy 1, policy_version 385936 (0.0007) [2023-12-27 21:59:44,919][106226] Updated weights for policy 0, policy_version 384975 (0.0008) [2023-12-27 21:59:44,982][106226] Updated weights for policy 0, policy_version 384985 (0.0008) [2023-12-27 21:59:45,047][106226] Updated weights for policy 0, policy_version 384995 (0.0008) [2023-12-27 21:59:45,354][106225] Updated weights for policy 1, policy_version 385946 (0.0008) [2023-12-27 21:59:45,400][106225] Updated weights for policy 1, policy_version 385956 (0.0009) [2023-12-27 21:59:45,448][106225] Updated weights for policy 1, policy_version 385966 (0.0008) [2023-12-27 21:59:45,811][106226] Updated weights for policy 0, policy_version 385005 (0.0008) [2023-12-27 21:59:45,861][106226] Updated weights for policy 0, policy_version 385015 (0.0009) [2023-12-27 21:59:45,917][106226] Updated weights for policy 0, policy_version 385025 (0.0009) [2023-12-27 21:59:46,065][106225] Updated weights for policy 1, policy_version 385976 (0.0006) [2023-12-27 21:59:46,119][106225] Updated weights for policy 1, policy_version 385986 (0.0005) [2023-12-27 21:59:46,171][106225] Updated weights for policy 1, policy_version 385996 (0.0007) [2023-12-27 21:59:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 197435392. Throughput: 0: 9673.9, 1: 10237.5. Samples: 197426428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:46,175][105115] Avg episode reward: [(0, '-5.188'), (1, '-6.036')] [2023-12-27 21:59:46,697][106226] Updated weights for policy 0, policy_version 385035 (0.0010) [2023-12-27 21:59:46,758][106226] Updated weights for policy 0, policy_version 385045 (0.0009) [2023-12-27 21:59:46,806][106226] Updated weights for policy 0, policy_version 385055 (0.0009) [2023-12-27 21:59:46,852][106225] Updated weights for policy 1, policy_version 386006 (0.0006) [2023-12-27 21:59:46,906][106225] Updated weights for policy 1, policy_version 386016 (0.0006) [2023-12-27 21:59:46,968][106225] Updated weights for policy 1, policy_version 386026 (0.0005) [2023-12-27 21:59:47,566][106225] Updated weights for policy 1, policy_version 386036 (0.0007) [2023-12-27 21:59:47,606][106226] Updated weights for policy 0, policy_version 385065 (0.0007) [2023-12-27 21:59:47,626][106225] Updated weights for policy 1, policy_version 386046 (0.0005) [2023-12-27 21:59:47,672][106226] Updated weights for policy 0, policy_version 385075 (0.0009) [2023-12-27 21:59:47,681][106225] Updated weights for policy 1, policy_version 386056 (0.0006) [2023-12-27 21:59:47,733][106226] Updated weights for policy 0, policy_version 385085 (0.0009) [2023-12-27 21:59:47,792][106226] Updated weights for policy 0, policy_version 385095 (0.0009) [2023-12-27 21:59:48,307][106225] Updated weights for policy 1, policy_version 386066 (0.0006) [2023-12-27 21:59:48,378][106225] Updated weights for policy 1, policy_version 386076 (0.0009) [2023-12-27 21:59:48,437][106225] Updated weights for policy 1, policy_version 386086 (0.0008) [2023-12-27 21:59:48,496][106225] Updated weights for policy 1, policy_version 386096 (0.0008) [2023-12-27 21:59:48,547][106226] Updated weights for policy 0, policy_version 385105 (0.0008) [2023-12-27 21:59:48,616][106226] Updated weights for policy 0, policy_version 385115 (0.0008) [2023-12-27 21:59:48,677][106226] Updated weights for policy 0, policy_version 385125 (0.0008) [2023-12-27 21:59:49,153][106225] Updated weights for policy 1, policy_version 386106 (0.0010) [2023-12-27 21:59:49,218][106225] Updated weights for policy 1, policy_version 386116 (0.0010) [2023-12-27 21:59:49,275][106225] Updated weights for policy 1, policy_version 386126 (0.0008) [2023-12-27 21:59:49,516][106226] Updated weights for policy 0, policy_version 385135 (0.0007) [2023-12-27 21:59:49,569][106226] Updated weights for policy 0, policy_version 385145 (0.0010) [2023-12-27 21:59:49,629][106226] Updated weights for policy 0, policy_version 385155 (0.0011) [2023-12-27 21:59:49,993][106225] Updated weights for policy 1, policy_version 386136 (0.0008) [2023-12-27 21:59:50,057][106225] Updated weights for policy 1, policy_version 386146 (0.0007) [2023-12-27 21:59:50,123][106225] Updated weights for policy 1, policy_version 386156 (0.0007) [2023-12-27 21:59:50,286][106226] Updated weights for policy 0, policy_version 385165 (0.0008) [2023-12-27 21:59:50,349][106226] Updated weights for policy 0, policy_version 385175 (0.0007) [2023-12-27 21:59:50,411][106226] Updated weights for policy 0, policy_version 385185 (0.0009) [2023-12-27 21:59:50,771][106225] Updated weights for policy 1, policy_version 386166 (0.0006) [2023-12-27 21:59:50,836][106225] Updated weights for policy 1, policy_version 386176 (0.0005) [2023-12-27 21:59:50,909][106225] Updated weights for policy 1, policy_version 386186 (0.0006) [2023-12-27 21:59:51,006][106226] Updated weights for policy 0, policy_version 385195 (0.0008) [2023-12-27 21:59:51,079][106226] Updated weights for policy 0, policy_version 385205 (0.0008) [2023-12-27 21:59:51,147][106226] Updated weights for policy 0, policy_version 385215 (0.0008) [2023-12-27 21:59:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 197533696. Throughput: 0: 9633.4, 1: 10254.6. Samples: 197545656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:51,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-6.012')] [2023-12-27 21:59:51,515][106225] Updated weights for policy 1, policy_version 386196 (0.0006) [2023-12-27 21:59:51,583][106225] Updated weights for policy 1, policy_version 386206 (0.0006) [2023-12-27 21:59:51,652][106225] Updated weights for policy 1, policy_version 386216 (0.0008) [2023-12-27 21:59:51,941][106226] Updated weights for policy 0, policy_version 385225 (0.0008) [2023-12-27 21:59:52,004][106226] Updated weights for policy 0, policy_version 385235 (0.0006) [2023-12-27 21:59:52,062][106226] Updated weights for policy 0, policy_version 385245 (0.0006) [2023-12-27 21:59:52,126][106226] Updated weights for policy 0, policy_version 385255 (0.0006) [2023-12-27 21:59:52,343][106225] Updated weights for policy 1, policy_version 386226 (0.0007) [2023-12-27 21:59:52,408][106225] Updated weights for policy 1, policy_version 386236 (0.0008) [2023-12-27 21:59:52,471][106225] Updated weights for policy 1, policy_version 386246 (0.0006) [2023-12-27 21:59:52,529][106225] Updated weights for policy 1, policy_version 386256 (0.0005) [2023-12-27 21:59:52,750][106226] Updated weights for policy 0, policy_version 385265 (0.0005) [2023-12-27 21:59:52,812][106226] Updated weights for policy 0, policy_version 385275 (0.0008) [2023-12-27 21:59:52,876][106226] Updated weights for policy 0, policy_version 385285 (0.0008) [2023-12-27 21:59:53,203][106225] Updated weights for policy 1, policy_version 386266 (0.0005) [2023-12-27 21:59:53,257][106225] Updated weights for policy 1, policy_version 386276 (0.0007) [2023-12-27 21:59:53,316][106225] Updated weights for policy 1, policy_version 386286 (0.0008) [2023-12-27 21:59:53,595][106226] Updated weights for policy 0, policy_version 385295 (0.0009) [2023-12-27 21:59:53,644][106226] Updated weights for policy 0, policy_version 385305 (0.0009) [2023-12-27 21:59:53,689][106226] Updated weights for policy 0, policy_version 385315 (0.0008) [2023-12-27 21:59:54,032][106225] Updated weights for policy 1, policy_version 386296 (0.0010) [2023-12-27 21:59:54,087][106225] Updated weights for policy 1, policy_version 386306 (0.0010) [2023-12-27 21:59:54,134][106225] Updated weights for policy 1, policy_version 386316 (0.0010) [2023-12-27 21:59:54,470][106226] Updated weights for policy 0, policy_version 385325 (0.0008) [2023-12-27 21:59:54,530][106226] Updated weights for policy 0, policy_version 385335 (0.0008) [2023-12-27 21:59:54,583][106226] Updated weights for policy 0, policy_version 385345 (0.0008) [2023-12-27 21:59:54,860][106225] Updated weights for policy 1, policy_version 386326 (0.0009) [2023-12-27 21:59:54,909][106225] Updated weights for policy 1, policy_version 386336 (0.0008) [2023-12-27 21:59:54,960][106225] Updated weights for policy 1, policy_version 386346 (0.0007) [2023-12-27 21:59:55,291][106226] Updated weights for policy 0, policy_version 385355 (0.0007) [2023-12-27 21:59:55,360][106226] Updated weights for policy 0, policy_version 385365 (0.0006) [2023-12-27 21:59:55,430][106226] Updated weights for policy 0, policy_version 385375 (0.0005) [2023-12-27 21:59:55,672][106225] Updated weights for policy 1, policy_version 386356 (0.0009) [2023-12-27 21:59:55,726][106225] Updated weights for policy 1, policy_version 386366 (0.0010) [2023-12-27 21:59:55,775][106225] Updated weights for policy 1, policy_version 386376 (0.0010) [2023-12-27 21:59:56,048][106226] Updated weights for policy 0, policy_version 385385 (0.0006) [2023-12-27 21:59:56,103][106226] Updated weights for policy 0, policy_version 385395 (0.0008) [2023-12-27 21:59:56,154][106226] Updated weights for policy 0, policy_version 385405 (0.0009) [2023-12-27 21:59:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 197632000. Throughput: 0: 9636.6, 1: 10237.7. Samples: 197604516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 21:59:56,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-5.835')] [2023-12-27 21:59:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000386384_98942976.pth... [2023-12-27 21:59:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000385200_98639872.pth [2023-12-27 21:59:56,204][106226] Updated weights for policy 0, policy_version 385415 (0.0007) [2023-12-27 21:59:56,207][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000385416_98697216.pth... [2023-12-27 21:59:56,211][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000384264_98402304.pth [2023-12-27 21:59:56,390][106225] Updated weights for policy 1, policy_version 386386 (0.0009) [2023-12-27 21:59:56,445][106225] Updated weights for policy 1, policy_version 386396 (0.0010) [2023-12-27 21:59:56,493][106225] Updated weights for policy 1, policy_version 386406 (0.0010) [2023-12-27 21:59:56,556][106225] Updated weights for policy 1, policy_version 386416 (0.0010) [2023-12-27 21:59:56,957][106226] Updated weights for policy 0, policy_version 385425 (0.0007) [2023-12-27 21:59:57,009][106226] Updated weights for policy 0, policy_version 385435 (0.0008) [2023-12-27 21:59:57,056][106226] Updated weights for policy 0, policy_version 385445 (0.0008) [2023-12-27 21:59:57,274][106225] Updated weights for policy 1, policy_version 386426 (0.0010) [2023-12-27 21:59:57,330][106225] Updated weights for policy 1, policy_version 386436 (0.0006) [2023-12-27 21:59:57,391][106225] Updated weights for policy 1, policy_version 386446 (0.0006) [2023-12-27 21:59:57,680][106226] Updated weights for policy 0, policy_version 385456 (0.0005) [2023-12-27 21:59:57,739][106226] Updated weights for policy 0, policy_version 385466 (0.0007) [2023-12-27 21:59:57,799][106226] Updated weights for policy 0, policy_version 385476 (0.0005) [2023-12-27 21:59:58,084][106225] Updated weights for policy 1, policy_version 386456 (0.0007) [2023-12-27 21:59:58,146][106225] Updated weights for policy 1, policy_version 386466 (0.0008) [2023-12-27 21:59:58,199][106225] Updated weights for policy 1, policy_version 386476 (0.0009) [2023-12-27 21:59:58,425][106226] Updated weights for policy 0, policy_version 385486 (0.0007) [2023-12-27 21:59:58,493][106226] Updated weights for policy 0, policy_version 385496 (0.0008) [2023-12-27 21:59:58,556][106226] Updated weights for policy 0, policy_version 385506 (0.0008) [2023-12-27 21:59:59,027][106225] Updated weights for policy 1, policy_version 386486 (0.0008) [2023-12-27 21:59:59,087][106225] Updated weights for policy 1, policy_version 386496 (0.0008) [2023-12-27 21:59:59,151][106225] Updated weights for policy 1, policy_version 386506 (0.0008) [2023-12-27 21:59:59,354][106226] Updated weights for policy 0, policy_version 385516 (0.0009) [2023-12-27 21:59:59,418][106226] Updated weights for policy 0, policy_version 385526 (0.0008) [2023-12-27 21:59:59,471][106226] Updated weights for policy 0, policy_version 385536 (0.0008) [2023-12-27 21:59:59,826][106225] Updated weights for policy 1, policy_version 386516 (0.0008) [2023-12-27 21:59:59,891][106225] Updated weights for policy 1, policy_version 386526 (0.0008) [2023-12-27 21:59:59,959][106225] Updated weights for policy 1, policy_version 386536 (0.0008) [2023-12-27 22:00:00,221][106226] Updated weights for policy 0, policy_version 385546 (0.0006) [2023-12-27 22:00:00,287][106226] Updated weights for policy 0, policy_version 385556 (0.0008) [2023-12-27 22:00:00,348][106226] Updated weights for policy 0, policy_version 385566 (0.0009) [2023-12-27 22:00:00,408][106226] Updated weights for policy 0, policy_version 385576 (0.0008) [2023-12-27 22:00:00,575][106225] Updated weights for policy 1, policy_version 386546 (0.0006) [2023-12-27 22:00:00,621][106225] Updated weights for policy 1, policy_version 386556 (0.0009) [2023-12-27 22:00:00,678][106225] Updated weights for policy 1, policy_version 386566 (0.0009) [2023-12-27 22:00:00,734][106225] Updated weights for policy 1, policy_version 386576 (0.0008) [2023-12-27 22:00:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 197730304. Throughput: 0: 9692.5, 1: 10185.1. Samples: 197722780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:00:01,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-6.033')] [2023-12-27 22:00:01,208][106226] Updated weights for policy 0, policy_version 385586 (0.0009) [2023-12-27 22:00:01,281][106226] Updated weights for policy 0, policy_version 385596 (0.0008) [2023-12-27 22:00:01,344][106226] Updated weights for policy 0, policy_version 385606 (0.0008) [2023-12-27 22:00:01,598][106225] Updated weights for policy 1, policy_version 386586 (0.0009) [2023-12-27 22:00:01,667][106225] Updated weights for policy 1, policy_version 386596 (0.0008) [2023-12-27 22:00:01,742][106225] Updated weights for policy 1, policy_version 386606 (0.0008) [2023-12-27 22:00:02,139][106226] Updated weights for policy 0, policy_version 385616 (0.0006) [2023-12-27 22:00:02,191][106226] Updated weights for policy 0, policy_version 385626 (0.0009) [2023-12-27 22:00:02,239][106226] Updated weights for policy 0, policy_version 385636 (0.0008) [2023-12-27 22:00:02,421][106225] Updated weights for policy 1, policy_version 386616 (0.0008) [2023-12-27 22:00:02,481][106225] Updated weights for policy 1, policy_version 386626 (0.0008) [2023-12-27 22:00:02,540][106225] Updated weights for policy 1, policy_version 386636 (0.0009) [2023-12-27 22:00:02,950][106226] Updated weights for policy 0, policy_version 385646 (0.0009) [2023-12-27 22:00:03,018][106226] Updated weights for policy 0, policy_version 385656 (0.0009) [2023-12-27 22:00:03,081][106226] Updated weights for policy 0, policy_version 385666 (0.0008) [2023-12-27 22:00:03,234][106225] Updated weights for policy 1, policy_version 386646 (0.0008) [2023-12-27 22:00:03,287][106225] Updated weights for policy 1, policy_version 386656 (0.0009) [2023-12-27 22:00:03,349][106225] Updated weights for policy 1, policy_version 386666 (0.0009) [2023-12-27 22:00:03,852][106226] Updated weights for policy 0, policy_version 385676 (0.0009) [2023-12-27 22:00:03,912][106226] Updated weights for policy 0, policy_version 385686 (0.0009) [2023-12-27 22:00:03,980][106226] Updated weights for policy 0, policy_version 385696 (0.0008) [2023-12-27 22:00:04,075][106225] Updated weights for policy 1, policy_version 386676 (0.0008) [2023-12-27 22:00:04,146][106225] Updated weights for policy 1, policy_version 386686 (0.0009) [2023-12-27 22:00:04,222][106225] Updated weights for policy 1, policy_version 386696 (0.0009) [2023-12-27 22:00:04,783][106226] Updated weights for policy 0, policy_version 385706 (0.0009) [2023-12-27 22:00:04,861][106226] Updated weights for policy 0, policy_version 385716 (0.0008) [2023-12-27 22:00:04,923][106226] Updated weights for policy 0, policy_version 385726 (0.0009) [2023-12-27 22:00:04,975][106225] Updated weights for policy 1, policy_version 386706 (0.0008) [2023-12-27 22:00:04,983][106226] Updated weights for policy 0, policy_version 385736 (0.0008) [2023-12-27 22:00:05,039][106225] Updated weights for policy 1, policy_version 386716 (0.0005) [2023-12-27 22:00:05,104][106225] Updated weights for policy 1, policy_version 386726 (0.0005) [2023-12-27 22:00:05,165][106225] Updated weights for policy 1, policy_version 386736 (0.0006) [2023-12-27 22:00:05,631][106226] Updated weights for policy 0, policy_version 385746 (0.0008) [2023-12-27 22:00:05,701][106226] Updated weights for policy 0, policy_version 385756 (0.0009) [2023-12-27 22:00:05,772][106226] Updated weights for policy 0, policy_version 385766 (0.0009) [2023-12-27 22:00:05,851][106225] Updated weights for policy 1, policy_version 386746 (0.0008) [2023-12-27 22:00:05,912][106225] Updated weights for policy 1, policy_version 386756 (0.0009) [2023-12-27 22:00:05,976][106225] Updated weights for policy 1, policy_version 386766 (0.0008) [2023-12-27 22:00:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 197828608. Throughput: 0: 9671.5, 1: 10159.9. Samples: 197834340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:00:06,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-5.431')] [2023-12-27 22:00:06,552][106226] Updated weights for policy 0, policy_version 385776 (0.0009) [2023-12-27 22:00:06,624][106226] Updated weights for policy 0, policy_version 385786 (0.0008) [2023-12-27 22:00:06,691][106226] Updated weights for policy 0, policy_version 385796 (0.0008) [2023-12-27 22:00:06,756][106225] Updated weights for policy 1, policy_version 386776 (0.0010) [2023-12-27 22:00:06,831][106225] Updated weights for policy 1, policy_version 386786 (0.0009) [2023-12-27 22:00:06,898][106225] Updated weights for policy 1, policy_version 386796 (0.0011) [2023-12-27 22:00:07,453][106226] Updated weights for policy 0, policy_version 385806 (0.0008) [2023-12-27 22:00:07,514][106226] Updated weights for policy 0, policy_version 385816 (0.0008) [2023-12-27 22:00:07,581][106226] Updated weights for policy 0, policy_version 385826 (0.0007) [2023-12-27 22:00:07,597][106225] Updated weights for policy 1, policy_version 386806 (0.0010) [2023-12-27 22:00:07,662][106225] Updated weights for policy 1, policy_version 386816 (0.0011) [2023-12-27 22:00:07,723][106225] Updated weights for policy 1, policy_version 386826 (0.0010) [2023-12-27 22:00:08,353][106226] Updated weights for policy 0, policy_version 385836 (0.0010) [2023-12-27 22:00:08,423][106226] Updated weights for policy 0, policy_version 385846 (0.0009) [2023-12-27 22:00:08,470][106225] Updated weights for policy 1, policy_version 386836 (0.0008) [2023-12-27 22:00:08,489][106226] Updated weights for policy 0, policy_version 385856 (0.0007) [2023-12-27 22:00:08,535][106225] Updated weights for policy 1, policy_version 386846 (0.0008) [2023-12-27 22:00:08,605][106225] Updated weights for policy 1, policy_version 386856 (0.0008) [2023-12-27 22:00:09,175][106226] Updated weights for policy 0, policy_version 385866 (0.0007) [2023-12-27 22:00:09,237][106226] Updated weights for policy 0, policy_version 385876 (0.0008) [2023-12-27 22:00:09,316][106226] Updated weights for policy 0, policy_version 385886 (0.0010) [2023-12-27 22:00:09,360][106225] Updated weights for policy 1, policy_version 386866 (0.0008) [2023-12-27 22:00:09,386][106226] Updated weights for policy 0, policy_version 385896 (0.0009) [2023-12-27 22:00:09,439][106225] Updated weights for policy 1, policy_version 386876 (0.0013) [2023-12-27 22:00:09,507][106225] Updated weights for policy 1, policy_version 386886 (0.0009) [2023-12-27 22:00:09,581][106225] Updated weights for policy 1, policy_version 386896 (0.0011) [2023-12-27 22:00:10,189][106226] Updated weights for policy 0, policy_version 385906 (0.0008) [2023-12-27 22:00:10,251][106226] Updated weights for policy 0, policy_version 385916 (0.0008) [2023-12-27 22:00:10,319][106226] Updated weights for policy 0, policy_version 385926 (0.0006) [2023-12-27 22:00:10,325][106225] Updated weights for policy 1, policy_version 386906 (0.0011) [2023-12-27 22:00:10,397][106225] Updated weights for policy 1, policy_version 386916 (0.0011) [2023-12-27 22:00:10,461][106225] Updated weights for policy 1, policy_version 386926 (0.0011) [2023-12-27 22:00:11,096][106226] Updated weights for policy 0, policy_version 385936 (0.0007) [2023-12-27 22:00:11,170][106226] Updated weights for policy 0, policy_version 385946 (0.0009) [2023-12-27 22:00:11,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 197910528. Throughput: 0: 9612.8, 1: 10115.3. Samples: 197889912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:00:11,175][105115] Avg episode reward: [(0, '-4.917'), (1, '-5.613')] [2023-12-27 22:00:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000386928_99082240.pth... [2023-12-27 22:00:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000385776_98787328.pth [2023-12-27 22:00:11,231][106226] Updated weights for policy 0, policy_version 385956 (0.0008) [2023-12-27 22:00:11,248][106225] Updated weights for policy 1, policy_version 386936 (0.0009) [2023-12-27 22:00:11,253][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000385960_98836480.pth... [2023-12-27 22:00:11,257][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000384840_98549760.pth [2023-12-27 22:00:11,311][106225] Updated weights for policy 1, policy_version 386946 (0.0006) [2023-12-27 22:00:11,385][106225] Updated weights for policy 1, policy_version 386956 (0.0009) [2023-12-27 22:00:12,028][106226] Updated weights for policy 0, policy_version 385966 (0.0008) [2023-12-27 22:00:12,103][106226] Updated weights for policy 0, policy_version 385976 (0.0008) [2023-12-27 22:00:12,177][106226] Updated weights for policy 0, policy_version 385986 (0.0007) [2023-12-27 22:00:12,186][106225] Updated weights for policy 1, policy_version 386966 (0.0011) [2023-12-27 22:00:12,261][106225] Updated weights for policy 1, policy_version 386976 (0.0011) [2023-12-27 22:00:12,327][106225] Updated weights for policy 1, policy_version 386986 (0.0012) [2023-12-27 22:00:12,822][106226] Updated weights for policy 0, policy_version 385996 (0.0008) [2023-12-27 22:00:12,879][106226] Updated weights for policy 0, policy_version 386006 (0.0011) [2023-12-27 22:00:12,936][106226] Updated weights for policy 0, policy_version 386016 (0.0011) [2023-12-27 22:00:13,051][106225] Updated weights for policy 1, policy_version 386996 (0.0010) [2023-12-27 22:00:13,111][106225] Updated weights for policy 1, policy_version 387006 (0.0011) [2023-12-27 22:00:13,171][106225] Updated weights for policy 1, policy_version 387016 (0.0011) [2023-12-27 22:00:13,617][106226] Updated weights for policy 0, policy_version 386026 (0.0010) [2023-12-27 22:00:13,682][106226] Updated weights for policy 0, policy_version 386036 (0.0006) [2023-12-27 22:00:13,740][106226] Updated weights for policy 0, policy_version 386046 (0.0005) [2023-12-27 22:00:13,806][106226] Updated weights for policy 0, policy_version 386056 (0.0008) [2023-12-27 22:00:13,922][106225] Updated weights for policy 1, policy_version 387026 (0.0011) [2023-12-27 22:00:13,976][106225] Updated weights for policy 1, policy_version 387036 (0.0010) [2023-12-27 22:00:14,043][106225] Updated weights for policy 1, policy_version 387046 (0.0008) [2023-12-27 22:00:14,112][106225] Updated weights for policy 1, policy_version 387056 (0.0008) [2023-12-27 22:00:14,477][106226] Updated weights for policy 0, policy_version 386066 (0.0009) [2023-12-27 22:00:14,548][106226] Updated weights for policy 0, policy_version 386076 (0.0008) [2023-12-27 22:00:14,619][106226] Updated weights for policy 0, policy_version 386086 (0.0006) [2023-12-27 22:00:14,782][106225] Updated weights for policy 1, policy_version 387066 (0.0007) [2023-12-27 22:00:14,844][106225] Updated weights for policy 1, policy_version 387076 (0.0008) [2023-12-27 22:00:14,899][106225] Updated weights for policy 1, policy_version 387086 (0.0008) [2023-12-27 22:00:15,340][106226] Updated weights for policy 0, policy_version 386096 (0.0011) [2023-12-27 22:00:15,408][106226] Updated weights for policy 0, policy_version 386106 (0.0011) [2023-12-27 22:00:15,479][106226] Updated weights for policy 0, policy_version 386116 (0.0009) [2023-12-27 22:00:15,673][106225] Updated weights for policy 1, policy_version 387096 (0.0009) [2023-12-27 22:00:15,745][106225] Updated weights for policy 1, policy_version 387106 (0.0006) [2023-12-27 22:00:15,805][106225] Updated weights for policy 1, policy_version 387116 (0.0007) [2023-12-27 22:00:16,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 198008832. Throughput: 0: 9541.8, 1: 9832.9. Samples: 198000812. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:16,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.843')] [2023-12-27 22:00:16,190][106226] Updated weights for policy 0, policy_version 386126 (0.0011) [2023-12-27 22:00:16,247][106226] Updated weights for policy 0, policy_version 386136 (0.0011) [2023-12-27 22:00:16,307][106226] Updated weights for policy 0, policy_version 386146 (0.0009) [2023-12-27 22:00:16,459][106225] Updated weights for policy 1, policy_version 387126 (0.0007) [2023-12-27 22:00:16,520][106225] Updated weights for policy 1, policy_version 387136 (0.0008) [2023-12-27 22:00:16,572][106225] Updated weights for policy 1, policy_version 387146 (0.0007) [2023-12-27 22:00:16,972][106226] Updated weights for policy 0, policy_version 386156 (0.0009) [2023-12-27 22:00:17,037][106226] Updated weights for policy 0, policy_version 386166 (0.0011) [2023-12-27 22:00:17,103][106226] Updated weights for policy 0, policy_version 386176 (0.0011) [2023-12-27 22:00:17,267][106225] Updated weights for policy 1, policy_version 387156 (0.0007) [2023-12-27 22:00:17,329][106225] Updated weights for policy 1, policy_version 387166 (0.0008) [2023-12-27 22:00:17,393][106225] Updated weights for policy 1, policy_version 387176 (0.0010) [2023-12-27 22:00:17,714][106226] Updated weights for policy 0, policy_version 386186 (0.0010) [2023-12-27 22:00:17,765][106226] Updated weights for policy 0, policy_version 386196 (0.0005) [2023-12-27 22:00:17,810][106226] Updated weights for policy 0, policy_version 386206 (0.0005) [2023-12-27 22:00:17,861][106226] Updated weights for policy 0, policy_version 386216 (0.0005) [2023-12-27 22:00:18,204][106225] Updated weights for policy 1, policy_version 387186 (0.0007) [2023-12-27 22:00:18,270][106225] Updated weights for policy 1, policy_version 387196 (0.0005) [2023-12-27 22:00:18,339][106225] Updated weights for policy 1, policy_version 387206 (0.0007) [2023-12-27 22:00:18,410][106225] Updated weights for policy 1, policy_version 387216 (0.0008) [2023-12-27 22:00:18,605][106226] Updated weights for policy 0, policy_version 386226 (0.0008) [2023-12-27 22:00:18,675][106226] Updated weights for policy 0, policy_version 386236 (0.0008) [2023-12-27 22:00:18,734][106226] Updated weights for policy 0, policy_version 386246 (0.0007) [2023-12-27 22:00:19,117][106225] Updated weights for policy 1, policy_version 387226 (0.0010) [2023-12-27 22:00:19,168][106225] Updated weights for policy 1, policy_version 387236 (0.0010) [2023-12-27 22:00:19,228][106225] Updated weights for policy 1, policy_version 387246 (0.0010) [2023-12-27 22:00:19,536][106226] Updated weights for policy 0, policy_version 386256 (0.0010) [2023-12-27 22:00:19,601][106226] Updated weights for policy 0, policy_version 386266 (0.0009) [2023-12-27 22:00:19,669][106226] Updated weights for policy 0, policy_version 386276 (0.0008) [2023-12-27 22:00:20,135][106225] Updated weights for policy 1, policy_version 387256 (0.0008) [2023-12-27 22:00:20,182][106225] Updated weights for policy 1, policy_version 387266 (0.0010) [2023-12-27 22:00:20,236][106225] Updated weights for policy 1, policy_version 387276 (0.0010) [2023-12-27 22:00:20,471][106226] Updated weights for policy 0, policy_version 386286 (0.0008) [2023-12-27 22:00:20,538][106226] Updated weights for policy 0, policy_version 386296 (0.0007) [2023-12-27 22:00:20,615][106226] Updated weights for policy 0, policy_version 386306 (0.0008) [2023-12-27 22:00:21,015][106225] Updated weights for policy 1, policy_version 387286 (0.0010) [2023-12-27 22:00:21,101][106225] Updated weights for policy 1, policy_version 387296 (0.0011) [2023-12-27 22:00:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19799.7). Total num frames: 198098944. Throughput: 0: 9484.5, 1: 9695.0. Samples: 198113752. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:21,175][106225] Updated weights for policy 1, policy_version 387306 (0.0009) [2023-12-27 22:00:21,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.496')] [2023-12-27 22:00:21,416][106226] Updated weights for policy 0, policy_version 386316 (0.0008) [2023-12-27 22:00:21,476][106226] Updated weights for policy 0, policy_version 386326 (0.0006) [2023-12-27 22:00:21,544][106226] Updated weights for policy 0, policy_version 386336 (0.0006) [2023-12-27 22:00:21,936][106225] Updated weights for policy 1, policy_version 387316 (0.0011) [2023-12-27 22:00:22,003][106225] Updated weights for policy 1, policy_version 387326 (0.0011) [2023-12-27 22:00:22,070][106225] Updated weights for policy 1, policy_version 387336 (0.0011) [2023-12-27 22:00:22,297][106226] Updated weights for policy 0, policy_version 386346 (0.0007) [2023-12-27 22:00:22,367][106226] Updated weights for policy 0, policy_version 386356 (0.0009) [2023-12-27 22:00:22,441][106226] Updated weights for policy 0, policy_version 386366 (0.0009) [2023-12-27 22:00:22,510][106226] Updated weights for policy 0, policy_version 386376 (0.0009) [2023-12-27 22:00:22,830][106225] Updated weights for policy 1, policy_version 387346 (0.0010) [2023-12-27 22:00:22,890][106225] Updated weights for policy 1, policy_version 387356 (0.0007) [2023-12-27 22:00:22,955][106225] Updated weights for policy 1, policy_version 387366 (0.0007) [2023-12-27 22:00:23,028][106225] Updated weights for policy 1, policy_version 387376 (0.0008) [2023-12-27 22:00:23,305][106226] Updated weights for policy 0, policy_version 386386 (0.0010) [2023-12-27 22:00:23,366][106226] Updated weights for policy 0, policy_version 386396 (0.0008) [2023-12-27 22:00:23,434][106226] Updated weights for policy 0, policy_version 386406 (0.0009) [2023-12-27 22:00:23,742][106225] Updated weights for policy 1, policy_version 387386 (0.0007) [2023-12-27 22:00:23,800][106225] Updated weights for policy 1, policy_version 387396 (0.0008) [2023-12-27 22:00:23,852][106225] Updated weights for policy 1, policy_version 387406 (0.0008) [2023-12-27 22:00:24,149][106226] Updated weights for policy 0, policy_version 386416 (0.0008) [2023-12-27 22:00:24,215][106226] Updated weights for policy 0, policy_version 386426 (0.0009) [2023-12-27 22:00:24,275][106226] Updated weights for policy 0, policy_version 386436 (0.0008) [2023-12-27 22:00:24,542][106225] Updated weights for policy 1, policy_version 387416 (0.0008) [2023-12-27 22:00:24,603][106225] Updated weights for policy 1, policy_version 387426 (0.0008) [2023-12-27 22:00:24,659][106225] Updated weights for policy 1, policy_version 387436 (0.0008) [2023-12-27 22:00:25,006][106226] Updated weights for policy 0, policy_version 386446 (0.0010) [2023-12-27 22:00:25,057][106226] Updated weights for policy 0, policy_version 386456 (0.0009) [2023-12-27 22:00:25,107][106226] Updated weights for policy 0, policy_version 386466 (0.0010) [2023-12-27 22:00:25,319][106225] Updated weights for policy 1, policy_version 387446 (0.0006) [2023-12-27 22:00:25,382][106225] Updated weights for policy 1, policy_version 387456 (0.0005) [2023-12-27 22:00:25,435][106225] Updated weights for policy 1, policy_version 387466 (0.0005) [2023-12-27 22:00:25,847][106226] Updated weights for policy 0, policy_version 386476 (0.0010) [2023-12-27 22:00:25,893][106226] Updated weights for policy 0, policy_version 386486 (0.0010) [2023-12-27 22:00:25,950][106226] Updated weights for policy 0, policy_version 386496 (0.0011) [2023-12-27 22:00:26,045][106225] Updated weights for policy 1, policy_version 387476 (0.0005) [2023-12-27 22:00:26,095][106225] Updated weights for policy 1, policy_version 387486 (0.0006) [2023-12-27 22:00:26,151][106225] Updated weights for policy 1, policy_version 387496 (0.0006) [2023-12-27 22:00:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 198197248. Throughput: 0: 9428.5, 1: 9656.5. Samples: 198167904. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:26,175][105115] Avg episode reward: [(0, '-5.028'), (1, '-5.438')] [2023-12-27 22:00:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000386504_98975744.pth... [2023-12-27 22:00:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000385416_98697216.pth [2023-12-27 22:00:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000387504_99229696.pth... [2023-12-27 22:00:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000386384_98942976.pth [2023-12-27 22:00:26,675][106226] Updated weights for policy 0, policy_version 386506 (0.0010) [2023-12-27 22:00:26,728][106226] Updated weights for policy 0, policy_version 386516 (0.0010) [2023-12-27 22:00:26,788][106226] Updated weights for policy 0, policy_version 386526 (0.0011) [2023-12-27 22:00:26,852][106226] Updated weights for policy 0, policy_version 386536 (0.0011) [2023-12-27 22:00:26,890][106225] Updated weights for policy 1, policy_version 387506 (0.0008) [2023-12-27 22:00:26,951][106225] Updated weights for policy 1, policy_version 387516 (0.0008) [2023-12-27 22:00:26,998][106225] Updated weights for policy 1, policy_version 387526 (0.0008) [2023-12-27 22:00:27,050][106225] Updated weights for policy 1, policy_version 387536 (0.0008) [2023-12-27 22:00:27,513][106226] Updated weights for policy 0, policy_version 386546 (0.0009) [2023-12-27 22:00:27,559][106226] Updated weights for policy 0, policy_version 386556 (0.0010) [2023-12-27 22:00:27,620][106226] Updated weights for policy 0, policy_version 386566 (0.0010) [2023-12-27 22:00:27,859][106225] Updated weights for policy 1, policy_version 387546 (0.0009) [2023-12-27 22:00:27,918][106225] Updated weights for policy 1, policy_version 387556 (0.0009) [2023-12-27 22:00:27,971][106225] Updated weights for policy 1, policy_version 387566 (0.0005) [2023-12-27 22:00:28,187][106226] Updated weights for policy 0, policy_version 386576 (0.0010) [2023-12-27 22:00:28,241][106226] Updated weights for policy 0, policy_version 386586 (0.0011) [2023-12-27 22:00:28,298][106226] Updated weights for policy 0, policy_version 386596 (0.0011) [2023-12-27 22:00:28,718][106225] Updated weights for policy 1, policy_version 387576 (0.0008) [2023-12-27 22:00:28,783][106225] Updated weights for policy 1, policy_version 387586 (0.0008) [2023-12-27 22:00:28,857][106225] Updated weights for policy 1, policy_version 387596 (0.0008) [2023-12-27 22:00:29,099][106226] Updated weights for policy 0, policy_version 386606 (0.0010) [2023-12-27 22:00:29,147][106226] Updated weights for policy 0, policy_version 386616 (0.0008) [2023-12-27 22:00:29,201][106226] Updated weights for policy 0, policy_version 386626 (0.0007) [2023-12-27 22:00:29,543][106225] Updated weights for policy 1, policy_version 387606 (0.0007) [2023-12-27 22:00:29,610][106225] Updated weights for policy 1, policy_version 387616 (0.0008) [2023-12-27 22:00:29,676][106225] Updated weights for policy 1, policy_version 387626 (0.0008) [2023-12-27 22:00:29,961][106226] Updated weights for policy 0, policy_version 386636 (0.0009) [2023-12-27 22:00:30,031][106226] Updated weights for policy 0, policy_version 386646 (0.0008) [2023-12-27 22:00:30,095][106226] Updated weights for policy 0, policy_version 386656 (0.0006) [2023-12-27 22:00:30,387][106225] Updated weights for policy 1, policy_version 387636 (0.0008) [2023-12-27 22:00:30,435][106225] Updated weights for policy 1, policy_version 387646 (0.0008) [2023-12-27 22:00:30,483][106225] Updated weights for policy 1, policy_version 387656 (0.0008) [2023-12-27 22:00:30,777][106226] Updated weights for policy 0, policy_version 386666 (0.0006) [2023-12-27 22:00:30,842][106226] Updated weights for policy 0, policy_version 386676 (0.0005) [2023-12-27 22:00:30,894][106226] Updated weights for policy 0, policy_version 386686 (0.0005) [2023-12-27 22:00:30,959][106226] Updated weights for policy 0, policy_version 386696 (0.0008) [2023-12-27 22:00:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19251.2, 300 sec: 19744.1). Total num frames: 198295552. Throughput: 0: 9475.4, 1: 9614.6. Samples: 198285476. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:31,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-5.928')] [2023-12-27 22:00:31,232][106225] Updated weights for policy 1, policy_version 387666 (0.0008) [2023-12-27 22:00:31,296][106225] Updated weights for policy 1, policy_version 387676 (0.0007) [2023-12-27 22:00:31,365][106225] Updated weights for policy 1, policy_version 387686 (0.0008) [2023-12-27 22:00:31,431][106225] Updated weights for policy 1, policy_version 387696 (0.0008) [2023-12-27 22:00:31,725][106226] Updated weights for policy 0, policy_version 386706 (0.0008) [2023-12-27 22:00:31,800][106226] Updated weights for policy 0, policy_version 386716 (0.0008) [2023-12-27 22:00:31,865][106226] Updated weights for policy 0, policy_version 386726 (0.0008) [2023-12-27 22:00:32,181][106225] Updated weights for policy 1, policy_version 387706 (0.0006) [2023-12-27 22:00:32,253][106225] Updated weights for policy 1, policy_version 387716 (0.0011) [2023-12-27 22:00:32,320][106225] Updated weights for policy 1, policy_version 387726 (0.0010) [2023-12-27 22:00:32,685][106226] Updated weights for policy 0, policy_version 386736 (0.0011) [2023-12-27 22:00:32,752][106226] Updated weights for policy 0, policy_version 386746 (0.0011) [2023-12-27 22:00:32,813][106226] Updated weights for policy 0, policy_version 386756 (0.0011) [2023-12-27 22:00:33,074][106225] Updated weights for policy 1, policy_version 387736 (0.0006) [2023-12-27 22:00:33,120][106225] Updated weights for policy 1, policy_version 387746 (0.0005) [2023-12-27 22:00:33,182][106225] Updated weights for policy 1, policy_version 387756 (0.0005) [2023-12-27 22:00:33,523][106226] Updated weights for policy 0, policy_version 386766 (0.0011) [2023-12-27 22:00:33,577][106226] Updated weights for policy 0, policy_version 386776 (0.0011) [2023-12-27 22:00:33,630][106226] Updated weights for policy 0, policy_version 386786 (0.0010) [2023-12-27 22:00:33,758][106225] Updated weights for policy 1, policy_version 387766 (0.0009) [2023-12-27 22:00:33,819][106225] Updated weights for policy 1, policy_version 387776 (0.0010) [2023-12-27 22:00:33,878][106225] Updated weights for policy 1, policy_version 387786 (0.0011) [2023-12-27 22:00:34,373][106226] Updated weights for policy 0, policy_version 386796 (0.0010) [2023-12-27 22:00:34,445][106226] Updated weights for policy 0, policy_version 386806 (0.0009) [2023-12-27 22:00:34,510][106226] Updated weights for policy 0, policy_version 386816 (0.0008) [2023-12-27 22:00:34,645][106225] Updated weights for policy 1, policy_version 387796 (0.0010) [2023-12-27 22:00:34,713][106225] Updated weights for policy 1, policy_version 387806 (0.0008) [2023-12-27 22:00:34,771][106225] Updated weights for policy 1, policy_version 387816 (0.0008) [2023-12-27 22:00:35,235][106226] Updated weights for policy 0, policy_version 386826 (0.0007) [2023-12-27 22:00:35,302][106226] Updated weights for policy 0, policy_version 386836 (0.0007) [2023-12-27 22:00:35,356][106226] Updated weights for policy 0, policy_version 386846 (0.0007) [2023-12-27 22:00:35,417][106226] Updated weights for policy 0, policy_version 386856 (0.0005) [2023-12-27 22:00:35,597][106225] Updated weights for policy 1, policy_version 387826 (0.0008) [2023-12-27 22:00:35,655][106225] Updated weights for policy 1, policy_version 387836 (0.0009) [2023-12-27 22:00:35,717][106225] Updated weights for policy 1, policy_version 387846 (0.0009) [2023-12-27 22:00:35,780][106225] Updated weights for policy 1, policy_version 387856 (0.0009) [2023-12-27 22:00:36,036][106226] Updated weights for policy 0, policy_version 386866 (0.0009) [2023-12-27 22:00:36,096][106226] Updated weights for policy 0, policy_version 386876 (0.0009) [2023-12-27 22:00:36,170][106226] Updated weights for policy 0, policy_version 386886 (0.0008) [2023-12-27 22:00:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19114.6, 300 sec: 19716.3). Total num frames: 198385664. Throughput: 0: 9491.3, 1: 9485.5. Samples: 198399612. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:36,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.683')] [2023-12-27 22:00:36,503][106225] Updated weights for policy 1, policy_version 387866 (0.0009) [2023-12-27 22:00:36,568][106225] Updated weights for policy 1, policy_version 387876 (0.0010) [2023-12-27 22:00:36,629][106225] Updated weights for policy 1, policy_version 387886 (0.0011) [2023-12-27 22:00:36,968][106226] Updated weights for policy 0, policy_version 386896 (0.0008) [2023-12-27 22:00:37,042][106226] Updated weights for policy 0, policy_version 386906 (0.0008) [2023-12-27 22:00:37,119][106226] Updated weights for policy 0, policy_version 386916 (0.0008) [2023-12-27 22:00:37,339][106225] Updated weights for policy 1, policy_version 387896 (0.0011) [2023-12-27 22:00:37,401][106225] Updated weights for policy 1, policy_version 387906 (0.0011) [2023-12-27 22:00:37,460][106225] Updated weights for policy 1, policy_version 387916 (0.0011) [2023-12-27 22:00:37,838][106226] Updated weights for policy 0, policy_version 386926 (0.0007) [2023-12-27 22:00:37,895][106226] Updated weights for policy 0, policy_version 386936 (0.0005) [2023-12-27 22:00:37,943][106226] Updated weights for policy 0, policy_version 386946 (0.0006) [2023-12-27 22:00:38,178][106225] Updated weights for policy 1, policy_version 387926 (0.0009) [2023-12-27 22:00:38,251][106225] Updated weights for policy 1, policy_version 387936 (0.0009) [2023-12-27 22:00:38,312][106225] Updated weights for policy 1, policy_version 387946 (0.0008) [2023-12-27 22:00:38,688][106226] Updated weights for policy 0, policy_version 386956 (0.0010) [2023-12-27 22:00:38,760][106226] Updated weights for policy 0, policy_version 386966 (0.0009) [2023-12-27 22:00:38,834][106226] Updated weights for policy 0, policy_version 386976 (0.0009) [2023-12-27 22:00:39,133][106225] Updated weights for policy 1, policy_version 387956 (0.0009) [2023-12-27 22:00:39,183][106225] Updated weights for policy 1, policy_version 387966 (0.0007) [2023-12-27 22:00:39,253][106225] Updated weights for policy 1, policy_version 387976 (0.0008) [2023-12-27 22:00:39,510][106226] Updated weights for policy 0, policy_version 386986 (0.0010) [2023-12-27 22:00:39,578][106226] Updated weights for policy 0, policy_version 386996 (0.0007) [2023-12-27 22:00:39,647][106226] Updated weights for policy 0, policy_version 387006 (0.0009) [2023-12-27 22:00:39,717][106226] Updated weights for policy 0, policy_version 387016 (0.0008) [2023-12-27 22:00:40,116][106225] Updated weights for policy 1, policy_version 387986 (0.0008) [2023-12-27 22:00:40,188][106225] Updated weights for policy 1, policy_version 387996 (0.0009) [2023-12-27 22:00:40,250][106225] Updated weights for policy 1, policy_version 388006 (0.0009) [2023-12-27 22:00:40,317][106225] Updated weights for policy 1, policy_version 388016 (0.0009) [2023-12-27 22:00:40,422][106226] Updated weights for policy 0, policy_version 387026 (0.0006) [2023-12-27 22:00:40,483][106226] Updated weights for policy 0, policy_version 387036 (0.0008) [2023-12-27 22:00:40,540][106226] Updated weights for policy 0, policy_version 387046 (0.0009) [2023-12-27 22:00:41,012][106225] Updated weights for policy 1, policy_version 388026 (0.0005) [2023-12-27 22:00:41,080][106225] Updated weights for policy 1, policy_version 388036 (0.0009) [2023-12-27 22:00:41,149][106225] Updated weights for policy 1, policy_version 388046 (0.0009) [2023-12-27 22:00:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19114.7, 300 sec: 19716.3). Total num frames: 198483968. Throughput: 0: 9466.9, 1: 9439.9. Samples: 198455324. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:41,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-5.705')] [2023-12-27 22:00:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000388048_99368960.pth... [2023-12-27 22:00:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000387048_99115008.pth... [2023-12-27 22:00:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000386928_99082240.pth [2023-12-27 22:00:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000385960_98836480.pth [2023-12-27 22:00:41,322][106226] Updated weights for policy 0, policy_version 387056 (0.0008) [2023-12-27 22:00:41,397][106226] Updated weights for policy 0, policy_version 387066 (0.0009) [2023-12-27 22:00:41,470][106226] Updated weights for policy 0, policy_version 387076 (0.0007) [2023-12-27 22:00:42,010][106225] Updated weights for policy 1, policy_version 388056 (0.0008) [2023-12-27 22:00:42,073][106225] Updated weights for policy 1, policy_version 388066 (0.0009) [2023-12-27 22:00:42,126][106225] Updated weights for policy 1, policy_version 388076 (0.0008) [2023-12-27 22:00:42,164][106226] Updated weights for policy 0, policy_version 387086 (0.0008) [2023-12-27 22:00:42,221][106226] Updated weights for policy 0, policy_version 387096 (0.0009) [2023-12-27 22:00:42,282][106226] Updated weights for policy 0, policy_version 387106 (0.0007) [2023-12-27 22:00:42,933][106225] Updated weights for policy 1, policy_version 388086 (0.0006) [2023-12-27 22:00:43,000][106225] Updated weights for policy 1, policy_version 388096 (0.0008) [2023-12-27 22:00:43,062][106225] Updated weights for policy 1, policy_version 388106 (0.0009) [2023-12-27 22:00:43,087][106226] Updated weights for policy 0, policy_version 387116 (0.0008) [2023-12-27 22:00:43,150][106226] Updated weights for policy 0, policy_version 387126 (0.0007) [2023-12-27 22:00:43,211][106226] Updated weights for policy 0, policy_version 387136 (0.0008) [2023-12-27 22:00:43,787][106225] Updated weights for policy 1, policy_version 388116 (0.0011) [2023-12-27 22:00:43,850][106225] Updated weights for policy 1, policy_version 388126 (0.0011) [2023-12-27 22:00:43,911][106225] Updated weights for policy 1, policy_version 388136 (0.0010) [2023-12-27 22:00:43,925][106226] Updated weights for policy 0, policy_version 387146 (0.0007) [2023-12-27 22:00:43,985][106226] Updated weights for policy 0, policy_version 387156 (0.0007) [2023-12-27 22:00:44,046][106226] Updated weights for policy 0, policy_version 387166 (0.0008) [2023-12-27 22:00:44,112][106226] Updated weights for policy 0, policy_version 387176 (0.0007) [2023-12-27 22:00:44,646][106225] Updated weights for policy 1, policy_version 388146 (0.0011) [2023-12-27 22:00:44,709][106225] Updated weights for policy 1, policy_version 388156 (0.0010) [2023-12-27 22:00:44,786][106225] Updated weights for policy 1, policy_version 388166 (0.0010) [2023-12-27 22:00:44,832][106226] Updated weights for policy 0, policy_version 387186 (0.0007) [2023-12-27 22:00:44,850][106225] Updated weights for policy 1, policy_version 388176 (0.0008) [2023-12-27 22:00:44,900][106226] Updated weights for policy 0, policy_version 387196 (0.0007) [2023-12-27 22:00:44,962][106226] Updated weights for policy 0, policy_version 387206 (0.0008) [2023-12-27 22:00:45,595][106225] Updated weights for policy 1, policy_version 388186 (0.0009) [2023-12-27 22:00:45,656][106225] Updated weights for policy 1, policy_version 388196 (0.0008) [2023-12-27 22:00:45,719][106226] Updated weights for policy 0, policy_version 387216 (0.0006) [2023-12-27 22:00:45,720][106225] Updated weights for policy 1, policy_version 388206 (0.0011) [2023-12-27 22:00:45,774][106226] Updated weights for policy 0, policy_version 387226 (0.0008) [2023-12-27 22:00:45,828][106226] Updated weights for policy 0, policy_version 387236 (0.0008) [2023-12-27 22:00:46,175][105115] Fps is (10 sec: 18841.9, 60 sec: 18978.1, 300 sec: 19688.6). Total num frames: 198574080. Throughput: 0: 9378.5, 1: 9328.2. Samples: 198564580. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:46,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.650')] [2023-12-27 22:00:46,372][106225] Updated weights for policy 1, policy_version 388216 (0.0010) [2023-12-27 22:00:46,437][106225] Updated weights for policy 1, policy_version 388226 (0.0010) [2023-12-27 22:00:46,504][106225] Updated weights for policy 1, policy_version 388236 (0.0009) [2023-12-27 22:00:46,582][106226] Updated weights for policy 0, policy_version 387246 (0.0009) [2023-12-27 22:00:46,647][106226] Updated weights for policy 0, policy_version 387256 (0.0006) [2023-12-27 22:00:46,703][106226] Updated weights for policy 0, policy_version 387266 (0.0009) [2023-12-27 22:00:47,195][106225] Updated weights for policy 1, policy_version 388246 (0.0008) [2023-12-27 22:00:47,250][106225] Updated weights for policy 1, policy_version 388256 (0.0006) [2023-12-27 22:00:47,302][106225] Updated weights for policy 1, policy_version 388266 (0.0008) [2023-12-27 22:00:47,406][106226] Updated weights for policy 0, policy_version 387276 (0.0010) [2023-12-27 22:00:47,470][106226] Updated weights for policy 0, policy_version 387286 (0.0009) [2023-12-27 22:00:47,531][106226] Updated weights for policy 0, policy_version 387296 (0.0008) [2023-12-27 22:00:47,997][106225] Updated weights for policy 1, policy_version 388276 (0.0009) [2023-12-27 22:00:48,056][106225] Updated weights for policy 1, policy_version 388286 (0.0010) [2023-12-27 22:00:48,113][106225] Updated weights for policy 1, policy_version 388296 (0.0010) [2023-12-27 22:00:48,269][106226] Updated weights for policy 0, policy_version 387306 (0.0007) [2023-12-27 22:00:48,335][106226] Updated weights for policy 0, policy_version 387316 (0.0009) [2023-12-27 22:00:48,405][106226] Updated weights for policy 0, policy_version 387326 (0.0009) [2023-12-27 22:00:48,470][106226] Updated weights for policy 0, policy_version 387336 (0.0008) [2023-12-27 22:00:48,817][106225] Updated weights for policy 1, policy_version 388306 (0.0010) [2023-12-27 22:00:48,889][106225] Updated weights for policy 1, policy_version 388316 (0.0008) [2023-12-27 22:00:48,955][106225] Updated weights for policy 1, policy_version 388326 (0.0008) [2023-12-27 22:00:49,017][106225] Updated weights for policy 1, policy_version 388336 (0.0008) [2023-12-27 22:00:49,210][106226] Updated weights for policy 0, policy_version 387346 (0.0009) [2023-12-27 22:00:49,267][106226] Updated weights for policy 0, policy_version 387356 (0.0008) [2023-12-27 22:00:49,326][106226] Updated weights for policy 0, policy_version 387366 (0.0008) [2023-12-27 22:00:49,851][106225] Updated weights for policy 1, policy_version 388346 (0.0009) [2023-12-27 22:00:49,912][106225] Updated weights for policy 1, policy_version 388356 (0.0008) [2023-12-27 22:00:49,982][106225] Updated weights for policy 1, policy_version 388366 (0.0009) [2023-12-27 22:00:50,141][106226] Updated weights for policy 0, policy_version 387376 (0.0008) [2023-12-27 22:00:50,204][106226] Updated weights for policy 0, policy_version 387386 (0.0009) [2023-12-27 22:00:50,267][106226] Updated weights for policy 0, policy_version 387396 (0.0009) [2023-12-27 22:00:50,760][106225] Updated weights for policy 1, policy_version 388376 (0.0008) [2023-12-27 22:00:50,822][106225] Updated weights for policy 1, policy_version 388386 (0.0009) [2023-12-27 22:00:50,890][106225] Updated weights for policy 1, policy_version 388396 (0.0008) [2023-12-27 22:00:51,052][106226] Updated weights for policy 0, policy_version 387406 (0.0008) [2023-12-27 22:00:51,119][106226] Updated weights for policy 0, policy_version 387416 (0.0009) [2023-12-27 22:00:51,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18841.6, 300 sec: 19633.0). Total num frames: 198664192. Throughput: 0: 9400.4, 1: 9321.4. Samples: 198676820. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:51,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.747')] [2023-12-27 22:00:51,187][106226] Updated weights for policy 0, policy_version 387426 (0.0009) [2023-12-27 22:00:51,697][106225] Updated weights for policy 1, policy_version 388406 (0.0009) [2023-12-27 22:00:51,767][106225] Updated weights for policy 1, policy_version 388416 (0.0009) [2023-12-27 22:00:51,824][106225] Updated weights for policy 1, policy_version 388426 (0.0007) [2023-12-27 22:00:52,023][106226] Updated weights for policy 0, policy_version 387436 (0.0010) [2023-12-27 22:00:52,081][106226] Updated weights for policy 0, policy_version 387446 (0.0011) [2023-12-27 22:00:52,142][106226] Updated weights for policy 0, policy_version 387456 (0.0011) [2023-12-27 22:00:52,511][106225] Updated weights for policy 1, policy_version 388436 (0.0007) [2023-12-27 22:00:52,565][106225] Updated weights for policy 1, policy_version 388446 (0.0006) [2023-12-27 22:00:52,622][106225] Updated weights for policy 1, policy_version 388456 (0.0007) [2023-12-27 22:00:53,204][106226] Updated weights for policy 0, policy_version 387466 (0.0011) [2023-12-27 22:00:53,261][106226] Updated weights for policy 0, policy_version 387477 (0.0011) [2023-12-27 22:00:53,327][106226] Updated weights for policy 0, policy_version 387487 (0.0011) [2023-12-27 22:00:53,374][106225] Updated weights for policy 1, policy_version 388466 (0.0008) [2023-12-27 22:00:53,438][106225] Updated weights for policy 1, policy_version 388476 (0.0011) [2023-12-27 22:00:53,502][106225] Updated weights for policy 1, policy_version 388486 (0.0011) [2023-12-27 22:00:53,566][106225] Updated weights for policy 1, policy_version 388496 (0.0009) [2023-12-27 22:00:54,172][106226] Updated weights for policy 0, policy_version 387497 (0.0011) [2023-12-27 22:00:54,227][106225] Updated weights for policy 1, policy_version 388506 (0.0006) [2023-12-27 22:00:54,230][106226] Updated weights for policy 0, policy_version 387507 (0.0008) [2023-12-27 22:00:54,286][106226] Updated weights for policy 0, policy_version 387517 (0.0006) [2023-12-27 22:00:54,288][106225] Updated weights for policy 1, policy_version 388516 (0.0007) [2023-12-27 22:00:54,338][106226] Updated weights for policy 0, policy_version 387527 (0.0008) [2023-12-27 22:00:54,347][106225] Updated weights for policy 1, policy_version 388526 (0.0007) [2023-12-27 22:00:55,063][106226] Updated weights for policy 0, policy_version 387537 (0.0007) [2023-12-27 22:00:55,070][106225] Updated weights for policy 1, policy_version 388536 (0.0007) [2023-12-27 22:00:55,123][106226] Updated weights for policy 0, policy_version 387547 (0.0008) [2023-12-27 22:00:55,126][106225] Updated weights for policy 1, policy_version 388546 (0.0008) [2023-12-27 22:00:55,181][106226] Updated weights for policy 0, policy_version 387557 (0.0007) [2023-12-27 22:00:55,185][106225] Updated weights for policy 1, policy_version 388556 (0.0007) [2023-12-27 22:00:55,874][106226] Updated weights for policy 0, policy_version 387567 (0.0008) [2023-12-27 22:00:55,921][106225] Updated weights for policy 1, policy_version 388566 (0.0008) [2023-12-27 22:00:55,942][106226] Updated weights for policy 0, policy_version 387577 (0.0007) [2023-12-27 22:00:55,976][106225] Updated weights for policy 1, policy_version 388576 (0.0007) [2023-12-27 22:00:56,010][106226] Updated weights for policy 0, policy_version 387587 (0.0007) [2023-12-27 22:00:56,034][106225] Updated weights for policy 1, policy_version 388586 (0.0008) [2023-12-27 22:00:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18841.6, 300 sec: 19633.0). Total num frames: 198762496. Throughput: 0: 9294.0, 1: 9310.1. Samples: 198727096. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:00:56,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-5.669')] [2023-12-27 22:00:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000388592_99508224.pth... [2023-12-27 22:00:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000387592_99254272.pth... [2023-12-27 22:00:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000387504_99229696.pth [2023-12-27 22:00:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000386504_98975744.pth [2023-12-27 22:00:56,697][106226] Updated weights for policy 0, policy_version 387597 (0.0007) [2023-12-27 22:00:56,744][106225] Updated weights for policy 1, policy_version 388596 (0.0007) [2023-12-27 22:00:56,760][106226] Updated weights for policy 0, policy_version 387607 (0.0008) [2023-12-27 22:00:56,802][106225] Updated weights for policy 1, policy_version 388606 (0.0006) [2023-12-27 22:00:56,823][106226] Updated weights for policy 0, policy_version 387617 (0.0008) [2023-12-27 22:00:56,867][106225] Updated weights for policy 1, policy_version 388616 (0.0008) [2023-12-27 22:00:57,439][106226] Updated weights for policy 0, policy_version 387627 (0.0006) [2023-12-27 22:00:57,494][106226] Updated weights for policy 0, policy_version 387637 (0.0008) [2023-12-27 22:00:57,558][106226] Updated weights for policy 0, policy_version 387647 (0.0007) [2023-12-27 22:00:57,662][106225] Updated weights for policy 1, policy_version 388626 (0.0009) [2023-12-27 22:00:57,738][106225] Updated weights for policy 1, policy_version 388636 (0.0007) [2023-12-27 22:00:57,803][106225] Updated weights for policy 1, policy_version 388646 (0.0008) [2023-12-27 22:00:57,866][106225] Updated weights for policy 1, policy_version 388656 (0.0008) [2023-12-27 22:00:58,286][106226] Updated weights for policy 0, policy_version 387657 (0.0008) [2023-12-27 22:00:58,350][106226] Updated weights for policy 0, policy_version 387667 (0.0010) [2023-12-27 22:00:58,416][106226] Updated weights for policy 0, policy_version 387677 (0.0010) [2023-12-27 22:00:58,486][106226] Updated weights for policy 0, policy_version 387687 (0.0010) [2023-12-27 22:00:58,614][106225] Updated weights for policy 1, policy_version 388666 (0.0008) [2023-12-27 22:00:58,707][106225] Updated weights for policy 1, policy_version 388676 (0.0008) [2023-12-27 22:00:58,777][106225] Updated weights for policy 1, policy_version 388686 (0.0008) [2023-12-27 22:00:59,400][106226] Updated weights for policy 0, policy_version 387701 (0.0009) [2023-12-27 22:00:59,472][106226] Updated weights for policy 0, policy_version 387711 (0.0009) [2023-12-27 22:00:59,699][106225] Updated weights for policy 1, policy_version 388696 (0.0009) [2023-12-27 22:00:59,768][106225] Updated weights for policy 1, policy_version 388706 (0.0008) [2023-12-27 22:00:59,840][106225] Updated weights for policy 1, policy_version 388716 (0.0009) [2023-12-27 22:01:00,299][106226] Updated weights for policy 0, policy_version 387721 (0.0009) [2023-12-27 22:01:00,363][106226] Updated weights for policy 0, policy_version 387731 (0.0007) [2023-12-27 22:01:00,429][106226] Updated weights for policy 0, policy_version 387741 (0.0007) [2023-12-27 22:01:00,488][106226] Updated weights for policy 0, policy_version 387751 (0.0007) [2023-12-27 22:01:00,621][106225] Updated weights for policy 1, policy_version 388726 (0.0006) [2023-12-27 22:01:00,684][106225] Updated weights for policy 1, policy_version 388736 (0.0005) [2023-12-27 22:01:00,754][106225] Updated weights for policy 1, policy_version 388746 (0.0005) [2023-12-27 22:01:01,117][106226] Updated weights for policy 0, policy_version 387761 (0.0009) [2023-12-27 22:01:01,174][105115] Fps is (10 sec: 18022.6, 60 sec: 18568.6, 300 sec: 19577.5). Total num frames: 198844416. Throughput: 0: 9295.5, 1: 9305.7. Samples: 198837864. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:01,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.656')] [2023-12-27 22:01:01,188][106226] Updated weights for policy 0, policy_version 387771 (0.0009) [2023-12-27 22:01:01,244][106226] Updated weights for policy 0, policy_version 387781 (0.0009) [2023-12-27 22:01:01,395][106225] Updated weights for policy 1, policy_version 388756 (0.0006) [2023-12-27 22:01:01,463][106225] Updated weights for policy 1, policy_version 388766 (0.0008) [2023-12-27 22:01:01,526][106225] Updated weights for policy 1, policy_version 388776 (0.0008) [2023-12-27 22:01:01,989][106226] Updated weights for policy 0, policy_version 387791 (0.0008) [2023-12-27 22:01:02,038][106226] Updated weights for policy 0, policy_version 387801 (0.0008) [2023-12-27 22:01:02,087][106226] Updated weights for policy 0, policy_version 387811 (0.0009) [2023-12-27 22:01:02,263][106225] Updated weights for policy 1, policy_version 388786 (0.0008) [2023-12-27 22:01:02,330][106225] Updated weights for policy 1, policy_version 388796 (0.0007) [2023-12-27 22:01:02,396][106225] Updated weights for policy 1, policy_version 388806 (0.0008) [2023-12-27 22:01:02,457][106225] Updated weights for policy 1, policy_version 388816 (0.0008) [2023-12-27 22:01:02,853][106226] Updated weights for policy 0, policy_version 387821 (0.0007) [2023-12-27 22:01:02,916][106226] Updated weights for policy 0, policy_version 387831 (0.0006) [2023-12-27 22:01:02,981][106226] Updated weights for policy 0, policy_version 387841 (0.0008) [2023-12-27 22:01:03,152][106225] Updated weights for policy 1, policy_version 388826 (0.0006) [2023-12-27 22:01:03,210][106225] Updated weights for policy 1, policy_version 388836 (0.0006) [2023-12-27 22:01:03,271][106225] Updated weights for policy 1, policy_version 388846 (0.0006) [2023-12-27 22:01:03,723][106226] Updated weights for policy 0, policy_version 387851 (0.0009) [2023-12-27 22:01:03,781][106226] Updated weights for policy 0, policy_version 387861 (0.0010) [2023-12-27 22:01:03,809][106225] Updated weights for policy 1, policy_version 388856 (0.0007) [2023-12-27 22:01:03,870][106226] Updated weights for policy 0, policy_version 387871 (0.0010) [2023-12-27 22:01:03,883][106225] Updated weights for policy 1, policy_version 388867 (0.0009) [2023-12-27 22:01:03,941][106225] Updated weights for policy 1, policy_version 388877 (0.0006) [2023-12-27 22:01:04,606][106226] Updated weights for policy 0, policy_version 387881 (0.0008) [2023-12-27 22:01:04,667][106226] Updated weights for policy 0, policy_version 387891 (0.0011) [2023-12-27 22:01:04,711][106225] Updated weights for policy 1, policy_version 388887 (0.0007) [2023-12-27 22:01:04,732][106226] Updated weights for policy 0, policy_version 387901 (0.0010) [2023-12-27 22:01:04,780][106225] Updated weights for policy 1, policy_version 388897 (0.0007) [2023-12-27 22:01:04,802][106226] Updated weights for policy 0, policy_version 387911 (0.0009) [2023-12-27 22:01:04,843][106225] Updated weights for policy 1, policy_version 388907 (0.0007) [2023-12-27 22:01:05,530][106226] Updated weights for policy 0, policy_version 387921 (0.0011) [2023-12-27 22:01:05,533][106225] Updated weights for policy 1, policy_version 388917 (0.0010) [2023-12-27 22:01:05,586][106226] Updated weights for policy 0, policy_version 387931 (0.0011) [2023-12-27 22:01:05,596][106225] Updated weights for policy 1, policy_version 388927 (0.0010) [2023-12-27 22:01:05,641][106226] Updated weights for policy 0, policy_version 387941 (0.0011) [2023-12-27 22:01:05,651][106225] Updated weights for policy 1, policy_version 388937 (0.0010) [2023-12-27 22:01:06,174][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.6, 300 sec: 19577.5). Total num frames: 198942720. Throughput: 0: 9263.1, 1: 9396.9. Samples: 198953452. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:06,175][105115] Avg episode reward: [(0, '-4.896'), (1, '-5.712')] [2023-12-27 22:01:06,377][106225] Updated weights for policy 1, policy_version 388947 (0.0009) [2023-12-27 22:01:06,399][106226] Updated weights for policy 0, policy_version 387951 (0.0007) [2023-12-27 22:01:06,439][106225] Updated weights for policy 1, policy_version 388957 (0.0011) [2023-12-27 22:01:06,463][106226] Updated weights for policy 0, policy_version 387961 (0.0007) [2023-12-27 22:01:06,504][106225] Updated weights for policy 1, policy_version 388967 (0.0009) [2023-12-27 22:01:06,518][106226] Updated weights for policy 0, policy_version 387971 (0.0007) [2023-12-27 22:01:07,168][106225] Updated weights for policy 1, policy_version 388977 (0.0011) [2023-12-27 22:01:07,188][106226] Updated weights for policy 0, policy_version 387981 (0.0007) [2023-12-27 22:01:07,232][106225] Updated weights for policy 1, policy_version 388987 (0.0006) [2023-12-27 22:01:07,254][106226] Updated weights for policy 0, policy_version 387991 (0.0009) [2023-12-27 22:01:07,285][106225] Updated weights for policy 1, policy_version 388997 (0.0006) [2023-12-27 22:01:07,319][106226] Updated weights for policy 0, policy_version 388001 (0.0008) [2023-12-27 22:01:07,338][106225] Updated weights for policy 1, policy_version 389007 (0.0007) [2023-12-27 22:01:07,973][106225] Updated weights for policy 1, policy_version 389017 (0.0010) [2023-12-27 22:01:08,034][106225] Updated weights for policy 1, policy_version 389027 (0.0008) [2023-12-27 22:01:08,062][106226] Updated weights for policy 0, policy_version 388011 (0.0008) [2023-12-27 22:01:08,091][106225] Updated weights for policy 1, policy_version 389037 (0.0010) [2023-12-27 22:01:08,123][106226] Updated weights for policy 0, policy_version 388021 (0.0010) [2023-12-27 22:01:08,173][106226] Updated weights for policy 0, policy_version 388031 (0.0011) [2023-12-27 22:01:08,895][106225] Updated weights for policy 1, policy_version 389047 (0.0011) [2023-12-27 22:01:08,910][106226] Updated weights for policy 0, policy_version 388041 (0.0011) [2023-12-27 22:01:08,957][106225] Updated weights for policy 1, policy_version 389057 (0.0011) [2023-12-27 22:01:08,971][106226] Updated weights for policy 0, policy_version 388051 (0.0011) [2023-12-27 22:01:09,020][106225] Updated weights for policy 1, policy_version 389067 (0.0011) [2023-12-27 22:01:09,035][106226] Updated weights for policy 0, policy_version 388061 (0.0011) [2023-12-27 22:01:09,102][106226] Updated weights for policy 0, policy_version 388071 (0.0011) [2023-12-27 22:01:09,817][106225] Updated weights for policy 1, policy_version 389077 (0.0010) [2023-12-27 22:01:09,886][106225] Updated weights for policy 1, policy_version 389087 (0.0008) [2023-12-27 22:01:09,946][106226] Updated weights for policy 0, policy_version 388081 (0.0011) [2023-12-27 22:01:09,953][106225] Updated weights for policy 1, policy_version 389097 (0.0008) [2023-12-27 22:01:10,009][106226] Updated weights for policy 0, policy_version 388091 (0.0011) [2023-12-27 22:01:10,061][106226] Updated weights for policy 0, policy_version 388101 (0.0011) [2023-12-27 22:01:10,731][106225] Updated weights for policy 1, policy_version 389107 (0.0006) [2023-12-27 22:01:10,795][106225] Updated weights for policy 1, policy_version 389117 (0.0008) [2023-12-27 22:01:10,840][106226] Updated weights for policy 0, policy_version 388111 (0.0011) [2023-12-27 22:01:10,860][106225] Updated weights for policy 1, policy_version 389127 (0.0010) [2023-12-27 22:01:10,902][106226] Updated weights for policy 0, policy_version 388121 (0.0011) [2023-12-27 22:01:10,959][106226] Updated weights for policy 0, policy_version 388131 (0.0010) [2023-12-27 22:01:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 18841.5, 300 sec: 19577.5). Total num frames: 199041024. Throughput: 0: 9298.7, 1: 9451.6. Samples: 199011672. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:11,176][105115] Avg episode reward: [(0, '-4.790'), (1, '-5.634')] [2023-12-27 22:01:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000389136_99647488.pth... [2023-12-27 22:01:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000388136_99393536.pth... [2023-12-27 22:01:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000387048_99115008.pth [2023-12-27 22:01:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000388048_99368960.pth [2023-12-27 22:01:11,672][106225] Updated weights for policy 1, policy_version 389137 (0.0007) [2023-12-27 22:01:11,744][106225] Updated weights for policy 1, policy_version 389147 (0.0010) [2023-12-27 22:01:11,769][106226] Updated weights for policy 0, policy_version 388141 (0.0009) [2023-12-27 22:01:11,812][106225] Updated weights for policy 1, policy_version 389157 (0.0010) [2023-12-27 22:01:11,834][106226] Updated weights for policy 0, policy_version 388151 (0.0006) [2023-12-27 22:01:11,876][106225] Updated weights for policy 1, policy_version 389167 (0.0010) [2023-12-27 22:01:11,896][106226] Updated weights for policy 0, policy_version 388161 (0.0008) [2023-12-27 22:01:12,574][106226] Updated weights for policy 0, policy_version 388171 (0.0009) [2023-12-27 22:01:12,637][106226] Updated weights for policy 0, policy_version 388181 (0.0008) [2023-12-27 22:01:12,665][106225] Updated weights for policy 1, policy_version 389177 (0.0006) [2023-12-27 22:01:12,707][106226] Updated weights for policy 0, policy_version 388191 (0.0008) [2023-12-27 22:01:12,727][106225] Updated weights for policy 1, policy_version 389187 (0.0007) [2023-12-27 22:01:12,787][106225] Updated weights for policy 1, policy_version 389197 (0.0007) [2023-12-27 22:01:13,279][106226] Updated weights for policy 0, policy_version 388201 (0.0008) [2023-12-27 22:01:13,342][106226] Updated weights for policy 0, policy_version 388211 (0.0007) [2023-12-27 22:01:13,405][106226] Updated weights for policy 0, policy_version 388221 (0.0008) [2023-12-27 22:01:13,467][106226] Updated weights for policy 0, policy_version 388231 (0.0005) [2023-12-27 22:01:13,565][106225] Updated weights for policy 1, policy_version 389207 (0.0009) [2023-12-27 22:01:13,625][106225] Updated weights for policy 1, policy_version 389217 (0.0007) [2023-12-27 22:01:13,686][106225] Updated weights for policy 1, policy_version 389227 (0.0008) [2023-12-27 22:01:14,086][106226] Updated weights for policy 0, policy_version 388241 (0.0008) [2023-12-27 22:01:14,150][106226] Updated weights for policy 0, policy_version 388251 (0.0009) [2023-12-27 22:01:14,215][106226] Updated weights for policy 0, policy_version 388261 (0.0011) [2023-12-27 22:01:14,312][106225] Updated weights for policy 1, policy_version 389237 (0.0007) [2023-12-27 22:01:14,363][106225] Updated weights for policy 1, policy_version 389247 (0.0008) [2023-12-27 22:01:14,411][106225] Updated weights for policy 1, policy_version 389257 (0.0005) [2023-12-27 22:01:14,921][106226] Updated weights for policy 0, policy_version 388271 (0.0009) [2023-12-27 22:01:14,988][106226] Updated weights for policy 0, policy_version 388281 (0.0008) [2023-12-27 22:01:15,056][106226] Updated weights for policy 0, policy_version 388291 (0.0009) [2023-12-27 22:01:15,143][106225] Updated weights for policy 1, policy_version 389267 (0.0006) [2023-12-27 22:01:15,214][106225] Updated weights for policy 1, policy_version 389277 (0.0008) [2023-12-27 22:01:15,278][106225] Updated weights for policy 1, policy_version 389287 (0.0009) [2023-12-27 22:01:15,835][106226] Updated weights for policy 0, policy_version 388301 (0.0010) [2023-12-27 22:01:15,893][106226] Updated weights for policy 0, policy_version 388311 (0.0010) [2023-12-27 22:01:15,908][106225] Updated weights for policy 1, policy_version 389297 (0.0009) [2023-12-27 22:01:15,959][106226] Updated weights for policy 0, policy_version 388321 (0.0009) [2023-12-27 22:01:15,964][106225] Updated weights for policy 1, policy_version 389307 (0.0006) [2023-12-27 22:01:16,023][106225] Updated weights for policy 1, policy_version 389317 (0.0007) [2023-12-27 22:01:16,072][106225] Updated weights for policy 1, policy_version 389327 (0.0008) [2023-12-27 22:01:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 18841.6, 300 sec: 19577.5). Total num frames: 199139328. Throughput: 0: 9268.5, 1: 9362.8. Samples: 199123884. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:16,175][105115] Avg episode reward: [(0, '-5.089'), (1, '-5.802')] [2023-12-27 22:01:16,593][106226] Updated weights for policy 0, policy_version 388331 (0.0009) [2023-12-27 22:01:16,653][106226] Updated weights for policy 0, policy_version 388341 (0.0010) [2023-12-27 22:01:16,711][106226] Updated weights for policy 0, policy_version 388351 (0.0007) [2023-12-27 22:01:16,856][106225] Updated weights for policy 1, policy_version 389337 (0.0008) [2023-12-27 22:01:16,917][106225] Updated weights for policy 1, policy_version 389347 (0.0008) [2023-12-27 22:01:16,976][106225] Updated weights for policy 1, policy_version 389357 (0.0010) [2023-12-27 22:01:17,329][106226] Updated weights for policy 0, policy_version 388361 (0.0006) [2023-12-27 22:01:17,398][106226] Updated weights for policy 0, policy_version 388371 (0.0011) [2023-12-27 22:01:17,468][106226] Updated weights for policy 0, policy_version 388381 (0.0009) [2023-12-27 22:01:17,528][106226] Updated weights for policy 0, policy_version 388391 (0.0009) [2023-12-27 22:01:17,694][106225] Updated weights for policy 1, policy_version 389367 (0.0008) [2023-12-27 22:01:17,753][106225] Updated weights for policy 1, policy_version 389377 (0.0008) [2023-12-27 22:01:17,809][106225] Updated weights for policy 1, policy_version 389387 (0.0009) [2023-12-27 22:01:18,172][106226] Updated weights for policy 0, policy_version 388401 (0.0008) [2023-12-27 22:01:18,233][106226] Updated weights for policy 0, policy_version 388411 (0.0009) [2023-12-27 22:01:18,282][106226] Updated weights for policy 0, policy_version 388421 (0.0008) [2023-12-27 22:01:18,562][106225] Updated weights for policy 1, policy_version 389397 (0.0008) [2023-12-27 22:01:18,629][106225] Updated weights for policy 1, policy_version 389407 (0.0009) [2023-12-27 22:01:18,692][106225] Updated weights for policy 1, policy_version 389417 (0.0009) [2023-12-27 22:01:19,049][106226] Updated weights for policy 0, policy_version 388431 (0.0006) [2023-12-27 22:01:19,112][106226] Updated weights for policy 0, policy_version 388441 (0.0005) [2023-12-27 22:01:19,172][106226] Updated weights for policy 0, policy_version 388451 (0.0006) [2023-12-27 22:01:19,477][106225] Updated weights for policy 1, policy_version 389427 (0.0009) [2023-12-27 22:01:19,542][106225] Updated weights for policy 1, policy_version 389437 (0.0008) [2023-12-27 22:01:19,605][106225] Updated weights for policy 1, policy_version 389447 (0.0006) [2023-12-27 22:01:19,855][106226] Updated weights for policy 0, policy_version 388461 (0.0007) [2023-12-27 22:01:19,918][106226] Updated weights for policy 0, policy_version 388471 (0.0010) [2023-12-27 22:01:19,980][106226] Updated weights for policy 0, policy_version 388481 (0.0007) [2023-12-27 22:01:20,404][106225] Updated weights for policy 1, policy_version 389457 (0.0008) [2023-12-27 22:01:20,473][106225] Updated weights for policy 1, policy_version 389467 (0.0007) [2023-12-27 22:01:20,539][106225] Updated weights for policy 1, policy_version 389477 (0.0009) [2023-12-27 22:01:20,606][106225] Updated weights for policy 1, policy_version 389487 (0.0009) [2023-12-27 22:01:20,730][106226] Updated weights for policy 0, policy_version 388491 (0.0007) [2023-12-27 22:01:20,796][106226] Updated weights for policy 0, policy_version 388501 (0.0008) [2023-12-27 22:01:20,862][106226] Updated weights for policy 0, policy_version 388511 (0.0007) [2023-12-27 22:01:21,175][105115] Fps is (10 sec: 18841.9, 60 sec: 18841.6, 300 sec: 19549.7). Total num frames: 199229440. Throughput: 0: 9312.9, 1: 9337.4. Samples: 199238876. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:21,175][105115] Avg episode reward: [(0, '-5.120'), (1, '-5.464')] [2023-12-27 22:01:21,447][106225] Updated weights for policy 1, policy_version 389497 (0.0008) [2023-12-27 22:01:21,511][106225] Updated weights for policy 1, policy_version 389507 (0.0009) [2023-12-27 22:01:21,573][106225] Updated weights for policy 1, policy_version 389517 (0.0007) [2023-12-27 22:01:21,619][106226] Updated weights for policy 0, policy_version 388521 (0.0008) [2023-12-27 22:01:21,694][106226] Updated weights for policy 0, policy_version 388531 (0.0007) [2023-12-27 22:01:21,775][106226] Updated weights for policy 0, policy_version 388541 (0.0009) [2023-12-27 22:01:21,845][106226] Updated weights for policy 0, policy_version 388551 (0.0008) [2023-12-27 22:01:22,276][106225] Updated weights for policy 1, policy_version 389527 (0.0007) [2023-12-27 22:01:22,348][106225] Updated weights for policy 1, policy_version 389537 (0.0010) [2023-12-27 22:01:22,406][106225] Updated weights for policy 1, policy_version 389547 (0.0009) [2023-12-27 22:01:22,567][106226] Updated weights for policy 0, policy_version 388561 (0.0008) [2023-12-27 22:01:22,630][106226] Updated weights for policy 0, policy_version 388571 (0.0009) [2023-12-27 22:01:22,693][106226] Updated weights for policy 0, policy_version 388581 (0.0009) [2023-12-27 22:01:23,142][106225] Updated weights for policy 1, policy_version 389557 (0.0009) [2023-12-27 22:01:23,190][106225] Updated weights for policy 1, policy_version 389567 (0.0008) [2023-12-27 22:01:23,250][106225] Updated weights for policy 1, policy_version 389577 (0.0009) [2023-12-27 22:01:23,463][106226] Updated weights for policy 0, policy_version 388591 (0.0011) [2023-12-27 22:01:23,523][106226] Updated weights for policy 0, policy_version 388601 (0.0010) [2023-12-27 22:01:23,579][106226] Updated weights for policy 0, policy_version 388611 (0.0010) [2023-12-27 22:01:23,923][106225] Updated weights for policy 1, policy_version 389587 (0.0007) [2023-12-27 22:01:23,982][106225] Updated weights for policy 1, policy_version 389597 (0.0008) [2023-12-27 22:01:24,042][106225] Updated weights for policy 1, policy_version 389607 (0.0009) [2023-12-27 22:01:24,209][106226] Updated weights for policy 0, policy_version 388621 (0.0008) [2023-12-27 22:01:24,259][106226] Updated weights for policy 0, policy_version 388631 (0.0008) [2023-12-27 22:01:24,313][106226] Updated weights for policy 0, policy_version 388641 (0.0006) [2023-12-27 22:01:24,743][106225] Updated weights for policy 1, policy_version 389617 (0.0007) [2023-12-27 22:01:24,805][106225] Updated weights for policy 1, policy_version 389627 (0.0007) [2023-12-27 22:01:24,865][106225] Updated weights for policy 1, policy_version 389637 (0.0008) [2023-12-27 22:01:24,926][106225] Updated weights for policy 1, policy_version 389647 (0.0007) [2023-12-27 22:01:25,042][106226] Updated weights for policy 0, policy_version 388651 (0.0007) [2023-12-27 22:01:25,104][106226] Updated weights for policy 0, policy_version 388661 (0.0010) [2023-12-27 22:01:25,163][106226] Updated weights for policy 0, policy_version 388671 (0.0010) [2023-12-27 22:01:25,592][106225] Updated weights for policy 1, policy_version 389657 (0.0005) [2023-12-27 22:01:25,648][106225] Updated weights for policy 1, policy_version 389667 (0.0006) [2023-12-27 22:01:25,707][106225] Updated weights for policy 1, policy_version 389677 (0.0007) [2023-12-27 22:01:25,892][106226] Updated weights for policy 0, policy_version 388681 (0.0011) [2023-12-27 22:01:25,949][106226] Updated weights for policy 0, policy_version 388691 (0.0010) [2023-12-27 22:01:26,009][106226] Updated weights for policy 0, policy_version 388701 (0.0006) [2023-12-27 22:01:26,060][106226] Updated weights for policy 0, policy_version 388711 (0.0005) [2023-12-27 22:01:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 18841.6, 300 sec: 19549.7). Total num frames: 199327744. Throughput: 0: 9333.2, 1: 9346.0. Samples: 199295892. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:26,175][105115] Avg episode reward: [(0, '-4.774'), (1, '-5.504')] [2023-12-27 22:01:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000389680_99786752.pth... [2023-12-27 22:01:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000388712_99540992.pth... [2023-12-27 22:01:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000388592_99508224.pth [2023-12-27 22:01:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000387592_99254272.pth [2023-12-27 22:01:26,393][106225] Updated weights for policy 1, policy_version 389687 (0.0008) [2023-12-27 22:01:26,449][106225] Updated weights for policy 1, policy_version 389697 (0.0007) [2023-12-27 22:01:26,505][106225] Updated weights for policy 1, policy_version 389707 (0.0009) [2023-12-27 22:01:26,748][106226] Updated weights for policy 0, policy_version 388721 (0.0007) [2023-12-27 22:01:26,802][106226] Updated weights for policy 0, policy_version 388731 (0.0009) [2023-12-27 22:01:26,849][106226] Updated weights for policy 0, policy_version 388741 (0.0008) [2023-12-27 22:01:27,125][106225] Updated weights for policy 1, policy_version 389717 (0.0007) [2023-12-27 22:01:27,177][106225] Updated weights for policy 1, policy_version 389727 (0.0005) [2023-12-27 22:01:27,234][106225] Updated weights for policy 1, policy_version 389737 (0.0005) [2023-12-27 22:01:27,659][106226] Updated weights for policy 0, policy_version 388751 (0.0007) [2023-12-27 22:01:27,719][106226] Updated weights for policy 0, policy_version 388761 (0.0010) [2023-12-27 22:01:27,769][106226] Updated weights for policy 0, policy_version 388771 (0.0006) [2023-12-27 22:01:27,778][106225] Updated weights for policy 1, policy_version 389747 (0.0007) [2023-12-27 22:01:27,840][106225] Updated weights for policy 1, policy_version 389757 (0.0010) [2023-12-27 22:01:27,905][106225] Updated weights for policy 1, policy_version 389767 (0.0010) [2023-12-27 22:01:28,450][106226] Updated weights for policy 0, policy_version 388781 (0.0007) [2023-12-27 22:01:28,502][106226] Updated weights for policy 0, policy_version 388791 (0.0008) [2023-12-27 22:01:28,560][106226] Updated weights for policy 0, policy_version 388801 (0.0008) [2023-12-27 22:01:28,603][106225] Updated weights for policy 1, policy_version 389777 (0.0010) [2023-12-27 22:01:28,653][106225] Updated weights for policy 1, policy_version 389787 (0.0010) [2023-12-27 22:01:28,707][106225] Updated weights for policy 1, policy_version 389797 (0.0009) [2023-12-27 22:01:28,762][106225] Updated weights for policy 1, policy_version 389807 (0.0010) [2023-12-27 22:01:29,328][106226] Updated weights for policy 0, policy_version 388811 (0.0008) [2023-12-27 22:01:29,397][106226] Updated weights for policy 0, policy_version 388821 (0.0010) [2023-12-27 22:01:29,459][106226] Updated weights for policy 0, policy_version 388831 (0.0008) [2023-12-27 22:01:29,525][106225] Updated weights for policy 1, policy_version 389817 (0.0008) [2023-12-27 22:01:29,586][106225] Updated weights for policy 1, policy_version 389827 (0.0009) [2023-12-27 22:01:29,646][106225] Updated weights for policy 1, policy_version 389837 (0.0009) [2023-12-27 22:01:30,226][106226] Updated weights for policy 0, policy_version 388841 (0.0008) [2023-12-27 22:01:30,288][106226] Updated weights for policy 0, policy_version 388851 (0.0008) [2023-12-27 22:01:30,350][106226] Updated weights for policy 0, policy_version 388861 (0.0008) [2023-12-27 22:01:30,373][106225] Updated weights for policy 1, policy_version 389847 (0.0009) [2023-12-27 22:01:30,412][106226] Updated weights for policy 0, policy_version 388871 (0.0008) [2023-12-27 22:01:30,437][106225] Updated weights for policy 1, policy_version 389857 (0.0008) [2023-12-27 22:01:30,503][106225] Updated weights for policy 1, policy_version 389867 (0.0008) [2023-12-27 22:01:31,134][106225] Updated weights for policy 1, policy_version 389877 (0.0008) [2023-12-27 22:01:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 18705.0, 300 sec: 19494.2). Total num frames: 199417856. Throughput: 0: 9362.6, 1: 9519.1. Samples: 199414260. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-27 22:01:31,176][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.915')] [2023-12-27 22:01:31,189][106226] Updated weights for policy 0, policy_version 388881 (0.0008) [2023-12-27 22:01:31,207][106225] Updated weights for policy 1, policy_version 389887 (0.0009) [2023-12-27 22:01:31,256][106226] Updated weights for policy 0, policy_version 388891 (0.0007) [2023-12-27 22:01:31,273][106225] Updated weights for policy 1, policy_version 389897 (0.0009) [2023-12-27 22:01:31,317][106226] Updated weights for policy 0, policy_version 388901 (0.0006) [2023-12-27 22:01:31,987][106225] Updated weights for policy 1, policy_version 389907 (0.0010) [2023-12-27 22:01:32,016][106226] Updated weights for policy 0, policy_version 388911 (0.0009) [2023-12-27 22:01:32,040][106225] Updated weights for policy 1, policy_version 389917 (0.0009) [2023-12-27 22:01:32,080][106226] Updated weights for policy 0, policy_version 388921 (0.0007) [2023-12-27 22:01:32,099][106225] Updated weights for policy 1, policy_version 389927 (0.0005) [2023-12-27 22:01:32,139][106226] Updated weights for policy 0, policy_version 388931 (0.0008) [2023-12-27 22:01:32,798][106226] Updated weights for policy 0, policy_version 388941 (0.0007) [2023-12-27 22:01:32,810][106225] Updated weights for policy 1, policy_version 389937 (0.0008) [2023-12-27 22:01:32,858][106226] Updated weights for policy 0, policy_version 388951 (0.0009) [2023-12-27 22:01:32,874][106225] Updated weights for policy 1, policy_version 389947 (0.0010) [2023-12-27 22:01:32,909][106226] Updated weights for policy 0, policy_version 388961 (0.0008) [2023-12-27 22:01:32,930][106225] Updated weights for policy 1, policy_version 389957 (0.0006) [2023-12-27 22:01:32,993][106225] Updated weights for policy 1, policy_version 389967 (0.0010) [2023-12-27 22:01:33,597][106225] Updated weights for policy 1, policy_version 389977 (0.0007) [2023-12-27 22:01:33,617][106226] Updated weights for policy 0, policy_version 388971 (0.0007) [2023-12-27 22:01:33,653][106225] Updated weights for policy 1, policy_version 389987 (0.0010) [2023-12-27 22:01:33,677][106226] Updated weights for policy 0, policy_version 388981 (0.0005) [2023-12-27 22:01:33,714][106225] Updated weights for policy 1, policy_version 389997 (0.0010) [2023-12-27 22:01:33,740][106226] Updated weights for policy 0, policy_version 388991 (0.0005) [2023-12-27 22:01:34,363][106226] Updated weights for policy 0, policy_version 389001 (0.0005) [2023-12-27 22:01:34,427][106226] Updated weights for policy 0, policy_version 389011 (0.0008) [2023-12-27 22:01:34,428][106225] Updated weights for policy 1, policy_version 390007 (0.0010) [2023-12-27 22:01:34,495][106226] Updated weights for policy 0, policy_version 389021 (0.0007) [2023-12-27 22:01:34,498][106225] Updated weights for policy 1, policy_version 390017 (0.0011) [2023-12-27 22:01:34,556][106226] Updated weights for policy 0, policy_version 389031 (0.0006) [2023-12-27 22:01:34,565][106225] Updated weights for policy 1, policy_version 390027 (0.0011) [2023-12-27 22:01:35,251][106226] Updated weights for policy 0, policy_version 389041 (0.0008) [2023-12-27 22:01:35,299][106225] Updated weights for policy 1, policy_version 390037 (0.0008) [2023-12-27 22:01:35,325][106226] Updated weights for policy 0, policy_version 389051 (0.0009) [2023-12-27 22:01:35,363][106225] Updated weights for policy 1, policy_version 390047 (0.0009) [2023-12-27 22:01:35,376][106226] Updated weights for policy 0, policy_version 389061 (0.0009) [2023-12-27 22:01:35,419][106225] Updated weights for policy 1, policy_version 390057 (0.0008) [2023-12-27 22:01:36,102][106226] Updated weights for policy 0, policy_version 389071 (0.0007) [2023-12-27 22:01:36,171][106226] Updated weights for policy 0, policy_version 389081 (0.0007) [2023-12-27 22:01:36,174][105115] Fps is (10 sec: 18841.9, 60 sec: 18841.6, 300 sec: 19494.2). Total num frames: 199516160. Throughput: 0: 9437.6, 1: 9563.5. Samples: 199531868. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:01:36,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-5.632')] [2023-12-27 22:01:36,181][106225] Updated weights for policy 1, policy_version 390067 (0.0008) [2023-12-27 22:01:36,233][106226] Updated weights for policy 0, policy_version 389091 (0.0007) [2023-12-27 22:01:36,243][106225] Updated weights for policy 1, policy_version 390077 (0.0007) [2023-12-27 22:01:36,302][106225] Updated weights for policy 1, policy_version 390087 (0.0008) [2023-12-27 22:01:36,918][106226] Updated weights for policy 0, policy_version 389101 (0.0006) [2023-12-27 22:01:36,983][106226] Updated weights for policy 0, policy_version 389111 (0.0005) [2023-12-27 22:01:37,051][106226] Updated weights for policy 0, policy_version 389121 (0.0006) [2023-12-27 22:01:37,086][106225] Updated weights for policy 1, policy_version 390097 (0.0009) [2023-12-27 22:01:37,156][106225] Updated weights for policy 1, policy_version 390107 (0.0010) [2023-12-27 22:01:37,217][106225] Updated weights for policy 1, policy_version 390117 (0.0008) [2023-12-27 22:01:37,283][106225] Updated weights for policy 1, policy_version 390127 (0.0008) [2023-12-27 22:01:37,621][106226] Updated weights for policy 0, policy_version 389131 (0.0007) [2023-12-27 22:01:37,685][106226] Updated weights for policy 0, policy_version 389141 (0.0009) [2023-12-27 22:01:37,743][106226] Updated weights for policy 0, policy_version 389151 (0.0009) [2023-12-27 22:01:37,998][106225] Updated weights for policy 1, policy_version 390137 (0.0008) [2023-12-27 22:01:38,049][106225] Updated weights for policy 1, policy_version 390147 (0.0007) [2023-12-27 22:01:38,103][106225] Updated weights for policy 1, policy_version 390157 (0.0007) [2023-12-27 22:01:38,442][106226] Updated weights for policy 0, policy_version 389161 (0.0009) [2023-12-27 22:01:38,511][106226] Updated weights for policy 0, policy_version 389171 (0.0011) [2023-12-27 22:01:38,579][106226] Updated weights for policy 0, policy_version 389181 (0.0011) [2023-12-27 22:01:38,644][106226] Updated weights for policy 0, policy_version 389191 (0.0011) [2023-12-27 22:01:38,866][106225] Updated weights for policy 1, policy_version 390167 (0.0007) [2023-12-27 22:01:38,930][106225] Updated weights for policy 1, policy_version 390177 (0.0007) [2023-12-27 22:01:38,988][106225] Updated weights for policy 1, policy_version 390187 (0.0006) [2023-12-27 22:01:39,242][106226] Updated weights for policy 0, policy_version 389201 (0.0010) [2023-12-27 22:01:39,315][106226] Updated weights for policy 0, policy_version 389211 (0.0008) [2023-12-27 22:01:39,386][106226] Updated weights for policy 0, policy_version 389221 (0.0007) [2023-12-27 22:01:39,788][106225] Updated weights for policy 1, policy_version 390197 (0.0012) [2023-12-27 22:01:39,866][106225] Updated weights for policy 1, policy_version 390207 (0.0011) [2023-12-27 22:01:39,925][106225] Updated weights for policy 1, policy_version 390217 (0.0006) [2023-12-27 22:01:40,189][106226] Updated weights for policy 0, policy_version 389231 (0.0009) [2023-12-27 22:01:40,253][106226] Updated weights for policy 0, policy_version 389241 (0.0009) [2023-12-27 22:01:40,322][106226] Updated weights for policy 0, policy_version 389251 (0.0009) [2023-12-27 22:01:40,621][106225] Updated weights for policy 1, policy_version 390227 (0.0009) [2023-12-27 22:01:40,675][106225] Updated weights for policy 1, policy_version 390237 (0.0009) [2023-12-27 22:01:40,736][106225] Updated weights for policy 1, policy_version 390247 (0.0009) [2023-12-27 22:01:41,120][106226] Updated weights for policy 0, policy_version 389261 (0.0009) [2023-12-27 22:01:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 18841.5, 300 sec: 19494.2). Total num frames: 199614464. Throughput: 0: 9612.8, 1: 9580.8. Samples: 199590812. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:01:41,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-5.710')] [2023-12-27 22:01:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000390256_99934208.pth... [2023-12-27 22:01:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000389136_99647488.pth [2023-12-27 22:01:41,196][106226] Updated weights for policy 0, policy_version 389271 (0.0009) [2023-12-27 22:01:41,265][106226] Updated weights for policy 0, policy_version 389281 (0.0009) [2023-12-27 22:01:41,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000389288_99688448.pth... [2023-12-27 22:01:41,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000388136_99393536.pth [2023-12-27 22:01:41,539][106225] Updated weights for policy 1, policy_version 390257 (0.0009) [2023-12-27 22:01:41,601][106225] Updated weights for policy 1, policy_version 390267 (0.0009) [2023-12-27 22:01:41,670][106225] Updated weights for policy 1, policy_version 390277 (0.0009) [2023-12-27 22:01:41,741][106225] Updated weights for policy 1, policy_version 390287 (0.0009) [2023-12-27 22:01:42,055][106226] Updated weights for policy 0, policy_version 389291 (0.0008) [2023-12-27 22:01:42,123][106226] Updated weights for policy 0, policy_version 389301 (0.0008) [2023-12-27 22:01:42,196][106226] Updated weights for policy 0, policy_version 389311 (0.0009) [2023-12-27 22:01:42,483][106225] Updated weights for policy 1, policy_version 390297 (0.0008) [2023-12-27 22:01:42,552][106225] Updated weights for policy 1, policy_version 390307 (0.0008) [2023-12-27 22:01:42,609][106225] Updated weights for policy 1, policy_version 390317 (0.0009) [2023-12-27 22:01:42,864][106226] Updated weights for policy 0, policy_version 389321 (0.0007) [2023-12-27 22:01:42,935][106226] Updated weights for policy 0, policy_version 389331 (0.0009) [2023-12-27 22:01:42,995][106226] Updated weights for policy 0, policy_version 389341 (0.0007) [2023-12-27 22:01:43,061][106226] Updated weights for policy 0, policy_version 389351 (0.0008) [2023-12-27 22:01:43,294][106225] Updated weights for policy 1, policy_version 390327 (0.0008) [2023-12-27 22:01:43,343][106225] Updated weights for policy 1, policy_version 390337 (0.0008) [2023-12-27 22:01:43,393][106225] Updated weights for policy 1, policy_version 390347 (0.0005) [2023-12-27 22:01:43,715][106226] Updated weights for policy 0, policy_version 389361 (0.0008) [2023-12-27 22:01:43,780][106226] Updated weights for policy 0, policy_version 389371 (0.0009) [2023-12-27 22:01:43,846][106226] Updated weights for policy 0, policy_version 389381 (0.0009) [2023-12-27 22:01:43,980][106225] Updated weights for policy 1, policy_version 390357 (0.0006) [2023-12-27 22:01:44,032][106225] Updated weights for policy 1, policy_version 390367 (0.0007) [2023-12-27 22:01:44,102][106225] Updated weights for policy 1, policy_version 390377 (0.0006) [2023-12-27 22:01:44,580][106226] Updated weights for policy 0, policy_version 389391 (0.0008) [2023-12-27 22:01:44,635][106226] Updated weights for policy 0, policy_version 389401 (0.0008) [2023-12-27 22:01:44,688][106226] Updated weights for policy 0, policy_version 389411 (0.0008) [2023-12-27 22:01:44,730][106225] Updated weights for policy 1, policy_version 390387 (0.0007) [2023-12-27 22:01:44,791][106225] Updated weights for policy 1, policy_version 390397 (0.0008) [2023-12-27 22:01:44,854][106225] Updated weights for policy 1, policy_version 390407 (0.0010) [2023-12-27 22:01:45,445][106226] Updated weights for policy 0, policy_version 389421 (0.0008) [2023-12-27 22:01:45,509][106226] Updated weights for policy 0, policy_version 389431 (0.0009) [2023-12-27 22:01:45,580][106226] Updated weights for policy 0, policy_version 389441 (0.0009) [2023-12-27 22:01:45,635][106225] Updated weights for policy 1, policy_version 390417 (0.0009) [2023-12-27 22:01:45,699][106225] Updated weights for policy 1, policy_version 390427 (0.0008) [2023-12-27 22:01:45,760][106225] Updated weights for policy 1, policy_version 390437 (0.0008) [2023-12-27 22:01:45,820][106225] Updated weights for policy 1, policy_version 390447 (0.0007) [2023-12-27 22:01:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 18978.1, 300 sec: 19494.2). Total num frames: 199712768. Throughput: 0: 9612.0, 1: 9652.4. Samples: 199704764. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:01:46,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-6.022')] [2023-12-27 22:01:46,322][106226] Updated weights for policy 0, policy_version 389451 (0.0009) [2023-12-27 22:01:46,375][106226] Updated weights for policy 0, policy_version 389461 (0.0009) [2023-12-27 22:01:46,427][106226] Updated weights for policy 0, policy_version 389471 (0.0009) [2023-12-27 22:01:46,507][106225] Updated weights for policy 1, policy_version 390457 (0.0008) [2023-12-27 22:01:46,571][106225] Updated weights for policy 1, policy_version 390467 (0.0008) [2023-12-27 22:01:46,628][106225] Updated weights for policy 1, policy_version 390477 (0.0008) [2023-12-27 22:01:47,221][106226] Updated weights for policy 0, policy_version 389481 (0.0008) [2023-12-27 22:01:47,286][106226] Updated weights for policy 0, policy_version 389491 (0.0008) [2023-12-27 22:01:47,315][106225] Updated weights for policy 1, policy_version 390487 (0.0008) [2023-12-27 22:01:47,345][106226] Updated weights for policy 0, policy_version 389501 (0.0007) [2023-12-27 22:01:47,376][106225] Updated weights for policy 1, policy_version 390497 (0.0007) [2023-12-27 22:01:47,398][106226] Updated weights for policy 0, policy_version 389511 (0.0008) [2023-12-27 22:01:47,427][106225] Updated weights for policy 1, policy_version 390507 (0.0006) [2023-12-27 22:01:48,110][106225] Updated weights for policy 1, policy_version 390517 (0.0007) [2023-12-27 22:01:48,157][106226] Updated weights for policy 0, policy_version 389521 (0.0007) [2023-12-27 22:01:48,170][106225] Updated weights for policy 1, policy_version 390527 (0.0007) [2023-12-27 22:01:48,211][106226] Updated weights for policy 0, policy_version 389531 (0.0007) [2023-12-27 22:01:48,227][106225] Updated weights for policy 1, policy_version 390537 (0.0006) [2023-12-27 22:01:48,268][106226] Updated weights for policy 0, policy_version 389541 (0.0008) [2023-12-27 22:01:48,939][106226] Updated weights for policy 0, policy_version 389551 (0.0009) [2023-12-27 22:01:48,961][106225] Updated weights for policy 1, policy_version 390547 (0.0006) [2023-12-27 22:01:48,999][106226] Updated weights for policy 0, policy_version 389561 (0.0007) [2023-12-27 22:01:49,023][106225] Updated weights for policy 1, policy_version 390557 (0.0006) [2023-12-27 22:01:49,060][106226] Updated weights for policy 0, policy_version 389571 (0.0007) [2023-12-27 22:01:49,074][106225] Updated weights for policy 1, policy_version 390567 (0.0006) [2023-12-27 22:01:49,791][106226] Updated weights for policy 0, policy_version 389581 (0.0007) [2023-12-27 22:01:49,859][106226] Updated weights for policy 0, policy_version 389591 (0.0009) [2023-12-27 22:01:49,919][106226] Updated weights for policy 0, policy_version 389601 (0.0006) [2023-12-27 22:01:49,920][106225] Updated weights for policy 1, policy_version 390577 (0.0008) [2023-12-27 22:01:49,988][106225] Updated weights for policy 1, policy_version 390587 (0.0008) [2023-12-27 22:01:50,044][106225] Updated weights for policy 1, policy_version 390597 (0.0008) [2023-12-27 22:01:50,111][106225] Updated weights for policy 1, policy_version 390607 (0.0008) [2023-12-27 22:01:50,654][106226] Updated weights for policy 0, policy_version 389611 (0.0009) [2023-12-27 22:01:50,715][106226] Updated weights for policy 0, policy_version 389621 (0.0008) [2023-12-27 22:01:50,782][106226] Updated weights for policy 0, policy_version 389631 (0.0009) [2023-12-27 22:01:50,869][106225] Updated weights for policy 1, policy_version 390617 (0.0008) [2023-12-27 22:01:50,937][106225] Updated weights for policy 1, policy_version 390627 (0.0009) [2023-12-27 22:01:50,997][106225] Updated weights for policy 1, policy_version 390637 (0.0008) [2023-12-27 22:01:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19114.7, 300 sec: 19494.2). Total num frames: 199811072. Throughput: 0: 9611.1, 1: 9590.5. Samples: 199817524. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:01:51,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-5.938')] [2023-12-27 22:01:51,519][106226] Updated weights for policy 0, policy_version 389641 (0.0008) [2023-12-27 22:01:51,578][106226] Updated weights for policy 0, policy_version 389651 (0.0007) [2023-12-27 22:01:51,644][106226] Updated weights for policy 0, policy_version 389661 (0.0006) [2023-12-27 22:01:51,706][106226] Updated weights for policy 0, policy_version 389671 (0.0008) [2023-12-27 22:01:51,824][106225] Updated weights for policy 1, policy_version 390647 (0.0006) [2023-12-27 22:01:51,896][106225] Updated weights for policy 1, policy_version 390657 (0.0006) [2023-12-27 22:01:51,963][106225] Updated weights for policy 1, policy_version 390667 (0.0006) [2023-12-27 22:01:52,516][106226] Updated weights for policy 0, policy_version 389681 (0.0009) [2023-12-27 22:01:52,575][106226] Updated weights for policy 0, policy_version 389691 (0.0008) [2023-12-27 22:01:52,579][106225] Updated weights for policy 1, policy_version 390677 (0.0007) [2023-12-27 22:01:52,636][106225] Updated weights for policy 1, policy_version 390687 (0.0006) [2023-12-27 22:01:52,638][106226] Updated weights for policy 0, policy_version 389701 (0.0008) [2023-12-27 22:01:52,703][106225] Updated weights for policy 1, policy_version 390697 (0.0007) [2023-12-27 22:01:53,362][106226] Updated weights for policy 0, policy_version 389711 (0.0009) [2023-12-27 22:01:53,420][106226] Updated weights for policy 0, policy_version 389721 (0.0008) [2023-12-27 22:01:53,433][106225] Updated weights for policy 1, policy_version 390707 (0.0008) [2023-12-27 22:01:53,488][106226] Updated weights for policy 0, policy_version 389731 (0.0008) [2023-12-27 22:01:53,499][106225] Updated weights for policy 1, policy_version 390717 (0.0009) [2023-12-27 22:01:53,568][106225] Updated weights for policy 1, policy_version 390727 (0.0008) [2023-12-27 22:01:54,158][106226] Updated weights for policy 0, policy_version 389741 (0.0007) [2023-12-27 22:01:54,226][106226] Updated weights for policy 0, policy_version 389751 (0.0008) [2023-12-27 22:01:54,275][106226] Updated weights for policy 0, policy_version 389761 (0.0009) [2023-12-27 22:01:54,280][106225] Updated weights for policy 1, policy_version 390737 (0.0009) [2023-12-27 22:01:54,335][106225] Updated weights for policy 1, policy_version 390747 (0.0005) [2023-12-27 22:01:54,396][106225] Updated weights for policy 1, policy_version 390757 (0.0007) [2023-12-27 22:01:54,457][106225] Updated weights for policy 1, policy_version 390767 (0.0009) [2023-12-27 22:01:55,033][106226] Updated weights for policy 0, policy_version 389771 (0.0009) [2023-12-27 22:01:55,090][106226] Updated weights for policy 0, policy_version 389781 (0.0008) [2023-12-27 22:01:55,136][106225] Updated weights for policy 1, policy_version 390777 (0.0008) [2023-12-27 22:01:55,155][106226] Updated weights for policy 0, policy_version 389791 (0.0009) [2023-12-27 22:01:55,198][106225] Updated weights for policy 1, policy_version 390787 (0.0008) [2023-12-27 22:01:55,256][106225] Updated weights for policy 1, policy_version 390797 (0.0008) [2023-12-27 22:01:55,819][106226] Updated weights for policy 0, policy_version 389801 (0.0006) [2023-12-27 22:01:55,874][106226] Updated weights for policy 0, policy_version 389811 (0.0005) [2023-12-27 22:01:55,940][106226] Updated weights for policy 0, policy_version 389821 (0.0007) [2023-12-27 22:01:55,988][106226] Updated weights for policy 0, policy_version 389831 (0.0010) [2023-12-27 22:01:56,001][106225] Updated weights for policy 1, policy_version 390807 (0.0007) [2023-12-27 22:01:56,061][106225] Updated weights for policy 1, policy_version 390817 (0.0008) [2023-12-27 22:01:56,122][106225] Updated weights for policy 1, policy_version 390827 (0.0008) [2023-12-27 22:01:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19114.6, 300 sec: 19494.2). Total num frames: 199909376. Throughput: 0: 9603.9, 1: 9555.4. Samples: 199873840. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:01:56,176][105115] Avg episode reward: [(0, '-5.058'), (1, '-5.788')] [2023-12-27 22:01:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000390832_100081664.pth... [2023-12-27 22:01:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000389832_99827712.pth... [2023-12-27 22:01:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000389680_99786752.pth [2023-12-27 22:01:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000388712_99540992.pth [2023-12-27 22:01:56,682][106226] Updated weights for policy 0, policy_version 389841 (0.0010) [2023-12-27 22:01:56,738][106226] Updated weights for policy 0, policy_version 389851 (0.0010) [2023-12-27 22:01:56,798][106226] Updated weights for policy 0, policy_version 389861 (0.0008) [2023-12-27 22:01:56,862][106225] Updated weights for policy 1, policy_version 390837 (0.0008) [2023-12-27 22:01:56,940][106225] Updated weights for policy 1, policy_version 390847 (0.0008) [2023-12-27 22:01:57,002][106225] Updated weights for policy 1, policy_version 390857 (0.0007) [2023-12-27 22:01:57,406][106226] Updated weights for policy 0, policy_version 389871 (0.0005) [2023-12-27 22:01:57,467][106226] Updated weights for policy 0, policy_version 389881 (0.0005) [2023-12-27 22:01:57,528][106226] Updated weights for policy 0, policy_version 389891 (0.0005) [2023-12-27 22:01:57,662][106225] Updated weights for policy 1, policy_version 390867 (0.0008) [2023-12-27 22:01:57,714][106225] Updated weights for policy 1, policy_version 390877 (0.0009) [2023-12-27 22:01:57,770][106225] Updated weights for policy 1, policy_version 390887 (0.0007) [2023-12-27 22:01:58,090][106226] Updated weights for policy 0, policy_version 389901 (0.0008) [2023-12-27 22:01:58,150][106226] Updated weights for policy 0, policy_version 389911 (0.0010) [2023-12-27 22:01:58,213][106226] Updated weights for policy 0, policy_version 389921 (0.0010) [2023-12-27 22:01:58,605][106225] Updated weights for policy 1, policy_version 390897 (0.0008) [2023-12-27 22:01:58,671][106225] Updated weights for policy 1, policy_version 390907 (0.0008) [2023-12-27 22:01:58,744][106225] Updated weights for policy 1, policy_version 390917 (0.0008) [2023-12-27 22:01:58,810][106225] Updated weights for policy 1, policy_version 390927 (0.0013) [2023-12-27 22:01:59,054][106226] Updated weights for policy 0, policy_version 389931 (0.0008) [2023-12-27 22:01:59,113][106226] Updated weights for policy 0, policy_version 389941 (0.0009) [2023-12-27 22:01:59,172][106226] Updated weights for policy 0, policy_version 389951 (0.0008) [2023-12-27 22:01:59,687][106225] Updated weights for policy 1, policy_version 390937 (0.0008) [2023-12-27 22:01:59,744][106225] Updated weights for policy 1, policy_version 390947 (0.0008) [2023-12-27 22:01:59,796][106225] Updated weights for policy 1, policy_version 390957 (0.0008) [2023-12-27 22:02:00,193][106226] Updated weights for policy 0, policy_version 389961 (0.0009) [2023-12-27 22:02:00,261][106226] Updated weights for policy 0, policy_version 389971 (0.0006) [2023-12-27 22:02:00,319][106226] Updated weights for policy 0, policy_version 389981 (0.0005) [2023-12-27 22:02:00,383][106226] Updated weights for policy 0, policy_version 389991 (0.0006) [2023-12-27 22:02:00,522][106225] Updated weights for policy 1, policy_version 390967 (0.0007) [2023-12-27 22:02:00,588][106225] Updated weights for policy 1, policy_version 390977 (0.0007) [2023-12-27 22:02:00,652][106225] Updated weights for policy 1, policy_version 390987 (0.0009) [2023-12-27 22:02:00,972][106226] Updated weights for policy 0, policy_version 390001 (0.0009) [2023-12-27 22:02:01,032][106226] Updated weights for policy 0, policy_version 390011 (0.0008) [2023-12-27 22:02:01,102][106226] Updated weights for policy 0, policy_version 390021 (0.0008) [2023-12-27 22:02:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.1, 300 sec: 19438.6). Total num frames: 199999488. Throughput: 0: 9590.8, 1: 9563.9. Samples: 199985848. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:01,175][105115] Avg episode reward: [(0, '-4.942'), (1, '-5.759')] [2023-12-27 22:02:01,355][106225] Updated weights for policy 1, policy_version 390997 (0.0008) [2023-12-27 22:02:01,422][106225] Updated weights for policy 1, policy_version 391007 (0.0008) [2023-12-27 22:02:01,473][106225] Updated weights for policy 1, policy_version 391017 (0.0008) [2023-12-27 22:02:01,889][106226] Updated weights for policy 0, policy_version 390031 (0.0009) [2023-12-27 22:02:01,953][106226] Updated weights for policy 0, policy_version 390041 (0.0009) [2023-12-27 22:02:02,027][106226] Updated weights for policy 0, policy_version 390051 (0.0008) [2023-12-27 22:02:02,262][106225] Updated weights for policy 1, policy_version 391027 (0.0008) [2023-12-27 22:02:02,328][106225] Updated weights for policy 1, policy_version 391037 (0.0011) [2023-12-27 22:02:02,396][106225] Updated weights for policy 1, policy_version 391047 (0.0009) [2023-12-27 22:02:02,751][106226] Updated weights for policy 0, policy_version 390061 (0.0008) [2023-12-27 22:02:02,810][106226] Updated weights for policy 0, policy_version 390071 (0.0005) [2023-12-27 22:02:02,872][106226] Updated weights for policy 0, policy_version 390081 (0.0007) [2023-12-27 22:02:03,116][106225] Updated weights for policy 1, policy_version 391057 (0.0010) [2023-12-27 22:02:03,176][106225] Updated weights for policy 1, policy_version 391067 (0.0005) [2023-12-27 22:02:03,240][106225] Updated weights for policy 1, policy_version 391077 (0.0005) [2023-12-27 22:02:03,302][106225] Updated weights for policy 1, policy_version 391087 (0.0005) [2023-12-27 22:02:03,555][106226] Updated weights for policy 0, policy_version 390091 (0.0007) [2023-12-27 22:02:03,618][106226] Updated weights for policy 0, policy_version 390101 (0.0005) [2023-12-27 22:02:03,681][106226] Updated weights for policy 0, policy_version 390111 (0.0007) [2023-12-27 22:02:03,887][106225] Updated weights for policy 1, policy_version 391097 (0.0008) [2023-12-27 22:02:03,949][106225] Updated weights for policy 1, policy_version 391107 (0.0005) [2023-12-27 22:02:04,010][106225] Updated weights for policy 1, policy_version 391117 (0.0006) [2023-12-27 22:02:04,414][106226] Updated weights for policy 0, policy_version 390121 (0.0009) [2023-12-27 22:02:04,474][106226] Updated weights for policy 0, policy_version 390131 (0.0008) [2023-12-27 22:02:04,543][106226] Updated weights for policy 0, policy_version 390141 (0.0007) [2023-12-27 22:02:04,614][106226] Updated weights for policy 0, policy_version 390151 (0.0006) [2023-12-27 22:02:04,684][106225] Updated weights for policy 1, policy_version 391127 (0.0008) [2023-12-27 22:02:04,747][106225] Updated weights for policy 1, policy_version 391137 (0.0009) [2023-12-27 22:02:04,811][106225] Updated weights for policy 1, policy_version 391147 (0.0008) [2023-12-27 22:02:05,289][106226] Updated weights for policy 0, policy_version 390161 (0.0008) [2023-12-27 22:02:05,353][106226] Updated weights for policy 0, policy_version 390171 (0.0009) [2023-12-27 22:02:05,418][106226] Updated weights for policy 0, policy_version 390181 (0.0006) [2023-12-27 22:02:05,583][106225] Updated weights for policy 1, policy_version 391157 (0.0008) [2023-12-27 22:02:05,651][106225] Updated weights for policy 1, policy_version 391167 (0.0007) [2023-12-27 22:02:05,714][106225] Updated weights for policy 1, policy_version 391177 (0.0008) [2023-12-27 22:02:06,059][106226] Updated weights for policy 0, policy_version 390191 (0.0009) [2023-12-27 22:02:06,149][106226] Updated weights for policy 0, policy_version 390201 (0.0010) [2023-12-27 22:02:06,175][105115] Fps is (10 sec: 18022.0, 60 sec: 19114.6, 300 sec: 19438.6). Total num frames: 200089600. Throughput: 0: 9589.7, 1: 9609.4. Samples: 200102844. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:06,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-5.514')] [2023-12-27 22:02:06,217][106226] Updated weights for policy 0, policy_version 390211 (0.0006) [2023-12-27 22:02:06,489][106225] Updated weights for policy 1, policy_version 391187 (0.0009) [2023-12-27 22:02:06,545][106225] Updated weights for policy 1, policy_version 391197 (0.0008) [2023-12-27 22:02:06,601][106225] Updated weights for policy 1, policy_version 391207 (0.0011) [2023-12-27 22:02:06,911][106226] Updated weights for policy 0, policy_version 390221 (0.0009) [2023-12-27 22:02:06,976][106226] Updated weights for policy 0, policy_version 390231 (0.0009) [2023-12-27 22:02:07,048][106226] Updated weights for policy 0, policy_version 390241 (0.0011) [2023-12-27 22:02:07,272][106225] Updated weights for policy 1, policy_version 391217 (0.0011) [2023-12-27 22:02:07,331][106225] Updated weights for policy 1, policy_version 391227 (0.0010) [2023-12-27 22:02:07,390][106225] Updated weights for policy 1, policy_version 391237 (0.0011) [2023-12-27 22:02:07,455][106225] Updated weights for policy 1, policy_version 391247 (0.0008) [2023-12-27 22:02:07,720][106226] Updated weights for policy 0, policy_version 390251 (0.0010) [2023-12-27 22:02:07,783][106226] Updated weights for policy 0, policy_version 390261 (0.0011) [2023-12-27 22:02:07,851][106226] Updated weights for policy 0, policy_version 390271 (0.0010) [2023-12-27 22:02:08,039][106225] Updated weights for policy 1, policy_version 391257 (0.0006) [2023-12-27 22:02:08,096][106225] Updated weights for policy 1, policy_version 391267 (0.0007) [2023-12-27 22:02:08,151][106225] Updated weights for policy 1, policy_version 391277 (0.0006) [2023-12-27 22:02:08,698][106226] Updated weights for policy 0, policy_version 390281 (0.0009) [2023-12-27 22:02:08,767][106226] Updated weights for policy 0, policy_version 390291 (0.0008) [2023-12-27 22:02:08,810][106225] Updated weights for policy 1, policy_version 391287 (0.0009) [2023-12-27 22:02:08,831][106226] Updated weights for policy 0, policy_version 390301 (0.0008) [2023-12-27 22:02:08,883][106225] Updated weights for policy 1, policy_version 391297 (0.0011) [2023-12-27 22:02:08,899][106226] Updated weights for policy 0, policy_version 390311 (0.0007) [2023-12-27 22:02:08,956][106225] Updated weights for policy 1, policy_version 391307 (0.0011) [2023-12-27 22:02:09,652][106225] Updated weights for policy 1, policy_version 391317 (0.0011) [2023-12-27 22:02:09,676][106226] Updated weights for policy 0, policy_version 390321 (0.0008) [2023-12-27 22:02:09,708][106225] Updated weights for policy 1, policy_version 391327 (0.0011) [2023-12-27 22:02:09,742][106226] Updated weights for policy 0, policy_version 390331 (0.0008) [2023-12-27 22:02:09,776][106225] Updated weights for policy 1, policy_version 391337 (0.0010) [2023-12-27 22:02:09,811][106226] Updated weights for policy 0, policy_version 390341 (0.0008) [2023-12-27 22:02:10,540][106225] Updated weights for policy 1, policy_version 391347 (0.0009) [2023-12-27 22:02:10,607][106225] Updated weights for policy 1, policy_version 391357 (0.0008) [2023-12-27 22:02:10,658][106226] Updated weights for policy 0, policy_version 390351 (0.0006) [2023-12-27 22:02:10,670][106225] Updated weights for policy 1, policy_version 391367 (0.0008) [2023-12-27 22:02:10,721][106226] Updated weights for policy 0, policy_version 390361 (0.0006) [2023-12-27 22:02:10,791][106226] Updated weights for policy 0, policy_version 390371 (0.0006) [2023-12-27 22:02:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19114.7, 300 sec: 19438.6). Total num frames: 200187904. Throughput: 0: 9572.8, 1: 9664.4. Samples: 200161564. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:11,175][105115] Avg episode reward: [(0, '-5.038'), (1, '-5.578')] [2023-12-27 22:02:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000391376_100220928.pth... [2023-12-27 22:02:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000390376_99966976.pth... [2023-12-27 22:02:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000389288_99688448.pth [2023-12-27 22:02:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000390256_99934208.pth [2023-12-27 22:02:11,374][106225] Updated weights for policy 1, policy_version 391377 (0.0006) [2023-12-27 22:02:11,459][106225] Updated weights for policy 1, policy_version 391387 (0.0008) [2023-12-27 22:02:11,515][106226] Updated weights for policy 0, policy_version 390381 (0.0010) [2023-12-27 22:02:11,530][106225] Updated weights for policy 1, policy_version 391397 (0.0009) [2023-12-27 22:02:11,589][106226] Updated weights for policy 0, policy_version 390391 (0.0008) [2023-12-27 22:02:11,599][106225] Updated weights for policy 1, policy_version 391407 (0.0008) [2023-12-27 22:02:11,665][106226] Updated weights for policy 0, policy_version 390401 (0.0008) [2023-12-27 22:02:12,296][106225] Updated weights for policy 1, policy_version 391417 (0.0009) [2023-12-27 22:02:12,361][106225] Updated weights for policy 1, policy_version 391427 (0.0009) [2023-12-27 22:02:12,432][106225] Updated weights for policy 1, policy_version 391437 (0.0007) [2023-12-27 22:02:12,477][106226] Updated weights for policy 0, policy_version 390411 (0.0008) [2023-12-27 22:02:12,538][106226] Updated weights for policy 0, policy_version 390421 (0.0009) [2023-12-27 22:02:12,597][106226] Updated weights for policy 0, policy_version 390431 (0.0008) [2023-12-27 22:02:13,187][106225] Updated weights for policy 1, policy_version 391447 (0.0008) [2023-12-27 22:02:13,248][106225] Updated weights for policy 1, policy_version 391457 (0.0009) [2023-12-27 22:02:13,309][106225] Updated weights for policy 1, policy_version 391467 (0.0009) [2023-12-27 22:02:13,351][106226] Updated weights for policy 0, policy_version 390441 (0.0009) [2023-12-27 22:02:13,415][106226] Updated weights for policy 0, policy_version 390451 (0.0009) [2023-12-27 22:02:13,478][106226] Updated weights for policy 0, policy_version 390461 (0.0009) [2023-12-27 22:02:13,529][106226] Updated weights for policy 0, policy_version 390471 (0.0009) [2023-12-27 22:02:14,053][106225] Updated weights for policy 1, policy_version 391477 (0.0009) [2023-12-27 22:02:14,116][106225] Updated weights for policy 1, policy_version 391487 (0.0007) [2023-12-27 22:02:14,175][106225] Updated weights for policy 1, policy_version 391497 (0.0009) [2023-12-27 22:02:14,244][106226] Updated weights for policy 0, policy_version 390481 (0.0009) [2023-12-27 22:02:14,310][106226] Updated weights for policy 0, policy_version 390491 (0.0011) [2023-12-27 22:02:14,374][106226] Updated weights for policy 0, policy_version 390501 (0.0011) [2023-12-27 22:02:14,982][106225] Updated weights for policy 1, policy_version 391507 (0.0007) [2023-12-27 22:02:15,000][106226] Updated weights for policy 0, policy_version 390511 (0.0010) [2023-12-27 22:02:15,047][106225] Updated weights for policy 1, policy_version 391517 (0.0007) [2023-12-27 22:02:15,069][106226] Updated weights for policy 0, policy_version 390521 (0.0010) [2023-12-27 22:02:15,111][106225] Updated weights for policy 1, policy_version 391527 (0.0006) [2023-12-27 22:02:15,137][106226] Updated weights for policy 0, policy_version 390531 (0.0009) [2023-12-27 22:02:15,812][106226] Updated weights for policy 0, policy_version 390541 (0.0007) [2023-12-27 22:02:15,887][106226] Updated weights for policy 0, policy_version 390551 (0.0006) [2023-12-27 22:02:15,918][106225] Updated weights for policy 1, policy_version 391537 (0.0008) [2023-12-27 22:02:15,968][106226] Updated weights for policy 0, policy_version 390561 (0.0009) [2023-12-27 22:02:15,975][106225] Updated weights for policy 1, policy_version 391547 (0.0007) [2023-12-27 22:02:16,035][106225] Updated weights for policy 1, policy_version 391557 (0.0007) [2023-12-27 22:02:16,093][106225] Updated weights for policy 1, policy_version 391567 (0.0008) [2023-12-27 22:02:16,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19114.6, 300 sec: 19438.6). Total num frames: 200286208. Throughput: 0: 9525.4, 1: 9520.4. Samples: 200271324. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:16,176][105115] Avg episode reward: [(0, '-5.025'), (1, '-5.655')] [2023-12-27 22:02:16,535][106226] Updated weights for policy 0, policy_version 390571 (0.0007) [2023-12-27 22:02:16,589][106226] Updated weights for policy 0, policy_version 390581 (0.0009) [2023-12-27 22:02:16,639][106226] Updated weights for policy 0, policy_version 390591 (0.0009) [2023-12-27 22:02:16,913][106225] Updated weights for policy 1, policy_version 391577 (0.0008) [2023-12-27 22:02:16,964][106225] Updated weights for policy 1, policy_version 391587 (0.0008) [2023-12-27 22:02:17,019][106225] Updated weights for policy 1, policy_version 391597 (0.0008) [2023-12-27 22:02:17,404][106226] Updated weights for policy 0, policy_version 390601 (0.0009) [2023-12-27 22:02:17,467][106226] Updated weights for policy 0, policy_version 390611 (0.0011) [2023-12-27 22:02:17,529][106226] Updated weights for policy 0, policy_version 390621 (0.0011) [2023-12-27 22:02:17,584][106226] Updated weights for policy 0, policy_version 390631 (0.0011) [2023-12-27 22:02:17,792][106225] Updated weights for policy 1, policy_version 391607 (0.0008) [2023-12-27 22:02:17,844][106225] Updated weights for policy 1, policy_version 391617 (0.0007) [2023-12-27 22:02:17,903][106225] Updated weights for policy 1, policy_version 391627 (0.0008) [2023-12-27 22:02:18,328][106226] Updated weights for policy 0, policy_version 390641 (0.0011) [2023-12-27 22:02:18,399][106226] Updated weights for policy 0, policy_version 390651 (0.0011) [2023-12-27 22:02:18,464][106226] Updated weights for policy 0, policy_version 390661 (0.0008) [2023-12-27 22:02:18,639][106225] Updated weights for policy 1, policy_version 391637 (0.0008) [2023-12-27 22:02:18,701][106225] Updated weights for policy 1, policy_version 391647 (0.0008) [2023-12-27 22:02:18,759][106225] Updated weights for policy 1, policy_version 391657 (0.0008) [2023-12-27 22:02:19,149][106226] Updated weights for policy 0, policy_version 390671 (0.0007) [2023-12-27 22:02:19,229][106226] Updated weights for policy 0, policy_version 390681 (0.0008) [2023-12-27 22:02:19,301][106226] Updated weights for policy 0, policy_version 390691 (0.0009) [2023-12-27 22:02:19,449][106225] Updated weights for policy 1, policy_version 391667 (0.0007) [2023-12-27 22:02:19,509][106225] Updated weights for policy 1, policy_version 391677 (0.0008) [2023-12-27 22:02:19,573][106225] Updated weights for policy 1, policy_version 391687 (0.0007) [2023-12-27 22:02:20,140][106226] Updated weights for policy 0, policy_version 390701 (0.0009) [2023-12-27 22:02:20,219][106226] Updated weights for policy 0, policy_version 390711 (0.0009) [2023-12-27 22:02:20,288][106226] Updated weights for policy 0, policy_version 390721 (0.0009) [2023-12-27 22:02:20,307][106225] Updated weights for policy 1, policy_version 391697 (0.0008) [2023-12-27 22:02:20,386][106225] Updated weights for policy 1, policy_version 391707 (0.0008) [2023-12-27 22:02:20,453][106225] Updated weights for policy 1, policy_version 391717 (0.0008) [2023-12-27 22:02:20,517][106225] Updated weights for policy 1, policy_version 391727 (0.0006) [2023-12-27 22:02:21,084][106226] Updated weights for policy 0, policy_version 390731 (0.0008) [2023-12-27 22:02:21,156][106226] Updated weights for policy 0, policy_version 390741 (0.0009) [2023-12-27 22:02:21,175][105115] Fps is (10 sec: 18022.4, 60 sec: 18978.1, 300 sec: 19383.1). Total num frames: 200368128. Throughput: 0: 9477.3, 1: 9442.9. Samples: 200383280. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:21,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-5.538')] [2023-12-27 22:02:21,215][106226] Updated weights for policy 0, policy_version 390751 (0.0008) [2023-12-27 22:02:21,325][106225] Updated weights for policy 1, policy_version 391737 (0.0008) [2023-12-27 22:02:21,401][106225] Updated weights for policy 1, policy_version 391747 (0.0008) [2023-12-27 22:02:21,466][106225] Updated weights for policy 1, policy_version 391757 (0.0007) [2023-12-27 22:02:22,006][106226] Updated weights for policy 0, policy_version 390761 (0.0009) [2023-12-27 22:02:22,061][106226] Updated weights for policy 0, policy_version 390771 (0.0008) [2023-12-27 22:02:22,127][106226] Updated weights for policy 0, policy_version 390781 (0.0008) [2023-12-27 22:02:22,190][106226] Updated weights for policy 0, policy_version 390791 (0.0010) [2023-12-27 22:02:22,253][106225] Updated weights for policy 1, policy_version 391767 (0.0007) [2023-12-27 22:02:22,318][106225] Updated weights for policy 1, policy_version 391777 (0.0007) [2023-12-27 22:02:22,387][106225] Updated weights for policy 1, policy_version 391787 (0.0007) [2023-12-27 22:02:23,034][106226] Updated weights for policy 0, policy_version 390801 (0.0011) [2023-12-27 22:02:23,092][106226] Updated weights for policy 0, policy_version 390811 (0.0011) [2023-12-27 22:02:23,154][106226] Updated weights for policy 0, policy_version 390821 (0.0010) [2023-12-27 22:02:23,178][106225] Updated weights for policy 1, policy_version 391797 (0.0005) [2023-12-27 22:02:23,229][106225] Updated weights for policy 1, policy_version 391807 (0.0005) [2023-12-27 22:02:23,289][106225] Updated weights for policy 1, policy_version 391817 (0.0005) [2023-12-27 22:02:23,873][106226] Updated weights for policy 0, policy_version 390831 (0.0009) [2023-12-27 22:02:23,931][106226] Updated weights for policy 0, policy_version 390841 (0.0008) [2023-12-27 22:02:23,954][106225] Updated weights for policy 1, policy_version 391827 (0.0006) [2023-12-27 22:02:23,988][106226] Updated weights for policy 0, policy_version 390851 (0.0006) [2023-12-27 22:02:24,014][106225] Updated weights for policy 1, policy_version 391837 (0.0010) [2023-12-27 22:02:24,067][106225] Updated weights for policy 1, policy_version 391847 (0.0005) [2023-12-27 22:02:24,689][106226] Updated weights for policy 0, policy_version 390861 (0.0008) [2023-12-27 22:02:24,749][106226] Updated weights for policy 0, policy_version 390871 (0.0011) [2023-12-27 22:02:24,790][106225] Updated weights for policy 1, policy_version 391857 (0.0006) [2023-12-27 22:02:24,806][106226] Updated weights for policy 0, policy_version 390881 (0.0010) [2023-12-27 22:02:24,854][106225] Updated weights for policy 1, policy_version 391867 (0.0006) [2023-12-27 22:02:24,922][106225] Updated weights for policy 1, policy_version 391877 (0.0008) [2023-12-27 22:02:24,972][106225] Updated weights for policy 1, policy_version 391887 (0.0008) [2023-12-27 22:02:25,522][106226] Updated weights for policy 0, policy_version 390891 (0.0010) [2023-12-27 22:02:25,589][106226] Updated weights for policy 0, policy_version 390901 (0.0007) [2023-12-27 22:02:25,647][106226] Updated weights for policy 0, policy_version 390911 (0.0010) [2023-12-27 22:02:25,707][106225] Updated weights for policy 1, policy_version 391897 (0.0006) [2023-12-27 22:02:25,759][106225] Updated weights for policy 1, policy_version 391907 (0.0007) [2023-12-27 22:02:25,817][106225] Updated weights for policy 1, policy_version 391917 (0.0008) [2023-12-27 22:02:26,175][105115] Fps is (10 sec: 18022.7, 60 sec: 18978.2, 300 sec: 19355.3). Total num frames: 200466432. Throughput: 0: 9387.8, 1: 9446.0. Samples: 200438328. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:26,175][105115] Avg episode reward: [(0, '-5.016'), (1, '-5.771')] [2023-12-27 22:02:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000391920_100360192.pth... [2023-12-27 22:02:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000390920_100106240.pth... [2023-12-27 22:02:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000390832_100081664.pth [2023-12-27 22:02:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000389832_99827712.pth [2023-12-27 22:02:26,296][106226] Updated weights for policy 0, policy_version 390921 (0.0010) [2023-12-27 22:02:26,343][106226] Updated weights for policy 0, policy_version 390931 (0.0010) [2023-12-27 22:02:26,399][106226] Updated weights for policy 0, policy_version 390941 (0.0009) [2023-12-27 22:02:26,456][106226] Updated weights for policy 0, policy_version 390951 (0.0008) [2023-12-27 22:02:26,478][106225] Updated weights for policy 1, policy_version 391927 (0.0007) [2023-12-27 22:02:26,539][106225] Updated weights for policy 1, policy_version 391937 (0.0008) [2023-12-27 22:02:26,596][106225] Updated weights for policy 1, policy_version 391947 (0.0009) [2023-12-27 22:02:27,151][106226] Updated weights for policy 0, policy_version 390961 (0.0010) [2023-12-27 22:02:27,201][106226] Updated weights for policy 0, policy_version 390971 (0.0010) [2023-12-27 22:02:27,251][106226] Updated weights for policy 0, policy_version 390981 (0.0010) [2023-12-27 22:02:27,328][106225] Updated weights for policy 1, policy_version 391957 (0.0010) [2023-12-27 22:02:27,381][106225] Updated weights for policy 1, policy_version 391967 (0.0009) [2023-12-27 22:02:27,438][106225] Updated weights for policy 1, policy_version 391977 (0.0008) [2023-12-27 22:02:27,928][106226] Updated weights for policy 0, policy_version 390991 (0.0011) [2023-12-27 22:02:28,005][106226] Updated weights for policy 0, policy_version 391001 (0.0007) [2023-12-27 22:02:28,063][106225] Updated weights for policy 1, policy_version 391987 (0.0008) [2023-12-27 22:02:28,064][106226] Updated weights for policy 0, policy_version 391011 (0.0006) [2023-12-27 22:02:28,119][106225] Updated weights for policy 1, policy_version 391997 (0.0006) [2023-12-27 22:02:28,176][106225] Updated weights for policy 1, policy_version 392007 (0.0008) [2023-12-27 22:02:28,685][106226] Updated weights for policy 0, policy_version 391021 (0.0008) [2023-12-27 22:02:28,749][106226] Updated weights for policy 0, policy_version 391031 (0.0007) [2023-12-27 22:02:28,808][106226] Updated weights for policy 0, policy_version 391041 (0.0009) [2023-12-27 22:02:28,882][106225] Updated weights for policy 1, policy_version 392017 (0.0008) [2023-12-27 22:02:28,941][106225] Updated weights for policy 1, policy_version 392027 (0.0009) [2023-12-27 22:02:29,003][106225] Updated weights for policy 1, policy_version 392037 (0.0007) [2023-12-27 22:02:29,049][106225] Updated weights for policy 1, policy_version 392047 (0.0006) [2023-12-27 22:02:29,428][106226] Updated weights for policy 0, policy_version 391051 (0.0008) [2023-12-27 22:02:29,485][106226] Updated weights for policy 0, policy_version 391061 (0.0005) [2023-12-27 22:02:29,548][106226] Updated weights for policy 0, policy_version 391071 (0.0006) [2023-12-27 22:02:29,825][106225] Updated weights for policy 1, policy_version 392057 (0.0008) [2023-12-27 22:02:29,887][106225] Updated weights for policy 1, policy_version 392067 (0.0008) [2023-12-27 22:02:29,953][106225] Updated weights for policy 1, policy_version 392077 (0.0008) [2023-12-27 22:02:30,192][106226] Updated weights for policy 0, policy_version 391081 (0.0006) [2023-12-27 22:02:30,252][106226] Updated weights for policy 0, policy_version 391091 (0.0010) [2023-12-27 22:02:30,309][106226] Updated weights for policy 0, policy_version 391101 (0.0010) [2023-12-27 22:02:30,368][106226] Updated weights for policy 0, policy_version 391111 (0.0008) [2023-12-27 22:02:30,659][106225] Updated weights for policy 1, policy_version 392087 (0.0009) [2023-12-27 22:02:30,708][106225] Updated weights for policy 1, policy_version 392097 (0.0009) [2023-12-27 22:02:30,756][106225] Updated weights for policy 1, policy_version 392107 (0.0007) [2023-12-27 22:02:31,015][106226] Updated weights for policy 0, policy_version 391121 (0.0008) [2023-12-27 22:02:31,081][106226] Updated weights for policy 0, policy_version 391131 (0.0008) [2023-12-27 22:02:31,133][106226] Updated weights for policy 0, policy_version 391141 (0.0008) [2023-12-27 22:02:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19251.3, 300 sec: 19410.9). Total num frames: 200572928. Throughput: 0: 9526.0, 1: 9456.7. Samples: 200558984. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:31,175][105115] Avg episode reward: [(0, '-4.902'), (1, '-5.895')] [2023-12-27 22:02:31,554][106225] Updated weights for policy 1, policy_version 392117 (0.0009) [2023-12-27 22:02:31,613][106225] Updated weights for policy 1, policy_version 392127 (0.0008) [2023-12-27 22:02:31,677][106225] Updated weights for policy 1, policy_version 392137 (0.0008) [2023-12-27 22:02:31,892][106226] Updated weights for policy 0, policy_version 391151 (0.0008) [2023-12-27 22:02:31,945][106226] Updated weights for policy 0, policy_version 391161 (0.0009) [2023-12-27 22:02:32,004][106226] Updated weights for policy 0, policy_version 391171 (0.0009) [2023-12-27 22:02:32,426][106225] Updated weights for policy 1, policy_version 392147 (0.0009) [2023-12-27 22:02:32,489][106225] Updated weights for policy 1, policy_version 392157 (0.0009) [2023-12-27 22:02:32,551][106225] Updated weights for policy 1, policy_version 392167 (0.0008) [2023-12-27 22:02:32,807][106226] Updated weights for policy 0, policy_version 391181 (0.0007) [2023-12-27 22:02:32,873][106226] Updated weights for policy 0, policy_version 391191 (0.0007) [2023-12-27 22:02:32,936][106226] Updated weights for policy 0, policy_version 391201 (0.0007) [2023-12-27 22:02:33,241][106225] Updated weights for policy 1, policy_version 392177 (0.0008) [2023-12-27 22:02:33,297][106225] Updated weights for policy 1, policy_version 392187 (0.0010) [2023-12-27 22:02:33,358][106225] Updated weights for policy 1, policy_version 392197 (0.0010) [2023-12-27 22:02:33,419][106225] Updated weights for policy 1, policy_version 392207 (0.0008) [2023-12-27 22:02:33,524][106226] Updated weights for policy 0, policy_version 391211 (0.0006) [2023-12-27 22:02:33,595][106226] Updated weights for policy 0, policy_version 391221 (0.0006) [2023-12-27 22:02:33,649][106226] Updated weights for policy 0, policy_version 391231 (0.0007) [2023-12-27 22:02:34,075][106225] Updated weights for policy 1, policy_version 392217 (0.0010) [2023-12-27 22:02:34,139][106225] Updated weights for policy 1, policy_version 392227 (0.0009) [2023-12-27 22:02:34,206][106225] Updated weights for policy 1, policy_version 392237 (0.0010) [2023-12-27 22:02:34,349][106226] Updated weights for policy 0, policy_version 391241 (0.0008) [2023-12-27 22:02:34,414][106226] Updated weights for policy 0, policy_version 391251 (0.0007) [2023-12-27 22:02:34,483][106226] Updated weights for policy 0, policy_version 391261 (0.0007) [2023-12-27 22:02:34,548][106226] Updated weights for policy 0, policy_version 391271 (0.0006) [2023-12-27 22:02:34,937][106225] Updated weights for policy 1, policy_version 392247 (0.0010) [2023-12-27 22:02:34,994][106225] Updated weights for policy 1, policy_version 392257 (0.0010) [2023-12-27 22:02:35,055][106225] Updated weights for policy 1, policy_version 392267 (0.0010) [2023-12-27 22:02:35,188][106226] Updated weights for policy 0, policy_version 391281 (0.0008) [2023-12-27 22:02:35,242][106226] Updated weights for policy 0, policy_version 391291 (0.0008) [2023-12-27 22:02:35,306][106226] Updated weights for policy 0, policy_version 391301 (0.0008) [2023-12-27 22:02:35,801][106225] Updated weights for policy 1, policy_version 392277 (0.0011) [2023-12-27 22:02:35,862][106225] Updated weights for policy 1, policy_version 392287 (0.0011) [2023-12-27 22:02:35,917][106225] Updated weights for policy 1, policy_version 392297 (0.0010) [2023-12-27 22:02:36,012][106226] Updated weights for policy 0, policy_version 391311 (0.0008) [2023-12-27 22:02:36,078][106226] Updated weights for policy 0, policy_version 391321 (0.0008) [2023-12-27 22:02:36,146][106226] Updated weights for policy 0, policy_version 391331 (0.0009) [2023-12-27 22:02:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19114.6, 300 sec: 19355.3). Total num frames: 200663040. Throughput: 0: 9598.3, 1: 9464.2. Samples: 200675336. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:36,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.625')] [2023-12-27 22:02:36,642][106225] Updated weights for policy 1, policy_version 392307 (0.0011) [2023-12-27 22:02:36,706][106225] Updated weights for policy 1, policy_version 392317 (0.0011) [2023-12-27 22:02:36,767][106225] Updated weights for policy 1, policy_version 392327 (0.0010) [2023-12-27 22:02:36,908][106226] Updated weights for policy 0, policy_version 391341 (0.0007) [2023-12-27 22:02:36,969][106226] Updated weights for policy 0, policy_version 391351 (0.0006) [2023-12-27 22:02:37,027][106226] Updated weights for policy 0, policy_version 391361 (0.0006) [2023-12-27 22:02:37,511][106225] Updated weights for policy 1, policy_version 392337 (0.0010) [2023-12-27 22:02:37,576][106225] Updated weights for policy 1, policy_version 392347 (0.0010) [2023-12-27 22:02:37,637][106225] Updated weights for policy 1, policy_version 392357 (0.0010) [2023-12-27 22:02:37,659][106226] Updated weights for policy 0, policy_version 391371 (0.0007) [2023-12-27 22:02:37,700][106225] Updated weights for policy 1, policy_version 392367 (0.0010) [2023-12-27 22:02:37,721][106226] Updated weights for policy 0, policy_version 391381 (0.0011) [2023-12-27 22:02:37,797][106226] Updated weights for policy 0, policy_version 391391 (0.0011) [2023-12-27 22:02:38,446][106225] Updated weights for policy 1, policy_version 392377 (0.0007) [2023-12-27 22:02:38,502][106225] Updated weights for policy 1, policy_version 392387 (0.0006) [2023-12-27 22:02:38,510][106226] Updated weights for policy 0, policy_version 391401 (0.0011) [2023-12-27 22:02:38,565][106226] Updated weights for policy 0, policy_version 391411 (0.0006) [2023-12-27 22:02:38,567][106225] Updated weights for policy 1, policy_version 392397 (0.0008) [2023-12-27 22:02:38,624][106226] Updated weights for policy 0, policy_version 391421 (0.0007) [2023-12-27 22:02:38,675][106226] Updated weights for policy 0, policy_version 391431 (0.0008) [2023-12-27 22:02:39,202][106225] Updated weights for policy 1, policy_version 392407 (0.0007) [2023-12-27 22:02:39,281][106225] Updated weights for policy 1, policy_version 392417 (0.0024) [2023-12-27 22:02:39,338][106225] Updated weights for policy 1, policy_version 392427 (0.0008) [2023-12-27 22:02:39,501][106226] Updated weights for policy 0, policy_version 391441 (0.0008) [2023-12-27 22:02:39,560][106226] Updated weights for policy 0, policy_version 391451 (0.0008) [2023-12-27 22:02:39,616][106226] Updated weights for policy 0, policy_version 391461 (0.0008) [2023-12-27 22:02:40,157][106225] Updated weights for policy 1, policy_version 392437 (0.0008) [2023-12-27 22:02:40,220][106225] Updated weights for policy 1, policy_version 392447 (0.0009) [2023-12-27 22:02:40,287][106225] Updated weights for policy 1, policy_version 392457 (0.0009) [2023-12-27 22:02:40,404][106226] Updated weights for policy 0, policy_version 391471 (0.0008) [2023-12-27 22:02:40,475][106226] Updated weights for policy 0, policy_version 391481 (0.0008) [2023-12-27 22:02:40,536][106226] Updated weights for policy 0, policy_version 391491 (0.0008) [2023-12-27 22:02:41,036][106225] Updated weights for policy 1, policy_version 392467 (0.0010) [2023-12-27 22:02:41,102][106225] Updated weights for policy 1, policy_version 392477 (0.0008) [2023-12-27 22:02:41,173][106225] Updated weights for policy 1, policy_version 392487 (0.0008) [2023-12-27 22:02:41,175][105115] Fps is (10 sec: 18022.2, 60 sec: 18978.2, 300 sec: 19327.6). Total num frames: 200753152. Throughput: 0: 9605.6, 1: 9468.5. Samples: 200732176. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:41,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-5.642')] [2023-12-27 22:02:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000391496_100253696.pth... [2023-12-27 22:02:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000390376_99966976.pth [2023-12-27 22:02:41,232][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000392496_100507648.pth... [2023-12-27 22:02:41,236][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000391376_100220928.pth [2023-12-27 22:02:41,311][106226] Updated weights for policy 0, policy_version 391501 (0.0007) [2023-12-27 22:02:41,380][106226] Updated weights for policy 0, policy_version 391511 (0.0009) [2023-12-27 22:02:41,451][106226] Updated weights for policy 0, policy_version 391521 (0.0009) [2023-12-27 22:02:41,958][106225] Updated weights for policy 1, policy_version 392497 (0.0009) [2023-12-27 22:02:42,025][106225] Updated weights for policy 1, policy_version 392507 (0.0008) [2023-12-27 22:02:42,085][106225] Updated weights for policy 1, policy_version 392517 (0.0008) [2023-12-27 22:02:42,144][106225] Updated weights for policy 1, policy_version 392527 (0.0008) [2023-12-27 22:02:42,201][106226] Updated weights for policy 0, policy_version 391531 (0.0009) [2023-12-27 22:02:42,262][106226] Updated weights for policy 0, policy_version 391541 (0.0009) [2023-12-27 22:02:42,333][106226] Updated weights for policy 0, policy_version 391551 (0.0008) [2023-12-27 22:02:42,943][106225] Updated weights for policy 1, policy_version 392537 (0.0009) [2023-12-27 22:02:42,970][106226] Updated weights for policy 0, policy_version 391561 (0.0008) [2023-12-27 22:02:43,004][106225] Updated weights for policy 1, policy_version 392547 (0.0008) [2023-12-27 22:02:43,033][106226] Updated weights for policy 0, policy_version 391571 (0.0006) [2023-12-27 22:02:43,061][106225] Updated weights for policy 1, policy_version 392557 (0.0006) [2023-12-27 22:02:43,090][106226] Updated weights for policy 0, policy_version 391581 (0.0008) [2023-12-27 22:02:43,140][106226] Updated weights for policy 0, policy_version 391591 (0.0010) [2023-12-27 22:02:43,663][106225] Updated weights for policy 1, policy_version 392567 (0.0005) [2023-12-27 22:02:43,710][106225] Updated weights for policy 1, policy_version 392577 (0.0005) [2023-12-27 22:02:43,760][106225] Updated weights for policy 1, policy_version 392587 (0.0008) [2023-12-27 22:02:43,950][106226] Updated weights for policy 0, policy_version 391601 (0.0009) [2023-12-27 22:02:44,025][106226] Updated weights for policy 0, policy_version 391611 (0.0009) [2023-12-27 22:02:44,091][106226] Updated weights for policy 0, policy_version 391621 (0.0008) [2023-12-27 22:02:44,358][106225] Updated weights for policy 1, policy_version 392597 (0.0007) [2023-12-27 22:02:44,414][106225] Updated weights for policy 1, policy_version 392607 (0.0008) [2023-12-27 22:02:44,471][106225] Updated weights for policy 1, policy_version 392617 (0.0009) [2023-12-27 22:02:44,866][106226] Updated weights for policy 0, policy_version 391631 (0.0008) [2023-12-27 22:02:44,927][106226] Updated weights for policy 0, policy_version 391641 (0.0008) [2023-12-27 22:02:44,991][106226] Updated weights for policy 0, policy_version 391651 (0.0009) [2023-12-27 22:02:45,149][106225] Updated weights for policy 1, policy_version 392627 (0.0008) [2023-12-27 22:02:45,213][106225] Updated weights for policy 1, policy_version 392637 (0.0008) [2023-12-27 22:02:45,282][106225] Updated weights for policy 1, policy_version 392647 (0.0008) [2023-12-27 22:02:45,729][106226] Updated weights for policy 0, policy_version 391661 (0.0010) [2023-12-27 22:02:45,788][106226] Updated weights for policy 0, policy_version 391671 (0.0010) [2023-12-27 22:02:45,838][106226] Updated weights for policy 0, policy_version 391681 (0.0010) [2023-12-27 22:02:45,938][106225] Updated weights for policy 1, policy_version 392657 (0.0008) [2023-12-27 22:02:45,996][106225] Updated weights for policy 1, policy_version 392667 (0.0008) [2023-12-27 22:02:46,054][106225] Updated weights for policy 1, policy_version 392677 (0.0009) [2023-12-27 22:02:46,109][106225] Updated weights for policy 1, policy_version 392687 (0.0008) [2023-12-27 22:02:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19114.7, 300 sec: 19355.3). Total num frames: 200859648. Throughput: 0: 9553.2, 1: 9535.2. Samples: 200844824. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:46,175][105115] Avg episode reward: [(0, '-4.994'), (1, '-5.734')] [2023-12-27 22:02:46,490][106226] Updated weights for policy 0, policy_version 391691 (0.0011) [2023-12-27 22:02:46,540][106226] Updated weights for policy 0, policy_version 391701 (0.0010) [2023-12-27 22:02:46,602][106226] Updated weights for policy 0, policy_version 391711 (0.0010) [2023-12-27 22:02:46,848][106225] Updated weights for policy 1, policy_version 392697 (0.0006) [2023-12-27 22:02:46,901][106225] Updated weights for policy 1, policy_version 392707 (0.0006) [2023-12-27 22:02:46,957][106225] Updated weights for policy 1, policy_version 392717 (0.0008) [2023-12-27 22:02:47,324][106226] Updated weights for policy 0, policy_version 391721 (0.0010) [2023-12-27 22:02:47,387][106226] Updated weights for policy 0, policy_version 391731 (0.0011) [2023-12-27 22:02:47,447][106226] Updated weights for policy 0, policy_version 391741 (0.0010) [2023-12-27 22:02:47,505][106226] Updated weights for policy 0, policy_version 391751 (0.0009) [2023-12-27 22:02:47,677][106225] Updated weights for policy 1, policy_version 392727 (0.0008) [2023-12-27 22:02:47,739][106225] Updated weights for policy 1, policy_version 392737 (0.0008) [2023-12-27 22:02:47,807][106225] Updated weights for policy 1, policy_version 392747 (0.0006) [2023-12-27 22:02:48,208][106226] Updated weights for policy 0, policy_version 391761 (0.0007) [2023-12-27 22:02:48,258][106226] Updated weights for policy 0, policy_version 391771 (0.0011) [2023-12-27 22:02:48,313][106226] Updated weights for policy 0, policy_version 391781 (0.0011) [2023-12-27 22:02:48,443][106225] Updated weights for policy 1, policy_version 392757 (0.0006) [2023-12-27 22:02:48,511][106225] Updated weights for policy 1, policy_version 392767 (0.0008) [2023-12-27 22:02:48,572][106225] Updated weights for policy 1, policy_version 392777 (0.0008) [2023-12-27 22:02:49,073][106226] Updated weights for policy 0, policy_version 391791 (0.0009) [2023-12-27 22:02:49,122][106226] Updated weights for policy 0, policy_version 391801 (0.0009) [2023-12-27 22:02:49,172][106226] Updated weights for policy 0, policy_version 391811 (0.0008) [2023-12-27 22:02:49,322][106225] Updated weights for policy 1, policy_version 392787 (0.0008) [2023-12-27 22:02:49,391][106225] Updated weights for policy 1, policy_version 392797 (0.0009) [2023-12-27 22:02:49,446][106225] Updated weights for policy 1, policy_version 392807 (0.0008) [2023-12-27 22:02:49,958][106226] Updated weights for policy 0, policy_version 391821 (0.0007) [2023-12-27 22:02:50,025][106226] Updated weights for policy 0, policy_version 391831 (0.0009) [2023-12-27 22:02:50,086][106226] Updated weights for policy 0, policy_version 391841 (0.0009) [2023-12-27 22:02:50,243][106225] Updated weights for policy 1, policy_version 392817 (0.0008) [2023-12-27 22:02:50,304][106225] Updated weights for policy 1, policy_version 392827 (0.0008) [2023-12-27 22:02:50,365][106225] Updated weights for policy 1, policy_version 392837 (0.0008) [2023-12-27 22:02:50,443][106225] Updated weights for policy 1, policy_version 392847 (0.0008) [2023-12-27 22:02:50,802][106226] Updated weights for policy 0, policy_version 391851 (0.0007) [2023-12-27 22:02:50,863][106226] Updated weights for policy 0, policy_version 391861 (0.0010) [2023-12-27 22:02:50,933][106226] Updated weights for policy 0, policy_version 391871 (0.0009) [2023-12-27 22:02:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 18978.1, 300 sec: 19327.6). Total num frames: 200949760. Throughput: 0: 9516.1, 1: 9521.2. Samples: 200959516. Policy #0 lag: (min: 16.0, avg: 39.5, max: 48.0) [2023-12-27 22:02:51,175][105115] Avg episode reward: [(0, '-5.036'), (1, '-5.496')] [2023-12-27 22:02:51,184][106225] Updated weights for policy 1, policy_version 392857 (0.0009) [2023-12-27 22:02:51,254][106225] Updated weights for policy 1, policy_version 392867 (0.0006) [2023-12-27 22:02:51,319][106225] Updated weights for policy 1, policy_version 392877 (0.0009) [2023-12-27 22:02:51,699][106226] Updated weights for policy 0, policy_version 391881 (0.0008) [2023-12-27 22:02:51,772][106226] Updated weights for policy 0, policy_version 391891 (0.0008) [2023-12-27 22:02:51,832][106226] Updated weights for policy 0, policy_version 391901 (0.0010) [2023-12-27 22:02:51,902][106226] Updated weights for policy 0, policy_version 391911 (0.0010) [2023-12-27 22:02:52,047][106225] Updated weights for policy 1, policy_version 392887 (0.0007) [2023-12-27 22:02:52,112][106225] Updated weights for policy 1, policy_version 392897 (0.0006) [2023-12-27 22:02:52,182][106225] Updated weights for policy 1, policy_version 392907 (0.0005) [2023-12-27 22:02:52,717][106226] Updated weights for policy 0, policy_version 391921 (0.0009) [2023-12-27 22:02:52,779][106226] Updated weights for policy 0, policy_version 391931 (0.0009) [2023-12-27 22:02:52,844][106226] Updated weights for policy 0, policy_version 391941 (0.0008) [2023-12-27 22:02:52,858][106225] Updated weights for policy 1, policy_version 392917 (0.0008) [2023-12-27 22:02:52,923][106225] Updated weights for policy 1, policy_version 392927 (0.0007) [2023-12-27 22:02:52,978][106225] Updated weights for policy 1, policy_version 392937 (0.0005) [2023-12-27 22:02:53,503][106225] Updated weights for policy 1, policy_version 392947 (0.0006) [2023-12-27 22:02:53,562][106225] Updated weights for policy 1, policy_version 392957 (0.0010) [2023-12-27 22:02:53,607][106226] Updated weights for policy 0, policy_version 391951 (0.0007) [2023-12-27 22:02:53,613][106225] Updated weights for policy 1, policy_version 392967 (0.0009) [2023-12-27 22:02:53,664][106226] Updated weights for policy 0, policy_version 391961 (0.0010) [2023-12-27 22:02:53,719][106226] Updated weights for policy 0, policy_version 391971 (0.0009) [2023-12-27 22:02:54,356][106225] Updated weights for policy 1, policy_version 392977 (0.0006) [2023-12-27 22:02:54,412][106225] Updated weights for policy 1, policy_version 392987 (0.0007) [2023-12-27 22:02:54,425][106226] Updated weights for policy 0, policy_version 391981 (0.0011) [2023-12-27 22:02:54,468][106225] Updated weights for policy 1, policy_version 392997 (0.0006) [2023-12-27 22:02:54,483][106226] Updated weights for policy 0, policy_version 391991 (0.0011) [2023-12-27 22:02:54,519][106225] Updated weights for policy 1, policy_version 393007 (0.0006) [2023-12-27 22:02:54,543][106226] Updated weights for policy 0, policy_version 392001 (0.0010) [2023-12-27 22:02:55,192][106225] Updated weights for policy 1, policy_version 393017 (0.0009) [2023-12-27 22:02:55,212][106226] Updated weights for policy 0, policy_version 392011 (0.0011) [2023-12-27 22:02:55,255][106225] Updated weights for policy 1, policy_version 393027 (0.0009) [2023-12-27 22:02:55,268][106226] Updated weights for policy 0, policy_version 392021 (0.0010) [2023-12-27 22:02:55,312][106225] Updated weights for policy 1, policy_version 393037 (0.0006) [2023-12-27 22:02:55,332][106226] Updated weights for policy 0, policy_version 392031 (0.0011) [2023-12-27 22:02:55,997][106225] Updated weights for policy 1, policy_version 393047 (0.0008) [2023-12-27 22:02:56,050][106226] Updated weights for policy 0, policy_version 392041 (0.0008) [2023-12-27 22:02:56,055][106225] Updated weights for policy 1, policy_version 393057 (0.0006) [2023-12-27 22:02:56,112][106225] Updated weights for policy 1, policy_version 393067 (0.0005) [2023-12-27 22:02:56,113][106226] Updated weights for policy 0, policy_version 392051 (0.0006) [2023-12-27 22:02:56,174][106226] Updated weights for policy 0, policy_version 392061 (0.0006) [2023-12-27 22:02:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 18978.1, 300 sec: 19327.6). Total num frames: 201048064. Throughput: 0: 9511.7, 1: 9523.4. Samples: 201018148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:02:56,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-5.669')] [2023-12-27 22:02:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000393072_100655104.pth... [2023-12-27 22:02:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000391920_100360192.pth [2023-12-27 22:02:56,244][106226] Updated weights for policy 0, policy_version 392071 (0.0007) [2023-12-27 22:02:56,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000392072_100401152.pth... [2023-12-27 22:02:56,252][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000390920_100106240.pth [2023-12-27 22:02:56,732][106225] Updated weights for policy 1, policy_version 393077 (0.0007) [2023-12-27 22:02:56,786][106225] Updated weights for policy 1, policy_version 393087 (0.0008) [2023-12-27 22:02:56,839][106225] Updated weights for policy 1, policy_version 393097 (0.0008) [2023-12-27 22:02:56,857][106226] Updated weights for policy 0, policy_version 392081 (0.0006) [2023-12-27 22:02:56,922][106226] Updated weights for policy 0, policy_version 392091 (0.0008) [2023-12-27 22:02:56,988][106226] Updated weights for policy 0, policy_version 392101 (0.0009) [2023-12-27 22:02:57,470][106225] Updated weights for policy 1, policy_version 393107 (0.0009) [2023-12-27 22:02:57,517][106225] Updated weights for policy 1, policy_version 393117 (0.0010) [2023-12-27 22:02:57,564][106225] Updated weights for policy 1, policy_version 393127 (0.0010) [2023-12-27 22:02:57,678][106226] Updated weights for policy 0, policy_version 392111 (0.0010) [2023-12-27 22:02:57,733][106226] Updated weights for policy 0, policy_version 392121 (0.0009) [2023-12-27 22:02:57,797][106226] Updated weights for policy 0, policy_version 392131 (0.0011) [2023-12-27 22:02:58,304][106225] Updated weights for policy 1, policy_version 393137 (0.0010) [2023-12-27 22:02:58,374][106225] Updated weights for policy 1, policy_version 393147 (0.0009) [2023-12-27 22:02:58,444][106225] Updated weights for policy 1, policy_version 393157 (0.0009) [2023-12-27 22:02:58,511][106225] Updated weights for policy 1, policy_version 393167 (0.0010) [2023-12-27 22:02:58,574][106226] Updated weights for policy 0, policy_version 392141 (0.0011) [2023-12-27 22:02:58,640][106226] Updated weights for policy 0, policy_version 392151 (0.0011) [2023-12-27 22:02:58,706][106226] Updated weights for policy 0, policy_version 392161 (0.0010) [2023-12-27 22:02:59,417][106225] Updated weights for policy 1, policy_version 393177 (0.0009) [2023-12-27 22:02:59,472][106225] Updated weights for policy 1, policy_version 393187 (0.0008) [2023-12-27 22:02:59,536][106225] Updated weights for policy 1, policy_version 393197 (0.0009) [2023-12-27 22:02:59,648][106226] Updated weights for policy 0, policy_version 392171 (0.0009) [2023-12-27 22:02:59,711][106226] Updated weights for policy 0, policy_version 392181 (0.0009) [2023-12-27 22:02:59,775][106226] Updated weights for policy 0, policy_version 392191 (0.0009) [2023-12-27 22:03:00,336][106225] Updated weights for policy 1, policy_version 393207 (0.0008) [2023-12-27 22:03:00,388][106225] Updated weights for policy 1, policy_version 393217 (0.0008) [2023-12-27 22:03:00,437][106225] Updated weights for policy 1, policy_version 393227 (0.0008) [2023-12-27 22:03:00,530][106226] Updated weights for policy 0, policy_version 392201 (0.0009) [2023-12-27 22:03:00,607][106226] Updated weights for policy 0, policy_version 392211 (0.0009) [2023-12-27 22:03:00,660][106226] Updated weights for policy 0, policy_version 392221 (0.0008) [2023-12-27 22:03:00,722][106226] Updated weights for policy 0, policy_version 392231 (0.0005) [2023-12-27 22:03:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 18978.2, 300 sec: 19272.0). Total num frames: 201138176. Throughput: 0: 9549.3, 1: 9612.8. Samples: 201133612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:01,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-5.654')] [2023-12-27 22:03:01,229][106225] Updated weights for policy 1, policy_version 393237 (0.0008) [2023-12-27 22:03:01,298][106225] Updated weights for policy 1, policy_version 393247 (0.0008) [2023-12-27 22:03:01,365][106225] Updated weights for policy 1, policy_version 393257 (0.0008) [2023-12-27 22:03:01,422][106226] Updated weights for policy 0, policy_version 392241 (0.0008) [2023-12-27 22:03:01,487][106226] Updated weights for policy 0, policy_version 392251 (0.0009) [2023-12-27 22:03:01,555][106226] Updated weights for policy 0, policy_version 392261 (0.0011) [2023-12-27 22:03:02,101][106225] Updated weights for policy 1, policy_version 393267 (0.0007) [2023-12-27 22:03:02,160][106225] Updated weights for policy 1, policy_version 393277 (0.0008) [2023-12-27 22:03:02,217][106225] Updated weights for policy 1, policy_version 393287 (0.0007) [2023-12-27 22:03:02,340][106226] Updated weights for policy 0, policy_version 392271 (0.0008) [2023-12-27 22:03:02,410][106226] Updated weights for policy 0, policy_version 392281 (0.0008) [2023-12-27 22:03:02,470][106226] Updated weights for policy 0, policy_version 392291 (0.0008) [2023-12-27 22:03:02,891][106225] Updated weights for policy 1, policy_version 393297 (0.0007) [2023-12-27 22:03:02,950][106225] Updated weights for policy 1, policy_version 393307 (0.0010) [2023-12-27 22:03:03,001][106225] Updated weights for policy 1, policy_version 393317 (0.0008) [2023-12-27 22:03:03,053][106225] Updated weights for policy 1, policy_version 393327 (0.0007) [2023-12-27 22:03:03,142][106226] Updated weights for policy 0, policy_version 392301 (0.0009) [2023-12-27 22:03:03,202][106226] Updated weights for policy 0, policy_version 392311 (0.0007) [2023-12-27 22:03:03,260][106226] Updated weights for policy 0, policy_version 392321 (0.0009) [2023-12-27 22:03:03,750][106225] Updated weights for policy 1, policy_version 393337 (0.0005) [2023-12-27 22:03:03,823][106225] Updated weights for policy 1, policy_version 393347 (0.0008) [2023-12-27 22:03:03,901][106225] Updated weights for policy 1, policy_version 393357 (0.0011) [2023-12-27 22:03:03,939][106226] Updated weights for policy 0, policy_version 392331 (0.0009) [2023-12-27 22:03:04,005][106226] Updated weights for policy 0, policy_version 392341 (0.0008) [2023-12-27 22:03:04,069][106226] Updated weights for policy 0, policy_version 392351 (0.0008) [2023-12-27 22:03:04,577][106225] Updated weights for policy 1, policy_version 393367 (0.0008) [2023-12-27 22:03:04,640][106225] Updated weights for policy 1, policy_version 393377 (0.0010) [2023-12-27 22:03:04,701][106225] Updated weights for policy 1, policy_version 393387 (0.0009) [2023-12-27 22:03:04,832][106226] Updated weights for policy 0, policy_version 392361 (0.0009) [2023-12-27 22:03:04,892][106226] Updated weights for policy 0, policy_version 392371 (0.0010) [2023-12-27 22:03:04,962][106226] Updated weights for policy 0, policy_version 392381 (0.0009) [2023-12-27 22:03:05,023][106226] Updated weights for policy 0, policy_version 392391 (0.0008) [2023-12-27 22:03:05,326][106225] Updated weights for policy 1, policy_version 393397 (0.0008) [2023-12-27 22:03:05,376][106225] Updated weights for policy 1, policy_version 393407 (0.0010) [2023-12-27 22:03:05,423][106225] Updated weights for policy 1, policy_version 393417 (0.0010) [2023-12-27 22:03:05,713][106226] Updated weights for policy 0, policy_version 392401 (0.0007) [2023-12-27 22:03:05,783][106226] Updated weights for policy 0, policy_version 392411 (0.0008) [2023-12-27 22:03:05,842][106226] Updated weights for policy 0, policy_version 392421 (0.0007) [2023-12-27 22:03:06,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19114.8, 300 sec: 19299.8). Total num frames: 201236480. Throughput: 0: 9558.7, 1: 9675.0. Samples: 201248796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:06,175][105115] Avg episode reward: [(0, '-4.950'), (1, '-5.887')] [2023-12-27 22:03:06,190][106225] Updated weights for policy 1, policy_version 393427 (0.0010) [2023-12-27 22:03:06,256][106225] Updated weights for policy 1, policy_version 393437 (0.0011) [2023-12-27 22:03:06,314][106225] Updated weights for policy 1, policy_version 393447 (0.0010) [2023-12-27 22:03:06,602][106226] Updated weights for policy 0, policy_version 392431 (0.0008) [2023-12-27 22:03:06,671][106226] Updated weights for policy 0, policy_version 392441 (0.0006) [2023-12-27 22:03:06,743][106226] Updated weights for policy 0, policy_version 392451 (0.0006) [2023-12-27 22:03:07,033][106225] Updated weights for policy 1, policy_version 393457 (0.0010) [2023-12-27 22:03:07,086][106225] Updated weights for policy 1, policy_version 393467 (0.0005) [2023-12-27 22:03:07,144][106225] Updated weights for policy 1, policy_version 393477 (0.0008) [2023-12-27 22:03:07,191][106225] Updated weights for policy 1, policy_version 393487 (0.0007) [2023-12-27 22:03:07,503][106226] Updated weights for policy 0, policy_version 392461 (0.0010) [2023-12-27 22:03:07,553][106226] Updated weights for policy 0, policy_version 392471 (0.0009) [2023-12-27 22:03:07,604][106226] Updated weights for policy 0, policy_version 392481 (0.0008) [2023-12-27 22:03:07,770][106225] Updated weights for policy 1, policy_version 393497 (0.0008) [2023-12-27 22:03:07,828][106225] Updated weights for policy 1, policy_version 393507 (0.0007) [2023-12-27 22:03:07,889][106225] Updated weights for policy 1, policy_version 393517 (0.0006) [2023-12-27 22:03:08,415][106226] Updated weights for policy 0, policy_version 392491 (0.0008) [2023-12-27 22:03:08,485][106226] Updated weights for policy 0, policy_version 392501 (0.0009) [2023-12-27 22:03:08,551][106226] Updated weights for policy 0, policy_version 392511 (0.0009) [2023-12-27 22:03:08,574][106225] Updated weights for policy 1, policy_version 393527 (0.0010) [2023-12-27 22:03:08,634][106225] Updated weights for policy 1, policy_version 393537 (0.0007) [2023-12-27 22:03:08,693][106225] Updated weights for policy 1, policy_version 393547 (0.0007) [2023-12-27 22:03:09,167][106226] Updated weights for policy 0, policy_version 392521 (0.0008) [2023-12-27 22:03:09,238][106226] Updated weights for policy 0, policy_version 392531 (0.0007) [2023-12-27 22:03:09,302][106226] Updated weights for policy 0, policy_version 392541 (0.0008) [2023-12-27 22:03:09,381][106226] Updated weights for policy 0, policy_version 392551 (0.0008) [2023-12-27 22:03:09,450][106225] Updated weights for policy 1, policy_version 393557 (0.0007) [2023-12-27 22:03:09,514][106225] Updated weights for policy 1, policy_version 393567 (0.0007) [2023-12-27 22:03:09,572][106225] Updated weights for policy 1, policy_version 393577 (0.0013) [2023-12-27 22:03:10,143][106226] Updated weights for policy 0, policy_version 392561 (0.0007) [2023-12-27 22:03:10,211][106226] Updated weights for policy 0, policy_version 392571 (0.0005) [2023-12-27 22:03:10,271][106225] Updated weights for policy 1, policy_version 393587 (0.0010) [2023-12-27 22:03:10,272][106226] Updated weights for policy 0, policy_version 392581 (0.0006) [2023-12-27 22:03:10,330][106225] Updated weights for policy 1, policy_version 393597 (0.0011) [2023-12-27 22:03:10,388][106225] Updated weights for policy 1, policy_version 393607 (0.0010) [2023-12-27 22:03:10,944][106226] Updated weights for policy 0, policy_version 392591 (0.0008) [2023-12-27 22:03:11,001][106226] Updated weights for policy 0, policy_version 392601 (0.0008) [2023-12-27 22:03:11,066][106226] Updated weights for policy 0, policy_version 392611 (0.0008) [2023-12-27 22:03:11,159][106225] Updated weights for policy 1, policy_version 393617 (0.0010) [2023-12-27 22:03:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19114.6, 300 sec: 19299.8). Total num frames: 201334784. Throughput: 0: 9583.4, 1: 9730.3. Samples: 201307444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:11,175][105115] Avg episode reward: [(0, '-4.973'), (1, '-5.879')] [2023-12-27 22:03:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000392616_100540416.pth... [2023-12-27 22:03:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000391496_100253696.pth [2023-12-27 22:03:11,231][106225] Updated weights for policy 1, policy_version 393627 (0.0009) [2023-12-27 22:03:11,302][106225] Updated weights for policy 1, policy_version 393637 (0.0009) [2023-12-27 22:03:11,369][106225] Updated weights for policy 1, policy_version 393647 (0.0010) [2023-12-27 22:03:11,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000393648_100802560.pth... [2023-12-27 22:03:11,384][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000392496_100507648.pth [2023-12-27 22:03:11,871][106226] Updated weights for policy 0, policy_version 392621 (0.0009) [2023-12-27 22:03:11,936][106226] Updated weights for policy 0, policy_version 392631 (0.0007) [2023-12-27 22:03:11,999][106226] Updated weights for policy 0, policy_version 392641 (0.0009) [2023-12-27 22:03:12,171][106225] Updated weights for policy 1, policy_version 393657 (0.0011) [2023-12-27 22:03:12,241][106225] Updated weights for policy 1, policy_version 393667 (0.0010) [2023-12-27 22:03:12,301][106225] Updated weights for policy 1, policy_version 393677 (0.0010) [2023-12-27 22:03:12,754][106226] Updated weights for policy 0, policy_version 392651 (0.0009) [2023-12-27 22:03:12,813][106226] Updated weights for policy 0, policy_version 392661 (0.0008) [2023-12-27 22:03:12,873][106226] Updated weights for policy 0, policy_version 392671 (0.0007) [2023-12-27 22:03:12,926][106225] Updated weights for policy 1, policy_version 393687 (0.0009) [2023-12-27 22:03:12,992][106225] Updated weights for policy 1, policy_version 393697 (0.0006) [2023-12-27 22:03:13,045][106225] Updated weights for policy 1, policy_version 393707 (0.0006) [2023-12-27 22:03:13,490][106226] Updated weights for policy 0, policy_version 392681 (0.0007) [2023-12-27 22:03:13,549][106226] Updated weights for policy 0, policy_version 392691 (0.0008) [2023-12-27 22:03:13,606][106225] Updated weights for policy 1, policy_version 393717 (0.0008) [2023-12-27 22:03:13,607][106226] Updated weights for policy 0, policy_version 392701 (0.0009) [2023-12-27 22:03:13,666][106225] Updated weights for policy 1, policy_version 393727 (0.0011) [2023-12-27 22:03:13,667][106226] Updated weights for policy 0, policy_version 392711 (0.0008) [2023-12-27 22:03:13,722][106225] Updated weights for policy 1, policy_version 393737 (0.0009) [2023-12-27 22:03:14,303][106226] Updated weights for policy 0, policy_version 392721 (0.0005) [2023-12-27 22:03:14,331][106225] Updated weights for policy 1, policy_version 393747 (0.0007) [2023-12-27 22:03:14,355][106226] Updated weights for policy 0, policy_version 392731 (0.0005) [2023-12-27 22:03:14,386][106225] Updated weights for policy 1, policy_version 393757 (0.0011) [2023-12-27 22:03:14,411][106226] Updated weights for policy 0, policy_version 392741 (0.0005) [2023-12-27 22:03:14,437][106225] Updated weights for policy 1, policy_version 393767 (0.0010) [2023-12-27 22:03:14,967][106226] Updated weights for policy 0, policy_version 392751 (0.0009) [2023-12-27 22:03:15,032][106226] Updated weights for policy 0, policy_version 392761 (0.0009) [2023-12-27 22:03:15,101][106226] Updated weights for policy 0, policy_version 392771 (0.0011) [2023-12-27 22:03:15,181][106225] Updated weights for policy 1, policy_version 393777 (0.0010) [2023-12-27 22:03:15,247][106225] Updated weights for policy 1, policy_version 393787 (0.0011) [2023-12-27 22:03:15,313][106225] Updated weights for policy 1, policy_version 393797 (0.0011) [2023-12-27 22:03:15,380][106225] Updated weights for policy 1, policy_version 393807 (0.0011) [2023-12-27 22:03:15,811][106226] Updated weights for policy 0, policy_version 392781 (0.0009) [2023-12-27 22:03:15,872][106226] Updated weights for policy 0, policy_version 392791 (0.0006) [2023-12-27 22:03:15,941][106226] Updated weights for policy 0, policy_version 392801 (0.0006) [2023-12-27 22:03:16,049][106225] Updated weights for policy 1, policy_version 393817 (0.0010) [2023-12-27 22:03:16,099][106225] Updated weights for policy 1, policy_version 393827 (0.0010) [2023-12-27 22:03:16,157][106225] Updated weights for policy 1, policy_version 393837 (0.0010) [2023-12-27 22:03:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19251.3, 300 sec: 19327.6). Total num frames: 201441280. Throughput: 0: 9514.2, 1: 9745.8. Samples: 201425688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:16,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.637')] [2023-12-27 22:03:16,501][106226] Updated weights for policy 0, policy_version 392811 (0.0007) [2023-12-27 22:03:16,557][106226] Updated weights for policy 0, policy_version 392821 (0.0006) [2023-12-27 22:03:16,613][106226] Updated weights for policy 0, policy_version 392831 (0.0008) [2023-12-27 22:03:16,857][106225] Updated weights for policy 1, policy_version 393847 (0.0010) [2023-12-27 22:03:16,917][106225] Updated weights for policy 1, policy_version 393857 (0.0010) [2023-12-27 22:03:16,977][106225] Updated weights for policy 1, policy_version 393867 (0.0010) [2023-12-27 22:03:17,181][106226] Updated weights for policy 0, policy_version 392841 (0.0008) [2023-12-27 22:03:17,237][106226] Updated weights for policy 0, policy_version 392851 (0.0006) [2023-12-27 22:03:17,300][106226] Updated weights for policy 0, policy_version 392861 (0.0008) [2023-12-27 22:03:17,360][106226] Updated weights for policy 0, policy_version 392871 (0.0008) [2023-12-27 22:03:17,651][106225] Updated weights for policy 1, policy_version 393877 (0.0010) [2023-12-27 22:03:17,718][106225] Updated weights for policy 1, policy_version 393887 (0.0010) [2023-12-27 22:03:17,771][106225] Updated weights for policy 1, policy_version 393897 (0.0010) [2023-12-27 22:03:18,016][106226] Updated weights for policy 0, policy_version 392881 (0.0011) [2023-12-27 22:03:18,081][106226] Updated weights for policy 0, policy_version 392891 (0.0010) [2023-12-27 22:03:18,140][106226] Updated weights for policy 0, policy_version 392901 (0.0010) [2023-12-27 22:03:18,493][106225] Updated weights for policy 1, policy_version 393907 (0.0009) [2023-12-27 22:03:18,558][106225] Updated weights for policy 1, policy_version 393917 (0.0005) [2023-12-27 22:03:18,625][106225] Updated weights for policy 1, policy_version 393927 (0.0005) [2023-12-27 22:03:18,789][106226] Updated weights for policy 0, policy_version 392911 (0.0010) [2023-12-27 22:03:18,854][106226] Updated weights for policy 0, policy_version 392921 (0.0011) [2023-12-27 22:03:18,919][106226] Updated weights for policy 0, policy_version 392931 (0.0009) [2023-12-27 22:03:19,307][106225] Updated weights for policy 1, policy_version 393937 (0.0006) [2023-12-27 22:03:19,379][106225] Updated weights for policy 1, policy_version 393947 (0.0007) [2023-12-27 22:03:19,445][106225] Updated weights for policy 1, policy_version 393957 (0.0008) [2023-12-27 22:03:19,523][106225] Updated weights for policy 1, policy_version 393967 (0.0007) [2023-12-27 22:03:19,677][106226] Updated weights for policy 0, policy_version 392941 (0.0008) [2023-12-27 22:03:19,740][106226] Updated weights for policy 0, policy_version 392951 (0.0008) [2023-12-27 22:03:19,801][106226] Updated weights for policy 0, policy_version 392961 (0.0008) [2023-12-27 22:03:20,310][106225] Updated weights for policy 1, policy_version 393977 (0.0006) [2023-12-27 22:03:20,381][106225] Updated weights for policy 1, policy_version 393987 (0.0008) [2023-12-27 22:03:20,448][106225] Updated weights for policy 1, policy_version 393997 (0.0009) [2023-12-27 22:03:20,544][106226] Updated weights for policy 0, policy_version 392971 (0.0010) [2023-12-27 22:03:20,626][106226] Updated weights for policy 0, policy_version 392981 (0.0010) [2023-12-27 22:03:20,691][106226] Updated weights for policy 0, policy_version 392991 (0.0011) [2023-12-27 22:03:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.7, 300 sec: 19299.8). Total num frames: 201531392. Throughput: 0: 9546.8, 1: 9758.7. Samples: 201544080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:21,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.863')] [2023-12-27 22:03:21,202][106225] Updated weights for policy 1, policy_version 394007 (0.0008) [2023-12-27 22:03:21,263][106225] Updated weights for policy 1, policy_version 394017 (0.0008) [2023-12-27 22:03:21,320][106225] Updated weights for policy 1, policy_version 394027 (0.0008) [2023-12-27 22:03:21,516][106226] Updated weights for policy 0, policy_version 393001 (0.0011) [2023-12-27 22:03:21,583][106226] Updated weights for policy 0, policy_version 393011 (0.0009) [2023-12-27 22:03:21,654][106226] Updated weights for policy 0, policy_version 393021 (0.0008) [2023-12-27 22:03:21,727][106226] Updated weights for policy 0, policy_version 393031 (0.0009) [2023-12-27 22:03:22,107][106225] Updated weights for policy 1, policy_version 394037 (0.0012) [2023-12-27 22:03:22,157][106225] Updated weights for policy 1, policy_version 394047 (0.0010) [2023-12-27 22:03:22,226][106225] Updated weights for policy 1, policy_version 394057 (0.0011) [2023-12-27 22:03:22,376][106226] Updated weights for policy 0, policy_version 393041 (0.0008) [2023-12-27 22:03:22,443][106226] Updated weights for policy 0, policy_version 393051 (0.0007) [2023-12-27 22:03:22,510][106226] Updated weights for policy 0, policy_version 393061 (0.0007) [2023-12-27 22:03:22,947][106225] Updated weights for policy 1, policy_version 394067 (0.0011) [2023-12-27 22:03:22,996][106225] Updated weights for policy 1, policy_version 394077 (0.0010) [2023-12-27 22:03:23,043][106225] Updated weights for policy 1, policy_version 394087 (0.0010) [2023-12-27 22:03:23,088][106226] Updated weights for policy 0, policy_version 393071 (0.0008) [2023-12-27 22:03:23,155][106226] Updated weights for policy 0, policy_version 393081 (0.0008) [2023-12-27 22:03:23,221][106226] Updated weights for policy 0, policy_version 393091 (0.0008) [2023-12-27 22:03:23,814][106226] Updated weights for policy 0, policy_version 393101 (0.0007) [2023-12-27 22:03:23,816][106225] Updated weights for policy 1, policy_version 394097 (0.0010) [2023-12-27 22:03:23,865][106226] Updated weights for policy 0, policy_version 393111 (0.0006) [2023-12-27 22:03:23,870][106225] Updated weights for policy 1, policy_version 394107 (0.0010) [2023-12-27 22:03:23,920][106225] Updated weights for policy 1, policy_version 394117 (0.0010) [2023-12-27 22:03:23,922][106226] Updated weights for policy 0, policy_version 393121 (0.0006) [2023-12-27 22:03:23,970][106225] Updated weights for policy 1, policy_version 394127 (0.0010) [2023-12-27 22:03:24,614][106226] Updated weights for policy 0, policy_version 393131 (0.0007) [2023-12-27 22:03:24,629][106225] Updated weights for policy 1, policy_version 394137 (0.0010) [2023-12-27 22:03:24,670][106226] Updated weights for policy 0, policy_version 393141 (0.0007) [2023-12-27 22:03:24,686][106225] Updated weights for policy 1, policy_version 394147 (0.0010) [2023-12-27 22:03:24,721][106226] Updated weights for policy 0, policy_version 393151 (0.0008) [2023-12-27 22:03:24,746][106225] Updated weights for policy 1, policy_version 394157 (0.0010) [2023-12-27 22:03:25,303][106225] Updated weights for policy 1, policy_version 394167 (0.0010) [2023-12-27 22:03:25,350][106225] Updated weights for policy 1, policy_version 394177 (0.0010) [2023-12-27 22:03:25,397][106225] Updated weights for policy 1, policy_version 394187 (0.0010) [2023-12-27 22:03:25,418][106226] Updated weights for policy 0, policy_version 393161 (0.0006) [2023-12-27 22:03:25,467][106226] Updated weights for policy 0, policy_version 393171 (0.0007) [2023-12-27 22:03:25,517][106226] Updated weights for policy 0, policy_version 393181 (0.0008) [2023-12-27 22:03:25,567][106226] Updated weights for policy 0, policy_version 393191 (0.0008) [2023-12-27 22:03:26,041][106225] Updated weights for policy 1, policy_version 394197 (0.0008) [2023-12-27 22:03:26,106][106225] Updated weights for policy 1, policy_version 394207 (0.0008) [2023-12-27 22:03:26,166][106225] Updated weights for policy 1, policy_version 394217 (0.0010) [2023-12-27 22:03:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19244.2). Total num frames: 201629696. Throughput: 0: 9600.2, 1: 9749.3. Samples: 201602908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:26,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.600')] [2023-12-27 22:03:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000393192_100687872.pth... [2023-12-27 22:03:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000392072_100401152.pth [2023-12-27 22:03:26,204][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000394224_100950016.pth... [2023-12-27 22:03:26,208][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000393072_100655104.pth [2023-12-27 22:03:26,290][106226] Updated weights for policy 0, policy_version 393201 (0.0007) [2023-12-27 22:03:26,353][106226] Updated weights for policy 0, policy_version 393211 (0.0006) [2023-12-27 22:03:26,419][106226] Updated weights for policy 0, policy_version 393221 (0.0006) [2023-12-27 22:03:26,791][106225] Updated weights for policy 1, policy_version 394227 (0.0009) [2023-12-27 22:03:26,841][106225] Updated weights for policy 1, policy_version 394237 (0.0005) [2023-12-27 22:03:26,896][106225] Updated weights for policy 1, policy_version 394247 (0.0005) [2023-12-27 22:03:27,035][106226] Updated weights for policy 0, policy_version 393231 (0.0009) [2023-12-27 22:03:27,101][106226] Updated weights for policy 0, policy_version 393241 (0.0009) [2023-12-27 22:03:27,163][106226] Updated weights for policy 0, policy_version 393251 (0.0009) [2023-12-27 22:03:27,429][106225] Updated weights for policy 1, policy_version 394257 (0.0006) [2023-12-27 22:03:27,473][106225] Updated weights for policy 1, policy_version 394267 (0.0009) [2023-12-27 22:03:27,527][106225] Updated weights for policy 1, policy_version 394277 (0.0005) [2023-12-27 22:03:27,591][106225] Updated weights for policy 1, policy_version 394287 (0.0005) [2023-12-27 22:03:27,943][106226] Updated weights for policy 0, policy_version 393261 (0.0008) [2023-12-27 22:03:27,994][106226] Updated weights for policy 0, policy_version 393271 (0.0008) [2023-12-27 22:03:28,043][106226] Updated weights for policy 0, policy_version 393281 (0.0008) [2023-12-27 22:03:28,274][106225] Updated weights for policy 1, policy_version 394297 (0.0010) [2023-12-27 22:03:28,330][106225] Updated weights for policy 1, policy_version 394307 (0.0010) [2023-12-27 22:03:28,395][106225] Updated weights for policy 1, policy_version 394317 (0.0009) [2023-12-27 22:03:28,832][106226] Updated weights for policy 0, policy_version 393291 (0.0007) [2023-12-27 22:03:28,888][106226] Updated weights for policy 0, policy_version 393301 (0.0008) [2023-12-27 22:03:28,955][106226] Updated weights for policy 0, policy_version 393311 (0.0010) [2023-12-27 22:03:29,097][106225] Updated weights for policy 1, policy_version 394327 (0.0010) [2023-12-27 22:03:29,156][106225] Updated weights for policy 1, policy_version 394337 (0.0010) [2023-12-27 22:03:29,212][106225] Updated weights for policy 1, policy_version 394347 (0.0010) [2023-12-27 22:03:29,746][106226] Updated weights for policy 0, policy_version 393321 (0.0007) [2023-12-27 22:03:29,803][106226] Updated weights for policy 0, policy_version 393331 (0.0008) [2023-12-27 22:03:29,870][106226] Updated weights for policy 0, policy_version 393341 (0.0009) [2023-12-27 22:03:29,934][106226] Updated weights for policy 0, policy_version 393351 (0.0009) [2023-12-27 22:03:29,945][106225] Updated weights for policy 1, policy_version 394357 (0.0008) [2023-12-27 22:03:30,003][106225] Updated weights for policy 1, policy_version 394367 (0.0009) [2023-12-27 22:03:30,054][106225] Updated weights for policy 1, policy_version 394377 (0.0010) [2023-12-27 22:03:30,642][106226] Updated weights for policy 0, policy_version 393361 (0.0008) [2023-12-27 22:03:30,710][106226] Updated weights for policy 0, policy_version 393371 (0.0006) [2023-12-27 22:03:30,749][106225] Updated weights for policy 1, policy_version 394387 (0.0009) [2023-12-27 22:03:30,767][106226] Updated weights for policy 0, policy_version 393381 (0.0005) [2023-12-27 22:03:30,802][106225] Updated weights for policy 1, policy_version 394397 (0.0005) [2023-12-27 22:03:30,860][106225] Updated weights for policy 1, policy_version 394407 (0.0005) [2023-12-27 22:03:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19387.7, 300 sec: 19272.0). Total num frames: 201736192. Throughput: 0: 9666.2, 1: 9895.5. Samples: 201725100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:31,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-5.608')] [2023-12-27 22:03:31,391][106226] Updated weights for policy 0, policy_version 393391 (0.0007) [2023-12-27 22:03:31,454][106226] Updated weights for policy 0, policy_version 393401 (0.0008) [2023-12-27 22:03:31,519][106226] Updated weights for policy 0, policy_version 393411 (0.0008) [2023-12-27 22:03:31,568][106225] Updated weights for policy 1, policy_version 394417 (0.0007) [2023-12-27 22:03:31,629][106225] Updated weights for policy 1, policy_version 394427 (0.0008) [2023-12-27 22:03:31,689][106225] Updated weights for policy 1, policy_version 394437 (0.0008) [2023-12-27 22:03:31,758][106225] Updated weights for policy 1, policy_version 394447 (0.0008) [2023-12-27 22:03:32,261][106226] Updated weights for policy 0, policy_version 393421 (0.0008) [2023-12-27 22:03:32,328][106226] Updated weights for policy 0, policy_version 393431 (0.0006) [2023-12-27 22:03:32,390][106225] Updated weights for policy 1, policy_version 394457 (0.0007) [2023-12-27 22:03:32,397][106226] Updated weights for policy 0, policy_version 393441 (0.0008) [2023-12-27 22:03:32,452][106225] Updated weights for policy 1, policy_version 394467 (0.0006) [2023-12-27 22:03:32,517][106225] Updated weights for policy 1, policy_version 394477 (0.0008) [2023-12-27 22:03:33,003][106226] Updated weights for policy 0, policy_version 393451 (0.0009) [2023-12-27 22:03:33,058][106226] Updated weights for policy 0, policy_version 393461 (0.0008) [2023-12-27 22:03:33,115][106226] Updated weights for policy 0, policy_version 393471 (0.0008) [2023-12-27 22:03:33,202][106225] Updated weights for policy 1, policy_version 394487 (0.0006) [2023-12-27 22:03:33,262][106225] Updated weights for policy 1, policy_version 394497 (0.0005) [2023-12-27 22:03:33,311][106225] Updated weights for policy 1, policy_version 394507 (0.0005) [2023-12-27 22:03:33,769][106226] Updated weights for policy 0, policy_version 393481 (0.0006) [2023-12-27 22:03:33,817][106226] Updated weights for policy 0, policy_version 393491 (0.0008) [2023-12-27 22:03:33,871][106226] Updated weights for policy 0, policy_version 393501 (0.0009) [2023-12-27 22:03:33,899][106225] Updated weights for policy 1, policy_version 394517 (0.0006) [2023-12-27 22:03:33,931][106226] Updated weights for policy 0, policy_version 393511 (0.0008) [2023-12-27 22:03:33,955][106225] Updated weights for policy 1, policy_version 394527 (0.0005) [2023-12-27 22:03:34,008][106225] Updated weights for policy 1, policy_version 394537 (0.0005) [2023-12-27 22:03:34,691][106226] Updated weights for policy 0, policy_version 393521 (0.0008) [2023-12-27 22:03:34,718][106225] Updated weights for policy 1, policy_version 394547 (0.0006) [2023-12-27 22:03:34,738][106226] Updated weights for policy 0, policy_version 393531 (0.0007) [2023-12-27 22:03:34,778][106225] Updated weights for policy 1, policy_version 394557 (0.0008) [2023-12-27 22:03:34,799][106226] Updated weights for policy 0, policy_version 393541 (0.0009) [2023-12-27 22:03:34,834][106225] Updated weights for policy 1, policy_version 394567 (0.0007) [2023-12-27 22:03:35,516][106226] Updated weights for policy 0, policy_version 393551 (0.0010) [2023-12-27 22:03:35,533][106225] Updated weights for policy 1, policy_version 394577 (0.0008) [2023-12-27 22:03:35,579][106226] Updated weights for policy 0, policy_version 393561 (0.0011) [2023-12-27 22:03:35,592][106225] Updated weights for policy 1, policy_version 394587 (0.0007) [2023-12-27 22:03:35,636][106226] Updated weights for policy 0, policy_version 393571 (0.0010) [2023-12-27 22:03:35,643][106225] Updated weights for policy 1, policy_version 394597 (0.0006) [2023-12-27 22:03:35,702][106225] Updated weights for policy 1, policy_version 394607 (0.0008) [2023-12-27 22:03:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19524.3, 300 sec: 19272.0). Total num frames: 201834496. Throughput: 0: 9716.7, 1: 9973.4. Samples: 201845568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:36,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.814')] [2023-12-27 22:03:36,357][106226] Updated weights for policy 0, policy_version 393581 (0.0011) [2023-12-27 22:03:36,427][106226] Updated weights for policy 0, policy_version 393591 (0.0008) [2023-12-27 22:03:36,497][106226] Updated weights for policy 0, policy_version 393601 (0.0010) [2023-12-27 22:03:36,502][106225] Updated weights for policy 1, policy_version 394617 (0.0007) [2023-12-27 22:03:36,570][106225] Updated weights for policy 1, policy_version 394627 (0.0007) [2023-12-27 22:03:36,635][106225] Updated weights for policy 1, policy_version 394637 (0.0008) [2023-12-27 22:03:37,097][106226] Updated weights for policy 0, policy_version 393611 (0.0008) [2023-12-27 22:03:37,158][106226] Updated weights for policy 0, policy_version 393621 (0.0009) [2023-12-27 22:03:37,212][106226] Updated weights for policy 0, policy_version 393631 (0.0007) [2023-12-27 22:03:37,230][106225] Updated weights for policy 1, policy_version 394647 (0.0006) [2023-12-27 22:03:37,283][106225] Updated weights for policy 1, policy_version 394657 (0.0008) [2023-12-27 22:03:37,331][106225] Updated weights for policy 1, policy_version 394667 (0.0007) [2023-12-27 22:03:37,787][106226] Updated weights for policy 0, policy_version 393641 (0.0008) [2023-12-27 22:03:37,842][106226] Updated weights for policy 0, policy_version 393651 (0.0005) [2023-12-27 22:03:37,893][106226] Updated weights for policy 0, policy_version 393661 (0.0005) [2023-12-27 22:03:37,944][106226] Updated weights for policy 0, policy_version 393671 (0.0005) [2023-12-27 22:03:38,161][106225] Updated weights for policy 1, policy_version 394677 (0.0006) [2023-12-27 22:03:38,229][106225] Updated weights for policy 1, policy_version 394687 (0.0005) [2023-12-27 22:03:38,298][106225] Updated weights for policy 1, policy_version 394697 (0.0005) [2023-12-27 22:03:38,519][106226] Updated weights for policy 0, policy_version 393681 (0.0007) [2023-12-27 22:03:38,582][106226] Updated weights for policy 0, policy_version 393691 (0.0009) [2023-12-27 22:03:38,648][106226] Updated weights for policy 0, policy_version 393701 (0.0007) [2023-12-27 22:03:39,002][106225] Updated weights for policy 1, policy_version 394707 (0.0008) [2023-12-27 22:03:39,067][106225] Updated weights for policy 1, policy_version 394717 (0.0010) [2023-12-27 22:03:39,140][106225] Updated weights for policy 1, policy_version 394727 (0.0010) [2023-12-27 22:03:39,254][106226] Updated weights for policy 0, policy_version 393711 (0.0007) [2023-12-27 22:03:39,318][106226] Updated weights for policy 0, policy_version 393721 (0.0009) [2023-12-27 22:03:39,403][106226] Updated weights for policy 0, policy_version 393731 (0.0008) [2023-12-27 22:03:40,019][106225] Updated weights for policy 1, policy_version 394737 (0.0010) [2023-12-27 22:03:40,067][106225] Updated weights for policy 1, policy_version 394747 (0.0009) [2023-12-27 22:03:40,115][106226] Updated weights for policy 0, policy_version 393741 (0.0007) [2023-12-27 22:03:40,125][106225] Updated weights for policy 1, policy_version 394757 (0.0009) [2023-12-27 22:03:40,183][106226] Updated weights for policy 0, policy_version 393751 (0.0008) [2023-12-27 22:03:40,193][106225] Updated weights for policy 1, policy_version 394767 (0.0008) [2023-12-27 22:03:40,246][106226] Updated weights for policy 0, policy_version 393761 (0.0008) [2023-12-27 22:03:40,881][106226] Updated weights for policy 0, policy_version 393771 (0.0008) [2023-12-27 22:03:40,941][106226] Updated weights for policy 0, policy_version 393781 (0.0009) [2023-12-27 22:03:40,995][106225] Updated weights for policy 1, policy_version 394777 (0.0007) [2023-12-27 22:03:41,002][106226] Updated weights for policy 0, policy_version 393791 (0.0006) [2023-12-27 22:03:41,061][106225] Updated weights for policy 1, policy_version 394787 (0.0007) [2023-12-27 22:03:41,114][106225] Updated weights for policy 1, policy_version 394797 (0.0009) [2023-12-27 22:03:41,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19327.6). Total num frames: 201940992. Throughput: 0: 9850.5, 1: 9925.7. Samples: 201908076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:41,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-5.793')] [2023-12-27 22:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000394800_101097472.pth... [2023-12-27 22:03:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000393800_100843520.pth... [2023-12-27 22:03:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000392616_100540416.pth [2023-12-27 22:03:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000393648_100802560.pth [2023-12-27 22:03:41,827][106226] Updated weights for policy 0, policy_version 393801 (0.0007) [2023-12-27 22:03:41,886][106226] Updated weights for policy 0, policy_version 393811 (0.0011) [2023-12-27 22:03:41,948][106226] Updated weights for policy 0, policy_version 393821 (0.0011) [2023-12-27 22:03:41,963][106225] Updated weights for policy 1, policy_version 394807 (0.0008) [2023-12-27 22:03:42,016][106226] Updated weights for policy 0, policy_version 393831 (0.0008) [2023-12-27 22:03:42,025][106225] Updated weights for policy 1, policy_version 394817 (0.0007) [2023-12-27 22:03:42,089][106225] Updated weights for policy 1, policy_version 394827 (0.0008) [2023-12-27 22:03:42,823][106226] Updated weights for policy 0, policy_version 393841 (0.0009) [2023-12-27 22:03:42,841][106225] Updated weights for policy 1, policy_version 394837 (0.0007) [2023-12-27 22:03:42,881][106226] Updated weights for policy 0, policy_version 393851 (0.0006) [2023-12-27 22:03:42,887][106225] Updated weights for policy 1, policy_version 394847 (0.0008) [2023-12-27 22:03:42,936][106226] Updated weights for policy 0, policy_version 393861 (0.0006) [2023-12-27 22:03:42,938][106225] Updated weights for policy 1, policy_version 394857 (0.0006) [2023-12-27 22:03:43,639][106226] Updated weights for policy 0, policy_version 393871 (0.0007) [2023-12-27 22:03:43,650][106225] Updated weights for policy 1, policy_version 394867 (0.0008) [2023-12-27 22:03:43,687][106226] Updated weights for policy 0, policy_version 393881 (0.0006) [2023-12-27 22:03:43,706][106225] Updated weights for policy 1, policy_version 394877 (0.0005) [2023-12-27 22:03:43,742][106226] Updated weights for policy 0, policy_version 393891 (0.0006) [2023-12-27 22:03:43,757][106225] Updated weights for policy 1, policy_version 394887 (0.0007) [2023-12-27 22:03:44,381][106226] Updated weights for policy 0, policy_version 393901 (0.0007) [2023-12-27 22:03:44,441][106226] Updated weights for policy 0, policy_version 393911 (0.0009) [2023-12-27 22:03:44,468][106225] Updated weights for policy 1, policy_version 394897 (0.0008) [2023-12-27 22:03:44,506][106226] Updated weights for policy 0, policy_version 393921 (0.0008) [2023-12-27 22:03:44,523][106225] Updated weights for policy 1, policy_version 394907 (0.0007) [2023-12-27 22:03:44,572][106225] Updated weights for policy 1, policy_version 394917 (0.0006) [2023-12-27 22:03:44,626][106225] Updated weights for policy 1, policy_version 394927 (0.0006) [2023-12-27 22:03:45,261][106226] Updated weights for policy 0, policy_version 393931 (0.0007) [2023-12-27 22:03:45,287][106225] Updated weights for policy 1, policy_version 394937 (0.0009) [2023-12-27 22:03:45,326][106226] Updated weights for policy 0, policy_version 393941 (0.0007) [2023-12-27 22:03:45,348][106225] Updated weights for policy 1, policy_version 394947 (0.0007) [2023-12-27 22:03:45,383][106226] Updated weights for policy 0, policy_version 393951 (0.0006) [2023-12-27 22:03:45,400][106225] Updated weights for policy 1, policy_version 394957 (0.0006) [2023-12-27 22:03:46,026][106226] Updated weights for policy 0, policy_version 393961 (0.0007) [2023-12-27 22:03:46,080][106226] Updated weights for policy 0, policy_version 393971 (0.0006) [2023-12-27 22:03:46,112][106225] Updated weights for policy 1, policy_version 394967 (0.0006) [2023-12-27 22:03:46,132][106226] Updated weights for policy 0, policy_version 393981 (0.0007) [2023-12-27 22:03:46,168][106225] Updated weights for policy 1, policy_version 394977 (0.0005) [2023-12-27 22:03:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19272.0). Total num frames: 202022912. Throughput: 0: 9868.0, 1: 9826.2. Samples: 202019852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:46,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.707')] [2023-12-27 22:03:46,187][106226] Updated weights for policy 0, policy_version 393991 (0.0007) [2023-12-27 22:03:46,229][106225] Updated weights for policy 1, policy_version 394987 (0.0005) [2023-12-27 22:03:46,817][106226] Updated weights for policy 0, policy_version 394001 (0.0006) [2023-12-27 22:03:46,873][106226] Updated weights for policy 0, policy_version 394011 (0.0005) [2023-12-27 22:03:46,932][106226] Updated weights for policy 0, policy_version 394021 (0.0005) [2023-12-27 22:03:46,939][106225] Updated weights for policy 1, policy_version 394997 (0.0008) [2023-12-27 22:03:46,997][106225] Updated weights for policy 1, policy_version 395007 (0.0009) [2023-12-27 22:03:47,055][106225] Updated weights for policy 1, policy_version 395017 (0.0009) [2023-12-27 22:03:47,566][106226] Updated weights for policy 0, policy_version 394031 (0.0007) [2023-12-27 22:03:47,624][106226] Updated weights for policy 0, policy_version 394041 (0.0009) [2023-12-27 22:03:47,678][106226] Updated weights for policy 0, policy_version 394051 (0.0006) [2023-12-27 22:03:47,689][106225] Updated weights for policy 1, policy_version 395027 (0.0008) [2023-12-27 22:03:47,753][106225] Updated weights for policy 1, policy_version 395037 (0.0010) [2023-12-27 22:03:47,813][106225] Updated weights for policy 1, policy_version 395047 (0.0009) [2023-12-27 22:03:48,325][106226] Updated weights for policy 0, policy_version 394061 (0.0007) [2023-12-27 22:03:48,395][106226] Updated weights for policy 0, policy_version 394071 (0.0008) [2023-12-27 22:03:48,458][106226] Updated weights for policy 0, policy_version 394081 (0.0009) [2023-12-27 22:03:48,575][106225] Updated weights for policy 1, policy_version 395057 (0.0009) [2023-12-27 22:03:48,633][106225] Updated weights for policy 1, policy_version 395067 (0.0009) [2023-12-27 22:03:48,697][106225] Updated weights for policy 1, policy_version 395077 (0.0009) [2023-12-27 22:03:48,757][106225] Updated weights for policy 1, policy_version 395087 (0.0008) [2023-12-27 22:03:49,165][106226] Updated weights for policy 0, policy_version 394091 (0.0009) [2023-12-27 22:03:49,231][106226] Updated weights for policy 0, policy_version 394101 (0.0009) [2023-12-27 22:03:49,293][106226] Updated weights for policy 0, policy_version 394111 (0.0008) [2023-12-27 22:03:49,517][106225] Updated weights for policy 1, policy_version 395097 (0.0008) [2023-12-27 22:03:49,581][106225] Updated weights for policy 1, policy_version 395107 (0.0009) [2023-12-27 22:03:49,639][106225] Updated weights for policy 1, policy_version 395117 (0.0009) [2023-12-27 22:03:50,050][106226] Updated weights for policy 0, policy_version 394121 (0.0009) [2023-12-27 22:03:50,101][106226] Updated weights for policy 0, policy_version 394131 (0.0009) [2023-12-27 22:03:50,154][106226] Updated weights for policy 0, policy_version 394141 (0.0009) [2023-12-27 22:03:50,224][106226] Updated weights for policy 0, policy_version 394151 (0.0008) [2023-12-27 22:03:50,388][106225] Updated weights for policy 1, policy_version 395127 (0.0010) [2023-12-27 22:03:50,455][106225] Updated weights for policy 1, policy_version 395137 (0.0009) [2023-12-27 22:03:50,527][106225] Updated weights for policy 1, policy_version 395147 (0.0009) [2023-12-27 22:03:50,974][106226] Updated weights for policy 0, policy_version 394161 (0.0009) [2023-12-27 22:03:51,041][106226] Updated weights for policy 0, policy_version 394171 (0.0008) [2023-12-27 22:03:51,101][106226] Updated weights for policy 0, policy_version 394181 (0.0008) [2023-12-27 22:03:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19299.8). Total num frames: 202129408. Throughput: 0: 9929.8, 1: 9814.8. Samples: 202137308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:51,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-5.626')] [2023-12-27 22:03:51,284][106225] Updated weights for policy 1, policy_version 395157 (0.0007) [2023-12-27 22:03:51,345][106225] Updated weights for policy 1, policy_version 395167 (0.0007) [2023-12-27 22:03:51,420][106225] Updated weights for policy 1, policy_version 395177 (0.0008) [2023-12-27 22:03:51,885][106226] Updated weights for policy 0, policy_version 394191 (0.0009) [2023-12-27 22:03:51,951][106226] Updated weights for policy 0, policy_version 394201 (0.0009) [2023-12-27 22:03:52,011][106226] Updated weights for policy 0, policy_version 394211 (0.0011) [2023-12-27 22:03:52,108][106225] Updated weights for policy 1, policy_version 395187 (0.0008) [2023-12-27 22:03:52,167][106225] Updated weights for policy 1, policy_version 395197 (0.0006) [2023-12-27 22:03:52,225][106225] Updated weights for policy 1, policy_version 395207 (0.0006) [2023-12-27 22:03:52,744][106226] Updated weights for policy 0, policy_version 394221 (0.0011) [2023-12-27 22:03:52,794][106226] Updated weights for policy 0, policy_version 394231 (0.0011) [2023-12-27 22:03:52,848][106225] Updated weights for policy 1, policy_version 395217 (0.0007) [2023-12-27 22:03:52,852][106226] Updated weights for policy 0, policy_version 394241 (0.0011) [2023-12-27 22:03:52,905][106225] Updated weights for policy 1, policy_version 395227 (0.0010) [2023-12-27 22:03:52,956][106225] Updated weights for policy 1, policy_version 395237 (0.0010) [2023-12-27 22:03:53,011][106225] Updated weights for policy 1, policy_version 395247 (0.0010) [2023-12-27 22:03:53,577][106226] Updated weights for policy 0, policy_version 394251 (0.0011) [2023-12-27 22:03:53,623][106226] Updated weights for policy 0, policy_version 394261 (0.0010) [2023-12-27 22:03:53,670][106226] Updated weights for policy 0, policy_version 394271 (0.0010) [2023-12-27 22:03:53,742][106225] Updated weights for policy 1, policy_version 395257 (0.0007) [2023-12-27 22:03:53,799][106225] Updated weights for policy 1, policy_version 395267 (0.0008) [2023-12-27 22:03:53,863][106225] Updated weights for policy 1, policy_version 395277 (0.0007) [2023-12-27 22:03:54,447][106226] Updated weights for policy 0, policy_version 394281 (0.0010) [2023-12-27 22:03:54,495][106226] Updated weights for policy 0, policy_version 394291 (0.0005) [2023-12-27 22:03:54,549][106226] Updated weights for policy 0, policy_version 394301 (0.0006) [2023-12-27 22:03:54,602][106225] Updated weights for policy 1, policy_version 395287 (0.0009) [2023-12-27 22:03:54,612][106226] Updated weights for policy 0, policy_version 394311 (0.0006) [2023-12-27 22:03:54,656][106225] Updated weights for policy 1, policy_version 395297 (0.0010) [2023-12-27 22:03:54,716][106225] Updated weights for policy 1, policy_version 395307 (0.0010) [2023-12-27 22:03:55,261][106226] Updated weights for policy 0, policy_version 394321 (0.0006) [2023-12-27 22:03:55,327][106226] Updated weights for policy 0, policy_version 394331 (0.0007) [2023-12-27 22:03:55,370][106225] Updated weights for policy 1, policy_version 395317 (0.0009) [2023-12-27 22:03:55,386][106226] Updated weights for policy 0, policy_version 394341 (0.0006) [2023-12-27 22:03:55,432][106225] Updated weights for policy 1, policy_version 395327 (0.0007) [2023-12-27 22:03:55,496][106225] Updated weights for policy 1, policy_version 395337 (0.0008) [2023-12-27 22:03:55,988][106226] Updated weights for policy 0, policy_version 394351 (0.0007) [2023-12-27 22:03:56,046][106225] Updated weights for policy 1, policy_version 395347 (0.0007) [2023-12-27 22:03:56,048][106226] Updated weights for policy 0, policy_version 394361 (0.0006) [2023-12-27 22:03:56,095][106226] Updated weights for policy 0, policy_version 394371 (0.0006) [2023-12-27 22:03:56,111][106225] Updated weights for policy 1, policy_version 395357 (0.0008) [2023-12-27 22:03:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.8, 300 sec: 19299.8). Total num frames: 202227712. Throughput: 0: 9929.4, 1: 9791.7. Samples: 202194896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:03:56,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-5.825')] [2023-12-27 22:03:56,181][106225] Updated weights for policy 1, policy_version 395367 (0.0009) [2023-12-27 22:03:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000394376_100990976.pth... [2023-12-27 22:03:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000393192_100687872.pth [2023-12-27 22:03:56,233][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000395376_101244928.pth... [2023-12-27 22:03:56,237][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000394224_100950016.pth [2023-12-27 22:03:56,652][106226] Updated weights for policy 0, policy_version 394381 (0.0007) [2023-12-27 22:03:56,716][106226] Updated weights for policy 0, policy_version 394391 (0.0009) [2023-12-27 22:03:56,774][106226] Updated weights for policy 0, policy_version 394401 (0.0010) [2023-12-27 22:03:56,801][106225] Updated weights for policy 1, policy_version 395377 (0.0007) [2023-12-27 22:03:56,860][106225] Updated weights for policy 1, policy_version 395387 (0.0010) [2023-12-27 22:03:56,915][106225] Updated weights for policy 1, policy_version 395397 (0.0010) [2023-12-27 22:03:56,968][106225] Updated weights for policy 1, policy_version 395407 (0.0010) [2023-12-27 22:03:57,403][106226] Updated weights for policy 0, policy_version 394411 (0.0009) [2023-12-27 22:03:57,469][106226] Updated weights for policy 0, policy_version 394421 (0.0005) [2023-12-27 22:03:57,527][106226] Updated weights for policy 0, policy_version 394431 (0.0005) [2023-12-27 22:03:57,657][106225] Updated weights for policy 1, policy_version 395417 (0.0010) [2023-12-27 22:03:57,709][106225] Updated weights for policy 1, policy_version 395427 (0.0010) [2023-12-27 22:03:57,762][106225] Updated weights for policy 1, policy_version 395437 (0.0010) [2023-12-27 22:03:58,150][106226] Updated weights for policy 0, policy_version 394441 (0.0006) [2023-12-27 22:03:58,216][106226] Updated weights for policy 0, policy_version 394451 (0.0010) [2023-12-27 22:03:58,270][106226] Updated weights for policy 0, policy_version 394461 (0.0008) [2023-12-27 22:03:58,346][106226] Updated weights for policy 0, policy_version 394471 (0.0009) [2023-12-27 22:03:58,416][106225] Updated weights for policy 1, policy_version 395447 (0.0010) [2023-12-27 22:03:58,484][106225] Updated weights for policy 1, policy_version 395457 (0.0009) [2023-12-27 22:03:58,553][106225] Updated weights for policy 1, policy_version 395467 (0.0009) [2023-12-27 22:03:59,171][106226] Updated weights for policy 0, policy_version 394481 (0.0009) [2023-12-27 22:03:59,245][106226] Updated weights for policy 0, policy_version 394492 (0.0009) [2023-12-27 22:03:59,313][106226] Updated weights for policy 0, policy_version 394502 (0.0010) [2023-12-27 22:03:59,341][106225] Updated weights for policy 1, policy_version 395477 (0.0009) [2023-12-27 22:03:59,403][106225] Updated weights for policy 1, policy_version 395487 (0.0008) [2023-12-27 22:03:59,458][106225] Updated weights for policy 1, policy_version 395497 (0.0005) [2023-12-27 22:04:00,105][106226] Updated weights for policy 0, policy_version 394512 (0.0009) [2023-12-27 22:04:00,150][106225] Updated weights for policy 1, policy_version 395507 (0.0006) [2023-12-27 22:04:00,172][106226] Updated weights for policy 0, policy_version 394522 (0.0007) [2023-12-27 22:04:00,205][106225] Updated weights for policy 1, policy_version 395517 (0.0007) [2023-12-27 22:04:00,249][106226] Updated weights for policy 0, policy_version 394532 (0.0009) [2023-12-27 22:04:00,263][106225] Updated weights for policy 1, policy_version 395527 (0.0006) [2023-12-27 22:04:00,913][106225] Updated weights for policy 1, policy_version 395537 (0.0009) [2023-12-27 22:04:00,976][106225] Updated weights for policy 1, policy_version 395547 (0.0008) [2023-12-27 22:04:00,997][106226] Updated weights for policy 0, policy_version 394542 (0.0009) [2023-12-27 22:04:01,038][106225] Updated weights for policy 1, policy_version 395557 (0.0008) [2023-12-27 22:04:01,073][106226] Updated weights for policy 0, policy_version 394552 (0.0010) [2023-12-27 22:04:01,115][106225] Updated weights for policy 1, policy_version 395567 (0.0008) [2023-12-27 22:04:01,134][106226] Updated weights for policy 0, policy_version 394562 (0.0007) [2023-12-27 22:04:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19244.3). Total num frames: 202326016. Throughput: 0: 9969.2, 1: 9826.0. Samples: 202316476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:04:01,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-5.755')] [2023-12-27 22:04:01,900][106225] Updated weights for policy 1, policy_version 395577 (0.0008) [2023-12-27 22:04:01,934][106226] Updated weights for policy 0, policy_version 394572 (0.0009) [2023-12-27 22:04:01,960][106225] Updated weights for policy 1, policy_version 395587 (0.0006) [2023-12-27 22:04:01,992][106226] Updated weights for policy 0, policy_version 394582 (0.0009) [2023-12-27 22:04:02,024][106225] Updated weights for policy 1, policy_version 395597 (0.0006) [2023-12-27 22:04:02,054][106226] Updated weights for policy 0, policy_version 394592 (0.0008) [2023-12-27 22:04:02,721][106226] Updated weights for policy 0, policy_version 394602 (0.0009) [2023-12-27 22:04:02,737][106225] Updated weights for policy 1, policy_version 395607 (0.0008) [2023-12-27 22:04:02,779][106226] Updated weights for policy 0, policy_version 394612 (0.0007) [2023-12-27 22:04:02,793][106225] Updated weights for policy 1, policy_version 395617 (0.0007) [2023-12-27 22:04:02,834][106226] Updated weights for policy 0, policy_version 394622 (0.0005) [2023-12-27 22:04:02,851][106225] Updated weights for policy 1, policy_version 395627 (0.0007) [2023-12-27 22:04:02,888][106226] Updated weights for policy 0, policy_version 394632 (0.0008) [2023-12-27 22:04:03,528][106225] Updated weights for policy 1, policy_version 395637 (0.0006) [2023-12-27 22:04:03,572][106225] Updated weights for policy 1, policy_version 395647 (0.0005) [2023-12-27 22:04:03,607][106226] Updated weights for policy 0, policy_version 394642 (0.0008) [2023-12-27 22:04:03,631][106225] Updated weights for policy 1, policy_version 395657 (0.0010) [2023-12-27 22:04:03,665][106226] Updated weights for policy 0, policy_version 394652 (0.0010) [2023-12-27 22:04:03,725][106226] Updated weights for policy 0, policy_version 394662 (0.0008) [2023-12-27 22:04:04,287][106225] Updated weights for policy 1, policy_version 395667 (0.0010) [2023-12-27 22:04:04,346][106225] Updated weights for policy 1, policy_version 395677 (0.0011) [2023-12-27 22:04:04,354][106226] Updated weights for policy 0, policy_version 394672 (0.0010) [2023-12-27 22:04:04,401][106225] Updated weights for policy 1, policy_version 395687 (0.0011) [2023-12-27 22:04:04,418][106226] Updated weights for policy 0, policy_version 394682 (0.0011) [2023-12-27 22:04:04,480][106226] Updated weights for policy 0, policy_version 394692 (0.0011) [2023-12-27 22:04:05,103][106225] Updated weights for policy 1, policy_version 395697 (0.0010) [2023-12-27 22:04:05,160][106225] Updated weights for policy 1, policy_version 395707 (0.0010) [2023-12-27 22:04:05,165][106226] Updated weights for policy 0, policy_version 394702 (0.0010) [2023-12-27 22:04:05,217][106225] Updated weights for policy 1, policy_version 395717 (0.0009) [2023-12-27 22:04:05,229][106226] Updated weights for policy 0, policy_version 394712 (0.0011) [2023-12-27 22:04:05,271][106225] Updated weights for policy 1, policy_version 395727 (0.0005) [2023-12-27 22:04:05,289][106226] Updated weights for policy 0, policy_version 394722 (0.0011) [2023-12-27 22:04:05,919][106225] Updated weights for policy 1, policy_version 395737 (0.0010) [2023-12-27 22:04:05,980][106225] Updated weights for policy 1, policy_version 395747 (0.0011) [2023-12-27 22:04:05,985][106226] Updated weights for policy 0, policy_version 394732 (0.0010) [2023-12-27 22:04:06,037][106225] Updated weights for policy 1, policy_version 395757 (0.0010) [2023-12-27 22:04:06,038][106226] Updated weights for policy 0, policy_version 394742 (0.0010) [2023-12-27 22:04:06,093][106226] Updated weights for policy 0, policy_version 394752 (0.0010) [2023-12-27 22:04:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19299.8). Total num frames: 202432512. Throughput: 0: 9910.6, 1: 9870.6. Samples: 202434232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:04:06,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.748')] [2023-12-27 22:04:06,853][106226] Updated weights for policy 0, policy_version 394762 (0.0008) [2023-12-27 22:04:06,855][106225] Updated weights for policy 1, policy_version 395767 (0.0010) [2023-12-27 22:04:06,909][106226] Updated weights for policy 0, policy_version 394772 (0.0011) [2023-12-27 22:04:06,913][106225] Updated weights for policy 1, policy_version 395777 (0.0010) [2023-12-27 22:04:06,971][106226] Updated weights for policy 0, policy_version 394782 (0.0008) [2023-12-27 22:04:06,974][106225] Updated weights for policy 1, policy_version 395787 (0.0010) [2023-12-27 22:04:07,035][106226] Updated weights for policy 0, policy_version 394792 (0.0011) [2023-12-27 22:04:07,688][106225] Updated weights for policy 1, policy_version 395797 (0.0010) [2023-12-27 22:04:07,716][106226] Updated weights for policy 0, policy_version 394802 (0.0008) [2023-12-27 22:04:07,745][106225] Updated weights for policy 1, policy_version 395807 (0.0008) [2023-12-27 22:04:07,784][106226] Updated weights for policy 0, policy_version 394812 (0.0008) [2023-12-27 22:04:07,802][106225] Updated weights for policy 1, policy_version 395817 (0.0010) [2023-12-27 22:04:07,849][106226] Updated weights for policy 0, policy_version 394822 (0.0008) [2023-12-27 22:04:08,439][106225] Updated weights for policy 1, policy_version 395827 (0.0011) [2023-12-27 22:04:08,496][106225] Updated weights for policy 1, policy_version 395837 (0.0010) [2023-12-27 22:04:08,564][106225] Updated weights for policy 1, policy_version 395847 (0.0010) [2023-12-27 22:04:08,628][106226] Updated weights for policy 0, policy_version 394832 (0.0006) [2023-12-27 22:04:08,691][106226] Updated weights for policy 0, policy_version 394842 (0.0008) [2023-12-27 22:04:08,751][106226] Updated weights for policy 0, policy_version 394852 (0.0008) [2023-12-27 22:04:09,219][106225] Updated weights for policy 1, policy_version 395857 (0.0010) [2023-12-27 22:04:09,281][106225] Updated weights for policy 1, policy_version 395867 (0.0010) [2023-12-27 22:04:09,344][106225] Updated weights for policy 1, policy_version 395877 (0.0011) [2023-12-27 22:04:09,414][106225] Updated weights for policy 1, policy_version 395887 (0.0010) [2023-12-27 22:04:09,566][106226] Updated weights for policy 0, policy_version 394862 (0.0011) [2023-12-27 22:04:09,625][106226] Updated weights for policy 0, policy_version 394872 (0.0011) [2023-12-27 22:04:09,674][106226] Updated weights for policy 0, policy_version 394882 (0.0011) [2023-12-27 22:04:10,157][106225] Updated weights for policy 1, policy_version 395897 (0.0007) [2023-12-27 22:04:10,218][106225] Updated weights for policy 1, policy_version 395907 (0.0009) [2023-12-27 22:04:10,277][106225] Updated weights for policy 1, policy_version 395917 (0.0008) [2023-12-27 22:04:10,426][106226] Updated weights for policy 0, policy_version 394892 (0.0011) [2023-12-27 22:04:10,490][106226] Updated weights for policy 0, policy_version 394902 (0.0011) [2023-12-27 22:04:10,558][106226] Updated weights for policy 0, policy_version 394912 (0.0011) [2023-12-27 22:04:10,935][106225] Updated weights for policy 1, policy_version 395927 (0.0010) [2023-12-27 22:04:10,999][106225] Updated weights for policy 1, policy_version 395937 (0.0011) [2023-12-27 22:04:11,064][106225] Updated weights for policy 1, policy_version 395947 (0.0009) [2023-12-27 22:04:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19272.0). Total num frames: 202522624. Throughput: 0: 9849.0, 1: 9905.4. Samples: 202491856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:04:11,175][105115] Avg episode reward: [(0, '-4.846'), (1, '-5.700')] [2023-12-27 22:04:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000394920_101130240.pth... [2023-12-27 22:04:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000395952_101392384.pth... [2023-12-27 22:04:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000393800_100843520.pth [2023-12-27 22:04:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000394800_101097472.pth [2023-12-27 22:04:11,336][106226] Updated weights for policy 0, policy_version 394922 (0.0010) [2023-12-27 22:04:11,408][106226] Updated weights for policy 0, policy_version 394932 (0.0010) [2023-12-27 22:04:11,473][106226] Updated weights for policy 0, policy_version 394942 (0.0011) [2023-12-27 22:04:11,535][106226] Updated weights for policy 0, policy_version 394952 (0.0010) [2023-12-27 22:04:11,907][106225] Updated weights for policy 1, policy_version 395957 (0.0008) [2023-12-27 22:04:11,972][106225] Updated weights for policy 1, policy_version 395967 (0.0008) [2023-12-27 22:04:12,040][106225] Updated weights for policy 1, policy_version 395977 (0.0008) [2023-12-27 22:04:12,397][106226] Updated weights for policy 0, policy_version 394962 (0.0008) [2023-12-27 22:04:12,463][106226] Updated weights for policy 0, policy_version 394972 (0.0008) [2023-12-27 22:04:12,527][106226] Updated weights for policy 0, policy_version 394982 (0.0008) [2023-12-27 22:04:12,799][106225] Updated weights for policy 1, policy_version 395987 (0.0008) [2023-12-27 22:04:12,863][106225] Updated weights for policy 1, policy_version 395997 (0.0008) [2023-12-27 22:04:12,931][106225] Updated weights for policy 1, policy_version 396007 (0.0008) [2023-12-27 22:04:13,287][106226] Updated weights for policy 0, policy_version 394992 (0.0010) [2023-12-27 22:04:13,356][106226] Updated weights for policy 0, policy_version 395002 (0.0011) [2023-12-27 22:04:13,420][106226] Updated weights for policy 0, policy_version 395012 (0.0011) [2023-12-27 22:04:13,525][106225] Updated weights for policy 1, policy_version 396017 (0.0007) [2023-12-27 22:04:13,576][106225] Updated weights for policy 1, policy_version 396027 (0.0005) [2023-12-27 22:04:13,631][106225] Updated weights for policy 1, policy_version 396037 (0.0009) [2023-12-27 22:04:13,682][106225] Updated weights for policy 1, policy_version 396047 (0.0009) [2023-12-27 22:04:13,988][106226] Updated weights for policy 0, policy_version 395022 (0.0009) [2023-12-27 22:04:14,054][106226] Updated weights for policy 0, policy_version 395032 (0.0006) [2023-12-27 22:04:14,108][106226] Updated weights for policy 0, policy_version 395042 (0.0006) [2023-12-27 22:04:14,395][106225] Updated weights for policy 1, policy_version 396057 (0.0010) [2023-12-27 22:04:14,442][106225] Updated weights for policy 1, policy_version 396067 (0.0010) [2023-12-27 22:04:14,493][106225] Updated weights for policy 1, policy_version 396077 (0.0010) [2023-12-27 22:04:14,820][106226] Updated weights for policy 0, policy_version 395052 (0.0007) [2023-12-27 22:04:14,874][106226] Updated weights for policy 0, policy_version 395062 (0.0008) [2023-12-27 22:04:14,939][106226] Updated weights for policy 0, policy_version 395072 (0.0008) [2023-12-27 22:04:15,294][106225] Updated weights for policy 1, policy_version 396087 (0.0010) [2023-12-27 22:04:15,343][106225] Updated weights for policy 1, policy_version 396097 (0.0010) [2023-12-27 22:04:15,398][106225] Updated weights for policy 1, policy_version 396107 (0.0010) [2023-12-27 22:04:15,697][106226] Updated weights for policy 0, policy_version 395082 (0.0007) [2023-12-27 22:04:15,743][106226] Updated weights for policy 0, policy_version 395092 (0.0005) [2023-12-27 22:04:15,803][106226] Updated weights for policy 0, policy_version 395102 (0.0006) [2023-12-27 22:04:15,864][106226] Updated weights for policy 0, policy_version 395112 (0.0007) [2023-12-27 22:04:16,131][106225] Updated weights for policy 1, policy_version 396117 (0.0010) [2023-12-27 22:04:16,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19524.3, 300 sec: 19244.3). Total num frames: 202612736. Throughput: 0: 9823.1, 1: 9763.2. Samples: 202606484. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:16,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-5.618')] [2023-12-27 22:04:16,190][106225] Updated weights for policy 1, policy_version 396127 (0.0008) [2023-12-27 22:04:16,246][106225] Updated weights for policy 1, policy_version 396137 (0.0010) [2023-12-27 22:04:16,480][106226] Updated weights for policy 0, policy_version 395122 (0.0006) [2023-12-27 22:04:16,535][106226] Updated weights for policy 0, policy_version 395132 (0.0005) [2023-12-27 22:04:16,580][106226] Updated weights for policy 0, policy_version 395142 (0.0006) [2023-12-27 22:04:16,928][106225] Updated weights for policy 1, policy_version 396147 (0.0010) [2023-12-27 22:04:16,989][106225] Updated weights for policy 1, policy_version 396157 (0.0009) [2023-12-27 22:04:17,041][106225] Updated weights for policy 1, policy_version 396167 (0.0008) [2023-12-27 22:04:17,195][106226] Updated weights for policy 0, policy_version 395152 (0.0009) [2023-12-27 22:04:17,256][106226] Updated weights for policy 0, policy_version 395162 (0.0008) [2023-12-27 22:04:17,316][106226] Updated weights for policy 0, policy_version 395172 (0.0009) [2023-12-27 22:04:17,719][106225] Updated weights for policy 1, policy_version 396177 (0.0008) [2023-12-27 22:04:17,781][106225] Updated weights for policy 1, policy_version 396187 (0.0005) [2023-12-27 22:04:17,838][106225] Updated weights for policy 1, policy_version 396197 (0.0008) [2023-12-27 22:04:17,890][106225] Updated weights for policy 1, policy_version 396207 (0.0009) [2023-12-27 22:04:17,987][106226] Updated weights for policy 0, policy_version 395182 (0.0006) [2023-12-27 22:04:18,057][106226] Updated weights for policy 0, policy_version 395192 (0.0005) [2023-12-27 22:04:18,118][106226] Updated weights for policy 0, policy_version 395202 (0.0007) [2023-12-27 22:04:18,635][106225] Updated weights for policy 1, policy_version 396217 (0.0008) [2023-12-27 22:04:18,696][106225] Updated weights for policy 1, policy_version 396227 (0.0008) [2023-12-27 22:04:18,732][106226] Updated weights for policy 0, policy_version 395213 (0.0009) [2023-12-27 22:04:18,756][106225] Updated weights for policy 1, policy_version 396237 (0.0010) [2023-12-27 22:04:18,793][106226] Updated weights for policy 0, policy_version 395223 (0.0007) [2023-12-27 22:04:18,845][106226] Updated weights for policy 0, policy_version 395233 (0.0005) [2023-12-27 22:04:19,497][106225] Updated weights for policy 1, policy_version 396247 (0.0011) [2023-12-27 22:04:19,527][106226] Updated weights for policy 0, policy_version 395243 (0.0007) [2023-12-27 22:04:19,566][106225] Updated weights for policy 1, policy_version 396257 (0.0006) [2023-12-27 22:04:19,596][106226] Updated weights for policy 0, policy_version 395253 (0.0008) [2023-12-27 22:04:19,623][106225] Updated weights for policy 1, policy_version 396267 (0.0006) [2023-12-27 22:04:19,655][106226] Updated weights for policy 0, policy_version 395263 (0.0008) [2023-12-27 22:04:20,279][106225] Updated weights for policy 1, policy_version 396277 (0.0006) [2023-12-27 22:04:20,339][106225] Updated weights for policy 1, policy_version 396287 (0.0006) [2023-12-27 22:04:20,402][106225] Updated weights for policy 1, policy_version 396297 (0.0005) [2023-12-27 22:04:20,432][106226] Updated weights for policy 0, policy_version 395273 (0.0008) [2023-12-27 22:04:20,496][106226] Updated weights for policy 0, policy_version 395283 (0.0007) [2023-12-27 22:04:20,558][106226] Updated weights for policy 0, policy_version 395293 (0.0008) [2023-12-27 22:04:20,626][106226] Updated weights for policy 0, policy_version 395303 (0.0009) [2023-12-27 22:04:21,083][106225] Updated weights for policy 1, policy_version 396307 (0.0009) [2023-12-27 22:04:21,152][106225] Updated weights for policy 1, policy_version 396317 (0.0010) [2023-12-27 22:04:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19244.3). Total num frames: 202711040. Throughput: 0: 9849.4, 1: 9714.7. Samples: 202725952. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:21,175][105115] Avg episode reward: [(0, '-4.985'), (1, '-5.817')] [2023-12-27 22:04:21,222][106225] Updated weights for policy 1, policy_version 396327 (0.0008) [2023-12-27 22:04:21,399][106226] Updated weights for policy 0, policy_version 395313 (0.0009) [2023-12-27 22:04:21,459][106226] Updated weights for policy 0, policy_version 395323 (0.0009) [2023-12-27 22:04:21,520][106226] Updated weights for policy 0, policy_version 395333 (0.0009) [2023-12-27 22:04:21,995][106225] Updated weights for policy 1, policy_version 396337 (0.0008) [2023-12-27 22:04:22,060][106225] Updated weights for policy 1, policy_version 396347 (0.0009) [2023-12-27 22:04:22,128][106225] Updated weights for policy 1, policy_version 396357 (0.0009) [2023-12-27 22:04:22,189][106225] Updated weights for policy 1, policy_version 396367 (0.0009) [2023-12-27 22:04:22,263][106226] Updated weights for policy 0, policy_version 395343 (0.0007) [2023-12-27 22:04:22,331][106226] Updated weights for policy 0, policy_version 395353 (0.0006) [2023-12-27 22:04:22,398][106226] Updated weights for policy 0, policy_version 395363 (0.0008) [2023-12-27 22:04:22,919][106225] Updated weights for policy 1, policy_version 396377 (0.0011) [2023-12-27 22:04:22,971][106225] Updated weights for policy 1, policy_version 396387 (0.0010) [2023-12-27 22:04:23,026][106225] Updated weights for policy 1, policy_version 396397 (0.0010) [2023-12-27 22:04:23,148][106226] Updated weights for policy 0, policy_version 395373 (0.0008) [2023-12-27 22:04:23,224][106226] Updated weights for policy 0, policy_version 395383 (0.0008) [2023-12-27 22:04:23,288][106226] Updated weights for policy 0, policy_version 395393 (0.0008) [2023-12-27 22:04:23,769][106225] Updated weights for policy 1, policy_version 396407 (0.0009) [2023-12-27 22:04:23,825][106225] Updated weights for policy 1, policy_version 396417 (0.0010) [2023-12-27 22:04:23,882][106225] Updated weights for policy 1, policy_version 396427 (0.0010) [2023-12-27 22:04:23,923][106226] Updated weights for policy 0, policy_version 395403 (0.0007) [2023-12-27 22:04:23,973][106226] Updated weights for policy 0, policy_version 395413 (0.0008) [2023-12-27 22:04:24,031][106226] Updated weights for policy 0, policy_version 395423 (0.0007) [2023-12-27 22:04:24,583][106225] Updated weights for policy 1, policy_version 396437 (0.0009) [2023-12-27 22:04:24,637][106225] Updated weights for policy 1, policy_version 396447 (0.0010) [2023-12-27 22:04:24,689][106226] Updated weights for policy 0, policy_version 395433 (0.0008) [2023-12-27 22:04:24,701][106225] Updated weights for policy 1, policy_version 396457 (0.0010) [2023-12-27 22:04:24,750][106226] Updated weights for policy 0, policy_version 395443 (0.0010) [2023-12-27 22:04:24,812][106226] Updated weights for policy 0, policy_version 395453 (0.0010) [2023-12-27 22:04:24,870][106226] Updated weights for policy 0, policy_version 395463 (0.0007) [2023-12-27 22:04:25,379][106225] Updated weights for policy 1, policy_version 396467 (0.0010) [2023-12-27 22:04:25,436][106225] Updated weights for policy 1, policy_version 396477 (0.0006) [2023-12-27 22:04:25,483][106225] Updated weights for policy 1, policy_version 396487 (0.0008) [2023-12-27 22:04:25,531][106226] Updated weights for policy 0, policy_version 395473 (0.0007) [2023-12-27 22:04:25,579][106226] Updated weights for policy 0, policy_version 395483 (0.0008) [2023-12-27 22:04:25,627][106226] Updated weights for policy 0, policy_version 395493 (0.0008) [2023-12-27 22:04:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19216.5). Total num frames: 202809344. Throughput: 0: 9719.2, 1: 9682.3. Samples: 202781144. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:26,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-6.238')] [2023-12-27 22:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000396496_101531648.pth... [2023-12-27 22:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000395496_101277696.pth... [2023-12-27 22:04:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000395376_101244928.pth [2023-12-27 22:04:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000394376_100990976.pth [2023-12-27 22:04:26,204][106225] Updated weights for policy 1, policy_version 396497 (0.0006) [2023-12-27 22:04:26,266][106225] Updated weights for policy 1, policy_version 396507 (0.0008) [2023-12-27 22:04:26,320][106225] Updated weights for policy 1, policy_version 396517 (0.0008) [2023-12-27 22:04:26,376][106225] Updated weights for policy 1, policy_version 396527 (0.0007) [2023-12-27 22:04:26,382][106226] Updated weights for policy 0, policy_version 395503 (0.0007) [2023-12-27 22:04:26,439][106226] Updated weights for policy 0, policy_version 395513 (0.0009) [2023-12-27 22:04:26,484][106226] Updated weights for policy 0, policy_version 395523 (0.0008) [2023-12-27 22:04:27,095][106225] Updated weights for policy 1, policy_version 396537 (0.0006) [2023-12-27 22:04:27,162][106225] Updated weights for policy 1, policy_version 396547 (0.0007) [2023-12-27 22:04:27,202][106226] Updated weights for policy 0, policy_version 395533 (0.0007) [2023-12-27 22:04:27,217][106225] Updated weights for policy 1, policy_version 396557 (0.0007) [2023-12-27 22:04:27,269][106226] Updated weights for policy 0, policy_version 395543 (0.0007) [2023-12-27 22:04:27,336][106226] Updated weights for policy 0, policy_version 395553 (0.0009) [2023-12-27 22:04:27,947][106226] Updated weights for policy 0, policy_version 395563 (0.0005) [2023-12-27 22:04:27,966][106225] Updated weights for policy 1, policy_version 396567 (0.0007) [2023-12-27 22:04:27,994][106226] Updated weights for policy 0, policy_version 395573 (0.0006) [2023-12-27 22:04:28,013][106225] Updated weights for policy 1, policy_version 396577 (0.0007) [2023-12-27 22:04:28,046][106226] Updated weights for policy 0, policy_version 395583 (0.0007) [2023-12-27 22:04:28,067][106225] Updated weights for policy 1, policy_version 396587 (0.0006) [2023-12-27 22:04:28,751][106226] Updated weights for policy 0, policy_version 395593 (0.0006) [2023-12-27 22:04:28,778][106225] Updated weights for policy 1, policy_version 396597 (0.0009) [2023-12-27 22:04:28,814][106226] Updated weights for policy 0, policy_version 395603 (0.0006) [2023-12-27 22:04:28,839][106225] Updated weights for policy 1, policy_version 396607 (0.0010) [2023-12-27 22:04:28,879][106226] Updated weights for policy 0, policy_version 395613 (0.0007) [2023-12-27 22:04:28,905][106225] Updated weights for policy 1, policy_version 396617 (0.0005) [2023-12-27 22:04:28,944][106226] Updated weights for policy 0, policy_version 395623 (0.0010) [2023-12-27 22:04:29,531][106225] Updated weights for policy 1, policy_version 396627 (0.0006) [2023-12-27 22:04:29,590][106225] Updated weights for policy 1, policy_version 396637 (0.0008) [2023-12-27 22:04:29,646][106225] Updated weights for policy 1, policy_version 396647 (0.0007) [2023-12-27 22:04:29,659][106226] Updated weights for policy 0, policy_version 395633 (0.0009) [2023-12-27 22:04:29,725][106226] Updated weights for policy 0, policy_version 395643 (0.0007) [2023-12-27 22:04:29,785][106226] Updated weights for policy 0, policy_version 395653 (0.0009) [2023-12-27 22:04:30,361][106225] Updated weights for policy 1, policy_version 396657 (0.0007) [2023-12-27 22:04:30,423][106225] Updated weights for policy 1, policy_version 396667 (0.0010) [2023-12-27 22:04:30,474][106225] Updated weights for policy 1, policy_version 396677 (0.0008) [2023-12-27 22:04:30,498][106226] Updated weights for policy 0, policy_version 395663 (0.0008) [2023-12-27 22:04:30,531][106225] Updated weights for policy 1, policy_version 396687 (0.0005) [2023-12-27 22:04:30,544][106226] Updated weights for policy 0, policy_version 395673 (0.0008) [2023-12-27 22:04:30,598][106226] Updated weights for policy 0, policy_version 395684 (0.0009) [2023-12-27 22:04:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19216.5). Total num frames: 202907648. Throughput: 0: 9796.2, 1: 9778.4. Samples: 202900708. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:31,175][105115] Avg episode reward: [(0, '-4.898'), (1, '-5.774')] [2023-12-27 22:04:31,233][106225] Updated weights for policy 1, policy_version 396697 (0.0006) [2023-12-27 22:04:31,296][106225] Updated weights for policy 1, policy_version 396707 (0.0006) [2023-12-27 22:04:31,369][106225] Updated weights for policy 1, policy_version 396717 (0.0007) [2023-12-27 22:04:31,394][106226] Updated weights for policy 0, policy_version 395694 (0.0009) [2023-12-27 22:04:31,457][106226] Updated weights for policy 0, policy_version 395704 (0.0009) [2023-12-27 22:04:31,516][106226] Updated weights for policy 0, policy_version 395714 (0.0008) [2023-12-27 22:04:32,056][106225] Updated weights for policy 1, policy_version 396727 (0.0008) [2023-12-27 22:04:32,127][106225] Updated weights for policy 1, policy_version 396737 (0.0009) [2023-12-27 22:04:32,186][106225] Updated weights for policy 1, policy_version 396747 (0.0008) [2023-12-27 22:04:32,260][106226] Updated weights for policy 0, policy_version 395724 (0.0008) [2023-12-27 22:04:32,322][106226] Updated weights for policy 0, policy_version 395734 (0.0009) [2023-12-27 22:04:32,386][106226] Updated weights for policy 0, policy_version 395744 (0.0008) [2023-12-27 22:04:32,930][106225] Updated weights for policy 1, policy_version 396757 (0.0009) [2023-12-27 22:04:32,979][106225] Updated weights for policy 1, policy_version 396767 (0.0006) [2023-12-27 22:04:33,031][106225] Updated weights for policy 1, policy_version 396777 (0.0005) [2023-12-27 22:04:33,072][106226] Updated weights for policy 0, policy_version 395754 (0.0009) [2023-12-27 22:04:33,133][106226] Updated weights for policy 0, policy_version 395764 (0.0010) [2023-12-27 22:04:33,191][106226] Updated weights for policy 0, policy_version 395774 (0.0011) [2023-12-27 22:04:33,244][106226] Updated weights for policy 0, policy_version 395784 (0.0010) [2023-12-27 22:04:33,669][106225] Updated weights for policy 1, policy_version 396787 (0.0006) [2023-12-27 22:04:33,714][106225] Updated weights for policy 1, policy_version 396797 (0.0007) [2023-12-27 22:04:33,759][106225] Updated weights for policy 1, policy_version 396807 (0.0007) [2023-12-27 22:04:33,968][106226] Updated weights for policy 0, policy_version 395794 (0.0010) [2023-12-27 22:04:34,024][106226] Updated weights for policy 0, policy_version 395804 (0.0010) [2023-12-27 22:04:34,086][106226] Updated weights for policy 0, policy_version 395814 (0.0010) [2023-12-27 22:04:34,520][106225] Updated weights for policy 1, policy_version 396817 (0.0008) [2023-12-27 22:04:34,577][106225] Updated weights for policy 1, policy_version 396827 (0.0008) [2023-12-27 22:04:34,631][106225] Updated weights for policy 1, policy_version 396837 (0.0007) [2023-12-27 22:04:34,682][106225] Updated weights for policy 1, policy_version 396847 (0.0008) [2023-12-27 22:04:34,829][106226] Updated weights for policy 0, policy_version 395824 (0.0006) [2023-12-27 22:04:34,891][106226] Updated weights for policy 0, policy_version 395834 (0.0007) [2023-12-27 22:04:34,951][106226] Updated weights for policy 0, policy_version 395844 (0.0010) [2023-12-27 22:04:35,400][106225] Updated weights for policy 1, policy_version 396857 (0.0007) [2023-12-27 22:04:35,465][106225] Updated weights for policy 1, policy_version 396867 (0.0007) [2023-12-27 22:04:35,521][106225] Updated weights for policy 1, policy_version 396877 (0.0007) [2023-12-27 22:04:35,630][106226] Updated weights for policy 0, policy_version 395854 (0.0010) [2023-12-27 22:04:35,689][106226] Updated weights for policy 0, policy_version 395864 (0.0010) [2023-12-27 22:04:35,739][106226] Updated weights for policy 0, policy_version 395874 (0.0010) [2023-12-27 22:04:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19216.5). Total num frames: 203005952. Throughput: 0: 9765.6, 1: 9812.3. Samples: 203018312. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:36,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-5.837')] [2023-12-27 22:04:36,217][106225] Updated weights for policy 1, policy_version 396887 (0.0008) [2023-12-27 22:04:36,276][106225] Updated weights for policy 1, policy_version 396897 (0.0008) [2023-12-27 22:04:36,339][106225] Updated weights for policy 1, policy_version 396907 (0.0008) [2023-12-27 22:04:36,415][106226] Updated weights for policy 0, policy_version 395884 (0.0010) [2023-12-27 22:04:36,478][106226] Updated weights for policy 0, policy_version 395894 (0.0011) [2023-12-27 22:04:36,541][106226] Updated weights for policy 0, policy_version 395904 (0.0011) [2023-12-27 22:04:37,091][106225] Updated weights for policy 1, policy_version 396917 (0.0007) [2023-12-27 22:04:37,157][106225] Updated weights for policy 1, policy_version 396927 (0.0006) [2023-12-27 22:04:37,221][106225] Updated weights for policy 1, policy_version 396937 (0.0008) [2023-12-27 22:04:37,226][106226] Updated weights for policy 0, policy_version 395914 (0.0011) [2023-12-27 22:04:37,290][106226] Updated weights for policy 0, policy_version 395924 (0.0011) [2023-12-27 22:04:37,358][106226] Updated weights for policy 0, policy_version 395934 (0.0011) [2023-12-27 22:04:37,417][106226] Updated weights for policy 0, policy_version 395944 (0.0011) [2023-12-27 22:04:37,910][106225] Updated weights for policy 1, policy_version 396947 (0.0008) [2023-12-27 22:04:37,976][106225] Updated weights for policy 1, policy_version 396957 (0.0007) [2023-12-27 22:04:38,031][106225] Updated weights for policy 1, policy_version 396967 (0.0007) [2023-12-27 22:04:38,131][106226] Updated weights for policy 0, policy_version 395954 (0.0006) [2023-12-27 22:04:38,189][106226] Updated weights for policy 0, policy_version 395964 (0.0005) [2023-12-27 22:04:38,256][106226] Updated weights for policy 0, policy_version 395974 (0.0008) [2023-12-27 22:04:38,714][106225] Updated weights for policy 1, policy_version 396977 (0.0009) [2023-12-27 22:04:38,779][106225] Updated weights for policy 1, policy_version 396987 (0.0007) [2023-12-27 22:04:38,844][106225] Updated weights for policy 1, policy_version 396997 (0.0008) [2023-12-27 22:04:38,903][106225] Updated weights for policy 1, policy_version 397007 (0.0009) [2023-12-27 22:04:38,973][106226] Updated weights for policy 0, policy_version 395984 (0.0007) [2023-12-27 22:04:39,023][106226] Updated weights for policy 0, policy_version 395994 (0.0005) [2023-12-27 22:04:39,078][106226] Updated weights for policy 0, policy_version 396004 (0.0005) [2023-12-27 22:04:39,667][106225] Updated weights for policy 1, policy_version 397017 (0.0008) [2023-12-27 22:04:39,727][106225] Updated weights for policy 1, policy_version 397027 (0.0009) [2023-12-27 22:04:39,761][106226] Updated weights for policy 0, policy_version 396014 (0.0007) [2023-12-27 22:04:39,794][106225] Updated weights for policy 1, policy_version 397037 (0.0010) [2023-12-27 22:04:39,846][106226] Updated weights for policy 0, policy_version 396024 (0.0007) [2023-12-27 22:04:39,914][106226] Updated weights for policy 0, policy_version 396034 (0.0008) [2023-12-27 22:04:40,567][106226] Updated weights for policy 0, policy_version 396044 (0.0007) [2023-12-27 22:04:40,620][106226] Updated weights for policy 0, policy_version 396054 (0.0006) [2023-12-27 22:04:40,657][106225] Updated weights for policy 1, policy_version 397047 (0.0008) [2023-12-27 22:04:40,678][106226] Updated weights for policy 0, policy_version 396064 (0.0006) [2023-12-27 22:04:40,717][106225] Updated weights for policy 1, policy_version 397057 (0.0006) [2023-12-27 22:04:40,775][106225] Updated weights for policy 1, policy_version 397067 (0.0007) [2023-12-27 22:04:41,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19216.5). Total num frames: 203104256. Throughput: 0: 9790.0, 1: 9808.7. Samples: 203076832. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:41,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-6.134')] [2023-12-27 22:04:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000396072_101425152.pth... [2023-12-27 22:04:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000397072_101679104.pth... [2023-12-27 22:04:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000394920_101130240.pth [2023-12-27 22:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000395952_101392384.pth [2023-12-27 22:04:41,386][106226] Updated weights for policy 0, policy_version 396074 (0.0007) [2023-12-27 22:04:41,443][106226] Updated weights for policy 0, policy_version 396084 (0.0009) [2023-12-27 22:04:41,509][106226] Updated weights for policy 0, policy_version 396094 (0.0007) [2023-12-27 22:04:41,549][106225] Updated weights for policy 1, policy_version 397077 (0.0007) [2023-12-27 22:04:41,576][106226] Updated weights for policy 0, policy_version 396104 (0.0008) [2023-12-27 22:04:41,621][106225] Updated weights for policy 1, policy_version 397087 (0.0007) [2023-12-27 22:04:41,692][106225] Updated weights for policy 1, policy_version 397097 (0.0007) [2023-12-27 22:04:42,322][106226] Updated weights for policy 0, policy_version 396114 (0.0008) [2023-12-27 22:04:42,393][106226] Updated weights for policy 0, policy_version 396124 (0.0009) [2023-12-27 22:04:42,443][106225] Updated weights for policy 1, policy_version 397107 (0.0008) [2023-12-27 22:04:42,459][106226] Updated weights for policy 0, policy_version 396134 (0.0009) [2023-12-27 22:04:42,503][106225] Updated weights for policy 1, policy_version 397117 (0.0008) [2023-12-27 22:04:42,563][106225] Updated weights for policy 1, policy_version 397127 (0.0008) [2023-12-27 22:04:43,191][106226] Updated weights for policy 0, policy_version 396144 (0.0008) [2023-12-27 22:04:43,248][106226] Updated weights for policy 0, policy_version 396154 (0.0006) [2023-12-27 22:04:43,306][106226] Updated weights for policy 0, policy_version 396164 (0.0005) [2023-12-27 22:04:43,321][106225] Updated weights for policy 1, policy_version 397137 (0.0008) [2023-12-27 22:04:43,382][106225] Updated weights for policy 1, policy_version 397147 (0.0007) [2023-12-27 22:04:43,447][106225] Updated weights for policy 1, policy_version 397157 (0.0008) [2023-12-27 22:04:43,509][106225] Updated weights for policy 1, policy_version 397167 (0.0011) [2023-12-27 22:04:44,065][106226] Updated weights for policy 0, policy_version 396174 (0.0007) [2023-12-27 22:04:44,092][106225] Updated weights for policy 1, policy_version 397177 (0.0006) [2023-12-27 22:04:44,132][106226] Updated weights for policy 0, policy_version 396184 (0.0009) [2023-12-27 22:04:44,153][106225] Updated weights for policy 1, policy_version 397187 (0.0006) [2023-12-27 22:04:44,189][106226] Updated weights for policy 0, policy_version 396194 (0.0007) [2023-12-27 22:04:44,210][106225] Updated weights for policy 1, policy_version 397197 (0.0008) [2023-12-27 22:04:44,861][106225] Updated weights for policy 1, policy_version 397207 (0.0008) [2023-12-27 22:04:44,921][106225] Updated weights for policy 1, policy_version 397217 (0.0008) [2023-12-27 22:04:44,941][106226] Updated weights for policy 0, policy_version 396204 (0.0007) [2023-12-27 22:04:44,978][106225] Updated weights for policy 1, policy_version 397227 (0.0006) [2023-12-27 22:04:45,009][106226] Updated weights for policy 0, policy_version 396214 (0.0008) [2023-12-27 22:04:45,075][106226] Updated weights for policy 0, policy_version 396224 (0.0010) [2023-12-27 22:04:45,716][106225] Updated weights for policy 1, policy_version 397237 (0.0007) [2023-12-27 22:04:45,768][106225] Updated weights for policy 1, policy_version 397247 (0.0008) [2023-12-27 22:04:45,804][106226] Updated weights for policy 0, policy_version 396234 (0.0009) [2023-12-27 22:04:45,819][106225] Updated weights for policy 1, policy_version 397257 (0.0007) [2023-12-27 22:04:45,859][106226] Updated weights for policy 0, policy_version 396244 (0.0008) [2023-12-27 22:04:45,914][106226] Updated weights for policy 0, policy_version 396254 (0.0010) [2023-12-27 22:04:45,980][106226] Updated weights for policy 0, policy_version 396264 (0.0011) [2023-12-27 22:04:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19216.5). Total num frames: 203202560. Throughput: 0: 9706.1, 1: 9714.1. Samples: 203190380. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:46,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-5.898')] [2023-12-27 22:04:46,553][106225] Updated weights for policy 1, policy_version 397267 (0.0008) [2023-12-27 22:04:46,582][106226] Updated weights for policy 0, policy_version 396274 (0.0005) [2023-12-27 22:04:46,613][106225] Updated weights for policy 1, policy_version 397277 (0.0008) [2023-12-27 22:04:46,652][106226] Updated weights for policy 0, policy_version 396284 (0.0006) [2023-12-27 22:04:46,672][106225] Updated weights for policy 1, policy_version 397287 (0.0008) [2023-12-27 22:04:46,715][106226] Updated weights for policy 0, policy_version 396294 (0.0005) [2023-12-27 22:04:47,302][106226] Updated weights for policy 0, policy_version 396304 (0.0009) [2023-12-27 22:04:47,324][106225] Updated weights for policy 1, policy_version 397297 (0.0007) [2023-12-27 22:04:47,359][106226] Updated weights for policy 0, policy_version 396314 (0.0010) [2023-12-27 22:04:47,391][106225] Updated weights for policy 1, policy_version 397307 (0.0005) [2023-12-27 22:04:47,406][106226] Updated weights for policy 0, policy_version 396324 (0.0010) [2023-12-27 22:04:47,451][106225] Updated weights for policy 1, policy_version 397317 (0.0006) [2023-12-27 22:04:47,504][106225] Updated weights for policy 1, policy_version 397327 (0.0005) [2023-12-27 22:04:48,055][106225] Updated weights for policy 1, policy_version 397337 (0.0007) [2023-12-27 22:04:48,116][106225] Updated weights for policy 1, policy_version 397347 (0.0008) [2023-12-27 22:04:48,119][106226] Updated weights for policy 0, policy_version 396334 (0.0008) [2023-12-27 22:04:48,176][106226] Updated weights for policy 0, policy_version 396344 (0.0008) [2023-12-27 22:04:48,182][106225] Updated weights for policy 1, policy_version 397357 (0.0005) [2023-12-27 22:04:48,236][106226] Updated weights for policy 0, policy_version 396354 (0.0011) [2023-12-27 22:04:48,867][106225] Updated weights for policy 1, policy_version 397367 (0.0007) [2023-12-27 22:04:48,874][106226] Updated weights for policy 0, policy_version 396364 (0.0010) [2023-12-27 22:04:48,927][106225] Updated weights for policy 1, policy_version 397377 (0.0006) [2023-12-27 22:04:48,935][106226] Updated weights for policy 0, policy_version 396374 (0.0010) [2023-12-27 22:04:48,991][106225] Updated weights for policy 1, policy_version 397387 (0.0006) [2023-12-27 22:04:49,000][106226] Updated weights for policy 0, policy_version 396384 (0.0011) [2023-12-27 22:04:49,668][106225] Updated weights for policy 1, policy_version 397397 (0.0007) [2023-12-27 22:04:49,713][106226] Updated weights for policy 0, policy_version 396394 (0.0011) [2023-12-27 22:04:49,731][106225] Updated weights for policy 1, policy_version 397407 (0.0007) [2023-12-27 22:04:49,768][106226] Updated weights for policy 0, policy_version 396404 (0.0011) [2023-12-27 22:04:49,796][106225] Updated weights for policy 1, policy_version 397417 (0.0005) [2023-12-27 22:04:49,835][106226] Updated weights for policy 0, policy_version 396414 (0.0009) [2023-12-27 22:04:49,899][106226] Updated weights for policy 0, policy_version 396424 (0.0008) [2023-12-27 22:04:50,482][106225] Updated weights for policy 1, policy_version 397427 (0.0007) [2023-12-27 22:04:50,541][106225] Updated weights for policy 1, policy_version 397437 (0.0005) [2023-12-27 22:04:50,601][106226] Updated weights for policy 0, policy_version 396434 (0.0007) [2023-12-27 22:04:50,613][106225] Updated weights for policy 1, policy_version 397447 (0.0007) [2023-12-27 22:04:50,661][106226] Updated weights for policy 0, policy_version 396444 (0.0006) [2023-12-27 22:04:50,720][106226] Updated weights for policy 0, policy_version 396454 (0.0010) [2023-12-27 22:04:51,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19216.5). Total num frames: 203300864. Throughput: 0: 9759.0, 1: 9759.8. Samples: 203312572. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:51,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.717')] [2023-12-27 22:04:51,191][106225] Updated weights for policy 1, policy_version 397457 (0.0006) [2023-12-27 22:04:51,244][106225] Updated weights for policy 1, policy_version 397467 (0.0009) [2023-12-27 22:04:51,308][106225] Updated weights for policy 1, policy_version 397477 (0.0008) [2023-12-27 22:04:51,376][106225] Updated weights for policy 1, policy_version 397487 (0.0008) [2023-12-27 22:04:51,442][106226] Updated weights for policy 0, policy_version 396464 (0.0009) [2023-12-27 22:04:51,497][106226] Updated weights for policy 0, policy_version 396474 (0.0008) [2023-12-27 22:04:51,549][106226] Updated weights for policy 0, policy_version 396484 (0.0008) [2023-12-27 22:04:52,154][106225] Updated weights for policy 1, policy_version 397497 (0.0008) [2023-12-27 22:04:52,200][106225] Updated weights for policy 1, policy_version 397507 (0.0008) [2023-12-27 22:04:52,256][106225] Updated weights for policy 1, policy_version 397517 (0.0008) [2023-12-27 22:04:52,315][106226] Updated weights for policy 0, policy_version 396494 (0.0009) [2023-12-27 22:04:52,382][106226] Updated weights for policy 0, policy_version 396504 (0.0008) [2023-12-27 22:04:52,451][106226] Updated weights for policy 0, policy_version 396514 (0.0009) [2023-12-27 22:04:53,029][106225] Updated weights for policy 1, policy_version 397527 (0.0006) [2023-12-27 22:04:53,083][106225] Updated weights for policy 1, policy_version 397537 (0.0008) [2023-12-27 22:04:53,135][106225] Updated weights for policy 1, policy_version 397547 (0.0009) [2023-12-27 22:04:53,184][106226] Updated weights for policy 0, policy_version 396524 (0.0007) [2023-12-27 22:04:53,247][106226] Updated weights for policy 0, policy_version 396534 (0.0009) [2023-12-27 22:04:53,307][106226] Updated weights for policy 0, policy_version 396544 (0.0009) [2023-12-27 22:04:53,886][106225] Updated weights for policy 1, policy_version 397557 (0.0008) [2023-12-27 22:04:53,938][106225] Updated weights for policy 1, policy_version 397567 (0.0006) [2023-12-27 22:04:54,000][106225] Updated weights for policy 1, policy_version 397577 (0.0005) [2023-12-27 22:04:54,049][106226] Updated weights for policy 0, policy_version 396554 (0.0008) [2023-12-27 22:04:54,115][106226] Updated weights for policy 0, policy_version 396564 (0.0009) [2023-12-27 22:04:54,180][106226] Updated weights for policy 0, policy_version 396574 (0.0009) [2023-12-27 22:04:54,243][106226] Updated weights for policy 0, policy_version 396584 (0.0008) [2023-12-27 22:04:54,542][106225] Updated weights for policy 1, policy_version 397587 (0.0006) [2023-12-27 22:04:54,599][106225] Updated weights for policy 1, policy_version 397597 (0.0005) [2023-12-27 22:04:54,662][106225] Updated weights for policy 1, policy_version 397607 (0.0008) [2023-12-27 22:04:54,947][106226] Updated weights for policy 0, policy_version 396594 (0.0009) [2023-12-27 22:04:54,999][106226] Updated weights for policy 0, policy_version 396604 (0.0008) [2023-12-27 22:04:55,064][106226] Updated weights for policy 0, policy_version 396614 (0.0007) [2023-12-27 22:04:55,330][106225] Updated weights for policy 1, policy_version 397617 (0.0007) [2023-12-27 22:04:55,394][106225] Updated weights for policy 1, policy_version 397627 (0.0007) [2023-12-27 22:04:55,439][106225] Updated weights for policy 1, policy_version 397637 (0.0008) [2023-12-27 22:04:55,489][106225] Updated weights for policy 1, policy_version 397647 (0.0008) [2023-12-27 22:04:55,756][106226] Updated weights for policy 0, policy_version 396624 (0.0008) [2023-12-27 22:04:55,809][106226] Updated weights for policy 0, policy_version 396634 (0.0007) [2023-12-27 22:04:55,873][106226] Updated weights for policy 0, policy_version 396644 (0.0008) [2023-12-27 22:04:56,168][106225] Updated weights for policy 1, policy_version 397657 (0.0006) [2023-12-27 22:04:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19524.2, 300 sec: 19216.5). Total num frames: 203399168. Throughput: 0: 9756.2, 1: 9734.7. Samples: 203368952. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:04:56,176][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.864')] [2023-12-27 22:04:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000396648_101572608.pth... [2023-12-27 22:04:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000395496_101277696.pth [2023-12-27 22:04:56,222][106225] Updated weights for policy 1, policy_version 397667 (0.0005) [2023-12-27 22:04:56,273][106225] Updated weights for policy 1, policy_version 397677 (0.0008) [2023-12-27 22:04:56,290][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000397680_101834752.pth... [2023-12-27 22:04:56,294][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000396496_101531648.pth [2023-12-27 22:04:56,563][106226] Updated weights for policy 0, policy_version 396654 (0.0010) [2023-12-27 22:04:56,633][106226] Updated weights for policy 0, policy_version 396664 (0.0011) [2023-12-27 22:04:56,702][106226] Updated weights for policy 0, policy_version 396674 (0.0010) [2023-12-27 22:04:56,900][106225] Updated weights for policy 1, policy_version 397687 (0.0009) [2023-12-27 22:04:56,960][106225] Updated weights for policy 1, policy_version 397697 (0.0010) [2023-12-27 22:04:57,021][106225] Updated weights for policy 1, policy_version 397707 (0.0010) [2023-12-27 22:04:57,311][106226] Updated weights for policy 0, policy_version 396684 (0.0009) [2023-12-27 22:04:57,361][106226] Updated weights for policy 0, policy_version 396694 (0.0009) [2023-12-27 22:04:57,406][106226] Updated weights for policy 0, policy_version 396704 (0.0008) [2023-12-27 22:04:57,688][106225] Updated weights for policy 1, policy_version 397717 (0.0007) [2023-12-27 22:04:57,752][106225] Updated weights for policy 1, policy_version 397727 (0.0008) [2023-12-27 22:04:57,821][106225] Updated weights for policy 1, policy_version 397737 (0.0009) [2023-12-27 22:04:58,113][106226] Updated weights for policy 0, policy_version 396714 (0.0008) [2023-12-27 22:04:58,164][106226] Updated weights for policy 0, policy_version 396724 (0.0005) [2023-12-27 22:04:58,229][106226] Updated weights for policy 0, policy_version 396734 (0.0007) [2023-12-27 22:04:58,288][106226] Updated weights for policy 0, policy_version 396744 (0.0008) [2023-12-27 22:04:58,631][106225] Updated weights for policy 1, policy_version 397747 (0.0008) [2023-12-27 22:04:58,693][106225] Updated weights for policy 1, policy_version 397757 (0.0008) [2023-12-27 22:04:58,753][106225] Updated weights for policy 1, policy_version 397767 (0.0009) [2023-12-27 22:04:59,112][106226] Updated weights for policy 0, policy_version 396754 (0.0009) [2023-12-27 22:04:59,178][106226] Updated weights for policy 0, policy_version 396764 (0.0008) [2023-12-27 22:04:59,249][106226] Updated weights for policy 0, policy_version 396774 (0.0009) [2023-12-27 22:04:59,606][106225] Updated weights for policy 1, policy_version 397777 (0.0008) [2023-12-27 22:04:59,661][106225] Updated weights for policy 1, policy_version 397787 (0.0008) [2023-12-27 22:04:59,719][106225] Updated weights for policy 1, policy_version 397797 (0.0006) [2023-12-27 22:04:59,775][106225] Updated weights for policy 1, policy_version 397807 (0.0006) [2023-12-27 22:05:00,043][106226] Updated weights for policy 0, policy_version 396784 (0.0009) [2023-12-27 22:05:00,107][106226] Updated weights for policy 0, policy_version 396794 (0.0008) [2023-12-27 22:05:00,172][106226] Updated weights for policy 0, policy_version 396804 (0.0007) [2023-12-27 22:05:00,513][106225] Updated weights for policy 1, policy_version 397817 (0.0008) [2023-12-27 22:05:00,564][106225] Updated weights for policy 1, policy_version 397827 (0.0008) [2023-12-27 22:05:00,624][106225] Updated weights for policy 1, policy_version 397837 (0.0008) [2023-12-27 22:05:00,901][106226] Updated weights for policy 0, policy_version 396814 (0.0008) [2023-12-27 22:05:00,965][106226] Updated weights for policy 0, policy_version 396824 (0.0009) [2023-12-27 22:05:01,017][106226] Updated weights for policy 0, policy_version 396834 (0.0008) [2023-12-27 22:05:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19216.5). Total num frames: 203497472. Throughput: 0: 9793.1, 1: 9763.5. Samples: 203486528. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:01,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-6.070')] [2023-12-27 22:05:01,388][106225] Updated weights for policy 1, policy_version 397847 (0.0008) [2023-12-27 22:05:01,448][106225] Updated weights for policy 1, policy_version 397857 (0.0011) [2023-12-27 22:05:01,509][106225] Updated weights for policy 1, policy_version 397867 (0.0010) [2023-12-27 22:05:01,793][106226] Updated weights for policy 0, policy_version 396844 (0.0008) [2023-12-27 22:05:01,843][106226] Updated weights for policy 0, policy_version 396854 (0.0007) [2023-12-27 22:05:01,899][106226] Updated weights for policy 0, policy_version 396864 (0.0008) [2023-12-27 22:05:02,245][106225] Updated weights for policy 1, policy_version 397877 (0.0009) [2023-12-27 22:05:02,305][106225] Updated weights for policy 1, policy_version 397887 (0.0010) [2023-12-27 22:05:02,368][106225] Updated weights for policy 1, policy_version 397897 (0.0010) [2023-12-27 22:05:02,747][106226] Updated weights for policy 0, policy_version 396874 (0.0009) [2023-12-27 22:05:02,795][106226] Updated weights for policy 0, policy_version 396884 (0.0006) [2023-12-27 22:05:02,846][106226] Updated weights for policy 0, policy_version 396894 (0.0008) [2023-12-27 22:05:02,895][106226] Updated weights for policy 0, policy_version 396904 (0.0009) [2023-12-27 22:05:02,986][106225] Updated weights for policy 1, policy_version 397907 (0.0010) [2023-12-27 22:05:03,042][106225] Updated weights for policy 1, policy_version 397917 (0.0010) [2023-12-27 22:05:03,089][106225] Updated weights for policy 1, policy_version 397927 (0.0010) [2023-12-27 22:05:03,622][106226] Updated weights for policy 0, policy_version 396914 (0.0008) [2023-12-27 22:05:03,668][106226] Updated weights for policy 0, policy_version 396924 (0.0007) [2023-12-27 22:05:03,720][106226] Updated weights for policy 0, policy_version 396934 (0.0008) [2023-12-27 22:05:03,806][106225] Updated weights for policy 1, policy_version 397937 (0.0010) [2023-12-27 22:05:03,869][106225] Updated weights for policy 1, policy_version 397947 (0.0010) [2023-12-27 22:05:03,927][106225] Updated weights for policy 1, policy_version 397957 (0.0010) [2023-12-27 22:05:03,983][106225] Updated weights for policy 1, policy_version 397967 (0.0008) [2023-12-27 22:05:04,491][106226] Updated weights for policy 0, policy_version 396944 (0.0009) [2023-12-27 22:05:04,542][106226] Updated weights for policy 0, policy_version 396954 (0.0008) [2023-12-27 22:05:04,597][106226] Updated weights for policy 0, policy_version 396964 (0.0008) [2023-12-27 22:05:04,691][106225] Updated weights for policy 1, policy_version 397977 (0.0009) [2023-12-27 22:05:04,750][106225] Updated weights for policy 1, policy_version 397987 (0.0009) [2023-12-27 22:05:04,812][106225] Updated weights for policy 1, policy_version 397997 (0.0008) [2023-12-27 22:05:05,232][106226] Updated weights for policy 0, policy_version 396974 (0.0008) [2023-12-27 22:05:05,293][106226] Updated weights for policy 0, policy_version 396984 (0.0009) [2023-12-27 22:05:05,357][106226] Updated weights for policy 0, policy_version 396994 (0.0009) [2023-12-27 22:05:05,543][106225] Updated weights for policy 1, policy_version 398007 (0.0008) [2023-12-27 22:05:05,607][106225] Updated weights for policy 1, policy_version 398017 (0.0006) [2023-12-27 22:05:05,660][106225] Updated weights for policy 1, policy_version 398027 (0.0005) [2023-12-27 22:05:06,043][106226] Updated weights for policy 0, policy_version 397004 (0.0010) [2023-12-27 22:05:06,104][106226] Updated weights for policy 0, policy_version 397014 (0.0010) [2023-12-27 22:05:06,172][106226] Updated weights for policy 0, policy_version 397024 (0.0008) [2023-12-27 22:05:06,175][105115] Fps is (10 sec: 18842.1, 60 sec: 19251.2, 300 sec: 19244.3). Total num frames: 203587584. Throughput: 0: 9711.9, 1: 9782.1. Samples: 203603184. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:06,175][105115] Avg episode reward: [(0, '-5.131'), (1, '-6.109')] [2023-12-27 22:05:06,208][106225] Updated weights for policy 1, policy_version 398037 (0.0006) [2023-12-27 22:05:06,279][106225] Updated weights for policy 1, policy_version 398047 (0.0008) [2023-12-27 22:05:06,347][106225] Updated weights for policy 1, policy_version 398057 (0.0009) [2023-12-27 22:05:06,918][106226] Updated weights for policy 0, policy_version 397034 (0.0011) [2023-12-27 22:05:06,984][106226] Updated weights for policy 0, policy_version 397044 (0.0011) [2023-12-27 22:05:07,019][106225] Updated weights for policy 1, policy_version 398067 (0.0007) [2023-12-27 22:05:07,048][106226] Updated weights for policy 0, policy_version 397054 (0.0011) [2023-12-27 22:05:07,085][106225] Updated weights for policy 1, policy_version 398077 (0.0010) [2023-12-27 22:05:07,111][106226] Updated weights for policy 0, policy_version 397064 (0.0011) [2023-12-27 22:05:07,151][106225] Updated weights for policy 1, policy_version 398087 (0.0007) [2023-12-27 22:05:07,828][106226] Updated weights for policy 0, policy_version 397074 (0.0011) [2023-12-27 22:05:07,881][106226] Updated weights for policy 0, policy_version 397084 (0.0010) [2023-12-27 22:05:07,887][106225] Updated weights for policy 1, policy_version 398097 (0.0008) [2023-12-27 22:05:07,928][106226] Updated weights for policy 0, policy_version 397094 (0.0010) [2023-12-27 22:05:07,934][106225] Updated weights for policy 1, policy_version 398107 (0.0005) [2023-12-27 22:05:07,990][106225] Updated weights for policy 1, policy_version 398117 (0.0008) [2023-12-27 22:05:08,041][106225] Updated weights for policy 1, policy_version 398127 (0.0008) [2023-12-27 22:05:08,677][106226] Updated weights for policy 0, policy_version 397104 (0.0011) [2023-12-27 22:05:08,739][106226] Updated weights for policy 0, policy_version 397114 (0.0011) [2023-12-27 22:05:08,797][106226] Updated weights for policy 0, policy_version 397124 (0.0011) [2023-12-27 22:05:08,807][106225] Updated weights for policy 1, policy_version 398137 (0.0006) [2023-12-27 22:05:08,864][106225] Updated weights for policy 1, policy_version 398147 (0.0008) [2023-12-27 22:05:08,924][106225] Updated weights for policy 1, policy_version 398157 (0.0007) [2023-12-27 22:05:09,565][106226] Updated weights for policy 0, policy_version 397134 (0.0011) [2023-12-27 22:05:09,633][106226] Updated weights for policy 0, policy_version 397144 (0.0011) [2023-12-27 22:05:09,670][106225] Updated weights for policy 1, policy_version 398167 (0.0006) [2023-12-27 22:05:09,695][106226] Updated weights for policy 0, policy_version 397154 (0.0011) [2023-12-27 22:05:09,736][106225] Updated weights for policy 1, policy_version 398177 (0.0007) [2023-12-27 22:05:09,795][106225] Updated weights for policy 1, policy_version 398187 (0.0008) [2023-12-27 22:05:10,422][106226] Updated weights for policy 0, policy_version 397164 (0.0009) [2023-12-27 22:05:10,477][106226] Updated weights for policy 0, policy_version 397174 (0.0006) [2023-12-27 22:05:10,536][106226] Updated weights for policy 0, policy_version 397184 (0.0005) [2023-12-27 22:05:10,581][106225] Updated weights for policy 1, policy_version 398197 (0.0008) [2023-12-27 22:05:10,644][106225] Updated weights for policy 1, policy_version 398207 (0.0010) [2023-12-27 22:05:10,711][106225] Updated weights for policy 1, policy_version 398217 (0.0009) [2023-12-27 22:05:11,137][106226] Updated weights for policy 0, policy_version 397194 (0.0008) [2023-12-27 22:05:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19244.3). Total num frames: 203685888. Throughput: 0: 9714.5, 1: 9845.9. Samples: 203661364. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:11,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-6.129')] [2023-12-27 22:05:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000398224_101974016.pth... [2023-12-27 22:05:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000397072_101679104.pth [2023-12-27 22:05:11,202][106226] Updated weights for policy 0, policy_version 397204 (0.0009) [2023-12-27 22:05:11,274][106226] Updated weights for policy 0, policy_version 397214 (0.0008) [2023-12-27 22:05:11,345][106226] Updated weights for policy 0, policy_version 397224 (0.0008) [2023-12-27 22:05:11,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000397224_101720064.pth... [2023-12-27 22:05:11,352][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000396072_101425152.pth [2023-12-27 22:05:11,576][106225] Updated weights for policy 1, policy_version 398227 (0.0008) [2023-12-27 22:05:11,646][106225] Updated weights for policy 1, policy_version 398237 (0.0008) [2023-12-27 22:05:11,717][106225] Updated weights for policy 1, policy_version 398247 (0.0008) [2023-12-27 22:05:12,099][106226] Updated weights for policy 0, policy_version 397234 (0.0009) [2023-12-27 22:05:12,163][106226] Updated weights for policy 0, policy_version 397244 (0.0007) [2023-12-27 22:05:12,220][106226] Updated weights for policy 0, policy_version 397254 (0.0006) [2023-12-27 22:05:12,432][106225] Updated weights for policy 1, policy_version 398257 (0.0007) [2023-12-27 22:05:12,488][106225] Updated weights for policy 1, policy_version 398267 (0.0006) [2023-12-27 22:05:12,535][106225] Updated weights for policy 1, policy_version 398277 (0.0007) [2023-12-27 22:05:12,583][106225] Updated weights for policy 1, policy_version 398287 (0.0008) [2023-12-27 22:05:12,882][106226] Updated weights for policy 0, policy_version 397264 (0.0009) [2023-12-27 22:05:12,933][106226] Updated weights for policy 0, policy_version 397274 (0.0009) [2023-12-27 22:05:12,990][106226] Updated weights for policy 0, policy_version 397284 (0.0009) [2023-12-27 22:05:13,197][106225] Updated weights for policy 1, policy_version 398297 (0.0007) [2023-12-27 22:05:13,249][106225] Updated weights for policy 1, policy_version 398307 (0.0008) [2023-12-27 22:05:13,304][106225] Updated weights for policy 1, policy_version 398317 (0.0009) [2023-12-27 22:05:13,765][106226] Updated weights for policy 0, policy_version 397294 (0.0009) [2023-12-27 22:05:13,817][106226] Updated weights for policy 0, policy_version 397304 (0.0008) [2023-12-27 22:05:13,876][106226] Updated weights for policy 0, policy_version 397314 (0.0008) [2023-12-27 22:05:13,937][106225] Updated weights for policy 1, policy_version 398327 (0.0007) [2023-12-27 22:05:13,990][106225] Updated weights for policy 1, policy_version 398337 (0.0005) [2023-12-27 22:05:14,038][106225] Updated weights for policy 1, policy_version 398347 (0.0006) [2023-12-27 22:05:14,690][106226] Updated weights for policy 0, policy_version 397324 (0.0009) [2023-12-27 22:05:14,725][106225] Updated weights for policy 1, policy_version 398357 (0.0005) [2023-12-27 22:05:14,749][106226] Updated weights for policy 0, policy_version 397334 (0.0009) [2023-12-27 22:05:14,799][106225] Updated weights for policy 1, policy_version 398367 (0.0008) [2023-12-27 22:05:14,832][106226] Updated weights for policy 0, policy_version 397344 (0.0008) [2023-12-27 22:05:14,858][106225] Updated weights for policy 1, policy_version 398377 (0.0009) [2023-12-27 22:05:15,570][106225] Updated weights for policy 1, policy_version 398387 (0.0011) [2023-12-27 22:05:15,606][106226] Updated weights for policy 0, policy_version 397354 (0.0009) [2023-12-27 22:05:15,623][106225] Updated weights for policy 1, policy_version 398397 (0.0010) [2023-12-27 22:05:15,663][106226] Updated weights for policy 0, policy_version 397364 (0.0005) [2023-12-27 22:05:15,671][106225] Updated weights for policy 1, policy_version 398407 (0.0010) [2023-12-27 22:05:15,716][106226] Updated weights for policy 0, policy_version 397374 (0.0005) [2023-12-27 22:05:15,764][106226] Updated weights for policy 0, policy_version 397384 (0.0009) [2023-12-27 22:05:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19272.0). Total num frames: 203784192. Throughput: 0: 9622.8, 1: 9829.7. Samples: 203776072. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:16,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.850')] [2023-12-27 22:05:16,360][106225] Updated weights for policy 1, policy_version 398417 (0.0008) [2023-12-27 22:05:16,373][106226] Updated weights for policy 0, policy_version 397394 (0.0006) [2023-12-27 22:05:16,417][106225] Updated weights for policy 1, policy_version 398427 (0.0008) [2023-12-27 22:05:16,429][106226] Updated weights for policy 0, policy_version 397404 (0.0005) [2023-12-27 22:05:16,478][106226] Updated weights for policy 0, policy_version 397414 (0.0005) [2023-12-27 22:05:16,479][106225] Updated weights for policy 1, policy_version 398437 (0.0007) [2023-12-27 22:05:16,541][106225] Updated weights for policy 1, policy_version 398447 (0.0005) [2023-12-27 22:05:17,009][106226] Updated weights for policy 0, policy_version 397424 (0.0005) [2023-12-27 22:05:17,065][106226] Updated weights for policy 0, policy_version 397434 (0.0005) [2023-12-27 22:05:17,119][106226] Updated weights for policy 0, policy_version 397444 (0.0008) [2023-12-27 22:05:17,154][106225] Updated weights for policy 1, policy_version 398457 (0.0010) [2023-12-27 22:05:17,211][106225] Updated weights for policy 1, policy_version 398467 (0.0010) [2023-12-27 22:05:17,268][106225] Updated weights for policy 1, policy_version 398477 (0.0010) [2023-12-27 22:05:17,802][106226] Updated weights for policy 0, policy_version 397454 (0.0009) [2023-12-27 22:05:17,856][106226] Updated weights for policy 0, policy_version 397464 (0.0008) [2023-12-27 22:05:17,915][106226] Updated weights for policy 0, policy_version 397474 (0.0009) [2023-12-27 22:05:17,998][106225] Updated weights for policy 1, policy_version 398487 (0.0008) [2023-12-27 22:05:18,066][106225] Updated weights for policy 1, policy_version 398497 (0.0005) [2023-12-27 22:05:18,137][106225] Updated weights for policy 1, policy_version 398507 (0.0005) [2023-12-27 22:05:18,667][106226] Updated weights for policy 0, policy_version 397484 (0.0008) [2023-12-27 22:05:18,734][106226] Updated weights for policy 0, policy_version 397494 (0.0006) [2023-12-27 22:05:18,741][106225] Updated weights for policy 1, policy_version 398517 (0.0007) [2023-12-27 22:05:18,798][106226] Updated weights for policy 0, policy_version 397504 (0.0006) [2023-12-27 22:05:18,801][106225] Updated weights for policy 1, policy_version 398527 (0.0008) [2023-12-27 22:05:18,858][106225] Updated weights for policy 1, policy_version 398537 (0.0008) [2023-12-27 22:05:19,429][106226] Updated weights for policy 0, policy_version 397514 (0.0006) [2023-12-27 22:05:19,497][106226] Updated weights for policy 0, policy_version 397524 (0.0008) [2023-12-27 22:05:19,563][106226] Updated weights for policy 0, policy_version 397534 (0.0008) [2023-12-27 22:05:19,625][106226] Updated weights for policy 0, policy_version 397544 (0.0009) [2023-12-27 22:05:19,649][106225] Updated weights for policy 1, policy_version 398547 (0.0008) [2023-12-27 22:05:19,709][106225] Updated weights for policy 1, policy_version 398557 (0.0008) [2023-12-27 22:05:19,771][106225] Updated weights for policy 1, policy_version 398567 (0.0010) [2023-12-27 22:05:20,341][106226] Updated weights for policy 0, policy_version 397554 (0.0007) [2023-12-27 22:05:20,403][106226] Updated weights for policy 0, policy_version 397564 (0.0008) [2023-12-27 22:05:20,463][106226] Updated weights for policy 0, policy_version 397574 (0.0009) [2023-12-27 22:05:20,552][106225] Updated weights for policy 1, policy_version 398577 (0.0009) [2023-12-27 22:05:20,620][106225] Updated weights for policy 1, policy_version 398587 (0.0008) [2023-12-27 22:05:20,688][106225] Updated weights for policy 1, policy_version 398597 (0.0009) [2023-12-27 22:05:20,749][106225] Updated weights for policy 1, policy_version 398607 (0.0008) [2023-12-27 22:05:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19272.0). Total num frames: 203882496. Throughput: 0: 9697.1, 1: 9814.2. Samples: 203896320. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:21,175][105115] Avg episode reward: [(0, '-4.977'), (1, '-6.021')] [2023-12-27 22:05:21,228][106226] Updated weights for policy 0, policy_version 397584 (0.0008) [2023-12-27 22:05:21,290][106226] Updated weights for policy 0, policy_version 397594 (0.0007) [2023-12-27 22:05:21,351][106226] Updated weights for policy 0, policy_version 397604 (0.0008) [2023-12-27 22:05:21,554][106225] Updated weights for policy 1, policy_version 398617 (0.0010) [2023-12-27 22:05:21,609][106225] Updated weights for policy 1, policy_version 398627 (0.0010) [2023-12-27 22:05:21,678][106225] Updated weights for policy 1, policy_version 398637 (0.0010) [2023-12-27 22:05:22,150][106226] Updated weights for policy 0, policy_version 397614 (0.0009) [2023-12-27 22:05:22,213][106226] Updated weights for policy 0, policy_version 397624 (0.0011) [2023-12-27 22:05:22,284][106226] Updated weights for policy 0, policy_version 397634 (0.0011) [2023-12-27 22:05:22,444][106225] Updated weights for policy 1, policy_version 398647 (0.0009) [2023-12-27 22:05:22,503][106225] Updated weights for policy 1, policy_version 398657 (0.0008) [2023-12-27 22:05:22,567][106225] Updated weights for policy 1, policy_version 398667 (0.0006) [2023-12-27 22:05:23,028][106226] Updated weights for policy 0, policy_version 397644 (0.0009) [2023-12-27 22:05:23,092][106226] Updated weights for policy 0, policy_version 397654 (0.0011) [2023-12-27 22:05:23,146][106226] Updated weights for policy 0, policy_version 397664 (0.0011) [2023-12-27 22:05:23,266][106225] Updated weights for policy 1, policy_version 398677 (0.0008) [2023-12-27 22:05:23,318][106225] Updated weights for policy 1, policy_version 398687 (0.0008) [2023-12-27 22:05:23,375][106225] Updated weights for policy 1, policy_version 398697 (0.0008) [2023-12-27 22:05:23,864][106226] Updated weights for policy 0, policy_version 397674 (0.0011) [2023-12-27 22:05:23,925][106226] Updated weights for policy 0, policy_version 397684 (0.0011) [2023-12-27 22:05:23,983][106226] Updated weights for policy 0, policy_version 397694 (0.0011) [2023-12-27 22:05:24,048][106226] Updated weights for policy 0, policy_version 397704 (0.0011) [2023-12-27 22:05:24,136][106225] Updated weights for policy 1, policy_version 398707 (0.0007) [2023-12-27 22:05:24,197][106225] Updated weights for policy 1, policy_version 398717 (0.0008) [2023-12-27 22:05:24,252][106225] Updated weights for policy 1, policy_version 398727 (0.0007) [2023-12-27 22:05:24,732][106226] Updated weights for policy 0, policy_version 397714 (0.0010) [2023-12-27 22:05:24,779][106226] Updated weights for policy 0, policy_version 397724 (0.0010) [2023-12-27 22:05:24,827][106226] Updated weights for policy 0, policy_version 397734 (0.0008) [2023-12-27 22:05:25,011][106225] Updated weights for policy 1, policy_version 398737 (0.0008) [2023-12-27 22:05:25,062][106225] Updated weights for policy 1, policy_version 398747 (0.0009) [2023-12-27 22:05:25,114][106225] Updated weights for policy 1, policy_version 398757 (0.0008) [2023-12-27 22:05:25,163][106225] Updated weights for policy 1, policy_version 398767 (0.0010) [2023-12-27 22:05:25,447][106226] Updated weights for policy 0, policy_version 397744 (0.0006) [2023-12-27 22:05:25,498][106226] Updated weights for policy 0, policy_version 397754 (0.0005) [2023-12-27 22:05:25,546][106226] Updated weights for policy 0, policy_version 397764 (0.0005) [2023-12-27 22:05:25,848][106225] Updated weights for policy 1, policy_version 398777 (0.0008) [2023-12-27 22:05:25,913][106225] Updated weights for policy 1, policy_version 398787 (0.0009) [2023-12-27 22:05:25,981][106225] Updated weights for policy 1, policy_version 398797 (0.0009) [2023-12-27 22:05:26,139][106226] Updated weights for policy 0, policy_version 397774 (0.0008) [2023-12-27 22:05:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19272.0). Total num frames: 203980800. Throughput: 0: 9660.4, 1: 9772.7. Samples: 203951324. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:26,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-6.160')] [2023-12-27 22:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000398800_102121472.pth... [2023-12-27 22:05:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000397680_101834752.pth [2023-12-27 22:05:26,192][106226] Updated weights for policy 0, policy_version 397784 (0.0011) [2023-12-27 22:05:26,252][106226] Updated weights for policy 0, policy_version 397794 (0.0010) [2023-12-27 22:05:26,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000397800_101867520.pth... [2023-12-27 22:05:26,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000396648_101572608.pth [2023-12-27 22:05:26,680][106225] Updated weights for policy 1, policy_version 398807 (0.0010) [2023-12-27 22:05:26,736][106225] Updated weights for policy 1, policy_version 398817 (0.0010) [2023-12-27 22:05:26,786][106225] Updated weights for policy 1, policy_version 398827 (0.0010) [2023-12-27 22:05:26,909][106226] Updated weights for policy 0, policy_version 397804 (0.0008) [2023-12-27 22:05:26,974][106226] Updated weights for policy 0, policy_version 397814 (0.0007) [2023-12-27 22:05:27,041][106226] Updated weights for policy 0, policy_version 397824 (0.0005) [2023-12-27 22:05:27,383][106225] Updated weights for policy 1, policy_version 398837 (0.0010) [2023-12-27 22:05:27,436][106225] Updated weights for policy 1, policy_version 398847 (0.0010) [2023-12-27 22:05:27,482][106225] Updated weights for policy 1, policy_version 398857 (0.0010) [2023-12-27 22:05:27,586][106226] Updated weights for policy 0, policy_version 397834 (0.0005) [2023-12-27 22:05:27,641][106226] Updated weights for policy 0, policy_version 397844 (0.0005) [2023-12-27 22:05:27,694][106226] Updated weights for policy 0, policy_version 397854 (0.0005) [2023-12-27 22:05:27,753][106226] Updated weights for policy 0, policy_version 397864 (0.0005) [2023-12-27 22:05:28,208][106225] Updated weights for policy 1, policy_version 398867 (0.0010) [2023-12-27 22:05:28,258][106225] Updated weights for policy 1, policy_version 398877 (0.0010) [2023-12-27 22:05:28,321][106225] Updated weights for policy 1, policy_version 398887 (0.0010) [2023-12-27 22:05:28,393][106226] Updated weights for policy 0, policy_version 397874 (0.0007) [2023-12-27 22:05:28,453][106226] Updated weights for policy 0, policy_version 397884 (0.0007) [2023-12-27 22:05:28,513][106226] Updated weights for policy 0, policy_version 397894 (0.0007) [2023-12-27 22:05:29,043][106225] Updated weights for policy 1, policy_version 398897 (0.0009) [2023-12-27 22:05:29,111][106225] Updated weights for policy 1, policy_version 398907 (0.0005) [2023-12-27 22:05:29,175][106225] Updated weights for policy 1, policy_version 398917 (0.0005) [2023-12-27 22:05:29,192][106226] Updated weights for policy 0, policy_version 397904 (0.0006) [2023-12-27 22:05:29,234][106225] Updated weights for policy 1, policy_version 398927 (0.0006) [2023-12-27 22:05:29,265][106226] Updated weights for policy 0, policy_version 397914 (0.0007) [2023-12-27 22:05:29,359][106226] Updated weights for policy 0, policy_version 397924 (0.0006) [2023-12-27 22:05:29,879][106225] Updated weights for policy 1, policy_version 398937 (0.0010) [2023-12-27 22:05:29,936][106225] Updated weights for policy 1, policy_version 398947 (0.0009) [2023-12-27 22:05:30,002][106225] Updated weights for policy 1, policy_version 398957 (0.0008) [2023-12-27 22:05:30,021][106226] Updated weights for policy 0, policy_version 397934 (0.0008) [2023-12-27 22:05:30,082][106226] Updated weights for policy 0, policy_version 397944 (0.0006) [2023-12-27 22:05:30,135][106226] Updated weights for policy 0, policy_version 397954 (0.0007) [2023-12-27 22:05:30,698][106225] Updated weights for policy 1, policy_version 398967 (0.0008) [2023-12-27 22:05:30,752][106225] Updated weights for policy 1, policy_version 398977 (0.0009) [2023-12-27 22:05:30,788][106226] Updated weights for policy 0, policy_version 397964 (0.0009) [2023-12-27 22:05:30,802][106225] Updated weights for policy 1, policy_version 398987 (0.0008) [2023-12-27 22:05:30,853][106226] Updated weights for policy 0, policy_version 397974 (0.0009) [2023-12-27 22:05:30,901][106226] Updated weights for policy 0, policy_version 397984 (0.0008) [2023-12-27 22:05:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19327.6). Total num frames: 204087296. Throughput: 0: 9822.6, 1: 9846.6. Samples: 204075500. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-27 22:05:31,175][105115] Avg episode reward: [(0, '-4.994'), (1, '-6.070')] [2023-12-27 22:05:31,583][106225] Updated weights for policy 1, policy_version 398997 (0.0007) [2023-12-27 22:05:31,650][106225] Updated weights for policy 1, policy_version 399007 (0.0008) [2023-12-27 22:05:31,684][106226] Updated weights for policy 0, policy_version 397994 (0.0008) [2023-12-27 22:05:31,708][106225] Updated weights for policy 1, policy_version 399017 (0.0006) [2023-12-27 22:05:31,746][106226] Updated weights for policy 0, policy_version 398004 (0.0008) [2023-12-27 22:05:31,807][106226] Updated weights for policy 0, policy_version 398014 (0.0008) [2023-12-27 22:05:31,867][106226] Updated weights for policy 0, policy_version 398024 (0.0006) [2023-12-27 22:05:32,413][106225] Updated weights for policy 1, policy_version 399027 (0.0008) [2023-12-27 22:05:32,464][106225] Updated weights for policy 1, policy_version 399037 (0.0008) [2023-12-27 22:05:32,527][106225] Updated weights for policy 1, policy_version 399047 (0.0007) [2023-12-27 22:05:32,591][106226] Updated weights for policy 0, policy_version 398034 (0.0008) [2023-12-27 22:05:32,649][106226] Updated weights for policy 0, policy_version 398044 (0.0009) [2023-12-27 22:05:32,705][106226] Updated weights for policy 0, policy_version 398054 (0.0009) [2023-12-27 22:05:33,228][106225] Updated weights for policy 1, policy_version 399057 (0.0007) [2023-12-27 22:05:33,287][106225] Updated weights for policy 1, policy_version 399067 (0.0008) [2023-12-27 22:05:33,343][106225] Updated weights for policy 1, policy_version 399077 (0.0008) [2023-12-27 22:05:33,389][106225] Updated weights for policy 1, policy_version 399087 (0.0008) [2023-12-27 22:05:33,437][106226] Updated weights for policy 0, policy_version 398064 (0.0010) [2023-12-27 22:05:33,486][106226] Updated weights for policy 0, policy_version 398074 (0.0010) [2023-12-27 22:05:33,533][106226] Updated weights for policy 0, policy_version 398084 (0.0010) [2023-12-27 22:05:34,133][106225] Updated weights for policy 1, policy_version 399097 (0.0008) [2023-12-27 22:05:34,204][106225] Updated weights for policy 1, policy_version 399107 (0.0008) [2023-12-27 22:05:34,217][106226] Updated weights for policy 0, policy_version 398094 (0.0009) [2023-12-27 22:05:34,275][106225] Updated weights for policy 1, policy_version 399117 (0.0007) [2023-12-27 22:05:34,285][106226] Updated weights for policy 0, policy_version 398104 (0.0008) [2023-12-27 22:05:34,352][106226] Updated weights for policy 0, policy_version 398114 (0.0008) [2023-12-27 22:05:34,866][106225] Updated weights for policy 1, policy_version 399127 (0.0008) [2023-12-27 22:05:34,919][106225] Updated weights for policy 1, policy_version 399137 (0.0007) [2023-12-27 22:05:34,973][106225] Updated weights for policy 1, policy_version 399147 (0.0007) [2023-12-27 22:05:35,002][106226] Updated weights for policy 0, policy_version 398124 (0.0009) [2023-12-27 22:05:35,057][106226] Updated weights for policy 0, policy_version 398134 (0.0007) [2023-12-27 22:05:35,109][106226] Updated weights for policy 0, policy_version 398144 (0.0008) [2023-12-27 22:05:35,657][106225] Updated weights for policy 1, policy_version 399157 (0.0007) [2023-12-27 22:05:35,720][106225] Updated weights for policy 1, policy_version 399167 (0.0007) [2023-12-27 22:05:35,778][106225] Updated weights for policy 1, policy_version 399177 (0.0007) [2023-12-27 22:05:35,784][106226] Updated weights for policy 0, policy_version 398154 (0.0006) [2023-12-27 22:05:35,839][106226] Updated weights for policy 0, policy_version 398164 (0.0008) [2023-12-27 22:05:35,901][106226] Updated weights for policy 0, policy_version 398174 (0.0008) [2023-12-27 22:05:35,964][106226] Updated weights for policy 0, policy_version 398184 (0.0008) [2023-12-27 22:05:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19327.6). Total num frames: 204185600. Throughput: 0: 9775.3, 1: 9799.3. Samples: 204193428. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:05:36,175][105115] Avg episode reward: [(0, '-5.083'), (1, '-5.979')] [2023-12-27 22:05:36,497][106225] Updated weights for policy 1, policy_version 399187 (0.0007) [2023-12-27 22:05:36,567][106225] Updated weights for policy 1, policy_version 399197 (0.0011) [2023-12-27 22:05:36,639][106225] Updated weights for policy 1, policy_version 399207 (0.0011) [2023-12-27 22:05:36,724][106226] Updated weights for policy 0, policy_version 398194 (0.0007) [2023-12-27 22:05:36,789][106226] Updated weights for policy 0, policy_version 398204 (0.0008) [2023-12-27 22:05:36,850][106226] Updated weights for policy 0, policy_version 398214 (0.0008) [2023-12-27 22:05:37,381][106225] Updated weights for policy 1, policy_version 399217 (0.0011) [2023-12-27 22:05:37,445][106225] Updated weights for policy 1, policy_version 399227 (0.0010) [2023-12-27 22:05:37,507][106225] Updated weights for policy 1, policy_version 399237 (0.0011) [2023-12-27 22:05:37,572][106225] Updated weights for policy 1, policy_version 399247 (0.0011) [2023-12-27 22:05:37,585][106226] Updated weights for policy 0, policy_version 398224 (0.0009) [2023-12-27 22:05:37,647][106226] Updated weights for policy 0, policy_version 398234 (0.0008) [2023-12-27 22:05:37,703][106226] Updated weights for policy 0, policy_version 398244 (0.0008) [2023-12-27 22:05:38,289][106225] Updated weights for policy 1, policy_version 399257 (0.0010) [2023-12-27 22:05:38,349][106225] Updated weights for policy 1, policy_version 399267 (0.0010) [2023-12-27 22:05:38,410][106225] Updated weights for policy 1, policy_version 399277 (0.0010) [2023-12-27 22:05:38,440][106226] Updated weights for policy 0, policy_version 398254 (0.0007) [2023-12-27 22:05:38,508][106226] Updated weights for policy 0, policy_version 398264 (0.0008) [2023-12-27 22:05:38,569][106226] Updated weights for policy 0, policy_version 398274 (0.0008) [2023-12-27 22:05:39,130][106225] Updated weights for policy 1, policy_version 399287 (0.0011) [2023-12-27 22:05:39,184][106225] Updated weights for policy 1, policy_version 399297 (0.0010) [2023-12-27 22:05:39,254][106225] Updated weights for policy 1, policy_version 399307 (0.0009) [2023-12-27 22:05:39,311][106226] Updated weights for policy 0, policy_version 398284 (0.0008) [2023-12-27 22:05:39,379][106226] Updated weights for policy 0, policy_version 398294 (0.0009) [2023-12-27 22:05:39,455][106226] Updated weights for policy 0, policy_version 398304 (0.0008) [2023-12-27 22:05:40,072][106225] Updated weights for policy 1, policy_version 399317 (0.0009) [2023-12-27 22:05:40,137][106225] Updated weights for policy 1, policy_version 399327 (0.0009) [2023-12-27 22:05:40,201][106225] Updated weights for policy 1, policy_version 399337 (0.0008) [2023-12-27 22:05:40,211][106226] Updated weights for policy 0, policy_version 398314 (0.0008) [2023-12-27 22:05:40,269][106226] Updated weights for policy 0, policy_version 398324 (0.0007) [2023-12-27 22:05:40,326][106226] Updated weights for policy 0, policy_version 398334 (0.0009) [2023-12-27 22:05:40,388][106226] Updated weights for policy 0, policy_version 398344 (0.0007) [2023-12-27 22:05:40,895][106225] Updated weights for policy 1, policy_version 399347 (0.0007) [2023-12-27 22:05:40,957][106225] Updated weights for policy 1, policy_version 399357 (0.0011) [2023-12-27 22:05:41,032][106225] Updated weights for policy 1, policy_version 399367 (0.0007) [2023-12-27 22:05:41,150][106226] Updated weights for policy 0, policy_version 398354 (0.0006) [2023-12-27 22:05:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19327.6). Total num frames: 204275712. Throughput: 0: 9762.6, 1: 9798.7. Samples: 204249208. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:05:41,175][105115] Avg episode reward: [(0, '-5.193'), (1, '-5.905')] [2023-12-27 22:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000399376_102268928.pth... [2023-12-27 22:05:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000398224_101974016.pth [2023-12-27 22:05:41,216][106226] Updated weights for policy 0, policy_version 398364 (0.0008) [2023-12-27 22:05:41,287][106226] Updated weights for policy 0, policy_version 398374 (0.0008) [2023-12-27 22:05:41,300][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000398376_102014976.pth... [2023-12-27 22:05:41,303][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000397224_101720064.pth [2023-12-27 22:05:41,830][106225] Updated weights for policy 1, policy_version 399377 (0.0009) [2023-12-27 22:05:41,894][106225] Updated weights for policy 1, policy_version 399387 (0.0008) [2023-12-27 22:05:41,958][106225] Updated weights for policy 1, policy_version 399397 (0.0008) [2023-12-27 22:05:42,021][106225] Updated weights for policy 1, policy_version 399407 (0.0008) [2023-12-27 22:05:42,136][106226] Updated weights for policy 0, policy_version 398384 (0.0007) [2023-12-27 22:05:42,203][106226] Updated weights for policy 0, policy_version 398394 (0.0008) [2023-12-27 22:05:42,265][106226] Updated weights for policy 0, policy_version 398404 (0.0009) [2023-12-27 22:05:42,779][106225] Updated weights for policy 1, policy_version 399417 (0.0009) [2023-12-27 22:05:42,831][106225] Updated weights for policy 1, policy_version 399427 (0.0010) [2023-12-27 22:05:42,888][106225] Updated weights for policy 1, policy_version 399437 (0.0008) [2023-12-27 22:05:42,921][106226] Updated weights for policy 0, policy_version 398414 (0.0008) [2023-12-27 22:05:42,982][106226] Updated weights for policy 0, policy_version 398424 (0.0006) [2023-12-27 22:05:43,042][106226] Updated weights for policy 0, policy_version 398434 (0.0006) [2023-12-27 22:05:43,612][106225] Updated weights for policy 1, policy_version 399447 (0.0010) [2023-12-27 22:05:43,678][106225] Updated weights for policy 1, policy_version 399457 (0.0010) [2023-12-27 22:05:43,687][106226] Updated weights for policy 0, policy_version 398444 (0.0006) [2023-12-27 22:05:43,737][106226] Updated weights for policy 0, policy_version 398454 (0.0006) [2023-12-27 22:05:43,742][106225] Updated weights for policy 1, policy_version 399467 (0.0010) [2023-12-27 22:05:43,788][106226] Updated weights for policy 0, policy_version 398464 (0.0006) [2023-12-27 22:05:44,407][106225] Updated weights for policy 1, policy_version 399477 (0.0010) [2023-12-27 22:05:44,417][106226] Updated weights for policy 0, policy_version 398474 (0.0005) [2023-12-27 22:05:44,468][106225] Updated weights for policy 1, policy_version 399487 (0.0011) [2023-12-27 22:05:44,471][106226] Updated weights for policy 0, policy_version 398484 (0.0005) [2023-12-27 22:05:44,518][106225] Updated weights for policy 1, policy_version 399497 (0.0008) [2023-12-27 22:05:44,523][106226] Updated weights for policy 0, policy_version 398494 (0.0008) [2023-12-27 22:05:44,590][106226] Updated weights for policy 0, policy_version 398504 (0.0006) [2023-12-27 22:05:45,276][106225] Updated weights for policy 1, policy_version 399507 (0.0007) [2023-12-27 22:05:45,342][106225] Updated weights for policy 1, policy_version 399517 (0.0007) [2023-12-27 22:05:45,380][106226] Updated weights for policy 0, policy_version 398514 (0.0009) [2023-12-27 22:05:45,402][106225] Updated weights for policy 1, policy_version 399527 (0.0007) [2023-12-27 22:05:45,441][106226] Updated weights for policy 0, policy_version 398524 (0.0006) [2023-12-27 22:05:45,492][106226] Updated weights for policy 0, policy_version 398534 (0.0008) [2023-12-27 22:05:46,082][106225] Updated weights for policy 1, policy_version 399537 (0.0007) [2023-12-27 22:05:46,132][106226] Updated weights for policy 0, policy_version 398544 (0.0007) [2023-12-27 22:05:46,142][106225] Updated weights for policy 1, policy_version 399547 (0.0006) [2023-12-27 22:05:46,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19387.7, 300 sec: 19327.6). Total num frames: 204365824. Throughput: 0: 9755.5, 1: 9721.2. Samples: 204362976. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:05:46,175][105115] Avg episode reward: [(0, '-4.985'), (1, '-5.781')] [2023-12-27 22:05:46,195][106226] Updated weights for policy 0, policy_version 398554 (0.0008) [2023-12-27 22:05:46,201][106225] Updated weights for policy 1, policy_version 399557 (0.0006) [2023-12-27 22:05:46,247][106226] Updated weights for policy 0, policy_version 398564 (0.0007) [2023-12-27 22:05:46,253][106225] Updated weights for policy 1, policy_version 399567 (0.0006) [2023-12-27 22:05:46,915][106225] Updated weights for policy 1, policy_version 399577 (0.0005) [2023-12-27 22:05:46,968][106225] Updated weights for policy 1, policy_version 399587 (0.0005) [2023-12-27 22:05:46,978][106226] Updated weights for policy 0, policy_version 398574 (0.0008) [2023-12-27 22:05:47,033][106225] Updated weights for policy 1, policy_version 399597 (0.0005) [2023-12-27 22:05:47,040][106226] Updated weights for policy 0, policy_version 398584 (0.0008) [2023-12-27 22:05:47,100][106226] Updated weights for policy 0, policy_version 398594 (0.0006) [2023-12-27 22:05:47,692][106226] Updated weights for policy 0, policy_version 398604 (0.0006) [2023-12-27 22:05:47,724][106225] Updated weights for policy 1, policy_version 399607 (0.0006) [2023-12-27 22:05:47,749][106226] Updated weights for policy 0, policy_version 398614 (0.0007) [2023-12-27 22:05:47,775][106225] Updated weights for policy 1, policy_version 399617 (0.0005) [2023-12-27 22:05:47,804][106226] Updated weights for policy 0, policy_version 398624 (0.0006) [2023-12-27 22:05:47,826][106225] Updated weights for policy 1, policy_version 399627 (0.0006) [2023-12-27 22:05:48,501][106225] Updated weights for policy 1, policy_version 399637 (0.0009) [2023-12-27 22:05:48,562][106226] Updated weights for policy 0, policy_version 398634 (0.0006) [2023-12-27 22:05:48,562][106225] Updated weights for policy 1, policy_version 399647 (0.0011) [2023-12-27 22:05:48,620][106225] Updated weights for policy 1, policy_version 399657 (0.0011) [2023-12-27 22:05:48,622][106226] Updated weights for policy 0, policy_version 398644 (0.0006) [2023-12-27 22:05:48,686][106226] Updated weights for policy 0, policy_version 398654 (0.0007) [2023-12-27 22:05:48,750][106226] Updated weights for policy 0, policy_version 398664 (0.0008) [2023-12-27 22:05:49,360][106225] Updated weights for policy 1, policy_version 399667 (0.0010) [2023-12-27 22:05:49,426][106225] Updated weights for policy 1, policy_version 399677 (0.0009) [2023-12-27 22:05:49,432][106226] Updated weights for policy 0, policy_version 398674 (0.0008) [2023-12-27 22:05:49,488][106226] Updated weights for policy 0, policy_version 398684 (0.0006) [2023-12-27 22:05:49,489][106225] Updated weights for policy 1, policy_version 399687 (0.0010) [2023-12-27 22:05:49,546][106226] Updated weights for policy 0, policy_version 398694 (0.0006) [2023-12-27 22:05:50,228][106225] Updated weights for policy 1, policy_version 399697 (0.0010) [2023-12-27 22:05:50,285][106226] Updated weights for policy 0, policy_version 398704 (0.0006) [2023-12-27 22:05:50,285][106225] Updated weights for policy 1, policy_version 399707 (0.0008) [2023-12-27 22:05:50,340][106225] Updated weights for policy 1, policy_version 399717 (0.0008) [2023-12-27 22:05:50,343][106226] Updated weights for policy 0, policy_version 398714 (0.0008) [2023-12-27 22:05:50,400][106225] Updated weights for policy 1, policy_version 399727 (0.0009) [2023-12-27 22:05:50,403][106226] Updated weights for policy 0, policy_version 398724 (0.0009) [2023-12-27 22:05:51,081][106225] Updated weights for policy 1, policy_version 399737 (0.0008) [2023-12-27 22:05:51,145][106225] Updated weights for policy 1, policy_version 399747 (0.0007) [2023-12-27 22:05:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19387.7, 300 sec: 19327.6). Total num frames: 204464128. Throughput: 0: 9792.2, 1: 9697.5. Samples: 204480220. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:05:51,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-6.053')] [2023-12-27 22:05:51,210][106225] Updated weights for policy 1, policy_version 399757 (0.0008) [2023-12-27 22:05:51,227][106226] Updated weights for policy 0, policy_version 398734 (0.0008) [2023-12-27 22:05:51,295][106226] Updated weights for policy 0, policy_version 398744 (0.0006) [2023-12-27 22:05:51,370][106226] Updated weights for policy 0, policy_version 398754 (0.0007) [2023-12-27 22:05:51,970][106225] Updated weights for policy 1, policy_version 399767 (0.0007) [2023-12-27 22:05:52,033][106225] Updated weights for policy 1, policy_version 399777 (0.0006) [2023-12-27 22:05:52,071][106226] Updated weights for policy 0, policy_version 398764 (0.0008) [2023-12-27 22:05:52,092][106225] Updated weights for policy 1, policy_version 399787 (0.0007) [2023-12-27 22:05:52,146][106226] Updated weights for policy 0, policy_version 398774 (0.0007) [2023-12-27 22:05:52,222][106226] Updated weights for policy 0, policy_version 398784 (0.0007) [2023-12-27 22:05:52,772][106225] Updated weights for policy 1, policy_version 399797 (0.0008) [2023-12-27 22:05:52,826][106225] Updated weights for policy 1, policy_version 399807 (0.0009) [2023-12-27 22:05:52,877][106225] Updated weights for policy 1, policy_version 399817 (0.0010) [2023-12-27 22:05:52,901][106226] Updated weights for policy 0, policy_version 398794 (0.0007) [2023-12-27 22:05:52,965][106226] Updated weights for policy 0, policy_version 398804 (0.0007) [2023-12-27 22:05:53,023][106226] Updated weights for policy 0, policy_version 398814 (0.0008) [2023-12-27 22:05:53,082][106226] Updated weights for policy 0, policy_version 398824 (0.0008) [2023-12-27 22:05:53,627][106225] Updated weights for policy 1, policy_version 399827 (0.0007) [2023-12-27 22:05:53,680][106225] Updated weights for policy 1, policy_version 399837 (0.0008) [2023-12-27 22:05:53,741][106225] Updated weights for policy 1, policy_version 399847 (0.0008) [2023-12-27 22:05:53,813][106226] Updated weights for policy 0, policy_version 398834 (0.0010) [2023-12-27 22:05:53,866][106226] Updated weights for policy 0, policy_version 398844 (0.0010) [2023-12-27 22:05:53,921][106226] Updated weights for policy 0, policy_version 398854 (0.0010) [2023-12-27 22:05:54,485][106225] Updated weights for policy 1, policy_version 399857 (0.0006) [2023-12-27 22:05:54,540][106225] Updated weights for policy 1, policy_version 399867 (0.0008) [2023-12-27 22:05:54,605][106225] Updated weights for policy 1, policy_version 399877 (0.0008) [2023-12-27 22:05:54,652][106226] Updated weights for policy 0, policy_version 398864 (0.0011) [2023-12-27 22:05:54,661][106225] Updated weights for policy 1, policy_version 399887 (0.0006) [2023-12-27 22:05:54,713][106226] Updated weights for policy 0, policy_version 398874 (0.0010) [2023-12-27 22:05:54,775][106226] Updated weights for policy 0, policy_version 398884 (0.0006) [2023-12-27 22:05:55,423][106225] Updated weights for policy 1, policy_version 399897 (0.0007) [2023-12-27 22:05:55,458][106226] Updated weights for policy 0, policy_version 398894 (0.0009) [2023-12-27 22:05:55,476][106225] Updated weights for policy 1, policy_version 399907 (0.0007) [2023-12-27 22:05:55,512][106226] Updated weights for policy 0, policy_version 398904 (0.0011) [2023-12-27 22:05:55,529][106225] Updated weights for policy 1, policy_version 399917 (0.0007) [2023-12-27 22:05:55,569][106226] Updated weights for policy 0, policy_version 398914 (0.0008) [2023-12-27 22:05:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.8, 300 sec: 19383.1). Total num frames: 204562432. Throughput: 0: 9811.0, 1: 9671.3. Samples: 204538068. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:05:56,175][106226] Updated weights for policy 0, policy_version 398924 (0.0008) [2023-12-27 22:05:56,176][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.517')] [2023-12-27 22:05:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000399920_102408192.pth... [2023-12-27 22:05:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000398800_102121472.pth [2023-12-27 22:05:56,233][106226] Updated weights for policy 0, policy_version 398934 (0.0011) [2023-12-27 22:05:56,283][106226] Updated weights for policy 0, policy_version 398944 (0.0010) [2023-12-27 22:05:56,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000398952_102162432.pth... [2023-12-27 22:05:56,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000397800_101867520.pth [2023-12-27 22:05:56,330][106225] Updated weights for policy 1, policy_version 399927 (0.0006) [2023-12-27 22:05:56,392][106225] Updated weights for policy 1, policy_version 399937 (0.0010) [2023-12-27 22:05:56,453][106225] Updated weights for policy 1, policy_version 399947 (0.0010) [2023-12-27 22:05:56,936][106226] Updated weights for policy 0, policy_version 398954 (0.0010) [2023-12-27 22:05:56,990][106226] Updated weights for policy 0, policy_version 398964 (0.0005) [2023-12-27 22:05:57,043][106226] Updated weights for policy 0, policy_version 398974 (0.0005) [2023-12-27 22:05:57,098][106226] Updated weights for policy 0, policy_version 398984 (0.0005) [2023-12-27 22:05:57,134][106225] Updated weights for policy 1, policy_version 399957 (0.0009) [2023-12-27 22:05:57,198][106225] Updated weights for policy 1, policy_version 399967 (0.0005) [2023-12-27 22:05:57,262][106225] Updated weights for policy 1, policy_version 399977 (0.0006) [2023-12-27 22:05:57,706][106226] Updated weights for policy 0, policy_version 398994 (0.0009) [2023-12-27 22:05:57,767][106226] Updated weights for policy 0, policy_version 399004 (0.0008) [2023-12-27 22:05:57,828][106226] Updated weights for policy 0, policy_version 399014 (0.0008) [2023-12-27 22:05:57,898][106225] Updated weights for policy 1, policy_version 399987 (0.0010) [2023-12-27 22:05:57,961][106225] Updated weights for policy 1, policy_version 399997 (0.0010) [2023-12-27 22:05:58,020][106225] Updated weights for policy 1, policy_version 400007 (0.0010) [2023-12-27 22:05:58,521][106226] Updated weights for policy 0, policy_version 399024 (0.0008) [2023-12-27 22:05:58,579][106226] Updated weights for policy 0, policy_version 399034 (0.0008) [2023-12-27 22:05:58,644][106226] Updated weights for policy 0, policy_version 399044 (0.0009) [2023-12-27 22:05:58,776][106225] Updated weights for policy 1, policy_version 400017 (0.0010) [2023-12-27 22:05:58,855][106225] Updated weights for policy 1, policy_version 400028 (0.0009) [2023-12-27 22:05:58,924][106225] Updated weights for policy 1, policy_version 400038 (0.0009) [2023-12-27 22:05:58,982][106225] Updated weights for policy 1, policy_version 400048 (0.0010) [2023-12-27 22:05:59,500][106226] Updated weights for policy 0, policy_version 399055 (0.0007) [2023-12-27 22:05:59,569][106226] Updated weights for policy 0, policy_version 399065 (0.0008) [2023-12-27 22:05:59,633][106226] Updated weights for policy 0, policy_version 399075 (0.0007) [2023-12-27 22:05:59,756][106225] Updated weights for policy 1, policy_version 400058 (0.0009) [2023-12-27 22:05:59,811][106225] Updated weights for policy 1, policy_version 400068 (0.0009) [2023-12-27 22:05:59,877][106225] Updated weights for policy 1, policy_version 400078 (0.0009) [2023-12-27 22:06:00,184][106226] Updated weights for policy 0, policy_version 399085 (0.0007) [2023-12-27 22:06:00,243][106226] Updated weights for policy 0, policy_version 399095 (0.0008) [2023-12-27 22:06:00,300][106226] Updated weights for policy 0, policy_version 399105 (0.0009) [2023-12-27 22:06:00,604][106225] Updated weights for policy 1, policy_version 400088 (0.0009) [2023-12-27 22:06:00,661][106225] Updated weights for policy 1, policy_version 400098 (0.0008) [2023-12-27 22:06:00,717][106225] Updated weights for policy 1, policy_version 400108 (0.0008) [2023-12-27 22:06:00,968][106226] Updated weights for policy 0, policy_version 399115 (0.0008) [2023-12-27 22:06:01,017][106226] Updated weights for policy 0, policy_version 399125 (0.0008) [2023-12-27 22:06:01,079][106226] Updated weights for policy 0, policy_version 399135 (0.0009) [2023-12-27 22:06:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 204668928. Throughput: 0: 9910.9, 1: 9628.5. Samples: 204655348. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:01,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-5.647')] [2023-12-27 22:06:01,458][106225] Updated weights for policy 1, policy_version 400118 (0.0007) [2023-12-27 22:06:01,506][106225] Updated weights for policy 1, policy_version 400128 (0.0008) [2023-12-27 22:06:01,562][106225] Updated weights for policy 1, policy_version 400138 (0.0008) [2023-12-27 22:06:01,863][106226] Updated weights for policy 0, policy_version 399145 (0.0009) [2023-12-27 22:06:01,922][106226] Updated weights for policy 0, policy_version 399155 (0.0009) [2023-12-27 22:06:01,996][106226] Updated weights for policy 0, policy_version 399165 (0.0008) [2023-12-27 22:06:02,068][106226] Updated weights for policy 0, policy_version 399175 (0.0010) [2023-12-27 22:06:02,307][106225] Updated weights for policy 1, policy_version 400148 (0.0009) [2023-12-27 22:06:02,378][106225] Updated weights for policy 1, policy_version 400158 (0.0010) [2023-12-27 22:06:02,445][106225] Updated weights for policy 1, policy_version 400168 (0.0009) [2023-12-27 22:06:02,781][106226] Updated weights for policy 0, policy_version 399185 (0.0011) [2023-12-27 22:06:02,845][106226] Updated weights for policy 0, policy_version 399195 (0.0011) [2023-12-27 22:06:02,903][106226] Updated weights for policy 0, policy_version 399205 (0.0010) [2023-12-27 22:06:03,087][106225] Updated weights for policy 1, policy_version 400178 (0.0009) [2023-12-27 22:06:03,140][106225] Updated weights for policy 1, policy_version 400188 (0.0007) [2023-12-27 22:06:03,190][106225] Updated weights for policy 1, policy_version 400198 (0.0005) [2023-12-27 22:06:03,245][106225] Updated weights for policy 1, policy_version 400208 (0.0005) [2023-12-27 22:06:03,550][106226] Updated weights for policy 0, policy_version 399215 (0.0011) [2023-12-27 22:06:03,609][106226] Updated weights for policy 0, policy_version 399225 (0.0010) [2023-12-27 22:06:03,666][106226] Updated weights for policy 0, policy_version 399235 (0.0010) [2023-12-27 22:06:03,945][106225] Updated weights for policy 1, policy_version 400218 (0.0010) [2023-12-27 22:06:04,000][106225] Updated weights for policy 1, policy_version 400228 (0.0010) [2023-12-27 22:06:04,070][106225] Updated weights for policy 1, policy_version 400238 (0.0006) [2023-12-27 22:06:04,336][106226] Updated weights for policy 0, policy_version 399245 (0.0010) [2023-12-27 22:06:04,393][106226] Updated weights for policy 0, policy_version 399255 (0.0011) [2023-12-27 22:06:04,456][106226] Updated weights for policy 0, policy_version 399265 (0.0011) [2023-12-27 22:06:04,832][106225] Updated weights for policy 1, policy_version 400248 (0.0008) [2023-12-27 22:06:04,881][106225] Updated weights for policy 1, policy_version 400258 (0.0008) [2023-12-27 22:06:04,935][106225] Updated weights for policy 1, policy_version 400268 (0.0009) [2023-12-27 22:06:05,049][106226] Updated weights for policy 0, policy_version 399275 (0.0008) [2023-12-27 22:06:05,109][106226] Updated weights for policy 0, policy_version 399285 (0.0005) [2023-12-27 22:06:05,167][106226] Updated weights for policy 0, policy_version 399295 (0.0008) [2023-12-27 22:06:05,703][106226] Updated weights for policy 0, policy_version 399305 (0.0009) [2023-12-27 22:06:05,725][106225] Updated weights for policy 1, policy_version 400278 (0.0007) [2023-12-27 22:06:05,755][106226] Updated weights for policy 0, policy_version 399315 (0.0006) [2023-12-27 22:06:05,782][106225] Updated weights for policy 1, policy_version 400288 (0.0006) [2023-12-27 22:06:05,811][106226] Updated weights for policy 0, policy_version 399325 (0.0006) [2023-12-27 22:06:05,845][106225] Updated weights for policy 1, policy_version 400298 (0.0008) [2023-12-27 22:06:05,873][106226] Updated weights for policy 0, policy_version 399335 (0.0006) [2023-12-27 22:06:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 204767232. Throughput: 0: 9915.4, 1: 9606.6. Samples: 204774808. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:06,175][105115] Avg episode reward: [(0, '-5.050'), (1, '-6.010')] [2023-12-27 22:06:06,526][106225] Updated weights for policy 1, policy_version 400308 (0.0006) [2023-12-27 22:06:06,588][106225] Updated weights for policy 1, policy_version 400318 (0.0009) [2023-12-27 22:06:06,598][106226] Updated weights for policy 0, policy_version 399345 (0.0007) [2023-12-27 22:06:06,646][106225] Updated weights for policy 1, policy_version 400328 (0.0007) [2023-12-27 22:06:06,657][106226] Updated weights for policy 0, policy_version 399355 (0.0009) [2023-12-27 22:06:06,721][106226] Updated weights for policy 0, policy_version 399365 (0.0008) [2023-12-27 22:06:07,333][106225] Updated weights for policy 1, policy_version 400338 (0.0008) [2023-12-27 22:06:07,395][106225] Updated weights for policy 1, policy_version 400348 (0.0011) [2023-12-27 22:06:07,458][106225] Updated weights for policy 1, policy_version 400358 (0.0011) [2023-12-27 22:06:07,493][106226] Updated weights for policy 0, policy_version 399375 (0.0008) [2023-12-27 22:06:07,527][106225] Updated weights for policy 1, policy_version 400368 (0.0010) [2023-12-27 22:06:07,554][106226] Updated weights for policy 0, policy_version 399385 (0.0008) [2023-12-27 22:06:07,614][106226] Updated weights for policy 0, policy_version 399395 (0.0008) [2023-12-27 22:06:08,229][106225] Updated weights for policy 1, policy_version 400378 (0.0006) [2023-12-27 22:06:08,292][106225] Updated weights for policy 1, policy_version 400388 (0.0005) [2023-12-27 22:06:08,364][106225] Updated weights for policy 1, policy_version 400398 (0.0010) [2023-12-27 22:06:08,441][106226] Updated weights for policy 0, policy_version 399405 (0.0008) [2023-12-27 22:06:08,506][106226] Updated weights for policy 0, policy_version 399415 (0.0008) [2023-12-27 22:06:08,558][106226] Updated weights for policy 0, policy_version 399425 (0.0006) [2023-12-27 22:06:09,061][106225] Updated weights for policy 1, policy_version 400408 (0.0010) [2023-12-27 22:06:09,104][106225] Updated weights for policy 1, policy_version 400418 (0.0010) [2023-12-27 22:06:09,150][106225] Updated weights for policy 1, policy_version 400428 (0.0010) [2023-12-27 22:06:09,198][106226] Updated weights for policy 0, policy_version 399435 (0.0007) [2023-12-27 22:06:09,265][106226] Updated weights for policy 0, policy_version 399445 (0.0008) [2023-12-27 22:06:09,326][106226] Updated weights for policy 0, policy_version 399455 (0.0008) [2023-12-27 22:06:09,977][106225] Updated weights for policy 1, policy_version 400438 (0.0008) [2023-12-27 22:06:10,044][106225] Updated weights for policy 1, policy_version 400448 (0.0008) [2023-12-27 22:06:10,105][106226] Updated weights for policy 0, policy_version 399465 (0.0009) [2023-12-27 22:06:10,111][106225] Updated weights for policy 1, policy_version 400458 (0.0008) [2023-12-27 22:06:10,167][106226] Updated weights for policy 0, policy_version 399475 (0.0007) [2023-12-27 22:06:10,232][106226] Updated weights for policy 0, policy_version 399485 (0.0009) [2023-12-27 22:06:10,302][106226] Updated weights for policy 0, policy_version 399495 (0.0009) [2023-12-27 22:06:10,840][106225] Updated weights for policy 1, policy_version 400468 (0.0007) [2023-12-27 22:06:10,903][106225] Updated weights for policy 1, policy_version 400478 (0.0008) [2023-12-27 22:06:10,958][106225] Updated weights for policy 1, policy_version 400488 (0.0006) [2023-12-27 22:06:11,042][106226] Updated weights for policy 0, policy_version 399505 (0.0008) [2023-12-27 22:06:11,110][106226] Updated weights for policy 0, policy_version 399515 (0.0007) [2023-12-27 22:06:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 204857344. Throughput: 0: 9937.1, 1: 9656.5. Samples: 204833040. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:11,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-6.039')] [2023-12-27 22:06:11,181][106226] Updated weights for policy 0, policy_version 399525 (0.0007) [2023-12-27 22:06:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000400496_102555648.pth... [2023-12-27 22:06:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000399376_102268928.pth [2023-12-27 22:06:11,202][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000399528_102309888.pth... [2023-12-27 22:06:11,208][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000398376_102014976.pth [2023-12-27 22:06:11,672][106225] Updated weights for policy 1, policy_version 400498 (0.0005) [2023-12-27 22:06:11,740][106225] Updated weights for policy 1, policy_version 400508 (0.0008) [2023-12-27 22:06:11,809][106225] Updated weights for policy 1, policy_version 400518 (0.0009) [2023-12-27 22:06:11,874][106225] Updated weights for policy 1, policy_version 400528 (0.0009) [2023-12-27 22:06:11,931][106226] Updated weights for policy 0, policy_version 399535 (0.0008) [2023-12-27 22:06:12,001][106226] Updated weights for policy 0, policy_version 399545 (0.0007) [2023-12-27 22:06:12,068][106226] Updated weights for policy 0, policy_version 399555 (0.0007) [2023-12-27 22:06:12,721][106225] Updated weights for policy 1, policy_version 400538 (0.0008) [2023-12-27 22:06:12,784][106225] Updated weights for policy 1, policy_version 400548 (0.0008) [2023-12-27 22:06:12,803][106226] Updated weights for policy 0, policy_version 399565 (0.0009) [2023-12-27 22:06:12,847][106225] Updated weights for policy 1, policy_version 400558 (0.0006) [2023-12-27 22:06:12,865][106226] Updated weights for policy 0, policy_version 399575 (0.0011) [2023-12-27 22:06:12,926][106226] Updated weights for policy 0, policy_version 399585 (0.0010) [2023-12-27 22:06:13,555][106225] Updated weights for policy 1, policy_version 400568 (0.0008) [2023-12-27 22:06:13,614][106225] Updated weights for policy 1, policy_version 400578 (0.0009) [2023-12-27 22:06:13,660][106226] Updated weights for policy 0, policy_version 399595 (0.0008) [2023-12-27 22:06:13,669][106225] Updated weights for policy 1, policy_version 400588 (0.0010) [2023-12-27 22:06:13,730][106226] Updated weights for policy 0, policy_version 399605 (0.0006) [2023-12-27 22:06:13,804][106226] Updated weights for policy 0, policy_version 399615 (0.0010) [2023-12-27 22:06:14,333][106225] Updated weights for policy 1, policy_version 400598 (0.0010) [2023-12-27 22:06:14,401][106225] Updated weights for policy 1, policy_version 400608 (0.0007) [2023-12-27 22:06:14,458][106225] Updated weights for policy 1, policy_version 400618 (0.0009) [2023-12-27 22:06:14,511][106226] Updated weights for policy 0, policy_version 399625 (0.0009) [2023-12-27 22:06:14,575][106226] Updated weights for policy 0, policy_version 399635 (0.0007) [2023-12-27 22:06:14,640][106226] Updated weights for policy 0, policy_version 399645 (0.0009) [2023-12-27 22:06:14,704][106226] Updated weights for policy 0, policy_version 399655 (0.0007) [2023-12-27 22:06:15,233][106225] Updated weights for policy 1, policy_version 400628 (0.0008) [2023-12-27 22:06:15,298][106225] Updated weights for policy 1, policy_version 400638 (0.0007) [2023-12-27 22:06:15,324][106226] Updated weights for policy 0, policy_version 399665 (0.0007) [2023-12-27 22:06:15,362][106225] Updated weights for policy 1, policy_version 400648 (0.0007) [2023-12-27 22:06:15,384][106226] Updated weights for policy 0, policy_version 399675 (0.0006) [2023-12-27 22:06:15,451][106226] Updated weights for policy 0, policy_version 399685 (0.0008) [2023-12-27 22:06:16,045][106225] Updated weights for policy 1, policy_version 400658 (0.0007) [2023-12-27 22:06:16,092][106225] Updated weights for policy 1, policy_version 400668 (0.0008) [2023-12-27 22:06:16,145][106226] Updated weights for policy 0, policy_version 399695 (0.0009) [2023-12-27 22:06:16,147][106225] Updated weights for policy 1, policy_version 400678 (0.0008) [2023-12-27 22:06:16,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19387.7, 300 sec: 19383.1). Total num frames: 204947456. Throughput: 0: 9749.3, 1: 9580.4. Samples: 204945332. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:16,175][105115] Avg episode reward: [(0, '-4.938'), (1, '-5.691')] [2023-12-27 22:06:16,202][106225] Updated weights for policy 1, policy_version 400688 (0.0006) [2023-12-27 22:06:16,203][106226] Updated weights for policy 0, policy_version 399705 (0.0011) [2023-12-27 22:06:16,261][106226] Updated weights for policy 0, policy_version 399715 (0.0010) [2023-12-27 22:06:16,953][106225] Updated weights for policy 1, policy_version 400698 (0.0010) [2023-12-27 22:06:17,000][106225] Updated weights for policy 1, policy_version 400708 (0.0009) [2023-12-27 22:06:17,020][106226] Updated weights for policy 0, policy_version 399725 (0.0011) [2023-12-27 22:06:17,052][106225] Updated weights for policy 1, policy_version 400718 (0.0010) [2023-12-27 22:06:17,095][106226] Updated weights for policy 0, policy_version 399735 (0.0011) [2023-12-27 22:06:17,164][106226] Updated weights for policy 0, policy_version 399745 (0.0010) [2023-12-27 22:06:17,763][106225] Updated weights for policy 1, policy_version 400728 (0.0009) [2023-12-27 22:06:17,815][106225] Updated weights for policy 1, policy_version 400738 (0.0009) [2023-12-27 22:06:17,828][106226] Updated weights for policy 0, policy_version 399755 (0.0009) [2023-12-27 22:06:17,874][106225] Updated weights for policy 1, policy_version 400748 (0.0008) [2023-12-27 22:06:17,884][106226] Updated weights for policy 0, policy_version 399765 (0.0007) [2023-12-27 22:06:17,934][106226] Updated weights for policy 0, policy_version 399775 (0.0009) [2023-12-27 22:06:18,610][106225] Updated weights for policy 1, policy_version 400758 (0.0009) [2023-12-27 22:06:18,676][106226] Updated weights for policy 0, policy_version 399785 (0.0008) [2023-12-27 22:06:18,680][106225] Updated weights for policy 1, policy_version 400768 (0.0011) [2023-12-27 22:06:18,739][106225] Updated weights for policy 1, policy_version 400778 (0.0010) [2023-12-27 22:06:18,739][106226] Updated weights for policy 0, policy_version 399795 (0.0008) [2023-12-27 22:06:18,803][106226] Updated weights for policy 0, policy_version 399805 (0.0009) [2023-12-27 22:06:18,866][106226] Updated weights for policy 0, policy_version 399815 (0.0008) [2023-12-27 22:06:19,507][106225] Updated weights for policy 1, policy_version 400788 (0.0010) [2023-12-27 22:06:19,567][106225] Updated weights for policy 1, policy_version 400798 (0.0010) [2023-12-27 22:06:19,572][106226] Updated weights for policy 0, policy_version 399825 (0.0006) [2023-12-27 22:06:19,619][106226] Updated weights for policy 0, policy_version 399835 (0.0006) [2023-12-27 22:06:19,628][106225] Updated weights for policy 1, policy_version 400808 (0.0010) [2023-12-27 22:06:19,667][106226] Updated weights for policy 0, policy_version 399845 (0.0005) [2023-12-27 22:06:20,393][106226] Updated weights for policy 0, policy_version 399855 (0.0008) [2023-12-27 22:06:20,452][106226] Updated weights for policy 0, policy_version 399865 (0.0009) [2023-12-27 22:06:20,481][106225] Updated weights for policy 1, policy_version 400818 (0.0009) [2023-12-27 22:06:20,500][106226] Updated weights for policy 0, policy_version 399875 (0.0007) [2023-12-27 22:06:20,540][106225] Updated weights for policy 1, policy_version 400828 (0.0009) [2023-12-27 22:06:20,604][106225] Updated weights for policy 1, policy_version 400838 (0.0008) [2023-12-27 22:06:20,668][106225] Updated weights for policy 1, policy_version 400848 (0.0008) [2023-12-27 22:06:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19383.1). Total num frames: 205045760. Throughput: 0: 9747.6, 1: 9494.2. Samples: 205059308. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:21,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-5.804')] [2023-12-27 22:06:21,263][106226] Updated weights for policy 0, policy_version 399885 (0.0009) [2023-12-27 22:06:21,331][106226] Updated weights for policy 0, policy_version 399895 (0.0009) [2023-12-27 22:06:21,400][106226] Updated weights for policy 0, policy_version 399905 (0.0008) [2023-12-27 22:06:21,434][106225] Updated weights for policy 1, policy_version 400858 (0.0008) [2023-12-27 22:06:21,497][106225] Updated weights for policy 1, policy_version 400868 (0.0009) [2023-12-27 22:06:21,557][106225] Updated weights for policy 1, policy_version 400878 (0.0008) [2023-12-27 22:06:22,103][106226] Updated weights for policy 0, policy_version 399915 (0.0007) [2023-12-27 22:06:22,166][106226] Updated weights for policy 0, policy_version 399925 (0.0006) [2023-12-27 22:06:22,239][106226] Updated weights for policy 0, policy_version 399935 (0.0006) [2023-12-27 22:06:22,364][106225] Updated weights for policy 1, policy_version 400888 (0.0008) [2023-12-27 22:06:22,437][106225] Updated weights for policy 1, policy_version 400898 (0.0009) [2023-12-27 22:06:22,497][106225] Updated weights for policy 1, policy_version 400908 (0.0009) [2023-12-27 22:06:22,910][106226] Updated weights for policy 0, policy_version 399945 (0.0009) [2023-12-27 22:06:22,974][106226] Updated weights for policy 0, policy_version 399955 (0.0008) [2023-12-27 22:06:23,042][106226] Updated weights for policy 0, policy_version 399965 (0.0007) [2023-12-27 22:06:23,111][106226] Updated weights for policy 0, policy_version 399975 (0.0008) [2023-12-27 22:06:23,214][106225] Updated weights for policy 1, policy_version 400918 (0.0007) [2023-12-27 22:06:23,274][106225] Updated weights for policy 1, policy_version 400928 (0.0008) [2023-12-27 22:06:23,325][106225] Updated weights for policy 1, policy_version 400938 (0.0008) [2023-12-27 22:06:23,849][106226] Updated weights for policy 0, policy_version 399985 (0.0007) [2023-12-27 22:06:23,912][106226] Updated weights for policy 0, policy_version 399995 (0.0010) [2023-12-27 22:06:23,949][106225] Updated weights for policy 1, policy_version 400948 (0.0007) [2023-12-27 22:06:23,966][106226] Updated weights for policy 0, policy_version 400005 (0.0006) [2023-12-27 22:06:24,009][106225] Updated weights for policy 1, policy_version 400958 (0.0009) [2023-12-27 22:06:24,075][106225] Updated weights for policy 1, policy_version 400968 (0.0010) [2023-12-27 22:06:24,612][106226] Updated weights for policy 0, policy_version 400015 (0.0007) [2023-12-27 22:06:24,659][106226] Updated weights for policy 0, policy_version 400025 (0.0008) [2023-12-27 22:06:24,708][106226] Updated weights for policy 0, policy_version 400035 (0.0008) [2023-12-27 22:06:24,824][106225] Updated weights for policy 1, policy_version 400978 (0.0009) [2023-12-27 22:06:24,873][106225] Updated weights for policy 1, policy_version 400988 (0.0010) [2023-12-27 22:06:24,921][106225] Updated weights for policy 1, policy_version 400998 (0.0009) [2023-12-27 22:06:24,965][106225] Updated weights for policy 1, policy_version 401008 (0.0007) [2023-12-27 22:06:25,316][106226] Updated weights for policy 0, policy_version 400045 (0.0006) [2023-12-27 22:06:25,385][106226] Updated weights for policy 0, policy_version 400055 (0.0005) [2023-12-27 22:06:25,457][106226] Updated weights for policy 0, policy_version 400065 (0.0005) [2023-12-27 22:06:25,623][106225] Updated weights for policy 1, policy_version 401018 (0.0008) [2023-12-27 22:06:25,674][106225] Updated weights for policy 1, policy_version 401028 (0.0008) [2023-12-27 22:06:25,725][106225] Updated weights for policy 1, policy_version 401038 (0.0008) [2023-12-27 22:06:26,033][106226] Updated weights for policy 0, policy_version 400075 (0.0005) [2023-12-27 22:06:26,085][106226] Updated weights for policy 0, policy_version 400085 (0.0005) [2023-12-27 22:06:26,135][106226] Updated weights for policy 0, policy_version 400095 (0.0006) [2023-12-27 22:06:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 205144064. Throughput: 0: 9769.6, 1: 9496.2. Samples: 205116168. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:26,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-5.557')] [2023-12-27 22:06:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000400104_102457344.pth... [2023-12-27 22:06:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000401040_102694912.pth... [2023-12-27 22:06:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000398952_102162432.pth [2023-12-27 22:06:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000399920_102408192.pth [2023-12-27 22:06:26,490][106225] Updated weights for policy 1, policy_version 401048 (0.0006) [2023-12-27 22:06:26,552][106225] Updated weights for policy 1, policy_version 401058 (0.0008) [2023-12-27 22:06:26,608][106225] Updated weights for policy 1, policy_version 401068 (0.0008) [2023-12-27 22:06:26,799][106226] Updated weights for policy 0, policy_version 400105 (0.0009) [2023-12-27 22:06:26,853][106226] Updated weights for policy 0, policy_version 400115 (0.0009) [2023-12-27 22:06:26,907][106226] Updated weights for policy 0, policy_version 400125 (0.0009) [2023-12-27 22:06:26,960][106226] Updated weights for policy 0, policy_version 400135 (0.0008) [2023-12-27 22:06:27,177][106225] Updated weights for policy 1, policy_version 401078 (0.0005) [2023-12-27 22:06:27,227][106225] Updated weights for policy 1, policy_version 401088 (0.0005) [2023-12-27 22:06:27,275][106225] Updated weights for policy 1, policy_version 401098 (0.0005) [2023-12-27 22:06:27,810][106226] Updated weights for policy 0, policy_version 400145 (0.0007) [2023-12-27 22:06:27,815][106225] Updated weights for policy 1, policy_version 401108 (0.0007) [2023-12-27 22:06:27,859][106226] Updated weights for policy 0, policy_version 400155 (0.0005) [2023-12-27 22:06:27,865][106225] Updated weights for policy 1, policy_version 401118 (0.0010) [2023-12-27 22:06:27,910][106226] Updated weights for policy 0, policy_version 400165 (0.0005) [2023-12-27 22:06:27,918][106225] Updated weights for policy 1, policy_version 401128 (0.0010) [2023-12-27 22:06:28,532][106225] Updated weights for policy 1, policy_version 401138 (0.0010) [2023-12-27 22:06:28,558][106226] Updated weights for policy 0, policy_version 400175 (0.0011) [2023-12-27 22:06:28,593][106225] Updated weights for policy 1, policy_version 401148 (0.0010) [2023-12-27 22:06:28,616][106226] Updated weights for policy 0, policy_version 400185 (0.0011) [2023-12-27 22:06:28,647][106225] Updated weights for policy 1, policy_version 401158 (0.0010) [2023-12-27 22:06:28,678][106226] Updated weights for policy 0, policy_version 400195 (0.0011) [2023-12-27 22:06:28,707][106225] Updated weights for policy 1, policy_version 401168 (0.0010) [2023-12-27 22:06:29,416][106225] Updated weights for policy 1, policy_version 401178 (0.0009) [2023-12-27 22:06:29,437][106226] Updated weights for policy 0, policy_version 400205 (0.0011) [2023-12-27 22:06:29,476][106225] Updated weights for policy 1, policy_version 401188 (0.0011) [2023-12-27 22:06:29,491][106226] Updated weights for policy 0, policy_version 400215 (0.0008) [2023-12-27 22:06:29,537][106225] Updated weights for policy 1, policy_version 401198 (0.0010) [2023-12-27 22:06:29,544][106226] Updated weights for policy 0, policy_version 400225 (0.0006) [2023-12-27 22:06:30,190][106225] Updated weights for policy 1, policy_version 401208 (0.0008) [2023-12-27 22:06:30,252][106225] Updated weights for policy 1, policy_version 401218 (0.0008) [2023-12-27 22:06:30,306][106225] Updated weights for policy 1, policy_version 401228 (0.0009) [2023-12-27 22:06:30,351][106226] Updated weights for policy 0, policy_version 400235 (0.0009) [2023-12-27 22:06:30,411][106226] Updated weights for policy 0, policy_version 400245 (0.0007) [2023-12-27 22:06:30,476][106226] Updated weights for policy 0, policy_version 400255 (0.0005) [2023-12-27 22:06:31,070][106225] Updated weights for policy 1, policy_version 401238 (0.0007) [2023-12-27 22:06:31,095][106226] Updated weights for policy 0, policy_version 400265 (0.0006) [2023-12-27 22:06:31,137][106225] Updated weights for policy 1, policy_version 401248 (0.0006) [2023-12-27 22:06:31,167][106226] Updated weights for policy 0, policy_version 400275 (0.0008) [2023-12-27 22:06:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 205242368. Throughput: 0: 9817.4, 1: 9644.8. Samples: 205238776. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:31,176][105115] Avg episode reward: [(0, '-5.135'), (1, '-5.949')] [2023-12-27 22:06:31,209][106225] Updated weights for policy 1, policy_version 401258 (0.0007) [2023-12-27 22:06:31,222][106226] Updated weights for policy 0, policy_version 400285 (0.0010) [2023-12-27 22:06:31,285][106226] Updated weights for policy 0, policy_version 400295 (0.0009) [2023-12-27 22:06:31,874][106225] Updated weights for policy 1, policy_version 401268 (0.0007) [2023-12-27 22:06:31,922][106225] Updated weights for policy 1, policy_version 401278 (0.0008) [2023-12-27 22:06:31,967][106225] Updated weights for policy 1, policy_version 401288 (0.0007) [2023-12-27 22:06:32,004][106226] Updated weights for policy 0, policy_version 400305 (0.0011) [2023-12-27 22:06:32,064][106226] Updated weights for policy 0, policy_version 400315 (0.0010) [2023-12-27 22:06:32,129][106226] Updated weights for policy 0, policy_version 400325 (0.0011) [2023-12-27 22:06:32,767][106225] Updated weights for policy 1, policy_version 401298 (0.0006) [2023-12-27 22:06:32,823][106225] Updated weights for policy 1, policy_version 401308 (0.0009) [2023-12-27 22:06:32,887][106225] Updated weights for policy 1, policy_version 401318 (0.0006) [2023-12-27 22:06:32,937][106226] Updated weights for policy 0, policy_version 400335 (0.0007) [2023-12-27 22:06:32,951][106225] Updated weights for policy 1, policy_version 401328 (0.0005) [2023-12-27 22:06:32,998][106226] Updated weights for policy 0, policy_version 400345 (0.0006) [2023-12-27 22:06:33,057][106226] Updated weights for policy 0, policy_version 400355 (0.0005) [2023-12-27 22:06:33,575][106225] Updated weights for policy 1, policy_version 401338 (0.0008) [2023-12-27 22:06:33,635][106226] Updated weights for policy 0, policy_version 400365 (0.0008) [2023-12-27 22:06:33,635][106225] Updated weights for policy 1, policy_version 401348 (0.0008) [2023-12-27 22:06:33,678][106225] Updated weights for policy 1, policy_version 401358 (0.0006) [2023-12-27 22:06:33,694][106226] Updated weights for policy 0, policy_version 400375 (0.0008) [2023-12-27 22:06:33,758][106226] Updated weights for policy 0, policy_version 400385 (0.0007) [2023-12-27 22:06:34,339][106226] Updated weights for policy 0, policy_version 400395 (0.0006) [2023-12-27 22:06:34,404][106226] Updated weights for policy 0, policy_version 400405 (0.0006) [2023-12-27 22:06:34,470][106226] Updated weights for policy 0, policy_version 400415 (0.0006) [2023-12-27 22:06:34,484][106225] Updated weights for policy 1, policy_version 401368 (0.0007) [2023-12-27 22:06:34,551][106225] Updated weights for policy 1, policy_version 401378 (0.0010) [2023-12-27 22:06:34,615][106225] Updated weights for policy 1, policy_version 401388 (0.0009) [2023-12-27 22:06:35,043][106226] Updated weights for policy 0, policy_version 400425 (0.0006) [2023-12-27 22:06:35,113][106226] Updated weights for policy 0, policy_version 400435 (0.0005) [2023-12-27 22:06:35,172][106226] Updated weights for policy 0, policy_version 400445 (0.0007) [2023-12-27 22:06:35,219][106226] Updated weights for policy 0, policy_version 400455 (0.0005) [2023-12-27 22:06:35,357][106225] Updated weights for policy 1, policy_version 401398 (0.0010) [2023-12-27 22:06:35,408][106225] Updated weights for policy 1, policy_version 401408 (0.0010) [2023-12-27 22:06:35,471][106225] Updated weights for policy 1, policy_version 401418 (0.0008) [2023-12-27 22:06:35,796][106226] Updated weights for policy 0, policy_version 400465 (0.0007) [2023-12-27 22:06:35,853][106226] Updated weights for policy 0, policy_version 400475 (0.0008) [2023-12-27 22:06:35,909][106226] Updated weights for policy 0, policy_version 400485 (0.0008) [2023-12-27 22:06:36,050][106225] Updated weights for policy 1, policy_version 401428 (0.0008) [2023-12-27 22:06:36,117][106225] Updated weights for policy 1, policy_version 401438 (0.0010) [2023-12-27 22:06:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19387.8, 300 sec: 19438.7). Total num frames: 205348864. Throughput: 0: 9919.3, 1: 9642.0. Samples: 205360480. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:36,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-5.604')] [2023-12-27 22:06:36,187][106225] Updated weights for policy 1, policy_version 401448 (0.0010) [2023-12-27 22:06:36,610][106226] Updated weights for policy 0, policy_version 400495 (0.0007) [2023-12-27 22:06:36,675][106226] Updated weights for policy 0, policy_version 400505 (0.0007) [2023-12-27 22:06:36,733][106226] Updated weights for policy 0, policy_version 400515 (0.0008) [2023-12-27 22:06:36,898][106225] Updated weights for policy 1, policy_version 401458 (0.0011) [2023-12-27 22:06:36,949][106225] Updated weights for policy 1, policy_version 401468 (0.0011) [2023-12-27 22:06:37,014][106225] Updated weights for policy 1, policy_version 401478 (0.0010) [2023-12-27 22:06:37,070][106225] Updated weights for policy 1, policy_version 401488 (0.0010) [2023-12-27 22:06:37,459][106226] Updated weights for policy 0, policy_version 400525 (0.0008) [2023-12-27 22:06:37,508][106226] Updated weights for policy 0, policy_version 400535 (0.0008) [2023-12-27 22:06:37,578][106226] Updated weights for policy 0, policy_version 400545 (0.0010) [2023-12-27 22:06:37,780][106225] Updated weights for policy 1, policy_version 401498 (0.0010) [2023-12-27 22:06:37,833][106225] Updated weights for policy 1, policy_version 401508 (0.0006) [2023-12-27 22:06:37,895][106225] Updated weights for policy 1, policy_version 401518 (0.0009) [2023-12-27 22:06:38,283][106226] Updated weights for policy 0, policy_version 400555 (0.0009) [2023-12-27 22:06:38,349][106226] Updated weights for policy 0, policy_version 400565 (0.0007) [2023-12-27 22:06:38,415][106226] Updated weights for policy 0, policy_version 400575 (0.0006) [2023-12-27 22:06:38,652][106225] Updated weights for policy 1, policy_version 401528 (0.0011) [2023-12-27 22:06:38,710][106225] Updated weights for policy 1, policy_version 401538 (0.0010) [2023-12-27 22:06:38,772][106225] Updated weights for policy 1, policy_version 401548 (0.0011) [2023-12-27 22:06:39,017][106226] Updated weights for policy 0, policy_version 400585 (0.0006) [2023-12-27 22:06:39,078][106226] Updated weights for policy 0, policy_version 400595 (0.0007) [2023-12-27 22:06:39,125][106226] Updated weights for policy 0, policy_version 400605 (0.0010) [2023-12-27 22:06:39,178][106226] Updated weights for policy 0, policy_version 400615 (0.0007) [2023-12-27 22:06:39,511][106225] Updated weights for policy 1, policy_version 401558 (0.0011) [2023-12-27 22:06:39,580][106225] Updated weights for policy 1, policy_version 401568 (0.0010) [2023-12-27 22:06:39,652][106225] Updated weights for policy 1, policy_version 401578 (0.0010) [2023-12-27 22:06:39,871][106226] Updated weights for policy 0, policy_version 400625 (0.0008) [2023-12-27 22:06:39,941][106226] Updated weights for policy 0, policy_version 400635 (0.0008) [2023-12-27 22:06:40,013][106226] Updated weights for policy 0, policy_version 400645 (0.0007) [2023-12-27 22:06:40,374][106225] Updated weights for policy 1, policy_version 401588 (0.0010) [2023-12-27 22:06:40,437][106225] Updated weights for policy 1, policy_version 401598 (0.0008) [2023-12-27 22:06:40,497][106225] Updated weights for policy 1, policy_version 401608 (0.0009) [2023-12-27 22:06:40,703][106226] Updated weights for policy 0, policy_version 400655 (0.0006) [2023-12-27 22:06:40,772][106226] Updated weights for policy 0, policy_version 400665 (0.0007) [2023-12-27 22:06:40,831][106226] Updated weights for policy 0, policy_version 400675 (0.0009) [2023-12-27 22:06:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 205447168. Throughput: 0: 9948.2, 1: 9646.8. Samples: 205419840. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:41,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-5.677')] [2023-12-27 22:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000400680_102604800.pth... [2023-12-27 22:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000401616_102842368.pth... [2023-12-27 22:06:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000399528_102309888.pth [2023-12-27 22:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000400496_102555648.pth [2023-12-27 22:06:41,215][106225] Updated weights for policy 1, policy_version 401618 (0.0009) [2023-12-27 22:06:41,289][106225] Updated weights for policy 1, policy_version 401628 (0.0009) [2023-12-27 22:06:41,360][106225] Updated weights for policy 1, policy_version 401638 (0.0010) [2023-12-27 22:06:41,430][106225] Updated weights for policy 1, policy_version 401648 (0.0010) [2023-12-27 22:06:41,560][106226] Updated weights for policy 0, policy_version 400685 (0.0009) [2023-12-27 22:06:41,621][106226] Updated weights for policy 0, policy_version 400695 (0.0008) [2023-12-27 22:06:41,691][106226] Updated weights for policy 0, policy_version 400705 (0.0007) [2023-12-27 22:06:42,184][106225] Updated weights for policy 1, policy_version 401658 (0.0011) [2023-12-27 22:06:42,247][106225] Updated weights for policy 1, policy_version 401668 (0.0010) [2023-12-27 22:06:42,317][106225] Updated weights for policy 1, policy_version 401678 (0.0007) [2023-12-27 22:06:42,532][106226] Updated weights for policy 0, policy_version 400715 (0.0009) [2023-12-27 22:06:42,588][106226] Updated weights for policy 0, policy_version 400725 (0.0007) [2023-12-27 22:06:42,655][106226] Updated weights for policy 0, policy_version 400735 (0.0007) [2023-12-27 22:06:43,048][106225] Updated weights for policy 1, policy_version 401689 (0.0009) [2023-12-27 22:06:43,110][106225] Updated weights for policy 1, policy_version 401699 (0.0007) [2023-12-27 22:06:43,178][106225] Updated weights for policy 1, policy_version 401709 (0.0007) [2023-12-27 22:06:43,355][106226] Updated weights for policy 0, policy_version 400745 (0.0009) [2023-12-27 22:06:43,420][106226] Updated weights for policy 0, policy_version 400755 (0.0009) [2023-12-27 22:06:43,470][106226] Updated weights for policy 0, policy_version 400765 (0.0009) [2023-12-27 22:06:43,523][106226] Updated weights for policy 0, policy_version 400775 (0.0008) [2023-12-27 22:06:43,755][106225] Updated weights for policy 1, policy_version 401719 (0.0006) [2023-12-27 22:06:43,803][106225] Updated weights for policy 1, policy_version 401729 (0.0005) [2023-12-27 22:06:43,873][106225] Updated weights for policy 1, policy_version 401739 (0.0008) [2023-12-27 22:06:44,277][106226] Updated weights for policy 0, policy_version 400785 (0.0009) [2023-12-27 22:06:44,334][106226] Updated weights for policy 0, policy_version 400795 (0.0009) [2023-12-27 22:06:44,384][106226] Updated weights for policy 0, policy_version 400805 (0.0008) [2023-12-27 22:06:44,480][106225] Updated weights for policy 1, policy_version 401749 (0.0008) [2023-12-27 22:06:44,533][106225] Updated weights for policy 1, policy_version 401759 (0.0009) [2023-12-27 22:06:44,588][106225] Updated weights for policy 1, policy_version 401769 (0.0008) [2023-12-27 22:06:45,157][106226] Updated weights for policy 0, policy_version 400815 (0.0009) [2023-12-27 22:06:45,224][106226] Updated weights for policy 0, policy_version 400825 (0.0010) [2023-12-27 22:06:45,292][106226] Updated weights for policy 0, policy_version 400835 (0.0009) [2023-12-27 22:06:45,344][106225] Updated weights for policy 1, policy_version 401779 (0.0008) [2023-12-27 22:06:45,408][106225] Updated weights for policy 1, policy_version 401789 (0.0008) [2023-12-27 22:06:45,466][106225] Updated weights for policy 1, policy_version 401799 (0.0008) [2023-12-27 22:06:46,053][106226] Updated weights for policy 0, policy_version 400845 (0.0008) [2023-12-27 22:06:46,117][106226] Updated weights for policy 0, policy_version 400855 (0.0009) [2023-12-27 22:06:46,132][106225] Updated weights for policy 1, policy_version 401809 (0.0009) [2023-12-27 22:06:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 205537280. Throughput: 0: 9846.5, 1: 9688.2. Samples: 205534408. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:46,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.968')] [2023-12-27 22:06:46,178][106226] Updated weights for policy 0, policy_version 400865 (0.0007) [2023-12-27 22:06:46,184][106225] Updated weights for policy 1, policy_version 401819 (0.0007) [2023-12-27 22:06:46,238][106225] Updated weights for policy 1, policy_version 401829 (0.0007) [2023-12-27 22:06:46,297][106225] Updated weights for policy 1, policy_version 401839 (0.0009) [2023-12-27 22:06:46,929][106226] Updated weights for policy 0, policy_version 400875 (0.0008) [2023-12-27 22:06:46,976][106225] Updated weights for policy 1, policy_version 401849 (0.0007) [2023-12-27 22:06:46,989][106226] Updated weights for policy 0, policy_version 400885 (0.0007) [2023-12-27 22:06:47,031][106225] Updated weights for policy 1, policy_version 401859 (0.0007) [2023-12-27 22:06:47,045][106226] Updated weights for policy 0, policy_version 400895 (0.0007) [2023-12-27 22:06:47,083][106225] Updated weights for policy 1, policy_version 401869 (0.0006) [2023-12-27 22:06:47,722][106225] Updated weights for policy 1, policy_version 401879 (0.0008) [2023-12-27 22:06:47,775][106226] Updated weights for policy 0, policy_version 400905 (0.0006) [2023-12-27 22:06:47,778][106225] Updated weights for policy 1, policy_version 401889 (0.0007) [2023-12-27 22:06:47,831][106226] Updated weights for policy 0, policy_version 400915 (0.0007) [2023-12-27 22:06:47,833][106225] Updated weights for policy 1, policy_version 401899 (0.0006) [2023-12-27 22:06:47,880][106226] Updated weights for policy 0, policy_version 400925 (0.0006) [2023-12-27 22:06:47,942][106226] Updated weights for policy 0, policy_version 400935 (0.0010) [2023-12-27 22:06:48,584][106226] Updated weights for policy 0, policy_version 400945 (0.0009) [2023-12-27 22:06:48,611][106225] Updated weights for policy 1, policy_version 401909 (0.0009) [2023-12-27 22:06:48,637][106226] Updated weights for policy 0, policy_version 400955 (0.0006) [2023-12-27 22:06:48,670][106225] Updated weights for policy 1, policy_version 401919 (0.0011) [2023-12-27 22:06:48,685][106226] Updated weights for policy 0, policy_version 400965 (0.0008) [2023-12-27 22:06:48,724][106225] Updated weights for policy 1, policy_version 401929 (0.0010) [2023-12-27 22:06:49,433][106225] Updated weights for policy 1, policy_version 401939 (0.0010) [2023-12-27 22:06:49,485][106225] Updated weights for policy 1, policy_version 401949 (0.0008) [2023-12-27 22:06:49,486][106226] Updated weights for policy 0, policy_version 400975 (0.0008) [2023-12-27 22:06:49,543][106225] Updated weights for policy 1, policy_version 401959 (0.0008) [2023-12-27 22:06:49,554][106226] Updated weights for policy 0, policy_version 400985 (0.0008) [2023-12-27 22:06:49,619][106226] Updated weights for policy 0, policy_version 400995 (0.0008) [2023-12-27 22:06:50,340][106225] Updated weights for policy 1, policy_version 401969 (0.0008) [2023-12-27 22:06:50,362][106226] Updated weights for policy 0, policy_version 401005 (0.0009) [2023-12-27 22:06:50,399][106225] Updated weights for policy 1, policy_version 401979 (0.0008) [2023-12-27 22:06:50,421][106226] Updated weights for policy 0, policy_version 401015 (0.0006) [2023-12-27 22:06:50,463][106225] Updated weights for policy 1, policy_version 401989 (0.0008) [2023-12-27 22:06:50,477][106226] Updated weights for policy 0, policy_version 401025 (0.0006) [2023-12-27 22:06:50,515][106225] Updated weights for policy 1, policy_version 401999 (0.0006) [2023-12-27 22:06:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 205635584. Throughput: 0: 9735.2, 1: 9704.8. Samples: 205649608. Policy #0 lag: (min: 28.0, avg: 33.8, max: 60.0) [2023-12-27 22:06:51,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.840')] [2023-12-27 22:06:51,183][106226] Updated weights for policy 0, policy_version 401035 (0.0008) [2023-12-27 22:06:51,247][106226] Updated weights for policy 0, policy_version 401045 (0.0007) [2023-12-27 22:06:51,297][106225] Updated weights for policy 1, policy_version 402009 (0.0007) [2023-12-27 22:06:51,314][106226] Updated weights for policy 0, policy_version 401055 (0.0009) [2023-12-27 22:06:51,360][106225] Updated weights for policy 1, policy_version 402019 (0.0008) [2023-12-27 22:06:51,425][106225] Updated weights for policy 1, policy_version 402029 (0.0009) [2023-12-27 22:06:52,096][106226] Updated weights for policy 0, policy_version 401065 (0.0010) [2023-12-27 22:06:52,158][106226] Updated weights for policy 0, policy_version 401075 (0.0009) [2023-12-27 22:06:52,175][106225] Updated weights for policy 1, policy_version 402039 (0.0008) [2023-12-27 22:06:52,214][106226] Updated weights for policy 0, policy_version 401085 (0.0009) [2023-12-27 22:06:52,234][106225] Updated weights for policy 1, policy_version 402049 (0.0010) [2023-12-27 22:06:52,285][106226] Updated weights for policy 0, policy_version 401095 (0.0009) [2023-12-27 22:06:52,300][106225] Updated weights for policy 1, policy_version 402059 (0.0009) [2023-12-27 22:06:53,013][106226] Updated weights for policy 0, policy_version 401105 (0.0008) [2023-12-27 22:06:53,077][106226] Updated weights for policy 0, policy_version 401115 (0.0008) [2023-12-27 22:06:53,086][106225] Updated weights for policy 1, policy_version 402069 (0.0008) [2023-12-27 22:06:53,139][106226] Updated weights for policy 0, policy_version 401125 (0.0009) [2023-12-27 22:06:53,145][106225] Updated weights for policy 1, policy_version 402079 (0.0005) [2023-12-27 22:06:53,206][106225] Updated weights for policy 1, policy_version 402089 (0.0005) [2023-12-27 22:06:53,818][106225] Updated weights for policy 1, policy_version 402099 (0.0007) [2023-12-27 22:06:53,870][106225] Updated weights for policy 1, policy_version 402109 (0.0006) [2023-12-27 22:06:53,911][106226] Updated weights for policy 0, policy_version 401135 (0.0008) [2023-12-27 22:06:53,923][106225] Updated weights for policy 1, policy_version 402119 (0.0006) [2023-12-27 22:06:53,966][106226] Updated weights for policy 0, policy_version 401145 (0.0007) [2023-12-27 22:06:54,019][106226] Updated weights for policy 0, policy_version 401155 (0.0010) [2023-12-27 22:06:54,529][106225] Updated weights for policy 1, policy_version 402129 (0.0006) [2023-12-27 22:06:54,581][106225] Updated weights for policy 1, policy_version 402139 (0.0008) [2023-12-27 22:06:54,633][106225] Updated weights for policy 1, policy_version 402149 (0.0008) [2023-12-27 22:06:54,692][106225] Updated weights for policy 1, policy_version 402159 (0.0009) [2023-12-27 22:06:54,741][106226] Updated weights for policy 0, policy_version 401165 (0.0008) [2023-12-27 22:06:54,802][106226] Updated weights for policy 0, policy_version 401175 (0.0009) [2023-12-27 22:06:54,858][106226] Updated weights for policy 0, policy_version 401185 (0.0008) [2023-12-27 22:06:55,480][106226] Updated weights for policy 0, policy_version 401195 (0.0005) [2023-12-27 22:06:55,489][106225] Updated weights for policy 1, policy_version 402169 (0.0010) [2023-12-27 22:06:55,536][106225] Updated weights for policy 1, policy_version 402179 (0.0010) [2023-12-27 22:06:55,537][106226] Updated weights for policy 0, policy_version 401205 (0.0006) [2023-12-27 22:06:55,583][106225] Updated weights for policy 1, policy_version 402189 (0.0010) [2023-12-27 22:06:55,594][106226] Updated weights for policy 0, policy_version 401215 (0.0008) [2023-12-27 22:06:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19438.7). Total num frames: 205733888. Throughput: 0: 9697.1, 1: 9677.7. Samples: 205704904. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:06:56,175][105115] Avg episode reward: [(0, '-4.902'), (1, '-5.644')] [2023-12-27 22:06:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000401224_102744064.pth... [2023-12-27 22:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000402192_102989824.pth... [2023-12-27 22:06:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000401040_102694912.pth [2023-12-27 22:06:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000400104_102457344.pth [2023-12-27 22:06:56,331][106225] Updated weights for policy 1, policy_version 402199 (0.0010) [2023-12-27 22:06:56,336][106226] Updated weights for policy 0, policy_version 401225 (0.0008) [2023-12-27 22:06:56,383][106226] Updated weights for policy 0, policy_version 401235 (0.0006) [2023-12-27 22:06:56,384][106225] Updated weights for policy 1, policy_version 402209 (0.0010) [2023-12-27 22:06:56,434][106225] Updated weights for policy 1, policy_version 402219 (0.0010) [2023-12-27 22:06:56,436][106226] Updated weights for policy 0, policy_version 401245 (0.0005) [2023-12-27 22:06:56,489][106226] Updated weights for policy 0, policy_version 401255 (0.0007) [2023-12-27 22:06:57,161][106225] Updated weights for policy 1, policy_version 402229 (0.0010) [2023-12-27 22:06:57,222][106225] Updated weights for policy 1, policy_version 402239 (0.0010) [2023-12-27 22:06:57,228][106226] Updated weights for policy 0, policy_version 401265 (0.0006) [2023-12-27 22:06:57,287][106225] Updated weights for policy 1, policy_version 402249 (0.0010) [2023-12-27 22:06:57,296][106226] Updated weights for policy 0, policy_version 401275 (0.0006) [2023-12-27 22:06:57,351][106226] Updated weights for policy 0, policy_version 401285 (0.0007) [2023-12-27 22:06:57,963][106225] Updated weights for policy 1, policy_version 402259 (0.0009) [2023-12-27 22:06:58,009][106225] Updated weights for policy 1, policy_version 402269 (0.0008) [2023-12-27 22:06:58,035][106226] Updated weights for policy 0, policy_version 401295 (0.0007) [2023-12-27 22:06:58,058][106225] Updated weights for policy 1, policy_version 402279 (0.0007) [2023-12-27 22:06:58,088][106226] Updated weights for policy 0, policy_version 401305 (0.0006) [2023-12-27 22:06:58,136][106226] Updated weights for policy 0, policy_version 401315 (0.0006) [2023-12-27 22:06:58,884][106225] Updated weights for policy 1, policy_version 402289 (0.0009) [2023-12-27 22:06:58,948][106225] Updated weights for policy 1, policy_version 402299 (0.0011) [2023-12-27 22:06:59,013][106225] Updated weights for policy 1, policy_version 402309 (0.0010) [2023-12-27 22:06:59,018][106226] Updated weights for policy 0, policy_version 401325 (0.0008) [2023-12-27 22:06:59,064][106225] Updated weights for policy 1, policy_version 402319 (0.0010) [2023-12-27 22:06:59,074][106226] Updated weights for policy 0, policy_version 401335 (0.0006) [2023-12-27 22:06:59,124][106226] Updated weights for policy 0, policy_version 401345 (0.0008) [2023-12-27 22:06:59,854][106225] Updated weights for policy 1, policy_version 402329 (0.0010) [2023-12-27 22:06:59,865][106226] Updated weights for policy 0, policy_version 401355 (0.0008) [2023-12-27 22:06:59,914][106225] Updated weights for policy 1, policy_version 402339 (0.0010) [2023-12-27 22:06:59,921][106226] Updated weights for policy 0, policy_version 401365 (0.0006) [2023-12-27 22:06:59,977][106225] Updated weights for policy 1, policy_version 402349 (0.0010) [2023-12-27 22:06:59,984][106226] Updated weights for policy 0, policy_version 401375 (0.0007) [2023-12-27 22:07:00,668][106226] Updated weights for policy 0, policy_version 401385 (0.0007) [2023-12-27 22:07:00,725][106226] Updated weights for policy 0, policy_version 401395 (0.0008) [2023-12-27 22:07:00,781][106226] Updated weights for policy 0, policy_version 401405 (0.0008) [2023-12-27 22:07:00,830][106226] Updated weights for policy 0, policy_version 401415 (0.0009) [2023-12-27 22:07:00,839][106225] Updated weights for policy 1, policy_version 402359 (0.0008) [2023-12-27 22:07:00,897][106225] Updated weights for policy 1, policy_version 402369 (0.0008) [2023-12-27 22:07:00,950][106225] Updated weights for policy 1, policy_version 402379 (0.0008) [2023-12-27 22:07:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 205832192. Throughput: 0: 9753.1, 1: 9703.8. Samples: 205820892. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:01,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-6.187')] [2023-12-27 22:07:01,579][106226] Updated weights for policy 0, policy_version 401425 (0.0006) [2023-12-27 22:07:01,652][106226] Updated weights for policy 0, policy_version 401435 (0.0008) [2023-12-27 22:07:01,725][106226] Updated weights for policy 0, policy_version 401445 (0.0010) [2023-12-27 22:07:01,782][106225] Updated weights for policy 1, policy_version 402389 (0.0009) [2023-12-27 22:07:01,845][106225] Updated weights for policy 1, policy_version 402399 (0.0008) [2023-12-27 22:07:01,916][106225] Updated weights for policy 1, policy_version 402409 (0.0008) [2023-12-27 22:07:02,412][106226] Updated weights for policy 0, policy_version 401455 (0.0009) [2023-12-27 22:07:02,477][106226] Updated weights for policy 0, policy_version 401465 (0.0009) [2023-12-27 22:07:02,543][106226] Updated weights for policy 0, policy_version 401475 (0.0009) [2023-12-27 22:07:02,649][106225] Updated weights for policy 1, policy_version 402419 (0.0008) [2023-12-27 22:07:02,700][106225] Updated weights for policy 1, policy_version 402429 (0.0005) [2023-12-27 22:07:02,761][106225] Updated weights for policy 1, policy_version 402439 (0.0007) [2023-12-27 22:07:03,212][106226] Updated weights for policy 0, policy_version 401485 (0.0006) [2023-12-27 22:07:03,283][106226] Updated weights for policy 0, policy_version 401495 (0.0005) [2023-12-27 22:07:03,359][106226] Updated weights for policy 0, policy_version 401505 (0.0005) [2023-12-27 22:07:03,364][106225] Updated weights for policy 1, policy_version 402449 (0.0008) [2023-12-27 22:07:03,412][106225] Updated weights for policy 1, policy_version 402459 (0.0005) [2023-12-27 22:07:03,459][106225] Updated weights for policy 1, policy_version 402469 (0.0005) [2023-12-27 22:07:03,515][106225] Updated weights for policy 1, policy_version 402479 (0.0006) [2023-12-27 22:07:03,901][106226] Updated weights for policy 0, policy_version 401515 (0.0005) [2023-12-27 22:07:03,971][106226] Updated weights for policy 0, policy_version 401525 (0.0006) [2023-12-27 22:07:04,045][106226] Updated weights for policy 0, policy_version 401535 (0.0005) [2023-12-27 22:07:04,264][106225] Updated weights for policy 1, policy_version 402489 (0.0009) [2023-12-27 22:07:04,334][106225] Updated weights for policy 1, policy_version 402499 (0.0007) [2023-12-27 22:07:04,393][106225] Updated weights for policy 1, policy_version 402509 (0.0008) [2023-12-27 22:07:04,683][106226] Updated weights for policy 0, policy_version 401545 (0.0008) [2023-12-27 22:07:04,742][106226] Updated weights for policy 0, policy_version 401555 (0.0008) [2023-12-27 22:07:04,797][106226] Updated weights for policy 0, policy_version 401565 (0.0008) [2023-12-27 22:07:04,851][106226] Updated weights for policy 0, policy_version 401575 (0.0007) [2023-12-27 22:07:05,069][106225] Updated weights for policy 1, policy_version 402519 (0.0010) [2023-12-27 22:07:05,119][106225] Updated weights for policy 1, policy_version 402529 (0.0010) [2023-12-27 22:07:05,162][106225] Updated weights for policy 1, policy_version 402539 (0.0010) [2023-12-27 22:07:05,489][106226] Updated weights for policy 0, policy_version 401585 (0.0008) [2023-12-27 22:07:05,550][106226] Updated weights for policy 0, policy_version 401595 (0.0005) [2023-12-27 22:07:05,614][106226] Updated weights for policy 0, policy_version 401605 (0.0007) [2023-12-27 22:07:05,806][106225] Updated weights for policy 1, policy_version 402549 (0.0008) [2023-12-27 22:07:05,855][106225] Updated weights for policy 1, policy_version 402559 (0.0005) [2023-12-27 22:07:05,906][106225] Updated weights for policy 1, policy_version 402569 (0.0005) [2023-12-27 22:07:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 205930496. Throughput: 0: 9810.8, 1: 9753.1. Samples: 205939680. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:06,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.784')] [2023-12-27 22:07:06,394][106226] Updated weights for policy 0, policy_version 401615 (0.0008) [2023-12-27 22:07:06,463][106226] Updated weights for policy 0, policy_version 401625 (0.0008) [2023-12-27 22:07:06,521][106226] Updated weights for policy 0, policy_version 401635 (0.0008) [2023-12-27 22:07:06,623][106225] Updated weights for policy 1, policy_version 402579 (0.0008) [2023-12-27 22:07:06,692][106225] Updated weights for policy 1, policy_version 402589 (0.0010) [2023-12-27 22:07:06,749][106225] Updated weights for policy 1, policy_version 402599 (0.0010) [2023-12-27 22:07:07,248][106226] Updated weights for policy 0, policy_version 401645 (0.0010) [2023-12-27 22:07:07,298][106226] Updated weights for policy 0, policy_version 401655 (0.0008) [2023-12-27 22:07:07,352][106226] Updated weights for policy 0, policy_version 401665 (0.0009) [2023-12-27 22:07:07,410][106225] Updated weights for policy 1, policy_version 402609 (0.0010) [2023-12-27 22:07:07,459][106225] Updated weights for policy 1, policy_version 402619 (0.0008) [2023-12-27 22:07:07,513][106225] Updated weights for policy 1, policy_version 402630 (0.0010) [2023-12-27 22:07:07,567][106225] Updated weights for policy 1, policy_version 402640 (0.0005) [2023-12-27 22:07:08,165][106226] Updated weights for policy 0, policy_version 401675 (0.0008) [2023-12-27 22:07:08,174][106225] Updated weights for policy 1, policy_version 402650 (0.0007) [2023-12-27 22:07:08,229][106226] Updated weights for policy 0, policy_version 401685 (0.0006) [2023-12-27 22:07:08,230][106225] Updated weights for policy 1, policy_version 402660 (0.0007) [2023-12-27 22:07:08,295][106225] Updated weights for policy 1, policy_version 402670 (0.0007) [2023-12-27 22:07:08,298][106226] Updated weights for policy 0, policy_version 401695 (0.0008) [2023-12-27 22:07:08,974][106226] Updated weights for policy 0, policy_version 401705 (0.0008) [2023-12-27 22:07:08,994][106225] Updated weights for policy 1, policy_version 402680 (0.0006) [2023-12-27 22:07:09,038][106226] Updated weights for policy 0, policy_version 401715 (0.0007) [2023-12-27 22:07:09,053][106225] Updated weights for policy 1, policy_version 402690 (0.0007) [2023-12-27 22:07:09,103][106226] Updated weights for policy 0, policy_version 401725 (0.0005) [2023-12-27 22:07:09,122][106225] Updated weights for policy 1, policy_version 402700 (0.0006) [2023-12-27 22:07:09,164][106226] Updated weights for policy 0, policy_version 401735 (0.0005) [2023-12-27 22:07:09,804][106226] Updated weights for policy 0, policy_version 401745 (0.0008) [2023-12-27 22:07:09,812][106225] Updated weights for policy 1, policy_version 402710 (0.0010) [2023-12-27 22:07:09,872][106226] Updated weights for policy 0, policy_version 401755 (0.0007) [2023-12-27 22:07:09,881][106225] Updated weights for policy 1, policy_version 402720 (0.0009) [2023-12-27 22:07:09,942][106226] Updated weights for policy 0, policy_version 401765 (0.0008) [2023-12-27 22:07:09,947][106225] Updated weights for policy 1, policy_version 402730 (0.0008) [2023-12-27 22:07:10,582][106225] Updated weights for policy 1, policy_version 402740 (0.0007) [2023-12-27 22:07:10,633][106226] Updated weights for policy 0, policy_version 401775 (0.0007) [2023-12-27 22:07:10,639][106225] Updated weights for policy 1, policy_version 402750 (0.0009) [2023-12-27 22:07:10,703][106226] Updated weights for policy 0, policy_version 401785 (0.0006) [2023-12-27 22:07:10,707][106225] Updated weights for policy 1, policy_version 402760 (0.0009) [2023-12-27 22:07:10,768][106226] Updated weights for policy 0, policy_version 401795 (0.0007) [2023-12-27 22:07:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 206028800. Throughput: 0: 9796.8, 1: 9817.3. Samples: 205998804. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:11,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.968')] [2023-12-27 22:07:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000402768_103137280.pth... [2023-12-27 22:07:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000401800_102891520.pth... [2023-12-27 22:07:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000400680_102604800.pth [2023-12-27 22:07:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000401616_102842368.pth [2023-12-27 22:07:11,504][106226] Updated weights for policy 0, policy_version 401805 (0.0008) [2023-12-27 22:07:11,529][106225] Updated weights for policy 1, policy_version 402770 (0.0009) [2023-12-27 22:07:11,570][106226] Updated weights for policy 0, policy_version 401815 (0.0009) [2023-12-27 22:07:11,600][106225] Updated weights for policy 1, policy_version 402780 (0.0008) [2023-12-27 22:07:11,638][106226] Updated weights for policy 0, policy_version 401825 (0.0008) [2023-12-27 22:07:11,669][106225] Updated weights for policy 1, policy_version 402790 (0.0008) [2023-12-27 22:07:11,740][106225] Updated weights for policy 1, policy_version 402800 (0.0009) [2023-12-27 22:07:12,407][106226] Updated weights for policy 0, policy_version 401835 (0.0008) [2023-12-27 22:07:12,471][106226] Updated weights for policy 0, policy_version 401845 (0.0009) [2023-12-27 22:07:12,513][106225] Updated weights for policy 1, policy_version 402810 (0.0007) [2023-12-27 22:07:12,531][106226] Updated weights for policy 0, policy_version 401855 (0.0009) [2023-12-27 22:07:12,571][106225] Updated weights for policy 1, policy_version 402820 (0.0007) [2023-12-27 22:07:12,631][106225] Updated weights for policy 1, policy_version 402830 (0.0007) [2023-12-27 22:07:13,219][106226] Updated weights for policy 0, policy_version 401865 (0.0009) [2023-12-27 22:07:13,278][106226] Updated weights for policy 0, policy_version 401875 (0.0008) [2023-12-27 22:07:13,339][106226] Updated weights for policy 0, policy_version 401885 (0.0008) [2023-12-27 22:07:13,402][106225] Updated weights for policy 1, policy_version 402840 (0.0007) [2023-12-27 22:07:13,408][106226] Updated weights for policy 0, policy_version 401895 (0.0006) [2023-12-27 22:07:13,459][106225] Updated weights for policy 1, policy_version 402850 (0.0007) [2023-12-27 22:07:13,519][106225] Updated weights for policy 1, policy_version 402860 (0.0008) [2023-12-27 22:07:14,127][106226] Updated weights for policy 0, policy_version 401905 (0.0008) [2023-12-27 22:07:14,171][106226] Updated weights for policy 0, policy_version 401915 (0.0009) [2023-12-27 22:07:14,222][106226] Updated weights for policy 0, policy_version 401925 (0.0009) [2023-12-27 22:07:14,228][106225] Updated weights for policy 1, policy_version 402870 (0.0007) [2023-12-27 22:07:14,283][106225] Updated weights for policy 1, policy_version 402880 (0.0008) [2023-12-27 22:07:14,328][106225] Updated weights for policy 1, policy_version 402890 (0.0008) [2023-12-27 22:07:14,972][106226] Updated weights for policy 0, policy_version 401935 (0.0007) [2023-12-27 22:07:15,039][106226] Updated weights for policy 0, policy_version 401945 (0.0007) [2023-12-27 22:07:15,091][106225] Updated weights for policy 1, policy_version 402900 (0.0008) [2023-12-27 22:07:15,101][106226] Updated weights for policy 0, policy_version 401955 (0.0007) [2023-12-27 22:07:15,144][106225] Updated weights for policy 1, policy_version 402910 (0.0008) [2023-12-27 22:07:15,215][106225] Updated weights for policy 1, policy_version 402920 (0.0008) [2023-12-27 22:07:15,763][106226] Updated weights for policy 0, policy_version 401965 (0.0007) [2023-12-27 22:07:15,822][106226] Updated weights for policy 0, policy_version 401975 (0.0006) [2023-12-27 22:07:15,860][106225] Updated weights for policy 1, policy_version 402930 (0.0008) [2023-12-27 22:07:15,874][106226] Updated weights for policy 0, policy_version 401985 (0.0007) [2023-12-27 22:07:15,908][106225] Updated weights for policy 1, policy_version 402940 (0.0006) [2023-12-27 22:07:15,963][106225] Updated weights for policy 1, policy_version 402950 (0.0008) [2023-12-27 22:07:16,022][106225] Updated weights for policy 1, policy_version 402960 (0.0006) [2023-12-27 22:07:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19521.9). Total num frames: 206127104. Throughput: 0: 9742.7, 1: 9679.1. Samples: 206112756. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:16,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-5.768')] [2023-12-27 22:07:16,478][106226] Updated weights for policy 0, policy_version 401995 (0.0006) [2023-12-27 22:07:16,533][106226] Updated weights for policy 0, policy_version 402005 (0.0007) [2023-12-27 22:07:16,590][106226] Updated weights for policy 0, policy_version 402015 (0.0009) [2023-12-27 22:07:16,782][106225] Updated weights for policy 1, policy_version 402970 (0.0006) [2023-12-27 22:07:16,838][106225] Updated weights for policy 1, policy_version 402980 (0.0006) [2023-12-27 22:07:16,901][106225] Updated weights for policy 1, policy_version 402990 (0.0007) [2023-12-27 22:07:17,348][106226] Updated weights for policy 0, policy_version 402025 (0.0009) [2023-12-27 22:07:17,409][106226] Updated weights for policy 0, policy_version 402035 (0.0009) [2023-12-27 22:07:17,464][106226] Updated weights for policy 0, policy_version 402045 (0.0008) [2023-12-27 22:07:17,516][106226] Updated weights for policy 0, policy_version 402055 (0.0008) [2023-12-27 22:07:17,556][106225] Updated weights for policy 1, policy_version 403000 (0.0008) [2023-12-27 22:07:17,605][106225] Updated weights for policy 1, policy_version 403010 (0.0005) [2023-12-27 22:07:17,654][106225] Updated weights for policy 1, policy_version 403020 (0.0006) [2023-12-27 22:07:18,213][106226] Updated weights for policy 0, policy_version 402065 (0.0009) [2023-12-27 22:07:18,256][106225] Updated weights for policy 1, policy_version 403030 (0.0010) [2023-12-27 22:07:18,263][106226] Updated weights for policy 0, policy_version 402075 (0.0010) [2023-12-27 22:07:18,320][106225] Updated weights for policy 1, policy_version 403040 (0.0010) [2023-12-27 22:07:18,325][106226] Updated weights for policy 0, policy_version 402085 (0.0010) [2023-12-27 22:07:18,385][106225] Updated weights for policy 1, policy_version 403050 (0.0009) [2023-12-27 22:07:19,085][106226] Updated weights for policy 0, policy_version 402095 (0.0011) [2023-12-27 22:07:19,130][106225] Updated weights for policy 1, policy_version 403060 (0.0007) [2023-12-27 22:07:19,147][106226] Updated weights for policy 0, policy_version 402105 (0.0011) [2023-12-27 22:07:19,192][106225] Updated weights for policy 1, policy_version 403070 (0.0006) [2023-12-27 22:07:19,210][106226] Updated weights for policy 0, policy_version 402115 (0.0011) [2023-12-27 22:07:19,260][106225] Updated weights for policy 1, policy_version 403080 (0.0007) [2023-12-27 22:07:19,897][106225] Updated weights for policy 1, policy_version 403090 (0.0008) [2023-12-27 22:07:19,965][106225] Updated weights for policy 1, policy_version 403100 (0.0007) [2023-12-27 22:07:20,031][106225] Updated weights for policy 1, policy_version 403110 (0.0007) [2023-12-27 22:07:20,071][106226] Updated weights for policy 0, policy_version 402125 (0.0008) [2023-12-27 22:07:20,096][106225] Updated weights for policy 1, policy_version 403120 (0.0009) [2023-12-27 22:07:20,134][106226] Updated weights for policy 0, policy_version 402135 (0.0009) [2023-12-27 22:07:20,197][106226] Updated weights for policy 0, policy_version 402145 (0.0009) [2023-12-27 22:07:20,766][106225] Updated weights for policy 1, policy_version 403130 (0.0008) [2023-12-27 22:07:20,831][106225] Updated weights for policy 1, policy_version 403140 (0.0008) [2023-12-27 22:07:20,899][106225] Updated weights for policy 1, policy_version 403150 (0.0009) [2023-12-27 22:07:20,928][106226] Updated weights for policy 0, policy_version 402155 (0.0009) [2023-12-27 22:07:20,990][106226] Updated weights for policy 0, policy_version 402165 (0.0008) [2023-12-27 22:07:21,068][106226] Updated weights for policy 0, policy_version 402175 (0.0009) [2023-12-27 22:07:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 206225408. Throughput: 0: 9592.5, 1: 9729.3. Samples: 206229960. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:21,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.905')] [2023-12-27 22:07:21,685][106225] Updated weights for policy 1, policy_version 403160 (0.0009) [2023-12-27 22:07:21,755][106225] Updated weights for policy 1, policy_version 403170 (0.0009) [2023-12-27 22:07:21,823][106225] Updated weights for policy 1, policy_version 403180 (0.0008) [2023-12-27 22:07:21,883][106226] Updated weights for policy 0, policy_version 402185 (0.0008) [2023-12-27 22:07:21,940][106226] Updated weights for policy 0, policy_version 402195 (0.0008) [2023-12-27 22:07:21,999][106226] Updated weights for policy 0, policy_version 402205 (0.0009) [2023-12-27 22:07:22,068][106226] Updated weights for policy 0, policy_version 402215 (0.0009) [2023-12-27 22:07:22,561][106225] Updated weights for policy 1, policy_version 403190 (0.0008) [2023-12-27 22:07:22,621][106225] Updated weights for policy 1, policy_version 403200 (0.0008) [2023-12-27 22:07:22,681][106225] Updated weights for policy 1, policy_version 403210 (0.0009) [2023-12-27 22:07:22,793][106226] Updated weights for policy 0, policy_version 402225 (0.0006) [2023-12-27 22:07:22,859][106226] Updated weights for policy 0, policy_version 402235 (0.0008) [2023-12-27 22:07:22,914][106226] Updated weights for policy 0, policy_version 402245 (0.0008) [2023-12-27 22:07:23,463][106225] Updated weights for policy 1, policy_version 403220 (0.0009) [2023-12-27 22:07:23,525][106225] Updated weights for policy 1, policy_version 403230 (0.0009) [2023-12-27 22:07:23,582][106225] Updated weights for policy 1, policy_version 403240 (0.0008) [2023-12-27 22:07:23,632][106226] Updated weights for policy 0, policy_version 402255 (0.0008) [2023-12-27 22:07:23,696][106226] Updated weights for policy 0, policy_version 402265 (0.0008) [2023-12-27 22:07:23,755][106226] Updated weights for policy 0, policy_version 402275 (0.0008) [2023-12-27 22:07:24,293][106225] Updated weights for policy 1, policy_version 403250 (0.0007) [2023-12-27 22:07:24,366][106225] Updated weights for policy 1, policy_version 403260 (0.0008) [2023-12-27 22:07:24,430][106225] Updated weights for policy 1, policy_version 403270 (0.0008) [2023-12-27 22:07:24,434][106226] Updated weights for policy 0, policy_version 402285 (0.0007) [2023-12-27 22:07:24,483][106226] Updated weights for policy 0, policy_version 402295 (0.0005) [2023-12-27 22:07:24,487][106225] Updated weights for policy 1, policy_version 403280 (0.0009) [2023-12-27 22:07:24,535][106226] Updated weights for policy 0, policy_version 402305 (0.0007) [2023-12-27 22:07:25,143][106225] Updated weights for policy 1, policy_version 403290 (0.0006) [2023-12-27 22:07:25,190][106225] Updated weights for policy 1, policy_version 403300 (0.0006) [2023-12-27 22:07:25,219][106226] Updated weights for policy 0, policy_version 402315 (0.0007) [2023-12-27 22:07:25,242][106225] Updated weights for policy 1, policy_version 403310 (0.0006) [2023-12-27 22:07:25,267][106226] Updated weights for policy 0, policy_version 402325 (0.0006) [2023-12-27 22:07:25,319][106226] Updated weights for policy 0, policy_version 402335 (0.0010) [2023-12-27 22:07:25,919][106225] Updated weights for policy 1, policy_version 403320 (0.0007) [2023-12-27 22:07:25,968][106225] Updated weights for policy 1, policy_version 403330 (0.0009) [2023-12-27 22:07:26,007][106226] Updated weights for policy 0, policy_version 402345 (0.0010) [2023-12-27 22:07:26,017][106225] Updated weights for policy 1, policy_version 403340 (0.0007) [2023-12-27 22:07:26,057][106226] Updated weights for policy 0, policy_version 402355 (0.0010) [2023-12-27 22:07:26,110][106226] Updated weights for policy 0, policy_version 402365 (0.0008) [2023-12-27 22:07:26,166][106226] Updated weights for policy 0, policy_version 402375 (0.0005) [2023-12-27 22:07:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 206323712. Throughput: 0: 9542.2, 1: 9669.4. Samples: 206284364. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:26,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-6.030')] [2023-12-27 22:07:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000403344_103284736.pth... [2023-12-27 22:07:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000402376_103038976.pth... [2023-12-27 22:07:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000402192_102989824.pth [2023-12-27 22:07:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000401224_102744064.pth [2023-12-27 22:07:26,635][106225] Updated weights for policy 1, policy_version 403350 (0.0005) [2023-12-27 22:07:26,695][106225] Updated weights for policy 1, policy_version 403360 (0.0005) [2023-12-27 22:07:26,740][106226] Updated weights for policy 0, policy_version 402385 (0.0005) [2023-12-27 22:07:26,751][106225] Updated weights for policy 1, policy_version 403370 (0.0007) [2023-12-27 22:07:26,789][106226] Updated weights for policy 0, policy_version 402395 (0.0005) [2023-12-27 22:07:26,837][106226] Updated weights for policy 0, policy_version 402405 (0.0005) [2023-12-27 22:07:27,344][106226] Updated weights for policy 0, policy_version 402415 (0.0008) [2023-12-27 22:07:27,395][106226] Updated weights for policy 0, policy_version 402425 (0.0008) [2023-12-27 22:07:27,446][106226] Updated weights for policy 0, policy_version 402435 (0.0005) [2023-12-27 22:07:27,491][106225] Updated weights for policy 1, policy_version 403380 (0.0007) [2023-12-27 22:07:27,551][106225] Updated weights for policy 1, policy_version 403390 (0.0007) [2023-12-27 22:07:27,605][106225] Updated weights for policy 1, policy_version 403400 (0.0009) [2023-12-27 22:07:28,089][106226] Updated weights for policy 0, policy_version 402445 (0.0008) [2023-12-27 22:07:28,147][106226] Updated weights for policy 0, policy_version 402455 (0.0009) [2023-12-27 22:07:28,201][106226] Updated weights for policy 0, policy_version 402465 (0.0009) [2023-12-27 22:07:28,259][106225] Updated weights for policy 1, policy_version 403410 (0.0008) [2023-12-27 22:07:28,311][106225] Updated weights for policy 1, policy_version 403420 (0.0009) [2023-12-27 22:07:28,377][106225] Updated weights for policy 1, policy_version 403430 (0.0008) [2023-12-27 22:07:28,446][106225] Updated weights for policy 1, policy_version 403440 (0.0008) [2023-12-27 22:07:28,961][106226] Updated weights for policy 0, policy_version 402475 (0.0009) [2023-12-27 22:07:29,011][106226] Updated weights for policy 0, policy_version 402485 (0.0009) [2023-12-27 22:07:29,060][106226] Updated weights for policy 0, policy_version 402495 (0.0009) [2023-12-27 22:07:29,118][106225] Updated weights for policy 1, policy_version 403450 (0.0005) [2023-12-27 22:07:29,177][106225] Updated weights for policy 1, policy_version 403460 (0.0007) [2023-12-27 22:07:29,235][106225] Updated weights for policy 1, policy_version 403470 (0.0008) [2023-12-27 22:07:29,802][106226] Updated weights for policy 0, policy_version 402505 (0.0008) [2023-12-27 22:07:29,869][106226] Updated weights for policy 0, policy_version 402515 (0.0008) [2023-12-27 22:07:29,932][106226] Updated weights for policy 0, policy_version 402525 (0.0006) [2023-12-27 22:07:29,998][106226] Updated weights for policy 0, policy_version 402535 (0.0009) [2023-12-27 22:07:30,019][106225] Updated weights for policy 1, policy_version 403480 (0.0009) [2023-12-27 22:07:30,077][106225] Updated weights for policy 1, policy_version 403490 (0.0009) [2023-12-27 22:07:30,138][106225] Updated weights for policy 1, policy_version 403500 (0.0009) [2023-12-27 22:07:30,649][106226] Updated weights for policy 0, policy_version 402545 (0.0008) [2023-12-27 22:07:30,699][106226] Updated weights for policy 0, policy_version 402555 (0.0007) [2023-12-27 22:07:30,749][106226] Updated weights for policy 0, policy_version 402565 (0.0008) [2023-12-27 22:07:30,795][106225] Updated weights for policy 1, policy_version 403510 (0.0008) [2023-12-27 22:07:30,851][106225] Updated weights for policy 1, policy_version 403520 (0.0008) [2023-12-27 22:07:30,905][106225] Updated weights for policy 1, policy_version 403530 (0.0008) [2023-12-27 22:07:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 206422016. Throughput: 0: 9704.4, 1: 9737.7. Samples: 206409300. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:31,175][105115] Avg episode reward: [(0, '-5.134'), (1, '-5.724')] [2023-12-27 22:07:31,448][106226] Updated weights for policy 0, policy_version 402575 (0.0008) [2023-12-27 22:07:31,500][106226] Updated weights for policy 0, policy_version 402585 (0.0009) [2023-12-27 22:07:31,553][106226] Updated weights for policy 0, policy_version 402595 (0.0008) [2023-12-27 22:07:31,637][106225] Updated weights for policy 1, policy_version 403540 (0.0006) [2023-12-27 22:07:31,699][106225] Updated weights for policy 1, policy_version 403550 (0.0008) [2023-12-27 22:07:31,762][106225] Updated weights for policy 1, policy_version 403560 (0.0007) [2023-12-27 22:07:32,334][106225] Updated weights for policy 1, policy_version 403570 (0.0006) [2023-12-27 22:07:32,399][106226] Updated weights for policy 0, policy_version 402605 (0.0008) [2023-12-27 22:07:32,403][106225] Updated weights for policy 1, policy_version 403580 (0.0007) [2023-12-27 22:07:32,464][106226] Updated weights for policy 0, policy_version 402615 (0.0007) [2023-12-27 22:07:32,470][106225] Updated weights for policy 1, policy_version 403590 (0.0008) [2023-12-27 22:07:32,522][106226] Updated weights for policy 0, policy_version 402625 (0.0006) [2023-12-27 22:07:32,524][106225] Updated weights for policy 1, policy_version 403600 (0.0006) [2023-12-27 22:07:33,165][106225] Updated weights for policy 1, policy_version 403610 (0.0005) [2023-12-27 22:07:33,214][106225] Updated weights for policy 1, policy_version 403620 (0.0006) [2023-12-27 22:07:33,258][106225] Updated weights for policy 1, policy_version 403630 (0.0008) [2023-12-27 22:07:33,284][106226] Updated weights for policy 0, policy_version 402635 (0.0009) [2023-12-27 22:07:33,332][106226] Updated weights for policy 0, policy_version 402645 (0.0009) [2023-12-27 22:07:33,384][106226] Updated weights for policy 0, policy_version 402655 (0.0008) [2023-12-27 22:07:34,000][106225] Updated weights for policy 1, policy_version 403640 (0.0008) [2023-12-27 22:07:34,019][106226] Updated weights for policy 0, policy_version 402665 (0.0008) [2023-12-27 22:07:34,054][106225] Updated weights for policy 1, policy_version 403650 (0.0008) [2023-12-27 22:07:34,069][106226] Updated weights for policy 0, policy_version 402675 (0.0006) [2023-12-27 22:07:34,105][106225] Updated weights for policy 1, policy_version 403660 (0.0008) [2023-12-27 22:07:34,118][106226] Updated weights for policy 0, policy_version 402685 (0.0006) [2023-12-27 22:07:34,179][106226] Updated weights for policy 0, policy_version 402695 (0.0008) [2023-12-27 22:07:34,822][106225] Updated weights for policy 1, policy_version 403670 (0.0008) [2023-12-27 22:07:34,883][106225] Updated weights for policy 1, policy_version 403680 (0.0008) [2023-12-27 22:07:34,941][106225] Updated weights for policy 1, policy_version 403690 (0.0005) [2023-12-27 22:07:34,942][106226] Updated weights for policy 0, policy_version 402705 (0.0008) [2023-12-27 22:07:34,992][106226] Updated weights for policy 0, policy_version 402715 (0.0007) [2023-12-27 22:07:35,041][106226] Updated weights for policy 0, policy_version 402725 (0.0008) [2023-12-27 22:07:35,580][106225] Updated weights for policy 1, policy_version 403700 (0.0005) [2023-12-27 22:07:35,638][106225] Updated weights for policy 1, policy_version 403710 (0.0006) [2023-12-27 22:07:35,686][106225] Updated weights for policy 1, policy_version 403720 (0.0008) [2023-12-27 22:07:35,825][106226] Updated weights for policy 0, policy_version 402735 (0.0008) [2023-12-27 22:07:35,881][106226] Updated weights for policy 0, policy_version 402745 (0.0009) [2023-12-27 22:07:35,936][106226] Updated weights for policy 0, policy_version 402755 (0.0008) [2023-12-27 22:07:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 206520320. Throughput: 0: 9722.7, 1: 9791.8. Samples: 206527760. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:36,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-5.755')] [2023-12-27 22:07:36,411][106225] Updated weights for policy 1, policy_version 403730 (0.0008) [2023-12-27 22:07:36,471][106225] Updated weights for policy 1, policy_version 403740 (0.0008) [2023-12-27 22:07:36,538][106225] Updated weights for policy 1, policy_version 403750 (0.0008) [2023-12-27 22:07:36,604][106225] Updated weights for policy 1, policy_version 403760 (0.0008) [2023-12-27 22:07:36,710][106226] Updated weights for policy 0, policy_version 402765 (0.0008) [2023-12-27 22:07:36,768][106226] Updated weights for policy 0, policy_version 402775 (0.0007) [2023-12-27 22:07:36,829][106226] Updated weights for policy 0, policy_version 402785 (0.0009) [2023-12-27 22:07:37,250][106225] Updated weights for policy 1, policy_version 403770 (0.0010) [2023-12-27 22:07:37,309][106225] Updated weights for policy 1, policy_version 403780 (0.0010) [2023-12-27 22:07:37,365][106225] Updated weights for policy 1, policy_version 403790 (0.0010) [2023-12-27 22:07:37,585][106226] Updated weights for policy 0, policy_version 402795 (0.0008) [2023-12-27 22:07:37,650][106226] Updated weights for policy 0, policy_version 402805 (0.0008) [2023-12-27 22:07:37,719][106226] Updated weights for policy 0, policy_version 402815 (0.0008) [2023-12-27 22:07:38,095][106225] Updated weights for policy 1, policy_version 403800 (0.0010) [2023-12-27 22:07:38,157][106225] Updated weights for policy 1, policy_version 403810 (0.0008) [2023-12-27 22:07:38,216][106225] Updated weights for policy 1, policy_version 403820 (0.0008) [2023-12-27 22:07:38,460][106226] Updated weights for policy 0, policy_version 402825 (0.0008) [2023-12-27 22:07:38,516][106226] Updated weights for policy 0, policy_version 402835 (0.0008) [2023-12-27 22:07:38,576][106226] Updated weights for policy 0, policy_version 402845 (0.0008) [2023-12-27 22:07:38,641][106226] Updated weights for policy 0, policy_version 402855 (0.0008) [2023-12-27 22:07:38,974][106225] Updated weights for policy 1, policy_version 403830 (0.0007) [2023-12-27 22:07:39,022][106225] Updated weights for policy 1, policy_version 403840 (0.0008) [2023-12-27 22:07:39,070][106225] Updated weights for policy 1, policy_version 403850 (0.0008) [2023-12-27 22:07:39,414][106226] Updated weights for policy 0, policy_version 402865 (0.0009) [2023-12-27 22:07:39,480][106226] Updated weights for policy 0, policy_version 402875 (0.0006) [2023-12-27 22:07:39,545][106226] Updated weights for policy 0, policy_version 402885 (0.0008) [2023-12-27 22:07:39,816][106225] Updated weights for policy 1, policy_version 403860 (0.0009) [2023-12-27 22:07:39,886][106225] Updated weights for policy 1, policy_version 403870 (0.0010) [2023-12-27 22:07:39,952][106225] Updated weights for policy 1, policy_version 403880 (0.0012) [2023-12-27 22:07:40,267][106226] Updated weights for policy 0, policy_version 402895 (0.0006) [2023-12-27 22:07:40,323][106226] Updated weights for policy 0, policy_version 402905 (0.0006) [2023-12-27 22:07:40,382][106226] Updated weights for policy 0, policy_version 402915 (0.0007) [2023-12-27 22:07:40,683][106225] Updated weights for policy 1, policy_version 403890 (0.0010) [2023-12-27 22:07:40,734][106225] Updated weights for policy 1, policy_version 403900 (0.0005) [2023-12-27 22:07:40,793][106225] Updated weights for policy 1, policy_version 403910 (0.0006) [2023-12-27 22:07:40,861][106225] Updated weights for policy 1, policy_version 403920 (0.0006) [2023-12-27 22:07:41,118][106226] Updated weights for policy 0, policy_version 402925 (0.0008) [2023-12-27 22:07:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 206610432. Throughput: 0: 9742.0, 1: 9799.2. Samples: 206584260. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:41,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-6.027')] [2023-12-27 22:07:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000403920_103432192.pth... [2023-12-27 22:07:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000402768_103137280.pth [2023-12-27 22:07:41,190][106226] Updated weights for policy 0, policy_version 402935 (0.0009) [2023-12-27 22:07:41,265][106226] Updated weights for policy 0, policy_version 402945 (0.0008) [2023-12-27 22:07:41,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000402952_103186432.pth... [2023-12-27 22:07:41,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000401800_102891520.pth [2023-12-27 22:07:41,589][106225] Updated weights for policy 1, policy_version 403930 (0.0008) [2023-12-27 22:07:41,651][106225] Updated weights for policy 1, policy_version 403940 (0.0008) [2023-12-27 22:07:41,717][106225] Updated weights for policy 1, policy_version 403950 (0.0008) [2023-12-27 22:07:42,119][106226] Updated weights for policy 0, policy_version 402955 (0.0008) [2023-12-27 22:07:42,173][106226] Updated weights for policy 0, policy_version 402965 (0.0009) [2023-12-27 22:07:42,227][106226] Updated weights for policy 0, policy_version 402975 (0.0009) [2023-12-27 22:07:42,466][106225] Updated weights for policy 1, policy_version 403960 (0.0006) [2023-12-27 22:07:42,525][106225] Updated weights for policy 1, policy_version 403970 (0.0005) [2023-12-27 22:07:42,581][106225] Updated weights for policy 1, policy_version 403980 (0.0005) [2023-12-27 22:07:43,072][106226] Updated weights for policy 0, policy_version 402985 (0.0008) [2023-12-27 22:07:43,132][106226] Updated weights for policy 0, policy_version 402995 (0.0008) [2023-12-27 22:07:43,192][106226] Updated weights for policy 0, policy_version 403005 (0.0009) [2023-12-27 22:07:43,218][106225] Updated weights for policy 1, policy_version 403990 (0.0006) [2023-12-27 22:07:43,244][106226] Updated weights for policy 0, policy_version 403015 (0.0006) [2023-12-27 22:07:43,275][106225] Updated weights for policy 1, policy_version 404000 (0.0008) [2023-12-27 22:07:43,338][106225] Updated weights for policy 1, policy_version 404010 (0.0009) [2023-12-27 22:07:43,980][106226] Updated weights for policy 0, policy_version 403025 (0.0009) [2023-12-27 22:07:44,048][106226] Updated weights for policy 0, policy_version 403035 (0.0005) [2023-12-27 22:07:44,091][106225] Updated weights for policy 1, policy_version 404020 (0.0007) [2023-12-27 22:07:44,099][106226] Updated weights for policy 0, policy_version 403045 (0.0008) [2023-12-27 22:07:44,146][106225] Updated weights for policy 1, policy_version 404030 (0.0006) [2023-12-27 22:07:44,214][106225] Updated weights for policy 1, policy_version 404040 (0.0006) [2023-12-27 22:07:44,682][106226] Updated weights for policy 0, policy_version 403055 (0.0008) [2023-12-27 22:07:44,736][106226] Updated weights for policy 0, policy_version 403065 (0.0009) [2023-12-27 22:07:44,809][106226] Updated weights for policy 0, policy_version 403075 (0.0007) [2023-12-27 22:07:44,941][106225] Updated weights for policy 1, policy_version 404050 (0.0006) [2023-12-27 22:07:45,003][106225] Updated weights for policy 1, policy_version 404060 (0.0010) [2023-12-27 22:07:45,067][106225] Updated weights for policy 1, policy_version 404070 (0.0008) [2023-12-27 22:07:45,131][106225] Updated weights for policy 1, policy_version 404080 (0.0008) [2023-12-27 22:07:45,481][106226] Updated weights for policy 0, policy_version 403085 (0.0007) [2023-12-27 22:07:45,533][106226] Updated weights for policy 0, policy_version 403095 (0.0011) [2023-12-27 22:07:45,584][106226] Updated weights for policy 0, policy_version 403105 (0.0011) [2023-12-27 22:07:45,880][106225] Updated weights for policy 1, policy_version 404090 (0.0010) [2023-12-27 22:07:45,934][106225] Updated weights for policy 1, policy_version 404100 (0.0010) [2023-12-27 22:07:45,988][106225] Updated weights for policy 1, policy_version 404110 (0.0010) [2023-12-27 22:07:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19522.0). Total num frames: 206708736. Throughput: 0: 9693.1, 1: 9800.9. Samples: 206698120. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:46,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-5.966')] [2023-12-27 22:07:46,319][106226] Updated weights for policy 0, policy_version 403115 (0.0010) [2023-12-27 22:07:46,380][106226] Updated weights for policy 0, policy_version 403125 (0.0008) [2023-12-27 22:07:46,431][106226] Updated weights for policy 0, policy_version 403135 (0.0007) [2023-12-27 22:07:46,725][106225] Updated weights for policy 1, policy_version 404120 (0.0011) [2023-12-27 22:07:46,797][106225] Updated weights for policy 1, policy_version 404130 (0.0011) [2023-12-27 22:07:46,854][106225] Updated weights for policy 1, policy_version 404140 (0.0010) [2023-12-27 22:07:47,156][106226] Updated weights for policy 0, policy_version 403145 (0.0008) [2023-12-27 22:07:47,220][106226] Updated weights for policy 0, policy_version 403155 (0.0007) [2023-12-27 22:07:47,279][106226] Updated weights for policy 0, policy_version 403165 (0.0008) [2023-12-27 22:07:47,347][106226] Updated weights for policy 0, policy_version 403175 (0.0008) [2023-12-27 22:07:47,543][106225] Updated weights for policy 1, policy_version 404150 (0.0010) [2023-12-27 22:07:47,594][106225] Updated weights for policy 1, policy_version 404160 (0.0010) [2023-12-27 22:07:47,644][106225] Updated weights for policy 1, policy_version 404170 (0.0010) [2023-12-27 22:07:48,096][106226] Updated weights for policy 0, policy_version 403185 (0.0008) [2023-12-27 22:07:48,151][106226] Updated weights for policy 0, policy_version 403195 (0.0009) [2023-12-27 22:07:48,200][106226] Updated weights for policy 0, policy_version 403205 (0.0008) [2023-12-27 22:07:48,366][106225] Updated weights for policy 1, policy_version 404180 (0.0009) [2023-12-27 22:07:48,432][106225] Updated weights for policy 1, policy_version 404190 (0.0008) [2023-12-27 22:07:48,494][106225] Updated weights for policy 1, policy_version 404200 (0.0008) [2023-12-27 22:07:48,862][106226] Updated weights for policy 0, policy_version 403215 (0.0007) [2023-12-27 22:07:48,926][106226] Updated weights for policy 0, policy_version 403225 (0.0007) [2023-12-27 22:07:48,984][106226] Updated weights for policy 0, policy_version 403235 (0.0007) [2023-12-27 22:07:49,215][106225] Updated weights for policy 1, policy_version 404210 (0.0008) [2023-12-27 22:07:49,285][106225] Updated weights for policy 1, policy_version 404220 (0.0008) [2023-12-27 22:07:49,351][106225] Updated weights for policy 1, policy_version 404230 (0.0008) [2023-12-27 22:07:49,425][106225] Updated weights for policy 1, policy_version 404240 (0.0007) [2023-12-27 22:07:49,740][106226] Updated weights for policy 0, policy_version 403245 (0.0009) [2023-12-27 22:07:49,802][106226] Updated weights for policy 0, policy_version 403255 (0.0009) [2023-12-27 22:07:49,867][106226] Updated weights for policy 0, policy_version 403265 (0.0007) [2023-12-27 22:07:50,130][106225] Updated weights for policy 1, policy_version 404250 (0.0009) [2023-12-27 22:07:50,193][106225] Updated weights for policy 1, policy_version 404260 (0.0008) [2023-12-27 22:07:50,252][106225] Updated weights for policy 1, policy_version 404270 (0.0008) [2023-12-27 22:07:50,570][106226] Updated weights for policy 0, policy_version 403275 (0.0008) [2023-12-27 22:07:50,639][106226] Updated weights for policy 0, policy_version 403285 (0.0009) [2023-12-27 22:07:50,693][106226] Updated weights for policy 0, policy_version 403295 (0.0007) [2023-12-27 22:07:50,974][106225] Updated weights for policy 1, policy_version 404280 (0.0008) [2023-12-27 22:07:51,033][106225] Updated weights for policy 1, policy_version 404290 (0.0008) [2023-12-27 22:07:51,101][106225] Updated weights for policy 1, policy_version 404300 (0.0008) [2023-12-27 22:07:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 206807040. Throughput: 0: 9622.1, 1: 9787.5. Samples: 206813112. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:51,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.859')] [2023-12-27 22:07:51,489][106226] Updated weights for policy 0, policy_version 403305 (0.0008) [2023-12-27 22:07:51,554][106226] Updated weights for policy 0, policy_version 403315 (0.0008) [2023-12-27 22:07:51,620][106226] Updated weights for policy 0, policy_version 403325 (0.0009) [2023-12-27 22:07:51,688][106226] Updated weights for policy 0, policy_version 403335 (0.0008) [2023-12-27 22:07:51,899][106225] Updated weights for policy 1, policy_version 404310 (0.0008) [2023-12-27 22:07:51,958][106225] Updated weights for policy 1, policy_version 404320 (0.0008) [2023-12-27 22:07:52,021][106225] Updated weights for policy 1, policy_version 404330 (0.0008) [2023-12-27 22:07:52,437][106226] Updated weights for policy 0, policy_version 403345 (0.0006) [2023-12-27 22:07:52,493][106226] Updated weights for policy 0, policy_version 403355 (0.0007) [2023-12-27 22:07:52,546][106226] Updated weights for policy 0, policy_version 403365 (0.0009) [2023-12-27 22:07:52,742][106225] Updated weights for policy 1, policy_version 404340 (0.0009) [2023-12-27 22:07:52,807][106225] Updated weights for policy 1, policy_version 404350 (0.0010) [2023-12-27 22:07:52,871][106225] Updated weights for policy 1, policy_version 404360 (0.0011) [2023-12-27 22:07:53,124][106226] Updated weights for policy 0, policy_version 403375 (0.0008) [2023-12-27 22:07:53,183][106226] Updated weights for policy 0, policy_version 403385 (0.0008) [2023-12-27 22:07:53,238][106226] Updated weights for policy 0, policy_version 403395 (0.0008) [2023-12-27 22:07:53,613][106225] Updated weights for policy 1, policy_version 404370 (0.0010) [2023-12-27 22:07:53,674][106225] Updated weights for policy 1, policy_version 404380 (0.0009) [2023-12-27 22:07:53,742][106225] Updated weights for policy 1, policy_version 404390 (0.0008) [2023-12-27 22:07:53,805][106225] Updated weights for policy 1, policy_version 404400 (0.0008) [2023-12-27 22:07:53,938][106226] Updated weights for policy 0, policy_version 403405 (0.0008) [2023-12-27 22:07:53,996][106226] Updated weights for policy 0, policy_version 403415 (0.0009) [2023-12-27 22:07:54,062][106226] Updated weights for policy 0, policy_version 403425 (0.0009) [2023-12-27 22:07:54,440][106225] Updated weights for policy 1, policy_version 404410 (0.0008) [2023-12-27 22:07:54,484][106225] Updated weights for policy 1, policy_version 404420 (0.0008) [2023-12-27 22:07:54,533][106225] Updated weights for policy 1, policy_version 404430 (0.0008) [2023-12-27 22:07:54,830][106226] Updated weights for policy 0, policy_version 403435 (0.0009) [2023-12-27 22:07:54,893][106226] Updated weights for policy 0, policy_version 403445 (0.0009) [2023-12-27 22:07:54,952][106226] Updated weights for policy 0, policy_version 403455 (0.0008) [2023-12-27 22:07:55,222][106225] Updated weights for policy 1, policy_version 404440 (0.0008) [2023-12-27 22:07:55,284][106225] Updated weights for policy 1, policy_version 404450 (0.0006) [2023-12-27 22:07:55,335][106225] Updated weights for policy 1, policy_version 404460 (0.0005) [2023-12-27 22:07:55,584][106226] Updated weights for policy 0, policy_version 403465 (0.0008) [2023-12-27 22:07:55,632][106226] Updated weights for policy 0, policy_version 403475 (0.0005) [2023-12-27 22:07:55,680][106226] Updated weights for policy 0, policy_version 403485 (0.0005) [2023-12-27 22:07:55,736][106226] Updated weights for policy 0, policy_version 403495 (0.0006) [2023-12-27 22:07:56,001][106225] Updated weights for policy 1, policy_version 404470 (0.0007) [2023-12-27 22:07:56,065][106225] Updated weights for policy 1, policy_version 404480 (0.0010) [2023-12-27 22:07:56,124][106225] Updated weights for policy 1, policy_version 404490 (0.0010) [2023-12-27 22:07:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 206905344. Throughput: 0: 9651.9, 1: 9714.6. Samples: 206870296. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:07:56,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-6.067')] [2023-12-27 22:07:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000404496_103579648.pth... [2023-12-27 22:07:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000403496_103325696.pth... [2023-12-27 22:07:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000403344_103284736.pth [2023-12-27 22:07:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000402376_103038976.pth [2023-12-27 22:07:56,394][106226] Updated weights for policy 0, policy_version 403505 (0.0007) [2023-12-27 22:07:56,457][106226] Updated weights for policy 0, policy_version 403515 (0.0008) [2023-12-27 22:07:56,508][106226] Updated weights for policy 0, policy_version 403525 (0.0008) [2023-12-27 22:07:56,834][106225] Updated weights for policy 1, policy_version 404500 (0.0010) [2023-12-27 22:07:56,895][106225] Updated weights for policy 1, policy_version 404510 (0.0010) [2023-12-27 22:07:56,951][106225] Updated weights for policy 1, policy_version 404520 (0.0010) [2023-12-27 22:07:57,248][106226] Updated weights for policy 0, policy_version 403535 (0.0007) [2023-12-27 22:07:57,301][106226] Updated weights for policy 0, policy_version 403545 (0.0008) [2023-12-27 22:07:57,352][106226] Updated weights for policy 0, policy_version 403555 (0.0008) [2023-12-27 22:07:57,654][106225] Updated weights for policy 1, policy_version 404530 (0.0010) [2023-12-27 22:07:57,707][106225] Updated weights for policy 1, policy_version 404540 (0.0010) [2023-12-27 22:07:57,757][106225] Updated weights for policy 1, policy_version 404550 (0.0010) [2023-12-27 22:07:57,804][106225] Updated weights for policy 1, policy_version 404560 (0.0010) [2023-12-27 22:07:58,079][106226] Updated weights for policy 0, policy_version 403565 (0.0008) [2023-12-27 22:07:58,134][106226] Updated weights for policy 0, policy_version 403575 (0.0008) [2023-12-27 22:07:58,184][106226] Updated weights for policy 0, policy_version 403585 (0.0008) [2023-12-27 22:07:58,544][106225] Updated weights for policy 1, policy_version 404570 (0.0008) [2023-12-27 22:07:58,611][106225] Updated weights for policy 1, policy_version 404580 (0.0008) [2023-12-27 22:07:58,692][106225] Updated weights for policy 1, policy_version 404590 (0.0008) [2023-12-27 22:07:58,990][106226] Updated weights for policy 0, policy_version 403595 (0.0009) [2023-12-27 22:07:59,056][106226] Updated weights for policy 0, policy_version 403605 (0.0008) [2023-12-27 22:07:59,119][106226] Updated weights for policy 0, policy_version 403615 (0.0007) [2023-12-27 22:07:59,562][106225] Updated weights for policy 1, policy_version 404600 (0.0007) [2023-12-27 22:07:59,620][106225] Updated weights for policy 1, policy_version 404610 (0.0009) [2023-12-27 22:07:59,677][106225] Updated weights for policy 1, policy_version 404620 (0.0005) [2023-12-27 22:07:59,915][106226] Updated weights for policy 0, policy_version 403625 (0.0008) [2023-12-27 22:07:59,981][106226] Updated weights for policy 0, policy_version 403635 (0.0008) [2023-12-27 22:08:00,034][106226] Updated weights for policy 0, policy_version 403645 (0.0010) [2023-12-27 22:08:00,082][106226] Updated weights for policy 0, policy_version 403655 (0.0008) [2023-12-27 22:08:00,360][106225] Updated weights for policy 1, policy_version 404630 (0.0008) [2023-12-27 22:08:00,416][106225] Updated weights for policy 1, policy_version 404640 (0.0009) [2023-12-27 22:08:00,470][106225] Updated weights for policy 1, policy_version 404650 (0.0009) [2023-12-27 22:08:00,848][106226] Updated weights for policy 0, policy_version 403665 (0.0008) [2023-12-27 22:08:00,902][106226] Updated weights for policy 0, policy_version 403675 (0.0008) [2023-12-27 22:08:00,962][106226] Updated weights for policy 0, policy_version 403685 (0.0008) [2023-12-27 22:08:01,095][106225] Updated weights for policy 1, policy_version 404661 (0.0010) [2023-12-27 22:08:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 206995456. Throughput: 0: 9650.5, 1: 9753.7. Samples: 206985944. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:08:01,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-5.914')] [2023-12-27 22:08:01,199][106225] Updated weights for policy 1, policy_version 404671 (0.0008) [2023-12-27 22:08:01,258][106225] Updated weights for policy 1, policy_version 404681 (0.0008) [2023-12-27 22:08:01,741][106226] Updated weights for policy 0, policy_version 403695 (0.0010) [2023-12-27 22:08:01,810][106226] Updated weights for policy 0, policy_version 403705 (0.0008) [2023-12-27 22:08:01,868][106226] Updated weights for policy 0, policy_version 403715 (0.0011) [2023-12-27 22:08:01,945][106225] Updated weights for policy 1, policy_version 404691 (0.0008) [2023-12-27 22:08:02,011][106225] Updated weights for policy 1, policy_version 404701 (0.0005) [2023-12-27 22:08:02,066][106225] Updated weights for policy 1, policy_version 404711 (0.0005) [2023-12-27 22:08:02,633][106226] Updated weights for policy 0, policy_version 403725 (0.0011) [2023-12-27 22:08:02,680][106225] Updated weights for policy 1, policy_version 404721 (0.0005) [2023-12-27 22:08:02,682][106226] Updated weights for policy 0, policy_version 403735 (0.0008) [2023-12-27 22:08:02,736][106225] Updated weights for policy 1, policy_version 404731 (0.0006) [2023-12-27 22:08:02,739][106226] Updated weights for policy 0, policy_version 403745 (0.0008) [2023-12-27 22:08:02,792][106225] Updated weights for policy 1, policy_version 404741 (0.0008) [2023-12-27 22:08:02,835][106225] Updated weights for policy 1, policy_version 404751 (0.0008) [2023-12-27 22:08:03,408][106226] Updated weights for policy 0, policy_version 403755 (0.0007) [2023-12-27 22:08:03,469][106226] Updated weights for policy 0, policy_version 403765 (0.0008) [2023-12-27 22:08:03,527][106226] Updated weights for policy 0, policy_version 403775 (0.0007) [2023-12-27 22:08:03,575][106225] Updated weights for policy 1, policy_version 404761 (0.0008) [2023-12-27 22:08:03,634][106225] Updated weights for policy 1, policy_version 404771 (0.0005) [2023-12-27 22:08:03,699][106225] Updated weights for policy 1, policy_version 404781 (0.0005) [2023-12-27 22:08:04,280][106226] Updated weights for policy 0, policy_version 403785 (0.0006) [2023-12-27 22:08:04,344][106225] Updated weights for policy 1, policy_version 404791 (0.0008) [2023-12-27 22:08:04,345][106226] Updated weights for policy 0, policy_version 403795 (0.0008) [2023-12-27 22:08:04,402][106226] Updated weights for policy 0, policy_version 403805 (0.0008) [2023-12-27 22:08:04,408][106225] Updated weights for policy 1, policy_version 404801 (0.0006) [2023-12-27 22:08:04,462][106226] Updated weights for policy 0, policy_version 403815 (0.0007) [2023-12-27 22:08:04,468][106225] Updated weights for policy 1, policy_version 404811 (0.0006) [2023-12-27 22:08:05,130][106226] Updated weights for policy 0, policy_version 403825 (0.0007) [2023-12-27 22:08:05,199][106226] Updated weights for policy 0, policy_version 403835 (0.0008) [2023-12-27 22:08:05,223][106225] Updated weights for policy 1, policy_version 404821 (0.0009) [2023-12-27 22:08:05,256][106226] Updated weights for policy 0, policy_version 403845 (0.0007) [2023-12-27 22:08:05,284][106225] Updated weights for policy 1, policy_version 404831 (0.0010) [2023-12-27 22:08:05,339][106225] Updated weights for policy 1, policy_version 404841 (0.0008) [2023-12-27 22:08:05,804][106226] Updated weights for policy 0, policy_version 403855 (0.0005) [2023-12-27 22:08:05,851][106226] Updated weights for policy 0, policy_version 403865 (0.0005) [2023-12-27 22:08:05,909][106226] Updated weights for policy 0, policy_version 403875 (0.0008) [2023-12-27 22:08:05,922][106225] Updated weights for policy 1, policy_version 404851 (0.0005) [2023-12-27 22:08:05,979][106225] Updated weights for policy 1, policy_version 404861 (0.0005) [2023-12-27 22:08:06,033][106225] Updated weights for policy 1, policy_version 404871 (0.0005) [2023-12-27 22:08:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 207101952. Throughput: 0: 9713.5, 1: 9777.2. Samples: 207107040. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:08:06,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-5.760')] [2023-12-27 22:08:06,681][106226] Updated weights for policy 0, policy_version 403885 (0.0008) [2023-12-27 22:08:06,727][106225] Updated weights for policy 1, policy_version 404881 (0.0009) [2023-12-27 22:08:06,744][106226] Updated weights for policy 0, policy_version 403895 (0.0009) [2023-12-27 22:08:06,785][106225] Updated weights for policy 1, policy_version 404891 (0.0011) [2023-12-27 22:08:06,829][106226] Updated weights for policy 0, policy_version 403905 (0.0009) [2023-12-27 22:08:06,847][106225] Updated weights for policy 1, policy_version 404901 (0.0010) [2023-12-27 22:08:06,913][106225] Updated weights for policy 1, policy_version 404911 (0.0010) [2023-12-27 22:08:07,488][106226] Updated weights for policy 0, policy_version 403915 (0.0008) [2023-12-27 22:08:07,556][106226] Updated weights for policy 0, policy_version 403925 (0.0005) [2023-12-27 22:08:07,619][106226] Updated weights for policy 0, policy_version 403935 (0.0006) [2023-12-27 22:08:07,627][106225] Updated weights for policy 1, policy_version 404921 (0.0010) [2023-12-27 22:08:07,681][106225] Updated weights for policy 1, policy_version 404931 (0.0010) [2023-12-27 22:08:07,731][106225] Updated weights for policy 1, policy_version 404941 (0.0010) [2023-12-27 22:08:08,152][106226] Updated weights for policy 0, policy_version 403945 (0.0008) [2023-12-27 22:08:08,214][106226] Updated weights for policy 0, policy_version 403955 (0.0006) [2023-12-27 22:08:08,267][106226] Updated weights for policy 0, policy_version 403965 (0.0005) [2023-12-27 22:08:08,321][106226] Updated weights for policy 0, policy_version 403975 (0.0006) [2023-12-27 22:08:08,489][106225] Updated weights for policy 1, policy_version 404951 (0.0010) [2023-12-27 22:08:08,550][106225] Updated weights for policy 1, policy_version 404961 (0.0010) [2023-12-27 22:08:08,612][106225] Updated weights for policy 1, policy_version 404971 (0.0010) [2023-12-27 22:08:08,973][106226] Updated weights for policy 0, policy_version 403985 (0.0007) [2023-12-27 22:08:09,022][106226] Updated weights for policy 0, policy_version 403995 (0.0009) [2023-12-27 22:08:09,074][106226] Updated weights for policy 0, policy_version 404005 (0.0007) [2023-12-27 22:08:09,253][106225] Updated weights for policy 1, policy_version 404981 (0.0009) [2023-12-27 22:08:09,318][106225] Updated weights for policy 1, policy_version 404991 (0.0011) [2023-12-27 22:08:09,389][106225] Updated weights for policy 1, policy_version 405001 (0.0009) [2023-12-27 22:08:09,799][106226] Updated weights for policy 0, policy_version 404015 (0.0007) [2023-12-27 22:08:09,865][106226] Updated weights for policy 0, policy_version 404025 (0.0010) [2023-12-27 22:08:09,927][106226] Updated weights for policy 0, policy_version 404035 (0.0011) [2023-12-27 22:08:10,168][106225] Updated weights for policy 1, policy_version 405011 (0.0011) [2023-12-27 22:08:10,220][106225] Updated weights for policy 1, policy_version 405021 (0.0010) [2023-12-27 22:08:10,280][106225] Updated weights for policy 1, policy_version 405031 (0.0009) [2023-12-27 22:08:10,724][106226] Updated weights for policy 0, policy_version 404045 (0.0009) [2023-12-27 22:08:10,797][106226] Updated weights for policy 0, policy_version 404055 (0.0009) [2023-12-27 22:08:10,862][106226] Updated weights for policy 0, policy_version 404065 (0.0010) [2023-12-27 22:08:10,896][106225] Updated weights for policy 1, policy_version 405041 (0.0007) [2023-12-27 22:08:10,950][106225] Updated weights for policy 1, policy_version 405051 (0.0010) [2023-12-27 22:08:11,008][106225] Updated weights for policy 1, policy_version 405061 (0.0010) [2023-12-27 22:08:11,078][106225] Updated weights for policy 1, policy_version 405071 (0.0010) [2023-12-27 22:08:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.3, 300 sec: 19521.9). Total num frames: 207200256. Throughput: 0: 9788.1, 1: 9827.7. Samples: 207167076. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-27 22:08:11,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.960')] [2023-12-27 22:08:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000405072_103727104.pth... [2023-12-27 22:08:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000404072_103473152.pth... [2023-12-27 22:08:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000403920_103432192.pth [2023-12-27 22:08:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000402952_103186432.pth [2023-12-27 22:08:11,607][106226] Updated weights for policy 0, policy_version 404075 (0.0009) [2023-12-27 22:08:11,674][106226] Updated weights for policy 0, policy_version 404085 (0.0007) [2023-12-27 22:08:11,736][106226] Updated weights for policy 0, policy_version 404095 (0.0010) [2023-12-27 22:08:11,908][106225] Updated weights for policy 1, policy_version 405081 (0.0009) [2023-12-27 22:08:11,971][106225] Updated weights for policy 1, policy_version 405091 (0.0009) [2023-12-27 22:08:12,031][106225] Updated weights for policy 1, policy_version 405101 (0.0008) [2023-12-27 22:08:12,535][106226] Updated weights for policy 0, policy_version 404105 (0.0009) [2023-12-27 22:08:12,583][106226] Updated weights for policy 0, policy_version 404115 (0.0008) [2023-12-27 22:08:12,636][106226] Updated weights for policy 0, policy_version 404125 (0.0008) [2023-12-27 22:08:12,690][106226] Updated weights for policy 0, policy_version 404135 (0.0008) [2023-12-27 22:08:12,731][106225] Updated weights for policy 1, policy_version 405111 (0.0008) [2023-12-27 22:08:12,784][106225] Updated weights for policy 1, policy_version 405121 (0.0009) [2023-12-27 22:08:12,841][106225] Updated weights for policy 1, policy_version 405131 (0.0008) [2023-12-27 22:08:13,455][106226] Updated weights for policy 0, policy_version 404145 (0.0008) [2023-12-27 22:08:13,525][106226] Updated weights for policy 0, policy_version 404155 (0.0009) [2023-12-27 22:08:13,560][106225] Updated weights for policy 1, policy_version 405141 (0.0008) [2023-12-27 22:08:13,580][106226] Updated weights for policy 0, policy_version 404165 (0.0008) [2023-12-27 22:08:13,610][106225] Updated weights for policy 1, policy_version 405151 (0.0006) [2023-12-27 22:08:13,665][106225] Updated weights for policy 1, policy_version 405161 (0.0007) [2023-12-27 22:08:14,304][106226] Updated weights for policy 0, policy_version 404175 (0.0008) [2023-12-27 22:08:14,370][106226] Updated weights for policy 0, policy_version 404185 (0.0008) [2023-12-27 22:08:14,403][106225] Updated weights for policy 1, policy_version 405171 (0.0009) [2023-12-27 22:08:14,426][106226] Updated weights for policy 0, policy_version 404195 (0.0007) [2023-12-27 22:08:14,452][106225] Updated weights for policy 1, policy_version 405181 (0.0007) [2023-12-27 22:08:14,508][106225] Updated weights for policy 1, policy_version 405191 (0.0008) [2023-12-27 22:08:15,227][106226] Updated weights for policy 0, policy_version 404205 (0.0007) [2023-12-27 22:08:15,294][106226] Updated weights for policy 0, policy_version 404215 (0.0009) [2023-12-27 22:08:15,317][106225] Updated weights for policy 1, policy_version 405201 (0.0008) [2023-12-27 22:08:15,350][106226] Updated weights for policy 0, policy_version 404225 (0.0009) [2023-12-27 22:08:15,376][106225] Updated weights for policy 1, policy_version 405211 (0.0008) [2023-12-27 22:08:15,439][106225] Updated weights for policy 1, policy_version 405221 (0.0008) [2023-12-27 22:08:15,500][106225] Updated weights for policy 1, policy_version 405231 (0.0008) [2023-12-27 22:08:16,131][106225] Updated weights for policy 1, policy_version 405241 (0.0008) [2023-12-27 22:08:16,166][106226] Updated weights for policy 0, policy_version 404235 (0.0008) [2023-12-27 22:08:16,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 207282176. Throughput: 0: 9587.0, 1: 9762.1. Samples: 207280012. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:16,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.771')] [2023-12-27 22:08:16,188][106225] Updated weights for policy 1, policy_version 405251 (0.0007) [2023-12-27 22:08:16,230][106226] Updated weights for policy 0, policy_version 404245 (0.0008) [2023-12-27 22:08:16,240][106225] Updated weights for policy 1, policy_version 405261 (0.0005) [2023-12-27 22:08:16,283][106226] Updated weights for policy 0, policy_version 404255 (0.0007) [2023-12-27 22:08:16,885][106225] Updated weights for policy 1, policy_version 405271 (0.0009) [2023-12-27 22:08:16,939][106225] Updated weights for policy 1, policy_version 405281 (0.0010) [2023-12-27 22:08:16,981][106226] Updated weights for policy 0, policy_version 404265 (0.0009) [2023-12-27 22:08:16,989][106225] Updated weights for policy 1, policy_version 405291 (0.0010) [2023-12-27 22:08:17,039][106226] Updated weights for policy 0, policy_version 404275 (0.0007) [2023-12-27 22:08:17,092][106226] Updated weights for policy 0, policy_version 404285 (0.0008) [2023-12-27 22:08:17,145][106226] Updated weights for policy 0, policy_version 404295 (0.0009) [2023-12-27 22:08:17,579][106225] Updated weights for policy 1, policy_version 405301 (0.0008) [2023-12-27 22:08:17,636][106225] Updated weights for policy 1, policy_version 405311 (0.0005) [2023-12-27 22:08:17,689][106225] Updated weights for policy 1, policy_version 405321 (0.0005) [2023-12-27 22:08:17,994][106226] Updated weights for policy 0, policy_version 404305 (0.0008) [2023-12-27 22:08:18,056][106226] Updated weights for policy 0, policy_version 404315 (0.0008) [2023-12-27 22:08:18,116][106226] Updated weights for policy 0, policy_version 404325 (0.0008) [2023-12-27 22:08:18,345][106225] Updated weights for policy 1, policy_version 405331 (0.0006) [2023-12-27 22:08:18,406][106225] Updated weights for policy 1, policy_version 405341 (0.0009) [2023-12-27 22:08:18,460][106225] Updated weights for policy 1, policy_version 405351 (0.0009) [2023-12-27 22:08:18,970][106226] Updated weights for policy 0, policy_version 404335 (0.0008) [2023-12-27 22:08:19,024][106226] Updated weights for policy 0, policy_version 404345 (0.0008) [2023-12-27 22:08:19,071][106226] Updated weights for policy 0, policy_version 404355 (0.0008) [2023-12-27 22:08:19,194][106225] Updated weights for policy 1, policy_version 405361 (0.0009) [2023-12-27 22:08:19,267][106225] Updated weights for policy 1, policy_version 405371 (0.0010) [2023-12-27 22:08:19,334][106225] Updated weights for policy 1, policy_version 405381 (0.0008) [2023-12-27 22:08:19,398][106225] Updated weights for policy 1, policy_version 405391 (0.0008) [2023-12-27 22:08:19,820][106226] Updated weights for policy 0, policy_version 404365 (0.0007) [2023-12-27 22:08:19,889][106226] Updated weights for policy 0, policy_version 404375 (0.0008) [2023-12-27 22:08:19,967][106226] Updated weights for policy 0, policy_version 404385 (0.0008) [2023-12-27 22:08:20,103][106225] Updated weights for policy 1, policy_version 405401 (0.0009) [2023-12-27 22:08:20,163][106225] Updated weights for policy 1, policy_version 405411 (0.0009) [2023-12-27 22:08:20,225][106225] Updated weights for policy 1, policy_version 405421 (0.0009) [2023-12-27 22:08:20,679][106226] Updated weights for policy 0, policy_version 404395 (0.0008) [2023-12-27 22:08:20,746][106226] Updated weights for policy 0, policy_version 404405 (0.0008) [2023-12-27 22:08:20,810][106226] Updated weights for policy 0, policy_version 404415 (0.0008) [2023-12-27 22:08:20,994][106225] Updated weights for policy 1, policy_version 405431 (0.0009) [2023-12-27 22:08:21,057][106225] Updated weights for policy 1, policy_version 405441 (0.0008) [2023-12-27 22:08:21,119][106225] Updated weights for policy 1, policy_version 405451 (0.0008) [2023-12-27 22:08:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 207388672. Throughput: 0: 9495.7, 1: 9753.0. Samples: 207393948. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:21,175][105115] Avg episode reward: [(0, '-5.127'), (1, '-5.837')] [2023-12-27 22:08:21,595][106226] Updated weights for policy 0, policy_version 404425 (0.0008) [2023-12-27 22:08:21,670][106226] Updated weights for policy 0, policy_version 404435 (0.0008) [2023-12-27 22:08:21,746][106226] Updated weights for policy 0, policy_version 404445 (0.0009) [2023-12-27 22:08:21,816][106226] Updated weights for policy 0, policy_version 404455 (0.0007) [2023-12-27 22:08:21,931][106225] Updated weights for policy 1, policy_version 405461 (0.0008) [2023-12-27 22:08:21,996][106225] Updated weights for policy 1, policy_version 405471 (0.0009) [2023-12-27 22:08:22,060][106225] Updated weights for policy 1, policy_version 405481 (0.0008) [2023-12-27 22:08:22,551][106226] Updated weights for policy 0, policy_version 404465 (0.0008) [2023-12-27 22:08:22,617][106226] Updated weights for policy 0, policy_version 404475 (0.0009) [2023-12-27 22:08:22,679][106226] Updated weights for policy 0, policy_version 404485 (0.0010) [2023-12-27 22:08:22,808][106225] Updated weights for policy 1, policy_version 405491 (0.0008) [2023-12-27 22:08:22,867][106225] Updated weights for policy 1, policy_version 405501 (0.0007) [2023-12-27 22:08:22,925][106225] Updated weights for policy 1, policy_version 405511 (0.0008) [2023-12-27 22:08:23,421][106226] Updated weights for policy 0, policy_version 404495 (0.0010) [2023-12-27 22:08:23,485][106226] Updated weights for policy 0, policy_version 404505 (0.0011) [2023-12-27 22:08:23,549][106226] Updated weights for policy 0, policy_version 404515 (0.0011) [2023-12-27 22:08:23,620][106225] Updated weights for policy 1, policy_version 405521 (0.0008) [2023-12-27 22:08:23,686][106225] Updated weights for policy 1, policy_version 405531 (0.0008) [2023-12-27 22:08:23,751][106225] Updated weights for policy 1, policy_version 405541 (0.0005) [2023-12-27 22:08:23,817][106225] Updated weights for policy 1, policy_version 405551 (0.0009) [2023-12-27 22:08:24,184][106226] Updated weights for policy 0, policy_version 404525 (0.0008) [2023-12-27 22:08:24,249][106226] Updated weights for policy 0, policy_version 404535 (0.0005) [2023-12-27 22:08:24,301][106226] Updated weights for policy 0, policy_version 404545 (0.0006) [2023-12-27 22:08:24,486][106225] Updated weights for policy 1, policy_version 405561 (0.0005) [2023-12-27 22:08:24,536][106225] Updated weights for policy 1, policy_version 405571 (0.0005) [2023-12-27 22:08:24,585][106225] Updated weights for policy 1, policy_version 405581 (0.0005) [2023-12-27 22:08:25,061][106226] Updated weights for policy 0, policy_version 404555 (0.0009) [2023-12-27 22:08:25,109][106226] Updated weights for policy 0, policy_version 404565 (0.0009) [2023-12-27 22:08:25,162][106226] Updated weights for policy 0, policy_version 404575 (0.0008) [2023-12-27 22:08:25,177][106225] Updated weights for policy 1, policy_version 405591 (0.0007) [2023-12-27 22:08:25,240][106225] Updated weights for policy 1, policy_version 405601 (0.0008) [2023-12-27 22:08:25,305][106225] Updated weights for policy 1, policy_version 405611 (0.0008) [2023-12-27 22:08:25,899][106226] Updated weights for policy 0, policy_version 404585 (0.0008) [2023-12-27 22:08:25,952][106226] Updated weights for policy 0, policy_version 404595 (0.0009) [2023-12-27 22:08:25,971][106225] Updated weights for policy 1, policy_version 405621 (0.0007) [2023-12-27 22:08:26,008][106226] Updated weights for policy 0, policy_version 404605 (0.0008) [2023-12-27 22:08:26,031][106225] Updated weights for policy 1, policy_version 405631 (0.0006) [2023-12-27 22:08:26,071][106226] Updated weights for policy 0, policy_version 404615 (0.0007) [2023-12-27 22:08:26,093][106225] Updated weights for policy 1, policy_version 405641 (0.0007) [2023-12-27 22:08:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 207486976. Throughput: 0: 9500.8, 1: 9732.4. Samples: 207449752. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:26,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-5.824')] [2023-12-27 22:08:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000404616_103612416.pth... [2023-12-27 22:08:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000405648_103874560.pth... [2023-12-27 22:08:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000403496_103325696.pth [2023-12-27 22:08:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000404496_103579648.pth [2023-12-27 22:08:26,731][106225] Updated weights for policy 1, policy_version 405651 (0.0008) [2023-12-27 22:08:26,742][106226] Updated weights for policy 0, policy_version 404625 (0.0007) [2023-12-27 22:08:26,787][106225] Updated weights for policy 1, policy_version 405661 (0.0005) [2023-12-27 22:08:26,804][106226] Updated weights for policy 0, policy_version 404635 (0.0006) [2023-12-27 22:08:26,847][106225] Updated weights for policy 1, policy_version 405671 (0.0007) [2023-12-27 22:08:26,865][106226] Updated weights for policy 0, policy_version 404645 (0.0006) [2023-12-27 22:08:27,444][106226] Updated weights for policy 0, policy_version 404655 (0.0006) [2023-12-27 22:08:27,497][106226] Updated weights for policy 0, policy_version 404665 (0.0005) [2023-12-27 22:08:27,549][106226] Updated weights for policy 0, policy_version 404675 (0.0005) [2023-12-27 22:08:27,556][106225] Updated weights for policy 1, policy_version 405681 (0.0010) [2023-12-27 22:08:27,619][106225] Updated weights for policy 1, policy_version 405691 (0.0009) [2023-12-27 22:08:27,675][106225] Updated weights for policy 1, policy_version 405701 (0.0008) [2023-12-27 22:08:27,740][106225] Updated weights for policy 1, policy_version 405711 (0.0009) [2023-12-27 22:08:28,122][106226] Updated weights for policy 0, policy_version 404685 (0.0005) [2023-12-27 22:08:28,184][106226] Updated weights for policy 0, policy_version 404695 (0.0005) [2023-12-27 22:08:28,250][106226] Updated weights for policy 0, policy_version 404705 (0.0005) [2023-12-27 22:08:28,376][106225] Updated weights for policy 1, policy_version 405721 (0.0008) [2023-12-27 22:08:28,422][106225] Updated weights for policy 1, policy_version 405731 (0.0005) [2023-12-27 22:08:28,472][106225] Updated weights for policy 1, policy_version 405741 (0.0005) [2023-12-27 22:08:28,942][106226] Updated weights for policy 0, policy_version 404715 (0.0007) [2023-12-27 22:08:28,996][106226] Updated weights for policy 0, policy_version 404725 (0.0008) [2023-12-27 22:08:29,052][106226] Updated weights for policy 0, policy_version 404735 (0.0008) [2023-12-27 22:08:29,115][106225] Updated weights for policy 1, policy_version 405751 (0.0006) [2023-12-27 22:08:29,167][106225] Updated weights for policy 1, policy_version 405761 (0.0008) [2023-12-27 22:08:29,224][106225] Updated weights for policy 1, policy_version 405771 (0.0008) [2023-12-27 22:08:29,802][106226] Updated weights for policy 0, policy_version 404745 (0.0007) [2023-12-27 22:08:29,866][106226] Updated weights for policy 0, policy_version 404755 (0.0008) [2023-12-27 22:08:29,935][106226] Updated weights for policy 0, policy_version 404765 (0.0008) [2023-12-27 22:08:29,992][106225] Updated weights for policy 1, policy_version 405781 (0.0010) [2023-12-27 22:08:29,997][106226] Updated weights for policy 0, policy_version 404775 (0.0006) [2023-12-27 22:08:30,050][106225] Updated weights for policy 1, policy_version 405791 (0.0010) [2023-12-27 22:08:30,115][106225] Updated weights for policy 1, policy_version 405801 (0.0010) [2023-12-27 22:08:30,596][106226] Updated weights for policy 0, policy_version 404785 (0.0009) [2023-12-27 22:08:30,652][106226] Updated weights for policy 0, policy_version 404795 (0.0005) [2023-12-27 22:08:30,711][106226] Updated weights for policy 0, policy_version 404805 (0.0006) [2023-12-27 22:08:30,846][106225] Updated weights for policy 1, policy_version 405811 (0.0009) [2023-12-27 22:08:30,901][106225] Updated weights for policy 1, policy_version 405821 (0.0010) [2023-12-27 22:08:30,952][106225] Updated weights for policy 1, policy_version 405831 (0.0010) [2023-12-27 22:08:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 207585280. Throughput: 0: 9603.5, 1: 9839.8. Samples: 207573068. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:31,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.500')] [2023-12-27 22:08:31,451][106226] Updated weights for policy 0, policy_version 404815 (0.0006) [2023-12-27 22:08:31,515][106226] Updated weights for policy 0, policy_version 404825 (0.0008) [2023-12-27 22:08:31,585][106226] Updated weights for policy 0, policy_version 404835 (0.0007) [2023-12-27 22:08:31,751][106225] Updated weights for policy 1, policy_version 405841 (0.0010) [2023-12-27 22:08:31,809][106225] Updated weights for policy 1, policy_version 405851 (0.0008) [2023-12-27 22:08:31,872][106225] Updated weights for policy 1, policy_version 405861 (0.0008) [2023-12-27 22:08:31,932][106225] Updated weights for policy 1, policy_version 405871 (0.0008) [2023-12-27 22:08:32,291][106226] Updated weights for policy 0, policy_version 404845 (0.0010) [2023-12-27 22:08:32,354][106226] Updated weights for policy 0, policy_version 404855 (0.0011) [2023-12-27 22:08:32,424][106226] Updated weights for policy 0, policy_version 404865 (0.0011) [2023-12-27 22:08:32,691][106225] Updated weights for policy 1, policy_version 405881 (0.0008) [2023-12-27 22:08:32,750][106225] Updated weights for policy 1, policy_version 405891 (0.0008) [2023-12-27 22:08:32,815][106225] Updated weights for policy 1, policy_version 405901 (0.0008) [2023-12-27 22:08:33,123][106226] Updated weights for policy 0, policy_version 404875 (0.0011) [2023-12-27 22:08:33,179][106226] Updated weights for policy 0, policy_version 404885 (0.0010) [2023-12-27 22:08:33,228][106226] Updated weights for policy 0, policy_version 404895 (0.0010) [2023-12-27 22:08:33,549][106225] Updated weights for policy 1, policy_version 405911 (0.0008) [2023-12-27 22:08:33,604][106225] Updated weights for policy 1, policy_version 405921 (0.0007) [2023-12-27 22:08:33,657][106225] Updated weights for policy 1, policy_version 405931 (0.0008) [2023-12-27 22:08:33,938][106226] Updated weights for policy 0, policy_version 404905 (0.0010) [2023-12-27 22:08:33,987][106226] Updated weights for policy 0, policy_version 404915 (0.0010) [2023-12-27 22:08:34,036][106226] Updated weights for policy 0, policy_version 404925 (0.0010) [2023-12-27 22:08:34,086][106226] Updated weights for policy 0, policy_version 404935 (0.0010) [2023-12-27 22:08:34,386][106225] Updated weights for policy 1, policy_version 405941 (0.0008) [2023-12-27 22:08:34,447][106225] Updated weights for policy 1, policy_version 405951 (0.0008) [2023-12-27 22:08:34,511][106225] Updated weights for policy 1, policy_version 405961 (0.0008) [2023-12-27 22:08:34,820][106226] Updated weights for policy 0, policy_version 404945 (0.0008) [2023-12-27 22:08:34,866][106226] Updated weights for policy 0, policy_version 404955 (0.0009) [2023-12-27 22:08:34,914][106226] Updated weights for policy 0, policy_version 404965 (0.0008) [2023-12-27 22:08:35,195][106225] Updated weights for policy 1, policy_version 405971 (0.0007) [2023-12-27 22:08:35,250][106225] Updated weights for policy 1, policy_version 405981 (0.0008) [2023-12-27 22:08:35,308][106225] Updated weights for policy 1, policy_version 405991 (0.0008) [2023-12-27 22:08:35,673][106226] Updated weights for policy 0, policy_version 404975 (0.0007) [2023-12-27 22:08:35,722][106226] Updated weights for policy 0, policy_version 404985 (0.0005) [2023-12-27 22:08:35,769][106226] Updated weights for policy 0, policy_version 404995 (0.0005) [2023-12-27 22:08:35,999][106225] Updated weights for policy 1, policy_version 406001 (0.0008) [2023-12-27 22:08:36,049][106225] Updated weights for policy 1, policy_version 406011 (0.0010) [2023-12-27 22:08:36,109][106225] Updated weights for policy 1, policy_version 406021 (0.0009) [2023-12-27 22:08:36,174][106225] Updated weights for policy 1, policy_version 406031 (0.0009) [2023-12-27 22:08:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 207675392. Throughput: 0: 9634.7, 1: 9819.5. Samples: 207688548. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:36,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-5.933')] [2023-12-27 22:08:36,508][106226] Updated weights for policy 0, policy_version 405005 (0.0007) [2023-12-27 22:08:36,572][106226] Updated weights for policy 0, policy_version 405015 (0.0008) [2023-12-27 22:08:36,628][106226] Updated weights for policy 0, policy_version 405025 (0.0009) [2023-12-27 22:08:36,915][106225] Updated weights for policy 1, policy_version 406041 (0.0009) [2023-12-27 22:08:36,975][106225] Updated weights for policy 1, policy_version 406051 (0.0008) [2023-12-27 22:08:37,035][106225] Updated weights for policy 1, policy_version 406061 (0.0009) [2023-12-27 22:08:37,353][106226] Updated weights for policy 0, policy_version 405035 (0.0009) [2023-12-27 22:08:37,408][106226] Updated weights for policy 0, policy_version 405045 (0.0008) [2023-12-27 22:08:37,464][106226] Updated weights for policy 0, policy_version 405055 (0.0009) [2023-12-27 22:08:37,680][106225] Updated weights for policy 1, policy_version 406071 (0.0007) [2023-12-27 22:08:37,750][106225] Updated weights for policy 1, policy_version 406081 (0.0006) [2023-12-27 22:08:37,814][106225] Updated weights for policy 1, policy_version 406091 (0.0009) [2023-12-27 22:08:38,232][106226] Updated weights for policy 0, policy_version 405065 (0.0009) [2023-12-27 22:08:38,281][106226] Updated weights for policy 0, policy_version 405075 (0.0009) [2023-12-27 22:08:38,338][106226] Updated weights for policy 0, policy_version 405085 (0.0009) [2023-12-27 22:08:38,394][106226] Updated weights for policy 0, policy_version 405095 (0.0009) [2023-12-27 22:08:38,474][106225] Updated weights for policy 1, policy_version 406101 (0.0008) [2023-12-27 22:08:38,526][106225] Updated weights for policy 1, policy_version 406111 (0.0008) [2023-12-27 22:08:38,579][106225] Updated weights for policy 1, policy_version 406121 (0.0008) [2023-12-27 22:08:39,159][106226] Updated weights for policy 0, policy_version 405105 (0.0009) [2023-12-27 22:08:39,222][106226] Updated weights for policy 0, policy_version 405115 (0.0008) [2023-12-27 22:08:39,288][106226] Updated weights for policy 0, policy_version 405125 (0.0008) [2023-12-27 22:08:39,341][106225] Updated weights for policy 1, policy_version 406131 (0.0009) [2023-12-27 22:08:39,417][106225] Updated weights for policy 1, policy_version 406141 (0.0008) [2023-12-27 22:08:39,483][106225] Updated weights for policy 1, policy_version 406151 (0.0006) [2023-12-27 22:08:40,101][106226] Updated weights for policy 0, policy_version 405135 (0.0010) [2023-12-27 22:08:40,171][106226] Updated weights for policy 0, policy_version 405145 (0.0011) [2023-12-27 22:08:40,205][106225] Updated weights for policy 1, policy_version 406161 (0.0007) [2023-12-27 22:08:40,244][106226] Updated weights for policy 0, policy_version 405155 (0.0011) [2023-12-27 22:08:40,266][106225] Updated weights for policy 1, policy_version 406171 (0.0007) [2023-12-27 22:08:40,331][106225] Updated weights for policy 1, policy_version 406181 (0.0006) [2023-12-27 22:08:40,403][106225] Updated weights for policy 1, policy_version 406191 (0.0008) [2023-12-27 22:08:40,915][106226] Updated weights for policy 0, policy_version 405165 (0.0011) [2023-12-27 22:08:40,977][106226] Updated weights for policy 0, policy_version 405175 (0.0011) [2023-12-27 22:08:41,030][106225] Updated weights for policy 1, policy_version 406201 (0.0006) [2023-12-27 22:08:41,054][106226] Updated weights for policy 0, policy_version 405185 (0.0010) [2023-12-27 22:08:41,097][106225] Updated weights for policy 1, policy_version 406211 (0.0006) [2023-12-27 22:08:41,166][106225] Updated weights for policy 1, policy_version 406221 (0.0008) [2023-12-27 22:08:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 207773696. Throughput: 0: 9607.4, 1: 9858.8. Samples: 207746272. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:41,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-5.595')] [2023-12-27 22:08:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000405192_103759872.pth... [2023-12-27 22:08:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000404072_103473152.pth [2023-12-27 22:08:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000406224_104022016.pth... [2023-12-27 22:08:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000405072_103727104.pth [2023-12-27 22:08:41,880][106226] Updated weights for policy 0, policy_version 405195 (0.0009) [2023-12-27 22:08:41,900][106225] Updated weights for policy 1, policy_version 406231 (0.0008) [2023-12-27 22:08:41,945][106226] Updated weights for policy 0, policy_version 405205 (0.0008) [2023-12-27 22:08:41,960][106225] Updated weights for policy 1, policy_version 406241 (0.0007) [2023-12-27 22:08:42,006][106226] Updated weights for policy 0, policy_version 405215 (0.0008) [2023-12-27 22:08:42,023][106225] Updated weights for policy 1, policy_version 406251 (0.0007) [2023-12-27 22:08:42,732][106226] Updated weights for policy 0, policy_version 405225 (0.0007) [2023-12-27 22:08:42,759][106225] Updated weights for policy 1, policy_version 406261 (0.0007) [2023-12-27 22:08:42,797][106226] Updated weights for policy 0, policy_version 405235 (0.0007) [2023-12-27 22:08:42,823][106225] Updated weights for policy 1, policy_version 406271 (0.0008) [2023-12-27 22:08:42,853][106226] Updated weights for policy 0, policy_version 405245 (0.0006) [2023-12-27 22:08:42,879][106225] Updated weights for policy 1, policy_version 406281 (0.0006) [2023-12-27 22:08:42,916][106226] Updated weights for policy 0, policy_version 405255 (0.0007) [2023-12-27 22:08:43,581][106226] Updated weights for policy 0, policy_version 405265 (0.0006) [2023-12-27 22:08:43,621][106225] Updated weights for policy 1, policy_version 406291 (0.0005) [2023-12-27 22:08:43,636][106226] Updated weights for policy 0, policy_version 405275 (0.0006) [2023-12-27 22:08:43,669][106225] Updated weights for policy 1, policy_version 406301 (0.0009) [2023-12-27 22:08:43,683][106226] Updated weights for policy 0, policy_version 405285 (0.0005) [2023-12-27 22:08:43,720][106225] Updated weights for policy 1, policy_version 406311 (0.0009) [2023-12-27 22:08:44,268][106226] Updated weights for policy 0, policy_version 405295 (0.0009) [2023-12-27 22:08:44,326][106226] Updated weights for policy 0, policy_version 405305 (0.0009) [2023-12-27 22:08:44,376][106226] Updated weights for policy 0, policy_version 405315 (0.0009) [2023-12-27 22:08:44,451][106225] Updated weights for policy 1, policy_version 406321 (0.0008) [2023-12-27 22:08:44,522][106225] Updated weights for policy 1, policy_version 406331 (0.0008) [2023-12-27 22:08:44,581][106225] Updated weights for policy 1, policy_version 406341 (0.0008) [2023-12-27 22:08:44,648][106225] Updated weights for policy 1, policy_version 406351 (0.0009) [2023-12-27 22:08:45,109][106226] Updated weights for policy 0, policy_version 405325 (0.0008) [2023-12-27 22:08:45,172][106226] Updated weights for policy 0, policy_version 405335 (0.0008) [2023-12-27 22:08:45,236][106226] Updated weights for policy 0, policy_version 405345 (0.0009) [2023-12-27 22:08:45,396][106225] Updated weights for policy 1, policy_version 406361 (0.0009) [2023-12-27 22:08:45,450][106225] Updated weights for policy 1, policy_version 406371 (0.0009) [2023-12-27 22:08:45,494][106225] Updated weights for policy 1, policy_version 406381 (0.0008) [2023-12-27 22:08:45,917][106226] Updated weights for policy 0, policy_version 405355 (0.0008) [2023-12-27 22:08:45,984][106226] Updated weights for policy 0, policy_version 405365 (0.0008) [2023-12-27 22:08:46,033][106226] Updated weights for policy 0, policy_version 405375 (0.0009) [2023-12-27 22:08:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 207872000. Throughput: 0: 9609.9, 1: 9837.1. Samples: 207861056. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:46,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-5.714')] [2023-12-27 22:08:46,281][106225] Updated weights for policy 1, policy_version 406391 (0.0007) [2023-12-27 22:08:46,340][106225] Updated weights for policy 1, policy_version 406401 (0.0005) [2023-12-27 22:08:46,408][106225] Updated weights for policy 1, policy_version 406411 (0.0005) [2023-12-27 22:08:46,749][106226] Updated weights for policy 0, policy_version 405385 (0.0009) [2023-12-27 22:08:46,816][106226] Updated weights for policy 0, policy_version 405395 (0.0007) [2023-12-27 22:08:46,873][106226] Updated weights for policy 0, policy_version 405405 (0.0005) [2023-12-27 22:08:46,928][106226] Updated weights for policy 0, policy_version 405415 (0.0005) [2023-12-27 22:08:47,042][106225] Updated weights for policy 1, policy_version 406421 (0.0006) [2023-12-27 22:08:47,099][106225] Updated weights for policy 1, policy_version 406431 (0.0006) [2023-12-27 22:08:47,159][106225] Updated weights for policy 1, policy_version 406441 (0.0007) [2023-12-27 22:08:47,608][106226] Updated weights for policy 0, policy_version 405425 (0.0007) [2023-12-27 22:08:47,662][106226] Updated weights for policy 0, policy_version 405435 (0.0008) [2023-12-27 22:08:47,719][106226] Updated weights for policy 0, policy_version 405445 (0.0008) [2023-12-27 22:08:47,847][106225] Updated weights for policy 1, policy_version 406451 (0.0010) [2023-12-27 22:08:47,916][106225] Updated weights for policy 1, policy_version 406461 (0.0008) [2023-12-27 22:08:47,975][106225] Updated weights for policy 1, policy_version 406471 (0.0009) [2023-12-27 22:08:48,522][106226] Updated weights for policy 0, policy_version 405455 (0.0008) [2023-12-27 22:08:48,586][106226] Updated weights for policy 0, policy_version 405465 (0.0009) [2023-12-27 22:08:48,600][106225] Updated weights for policy 1, policy_version 406481 (0.0007) [2023-12-27 22:08:48,643][106226] Updated weights for policy 0, policy_version 405475 (0.0007) [2023-12-27 22:08:48,663][106225] Updated weights for policy 1, policy_version 406491 (0.0009) [2023-12-27 22:08:48,725][106225] Updated weights for policy 1, policy_version 406501 (0.0009) [2023-12-27 22:08:48,786][106225] Updated weights for policy 1, policy_version 406511 (0.0008) [2023-12-27 22:08:49,312][106226] Updated weights for policy 0, policy_version 405485 (0.0008) [2023-12-27 22:08:49,402][106226] Updated weights for policy 0, policy_version 405495 (0.0006) [2023-12-27 22:08:49,484][106226] Updated weights for policy 0, policy_version 405505 (0.0005) [2023-12-27 22:08:49,590][106225] Updated weights for policy 1, policy_version 406521 (0.0009) [2023-12-27 22:08:49,650][106225] Updated weights for policy 1, policy_version 406531 (0.0008) [2023-12-27 22:08:49,707][106225] Updated weights for policy 1, policy_version 406541 (0.0009) [2023-12-27 22:08:50,175][106226] Updated weights for policy 0, policy_version 405515 (0.0007) [2023-12-27 22:08:50,228][106226] Updated weights for policy 0, policy_version 405525 (0.0008) [2023-12-27 22:08:50,283][106226] Updated weights for policy 0, policy_version 405535 (0.0009) [2023-12-27 22:08:50,462][106225] Updated weights for policy 1, policy_version 406551 (0.0009) [2023-12-27 22:08:50,524][106225] Updated weights for policy 1, policy_version 406561 (0.0008) [2023-12-27 22:08:50,589][106225] Updated weights for policy 1, policy_version 406571 (0.0008) [2023-12-27 22:08:51,037][106226] Updated weights for policy 0, policy_version 405545 (0.0009) [2023-12-27 22:08:51,107][106226] Updated weights for policy 0, policy_version 405555 (0.0008) [2023-12-27 22:08:51,173][106226] Updated weights for policy 0, policy_version 405565 (0.0008) [2023-12-27 22:08:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19251.2, 300 sec: 19438.7). Total num frames: 207962112. Throughput: 0: 9563.2, 1: 9740.9. Samples: 207975724. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:51,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.799')] [2023-12-27 22:08:51,243][106226] Updated weights for policy 0, policy_version 405575 (0.0010) [2023-12-27 22:08:51,339][106225] Updated weights for policy 1, policy_version 406581 (0.0008) [2023-12-27 22:08:51,410][106225] Updated weights for policy 1, policy_version 406591 (0.0009) [2023-12-27 22:08:51,505][106225] Updated weights for policy 1, policy_version 406601 (0.0006) [2023-12-27 22:08:52,089][106226] Updated weights for policy 0, policy_version 405585 (0.0009) [2023-12-27 22:08:52,150][106226] Updated weights for policy 0, policy_version 405595 (0.0009) [2023-12-27 22:08:52,211][106226] Updated weights for policy 0, policy_version 405605 (0.0008) [2023-12-27 22:08:52,224][106225] Updated weights for policy 1, policy_version 406611 (0.0006) [2023-12-27 22:08:52,283][106225] Updated weights for policy 1, policy_version 406621 (0.0009) [2023-12-27 22:08:52,348][106225] Updated weights for policy 1, policy_version 406631 (0.0008) [2023-12-27 22:08:52,960][106226] Updated weights for policy 0, policy_version 405615 (0.0007) [2023-12-27 22:08:53,004][106225] Updated weights for policy 1, policy_version 406641 (0.0008) [2023-12-27 22:08:53,013][106226] Updated weights for policy 0, policy_version 405625 (0.0008) [2023-12-27 22:08:53,062][106225] Updated weights for policy 1, policy_version 406651 (0.0005) [2023-12-27 22:08:53,067][106226] Updated weights for policy 0, policy_version 405635 (0.0008) [2023-12-27 22:08:53,122][106225] Updated weights for policy 1, policy_version 406661 (0.0006) [2023-12-27 22:08:53,177][106225] Updated weights for policy 1, policy_version 406671 (0.0006) [2023-12-27 22:08:53,802][106225] Updated weights for policy 1, policy_version 406681 (0.0009) [2023-12-27 22:08:53,869][106225] Updated weights for policy 1, policy_version 406691 (0.0006) [2023-12-27 22:08:53,870][106226] Updated weights for policy 0, policy_version 405645 (0.0007) [2023-12-27 22:08:53,926][106225] Updated weights for policy 1, policy_version 406701 (0.0006) [2023-12-27 22:08:53,931][106226] Updated weights for policy 0, policy_version 405655 (0.0009) [2023-12-27 22:08:53,994][106226] Updated weights for policy 0, policy_version 405665 (0.0008) [2023-12-27 22:08:54,564][106225] Updated weights for policy 1, policy_version 406711 (0.0008) [2023-12-27 22:08:54,631][106225] Updated weights for policy 1, policy_version 406721 (0.0008) [2023-12-27 22:08:54,694][106225] Updated weights for policy 1, policy_version 406731 (0.0009) [2023-12-27 22:08:54,737][106226] Updated weights for policy 0, policy_version 405675 (0.0008) [2023-12-27 22:08:54,800][106226] Updated weights for policy 0, policy_version 405685 (0.0008) [2023-12-27 22:08:54,858][106226] Updated weights for policy 0, policy_version 405695 (0.0008) [2023-12-27 22:08:55,349][106225] Updated weights for policy 1, policy_version 406741 (0.0006) [2023-12-27 22:08:55,403][106225] Updated weights for policy 1, policy_version 406751 (0.0005) [2023-12-27 22:08:55,462][106225] Updated weights for policy 1, policy_version 406761 (0.0005) [2023-12-27 22:08:55,569][106226] Updated weights for policy 0, policy_version 405705 (0.0005) [2023-12-27 22:08:55,626][106226] Updated weights for policy 0, policy_version 405715 (0.0007) [2023-12-27 22:08:55,683][106226] Updated weights for policy 0, policy_version 405725 (0.0005) [2023-12-27 22:08:55,752][106226] Updated weights for policy 0, policy_version 405735 (0.0005) [2023-12-27 22:08:56,055][106225] Updated weights for policy 1, policy_version 406771 (0.0010) [2023-12-27 22:08:56,112][106225] Updated weights for policy 1, policy_version 406781 (0.0010) [2023-12-27 22:08:56,163][106225] Updated weights for policy 1, policy_version 406791 (0.0007) [2023-12-27 22:08:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 208060416. Throughput: 0: 9459.8, 1: 9774.1. Samples: 208032596. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:08:56,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-5.659')] [2023-12-27 22:08:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000405736_103899136.pth... [2023-12-27 22:08:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000404616_103612416.pth [2023-12-27 22:08:56,214][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000406800_104169472.pth... [2023-12-27 22:08:56,218][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000405648_103874560.pth [2023-12-27 22:08:56,401][106226] Updated weights for policy 0, policy_version 405745 (0.0005) [2023-12-27 22:08:56,471][106226] Updated weights for policy 0, policy_version 405755 (0.0010) [2023-12-27 22:08:56,539][106226] Updated weights for policy 0, policy_version 405765 (0.0005) [2023-12-27 22:08:56,896][106225] Updated weights for policy 1, policy_version 406801 (0.0007) [2023-12-27 22:08:56,947][106225] Updated weights for policy 1, policy_version 406811 (0.0009) [2023-12-27 22:08:57,006][106225] Updated weights for policy 1, policy_version 406821 (0.0008) [2023-12-27 22:08:57,069][106225] Updated weights for policy 1, policy_version 406831 (0.0008) [2023-12-27 22:08:57,083][106226] Updated weights for policy 0, policy_version 405775 (0.0007) [2023-12-27 22:08:57,132][106226] Updated weights for policy 0, policy_version 405785 (0.0009) [2023-12-27 22:08:57,192][106226] Updated weights for policy 0, policy_version 405795 (0.0009) [2023-12-27 22:08:57,698][106225] Updated weights for policy 1, policy_version 406841 (0.0007) [2023-12-27 22:08:57,750][106225] Updated weights for policy 1, policy_version 406851 (0.0008) [2023-12-27 22:08:57,804][106225] Updated weights for policy 1, policy_version 406862 (0.0008) [2023-12-27 22:08:57,870][106226] Updated weights for policy 0, policy_version 405805 (0.0009) [2023-12-27 22:08:57,922][106226] Updated weights for policy 0, policy_version 405815 (0.0009) [2023-12-27 22:08:57,985][106226] Updated weights for policy 0, policy_version 405825 (0.0009) [2023-12-27 22:08:58,527][106225] Updated weights for policy 1, policy_version 406872 (0.0009) [2023-12-27 22:08:58,586][106225] Updated weights for policy 1, policy_version 406882 (0.0008) [2023-12-27 22:08:58,650][106225] Updated weights for policy 1, policy_version 406892 (0.0008) [2023-12-27 22:08:58,798][106226] Updated weights for policy 0, policy_version 405835 (0.0010) [2023-12-27 22:08:58,880][106226] Updated weights for policy 0, policy_version 405845 (0.0009) [2023-12-27 22:08:58,946][106226] Updated weights for policy 0, policy_version 405855 (0.0007) [2023-12-27 22:08:59,554][106225] Updated weights for policy 1, policy_version 406902 (0.0010) [2023-12-27 22:08:59,611][106225] Updated weights for policy 1, policy_version 406912 (0.0010) [2023-12-27 22:08:59,674][106225] Updated weights for policy 1, policy_version 406922 (0.0010) [2023-12-27 22:08:59,732][106226] Updated weights for policy 0, policy_version 405865 (0.0006) [2023-12-27 22:08:59,794][106226] Updated weights for policy 0, policy_version 405875 (0.0007) [2023-12-27 22:08:59,866][106226] Updated weights for policy 0, policy_version 405885 (0.0009) [2023-12-27 22:08:59,923][106226] Updated weights for policy 0, policy_version 405895 (0.0011) [2023-12-27 22:09:00,379][106225] Updated weights for policy 1, policy_version 406932 (0.0009) [2023-12-27 22:09:00,443][106225] Updated weights for policy 1, policy_version 406942 (0.0007) [2023-12-27 22:09:00,501][106225] Updated weights for policy 1, policy_version 406952 (0.0007) [2023-12-27 22:09:00,663][106226] Updated weights for policy 0, policy_version 405905 (0.0008) [2023-12-27 22:09:00,718][106226] Updated weights for policy 0, policy_version 405915 (0.0009) [2023-12-27 22:09:00,774][106226] Updated weights for policy 0, policy_version 405925 (0.0008) [2023-12-27 22:09:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 208158720. Throughput: 0: 9535.3, 1: 9801.6. Samples: 208150172. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:01,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.605')] [2023-12-27 22:09:01,223][106225] Updated weights for policy 1, policy_version 406962 (0.0006) [2023-12-27 22:09:01,291][106225] Updated weights for policy 1, policy_version 406972 (0.0008) [2023-12-27 22:09:01,361][106225] Updated weights for policy 1, policy_version 406982 (0.0009) [2023-12-27 22:09:01,424][106225] Updated weights for policy 1, policy_version 406992 (0.0009) [2023-12-27 22:09:01,449][106226] Updated weights for policy 0, policy_version 405935 (0.0008) [2023-12-27 22:09:01,515][106226] Updated weights for policy 0, policy_version 405945 (0.0009) [2023-12-27 22:09:01,576][106226] Updated weights for policy 0, policy_version 405955 (0.0009) [2023-12-27 22:09:02,170][106225] Updated weights for policy 1, policy_version 407002 (0.0008) [2023-12-27 22:09:02,218][106225] Updated weights for policy 1, policy_version 407012 (0.0007) [2023-12-27 22:09:02,275][106225] Updated weights for policy 1, policy_version 407022 (0.0007) [2023-12-27 22:09:02,406][106226] Updated weights for policy 0, policy_version 405965 (0.0008) [2023-12-27 22:09:02,469][106226] Updated weights for policy 0, policy_version 405975 (0.0006) [2023-12-27 22:09:02,528][106226] Updated weights for policy 0, policy_version 405985 (0.0008) [2023-12-27 22:09:03,054][106225] Updated weights for policy 1, policy_version 407032 (0.0007) [2023-12-27 22:09:03,112][106225] Updated weights for policy 1, policy_version 407042 (0.0009) [2023-12-27 22:09:03,167][106225] Updated weights for policy 1, policy_version 407052 (0.0009) [2023-12-27 22:09:03,192][106226] Updated weights for policy 0, policy_version 405995 (0.0009) [2023-12-27 22:09:03,249][106226] Updated weights for policy 0, policy_version 406005 (0.0006) [2023-12-27 22:09:03,308][106226] Updated weights for policy 0, policy_version 406015 (0.0005) [2023-12-27 22:09:03,920][106226] Updated weights for policy 0, policy_version 406025 (0.0006) [2023-12-27 22:09:03,932][106225] Updated weights for policy 1, policy_version 407062 (0.0006) [2023-12-27 22:09:03,983][106226] Updated weights for policy 0, policy_version 406035 (0.0007) [2023-12-27 22:09:03,996][106225] Updated weights for policy 1, policy_version 407072 (0.0007) [2023-12-27 22:09:04,047][106226] Updated weights for policy 0, policy_version 406045 (0.0008) [2023-12-27 22:09:04,064][106225] Updated weights for policy 1, policy_version 407082 (0.0006) [2023-12-27 22:09:04,113][106226] Updated weights for policy 0, policy_version 406055 (0.0007) [2023-12-27 22:09:04,674][106225] Updated weights for policy 1, policy_version 407092 (0.0006) [2023-12-27 22:09:04,737][106225] Updated weights for policy 1, policy_version 407102 (0.0005) [2023-12-27 22:09:04,796][106225] Updated weights for policy 1, policy_version 407112 (0.0008) [2023-12-27 22:09:04,884][106226] Updated weights for policy 0, policy_version 406065 (0.0009) [2023-12-27 22:09:04,931][106226] Updated weights for policy 0, policy_version 406075 (0.0008) [2023-12-27 22:09:04,984][106226] Updated weights for policy 0, policy_version 406085 (0.0009) [2023-12-27 22:09:05,351][106225] Updated weights for policy 1, policy_version 407122 (0.0006) [2023-12-27 22:09:05,405][106225] Updated weights for policy 1, policy_version 407132 (0.0008) [2023-12-27 22:09:05,457][106225] Updated weights for policy 1, policy_version 407142 (0.0005) [2023-12-27 22:09:05,508][106225] Updated weights for policy 1, policy_version 407152 (0.0005) [2023-12-27 22:09:05,831][106226] Updated weights for policy 0, policy_version 406095 (0.0009) [2023-12-27 22:09:05,890][106226] Updated weights for policy 0, policy_version 406105 (0.0009) [2023-12-27 22:09:05,958][106226] Updated weights for policy 0, policy_version 406115 (0.0008) [2023-12-27 22:09:06,066][106225] Updated weights for policy 1, policy_version 407162 (0.0007) [2023-12-27 22:09:06,127][106225] Updated weights for policy 1, policy_version 407172 (0.0008) [2023-12-27 22:09:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 208257024. Throughput: 0: 9602.5, 1: 9793.0. Samples: 208266744. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:06,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.899')] [2023-12-27 22:09:06,188][106225] Updated weights for policy 1, policy_version 407182 (0.0008) [2023-12-27 22:09:06,795][106225] Updated weights for policy 1, policy_version 407192 (0.0008) [2023-12-27 22:09:06,797][106226] Updated weights for policy 0, policy_version 406125 (0.0008) [2023-12-27 22:09:06,855][106225] Updated weights for policy 1, policy_version 407202 (0.0006) [2023-12-27 22:09:06,864][106226] Updated weights for policy 0, policy_version 406135 (0.0007) [2023-12-27 22:09:06,913][106225] Updated weights for policy 1, policy_version 407212 (0.0007) [2023-12-27 22:09:06,927][106226] Updated weights for policy 0, policy_version 406145 (0.0008) [2023-12-27 22:09:07,557][106225] Updated weights for policy 1, policy_version 407222 (0.0008) [2023-12-27 22:09:07,608][106225] Updated weights for policy 1, policy_version 407232 (0.0008) [2023-12-27 22:09:07,669][106225] Updated weights for policy 1, policy_version 407242 (0.0008) [2023-12-27 22:09:07,688][106226] Updated weights for policy 0, policy_version 406155 (0.0007) [2023-12-27 22:09:07,739][106226] Updated weights for policy 0, policy_version 406165 (0.0008) [2023-12-27 22:09:07,790][106226] Updated weights for policy 0, policy_version 406175 (0.0009) [2023-12-27 22:09:08,417][106225] Updated weights for policy 1, policy_version 407252 (0.0008) [2023-12-27 22:09:08,479][106225] Updated weights for policy 1, policy_version 407262 (0.0006) [2023-12-27 22:09:08,537][106225] Updated weights for policy 1, policy_version 407272 (0.0008) [2023-12-27 22:09:08,561][106226] Updated weights for policy 0, policy_version 406185 (0.0009) [2023-12-27 22:09:08,616][106226] Updated weights for policy 0, policy_version 406195 (0.0008) [2023-12-27 22:09:08,667][106226] Updated weights for policy 0, policy_version 406205 (0.0009) [2023-12-27 22:09:08,718][106226] Updated weights for policy 0, policy_version 406215 (0.0010) [2023-12-27 22:09:09,194][106225] Updated weights for policy 1, policy_version 407282 (0.0008) [2023-12-27 22:09:09,264][106225] Updated weights for policy 1, policy_version 407292 (0.0008) [2023-12-27 22:09:09,326][106225] Updated weights for policy 1, policy_version 407302 (0.0009) [2023-12-27 22:09:09,400][106225] Updated weights for policy 1, policy_version 407312 (0.0009) [2023-12-27 22:09:09,545][106226] Updated weights for policy 0, policy_version 406225 (0.0009) [2023-12-27 22:09:09,597][106226] Updated weights for policy 0, policy_version 406235 (0.0009) [2023-12-27 22:09:09,654][106226] Updated weights for policy 0, policy_version 406245 (0.0009) [2023-12-27 22:09:10,150][106225] Updated weights for policy 1, policy_version 407322 (0.0009) [2023-12-27 22:09:10,208][106225] Updated weights for policy 1, policy_version 407332 (0.0009) [2023-12-27 22:09:10,261][106225] Updated weights for policy 1, policy_version 407342 (0.0009) [2023-12-27 22:09:10,509][106226] Updated weights for policy 0, policy_version 406255 (0.0010) [2023-12-27 22:09:10,569][106226] Updated weights for policy 0, policy_version 406265 (0.0011) [2023-12-27 22:09:10,629][106226] Updated weights for policy 0, policy_version 406275 (0.0011) [2023-12-27 22:09:11,031][106225] Updated weights for policy 1, policy_version 407352 (0.0010) [2023-12-27 22:09:11,100][106225] Updated weights for policy 1, policy_version 407362 (0.0008) [2023-12-27 22:09:11,164][106225] Updated weights for policy 1, policy_version 407372 (0.0009) [2023-12-27 22:09:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19114.7, 300 sec: 19438.6). Total num frames: 208347136. Throughput: 0: 9583.8, 1: 9875.4. Samples: 208325420. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:11,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-5.804')] [2023-12-27 22:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000406280_104038400.pth... [2023-12-27 22:09:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000405192_103759872.pth [2023-12-27 22:09:11,191][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000407376_104316928.pth... [2023-12-27 22:09:11,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000406224_104022016.pth [2023-12-27 22:09:11,367][106226] Updated weights for policy 0, policy_version 406285 (0.0009) [2023-12-27 22:09:11,421][106226] Updated weights for policy 0, policy_version 406295 (0.0009) [2023-12-27 22:09:11,470][106226] Updated weights for policy 0, policy_version 406305 (0.0009) [2023-12-27 22:09:11,974][106225] Updated weights for policy 1, policy_version 407382 (0.0008) [2023-12-27 22:09:12,033][106225] Updated weights for policy 1, policy_version 407392 (0.0008) [2023-12-27 22:09:12,093][106225] Updated weights for policy 1, policy_version 407402 (0.0009) [2023-12-27 22:09:12,296][106226] Updated weights for policy 0, policy_version 406315 (0.0009) [2023-12-27 22:09:12,365][106226] Updated weights for policy 0, policy_version 406325 (0.0008) [2023-12-27 22:09:12,436][106226] Updated weights for policy 0, policy_version 406335 (0.0009) [2023-12-27 22:09:12,909][106225] Updated weights for policy 1, policy_version 407412 (0.0009) [2023-12-27 22:09:12,966][106225] Updated weights for policy 1, policy_version 407422 (0.0009) [2023-12-27 22:09:13,026][106225] Updated weights for policy 1, policy_version 407432 (0.0008) [2023-12-27 22:09:13,097][106226] Updated weights for policy 0, policy_version 406345 (0.0009) [2023-12-27 22:09:13,153][106226] Updated weights for policy 0, policy_version 406355 (0.0008) [2023-12-27 22:09:13,209][106226] Updated weights for policy 0, policy_version 406365 (0.0008) [2023-12-27 22:09:13,270][106226] Updated weights for policy 0, policy_version 406375 (0.0009) [2023-12-27 22:09:13,732][106225] Updated weights for policy 1, policy_version 407442 (0.0008) [2023-12-27 22:09:13,788][106225] Updated weights for policy 1, policy_version 407452 (0.0008) [2023-12-27 22:09:13,843][106225] Updated weights for policy 1, policy_version 407462 (0.0009) [2023-12-27 22:09:13,897][106225] Updated weights for policy 1, policy_version 407472 (0.0008) [2023-12-27 22:09:14,012][106226] Updated weights for policy 0, policy_version 406385 (0.0008) [2023-12-27 22:09:14,071][106226] Updated weights for policy 0, policy_version 406395 (0.0007) [2023-12-27 22:09:14,134][106226] Updated weights for policy 0, policy_version 406405 (0.0008) [2023-12-27 22:09:14,672][106225] Updated weights for policy 1, policy_version 407482 (0.0008) [2023-12-27 22:09:14,707][106226] Updated weights for policy 0, policy_version 406415 (0.0006) [2023-12-27 22:09:14,734][106225] Updated weights for policy 1, policy_version 407492 (0.0008) [2023-12-27 22:09:14,778][106226] Updated weights for policy 0, policy_version 406425 (0.0008) [2023-12-27 22:09:14,798][106225] Updated weights for policy 1, policy_version 407502 (0.0008) [2023-12-27 22:09:14,839][106226] Updated weights for policy 0, policy_version 406435 (0.0006) [2023-12-27 22:09:15,540][106225] Updated weights for policy 1, policy_version 407512 (0.0009) [2023-12-27 22:09:15,544][106226] Updated weights for policy 0, policy_version 406445 (0.0010) [2023-12-27 22:09:15,592][106226] Updated weights for policy 0, policy_version 406455 (0.0010) [2023-12-27 22:09:15,597][106225] Updated weights for policy 1, policy_version 407522 (0.0007) [2023-12-27 22:09:15,657][106226] Updated weights for policy 0, policy_version 406465 (0.0011) [2023-12-27 22:09:15,658][106225] Updated weights for policy 1, policy_version 407532 (0.0006) [2023-12-27 22:09:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 208445440. Throughput: 0: 9499.3, 1: 9706.7. Samples: 208437336. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:16,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-5.586')] [2023-12-27 22:09:16,324][106225] Updated weights for policy 1, policy_version 407542 (0.0008) [2023-12-27 22:09:16,377][106226] Updated weights for policy 0, policy_version 406475 (0.0010) [2023-12-27 22:09:16,384][106225] Updated weights for policy 1, policy_version 407552 (0.0010) [2023-12-27 22:09:16,432][106225] Updated weights for policy 1, policy_version 407562 (0.0010) [2023-12-27 22:09:16,433][106226] Updated weights for policy 0, policy_version 406485 (0.0010) [2023-12-27 22:09:16,487][106226] Updated weights for policy 0, policy_version 406496 (0.0010) [2023-12-27 22:09:17,107][106225] Updated weights for policy 1, policy_version 407572 (0.0008) [2023-12-27 22:09:17,171][106225] Updated weights for policy 1, policy_version 407582 (0.0007) [2023-12-27 22:09:17,233][106225] Updated weights for policy 1, policy_version 407592 (0.0006) [2023-12-27 22:09:17,272][106226] Updated weights for policy 0, policy_version 406506 (0.0008) [2023-12-27 22:09:17,326][106226] Updated weights for policy 0, policy_version 406516 (0.0008) [2023-12-27 22:09:17,376][106226] Updated weights for policy 0, policy_version 406526 (0.0008) [2023-12-27 22:09:17,431][106226] Updated weights for policy 0, policy_version 406536 (0.0010) [2023-12-27 22:09:17,926][106225] Updated weights for policy 1, policy_version 407602 (0.0006) [2023-12-27 22:09:17,974][106225] Updated weights for policy 1, policy_version 407612 (0.0008) [2023-12-27 22:09:18,031][106225] Updated weights for policy 1, policy_version 407622 (0.0008) [2023-12-27 22:09:18,037][106226] Updated weights for policy 0, policy_version 406546 (0.0008) [2023-12-27 22:09:18,089][106226] Updated weights for policy 0, policy_version 406556 (0.0005) [2023-12-27 22:09:18,089][106225] Updated weights for policy 1, policy_version 407632 (0.0008) [2023-12-27 22:09:18,141][106226] Updated weights for policy 0, policy_version 406566 (0.0005) [2023-12-27 22:09:18,866][106225] Updated weights for policy 1, policy_version 407642 (0.0006) [2023-12-27 22:09:18,874][106226] Updated weights for policy 0, policy_version 406576 (0.0008) [2023-12-27 22:09:18,927][106225] Updated weights for policy 1, policy_version 407652 (0.0007) [2023-12-27 22:09:18,938][106226] Updated weights for policy 0, policy_version 406586 (0.0008) [2023-12-27 22:09:18,998][106225] Updated weights for policy 1, policy_version 407662 (0.0006) [2023-12-27 22:09:19,000][106226] Updated weights for policy 0, policy_version 406596 (0.0006) [2023-12-27 22:09:19,714][106225] Updated weights for policy 1, policy_version 407672 (0.0007) [2023-12-27 22:09:19,773][106226] Updated weights for policy 0, policy_version 406606 (0.0009) [2023-12-27 22:09:19,787][106225] Updated weights for policy 1, policy_version 407682 (0.0006) [2023-12-27 22:09:19,842][106226] Updated weights for policy 0, policy_version 406616 (0.0009) [2023-12-27 22:09:19,858][106225] Updated weights for policy 1, policy_version 407692 (0.0007) [2023-12-27 22:09:19,911][106226] Updated weights for policy 0, policy_version 406626 (0.0007) [2023-12-27 22:09:20,556][106225] Updated weights for policy 1, policy_version 407702 (0.0007) [2023-12-27 22:09:20,638][106225] Updated weights for policy 1, policy_version 407712 (0.0009) [2023-12-27 22:09:20,644][106226] Updated weights for policy 0, policy_version 406636 (0.0007) [2023-12-27 22:09:20,703][106225] Updated weights for policy 1, policy_version 407722 (0.0009) [2023-12-27 22:09:20,710][106226] Updated weights for policy 0, policy_version 406646 (0.0006) [2023-12-27 22:09:20,780][106226] Updated weights for policy 0, policy_version 406656 (0.0008) [2023-12-27 22:09:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19251.2, 300 sec: 19438.7). Total num frames: 208543744. Throughput: 0: 9468.1, 1: 9747.5. Samples: 208553248. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:21,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-5.740')] [2023-12-27 22:09:21,438][106225] Updated weights for policy 1, policy_version 407732 (0.0007) [2023-12-27 22:09:21,473][106226] Updated weights for policy 0, policy_version 406666 (0.0006) [2023-12-27 22:09:21,503][106225] Updated weights for policy 1, policy_version 407742 (0.0008) [2023-12-27 22:09:21,536][106226] Updated weights for policy 0, policy_version 406676 (0.0007) [2023-12-27 22:09:21,569][106225] Updated weights for policy 1, policy_version 407752 (0.0007) [2023-12-27 22:09:21,594][106226] Updated weights for policy 0, policy_version 406686 (0.0008) [2023-12-27 22:09:21,660][106226] Updated weights for policy 0, policy_version 406696 (0.0010) [2023-12-27 22:09:22,341][106226] Updated weights for policy 0, policy_version 406706 (0.0009) [2023-12-27 22:09:22,358][106225] Updated weights for policy 1, policy_version 407762 (0.0007) [2023-12-27 22:09:22,411][106226] Updated weights for policy 0, policy_version 406716 (0.0009) [2023-12-27 22:09:22,427][106225] Updated weights for policy 1, policy_version 407772 (0.0007) [2023-12-27 22:09:22,466][106226] Updated weights for policy 0, policy_version 406726 (0.0007) [2023-12-27 22:09:22,480][106225] Updated weights for policy 1, policy_version 407782 (0.0006) [2023-12-27 22:09:22,533][106225] Updated weights for policy 1, policy_version 407792 (0.0008) [2023-12-27 22:09:23,203][106226] Updated weights for policy 0, policy_version 406736 (0.0009) [2023-12-27 22:09:23,269][106226] Updated weights for policy 0, policy_version 406746 (0.0009) [2023-12-27 22:09:23,273][106225] Updated weights for policy 1, policy_version 407802 (0.0006) [2023-12-27 22:09:23,328][106225] Updated weights for policy 1, policy_version 407812 (0.0006) [2023-12-27 22:09:23,331][106226] Updated weights for policy 0, policy_version 406756 (0.0006) [2023-12-27 22:09:23,383][106225] Updated weights for policy 1, policy_version 407822 (0.0006) [2023-12-27 22:09:23,967][106225] Updated weights for policy 1, policy_version 407832 (0.0006) [2023-12-27 22:09:24,024][106225] Updated weights for policy 1, policy_version 407842 (0.0006) [2023-12-27 22:09:24,096][106225] Updated weights for policy 1, policy_version 407852 (0.0007) [2023-12-27 22:09:24,142][106226] Updated weights for policy 0, policy_version 406766 (0.0008) [2023-12-27 22:09:24,200][106226] Updated weights for policy 0, policy_version 406776 (0.0009) [2023-12-27 22:09:24,248][106226] Updated weights for policy 0, policy_version 406786 (0.0007) [2023-12-27 22:09:24,790][106225] Updated weights for policy 1, policy_version 407862 (0.0007) [2023-12-27 22:09:24,841][106225] Updated weights for policy 1, policy_version 407872 (0.0008) [2023-12-27 22:09:24,894][106225] Updated weights for policy 1, policy_version 407882 (0.0008) [2023-12-27 22:09:25,008][106226] Updated weights for policy 0, policy_version 406796 (0.0008) [2023-12-27 22:09:25,062][106226] Updated weights for policy 0, policy_version 406807 (0.0009) [2023-12-27 22:09:25,115][106226] Updated weights for policy 0, policy_version 406817 (0.0008) [2023-12-27 22:09:25,639][106225] Updated weights for policy 1, policy_version 407892 (0.0008) [2023-12-27 22:09:25,698][106225] Updated weights for policy 1, policy_version 407902 (0.0006) [2023-12-27 22:09:25,759][106225] Updated weights for policy 1, policy_version 407912 (0.0005) [2023-12-27 22:09:25,893][106226] Updated weights for policy 0, policy_version 406827 (0.0009) [2023-12-27 22:09:25,955][106226] Updated weights for policy 0, policy_version 406837 (0.0009) [2023-12-27 22:09:26,009][106226] Updated weights for policy 0, policy_version 406847 (0.0008) [2023-12-27 22:09:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 208642048. Throughput: 0: 9482.2, 1: 9729.9. Samples: 208610816. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:26,175][105115] Avg episode reward: [(0, '-5.268'), (1, '-5.647')] [2023-12-27 22:09:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000406856_104185856.pth... [2023-12-27 22:09:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000407920_104456192.pth... [2023-12-27 22:09:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000406800_104169472.pth [2023-12-27 22:09:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000405736_103899136.pth [2023-12-27 22:09:26,345][106225] Updated weights for policy 1, policy_version 407922 (0.0006) [2023-12-27 22:09:26,394][106225] Updated weights for policy 1, policy_version 407932 (0.0008) [2023-12-27 22:09:26,439][106225] Updated weights for policy 1, policy_version 407942 (0.0008) [2023-12-27 22:09:26,485][106225] Updated weights for policy 1, policy_version 407952 (0.0008) [2023-12-27 22:09:26,762][106226] Updated weights for policy 0, policy_version 406857 (0.0008) [2023-12-27 22:09:26,806][106226] Updated weights for policy 0, policy_version 406867 (0.0008) [2023-12-27 22:09:26,851][106226] Updated weights for policy 0, policy_version 406877 (0.0007) [2023-12-27 22:09:26,895][106226] Updated weights for policy 0, policy_version 406887 (0.0008) [2023-12-27 22:09:27,259][106225] Updated weights for policy 1, policy_version 407962 (0.0010) [2023-12-27 22:09:27,325][106225] Updated weights for policy 1, policy_version 407972 (0.0010) [2023-12-27 22:09:27,368][106225] Updated weights for policy 1, policy_version 407982 (0.0010) [2023-12-27 22:09:27,672][106226] Updated weights for policy 0, policy_version 406897 (0.0008) [2023-12-27 22:09:27,736][106226] Updated weights for policy 0, policy_version 406907 (0.0008) [2023-12-27 22:09:27,785][106226] Updated weights for policy 0, policy_version 406917 (0.0007) [2023-12-27 22:09:28,083][106225] Updated weights for policy 1, policy_version 407992 (0.0010) [2023-12-27 22:09:28,142][106225] Updated weights for policy 1, policy_version 408002 (0.0010) [2023-12-27 22:09:28,204][106225] Updated weights for policy 1, policy_version 408012 (0.0010) [2023-12-27 22:09:28,534][106226] Updated weights for policy 0, policy_version 406927 (0.0008) [2023-12-27 22:09:28,584][106226] Updated weights for policy 0, policy_version 406937 (0.0008) [2023-12-27 22:09:28,649][106226] Updated weights for policy 0, policy_version 406947 (0.0008) [2023-12-27 22:09:28,920][106225] Updated weights for policy 1, policy_version 408022 (0.0010) [2023-12-27 22:09:28,976][106225] Updated weights for policy 1, policy_version 408032 (0.0010) [2023-12-27 22:09:29,023][106225] Updated weights for policy 1, policy_version 408042 (0.0010) [2023-12-27 22:09:29,405][106226] Updated weights for policy 0, policy_version 406957 (0.0008) [2023-12-27 22:09:29,459][106226] Updated weights for policy 0, policy_version 406967 (0.0008) [2023-12-27 22:09:29,514][106226] Updated weights for policy 0, policy_version 406977 (0.0008) [2023-12-27 22:09:29,767][106225] Updated weights for policy 1, policy_version 408052 (0.0010) [2023-12-27 22:09:29,835][106225] Updated weights for policy 1, policy_version 408062 (0.0011) [2023-12-27 22:09:29,906][106225] Updated weights for policy 1, policy_version 408072 (0.0011) [2023-12-27 22:09:30,289][106226] Updated weights for policy 0, policy_version 406987 (0.0008) [2023-12-27 22:09:30,347][106226] Updated weights for policy 0, policy_version 406997 (0.0008) [2023-12-27 22:09:30,401][106226] Updated weights for policy 0, policy_version 407007 (0.0008) [2023-12-27 22:09:30,633][106225] Updated weights for policy 1, policy_version 408082 (0.0008) [2023-12-27 22:09:30,682][106225] Updated weights for policy 1, policy_version 408092 (0.0010) [2023-12-27 22:09:30,732][106225] Updated weights for policy 1, policy_version 408102 (0.0010) [2023-12-27 22:09:30,791][106225] Updated weights for policy 1, policy_version 408112 (0.0010) [2023-12-27 22:09:31,158][106226] Updated weights for policy 0, policy_version 407017 (0.0008) [2023-12-27 22:09:31,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19114.7, 300 sec: 19410.9). Total num frames: 208732160. Throughput: 0: 9443.6, 1: 9776.9. Samples: 208725976. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:31,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.929')] [2023-12-27 22:09:31,222][106226] Updated weights for policy 0, policy_version 407027 (0.0008) [2023-12-27 22:09:31,281][106226] Updated weights for policy 0, policy_version 407037 (0.0008) [2023-12-27 22:09:31,344][106226] Updated weights for policy 0, policy_version 407047 (0.0008) [2023-12-27 22:09:31,553][106225] Updated weights for policy 1, policy_version 408122 (0.0006) [2023-12-27 22:09:31,619][106225] Updated weights for policy 1, policy_version 408132 (0.0008) [2023-12-27 22:09:31,682][106225] Updated weights for policy 1, policy_version 408142 (0.0007) [2023-12-27 22:09:32,115][106226] Updated weights for policy 0, policy_version 407057 (0.0008) [2023-12-27 22:09:32,179][106226] Updated weights for policy 0, policy_version 407067 (0.0007) [2023-12-27 22:09:32,240][106226] Updated weights for policy 0, policy_version 407077 (0.0008) [2023-12-27 22:09:32,398][106225] Updated weights for policy 1, policy_version 408152 (0.0009) [2023-12-27 22:09:32,466][106225] Updated weights for policy 1, policy_version 408162 (0.0011) [2023-12-27 22:09:32,532][106225] Updated weights for policy 1, policy_version 408172 (0.0011) [2023-12-27 22:09:32,981][106226] Updated weights for policy 0, policy_version 407087 (0.0008) [2023-12-27 22:09:33,029][106226] Updated weights for policy 0, policy_version 407097 (0.0008) [2023-12-27 22:09:33,074][106226] Updated weights for policy 0, policy_version 407107 (0.0008) [2023-12-27 22:09:33,260][106225] Updated weights for policy 1, policy_version 408182 (0.0011) [2023-12-27 22:09:33,313][106225] Updated weights for policy 1, policy_version 408192 (0.0010) [2023-12-27 22:09:33,358][106225] Updated weights for policy 1, policy_version 408202 (0.0010) [2023-12-27 22:09:33,832][106226] Updated weights for policy 0, policy_version 407117 (0.0008) [2023-12-27 22:09:33,888][106226] Updated weights for policy 0, policy_version 407127 (0.0008) [2023-12-27 22:09:33,945][106226] Updated weights for policy 0, policy_version 407137 (0.0007) [2023-12-27 22:09:34,079][106225] Updated weights for policy 1, policy_version 408212 (0.0010) [2023-12-27 22:09:34,133][106225] Updated weights for policy 1, policy_version 408222 (0.0010) [2023-12-27 22:09:34,198][106225] Updated weights for policy 1, policy_version 408232 (0.0008) [2023-12-27 22:09:34,712][106226] Updated weights for policy 0, policy_version 407147 (0.0008) [2023-12-27 22:09:34,777][106226] Updated weights for policy 0, policy_version 407157 (0.0008) [2023-12-27 22:09:34,839][106226] Updated weights for policy 0, policy_version 407167 (0.0008) [2023-12-27 22:09:34,962][106225] Updated weights for policy 1, policy_version 408242 (0.0011) [2023-12-27 22:09:35,019][106225] Updated weights for policy 1, policy_version 408252 (0.0010) [2023-12-27 22:09:35,068][106225] Updated weights for policy 1, policy_version 408262 (0.0010) [2023-12-27 22:09:35,127][106225] Updated weights for policy 1, policy_version 408272 (0.0010) [2023-12-27 22:09:35,564][106226] Updated weights for policy 0, policy_version 407177 (0.0008) [2023-12-27 22:09:35,622][106226] Updated weights for policy 0, policy_version 407187 (0.0008) [2023-12-27 22:09:35,674][106226] Updated weights for policy 0, policy_version 407197 (0.0008) [2023-12-27 22:09:35,728][106226] Updated weights for policy 0, policy_version 407207 (0.0008) [2023-12-27 22:09:35,842][106225] Updated weights for policy 1, policy_version 408282 (0.0008) [2023-12-27 22:09:35,889][106225] Updated weights for policy 1, policy_version 408292 (0.0008) [2023-12-27 22:09:35,947][106225] Updated weights for policy 1, policy_version 408302 (0.0009) [2023-12-27 22:09:36,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 208830464. Throughput: 0: 9410.1, 1: 9774.8. Samples: 208839048. Policy #0 lag: (min: 28.0, avg: 38.7, max: 60.0) [2023-12-27 22:09:36,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-6.017')] [2023-12-27 22:09:36,406][106226] Updated weights for policy 0, policy_version 407217 (0.0006) [2023-12-27 22:09:36,463][106226] Updated weights for policy 0, policy_version 407227 (0.0007) [2023-12-27 22:09:36,528][106226] Updated weights for policy 0, policy_version 407237 (0.0009) [2023-12-27 22:09:36,727][106225] Updated weights for policy 1, policy_version 408312 (0.0008) [2023-12-27 22:09:36,786][106225] Updated weights for policy 1, policy_version 408322 (0.0009) [2023-12-27 22:09:36,857][106225] Updated weights for policy 1, policy_version 408332 (0.0010) [2023-12-27 22:09:37,182][106226] Updated weights for policy 0, policy_version 407247 (0.0008) [2023-12-27 22:09:37,233][106226] Updated weights for policy 0, policy_version 407257 (0.0008) [2023-12-27 22:09:37,284][106226] Updated weights for policy 0, policy_version 407267 (0.0008) [2023-12-27 22:09:37,645][106225] Updated weights for policy 1, policy_version 408342 (0.0007) [2023-12-27 22:09:37,706][106225] Updated weights for policy 1, policy_version 408352 (0.0005) [2023-12-27 22:09:37,766][106225] Updated weights for policy 1, policy_version 408362 (0.0007) [2023-12-27 22:09:38,062][106226] Updated weights for policy 0, policy_version 407277 (0.0008) [2023-12-27 22:09:38,132][106226] Updated weights for policy 0, policy_version 407287 (0.0009) [2023-12-27 22:09:38,181][106226] Updated weights for policy 0, policy_version 407297 (0.0008) [2023-12-27 22:09:38,330][106225] Updated weights for policy 1, policy_version 408372 (0.0008) [2023-12-27 22:09:38,402][106225] Updated weights for policy 1, policy_version 408382 (0.0008) [2023-12-27 22:09:38,465][106225] Updated weights for policy 1, policy_version 408392 (0.0008) [2023-12-27 22:09:38,983][106226] Updated weights for policy 0, policy_version 407307 (0.0008) [2023-12-27 22:09:39,036][106226] Updated weights for policy 0, policy_version 407317 (0.0010) [2023-12-27 22:09:39,087][106225] Updated weights for policy 1, policy_version 408402 (0.0007) [2023-12-27 22:09:39,095][106226] Updated weights for policy 0, policy_version 407327 (0.0007) [2023-12-27 22:09:39,144][106225] Updated weights for policy 1, policy_version 408412 (0.0005) [2023-12-27 22:09:39,197][106225] Updated weights for policy 1, policy_version 408422 (0.0005) [2023-12-27 22:09:39,266][106225] Updated weights for policy 1, policy_version 408432 (0.0008) [2023-12-27 22:09:39,948][106226] Updated weights for policy 0, policy_version 407337 (0.0009) [2023-12-27 22:09:39,950][106225] Updated weights for policy 1, policy_version 408442 (0.0008) [2023-12-27 22:09:40,018][106225] Updated weights for policy 1, policy_version 408452 (0.0009) [2023-12-27 22:09:40,023][106226] Updated weights for policy 0, policy_version 407347 (0.0007) [2023-12-27 22:09:40,077][106225] Updated weights for policy 1, policy_version 408462 (0.0009) [2023-12-27 22:09:40,091][106226] Updated weights for policy 0, policy_version 407357 (0.0006) [2023-12-27 22:09:40,161][106226] Updated weights for policy 0, policy_version 407367 (0.0009) [2023-12-27 22:09:40,842][106225] Updated weights for policy 1, policy_version 408472 (0.0006) [2023-12-27 22:09:40,860][106226] Updated weights for policy 0, policy_version 407377 (0.0009) [2023-12-27 22:09:40,902][106225] Updated weights for policy 1, policy_version 408482 (0.0006) [2023-12-27 22:09:40,923][106226] Updated weights for policy 0, policy_version 407387 (0.0009) [2023-12-27 22:09:40,954][106225] Updated weights for policy 1, policy_version 408492 (0.0006) [2023-12-27 22:09:40,979][106226] Updated weights for policy 0, policy_version 407397 (0.0007) [2023-12-27 22:09:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 208928768. Throughput: 0: 9452.7, 1: 9745.8. Samples: 208896532. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:09:41,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.712')] [2023-12-27 22:09:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000408496_104603648.pth... [2023-12-27 22:09:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000407400_104325120.pth... [2023-12-27 22:09:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000407376_104316928.pth [2023-12-27 22:09:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000406280_104038400.pth [2023-12-27 22:09:41,738][106225] Updated weights for policy 1, policy_version 408502 (0.0008) [2023-12-27 22:09:41,765][106226] Updated weights for policy 0, policy_version 407407 (0.0008) [2023-12-27 22:09:41,800][106225] Updated weights for policy 1, policy_version 408512 (0.0007) [2023-12-27 22:09:41,833][106226] Updated weights for policy 0, policy_version 407417 (0.0009) [2023-12-27 22:09:41,867][106225] Updated weights for policy 1, policy_version 408522 (0.0007) [2023-12-27 22:09:41,898][106226] Updated weights for policy 0, policy_version 407427 (0.0006) [2023-12-27 22:09:42,616][106226] Updated weights for policy 0, policy_version 407437 (0.0008) [2023-12-27 22:09:42,619][106225] Updated weights for policy 1, policy_version 408533 (0.0008) [2023-12-27 22:09:42,673][106226] Updated weights for policy 0, policy_version 407447 (0.0008) [2023-12-27 22:09:42,683][106225] Updated weights for policy 1, policy_version 408543 (0.0006) [2023-12-27 22:09:42,733][106226] Updated weights for policy 0, policy_version 407457 (0.0008) [2023-12-27 22:09:42,745][106225] Updated weights for policy 1, policy_version 408553 (0.0006) [2023-12-27 22:09:43,411][106226] Updated weights for policy 0, policy_version 407467 (0.0008) [2023-12-27 22:09:43,461][106225] Updated weights for policy 1, policy_version 408563 (0.0007) [2023-12-27 22:09:43,475][106226] Updated weights for policy 0, policy_version 407477 (0.0008) [2023-12-27 22:09:43,508][106225] Updated weights for policy 1, policy_version 408573 (0.0006) [2023-12-27 22:09:43,526][106226] Updated weights for policy 0, policy_version 407487 (0.0007) [2023-12-27 22:09:43,559][106225] Updated weights for policy 1, policy_version 408583 (0.0006) [2023-12-27 22:09:44,228][106226] Updated weights for policy 0, policy_version 407497 (0.0006) [2023-12-27 22:09:44,290][106226] Updated weights for policy 0, policy_version 407507 (0.0009) [2023-12-27 22:09:44,309][106225] Updated weights for policy 1, policy_version 408593 (0.0007) [2023-12-27 22:09:44,346][106226] Updated weights for policy 0, policy_version 407517 (0.0009) [2023-12-27 22:09:44,367][106225] Updated weights for policy 1, policy_version 408603 (0.0008) [2023-12-27 22:09:44,401][106226] Updated weights for policy 0, policy_version 407527 (0.0007) [2023-12-27 22:09:44,429][106225] Updated weights for policy 1, policy_version 408613 (0.0007) [2023-12-27 22:09:44,490][106225] Updated weights for policy 1, policy_version 408623 (0.0008) [2023-12-27 22:09:45,155][106226] Updated weights for policy 0, policy_version 407537 (0.0006) [2023-12-27 22:09:45,209][106225] Updated weights for policy 1, policy_version 408633 (0.0010) [2023-12-27 22:09:45,221][106226] Updated weights for policy 0, policy_version 407547 (0.0006) [2023-12-27 22:09:45,275][106225] Updated weights for policy 1, policy_version 408643 (0.0006) [2023-12-27 22:09:45,290][106226] Updated weights for policy 0, policy_version 407557 (0.0007) [2023-12-27 22:09:45,335][106225] Updated weights for policy 1, policy_version 408653 (0.0009) [2023-12-27 22:09:45,923][106226] Updated weights for policy 0, policy_version 407567 (0.0010) [2023-12-27 22:09:45,973][106226] Updated weights for policy 0, policy_version 407577 (0.0010) [2023-12-27 22:09:46,023][106226] Updated weights for policy 0, policy_version 407587 (0.0010) [2023-12-27 22:09:46,027][106225] Updated weights for policy 1, policy_version 408663 (0.0010) [2023-12-27 22:09:46,078][106225] Updated weights for policy 1, policy_version 408673 (0.0010) [2023-12-27 22:09:46,135][106225] Updated weights for policy 1, policy_version 408683 (0.0010) [2023-12-27 22:09:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 209027072. Throughput: 0: 9415.8, 1: 9699.3. Samples: 209010352. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:09:46,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.822')] [2023-12-27 22:09:46,762][106226] Updated weights for policy 0, policy_version 407597 (0.0008) [2023-12-27 22:09:46,806][106225] Updated weights for policy 1, policy_version 408693 (0.0009) [2023-12-27 22:09:46,820][106226] Updated weights for policy 0, policy_version 407607 (0.0007) [2023-12-27 22:09:46,866][106225] Updated weights for policy 1, policy_version 408703 (0.0008) [2023-12-27 22:09:46,872][106226] Updated weights for policy 0, policy_version 407617 (0.0007) [2023-12-27 22:09:46,926][106225] Updated weights for policy 1, policy_version 408713 (0.0007) [2023-12-27 22:09:47,470][106226] Updated weights for policy 0, policy_version 407627 (0.0006) [2023-12-27 22:09:47,537][106226] Updated weights for policy 0, policy_version 407637 (0.0005) [2023-12-27 22:09:47,603][106226] Updated weights for policy 0, policy_version 407647 (0.0007) [2023-12-27 22:09:47,694][106225] Updated weights for policy 1, policy_version 408723 (0.0008) [2023-12-27 22:09:47,756][106225] Updated weights for policy 1, policy_version 408733 (0.0005) [2023-12-27 22:09:47,818][106225] Updated weights for policy 1, policy_version 408743 (0.0006) [2023-12-27 22:09:48,179][106226] Updated weights for policy 0, policy_version 407657 (0.0009) [2023-12-27 22:09:48,239][106226] Updated weights for policy 0, policy_version 407667 (0.0008) [2023-12-27 22:09:48,296][106226] Updated weights for policy 0, policy_version 407677 (0.0008) [2023-12-27 22:09:48,352][106226] Updated weights for policy 0, policy_version 407687 (0.0008) [2023-12-27 22:09:48,526][106225] Updated weights for policy 1, policy_version 408753 (0.0008) [2023-12-27 22:09:48,585][106225] Updated weights for policy 1, policy_version 408763 (0.0008) [2023-12-27 22:09:48,645][106225] Updated weights for policy 1, policy_version 408773 (0.0007) [2023-12-27 22:09:48,707][106225] Updated weights for policy 1, policy_version 408783 (0.0005) [2023-12-27 22:09:49,140][106226] Updated weights for policy 0, policy_version 407697 (0.0009) [2023-12-27 22:09:49,204][106226] Updated weights for policy 0, policy_version 407707 (0.0010) [2023-12-27 22:09:49,275][106226] Updated weights for policy 0, policy_version 407717 (0.0007) [2023-12-27 22:09:49,407][106225] Updated weights for policy 1, policy_version 408793 (0.0009) [2023-12-27 22:09:49,479][106225] Updated weights for policy 1, policy_version 408803 (0.0010) [2023-12-27 22:09:49,541][106225] Updated weights for policy 1, policy_version 408813 (0.0008) [2023-12-27 22:09:50,017][106226] Updated weights for policy 0, policy_version 407727 (0.0008) [2023-12-27 22:09:50,092][106226] Updated weights for policy 0, policy_version 407737 (0.0008) [2023-12-27 22:09:50,163][106226] Updated weights for policy 0, policy_version 407747 (0.0009) [2023-12-27 22:09:50,320][106225] Updated weights for policy 1, policy_version 408823 (0.0008) [2023-12-27 22:09:50,379][106225] Updated weights for policy 1, policy_version 408833 (0.0008) [2023-12-27 22:09:50,441][106225] Updated weights for policy 1, policy_version 408843 (0.0006) [2023-12-27 22:09:50,875][106226] Updated weights for policy 0, policy_version 407757 (0.0007) [2023-12-27 22:09:50,933][106226] Updated weights for policy 0, policy_version 407767 (0.0008) [2023-12-27 22:09:51,002][106226] Updated weights for policy 0, policy_version 407777 (0.0009) [2023-12-27 22:09:51,163][106225] Updated weights for policy 1, policy_version 408853 (0.0008) [2023-12-27 22:09:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 209117184. Throughput: 0: 9467.4, 1: 9656.3. Samples: 209127308. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:09:51,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-5.660')] [2023-12-27 22:09:51,226][106225] Updated weights for policy 1, policy_version 408863 (0.0008) [2023-12-27 22:09:51,297][106225] Updated weights for policy 1, policy_version 408873 (0.0008) [2023-12-27 22:09:51,781][106226] Updated weights for policy 0, policy_version 407787 (0.0007) [2023-12-27 22:09:51,831][106226] Updated weights for policy 0, policy_version 407797 (0.0006) [2023-12-27 22:09:51,898][106226] Updated weights for policy 0, policy_version 407807 (0.0006) [2023-12-27 22:09:52,054][106225] Updated weights for policy 1, policy_version 408883 (0.0007) [2023-12-27 22:09:52,128][106225] Updated weights for policy 1, policy_version 408893 (0.0006) [2023-12-27 22:09:52,203][106225] Updated weights for policy 1, policy_version 408903 (0.0008) [2023-12-27 22:09:52,544][106226] Updated weights for policy 0, policy_version 407817 (0.0005) [2023-12-27 22:09:52,602][106226] Updated weights for policy 0, policy_version 407827 (0.0010) [2023-12-27 22:09:52,663][106226] Updated weights for policy 0, policy_version 407837 (0.0010) [2023-12-27 22:09:52,733][106226] Updated weights for policy 0, policy_version 407847 (0.0008) [2023-12-27 22:09:52,849][106225] Updated weights for policy 1, policy_version 408913 (0.0008) [2023-12-27 22:09:52,903][106225] Updated weights for policy 1, policy_version 408923 (0.0007) [2023-12-27 22:09:52,960][106225] Updated weights for policy 1, policy_version 408933 (0.0008) [2023-12-27 22:09:53,022][106225] Updated weights for policy 1, policy_version 408943 (0.0008) [2023-12-27 22:09:53,370][106226] Updated weights for policy 0, policy_version 407857 (0.0010) [2023-12-27 22:09:53,423][106226] Updated weights for policy 0, policy_version 407867 (0.0010) [2023-12-27 22:09:53,473][106226] Updated weights for policy 0, policy_version 407877 (0.0010) [2023-12-27 22:09:53,689][106225] Updated weights for policy 1, policy_version 408953 (0.0007) [2023-12-27 22:09:53,740][106225] Updated weights for policy 1, policy_version 408963 (0.0008) [2023-12-27 22:09:53,800][106225] Updated weights for policy 1, policy_version 408973 (0.0007) [2023-12-27 22:09:54,197][106226] Updated weights for policy 0, policy_version 407887 (0.0011) [2023-12-27 22:09:54,254][106226] Updated weights for policy 0, policy_version 407897 (0.0010) [2023-12-27 22:09:54,317][106226] Updated weights for policy 0, policy_version 407907 (0.0011) [2023-12-27 22:09:54,506][106225] Updated weights for policy 1, policy_version 408983 (0.0009) [2023-12-27 22:09:54,571][106225] Updated weights for policy 1, policy_version 408993 (0.0011) [2023-12-27 22:09:54,635][106225] Updated weights for policy 1, policy_version 409003 (0.0008) [2023-12-27 22:09:55,066][106226] Updated weights for policy 0, policy_version 407917 (0.0009) [2023-12-27 22:09:55,120][106226] Updated weights for policy 0, policy_version 407927 (0.0011) [2023-12-27 22:09:55,180][106226] Updated weights for policy 0, policy_version 407937 (0.0011) [2023-12-27 22:09:55,338][106225] Updated weights for policy 1, policy_version 409013 (0.0008) [2023-12-27 22:09:55,385][106225] Updated weights for policy 1, policy_version 409023 (0.0008) [2023-12-27 22:09:55,446][106225] Updated weights for policy 1, policy_version 409033 (0.0008) [2023-12-27 22:09:55,888][106226] Updated weights for policy 0, policy_version 407947 (0.0010) [2023-12-27 22:09:55,936][106226] Updated weights for policy 0, policy_version 407957 (0.0010) [2023-12-27 22:09:56,002][106226] Updated weights for policy 0, policy_version 407967 (0.0010) [2023-12-27 22:09:56,123][106225] Updated weights for policy 1, policy_version 409043 (0.0010) [2023-12-27 22:09:56,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 209215488. Throughput: 0: 9534.1, 1: 9595.5. Samples: 209186248. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:09:56,175][105115] Avg episode reward: [(0, '-4.947'), (1, '-5.305')] [2023-12-27 22:09:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000407976_104472576.pth... [2023-12-27 22:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000406856_104185856.pth [2023-12-27 22:09:56,192][106225] Updated weights for policy 1, policy_version 409053 (0.0010) [2023-12-27 22:09:56,253][106225] Updated weights for policy 1, policy_version 409063 (0.0010) [2023-12-27 22:09:56,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000409072_104751104.pth... [2023-12-27 22:09:56,309][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000407920_104456192.pth [2023-12-27 22:09:56,650][106226] Updated weights for policy 0, policy_version 407977 (0.0009) [2023-12-27 22:09:56,716][106226] Updated weights for policy 0, policy_version 407987 (0.0005) [2023-12-27 22:09:56,781][106226] Updated weights for policy 0, policy_version 407997 (0.0005) [2023-12-27 22:09:56,846][106226] Updated weights for policy 0, policy_version 408007 (0.0005) [2023-12-27 22:09:56,932][106225] Updated weights for policy 1, policy_version 409073 (0.0010) [2023-12-27 22:09:56,994][106225] Updated weights for policy 1, policy_version 409083 (0.0008) [2023-12-27 22:09:57,038][106225] Updated weights for policy 1, policy_version 409093 (0.0008) [2023-12-27 22:09:57,082][106225] Updated weights for policy 1, policy_version 409103 (0.0008) [2023-12-27 22:09:57,491][106226] Updated weights for policy 0, policy_version 408017 (0.0005) [2023-12-27 22:09:57,550][106226] Updated weights for policy 0, policy_version 408027 (0.0006) [2023-12-27 22:09:57,600][106226] Updated weights for policy 0, policy_version 408037 (0.0010) [2023-12-27 22:09:57,706][106225] Updated weights for policy 1, policy_version 409113 (0.0010) [2023-12-27 22:09:57,773][106225] Updated weights for policy 1, policy_version 409123 (0.0005) [2023-12-27 22:09:57,830][106225] Updated weights for policy 1, policy_version 409133 (0.0008) [2023-12-27 22:09:58,295][106226] Updated weights for policy 0, policy_version 408047 (0.0009) [2023-12-27 22:09:58,360][106226] Updated weights for policy 0, policy_version 408057 (0.0008) [2023-12-27 22:09:58,420][106226] Updated weights for policy 0, policy_version 408067 (0.0009) [2023-12-27 22:09:58,604][106225] Updated weights for policy 1, policy_version 409143 (0.0008) [2023-12-27 22:09:58,674][106225] Updated weights for policy 1, policy_version 409153 (0.0009) [2023-12-27 22:09:58,738][106225] Updated weights for policy 1, policy_version 409163 (0.0010) [2023-12-27 22:09:59,247][106226] Updated weights for policy 0, policy_version 408077 (0.0009) [2023-12-27 22:09:59,314][106226] Updated weights for policy 0, policy_version 408087 (0.0014) [2023-12-27 22:09:59,393][106226] Updated weights for policy 0, policy_version 408097 (0.0009) [2023-12-27 22:09:59,568][106225] Updated weights for policy 1, policy_version 409173 (0.0008) [2023-12-27 22:09:59,629][106225] Updated weights for policy 1, policy_version 409183 (0.0008) [2023-12-27 22:09:59,683][106225] Updated weights for policy 1, policy_version 409193 (0.0008) [2023-12-27 22:10:00,172][106226] Updated weights for policy 0, policy_version 408107 (0.0008) [2023-12-27 22:10:00,235][106226] Updated weights for policy 0, policy_version 408117 (0.0008) [2023-12-27 22:10:00,297][106226] Updated weights for policy 0, policy_version 408127 (0.0008) [2023-12-27 22:10:00,401][106225] Updated weights for policy 1, policy_version 409203 (0.0008) [2023-12-27 22:10:00,467][106225] Updated weights for policy 1, policy_version 409213 (0.0008) [2023-12-27 22:10:00,533][106225] Updated weights for policy 1, policy_version 409223 (0.0008) [2023-12-27 22:10:00,986][106226] Updated weights for policy 0, policy_version 408137 (0.0008) [2023-12-27 22:10:01,054][106226] Updated weights for policy 0, policy_version 408147 (0.0008) [2023-12-27 22:10:01,120][106226] Updated weights for policy 0, policy_version 408157 (0.0008) [2023-12-27 22:10:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19114.6, 300 sec: 19383.1). Total num frames: 209305600. Throughput: 0: 9529.0, 1: 9664.7. Samples: 209301052. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:01,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.923')] [2023-12-27 22:10:01,182][106226] Updated weights for policy 0, policy_version 408167 (0.0008) [2023-12-27 22:10:01,247][106225] Updated weights for policy 1, policy_version 409233 (0.0011) [2023-12-27 22:10:01,307][106225] Updated weights for policy 1, policy_version 409243 (0.0012) [2023-12-27 22:10:01,379][106225] Updated weights for policy 1, policy_version 409253 (0.0010) [2023-12-27 22:10:01,447][106225] Updated weights for policy 1, policy_version 409263 (0.0009) [2023-12-27 22:10:01,870][106226] Updated weights for policy 0, policy_version 408177 (0.0010) [2023-12-27 22:10:01,921][106226] Updated weights for policy 0, policy_version 408187 (0.0011) [2023-12-27 22:10:01,982][106226] Updated weights for policy 0, policy_version 408197 (0.0010) [2023-12-27 22:10:02,168][106225] Updated weights for policy 1, policy_version 409273 (0.0007) [2023-12-27 22:10:02,235][106225] Updated weights for policy 1, policy_version 409283 (0.0008) [2023-12-27 22:10:02,297][106225] Updated weights for policy 1, policy_version 409293 (0.0008) [2023-12-27 22:10:02,764][106226] Updated weights for policy 0, policy_version 408207 (0.0011) [2023-12-27 22:10:02,830][106226] Updated weights for policy 0, policy_version 408217 (0.0011) [2023-12-27 22:10:02,890][106226] Updated weights for policy 0, policy_version 408227 (0.0010) [2023-12-27 22:10:02,992][106225] Updated weights for policy 1, policy_version 409303 (0.0007) [2023-12-27 22:10:03,054][106225] Updated weights for policy 1, policy_version 409313 (0.0005) [2023-12-27 22:10:03,116][106225] Updated weights for policy 1, policy_version 409323 (0.0008) [2023-12-27 22:10:03,599][106226] Updated weights for policy 0, policy_version 408237 (0.0008) [2023-12-27 22:10:03,667][106226] Updated weights for policy 0, policy_version 408247 (0.0005) [2023-12-27 22:10:03,734][106226] Updated weights for policy 0, policy_version 408257 (0.0005) [2023-12-27 22:10:03,805][106225] Updated weights for policy 1, policy_version 409333 (0.0010) [2023-12-27 22:10:03,871][106225] Updated weights for policy 1, policy_version 409343 (0.0010) [2023-12-27 22:10:03,935][106225] Updated weights for policy 1, policy_version 409353 (0.0011) [2023-12-27 22:10:04,390][106226] Updated weights for policy 0, policy_version 408267 (0.0007) [2023-12-27 22:10:04,456][106226] Updated weights for policy 0, policy_version 408277 (0.0011) [2023-12-27 22:10:04,521][106226] Updated weights for policy 0, policy_version 408287 (0.0011) [2023-12-27 22:10:04,571][106225] Updated weights for policy 1, policy_version 409363 (0.0009) [2023-12-27 22:10:04,624][106225] Updated weights for policy 1, policy_version 409373 (0.0009) [2023-12-27 22:10:04,675][106225] Updated weights for policy 1, policy_version 409383 (0.0010) [2023-12-27 22:10:05,236][106226] Updated weights for policy 0, policy_version 408297 (0.0011) [2023-12-27 22:10:05,300][106226] Updated weights for policy 0, policy_version 408307 (0.0011) [2023-12-27 22:10:05,356][106226] Updated weights for policy 0, policy_version 408317 (0.0010) [2023-12-27 22:10:05,402][106226] Updated weights for policy 0, policy_version 408327 (0.0010) [2023-12-27 22:10:05,408][106225] Updated weights for policy 1, policy_version 409393 (0.0010) [2023-12-27 22:10:05,466][106225] Updated weights for policy 1, policy_version 409403 (0.0008) [2023-12-27 22:10:05,530][106225] Updated weights for policy 1, policy_version 409413 (0.0010) [2023-12-27 22:10:05,589][106225] Updated weights for policy 1, policy_version 409423 (0.0010) [2023-12-27 22:10:06,088][106226] Updated weights for policy 0, policy_version 408337 (0.0008) [2023-12-27 22:10:06,156][106226] Updated weights for policy 0, policy_version 408347 (0.0010) [2023-12-27 22:10:06,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19114.7, 300 sec: 19383.1). Total num frames: 209403904. Throughput: 0: 9551.7, 1: 9684.2. Samples: 209418868. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:06,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-6.013')] [2023-12-27 22:10:06,229][106226] Updated weights for policy 0, policy_version 408357 (0.0007) [2023-12-27 22:10:06,315][106225] Updated weights for policy 1, policy_version 409433 (0.0011) [2023-12-27 22:10:06,380][106225] Updated weights for policy 1, policy_version 409443 (0.0011) [2023-12-27 22:10:06,436][106225] Updated weights for policy 1, policy_version 409453 (0.0008) [2023-12-27 22:10:06,972][106226] Updated weights for policy 0, policy_version 408367 (0.0007) [2023-12-27 22:10:07,033][106226] Updated weights for policy 0, policy_version 408377 (0.0007) [2023-12-27 22:10:07,097][106226] Updated weights for policy 0, policy_version 408387 (0.0008) [2023-12-27 22:10:07,167][106225] Updated weights for policy 1, policy_version 409463 (0.0008) [2023-12-27 22:10:07,227][106225] Updated weights for policy 1, policy_version 409473 (0.0009) [2023-12-27 22:10:07,292][106225] Updated weights for policy 1, policy_version 409483 (0.0010) [2023-12-27 22:10:07,728][106226] Updated weights for policy 0, policy_version 408397 (0.0007) [2023-12-27 22:10:07,783][106226] Updated weights for policy 0, policy_version 408407 (0.0008) [2023-12-27 22:10:07,839][106226] Updated weights for policy 0, policy_version 408417 (0.0008) [2023-12-27 22:10:08,019][106225] Updated weights for policy 1, policy_version 409493 (0.0011) [2023-12-27 22:10:08,067][106225] Updated weights for policy 1, policy_version 409503 (0.0010) [2023-12-27 22:10:08,129][106225] Updated weights for policy 1, policy_version 409513 (0.0010) [2023-12-27 22:10:08,556][106226] Updated weights for policy 0, policy_version 408427 (0.0008) [2023-12-27 22:10:08,619][106226] Updated weights for policy 0, policy_version 408437 (0.0008) [2023-12-27 22:10:08,673][106226] Updated weights for policy 0, policy_version 408447 (0.0008) [2023-12-27 22:10:08,889][106225] Updated weights for policy 1, policy_version 409523 (0.0010) [2023-12-27 22:10:08,956][106225] Updated weights for policy 1, policy_version 409533 (0.0010) [2023-12-27 22:10:09,013][106225] Updated weights for policy 1, policy_version 409543 (0.0010) [2023-12-27 22:10:09,420][106226] Updated weights for policy 0, policy_version 408457 (0.0008) [2023-12-27 22:10:09,479][106226] Updated weights for policy 0, policy_version 408467 (0.0008) [2023-12-27 22:10:09,548][106226] Updated weights for policy 0, policy_version 408477 (0.0008) [2023-12-27 22:10:09,615][106226] Updated weights for policy 0, policy_version 408487 (0.0008) [2023-12-27 22:10:09,803][106225] Updated weights for policy 1, policy_version 409553 (0.0010) [2023-12-27 22:10:09,870][106225] Updated weights for policy 1, policy_version 409563 (0.0009) [2023-12-27 22:10:09,937][106225] Updated weights for policy 1, policy_version 409573 (0.0008) [2023-12-27 22:10:09,987][106225] Updated weights for policy 1, policy_version 409583 (0.0006) [2023-12-27 22:10:10,379][106226] Updated weights for policy 0, policy_version 408497 (0.0008) [2023-12-27 22:10:10,451][106226] Updated weights for policy 0, policy_version 408507 (0.0008) [2023-12-27 22:10:10,511][106226] Updated weights for policy 0, policy_version 408517 (0.0008) [2023-12-27 22:10:10,721][106225] Updated weights for policy 1, policy_version 409593 (0.0006) [2023-12-27 22:10:10,782][106225] Updated weights for policy 1, policy_version 409603 (0.0007) [2023-12-27 22:10:10,849][106225] Updated weights for policy 1, policy_version 409613 (0.0010) [2023-12-27 22:10:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 209502208. Throughput: 0: 9572.0, 1: 9673.2. Samples: 209476848. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:11,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.775')] [2023-12-27 22:10:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000409616_104890368.pth... [2023-12-27 22:10:11,186][106226] Updated weights for policy 0, policy_version 408527 (0.0008) [2023-12-27 22:10:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000408496_104603648.pth [2023-12-27 22:10:11,261][106226] Updated weights for policy 0, policy_version 408537 (0.0009) [2023-12-27 22:10:11,323][106226] Updated weights for policy 0, policy_version 408547 (0.0009) [2023-12-27 22:10:11,352][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000408552_104620032.pth... [2023-12-27 22:10:11,356][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000407400_104325120.pth [2023-12-27 22:10:11,613][106225] Updated weights for policy 1, policy_version 409623 (0.0007) [2023-12-27 22:10:11,686][106225] Updated weights for policy 1, policy_version 409633 (0.0008) [2023-12-27 22:10:11,756][106225] Updated weights for policy 1, policy_version 409643 (0.0008) [2023-12-27 22:10:12,091][106226] Updated weights for policy 0, policy_version 408557 (0.0011) [2023-12-27 22:10:12,152][106226] Updated weights for policy 0, policy_version 408567 (0.0011) [2023-12-27 22:10:12,215][106226] Updated weights for policy 0, policy_version 408577 (0.0011) [2023-12-27 22:10:12,447][106225] Updated weights for policy 1, policy_version 409653 (0.0007) [2023-12-27 22:10:12,510][106225] Updated weights for policy 1, policy_version 409663 (0.0008) [2023-12-27 22:10:12,575][106225] Updated weights for policy 1, policy_version 409673 (0.0008) [2023-12-27 22:10:12,941][106226] Updated weights for policy 0, policy_version 408587 (0.0010) [2023-12-27 22:10:13,002][106226] Updated weights for policy 0, policy_version 408597 (0.0010) [2023-12-27 22:10:13,053][106226] Updated weights for policy 0, policy_version 408607 (0.0011) [2023-12-27 22:10:13,140][106225] Updated weights for policy 1, policy_version 409683 (0.0006) [2023-12-27 22:10:13,192][106225] Updated weights for policy 1, policy_version 409693 (0.0010) [2023-12-27 22:10:13,251][106225] Updated weights for policy 1, policy_version 409703 (0.0006) [2023-12-27 22:10:13,780][106226] Updated weights for policy 0, policy_version 408617 (0.0010) [2023-12-27 22:10:13,848][106226] Updated weights for policy 0, policy_version 408627 (0.0005) [2023-12-27 22:10:13,854][106225] Updated weights for policy 1, policy_version 409713 (0.0010) [2023-12-27 22:10:13,904][106226] Updated weights for policy 0, policy_version 408637 (0.0005) [2023-12-27 22:10:13,922][106225] Updated weights for policy 1, policy_version 409723 (0.0006) [2023-12-27 22:10:13,966][106226] Updated weights for policy 0, policy_version 408647 (0.0006) [2023-12-27 22:10:13,987][106225] Updated weights for policy 1, policy_version 409733 (0.0007) [2023-12-27 22:10:14,051][106225] Updated weights for policy 1, policy_version 409744 (0.0009) [2023-12-27 22:10:14,489][106226] Updated weights for policy 0, policy_version 408657 (0.0005) [2023-12-27 22:10:14,549][106226] Updated weights for policy 0, policy_version 408667 (0.0005) [2023-12-27 22:10:14,603][106226] Updated weights for policy 0, policy_version 408677 (0.0005) [2023-12-27 22:10:14,798][106225] Updated weights for policy 1, policy_version 409754 (0.0008) [2023-12-27 22:10:14,851][106225] Updated weights for policy 1, policy_version 409764 (0.0008) [2023-12-27 22:10:14,911][106225] Updated weights for policy 1, policy_version 409774 (0.0008) [2023-12-27 22:10:15,216][106226] Updated weights for policy 0, policy_version 408687 (0.0008) [2023-12-27 22:10:15,285][106226] Updated weights for policy 0, policy_version 408697 (0.0007) [2023-12-27 22:10:15,356][106226] Updated weights for policy 0, policy_version 408707 (0.0006) [2023-12-27 22:10:15,625][106225] Updated weights for policy 1, policy_version 409784 (0.0008) [2023-12-27 22:10:15,674][106225] Updated weights for policy 1, policy_version 409794 (0.0006) [2023-12-27 22:10:15,728][106225] Updated weights for policy 1, policy_version 409804 (0.0006) [2023-12-27 22:10:16,032][106226] Updated weights for policy 0, policy_version 408717 (0.0010) [2023-12-27 22:10:16,092][106226] Updated weights for policy 0, policy_version 408727 (0.0011) [2023-12-27 22:10:16,144][106226] Updated weights for policy 0, policy_version 408737 (0.0008) [2023-12-27 22:10:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 209600512. Throughput: 0: 9656.3, 1: 9659.0. Samples: 209595168. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:16,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.639')] [2023-12-27 22:10:16,494][106225] Updated weights for policy 1, policy_version 409814 (0.0008) [2023-12-27 22:10:16,556][106225] Updated weights for policy 1, policy_version 409824 (0.0008) [2023-12-27 22:10:16,619][106225] Updated weights for policy 1, policy_version 409834 (0.0008) [2023-12-27 22:10:16,737][106226] Updated weights for policy 0, policy_version 408747 (0.0006) [2023-12-27 22:10:16,792][106226] Updated weights for policy 0, policy_version 408757 (0.0008) [2023-12-27 22:10:16,845][106226] Updated weights for policy 0, policy_version 408767 (0.0011) [2023-12-27 22:10:17,365][106225] Updated weights for policy 1, policy_version 409844 (0.0008) [2023-12-27 22:10:17,429][106225] Updated weights for policy 1, policy_version 409854 (0.0007) [2023-12-27 22:10:17,488][106225] Updated weights for policy 1, policy_version 409864 (0.0007) [2023-12-27 22:10:17,553][106226] Updated weights for policy 0, policy_version 408777 (0.0011) [2023-12-27 22:10:17,607][106226] Updated weights for policy 0, policy_version 408787 (0.0010) [2023-12-27 22:10:17,653][106226] Updated weights for policy 0, policy_version 408797 (0.0010) [2023-12-27 22:10:17,704][106226] Updated weights for policy 0, policy_version 408807 (0.0010) [2023-12-27 22:10:18,203][106225] Updated weights for policy 1, policy_version 409874 (0.0007) [2023-12-27 22:10:18,259][106225] Updated weights for policy 1, policy_version 409884 (0.0008) [2023-12-27 22:10:18,310][106225] Updated weights for policy 1, policy_version 409894 (0.0008) [2023-12-27 22:10:18,383][106225] Updated weights for policy 1, policy_version 409904 (0.0007) [2023-12-27 22:10:18,489][106226] Updated weights for policy 0, policy_version 408817 (0.0011) [2023-12-27 22:10:18,550][106226] Updated weights for policy 0, policy_version 408827 (0.0011) [2023-12-27 22:10:18,608][106226] Updated weights for policy 0, policy_version 408837 (0.0011) [2023-12-27 22:10:19,181][106225] Updated weights for policy 1, policy_version 409914 (0.0008) [2023-12-27 22:10:19,239][106225] Updated weights for policy 1, policy_version 409924 (0.0008) [2023-12-27 22:10:19,270][106226] Updated weights for policy 0, policy_version 408847 (0.0008) [2023-12-27 22:10:19,306][106225] Updated weights for policy 1, policy_version 409934 (0.0008) [2023-12-27 22:10:19,330][106226] Updated weights for policy 0, policy_version 408857 (0.0007) [2023-12-27 22:10:19,394][106226] Updated weights for policy 0, policy_version 408867 (0.0008) [2023-12-27 22:10:20,046][106225] Updated weights for policy 1, policy_version 409944 (0.0008) [2023-12-27 22:10:20,118][106225] Updated weights for policy 1, policy_version 409954 (0.0008) [2023-12-27 22:10:20,141][106226] Updated weights for policy 0, policy_version 408877 (0.0007) [2023-12-27 22:10:20,185][106225] Updated weights for policy 1, policy_version 409964 (0.0006) [2023-12-27 22:10:20,208][106226] Updated weights for policy 0, policy_version 408887 (0.0007) [2023-12-27 22:10:20,272][106226] Updated weights for policy 0, policy_version 408897 (0.0008) [2023-12-27 22:10:20,937][106225] Updated weights for policy 1, policy_version 409974 (0.0010) [2023-12-27 22:10:20,990][106225] Updated weights for policy 1, policy_version 409984 (0.0006) [2023-12-27 22:10:21,039][106226] Updated weights for policy 0, policy_version 408907 (0.0008) [2023-12-27 22:10:21,051][106225] Updated weights for policy 1, policy_version 409994 (0.0007) [2023-12-27 22:10:21,105][106226] Updated weights for policy 0, policy_version 408917 (0.0009) [2023-12-27 22:10:21,172][106226] Updated weights for policy 0, policy_version 408927 (0.0009) [2023-12-27 22:10:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 209698816. Throughput: 0: 9712.9, 1: 9629.0. Samples: 209709432. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:21,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.405')] [2023-12-27 22:10:21,826][106225] Updated weights for policy 1, policy_version 410004 (0.0009) [2023-12-27 22:10:21,894][106225] Updated weights for policy 1, policy_version 410014 (0.0008) [2023-12-27 22:10:21,960][106225] Updated weights for policy 1, policy_version 410024 (0.0008) [2023-12-27 22:10:22,039][106226] Updated weights for policy 0, policy_version 408937 (0.0008) [2023-12-27 22:10:22,105][106226] Updated weights for policy 0, policy_version 408947 (0.0008) [2023-12-27 22:10:22,172][106226] Updated weights for policy 0, policy_version 408957 (0.0007) [2023-12-27 22:10:22,238][106226] Updated weights for policy 0, policy_version 408967 (0.0008) [2023-12-27 22:10:22,741][106225] Updated weights for policy 1, policy_version 410034 (0.0010) [2023-12-27 22:10:22,809][106225] Updated weights for policy 1, policy_version 410044 (0.0008) [2023-12-27 22:10:22,874][106225] Updated weights for policy 1, policy_version 410054 (0.0008) [2023-12-27 22:10:22,936][106225] Updated weights for policy 1, policy_version 410064 (0.0007) [2023-12-27 22:10:22,991][106226] Updated weights for policy 0, policy_version 408977 (0.0008) [2023-12-27 22:10:23,047][106226] Updated weights for policy 0, policy_version 408987 (0.0008) [2023-12-27 22:10:23,101][106226] Updated weights for policy 0, policy_version 408997 (0.0009) [2023-12-27 22:10:23,628][106225] Updated weights for policy 1, policy_version 410074 (0.0009) [2023-12-27 22:10:23,690][106225] Updated weights for policy 1, policy_version 410084 (0.0009) [2023-12-27 22:10:23,748][106225] Updated weights for policy 1, policy_version 410094 (0.0008) [2023-12-27 22:10:23,830][106226] Updated weights for policy 0, policy_version 409007 (0.0006) [2023-12-27 22:10:23,899][106226] Updated weights for policy 0, policy_version 409017 (0.0005) [2023-12-27 22:10:23,962][106226] Updated weights for policy 0, policy_version 409027 (0.0007) [2023-12-27 22:10:24,400][106225] Updated weights for policy 1, policy_version 410104 (0.0007) [2023-12-27 22:10:24,465][106225] Updated weights for policy 1, policy_version 410114 (0.0005) [2023-12-27 22:10:24,523][106225] Updated weights for policy 1, policy_version 410124 (0.0006) [2023-12-27 22:10:24,654][106226] Updated weights for policy 0, policy_version 409037 (0.0007) [2023-12-27 22:10:24,726][106226] Updated weights for policy 0, policy_version 409047 (0.0008) [2023-12-27 22:10:24,796][106226] Updated weights for policy 0, policy_version 409057 (0.0008) [2023-12-27 22:10:25,106][106225] Updated weights for policy 1, policy_version 410134 (0.0007) [2023-12-27 22:10:25,170][106225] Updated weights for policy 1, policy_version 410144 (0.0006) [2023-12-27 22:10:25,228][106225] Updated weights for policy 1, policy_version 410154 (0.0008) [2023-12-27 22:10:25,582][106226] Updated weights for policy 0, policy_version 409067 (0.0009) [2023-12-27 22:10:25,643][106226] Updated weights for policy 0, policy_version 409077 (0.0008) [2023-12-27 22:10:25,693][106226] Updated weights for policy 0, policy_version 409087 (0.0008) [2023-12-27 22:10:25,862][106225] Updated weights for policy 1, policy_version 410164 (0.0009) [2023-12-27 22:10:25,911][106225] Updated weights for policy 1, policy_version 410174 (0.0008) [2023-12-27 22:10:25,963][106225] Updated weights for policy 1, policy_version 410184 (0.0009) [2023-12-27 22:10:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19355.3). Total num frames: 209797120. Throughput: 0: 9691.6, 1: 9601.0. Samples: 209764696. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:26,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-5.438')] [2023-12-27 22:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000409096_104759296.pth... [2023-12-27 22:10:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000410192_105037824.pth... [2023-12-27 22:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000407976_104472576.pth [2023-12-27 22:10:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000409072_104751104.pth [2023-12-27 22:10:26,316][106226] Updated weights for policy 0, policy_version 409097 (0.0008) [2023-12-27 22:10:26,380][106226] Updated weights for policy 0, policy_version 409107 (0.0008) [2023-12-27 22:10:26,448][106226] Updated weights for policy 0, policy_version 409117 (0.0008) [2023-12-27 22:10:26,497][106226] Updated weights for policy 0, policy_version 409127 (0.0010) [2023-12-27 22:10:26,620][106225] Updated weights for policy 1, policy_version 410194 (0.0009) [2023-12-27 22:10:26,674][106225] Updated weights for policy 1, policy_version 410204 (0.0006) [2023-12-27 22:10:26,727][106225] Updated weights for policy 1, policy_version 410214 (0.0007) [2023-12-27 22:10:26,771][106225] Updated weights for policy 1, policy_version 410224 (0.0007) [2023-12-27 22:10:27,167][106226] Updated weights for policy 0, policy_version 409137 (0.0011) [2023-12-27 22:10:27,225][106226] Updated weights for policy 0, policy_version 409147 (0.0011) [2023-12-27 22:10:27,285][106226] Updated weights for policy 0, policy_version 409157 (0.0005) [2023-12-27 22:10:27,512][106225] Updated weights for policy 1, policy_version 410234 (0.0008) [2023-12-27 22:10:27,574][106225] Updated weights for policy 1, policy_version 410244 (0.0006) [2023-12-27 22:10:27,642][106225] Updated weights for policy 1, policy_version 410254 (0.0007) [2023-12-27 22:10:27,908][106226] Updated weights for policy 0, policy_version 409167 (0.0007) [2023-12-27 22:10:27,967][106226] Updated weights for policy 0, policy_version 409177 (0.0010) [2023-12-27 22:10:28,029][106226] Updated weights for policy 0, policy_version 409187 (0.0009) [2023-12-27 22:10:28,270][106225] Updated weights for policy 1, policy_version 410264 (0.0008) [2023-12-27 22:10:28,325][106225] Updated weights for policy 1, policy_version 410274 (0.0008) [2023-12-27 22:10:28,390][106225] Updated weights for policy 1, policy_version 410284 (0.0008) [2023-12-27 22:10:28,797][106226] Updated weights for policy 0, policy_version 409197 (0.0009) [2023-12-27 22:10:28,857][106226] Updated weights for policy 0, policy_version 409207 (0.0009) [2023-12-27 22:10:28,915][106226] Updated weights for policy 0, policy_version 409217 (0.0008) [2023-12-27 22:10:29,108][106225] Updated weights for policy 1, policy_version 410294 (0.0008) [2023-12-27 22:10:29,169][106225] Updated weights for policy 1, policy_version 410304 (0.0009) [2023-12-27 22:10:29,230][106225] Updated weights for policy 1, policy_version 410314 (0.0008) [2023-12-27 22:10:29,773][106226] Updated weights for policy 0, policy_version 409227 (0.0008) [2023-12-27 22:10:29,831][106226] Updated weights for policy 0, policy_version 409238 (0.0010) [2023-12-27 22:10:29,898][106226] Updated weights for policy 0, policy_version 409248 (0.0008) [2023-12-27 22:10:29,910][106225] Updated weights for policy 1, policy_version 410324 (0.0007) [2023-12-27 22:10:29,976][106225] Updated weights for policy 1, policy_version 410334 (0.0009) [2023-12-27 22:10:30,031][106225] Updated weights for policy 1, policy_version 410344 (0.0008) [2023-12-27 22:10:30,651][106226] Updated weights for policy 0, policy_version 409258 (0.0007) [2023-12-27 22:10:30,715][106226] Updated weights for policy 0, policy_version 409268 (0.0009) [2023-12-27 22:10:30,742][106225] Updated weights for policy 1, policy_version 410354 (0.0009) [2023-12-27 22:10:30,760][106226] Updated weights for policy 0, policy_version 409278 (0.0007) [2023-12-27 22:10:30,799][106225] Updated weights for policy 1, policy_version 410364 (0.0009) [2023-12-27 22:10:30,806][106226] Updated weights for policy 0, policy_version 409288 (0.0007) [2023-12-27 22:10:30,856][106225] Updated weights for policy 1, policy_version 410374 (0.0009) [2023-12-27 22:10:30,909][106225] Updated weights for policy 1, policy_version 410384 (0.0009) [2023-12-27 22:10:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19355.3). Total num frames: 209895424. Throughput: 0: 9702.8, 1: 9714.9. Samples: 209884152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:31,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-5.587')] [2023-12-27 22:10:31,503][106226] Updated weights for policy 0, policy_version 409298 (0.0008) [2023-12-27 22:10:31,561][106226] Updated weights for policy 0, policy_version 409308 (0.0008) [2023-12-27 22:10:31,610][106225] Updated weights for policy 1, policy_version 410394 (0.0008) [2023-12-27 22:10:31,624][106226] Updated weights for policy 0, policy_version 409318 (0.0006) [2023-12-27 22:10:31,671][106225] Updated weights for policy 1, policy_version 410404 (0.0009) [2023-12-27 22:10:31,729][106225] Updated weights for policy 1, policy_version 410414 (0.0009) [2023-12-27 22:10:32,402][106226] Updated weights for policy 0, policy_version 409328 (0.0008) [2023-12-27 22:10:32,422][106225] Updated weights for policy 1, policy_version 410424 (0.0008) [2023-12-27 22:10:32,461][106226] Updated weights for policy 0, policy_version 409338 (0.0007) [2023-12-27 22:10:32,481][106225] Updated weights for policy 1, policy_version 410434 (0.0007) [2023-12-27 22:10:32,515][106226] Updated weights for policy 0, policy_version 409348 (0.0007) [2023-12-27 22:10:32,543][106225] Updated weights for policy 1, policy_version 410444 (0.0006) [2023-12-27 22:10:33,121][106225] Updated weights for policy 1, policy_version 410454 (0.0007) [2023-12-27 22:10:33,179][106225] Updated weights for policy 1, policy_version 410464 (0.0007) [2023-12-27 22:10:33,244][106225] Updated weights for policy 1, policy_version 410474 (0.0005) [2023-12-27 22:10:33,312][106226] Updated weights for policy 0, policy_version 409358 (0.0008) [2023-12-27 22:10:33,384][106226] Updated weights for policy 0, policy_version 409368 (0.0008) [2023-12-27 22:10:33,438][106226] Updated weights for policy 0, policy_version 409378 (0.0009) [2023-12-27 22:10:33,769][106225] Updated weights for policy 1, policy_version 410484 (0.0007) [2023-12-27 22:10:33,826][106225] Updated weights for policy 1, policy_version 410494 (0.0010) [2023-12-27 22:10:33,878][106225] Updated weights for policy 1, policy_version 410504 (0.0010) [2023-12-27 22:10:34,242][106226] Updated weights for policy 0, policy_version 409388 (0.0009) [2023-12-27 22:10:34,310][106226] Updated weights for policy 0, policy_version 409398 (0.0008) [2023-12-27 22:10:34,376][106226] Updated weights for policy 0, policy_version 409408 (0.0009) [2023-12-27 22:10:34,645][106225] Updated weights for policy 1, policy_version 410514 (0.0009) [2023-12-27 22:10:34,711][106225] Updated weights for policy 1, policy_version 410524 (0.0008) [2023-12-27 22:10:34,773][106225] Updated weights for policy 1, policy_version 410534 (0.0008) [2023-12-27 22:10:34,824][106225] Updated weights for policy 1, policy_version 410544 (0.0008) [2023-12-27 22:10:35,053][106226] Updated weights for policy 0, policy_version 409418 (0.0007) [2023-12-27 22:10:35,103][106226] Updated weights for policy 0, policy_version 409428 (0.0009) [2023-12-27 22:10:35,155][106226] Updated weights for policy 0, policy_version 409438 (0.0008) [2023-12-27 22:10:35,213][106226] Updated weights for policy 0, policy_version 409448 (0.0009) [2023-12-27 22:10:35,532][106225] Updated weights for policy 1, policy_version 410554 (0.0010) [2023-12-27 22:10:35,578][106225] Updated weights for policy 1, policy_version 410564 (0.0010) [2023-12-27 22:10:35,625][106225] Updated weights for policy 1, policy_version 410574 (0.0010) [2023-12-27 22:10:35,966][106226] Updated weights for policy 0, policy_version 409458 (0.0009) [2023-12-27 22:10:36,016][106226] Updated weights for policy 0, policy_version 409468 (0.0007) [2023-12-27 22:10:36,074][106226] Updated weights for policy 0, policy_version 409478 (0.0007) [2023-12-27 22:10:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.8, 300 sec: 19383.1). Total num frames: 209993728. Throughput: 0: 9635.7, 1: 9784.5. Samples: 210001220. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:36,179][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.548')] [2023-12-27 22:10:36,305][106225] Updated weights for policy 1, policy_version 410584 (0.0007) [2023-12-27 22:10:36,365][106225] Updated weights for policy 1, policy_version 410594 (0.0006) [2023-12-27 22:10:36,426][106225] Updated weights for policy 1, policy_version 410604 (0.0009) [2023-12-27 22:10:36,910][106226] Updated weights for policy 0, policy_version 409488 (0.0006) [2023-12-27 22:10:36,959][106226] Updated weights for policy 0, policy_version 409498 (0.0005) [2023-12-27 22:10:37,008][106226] Updated weights for policy 0, policy_version 409508 (0.0006) [2023-12-27 22:10:37,045][106225] Updated weights for policy 1, policy_version 410614 (0.0009) [2023-12-27 22:10:37,106][106225] Updated weights for policy 1, policy_version 410624 (0.0011) [2023-12-27 22:10:37,160][106225] Updated weights for policy 1, policy_version 410634 (0.0010) [2023-12-27 22:10:37,538][106226] Updated weights for policy 0, policy_version 409518 (0.0006) [2023-12-27 22:10:37,587][106226] Updated weights for policy 0, policy_version 409528 (0.0006) [2023-12-27 22:10:37,642][106226] Updated weights for policy 0, policy_version 409538 (0.0006) [2023-12-27 22:10:37,836][106225] Updated weights for policy 1, policy_version 410644 (0.0010) [2023-12-27 22:10:37,891][106225] Updated weights for policy 1, policy_version 410654 (0.0008) [2023-12-27 22:10:37,941][106225] Updated weights for policy 1, policy_version 410664 (0.0009) [2023-12-27 22:10:38,277][106226] Updated weights for policy 0, policy_version 409548 (0.0010) [2023-12-27 22:10:38,342][106226] Updated weights for policy 0, policy_version 409558 (0.0007) [2023-12-27 22:10:38,397][106226] Updated weights for policy 0, policy_version 409568 (0.0008) [2023-12-27 22:10:38,715][106225] Updated weights for policy 1, policy_version 410674 (0.0010) [2023-12-27 22:10:38,781][106225] Updated weights for policy 1, policy_version 410684 (0.0006) [2023-12-27 22:10:38,844][106225] Updated weights for policy 1, policy_version 410694 (0.0008) [2023-12-27 22:10:38,901][106225] Updated weights for policy 1, policy_version 410704 (0.0008) [2023-12-27 22:10:39,153][106226] Updated weights for policy 0, policy_version 409578 (0.0008) [2023-12-27 22:10:39,201][106226] Updated weights for policy 0, policy_version 409588 (0.0008) [2023-12-27 22:10:39,263][106226] Updated weights for policy 0, policy_version 409598 (0.0008) [2023-12-27 22:10:39,320][106226] Updated weights for policy 0, policy_version 409608 (0.0009) [2023-12-27 22:10:39,613][106225] Updated weights for policy 1, policy_version 410714 (0.0006) [2023-12-27 22:10:39,680][106225] Updated weights for policy 1, policy_version 410724 (0.0006) [2023-12-27 22:10:39,746][106225] Updated weights for policy 1, policy_version 410734 (0.0006) [2023-12-27 22:10:40,133][106226] Updated weights for policy 0, policy_version 409618 (0.0011) [2023-12-27 22:10:40,199][106226] Updated weights for policy 0, policy_version 409628 (0.0011) [2023-12-27 22:10:40,258][106226] Updated weights for policy 0, policy_version 409638 (0.0008) [2023-12-27 22:10:40,468][106225] Updated weights for policy 1, policy_version 410744 (0.0006) [2023-12-27 22:10:40,526][106225] Updated weights for policy 1, policy_version 410754 (0.0006) [2023-12-27 22:10:40,580][106225] Updated weights for policy 1, policy_version 410764 (0.0005) [2023-12-27 22:10:40,959][106226] Updated weights for policy 0, policy_version 409648 (0.0007) [2023-12-27 22:10:41,024][106226] Updated weights for policy 0, policy_version 409659 (0.0008) [2023-12-27 22:10:41,094][106226] Updated weights for policy 0, policy_version 409669 (0.0008) [2023-12-27 22:10:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 210092032. Throughput: 0: 9655.9, 1: 9824.2. Samples: 210062856. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:41,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.598')] [2023-12-27 22:10:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000409672_104906752.pth... [2023-12-27 22:10:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000408552_104620032.pth [2023-12-27 22:10:41,226][106225] Updated weights for policy 1, policy_version 410774 (0.0010) [2023-12-27 22:10:41,290][106225] Updated weights for policy 1, policy_version 410784 (0.0009) [2023-12-27 22:10:41,338][106225] Updated weights for policy 1, policy_version 410794 (0.0008) [2023-12-27 22:10:41,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000410800_105193472.pth... [2023-12-27 22:10:41,384][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000409616_104890368.pth [2023-12-27 22:10:41,843][106226] Updated weights for policy 0, policy_version 409679 (0.0008) [2023-12-27 22:10:41,901][106226] Updated weights for policy 0, policy_version 409689 (0.0009) [2023-12-27 22:10:41,956][106226] Updated weights for policy 0, policy_version 409699 (0.0008) [2023-12-27 22:10:42,157][106225] Updated weights for policy 1, policy_version 410804 (0.0008) [2023-12-27 22:10:42,204][106225] Updated weights for policy 1, policy_version 410814 (0.0008) [2023-12-27 22:10:42,257][106225] Updated weights for policy 1, policy_version 410824 (0.0008) [2023-12-27 22:10:42,710][106226] Updated weights for policy 0, policy_version 409709 (0.0009) [2023-12-27 22:10:42,777][106226] Updated weights for policy 0, policy_version 409719 (0.0008) [2023-12-27 22:10:42,839][106226] Updated weights for policy 0, policy_version 409729 (0.0008) [2023-12-27 22:10:43,030][106225] Updated weights for policy 1, policy_version 410834 (0.0008) [2023-12-27 22:10:43,097][106225] Updated weights for policy 1, policy_version 410844 (0.0008) [2023-12-27 22:10:43,162][106225] Updated weights for policy 1, policy_version 410854 (0.0009) [2023-12-27 22:10:43,210][106225] Updated weights for policy 1, policy_version 410864 (0.0009) [2023-12-27 22:10:43,518][106226] Updated weights for policy 0, policy_version 409739 (0.0008) [2023-12-27 22:10:43,576][106226] Updated weights for policy 0, policy_version 409749 (0.0009) [2023-12-27 22:10:43,624][106226] Updated weights for policy 0, policy_version 409759 (0.0008) [2023-12-27 22:10:43,945][106225] Updated weights for policy 1, policy_version 410874 (0.0008) [2023-12-27 22:10:44,000][106225] Updated weights for policy 1, policy_version 410884 (0.0008) [2023-12-27 22:10:44,048][106225] Updated weights for policy 1, policy_version 410894 (0.0008) [2023-12-27 22:10:44,353][106226] Updated weights for policy 0, policy_version 409769 (0.0009) [2023-12-27 22:10:44,417][106226] Updated weights for policy 0, policy_version 409779 (0.0007) [2023-12-27 22:10:44,489][106226] Updated weights for policy 0, policy_version 409789 (0.0005) [2023-12-27 22:10:44,554][106226] Updated weights for policy 0, policy_version 409799 (0.0005) [2023-12-27 22:10:44,788][106225] Updated weights for policy 1, policy_version 410904 (0.0008) [2023-12-27 22:10:44,856][106225] Updated weights for policy 1, policy_version 410914 (0.0008) [2023-12-27 22:10:44,919][106225] Updated weights for policy 1, policy_version 410924 (0.0008) [2023-12-27 22:10:45,235][106226] Updated weights for policy 0, policy_version 409809 (0.0008) [2023-12-27 22:10:45,299][106226] Updated weights for policy 0, policy_version 409819 (0.0008) [2023-12-27 22:10:45,354][106226] Updated weights for policy 0, policy_version 409829 (0.0008) [2023-12-27 22:10:45,595][106225] Updated weights for policy 1, policy_version 410934 (0.0008) [2023-12-27 22:10:45,647][106225] Updated weights for policy 1, policy_version 410944 (0.0008) [2023-12-27 22:10:45,701][106225] Updated weights for policy 1, policy_version 410954 (0.0008) [2023-12-27 22:10:46,146][106226] Updated weights for policy 0, policy_version 409839 (0.0006) [2023-12-27 22:10:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.2, 300 sec: 19383.1). Total num frames: 210182144. Throughput: 0: 9653.0, 1: 9806.0. Samples: 210176704. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:46,175][105115] Avg episode reward: [(0, '-5.090'), (1, '-5.702')] [2023-12-27 22:10:46,215][106226] Updated weights for policy 0, policy_version 409849 (0.0005) [2023-12-27 22:10:46,276][106226] Updated weights for policy 0, policy_version 409859 (0.0005) [2023-12-27 22:10:46,279][106225] Updated weights for policy 1, policy_version 410964 (0.0006) [2023-12-27 22:10:46,323][106225] Updated weights for policy 1, policy_version 410974 (0.0007) [2023-12-27 22:10:46,369][106225] Updated weights for policy 1, policy_version 410984 (0.0005) [2023-12-27 22:10:46,854][106226] Updated weights for policy 0, policy_version 409869 (0.0007) [2023-12-27 22:10:46,902][106226] Updated weights for policy 0, policy_version 409879 (0.0008) [2023-12-27 22:10:46,987][106226] Updated weights for policy 0, policy_version 409889 (0.0006) [2023-12-27 22:10:47,035][106225] Updated weights for policy 1, policy_version 410994 (0.0005) [2023-12-27 22:10:47,090][106225] Updated weights for policy 1, policy_version 411004 (0.0008) [2023-12-27 22:10:47,140][106225] Updated weights for policy 1, policy_version 411014 (0.0008) [2023-12-27 22:10:47,188][106225] Updated weights for policy 1, policy_version 411024 (0.0008) [2023-12-27 22:10:47,581][106226] Updated weights for policy 0, policy_version 409899 (0.0006) [2023-12-27 22:10:47,645][106226] Updated weights for policy 0, policy_version 409909 (0.0009) [2023-12-27 22:10:47,703][106226] Updated weights for policy 0, policy_version 409919 (0.0008) [2023-12-27 22:10:47,942][106225] Updated weights for policy 1, policy_version 411034 (0.0008) [2023-12-27 22:10:47,991][106225] Updated weights for policy 1, policy_version 411044 (0.0008) [2023-12-27 22:10:48,046][106225] Updated weights for policy 1, policy_version 411054 (0.0009) [2023-12-27 22:10:48,438][106226] Updated weights for policy 0, policy_version 409929 (0.0008) [2023-12-27 22:10:48,505][106226] Updated weights for policy 0, policy_version 409939 (0.0008) [2023-12-27 22:10:48,568][106226] Updated weights for policy 0, policy_version 409949 (0.0008) [2023-12-27 22:10:48,624][106226] Updated weights for policy 0, policy_version 409959 (0.0009) [2023-12-27 22:10:48,812][106225] Updated weights for policy 1, policy_version 411064 (0.0008) [2023-12-27 22:10:48,872][106225] Updated weights for policy 1, policy_version 411074 (0.0009) [2023-12-27 22:10:48,934][106225] Updated weights for policy 1, policy_version 411084 (0.0006) [2023-12-27 22:10:49,422][106226] Updated weights for policy 0, policy_version 409969 (0.0008) [2023-12-27 22:10:49,484][106226] Updated weights for policy 0, policy_version 409979 (0.0007) [2023-12-27 22:10:49,548][106226] Updated weights for policy 0, policy_version 409989 (0.0009) [2023-12-27 22:10:49,604][106225] Updated weights for policy 1, policy_version 411094 (0.0007) [2023-12-27 22:10:49,671][106225] Updated weights for policy 1, policy_version 411104 (0.0009) [2023-12-27 22:10:49,735][106225] Updated weights for policy 1, policy_version 411114 (0.0008) [2023-12-27 22:10:50,327][106226] Updated weights for policy 0, policy_version 409999 (0.0008) [2023-12-27 22:10:50,398][106226] Updated weights for policy 0, policy_version 410009 (0.0008) [2023-12-27 22:10:50,465][106226] Updated weights for policy 0, policy_version 410019 (0.0008) [2023-12-27 22:10:50,499][106225] Updated weights for policy 1, policy_version 411124 (0.0008) [2023-12-27 22:10:50,554][106225] Updated weights for policy 1, policy_version 411134 (0.0006) [2023-12-27 22:10:50,620][106225] Updated weights for policy 1, policy_version 411144 (0.0009) [2023-12-27 22:10:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19383.1). Total num frames: 210280448. Throughput: 0: 9614.1, 1: 9819.7. Samples: 210293392. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:51,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-5.449')] [2023-12-27 22:10:51,228][106226] Updated weights for policy 0, policy_version 410029 (0.0009) [2023-12-27 22:10:51,306][106226] Updated weights for policy 0, policy_version 410039 (0.0009) [2023-12-27 22:10:51,366][106226] Updated weights for policy 0, policy_version 410049 (0.0008) [2023-12-27 22:10:51,419][106225] Updated weights for policy 1, policy_version 411154 (0.0009) [2023-12-27 22:10:51,475][106225] Updated weights for policy 1, policy_version 411164 (0.0008) [2023-12-27 22:10:51,535][106225] Updated weights for policy 1, policy_version 411174 (0.0008) [2023-12-27 22:10:51,601][106225] Updated weights for policy 1, policy_version 411184 (0.0008) [2023-12-27 22:10:52,042][106226] Updated weights for policy 0, policy_version 410059 (0.0008) [2023-12-27 22:10:52,105][106226] Updated weights for policy 0, policy_version 410069 (0.0007) [2023-12-27 22:10:52,164][106226] Updated weights for policy 0, policy_version 410079 (0.0008) [2023-12-27 22:10:52,358][106225] Updated weights for policy 1, policy_version 411194 (0.0008) [2023-12-27 22:10:52,425][106225] Updated weights for policy 1, policy_version 411204 (0.0008) [2023-12-27 22:10:52,492][106225] Updated weights for policy 1, policy_version 411214 (0.0008) [2023-12-27 22:10:52,899][106226] Updated weights for policy 0, policy_version 410089 (0.0011) [2023-12-27 22:10:52,965][106226] Updated weights for policy 0, policy_version 410099 (0.0010) [2023-12-27 22:10:53,028][106226] Updated weights for policy 0, policy_version 410109 (0.0010) [2023-12-27 22:10:53,090][106226] Updated weights for policy 0, policy_version 410119 (0.0005) [2023-12-27 22:10:53,169][106225] Updated weights for policy 1, policy_version 411224 (0.0006) [2023-12-27 22:10:53,226][106225] Updated weights for policy 1, policy_version 411234 (0.0005) [2023-12-27 22:10:53,269][106225] Updated weights for policy 1, policy_version 411244 (0.0005) [2023-12-27 22:10:53,746][106226] Updated weights for policy 0, policy_version 410129 (0.0010) [2023-12-27 22:10:53,803][106226] Updated weights for policy 0, policy_version 410139 (0.0006) [2023-12-27 22:10:53,819][106225] Updated weights for policy 1, policy_version 411254 (0.0008) [2023-12-27 22:10:53,857][106226] Updated weights for policy 0, policy_version 410149 (0.0006) [2023-12-27 22:10:53,873][106225] Updated weights for policy 1, policy_version 411264 (0.0010) [2023-12-27 22:10:53,934][106225] Updated weights for policy 1, policy_version 411274 (0.0010) [2023-12-27 22:10:54,510][106226] Updated weights for policy 0, policy_version 410159 (0.0009) [2023-12-27 22:10:54,574][106226] Updated weights for policy 0, policy_version 410169 (0.0011) [2023-12-27 22:10:54,623][106225] Updated weights for policy 1, policy_version 411284 (0.0009) [2023-12-27 22:10:54,640][106226] Updated weights for policy 0, policy_version 410179 (0.0011) [2023-12-27 22:10:54,688][106225] Updated weights for policy 1, policy_version 411294 (0.0009) [2023-12-27 22:10:54,743][106225] Updated weights for policy 1, policy_version 411304 (0.0009) [2023-12-27 22:10:55,349][106226] Updated weights for policy 0, policy_version 410189 (0.0011) [2023-12-27 22:10:55,416][106226] Updated weights for policy 0, policy_version 410199 (0.0011) [2023-12-27 22:10:55,476][106226] Updated weights for policy 0, policy_version 410209 (0.0010) [2023-12-27 22:10:55,490][106225] Updated weights for policy 1, policy_version 411314 (0.0008) [2023-12-27 22:10:55,559][106225] Updated weights for policy 1, policy_version 411324 (0.0007) [2023-12-27 22:10:55,631][106225] Updated weights for policy 1, policy_version 411334 (0.0008) [2023-12-27 22:10:55,692][106225] Updated weights for policy 1, policy_version 411344 (0.0008) [2023-12-27 22:10:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19355.3). Total num frames: 210378752. Throughput: 0: 9621.2, 1: 9866.0. Samples: 210353776. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 22:10:56,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.594')] [2023-12-27 22:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000411344_105332736.pth... [2023-12-27 22:10:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000410192_105037824.pth [2023-12-27 22:10:56,189][106226] Updated weights for policy 0, policy_version 410219 (0.0007) [2023-12-27 22:10:56,244][106226] Updated weights for policy 0, policy_version 410229 (0.0005) [2023-12-27 22:10:56,301][106226] Updated weights for policy 0, policy_version 410239 (0.0005) [2023-12-27 22:10:56,349][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000410248_105054208.pth... [2023-12-27 22:10:56,354][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000409096_104759296.pth [2023-12-27 22:10:56,433][106225] Updated weights for policy 1, policy_version 411354 (0.0008) [2023-12-27 22:10:56,490][106225] Updated weights for policy 1, policy_version 411364 (0.0008) [2023-12-27 22:10:56,549][106225] Updated weights for policy 1, policy_version 411374 (0.0007) [2023-12-27 22:10:56,917][106226] Updated weights for policy 0, policy_version 410249 (0.0005) [2023-12-27 22:10:56,978][106226] Updated weights for policy 0, policy_version 410259 (0.0005) [2023-12-27 22:10:57,030][106226] Updated weights for policy 0, policy_version 410269 (0.0007) [2023-12-27 22:10:57,077][106226] Updated weights for policy 0, policy_version 410279 (0.0010) [2023-12-27 22:10:57,249][106225] Updated weights for policy 1, policy_version 411384 (0.0008) [2023-12-27 22:10:57,300][106225] Updated weights for policy 1, policy_version 411394 (0.0007) [2023-12-27 22:10:57,356][106225] Updated weights for policy 1, policy_version 411404 (0.0008) [2023-12-27 22:10:57,746][106226] Updated weights for policy 0, policy_version 410289 (0.0011) [2023-12-27 22:10:57,799][106226] Updated weights for policy 0, policy_version 410299 (0.0011) [2023-12-27 22:10:57,856][106226] Updated weights for policy 0, policy_version 410309 (0.0010) [2023-12-27 22:10:58,100][106225] Updated weights for policy 1, policy_version 411414 (0.0007) [2023-12-27 22:10:58,149][106225] Updated weights for policy 1, policy_version 411424 (0.0008) [2023-12-27 22:10:58,212][106225] Updated weights for policy 1, policy_version 411434 (0.0008) [2023-12-27 22:10:58,550][106226] Updated weights for policy 0, policy_version 410319 (0.0010) [2023-12-27 22:10:58,619][106226] Updated weights for policy 0, policy_version 410329 (0.0009) [2023-12-27 22:10:58,685][106226] Updated weights for policy 0, policy_version 410339 (0.0008) [2023-12-27 22:10:59,090][106225] Updated weights for policy 1, policy_version 411444 (0.0007) [2023-12-27 22:10:59,152][106225] Updated weights for policy 1, policy_version 411454 (0.0007) [2023-12-27 22:10:59,210][106225] Updated weights for policy 1, policy_version 411464 (0.0007) [2023-12-27 22:10:59,530][106226] Updated weights for policy 0, policy_version 410349 (0.0007) [2023-12-27 22:10:59,592][106226] Updated weights for policy 0, policy_version 410359 (0.0005) [2023-12-27 22:10:59,657][106226] Updated weights for policy 0, policy_version 410369 (0.0006) [2023-12-27 22:10:59,863][106225] Updated weights for policy 1, policy_version 411474 (0.0009) [2023-12-27 22:10:59,924][106225] Updated weights for policy 1, policy_version 411484 (0.0010) [2023-12-27 22:10:59,998][106225] Updated weights for policy 1, policy_version 411494 (0.0008) [2023-12-27 22:11:00,047][106225] Updated weights for policy 1, policy_version 411504 (0.0008) [2023-12-27 22:11:00,364][106226] Updated weights for policy 0, policy_version 410379 (0.0008) [2023-12-27 22:11:00,430][106226] Updated weights for policy 0, policy_version 410389 (0.0009) [2023-12-27 22:11:00,492][106226] Updated weights for policy 0, policy_version 410399 (0.0009) [2023-12-27 22:11:00,789][106225] Updated weights for policy 1, policy_version 411514 (0.0006) [2023-12-27 22:11:00,852][106225] Updated weights for policy 1, policy_version 411524 (0.0005) [2023-12-27 22:11:00,920][106225] Updated weights for policy 1, policy_version 411534 (0.0006) [2023-12-27 22:11:01,075][106226] Updated weights for policy 0, policy_version 410409 (0.0006) [2023-12-27 22:11:01,143][106226] Updated weights for policy 0, policy_version 410419 (0.0010) [2023-12-27 22:11:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19355.3). Total num frames: 210477056. Throughput: 0: 9609.4, 1: 9813.3. Samples: 210469192. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:01,175][105115] Avg episode reward: [(0, '-5.007'), (1, '-5.611')] [2023-12-27 22:11:01,210][106226] Updated weights for policy 0, policy_version 410429 (0.0010) [2023-12-27 22:11:01,270][106226] Updated weights for policy 0, policy_version 410439 (0.0011) [2023-12-27 22:11:01,587][106225] Updated weights for policy 1, policy_version 411544 (0.0006) [2023-12-27 22:11:01,656][106225] Updated weights for policy 1, policy_version 411554 (0.0008) [2023-12-27 22:11:01,719][106225] Updated weights for policy 1, policy_version 411564 (0.0010) [2023-12-27 22:11:01,957][106226] Updated weights for policy 0, policy_version 410449 (0.0008) [2023-12-27 22:11:02,021][106226] Updated weights for policy 0, policy_version 410459 (0.0009) [2023-12-27 22:11:02,083][106226] Updated weights for policy 0, policy_version 410469 (0.0007) [2023-12-27 22:11:02,362][106225] Updated weights for policy 1, policy_version 411574 (0.0007) [2023-12-27 22:11:02,423][106225] Updated weights for policy 1, policy_version 411584 (0.0008) [2023-12-27 22:11:02,474][106225] Updated weights for policy 1, policy_version 411594 (0.0008) [2023-12-27 22:11:02,814][106226] Updated weights for policy 0, policy_version 410479 (0.0008) [2023-12-27 22:11:02,874][106226] Updated weights for policy 0, policy_version 410489 (0.0009) [2023-12-27 22:11:02,933][106226] Updated weights for policy 0, policy_version 410499 (0.0009) [2023-12-27 22:11:03,138][106225] Updated weights for policy 1, policy_version 411604 (0.0007) [2023-12-27 22:11:03,190][106225] Updated weights for policy 1, policy_version 411614 (0.0005) [2023-12-27 22:11:03,249][106225] Updated weights for policy 1, policy_version 411624 (0.0007) [2023-12-27 22:11:03,681][106226] Updated weights for policy 0, policy_version 410509 (0.0009) [2023-12-27 22:11:03,741][106226] Updated weights for policy 0, policy_version 410519 (0.0009) [2023-12-27 22:11:03,789][106226] Updated weights for policy 0, policy_version 410529 (0.0010) [2023-12-27 22:11:03,877][106225] Updated weights for policy 1, policy_version 411634 (0.0009) [2023-12-27 22:11:03,937][106225] Updated weights for policy 1, policy_version 411644 (0.0008) [2023-12-27 22:11:04,007][106225] Updated weights for policy 1, policy_version 411654 (0.0007) [2023-12-27 22:11:04,069][106225] Updated weights for policy 1, policy_version 411664 (0.0009) [2023-12-27 22:11:04,578][106226] Updated weights for policy 0, policy_version 410539 (0.0010) [2023-12-27 22:11:04,637][106226] Updated weights for policy 0, policy_version 410549 (0.0008) [2023-12-27 22:11:04,705][106226] Updated weights for policy 0, policy_version 410559 (0.0007) [2023-12-27 22:11:04,783][106225] Updated weights for policy 1, policy_version 411674 (0.0007) [2023-12-27 22:11:04,832][106225] Updated weights for policy 1, policy_version 411684 (0.0006) [2023-12-27 22:11:04,881][106225] Updated weights for policy 1, policy_version 411694 (0.0007) [2023-12-27 22:11:05,405][106226] Updated weights for policy 0, policy_version 410569 (0.0007) [2023-12-27 22:11:05,465][106226] Updated weights for policy 0, policy_version 410579 (0.0008) [2023-12-27 22:11:05,524][106226] Updated weights for policy 0, policy_version 410589 (0.0008) [2023-12-27 22:11:05,584][106226] Updated weights for policy 0, policy_version 410599 (0.0009) [2023-12-27 22:11:05,590][106225] Updated weights for policy 1, policy_version 411704 (0.0007) [2023-12-27 22:11:05,649][106225] Updated weights for policy 1, policy_version 411714 (0.0005) [2023-12-27 22:11:05,714][106225] Updated weights for policy 1, policy_version 411724 (0.0007) [2023-12-27 22:11:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 210575360. Throughput: 0: 9603.0, 1: 9908.5. Samples: 210587452. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:06,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.747')] [2023-12-27 22:11:06,347][106226] Updated weights for policy 0, policy_version 410609 (0.0008) [2023-12-27 22:11:06,363][106225] Updated weights for policy 1, policy_version 411734 (0.0006) [2023-12-27 22:11:06,409][106226] Updated weights for policy 0, policy_version 410619 (0.0009) [2023-12-27 22:11:06,430][106225] Updated weights for policy 1, policy_version 411744 (0.0006) [2023-12-27 22:11:06,477][106226] Updated weights for policy 0, policy_version 410629 (0.0008) [2023-12-27 22:11:06,494][106225] Updated weights for policy 1, policy_version 411754 (0.0007) [2023-12-27 22:11:07,144][106225] Updated weights for policy 1, policy_version 411764 (0.0007) [2023-12-27 22:11:07,194][106225] Updated weights for policy 1, policy_version 411774 (0.0007) [2023-12-27 22:11:07,207][106226] Updated weights for policy 0, policy_version 410639 (0.0010) [2023-12-27 22:11:07,257][106225] Updated weights for policy 1, policy_version 411784 (0.0005) [2023-12-27 22:11:07,268][106226] Updated weights for policy 0, policy_version 410649 (0.0008) [2023-12-27 22:11:07,327][106226] Updated weights for policy 0, policy_version 410659 (0.0011) [2023-12-27 22:11:07,860][106225] Updated weights for policy 1, policy_version 411794 (0.0006) [2023-12-27 22:11:07,917][106225] Updated weights for policy 1, policy_version 411804 (0.0005) [2023-12-27 22:11:07,978][106225] Updated weights for policy 1, policy_version 411814 (0.0005) [2023-12-27 22:11:07,992][106226] Updated weights for policy 0, policy_version 410669 (0.0007) [2023-12-27 22:11:08,041][106225] Updated weights for policy 1, policy_version 411824 (0.0008) [2023-12-27 22:11:08,046][106226] Updated weights for policy 0, policy_version 410679 (0.0007) [2023-12-27 22:11:08,108][106226] Updated weights for policy 0, policy_version 410689 (0.0005) [2023-12-27 22:11:08,607][106225] Updated weights for policy 1, policy_version 411834 (0.0005) [2023-12-27 22:11:08,668][106225] Updated weights for policy 1, policy_version 411844 (0.0006) [2023-12-27 22:11:08,733][106225] Updated weights for policy 1, policy_version 411854 (0.0006) [2023-12-27 22:11:08,754][106226] Updated weights for policy 0, policy_version 410699 (0.0006) [2023-12-27 22:11:08,824][106226] Updated weights for policy 0, policy_version 410709 (0.0006) [2023-12-27 22:11:08,892][106226] Updated weights for policy 0, policy_version 410719 (0.0006) [2023-12-27 22:11:09,368][106225] Updated weights for policy 1, policy_version 411864 (0.0009) [2023-12-27 22:11:09,439][106225] Updated weights for policy 1, policy_version 411874 (0.0008) [2023-12-27 22:11:09,497][106225] Updated weights for policy 1, policy_version 411884 (0.0007) [2023-12-27 22:11:09,565][106226] Updated weights for policy 0, policy_version 410729 (0.0006) [2023-12-27 22:11:09,631][106226] Updated weights for policy 0, policy_version 410739 (0.0011) [2023-12-27 22:11:09,696][106226] Updated weights for policy 0, policy_version 410749 (0.0011) [2023-12-27 22:11:09,763][106226] Updated weights for policy 0, policy_version 410759 (0.0006) [2023-12-27 22:11:10,265][106225] Updated weights for policy 1, policy_version 411894 (0.0010) [2023-12-27 22:11:10,320][106225] Updated weights for policy 1, policy_version 411904 (0.0010) [2023-12-27 22:11:10,381][106225] Updated weights for policy 1, policy_version 411914 (0.0010) [2023-12-27 22:11:10,528][106226] Updated weights for policy 0, policy_version 410769 (0.0008) [2023-12-27 22:11:10,598][106226] Updated weights for policy 0, policy_version 410779 (0.0006) [2023-12-27 22:11:10,665][106226] Updated weights for policy 0, policy_version 410789 (0.0005) [2023-12-27 22:11:11,138][106225] Updated weights for policy 1, policy_version 411924 (0.0010) [2023-12-27 22:11:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 210673664. Throughput: 0: 9656.1, 1: 10013.9. Samples: 210649848. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:11,175][105115] Avg episode reward: [(0, '-4.940'), (1, '-5.656')] [2023-12-27 22:11:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000410792_105193472.pth... [2023-12-27 22:11:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000409672_104906752.pth [2023-12-27 22:11:11,213][106225] Updated weights for policy 1, policy_version 411934 (0.0010) [2023-12-27 22:11:11,276][106225] Updated weights for policy 1, policy_version 411944 (0.0009) [2023-12-27 22:11:11,281][106226] Updated weights for policy 0, policy_version 410799 (0.0007) [2023-12-27 22:11:11,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000411952_105488384.pth... [2023-12-27 22:11:11,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000410800_105193472.pth [2023-12-27 22:11:11,349][106226] Updated weights for policy 0, policy_version 410809 (0.0007) [2023-12-27 22:11:11,419][106226] Updated weights for policy 0, policy_version 410819 (0.0008) [2023-12-27 22:11:12,060][106225] Updated weights for policy 1, policy_version 411954 (0.0010) [2023-12-27 22:11:12,126][106225] Updated weights for policy 1, policy_version 411964 (0.0006) [2023-12-27 22:11:12,173][106226] Updated weights for policy 0, policy_version 410829 (0.0007) [2023-12-27 22:11:12,179][106225] Updated weights for policy 1, policy_version 411974 (0.0007) [2023-12-27 22:11:12,236][106226] Updated weights for policy 0, policy_version 410839 (0.0008) [2023-12-27 22:11:12,238][106225] Updated weights for policy 1, policy_version 411984 (0.0006) [2023-12-27 22:11:12,304][106226] Updated weights for policy 0, policy_version 410849 (0.0008) [2023-12-27 22:11:12,916][106225] Updated weights for policy 1, policy_version 411994 (0.0006) [2023-12-27 22:11:12,964][106225] Updated weights for policy 1, policy_version 412004 (0.0008) [2023-12-27 22:11:13,012][106225] Updated weights for policy 1, policy_version 412014 (0.0008) [2023-12-27 22:11:13,077][106226] Updated weights for policy 0, policy_version 410859 (0.0009) [2023-12-27 22:11:13,127][106226] Updated weights for policy 0, policy_version 410869 (0.0008) [2023-12-27 22:11:13,178][106226] Updated weights for policy 0, policy_version 410879 (0.0007) [2023-12-27 22:11:13,767][106225] Updated weights for policy 1, policy_version 412024 (0.0009) [2023-12-27 22:11:13,818][106225] Updated weights for policy 1, policy_version 412034 (0.0009) [2023-12-27 22:11:13,842][106226] Updated weights for policy 0, policy_version 410889 (0.0008) [2023-12-27 22:11:13,875][106225] Updated weights for policy 1, policy_version 412044 (0.0008) [2023-12-27 22:11:13,893][106226] Updated weights for policy 0, policy_version 410899 (0.0007) [2023-12-27 22:11:13,940][106226] Updated weights for policy 0, policy_version 410909 (0.0008) [2023-12-27 22:11:13,988][106226] Updated weights for policy 0, policy_version 410919 (0.0008) [2023-12-27 22:11:14,533][106225] Updated weights for policy 1, policy_version 412054 (0.0007) [2023-12-27 22:11:14,588][106225] Updated weights for policy 1, policy_version 412064 (0.0005) [2023-12-27 22:11:14,640][106225] Updated weights for policy 1, policy_version 412074 (0.0005) [2023-12-27 22:11:14,815][106226] Updated weights for policy 0, policy_version 410929 (0.0008) [2023-12-27 22:11:14,879][106226] Updated weights for policy 0, policy_version 410939 (0.0007) [2023-12-27 22:11:14,941][106226] Updated weights for policy 0, policy_version 410949 (0.0008) [2023-12-27 22:11:15,338][106225] Updated weights for policy 1, policy_version 412084 (0.0007) [2023-12-27 22:11:15,386][106225] Updated weights for policy 1, policy_version 412094 (0.0008) [2023-12-27 22:11:15,436][106225] Updated weights for policy 1, policy_version 412104 (0.0009) [2023-12-27 22:11:15,647][106226] Updated weights for policy 0, policy_version 410959 (0.0008) [2023-12-27 22:11:15,712][106226] Updated weights for policy 0, policy_version 410969 (0.0008) [2023-12-27 22:11:15,783][106226] Updated weights for policy 0, policy_version 410979 (0.0009) [2023-12-27 22:11:16,104][106225] Updated weights for policy 1, policy_version 412114 (0.0008) [2023-12-27 22:11:16,167][106225] Updated weights for policy 1, policy_version 412124 (0.0006) [2023-12-27 22:11:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 210771968. Throughput: 0: 9644.3, 1: 9917.9. Samples: 210764448. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:16,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-5.868')] [2023-12-27 22:11:16,232][106225] Updated weights for policy 1, policy_version 412134 (0.0010) [2023-12-27 22:11:16,292][106225] Updated weights for policy 1, policy_version 412144 (0.0010) [2023-12-27 22:11:16,562][106226] Updated weights for policy 0, policy_version 410989 (0.0010) [2023-12-27 22:11:16,615][106226] Updated weights for policy 0, policy_version 410999 (0.0008) [2023-12-27 22:11:16,680][106226] Updated weights for policy 0, policy_version 411009 (0.0009) [2023-12-27 22:11:16,845][106225] Updated weights for policy 1, policy_version 412154 (0.0005) [2023-12-27 22:11:16,906][106225] Updated weights for policy 1, policy_version 412164 (0.0006) [2023-12-27 22:11:16,962][106225] Updated weights for policy 1, policy_version 412174 (0.0009) [2023-12-27 22:11:17,352][106226] Updated weights for policy 0, policy_version 411019 (0.0007) [2023-12-27 22:11:17,407][106226] Updated weights for policy 0, policy_version 411029 (0.0008) [2023-12-27 22:11:17,466][106226] Updated weights for policy 0, policy_version 411039 (0.0009) [2023-12-27 22:11:17,648][106225] Updated weights for policy 1, policy_version 412184 (0.0008) [2023-12-27 22:11:17,703][106225] Updated weights for policy 1, policy_version 412194 (0.0009) [2023-12-27 22:11:17,753][106225] Updated weights for policy 1, policy_version 412204 (0.0007) [2023-12-27 22:11:18,200][106226] Updated weights for policy 0, policy_version 411049 (0.0008) [2023-12-27 22:11:18,266][106226] Updated weights for policy 0, policy_version 411059 (0.0008) [2023-12-27 22:11:18,332][106226] Updated weights for policy 0, policy_version 411069 (0.0008) [2023-12-27 22:11:18,402][106226] Updated weights for policy 0, policy_version 411079 (0.0008) [2023-12-27 22:11:18,473][106225] Updated weights for policy 1, policy_version 412214 (0.0008) [2023-12-27 22:11:18,540][106225] Updated weights for policy 1, policy_version 412224 (0.0009) [2023-12-27 22:11:18,610][106225] Updated weights for policy 1, policy_version 412234 (0.0010) [2023-12-27 22:11:19,046][106226] Updated weights for policy 0, policy_version 411089 (0.0008) [2023-12-27 22:11:19,099][106226] Updated weights for policy 0, policy_version 411099 (0.0008) [2023-12-27 22:11:19,157][106226] Updated weights for policy 0, policy_version 411109 (0.0009) [2023-12-27 22:11:19,351][106225] Updated weights for policy 1, policy_version 412244 (0.0009) [2023-12-27 22:11:19,418][106225] Updated weights for policy 1, policy_version 412254 (0.0008) [2023-12-27 22:11:19,482][106225] Updated weights for policy 1, policy_version 412264 (0.0007) [2023-12-27 22:11:19,930][106226] Updated weights for policy 0, policy_version 411119 (0.0008) [2023-12-27 22:11:19,997][106226] Updated weights for policy 0, policy_version 411129 (0.0008) [2023-12-27 22:11:20,061][106226] Updated weights for policy 0, policy_version 411139 (0.0008) [2023-12-27 22:11:20,235][106225] Updated weights for policy 1, policy_version 412274 (0.0009) [2023-12-27 22:11:20,303][106225] Updated weights for policy 1, policy_version 412284 (0.0005) [2023-12-27 22:11:20,369][106225] Updated weights for policy 1, policy_version 412294 (0.0007) [2023-12-27 22:11:20,431][106225] Updated weights for policy 1, policy_version 412304 (0.0006) [2023-12-27 22:11:20,885][106226] Updated weights for policy 0, policy_version 411149 (0.0009) [2023-12-27 22:11:20,944][106226] Updated weights for policy 0, policy_version 411159 (0.0009) [2023-12-27 22:11:21,007][106226] Updated weights for policy 0, policy_version 411169 (0.0009) [2023-12-27 22:11:21,055][106225] Updated weights for policy 1, policy_version 412314 (0.0008) [2023-12-27 22:11:21,120][106225] Updated weights for policy 1, policy_version 412324 (0.0008) [2023-12-27 22:11:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 210870272. Throughput: 0: 9652.3, 1: 9892.1. Samples: 210880720. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:21,175][105115] Avg episode reward: [(0, '-5.076'), (1, '-5.668')] [2023-12-27 22:11:21,186][106225] Updated weights for policy 1, policy_version 412334 (0.0008) [2023-12-27 22:11:21,840][106226] Updated weights for policy 0, policy_version 411179 (0.0008) [2023-12-27 22:11:21,904][106226] Updated weights for policy 0, policy_version 411189 (0.0009) [2023-12-27 22:11:21,966][106226] Updated weights for policy 0, policy_version 411199 (0.0007) [2023-12-27 22:11:21,993][106225] Updated weights for policy 1, policy_version 412344 (0.0008) [2023-12-27 22:11:22,058][106225] Updated weights for policy 1, policy_version 412354 (0.0009) [2023-12-27 22:11:22,124][106225] Updated weights for policy 1, policy_version 412364 (0.0011) [2023-12-27 22:11:22,787][106226] Updated weights for policy 0, policy_version 411209 (0.0007) [2023-12-27 22:11:22,843][106226] Updated weights for policy 0, policy_version 411219 (0.0008) [2023-12-27 22:11:22,878][106225] Updated weights for policy 1, policy_version 412374 (0.0010) [2023-12-27 22:11:22,906][106226] Updated weights for policy 0, policy_version 411229 (0.0008) [2023-12-27 22:11:22,939][106225] Updated weights for policy 1, policy_version 412384 (0.0007) [2023-12-27 22:11:22,966][106226] Updated weights for policy 0, policy_version 411239 (0.0010) [2023-12-27 22:11:22,990][106225] Updated weights for policy 1, policy_version 412394 (0.0005) [2023-12-27 22:11:23,592][106225] Updated weights for policy 1, policy_version 412404 (0.0007) [2023-12-27 22:11:23,648][106225] Updated weights for policy 1, policy_version 412414 (0.0009) [2023-12-27 22:11:23,669][106226] Updated weights for policy 0, policy_version 411249 (0.0006) [2023-12-27 22:11:23,713][106225] Updated weights for policy 1, policy_version 412424 (0.0006) [2023-12-27 22:11:23,736][106226] Updated weights for policy 0, policy_version 411259 (0.0006) [2023-12-27 22:11:23,787][106226] Updated weights for policy 0, policy_version 411269 (0.0009) [2023-12-27 22:11:24,330][106225] Updated weights for policy 1, policy_version 412434 (0.0006) [2023-12-27 22:11:24,348][106226] Updated weights for policy 0, policy_version 411279 (0.0007) [2023-12-27 22:11:24,387][106225] Updated weights for policy 1, policy_version 412444 (0.0009) [2023-12-27 22:11:24,410][106226] Updated weights for policy 0, policy_version 411289 (0.0006) [2023-12-27 22:11:24,436][106225] Updated weights for policy 1, policy_version 412454 (0.0009) [2023-12-27 22:11:24,470][106226] Updated weights for policy 0, policy_version 411299 (0.0005) [2023-12-27 22:11:24,486][106225] Updated weights for policy 1, policy_version 412464 (0.0008) [2023-12-27 22:11:25,054][106226] Updated weights for policy 0, policy_version 411309 (0.0005) [2023-12-27 22:11:25,112][106226] Updated weights for policy 0, policy_version 411319 (0.0005) [2023-12-27 22:11:25,139][106225] Updated weights for policy 1, policy_version 412474 (0.0009) [2023-12-27 22:11:25,163][106226] Updated weights for policy 0, policy_version 411329 (0.0005) [2023-12-27 22:11:25,213][106225] Updated weights for policy 1, policy_version 412484 (0.0007) [2023-12-27 22:11:25,282][106225] Updated weights for policy 1, policy_version 412494 (0.0008) [2023-12-27 22:11:25,827][106226] Updated weights for policy 0, policy_version 411339 (0.0008) [2023-12-27 22:11:25,892][106226] Updated weights for policy 0, policy_version 411349 (0.0007) [2023-12-27 22:11:25,948][106226] Updated weights for policy 0, policy_version 411359 (0.0006) [2023-12-27 22:11:25,987][106225] Updated weights for policy 1, policy_version 412504 (0.0008) [2023-12-27 22:11:26,038][106225] Updated weights for policy 1, policy_version 412514 (0.0008) [2023-12-27 22:11:26,096][106225] Updated weights for policy 1, policy_version 412524 (0.0008) [2023-12-27 22:11:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19438.6). Total num frames: 210976768. Throughput: 0: 9598.8, 1: 9853.0. Samples: 210938184. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:26,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-5.556')] [2023-12-27 22:11:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000412528_105635840.pth... [2023-12-27 22:11:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000411368_105340928.pth... [2023-12-27 22:11:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000410248_105054208.pth [2023-12-27 22:11:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000411344_105332736.pth [2023-12-27 22:11:26,546][106226] Updated weights for policy 0, policy_version 411369 (0.0008) [2023-12-27 22:11:26,604][106226] Updated weights for policy 0, policy_version 411379 (0.0007) [2023-12-27 22:11:26,655][106226] Updated weights for policy 0, policy_version 411391 (0.0009) [2023-12-27 22:11:26,822][106225] Updated weights for policy 1, policy_version 412534 (0.0008) [2023-12-27 22:11:26,883][106225] Updated weights for policy 1, policy_version 412544 (0.0005) [2023-12-27 22:11:26,940][106225] Updated weights for policy 1, policy_version 412554 (0.0005) [2023-12-27 22:11:27,396][106226] Updated weights for policy 0, policy_version 411401 (0.0008) [2023-12-27 22:11:27,453][106226] Updated weights for policy 0, policy_version 411411 (0.0009) [2023-12-27 22:11:27,499][106226] Updated weights for policy 0, policy_version 411421 (0.0007) [2023-12-27 22:11:27,515][106225] Updated weights for policy 1, policy_version 412564 (0.0006) [2023-12-27 22:11:27,543][106226] Updated weights for policy 0, policy_version 411431 (0.0005) [2023-12-27 22:11:27,599][106225] Updated weights for policy 1, policy_version 412574 (0.0007) [2023-12-27 22:11:27,656][106225] Updated weights for policy 1, policy_version 412584 (0.0008) [2023-12-27 22:11:28,196][106226] Updated weights for policy 0, policy_version 411441 (0.0008) [2023-12-27 22:11:28,253][106226] Updated weights for policy 0, policy_version 411451 (0.0008) [2023-12-27 22:11:28,298][106226] Updated weights for policy 0, policy_version 411461 (0.0006) [2023-12-27 22:11:28,373][106225] Updated weights for policy 1, policy_version 412594 (0.0008) [2023-12-27 22:11:28,428][106225] Updated weights for policy 1, policy_version 412604 (0.0009) [2023-12-27 22:11:28,485][106225] Updated weights for policy 1, policy_version 412614 (0.0009) [2023-12-27 22:11:28,548][106225] Updated weights for policy 1, policy_version 412624 (0.0008) [2023-12-27 22:11:29,019][106226] Updated weights for policy 0, policy_version 411471 (0.0009) [2023-12-27 22:11:29,072][106226] Updated weights for policy 0, policy_version 411481 (0.0010) [2023-12-27 22:11:29,126][106226] Updated weights for policy 0, policy_version 411491 (0.0010) [2023-12-27 22:11:29,311][106225] Updated weights for policy 1, policy_version 412634 (0.0008) [2023-12-27 22:11:29,378][106225] Updated weights for policy 1, policy_version 412644 (0.0009) [2023-12-27 22:11:29,428][106225] Updated weights for policy 1, policy_version 412654 (0.0009) [2023-12-27 22:11:29,835][106226] Updated weights for policy 0, policy_version 411501 (0.0010) [2023-12-27 22:11:29,894][106226] Updated weights for policy 0, policy_version 411511 (0.0008) [2023-12-27 22:11:29,958][106226] Updated weights for policy 0, policy_version 411521 (0.0007) [2023-12-27 22:11:30,256][106225] Updated weights for policy 1, policy_version 412664 (0.0009) [2023-12-27 22:11:30,322][106225] Updated weights for policy 1, policy_version 412674 (0.0009) [2023-12-27 22:11:30,381][106225] Updated weights for policy 1, policy_version 412684 (0.0008) [2023-12-27 22:11:30,620][106226] Updated weights for policy 0, policy_version 411531 (0.0007) [2023-12-27 22:11:30,676][106226] Updated weights for policy 0, policy_version 411541 (0.0009) [2023-12-27 22:11:30,724][106226] Updated weights for policy 0, policy_version 411551 (0.0008) [2023-12-27 22:11:31,172][106225] Updated weights for policy 1, policy_version 412694 (0.0009) [2023-12-27 22:11:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 211066880. Throughput: 0: 9727.6, 1: 9904.7. Samples: 211060152. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:31,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-5.783')] [2023-12-27 22:11:31,230][106225] Updated weights for policy 1, policy_version 412704 (0.0009) [2023-12-27 22:11:31,299][106225] Updated weights for policy 1, policy_version 412714 (0.0008) [2023-12-27 22:11:31,426][106226] Updated weights for policy 0, policy_version 411561 (0.0007) [2023-12-27 22:11:31,493][106226] Updated weights for policy 0, policy_version 411571 (0.0005) [2023-12-27 22:11:31,557][106226] Updated weights for policy 0, policy_version 411581 (0.0005) [2023-12-27 22:11:31,632][106226] Updated weights for policy 0, policy_version 411591 (0.0008) [2023-12-27 22:11:32,062][106225] Updated weights for policy 1, policy_version 412724 (0.0008) [2023-12-27 22:11:32,124][106225] Updated weights for policy 1, policy_version 412734 (0.0008) [2023-12-27 22:11:32,182][106225] Updated weights for policy 1, policy_version 412744 (0.0008) [2023-12-27 22:11:32,283][106226] Updated weights for policy 0, policy_version 411601 (0.0010) [2023-12-27 22:11:32,342][106226] Updated weights for policy 0, policy_version 411611 (0.0009) [2023-12-27 22:11:32,408][106226] Updated weights for policy 0, policy_version 411621 (0.0010) [2023-12-27 22:11:32,838][106225] Updated weights for policy 1, policy_version 412754 (0.0008) [2023-12-27 22:11:32,893][106225] Updated weights for policy 1, policy_version 412764 (0.0007) [2023-12-27 22:11:32,939][106225] Updated weights for policy 1, policy_version 412774 (0.0007) [2023-12-27 22:11:32,991][106225] Updated weights for policy 1, policy_version 412784 (0.0007) [2023-12-27 22:11:33,114][106226] Updated weights for policy 0, policy_version 411631 (0.0009) [2023-12-27 22:11:33,169][106226] Updated weights for policy 0, policy_version 411641 (0.0008) [2023-12-27 22:11:33,215][106226] Updated weights for policy 0, policy_version 411651 (0.0009) [2023-12-27 22:11:33,665][106225] Updated weights for policy 1, policy_version 412794 (0.0007) [2023-12-27 22:11:33,716][106225] Updated weights for policy 1, policy_version 412804 (0.0008) [2023-12-27 22:11:33,762][106225] Updated weights for policy 1, policy_version 412814 (0.0007) [2023-12-27 22:11:33,943][106226] Updated weights for policy 0, policy_version 411661 (0.0010) [2023-12-27 22:11:33,995][106226] Updated weights for policy 0, policy_version 411671 (0.0010) [2023-12-27 22:11:34,053][106226] Updated weights for policy 0, policy_version 411681 (0.0008) [2023-12-27 22:11:34,453][106225] Updated weights for policy 1, policy_version 412824 (0.0006) [2023-12-27 22:11:34,514][106225] Updated weights for policy 1, policy_version 412834 (0.0007) [2023-12-27 22:11:34,574][106225] Updated weights for policy 1, policy_version 412844 (0.0009) [2023-12-27 22:11:34,786][106226] Updated weights for policy 0, policy_version 411691 (0.0009) [2023-12-27 22:11:34,847][106226] Updated weights for policy 0, policy_version 411701 (0.0005) [2023-12-27 22:11:34,902][106226] Updated weights for policy 0, policy_version 411711 (0.0005) [2023-12-27 22:11:35,314][106225] Updated weights for policy 1, policy_version 412854 (0.0009) [2023-12-27 22:11:35,382][106225] Updated weights for policy 1, policy_version 412864 (0.0008) [2023-12-27 22:11:35,441][106225] Updated weights for policy 1, policy_version 412874 (0.0008) [2023-12-27 22:11:35,460][106226] Updated weights for policy 0, policy_version 411721 (0.0006) [2023-12-27 22:11:35,518][106226] Updated weights for policy 0, policy_version 411731 (0.0007) [2023-12-27 22:11:35,578][106226] Updated weights for policy 0, policy_version 411741 (0.0005) [2023-12-27 22:11:35,633][106226] Updated weights for policy 0, policy_version 411751 (0.0005) [2023-12-27 22:11:36,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 211165184. Throughput: 0: 9841.4, 1: 9855.1. Samples: 211179736. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:36,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.765')] [2023-12-27 22:11:36,264][106226] Updated weights for policy 0, policy_version 411761 (0.0009) [2023-12-27 22:11:36,274][106225] Updated weights for policy 1, policy_version 412884 (0.0006) [2023-12-27 22:11:36,334][106226] Updated weights for policy 0, policy_version 411771 (0.0008) [2023-12-27 22:11:36,334][106225] Updated weights for policy 1, policy_version 412894 (0.0006) [2023-12-27 22:11:36,400][106225] Updated weights for policy 1, policy_version 412904 (0.0006) [2023-12-27 22:11:36,402][106226] Updated weights for policy 0, policy_version 411781 (0.0007) [2023-12-27 22:11:37,049][106225] Updated weights for policy 1, policy_version 412914 (0.0007) [2023-12-27 22:11:37,119][106225] Updated weights for policy 1, policy_version 412924 (0.0007) [2023-12-27 22:11:37,181][106225] Updated weights for policy 1, policy_version 412934 (0.0007) [2023-12-27 22:11:37,189][106226] Updated weights for policy 0, policy_version 411791 (0.0008) [2023-12-27 22:11:37,246][106225] Updated weights for policy 1, policy_version 412944 (0.0008) [2023-12-27 22:11:37,248][106226] Updated weights for policy 0, policy_version 411801 (0.0008) [2023-12-27 22:11:37,297][106226] Updated weights for policy 0, policy_version 411811 (0.0008) [2023-12-27 22:11:37,781][106225] Updated weights for policy 1, policy_version 412954 (0.0006) [2023-12-27 22:11:37,837][106225] Updated weights for policy 1, policy_version 412964 (0.0005) [2023-12-27 22:11:37,891][106225] Updated weights for policy 1, policy_version 412974 (0.0005) [2023-12-27 22:11:38,060][106226] Updated weights for policy 0, policy_version 411821 (0.0009) [2023-12-27 22:11:38,116][106226] Updated weights for policy 0, policy_version 411831 (0.0009) [2023-12-27 22:11:38,173][106226] Updated weights for policy 0, policy_version 411841 (0.0008) [2023-12-27 22:11:38,497][106225] Updated weights for policy 1, policy_version 412984 (0.0007) [2023-12-27 22:11:38,563][106225] Updated weights for policy 1, policy_version 412994 (0.0006) [2023-12-27 22:11:38,630][106225] Updated weights for policy 1, policy_version 413004 (0.0006) [2023-12-27 22:11:38,964][106226] Updated weights for policy 0, policy_version 411851 (0.0008) [2023-12-27 22:11:39,025][106226] Updated weights for policy 0, policy_version 411861 (0.0008) [2023-12-27 22:11:39,088][106226] Updated weights for policy 0, policy_version 411871 (0.0008) [2023-12-27 22:11:39,294][106225] Updated weights for policy 1, policy_version 413014 (0.0008) [2023-12-27 22:11:39,359][106225] Updated weights for policy 1, policy_version 413024 (0.0008) [2023-12-27 22:11:39,436][106225] Updated weights for policy 1, policy_version 413034 (0.0009) [2023-12-27 22:11:39,856][106226] Updated weights for policy 0, policy_version 411881 (0.0008) [2023-12-27 22:11:39,929][106226] Updated weights for policy 0, policy_version 411891 (0.0008) [2023-12-27 22:11:40,003][106226] Updated weights for policy 0, policy_version 411901 (0.0009) [2023-12-27 22:11:40,069][106226] Updated weights for policy 0, policy_version 411911 (0.0009) [2023-12-27 22:11:40,202][106225] Updated weights for policy 1, policy_version 413044 (0.0012) [2023-12-27 22:11:40,250][106225] Updated weights for policy 1, policy_version 413054 (0.0008) [2023-12-27 22:11:40,307][106225] Updated weights for policy 1, policy_version 413064 (0.0007) [2023-12-27 22:11:40,826][106226] Updated weights for policy 0, policy_version 411921 (0.0008) [2023-12-27 22:11:40,885][106226] Updated weights for policy 0, policy_version 411931 (0.0008) [2023-12-27 22:11:40,954][106226] Updated weights for policy 0, policy_version 411941 (0.0009) [2023-12-27 22:11:41,031][106225] Updated weights for policy 1, policy_version 413074 (0.0010) [2023-12-27 22:11:41,094][106225] Updated weights for policy 1, policy_version 413084 (0.0010) [2023-12-27 22:11:41,169][106225] Updated weights for policy 1, policy_version 413094 (0.0010) [2023-12-27 22:11:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 211263488. Throughput: 0: 9773.2, 1: 9889.4. Samples: 211238592. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:41,175][105115] Avg episode reward: [(0, '-4.872'), (1, '-5.978')] [2023-12-27 22:11:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000411944_105488384.pth... [2023-12-27 22:11:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000410792_105193472.pth [2023-12-27 22:11:41,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000413104_105783296.pth... [2023-12-27 22:11:41,238][106225] Updated weights for policy 1, policy_version 413104 (0.0009) [2023-12-27 22:11:41,244][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000411952_105488384.pth [2023-12-27 22:11:41,739][106226] Updated weights for policy 0, policy_version 411951 (0.0008) [2023-12-27 22:11:41,805][106226] Updated weights for policy 0, policy_version 411961 (0.0008) [2023-12-27 22:11:41,871][106226] Updated weights for policy 0, policy_version 411971 (0.0008) [2023-12-27 22:11:42,025][106225] Updated weights for policy 1, policy_version 413114 (0.0008) [2023-12-27 22:11:42,078][106225] Updated weights for policy 1, policy_version 413124 (0.0008) [2023-12-27 22:11:42,137][106225] Updated weights for policy 1, policy_version 413134 (0.0008) [2023-12-27 22:11:42,642][106226] Updated weights for policy 0, policy_version 411981 (0.0008) [2023-12-27 22:11:42,708][106226] Updated weights for policy 0, policy_version 411991 (0.0010) [2023-12-27 22:11:42,781][106226] Updated weights for policy 0, policy_version 412001 (0.0008) [2023-12-27 22:11:42,860][106225] Updated weights for policy 1, policy_version 413144 (0.0008) [2023-12-27 22:11:42,916][106225] Updated weights for policy 1, policy_version 413154 (0.0007) [2023-12-27 22:11:42,975][106225] Updated weights for policy 1, policy_version 413164 (0.0005) [2023-12-27 22:11:43,464][106226] Updated weights for policy 0, policy_version 412011 (0.0008) [2023-12-27 22:11:43,515][106226] Updated weights for policy 0, policy_version 412021 (0.0009) [2023-12-27 22:11:43,564][106226] Updated weights for policy 0, policy_version 412031 (0.0009) [2023-12-27 22:11:43,609][106225] Updated weights for policy 1, policy_version 413174 (0.0008) [2023-12-27 22:11:43,667][106225] Updated weights for policy 1, policy_version 413184 (0.0010) [2023-12-27 22:11:43,726][106225] Updated weights for policy 1, policy_version 413194 (0.0010) [2023-12-27 22:11:44,310][106226] Updated weights for policy 0, policy_version 412041 (0.0007) [2023-12-27 22:11:44,365][106225] Updated weights for policy 1, policy_version 413204 (0.0008) [2023-12-27 22:11:44,367][106226] Updated weights for policy 0, policy_version 412051 (0.0011) [2023-12-27 22:11:44,411][106225] Updated weights for policy 1, policy_version 413214 (0.0006) [2023-12-27 22:11:44,417][106226] Updated weights for policy 0, policy_version 412061 (0.0011) [2023-12-27 22:11:44,457][106225] Updated weights for policy 1, policy_version 413224 (0.0005) [2023-12-27 22:11:44,468][106226] Updated weights for policy 0, policy_version 412071 (0.0010) [2023-12-27 22:11:45,207][106226] Updated weights for policy 0, policy_version 412081 (0.0011) [2023-12-27 22:11:45,263][106226] Updated weights for policy 0, policy_version 412091 (0.0011) [2023-12-27 22:11:45,310][106225] Updated weights for policy 1, policy_version 413234 (0.0006) [2023-12-27 22:11:45,321][106226] Updated weights for policy 0, policy_version 412101 (0.0010) [2023-12-27 22:11:45,364][106225] Updated weights for policy 1, policy_version 413244 (0.0010) [2023-12-27 22:11:45,425][106225] Updated weights for policy 1, policy_version 413254 (0.0011) [2023-12-27 22:11:45,483][106225] Updated weights for policy 1, policy_version 413264 (0.0008) [2023-12-27 22:11:46,042][106226] Updated weights for policy 0, policy_version 412111 (0.0010) [2023-12-27 22:11:46,096][106226] Updated weights for policy 0, policy_version 412121 (0.0009) [2023-12-27 22:11:46,148][106226] Updated weights for policy 0, policy_version 412131 (0.0007) [2023-12-27 22:11:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 211361792. Throughput: 0: 9691.8, 1: 9934.8. Samples: 211352388. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:46,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.552')] [2023-12-27 22:11:46,206][106225] Updated weights for policy 1, policy_version 413274 (0.0007) [2023-12-27 22:11:46,260][106225] Updated weights for policy 1, policy_version 413284 (0.0008) [2023-12-27 22:11:46,319][106225] Updated weights for policy 1, policy_version 413294 (0.0008) [2023-12-27 22:11:46,866][106226] Updated weights for policy 0, policy_version 412141 (0.0011) [2023-12-27 22:11:46,917][106226] Updated weights for policy 0, policy_version 412151 (0.0010) [2023-12-27 22:11:46,971][106226] Updated weights for policy 0, policy_version 412161 (0.0011) [2023-12-27 22:11:47,035][106225] Updated weights for policy 1, policy_version 413304 (0.0007) [2023-12-27 22:11:47,083][106225] Updated weights for policy 1, policy_version 413314 (0.0008) [2023-12-27 22:11:47,129][106225] Updated weights for policy 1, policy_version 413324 (0.0008) [2023-12-27 22:11:47,686][106226] Updated weights for policy 0, policy_version 412171 (0.0010) [2023-12-27 22:11:47,735][106226] Updated weights for policy 0, policy_version 412181 (0.0008) [2023-12-27 22:11:47,794][106226] Updated weights for policy 0, policy_version 412191 (0.0005) [2023-12-27 22:11:47,812][106225] Updated weights for policy 1, policy_version 413334 (0.0008) [2023-12-27 22:11:47,871][106225] Updated weights for policy 1, policy_version 413344 (0.0007) [2023-12-27 22:11:47,925][106225] Updated weights for policy 1, policy_version 413354 (0.0009) [2023-12-27 22:11:48,430][106226] Updated weights for policy 0, policy_version 412201 (0.0006) [2023-12-27 22:11:48,490][106226] Updated weights for policy 0, policy_version 412211 (0.0009) [2023-12-27 22:11:48,559][106226] Updated weights for policy 0, policy_version 412221 (0.0008) [2023-12-27 22:11:48,624][106226] Updated weights for policy 0, policy_version 412231 (0.0009) [2023-12-27 22:11:48,648][106225] Updated weights for policy 1, policy_version 413364 (0.0007) [2023-12-27 22:11:48,701][106225] Updated weights for policy 1, policy_version 413374 (0.0006) [2023-12-27 22:11:48,771][106225] Updated weights for policy 1, policy_version 413384 (0.0006) [2023-12-27 22:11:49,293][106226] Updated weights for policy 0, policy_version 412241 (0.0009) [2023-12-27 22:11:49,359][106226] Updated weights for policy 0, policy_version 412251 (0.0008) [2023-12-27 22:11:49,429][106226] Updated weights for policy 0, policy_version 412261 (0.0008) [2023-12-27 22:11:49,440][106225] Updated weights for policy 1, policy_version 413394 (0.0006) [2023-12-27 22:11:49,506][106225] Updated weights for policy 1, policy_version 413404 (0.0006) [2023-12-27 22:11:49,571][106225] Updated weights for policy 1, policy_version 413414 (0.0005) [2023-12-27 22:11:49,641][106225] Updated weights for policy 1, policy_version 413424 (0.0005) [2023-12-27 22:11:50,191][106226] Updated weights for policy 0, policy_version 412271 (0.0009) [2023-12-27 22:11:50,256][106226] Updated weights for policy 0, policy_version 412281 (0.0008) [2023-12-27 22:11:50,280][106225] Updated weights for policy 1, policy_version 413434 (0.0008) [2023-12-27 22:11:50,316][106226] Updated weights for policy 0, policy_version 412291 (0.0008) [2023-12-27 22:11:50,337][106225] Updated weights for policy 1, policy_version 413444 (0.0009) [2023-12-27 22:11:50,399][106225] Updated weights for policy 1, policy_version 413454 (0.0008) [2023-12-27 22:11:51,023][106226] Updated weights for policy 0, policy_version 412301 (0.0009) [2023-12-27 22:11:51,101][106226] Updated weights for policy 0, policy_version 412312 (0.0009) [2023-12-27 22:11:51,113][106225] Updated weights for policy 1, policy_version 413464 (0.0007) [2023-12-27 22:11:51,161][106226] Updated weights for policy 0, policy_version 412322 (0.0010) [2023-12-27 22:11:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 211451904. Throughput: 0: 9699.3, 1: 9878.5. Samples: 211468452. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:51,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-5.603')] [2023-12-27 22:11:51,178][106225] Updated weights for policy 1, policy_version 413474 (0.0008) [2023-12-27 22:11:51,238][106225] Updated weights for policy 1, policy_version 413484 (0.0009) [2023-12-27 22:11:51,913][106226] Updated weights for policy 0, policy_version 412332 (0.0010) [2023-12-27 22:11:51,980][106226] Updated weights for policy 0, policy_version 412342 (0.0009) [2023-12-27 22:11:52,042][106226] Updated weights for policy 0, policy_version 412352 (0.0009) [2023-12-27 22:11:52,054][106225] Updated weights for policy 1, policy_version 413494 (0.0007) [2023-12-27 22:11:52,117][106225] Updated weights for policy 1, policy_version 413504 (0.0007) [2023-12-27 22:11:52,181][106225] Updated weights for policy 1, policy_version 413514 (0.0008) [2023-12-27 22:11:52,835][106226] Updated weights for policy 0, policy_version 412362 (0.0009) [2023-12-27 22:11:52,894][106226] Updated weights for policy 0, policy_version 412372 (0.0009) [2023-12-27 22:11:52,921][106225] Updated weights for policy 1, policy_version 413524 (0.0009) [2023-12-27 22:11:52,954][106226] Updated weights for policy 0, policy_version 412382 (0.0007) [2023-12-27 22:11:52,983][106225] Updated weights for policy 1, policy_version 413534 (0.0008) [2023-12-27 22:11:53,014][106226] Updated weights for policy 0, policy_version 412392 (0.0007) [2023-12-27 22:11:53,042][106225] Updated weights for policy 1, policy_version 413544 (0.0006) [2023-12-27 22:11:53,659][106226] Updated weights for policy 0, policy_version 412402 (0.0009) [2023-12-27 22:11:53,677][106225] Updated weights for policy 1, policy_version 413554 (0.0006) [2023-12-27 22:11:53,717][106226] Updated weights for policy 0, policy_version 412412 (0.0007) [2023-12-27 22:11:53,727][106225] Updated weights for policy 1, policy_version 413564 (0.0007) [2023-12-27 22:11:53,776][106225] Updated weights for policy 1, policy_version 413574 (0.0007) [2023-12-27 22:11:53,778][106226] Updated weights for policy 0, policy_version 412422 (0.0007) [2023-12-27 22:11:53,827][106225] Updated weights for policy 1, policy_version 413584 (0.0008) [2023-12-27 22:11:54,493][106225] Updated weights for policy 1, policy_version 413594 (0.0010) [2023-12-27 22:11:54,537][106226] Updated weights for policy 0, policy_version 412432 (0.0006) [2023-12-27 22:11:54,553][106225] Updated weights for policy 1, policy_version 413604 (0.0010) [2023-12-27 22:11:54,598][106226] Updated weights for policy 0, policy_version 412442 (0.0006) [2023-12-27 22:11:54,607][106225] Updated weights for policy 1, policy_version 413614 (0.0010) [2023-12-27 22:11:54,656][106226] Updated weights for policy 0, policy_version 412452 (0.0007) [2023-12-27 22:11:55,247][106225] Updated weights for policy 1, policy_version 413624 (0.0009) [2023-12-27 22:11:55,295][106225] Updated weights for policy 1, policy_version 413634 (0.0008) [2023-12-27 22:11:55,338][106225] Updated weights for policy 1, policy_version 413644 (0.0008) [2023-12-27 22:11:55,387][106226] Updated weights for policy 0, policy_version 412462 (0.0008) [2023-12-27 22:11:55,435][106226] Updated weights for policy 0, policy_version 412472 (0.0008) [2023-12-27 22:11:55,489][106226] Updated weights for policy 0, policy_version 412482 (0.0008) [2023-12-27 22:11:56,054][106225] Updated weights for policy 1, policy_version 413654 (0.0006) [2023-12-27 22:11:56,110][106225] Updated weights for policy 1, policy_version 413664 (0.0006) [2023-12-27 22:11:56,167][106225] Updated weights for policy 1, policy_version 413674 (0.0006) [2023-12-27 22:11:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19383.1). Total num frames: 211550208. Throughput: 0: 9656.4, 1: 9798.4. Samples: 211525312. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:11:56,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.686')] [2023-12-27 22:11:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000412488_105627648.pth... [2023-12-27 22:11:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000411368_105340928.pth [2023-12-27 22:11:56,197][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000413680_105930752.pth... [2023-12-27 22:11:56,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000412528_105635840.pth [2023-12-27 22:11:56,284][106226] Updated weights for policy 0, policy_version 412492 (0.0008) [2023-12-27 22:11:56,347][106226] Updated weights for policy 0, policy_version 412502 (0.0008) [2023-12-27 22:11:56,422][106226] Updated weights for policy 0, policy_version 412512 (0.0010) [2023-12-27 22:11:56,754][106225] Updated weights for policy 1, policy_version 413684 (0.0007) [2023-12-27 22:11:56,805][106225] Updated weights for policy 1, policy_version 413694 (0.0008) [2023-12-27 22:11:56,852][106225] Updated weights for policy 1, policy_version 413704 (0.0008) [2023-12-27 22:11:57,177][106226] Updated weights for policy 0, policy_version 412522 (0.0010) [2023-12-27 22:11:57,233][106226] Updated weights for policy 0, policy_version 412532 (0.0007) [2023-12-27 22:11:57,286][106226] Updated weights for policy 0, policy_version 412542 (0.0010) [2023-12-27 22:11:57,347][106226] Updated weights for policy 0, policy_version 412552 (0.0009) [2023-12-27 22:11:57,481][106225] Updated weights for policy 1, policy_version 413714 (0.0008) [2023-12-27 22:11:57,545][106225] Updated weights for policy 1, policy_version 413724 (0.0008) [2023-12-27 22:11:57,603][106225] Updated weights for policy 1, policy_version 413734 (0.0005) [2023-12-27 22:11:57,662][106225] Updated weights for policy 1, policy_version 413744 (0.0007) [2023-12-27 22:11:58,021][106226] Updated weights for policy 0, policy_version 412562 (0.0011) [2023-12-27 22:11:58,073][106226] Updated weights for policy 0, policy_version 412572 (0.0010) [2023-12-27 22:11:58,127][106226] Updated weights for policy 0, policy_version 412582 (0.0007) [2023-12-27 22:11:58,269][106225] Updated weights for policy 1, policy_version 413754 (0.0008) [2023-12-27 22:11:58,344][106225] Updated weights for policy 1, policy_version 413765 (0.0008) [2023-12-27 22:11:58,420][106225] Updated weights for policy 1, policy_version 413775 (0.0008) [2023-12-27 22:11:58,943][106226] Updated weights for policy 0, policy_version 412592 (0.0006) [2023-12-27 22:11:59,007][106226] Updated weights for policy 0, policy_version 412602 (0.0008) [2023-12-27 22:11:59,068][106226] Updated weights for policy 0, policy_version 412612 (0.0008) [2023-12-27 22:11:59,206][106225] Updated weights for policy 1, policy_version 413785 (0.0006) [2023-12-27 22:11:59,273][106225] Updated weights for policy 1, policy_version 413795 (0.0009) [2023-12-27 22:11:59,330][106225] Updated weights for policy 1, policy_version 413805 (0.0008) [2023-12-27 22:11:59,852][106226] Updated weights for policy 0, policy_version 412622 (0.0008) [2023-12-27 22:11:59,921][106226] Updated weights for policy 0, policy_version 412632 (0.0009) [2023-12-27 22:11:59,949][106225] Updated weights for policy 1, policy_version 413815 (0.0007) [2023-12-27 22:11:59,988][106226] Updated weights for policy 0, policy_version 412642 (0.0008) [2023-12-27 22:12:00,017][106225] Updated weights for policy 1, policy_version 413825 (0.0007) [2023-12-27 22:12:00,080][106225] Updated weights for policy 1, policy_version 413835 (0.0008) [2023-12-27 22:12:00,707][106226] Updated weights for policy 0, policy_version 412652 (0.0009) [2023-12-27 22:12:00,749][106225] Updated weights for policy 1, policy_version 413845 (0.0007) [2023-12-27 22:12:00,767][106226] Updated weights for policy 0, policy_version 412662 (0.0011) [2023-12-27 22:12:00,804][106225] Updated weights for policy 1, policy_version 413855 (0.0006) [2023-12-27 22:12:00,828][106226] Updated weights for policy 0, policy_version 412672 (0.0010) [2023-12-27 22:12:00,862][106225] Updated weights for policy 1, policy_version 413865 (0.0005) [2023-12-27 22:12:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 211656704. Throughput: 0: 9636.3, 1: 9905.0. Samples: 211643808. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:12:01,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-5.780')] [2023-12-27 22:12:01,525][106226] Updated weights for policy 0, policy_version 412682 (0.0010) [2023-12-27 22:12:01,574][106225] Updated weights for policy 1, policy_version 413875 (0.0008) [2023-12-27 22:12:01,592][106226] Updated weights for policy 0, policy_version 412692 (0.0006) [2023-12-27 22:12:01,641][106225] Updated weights for policy 1, policy_version 413885 (0.0009) [2023-12-27 22:12:01,655][106226] Updated weights for policy 0, policy_version 412702 (0.0012) [2023-12-27 22:12:01,696][106225] Updated weights for policy 1, policy_version 413895 (0.0006) [2023-12-27 22:12:01,710][106226] Updated weights for policy 0, policy_version 412712 (0.0007) [2023-12-27 22:12:02,426][106225] Updated weights for policy 1, policy_version 413905 (0.0009) [2023-12-27 22:12:02,426][106226] Updated weights for policy 0, policy_version 412722 (0.0008) [2023-12-27 22:12:02,482][106226] Updated weights for policy 0, policy_version 412732 (0.0006) [2023-12-27 22:12:02,485][106225] Updated weights for policy 1, policy_version 413915 (0.0008) [2023-12-27 22:12:02,542][106226] Updated weights for policy 0, policy_version 412742 (0.0008) [2023-12-27 22:12:02,548][106225] Updated weights for policy 1, policy_version 413925 (0.0008) [2023-12-27 22:12:02,599][106225] Updated weights for policy 1, policy_version 413935 (0.0008) [2023-12-27 22:12:03,259][106226] Updated weights for policy 0, policy_version 412752 (0.0006) [2023-12-27 22:12:03,297][106225] Updated weights for policy 1, policy_version 413945 (0.0007) [2023-12-27 22:12:03,312][106226] Updated weights for policy 0, policy_version 412762 (0.0005) [2023-12-27 22:12:03,349][106225] Updated weights for policy 1, policy_version 413955 (0.0006) [2023-12-27 22:12:03,363][106226] Updated weights for policy 0, policy_version 412772 (0.0007) [2023-12-27 22:12:03,395][106225] Updated weights for policy 1, policy_version 413965 (0.0005) [2023-12-27 22:12:03,998][106225] Updated weights for policy 1, policy_version 413975 (0.0008) [2023-12-27 22:12:04,058][106226] Updated weights for policy 0, policy_version 412782 (0.0008) [2023-12-27 22:12:04,068][106225] Updated weights for policy 1, policy_version 413985 (0.0008) [2023-12-27 22:12:04,124][106226] Updated weights for policy 0, policy_version 412792 (0.0006) [2023-12-27 22:12:04,143][106225] Updated weights for policy 1, policy_version 413995 (0.0007) [2023-12-27 22:12:04,180][106226] Updated weights for policy 0, policy_version 412802 (0.0007) [2023-12-27 22:12:04,845][106225] Updated weights for policy 1, policy_version 414005 (0.0009) [2023-12-27 22:12:04,885][106226] Updated weights for policy 0, policy_version 412812 (0.0008) [2023-12-27 22:12:04,894][106225] Updated weights for policy 1, policy_version 414015 (0.0007) [2023-12-27 22:12:04,943][106226] Updated weights for policy 0, policy_version 412822 (0.0006) [2023-12-27 22:12:04,945][106225] Updated weights for policy 1, policy_version 414025 (0.0006) [2023-12-27 22:12:04,987][106226] Updated weights for policy 0, policy_version 412832 (0.0005) [2023-12-27 22:12:05,663][106226] Updated weights for policy 0, policy_version 412842 (0.0007) [2023-12-27 22:12:05,668][106225] Updated weights for policy 1, policy_version 414035 (0.0006) [2023-12-27 22:12:05,714][106225] Updated weights for policy 1, policy_version 414045 (0.0007) [2023-12-27 22:12:05,737][106226] Updated weights for policy 0, policy_version 412852 (0.0008) [2023-12-27 22:12:05,769][106225] Updated weights for policy 1, policy_version 414055 (0.0005) [2023-12-27 22:12:05,811][106226] Updated weights for policy 0, policy_version 412862 (0.0009) [2023-12-27 22:12:05,860][106226] Updated weights for policy 0, policy_version 412872 (0.0008) [2023-12-27 22:12:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 211755008. Throughput: 0: 9705.0, 1: 9906.5. Samples: 211763236. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:12:06,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.265')] [2023-12-27 22:12:06,442][106225] Updated weights for policy 1, policy_version 414065 (0.0006) [2023-12-27 22:12:06,504][106225] Updated weights for policy 1, policy_version 414075 (0.0011) [2023-12-27 22:12:06,566][106225] Updated weights for policy 1, policy_version 414085 (0.0010) [2023-12-27 22:12:06,570][106226] Updated weights for policy 0, policy_version 412882 (0.0007) [2023-12-27 22:12:06,634][106225] Updated weights for policy 1, policy_version 414095 (0.0007) [2023-12-27 22:12:06,637][106226] Updated weights for policy 0, policy_version 412892 (0.0007) [2023-12-27 22:12:06,705][106226] Updated weights for policy 0, policy_version 412902 (0.0006) [2023-12-27 22:12:07,233][106225] Updated weights for policy 1, policy_version 414105 (0.0006) [2023-12-27 22:12:07,279][106225] Updated weights for policy 1, policy_version 414115 (0.0006) [2023-12-27 22:12:07,291][106226] Updated weights for policy 0, policy_version 412912 (0.0007) [2023-12-27 22:12:07,333][106225] Updated weights for policy 1, policy_version 414125 (0.0006) [2023-12-27 22:12:07,355][106226] Updated weights for policy 0, policy_version 412922 (0.0010) [2023-12-27 22:12:07,417][106226] Updated weights for policy 0, policy_version 412932 (0.0011) [2023-12-27 22:12:08,000][106225] Updated weights for policy 1, policy_version 414135 (0.0006) [2023-12-27 22:12:08,012][106226] Updated weights for policy 0, policy_version 412942 (0.0010) [2023-12-27 22:12:08,060][106225] Updated weights for policy 1, policy_version 414145 (0.0006) [2023-12-27 22:12:08,073][106226] Updated weights for policy 0, policy_version 412952 (0.0011) [2023-12-27 22:12:08,121][106225] Updated weights for policy 1, policy_version 414155 (0.0007) [2023-12-27 22:12:08,134][106226] Updated weights for policy 0, policy_version 412962 (0.0011) [2023-12-27 22:12:08,805][106225] Updated weights for policy 1, policy_version 414165 (0.0008) [2023-12-27 22:12:08,865][106225] Updated weights for policy 1, policy_version 414175 (0.0006) [2023-12-27 22:12:08,884][106226] Updated weights for policy 0, policy_version 412972 (0.0011) [2023-12-27 22:12:08,924][106225] Updated weights for policy 1, policy_version 414185 (0.0006) [2023-12-27 22:12:08,943][106226] Updated weights for policy 0, policy_version 412982 (0.0011) [2023-12-27 22:12:09,002][106226] Updated weights for policy 0, policy_version 412992 (0.0011) [2023-12-27 22:12:09,652][106225] Updated weights for policy 1, policy_version 414195 (0.0009) [2023-12-27 22:12:09,719][106226] Updated weights for policy 0, policy_version 413002 (0.0010) [2023-12-27 22:12:09,723][106225] Updated weights for policy 1, policy_version 414205 (0.0008) [2023-12-27 22:12:09,783][106226] Updated weights for policy 0, policy_version 413012 (0.0008) [2023-12-27 22:12:09,789][106225] Updated weights for policy 1, policy_version 414215 (0.0008) [2023-12-27 22:12:09,848][106226] Updated weights for policy 0, policy_version 413022 (0.0008) [2023-12-27 22:12:09,919][106226] Updated weights for policy 0, policy_version 413032 (0.0008) [2023-12-27 22:12:10,548][106225] Updated weights for policy 1, policy_version 414225 (0.0008) [2023-12-27 22:12:10,592][106226] Updated weights for policy 0, policy_version 413042 (0.0009) [2023-12-27 22:12:10,612][106225] Updated weights for policy 1, policy_version 414235 (0.0008) [2023-12-27 22:12:10,656][106226] Updated weights for policy 0, policy_version 413052 (0.0007) [2023-12-27 22:12:10,683][106225] Updated weights for policy 1, policy_version 414245 (0.0009) [2023-12-27 22:12:10,723][106226] Updated weights for policy 0, policy_version 413062 (0.0007) [2023-12-27 22:12:10,745][106225] Updated weights for policy 1, policy_version 414255 (0.0008) [2023-12-27 22:12:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 211853312. Throughput: 0: 9750.9, 1: 9965.2. Samples: 211825404. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:12:11,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-5.536')] [2023-12-27 22:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000414256_106078208.pth... [2023-12-27 22:12:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000413064_105775104.pth... [2023-12-27 22:12:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000411944_105488384.pth [2023-12-27 22:12:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000413104_105783296.pth [2023-12-27 22:12:11,446][106226] Updated weights for policy 0, policy_version 413072 (0.0008) [2023-12-27 22:12:11,507][106226] Updated weights for policy 0, policy_version 413082 (0.0008) [2023-12-27 22:12:11,531][106225] Updated weights for policy 1, policy_version 414265 (0.0008) [2023-12-27 22:12:11,567][106226] Updated weights for policy 0, policy_version 413092 (0.0007) [2023-12-27 22:12:11,594][106225] Updated weights for policy 1, policy_version 414275 (0.0008) [2023-12-27 22:12:11,663][106225] Updated weights for policy 1, policy_version 414285 (0.0009) [2023-12-27 22:12:12,328][106226] Updated weights for policy 0, policy_version 413102 (0.0009) [2023-12-27 22:12:12,404][106226] Updated weights for policy 0, policy_version 413112 (0.0010) [2023-12-27 22:12:12,423][106225] Updated weights for policy 1, policy_version 414295 (0.0009) [2023-12-27 22:12:12,456][106226] Updated weights for policy 0, policy_version 413122 (0.0011) [2023-12-27 22:12:12,484][106225] Updated weights for policy 1, policy_version 414305 (0.0006) [2023-12-27 22:12:12,541][106225] Updated weights for policy 1, policy_version 414315 (0.0007) [2023-12-27 22:12:13,189][106225] Updated weights for policy 1, policy_version 414325 (0.0008) [2023-12-27 22:12:13,240][106225] Updated weights for policy 1, policy_version 414335 (0.0006) [2023-12-27 22:12:13,247][106226] Updated weights for policy 0, policy_version 413132 (0.0010) [2023-12-27 22:12:13,291][106225] Updated weights for policy 1, policy_version 414345 (0.0005) [2023-12-27 22:12:13,300][106226] Updated weights for policy 0, policy_version 413142 (0.0009) [2023-12-27 22:12:13,350][106226] Updated weights for policy 0, policy_version 413152 (0.0009) [2023-12-27 22:12:13,972][106225] Updated weights for policy 1, policy_version 414355 (0.0006) [2023-12-27 22:12:14,026][106225] Updated weights for policy 1, policy_version 414365 (0.0008) [2023-12-27 22:12:14,082][106225] Updated weights for policy 1, policy_version 414375 (0.0008) [2023-12-27 22:12:14,095][106226] Updated weights for policy 0, policy_version 413162 (0.0007) [2023-12-27 22:12:14,147][106226] Updated weights for policy 0, policy_version 413172 (0.0005) [2023-12-27 22:12:14,199][106226] Updated weights for policy 0, policy_version 413182 (0.0006) [2023-12-27 22:12:14,248][106226] Updated weights for policy 0, policy_version 413192 (0.0008) [2023-12-27 22:12:14,820][106225] Updated weights for policy 1, policy_version 414385 (0.0008) [2023-12-27 22:12:14,883][106225] Updated weights for policy 1, policy_version 414395 (0.0006) [2023-12-27 22:12:14,946][106225] Updated weights for policy 1, policy_version 414405 (0.0008) [2023-12-27 22:12:14,968][106226] Updated weights for policy 0, policy_version 413202 (0.0009) [2023-12-27 22:12:15,015][106225] Updated weights for policy 1, policy_version 414415 (0.0010) [2023-12-27 22:12:15,033][106226] Updated weights for policy 0, policy_version 413212 (0.0008) [2023-12-27 22:12:15,105][106226] Updated weights for policy 0, policy_version 413222 (0.0009) [2023-12-27 22:12:15,621][106225] Updated weights for policy 1, policy_version 414425 (0.0005) [2023-12-27 22:12:15,683][106225] Updated weights for policy 1, policy_version 414435 (0.0005) [2023-12-27 22:12:15,744][106225] Updated weights for policy 1, policy_version 414445 (0.0009) [2023-12-27 22:12:15,863][106226] Updated weights for policy 0, policy_version 413232 (0.0008) [2023-12-27 22:12:15,920][106226] Updated weights for policy 0, policy_version 413242 (0.0008) [2023-12-27 22:12:15,986][106226] Updated weights for policy 0, policy_version 413252 (0.0007) [2023-12-27 22:12:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 211951616. Throughput: 0: 9631.4, 1: 9909.7. Samples: 211939500. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:12:16,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-5.474')] [2023-12-27 22:12:16,354][106225] Updated weights for policy 1, policy_version 414455 (0.0010) [2023-12-27 22:12:16,404][106225] Updated weights for policy 1, policy_version 414465 (0.0010) [2023-12-27 22:12:16,451][106225] Updated weights for policy 1, policy_version 414475 (0.0010) [2023-12-27 22:12:16,722][106226] Updated weights for policy 0, policy_version 413262 (0.0008) [2023-12-27 22:12:16,786][106226] Updated weights for policy 0, policy_version 413272 (0.0008) [2023-12-27 22:12:16,849][106226] Updated weights for policy 0, policy_version 413282 (0.0008) [2023-12-27 22:12:17,110][106225] Updated weights for policy 1, policy_version 414485 (0.0009) [2023-12-27 22:12:17,159][106225] Updated weights for policy 1, policy_version 414495 (0.0008) [2023-12-27 22:12:17,209][106225] Updated weights for policy 1, policy_version 414505 (0.0006) [2023-12-27 22:12:17,607][106226] Updated weights for policy 0, policy_version 413292 (0.0009) [2023-12-27 22:12:17,668][106226] Updated weights for policy 0, policy_version 413302 (0.0010) [2023-12-27 22:12:17,722][106226] Updated weights for policy 0, policy_version 413312 (0.0009) [2023-12-27 22:12:17,832][106225] Updated weights for policy 1, policy_version 414515 (0.0006) [2023-12-27 22:12:17,880][106225] Updated weights for policy 1, policy_version 414525 (0.0009) [2023-12-27 22:12:17,929][106225] Updated weights for policy 1, policy_version 414535 (0.0008) [2023-12-27 22:12:18,517][106226] Updated weights for policy 0, policy_version 413322 (0.0007) [2023-12-27 22:12:18,582][106226] Updated weights for policy 0, policy_version 413332 (0.0007) [2023-12-27 22:12:18,598][106225] Updated weights for policy 1, policy_version 414545 (0.0006) [2023-12-27 22:12:18,644][106226] Updated weights for policy 0, policy_version 413342 (0.0007) [2023-12-27 22:12:18,658][106225] Updated weights for policy 1, policy_version 414555 (0.0008) [2023-12-27 22:12:18,707][106226] Updated weights for policy 0, policy_version 413352 (0.0006) [2023-12-27 22:12:18,717][106225] Updated weights for policy 1, policy_version 414565 (0.0008) [2023-12-27 22:12:18,769][106225] Updated weights for policy 1, policy_version 414575 (0.0010) [2023-12-27 22:12:19,287][106226] Updated weights for policy 0, policy_version 413362 (0.0008) [2023-12-27 22:12:19,372][106226] Updated weights for policy 0, policy_version 413372 (0.0007) [2023-12-27 22:12:19,450][106226] Updated weights for policy 0, policy_version 413382 (0.0006) [2023-12-27 22:12:19,509][106225] Updated weights for policy 1, policy_version 414585 (0.0010) [2023-12-27 22:12:19,575][106225] Updated weights for policy 1, policy_version 414595 (0.0009) [2023-12-27 22:12:19,641][106225] Updated weights for policy 1, policy_version 414605 (0.0010) [2023-12-27 22:12:20,151][106226] Updated weights for policy 0, policy_version 413392 (0.0008) [2023-12-27 22:12:20,214][106226] Updated weights for policy 0, policy_version 413402 (0.0008) [2023-12-27 22:12:20,276][106226] Updated weights for policy 0, policy_version 413412 (0.0009) [2023-12-27 22:12:20,377][106225] Updated weights for policy 1, policy_version 414615 (0.0009) [2023-12-27 22:12:20,441][106225] Updated weights for policy 1, policy_version 414625 (0.0009) [2023-12-27 22:12:20,501][106225] Updated weights for policy 1, policy_version 414635 (0.0008) [2023-12-27 22:12:20,954][106226] Updated weights for policy 0, policy_version 413422 (0.0008) [2023-12-27 22:12:21,026][106226] Updated weights for policy 0, policy_version 413432 (0.0009) [2023-12-27 22:12:21,100][106226] Updated weights for policy 0, policy_version 413442 (0.0007) [2023-12-27 22:12:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 212049920. Throughput: 0: 9514.0, 1: 9997.2. Samples: 212057736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:21,175][105115] Avg episode reward: [(0, '-5.015'), (1, '-5.519')] [2023-12-27 22:12:21,323][106225] Updated weights for policy 1, policy_version 414645 (0.0009) [2023-12-27 22:12:21,393][106225] Updated weights for policy 1, policy_version 414655 (0.0011) [2023-12-27 22:12:21,459][106225] Updated weights for policy 1, policy_version 414665 (0.0010) [2023-12-27 22:12:21,825][106226] Updated weights for policy 0, policy_version 413452 (0.0007) [2023-12-27 22:12:21,889][106226] Updated weights for policy 0, policy_version 413462 (0.0008) [2023-12-27 22:12:21,945][106226] Updated weights for policy 0, policy_version 413472 (0.0006) [2023-12-27 22:12:22,222][106225] Updated weights for policy 1, policy_version 414675 (0.0009) [2023-12-27 22:12:22,289][106225] Updated weights for policy 1, policy_version 414685 (0.0008) [2023-12-27 22:12:22,347][106225] Updated weights for policy 1, policy_version 414695 (0.0009) [2023-12-27 22:12:22,712][106226] Updated weights for policy 0, policy_version 413482 (0.0009) [2023-12-27 22:12:22,771][106226] Updated weights for policy 0, policy_version 413492 (0.0006) [2023-12-27 22:12:22,839][106226] Updated weights for policy 0, policy_version 413502 (0.0009) [2023-12-27 22:12:22,897][106226] Updated weights for policy 0, policy_version 413512 (0.0009) [2023-12-27 22:12:23,045][106225] Updated weights for policy 1, policy_version 414705 (0.0008) [2023-12-27 22:12:23,101][106225] Updated weights for policy 1, policy_version 414715 (0.0008) [2023-12-27 22:12:23,159][106225] Updated weights for policy 1, policy_version 414725 (0.0008) [2023-12-27 22:12:23,211][106225] Updated weights for policy 1, policy_version 414735 (0.0008) [2023-12-27 22:12:23,653][106226] Updated weights for policy 0, policy_version 413522 (0.0008) [2023-12-27 22:12:23,712][106226] Updated weights for policy 0, policy_version 413532 (0.0008) [2023-12-27 22:12:23,766][106226] Updated weights for policy 0, policy_version 413542 (0.0010) [2023-12-27 22:12:23,902][106225] Updated weights for policy 1, policy_version 414745 (0.0006) [2023-12-27 22:12:23,954][106225] Updated weights for policy 1, policy_version 414755 (0.0008) [2023-12-27 22:12:24,006][106225] Updated weights for policy 1, policy_version 414765 (0.0008) [2023-12-27 22:12:24,488][106226] Updated weights for policy 0, policy_version 413552 (0.0010) [2023-12-27 22:12:24,541][106226] Updated weights for policy 0, policy_version 413562 (0.0010) [2023-12-27 22:12:24,597][106226] Updated weights for policy 0, policy_version 413572 (0.0010) [2023-12-27 22:12:24,739][106225] Updated weights for policy 1, policy_version 414775 (0.0008) [2023-12-27 22:12:24,798][106225] Updated weights for policy 1, policy_version 414785 (0.0009) [2023-12-27 22:12:24,864][106225] Updated weights for policy 1, policy_version 414795 (0.0008) [2023-12-27 22:12:25,278][106226] Updated weights for policy 0, policy_version 413582 (0.0010) [2023-12-27 22:12:25,337][106226] Updated weights for policy 0, policy_version 413592 (0.0010) [2023-12-27 22:12:25,396][106226] Updated weights for policy 0, policy_version 413602 (0.0010) [2023-12-27 22:12:25,597][106225] Updated weights for policy 1, policy_version 414805 (0.0007) [2023-12-27 22:12:25,650][106225] Updated weights for policy 1, policy_version 414815 (0.0007) [2023-12-27 22:12:25,699][106225] Updated weights for policy 1, policy_version 414825 (0.0007) [2023-12-27 22:12:26,142][106226] Updated weights for policy 0, policy_version 413612 (0.0010) [2023-12-27 22:12:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.8, 300 sec: 19383.1). Total num frames: 212140032. Throughput: 0: 9524.9, 1: 9908.8. Samples: 212113108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:26,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-5.256')] [2023-12-27 22:12:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000414832_106225664.pth... [2023-12-27 22:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000413680_105930752.pth [2023-12-27 22:12:26,204][106226] Updated weights for policy 0, policy_version 413622 (0.0009) [2023-12-27 22:12:26,263][106226] Updated weights for policy 0, policy_version 413632 (0.0009) [2023-12-27 22:12:26,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000413640_105922560.pth... [2023-12-27 22:12:26,318][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000412488_105627648.pth [2023-12-27 22:12:26,395][106225] Updated weights for policy 1, policy_version 414835 (0.0008) [2023-12-27 22:12:26,444][106225] Updated weights for policy 1, policy_version 414845 (0.0008) [2023-12-27 22:12:26,493][106225] Updated weights for policy 1, policy_version 414855 (0.0008) [2023-12-27 22:12:27,075][106226] Updated weights for policy 0, policy_version 413642 (0.0009) [2023-12-27 22:12:27,113][106225] Updated weights for policy 1, policy_version 414865 (0.0008) [2023-12-27 22:12:27,136][106226] Updated weights for policy 0, policy_version 413652 (0.0007) [2023-12-27 22:12:27,166][106225] Updated weights for policy 1, policy_version 414875 (0.0006) [2023-12-27 22:12:27,198][106226] Updated weights for policy 0, policy_version 413662 (0.0008) [2023-12-27 22:12:27,216][106225] Updated weights for policy 1, policy_version 414885 (0.0007) [2023-12-27 22:12:27,256][106226] Updated weights for policy 0, policy_version 413672 (0.0007) [2023-12-27 22:12:27,272][106225] Updated weights for policy 1, policy_version 414895 (0.0009) [2023-12-27 22:12:27,914][106226] Updated weights for policy 0, policy_version 413682 (0.0005) [2023-12-27 22:12:27,976][106226] Updated weights for policy 0, policy_version 413692 (0.0008) [2023-12-27 22:12:27,994][106225] Updated weights for policy 1, policy_version 414905 (0.0006) [2023-12-27 22:12:28,032][106226] Updated weights for policy 0, policy_version 413702 (0.0007) [2023-12-27 22:12:28,048][106225] Updated weights for policy 1, policy_version 414915 (0.0006) [2023-12-27 22:12:28,099][106225] Updated weights for policy 1, policy_version 414925 (0.0007) [2023-12-27 22:12:28,741][106226] Updated weights for policy 0, policy_version 413712 (0.0008) [2023-12-27 22:12:28,764][106225] Updated weights for policy 1, policy_version 414935 (0.0008) [2023-12-27 22:12:28,800][106226] Updated weights for policy 0, policy_version 413722 (0.0007) [2023-12-27 22:12:28,831][106225] Updated weights for policy 1, policy_version 414945 (0.0007) [2023-12-27 22:12:28,862][106226] Updated weights for policy 0, policy_version 413732 (0.0008) [2023-12-27 22:12:28,887][106225] Updated weights for policy 1, policy_version 414955 (0.0006) [2023-12-27 22:12:29,546][106225] Updated weights for policy 1, policy_version 414965 (0.0005) [2023-12-27 22:12:29,590][106226] Updated weights for policy 0, policy_version 413742 (0.0008) [2023-12-27 22:12:29,606][106225] Updated weights for policy 1, policy_version 414975 (0.0008) [2023-12-27 22:12:29,651][106226] Updated weights for policy 0, policy_version 413752 (0.0009) [2023-12-27 22:12:29,668][106225] Updated weights for policy 1, policy_version 414985 (0.0010) [2023-12-27 22:12:29,713][106226] Updated weights for policy 0, policy_version 413762 (0.0007) [2023-12-27 22:12:30,316][106225] Updated weights for policy 1, policy_version 414995 (0.0005) [2023-12-27 22:12:30,378][106225] Updated weights for policy 1, policy_version 415005 (0.0006) [2023-12-27 22:12:30,421][106226] Updated weights for policy 0, policy_version 413772 (0.0007) [2023-12-27 22:12:30,445][106225] Updated weights for policy 1, policy_version 415015 (0.0005) [2023-12-27 22:12:30,478][106226] Updated weights for policy 0, policy_version 413782 (0.0008) [2023-12-27 22:12:30,536][106226] Updated weights for policy 0, policy_version 413792 (0.0007) [2023-12-27 22:12:31,019][106225] Updated weights for policy 1, policy_version 415025 (0.0006) [2023-12-27 22:12:31,080][106225] Updated weights for policy 1, policy_version 415035 (0.0010) [2023-12-27 22:12:31,149][106225] Updated weights for policy 1, policy_version 415045 (0.0009) [2023-12-27 22:12:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19383.1). Total num frames: 212238336. Throughput: 0: 9588.3, 1: 9967.4. Samples: 212232392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:31,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.974')] [2023-12-27 22:12:31,211][106225] Updated weights for policy 1, policy_version 415055 (0.0007) [2023-12-27 22:12:31,272][106226] Updated weights for policy 0, policy_version 413802 (0.0006) [2023-12-27 22:12:31,337][106226] Updated weights for policy 0, policy_version 413812 (0.0008) [2023-12-27 22:12:31,404][106226] Updated weights for policy 0, policy_version 413822 (0.0008) [2023-12-27 22:12:31,465][106226] Updated weights for policy 0, policy_version 413832 (0.0006) [2023-12-27 22:12:31,955][106225] Updated weights for policy 1, policy_version 415065 (0.0009) [2023-12-27 22:12:32,018][106225] Updated weights for policy 1, policy_version 415075 (0.0010) [2023-12-27 22:12:32,082][106225] Updated weights for policy 1, policy_version 415085 (0.0010) [2023-12-27 22:12:32,139][106226] Updated weights for policy 0, policy_version 413842 (0.0011) [2023-12-27 22:12:32,204][106226] Updated weights for policy 0, policy_version 413852 (0.0011) [2023-12-27 22:12:32,265][106226] Updated weights for policy 0, policy_version 413862 (0.0009) [2023-12-27 22:12:32,786][106225] Updated weights for policy 1, policy_version 415095 (0.0009) [2023-12-27 22:12:32,842][106225] Updated weights for policy 1, policy_version 415105 (0.0010) [2023-12-27 22:12:32,892][106225] Updated weights for policy 1, policy_version 415115 (0.0010) [2023-12-27 22:12:33,016][106226] Updated weights for policy 0, policy_version 413872 (0.0006) [2023-12-27 22:12:33,067][106226] Updated weights for policy 0, policy_version 413882 (0.0005) [2023-12-27 22:12:33,114][106226] Updated weights for policy 0, policy_version 413892 (0.0007) [2023-12-27 22:12:33,634][106225] Updated weights for policy 1, policy_version 415125 (0.0010) [2023-12-27 22:12:33,678][106226] Updated weights for policy 0, policy_version 413902 (0.0007) [2023-12-27 22:12:33,690][106225] Updated weights for policy 1, policy_version 415135 (0.0010) [2023-12-27 22:12:33,737][106226] Updated weights for policy 0, policy_version 413912 (0.0008) [2023-12-27 22:12:33,743][106225] Updated weights for policy 1, policy_version 415145 (0.0010) [2023-12-27 22:12:33,796][106226] Updated weights for policy 0, policy_version 413922 (0.0010) [2023-12-27 22:12:34,451][106225] Updated weights for policy 1, policy_version 415155 (0.0009) [2023-12-27 22:12:34,460][106226] Updated weights for policy 0, policy_version 413932 (0.0009) [2023-12-27 22:12:34,519][106225] Updated weights for policy 1, policy_version 415165 (0.0007) [2023-12-27 22:12:34,521][106226] Updated weights for policy 0, policy_version 413942 (0.0007) [2023-12-27 22:12:34,578][106226] Updated weights for policy 0, policy_version 413952 (0.0007) [2023-12-27 22:12:34,585][106225] Updated weights for policy 1, policy_version 415175 (0.0007) [2023-12-27 22:12:35,155][106225] Updated weights for policy 1, policy_version 415185 (0.0007) [2023-12-27 22:12:35,212][106225] Updated weights for policy 1, policy_version 415195 (0.0009) [2023-12-27 22:12:35,265][106225] Updated weights for policy 1, policy_version 415205 (0.0008) [2023-12-27 22:12:35,319][106225] Updated weights for policy 1, policy_version 415215 (0.0008) [2023-12-27 22:12:35,358][106226] Updated weights for policy 0, policy_version 413962 (0.0007) [2023-12-27 22:12:35,408][106226] Updated weights for policy 0, policy_version 413972 (0.0009) [2023-12-27 22:12:35,456][106226] Updated weights for policy 0, policy_version 413982 (0.0008) [2023-12-27 22:12:35,509][106226] Updated weights for policy 0, policy_version 413992 (0.0007) [2023-12-27 22:12:35,968][106225] Updated weights for policy 1, policy_version 415225 (0.0006) [2023-12-27 22:12:36,034][106225] Updated weights for policy 1, policy_version 415235 (0.0005) [2023-12-27 22:12:36,082][106225] Updated weights for policy 1, policy_version 415245 (0.0008) [2023-12-27 22:12:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19438.6). Total num frames: 212344832. Throughput: 0: 9619.8, 1: 10037.0. Samples: 212353008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:36,175][105115] Avg episode reward: [(0, '-4.983'), (1, '-5.756')] [2023-12-27 22:12:36,234][106226] Updated weights for policy 0, policy_version 414002 (0.0008) [2023-12-27 22:12:36,297][106226] Updated weights for policy 0, policy_version 414012 (0.0007) [2023-12-27 22:12:36,359][106226] Updated weights for policy 0, policy_version 414022 (0.0008) [2023-12-27 22:12:36,704][106225] Updated weights for policy 1, policy_version 415255 (0.0009) [2023-12-27 22:12:36,764][106225] Updated weights for policy 1, policy_version 415265 (0.0009) [2023-12-27 22:12:36,825][106225] Updated weights for policy 1, policy_version 415275 (0.0008) [2023-12-27 22:12:37,108][106226] Updated weights for policy 0, policy_version 414032 (0.0008) [2023-12-27 22:12:37,164][106226] Updated weights for policy 0, policy_version 414042 (0.0009) [2023-12-27 22:12:37,224][106226] Updated weights for policy 0, policy_version 414052 (0.0009) [2023-12-27 22:12:37,535][106225] Updated weights for policy 1, policy_version 415285 (0.0009) [2023-12-27 22:12:37,597][106225] Updated weights for policy 1, policy_version 415295 (0.0008) [2023-12-27 22:12:37,661][106225] Updated weights for policy 1, policy_version 415305 (0.0008) [2023-12-27 22:12:37,971][106226] Updated weights for policy 0, policy_version 414062 (0.0009) [2023-12-27 22:12:38,038][106226] Updated weights for policy 0, policy_version 414072 (0.0008) [2023-12-27 22:12:38,105][106226] Updated weights for policy 0, policy_version 414082 (0.0008) [2023-12-27 22:12:38,397][106225] Updated weights for policy 1, policy_version 415315 (0.0009) [2023-12-27 22:12:38,466][106225] Updated weights for policy 1, policy_version 415325 (0.0008) [2023-12-27 22:12:38,526][106225] Updated weights for policy 1, policy_version 415335 (0.0006) [2023-12-27 22:12:38,857][106226] Updated weights for policy 0, policy_version 414092 (0.0009) [2023-12-27 22:12:38,920][106226] Updated weights for policy 0, policy_version 414102 (0.0009) [2023-12-27 22:12:38,980][106226] Updated weights for policy 0, policy_version 414112 (0.0009) [2023-12-27 22:12:39,257][106225] Updated weights for policy 1, policy_version 415345 (0.0008) [2023-12-27 22:12:39,307][106225] Updated weights for policy 1, policy_version 415355 (0.0009) [2023-12-27 22:12:39,378][106225] Updated weights for policy 1, policy_version 415365 (0.0009) [2023-12-27 22:12:39,463][106225] Updated weights for policy 1, policy_version 415376 (0.0009) [2023-12-27 22:12:39,816][106226] Updated weights for policy 0, policy_version 414122 (0.0009) [2023-12-27 22:12:39,885][106226] Updated weights for policy 0, policy_version 414132 (0.0007) [2023-12-27 22:12:39,951][106226] Updated weights for policy 0, policy_version 414142 (0.0009) [2023-12-27 22:12:40,014][106226] Updated weights for policy 0, policy_version 414152 (0.0008) [2023-12-27 22:12:40,276][106225] Updated weights for policy 1, policy_version 415386 (0.0011) [2023-12-27 22:12:40,340][106225] Updated weights for policy 1, policy_version 415396 (0.0011) [2023-12-27 22:12:40,408][106225] Updated weights for policy 1, policy_version 415406 (0.0011) [2023-12-27 22:12:40,751][106226] Updated weights for policy 0, policy_version 414162 (0.0006) [2023-12-27 22:12:40,815][106226] Updated weights for policy 0, policy_version 414172 (0.0011) [2023-12-27 22:12:40,882][106226] Updated weights for policy 0, policy_version 414182 (0.0010) [2023-12-27 22:12:41,115][106225] Updated weights for policy 1, policy_version 415416 (0.0009) [2023-12-27 22:12:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 212434944. Throughput: 0: 9605.9, 1: 10060.7. Samples: 212410308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:41,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-5.884')] [2023-12-27 22:12:41,181][106225] Updated weights for policy 1, policy_version 415426 (0.0008) [2023-12-27 22:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000414184_106061824.pth... [2023-12-27 22:12:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000413064_105775104.pth [2023-12-27 22:12:41,241][106225] Updated weights for policy 1, policy_version 415436 (0.0008) [2023-12-27 22:12:41,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000415440_106381312.pth... [2023-12-27 22:12:41,271][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000414256_106078208.pth [2023-12-27 22:12:41,689][106226] Updated weights for policy 0, policy_version 414192 (0.0011) [2023-12-27 22:12:41,762][106226] Updated weights for policy 0, policy_version 414202 (0.0009) [2023-12-27 22:12:41,824][106226] Updated weights for policy 0, policy_version 414212 (0.0010) [2023-12-27 22:12:42,038][106225] Updated weights for policy 1, policy_version 415446 (0.0009) [2023-12-27 22:12:42,100][106225] Updated weights for policy 1, policy_version 415456 (0.0006) [2023-12-27 22:12:42,167][106225] Updated weights for policy 1, policy_version 415466 (0.0006) [2023-12-27 22:12:42,502][106226] Updated weights for policy 0, policy_version 414222 (0.0008) [2023-12-27 22:12:42,560][106226] Updated weights for policy 0, policy_version 414232 (0.0007) [2023-12-27 22:12:42,624][106226] Updated weights for policy 0, policy_version 414242 (0.0006) [2023-12-27 22:12:42,854][106225] Updated weights for policy 1, policy_version 415476 (0.0007) [2023-12-27 22:12:42,913][106225] Updated weights for policy 1, policy_version 415486 (0.0010) [2023-12-27 22:12:42,967][106225] Updated weights for policy 1, policy_version 415496 (0.0005) [2023-12-27 22:12:43,339][106226] Updated weights for policy 0, policy_version 414252 (0.0007) [2023-12-27 22:12:43,389][106226] Updated weights for policy 0, policy_version 414262 (0.0008) [2023-12-27 22:12:43,439][106226] Updated weights for policy 0, policy_version 414272 (0.0007) [2023-12-27 22:12:43,513][106225] Updated weights for policy 1, policy_version 415506 (0.0006) [2023-12-27 22:12:43,576][106225] Updated weights for policy 1, policy_version 415516 (0.0010) [2023-12-27 22:12:43,644][106225] Updated weights for policy 1, policy_version 415526 (0.0010) [2023-12-27 22:12:43,712][106225] Updated weights for policy 1, policy_version 415536 (0.0010) [2023-12-27 22:12:44,080][106226] Updated weights for policy 0, policy_version 414282 (0.0006) [2023-12-27 22:12:44,139][106226] Updated weights for policy 0, policy_version 414292 (0.0008) [2023-12-27 22:12:44,195][106226] Updated weights for policy 0, policy_version 414302 (0.0008) [2023-12-27 22:12:44,252][106226] Updated weights for policy 0, policy_version 414312 (0.0008) [2023-12-27 22:12:44,380][106225] Updated weights for policy 1, policy_version 415546 (0.0010) [2023-12-27 22:12:44,428][106225] Updated weights for policy 1, policy_version 415556 (0.0010) [2023-12-27 22:12:44,486][106225] Updated weights for policy 1, policy_version 415566 (0.0010) [2023-12-27 22:12:44,993][106226] Updated weights for policy 0, policy_version 414322 (0.0007) [2023-12-27 22:12:45,055][106226] Updated weights for policy 0, policy_version 414332 (0.0008) [2023-12-27 22:12:45,127][106226] Updated weights for policy 0, policy_version 414342 (0.0006) [2023-12-27 22:12:45,202][106225] Updated weights for policy 1, policy_version 415576 (0.0010) [2023-12-27 22:12:45,270][106225] Updated weights for policy 1, policy_version 415586 (0.0006) [2023-12-27 22:12:45,333][106225] Updated weights for policy 1, policy_version 415596 (0.0008) [2023-12-27 22:12:45,822][106226] Updated weights for policy 0, policy_version 414352 (0.0007) [2023-12-27 22:12:45,873][106226] Updated weights for policy 0, policy_version 414362 (0.0005) [2023-12-27 22:12:45,927][106226] Updated weights for policy 0, policy_version 414372 (0.0005) [2023-12-27 22:12:46,023][106225] Updated weights for policy 1, policy_version 415606 (0.0006) [2023-12-27 22:12:46,084][106225] Updated weights for policy 1, policy_version 415616 (0.0007) [2023-12-27 22:12:46,137][106225] Updated weights for policy 1, policy_version 415626 (0.0008) [2023-12-27 22:12:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19438.6). Total num frames: 212541440. Throughput: 0: 9627.8, 1: 9946.4. Samples: 212524648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:46,175][105115] Avg episode reward: [(0, '-5.076'), (1, '-5.593')] [2023-12-27 22:12:46,617][106226] Updated weights for policy 0, policy_version 414382 (0.0005) [2023-12-27 22:12:46,679][106226] Updated weights for policy 0, policy_version 414392 (0.0005) [2023-12-27 22:12:46,743][106226] Updated weights for policy 0, policy_version 414402 (0.0005) [2023-12-27 22:12:46,801][106225] Updated weights for policy 1, policy_version 415636 (0.0008) [2023-12-27 22:12:46,857][106225] Updated weights for policy 1, policy_version 415646 (0.0014) [2023-12-27 22:12:46,916][106225] Updated weights for policy 1, policy_version 415657 (0.0009) [2023-12-27 22:12:47,292][106226] Updated weights for policy 0, policy_version 414412 (0.0007) [2023-12-27 22:12:47,346][106226] Updated weights for policy 0, policy_version 414422 (0.0010) [2023-12-27 22:12:47,404][106226] Updated weights for policy 0, policy_version 414432 (0.0009) [2023-12-27 22:12:47,659][106225] Updated weights for policy 1, policy_version 415667 (0.0009) [2023-12-27 22:12:47,714][106225] Updated weights for policy 1, policy_version 415677 (0.0008) [2023-12-27 22:12:47,772][106225] Updated weights for policy 1, policy_version 415687 (0.0010) [2023-12-27 22:12:48,107][106226] Updated weights for policy 0, policy_version 414442 (0.0010) [2023-12-27 22:12:48,160][106226] Updated weights for policy 0, policy_version 414452 (0.0008) [2023-12-27 22:12:48,208][106226] Updated weights for policy 0, policy_version 414462 (0.0008) [2023-12-27 22:12:48,259][106226] Updated weights for policy 0, policy_version 414472 (0.0007) [2023-12-27 22:12:48,436][106225] Updated weights for policy 1, policy_version 415697 (0.0010) [2023-12-27 22:12:48,490][106225] Updated weights for policy 1, policy_version 415707 (0.0010) [2023-12-27 22:12:48,545][106225] Updated weights for policy 1, policy_version 415717 (0.0010) [2023-12-27 22:12:48,600][106225] Updated weights for policy 1, policy_version 415727 (0.0010) [2023-12-27 22:12:49,057][106226] Updated weights for policy 0, policy_version 414482 (0.0008) [2023-12-27 22:12:49,114][106226] Updated weights for policy 0, policy_version 414492 (0.0008) [2023-12-27 22:12:49,175][106226] Updated weights for policy 0, policy_version 414502 (0.0008) [2023-12-27 22:12:49,403][106225] Updated weights for policy 1, policy_version 415737 (0.0010) [2023-12-27 22:12:49,478][106225] Updated weights for policy 1, policy_version 415747 (0.0011) [2023-12-27 22:12:49,542][106225] Updated weights for policy 1, policy_version 415757 (0.0010) [2023-12-27 22:12:49,995][106226] Updated weights for policy 0, policy_version 414512 (0.0009) [2023-12-27 22:12:50,072][106226] Updated weights for policy 0, policy_version 414522 (0.0011) [2023-12-27 22:12:50,146][106226] Updated weights for policy 0, policy_version 414532 (0.0011) [2023-12-27 22:12:50,325][106225] Updated weights for policy 1, policy_version 415767 (0.0009) [2023-12-27 22:12:50,391][106225] Updated weights for policy 1, policy_version 415777 (0.0008) [2023-12-27 22:12:50,461][106225] Updated weights for policy 1, policy_version 415787 (0.0008) [2023-12-27 22:12:50,795][106226] Updated weights for policy 0, policy_version 414542 (0.0011) [2023-12-27 22:12:50,866][106226] Updated weights for policy 0, policy_version 414552 (0.0011) [2023-12-27 22:12:50,930][106226] Updated weights for policy 0, policy_version 414562 (0.0011) [2023-12-27 22:12:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 212631552. Throughput: 0: 9626.5, 1: 9904.8. Samples: 212642144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:51,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-5.728')] [2023-12-27 22:12:51,228][106225] Updated weights for policy 1, policy_version 415797 (0.0008) [2023-12-27 22:12:51,291][106225] Updated weights for policy 1, policy_version 415807 (0.0008) [2023-12-27 22:12:51,346][106225] Updated weights for policy 1, policy_version 415817 (0.0008) [2023-12-27 22:12:51,644][106226] Updated weights for policy 0, policy_version 414572 (0.0010) [2023-12-27 22:12:51,698][106226] Updated weights for policy 0, policy_version 414582 (0.0007) [2023-12-27 22:12:51,763][106226] Updated weights for policy 0, policy_version 414592 (0.0007) [2023-12-27 22:12:52,086][106225] Updated weights for policy 1, policy_version 415827 (0.0009) [2023-12-27 22:12:52,151][106225] Updated weights for policy 1, policy_version 415837 (0.0011) [2023-12-27 22:12:52,217][106225] Updated weights for policy 1, policy_version 415847 (0.0007) [2023-12-27 22:12:52,463][106226] Updated weights for policy 0, policy_version 414602 (0.0007) [2023-12-27 22:12:52,517][106226] Updated weights for policy 0, policy_version 414612 (0.0007) [2023-12-27 22:12:52,571][106226] Updated weights for policy 0, policy_version 414622 (0.0008) [2023-12-27 22:12:52,630][106226] Updated weights for policy 0, policy_version 414632 (0.0008) [2023-12-27 22:12:52,883][106225] Updated weights for policy 1, policy_version 415857 (0.0008) [2023-12-27 22:12:52,947][106225] Updated weights for policy 1, policy_version 415867 (0.0010) [2023-12-27 22:12:53,004][106225] Updated weights for policy 1, policy_version 415877 (0.0010) [2023-12-27 22:12:53,073][106225] Updated weights for policy 1, policy_version 415887 (0.0011) [2023-12-27 22:12:53,372][106226] Updated weights for policy 0, policy_version 414642 (0.0007) [2023-12-27 22:12:53,427][106226] Updated weights for policy 0, policy_version 414652 (0.0007) [2023-12-27 22:12:53,485][106226] Updated weights for policy 0, policy_version 414662 (0.0008) [2023-12-27 22:12:53,790][106225] Updated weights for policy 1, policy_version 415897 (0.0010) [2023-12-27 22:12:53,852][106225] Updated weights for policy 1, policy_version 415907 (0.0010) [2023-12-27 22:12:53,902][106225] Updated weights for policy 1, policy_version 415917 (0.0010) [2023-12-27 22:12:54,170][106226] Updated weights for policy 0, policy_version 414672 (0.0010) [2023-12-27 22:12:54,234][106226] Updated weights for policy 0, policy_version 414682 (0.0010) [2023-12-27 22:12:54,305][106226] Updated weights for policy 0, policy_version 414692 (0.0008) [2023-12-27 22:12:54,569][106225] Updated weights for policy 1, policy_version 415927 (0.0007) [2023-12-27 22:12:54,630][106225] Updated weights for policy 1, policy_version 415937 (0.0005) [2023-12-27 22:12:54,688][106225] Updated weights for policy 1, policy_version 415947 (0.0006) [2023-12-27 22:12:55,000][106226] Updated weights for policy 0, policy_version 414702 (0.0011) [2023-12-27 22:12:55,061][106226] Updated weights for policy 0, policy_version 414712 (0.0011) [2023-12-27 22:12:55,125][106226] Updated weights for policy 0, policy_version 414722 (0.0011) [2023-12-27 22:12:55,287][106225] Updated weights for policy 1, policy_version 415957 (0.0006) [2023-12-27 22:12:55,344][106225] Updated weights for policy 1, policy_version 415967 (0.0005) [2023-12-27 22:12:55,405][106225] Updated weights for policy 1, policy_version 415977 (0.0005) [2023-12-27 22:12:55,785][106226] Updated weights for policy 0, policy_version 414732 (0.0008) [2023-12-27 22:12:55,842][106226] Updated weights for policy 0, policy_version 414742 (0.0005) [2023-12-27 22:12:55,903][106226] Updated weights for policy 0, policy_version 414752 (0.0005) [2023-12-27 22:12:55,976][106225] Updated weights for policy 1, policy_version 415987 (0.0006) [2023-12-27 22:12:56,023][106225] Updated weights for policy 1, policy_version 415997 (0.0008) [2023-12-27 22:12:56,084][106225] Updated weights for policy 1, policy_version 416007 (0.0007) [2023-12-27 22:12:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19466.4). Total num frames: 212738048. Throughput: 0: 9594.2, 1: 9842.3. Samples: 212700048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:12:56,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-5.233')] [2023-12-27 22:12:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000416016_106528768.pth... [2023-12-27 22:12:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000414760_106209280.pth... [2023-12-27 22:12:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000414832_106225664.pth [2023-12-27 22:12:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000413640_105922560.pth [2023-12-27 22:12:56,549][106226] Updated weights for policy 0, policy_version 414762 (0.0009) [2023-12-27 22:12:56,610][106226] Updated weights for policy 0, policy_version 414772 (0.0007) [2023-12-27 22:12:56,672][106226] Updated weights for policy 0, policy_version 414782 (0.0008) [2023-12-27 22:12:56,737][106226] Updated weights for policy 0, policy_version 414792 (0.0008) [2023-12-27 22:12:56,840][106225] Updated weights for policy 1, policy_version 416017 (0.0009) [2023-12-27 22:12:56,897][106225] Updated weights for policy 1, policy_version 416027 (0.0009) [2023-12-27 22:12:56,954][106225] Updated weights for policy 1, policy_version 416037 (0.0008) [2023-12-27 22:12:57,008][106225] Updated weights for policy 1, policy_version 416047 (0.0008) [2023-12-27 22:12:57,397][106226] Updated weights for policy 0, policy_version 414802 (0.0007) [2023-12-27 22:12:57,453][106226] Updated weights for policy 0, policy_version 414812 (0.0008) [2023-12-27 22:12:57,511][106226] Updated weights for policy 0, policy_version 414822 (0.0009) [2023-12-27 22:12:57,734][106225] Updated weights for policy 1, policy_version 416057 (0.0005) [2023-12-27 22:12:57,789][106225] Updated weights for policy 1, policy_version 416067 (0.0005) [2023-12-27 22:12:57,833][106225] Updated weights for policy 1, policy_version 416077 (0.0005) [2023-12-27 22:12:58,293][106226] Updated weights for policy 0, policy_version 414832 (0.0008) [2023-12-27 22:12:58,365][106226] Updated weights for policy 0, policy_version 414842 (0.0008) [2023-12-27 22:12:58,431][106226] Updated weights for policy 0, policy_version 414852 (0.0009) [2023-12-27 22:12:58,445][106225] Updated weights for policy 1, policy_version 416087 (0.0007) [2023-12-27 22:12:58,509][106225] Updated weights for policy 1, policy_version 416097 (0.0009) [2023-12-27 22:12:58,578][106225] Updated weights for policy 1, policy_version 416107 (0.0009) [2023-12-27 22:12:59,240][106226] Updated weights for policy 0, policy_version 414862 (0.0007) [2023-12-27 22:12:59,302][106226] Updated weights for policy 0, policy_version 414872 (0.0008) [2023-12-27 22:12:59,364][106226] Updated weights for policy 0, policy_version 414882 (0.0009) [2023-12-27 22:12:59,453][106225] Updated weights for policy 1, policy_version 416117 (0.0008) [2023-12-27 22:12:59,509][106225] Updated weights for policy 1, policy_version 416127 (0.0005) [2023-12-27 22:12:59,565][106225] Updated weights for policy 1, policy_version 416137 (0.0005) [2023-12-27 22:13:00,120][106226] Updated weights for policy 0, policy_version 414892 (0.0008) [2023-12-27 22:13:00,169][106226] Updated weights for policy 0, policy_version 414902 (0.0008) [2023-12-27 22:13:00,213][106225] Updated weights for policy 1, policy_version 416147 (0.0007) [2023-12-27 22:13:00,223][106226] Updated weights for policy 0, policy_version 414912 (0.0007) [2023-12-27 22:13:00,269][106225] Updated weights for policy 1, policy_version 416157 (0.0006) [2023-12-27 22:13:00,330][106225] Updated weights for policy 1, policy_version 416167 (0.0008) [2023-12-27 22:13:00,951][106226] Updated weights for policy 0, policy_version 414922 (0.0006) [2023-12-27 22:13:01,009][106226] Updated weights for policy 0, policy_version 414932 (0.0006) [2023-12-27 22:13:01,063][106225] Updated weights for policy 1, policy_version 416177 (0.0008) [2023-12-27 22:13:01,075][106226] Updated weights for policy 0, policy_version 414942 (0.0008) [2023-12-27 22:13:01,124][106225] Updated weights for policy 1, policy_version 416187 (0.0008) [2023-12-27 22:13:01,139][106226] Updated weights for policy 0, policy_version 414952 (0.0008) [2023-12-27 22:13:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 212828160. Throughput: 0: 9599.0, 1: 9922.4. Samples: 212817968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:01,176][105115] Avg episode reward: [(0, '-5.005'), (1, '-5.637')] [2023-12-27 22:13:01,192][106225] Updated weights for policy 1, policy_version 416197 (0.0007) [2023-12-27 22:13:01,256][106225] Updated weights for policy 1, policy_version 416207 (0.0008) [2023-12-27 22:13:01,911][106226] Updated weights for policy 0, policy_version 414962 (0.0011) [2023-12-27 22:13:01,972][106226] Updated weights for policy 0, policy_version 414972 (0.0011) [2023-12-27 22:13:01,989][106225] Updated weights for policy 1, policy_version 416217 (0.0006) [2023-12-27 22:13:02,031][106226] Updated weights for policy 0, policy_version 414982 (0.0011) [2023-12-27 22:13:02,041][106225] Updated weights for policy 1, policy_version 416227 (0.0005) [2023-12-27 22:13:02,101][106225] Updated weights for policy 1, policy_version 416237 (0.0007) [2023-12-27 22:13:02,771][106226] Updated weights for policy 0, policy_version 414992 (0.0011) [2023-12-27 22:13:02,797][106225] Updated weights for policy 1, policy_version 416247 (0.0006) [2023-12-27 22:13:02,825][106226] Updated weights for policy 0, policy_version 415002 (0.0008) [2023-12-27 22:13:02,861][106225] Updated weights for policy 1, policy_version 416257 (0.0005) [2023-12-27 22:13:02,882][106226] Updated weights for policy 0, policy_version 415012 (0.0011) [2023-12-27 22:13:02,922][106225] Updated weights for policy 1, policy_version 416267 (0.0006) [2023-12-27 22:13:03,564][106226] Updated weights for policy 0, policy_version 415022 (0.0009) [2023-12-27 22:13:03,625][106226] Updated weights for policy 0, policy_version 415032 (0.0008) [2023-12-27 22:13:03,631][106225] Updated weights for policy 1, policy_version 416277 (0.0005) [2023-12-27 22:13:03,685][106225] Updated weights for policy 1, policy_version 416287 (0.0006) [2023-12-27 22:13:03,687][106226] Updated weights for policy 0, policy_version 415042 (0.0008) [2023-12-27 22:13:03,736][106225] Updated weights for policy 1, policy_version 416297 (0.0007) [2023-12-27 22:13:04,431][106225] Updated weights for policy 1, policy_version 416307 (0.0008) [2023-12-27 22:13:04,434][106226] Updated weights for policy 0, policy_version 415052 (0.0007) [2023-12-27 22:13:04,489][106225] Updated weights for policy 1, policy_version 416317 (0.0006) [2023-12-27 22:13:04,512][106226] Updated weights for policy 0, policy_version 415062 (0.0007) [2023-12-27 22:13:04,549][106225] Updated weights for policy 1, policy_version 416327 (0.0007) [2023-12-27 22:13:04,581][106226] Updated weights for policy 0, policy_version 415072 (0.0007) [2023-12-27 22:13:05,163][106225] Updated weights for policy 1, policy_version 416337 (0.0008) [2023-12-27 22:13:05,224][106225] Updated weights for policy 1, policy_version 416347 (0.0008) [2023-12-27 22:13:05,271][106226] Updated weights for policy 0, policy_version 415082 (0.0007) [2023-12-27 22:13:05,283][106225] Updated weights for policy 1, policy_version 416357 (0.0008) [2023-12-27 22:13:05,333][106225] Updated weights for policy 1, policy_version 416367 (0.0008) [2023-12-27 22:13:05,336][106226] Updated weights for policy 0, policy_version 415092 (0.0005) [2023-12-27 22:13:05,393][106226] Updated weights for policy 0, policy_version 415102 (0.0007) [2023-12-27 22:13:05,445][106226] Updated weights for policy 0, policy_version 415112 (0.0005) [2023-12-27 22:13:06,050][106226] Updated weights for policy 0, policy_version 415122 (0.0009) [2023-12-27 22:13:06,090][106225] Updated weights for policy 1, policy_version 416377 (0.0006) [2023-12-27 22:13:06,111][106226] Updated weights for policy 0, policy_version 415132 (0.0008) [2023-12-27 22:13:06,156][106225] Updated weights for policy 1, policy_version 416387 (0.0007) [2023-12-27 22:13:06,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19387.8, 300 sec: 19383.1). Total num frames: 212918272. Throughput: 0: 9639.9, 1: 9871.5. Samples: 212935748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:06,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-5.619')] [2023-12-27 22:13:06,176][106226] Updated weights for policy 0, policy_version 415142 (0.0008) [2023-12-27 22:13:06,216][106225] Updated weights for policy 1, policy_version 416397 (0.0008) [2023-12-27 22:13:06,949][106226] Updated weights for policy 0, policy_version 415152 (0.0010) [2023-12-27 22:13:06,949][106225] Updated weights for policy 1, policy_version 416407 (0.0010) [2023-12-27 22:13:07,007][106225] Updated weights for policy 1, policy_version 416417 (0.0008) [2023-12-27 22:13:07,009][106226] Updated weights for policy 0, policy_version 415162 (0.0011) [2023-12-27 22:13:07,061][106225] Updated weights for policy 1, policy_version 416427 (0.0009) [2023-12-27 22:13:07,070][106226] Updated weights for policy 0, policy_version 415172 (0.0009) [2023-12-27 22:13:07,759][106225] Updated weights for policy 1, policy_version 416437 (0.0008) [2023-12-27 22:13:07,777][106226] Updated weights for policy 0, policy_version 415182 (0.0009) [2023-12-27 22:13:07,813][106225] Updated weights for policy 1, policy_version 416447 (0.0005) [2023-12-27 22:13:07,839][106226] Updated weights for policy 0, policy_version 415192 (0.0008) [2023-12-27 22:13:07,866][106225] Updated weights for policy 1, policy_version 416457 (0.0008) [2023-12-27 22:13:07,899][106226] Updated weights for policy 0, policy_version 415202 (0.0007) [2023-12-27 22:13:08,520][106225] Updated weights for policy 1, policy_version 416467 (0.0010) [2023-12-27 22:13:08,580][106225] Updated weights for policy 1, policy_version 416477 (0.0008) [2023-12-27 22:13:08,598][106226] Updated weights for policy 0, policy_version 415212 (0.0005) [2023-12-27 22:13:08,634][106225] Updated weights for policy 1, policy_version 416487 (0.0009) [2023-12-27 22:13:08,660][106226] Updated weights for policy 0, policy_version 415222 (0.0007) [2023-12-27 22:13:08,723][106226] Updated weights for policy 0, policy_version 415232 (0.0006) [2023-12-27 22:13:09,340][106225] Updated weights for policy 1, policy_version 416497 (0.0009) [2023-12-27 22:13:09,410][106225] Updated weights for policy 1, policy_version 416507 (0.0009) [2023-12-27 22:13:09,473][106225] Updated weights for policy 1, policy_version 416517 (0.0008) [2023-12-27 22:13:09,485][106226] Updated weights for policy 0, policy_version 415242 (0.0007) [2023-12-27 22:13:09,533][106225] Updated weights for policy 1, policy_version 416527 (0.0008) [2023-12-27 22:13:09,546][106226] Updated weights for policy 0, policy_version 415252 (0.0007) [2023-12-27 22:13:09,618][106226] Updated weights for policy 0, policy_version 415262 (0.0008) [2023-12-27 22:13:09,685][106226] Updated weights for policy 0, policy_version 415272 (0.0008) [2023-12-27 22:13:10,275][106225] Updated weights for policy 1, policy_version 416537 (0.0008) [2023-12-27 22:13:10,328][106225] Updated weights for policy 1, policy_version 416547 (0.0008) [2023-12-27 22:13:10,385][106225] Updated weights for policy 1, policy_version 416557 (0.0009) [2023-12-27 22:13:10,467][106226] Updated weights for policy 0, policy_version 415282 (0.0009) [2023-12-27 22:13:10,532][106226] Updated weights for policy 0, policy_version 415292 (0.0009) [2023-12-27 22:13:10,590][106226] Updated weights for policy 0, policy_version 415302 (0.0009) [2023-12-27 22:13:11,143][106225] Updated weights for policy 1, policy_version 416567 (0.0008) [2023-12-27 22:13:11,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 213016576. Throughput: 0: 9675.7, 1: 9904.1. Samples: 212994200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:11,175][105115] Avg episode reward: [(0, '-4.957'), (1, '-5.914')] [2023-12-27 22:13:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000415304_106348544.pth... [2023-12-27 22:13:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000414184_106061824.pth [2023-12-27 22:13:11,210][106225] Updated weights for policy 1, policy_version 416577 (0.0010) [2023-12-27 22:13:11,277][106225] Updated weights for policy 1, policy_version 416587 (0.0009) [2023-12-27 22:13:11,309][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000416592_106676224.pth... [2023-12-27 22:13:11,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000415440_106381312.pth [2023-12-27 22:13:11,370][106226] Updated weights for policy 0, policy_version 415312 (0.0008) [2023-12-27 22:13:11,439][106226] Updated weights for policy 0, policy_version 415322 (0.0009) [2023-12-27 22:13:11,492][106226] Updated weights for policy 0, policy_version 415332 (0.0009) [2023-12-27 22:13:12,094][106225] Updated weights for policy 1, policy_version 416597 (0.0008) [2023-12-27 22:13:12,163][106225] Updated weights for policy 1, policy_version 416607 (0.0008) [2023-12-27 22:13:12,233][106225] Updated weights for policy 1, policy_version 416617 (0.0008) [2023-12-27 22:13:12,264][106226] Updated weights for policy 0, policy_version 415342 (0.0009) [2023-12-27 22:13:12,324][106226] Updated weights for policy 0, policy_version 415352 (0.0009) [2023-12-27 22:13:12,396][106226] Updated weights for policy 0, policy_version 415362 (0.0010) [2023-12-27 22:13:12,993][106225] Updated weights for policy 1, policy_version 416627 (0.0008) [2023-12-27 22:13:13,044][106225] Updated weights for policy 1, policy_version 416637 (0.0008) [2023-12-27 22:13:13,094][106225] Updated weights for policy 1, policy_version 416647 (0.0008) [2023-12-27 22:13:13,159][106226] Updated weights for policy 0, policy_version 415372 (0.0010) [2023-12-27 22:13:13,217][106226] Updated weights for policy 0, policy_version 415382 (0.0010) [2023-12-27 22:13:13,275][106226] Updated weights for policy 0, policy_version 415392 (0.0010) [2023-12-27 22:13:13,855][106225] Updated weights for policy 1, policy_version 416657 (0.0008) [2023-12-27 22:13:13,918][106225] Updated weights for policy 1, policy_version 416667 (0.0009) [2023-12-27 22:13:13,971][106226] Updated weights for policy 0, policy_version 415402 (0.0007) [2023-12-27 22:13:13,984][106225] Updated weights for policy 1, policy_version 416677 (0.0005) [2023-12-27 22:13:14,037][106226] Updated weights for policy 0, policy_version 415412 (0.0006) [2023-12-27 22:13:14,042][106225] Updated weights for policy 1, policy_version 416687 (0.0006) [2023-12-27 22:13:14,096][106226] Updated weights for policy 0, policy_version 415422 (0.0008) [2023-12-27 22:13:14,168][106226] Updated weights for policy 0, policy_version 415432 (0.0008) [2023-12-27 22:13:14,685][106225] Updated weights for policy 1, policy_version 416697 (0.0006) [2023-12-27 22:13:14,749][106225] Updated weights for policy 1, policy_version 416707 (0.0005) [2023-12-27 22:13:14,817][106225] Updated weights for policy 1, policy_version 416717 (0.0009) [2023-12-27 22:13:14,907][106226] Updated weights for policy 0, policy_version 415442 (0.0008) [2023-12-27 22:13:14,972][106226] Updated weights for policy 0, policy_version 415452 (0.0008) [2023-12-27 22:13:15,040][106226] Updated weights for policy 0, policy_version 415462 (0.0009) [2023-12-27 22:13:15,437][106225] Updated weights for policy 1, policy_version 416727 (0.0007) [2023-12-27 22:13:15,493][106225] Updated weights for policy 1, policy_version 416737 (0.0005) [2023-12-27 22:13:15,560][106225] Updated weights for policy 1, policy_version 416747 (0.0006) [2023-12-27 22:13:15,797][106226] Updated weights for policy 0, policy_version 415472 (0.0010) [2023-12-27 22:13:15,846][106226] Updated weights for policy 0, policy_version 415482 (0.0009) [2023-12-27 22:13:15,907][106226] Updated weights for policy 0, policy_version 415492 (0.0005) [2023-12-27 22:13:16,120][106225] Updated weights for policy 1, policy_version 416757 (0.0006) [2023-12-27 22:13:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 213114880. Throughput: 0: 9597.1, 1: 9799.5. Samples: 213105240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:16,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.543')] [2023-12-27 22:13:16,185][106225] Updated weights for policy 1, policy_version 416767 (0.0008) [2023-12-27 22:13:16,254][106225] Updated weights for policy 1, policy_version 416777 (0.0010) [2023-12-27 22:13:16,590][106226] Updated weights for policy 0, policy_version 415502 (0.0009) [2023-12-27 22:13:16,647][106226] Updated weights for policy 0, policy_version 415512 (0.0007) [2023-12-27 22:13:16,709][106226] Updated weights for policy 0, policy_version 415522 (0.0007) [2023-12-27 22:13:16,872][106225] Updated weights for policy 1, policy_version 416787 (0.0009) [2023-12-27 22:13:16,932][106225] Updated weights for policy 1, policy_version 416797 (0.0006) [2023-12-27 22:13:16,998][106225] Updated weights for policy 1, policy_version 416807 (0.0009) [2023-12-27 22:13:17,355][106226] Updated weights for policy 0, policy_version 415532 (0.0008) [2023-12-27 22:13:17,405][106226] Updated weights for policy 0, policy_version 415542 (0.0010) [2023-12-27 22:13:17,465][106226] Updated weights for policy 0, policy_version 415552 (0.0010) [2023-12-27 22:13:17,602][106225] Updated weights for policy 1, policy_version 416817 (0.0010) [2023-12-27 22:13:17,652][106225] Updated weights for policy 1, policy_version 416827 (0.0006) [2023-12-27 22:13:17,711][106225] Updated weights for policy 1, policy_version 416837 (0.0005) [2023-12-27 22:13:17,785][106225] Updated weights for policy 1, policy_version 416847 (0.0010) [2023-12-27 22:13:18,107][106226] Updated weights for policy 0, policy_version 415562 (0.0009) [2023-12-27 22:13:18,175][106226] Updated weights for policy 0, policy_version 415572 (0.0005) [2023-12-27 22:13:18,240][106226] Updated weights for policy 0, policy_version 415582 (0.0009) [2023-12-27 22:13:18,302][106226] Updated weights for policy 0, policy_version 415592 (0.0007) [2023-12-27 22:13:18,476][106225] Updated weights for policy 1, policy_version 416857 (0.0010) [2023-12-27 22:13:18,530][106225] Updated weights for policy 1, policy_version 416867 (0.0010) [2023-12-27 22:13:18,582][106225] Updated weights for policy 1, policy_version 416877 (0.0008) [2023-12-27 22:13:18,879][106226] Updated weights for policy 0, policy_version 415602 (0.0010) [2023-12-27 22:13:18,939][106226] Updated weights for policy 0, policy_version 415612 (0.0011) [2023-12-27 22:13:19,007][106226] Updated weights for policy 0, policy_version 415622 (0.0011) [2023-12-27 22:13:19,275][106225] Updated weights for policy 1, policy_version 416887 (0.0009) [2023-12-27 22:13:19,341][106225] Updated weights for policy 1, policy_version 416897 (0.0008) [2023-12-27 22:13:19,418][106225] Updated weights for policy 1, policy_version 416907 (0.0008) [2023-12-27 22:13:19,697][106226] Updated weights for policy 0, policy_version 415632 (0.0009) [2023-12-27 22:13:19,760][106226] Updated weights for policy 0, policy_version 415642 (0.0008) [2023-12-27 22:13:19,819][106226] Updated weights for policy 0, policy_version 415652 (0.0008) [2023-12-27 22:13:20,176][106225] Updated weights for policy 1, policy_version 416917 (0.0008) [2023-12-27 22:13:20,240][106225] Updated weights for policy 1, policy_version 416927 (0.0008) [2023-12-27 22:13:20,300][106225] Updated weights for policy 1, policy_version 416937 (0.0008) [2023-12-27 22:13:20,574][106226] Updated weights for policy 0, policy_version 415662 (0.0009) [2023-12-27 22:13:20,640][106226] Updated weights for policy 0, policy_version 415672 (0.0009) [2023-12-27 22:13:20,704][106226] Updated weights for policy 0, policy_version 415682 (0.0009) [2023-12-27 22:13:21,010][106225] Updated weights for policy 1, policy_version 416947 (0.0008) [2023-12-27 22:13:21,085][106225] Updated weights for policy 1, policy_version 416957 (0.0009) [2023-12-27 22:13:21,144][106225] Updated weights for policy 1, policy_version 416967 (0.0008) [2023-12-27 22:13:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 213213184. Throughput: 0: 9584.4, 1: 9813.0. Samples: 213225888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:21,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.241')] [2023-12-27 22:13:21,502][106226] Updated weights for policy 0, policy_version 415692 (0.0008) [2023-12-27 22:13:21,566][106226] Updated weights for policy 0, policy_version 415702 (0.0009) [2023-12-27 22:13:21,630][106226] Updated weights for policy 0, policy_version 415712 (0.0009) [2023-12-27 22:13:21,880][106225] Updated weights for policy 1, policy_version 416977 (0.0007) [2023-12-27 22:13:21,943][106225] Updated weights for policy 1, policy_version 416987 (0.0009) [2023-12-27 22:13:22,009][106225] Updated weights for policy 1, policy_version 416997 (0.0008) [2023-12-27 22:13:22,071][106225] Updated weights for policy 1, policy_version 417007 (0.0009) [2023-12-27 22:13:22,402][106226] Updated weights for policy 0, policy_version 415722 (0.0008) [2023-12-27 22:13:22,465][106226] Updated weights for policy 0, policy_version 415732 (0.0007) [2023-12-27 22:13:22,529][106226] Updated weights for policy 0, policy_version 415742 (0.0008) [2023-12-27 22:13:22,582][106226] Updated weights for policy 0, policy_version 415752 (0.0008) [2023-12-27 22:13:22,824][106225] Updated weights for policy 1, policy_version 417017 (0.0010) [2023-12-27 22:13:22,890][106225] Updated weights for policy 1, policy_version 417027 (0.0009) [2023-12-27 22:13:22,958][106225] Updated weights for policy 1, policy_version 417037 (0.0008) [2023-12-27 22:13:23,308][106226] Updated weights for policy 0, policy_version 415762 (0.0008) [2023-12-27 22:13:23,360][106226] Updated weights for policy 0, policy_version 415772 (0.0008) [2023-12-27 22:13:23,413][106226] Updated weights for policy 0, policy_version 415782 (0.0005) [2023-12-27 22:13:23,583][106225] Updated weights for policy 1, policy_version 417047 (0.0007) [2023-12-27 22:13:23,636][106225] Updated weights for policy 1, policy_version 417057 (0.0008) [2023-12-27 22:13:23,693][106225] Updated weights for policy 1, policy_version 417067 (0.0009) [2023-12-27 22:13:24,141][106226] Updated weights for policy 0, policy_version 415792 (0.0009) [2023-12-27 22:13:24,200][106226] Updated weights for policy 0, policy_version 415802 (0.0006) [2023-12-27 22:13:24,263][106226] Updated weights for policy 0, policy_version 415812 (0.0006) [2023-12-27 22:13:24,361][106225] Updated weights for policy 1, policy_version 417077 (0.0007) [2023-12-27 22:13:24,416][106225] Updated weights for policy 1, policy_version 417087 (0.0006) [2023-12-27 22:13:24,477][106225] Updated weights for policy 1, policy_version 417097 (0.0006) [2023-12-27 22:13:24,873][106226] Updated weights for policy 0, policy_version 415822 (0.0007) [2023-12-27 22:13:24,935][106226] Updated weights for policy 0, policy_version 415832 (0.0006) [2023-12-27 22:13:25,003][106226] Updated weights for policy 0, policy_version 415842 (0.0005) [2023-12-27 22:13:25,032][106225] Updated weights for policy 1, policy_version 417107 (0.0006) [2023-12-27 22:13:25,088][106225] Updated weights for policy 1, policy_version 417117 (0.0008) [2023-12-27 22:13:25,141][106225] Updated weights for policy 1, policy_version 417127 (0.0008) [2023-12-27 22:13:25,623][106226] Updated weights for policy 0, policy_version 415852 (0.0007) [2023-12-27 22:13:25,704][106226] Updated weights for policy 0, policy_version 415862 (0.0009) [2023-12-27 22:13:25,763][106226] Updated weights for policy 0, policy_version 415872 (0.0008) [2023-12-27 22:13:25,901][106225] Updated weights for policy 1, policy_version 417137 (0.0008) [2023-12-27 22:13:25,963][106225] Updated weights for policy 1, policy_version 417147 (0.0008) [2023-12-27 22:13:26,020][106225] Updated weights for policy 1, policy_version 417157 (0.0009) [2023-12-27 22:13:26,082][106225] Updated weights for policy 1, policy_version 417167 (0.0009) [2023-12-27 22:13:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19438.6). Total num frames: 213319680. Throughput: 0: 9600.5, 1: 9786.9. Samples: 213282744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:26,175][105115] Avg episode reward: [(0, '-4.981'), (1, '-5.556')] [2023-12-27 22:13:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000417168_106823680.pth... [2023-12-27 22:13:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000415880_106496000.pth... [2023-12-27 22:13:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000416016_106528768.pth [2023-12-27 22:13:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000414760_106209280.pth [2023-12-27 22:13:26,470][106226] Updated weights for policy 0, policy_version 415882 (0.0009) [2023-12-27 22:13:26,531][106226] Updated weights for policy 0, policy_version 415892 (0.0009) [2023-12-27 22:13:26,591][106226] Updated weights for policy 0, policy_version 415902 (0.0008) [2023-12-27 22:13:26,639][106226] Updated weights for policy 0, policy_version 415912 (0.0008) [2023-12-27 22:13:26,851][106225] Updated weights for policy 1, policy_version 417177 (0.0006) [2023-12-27 22:13:26,902][106225] Updated weights for policy 1, policy_version 417187 (0.0005) [2023-12-27 22:13:26,966][106225] Updated weights for policy 1, policy_version 417197 (0.0008) [2023-12-27 22:13:27,413][106226] Updated weights for policy 0, policy_version 415922 (0.0009) [2023-12-27 22:13:27,486][106226] Updated weights for policy 0, policy_version 415932 (0.0006) [2023-12-27 22:13:27,557][106226] Updated weights for policy 0, policy_version 415942 (0.0008) [2023-12-27 22:13:27,619][106225] Updated weights for policy 1, policy_version 417207 (0.0009) [2023-12-27 22:13:27,670][106225] Updated weights for policy 1, policy_version 417217 (0.0008) [2023-12-27 22:13:27,728][106225] Updated weights for policy 1, policy_version 417227 (0.0008) [2023-12-27 22:13:28,219][106226] Updated weights for policy 0, policy_version 415952 (0.0008) [2023-12-27 22:13:28,272][106226] Updated weights for policy 0, policy_version 415962 (0.0009) [2023-12-27 22:13:28,341][106226] Updated weights for policy 0, policy_version 415972 (0.0010) [2023-12-27 22:13:28,410][106225] Updated weights for policy 1, policy_version 417237 (0.0009) [2023-12-27 22:13:28,471][106225] Updated weights for policy 1, policy_version 417247 (0.0010) [2023-12-27 22:13:28,535][106225] Updated weights for policy 1, policy_version 417257 (0.0010) [2023-12-27 22:13:29,062][106226] Updated weights for policy 0, policy_version 415982 (0.0008) [2023-12-27 22:13:29,111][106226] Updated weights for policy 0, policy_version 415992 (0.0007) [2023-12-27 22:13:29,160][106226] Updated weights for policy 0, policy_version 416002 (0.0007) [2023-12-27 22:13:29,263][106225] Updated weights for policy 1, policy_version 417267 (0.0010) [2023-12-27 22:13:29,327][106225] Updated weights for policy 1, policy_version 417277 (0.0010) [2023-12-27 22:13:29,398][106225] Updated weights for policy 1, policy_version 417287 (0.0009) [2023-12-27 22:13:29,789][106226] Updated weights for policy 0, policy_version 416012 (0.0007) [2023-12-27 22:13:29,860][106226] Updated weights for policy 0, policy_version 416022 (0.0009) [2023-12-27 22:13:29,921][106226] Updated weights for policy 0, policy_version 416032 (0.0008) [2023-12-27 22:13:30,104][106225] Updated weights for policy 1, policy_version 417297 (0.0009) [2023-12-27 22:13:30,170][106225] Updated weights for policy 1, policy_version 417307 (0.0006) [2023-12-27 22:13:30,233][106225] Updated weights for policy 1, policy_version 417317 (0.0010) [2023-12-27 22:13:30,289][106225] Updated weights for policy 1, policy_version 417327 (0.0009) [2023-12-27 22:13:30,644][106226] Updated weights for policy 0, policy_version 416042 (0.0009) [2023-12-27 22:13:30,709][106226] Updated weights for policy 0, policy_version 416052 (0.0008) [2023-12-27 22:13:30,773][106226] Updated weights for policy 0, policy_version 416062 (0.0007) [2023-12-27 22:13:30,834][106226] Updated weights for policy 0, policy_version 416072 (0.0008) [2023-12-27 22:13:30,904][106225] Updated weights for policy 1, policy_version 417337 (0.0010) [2023-12-27 22:13:30,951][106225] Updated weights for policy 1, policy_version 417347 (0.0010) [2023-12-27 22:13:31,001][106225] Updated weights for policy 1, policy_version 417357 (0.0010) [2023-12-27 22:13:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 213417984. Throughput: 0: 9665.9, 1: 9845.0. Samples: 213402640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:31,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.673')] [2023-12-27 22:13:31,502][106226] Updated weights for policy 0, policy_version 416082 (0.0011) [2023-12-27 22:13:31,555][106226] Updated weights for policy 0, policy_version 416092 (0.0010) [2023-12-27 22:13:31,614][106226] Updated weights for policy 0, policy_version 416102 (0.0011) [2023-12-27 22:13:31,821][106225] Updated weights for policy 1, policy_version 417367 (0.0010) [2023-12-27 22:13:31,871][106225] Updated weights for policy 1, policy_version 417377 (0.0010) [2023-12-27 22:13:31,922][106225] Updated weights for policy 1, policy_version 417387 (0.0009) [2023-12-27 22:13:32,323][106226] Updated weights for policy 0, policy_version 416112 (0.0008) [2023-12-27 22:13:32,392][106226] Updated weights for policy 0, policy_version 416122 (0.0009) [2023-12-27 22:13:32,452][106226] Updated weights for policy 0, policy_version 416132 (0.0010) [2023-12-27 22:13:32,691][106225] Updated weights for policy 1, policy_version 417397 (0.0010) [2023-12-27 22:13:32,747][106225] Updated weights for policy 1, policy_version 417407 (0.0010) [2023-12-27 22:13:32,797][106225] Updated weights for policy 1, policy_version 417417 (0.0010) [2023-12-27 22:13:33,161][106226] Updated weights for policy 0, policy_version 416142 (0.0011) [2023-12-27 22:13:33,213][106226] Updated weights for policy 0, policy_version 416152 (0.0010) [2023-12-27 22:13:33,258][106226] Updated weights for policy 0, policy_version 416162 (0.0010) [2023-12-27 22:13:33,500][106225] Updated weights for policy 1, policy_version 417427 (0.0009) [2023-12-27 22:13:33,546][106225] Updated weights for policy 1, policy_version 417437 (0.0010) [2023-12-27 22:13:33,591][106225] Updated weights for policy 1, policy_version 417447 (0.0010) [2023-12-27 22:13:33,905][106226] Updated weights for policy 0, policy_version 416172 (0.0010) [2023-12-27 22:13:33,964][106226] Updated weights for policy 0, policy_version 416182 (0.0010) [2023-12-27 22:13:34,027][106226] Updated weights for policy 0, policy_version 416192 (0.0011) [2023-12-27 22:13:34,292][106225] Updated weights for policy 1, policy_version 417457 (0.0006) [2023-12-27 22:13:34,350][106225] Updated weights for policy 1, policy_version 417467 (0.0008) [2023-12-27 22:13:34,414][106225] Updated weights for policy 1, policy_version 417477 (0.0008) [2023-12-27 22:13:34,475][106225] Updated weights for policy 1, policy_version 417487 (0.0010) [2023-12-27 22:13:34,754][106226] Updated weights for policy 0, policy_version 416202 (0.0011) [2023-12-27 22:13:34,825][106226] Updated weights for policy 0, policy_version 416212 (0.0011) [2023-12-27 22:13:34,886][106226] Updated weights for policy 0, policy_version 416222 (0.0011) [2023-12-27 22:13:34,953][106226] Updated weights for policy 0, policy_version 416232 (0.0011) [2023-12-27 22:13:35,222][106225] Updated weights for policy 1, policy_version 417497 (0.0008) [2023-12-27 22:13:35,285][106225] Updated weights for policy 1, policy_version 417507 (0.0007) [2023-12-27 22:13:35,348][106225] Updated weights for policy 1, policy_version 417517 (0.0007) [2023-12-27 22:13:35,600][106226] Updated weights for policy 0, policy_version 416242 (0.0010) [2023-12-27 22:13:35,651][106226] Updated weights for policy 0, policy_version 416252 (0.0010) [2023-12-27 22:13:35,701][106226] Updated weights for policy 0, policy_version 416262 (0.0011) [2023-12-27 22:13:35,962][106225] Updated weights for policy 1, policy_version 417527 (0.0006) [2023-12-27 22:13:36,024][106225] Updated weights for policy 1, policy_version 417537 (0.0005) [2023-12-27 22:13:36,077][106225] Updated weights for policy 1, policy_version 417547 (0.0005) [2023-12-27 22:13:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 213516288. Throughput: 0: 9676.5, 1: 9877.1. Samples: 213522060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-27 22:13:36,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.554')] [2023-12-27 22:13:36,442][106226] Updated weights for policy 0, policy_version 416272 (0.0009) [2023-12-27 22:13:36,507][106226] Updated weights for policy 0, policy_version 416282 (0.0008) [2023-12-27 22:13:36,573][106226] Updated weights for policy 0, policy_version 416292 (0.0008) [2023-12-27 22:13:36,807][106225] Updated weights for policy 1, policy_version 417557 (0.0009) [2023-12-27 22:13:36,871][106225] Updated weights for policy 1, policy_version 417567 (0.0010) [2023-12-27 22:13:36,935][106225] Updated weights for policy 1, policy_version 417577 (0.0010) [2023-12-27 22:13:37,293][106226] Updated weights for policy 0, policy_version 416302 (0.0008) [2023-12-27 22:13:37,356][106226] Updated weights for policy 0, policy_version 416312 (0.0009) [2023-12-27 22:13:37,419][106226] Updated weights for policy 0, policy_version 416322 (0.0008) [2023-12-27 22:13:37,612][106225] Updated weights for policy 1, policy_version 417587 (0.0011) [2023-12-27 22:13:37,679][106225] Updated weights for policy 1, policy_version 417597 (0.0010) [2023-12-27 22:13:37,741][106225] Updated weights for policy 1, policy_version 417607 (0.0011) [2023-12-27 22:13:38,128][106226] Updated weights for policy 0, policy_version 416332 (0.0008) [2023-12-27 22:13:38,184][106226] Updated weights for policy 0, policy_version 416342 (0.0007) [2023-12-27 22:13:38,244][106226] Updated weights for policy 0, policy_version 416352 (0.0008) [2023-12-27 22:13:38,455][106225] Updated weights for policy 1, policy_version 417617 (0.0010) [2023-12-27 22:13:38,516][106225] Updated weights for policy 1, policy_version 417627 (0.0010) [2023-12-27 22:13:38,573][106225] Updated weights for policy 1, policy_version 417637 (0.0010) [2023-12-27 22:13:38,637][106225] Updated weights for policy 1, policy_version 417647 (0.0010) [2023-12-27 22:13:39,024][106226] Updated weights for policy 0, policy_version 416362 (0.0006) [2023-12-27 22:13:39,081][106226] Updated weights for policy 0, policy_version 416372 (0.0005) [2023-12-27 22:13:39,142][106226] Updated weights for policy 0, policy_version 416382 (0.0005) [2023-12-27 22:13:39,207][106226] Updated weights for policy 0, policy_version 416392 (0.0005) [2023-12-27 22:13:39,334][106225] Updated weights for policy 1, policy_version 417657 (0.0011) [2023-12-27 22:13:39,406][106225] Updated weights for policy 1, policy_version 417667 (0.0008) [2023-12-27 22:13:39,475][106225] Updated weights for policy 1, policy_version 417677 (0.0006) [2023-12-27 22:13:39,934][106226] Updated weights for policy 0, policy_version 416402 (0.0009) [2023-12-27 22:13:39,997][106226] Updated weights for policy 0, policy_version 416412 (0.0008) [2023-12-27 22:13:40,062][106226] Updated weights for policy 0, policy_version 416422 (0.0008) [2023-12-27 22:13:40,224][106225] Updated weights for policy 1, policy_version 417687 (0.0008) [2023-12-27 22:13:40,274][106225] Updated weights for policy 1, policy_version 417697 (0.0009) [2023-12-27 22:13:40,326][106225] Updated weights for policy 1, policy_version 417707 (0.0008) [2023-12-27 22:13:40,698][106226] Updated weights for policy 0, policy_version 416432 (0.0006) [2023-12-27 22:13:40,757][106226] Updated weights for policy 0, policy_version 416442 (0.0006) [2023-12-27 22:13:40,823][106226] Updated weights for policy 0, policy_version 416452 (0.0009) [2023-12-27 22:13:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19438.6). Total num frames: 213606400. Throughput: 0: 9676.5, 1: 9900.3. Samples: 213581008. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:13:41,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.520')] [2023-12-27 22:13:41,175][106225] Updated weights for policy 1, policy_version 417717 (0.0009) [2023-12-27 22:13:41,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000416456_106643456.pth... [2023-12-27 22:13:41,182][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000415304_106348544.pth [2023-12-27 22:13:41,183][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000416456_106643456.pth [2023-12-27 22:13:41,233][106225] Updated weights for policy 1, policy_version 417727 (0.0008) [2023-12-27 22:13:41,299][106225] Updated weights for policy 1, policy_version 417737 (0.0007) [2023-12-27 22:13:41,350][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000417744_106971136.pth... [2023-12-27 22:13:41,354][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000416592_106676224.pth [2023-12-27 22:13:41,355][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000417744_106971136.pth [2023-12-27 22:13:41,593][106226] Updated weights for policy 0, policy_version 416462 (0.0009) [2023-12-27 22:13:41,671][106226] Updated weights for policy 0, policy_version 416472 (0.0009) [2023-12-27 22:13:41,740][106226] Updated weights for policy 0, policy_version 416482 (0.0009) [2023-12-27 22:13:42,067][106225] Updated weights for policy 1, policy_version 417747 (0.0008) [2023-12-27 22:13:42,125][106225] Updated weights for policy 1, policy_version 417757 (0.0008) [2023-12-27 22:13:42,182][106225] Updated weights for policy 1, policy_version 417767 (0.0008) [2023-12-27 22:13:42,497][106226] Updated weights for policy 0, policy_version 416492 (0.0009) [2023-12-27 22:13:42,564][106226] Updated weights for policy 0, policy_version 416502 (0.0011) [2023-12-27 22:13:42,632][106226] Updated weights for policy 0, policy_version 416512 (0.0011) [2023-12-27 22:13:42,963][106225] Updated weights for policy 1, policy_version 417777 (0.0008) [2023-12-27 22:13:43,018][106225] Updated weights for policy 1, policy_version 417787 (0.0006) [2023-12-27 22:13:43,073][106225] Updated weights for policy 1, policy_version 417797 (0.0008) [2023-12-27 22:13:43,124][106225] Updated weights for policy 1, policy_version 417807 (0.0008) [2023-12-27 22:13:43,333][106226] Updated weights for policy 0, policy_version 416522 (0.0011) [2023-12-27 22:13:43,395][106226] Updated weights for policy 0, policy_version 416532 (0.0011) [2023-12-27 22:13:43,467][106226] Updated weights for policy 0, policy_version 416542 (0.0005) [2023-12-27 22:13:43,529][106226] Updated weights for policy 0, policy_version 416552 (0.0008) [2023-12-27 22:13:43,704][106225] Updated weights for policy 1, policy_version 417817 (0.0007) [2023-12-27 22:13:43,751][106225] Updated weights for policy 1, policy_version 417827 (0.0005) [2023-12-27 22:13:43,804][106225] Updated weights for policy 1, policy_version 417837 (0.0008) [2023-12-27 22:13:44,196][106226] Updated weights for policy 0, policy_version 416562 (0.0011) [2023-12-27 22:13:44,264][106226] Updated weights for policy 0, policy_version 416572 (0.0008) [2023-12-27 22:13:44,319][106226] Updated weights for policy 0, policy_version 416582 (0.0008) [2023-12-27 22:13:44,507][106225] Updated weights for policy 1, policy_version 417847 (0.0007) [2023-12-27 22:13:44,555][106225] Updated weights for policy 1, policy_version 417857 (0.0005) [2023-12-27 22:13:44,600][106225] Updated weights for policy 1, policy_version 417867 (0.0008) [2023-12-27 22:13:45,071][106226] Updated weights for policy 0, policy_version 416592 (0.0008) [2023-12-27 22:13:45,136][106226] Updated weights for policy 0, policy_version 416602 (0.0009) [2023-12-27 22:13:45,202][106226] Updated weights for policy 0, policy_version 416612 (0.0008) [2023-12-27 22:13:45,351][106225] Updated weights for policy 1, policy_version 417877 (0.0008) [2023-12-27 22:13:45,413][106225] Updated weights for policy 1, policy_version 417887 (0.0006) [2023-12-27 22:13:45,477][106225] Updated weights for policy 1, policy_version 417897 (0.0006) [2023-12-27 22:13:45,949][106226] Updated weights for policy 0, policy_version 416622 (0.0009) [2023-12-27 22:13:46,006][106226] Updated weights for policy 0, policy_version 416632 (0.0009) [2023-12-27 22:13:46,051][106226] Updated weights for policy 0, policy_version 416642 (0.0008) [2023-12-27 22:13:46,087][106225] Updated weights for policy 1, policy_version 417907 (0.0007) [2023-12-27 22:13:46,155][106225] Updated weights for policy 1, policy_version 417917 (0.0007) [2023-12-27 22:13:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 213704704. Throughput: 0: 9675.1, 1: 9832.6. Samples: 213695816. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:13:46,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-5.397')] [2023-12-27 22:13:46,206][106225] Updated weights for policy 1, policy_version 417927 (0.0009) [2023-12-27 22:13:46,643][106226] Updated weights for policy 0, policy_version 416652 (0.0007) [2023-12-27 22:13:46,696][106226] Updated weights for policy 0, policy_version 416662 (0.0009) [2023-12-27 22:13:46,753][106226] Updated weights for policy 0, policy_version 416672 (0.0008) [2023-12-27 22:13:46,898][106225] Updated weights for policy 1, policy_version 417937 (0.0009) [2023-12-27 22:13:46,943][106225] Updated weights for policy 1, policy_version 417947 (0.0008) [2023-12-27 22:13:47,002][106225] Updated weights for policy 1, policy_version 417957 (0.0008) [2023-12-27 22:13:47,057][106225] Updated weights for policy 1, policy_version 417967 (0.0008) [2023-12-27 22:13:47,507][106226] Updated weights for policy 0, policy_version 416682 (0.0009) [2023-12-27 22:13:47,569][106226] Updated weights for policy 0, policy_version 416692 (0.0008) [2023-12-27 22:13:47,618][106226] Updated weights for policy 0, policy_version 416702 (0.0009) [2023-12-27 22:13:47,672][106226] Updated weights for policy 0, policy_version 416712 (0.0008) [2023-12-27 22:13:47,716][106225] Updated weights for policy 1, policy_version 417977 (0.0008) [2023-12-27 22:13:47,778][106225] Updated weights for policy 1, policy_version 417987 (0.0008) [2023-12-27 22:13:47,833][106225] Updated weights for policy 1, policy_version 417997 (0.0009) [2023-12-27 22:13:48,359][106226] Updated weights for policy 0, policy_version 416722 (0.0007) [2023-12-27 22:13:48,433][106226] Updated weights for policy 0, policy_version 416732 (0.0006) [2023-12-27 22:13:48,514][106226] Updated weights for policy 0, policy_version 416742 (0.0006) [2023-12-27 22:13:48,590][106225] Updated weights for policy 1, policy_version 418007 (0.0008) [2023-12-27 22:13:48,660][106225] Updated weights for policy 1, policy_version 418017 (0.0006) [2023-12-27 22:13:48,724][106225] Updated weights for policy 1, policy_version 418027 (0.0008) [2023-12-27 22:13:49,182][106226] Updated weights for policy 0, policy_version 416752 (0.0009) [2023-12-27 22:13:49,242][106226] Updated weights for policy 0, policy_version 416762 (0.0009) [2023-12-27 22:13:49,306][106226] Updated weights for policy 0, policy_version 416772 (0.0008) [2023-12-27 22:13:49,371][106225] Updated weights for policy 1, policy_version 418037 (0.0009) [2023-12-27 22:13:49,430][106225] Updated weights for policy 1, policy_version 418047 (0.0010) [2023-12-27 22:13:49,478][106225] Updated weights for policy 1, policy_version 418057 (0.0010) [2023-12-27 22:13:50,069][106226] Updated weights for policy 0, policy_version 416782 (0.0008) [2023-12-27 22:13:50,133][106226] Updated weights for policy 0, policy_version 416792 (0.0008) [2023-12-27 22:13:50,197][106226] Updated weights for policy 0, policy_version 416802 (0.0008) [2023-12-27 22:13:50,222][106225] Updated weights for policy 1, policy_version 418067 (0.0010) [2023-12-27 22:13:50,282][106225] Updated weights for policy 1, policy_version 418077 (0.0008) [2023-12-27 22:13:50,348][106225] Updated weights for policy 1, policy_version 418087 (0.0008) [2023-12-27 22:13:50,861][106226] Updated weights for policy 0, policy_version 416812 (0.0008) [2023-12-27 22:13:50,925][106226] Updated weights for policy 0, policy_version 416822 (0.0009) [2023-12-27 22:13:50,993][106226] Updated weights for policy 0, policy_version 416832 (0.0009) [2023-12-27 22:13:51,142][106225] Updated weights for policy 1, policy_version 418097 (0.0008) [2023-12-27 22:13:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 213803008. Throughput: 0: 9667.7, 1: 9836.9. Samples: 213813460. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:13:51,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-6.052')] [2023-12-27 22:13:51,205][106225] Updated weights for policy 1, policy_version 418107 (0.0008) [2023-12-27 22:13:51,271][106225] Updated weights for policy 1, policy_version 418117 (0.0007) [2023-12-27 22:13:51,337][106225] Updated weights for policy 1, policy_version 418127 (0.0008) [2023-12-27 22:13:51,750][106226] Updated weights for policy 0, policy_version 416842 (0.0009) [2023-12-27 22:13:51,809][106226] Updated weights for policy 0, policy_version 416852 (0.0009) [2023-12-27 22:13:51,862][106226] Updated weights for policy 0, policy_version 416862 (0.0007) [2023-12-27 22:13:51,919][106226] Updated weights for policy 0, policy_version 416872 (0.0005) [2023-12-27 22:13:52,103][106225] Updated weights for policy 1, policy_version 418137 (0.0008) [2023-12-27 22:13:52,160][106225] Updated weights for policy 1, policy_version 418147 (0.0007) [2023-12-27 22:13:52,225][106225] Updated weights for policy 1, policy_version 418157 (0.0008) [2023-12-27 22:13:52,614][106226] Updated weights for policy 0, policy_version 416882 (0.0008) [2023-12-27 22:13:52,671][106226] Updated weights for policy 0, policy_version 416892 (0.0007) [2023-12-27 22:13:52,718][106226] Updated weights for policy 0, policy_version 416902 (0.0009) [2023-12-27 22:13:52,933][106225] Updated weights for policy 1, policy_version 418167 (0.0007) [2023-12-27 22:13:52,988][106225] Updated weights for policy 1, policy_version 418177 (0.0008) [2023-12-27 22:13:53,048][106225] Updated weights for policy 1, policy_version 418187 (0.0006) [2023-12-27 22:13:53,458][106226] Updated weights for policy 0, policy_version 416912 (0.0010) [2023-12-27 22:13:53,515][106226] Updated weights for policy 0, policy_version 416922 (0.0010) [2023-12-27 22:13:53,566][106226] Updated weights for policy 0, policy_version 416932 (0.0010) [2023-12-27 22:13:53,731][106225] Updated weights for policy 1, policy_version 418197 (0.0008) [2023-12-27 22:13:53,794][106225] Updated weights for policy 1, policy_version 418207 (0.0007) [2023-12-27 22:13:53,858][106225] Updated weights for policy 1, policy_version 418217 (0.0008) [2023-12-27 22:13:54,299][106226] Updated weights for policy 0, policy_version 416942 (0.0011) [2023-12-27 22:13:54,359][106226] Updated weights for policy 0, policy_version 416952 (0.0011) [2023-12-27 22:13:54,425][106226] Updated weights for policy 0, policy_version 416962 (0.0011) [2023-12-27 22:13:54,546][106225] Updated weights for policy 1, policy_version 418227 (0.0008) [2023-12-27 22:13:54,600][106225] Updated weights for policy 1, policy_version 418237 (0.0010) [2023-12-27 22:13:54,650][106225] Updated weights for policy 1, policy_version 418247 (0.0005) [2023-12-27 22:13:55,108][106226] Updated weights for policy 0, policy_version 416972 (0.0009) [2023-12-27 22:13:55,164][106226] Updated weights for policy 0, policy_version 416982 (0.0009) [2023-12-27 22:13:55,217][106226] Updated weights for policy 0, policy_version 416992 (0.0011) [2023-12-27 22:13:55,302][106225] Updated weights for policy 1, policy_version 418257 (0.0006) [2023-12-27 22:13:55,369][106225] Updated weights for policy 1, policy_version 418267 (0.0010) [2023-12-27 22:13:55,424][106225] Updated weights for policy 1, policy_version 418277 (0.0010) [2023-12-27 22:13:55,484][106225] Updated weights for policy 1, policy_version 418287 (0.0007) [2023-12-27 22:13:55,837][106226] Updated weights for policy 0, policy_version 417002 (0.0010) [2023-12-27 22:13:55,895][106226] Updated weights for policy 0, policy_version 417012 (0.0010) [2023-12-27 22:13:55,952][106226] Updated weights for policy 0, policy_version 417022 (0.0010) [2023-12-27 22:13:56,005][106226] Updated weights for policy 0, policy_version 417032 (0.0010) [2023-12-27 22:13:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 213901312. Throughput: 0: 9668.5, 1: 9819.0. Samples: 213871140. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:13:56,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.869')] [2023-12-27 22:13:56,177][106225] Updated weights for policy 1, policy_version 418297 (0.0005) [2023-12-27 22:13:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000417032_106790912.pth... [2023-12-27 22:13:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000415880_106496000.pth [2023-12-27 22:13:56,243][106225] Updated weights for policy 1, policy_version 418307 (0.0005) [2023-12-27 22:13:56,311][106225] Updated weights for policy 1, policy_version 418317 (0.0007) [2023-12-27 22:13:56,327][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000418320_107118592.pth... [2023-12-27 22:13:56,331][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000417168_106823680.pth [2023-12-27 22:13:56,736][106226] Updated weights for policy 0, policy_version 417042 (0.0011) [2023-12-27 22:13:56,801][106226] Updated weights for policy 0, policy_version 417052 (0.0007) [2023-12-27 22:13:56,853][106226] Updated weights for policy 0, policy_version 417062 (0.0008) [2023-12-27 22:13:57,006][106225] Updated weights for policy 1, policy_version 418327 (0.0010) [2023-12-27 22:13:57,061][106225] Updated weights for policy 1, policy_version 418337 (0.0010) [2023-12-27 22:13:57,118][106225] Updated weights for policy 1, policy_version 418347 (0.0010) [2023-12-27 22:13:57,539][106226] Updated weights for policy 0, policy_version 417072 (0.0011) [2023-12-27 22:13:57,602][106226] Updated weights for policy 0, policy_version 417082 (0.0011) [2023-12-27 22:13:57,664][106226] Updated weights for policy 0, policy_version 417092 (0.0010) [2023-12-27 22:13:57,825][106225] Updated weights for policy 1, policy_version 418357 (0.0010) [2023-12-27 22:13:57,877][106225] Updated weights for policy 1, policy_version 418367 (0.0010) [2023-12-27 22:13:57,935][106225] Updated weights for policy 1, policy_version 418377 (0.0010) [2023-12-27 22:13:58,378][106226] Updated weights for policy 0, policy_version 417102 (0.0010) [2023-12-27 22:13:58,442][106226] Updated weights for policy 0, policy_version 417112 (0.0009) [2023-12-27 22:13:58,508][106226] Updated weights for policy 0, policy_version 417122 (0.0011) [2023-12-27 22:13:58,689][106225] Updated weights for policy 1, policy_version 418387 (0.0010) [2023-12-27 22:13:58,756][106225] Updated weights for policy 1, policy_version 418397 (0.0010) [2023-12-27 22:13:58,824][106225] Updated weights for policy 1, policy_version 418407 (0.0007) [2023-12-27 22:13:59,336][106226] Updated weights for policy 0, policy_version 417132 (0.0010) [2023-12-27 22:13:59,420][106226] Updated weights for policy 0, policy_version 417143 (0.0011) [2023-12-27 22:13:59,486][106226] Updated weights for policy 0, policy_version 417153 (0.0007) [2023-12-27 22:13:59,617][106225] Updated weights for policy 1, policy_version 418417 (0.0008) [2023-12-27 22:13:59,681][106225] Updated weights for policy 1, policy_version 418427 (0.0006) [2023-12-27 22:13:59,738][106225] Updated weights for policy 1, policy_version 418437 (0.0009) [2023-12-27 22:13:59,785][106225] Updated weights for policy 1, policy_version 418447 (0.0010) [2023-12-27 22:14:00,178][106226] Updated weights for policy 0, policy_version 417163 (0.0008) [2023-12-27 22:14:00,236][106226] Updated weights for policy 0, policy_version 417173 (0.0011) [2023-12-27 22:14:00,293][106226] Updated weights for policy 0, policy_version 417183 (0.0011) [2023-12-27 22:14:00,537][106225] Updated weights for policy 1, policy_version 418457 (0.0008) [2023-12-27 22:14:00,591][106225] Updated weights for policy 1, policy_version 418467 (0.0008) [2023-12-27 22:14:00,648][106225] Updated weights for policy 1, policy_version 418477 (0.0008) [2023-12-27 22:14:01,005][106226] Updated weights for policy 0, policy_version 417193 (0.0010) [2023-12-27 22:14:01,071][106226] Updated weights for policy 0, policy_version 417203 (0.0009) [2023-12-27 22:14:01,141][106226] Updated weights for policy 0, policy_version 417213 (0.0009) [2023-12-27 22:14:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19438.6). Total num frames: 213991424. Throughput: 0: 9748.5, 1: 9847.0. Samples: 213987040. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:01,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.453')] [2023-12-27 22:14:01,201][106226] Updated weights for policy 0, policy_version 417223 (0.0008) [2023-12-27 22:14:01,419][106225] Updated weights for policy 1, policy_version 418487 (0.0008) [2023-12-27 22:14:01,480][106225] Updated weights for policy 1, policy_version 418497 (0.0008) [2023-12-27 22:14:01,534][106225] Updated weights for policy 1, policy_version 418507 (0.0008) [2023-12-27 22:14:02,004][106226] Updated weights for policy 0, policy_version 417233 (0.0007) [2023-12-27 22:14:02,072][106226] Updated weights for policy 0, policy_version 417243 (0.0007) [2023-12-27 22:14:02,133][106226] Updated weights for policy 0, policy_version 417253 (0.0009) [2023-12-27 22:14:02,219][106225] Updated weights for policy 1, policy_version 418517 (0.0008) [2023-12-27 22:14:02,283][106225] Updated weights for policy 1, policy_version 418527 (0.0008) [2023-12-27 22:14:02,334][106225] Updated weights for policy 1, policy_version 418537 (0.0008) [2023-12-27 22:14:02,811][106226] Updated weights for policy 0, policy_version 417263 (0.0011) [2023-12-27 22:14:02,867][106226] Updated weights for policy 0, policy_version 417273 (0.0010) [2023-12-27 22:14:02,926][106226] Updated weights for policy 0, policy_version 417283 (0.0010) [2023-12-27 22:14:03,091][106225] Updated weights for policy 1, policy_version 418547 (0.0008) [2023-12-27 22:14:03,139][106225] Updated weights for policy 1, policy_version 418557 (0.0005) [2023-12-27 22:14:03,224][106225] Updated weights for policy 1, policy_version 418567 (0.0005) [2023-12-27 22:14:03,601][106226] Updated weights for policy 0, policy_version 417293 (0.0010) [2023-12-27 22:14:03,655][106226] Updated weights for policy 0, policy_version 417303 (0.0009) [2023-12-27 22:14:03,716][106226] Updated weights for policy 0, policy_version 417313 (0.0008) [2023-12-27 22:14:03,735][106225] Updated weights for policy 1, policy_version 418577 (0.0008) [2023-12-27 22:14:03,792][106225] Updated weights for policy 1, policy_version 418587 (0.0010) [2023-12-27 22:14:03,854][106225] Updated weights for policy 1, policy_version 418597 (0.0010) [2023-12-27 22:14:03,920][106225] Updated weights for policy 1, policy_version 418607 (0.0011) [2023-12-27 22:14:04,497][106226] Updated weights for policy 0, policy_version 417323 (0.0008) [2023-12-27 22:14:04,565][106226] Updated weights for policy 0, policy_version 417333 (0.0009) [2023-12-27 22:14:04,615][106225] Updated weights for policy 1, policy_version 418617 (0.0006) [2023-12-27 22:14:04,627][106226] Updated weights for policy 0, policy_version 417343 (0.0008) [2023-12-27 22:14:04,664][106225] Updated weights for policy 1, policy_version 418627 (0.0005) [2023-12-27 22:14:04,726][106225] Updated weights for policy 1, policy_version 418637 (0.0005) [2023-12-27 22:14:05,290][106226] Updated weights for policy 0, policy_version 417353 (0.0008) [2023-12-27 22:14:05,353][106226] Updated weights for policy 0, policy_version 417363 (0.0005) [2023-12-27 22:14:05,412][106226] Updated weights for policy 0, policy_version 417373 (0.0005) [2023-12-27 22:14:05,416][106225] Updated weights for policy 1, policy_version 418647 (0.0010) [2023-12-27 22:14:05,469][106226] Updated weights for policy 0, policy_version 417383 (0.0005) [2023-12-27 22:14:05,470][106225] Updated weights for policy 1, policy_version 418657 (0.0010) [2023-12-27 22:14:05,527][106225] Updated weights for policy 1, policy_version 418667 (0.0010) [2023-12-27 22:14:06,132][106226] Updated weights for policy 0, policy_version 417394 (0.0008) [2023-12-27 22:14:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 214089728. Throughput: 0: 9728.1, 1: 9808.5. Samples: 214105036. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:06,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.501')] [2023-12-27 22:14:06,199][106226] Updated weights for policy 0, policy_version 417404 (0.0010) [2023-12-27 22:14:06,263][106226] Updated weights for policy 0, policy_version 417414 (0.0009) [2023-12-27 22:14:06,284][106225] Updated weights for policy 1, policy_version 418677 (0.0008) [2023-12-27 22:14:06,333][106225] Updated weights for policy 1, policy_version 418687 (0.0008) [2023-12-27 22:14:06,388][106225] Updated weights for policy 1, policy_version 418697 (0.0007) [2023-12-27 22:14:06,896][106226] Updated weights for policy 0, policy_version 417424 (0.0010) [2023-12-27 22:14:06,957][106226] Updated weights for policy 0, policy_version 417434 (0.0011) [2023-12-27 22:14:07,020][106226] Updated weights for policy 0, policy_version 417444 (0.0010) [2023-12-27 22:14:07,202][106225] Updated weights for policy 1, policy_version 418707 (0.0008) [2023-12-27 22:14:07,264][106225] Updated weights for policy 1, policy_version 418717 (0.0008) [2023-12-27 22:14:07,322][106225] Updated weights for policy 1, policy_version 418727 (0.0008) [2023-12-27 22:14:07,700][106226] Updated weights for policy 0, policy_version 417454 (0.0010) [2023-12-27 22:14:07,762][106226] Updated weights for policy 0, policy_version 417464 (0.0006) [2023-12-27 22:14:07,817][106226] Updated weights for policy 0, policy_version 417474 (0.0007) [2023-12-27 22:14:08,082][106225] Updated weights for policy 1, policy_version 418737 (0.0008) [2023-12-27 22:14:08,137][106225] Updated weights for policy 1, policy_version 418747 (0.0009) [2023-12-27 22:14:08,193][106225] Updated weights for policy 1, policy_version 418757 (0.0009) [2023-12-27 22:14:08,252][106225] Updated weights for policy 1, policy_version 418767 (0.0008) [2023-12-27 22:14:08,505][106226] Updated weights for policy 0, policy_version 417484 (0.0008) [2023-12-27 22:14:08,570][106226] Updated weights for policy 0, policy_version 417494 (0.0008) [2023-12-27 22:14:08,638][106226] Updated weights for policy 0, policy_version 417504 (0.0008) [2023-12-27 22:14:09,052][106225] Updated weights for policy 1, policy_version 418777 (0.0007) [2023-12-27 22:14:09,113][106225] Updated weights for policy 1, policy_version 418787 (0.0005) [2023-12-27 22:14:09,172][106225] Updated weights for policy 1, policy_version 418797 (0.0005) [2023-12-27 22:14:09,304][106226] Updated weights for policy 0, policy_version 417514 (0.0009) [2023-12-27 22:14:09,377][106226] Updated weights for policy 0, policy_version 417524 (0.0011) [2023-12-27 22:14:09,452][106226] Updated weights for policy 0, policy_version 417534 (0.0010) [2023-12-27 22:14:09,520][106226] Updated weights for policy 0, policy_version 417544 (0.0011) [2023-12-27 22:14:09,885][106225] Updated weights for policy 1, policy_version 418807 (0.0008) [2023-12-27 22:14:09,955][106225] Updated weights for policy 1, policy_version 418817 (0.0009) [2023-12-27 22:14:10,020][106225] Updated weights for policy 1, policy_version 418827 (0.0011) [2023-12-27 22:14:10,288][106226] Updated weights for policy 0, policy_version 417554 (0.0008) [2023-12-27 22:14:10,349][106226] Updated weights for policy 0, policy_version 417564 (0.0008) [2023-12-27 22:14:10,416][106226] Updated weights for policy 0, policy_version 417574 (0.0009) [2023-12-27 22:14:10,754][106225] Updated weights for policy 1, policy_version 418837 (0.0011) [2023-12-27 22:14:10,817][106225] Updated weights for policy 1, policy_version 418847 (0.0010) [2023-12-27 22:14:10,870][106225] Updated weights for policy 1, policy_version 418857 (0.0010) [2023-12-27 22:14:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 214188032. Throughput: 0: 9790.3, 1: 9774.5. Samples: 214163160. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:11,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-5.356')] [2023-12-27 22:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000418864_107257856.pth... [2023-12-27 22:14:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000417744_106971136.pth [2023-12-27 22:14:11,186][106226] Updated weights for policy 0, policy_version 417584 (0.0008) [2023-12-27 22:14:11,239][106226] Updated weights for policy 0, policy_version 417594 (0.0008) [2023-12-27 22:14:11,307][106226] Updated weights for policy 0, policy_version 417604 (0.0009) [2023-12-27 22:14:11,329][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000417608_106938368.pth... [2023-12-27 22:14:11,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000416456_106643456.pth [2023-12-27 22:14:11,601][106225] Updated weights for policy 1, policy_version 418867 (0.0010) [2023-12-27 22:14:11,672][106225] Updated weights for policy 1, policy_version 418877 (0.0008) [2023-12-27 22:14:11,746][106225] Updated weights for policy 1, policy_version 418887 (0.0008) [2023-12-27 22:14:12,081][106226] Updated weights for policy 0, policy_version 417614 (0.0008) [2023-12-27 22:14:12,143][106226] Updated weights for policy 0, policy_version 417624 (0.0008) [2023-12-27 22:14:12,201][106226] Updated weights for policy 0, policy_version 417634 (0.0008) [2023-12-27 22:14:12,553][106225] Updated weights for policy 1, policy_version 418897 (0.0008) [2023-12-27 22:14:12,612][106225] Updated weights for policy 1, policy_version 418907 (0.0008) [2023-12-27 22:14:12,671][106225] Updated weights for policy 1, policy_version 418917 (0.0008) [2023-12-27 22:14:12,727][106225] Updated weights for policy 1, policy_version 418927 (0.0009) [2023-12-27 22:14:12,956][106226] Updated weights for policy 0, policy_version 417644 (0.0008) [2023-12-27 22:14:13,012][106226] Updated weights for policy 0, policy_version 417654 (0.0009) [2023-12-27 22:14:13,066][106226] Updated weights for policy 0, policy_version 417664 (0.0008) [2023-12-27 22:14:13,443][106225] Updated weights for policy 1, policy_version 418937 (0.0005) [2023-12-27 22:14:13,494][106225] Updated weights for policy 1, policy_version 418947 (0.0005) [2023-12-27 22:14:13,540][106225] Updated weights for policy 1, policy_version 418957 (0.0005) [2023-12-27 22:14:13,782][106226] Updated weights for policy 0, policy_version 417674 (0.0008) [2023-12-27 22:14:13,835][106226] Updated weights for policy 0, policy_version 417684 (0.0007) [2023-12-27 22:14:13,889][106226] Updated weights for policy 0, policy_version 417694 (0.0008) [2023-12-27 22:14:13,942][106226] Updated weights for policy 0, policy_version 417704 (0.0008) [2023-12-27 22:14:14,140][106225] Updated weights for policy 1, policy_version 418967 (0.0009) [2023-12-27 22:14:14,187][106225] Updated weights for policy 1, policy_version 418977 (0.0009) [2023-12-27 22:14:14,239][106225] Updated weights for policy 1, policy_version 418987 (0.0008) [2023-12-27 22:14:14,689][106226] Updated weights for policy 0, policy_version 417714 (0.0008) [2023-12-27 22:14:14,744][106226] Updated weights for policy 0, policy_version 417724 (0.0008) [2023-12-27 22:14:14,810][106226] Updated weights for policy 0, policy_version 417734 (0.0008) [2023-12-27 22:14:14,970][106225] Updated weights for policy 1, policy_version 418997 (0.0009) [2023-12-27 22:14:15,037][106225] Updated weights for policy 1, policy_version 419007 (0.0008) [2023-12-27 22:14:15,103][106225] Updated weights for policy 1, policy_version 419017 (0.0007) [2023-12-27 22:14:15,597][106226] Updated weights for policy 0, policy_version 417744 (0.0008) [2023-12-27 22:14:15,656][106226] Updated weights for policy 0, policy_version 417754 (0.0008) [2023-12-27 22:14:15,718][106226] Updated weights for policy 0, policy_version 417764 (0.0008) [2023-12-27 22:14:15,810][106225] Updated weights for policy 1, policy_version 419027 (0.0009) [2023-12-27 22:14:15,863][106225] Updated weights for policy 1, policy_version 419037 (0.0010) [2023-12-27 22:14:15,921][106225] Updated weights for policy 1, policy_version 419047 (0.0007) [2023-12-27 22:14:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 214286336. Throughput: 0: 9676.6, 1: 9711.1. Samples: 214275088. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:16,176][105115] Avg episode reward: [(0, '-4.709'), (1, '-5.516')] [2023-12-27 22:14:16,493][106225] Updated weights for policy 1, policy_version 419057 (0.0006) [2023-12-27 22:14:16,511][106226] Updated weights for policy 0, policy_version 417774 (0.0008) [2023-12-27 22:14:16,547][106225] Updated weights for policy 1, policy_version 419067 (0.0006) [2023-12-27 22:14:16,565][106226] Updated weights for policy 0, policy_version 417784 (0.0008) [2023-12-27 22:14:16,601][106225] Updated weights for policy 1, policy_version 419077 (0.0005) [2023-12-27 22:14:16,620][106226] Updated weights for policy 0, policy_version 417794 (0.0009) [2023-12-27 22:14:16,656][106225] Updated weights for policy 1, policy_version 419087 (0.0005) [2023-12-27 22:14:17,305][106225] Updated weights for policy 1, policy_version 419097 (0.0010) [2023-12-27 22:14:17,361][106225] Updated weights for policy 1, policy_version 419107 (0.0010) [2023-12-27 22:14:17,398][106226] Updated weights for policy 0, policy_version 417804 (0.0007) [2023-12-27 22:14:17,414][106225] Updated weights for policy 1, policy_version 419117 (0.0008) [2023-12-27 22:14:17,464][106226] Updated weights for policy 0, policy_version 417814 (0.0007) [2023-12-27 22:14:17,525][106226] Updated weights for policy 0, policy_version 417824 (0.0008) [2023-12-27 22:14:17,984][106225] Updated weights for policy 1, policy_version 419127 (0.0006) [2023-12-27 22:14:18,041][106225] Updated weights for policy 1, policy_version 419137 (0.0010) [2023-12-27 22:14:18,092][106225] Updated weights for policy 1, policy_version 419147 (0.0010) [2023-12-27 22:14:18,323][106226] Updated weights for policy 0, policy_version 417834 (0.0008) [2023-12-27 22:14:18,391][106226] Updated weights for policy 0, policy_version 417844 (0.0008) [2023-12-27 22:14:18,454][106226] Updated weights for policy 0, policy_version 417854 (0.0008) [2023-12-27 22:14:18,512][106226] Updated weights for policy 0, policy_version 417864 (0.0008) [2023-12-27 22:14:18,826][106225] Updated weights for policy 1, policy_version 419157 (0.0008) [2023-12-27 22:14:18,894][106225] Updated weights for policy 1, policy_version 419167 (0.0007) [2023-12-27 22:14:18,959][106225] Updated weights for policy 1, policy_version 419177 (0.0008) [2023-12-27 22:14:19,177][106226] Updated weights for policy 0, policy_version 417874 (0.0006) [2023-12-27 22:14:19,233][106226] Updated weights for policy 0, policy_version 417884 (0.0006) [2023-12-27 22:14:19,295][106226] Updated weights for policy 0, policy_version 417894 (0.0008) [2023-12-27 22:14:19,650][106225] Updated weights for policy 1, policy_version 419187 (0.0007) [2023-12-27 22:14:19,713][106225] Updated weights for policy 1, policy_version 419197 (0.0010) [2023-12-27 22:14:19,778][106225] Updated weights for policy 1, policy_version 419207 (0.0009) [2023-12-27 22:14:19,936][106226] Updated weights for policy 0, policy_version 417904 (0.0008) [2023-12-27 22:14:20,009][106226] Updated weights for policy 0, policy_version 417914 (0.0009) [2023-12-27 22:14:20,077][106226] Updated weights for policy 0, policy_version 417924 (0.0009) [2023-12-27 22:14:20,551][106225] Updated weights for policy 1, policy_version 419217 (0.0009) [2023-12-27 22:14:20,619][106225] Updated weights for policy 1, policy_version 419227 (0.0007) [2023-12-27 22:14:20,682][106225] Updated weights for policy 1, policy_version 419237 (0.0005) [2023-12-27 22:14:20,745][106225] Updated weights for policy 1, policy_version 419247 (0.0006) [2023-12-27 22:14:20,828][106226] Updated weights for policy 0, policy_version 417934 (0.0008) [2023-12-27 22:14:20,899][106226] Updated weights for policy 0, policy_version 417944 (0.0008) [2023-12-27 22:14:20,962][106226] Updated weights for policy 0, policy_version 417954 (0.0009) [2023-12-27 22:14:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 214384640. Throughput: 0: 9586.1, 1: 9739.2. Samples: 214391696. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:21,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.636')] [2023-12-27 22:14:21,468][106225] Updated weights for policy 1, policy_version 419257 (0.0006) [2023-12-27 22:14:21,530][106225] Updated weights for policy 1, policy_version 419267 (0.0009) [2023-12-27 22:14:21,593][106225] Updated weights for policy 1, policy_version 419277 (0.0009) [2023-12-27 22:14:21,721][106226] Updated weights for policy 0, policy_version 417964 (0.0009) [2023-12-27 22:14:21,800][106226] Updated weights for policy 0, policy_version 417974 (0.0009) [2023-12-27 22:14:21,870][106226] Updated weights for policy 0, policy_version 417984 (0.0006) [2023-12-27 22:14:22,353][106225] Updated weights for policy 1, policy_version 419287 (0.0009) [2023-12-27 22:14:22,418][106225] Updated weights for policy 1, policy_version 419297 (0.0009) [2023-12-27 22:14:22,465][106225] Updated weights for policy 1, policy_version 419307 (0.0008) [2023-12-27 22:14:22,632][106226] Updated weights for policy 0, policy_version 417994 (0.0008) [2023-12-27 22:14:22,689][106226] Updated weights for policy 0, policy_version 418004 (0.0009) [2023-12-27 22:14:22,750][106226] Updated weights for policy 0, policy_version 418014 (0.0009) [2023-12-27 22:14:22,816][106226] Updated weights for policy 0, policy_version 418024 (0.0009) [2023-12-27 22:14:23,198][106225] Updated weights for policy 1, policy_version 419317 (0.0009) [2023-12-27 22:14:23,247][106225] Updated weights for policy 1, policy_version 419327 (0.0008) [2023-12-27 22:14:23,306][106225] Updated weights for policy 1, policy_version 419337 (0.0009) [2023-12-27 22:14:23,571][106226] Updated weights for policy 0, policy_version 418034 (0.0008) [2023-12-27 22:14:23,627][106226] Updated weights for policy 0, policy_version 418044 (0.0008) [2023-12-27 22:14:23,675][106226] Updated weights for policy 0, policy_version 418054 (0.0009) [2023-12-27 22:14:23,972][106225] Updated weights for policy 1, policy_version 419347 (0.0008) [2023-12-27 22:14:24,031][106225] Updated weights for policy 1, policy_version 419357 (0.0005) [2023-12-27 22:14:24,095][106225] Updated weights for policy 1, policy_version 419367 (0.0005) [2023-12-27 22:14:24,483][106226] Updated weights for policy 0, policy_version 418064 (0.0008) [2023-12-27 22:14:24,554][106226] Updated weights for policy 0, policy_version 418074 (0.0007) [2023-12-27 22:14:24,622][106226] Updated weights for policy 0, policy_version 418084 (0.0008) [2023-12-27 22:14:24,740][106225] Updated weights for policy 1, policy_version 419377 (0.0007) [2023-12-27 22:14:24,795][106225] Updated weights for policy 1, policy_version 419387 (0.0009) [2023-12-27 22:14:24,859][106225] Updated weights for policy 1, policy_version 419397 (0.0009) [2023-12-27 22:14:24,928][106225] Updated weights for policy 1, policy_version 419407 (0.0009) [2023-12-27 22:14:25,206][106226] Updated weights for policy 0, policy_version 418094 (0.0007) [2023-12-27 22:14:25,262][106226] Updated weights for policy 0, policy_version 418104 (0.0008) [2023-12-27 22:14:25,330][106226] Updated weights for policy 0, policy_version 418114 (0.0008) [2023-12-27 22:14:25,611][106225] Updated weights for policy 1, policy_version 419417 (0.0006) [2023-12-27 22:14:25,678][106225] Updated weights for policy 1, policy_version 419427 (0.0005) [2023-12-27 22:14:25,744][106225] Updated weights for policy 1, policy_version 419437 (0.0005) [2023-12-27 22:14:26,010][106226] Updated weights for policy 0, policy_version 418124 (0.0009) [2023-12-27 22:14:26,069][106226] Updated weights for policy 0, policy_version 418134 (0.0010) [2023-12-27 22:14:26,124][106226] Updated weights for policy 0, policy_version 418144 (0.0009) [2023-12-27 22:14:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 214482944. Throughput: 0: 9544.2, 1: 9704.6. Samples: 214447204. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:26,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.290')] [2023-12-27 22:14:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000418152_107077632.pth... [2023-12-27 22:14:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000419440_107405312.pth... [2023-12-27 22:14:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000417032_106790912.pth [2023-12-27 22:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000418320_107118592.pth [2023-12-27 22:14:26,269][106225] Updated weights for policy 1, policy_version 419447 (0.0007) [2023-12-27 22:14:26,339][106225] Updated weights for policy 1, policy_version 419457 (0.0006) [2023-12-27 22:14:26,408][106225] Updated weights for policy 1, policy_version 419467 (0.0006) [2023-12-27 22:14:26,812][106226] Updated weights for policy 0, policy_version 418154 (0.0009) [2023-12-27 22:14:26,877][106226] Updated weights for policy 0, policy_version 418164 (0.0008) [2023-12-27 22:14:26,940][106226] Updated weights for policy 0, policy_version 418174 (0.0007) [2023-12-27 22:14:26,971][106225] Updated weights for policy 1, policy_version 419477 (0.0008) [2023-12-27 22:14:26,992][106226] Updated weights for policy 0, policy_version 418184 (0.0007) [2023-12-27 22:14:27,023][106225] Updated weights for policy 1, policy_version 419487 (0.0009) [2023-12-27 22:14:27,084][106225] Updated weights for policy 1, policy_version 419497 (0.0008) [2023-12-27 22:14:27,727][106226] Updated weights for policy 0, policy_version 418194 (0.0010) [2023-12-27 22:14:27,797][106226] Updated weights for policy 0, policy_version 418204 (0.0010) [2023-12-27 22:14:27,802][106225] Updated weights for policy 1, policy_version 419507 (0.0008) [2023-12-27 22:14:27,855][106225] Updated weights for policy 1, policy_version 419517 (0.0006) [2023-12-27 22:14:27,865][106226] Updated weights for policy 0, policy_version 418214 (0.0009) [2023-12-27 22:14:27,914][106225] Updated weights for policy 1, policy_version 419527 (0.0007) [2023-12-27 22:14:28,592][106226] Updated weights for policy 0, policy_version 418224 (0.0008) [2023-12-27 22:14:28,599][106225] Updated weights for policy 1, policy_version 419537 (0.0008) [2023-12-27 22:14:28,648][106226] Updated weights for policy 0, policy_version 418234 (0.0006) [2023-12-27 22:14:28,650][106225] Updated weights for policy 1, policy_version 419547 (0.0007) [2023-12-27 22:14:28,697][106226] Updated weights for policy 0, policy_version 418244 (0.0006) [2023-12-27 22:14:28,699][106225] Updated weights for policy 1, policy_version 419557 (0.0007) [2023-12-27 22:14:28,749][106225] Updated weights for policy 1, policy_version 419567 (0.0008) [2023-12-27 22:14:29,415][106226] Updated weights for policy 0, policy_version 418254 (0.0006) [2023-12-27 22:14:29,485][106226] Updated weights for policy 0, policy_version 418264 (0.0006) [2023-12-27 22:14:29,543][106226] Updated weights for policy 0, policy_version 418274 (0.0005) [2023-12-27 22:14:29,543][106225] Updated weights for policy 1, policy_version 419577 (0.0008) [2023-12-27 22:14:29,609][106225] Updated weights for policy 1, policy_version 419587 (0.0008) [2023-12-27 22:14:29,674][106225] Updated weights for policy 1, policy_version 419597 (0.0009) [2023-12-27 22:14:30,179][106226] Updated weights for policy 0, policy_version 418284 (0.0007) [2023-12-27 22:14:30,235][106226] Updated weights for policy 0, policy_version 418294 (0.0008) [2023-12-27 22:14:30,287][106226] Updated weights for policy 0, policy_version 418304 (0.0009) [2023-12-27 22:14:30,422][106225] Updated weights for policy 1, policy_version 419607 (0.0008) [2023-12-27 22:14:30,480][106225] Updated weights for policy 1, policy_version 419617 (0.0007) [2023-12-27 22:14:30,537][106225] Updated weights for policy 1, policy_version 419627 (0.0007) [2023-12-27 22:14:31,024][106226] Updated weights for policy 0, policy_version 418314 (0.0010) [2023-12-27 22:14:31,098][106226] Updated weights for policy 0, policy_version 418325 (0.0007) [2023-12-27 22:14:31,158][106226] Updated weights for policy 0, policy_version 418335 (0.0013) [2023-12-27 22:14:31,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 214573056. Throughput: 0: 9611.0, 1: 9804.5. Samples: 214569512. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:31,175][105115] Avg episode reward: [(0, '-5.090'), (1, '-5.209')] [2023-12-27 22:14:31,304][106225] Updated weights for policy 1, policy_version 419637 (0.0008) [2023-12-27 22:14:31,374][106225] Updated weights for policy 1, policy_version 419647 (0.0007) [2023-12-27 22:14:31,440][106225] Updated weights for policy 1, policy_version 419657 (0.0007) [2023-12-27 22:14:31,924][106226] Updated weights for policy 0, policy_version 418345 (0.0010) [2023-12-27 22:14:31,984][106226] Updated weights for policy 0, policy_version 418355 (0.0008) [2023-12-27 22:14:32,037][106225] Updated weights for policy 1, policy_version 419667 (0.0006) [2023-12-27 22:14:32,045][106226] Updated weights for policy 0, policy_version 418365 (0.0007) [2023-12-27 22:14:32,102][106225] Updated weights for policy 1, policy_version 419677 (0.0007) [2023-12-27 22:14:32,107][106226] Updated weights for policy 0, policy_version 418375 (0.0008) [2023-12-27 22:14:32,165][106225] Updated weights for policy 1, policy_version 419687 (0.0007) [2023-12-27 22:14:32,813][106226] Updated weights for policy 0, policy_version 418385 (0.0010) [2023-12-27 22:14:32,867][106226] Updated weights for policy 0, policy_version 418395 (0.0010) [2023-12-27 22:14:32,877][106225] Updated weights for policy 1, policy_version 419697 (0.0007) [2023-12-27 22:14:32,931][106226] Updated weights for policy 0, policy_version 418405 (0.0006) [2023-12-27 22:14:32,934][106225] Updated weights for policy 1, policy_version 419707 (0.0008) [2023-12-27 22:14:32,994][106225] Updated weights for policy 1, policy_version 419717 (0.0009) [2023-12-27 22:14:33,049][106225] Updated weights for policy 1, policy_version 419727 (0.0008) [2023-12-27 22:14:33,516][106226] Updated weights for policy 0, policy_version 418415 (0.0005) [2023-12-27 22:14:33,568][106226] Updated weights for policy 0, policy_version 418425 (0.0005) [2023-12-27 22:14:33,622][106226] Updated weights for policy 0, policy_version 418435 (0.0005) [2023-12-27 22:14:33,788][106225] Updated weights for policy 1, policy_version 419737 (0.0008) [2023-12-27 22:14:33,841][106225] Updated weights for policy 1, policy_version 419747 (0.0008) [2023-12-27 22:14:33,898][106225] Updated weights for policy 1, policy_version 419757 (0.0008) [2023-12-27 22:14:34,138][106226] Updated weights for policy 0, policy_version 418445 (0.0006) [2023-12-27 22:14:34,199][106226] Updated weights for policy 0, policy_version 418455 (0.0008) [2023-12-27 22:14:34,258][106226] Updated weights for policy 0, policy_version 418465 (0.0008) [2023-12-27 22:14:34,692][106225] Updated weights for policy 1, policy_version 419767 (0.0009) [2023-12-27 22:14:34,756][106225] Updated weights for policy 1, policy_version 419777 (0.0009) [2023-12-27 22:14:34,814][106225] Updated weights for policy 1, policy_version 419787 (0.0008) [2023-12-27 22:14:34,948][106226] Updated weights for policy 0, policy_version 418475 (0.0008) [2023-12-27 22:14:34,999][106226] Updated weights for policy 0, policy_version 418485 (0.0007) [2023-12-27 22:14:35,048][106226] Updated weights for policy 0, policy_version 418495 (0.0008) [2023-12-27 22:14:35,597][106225] Updated weights for policy 1, policy_version 419797 (0.0008) [2023-12-27 22:14:35,644][106226] Updated weights for policy 0, policy_version 418505 (0.0005) [2023-12-27 22:14:35,646][106225] Updated weights for policy 1, policy_version 419807 (0.0009) [2023-12-27 22:14:35,692][106225] Updated weights for policy 1, policy_version 419817 (0.0007) [2023-12-27 22:14:35,704][106226] Updated weights for policy 0, policy_version 418515 (0.0006) [2023-12-27 22:14:35,773][106226] Updated weights for policy 0, policy_version 418525 (0.0009) [2023-12-27 22:14:35,838][106226] Updated weights for policy 0, policy_version 418535 (0.0007) [2023-12-27 22:14:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19494.2). Total num frames: 214679552. Throughput: 0: 9709.0, 1: 9744.7. Samples: 214688876. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:36,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.420')] [2023-12-27 22:14:36,373][106225] Updated weights for policy 1, policy_version 419827 (0.0007) [2023-12-27 22:14:36,435][106225] Updated weights for policy 1, policy_version 419837 (0.0010) [2023-12-27 22:14:36,467][106226] Updated weights for policy 0, policy_version 418545 (0.0007) [2023-12-27 22:14:36,499][106225] Updated weights for policy 1, policy_version 419847 (0.0010) [2023-12-27 22:14:36,531][106226] Updated weights for policy 0, policy_version 418555 (0.0007) [2023-12-27 22:14:36,597][106226] Updated weights for policy 0, policy_version 418565 (0.0007) [2023-12-27 22:14:37,233][106225] Updated weights for policy 1, policy_version 419857 (0.0011) [2023-12-27 22:14:37,288][106225] Updated weights for policy 1, policy_version 419867 (0.0010) [2023-12-27 22:14:37,306][106226] Updated weights for policy 0, policy_version 418575 (0.0008) [2023-12-27 22:14:37,349][106225] Updated weights for policy 1, policy_version 419877 (0.0010) [2023-12-27 22:14:37,367][106226] Updated weights for policy 0, policy_version 418585 (0.0006) [2023-12-27 22:14:37,418][106225] Updated weights for policy 1, policy_version 419887 (0.0011) [2023-12-27 22:14:37,427][106226] Updated weights for policy 0, policy_version 418595 (0.0009) [2023-12-27 22:14:38,103][106225] Updated weights for policy 1, policy_version 419897 (0.0009) [2023-12-27 22:14:38,148][106225] Updated weights for policy 1, policy_version 419907 (0.0008) [2023-12-27 22:14:38,191][106226] Updated weights for policy 0, policy_version 418605 (0.0008) [2023-12-27 22:14:38,198][106225] Updated weights for policy 1, policy_version 419917 (0.0008) [2023-12-27 22:14:38,238][106226] Updated weights for policy 0, policy_version 418615 (0.0007) [2023-12-27 22:14:38,289][106226] Updated weights for policy 0, policy_version 418625 (0.0005) [2023-12-27 22:14:38,976][106225] Updated weights for policy 1, policy_version 419927 (0.0008) [2023-12-27 22:14:39,024][106226] Updated weights for policy 0, policy_version 418635 (0.0008) [2023-12-27 22:14:39,037][106225] Updated weights for policy 1, policy_version 419937 (0.0007) [2023-12-27 22:14:39,084][106226] Updated weights for policy 0, policy_version 418645 (0.0008) [2023-12-27 22:14:39,093][106225] Updated weights for policy 1, policy_version 419947 (0.0008) [2023-12-27 22:14:39,147][106226] Updated weights for policy 0, policy_version 418655 (0.0007) [2023-12-27 22:14:39,794][106225] Updated weights for policy 1, policy_version 419957 (0.0008) [2023-12-27 22:14:39,857][106225] Updated weights for policy 1, policy_version 419967 (0.0008) [2023-12-27 22:14:39,918][106225] Updated weights for policy 1, policy_version 419977 (0.0007) [2023-12-27 22:14:39,982][106226] Updated weights for policy 0, policy_version 418665 (0.0009) [2023-12-27 22:14:40,040][106226] Updated weights for policy 0, policy_version 418675 (0.0008) [2023-12-27 22:14:40,091][106226] Updated weights for policy 0, policy_version 418685 (0.0009) [2023-12-27 22:14:40,156][106226] Updated weights for policy 0, policy_version 418695 (0.0008) [2023-12-27 22:14:40,627][106225] Updated weights for policy 1, policy_version 419987 (0.0008) [2023-12-27 22:14:40,677][106225] Updated weights for policy 1, policy_version 419997 (0.0008) [2023-12-27 22:14:40,731][106225] Updated weights for policy 1, policy_version 420007 (0.0009) [2023-12-27 22:14:40,893][106226] Updated weights for policy 0, policy_version 418705 (0.0006) [2023-12-27 22:14:40,949][106226] Updated weights for policy 0, policy_version 418715 (0.0007) [2023-12-27 22:14:41,014][106226] Updated weights for policy 0, policy_version 418725 (0.0009) [2023-12-27 22:14:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 214777856. Throughput: 0: 9698.5, 1: 9762.1. Samples: 214746868. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:41,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-5.169')] [2023-12-27 22:14:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000420016_107552768.pth... [2023-12-27 22:14:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000418728_107225088.pth... [2023-12-27 22:14:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000418864_107257856.pth [2023-12-27 22:14:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000417608_106938368.pth [2023-12-27 22:14:41,580][106225] Updated weights for policy 1, policy_version 420017 (0.0008) [2023-12-27 22:14:41,647][106225] Updated weights for policy 1, policy_version 420027 (0.0008) [2023-12-27 22:14:41,716][106225] Updated weights for policy 1, policy_version 420037 (0.0007) [2023-12-27 22:14:41,776][106226] Updated weights for policy 0, policy_version 418735 (0.0009) [2023-12-27 22:14:41,789][106225] Updated weights for policy 1, policy_version 420047 (0.0008) [2023-12-27 22:14:41,832][106226] Updated weights for policy 0, policy_version 418745 (0.0010) [2023-12-27 22:14:41,895][106226] Updated weights for policy 0, policy_version 418755 (0.0008) [2023-12-27 22:14:42,557][106225] Updated weights for policy 1, policy_version 420057 (0.0008) [2023-12-27 22:14:42,617][106225] Updated weights for policy 1, policy_version 420067 (0.0009) [2023-12-27 22:14:42,633][106226] Updated weights for policy 0, policy_version 418765 (0.0007) [2023-12-27 22:14:42,672][106225] Updated weights for policy 1, policy_version 420077 (0.0008) [2023-12-27 22:14:42,691][106226] Updated weights for policy 0, policy_version 418775 (0.0006) [2023-12-27 22:14:42,754][106226] Updated weights for policy 0, policy_version 418785 (0.0009) [2023-12-27 22:14:43,417][106225] Updated weights for policy 1, policy_version 420087 (0.0008) [2023-12-27 22:14:43,479][106225] Updated weights for policy 1, policy_version 420097 (0.0007) [2023-12-27 22:14:43,481][106226] Updated weights for policy 0, policy_version 418795 (0.0008) [2023-12-27 22:14:43,532][106226] Updated weights for policy 0, policy_version 418805 (0.0006) [2023-12-27 22:14:43,538][106225] Updated weights for policy 1, policy_version 420107 (0.0008) [2023-12-27 22:14:43,576][106226] Updated weights for policy 0, policy_version 418815 (0.0008) [2023-12-27 22:14:44,265][106225] Updated weights for policy 1, policy_version 420117 (0.0008) [2023-12-27 22:14:44,321][106226] Updated weights for policy 0, policy_version 418825 (0.0009) [2023-12-27 22:14:44,323][106225] Updated weights for policy 1, policy_version 420127 (0.0008) [2023-12-27 22:14:44,379][106226] Updated weights for policy 0, policy_version 418835 (0.0006) [2023-12-27 22:14:44,381][106225] Updated weights for policy 1, policy_version 420137 (0.0006) [2023-12-27 22:14:44,434][106226] Updated weights for policy 0, policy_version 418845 (0.0006) [2023-12-27 22:14:44,493][106226] Updated weights for policy 0, policy_version 418855 (0.0009) [2023-12-27 22:14:45,141][106225] Updated weights for policy 1, policy_version 420147 (0.0007) [2023-12-27 22:14:45,202][106225] Updated weights for policy 1, policy_version 420157 (0.0007) [2023-12-27 22:14:45,226][106226] Updated weights for policy 0, policy_version 418865 (0.0010) [2023-12-27 22:14:45,262][106225] Updated weights for policy 1, policy_version 420167 (0.0010) [2023-12-27 22:14:45,281][106226] Updated weights for policy 0, policy_version 418875 (0.0006) [2023-12-27 22:14:45,342][106226] Updated weights for policy 0, policy_version 418885 (0.0007) [2023-12-27 22:14:45,995][106225] Updated weights for policy 1, policy_version 420177 (0.0011) [2023-12-27 22:14:46,040][106225] Updated weights for policy 1, policy_version 420187 (0.0008) [2023-12-27 22:14:46,058][106226] Updated weights for policy 0, policy_version 418895 (0.0008) [2023-12-27 22:14:46,087][106225] Updated weights for policy 1, policy_version 420197 (0.0008) [2023-12-27 22:14:46,112][106226] Updated weights for policy 0, policy_version 418905 (0.0008) [2023-12-27 22:14:46,134][106225] Updated weights for policy 1, policy_version 420207 (0.0006) [2023-12-27 22:14:46,164][106226] Updated weights for policy 0, policy_version 418915 (0.0008) [2023-12-27 22:14:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 214867968. Throughput: 0: 9642.7, 1: 9717.7. Samples: 214858256. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:46,175][105115] Avg episode reward: [(0, '-4.872'), (1, '-5.582')] [2023-12-27 22:14:46,870][106225] Updated weights for policy 1, policy_version 420217 (0.0009) [2023-12-27 22:14:46,915][106226] Updated weights for policy 0, policy_version 418925 (0.0007) [2023-12-27 22:14:46,917][106225] Updated weights for policy 1, policy_version 420227 (0.0010) [2023-12-27 22:14:46,968][106225] Updated weights for policy 1, policy_version 420237 (0.0010) [2023-12-27 22:14:46,970][106226] Updated weights for policy 0, policy_version 418935 (0.0006) [2023-12-27 22:14:47,030][106226] Updated weights for policy 0, policy_version 418945 (0.0008) [2023-12-27 22:14:47,697][106225] Updated weights for policy 1, policy_version 420247 (0.0010) [2023-12-27 22:14:47,748][106225] Updated weights for policy 1, policy_version 420257 (0.0010) [2023-12-27 22:14:47,750][106226] Updated weights for policy 0, policy_version 418955 (0.0007) [2023-12-27 22:14:47,805][106225] Updated weights for policy 1, policy_version 420267 (0.0010) [2023-12-27 22:14:47,811][106226] Updated weights for policy 0, policy_version 418965 (0.0006) [2023-12-27 22:14:47,879][106226] Updated weights for policy 0, policy_version 418975 (0.0005) [2023-12-27 22:14:48,411][106225] Updated weights for policy 1, policy_version 420277 (0.0009) [2023-12-27 22:14:48,473][106225] Updated weights for policy 1, policy_version 420287 (0.0010) [2023-12-27 22:14:48,487][106226] Updated weights for policy 0, policy_version 418985 (0.0009) [2023-12-27 22:14:48,538][106225] Updated weights for policy 1, policy_version 420297 (0.0010) [2023-12-27 22:14:48,560][106226] Updated weights for policy 0, policy_version 418995 (0.0008) [2023-12-27 22:14:48,630][106226] Updated weights for policy 0, policy_version 419005 (0.0008) [2023-12-27 22:14:48,695][106226] Updated weights for policy 0, policy_version 419015 (0.0008) [2023-12-27 22:14:49,183][106225] Updated weights for policy 1, policy_version 420307 (0.0006) [2023-12-27 22:14:49,245][106225] Updated weights for policy 1, policy_version 420317 (0.0007) [2023-12-27 22:14:49,306][106225] Updated weights for policy 1, policy_version 420327 (0.0009) [2023-12-27 22:14:49,470][106226] Updated weights for policy 0, policy_version 419025 (0.0006) [2023-12-27 22:14:49,523][106226] Updated weights for policy 0, policy_version 419035 (0.0005) [2023-12-27 22:14:49,604][106226] Updated weights for policy 0, policy_version 419045 (0.0006) [2023-12-27 22:14:50,149][106225] Updated weights for policy 1, policy_version 420337 (0.0008) [2023-12-27 22:14:50,213][106225] Updated weights for policy 1, policy_version 420347 (0.0008) [2023-12-27 22:14:50,233][106226] Updated weights for policy 0, policy_version 419055 (0.0007) [2023-12-27 22:14:50,273][106225] Updated weights for policy 1, policy_version 420357 (0.0008) [2023-12-27 22:14:50,296][106226] Updated weights for policy 0, policy_version 419065 (0.0007) [2023-12-27 22:14:50,331][106225] Updated weights for policy 1, policy_version 420367 (0.0008) [2023-12-27 22:14:50,358][106226] Updated weights for policy 0, policy_version 419075 (0.0008) [2023-12-27 22:14:51,083][106226] Updated weights for policy 0, policy_version 419085 (0.0007) [2023-12-27 22:14:51,106][106225] Updated weights for policy 1, policy_version 420377 (0.0008) [2023-12-27 22:14:51,145][106226] Updated weights for policy 0, policy_version 419095 (0.0007) [2023-12-27 22:14:51,165][106225] Updated weights for policy 1, policy_version 420387 (0.0006) [2023-12-27 22:14:51,175][105115] Fps is (10 sec: 18022.6, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 214958080. Throughput: 0: 9654.3, 1: 9689.6. Samples: 214975512. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:51,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.423')] [2023-12-27 22:14:51,197][106226] Updated weights for policy 0, policy_version 419105 (0.0008) [2023-12-27 22:14:51,219][106225] Updated weights for policy 1, policy_version 420397 (0.0007) [2023-12-27 22:14:51,925][106225] Updated weights for policy 1, policy_version 420407 (0.0007) [2023-12-27 22:14:51,974][106225] Updated weights for policy 1, policy_version 420417 (0.0009) [2023-12-27 22:14:52,023][106226] Updated weights for policy 0, policy_version 419115 (0.0008) [2023-12-27 22:14:52,033][106225] Updated weights for policy 1, policy_version 420427 (0.0008) [2023-12-27 22:14:52,083][106226] Updated weights for policy 0, policy_version 419125 (0.0007) [2023-12-27 22:14:52,146][106226] Updated weights for policy 0, policy_version 419135 (0.0009) [2023-12-27 22:14:52,759][106225] Updated weights for policy 1, policy_version 420437 (0.0006) [2023-12-27 22:14:52,822][106225] Updated weights for policy 1, policy_version 420447 (0.0009) [2023-12-27 22:14:52,855][106226] Updated weights for policy 0, policy_version 419145 (0.0007) [2023-12-27 22:14:52,889][106225] Updated weights for policy 1, policy_version 420457 (0.0007) [2023-12-27 22:14:52,916][106226] Updated weights for policy 0, policy_version 419155 (0.0005) [2023-12-27 22:14:52,965][106226] Updated weights for policy 0, policy_version 419165 (0.0005) [2023-12-27 22:14:53,012][106226] Updated weights for policy 0, policy_version 419175 (0.0005) [2023-12-27 22:14:53,483][106225] Updated weights for policy 1, policy_version 420467 (0.0008) [2023-12-27 22:14:53,544][106225] Updated weights for policy 1, policy_version 420477 (0.0006) [2023-12-27 22:14:53,609][106225] Updated weights for policy 1, policy_version 420487 (0.0005) [2023-12-27 22:14:53,736][106226] Updated weights for policy 0, policy_version 419185 (0.0008) [2023-12-27 22:14:53,794][106226] Updated weights for policy 0, policy_version 419195 (0.0008) [2023-12-27 22:14:53,846][106226] Updated weights for policy 0, policy_version 419205 (0.0008) [2023-12-27 22:14:54,166][106225] Updated weights for policy 1, policy_version 420497 (0.0006) [2023-12-27 22:14:54,226][106225] Updated weights for policy 1, policy_version 420507 (0.0008) [2023-12-27 22:14:54,285][106225] Updated weights for policy 1, policy_version 420517 (0.0009) [2023-12-27 22:14:54,347][106225] Updated weights for policy 1, policy_version 420527 (0.0008) [2023-12-27 22:14:54,610][106226] Updated weights for policy 0, policy_version 419215 (0.0008) [2023-12-27 22:14:54,657][106226] Updated weights for policy 0, policy_version 419225 (0.0008) [2023-12-27 22:14:54,717][106226] Updated weights for policy 0, policy_version 419235 (0.0008) [2023-12-27 22:14:55,033][106225] Updated weights for policy 1, policy_version 420537 (0.0009) [2023-12-27 22:14:55,104][106225] Updated weights for policy 1, policy_version 420547 (0.0008) [2023-12-27 22:14:55,170][106225] Updated weights for policy 1, policy_version 420557 (0.0009) [2023-12-27 22:14:55,474][106226] Updated weights for policy 0, policy_version 419245 (0.0009) [2023-12-27 22:14:55,537][106226] Updated weights for policy 0, policy_version 419255 (0.0009) [2023-12-27 22:14:55,601][106226] Updated weights for policy 0, policy_version 419265 (0.0009) [2023-12-27 22:14:55,865][106225] Updated weights for policy 1, policy_version 420567 (0.0007) [2023-12-27 22:14:55,925][106225] Updated weights for policy 1, policy_version 420577 (0.0009) [2023-12-27 22:14:55,980][106225] Updated weights for policy 1, policy_version 420587 (0.0008) [2023-12-27 22:14:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 215064576. Throughput: 0: 9581.3, 1: 9748.3. Samples: 215032992. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:14:56,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-5.689')] [2023-12-27 22:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000420592_107700224.pth... [2023-12-27 22:14:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000419272_107364352.pth... [2023-12-27 22:14:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000419440_107405312.pth [2023-12-27 22:14:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000418152_107077632.pth [2023-12-27 22:14:56,384][106226] Updated weights for policy 0, policy_version 419275 (0.0009) [2023-12-27 22:14:56,433][106226] Updated weights for policy 0, policy_version 419285 (0.0008) [2023-12-27 22:14:56,482][106226] Updated weights for policy 0, policy_version 419295 (0.0008) [2023-12-27 22:14:56,542][106225] Updated weights for policy 1, policy_version 420597 (0.0007) [2023-12-27 22:14:56,594][106225] Updated weights for policy 1, policy_version 420607 (0.0008) [2023-12-27 22:14:56,643][106225] Updated weights for policy 1, policy_version 420617 (0.0008) [2023-12-27 22:14:57,237][106226] Updated weights for policy 0, policy_version 419305 (0.0008) [2023-12-27 22:14:57,302][106226] Updated weights for policy 0, policy_version 419315 (0.0008) [2023-12-27 22:14:57,361][106226] Updated weights for policy 0, policy_version 419325 (0.0008) [2023-12-27 22:14:57,396][106225] Updated weights for policy 1, policy_version 420627 (0.0007) [2023-12-27 22:14:57,420][106226] Updated weights for policy 0, policy_version 419335 (0.0008) [2023-12-27 22:14:57,457][106225] Updated weights for policy 1, policy_version 420637 (0.0008) [2023-12-27 22:14:57,517][106225] Updated weights for policy 1, policy_version 420647 (0.0009) [2023-12-27 22:14:58,143][106226] Updated weights for policy 0, policy_version 419345 (0.0008) [2023-12-27 22:14:58,209][106226] Updated weights for policy 0, policy_version 419355 (0.0008) [2023-12-27 22:14:58,238][106225] Updated weights for policy 1, policy_version 420657 (0.0008) [2023-12-27 22:14:58,275][106226] Updated weights for policy 0, policy_version 419365 (0.0009) [2023-12-27 22:14:58,301][106225] Updated weights for policy 1, policy_version 420667 (0.0008) [2023-12-27 22:14:58,375][106225] Updated weights for policy 1, policy_version 420677 (0.0008) [2023-12-27 22:14:58,440][106225] Updated weights for policy 1, policy_version 420687 (0.0007) [2023-12-27 22:14:59,227][106226] Updated weights for policy 0, policy_version 419375 (0.0007) [2023-12-27 22:14:59,285][106225] Updated weights for policy 1, policy_version 420697 (0.0008) [2023-12-27 22:14:59,295][106226] Updated weights for policy 0, policy_version 419385 (0.0008) [2023-12-27 22:14:59,362][106226] Updated weights for policy 0, policy_version 419395 (0.0009) [2023-12-27 22:14:59,365][106225] Updated weights for policy 1, policy_version 420707 (0.0007) [2023-12-27 22:14:59,438][106225] Updated weights for policy 1, policy_version 420717 (0.0008) [2023-12-27 22:15:00,094][106226] Updated weights for policy 0, policy_version 419405 (0.0009) [2023-12-27 22:15:00,113][106225] Updated weights for policy 1, policy_version 420727 (0.0006) [2023-12-27 22:15:00,162][106226] Updated weights for policy 0, policy_version 419415 (0.0008) [2023-12-27 22:15:00,166][106225] Updated weights for policy 1, policy_version 420737 (0.0006) [2023-12-27 22:15:00,229][106225] Updated weights for policy 1, policy_version 420747 (0.0006) [2023-12-27 22:15:00,230][106226] Updated weights for policy 0, policy_version 419425 (0.0008) [2023-12-27 22:15:00,930][106226] Updated weights for policy 0, policy_version 419435 (0.0008) [2023-12-27 22:15:00,951][106225] Updated weights for policy 1, policy_version 420757 (0.0008) [2023-12-27 22:15:00,991][106226] Updated weights for policy 0, policy_version 419445 (0.0005) [2023-12-27 22:15:01,004][106225] Updated weights for policy 1, policy_version 420767 (0.0010) [2023-12-27 22:15:01,055][106226] Updated weights for policy 0, policy_version 419455 (0.0007) [2023-12-27 22:15:01,073][106225] Updated weights for policy 1, policy_version 420777 (0.0009) [2023-12-27 22:15:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 215162880. Throughput: 0: 9577.1, 1: 9790.8. Samples: 215146640. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-27 22:15:01,175][105115] Avg episode reward: [(0, '-5.060'), (1, '-5.476')] [2023-12-27 22:15:01,784][106226] Updated weights for policy 0, policy_version 419465 (0.0006) [2023-12-27 22:15:01,844][106226] Updated weights for policy 0, policy_version 419475 (0.0008) [2023-12-27 22:15:01,851][106225] Updated weights for policy 1, policy_version 420787 (0.0009) [2023-12-27 22:15:01,900][106226] Updated weights for policy 0, policy_version 419485 (0.0007) [2023-12-27 22:15:01,902][106225] Updated weights for policy 1, policy_version 420797 (0.0005) [2023-12-27 22:15:01,964][106225] Updated weights for policy 1, policy_version 420807 (0.0006) [2023-12-27 22:15:01,965][106226] Updated weights for policy 0, policy_version 419495 (0.0008) [2023-12-27 22:15:02,665][106225] Updated weights for policy 1, policy_version 420817 (0.0008) [2023-12-27 22:15:02,694][106226] Updated weights for policy 0, policy_version 419505 (0.0009) [2023-12-27 22:15:02,725][106225] Updated weights for policy 1, policy_version 420827 (0.0006) [2023-12-27 22:15:02,752][106226] Updated weights for policy 0, policy_version 419515 (0.0008) [2023-12-27 22:15:02,778][106225] Updated weights for policy 1, policy_version 420837 (0.0007) [2023-12-27 22:15:02,814][106226] Updated weights for policy 0, policy_version 419525 (0.0007) [2023-12-27 22:15:02,835][106225] Updated weights for policy 1, policy_version 420847 (0.0008) [2023-12-27 22:15:03,476][106226] Updated weights for policy 0, policy_version 419535 (0.0007) [2023-12-27 22:15:03,531][106226] Updated weights for policy 0, policy_version 419545 (0.0005) [2023-12-27 22:15:03,557][106225] Updated weights for policy 1, policy_version 420857 (0.0009) [2023-12-27 22:15:03,588][106226] Updated weights for policy 0, policy_version 419555 (0.0007) [2023-12-27 22:15:03,606][106225] Updated weights for policy 1, policy_version 420867 (0.0008) [2023-12-27 22:15:03,669][106225] Updated weights for policy 1, policy_version 420877 (0.0007) [2023-12-27 22:15:04,224][106226] Updated weights for policy 0, policy_version 419565 (0.0006) [2023-12-27 22:15:04,291][106226] Updated weights for policy 0, policy_version 419575 (0.0007) [2023-12-27 22:15:04,353][106226] Updated weights for policy 0, policy_version 419585 (0.0006) [2023-12-27 22:15:04,355][106225] Updated weights for policy 1, policy_version 420887 (0.0009) [2023-12-27 22:15:04,417][106225] Updated weights for policy 1, policy_version 420897 (0.0010) [2023-12-27 22:15:04,475][106225] Updated weights for policy 1, policy_version 420907 (0.0010) [2023-12-27 22:15:05,000][106226] Updated weights for policy 0, policy_version 419595 (0.0006) [2023-12-27 22:15:05,062][106226] Updated weights for policy 0, policy_version 419605 (0.0005) [2023-12-27 22:15:05,116][106226] Updated weights for policy 0, policy_version 419615 (0.0007) [2023-12-27 22:15:05,124][106225] Updated weights for policy 1, policy_version 420917 (0.0008) [2023-12-27 22:15:05,187][106225] Updated weights for policy 1, policy_version 420927 (0.0010) [2023-12-27 22:15:05,248][106225] Updated weights for policy 1, policy_version 420937 (0.0010) [2023-12-27 22:15:05,735][106226] Updated weights for policy 0, policy_version 419625 (0.0010) [2023-12-27 22:15:05,787][106226] Updated weights for policy 0, policy_version 419635 (0.0010) [2023-12-27 22:15:05,842][106226] Updated weights for policy 0, policy_version 419645 (0.0010) [2023-12-27 22:15:05,899][106226] Updated weights for policy 0, policy_version 419655 (0.0010) [2023-12-27 22:15:05,956][106225] Updated weights for policy 1, policy_version 420947 (0.0009) [2023-12-27 22:15:06,003][106225] Updated weights for policy 1, policy_version 420957 (0.0008) [2023-12-27 22:15:06,049][106225] Updated weights for policy 1, policy_version 420967 (0.0007) [2023-12-27 22:15:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19521.9). Total num frames: 215261184. Throughput: 0: 9683.3, 1: 9749.0. Samples: 215266148. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:06,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.706')] [2023-12-27 22:15:06,627][106226] Updated weights for policy 0, policy_version 419665 (0.0008) [2023-12-27 22:15:06,693][106226] Updated weights for policy 0, policy_version 419675 (0.0005) [2023-12-27 22:15:06,757][106226] Updated weights for policy 0, policy_version 419685 (0.0010) [2023-12-27 22:15:06,845][106225] Updated weights for policy 1, policy_version 420977 (0.0008) [2023-12-27 22:15:06,911][106225] Updated weights for policy 1, policy_version 420987 (0.0007) [2023-12-27 22:15:06,977][106225] Updated weights for policy 1, policy_version 420997 (0.0009) [2023-12-27 22:15:07,036][106225] Updated weights for policy 1, policy_version 421007 (0.0009) [2023-12-27 22:15:07,413][106226] Updated weights for policy 0, policy_version 419695 (0.0011) [2023-12-27 22:15:07,475][106226] Updated weights for policy 0, policy_version 419705 (0.0011) [2023-12-27 22:15:07,543][106226] Updated weights for policy 0, policy_version 419715 (0.0009) [2023-12-27 22:15:07,701][106225] Updated weights for policy 1, policy_version 421017 (0.0008) [2023-12-27 22:15:07,760][106225] Updated weights for policy 1, policy_version 421027 (0.0008) [2023-12-27 22:15:07,815][106225] Updated weights for policy 1, policy_version 421037 (0.0008) [2023-12-27 22:15:08,270][106226] Updated weights for policy 0, policy_version 419725 (0.0010) [2023-12-27 22:15:08,324][106226] Updated weights for policy 0, policy_version 419735 (0.0008) [2023-12-27 22:15:08,387][106226] Updated weights for policy 0, policy_version 419745 (0.0008) [2023-12-27 22:15:08,552][106225] Updated weights for policy 1, policy_version 421047 (0.0010) [2023-12-27 22:15:08,617][106225] Updated weights for policy 1, policy_version 421057 (0.0010) [2023-12-27 22:15:08,679][106225] Updated weights for policy 1, policy_version 421067 (0.0011) [2023-12-27 22:15:09,110][106226] Updated weights for policy 0, policy_version 419755 (0.0008) [2023-12-27 22:15:09,160][106226] Updated weights for policy 0, policy_version 419765 (0.0008) [2023-12-27 22:15:09,206][106226] Updated weights for policy 0, policy_version 419775 (0.0007) [2023-12-27 22:15:09,488][106225] Updated weights for policy 1, policy_version 421077 (0.0008) [2023-12-27 22:15:09,550][106225] Updated weights for policy 1, policy_version 421087 (0.0008) [2023-12-27 22:15:09,614][106225] Updated weights for policy 1, policy_version 421097 (0.0008) [2023-12-27 22:15:09,983][106226] Updated weights for policy 0, policy_version 419785 (0.0008) [2023-12-27 22:15:10,042][106226] Updated weights for policy 0, policy_version 419795 (0.0008) [2023-12-27 22:15:10,112][106226] Updated weights for policy 0, policy_version 419805 (0.0009) [2023-12-27 22:15:10,170][106226] Updated weights for policy 0, policy_version 419815 (0.0007) [2023-12-27 22:15:10,328][106225] Updated weights for policy 1, policy_version 421107 (0.0008) [2023-12-27 22:15:10,398][106225] Updated weights for policy 1, policy_version 421117 (0.0008) [2023-12-27 22:15:10,466][106225] Updated weights for policy 1, policy_version 421127 (0.0008) [2023-12-27 22:15:10,877][106226] Updated weights for policy 0, policy_version 419825 (0.0005) [2023-12-27 22:15:10,937][106226] Updated weights for policy 0, policy_version 419835 (0.0007) [2023-12-27 22:15:10,986][106226] Updated weights for policy 0, policy_version 419845 (0.0009) [2023-12-27 22:15:11,163][106225] Updated weights for policy 1, policy_version 421137 (0.0008) [2023-12-27 22:15:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 215351296. Throughput: 0: 9741.6, 1: 9747.5. Samples: 215324212. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:11,175][105115] Avg episode reward: [(0, '-4.967'), (1, '-5.373')] [2023-12-27 22:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000419848_107511808.pth... [2023-12-27 22:15:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000418728_107225088.pth [2023-12-27 22:15:11,225][106225] Updated weights for policy 1, policy_version 421147 (0.0008) [2023-12-27 22:15:11,290][106225] Updated weights for policy 1, policy_version 421157 (0.0008) [2023-12-27 22:15:11,364][106225] Updated weights for policy 1, policy_version 421167 (0.0008) [2023-12-27 22:15:11,371][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000421168_107847680.pth... [2023-12-27 22:15:11,375][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000420016_107552768.pth [2023-12-27 22:15:11,745][106226] Updated weights for policy 0, policy_version 419855 (0.0008) [2023-12-27 22:15:11,814][106226] Updated weights for policy 0, policy_version 419865 (0.0009) [2023-12-27 22:15:11,879][106226] Updated weights for policy 0, policy_version 419875 (0.0008) [2023-12-27 22:15:12,164][106225] Updated weights for policy 1, policy_version 421177 (0.0007) [2023-12-27 22:15:12,231][106225] Updated weights for policy 1, policy_version 421187 (0.0008) [2023-12-27 22:15:12,299][106225] Updated weights for policy 1, policy_version 421197 (0.0008) [2023-12-27 22:15:12,637][106226] Updated weights for policy 0, policy_version 419885 (0.0008) [2023-12-27 22:15:12,697][106226] Updated weights for policy 0, policy_version 419895 (0.0008) [2023-12-27 22:15:12,761][106226] Updated weights for policy 0, policy_version 419905 (0.0008) [2023-12-27 22:15:12,996][106225] Updated weights for policy 1, policy_version 421207 (0.0008) [2023-12-27 22:15:13,064][106225] Updated weights for policy 1, policy_version 421217 (0.0008) [2023-12-27 22:15:13,131][106225] Updated weights for policy 1, policy_version 421227 (0.0009) [2023-12-27 22:15:13,463][106226] Updated weights for policy 0, policy_version 419915 (0.0009) [2023-12-27 22:15:13,523][106226] Updated weights for policy 0, policy_version 419925 (0.0011) [2023-12-27 22:15:13,577][106226] Updated weights for policy 0, policy_version 419935 (0.0011) [2023-12-27 22:15:13,797][106225] Updated weights for policy 1, policy_version 421237 (0.0008) [2023-12-27 22:15:13,847][106225] Updated weights for policy 1, policy_version 421247 (0.0008) [2023-12-27 22:15:13,901][106225] Updated weights for policy 1, policy_version 421257 (0.0008) [2023-12-27 22:15:14,287][106226] Updated weights for policy 0, policy_version 419945 (0.0011) [2023-12-27 22:15:14,337][106226] Updated weights for policy 0, policy_version 419955 (0.0010) [2023-12-27 22:15:14,391][106226] Updated weights for policy 0, policy_version 419965 (0.0010) [2023-12-27 22:15:14,445][106226] Updated weights for policy 0, policy_version 419975 (0.0009) [2023-12-27 22:15:14,643][106225] Updated weights for policy 1, policy_version 421267 (0.0009) [2023-12-27 22:15:14,694][106225] Updated weights for policy 1, policy_version 421277 (0.0010) [2023-12-27 22:15:14,778][106225] Updated weights for policy 1, policy_version 421287 (0.0010) [2023-12-27 22:15:15,058][106226] Updated weights for policy 0, policy_version 419985 (0.0007) [2023-12-27 22:15:15,120][106226] Updated weights for policy 0, policy_version 419995 (0.0008) [2023-12-27 22:15:15,188][106226] Updated weights for policy 0, policy_version 420005 (0.0008) [2023-12-27 22:15:15,511][106225] Updated weights for policy 1, policy_version 421297 (0.0010) [2023-12-27 22:15:15,572][106225] Updated weights for policy 1, policy_version 421307 (0.0008) [2023-12-27 22:15:15,622][106225] Updated weights for policy 1, policy_version 421317 (0.0005) [2023-12-27 22:15:15,678][106225] Updated weights for policy 1, policy_version 421327 (0.0005) [2023-12-27 22:15:15,881][106226] Updated weights for policy 0, policy_version 420015 (0.0010) [2023-12-27 22:15:15,936][106226] Updated weights for policy 0, policy_version 420025 (0.0010) [2023-12-27 22:15:15,993][106226] Updated weights for policy 0, policy_version 420035 (0.0011) [2023-12-27 22:15:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.8, 300 sec: 19494.2). Total num frames: 215449600. Throughput: 0: 9690.9, 1: 9635.0. Samples: 215439180. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:16,176][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.591')] [2023-12-27 22:15:16,309][106225] Updated weights for policy 1, policy_version 421337 (0.0009) [2023-12-27 22:15:16,369][106225] Updated weights for policy 1, policy_version 421347 (0.0010) [2023-12-27 22:15:16,436][106225] Updated weights for policy 1, policy_version 421357 (0.0009) [2023-12-27 22:15:16,704][106226] Updated weights for policy 0, policy_version 420045 (0.0009) [2023-12-27 22:15:16,771][106226] Updated weights for policy 0, policy_version 420055 (0.0008) [2023-12-27 22:15:16,838][106226] Updated weights for policy 0, policy_version 420065 (0.0011) [2023-12-27 22:15:17,136][106225] Updated weights for policy 1, policy_version 421367 (0.0010) [2023-12-27 22:15:17,195][106225] Updated weights for policy 1, policy_version 421377 (0.0010) [2023-12-27 22:15:17,255][106225] Updated weights for policy 1, policy_version 421387 (0.0010) [2023-12-27 22:15:17,445][106226] Updated weights for policy 0, policy_version 420075 (0.0011) [2023-12-27 22:15:17,504][106226] Updated weights for policy 0, policy_version 420085 (0.0010) [2023-12-27 22:15:17,564][106226] Updated weights for policy 0, policy_version 420095 (0.0010) [2023-12-27 22:15:17,891][106225] Updated weights for policy 1, policy_version 421397 (0.0008) [2023-12-27 22:15:17,943][106225] Updated weights for policy 1, policy_version 421407 (0.0006) [2023-12-27 22:15:17,991][106225] Updated weights for policy 1, policy_version 421417 (0.0008) [2023-12-27 22:15:18,308][106226] Updated weights for policy 0, policy_version 420105 (0.0008) [2023-12-27 22:15:18,372][106226] Updated weights for policy 0, policy_version 420115 (0.0009) [2023-12-27 22:15:18,436][106226] Updated weights for policy 0, policy_version 420125 (0.0008) [2023-12-27 22:15:18,497][106226] Updated weights for policy 0, policy_version 420135 (0.0008) [2023-12-27 22:15:18,718][106225] Updated weights for policy 1, policy_version 421427 (0.0008) [2023-12-27 22:15:18,780][106225] Updated weights for policy 1, policy_version 421437 (0.0007) [2023-12-27 22:15:18,834][106225] Updated weights for policy 1, policy_version 421447 (0.0010) [2023-12-27 22:15:19,312][106226] Updated weights for policy 0, policy_version 420145 (0.0009) [2023-12-27 22:15:19,384][106226] Updated weights for policy 0, policy_version 420155 (0.0009) [2023-12-27 22:15:19,437][106226] Updated weights for policy 0, policy_version 420165 (0.0008) [2023-12-27 22:15:19,570][106225] Updated weights for policy 1, policy_version 421457 (0.0010) [2023-12-27 22:15:19,642][106225] Updated weights for policy 1, policy_version 421467 (0.0009) [2023-12-27 22:15:19,704][106225] Updated weights for policy 1, policy_version 421477 (0.0008) [2023-12-27 22:15:19,767][106225] Updated weights for policy 1, policy_version 421487 (0.0008) [2023-12-27 22:15:20,215][106226] Updated weights for policy 0, policy_version 420175 (0.0008) [2023-12-27 22:15:20,276][106226] Updated weights for policy 0, policy_version 420185 (0.0007) [2023-12-27 22:15:20,349][106226] Updated weights for policy 0, policy_version 420195 (0.0008) [2023-12-27 22:15:20,457][106225] Updated weights for policy 1, policy_version 421497 (0.0008) [2023-12-27 22:15:20,521][106225] Updated weights for policy 1, policy_version 421507 (0.0009) [2023-12-27 22:15:20,592][106225] Updated weights for policy 1, policy_version 421517 (0.0009) [2023-12-27 22:15:21,102][106226] Updated weights for policy 0, policy_version 420205 (0.0008) [2023-12-27 22:15:21,172][106226] Updated weights for policy 0, policy_version 420215 (0.0008) [2023-12-27 22:15:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 215539712. Throughput: 0: 9554.9, 1: 9693.8. Samples: 215555068. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:21,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.489')] [2023-12-27 22:15:21,238][106226] Updated weights for policy 0, policy_version 420225 (0.0006) [2023-12-27 22:15:21,372][106225] Updated weights for policy 1, policy_version 421527 (0.0007) [2023-12-27 22:15:21,444][106225] Updated weights for policy 1, policy_version 421537 (0.0008) [2023-12-27 22:15:21,501][106225] Updated weights for policy 1, policy_version 421547 (0.0009) [2023-12-27 22:15:21,990][106226] Updated weights for policy 0, policy_version 420235 (0.0008) [2023-12-27 22:15:22,047][106226] Updated weights for policy 0, policy_version 420245 (0.0009) [2023-12-27 22:15:22,102][106226] Updated weights for policy 0, policy_version 420255 (0.0008) [2023-12-27 22:15:22,277][106225] Updated weights for policy 1, policy_version 421557 (0.0007) [2023-12-27 22:15:22,342][106225] Updated weights for policy 1, policy_version 421567 (0.0009) [2023-12-27 22:15:22,410][106225] Updated weights for policy 1, policy_version 421577 (0.0008) [2023-12-27 22:15:22,842][106226] Updated weights for policy 0, policy_version 420265 (0.0009) [2023-12-27 22:15:22,899][106226] Updated weights for policy 0, policy_version 420275 (0.0011) [2023-12-27 22:15:22,957][106226] Updated weights for policy 0, policy_version 420285 (0.0011) [2023-12-27 22:15:23,015][106226] Updated weights for policy 0, policy_version 420295 (0.0010) [2023-12-27 22:15:23,189][106225] Updated weights for policy 1, policy_version 421587 (0.0009) [2023-12-27 22:15:23,243][106225] Updated weights for policy 1, policy_version 421597 (0.0010) [2023-12-27 22:15:23,303][106225] Updated weights for policy 1, policy_version 421607 (0.0008) [2023-12-27 22:15:23,685][106226] Updated weights for policy 0, policy_version 420305 (0.0009) [2023-12-27 22:15:23,732][106226] Updated weights for policy 0, policy_version 420315 (0.0007) [2023-12-27 22:15:23,793][106226] Updated weights for policy 0, policy_version 420325 (0.0007) [2023-12-27 22:15:23,997][106225] Updated weights for policy 1, policy_version 421617 (0.0010) [2023-12-27 22:15:24,054][106225] Updated weights for policy 1, policy_version 421627 (0.0010) [2023-12-27 22:15:24,115][106225] Updated weights for policy 1, policy_version 421637 (0.0010) [2023-12-27 22:15:24,169][106225] Updated weights for policy 1, policy_version 421647 (0.0010) [2023-12-27 22:15:24,528][106226] Updated weights for policy 0, policy_version 420335 (0.0006) [2023-12-27 22:15:24,587][106226] Updated weights for policy 0, policy_version 420345 (0.0006) [2023-12-27 22:15:24,638][106226] Updated weights for policy 0, policy_version 420355 (0.0005) [2023-12-27 22:15:24,934][106225] Updated weights for policy 1, policy_version 421657 (0.0008) [2023-12-27 22:15:24,994][106225] Updated weights for policy 1, policy_version 421667 (0.0010) [2023-12-27 22:15:25,052][106225] Updated weights for policy 1, policy_version 421677 (0.0010) [2023-12-27 22:15:25,208][106226] Updated weights for policy 0, policy_version 420365 (0.0007) [2023-12-27 22:15:25,262][106226] Updated weights for policy 0, policy_version 420375 (0.0008) [2023-12-27 22:15:25,316][106226] Updated weights for policy 0, policy_version 420385 (0.0009) [2023-12-27 22:15:25,649][106225] Updated weights for policy 1, policy_version 421687 (0.0008) [2023-12-27 22:15:25,712][106225] Updated weights for policy 1, policy_version 421697 (0.0008) [2023-12-27 22:15:25,777][106225] Updated weights for policy 1, policy_version 421707 (0.0008) [2023-12-27 22:15:26,123][106226] Updated weights for policy 0, policy_version 420395 (0.0008) [2023-12-27 22:15:26,174][106226] Updated weights for policy 0, policy_version 420405 (0.0007) [2023-12-27 22:15:26,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 215638016. Throughput: 0: 9559.4, 1: 9650.2. Samples: 215611296. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:26,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.740')] [2023-12-27 22:15:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000421712_107986944.pth... [2023-12-27 22:15:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000420592_107700224.pth [2023-12-27 22:15:26,239][106226] Updated weights for policy 0, policy_version 420415 (0.0005) [2023-12-27 22:15:26,286][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000420424_107659264.pth... [2023-12-27 22:15:26,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000419272_107364352.pth [2023-12-27 22:15:26,493][106225] Updated weights for policy 1, policy_version 421717 (0.0006) [2023-12-27 22:15:26,543][106225] Updated weights for policy 1, policy_version 421727 (0.0005) [2023-12-27 22:15:26,589][106225] Updated weights for policy 1, policy_version 421737 (0.0005) [2023-12-27 22:15:26,946][106226] Updated weights for policy 0, policy_version 420425 (0.0007) [2023-12-27 22:15:27,003][106226] Updated weights for policy 0, policy_version 420435 (0.0006) [2023-12-27 22:15:27,060][106226] Updated weights for policy 0, policy_version 420445 (0.0005) [2023-12-27 22:15:27,116][106226] Updated weights for policy 0, policy_version 420455 (0.0006) [2023-12-27 22:15:27,239][106225] Updated weights for policy 1, policy_version 421747 (0.0007) [2023-12-27 22:15:27,300][106225] Updated weights for policy 1, policy_version 421757 (0.0009) [2023-12-27 22:15:27,363][106225] Updated weights for policy 1, policy_version 421767 (0.0006) [2023-12-27 22:15:27,724][106226] Updated weights for policy 0, policy_version 420465 (0.0007) [2023-12-27 22:15:27,791][106226] Updated weights for policy 0, policy_version 420475 (0.0005) [2023-12-27 22:15:27,848][106226] Updated weights for policy 0, policy_version 420485 (0.0007) [2023-12-27 22:15:28,114][106225] Updated weights for policy 1, policy_version 421777 (0.0009) [2023-12-27 22:15:28,171][106225] Updated weights for policy 1, policy_version 421787 (0.0008) [2023-12-27 22:15:28,227][106225] Updated weights for policy 1, policy_version 421797 (0.0008) [2023-12-27 22:15:28,288][106225] Updated weights for policy 1, policy_version 421807 (0.0006) [2023-12-27 22:15:28,481][106226] Updated weights for policy 0, policy_version 420495 (0.0007) [2023-12-27 22:15:28,547][106226] Updated weights for policy 0, policy_version 420505 (0.0008) [2023-12-27 22:15:28,608][106226] Updated weights for policy 0, policy_version 420515 (0.0007) [2023-12-27 22:15:29,049][106225] Updated weights for policy 1, policy_version 421817 (0.0008) [2023-12-27 22:15:29,104][106225] Updated weights for policy 1, policy_version 421827 (0.0008) [2023-12-27 22:15:29,161][106225] Updated weights for policy 1, policy_version 421837 (0.0008) [2023-12-27 22:15:29,239][106226] Updated weights for policy 0, policy_version 420525 (0.0007) [2023-12-27 22:15:29,303][106226] Updated weights for policy 0, policy_version 420535 (0.0008) [2023-12-27 22:15:29,368][106226] Updated weights for policy 0, policy_version 420545 (0.0009) [2023-12-27 22:15:29,921][106225] Updated weights for policy 1, policy_version 421847 (0.0008) [2023-12-27 22:15:29,981][106225] Updated weights for policy 1, policy_version 421857 (0.0009) [2023-12-27 22:15:30,042][106225] Updated weights for policy 1, policy_version 421867 (0.0007) [2023-12-27 22:15:30,148][106226] Updated weights for policy 0, policy_version 420555 (0.0008) [2023-12-27 22:15:30,211][106226] Updated weights for policy 0, policy_version 420565 (0.0009) [2023-12-27 22:15:30,275][106226] Updated weights for policy 0, policy_version 420575 (0.0008) [2023-12-27 22:15:30,789][106225] Updated weights for policy 1, policy_version 421877 (0.0009) [2023-12-27 22:15:30,834][106225] Updated weights for policy 1, policy_version 421887 (0.0008) [2023-12-27 22:15:30,886][106225] Updated weights for policy 1, policy_version 421897 (0.0008) [2023-12-27 22:15:30,934][106226] Updated weights for policy 0, policy_version 420585 (0.0006) [2023-12-27 22:15:30,988][106226] Updated weights for policy 0, policy_version 420595 (0.0008) [2023-12-27 22:15:31,057][106226] Updated weights for policy 0, policy_version 420605 (0.0008) [2023-12-27 22:15:31,116][106226] Updated weights for policy 0, policy_version 420615 (0.0008) [2023-12-27 22:15:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 215744512. Throughput: 0: 9672.5, 1: 9714.1. Samples: 215730648. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:31,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-5.567')] [2023-12-27 22:15:31,621][106225] Updated weights for policy 1, policy_version 421907 (0.0009) [2023-12-27 22:15:31,681][106225] Updated weights for policy 1, policy_version 421917 (0.0009) [2023-12-27 22:15:31,741][106225] Updated weights for policy 1, policy_version 421927 (0.0008) [2023-12-27 22:15:31,889][106226] Updated weights for policy 0, policy_version 420625 (0.0006) [2023-12-27 22:15:31,955][106226] Updated weights for policy 0, policy_version 420635 (0.0006) [2023-12-27 22:15:32,009][106226] Updated weights for policy 0, policy_version 420645 (0.0005) [2023-12-27 22:15:32,515][106225] Updated weights for policy 1, policy_version 421937 (0.0009) [2023-12-27 22:15:32,568][106225] Updated weights for policy 1, policy_version 421947 (0.0007) [2023-12-27 22:15:32,629][106225] Updated weights for policy 1, policy_version 421957 (0.0010) [2023-12-27 22:15:32,656][106226] Updated weights for policy 0, policy_version 420655 (0.0005) [2023-12-27 22:15:32,683][106225] Updated weights for policy 1, policy_version 421967 (0.0008) [2023-12-27 22:15:32,713][106226] Updated weights for policy 0, policy_version 420665 (0.0006) [2023-12-27 22:15:32,772][106226] Updated weights for policy 0, policy_version 420675 (0.0009) [2023-12-27 22:15:33,324][106225] Updated weights for policy 1, policy_version 421977 (0.0005) [2023-12-27 22:15:33,376][106225] Updated weights for policy 1, policy_version 421987 (0.0007) [2023-12-27 22:15:33,386][106226] Updated weights for policy 0, policy_version 420685 (0.0007) [2023-12-27 22:15:33,435][106225] Updated weights for policy 1, policy_version 421997 (0.0010) [2023-12-27 22:15:33,436][106226] Updated weights for policy 0, policy_version 420695 (0.0008) [2023-12-27 22:15:33,482][106226] Updated weights for policy 0, policy_version 420705 (0.0010) [2023-12-27 22:15:34,128][106225] Updated weights for policy 1, policy_version 422007 (0.0009) [2023-12-27 22:15:34,195][106225] Updated weights for policy 1, policy_version 422017 (0.0010) [2023-12-27 22:15:34,208][106226] Updated weights for policy 0, policy_version 420715 (0.0010) [2023-12-27 22:15:34,253][106225] Updated weights for policy 1, policy_version 422027 (0.0011) [2023-12-27 22:15:34,273][106226] Updated weights for policy 0, policy_version 420725 (0.0010) [2023-12-27 22:15:34,336][106226] Updated weights for policy 0, policy_version 420735 (0.0011) [2023-12-27 22:15:34,962][106225] Updated weights for policy 1, policy_version 422037 (0.0010) [2023-12-27 22:15:35,012][106225] Updated weights for policy 1, policy_version 422047 (0.0010) [2023-12-27 22:15:35,039][106226] Updated weights for policy 0, policy_version 420745 (0.0010) [2023-12-27 22:15:35,063][106225] Updated weights for policy 1, policy_version 422057 (0.0010) [2023-12-27 22:15:35,105][106226] Updated weights for policy 0, policy_version 420755 (0.0005) [2023-12-27 22:15:35,160][106226] Updated weights for policy 0, policy_version 420765 (0.0005) [2023-12-27 22:15:35,210][106226] Updated weights for policy 0, policy_version 420775 (0.0005) [2023-12-27 22:15:35,782][106225] Updated weights for policy 1, policy_version 422067 (0.0010) [2023-12-27 22:15:35,816][106226] Updated weights for policy 0, policy_version 420785 (0.0010) [2023-12-27 22:15:35,832][106225] Updated weights for policy 1, policy_version 422077 (0.0010) [2023-12-27 22:15:35,881][106226] Updated weights for policy 0, policy_version 420795 (0.0007) [2023-12-27 22:15:35,882][106225] Updated weights for policy 1, policy_version 422087 (0.0010) [2023-12-27 22:15:35,946][106226] Updated weights for policy 0, policy_version 420805 (0.0008) [2023-12-27 22:15:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 215842816. Throughput: 0: 9723.3, 1: 9711.0. Samples: 215850056. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:36,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-5.046')] [2023-12-27 22:15:36,176][106141] Saving new best policy, reward=-5.046! [2023-12-27 22:15:36,610][106226] Updated weights for policy 0, policy_version 420815 (0.0010) [2023-12-27 22:15:36,627][106225] Updated weights for policy 1, policy_version 422097 (0.0010) [2023-12-27 22:15:36,669][106226] Updated weights for policy 0, policy_version 420825 (0.0011) [2023-12-27 22:15:36,686][106225] Updated weights for policy 1, policy_version 422107 (0.0005) [2023-12-27 22:15:36,731][106226] Updated weights for policy 0, policy_version 420835 (0.0011) [2023-12-27 22:15:36,748][106225] Updated weights for policy 1, policy_version 422117 (0.0006) [2023-12-27 22:15:36,808][106225] Updated weights for policy 1, policy_version 422127 (0.0007) [2023-12-27 22:15:37,446][106226] Updated weights for policy 0, policy_version 420845 (0.0011) [2023-12-27 22:15:37,517][106226] Updated weights for policy 0, policy_version 420855 (0.0011) [2023-12-27 22:15:37,553][106225] Updated weights for policy 1, policy_version 422137 (0.0006) [2023-12-27 22:15:37,577][106226] Updated weights for policy 0, policy_version 420865 (0.0011) [2023-12-27 22:15:37,610][106225] Updated weights for policy 1, policy_version 422147 (0.0006) [2023-12-27 22:15:37,661][106225] Updated weights for policy 1, policy_version 422157 (0.0007) [2023-12-27 22:15:38,237][106226] Updated weights for policy 0, policy_version 420875 (0.0011) [2023-12-27 22:15:38,300][106226] Updated weights for policy 0, policy_version 420885 (0.0011) [2023-12-27 22:15:38,351][106225] Updated weights for policy 1, policy_version 422167 (0.0008) [2023-12-27 22:15:38,372][106226] Updated weights for policy 0, policy_version 420895 (0.0008) [2023-12-27 22:15:38,431][106225] Updated weights for policy 1, policy_version 422177 (0.0008) [2023-12-27 22:15:38,503][106225] Updated weights for policy 1, policy_version 422187 (0.0008) [2023-12-27 22:15:39,089][106226] Updated weights for policy 0, policy_version 420905 (0.0007) [2023-12-27 22:15:39,152][106226] Updated weights for policy 0, policy_version 420915 (0.0008) [2023-12-27 22:15:39,182][106225] Updated weights for policy 1, policy_version 422197 (0.0009) [2023-12-27 22:15:39,217][106226] Updated weights for policy 0, policy_version 420925 (0.0008) [2023-12-27 22:15:39,251][106225] Updated weights for policy 1, policy_version 422207 (0.0008) [2023-12-27 22:15:39,291][106226] Updated weights for policy 0, policy_version 420935 (0.0009) [2023-12-27 22:15:39,314][106225] Updated weights for policy 1, policy_version 422217 (0.0009) [2023-12-27 22:15:40,066][106226] Updated weights for policy 0, policy_version 420945 (0.0008) [2023-12-27 22:15:40,128][106226] Updated weights for policy 0, policy_version 420955 (0.0007) [2023-12-27 22:15:40,145][106225] Updated weights for policy 1, policy_version 422227 (0.0009) [2023-12-27 22:15:40,196][106226] Updated weights for policy 0, policy_version 420965 (0.0007) [2023-12-27 22:15:40,209][106225] Updated weights for policy 1, policy_version 422237 (0.0009) [2023-12-27 22:15:40,269][106225] Updated weights for policy 1, policy_version 422247 (0.0008) [2023-12-27 22:15:40,952][106226] Updated weights for policy 0, policy_version 420975 (0.0007) [2023-12-27 22:15:40,978][106225] Updated weights for policy 1, policy_version 422257 (0.0009) [2023-12-27 22:15:41,016][106226] Updated weights for policy 0, policy_version 420985 (0.0007) [2023-12-27 22:15:41,060][106225] Updated weights for policy 1, policy_version 422267 (0.0008) [2023-12-27 22:15:41,096][106226] Updated weights for policy 0, policy_version 420995 (0.0009) [2023-12-27 22:15:41,123][106225] Updated weights for policy 1, policy_version 422277 (0.0007) [2023-12-27 22:15:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 215932928. Throughput: 0: 9767.3, 1: 9681.2. Samples: 215908172. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:41,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.722')] [2023-12-27 22:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000421000_107806720.pth... [2023-12-27 22:15:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000419848_107511808.pth [2023-12-27 22:15:41,191][106225] Updated weights for policy 1, policy_version 422287 (0.0008) [2023-12-27 22:15:41,196][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000422288_108134400.pth... [2023-12-27 22:15:41,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000421168_107847680.pth [2023-12-27 22:15:41,839][106226] Updated weights for policy 0, policy_version 421005 (0.0008) [2023-12-27 22:15:41,896][106226] Updated weights for policy 0, policy_version 421015 (0.0009) [2023-12-27 22:15:41,962][106226] Updated weights for policy 0, policy_version 421025 (0.0009) [2023-12-27 22:15:41,992][106225] Updated weights for policy 1, policy_version 422297 (0.0009) [2023-12-27 22:15:42,054][106225] Updated weights for policy 1, policy_version 422307 (0.0007) [2023-12-27 22:15:42,120][106225] Updated weights for policy 1, policy_version 422317 (0.0008) [2023-12-27 22:15:42,692][106226] Updated weights for policy 0, policy_version 421035 (0.0007) [2023-12-27 22:15:42,752][106226] Updated weights for policy 0, policy_version 421045 (0.0009) [2023-12-27 22:15:42,813][106226] Updated weights for policy 0, policy_version 421055 (0.0009) [2023-12-27 22:15:42,884][106225] Updated weights for policy 1, policy_version 422327 (0.0007) [2023-12-27 22:15:42,939][106225] Updated weights for policy 1, policy_version 422337 (0.0009) [2023-12-27 22:15:42,990][106225] Updated weights for policy 1, policy_version 422347 (0.0009) [2023-12-27 22:15:43,465][106226] Updated weights for policy 0, policy_version 421065 (0.0008) [2023-12-27 22:15:43,523][106226] Updated weights for policy 0, policy_version 421075 (0.0005) [2023-12-27 22:15:43,579][106226] Updated weights for policy 0, policy_version 421085 (0.0009) [2023-12-27 22:15:43,637][106226] Updated weights for policy 0, policy_version 421095 (0.0008) [2023-12-27 22:15:43,655][106225] Updated weights for policy 1, policy_version 422357 (0.0008) [2023-12-27 22:15:43,712][106225] Updated weights for policy 1, policy_version 422367 (0.0008) [2023-12-27 22:15:43,764][106225] Updated weights for policy 1, policy_version 422377 (0.0008) [2023-12-27 22:15:44,351][106226] Updated weights for policy 0, policy_version 421105 (0.0009) [2023-12-27 22:15:44,408][106226] Updated weights for policy 0, policy_version 421115 (0.0009) [2023-12-27 22:15:44,462][106226] Updated weights for policy 0, policy_version 421125 (0.0007) [2023-12-27 22:15:44,463][106225] Updated weights for policy 1, policy_version 422387 (0.0009) [2023-12-27 22:15:44,525][106225] Updated weights for policy 1, policy_version 422397 (0.0007) [2023-12-27 22:15:44,584][106225] Updated weights for policy 1, policy_version 422407 (0.0007) [2023-12-27 22:15:45,239][106226] Updated weights for policy 0, policy_version 421135 (0.0008) [2023-12-27 22:15:45,260][106225] Updated weights for policy 1, policy_version 422417 (0.0006) [2023-12-27 22:15:45,306][106226] Updated weights for policy 0, policy_version 421145 (0.0007) [2023-12-27 22:15:45,325][106225] Updated weights for policy 1, policy_version 422427 (0.0007) [2023-12-27 22:15:45,370][106226] Updated weights for policy 0, policy_version 421155 (0.0009) [2023-12-27 22:15:45,389][106225] Updated weights for policy 1, policy_version 422437 (0.0007) [2023-12-27 22:15:45,441][106225] Updated weights for policy 1, policy_version 422447 (0.0008) [2023-12-27 22:15:46,112][106225] Updated weights for policy 1, policy_version 422457 (0.0005) [2023-12-27 22:15:46,140][106226] Updated weights for policy 0, policy_version 421165 (0.0007) [2023-12-27 22:15:46,165][106225] Updated weights for policy 1, policy_version 422467 (0.0007) [2023-12-27 22:15:46,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 216023040. Throughput: 0: 9804.4, 1: 9618.7. Samples: 216020684. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:46,176][105115] Avg episode reward: [(0, '-4.899'), (1, '-5.696')] [2023-12-27 22:15:46,200][106226] Updated weights for policy 0, policy_version 421175 (0.0006) [2023-12-27 22:15:46,214][106225] Updated weights for policy 1, policy_version 422477 (0.0007) [2023-12-27 22:15:46,268][106226] Updated weights for policy 0, policy_version 421185 (0.0007) [2023-12-27 22:15:46,765][106225] Updated weights for policy 1, policy_version 422487 (0.0008) [2023-12-27 22:15:46,819][106225] Updated weights for policy 1, policy_version 422497 (0.0008) [2023-12-27 22:15:46,875][106225] Updated weights for policy 1, policy_version 422507 (0.0008) [2023-12-27 22:15:46,945][106226] Updated weights for policy 0, policy_version 421195 (0.0009) [2023-12-27 22:15:47,005][106226] Updated weights for policy 0, policy_version 421205 (0.0010) [2023-12-27 22:15:47,069][106226] Updated weights for policy 0, policy_version 421215 (0.0011) [2023-12-27 22:15:47,590][106225] Updated weights for policy 1, policy_version 422517 (0.0007) [2023-12-27 22:15:47,652][106225] Updated weights for policy 1, policy_version 422527 (0.0005) [2023-12-27 22:15:47,721][106225] Updated weights for policy 1, policy_version 422537 (0.0005) [2023-12-27 22:15:47,781][106226] Updated weights for policy 0, policy_version 421225 (0.0010) [2023-12-27 22:15:47,844][106226] Updated weights for policy 0, policy_version 421235 (0.0005) [2023-12-27 22:15:47,909][106226] Updated weights for policy 0, policy_version 421245 (0.0006) [2023-12-27 22:15:47,967][106226] Updated weights for policy 0, policy_version 421255 (0.0006) [2023-12-27 22:15:48,372][106225] Updated weights for policy 1, policy_version 422547 (0.0009) [2023-12-27 22:15:48,433][106225] Updated weights for policy 1, policy_version 422557 (0.0006) [2023-12-27 22:15:48,495][106225] Updated weights for policy 1, policy_version 422567 (0.0008) [2023-12-27 22:15:48,627][106226] Updated weights for policy 0, policy_version 421265 (0.0006) [2023-12-27 22:15:48,686][106226] Updated weights for policy 0, policy_version 421275 (0.0007) [2023-12-27 22:15:48,743][106226] Updated weights for policy 0, policy_version 421285 (0.0006) [2023-12-27 22:15:49,285][106225] Updated weights for policy 1, policy_version 422577 (0.0008) [2023-12-27 22:15:49,360][106225] Updated weights for policy 1, policy_version 422587 (0.0008) [2023-12-27 22:15:49,393][106226] Updated weights for policy 0, policy_version 421295 (0.0009) [2023-12-27 22:15:49,426][106225] Updated weights for policy 1, policy_version 422597 (0.0008) [2023-12-27 22:15:49,457][106226] Updated weights for policy 0, policy_version 421305 (0.0011) [2023-12-27 22:15:49,487][106225] Updated weights for policy 1, policy_version 422607 (0.0008) [2023-12-27 22:15:49,524][106226] Updated weights for policy 0, policy_version 421315 (0.0010) [2023-12-27 22:15:50,258][106226] Updated weights for policy 0, policy_version 421325 (0.0008) [2023-12-27 22:15:50,260][106225] Updated weights for policy 1, policy_version 422617 (0.0008) [2023-12-27 22:15:50,318][106225] Updated weights for policy 1, policy_version 422627 (0.0008) [2023-12-27 22:15:50,321][106226] Updated weights for policy 0, policy_version 421335 (0.0006) [2023-12-27 22:15:50,382][106225] Updated weights for policy 1, policy_version 422637 (0.0008) [2023-12-27 22:15:50,390][106226] Updated weights for policy 0, policy_version 421345 (0.0008) [2023-12-27 22:15:51,147][106226] Updated weights for policy 0, policy_version 421355 (0.0007) [2023-12-27 22:15:51,155][106225] Updated weights for policy 1, policy_version 422647 (0.0009) [2023-12-27 22:15:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 216121344. Throughput: 0: 9740.5, 1: 9614.9. Samples: 216137136. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:51,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.497')] [2023-12-27 22:15:51,214][106225] Updated weights for policy 1, policy_version 422657 (0.0010) [2023-12-27 22:15:51,216][106226] Updated weights for policy 0, policy_version 421365 (0.0006) [2023-12-27 22:15:51,278][106226] Updated weights for policy 0, policy_version 421375 (0.0007) [2023-12-27 22:15:51,285][106225] Updated weights for policy 1, policy_version 422667 (0.0010) [2023-12-27 22:15:52,014][106226] Updated weights for policy 0, policy_version 421385 (0.0007) [2023-12-27 22:15:52,075][106226] Updated weights for policy 0, policy_version 421395 (0.0009) [2023-12-27 22:15:52,132][106225] Updated weights for policy 1, policy_version 422677 (0.0008) [2023-12-27 22:15:52,139][106226] Updated weights for policy 0, policy_version 421405 (0.0007) [2023-12-27 22:15:52,201][106226] Updated weights for policy 0, policy_version 421415 (0.0006) [2023-12-27 22:15:52,206][106225] Updated weights for policy 1, policy_version 422687 (0.0010) [2023-12-27 22:15:52,282][106225] Updated weights for policy 1, policy_version 422697 (0.0007) [2023-12-27 22:15:52,946][106226] Updated weights for policy 0, policy_version 421425 (0.0009) [2023-12-27 22:15:52,996][106226] Updated weights for policy 0, policy_version 421435 (0.0008) [2023-12-27 22:15:53,026][106225] Updated weights for policy 1, policy_version 422707 (0.0009) [2023-12-27 22:15:53,054][106226] Updated weights for policy 0, policy_version 421445 (0.0008) [2023-12-27 22:15:53,095][106225] Updated weights for policy 1, policy_version 422717 (0.0007) [2023-12-27 22:15:53,156][106225] Updated weights for policy 1, policy_version 422727 (0.0009) [2023-12-27 22:15:53,773][106226] Updated weights for policy 0, policy_version 421455 (0.0006) [2023-12-27 22:15:53,829][106226] Updated weights for policy 0, policy_version 421465 (0.0009) [2023-12-27 22:15:53,883][106226] Updated weights for policy 0, policy_version 421475 (0.0010) [2023-12-27 22:15:53,903][106225] Updated weights for policy 1, policy_version 422737 (0.0008) [2023-12-27 22:15:53,965][106225] Updated weights for policy 1, policy_version 422747 (0.0007) [2023-12-27 22:15:54,025][106225] Updated weights for policy 1, policy_version 422757 (0.0008) [2023-12-27 22:15:54,086][106225] Updated weights for policy 1, policy_version 422767 (0.0007) [2023-12-27 22:15:54,623][106226] Updated weights for policy 0, policy_version 421485 (0.0009) [2023-12-27 22:15:54,676][106226] Updated weights for policy 0, policy_version 421495 (0.0008) [2023-12-27 22:15:54,732][106226] Updated weights for policy 0, policy_version 421505 (0.0007) [2023-12-27 22:15:54,783][106225] Updated weights for policy 1, policy_version 422777 (0.0008) [2023-12-27 22:15:54,839][106225] Updated weights for policy 1, policy_version 422787 (0.0010) [2023-12-27 22:15:54,893][106225] Updated weights for policy 1, policy_version 422797 (0.0007) [2023-12-27 22:15:55,434][106226] Updated weights for policy 0, policy_version 421515 (0.0006) [2023-12-27 22:15:55,487][106226] Updated weights for policy 0, policy_version 421525 (0.0008) [2023-12-27 22:15:55,543][106226] Updated weights for policy 0, policy_version 421535 (0.0008) [2023-12-27 22:15:55,635][106225] Updated weights for policy 1, policy_version 422807 (0.0009) [2023-12-27 22:15:55,696][106225] Updated weights for policy 1, policy_version 422817 (0.0010) [2023-12-27 22:15:55,756][106225] Updated weights for policy 1, policy_version 422827 (0.0009) [2023-12-27 22:15:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 216219648. Throughput: 0: 9701.6, 1: 9573.4. Samples: 216191580. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:15:56,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-5.496')] [2023-12-27 22:15:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000422832_108273664.pth... [2023-12-27 22:15:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000421544_107945984.pth... [2023-12-27 22:15:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000420424_107659264.pth [2023-12-27 22:15:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000421712_107986944.pth [2023-12-27 22:15:56,230][106226] Updated weights for policy 0, policy_version 421545 (0.0009) [2023-12-27 22:15:56,291][106226] Updated weights for policy 0, policy_version 421555 (0.0008) [2023-12-27 22:15:56,352][106226] Updated weights for policy 0, policy_version 421565 (0.0009) [2023-12-27 22:15:56,417][106226] Updated weights for policy 0, policy_version 421575 (0.0009) [2023-12-27 22:15:56,533][106225] Updated weights for policy 1, policy_version 422837 (0.0009) [2023-12-27 22:15:56,597][106225] Updated weights for policy 1, policy_version 422847 (0.0008) [2023-12-27 22:15:56,660][106225] Updated weights for policy 1, policy_version 422857 (0.0008) [2023-12-27 22:15:57,167][106226] Updated weights for policy 0, policy_version 421585 (0.0008) [2023-12-27 22:15:57,221][106226] Updated weights for policy 0, policy_version 421595 (0.0009) [2023-12-27 22:15:57,270][106226] Updated weights for policy 0, policy_version 421605 (0.0008) [2023-12-27 22:15:57,379][106225] Updated weights for policy 1, policy_version 422867 (0.0008) [2023-12-27 22:15:57,441][106225] Updated weights for policy 1, policy_version 422877 (0.0010) [2023-12-27 22:15:57,491][106225] Updated weights for policy 1, policy_version 422887 (0.0008) [2023-12-27 22:15:57,938][106226] Updated weights for policy 0, policy_version 421615 (0.0007) [2023-12-27 22:15:57,995][106226] Updated weights for policy 0, policy_version 421625 (0.0007) [2023-12-27 22:15:58,063][106226] Updated weights for policy 0, policy_version 421635 (0.0008) [2023-12-27 22:15:58,398][106225] Updated weights for policy 1, policy_version 422897 (0.0008) [2023-12-27 22:15:58,460][106225] Updated weights for policy 1, policy_version 422907 (0.0008) [2023-12-27 22:15:58,526][106225] Updated weights for policy 1, policy_version 422917 (0.0008) [2023-12-27 22:15:58,595][106225] Updated weights for policy 1, policy_version 422927 (0.0008) [2023-12-27 22:15:58,855][106226] Updated weights for policy 0, policy_version 421645 (0.0009) [2023-12-27 22:15:58,920][106226] Updated weights for policy 0, policy_version 421655 (0.0007) [2023-12-27 22:15:58,985][106226] Updated weights for policy 0, policy_version 421665 (0.0008) [2023-12-27 22:15:59,371][106225] Updated weights for policy 1, policy_version 422937 (0.0008) [2023-12-27 22:15:59,439][106225] Updated weights for policy 1, policy_version 422947 (0.0008) [2023-12-27 22:15:59,505][106225] Updated weights for policy 1, policy_version 422957 (0.0007) [2023-12-27 22:15:59,750][106226] Updated weights for policy 0, policy_version 421675 (0.0007) [2023-12-27 22:15:59,812][106226] Updated weights for policy 0, policy_version 421685 (0.0009) [2023-12-27 22:15:59,883][106226] Updated weights for policy 0, policy_version 421695 (0.0006) [2023-12-27 22:16:00,139][106225] Updated weights for policy 1, policy_version 422967 (0.0007) [2023-12-27 22:16:00,205][106225] Updated weights for policy 1, policy_version 422977 (0.0010) [2023-12-27 22:16:00,264][106225] Updated weights for policy 1, policy_version 422987 (0.0009) [2023-12-27 22:16:00,600][106226] Updated weights for policy 0, policy_version 421705 (0.0007) [2023-12-27 22:16:00,653][106226] Updated weights for policy 0, policy_version 421715 (0.0009) [2023-12-27 22:16:00,712][106226] Updated weights for policy 0, policy_version 421725 (0.0008) [2023-12-27 22:16:00,771][106226] Updated weights for policy 0, policy_version 421735 (0.0006) [2023-12-27 22:16:00,963][106225] Updated weights for policy 1, policy_version 422997 (0.0008) [2023-12-27 22:16:01,019][106225] Updated weights for policy 1, policy_version 423007 (0.0008) [2023-12-27 22:16:01,098][106225] Updated weights for policy 1, policy_version 423017 (0.0007) [2023-12-27 22:16:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 216317952. Throughput: 0: 9681.2, 1: 9525.5. Samples: 216303480. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:16:01,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.564')] [2023-12-27 22:16:01,515][106226] Updated weights for policy 0, policy_version 421745 (0.0006) [2023-12-27 22:16:01,575][106226] Updated weights for policy 0, policy_version 421755 (0.0009) [2023-12-27 22:16:01,639][106226] Updated weights for policy 0, policy_version 421765 (0.0009) [2023-12-27 22:16:01,864][106225] Updated weights for policy 1, policy_version 423027 (0.0006) [2023-12-27 22:16:01,928][106225] Updated weights for policy 1, policy_version 423037 (0.0006) [2023-12-27 22:16:01,988][106225] Updated weights for policy 1, policy_version 423047 (0.0010) [2023-12-27 22:16:02,347][106226] Updated weights for policy 0, policy_version 421775 (0.0007) [2023-12-27 22:16:02,413][106226] Updated weights for policy 0, policy_version 421785 (0.0008) [2023-12-27 22:16:02,471][106226] Updated weights for policy 0, policy_version 421795 (0.0008) [2023-12-27 22:16:02,596][106225] Updated weights for policy 1, policy_version 423057 (0.0008) [2023-12-27 22:16:02,656][106225] Updated weights for policy 1, policy_version 423067 (0.0010) [2023-12-27 22:16:02,711][106225] Updated weights for policy 1, policy_version 423077 (0.0010) [2023-12-27 22:16:02,759][106225] Updated weights for policy 1, policy_version 423087 (0.0010) [2023-12-27 22:16:03,166][106226] Updated weights for policy 0, policy_version 421805 (0.0008) [2023-12-27 22:16:03,230][106226] Updated weights for policy 0, policy_version 421815 (0.0007) [2023-12-27 22:16:03,294][106226] Updated weights for policy 0, policy_version 421825 (0.0008) [2023-12-27 22:16:03,480][106225] Updated weights for policy 1, policy_version 423097 (0.0006) [2023-12-27 22:16:03,544][106225] Updated weights for policy 1, policy_version 423107 (0.0005) [2023-12-27 22:16:03,619][106225] Updated weights for policy 1, policy_version 423117 (0.0006) [2023-12-27 22:16:04,034][106226] Updated weights for policy 0, policy_version 421835 (0.0007) [2023-12-27 22:16:04,104][106226] Updated weights for policy 0, policy_version 421845 (0.0008) [2023-12-27 22:16:04,195][106226] Updated weights for policy 0, policy_version 421855 (0.0009) [2023-12-27 22:16:04,276][106225] Updated weights for policy 1, policy_version 423127 (0.0010) [2023-12-27 22:16:04,349][106225] Updated weights for policy 1, policy_version 423137 (0.0009) [2023-12-27 22:16:04,412][106225] Updated weights for policy 1, policy_version 423147 (0.0009) [2023-12-27 22:16:04,916][106226] Updated weights for policy 0, policy_version 421865 (0.0009) [2023-12-27 22:16:04,977][106226] Updated weights for policy 0, policy_version 421875 (0.0008) [2023-12-27 22:16:05,042][106226] Updated weights for policy 0, policy_version 421885 (0.0007) [2023-12-27 22:16:05,106][106226] Updated weights for policy 0, policy_version 421895 (0.0006) [2023-12-27 22:16:05,108][106225] Updated weights for policy 1, policy_version 423157 (0.0008) [2023-12-27 22:16:05,154][106225] Updated weights for policy 1, policy_version 423167 (0.0007) [2023-12-27 22:16:05,212][106225] Updated weights for policy 1, policy_version 423177 (0.0009) [2023-12-27 22:16:05,721][106226] Updated weights for policy 0, policy_version 421905 (0.0008) [2023-12-27 22:16:05,774][106226] Updated weights for policy 0, policy_version 421915 (0.0008) [2023-12-27 22:16:05,830][106226] Updated weights for policy 0, policy_version 421925 (0.0006) [2023-12-27 22:16:05,980][106225] Updated weights for policy 1, policy_version 423187 (0.0010) [2023-12-27 22:16:06,037][106225] Updated weights for policy 1, policy_version 423197 (0.0008) [2023-12-27 22:16:06,102][106225] Updated weights for policy 1, policy_version 423207 (0.0008) [2023-12-27 22:16:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19251.3, 300 sec: 19466.4). Total num frames: 216416256. Throughput: 0: 9728.0, 1: 9521.2. Samples: 216421280. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:16:06,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.785')] [2023-12-27 22:16:06,562][106226] Updated weights for policy 0, policy_version 421935 (0.0008) [2023-12-27 22:16:06,624][106226] Updated weights for policy 0, policy_version 421945 (0.0009) [2023-12-27 22:16:06,685][106226] Updated weights for policy 0, policy_version 421955 (0.0009) [2023-12-27 22:16:06,845][106225] Updated weights for policy 1, policy_version 423217 (0.0008) [2023-12-27 22:16:06,901][106225] Updated weights for policy 1, policy_version 423227 (0.0006) [2023-12-27 22:16:06,958][106225] Updated weights for policy 1, policy_version 423237 (0.0007) [2023-12-27 22:16:07,026][106225] Updated weights for policy 1, policy_version 423247 (0.0009) [2023-12-27 22:16:07,450][106226] Updated weights for policy 0, policy_version 421965 (0.0007) [2023-12-27 22:16:07,509][106226] Updated weights for policy 0, policy_version 421975 (0.0005) [2023-12-27 22:16:07,571][106226] Updated weights for policy 0, policy_version 421985 (0.0005) [2023-12-27 22:16:07,737][106225] Updated weights for policy 1, policy_version 423257 (0.0009) [2023-12-27 22:16:07,781][106225] Updated weights for policy 1, policy_version 423267 (0.0008) [2023-12-27 22:16:07,833][106225] Updated weights for policy 1, policy_version 423277 (0.0008) [2023-12-27 22:16:08,126][106226] Updated weights for policy 0, policy_version 421995 (0.0005) [2023-12-27 22:16:08,188][106226] Updated weights for policy 0, policy_version 422005 (0.0005) [2023-12-27 22:16:08,245][106226] Updated weights for policy 0, policy_version 422015 (0.0005) [2023-12-27 22:16:08,515][106225] Updated weights for policy 1, policy_version 423287 (0.0006) [2023-12-27 22:16:08,578][106225] Updated weights for policy 1, policy_version 423297 (0.0007) [2023-12-27 22:16:08,637][106225] Updated weights for policy 1, policy_version 423307 (0.0009) [2023-12-27 22:16:08,922][106226] Updated weights for policy 0, policy_version 422025 (0.0006) [2023-12-27 22:16:08,985][106226] Updated weights for policy 0, policy_version 422035 (0.0009) [2023-12-27 22:16:09,045][106226] Updated weights for policy 0, policy_version 422045 (0.0009) [2023-12-27 22:16:09,103][106226] Updated weights for policy 0, policy_version 422055 (0.0010) [2023-12-27 22:16:09,329][106225] Updated weights for policy 1, policy_version 423317 (0.0009) [2023-12-27 22:16:09,403][106225] Updated weights for policy 1, policy_version 423327 (0.0009) [2023-12-27 22:16:09,471][106225] Updated weights for policy 1, policy_version 423337 (0.0008) [2023-12-27 22:16:09,869][106226] Updated weights for policy 0, policy_version 422065 (0.0009) [2023-12-27 22:16:09,935][106226] Updated weights for policy 0, policy_version 422075 (0.0008) [2023-12-27 22:16:09,995][106226] Updated weights for policy 0, policy_version 422085 (0.0008) [2023-12-27 22:16:10,252][106225] Updated weights for policy 1, policy_version 423347 (0.0008) [2023-12-27 22:16:10,316][106225] Updated weights for policy 1, policy_version 423357 (0.0007) [2023-12-27 22:16:10,387][106225] Updated weights for policy 1, policy_version 423367 (0.0009) [2023-12-27 22:16:10,667][106226] Updated weights for policy 0, policy_version 422095 (0.0007) [2023-12-27 22:16:10,729][106226] Updated weights for policy 0, policy_version 422105 (0.0009) [2023-12-27 22:16:10,799][106226] Updated weights for policy 0, policy_version 422115 (0.0009) [2023-12-27 22:16:11,107][106225] Updated weights for policy 1, policy_version 423377 (0.0009) [2023-12-27 22:16:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 216506368. Throughput: 0: 9755.3, 1: 9545.5. Samples: 216479832. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:16:11,175][106225] Updated weights for policy 1, policy_version 423387 (0.0009) [2023-12-27 22:16:11,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.446')] [2023-12-27 22:16:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000422120_108093440.pth... [2023-12-27 22:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000421000_107806720.pth [2023-12-27 22:16:11,241][106225] Updated weights for policy 1, policy_version 423397 (0.0008) [2023-12-27 22:16:11,307][106225] Updated weights for policy 1, policy_version 423407 (0.0008) [2023-12-27 22:16:11,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000423408_108421120.pth... [2023-12-27 22:16:11,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000422288_108134400.pth [2023-12-27 22:16:11,637][106226] Updated weights for policy 0, policy_version 422125 (0.0007) [2023-12-27 22:16:11,703][106226] Updated weights for policy 0, policy_version 422135 (0.0008) [2023-12-27 22:16:11,765][106226] Updated weights for policy 0, policy_version 422145 (0.0008) [2023-12-27 22:16:12,145][106225] Updated weights for policy 1, policy_version 423417 (0.0008) [2023-12-27 22:16:12,207][106225] Updated weights for policy 1, policy_version 423427 (0.0007) [2023-12-27 22:16:12,271][106225] Updated weights for policy 1, policy_version 423437 (0.0007) [2023-12-27 22:16:12,552][106226] Updated weights for policy 0, policy_version 422155 (0.0007) [2023-12-27 22:16:12,621][106226] Updated weights for policy 0, policy_version 422165 (0.0006) [2023-12-27 22:16:12,682][106226] Updated weights for policy 0, policy_version 422175 (0.0008) [2023-12-27 22:16:12,968][106225] Updated weights for policy 1, policy_version 423447 (0.0010) [2023-12-27 22:16:13,025][106225] Updated weights for policy 1, policy_version 423457 (0.0010) [2023-12-27 22:16:13,078][106225] Updated weights for policy 1, policy_version 423467 (0.0009) [2023-12-27 22:16:13,362][106226] Updated weights for policy 0, policy_version 422185 (0.0006) [2023-12-27 22:16:13,430][106226] Updated weights for policy 0, policy_version 422195 (0.0005) [2023-12-27 22:16:13,492][106226] Updated weights for policy 0, policy_version 422205 (0.0010) [2023-12-27 22:16:13,547][106226] Updated weights for policy 0, policy_version 422215 (0.0006) [2023-12-27 22:16:13,828][106225] Updated weights for policy 1, policy_version 423477 (0.0010) [2023-12-27 22:16:13,892][106225] Updated weights for policy 1, policy_version 423487 (0.0010) [2023-12-27 22:16:13,958][106225] Updated weights for policy 1, policy_version 423497 (0.0010) [2023-12-27 22:16:14,110][106226] Updated weights for policy 0, policy_version 422225 (0.0010) [2023-12-27 22:16:14,177][106226] Updated weights for policy 0, policy_version 422235 (0.0011) [2023-12-27 22:16:14,229][106226] Updated weights for policy 0, policy_version 422245 (0.0008) [2023-12-27 22:16:14,621][106225] Updated weights for policy 1, policy_version 423507 (0.0009) [2023-12-27 22:16:14,688][106225] Updated weights for policy 1, policy_version 423517 (0.0008) [2023-12-27 22:16:14,759][106225] Updated weights for policy 1, policy_version 423527 (0.0010) [2023-12-27 22:16:14,815][106226] Updated weights for policy 0, policy_version 422255 (0.0008) [2023-12-27 22:16:14,875][106226] Updated weights for policy 0, policy_version 422265 (0.0008) [2023-12-27 22:16:14,935][106226] Updated weights for policy 0, policy_version 422275 (0.0008) [2023-12-27 22:16:15,451][106225] Updated weights for policy 1, policy_version 423537 (0.0011) [2023-12-27 22:16:15,501][106225] Updated weights for policy 1, policy_version 423547 (0.0007) [2023-12-27 22:16:15,553][106225] Updated weights for policy 1, policy_version 423557 (0.0005) [2023-12-27 22:16:15,606][106225] Updated weights for policy 1, policy_version 423567 (0.0005) [2023-12-27 22:16:15,692][106226] Updated weights for policy 0, policy_version 422285 (0.0010) [2023-12-27 22:16:15,761][106226] Updated weights for policy 0, policy_version 422295 (0.0011) [2023-12-27 22:16:15,824][106226] Updated weights for policy 0, policy_version 422305 (0.0010) [2023-12-27 22:16:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 216604672. Throughput: 0: 9721.8, 1: 9495.8. Samples: 216595440. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:16:16,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.716')] [2023-12-27 22:16:16,210][106225] Updated weights for policy 1, policy_version 423577 (0.0006) [2023-12-27 22:16:16,273][106225] Updated weights for policy 1, policy_version 423587 (0.0005) [2023-12-27 22:16:16,335][106225] Updated weights for policy 1, policy_version 423597 (0.0006) [2023-12-27 22:16:16,515][106226] Updated weights for policy 0, policy_version 422315 (0.0011) [2023-12-27 22:16:16,582][106226] Updated weights for policy 0, policy_version 422325 (0.0011) [2023-12-27 22:16:16,649][106226] Updated weights for policy 0, policy_version 422335 (0.0011) [2023-12-27 22:16:16,878][106225] Updated weights for policy 1, policy_version 423607 (0.0007) [2023-12-27 22:16:16,934][106225] Updated weights for policy 1, policy_version 423617 (0.0006) [2023-12-27 22:16:16,986][106225] Updated weights for policy 1, policy_version 423627 (0.0005) [2023-12-27 22:16:17,248][106226] Updated weights for policy 0, policy_version 422345 (0.0010) [2023-12-27 22:16:17,307][106226] Updated weights for policy 0, policy_version 422355 (0.0005) [2023-12-27 22:16:17,363][106226] Updated weights for policy 0, policy_version 422365 (0.0005) [2023-12-27 22:16:17,419][106226] Updated weights for policy 0, policy_version 422375 (0.0005) [2023-12-27 22:16:17,708][106225] Updated weights for policy 1, policy_version 423637 (0.0008) [2023-12-27 22:16:17,770][106225] Updated weights for policy 1, policy_version 423647 (0.0010) [2023-12-27 22:16:17,828][106225] Updated weights for policy 1, policy_version 423657 (0.0010) [2023-12-27 22:16:17,942][106226] Updated weights for policy 0, policy_version 422385 (0.0010) [2023-12-27 22:16:17,998][106226] Updated weights for policy 0, policy_version 422395 (0.0010) [2023-12-27 22:16:18,055][106226] Updated weights for policy 0, policy_version 422405 (0.0010) [2023-12-27 22:16:18,578][106225] Updated weights for policy 1, policy_version 423667 (0.0008) [2023-12-27 22:16:18,642][106225] Updated weights for policy 1, policy_version 423677 (0.0009) [2023-12-27 22:16:18,691][106225] Updated weights for policy 1, policy_version 423687 (0.0008) [2023-12-27 22:16:18,750][106226] Updated weights for policy 0, policy_version 422415 (0.0007) [2023-12-27 22:16:18,814][106226] Updated weights for policy 0, policy_version 422425 (0.0008) [2023-12-27 22:16:18,877][106226] Updated weights for policy 0, policy_version 422435 (0.0009) [2023-12-27 22:16:19,449][106225] Updated weights for policy 1, policy_version 423697 (0.0008) [2023-12-27 22:16:19,513][106225] Updated weights for policy 1, policy_version 423707 (0.0009) [2023-12-27 22:16:19,566][106225] Updated weights for policy 1, policy_version 423717 (0.0008) [2023-12-27 22:16:19,617][106225] Updated weights for policy 1, policy_version 423727 (0.0007) [2023-12-27 22:16:19,661][106226] Updated weights for policy 0, policy_version 422445 (0.0010) [2023-12-27 22:16:19,717][106226] Updated weights for policy 0, policy_version 422455 (0.0008) [2023-12-27 22:16:19,779][106226] Updated weights for policy 0, policy_version 422465 (0.0007) [2023-12-27 22:16:20,374][106225] Updated weights for policy 1, policy_version 423737 (0.0008) [2023-12-27 22:16:20,431][106225] Updated weights for policy 1, policy_version 423747 (0.0007) [2023-12-27 22:16:20,490][106225] Updated weights for policy 1, policy_version 423757 (0.0005) [2023-12-27 22:16:20,603][106226] Updated weights for policy 0, policy_version 422475 (0.0009) [2023-12-27 22:16:20,665][106226] Updated weights for policy 0, policy_version 422485 (0.0009) [2023-12-27 22:16:20,731][106226] Updated weights for policy 0, policy_version 422495 (0.0009) [2023-12-27 22:16:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 19410.9). Total num frames: 216702976. Throughput: 0: 9662.1, 1: 9529.0. Samples: 216713656. Policy #0 lag: (min: 16.0, avg: 38.8, max: 48.0) [2023-12-27 22:16:21,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-5.536')] [2023-12-27 22:16:21,274][106225] Updated weights for policy 1, policy_version 423767 (0.0008) [2023-12-27 22:16:21,336][106225] Updated weights for policy 1, policy_version 423777 (0.0009) [2023-12-27 22:16:21,412][106225] Updated weights for policy 1, policy_version 423787 (0.0007) [2023-12-27 22:16:21,506][106226] Updated weights for policy 0, policy_version 422505 (0.0009) [2023-12-27 22:16:21,567][106226] Updated weights for policy 0, policy_version 422515 (0.0008) [2023-12-27 22:16:21,635][106226] Updated weights for policy 0, policy_version 422525 (0.0008) [2023-12-27 22:16:21,701][106226] Updated weights for policy 0, policy_version 422535 (0.0009) [2023-12-27 22:16:22,150][106225] Updated weights for policy 1, policy_version 423797 (0.0008) [2023-12-27 22:16:22,204][106225] Updated weights for policy 1, policy_version 423807 (0.0009) [2023-12-27 22:16:22,268][106225] Updated weights for policy 1, policy_version 423817 (0.0009) [2023-12-27 22:16:22,404][106226] Updated weights for policy 0, policy_version 422545 (0.0009) [2023-12-27 22:16:22,454][106226] Updated weights for policy 0, policy_version 422555 (0.0009) [2023-12-27 22:16:22,504][106226] Updated weights for policy 0, policy_version 422565 (0.0009) [2023-12-27 22:16:23,119][106225] Updated weights for policy 1, policy_version 423827 (0.0010) [2023-12-27 22:16:23,188][106225] Updated weights for policy 1, policy_version 423837 (0.0009) [2023-12-27 22:16:23,207][106226] Updated weights for policy 0, policy_version 422575 (0.0006) [2023-12-27 22:16:23,234][106225] Updated weights for policy 1, policy_version 423847 (0.0009) [2023-12-27 22:16:23,269][106226] Updated weights for policy 0, policy_version 422585 (0.0005) [2023-12-27 22:16:23,330][106226] Updated weights for policy 0, policy_version 422595 (0.0007) [2023-12-27 22:16:23,961][106226] Updated weights for policy 0, policy_version 422605 (0.0008) [2023-12-27 22:16:24,000][106225] Updated weights for policy 1, policy_version 423857 (0.0008) [2023-12-27 22:16:24,018][106226] Updated weights for policy 0, policy_version 422615 (0.0007) [2023-12-27 22:16:24,058][106225] Updated weights for policy 1, policy_version 423867 (0.0007) [2023-12-27 22:16:24,072][106226] Updated weights for policy 0, policy_version 422625 (0.0005) [2023-12-27 22:16:24,123][106225] Updated weights for policy 1, policy_version 423877 (0.0009) [2023-12-27 22:16:24,183][106225] Updated weights for policy 1, policy_version 423887 (0.0007) [2023-12-27 22:16:24,740][106225] Updated weights for policy 1, policy_version 423897 (0.0005) [2023-12-27 22:16:24,800][106225] Updated weights for policy 1, policy_version 423907 (0.0005) [2023-12-27 22:16:24,818][106226] Updated weights for policy 0, policy_version 422635 (0.0008) [2023-12-27 22:16:24,848][106225] Updated weights for policy 1, policy_version 423917 (0.0005) [2023-12-27 22:16:24,874][106226] Updated weights for policy 0, policy_version 422645 (0.0010) [2023-12-27 22:16:24,928][106226] Updated weights for policy 0, policy_version 422655 (0.0011) [2023-12-27 22:16:25,450][106225] Updated weights for policy 1, policy_version 423927 (0.0005) [2023-12-27 22:16:25,500][106225] Updated weights for policy 1, policy_version 423937 (0.0005) [2023-12-27 22:16:25,517][106226] Updated weights for policy 0, policy_version 422665 (0.0011) [2023-12-27 22:16:25,556][106225] Updated weights for policy 1, policy_version 423947 (0.0007) [2023-12-27 22:16:25,571][106226] Updated weights for policy 0, policy_version 422675 (0.0010) [2023-12-27 22:16:25,618][106226] Updated weights for policy 0, policy_version 422685 (0.0010) [2023-12-27 22:16:25,668][106226] Updated weights for policy 0, policy_version 422695 (0.0011) [2023-12-27 22:16:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 216801280. Throughput: 0: 9667.5, 1: 9487.4. Samples: 216770144. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:26,175][105115] Avg episode reward: [(0, '-4.681'), (1, '-5.668')] [2023-12-27 22:16:26,178][106225] Updated weights for policy 1, policy_version 423957 (0.0010) [2023-12-27 22:16:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000422696_108240896.pth... [2023-12-27 22:16:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000421544_107945984.pth [2023-12-27 22:16:26,235][106225] Updated weights for policy 1, policy_version 423967 (0.0008) [2023-12-27 22:16:26,301][106225] Updated weights for policy 1, policy_version 423977 (0.0010) [2023-12-27 22:16:26,303][106226] Updated weights for policy 0, policy_version 422705 (0.0011) [2023-12-27 22:16:26,347][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000423984_108568576.pth... [2023-12-27 22:16:26,352][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000422832_108273664.pth [2023-12-27 22:16:26,359][106226] Updated weights for policy 0, policy_version 422715 (0.0011) [2023-12-27 22:16:26,413][106226] Updated weights for policy 0, policy_version 422725 (0.0010) [2023-12-27 22:16:26,987][106225] Updated weights for policy 1, policy_version 423987 (0.0011) [2023-12-27 22:16:27,041][106225] Updated weights for policy 1, policy_version 423997 (0.0010) [2023-12-27 22:16:27,105][106225] Updated weights for policy 1, policy_version 424007 (0.0010) [2023-12-27 22:16:27,122][106226] Updated weights for policy 0, policy_version 422735 (0.0009) [2023-12-27 22:16:27,173][106226] Updated weights for policy 0, policy_version 422745 (0.0010) [2023-12-27 22:16:27,227][106226] Updated weights for policy 0, policy_version 422755 (0.0007) [2023-12-27 22:16:27,816][106225] Updated weights for policy 1, policy_version 424017 (0.0011) [2023-12-27 22:16:27,872][106225] Updated weights for policy 1, policy_version 424027 (0.0010) [2023-12-27 22:16:27,901][106226] Updated weights for policy 0, policy_version 422765 (0.0008) [2023-12-27 22:16:27,931][106225] Updated weights for policy 1, policy_version 424037 (0.0010) [2023-12-27 22:16:27,959][106226] Updated weights for policy 0, policy_version 422775 (0.0010) [2023-12-27 22:16:27,993][106225] Updated weights for policy 1, policy_version 424047 (0.0011) [2023-12-27 22:16:28,024][106226] Updated weights for policy 0, policy_version 422785 (0.0008) [2023-12-27 22:16:28,739][106225] Updated weights for policy 1, policy_version 424057 (0.0008) [2023-12-27 22:16:28,805][106225] Updated weights for policy 1, policy_version 424067 (0.0007) [2023-12-27 22:16:28,839][106226] Updated weights for policy 0, policy_version 422795 (0.0011) [2023-12-27 22:16:28,863][106225] Updated weights for policy 1, policy_version 424077 (0.0007) [2023-12-27 22:16:28,885][106226] Updated weights for policy 0, policy_version 422805 (0.0008) [2023-12-27 22:16:28,940][106226] Updated weights for policy 0, policy_version 422815 (0.0009) [2023-12-27 22:16:29,507][106225] Updated weights for policy 1, policy_version 424087 (0.0007) [2023-12-27 22:16:29,568][106225] Updated weights for policy 1, policy_version 424097 (0.0008) [2023-12-27 22:16:29,618][106225] Updated weights for policy 1, policy_version 424107 (0.0007) [2023-12-27 22:16:29,733][106226] Updated weights for policy 0, policy_version 422825 (0.0011) [2023-12-27 22:16:29,796][106226] Updated weights for policy 0, policy_version 422835 (0.0010) [2023-12-27 22:16:29,865][106226] Updated weights for policy 0, policy_version 422845 (0.0008) [2023-12-27 22:16:29,934][106226] Updated weights for policy 0, policy_version 422855 (0.0008) [2023-12-27 22:16:30,341][106225] Updated weights for policy 1, policy_version 424117 (0.0008) [2023-12-27 22:16:30,401][106225] Updated weights for policy 1, policy_version 424127 (0.0010) [2023-12-27 22:16:30,457][106225] Updated weights for policy 1, policy_version 424137 (0.0007) [2023-12-27 22:16:30,548][106226] Updated weights for policy 0, policy_version 422865 (0.0010) [2023-12-27 22:16:30,608][106226] Updated weights for policy 0, policy_version 422875 (0.0010) [2023-12-27 22:16:30,665][106226] Updated weights for policy 0, policy_version 422885 (0.0011) [2023-12-27 22:16:31,136][106225] Updated weights for policy 1, policy_version 424147 (0.0009) [2023-12-27 22:16:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 216899584. Throughput: 0: 9752.5, 1: 9618.7. Samples: 216892384. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:31,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-5.544')] [2023-12-27 22:16:31,204][106225] Updated weights for policy 1, policy_version 424157 (0.0008) [2023-12-27 22:16:31,275][106225] Updated weights for policy 1, policy_version 424167 (0.0009) [2023-12-27 22:16:31,420][106226] Updated weights for policy 0, policy_version 422895 (0.0010) [2023-12-27 22:16:31,478][106226] Updated weights for policy 0, policy_version 422905 (0.0007) [2023-12-27 22:16:31,534][106226] Updated weights for policy 0, policy_version 422915 (0.0005) [2023-12-27 22:16:32,028][106225] Updated weights for policy 1, policy_version 424177 (0.0009) [2023-12-27 22:16:32,088][106225] Updated weights for policy 1, policy_version 424187 (0.0008) [2023-12-27 22:16:32,146][106225] Updated weights for policy 1, policy_version 424197 (0.0008) [2023-12-27 22:16:32,210][106225] Updated weights for policy 1, policy_version 424207 (0.0008) [2023-12-27 22:16:32,263][106226] Updated weights for policy 0, policy_version 422925 (0.0009) [2023-12-27 22:16:32,324][106226] Updated weights for policy 0, policy_version 422935 (0.0011) [2023-12-27 22:16:32,394][106226] Updated weights for policy 0, policy_version 422945 (0.0010) [2023-12-27 22:16:32,987][106225] Updated weights for policy 1, policy_version 424217 (0.0008) [2023-12-27 22:16:33,038][106225] Updated weights for policy 1, policy_version 424227 (0.0008) [2023-12-27 22:16:33,090][106225] Updated weights for policy 1, policy_version 424237 (0.0007) [2023-12-27 22:16:33,100][106226] Updated weights for policy 0, policy_version 422955 (0.0010) [2023-12-27 22:16:33,161][106226] Updated weights for policy 0, policy_version 422965 (0.0008) [2023-12-27 22:16:33,223][106226] Updated weights for policy 0, policy_version 422975 (0.0005) [2023-12-27 22:16:33,774][106225] Updated weights for policy 1, policy_version 424247 (0.0007) [2023-12-27 22:16:33,831][106225] Updated weights for policy 1, policy_version 424257 (0.0008) [2023-12-27 22:16:33,888][106225] Updated weights for policy 1, policy_version 424267 (0.0007) [2023-12-27 22:16:33,901][106226] Updated weights for policy 0, policy_version 422985 (0.0006) [2023-12-27 22:16:33,960][106226] Updated weights for policy 0, policy_version 422995 (0.0010) [2023-12-27 22:16:34,027][106226] Updated weights for policy 0, policy_version 423005 (0.0008) [2023-12-27 22:16:34,091][106226] Updated weights for policy 0, policy_version 423015 (0.0006) [2023-12-27 22:16:34,629][106225] Updated weights for policy 1, policy_version 424277 (0.0007) [2023-12-27 22:16:34,686][106225] Updated weights for policy 1, policy_version 424287 (0.0008) [2023-12-27 22:16:34,741][106225] Updated weights for policy 1, policy_version 424297 (0.0007) [2023-12-27 22:16:34,765][106226] Updated weights for policy 0, policy_version 423025 (0.0008) [2023-12-27 22:16:34,821][106226] Updated weights for policy 0, policy_version 423035 (0.0008) [2023-12-27 22:16:34,881][106226] Updated weights for policy 0, policy_version 423045 (0.0008) [2023-12-27 22:16:35,442][106225] Updated weights for policy 1, policy_version 424307 (0.0008) [2023-12-27 22:16:35,500][106225] Updated weights for policy 1, policy_version 424317 (0.0008) [2023-12-27 22:16:35,563][106225] Updated weights for policy 1, policy_version 424327 (0.0008) [2023-12-27 22:16:35,608][106226] Updated weights for policy 0, policy_version 423055 (0.0008) [2023-12-27 22:16:35,661][106226] Updated weights for policy 0, policy_version 423065 (0.0008) [2023-12-27 22:16:35,714][106226] Updated weights for policy 0, policy_version 423075 (0.0009) [2023-12-27 22:16:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 216997888. Throughput: 0: 9781.2, 1: 9584.2. Samples: 217008580. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:36,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-5.816')] [2023-12-27 22:16:36,305][106225] Updated weights for policy 1, policy_version 424337 (0.0006) [2023-12-27 22:16:36,365][106225] Updated weights for policy 1, policy_version 424347 (0.0008) [2023-12-27 22:16:36,387][106226] Updated weights for policy 0, policy_version 423085 (0.0007) [2023-12-27 22:16:36,428][106225] Updated weights for policy 1, policy_version 424357 (0.0008) [2023-12-27 22:16:36,447][106226] Updated weights for policy 0, policy_version 423095 (0.0005) [2023-12-27 22:16:36,494][106225] Updated weights for policy 1, policy_version 424367 (0.0010) [2023-12-27 22:16:36,513][106226] Updated weights for policy 0, policy_version 423105 (0.0009) [2023-12-27 22:16:37,102][106225] Updated weights for policy 1, policy_version 424377 (0.0008) [2023-12-27 22:16:37,169][106225] Updated weights for policy 1, policy_version 424387 (0.0007) [2023-12-27 22:16:37,228][106225] Updated weights for policy 1, policy_version 424397 (0.0008) [2023-12-27 22:16:37,284][106226] Updated weights for policy 0, policy_version 423115 (0.0010) [2023-12-27 22:16:37,340][106226] Updated weights for policy 0, policy_version 423125 (0.0009) [2023-12-27 22:16:37,398][106226] Updated weights for policy 0, policy_version 423135 (0.0008) [2023-12-27 22:16:37,854][106225] Updated weights for policy 1, policy_version 424407 (0.0008) [2023-12-27 22:16:37,910][106225] Updated weights for policy 1, policy_version 424417 (0.0009) [2023-12-27 22:16:37,967][106225] Updated weights for policy 1, policy_version 424427 (0.0007) [2023-12-27 22:16:38,171][106226] Updated weights for policy 0, policy_version 423145 (0.0008) [2023-12-27 22:16:38,227][106226] Updated weights for policy 0, policy_version 423155 (0.0008) [2023-12-27 22:16:38,274][106226] Updated weights for policy 0, policy_version 423165 (0.0008) [2023-12-27 22:16:38,330][106226] Updated weights for policy 0, policy_version 423175 (0.0007) [2023-12-27 22:16:38,728][106225] Updated weights for policy 1, policy_version 424437 (0.0007) [2023-12-27 22:16:38,783][106225] Updated weights for policy 1, policy_version 424447 (0.0008) [2023-12-27 22:16:38,843][106225] Updated weights for policy 1, policy_version 424457 (0.0009) [2023-12-27 22:16:39,035][106226] Updated weights for policy 0, policy_version 423185 (0.0008) [2023-12-27 22:16:39,097][106226] Updated weights for policy 0, policy_version 423195 (0.0009) [2023-12-27 22:16:39,156][106226] Updated weights for policy 0, policy_version 423205 (0.0008) [2023-12-27 22:16:39,579][106225] Updated weights for policy 1, policy_version 424467 (0.0008) [2023-12-27 22:16:39,646][106225] Updated weights for policy 1, policy_version 424477 (0.0008) [2023-12-27 22:16:39,712][106225] Updated weights for policy 1, policy_version 424487 (0.0008) [2023-12-27 22:16:39,948][106226] Updated weights for policy 0, policy_version 423215 (0.0010) [2023-12-27 22:16:40,010][106226] Updated weights for policy 0, policy_version 423225 (0.0011) [2023-12-27 22:16:40,059][106226] Updated weights for policy 0, policy_version 423235 (0.0010) [2023-12-27 22:16:40,494][106225] Updated weights for policy 1, policy_version 424497 (0.0008) [2023-12-27 22:16:40,556][106225] Updated weights for policy 1, policy_version 424507 (0.0008) [2023-12-27 22:16:40,621][106225] Updated weights for policy 1, policy_version 424517 (0.0007) [2023-12-27 22:16:40,677][106225] Updated weights for policy 1, policy_version 424527 (0.0008) [2023-12-27 22:16:40,808][106226] Updated weights for policy 0, policy_version 423245 (0.0011) [2023-12-27 22:16:40,870][106226] Updated weights for policy 0, policy_version 423255 (0.0011) [2023-12-27 22:16:40,933][106226] Updated weights for policy 0, policy_version 423265 (0.0010) [2023-12-27 22:16:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 217096192. Throughput: 0: 9784.9, 1: 9673.8. Samples: 217067228. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:41,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.550')] [2023-12-27 22:16:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000424528_108707840.pth... [2023-12-27 22:16:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000423272_108388352.pth... [2023-12-27 22:16:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000423408_108421120.pth [2023-12-27 22:16:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000422120_108093440.pth [2023-12-27 22:16:41,467][106225] Updated weights for policy 1, policy_version 424537 (0.0008) [2023-12-27 22:16:41,526][106225] Updated weights for policy 1, policy_version 424547 (0.0008) [2023-12-27 22:16:41,579][106225] Updated weights for policy 1, policy_version 424557 (0.0008) [2023-12-27 22:16:41,781][106226] Updated weights for policy 0, policy_version 423275 (0.0011) [2023-12-27 22:16:41,833][106226] Updated weights for policy 0, policy_version 423285 (0.0008) [2023-12-27 22:16:41,893][106226] Updated weights for policy 0, policy_version 423295 (0.0006) [2023-12-27 22:16:42,391][106225] Updated weights for policy 1, policy_version 424567 (0.0009) [2023-12-27 22:16:42,452][106225] Updated weights for policy 1, policy_version 424577 (0.0007) [2023-12-27 22:16:42,515][106225] Updated weights for policy 1, policy_version 424587 (0.0008) [2023-12-27 22:16:42,623][106226] Updated weights for policy 0, policy_version 423305 (0.0006) [2023-12-27 22:16:42,680][106226] Updated weights for policy 0, policy_version 423315 (0.0008) [2023-12-27 22:16:42,744][106226] Updated weights for policy 0, policy_version 423325 (0.0008) [2023-12-27 22:16:42,798][106226] Updated weights for policy 0, policy_version 423335 (0.0008) [2023-12-27 22:16:43,248][106225] Updated weights for policy 1, policy_version 424597 (0.0008) [2023-12-27 22:16:43,312][106225] Updated weights for policy 1, policy_version 424607 (0.0008) [2023-12-27 22:16:43,375][106225] Updated weights for policy 1, policy_version 424617 (0.0008) [2023-12-27 22:16:43,548][106226] Updated weights for policy 0, policy_version 423345 (0.0011) [2023-12-27 22:16:43,612][106226] Updated weights for policy 0, policy_version 423355 (0.0011) [2023-12-27 22:16:43,680][106226] Updated weights for policy 0, policy_version 423365 (0.0009) [2023-12-27 22:16:44,011][106225] Updated weights for policy 1, policy_version 424627 (0.0007) [2023-12-27 22:16:44,070][106225] Updated weights for policy 1, policy_version 424637 (0.0005) [2023-12-27 22:16:44,133][106225] Updated weights for policy 1, policy_version 424647 (0.0007) [2023-12-27 22:16:44,339][106226] Updated weights for policy 0, policy_version 423375 (0.0006) [2023-12-27 22:16:44,405][106226] Updated weights for policy 0, policy_version 423385 (0.0011) [2023-12-27 22:16:44,464][106226] Updated weights for policy 0, policy_version 423395 (0.0010) [2023-12-27 22:16:44,820][106225] Updated weights for policy 1, policy_version 424657 (0.0008) [2023-12-27 22:16:44,874][106225] Updated weights for policy 1, policy_version 424667 (0.0008) [2023-12-27 22:16:44,932][106225] Updated weights for policy 1, policy_version 424677 (0.0008) [2023-12-27 22:16:44,982][106225] Updated weights for policy 1, policy_version 424687 (0.0009) [2023-12-27 22:16:45,141][106226] Updated weights for policy 0, policy_version 423405 (0.0009) [2023-12-27 22:16:45,205][106226] Updated weights for policy 0, policy_version 423415 (0.0009) [2023-12-27 22:16:45,273][106226] Updated weights for policy 0, policy_version 423425 (0.0010) [2023-12-27 22:16:45,737][106225] Updated weights for policy 1, policy_version 424697 (0.0008) [2023-12-27 22:16:45,800][106225] Updated weights for policy 1, policy_version 424707 (0.0009) [2023-12-27 22:16:45,851][106225] Updated weights for policy 1, policy_version 424718 (0.0010) [2023-12-27 22:16:45,939][106226] Updated weights for policy 0, policy_version 423435 (0.0007) [2023-12-27 22:16:46,003][106226] Updated weights for policy 0, policy_version 423445 (0.0007) [2023-12-27 22:16:46,064][106226] Updated weights for policy 0, policy_version 423455 (0.0008) [2023-12-27 22:16:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 217194496. Throughput: 0: 9767.0, 1: 9699.1. Samples: 217179456. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:46,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.836')] [2023-12-27 22:16:46,614][106225] Updated weights for policy 1, policy_version 424728 (0.0009) [2023-12-27 22:16:46,658][106225] Updated weights for policy 1, policy_version 424738 (0.0005) [2023-12-27 22:16:46,684][106226] Updated weights for policy 0, policy_version 423465 (0.0008) [2023-12-27 22:16:46,707][106225] Updated weights for policy 1, policy_version 424748 (0.0007) [2023-12-27 22:16:46,743][106226] Updated weights for policy 0, policy_version 423475 (0.0006) [2023-12-27 22:16:46,801][106226] Updated weights for policy 0, policy_version 423485 (0.0006) [2023-12-27 22:16:46,863][106226] Updated weights for policy 0, policy_version 423495 (0.0009) [2023-12-27 22:16:47,430][106225] Updated weights for policy 1, policy_version 424758 (0.0009) [2023-12-27 22:16:47,488][106225] Updated weights for policy 1, policy_version 424768 (0.0006) [2023-12-27 22:16:47,538][106225] Updated weights for policy 1, policy_version 424778 (0.0006) [2023-12-27 22:16:47,568][106226] Updated weights for policy 0, policy_version 423505 (0.0008) [2023-12-27 22:16:47,625][106226] Updated weights for policy 0, policy_version 423515 (0.0008) [2023-12-27 22:16:47,678][106226] Updated weights for policy 0, policy_version 423525 (0.0008) [2023-12-27 22:16:48,292][106225] Updated weights for policy 1, policy_version 424788 (0.0007) [2023-12-27 22:16:48,356][106225] Updated weights for policy 1, policy_version 424798 (0.0008) [2023-12-27 22:16:48,357][106226] Updated weights for policy 0, policy_version 423535 (0.0008) [2023-12-27 22:16:48,417][106226] Updated weights for policy 0, policy_version 423545 (0.0008) [2023-12-27 22:16:48,420][106225] Updated weights for policy 1, policy_version 424808 (0.0006) [2023-12-27 22:16:48,480][106226] Updated weights for policy 0, policy_version 423555 (0.0008) [2023-12-27 22:16:49,120][106226] Updated weights for policy 0, policy_version 423565 (0.0007) [2023-12-27 22:16:49,135][106225] Updated weights for policy 1, policy_version 424818 (0.0006) [2023-12-27 22:16:49,177][106226] Updated weights for policy 0, policy_version 423575 (0.0008) [2023-12-27 22:16:49,188][106225] Updated weights for policy 1, policy_version 424828 (0.0006) [2023-12-27 22:16:49,240][106226] Updated weights for policy 0, policy_version 423585 (0.0010) [2023-12-27 22:16:49,255][106225] Updated weights for policy 1, policy_version 424838 (0.0007) [2023-12-27 22:16:49,315][106225] Updated weights for policy 1, policy_version 424848 (0.0007) [2023-12-27 22:16:49,934][106226] Updated weights for policy 0, policy_version 423595 (0.0010) [2023-12-27 22:16:49,998][106226] Updated weights for policy 0, policy_version 423605 (0.0008) [2023-12-27 22:16:50,061][106226] Updated weights for policy 0, policy_version 423615 (0.0008) [2023-12-27 22:16:50,154][106225] Updated weights for policy 1, policy_version 424858 (0.0008) [2023-12-27 22:16:50,216][106225] Updated weights for policy 1, policy_version 424868 (0.0008) [2023-12-27 22:16:50,279][106225] Updated weights for policy 1, policy_version 424878 (0.0008) [2023-12-27 22:16:50,818][106226] Updated weights for policy 0, policy_version 423625 (0.0007) [2023-12-27 22:16:50,876][106226] Updated weights for policy 0, policy_version 423635 (0.0008) [2023-12-27 22:16:50,936][106226] Updated weights for policy 0, policy_version 423645 (0.0008) [2023-12-27 22:16:50,995][106226] Updated weights for policy 0, policy_version 423655 (0.0008) [2023-12-27 22:16:51,040][106225] Updated weights for policy 1, policy_version 424888 (0.0009) [2023-12-27 22:16:51,107][106225] Updated weights for policy 1, policy_version 424898 (0.0008) [2023-12-27 22:16:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 217284608. Throughput: 0: 9789.3, 1: 9630.8. Samples: 217295188. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:51,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.775')] [2023-12-27 22:16:51,181][106225] Updated weights for policy 1, policy_version 424908 (0.0007) [2023-12-27 22:16:51,789][106226] Updated weights for policy 0, policy_version 423665 (0.0008) [2023-12-27 22:16:51,841][106226] Updated weights for policy 0, policy_version 423675 (0.0008) [2023-12-27 22:16:51,892][106226] Updated weights for policy 0, policy_version 423685 (0.0009) [2023-12-27 22:16:51,899][106225] Updated weights for policy 1, policy_version 424918 (0.0007) [2023-12-27 22:16:51,953][106225] Updated weights for policy 1, policy_version 424928 (0.0007) [2023-12-27 22:16:52,005][106225] Updated weights for policy 1, policy_version 424938 (0.0006) [2023-12-27 22:16:52,643][106225] Updated weights for policy 1, policy_version 424948 (0.0007) [2023-12-27 22:16:52,694][106226] Updated weights for policy 0, policy_version 423695 (0.0007) [2023-12-27 22:16:52,695][106225] Updated weights for policy 1, policy_version 424958 (0.0009) [2023-12-27 22:16:52,746][106226] Updated weights for policy 0, policy_version 423705 (0.0009) [2023-12-27 22:16:52,748][106225] Updated weights for policy 1, policy_version 424968 (0.0007) [2023-12-27 22:16:52,797][106226] Updated weights for policy 0, policy_version 423715 (0.0011) [2023-12-27 22:16:53,468][106226] Updated weights for policy 0, policy_version 423725 (0.0008) [2023-12-27 22:16:53,526][106226] Updated weights for policy 0, policy_version 423735 (0.0005) [2023-12-27 22:16:53,543][106225] Updated weights for policy 1, policy_version 424978 (0.0007) [2023-12-27 22:16:53,590][106226] Updated weights for policy 0, policy_version 423745 (0.0009) [2023-12-27 22:16:53,596][106225] Updated weights for policy 1, policy_version 424988 (0.0010) [2023-12-27 22:16:53,643][106225] Updated weights for policy 1, policy_version 424998 (0.0010) [2023-12-27 22:16:53,690][106225] Updated weights for policy 1, policy_version 425008 (0.0009) [2023-12-27 22:16:54,115][106226] Updated weights for policy 0, policy_version 423755 (0.0007) [2023-12-27 22:16:54,173][106226] Updated weights for policy 0, policy_version 423765 (0.0009) [2023-12-27 22:16:54,221][106226] Updated weights for policy 0, policy_version 423775 (0.0010) [2023-12-27 22:16:54,348][106225] Updated weights for policy 1, policy_version 425018 (0.0010) [2023-12-27 22:16:54,413][106225] Updated weights for policy 1, policy_version 425028 (0.0008) [2023-12-27 22:16:54,474][106225] Updated weights for policy 1, policy_version 425038 (0.0010) [2023-12-27 22:16:54,929][106226] Updated weights for policy 0, policy_version 423785 (0.0011) [2023-12-27 22:16:54,987][106226] Updated weights for policy 0, policy_version 423795 (0.0011) [2023-12-27 22:16:55,048][106226] Updated weights for policy 0, policy_version 423805 (0.0009) [2023-12-27 22:16:55,073][106225] Updated weights for policy 1, policy_version 425048 (0.0007) [2023-12-27 22:16:55,102][106226] Updated weights for policy 0, policy_version 423815 (0.0010) [2023-12-27 22:16:55,135][106225] Updated weights for policy 1, policy_version 425058 (0.0006) [2023-12-27 22:16:55,198][106225] Updated weights for policy 1, policy_version 425068 (0.0006) [2023-12-27 22:16:55,703][106226] Updated weights for policy 0, policy_version 423825 (0.0006) [2023-12-27 22:16:55,756][106226] Updated weights for policy 0, policy_version 423835 (0.0010) [2023-12-27 22:16:55,821][106226] Updated weights for policy 0, policy_version 423845 (0.0009) [2023-12-27 22:16:55,934][106225] Updated weights for policy 1, policy_version 425078 (0.0008) [2023-12-27 22:16:55,979][106225] Updated weights for policy 1, policy_version 425088 (0.0007) [2023-12-27 22:16:56,026][106225] Updated weights for policy 1, policy_version 425098 (0.0006) [2023-12-27 22:16:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19438.6). Total num frames: 217391104. Throughput: 0: 9802.6, 1: 9633.1. Samples: 217354436. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:16:56,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.409')] [2023-12-27 22:16:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000425104_108855296.pth... [2023-12-27 22:16:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000423848_108535808.pth... [2023-12-27 22:16:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000423984_108568576.pth [2023-12-27 22:16:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000422696_108240896.pth [2023-12-27 22:16:56,413][106226] Updated weights for policy 0, policy_version 423855 (0.0005) [2023-12-27 22:16:56,479][106226] Updated weights for policy 0, policy_version 423865 (0.0006) [2023-12-27 22:16:56,530][106226] Updated weights for policy 0, policy_version 423875 (0.0005) [2023-12-27 22:16:56,810][106225] Updated weights for policy 1, policy_version 425108 (0.0007) [2023-12-27 22:16:56,858][106225] Updated weights for policy 1, policy_version 425118 (0.0009) [2023-12-27 22:16:56,917][106225] Updated weights for policy 1, policy_version 425128 (0.0008) [2023-12-27 22:16:57,039][106226] Updated weights for policy 0, policy_version 423885 (0.0005) [2023-12-27 22:16:57,094][106226] Updated weights for policy 0, policy_version 423895 (0.0010) [2023-12-27 22:16:57,157][106226] Updated weights for policy 0, policy_version 423905 (0.0011) [2023-12-27 22:16:57,610][106225] Updated weights for policy 1, policy_version 425138 (0.0008) [2023-12-27 22:16:57,667][106225] Updated weights for policy 1, policy_version 425148 (0.0008) [2023-12-27 22:16:57,725][106225] Updated weights for policy 1, policy_version 425158 (0.0008) [2023-12-27 22:16:57,772][106225] Updated weights for policy 1, policy_version 425168 (0.0007) [2023-12-27 22:16:57,880][106226] Updated weights for policy 0, policy_version 423915 (0.0010) [2023-12-27 22:16:57,940][106226] Updated weights for policy 0, policy_version 423925 (0.0009) [2023-12-27 22:16:57,996][106226] Updated weights for policy 0, policy_version 423935 (0.0010) [2023-12-27 22:16:58,622][106225] Updated weights for policy 1, policy_version 425178 (0.0009) [2023-12-27 22:16:58,689][106225] Updated weights for policy 1, policy_version 425188 (0.0009) [2023-12-27 22:16:58,759][106225] Updated weights for policy 1, policy_version 425198 (0.0009) [2023-12-27 22:16:58,903][106226] Updated weights for policy 0, policy_version 423945 (0.0010) [2023-12-27 22:16:58,971][106226] Updated weights for policy 0, policy_version 423955 (0.0009) [2023-12-27 22:16:59,033][106226] Updated weights for policy 0, policy_version 423965 (0.0007) [2023-12-27 22:16:59,101][106226] Updated weights for policy 0, policy_version 423975 (0.0006) [2023-12-27 22:16:59,631][106225] Updated weights for policy 1, policy_version 425208 (0.0008) [2023-12-27 22:16:59,693][106225] Updated weights for policy 1, policy_version 425218 (0.0008) [2023-12-27 22:16:59,747][106225] Updated weights for policy 1, policy_version 425228 (0.0008) [2023-12-27 22:16:59,816][106226] Updated weights for policy 0, policy_version 423985 (0.0008) [2023-12-27 22:16:59,877][106226] Updated weights for policy 0, policy_version 423995 (0.0008) [2023-12-27 22:16:59,945][106226] Updated weights for policy 0, policy_version 424005 (0.0008) [2023-12-27 22:17:00,380][106225] Updated weights for policy 1, policy_version 425238 (0.0008) [2023-12-27 22:17:00,442][106225] Updated weights for policy 1, policy_version 425248 (0.0007) [2023-12-27 22:17:00,504][106225] Updated weights for policy 1, policy_version 425258 (0.0005) [2023-12-27 22:17:00,703][106226] Updated weights for policy 0, policy_version 424015 (0.0009) [2023-12-27 22:17:00,750][106226] Updated weights for policy 0, policy_version 424025 (0.0008) [2023-12-27 22:17:00,804][106226] Updated weights for policy 0, policy_version 424035 (0.0006) [2023-12-27 22:17:01,133][106225] Updated weights for policy 1, policy_version 425268 (0.0007) [2023-12-27 22:17:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 217481216. Throughput: 0: 9827.6, 1: 9661.8. Samples: 217472464. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:01,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.366')] [2023-12-27 22:17:01,211][106225] Updated weights for policy 1, policy_version 425278 (0.0009) [2023-12-27 22:17:01,281][106225] Updated weights for policy 1, policy_version 425288 (0.0010) [2023-12-27 22:17:01,502][106226] Updated weights for policy 0, policy_version 424045 (0.0005) [2023-12-27 22:17:01,557][106226] Updated weights for policy 0, policy_version 424055 (0.0006) [2023-12-27 22:17:01,613][106226] Updated weights for policy 0, policy_version 424065 (0.0007) [2023-12-27 22:17:02,020][106225] Updated weights for policy 1, policy_version 425298 (0.0010) [2023-12-27 22:17:02,084][106225] Updated weights for policy 1, policy_version 425308 (0.0010) [2023-12-27 22:17:02,145][106225] Updated weights for policy 1, policy_version 425318 (0.0011) [2023-12-27 22:17:02,204][106225] Updated weights for policy 1, policy_version 425328 (0.0010) [2023-12-27 22:17:02,380][106226] Updated weights for policy 0, policy_version 424075 (0.0008) [2023-12-27 22:17:02,447][106226] Updated weights for policy 0, policy_version 424085 (0.0008) [2023-12-27 22:17:02,503][106226] Updated weights for policy 0, policy_version 424095 (0.0008) [2023-12-27 22:17:02,873][106225] Updated weights for policy 1, policy_version 425338 (0.0005) [2023-12-27 22:17:02,924][106225] Updated weights for policy 1, policy_version 425348 (0.0005) [2023-12-27 22:17:02,979][106225] Updated weights for policy 1, policy_version 425358 (0.0005) [2023-12-27 22:17:03,262][106226] Updated weights for policy 0, policy_version 424105 (0.0008) [2023-12-27 22:17:03,328][106226] Updated weights for policy 0, policy_version 424115 (0.0008) [2023-12-27 22:17:03,381][106226] Updated weights for policy 0, policy_version 424125 (0.0008) [2023-12-27 22:17:03,427][106226] Updated weights for policy 0, policy_version 424135 (0.0007) [2023-12-27 22:17:03,606][106225] Updated weights for policy 1, policy_version 425368 (0.0008) [2023-12-27 22:17:03,664][106225] Updated weights for policy 1, policy_version 425378 (0.0007) [2023-12-27 22:17:03,721][106225] Updated weights for policy 1, policy_version 425388 (0.0007) [2023-12-27 22:17:04,168][106226] Updated weights for policy 0, policy_version 424145 (0.0009) [2023-12-27 22:17:04,227][106226] Updated weights for policy 0, policy_version 424155 (0.0008) [2023-12-27 22:17:04,283][106226] Updated weights for policy 0, policy_version 424165 (0.0008) [2023-12-27 22:17:04,383][106225] Updated weights for policy 1, policy_version 425398 (0.0009) [2023-12-27 22:17:04,446][106225] Updated weights for policy 1, policy_version 425408 (0.0009) [2023-12-27 22:17:04,515][106225] Updated weights for policy 1, policy_version 425418 (0.0008) [2023-12-27 22:17:05,017][106226] Updated weights for policy 0, policy_version 424175 (0.0009) [2023-12-27 22:17:05,078][106226] Updated weights for policy 0, policy_version 424185 (0.0008) [2023-12-27 22:17:05,141][106226] Updated weights for policy 0, policy_version 424195 (0.0008) [2023-12-27 22:17:05,179][106225] Updated weights for policy 1, policy_version 425428 (0.0008) [2023-12-27 22:17:05,244][106225] Updated weights for policy 1, policy_version 425438 (0.0009) [2023-12-27 22:17:05,294][106225] Updated weights for policy 1, policy_version 425448 (0.0008) [2023-12-27 22:17:05,813][106226] Updated weights for policy 0, policy_version 424205 (0.0008) [2023-12-27 22:17:05,868][106226] Updated weights for policy 0, policy_version 424215 (0.0009) [2023-12-27 22:17:05,930][106226] Updated weights for policy 0, policy_version 424225 (0.0007) [2023-12-27 22:17:05,970][106225] Updated weights for policy 1, policy_version 425458 (0.0007) [2023-12-27 22:17:06,021][106225] Updated weights for policy 1, policy_version 425468 (0.0007) [2023-12-27 22:17:06,088][106225] Updated weights for policy 1, policy_version 425478 (0.0005) [2023-12-27 22:17:06,163][106225] Updated weights for policy 1, policy_version 425488 (0.0009) [2023-12-27 22:17:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19438.6). Total num frames: 217587712. Throughput: 0: 9802.3, 1: 9699.2. Samples: 217591224. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:06,175][105115] Avg episode reward: [(0, '-4.954'), (1, '-5.585')] [2023-12-27 22:17:06,674][106226] Updated weights for policy 0, policy_version 424235 (0.0009) [2023-12-27 22:17:06,729][106226] Updated weights for policy 0, policy_version 424246 (0.0009) [2023-12-27 22:17:06,786][106226] Updated weights for policy 0, policy_version 424257 (0.0011) [2023-12-27 22:17:06,828][106225] Updated weights for policy 1, policy_version 425498 (0.0006) [2023-12-27 22:17:06,886][106225] Updated weights for policy 1, policy_version 425508 (0.0006) [2023-12-27 22:17:06,950][106225] Updated weights for policy 1, policy_version 425518 (0.0005) [2023-12-27 22:17:07,571][106226] Updated weights for policy 0, policy_version 424268 (0.0010) [2023-12-27 22:17:07,618][106226] Updated weights for policy 0, policy_version 424278 (0.0008) [2023-12-27 22:17:07,647][106225] Updated weights for policy 1, policy_version 425528 (0.0008) [2023-12-27 22:17:07,674][106226] Updated weights for policy 0, policy_version 424288 (0.0005) [2023-12-27 22:17:07,706][106225] Updated weights for policy 1, policy_version 425538 (0.0009) [2023-12-27 22:17:07,761][106225] Updated weights for policy 1, policy_version 425548 (0.0009) [2023-12-27 22:17:08,318][106226] Updated weights for policy 0, policy_version 424298 (0.0006) [2023-12-27 22:17:08,389][106226] Updated weights for policy 0, policy_version 424308 (0.0008) [2023-12-27 22:17:08,450][106226] Updated weights for policy 0, policy_version 424318 (0.0009) [2023-12-27 22:17:08,496][106225] Updated weights for policy 1, policy_version 425558 (0.0008) [2023-12-27 22:17:08,511][106226] Updated weights for policy 0, policy_version 424328 (0.0006) [2023-12-27 22:17:08,549][106225] Updated weights for policy 1, policy_version 425568 (0.0008) [2023-12-27 22:17:08,608][106225] Updated weights for policy 1, policy_version 425578 (0.0007) [2023-12-27 22:17:09,190][106226] Updated weights for policy 0, policy_version 424338 (0.0011) [2023-12-27 22:17:09,261][106226] Updated weights for policy 0, policy_version 424348 (0.0010) [2023-12-27 22:17:09,319][106226] Updated weights for policy 0, policy_version 424358 (0.0009) [2023-12-27 22:17:09,320][106225] Updated weights for policy 1, policy_version 425588 (0.0006) [2023-12-27 22:17:09,390][106225] Updated weights for policy 1, policy_version 425598 (0.0007) [2023-12-27 22:17:09,452][106225] Updated weights for policy 1, policy_version 425608 (0.0009) [2023-12-27 22:17:10,019][106226] Updated weights for policy 0, policy_version 424368 (0.0009) [2023-12-27 22:17:10,080][106226] Updated weights for policy 0, policy_version 424378 (0.0009) [2023-12-27 22:17:10,141][106226] Updated weights for policy 0, policy_version 424388 (0.0009) [2023-12-27 22:17:10,229][106225] Updated weights for policy 1, policy_version 425618 (0.0007) [2023-12-27 22:17:10,284][106225] Updated weights for policy 1, policy_version 425628 (0.0008) [2023-12-27 22:17:10,334][106225] Updated weights for policy 1, policy_version 425638 (0.0008) [2023-12-27 22:17:10,389][106225] Updated weights for policy 1, policy_version 425648 (0.0009) [2023-12-27 22:17:10,859][106226] Updated weights for policy 0, policy_version 424398 (0.0010) [2023-12-27 22:17:10,929][106226] Updated weights for policy 0, policy_version 424408 (0.0011) [2023-12-27 22:17:10,993][106226] Updated weights for policy 0, policy_version 424418 (0.0011) [2023-12-27 22:17:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 217677824. Throughput: 0: 9804.1, 1: 9770.8. Samples: 217651016. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:11,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.452')] [2023-12-27 22:17:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000424424_108683264.pth... [2023-12-27 22:17:11,187][106225] Updated weights for policy 1, policy_version 425658 (0.0008) [2023-12-27 22:17:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000423272_108388352.pth [2023-12-27 22:17:11,249][106225] Updated weights for policy 1, policy_version 425668 (0.0007) [2023-12-27 22:17:11,325][106225] Updated weights for policy 1, policy_version 425678 (0.0008) [2023-12-27 22:17:11,336][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000425680_109002752.pth... [2023-12-27 22:17:11,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000424528_108707840.pth [2023-12-27 22:17:11,810][106226] Updated weights for policy 0, policy_version 424428 (0.0009) [2023-12-27 22:17:11,882][106226] Updated weights for policy 0, policy_version 424438 (0.0006) [2023-12-27 22:17:11,949][106226] Updated weights for policy 0, policy_version 424448 (0.0010) [2023-12-27 22:17:12,128][106225] Updated weights for policy 1, policy_version 425688 (0.0008) [2023-12-27 22:17:12,198][106225] Updated weights for policy 1, policy_version 425698 (0.0010) [2023-12-27 22:17:12,260][106225] Updated weights for policy 1, policy_version 425708 (0.0007) [2023-12-27 22:17:12,582][106226] Updated weights for policy 0, policy_version 424458 (0.0011) [2023-12-27 22:17:12,651][106226] Updated weights for policy 0, policy_version 424468 (0.0010) [2023-12-27 22:17:12,718][106226] Updated weights for policy 0, policy_version 424478 (0.0010) [2023-12-27 22:17:12,792][106226] Updated weights for policy 0, policy_version 424488 (0.0011) [2023-12-27 22:17:13,006][106225] Updated weights for policy 1, policy_version 425718 (0.0008) [2023-12-27 22:17:13,063][106225] Updated weights for policy 1, policy_version 425728 (0.0008) [2023-12-27 22:17:13,125][106225] Updated weights for policy 1, policy_version 425738 (0.0008) [2023-12-27 22:17:13,414][106226] Updated weights for policy 0, policy_version 424498 (0.0009) [2023-12-27 22:17:13,479][106226] Updated weights for policy 0, policy_version 424508 (0.0008) [2023-12-27 22:17:13,541][106226] Updated weights for policy 0, policy_version 424518 (0.0008) [2023-12-27 22:17:13,819][106225] Updated weights for policy 1, policy_version 425748 (0.0008) [2023-12-27 22:17:13,882][106225] Updated weights for policy 1, policy_version 425758 (0.0006) [2023-12-27 22:17:13,947][106225] Updated weights for policy 1, policy_version 425768 (0.0009) [2023-12-27 22:17:14,279][106226] Updated weights for policy 0, policy_version 424528 (0.0008) [2023-12-27 22:17:14,341][106226] Updated weights for policy 0, policy_version 424538 (0.0009) [2023-12-27 22:17:14,413][106226] Updated weights for policy 0, policy_version 424548 (0.0009) [2023-12-27 22:17:14,595][106225] Updated weights for policy 1, policy_version 425778 (0.0008) [2023-12-27 22:17:14,660][106225] Updated weights for policy 1, policy_version 425788 (0.0006) [2023-12-27 22:17:14,728][106225] Updated weights for policy 1, policy_version 425798 (0.0006) [2023-12-27 22:17:14,799][106225] Updated weights for policy 1, policy_version 425808 (0.0008) [2023-12-27 22:17:15,114][106226] Updated weights for policy 0, policy_version 424558 (0.0009) [2023-12-27 22:17:15,179][106226] Updated weights for policy 0, policy_version 424568 (0.0007) [2023-12-27 22:17:15,242][106226] Updated weights for policy 0, policy_version 424578 (0.0007) [2023-12-27 22:17:15,544][106225] Updated weights for policy 1, policy_version 425818 (0.0008) [2023-12-27 22:17:15,589][106225] Updated weights for policy 1, policy_version 425828 (0.0008) [2023-12-27 22:17:15,638][106225] Updated weights for policy 1, policy_version 425838 (0.0008) [2023-12-27 22:17:15,898][106226] Updated weights for policy 0, policy_version 424588 (0.0008) [2023-12-27 22:17:15,962][106226] Updated weights for policy 0, policy_version 424598 (0.0011) [2023-12-27 22:17:16,017][106226] Updated weights for policy 0, policy_version 424608 (0.0010) [2023-12-27 22:17:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 217776128. Throughput: 0: 9761.5, 1: 9628.8. Samples: 217764948. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:16,176][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.636')] [2023-12-27 22:17:16,381][106225] Updated weights for policy 1, policy_version 425848 (0.0008) [2023-12-27 22:17:16,429][106225] Updated weights for policy 1, policy_version 425858 (0.0008) [2023-12-27 22:17:16,496][106225] Updated weights for policy 1, policy_version 425868 (0.0008) [2023-12-27 22:17:16,631][106226] Updated weights for policy 0, policy_version 424618 (0.0005) [2023-12-27 22:17:16,684][106226] Updated weights for policy 0, policy_version 424628 (0.0006) [2023-12-27 22:17:16,751][106226] Updated weights for policy 0, policy_version 424638 (0.0005) [2023-12-27 22:17:16,816][106226] Updated weights for policy 0, policy_version 424648 (0.0007) [2023-12-27 22:17:17,111][106225] Updated weights for policy 1, policy_version 425878 (0.0005) [2023-12-27 22:17:17,170][106225] Updated weights for policy 1, policy_version 425888 (0.0005) [2023-12-27 22:17:17,224][106225] Updated weights for policy 1, policy_version 425898 (0.0005) [2023-12-27 22:17:17,551][106226] Updated weights for policy 0, policy_version 424658 (0.0009) [2023-12-27 22:17:17,615][106226] Updated weights for policy 0, policy_version 424668 (0.0009) [2023-12-27 22:17:17,675][106226] Updated weights for policy 0, policy_version 424678 (0.0005) [2023-12-27 22:17:17,815][106225] Updated weights for policy 1, policy_version 425908 (0.0008) [2023-12-27 22:17:17,880][106225] Updated weights for policy 1, policy_version 425918 (0.0010) [2023-12-27 22:17:17,939][106225] Updated weights for policy 1, policy_version 425928 (0.0009) [2023-12-27 22:17:18,343][106226] Updated weights for policy 0, policy_version 424688 (0.0007) [2023-12-27 22:17:18,415][106226] Updated weights for policy 0, policy_version 424698 (0.0009) [2023-12-27 22:17:18,478][106226] Updated weights for policy 0, policy_version 424708 (0.0009) [2023-12-27 22:17:18,701][106225] Updated weights for policy 1, policy_version 425938 (0.0009) [2023-12-27 22:17:18,768][106225] Updated weights for policy 1, policy_version 425948 (0.0009) [2023-12-27 22:17:18,833][106225] Updated weights for policy 1, policy_version 425958 (0.0009) [2023-12-27 22:17:18,896][106225] Updated weights for policy 1, policy_version 425968 (0.0009) [2023-12-27 22:17:19,167][106226] Updated weights for policy 0, policy_version 424718 (0.0008) [2023-12-27 22:17:19,228][106226] Updated weights for policy 0, policy_version 424728 (0.0008) [2023-12-27 22:17:19,294][106226] Updated weights for policy 0, policy_version 424738 (0.0008) [2023-12-27 22:17:19,665][106225] Updated weights for policy 1, policy_version 425978 (0.0008) [2023-12-27 22:17:19,725][106225] Updated weights for policy 1, policy_version 425988 (0.0008) [2023-12-27 22:17:19,788][106225] Updated weights for policy 1, policy_version 425998 (0.0008) [2023-12-27 22:17:20,070][106226] Updated weights for policy 0, policy_version 424748 (0.0008) [2023-12-27 22:17:20,127][106226] Updated weights for policy 0, policy_version 424758 (0.0008) [2023-12-27 22:17:20,195][106226] Updated weights for policy 0, policy_version 424768 (0.0009) [2023-12-27 22:17:20,532][106225] Updated weights for policy 1, policy_version 426008 (0.0006) [2023-12-27 22:17:20,602][106225] Updated weights for policy 1, policy_version 426018 (0.0007) [2023-12-27 22:17:20,652][106225] Updated weights for policy 1, policy_version 426028 (0.0008) [2023-12-27 22:17:21,015][106226] Updated weights for policy 0, policy_version 424778 (0.0010) [2023-12-27 22:17:21,086][106226] Updated weights for policy 0, policy_version 424788 (0.0010) [2023-12-27 22:17:21,153][106226] Updated weights for policy 0, policy_version 424798 (0.0009) [2023-12-27 22:17:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 217866240. Throughput: 0: 9736.1, 1: 9653.3. Samples: 217881104. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:21,175][105115] Avg episode reward: [(0, '-4.940'), (1, '-5.215')] [2023-12-27 22:17:21,216][106226] Updated weights for policy 0, policy_version 424808 (0.0009) [2023-12-27 22:17:21,373][106225] Updated weights for policy 1, policy_version 426038 (0.0010) [2023-12-27 22:17:21,437][106225] Updated weights for policy 1, policy_version 426048 (0.0009) [2023-12-27 22:17:21,499][106225] Updated weights for policy 1, policy_version 426058 (0.0008) [2023-12-27 22:17:22,011][106226] Updated weights for policy 0, policy_version 424818 (0.0011) [2023-12-27 22:17:22,076][106226] Updated weights for policy 0, policy_version 424828 (0.0011) [2023-12-27 22:17:22,144][106226] Updated weights for policy 0, policy_version 424838 (0.0011) [2023-12-27 22:17:22,280][106225] Updated weights for policy 1, policy_version 426068 (0.0006) [2023-12-27 22:17:22,342][106225] Updated weights for policy 1, policy_version 426078 (0.0006) [2023-12-27 22:17:22,415][106225] Updated weights for policy 1, policy_version 426088 (0.0009) [2023-12-27 22:17:22,862][106226] Updated weights for policy 0, policy_version 424848 (0.0009) [2023-12-27 22:17:22,927][106226] Updated weights for policy 0, policy_version 424858 (0.0008) [2023-12-27 22:17:22,990][106226] Updated weights for policy 0, policy_version 424868 (0.0008) [2023-12-27 22:17:23,121][106225] Updated weights for policy 1, policy_version 426098 (0.0011) [2023-12-27 22:17:23,184][106225] Updated weights for policy 1, policy_version 426108 (0.0011) [2023-12-27 22:17:23,241][106225] Updated weights for policy 1, policy_version 426118 (0.0010) [2023-12-27 22:17:23,305][106225] Updated weights for policy 1, policy_version 426128 (0.0011) [2023-12-27 22:17:23,735][106226] Updated weights for policy 0, policy_version 424878 (0.0008) [2023-12-27 22:17:23,792][106226] Updated weights for policy 0, policy_version 424888 (0.0007) [2023-12-27 22:17:23,849][106226] Updated weights for policy 0, policy_version 424898 (0.0008) [2023-12-27 22:17:24,008][106225] Updated weights for policy 1, policy_version 426138 (0.0007) [2023-12-27 22:17:24,054][106225] Updated weights for policy 1, policy_version 426148 (0.0005) [2023-12-27 22:17:24,108][106225] Updated weights for policy 1, policy_version 426158 (0.0009) [2023-12-27 22:17:24,394][106226] Updated weights for policy 0, policy_version 424908 (0.0006) [2023-12-27 22:17:24,443][106226] Updated weights for policy 0, policy_version 424918 (0.0005) [2023-12-27 22:17:24,498][106226] Updated weights for policy 0, policy_version 424928 (0.0006) [2023-12-27 22:17:24,787][106225] Updated weights for policy 1, policy_version 426168 (0.0006) [2023-12-27 22:17:24,852][106225] Updated weights for policy 1, policy_version 426178 (0.0007) [2023-12-27 22:17:24,920][106225] Updated weights for policy 1, policy_version 426188 (0.0008) [2023-12-27 22:17:25,106][106226] Updated weights for policy 0, policy_version 424938 (0.0006) [2023-12-27 22:17:25,162][106226] Updated weights for policy 0, policy_version 424948 (0.0007) [2023-12-27 22:17:25,222][106226] Updated weights for policy 0, policy_version 424958 (0.0005) [2023-12-27 22:17:25,274][106226] Updated weights for policy 0, policy_version 424968 (0.0007) [2023-12-27 22:17:25,580][106225] Updated weights for policy 1, policy_version 426198 (0.0007) [2023-12-27 22:17:25,637][106225] Updated weights for policy 1, policy_version 426208 (0.0005) [2023-12-27 22:17:25,696][106225] Updated weights for policy 1, policy_version 426218 (0.0005) [2023-12-27 22:17:25,846][106226] Updated weights for policy 0, policy_version 424978 (0.0008) [2023-12-27 22:17:25,920][106226] Updated weights for policy 0, policy_version 424988 (0.0009) [2023-12-27 22:17:25,977][106226] Updated weights for policy 0, policy_version 424998 (0.0011) [2023-12-27 22:17:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 217972736. Throughput: 0: 9726.5, 1: 9606.6. Samples: 217937216. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:26,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.386')] [2023-12-27 22:17:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000426224_109142016.pth... [2023-12-27 22:17:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000425000_108830720.pth... [2023-12-27 22:17:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000423848_108535808.pth [2023-12-27 22:17:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000425104_108855296.pth [2023-12-27 22:17:26,356][106225] Updated weights for policy 1, policy_version 426228 (0.0007) [2023-12-27 22:17:26,406][106225] Updated weights for policy 1, policy_version 426238 (0.0007) [2023-12-27 22:17:26,458][106225] Updated weights for policy 1, policy_version 426248 (0.0009) [2023-12-27 22:17:26,562][106226] Updated weights for policy 0, policy_version 425008 (0.0007) [2023-12-27 22:17:26,624][106226] Updated weights for policy 0, policy_version 425018 (0.0011) [2023-12-27 22:17:26,690][106226] Updated weights for policy 0, policy_version 425028 (0.0010) [2023-12-27 22:17:27,123][106225] Updated weights for policy 1, policy_version 426258 (0.0009) [2023-12-27 22:17:27,177][106225] Updated weights for policy 1, policy_version 426268 (0.0005) [2023-12-27 22:17:27,225][106225] Updated weights for policy 1, policy_version 426278 (0.0005) [2023-12-27 22:17:27,278][106225] Updated weights for policy 1, policy_version 426288 (0.0005) [2023-12-27 22:17:27,305][106226] Updated weights for policy 0, policy_version 425038 (0.0011) [2023-12-27 22:17:27,369][106226] Updated weights for policy 0, policy_version 425048 (0.0010) [2023-12-27 22:17:27,423][106226] Updated weights for policy 0, policy_version 425058 (0.0008) [2023-12-27 22:17:27,996][106225] Updated weights for policy 1, policy_version 426298 (0.0008) [2023-12-27 22:17:28,053][106225] Updated weights for policy 1, policy_version 426308 (0.0006) [2023-12-27 22:17:28,108][106225] Updated weights for policy 1, policy_version 426318 (0.0006) [2023-12-27 22:17:28,110][106226] Updated weights for policy 0, policy_version 425068 (0.0006) [2023-12-27 22:17:28,171][106226] Updated weights for policy 0, policy_version 425078 (0.0009) [2023-12-27 22:17:28,229][106226] Updated weights for policy 0, policy_version 425088 (0.0008) [2023-12-27 22:17:28,751][106225] Updated weights for policy 1, policy_version 426328 (0.0008) [2023-12-27 22:17:28,811][106225] Updated weights for policy 1, policy_version 426338 (0.0009) [2023-12-27 22:17:28,861][106225] Updated weights for policy 1, policy_version 426348 (0.0008) [2023-12-27 22:17:29,016][106226] Updated weights for policy 0, policy_version 425098 (0.0009) [2023-12-27 22:17:29,075][106226] Updated weights for policy 0, policy_version 425108 (0.0010) [2023-12-27 22:17:29,138][106226] Updated weights for policy 0, policy_version 425118 (0.0010) [2023-12-27 22:17:29,187][106226] Updated weights for policy 0, policy_version 425128 (0.0010) [2023-12-27 22:17:29,651][106225] Updated weights for policy 1, policy_version 426358 (0.0006) [2023-12-27 22:17:29,710][106225] Updated weights for policy 1, policy_version 426368 (0.0005) [2023-12-27 22:17:29,773][106225] Updated weights for policy 1, policy_version 426378 (0.0005) [2023-12-27 22:17:29,902][106226] Updated weights for policy 0, policy_version 425138 (0.0011) [2023-12-27 22:17:29,971][106226] Updated weights for policy 0, policy_version 425148 (0.0009) [2023-12-27 22:17:30,025][106226] Updated weights for policy 0, policy_version 425158 (0.0009) [2023-12-27 22:17:30,484][106225] Updated weights for policy 1, policy_version 426388 (0.0006) [2023-12-27 22:17:30,539][106225] Updated weights for policy 1, policy_version 426398 (0.0007) [2023-12-27 22:17:30,600][106225] Updated weights for policy 1, policy_version 426408 (0.0009) [2023-12-27 22:17:30,751][106226] Updated weights for policy 0, policy_version 425168 (0.0006) [2023-12-27 22:17:30,804][106226] Updated weights for policy 0, policy_version 425178 (0.0005) [2023-12-27 22:17:30,857][106226] Updated weights for policy 0, policy_version 425188 (0.0005) [2023-12-27 22:17:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 218071040. Throughput: 0: 9887.3, 1: 9725.0. Samples: 218062008. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:31,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.555')] [2023-12-27 22:17:31,374][106225] Updated weights for policy 1, policy_version 426418 (0.0008) [2023-12-27 22:17:31,441][106225] Updated weights for policy 1, policy_version 426428 (0.0007) [2023-12-27 22:17:31,487][106226] Updated weights for policy 0, policy_version 425198 (0.0006) [2023-12-27 22:17:31,503][106225] Updated weights for policy 1, policy_version 426438 (0.0006) [2023-12-27 22:17:31,549][106226] Updated weights for policy 0, policy_version 425208 (0.0005) [2023-12-27 22:17:31,565][106225] Updated weights for policy 1, policy_version 426448 (0.0008) [2023-12-27 22:17:31,611][106226] Updated weights for policy 0, policy_version 425218 (0.0008) [2023-12-27 22:17:32,294][106225] Updated weights for policy 1, policy_version 426458 (0.0009) [2023-12-27 22:17:32,328][106226] Updated weights for policy 0, policy_version 425228 (0.0009) [2023-12-27 22:17:32,354][106225] Updated weights for policy 1, policy_version 426468 (0.0008) [2023-12-27 22:17:32,385][106226] Updated weights for policy 0, policy_version 425238 (0.0008) [2023-12-27 22:17:32,414][106225] Updated weights for policy 1, policy_version 426478 (0.0008) [2023-12-27 22:17:32,449][106226] Updated weights for policy 0, policy_version 425248 (0.0007) [2023-12-27 22:17:33,003][106225] Updated weights for policy 1, policy_version 426488 (0.0006) [2023-12-27 22:17:33,062][106225] Updated weights for policy 1, policy_version 426498 (0.0005) [2023-12-27 22:17:33,111][106225] Updated weights for policy 1, policy_version 426508 (0.0009) [2023-12-27 22:17:33,212][106226] Updated weights for policy 0, policy_version 425258 (0.0009) [2023-12-27 22:17:33,268][106226] Updated weights for policy 0, policy_version 425268 (0.0005) [2023-12-27 22:17:33,318][106226] Updated weights for policy 0, policy_version 425278 (0.0005) [2023-12-27 22:17:33,404][106226] Updated weights for policy 0, policy_version 425288 (0.0006) [2023-12-27 22:17:33,817][106225] Updated weights for policy 1, policy_version 426519 (0.0009) [2023-12-27 22:17:33,879][106225] Updated weights for policy 1, policy_version 426529 (0.0008) [2023-12-27 22:17:33,943][106225] Updated weights for policy 1, policy_version 426539 (0.0008) [2023-12-27 22:17:34,020][106226] Updated weights for policy 0, policy_version 425298 (0.0008) [2023-12-27 22:17:34,091][106226] Updated weights for policy 0, policy_version 425308 (0.0005) [2023-12-27 22:17:34,166][106226] Updated weights for policy 0, policy_version 425318 (0.0007) [2023-12-27 22:17:34,656][106225] Updated weights for policy 1, policy_version 426549 (0.0009) [2023-12-27 22:17:34,726][106225] Updated weights for policy 1, policy_version 426559 (0.0007) [2023-12-27 22:17:34,786][106225] Updated weights for policy 1, policy_version 426569 (0.0009) [2023-12-27 22:17:34,875][106226] Updated weights for policy 0, policy_version 425328 (0.0010) [2023-12-27 22:17:34,936][106226] Updated weights for policy 0, policy_version 425338 (0.0009) [2023-12-27 22:17:35,004][106226] Updated weights for policy 0, policy_version 425348 (0.0010) [2023-12-27 22:17:35,390][106225] Updated weights for policy 1, policy_version 426579 (0.0007) [2023-12-27 22:17:35,456][106225] Updated weights for policy 1, policy_version 426589 (0.0006) [2023-12-27 22:17:35,519][106225] Updated weights for policy 1, policy_version 426599 (0.0009) [2023-12-27 22:17:35,664][106226] Updated weights for policy 0, policy_version 425358 (0.0009) [2023-12-27 22:17:35,718][106226] Updated weights for policy 0, policy_version 425368 (0.0008) [2023-12-27 22:17:35,770][106226] Updated weights for policy 0, policy_version 425378 (0.0008) [2023-12-27 22:17:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 218169344. Throughput: 0: 9894.2, 1: 9799.7. Samples: 218181408. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:36,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-5.660')] [2023-12-27 22:17:36,260][106225] Updated weights for policy 1, policy_version 426609 (0.0008) [2023-12-27 22:17:36,324][106225] Updated weights for policy 1, policy_version 426619 (0.0008) [2023-12-27 22:17:36,389][106225] Updated weights for policy 1, policy_version 426629 (0.0008) [2023-12-27 22:17:36,453][106225] Updated weights for policy 1, policy_version 426639 (0.0009) [2023-12-27 22:17:36,467][106226] Updated weights for policy 0, policy_version 425388 (0.0007) [2023-12-27 22:17:36,533][106226] Updated weights for policy 0, policy_version 425398 (0.0008) [2023-12-27 22:17:36,605][106226] Updated weights for policy 0, policy_version 425408 (0.0006) [2023-12-27 22:17:37,188][106225] Updated weights for policy 1, policy_version 426649 (0.0005) [2023-12-27 22:17:37,235][106225] Updated weights for policy 1, policy_version 426659 (0.0005) [2023-12-27 22:17:37,294][106225] Updated weights for policy 1, policy_version 426669 (0.0005) [2023-12-27 22:17:37,297][106226] Updated weights for policy 0, policy_version 425418 (0.0008) [2023-12-27 22:17:37,351][106226] Updated weights for policy 0, policy_version 425428 (0.0007) [2023-12-27 22:17:37,415][106226] Updated weights for policy 0, policy_version 425438 (0.0010) [2023-12-27 22:17:37,471][106226] Updated weights for policy 0, policy_version 425448 (0.0010) [2023-12-27 22:17:37,954][106225] Updated weights for policy 1, policy_version 426679 (0.0008) [2023-12-27 22:17:38,003][106225] Updated weights for policy 1, policy_version 426689 (0.0008) [2023-12-27 22:17:38,048][106225] Updated weights for policy 1, policy_version 426699 (0.0008) [2023-12-27 22:17:38,250][106226] Updated weights for policy 0, policy_version 425458 (0.0009) [2023-12-27 22:17:38,303][106226] Updated weights for policy 0, policy_version 425468 (0.0008) [2023-12-27 22:17:38,368][106226] Updated weights for policy 0, policy_version 425478 (0.0008) [2023-12-27 22:17:38,796][106225] Updated weights for policy 1, policy_version 426709 (0.0008) [2023-12-27 22:17:38,849][106225] Updated weights for policy 1, policy_version 426719 (0.0008) [2023-12-27 22:17:38,911][106225] Updated weights for policy 1, policy_version 426729 (0.0008) [2023-12-27 22:17:39,131][106226] Updated weights for policy 0, policy_version 425488 (0.0009) [2023-12-27 22:17:39,191][106226] Updated weights for policy 0, policy_version 425498 (0.0008) [2023-12-27 22:17:39,260][106226] Updated weights for policy 0, policy_version 425508 (0.0009) [2023-12-27 22:17:39,669][106225] Updated weights for policy 1, policy_version 426739 (0.0008) [2023-12-27 22:17:39,729][106225] Updated weights for policy 1, policy_version 426749 (0.0008) [2023-12-27 22:17:39,778][106225] Updated weights for policy 1, policy_version 426759 (0.0009) [2023-12-27 22:17:40,050][106226] Updated weights for policy 0, policy_version 425518 (0.0009) [2023-12-27 22:17:40,110][106226] Updated weights for policy 0, policy_version 425528 (0.0008) [2023-12-27 22:17:40,179][106226] Updated weights for policy 0, policy_version 425538 (0.0009) [2023-12-27 22:17:40,468][106225] Updated weights for policy 1, policy_version 426769 (0.0008) [2023-12-27 22:17:40,526][106225] Updated weights for policy 1, policy_version 426779 (0.0007) [2023-12-27 22:17:40,584][106225] Updated weights for policy 1, policy_version 426789 (0.0007) [2023-12-27 22:17:40,649][106225] Updated weights for policy 1, policy_version 426799 (0.0008) [2023-12-27 22:17:40,889][106226] Updated weights for policy 0, policy_version 425548 (0.0008) [2023-12-27 22:17:40,958][106226] Updated weights for policy 0, policy_version 425558 (0.0009) [2023-12-27 22:17:41,026][106226] Updated weights for policy 0, policy_version 425568 (0.0008) [2023-12-27 22:17:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 218267648. Throughput: 0: 9844.5, 1: 9801.3. Samples: 218238500. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:41,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-5.669')] [2023-12-27 22:17:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000426800_109289472.pth... [2023-12-27 22:17:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000425576_108978176.pth... [2023-12-27 22:17:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000425680_109002752.pth [2023-12-27 22:17:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000424424_108683264.pth [2023-12-27 22:17:41,444][106225] Updated weights for policy 1, policy_version 426809 (0.0007) [2023-12-27 22:17:41,510][106225] Updated weights for policy 1, policy_version 426819 (0.0005) [2023-12-27 22:17:41,578][106225] Updated weights for policy 1, policy_version 426829 (0.0006) [2023-12-27 22:17:41,759][106226] Updated weights for policy 0, policy_version 425578 (0.0011) [2023-12-27 22:17:41,829][106226] Updated weights for policy 0, policy_version 425588 (0.0010) [2023-12-27 22:17:41,898][106226] Updated weights for policy 0, policy_version 425598 (0.0011) [2023-12-27 22:17:41,956][106226] Updated weights for policy 0, policy_version 425608 (0.0011) [2023-12-27 22:17:42,332][106225] Updated weights for policy 1, policy_version 426839 (0.0007) [2023-12-27 22:17:42,404][106225] Updated weights for policy 1, policy_version 426849 (0.0009) [2023-12-27 22:17:42,461][106225] Updated weights for policy 1, policy_version 426859 (0.0007) [2023-12-27 22:17:42,679][106226] Updated weights for policy 0, policy_version 425618 (0.0005) [2023-12-27 22:17:42,728][106226] Updated weights for policy 0, policy_version 425628 (0.0005) [2023-12-27 22:17:42,781][106226] Updated weights for policy 0, policy_version 425638 (0.0010) [2023-12-27 22:17:43,140][106225] Updated weights for policy 1, policy_version 426869 (0.0008) [2023-12-27 22:17:43,205][106225] Updated weights for policy 1, policy_version 426879 (0.0006) [2023-12-27 22:17:43,267][106225] Updated weights for policy 1, policy_version 426889 (0.0006) [2023-12-27 22:17:43,416][106226] Updated weights for policy 0, policy_version 425648 (0.0010) [2023-12-27 22:17:43,469][106226] Updated weights for policy 0, policy_version 425658 (0.0010) [2023-12-27 22:17:43,526][106226] Updated weights for policy 0, policy_version 425668 (0.0005) [2023-12-27 22:17:43,868][106225] Updated weights for policy 1, policy_version 426899 (0.0007) [2023-12-27 22:17:43,934][106225] Updated weights for policy 1, policy_version 426909 (0.0010) [2023-12-27 22:17:43,998][106225] Updated weights for policy 1, policy_version 426919 (0.0011) [2023-12-27 22:17:44,136][106226] Updated weights for policy 0, policy_version 425678 (0.0009) [2023-12-27 22:17:44,198][106226] Updated weights for policy 0, policy_version 425688 (0.0010) [2023-12-27 22:17:44,259][106226] Updated weights for policy 0, policy_version 425698 (0.0010) [2023-12-27 22:17:44,717][106225] Updated weights for policy 1, policy_version 426929 (0.0011) [2023-12-27 22:17:44,779][106225] Updated weights for policy 1, policy_version 426939 (0.0009) [2023-12-27 22:17:44,847][106225] Updated weights for policy 1, policy_version 426949 (0.0008) [2023-12-27 22:17:44,908][106225] Updated weights for policy 1, policy_version 426959 (0.0008) [2023-12-27 22:17:44,976][106226] Updated weights for policy 0, policy_version 425708 (0.0009) [2023-12-27 22:17:45,045][106226] Updated weights for policy 0, policy_version 425718 (0.0011) [2023-12-27 22:17:45,098][106226] Updated weights for policy 0, policy_version 425728 (0.0011) [2023-12-27 22:17:45,680][106225] Updated weights for policy 1, policy_version 426969 (0.0008) [2023-12-27 22:17:45,733][106225] Updated weights for policy 1, policy_version 426979 (0.0007) [2023-12-27 22:17:45,797][106225] Updated weights for policy 1, policy_version 426989 (0.0008) [2023-12-27 22:17:45,805][106226] Updated weights for policy 0, policy_version 425738 (0.0011) [2023-12-27 22:17:45,865][106226] Updated weights for policy 0, policy_version 425748 (0.0010) [2023-12-27 22:17:45,915][106226] Updated weights for policy 0, policy_version 425758 (0.0010) [2023-12-27 22:17:45,973][106226] Updated weights for policy 0, policy_version 425768 (0.0011) [2023-12-27 22:17:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 218365952. Throughput: 0: 9792.2, 1: 9810.7. Samples: 218354592. Policy #0 lag: (min: 2.0, avg: 14.9, max: 34.0) [2023-12-27 22:17:46,175][105115] Avg episode reward: [(0, '-4.952'), (1, '-5.549')] [2023-12-27 22:17:46,528][106225] Updated weights for policy 1, policy_version 426999 (0.0009) [2023-12-27 22:17:46,578][106225] Updated weights for policy 1, policy_version 427009 (0.0009) [2023-12-27 22:17:46,626][106225] Updated weights for policy 1, policy_version 427019 (0.0008) [2023-12-27 22:17:46,664][106226] Updated weights for policy 0, policy_version 425778 (0.0011) [2023-12-27 22:17:46,727][106226] Updated weights for policy 0, policy_version 425788 (0.0008) [2023-12-27 22:17:46,789][106226] Updated weights for policy 0, policy_version 425798 (0.0005) [2023-12-27 22:17:47,376][106225] Updated weights for policy 1, policy_version 427029 (0.0008) [2023-12-27 22:17:47,426][106226] Updated weights for policy 0, policy_version 425808 (0.0010) [2023-12-27 22:17:47,429][106225] Updated weights for policy 1, policy_version 427039 (0.0006) [2023-12-27 22:17:47,481][106225] Updated weights for policy 1, policy_version 427049 (0.0008) [2023-12-27 22:17:47,494][106226] Updated weights for policy 0, policy_version 425818 (0.0011) [2023-12-27 22:17:47,564][106226] Updated weights for policy 0, policy_version 425828 (0.0011) [2023-12-27 22:17:48,221][106225] Updated weights for policy 1, policy_version 427059 (0.0006) [2023-12-27 22:17:48,238][106226] Updated weights for policy 0, policy_version 425838 (0.0010) [2023-12-27 22:17:48,279][106225] Updated weights for policy 1, policy_version 427069 (0.0005) [2023-12-27 22:17:48,285][106226] Updated weights for policy 0, policy_version 425848 (0.0010) [2023-12-27 22:17:48,342][106225] Updated weights for policy 1, policy_version 427079 (0.0007) [2023-12-27 22:17:48,351][106226] Updated weights for policy 0, policy_version 425858 (0.0011) [2023-12-27 22:17:49,078][106226] Updated weights for policy 0, policy_version 425868 (0.0011) [2023-12-27 22:17:49,079][106225] Updated weights for policy 1, policy_version 427089 (0.0007) [2023-12-27 22:17:49,137][106225] Updated weights for policy 1, policy_version 427099 (0.0006) [2023-12-27 22:17:49,140][106226] Updated weights for policy 0, policy_version 425878 (0.0011) [2023-12-27 22:17:49,196][106225] Updated weights for policy 1, policy_version 427109 (0.0006) [2023-12-27 22:17:49,198][106226] Updated weights for policy 0, policy_version 425888 (0.0011) [2023-12-27 22:17:49,270][106225] Updated weights for policy 1, policy_version 427119 (0.0007) [2023-12-27 22:17:49,963][106226] Updated weights for policy 0, policy_version 425898 (0.0010) [2023-12-27 22:17:50,012][106225] Updated weights for policy 1, policy_version 427129 (0.0006) [2023-12-27 22:17:50,031][106226] Updated weights for policy 0, policy_version 425908 (0.0008) [2023-12-27 22:17:50,070][106225] Updated weights for policy 1, policy_version 427139 (0.0006) [2023-12-27 22:17:50,092][106226] Updated weights for policy 0, policy_version 425918 (0.0006) [2023-12-27 22:17:50,129][106225] Updated weights for policy 1, policy_version 427149 (0.0008) [2023-12-27 22:17:50,155][106226] Updated weights for policy 0, policy_version 425928 (0.0007) [2023-12-27 22:17:50,838][106225] Updated weights for policy 1, policy_version 427159 (0.0008) [2023-12-27 22:17:50,898][106225] Updated weights for policy 1, policy_version 427169 (0.0009) [2023-12-27 22:17:50,913][106226] Updated weights for policy 0, policy_version 425938 (0.0008) [2023-12-27 22:17:50,960][106225] Updated weights for policy 1, policy_version 427179 (0.0007) [2023-12-27 22:17:50,980][106226] Updated weights for policy 0, policy_version 425948 (0.0009) [2023-12-27 22:17:51,042][106226] Updated weights for policy 0, policy_version 425958 (0.0009) [2023-12-27 22:17:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 218464256. Throughput: 0: 9803.5, 1: 9701.7. Samples: 218468956. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:17:51,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-5.341')] [2023-12-27 22:17:51,736][106225] Updated weights for policy 1, policy_version 427189 (0.0008) [2023-12-27 22:17:51,797][106225] Updated weights for policy 1, policy_version 427199 (0.0006) [2023-12-27 22:17:51,826][106226] Updated weights for policy 0, policy_version 425968 (0.0008) [2023-12-27 22:17:51,859][106225] Updated weights for policy 1, policy_version 427209 (0.0005) [2023-12-27 22:17:51,885][106226] Updated weights for policy 0, policy_version 425978 (0.0010) [2023-12-27 22:17:51,947][106226] Updated weights for policy 0, policy_version 425988 (0.0011) [2023-12-27 22:17:52,512][106225] Updated weights for policy 1, policy_version 427219 (0.0005) [2023-12-27 22:17:52,574][106225] Updated weights for policy 1, policy_version 427229 (0.0006) [2023-12-27 22:17:52,630][106225] Updated weights for policy 1, policy_version 427239 (0.0006) [2023-12-27 22:17:52,684][106226] Updated weights for policy 0, policy_version 425998 (0.0011) [2023-12-27 22:17:52,738][106226] Updated weights for policy 0, policy_version 426008 (0.0007) [2023-12-27 22:17:52,797][106226] Updated weights for policy 0, policy_version 426018 (0.0009) [2023-12-27 22:17:53,329][106225] Updated weights for policy 1, policy_version 427249 (0.0006) [2023-12-27 22:17:53,389][106225] Updated weights for policy 1, policy_version 427259 (0.0009) [2023-12-27 22:17:53,407][106226] Updated weights for policy 0, policy_version 426028 (0.0010) [2023-12-27 22:17:53,445][106225] Updated weights for policy 1, policy_version 427269 (0.0008) [2023-12-27 22:17:53,461][106226] Updated weights for policy 0, policy_version 426038 (0.0011) [2023-12-27 22:17:53,501][106225] Updated weights for policy 1, policy_version 427279 (0.0006) [2023-12-27 22:17:53,511][106226] Updated weights for policy 0, policy_version 426048 (0.0008) [2023-12-27 22:17:54,084][106225] Updated weights for policy 1, policy_version 427289 (0.0005) [2023-12-27 22:17:54,136][106225] Updated weights for policy 1, policy_version 427299 (0.0006) [2023-12-27 22:17:54,154][106226] Updated weights for policy 0, policy_version 426058 (0.0008) [2023-12-27 22:17:54,195][106225] Updated weights for policy 1, policy_version 427309 (0.0007) [2023-12-27 22:17:54,211][106226] Updated weights for policy 0, policy_version 426068 (0.0011) [2023-12-27 22:17:54,271][106226] Updated weights for policy 0, policy_version 426078 (0.0010) [2023-12-27 22:17:54,337][106226] Updated weights for policy 0, policy_version 426088 (0.0011) [2023-12-27 22:17:54,896][106225] Updated weights for policy 1, policy_version 427319 (0.0008) [2023-12-27 22:17:54,947][106225] Updated weights for policy 1, policy_version 427329 (0.0007) [2023-12-27 22:17:54,986][106226] Updated weights for policy 0, policy_version 426098 (0.0008) [2023-12-27 22:17:55,007][106225] Updated weights for policy 1, policy_version 427339 (0.0007) [2023-12-27 22:17:55,049][106226] Updated weights for policy 0, policy_version 426108 (0.0006) [2023-12-27 22:17:55,116][106226] Updated weights for policy 0, policy_version 426118 (0.0006) [2023-12-27 22:17:55,741][106225] Updated weights for policy 1, policy_version 427349 (0.0008) [2023-12-27 22:17:55,783][106226] Updated weights for policy 0, policy_version 426128 (0.0006) [2023-12-27 22:17:55,799][106225] Updated weights for policy 1, policy_version 427359 (0.0008) [2023-12-27 22:17:55,831][106226] Updated weights for policy 0, policy_version 426138 (0.0008) [2023-12-27 22:17:55,859][106225] Updated weights for policy 1, policy_version 427369 (0.0007) [2023-12-27 22:17:55,888][106226] Updated weights for policy 0, policy_version 426148 (0.0007) [2023-12-27 22:17:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 218562560. Throughput: 0: 9804.9, 1: 9692.2. Samples: 218528384. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:17:56,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.353')] [2023-12-27 22:17:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000427376_109436928.pth... [2023-12-27 22:17:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000426152_109125632.pth... [2023-12-27 22:17:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000426224_109142016.pth [2023-12-27 22:17:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000425000_108830720.pth [2023-12-27 22:17:56,586][106225] Updated weights for policy 1, policy_version 427379 (0.0006) [2023-12-27 22:17:56,628][106226] Updated weights for policy 0, policy_version 426158 (0.0007) [2023-12-27 22:17:56,639][106225] Updated weights for policy 1, policy_version 427389 (0.0006) [2023-12-27 22:17:56,681][106226] Updated weights for policy 0, policy_version 426168 (0.0008) [2023-12-27 22:17:56,702][106225] Updated weights for policy 1, policy_version 427399 (0.0007) [2023-12-27 22:17:56,736][106226] Updated weights for policy 0, policy_version 426178 (0.0005) [2023-12-27 22:17:57,390][106225] Updated weights for policy 1, policy_version 427409 (0.0008) [2023-12-27 22:17:57,438][106225] Updated weights for policy 1, policy_version 427419 (0.0008) [2023-12-27 22:17:57,483][106226] Updated weights for policy 0, policy_version 426188 (0.0006) [2023-12-27 22:17:57,496][106225] Updated weights for policy 1, policy_version 427429 (0.0008) [2023-12-27 22:17:57,540][106226] Updated weights for policy 0, policy_version 426198 (0.0006) [2023-12-27 22:17:57,548][106225] Updated weights for policy 1, policy_version 427439 (0.0008) [2023-12-27 22:17:57,587][106226] Updated weights for policy 0, policy_version 426208 (0.0008) [2023-12-27 22:17:58,267][106225] Updated weights for policy 1, policy_version 427449 (0.0007) [2023-12-27 22:17:58,338][106226] Updated weights for policy 0, policy_version 426218 (0.0009) [2023-12-27 22:17:58,338][106225] Updated weights for policy 1, policy_version 427459 (0.0008) [2023-12-27 22:17:58,411][106225] Updated weights for policy 1, policy_version 427469 (0.0009) [2023-12-27 22:17:58,420][106226] Updated weights for policy 0, policy_version 426228 (0.0009) [2023-12-27 22:17:58,490][106226] Updated weights for policy 0, policy_version 426238 (0.0008) [2023-12-27 22:17:58,559][106226] Updated weights for policy 0, policy_version 426248 (0.0008) [2023-12-27 22:17:59,275][106225] Updated weights for policy 1, policy_version 427479 (0.0008) [2023-12-27 22:17:59,343][106225] Updated weights for policy 1, policy_version 427489 (0.0009) [2023-12-27 22:17:59,414][106225] Updated weights for policy 1, policy_version 427499 (0.0009) [2023-12-27 22:17:59,648][106226] Updated weights for policy 0, policy_version 426258 (0.0011) [2023-12-27 22:17:59,708][106226] Updated weights for policy 0, policy_version 426268 (0.0011) [2023-12-27 22:17:59,769][106226] Updated weights for policy 0, policy_version 426278 (0.0010) [2023-12-27 22:18:00,148][106225] Updated weights for policy 1, policy_version 427509 (0.0008) [2023-12-27 22:18:00,213][106225] Updated weights for policy 1, policy_version 427519 (0.0009) [2023-12-27 22:18:00,266][106225] Updated weights for policy 1, policy_version 427529 (0.0009) [2023-12-27 22:18:00,499][106226] Updated weights for policy 0, policy_version 426288 (0.0006) [2023-12-27 22:18:00,560][106226] Updated weights for policy 0, policy_version 426298 (0.0006) [2023-12-27 22:18:00,609][106226] Updated weights for policy 0, policy_version 426308 (0.0008) [2023-12-27 22:18:00,965][106225] Updated weights for policy 1, policy_version 427539 (0.0007) [2023-12-27 22:18:01,022][106225] Updated weights for policy 1, policy_version 427549 (0.0006) [2023-12-27 22:18:01,092][106225] Updated weights for policy 1, policy_version 427559 (0.0008) [2023-12-27 22:18:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19438.6). Total num frames: 218652672. Throughput: 0: 9742.3, 1: 9709.3. Samples: 218640272. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:01,175][105115] Avg episode reward: [(0, '-4.959'), (1, '-5.534')] [2023-12-27 22:18:01,244][106226] Updated weights for policy 0, policy_version 426318 (0.0010) [2023-12-27 22:18:01,300][106226] Updated weights for policy 0, policy_version 426328 (0.0008) [2023-12-27 22:18:01,361][106226] Updated weights for policy 0, policy_version 426338 (0.0008) [2023-12-27 22:18:01,783][106225] Updated weights for policy 1, policy_version 427569 (0.0008) [2023-12-27 22:18:01,845][106225] Updated weights for policy 1, policy_version 427579 (0.0010) [2023-12-27 22:18:01,896][106225] Updated weights for policy 1, policy_version 427589 (0.0009) [2023-12-27 22:18:01,953][106225] Updated weights for policy 1, policy_version 427599 (0.0009) [2023-12-27 22:18:02,099][106226] Updated weights for policy 0, policy_version 426348 (0.0007) [2023-12-27 22:18:02,160][106226] Updated weights for policy 0, policy_version 426358 (0.0007) [2023-12-27 22:18:02,220][106226] Updated weights for policy 0, policy_version 426368 (0.0008) [2023-12-27 22:18:02,762][106225] Updated weights for policy 1, policy_version 427609 (0.0006) [2023-12-27 22:18:02,825][106225] Updated weights for policy 1, policy_version 427619 (0.0005) [2023-12-27 22:18:02,870][106226] Updated weights for policy 0, policy_version 426378 (0.0008) [2023-12-27 22:18:02,885][106225] Updated weights for policy 1, policy_version 427629 (0.0007) [2023-12-27 22:18:02,927][106226] Updated weights for policy 0, policy_version 426388 (0.0008) [2023-12-27 22:18:02,978][106226] Updated weights for policy 0, policy_version 426398 (0.0009) [2023-12-27 22:18:03,033][106226] Updated weights for policy 0, policy_version 426408 (0.0009) [2023-12-27 22:18:03,400][106225] Updated weights for policy 1, policy_version 427639 (0.0007) [2023-12-27 22:18:03,451][106225] Updated weights for policy 1, policy_version 427649 (0.0005) [2023-12-27 22:18:03,499][106225] Updated weights for policy 1, policy_version 427659 (0.0005) [2023-12-27 22:18:03,742][106226] Updated weights for policy 0, policy_version 426418 (0.0008) [2023-12-27 22:18:03,790][106226] Updated weights for policy 0, policy_version 426428 (0.0008) [2023-12-27 22:18:03,838][106226] Updated weights for policy 0, policy_version 426438 (0.0008) [2023-12-27 22:18:04,189][106225] Updated weights for policy 1, policy_version 427669 (0.0008) [2023-12-27 22:18:04,253][106225] Updated weights for policy 1, policy_version 427679 (0.0010) [2023-12-27 22:18:04,315][106225] Updated weights for policy 1, policy_version 427689 (0.0010) [2023-12-27 22:18:04,634][106226] Updated weights for policy 0, policy_version 426448 (0.0008) [2023-12-27 22:18:04,688][106226] Updated weights for policy 0, policy_version 426458 (0.0009) [2023-12-27 22:18:04,743][106226] Updated weights for policy 0, policy_version 426468 (0.0009) [2023-12-27 22:18:04,924][106225] Updated weights for policy 1, policy_version 427699 (0.0009) [2023-12-27 22:18:04,988][106225] Updated weights for policy 1, policy_version 427709 (0.0009) [2023-12-27 22:18:05,052][106225] Updated weights for policy 1, policy_version 427719 (0.0010) [2023-12-27 22:18:05,428][106226] Updated weights for policy 0, policy_version 426478 (0.0009) [2023-12-27 22:18:05,483][106226] Updated weights for policy 0, policy_version 426488 (0.0008) [2023-12-27 22:18:05,535][106226] Updated weights for policy 0, policy_version 426498 (0.0008) [2023-12-27 22:18:05,736][106225] Updated weights for policy 1, policy_version 427729 (0.0010) [2023-12-27 22:18:05,783][106225] Updated weights for policy 1, policy_version 427739 (0.0010) [2023-12-27 22:18:05,834][106225] Updated weights for policy 1, policy_version 427749 (0.0010) [2023-12-27 22:18:05,901][106225] Updated weights for policy 1, policy_version 427759 (0.0009) [2023-12-27 22:18:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19387.8, 300 sec: 19438.6). Total num frames: 218750976. Throughput: 0: 9795.1, 1: 9772.2. Samples: 218761632. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:06,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.913')] [2023-12-27 22:18:06,197][106226] Updated weights for policy 0, policy_version 426508 (0.0008) [2023-12-27 22:18:06,282][106226] Updated weights for policy 0, policy_version 426518 (0.0010) [2023-12-27 22:18:06,347][106226] Updated weights for policy 0, policy_version 426528 (0.0009) [2023-12-27 22:18:06,551][106225] Updated weights for policy 1, policy_version 427769 (0.0010) [2023-12-27 22:18:06,607][106225] Updated weights for policy 1, policy_version 427779 (0.0010) [2023-12-27 22:18:06,658][106225] Updated weights for policy 1, policy_version 427789 (0.0010) [2023-12-27 22:18:07,143][106226] Updated weights for policy 0, policy_version 426538 (0.0010) [2023-12-27 22:18:07,206][106226] Updated weights for policy 0, policy_version 426548 (0.0008) [2023-12-27 22:18:07,270][106226] Updated weights for policy 0, policy_version 426558 (0.0007) [2023-12-27 22:18:07,280][106225] Updated weights for policy 1, policy_version 427799 (0.0011) [2023-12-27 22:18:07,333][106226] Updated weights for policy 0, policy_version 426568 (0.0007) [2023-12-27 22:18:07,338][106225] Updated weights for policy 1, policy_version 427809 (0.0010) [2023-12-27 22:18:07,400][106225] Updated weights for policy 1, policy_version 427819 (0.0010) [2023-12-27 22:18:08,019][106226] Updated weights for policy 0, policy_version 426578 (0.0006) [2023-12-27 22:18:08,075][106226] Updated weights for policy 0, policy_version 426588 (0.0008) [2023-12-27 22:18:08,082][106225] Updated weights for policy 1, policy_version 427829 (0.0009) [2023-12-27 22:18:08,134][106225] Updated weights for policy 1, policy_version 427839 (0.0005) [2023-12-27 22:18:08,144][106226] Updated weights for policy 0, policy_version 426598 (0.0009) [2023-12-27 22:18:08,185][106225] Updated weights for policy 1, policy_version 427849 (0.0006) [2023-12-27 22:18:08,861][106226] Updated weights for policy 0, policy_version 426608 (0.0008) [2023-12-27 22:18:08,885][106225] Updated weights for policy 1, policy_version 427859 (0.0010) [2023-12-27 22:18:08,921][106226] Updated weights for policy 0, policy_version 426618 (0.0007) [2023-12-27 22:18:08,936][106225] Updated weights for policy 1, policy_version 427869 (0.0010) [2023-12-27 22:18:08,975][106226] Updated weights for policy 0, policy_version 426628 (0.0009) [2023-12-27 22:18:08,994][106225] Updated weights for policy 1, policy_version 427879 (0.0007) [2023-12-27 22:18:09,702][106226] Updated weights for policy 0, policy_version 426638 (0.0008) [2023-12-27 22:18:09,703][106225] Updated weights for policy 1, policy_version 427889 (0.0006) [2023-12-27 22:18:09,766][106226] Updated weights for policy 0, policy_version 426648 (0.0006) [2023-12-27 22:18:09,767][106225] Updated weights for policy 1, policy_version 427899 (0.0008) [2023-12-27 22:18:09,826][106226] Updated weights for policy 0, policy_version 426658 (0.0006) [2023-12-27 22:18:09,838][106225] Updated weights for policy 1, policy_version 427909 (0.0008) [2023-12-27 22:18:09,908][106225] Updated weights for policy 1, policy_version 427919 (0.0008) [2023-12-27 22:18:10,598][106226] Updated weights for policy 0, policy_version 426668 (0.0008) [2023-12-27 22:18:10,632][106225] Updated weights for policy 1, policy_version 427929 (0.0006) [2023-12-27 22:18:10,657][106226] Updated weights for policy 0, policy_version 426678 (0.0008) [2023-12-27 22:18:10,676][106225] Updated weights for policy 1, policy_version 427939 (0.0006) [2023-12-27 22:18:10,715][106226] Updated weights for policy 0, policy_version 426688 (0.0007) [2023-12-27 22:18:10,722][106225] Updated weights for policy 1, policy_version 427949 (0.0006) [2023-12-27 22:18:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 218849280. Throughput: 0: 9793.0, 1: 9846.4. Samples: 218820996. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:11,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-6.032')] [2023-12-27 22:18:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000427952_109584384.pth... [2023-12-27 22:18:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000426696_109264896.pth... [2023-12-27 22:18:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000426800_109289472.pth [2023-12-27 22:18:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000425576_108978176.pth [2023-12-27 22:18:11,484][106225] Updated weights for policy 1, policy_version 427959 (0.0007) [2023-12-27 22:18:11,526][106226] Updated weights for policy 0, policy_version 426698 (0.0007) [2023-12-27 22:18:11,543][106225] Updated weights for policy 1, policy_version 427969 (0.0009) [2023-12-27 22:18:11,588][106226] Updated weights for policy 0, policy_version 426708 (0.0009) [2023-12-27 22:18:11,595][106225] Updated weights for policy 1, policy_version 427979 (0.0006) [2023-12-27 22:18:11,659][106226] Updated weights for policy 0, policy_version 426718 (0.0007) [2023-12-27 22:18:11,730][106226] Updated weights for policy 0, policy_version 426728 (0.0008) [2023-12-27 22:18:12,288][106225] Updated weights for policy 1, policy_version 427989 (0.0008) [2023-12-27 22:18:12,358][106225] Updated weights for policy 1, policy_version 427999 (0.0007) [2023-12-27 22:18:12,431][106225] Updated weights for policy 1, policy_version 428009 (0.0008) [2023-12-27 22:18:12,498][106226] Updated weights for policy 0, policy_version 426738 (0.0008) [2023-12-27 22:18:12,560][106226] Updated weights for policy 0, policy_version 426748 (0.0008) [2023-12-27 22:18:12,623][106226] Updated weights for policy 0, policy_version 426758 (0.0008) [2023-12-27 22:18:13,073][106225] Updated weights for policy 1, policy_version 428019 (0.0007) [2023-12-27 22:18:13,125][106225] Updated weights for policy 1, policy_version 428029 (0.0005) [2023-12-27 22:18:13,171][106225] Updated weights for policy 1, policy_version 428039 (0.0005) [2023-12-27 22:18:13,336][106226] Updated weights for policy 0, policy_version 426768 (0.0009) [2023-12-27 22:18:13,383][106226] Updated weights for policy 0, policy_version 426778 (0.0010) [2023-12-27 22:18:13,426][106226] Updated weights for policy 0, policy_version 426788 (0.0010) [2023-12-27 22:18:13,756][106225] Updated weights for policy 1, policy_version 428049 (0.0006) [2023-12-27 22:18:13,817][106225] Updated weights for policy 1, policy_version 428059 (0.0005) [2023-12-27 22:18:13,867][106225] Updated weights for policy 1, policy_version 428069 (0.0005) [2023-12-27 22:18:13,914][106225] Updated weights for policy 1, policy_version 428079 (0.0005) [2023-12-27 22:18:14,135][106226] Updated weights for policy 0, policy_version 426798 (0.0011) [2023-12-27 22:18:14,204][106226] Updated weights for policy 0, policy_version 426808 (0.0010) [2023-12-27 22:18:14,283][106226] Updated weights for policy 0, policy_version 426818 (0.0010) [2023-12-27 22:18:14,576][106225] Updated weights for policy 1, policy_version 428089 (0.0010) [2023-12-27 22:18:14,631][106225] Updated weights for policy 1, policy_version 428099 (0.0010) [2023-12-27 22:18:14,684][106225] Updated weights for policy 1, policy_version 428109 (0.0010) [2023-12-27 22:18:15,003][106226] Updated weights for policy 0, policy_version 426828 (0.0010) [2023-12-27 22:18:15,066][106226] Updated weights for policy 0, policy_version 426838 (0.0010) [2023-12-27 22:18:15,125][106226] Updated weights for policy 0, policy_version 426848 (0.0011) [2023-12-27 22:18:15,362][106225] Updated weights for policy 1, policy_version 428119 (0.0010) [2023-12-27 22:18:15,416][106225] Updated weights for policy 1, policy_version 428129 (0.0009) [2023-12-27 22:18:15,477][106225] Updated weights for policy 1, policy_version 428139 (0.0008) [2023-12-27 22:18:15,887][106226] Updated weights for policy 0, policy_version 426858 (0.0010) [2023-12-27 22:18:15,946][106226] Updated weights for policy 0, policy_version 426868 (0.0010) [2023-12-27 22:18:15,999][106226] Updated weights for policy 0, policy_version 426878 (0.0009) [2023-12-27 22:18:16,043][106225] Updated weights for policy 1, policy_version 428149 (0.0008) [2023-12-27 22:18:16,063][106226] Updated weights for policy 0, policy_version 426888 (0.0008) [2023-12-27 22:18:16,103][106225] Updated weights for policy 1, policy_version 428159 (0.0006) [2023-12-27 22:18:16,149][106225] Updated weights for policy 1, policy_version 428169 (0.0008) [2023-12-27 22:18:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 218947584. Throughput: 0: 9621.5, 1: 9832.5. Samples: 218937440. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:16,176][105115] Avg episode reward: [(0, '-4.976'), (1, '-5.316')] [2023-12-27 22:18:16,715][106226] Updated weights for policy 0, policy_version 426898 (0.0009) [2023-12-27 22:18:16,764][106226] Updated weights for policy 0, policy_version 426908 (0.0008) [2023-12-27 22:18:16,821][106226] Updated weights for policy 0, policy_version 426918 (0.0008) [2023-12-27 22:18:16,834][106225] Updated weights for policy 1, policy_version 428179 (0.0008) [2023-12-27 22:18:16,889][106225] Updated weights for policy 1, policy_version 428189 (0.0010) [2023-12-27 22:18:16,936][106225] Updated weights for policy 1, policy_version 428199 (0.0010) [2023-12-27 22:18:17,512][106225] Updated weights for policy 1, policy_version 428209 (0.0008) [2023-12-27 22:18:17,569][106225] Updated weights for policy 1, policy_version 428219 (0.0010) [2023-12-27 22:18:17,569][106226] Updated weights for policy 0, policy_version 426928 (0.0005) [2023-12-27 22:18:17,626][106225] Updated weights for policy 1, policy_version 428229 (0.0010) [2023-12-27 22:18:17,632][106226] Updated weights for policy 0, policy_version 426938 (0.0006) [2023-12-27 22:18:17,691][106225] Updated weights for policy 1, policy_version 428239 (0.0010) [2023-12-27 22:18:17,699][106226] Updated weights for policy 0, policy_version 426948 (0.0006) [2023-12-27 22:18:18,342][106225] Updated weights for policy 1, policy_version 428249 (0.0008) [2023-12-27 22:18:18,406][106225] Updated weights for policy 1, policy_version 428259 (0.0007) [2023-12-27 22:18:18,420][106226] Updated weights for policy 0, policy_version 426958 (0.0008) [2023-12-27 22:18:18,467][106225] Updated weights for policy 1, policy_version 428269 (0.0008) [2023-12-27 22:18:18,484][106226] Updated weights for policy 0, policy_version 426968 (0.0008) [2023-12-27 22:18:18,547][106226] Updated weights for policy 0, policy_version 426978 (0.0008) [2023-12-27 22:18:19,107][106225] Updated weights for policy 1, policy_version 428279 (0.0008) [2023-12-27 22:18:19,167][106225] Updated weights for policy 1, policy_version 428289 (0.0008) [2023-12-27 22:18:19,233][106225] Updated weights for policy 1, policy_version 428299 (0.0008) [2023-12-27 22:18:19,348][106226] Updated weights for policy 0, policy_version 426988 (0.0010) [2023-12-27 22:18:19,414][106226] Updated weights for policy 0, policy_version 426998 (0.0011) [2023-12-27 22:18:19,486][106226] Updated weights for policy 0, policy_version 427008 (0.0010) [2023-12-27 22:18:19,976][106225] Updated weights for policy 1, policy_version 428309 (0.0007) [2023-12-27 22:18:20,037][106225] Updated weights for policy 1, policy_version 428319 (0.0007) [2023-12-27 22:18:20,092][106225] Updated weights for policy 1, policy_version 428329 (0.0007) [2023-12-27 22:18:20,506][106226] Updated weights for policy 0, policy_version 427018 (0.0011) [2023-12-27 22:18:20,566][106226] Updated weights for policy 0, policy_version 427028 (0.0008) [2023-12-27 22:18:20,634][106226] Updated weights for policy 0, policy_version 427038 (0.0009) [2023-12-27 22:18:20,696][106226] Updated weights for policy 0, policy_version 427048 (0.0008) [2023-12-27 22:18:20,752][106225] Updated weights for policy 1, policy_version 428339 (0.0007) [2023-12-27 22:18:20,815][106225] Updated weights for policy 1, policy_version 428349 (0.0007) [2023-12-27 22:18:20,878][106225] Updated weights for policy 1, policy_version 428359 (0.0006) [2023-12-27 22:18:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 219045888. Throughput: 0: 9459.3, 1: 9940.7. Samples: 219054412. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:21,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.723')] [2023-12-27 22:18:21,532][106226] Updated weights for policy 0, policy_version 427058 (0.0008) [2023-12-27 22:18:21,595][106226] Updated weights for policy 0, policy_version 427068 (0.0008) [2023-12-27 22:18:21,605][106225] Updated weights for policy 1, policy_version 428369 (0.0009) [2023-12-27 22:18:21,666][106226] Updated weights for policy 0, policy_version 427078 (0.0008) [2023-12-27 22:18:21,672][106225] Updated weights for policy 1, policy_version 428379 (0.0007) [2023-12-27 22:18:21,745][106225] Updated weights for policy 1, policy_version 428389 (0.0009) [2023-12-27 22:18:21,808][106225] Updated weights for policy 1, policy_version 428399 (0.0008) [2023-12-27 22:18:22,467][106226] Updated weights for policy 0, policy_version 427088 (0.0010) [2023-12-27 22:18:22,532][106226] Updated weights for policy 0, policy_version 427098 (0.0009) [2023-12-27 22:18:22,581][106225] Updated weights for policy 1, policy_version 428409 (0.0008) [2023-12-27 22:18:22,595][106226] Updated weights for policy 0, policy_version 427108 (0.0006) [2023-12-27 22:18:22,643][106225] Updated weights for policy 1, policy_version 428419 (0.0008) [2023-12-27 22:18:22,708][106225] Updated weights for policy 1, policy_version 428429 (0.0008) [2023-12-27 22:18:23,315][106226] Updated weights for policy 0, policy_version 427118 (0.0010) [2023-12-27 22:18:23,371][106226] Updated weights for policy 0, policy_version 427128 (0.0010) [2023-12-27 22:18:23,404][106225] Updated weights for policy 1, policy_version 428439 (0.0006) [2023-12-27 22:18:23,445][106226] Updated weights for policy 0, policy_version 427138 (0.0005) [2023-12-27 22:18:23,462][106225] Updated weights for policy 1, policy_version 428449 (0.0008) [2023-12-27 22:18:23,512][106225] Updated weights for policy 1, policy_version 428459 (0.0006) [2023-12-27 22:18:24,043][106226] Updated weights for policy 0, policy_version 427148 (0.0009) [2023-12-27 22:18:24,107][106226] Updated weights for policy 0, policy_version 427158 (0.0010) [2023-12-27 22:18:24,161][106225] Updated weights for policy 1, policy_version 428469 (0.0006) [2023-12-27 22:18:24,164][106226] Updated weights for policy 0, policy_version 427168 (0.0010) [2023-12-27 22:18:24,213][106225] Updated weights for policy 1, policy_version 428479 (0.0005) [2023-12-27 22:18:24,275][106225] Updated weights for policy 1, policy_version 428489 (0.0009) [2023-12-27 22:18:24,862][106226] Updated weights for policy 0, policy_version 427178 (0.0010) [2023-12-27 22:18:24,912][106226] Updated weights for policy 0, policy_version 427188 (0.0007) [2023-12-27 22:18:24,963][106226] Updated weights for policy 0, policy_version 427198 (0.0010) [2023-12-27 22:18:24,976][106225] Updated weights for policy 1, policy_version 428499 (0.0007) [2023-12-27 22:18:25,020][106226] Updated weights for policy 0, policy_version 427208 (0.0010) [2023-12-27 22:18:25,034][106225] Updated weights for policy 1, policy_version 428509 (0.0007) [2023-12-27 22:18:25,093][106225] Updated weights for policy 1, policy_version 428519 (0.0008) [2023-12-27 22:18:25,597][106226] Updated weights for policy 0, policy_version 427218 (0.0010) [2023-12-27 22:18:25,663][106226] Updated weights for policy 0, policy_version 427228 (0.0010) [2023-12-27 22:18:25,722][106226] Updated weights for policy 0, policy_version 427238 (0.0005) [2023-12-27 22:18:25,910][106225] Updated weights for policy 1, policy_version 428529 (0.0009) [2023-12-27 22:18:25,962][106225] Updated weights for policy 1, policy_version 428539 (0.0007) [2023-12-27 22:18:26,019][106225] Updated weights for policy 1, policy_version 428549 (0.0008) [2023-12-27 22:18:26,084][106225] Updated weights for policy 1, policy_version 428559 (0.0009) [2023-12-27 22:18:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 219144192. Throughput: 0: 9463.9, 1: 9930.2. Samples: 219111236. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:26,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.719')] [2023-12-27 22:18:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000428560_109740032.pth... [2023-12-27 22:18:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000427240_109404160.pth... [2023-12-27 22:18:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000427376_109436928.pth [2023-12-27 22:18:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000426152_109125632.pth [2023-12-27 22:18:26,253][106226] Updated weights for policy 0, policy_version 427248 (0.0005) [2023-12-27 22:18:26,317][106226] Updated weights for policy 0, policy_version 427258 (0.0005) [2023-12-27 22:18:26,381][106226] Updated weights for policy 0, policy_version 427268 (0.0005) [2023-12-27 22:18:26,866][106225] Updated weights for policy 1, policy_version 428569 (0.0010) [2023-12-27 22:18:26,927][106225] Updated weights for policy 1, policy_version 428579 (0.0010) [2023-12-27 22:18:26,986][106225] Updated weights for policy 1, policy_version 428589 (0.0005) [2023-12-27 22:18:26,988][106226] Updated weights for policy 0, policy_version 427278 (0.0009) [2023-12-27 22:18:27,044][106226] Updated weights for policy 0, policy_version 427288 (0.0010) [2023-12-27 22:18:27,100][106226] Updated weights for policy 0, policy_version 427298 (0.0010) [2023-12-27 22:18:27,678][106225] Updated weights for policy 1, policy_version 428599 (0.0010) [2023-12-27 22:18:27,699][106226] Updated weights for policy 0, policy_version 427308 (0.0008) [2023-12-27 22:18:27,732][106225] Updated weights for policy 1, policy_version 428609 (0.0010) [2023-12-27 22:18:27,750][106226] Updated weights for policy 0, policy_version 427318 (0.0005) [2023-12-27 22:18:27,791][106225] Updated weights for policy 1, policy_version 428619 (0.0010) [2023-12-27 22:18:27,801][106226] Updated weights for policy 0, policy_version 427328 (0.0005) [2023-12-27 22:18:28,313][106226] Updated weights for policy 0, policy_version 427338 (0.0006) [2023-12-27 22:18:28,375][106226] Updated weights for policy 0, policy_version 427348 (0.0008) [2023-12-27 22:18:28,431][106226] Updated weights for policy 0, policy_version 427358 (0.0009) [2023-12-27 22:18:28,489][106226] Updated weights for policy 0, policy_version 427368 (0.0011) [2023-12-27 22:18:28,496][106225] Updated weights for policy 1, policy_version 428629 (0.0010) [2023-12-27 22:18:28,549][106225] Updated weights for policy 1, policy_version 428639 (0.0010) [2023-12-27 22:18:28,610][106225] Updated weights for policy 1, policy_version 428649 (0.0010) [2023-12-27 22:18:29,210][106226] Updated weights for policy 0, policy_version 427378 (0.0010) [2023-12-27 22:18:29,291][106226] Updated weights for policy 0, policy_version 427388 (0.0008) [2023-12-27 22:18:29,356][106226] Updated weights for policy 0, policy_version 427398 (0.0011) [2023-12-27 22:18:29,385][106225] Updated weights for policy 1, policy_version 428659 (0.0010) [2023-12-27 22:18:29,442][106225] Updated weights for policy 1, policy_version 428669 (0.0010) [2023-12-27 22:18:29,506][106225] Updated weights for policy 1, policy_version 428679 (0.0011) [2023-12-27 22:18:30,062][106226] Updated weights for policy 0, policy_version 427408 (0.0009) [2023-12-27 22:18:30,127][106226] Updated weights for policy 0, policy_version 427418 (0.0008) [2023-12-27 22:18:30,185][106226] Updated weights for policy 0, policy_version 427428 (0.0008) [2023-12-27 22:18:30,204][106225] Updated weights for policy 1, policy_version 428689 (0.0010) [2023-12-27 22:18:30,276][106225] Updated weights for policy 1, policy_version 428699 (0.0007) [2023-12-27 22:18:30,354][106225] Updated weights for policy 1, policy_version 428709 (0.0005) [2023-12-27 22:18:30,430][106225] Updated weights for policy 1, policy_version 428719 (0.0006) [2023-12-27 22:18:30,885][106226] Updated weights for policy 0, policy_version 427438 (0.0006) [2023-12-27 22:18:30,916][106225] Updated weights for policy 1, policy_version 428729 (0.0006) [2023-12-27 22:18:30,948][106226] Updated weights for policy 0, policy_version 427448 (0.0006) [2023-12-27 22:18:30,971][106225] Updated weights for policy 1, policy_version 428739 (0.0005) [2023-12-27 22:18:31,005][106226] Updated weights for policy 0, policy_version 427458 (0.0007) [2023-12-27 22:18:31,032][106225] Updated weights for policy 1, policy_version 428749 (0.0006) [2023-12-27 22:18:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.9, 300 sec: 19438.7). Total num frames: 219250688. Throughput: 0: 9629.0, 1: 9905.9. Samples: 219233660. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:31,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.415')] [2023-12-27 22:18:31,654][106226] Updated weights for policy 0, policy_version 427468 (0.0008) [2023-12-27 22:18:31,715][106226] Updated weights for policy 0, policy_version 427478 (0.0009) [2023-12-27 22:18:31,783][106226] Updated weights for policy 0, policy_version 427488 (0.0010) [2023-12-27 22:18:31,812][106225] Updated weights for policy 1, policy_version 428759 (0.0006) [2023-12-27 22:18:31,869][106225] Updated weights for policy 1, policy_version 428769 (0.0008) [2023-12-27 22:18:31,930][106225] Updated weights for policy 1, policy_version 428779 (0.0008) [2023-12-27 22:18:32,461][106226] Updated weights for policy 0, policy_version 427498 (0.0008) [2023-12-27 22:18:32,527][106226] Updated weights for policy 0, policy_version 427508 (0.0008) [2023-12-27 22:18:32,592][106226] Updated weights for policy 0, policy_version 427518 (0.0008) [2023-12-27 22:18:32,652][106226] Updated weights for policy 0, policy_version 427528 (0.0005) [2023-12-27 22:18:32,705][106225] Updated weights for policy 1, policy_version 428789 (0.0009) [2023-12-27 22:18:32,760][106225] Updated weights for policy 1, policy_version 428799 (0.0010) [2023-12-27 22:18:32,825][106225] Updated weights for policy 1, policy_version 428809 (0.0009) [2023-12-27 22:18:33,185][106226] Updated weights for policy 0, policy_version 427538 (0.0010) [2023-12-27 22:18:33,242][106226] Updated weights for policy 0, policy_version 427548 (0.0008) [2023-12-27 22:18:33,296][106226] Updated weights for policy 0, policy_version 427558 (0.0005) [2023-12-27 22:18:33,486][106225] Updated weights for policy 1, policy_version 428819 (0.0007) [2023-12-27 22:18:33,546][106225] Updated weights for policy 1, policy_version 428829 (0.0006) [2023-12-27 22:18:33,603][106225] Updated weights for policy 1, policy_version 428839 (0.0006) [2023-12-27 22:18:33,827][106226] Updated weights for policy 0, policy_version 427568 (0.0005) [2023-12-27 22:18:33,896][106226] Updated weights for policy 0, policy_version 427578 (0.0005) [2023-12-27 22:18:33,962][106226] Updated weights for policy 0, policy_version 427588 (0.0005) [2023-12-27 22:18:34,192][106225] Updated weights for policy 1, policy_version 428849 (0.0007) [2023-12-27 22:18:34,262][106225] Updated weights for policy 1, policy_version 428859 (0.0010) [2023-12-27 22:18:34,327][106225] Updated weights for policy 1, policy_version 428869 (0.0011) [2023-12-27 22:18:34,394][106225] Updated weights for policy 1, policy_version 428879 (0.0010) [2023-12-27 22:18:34,543][106226] Updated weights for policy 0, policy_version 427598 (0.0008) [2023-12-27 22:18:34,614][106226] Updated weights for policy 0, policy_version 427608 (0.0010) [2023-12-27 22:18:34,676][106226] Updated weights for policy 0, policy_version 427618 (0.0009) [2023-12-27 22:18:35,112][106225] Updated weights for policy 1, policy_version 428889 (0.0010) [2023-12-27 22:18:35,168][106225] Updated weights for policy 1, policy_version 428899 (0.0010) [2023-12-27 22:18:35,225][106225] Updated weights for policy 1, policy_version 428909 (0.0008) [2023-12-27 22:18:35,310][106226] Updated weights for policy 0, policy_version 427628 (0.0008) [2023-12-27 22:18:35,366][106226] Updated weights for policy 0, policy_version 427638 (0.0010) [2023-12-27 22:18:35,429][106226] Updated weights for policy 0, policy_version 427648 (0.0010) [2023-12-27 22:18:35,847][106225] Updated weights for policy 1, policy_version 428919 (0.0006) [2023-12-27 22:18:35,894][106225] Updated weights for policy 1, policy_version 428929 (0.0005) [2023-12-27 22:18:35,951][106225] Updated weights for policy 1, policy_version 428939 (0.0006) [2023-12-27 22:18:36,124][106226] Updated weights for policy 0, policy_version 427658 (0.0011) [2023-12-27 22:18:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 219348992. Throughput: 0: 9775.4, 1: 10015.6. Samples: 219359548. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:36,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.350')] [2023-12-27 22:18:36,188][106226] Updated weights for policy 0, policy_version 427668 (0.0011) [2023-12-27 22:18:36,243][106226] Updated weights for policy 0, policy_version 427678 (0.0010) [2023-12-27 22:18:36,303][106226] Updated weights for policy 0, policy_version 427688 (0.0011) [2023-12-27 22:18:36,657][106225] Updated weights for policy 1, policy_version 428949 (0.0009) [2023-12-27 22:18:36,720][106225] Updated weights for policy 1, policy_version 428959 (0.0011) [2023-12-27 22:18:36,781][106225] Updated weights for policy 1, policy_version 428969 (0.0011) [2023-12-27 22:18:37,088][106226] Updated weights for policy 0, policy_version 427698 (0.0010) [2023-12-27 22:18:37,138][106226] Updated weights for policy 0, policy_version 427708 (0.0010) [2023-12-27 22:18:37,197][106226] Updated weights for policy 0, policy_version 427718 (0.0007) [2023-12-27 22:18:37,461][106225] Updated weights for policy 1, policy_version 428979 (0.0011) [2023-12-27 22:18:37,525][106225] Updated weights for policy 1, policy_version 428989 (0.0011) [2023-12-27 22:18:37,586][106225] Updated weights for policy 1, policy_version 428999 (0.0010) [2023-12-27 22:18:37,911][106226] Updated weights for policy 0, policy_version 427728 (0.0010) [2023-12-27 22:18:37,972][106226] Updated weights for policy 0, policy_version 427738 (0.0011) [2023-12-27 22:18:38,030][106226] Updated weights for policy 0, policy_version 427748 (0.0011) [2023-12-27 22:18:38,301][106225] Updated weights for policy 1, policy_version 429009 (0.0011) [2023-12-27 22:18:38,382][106225] Updated weights for policy 1, policy_version 429019 (0.0010) [2023-12-27 22:18:38,440][106225] Updated weights for policy 1, policy_version 429029 (0.0010) [2023-12-27 22:18:38,505][106225] Updated weights for policy 1, policy_version 429039 (0.0011) [2023-12-27 22:18:38,771][106226] Updated weights for policy 0, policy_version 427758 (0.0011) [2023-12-27 22:18:38,843][106226] Updated weights for policy 0, policy_version 427768 (0.0010) [2023-12-27 22:18:38,916][106226] Updated weights for policy 0, policy_version 427778 (0.0011) [2023-12-27 22:18:39,140][106225] Updated weights for policy 1, policy_version 429049 (0.0006) [2023-12-27 22:18:39,198][106225] Updated weights for policy 1, policy_version 429059 (0.0006) [2023-12-27 22:18:39,264][106225] Updated weights for policy 1, policy_version 429069 (0.0008) [2023-12-27 22:18:39,653][106226] Updated weights for policy 0, policy_version 427788 (0.0011) [2023-12-27 22:18:39,714][106226] Updated weights for policy 0, policy_version 427798 (0.0006) [2023-12-27 22:18:39,788][106226] Updated weights for policy 0, policy_version 427808 (0.0009) [2023-12-27 22:18:40,012][106225] Updated weights for policy 1, policy_version 429079 (0.0008) [2023-12-27 22:18:40,079][106225] Updated weights for policy 1, policy_version 429089 (0.0009) [2023-12-27 22:18:40,145][106225] Updated weights for policy 1, policy_version 429099 (0.0009) [2023-12-27 22:18:40,449][106226] Updated weights for policy 0, policy_version 427818 (0.0009) [2023-12-27 22:18:40,506][106226] Updated weights for policy 0, policy_version 427828 (0.0010) [2023-12-27 22:18:40,593][106226] Updated weights for policy 0, policy_version 427838 (0.0011) [2023-12-27 22:18:40,642][106226] Updated weights for policy 0, policy_version 427848 (0.0009) [2023-12-27 22:18:40,950][106225] Updated weights for policy 1, policy_version 429109 (0.0008) [2023-12-27 22:18:41,002][106225] Updated weights for policy 1, policy_version 429119 (0.0008) [2023-12-27 22:18:41,073][106225] Updated weights for policy 1, policy_version 429129 (0.0009) [2023-12-27 22:18:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19466.4). Total num frames: 219447296. Throughput: 0: 9740.9, 1: 10011.9. Samples: 219417260. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:41,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.598')] [2023-12-27 22:18:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000429136_109887488.pth... [2023-12-27 22:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000427848_109559808.pth... [2023-12-27 22:18:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000427952_109584384.pth [2023-12-27 22:18:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000426696_109264896.pth [2023-12-27 22:18:41,335][106226] Updated weights for policy 0, policy_version 427858 (0.0009) [2023-12-27 22:18:41,409][106226] Updated weights for policy 0, policy_version 427868 (0.0008) [2023-12-27 22:18:41,479][106226] Updated weights for policy 0, policy_version 427878 (0.0009) [2023-12-27 22:18:41,857][106225] Updated weights for policy 1, policy_version 429139 (0.0008) [2023-12-27 22:18:41,910][106225] Updated weights for policy 1, policy_version 429149 (0.0008) [2023-12-27 22:18:41,971][106225] Updated weights for policy 1, policy_version 429159 (0.0006) [2023-12-27 22:18:42,244][106226] Updated weights for policy 0, policy_version 427888 (0.0009) [2023-12-27 22:18:42,307][106226] Updated weights for policy 0, policy_version 427898 (0.0008) [2023-12-27 22:18:42,371][106226] Updated weights for policy 0, policy_version 427908 (0.0008) [2023-12-27 22:18:42,678][106225] Updated weights for policy 1, policy_version 429169 (0.0007) [2023-12-27 22:18:42,739][106225] Updated weights for policy 1, policy_version 429179 (0.0009) [2023-12-27 22:18:42,802][106225] Updated weights for policy 1, policy_version 429189 (0.0007) [2023-12-27 22:18:42,855][106225] Updated weights for policy 1, policy_version 429199 (0.0005) [2023-12-27 22:18:43,020][106226] Updated weights for policy 0, policy_version 427918 (0.0007) [2023-12-27 22:18:43,084][106226] Updated weights for policy 0, policy_version 427928 (0.0009) [2023-12-27 22:18:43,142][106226] Updated weights for policy 0, policy_version 427938 (0.0010) [2023-12-27 22:18:43,511][106225] Updated weights for policy 1, policy_version 429209 (0.0005) [2023-12-27 22:18:43,567][106225] Updated weights for policy 1, policy_version 429219 (0.0005) [2023-12-27 22:18:43,636][106225] Updated weights for policy 1, policy_version 429229 (0.0005) [2023-12-27 22:18:43,813][106226] Updated weights for policy 0, policy_version 427948 (0.0009) [2023-12-27 22:18:43,867][106226] Updated weights for policy 0, policy_version 427958 (0.0008) [2023-12-27 22:18:43,927][106226] Updated weights for policy 0, policy_version 427968 (0.0006) [2023-12-27 22:18:44,318][106225] Updated weights for policy 1, policy_version 429239 (0.0010) [2023-12-27 22:18:44,382][106225] Updated weights for policy 1, policy_version 429249 (0.0009) [2023-12-27 22:18:44,444][106225] Updated weights for policy 1, policy_version 429259 (0.0010) [2023-12-27 22:18:44,618][106226] Updated weights for policy 0, policy_version 427978 (0.0006) [2023-12-27 22:18:44,679][106226] Updated weights for policy 0, policy_version 427988 (0.0007) [2023-12-27 22:18:44,737][106226] Updated weights for policy 0, policy_version 427998 (0.0008) [2023-12-27 22:18:44,808][106226] Updated weights for policy 0, policy_version 428008 (0.0008) [2023-12-27 22:18:45,208][106225] Updated weights for policy 1, policy_version 429269 (0.0010) [2023-12-27 22:18:45,270][106225] Updated weights for policy 1, policy_version 429279 (0.0010) [2023-12-27 22:18:45,329][106225] Updated weights for policy 1, policy_version 429289 (0.0010) [2023-12-27 22:18:45,560][106226] Updated weights for policy 0, policy_version 428018 (0.0008) [2023-12-27 22:18:45,611][106226] Updated weights for policy 0, policy_version 428028 (0.0008) [2023-12-27 22:18:45,659][106226] Updated weights for policy 0, policy_version 428038 (0.0008) [2023-12-27 22:18:46,048][106225] Updated weights for policy 1, policy_version 429299 (0.0010) [2023-12-27 22:18:46,112][106225] Updated weights for policy 1, policy_version 429309 (0.0010) [2023-12-27 22:18:46,169][106225] Updated weights for policy 1, policy_version 429319 (0.0010) [2023-12-27 22:18:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19438.7). Total num frames: 219537408. Throughput: 0: 9812.5, 1: 10018.0. Samples: 219532640. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:46,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.527')] [2023-12-27 22:18:46,407][106226] Updated weights for policy 0, policy_version 428048 (0.0007) [2023-12-27 22:18:46,460][106226] Updated weights for policy 0, policy_version 428058 (0.0008) [2023-12-27 22:18:46,505][106226] Updated weights for policy 0, policy_version 428068 (0.0007) [2023-12-27 22:18:46,879][106225] Updated weights for policy 1, policy_version 429329 (0.0010) [2023-12-27 22:18:46,946][106225] Updated weights for policy 1, policy_version 429339 (0.0010) [2023-12-27 22:18:47,007][106225] Updated weights for policy 1, policy_version 429349 (0.0010) [2023-12-27 22:18:47,053][106225] Updated weights for policy 1, policy_version 429359 (0.0010) [2023-12-27 22:18:47,234][106226] Updated weights for policy 0, policy_version 428078 (0.0010) [2023-12-27 22:18:47,290][106226] Updated weights for policy 0, policy_version 428088 (0.0010) [2023-12-27 22:18:47,344][106226] Updated weights for policy 0, policy_version 428098 (0.0010) [2023-12-27 22:18:47,759][106225] Updated weights for policy 1, policy_version 429369 (0.0007) [2023-12-27 22:18:47,817][106225] Updated weights for policy 1, policy_version 429379 (0.0005) [2023-12-27 22:18:47,878][106225] Updated weights for policy 1, policy_version 429389 (0.0006) [2023-12-27 22:18:48,017][106226] Updated weights for policy 0, policy_version 428108 (0.0010) [2023-12-27 22:18:48,079][106226] Updated weights for policy 0, policy_version 428118 (0.0008) [2023-12-27 22:18:48,136][106226] Updated weights for policy 0, policy_version 428128 (0.0006) [2023-12-27 22:18:48,514][106225] Updated weights for policy 1, policy_version 429399 (0.0007) [2023-12-27 22:18:48,567][106225] Updated weights for policy 1, policy_version 429409 (0.0008) [2023-12-27 22:18:48,628][106225] Updated weights for policy 1, policy_version 429419 (0.0010) [2023-12-27 22:18:48,824][106226] Updated weights for policy 0, policy_version 428138 (0.0009) [2023-12-27 22:18:48,888][106226] Updated weights for policy 0, policy_version 428148 (0.0009) [2023-12-27 22:18:48,944][106226] Updated weights for policy 0, policy_version 428158 (0.0008) [2023-12-27 22:18:49,007][106226] Updated weights for policy 0, policy_version 428168 (0.0009) [2023-12-27 22:18:49,415][106225] Updated weights for policy 1, policy_version 429429 (0.0008) [2023-12-27 22:18:49,465][106225] Updated weights for policy 1, policy_version 429439 (0.0009) [2023-12-27 22:18:49,515][106225] Updated weights for policy 1, policy_version 429449 (0.0008) [2023-12-27 22:18:49,698][106226] Updated weights for policy 0, policy_version 428178 (0.0008) [2023-12-27 22:18:49,754][106226] Updated weights for policy 0, policy_version 428188 (0.0009) [2023-12-27 22:18:49,811][106226] Updated weights for policy 0, policy_version 428198 (0.0008) [2023-12-27 22:18:50,338][106225] Updated weights for policy 1, policy_version 429459 (0.0009) [2023-12-27 22:18:50,398][106225] Updated weights for policy 1, policy_version 429469 (0.0010) [2023-12-27 22:18:50,459][106225] Updated weights for policy 1, policy_version 429479 (0.0010) [2023-12-27 22:18:50,620][106226] Updated weights for policy 0, policy_version 428208 (0.0008) [2023-12-27 22:18:50,685][106226] Updated weights for policy 0, policy_version 428218 (0.0008) [2023-12-27 22:18:50,746][106226] Updated weights for policy 0, policy_version 428228 (0.0008) [2023-12-27 22:18:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 219635712. Throughput: 0: 9761.5, 1: 9939.0. Samples: 219648156. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:51,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-5.360')] [2023-12-27 22:18:51,207][106225] Updated weights for policy 1, policy_version 429489 (0.0010) [2023-12-27 22:18:51,275][106225] Updated weights for policy 1, policy_version 429499 (0.0011) [2023-12-27 22:18:51,331][106225] Updated weights for policy 1, policy_version 429509 (0.0011) [2023-12-27 22:18:51,407][106225] Updated weights for policy 1, policy_version 429519 (0.0011) [2023-12-27 22:18:51,447][106226] Updated weights for policy 0, policy_version 428238 (0.0007) [2023-12-27 22:18:51,509][106226] Updated weights for policy 0, policy_version 428248 (0.0008) [2023-12-27 22:18:51,571][106226] Updated weights for policy 0, policy_version 428258 (0.0007) [2023-12-27 22:18:52,163][106225] Updated weights for policy 1, policy_version 429529 (0.0010) [2023-12-27 22:18:52,229][106225] Updated weights for policy 1, policy_version 429539 (0.0011) [2023-12-27 22:18:52,268][106226] Updated weights for policy 0, policy_version 428268 (0.0009) [2023-12-27 22:18:52,295][106225] Updated weights for policy 1, policy_version 429549 (0.0011) [2023-12-27 22:18:52,333][106226] Updated weights for policy 0, policy_version 428278 (0.0007) [2023-12-27 22:18:52,405][106226] Updated weights for policy 0, policy_version 428288 (0.0007) [2023-12-27 22:18:53,011][106225] Updated weights for policy 1, policy_version 429559 (0.0010) [2023-12-27 22:18:53,058][106225] Updated weights for policy 1, policy_version 429569 (0.0010) [2023-12-27 22:18:53,114][106225] Updated weights for policy 1, policy_version 429579 (0.0008) [2023-12-27 22:18:53,117][106226] Updated weights for policy 0, policy_version 428298 (0.0007) [2023-12-27 22:18:53,165][106226] Updated weights for policy 0, policy_version 428308 (0.0007) [2023-12-27 22:18:53,218][106226] Updated weights for policy 0, policy_version 428318 (0.0007) [2023-12-27 22:18:53,277][106226] Updated weights for policy 0, policy_version 428328 (0.0008) [2023-12-27 22:18:53,825][106225] Updated weights for policy 1, policy_version 429589 (0.0008) [2023-12-27 22:18:53,889][106225] Updated weights for policy 1, policy_version 429599 (0.0006) [2023-12-27 22:18:53,944][106225] Updated weights for policy 1, policy_version 429609 (0.0006) [2023-12-27 22:18:54,032][106226] Updated weights for policy 0, policy_version 428338 (0.0005) [2023-12-27 22:18:54,090][106226] Updated weights for policy 0, policy_version 428348 (0.0005) [2023-12-27 22:18:54,144][106226] Updated weights for policy 0, policy_version 428358 (0.0006) [2023-12-27 22:18:54,668][106225] Updated weights for policy 1, policy_version 429619 (0.0008) [2023-12-27 22:18:54,733][106225] Updated weights for policy 1, policy_version 429629 (0.0011) [2023-12-27 22:18:54,738][106226] Updated weights for policy 0, policy_version 428368 (0.0006) [2023-12-27 22:18:54,784][106225] Updated weights for policy 1, policy_version 429639 (0.0010) [2023-12-27 22:18:54,794][106226] Updated weights for policy 0, policy_version 428378 (0.0005) [2023-12-27 22:18:54,847][106226] Updated weights for policy 0, policy_version 428388 (0.0007) [2023-12-27 22:18:55,429][106226] Updated weights for policy 0, policy_version 428398 (0.0005) [2023-12-27 22:18:55,473][106225] Updated weights for policy 1, policy_version 429649 (0.0009) [2023-12-27 22:18:55,497][106226] Updated weights for policy 0, policy_version 428408 (0.0006) [2023-12-27 22:18:55,529][106225] Updated weights for policy 1, policy_version 429659 (0.0007) [2023-12-27 22:18:55,553][106226] Updated weights for policy 0, policy_version 428418 (0.0008) [2023-12-27 22:18:55,583][106225] Updated weights for policy 1, policy_version 429669 (0.0006) [2023-12-27 22:18:55,640][106225] Updated weights for policy 1, policy_version 429679 (0.0008) [2023-12-27 22:18:56,112][106226] Updated weights for policy 0, policy_version 428428 (0.0008) [2023-12-27 22:18:56,167][106226] Updated weights for policy 0, policy_version 428438 (0.0007) [2023-12-27 22:18:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 219734016. Throughput: 0: 9795.9, 1: 9857.0. Samples: 219705372. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:18:56,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.553')] [2023-12-27 22:18:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000429680_110026752.pth... [2023-12-27 22:18:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000428560_109740032.pth [2023-12-27 22:18:56,226][106226] Updated weights for policy 0, policy_version 428448 (0.0010) [2023-12-27 22:18:56,260][106225] Updated weights for policy 1, policy_version 429689 (0.0008) [2023-12-27 22:18:56,267][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000428456_109715456.pth... [2023-12-27 22:18:56,270][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000427240_109404160.pth [2023-12-27 22:18:56,309][106225] Updated weights for policy 1, policy_version 429699 (0.0006) [2023-12-27 22:18:56,362][106225] Updated weights for policy 1, policy_version 429709 (0.0005) [2023-12-27 22:18:56,904][106226] Updated weights for policy 0, policy_version 428458 (0.0006) [2023-12-27 22:18:56,967][106226] Updated weights for policy 0, policy_version 428468 (0.0006) [2023-12-27 22:18:56,977][106225] Updated weights for policy 1, policy_version 429719 (0.0007) [2023-12-27 22:18:57,021][106226] Updated weights for policy 0, policy_version 428478 (0.0006) [2023-12-27 22:18:57,029][106225] Updated weights for policy 1, policy_version 429729 (0.0008) [2023-12-27 22:18:57,065][106226] Updated weights for policy 0, policy_version 428488 (0.0005) [2023-12-27 22:18:57,077][106225] Updated weights for policy 1, policy_version 429739 (0.0007) [2023-12-27 22:18:57,715][106225] Updated weights for policy 1, policy_version 429749 (0.0009) [2023-12-27 22:18:57,755][106226] Updated weights for policy 0, policy_version 428498 (0.0005) [2023-12-27 22:18:57,760][106225] Updated weights for policy 1, policy_version 429759 (0.0008) [2023-12-27 22:18:57,808][106226] Updated weights for policy 0, policy_version 428508 (0.0005) [2023-12-27 22:18:57,813][106225] Updated weights for policy 1, policy_version 429769 (0.0007) [2023-12-27 22:18:57,871][106226] Updated weights for policy 0, policy_version 428518 (0.0005) [2023-12-27 22:18:58,525][106225] Updated weights for policy 1, policy_version 429779 (0.0006) [2023-12-27 22:18:58,542][106226] Updated weights for policy 0, policy_version 428528 (0.0007) [2023-12-27 22:18:58,600][106225] Updated weights for policy 1, policy_version 429790 (0.0009) [2023-12-27 22:18:58,612][106226] Updated weights for policy 0, policy_version 428538 (0.0008) [2023-12-27 22:18:58,663][106225] Updated weights for policy 1, policy_version 429800 (0.0008) [2023-12-27 22:18:58,676][106226] Updated weights for policy 0, policy_version 428548 (0.0008) [2023-12-27 22:18:59,536][106225] Updated weights for policy 1, policy_version 429810 (0.0008) [2023-12-27 22:18:59,554][106226] Updated weights for policy 0, policy_version 428558 (0.0006) [2023-12-27 22:18:59,606][106225] Updated weights for policy 1, policy_version 429820 (0.0008) [2023-12-27 22:18:59,621][106226] Updated weights for policy 0, policy_version 428568 (0.0006) [2023-12-27 22:18:59,671][106225] Updated weights for policy 1, policy_version 429830 (0.0007) [2023-12-27 22:18:59,685][106226] Updated weights for policy 0, policy_version 428578 (0.0008) [2023-12-27 22:18:59,731][106225] Updated weights for policy 1, policy_version 429840 (0.0008) [2023-12-27 22:19:00,425][106226] Updated weights for policy 0, policy_version 428588 (0.0008) [2023-12-27 22:19:00,444][106225] Updated weights for policy 1, policy_version 429850 (0.0009) [2023-12-27 22:19:00,489][106226] Updated weights for policy 0, policy_version 428598 (0.0011) [2023-12-27 22:19:00,502][106225] Updated weights for policy 1, policy_version 429860 (0.0007) [2023-12-27 22:19:00,550][106226] Updated weights for policy 0, policy_version 428608 (0.0011) [2023-12-27 22:19:00,559][106225] Updated weights for policy 1, policy_version 429870 (0.0007) [2023-12-27 22:19:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19466.4). Total num frames: 219832320. Throughput: 0: 9919.0, 1: 9838.4. Samples: 219826516. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:19:01,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.512')] [2023-12-27 22:19:01,274][106226] Updated weights for policy 0, policy_version 428618 (0.0011) [2023-12-27 22:19:01,301][106225] Updated weights for policy 1, policy_version 429880 (0.0007) [2023-12-27 22:19:01,335][106226] Updated weights for policy 0, policy_version 428628 (0.0011) [2023-12-27 22:19:01,369][106225] Updated weights for policy 1, policy_version 429890 (0.0008) [2023-12-27 22:19:01,406][106226] Updated weights for policy 0, policy_version 428638 (0.0012) [2023-12-27 22:19:01,431][106225] Updated weights for policy 1, policy_version 429900 (0.0007) [2023-12-27 22:19:01,457][106226] Updated weights for policy 0, policy_version 428648 (0.0008) [2023-12-27 22:19:02,157][106225] Updated weights for policy 1, policy_version 429910 (0.0007) [2023-12-27 22:19:02,188][106226] Updated weights for policy 0, policy_version 428658 (0.0008) [2023-12-27 22:19:02,215][106225] Updated weights for policy 1, policy_version 429920 (0.0005) [2023-12-27 22:19:02,248][106226] Updated weights for policy 0, policy_version 428668 (0.0006) [2023-12-27 22:19:02,275][106225] Updated weights for policy 1, policy_version 429930 (0.0010) [2023-12-27 22:19:02,314][106226] Updated weights for policy 0, policy_version 428678 (0.0006) [2023-12-27 22:19:02,967][106226] Updated weights for policy 0, policy_version 428688 (0.0010) [2023-12-27 22:19:03,002][106225] Updated weights for policy 1, policy_version 429940 (0.0007) [2023-12-27 22:19:03,020][106226] Updated weights for policy 0, policy_version 428698 (0.0007) [2023-12-27 22:19:03,061][106225] Updated weights for policy 1, policy_version 429950 (0.0010) [2023-12-27 22:19:03,072][106226] Updated weights for policy 0, policy_version 428708 (0.0008) [2023-12-27 22:19:03,124][106225] Updated weights for policy 1, policy_version 429960 (0.0010) [2023-12-27 22:19:03,682][106225] Updated weights for policy 1, policy_version 429970 (0.0009) [2023-12-27 22:19:03,750][106225] Updated weights for policy 1, policy_version 429980 (0.0005) [2023-12-27 22:19:03,781][106226] Updated weights for policy 0, policy_version 428718 (0.0010) [2023-12-27 22:19:03,798][106225] Updated weights for policy 1, policy_version 429990 (0.0005) [2023-12-27 22:19:03,841][106226] Updated weights for policy 0, policy_version 428728 (0.0010) [2023-12-27 22:19:03,850][106225] Updated weights for policy 1, policy_version 430000 (0.0006) [2023-12-27 22:19:03,912][106226] Updated weights for policy 0, policy_version 428738 (0.0011) [2023-12-27 22:19:04,489][106225] Updated weights for policy 1, policy_version 430010 (0.0008) [2023-12-27 22:19:04,556][106225] Updated weights for policy 1, policy_version 430020 (0.0006) [2023-12-27 22:19:04,599][106226] Updated weights for policy 0, policy_version 428748 (0.0011) [2023-12-27 22:19:04,613][106225] Updated weights for policy 1, policy_version 430030 (0.0007) [2023-12-27 22:19:04,653][106226] Updated weights for policy 0, policy_version 428758 (0.0010) [2023-12-27 22:19:04,713][106226] Updated weights for policy 0, policy_version 428768 (0.0010) [2023-12-27 22:19:05,231][106225] Updated weights for policy 1, policy_version 430040 (0.0008) [2023-12-27 22:19:05,287][106225] Updated weights for policy 1, policy_version 430050 (0.0010) [2023-12-27 22:19:05,349][106225] Updated weights for policy 1, policy_version 430060 (0.0009) [2023-12-27 22:19:05,380][106226] Updated weights for policy 0, policy_version 428778 (0.0010) [2023-12-27 22:19:05,431][106226] Updated weights for policy 0, policy_version 428788 (0.0005) [2023-12-27 22:19:05,488][106226] Updated weights for policy 0, policy_version 428798 (0.0008) [2023-12-27 22:19:05,531][106226] Updated weights for policy 0, policy_version 428808 (0.0010) [2023-12-27 22:19:06,102][106225] Updated weights for policy 1, policy_version 430070 (0.0009) [2023-12-27 22:19:06,167][106225] Updated weights for policy 1, policy_version 430080 (0.0008) [2023-12-27 22:19:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 219930624. Throughput: 0: 10061.7, 1: 9740.1. Samples: 219945492. Policy #0 lag: (min: 26.0, avg: 43.4, max: 58.0) [2023-12-27 22:19:06,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.618')] [2023-12-27 22:19:06,230][106226] Updated weights for policy 0, policy_version 428818 (0.0007) [2023-12-27 22:19:06,231][106225] Updated weights for policy 1, policy_version 430090 (0.0009) [2023-12-27 22:19:06,292][106226] Updated weights for policy 0, policy_version 428828 (0.0008) [2023-12-27 22:19:06,350][106226] Updated weights for policy 0, policy_version 428838 (0.0008) [2023-12-27 22:19:06,938][106225] Updated weights for policy 1, policy_version 430100 (0.0010) [2023-12-27 22:19:06,991][106225] Updated weights for policy 1, policy_version 430110 (0.0009) [2023-12-27 22:19:07,052][106226] Updated weights for policy 0, policy_version 428848 (0.0007) [2023-12-27 22:19:07,057][106225] Updated weights for policy 1, policy_version 430120 (0.0008) [2023-12-27 22:19:07,113][106226] Updated weights for policy 0, policy_version 428858 (0.0007) [2023-12-27 22:19:07,173][106226] Updated weights for policy 0, policy_version 428868 (0.0009) [2023-12-27 22:19:07,693][106225] Updated weights for policy 1, policy_version 430130 (0.0006) [2023-12-27 22:19:07,744][106225] Updated weights for policy 1, policy_version 430140 (0.0010) [2023-12-27 22:19:07,792][106225] Updated weights for policy 1, policy_version 430150 (0.0007) [2023-12-27 22:19:07,844][106225] Updated weights for policy 1, policy_version 430160 (0.0010) [2023-12-27 22:19:07,883][106226] Updated weights for policy 0, policy_version 428878 (0.0008) [2023-12-27 22:19:07,928][106226] Updated weights for policy 0, policy_version 428888 (0.0008) [2023-12-27 22:19:07,991][106226] Updated weights for policy 0, policy_version 428898 (0.0009) [2023-12-27 22:19:08,617][106225] Updated weights for policy 1, policy_version 430170 (0.0009) [2023-12-27 22:19:08,656][106226] Updated weights for policy 0, policy_version 428908 (0.0007) [2023-12-27 22:19:08,679][106225] Updated weights for policy 1, policy_version 430180 (0.0007) [2023-12-27 22:19:08,705][106226] Updated weights for policy 0, policy_version 428918 (0.0006) [2023-12-27 22:19:08,763][106226] Updated weights for policy 0, policy_version 428928 (0.0006) [2023-12-27 22:19:08,765][106225] Updated weights for policy 1, policy_version 430190 (0.0008) [2023-12-27 22:19:09,516][106225] Updated weights for policy 1, policy_version 430200 (0.0007) [2023-12-27 22:19:09,542][106226] Updated weights for policy 0, policy_version 428938 (0.0008) [2023-12-27 22:19:09,572][106225] Updated weights for policy 1, policy_version 430210 (0.0009) [2023-12-27 22:19:09,601][106226] Updated weights for policy 0, policy_version 428948 (0.0011) [2023-12-27 22:19:09,629][106225] Updated weights for policy 1, policy_version 430220 (0.0009) [2023-12-27 22:19:09,664][106226] Updated weights for policy 0, policy_version 428958 (0.0010) [2023-12-27 22:19:09,722][106226] Updated weights for policy 0, policy_version 428968 (0.0010) [2023-12-27 22:19:10,384][106225] Updated weights for policy 1, policy_version 430230 (0.0010) [2023-12-27 22:19:10,454][106225] Updated weights for policy 1, policy_version 430240 (0.0011) [2023-12-27 22:19:10,502][106226] Updated weights for policy 0, policy_version 428978 (0.0010) [2023-12-27 22:19:10,517][106225] Updated weights for policy 1, policy_version 430250 (0.0011) [2023-12-27 22:19:10,562][106226] Updated weights for policy 0, policy_version 428988 (0.0010) [2023-12-27 22:19:10,621][106226] Updated weights for policy 0, policy_version 428998 (0.0009) [2023-12-27 22:19:11,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 220028928. Throughput: 0: 10091.1, 1: 9763.0. Samples: 220004672. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:11,176][105115] Avg episode reward: [(0, '-4.830'), (1, '-5.552')] [2023-12-27 22:19:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000429000_109854720.pth... [2023-12-27 22:19:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000427848_109559808.pth [2023-12-27 22:19:11,195][106225] Updated weights for policy 1, policy_version 430260 (0.0009) [2023-12-27 22:19:11,260][106225] Updated weights for policy 1, policy_version 430270 (0.0008) [2023-12-27 22:19:11,332][106225] Updated weights for policy 1, policy_version 430280 (0.0008) [2023-12-27 22:19:11,386][106226] Updated weights for policy 0, policy_version 429008 (0.0009) [2023-12-27 22:19:11,390][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000430288_110182400.pth... [2023-12-27 22:19:11,393][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000429136_109887488.pth [2023-12-27 22:19:11,454][106226] Updated weights for policy 0, policy_version 429018 (0.0008) [2023-12-27 22:19:11,511][106226] Updated weights for policy 0, policy_version 429028 (0.0008) [2023-12-27 22:19:12,122][106225] Updated weights for policy 1, policy_version 430290 (0.0008) [2023-12-27 22:19:12,172][106225] Updated weights for policy 1, policy_version 430300 (0.0009) [2023-12-27 22:19:12,230][106225] Updated weights for policy 1, policy_version 430310 (0.0008) [2023-12-27 22:19:12,277][106226] Updated weights for policy 0, policy_version 429038 (0.0007) [2023-12-27 22:19:12,295][106225] Updated weights for policy 1, policy_version 430320 (0.0007) [2023-12-27 22:19:12,344][106226] Updated weights for policy 0, policy_version 429048 (0.0009) [2023-12-27 22:19:12,412][106226] Updated weights for policy 0, policy_version 429058 (0.0008) [2023-12-27 22:19:13,026][106225] Updated weights for policy 1, policy_version 430330 (0.0007) [2023-12-27 22:19:13,092][106225] Updated weights for policy 1, policy_version 430340 (0.0009) [2023-12-27 22:19:13,141][106225] Updated weights for policy 1, policy_version 430350 (0.0008) [2023-12-27 22:19:13,191][106226] Updated weights for policy 0, policy_version 429068 (0.0008) [2023-12-27 22:19:13,244][106226] Updated weights for policy 0, policy_version 429078 (0.0009) [2023-12-27 22:19:13,311][106226] Updated weights for policy 0, policy_version 429088 (0.0008) [2023-12-27 22:19:13,803][106225] Updated weights for policy 1, policy_version 430360 (0.0010) [2023-12-27 22:19:13,857][106225] Updated weights for policy 1, policy_version 430370 (0.0010) [2023-12-27 22:19:13,925][106225] Updated weights for policy 1, policy_version 430380 (0.0010) [2023-12-27 22:19:14,020][106226] Updated weights for policy 0, policy_version 429098 (0.0008) [2023-12-27 22:19:14,084][106226] Updated weights for policy 0, policy_version 429108 (0.0009) [2023-12-27 22:19:14,145][106226] Updated weights for policy 0, policy_version 429118 (0.0008) [2023-12-27 22:19:14,203][106226] Updated weights for policy 0, policy_version 429128 (0.0008) [2023-12-27 22:19:14,630][106225] Updated weights for policy 1, policy_version 430390 (0.0009) [2023-12-27 22:19:14,690][106225] Updated weights for policy 1, policy_version 430400 (0.0008) [2023-12-27 22:19:14,746][106225] Updated weights for policy 1, policy_version 430410 (0.0009) [2023-12-27 22:19:14,950][106226] Updated weights for policy 0, policy_version 429138 (0.0009) [2023-12-27 22:19:15,008][106226] Updated weights for policy 0, policy_version 429148 (0.0009) [2023-12-27 22:19:15,065][106226] Updated weights for policy 0, policy_version 429159 (0.0009) [2023-12-27 22:19:15,433][106225] Updated weights for policy 1, policy_version 430420 (0.0009) [2023-12-27 22:19:15,501][106225] Updated weights for policy 1, policy_version 430430 (0.0008) [2023-12-27 22:19:15,566][106225] Updated weights for policy 1, policy_version 430440 (0.0008) [2023-12-27 22:19:15,767][106226] Updated weights for policy 0, policy_version 429169 (0.0008) [2023-12-27 22:19:15,831][106226] Updated weights for policy 0, policy_version 429179 (0.0009) [2023-12-27 22:19:15,888][106226] Updated weights for policy 0, policy_version 429189 (0.0008) [2023-12-27 22:19:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19466.4). Total num frames: 220127232. Throughput: 0: 9872.5, 1: 9765.2. Samples: 220117360. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:16,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.520')] [2023-12-27 22:19:16,306][106225] Updated weights for policy 1, policy_version 430450 (0.0006) [2023-12-27 22:19:16,365][106225] Updated weights for policy 1, policy_version 430460 (0.0010) [2023-12-27 22:19:16,429][106225] Updated weights for policy 1, policy_version 430470 (0.0010) [2023-12-27 22:19:16,479][106225] Updated weights for policy 1, policy_version 430480 (0.0010) [2023-12-27 22:19:16,571][106226] Updated weights for policy 0, policy_version 429199 (0.0007) [2023-12-27 22:19:16,620][106226] Updated weights for policy 0, policy_version 429209 (0.0005) [2023-12-27 22:19:16,680][106226] Updated weights for policy 0, policy_version 429219 (0.0005) [2023-12-27 22:19:17,069][106225] Updated weights for policy 1, policy_version 430490 (0.0009) [2023-12-27 22:19:17,126][106225] Updated weights for policy 1, policy_version 430500 (0.0008) [2023-12-27 22:19:17,179][106225] Updated weights for policy 1, policy_version 430510 (0.0010) [2023-12-27 22:19:17,286][106226] Updated weights for policy 0, policy_version 429229 (0.0007) [2023-12-27 22:19:17,352][106226] Updated weights for policy 0, policy_version 429239 (0.0006) [2023-12-27 22:19:17,402][106226] Updated weights for policy 0, policy_version 429249 (0.0007) [2023-12-27 22:19:17,858][106225] Updated weights for policy 1, policy_version 430520 (0.0010) [2023-12-27 22:19:17,908][106225] Updated weights for policy 1, policy_version 430530 (0.0010) [2023-12-27 22:19:17,968][106225] Updated weights for policy 1, policy_version 430540 (0.0010) [2023-12-27 22:19:18,134][106226] Updated weights for policy 0, policy_version 429259 (0.0008) [2023-12-27 22:19:18,196][106226] Updated weights for policy 0, policy_version 429269 (0.0011) [2023-12-27 22:19:18,257][106226] Updated weights for policy 0, policy_version 429279 (0.0011) [2023-12-27 22:19:18,655][106225] Updated weights for policy 1, policy_version 430550 (0.0010) [2023-12-27 22:19:18,716][106225] Updated weights for policy 1, policy_version 430560 (0.0011) [2023-12-27 22:19:18,778][106225] Updated weights for policy 1, policy_version 430570 (0.0011) [2023-12-27 22:19:18,985][106226] Updated weights for policy 0, policy_version 429289 (0.0011) [2023-12-27 22:19:19,039][106226] Updated weights for policy 0, policy_version 429299 (0.0011) [2023-12-27 22:19:19,099][106226] Updated weights for policy 0, policy_version 429309 (0.0011) [2023-12-27 22:19:19,160][106226] Updated weights for policy 0, policy_version 429319 (0.0011) [2023-12-27 22:19:19,506][106225] Updated weights for policy 1, policy_version 430580 (0.0009) [2023-12-27 22:19:19,573][106225] Updated weights for policy 1, policy_version 430590 (0.0010) [2023-12-27 22:19:19,638][106225] Updated weights for policy 1, policy_version 430600 (0.0009) [2023-12-27 22:19:19,843][106226] Updated weights for policy 0, policy_version 429329 (0.0008) [2023-12-27 22:19:19,903][106226] Updated weights for policy 0, policy_version 429339 (0.0009) [2023-12-27 22:19:19,971][106226] Updated weights for policy 0, policy_version 429349 (0.0008) [2023-12-27 22:19:20,424][106225] Updated weights for policy 1, policy_version 430610 (0.0008) [2023-12-27 22:19:20,485][106225] Updated weights for policy 1, policy_version 430620 (0.0008) [2023-12-27 22:19:20,547][106225] Updated weights for policy 1, policy_version 430630 (0.0008) [2023-12-27 22:19:20,633][106225] Updated weights for policy 1, policy_version 430640 (0.0008) [2023-12-27 22:19:20,688][106226] Updated weights for policy 0, policy_version 429359 (0.0009) [2023-12-27 22:19:20,748][106226] Updated weights for policy 0, policy_version 429369 (0.0009) [2023-12-27 22:19:20,820][106226] Updated weights for policy 0, policy_version 429379 (0.0007) [2023-12-27 22:19:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 220225536. Throughput: 0: 9773.0, 1: 9708.7. Samples: 220236224. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:21,175][105115] Avg episode reward: [(0, '-4.907'), (1, '-5.242')] [2023-12-27 22:19:21,452][106225] Updated weights for policy 1, policy_version 430650 (0.0006) [2023-12-27 22:19:21,515][106225] Updated weights for policy 1, policy_version 430660 (0.0009) [2023-12-27 22:19:21,542][106226] Updated weights for policy 0, policy_version 429389 (0.0008) [2023-12-27 22:19:21,575][106225] Updated weights for policy 1, policy_version 430670 (0.0006) [2023-12-27 22:19:21,606][106226] Updated weights for policy 0, policy_version 429399 (0.0008) [2023-12-27 22:19:21,692][106226] Updated weights for policy 0, policy_version 429409 (0.0008) [2023-12-27 22:19:22,335][106225] Updated weights for policy 1, policy_version 430680 (0.0010) [2023-12-27 22:19:22,409][106225] Updated weights for policy 1, policy_version 430690 (0.0012) [2023-12-27 22:19:22,433][106226] Updated weights for policy 0, policy_version 429419 (0.0008) [2023-12-27 22:19:22,476][106225] Updated weights for policy 1, policy_version 430700 (0.0009) [2023-12-27 22:19:22,489][106226] Updated weights for policy 0, policy_version 429429 (0.0006) [2023-12-27 22:19:22,557][106226] Updated weights for policy 0, policy_version 429439 (0.0007) [2023-12-27 22:19:23,181][106225] Updated weights for policy 1, policy_version 430710 (0.0007) [2023-12-27 22:19:23,248][106225] Updated weights for policy 1, policy_version 430720 (0.0008) [2023-12-27 22:19:23,279][106226] Updated weights for policy 0, policy_version 429449 (0.0010) [2023-12-27 22:19:23,308][106225] Updated weights for policy 1, policy_version 430730 (0.0008) [2023-12-27 22:19:23,341][106226] Updated weights for policy 0, policy_version 429459 (0.0009) [2023-12-27 22:19:23,401][106226] Updated weights for policy 0, policy_version 429469 (0.0009) [2023-12-27 22:19:23,460][106226] Updated weights for policy 0, policy_version 429479 (0.0008) [2023-12-27 22:19:23,986][106225] Updated weights for policy 1, policy_version 430740 (0.0006) [2023-12-27 22:19:24,050][106225] Updated weights for policy 1, policy_version 430750 (0.0005) [2023-12-27 22:19:24,102][106225] Updated weights for policy 1, policy_version 430760 (0.0006) [2023-12-27 22:19:24,237][106226] Updated weights for policy 0, policy_version 429489 (0.0008) [2023-12-27 22:19:24,287][106226] Updated weights for policy 0, policy_version 429499 (0.0008) [2023-12-27 22:19:24,348][106226] Updated weights for policy 0, policy_version 429509 (0.0009) [2023-12-27 22:19:24,644][106225] Updated weights for policy 1, policy_version 430770 (0.0008) [2023-12-27 22:19:24,710][106225] Updated weights for policy 1, policy_version 430780 (0.0009) [2023-12-27 22:19:24,768][106225] Updated weights for policy 1, policy_version 430790 (0.0007) [2023-12-27 22:19:24,824][106225] Updated weights for policy 1, policy_version 430800 (0.0007) [2023-12-27 22:19:25,174][106226] Updated weights for policy 0, policy_version 429519 (0.0009) [2023-12-27 22:19:25,227][106226] Updated weights for policy 0, policy_version 429529 (0.0008) [2023-12-27 22:19:25,280][106226] Updated weights for policy 0, policy_version 429539 (0.0009) [2023-12-27 22:19:25,487][106225] Updated weights for policy 1, policy_version 430810 (0.0005) [2023-12-27 22:19:25,542][106225] Updated weights for policy 1, policy_version 430820 (0.0006) [2023-12-27 22:19:25,591][106225] Updated weights for policy 1, policy_version 430830 (0.0008) [2023-12-27 22:19:26,047][106226] Updated weights for policy 0, policy_version 429549 (0.0008) [2023-12-27 22:19:26,104][106226] Updated weights for policy 0, policy_version 429559 (0.0009) [2023-12-27 22:19:26,171][106226] Updated weights for policy 0, policy_version 429569 (0.0008) [2023-12-27 22:19:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 220315648. Throughput: 0: 9756.1, 1: 9674.7. Samples: 220291644. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:26,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.731')] [2023-12-27 22:19:26,214][106225] Updated weights for policy 1, policy_version 430840 (0.0007) [2023-12-27 22:19:26,216][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000429576_110002176.pth... [2023-12-27 22:19:26,220][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000428456_109715456.pth [2023-12-27 22:19:26,274][106225] Updated weights for policy 1, policy_version 430850 (0.0009) [2023-12-27 22:19:26,326][106225] Updated weights for policy 1, policy_version 430860 (0.0009) [2023-12-27 22:19:26,346][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000430864_110329856.pth... [2023-12-27 22:19:26,350][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000429680_110026752.pth [2023-12-27 22:19:26,815][106226] Updated weights for policy 0, policy_version 429579 (0.0008) [2023-12-27 22:19:26,869][106226] Updated weights for policy 0, policy_version 429590 (0.0009) [2023-12-27 22:19:26,922][106226] Updated weights for policy 0, policy_version 429600 (0.0009) [2023-12-27 22:19:27,028][106225] Updated weights for policy 1, policy_version 430870 (0.0008) [2023-12-27 22:19:27,078][106225] Updated weights for policy 1, policy_version 430880 (0.0008) [2023-12-27 22:19:27,131][106225] Updated weights for policy 1, policy_version 430890 (0.0009) [2023-12-27 22:19:27,700][106226] Updated weights for policy 0, policy_version 429610 (0.0008) [2023-12-27 22:19:27,759][106226] Updated weights for policy 0, policy_version 429620 (0.0009) [2023-12-27 22:19:27,807][106225] Updated weights for policy 1, policy_version 430900 (0.0007) [2023-12-27 22:19:27,813][106226] Updated weights for policy 0, policy_version 429630 (0.0008) [2023-12-27 22:19:27,861][106225] Updated weights for policy 1, policy_version 430910 (0.0007) [2023-12-27 22:19:27,866][106226] Updated weights for policy 0, policy_version 429640 (0.0006) [2023-12-27 22:19:27,908][106225] Updated weights for policy 1, policy_version 430920 (0.0008) [2023-12-27 22:19:28,624][106226] Updated weights for policy 0, policy_version 429650 (0.0005) [2023-12-27 22:19:28,661][106225] Updated weights for policy 1, policy_version 430930 (0.0008) [2023-12-27 22:19:28,690][106226] Updated weights for policy 0, policy_version 429660 (0.0006) [2023-12-27 22:19:28,712][106225] Updated weights for policy 1, policy_version 430940 (0.0009) [2023-12-27 22:19:28,746][106226] Updated weights for policy 0, policy_version 429670 (0.0005) [2023-12-27 22:19:28,769][106225] Updated weights for policy 1, policy_version 430950 (0.0009) [2023-12-27 22:19:28,828][106225] Updated weights for policy 1, policy_version 430960 (0.0008) [2023-12-27 22:19:29,289][106226] Updated weights for policy 0, policy_version 429680 (0.0006) [2023-12-27 22:19:29,358][106226] Updated weights for policy 0, policy_version 429690 (0.0008) [2023-12-27 22:19:29,427][106226] Updated weights for policy 0, policy_version 429700 (0.0008) [2023-12-27 22:19:29,580][106225] Updated weights for policy 1, policy_version 430970 (0.0010) [2023-12-27 22:19:29,645][106225] Updated weights for policy 1, policy_version 430980 (0.0010) [2023-12-27 22:19:29,719][106225] Updated weights for policy 1, policy_version 430991 (0.0009) [2023-12-27 22:19:30,112][106226] Updated weights for policy 0, policy_version 429710 (0.0008) [2023-12-27 22:19:30,182][106226] Updated weights for policy 0, policy_version 429720 (0.0006) [2023-12-27 22:19:30,251][106226] Updated weights for policy 0, policy_version 429730 (0.0008) [2023-12-27 22:19:30,405][106225] Updated weights for policy 1, policy_version 431001 (0.0011) [2023-12-27 22:19:30,464][106225] Updated weights for policy 1, policy_version 431011 (0.0011) [2023-12-27 22:19:30,524][106225] Updated weights for policy 1, policy_version 431021 (0.0007) [2023-12-27 22:19:30,982][106226] Updated weights for policy 0, policy_version 429740 (0.0008) [2023-12-27 22:19:31,043][106226] Updated weights for policy 0, policy_version 429750 (0.0008) [2023-12-27 22:19:31,105][106226] Updated weights for policy 0, policy_version 429760 (0.0008) [2023-12-27 22:19:31,108][106225] Updated weights for policy 1, policy_version 431031 (0.0008) [2023-12-27 22:19:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 220422144. Throughput: 0: 9761.7, 1: 9769.3. Samples: 220411536. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:31,175][105115] Avg episode reward: [(0, '-4.984'), (1, '-5.449')] [2023-12-27 22:19:31,177][106225] Updated weights for policy 1, policy_version 431041 (0.0009) [2023-12-27 22:19:31,235][106225] Updated weights for policy 1, policy_version 431051 (0.0010) [2023-12-27 22:19:31,882][106226] Updated weights for policy 0, policy_version 429770 (0.0008) [2023-12-27 22:19:31,940][106226] Updated weights for policy 0, policy_version 429780 (0.0008) [2023-12-27 22:19:31,972][106225] Updated weights for policy 1, policy_version 431061 (0.0009) [2023-12-27 22:19:31,998][106226] Updated weights for policy 0, policy_version 429790 (0.0008) [2023-12-27 22:19:32,027][106225] Updated weights for policy 1, policy_version 431071 (0.0010) [2023-12-27 22:19:32,061][106226] Updated weights for policy 0, policy_version 429800 (0.0007) [2023-12-27 22:19:32,086][106225] Updated weights for policy 1, policy_version 431081 (0.0010) [2023-12-27 22:19:32,700][106226] Updated weights for policy 0, policy_version 429810 (0.0008) [2023-12-27 22:19:32,763][106226] Updated weights for policy 0, policy_version 429820 (0.0008) [2023-12-27 22:19:32,828][106225] Updated weights for policy 1, policy_version 431091 (0.0011) [2023-12-27 22:19:32,833][106226] Updated weights for policy 0, policy_version 429830 (0.0008) [2023-12-27 22:19:32,884][106225] Updated weights for policy 1, policy_version 431101 (0.0010) [2023-12-27 22:19:32,947][106225] Updated weights for policy 1, policy_version 431111 (0.0010) [2023-12-27 22:19:33,537][106226] Updated weights for policy 0, policy_version 429840 (0.0007) [2023-12-27 22:19:33,593][106226] Updated weights for policy 0, policy_version 429850 (0.0008) [2023-12-27 22:19:33,645][106225] Updated weights for policy 1, policy_version 431121 (0.0010) [2023-12-27 22:19:33,650][106226] Updated weights for policy 0, policy_version 429860 (0.0008) [2023-12-27 22:19:33,701][106225] Updated weights for policy 1, policy_version 431131 (0.0010) [2023-12-27 22:19:33,750][106225] Updated weights for policy 1, policy_version 431141 (0.0010) [2023-12-27 22:19:33,801][106225] Updated weights for policy 1, policy_version 431151 (0.0007) [2023-12-27 22:19:34,407][106226] Updated weights for policy 0, policy_version 429870 (0.0007) [2023-12-27 22:19:34,462][106226] Updated weights for policy 0, policy_version 429880 (0.0007) [2023-12-27 22:19:34,511][106226] Updated weights for policy 0, policy_version 429890 (0.0008) [2023-12-27 22:19:34,560][106225] Updated weights for policy 1, policy_version 431161 (0.0010) [2023-12-27 22:19:34,628][106225] Updated weights for policy 1, policy_version 431171 (0.0010) [2023-12-27 22:19:34,690][106225] Updated weights for policy 1, policy_version 431181 (0.0010) [2023-12-27 22:19:35,225][106226] Updated weights for policy 0, policy_version 429900 (0.0006) [2023-12-27 22:19:35,290][106226] Updated weights for policy 0, policy_version 429910 (0.0008) [2023-12-27 22:19:35,293][106225] Updated weights for policy 1, policy_version 431191 (0.0010) [2023-12-27 22:19:35,336][106225] Updated weights for policy 1, policy_version 431201 (0.0010) [2023-12-27 22:19:35,361][106226] Updated weights for policy 0, policy_version 429920 (0.0007) [2023-12-27 22:19:35,389][106225] Updated weights for policy 1, policy_version 431211 (0.0010) [2023-12-27 22:19:36,023][106226] Updated weights for policy 0, policy_version 429930 (0.0009) [2023-12-27 22:19:36,083][106226] Updated weights for policy 0, policy_version 429940 (0.0005) [2023-12-27 22:19:36,134][106225] Updated weights for policy 1, policy_version 431221 (0.0010) [2023-12-27 22:19:36,148][106226] Updated weights for policy 0, policy_version 429950 (0.0010) [2023-12-27 22:19:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19438.7). Total num frames: 220512256. Throughput: 0: 9753.9, 1: 9818.2. Samples: 220528900. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:36,175][105115] Avg episode reward: [(0, '-5.038'), (1, '-5.241')] [2023-12-27 22:19:36,197][106225] Updated weights for policy 1, policy_version 431231 (0.0010) [2023-12-27 22:19:36,215][106226] Updated weights for policy 0, policy_version 429960 (0.0011) [2023-12-27 22:19:36,258][106225] Updated weights for policy 1, policy_version 431241 (0.0010) [2023-12-27 22:19:36,937][106226] Updated weights for policy 0, policy_version 429970 (0.0011) [2023-12-27 22:19:36,998][106226] Updated weights for policy 0, policy_version 429980 (0.0010) [2023-12-27 22:19:37,012][106225] Updated weights for policy 1, policy_version 431251 (0.0010) [2023-12-27 22:19:37,059][106226] Updated weights for policy 0, policy_version 429990 (0.0011) [2023-12-27 22:19:37,073][106225] Updated weights for policy 1, policy_version 431261 (0.0010) [2023-12-27 22:19:37,133][106225] Updated weights for policy 1, policy_version 431271 (0.0010) [2023-12-27 22:19:37,777][106226] Updated weights for policy 0, policy_version 430000 (0.0007) [2023-12-27 22:19:37,779][106225] Updated weights for policy 1, policy_version 431281 (0.0010) [2023-12-27 22:19:37,836][106226] Updated weights for policy 0, policy_version 430010 (0.0009) [2023-12-27 22:19:37,844][106225] Updated weights for policy 1, policy_version 431291 (0.0006) [2023-12-27 22:19:37,895][106226] Updated weights for policy 0, policy_version 430020 (0.0006) [2023-12-27 22:19:37,915][106225] Updated weights for policy 1, policy_version 431301 (0.0008) [2023-12-27 22:19:37,987][106225] Updated weights for policy 1, policy_version 431311 (0.0009) [2023-12-27 22:19:38,533][106226] Updated weights for policy 0, policy_version 430030 (0.0006) [2023-12-27 22:19:38,587][106226] Updated weights for policy 0, policy_version 430040 (0.0006) [2023-12-27 22:19:38,657][106226] Updated weights for policy 0, policy_version 430050 (0.0008) [2023-12-27 22:19:38,663][106225] Updated weights for policy 1, policy_version 431321 (0.0009) [2023-12-27 22:19:38,723][106225] Updated weights for policy 1, policy_version 431331 (0.0007) [2023-12-27 22:19:38,778][106225] Updated weights for policy 1, policy_version 431341 (0.0007) [2023-12-27 22:19:39,254][106226] Updated weights for policy 0, policy_version 430060 (0.0008) [2023-12-27 22:19:39,322][106226] Updated weights for policy 0, policy_version 430070 (0.0008) [2023-12-27 22:19:39,395][106226] Updated weights for policy 0, policy_version 430080 (0.0008) [2023-12-27 22:19:39,499][106225] Updated weights for policy 1, policy_version 431351 (0.0010) [2023-12-27 22:19:39,554][106225] Updated weights for policy 1, policy_version 431361 (0.0011) [2023-12-27 22:19:39,619][106225] Updated weights for policy 1, policy_version 431371 (0.0010) [2023-12-27 22:19:40,174][106226] Updated weights for policy 0, policy_version 430090 (0.0008) [2023-12-27 22:19:40,237][106226] Updated weights for policy 0, policy_version 430100 (0.0008) [2023-12-27 22:19:40,292][106226] Updated weights for policy 0, policy_version 430110 (0.0008) [2023-12-27 22:19:40,354][106226] Updated weights for policy 0, policy_version 430120 (0.0008) [2023-12-27 22:19:40,379][106225] Updated weights for policy 1, policy_version 431381 (0.0011) [2023-12-27 22:19:40,442][106225] Updated weights for policy 1, policy_version 431391 (0.0011) [2023-12-27 22:19:40,498][106225] Updated weights for policy 1, policy_version 431401 (0.0011) [2023-12-27 22:19:41,034][106226] Updated weights for policy 0, policy_version 430130 (0.0008) [2023-12-27 22:19:41,098][106226] Updated weights for policy 0, policy_version 430140 (0.0008) [2023-12-27 22:19:41,171][106226] Updated weights for policy 0, policy_version 430150 (0.0009) [2023-12-27 22:19:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 220610560. Throughput: 0: 9770.5, 1: 9847.3. Samples: 220588180. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:41,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.202')] [2023-12-27 22:19:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000430152_110149632.pth... [2023-12-27 22:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000429000_109854720.pth [2023-12-27 22:19:41,206][106225] Updated weights for policy 1, policy_version 431411 (0.0010) [2023-12-27 22:19:41,274][106225] Updated weights for policy 1, policy_version 431421 (0.0008) [2023-12-27 22:19:41,348][106225] Updated weights for policy 1, policy_version 431431 (0.0008) [2023-12-27 22:19:41,416][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000431440_110477312.pth... [2023-12-27 22:19:41,420][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000430288_110182400.pth [2023-12-27 22:19:41,971][106226] Updated weights for policy 0, policy_version 430160 (0.0009) [2023-12-27 22:19:42,037][106226] Updated weights for policy 0, policy_version 430170 (0.0007) [2023-12-27 22:19:42,107][106226] Updated weights for policy 0, policy_version 430180 (0.0009) [2023-12-27 22:19:42,126][106225] Updated weights for policy 1, policy_version 431441 (0.0008) [2023-12-27 22:19:42,199][106225] Updated weights for policy 1, policy_version 431451 (0.0007) [2023-12-27 22:19:42,257][106225] Updated weights for policy 1, policy_version 431461 (0.0009) [2023-12-27 22:19:42,324][106225] Updated weights for policy 1, policy_version 431471 (0.0010) [2023-12-27 22:19:42,784][106226] Updated weights for policy 0, policy_version 430190 (0.0007) [2023-12-27 22:19:42,846][106226] Updated weights for policy 0, policy_version 430200 (0.0009) [2023-12-27 22:19:42,906][106226] Updated weights for policy 0, policy_version 430210 (0.0009) [2023-12-27 22:19:43,014][106225] Updated weights for policy 1, policy_version 431481 (0.0006) [2023-12-27 22:19:43,072][106225] Updated weights for policy 1, policy_version 431491 (0.0007) [2023-12-27 22:19:43,130][106225] Updated weights for policy 1, policy_version 431501 (0.0007) [2023-12-27 22:19:43,572][106226] Updated weights for policy 0, policy_version 430220 (0.0007) [2023-12-27 22:19:43,628][106226] Updated weights for policy 0, policy_version 430230 (0.0005) [2023-12-27 22:19:43,697][106226] Updated weights for policy 0, policy_version 430240 (0.0005) [2023-12-27 22:19:43,751][106225] Updated weights for policy 1, policy_version 431511 (0.0005) [2023-12-27 22:19:43,805][106225] Updated weights for policy 1, policy_version 431521 (0.0005) [2023-12-27 22:19:43,856][106225] Updated weights for policy 1, policy_version 431531 (0.0008) [2023-12-27 22:19:44,358][106226] Updated weights for policy 0, policy_version 430250 (0.0007) [2023-12-27 22:19:44,413][106226] Updated weights for policy 0, policy_version 430260 (0.0009) [2023-12-27 22:19:44,469][106226] Updated weights for policy 0, policy_version 430270 (0.0010) [2023-12-27 22:19:44,505][106225] Updated weights for policy 1, policy_version 431541 (0.0007) [2023-12-27 22:19:44,546][106226] Updated weights for policy 0, policy_version 430280 (0.0007) [2023-12-27 22:19:44,574][106225] Updated weights for policy 1, policy_version 431551 (0.0008) [2023-12-27 22:19:44,647][106225] Updated weights for policy 1, policy_version 431561 (0.0007) [2023-12-27 22:19:45,265][106226] Updated weights for policy 0, policy_version 430290 (0.0008) [2023-12-27 22:19:45,321][106226] Updated weights for policy 0, policy_version 430300 (0.0008) [2023-12-27 22:19:45,323][106225] Updated weights for policy 1, policy_version 431571 (0.0007) [2023-12-27 22:19:45,376][106226] Updated weights for policy 0, policy_version 430310 (0.0008) [2023-12-27 22:19:45,386][106225] Updated weights for policy 1, policy_version 431581 (0.0007) [2023-12-27 22:19:45,452][106225] Updated weights for policy 1, policy_version 431591 (0.0009) [2023-12-27 22:19:45,952][106226] Updated weights for policy 0, policy_version 430320 (0.0010) [2023-12-27 22:19:46,010][106226] Updated weights for policy 0, policy_version 430330 (0.0008) [2023-12-27 22:19:46,062][106226] Updated weights for policy 0, policy_version 430340 (0.0010) [2023-12-27 22:19:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.7, 300 sec: 19521.9). Total num frames: 220717056. Throughput: 0: 9701.7, 1: 9823.3. Samples: 220705148. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:46,176][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.485')] [2023-12-27 22:19:46,206][106225] Updated weights for policy 1, policy_version 431601 (0.0009) [2023-12-27 22:19:46,266][106225] Updated weights for policy 1, policy_version 431611 (0.0008) [2023-12-27 22:19:46,334][106225] Updated weights for policy 1, policy_version 431621 (0.0008) [2023-12-27 22:19:46,392][106225] Updated weights for policy 1, policy_version 431631 (0.0007) [2023-12-27 22:19:46,762][106226] Updated weights for policy 0, policy_version 430350 (0.0007) [2023-12-27 22:19:46,823][106226] Updated weights for policy 0, policy_version 430360 (0.0005) [2023-12-27 22:19:46,888][106226] Updated weights for policy 0, policy_version 430370 (0.0006) [2023-12-27 22:19:46,984][106225] Updated weights for policy 1, policy_version 431641 (0.0008) [2023-12-27 22:19:47,035][106225] Updated weights for policy 1, policy_version 431651 (0.0008) [2023-12-27 22:19:47,086][106225] Updated weights for policy 1, policy_version 431661 (0.0007) [2023-12-27 22:19:47,493][106226] Updated weights for policy 0, policy_version 430380 (0.0009) [2023-12-27 22:19:47,560][106226] Updated weights for policy 0, policy_version 430390 (0.0005) [2023-12-27 22:19:47,619][106226] Updated weights for policy 0, policy_version 430400 (0.0005) [2023-12-27 22:19:47,762][106225] Updated weights for policy 1, policy_version 431671 (0.0006) [2023-12-27 22:19:47,821][106225] Updated weights for policy 1, policy_version 431681 (0.0007) [2023-12-27 22:19:47,876][106225] Updated weights for policy 1, policy_version 431691 (0.0006) [2023-12-27 22:19:48,225][106226] Updated weights for policy 0, policy_version 430410 (0.0006) [2023-12-27 22:19:48,285][106226] Updated weights for policy 0, policy_version 430420 (0.0008) [2023-12-27 22:19:48,350][106226] Updated weights for policy 0, policy_version 430430 (0.0008) [2023-12-27 22:19:48,410][106226] Updated weights for policy 0, policy_version 430440 (0.0008) [2023-12-27 22:19:48,605][106225] Updated weights for policy 1, policy_version 431701 (0.0008) [2023-12-27 22:19:48,671][106225] Updated weights for policy 1, policy_version 431711 (0.0008) [2023-12-27 22:19:48,740][106225] Updated weights for policy 1, policy_version 431721 (0.0008) [2023-12-27 22:19:49,154][106226] Updated weights for policy 0, policy_version 430450 (0.0005) [2023-12-27 22:19:49,224][106226] Updated weights for policy 0, policy_version 430460 (0.0007) [2023-12-27 22:19:49,288][106226] Updated weights for policy 0, policy_version 430470 (0.0008) [2023-12-27 22:19:49,446][106225] Updated weights for policy 1, policy_version 431731 (0.0008) [2023-12-27 22:19:49,514][106225] Updated weights for policy 1, policy_version 431741 (0.0007) [2023-12-27 22:19:49,580][106225] Updated weights for policy 1, policy_version 431751 (0.0006) [2023-12-27 22:19:49,952][106226] Updated weights for policy 0, policy_version 430480 (0.0008) [2023-12-27 22:19:50,023][106226] Updated weights for policy 0, policy_version 430490 (0.0008) [2023-12-27 22:19:50,079][106226] Updated weights for policy 0, policy_version 430500 (0.0008) [2023-12-27 22:19:50,289][106225] Updated weights for policy 1, policy_version 431761 (0.0006) [2023-12-27 22:19:50,354][106225] Updated weights for policy 1, policy_version 431771 (0.0008) [2023-12-27 22:19:50,418][106225] Updated weights for policy 1, policy_version 431781 (0.0008) [2023-12-27 22:19:50,476][106225] Updated weights for policy 1, policy_version 431791 (0.0008) [2023-12-27 22:19:50,815][106226] Updated weights for policy 0, policy_version 430510 (0.0008) [2023-12-27 22:19:50,883][106226] Updated weights for policy 0, policy_version 430520 (0.0008) [2023-12-27 22:19:50,949][106226] Updated weights for policy 0, policy_version 430530 (0.0007) [2023-12-27 22:19:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 220815360. Throughput: 0: 9740.9, 1: 9810.8. Samples: 220825320. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:51,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-5.358')] [2023-12-27 22:19:51,233][106225] Updated weights for policy 1, policy_version 431801 (0.0008) [2023-12-27 22:19:51,302][106225] Updated weights for policy 1, policy_version 431811 (0.0008) [2023-12-27 22:19:51,372][106225] Updated weights for policy 1, policy_version 431821 (0.0007) [2023-12-27 22:19:51,604][106226] Updated weights for policy 0, policy_version 430540 (0.0009) [2023-12-27 22:19:51,674][106226] Updated weights for policy 0, policy_version 430550 (0.0009) [2023-12-27 22:19:51,742][106226] Updated weights for policy 0, policy_version 430560 (0.0008) [2023-12-27 22:19:52,111][106225] Updated weights for policy 1, policy_version 431831 (0.0006) [2023-12-27 22:19:52,171][106225] Updated weights for policy 1, policy_version 431841 (0.0008) [2023-12-27 22:19:52,219][106225] Updated weights for policy 1, policy_version 431851 (0.0008) [2023-12-27 22:19:52,464][106226] Updated weights for policy 0, policy_version 430570 (0.0008) [2023-12-27 22:19:52,517][106226] Updated weights for policy 0, policy_version 430580 (0.0009) [2023-12-27 22:19:52,570][106226] Updated weights for policy 0, policy_version 430590 (0.0009) [2023-12-27 22:19:52,632][106226] Updated weights for policy 0, policy_version 430600 (0.0007) [2023-12-27 22:19:53,001][106225] Updated weights for policy 1, policy_version 431861 (0.0008) [2023-12-27 22:19:53,055][106225] Updated weights for policy 1, policy_version 431871 (0.0008) [2023-12-27 22:19:53,110][106225] Updated weights for policy 1, policy_version 431881 (0.0008) [2023-12-27 22:19:53,238][106226] Updated weights for policy 0, policy_version 430610 (0.0007) [2023-12-27 22:19:53,298][106226] Updated weights for policy 0, policy_version 430620 (0.0007) [2023-12-27 22:19:53,358][106226] Updated weights for policy 0, policy_version 430630 (0.0010) [2023-12-27 22:19:53,867][106225] Updated weights for policy 1, policy_version 431891 (0.0006) [2023-12-27 22:19:53,912][106226] Updated weights for policy 0, policy_version 430640 (0.0006) [2023-12-27 22:19:53,918][106225] Updated weights for policy 1, policy_version 431901 (0.0008) [2023-12-27 22:19:53,967][106226] Updated weights for policy 0, policy_version 430650 (0.0005) [2023-12-27 22:19:53,971][106225] Updated weights for policy 1, policy_version 431911 (0.0007) [2023-12-27 22:19:54,032][106226] Updated weights for policy 0, policy_version 430660 (0.0010) [2023-12-27 22:19:54,630][106225] Updated weights for policy 1, policy_version 431921 (0.0006) [2023-12-27 22:19:54,681][106225] Updated weights for policy 1, policy_version 431931 (0.0008) [2023-12-27 22:19:54,716][106226] Updated weights for policy 0, policy_version 430670 (0.0010) [2023-12-27 22:19:54,732][106225] Updated weights for policy 1, policy_version 431941 (0.0006) [2023-12-27 22:19:54,776][106226] Updated weights for policy 0, policy_version 430680 (0.0010) [2023-12-27 22:19:54,782][106225] Updated weights for policy 1, policy_version 431951 (0.0007) [2023-12-27 22:19:54,836][106226] Updated weights for policy 0, policy_version 430690 (0.0010) [2023-12-27 22:19:55,395][106225] Updated weights for policy 1, policy_version 431961 (0.0005) [2023-12-27 22:19:55,447][106225] Updated weights for policy 1, policy_version 431971 (0.0005) [2023-12-27 22:19:55,500][106225] Updated weights for policy 1, policy_version 431981 (0.0006) [2023-12-27 22:19:55,557][106226] Updated weights for policy 0, policy_version 430700 (0.0010) [2023-12-27 22:19:55,614][106226] Updated weights for policy 0, policy_version 430710 (0.0007) [2023-12-27 22:19:55,677][106226] Updated weights for policy 0, policy_version 430720 (0.0005) [2023-12-27 22:19:56,100][106225] Updated weights for policy 1, policy_version 431991 (0.0008) [2023-12-27 22:19:56,159][106225] Updated weights for policy 1, policy_version 432001 (0.0007) [2023-12-27 22:19:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19494.2). Total num frames: 220913664. Throughput: 0: 9796.2, 1: 9763.9. Samples: 220884876. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:19:56,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.100')] [2023-12-27 22:19:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000430728_110297088.pth... [2023-12-27 22:19:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000429576_110002176.pth [2023-12-27 22:19:56,222][106225] Updated weights for policy 1, policy_version 432011 (0.0006) [2023-12-27 22:19:56,248][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000432016_110624768.pth... [2023-12-27 22:19:56,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000430864_110329856.pth [2023-12-27 22:19:56,346][106226] Updated weights for policy 0, policy_version 430730 (0.0007) [2023-12-27 22:19:56,407][106226] Updated weights for policy 0, policy_version 430740 (0.0011) [2023-12-27 22:19:56,462][106226] Updated weights for policy 0, policy_version 430750 (0.0009) [2023-12-27 22:19:56,519][106226] Updated weights for policy 0, policy_version 430760 (0.0005) [2023-12-27 22:19:56,937][106225] Updated weights for policy 1, policy_version 432021 (0.0007) [2023-12-27 22:19:56,990][106225] Updated weights for policy 1, policy_version 432031 (0.0006) [2023-12-27 22:19:57,049][106225] Updated weights for policy 1, policy_version 432041 (0.0005) [2023-12-27 22:19:57,086][106226] Updated weights for policy 0, policy_version 430770 (0.0007) [2023-12-27 22:19:57,144][106226] Updated weights for policy 0, policy_version 430780 (0.0005) [2023-12-27 22:19:57,209][106226] Updated weights for policy 0, policy_version 430790 (0.0007) [2023-12-27 22:19:57,633][106225] Updated weights for policy 1, policy_version 432051 (0.0007) [2023-12-27 22:19:57,688][106225] Updated weights for policy 1, policy_version 432061 (0.0008) [2023-12-27 22:19:57,747][106225] Updated weights for policy 1, policy_version 432071 (0.0009) [2023-12-27 22:19:57,833][106226] Updated weights for policy 0, policy_version 430800 (0.0008) [2023-12-27 22:19:57,888][106226] Updated weights for policy 0, policy_version 430810 (0.0006) [2023-12-27 22:19:57,944][106226] Updated weights for policy 0, policy_version 430820 (0.0008) [2023-12-27 22:19:58,481][106225] Updated weights for policy 1, policy_version 432081 (0.0007) [2023-12-27 22:19:58,541][106225] Updated weights for policy 1, policy_version 432091 (0.0008) [2023-12-27 22:19:58,615][106225] Updated weights for policy 1, policy_version 432102 (0.0008) [2023-12-27 22:19:58,678][106225] Updated weights for policy 1, policy_version 432112 (0.0008) [2023-12-27 22:19:58,701][106226] Updated weights for policy 0, policy_version 430830 (0.0007) [2023-12-27 22:19:58,783][106226] Updated weights for policy 0, policy_version 430840 (0.0008) [2023-12-27 22:19:58,865][106226] Updated weights for policy 0, policy_version 430850 (0.0008) [2023-12-27 22:19:59,434][106225] Updated weights for policy 1, policy_version 432122 (0.0009) [2023-12-27 22:19:59,491][106225] Updated weights for policy 1, policy_version 432132 (0.0010) [2023-12-27 22:19:59,540][106225] Updated weights for policy 1, policy_version 432142 (0.0009) [2023-12-27 22:19:59,599][106226] Updated weights for policy 0, policy_version 430860 (0.0008) [2023-12-27 22:19:59,660][106226] Updated weights for policy 0, policy_version 430870 (0.0009) [2023-12-27 22:19:59,724][106226] Updated weights for policy 0, policy_version 430880 (0.0009) [2023-12-27 22:20:00,337][106225] Updated weights for policy 1, policy_version 432152 (0.0006) [2023-12-27 22:20:00,398][106225] Updated weights for policy 1, policy_version 432162 (0.0008) [2023-12-27 22:20:00,457][106225] Updated weights for policy 1, policy_version 432172 (0.0008) [2023-12-27 22:20:00,480][106226] Updated weights for policy 0, policy_version 430890 (0.0008) [2023-12-27 22:20:00,532][106226] Updated weights for policy 0, policy_version 430900 (0.0009) [2023-12-27 22:20:00,582][106226] Updated weights for policy 0, policy_version 430910 (0.0008) [2023-12-27 22:20:00,630][106226] Updated weights for policy 0, policy_version 430920 (0.0008) [2023-12-27 22:20:01,118][106225] Updated weights for policy 1, policy_version 432182 (0.0008) [2023-12-27 22:20:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 221011968. Throughput: 0: 9884.2, 1: 9867.7. Samples: 221006196. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:01,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-5.671')] [2023-12-27 22:20:01,189][106225] Updated weights for policy 1, policy_version 432192 (0.0009) [2023-12-27 22:20:01,254][106225] Updated weights for policy 1, policy_version 432202 (0.0009) [2023-12-27 22:20:01,406][106226] Updated weights for policy 0, policy_version 430930 (0.0009) [2023-12-27 22:20:01,464][106226] Updated weights for policy 0, policy_version 430940 (0.0009) [2023-12-27 22:20:01,531][106226] Updated weights for policy 0, policy_version 430950 (0.0006) [2023-12-27 22:20:01,988][106225] Updated weights for policy 1, policy_version 432212 (0.0008) [2023-12-27 22:20:02,036][106225] Updated weights for policy 1, policy_version 432222 (0.0008) [2023-12-27 22:20:02,084][106225] Updated weights for policy 1, policy_version 432232 (0.0009) [2023-12-27 22:20:02,299][106226] Updated weights for policy 0, policy_version 430960 (0.0009) [2023-12-27 22:20:02,367][106226] Updated weights for policy 0, policy_version 430970 (0.0008) [2023-12-27 22:20:02,438][106226] Updated weights for policy 0, policy_version 430980 (0.0009) [2023-12-27 22:20:02,849][106225] Updated weights for policy 1, policy_version 432242 (0.0008) [2023-12-27 22:20:02,901][106225] Updated weights for policy 1, policy_version 432252 (0.0008) [2023-12-27 22:20:02,950][106225] Updated weights for policy 1, policy_version 432262 (0.0008) [2023-12-27 22:20:03,010][106225] Updated weights for policy 1, policy_version 432272 (0.0008) [2023-12-27 22:20:03,110][106226] Updated weights for policy 0, policy_version 430990 (0.0008) [2023-12-27 22:20:03,176][106226] Updated weights for policy 0, policy_version 431000 (0.0009) [2023-12-27 22:20:03,233][106226] Updated weights for policy 0, policy_version 431010 (0.0009) [2023-12-27 22:20:03,752][106225] Updated weights for policy 1, policy_version 432282 (0.0005) [2023-12-27 22:20:03,812][106225] Updated weights for policy 1, policy_version 432292 (0.0005) [2023-12-27 22:20:03,886][106225] Updated weights for policy 1, policy_version 432302 (0.0008) [2023-12-27 22:20:03,963][106226] Updated weights for policy 0, policy_version 431020 (0.0008) [2023-12-27 22:20:04,031][106226] Updated weights for policy 0, policy_version 431030 (0.0008) [2023-12-27 22:20:04,095][106226] Updated weights for policy 0, policy_version 431040 (0.0009) [2023-12-27 22:20:04,538][106225] Updated weights for policy 1, policy_version 432312 (0.0008) [2023-12-27 22:20:04,583][106225] Updated weights for policy 1, policy_version 432322 (0.0008) [2023-12-27 22:20:04,632][106225] Updated weights for policy 1, policy_version 432332 (0.0009) [2023-12-27 22:20:04,829][106226] Updated weights for policy 0, policy_version 431050 (0.0009) [2023-12-27 22:20:04,891][106226] Updated weights for policy 0, policy_version 431060 (0.0009) [2023-12-27 22:20:04,956][106226] Updated weights for policy 0, policy_version 431070 (0.0008) [2023-12-27 22:20:05,023][106226] Updated weights for policy 0, policy_version 431080 (0.0009) [2023-12-27 22:20:05,298][106225] Updated weights for policy 1, policy_version 432342 (0.0008) [2023-12-27 22:20:05,346][106225] Updated weights for policy 1, policy_version 432352 (0.0008) [2023-12-27 22:20:05,398][106225] Updated weights for policy 1, policy_version 432362 (0.0008) [2023-12-27 22:20:05,743][106226] Updated weights for policy 0, policy_version 431090 (0.0008) [2023-12-27 22:20:05,802][106226] Updated weights for policy 0, policy_version 431100 (0.0009) [2023-12-27 22:20:05,864][106226] Updated weights for policy 0, policy_version 431110 (0.0009) [2023-12-27 22:20:06,092][106225] Updated weights for policy 1, policy_version 432372 (0.0008) [2023-12-27 22:20:06,152][106225] Updated weights for policy 1, policy_version 432382 (0.0007) [2023-12-27 22:20:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 221110272. Throughput: 0: 9808.2, 1: 9870.3. Samples: 221121756. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:06,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.432')] [2023-12-27 22:20:06,216][106225] Updated weights for policy 1, policy_version 432392 (0.0009) [2023-12-27 22:20:06,629][106226] Updated weights for policy 0, policy_version 431120 (0.0008) [2023-12-27 22:20:06,701][106226] Updated weights for policy 0, policy_version 431130 (0.0008) [2023-12-27 22:20:06,768][106226] Updated weights for policy 0, policy_version 431140 (0.0009) [2023-12-27 22:20:06,986][106225] Updated weights for policy 1, policy_version 432402 (0.0009) [2023-12-27 22:20:07,043][106225] Updated weights for policy 1, policy_version 432412 (0.0006) [2023-12-27 22:20:07,098][106225] Updated weights for policy 1, policy_version 432422 (0.0010) [2023-12-27 22:20:07,162][106225] Updated weights for policy 1, policy_version 432432 (0.0010) [2023-12-27 22:20:07,497][106226] Updated weights for policy 0, policy_version 431150 (0.0008) [2023-12-27 22:20:07,550][106226] Updated weights for policy 0, policy_version 431160 (0.0007) [2023-12-27 22:20:07,600][106226] Updated weights for policy 0, policy_version 431170 (0.0008) [2023-12-27 22:20:07,839][106225] Updated weights for policy 1, policy_version 432442 (0.0006) [2023-12-27 22:20:07,896][106225] Updated weights for policy 1, policy_version 432452 (0.0010) [2023-12-27 22:20:07,956][106225] Updated weights for policy 1, policy_version 432462 (0.0010) [2023-12-27 22:20:08,307][106226] Updated weights for policy 0, policy_version 431180 (0.0007) [2023-12-27 22:20:08,376][106226] Updated weights for policy 0, policy_version 431190 (0.0009) [2023-12-27 22:20:08,446][106226] Updated weights for policy 0, policy_version 431200 (0.0007) [2023-12-27 22:20:08,672][106225] Updated weights for policy 1, policy_version 432472 (0.0010) [2023-12-27 22:20:08,733][106225] Updated weights for policy 1, policy_version 432482 (0.0010) [2023-12-27 22:20:08,794][106225] Updated weights for policy 1, policy_version 432492 (0.0010) [2023-12-27 22:20:09,164][106226] Updated weights for policy 0, policy_version 431210 (0.0008) [2023-12-27 22:20:09,234][106226] Updated weights for policy 0, policy_version 431220 (0.0010) [2023-12-27 22:20:09,302][106226] Updated weights for policy 0, policy_version 431230 (0.0010) [2023-12-27 22:20:09,369][106226] Updated weights for policy 0, policy_version 431240 (0.0011) [2023-12-27 22:20:09,537][106225] Updated weights for policy 1, policy_version 432502 (0.0009) [2023-12-27 22:20:09,600][106225] Updated weights for policy 1, policy_version 432512 (0.0008) [2023-12-27 22:20:09,662][106225] Updated weights for policy 1, policy_version 432522 (0.0010) [2023-12-27 22:20:10,108][106226] Updated weights for policy 0, policy_version 431250 (0.0008) [2023-12-27 22:20:10,174][106226] Updated weights for policy 0, policy_version 431260 (0.0011) [2023-12-27 22:20:10,242][106226] Updated weights for policy 0, policy_version 431270 (0.0009) [2023-12-27 22:20:10,457][106225] Updated weights for policy 1, policy_version 432532 (0.0010) [2023-12-27 22:20:10,524][106225] Updated weights for policy 1, policy_version 432542 (0.0009) [2023-12-27 22:20:10,586][106225] Updated weights for policy 1, policy_version 432552 (0.0008) [2023-12-27 22:20:10,912][106226] Updated weights for policy 0, policy_version 431280 (0.0006) [2023-12-27 22:20:10,965][106226] Updated weights for policy 0, policy_version 431290 (0.0007) [2023-12-27 22:20:11,028][106226] Updated weights for policy 0, policy_version 431300 (0.0010) [2023-12-27 22:20:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 221208576. Throughput: 0: 9834.7, 1: 9895.6. Samples: 221179512. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:11,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-5.192')] [2023-12-27 22:20:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000432560_110764032.pth... [2023-12-27 22:20:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000431304_110444544.pth... [2023-12-27 22:20:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000431440_110477312.pth [2023-12-27 22:20:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000430152_110149632.pth [2023-12-27 22:20:11,402][106225] Updated weights for policy 1, policy_version 432562 (0.0008) [2023-12-27 22:20:11,465][106225] Updated weights for policy 1, policy_version 432572 (0.0008) [2023-12-27 22:20:11,523][106225] Updated weights for policy 1, policy_version 432582 (0.0008) [2023-12-27 22:20:11,575][106225] Updated weights for policy 1, policy_version 432592 (0.0008) [2023-12-27 22:20:11,818][106226] Updated weights for policy 0, policy_version 431310 (0.0010) [2023-12-27 22:20:11,881][106226] Updated weights for policy 0, policy_version 431320 (0.0008) [2023-12-27 22:20:11,944][106226] Updated weights for policy 0, policy_version 431330 (0.0008) [2023-12-27 22:20:12,395][106225] Updated weights for policy 1, policy_version 432602 (0.0009) [2023-12-27 22:20:12,460][106225] Updated weights for policy 1, policy_version 432612 (0.0008) [2023-12-27 22:20:12,520][106225] Updated weights for policy 1, policy_version 432622 (0.0008) [2023-12-27 22:20:12,724][106226] Updated weights for policy 0, policy_version 431340 (0.0008) [2023-12-27 22:20:12,790][106226] Updated weights for policy 0, policy_version 431350 (0.0008) [2023-12-27 22:20:12,845][106226] Updated weights for policy 0, policy_version 431360 (0.0007) [2023-12-27 22:20:13,229][106225] Updated weights for policy 1, policy_version 432632 (0.0010) [2023-12-27 22:20:13,282][106225] Updated weights for policy 1, policy_version 432642 (0.0008) [2023-12-27 22:20:13,330][106225] Updated weights for policy 1, policy_version 432652 (0.0005) [2023-12-27 22:20:13,623][106226] Updated weights for policy 0, policy_version 431370 (0.0008) [2023-12-27 22:20:13,672][106226] Updated weights for policy 0, policy_version 431380 (0.0009) [2023-12-27 22:20:13,727][106226] Updated weights for policy 0, policy_version 431390 (0.0009) [2023-12-27 22:20:13,781][106226] Updated weights for policy 0, policy_version 431400 (0.0008) [2023-12-27 22:20:13,886][106225] Updated weights for policy 1, policy_version 432662 (0.0008) [2023-12-27 22:20:13,938][106225] Updated weights for policy 1, policy_version 432672 (0.0006) [2023-12-27 22:20:13,992][106225] Updated weights for policy 1, policy_version 432682 (0.0005) [2023-12-27 22:20:14,583][106225] Updated weights for policy 1, policy_version 432692 (0.0005) [2023-12-27 22:20:14,615][106226] Updated weights for policy 0, policy_version 431410 (0.0009) [2023-12-27 22:20:14,643][106225] Updated weights for policy 1, policy_version 432702 (0.0007) [2023-12-27 22:20:14,672][106226] Updated weights for policy 0, policy_version 431420 (0.0006) [2023-12-27 22:20:14,699][106225] Updated weights for policy 1, policy_version 432712 (0.0010) [2023-12-27 22:20:14,729][106226] Updated weights for policy 0, policy_version 431430 (0.0006) [2023-12-27 22:20:15,361][106225] Updated weights for policy 1, policy_version 432722 (0.0007) [2023-12-27 22:20:15,422][106225] Updated weights for policy 1, policy_version 432732 (0.0008) [2023-12-27 22:20:15,486][106225] Updated weights for policy 1, policy_version 432742 (0.0008) [2023-12-27 22:20:15,520][106226] Updated weights for policy 0, policy_version 431440 (0.0006) [2023-12-27 22:20:15,538][106225] Updated weights for policy 1, policy_version 432752 (0.0007) [2023-12-27 22:20:15,569][106226] Updated weights for policy 0, policy_version 431450 (0.0007) [2023-12-27 22:20:15,631][106226] Updated weights for policy 0, policy_version 431460 (0.0008) [2023-12-27 22:20:16,169][106225] Updated weights for policy 1, policy_version 432762 (0.0005) [2023-12-27 22:20:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19522.0). Total num frames: 221298688. Throughput: 0: 9726.7, 1: 9831.8. Samples: 221291668. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:16,175][105115] Avg episode reward: [(0, '-4.982'), (1, '-5.657')] [2023-12-27 22:20:16,217][106225] Updated weights for policy 1, policy_version 432772 (0.0005) [2023-12-27 22:20:16,271][106225] Updated weights for policy 1, policy_version 432782 (0.0005) [2023-12-27 22:20:16,449][106226] Updated weights for policy 0, policy_version 431470 (0.0010) [2023-12-27 22:20:16,502][106226] Updated weights for policy 0, policy_version 431480 (0.0009) [2023-12-27 22:20:16,559][106226] Updated weights for policy 0, policy_version 431490 (0.0008) [2023-12-27 22:20:16,833][106225] Updated weights for policy 1, policy_version 432792 (0.0006) [2023-12-27 22:20:16,891][106225] Updated weights for policy 1, policy_version 432802 (0.0005) [2023-12-27 22:20:16,946][106225] Updated weights for policy 1, policy_version 432812 (0.0005) [2023-12-27 22:20:17,409][106226] Updated weights for policy 0, policy_version 431500 (0.0009) [2023-12-27 22:20:17,466][106225] Updated weights for policy 1, policy_version 432822 (0.0005) [2023-12-27 22:20:17,467][106226] Updated weights for policy 0, policy_version 431510 (0.0008) [2023-12-27 22:20:17,516][106226] Updated weights for policy 0, policy_version 431520 (0.0008) [2023-12-27 22:20:17,526][106225] Updated weights for policy 1, policy_version 432832 (0.0005) [2023-12-27 22:20:17,587][106225] Updated weights for policy 1, policy_version 432842 (0.0005) [2023-12-27 22:20:18,251][106225] Updated weights for policy 1, policy_version 432852 (0.0008) [2023-12-27 22:20:18,278][106226] Updated weights for policy 0, policy_version 431530 (0.0008) [2023-12-27 22:20:18,308][106225] Updated weights for policy 1, policy_version 432862 (0.0006) [2023-12-27 22:20:18,338][106226] Updated weights for policy 0, policy_version 431540 (0.0007) [2023-12-27 22:20:18,377][106225] Updated weights for policy 1, policy_version 432873 (0.0007) [2023-12-27 22:20:18,399][106226] Updated weights for policy 0, policy_version 431550 (0.0008) [2023-12-27 22:20:18,462][106226] Updated weights for policy 0, policy_version 431560 (0.0008) [2023-12-27 22:20:19,057][106225] Updated weights for policy 1, policy_version 432883 (0.0008) [2023-12-27 22:20:19,119][106225] Updated weights for policy 1, policy_version 432893 (0.0008) [2023-12-27 22:20:19,170][106225] Updated weights for policy 1, policy_version 432903 (0.0008) [2023-12-27 22:20:19,201][106226] Updated weights for policy 0, policy_version 431570 (0.0008) [2023-12-27 22:20:19,262][106226] Updated weights for policy 0, policy_version 431580 (0.0008) [2023-12-27 22:20:19,325][106226] Updated weights for policy 0, policy_version 431590 (0.0008) [2023-12-27 22:20:19,900][106225] Updated weights for policy 1, policy_version 432913 (0.0008) [2023-12-27 22:20:19,967][106225] Updated weights for policy 1, policy_version 432923 (0.0010) [2023-12-27 22:20:20,032][106225] Updated weights for policy 1, policy_version 432933 (0.0010) [2023-12-27 22:20:20,097][106225] Updated weights for policy 1, policy_version 432943 (0.0011) [2023-12-27 22:20:20,173][106226] Updated weights for policy 0, policy_version 431600 (0.0006) [2023-12-27 22:20:20,242][106226] Updated weights for policy 0, policy_version 431610 (0.0006) [2023-12-27 22:20:20,311][106226] Updated weights for policy 0, policy_version 431620 (0.0006) [2023-12-27 22:20:20,807][106225] Updated weights for policy 1, policy_version 432953 (0.0008) [2023-12-27 22:20:20,872][106225] Updated weights for policy 1, policy_version 432963 (0.0008) [2023-12-27 22:20:20,938][106225] Updated weights for policy 1, policy_version 432973 (0.0009) [2023-12-27 22:20:20,949][106226] Updated weights for policy 0, policy_version 431630 (0.0010) [2023-12-27 22:20:21,005][106226] Updated weights for policy 0, policy_version 431640 (0.0010) [2023-12-27 22:20:21,080][106226] Updated weights for policy 0, policy_version 431650 (0.0008) [2023-12-27 22:20:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 221405184. Throughput: 0: 9652.3, 1: 9908.2. Samples: 221409120. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:21,175][105115] Avg episode reward: [(0, '-5.083'), (1, '-5.281')] [2023-12-27 22:20:21,781][106225] Updated weights for policy 1, policy_version 432983 (0.0008) [2023-12-27 22:20:21,852][106225] Updated weights for policy 1, policy_version 432993 (0.0008) [2023-12-27 22:20:21,859][106226] Updated weights for policy 0, policy_version 431660 (0.0011) [2023-12-27 22:20:21,914][106225] Updated weights for policy 1, policy_version 433003 (0.0007) [2023-12-27 22:20:21,924][106226] Updated weights for policy 0, policy_version 431670 (0.0009) [2023-12-27 22:20:21,988][106226] Updated weights for policy 0, policy_version 431680 (0.0009) [2023-12-27 22:20:22,625][106226] Updated weights for policy 0, policy_version 431690 (0.0008) [2023-12-27 22:20:22,653][106225] Updated weights for policy 1, policy_version 433013 (0.0006) [2023-12-27 22:20:22,689][106226] Updated weights for policy 0, policy_version 431700 (0.0006) [2023-12-27 22:20:22,719][106225] Updated weights for policy 1, policy_version 433023 (0.0006) [2023-12-27 22:20:22,754][106226] Updated weights for policy 0, policy_version 431710 (0.0006) [2023-12-27 22:20:22,783][106225] Updated weights for policy 1, policy_version 433033 (0.0009) [2023-12-27 22:20:22,812][106226] Updated weights for policy 0, policy_version 431720 (0.0009) [2023-12-27 22:20:23,461][106226] Updated weights for policy 0, policy_version 431730 (0.0007) [2023-12-27 22:20:23,467][106225] Updated weights for policy 1, policy_version 433043 (0.0006) [2023-12-27 22:20:23,520][106226] Updated weights for policy 0, policy_version 431740 (0.0005) [2023-12-27 22:20:23,527][106225] Updated weights for policy 1, policy_version 433053 (0.0005) [2023-12-27 22:20:23,579][106226] Updated weights for policy 0, policy_version 431750 (0.0005) [2023-12-27 22:20:23,591][106225] Updated weights for policy 1, policy_version 433063 (0.0008) [2023-12-27 22:20:24,087][106226] Updated weights for policy 0, policy_version 431760 (0.0005) [2023-12-27 22:20:24,147][106226] Updated weights for policy 0, policy_version 431770 (0.0006) [2023-12-27 22:20:24,209][106226] Updated weights for policy 0, policy_version 431780 (0.0007) [2023-12-27 22:20:24,387][106225] Updated weights for policy 1, policy_version 433073 (0.0010) [2023-12-27 22:20:24,444][106225] Updated weights for policy 1, policy_version 433083 (0.0008) [2023-12-27 22:20:24,504][106225] Updated weights for policy 1, policy_version 433093 (0.0007) [2023-12-27 22:20:24,557][106225] Updated weights for policy 1, policy_version 433104 (0.0008) [2023-12-27 22:20:24,805][106226] Updated weights for policy 0, policy_version 431790 (0.0011) [2023-12-27 22:20:24,862][106226] Updated weights for policy 0, policy_version 431800 (0.0010) [2023-12-27 22:20:24,912][106226] Updated weights for policy 0, policy_version 431810 (0.0010) [2023-12-27 22:20:25,205][106225] Updated weights for policy 1, policy_version 433114 (0.0008) [2023-12-27 22:20:25,253][106225] Updated weights for policy 1, policy_version 433124 (0.0006) [2023-12-27 22:20:25,308][106225] Updated weights for policy 1, policy_version 433134 (0.0005) [2023-12-27 22:20:25,634][106226] Updated weights for policy 0, policy_version 431820 (0.0011) [2023-12-27 22:20:25,684][106226] Updated weights for policy 0, policy_version 431830 (0.0011) [2023-12-27 22:20:25,732][106226] Updated weights for policy 0, policy_version 431840 (0.0010) [2023-12-27 22:20:25,968][106225] Updated weights for policy 1, policy_version 433144 (0.0008) [2023-12-27 22:20:26,032][106225] Updated weights for policy 1, policy_version 433154 (0.0008) [2023-12-27 22:20:26,098][106225] Updated weights for policy 1, policy_version 433164 (0.0009) [2023-12-27 22:20:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19521.9). Total num frames: 221503488. Throughput: 0: 9686.4, 1: 9868.8. Samples: 221468164. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:26,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.545')] [2023-12-27 22:20:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000433168_110919680.pth... [2023-12-27 22:20:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000431848_110583808.pth... [2023-12-27 22:20:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000432016_110624768.pth [2023-12-27 22:20:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000430728_110297088.pth [2023-12-27 22:20:26,438][106226] Updated weights for policy 0, policy_version 431850 (0.0010) [2023-12-27 22:20:26,502][106226] Updated weights for policy 0, policy_version 431860 (0.0010) [2023-12-27 22:20:26,562][106226] Updated weights for policy 0, policy_version 431870 (0.0009) [2023-12-27 22:20:26,623][106226] Updated weights for policy 0, policy_version 431880 (0.0009) [2023-12-27 22:20:26,782][106225] Updated weights for policy 1, policy_version 433174 (0.0009) [2023-12-27 22:20:26,840][106225] Updated weights for policy 1, policy_version 433184 (0.0009) [2023-12-27 22:20:26,886][106225] Updated weights for policy 1, policy_version 433194 (0.0007) [2023-12-27 22:20:27,331][106226] Updated weights for policy 0, policy_version 431890 (0.0007) [2023-12-27 22:20:27,383][106226] Updated weights for policy 0, policy_version 431900 (0.0009) [2023-12-27 22:20:27,426][106226] Updated weights for policy 0, policy_version 431910 (0.0008) [2023-12-27 22:20:27,532][106225] Updated weights for policy 1, policy_version 433204 (0.0007) [2023-12-27 22:20:27,592][106225] Updated weights for policy 1, policy_version 433214 (0.0008) [2023-12-27 22:20:27,650][106225] Updated weights for policy 1, policy_version 433224 (0.0009) [2023-12-27 22:20:28,146][106226] Updated weights for policy 0, policy_version 431920 (0.0008) [2023-12-27 22:20:28,196][106226] Updated weights for policy 0, policy_version 431930 (0.0009) [2023-12-27 22:20:28,254][106226] Updated weights for policy 0, policy_version 431940 (0.0009) [2023-12-27 22:20:28,292][106225] Updated weights for policy 1, policy_version 433234 (0.0007) [2023-12-27 22:20:28,359][106225] Updated weights for policy 1, policy_version 433244 (0.0008) [2023-12-27 22:20:28,425][106225] Updated weights for policy 1, policy_version 433254 (0.0009) [2023-12-27 22:20:28,492][106225] Updated weights for policy 1, policy_version 433264 (0.0009) [2023-12-27 22:20:29,063][106226] Updated weights for policy 0, policy_version 431950 (0.0008) [2023-12-27 22:20:29,085][106225] Updated weights for policy 1, policy_version 433274 (0.0007) [2023-12-27 22:20:29,113][106226] Updated weights for policy 0, policy_version 431960 (0.0008) [2023-12-27 22:20:29,131][106225] Updated weights for policy 1, policy_version 433284 (0.0005) [2023-12-27 22:20:29,164][106226] Updated weights for policy 0, policy_version 431970 (0.0007) [2023-12-27 22:20:29,174][106225] Updated weights for policy 1, policy_version 433294 (0.0005) [2023-12-27 22:20:29,844][106226] Updated weights for policy 0, policy_version 431980 (0.0007) [2023-12-27 22:20:29,907][106226] Updated weights for policy 0, policy_version 431990 (0.0006) [2023-12-27 22:20:29,972][106226] Updated weights for policy 0, policy_version 432000 (0.0008) [2023-12-27 22:20:30,043][106225] Updated weights for policy 1, policy_version 433304 (0.0007) [2023-12-27 22:20:30,102][106225] Updated weights for policy 1, policy_version 433314 (0.0008) [2023-12-27 22:20:30,163][106225] Updated weights for policy 1, policy_version 433324 (0.0010) [2023-12-27 22:20:30,638][106226] Updated weights for policy 0, policy_version 432010 (0.0009) [2023-12-27 22:20:30,697][106226] Updated weights for policy 0, policy_version 432020 (0.0005) [2023-12-27 22:20:30,753][106226] Updated weights for policy 0, policy_version 432030 (0.0006) [2023-12-27 22:20:30,809][106226] Updated weights for policy 0, policy_version 432040 (0.0006) [2023-12-27 22:20:30,926][106225] Updated weights for policy 1, policy_version 433334 (0.0008) [2023-12-27 22:20:30,981][106225] Updated weights for policy 1, policy_version 433344 (0.0008) [2023-12-27 22:20:31,032][106225] Updated weights for policy 1, policy_version 433354 (0.0008) [2023-12-27 22:20:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 221601792. Throughput: 0: 9708.9, 1: 9918.8. Samples: 221588392. Policy #0 lag: (min: 18.0, avg: 32.7, max: 50.0) [2023-12-27 22:20:31,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.441')] [2023-12-27 22:20:31,409][106226] Updated weights for policy 0, policy_version 432050 (0.0009) [2023-12-27 22:20:31,478][106226] Updated weights for policy 0, policy_version 432060 (0.0006) [2023-12-27 22:20:31,550][106226] Updated weights for policy 0, policy_version 432070 (0.0007) [2023-12-27 22:20:31,850][106225] Updated weights for policy 1, policy_version 433364 (0.0008) [2023-12-27 22:20:31,903][106225] Updated weights for policy 1, policy_version 433374 (0.0008) [2023-12-27 22:20:31,949][106225] Updated weights for policy 1, policy_version 433384 (0.0007) [2023-12-27 22:20:32,235][106226] Updated weights for policy 0, policy_version 432080 (0.0008) [2023-12-27 22:20:32,304][106226] Updated weights for policy 0, policy_version 432090 (0.0008) [2023-12-27 22:20:32,375][106226] Updated weights for policy 0, policy_version 432100 (0.0007) [2023-12-27 22:20:32,693][106225] Updated weights for policy 1, policy_version 433394 (0.0008) [2023-12-27 22:20:32,756][106225] Updated weights for policy 1, policy_version 433404 (0.0010) [2023-12-27 22:20:32,820][106225] Updated weights for policy 1, policy_version 433414 (0.0005) [2023-12-27 22:20:32,882][106225] Updated weights for policy 1, policy_version 433424 (0.0006) [2023-12-27 22:20:33,058][106226] Updated weights for policy 0, policy_version 432110 (0.0007) [2023-12-27 22:20:33,105][106226] Updated weights for policy 0, policy_version 432120 (0.0008) [2023-12-27 22:20:33,170][106226] Updated weights for policy 0, policy_version 432130 (0.0007) [2023-12-27 22:20:33,437][106225] Updated weights for policy 1, policy_version 433434 (0.0005) [2023-12-27 22:20:33,500][106225] Updated weights for policy 1, policy_version 433444 (0.0005) [2023-12-27 22:20:33,568][106225] Updated weights for policy 1, policy_version 433454 (0.0007) [2023-12-27 22:20:33,778][106226] Updated weights for policy 0, policy_version 432140 (0.0007) [2023-12-27 22:20:33,841][106226] Updated weights for policy 0, policy_version 432150 (0.0008) [2023-12-27 22:20:33,906][106226] Updated weights for policy 0, policy_version 432160 (0.0010) [2023-12-27 22:20:34,208][106225] Updated weights for policy 1, policy_version 433464 (0.0007) [2023-12-27 22:20:34,270][106225] Updated weights for policy 1, policy_version 433474 (0.0006) [2023-12-27 22:20:34,323][106225] Updated weights for policy 1, policy_version 433484 (0.0007) [2023-12-27 22:20:34,785][106226] Updated weights for policy 0, policy_version 432170 (0.0008) [2023-12-27 22:20:34,850][106226] Updated weights for policy 0, policy_version 432180 (0.0009) [2023-12-27 22:20:34,903][106226] Updated weights for policy 0, policy_version 432190 (0.0008) [2023-12-27 22:20:34,948][106225] Updated weights for policy 1, policy_version 433494 (0.0006) [2023-12-27 22:20:34,964][106226] Updated weights for policy 0, policy_version 432200 (0.0008) [2023-12-27 22:20:35,010][106225] Updated weights for policy 1, policy_version 433504 (0.0005) [2023-12-27 22:20:35,072][106225] Updated weights for policy 1, policy_version 433514 (0.0008) [2023-12-27 22:20:35,716][106226] Updated weights for policy 0, policy_version 432210 (0.0008) [2023-12-27 22:20:35,754][106225] Updated weights for policy 1, policy_version 433524 (0.0008) [2023-12-27 22:20:35,771][106226] Updated weights for policy 0, policy_version 432220 (0.0008) [2023-12-27 22:20:35,821][106225] Updated weights for policy 1, policy_version 433534 (0.0006) [2023-12-27 22:20:35,836][106226] Updated weights for policy 0, policy_version 432230 (0.0009) [2023-12-27 22:20:35,878][106225] Updated weights for policy 1, policy_version 433544 (0.0006) [2023-12-27 22:20:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 221700096. Throughput: 0: 9656.1, 1: 9929.7. Samples: 221706680. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:20:36,175][105115] Avg episode reward: [(0, '-5.027'), (1, '-5.674')] [2023-12-27 22:20:36,561][106226] Updated weights for policy 0, policy_version 432240 (0.0010) [2023-12-27 22:20:36,575][106225] Updated weights for policy 1, policy_version 433554 (0.0008) [2023-12-27 22:20:36,623][106226] Updated weights for policy 0, policy_version 432250 (0.0011) [2023-12-27 22:20:36,640][106225] Updated weights for policy 1, policy_version 433564 (0.0009) [2023-12-27 22:20:36,684][106226] Updated weights for policy 0, policy_version 432260 (0.0011) [2023-12-27 22:20:36,694][106225] Updated weights for policy 1, policy_version 433574 (0.0006) [2023-12-27 22:20:36,760][106225] Updated weights for policy 1, policy_version 433584 (0.0006) [2023-12-27 22:20:37,345][106225] Updated weights for policy 1, policy_version 433595 (0.0006) [2023-12-27 22:20:37,415][106225] Updated weights for policy 1, policy_version 433605 (0.0006) [2023-12-27 22:20:37,422][106226] Updated weights for policy 0, policy_version 432270 (0.0007) [2023-12-27 22:20:37,481][106225] Updated weights for policy 1, policy_version 433615 (0.0008) [2023-12-27 22:20:37,487][106226] Updated weights for policy 0, policy_version 432280 (0.0007) [2023-12-27 22:20:37,546][106226] Updated weights for policy 0, policy_version 432290 (0.0008) [2023-12-27 22:20:38,076][106225] Updated weights for policy 1, policy_version 433625 (0.0010) [2023-12-27 22:20:38,139][106225] Updated weights for policy 1, policy_version 433635 (0.0010) [2023-12-27 22:20:38,195][106225] Updated weights for policy 1, policy_version 433645 (0.0010) [2023-12-27 22:20:38,275][106226] Updated weights for policy 0, policy_version 432300 (0.0007) [2023-12-27 22:20:38,335][106226] Updated weights for policy 0, policy_version 432310 (0.0008) [2023-12-27 22:20:38,403][106226] Updated weights for policy 0, policy_version 432320 (0.0008) [2023-12-27 22:20:38,874][106225] Updated weights for policy 1, policy_version 433655 (0.0010) [2023-12-27 22:20:38,928][106225] Updated weights for policy 1, policy_version 433665 (0.0010) [2023-12-27 22:20:38,979][106225] Updated weights for policy 1, policy_version 433675 (0.0010) [2023-12-27 22:20:39,193][106226] Updated weights for policy 0, policy_version 432330 (0.0009) [2023-12-27 22:20:39,262][106226] Updated weights for policy 0, policy_version 432340 (0.0009) [2023-12-27 22:20:39,323][106226] Updated weights for policy 0, policy_version 432350 (0.0008) [2023-12-27 22:20:39,399][106226] Updated weights for policy 0, policy_version 432360 (0.0009) [2023-12-27 22:20:39,743][106225] Updated weights for policy 1, policy_version 433685 (0.0010) [2023-12-27 22:20:39,809][106225] Updated weights for policy 1, policy_version 433695 (0.0007) [2023-12-27 22:20:39,879][106225] Updated weights for policy 1, policy_version 433705 (0.0007) [2023-12-27 22:20:40,173][106226] Updated weights for policy 0, policy_version 432370 (0.0009) [2023-12-27 22:20:40,243][106226] Updated weights for policy 0, policy_version 432380 (0.0007) [2023-12-27 22:20:40,311][106226] Updated weights for policy 0, policy_version 432390 (0.0007) [2023-12-27 22:20:40,555][106225] Updated weights for policy 1, policy_version 433715 (0.0007) [2023-12-27 22:20:40,624][106225] Updated weights for policy 1, policy_version 433725 (0.0008) [2023-12-27 22:20:40,695][106225] Updated weights for policy 1, policy_version 433735 (0.0010) [2023-12-27 22:20:40,918][106226] Updated weights for policy 0, policy_version 432400 (0.0006) [2023-12-27 22:20:40,980][106226] Updated weights for policy 0, policy_version 432410 (0.0006) [2023-12-27 22:20:41,048][106226] Updated weights for policy 0, policy_version 432420 (0.0007) [2023-12-27 22:20:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19577.5). Total num frames: 221798400. Throughput: 0: 9561.2, 1: 10022.2. Samples: 221766128. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:20:41,175][105115] Avg episode reward: [(0, '-4.898'), (1, '-5.222')] [2023-12-27 22:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000433744_111067136.pth... [2023-12-27 22:20:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000432424_110731264.pth... [2023-12-27 22:20:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000432560_110764032.pth [2023-12-27 22:20:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000431304_110444544.pth [2023-12-27 22:20:41,468][106225] Updated weights for policy 1, policy_version 433745 (0.0008) [2023-12-27 22:20:41,531][106225] Updated weights for policy 1, policy_version 433755 (0.0009) [2023-12-27 22:20:41,592][106225] Updated weights for policy 1, policy_version 433765 (0.0010) [2023-12-27 22:20:41,665][106225] Updated weights for policy 1, policy_version 433775 (0.0009) [2023-12-27 22:20:41,890][106226] Updated weights for policy 0, policy_version 432430 (0.0007) [2023-12-27 22:20:41,954][106226] Updated weights for policy 0, policy_version 432440 (0.0008) [2023-12-27 22:20:42,012][106226] Updated weights for policy 0, policy_version 432450 (0.0008) [2023-12-27 22:20:42,454][106225] Updated weights for policy 1, policy_version 433785 (0.0010) [2023-12-27 22:20:42,517][106225] Updated weights for policy 1, policy_version 433795 (0.0011) [2023-12-27 22:20:42,579][106225] Updated weights for policy 1, policy_version 433805 (0.0010) [2023-12-27 22:20:42,845][106226] Updated weights for policy 0, policy_version 432460 (0.0008) [2023-12-27 22:20:42,896][106226] Updated weights for policy 0, policy_version 432470 (0.0008) [2023-12-27 22:20:42,955][106226] Updated weights for policy 0, policy_version 432480 (0.0009) [2023-12-27 22:20:43,197][106225] Updated weights for policy 1, policy_version 433815 (0.0008) [2023-12-27 22:20:43,261][106225] Updated weights for policy 1, policy_version 433825 (0.0008) [2023-12-27 22:20:43,325][106225] Updated weights for policy 1, policy_version 433835 (0.0008) [2023-12-27 22:20:43,751][106226] Updated weights for policy 0, policy_version 432490 (0.0008) [2023-12-27 22:20:43,815][106226] Updated weights for policy 0, policy_version 432500 (0.0008) [2023-12-27 22:20:43,883][106226] Updated weights for policy 0, policy_version 432510 (0.0011) [2023-12-27 22:20:43,899][106225] Updated weights for policy 1, policy_version 433845 (0.0006) [2023-12-27 22:20:43,951][106226] Updated weights for policy 0, policy_version 432520 (0.0011) [2023-12-27 22:20:43,966][106225] Updated weights for policy 1, policy_version 433855 (0.0008) [2023-12-27 22:20:44,031][106225] Updated weights for policy 1, policy_version 433865 (0.0007) [2023-12-27 22:20:44,624][106225] Updated weights for policy 1, policy_version 433875 (0.0005) [2023-12-27 22:20:44,627][106226] Updated weights for policy 0, policy_version 432530 (0.0011) [2023-12-27 22:20:44,673][106226] Updated weights for policy 0, policy_version 432540 (0.0010) [2023-12-27 22:20:44,675][106225] Updated weights for policy 1, policy_version 433885 (0.0005) [2023-12-27 22:20:44,723][106226] Updated weights for policy 0, policy_version 432550 (0.0010) [2023-12-27 22:20:44,729][106225] Updated weights for policy 1, policy_version 433895 (0.0005) [2023-12-27 22:20:45,469][106226] Updated weights for policy 0, policy_version 432560 (0.0007) [2023-12-27 22:20:45,503][106225] Updated weights for policy 1, policy_version 433905 (0.0008) [2023-12-27 22:20:45,539][106226] Updated weights for policy 0, policy_version 432570 (0.0009) [2023-12-27 22:20:45,571][106225] Updated weights for policy 1, policy_version 433915 (0.0009) [2023-12-27 22:20:45,601][106226] Updated weights for policy 0, policy_version 432580 (0.0009) [2023-12-27 22:20:45,634][106225] Updated weights for policy 1, policy_version 433925 (0.0006) [2023-12-27 22:20:45,700][106225] Updated weights for policy 1, policy_version 433935 (0.0007) [2023-12-27 22:20:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 221888512. Throughput: 0: 9477.7, 1: 9976.9. Samples: 221881652. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:20:46,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.123')] [2023-12-27 22:20:46,258][106226] Updated weights for policy 0, policy_version 432590 (0.0009) [2023-12-27 22:20:46,322][106226] Updated weights for policy 0, policy_version 432600 (0.0010) [2023-12-27 22:20:46,382][106226] Updated weights for policy 0, policy_version 432610 (0.0010) [2023-12-27 22:20:46,396][106225] Updated weights for policy 1, policy_version 433945 (0.0005) [2023-12-27 22:20:46,455][106225] Updated weights for policy 1, policy_version 433955 (0.0007) [2023-12-27 22:20:46,514][106225] Updated weights for policy 1, policy_version 433965 (0.0007) [2023-12-27 22:20:47,017][106226] Updated weights for policy 0, policy_version 432620 (0.0010) [2023-12-27 22:20:47,064][106226] Updated weights for policy 0, policy_version 432630 (0.0010) [2023-12-27 22:20:47,114][106226] Updated weights for policy 0, policy_version 432640 (0.0010) [2023-12-27 22:20:47,123][106225] Updated weights for policy 1, policy_version 433975 (0.0006) [2023-12-27 22:20:47,187][106225] Updated weights for policy 1, policy_version 433985 (0.0006) [2023-12-27 22:20:47,258][106225] Updated weights for policy 1, policy_version 433995 (0.0005) [2023-12-27 22:20:47,816][106226] Updated weights for policy 0, policy_version 432650 (0.0009) [2023-12-27 22:20:47,855][106225] Updated weights for policy 1, policy_version 434005 (0.0007) [2023-12-27 22:20:47,883][106226] Updated weights for policy 0, policy_version 432660 (0.0010) [2023-12-27 22:20:47,923][106225] Updated weights for policy 1, policy_version 434015 (0.0009) [2023-12-27 22:20:47,941][106226] Updated weights for policy 0, policy_version 432670 (0.0007) [2023-12-27 22:20:47,988][106225] Updated weights for policy 1, policy_version 434025 (0.0009) [2023-12-27 22:20:48,000][106226] Updated weights for policy 0, policy_version 432680 (0.0008) [2023-12-27 22:20:48,693][106225] Updated weights for policy 1, policy_version 434035 (0.0008) [2023-12-27 22:20:48,708][106226] Updated weights for policy 0, policy_version 432690 (0.0009) [2023-12-27 22:20:48,756][106225] Updated weights for policy 1, policy_version 434045 (0.0006) [2023-12-27 22:20:48,770][106226] Updated weights for policy 0, policy_version 432700 (0.0008) [2023-12-27 22:20:48,814][106225] Updated weights for policy 1, policy_version 434055 (0.0006) [2023-12-27 22:20:48,833][106226] Updated weights for policy 0, policy_version 432710 (0.0008) [2023-12-27 22:20:49,425][106225] Updated weights for policy 1, policy_version 434065 (0.0006) [2023-12-27 22:20:49,479][106225] Updated weights for policy 1, policy_version 434075 (0.0007) [2023-12-27 22:20:49,539][106225] Updated weights for policy 1, policy_version 434085 (0.0005) [2023-12-27 22:20:49,598][106225] Updated weights for policy 1, policy_version 434095 (0.0008) [2023-12-27 22:20:49,726][106226] Updated weights for policy 0, policy_version 432720 (0.0010) [2023-12-27 22:20:49,786][106226] Updated weights for policy 0, policy_version 432730 (0.0010) [2023-12-27 22:20:49,850][106226] Updated weights for policy 0, policy_version 432740 (0.0011) [2023-12-27 22:20:50,342][106225] Updated weights for policy 1, policy_version 434105 (0.0008) [2023-12-27 22:20:50,400][106225] Updated weights for policy 1, policy_version 434115 (0.0008) [2023-12-27 22:20:50,463][106225] Updated weights for policy 1, policy_version 434125 (0.0006) [2023-12-27 22:20:50,622][106226] Updated weights for policy 0, policy_version 432750 (0.0008) [2023-12-27 22:20:50,690][106226] Updated weights for policy 0, policy_version 432760 (0.0008) [2023-12-27 22:20:50,759][106226] Updated weights for policy 0, policy_version 432770 (0.0009) [2023-12-27 22:20:51,162][106225] Updated weights for policy 1, policy_version 434135 (0.0008) [2023-12-27 22:20:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 221986816. Throughput: 0: 9481.4, 1: 10016.7. Samples: 221999172. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:20:51,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-5.295')] [2023-12-27 22:20:51,224][106225] Updated weights for policy 1, policy_version 434145 (0.0009) [2023-12-27 22:20:51,292][106225] Updated weights for policy 1, policy_version 434155 (0.0009) [2023-12-27 22:20:51,543][106226] Updated weights for policy 0, policy_version 432780 (0.0009) [2023-12-27 22:20:51,612][106226] Updated weights for policy 0, policy_version 432790 (0.0008) [2023-12-27 22:20:51,681][106226] Updated weights for policy 0, policy_version 432800 (0.0009) [2023-12-27 22:20:51,995][106225] Updated weights for policy 1, policy_version 434165 (0.0008) [2023-12-27 22:20:52,060][106225] Updated weights for policy 1, policy_version 434175 (0.0008) [2023-12-27 22:20:52,122][106225] Updated weights for policy 1, policy_version 434185 (0.0008) [2023-12-27 22:20:52,469][106226] Updated weights for policy 0, policy_version 432810 (0.0008) [2023-12-27 22:20:52,532][106226] Updated weights for policy 0, policy_version 432820 (0.0008) [2023-12-27 22:20:52,596][106226] Updated weights for policy 0, policy_version 432830 (0.0008) [2023-12-27 22:20:52,661][106226] Updated weights for policy 0, policy_version 432840 (0.0009) [2023-12-27 22:20:52,821][106225] Updated weights for policy 1, policy_version 434195 (0.0008) [2023-12-27 22:20:52,889][106225] Updated weights for policy 1, policy_version 434205 (0.0008) [2023-12-27 22:20:52,955][106225] Updated weights for policy 1, policy_version 434215 (0.0007) [2023-12-27 22:20:53,329][106226] Updated weights for policy 0, policy_version 432850 (0.0005) [2023-12-27 22:20:53,378][106226] Updated weights for policy 0, policy_version 432860 (0.0005) [2023-12-27 22:20:53,432][106226] Updated weights for policy 0, policy_version 432870 (0.0005) [2023-12-27 22:20:53,715][106225] Updated weights for policy 1, policy_version 434225 (0.0007) [2023-12-27 22:20:53,773][106225] Updated weights for policy 1, policy_version 434235 (0.0005) [2023-12-27 22:20:53,835][106225] Updated weights for policy 1, policy_version 434245 (0.0008) [2023-12-27 22:20:53,897][106225] Updated weights for policy 1, policy_version 434255 (0.0009) [2023-12-27 22:20:53,998][106226] Updated weights for policy 0, policy_version 432880 (0.0008) [2023-12-27 22:20:54,058][106226] Updated weights for policy 0, policy_version 432890 (0.0008) [2023-12-27 22:20:54,120][106226] Updated weights for policy 0, policy_version 432900 (0.0005) [2023-12-27 22:20:54,633][106225] Updated weights for policy 1, policy_version 434265 (0.0009) [2023-12-27 22:20:54,687][106225] Updated weights for policy 1, policy_version 434275 (0.0010) [2023-12-27 22:20:54,742][106225] Updated weights for policy 1, policy_version 434285 (0.0009) [2023-12-27 22:20:54,761][106226] Updated weights for policy 0, policy_version 432910 (0.0006) [2023-12-27 22:20:54,820][106226] Updated weights for policy 0, policy_version 432920 (0.0008) [2023-12-27 22:20:54,875][106226] Updated weights for policy 0, policy_version 432930 (0.0011) [2023-12-27 22:20:55,486][106225] Updated weights for policy 1, policy_version 434295 (0.0008) [2023-12-27 22:20:55,545][106225] Updated weights for policy 1, policy_version 434305 (0.0008) [2023-12-27 22:20:55,588][106226] Updated weights for policy 0, policy_version 432940 (0.0009) [2023-12-27 22:20:55,594][106225] Updated weights for policy 1, policy_version 434315 (0.0006) [2023-12-27 22:20:55,648][106226] Updated weights for policy 0, policy_version 432950 (0.0007) [2023-12-27 22:20:55,699][106226] Updated weights for policy 0, policy_version 432961 (0.0006) [2023-12-27 22:20:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 222085120. Throughput: 0: 9504.2, 1: 10012.9. Samples: 222057780. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:20:56,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-5.565')] [2023-12-27 22:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000434320_111214592.pth... [2023-12-27 22:20:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000432968_110870528.pth... [2023-12-27 22:20:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000433168_110919680.pth [2023-12-27 22:20:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000431848_110583808.pth [2023-12-27 22:20:56,342][106226] Updated weights for policy 0, policy_version 432971 (0.0005) [2023-12-27 22:20:56,368][106225] Updated weights for policy 1, policy_version 434325 (0.0007) [2023-12-27 22:20:56,402][106226] Updated weights for policy 0, policy_version 432981 (0.0006) [2023-12-27 22:20:56,417][106225] Updated weights for policy 1, policy_version 434335 (0.0006) [2023-12-27 22:20:56,456][106226] Updated weights for policy 0, policy_version 432991 (0.0008) [2023-12-27 22:20:56,475][106225] Updated weights for policy 1, policy_version 434345 (0.0007) [2023-12-27 22:20:57,021][106226] Updated weights for policy 0, policy_version 433001 (0.0006) [2023-12-27 22:20:57,080][106226] Updated weights for policy 0, policy_version 433011 (0.0008) [2023-12-27 22:20:57,131][106226] Updated weights for policy 0, policy_version 433021 (0.0005) [2023-12-27 22:20:57,191][106226] Updated weights for policy 0, policy_version 433031 (0.0005) [2023-12-27 22:20:57,289][106225] Updated weights for policy 1, policy_version 434356 (0.0009) [2023-12-27 22:20:57,343][106225] Updated weights for policy 1, policy_version 434366 (0.0009) [2023-12-27 22:20:57,388][106225] Updated weights for policy 1, policy_version 434376 (0.0008) [2023-12-27 22:20:57,832][106226] Updated weights for policy 0, policy_version 433041 (0.0008) [2023-12-27 22:20:57,889][106226] Updated weights for policy 0, policy_version 433051 (0.0009) [2023-12-27 22:20:57,944][106226] Updated weights for policy 0, policy_version 433061 (0.0008) [2023-12-27 22:20:58,126][106225] Updated weights for policy 1, policy_version 434386 (0.0007) [2023-12-27 22:20:58,184][106225] Updated weights for policy 1, policy_version 434396 (0.0005) [2023-12-27 22:20:58,251][106225] Updated weights for policy 1, policy_version 434406 (0.0008) [2023-12-27 22:20:58,309][106225] Updated weights for policy 1, policy_version 434416 (0.0008) [2023-12-27 22:20:58,691][106226] Updated weights for policy 0, policy_version 433071 (0.0008) [2023-12-27 22:20:58,758][106226] Updated weights for policy 0, policy_version 433081 (0.0007) [2023-12-27 22:20:58,828][106226] Updated weights for policy 0, policy_version 433091 (0.0012) [2023-12-27 22:20:59,166][106225] Updated weights for policy 1, policy_version 434426 (0.0011) [2023-12-27 22:20:59,258][106225] Updated weights for policy 1, policy_version 434436 (0.0009) [2023-12-27 22:20:59,325][106225] Updated weights for policy 1, policy_version 434446 (0.0009) [2023-12-27 22:20:59,708][106226] Updated weights for policy 0, policy_version 433101 (0.0007) [2023-12-27 22:20:59,762][106226] Updated weights for policy 0, policy_version 433111 (0.0008) [2023-12-27 22:20:59,812][106226] Updated weights for policy 0, policy_version 433121 (0.0009) [2023-12-27 22:21:00,011][106225] Updated weights for policy 1, policy_version 434456 (0.0007) [2023-12-27 22:21:00,070][106225] Updated weights for policy 1, policy_version 434466 (0.0007) [2023-12-27 22:21:00,129][106225] Updated weights for policy 1, policy_version 434476 (0.0007) [2023-12-27 22:21:00,538][106226] Updated weights for policy 0, policy_version 433131 (0.0008) [2023-12-27 22:21:00,602][106226] Updated weights for policy 0, policy_version 433141 (0.0008) [2023-12-27 22:21:00,656][106226] Updated weights for policy 0, policy_version 433151 (0.0007) [2023-12-27 22:21:00,863][106225] Updated weights for policy 1, policy_version 434486 (0.0009) [2023-12-27 22:21:00,919][106225] Updated weights for policy 1, policy_version 434496 (0.0010) [2023-12-27 22:21:00,969][106225] Updated weights for policy 1, policy_version 434506 (0.0010) [2023-12-27 22:21:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 222183424. Throughput: 0: 9630.7, 1: 9932.1. Samples: 222171992. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:01,175][105115] Avg episode reward: [(0, '-5.087'), (1, '-5.423')] [2023-12-27 22:21:01,441][106226] Updated weights for policy 0, policy_version 433161 (0.0008) [2023-12-27 22:21:01,506][106226] Updated weights for policy 0, policy_version 433171 (0.0006) [2023-12-27 22:21:01,571][106226] Updated weights for policy 0, policy_version 433181 (0.0006) [2023-12-27 22:21:01,639][106226] Updated weights for policy 0, policy_version 433191 (0.0007) [2023-12-27 22:21:01,706][106225] Updated weights for policy 1, policy_version 434516 (0.0009) [2023-12-27 22:21:01,774][106225] Updated weights for policy 1, policy_version 434526 (0.0008) [2023-12-27 22:21:01,836][106225] Updated weights for policy 1, policy_version 434536 (0.0008) [2023-12-27 22:21:02,339][106226] Updated weights for policy 0, policy_version 433201 (0.0008) [2023-12-27 22:21:02,400][106226] Updated weights for policy 0, policy_version 433211 (0.0009) [2023-12-27 22:21:02,461][106226] Updated weights for policy 0, policy_version 433221 (0.0009) [2023-12-27 22:21:02,603][106225] Updated weights for policy 1, policy_version 434546 (0.0008) [2023-12-27 22:21:02,657][106225] Updated weights for policy 1, policy_version 434556 (0.0005) [2023-12-27 22:21:02,717][106225] Updated weights for policy 1, policy_version 434566 (0.0006) [2023-12-27 22:21:02,783][106225] Updated weights for policy 1, policy_version 434576 (0.0008) [2023-12-27 22:21:03,205][106226] Updated weights for policy 0, policy_version 433231 (0.0009) [2023-12-27 22:21:03,266][106226] Updated weights for policy 0, policy_version 433241 (0.0009) [2023-12-27 22:21:03,330][106226] Updated weights for policy 0, policy_version 433251 (0.0009) [2023-12-27 22:21:03,364][106225] Updated weights for policy 1, policy_version 434586 (0.0006) [2023-12-27 22:21:03,422][106225] Updated weights for policy 1, policy_version 434596 (0.0008) [2023-12-27 22:21:03,469][106225] Updated weights for policy 1, policy_version 434606 (0.0008) [2023-12-27 22:21:04,047][106226] Updated weights for policy 0, policy_version 433261 (0.0008) [2023-12-27 22:21:04,111][106226] Updated weights for policy 0, policy_version 433271 (0.0009) [2023-12-27 22:21:04,176][106226] Updated weights for policy 0, policy_version 433281 (0.0008) [2023-12-27 22:21:04,252][106225] Updated weights for policy 1, policy_version 434616 (0.0007) [2023-12-27 22:21:04,321][106225] Updated weights for policy 1, policy_version 434626 (0.0006) [2023-12-27 22:21:04,387][106225] Updated weights for policy 1, policy_version 434636 (0.0007) [2023-12-27 22:21:04,889][106226] Updated weights for policy 0, policy_version 433291 (0.0007) [2023-12-27 22:21:04,949][106226] Updated weights for policy 0, policy_version 433301 (0.0006) [2023-12-27 22:21:05,006][106226] Updated weights for policy 0, policy_version 433311 (0.0005) [2023-12-27 22:21:05,079][106225] Updated weights for policy 1, policy_version 434646 (0.0007) [2023-12-27 22:21:05,146][106225] Updated weights for policy 1, policy_version 434656 (0.0009) [2023-12-27 22:21:05,213][106225] Updated weights for policy 1, policy_version 434666 (0.0008) [2023-12-27 22:21:05,530][106226] Updated weights for policy 0, policy_version 433321 (0.0005) [2023-12-27 22:21:05,592][106226] Updated weights for policy 0, policy_version 433331 (0.0009) [2023-12-27 22:21:05,657][106226] Updated weights for policy 0, policy_version 433341 (0.0009) [2023-12-27 22:21:05,714][106226] Updated weights for policy 0, policy_version 433351 (0.0008) [2023-12-27 22:21:05,968][106225] Updated weights for policy 1, policy_version 434676 (0.0007) [2023-12-27 22:21:06,045][106225] Updated weights for policy 1, policy_version 434686 (0.0005) [2023-12-27 22:21:06,118][106225] Updated weights for policy 1, policy_version 434696 (0.0006) [2023-12-27 22:21:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19577.5). Total num frames: 222281728. Throughput: 0: 9740.4, 1: 9800.9. Samples: 222288480. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:06,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-5.435')] [2023-12-27 22:21:06,494][106226] Updated weights for policy 0, policy_version 433361 (0.0007) [2023-12-27 22:21:06,556][106226] Updated weights for policy 0, policy_version 433371 (0.0008) [2023-12-27 22:21:06,610][106226] Updated weights for policy 0, policy_version 433381 (0.0008) [2023-12-27 22:21:06,805][106225] Updated weights for policy 1, policy_version 434706 (0.0007) [2023-12-27 22:21:06,862][106225] Updated weights for policy 1, policy_version 434716 (0.0007) [2023-12-27 22:21:06,918][106225] Updated weights for policy 1, policy_version 434726 (0.0009) [2023-12-27 22:21:06,975][106225] Updated weights for policy 1, policy_version 434736 (0.0008) [2023-12-27 22:21:07,374][106226] Updated weights for policy 0, policy_version 433391 (0.0007) [2023-12-27 22:21:07,434][106226] Updated weights for policy 0, policy_version 433401 (0.0006) [2023-12-27 22:21:07,484][106226] Updated weights for policy 0, policy_version 433411 (0.0005) [2023-12-27 22:21:07,679][106225] Updated weights for policy 1, policy_version 434746 (0.0008) [2023-12-27 22:21:07,740][106225] Updated weights for policy 1, policy_version 434756 (0.0006) [2023-12-27 22:21:07,799][106225] Updated weights for policy 1, policy_version 434766 (0.0005) [2023-12-27 22:21:08,142][106226] Updated weights for policy 0, policy_version 433421 (0.0007) [2023-12-27 22:21:08,197][106226] Updated weights for policy 0, policy_version 433431 (0.0009) [2023-12-27 22:21:08,254][106226] Updated weights for policy 0, policy_version 433441 (0.0008) [2023-12-27 22:21:08,477][106225] Updated weights for policy 1, policy_version 434776 (0.0006) [2023-12-27 22:21:08,532][106225] Updated weights for policy 1, policy_version 434786 (0.0008) [2023-12-27 22:21:08,593][106225] Updated weights for policy 1, policy_version 434796 (0.0008) [2023-12-27 22:21:09,033][106226] Updated weights for policy 0, policy_version 433451 (0.0008) [2023-12-27 22:21:09,090][106226] Updated weights for policy 0, policy_version 433461 (0.0008) [2023-12-27 22:21:09,145][106226] Updated weights for policy 0, policy_version 433471 (0.0009) [2023-12-27 22:21:09,252][106225] Updated weights for policy 1, policy_version 434806 (0.0008) [2023-12-27 22:21:09,318][106225] Updated weights for policy 1, policy_version 434816 (0.0007) [2023-12-27 22:21:09,387][106225] Updated weights for policy 1, policy_version 434826 (0.0010) [2023-12-27 22:21:09,905][106226] Updated weights for policy 0, policy_version 433481 (0.0009) [2023-12-27 22:21:09,975][106226] Updated weights for policy 0, policy_version 433491 (0.0008) [2023-12-27 22:21:10,038][106226] Updated weights for policy 0, policy_version 433501 (0.0008) [2023-12-27 22:21:10,094][106225] Updated weights for policy 1, policy_version 434836 (0.0007) [2023-12-27 22:21:10,099][106226] Updated weights for policy 0, policy_version 433511 (0.0008) [2023-12-27 22:21:10,149][106225] Updated weights for policy 1, policy_version 434846 (0.0007) [2023-12-27 22:21:10,207][106225] Updated weights for policy 1, policy_version 434856 (0.0006) [2023-12-27 22:21:10,826][106226] Updated weights for policy 0, policy_version 433521 (0.0009) [2023-12-27 22:21:10,875][106226] Updated weights for policy 0, policy_version 433531 (0.0008) [2023-12-27 22:21:10,920][106226] Updated weights for policy 0, policy_version 433541 (0.0008) [2023-12-27 22:21:10,946][106225] Updated weights for policy 1, policy_version 434866 (0.0005) [2023-12-27 22:21:10,997][106225] Updated weights for policy 1, policy_version 434876 (0.0008) [2023-12-27 22:21:11,062][106225] Updated weights for policy 1, policy_version 434886 (0.0009) [2023-12-27 22:21:11,122][106225] Updated weights for policy 1, policy_version 434896 (0.0006) [2023-12-27 22:21:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19577.5). Total num frames: 222380032. Throughput: 0: 9670.9, 1: 9843.5. Samples: 222346312. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:11,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.176')] [2023-12-27 22:21:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000434896_111362048.pth... [2023-12-27 22:21:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000433544_111017984.pth... [2023-12-27 22:21:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000433744_111067136.pth [2023-12-27 22:21:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000432424_110731264.pth [2023-12-27 22:21:11,800][106226] Updated weights for policy 0, policy_version 433551 (0.0008) [2023-12-27 22:21:11,863][106226] Updated weights for policy 0, policy_version 433561 (0.0008) [2023-12-27 22:21:11,930][106226] Updated weights for policy 0, policy_version 433571 (0.0008) [2023-12-27 22:21:11,948][106225] Updated weights for policy 1, policy_version 434906 (0.0008) [2023-12-27 22:21:12,014][106225] Updated weights for policy 1, policy_version 434916 (0.0009) [2023-12-27 22:21:12,080][106225] Updated weights for policy 1, policy_version 434926 (0.0008) [2023-12-27 22:21:12,675][106226] Updated weights for policy 0, policy_version 433581 (0.0008) [2023-12-27 22:21:12,726][106226] Updated weights for policy 0, policy_version 433591 (0.0007) [2023-12-27 22:21:12,774][106226] Updated weights for policy 0, policy_version 433601 (0.0007) [2023-12-27 22:21:12,826][106225] Updated weights for policy 1, policy_version 434936 (0.0009) [2023-12-27 22:21:12,887][106225] Updated weights for policy 1, policy_version 434946 (0.0006) [2023-12-27 22:21:12,946][106225] Updated weights for policy 1, policy_version 434956 (0.0008) [2023-12-27 22:21:13,473][106226] Updated weights for policy 0, policy_version 433611 (0.0009) [2023-12-27 22:21:13,543][106226] Updated weights for policy 0, policy_version 433621 (0.0006) [2023-12-27 22:21:13,610][106226] Updated weights for policy 0, policy_version 433631 (0.0005) [2023-12-27 22:21:13,681][106225] Updated weights for policy 1, policy_version 434966 (0.0007) [2023-12-27 22:21:13,733][106225] Updated weights for policy 1, policy_version 434976 (0.0005) [2023-12-27 22:21:13,794][106225] Updated weights for policy 1, policy_version 434986 (0.0005) [2023-12-27 22:21:14,132][106226] Updated weights for policy 0, policy_version 433641 (0.0008) [2023-12-27 22:21:14,181][106226] Updated weights for policy 0, policy_version 433651 (0.0007) [2023-12-27 22:21:14,229][106226] Updated weights for policy 0, policy_version 433661 (0.0008) [2023-12-27 22:21:14,283][106226] Updated weights for policy 0, policy_version 433671 (0.0009) [2023-12-27 22:21:14,373][106225] Updated weights for policy 1, policy_version 434996 (0.0006) [2023-12-27 22:21:14,431][106225] Updated weights for policy 1, policy_version 435006 (0.0010) [2023-12-27 22:21:14,485][106225] Updated weights for policy 1, policy_version 435016 (0.0010) [2023-12-27 22:21:14,990][106226] Updated weights for policy 0, policy_version 433681 (0.0009) [2023-12-27 22:21:15,054][106226] Updated weights for policy 0, policy_version 433691 (0.0008) [2023-12-27 22:21:15,119][106226] Updated weights for policy 0, policy_version 433701 (0.0008) [2023-12-27 22:21:15,191][106225] Updated weights for policy 1, policy_version 435026 (0.0010) [2023-12-27 22:21:15,259][106225] Updated weights for policy 1, policy_version 435036 (0.0007) [2023-12-27 22:21:15,324][106225] Updated weights for policy 1, policy_version 435046 (0.0008) [2023-12-27 22:21:15,388][106225] Updated weights for policy 1, policy_version 435056 (0.0008) [2023-12-27 22:21:15,826][106226] Updated weights for policy 0, policy_version 433711 (0.0009) [2023-12-27 22:21:15,892][106226] Updated weights for policy 0, policy_version 433721 (0.0008) [2023-12-27 22:21:15,950][106226] Updated weights for policy 0, policy_version 433731 (0.0009) [2023-12-27 22:21:16,120][106225] Updated weights for policy 1, policy_version 435066 (0.0009) [2023-12-27 22:21:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 222470144. Throughput: 0: 9637.1, 1: 9774.7. Samples: 222461928. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:16,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.204')] [2023-12-27 22:21:16,183][106225] Updated weights for policy 1, policy_version 435076 (0.0009) [2023-12-27 22:21:16,242][106225] Updated weights for policy 1, policy_version 435086 (0.0008) [2023-12-27 22:21:16,680][106226] Updated weights for policy 0, policy_version 433741 (0.0009) [2023-12-27 22:21:16,739][106226] Updated weights for policy 0, policy_version 433751 (0.0008) [2023-12-27 22:21:16,787][106226] Updated weights for policy 0, policy_version 433761 (0.0005) [2023-12-27 22:21:16,807][106225] Updated weights for policy 1, policy_version 435096 (0.0008) [2023-12-27 22:21:16,863][106225] Updated weights for policy 1, policy_version 435106 (0.0008) [2023-12-27 22:21:16,924][106225] Updated weights for policy 1, policy_version 435116 (0.0009) [2023-12-27 22:21:17,448][106226] Updated weights for policy 0, policy_version 433771 (0.0007) [2023-12-27 22:21:17,508][106226] Updated weights for policy 0, policy_version 433781 (0.0009) [2023-12-27 22:21:17,566][106226] Updated weights for policy 0, policy_version 433791 (0.0008) [2023-12-27 22:21:17,690][106225] Updated weights for policy 1, policy_version 435126 (0.0009) [2023-12-27 22:21:17,749][106225] Updated weights for policy 1, policy_version 435136 (0.0008) [2023-12-27 22:21:17,806][106225] Updated weights for policy 1, policy_version 435146 (0.0009) [2023-12-27 22:21:18,204][106226] Updated weights for policy 0, policy_version 433801 (0.0008) [2023-12-27 22:21:18,260][106226] Updated weights for policy 0, policy_version 433811 (0.0006) [2023-12-27 22:21:18,370][106226] Updated weights for policy 0, policy_version 433821 (0.0007) [2023-12-27 22:21:18,429][106226] Updated weights for policy 0, policy_version 433831 (0.0008) [2023-12-27 22:21:18,504][106225] Updated weights for policy 1, policy_version 435156 (0.0008) [2023-12-27 22:21:18,559][106225] Updated weights for policy 1, policy_version 435166 (0.0006) [2023-12-27 22:21:18,610][106225] Updated weights for policy 1, policy_version 435176 (0.0008) [2023-12-27 22:21:19,136][106226] Updated weights for policy 0, policy_version 433841 (0.0008) [2023-12-27 22:21:19,197][106226] Updated weights for policy 0, policy_version 433851 (0.0008) [2023-12-27 22:21:19,295][106226] Updated weights for policy 0, policy_version 433862 (0.0007) [2023-12-27 22:21:19,326][106225] Updated weights for policy 1, policy_version 435186 (0.0008) [2023-12-27 22:21:19,396][106225] Updated weights for policy 1, policy_version 435196 (0.0010) [2023-12-27 22:21:19,459][106225] Updated weights for policy 1, policy_version 435206 (0.0008) [2023-12-27 22:21:19,535][106225] Updated weights for policy 1, policy_version 435216 (0.0006) [2023-12-27 22:21:19,987][106226] Updated weights for policy 0, policy_version 433872 (0.0009) [2023-12-27 22:21:20,053][106226] Updated weights for policy 0, policy_version 433882 (0.0007) [2023-12-27 22:21:20,118][106226] Updated weights for policy 0, policy_version 433892 (0.0009) [2023-12-27 22:21:20,142][106225] Updated weights for policy 1, policy_version 435226 (0.0006) [2023-12-27 22:21:20,207][106225] Updated weights for policy 1, policy_version 435236 (0.0007) [2023-12-27 22:21:20,272][106225] Updated weights for policy 1, policy_version 435246 (0.0008) [2023-12-27 22:21:20,836][106226] Updated weights for policy 0, policy_version 433902 (0.0008) [2023-12-27 22:21:20,900][106226] Updated weights for policy 0, policy_version 433912 (0.0008) [2023-12-27 22:21:20,924][106225] Updated weights for policy 1, policy_version 435256 (0.0009) [2023-12-27 22:21:20,965][106226] Updated weights for policy 0, policy_version 433922 (0.0006) [2023-12-27 22:21:20,986][106225] Updated weights for policy 1, policy_version 435266 (0.0011) [2023-12-27 22:21:21,057][106225] Updated weights for policy 1, policy_version 435276 (0.0009) [2023-12-27 22:21:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19577.5). Total num frames: 222576640. Throughput: 0: 9641.7, 1: 9793.3. Samples: 222581256. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:21,175][105115] Avg episode reward: [(0, '-4.934'), (1, '-5.077')] [2023-12-27 22:21:21,723][106226] Updated weights for policy 0, policy_version 433932 (0.0007) [2023-12-27 22:21:21,780][106226] Updated weights for policy 0, policy_version 433942 (0.0009) [2023-12-27 22:21:21,839][106226] Updated weights for policy 0, policy_version 433952 (0.0009) [2023-12-27 22:21:21,854][106225] Updated weights for policy 1, policy_version 435286 (0.0010) [2023-12-27 22:21:21,905][106225] Updated weights for policy 1, policy_version 435296 (0.0010) [2023-12-27 22:21:21,956][106225] Updated weights for policy 1, policy_version 435306 (0.0010) [2023-12-27 22:21:22,657][106226] Updated weights for policy 0, policy_version 433962 (0.0009) [2023-12-27 22:21:22,674][106225] Updated weights for policy 1, policy_version 435316 (0.0007) [2023-12-27 22:21:22,724][106226] Updated weights for policy 0, policy_version 433972 (0.0009) [2023-12-27 22:21:22,735][106225] Updated weights for policy 1, policy_version 435326 (0.0007) [2023-12-27 22:21:22,799][106225] Updated weights for policy 1, policy_version 435336 (0.0007) [2023-12-27 22:21:22,800][106226] Updated weights for policy 0, policy_version 433982 (0.0007) [2023-12-27 22:21:22,879][106226] Updated weights for policy 0, policy_version 433992 (0.0008) [2023-12-27 22:21:23,457][106226] Updated weights for policy 0, policy_version 434002 (0.0008) [2023-12-27 22:21:23,524][106226] Updated weights for policy 0, policy_version 434012 (0.0009) [2023-12-27 22:21:23,534][106225] Updated weights for policy 1, policy_version 435346 (0.0010) [2023-12-27 22:21:23,576][106226] Updated weights for policy 0, policy_version 434022 (0.0005) [2023-12-27 22:21:23,590][106225] Updated weights for policy 1, policy_version 435356 (0.0007) [2023-12-27 22:21:23,644][106225] Updated weights for policy 1, policy_version 435366 (0.0008) [2023-12-27 22:21:23,707][106225] Updated weights for policy 1, policy_version 435376 (0.0008) [2023-12-27 22:21:24,245][106226] Updated weights for policy 0, policy_version 434032 (0.0008) [2023-12-27 22:21:24,304][106226] Updated weights for policy 0, policy_version 434042 (0.0008) [2023-12-27 22:21:24,365][106226] Updated weights for policy 0, policy_version 434052 (0.0007) [2023-12-27 22:21:24,444][106225] Updated weights for policy 1, policy_version 435386 (0.0008) [2023-12-27 22:21:24,498][106225] Updated weights for policy 1, policy_version 435396 (0.0008) [2023-12-27 22:21:24,562][106225] Updated weights for policy 1, policy_version 435406 (0.0010) [2023-12-27 22:21:25,081][106226] Updated weights for policy 0, policy_version 434062 (0.0009) [2023-12-27 22:21:25,138][106226] Updated weights for policy 0, policy_version 434072 (0.0007) [2023-12-27 22:21:25,191][106226] Updated weights for policy 0, policy_version 434082 (0.0008) [2023-12-27 22:21:25,293][106225] Updated weights for policy 1, policy_version 435416 (0.0010) [2023-12-27 22:21:25,339][106225] Updated weights for policy 1, policy_version 435426 (0.0010) [2023-12-27 22:21:25,392][106225] Updated weights for policy 1, policy_version 435436 (0.0010) [2023-12-27 22:21:25,836][106226] Updated weights for policy 0, policy_version 434092 (0.0007) [2023-12-27 22:21:25,881][106226] Updated weights for policy 0, policy_version 434102 (0.0005) [2023-12-27 22:21:25,931][106226] Updated weights for policy 0, policy_version 434112 (0.0005) [2023-12-27 22:21:26,126][106225] Updated weights for policy 1, policy_version 435446 (0.0010) [2023-12-27 22:21:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 222666752. Throughput: 0: 9662.1, 1: 9714.8. Samples: 222638092. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:26,175][105115] Avg episode reward: [(0, '-5.044'), (1, '-5.908')] [2023-12-27 22:21:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000434120_111165440.pth... [2023-12-27 22:21:26,183][106225] Updated weights for policy 1, policy_version 435456 (0.0010) [2023-12-27 22:21:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000432968_110870528.pth [2023-12-27 22:21:26,236][106225] Updated weights for policy 1, policy_version 435466 (0.0010) [2023-12-27 22:21:26,263][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000435472_111509504.pth... [2023-12-27 22:21:26,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000434320_111214592.pth [2023-12-27 22:21:26,591][106226] Updated weights for policy 0, policy_version 434122 (0.0006) [2023-12-27 22:21:26,636][106226] Updated weights for policy 0, policy_version 434132 (0.0006) [2023-12-27 22:21:26,681][106226] Updated weights for policy 0, policy_version 434142 (0.0005) [2023-12-27 22:21:26,740][106226] Updated weights for policy 0, policy_version 434152 (0.0005) [2023-12-27 22:21:26,928][106225] Updated weights for policy 1, policy_version 435476 (0.0008) [2023-12-27 22:21:26,977][106225] Updated weights for policy 1, policy_version 435486 (0.0005) [2023-12-27 22:21:27,023][106225] Updated weights for policy 1, policy_version 435496 (0.0005) [2023-12-27 22:21:27,421][106226] Updated weights for policy 0, policy_version 434162 (0.0010) [2023-12-27 22:21:27,471][106226] Updated weights for policy 0, policy_version 434172 (0.0010) [2023-12-27 22:21:27,528][106226] Updated weights for policy 0, policy_version 434182 (0.0009) [2023-12-27 22:21:27,658][106225] Updated weights for policy 1, policy_version 435506 (0.0006) [2023-12-27 22:21:27,720][106225] Updated weights for policy 1, policy_version 435516 (0.0010) [2023-12-27 22:21:27,781][106225] Updated weights for policy 1, policy_version 435526 (0.0007) [2023-12-27 22:21:27,844][106225] Updated weights for policy 1, policy_version 435536 (0.0007) [2023-12-27 22:21:28,198][106226] Updated weights for policy 0, policy_version 434192 (0.0008) [2023-12-27 22:21:28,249][106226] Updated weights for policy 0, policy_version 434202 (0.0008) [2023-12-27 22:21:28,294][106226] Updated weights for policy 0, policy_version 434212 (0.0008) [2023-12-27 22:21:28,576][106225] Updated weights for policy 1, policy_version 435546 (0.0005) [2023-12-27 22:21:28,640][106225] Updated weights for policy 1, policy_version 435556 (0.0009) [2023-12-27 22:21:28,703][106225] Updated weights for policy 1, policy_version 435566 (0.0008) [2023-12-27 22:21:29,055][106226] Updated weights for policy 0, policy_version 434222 (0.0008) [2023-12-27 22:21:29,100][106226] Updated weights for policy 0, policy_version 434232 (0.0008) [2023-12-27 22:21:29,154][106226] Updated weights for policy 0, policy_version 434242 (0.0007) [2023-12-27 22:21:29,438][106225] Updated weights for policy 1, policy_version 435576 (0.0009) [2023-12-27 22:21:29,504][106225] Updated weights for policy 1, policy_version 435586 (0.0009) [2023-12-27 22:21:29,570][106225] Updated weights for policy 1, policy_version 435596 (0.0008) [2023-12-27 22:21:29,589][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000001 [2023-12-27 22:21:29,882][106226] Updated weights for policy 0, policy_version 434252 (0.0007) [2023-12-27 22:21:29,950][106226] Updated weights for policy 0, policy_version 434262 (0.0009) [2023-12-27 22:21:30,025][106226] Updated weights for policy 0, policy_version 434272 (0.0008) [2023-12-27 22:21:30,198][106225] Updated weights for policy 1, policy_version 435606 (0.0009) [2023-12-27 22:21:30,262][106225] Updated weights for policy 1, policy_version 435616 (0.0007) [2023-12-27 22:21:30,318][106225] Updated weights for policy 1, policy_version 435626 (0.0006) [2023-12-27 22:21:30,732][106226] Updated weights for policy 0, policy_version 434282 (0.0009) [2023-12-27 22:21:30,792][106226] Updated weights for policy 0, policy_version 434292 (0.0007) [2023-12-27 22:21:30,853][106226] Updated weights for policy 0, policy_version 434302 (0.0009) [2023-12-27 22:21:30,914][106226] Updated weights for policy 0, policy_version 434312 (0.0007) [2023-12-27 22:21:31,100][106225] Updated weights for policy 1, policy_version 435636 (0.0009) [2023-12-27 22:21:31,163][106225] Updated weights for policy 1, policy_version 435646 (0.0010) [2023-12-27 22:21:31,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 222765056. Throughput: 0: 9755.9, 1: 9695.7. Samples: 222756976. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:31,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-5.183')] [2023-12-27 22:21:31,230][106225] Updated weights for policy 1, policy_version 435656 (0.0009) [2023-12-27 22:21:31,586][106226] Updated weights for policy 0, policy_version 434322 (0.0009) [2023-12-27 22:21:31,650][106226] Updated weights for policy 0, policy_version 434332 (0.0008) [2023-12-27 22:21:31,716][106226] Updated weights for policy 0, policy_version 434342 (0.0008) [2023-12-27 22:21:32,003][106225] Updated weights for policy 1, policy_version 435666 (0.0008) [2023-12-27 22:21:32,050][106225] Updated weights for policy 1, policy_version 435676 (0.0008) [2023-12-27 22:21:32,106][106225] Updated weights for policy 1, policy_version 435686 (0.0008) [2023-12-27 22:21:32,167][106225] Updated weights for policy 1, policy_version 435696 (0.0008) [2023-12-27 22:21:32,485][106226] Updated weights for policy 0, policy_version 434352 (0.0008) [2023-12-27 22:21:32,541][106226] Updated weights for policy 0, policy_version 434362 (0.0008) [2023-12-27 22:21:32,608][106226] Updated weights for policy 0, policy_version 434372 (0.0009) [2023-12-27 22:21:32,889][106225] Updated weights for policy 1, policy_version 435706 (0.0008) [2023-12-27 22:21:32,949][106225] Updated weights for policy 1, policy_version 435716 (0.0008) [2023-12-27 22:21:33,007][106225] Updated weights for policy 1, policy_version 435726 (0.0009) [2023-12-27 22:21:33,314][106226] Updated weights for policy 0, policy_version 434382 (0.0007) [2023-12-27 22:21:33,364][106226] Updated weights for policy 0, policy_version 434392 (0.0008) [2023-12-27 22:21:33,417][106226] Updated weights for policy 0, policy_version 434402 (0.0009) [2023-12-27 22:21:33,753][106225] Updated weights for policy 1, policy_version 435736 (0.0009) [2023-12-27 22:21:33,796][106225] Updated weights for policy 1, policy_version 435746 (0.0008) [2023-12-27 22:21:33,845][106225] Updated weights for policy 1, policy_version 435756 (0.0008) [2023-12-27 22:21:34,060][106226] Updated weights for policy 0, policy_version 434412 (0.0008) [2023-12-27 22:21:34,116][106226] Updated weights for policy 0, policy_version 434422 (0.0008) [2023-12-27 22:21:34,181][106226] Updated weights for policy 0, policy_version 434432 (0.0008) [2023-12-27 22:21:34,683][106225] Updated weights for policy 1, policy_version 435767 (0.0009) [2023-12-27 22:21:34,747][106225] Updated weights for policy 1, policy_version 435777 (0.0009) [2023-12-27 22:21:34,807][106225] Updated weights for policy 1, policy_version 435787 (0.0010) [2023-12-27 22:21:34,889][106226] Updated weights for policy 0, policy_version 434442 (0.0008) [2023-12-27 22:21:34,942][106226] Updated weights for policy 0, policy_version 434452 (0.0008) [2023-12-27 22:21:34,995][106226] Updated weights for policy 0, policy_version 434462 (0.0008) [2023-12-27 22:21:35,049][106226] Updated weights for policy 0, policy_version 434472 (0.0005) [2023-12-27 22:21:35,522][106225] Updated weights for policy 1, policy_version 435797 (0.0010) [2023-12-27 22:21:35,582][106225] Updated weights for policy 1, policy_version 435807 (0.0010) [2023-12-27 22:21:35,636][106225] Updated weights for policy 1, policy_version 435817 (0.0010) [2023-12-27 22:21:35,642][106226] Updated weights for policy 0, policy_version 434482 (0.0010) [2023-12-27 22:21:35,702][106226] Updated weights for policy 0, policy_version 434492 (0.0011) [2023-12-27 22:21:35,762][106226] Updated weights for policy 0, policy_version 434502 (0.0008) [2023-12-27 22:21:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 222863360. Throughput: 0: 9851.9, 1: 9596.8. Samples: 222874364. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:36,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-5.622')] [2023-12-27 22:21:36,395][106226] Updated weights for policy 0, policy_version 434512 (0.0011) [2023-12-27 22:21:36,418][106225] Updated weights for policy 1, policy_version 435827 (0.0009) [2023-12-27 22:21:36,458][106226] Updated weights for policy 0, policy_version 434522 (0.0011) [2023-12-27 22:21:36,484][106225] Updated weights for policy 1, policy_version 435837 (0.0008) [2023-12-27 22:21:36,520][106226] Updated weights for policy 0, policy_version 434532 (0.0011) [2023-12-27 22:21:36,545][106225] Updated weights for policy 1, policy_version 435847 (0.0007) [2023-12-27 22:21:37,154][106225] Updated weights for policy 1, policy_version 435857 (0.0008) [2023-12-27 22:21:37,214][106225] Updated weights for policy 1, policy_version 435867 (0.0007) [2023-12-27 22:21:37,263][106226] Updated weights for policy 0, policy_version 434542 (0.0008) [2023-12-27 22:21:37,272][106225] Updated weights for policy 1, policy_version 435877 (0.0006) [2023-12-27 22:21:37,320][106226] Updated weights for policy 0, policy_version 434552 (0.0008) [2023-12-27 22:21:37,327][106225] Updated weights for policy 1, policy_version 435887 (0.0005) [2023-12-27 22:21:37,386][106226] Updated weights for policy 0, policy_version 434562 (0.0009) [2023-12-27 22:21:37,968][106225] Updated weights for policy 1, policy_version 435897 (0.0011) [2023-12-27 22:21:38,031][106225] Updated weights for policy 1, policy_version 435907 (0.0008) [2023-12-27 22:21:38,088][106225] Updated weights for policy 1, policy_version 435917 (0.0008) [2023-12-27 22:21:38,122][106226] Updated weights for policy 0, policy_version 434572 (0.0008) [2023-12-27 22:21:38,184][106226] Updated weights for policy 0, policy_version 434582 (0.0006) [2023-12-27 22:21:38,243][106226] Updated weights for policy 0, policy_version 434592 (0.0006) [2023-12-27 22:21:38,828][106225] Updated weights for policy 1, policy_version 435927 (0.0010) [2023-12-27 22:21:38,890][106226] Updated weights for policy 0, policy_version 434602 (0.0007) [2023-12-27 22:21:38,894][106225] Updated weights for policy 1, policy_version 435937 (0.0010) [2023-12-27 22:21:38,945][106226] Updated weights for policy 0, policy_version 434612 (0.0011) [2023-12-27 22:21:38,951][106225] Updated weights for policy 1, policy_version 435947 (0.0010) [2023-12-27 22:21:38,993][106226] Updated weights for policy 0, policy_version 434622 (0.0010) [2023-12-27 22:21:39,040][106226] Updated weights for policy 0, policy_version 434632 (0.0010) [2023-12-27 22:21:39,695][106225] Updated weights for policy 1, policy_version 435957 (0.0009) [2023-12-27 22:21:39,757][106225] Updated weights for policy 1, policy_version 435967 (0.0007) [2023-12-27 22:21:39,800][106226] Updated weights for policy 0, policy_version 434642 (0.0007) [2023-12-27 22:21:39,824][106225] Updated weights for policy 1, policy_version 435977 (0.0009) [2023-12-27 22:21:39,862][106226] Updated weights for policy 0, policy_version 434652 (0.0008) [2023-12-27 22:21:39,908][106226] Updated weights for policy 0, policy_version 434662 (0.0007) [2023-12-27 22:21:40,604][106225] Updated weights for policy 1, policy_version 435987 (0.0009) [2023-12-27 22:21:40,641][106226] Updated weights for policy 0, policy_version 434672 (0.0006) [2023-12-27 22:21:40,655][106225] Updated weights for policy 1, policy_version 435997 (0.0010) [2023-12-27 22:21:40,696][106226] Updated weights for policy 0, policy_version 434682 (0.0005) [2023-12-27 22:21:40,710][106225] Updated weights for policy 1, policy_version 436007 (0.0010) [2023-12-27 22:21:40,754][106226] Updated weights for policy 0, policy_version 434692 (0.0005) [2023-12-27 22:21:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 222961664. Throughput: 0: 9832.1, 1: 9632.0. Samples: 222933664. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:41,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.166')] [2023-12-27 22:21:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000436016_111648768.pth... [2023-12-27 22:21:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000434696_111312896.pth... [2023-12-27 22:21:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000434896_111362048.pth [2023-12-27 22:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000433544_111017984.pth [2023-12-27 22:21:41,454][106225] Updated weights for policy 1, policy_version 436017 (0.0010) [2023-12-27 22:21:41,513][106225] Updated weights for policy 1, policy_version 436027 (0.0010) [2023-12-27 22:21:41,574][106225] Updated weights for policy 1, policy_version 436037 (0.0011) [2023-12-27 22:21:41,584][106226] Updated weights for policy 0, policy_version 434702 (0.0007) [2023-12-27 22:21:41,656][106226] Updated weights for policy 0, policy_version 434712 (0.0008) [2023-12-27 22:21:41,657][106225] Updated weights for policy 1, policy_version 436047 (0.0010) [2023-12-27 22:21:41,727][106226] Updated weights for policy 0, policy_version 434722 (0.0007) [2023-12-27 22:21:42,419][106225] Updated weights for policy 1, policy_version 436057 (0.0009) [2023-12-27 22:21:42,478][106225] Updated weights for policy 1, policy_version 436067 (0.0008) [2023-12-27 22:21:42,519][106226] Updated weights for policy 0, policy_version 434732 (0.0008) [2023-12-27 22:21:42,541][106225] Updated weights for policy 1, policy_version 436077 (0.0009) [2023-12-27 22:21:42,583][106226] Updated weights for policy 0, policy_version 434742 (0.0007) [2023-12-27 22:21:42,639][106226] Updated weights for policy 0, policy_version 434752 (0.0008) [2023-12-27 22:21:43,278][106225] Updated weights for policy 1, policy_version 436087 (0.0010) [2023-12-27 22:21:43,340][106225] Updated weights for policy 1, policy_version 436097 (0.0010) [2023-12-27 22:21:43,390][106226] Updated weights for policy 0, policy_version 434762 (0.0008) [2023-12-27 22:21:43,403][106225] Updated weights for policy 1, policy_version 436107 (0.0010) [2023-12-27 22:21:43,446][106226] Updated weights for policy 0, policy_version 434772 (0.0008) [2023-12-27 22:21:43,506][106226] Updated weights for policy 0, policy_version 434782 (0.0008) [2023-12-27 22:21:43,567][106226] Updated weights for policy 0, policy_version 434792 (0.0009) [2023-12-27 22:21:44,089][106225] Updated weights for policy 1, policy_version 436117 (0.0007) [2023-12-27 22:21:44,148][106225] Updated weights for policy 1, policy_version 436127 (0.0008) [2023-12-27 22:21:44,184][106226] Updated weights for policy 0, policy_version 434802 (0.0006) [2023-12-27 22:21:44,203][106225] Updated weights for policy 1, policy_version 436137 (0.0007) [2023-12-27 22:21:44,246][106226] Updated weights for policy 0, policy_version 434812 (0.0006) [2023-12-27 22:21:44,312][106226] Updated weights for policy 0, policy_version 434822 (0.0007) [2023-12-27 22:21:44,852][106225] Updated weights for policy 1, policy_version 436147 (0.0007) [2023-12-27 22:21:44,914][106225] Updated weights for policy 1, policy_version 436157 (0.0011) [2023-12-27 22:21:44,999][106225] Updated weights for policy 1, policy_version 436167 (0.0011) [2023-12-27 22:21:45,010][106226] Updated weights for policy 0, policy_version 434832 (0.0007) [2023-12-27 22:21:45,072][106226] Updated weights for policy 0, policy_version 434842 (0.0007) [2023-12-27 22:21:45,136][106226] Updated weights for policy 0, policy_version 434852 (0.0007) [2023-12-27 22:21:45,700][106225] Updated weights for policy 1, policy_version 436177 (0.0011) [2023-12-27 22:21:45,747][106225] Updated weights for policy 1, policy_version 436187 (0.0010) [2023-12-27 22:21:45,804][106225] Updated weights for policy 1, policy_version 436197 (0.0010) [2023-12-27 22:21:45,867][106225] Updated weights for policy 1, policy_version 436207 (0.0009) [2023-12-27 22:21:45,883][106226] Updated weights for policy 0, policy_version 434862 (0.0008) [2023-12-27 22:21:45,942][106226] Updated weights for policy 0, policy_version 434872 (0.0008) [2023-12-27 22:21:45,997][106226] Updated weights for policy 0, policy_version 434882 (0.0008) [2023-12-27 22:21:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19577.5). Total num frames: 223059968. Throughput: 0: 9769.6, 1: 9668.3. Samples: 223046696. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:46,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-5.294')] [2023-12-27 22:21:46,625][106225] Updated weights for policy 1, policy_version 436217 (0.0011) [2023-12-27 22:21:46,690][106225] Updated weights for policy 1, policy_version 436227 (0.0010) [2023-12-27 22:21:46,747][106225] Updated weights for policy 1, policy_version 436237 (0.0005) [2023-12-27 22:21:46,754][106226] Updated weights for policy 0, policy_version 434892 (0.0008) [2023-12-27 22:21:46,808][106226] Updated weights for policy 0, policy_version 434902 (0.0009) [2023-12-27 22:21:46,858][106226] Updated weights for policy 0, policy_version 434912 (0.0009) [2023-12-27 22:21:47,352][106225] Updated weights for policy 1, policy_version 436247 (0.0005) [2023-12-27 22:21:47,415][106225] Updated weights for policy 1, policy_version 436257 (0.0006) [2023-12-27 22:21:47,469][106225] Updated weights for policy 1, policy_version 436267 (0.0008) [2023-12-27 22:21:47,636][106226] Updated weights for policy 0, policy_version 434922 (0.0009) [2023-12-27 22:21:47,687][106226] Updated weights for policy 0, policy_version 434932 (0.0008) [2023-12-27 22:21:47,742][106226] Updated weights for policy 0, policy_version 434942 (0.0009) [2023-12-27 22:21:47,810][106226] Updated weights for policy 0, policy_version 434952 (0.0009) [2023-12-27 22:21:48,154][106225] Updated weights for policy 1, policy_version 436277 (0.0008) [2023-12-27 22:21:48,208][106225] Updated weights for policy 1, policy_version 436287 (0.0009) [2023-12-27 22:21:48,260][106225] Updated weights for policy 1, policy_version 436297 (0.0008) [2023-12-27 22:21:48,588][106226] Updated weights for policy 0, policy_version 434962 (0.0009) [2023-12-27 22:21:48,650][106226] Updated weights for policy 0, policy_version 434972 (0.0009) [2023-12-27 22:21:48,718][106226] Updated weights for policy 0, policy_version 434982 (0.0009) [2023-12-27 22:21:49,012][106225] Updated weights for policy 1, policy_version 436307 (0.0009) [2023-12-27 22:21:49,066][106225] Updated weights for policy 1, policy_version 436317 (0.0006) [2023-12-27 22:21:49,119][106225] Updated weights for policy 1, policy_version 436327 (0.0005) [2023-12-27 22:21:49,551][106226] Updated weights for policy 0, policy_version 434992 (0.0008) [2023-12-27 22:21:49,611][106226] Updated weights for policy 0, policy_version 435002 (0.0009) [2023-12-27 22:21:49,671][106226] Updated weights for policy 0, policy_version 435012 (0.0008) [2023-12-27 22:21:49,742][106225] Updated weights for policy 1, policy_version 436337 (0.0005) [2023-12-27 22:21:49,808][106225] Updated weights for policy 1, policy_version 436347 (0.0008) [2023-12-27 22:21:49,877][106225] Updated weights for policy 1, policy_version 436357 (0.0008) [2023-12-27 22:21:49,944][106225] Updated weights for policy 1, policy_version 436367 (0.0008) [2023-12-27 22:21:50,508][106226] Updated weights for policy 0, policy_version 435022 (0.0009) [2023-12-27 22:21:50,561][106226] Updated weights for policy 0, policy_version 435032 (0.0008) [2023-12-27 22:21:50,591][106225] Updated weights for policy 1, policy_version 436377 (0.0007) [2023-12-27 22:21:50,634][106226] Updated weights for policy 0, policy_version 435042 (0.0010) [2023-12-27 22:21:50,645][106225] Updated weights for policy 1, policy_version 436387 (0.0007) [2023-12-27 22:21:50,696][106225] Updated weights for policy 1, policy_version 436397 (0.0008) [2023-12-27 22:21:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 223150080. Throughput: 0: 9650.0, 1: 9727.2. Samples: 223160456. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-27 22:21:51,175][105115] Avg episode reward: [(0, '-5.024'), (1, '-5.639')] [2023-12-27 22:21:51,426][106226] Updated weights for policy 0, policy_version 435052 (0.0011) [2023-12-27 22:21:51,464][106225] Updated weights for policy 1, policy_version 436407 (0.0006) [2023-12-27 22:21:51,489][106226] Updated weights for policy 0, policy_version 435062 (0.0011) [2023-12-27 22:21:51,530][106225] Updated weights for policy 1, policy_version 436417 (0.0005) [2023-12-27 22:21:51,540][106226] Updated weights for policy 0, policy_version 435072 (0.0009) [2023-12-27 22:21:51,587][106225] Updated weights for policy 1, policy_version 436427 (0.0008) [2023-12-27 22:21:52,199][106226] Updated weights for policy 0, policy_version 435082 (0.0009) [2023-12-27 22:21:52,247][106226] Updated weights for policy 0, policy_version 435092 (0.0008) [2023-12-27 22:21:52,311][106225] Updated weights for policy 1, policy_version 436437 (0.0007) [2023-12-27 22:21:52,335][106226] Updated weights for policy 0, policy_version 435102 (0.0011) [2023-12-27 22:21:52,380][106225] Updated weights for policy 1, policy_version 436447 (0.0008) [2023-12-27 22:21:52,407][106226] Updated weights for policy 0, policy_version 435112 (0.0011) [2023-12-27 22:21:52,451][106225] Updated weights for policy 1, policy_version 436457 (0.0006) [2023-12-27 22:21:53,089][106226] Updated weights for policy 0, policy_version 435122 (0.0011) [2023-12-27 22:21:53,093][106225] Updated weights for policy 1, policy_version 436467 (0.0006) [2023-12-27 22:21:53,149][106226] Updated weights for policy 0, policy_version 435132 (0.0010) [2023-12-27 22:21:53,149][106225] Updated weights for policy 1, policy_version 436477 (0.0006) [2023-12-27 22:21:53,203][106225] Updated weights for policy 1, policy_version 436487 (0.0007) [2023-12-27 22:21:53,206][106226] Updated weights for policy 0, policy_version 435142 (0.0010) [2023-12-27 22:21:53,811][106226] Updated weights for policy 0, policy_version 435152 (0.0008) [2023-12-27 22:21:53,862][106226] Updated weights for policy 0, policy_version 435162 (0.0010) [2023-12-27 22:21:53,921][106226] Updated weights for policy 0, policy_version 435172 (0.0010) [2023-12-27 22:21:53,968][106225] Updated weights for policy 1, policy_version 436497 (0.0007) [2023-12-27 22:21:54,023][106225] Updated weights for policy 1, policy_version 436507 (0.0008) [2023-12-27 22:21:54,071][106225] Updated weights for policy 1, policy_version 436517 (0.0008) [2023-12-27 22:21:54,132][106225] Updated weights for policy 1, policy_version 436527 (0.0008) [2023-12-27 22:21:54,628][106226] Updated weights for policy 0, policy_version 435182 (0.0010) [2023-12-27 22:21:54,687][106226] Updated weights for policy 0, policy_version 435192 (0.0010) [2023-12-27 22:21:54,741][106226] Updated weights for policy 0, policy_version 435202 (0.0010) [2023-12-27 22:21:54,880][106225] Updated weights for policy 1, policy_version 436537 (0.0008) [2023-12-27 22:21:54,951][106225] Updated weights for policy 1, policy_version 436547 (0.0009) [2023-12-27 22:21:55,021][106225] Updated weights for policy 1, policy_version 436557 (0.0009) [2023-12-27 22:21:55,403][106226] Updated weights for policy 0, policy_version 435212 (0.0010) [2023-12-27 22:21:55,456][106226] Updated weights for policy 0, policy_version 435222 (0.0010) [2023-12-27 22:21:55,517][106226] Updated weights for policy 0, policy_version 435232 (0.0011) [2023-12-27 22:21:55,752][106225] Updated weights for policy 1, policy_version 436567 (0.0008) [2023-12-27 22:21:55,816][106225] Updated weights for policy 1, policy_version 436577 (0.0008) [2023-12-27 22:21:55,881][106225] Updated weights for policy 1, policy_version 436587 (0.0008) [2023-12-27 22:21:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 223248384. Throughput: 0: 9689.6, 1: 9715.5. Samples: 223219544. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:21:56,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.458')] [2023-12-27 22:21:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000436592_111796224.pth... [2023-12-27 22:21:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000435240_111452160.pth... [2023-12-27 22:21:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000434120_111165440.pth [2023-12-27 22:21:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000435472_111509504.pth [2023-12-27 22:21:56,244][106226] Updated weights for policy 0, policy_version 435242 (0.0011) [2023-12-27 22:21:56,307][106226] Updated weights for policy 0, policy_version 435252 (0.0010) [2023-12-27 22:21:56,369][106226] Updated weights for policy 0, policy_version 435262 (0.0010) [2023-12-27 22:21:56,433][106226] Updated weights for policy 0, policy_version 435272 (0.0011) [2023-12-27 22:21:56,613][106225] Updated weights for policy 1, policy_version 436597 (0.0008) [2023-12-27 22:21:56,669][106225] Updated weights for policy 1, policy_version 436607 (0.0008) [2023-12-27 22:21:56,718][106225] Updated weights for policy 1, policy_version 436617 (0.0007) [2023-12-27 22:21:57,119][106226] Updated weights for policy 0, policy_version 435282 (0.0011) [2023-12-27 22:21:57,184][106226] Updated weights for policy 0, policy_version 435292 (0.0010) [2023-12-27 22:21:57,247][106226] Updated weights for policy 0, policy_version 435302 (0.0010) [2023-12-27 22:21:57,357][106225] Updated weights for policy 1, policy_version 436627 (0.0005) [2023-12-27 22:21:57,413][106225] Updated weights for policy 1, policy_version 436637 (0.0007) [2023-12-27 22:21:57,477][106225] Updated weights for policy 1, policy_version 436647 (0.0006) [2023-12-27 22:21:57,944][106226] Updated weights for policy 0, policy_version 435312 (0.0011) [2023-12-27 22:21:58,002][106225] Updated weights for policy 1, policy_version 436657 (0.0006) [2023-12-27 22:21:58,011][106226] Updated weights for policy 0, policy_version 435322 (0.0011) [2023-12-27 22:21:58,053][106225] Updated weights for policy 1, policy_version 436667 (0.0010) [2023-12-27 22:21:58,069][106226] Updated weights for policy 0, policy_version 435332 (0.0011) [2023-12-27 22:21:58,112][106225] Updated weights for policy 1, policy_version 436677 (0.0007) [2023-12-27 22:21:58,169][106225] Updated weights for policy 1, policy_version 436687 (0.0006) [2023-12-27 22:21:58,881][106226] Updated weights for policy 0, policy_version 435342 (0.0009) [2023-12-27 22:21:58,960][106226] Updated weights for policy 0, policy_version 435352 (0.0009) [2023-12-27 22:21:59,012][106226] Updated weights for policy 0, policy_version 435362 (0.0009) [2023-12-27 22:21:59,119][106225] Updated weights for policy 1, policy_version 436697 (0.0009) [2023-12-27 22:21:59,176][106225] Updated weights for policy 1, policy_version 436707 (0.0009) [2023-12-27 22:21:59,241][106225] Updated weights for policy 1, policy_version 436717 (0.0009) [2023-12-27 22:21:59,846][106226] Updated weights for policy 0, policy_version 435372 (0.0009) [2023-12-27 22:21:59,916][106226] Updated weights for policy 0, policy_version 435382 (0.0008) [2023-12-27 22:21:59,985][106226] Updated weights for policy 0, policy_version 435392 (0.0009) [2023-12-27 22:21:59,993][106225] Updated weights for policy 1, policy_version 436727 (0.0006) [2023-12-27 22:22:00,054][106225] Updated weights for policy 1, policy_version 436737 (0.0008) [2023-12-27 22:22:00,116][106225] Updated weights for policy 1, policy_version 436747 (0.0009) [2023-12-27 22:22:00,686][106226] Updated weights for policy 0, policy_version 435402 (0.0009) [2023-12-27 22:22:00,736][106225] Updated weights for policy 1, policy_version 436757 (0.0007) [2023-12-27 22:22:00,740][106226] Updated weights for policy 0, policy_version 435412 (0.0009) [2023-12-27 22:22:00,785][106225] Updated weights for policy 1, policy_version 436767 (0.0005) [2023-12-27 22:22:00,790][106226] Updated weights for policy 0, policy_version 435422 (0.0008) [2023-12-27 22:22:00,838][106225] Updated weights for policy 1, policy_version 436777 (0.0009) [2023-12-27 22:22:00,847][106226] Updated weights for policy 0, policy_version 435432 (0.0006) [2023-12-27 22:22:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 223346688. Throughput: 0: 9670.3, 1: 9703.3. Samples: 223333740. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:01,175][105115] Avg episode reward: [(0, '-5.124'), (1, '-5.878')] [2023-12-27 22:22:01,540][106225] Updated weights for policy 1, policy_version 436787 (0.0009) [2023-12-27 22:22:01,606][106225] Updated weights for policy 1, policy_version 436797 (0.0008) [2023-12-27 22:22:01,633][106226] Updated weights for policy 0, policy_version 435442 (0.0007) [2023-12-27 22:22:01,687][106225] Updated weights for policy 1, policy_version 436807 (0.0008) [2023-12-27 22:22:01,702][106226] Updated weights for policy 0, policy_version 435452 (0.0009) [2023-12-27 22:22:01,772][106226] Updated weights for policy 0, policy_version 435462 (0.0010) [2023-12-27 22:22:02,369][106225] Updated weights for policy 1, policy_version 436817 (0.0008) [2023-12-27 22:22:02,427][106225] Updated weights for policy 1, policy_version 436827 (0.0009) [2023-12-27 22:22:02,488][106225] Updated weights for policy 1, policy_version 436837 (0.0008) [2023-12-27 22:22:02,524][106226] Updated weights for policy 0, policy_version 435472 (0.0010) [2023-12-27 22:22:02,553][106225] Updated weights for policy 1, policy_version 436847 (0.0009) [2023-12-27 22:22:02,578][106226] Updated weights for policy 0, policy_version 435482 (0.0007) [2023-12-27 22:22:02,632][106226] Updated weights for policy 0, policy_version 435492 (0.0009) [2023-12-27 22:22:03,208][106225] Updated weights for policy 1, policy_version 436857 (0.0007) [2023-12-27 22:22:03,260][106225] Updated weights for policy 1, policy_version 436867 (0.0009) [2023-12-27 22:22:03,319][106225] Updated weights for policy 1, policy_version 436877 (0.0005) [2023-12-27 22:22:03,364][106226] Updated weights for policy 0, policy_version 435502 (0.0010) [2023-12-27 22:22:03,422][106226] Updated weights for policy 0, policy_version 435512 (0.0008) [2023-12-27 22:22:03,489][106226] Updated weights for policy 0, policy_version 435522 (0.0009) [2023-12-27 22:22:04,011][106225] Updated weights for policy 1, policy_version 436887 (0.0007) [2023-12-27 22:22:04,069][106225] Updated weights for policy 1, policy_version 436897 (0.0007) [2023-12-27 22:22:04,133][106225] Updated weights for policy 1, policy_version 436907 (0.0008) [2023-12-27 22:22:04,194][106226] Updated weights for policy 0, policy_version 435532 (0.0009) [2023-12-27 22:22:04,259][106226] Updated weights for policy 0, policy_version 435542 (0.0009) [2023-12-27 22:22:04,320][106226] Updated weights for policy 0, policy_version 435552 (0.0008) [2023-12-27 22:22:04,848][106225] Updated weights for policy 1, policy_version 436917 (0.0008) [2023-12-27 22:22:04,902][106225] Updated weights for policy 1, policy_version 436927 (0.0008) [2023-12-27 22:22:04,956][106225] Updated weights for policy 1, policy_version 436937 (0.0008) [2023-12-27 22:22:05,036][106226] Updated weights for policy 0, policy_version 435562 (0.0008) [2023-12-27 22:22:05,093][106226] Updated weights for policy 0, policy_version 435572 (0.0009) [2023-12-27 22:22:05,147][106226] Updated weights for policy 0, policy_version 435582 (0.0009) [2023-12-27 22:22:05,203][106226] Updated weights for policy 0, policy_version 435592 (0.0008) [2023-12-27 22:22:05,597][106225] Updated weights for policy 1, policy_version 436947 (0.0008) [2023-12-27 22:22:05,655][106225] Updated weights for policy 1, policy_version 436957 (0.0009) [2023-12-27 22:22:05,702][106225] Updated weights for policy 1, policy_version 436967 (0.0008) [2023-12-27 22:22:05,873][106226] Updated weights for policy 0, policy_version 435602 (0.0005) [2023-12-27 22:22:05,928][106226] Updated weights for policy 0, policy_version 435612 (0.0005) [2023-12-27 22:22:05,991][106226] Updated weights for policy 0, policy_version 435622 (0.0005) [2023-12-27 22:22:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 223444992. Throughput: 0: 9642.4, 1: 9706.5. Samples: 223451956. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:06,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.401')] [2023-12-27 22:22:06,517][106225] Updated weights for policy 1, policy_version 436978 (0.0008) [2023-12-27 22:22:06,578][106225] Updated weights for policy 1, policy_version 436988 (0.0009) [2023-12-27 22:22:06,638][106225] Updated weights for policy 1, policy_version 436998 (0.0007) [2023-12-27 22:22:06,654][106226] Updated weights for policy 0, policy_version 435632 (0.0009) [2023-12-27 22:22:06,694][106225] Updated weights for policy 1, policy_version 437008 (0.0007) [2023-12-27 22:22:06,721][106226] Updated weights for policy 0, policy_version 435642 (0.0007) [2023-12-27 22:22:06,773][106226] Updated weights for policy 0, policy_version 435652 (0.0006) [2023-12-27 22:22:07,463][106225] Updated weights for policy 1, policy_version 437018 (0.0009) [2023-12-27 22:22:07,483][106226] Updated weights for policy 0, policy_version 435662 (0.0009) [2023-12-27 22:22:07,520][106225] Updated weights for policy 1, policy_version 437028 (0.0008) [2023-12-27 22:22:07,534][106226] Updated weights for policy 0, policy_version 435672 (0.0011) [2023-12-27 22:22:07,573][106225] Updated weights for policy 1, policy_version 437038 (0.0006) [2023-12-27 22:22:07,581][106226] Updated weights for policy 0, policy_version 435682 (0.0010) [2023-12-27 22:22:08,187][106225] Updated weights for policy 1, policy_version 437048 (0.0010) [2023-12-27 22:22:08,209][106226] Updated weights for policy 0, policy_version 435692 (0.0008) [2023-12-27 22:22:08,249][106225] Updated weights for policy 1, policy_version 437058 (0.0011) [2023-12-27 22:22:08,266][106226] Updated weights for policy 0, policy_version 435702 (0.0006) [2023-12-27 22:22:08,302][106225] Updated weights for policy 1, policy_version 437068 (0.0010) [2023-12-27 22:22:08,321][106226] Updated weights for policy 0, policy_version 435712 (0.0006) [2023-12-27 22:22:09,013][106226] Updated weights for policy 0, policy_version 435722 (0.0009) [2023-12-27 22:22:09,060][106225] Updated weights for policy 1, policy_version 437078 (0.0008) [2023-12-27 22:22:09,066][106226] Updated weights for policy 0, policy_version 435732 (0.0007) [2023-12-27 22:22:09,112][106225] Updated weights for policy 1, policy_version 437088 (0.0005) [2023-12-27 22:22:09,130][106226] Updated weights for policy 0, policy_version 435742 (0.0006) [2023-12-27 22:22:09,174][106225] Updated weights for policy 1, policy_version 437098 (0.0006) [2023-12-27 22:22:09,184][106226] Updated weights for policy 0, policy_version 435752 (0.0005) [2023-12-27 22:22:09,881][106226] Updated weights for policy 0, policy_version 435762 (0.0009) [2023-12-27 22:22:09,925][106225] Updated weights for policy 1, policy_version 437108 (0.0008) [2023-12-27 22:22:09,952][106226] Updated weights for policy 0, policy_version 435772 (0.0008) [2023-12-27 22:22:09,988][106225] Updated weights for policy 1, policy_version 437118 (0.0007) [2023-12-27 22:22:10,014][106226] Updated weights for policy 0, policy_version 435782 (0.0009) [2023-12-27 22:22:10,047][106225] Updated weights for policy 1, policy_version 437128 (0.0008) [2023-12-27 22:22:10,771][106225] Updated weights for policy 1, policy_version 437138 (0.0007) [2023-12-27 22:22:10,773][106226] Updated weights for policy 0, policy_version 435792 (0.0008) [2023-12-27 22:22:10,825][106225] Updated weights for policy 1, policy_version 437148 (0.0006) [2023-12-27 22:22:10,830][106226] Updated weights for policy 0, policy_version 435802 (0.0009) [2023-12-27 22:22:10,876][106225] Updated weights for policy 1, policy_version 437158 (0.0005) [2023-12-27 22:22:10,888][106226] Updated weights for policy 0, policy_version 435812 (0.0007) [2023-12-27 22:22:10,934][106225] Updated weights for policy 1, policy_version 437168 (0.0005) [2023-12-27 22:22:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19549.7). Total num frames: 223543296. Throughput: 0: 9670.1, 1: 9727.0. Samples: 223510964. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:11,175][105115] Avg episode reward: [(0, '-4.835'), (1, '-5.289')] [2023-12-27 22:22:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000437168_111943680.pth... [2023-12-27 22:22:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000435816_111599616.pth... [2023-12-27 22:22:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000436016_111648768.pth [2023-12-27 22:22:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000434696_111312896.pth [2023-12-27 22:22:11,719][106225] Updated weights for policy 1, policy_version 437178 (0.0008) [2023-12-27 22:22:11,762][106226] Updated weights for policy 0, policy_version 435822 (0.0009) [2023-12-27 22:22:11,790][106225] Updated weights for policy 1, policy_version 437188 (0.0009) [2023-12-27 22:22:11,821][106226] Updated weights for policy 0, policy_version 435832 (0.0008) [2023-12-27 22:22:11,849][106225] Updated weights for policy 1, policy_version 437198 (0.0010) [2023-12-27 22:22:11,880][106226] Updated weights for policy 0, policy_version 435842 (0.0008) [2023-12-27 22:22:12,610][106225] Updated weights for policy 1, policy_version 437208 (0.0008) [2023-12-27 22:22:12,676][106225] Updated weights for policy 1, policy_version 437218 (0.0008) [2023-12-27 22:22:12,694][106226] Updated weights for policy 0, policy_version 435852 (0.0008) [2023-12-27 22:22:12,739][106225] Updated weights for policy 1, policy_version 437228 (0.0007) [2023-12-27 22:22:12,757][106226] Updated weights for policy 0, policy_version 435862 (0.0006) [2023-12-27 22:22:12,834][106226] Updated weights for policy 0, policy_version 435872 (0.0008) [2023-12-27 22:22:13,462][106226] Updated weights for policy 0, policy_version 435882 (0.0009) [2023-12-27 22:22:13,501][106225] Updated weights for policy 1, policy_version 437238 (0.0006) [2023-12-27 22:22:13,512][106226] Updated weights for policy 0, policy_version 435892 (0.0010) [2023-12-27 22:22:13,565][106226] Updated weights for policy 0, policy_version 435902 (0.0010) [2023-12-27 22:22:13,577][106225] Updated weights for policy 1, policy_version 437248 (0.0005) [2023-12-27 22:22:13,622][106226] Updated weights for policy 0, policy_version 435912 (0.0011) [2023-12-27 22:22:13,645][106225] Updated weights for policy 1, policy_version 437258 (0.0008) [2023-12-27 22:22:14,253][106225] Updated weights for policy 1, policy_version 437268 (0.0010) [2023-12-27 22:22:14,313][106225] Updated weights for policy 1, policy_version 437278 (0.0010) [2023-12-27 22:22:14,343][106226] Updated weights for policy 0, policy_version 435922 (0.0006) [2023-12-27 22:22:14,371][106225] Updated weights for policy 1, policy_version 437288 (0.0010) [2023-12-27 22:22:14,408][106226] Updated weights for policy 0, policy_version 435932 (0.0006) [2023-12-27 22:22:14,465][106226] Updated weights for policy 0, policy_version 435942 (0.0006) [2023-12-27 22:22:15,094][106225] Updated weights for policy 1, policy_version 437298 (0.0010) [2023-12-27 22:22:15,145][106226] Updated weights for policy 0, policy_version 435952 (0.0007) [2023-12-27 22:22:15,162][106225] Updated weights for policy 1, policy_version 437308 (0.0011) [2023-12-27 22:22:15,206][106226] Updated weights for policy 0, policy_version 435962 (0.0010) [2023-12-27 22:22:15,225][106225] Updated weights for policy 1, policy_version 437318 (0.0011) [2023-12-27 22:22:15,272][106226] Updated weights for policy 0, policy_version 435972 (0.0007) [2023-12-27 22:22:15,288][106225] Updated weights for policy 1, policy_version 437328 (0.0011) [2023-12-27 22:22:15,853][106226] Updated weights for policy 0, policy_version 435982 (0.0008) [2023-12-27 22:22:15,909][106225] Updated weights for policy 1, policy_version 437338 (0.0010) [2023-12-27 22:22:15,911][106226] Updated weights for policy 0, policy_version 435992 (0.0006) [2023-12-27 22:22:15,970][106226] Updated weights for policy 0, policy_version 436002 (0.0006) [2023-12-27 22:22:15,973][106225] Updated weights for policy 1, policy_version 437348 (0.0010) [2023-12-27 22:22:16,039][106225] Updated weights for policy 1, policy_version 437358 (0.0010) [2023-12-27 22:22:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19577.5). Total num frames: 223641600. Throughput: 0: 9602.5, 1: 9672.1. Samples: 223624332. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:16,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.810')] [2023-12-27 22:22:16,707][106226] Updated weights for policy 0, policy_version 436012 (0.0006) [2023-12-27 22:22:16,750][106225] Updated weights for policy 1, policy_version 437368 (0.0008) [2023-12-27 22:22:16,771][106226] Updated weights for policy 0, policy_version 436022 (0.0006) [2023-12-27 22:22:16,807][106225] Updated weights for policy 1, policy_version 437378 (0.0008) [2023-12-27 22:22:16,832][106226] Updated weights for policy 0, policy_version 436032 (0.0007) [2023-12-27 22:22:16,855][106225] Updated weights for policy 1, policy_version 437388 (0.0007) [2023-12-27 22:22:17,451][106225] Updated weights for policy 1, policy_version 437398 (0.0008) [2023-12-27 22:22:17,465][106226] Updated weights for policy 0, policy_version 436042 (0.0008) [2023-12-27 22:22:17,499][106225] Updated weights for policy 1, policy_version 437408 (0.0010) [2023-12-27 22:22:17,530][106226] Updated weights for policy 0, policy_version 436052 (0.0006) [2023-12-27 22:22:17,543][106225] Updated weights for policy 1, policy_version 437418 (0.0010) [2023-12-27 22:22:17,597][106226] Updated weights for policy 0, policy_version 436062 (0.0005) [2023-12-27 22:22:17,663][106226] Updated weights for policy 0, policy_version 436072 (0.0005) [2023-12-27 22:22:18,200][106226] Updated weights for policy 0, policy_version 436082 (0.0005) [2023-12-27 22:22:18,256][106226] Updated weights for policy 0, policy_version 436092 (0.0005) [2023-12-27 22:22:18,300][106225] Updated weights for policy 1, policy_version 437428 (0.0010) [2023-12-27 22:22:18,312][106226] Updated weights for policy 0, policy_version 436102 (0.0005) [2023-12-27 22:22:18,357][106225] Updated weights for policy 1, policy_version 437438 (0.0010) [2023-12-27 22:22:18,426][106225] Updated weights for policy 1, policy_version 437448 (0.0010) [2023-12-27 22:22:18,979][106226] Updated weights for policy 0, policy_version 436113 (0.0010) [2023-12-27 22:22:19,041][106226] Updated weights for policy 0, policy_version 436123 (0.0010) [2023-12-27 22:22:19,095][106226] Updated weights for policy 0, policy_version 436133 (0.0010) [2023-12-27 22:22:19,115][106225] Updated weights for policy 1, policy_version 437458 (0.0009) [2023-12-27 22:22:19,175][106225] Updated weights for policy 1, policy_version 437468 (0.0008) [2023-12-27 22:22:19,238][106225] Updated weights for policy 1, policy_version 437478 (0.0007) [2023-12-27 22:22:19,304][106225] Updated weights for policy 1, policy_version 437488 (0.0008) [2023-12-27 22:22:19,843][106226] Updated weights for policy 0, policy_version 436143 (0.0009) [2023-12-27 22:22:19,912][106226] Updated weights for policy 0, policy_version 436153 (0.0008) [2023-12-27 22:22:19,982][106226] Updated weights for policy 0, policy_version 436163 (0.0010) [2023-12-27 22:22:20,079][106225] Updated weights for policy 1, policy_version 437498 (0.0011) [2023-12-27 22:22:20,138][106225] Updated weights for policy 1, policy_version 437508 (0.0010) [2023-12-27 22:22:20,204][106225] Updated weights for policy 1, policy_version 437518 (0.0008) [2023-12-27 22:22:20,756][106226] Updated weights for policy 0, policy_version 436173 (0.0009) [2023-12-27 22:22:20,819][106226] Updated weights for policy 0, policy_version 436183 (0.0011) [2023-12-27 22:22:20,885][106226] Updated weights for policy 0, policy_version 436193 (0.0011) [2023-12-27 22:22:20,889][106225] Updated weights for policy 1, policy_version 437528 (0.0010) [2023-12-27 22:22:20,950][106225] Updated weights for policy 1, policy_version 437538 (0.0011) [2023-12-27 22:22:21,012][106225] Updated weights for policy 1, policy_version 437548 (0.0007) [2023-12-27 22:22:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19549.7). Total num frames: 223739904. Throughput: 0: 9584.7, 1: 9749.2. Samples: 223744388. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:21,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.422')] [2023-12-27 22:22:21,644][106226] Updated weights for policy 0, policy_version 436203 (0.0011) [2023-12-27 22:22:21,704][106226] Updated weights for policy 0, policy_version 436213 (0.0009) [2023-12-27 22:22:21,769][106226] Updated weights for policy 0, policy_version 436223 (0.0009) [2023-12-27 22:22:21,789][106225] Updated weights for policy 1, policy_version 437558 (0.0009) [2023-12-27 22:22:21,853][106225] Updated weights for policy 1, policy_version 437568 (0.0009) [2023-12-27 22:22:21,911][106225] Updated weights for policy 1, policy_version 437578 (0.0007) [2023-12-27 22:22:22,564][106226] Updated weights for policy 0, policy_version 436233 (0.0008) [2023-12-27 22:22:22,627][106226] Updated weights for policy 0, policy_version 436243 (0.0006) [2023-12-27 22:22:22,662][106225] Updated weights for policy 1, policy_version 437588 (0.0008) [2023-12-27 22:22:22,698][106226] Updated weights for policy 0, policy_version 436253 (0.0006) [2023-12-27 22:22:22,714][106225] Updated weights for policy 1, policy_version 437598 (0.0008) [2023-12-27 22:22:22,762][106226] Updated weights for policy 0, policy_version 436263 (0.0008) [2023-12-27 22:22:22,768][106225] Updated weights for policy 1, policy_version 437608 (0.0007) [2023-12-27 22:22:23,327][106226] Updated weights for policy 0, policy_version 436273 (0.0011) [2023-12-27 22:22:23,378][106226] Updated weights for policy 0, policy_version 436283 (0.0011) [2023-12-27 22:22:23,446][106226] Updated weights for policy 0, policy_version 436293 (0.0010) [2023-12-27 22:22:23,489][106225] Updated weights for policy 1, policy_version 437618 (0.0007) [2023-12-27 22:22:23,549][106225] Updated weights for policy 1, policy_version 437628 (0.0010) [2023-12-27 22:22:23,611][106225] Updated weights for policy 1, policy_version 437638 (0.0006) [2023-12-27 22:22:23,671][106225] Updated weights for policy 1, policy_version 437648 (0.0007) [2023-12-27 22:22:24,049][106226] Updated weights for policy 0, policy_version 436303 (0.0007) [2023-12-27 22:22:24,112][106226] Updated weights for policy 0, policy_version 436313 (0.0006) [2023-12-27 22:22:24,184][106226] Updated weights for policy 0, policy_version 436323 (0.0006) [2023-12-27 22:22:24,338][106225] Updated weights for policy 1, policy_version 437658 (0.0007) [2023-12-27 22:22:24,410][106225] Updated weights for policy 1, policy_version 437668 (0.0011) [2023-12-27 22:22:24,471][106225] Updated weights for policy 1, policy_version 437678 (0.0010) [2023-12-27 22:22:24,695][106226] Updated weights for policy 0, policy_version 436333 (0.0008) [2023-12-27 22:22:24,745][106226] Updated weights for policy 0, policy_version 436343 (0.0010) [2023-12-27 22:22:24,799][106226] Updated weights for policy 0, policy_version 436353 (0.0010) [2023-12-27 22:22:25,177][106225] Updated weights for policy 1, policy_version 437688 (0.0007) [2023-12-27 22:22:25,242][106225] Updated weights for policy 1, policy_version 437698 (0.0006) [2023-12-27 22:22:25,305][106225] Updated weights for policy 1, policy_version 437708 (0.0005) [2023-12-27 22:22:25,464][106226] Updated weights for policy 0, policy_version 436363 (0.0010) [2023-12-27 22:22:25,511][106226] Updated weights for policy 0, policy_version 436373 (0.0010) [2023-12-27 22:22:25,564][106226] Updated weights for policy 0, policy_version 436383 (0.0005) [2023-12-27 22:22:25,837][106225] Updated weights for policy 1, policy_version 437718 (0.0008) [2023-12-27 22:22:25,880][106225] Updated weights for policy 1, policy_version 437728 (0.0010) [2023-12-27 22:22:25,936][106225] Updated weights for policy 1, policy_version 437738 (0.0010) [2023-12-27 22:22:26,154][106226] Updated weights for policy 0, policy_version 436393 (0.0006) [2023-12-27 22:22:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 223838208. Throughput: 0: 9624.6, 1: 9699.4. Samples: 223803248. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:26,176][105115] Avg episode reward: [(0, '-4.983'), (1, '-5.300')] [2023-12-27 22:22:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000437744_112091136.pth... [2023-12-27 22:22:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000436592_111796224.pth [2023-12-27 22:22:26,205][106226] Updated weights for policy 0, policy_version 436403 (0.0011) [2023-12-27 22:22:26,269][106226] Updated weights for policy 0, policy_version 436413 (0.0010) [2023-12-27 22:22:26,331][106226] Updated weights for policy 0, policy_version 436423 (0.0010) [2023-12-27 22:22:26,336][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000436424_111755264.pth... [2023-12-27 22:22:26,340][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000435240_111452160.pth [2023-12-27 22:22:26,685][106225] Updated weights for policy 1, policy_version 437748 (0.0011) [2023-12-27 22:22:26,738][106225] Updated weights for policy 1, policy_version 437758 (0.0010) [2023-12-27 22:22:26,809][106225] Updated weights for policy 1, policy_version 437768 (0.0007) [2023-12-27 22:22:26,994][106226] Updated weights for policy 0, policy_version 436433 (0.0005) [2023-12-27 22:22:27,055][106226] Updated weights for policy 0, policy_version 436443 (0.0007) [2023-12-27 22:22:27,116][106226] Updated weights for policy 0, policy_version 436453 (0.0005) [2023-12-27 22:22:27,499][106225] Updated weights for policy 1, policy_version 437778 (0.0009) [2023-12-27 22:22:27,552][106225] Updated weights for policy 1, policy_version 437788 (0.0010) [2023-12-27 22:22:27,612][106225] Updated weights for policy 1, policy_version 437798 (0.0010) [2023-12-27 22:22:27,657][106226] Updated weights for policy 0, policy_version 436463 (0.0009) [2023-12-27 22:22:27,669][106225] Updated weights for policy 1, policy_version 437808 (0.0008) [2023-12-27 22:22:27,711][106226] Updated weights for policy 0, policy_version 436473 (0.0010) [2023-12-27 22:22:27,767][106226] Updated weights for policy 0, policy_version 436483 (0.0010) [2023-12-27 22:22:28,239][106225] Updated weights for policy 1, policy_version 437818 (0.0011) [2023-12-27 22:22:28,297][106225] Updated weights for policy 1, policy_version 437828 (0.0011) [2023-12-27 22:22:28,354][106225] Updated weights for policy 1, policy_version 437838 (0.0010) [2023-12-27 22:22:28,558][106226] Updated weights for policy 0, policy_version 436493 (0.0009) [2023-12-27 22:22:28,623][106226] Updated weights for policy 0, policy_version 436503 (0.0008) [2023-12-27 22:22:28,685][106226] Updated weights for policy 0, policy_version 436513 (0.0008) [2023-12-27 22:22:29,053][106225] Updated weights for policy 1, policy_version 437848 (0.0010) [2023-12-27 22:22:29,104][106225] Updated weights for policy 1, policy_version 437858 (0.0010) [2023-12-27 22:22:29,147][106225] Updated weights for policy 1, policy_version 437868 (0.0008) [2023-12-27 22:22:29,351][106226] Updated weights for policy 0, policy_version 436523 (0.0009) [2023-12-27 22:22:29,418][106226] Updated weights for policy 0, policy_version 436533 (0.0007) [2023-12-27 22:22:29,482][106226] Updated weights for policy 0, policy_version 436543 (0.0009) [2023-12-27 22:22:29,931][106225] Updated weights for policy 1, policy_version 437878 (0.0006) [2023-12-27 22:22:29,990][106225] Updated weights for policy 1, policy_version 437888 (0.0008) [2023-12-27 22:22:30,039][106225] Updated weights for policy 1, policy_version 437898 (0.0008) [2023-12-27 22:22:30,183][106226] Updated weights for policy 0, policy_version 436553 (0.0006) [2023-12-27 22:22:30,246][106226] Updated weights for policy 0, policy_version 436563 (0.0009) [2023-12-27 22:22:30,308][106226] Updated weights for policy 0, policy_version 436573 (0.0009) [2023-12-27 22:22:30,370][106226] Updated weights for policy 0, policy_version 436583 (0.0007) [2023-12-27 22:22:30,673][106225] Updated weights for policy 1, policy_version 437908 (0.0007) [2023-12-27 22:22:30,733][106225] Updated weights for policy 1, policy_version 437918 (0.0010) [2023-12-27 22:22:30,792][106225] Updated weights for policy 1, policy_version 437928 (0.0010) [2023-12-27 22:22:30,964][106226] Updated weights for policy 0, policy_version 436593 (0.0008) [2023-12-27 22:22:31,035][106226] Updated weights for policy 0, policy_version 436603 (0.0009) [2023-12-27 22:22:31,101][106226] Updated weights for policy 0, policy_version 436613 (0.0008) [2023-12-27 22:22:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 223944704. Throughput: 0: 9786.0, 1: 9813.2. Samples: 223928656. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:31,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.549')] [2023-12-27 22:22:31,465][106225] Updated weights for policy 1, policy_version 437938 (0.0009) [2023-12-27 22:22:31,521][106225] Updated weights for policy 1, policy_version 437948 (0.0006) [2023-12-27 22:22:31,573][106225] Updated weights for policy 1, policy_version 437958 (0.0005) [2023-12-27 22:22:31,631][106225] Updated weights for policy 1, policy_version 437968 (0.0007) [2023-12-27 22:22:32,015][106226] Updated weights for policy 0, policy_version 436623 (0.0010) [2023-12-27 22:22:32,071][106226] Updated weights for policy 0, policy_version 436633 (0.0010) [2023-12-27 22:22:32,127][106226] Updated weights for policy 0, policy_version 436643 (0.0010) [2023-12-27 22:22:32,282][106225] Updated weights for policy 1, policy_version 437978 (0.0007) [2023-12-27 22:22:32,344][106225] Updated weights for policy 1, policy_version 437988 (0.0006) [2023-12-27 22:22:32,402][106225] Updated weights for policy 1, policy_version 437998 (0.0009) [2023-12-27 22:22:32,952][106226] Updated weights for policy 0, policy_version 436653 (0.0008) [2023-12-27 22:22:33,015][106226] Updated weights for policy 0, policy_version 436663 (0.0006) [2023-12-27 22:22:33,075][106226] Updated weights for policy 0, policy_version 436673 (0.0007) [2023-12-27 22:22:33,102][106225] Updated weights for policy 1, policy_version 438008 (0.0008) [2023-12-27 22:22:33,163][106225] Updated weights for policy 1, policy_version 438018 (0.0010) [2023-12-27 22:22:33,233][106225] Updated weights for policy 1, policy_version 438028 (0.0010) [2023-12-27 22:22:33,682][106226] Updated weights for policy 0, policy_version 436683 (0.0006) [2023-12-27 22:22:33,731][106226] Updated weights for policy 0, policy_version 436693 (0.0006) [2023-12-27 22:22:33,794][106226] Updated weights for policy 0, policy_version 436703 (0.0009) [2023-12-27 22:22:33,850][106225] Updated weights for policy 1, policy_version 438038 (0.0008) [2023-12-27 22:22:33,903][106225] Updated weights for policy 1, policy_version 438048 (0.0005) [2023-12-27 22:22:33,957][106225] Updated weights for policy 1, policy_version 438058 (0.0005) [2023-12-27 22:22:34,570][106226] Updated weights for policy 0, policy_version 436713 (0.0009) [2023-12-27 22:22:34,633][106226] Updated weights for policy 0, policy_version 436723 (0.0008) [2023-12-27 22:22:34,659][106225] Updated weights for policy 1, policy_version 438068 (0.0007) [2023-12-27 22:22:34,699][106226] Updated weights for policy 0, policy_version 436733 (0.0010) [2023-12-27 22:22:34,725][106225] Updated weights for policy 1, policy_version 438078 (0.0009) [2023-12-27 22:22:34,761][106226] Updated weights for policy 0, policy_version 436743 (0.0006) [2023-12-27 22:22:34,786][106225] Updated weights for policy 1, policy_version 438088 (0.0009) [2023-12-27 22:22:35,437][106226] Updated weights for policy 0, policy_version 436753 (0.0010) [2023-12-27 22:22:35,504][106226] Updated weights for policy 0, policy_version 436763 (0.0009) [2023-12-27 22:22:35,517][106225] Updated weights for policy 1, policy_version 438098 (0.0009) [2023-12-27 22:22:35,565][106226] Updated weights for policy 0, policy_version 436773 (0.0010) [2023-12-27 22:22:35,581][106225] Updated weights for policy 1, policy_version 438108 (0.0010) [2023-12-27 22:22:35,645][106225] Updated weights for policy 1, policy_version 438118 (0.0008) [2023-12-27 22:22:35,707][106225] Updated weights for policy 1, policy_version 438128 (0.0005) [2023-12-27 22:22:36,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 224034816. Throughput: 0: 9852.9, 1: 9836.7. Samples: 224046488. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:36,175][105115] Avg episode reward: [(0, '-5.029'), (1, '-5.383')] [2023-12-27 22:22:36,232][106226] Updated weights for policy 0, policy_version 436783 (0.0010) [2023-12-27 22:22:36,295][106226] Updated weights for policy 0, policy_version 436793 (0.0011) [2023-12-27 22:22:36,350][106225] Updated weights for policy 1, policy_version 438138 (0.0009) [2023-12-27 22:22:36,356][106226] Updated weights for policy 0, policy_version 436803 (0.0011) [2023-12-27 22:22:36,417][106225] Updated weights for policy 1, policy_version 438148 (0.0008) [2023-12-27 22:22:36,485][106225] Updated weights for policy 1, policy_version 438158 (0.0008) [2023-12-27 22:22:37,102][106226] Updated weights for policy 0, policy_version 436813 (0.0010) [2023-12-27 22:22:37,156][106226] Updated weights for policy 0, policy_version 436823 (0.0011) [2023-12-27 22:22:37,204][106225] Updated weights for policy 1, policy_version 438168 (0.0007) [2023-12-27 22:22:37,221][106226] Updated weights for policy 0, policy_version 436833 (0.0011) [2023-12-27 22:22:37,261][106225] Updated weights for policy 1, policy_version 438178 (0.0007) [2023-12-27 22:22:37,321][106225] Updated weights for policy 1, policy_version 438188 (0.0008) [2023-12-27 22:22:37,943][106226] Updated weights for policy 0, policy_version 436843 (0.0009) [2023-12-27 22:22:38,002][106226] Updated weights for policy 0, policy_version 436853 (0.0006) [2023-12-27 22:22:38,054][106226] Updated weights for policy 0, policy_version 436863 (0.0006) [2023-12-27 22:22:38,071][106225] Updated weights for policy 1, policy_version 438198 (0.0007) [2023-12-27 22:22:38,119][106225] Updated weights for policy 1, policy_version 438208 (0.0010) [2023-12-27 22:22:38,166][106225] Updated weights for policy 1, policy_version 438218 (0.0010) [2023-12-27 22:22:38,689][106226] Updated weights for policy 0, policy_version 436873 (0.0006) [2023-12-27 22:22:38,757][106226] Updated weights for policy 0, policy_version 436883 (0.0011) [2023-12-27 22:22:38,814][106226] Updated weights for policy 0, policy_version 436893 (0.0010) [2023-12-27 22:22:38,879][106226] Updated weights for policy 0, policy_version 436903 (0.0011) [2023-12-27 22:22:38,906][106225] Updated weights for policy 1, policy_version 438228 (0.0010) [2023-12-27 22:22:38,953][106225] Updated weights for policy 1, policy_version 438238 (0.0010) [2023-12-27 22:22:38,999][106225] Updated weights for policy 1, policy_version 438248 (0.0005) [2023-12-27 22:22:39,621][106226] Updated weights for policy 0, policy_version 436913 (0.0009) [2023-12-27 22:22:39,690][106226] Updated weights for policy 0, policy_version 436923 (0.0008) [2023-12-27 22:22:39,767][106226] Updated weights for policy 0, policy_version 436933 (0.0008) [2023-12-27 22:22:39,828][106225] Updated weights for policy 1, policy_version 438258 (0.0009) [2023-12-27 22:22:39,886][106225] Updated weights for policy 1, policy_version 438268 (0.0008) [2023-12-27 22:22:39,952][106225] Updated weights for policy 1, policy_version 438278 (0.0008) [2023-12-27 22:22:40,008][106225] Updated weights for policy 1, policy_version 438288 (0.0010) [2023-12-27 22:22:40,421][106226] Updated weights for policy 0, policy_version 436943 (0.0007) [2023-12-27 22:22:40,475][106226] Updated weights for policy 0, policy_version 436953 (0.0009) [2023-12-27 22:22:40,529][106226] Updated weights for policy 0, policy_version 436963 (0.0009) [2023-12-27 22:22:40,690][106225] Updated weights for policy 1, policy_version 438298 (0.0006) [2023-12-27 22:22:40,745][106225] Updated weights for policy 1, policy_version 438308 (0.0006) [2023-12-27 22:22:40,798][106225] Updated weights for policy 1, policy_version 438318 (0.0007) [2023-12-27 22:22:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 224133120. Throughput: 0: 9832.8, 1: 9851.6. Samples: 224105340. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:41,175][105115] Avg episode reward: [(0, '-5.059'), (1, '-5.799')] [2023-12-27 22:22:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000438320_112238592.pth... [2023-12-27 22:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000436968_111894528.pth... [2023-12-27 22:22:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000435816_111599616.pth [2023-12-27 22:22:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000437168_111943680.pth [2023-12-27 22:22:41,314][106226] Updated weights for policy 0, policy_version 436973 (0.0008) [2023-12-27 22:22:41,380][106226] Updated weights for policy 0, policy_version 436983 (0.0009) [2023-12-27 22:22:41,454][106226] Updated weights for policy 0, policy_version 436993 (0.0009) [2023-12-27 22:22:41,551][106225] Updated weights for policy 1, policy_version 438328 (0.0006) [2023-12-27 22:22:41,624][106225] Updated weights for policy 1, policy_version 438338 (0.0006) [2023-12-27 22:22:41,688][106225] Updated weights for policy 1, policy_version 438348 (0.0007) [2023-12-27 22:22:42,235][106226] Updated weights for policy 0, policy_version 437003 (0.0009) [2023-12-27 22:22:42,297][106226] Updated weights for policy 0, policy_version 437013 (0.0008) [2023-12-27 22:22:42,360][106226] Updated weights for policy 0, policy_version 437023 (0.0009) [2023-12-27 22:22:42,396][106225] Updated weights for policy 1, policy_version 438358 (0.0008) [2023-12-27 22:22:42,454][106225] Updated weights for policy 1, policy_version 438368 (0.0008) [2023-12-27 22:22:42,513][106225] Updated weights for policy 1, policy_version 438378 (0.0009) [2023-12-27 22:22:43,150][106226] Updated weights for policy 0, policy_version 437033 (0.0007) [2023-12-27 22:22:43,186][106225] Updated weights for policy 1, policy_version 438388 (0.0009) [2023-12-27 22:22:43,219][106226] Updated weights for policy 0, policy_version 437043 (0.0006) [2023-12-27 22:22:43,252][106225] Updated weights for policy 1, policy_version 438398 (0.0008) [2023-12-27 22:22:43,280][106226] Updated weights for policy 0, policy_version 437053 (0.0005) [2023-12-27 22:22:43,313][106225] Updated weights for policy 1, policy_version 438408 (0.0008) [2023-12-27 22:22:43,331][106226] Updated weights for policy 0, policy_version 437063 (0.0006) [2023-12-27 22:22:43,967][106225] Updated weights for policy 1, policy_version 438418 (0.0008) [2023-12-27 22:22:43,975][106226] Updated weights for policy 0, policy_version 437073 (0.0007) [2023-12-27 22:22:44,031][106225] Updated weights for policy 1, policy_version 438428 (0.0010) [2023-12-27 22:22:44,033][106226] Updated weights for policy 0, policy_version 437083 (0.0005) [2023-12-27 22:22:44,095][106226] Updated weights for policy 0, policy_version 437093 (0.0006) [2023-12-27 22:22:44,099][106225] Updated weights for policy 1, policy_version 438438 (0.0010) [2023-12-27 22:22:44,165][106225] Updated weights for policy 1, policy_version 438448 (0.0010) [2023-12-27 22:22:44,732][106226] Updated weights for policy 0, policy_version 437103 (0.0008) [2023-12-27 22:22:44,800][106226] Updated weights for policy 0, policy_version 437113 (0.0009) [2023-12-27 22:22:44,865][106226] Updated weights for policy 0, policy_version 437123 (0.0006) [2023-12-27 22:22:44,869][106225] Updated weights for policy 1, policy_version 438458 (0.0010) [2023-12-27 22:22:44,929][106225] Updated weights for policy 1, policy_version 438468 (0.0011) [2023-12-27 22:22:44,992][106225] Updated weights for policy 1, policy_version 438478 (0.0011) [2023-12-27 22:22:45,606][106226] Updated weights for policy 0, policy_version 437133 (0.0006) [2023-12-27 22:22:45,654][106226] Updated weights for policy 0, policy_version 437143 (0.0007) [2023-12-27 22:22:45,708][106226] Updated weights for policy 0, policy_version 437153 (0.0008) [2023-12-27 22:22:45,740][106225] Updated weights for policy 1, policy_version 438488 (0.0007) [2023-12-27 22:22:45,794][106225] Updated weights for policy 1, policy_version 438498 (0.0006) [2023-12-27 22:22:45,846][106225] Updated weights for policy 1, policy_version 438508 (0.0009) [2023-12-27 22:22:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 224231424. Throughput: 0: 9840.8, 1: 9860.1. Samples: 224220280. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:46,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.650')] [2023-12-27 22:22:46,491][106226] Updated weights for policy 0, policy_version 437163 (0.0007) [2023-12-27 22:22:46,510][106225] Updated weights for policy 1, policy_version 438518 (0.0008) [2023-12-27 22:22:46,558][106226] Updated weights for policy 0, policy_version 437173 (0.0005) [2023-12-27 22:22:46,571][106225] Updated weights for policy 1, policy_version 438528 (0.0010) [2023-12-27 22:22:46,618][106226] Updated weights for policy 0, policy_version 437183 (0.0007) [2023-12-27 22:22:46,632][106225] Updated weights for policy 1, policy_version 438538 (0.0010) [2023-12-27 22:22:47,288][106225] Updated weights for policy 1, policy_version 438548 (0.0008) [2023-12-27 22:22:47,307][106226] Updated weights for policy 0, policy_version 437193 (0.0007) [2023-12-27 22:22:47,338][106225] Updated weights for policy 1, policy_version 438558 (0.0010) [2023-12-27 22:22:47,362][106226] Updated weights for policy 0, policy_version 437203 (0.0008) [2023-12-27 22:22:47,397][106225] Updated weights for policy 1, policy_version 438568 (0.0010) [2023-12-27 22:22:47,422][106226] Updated weights for policy 0, policy_version 437213 (0.0007) [2023-12-27 22:22:47,480][106226] Updated weights for policy 0, policy_version 437223 (0.0008) [2023-12-27 22:22:48,091][106225] Updated weights for policy 1, policy_version 438578 (0.0010) [2023-12-27 22:22:48,139][106226] Updated weights for policy 0, policy_version 437233 (0.0007) [2023-12-27 22:22:48,156][106225] Updated weights for policy 1, policy_version 438588 (0.0010) [2023-12-27 22:22:48,200][106226] Updated weights for policy 0, policy_version 437243 (0.0009) [2023-12-27 22:22:48,218][106225] Updated weights for policy 1, policy_version 438598 (0.0011) [2023-12-27 22:22:48,255][106226] Updated weights for policy 0, policy_version 437253 (0.0005) [2023-12-27 22:22:48,275][106225] Updated weights for policy 1, policy_version 438608 (0.0010) [2023-12-27 22:22:48,991][106225] Updated weights for policy 1, policy_version 438618 (0.0010) [2023-12-27 22:22:49,019][106226] Updated weights for policy 0, policy_version 437263 (0.0009) [2023-12-27 22:22:49,045][106225] Updated weights for policy 1, policy_version 438628 (0.0010) [2023-12-27 22:22:49,079][106226] Updated weights for policy 0, policy_version 437273 (0.0011) [2023-12-27 22:22:49,095][106225] Updated weights for policy 1, policy_version 438638 (0.0010) [2023-12-27 22:22:49,126][106226] Updated weights for policy 0, policy_version 437283 (0.0010) [2023-12-27 22:22:49,865][106225] Updated weights for policy 1, policy_version 438648 (0.0012) [2023-12-27 22:22:49,887][106226] Updated weights for policy 0, policy_version 437293 (0.0010) [2023-12-27 22:22:49,916][106225] Updated weights for policy 1, policy_version 438658 (0.0006) [2023-12-27 22:22:49,956][106226] Updated weights for policy 0, policy_version 437303 (0.0010) [2023-12-27 22:22:49,981][106225] Updated weights for policy 1, policy_version 438668 (0.0008) [2023-12-27 22:22:50,019][106226] Updated weights for policy 0, policy_version 437313 (0.0011) [2023-12-27 22:22:50,744][106226] Updated weights for policy 0, policy_version 437323 (0.0010) [2023-12-27 22:22:50,795][106226] Updated weights for policy 0, policy_version 437333 (0.0008) [2023-12-27 22:22:50,814][106225] Updated weights for policy 1, policy_version 438678 (0.0006) [2023-12-27 22:22:50,845][106226] Updated weights for policy 0, policy_version 437343 (0.0007) [2023-12-27 22:22:50,881][106225] Updated weights for policy 1, policy_version 438688 (0.0007) [2023-12-27 22:22:50,939][106225] Updated weights for policy 1, policy_version 438698 (0.0007) [2023-12-27 22:22:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 224329728. Throughput: 0: 9830.8, 1: 9802.9. Samples: 224335476. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:51,175][105115] Avg episode reward: [(0, '-4.936'), (1, '-5.385')] [2023-12-27 22:22:51,638][106226] Updated weights for policy 0, policy_version 437353 (0.0008) [2023-12-27 22:22:51,686][106225] Updated weights for policy 1, policy_version 438708 (0.0008) [2023-12-27 22:22:51,703][106226] Updated weights for policy 0, policy_version 437363 (0.0008) [2023-12-27 22:22:51,758][106225] Updated weights for policy 1, policy_version 438718 (0.0010) [2023-12-27 22:22:51,772][106226] Updated weights for policy 0, policy_version 437373 (0.0009) [2023-12-27 22:22:51,821][106225] Updated weights for policy 1, policy_version 438728 (0.0010) [2023-12-27 22:22:51,836][106226] Updated weights for policy 0, policy_version 437383 (0.0008) [2023-12-27 22:22:52,523][106225] Updated weights for policy 1, policy_version 438738 (0.0010) [2023-12-27 22:22:52,582][106225] Updated weights for policy 1, policy_version 438748 (0.0006) [2023-12-27 22:22:52,638][106225] Updated weights for policy 1, policy_version 438758 (0.0008) [2023-12-27 22:22:52,672][106226] Updated weights for policy 0, policy_version 437393 (0.0011) [2023-12-27 22:22:52,690][106225] Updated weights for policy 1, policy_version 438768 (0.0010) [2023-12-27 22:22:52,729][106226] Updated weights for policy 0, policy_version 437403 (0.0011) [2023-12-27 22:22:52,799][106226] Updated weights for policy 0, policy_version 437413 (0.0010) [2023-12-27 22:22:53,318][106225] Updated weights for policy 1, policy_version 438778 (0.0010) [2023-12-27 22:22:53,372][106225] Updated weights for policy 1, policy_version 438788 (0.0010) [2023-12-27 22:22:53,418][106225] Updated weights for policy 1, policy_version 438798 (0.0010) [2023-12-27 22:22:53,476][106226] Updated weights for policy 0, policy_version 437423 (0.0007) [2023-12-27 22:22:53,534][106226] Updated weights for policy 0, policy_version 437433 (0.0008) [2023-12-27 22:22:53,590][106226] Updated weights for policy 0, policy_version 437443 (0.0008) [2023-12-27 22:22:54,095][106225] Updated weights for policy 1, policy_version 438808 (0.0006) [2023-12-27 22:22:54,154][106225] Updated weights for policy 1, policy_version 438818 (0.0005) [2023-12-27 22:22:54,213][106225] Updated weights for policy 1, policy_version 438828 (0.0005) [2023-12-27 22:22:54,354][106226] Updated weights for policy 0, policy_version 437453 (0.0008) [2023-12-27 22:22:54,407][106226] Updated weights for policy 0, policy_version 437463 (0.0008) [2023-12-27 22:22:54,460][106226] Updated weights for policy 0, policy_version 437473 (0.0009) [2023-12-27 22:22:54,730][106225] Updated weights for policy 1, policy_version 438838 (0.0005) [2023-12-27 22:22:54,774][106225] Updated weights for policy 1, policy_version 438848 (0.0005) [2023-12-27 22:22:54,820][106225] Updated weights for policy 1, policy_version 438858 (0.0007) [2023-12-27 22:22:55,319][106226] Updated weights for policy 0, policy_version 437483 (0.0008) [2023-12-27 22:22:55,371][106226] Updated weights for policy 0, policy_version 437493 (0.0009) [2023-12-27 22:22:55,409][106225] Updated weights for policy 1, policy_version 438868 (0.0008) [2023-12-27 22:22:55,421][106226] Updated weights for policy 0, policy_version 437503 (0.0009) [2023-12-27 22:22:55,456][106225] Updated weights for policy 1, policy_version 438878 (0.0005) [2023-12-27 22:22:55,502][106225] Updated weights for policy 1, policy_version 438888 (0.0010) [2023-12-27 22:22:56,086][106225] Updated weights for policy 1, policy_version 438898 (0.0009) [2023-12-27 22:22:56,141][106225] Updated weights for policy 1, policy_version 438908 (0.0005) [2023-12-27 22:22:56,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 224419840. Throughput: 0: 9782.5, 1: 9800.8. Samples: 224392212. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:22:56,175][105115] Avg episode reward: [(0, '-5.131'), (1, '-5.604')] [2023-12-27 22:22:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000437512_112033792.pth... [2023-12-27 22:22:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000436424_111755264.pth [2023-12-27 22:22:56,197][106225] Updated weights for policy 1, policy_version 438918 (0.0007) [2023-12-27 22:22:56,245][106226] Updated weights for policy 0, policy_version 437513 (0.0008) [2023-12-27 22:22:56,255][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000438928_112394240.pth... [2023-12-27 22:22:56,258][106225] Updated weights for policy 1, policy_version 438928 (0.0010) [2023-12-27 22:22:56,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000437744_112091136.pth [2023-12-27 22:22:56,305][106226] Updated weights for policy 0, policy_version 437523 (0.0006) [2023-12-27 22:22:56,368][106226] Updated weights for policy 0, policy_version 437533 (0.0005) [2023-12-27 22:22:56,425][106226] Updated weights for policy 0, policy_version 437543 (0.0008) [2023-12-27 22:22:56,896][106225] Updated weights for policy 1, policy_version 438938 (0.0005) [2023-12-27 22:22:56,956][106225] Updated weights for policy 1, policy_version 438948 (0.0007) [2023-12-27 22:22:57,018][106225] Updated weights for policy 1, policy_version 438958 (0.0007) [2023-12-27 22:22:57,106][106226] Updated weights for policy 0, policy_version 437553 (0.0010) [2023-12-27 22:22:57,153][106226] Updated weights for policy 0, policy_version 437563 (0.0010) [2023-12-27 22:22:57,216][106226] Updated weights for policy 0, policy_version 437573 (0.0011) [2023-12-27 22:22:57,589][106225] Updated weights for policy 1, policy_version 438968 (0.0007) [2023-12-27 22:22:57,643][106225] Updated weights for policy 1, policy_version 438978 (0.0007) [2023-12-27 22:22:57,700][106225] Updated weights for policy 1, policy_version 438988 (0.0008) [2023-12-27 22:22:57,939][106226] Updated weights for policy 0, policy_version 437583 (0.0011) [2023-12-27 22:22:57,998][106226] Updated weights for policy 0, policy_version 437593 (0.0011) [2023-12-27 22:22:58,052][106226] Updated weights for policy 0, policy_version 437603 (0.0010) [2023-12-27 22:22:58,444][106225] Updated weights for policy 1, policy_version 438998 (0.0008) [2023-12-27 22:22:58,505][106225] Updated weights for policy 1, policy_version 439008 (0.0008) [2023-12-27 22:22:58,568][106225] Updated weights for policy 1, policy_version 439018 (0.0008) [2023-12-27 22:22:58,788][106226] Updated weights for policy 0, policy_version 437613 (0.0006) [2023-12-27 22:22:58,865][106226] Updated weights for policy 0, policy_version 437623 (0.0008) [2023-12-27 22:22:58,927][106226] Updated weights for policy 0, policy_version 437633 (0.0009) [2023-12-27 22:22:59,328][106225] Updated weights for policy 1, policy_version 439028 (0.0008) [2023-12-27 22:22:59,397][106225] Updated weights for policy 1, policy_version 439038 (0.0008) [2023-12-27 22:22:59,465][106225] Updated weights for policy 1, policy_version 439048 (0.0008) [2023-12-27 22:22:59,681][106226] Updated weights for policy 0, policy_version 437643 (0.0008) [2023-12-27 22:22:59,742][106226] Updated weights for policy 0, policy_version 437653 (0.0005) [2023-12-27 22:22:59,815][106226] Updated weights for policy 0, policy_version 437663 (0.0007) [2023-12-27 22:23:00,208][106225] Updated weights for policy 1, policy_version 439058 (0.0009) [2023-12-27 22:23:00,279][106225] Updated weights for policy 1, policy_version 439068 (0.0006) [2023-12-27 22:23:00,347][106225] Updated weights for policy 1, policy_version 439078 (0.0005) [2023-12-27 22:23:00,410][106225] Updated weights for policy 1, policy_version 439088 (0.0006) [2023-12-27 22:23:00,462][106226] Updated weights for policy 0, policy_version 437673 (0.0009) [2023-12-27 22:23:00,523][106226] Updated weights for policy 0, policy_version 437683 (0.0008) [2023-12-27 22:23:00,571][106226] Updated weights for policy 0, policy_version 437693 (0.0008) [2023-12-27 22:23:00,630][106226] Updated weights for policy 0, policy_version 437703 (0.0009) [2023-12-27 22:23:01,078][106225] Updated weights for policy 1, policy_version 439098 (0.0008) [2023-12-27 22:23:01,149][106225] Updated weights for policy 1, policy_version 439108 (0.0007) [2023-12-27 22:23:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 224518144. Throughput: 0: 9744.4, 1: 9985.5. Samples: 224512176. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:23:01,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-5.441')] [2023-12-27 22:23:01,212][106225] Updated weights for policy 1, policy_version 439118 (0.0008) [2023-12-27 22:23:01,420][106226] Updated weights for policy 0, policy_version 437713 (0.0010) [2023-12-27 22:23:01,477][106226] Updated weights for policy 0, policy_version 437723 (0.0010) [2023-12-27 22:23:01,555][106226] Updated weights for policy 0, policy_version 437733 (0.0011) [2023-12-27 22:23:01,955][106225] Updated weights for policy 1, policy_version 439128 (0.0008) [2023-12-27 22:23:02,013][106225] Updated weights for policy 1, policy_version 439138 (0.0008) [2023-12-27 22:23:02,071][106225] Updated weights for policy 1, policy_version 439148 (0.0008) [2023-12-27 22:23:02,370][106226] Updated weights for policy 0, policy_version 437744 (0.0009) [2023-12-27 22:23:02,431][106226] Updated weights for policy 0, policy_version 437754 (0.0009) [2023-12-27 22:23:02,490][106226] Updated weights for policy 0, policy_version 437764 (0.0008) [2023-12-27 22:23:02,797][106225] Updated weights for policy 1, policy_version 439158 (0.0008) [2023-12-27 22:23:02,860][106225] Updated weights for policy 1, policy_version 439168 (0.0009) [2023-12-27 22:23:02,920][106225] Updated weights for policy 1, policy_version 439178 (0.0009) [2023-12-27 22:23:03,217][106226] Updated weights for policy 0, policy_version 437774 (0.0007) [2023-12-27 22:23:03,278][106226] Updated weights for policy 0, policy_version 437784 (0.0006) [2023-12-27 22:23:03,339][106226] Updated weights for policy 0, policy_version 437794 (0.0005) [2023-12-27 22:23:03,509][106225] Updated weights for policy 1, policy_version 439188 (0.0009) [2023-12-27 22:23:03,560][106225] Updated weights for policy 1, policy_version 439198 (0.0005) [2023-12-27 22:23:03,611][106225] Updated weights for policy 1, policy_version 439208 (0.0005) [2023-12-27 22:23:04,046][106226] Updated weights for policy 0, policy_version 437804 (0.0009) [2023-12-27 22:23:04,107][106226] Updated weights for policy 0, policy_version 437814 (0.0010) [2023-12-27 22:23:04,172][106226] Updated weights for policy 0, policy_version 437824 (0.0009) [2023-12-27 22:23:04,209][106225] Updated weights for policy 1, policy_version 439218 (0.0005) [2023-12-27 22:23:04,271][106225] Updated weights for policy 1, policy_version 439228 (0.0009) [2023-12-27 22:23:04,333][106225] Updated weights for policy 1, policy_version 439238 (0.0010) [2023-12-27 22:23:04,396][106225] Updated weights for policy 1, policy_version 439248 (0.0010) [2023-12-27 22:23:04,920][106226] Updated weights for policy 0, policy_version 437834 (0.0008) [2023-12-27 22:23:04,983][106226] Updated weights for policy 0, policy_version 437844 (0.0006) [2023-12-27 22:23:05,048][106226] Updated weights for policy 0, policy_version 437854 (0.0005) [2023-12-27 22:23:05,099][106225] Updated weights for policy 1, policy_version 439258 (0.0010) [2023-12-27 22:23:05,114][106226] Updated weights for policy 0, policy_version 437864 (0.0006) [2023-12-27 22:23:05,153][106225] Updated weights for policy 1, policy_version 439268 (0.0010) [2023-12-27 22:23:05,205][106225] Updated weights for policy 1, policy_version 439278 (0.0010) [2023-12-27 22:23:05,770][106226] Updated weights for policy 0, policy_version 437874 (0.0008) [2023-12-27 22:23:05,834][106226] Updated weights for policy 0, policy_version 437884 (0.0008) [2023-12-27 22:23:05,893][106226] Updated weights for policy 0, policy_version 437894 (0.0006) [2023-12-27 22:23:05,935][106225] Updated weights for policy 1, policy_version 439288 (0.0010) [2023-12-27 22:23:05,988][106225] Updated weights for policy 1, policy_version 439298 (0.0010) [2023-12-27 22:23:06,053][106225] Updated weights for policy 1, policy_version 439308 (0.0010) [2023-12-27 22:23:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 224624640. Throughput: 0: 9677.3, 1: 10010.5. Samples: 224630340. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:23:06,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-5.371')] [2023-12-27 22:23:06,468][106226] Updated weights for policy 0, policy_version 437904 (0.0008) [2023-12-27 22:23:06,529][106226] Updated weights for policy 0, policy_version 437914 (0.0008) [2023-12-27 22:23:06,596][106226] Updated weights for policy 0, policy_version 437924 (0.0007) [2023-12-27 22:23:06,825][106225] Updated weights for policy 1, policy_version 439318 (0.0010) [2023-12-27 22:23:06,887][106225] Updated weights for policy 1, policy_version 439328 (0.0010) [2023-12-27 22:23:06,942][106225] Updated weights for policy 1, policy_version 439338 (0.0010) [2023-12-27 22:23:07,213][106226] Updated weights for policy 0, policy_version 437934 (0.0005) [2023-12-27 22:23:07,273][106226] Updated weights for policy 0, policy_version 437944 (0.0005) [2023-12-27 22:23:07,339][106226] Updated weights for policy 0, policy_version 437954 (0.0005) [2023-12-27 22:23:07,622][106225] Updated weights for policy 1, policy_version 439348 (0.0010) [2023-12-27 22:23:07,676][106225] Updated weights for policy 1, policy_version 439358 (0.0007) [2023-12-27 22:23:07,734][106225] Updated weights for policy 1, policy_version 439368 (0.0008) [2023-12-27 22:23:07,983][106226] Updated weights for policy 0, policy_version 437964 (0.0005) [2023-12-27 22:23:08,047][106226] Updated weights for policy 0, policy_version 437974 (0.0006) [2023-12-27 22:23:08,111][106226] Updated weights for policy 0, policy_version 437984 (0.0005) [2023-12-27 22:23:08,445][106225] Updated weights for policy 1, policy_version 439378 (0.0006) [2023-12-27 22:23:08,509][106225] Updated weights for policy 1, policy_version 439388 (0.0008) [2023-12-27 22:23:08,575][106225] Updated weights for policy 1, policy_version 439398 (0.0008) [2023-12-27 22:23:08,640][106225] Updated weights for policy 1, policy_version 439408 (0.0009) [2023-12-27 22:23:08,726][106226] Updated weights for policy 0, policy_version 437994 (0.0007) [2023-12-27 22:23:08,787][106226] Updated weights for policy 0, policy_version 438004 (0.0008) [2023-12-27 22:23:08,850][106226] Updated weights for policy 0, policy_version 438014 (0.0006) [2023-12-27 22:23:08,908][106226] Updated weights for policy 0, policy_version 438024 (0.0008) [2023-12-27 22:23:09,392][106225] Updated weights for policy 1, policy_version 439418 (0.0008) [2023-12-27 22:23:09,465][106225] Updated weights for policy 1, policy_version 439428 (0.0007) [2023-12-27 22:23:09,523][106225] Updated weights for policy 1, policy_version 439438 (0.0008) [2023-12-27 22:23:09,690][106226] Updated weights for policy 0, policy_version 438034 (0.0009) [2023-12-27 22:23:09,755][106226] Updated weights for policy 0, policy_version 438044 (0.0009) [2023-12-27 22:23:09,818][106226] Updated weights for policy 0, policy_version 438054 (0.0008) [2023-12-27 22:23:10,311][106225] Updated weights for policy 1, policy_version 439448 (0.0008) [2023-12-27 22:23:10,372][106225] Updated weights for policy 1, policy_version 439458 (0.0008) [2023-12-27 22:23:10,435][106225] Updated weights for policy 1, policy_version 439468 (0.0008) [2023-12-27 22:23:10,605][106226] Updated weights for policy 0, policy_version 438064 (0.0010) [2023-12-27 22:23:10,670][106226] Updated weights for policy 0, policy_version 438074 (0.0011) [2023-12-27 22:23:10,733][106226] Updated weights for policy 0, policy_version 438084 (0.0011) [2023-12-27 22:23:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 224714752. Throughput: 0: 9704.6, 1: 10024.9. Samples: 224691072. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:23:11,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-5.319')] [2023-12-27 22:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000439472_112533504.pth... [2023-12-27 22:23:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000438088_112181248.pth... [2023-12-27 22:23:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000436968_111894528.pth [2023-12-27 22:23:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000438320_112238592.pth [2023-12-27 22:23:11,259][106225] Updated weights for policy 1, policy_version 439478 (0.0008) [2023-12-27 22:23:11,332][106225] Updated weights for policy 1, policy_version 439488 (0.0008) [2023-12-27 22:23:11,377][106226] Updated weights for policy 0, policy_version 438094 (0.0009) [2023-12-27 22:23:11,399][106225] Updated weights for policy 1, policy_version 439498 (0.0008) [2023-12-27 22:23:11,449][106226] Updated weights for policy 0, policy_version 438104 (0.0008) [2023-12-27 22:23:11,516][106226] Updated weights for policy 0, policy_version 438114 (0.0009) [2023-12-27 22:23:12,135][106225] Updated weights for policy 1, policy_version 439508 (0.0009) [2023-12-27 22:23:12,189][106225] Updated weights for policy 1, policy_version 439518 (0.0009) [2023-12-27 22:23:12,250][106225] Updated weights for policy 1, policy_version 439528 (0.0009) [2023-12-27 22:23:12,278][106226] Updated weights for policy 0, policy_version 438124 (0.0008) [2023-12-27 22:23:12,334][106226] Updated weights for policy 0, policy_version 438134 (0.0008) [2023-12-27 22:23:12,401][106226] Updated weights for policy 0, policy_version 438144 (0.0009) [2023-12-27 22:23:12,996][106225] Updated weights for policy 1, policy_version 439538 (0.0008) [2023-12-27 22:23:13,054][106225] Updated weights for policy 1, policy_version 439548 (0.0008) [2023-12-27 22:23:13,117][106225] Updated weights for policy 1, policy_version 439558 (0.0008) [2023-12-27 22:23:13,162][106226] Updated weights for policy 0, policy_version 438154 (0.0009) [2023-12-27 22:23:13,177][106225] Updated weights for policy 1, policy_version 439568 (0.0007) [2023-12-27 22:23:13,227][106226] Updated weights for policy 0, policy_version 438164 (0.0011) [2023-12-27 22:23:13,290][106226] Updated weights for policy 0, policy_version 438174 (0.0011) [2023-12-27 22:23:13,350][106226] Updated weights for policy 0, policy_version 438184 (0.0011) [2023-12-27 22:23:13,921][106225] Updated weights for policy 1, policy_version 439578 (0.0008) [2023-12-27 22:23:13,982][106225] Updated weights for policy 1, policy_version 439588 (0.0008) [2023-12-27 22:23:14,043][106225] Updated weights for policy 1, policy_version 439598 (0.0007) [2023-12-27 22:23:14,048][106226] Updated weights for policy 0, policy_version 438194 (0.0011) [2023-12-27 22:23:14,098][106226] Updated weights for policy 0, policy_version 438204 (0.0010) [2023-12-27 22:23:14,157][106226] Updated weights for policy 0, policy_version 438214 (0.0011) [2023-12-27 22:23:14,755][106225] Updated weights for policy 1, policy_version 439608 (0.0007) [2023-12-27 22:23:14,822][106225] Updated weights for policy 1, policy_version 439618 (0.0008) [2023-12-27 22:23:14,863][106226] Updated weights for policy 0, policy_version 438224 (0.0008) [2023-12-27 22:23:14,887][106225] Updated weights for policy 1, policy_version 439628 (0.0005) [2023-12-27 22:23:14,931][106226] Updated weights for policy 0, policy_version 438234 (0.0007) [2023-12-27 22:23:15,004][106226] Updated weights for policy 0, policy_version 438244 (0.0006) [2023-12-27 22:23:15,631][106225] Updated weights for policy 1, policy_version 439638 (0.0008) [2023-12-27 22:23:15,671][106226] Updated weights for policy 0, policy_version 438254 (0.0006) [2023-12-27 22:23:15,690][106225] Updated weights for policy 1, policy_version 439648 (0.0008) [2023-12-27 22:23:15,733][106226] Updated weights for policy 0, policy_version 438264 (0.0006) [2023-12-27 22:23:15,755][106225] Updated weights for policy 1, policy_version 439658 (0.0008) [2023-12-27 22:23:15,791][106226] Updated weights for policy 0, policy_version 438274 (0.0007) [2023-12-27 22:23:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 224813056. Throughput: 0: 9548.0, 1: 9873.9. Samples: 224802640. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-27 22:23:16,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.408')] [2023-12-27 22:23:16,436][106226] Updated weights for policy 0, policy_version 438284 (0.0006) [2023-12-27 22:23:16,497][106226] Updated weights for policy 0, policy_version 438294 (0.0007) [2023-12-27 22:23:16,525][106225] Updated weights for policy 1, policy_version 439668 (0.0009) [2023-12-27 22:23:16,556][106226] Updated weights for policy 0, policy_version 438304 (0.0005) [2023-12-27 22:23:16,586][106225] Updated weights for policy 1, policy_version 439678 (0.0008) [2023-12-27 22:23:16,650][106225] Updated weights for policy 1, policy_version 439688 (0.0006) [2023-12-27 22:23:17,252][106226] Updated weights for policy 0, policy_version 438314 (0.0008) [2023-12-27 22:23:17,308][106226] Updated weights for policy 0, policy_version 438324 (0.0011) [2023-12-27 22:23:17,345][106225] Updated weights for policy 1, policy_version 439698 (0.0008) [2023-12-27 22:23:17,358][106226] Updated weights for policy 0, policy_version 438334 (0.0010) [2023-12-27 22:23:17,405][106226] Updated weights for policy 0, policy_version 438344 (0.0010) [2023-12-27 22:23:17,407][106225] Updated weights for policy 1, policy_version 439708 (0.0005) [2023-12-27 22:23:17,469][106225] Updated weights for policy 1, policy_version 439718 (0.0008) [2023-12-27 22:23:17,536][106225] Updated weights for policy 1, policy_version 439728 (0.0007) [2023-12-27 22:23:18,081][106226] Updated weights for policy 0, policy_version 438354 (0.0008) [2023-12-27 22:23:18,112][106225] Updated weights for policy 1, policy_version 439738 (0.0008) [2023-12-27 22:23:18,143][106226] Updated weights for policy 0, policy_version 438364 (0.0007) [2023-12-27 22:23:18,167][106225] Updated weights for policy 1, policy_version 439748 (0.0008) [2023-12-27 22:23:18,205][106226] Updated weights for policy 0, policy_version 438374 (0.0010) [2023-12-27 22:23:18,218][106225] Updated weights for policy 1, policy_version 439758 (0.0005) [2023-12-27 22:23:18,873][106226] Updated weights for policy 0, policy_version 438384 (0.0009) [2023-12-27 22:23:18,934][106226] Updated weights for policy 0, policy_version 438394 (0.0007) [2023-12-27 22:23:18,943][106225] Updated weights for policy 1, policy_version 439768 (0.0008) [2023-12-27 22:23:18,994][106226] Updated weights for policy 0, policy_version 438404 (0.0007) [2023-12-27 22:23:19,000][106225] Updated weights for policy 1, policy_version 439778 (0.0007) [2023-12-27 22:23:19,055][106225] Updated weights for policy 1, policy_version 439788 (0.0008) [2023-12-27 22:23:19,639][106226] Updated weights for policy 0, policy_version 438414 (0.0007) [2023-12-27 22:23:19,703][106226] Updated weights for policy 0, policy_version 438424 (0.0007) [2023-12-27 22:23:19,769][106226] Updated weights for policy 0, policy_version 438434 (0.0008) [2023-12-27 22:23:19,920][106225] Updated weights for policy 1, policy_version 439798 (0.0008) [2023-12-27 22:23:19,992][106225] Updated weights for policy 1, policy_version 439808 (0.0009) [2023-12-27 22:23:20,060][106225] Updated weights for policy 1, policy_version 439818 (0.0009) [2023-12-27 22:23:20,475][106226] Updated weights for policy 0, policy_version 438444 (0.0008) [2023-12-27 22:23:20,529][106226] Updated weights for policy 0, policy_version 438454 (0.0009) [2023-12-27 22:23:20,612][106226] Updated weights for policy 0, policy_version 438464 (0.0008) [2023-12-27 22:23:20,705][106225] Updated weights for policy 1, policy_version 439828 (0.0008) [2023-12-27 22:23:20,759][106225] Updated weights for policy 1, policy_version 439838 (0.0008) [2023-12-27 22:23:20,814][106225] Updated weights for policy 1, policy_version 439848 (0.0008) [2023-12-27 22:23:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19549.7). Total num frames: 224911360. Throughput: 0: 9637.3, 1: 9800.0. Samples: 224921168. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:21,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-5.415')] [2023-12-27 22:23:21,373][106226] Updated weights for policy 0, policy_version 438474 (0.0007) [2023-12-27 22:23:21,438][106226] Updated weights for policy 0, policy_version 438484 (0.0009) [2023-12-27 22:23:21,498][106226] Updated weights for policy 0, policy_version 438494 (0.0007) [2023-12-27 22:23:21,559][106226] Updated weights for policy 0, policy_version 438504 (0.0007) [2023-12-27 22:23:21,657][106225] Updated weights for policy 1, policy_version 439858 (0.0008) [2023-12-27 22:23:21,723][106225] Updated weights for policy 1, policy_version 439868 (0.0008) [2023-12-27 22:23:21,790][106225] Updated weights for policy 1, policy_version 439878 (0.0008) [2023-12-27 22:23:21,847][106225] Updated weights for policy 1, policy_version 439888 (0.0009) [2023-12-27 22:23:22,298][106226] Updated weights for policy 0, policy_version 438514 (0.0009) [2023-12-27 22:23:22,362][106226] Updated weights for policy 0, policy_version 438524 (0.0008) [2023-12-27 22:23:22,429][106226] Updated weights for policy 0, policy_version 438534 (0.0009) [2023-12-27 22:23:22,618][106225] Updated weights for policy 1, policy_version 439898 (0.0009) [2023-12-27 22:23:22,691][106225] Updated weights for policy 1, policy_version 439908 (0.0007) [2023-12-27 22:23:22,757][106225] Updated weights for policy 1, policy_version 439918 (0.0007) [2023-12-27 22:23:23,194][106226] Updated weights for policy 0, policy_version 438544 (0.0008) [2023-12-27 22:23:23,252][106226] Updated weights for policy 0, policy_version 438554 (0.0008) [2023-12-27 22:23:23,315][106226] Updated weights for policy 0, policy_version 438564 (0.0007) [2023-12-27 22:23:23,398][106225] Updated weights for policy 1, policy_version 439928 (0.0010) [2023-12-27 22:23:23,455][106225] Updated weights for policy 1, policy_version 439938 (0.0010) [2023-12-27 22:23:23,518][106225] Updated weights for policy 1, policy_version 439948 (0.0010) [2023-12-27 22:23:23,885][106226] Updated weights for policy 0, policy_version 438574 (0.0007) [2023-12-27 22:23:23,942][106226] Updated weights for policy 0, policy_version 438584 (0.0008) [2023-12-27 22:23:23,997][106226] Updated weights for policy 0, policy_version 438594 (0.0008) [2023-12-27 22:23:24,214][106225] Updated weights for policy 1, policy_version 439958 (0.0008) [2023-12-27 22:23:24,268][106225] Updated weights for policy 1, policy_version 439968 (0.0006) [2023-12-27 22:23:24,317][106225] Updated weights for policy 1, policy_version 439978 (0.0007) [2023-12-27 22:23:24,731][106226] Updated weights for policy 0, policy_version 438604 (0.0007) [2023-12-27 22:23:24,792][106226] Updated weights for policy 0, policy_version 438614 (0.0005) [2023-12-27 22:23:24,849][106226] Updated weights for policy 0, policy_version 438624 (0.0006) [2023-12-27 22:23:25,044][106225] Updated weights for policy 1, policy_version 439988 (0.0009) [2023-12-27 22:23:25,103][106225] Updated weights for policy 1, policy_version 439998 (0.0010) [2023-12-27 22:23:25,157][106225] Updated weights for policy 1, policy_version 440008 (0.0010) [2023-12-27 22:23:25,482][106226] Updated weights for policy 0, policy_version 438634 (0.0010) [2023-12-27 22:23:25,535][106226] Updated weights for policy 0, policy_version 438644 (0.0010) [2023-12-27 22:23:25,581][106226] Updated weights for policy 0, policy_version 438654 (0.0010) [2023-12-27 22:23:25,630][106226] Updated weights for policy 0, policy_version 438664 (0.0010) [2023-12-27 22:23:25,894][106225] Updated weights for policy 1, policy_version 440018 (0.0010) [2023-12-27 22:23:25,946][106225] Updated weights for policy 1, policy_version 440028 (0.0008) [2023-12-27 22:23:26,003][106225] Updated weights for policy 1, policy_version 440038 (0.0008) [2023-12-27 22:23:26,065][106225] Updated weights for policy 1, policy_version 440048 (0.0009) [2023-12-27 22:23:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.4, 300 sec: 19521.9). Total num frames: 225009664. Throughput: 0: 9622.3, 1: 9761.2. Samples: 224977596. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:26,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.435')] [2023-12-27 22:23:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000440048_112680960.pth... [2023-12-27 22:23:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000438664_112328704.pth... [2023-12-27 22:23:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000438928_112394240.pth [2023-12-27 22:23:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000437512_112033792.pth [2023-12-27 22:23:26,319][106226] Updated weights for policy 0, policy_version 438674 (0.0009) [2023-12-27 22:23:26,389][106226] Updated weights for policy 0, policy_version 438684 (0.0008) [2023-12-27 22:23:26,462][106226] Updated weights for policy 0, policy_version 438694 (0.0006) [2023-12-27 22:23:26,678][106225] Updated weights for policy 1, policy_version 440058 (0.0007) [2023-12-27 22:23:26,735][106225] Updated weights for policy 1, policy_version 440068 (0.0008) [2023-12-27 22:23:26,788][106225] Updated weights for policy 1, policy_version 440078 (0.0008) [2023-12-27 22:23:27,119][106226] Updated weights for policy 0, policy_version 438704 (0.0008) [2023-12-27 22:23:27,169][106226] Updated weights for policy 0, policy_version 438714 (0.0008) [2023-12-27 22:23:27,226][106226] Updated weights for policy 0, policy_version 438724 (0.0008) [2023-12-27 22:23:27,475][106225] Updated weights for policy 1, policy_version 440088 (0.0009) [2023-12-27 22:23:27,536][106225] Updated weights for policy 1, policy_version 440098 (0.0009) [2023-12-27 22:23:27,600][106225] Updated weights for policy 1, policy_version 440108 (0.0009) [2023-12-27 22:23:27,917][106226] Updated weights for policy 0, policy_version 438734 (0.0009) [2023-12-27 22:23:27,986][106226] Updated weights for policy 0, policy_version 438744 (0.0008) [2023-12-27 22:23:28,046][106226] Updated weights for policy 0, policy_version 438754 (0.0008) [2023-12-27 22:23:28,252][106225] Updated weights for policy 1, policy_version 440118 (0.0009) [2023-12-27 22:23:28,317][106225] Updated weights for policy 1, policy_version 440128 (0.0009) [2023-12-27 22:23:28,383][106225] Updated weights for policy 1, policy_version 440138 (0.0008) [2023-12-27 22:23:28,769][106226] Updated weights for policy 0, policy_version 438764 (0.0008) [2023-12-27 22:23:28,833][106226] Updated weights for policy 0, policy_version 438774 (0.0008) [2023-12-27 22:23:28,890][106226] Updated weights for policy 0, policy_version 438784 (0.0009) [2023-12-27 22:23:29,102][106225] Updated weights for policy 1, policy_version 440148 (0.0008) [2023-12-27 22:23:29,149][106225] Updated weights for policy 1, policy_version 440158 (0.0008) [2023-12-27 22:23:29,212][106225] Updated weights for policy 1, policy_version 440168 (0.0006) [2023-12-27 22:23:29,638][106226] Updated weights for policy 0, policy_version 438794 (0.0009) [2023-12-27 22:23:29,691][106226] Updated weights for policy 0, policy_version 438804 (0.0008) [2023-12-27 22:23:29,748][106226] Updated weights for policy 0, policy_version 438814 (0.0008) [2023-12-27 22:23:29,804][106226] Updated weights for policy 0, policy_version 438824 (0.0009) [2023-12-27 22:23:29,938][106225] Updated weights for policy 1, policy_version 440178 (0.0008) [2023-12-27 22:23:29,996][106225] Updated weights for policy 1, policy_version 440188 (0.0008) [2023-12-27 22:23:30,053][106225] Updated weights for policy 1, policy_version 440198 (0.0005) [2023-12-27 22:23:30,109][106225] Updated weights for policy 1, policy_version 440208 (0.0006) [2023-12-27 22:23:30,626][106226] Updated weights for policy 0, policy_version 438834 (0.0005) [2023-12-27 22:23:30,688][106226] Updated weights for policy 0, policy_version 438844 (0.0005) [2023-12-27 22:23:30,699][106225] Updated weights for policy 1, policy_version 440218 (0.0007) [2023-12-27 22:23:30,758][106226] Updated weights for policy 0, policy_version 438854 (0.0005) [2023-12-27 22:23:30,766][106225] Updated weights for policy 1, policy_version 440228 (0.0008) [2023-12-27 22:23:30,825][106225] Updated weights for policy 1, policy_version 440238 (0.0009) [2023-12-27 22:23:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19521.9). Total num frames: 225107968. Throughput: 0: 9672.9, 1: 9805.9. Samples: 225096824. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:31,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.446')] [2023-12-27 22:23:31,453][106226] Updated weights for policy 0, policy_version 438864 (0.0008) [2023-12-27 22:23:31,523][106226] Updated weights for policy 0, policy_version 438874 (0.0008) [2023-12-27 22:23:31,560][106225] Updated weights for policy 1, policy_version 440248 (0.0008) [2023-12-27 22:23:31,586][106226] Updated weights for policy 0, policy_version 438884 (0.0007) [2023-12-27 22:23:31,621][106225] Updated weights for policy 1, policy_version 440258 (0.0008) [2023-12-27 22:23:31,688][106225] Updated weights for policy 1, policy_version 440268 (0.0007) [2023-12-27 22:23:32,306][106226] Updated weights for policy 0, policy_version 438894 (0.0009) [2023-12-27 22:23:32,380][106226] Updated weights for policy 0, policy_version 438904 (0.0008) [2023-12-27 22:23:32,443][106226] Updated weights for policy 0, policy_version 438914 (0.0008) [2023-12-27 22:23:32,487][106225] Updated weights for policy 1, policy_version 440278 (0.0007) [2023-12-27 22:23:32,559][106225] Updated weights for policy 1, policy_version 440288 (0.0006) [2023-12-27 22:23:32,629][106225] Updated weights for policy 1, policy_version 440298 (0.0006) [2023-12-27 22:23:33,210][106226] Updated weights for policy 0, policy_version 438924 (0.0008) [2023-12-27 22:23:33,220][106225] Updated weights for policy 1, policy_version 440308 (0.0007) [2023-12-27 22:23:33,264][106226] Updated weights for policy 0, policy_version 438934 (0.0006) [2023-12-27 22:23:33,277][106225] Updated weights for policy 1, policy_version 440318 (0.0007) [2023-12-27 22:23:33,322][106226] Updated weights for policy 0, policy_version 438944 (0.0006) [2023-12-27 22:23:33,331][106225] Updated weights for policy 1, policy_version 440328 (0.0006) [2023-12-27 22:23:34,005][106226] Updated weights for policy 0, policy_version 438954 (0.0008) [2023-12-27 22:23:34,052][106226] Updated weights for policy 0, policy_version 438964 (0.0008) [2023-12-27 22:23:34,057][106225] Updated weights for policy 1, policy_version 440338 (0.0007) [2023-12-27 22:23:34,097][106226] Updated weights for policy 0, policy_version 438974 (0.0006) [2023-12-27 22:23:34,110][106225] Updated weights for policy 1, policy_version 440348 (0.0010) [2023-12-27 22:23:34,151][106226] Updated weights for policy 0, policy_version 438984 (0.0006) [2023-12-27 22:23:34,175][106225] Updated weights for policy 1, policy_version 440358 (0.0010) [2023-12-27 22:23:34,234][106225] Updated weights for policy 1, policy_version 440368 (0.0010) [2023-12-27 22:23:34,929][106226] Updated weights for policy 0, policy_version 438994 (0.0007) [2023-12-27 22:23:34,953][106225] Updated weights for policy 1, policy_version 440378 (0.0010) [2023-12-27 22:23:34,986][106226] Updated weights for policy 0, policy_version 439004 (0.0006) [2023-12-27 22:23:35,017][106225] Updated weights for policy 1, policy_version 440388 (0.0007) [2023-12-27 22:23:35,047][106226] Updated weights for policy 0, policy_version 439014 (0.0005) [2023-12-27 22:23:35,074][106225] Updated weights for policy 1, policy_version 440398 (0.0010) [2023-12-27 22:23:35,691][106225] Updated weights for policy 1, policy_version 440408 (0.0006) [2023-12-27 22:23:35,747][106225] Updated weights for policy 1, policy_version 440418 (0.0010) [2023-12-27 22:23:35,812][106225] Updated weights for policy 1, policy_version 440428 (0.0011) [2023-12-27 22:23:35,823][106226] Updated weights for policy 0, policy_version 439024 (0.0006) [2023-12-27 22:23:35,883][106226] Updated weights for policy 0, policy_version 439034 (0.0007) [2023-12-27 22:23:35,934][106226] Updated weights for policy 0, policy_version 439044 (0.0008) [2023-12-27 22:23:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 225206272. Throughput: 0: 9653.5, 1: 9864.7. Samples: 225213796. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:36,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-5.582')] [2023-12-27 22:23:36,515][106225] Updated weights for policy 1, policy_version 440438 (0.0011) [2023-12-27 22:23:36,567][106225] Updated weights for policy 1, policy_version 440448 (0.0010) [2023-12-27 22:23:36,626][106225] Updated weights for policy 1, policy_version 440458 (0.0010) [2023-12-27 22:23:36,687][106226] Updated weights for policy 0, policy_version 439054 (0.0008) [2023-12-27 22:23:36,740][106226] Updated weights for policy 0, policy_version 439064 (0.0009) [2023-12-27 22:23:36,802][106226] Updated weights for policy 0, policy_version 439074 (0.0008) [2023-12-27 22:23:37,379][106225] Updated weights for policy 1, policy_version 440468 (0.0009) [2023-12-27 22:23:37,439][106225] Updated weights for policy 1, policy_version 440478 (0.0008) [2023-12-27 22:23:37,504][106225] Updated weights for policy 1, policy_version 440488 (0.0008) [2023-12-27 22:23:37,504][106226] Updated weights for policy 0, policy_version 439084 (0.0009) [2023-12-27 22:23:37,556][106226] Updated weights for policy 0, policy_version 439094 (0.0008) [2023-12-27 22:23:37,614][106226] Updated weights for policy 0, policy_version 439104 (0.0009) [2023-12-27 22:23:38,119][106225] Updated weights for policy 1, policy_version 440498 (0.0006) [2023-12-27 22:23:38,178][106225] Updated weights for policy 1, policy_version 440508 (0.0005) [2023-12-27 22:23:38,235][106225] Updated weights for policy 1, policy_version 440518 (0.0005) [2023-12-27 22:23:38,296][106225] Updated weights for policy 1, policy_version 440528 (0.0005) [2023-12-27 22:23:38,378][106226] Updated weights for policy 0, policy_version 439114 (0.0007) [2023-12-27 22:23:38,440][106226] Updated weights for policy 0, policy_version 439124 (0.0008) [2023-12-27 22:23:38,497][106226] Updated weights for policy 0, policy_version 439134 (0.0008) [2023-12-27 22:23:38,561][106226] Updated weights for policy 0, policy_version 439144 (0.0007) [2023-12-27 22:23:38,984][106225] Updated weights for policy 1, policy_version 440538 (0.0009) [2023-12-27 22:23:39,050][106225] Updated weights for policy 1, policy_version 440548 (0.0008) [2023-12-27 22:23:39,113][106225] Updated weights for policy 1, policy_version 440558 (0.0009) [2023-12-27 22:23:39,306][106226] Updated weights for policy 0, policy_version 439154 (0.0008) [2023-12-27 22:23:39,377][106226] Updated weights for policy 0, policy_version 439164 (0.0009) [2023-12-27 22:23:39,453][106226] Updated weights for policy 0, policy_version 439174 (0.0007) [2023-12-27 22:23:39,922][106225] Updated weights for policy 1, policy_version 440568 (0.0008) [2023-12-27 22:23:39,992][106225] Updated weights for policy 1, policy_version 440578 (0.0007) [2023-12-27 22:23:40,057][106225] Updated weights for policy 1, policy_version 440588 (0.0007) [2023-12-27 22:23:40,179][106226] Updated weights for policy 0, policy_version 439184 (0.0008) [2023-12-27 22:23:40,242][106226] Updated weights for policy 0, policy_version 439194 (0.0008) [2023-12-27 22:23:40,309][106226] Updated weights for policy 0, policy_version 439204 (0.0008) [2023-12-27 22:23:40,758][106225] Updated weights for policy 1, policy_version 440598 (0.0008) [2023-12-27 22:23:40,813][106225] Updated weights for policy 1, policy_version 440608 (0.0008) [2023-12-27 22:23:40,865][106225] Updated weights for policy 1, policy_version 440618 (0.0008) [2023-12-27 22:23:41,057][106226] Updated weights for policy 0, policy_version 439214 (0.0008) [2023-12-27 22:23:41,128][106226] Updated weights for policy 0, policy_version 439224 (0.0009) [2023-12-27 22:23:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19521.9). Total num frames: 225296384. Throughput: 0: 9666.1, 1: 9889.1. Samples: 225272200. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:41,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-5.649')] [2023-12-27 22:23:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000440624_112828416.pth... [2023-12-27 22:23:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000439472_112533504.pth [2023-12-27 22:23:41,200][106226] Updated weights for policy 0, policy_version 439234 (0.0007) [2023-12-27 22:23:41,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000439240_112476160.pth... [2023-12-27 22:23:41,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000438088_112181248.pth [2023-12-27 22:23:41,695][106225] Updated weights for policy 1, policy_version 440628 (0.0008) [2023-12-27 22:23:41,762][106225] Updated weights for policy 1, policy_version 440638 (0.0009) [2023-12-27 22:23:41,822][106225] Updated weights for policy 1, policy_version 440648 (0.0009) [2023-12-27 22:23:41,972][106226] Updated weights for policy 0, policy_version 439244 (0.0007) [2023-12-27 22:23:42,051][106226] Updated weights for policy 0, policy_version 439254 (0.0009) [2023-12-27 22:23:42,129][106226] Updated weights for policy 0, policy_version 439264 (0.0009) [2023-12-27 22:23:42,518][106225] Updated weights for policy 1, policy_version 440658 (0.0008) [2023-12-27 22:23:42,584][106225] Updated weights for policy 1, policy_version 440668 (0.0008) [2023-12-27 22:23:42,643][106225] Updated weights for policy 1, policy_version 440678 (0.0008) [2023-12-27 22:23:42,709][106225] Updated weights for policy 1, policy_version 440688 (0.0008) [2023-12-27 22:23:42,840][106226] Updated weights for policy 0, policy_version 439274 (0.0007) [2023-12-27 22:23:42,894][106226] Updated weights for policy 0, policy_version 439284 (0.0007) [2023-12-27 22:23:42,951][106226] Updated weights for policy 0, policy_version 439294 (0.0007) [2023-12-27 22:23:43,004][106226] Updated weights for policy 0, policy_version 439304 (0.0008) [2023-12-27 22:23:43,364][106225] Updated weights for policy 1, policy_version 440698 (0.0005) [2023-12-27 22:23:43,415][106225] Updated weights for policy 1, policy_version 440708 (0.0005) [2023-12-27 22:23:43,466][106225] Updated weights for policy 1, policy_version 440718 (0.0005) [2023-12-27 22:23:43,791][106226] Updated weights for policy 0, policy_version 439314 (0.0009) [2023-12-27 22:23:43,856][106226] Updated weights for policy 0, policy_version 439324 (0.0006) [2023-12-27 22:23:43,926][106226] Updated weights for policy 0, policy_version 439334 (0.0005) [2023-12-27 22:23:44,097][106225] Updated weights for policy 1, policy_version 440728 (0.0009) [2023-12-27 22:23:44,163][106225] Updated weights for policy 1, policy_version 440738 (0.0010) [2023-12-27 22:23:44,227][106225] Updated weights for policy 1, policy_version 440748 (0.0010) [2023-12-27 22:23:44,570][106226] Updated weights for policy 0, policy_version 439344 (0.0008) [2023-12-27 22:23:44,626][106226] Updated weights for policy 0, policy_version 439354 (0.0008) [2023-12-27 22:23:44,672][106226] Updated weights for policy 0, policy_version 439364 (0.0007) [2023-12-27 22:23:44,945][106225] Updated weights for policy 1, policy_version 440758 (0.0010) [2023-12-27 22:23:45,014][106225] Updated weights for policy 1, policy_version 440768 (0.0011) [2023-12-27 22:23:45,078][106225] Updated weights for policy 1, policy_version 440778 (0.0010) [2023-12-27 22:23:45,418][106226] Updated weights for policy 0, policy_version 439374 (0.0006) [2023-12-27 22:23:45,480][106226] Updated weights for policy 0, policy_version 439384 (0.0007) [2023-12-27 22:23:45,543][106226] Updated weights for policy 0, policy_version 439394 (0.0011) [2023-12-27 22:23:45,786][106225] Updated weights for policy 1, policy_version 440788 (0.0009) [2023-12-27 22:23:45,848][106225] Updated weights for policy 1, policy_version 440798 (0.0008) [2023-12-27 22:23:45,906][106225] Updated weights for policy 1, policy_version 440808 (0.0008) [2023-12-27 22:23:46,117][106226] Updated weights for policy 0, policy_version 439404 (0.0008) [2023-12-27 22:23:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19521.9). Total num frames: 225394688. Throughput: 0: 9687.1, 1: 9722.5. Samples: 225385612. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:46,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-5.218')] [2023-12-27 22:23:46,182][106226] Updated weights for policy 0, policy_version 439414 (0.0006) [2023-12-27 22:23:46,244][106226] Updated weights for policy 0, policy_version 439424 (0.0006) [2023-12-27 22:23:46,714][106225] Updated weights for policy 1, policy_version 440818 (0.0009) [2023-12-27 22:23:46,775][106225] Updated weights for policy 1, policy_version 440828 (0.0008) [2023-12-27 22:23:46,822][106226] Updated weights for policy 0, policy_version 439434 (0.0006) [2023-12-27 22:23:46,838][106225] Updated weights for policy 1, policy_version 440838 (0.0007) [2023-12-27 22:23:46,890][106226] Updated weights for policy 0, policy_version 439444 (0.0011) [2023-12-27 22:23:46,902][106225] Updated weights for policy 1, policy_version 440848 (0.0006) [2023-12-27 22:23:46,955][106226] Updated weights for policy 0, policy_version 439454 (0.0011) [2023-12-27 22:23:47,017][106226] Updated weights for policy 0, policy_version 439464 (0.0011) [2023-12-27 22:23:47,586][106225] Updated weights for policy 1, policy_version 440858 (0.0008) [2023-12-27 22:23:47,644][106225] Updated weights for policy 1, policy_version 440868 (0.0008) [2023-12-27 22:23:47,704][106225] Updated weights for policy 1, policy_version 440878 (0.0006) [2023-12-27 22:23:47,717][106226] Updated weights for policy 0, policy_version 439474 (0.0009) [2023-12-27 22:23:47,782][106226] Updated weights for policy 0, policy_version 439484 (0.0006) [2023-12-27 22:23:47,838][106226] Updated weights for policy 0, policy_version 439494 (0.0006) [2023-12-27 22:23:48,273][106225] Updated weights for policy 1, policy_version 440888 (0.0008) [2023-12-27 22:23:48,329][106225] Updated weights for policy 1, policy_version 440898 (0.0007) [2023-12-27 22:23:48,393][106225] Updated weights for policy 1, policy_version 440908 (0.0008) [2023-12-27 22:23:48,519][106226] Updated weights for policy 0, policy_version 439504 (0.0007) [2023-12-27 22:23:48,585][106226] Updated weights for policy 0, policy_version 439514 (0.0006) [2023-12-27 22:23:48,646][106226] Updated weights for policy 0, policy_version 439524 (0.0008) [2023-12-27 22:23:49,144][106225] Updated weights for policy 1, policy_version 440918 (0.0009) [2023-12-27 22:23:49,194][106225] Updated weights for policy 1, policy_version 440928 (0.0010) [2023-12-27 22:23:49,260][106226] Updated weights for policy 0, policy_version 439534 (0.0008) [2023-12-27 22:23:49,261][106225] Updated weights for policy 1, policy_version 440938 (0.0009) [2023-12-27 22:23:49,321][106226] Updated weights for policy 0, policy_version 439544 (0.0006) [2023-12-27 22:23:49,397][106226] Updated weights for policy 0, policy_version 439554 (0.0008) [2023-12-27 22:23:50,002][106225] Updated weights for policy 1, policy_version 440948 (0.0007) [2023-12-27 22:23:50,057][106225] Updated weights for policy 1, policy_version 440958 (0.0005) [2023-12-27 22:23:50,116][106225] Updated weights for policy 1, policy_version 440968 (0.0008) [2023-12-27 22:23:50,131][106226] Updated weights for policy 0, policy_version 439564 (0.0009) [2023-12-27 22:23:50,198][106226] Updated weights for policy 0, policy_version 439574 (0.0007) [2023-12-27 22:23:50,264][106226] Updated weights for policy 0, policy_version 439584 (0.0007) [2023-12-27 22:23:50,795][106225] Updated weights for policy 1, policy_version 440978 (0.0007) [2023-12-27 22:23:50,859][106225] Updated weights for policy 1, policy_version 440988 (0.0008) [2023-12-27 22:23:50,922][106225] Updated weights for policy 1, policy_version 440998 (0.0009) [2023-12-27 22:23:50,979][106225] Updated weights for policy 1, policy_version 441008 (0.0008) [2023-12-27 22:23:51,009][106226] Updated weights for policy 0, policy_version 439594 (0.0008) [2023-12-27 22:23:51,077][106226] Updated weights for policy 0, policy_version 439604 (0.0008) [2023-12-27 22:23:51,142][106226] Updated weights for policy 0, policy_version 439614 (0.0008) [2023-12-27 22:23:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19522.0). Total num frames: 225492992. Throughput: 0: 9762.9, 1: 9672.6. Samples: 225504936. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:51,175][105115] Avg episode reward: [(0, '-5.118'), (1, '-5.685')] [2023-12-27 22:23:51,205][106226] Updated weights for policy 0, policy_version 439624 (0.0008) [2023-12-27 22:23:51,766][106225] Updated weights for policy 1, policy_version 441018 (0.0008) [2023-12-27 22:23:51,824][106225] Updated weights for policy 1, policy_version 441028 (0.0008) [2023-12-27 22:23:51,880][106225] Updated weights for policy 1, policy_version 441038 (0.0008) [2023-12-27 22:23:51,978][106226] Updated weights for policy 0, policy_version 439634 (0.0011) [2023-12-27 22:23:52,041][106226] Updated weights for policy 0, policy_version 439644 (0.0010) [2023-12-27 22:23:52,093][106226] Updated weights for policy 0, policy_version 439654 (0.0010) [2023-12-27 22:23:52,636][106225] Updated weights for policy 1, policy_version 441048 (0.0007) [2023-12-27 22:23:52,705][106225] Updated weights for policy 1, policy_version 441058 (0.0006) [2023-12-27 22:23:52,766][106225] Updated weights for policy 1, policy_version 441068 (0.0007) [2023-12-27 22:23:52,813][106226] Updated weights for policy 0, policy_version 439664 (0.0010) [2023-12-27 22:23:52,871][106226] Updated weights for policy 0, policy_version 439674 (0.0009) [2023-12-27 22:23:52,935][106226] Updated weights for policy 0, policy_version 439684 (0.0007) [2023-12-27 22:23:53,423][106225] Updated weights for policy 1, policy_version 441078 (0.0008) [2023-12-27 22:23:53,484][106225] Updated weights for policy 1, policy_version 441088 (0.0009) [2023-12-27 22:23:53,546][106225] Updated weights for policy 1, policy_version 441098 (0.0009) [2023-12-27 22:23:53,667][106226] Updated weights for policy 0, policy_version 439694 (0.0010) [2023-12-27 22:23:53,727][106226] Updated weights for policy 0, policy_version 439704 (0.0010) [2023-12-27 22:23:53,776][106226] Updated weights for policy 0, policy_version 439714 (0.0010) [2023-12-27 22:23:54,179][106225] Updated weights for policy 1, policy_version 441108 (0.0010) [2023-12-27 22:23:54,239][106225] Updated weights for policy 1, policy_version 441118 (0.0010) [2023-12-27 22:23:54,288][106225] Updated weights for policy 1, policy_version 441128 (0.0010) [2023-12-27 22:23:54,464][106226] Updated weights for policy 0, policy_version 439724 (0.0009) [2023-12-27 22:23:54,518][106226] Updated weights for policy 0, policy_version 439734 (0.0007) [2023-12-27 22:23:54,569][106226] Updated weights for policy 0, policy_version 439744 (0.0008) [2023-12-27 22:23:55,018][106225] Updated weights for policy 1, policy_version 441138 (0.0010) [2023-12-27 22:23:55,067][106225] Updated weights for policy 1, policy_version 441148 (0.0008) [2023-12-27 22:23:55,119][106225] Updated weights for policy 1, policy_version 441158 (0.0008) [2023-12-27 22:23:55,165][106225] Updated weights for policy 1, policy_version 441168 (0.0008) [2023-12-27 22:23:55,232][106226] Updated weights for policy 0, policy_version 439754 (0.0007) [2023-12-27 22:23:55,280][106226] Updated weights for policy 0, policy_version 439764 (0.0008) [2023-12-27 22:23:55,327][106226] Updated weights for policy 0, policy_version 439774 (0.0006) [2023-12-27 22:23:55,381][106226] Updated weights for policy 0, policy_version 439784 (0.0008) [2023-12-27 22:23:55,961][106225] Updated weights for policy 1, policy_version 441178 (0.0010) [2023-12-27 22:23:56,018][106225] Updated weights for policy 1, policy_version 441188 (0.0008) [2023-12-27 22:23:56,053][106226] Updated weights for policy 0, policy_version 439794 (0.0005) [2023-12-27 22:23:56,070][106225] Updated weights for policy 1, policy_version 441198 (0.0008) [2023-12-27 22:23:56,104][106226] Updated weights for policy 0, policy_version 439804 (0.0005) [2023-12-27 22:23:56,150][106226] Updated weights for policy 0, policy_version 439814 (0.0005) [2023-12-27 22:23:56,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 225599488. Throughput: 0: 9685.4, 1: 9659.9. Samples: 225561604. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:23:56,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.612')] [2023-12-27 22:23:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000441200_112975872.pth... [2023-12-27 22:23:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000439816_112623616.pth... [2023-12-27 22:23:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000440048_112680960.pth [2023-12-27 22:23:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000438664_112328704.pth [2023-12-27 22:23:56,741][106226] Updated weights for policy 0, policy_version 439824 (0.0008) [2023-12-27 22:23:56,792][106226] Updated weights for policy 0, policy_version 439834 (0.0009) [2023-12-27 22:23:56,817][106225] Updated weights for policy 1, policy_version 441208 (0.0007) [2023-12-27 22:23:56,842][106226] Updated weights for policy 0, policy_version 439844 (0.0007) [2023-12-27 22:23:56,872][106225] Updated weights for policy 1, policy_version 441218 (0.0006) [2023-12-27 22:23:56,930][106225] Updated weights for policy 1, policy_version 441228 (0.0008) [2023-12-27 22:23:57,590][106226] Updated weights for policy 0, policy_version 439854 (0.0007) [2023-12-27 22:23:57,645][106226] Updated weights for policy 0, policy_version 439864 (0.0007) [2023-12-27 22:23:57,647][106225] Updated weights for policy 1, policy_version 441238 (0.0007) [2023-12-27 22:23:57,700][106225] Updated weights for policy 1, policy_version 441248 (0.0006) [2023-12-27 22:23:57,706][106226] Updated weights for policy 0, policy_version 439874 (0.0008) [2023-12-27 22:23:57,759][106225] Updated weights for policy 1, policy_version 441258 (0.0006) [2023-12-27 22:23:58,483][106225] Updated weights for policy 1, policy_version 441268 (0.0008) [2023-12-27 22:23:58,498][106226] Updated weights for policy 0, policy_version 439884 (0.0008) [2023-12-27 22:23:58,549][106225] Updated weights for policy 1, policy_version 441278 (0.0008) [2023-12-27 22:23:58,563][106226] Updated weights for policy 0, policy_version 439894 (0.0008) [2023-12-27 22:23:58,612][106225] Updated weights for policy 1, policy_version 441288 (0.0008) [2023-12-27 22:23:58,627][106226] Updated weights for policy 0, policy_version 439904 (0.0008) [2023-12-27 22:23:59,458][106226] Updated weights for policy 0, policy_version 439914 (0.0008) [2023-12-27 22:23:59,518][106226] Updated weights for policy 0, policy_version 439924 (0.0007) [2023-12-27 22:23:59,533][106225] Updated weights for policy 1, policy_version 441298 (0.0010) [2023-12-27 22:23:59,581][106226] Updated weights for policy 0, policy_version 439934 (0.0006) [2023-12-27 22:23:59,590][106225] Updated weights for policy 1, policy_version 441308 (0.0010) [2023-12-27 22:23:59,640][106226] Updated weights for policy 0, policy_version 439944 (0.0006) [2023-12-27 22:23:59,653][106225] Updated weights for policy 1, policy_version 441318 (0.0011) [2023-12-27 22:23:59,718][106225] Updated weights for policy 1, policy_version 441328 (0.0010) [2023-12-27 22:24:00,421][106225] Updated weights for policy 1, policy_version 441338 (0.0005) [2023-12-27 22:24:00,434][106226] Updated weights for policy 0, policy_version 439954 (0.0009) [2023-12-27 22:24:00,482][106225] Updated weights for policy 1, policy_version 441348 (0.0006) [2023-12-27 22:24:00,496][106226] Updated weights for policy 0, policy_version 439964 (0.0007) [2023-12-27 22:24:00,537][106225] Updated weights for policy 1, policy_version 441358 (0.0006) [2023-12-27 22:24:00,547][106226] Updated weights for policy 0, policy_version 439974 (0.0007) [2023-12-27 22:24:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 225681408. Throughput: 0: 9726.4, 1: 9693.3. Samples: 225676524. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:01,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-5.599')] [2023-12-27 22:24:01,229][106225] Updated weights for policy 1, policy_version 441368 (0.0010) [2023-12-27 22:24:01,288][106225] Updated weights for policy 1, policy_version 441378 (0.0010) [2023-12-27 22:24:01,300][106226] Updated weights for policy 0, policy_version 439984 (0.0007) [2023-12-27 22:24:01,338][106225] Updated weights for policy 1, policy_version 441388 (0.0009) [2023-12-27 22:24:01,365][106226] Updated weights for policy 0, policy_version 439994 (0.0007) [2023-12-27 22:24:01,434][106226] Updated weights for policy 0, policy_version 440004 (0.0009) [2023-12-27 22:24:02,050][106225] Updated weights for policy 1, policy_version 441398 (0.0011) [2023-12-27 22:24:02,103][106225] Updated weights for policy 1, policy_version 441408 (0.0009) [2023-12-27 22:24:02,153][106226] Updated weights for policy 0, policy_version 440014 (0.0007) [2023-12-27 22:24:02,168][106225] Updated weights for policy 1, policy_version 441418 (0.0007) [2023-12-27 22:24:02,213][106226] Updated weights for policy 0, policy_version 440024 (0.0009) [2023-12-27 22:24:02,278][106226] Updated weights for policy 0, policy_version 440034 (0.0011) [2023-12-27 22:24:02,866][106225] Updated weights for policy 1, policy_version 441428 (0.0006) [2023-12-27 22:24:02,924][106225] Updated weights for policy 1, policy_version 441438 (0.0007) [2023-12-27 22:24:02,976][106226] Updated weights for policy 0, policy_version 440044 (0.0011) [2023-12-27 22:24:02,979][106225] Updated weights for policy 1, policy_version 441448 (0.0007) [2023-12-27 22:24:03,036][106226] Updated weights for policy 0, policy_version 440054 (0.0011) [2023-12-27 22:24:03,100][106226] Updated weights for policy 0, policy_version 440064 (0.0011) [2023-12-27 22:24:03,571][106225] Updated weights for policy 1, policy_version 441458 (0.0009) [2023-12-27 22:24:03,640][106225] Updated weights for policy 1, policy_version 441468 (0.0010) [2023-12-27 22:24:03,686][106225] Updated weights for policy 1, policy_version 441478 (0.0010) [2023-12-27 22:24:03,735][106225] Updated weights for policy 1, policy_version 441488 (0.0006) [2023-12-27 22:24:03,747][106226] Updated weights for policy 0, policy_version 440074 (0.0011) [2023-12-27 22:24:03,799][106226] Updated weights for policy 0, policy_version 440084 (0.0010) [2023-12-27 22:24:03,854][106226] Updated weights for policy 0, policy_version 440094 (0.0010) [2023-12-27 22:24:03,918][106226] Updated weights for policy 0, policy_version 440104 (0.0011) [2023-12-27 22:24:04,462][106225] Updated weights for policy 1, policy_version 441498 (0.0005) [2023-12-27 22:24:04,514][106225] Updated weights for policy 1, policy_version 441508 (0.0008) [2023-12-27 22:24:04,559][106225] Updated weights for policy 1, policy_version 441518 (0.0010) [2023-12-27 22:24:04,608][106226] Updated weights for policy 0, policy_version 440114 (0.0010) [2023-12-27 22:24:04,667][106226] Updated weights for policy 0, policy_version 440124 (0.0009) [2023-12-27 22:24:04,716][106226] Updated weights for policy 0, policy_version 440134 (0.0009) [2023-12-27 22:24:05,307][106225] Updated weights for policy 1, policy_version 441528 (0.0010) [2023-12-27 22:24:05,368][106225] Updated weights for policy 1, policy_version 441538 (0.0010) [2023-12-27 22:24:05,428][106225] Updated weights for policy 1, policy_version 441548 (0.0010) [2023-12-27 22:24:05,473][106226] Updated weights for policy 0, policy_version 440144 (0.0007) [2023-12-27 22:24:05,531][106226] Updated weights for policy 0, policy_version 440154 (0.0008) [2023-12-27 22:24:05,585][106226] Updated weights for policy 0, policy_version 440164 (0.0008) [2023-12-27 22:24:06,147][106225] Updated weights for policy 1, policy_version 441558 (0.0009) [2023-12-27 22:24:06,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 225779712. Throughput: 0: 9654.6, 1: 9741.1. Samples: 225793972. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:06,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-5.380')] [2023-12-27 22:24:06,212][106225] Updated weights for policy 1, policy_version 441568 (0.0010) [2023-12-27 22:24:06,279][106225] Updated weights for policy 1, policy_version 441578 (0.0011) [2023-12-27 22:24:06,376][106226] Updated weights for policy 0, policy_version 440174 (0.0008) [2023-12-27 22:24:06,444][106226] Updated weights for policy 0, policy_version 440184 (0.0008) [2023-12-27 22:24:06,513][106226] Updated weights for policy 0, policy_version 440194 (0.0008) [2023-12-27 22:24:07,086][106225] Updated weights for policy 1, policy_version 441588 (0.0009) [2023-12-27 22:24:07,149][106225] Updated weights for policy 1, policy_version 441598 (0.0008) [2023-12-27 22:24:07,150][106226] Updated weights for policy 0, policy_version 440204 (0.0008) [2023-12-27 22:24:07,203][106226] Updated weights for policy 0, policy_version 440214 (0.0007) [2023-12-27 22:24:07,209][106225] Updated weights for policy 1, policy_version 441608 (0.0007) [2023-12-27 22:24:07,257][106226] Updated weights for policy 0, policy_version 440224 (0.0006) [2023-12-27 22:24:07,842][106225] Updated weights for policy 1, policy_version 441618 (0.0007) [2023-12-27 22:24:07,902][106225] Updated weights for policy 1, policy_version 441628 (0.0009) [2023-12-27 22:24:07,965][106225] Updated weights for policy 1, policy_version 441638 (0.0008) [2023-12-27 22:24:07,988][106226] Updated weights for policy 0, policy_version 440234 (0.0009) [2023-12-27 22:24:08,029][106225] Updated weights for policy 1, policy_version 441648 (0.0008) [2023-12-27 22:24:08,050][106226] Updated weights for policy 0, policy_version 440244 (0.0011) [2023-12-27 22:24:08,116][106226] Updated weights for policy 0, policy_version 440254 (0.0011) [2023-12-27 22:24:08,173][106226] Updated weights for policy 0, policy_version 440264 (0.0011) [2023-12-27 22:24:08,767][106225] Updated weights for policy 1, policy_version 441658 (0.0007) [2023-12-27 22:24:08,828][106225] Updated weights for policy 1, policy_version 441668 (0.0006) [2023-12-27 22:24:08,868][106226] Updated weights for policy 0, policy_version 440274 (0.0007) [2023-12-27 22:24:08,886][106225] Updated weights for policy 1, policy_version 441678 (0.0007) [2023-12-27 22:24:08,928][106226] Updated weights for policy 0, policy_version 440284 (0.0008) [2023-12-27 22:24:08,983][106226] Updated weights for policy 0, policy_version 440294 (0.0010) [2023-12-27 22:24:09,655][106226] Updated weights for policy 0, policy_version 440304 (0.0007) [2023-12-27 22:24:09,710][106225] Updated weights for policy 1, policy_version 441688 (0.0007) [2023-12-27 22:24:09,721][106226] Updated weights for policy 0, policy_version 440314 (0.0010) [2023-12-27 22:24:09,779][106225] Updated weights for policy 1, policy_version 441698 (0.0009) [2023-12-27 22:24:09,784][106226] Updated weights for policy 0, policy_version 440324 (0.0011) [2023-12-27 22:24:09,851][106225] Updated weights for policy 1, policy_version 441708 (0.0008) [2023-12-27 22:24:10,466][106225] Updated weights for policy 1, policy_version 441718 (0.0007) [2023-12-27 22:24:10,522][106225] Updated weights for policy 1, policy_version 441728 (0.0006) [2023-12-27 22:24:10,579][106225] Updated weights for policy 1, policy_version 441738 (0.0008) [2023-12-27 22:24:10,677][106226] Updated weights for policy 0, policy_version 440334 (0.0010) [2023-12-27 22:24:10,730][106226] Updated weights for policy 0, policy_version 440344 (0.0009) [2023-12-27 22:24:10,787][106226] Updated weights for policy 0, policy_version 440354 (0.0009) [2023-12-27 22:24:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.8, 300 sec: 19494.2). Total num frames: 225878016. Throughput: 0: 9672.2, 1: 9760.2. Samples: 225852056. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:11,175][105115] Avg episode reward: [(0, '-5.024'), (1, '-5.268')] [2023-12-27 22:24:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000441744_113115136.pth... [2023-12-27 22:24:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000440360_112762880.pth... [2023-12-27 22:24:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000439240_112476160.pth [2023-12-27 22:24:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000440624_112828416.pth [2023-12-27 22:24:11,313][106225] Updated weights for policy 1, policy_version 441748 (0.0008) [2023-12-27 22:24:11,382][106225] Updated weights for policy 1, policy_version 441758 (0.0007) [2023-12-27 22:24:11,447][106225] Updated weights for policy 1, policy_version 441768 (0.0008) [2023-12-27 22:24:11,614][106226] Updated weights for policy 0, policy_version 440364 (0.0009) [2023-12-27 22:24:11,688][106226] Updated weights for policy 0, policy_version 440374 (0.0008) [2023-12-27 22:24:11,758][106226] Updated weights for policy 0, policy_version 440384 (0.0009) [2023-12-27 22:24:12,154][106225] Updated weights for policy 1, policy_version 441778 (0.0009) [2023-12-27 22:24:12,218][106225] Updated weights for policy 1, policy_version 441788 (0.0008) [2023-12-27 22:24:12,279][106225] Updated weights for policy 1, policy_version 441798 (0.0007) [2023-12-27 22:24:12,347][106225] Updated weights for policy 1, policy_version 441808 (0.0008) [2023-12-27 22:24:12,544][106226] Updated weights for policy 0, policy_version 440394 (0.0010) [2023-12-27 22:24:12,604][106226] Updated weights for policy 0, policy_version 440404 (0.0009) [2023-12-27 22:24:12,660][106226] Updated weights for policy 0, policy_version 440414 (0.0009) [2023-12-27 22:24:12,712][106226] Updated weights for policy 0, policy_version 440424 (0.0009) [2023-12-27 22:24:13,030][106225] Updated weights for policy 1, policy_version 441818 (0.0005) [2023-12-27 22:24:13,095][106225] Updated weights for policy 1, policy_version 441828 (0.0007) [2023-12-27 22:24:13,157][106225] Updated weights for policy 1, policy_version 441838 (0.0008) [2023-12-27 22:24:13,434][106226] Updated weights for policy 0, policy_version 440434 (0.0006) [2023-12-27 22:24:13,488][106226] Updated weights for policy 0, policy_version 440444 (0.0009) [2023-12-27 22:24:13,553][106226] Updated weights for policy 0, policy_version 440454 (0.0007) [2023-12-27 22:24:13,728][106225] Updated weights for policy 1, policy_version 441848 (0.0006) [2023-12-27 22:24:13,774][106225] Updated weights for policy 1, policy_version 441858 (0.0005) [2023-12-27 22:24:13,820][106225] Updated weights for policy 1, policy_version 441868 (0.0005) [2023-12-27 22:24:14,323][106226] Updated weights for policy 0, policy_version 440464 (0.0008) [2023-12-27 22:24:14,384][106226] Updated weights for policy 0, policy_version 440474 (0.0009) [2023-12-27 22:24:14,395][106225] Updated weights for policy 1, policy_version 441878 (0.0007) [2023-12-27 22:24:14,436][106226] Updated weights for policy 0, policy_version 440484 (0.0006) [2023-12-27 22:24:14,448][106225] Updated weights for policy 1, policy_version 441888 (0.0007) [2023-12-27 22:24:14,509][106225] Updated weights for policy 1, policy_version 441898 (0.0005) [2023-12-27 22:24:15,088][106226] Updated weights for policy 0, policy_version 440494 (0.0008) [2023-12-27 22:24:15,151][106226] Updated weights for policy 0, policy_version 440504 (0.0008) [2023-12-27 22:24:15,219][106226] Updated weights for policy 0, policy_version 440514 (0.0006) [2023-12-27 22:24:15,272][106225] Updated weights for policy 1, policy_version 441908 (0.0007) [2023-12-27 22:24:15,332][106225] Updated weights for policy 1, policy_version 441918 (0.0007) [2023-12-27 22:24:15,399][106225] Updated weights for policy 1, policy_version 441928 (0.0008) [2023-12-27 22:24:15,850][106226] Updated weights for policy 0, policy_version 440524 (0.0009) [2023-12-27 22:24:15,907][106226] Updated weights for policy 0, policy_version 440534 (0.0009) [2023-12-27 22:24:15,966][106226] Updated weights for policy 0, policy_version 440544 (0.0009) [2023-12-27 22:24:16,127][106225] Updated weights for policy 1, policy_version 441938 (0.0008) [2023-12-27 22:24:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19494.2). Total num frames: 225976320. Throughput: 0: 9572.6, 1: 9775.2. Samples: 225967472. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:16,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.218')] [2023-12-27 22:24:16,185][106225] Updated weights for policy 1, policy_version 441948 (0.0008) [2023-12-27 22:24:16,244][106225] Updated weights for policy 1, policy_version 441958 (0.0009) [2023-12-27 22:24:16,305][106225] Updated weights for policy 1, policy_version 441968 (0.0006) [2023-12-27 22:24:16,718][106226] Updated weights for policy 0, policy_version 440554 (0.0009) [2023-12-27 22:24:16,780][106226] Updated weights for policy 0, policy_version 440564 (0.0009) [2023-12-27 22:24:16,846][106226] Updated weights for policy 0, policy_version 440574 (0.0009) [2023-12-27 22:24:16,905][106226] Updated weights for policy 0, policy_version 440584 (0.0005) [2023-12-27 22:24:16,943][106225] Updated weights for policy 1, policy_version 441978 (0.0008) [2023-12-27 22:24:17,004][106225] Updated weights for policy 1, policy_version 441988 (0.0008) [2023-12-27 22:24:17,074][106225] Updated weights for policy 1, policy_version 441998 (0.0008) [2023-12-27 22:24:17,686][106226] Updated weights for policy 0, policy_version 440594 (0.0011) [2023-12-27 22:24:17,711][106225] Updated weights for policy 1, policy_version 442008 (0.0007) [2023-12-27 22:24:17,747][106226] Updated weights for policy 0, policy_version 440604 (0.0011) [2023-12-27 22:24:17,763][106225] Updated weights for policy 1, policy_version 442018 (0.0009) [2023-12-27 22:24:17,803][106226] Updated weights for policy 0, policy_version 440614 (0.0010) [2023-12-27 22:24:17,823][106225] Updated weights for policy 1, policy_version 442028 (0.0007) [2023-12-27 22:24:18,546][106225] Updated weights for policy 1, policy_version 442038 (0.0010) [2023-12-27 22:24:18,579][106226] Updated weights for policy 0, policy_version 440624 (0.0008) [2023-12-27 22:24:18,608][106225] Updated weights for policy 1, policy_version 442048 (0.0011) [2023-12-27 22:24:18,636][106226] Updated weights for policy 0, policy_version 440634 (0.0006) [2023-12-27 22:24:18,663][106225] Updated weights for policy 1, policy_version 442058 (0.0010) [2023-12-27 22:24:18,697][106226] Updated weights for policy 0, policy_version 440644 (0.0007) [2023-12-27 22:24:19,254][106225] Updated weights for policy 1, policy_version 442068 (0.0007) [2023-12-27 22:24:19,317][106225] Updated weights for policy 1, policy_version 442078 (0.0008) [2023-12-27 22:24:19,394][106225] Updated weights for policy 1, policy_version 442088 (0.0008) [2023-12-27 22:24:19,499][106226] Updated weights for policy 0, policy_version 440654 (0.0009) [2023-12-27 22:24:19,566][106226] Updated weights for policy 0, policy_version 440664 (0.0008) [2023-12-27 22:24:19,631][106226] Updated weights for policy 0, policy_version 440674 (0.0008) [2023-12-27 22:24:20,174][106225] Updated weights for policy 1, policy_version 442098 (0.0008) [2023-12-27 22:24:20,230][106225] Updated weights for policy 1, policy_version 442108 (0.0008) [2023-12-27 22:24:20,295][106225] Updated weights for policy 1, policy_version 442118 (0.0009) [2023-12-27 22:24:20,347][106225] Updated weights for policy 1, policy_version 442128 (0.0008) [2023-12-27 22:24:20,397][106226] Updated weights for policy 0, policy_version 440684 (0.0008) [2023-12-27 22:24:20,467][106226] Updated weights for policy 0, policy_version 440694 (0.0009) [2023-12-27 22:24:20,529][106226] Updated weights for policy 0, policy_version 440704 (0.0008) [2023-12-27 22:24:21,128][106225] Updated weights for policy 1, policy_version 442138 (0.0007) [2023-12-27 22:24:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 226066432. Throughput: 0: 9555.5, 1: 9729.6. Samples: 226081628. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:21,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.663')] [2023-12-27 22:24:21,196][106225] Updated weights for policy 1, policy_version 442148 (0.0008) [2023-12-27 22:24:21,260][106225] Updated weights for policy 1, policy_version 442158 (0.0007) [2023-12-27 22:24:21,294][106226] Updated weights for policy 0, policy_version 440714 (0.0008) [2023-12-27 22:24:21,366][106226] Updated weights for policy 0, policy_version 440724 (0.0010) [2023-12-27 22:24:21,436][106226] Updated weights for policy 0, policy_version 440734 (0.0010) [2023-12-27 22:24:21,508][106226] Updated weights for policy 0, policy_version 440744 (0.0011) [2023-12-27 22:24:22,020][106225] Updated weights for policy 1, policy_version 442168 (0.0008) [2023-12-27 22:24:22,080][106225] Updated weights for policy 1, policy_version 442178 (0.0007) [2023-12-27 22:24:22,135][106225] Updated weights for policy 1, policy_version 442188 (0.0008) [2023-12-27 22:24:22,207][106226] Updated weights for policy 0, policy_version 440754 (0.0009) [2023-12-27 22:24:22,273][106226] Updated weights for policy 0, policy_version 440764 (0.0008) [2023-12-27 22:24:22,342][106226] Updated weights for policy 0, policy_version 440774 (0.0011) [2023-12-27 22:24:22,904][106225] Updated weights for policy 1, policy_version 442198 (0.0008) [2023-12-27 22:24:22,968][106225] Updated weights for policy 1, policy_version 442208 (0.0008) [2023-12-27 22:24:23,032][106225] Updated weights for policy 1, policy_version 442218 (0.0009) [2023-12-27 22:24:23,080][106226] Updated weights for policy 0, policy_version 440784 (0.0007) [2023-12-27 22:24:23,130][106226] Updated weights for policy 0, policy_version 440794 (0.0009) [2023-12-27 22:24:23,182][106226] Updated weights for policy 0, policy_version 440804 (0.0009) [2023-12-27 22:24:23,756][106225] Updated weights for policy 1, policy_version 442228 (0.0007) [2023-12-27 22:24:23,802][106225] Updated weights for policy 1, policy_version 442238 (0.0009) [2023-12-27 22:24:23,861][106225] Updated weights for policy 1, policy_version 442248 (0.0009) [2023-12-27 22:24:23,939][106226] Updated weights for policy 0, policy_version 440814 (0.0010) [2023-12-27 22:24:24,005][106226] Updated weights for policy 0, policy_version 440824 (0.0010) [2023-12-27 22:24:24,069][106226] Updated weights for policy 0, policy_version 440834 (0.0010) [2023-12-27 22:24:24,562][106225] Updated weights for policy 1, policy_version 442258 (0.0008) [2023-12-27 22:24:24,612][106225] Updated weights for policy 1, policy_version 442268 (0.0008) [2023-12-27 22:24:24,667][106225] Updated weights for policy 1, policy_version 442278 (0.0008) [2023-12-27 22:24:24,721][106225] Updated weights for policy 1, policy_version 442288 (0.0008) [2023-12-27 22:24:24,770][106226] Updated weights for policy 0, policy_version 440844 (0.0011) [2023-12-27 22:24:24,826][106226] Updated weights for policy 0, policy_version 440854 (0.0010) [2023-12-27 22:24:24,880][106226] Updated weights for policy 0, policy_version 440864 (0.0010) [2023-12-27 22:24:25,458][106225] Updated weights for policy 1, policy_version 442298 (0.0008) [2023-12-27 22:24:25,513][106225] Updated weights for policy 1, policy_version 442308 (0.0008) [2023-12-27 22:24:25,570][106225] Updated weights for policy 1, policy_version 442318 (0.0007) [2023-12-27 22:24:25,585][106226] Updated weights for policy 0, policy_version 440874 (0.0010) [2023-12-27 22:24:25,644][106226] Updated weights for policy 0, policy_version 440884 (0.0010) [2023-12-27 22:24:25,691][106226] Updated weights for policy 0, policy_version 440894 (0.0010) [2023-12-27 22:24:25,738][106226] Updated weights for policy 0, policy_version 440904 (0.0010) [2023-12-27 22:24:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19251.1, 300 sec: 19466.4). Total num frames: 226164736. Throughput: 0: 9536.8, 1: 9679.3. Samples: 226136924. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:26,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.366')] [2023-12-27 22:24:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000442320_113262592.pth... [2023-12-27 22:24:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000440904_112902144.pth... [2023-12-27 22:24:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000441200_112975872.pth [2023-12-27 22:24:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000439816_112623616.pth [2023-12-27 22:24:26,325][106225] Updated weights for policy 1, policy_version 442328 (0.0007) [2023-12-27 22:24:26,375][106225] Updated weights for policy 1, policy_version 442338 (0.0007) [2023-12-27 22:24:26,417][106226] Updated weights for policy 0, policy_version 440914 (0.0011) [2023-12-27 22:24:26,429][106225] Updated weights for policy 1, policy_version 442348 (0.0010) [2023-12-27 22:24:26,474][106226] Updated weights for policy 0, policy_version 440924 (0.0011) [2023-12-27 22:24:26,531][106226] Updated weights for policy 0, policy_version 440934 (0.0011) [2023-12-27 22:24:27,085][106225] Updated weights for policy 1, policy_version 442358 (0.0010) [2023-12-27 22:24:27,147][106225] Updated weights for policy 1, policy_version 442368 (0.0010) [2023-12-27 22:24:27,150][106226] Updated weights for policy 0, policy_version 440944 (0.0006) [2023-12-27 22:24:27,206][106225] Updated weights for policy 1, policy_version 442378 (0.0010) [2023-12-27 22:24:27,207][106226] Updated weights for policy 0, policy_version 440954 (0.0006) [2023-12-27 22:24:27,265][106226] Updated weights for policy 0, policy_version 440964 (0.0010) [2023-12-27 22:24:27,833][106226] Updated weights for policy 0, policy_version 440974 (0.0007) [2023-12-27 22:24:27,888][106226] Updated weights for policy 0, policy_version 440984 (0.0009) [2023-12-27 22:24:27,909][106225] Updated weights for policy 1, policy_version 442388 (0.0009) [2023-12-27 22:24:27,941][106226] Updated weights for policy 0, policy_version 440994 (0.0010) [2023-12-27 22:24:27,958][106225] Updated weights for policy 1, policy_version 442398 (0.0008) [2023-12-27 22:24:28,015][106225] Updated weights for policy 1, policy_version 442408 (0.0006) [2023-12-27 22:24:28,597][106226] Updated weights for policy 0, policy_version 441004 (0.0011) [2023-12-27 22:24:28,636][106225] Updated weights for policy 1, policy_version 442418 (0.0007) [2023-12-27 22:24:28,665][106226] Updated weights for policy 0, policy_version 441014 (0.0011) [2023-12-27 22:24:28,698][106225] Updated weights for policy 1, policy_version 442428 (0.0006) [2023-12-27 22:24:28,729][106226] Updated weights for policy 0, policy_version 441024 (0.0009) [2023-12-27 22:24:28,757][106225] Updated weights for policy 1, policy_version 442438 (0.0008) [2023-12-27 22:24:28,815][106225] Updated weights for policy 1, policy_version 442448 (0.0008) [2023-12-27 22:24:29,439][106226] Updated weights for policy 0, policy_version 441034 (0.0006) [2023-12-27 22:24:29,501][106226] Updated weights for policy 0, policy_version 441044 (0.0008) [2023-12-27 22:24:29,549][106225] Updated weights for policy 1, policy_version 442458 (0.0007) [2023-12-27 22:24:29,559][106226] Updated weights for policy 0, policy_version 441054 (0.0007) [2023-12-27 22:24:29,604][106225] Updated weights for policy 1, policy_version 442468 (0.0008) [2023-12-27 22:24:29,618][106226] Updated weights for policy 0, policy_version 441064 (0.0006) [2023-12-27 22:24:29,662][106225] Updated weights for policy 1, policy_version 442478 (0.0008) [2023-12-27 22:24:30,376][106226] Updated weights for policy 0, policy_version 441074 (0.0008) [2023-12-27 22:24:30,394][106225] Updated weights for policy 1, policy_version 442488 (0.0008) [2023-12-27 22:24:30,438][106226] Updated weights for policy 0, policy_version 441084 (0.0006) [2023-12-27 22:24:30,452][106225] Updated weights for policy 1, policy_version 442498 (0.0007) [2023-12-27 22:24:30,494][106226] Updated weights for policy 0, policy_version 441094 (0.0008) [2023-12-27 22:24:30,516][106225] Updated weights for policy 1, policy_version 442508 (0.0007) [2023-12-27 22:24:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 226263040. Throughput: 0: 9646.5, 1: 9733.4. Samples: 226257708. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:31,175][105115] Avg episode reward: [(0, '-5.136'), (1, '-5.840')] [2023-12-27 22:24:31,209][106225] Updated weights for policy 1, policy_version 442518 (0.0007) [2023-12-27 22:24:31,243][106226] Updated weights for policy 0, policy_version 441104 (0.0008) [2023-12-27 22:24:31,274][106225] Updated weights for policy 1, policy_version 442528 (0.0007) [2023-12-27 22:24:31,306][106226] Updated weights for policy 0, policy_version 441114 (0.0011) [2023-12-27 22:24:31,324][106225] Updated weights for policy 1, policy_version 442538 (0.0008) [2023-12-27 22:24:31,372][106226] Updated weights for policy 0, policy_version 441124 (0.0008) [2023-12-27 22:24:32,059][106226] Updated weights for policy 0, policy_version 441134 (0.0009) [2023-12-27 22:24:32,075][106225] Updated weights for policy 1, policy_version 442548 (0.0009) [2023-12-27 22:24:32,117][106226] Updated weights for policy 0, policy_version 441144 (0.0008) [2023-12-27 22:24:32,137][106225] Updated weights for policy 1, policy_version 442558 (0.0009) [2023-12-27 22:24:32,178][106226] Updated weights for policy 0, policy_version 441154 (0.0007) [2023-12-27 22:24:32,195][106225] Updated weights for policy 1, policy_version 442568 (0.0007) [2023-12-27 22:24:32,849][106225] Updated weights for policy 1, policy_version 442578 (0.0007) [2023-12-27 22:24:32,912][106225] Updated weights for policy 1, policy_version 442588 (0.0007) [2023-12-27 22:24:32,963][106226] Updated weights for policy 0, policy_version 441164 (0.0008) [2023-12-27 22:24:32,965][106225] Updated weights for policy 1, policy_version 442598 (0.0007) [2023-12-27 22:24:33,017][106225] Updated weights for policy 1, policy_version 442608 (0.0007) [2023-12-27 22:24:33,019][106226] Updated weights for policy 0, policy_version 441174 (0.0006) [2023-12-27 22:24:33,066][106226] Updated weights for policy 0, policy_version 441184 (0.0008) [2023-12-27 22:24:33,625][106225] Updated weights for policy 1, policy_version 442618 (0.0008) [2023-12-27 22:24:33,689][106225] Updated weights for policy 1, policy_version 442628 (0.0008) [2023-12-27 22:24:33,752][106225] Updated weights for policy 1, policy_version 442638 (0.0007) [2023-12-27 22:24:33,783][106226] Updated weights for policy 0, policy_version 441194 (0.0006) [2023-12-27 22:24:33,836][106226] Updated weights for policy 0, policy_version 441204 (0.0006) [2023-12-27 22:24:33,902][106226] Updated weights for policy 0, policy_version 441214 (0.0006) [2023-12-27 22:24:33,962][106226] Updated weights for policy 0, policy_version 441224 (0.0011) [2023-12-27 22:24:34,483][106225] Updated weights for policy 1, policy_version 442648 (0.0008) [2023-12-27 22:24:34,535][106225] Updated weights for policy 1, policy_version 442658 (0.0009) [2023-12-27 22:24:34,595][106225] Updated weights for policy 1, policy_version 442668 (0.0008) [2023-12-27 22:24:34,609][106226] Updated weights for policy 0, policy_version 441234 (0.0006) [2023-12-27 22:24:34,666][106226] Updated weights for policy 0, policy_version 441244 (0.0008) [2023-12-27 22:24:34,716][106226] Updated weights for policy 0, policy_version 441254 (0.0008) [2023-12-27 22:24:35,335][106226] Updated weights for policy 0, policy_version 441264 (0.0009) [2023-12-27 22:24:35,395][106226] Updated weights for policy 0, policy_version 441274 (0.0011) [2023-12-27 22:24:35,397][106225] Updated weights for policy 1, policy_version 442678 (0.0008) [2023-12-27 22:24:35,452][106225] Updated weights for policy 1, policy_version 442688 (0.0008) [2023-12-27 22:24:35,454][106226] Updated weights for policy 0, policy_version 441284 (0.0006) [2023-12-27 22:24:35,513][106225] Updated weights for policy 1, policy_version 442698 (0.0010) [2023-12-27 22:24:36,069][106226] Updated weights for policy 0, policy_version 441294 (0.0008) [2023-12-27 22:24:36,131][106226] Updated weights for policy 0, policy_version 441304 (0.0010) [2023-12-27 22:24:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19251.2, 300 sec: 19494.2). Total num frames: 226361344. Throughput: 0: 9629.4, 1: 9719.1. Samples: 226375620. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:36,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.592')] [2023-12-27 22:24:36,191][106226] Updated weights for policy 0, policy_version 441314 (0.0011) [2023-12-27 22:24:36,295][106225] Updated weights for policy 1, policy_version 442708 (0.0009) [2023-12-27 22:24:36,350][106225] Updated weights for policy 1, policy_version 442718 (0.0008) [2023-12-27 22:24:36,410][106225] Updated weights for policy 1, policy_version 442728 (0.0009) [2023-12-27 22:24:36,997][106226] Updated weights for policy 0, policy_version 441324 (0.0010) [2023-12-27 22:24:37,058][106226] Updated weights for policy 0, policy_version 441334 (0.0008) [2023-12-27 22:24:37,125][106226] Updated weights for policy 0, policy_version 441344 (0.0009) [2023-12-27 22:24:37,129][106225] Updated weights for policy 1, policy_version 442738 (0.0008) [2023-12-27 22:24:37,183][106225] Updated weights for policy 1, policy_version 442748 (0.0006) [2023-12-27 22:24:37,237][106225] Updated weights for policy 1, policy_version 442758 (0.0006) [2023-12-27 22:24:37,292][106225] Updated weights for policy 1, policy_version 442768 (0.0005) [2023-12-27 22:24:37,714][106226] Updated weights for policy 0, policy_version 441354 (0.0008) [2023-12-27 22:24:37,770][106226] Updated weights for policy 0, policy_version 441364 (0.0007) [2023-12-27 22:24:37,819][106226] Updated weights for policy 0, policy_version 441374 (0.0005) [2023-12-27 22:24:37,875][106226] Updated weights for policy 0, policy_version 441384 (0.0006) [2023-12-27 22:24:37,938][106225] Updated weights for policy 1, policy_version 442778 (0.0006) [2023-12-27 22:24:37,985][106225] Updated weights for policy 1, policy_version 442788 (0.0005) [2023-12-27 22:24:38,048][106225] Updated weights for policy 1, policy_version 442798 (0.0010) [2023-12-27 22:24:38,563][106226] Updated weights for policy 0, policy_version 441394 (0.0008) [2023-12-27 22:24:38,632][106226] Updated weights for policy 0, policy_version 441404 (0.0008) [2023-12-27 22:24:38,696][106226] Updated weights for policy 0, policy_version 441414 (0.0008) [2023-12-27 22:24:38,750][106225] Updated weights for policy 1, policy_version 442808 (0.0009) [2023-12-27 22:24:38,816][106225] Updated weights for policy 1, policy_version 442818 (0.0011) [2023-12-27 22:24:38,881][106225] Updated weights for policy 1, policy_version 442828 (0.0011) [2023-12-27 22:24:39,407][106226] Updated weights for policy 0, policy_version 441424 (0.0009) [2023-12-27 22:24:39,495][106226] Updated weights for policy 0, policy_version 441434 (0.0009) [2023-12-27 22:24:39,557][106226] Updated weights for policy 0, policy_version 441444 (0.0009) [2023-12-27 22:24:39,617][106225] Updated weights for policy 1, policy_version 442838 (0.0010) [2023-12-27 22:24:39,684][106225] Updated weights for policy 1, policy_version 442848 (0.0010) [2023-12-27 22:24:39,748][106225] Updated weights for policy 1, policy_version 442858 (0.0011) [2023-12-27 22:24:40,266][106226] Updated weights for policy 0, policy_version 441454 (0.0010) [2023-12-27 22:24:40,332][106226] Updated weights for policy 0, policy_version 441464 (0.0011) [2023-12-27 22:24:40,407][106226] Updated weights for policy 0, policy_version 441474 (0.0010) [2023-12-27 22:24:40,460][106225] Updated weights for policy 1, policy_version 442868 (0.0008) [2023-12-27 22:24:40,515][106225] Updated weights for policy 1, policy_version 442878 (0.0007) [2023-12-27 22:24:40,574][106225] Updated weights for policy 1, policy_version 442888 (0.0007) [2023-12-27 22:24:41,112][106226] Updated weights for policy 0, policy_version 441484 (0.0008) [2023-12-27 22:24:41,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 226459648. Throughput: 0: 9659.9, 1: 9767.2. Samples: 226435824. Policy #0 lag: (min: 19.0, avg: 27.9, max: 51.0) [2023-12-27 22:24:41,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-5.588')] [2023-12-27 22:24:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000442896_113410048.pth... [2023-12-27 22:24:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000441744_113115136.pth [2023-12-27 22:24:41,200][106226] Updated weights for policy 0, policy_version 441494 (0.0009) [2023-12-27 22:24:41,258][106226] Updated weights for policy 0, policy_version 441504 (0.0009) [2023-12-27 22:24:41,260][106225] Updated weights for policy 1, policy_version 442898 (0.0008) [2023-12-27 22:24:41,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000441512_113057792.pth... [2023-12-27 22:24:41,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000440360_112762880.pth [2023-12-27 22:24:41,318][106225] Updated weights for policy 1, policy_version 442908 (0.0007) [2023-12-27 22:24:41,387][106225] Updated weights for policy 1, policy_version 442918 (0.0008) [2023-12-27 22:24:41,456][106225] Updated weights for policy 1, policy_version 442928 (0.0008) [2023-12-27 22:24:41,950][106226] Updated weights for policy 0, policy_version 441514 (0.0008) [2023-12-27 22:24:42,012][106226] Updated weights for policy 0, policy_version 441524 (0.0006) [2023-12-27 22:24:42,067][106226] Updated weights for policy 0, policy_version 441534 (0.0007) [2023-12-27 22:24:42,123][106226] Updated weights for policy 0, policy_version 441544 (0.0006) [2023-12-27 22:24:42,215][106225] Updated weights for policy 1, policy_version 442938 (0.0008) [2023-12-27 22:24:42,279][106225] Updated weights for policy 1, policy_version 442948 (0.0009) [2023-12-27 22:24:42,353][106225] Updated weights for policy 1, policy_version 442958 (0.0008) [2023-12-27 22:24:42,857][106226] Updated weights for policy 0, policy_version 441554 (0.0009) [2023-12-27 22:24:42,908][106226] Updated weights for policy 0, policy_version 441564 (0.0008) [2023-12-27 22:24:42,964][106226] Updated weights for policy 0, policy_version 441574 (0.0008) [2023-12-27 22:24:43,062][106225] Updated weights for policy 1, policy_version 442968 (0.0006) [2023-12-27 22:24:43,111][106225] Updated weights for policy 1, policy_version 442978 (0.0006) [2023-12-27 22:24:43,157][106225] Updated weights for policy 1, policy_version 442988 (0.0007) [2023-12-27 22:24:43,766][106226] Updated weights for policy 0, policy_version 441584 (0.0008) [2023-12-27 22:24:43,785][106225] Updated weights for policy 1, policy_version 442998 (0.0009) [2023-12-27 22:24:43,815][106226] Updated weights for policy 0, policy_version 441594 (0.0009) [2023-12-27 22:24:43,841][106225] Updated weights for policy 1, policy_version 443008 (0.0007) [2023-12-27 22:24:43,870][106226] Updated weights for policy 0, policy_version 441604 (0.0007) [2023-12-27 22:24:43,902][106225] Updated weights for policy 1, policy_version 443018 (0.0008) [2023-12-27 22:24:44,578][106226] Updated weights for policy 0, policy_version 441614 (0.0006) [2023-12-27 22:24:44,611][106225] Updated weights for policy 1, policy_version 443028 (0.0007) [2023-12-27 22:24:44,639][106226] Updated weights for policy 0, policy_version 441624 (0.0007) [2023-12-27 22:24:44,661][106225] Updated weights for policy 1, policy_version 443038 (0.0007) [2023-12-27 22:24:44,699][106226] Updated weights for policy 0, policy_version 441634 (0.0010) [2023-12-27 22:24:44,717][106225] Updated weights for policy 1, policy_version 443048 (0.0005) [2023-12-27 22:24:45,321][106225] Updated weights for policy 1, policy_version 443058 (0.0009) [2023-12-27 22:24:45,374][106225] Updated weights for policy 1, policy_version 443068 (0.0008) [2023-12-27 22:24:45,431][106225] Updated weights for policy 1, policy_version 443078 (0.0008) [2023-12-27 22:24:45,442][106226] Updated weights for policy 0, policy_version 441644 (0.0011) [2023-12-27 22:24:45,497][106225] Updated weights for policy 1, policy_version 443088 (0.0007) [2023-12-27 22:24:45,510][106226] Updated weights for policy 0, policy_version 441654 (0.0011) [2023-12-27 22:24:45,571][106226] Updated weights for policy 0, policy_version 441664 (0.0010) [2023-12-27 22:24:46,170][106226] Updated weights for policy 0, policy_version 441674 (0.0010) [2023-12-27 22:24:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 226557952. Throughput: 0: 9623.7, 1: 9815.4. Samples: 226551288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:24:46,175][105115] Avg episode reward: [(0, '-4.960'), (1, '-5.319')] [2023-12-27 22:24:46,194][106225] Updated weights for policy 1, policy_version 443098 (0.0005) [2023-12-27 22:24:46,232][106226] Updated weights for policy 0, policy_version 441684 (0.0010) [2023-12-27 22:24:46,253][106225] Updated weights for policy 1, policy_version 443108 (0.0006) [2023-12-27 22:24:46,292][106226] Updated weights for policy 0, policy_version 441694 (0.0010) [2023-12-27 22:24:46,307][106225] Updated weights for policy 1, policy_version 443118 (0.0008) [2023-12-27 22:24:46,349][106226] Updated weights for policy 0, policy_version 441704 (0.0010) [2023-12-27 22:24:46,932][106226] Updated weights for policy 0, policy_version 441714 (0.0008) [2023-12-27 22:24:46,988][106226] Updated weights for policy 0, policy_version 441724 (0.0005) [2023-12-27 22:24:47,046][106225] Updated weights for policy 1, policy_version 443128 (0.0007) [2023-12-27 22:24:47,047][106226] Updated weights for policy 0, policy_version 441734 (0.0007) [2023-12-27 22:24:47,108][106225] Updated weights for policy 1, policy_version 443138 (0.0009) [2023-12-27 22:24:47,169][106225] Updated weights for policy 1, policy_version 443148 (0.0008) [2023-12-27 22:24:47,724][106226] Updated weights for policy 0, policy_version 441744 (0.0007) [2023-12-27 22:24:47,789][106226] Updated weights for policy 0, policy_version 441754 (0.0009) [2023-12-27 22:24:47,854][106226] Updated weights for policy 0, policy_version 441764 (0.0009) [2023-12-27 22:24:47,928][106225] Updated weights for policy 1, policy_version 443158 (0.0008) [2023-12-27 22:24:47,989][106225] Updated weights for policy 1, policy_version 443168 (0.0009) [2023-12-27 22:24:48,052][106225] Updated weights for policy 1, policy_version 443178 (0.0008) [2023-12-27 22:24:48,633][106226] Updated weights for policy 0, policy_version 441774 (0.0007) [2023-12-27 22:24:48,705][106226] Updated weights for policy 0, policy_version 441784 (0.0006) [2023-12-27 22:24:48,766][106226] Updated weights for policy 0, policy_version 441794 (0.0007) [2023-12-27 22:24:48,820][106225] Updated weights for policy 1, policy_version 443188 (0.0008) [2023-12-27 22:24:48,877][106225] Updated weights for policy 1, policy_version 443198 (0.0009) [2023-12-27 22:24:48,927][106225] Updated weights for policy 1, policy_version 443208 (0.0008) [2023-12-27 22:24:49,370][106226] Updated weights for policy 0, policy_version 441804 (0.0008) [2023-12-27 22:24:49,439][106226] Updated weights for policy 0, policy_version 441814 (0.0008) [2023-12-27 22:24:49,502][106226] Updated weights for policy 0, policy_version 441824 (0.0009) [2023-12-27 22:24:49,785][106225] Updated weights for policy 1, policy_version 443218 (0.0009) [2023-12-27 22:24:49,853][106225] Updated weights for policy 1, policy_version 443228 (0.0007) [2023-12-27 22:24:49,913][106225] Updated weights for policy 1, policy_version 443238 (0.0009) [2023-12-27 22:24:49,974][106225] Updated weights for policy 1, policy_version 443248 (0.0010) [2023-12-27 22:24:50,187][106226] Updated weights for policy 0, policy_version 441834 (0.0009) [2023-12-27 22:24:50,245][106226] Updated weights for policy 0, policy_version 441844 (0.0008) [2023-12-27 22:24:50,306][106226] Updated weights for policy 0, policy_version 441854 (0.0009) [2023-12-27 22:24:50,365][106226] Updated weights for policy 0, policy_version 441864 (0.0009) [2023-12-27 22:24:50,729][106225] Updated weights for policy 1, policy_version 443258 (0.0009) [2023-12-27 22:24:50,795][106225] Updated weights for policy 1, policy_version 443268 (0.0009) [2023-12-27 22:24:50,860][106225] Updated weights for policy 1, policy_version 443278 (0.0008) [2023-12-27 22:24:51,174][106226] Updated weights for policy 0, policy_version 441874 (0.0009) [2023-12-27 22:24:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 226656256. Throughput: 0: 9694.7, 1: 9741.4. Samples: 226668596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:24:51,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-5.543')] [2023-12-27 22:24:51,243][106226] Updated weights for policy 0, policy_version 441884 (0.0011) [2023-12-27 22:24:51,308][106226] Updated weights for policy 0, policy_version 441894 (0.0011) [2023-12-27 22:24:51,594][106225] Updated weights for policy 1, policy_version 443288 (0.0008) [2023-12-27 22:24:51,659][106225] Updated weights for policy 1, policy_version 443298 (0.0007) [2023-12-27 22:24:51,725][106225] Updated weights for policy 1, policy_version 443308 (0.0007) [2023-12-27 22:24:52,080][106226] Updated weights for policy 0, policy_version 441904 (0.0009) [2023-12-27 22:24:52,139][106226] Updated weights for policy 0, policy_version 441914 (0.0008) [2023-12-27 22:24:52,212][106226] Updated weights for policy 0, policy_version 441924 (0.0008) [2023-12-27 22:24:52,497][106225] Updated weights for policy 1, policy_version 443318 (0.0008) [2023-12-27 22:24:52,563][106225] Updated weights for policy 1, policy_version 443328 (0.0008) [2023-12-27 22:24:52,631][106225] Updated weights for policy 1, policy_version 443338 (0.0008) [2023-12-27 22:24:52,891][106226] Updated weights for policy 0, policy_version 441934 (0.0008) [2023-12-27 22:24:52,945][106226] Updated weights for policy 0, policy_version 441944 (0.0005) [2023-12-27 22:24:53,002][106226] Updated weights for policy 0, policy_version 441954 (0.0005) [2023-12-27 22:24:53,307][106225] Updated weights for policy 1, policy_version 443348 (0.0008) [2023-12-27 22:24:53,360][106225] Updated weights for policy 1, policy_version 443358 (0.0008) [2023-12-27 22:24:53,409][106225] Updated weights for policy 1, policy_version 443368 (0.0007) [2023-12-27 22:24:53,667][106226] Updated weights for policy 0, policy_version 441964 (0.0007) [2023-12-27 22:24:53,727][106226] Updated weights for policy 0, policy_version 441974 (0.0011) [2023-12-27 22:24:53,781][106226] Updated weights for policy 0, policy_version 441984 (0.0010) [2023-12-27 22:24:54,065][106225] Updated weights for policy 1, policy_version 443378 (0.0008) [2023-12-27 22:24:54,118][106225] Updated weights for policy 1, policy_version 443388 (0.0008) [2023-12-27 22:24:54,173][106225] Updated weights for policy 1, policy_version 443398 (0.0008) [2023-12-27 22:24:54,234][106225] Updated weights for policy 1, policy_version 443408 (0.0007) [2023-12-27 22:24:54,503][106226] Updated weights for policy 0, policy_version 441994 (0.0010) [2023-12-27 22:24:54,567][106226] Updated weights for policy 0, policy_version 442004 (0.0011) [2023-12-27 22:24:54,616][106226] Updated weights for policy 0, policy_version 442014 (0.0010) [2023-12-27 22:24:54,670][106226] Updated weights for policy 0, policy_version 442024 (0.0011) [2023-12-27 22:24:54,976][106225] Updated weights for policy 1, policy_version 443418 (0.0007) [2023-12-27 22:24:55,042][106225] Updated weights for policy 1, policy_version 443428 (0.0008) [2023-12-27 22:24:55,106][106225] Updated weights for policy 1, policy_version 443438 (0.0008) [2023-12-27 22:24:55,397][106226] Updated weights for policy 0, policy_version 442034 (0.0010) [2023-12-27 22:24:55,447][106226] Updated weights for policy 0, policy_version 442044 (0.0010) [2023-12-27 22:24:55,506][106226] Updated weights for policy 0, policy_version 442054 (0.0010) [2023-12-27 22:24:55,814][106225] Updated weights for policy 1, policy_version 443448 (0.0008) [2023-12-27 22:24:55,867][106225] Updated weights for policy 1, policy_version 443458 (0.0008) [2023-12-27 22:24:55,916][106225] Updated weights for policy 1, policy_version 443468 (0.0007) [2023-12-27 22:24:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19251.2, 300 sec: 19466.4). Total num frames: 226754560. Throughput: 0: 9679.0, 1: 9734.9. Samples: 226725680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:24:56,175][105115] Avg episode reward: [(0, '-4.985'), (1, '-5.647')] [2023-12-27 22:24:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000442056_113197056.pth... [2023-12-27 22:24:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000443472_113557504.pth... [2023-12-27 22:24:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000440904_112902144.pth [2023-12-27 22:24:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000442320_113262592.pth [2023-12-27 22:24:56,238][106226] Updated weights for policy 0, policy_version 442064 (0.0008) [2023-12-27 22:24:56,287][106226] Updated weights for policy 0, policy_version 442074 (0.0008) [2023-12-27 22:24:56,336][106226] Updated weights for policy 0, policy_version 442084 (0.0008) [2023-12-27 22:24:56,636][106225] Updated weights for policy 1, policy_version 443478 (0.0008) [2023-12-27 22:24:56,695][106225] Updated weights for policy 1, policy_version 443488 (0.0008) [2023-12-27 22:24:56,741][106225] Updated weights for policy 1, policy_version 443498 (0.0007) [2023-12-27 22:24:57,026][106226] Updated weights for policy 0, policy_version 442094 (0.0010) [2023-12-27 22:24:57,086][106226] Updated weights for policy 0, policy_version 442104 (0.0010) [2023-12-27 22:24:57,141][106226] Updated weights for policy 0, policy_version 442114 (0.0010) [2023-12-27 22:24:57,380][106225] Updated weights for policy 1, policy_version 443508 (0.0007) [2023-12-27 22:24:57,426][106225] Updated weights for policy 1, policy_version 443518 (0.0005) [2023-12-27 22:24:57,475][106225] Updated weights for policy 1, policy_version 443528 (0.0005) [2023-12-27 22:24:57,823][106226] Updated weights for policy 0, policy_version 442124 (0.0010) [2023-12-27 22:24:57,887][106226] Updated weights for policy 0, policy_version 442134 (0.0006) [2023-12-27 22:24:57,939][106226] Updated weights for policy 0, policy_version 442144 (0.0005) [2023-12-27 22:24:58,143][106225] Updated weights for policy 1, policy_version 443538 (0.0005) [2023-12-27 22:24:58,203][106225] Updated weights for policy 1, policy_version 443548 (0.0007) [2023-12-27 22:24:58,267][106225] Updated weights for policy 1, policy_version 443558 (0.0008) [2023-12-27 22:24:58,331][106225] Updated weights for policy 1, policy_version 443568 (0.0008) [2023-12-27 22:24:58,647][106226] Updated weights for policy 0, policy_version 442154 (0.0006) [2023-12-27 22:24:58,713][106226] Updated weights for policy 0, policy_version 442164 (0.0008) [2023-12-27 22:24:58,782][106226] Updated weights for policy 0, policy_version 442174 (0.0008) [2023-12-27 22:24:58,850][106226] Updated weights for policy 0, policy_version 442184 (0.0010) [2023-12-27 22:24:59,120][106225] Updated weights for policy 1, policy_version 443578 (0.0008) [2023-12-27 22:24:59,179][106225] Updated weights for policy 1, policy_version 443588 (0.0008) [2023-12-27 22:24:59,244][106225] Updated weights for policy 1, policy_version 443598 (0.0008) [2023-12-27 22:24:59,703][106226] Updated weights for policy 0, policy_version 442194 (0.0007) [2023-12-27 22:24:59,765][106226] Updated weights for policy 0, policy_version 442204 (0.0006) [2023-12-27 22:24:59,822][106226] Updated weights for policy 0, policy_version 442214 (0.0008) [2023-12-27 22:25:00,024][106225] Updated weights for policy 1, policy_version 443608 (0.0010) [2023-12-27 22:25:00,079][106225] Updated weights for policy 1, policy_version 443618 (0.0010) [2023-12-27 22:25:00,130][106225] Updated weights for policy 1, policy_version 443628 (0.0010) [2023-12-27 22:25:00,460][106226] Updated weights for policy 0, policy_version 442224 (0.0007) [2023-12-27 22:25:00,516][106226] Updated weights for policy 0, policy_version 442234 (0.0008) [2023-12-27 22:25:00,572][106226] Updated weights for policy 0, policy_version 442244 (0.0007) [2023-12-27 22:25:00,837][106225] Updated weights for policy 1, policy_version 443638 (0.0010) [2023-12-27 22:25:00,893][106225] Updated weights for policy 1, policy_version 443648 (0.0010) [2023-12-27 22:25:00,955][106225] Updated weights for policy 1, policy_version 443659 (0.0010) [2023-12-27 22:25:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 226852864. Throughput: 0: 9729.2, 1: 9698.8. Samples: 226841732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:01,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-5.276')] [2023-12-27 22:25:01,314][106226] Updated weights for policy 0, policy_version 442254 (0.0009) [2023-12-27 22:25:01,383][106226] Updated weights for policy 0, policy_version 442264 (0.0008) [2023-12-27 22:25:01,449][106226] Updated weights for policy 0, policy_version 442274 (0.0009) [2023-12-27 22:25:01,696][106225] Updated weights for policy 1, policy_version 443669 (0.0005) [2023-12-27 22:25:01,772][106225] Updated weights for policy 1, policy_version 443679 (0.0007) [2023-12-27 22:25:01,825][106225] Updated weights for policy 1, policy_version 443689 (0.0008) [2023-12-27 22:25:02,145][106226] Updated weights for policy 0, policy_version 442284 (0.0007) [2023-12-27 22:25:02,216][106226] Updated weights for policy 0, policy_version 442294 (0.0007) [2023-12-27 22:25:02,287][106226] Updated weights for policy 0, policy_version 442304 (0.0008) [2023-12-27 22:25:02,520][106225] Updated weights for policy 1, policy_version 443699 (0.0008) [2023-12-27 22:25:02,593][106225] Updated weights for policy 1, policy_version 443709 (0.0006) [2023-12-27 22:25:02,645][106225] Updated weights for policy 1, policy_version 443719 (0.0008) [2023-12-27 22:25:02,872][106226] Updated weights for policy 0, policy_version 442314 (0.0005) [2023-12-27 22:25:02,931][106226] Updated weights for policy 0, policy_version 442324 (0.0006) [2023-12-27 22:25:02,991][106226] Updated weights for policy 0, policy_version 442334 (0.0005) [2023-12-27 22:25:03,043][106226] Updated weights for policy 0, policy_version 442344 (0.0005) [2023-12-27 22:25:03,249][106225] Updated weights for policy 1, policy_version 443729 (0.0007) [2023-12-27 22:25:03,311][106225] Updated weights for policy 1, policy_version 443739 (0.0006) [2023-12-27 22:25:03,378][106225] Updated weights for policy 1, policy_version 443749 (0.0005) [2023-12-27 22:25:03,436][106225] Updated weights for policy 1, policy_version 443759 (0.0006) [2023-12-27 22:25:03,567][106226] Updated weights for policy 0, policy_version 442354 (0.0006) [2023-12-27 22:25:03,635][106226] Updated weights for policy 0, policy_version 442364 (0.0008) [2023-12-27 22:25:03,693][106226] Updated weights for policy 0, policy_version 442374 (0.0008) [2023-12-27 22:25:04,043][106225] Updated weights for policy 1, policy_version 443769 (0.0010) [2023-12-27 22:25:04,112][106225] Updated weights for policy 1, policy_version 443779 (0.0011) [2023-12-27 22:25:04,178][106225] Updated weights for policy 1, policy_version 443789 (0.0011) [2023-12-27 22:25:04,433][106226] Updated weights for policy 0, policy_version 442384 (0.0008) [2023-12-27 22:25:04,495][106226] Updated weights for policy 0, policy_version 442394 (0.0008) [2023-12-27 22:25:04,550][106226] Updated weights for policy 0, policy_version 442404 (0.0008) [2023-12-27 22:25:04,913][106225] Updated weights for policy 1, policy_version 443799 (0.0011) [2023-12-27 22:25:04,976][106225] Updated weights for policy 1, policy_version 443809 (0.0010) [2023-12-27 22:25:05,034][106225] Updated weights for policy 1, policy_version 443819 (0.0010) [2023-12-27 22:25:05,209][106226] Updated weights for policy 0, policy_version 442414 (0.0008) [2023-12-27 22:25:05,267][106226] Updated weights for policy 0, policy_version 442424 (0.0008) [2023-12-27 22:25:05,313][106226] Updated weights for policy 0, policy_version 442434 (0.0008) [2023-12-27 22:25:05,741][106225] Updated weights for policy 1, policy_version 443829 (0.0010) [2023-12-27 22:25:05,788][106225] Updated weights for policy 1, policy_version 443839 (0.0010) [2023-12-27 22:25:05,837][106225] Updated weights for policy 1, policy_version 443849 (0.0010) [2023-12-27 22:25:06,011][106226] Updated weights for policy 0, policy_version 442444 (0.0009) [2023-12-27 22:25:06,073][106226] Updated weights for policy 0, policy_version 442454 (0.0010) [2023-12-27 22:25:06,139][106226] Updated weights for policy 0, policy_version 442464 (0.0010) [2023-12-27 22:25:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 226951168. Throughput: 0: 9877.5, 1: 9724.7. Samples: 226963728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:06,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-5.552')] [2023-12-27 22:25:06,570][106225] Updated weights for policy 1, policy_version 443859 (0.0009) [2023-12-27 22:25:06,631][106225] Updated weights for policy 1, policy_version 443869 (0.0008) [2023-12-27 22:25:06,689][106225] Updated weights for policy 1, policy_version 443879 (0.0007) [2023-12-27 22:25:06,894][106226] Updated weights for policy 0, policy_version 442474 (0.0011) [2023-12-27 22:25:06,954][106226] Updated weights for policy 0, policy_version 442484 (0.0010) [2023-12-27 22:25:07,025][106226] Updated weights for policy 0, policy_version 442494 (0.0011) [2023-12-27 22:25:07,090][106226] Updated weights for policy 0, policy_version 442504 (0.0008) [2023-12-27 22:25:07,358][106225] Updated weights for policy 1, policy_version 443889 (0.0008) [2023-12-27 22:25:07,429][106225] Updated weights for policy 1, policy_version 443899 (0.0008) [2023-12-27 22:25:07,491][106225] Updated weights for policy 1, policy_version 443909 (0.0008) [2023-12-27 22:25:07,552][106225] Updated weights for policy 1, policy_version 443919 (0.0009) [2023-12-27 22:25:07,697][106226] Updated weights for policy 0, policy_version 442514 (0.0009) [2023-12-27 22:25:07,755][106226] Updated weights for policy 0, policy_version 442524 (0.0008) [2023-12-27 22:25:07,818][106226] Updated weights for policy 0, policy_version 442534 (0.0009) [2023-12-27 22:25:08,270][106225] Updated weights for policy 1, policy_version 443929 (0.0009) [2023-12-27 22:25:08,340][106225] Updated weights for policy 1, policy_version 443939 (0.0009) [2023-12-27 22:25:08,404][106225] Updated weights for policy 1, policy_version 443949 (0.0007) [2023-12-27 22:25:08,569][106226] Updated weights for policy 0, policy_version 442544 (0.0008) [2023-12-27 22:25:08,626][106226] Updated weights for policy 0, policy_version 442554 (0.0009) [2023-12-27 22:25:08,687][106226] Updated weights for policy 0, policy_version 442564 (0.0009) [2023-12-27 22:25:09,021][106225] Updated weights for policy 1, policy_version 443959 (0.0007) [2023-12-27 22:25:09,074][106225] Updated weights for policy 1, policy_version 443969 (0.0006) [2023-12-27 22:25:09,126][106225] Updated weights for policy 1, policy_version 443979 (0.0007) [2023-12-27 22:25:09,547][106226] Updated weights for policy 0, policy_version 442574 (0.0009) [2023-12-27 22:25:09,620][106226] Updated weights for policy 0, policy_version 442584 (0.0008) [2023-12-27 22:25:09,683][106226] Updated weights for policy 0, policy_version 442594 (0.0008) [2023-12-27 22:25:09,819][106225] Updated weights for policy 1, policy_version 443989 (0.0007) [2023-12-27 22:25:09,888][106225] Updated weights for policy 1, policy_version 443999 (0.0008) [2023-12-27 22:25:09,953][106225] Updated weights for policy 1, policy_version 444009 (0.0009) [2023-12-27 22:25:10,412][106226] Updated weights for policy 0, policy_version 442604 (0.0008) [2023-12-27 22:25:10,477][106226] Updated weights for policy 0, policy_version 442614 (0.0006) [2023-12-27 22:25:10,535][106226] Updated weights for policy 0, policy_version 442624 (0.0008) [2023-12-27 22:25:10,697][106225] Updated weights for policy 1, policy_version 444019 (0.0008) [2023-12-27 22:25:10,750][106225] Updated weights for policy 1, policy_version 444029 (0.0010) [2023-12-27 22:25:10,808][106225] Updated weights for policy 1, policy_version 444039 (0.0010) [2023-12-27 22:25:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19494.2). Total num frames: 227049472. Throughput: 0: 9896.9, 1: 9774.0. Samples: 227022112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:11,175][105115] Avg episode reward: [(0, '-5.006'), (1, '-5.323')] [2023-12-27 22:25:11,178][106226] Updated weights for policy 0, policy_version 442634 (0.0008) [2023-12-27 22:25:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000444048_113704960.pth... [2023-12-27 22:25:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000442896_113410048.pth [2023-12-27 22:25:11,236][106226] Updated weights for policy 0, policy_version 442644 (0.0010) [2023-12-27 22:25:11,307][106226] Updated weights for policy 0, policy_version 442654 (0.0006) [2023-12-27 22:25:11,375][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000442664_113352704.pth... [2023-12-27 22:25:11,378][106226] Updated weights for policy 0, policy_version 442664 (0.0008) [2023-12-27 22:25:11,380][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000441512_113057792.pth [2023-12-27 22:25:11,531][106225] Updated weights for policy 1, policy_version 444049 (0.0010) [2023-12-27 22:25:11,582][106225] Updated weights for policy 1, policy_version 444059 (0.0011) [2023-12-27 22:25:11,643][106225] Updated weights for policy 1, policy_version 444069 (0.0011) [2023-12-27 22:25:11,742][106225] Updated weights for policy 1, policy_version 444079 (0.0008) [2023-12-27 22:25:12,125][106226] Updated weights for policy 0, policy_version 442674 (0.0006) [2023-12-27 22:25:12,203][106226] Updated weights for policy 0, policy_version 442684 (0.0006) [2023-12-27 22:25:12,269][106226] Updated weights for policy 0, policy_version 442694 (0.0008) [2023-12-27 22:25:12,461][106225] Updated weights for policy 1, policy_version 444089 (0.0008) [2023-12-27 22:25:12,523][106225] Updated weights for policy 1, policy_version 444099 (0.0009) [2023-12-27 22:25:12,581][106225] Updated weights for policy 1, policy_version 444109 (0.0009) [2023-12-27 22:25:12,934][106226] Updated weights for policy 0, policy_version 442704 (0.0009) [2023-12-27 22:25:12,986][106226] Updated weights for policy 0, policy_version 442714 (0.0009) [2023-12-27 22:25:13,049][106226] Updated weights for policy 0, policy_version 442724 (0.0008) [2023-12-27 22:25:13,249][106225] Updated weights for policy 1, policy_version 444119 (0.0006) [2023-12-27 22:25:13,306][106225] Updated weights for policy 1, policy_version 444129 (0.0007) [2023-12-27 22:25:13,362][106225] Updated weights for policy 1, policy_version 444139 (0.0008) [2023-12-27 22:25:13,814][106226] Updated weights for policy 0, policy_version 442734 (0.0009) [2023-12-27 22:25:13,869][106226] Updated weights for policy 0, policy_version 442744 (0.0009) [2023-12-27 22:25:13,921][106226] Updated weights for policy 0, policy_version 442754 (0.0008) [2023-12-27 22:25:13,995][106225] Updated weights for policy 1, policy_version 444149 (0.0009) [2023-12-27 22:25:14,047][106225] Updated weights for policy 1, policy_version 444159 (0.0009) [2023-12-27 22:25:14,099][106225] Updated weights for policy 1, policy_version 444169 (0.0008) [2023-12-27 22:25:14,626][106226] Updated weights for policy 0, policy_version 442764 (0.0009) [2023-12-27 22:25:14,683][106226] Updated weights for policy 0, policy_version 442774 (0.0009) [2023-12-27 22:25:14,741][106226] Updated weights for policy 0, policy_version 442784 (0.0008) [2023-12-27 22:25:14,799][106225] Updated weights for policy 1, policy_version 444179 (0.0009) [2023-12-27 22:25:14,861][106225] Updated weights for policy 1, policy_version 444189 (0.0008) [2023-12-27 22:25:14,923][106225] Updated weights for policy 1, policy_version 444199 (0.0009) [2023-12-27 22:25:15,466][106226] Updated weights for policy 0, policy_version 442794 (0.0008) [2023-12-27 22:25:15,518][106226] Updated weights for policy 0, policy_version 442804 (0.0008) [2023-12-27 22:25:15,576][106226] Updated weights for policy 0, policy_version 442814 (0.0009) [2023-12-27 22:25:15,636][106226] Updated weights for policy 0, policy_version 442824 (0.0009) [2023-12-27 22:25:15,706][106225] Updated weights for policy 1, policy_version 444209 (0.0010) [2023-12-27 22:25:15,769][106225] Updated weights for policy 1, policy_version 444219 (0.0009) [2023-12-27 22:25:15,820][106225] Updated weights for policy 1, policy_version 444229 (0.0008) [2023-12-27 22:25:15,865][106225] Updated weights for policy 1, policy_version 444239 (0.0008) [2023-12-27 22:25:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 227147776. Throughput: 0: 9808.5, 1: 9760.5. Samples: 227138308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:16,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-5.181')] [2023-12-27 22:25:16,414][106226] Updated weights for policy 0, policy_version 442834 (0.0008) [2023-12-27 22:25:16,480][106226] Updated weights for policy 0, policy_version 442844 (0.0008) [2023-12-27 22:25:16,535][106226] Updated weights for policy 0, policy_version 442854 (0.0008) [2023-12-27 22:25:16,559][106225] Updated weights for policy 1, policy_version 444249 (0.0009) [2023-12-27 22:25:16,621][106225] Updated weights for policy 1, policy_version 444259 (0.0009) [2023-12-27 22:25:16,671][106225] Updated weights for policy 1, policy_version 444269 (0.0008) [2023-12-27 22:25:17,218][106226] Updated weights for policy 0, policy_version 442864 (0.0007) [2023-12-27 22:25:17,263][106226] Updated weights for policy 0, policy_version 442874 (0.0009) [2023-12-27 22:25:17,309][106226] Updated weights for policy 0, policy_version 442884 (0.0008) [2023-12-27 22:25:17,396][106225] Updated weights for policy 1, policy_version 444279 (0.0007) [2023-12-27 22:25:17,455][106225] Updated weights for policy 1, policy_version 444289 (0.0009) [2023-12-27 22:25:17,503][106225] Updated weights for policy 1, policy_version 444299 (0.0008) [2023-12-27 22:25:18,115][106226] Updated weights for policy 0, policy_version 442894 (0.0010) [2023-12-27 22:25:18,184][106226] Updated weights for policy 0, policy_version 442904 (0.0009) [2023-12-27 22:25:18,247][106226] Updated weights for policy 0, policy_version 442914 (0.0008) [2023-12-27 22:25:18,265][106225] Updated weights for policy 1, policy_version 444309 (0.0010) [2023-12-27 22:25:18,319][106225] Updated weights for policy 1, policy_version 444319 (0.0007) [2023-12-27 22:25:18,405][106225] Updated weights for policy 1, policy_version 444329 (0.0009) [2023-12-27 22:25:18,995][106226] Updated weights for policy 0, policy_version 442924 (0.0007) [2023-12-27 22:25:19,059][106226] Updated weights for policy 0, policy_version 442934 (0.0008) [2023-12-27 22:25:19,083][106225] Updated weights for policy 1, policy_version 444339 (0.0009) [2023-12-27 22:25:19,119][106226] Updated weights for policy 0, policy_version 442944 (0.0007) [2023-12-27 22:25:19,136][106225] Updated weights for policy 1, policy_version 444349 (0.0010) [2023-12-27 22:25:19,189][106225] Updated weights for policy 1, policy_version 444359 (0.0008) [2023-12-27 22:25:19,891][106226] Updated weights for policy 0, policy_version 442954 (0.0006) [2023-12-27 22:25:19,957][106226] Updated weights for policy 0, policy_version 442964 (0.0008) [2023-12-27 22:25:20,010][106225] Updated weights for policy 1, policy_version 444370 (0.0008) [2023-12-27 22:25:20,022][106226] Updated weights for policy 0, policy_version 442974 (0.0008) [2023-12-27 22:25:20,076][106225] Updated weights for policy 1, policy_version 444380 (0.0008) [2023-12-27 22:25:20,086][106226] Updated weights for policy 0, policy_version 442984 (0.0009) [2023-12-27 22:25:20,138][106225] Updated weights for policy 1, policy_version 444390 (0.0008) [2023-12-27 22:25:20,199][106225] Updated weights for policy 1, policy_version 444400 (0.0008) [2023-12-27 22:25:20,852][106226] Updated weights for policy 0, policy_version 442994 (0.0009) [2023-12-27 22:25:20,906][106225] Updated weights for policy 1, policy_version 444410 (0.0006) [2023-12-27 22:25:20,913][106226] Updated weights for policy 0, policy_version 443004 (0.0009) [2023-12-27 22:25:20,967][106225] Updated weights for policy 1, policy_version 444420 (0.0007) [2023-12-27 22:25:20,976][106226] Updated weights for policy 0, policy_version 443014 (0.0006) [2023-12-27 22:25:21,033][106225] Updated weights for policy 1, policy_version 444430 (0.0007) [2023-12-27 22:25:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 227246080. Throughput: 0: 9709.3, 1: 9730.5. Samples: 227250408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:21,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.975')] [2023-12-27 22:25:21,176][106141] Saving new best policy, reward=-4.975! [2023-12-27 22:25:21,815][106226] Updated weights for policy 0, policy_version 443024 (0.0009) [2023-12-27 22:25:21,872][106226] Updated weights for policy 0, policy_version 443034 (0.0009) [2023-12-27 22:25:21,935][106225] Updated weights for policy 1, policy_version 444440 (0.0010) [2023-12-27 22:25:21,937][106226] Updated weights for policy 0, policy_version 443044 (0.0011) [2023-12-27 22:25:22,000][106225] Updated weights for policy 1, policy_version 444450 (0.0010) [2023-12-27 22:25:22,059][106225] Updated weights for policy 1, policy_version 444460 (0.0009) [2023-12-27 22:25:22,720][106226] Updated weights for policy 0, policy_version 443054 (0.0009) [2023-12-27 22:25:22,782][106226] Updated weights for policy 0, policy_version 443064 (0.0008) [2023-12-27 22:25:22,842][106225] Updated weights for policy 1, policy_version 444470 (0.0007) [2023-12-27 22:25:22,846][106226] Updated weights for policy 0, policy_version 443074 (0.0008) [2023-12-27 22:25:22,896][106225] Updated weights for policy 1, policy_version 444480 (0.0008) [2023-12-27 22:25:22,955][106225] Updated weights for policy 1, policy_version 444490 (0.0005) [2023-12-27 22:25:23,559][106225] Updated weights for policy 1, policy_version 444500 (0.0006) [2023-12-27 22:25:23,608][106225] Updated weights for policy 1, policy_version 444510 (0.0007) [2023-12-27 22:25:23,624][106226] Updated weights for policy 0, policy_version 443084 (0.0009) [2023-12-27 22:25:23,665][106225] Updated weights for policy 1, policy_version 444520 (0.0006) [2023-12-27 22:25:23,685][106226] Updated weights for policy 0, policy_version 443094 (0.0011) [2023-12-27 22:25:23,735][106226] Updated weights for policy 0, policy_version 443104 (0.0010) [2023-12-27 22:25:24,388][106225] Updated weights for policy 1, policy_version 444530 (0.0006) [2023-12-27 22:25:24,452][106225] Updated weights for policy 1, policy_version 444540 (0.0005) [2023-12-27 22:25:24,457][106226] Updated weights for policy 0, policy_version 443114 (0.0010) [2023-12-27 22:25:24,499][106225] Updated weights for policy 1, policy_version 444550 (0.0005) [2023-12-27 22:25:24,508][106226] Updated weights for policy 0, policy_version 443124 (0.0007) [2023-12-27 22:25:24,545][106225] Updated weights for policy 1, policy_version 444560 (0.0005) [2023-12-27 22:25:24,566][106226] Updated weights for policy 0, policy_version 443134 (0.0008) [2023-12-27 22:25:24,627][106226] Updated weights for policy 0, policy_version 443144 (0.0009) [2023-12-27 22:25:25,145][106225] Updated weights for policy 1, policy_version 444570 (0.0008) [2023-12-27 22:25:25,205][106225] Updated weights for policy 1, policy_version 444580 (0.0009) [2023-12-27 22:25:25,245][106226] Updated weights for policy 0, policy_version 443154 (0.0007) [2023-12-27 22:25:25,263][106225] Updated weights for policy 1, policy_version 444590 (0.0006) [2023-12-27 22:25:25,300][106226] Updated weights for policy 0, policy_version 443164 (0.0006) [2023-12-27 22:25:25,351][106226] Updated weights for policy 0, policy_version 443174 (0.0008) [2023-12-27 22:25:25,973][106226] Updated weights for policy 0, policy_version 443184 (0.0009) [2023-12-27 22:25:26,016][106225] Updated weights for policy 1, policy_version 444600 (0.0009) [2023-12-27 22:25:26,032][106226] Updated weights for policy 0, policy_version 443194 (0.0007) [2023-12-27 22:25:26,075][106225] Updated weights for policy 1, policy_version 444610 (0.0007) [2023-12-27 22:25:26,081][106226] Updated weights for policy 0, policy_version 443204 (0.0007) [2023-12-27 22:25:26,130][106225] Updated weights for policy 1, policy_version 444620 (0.0009) [2023-12-27 22:25:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 227344384. Throughput: 0: 9640.9, 1: 9668.1. Samples: 227304736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:26,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.749')] [2023-12-27 22:25:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000444624_113852416.pth... [2023-12-27 22:25:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000443208_113491968.pth... [2023-12-27 22:25:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000443472_113557504.pth [2023-12-27 22:25:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000442056_113197056.pth [2023-12-27 22:25:26,641][106226] Updated weights for policy 0, policy_version 443214 (0.0005) [2023-12-27 22:25:26,703][106226] Updated weights for policy 0, policy_version 443224 (0.0005) [2023-12-27 22:25:26,766][106226] Updated weights for policy 0, policy_version 443234 (0.0007) [2023-12-27 22:25:26,897][106225] Updated weights for policy 1, policy_version 444630 (0.0006) [2023-12-27 22:25:26,950][106225] Updated weights for policy 1, policy_version 444640 (0.0008) [2023-12-27 22:25:27,004][106225] Updated weights for policy 1, policy_version 444650 (0.0009) [2023-12-27 22:25:27,430][106226] Updated weights for policy 0, policy_version 443244 (0.0009) [2023-12-27 22:25:27,484][106226] Updated weights for policy 0, policy_version 443254 (0.0008) [2023-12-27 22:25:27,530][106226] Updated weights for policy 0, policy_version 443264 (0.0008) [2023-12-27 22:25:27,718][106225] Updated weights for policy 1, policy_version 444660 (0.0008) [2023-12-27 22:25:27,780][106225] Updated weights for policy 1, policy_version 444670 (0.0008) [2023-12-27 22:25:27,840][106225] Updated weights for policy 1, policy_version 444680 (0.0008) [2023-12-27 22:25:28,235][106226] Updated weights for policy 0, policy_version 443274 (0.0008) [2023-12-27 22:25:28,289][106226] Updated weights for policy 0, policy_version 443284 (0.0008) [2023-12-27 22:25:28,355][106226] Updated weights for policy 0, policy_version 443294 (0.0009) [2023-12-27 22:25:28,426][106226] Updated weights for policy 0, policy_version 443304 (0.0008) [2023-12-27 22:25:28,585][106225] Updated weights for policy 1, policy_version 444690 (0.0007) [2023-12-27 22:25:28,642][106225] Updated weights for policy 1, policy_version 444700 (0.0005) [2023-12-27 22:25:28,698][106225] Updated weights for policy 1, policy_version 444710 (0.0005) [2023-12-27 22:25:28,750][106225] Updated weights for policy 1, policy_version 444720 (0.0005) [2023-12-27 22:25:29,207][106226] Updated weights for policy 0, policy_version 443314 (0.0008) [2023-12-27 22:25:29,276][106226] Updated weights for policy 0, policy_version 443324 (0.0008) [2023-12-27 22:25:29,313][106225] Updated weights for policy 1, policy_version 444730 (0.0007) [2023-12-27 22:25:29,337][106226] Updated weights for policy 0, policy_version 443334 (0.0006) [2023-12-27 22:25:29,381][106225] Updated weights for policy 1, policy_version 444740 (0.0008) [2023-12-27 22:25:29,429][106225] Updated weights for policy 1, policy_version 444750 (0.0008) [2023-12-27 22:25:30,001][106226] Updated weights for policy 0, policy_version 443344 (0.0006) [2023-12-27 22:25:30,058][106226] Updated weights for policy 0, policy_version 443354 (0.0006) [2023-12-27 22:25:30,111][106226] Updated weights for policy 0, policy_version 443364 (0.0006) [2023-12-27 22:25:30,205][106225] Updated weights for policy 1, policy_version 444760 (0.0009) [2023-12-27 22:25:30,262][106225] Updated weights for policy 1, policy_version 444770 (0.0009) [2023-12-27 22:25:30,321][106225] Updated weights for policy 1, policy_version 444780 (0.0009) [2023-12-27 22:25:30,767][106226] Updated weights for policy 0, policy_version 443374 (0.0006) [2023-12-27 22:25:30,816][106226] Updated weights for policy 0, policy_version 443384 (0.0005) [2023-12-27 22:25:30,874][106226] Updated weights for policy 0, policy_version 443394 (0.0005) [2023-12-27 22:25:31,042][106225] Updated weights for policy 1, policy_version 444790 (0.0009) [2023-12-27 22:25:31,105][106225] Updated weights for policy 1, policy_version 444800 (0.0010) [2023-12-27 22:25:31,165][106225] Updated weights for policy 1, policy_version 444810 (0.0009) [2023-12-27 22:25:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19438.6). Total num frames: 227434496. Throughput: 0: 9762.0, 1: 9698.8. Samples: 227427028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:31,176][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.547')] [2023-12-27 22:25:31,560][106226] Updated weights for policy 0, policy_version 443404 (0.0007) [2023-12-27 22:25:31,616][106226] Updated weights for policy 0, policy_version 443414 (0.0009) [2023-12-27 22:25:31,686][106226] Updated weights for policy 0, policy_version 443424 (0.0007) [2023-12-27 22:25:31,931][106225] Updated weights for policy 1, policy_version 444820 (0.0008) [2023-12-27 22:25:31,990][106225] Updated weights for policy 1, policy_version 444830 (0.0008) [2023-12-27 22:25:32,052][106225] Updated weights for policy 1, policy_version 444840 (0.0008) [2023-12-27 22:25:32,444][106226] Updated weights for policy 0, policy_version 443434 (0.0008) [2023-12-27 22:25:32,509][106226] Updated weights for policy 0, policy_version 443444 (0.0005) [2023-12-27 22:25:32,585][106226] Updated weights for policy 0, policy_version 443454 (0.0005) [2023-12-27 22:25:32,639][106226] Updated weights for policy 0, policy_version 443464 (0.0005) [2023-12-27 22:25:32,764][106225] Updated weights for policy 1, policy_version 444850 (0.0008) [2023-12-27 22:25:32,833][106225] Updated weights for policy 1, policy_version 444860 (0.0008) [2023-12-27 22:25:32,887][106225] Updated weights for policy 1, policy_version 444870 (0.0008) [2023-12-27 22:25:32,947][106225] Updated weights for policy 1, policy_version 444880 (0.0009) [2023-12-27 22:25:33,250][106226] Updated weights for policy 0, policy_version 443474 (0.0005) [2023-12-27 22:25:33,319][106226] Updated weights for policy 0, policy_version 443484 (0.0005) [2023-12-27 22:25:33,376][106226] Updated weights for policy 0, policy_version 443494 (0.0005) [2023-12-27 22:25:33,764][106225] Updated weights for policy 1, policy_version 444890 (0.0010) [2023-12-27 22:25:33,822][106225] Updated weights for policy 1, policy_version 444900 (0.0008) [2023-12-27 22:25:33,875][106226] Updated weights for policy 0, policy_version 443504 (0.0007) [2023-12-27 22:25:33,878][106225] Updated weights for policy 1, policy_version 444910 (0.0006) [2023-12-27 22:25:33,935][106226] Updated weights for policy 0, policy_version 443514 (0.0009) [2023-12-27 22:25:33,993][106226] Updated weights for policy 0, policy_version 443524 (0.0009) [2023-12-27 22:25:34,579][106225] Updated weights for policy 1, policy_version 444920 (0.0005) [2023-12-27 22:25:34,650][106225] Updated weights for policy 1, policy_version 444930 (0.0006) [2023-12-27 22:25:34,722][106225] Updated weights for policy 1, policy_version 444940 (0.0006) [2023-12-27 22:25:34,757][106226] Updated weights for policy 0, policy_version 443534 (0.0008) [2023-12-27 22:25:34,820][106226] Updated weights for policy 0, policy_version 443544 (0.0006) [2023-12-27 22:25:34,892][106226] Updated weights for policy 0, policy_version 443554 (0.0006) [2023-12-27 22:25:35,431][106226] Updated weights for policy 0, policy_version 443564 (0.0006) [2023-12-27 22:25:35,466][106225] Updated weights for policy 1, policy_version 444950 (0.0008) [2023-12-27 22:25:35,497][106226] Updated weights for policy 0, policy_version 443574 (0.0006) [2023-12-27 22:25:35,516][106225] Updated weights for policy 1, policy_version 444960 (0.0008) [2023-12-27 22:25:35,557][106226] Updated weights for policy 0, policy_version 443584 (0.0006) [2023-12-27 22:25:35,564][106225] Updated weights for policy 1, policy_version 444970 (0.0007) [2023-12-27 22:25:36,172][106226] Updated weights for policy 0, policy_version 443594 (0.0006) [2023-12-27 22:25:36,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 227532800. Throughput: 0: 9815.1, 1: 9677.7. Samples: 227545772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:36,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.524')] [2023-12-27 22:25:36,231][106226] Updated weights for policy 0, policy_version 443604 (0.0009) [2023-12-27 22:25:36,290][106226] Updated weights for policy 0, policy_version 443614 (0.0009) [2023-12-27 22:25:36,345][106225] Updated weights for policy 1, policy_version 444980 (0.0007) [2023-12-27 22:25:36,356][106226] Updated weights for policy 0, policy_version 443624 (0.0007) [2023-12-27 22:25:36,409][106225] Updated weights for policy 1, policy_version 444990 (0.0008) [2023-12-27 22:25:36,475][106225] Updated weights for policy 1, policy_version 445000 (0.0008) [2023-12-27 22:25:37,106][106226] Updated weights for policy 0, policy_version 443634 (0.0008) [2023-12-27 22:25:37,167][106226] Updated weights for policy 0, policy_version 443644 (0.0009) [2023-12-27 22:25:37,199][106225] Updated weights for policy 1, policy_version 445010 (0.0007) [2023-12-27 22:25:37,226][106226] Updated weights for policy 0, policy_version 443654 (0.0008) [2023-12-27 22:25:37,260][106225] Updated weights for policy 1, policy_version 445020 (0.0007) [2023-12-27 22:25:37,318][106225] Updated weights for policy 1, policy_version 445030 (0.0008) [2023-12-27 22:25:37,378][106225] Updated weights for policy 1, policy_version 445040 (0.0008) [2023-12-27 22:25:37,957][106226] Updated weights for policy 0, policy_version 443664 (0.0008) [2023-12-27 22:25:38,014][106226] Updated weights for policy 0, policy_version 443674 (0.0008) [2023-12-27 22:25:38,075][106226] Updated weights for policy 0, policy_version 443684 (0.0007) [2023-12-27 22:25:38,089][106225] Updated weights for policy 1, policy_version 445050 (0.0007) [2023-12-27 22:25:38,154][106225] Updated weights for policy 1, policy_version 445060 (0.0008) [2023-12-27 22:25:38,207][106225] Updated weights for policy 1, policy_version 445070 (0.0008) [2023-12-27 22:25:38,822][106226] Updated weights for policy 0, policy_version 443694 (0.0007) [2023-12-27 22:25:38,888][106226] Updated weights for policy 0, policy_version 443704 (0.0009) [2023-12-27 22:25:38,930][106225] Updated weights for policy 1, policy_version 445080 (0.0007) [2023-12-27 22:25:38,947][106226] Updated weights for policy 0, policy_version 443714 (0.0007) [2023-12-27 22:25:38,987][106225] Updated weights for policy 1, policy_version 445090 (0.0007) [2023-12-27 22:25:39,046][106225] Updated weights for policy 1, policy_version 445100 (0.0005) [2023-12-27 22:25:39,651][106226] Updated weights for policy 0, policy_version 443724 (0.0006) [2023-12-27 22:25:39,714][106226] Updated weights for policy 0, policy_version 443734 (0.0007) [2023-12-27 22:25:39,777][106226] Updated weights for policy 0, policy_version 443744 (0.0006) [2023-12-27 22:25:39,821][106225] Updated weights for policy 1, policy_version 445110 (0.0006) [2023-12-27 22:25:39,892][106225] Updated weights for policy 1, policy_version 445120 (0.0008) [2023-12-27 22:25:39,964][106225] Updated weights for policy 1, policy_version 445130 (0.0008) [2023-12-27 22:25:40,516][106226] Updated weights for policy 0, policy_version 443754 (0.0008) [2023-12-27 22:25:40,584][106226] Updated weights for policy 0, policy_version 443764 (0.0008) [2023-12-27 22:25:40,653][106226] Updated weights for policy 0, policy_version 443774 (0.0008) [2023-12-27 22:25:40,699][106225] Updated weights for policy 1, policy_version 445140 (0.0009) [2023-12-27 22:25:40,718][106226] Updated weights for policy 0, policy_version 443784 (0.0007) [2023-12-27 22:25:40,760][106225] Updated weights for policy 1, policy_version 445150 (0.0008) [2023-12-27 22:25:40,824][106225] Updated weights for policy 1, policy_version 445160 (0.0008) [2023-12-27 22:25:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 227631104. Throughput: 0: 9784.0, 1: 9681.0. Samples: 227601604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:41,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.636')] [2023-12-27 22:25:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000445168_113991680.pth... [2023-12-27 22:25:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000443784_113639424.pth... [2023-12-27 22:25:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000444048_113704960.pth [2023-12-27 22:25:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000442664_113352704.pth [2023-12-27 22:25:41,465][106226] Updated weights for policy 0, policy_version 443794 (0.0010) [2023-12-27 22:25:41,528][106226] Updated weights for policy 0, policy_version 443804 (0.0009) [2023-12-27 22:25:41,595][106226] Updated weights for policy 0, policy_version 443814 (0.0006) [2023-12-27 22:25:41,613][106225] Updated weights for policy 1, policy_version 445170 (0.0008) [2023-12-27 22:25:41,689][106225] Updated weights for policy 1, policy_version 445180 (0.0008) [2023-12-27 22:25:41,754][106225] Updated weights for policy 1, policy_version 445190 (0.0008) [2023-12-27 22:25:41,819][106225] Updated weights for policy 1, policy_version 445200 (0.0008) [2023-12-27 22:25:42,301][106226] Updated weights for policy 0, policy_version 443824 (0.0008) [2023-12-27 22:25:42,369][106226] Updated weights for policy 0, policy_version 443834 (0.0008) [2023-12-27 22:25:42,427][106226] Updated weights for policy 0, policy_version 443844 (0.0006) [2023-12-27 22:25:42,589][106225] Updated weights for policy 1, policy_version 445210 (0.0008) [2023-12-27 22:25:42,656][106225] Updated weights for policy 1, policy_version 445220 (0.0007) [2023-12-27 22:25:42,719][106225] Updated weights for policy 1, policy_version 445230 (0.0008) [2023-12-27 22:25:43,124][106226] Updated weights for policy 0, policy_version 443854 (0.0008) [2023-12-27 22:25:43,186][106226] Updated weights for policy 0, policy_version 443864 (0.0008) [2023-12-27 22:25:43,240][106226] Updated weights for policy 0, policy_version 443874 (0.0005) [2023-12-27 22:25:43,373][106225] Updated weights for policy 1, policy_version 445240 (0.0008) [2023-12-27 22:25:43,424][106225] Updated weights for policy 1, policy_version 445250 (0.0009) [2023-12-27 22:25:43,481][106225] Updated weights for policy 1, policy_version 445260 (0.0009) [2023-12-27 22:25:43,846][106226] Updated weights for policy 0, policy_version 443884 (0.0007) [2023-12-27 22:25:43,897][106226] Updated weights for policy 0, policy_version 443894 (0.0010) [2023-12-27 22:25:43,944][106226] Updated weights for policy 0, policy_version 443904 (0.0010) [2023-12-27 22:25:44,237][106225] Updated weights for policy 1, policy_version 445270 (0.0008) [2023-12-27 22:25:44,298][106225] Updated weights for policy 1, policy_version 445280 (0.0010) [2023-12-27 22:25:44,354][106225] Updated weights for policy 1, policy_version 445290 (0.0007) [2023-12-27 22:25:44,605][106226] Updated weights for policy 0, policy_version 443914 (0.0010) [2023-12-27 22:25:44,662][106226] Updated weights for policy 0, policy_version 443924 (0.0007) [2023-12-27 22:25:44,715][106226] Updated weights for policy 0, policy_version 443934 (0.0009) [2023-12-27 22:25:44,791][106226] Updated weights for policy 0, policy_version 443944 (0.0008) [2023-12-27 22:25:45,113][106225] Updated weights for policy 1, policy_version 445300 (0.0009) [2023-12-27 22:25:45,172][106225] Updated weights for policy 1, policy_version 445310 (0.0010) [2023-12-27 22:25:45,241][106225] Updated weights for policy 1, policy_version 445320 (0.0011) [2023-12-27 22:25:45,523][106226] Updated weights for policy 0, policy_version 443954 (0.0009) [2023-12-27 22:25:45,589][106226] Updated weights for policy 0, policy_version 443964 (0.0008) [2023-12-27 22:25:45,647][106226] Updated weights for policy 0, policy_version 443974 (0.0008) [2023-12-27 22:25:45,957][106225] Updated weights for policy 1, policy_version 445330 (0.0010) [2023-12-27 22:25:46,014][106225] Updated weights for policy 1, policy_version 445340 (0.0008) [2023-12-27 22:25:46,063][106225] Updated weights for policy 1, policy_version 445350 (0.0007) [2023-12-27 22:25:46,126][106225] Updated weights for policy 1, policy_version 445360 (0.0006) [2023-12-27 22:25:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19466.4). Total num frames: 227729408. Throughput: 0: 9830.2, 1: 9622.5. Samples: 227717108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:46,176][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.089')] [2023-12-27 22:25:46,367][106226] Updated weights for policy 0, policy_version 443984 (0.0010) [2023-12-27 22:25:46,423][106226] Updated weights for policy 0, policy_version 443994 (0.0010) [2023-12-27 22:25:46,478][106226] Updated weights for policy 0, policy_version 444004 (0.0009) [2023-12-27 22:25:46,820][106225] Updated weights for policy 1, policy_version 445370 (0.0009) [2023-12-27 22:25:46,877][106225] Updated weights for policy 1, policy_version 445380 (0.0008) [2023-12-27 22:25:46,939][106225] Updated weights for policy 1, policy_version 445390 (0.0008) [2023-12-27 22:25:47,120][106226] Updated weights for policy 0, policy_version 444014 (0.0007) [2023-12-27 22:25:47,178][106226] Updated weights for policy 0, policy_version 444024 (0.0008) [2023-12-27 22:25:47,238][106226] Updated weights for policy 0, policy_version 444034 (0.0005) [2023-12-27 22:25:47,682][106225] Updated weights for policy 1, policy_version 445400 (0.0009) [2023-12-27 22:25:47,733][106225] Updated weights for policy 1, policy_version 445410 (0.0008) [2023-12-27 22:25:47,790][106225] Updated weights for policy 1, policy_version 445420 (0.0009) [2023-12-27 22:25:47,877][106226] Updated weights for policy 0, policy_version 444044 (0.0007) [2023-12-27 22:25:47,937][106226] Updated weights for policy 0, policy_version 444055 (0.0009) [2023-12-27 22:25:48,003][106226] Updated weights for policy 0, policy_version 444065 (0.0010) [2023-12-27 22:25:48,578][106225] Updated weights for policy 1, policy_version 445430 (0.0008) [2023-12-27 22:25:48,637][106225] Updated weights for policy 1, policy_version 445440 (0.0009) [2023-12-27 22:25:48,693][106225] Updated weights for policy 1, policy_version 445450 (0.0009) [2023-12-27 22:25:48,770][106226] Updated weights for policy 0, policy_version 444075 (0.0009) [2023-12-27 22:25:48,824][106226] Updated weights for policy 0, policy_version 444085 (0.0006) [2023-12-27 22:25:48,885][106226] Updated weights for policy 0, policy_version 444095 (0.0006) [2023-12-27 22:25:49,473][106225] Updated weights for policy 1, policy_version 445460 (0.0008) [2023-12-27 22:25:49,531][106225] Updated weights for policy 1, policy_version 445470 (0.0008) [2023-12-27 22:25:49,566][106226] Updated weights for policy 0, policy_version 444105 (0.0006) [2023-12-27 22:25:49,590][106225] Updated weights for policy 1, policy_version 445480 (0.0008) [2023-12-27 22:25:49,629][106226] Updated weights for policy 0, policy_version 444115 (0.0007) [2023-12-27 22:25:49,699][106226] Updated weights for policy 0, policy_version 444125 (0.0006) [2023-12-27 22:25:49,770][106226] Updated weights for policy 0, policy_version 444135 (0.0006) [2023-12-27 22:25:50,333][106225] Updated weights for policy 1, policy_version 445490 (0.0008) [2023-12-27 22:25:50,395][106225] Updated weights for policy 1, policy_version 445500 (0.0008) [2023-12-27 22:25:50,441][106226] Updated weights for policy 0, policy_version 444145 (0.0006) [2023-12-27 22:25:50,454][106225] Updated weights for policy 1, policy_version 445510 (0.0007) [2023-12-27 22:25:50,493][106226] Updated weights for policy 0, policy_version 444155 (0.0005) [2023-12-27 22:25:50,513][106225] Updated weights for policy 1, policy_version 445520 (0.0008) [2023-12-27 22:25:50,546][106226] Updated weights for policy 0, policy_version 444165 (0.0007) [2023-12-27 22:25:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19438.7). Total num frames: 227819520. Throughput: 0: 9773.7, 1: 9529.4. Samples: 227832368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:51,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.446')] [2023-12-27 22:25:51,295][106226] Updated weights for policy 0, policy_version 444175 (0.0008) [2023-12-27 22:25:51,344][106225] Updated weights for policy 1, policy_version 445530 (0.0008) [2023-12-27 22:25:51,361][106226] Updated weights for policy 0, policy_version 444185 (0.0008) [2023-12-27 22:25:51,418][106225] Updated weights for policy 1, policy_version 445540 (0.0008) [2023-12-27 22:25:51,436][106226] Updated weights for policy 0, policy_version 444195 (0.0007) [2023-12-27 22:25:51,483][106225] Updated weights for policy 1, policy_version 445550 (0.0007) [2023-12-27 22:25:52,102][106226] Updated weights for policy 0, policy_version 444205 (0.0008) [2023-12-27 22:25:52,167][106226] Updated weights for policy 0, policy_version 444215 (0.0009) [2023-12-27 22:25:52,227][106226] Updated weights for policy 0, policy_version 444225 (0.0009) [2023-12-27 22:25:52,290][106225] Updated weights for policy 1, policy_version 445560 (0.0008) [2023-12-27 22:25:52,350][106225] Updated weights for policy 1, policy_version 445570 (0.0007) [2023-12-27 22:25:52,420][106225] Updated weights for policy 1, policy_version 445580 (0.0009) [2023-12-27 22:25:52,924][106226] Updated weights for policy 0, policy_version 444235 (0.0009) [2023-12-27 22:25:52,968][106226] Updated weights for policy 0, policy_version 444245 (0.0008) [2023-12-27 22:25:53,014][106226] Updated weights for policy 0, policy_version 444255 (0.0009) [2023-12-27 22:25:53,131][106225] Updated weights for policy 1, policy_version 445590 (0.0008) [2023-12-27 22:25:53,184][106225] Updated weights for policy 1, policy_version 445600 (0.0009) [2023-12-27 22:25:53,236][106225] Updated weights for policy 1, policy_version 445610 (0.0008) [2023-12-27 22:25:53,799][106226] Updated weights for policy 0, policy_version 444265 (0.0008) [2023-12-27 22:25:53,864][106226] Updated weights for policy 0, policy_version 444275 (0.0008) [2023-12-27 22:25:53,908][106225] Updated weights for policy 1, policy_version 445620 (0.0006) [2023-12-27 22:25:53,922][106226] Updated weights for policy 0, policy_version 444285 (0.0007) [2023-12-27 22:25:53,966][106225] Updated weights for policy 1, policy_version 445630 (0.0006) [2023-12-27 22:25:53,973][106226] Updated weights for policy 0, policy_version 444295 (0.0006) [2023-12-27 22:25:54,027][106225] Updated weights for policy 1, policy_version 445640 (0.0008) [2023-12-27 22:25:54,629][106226] Updated weights for policy 0, policy_version 444305 (0.0005) [2023-12-27 22:25:54,680][106226] Updated weights for policy 0, policy_version 444315 (0.0005) [2023-12-27 22:25:54,718][106225] Updated weights for policy 1, policy_version 445650 (0.0008) [2023-12-27 22:25:54,734][106226] Updated weights for policy 0, policy_version 444325 (0.0005) [2023-12-27 22:25:54,785][106225] Updated weights for policy 1, policy_version 445660 (0.0009) [2023-12-27 22:25:54,844][106225] Updated weights for policy 1, policy_version 445670 (0.0009) [2023-12-27 22:25:54,894][106225] Updated weights for policy 1, policy_version 445680 (0.0009) [2023-12-27 22:25:55,349][106226] Updated weights for policy 0, policy_version 444335 (0.0007) [2023-12-27 22:25:55,411][106226] Updated weights for policy 0, policy_version 444345 (0.0009) [2023-12-27 22:25:55,473][106226] Updated weights for policy 0, policy_version 444355 (0.0009) [2023-12-27 22:25:55,643][106225] Updated weights for policy 1, policy_version 445690 (0.0008) [2023-12-27 22:25:55,691][106225] Updated weights for policy 1, policy_version 445700 (0.0008) [2023-12-27 22:25:55,740][106225] Updated weights for policy 1, policy_version 445710 (0.0008) [2023-12-27 22:25:56,132][106226] Updated weights for policy 0, policy_version 444365 (0.0007) [2023-12-27 22:25:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 227917824. Throughput: 0: 9769.3, 1: 9492.8. Samples: 227888904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:25:56,175][105115] Avg episode reward: [(0, '-5.217'), (1, '-5.570')] [2023-12-27 22:25:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000445712_114130944.pth... [2023-12-27 22:25:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000444624_113852416.pth [2023-12-27 22:25:56,188][106226] Updated weights for policy 0, policy_version 444375 (0.0009) [2023-12-27 22:25:56,244][106226] Updated weights for policy 0, policy_version 444385 (0.0005) [2023-12-27 22:25:56,286][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000444392_113795072.pth... [2023-12-27 22:25:56,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000443208_113491968.pth [2023-12-27 22:25:56,564][106225] Updated weights for policy 1, policy_version 445720 (0.0008) [2023-12-27 22:25:56,614][106225] Updated weights for policy 1, policy_version 445730 (0.0007) [2023-12-27 22:25:56,667][106225] Updated weights for policy 1, policy_version 445740 (0.0007) [2023-12-27 22:25:56,852][106226] Updated weights for policy 0, policy_version 444395 (0.0005) [2023-12-27 22:25:56,908][106226] Updated weights for policy 0, policy_version 444405 (0.0005) [2023-12-27 22:25:56,970][106226] Updated weights for policy 0, policy_version 444415 (0.0005) [2023-12-27 22:25:57,433][106225] Updated weights for policy 1, policy_version 445750 (0.0007) [2023-12-27 22:25:57,489][106225] Updated weights for policy 1, policy_version 445760 (0.0007) [2023-12-27 22:25:57,544][106225] Updated weights for policy 1, policy_version 445770 (0.0008) [2023-12-27 22:25:57,554][106226] Updated weights for policy 0, policy_version 444425 (0.0006) [2023-12-27 22:25:57,607][106226] Updated weights for policy 0, policy_version 444435 (0.0011) [2023-12-27 22:25:57,654][106226] Updated weights for policy 0, policy_version 444445 (0.0010) [2023-12-27 22:25:57,700][106226] Updated weights for policy 0, policy_version 444455 (0.0010) [2023-12-27 22:25:58,294][106225] Updated weights for policy 1, policy_version 445780 (0.0007) [2023-12-27 22:25:58,365][106225] Updated weights for policy 1, policy_version 445790 (0.0008) [2023-12-27 22:25:58,435][106225] Updated weights for policy 1, policy_version 445800 (0.0009) [2023-12-27 22:25:58,485][106226] Updated weights for policy 0, policy_version 444465 (0.0008) [2023-12-27 22:25:58,558][106226] Updated weights for policy 0, policy_version 444475 (0.0008) [2023-12-27 22:25:58,624][106226] Updated weights for policy 0, policy_version 444485 (0.0007) [2023-12-27 22:25:59,185][106225] Updated weights for policy 1, policy_version 445810 (0.0007) [2023-12-27 22:25:59,256][106225] Updated weights for policy 1, policy_version 445820 (0.0008) [2023-12-27 22:25:59,317][106225] Updated weights for policy 1, policy_version 445830 (0.0008) [2023-12-27 22:25:59,386][106225] Updated weights for policy 1, policy_version 445840 (0.0008) [2023-12-27 22:25:59,431][106226] Updated weights for policy 0, policy_version 444495 (0.0008) [2023-12-27 22:25:59,489][106226] Updated weights for policy 0, policy_version 444505 (0.0008) [2023-12-27 22:25:59,537][106226] Updated weights for policy 0, policy_version 444515 (0.0008) [2023-12-27 22:26:00,101][106225] Updated weights for policy 1, policy_version 445850 (0.0009) [2023-12-27 22:26:00,150][106225] Updated weights for policy 1, policy_version 445860 (0.0008) [2023-12-27 22:26:00,202][106225] Updated weights for policy 1, policy_version 445870 (0.0008) [2023-12-27 22:26:00,277][106226] Updated weights for policy 0, policy_version 444525 (0.0007) [2023-12-27 22:26:00,331][106226] Updated weights for policy 0, policy_version 444535 (0.0005) [2023-12-27 22:26:00,385][106226] Updated weights for policy 0, policy_version 444545 (0.0007) [2023-12-27 22:26:00,912][106226] Updated weights for policy 0, policy_version 444555 (0.0005) [2023-12-27 22:26:00,967][106226] Updated weights for policy 0, policy_version 444565 (0.0005) [2023-12-27 22:26:00,999][106225] Updated weights for policy 1, policy_version 445880 (0.0009) [2023-12-27 22:26:01,023][106226] Updated weights for policy 0, policy_version 444575 (0.0005) [2023-12-27 22:26:01,064][106225] Updated weights for policy 1, policy_version 445890 (0.0009) [2023-12-27 22:26:01,138][106225] Updated weights for policy 1, policy_version 445900 (0.0008) [2023-12-27 22:26:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 228024320. Throughput: 0: 9868.1, 1: 9418.4. Samples: 228006200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:26:01,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.589')] [2023-12-27 22:26:01,725][106226] Updated weights for policy 0, policy_version 444585 (0.0008) [2023-12-27 22:26:01,801][106226] Updated weights for policy 0, policy_version 444595 (0.0008) [2023-12-27 22:26:01,845][106225] Updated weights for policy 1, policy_version 445910 (0.0006) [2023-12-27 22:26:01,864][106226] Updated weights for policy 0, policy_version 444605 (0.0007) [2023-12-27 22:26:01,905][106225] Updated weights for policy 1, policy_version 445920 (0.0008) [2023-12-27 22:26:01,923][106226] Updated weights for policy 0, policy_version 444615 (0.0008) [2023-12-27 22:26:01,965][106225] Updated weights for policy 1, policy_version 445930 (0.0008) [2023-12-27 22:26:02,592][106226] Updated weights for policy 0, policy_version 444625 (0.0005) [2023-12-27 22:26:02,653][106226] Updated weights for policy 0, policy_version 444635 (0.0006) [2023-12-27 22:26:02,714][106226] Updated weights for policy 0, policy_version 444645 (0.0008) [2023-12-27 22:26:02,732][106225] Updated weights for policy 1, policy_version 445940 (0.0008) [2023-12-27 22:26:02,797][106225] Updated weights for policy 1, policy_version 445950 (0.0009) [2023-12-27 22:26:02,856][106225] Updated weights for policy 1, policy_version 445960 (0.0007) [2023-12-27 22:26:03,413][106226] Updated weights for policy 0, policy_version 444655 (0.0008) [2023-12-27 22:26:03,472][106226] Updated weights for policy 0, policy_version 444665 (0.0008) [2023-12-27 22:26:03,513][106225] Updated weights for policy 1, policy_version 445970 (0.0008) [2023-12-27 22:26:03,524][106226] Updated weights for policy 0, policy_version 444675 (0.0009) [2023-12-27 22:26:03,582][106225] Updated weights for policy 1, policy_version 445980 (0.0006) [2023-12-27 22:26:03,649][106225] Updated weights for policy 1, policy_version 445990 (0.0007) [2023-12-27 22:26:03,709][106225] Updated weights for policy 1, policy_version 446000 (0.0008) [2023-12-27 22:26:04,282][106226] Updated weights for policy 0, policy_version 444685 (0.0007) [2023-12-27 22:26:04,351][106226] Updated weights for policy 0, policy_version 444695 (0.0007) [2023-12-27 22:26:04,413][106226] Updated weights for policy 0, policy_version 444705 (0.0007) [2023-12-27 22:26:04,421][106225] Updated weights for policy 1, policy_version 446010 (0.0009) [2023-12-27 22:26:04,478][106225] Updated weights for policy 1, policy_version 446020 (0.0009) [2023-12-27 22:26:04,533][106225] Updated weights for policy 1, policy_version 446030 (0.0008) [2023-12-27 22:26:05,108][106226] Updated weights for policy 0, policy_version 444715 (0.0007) [2023-12-27 22:26:05,158][106226] Updated weights for policy 0, policy_version 444725 (0.0009) [2023-12-27 22:26:05,214][106226] Updated weights for policy 0, policy_version 444735 (0.0008) [2023-12-27 22:26:05,236][106225] Updated weights for policy 1, policy_version 446040 (0.0008) [2023-12-27 22:26:05,295][106225] Updated weights for policy 1, policy_version 446050 (0.0007) [2023-12-27 22:26:05,357][106225] Updated weights for policy 1, policy_version 446060 (0.0008) [2023-12-27 22:26:05,975][106226] Updated weights for policy 0, policy_version 444745 (0.0008) [2023-12-27 22:26:06,042][106226] Updated weights for policy 0, policy_version 444755 (0.0011) [2023-12-27 22:26:06,074][106225] Updated weights for policy 1, policy_version 446070 (0.0007) [2023-12-27 22:26:06,101][106226] Updated weights for policy 0, policy_version 444765 (0.0010) [2023-12-27 22:26:06,135][106225] Updated weights for policy 1, policy_version 446080 (0.0008) [2023-12-27 22:26:06,167][106226] Updated weights for policy 0, policy_version 444775 (0.0011) [2023-12-27 22:26:06,178][105115] Fps is (10 sec: 19654.8, 60 sec: 19386.7, 300 sec: 19438.4). Total num frames: 228114432. Throughput: 0: 9973.8, 1: 9425.1. Samples: 228123420. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:06,179][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.337')] [2023-12-27 22:26:06,200][106225] Updated weights for policy 1, policy_version 446090 (0.0009) [2023-12-27 22:26:06,891][106226] Updated weights for policy 0, policy_version 444785 (0.0008) [2023-12-27 22:26:06,948][106225] Updated weights for policy 1, policy_version 446100 (0.0011) [2023-12-27 22:26:06,954][106226] Updated weights for policy 0, policy_version 444795 (0.0008) [2023-12-27 22:26:07,000][106225] Updated weights for policy 1, policy_version 446110 (0.0010) [2023-12-27 22:26:07,005][106226] Updated weights for policy 0, policy_version 444805 (0.0005) [2023-12-27 22:26:07,047][106225] Updated weights for policy 1, policy_version 446120 (0.0010) [2023-12-27 22:26:07,720][106225] Updated weights for policy 1, policy_version 446130 (0.0010) [2023-12-27 22:26:07,782][106225] Updated weights for policy 1, policy_version 446140 (0.0007) [2023-12-27 22:26:07,790][106226] Updated weights for policy 0, policy_version 444815 (0.0007) [2023-12-27 22:26:07,837][106225] Updated weights for policy 1, policy_version 446150 (0.0006) [2023-12-27 22:26:07,851][106226] Updated weights for policy 0, policy_version 444825 (0.0008) [2023-12-27 22:26:07,890][106225] Updated weights for policy 1, policy_version 446160 (0.0008) [2023-12-27 22:26:07,913][106226] Updated weights for policy 0, policy_version 444835 (0.0008) [2023-12-27 22:26:08,612][106225] Updated weights for policy 1, policy_version 446170 (0.0009) [2023-12-27 22:26:08,667][106225] Updated weights for policy 1, policy_version 446180 (0.0008) [2023-12-27 22:26:08,701][106226] Updated weights for policy 0, policy_version 444845 (0.0007) [2023-12-27 22:26:08,728][106225] Updated weights for policy 1, policy_version 446190 (0.0006) [2023-12-27 22:26:08,764][106226] Updated weights for policy 0, policy_version 444855 (0.0006) [2023-12-27 22:26:08,832][106226] Updated weights for policy 0, policy_version 444865 (0.0006) [2023-12-27 22:26:09,489][106226] Updated weights for policy 0, policy_version 444875 (0.0006) [2023-12-27 22:26:09,544][106226] Updated weights for policy 0, policy_version 444885 (0.0008) [2023-12-27 22:26:09,578][106225] Updated weights for policy 1, policy_version 446200 (0.0008) [2023-12-27 22:26:09,604][106226] Updated weights for policy 0, policy_version 444895 (0.0006) [2023-12-27 22:26:09,634][106225] Updated weights for policy 1, policy_version 446210 (0.0007) [2023-12-27 22:26:09,698][106225] Updated weights for policy 1, policy_version 446220 (0.0007) [2023-12-27 22:26:10,401][106226] Updated weights for policy 0, policy_version 444905 (0.0006) [2023-12-27 22:26:10,431][106225] Updated weights for policy 1, policy_version 446230 (0.0007) [2023-12-27 22:26:10,462][106226] Updated weights for policy 0, policy_version 444915 (0.0008) [2023-12-27 22:26:10,501][106225] Updated weights for policy 1, policy_version 446240 (0.0006) [2023-12-27 22:26:10,511][106226] Updated weights for policy 0, policy_version 444925 (0.0008) [2023-12-27 22:26:10,562][106225] Updated weights for policy 1, policy_version 446250 (0.0008) [2023-12-27 22:26:10,564][106226] Updated weights for policy 0, policy_version 444935 (0.0007) [2023-12-27 22:26:11,175][105115] Fps is (10 sec: 18022.0, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 228204544. Throughput: 0: 10003.4, 1: 9460.3. Samples: 228180600. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:11,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.481')] [2023-12-27 22:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000444936_113934336.pth... [2023-12-27 22:26:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000446256_114270208.pth... [2023-12-27 22:26:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000443784_113639424.pth [2023-12-27 22:26:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000445168_113991680.pth [2023-12-27 22:26:11,260][106225] Updated weights for policy 1, policy_version 446260 (0.0008) [2023-12-27 22:26:11,323][106225] Updated weights for policy 1, policy_version 446270 (0.0008) [2023-12-27 22:26:11,323][106226] Updated weights for policy 0, policy_version 444945 (0.0006) [2023-12-27 22:26:11,395][106225] Updated weights for policy 1, policy_version 446280 (0.0008) [2023-12-27 22:26:11,404][106226] Updated weights for policy 0, policy_version 444956 (0.0010) [2023-12-27 22:26:11,467][106226] Updated weights for policy 0, policy_version 444966 (0.0009) [2023-12-27 22:26:12,205][106225] Updated weights for policy 1, policy_version 446290 (0.0007) [2023-12-27 22:26:12,207][106226] Updated weights for policy 0, policy_version 444976 (0.0010) [2023-12-27 22:26:12,260][106225] Updated weights for policy 1, policy_version 446300 (0.0006) [2023-12-27 22:26:12,266][106226] Updated weights for policy 0, policy_version 444986 (0.0011) [2023-12-27 22:26:12,325][106225] Updated weights for policy 1, policy_version 446310 (0.0006) [2023-12-27 22:26:12,331][106226] Updated weights for policy 0, policy_version 444996 (0.0010) [2023-12-27 22:26:12,398][106225] Updated weights for policy 1, policy_version 446320 (0.0008) [2023-12-27 22:26:13,049][106226] Updated weights for policy 0, policy_version 445006 (0.0011) [2023-12-27 22:26:13,106][106226] Updated weights for policy 0, policy_version 445016 (0.0011) [2023-12-27 22:26:13,158][106225] Updated weights for policy 1, policy_version 446330 (0.0006) [2023-12-27 22:26:13,164][106226] Updated weights for policy 0, policy_version 445026 (0.0011) [2023-12-27 22:26:13,222][106225] Updated weights for policy 1, policy_version 446340 (0.0006) [2023-12-27 22:26:13,284][106225] Updated weights for policy 1, policy_version 446350 (0.0007) [2023-12-27 22:26:13,870][106226] Updated weights for policy 0, policy_version 445036 (0.0010) [2023-12-27 22:26:13,920][106226] Updated weights for policy 0, policy_version 445046 (0.0011) [2023-12-27 22:26:13,974][106226] Updated weights for policy 0, policy_version 445056 (0.0011) [2023-12-27 22:26:13,999][106225] Updated weights for policy 1, policy_version 446360 (0.0005) [2023-12-27 22:26:14,059][106225] Updated weights for policy 1, policy_version 446370 (0.0007) [2023-12-27 22:26:14,122][106225] Updated weights for policy 1, policy_version 446380 (0.0008) [2023-12-27 22:26:14,656][106226] Updated weights for policy 0, policy_version 445066 (0.0010) [2023-12-27 22:26:14,721][106226] Updated weights for policy 0, policy_version 445076 (0.0010) [2023-12-27 22:26:14,781][106226] Updated weights for policy 0, policy_version 445086 (0.0010) [2023-12-27 22:26:14,793][106225] Updated weights for policy 1, policy_version 446390 (0.0008) [2023-12-27 22:26:14,841][106226] Updated weights for policy 0, policy_version 445096 (0.0011) [2023-12-27 22:26:14,859][106225] Updated weights for policy 1, policy_version 446400 (0.0007) [2023-12-27 22:26:14,925][106225] Updated weights for policy 1, policy_version 446410 (0.0008) [2023-12-27 22:26:15,574][106226] Updated weights for policy 0, policy_version 445106 (0.0011) [2023-12-27 22:26:15,630][106226] Updated weights for policy 0, policy_version 445116 (0.0010) [2023-12-27 22:26:15,648][106225] Updated weights for policy 1, policy_version 446420 (0.0008) [2023-12-27 22:26:15,680][106226] Updated weights for policy 0, policy_version 445126 (0.0010) [2023-12-27 22:26:15,694][106225] Updated weights for policy 1, policy_version 446430 (0.0006) [2023-12-27 22:26:15,744][106225] Updated weights for policy 1, policy_version 446440 (0.0008) [2023-12-27 22:26:16,175][105115] Fps is (10 sec: 18847.4, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 228302848. Throughput: 0: 9879.8, 1: 9381.5. Samples: 228293784. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:16,175][105115] Avg episode reward: [(0, '-5.147'), (1, '-5.500')] [2023-12-27 22:26:16,315][106226] Updated weights for policy 0, policy_version 445136 (0.0006) [2023-12-27 22:26:16,368][106226] Updated weights for policy 0, policy_version 445146 (0.0010) [2023-12-27 22:26:16,425][106226] Updated weights for policy 0, policy_version 445156 (0.0010) [2023-12-27 22:26:16,461][106225] Updated weights for policy 1, policy_version 446450 (0.0007) [2023-12-27 22:26:16,513][106225] Updated weights for policy 1, policy_version 446460 (0.0005) [2023-12-27 22:26:16,568][106225] Updated weights for policy 1, policy_version 446470 (0.0005) [2023-12-27 22:26:16,629][106225] Updated weights for policy 1, policy_version 446480 (0.0005) [2023-12-27 22:26:17,122][106226] Updated weights for policy 0, policy_version 445166 (0.0011) [2023-12-27 22:26:17,169][106226] Updated weights for policy 0, policy_version 445176 (0.0010) [2023-12-27 22:26:17,216][106226] Updated weights for policy 0, policy_version 445186 (0.0010) [2023-12-27 22:26:17,234][106225] Updated weights for policy 1, policy_version 446490 (0.0006) [2023-12-27 22:26:17,286][106225] Updated weights for policy 1, policy_version 446500 (0.0007) [2023-12-27 22:26:17,346][106225] Updated weights for policy 1, policy_version 446510 (0.0008) [2023-12-27 22:26:17,904][106226] Updated weights for policy 0, policy_version 445196 (0.0011) [2023-12-27 22:26:17,962][106226] Updated weights for policy 0, policy_version 445206 (0.0011) [2023-12-27 22:26:18,016][106226] Updated weights for policy 0, policy_version 445216 (0.0011) [2023-12-27 22:26:18,078][106225] Updated weights for policy 1, policy_version 446520 (0.0006) [2023-12-27 22:26:18,134][106225] Updated weights for policy 1, policy_version 446530 (0.0007) [2023-12-27 22:26:18,184][106225] Updated weights for policy 1, policy_version 446540 (0.0007) [2023-12-27 22:26:18,793][106226] Updated weights for policy 0, policy_version 445226 (0.0010) [2023-12-27 22:26:18,858][106226] Updated weights for policy 0, policy_version 445236 (0.0009) [2023-12-27 22:26:18,913][106225] Updated weights for policy 1, policy_version 446550 (0.0007) [2023-12-27 22:26:18,921][106226] Updated weights for policy 0, policy_version 445246 (0.0009) [2023-12-27 22:26:18,973][106225] Updated weights for policy 1, policy_version 446560 (0.0006) [2023-12-27 22:26:18,982][106226] Updated weights for policy 0, policy_version 445256 (0.0009) [2023-12-27 22:26:19,035][106225] Updated weights for policy 1, policy_version 446570 (0.0007) [2023-12-27 22:26:19,649][106225] Updated weights for policy 1, policy_version 446580 (0.0006) [2023-12-27 22:26:19,713][106225] Updated weights for policy 1, policy_version 446590 (0.0007) [2023-12-27 22:26:19,769][106225] Updated weights for policy 1, policy_version 446600 (0.0008) [2023-12-27 22:26:19,770][106226] Updated weights for policy 0, policy_version 445266 (0.0008) [2023-12-27 22:26:19,838][106226] Updated weights for policy 0, policy_version 445276 (0.0009) [2023-12-27 22:26:19,903][106226] Updated weights for policy 0, policy_version 445286 (0.0008) [2023-12-27 22:26:20,531][106225] Updated weights for policy 1, policy_version 446610 (0.0007) [2023-12-27 22:26:20,602][106225] Updated weights for policy 1, policy_version 446620 (0.0008) [2023-12-27 22:26:20,624][106226] Updated weights for policy 0, policy_version 445296 (0.0009) [2023-12-27 22:26:20,666][106225] Updated weights for policy 1, policy_version 446630 (0.0006) [2023-12-27 22:26:20,683][106226] Updated weights for policy 0, policy_version 445306 (0.0009) [2023-12-27 22:26:20,730][106225] Updated weights for policy 1, policy_version 446640 (0.0006) [2023-12-27 22:26:20,745][106226] Updated weights for policy 0, policy_version 445316 (0.0007) [2023-12-27 22:26:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19251.2, 300 sec: 19438.7). Total num frames: 228401152. Throughput: 0: 9759.6, 1: 9456.9. Samples: 228410512. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:21,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-5.688')] [2023-12-27 22:26:21,422][106225] Updated weights for policy 1, policy_version 446650 (0.0008) [2023-12-27 22:26:21,490][106225] Updated weights for policy 1, policy_version 446660 (0.0009) [2023-12-27 22:26:21,548][106225] Updated weights for policy 1, policy_version 446670 (0.0008) [2023-12-27 22:26:21,584][106226] Updated weights for policy 0, policy_version 445326 (0.0008) [2023-12-27 22:26:21,653][106226] Updated weights for policy 0, policy_version 445336 (0.0008) [2023-12-27 22:26:21,716][106226] Updated weights for policy 0, policy_version 445346 (0.0009) [2023-12-27 22:26:22,262][106225] Updated weights for policy 1, policy_version 446680 (0.0008) [2023-12-27 22:26:22,335][106225] Updated weights for policy 1, policy_version 446690 (0.0009) [2023-12-27 22:26:22,376][106226] Updated weights for policy 0, policy_version 445357 (0.0013) [2023-12-27 22:26:22,391][106225] Updated weights for policy 1, policy_version 446700 (0.0008) [2023-12-27 22:26:22,435][106226] Updated weights for policy 0, policy_version 445367 (0.0008) [2023-12-27 22:26:22,495][106226] Updated weights for policy 0, policy_version 445377 (0.0007) [2023-12-27 22:26:23,164][106226] Updated weights for policy 0, policy_version 445387 (0.0009) [2023-12-27 22:26:23,209][106225] Updated weights for policy 1, policy_version 446710 (0.0007) [2023-12-27 22:26:23,223][106226] Updated weights for policy 0, policy_version 445397 (0.0006) [2023-12-27 22:26:23,267][106225] Updated weights for policy 1, policy_version 446720 (0.0008) [2023-12-27 22:26:23,286][106226] Updated weights for policy 0, policy_version 445407 (0.0008) [2023-12-27 22:26:23,331][106225] Updated weights for policy 1, policy_version 446730 (0.0007) [2023-12-27 22:26:23,903][106226] Updated weights for policy 0, policy_version 445417 (0.0007) [2023-12-27 22:26:23,957][106226] Updated weights for policy 0, policy_version 445427 (0.0009) [2023-12-27 22:26:24,020][106226] Updated weights for policy 0, policy_version 445437 (0.0008) [2023-12-27 22:26:24,051][106225] Updated weights for policy 1, policy_version 446740 (0.0007) [2023-12-27 22:26:24,077][106226] Updated weights for policy 0, policy_version 445447 (0.0007) [2023-12-27 22:26:24,106][106225] Updated weights for policy 1, policy_version 446750 (0.0008) [2023-12-27 22:26:24,167][106225] Updated weights for policy 1, policy_version 446760 (0.0009) [2023-12-27 22:26:24,778][106226] Updated weights for policy 0, policy_version 445457 (0.0006) [2023-12-27 22:26:24,839][106226] Updated weights for policy 0, policy_version 445467 (0.0005) [2023-12-27 22:26:24,901][106226] Updated weights for policy 0, policy_version 445477 (0.0005) [2023-12-27 22:26:24,948][106225] Updated weights for policy 1, policy_version 446770 (0.0009) [2023-12-27 22:26:25,010][106225] Updated weights for policy 1, policy_version 446780 (0.0008) [2023-12-27 22:26:25,072][106225] Updated weights for policy 1, policy_version 446791 (0.0009) [2023-12-27 22:26:25,391][106226] Updated weights for policy 0, policy_version 445487 (0.0005) [2023-12-27 22:26:25,451][106226] Updated weights for policy 0, policy_version 445497 (0.0005) [2023-12-27 22:26:25,503][106226] Updated weights for policy 0, policy_version 445507 (0.0006) [2023-12-27 22:26:25,877][106225] Updated weights for policy 1, policy_version 446801 (0.0009) [2023-12-27 22:26:25,932][106225] Updated weights for policy 1, policy_version 446811 (0.0008) [2023-12-27 22:26:25,991][106225] Updated weights for policy 1, policy_version 446821 (0.0008) [2023-12-27 22:26:26,042][106225] Updated weights for policy 1, policy_version 446831 (0.0008) [2023-12-27 22:26:26,061][106226] Updated weights for policy 0, policy_version 445517 (0.0006) [2023-12-27 22:26:26,123][106226] Updated weights for policy 0, policy_version 445527 (0.0008) [2023-12-27 22:26:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19251.3, 300 sec: 19438.6). Total num frames: 228499456. Throughput: 0: 9811.3, 1: 9431.4. Samples: 228467524. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:26,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-5.584')] [2023-12-27 22:26:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000446832_114417664.pth... [2023-12-27 22:26:26,182][106226] Updated weights for policy 0, policy_version 445537 (0.0008) [2023-12-27 22:26:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000445712_114130944.pth [2023-12-27 22:26:26,226][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000445544_114089984.pth... [2023-12-27 22:26:26,230][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000444392_113795072.pth [2023-12-27 22:26:26,751][106226] Updated weights for policy 0, policy_version 445547 (0.0009) [2023-12-27 22:26:26,809][106226] Updated weights for policy 0, policy_version 445557 (0.0008) [2023-12-27 22:26:26,855][106225] Updated weights for policy 1, policy_version 446841 (0.0007) [2023-12-27 22:26:26,866][106226] Updated weights for policy 0, policy_version 445567 (0.0006) [2023-12-27 22:26:26,911][106225] Updated weights for policy 1, policy_version 446851 (0.0007) [2023-12-27 22:26:26,969][106225] Updated weights for policy 1, policy_version 446861 (0.0008) [2023-12-27 22:26:27,454][106226] Updated weights for policy 0, policy_version 445577 (0.0006) [2023-12-27 22:26:27,518][106226] Updated weights for policy 0, policy_version 445588 (0.0006) [2023-12-27 22:26:27,574][106226] Updated weights for policy 0, policy_version 445598 (0.0006) [2023-12-27 22:26:27,632][106226] Updated weights for policy 0, policy_version 445608 (0.0010) [2023-12-27 22:26:27,676][106225] Updated weights for policy 1, policy_version 446871 (0.0008) [2023-12-27 22:26:27,730][106225] Updated weights for policy 1, policy_version 446881 (0.0008) [2023-12-27 22:26:27,793][106225] Updated weights for policy 1, policy_version 446891 (0.0008) [2023-12-27 22:26:28,231][106226] Updated weights for policy 0, policy_version 445618 (0.0006) [2023-12-27 22:26:28,289][106226] Updated weights for policy 0, policy_version 445628 (0.0007) [2023-12-27 22:26:28,366][106226] Updated weights for policy 0, policy_version 445638 (0.0007) [2023-12-27 22:26:28,566][106225] Updated weights for policy 1, policy_version 446901 (0.0008) [2023-12-27 22:26:28,627][106225] Updated weights for policy 1, policy_version 446911 (0.0007) [2023-12-27 22:26:28,687][106225] Updated weights for policy 1, policy_version 446921 (0.0007) [2023-12-27 22:26:28,976][106226] Updated weights for policy 0, policy_version 445648 (0.0010) [2023-12-27 22:26:29,041][106226] Updated weights for policy 0, policy_version 445658 (0.0010) [2023-12-27 22:26:29,094][106226] Updated weights for policy 0, policy_version 445668 (0.0010) [2023-12-27 22:26:29,460][106225] Updated weights for policy 1, policy_version 446931 (0.0009) [2023-12-27 22:26:29,523][106225] Updated weights for policy 1, policy_version 446941 (0.0009) [2023-12-27 22:26:29,582][106225] Updated weights for policy 1, policy_version 446951 (0.0008) [2023-12-27 22:26:29,823][106226] Updated weights for policy 0, policy_version 445678 (0.0009) [2023-12-27 22:26:29,891][106226] Updated weights for policy 0, policy_version 445688 (0.0010) [2023-12-27 22:26:29,966][106226] Updated weights for policy 0, policy_version 445698 (0.0009) [2023-12-27 22:26:30,381][106225] Updated weights for policy 1, policy_version 446961 (0.0008) [2023-12-27 22:26:30,440][106225] Updated weights for policy 1, policy_version 446971 (0.0009) [2023-12-27 22:26:30,501][106225] Updated weights for policy 1, policy_version 446981 (0.0008) [2023-12-27 22:26:30,551][106225] Updated weights for policy 1, policy_version 446991 (0.0008) [2023-12-27 22:26:30,621][106226] Updated weights for policy 0, policy_version 445708 (0.0008) [2023-12-27 22:26:30,676][106226] Updated weights for policy 0, policy_version 445718 (0.0009) [2023-12-27 22:26:30,727][106226] Updated weights for policy 0, policy_version 445728 (0.0008) [2023-12-27 22:26:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.8, 300 sec: 19438.7). Total num frames: 228597760. Throughput: 0: 9980.5, 1: 9396.7. Samples: 228589076. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:31,175][105115] Avg episode reward: [(0, '-5.007'), (1, '-5.567')] [2023-12-27 22:26:31,307][106225] Updated weights for policy 1, policy_version 447001 (0.0009) [2023-12-27 22:26:31,373][106225] Updated weights for policy 1, policy_version 447011 (0.0009) [2023-12-27 22:26:31,428][106225] Updated weights for policy 1, policy_version 447021 (0.0006) [2023-12-27 22:26:31,528][106226] Updated weights for policy 0, policy_version 445738 (0.0008) [2023-12-27 22:26:31,590][106226] Updated weights for policy 0, policy_version 445748 (0.0007) [2023-12-27 22:26:31,660][106226] Updated weights for policy 0, policy_version 445758 (0.0008) [2023-12-27 22:26:31,722][106226] Updated weights for policy 0, policy_version 445768 (0.0009) [2023-12-27 22:26:32,126][106225] Updated weights for policy 1, policy_version 447031 (0.0008) [2023-12-27 22:26:32,181][106225] Updated weights for policy 1, policy_version 447041 (0.0008) [2023-12-27 22:26:32,243][106225] Updated weights for policy 1, policy_version 447051 (0.0008) [2023-12-27 22:26:32,456][106226] Updated weights for policy 0, policy_version 445778 (0.0006) [2023-12-27 22:26:32,519][106226] Updated weights for policy 0, policy_version 445788 (0.0008) [2023-12-27 22:26:32,571][106226] Updated weights for policy 0, policy_version 445798 (0.0007) [2023-12-27 22:26:33,007][106225] Updated weights for policy 1, policy_version 447061 (0.0007) [2023-12-27 22:26:33,064][106225] Updated weights for policy 1, policy_version 447071 (0.0008) [2023-12-27 22:26:33,122][106225] Updated weights for policy 1, policy_version 447081 (0.0008) [2023-12-27 22:26:33,130][106226] Updated weights for policy 0, policy_version 445808 (0.0009) [2023-12-27 22:26:33,189][106226] Updated weights for policy 0, policy_version 445818 (0.0009) [2023-12-27 22:26:33,253][106226] Updated weights for policy 0, policy_version 445828 (0.0008) [2023-12-27 22:26:33,872][106225] Updated weights for policy 1, policy_version 447091 (0.0006) [2023-12-27 22:26:33,925][106225] Updated weights for policy 1, policy_version 447101 (0.0006) [2023-12-27 22:26:33,976][106226] Updated weights for policy 0, policy_version 445838 (0.0009) [2023-12-27 22:26:33,982][106225] Updated weights for policy 1, policy_version 447111 (0.0007) [2023-12-27 22:26:34,033][106226] Updated weights for policy 0, policy_version 445848 (0.0008) [2023-12-27 22:26:34,099][106226] Updated weights for policy 0, policy_version 445858 (0.0008) [2023-12-27 22:26:34,722][106225] Updated weights for policy 1, policy_version 447121 (0.0006) [2023-12-27 22:26:34,778][106225] Updated weights for policy 1, policy_version 447131 (0.0008) [2023-12-27 22:26:34,833][106225] Updated weights for policy 1, policy_version 447141 (0.0008) [2023-12-27 22:26:34,848][106226] Updated weights for policy 0, policy_version 445868 (0.0008) [2023-12-27 22:26:34,884][106225] Updated weights for policy 1, policy_version 447151 (0.0009) [2023-12-27 22:26:34,906][106226] Updated weights for policy 0, policy_version 445878 (0.0006) [2023-12-27 22:26:34,966][106226] Updated weights for policy 0, policy_version 445888 (0.0007) [2023-12-27 22:26:35,633][106225] Updated weights for policy 1, policy_version 447161 (0.0009) [2023-12-27 22:26:35,638][106226] Updated weights for policy 0, policy_version 445898 (0.0007) [2023-12-27 22:26:35,688][106225] Updated weights for policy 1, policy_version 447171 (0.0007) [2023-12-27 22:26:35,688][106226] Updated weights for policy 0, policy_version 445908 (0.0007) [2023-12-27 22:26:35,738][106226] Updated weights for policy 0, policy_version 445918 (0.0006) [2023-12-27 22:26:35,738][106225] Updated weights for policy 1, policy_version 447181 (0.0008) [2023-12-27 22:26:35,786][106226] Updated weights for policy 0, policy_version 445928 (0.0008) [2023-12-27 22:26:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19438.6). Total num frames: 228696064. Throughput: 0: 9974.0, 1: 9431.1. Samples: 228705600. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:36,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-5.355')] [2023-12-27 22:26:36,471][106225] Updated weights for policy 1, policy_version 447191 (0.0008) [2023-12-27 22:26:36,534][106225] Updated weights for policy 1, policy_version 447201 (0.0009) [2023-12-27 22:26:36,559][106226] Updated weights for policy 0, policy_version 445938 (0.0007) [2023-12-27 22:26:36,599][106225] Updated weights for policy 1, policy_version 447211 (0.0006) [2023-12-27 22:26:36,625][106226] Updated weights for policy 0, policy_version 445948 (0.0006) [2023-12-27 22:26:36,692][106226] Updated weights for policy 0, policy_version 445958 (0.0009) [2023-12-27 22:26:37,332][106225] Updated weights for policy 1, policy_version 447221 (0.0008) [2023-12-27 22:26:37,395][106225] Updated weights for policy 1, policy_version 447231 (0.0008) [2023-12-27 22:26:37,425][106226] Updated weights for policy 0, policy_version 445968 (0.0007) [2023-12-27 22:26:37,450][106225] Updated weights for policy 1, policy_version 447241 (0.0007) [2023-12-27 22:26:37,479][106226] Updated weights for policy 0, policy_version 445978 (0.0007) [2023-12-27 22:26:37,538][106226] Updated weights for policy 0, policy_version 445988 (0.0008) [2023-12-27 22:26:38,074][106225] Updated weights for policy 1, policy_version 447251 (0.0006) [2023-12-27 22:26:38,134][106225] Updated weights for policy 1, policy_version 447261 (0.0005) [2023-12-27 22:26:38,201][106225] Updated weights for policy 1, policy_version 447271 (0.0005) [2023-12-27 22:26:38,362][106226] Updated weights for policy 0, policy_version 445998 (0.0008) [2023-12-27 22:26:38,426][106226] Updated weights for policy 0, policy_version 446008 (0.0008) [2023-12-27 22:26:38,494][106226] Updated weights for policy 0, policy_version 446018 (0.0009) [2023-12-27 22:26:38,888][106225] Updated weights for policy 1, policy_version 447281 (0.0006) [2023-12-27 22:26:38,955][106225] Updated weights for policy 1, policy_version 447291 (0.0007) [2023-12-27 22:26:39,024][106225] Updated weights for policy 1, policy_version 447301 (0.0009) [2023-12-27 22:26:39,085][106225] Updated weights for policy 1, policy_version 447311 (0.0008) [2023-12-27 22:26:39,174][106226] Updated weights for policy 0, policy_version 446028 (0.0009) [2023-12-27 22:26:39,235][106226] Updated weights for policy 0, policy_version 446038 (0.0009) [2023-12-27 22:26:39,298][106226] Updated weights for policy 0, policy_version 446048 (0.0008) [2023-12-27 22:26:39,869][106225] Updated weights for policy 1, policy_version 447321 (0.0009) [2023-12-27 22:26:39,947][106225] Updated weights for policy 1, policy_version 447331 (0.0009) [2023-12-27 22:26:40,015][106225] Updated weights for policy 1, policy_version 447341 (0.0009) [2023-12-27 22:26:40,135][106226] Updated weights for policy 0, policy_version 446058 (0.0008) [2023-12-27 22:26:40,198][106226] Updated weights for policy 0, policy_version 446068 (0.0008) [2023-12-27 22:26:40,261][106226] Updated weights for policy 0, policy_version 446078 (0.0009) [2023-12-27 22:26:40,322][106226] Updated weights for policy 0, policy_version 446088 (0.0009) [2023-12-27 22:26:40,759][106225] Updated weights for policy 1, policy_version 447351 (0.0008) [2023-12-27 22:26:40,811][106225] Updated weights for policy 1, policy_version 447361 (0.0009) [2023-12-27 22:26:40,868][106225] Updated weights for policy 1, policy_version 447371 (0.0009) [2023-12-27 22:26:41,068][106226] Updated weights for policy 0, policy_version 446098 (0.0008) [2023-12-27 22:26:41,129][106226] Updated weights for policy 0, policy_version 446108 (0.0008) [2023-12-27 22:26:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19251.2, 300 sec: 19410.9). Total num frames: 228786176. Throughput: 0: 9959.4, 1: 9484.0. Samples: 228763856. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:41,175][105115] Avg episode reward: [(0, '-4.786'), (1, '-5.612')] [2023-12-27 22:26:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000447376_114556928.pth... [2023-12-27 22:26:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000446256_114270208.pth [2023-12-27 22:26:41,199][106226] Updated weights for policy 0, policy_version 446118 (0.0008) [2023-12-27 22:26:41,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000446120_114237440.pth... [2023-12-27 22:26:41,219][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000444936_113934336.pth [2023-12-27 22:26:41,655][106225] Updated weights for policy 1, policy_version 447381 (0.0009) [2023-12-27 22:26:41,717][106225] Updated weights for policy 1, policy_version 447391 (0.0009) [2023-12-27 22:26:41,788][106225] Updated weights for policy 1, policy_version 447401 (0.0008) [2023-12-27 22:26:42,014][106226] Updated weights for policy 0, policy_version 446128 (0.0006) [2023-12-27 22:26:42,080][106226] Updated weights for policy 0, policy_version 446138 (0.0006) [2023-12-27 22:26:42,141][106226] Updated weights for policy 0, policy_version 446148 (0.0006) [2023-12-27 22:26:42,597][106225] Updated weights for policy 1, policy_version 447411 (0.0010) [2023-12-27 22:26:42,652][106225] Updated weights for policy 1, policy_version 447421 (0.0010) [2023-12-27 22:26:42,707][106225] Updated weights for policy 1, policy_version 447431 (0.0010) [2023-12-27 22:26:42,804][106226] Updated weights for policy 0, policy_version 446158 (0.0006) [2023-12-27 22:26:42,870][106226] Updated weights for policy 0, policy_version 446168 (0.0005) [2023-12-27 22:26:42,929][106226] Updated weights for policy 0, policy_version 446178 (0.0008) [2023-12-27 22:26:43,409][106225] Updated weights for policy 1, policy_version 447441 (0.0010) [2023-12-27 22:26:43,475][106225] Updated weights for policy 1, policy_version 447451 (0.0010) [2023-12-27 22:26:43,532][106225] Updated weights for policy 1, policy_version 447461 (0.0010) [2023-12-27 22:26:43,595][106225] Updated weights for policy 1, policy_version 447471 (0.0010) [2023-12-27 22:26:43,607][106226] Updated weights for policy 0, policy_version 446188 (0.0008) [2023-12-27 22:26:43,664][106226] Updated weights for policy 0, policy_version 446198 (0.0011) [2023-12-27 22:26:43,715][106226] Updated weights for policy 0, policy_version 446208 (0.0010) [2023-12-27 22:26:44,249][106225] Updated weights for policy 1, policy_version 447481 (0.0008) [2023-12-27 22:26:44,297][106225] Updated weights for policy 1, policy_version 447491 (0.0008) [2023-12-27 22:26:44,345][106225] Updated weights for policy 1, policy_version 447501 (0.0008) [2023-12-27 22:26:44,453][106226] Updated weights for policy 0, policy_version 446218 (0.0009) [2023-12-27 22:26:44,504][106226] Updated weights for policy 0, policy_version 446228 (0.0008) [2023-12-27 22:26:44,556][106226] Updated weights for policy 0, policy_version 446238 (0.0009) [2023-12-27 22:26:45,021][106225] Updated weights for policy 1, policy_version 447511 (0.0007) [2023-12-27 22:26:45,075][106225] Updated weights for policy 1, policy_version 447521 (0.0007) [2023-12-27 22:26:45,141][106225] Updated weights for policy 1, policy_version 447531 (0.0010) [2023-12-27 22:26:45,305][106226] Updated weights for policy 0, policy_version 446249 (0.0007) [2023-12-27 22:26:45,366][106226] Updated weights for policy 0, policy_version 446259 (0.0008) [2023-12-27 22:26:45,429][106226] Updated weights for policy 0, policy_version 446269 (0.0008) [2023-12-27 22:26:45,492][106226] Updated weights for policy 0, policy_version 446279 (0.0008) [2023-12-27 22:26:45,808][106225] Updated weights for policy 1, policy_version 447541 (0.0009) [2023-12-27 22:26:45,868][106225] Updated weights for policy 1, policy_version 447551 (0.0008) [2023-12-27 22:26:45,930][106225] Updated weights for policy 1, policy_version 447561 (0.0008) [2023-12-27 22:26:46,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19251.3, 300 sec: 19438.7). Total num frames: 228884480. Throughput: 0: 9830.9, 1: 9496.9. Samples: 228875952. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:46,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.787')] [2023-12-27 22:26:46,205][106226] Updated weights for policy 0, policy_version 446289 (0.0009) [2023-12-27 22:26:46,257][106226] Updated weights for policy 0, policy_version 446299 (0.0008) [2023-12-27 22:26:46,309][106226] Updated weights for policy 0, policy_version 446309 (0.0008) [2023-12-27 22:26:46,674][106225] Updated weights for policy 1, policy_version 447571 (0.0008) [2023-12-27 22:26:46,741][106225] Updated weights for policy 1, policy_version 447581 (0.0009) [2023-12-27 22:26:46,797][106225] Updated weights for policy 1, policy_version 447591 (0.0008) [2023-12-27 22:26:46,924][106226] Updated weights for policy 0, policy_version 446319 (0.0008) [2023-12-27 22:26:46,988][106226] Updated weights for policy 0, policy_version 446329 (0.0006) [2023-12-27 22:26:47,051][106226] Updated weights for policy 0, policy_version 446339 (0.0009) [2023-12-27 22:26:47,482][106225] Updated weights for policy 1, policy_version 447601 (0.0008) [2023-12-27 22:26:47,539][106225] Updated weights for policy 1, policy_version 447611 (0.0010) [2023-12-27 22:26:47,596][106225] Updated weights for policy 1, policy_version 447621 (0.0010) [2023-12-27 22:26:47,657][106225] Updated weights for policy 1, policy_version 447631 (0.0009) [2023-12-27 22:26:47,676][106226] Updated weights for policy 0, policy_version 446349 (0.0008) [2023-12-27 22:26:47,744][106226] Updated weights for policy 0, policy_version 446359 (0.0005) [2023-12-27 22:26:47,807][106226] Updated weights for policy 0, policy_version 446369 (0.0005) [2023-12-27 22:26:48,254][106225] Updated weights for policy 1, policy_version 447641 (0.0010) [2023-12-27 22:26:48,315][106226] Updated weights for policy 0, policy_version 446379 (0.0006) [2023-12-27 22:26:48,316][106225] Updated weights for policy 1, policy_version 447651 (0.0011) [2023-12-27 22:26:48,369][106226] Updated weights for policy 0, policy_version 446389 (0.0008) [2023-12-27 22:26:48,381][106225] Updated weights for policy 1, policy_version 447661 (0.0009) [2023-12-27 22:26:48,442][106226] Updated weights for policy 0, policy_version 446399 (0.0007) [2023-12-27 22:26:49,110][106225] Updated weights for policy 1, policy_version 447671 (0.0008) [2023-12-27 22:26:49,152][106226] Updated weights for policy 0, policy_version 446409 (0.0008) [2023-12-27 22:26:49,165][106225] Updated weights for policy 1, policy_version 447681 (0.0006) [2023-12-27 22:26:49,219][106226] Updated weights for policy 0, policy_version 446419 (0.0006) [2023-12-27 22:26:49,230][106225] Updated weights for policy 1, policy_version 447691 (0.0006) [2023-12-27 22:26:49,280][106226] Updated weights for policy 0, policy_version 446429 (0.0008) [2023-12-27 22:26:49,347][106226] Updated weights for policy 0, policy_version 446439 (0.0008) [2023-12-27 22:26:49,938][106225] Updated weights for policy 1, policy_version 447701 (0.0009) [2023-12-27 22:26:50,003][106225] Updated weights for policy 1, policy_version 447711 (0.0011) [2023-12-27 22:26:50,065][106225] Updated weights for policy 1, policy_version 447721 (0.0010) [2023-12-27 22:26:50,075][106226] Updated weights for policy 0, policy_version 446449 (0.0007) [2023-12-27 22:26:50,144][106226] Updated weights for policy 0, policy_version 446459 (0.0007) [2023-12-27 22:26:50,210][106226] Updated weights for policy 0, policy_version 446469 (0.0008) [2023-12-27 22:26:50,793][106225] Updated weights for policy 1, policy_version 447731 (0.0009) [2023-12-27 22:26:50,862][106225] Updated weights for policy 1, policy_version 447741 (0.0007) [2023-12-27 22:26:50,928][106225] Updated weights for policy 1, policy_version 447751 (0.0011) [2023-12-27 22:26:50,956][106226] Updated weights for policy 0, policy_version 446479 (0.0009) [2023-12-27 22:26:51,012][106226] Updated weights for policy 0, policy_version 446489 (0.0005) [2023-12-27 22:26:51,082][106226] Updated weights for policy 0, policy_version 446499 (0.0008) [2023-12-27 22:26:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 228990976. Throughput: 0: 9855.1, 1: 9548.0. Samples: 228996504. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:51,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.532')] [2023-12-27 22:26:51,674][106225] Updated weights for policy 1, policy_version 447761 (0.0010) [2023-12-27 22:26:51,745][106225] Updated weights for policy 1, policy_version 447771 (0.0008) [2023-12-27 22:26:51,777][106226] Updated weights for policy 0, policy_version 446509 (0.0008) [2023-12-27 22:26:51,803][106225] Updated weights for policy 1, policy_version 447781 (0.0009) [2023-12-27 22:26:51,839][106226] Updated weights for policy 0, policy_version 446519 (0.0009) [2023-12-27 22:26:51,854][106225] Updated weights for policy 1, policy_version 447791 (0.0005) [2023-12-27 22:26:51,904][106226] Updated weights for policy 0, policy_version 446529 (0.0009) [2023-12-27 22:26:52,530][106225] Updated weights for policy 1, policy_version 447801 (0.0008) [2023-12-27 22:26:52,595][106226] Updated weights for policy 0, policy_version 446539 (0.0008) [2023-12-27 22:26:52,600][106225] Updated weights for policy 1, policy_version 447811 (0.0009) [2023-12-27 22:26:52,653][106226] Updated weights for policy 0, policy_version 446549 (0.0006) [2023-12-27 22:26:52,659][106225] Updated weights for policy 1, policy_version 447821 (0.0008) [2023-12-27 22:26:52,708][106226] Updated weights for policy 0, policy_version 446559 (0.0009) [2023-12-27 22:26:53,344][106225] Updated weights for policy 1, policy_version 447831 (0.0007) [2023-12-27 22:26:53,405][106226] Updated weights for policy 0, policy_version 446569 (0.0009) [2023-12-27 22:26:53,407][106225] Updated weights for policy 1, policy_version 447841 (0.0007) [2023-12-27 22:26:53,466][106225] Updated weights for policy 1, policy_version 447851 (0.0007) [2023-12-27 22:26:53,480][106226] Updated weights for policy 0, policy_version 446579 (0.0011) [2023-12-27 22:26:53,556][106226] Updated weights for policy 0, policy_version 446589 (0.0011) [2023-12-27 22:26:53,629][106226] Updated weights for policy 0, policy_version 446599 (0.0011) [2023-12-27 22:26:54,172][106226] Updated weights for policy 0, policy_version 446609 (0.0009) [2023-12-27 22:26:54,205][106225] Updated weights for policy 1, policy_version 447861 (0.0006) [2023-12-27 22:26:54,237][106226] Updated weights for policy 0, policy_version 446619 (0.0011) [2023-12-27 22:26:54,269][106225] Updated weights for policy 1, policy_version 447871 (0.0005) [2023-12-27 22:26:54,301][106226] Updated weights for policy 0, policy_version 446629 (0.0011) [2023-12-27 22:26:54,330][106225] Updated weights for policy 1, policy_version 447881 (0.0006) [2023-12-27 22:26:54,973][106225] Updated weights for policy 1, policy_version 447891 (0.0007) [2023-12-27 22:26:55,024][106226] Updated weights for policy 0, policy_version 446639 (0.0009) [2023-12-27 22:26:55,036][106225] Updated weights for policy 1, policy_version 447901 (0.0007) [2023-12-27 22:26:55,085][106226] Updated weights for policy 0, policy_version 446649 (0.0007) [2023-12-27 22:26:55,093][106225] Updated weights for policy 1, policy_version 447911 (0.0009) [2023-12-27 22:26:55,147][106226] Updated weights for policy 0, policy_version 446659 (0.0007) [2023-12-27 22:26:55,778][106225] Updated weights for policy 1, policy_version 447921 (0.0007) [2023-12-27 22:26:55,841][106226] Updated weights for policy 0, policy_version 446669 (0.0009) [2023-12-27 22:26:55,843][106225] Updated weights for policy 1, policy_version 447931 (0.0007) [2023-12-27 22:26:55,902][106225] Updated weights for policy 1, policy_version 447941 (0.0006) [2023-12-27 22:26:55,902][106226] Updated weights for policy 0, policy_version 446680 (0.0010) [2023-12-27 22:26:55,960][106225] Updated weights for policy 1, policy_version 447951 (0.0006) [2023-12-27 22:26:55,969][106226] Updated weights for policy 0, policy_version 446690 (0.0006) [2023-12-27 22:26:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 229089280. Throughput: 0: 9908.1, 1: 9549.4. Samples: 229056188. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:26:56,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.593')] [2023-12-27 22:26:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000447952_114704384.pth... [2023-12-27 22:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000446696_114384896.pth... [2023-12-27 22:26:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000445544_114089984.pth [2023-12-27 22:26:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000446832_114417664.pth [2023-12-27 22:26:56,494][106226] Updated weights for policy 0, policy_version 446700 (0.0005) [2023-12-27 22:26:56,549][106226] Updated weights for policy 0, policy_version 446710 (0.0005) [2023-12-27 22:26:56,598][106226] Updated weights for policy 0, policy_version 446720 (0.0005) [2023-12-27 22:26:56,644][106225] Updated weights for policy 1, policy_version 447961 (0.0008) [2023-12-27 22:26:56,692][106225] Updated weights for policy 1, policy_version 447971 (0.0008) [2023-12-27 22:26:56,750][106225] Updated weights for policy 1, policy_version 447982 (0.0010) [2023-12-27 22:26:57,210][106226] Updated weights for policy 0, policy_version 446730 (0.0006) [2023-12-27 22:26:57,271][106226] Updated weights for policy 0, policy_version 446740 (0.0009) [2023-12-27 22:26:57,335][106226] Updated weights for policy 0, policy_version 446750 (0.0010) [2023-12-27 22:26:57,401][106226] Updated weights for policy 0, policy_version 446760 (0.0011) [2023-12-27 22:26:57,480][106225] Updated weights for policy 1, policy_version 447992 (0.0006) [2023-12-27 22:26:57,536][106225] Updated weights for policy 1, policy_version 448002 (0.0005) [2023-12-27 22:26:57,589][106225] Updated weights for policy 1, policy_version 448012 (0.0008) [2023-12-27 22:26:58,077][106226] Updated weights for policy 0, policy_version 446770 (0.0005) [2023-12-27 22:26:58,137][106226] Updated weights for policy 0, policy_version 446780 (0.0005) [2023-12-27 22:26:58,207][106226] Updated weights for policy 0, policy_version 446790 (0.0009) [2023-12-27 22:26:58,288][106225] Updated weights for policy 1, policy_version 448022 (0.0008) [2023-12-27 22:26:58,367][106225] Updated weights for policy 1, policy_version 448032 (0.0008) [2023-12-27 22:26:58,430][106225] Updated weights for policy 1, policy_version 448042 (0.0007) [2023-12-27 22:26:58,952][106226] Updated weights for policy 0, policy_version 446800 (0.0009) [2023-12-27 22:26:59,028][106226] Updated weights for policy 0, policy_version 446810 (0.0011) [2023-12-27 22:26:59,090][106226] Updated weights for policy 0, policy_version 446820 (0.0010) [2023-12-27 22:26:59,192][106225] Updated weights for policy 1, policy_version 448052 (0.0008) [2023-12-27 22:26:59,260][106225] Updated weights for policy 1, policy_version 448062 (0.0009) [2023-12-27 22:26:59,330][106225] Updated weights for policy 1, policy_version 448072 (0.0010) [2023-12-27 22:26:59,853][106226] Updated weights for policy 0, policy_version 446830 (0.0009) [2023-12-27 22:26:59,905][106226] Updated weights for policy 0, policy_version 446840 (0.0009) [2023-12-27 22:26:59,976][106226] Updated weights for policy 0, policy_version 446850 (0.0010) [2023-12-27 22:27:00,105][106225] Updated weights for policy 1, policy_version 448083 (0.0010) [2023-12-27 22:27:00,169][106225] Updated weights for policy 1, policy_version 448093 (0.0010) [2023-12-27 22:27:00,232][106225] Updated weights for policy 1, policy_version 448103 (0.0010) [2023-12-27 22:27:00,656][106226] Updated weights for policy 0, policy_version 446860 (0.0009) [2023-12-27 22:27:00,716][106226] Updated weights for policy 0, policy_version 446870 (0.0010) [2023-12-27 22:27:00,771][106226] Updated weights for policy 0, policy_version 446880 (0.0010) [2023-12-27 22:27:00,830][106225] Updated weights for policy 1, policy_version 448113 (0.0010) [2023-12-27 22:27:00,889][106225] Updated weights for policy 1, policy_version 448123 (0.0010) [2023-12-27 22:27:00,944][106225] Updated weights for policy 1, policy_version 448133 (0.0007) [2023-12-27 22:27:00,995][106225] Updated weights for policy 1, policy_version 448143 (0.0005) [2023-12-27 22:27:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.7, 300 sec: 19466.4). Total num frames: 229187584. Throughput: 0: 9985.7, 1: 9566.0. Samples: 229173608. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:01,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-5.421')] [2023-12-27 22:27:01,494][106226] Updated weights for policy 0, policy_version 446890 (0.0010) [2023-12-27 22:27:01,552][106226] Updated weights for policy 0, policy_version 446900 (0.0006) [2023-12-27 22:27:01,613][106226] Updated weights for policy 0, policy_version 446910 (0.0007) [2023-12-27 22:27:01,679][106226] Updated weights for policy 0, policy_version 446920 (0.0006) [2023-12-27 22:27:01,895][106225] Updated weights for policy 1, policy_version 448153 (0.0010) [2023-12-27 22:27:01,951][106225] Updated weights for policy 1, policy_version 448163 (0.0012) [2023-12-27 22:27:02,012][106225] Updated weights for policy 1, policy_version 448173 (0.0005) [2023-12-27 22:27:02,416][106226] Updated weights for policy 0, policy_version 446930 (0.0009) [2023-12-27 22:27:02,466][106226] Updated weights for policy 0, policy_version 446940 (0.0008) [2023-12-27 22:27:02,524][106226] Updated weights for policy 0, policy_version 446950 (0.0008) [2023-12-27 22:27:02,662][106225] Updated weights for policy 1, policy_version 448183 (0.0009) [2023-12-27 22:27:02,725][106225] Updated weights for policy 1, policy_version 448193 (0.0006) [2023-12-27 22:27:02,795][106225] Updated weights for policy 1, policy_version 448203 (0.0006) [2023-12-27 22:27:03,200][106226] Updated weights for policy 0, policy_version 446960 (0.0010) [2023-12-27 22:27:03,260][106226] Updated weights for policy 0, policy_version 446970 (0.0010) [2023-12-27 22:27:03,322][106226] Updated weights for policy 0, policy_version 446980 (0.0010) [2023-12-27 22:27:03,359][106225] Updated weights for policy 1, policy_version 448213 (0.0005) [2023-12-27 22:27:03,413][106225] Updated weights for policy 1, policy_version 448223 (0.0005) [2023-12-27 22:27:03,471][106225] Updated weights for policy 1, policy_version 448233 (0.0005) [2023-12-27 22:27:04,034][106226] Updated weights for policy 0, policy_version 446990 (0.0011) [2023-12-27 22:27:04,101][106226] Updated weights for policy 0, policy_version 447000 (0.0011) [2023-12-27 22:27:04,149][106225] Updated weights for policy 1, policy_version 448243 (0.0007) [2023-12-27 22:27:04,159][106226] Updated weights for policy 0, policy_version 447010 (0.0010) [2023-12-27 22:27:04,208][106225] Updated weights for policy 1, policy_version 448253 (0.0007) [2023-12-27 22:27:04,270][106225] Updated weights for policy 1, policy_version 448263 (0.0008) [2023-12-27 22:27:04,782][106226] Updated weights for policy 0, policy_version 447020 (0.0008) [2023-12-27 22:27:04,831][106226] Updated weights for policy 0, policy_version 447030 (0.0009) [2023-12-27 22:27:04,891][106226] Updated weights for policy 0, policy_version 447040 (0.0010) [2023-12-27 22:27:05,028][106225] Updated weights for policy 1, policy_version 448273 (0.0007) [2023-12-27 22:27:05,097][106225] Updated weights for policy 1, policy_version 448283 (0.0005) [2023-12-27 22:27:05,166][106225] Updated weights for policy 1, policy_version 448293 (0.0006) [2023-12-27 22:27:05,223][106225] Updated weights for policy 1, policy_version 448303 (0.0009) [2023-12-27 22:27:05,490][106226] Updated weights for policy 0, policy_version 447050 (0.0010) [2023-12-27 22:27:05,539][106226] Updated weights for policy 0, policy_version 447060 (0.0008) [2023-12-27 22:27:05,598][106226] Updated weights for policy 0, policy_version 447070 (0.0008) [2023-12-27 22:27:05,665][106226] Updated weights for policy 0, policy_version 447080 (0.0005) [2023-12-27 22:27:05,843][106225] Updated weights for policy 1, policy_version 448313 (0.0006) [2023-12-27 22:27:05,901][106225] Updated weights for policy 1, policy_version 448323 (0.0008) [2023-12-27 22:27:05,959][106225] Updated weights for policy 1, policy_version 448333 (0.0008) [2023-12-27 22:27:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19525.3, 300 sec: 19466.4). Total num frames: 229285888. Throughput: 0: 10067.9, 1: 9591.8. Samples: 229295200. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:06,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.383')] [2023-12-27 22:27:06,352][106226] Updated weights for policy 0, policy_version 447090 (0.0011) [2023-12-27 22:27:06,415][106226] Updated weights for policy 0, policy_version 447100 (0.0010) [2023-12-27 22:27:06,481][106226] Updated weights for policy 0, policy_version 447110 (0.0011) [2023-12-27 22:27:06,730][106225] Updated weights for policy 1, policy_version 448343 (0.0009) [2023-12-27 22:27:06,787][106225] Updated weights for policy 1, policy_version 448353 (0.0010) [2023-12-27 22:27:06,838][106225] Updated weights for policy 1, policy_version 448363 (0.0008) [2023-12-27 22:27:07,140][106226] Updated weights for policy 0, policy_version 447120 (0.0011) [2023-12-27 22:27:07,191][106226] Updated weights for policy 0, policy_version 447130 (0.0010) [2023-12-27 22:27:07,246][106226] Updated weights for policy 0, policy_version 447140 (0.0011) [2023-12-27 22:27:07,556][106225] Updated weights for policy 1, policy_version 448373 (0.0008) [2023-12-27 22:27:07,623][106225] Updated weights for policy 1, policy_version 448383 (0.0008) [2023-12-27 22:27:07,686][106225] Updated weights for policy 1, policy_version 448393 (0.0008) [2023-12-27 22:27:07,992][106226] Updated weights for policy 0, policy_version 447150 (0.0008) [2023-12-27 22:27:08,049][106226] Updated weights for policy 0, policy_version 447160 (0.0011) [2023-12-27 22:27:08,113][106226] Updated weights for policy 0, policy_version 447170 (0.0011) [2023-12-27 22:27:08,405][106225] Updated weights for policy 1, policy_version 448403 (0.0007) [2023-12-27 22:27:08,467][106225] Updated weights for policy 1, policy_version 448413 (0.0006) [2023-12-27 22:27:08,530][106225] Updated weights for policy 1, policy_version 448423 (0.0007) [2023-12-27 22:27:08,870][106226] Updated weights for policy 0, policy_version 447180 (0.0009) [2023-12-27 22:27:08,940][106226] Updated weights for policy 0, policy_version 447190 (0.0009) [2023-12-27 22:27:09,003][106226] Updated weights for policy 0, policy_version 447200 (0.0009) [2023-12-27 22:27:09,222][106225] Updated weights for policy 1, policy_version 448433 (0.0009) [2023-12-27 22:27:09,293][106225] Updated weights for policy 1, policy_version 448443 (0.0008) [2023-12-27 22:27:09,367][106225] Updated weights for policy 1, policy_version 448453 (0.0009) [2023-12-27 22:27:09,434][106225] Updated weights for policy 1, policy_version 448463 (0.0009) [2023-12-27 22:27:09,667][106226] Updated weights for policy 0, policy_version 447210 (0.0008) [2023-12-27 22:27:09,734][106226] Updated weights for policy 0, policy_version 447220 (0.0008) [2023-12-27 22:27:09,804][106226] Updated weights for policy 0, policy_version 447230 (0.0009) [2023-12-27 22:27:09,890][106226] Updated weights for policy 0, policy_version 447240 (0.0010) [2023-12-27 22:27:10,225][106225] Updated weights for policy 1, policy_version 448473 (0.0008) [2023-12-27 22:27:10,290][106225] Updated weights for policy 1, policy_version 448483 (0.0008) [2023-12-27 22:27:10,356][106225] Updated weights for policy 1, policy_version 448493 (0.0008) [2023-12-27 22:27:10,658][106226] Updated weights for policy 0, policy_version 447250 (0.0009) [2023-12-27 22:27:10,707][106226] Updated weights for policy 0, policy_version 447260 (0.0009) [2023-12-27 22:27:10,772][106226] Updated weights for policy 0, policy_version 447270 (0.0008) [2023-12-27 22:27:11,083][106225] Updated weights for policy 1, policy_version 448503 (0.0008) [2023-12-27 22:27:11,147][106225] Updated weights for policy 1, policy_version 448513 (0.0008) [2023-12-27 22:27:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 229376000. Throughput: 0: 10036.8, 1: 9627.4. Samples: 229352416. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:11,177][105115] Avg episode reward: [(0, '-4.763'), (1, '-5.613')] [2023-12-27 22:27:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000447272_114532352.pth... [2023-12-27 22:27:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000446120_114237440.pth [2023-12-27 22:27:11,217][106225] Updated weights for policy 1, policy_version 448523 (0.0008) [2023-12-27 22:27:11,250][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000448528_114851840.pth... [2023-12-27 22:27:11,254][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000447376_114556928.pth [2023-12-27 22:27:11,574][106226] Updated weights for policy 0, policy_version 447280 (0.0008) [2023-12-27 22:27:11,642][106226] Updated weights for policy 0, policy_version 447290 (0.0009) [2023-12-27 22:27:11,706][106226] Updated weights for policy 0, policy_version 447300 (0.0008) [2023-12-27 22:27:12,025][106225] Updated weights for policy 1, policy_version 448533 (0.0008) [2023-12-27 22:27:12,087][106225] Updated weights for policy 1, policy_version 448543 (0.0008) [2023-12-27 22:27:12,153][106225] Updated weights for policy 1, policy_version 448553 (0.0008) [2023-12-27 22:27:12,470][106226] Updated weights for policy 0, policy_version 447310 (0.0007) [2023-12-27 22:27:12,529][106226] Updated weights for policy 0, policy_version 447320 (0.0006) [2023-12-27 22:27:12,591][106226] Updated weights for policy 0, policy_version 447330 (0.0006) [2023-12-27 22:27:12,845][106225] Updated weights for policy 1, policy_version 448563 (0.0008) [2023-12-27 22:27:12,904][106225] Updated weights for policy 1, policy_version 448573 (0.0008) [2023-12-27 22:27:12,959][106225] Updated weights for policy 1, policy_version 448583 (0.0008) [2023-12-27 22:27:13,275][106226] Updated weights for policy 0, policy_version 447340 (0.0009) [2023-12-27 22:27:13,335][106226] Updated weights for policy 0, policy_version 447350 (0.0011) [2023-12-27 22:27:13,392][106226] Updated weights for policy 0, policy_version 447360 (0.0010) [2023-12-27 22:27:13,615][106225] Updated weights for policy 1, policy_version 448593 (0.0007) [2023-12-27 22:27:13,676][106225] Updated weights for policy 1, policy_version 448603 (0.0007) [2023-12-27 22:27:13,733][106225] Updated weights for policy 1, policy_version 448613 (0.0008) [2023-12-27 22:27:13,790][106225] Updated weights for policy 1, policy_version 448623 (0.0008) [2023-12-27 22:27:14,102][106226] Updated weights for policy 0, policy_version 447370 (0.0011) [2023-12-27 22:27:14,150][106226] Updated weights for policy 0, policy_version 447380 (0.0010) [2023-12-27 22:27:14,206][106226] Updated weights for policy 0, policy_version 447390 (0.0011) [2023-12-27 22:27:14,276][106226] Updated weights for policy 0, policy_version 447400 (0.0011) [2023-12-27 22:27:14,414][106225] Updated weights for policy 1, policy_version 448633 (0.0007) [2023-12-27 22:27:14,464][106225] Updated weights for policy 1, policy_version 448643 (0.0008) [2023-12-27 22:27:14,518][106225] Updated weights for policy 1, policy_version 448653 (0.0005) [2023-12-27 22:27:14,994][106226] Updated weights for policy 0, policy_version 447410 (0.0011) [2023-12-27 22:27:15,061][106226] Updated weights for policy 0, policy_version 447420 (0.0010) [2023-12-27 22:27:15,126][106226] Updated weights for policy 0, policy_version 447430 (0.0009) [2023-12-27 22:27:15,211][106225] Updated weights for policy 1, policy_version 448663 (0.0008) [2023-12-27 22:27:15,271][106225] Updated weights for policy 1, policy_version 448673 (0.0008) [2023-12-27 22:27:15,341][106225] Updated weights for policy 1, policy_version 448683 (0.0010) [2023-12-27 22:27:15,756][106226] Updated weights for policy 0, policy_version 447440 (0.0006) [2023-12-27 22:27:15,802][106226] Updated weights for policy 0, policy_version 447450 (0.0010) [2023-12-27 22:27:15,849][106226] Updated weights for policy 0, policy_version 447460 (0.0011) [2023-12-27 22:27:15,985][106225] Updated weights for policy 1, policy_version 448693 (0.0009) [2023-12-27 22:27:16,045][106225] Updated weights for policy 1, policy_version 448703 (0.0008) [2023-12-27 22:27:16,108][106225] Updated weights for policy 1, policy_version 448713 (0.0008) [2023-12-27 22:27:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 229482496. Throughput: 0: 9793.7, 1: 9696.5. Samples: 229466136. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:16,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.980')] [2023-12-27 22:27:16,534][106226] Updated weights for policy 0, policy_version 447470 (0.0009) [2023-12-27 22:27:16,593][106226] Updated weights for policy 0, policy_version 447480 (0.0005) [2023-12-27 22:27:16,648][106226] Updated weights for policy 0, policy_version 447490 (0.0005) [2023-12-27 22:27:16,827][106225] Updated weights for policy 1, policy_version 448723 (0.0006) [2023-12-27 22:27:16,874][106225] Updated weights for policy 1, policy_version 448733 (0.0008) [2023-12-27 22:27:16,926][106225] Updated weights for policy 1, policy_version 448743 (0.0007) [2023-12-27 22:27:17,276][106226] Updated weights for policy 0, policy_version 447500 (0.0007) [2023-12-27 22:27:17,334][106226] Updated weights for policy 0, policy_version 447510 (0.0009) [2023-12-27 22:27:17,391][106226] Updated weights for policy 0, policy_version 447520 (0.0009) [2023-12-27 22:27:17,675][106225] Updated weights for policy 1, policy_version 448753 (0.0009) [2023-12-27 22:27:17,735][106225] Updated weights for policy 1, policy_version 448764 (0.0010) [2023-12-27 22:27:17,786][106225] Updated weights for policy 1, policy_version 448774 (0.0008) [2023-12-27 22:27:17,834][106225] Updated weights for policy 1, policy_version 448784 (0.0008) [2023-12-27 22:27:18,079][106226] Updated weights for policy 0, policy_version 447530 (0.0007) [2023-12-27 22:27:18,132][106226] Updated weights for policy 0, policy_version 447540 (0.0009) [2023-12-27 22:27:18,188][106226] Updated weights for policy 0, policy_version 447550 (0.0008) [2023-12-27 22:27:18,241][106226] Updated weights for policy 0, policy_version 447560 (0.0008) [2023-12-27 22:27:18,590][106225] Updated weights for policy 1, policy_version 448794 (0.0009) [2023-12-27 22:27:18,646][106225] Updated weights for policy 1, policy_version 448804 (0.0008) [2023-12-27 22:27:18,699][106225] Updated weights for policy 1, policy_version 448814 (0.0009) [2023-12-27 22:27:18,997][106226] Updated weights for policy 0, policy_version 447570 (0.0009) [2023-12-27 22:27:19,059][106226] Updated weights for policy 0, policy_version 447580 (0.0008) [2023-12-27 22:27:19,124][106226] Updated weights for policy 0, policy_version 447590 (0.0006) [2023-12-27 22:27:19,486][106225] Updated weights for policy 1, policy_version 448824 (0.0008) [2023-12-27 22:27:19,553][106225] Updated weights for policy 1, policy_version 448834 (0.0007) [2023-12-27 22:27:19,619][106225] Updated weights for policy 1, policy_version 448844 (0.0008) [2023-12-27 22:27:19,808][106226] Updated weights for policy 0, policy_version 447600 (0.0009) [2023-12-27 22:27:19,876][106226] Updated weights for policy 0, policy_version 447610 (0.0010) [2023-12-27 22:27:19,951][106226] Updated weights for policy 0, policy_version 447620 (0.0011) [2023-12-27 22:27:20,310][106225] Updated weights for policy 1, policy_version 448854 (0.0006) [2023-12-27 22:27:20,370][106225] Updated weights for policy 1, policy_version 448864 (0.0008) [2023-12-27 22:27:20,428][106225] Updated weights for policy 1, policy_version 448874 (0.0009) [2023-12-27 22:27:20,667][106226] Updated weights for policy 0, policy_version 447630 (0.0010) [2023-12-27 22:27:20,737][106226] Updated weights for policy 0, policy_version 447640 (0.0010) [2023-12-27 22:27:20,806][106226] Updated weights for policy 0, policy_version 447650 (0.0011) [2023-12-27 22:27:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19438.7). Total num frames: 229572608. Throughput: 0: 9803.9, 1: 9712.4. Samples: 229583832. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:21,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-5.537')] [2023-12-27 22:27:21,188][106225] Updated weights for policy 1, policy_version 448884 (0.0007) [2023-12-27 22:27:21,247][106225] Updated weights for policy 1, policy_version 448894 (0.0008) [2023-12-27 22:27:21,312][106225] Updated weights for policy 1, policy_version 448904 (0.0008) [2023-12-27 22:27:21,580][106226] Updated weights for policy 0, policy_version 447660 (0.0010) [2023-12-27 22:27:21,649][106226] Updated weights for policy 0, policy_version 447670 (0.0007) [2023-12-27 22:27:21,720][106226] Updated weights for policy 0, policy_version 447680 (0.0008) [2023-12-27 22:27:22,012][106225] Updated weights for policy 1, policy_version 448914 (0.0007) [2023-12-27 22:27:22,078][106225] Updated weights for policy 1, policy_version 448924 (0.0007) [2023-12-27 22:27:22,154][106225] Updated weights for policy 1, policy_version 448934 (0.0009) [2023-12-27 22:27:22,218][106225] Updated weights for policy 1, policy_version 448944 (0.0009) [2023-12-27 22:27:22,553][106226] Updated weights for policy 0, policy_version 447690 (0.0008) [2023-12-27 22:27:22,618][106226] Updated weights for policy 0, policy_version 447700 (0.0009) [2023-12-27 22:27:22,682][106226] Updated weights for policy 0, policy_version 447710 (0.0008) [2023-12-27 22:27:22,743][106226] Updated weights for policy 0, policy_version 447720 (0.0009) [2023-12-27 22:27:22,929][106225] Updated weights for policy 1, policy_version 448954 (0.0009) [2023-12-27 22:27:22,989][106225] Updated weights for policy 1, policy_version 448964 (0.0009) [2023-12-27 22:27:23,051][106225] Updated weights for policy 1, policy_version 448974 (0.0010) [2023-12-27 22:27:23,384][106226] Updated weights for policy 0, policy_version 447730 (0.0007) [2023-12-27 22:27:23,448][106226] Updated weights for policy 0, policy_version 447740 (0.0007) [2023-12-27 22:27:23,511][106226] Updated weights for policy 0, policy_version 447750 (0.0007) [2023-12-27 22:27:23,829][106225] Updated weights for policy 1, policy_version 448984 (0.0010) [2023-12-27 22:27:23,880][106225] Updated weights for policy 1, policy_version 448994 (0.0010) [2023-12-27 22:27:23,932][106225] Updated weights for policy 1, policy_version 449004 (0.0011) [2023-12-27 22:27:24,160][106226] Updated weights for policy 0, policy_version 447760 (0.0009) [2023-12-27 22:27:24,220][106226] Updated weights for policy 0, policy_version 447770 (0.0007) [2023-12-27 22:27:24,285][106226] Updated weights for policy 0, policy_version 447781 (0.0008) [2023-12-27 22:27:24,684][106225] Updated weights for policy 1, policy_version 449014 (0.0009) [2023-12-27 22:27:24,738][106225] Updated weights for policy 1, policy_version 449024 (0.0010) [2023-12-27 22:27:24,788][106225] Updated weights for policy 1, policy_version 449034 (0.0010) [2023-12-27 22:27:24,995][106226] Updated weights for policy 0, policy_version 447791 (0.0009) [2023-12-27 22:27:25,050][106226] Updated weights for policy 0, policy_version 447801 (0.0005) [2023-12-27 22:27:25,108][106226] Updated weights for policy 0, policy_version 447811 (0.0005) [2023-12-27 22:27:25,467][106225] Updated weights for policy 1, policy_version 449044 (0.0010) [2023-12-27 22:27:25,531][106225] Updated weights for policy 1, policy_version 449054 (0.0010) [2023-12-27 22:27:25,602][106225] Updated weights for policy 1, policy_version 449064 (0.0010) [2023-12-27 22:27:25,702][106226] Updated weights for policy 0, policy_version 447821 (0.0005) [2023-12-27 22:27:25,754][106226] Updated weights for policy 0, policy_version 447831 (0.0009) [2023-12-27 22:27:25,808][106226] Updated weights for policy 0, policy_version 447841 (0.0010) [2023-12-27 22:27:26,154][106225] Updated weights for policy 1, policy_version 449074 (0.0008) [2023-12-27 22:27:26,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19410.9). Total num frames: 229670912. Throughput: 0: 9823.4, 1: 9652.7. Samples: 229640276. Policy #0 lag: (min: 14.0, avg: 20.7, max: 46.0) [2023-12-27 22:27:26,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.464')] [2023-12-27 22:27:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000447848_114679808.pth... [2023-12-27 22:27:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000446696_114384896.pth [2023-12-27 22:27:26,208][106225] Updated weights for policy 1, policy_version 449084 (0.0009) [2023-12-27 22:27:26,267][106225] Updated weights for policy 1, policy_version 449094 (0.0010) [2023-12-27 22:27:26,323][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000449104_114999296.pth... [2023-12-27 22:27:26,324][106225] Updated weights for policy 1, policy_version 449104 (0.0010) [2023-12-27 22:27:26,327][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000447952_114704384.pth [2023-12-27 22:27:26,477][106226] Updated weights for policy 0, policy_version 447851 (0.0008) [2023-12-27 22:27:26,531][106226] Updated weights for policy 0, policy_version 447861 (0.0006) [2023-12-27 22:27:26,577][106226] Updated weights for policy 0, policy_version 447871 (0.0009) [2023-12-27 22:27:27,021][106225] Updated weights for policy 1, policy_version 449114 (0.0010) [2023-12-27 22:27:27,081][106225] Updated weights for policy 1, policy_version 449124 (0.0010) [2023-12-27 22:27:27,124][106226] Updated weights for policy 0, policy_version 447881 (0.0008) [2023-12-27 22:27:27,148][106225] Updated weights for policy 1, policy_version 449134 (0.0010) [2023-12-27 22:27:27,185][106226] Updated weights for policy 0, policy_version 447891 (0.0006) [2023-12-27 22:27:27,250][106226] Updated weights for policy 0, policy_version 447901 (0.0006) [2023-12-27 22:27:27,319][106226] Updated weights for policy 0, policy_version 447911 (0.0006) [2023-12-27 22:27:27,767][106225] Updated weights for policy 1, policy_version 449144 (0.0008) [2023-12-27 22:27:27,823][106225] Updated weights for policy 1, policy_version 449154 (0.0009) [2023-12-27 22:27:27,884][106225] Updated weights for policy 1, policy_version 449164 (0.0007) [2023-12-27 22:27:27,921][106226] Updated weights for policy 0, policy_version 447921 (0.0008) [2023-12-27 22:27:27,968][106226] Updated weights for policy 0, policy_version 447931 (0.0009) [2023-12-27 22:27:28,024][106226] Updated weights for policy 0, policy_version 447941 (0.0008) [2023-12-27 22:27:28,567][106225] Updated weights for policy 1, policy_version 449174 (0.0005) [2023-12-27 22:27:28,627][106225] Updated weights for policy 1, policy_version 449184 (0.0005) [2023-12-27 22:27:28,690][106225] Updated weights for policy 1, policy_version 449194 (0.0006) [2023-12-27 22:27:28,822][106226] Updated weights for policy 0, policy_version 447951 (0.0008) [2023-12-27 22:27:28,887][106226] Updated weights for policy 0, policy_version 447961 (0.0009) [2023-12-27 22:27:28,952][106226] Updated weights for policy 0, policy_version 447971 (0.0008) [2023-12-27 22:27:29,340][106225] Updated weights for policy 1, policy_version 449204 (0.0006) [2023-12-27 22:27:29,411][106225] Updated weights for policy 1, policy_version 449214 (0.0007) [2023-12-27 22:27:29,470][106225] Updated weights for policy 1, policy_version 449224 (0.0007) [2023-12-27 22:27:29,728][106226] Updated weights for policy 0, policy_version 447981 (0.0008) [2023-12-27 22:27:29,790][106226] Updated weights for policy 0, policy_version 447991 (0.0009) [2023-12-27 22:27:29,873][106226] Updated weights for policy 0, policy_version 448001 (0.0008) [2023-12-27 22:27:30,119][106225] Updated weights for policy 1, policy_version 449234 (0.0008) [2023-12-27 22:27:30,178][106225] Updated weights for policy 1, policy_version 449244 (0.0008) [2023-12-27 22:27:30,239][106225] Updated weights for policy 1, policy_version 449254 (0.0007) [2023-12-27 22:27:30,301][106225] Updated weights for policy 1, policy_version 449264 (0.0006) [2023-12-27 22:27:30,518][106226] Updated weights for policy 0, policy_version 448011 (0.0008) [2023-12-27 22:27:30,571][106226] Updated weights for policy 0, policy_version 448021 (0.0006) [2023-12-27 22:27:30,624][106226] Updated weights for policy 0, policy_version 448031 (0.0005) [2023-12-27 22:27:30,978][106225] Updated weights for policy 1, policy_version 449274 (0.0005) [2023-12-27 22:27:31,043][106225] Updated weights for policy 1, policy_version 449284 (0.0007) [2023-12-27 22:27:31,111][106225] Updated weights for policy 1, policy_version 449294 (0.0007) [2023-12-27 22:27:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 229777408. Throughput: 0: 9942.2, 1: 9776.4. Samples: 229763292. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:31,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.371')] [2023-12-27 22:27:31,314][106226] Updated weights for policy 0, policy_version 448041 (0.0006) [2023-12-27 22:27:31,376][106226] Updated weights for policy 0, policy_version 448051 (0.0009) [2023-12-27 22:27:31,431][106226] Updated weights for policy 0, policy_version 448061 (0.0008) [2023-12-27 22:27:31,488][106226] Updated weights for policy 0, policy_version 448071 (0.0008) [2023-12-27 22:27:31,816][106225] Updated weights for policy 1, policy_version 449304 (0.0008) [2023-12-27 22:27:31,889][106225] Updated weights for policy 1, policy_version 449314 (0.0008) [2023-12-27 22:27:31,958][106225] Updated weights for policy 1, policy_version 449324 (0.0008) [2023-12-27 22:27:32,155][106226] Updated weights for policy 0, policy_version 448081 (0.0007) [2023-12-27 22:27:32,208][106226] Updated weights for policy 0, policy_version 448091 (0.0005) [2023-12-27 22:27:32,282][106226] Updated weights for policy 0, policy_version 448101 (0.0007) [2023-12-27 22:27:32,757][106225] Updated weights for policy 1, policy_version 449334 (0.0008) [2023-12-27 22:27:32,818][106225] Updated weights for policy 1, policy_version 449344 (0.0008) [2023-12-27 22:27:32,873][106226] Updated weights for policy 0, policy_version 448111 (0.0009) [2023-12-27 22:27:32,877][106225] Updated weights for policy 1, policy_version 449354 (0.0006) [2023-12-27 22:27:32,927][106226] Updated weights for policy 0, policy_version 448121 (0.0007) [2023-12-27 22:27:32,984][106226] Updated weights for policy 0, policy_version 448131 (0.0008) [2023-12-27 22:27:33,499][106225] Updated weights for policy 1, policy_version 449364 (0.0008) [2023-12-27 22:27:33,558][106225] Updated weights for policy 1, policy_version 449374 (0.0005) [2023-12-27 22:27:33,627][106225] Updated weights for policy 1, policy_version 449384 (0.0007) [2023-12-27 22:27:33,772][106226] Updated weights for policy 0, policy_version 448141 (0.0008) [2023-12-27 22:27:33,826][106226] Updated weights for policy 0, policy_version 448151 (0.0009) [2023-12-27 22:27:33,879][106226] Updated weights for policy 0, policy_version 448161 (0.0009) [2023-12-27 22:27:34,201][106225] Updated weights for policy 1, policy_version 449394 (0.0009) [2023-12-27 22:27:34,259][106225] Updated weights for policy 1, policy_version 449404 (0.0009) [2023-12-27 22:27:34,334][106225] Updated weights for policy 1, policy_version 449414 (0.0011) [2023-12-27 22:27:34,399][106225] Updated weights for policy 1, policy_version 449424 (0.0009) [2023-12-27 22:27:34,728][106226] Updated weights for policy 0, policy_version 448171 (0.0007) [2023-12-27 22:27:34,784][106226] Updated weights for policy 0, policy_version 448181 (0.0007) [2023-12-27 22:27:34,848][106226] Updated weights for policy 0, policy_version 448191 (0.0008) [2023-12-27 22:27:35,092][106225] Updated weights for policy 1, policy_version 449434 (0.0007) [2023-12-27 22:27:35,154][106225] Updated weights for policy 1, policy_version 449444 (0.0010) [2023-12-27 22:27:35,218][106225] Updated weights for policy 1, policy_version 449454 (0.0010) [2023-12-27 22:27:35,608][106226] Updated weights for policy 0, policy_version 448201 (0.0008) [2023-12-27 22:27:35,670][106226] Updated weights for policy 0, policy_version 448211 (0.0009) [2023-12-27 22:27:35,733][106226] Updated weights for policy 0, policy_version 448221 (0.0008) [2023-12-27 22:27:35,782][106225] Updated weights for policy 1, policy_version 449464 (0.0006) [2023-12-27 22:27:35,793][106226] Updated weights for policy 0, policy_version 448231 (0.0009) [2023-12-27 22:27:35,832][106225] Updated weights for policy 1, policy_version 449474 (0.0006) [2023-12-27 22:27:35,882][106225] Updated weights for policy 1, policy_version 449484 (0.0010) [2023-12-27 22:27:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 229875712. Throughput: 0: 9886.0, 1: 9819.7. Samples: 229883260. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:36,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.484')] [2023-12-27 22:27:36,564][106226] Updated weights for policy 0, policy_version 448241 (0.0008) [2023-12-27 22:27:36,635][106226] Updated weights for policy 0, policy_version 448251 (0.0006) [2023-12-27 22:27:36,649][106225] Updated weights for policy 1, policy_version 449494 (0.0010) [2023-12-27 22:27:36,701][106226] Updated weights for policy 0, policy_version 448261 (0.0006) [2023-12-27 22:27:36,711][106225] Updated weights for policy 1, policy_version 449504 (0.0011) [2023-12-27 22:27:36,766][106225] Updated weights for policy 1, policy_version 449514 (0.0010) [2023-12-27 22:27:37,391][106225] Updated weights for policy 1, policy_version 449524 (0.0009) [2023-12-27 22:27:37,438][106225] Updated weights for policy 1, policy_version 449534 (0.0008) [2023-12-27 22:27:37,444][106226] Updated weights for policy 0, policy_version 448271 (0.0007) [2023-12-27 22:27:37,486][106225] Updated weights for policy 1, policy_version 449544 (0.0010) [2023-12-27 22:27:37,506][106226] Updated weights for policy 0, policy_version 448281 (0.0010) [2023-12-27 22:27:37,563][106226] Updated weights for policy 0, policy_version 448291 (0.0011) [2023-12-27 22:27:38,197][106225] Updated weights for policy 1, policy_version 449554 (0.0010) [2023-12-27 22:27:38,220][106226] Updated weights for policy 0, policy_version 448301 (0.0008) [2023-12-27 22:27:38,258][106225] Updated weights for policy 1, policy_version 449564 (0.0010) [2023-12-27 22:27:38,277][106226] Updated weights for policy 0, policy_version 448311 (0.0005) [2023-12-27 22:27:38,326][106225] Updated weights for policy 1, policy_version 449574 (0.0011) [2023-12-27 22:27:38,339][106226] Updated weights for policy 0, policy_version 448321 (0.0008) [2023-12-27 22:27:38,388][106225] Updated weights for policy 1, policy_version 449584 (0.0011) [2023-12-27 22:27:39,015][106226] Updated weights for policy 0, policy_version 448332 (0.0008) [2023-12-27 22:27:39,046][106225] Updated weights for policy 1, policy_version 449594 (0.0010) [2023-12-27 22:27:39,068][106226] Updated weights for policy 0, policy_version 448342 (0.0006) [2023-12-27 22:27:39,096][106225] Updated weights for policy 1, policy_version 449604 (0.0010) [2023-12-27 22:27:39,119][106226] Updated weights for policy 0, policy_version 448352 (0.0007) [2023-12-27 22:27:39,149][106225] Updated weights for policy 1, policy_version 449614 (0.0010) [2023-12-27 22:27:39,910][106225] Updated weights for policy 1, policy_version 449624 (0.0013) [2023-12-27 22:27:39,950][106226] Updated weights for policy 0, policy_version 448362 (0.0008) [2023-12-27 22:27:39,992][106225] Updated weights for policy 1, policy_version 449634 (0.0011) [2023-12-27 22:27:40,019][106226] Updated weights for policy 0, policy_version 448372 (0.0007) [2023-12-27 22:27:40,064][106225] Updated weights for policy 1, policy_version 449644 (0.0009) [2023-12-27 22:27:40,086][106226] Updated weights for policy 0, policy_version 448382 (0.0008) [2023-12-27 22:27:40,152][106226] Updated weights for policy 0, policy_version 448392 (0.0008) [2023-12-27 22:27:40,803][106225] Updated weights for policy 1, policy_version 449654 (0.0010) [2023-12-27 22:27:40,861][106225] Updated weights for policy 1, policy_version 449664 (0.0006) [2023-12-27 22:27:40,865][106226] Updated weights for policy 0, policy_version 448402 (0.0006) [2023-12-27 22:27:40,925][106225] Updated weights for policy 1, policy_version 449674 (0.0010) [2023-12-27 22:27:40,930][106226] Updated weights for policy 0, policy_version 448412 (0.0006) [2023-12-27 22:27:40,992][106226] Updated weights for policy 0, policy_version 448422 (0.0007) [2023-12-27 22:27:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19466.4). Total num frames: 229974016. Throughput: 0: 9858.6, 1: 9840.2. Samples: 229942636. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:41,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.502')] [2023-12-27 22:27:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000448424_114827264.pth... [2023-12-27 22:27:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000449680_115146752.pth... [2023-12-27 22:27:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000447272_114532352.pth [2023-12-27 22:27:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000448528_114851840.pth [2023-12-27 22:27:41,688][106225] Updated weights for policy 1, policy_version 449684 (0.0010) [2023-12-27 22:27:41,758][106225] Updated weights for policy 1, policy_version 449694 (0.0008) [2023-12-27 22:27:41,764][106226] Updated weights for policy 0, policy_version 448432 (0.0009) [2023-12-27 22:27:41,825][106225] Updated weights for policy 1, policy_version 449704 (0.0008) [2023-12-27 22:27:41,828][106226] Updated weights for policy 0, policy_version 448442 (0.0008) [2023-12-27 22:27:41,888][106226] Updated weights for policy 0, policy_version 448452 (0.0007) [2023-12-27 22:27:42,549][106225] Updated weights for policy 1, policy_version 449714 (0.0008) [2023-12-27 22:27:42,609][106225] Updated weights for policy 1, policy_version 449724 (0.0008) [2023-12-27 22:27:42,663][106226] Updated weights for policy 0, policy_version 448462 (0.0007) [2023-12-27 22:27:42,672][106225] Updated weights for policy 1, policy_version 449734 (0.0008) [2023-12-27 22:27:42,726][106226] Updated weights for policy 0, policy_version 448472 (0.0006) [2023-12-27 22:27:42,740][106225] Updated weights for policy 1, policy_version 449744 (0.0008) [2023-12-27 22:27:42,787][106226] Updated weights for policy 0, policy_version 448482 (0.0005) [2023-12-27 22:27:43,344][106225] Updated weights for policy 1, policy_version 449754 (0.0008) [2023-12-27 22:27:43,394][106225] Updated weights for policy 1, policy_version 449764 (0.0009) [2023-12-27 22:27:43,419][106226] Updated weights for policy 0, policy_version 448492 (0.0006) [2023-12-27 22:27:43,446][106225] Updated weights for policy 1, policy_version 449774 (0.0006) [2023-12-27 22:27:43,489][106226] Updated weights for policy 0, policy_version 448502 (0.0009) [2023-12-27 22:27:43,557][106226] Updated weights for policy 0, policy_version 448512 (0.0007) [2023-12-27 22:27:44,151][106226] Updated weights for policy 0, policy_version 448522 (0.0009) [2023-12-27 22:27:44,210][106226] Updated weights for policy 0, policy_version 448532 (0.0008) [2023-12-27 22:27:44,224][106225] Updated weights for policy 1, policy_version 449784 (0.0006) [2023-12-27 22:27:44,272][106226] Updated weights for policy 0, policy_version 448542 (0.0007) [2023-12-27 22:27:44,278][106225] Updated weights for policy 1, policy_version 449794 (0.0006) [2023-12-27 22:27:44,328][106225] Updated weights for policy 1, policy_version 449804 (0.0006) [2023-12-27 22:27:44,331][106226] Updated weights for policy 0, policy_version 448552 (0.0007) [2023-12-27 22:27:45,018][106225] Updated weights for policy 1, policy_version 449814 (0.0007) [2023-12-27 22:27:45,042][106226] Updated weights for policy 0, policy_version 448562 (0.0008) [2023-12-27 22:27:45,087][106225] Updated weights for policy 1, policy_version 449824 (0.0006) [2023-12-27 22:27:45,107][106226] Updated weights for policy 0, policy_version 448572 (0.0008) [2023-12-27 22:27:45,146][106225] Updated weights for policy 1, policy_version 449834 (0.0007) [2023-12-27 22:27:45,170][106226] Updated weights for policy 0, policy_version 448582 (0.0008) [2023-12-27 22:27:45,763][106225] Updated weights for policy 1, policy_version 449844 (0.0006) [2023-12-27 22:27:45,812][106225] Updated weights for policy 1, policy_version 449854 (0.0005) [2023-12-27 22:27:45,860][106225] Updated weights for policy 1, policy_version 449864 (0.0005) [2023-12-27 22:27:45,952][106226] Updated weights for policy 0, policy_version 448592 (0.0010) [2023-12-27 22:27:46,003][106226] Updated weights for policy 0, policy_version 448602 (0.0009) [2023-12-27 22:27:46,055][106226] Updated weights for policy 0, policy_version 448612 (0.0008) [2023-12-27 22:27:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19466.4). Total num frames: 230072320. Throughput: 0: 9789.7, 1: 9850.7. Samples: 230057432. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:46,176][105115] Avg episode reward: [(0, '-4.976'), (1, '-5.514')] [2023-12-27 22:27:46,414][106225] Updated weights for policy 1, policy_version 449874 (0.0005) [2023-12-27 22:27:46,484][106225] Updated weights for policy 1, policy_version 449884 (0.0005) [2023-12-27 22:27:46,537][106225] Updated weights for policy 1, policy_version 449894 (0.0007) [2023-12-27 22:27:46,584][106225] Updated weights for policy 1, policy_version 449904 (0.0008) [2023-12-27 22:27:46,813][106226] Updated weights for policy 0, policy_version 448622 (0.0009) [2023-12-27 22:27:46,880][106226] Updated weights for policy 0, policy_version 448632 (0.0008) [2023-12-27 22:27:46,944][106226] Updated weights for policy 0, policy_version 448642 (0.0010) [2023-12-27 22:27:47,205][106225] Updated weights for policy 1, policy_version 449914 (0.0010) [2023-12-27 22:27:47,257][106225] Updated weights for policy 1, policy_version 449924 (0.0010) [2023-12-27 22:27:47,310][106225] Updated weights for policy 1, policy_version 449934 (0.0010) [2023-12-27 22:27:47,604][106226] Updated weights for policy 0, policy_version 448652 (0.0009) [2023-12-27 22:27:47,667][106226] Updated weights for policy 0, policy_version 448662 (0.0008) [2023-12-27 22:27:47,731][106226] Updated weights for policy 0, policy_version 448672 (0.0007) [2023-12-27 22:27:47,999][106225] Updated weights for policy 1, policy_version 449944 (0.0006) [2023-12-27 22:27:48,053][106225] Updated weights for policy 1, policy_version 449954 (0.0006) [2023-12-27 22:27:48,119][106225] Updated weights for policy 1, policy_version 449964 (0.0006) [2023-12-27 22:27:48,473][106226] Updated weights for policy 0, policy_version 448682 (0.0008) [2023-12-27 22:27:48,538][106226] Updated weights for policy 0, policy_version 448692 (0.0011) [2023-12-27 22:27:48,599][106226] Updated weights for policy 0, policy_version 448702 (0.0011) [2023-12-27 22:27:48,660][106226] Updated weights for policy 0, policy_version 448712 (0.0011) [2023-12-27 22:27:48,772][106225] Updated weights for policy 1, policy_version 449974 (0.0010) [2023-12-27 22:27:48,820][106225] Updated weights for policy 1, policy_version 449984 (0.0010) [2023-12-27 22:27:48,870][106225] Updated weights for policy 1, policy_version 449994 (0.0010) [2023-12-27 22:27:49,365][106226] Updated weights for policy 0, policy_version 448722 (0.0008) [2023-12-27 22:27:49,427][106226] Updated weights for policy 0, policy_version 448732 (0.0008) [2023-12-27 22:27:49,478][106226] Updated weights for policy 0, policy_version 448742 (0.0008) [2023-12-27 22:27:49,714][106225] Updated weights for policy 1, policy_version 450004 (0.0009) [2023-12-27 22:27:49,763][106225] Updated weights for policy 1, policy_version 450014 (0.0008) [2023-12-27 22:27:49,820][106225] Updated weights for policy 1, policy_version 450024 (0.0008) [2023-12-27 22:27:50,231][106226] Updated weights for policy 0, policy_version 448752 (0.0010) [2023-12-27 22:27:50,292][106226] Updated weights for policy 0, policy_version 448762 (0.0009) [2023-12-27 22:27:50,349][106226] Updated weights for policy 0, policy_version 448772 (0.0006) [2023-12-27 22:27:50,566][106225] Updated weights for policy 1, policy_version 450034 (0.0008) [2023-12-27 22:27:50,632][106225] Updated weights for policy 1, policy_version 450044 (0.0010) [2023-12-27 22:27:50,722][106225] Updated weights for policy 1, policy_version 450054 (0.0007) [2023-12-27 22:27:50,792][106225] Updated weights for policy 1, policy_version 450064 (0.0006) [2023-12-27 22:27:51,033][106226] Updated weights for policy 0, policy_version 448782 (0.0008) [2023-12-27 22:27:51,099][106226] Updated weights for policy 0, policy_version 448792 (0.0008) [2023-12-27 22:27:51,165][106226] Updated weights for policy 0, policy_version 448802 (0.0007) [2023-12-27 22:27:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 230162432. Throughput: 0: 9682.4, 1: 9879.4. Samples: 230175480. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:51,178][105115] Avg episode reward: [(0, '-4.702'), (1, '-5.390')] [2023-12-27 22:27:51,475][106225] Updated weights for policy 1, policy_version 450074 (0.0007) [2023-12-27 22:27:51,522][106225] Updated weights for policy 1, policy_version 450084 (0.0010) [2023-12-27 22:27:51,574][106225] Updated weights for policy 1, policy_version 450094 (0.0009) [2023-12-27 22:27:51,908][106226] Updated weights for policy 0, policy_version 448812 (0.0008) [2023-12-27 22:27:51,976][106226] Updated weights for policy 0, policy_version 448822 (0.0011) [2023-12-27 22:27:52,041][106226] Updated weights for policy 0, policy_version 448832 (0.0011) [2023-12-27 22:27:52,331][106225] Updated weights for policy 1, policy_version 450104 (0.0007) [2023-12-27 22:27:52,404][106225] Updated weights for policy 1, policy_version 450114 (0.0009) [2023-12-27 22:27:52,469][106225] Updated weights for policy 1, policy_version 450124 (0.0007) [2023-12-27 22:27:52,757][106226] Updated weights for policy 0, policy_version 448842 (0.0010) [2023-12-27 22:27:52,821][106226] Updated weights for policy 0, policy_version 448852 (0.0006) [2023-12-27 22:27:52,888][106226] Updated weights for policy 0, policy_version 448862 (0.0011) [2023-12-27 22:27:52,934][106226] Updated weights for policy 0, policy_version 448872 (0.0010) [2023-12-27 22:27:53,148][106225] Updated weights for policy 1, policy_version 450134 (0.0006) [2023-12-27 22:27:53,205][106225] Updated weights for policy 1, policy_version 450144 (0.0006) [2023-12-27 22:27:53,254][106225] Updated weights for policy 1, policy_version 450154 (0.0005) [2023-12-27 22:27:53,644][106226] Updated weights for policy 0, policy_version 448882 (0.0008) [2023-12-27 22:27:53,704][106226] Updated weights for policy 0, policy_version 448892 (0.0009) [2023-12-27 22:27:53,759][106226] Updated weights for policy 0, policy_version 448902 (0.0008) [2023-12-27 22:27:53,857][106225] Updated weights for policy 1, policy_version 450164 (0.0007) [2023-12-27 22:27:53,909][106225] Updated weights for policy 1, policy_version 450174 (0.0008) [2023-12-27 22:27:53,965][106225] Updated weights for policy 1, policy_version 450184 (0.0008) [2023-12-27 22:27:54,464][106226] Updated weights for policy 0, policy_version 448912 (0.0009) [2023-12-27 22:27:54,530][106226] Updated weights for policy 0, policy_version 448922 (0.0008) [2023-12-27 22:27:54,592][106226] Updated weights for policy 0, policy_version 448932 (0.0009) [2023-12-27 22:27:54,701][106225] Updated weights for policy 1, policy_version 450194 (0.0008) [2023-12-27 22:27:54,773][106225] Updated weights for policy 1, policy_version 450204 (0.0009) [2023-12-27 22:27:54,840][106225] Updated weights for policy 1, policy_version 450214 (0.0007) [2023-12-27 22:27:54,900][106225] Updated weights for policy 1, policy_version 450224 (0.0009) [2023-12-27 22:27:55,333][106226] Updated weights for policy 0, policy_version 448942 (0.0008) [2023-12-27 22:27:55,397][106226] Updated weights for policy 0, policy_version 448952 (0.0008) [2023-12-27 22:27:55,457][106226] Updated weights for policy 0, policy_version 448962 (0.0008) [2023-12-27 22:27:55,548][106225] Updated weights for policy 1, policy_version 450234 (0.0009) [2023-12-27 22:27:55,607][106225] Updated weights for policy 1, policy_version 450244 (0.0005) [2023-12-27 22:27:55,661][106225] Updated weights for policy 1, policy_version 450254 (0.0009) [2023-12-27 22:27:56,114][106226] Updated weights for policy 0, policy_version 448972 (0.0007) [2023-12-27 22:27:56,170][106226] Updated weights for policy 0, policy_version 448982 (0.0005) [2023-12-27 22:27:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 230260736. Throughput: 0: 9695.0, 1: 9905.0. Samples: 230234416. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:27:56,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-5.576')] [2023-12-27 22:27:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000450256_115294208.pth... [2023-12-27 22:27:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000449104_114999296.pth [2023-12-27 22:27:56,224][106226] Updated weights for policy 0, policy_version 448992 (0.0006) [2023-12-27 22:27:56,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000449000_114974720.pth... [2023-12-27 22:27:56,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000447848_114679808.pth [2023-12-27 22:27:56,371][106225] Updated weights for policy 1, policy_version 450264 (0.0010) [2023-12-27 22:27:56,429][106225] Updated weights for policy 1, policy_version 450274 (0.0010) [2023-12-27 22:27:56,492][106225] Updated weights for policy 1, policy_version 450284 (0.0010) [2023-12-27 22:27:56,842][106226] Updated weights for policy 0, policy_version 449002 (0.0007) [2023-12-27 22:27:56,894][106226] Updated weights for policy 0, policy_version 449012 (0.0006) [2023-12-27 22:27:56,945][106226] Updated weights for policy 0, policy_version 449022 (0.0005) [2023-12-27 22:27:56,996][106226] Updated weights for policy 0, policy_version 449032 (0.0005) [2023-12-27 22:27:57,202][106225] Updated weights for policy 1, policy_version 450294 (0.0010) [2023-12-27 22:27:57,251][106225] Updated weights for policy 1, policy_version 450304 (0.0010) [2023-12-27 22:27:57,299][106225] Updated weights for policy 1, policy_version 450314 (0.0010) [2023-12-27 22:27:57,623][106226] Updated weights for policy 0, policy_version 449042 (0.0010) [2023-12-27 22:27:57,676][106226] Updated weights for policy 0, policy_version 449052 (0.0011) [2023-12-27 22:27:57,735][106226] Updated weights for policy 0, policy_version 449062 (0.0010) [2023-12-27 22:27:57,945][106225] Updated weights for policy 1, policy_version 450324 (0.0011) [2023-12-27 22:27:57,995][106225] Updated weights for policy 1, policy_version 450334 (0.0010) [2023-12-27 22:27:58,048][106225] Updated weights for policy 1, policy_version 450344 (0.0010) [2023-12-27 22:27:58,366][106226] Updated weights for policy 0, policy_version 449072 (0.0009) [2023-12-27 22:27:58,434][106226] Updated weights for policy 0, policy_version 449082 (0.0010) [2023-12-27 22:27:58,504][106226] Updated weights for policy 0, policy_version 449092 (0.0011) [2023-12-27 22:27:58,927][106225] Updated weights for policy 1, policy_version 450354 (0.0009) [2023-12-27 22:27:58,991][106225] Updated weights for policy 1, policy_version 450364 (0.0006) [2023-12-27 22:27:59,059][106225] Updated weights for policy 1, policy_version 450374 (0.0009) [2023-12-27 22:27:59,119][106225] Updated weights for policy 1, policy_version 450384 (0.0007) [2023-12-27 22:27:59,302][106226] Updated weights for policy 0, policy_version 449102 (0.0010) [2023-12-27 22:27:59,370][106226] Updated weights for policy 0, policy_version 449112 (0.0008) [2023-12-27 22:27:59,444][106226] Updated weights for policy 0, policy_version 449122 (0.0007) [2023-12-27 22:27:59,869][106225] Updated weights for policy 1, policy_version 450394 (0.0008) [2023-12-27 22:27:59,943][106225] Updated weights for policy 1, policy_version 450404 (0.0009) [2023-12-27 22:28:00,018][106225] Updated weights for policy 1, policy_version 450414 (0.0006) [2023-12-27 22:28:00,060][106226] Updated weights for policy 0, policy_version 449132 (0.0007) [2023-12-27 22:28:00,120][106226] Updated weights for policy 0, policy_version 449142 (0.0008) [2023-12-27 22:28:00,180][106226] Updated weights for policy 0, policy_version 449152 (0.0008) [2023-12-27 22:28:00,667][106225] Updated weights for policy 1, policy_version 450424 (0.0006) [2023-12-27 22:28:00,731][106225] Updated weights for policy 1, policy_version 450434 (0.0007) [2023-12-27 22:28:00,800][106225] Updated weights for policy 1, policy_version 450444 (0.0005) [2023-12-27 22:28:00,823][106226] Updated weights for policy 0, policy_version 449162 (0.0008) [2023-12-27 22:28:00,874][106226] Updated weights for policy 0, policy_version 449172 (0.0006) [2023-12-27 22:28:00,927][106226] Updated weights for policy 0, policy_version 449182 (0.0006) [2023-12-27 22:28:00,980][106226] Updated weights for policy 0, policy_version 449192 (0.0007) [2023-12-27 22:28:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 230367232. Throughput: 0: 9809.5, 1: 9896.1. Samples: 230352888. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:01,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.508')] [2023-12-27 22:28:01,472][106225] Updated weights for policy 1, policy_version 450454 (0.0006) [2023-12-27 22:28:01,536][106225] Updated weights for policy 1, policy_version 450464 (0.0005) [2023-12-27 22:28:01,599][106225] Updated weights for policy 1, policy_version 450474 (0.0007) [2023-12-27 22:28:01,778][106226] Updated weights for policy 0, policy_version 449202 (0.0008) [2023-12-27 22:28:01,829][106226] Updated weights for policy 0, policy_version 449212 (0.0006) [2023-12-27 22:28:01,888][106226] Updated weights for policy 0, policy_version 449222 (0.0006) [2023-12-27 22:28:02,303][106225] Updated weights for policy 1, policy_version 450484 (0.0008) [2023-12-27 22:28:02,362][106225] Updated weights for policy 1, policy_version 450494 (0.0007) [2023-12-27 22:28:02,428][106225] Updated weights for policy 1, policy_version 450504 (0.0006) [2023-12-27 22:28:02,510][106226] Updated weights for policy 0, policy_version 449232 (0.0006) [2023-12-27 22:28:02,568][106226] Updated weights for policy 0, policy_version 449242 (0.0005) [2023-12-27 22:28:02,628][106226] Updated weights for policy 0, policy_version 449252 (0.0005) [2023-12-27 22:28:03,114][106225] Updated weights for policy 1, policy_version 450514 (0.0007) [2023-12-27 22:28:03,173][106225] Updated weights for policy 1, policy_version 450524 (0.0010) [2023-12-27 22:28:03,232][106225] Updated weights for policy 1, policy_version 450534 (0.0010) [2023-12-27 22:28:03,254][106226] Updated weights for policy 0, policy_version 449262 (0.0006) [2023-12-27 22:28:03,292][106225] Updated weights for policy 1, policy_version 450544 (0.0010) [2023-12-27 22:28:03,308][106226] Updated weights for policy 0, policy_version 449272 (0.0008) [2023-12-27 22:28:03,361][106226] Updated weights for policy 0, policy_version 449282 (0.0008) [2023-12-27 22:28:04,025][106225] Updated weights for policy 1, policy_version 450554 (0.0005) [2023-12-27 22:28:04,072][106226] Updated weights for policy 0, policy_version 449292 (0.0008) [2023-12-27 22:28:04,093][106225] Updated weights for policy 1, policy_version 450564 (0.0007) [2023-12-27 22:28:04,140][106226] Updated weights for policy 0, policy_version 449302 (0.0006) [2023-12-27 22:28:04,162][106225] Updated weights for policy 1, policy_version 450574 (0.0006) [2023-12-27 22:28:04,213][106226] Updated weights for policy 0, policy_version 449312 (0.0008) [2023-12-27 22:28:04,871][106225] Updated weights for policy 1, policy_version 450584 (0.0006) [2023-12-27 22:28:04,876][106226] Updated weights for policy 0, policy_version 449322 (0.0008) [2023-12-27 22:28:04,934][106226] Updated weights for policy 0, policy_version 449332 (0.0007) [2023-12-27 22:28:04,935][106225] Updated weights for policy 1, policy_version 450594 (0.0006) [2023-12-27 22:28:05,002][106225] Updated weights for policy 1, policy_version 450604 (0.0006) [2023-12-27 22:28:05,002][106226] Updated weights for policy 0, policy_version 449342 (0.0005) [2023-12-27 22:28:05,075][106226] Updated weights for policy 0, policy_version 449352 (0.0009) [2023-12-27 22:28:05,529][106225] Updated weights for policy 1, policy_version 450614 (0.0006) [2023-12-27 22:28:05,573][106225] Updated weights for policy 1, policy_version 450624 (0.0005) [2023-12-27 22:28:05,623][106225] Updated weights for policy 1, policy_version 450634 (0.0005) [2023-12-27 22:28:05,873][106226] Updated weights for policy 0, policy_version 449362 (0.0009) [2023-12-27 22:28:05,946][106226] Updated weights for policy 0, policy_version 449372 (0.0010) [2023-12-27 22:28:06,013][106226] Updated weights for policy 0, policy_version 449382 (0.0010) [2023-12-27 22:28:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 230465536. Throughput: 0: 9792.7, 1: 9975.7. Samples: 230473412. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:06,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.554')] [2023-12-27 22:28:06,192][106225] Updated weights for policy 1, policy_version 450644 (0.0005) [2023-12-27 22:28:06,245][106225] Updated weights for policy 1, policy_version 450654 (0.0007) [2023-12-27 22:28:06,305][106225] Updated weights for policy 1, policy_version 450664 (0.0007) [2023-12-27 22:28:06,782][106226] Updated weights for policy 0, policy_version 449392 (0.0009) [2023-12-27 22:28:06,844][106226] Updated weights for policy 0, policy_version 449402 (0.0009) [2023-12-27 22:28:06,904][106226] Updated weights for policy 0, policy_version 449412 (0.0009) [2023-12-27 22:28:07,002][106225] Updated weights for policy 1, policy_version 450674 (0.0007) [2023-12-27 22:28:07,060][106225] Updated weights for policy 1, policy_version 450684 (0.0008) [2023-12-27 22:28:07,118][106225] Updated weights for policy 1, policy_version 450694 (0.0008) [2023-12-27 22:28:07,183][106225] Updated weights for policy 1, policy_version 450704 (0.0008) [2023-12-27 22:28:07,659][106226] Updated weights for policy 0, policy_version 449422 (0.0007) [2023-12-27 22:28:07,714][106226] Updated weights for policy 0, policy_version 449432 (0.0005) [2023-12-27 22:28:07,779][106226] Updated weights for policy 0, policy_version 449442 (0.0006) [2023-12-27 22:28:07,834][106225] Updated weights for policy 1, policy_version 450714 (0.0010) [2023-12-27 22:28:07,895][106225] Updated weights for policy 1, policy_version 450724 (0.0010) [2023-12-27 22:28:07,949][106225] Updated weights for policy 1, policy_version 450734 (0.0010) [2023-12-27 22:28:08,458][106226] Updated weights for policy 0, policy_version 449452 (0.0006) [2023-12-27 22:28:08,525][106226] Updated weights for policy 0, policy_version 449462 (0.0008) [2023-12-27 22:28:08,587][106226] Updated weights for policy 0, policy_version 449472 (0.0008) [2023-12-27 22:28:08,672][106225] Updated weights for policy 1, policy_version 450744 (0.0010) [2023-12-27 22:28:08,738][106225] Updated weights for policy 1, policy_version 450754 (0.0009) [2023-12-27 22:28:08,804][106225] Updated weights for policy 1, policy_version 450764 (0.0008) [2023-12-27 22:28:09,284][106226] Updated weights for policy 0, policy_version 449482 (0.0007) [2023-12-27 22:28:09,343][106226] Updated weights for policy 0, policy_version 449492 (0.0007) [2023-12-27 22:28:09,417][106226] Updated weights for policy 0, policy_version 449502 (0.0007) [2023-12-27 22:28:09,485][106226] Updated weights for policy 0, policy_version 449512 (0.0006) [2023-12-27 22:28:09,542][106225] Updated weights for policy 1, policy_version 450774 (0.0009) [2023-12-27 22:28:09,608][106225] Updated weights for policy 1, policy_version 450784 (0.0008) [2023-12-27 22:28:09,674][106225] Updated weights for policy 1, policy_version 450794 (0.0006) [2023-12-27 22:28:10,287][106226] Updated weights for policy 0, policy_version 449522 (0.0009) [2023-12-27 22:28:10,351][106226] Updated weights for policy 0, policy_version 449532 (0.0009) [2023-12-27 22:28:10,367][106225] Updated weights for policy 1, policy_version 450804 (0.0007) [2023-12-27 22:28:10,414][106226] Updated weights for policy 0, policy_version 449542 (0.0006) [2023-12-27 22:28:10,429][106225] Updated weights for policy 1, policy_version 450814 (0.0008) [2023-12-27 22:28:10,496][106225] Updated weights for policy 1, policy_version 450824 (0.0008) [2023-12-27 22:28:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 230555648. Throughput: 0: 9787.4, 1: 10042.3. Samples: 230532612. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:11,175][105115] Avg episode reward: [(0, '-5.093'), (1, '-5.639')] [2023-12-27 22:28:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000449544_115113984.pth... [2023-12-27 22:28:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000450832_115441664.pth... [2023-12-27 22:28:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000448424_114827264.pth [2023-12-27 22:28:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000449680_115146752.pth [2023-12-27 22:28:11,261][106226] Updated weights for policy 0, policy_version 449552 (0.0009) [2023-12-27 22:28:11,266][106225] Updated weights for policy 1, policy_version 450834 (0.0008) [2023-12-27 22:28:11,331][106225] Updated weights for policy 1, policy_version 450844 (0.0007) [2023-12-27 22:28:11,333][106226] Updated weights for policy 0, policy_version 449562 (0.0009) [2023-12-27 22:28:11,414][106226] Updated weights for policy 0, policy_version 449572 (0.0009) [2023-12-27 22:28:11,423][106225] Updated weights for policy 1, policy_version 450854 (0.0007) [2023-12-27 22:28:11,495][106225] Updated weights for policy 1, policy_version 450864 (0.0008) [2023-12-27 22:28:12,194][106226] Updated weights for policy 0, policy_version 449582 (0.0010) [2023-12-27 22:28:12,256][106226] Updated weights for policy 0, policy_version 449592 (0.0008) [2023-12-27 22:28:12,315][106225] Updated weights for policy 1, policy_version 450874 (0.0009) [2023-12-27 22:28:12,323][106226] Updated weights for policy 0, policy_version 449602 (0.0008) [2023-12-27 22:28:12,382][106225] Updated weights for policy 1, policy_version 450884 (0.0008) [2023-12-27 22:28:12,446][106225] Updated weights for policy 1, policy_version 450894 (0.0009) [2023-12-27 22:28:13,079][106226] Updated weights for policy 0, policy_version 449612 (0.0008) [2023-12-27 22:28:13,130][106226] Updated weights for policy 0, policy_version 449622 (0.0007) [2023-12-27 22:28:13,152][106225] Updated weights for policy 1, policy_version 450904 (0.0007) [2023-12-27 22:28:13,190][106226] Updated weights for policy 0, policy_version 449632 (0.0006) [2023-12-27 22:28:13,215][106225] Updated weights for policy 1, policy_version 450914 (0.0007) [2023-12-27 22:28:13,273][106225] Updated weights for policy 1, policy_version 450924 (0.0008) [2023-12-27 22:28:13,898][106226] Updated weights for policy 0, policy_version 449642 (0.0007) [2023-12-27 22:28:13,935][106225] Updated weights for policy 1, policy_version 450934 (0.0008) [2023-12-27 22:28:13,955][106226] Updated weights for policy 0, policy_version 449652 (0.0010) [2023-12-27 22:28:13,989][106225] Updated weights for policy 1, policy_version 450944 (0.0008) [2023-12-27 22:28:14,008][106226] Updated weights for policy 0, policy_version 449662 (0.0010) [2023-12-27 22:28:14,042][106225] Updated weights for policy 1, policy_version 450954 (0.0009) [2023-12-27 22:28:14,058][106226] Updated weights for policy 0, policy_version 449672 (0.0010) [2023-12-27 22:28:14,724][106226] Updated weights for policy 0, policy_version 449682 (0.0006) [2023-12-27 22:28:14,797][106226] Updated weights for policy 0, policy_version 449692 (0.0008) [2023-12-27 22:28:14,797][106225] Updated weights for policy 1, policy_version 450964 (0.0007) [2023-12-27 22:28:14,860][106226] Updated weights for policy 0, policy_version 449702 (0.0006) [2023-12-27 22:28:14,869][106225] Updated weights for policy 1, policy_version 450974 (0.0007) [2023-12-27 22:28:14,932][106225] Updated weights for policy 1, policy_version 450984 (0.0008) [2023-12-27 22:28:15,502][106226] Updated weights for policy 0, policy_version 449712 (0.0010) [2023-12-27 22:28:15,561][106226] Updated weights for policy 0, policy_version 449722 (0.0011) [2023-12-27 22:28:15,628][106226] Updated weights for policy 0, policy_version 449732 (0.0010) [2023-12-27 22:28:15,639][106225] Updated weights for policy 1, policy_version 450994 (0.0007) [2023-12-27 22:28:15,688][106225] Updated weights for policy 1, policy_version 451004 (0.0008) [2023-12-27 22:28:15,749][106225] Updated weights for policy 1, policy_version 451014 (0.0008) [2023-12-27 22:28:15,813][106225] Updated weights for policy 1, policy_version 451024 (0.0007) [2023-12-27 22:28:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19466.4). Total num frames: 230653952. Throughput: 0: 9662.9, 1: 9917.1. Samples: 230644388. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:16,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-5.484')] [2023-12-27 22:28:16,330][106226] Updated weights for policy 0, policy_version 449742 (0.0010) [2023-12-27 22:28:16,380][106226] Updated weights for policy 0, policy_version 449752 (0.0010) [2023-12-27 22:28:16,450][106226] Updated weights for policy 0, policy_version 449762 (0.0011) [2023-12-27 22:28:16,516][106225] Updated weights for policy 1, policy_version 451034 (0.0007) [2023-12-27 22:28:16,566][106225] Updated weights for policy 1, policy_version 451044 (0.0008) [2023-12-27 22:28:16,620][106225] Updated weights for policy 1, policy_version 451054 (0.0007) [2023-12-27 22:28:17,073][106226] Updated weights for policy 0, policy_version 449772 (0.0008) [2023-12-27 22:28:17,133][106226] Updated weights for policy 0, policy_version 449782 (0.0008) [2023-12-27 22:28:17,192][106226] Updated weights for policy 0, policy_version 449792 (0.0008) [2023-12-27 22:28:17,357][106225] Updated weights for policy 1, policy_version 451064 (0.0006) [2023-12-27 22:28:17,407][106225] Updated weights for policy 1, policy_version 451074 (0.0007) [2023-12-27 22:28:17,456][106225] Updated weights for policy 1, policy_version 451084 (0.0008) [2023-12-27 22:28:17,960][106226] Updated weights for policy 0, policy_version 449802 (0.0008) [2023-12-27 22:28:18,018][106226] Updated weights for policy 0, policy_version 449812 (0.0008) [2023-12-27 22:28:18,074][106226] Updated weights for policy 0, policy_version 449822 (0.0009) [2023-12-27 22:28:18,103][106225] Updated weights for policy 1, policy_version 451094 (0.0005) [2023-12-27 22:28:18,127][106226] Updated weights for policy 0, policy_version 449832 (0.0008) [2023-12-27 22:28:18,164][106225] Updated weights for policy 1, policy_version 451104 (0.0008) [2023-12-27 22:28:18,222][106225] Updated weights for policy 1, policy_version 451114 (0.0008) [2023-12-27 22:28:18,823][106225] Updated weights for policy 1, policy_version 451124 (0.0005) [2023-12-27 22:28:18,895][106225] Updated weights for policy 1, policy_version 451134 (0.0008) [2023-12-27 22:28:18,948][106226] Updated weights for policy 0, policy_version 449842 (0.0006) [2023-12-27 22:28:18,965][106225] Updated weights for policy 1, policy_version 451144 (0.0009) [2023-12-27 22:28:18,996][106226] Updated weights for policy 0, policy_version 449852 (0.0006) [2023-12-27 22:28:19,042][106226] Updated weights for policy 0, policy_version 449862 (0.0008) [2023-12-27 22:28:19,654][106225] Updated weights for policy 1, policy_version 451154 (0.0007) [2023-12-27 22:28:19,724][106225] Updated weights for policy 1, policy_version 451164 (0.0008) [2023-12-27 22:28:19,782][106225] Updated weights for policy 1, policy_version 451174 (0.0011) [2023-12-27 22:28:19,852][106225] Updated weights for policy 1, policy_version 451184 (0.0010) [2023-12-27 22:28:19,905][106226] Updated weights for policy 0, policy_version 449872 (0.0008) [2023-12-27 22:28:19,976][106226] Updated weights for policy 0, policy_version 449882 (0.0008) [2023-12-27 22:28:20,043][106226] Updated weights for policy 0, policy_version 449892 (0.0008) [2023-12-27 22:28:20,547][106225] Updated weights for policy 1, policy_version 451194 (0.0008) [2023-12-27 22:28:20,617][106225] Updated weights for policy 1, policy_version 451204 (0.0007) [2023-12-27 22:28:20,675][106225] Updated weights for policy 1, policy_version 451214 (0.0007) [2023-12-27 22:28:20,725][106226] Updated weights for policy 0, policy_version 449902 (0.0009) [2023-12-27 22:28:20,790][106226] Updated weights for policy 0, policy_version 449912 (0.0007) [2023-12-27 22:28:20,857][106226] Updated weights for policy 0, policy_version 449922 (0.0006) [2023-12-27 22:28:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 230752256. Throughput: 0: 9633.0, 1: 9880.2. Samples: 230761352. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:21,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-5.515')] [2023-12-27 22:28:21,452][106225] Updated weights for policy 1, policy_version 451224 (0.0008) [2023-12-27 22:28:21,509][106225] Updated weights for policy 1, policy_version 451234 (0.0008) [2023-12-27 22:28:21,568][106225] Updated weights for policy 1, policy_version 451244 (0.0007) [2023-12-27 22:28:21,608][106226] Updated weights for policy 0, policy_version 449932 (0.0008) [2023-12-27 22:28:21,679][106226] Updated weights for policy 0, policy_version 449942 (0.0008) [2023-12-27 22:28:21,748][106226] Updated weights for policy 0, policy_version 449952 (0.0008) [2023-12-27 22:28:22,365][106225] Updated weights for policy 1, policy_version 451254 (0.0007) [2023-12-27 22:28:22,438][106225] Updated weights for policy 1, policy_version 451264 (0.0007) [2023-12-27 22:28:22,473][106226] Updated weights for policy 0, policy_version 449962 (0.0008) [2023-12-27 22:28:22,502][106225] Updated weights for policy 1, policy_version 451274 (0.0007) [2023-12-27 22:28:22,538][106226] Updated weights for policy 0, policy_version 449972 (0.0009) [2023-12-27 22:28:22,603][106226] Updated weights for policy 0, policy_version 449982 (0.0009) [2023-12-27 22:28:22,679][106226] Updated weights for policy 0, policy_version 449992 (0.0009) [2023-12-27 22:28:23,159][106225] Updated weights for policy 1, policy_version 451284 (0.0007) [2023-12-27 22:28:23,218][106225] Updated weights for policy 1, policy_version 451294 (0.0008) [2023-12-27 22:28:23,280][106225] Updated weights for policy 1, policy_version 451304 (0.0007) [2023-12-27 22:28:23,413][106226] Updated weights for policy 0, policy_version 450002 (0.0009) [2023-12-27 22:28:23,462][106226] Updated weights for policy 0, policy_version 450012 (0.0009) [2023-12-27 22:28:23,517][106226] Updated weights for policy 0, policy_version 450022 (0.0009) [2023-12-27 22:28:23,894][106225] Updated weights for policy 1, policy_version 451314 (0.0006) [2023-12-27 22:28:23,946][106225] Updated weights for policy 1, policy_version 451324 (0.0008) [2023-12-27 22:28:24,002][106225] Updated weights for policy 1, policy_version 451334 (0.0008) [2023-12-27 22:28:24,067][106225] Updated weights for policy 1, policy_version 451344 (0.0008) [2023-12-27 22:28:24,243][106226] Updated weights for policy 0, policy_version 450032 (0.0006) [2023-12-27 22:28:24,297][106226] Updated weights for policy 0, policy_version 450042 (0.0007) [2023-12-27 22:28:24,348][106226] Updated weights for policy 0, policy_version 450052 (0.0008) [2023-12-27 22:28:24,810][106225] Updated weights for policy 1, policy_version 451354 (0.0008) [2023-12-27 22:28:24,869][106225] Updated weights for policy 1, policy_version 451364 (0.0009) [2023-12-27 22:28:24,928][106225] Updated weights for policy 1, policy_version 451374 (0.0009) [2023-12-27 22:28:25,034][106226] Updated weights for policy 0, policy_version 450062 (0.0009) [2023-12-27 22:28:25,093][106226] Updated weights for policy 0, policy_version 450072 (0.0007) [2023-12-27 22:28:25,149][106226] Updated weights for policy 0, policy_version 450082 (0.0008) [2023-12-27 22:28:25,655][106225] Updated weights for policy 1, policy_version 451384 (0.0009) [2023-12-27 22:28:25,721][106225] Updated weights for policy 1, policy_version 451394 (0.0006) [2023-12-27 22:28:25,785][106225] Updated weights for policy 1, policy_version 451404 (0.0006) [2023-12-27 22:28:25,832][106226] Updated weights for policy 0, policy_version 450092 (0.0007) [2023-12-27 22:28:25,881][106226] Updated weights for policy 0, policy_version 450102 (0.0008) [2023-12-27 22:28:25,934][106226] Updated weights for policy 0, policy_version 450112 (0.0009) [2023-12-27 22:28:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 230850560. Throughput: 0: 9600.2, 1: 9864.8. Samples: 230818560. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:26,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-5.642')] [2023-12-27 22:28:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000451408_115589120.pth... [2023-12-27 22:28:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000450120_115261440.pth... [2023-12-27 22:28:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000450256_115294208.pth [2023-12-27 22:28:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000449000_114974720.pth [2023-12-27 22:28:26,402][106225] Updated weights for policy 1, policy_version 451414 (0.0007) [2023-12-27 22:28:26,465][106225] Updated weights for policy 1, policy_version 451424 (0.0010) [2023-12-27 22:28:26,523][106225] Updated weights for policy 1, policy_version 451434 (0.0008) [2023-12-27 22:28:26,651][106226] Updated weights for policy 0, policy_version 450122 (0.0009) [2023-12-27 22:28:26,714][106226] Updated weights for policy 0, policy_version 450132 (0.0009) [2023-12-27 22:28:26,777][106226] Updated weights for policy 0, policy_version 450142 (0.0008) [2023-12-27 22:28:26,844][106226] Updated weights for policy 0, policy_version 450152 (0.0009) [2023-12-27 22:28:27,160][106225] Updated weights for policy 1, policy_version 451444 (0.0009) [2023-12-27 22:28:27,216][106225] Updated weights for policy 1, policy_version 451454 (0.0008) [2023-12-27 22:28:27,272][106225] Updated weights for policy 1, policy_version 451464 (0.0006) [2023-12-27 22:28:27,639][106226] Updated weights for policy 0, policy_version 450162 (0.0008) [2023-12-27 22:28:27,693][106226] Updated weights for policy 0, policy_version 450172 (0.0009) [2023-12-27 22:28:27,755][106226] Updated weights for policy 0, policy_version 450182 (0.0008) [2023-12-27 22:28:27,867][106225] Updated weights for policy 1, policy_version 451474 (0.0007) [2023-12-27 22:28:27,918][106225] Updated weights for policy 1, policy_version 451484 (0.0008) [2023-12-27 22:28:27,964][106225] Updated weights for policy 1, policy_version 451494 (0.0008) [2023-12-27 22:28:28,015][106225] Updated weights for policy 1, policy_version 451504 (0.0008) [2023-12-27 22:28:28,496][106226] Updated weights for policy 0, policy_version 450192 (0.0009) [2023-12-27 22:28:28,545][106226] Updated weights for policy 0, policy_version 450202 (0.0008) [2023-12-27 22:28:28,596][106226] Updated weights for policy 0, policy_version 450212 (0.0007) [2023-12-27 22:28:28,646][106225] Updated weights for policy 1, policy_version 451514 (0.0007) [2023-12-27 22:28:28,703][106225] Updated weights for policy 1, policy_version 451524 (0.0006) [2023-12-27 22:28:28,756][106225] Updated weights for policy 1, policy_version 451534 (0.0008) [2023-12-27 22:28:29,394][106225] Updated weights for policy 1, policy_version 451544 (0.0007) [2023-12-27 22:28:29,440][106226] Updated weights for policy 0, policy_version 450222 (0.0007) [2023-12-27 22:28:29,454][106225] Updated weights for policy 1, policy_version 451554 (0.0006) [2023-12-27 22:28:29,499][106226] Updated weights for policy 0, policy_version 450232 (0.0006) [2023-12-27 22:28:29,517][106225] Updated weights for policy 1, policy_version 451564 (0.0006) [2023-12-27 22:28:29,562][106226] Updated weights for policy 0, policy_version 450242 (0.0008) [2023-12-27 22:28:30,263][106225] Updated weights for policy 1, policy_version 451574 (0.0008) [2023-12-27 22:28:30,296][106226] Updated weights for policy 0, policy_version 450252 (0.0007) [2023-12-27 22:28:30,316][106225] Updated weights for policy 1, policy_version 451584 (0.0009) [2023-12-27 22:28:30,352][106226] Updated weights for policy 0, policy_version 450262 (0.0007) [2023-12-27 22:28:30,371][106225] Updated weights for policy 1, policy_version 451594 (0.0007) [2023-12-27 22:28:30,404][106226] Updated weights for policy 0, policy_version 450272 (0.0005) [2023-12-27 22:28:31,017][106226] Updated weights for policy 0, policy_version 450282 (0.0007) [2023-12-27 22:28:31,084][106226] Updated weights for policy 0, policy_version 450292 (0.0008) [2023-12-27 22:28:31,156][106226] Updated weights for policy 0, policy_version 450302 (0.0010) [2023-12-27 22:28:31,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19438.7). Total num frames: 230940672. Throughput: 0: 9585.6, 1: 9973.4. Samples: 230937584. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:31,175][105115] Avg episode reward: [(0, '-4.972'), (1, '-5.717')] [2023-12-27 22:28:31,176][106225] Updated weights for policy 1, policy_version 451604 (0.0007) [2023-12-27 22:28:31,218][106226] Updated weights for policy 0, policy_version 450312 (0.0009) [2023-12-27 22:28:31,239][106225] Updated weights for policy 1, policy_version 451614 (0.0007) [2023-12-27 22:28:31,301][106225] Updated weights for policy 1, policy_version 451624 (0.0008) [2023-12-27 22:28:31,934][106226] Updated weights for policy 0, policy_version 450322 (0.0009) [2023-12-27 22:28:31,994][106226] Updated weights for policy 0, policy_version 450332 (0.0009) [2023-12-27 22:28:32,038][106225] Updated weights for policy 1, policy_version 451634 (0.0008) [2023-12-27 22:28:32,048][106226] Updated weights for policy 0, policy_version 450342 (0.0007) [2023-12-27 22:28:32,095][106225] Updated weights for policy 1, policy_version 451644 (0.0008) [2023-12-27 22:28:32,150][106225] Updated weights for policy 1, policy_version 451654 (0.0008) [2023-12-27 22:28:32,211][106225] Updated weights for policy 1, policy_version 451664 (0.0008) [2023-12-27 22:28:32,802][106226] Updated weights for policy 0, policy_version 450352 (0.0008) [2023-12-27 22:28:32,869][106226] Updated weights for policy 0, policy_version 450362 (0.0009) [2023-12-27 22:28:32,929][106226] Updated weights for policy 0, policy_version 450372 (0.0009) [2023-12-27 22:28:32,947][106225] Updated weights for policy 1, policy_version 451674 (0.0007) [2023-12-27 22:28:32,997][106225] Updated weights for policy 1, policy_version 451684 (0.0008) [2023-12-27 22:28:33,052][106225] Updated weights for policy 1, policy_version 451694 (0.0009) [2023-12-27 22:28:33,670][106226] Updated weights for policy 0, policy_version 450382 (0.0009) [2023-12-27 22:28:33,685][106225] Updated weights for policy 1, policy_version 451704 (0.0008) [2023-12-27 22:28:33,723][106226] Updated weights for policy 0, policy_version 450392 (0.0010) [2023-12-27 22:28:33,738][106225] Updated weights for policy 1, policy_version 451714 (0.0006) [2023-12-27 22:28:33,773][106226] Updated weights for policy 0, policy_version 450402 (0.0010) [2023-12-27 22:28:33,791][106225] Updated weights for policy 1, policy_version 451724 (0.0008) [2023-12-27 22:28:34,419][106225] Updated weights for policy 1, policy_version 451734 (0.0006) [2023-12-27 22:28:34,482][106226] Updated weights for policy 0, policy_version 450412 (0.0011) [2023-12-27 22:28:34,488][106225] Updated weights for policy 1, policy_version 451744 (0.0007) [2023-12-27 22:28:34,547][106226] Updated weights for policy 0, policy_version 450422 (0.0011) [2023-12-27 22:28:34,553][106225] Updated weights for policy 1, policy_version 451754 (0.0006) [2023-12-27 22:28:34,612][106226] Updated weights for policy 0, policy_version 450432 (0.0011) [2023-12-27 22:28:35,257][106225] Updated weights for policy 1, policy_version 451764 (0.0007) [2023-12-27 22:28:35,308][106225] Updated weights for policy 1, policy_version 451774 (0.0008) [2023-12-27 22:28:35,331][106226] Updated weights for policy 0, policy_version 450442 (0.0010) [2023-12-27 22:28:35,356][106225] Updated weights for policy 1, policy_version 451784 (0.0007) [2023-12-27 22:28:35,377][106226] Updated weights for policy 0, policy_version 450452 (0.0007) [2023-12-27 22:28:35,434][106226] Updated weights for policy 0, policy_version 450462 (0.0010) [2023-12-27 22:28:35,494][106226] Updated weights for policy 0, policy_version 450472 (0.0010) [2023-12-27 22:28:36,097][106225] Updated weights for policy 1, policy_version 451794 (0.0008) [2023-12-27 22:28:36,128][106226] Updated weights for policy 0, policy_version 450482 (0.0011) [2023-12-27 22:28:36,162][106225] Updated weights for policy 1, policy_version 451804 (0.0008) [2023-12-27 22:28:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 231038976. Throughput: 0: 9648.5, 1: 9908.0. Samples: 231055520. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:36,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.397')] [2023-12-27 22:28:36,185][106226] Updated weights for policy 0, policy_version 450492 (0.0011) [2023-12-27 22:28:36,223][106225] Updated weights for policy 1, policy_version 451814 (0.0009) [2023-12-27 22:28:36,246][106226] Updated weights for policy 0, policy_version 450502 (0.0011) [2023-12-27 22:28:36,286][106225] Updated weights for policy 1, policy_version 451824 (0.0006) [2023-12-27 22:28:36,982][106225] Updated weights for policy 1, policy_version 451834 (0.0006) [2023-12-27 22:28:37,005][106226] Updated weights for policy 0, policy_version 450512 (0.0011) [2023-12-27 22:28:37,041][106225] Updated weights for policy 1, policy_version 451844 (0.0006) [2023-12-27 22:28:37,066][106226] Updated weights for policy 0, policy_version 450522 (0.0010) [2023-12-27 22:28:37,099][106225] Updated weights for policy 1, policy_version 451854 (0.0006) [2023-12-27 22:28:37,123][106226] Updated weights for policy 0, policy_version 450532 (0.0010) [2023-12-27 22:28:37,799][106225] Updated weights for policy 1, policy_version 451864 (0.0005) [2023-12-27 22:28:37,837][106226] Updated weights for policy 0, policy_version 450542 (0.0011) [2023-12-27 22:28:37,860][106225] Updated weights for policy 1, policy_version 451874 (0.0008) [2023-12-27 22:28:37,892][106226] Updated weights for policy 0, policy_version 450552 (0.0011) [2023-12-27 22:28:37,921][106225] Updated weights for policy 1, policy_version 451884 (0.0006) [2023-12-27 22:28:37,954][106226] Updated weights for policy 0, policy_version 450562 (0.0010) [2023-12-27 22:28:38,521][106225] Updated weights for policy 1, policy_version 451894 (0.0007) [2023-12-27 22:28:38,581][106225] Updated weights for policy 1, policy_version 451904 (0.0007) [2023-12-27 22:28:38,641][106225] Updated weights for policy 1, policy_version 451914 (0.0008) [2023-12-27 22:28:38,717][106226] Updated weights for policy 0, policy_version 450572 (0.0010) [2023-12-27 22:28:38,777][106226] Updated weights for policy 0, policy_version 450582 (0.0008) [2023-12-27 22:28:38,845][106226] Updated weights for policy 0, policy_version 450592 (0.0009) [2023-12-27 22:28:39,364][106225] Updated weights for policy 1, policy_version 451924 (0.0008) [2023-12-27 22:28:39,434][106225] Updated weights for policy 1, policy_version 451934 (0.0012) [2023-12-27 22:28:39,499][106225] Updated weights for policy 1, policy_version 451944 (0.0006) [2023-12-27 22:28:39,599][106226] Updated weights for policy 0, policy_version 450602 (0.0010) [2023-12-27 22:28:39,659][106226] Updated weights for policy 0, policy_version 450612 (0.0008) [2023-12-27 22:28:39,722][106226] Updated weights for policy 0, policy_version 450622 (0.0010) [2023-12-27 22:28:39,788][106226] Updated weights for policy 0, policy_version 450632 (0.0009) [2023-12-27 22:28:40,163][106225] Updated weights for policy 1, policy_version 451954 (0.0006) [2023-12-27 22:28:40,222][106225] Updated weights for policy 1, policy_version 451964 (0.0008) [2023-12-27 22:28:40,283][106225] Updated weights for policy 1, policy_version 451974 (0.0009) [2023-12-27 22:28:40,346][106225] Updated weights for policy 1, policy_version 451984 (0.0007) [2023-12-27 22:28:40,582][106226] Updated weights for policy 0, policy_version 450642 (0.0009) [2023-12-27 22:28:40,643][106226] Updated weights for policy 0, policy_version 450652 (0.0008) [2023-12-27 22:28:40,703][106226] Updated weights for policy 0, policy_version 450662 (0.0009) [2023-12-27 22:28:40,985][106225] Updated weights for policy 1, policy_version 451994 (0.0006) [2023-12-27 22:28:41,047][106225] Updated weights for policy 1, policy_version 452004 (0.0007) [2023-12-27 22:28:41,116][106225] Updated weights for policy 1, policy_version 452014 (0.0009) [2023-12-27 22:28:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 231145472. Throughput: 0: 9625.3, 1: 9907.3. Samples: 231113388. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:41,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-5.288')] [2023-12-27 22:28:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000452016_115744768.pth... [2023-12-27 22:28:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000450664_115400704.pth... [2023-12-27 22:28:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000450832_115441664.pth [2023-12-27 22:28:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000449544_115113984.pth [2023-12-27 22:28:41,549][106226] Updated weights for policy 0, policy_version 450672 (0.0008) [2023-12-27 22:28:41,613][106226] Updated weights for policy 0, policy_version 450682 (0.0008) [2023-12-27 22:28:41,680][106226] Updated weights for policy 0, policy_version 450692 (0.0009) [2023-12-27 22:28:41,935][106225] Updated weights for policy 1, policy_version 452024 (0.0009) [2023-12-27 22:28:42,000][106225] Updated weights for policy 1, policy_version 452034 (0.0009) [2023-12-27 22:28:42,066][106225] Updated weights for policy 1, policy_version 452044 (0.0009) [2023-12-27 22:28:42,533][106226] Updated weights for policy 0, policy_version 450702 (0.0007) [2023-12-27 22:28:42,597][106226] Updated weights for policy 0, policy_version 450712 (0.0007) [2023-12-27 22:28:42,659][106226] Updated weights for policy 0, policy_version 450722 (0.0009) [2023-12-27 22:28:42,824][106225] Updated weights for policy 1, policy_version 452054 (0.0008) [2023-12-27 22:28:42,893][106225] Updated weights for policy 1, policy_version 452064 (0.0007) [2023-12-27 22:28:42,958][106225] Updated weights for policy 1, policy_version 452074 (0.0008) [2023-12-27 22:28:43,346][106226] Updated weights for policy 0, policy_version 450732 (0.0007) [2023-12-27 22:28:43,404][106226] Updated weights for policy 0, policy_version 450742 (0.0008) [2023-12-27 22:28:43,453][106226] Updated weights for policy 0, policy_version 450752 (0.0006) [2023-12-27 22:28:43,657][106225] Updated weights for policy 1, policy_version 452084 (0.0008) [2023-12-27 22:28:43,707][106225] Updated weights for policy 1, policy_version 452094 (0.0009) [2023-12-27 22:28:43,758][106225] Updated weights for policy 1, policy_version 452104 (0.0009) [2023-12-27 22:28:44,130][106226] Updated weights for policy 0, policy_version 450762 (0.0009) [2023-12-27 22:28:44,178][106226] Updated weights for policy 0, policy_version 450772 (0.0009) [2023-12-27 22:28:44,231][106226] Updated weights for policy 0, policy_version 450782 (0.0009) [2023-12-27 22:28:44,293][106226] Updated weights for policy 0, policy_version 450792 (0.0008) [2023-12-27 22:28:44,496][106225] Updated weights for policy 1, policy_version 452114 (0.0007) [2023-12-27 22:28:44,560][106225] Updated weights for policy 1, policy_version 452124 (0.0008) [2023-12-27 22:28:44,627][106225] Updated weights for policy 1, policy_version 452134 (0.0009) [2023-12-27 22:28:44,700][106225] Updated weights for policy 1, policy_version 452144 (0.0005) [2023-12-27 22:28:44,996][106226] Updated weights for policy 0, policy_version 450802 (0.0006) [2023-12-27 22:28:45,054][106226] Updated weights for policy 0, policy_version 450812 (0.0007) [2023-12-27 22:28:45,112][106226] Updated weights for policy 0, policy_version 450822 (0.0008) [2023-12-27 22:28:45,405][106225] Updated weights for policy 1, policy_version 452154 (0.0008) [2023-12-27 22:28:45,466][106225] Updated weights for policy 1, policy_version 452164 (0.0009) [2023-12-27 22:28:45,525][106225] Updated weights for policy 1, policy_version 452174 (0.0008) [2023-12-27 22:28:45,835][106226] Updated weights for policy 0, policy_version 450832 (0.0010) [2023-12-27 22:28:45,898][106226] Updated weights for policy 0, policy_version 450842 (0.0008) [2023-12-27 22:28:45,963][106226] Updated weights for policy 0, policy_version 450852 (0.0006) [2023-12-27 22:28:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.8, 300 sec: 19466.4). Total num frames: 231235584. Throughput: 0: 9513.7, 1: 9901.6. Samples: 231226576. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:46,175][105115] Avg episode reward: [(0, '-5.053'), (1, '-5.424')] [2023-12-27 22:28:46,208][106225] Updated weights for policy 1, policy_version 452184 (0.0006) [2023-12-27 22:28:46,257][106225] Updated weights for policy 1, policy_version 452194 (0.0005) [2023-12-27 22:28:46,304][106225] Updated weights for policy 1, policy_version 452204 (0.0006) [2023-12-27 22:28:46,554][106226] Updated weights for policy 0, policy_version 450862 (0.0007) [2023-12-27 22:28:46,614][106226] Updated weights for policy 0, policy_version 450872 (0.0009) [2023-12-27 22:28:46,667][106226] Updated weights for policy 0, policy_version 450882 (0.0006) [2023-12-27 22:28:47,024][106225] Updated weights for policy 1, policy_version 452214 (0.0009) [2023-12-27 22:28:47,084][106225] Updated weights for policy 1, policy_version 452224 (0.0009) [2023-12-27 22:28:47,145][106225] Updated weights for policy 1, policy_version 452234 (0.0008) [2023-12-27 22:28:47,332][106226] Updated weights for policy 0, policy_version 450892 (0.0009) [2023-12-27 22:28:47,395][106226] Updated weights for policy 0, policy_version 450902 (0.0008) [2023-12-27 22:28:47,442][106226] Updated weights for policy 0, policy_version 450912 (0.0006) [2023-12-27 22:28:47,835][106225] Updated weights for policy 1, policy_version 452244 (0.0007) [2023-12-27 22:28:47,891][106225] Updated weights for policy 1, policy_version 452254 (0.0005) [2023-12-27 22:28:47,949][106225] Updated weights for policy 1, policy_version 452264 (0.0005) [2023-12-27 22:28:48,178][106226] Updated weights for policy 0, policy_version 450922 (0.0006) [2023-12-27 22:28:48,229][106226] Updated weights for policy 0, policy_version 450932 (0.0007) [2023-12-27 22:28:48,288][106226] Updated weights for policy 0, policy_version 450942 (0.0005) [2023-12-27 22:28:48,347][106226] Updated weights for policy 0, policy_version 450952 (0.0007) [2023-12-27 22:28:48,548][106225] Updated weights for policy 1, policy_version 452274 (0.0006) [2023-12-27 22:28:48,603][106225] Updated weights for policy 1, policy_version 452284 (0.0009) [2023-12-27 22:28:48,663][106225] Updated weights for policy 1, policy_version 452294 (0.0009) [2023-12-27 22:28:48,726][106225] Updated weights for policy 1, policy_version 452304 (0.0008) [2023-12-27 22:28:48,970][106226] Updated weights for policy 0, policy_version 450962 (0.0009) [2023-12-27 22:28:49,031][106226] Updated weights for policy 0, policy_version 450972 (0.0009) [2023-12-27 22:28:49,083][106226] Updated weights for policy 0, policy_version 450982 (0.0009) [2023-12-27 22:28:49,507][106225] Updated weights for policy 1, policy_version 452314 (0.0008) [2023-12-27 22:28:49,558][106225] Updated weights for policy 1, policy_version 452324 (0.0008) [2023-12-27 22:28:49,629][106225] Updated weights for policy 1, policy_version 452334 (0.0008) [2023-12-27 22:28:49,816][106226] Updated weights for policy 0, policy_version 450992 (0.0008) [2023-12-27 22:28:49,880][106226] Updated weights for policy 0, policy_version 451002 (0.0008) [2023-12-27 22:28:49,944][106226] Updated weights for policy 0, policy_version 451012 (0.0008) [2023-12-27 22:28:50,393][106225] Updated weights for policy 1, policy_version 452344 (0.0008) [2023-12-27 22:28:50,438][106225] Updated weights for policy 1, policy_version 452354 (0.0008) [2023-12-27 22:28:50,486][106225] Updated weights for policy 1, policy_version 452364 (0.0007) [2023-12-27 22:28:50,622][106226] Updated weights for policy 0, policy_version 451022 (0.0008) [2023-12-27 22:28:50,685][106226] Updated weights for policy 0, policy_version 451032 (0.0006) [2023-12-27 22:28:50,749][106226] Updated weights for policy 0, policy_version 451042 (0.0009) [2023-12-27 22:28:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19438.6). Total num frames: 231333888. Throughput: 0: 9554.0, 1: 9837.1. Samples: 231346016. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-27 22:28:51,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-5.389')] [2023-12-27 22:28:51,264][106225] Updated weights for policy 1, policy_version 452374 (0.0008) [2023-12-27 22:28:51,327][106225] Updated weights for policy 1, policy_version 452384 (0.0007) [2023-12-27 22:28:51,396][106225] Updated weights for policy 1, policy_version 452394 (0.0008) [2023-12-27 22:28:51,412][106226] Updated weights for policy 0, policy_version 451052 (0.0009) [2023-12-27 22:28:51,476][106226] Updated weights for policy 0, policy_version 451062 (0.0008) [2023-12-27 22:28:51,536][106226] Updated weights for policy 0, policy_version 451072 (0.0009) [2023-12-27 22:28:52,206][106225] Updated weights for policy 1, policy_version 452404 (0.0007) [2023-12-27 22:28:52,273][106225] Updated weights for policy 1, policy_version 452414 (0.0006) [2023-12-27 22:28:52,290][106226] Updated weights for policy 0, policy_version 451082 (0.0008) [2023-12-27 22:28:52,337][106225] Updated weights for policy 1, policy_version 452424 (0.0006) [2023-12-27 22:28:52,344][106226] Updated weights for policy 0, policy_version 451092 (0.0008) [2023-12-27 22:28:52,414][106226] Updated weights for policy 0, policy_version 451102 (0.0008) [2023-12-27 22:28:52,477][106226] Updated weights for policy 0, policy_version 451112 (0.0008) [2023-12-27 22:28:53,049][106225] Updated weights for policy 1, policy_version 452434 (0.0007) [2023-12-27 22:28:53,110][106225] Updated weights for policy 1, policy_version 452444 (0.0007) [2023-12-27 22:28:53,159][106226] Updated weights for policy 0, policy_version 451122 (0.0010) [2023-12-27 22:28:53,170][106225] Updated weights for policy 1, policy_version 452454 (0.0009) [2023-12-27 22:28:53,224][106226] Updated weights for policy 0, policy_version 451132 (0.0009) [2023-12-27 22:28:53,233][106225] Updated weights for policy 1, policy_version 452464 (0.0010) [2023-12-27 22:28:53,288][106226] Updated weights for policy 0, policy_version 451142 (0.0006) [2023-12-27 22:28:53,826][106225] Updated weights for policy 1, policy_version 452474 (0.0005) [2023-12-27 22:28:53,842][106226] Updated weights for policy 0, policy_version 451152 (0.0007) [2023-12-27 22:28:53,880][106225] Updated weights for policy 1, policy_version 452484 (0.0005) [2023-12-27 22:28:53,906][106226] Updated weights for policy 0, policy_version 451162 (0.0010) [2023-12-27 22:28:53,944][106225] Updated weights for policy 1, policy_version 452494 (0.0006) [2023-12-27 22:28:53,993][106226] Updated weights for policy 0, policy_version 451172 (0.0009) [2023-12-27 22:28:54,539][106225] Updated weights for policy 1, policy_version 452504 (0.0009) [2023-12-27 22:28:54,599][106225] Updated weights for policy 1, policy_version 452514 (0.0008) [2023-12-27 22:28:54,659][106225] Updated weights for policy 1, policy_version 452524 (0.0010) [2023-12-27 22:28:54,666][106226] Updated weights for policy 0, policy_version 451182 (0.0011) [2023-12-27 22:28:54,723][106226] Updated weights for policy 0, policy_version 451192 (0.0010) [2023-12-27 22:28:54,777][106226] Updated weights for policy 0, policy_version 451202 (0.0010) [2023-12-27 22:28:55,282][106225] Updated weights for policy 1, policy_version 452534 (0.0009) [2023-12-27 22:28:55,333][106225] Updated weights for policy 1, policy_version 452544 (0.0008) [2023-12-27 22:28:55,392][106225] Updated weights for policy 1, policy_version 452554 (0.0008) [2023-12-27 22:28:55,393][106226] Updated weights for policy 0, policy_version 451212 (0.0010) [2023-12-27 22:28:55,452][106226] Updated weights for policy 0, policy_version 451222 (0.0008) [2023-12-27 22:28:55,517][106226] Updated weights for policy 0, policy_version 451232 (0.0005) [2023-12-27 22:28:56,032][106225] Updated weights for policy 1, policy_version 452564 (0.0006) [2023-12-27 22:28:56,085][106225] Updated weights for policy 1, policy_version 452574 (0.0005) [2023-12-27 22:28:56,140][106225] Updated weights for policy 1, policy_version 452584 (0.0006) [2023-12-27 22:28:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 231432192. Throughput: 0: 9591.3, 1: 9789.6. Samples: 231404752. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:28:56,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-5.653')] [2023-12-27 22:28:56,182][106226] Updated weights for policy 0, policy_version 451242 (0.0006) [2023-12-27 22:28:56,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000452592_115892224.pth... [2023-12-27 22:28:56,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000451408_115589120.pth [2023-12-27 22:28:56,247][106226] Updated weights for policy 0, policy_version 451252 (0.0009) [2023-12-27 22:28:56,317][106226] Updated weights for policy 0, policy_version 451262 (0.0008) [2023-12-27 22:28:56,364][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000451272_115556352.pth... [2023-12-27 22:28:56,367][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000450120_115261440.pth [2023-12-27 22:28:56,368][106226] Updated weights for policy 0, policy_version 451272 (0.0009) [2023-12-27 22:28:56,683][106225] Updated weights for policy 1, policy_version 452594 (0.0006) [2023-12-27 22:28:56,731][106225] Updated weights for policy 1, policy_version 452604 (0.0005) [2023-12-27 22:28:56,783][106225] Updated weights for policy 1, policy_version 452614 (0.0005) [2023-12-27 22:28:56,843][106225] Updated weights for policy 1, policy_version 452624 (0.0005) [2023-12-27 22:28:57,214][106226] Updated weights for policy 0, policy_version 451282 (0.0007) [2023-12-27 22:28:57,279][106226] Updated weights for policy 0, policy_version 451292 (0.0009) [2023-12-27 22:28:57,343][106226] Updated weights for policy 0, policy_version 451302 (0.0009) [2023-12-27 22:28:57,371][106225] Updated weights for policy 1, policy_version 452634 (0.0007) [2023-12-27 22:28:57,430][106225] Updated weights for policy 1, policy_version 452644 (0.0005) [2023-12-27 22:28:57,476][106225] Updated weights for policy 1, policy_version 452654 (0.0005) [2023-12-27 22:28:57,953][106226] Updated weights for policy 0, policy_version 451312 (0.0006) [2023-12-27 22:28:58,005][106225] Updated weights for policy 1, policy_version 452664 (0.0006) [2023-12-27 22:28:58,031][106226] Updated weights for policy 0, policy_version 451322 (0.0010) [2023-12-27 22:28:58,060][106225] Updated weights for policy 1, policy_version 452674 (0.0006) [2023-12-27 22:28:58,107][106226] Updated weights for policy 0, policy_version 451332 (0.0005) [2023-12-27 22:28:58,121][106225] Updated weights for policy 1, policy_version 452684 (0.0006) [2023-12-27 22:28:58,784][106226] Updated weights for policy 0, policy_version 451342 (0.0008) [2023-12-27 22:28:58,854][106226] Updated weights for policy 0, policy_version 451352 (0.0009) [2023-12-27 22:28:58,918][106226] Updated weights for policy 0, policy_version 451362 (0.0007) [2023-12-27 22:28:58,996][106225] Updated weights for policy 1, policy_version 452694 (0.0007) [2023-12-27 22:28:59,061][106225] Updated weights for policy 1, policy_version 452704 (0.0008) [2023-12-27 22:28:59,127][106225] Updated weights for policy 1, policy_version 452714 (0.0008) [2023-12-27 22:28:59,752][106226] Updated weights for policy 0, policy_version 451372 (0.0008) [2023-12-27 22:28:59,803][106226] Updated weights for policy 0, policy_version 451382 (0.0008) [2023-12-27 22:28:59,835][106225] Updated weights for policy 1, policy_version 452724 (0.0008) [2023-12-27 22:28:59,866][106226] Updated weights for policy 0, policy_version 451392 (0.0010) [2023-12-27 22:28:59,897][106225] Updated weights for policy 1, policy_version 452734 (0.0006) [2023-12-27 22:28:59,969][106225] Updated weights for policy 1, policy_version 452744 (0.0008) [2023-12-27 22:29:00,531][106226] Updated weights for policy 0, policy_version 451402 (0.0008) [2023-12-27 22:29:00,597][106226] Updated weights for policy 0, policy_version 451412 (0.0006) [2023-12-27 22:29:00,618][106225] Updated weights for policy 1, policy_version 452754 (0.0009) [2023-12-27 22:29:00,652][106226] Updated weights for policy 0, policy_version 451422 (0.0005) [2023-12-27 22:29:00,676][106225] Updated weights for policy 1, policy_version 452764 (0.0005) [2023-12-27 22:29:00,713][106226] Updated weights for policy 0, policy_version 451432 (0.0005) [2023-12-27 22:29:00,733][106225] Updated weights for policy 1, policy_version 452774 (0.0005) [2023-12-27 22:29:00,794][106225] Updated weights for policy 1, policy_version 452784 (0.0009) [2023-12-27 22:29:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 231538688. Throughput: 0: 9639.8, 1: 9992.5. Samples: 231527840. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:01,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-5.804')] [2023-12-27 22:29:01,330][106226] Updated weights for policy 0, policy_version 451442 (0.0006) [2023-12-27 22:29:01,399][106226] Updated weights for policy 0, policy_version 451452 (0.0008) [2023-12-27 22:29:01,468][106226] Updated weights for policy 0, policy_version 451462 (0.0007) [2023-12-27 22:29:01,501][106225] Updated weights for policy 1, policy_version 452794 (0.0011) [2023-12-27 22:29:01,560][106225] Updated weights for policy 1, policy_version 452804 (0.0010) [2023-12-27 22:29:01,624][106225] Updated weights for policy 1, policy_version 452814 (0.0010) [2023-12-27 22:29:02,152][106226] Updated weights for policy 0, policy_version 451472 (0.0008) [2023-12-27 22:29:02,204][106226] Updated weights for policy 0, policy_version 451482 (0.0008) [2023-12-27 22:29:02,266][106226] Updated weights for policy 0, policy_version 451492 (0.0008) [2023-12-27 22:29:02,347][106225] Updated weights for policy 1, policy_version 452824 (0.0010) [2023-12-27 22:29:02,416][106225] Updated weights for policy 1, policy_version 452834 (0.0011) [2023-12-27 22:29:02,473][106225] Updated weights for policy 1, policy_version 452844 (0.0008) [2023-12-27 22:29:02,982][106226] Updated weights for policy 0, policy_version 451502 (0.0007) [2023-12-27 22:29:03,045][106226] Updated weights for policy 0, policy_version 451512 (0.0008) [2023-12-27 22:29:03,048][106225] Updated weights for policy 1, policy_version 452854 (0.0007) [2023-12-27 22:29:03,097][106225] Updated weights for policy 1, policy_version 452864 (0.0005) [2023-12-27 22:29:03,113][106226] Updated weights for policy 0, policy_version 451522 (0.0005) [2023-12-27 22:29:03,147][106225] Updated weights for policy 1, policy_version 452874 (0.0005) [2023-12-27 22:29:03,756][106225] Updated weights for policy 1, policy_version 452884 (0.0006) [2023-12-27 22:29:03,770][106226] Updated weights for policy 0, policy_version 451532 (0.0007) [2023-12-27 22:29:03,802][106225] Updated weights for policy 1, policy_version 452894 (0.0010) [2023-12-27 22:29:03,826][106226] Updated weights for policy 0, policy_version 451542 (0.0006) [2023-12-27 22:29:03,859][106225] Updated weights for policy 1, policy_version 452904 (0.0010) [2023-12-27 22:29:03,892][106226] Updated weights for policy 0, policy_version 451552 (0.0009) [2023-12-27 22:29:04,547][106226] Updated weights for policy 0, policy_version 451562 (0.0007) [2023-12-27 22:29:04,601][106226] Updated weights for policy 0, policy_version 451572 (0.0005) [2023-12-27 22:29:04,631][106225] Updated weights for policy 1, policy_version 452914 (0.0010) [2023-12-27 22:29:04,655][106226] Updated weights for policy 0, policy_version 451582 (0.0006) [2023-12-27 22:29:04,693][106225] Updated weights for policy 1, policy_version 452924 (0.0010) [2023-12-27 22:29:04,718][106226] Updated weights for policy 0, policy_version 451592 (0.0007) [2023-12-27 22:29:04,764][106225] Updated weights for policy 1, policy_version 452934 (0.0011) [2023-12-27 22:29:04,826][106225] Updated weights for policy 1, policy_version 452944 (0.0010) [2023-12-27 22:29:05,459][106226] Updated weights for policy 0, policy_version 451602 (0.0008) [2023-12-27 22:29:05,523][106226] Updated weights for policy 0, policy_version 451612 (0.0008) [2023-12-27 22:29:05,523][106225] Updated weights for policy 1, policy_version 452954 (0.0008) [2023-12-27 22:29:05,582][106226] Updated weights for policy 0, policy_version 451622 (0.0008) [2023-12-27 22:29:05,584][106225] Updated weights for policy 1, policy_version 452964 (0.0006) [2023-12-27 22:29:05,643][106225] Updated weights for policy 1, policy_version 452974 (0.0008) [2023-12-27 22:29:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 231636992. Throughput: 0: 9709.8, 1: 10032.7. Samples: 231649760. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:06,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.355')] [2023-12-27 22:29:06,311][106226] Updated weights for policy 0, policy_version 451632 (0.0007) [2023-12-27 22:29:06,321][106225] Updated weights for policy 1, policy_version 452984 (0.0007) [2023-12-27 22:29:06,378][106226] Updated weights for policy 0, policy_version 451642 (0.0009) [2023-12-27 22:29:06,384][106225] Updated weights for policy 1, policy_version 452994 (0.0006) [2023-12-27 22:29:06,450][106226] Updated weights for policy 0, policy_version 451652 (0.0008) [2023-12-27 22:29:06,456][106225] Updated weights for policy 1, policy_version 453004 (0.0006) [2023-12-27 22:29:07,106][106225] Updated weights for policy 1, policy_version 453014 (0.0007) [2023-12-27 22:29:07,162][106225] Updated weights for policy 1, policy_version 453024 (0.0008) [2023-12-27 22:29:07,210][106226] Updated weights for policy 0, policy_version 451662 (0.0007) [2023-12-27 22:29:07,222][106225] Updated weights for policy 1, policy_version 453034 (0.0008) [2023-12-27 22:29:07,278][106226] Updated weights for policy 0, policy_version 451672 (0.0008) [2023-12-27 22:29:07,353][106226] Updated weights for policy 0, policy_version 451682 (0.0009) [2023-12-27 22:29:07,885][106225] Updated weights for policy 1, policy_version 453044 (0.0007) [2023-12-27 22:29:07,938][106225] Updated weights for policy 1, policy_version 453054 (0.0009) [2023-12-27 22:29:07,991][106225] Updated weights for policy 1, policy_version 453064 (0.0008) [2023-12-27 22:29:08,088][106226] Updated weights for policy 0, policy_version 451692 (0.0009) [2023-12-27 22:29:08,150][106226] Updated weights for policy 0, policy_version 451702 (0.0009) [2023-12-27 22:29:08,212][106226] Updated weights for policy 0, policy_version 451712 (0.0008) [2023-12-27 22:29:08,733][106225] Updated weights for policy 1, policy_version 453074 (0.0009) [2023-12-27 22:29:08,792][106225] Updated weights for policy 1, policy_version 453084 (0.0008) [2023-12-27 22:29:08,848][106225] Updated weights for policy 1, policy_version 453094 (0.0008) [2023-12-27 22:29:08,912][106225] Updated weights for policy 1, policy_version 453104 (0.0009) [2023-12-27 22:29:08,927][106226] Updated weights for policy 0, policy_version 451722 (0.0010) [2023-12-27 22:29:08,990][106226] Updated weights for policy 0, policy_version 451732 (0.0009) [2023-12-27 22:29:09,053][106226] Updated weights for policy 0, policy_version 451742 (0.0009) [2023-12-27 22:29:09,119][106226] Updated weights for policy 0, policy_version 451752 (0.0008) [2023-12-27 22:29:09,746][106225] Updated weights for policy 1, policy_version 453114 (0.0008) [2023-12-27 22:29:09,805][106225] Updated weights for policy 1, policy_version 453124 (0.0008) [2023-12-27 22:29:09,847][106226] Updated weights for policy 0, policy_version 451762 (0.0009) [2023-12-27 22:29:09,872][106225] Updated weights for policy 1, policy_version 453134 (0.0008) [2023-12-27 22:29:09,906][106226] Updated weights for policy 0, policy_version 451772 (0.0007) [2023-12-27 22:29:09,974][106226] Updated weights for policy 0, policy_version 451782 (0.0009) [2023-12-27 22:29:10,650][106225] Updated weights for policy 1, policy_version 453144 (0.0007) [2023-12-27 22:29:10,680][106226] Updated weights for policy 0, policy_version 451792 (0.0007) [2023-12-27 22:29:10,704][106225] Updated weights for policy 1, policy_version 453154 (0.0009) [2023-12-27 22:29:10,738][106226] Updated weights for policy 0, policy_version 451802 (0.0007) [2023-12-27 22:29:10,760][106225] Updated weights for policy 1, policy_version 453164 (0.0007) [2023-12-27 22:29:10,796][106226] Updated weights for policy 0, policy_version 451812 (0.0007) [2023-12-27 22:29:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19521.9). Total num frames: 231735296. Throughput: 0: 9705.2, 1: 10044.8. Samples: 231707312. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:11,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.361')] [2023-12-27 22:29:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000453168_116039680.pth... [2023-12-27 22:29:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000451816_115695616.pth... [2023-12-27 22:29:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000452016_115744768.pth [2023-12-27 22:29:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000450664_115400704.pth [2023-12-27 22:29:11,534][106225] Updated weights for policy 1, policy_version 453174 (0.0007) [2023-12-27 22:29:11,544][106226] Updated weights for policy 0, policy_version 451822 (0.0008) [2023-12-27 22:29:11,590][106225] Updated weights for policy 1, policy_version 453184 (0.0008) [2023-12-27 22:29:11,603][106226] Updated weights for policy 0, policy_version 451832 (0.0008) [2023-12-27 22:29:11,657][106225] Updated weights for policy 1, policy_version 453194 (0.0008) [2023-12-27 22:29:11,673][106226] Updated weights for policy 0, policy_version 451842 (0.0007) [2023-12-27 22:29:12,392][106226] Updated weights for policy 0, policy_version 451852 (0.0008) [2023-12-27 22:29:12,458][106226] Updated weights for policy 0, policy_version 451862 (0.0008) [2023-12-27 22:29:12,458][106225] Updated weights for policy 1, policy_version 453204 (0.0009) [2023-12-27 22:29:12,518][106226] Updated weights for policy 0, policy_version 451872 (0.0006) [2023-12-27 22:29:12,523][106225] Updated weights for policy 1, policy_version 453214 (0.0008) [2023-12-27 22:29:12,586][106225] Updated weights for policy 1, policy_version 453224 (0.0008) [2023-12-27 22:29:13,150][106226] Updated weights for policy 0, policy_version 451882 (0.0006) [2023-12-27 22:29:13,206][106226] Updated weights for policy 0, policy_version 451892 (0.0009) [2023-12-27 22:29:13,260][106226] Updated weights for policy 0, policy_version 451902 (0.0009) [2023-12-27 22:29:13,321][106226] Updated weights for policy 0, policy_version 451912 (0.0009) [2023-12-27 22:29:13,397][106225] Updated weights for policy 1, policy_version 453234 (0.0009) [2023-12-27 22:29:13,465][106225] Updated weights for policy 1, policy_version 453244 (0.0006) [2023-12-27 22:29:13,530][106225] Updated weights for policy 1, policy_version 453254 (0.0006) [2023-12-27 22:29:13,596][106225] Updated weights for policy 1, policy_version 453264 (0.0006) [2023-12-27 22:29:13,971][106226] Updated weights for policy 0, policy_version 451922 (0.0008) [2023-12-27 22:29:14,020][106226] Updated weights for policy 0, policy_version 451932 (0.0009) [2023-12-27 22:29:14,077][106226] Updated weights for policy 0, policy_version 451942 (0.0008) [2023-12-27 22:29:14,288][106225] Updated weights for policy 1, policy_version 453274 (0.0009) [2023-12-27 22:29:14,347][106225] Updated weights for policy 1, policy_version 453284 (0.0009) [2023-12-27 22:29:14,404][106225] Updated weights for policy 1, policy_version 453294 (0.0008) [2023-12-27 22:29:14,762][106226] Updated weights for policy 0, policy_version 451952 (0.0010) [2023-12-27 22:29:14,830][106226] Updated weights for policy 0, policy_version 451962 (0.0008) [2023-12-27 22:29:14,897][106226] Updated weights for policy 0, policy_version 451973 (0.0008) [2023-12-27 22:29:15,163][106225] Updated weights for policy 1, policy_version 453304 (0.0009) [2023-12-27 22:29:15,235][106225] Updated weights for policy 1, policy_version 453314 (0.0009) [2023-12-27 22:29:15,304][106225] Updated weights for policy 1, policy_version 453324 (0.0009) [2023-12-27 22:29:15,494][106226] Updated weights for policy 0, policy_version 451983 (0.0006) [2023-12-27 22:29:15,553][106226] Updated weights for policy 0, policy_version 451993 (0.0007) [2023-12-27 22:29:15,614][106226] Updated weights for policy 0, policy_version 452003 (0.0009) [2023-12-27 22:29:16,034][106225] Updated weights for policy 1, policy_version 453334 (0.0009) [2023-12-27 22:29:16,092][106225] Updated weights for policy 1, policy_version 453344 (0.0008) [2023-12-27 22:29:16,143][106225] Updated weights for policy 1, policy_version 453354 (0.0007) [2023-12-27 22:29:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 231833600. Throughput: 0: 9770.3, 1: 9853.0. Samples: 231820632. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:16,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-5.554')] [2023-12-27 22:29:16,205][106226] Updated weights for policy 0, policy_version 452013 (0.0008) [2023-12-27 22:29:16,267][106226] Updated weights for policy 0, policy_version 452023 (0.0008) [2023-12-27 22:29:16,329][106226] Updated weights for policy 0, policy_version 452033 (0.0008) [2023-12-27 22:29:16,770][106225] Updated weights for policy 1, policy_version 453364 (0.0006) [2023-12-27 22:29:16,817][106225] Updated weights for policy 1, policy_version 453374 (0.0005) [2023-12-27 22:29:16,883][106225] Updated weights for policy 1, policy_version 453384 (0.0007) [2023-12-27 22:29:17,114][106226] Updated weights for policy 0, policy_version 452043 (0.0009) [2023-12-27 22:29:17,175][106226] Updated weights for policy 0, policy_version 452053 (0.0008) [2023-12-27 22:29:17,237][106226] Updated weights for policy 0, policy_version 452063 (0.0008) [2023-12-27 22:29:17,502][106225] Updated weights for policy 1, policy_version 453394 (0.0008) [2023-12-27 22:29:17,559][106225] Updated weights for policy 1, policy_version 453404 (0.0008) [2023-12-27 22:29:17,622][106225] Updated weights for policy 1, policy_version 453414 (0.0009) [2023-12-27 22:29:17,684][106225] Updated weights for policy 1, policy_version 453424 (0.0008) [2023-12-27 22:29:17,963][106226] Updated weights for policy 0, policy_version 452073 (0.0009) [2023-12-27 22:29:18,012][106226] Updated weights for policy 0, policy_version 452083 (0.0008) [2023-12-27 22:29:18,067][106226] Updated weights for policy 0, policy_version 452093 (0.0008) [2023-12-27 22:29:18,122][106226] Updated weights for policy 0, policy_version 452103 (0.0008) [2023-12-27 22:29:18,412][106225] Updated weights for policy 1, policy_version 453434 (0.0009) [2023-12-27 22:29:18,472][106225] Updated weights for policy 1, policy_version 453444 (0.0009) [2023-12-27 22:29:18,535][106225] Updated weights for policy 1, policy_version 453454 (0.0009) [2023-12-27 22:29:18,898][106226] Updated weights for policy 0, policy_version 452113 (0.0009) [2023-12-27 22:29:18,946][106226] Updated weights for policy 0, policy_version 452123 (0.0008) [2023-12-27 22:29:18,999][106226] Updated weights for policy 0, policy_version 452133 (0.0007) [2023-12-27 22:29:19,235][106225] Updated weights for policy 1, policy_version 453464 (0.0007) [2023-12-27 22:29:19,293][106225] Updated weights for policy 1, policy_version 453474 (0.0008) [2023-12-27 22:29:19,360][106225] Updated weights for policy 1, policy_version 453484 (0.0008) [2023-12-27 22:29:19,748][106226] Updated weights for policy 0, policy_version 452143 (0.0007) [2023-12-27 22:29:19,805][106226] Updated weights for policy 0, policy_version 452153 (0.0009) [2023-12-27 22:29:19,874][106226] Updated weights for policy 0, policy_version 452163 (0.0009) [2023-12-27 22:29:20,134][106225] Updated weights for policy 1, policy_version 453494 (0.0007) [2023-12-27 22:29:20,202][106225] Updated weights for policy 1, policy_version 453504 (0.0008) [2023-12-27 22:29:20,274][106225] Updated weights for policy 1, policy_version 453514 (0.0009) [2023-12-27 22:29:20,579][106226] Updated weights for policy 0, policy_version 452173 (0.0010) [2023-12-27 22:29:20,647][106226] Updated weights for policy 0, policy_version 452183 (0.0012) [2023-12-27 22:29:20,712][106226] Updated weights for policy 0, policy_version 452193 (0.0011) [2023-12-27 22:29:21,054][106225] Updated weights for policy 1, policy_version 453524 (0.0009) [2023-12-27 22:29:21,116][106225] Updated weights for policy 1, policy_version 453534 (0.0011) [2023-12-27 22:29:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 231923712. Throughput: 0: 9752.3, 1: 9836.6. Samples: 231937024. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:21,175][105115] Avg episode reward: [(0, '-5.203'), (1, '-5.528')] [2023-12-27 22:29:21,180][106225] Updated weights for policy 1, policy_version 453544 (0.0010) [2023-12-27 22:29:21,491][106226] Updated weights for policy 0, policy_version 452203 (0.0010) [2023-12-27 22:29:21,546][106226] Updated weights for policy 0, policy_version 452213 (0.0011) [2023-12-27 22:29:21,600][106226] Updated weights for policy 0, policy_version 452223 (0.0009) [2023-12-27 22:29:21,960][106225] Updated weights for policy 1, policy_version 453554 (0.0010) [2023-12-27 22:29:22,004][106225] Updated weights for policy 1, policy_version 453564 (0.0007) [2023-12-27 22:29:22,058][106225] Updated weights for policy 1, policy_version 453574 (0.0007) [2023-12-27 22:29:22,109][106225] Updated weights for policy 1, policy_version 453584 (0.0007) [2023-12-27 22:29:22,422][106226] Updated weights for policy 0, policy_version 452234 (0.0009) [2023-12-27 22:29:22,484][106226] Updated weights for policy 0, policy_version 452244 (0.0011) [2023-12-27 22:29:22,561][106226] Updated weights for policy 0, policy_version 452255 (0.0010) [2023-12-27 22:29:22,837][106225] Updated weights for policy 1, policy_version 453594 (0.0005) [2023-12-27 22:29:22,893][106225] Updated weights for policy 1, policy_version 453604 (0.0006) [2023-12-27 22:29:22,954][106225] Updated weights for policy 1, policy_version 453614 (0.0005) [2023-12-27 22:29:23,302][106226] Updated weights for policy 0, policy_version 452265 (0.0011) [2023-12-27 22:29:23,370][106226] Updated weights for policy 0, policy_version 452275 (0.0011) [2023-12-27 22:29:23,424][106226] Updated weights for policy 0, policy_version 452285 (0.0011) [2023-12-27 22:29:23,474][106225] Updated weights for policy 1, policy_version 453624 (0.0006) [2023-12-27 22:29:23,479][106226] Updated weights for policy 0, policy_version 452295 (0.0011) [2023-12-27 22:29:23,533][106225] Updated weights for policy 1, policy_version 453634 (0.0008) [2023-12-27 22:29:23,595][106225] Updated weights for policy 1, policy_version 453644 (0.0008) [2023-12-27 22:29:24,216][106226] Updated weights for policy 0, policy_version 452305 (0.0011) [2023-12-27 22:29:24,262][106226] Updated weights for policy 0, policy_version 452315 (0.0010) [2023-12-27 22:29:24,309][106225] Updated weights for policy 1, policy_version 453654 (0.0007) [2023-12-27 22:29:24,328][106226] Updated weights for policy 0, policy_version 452325 (0.0010) [2023-12-27 22:29:24,369][106225] Updated weights for policy 1, policy_version 453664 (0.0007) [2023-12-27 22:29:24,426][106225] Updated weights for policy 1, policy_version 453674 (0.0008) [2023-12-27 22:29:25,047][106226] Updated weights for policy 0, policy_version 452335 (0.0010) [2023-12-27 22:29:25,075][106225] Updated weights for policy 1, policy_version 453684 (0.0008) [2023-12-27 22:29:25,104][106226] Updated weights for policy 0, policy_version 452345 (0.0006) [2023-12-27 22:29:25,137][106225] Updated weights for policy 1, policy_version 453694 (0.0007) [2023-12-27 22:29:25,162][106226] Updated weights for policy 0, policy_version 452355 (0.0006) [2023-12-27 22:29:25,203][106225] Updated weights for policy 1, policy_version 453704 (0.0008) [2023-12-27 22:29:25,815][106225] Updated weights for policy 1, policy_version 453714 (0.0007) [2023-12-27 22:29:25,817][106226] Updated weights for policy 0, policy_version 452365 (0.0006) [2023-12-27 22:29:25,866][106225] Updated weights for policy 1, policy_version 453724 (0.0005) [2023-12-27 22:29:25,867][106226] Updated weights for policy 0, policy_version 452375 (0.0010) [2023-12-27 22:29:25,915][106225] Updated weights for policy 1, policy_version 453734 (0.0008) [2023-12-27 22:29:25,924][106226] Updated weights for policy 0, policy_version 452385 (0.0008) [2023-12-27 22:29:25,972][106225] Updated weights for policy 1, policy_version 453744 (0.0007) [2023-12-27 22:29:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 232030208. Throughput: 0: 9742.3, 1: 9836.7. Samples: 231994436. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:26,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-5.442')] [2023-12-27 22:29:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000453744_116187136.pth... [2023-12-27 22:29:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000452392_115843072.pth... [2023-12-27 22:29:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000451272_115556352.pth [2023-12-27 22:29:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000452592_115892224.pth [2023-12-27 22:29:26,593][106225] Updated weights for policy 1, policy_version 453754 (0.0005) [2023-12-27 22:29:26,657][106225] Updated weights for policy 1, policy_version 453764 (0.0008) [2023-12-27 22:29:26,669][106226] Updated weights for policy 0, policy_version 452395 (0.0007) [2023-12-27 22:29:26,714][106225] Updated weights for policy 1, policy_version 453774 (0.0007) [2023-12-27 22:29:26,731][106226] Updated weights for policy 0, policy_version 452405 (0.0011) [2023-12-27 22:29:26,791][106226] Updated weights for policy 0, policy_version 452415 (0.0010) [2023-12-27 22:29:27,337][106225] Updated weights for policy 1, policy_version 453784 (0.0005) [2023-12-27 22:29:27,396][106225] Updated weights for policy 1, policy_version 453794 (0.0009) [2023-12-27 22:29:27,450][106225] Updated weights for policy 1, policy_version 453804 (0.0008) [2023-12-27 22:29:27,479][106226] Updated weights for policy 0, policy_version 452425 (0.0010) [2023-12-27 22:29:27,541][106226] Updated weights for policy 0, policy_version 452435 (0.0010) [2023-12-27 22:29:27,603][106226] Updated weights for policy 0, policy_version 452445 (0.0010) [2023-12-27 22:29:27,669][106226] Updated weights for policy 0, policy_version 452455 (0.0010) [2023-12-27 22:29:27,973][106225] Updated weights for policy 1, policy_version 453814 (0.0005) [2023-12-27 22:29:28,028][106225] Updated weights for policy 1, policy_version 453824 (0.0005) [2023-12-27 22:29:28,073][106225] Updated weights for policy 1, policy_version 453834 (0.0005) [2023-12-27 22:29:28,379][106226] Updated weights for policy 0, policy_version 452466 (0.0008) [2023-12-27 22:29:28,440][106226] Updated weights for policy 0, policy_version 452476 (0.0008) [2023-12-27 22:29:28,504][106226] Updated weights for policy 0, policy_version 452486 (0.0009) [2023-12-27 22:29:28,644][106225] Updated weights for policy 1, policy_version 453844 (0.0007) [2023-12-27 22:29:28,705][106225] Updated weights for policy 1, policy_version 453854 (0.0010) [2023-12-27 22:29:28,761][106225] Updated weights for policy 1, policy_version 453864 (0.0011) [2023-12-27 22:29:29,241][106226] Updated weights for policy 0, policy_version 452496 (0.0008) [2023-12-27 22:29:29,307][106226] Updated weights for policy 0, policy_version 452506 (0.0008) [2023-12-27 22:29:29,379][106226] Updated weights for policy 0, policy_version 452516 (0.0007) [2023-12-27 22:29:29,458][106225] Updated weights for policy 1, policy_version 453874 (0.0008) [2023-12-27 22:29:29,519][106225] Updated weights for policy 1, policy_version 453884 (0.0009) [2023-12-27 22:29:29,573][106225] Updated weights for policy 1, policy_version 453894 (0.0010) [2023-12-27 22:29:29,628][106225] Updated weights for policy 1, policy_version 453904 (0.0010) [2023-12-27 22:29:30,127][106226] Updated weights for policy 0, policy_version 452526 (0.0008) [2023-12-27 22:29:30,190][106226] Updated weights for policy 0, policy_version 452536 (0.0008) [2023-12-27 22:29:30,252][106226] Updated weights for policy 0, policy_version 452546 (0.0008) [2023-12-27 22:29:30,359][106225] Updated weights for policy 1, policy_version 453914 (0.0010) [2023-12-27 22:29:30,418][106225] Updated weights for policy 1, policy_version 453924 (0.0010) [2023-12-27 22:29:30,475][106225] Updated weights for policy 1, policy_version 453934 (0.0010) [2023-12-27 22:29:30,965][106226] Updated weights for policy 0, policy_version 452556 (0.0008) [2023-12-27 22:29:31,038][106226] Updated weights for policy 0, policy_version 452566 (0.0008) [2023-12-27 22:29:31,103][106226] Updated weights for policy 0, policy_version 452576 (0.0008) [2023-12-27 22:29:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 232128512. Throughput: 0: 9784.5, 1: 10015.2. Samples: 232117564. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:31,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-5.496')] [2023-12-27 22:29:31,192][106225] Updated weights for policy 1, policy_version 453944 (0.0010) [2023-12-27 22:29:31,257][106225] Updated weights for policy 1, policy_version 453954 (0.0010) [2023-12-27 22:29:31,315][106225] Updated weights for policy 1, policy_version 453964 (0.0010) [2023-12-27 22:29:31,874][106226] Updated weights for policy 0, policy_version 452586 (0.0008) [2023-12-27 22:29:31,931][106226] Updated weights for policy 0, policy_version 452596 (0.0008) [2023-12-27 22:29:31,986][106226] Updated weights for policy 0, policy_version 452606 (0.0008) [2023-12-27 22:29:32,050][106226] Updated weights for policy 0, policy_version 452616 (0.0007) [2023-12-27 22:29:32,063][106225] Updated weights for policy 1, policy_version 453974 (0.0010) [2023-12-27 22:29:32,124][106225] Updated weights for policy 1, policy_version 453984 (0.0010) [2023-12-27 22:29:32,188][106225] Updated weights for policy 1, policy_version 453994 (0.0010) [2023-12-27 22:29:32,790][106226] Updated weights for policy 0, policy_version 452626 (0.0011) [2023-12-27 22:29:32,850][106226] Updated weights for policy 0, policy_version 452636 (0.0011) [2023-12-27 22:29:32,911][106226] Updated weights for policy 0, policy_version 452646 (0.0010) [2023-12-27 22:29:32,940][106225] Updated weights for policy 1, policy_version 454004 (0.0010) [2023-12-27 22:29:32,992][106225] Updated weights for policy 1, policy_version 454014 (0.0010) [2023-12-27 22:29:33,042][106225] Updated weights for policy 1, policy_version 454024 (0.0010) [2023-12-27 22:29:33,570][106226] Updated weights for policy 0, policy_version 452656 (0.0006) [2023-12-27 22:29:33,633][106226] Updated weights for policy 0, policy_version 452666 (0.0005) [2023-12-27 22:29:33,693][106226] Updated weights for policy 0, policy_version 452676 (0.0009) [2023-12-27 22:29:33,796][106225] Updated weights for policy 1, policy_version 454034 (0.0010) [2023-12-27 22:29:33,857][106225] Updated weights for policy 1, policy_version 454044 (0.0006) [2023-12-27 22:29:33,914][106225] Updated weights for policy 1, policy_version 454054 (0.0007) [2023-12-27 22:29:33,970][106225] Updated weights for policy 1, policy_version 454064 (0.0008) [2023-12-27 22:29:34,379][106226] Updated weights for policy 0, policy_version 452686 (0.0009) [2023-12-27 22:29:34,445][106226] Updated weights for policy 0, policy_version 452696 (0.0011) [2023-12-27 22:29:34,507][106226] Updated weights for policy 0, policy_version 452706 (0.0011) [2023-12-27 22:29:34,702][106225] Updated weights for policy 1, policy_version 454074 (0.0009) [2023-12-27 22:29:34,759][106225] Updated weights for policy 1, policy_version 454084 (0.0008) [2023-12-27 22:29:34,829][106225] Updated weights for policy 1, policy_version 454094 (0.0008) [2023-12-27 22:29:35,219][106226] Updated weights for policy 0, policy_version 452716 (0.0011) [2023-12-27 22:29:35,270][106226] Updated weights for policy 0, policy_version 452726 (0.0010) [2023-12-27 22:29:35,321][106226] Updated weights for policy 0, policy_version 452736 (0.0011) [2023-12-27 22:29:35,594][106225] Updated weights for policy 1, policy_version 454104 (0.0008) [2023-12-27 22:29:35,648][106225] Updated weights for policy 1, policy_version 454114 (0.0008) [2023-12-27 22:29:35,695][106225] Updated weights for policy 1, policy_version 454124 (0.0008) [2023-12-27 22:29:36,062][106226] Updated weights for policy 0, policy_version 452746 (0.0010) [2023-12-27 22:29:36,130][106226] Updated weights for policy 0, policy_version 452756 (0.0009) [2023-12-27 22:29:36,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 232218624. Throughput: 0: 9719.5, 1: 9969.8. Samples: 232232032. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:36,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-5.227')] [2023-12-27 22:29:36,209][106226] Updated weights for policy 0, policy_version 452766 (0.0009) [2023-12-27 22:29:36,274][106226] Updated weights for policy 0, policy_version 452776 (0.0009) [2023-12-27 22:29:36,330][106225] Updated weights for policy 1, policy_version 454134 (0.0009) [2023-12-27 22:29:36,394][106225] Updated weights for policy 1, policy_version 454144 (0.0009) [2023-12-27 22:29:36,453][106225] Updated weights for policy 1, policy_version 454154 (0.0008) [2023-12-27 22:29:37,007][106226] Updated weights for policy 0, policy_version 452786 (0.0009) [2023-12-27 22:29:37,071][106226] Updated weights for policy 0, policy_version 452796 (0.0011) [2023-12-27 22:29:37,098][106225] Updated weights for policy 1, policy_version 454164 (0.0009) [2023-12-27 22:29:37,135][106226] Updated weights for policy 0, policy_version 452806 (0.0009) [2023-12-27 22:29:37,157][106225] Updated weights for policy 1, policy_version 454174 (0.0008) [2023-12-27 22:29:37,216][106225] Updated weights for policy 1, policy_version 454184 (0.0009) [2023-12-27 22:29:37,781][106226] Updated weights for policy 0, policy_version 452816 (0.0008) [2023-12-27 22:29:37,846][106226] Updated weights for policy 0, policy_version 452826 (0.0008) [2023-12-27 22:29:37,920][106226] Updated weights for policy 0, policy_version 452836 (0.0009) [2023-12-27 22:29:37,963][106225] Updated weights for policy 1, policy_version 454194 (0.0009) [2023-12-27 22:29:38,020][106225] Updated weights for policy 1, policy_version 454204 (0.0010) [2023-12-27 22:29:38,071][106225] Updated weights for policy 1, policy_version 454214 (0.0010) [2023-12-27 22:29:38,128][106225] Updated weights for policy 1, policy_version 454224 (0.0010) [2023-12-27 22:29:38,603][106226] Updated weights for policy 0, policy_version 452846 (0.0009) [2023-12-27 22:29:38,670][106226] Updated weights for policy 0, policy_version 452856 (0.0007) [2023-12-27 22:29:38,734][106226] Updated weights for policy 0, policy_version 452866 (0.0007) [2023-12-27 22:29:38,776][106225] Updated weights for policy 1, policy_version 454234 (0.0009) [2023-12-27 22:29:38,844][106225] Updated weights for policy 1, policy_version 454244 (0.0011) [2023-12-27 22:29:38,909][106225] Updated weights for policy 1, policy_version 454254 (0.0011) [2023-12-27 22:29:39,450][106226] Updated weights for policy 0, policy_version 452876 (0.0007) [2023-12-27 22:29:39,519][106226] Updated weights for policy 0, policy_version 452886 (0.0008) [2023-12-27 22:29:39,582][106226] Updated weights for policy 0, policy_version 452896 (0.0008) [2023-12-27 22:29:39,762][106225] Updated weights for policy 1, policy_version 454264 (0.0011) [2023-12-27 22:29:39,823][106225] Updated weights for policy 1, policy_version 454274 (0.0010) [2023-12-27 22:29:39,877][106225] Updated weights for policy 1, policy_version 454284 (0.0008) [2023-12-27 22:29:40,296][106226] Updated weights for policy 0, policy_version 452906 (0.0007) [2023-12-27 22:29:40,359][106226] Updated weights for policy 0, policy_version 452916 (0.0008) [2023-12-27 22:29:40,415][106226] Updated weights for policy 0, policy_version 452926 (0.0008) [2023-12-27 22:29:40,479][106226] Updated weights for policy 0, policy_version 452936 (0.0008) [2023-12-27 22:29:40,615][106225] Updated weights for policy 1, policy_version 454294 (0.0009) [2023-12-27 22:29:40,672][106225] Updated weights for policy 1, policy_version 454304 (0.0010) [2023-12-27 22:29:40,719][106225] Updated weights for policy 1, policy_version 454314 (0.0010) [2023-12-27 22:29:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 232316928. Throughput: 0: 9704.7, 1: 10023.7. Samples: 232292532. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:41,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-5.160')] [2023-12-27 22:29:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000454320_116334592.pth... [2023-12-27 22:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000453168_116039680.pth [2023-12-27 22:29:41,220][106226] Updated weights for policy 0, policy_version 452946 (0.0008) [2023-12-27 22:29:41,289][106226] Updated weights for policy 0, policy_version 452956 (0.0008) [2023-12-27 22:29:41,354][106226] Updated weights for policy 0, policy_version 452966 (0.0009) [2023-12-27 22:29:41,368][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000452968_115990528.pth... [2023-12-27 22:29:41,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000451816_115695616.pth [2023-12-27 22:29:41,481][106225] Updated weights for policy 1, policy_version 454324 (0.0009) [2023-12-27 22:29:41,536][106225] Updated weights for policy 1, policy_version 454334 (0.0008) [2023-12-27 22:29:41,600][106225] Updated weights for policy 1, policy_version 454344 (0.0008) [2023-12-27 22:29:42,093][106226] Updated weights for policy 0, policy_version 452976 (0.0007) [2023-12-27 22:29:42,160][106226] Updated weights for policy 0, policy_version 452986 (0.0008) [2023-12-27 22:29:42,222][106226] Updated weights for policy 0, policy_version 452996 (0.0008) [2023-12-27 22:29:42,358][106225] Updated weights for policy 1, policy_version 454354 (0.0009) [2023-12-27 22:29:42,433][106225] Updated weights for policy 1, policy_version 454364 (0.0009) [2023-12-27 22:29:42,492][106225] Updated weights for policy 1, policy_version 454374 (0.0008) [2023-12-27 22:29:42,552][106225] Updated weights for policy 1, policy_version 454384 (0.0008) [2023-12-27 22:29:42,882][106226] Updated weights for policy 0, policy_version 453006 (0.0008) [2023-12-27 22:29:42,943][106226] Updated weights for policy 0, policy_version 453016 (0.0009) [2023-12-27 22:29:43,004][106226] Updated weights for policy 0, policy_version 453026 (0.0009) [2023-12-27 22:29:43,328][106225] Updated weights for policy 1, policy_version 454394 (0.0009) [2023-12-27 22:29:43,389][106225] Updated weights for policy 1, policy_version 454404 (0.0008) [2023-12-27 22:29:43,448][106225] Updated weights for policy 1, policy_version 454414 (0.0009) [2023-12-27 22:29:43,640][106226] Updated weights for policy 0, policy_version 453036 (0.0008) [2023-12-27 22:29:43,704][106226] Updated weights for policy 0, policy_version 453046 (0.0008) [2023-12-27 22:29:43,771][106226] Updated weights for policy 0, policy_version 453056 (0.0009) [2023-12-27 22:29:44,189][106225] Updated weights for policy 1, policy_version 454424 (0.0008) [2023-12-27 22:29:44,255][106225] Updated weights for policy 1, policy_version 454434 (0.0009) [2023-12-27 22:29:44,320][106225] Updated weights for policy 1, policy_version 454444 (0.0008) [2023-12-27 22:29:44,430][106226] Updated weights for policy 0, policy_version 453066 (0.0008) [2023-12-27 22:29:44,479][106226] Updated weights for policy 0, policy_version 453076 (0.0009) [2023-12-27 22:29:44,542][106226] Updated weights for policy 0, policy_version 453086 (0.0008) [2023-12-27 22:29:44,608][106226] Updated weights for policy 0, policy_version 453096 (0.0009) [2023-12-27 22:29:45,132][106225] Updated weights for policy 1, policy_version 454454 (0.0008) [2023-12-27 22:29:45,196][106225] Updated weights for policy 1, policy_version 454464 (0.0009) [2023-12-27 22:29:45,276][106225] Updated weights for policy 1, policy_version 454474 (0.0008) [2023-12-27 22:29:45,415][106226] Updated weights for policy 0, policy_version 453106 (0.0009) [2023-12-27 22:29:45,490][106226] Updated weights for policy 0, policy_version 453116 (0.0008) [2023-12-27 22:29:45,556][106226] Updated weights for policy 0, policy_version 453126 (0.0009) [2023-12-27 22:29:46,018][106225] Updated weights for policy 1, policy_version 454484 (0.0009) [2023-12-27 22:29:46,080][106225] Updated weights for policy 1, policy_version 454494 (0.0008) [2023-12-27 22:29:46,139][106225] Updated weights for policy 1, policy_version 454504 (0.0008) [2023-12-27 22:29:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19494.2). Total num frames: 232407040. Throughput: 0: 9697.7, 1: 9788.6. Samples: 232404728. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:46,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.371')] [2023-12-27 22:29:46,190][106226] Updated weights for policy 0, policy_version 453136 (0.0007) [2023-12-27 22:29:46,236][106226] Updated weights for policy 0, policy_version 453146 (0.0009) [2023-12-27 22:29:46,279][106226] Updated weights for policy 0, policy_version 453156 (0.0008) [2023-12-27 22:29:46,845][106225] Updated weights for policy 1, policy_version 454514 (0.0009) [2023-12-27 22:29:46,897][106225] Updated weights for policy 1, policy_version 454524 (0.0008) [2023-12-27 22:29:46,942][106225] Updated weights for policy 1, policy_version 454534 (0.0008) [2023-12-27 22:29:46,995][106225] Updated weights for policy 1, policy_version 454544 (0.0008) [2023-12-27 22:29:47,040][106226] Updated weights for policy 0, policy_version 453166 (0.0009) [2023-12-27 22:29:47,085][106226] Updated weights for policy 0, policy_version 453176 (0.0008) [2023-12-27 22:29:47,137][106226] Updated weights for policy 0, policy_version 453186 (0.0008) [2023-12-27 22:29:47,755][106225] Updated weights for policy 1, policy_version 454554 (0.0009) [2023-12-27 22:29:47,811][106225] Updated weights for policy 1, policy_version 454564 (0.0009) [2023-12-27 22:29:47,845][106226] Updated weights for policy 0, policy_version 453196 (0.0008) [2023-12-27 22:29:47,866][106225] Updated weights for policy 1, policy_version 454574 (0.0006) [2023-12-27 22:29:47,897][106226] Updated weights for policy 0, policy_version 453206 (0.0007) [2023-12-27 22:29:47,947][106226] Updated weights for policy 0, policy_version 453216 (0.0009) [2023-12-27 22:29:48,543][106225] Updated weights for policy 1, policy_version 454584 (0.0006) [2023-12-27 22:29:48,610][106225] Updated weights for policy 1, policy_version 454594 (0.0007) [2023-12-27 22:29:48,674][106225] Updated weights for policy 1, policy_version 454604 (0.0007) [2023-12-27 22:29:48,772][106226] Updated weights for policy 0, policy_version 453226 (0.0009) [2023-12-27 22:29:48,832][106226] Updated weights for policy 0, policy_version 453236 (0.0009) [2023-12-27 22:29:48,900][106226] Updated weights for policy 0, policy_version 453246 (0.0008) [2023-12-27 22:29:48,952][106226] Updated weights for policy 0, policy_version 453256 (0.0009) [2023-12-27 22:29:49,331][106225] Updated weights for policy 1, policy_version 454614 (0.0007) [2023-12-27 22:29:49,398][106225] Updated weights for policy 1, policy_version 454624 (0.0007) [2023-12-27 22:29:49,458][106225] Updated weights for policy 1, policy_version 454634 (0.0007) [2023-12-27 22:29:49,739][106226] Updated weights for policy 0, policy_version 453266 (0.0009) [2023-12-27 22:29:49,803][106226] Updated weights for policy 0, policy_version 453276 (0.0009) [2023-12-27 22:29:49,873][106226] Updated weights for policy 0, policy_version 453286 (0.0008) [2023-12-27 22:29:50,206][106225] Updated weights for policy 1, policy_version 454644 (0.0009) [2023-12-27 22:29:50,271][106225] Updated weights for policy 1, policy_version 454654 (0.0011) [2023-12-27 22:29:50,328][106225] Updated weights for policy 1, policy_version 454664 (0.0010) [2023-12-27 22:29:50,602][106226] Updated weights for policy 0, policy_version 453296 (0.0008) [2023-12-27 22:29:50,667][106226] Updated weights for policy 0, policy_version 453306 (0.0009) [2023-12-27 22:29:50,725][106226] Updated weights for policy 0, policy_version 453316 (0.0009) [2023-12-27 22:29:51,091][106225] Updated weights for policy 1, policy_version 454674 (0.0011) [2023-12-27 22:29:51,164][106225] Updated weights for policy 1, policy_version 454684 (0.0010) [2023-12-27 22:29:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 232505344. Throughput: 0: 9615.4, 1: 9698.2. Samples: 232518876. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:51,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.553')] [2023-12-27 22:29:51,232][106225] Updated weights for policy 1, policy_version 454694 (0.0010) [2023-12-27 22:29:51,303][106225] Updated weights for policy 1, policy_version 454704 (0.0010) [2023-12-27 22:29:51,384][106226] Updated weights for policy 0, policy_version 453326 (0.0009) [2023-12-27 22:29:51,451][106226] Updated weights for policy 0, policy_version 453336 (0.0007) [2023-12-27 22:29:51,518][106226] Updated weights for policy 0, policy_version 453346 (0.0006) [2023-12-27 22:29:52,046][106225] Updated weights for policy 1, policy_version 454714 (0.0009) [2023-12-27 22:29:52,096][106225] Updated weights for policy 1, policy_version 454724 (0.0008) [2023-12-27 22:29:52,132][106226] Updated weights for policy 0, policy_version 453356 (0.0007) [2023-12-27 22:29:52,154][106225] Updated weights for policy 1, policy_version 454734 (0.0008) [2023-12-27 22:29:52,193][106226] Updated weights for policy 0, policy_version 453366 (0.0007) [2023-12-27 22:29:52,257][106226] Updated weights for policy 0, policy_version 453376 (0.0007) [2023-12-27 22:29:52,941][106225] Updated weights for policy 1, policy_version 454744 (0.0008) [2023-12-27 22:29:52,967][106226] Updated weights for policy 0, policy_version 453386 (0.0007) [2023-12-27 22:29:52,992][106225] Updated weights for policy 1, policy_version 454754 (0.0007) [2023-12-27 22:29:53,020][106226] Updated weights for policy 0, policy_version 453396 (0.0007) [2023-12-27 22:29:53,045][106225] Updated weights for policy 1, policy_version 454764 (0.0007) [2023-12-27 22:29:53,074][106226] Updated weights for policy 0, policy_version 453406 (0.0006) [2023-12-27 22:29:53,135][106226] Updated weights for policy 0, policy_version 453416 (0.0009) [2023-12-27 22:29:53,769][106225] Updated weights for policy 1, policy_version 454774 (0.0007) [2023-12-27 22:29:53,836][106225] Updated weights for policy 1, policy_version 454784 (0.0009) [2023-12-27 22:29:53,866][106226] Updated weights for policy 0, policy_version 453426 (0.0005) [2023-12-27 22:29:53,894][106225] Updated weights for policy 1, policy_version 454794 (0.0006) [2023-12-27 22:29:53,932][106226] Updated weights for policy 0, policy_version 453436 (0.0007) [2023-12-27 22:29:53,981][106226] Updated weights for policy 0, policy_version 453446 (0.0009) [2023-12-27 22:29:54,596][106226] Updated weights for policy 0, policy_version 453456 (0.0010) [2023-12-27 22:29:54,618][106225] Updated weights for policy 1, policy_version 454804 (0.0006) [2023-12-27 22:29:54,660][106226] Updated weights for policy 0, policy_version 453466 (0.0011) [2023-12-27 22:29:54,681][106225] Updated weights for policy 1, policy_version 454814 (0.0009) [2023-12-27 22:29:54,711][106226] Updated weights for policy 0, policy_version 453476 (0.0010) [2023-12-27 22:29:54,736][106225] Updated weights for policy 1, policy_version 454824 (0.0006) [2023-12-27 22:29:55,429][106226] Updated weights for policy 0, policy_version 453486 (0.0010) [2023-12-27 22:29:55,469][106225] Updated weights for policy 1, policy_version 454834 (0.0007) [2023-12-27 22:29:55,485][106226] Updated weights for policy 0, policy_version 453496 (0.0008) [2023-12-27 22:29:55,529][106225] Updated weights for policy 1, policy_version 454844 (0.0008) [2023-12-27 22:29:55,537][106226] Updated weights for policy 0, policy_version 453506 (0.0006) [2023-12-27 22:29:55,580][106225] Updated weights for policy 1, policy_version 454854 (0.0009) [2023-12-27 22:29:55,636][106225] Updated weights for policy 1, policy_version 454864 (0.0008) [2023-12-27 22:29:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19494.2). Total num frames: 232603648. Throughput: 0: 9662.9, 1: 9646.3. Samples: 232576228. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:29:56,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-5.374')] [2023-12-27 22:29:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000453512_116129792.pth... [2023-12-27 22:29:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000454864_116473856.pth... [2023-12-27 22:29:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000452392_115843072.pth [2023-12-27 22:29:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000453744_116187136.pth [2023-12-27 22:29:56,253][106226] Updated weights for policy 0, policy_version 453516 (0.0010) [2023-12-27 22:29:56,307][106226] Updated weights for policy 0, policy_version 453526 (0.0008) [2023-12-27 22:29:56,363][106226] Updated weights for policy 0, policy_version 453536 (0.0007) [2023-12-27 22:29:56,375][106225] Updated weights for policy 1, policy_version 454874 (0.0008) [2023-12-27 22:29:56,436][106225] Updated weights for policy 1, policy_version 454884 (0.0007) [2023-12-27 22:29:56,485][106225] Updated weights for policy 1, policy_version 454894 (0.0008) [2023-12-27 22:29:57,039][106226] Updated weights for policy 0, policy_version 453546 (0.0007) [2023-12-27 22:29:57,102][106226] Updated weights for policy 0, policy_version 453556 (0.0007) [2023-12-27 22:29:57,113][106225] Updated weights for policy 1, policy_version 454904 (0.0006) [2023-12-27 22:29:57,159][106226] Updated weights for policy 0, policy_version 453566 (0.0008) [2023-12-27 22:29:57,162][106225] Updated weights for policy 1, policy_version 454914 (0.0005) [2023-12-27 22:29:57,212][106225] Updated weights for policy 1, policy_version 454924 (0.0006) [2023-12-27 22:29:57,215][106226] Updated weights for policy 0, policy_version 453576 (0.0007) [2023-12-27 22:29:57,825][106225] Updated weights for policy 1, policy_version 454934 (0.0006) [2023-12-27 22:29:57,882][106225] Updated weights for policy 1, policy_version 454944 (0.0005) [2023-12-27 22:29:57,896][106226] Updated weights for policy 0, policy_version 453586 (0.0008) [2023-12-27 22:29:57,934][106225] Updated weights for policy 1, policy_version 454954 (0.0005) [2023-12-27 22:29:57,944][106226] Updated weights for policy 0, policy_version 453596 (0.0007) [2023-12-27 22:29:57,998][106226] Updated weights for policy 0, policy_version 453606 (0.0008) [2023-12-27 22:29:58,602][106225] Updated weights for policy 1, policy_version 454964 (0.0006) [2023-12-27 22:29:58,663][106225] Updated weights for policy 1, policy_version 454974 (0.0008) [2023-12-27 22:29:58,727][106225] Updated weights for policy 1, policy_version 454984 (0.0008) [2023-12-27 22:29:58,983][106226] Updated weights for policy 0, policy_version 453616 (0.0010) [2023-12-27 22:29:59,055][106226] Updated weights for policy 0, policy_version 453626 (0.0011) [2023-12-27 22:29:59,120][106226] Updated weights for policy 0, policy_version 453636 (0.0011) [2023-12-27 22:29:59,570][106225] Updated weights for policy 1, policy_version 454994 (0.0008) [2023-12-27 22:29:59,632][106225] Updated weights for policy 1, policy_version 455004 (0.0009) [2023-12-27 22:29:59,682][106225] Updated weights for policy 1, policy_version 455014 (0.0010) [2023-12-27 22:29:59,734][106225] Updated weights for policy 1, policy_version 455024 (0.0010) [2023-12-27 22:29:59,811][106226] Updated weights for policy 0, policy_version 453646 (0.0008) [2023-12-27 22:29:59,886][106226] Updated weights for policy 0, policy_version 453656 (0.0009) [2023-12-27 22:29:59,950][106226] Updated weights for policy 0, policy_version 453666 (0.0009) [2023-12-27 22:30:00,522][106225] Updated weights for policy 1, policy_version 455034 (0.0010) [2023-12-27 22:30:00,579][106225] Updated weights for policy 1, policy_version 455044 (0.0010) [2023-12-27 22:30:00,637][106225] Updated weights for policy 1, policy_version 455054 (0.0010) [2023-12-27 22:30:00,704][106226] Updated weights for policy 0, policy_version 453676 (0.0008) [2023-12-27 22:30:00,766][106226] Updated weights for policy 0, policy_version 453686 (0.0007) [2023-12-27 22:30:00,822][106226] Updated weights for policy 0, policy_version 453696 (0.0009) [2023-12-27 22:30:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 232701952. Throughput: 0: 9620.5, 1: 9762.2. Samples: 232692856. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:30:01,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-5.445')] [2023-12-27 22:30:01,321][106225] Updated weights for policy 1, policy_version 455064 (0.0007) [2023-12-27 22:30:01,392][106225] Updated weights for policy 1, policy_version 455074 (0.0006) [2023-12-27 22:30:01,451][106225] Updated weights for policy 1, policy_version 455084 (0.0009) [2023-12-27 22:30:01,571][106226] Updated weights for policy 0, policy_version 453706 (0.0009) [2023-12-27 22:30:01,641][106226] Updated weights for policy 0, policy_version 453716 (0.0009) [2023-12-27 22:30:01,701][106226] Updated weights for policy 0, policy_version 453726 (0.0008) [2023-12-27 22:30:01,778][106226] Updated weights for policy 0, policy_version 453736 (0.0007) [2023-12-27 22:30:02,078][106225] Updated weights for policy 1, policy_version 455094 (0.0009) [2023-12-27 22:30:02,127][106225] Updated weights for policy 1, policy_version 455104 (0.0008) [2023-12-27 22:30:02,183][106225] Updated weights for policy 1, policy_version 455114 (0.0008) [2023-12-27 22:30:02,499][106226] Updated weights for policy 0, policy_version 453746 (0.0005) [2023-12-27 22:30:02,561][106226] Updated weights for policy 0, policy_version 453756 (0.0005) [2023-12-27 22:30:02,627][106226] Updated weights for policy 0, policy_version 453766 (0.0007) [2023-12-27 22:30:02,955][106225] Updated weights for policy 1, policy_version 455124 (0.0009) [2023-12-27 22:30:03,018][106225] Updated weights for policy 1, policy_version 455134 (0.0010) [2023-12-27 22:30:03,080][106225] Updated weights for policy 1, policy_version 455144 (0.0009) [2023-12-27 22:30:03,222][106226] Updated weights for policy 0, policy_version 453776 (0.0006) [2023-12-27 22:30:03,283][106226] Updated weights for policy 0, policy_version 453786 (0.0008) [2023-12-27 22:30:03,341][106226] Updated weights for policy 0, policy_version 453796 (0.0008) [2023-12-27 22:30:03,814][106225] Updated weights for policy 1, policy_version 455154 (0.0008) [2023-12-27 22:30:03,877][106225] Updated weights for policy 1, policy_version 455164 (0.0008) [2023-12-27 22:30:03,935][106225] Updated weights for policy 1, policy_version 455174 (0.0010) [2023-12-27 22:30:04,002][106225] Updated weights for policy 1, policy_version 455184 (0.0008) [2023-12-27 22:30:04,036][106226] Updated weights for policy 0, policy_version 453806 (0.0008) [2023-12-27 22:30:04,098][106226] Updated weights for policy 0, policy_version 453816 (0.0008) [2023-12-27 22:30:04,165][106226] Updated weights for policy 0, policy_version 453826 (0.0009) [2023-12-27 22:30:04,596][106225] Updated weights for policy 1, policy_version 455194 (0.0006) [2023-12-27 22:30:04,645][106225] Updated weights for policy 1, policy_version 455204 (0.0007) [2023-12-27 22:30:04,690][106225] Updated weights for policy 1, policy_version 455214 (0.0005) [2023-12-27 22:30:04,931][106226] Updated weights for policy 0, policy_version 453836 (0.0008) [2023-12-27 22:30:04,982][106226] Updated weights for policy 0, policy_version 453846 (0.0008) [2023-12-27 22:30:05,039][106226] Updated weights for policy 0, policy_version 453856 (0.0008) [2023-12-27 22:30:05,362][106225] Updated weights for policy 1, policy_version 455224 (0.0010) [2023-12-27 22:30:05,418][106225] Updated weights for policy 1, policy_version 455234 (0.0010) [2023-12-27 22:30:05,473][106225] Updated weights for policy 1, policy_version 455244 (0.0010) [2023-12-27 22:30:05,755][106226] Updated weights for policy 0, policy_version 453866 (0.0008) [2023-12-27 22:30:05,810][106226] Updated weights for policy 0, policy_version 453876 (0.0008) [2023-12-27 22:30:05,871][106226] Updated weights for policy 0, policy_version 453886 (0.0007) [2023-12-27 22:30:05,925][106226] Updated weights for policy 0, policy_version 453896 (0.0008) [2023-12-27 22:30:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 232800256. Throughput: 0: 9599.5, 1: 9813.8. Samples: 232810628. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:30:06,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-5.624')] [2023-12-27 22:30:06,181][106225] Updated weights for policy 1, policy_version 455254 (0.0008) [2023-12-27 22:30:06,241][106225] Updated weights for policy 1, policy_version 455264 (0.0008) [2023-12-27 22:30:06,296][106225] Updated weights for policy 1, policy_version 455274 (0.0010) [2023-12-27 22:30:06,668][106226] Updated weights for policy 0, policy_version 453906 (0.0008) [2023-12-27 22:30:06,726][106226] Updated weights for policy 0, policy_version 453916 (0.0008) [2023-12-27 22:30:06,786][106226] Updated weights for policy 0, policy_version 453926 (0.0007) [2023-12-27 22:30:07,002][106225] Updated weights for policy 1, policy_version 455284 (0.0010) [2023-12-27 22:30:07,057][106225] Updated weights for policy 1, policy_version 455294 (0.0011) [2023-12-27 22:30:07,110][106225] Updated weights for policy 1, policy_version 455304 (0.0011) [2023-12-27 22:30:07,540][106226] Updated weights for policy 0, policy_version 453936 (0.0008) [2023-12-27 22:30:07,591][106226] Updated weights for policy 0, policy_version 453946 (0.0008) [2023-12-27 22:30:07,652][106226] Updated weights for policy 0, policy_version 453956 (0.0009) [2023-12-27 22:30:07,782][106225] Updated weights for policy 1, policy_version 455314 (0.0010) [2023-12-27 22:30:07,833][106225] Updated weights for policy 1, policy_version 455324 (0.0007) [2023-12-27 22:30:07,879][106225] Updated weights for policy 1, policy_version 455334 (0.0008) [2023-12-27 22:30:07,924][106225] Updated weights for policy 1, policy_version 455344 (0.0007) [2023-12-27 22:30:08,303][106226] Updated weights for policy 0, policy_version 453966 (0.0007) [2023-12-27 22:30:08,376][106226] Updated weights for policy 0, policy_version 453976 (0.0008) [2023-12-27 22:30:08,440][106226] Updated weights for policy 0, policy_version 453986 (0.0006) [2023-12-27 22:30:08,726][106225] Updated weights for policy 1, policy_version 455354 (0.0006) [2023-12-27 22:30:08,792][106225] Updated weights for policy 1, policy_version 455364 (0.0006) [2023-12-27 22:30:08,856][106225] Updated weights for policy 1, policy_version 455374 (0.0008) [2023-12-27 22:30:09,099][106226] Updated weights for policy 0, policy_version 453996 (0.0005) [2023-12-27 22:30:09,157][106226] Updated weights for policy 0, policy_version 454007 (0.0006) [2023-12-27 22:30:09,206][106226] Updated weights for policy 0, policy_version 454017 (0.0010) [2023-12-27 22:30:09,568][106225] Updated weights for policy 1, policy_version 455384 (0.0006) [2023-12-27 22:30:09,631][106225] Updated weights for policy 1, policy_version 455394 (0.0007) [2023-12-27 22:30:09,701][106225] Updated weights for policy 1, policy_version 455404 (0.0007) [2023-12-27 22:30:09,991][106226] Updated weights for policy 0, policy_version 454027 (0.0010) [2023-12-27 22:30:10,061][106226] Updated weights for policy 0, policy_version 454037 (0.0008) [2023-12-27 22:30:10,120][106226] Updated weights for policy 0, policy_version 454047 (0.0008) [2023-12-27 22:30:10,390][106225] Updated weights for policy 1, policy_version 455414 (0.0008) [2023-12-27 22:30:10,449][106225] Updated weights for policy 1, policy_version 455424 (0.0007) [2023-12-27 22:30:10,513][106225] Updated weights for policy 1, policy_version 455434 (0.0009) [2023-12-27 22:30:10,792][106226] Updated weights for policy 0, policy_version 454057 (0.0009) [2023-12-27 22:30:10,844][106226] Updated weights for policy 0, policy_version 454067 (0.0009) [2023-12-27 22:30:10,905][106226] Updated weights for policy 0, policy_version 454077 (0.0010) [2023-12-27 22:30:10,970][106226] Updated weights for policy 0, policy_version 454087 (0.0011) [2023-12-27 22:30:11,176][105115] Fps is (10 sec: 19658.3, 60 sec: 19387.4, 300 sec: 19494.1). Total num frames: 232898560. Throughput: 0: 9655.8, 1: 9799.3. Samples: 232869940. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:30:11,177][105115] Avg episode reward: [(0, '-4.734'), (1, '-5.594')] [2023-12-27 22:30:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000455440_116621312.pth... [2023-12-27 22:30:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000454088_116277248.pth... [2023-12-27 22:30:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000454320_116334592.pth [2023-12-27 22:30:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000452968_115990528.pth [2023-12-27 22:30:11,265][106225] Updated weights for policy 1, policy_version 455444 (0.0008) [2023-12-27 22:30:11,339][106225] Updated weights for policy 1, policy_version 455454 (0.0009) [2023-12-27 22:30:11,417][106225] Updated weights for policy 1, policy_version 455464 (0.0008) [2023-12-27 22:30:11,719][106226] Updated weights for policy 0, policy_version 454097 (0.0008) [2023-12-27 22:30:11,784][106226] Updated weights for policy 0, policy_version 454107 (0.0008) [2023-12-27 22:30:11,844][106226] Updated weights for policy 0, policy_version 454117 (0.0009) [2023-12-27 22:30:12,136][106225] Updated weights for policy 1, policy_version 455474 (0.0007) [2023-12-27 22:30:12,187][106225] Updated weights for policy 1, policy_version 455484 (0.0005) [2023-12-27 22:30:12,248][106225] Updated weights for policy 1, policy_version 455494 (0.0007) [2023-12-27 22:30:12,311][106225] Updated weights for policy 1, policy_version 455504 (0.0007) [2023-12-27 22:30:12,666][106226] Updated weights for policy 0, policy_version 454127 (0.0010) [2023-12-27 22:30:12,736][106226] Updated weights for policy 0, policy_version 454137 (0.0008) [2023-12-27 22:30:12,794][106226] Updated weights for policy 0, policy_version 454147 (0.0009) [2023-12-27 22:30:12,962][106225] Updated weights for policy 1, policy_version 455514 (0.0007) [2023-12-27 22:30:13,019][106225] Updated weights for policy 1, policy_version 455524 (0.0010) [2023-12-27 22:30:13,079][106225] Updated weights for policy 1, policy_version 455534 (0.0010) [2023-12-27 22:30:13,431][106226] Updated weights for policy 0, policy_version 454157 (0.0008) [2023-12-27 22:30:13,496][106226] Updated weights for policy 0, policy_version 454167 (0.0006) [2023-12-27 22:30:13,548][106226] Updated weights for policy 0, policy_version 454177 (0.0005) [2023-12-27 22:30:13,771][106225] Updated weights for policy 1, policy_version 455544 (0.0011) [2023-12-27 22:30:13,832][106225] Updated weights for policy 1, policy_version 455554 (0.0010) [2023-12-27 22:30:13,898][106225] Updated weights for policy 1, policy_version 455564 (0.0011) [2023-12-27 22:30:14,210][106226] Updated weights for policy 0, policy_version 454187 (0.0007) [2023-12-27 22:30:14,274][106226] Updated weights for policy 0, policy_version 454197 (0.0009) [2023-12-27 22:30:14,342][106226] Updated weights for policy 0, policy_version 454207 (0.0011) [2023-12-27 22:30:14,524][106225] Updated weights for policy 1, policy_version 455574 (0.0010) [2023-12-27 22:30:14,581][106225] Updated weights for policy 1, policy_version 455584 (0.0010) [2023-12-27 22:30:14,644][106225] Updated weights for policy 1, policy_version 455594 (0.0010) [2023-12-27 22:30:15,009][106226] Updated weights for policy 0, policy_version 454217 (0.0010) [2023-12-27 22:30:15,073][106226] Updated weights for policy 0, policy_version 454227 (0.0010) [2023-12-27 22:30:15,138][106226] Updated weights for policy 0, policy_version 454237 (0.0008) [2023-12-27 22:30:15,201][106226] Updated weights for policy 0, policy_version 454247 (0.0008) [2023-12-27 22:30:15,353][106225] Updated weights for policy 1, policy_version 455604 (0.0008) [2023-12-27 22:30:15,411][106225] Updated weights for policy 1, policy_version 455614 (0.0006) [2023-12-27 22:30:15,479][106225] Updated weights for policy 1, policy_version 455624 (0.0007) [2023-12-27 22:30:15,999][106226] Updated weights for policy 0, policy_version 454257 (0.0010) [2023-12-27 22:30:16,057][106226] Updated weights for policy 0, policy_version 454267 (0.0011) [2023-12-27 22:30:16,108][106226] Updated weights for policy 0, policy_version 454277 (0.0011) [2023-12-27 22:30:16,110][106225] Updated weights for policy 1, policy_version 455634 (0.0008) [2023-12-27 22:30:16,168][106225] Updated weights for policy 1, policy_version 455644 (0.0005) [2023-12-27 22:30:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 232996864. Throughput: 0: 9652.1, 1: 9656.1. Samples: 232986432. Policy #0 lag: (min: 19.0, avg: 26.8, max: 51.0) [2023-12-27 22:30:16,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-5.481')] [2023-12-27 22:30:16,229][106225] Updated weights for policy 1, policy_version 455654 (0.0005) [2023-12-27 22:30:16,281][106225] Updated weights for policy 1, policy_version 455664 (0.0006) [2023-12-27 22:30:16,825][106226] Updated weights for policy 0, policy_version 454287 (0.0010) [2023-12-27 22:30:16,888][106226] Updated weights for policy 0, policy_version 454297 (0.0006) [2023-12-27 22:30:16,904][106225] Updated weights for policy 1, policy_version 455674 (0.0005) [2023-12-27 22:30:16,953][106226] Updated weights for policy 0, policy_version 454307 (0.0006) [2023-12-27 22:30:16,957][106225] Updated weights for policy 1, policy_version 455684 (0.0005) [2023-12-27 22:30:17,005][106225] Updated weights for policy 1, policy_version 455694 (0.0005) [2023-12-27 22:30:17,509][106226] Updated weights for policy 0, policy_version 454317 (0.0009) [2023-12-27 22:30:17,549][106225] Updated weights for policy 1, policy_version 455704 (0.0009) [2023-12-27 22:30:17,556][106226] Updated weights for policy 0, policy_version 454327 (0.0009) [2023-12-27 22:30:17,603][106226] Updated weights for policy 0, policy_version 454337 (0.0006) [2023-12-27 22:30:17,606][106225] Updated weights for policy 1, policy_version 455714 (0.0010) [2023-12-27 22:30:17,659][106225] Updated weights for policy 1, policy_version 455724 (0.0010) [2023-12-27 22:30:18,345][106225] Updated weights for policy 1, policy_version 455734 (0.0009) [2023-12-27 22:30:18,358][106226] Updated weights for policy 0, policy_version 454347 (0.0006) [2023-12-27 22:30:18,404][106225] Updated weights for policy 1, policy_version 455744 (0.0006) [2023-12-27 22:30:18,422][106226] Updated weights for policy 0, policy_version 454357 (0.0009) [2023-12-27 22:30:18,463][106225] Updated weights for policy 1, policy_version 455754 (0.0006) [2023-12-27 22:30:18,483][106226] Updated weights for policy 0, policy_version 454367 (0.0007) [2023-12-27 22:30:19,047][106225] Updated weights for policy 1, policy_version 455764 (0.0007) [2023-12-27 22:30:19,111][106225] Updated weights for policy 1, policy_version 455774 (0.0005) [2023-12-27 22:30:19,134][106226] Updated weights for policy 0, policy_version 454377 (0.0006) [2023-12-27 22:30:19,174][106225] Updated weights for policy 1, policy_version 455784 (0.0005) [2023-12-27 22:30:19,191][106226] Updated weights for policy 0, policy_version 454387 (0.0006) [2023-12-27 22:30:19,263][106226] Updated weights for policy 0, policy_version 454397 (0.0007) [2023-12-27 22:30:19,320][106226] Updated weights for policy 0, policy_version 454407 (0.0008) [2023-12-27 22:30:19,876][106225] Updated weights for policy 1, policy_version 455794 (0.0010) [2023-12-27 22:30:19,946][106225] Updated weights for policy 1, policy_version 455804 (0.0010) [2023-12-27 22:30:20,015][106225] Updated weights for policy 1, policy_version 455814 (0.0008) [2023-12-27 22:30:20,080][106225] Updated weights for policy 1, policy_version 455824 (0.0010) [2023-12-27 22:30:20,106][106226] Updated weights for policy 0, policy_version 454417 (0.0007) [2023-12-27 22:30:20,173][106226] Updated weights for policy 0, policy_version 454427 (0.0008) [2023-12-27 22:30:20,243][106226] Updated weights for policy 0, policy_version 454437 (0.0008) [2023-12-27 22:30:20,848][106225] Updated weights for policy 1, policy_version 455834 (0.0011) [2023-12-27 22:30:20,913][106225] Updated weights for policy 1, policy_version 455844 (0.0010) [2023-12-27 22:30:20,979][106225] Updated weights for policy 1, policy_version 455854 (0.0010) [2023-12-27 22:30:21,036][106226] Updated weights for policy 0, policy_version 454447 (0.0007) [2023-12-27 22:30:21,108][106226] Updated weights for policy 0, policy_version 454457 (0.0008) [2023-12-27 22:30:21,174][106226] Updated weights for policy 0, policy_version 454467 (0.0008) [2023-12-27 22:30:21,174][105115] Fps is (10 sec: 19663.3, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 233095168. Throughput: 0: 9644.3, 1: 9806.5. Samples: 233107316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:21,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-5.548')] [2023-12-27 22:30:21,779][106225] Updated weights for policy 1, policy_version 455864 (0.0009) [2023-12-27 22:30:21,844][106225] Updated weights for policy 1, policy_version 455874 (0.0008) [2023-12-27 22:30:21,905][106225] Updated weights for policy 1, policy_version 455884 (0.0008) [2023-12-27 22:30:21,991][106226] Updated weights for policy 0, policy_version 454477 (0.0008) [2023-12-27 22:30:22,057][106226] Updated weights for policy 0, policy_version 454487 (0.0008) [2023-12-27 22:30:22,120][106226] Updated weights for policy 0, policy_version 454497 (0.0007) [2023-12-27 22:30:22,605][106225] Updated weights for policy 1, policy_version 455894 (0.0010) [2023-12-27 22:30:22,668][106225] Updated weights for policy 1, policy_version 455904 (0.0010) [2023-12-27 22:30:22,723][106225] Updated weights for policy 1, policy_version 455914 (0.0010) [2023-12-27 22:30:22,795][106226] Updated weights for policy 0, policy_version 454507 (0.0005) [2023-12-27 22:30:22,857][106226] Updated weights for policy 0, policy_version 454517 (0.0006) [2023-12-27 22:30:22,913][106226] Updated weights for policy 0, policy_version 454527 (0.0007) [2023-12-27 22:30:23,415][106225] Updated weights for policy 1, policy_version 455924 (0.0008) [2023-12-27 22:30:23,472][106225] Updated weights for policy 1, policy_version 455934 (0.0008) [2023-12-27 22:30:23,538][106225] Updated weights for policy 1, policy_version 455944 (0.0010) [2023-12-27 22:30:23,641][106226] Updated weights for policy 0, policy_version 454537 (0.0008) [2023-12-27 22:30:23,698][106226] Updated weights for policy 0, policy_version 454547 (0.0009) [2023-12-27 22:30:23,748][106226] Updated weights for policy 0, policy_version 454557 (0.0007) [2023-12-27 22:30:23,806][106226] Updated weights for policy 0, policy_version 454567 (0.0008) [2023-12-27 22:30:24,184][106225] Updated weights for policy 1, policy_version 455954 (0.0009) [2023-12-27 22:30:24,237][106225] Updated weights for policy 1, policy_version 455964 (0.0005) [2023-12-27 22:30:24,299][106225] Updated weights for policy 1, policy_version 455974 (0.0005) [2023-12-27 22:30:24,365][106225] Updated weights for policy 1, policy_version 455984 (0.0006) [2023-12-27 22:30:24,597][106226] Updated weights for policy 0, policy_version 454577 (0.0008) [2023-12-27 22:30:24,649][106226] Updated weights for policy 0, policy_version 454587 (0.0008) [2023-12-27 22:30:24,711][106226] Updated weights for policy 0, policy_version 454597 (0.0009) [2023-12-27 22:30:24,998][106225] Updated weights for policy 1, policy_version 455994 (0.0010) [2023-12-27 22:30:25,060][106225] Updated weights for policy 1, policy_version 456004 (0.0009) [2023-12-27 22:30:25,119][106225] Updated weights for policy 1, policy_version 456014 (0.0009) [2023-12-27 22:30:25,407][106226] Updated weights for policy 0, policy_version 454607 (0.0008) [2023-12-27 22:30:25,455][106226] Updated weights for policy 0, policy_version 454617 (0.0008) [2023-12-27 22:30:25,516][106226] Updated weights for policy 0, policy_version 454627 (0.0009) [2023-12-27 22:30:25,796][106225] Updated weights for policy 1, policy_version 456024 (0.0008) [2023-12-27 22:30:25,856][106225] Updated weights for policy 1, policy_version 456034 (0.0008) [2023-12-27 22:30:25,911][106225] Updated weights for policy 1, policy_version 456044 (0.0009) [2023-12-27 22:30:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19522.0). Total num frames: 233193472. Throughput: 0: 9612.4, 1: 9750.4. Samples: 233163856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:26,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-5.688')] [2023-12-27 22:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000456048_116776960.pth... [2023-12-27 22:30:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000454632_116416512.pth... [2023-12-27 22:30:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000453512_116129792.pth [2023-12-27 22:30:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000454864_116473856.pth [2023-12-27 22:30:26,319][106226] Updated weights for policy 0, policy_version 454637 (0.0009) [2023-12-27 22:30:26,374][106226] Updated weights for policy 0, policy_version 454647 (0.0009) [2023-12-27 22:30:26,427][106226] Updated weights for policy 0, policy_version 454657 (0.0010) [2023-12-27 22:30:26,532][106225] Updated weights for policy 1, policy_version 456054 (0.0008) [2023-12-27 22:30:26,582][106225] Updated weights for policy 1, policy_version 456064 (0.0008) [2023-12-27 22:30:26,635][106225] Updated weights for policy 1, policy_version 456074 (0.0007) [2023-12-27 22:30:27,141][106226] Updated weights for policy 0, policy_version 454667 (0.0007) [2023-12-27 22:30:27,203][106226] Updated weights for policy 0, policy_version 454677 (0.0006) [2023-12-27 22:30:27,264][106226] Updated weights for policy 0, policy_version 454687 (0.0005) [2023-12-27 22:30:27,343][106225] Updated weights for policy 1, policy_version 456084 (0.0007) [2023-12-27 22:30:27,412][106225] Updated weights for policy 1, policy_version 456094 (0.0010) [2023-12-27 22:30:27,478][106225] Updated weights for policy 1, policy_version 456104 (0.0010) [2023-12-27 22:30:27,779][106226] Updated weights for policy 0, policy_version 454697 (0.0007) [2023-12-27 22:30:27,833][106226] Updated weights for policy 0, policy_version 454707 (0.0007) [2023-12-27 22:30:27,896][106226] Updated weights for policy 0, policy_version 454717 (0.0006) [2023-12-27 22:30:27,963][106226] Updated weights for policy 0, policy_version 454727 (0.0005) [2023-12-27 22:30:28,161][106225] Updated weights for policy 1, policy_version 456114 (0.0009) [2023-12-27 22:30:28,220][106225] Updated weights for policy 1, policy_version 456124 (0.0010) [2023-12-27 22:30:28,287][106225] Updated weights for policy 1, policy_version 456134 (0.0010) [2023-12-27 22:30:28,358][106225] Updated weights for policy 1, policy_version 456144 (0.0009) [2023-12-27 22:30:28,609][106226] Updated weights for policy 0, policy_version 454737 (0.0008) [2023-12-27 22:30:28,667][106226] Updated weights for policy 0, policy_version 454747 (0.0007) [2023-12-27 22:30:28,721][106226] Updated weights for policy 0, policy_version 454757 (0.0008) [2023-12-27 22:30:29,047][106225] Updated weights for policy 1, policy_version 456154 (0.0010) [2023-12-27 22:30:29,103][106225] Updated weights for policy 1, policy_version 456164 (0.0010) [2023-12-27 22:30:29,168][106225] Updated weights for policy 1, policy_version 456174 (0.0010) [2023-12-27 22:30:29,486][106226] Updated weights for policy 0, policy_version 454767 (0.0010) [2023-12-27 22:30:29,553][106226] Updated weights for policy 0, policy_version 454777 (0.0010) [2023-12-27 22:30:29,603][106226] Updated weights for policy 0, policy_version 454787 (0.0010) [2023-12-27 22:30:29,890][106225] Updated weights for policy 1, policy_version 456184 (0.0010) [2023-12-27 22:30:29,953][106225] Updated weights for policy 1, policy_version 456194 (0.0011) [2023-12-27 22:30:30,008][106225] Updated weights for policy 1, policy_version 456204 (0.0010) [2023-12-27 22:30:30,363][106226] Updated weights for policy 0, policy_version 454797 (0.0009) [2023-12-27 22:30:30,417][106226] Updated weights for policy 0, policy_version 454807 (0.0008) [2023-12-27 22:30:30,472][106226] Updated weights for policy 0, policy_version 454817 (0.0008) [2023-12-27 22:30:30,740][106225] Updated weights for policy 1, policy_version 456214 (0.0010) [2023-12-27 22:30:30,793][106225] Updated weights for policy 1, policy_version 456224 (0.0010) [2023-12-27 22:30:30,852][106225] Updated weights for policy 1, policy_version 456234 (0.0010) [2023-12-27 22:30:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19521.9). Total num frames: 233291776. Throughput: 0: 9652.1, 1: 9888.1. Samples: 233284036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:31,175][105115] Avg episode reward: [(0, '-4.933'), (1, '-5.351')] [2023-12-27 22:30:31,267][106226] Updated weights for policy 0, policy_version 454827 (0.0008) [2023-12-27 22:30:31,325][106226] Updated weights for policy 0, policy_version 454837 (0.0009) [2023-12-27 22:30:31,393][106226] Updated weights for policy 0, policy_version 454847 (0.0009) [2023-12-27 22:30:31,685][106225] Updated weights for policy 1, policy_version 456244 (0.0008) [2023-12-27 22:30:31,756][106225] Updated weights for policy 1, policy_version 456254 (0.0007) [2023-12-27 22:30:31,822][106225] Updated weights for policy 1, policy_version 456264 (0.0008) [2023-12-27 22:30:32,133][106226] Updated weights for policy 0, policy_version 454857 (0.0009) [2023-12-27 22:30:32,191][106226] Updated weights for policy 0, policy_version 454867 (0.0006) [2023-12-27 22:30:32,263][106226] Updated weights for policy 0, policy_version 454877 (0.0009) [2023-12-27 22:30:32,331][106226] Updated weights for policy 0, policy_version 454887 (0.0010) [2023-12-27 22:30:32,522][106225] Updated weights for policy 1, policy_version 456274 (0.0011) [2023-12-27 22:30:32,592][106225] Updated weights for policy 1, policy_version 456284 (0.0011) [2023-12-27 22:30:32,654][106225] Updated weights for policy 1, policy_version 456294 (0.0011) [2023-12-27 22:30:32,714][106225] Updated weights for policy 1, policy_version 456304 (0.0010) [2023-12-27 22:30:32,966][106226] Updated weights for policy 0, policy_version 454897 (0.0005) [2023-12-27 22:30:33,026][106226] Updated weights for policy 0, policy_version 454907 (0.0006) [2023-12-27 22:30:33,076][106226] Updated weights for policy 0, policy_version 454917 (0.0007) [2023-12-27 22:30:33,420][106225] Updated weights for policy 1, policy_version 456314 (0.0010) [2023-12-27 22:30:33,485][106225] Updated weights for policy 1, policy_version 456324 (0.0010) [2023-12-27 22:30:33,544][106225] Updated weights for policy 1, policy_version 456334 (0.0010) [2023-12-27 22:30:33,708][106226] Updated weights for policy 0, policy_version 454927 (0.0007) [2023-12-27 22:30:33,759][106226] Updated weights for policy 0, policy_version 454937 (0.0008) [2023-12-27 22:30:33,812][106226] Updated weights for policy 0, policy_version 454947 (0.0008) [2023-12-27 22:30:34,261][106225] Updated weights for policy 1, policy_version 456344 (0.0007) [2023-12-27 22:30:34,323][106225] Updated weights for policy 1, policy_version 456354 (0.0011) [2023-12-27 22:30:34,389][106225] Updated weights for policy 1, policy_version 456364 (0.0010) [2023-12-27 22:30:34,583][106226] Updated weights for policy 0, policy_version 454957 (0.0008) [2023-12-27 22:30:34,649][106226] Updated weights for policy 0, policy_version 454967 (0.0008) [2023-12-27 22:30:34,711][106226] Updated weights for policy 0, policy_version 454977 (0.0006) [2023-12-27 22:30:35,083][106225] Updated weights for policy 1, policy_version 456374 (0.0010) [2023-12-27 22:30:35,141][106225] Updated weights for policy 1, policy_version 456384 (0.0010) [2023-12-27 22:30:35,198][106225] Updated weights for policy 1, policy_version 456394 (0.0010) [2023-12-27 22:30:35,317][106226] Updated weights for policy 0, policy_version 454987 (0.0007) [2023-12-27 22:30:35,377][106226] Updated weights for policy 0, policy_version 454997 (0.0008) [2023-12-27 22:30:35,437][106226] Updated weights for policy 0, policy_version 455007 (0.0008) [2023-12-27 22:30:35,907][106225] Updated weights for policy 1, policy_version 456404 (0.0010) [2023-12-27 22:30:35,968][106225] Updated weights for policy 1, policy_version 456414 (0.0009) [2023-12-27 22:30:36,032][106225] Updated weights for policy 1, policy_version 456424 (0.0008) [2023-12-27 22:30:36,131][106226] Updated weights for policy 0, policy_version 455017 (0.0008) [2023-12-27 22:30:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19522.0). Total num frames: 233390080. Throughput: 0: 9708.6, 1: 9879.1. Samples: 233400324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:36,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.170')] [2023-12-27 22:30:36,197][106226] Updated weights for policy 0, policy_version 455027 (0.0007) [2023-12-27 22:30:36,257][106226] Updated weights for policy 0, policy_version 455037 (0.0008) [2023-12-27 22:30:36,323][106226] Updated weights for policy 0, policy_version 455047 (0.0009) [2023-12-27 22:30:36,792][106225] Updated weights for policy 1, policy_version 456434 (0.0009) [2023-12-27 22:30:36,850][106225] Updated weights for policy 1, policy_version 456444 (0.0008) [2023-12-27 22:30:36,906][106225] Updated weights for policy 1, policy_version 456454 (0.0008) [2023-12-27 22:30:36,960][106225] Updated weights for policy 1, policy_version 456464 (0.0006) [2023-12-27 22:30:37,042][106226] Updated weights for policy 0, policy_version 455057 (0.0009) [2023-12-27 22:30:37,099][106226] Updated weights for policy 0, policy_version 455067 (0.0008) [2023-12-27 22:30:37,155][106226] Updated weights for policy 0, policy_version 455077 (0.0008) [2023-12-27 22:30:37,645][106225] Updated weights for policy 1, policy_version 456474 (0.0008) [2023-12-27 22:30:37,712][106225] Updated weights for policy 1, policy_version 456484 (0.0008) [2023-12-27 22:30:37,775][106225] Updated weights for policy 1, policy_version 456494 (0.0009) [2023-12-27 22:30:37,908][106226] Updated weights for policy 0, policy_version 455087 (0.0006) [2023-12-27 22:30:37,969][106226] Updated weights for policy 0, policy_version 455097 (0.0007) [2023-12-27 22:30:38,020][106226] Updated weights for policy 0, policy_version 455107 (0.0010) [2023-12-27 22:30:38,571][106225] Updated weights for policy 1, policy_version 456504 (0.0008) [2023-12-27 22:30:38,629][106225] Updated weights for policy 1, policy_version 456514 (0.0007) [2023-12-27 22:30:38,687][106225] Updated weights for policy 1, policy_version 456524 (0.0009) [2023-12-27 22:30:38,704][106226] Updated weights for policy 0, policy_version 455117 (0.0008) [2023-12-27 22:30:38,758][106226] Updated weights for policy 0, policy_version 455127 (0.0010) [2023-12-27 22:30:38,806][106226] Updated weights for policy 0, policy_version 455137 (0.0010) [2023-12-27 22:30:39,340][106225] Updated weights for policy 1, policy_version 456534 (0.0008) [2023-12-27 22:30:39,414][106225] Updated weights for policy 1, policy_version 456544 (0.0008) [2023-12-27 22:30:39,484][106225] Updated weights for policy 1, policy_version 456554 (0.0007) [2023-12-27 22:30:39,546][106226] Updated weights for policy 0, policy_version 455147 (0.0011) [2023-12-27 22:30:39,608][106226] Updated weights for policy 0, policy_version 455157 (0.0011) [2023-12-27 22:30:39,673][106226] Updated weights for policy 0, policy_version 455167 (0.0011) [2023-12-27 22:30:40,202][106225] Updated weights for policy 1, policy_version 456564 (0.0009) [2023-12-27 22:30:40,258][106225] Updated weights for policy 1, policy_version 456574 (0.0008) [2023-12-27 22:30:40,314][106225] Updated weights for policy 1, policy_version 456584 (0.0008) [2023-12-27 22:30:40,346][106226] Updated weights for policy 0, policy_version 455177 (0.0010) [2023-12-27 22:30:40,408][106226] Updated weights for policy 0, policy_version 455187 (0.0007) [2023-12-27 22:30:40,461][106226] Updated weights for policy 0, policy_version 455197 (0.0010) [2023-12-27 22:30:40,513][106226] Updated weights for policy 0, policy_version 455207 (0.0011) [2023-12-27 22:30:41,126][106225] Updated weights for policy 1, policy_version 456594 (0.0009) [2023-12-27 22:30:41,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19494.2). Total num frames: 233480192. Throughput: 0: 9691.1, 1: 9888.8. Samples: 233457324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:41,175][105115] Avg episode reward: [(0, '-5.044'), (1, '-5.722')] [2023-12-27 22:30:41,181][106226] Updated weights for policy 0, policy_version 455217 (0.0010) [2023-12-27 22:30:41,193][106225] Updated weights for policy 1, policy_version 456604 (0.0009) [2023-12-27 22:30:41,245][106226] Updated weights for policy 0, policy_version 455227 (0.0011) [2023-12-27 22:30:41,258][106225] Updated weights for policy 1, policy_version 456614 (0.0009) [2023-12-27 22:30:41,313][106226] Updated weights for policy 0, policy_version 455237 (0.0009) [2023-12-27 22:30:41,317][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000456624_116924416.pth... [2023-12-27 22:30:41,318][106225] Updated weights for policy 1, policy_version 456624 (0.0006) [2023-12-27 22:30:41,322][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000455440_116621312.pth [2023-12-27 22:30:41,332][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000455240_116572160.pth... [2023-12-27 22:30:41,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000454088_116277248.pth [2023-12-27 22:30:41,989][106225] Updated weights for policy 1, policy_version 456634 (0.0006) [2023-12-27 22:30:42,049][106226] Updated weights for policy 0, policy_version 455247 (0.0007) [2023-12-27 22:30:42,050][106225] Updated weights for policy 1, policy_version 456644 (0.0006) [2023-12-27 22:30:42,104][106225] Updated weights for policy 1, policy_version 456654 (0.0006) [2023-12-27 22:30:42,109][106226] Updated weights for policy 0, policy_version 455257 (0.0009) [2023-12-27 22:30:42,170][106226] Updated weights for policy 0, policy_version 455267 (0.0009) [2023-12-27 22:30:42,744][106225] Updated weights for policy 1, policy_version 456664 (0.0010) [2023-12-27 22:30:42,795][106225] Updated weights for policy 1, policy_version 456674 (0.0010) [2023-12-27 22:30:42,859][106225] Updated weights for policy 1, policy_version 456684 (0.0007) [2023-12-27 22:30:42,951][106226] Updated weights for policy 0, policy_version 455277 (0.0009) [2023-12-27 22:30:43,000][106226] Updated weights for policy 0, policy_version 455287 (0.0009) [2023-12-27 22:30:43,058][106226] Updated weights for policy 0, policy_version 455297 (0.0009) [2023-12-27 22:30:43,544][106225] Updated weights for policy 1, policy_version 456694 (0.0008) [2023-12-27 22:30:43,594][106225] Updated weights for policy 1, policy_version 456704 (0.0010) [2023-12-27 22:30:43,651][106225] Updated weights for policy 1, policy_version 456714 (0.0010) [2023-12-27 22:30:43,725][106226] Updated weights for policy 0, policy_version 455307 (0.0007) [2023-12-27 22:30:43,781][106226] Updated weights for policy 0, policy_version 455317 (0.0008) [2023-12-27 22:30:43,841][106226] Updated weights for policy 0, policy_version 455327 (0.0011) [2023-12-27 22:30:44,298][106225] Updated weights for policy 1, policy_version 456724 (0.0010) [2023-12-27 22:30:44,352][106225] Updated weights for policy 1, policy_version 456734 (0.0007) [2023-12-27 22:30:44,419][106225] Updated weights for policy 1, policy_version 456744 (0.0007) [2023-12-27 22:30:44,449][106226] Updated weights for policy 0, policy_version 455337 (0.0010) [2023-12-27 22:30:44,513][106226] Updated weights for policy 0, policy_version 455347 (0.0006) [2023-12-27 22:30:44,571][106226] Updated weights for policy 0, policy_version 455357 (0.0006) [2023-12-27 22:30:44,627][106226] Updated weights for policy 0, policy_version 455367 (0.0005) [2023-12-27 22:30:45,142][106225] Updated weights for policy 1, policy_version 456754 (0.0008) [2023-12-27 22:30:45,207][106225] Updated weights for policy 1, policy_version 456764 (0.0008) [2023-12-27 22:30:45,264][106226] Updated weights for policy 0, policy_version 455377 (0.0010) [2023-12-27 22:30:45,266][106225] Updated weights for policy 1, policy_version 456774 (0.0006) [2023-12-27 22:30:45,325][106225] Updated weights for policy 1, policy_version 456784 (0.0006) [2023-12-27 22:30:45,327][106226] Updated weights for policy 0, policy_version 455387 (0.0011) [2023-12-27 22:30:45,392][106226] Updated weights for policy 0, policy_version 455397 (0.0011) [2023-12-27 22:30:45,951][106225] Updated weights for policy 1, policy_version 456794 (0.0007) [2023-12-27 22:30:46,004][106225] Updated weights for policy 1, policy_version 456804 (0.0010) [2023-12-27 22:30:46,051][106225] Updated weights for policy 1, policy_version 456814 (0.0010) [2023-12-27 22:30:46,111][106226] Updated weights for policy 0, policy_version 455407 (0.0011) [2023-12-27 22:30:46,174][106226] Updated weights for policy 0, policy_version 455417 (0.0008) [2023-12-27 22:30:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 233586688. Throughput: 0: 9760.2, 1: 9893.7. Samples: 233577280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:46,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-5.781')] [2023-12-27 22:30:46,233][106226] Updated weights for policy 0, policy_version 455427 (0.0005) [2023-12-27 22:30:46,766][106225] Updated weights for policy 1, policy_version 456824 (0.0010) [2023-12-27 22:30:46,814][106226] Updated weights for policy 0, policy_version 455437 (0.0008) [2023-12-27 22:30:46,817][106225] Updated weights for policy 1, policy_version 456834 (0.0010) [2023-12-27 22:30:46,864][106226] Updated weights for policy 0, policy_version 455447 (0.0010) [2023-12-27 22:30:46,867][106225] Updated weights for policy 1, policy_version 456844 (0.0009) [2023-12-27 22:30:46,914][106226] Updated weights for policy 0, policy_version 455457 (0.0010) [2023-12-27 22:30:47,603][106225] Updated weights for policy 1, policy_version 456854 (0.0010) [2023-12-27 22:30:47,650][106226] Updated weights for policy 0, policy_version 455467 (0.0009) [2023-12-27 22:30:47,667][106225] Updated weights for policy 1, policy_version 456864 (0.0010) [2023-12-27 22:30:47,709][106226] Updated weights for policy 0, policy_version 455477 (0.0006) [2023-12-27 22:30:47,733][106225] Updated weights for policy 1, policy_version 456874 (0.0010) [2023-12-27 22:30:47,768][106226] Updated weights for policy 0, policy_version 455487 (0.0006) [2023-12-27 22:30:48,410][106225] Updated weights for policy 1, policy_version 456884 (0.0011) [2023-12-27 22:30:48,426][106226] Updated weights for policy 0, policy_version 455497 (0.0010) [2023-12-27 22:30:48,475][106225] Updated weights for policy 1, policy_version 456894 (0.0011) [2023-12-27 22:30:48,492][106226] Updated weights for policy 0, policy_version 455507 (0.0011) [2023-12-27 22:30:48,541][106225] Updated weights for policy 1, policy_version 456904 (0.0009) [2023-12-27 22:30:48,554][106226] Updated weights for policy 0, policy_version 455517 (0.0009) [2023-12-27 22:30:48,614][106226] Updated weights for policy 0, policy_version 455527 (0.0011) [2023-12-27 22:30:49,236][106225] Updated weights for policy 1, policy_version 456914 (0.0010) [2023-12-27 22:30:49,288][106226] Updated weights for policy 0, policy_version 455537 (0.0008) [2023-12-27 22:30:49,302][106225] Updated weights for policy 1, policy_version 456924 (0.0011) [2023-12-27 22:30:49,357][106226] Updated weights for policy 0, policy_version 455547 (0.0007) [2023-12-27 22:30:49,376][106225] Updated weights for policy 1, policy_version 456934 (0.0010) [2023-12-27 22:30:49,425][106226] Updated weights for policy 0, policy_version 455557 (0.0007) [2023-12-27 22:30:49,439][106225] Updated weights for policy 1, policy_version 456944 (0.0009) [2023-12-27 22:30:50,160][106226] Updated weights for policy 0, policy_version 455567 (0.0007) [2023-12-27 22:30:50,211][106225] Updated weights for policy 1, policy_version 456954 (0.0010) [2023-12-27 22:30:50,223][106226] Updated weights for policy 0, policy_version 455577 (0.0010) [2023-12-27 22:30:50,273][106225] Updated weights for policy 1, policy_version 456964 (0.0009) [2023-12-27 22:30:50,287][106226] Updated weights for policy 0, policy_version 455587 (0.0007) [2023-12-27 22:30:50,329][106225] Updated weights for policy 1, policy_version 456974 (0.0011) [2023-12-27 22:30:51,007][106226] Updated weights for policy 0, policy_version 455597 (0.0008) [2023-12-27 22:30:51,074][106226] Updated weights for policy 0, policy_version 455607 (0.0008) [2023-12-27 22:30:51,099][106225] Updated weights for policy 1, policy_version 456984 (0.0009) [2023-12-27 22:30:51,149][106226] Updated weights for policy 0, policy_version 455617 (0.0008) [2023-12-27 22:30:51,167][106225] Updated weights for policy 1, policy_version 456994 (0.0008) [2023-12-27 22:30:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19522.0). Total num frames: 233676800. Throughput: 0: 9794.9, 1: 9857.4. Samples: 233694984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:51,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-5.862')] [2023-12-27 22:30:51,230][106225] Updated weights for policy 1, policy_version 457004 (0.0006) [2023-12-27 22:30:51,894][106226] Updated weights for policy 0, policy_version 455627 (0.0008) [2023-12-27 22:30:51,960][106226] Updated weights for policy 0, policy_version 455637 (0.0008) [2023-12-27 22:30:51,971][106225] Updated weights for policy 1, policy_version 457014 (0.0007) [2023-12-27 22:30:52,022][106226] Updated weights for policy 0, policy_version 455647 (0.0007) [2023-12-27 22:30:52,032][106225] Updated weights for policy 1, policy_version 457024 (0.0009) [2023-12-27 22:30:52,092][106225] Updated weights for policy 1, policy_version 457034 (0.0008) [2023-12-27 22:30:52,771][106226] Updated weights for policy 0, policy_version 455657 (0.0008) [2023-12-27 22:30:52,831][106226] Updated weights for policy 0, policy_version 455667 (0.0009) [2023-12-27 22:30:52,845][106225] Updated weights for policy 1, policy_version 457044 (0.0007) [2023-12-27 22:30:52,891][106226] Updated weights for policy 0, policy_version 455677 (0.0010) [2023-12-27 22:30:52,909][106225] Updated weights for policy 1, policy_version 457054 (0.0007) [2023-12-27 22:30:52,953][106226] Updated weights for policy 0, policy_version 455687 (0.0008) [2023-12-27 22:30:52,972][106225] Updated weights for policy 1, policy_version 457064 (0.0007) [2023-12-27 22:30:53,616][106226] Updated weights for policy 0, policy_version 455697 (0.0009) [2023-12-27 22:30:53,675][106226] Updated weights for policy 0, policy_version 455707 (0.0009) [2023-12-27 22:30:53,733][106225] Updated weights for policy 1, policy_version 457074 (0.0008) [2023-12-27 22:30:53,739][106226] Updated weights for policy 0, policy_version 455717 (0.0007) [2023-12-27 22:30:53,788][106225] Updated weights for policy 1, policy_version 457084 (0.0008) [2023-12-27 22:30:53,843][106225] Updated weights for policy 1, policy_version 457094 (0.0008) [2023-12-27 22:30:53,901][106225] Updated weights for policy 1, policy_version 457104 (0.0007) [2023-12-27 22:30:54,478][106226] Updated weights for policy 0, policy_version 455727 (0.0008) [2023-12-27 22:30:54,543][106226] Updated weights for policy 0, policy_version 455737 (0.0008) [2023-12-27 22:30:54,602][106226] Updated weights for policy 0, policy_version 455747 (0.0008) [2023-12-27 22:30:54,665][106225] Updated weights for policy 1, policy_version 457114 (0.0008) [2023-12-27 22:30:54,718][106225] Updated weights for policy 1, policy_version 457124 (0.0008) [2023-12-27 22:30:54,772][106225] Updated weights for policy 1, policy_version 457134 (0.0008) [2023-12-27 22:30:55,328][106226] Updated weights for policy 0, policy_version 455757 (0.0007) [2023-12-27 22:30:55,388][106226] Updated weights for policy 0, policy_version 455767 (0.0009) [2023-12-27 22:30:55,438][106226] Updated weights for policy 0, policy_version 455777 (0.0007) [2023-12-27 22:30:55,525][106225] Updated weights for policy 1, policy_version 457144 (0.0009) [2023-12-27 22:30:55,586][106225] Updated weights for policy 1, policy_version 457154 (0.0009) [2023-12-27 22:30:55,635][106225] Updated weights for policy 1, policy_version 457164 (0.0008) [2023-12-27 22:30:56,083][106226] Updated weights for policy 0, policy_version 455787 (0.0005) [2023-12-27 22:30:56,145][106226] Updated weights for policy 0, policy_version 455797 (0.0008) [2023-12-27 22:30:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 233775104. Throughput: 0: 9762.9, 1: 9822.0. Samples: 233751236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:30:56,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-5.211')] [2023-12-27 22:30:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000457168_117063680.pth... [2023-12-27 22:30:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000456048_116776960.pth [2023-12-27 22:30:56,200][106226] Updated weights for policy 0, policy_version 455807 (0.0008) [2023-12-27 22:30:56,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000455816_116719616.pth... [2023-12-27 22:30:56,252][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000454632_116416512.pth [2023-12-27 22:30:56,388][106225] Updated weights for policy 1, policy_version 457174 (0.0008) [2023-12-27 22:30:56,449][106225] Updated weights for policy 1, policy_version 457184 (0.0007) [2023-12-27 22:30:56,507][106225] Updated weights for policy 1, policy_version 457194 (0.0008) [2023-12-27 22:30:56,876][106226] Updated weights for policy 0, policy_version 455817 (0.0009) [2023-12-27 22:30:56,927][106226] Updated weights for policy 0, policy_version 455827 (0.0005) [2023-12-27 22:30:56,987][106226] Updated weights for policy 0, policy_version 455837 (0.0005) [2023-12-27 22:30:57,050][106226] Updated weights for policy 0, policy_version 455847 (0.0005) [2023-12-27 22:30:57,186][106225] Updated weights for policy 1, policy_version 457204 (0.0007) [2023-12-27 22:30:57,237][106225] Updated weights for policy 1, policy_version 457214 (0.0009) [2023-12-27 22:30:57,291][106225] Updated weights for policy 1, policy_version 457224 (0.0008) [2023-12-27 22:30:57,625][106226] Updated weights for policy 0, policy_version 455857 (0.0010) [2023-12-27 22:30:57,673][106226] Updated weights for policy 0, policy_version 455867 (0.0009) [2023-12-27 22:30:57,726][106226] Updated weights for policy 0, policy_version 455877 (0.0010) [2023-12-27 22:30:58,038][106225] Updated weights for policy 1, policy_version 457234 (0.0008) [2023-12-27 22:30:58,092][106225] Updated weights for policy 1, policy_version 457244 (0.0008) [2023-12-27 22:30:58,141][106225] Updated weights for policy 1, policy_version 457254 (0.0008) [2023-12-27 22:30:58,191][106225] Updated weights for policy 1, policy_version 457264 (0.0009) [2023-12-27 22:30:58,446][106226] Updated weights for policy 0, policy_version 455887 (0.0010) [2023-12-27 22:30:58,509][106226] Updated weights for policy 0, policy_version 455897 (0.0011) [2023-12-27 22:30:58,565][106226] Updated weights for policy 0, policy_version 455907 (0.0009) [2023-12-27 22:30:59,116][106225] Updated weights for policy 1, policy_version 457274 (0.0008) [2023-12-27 22:30:59,181][106225] Updated weights for policy 1, policy_version 457284 (0.0006) [2023-12-27 22:30:59,253][106225] Updated weights for policy 1, policy_version 457294 (0.0007) [2023-12-27 22:30:59,506][106226] Updated weights for policy 0, policy_version 455917 (0.0010) [2023-12-27 22:30:59,564][106226] Updated weights for policy 0, policy_version 455927 (0.0011) [2023-12-27 22:30:59,623][106226] Updated weights for policy 0, policy_version 455937 (0.0010) [2023-12-27 22:31:00,022][106225] Updated weights for policy 1, policy_version 457304 (0.0008) [2023-12-27 22:31:00,076][106225] Updated weights for policy 1, policy_version 457314 (0.0009) [2023-12-27 22:31:00,136][106225] Updated weights for policy 1, policy_version 457324 (0.0009) [2023-12-27 22:31:00,362][106226] Updated weights for policy 0, policy_version 455947 (0.0010) [2023-12-27 22:31:00,424][106226] Updated weights for policy 0, policy_version 455957 (0.0006) [2023-12-27 22:31:00,485][106226] Updated weights for policy 0, policy_version 455967 (0.0005) [2023-12-27 22:31:00,888][106225] Updated weights for policy 1, policy_version 457334 (0.0008) [2023-12-27 22:31:00,937][106225] Updated weights for policy 1, policy_version 457344 (0.0008) [2023-12-27 22:31:01,000][106225] Updated weights for policy 1, policy_version 457354 (0.0008) [2023-12-27 22:31:01,153][106226] Updated weights for policy 0, policy_version 455977 (0.0008) [2023-12-27 22:31:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19522.2). Total num frames: 233873408. Throughput: 0: 9765.1, 1: 9740.8. Samples: 233864196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:01,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-5.523')] [2023-12-27 22:31:01,208][106226] Updated weights for policy 0, policy_version 455987 (0.0009) [2023-12-27 22:31:01,270][106226] Updated weights for policy 0, policy_version 455997 (0.0006) [2023-12-27 22:31:01,334][106226] Updated weights for policy 0, policy_version 456007 (0.0006) [2023-12-27 22:31:01,775][106225] Updated weights for policy 1, policy_version 457364 (0.0009) [2023-12-27 22:31:01,835][106225] Updated weights for policy 1, policy_version 457374 (0.0008) [2023-12-27 22:31:01,890][106225] Updated weights for policy 1, policy_version 457384 (0.0008) [2023-12-27 22:31:02,069][106226] Updated weights for policy 0, policy_version 456017 (0.0009) [2023-12-27 22:31:02,119][106226] Updated weights for policy 0, policy_version 456027 (0.0009) [2023-12-27 22:31:02,171][106226] Updated weights for policy 0, policy_version 456037 (0.0008) [2023-12-27 22:31:02,618][106225] Updated weights for policy 1, policy_version 457394 (0.0008) [2023-12-27 22:31:02,679][106225] Updated weights for policy 1, policy_version 457404 (0.0008) [2023-12-27 22:31:02,738][106225] Updated weights for policy 1, policy_version 457414 (0.0008) [2023-12-27 22:31:02,797][106225] Updated weights for policy 1, policy_version 457424 (0.0008) [2023-12-27 22:31:02,919][106226] Updated weights for policy 0, policy_version 456047 (0.0008) [2023-12-27 22:31:02,979][106226] Updated weights for policy 0, policy_version 456057 (0.0008) [2023-12-27 22:31:03,039][106226] Updated weights for policy 0, policy_version 456067 (0.0008) [2023-12-27 22:31:03,414][106225] Updated weights for policy 1, policy_version 457434 (0.0005) [2023-12-27 22:31:03,475][106225] Updated weights for policy 1, policy_version 457444 (0.0005) [2023-12-27 22:31:03,535][106225] Updated weights for policy 1, policy_version 457454 (0.0006) [2023-12-27 22:31:03,679][106226] Updated weights for policy 0, policy_version 456077 (0.0008) [2023-12-27 22:31:03,736][106226] Updated weights for policy 0, policy_version 456087 (0.0006) [2023-12-27 22:31:03,784][106226] Updated weights for policy 0, policy_version 456097 (0.0005) [2023-12-27 22:31:04,140][106225] Updated weights for policy 1, policy_version 457464 (0.0009) [2023-12-27 22:31:04,200][106225] Updated weights for policy 1, policy_version 457474 (0.0009) [2023-12-27 22:31:04,260][106225] Updated weights for policy 1, policy_version 457484 (0.0009) [2023-12-27 22:31:04,483][106226] Updated weights for policy 0, policy_version 456107 (0.0006) [2023-12-27 22:31:04,534][106226] Updated weights for policy 0, policy_version 456117 (0.0005) [2023-12-27 22:31:04,586][106226] Updated weights for policy 0, policy_version 456127 (0.0005) [2023-12-27 22:31:05,039][106225] Updated weights for policy 1, policy_version 457494 (0.0008) [2023-12-27 22:31:05,096][106225] Updated weights for policy 1, policy_version 457504 (0.0008) [2023-12-27 22:31:05,130][106226] Updated weights for policy 0, policy_version 456137 (0.0005) [2023-12-27 22:31:05,147][106225] Updated weights for policy 1, policy_version 457514 (0.0009) [2023-12-27 22:31:05,184][106226] Updated weights for policy 0, policy_version 456147 (0.0006) [2023-12-27 22:31:05,246][106226] Updated weights for policy 0, policy_version 456157 (0.0008) [2023-12-27 22:31:05,300][106226] Updated weights for policy 0, policy_version 456167 (0.0008) [2023-12-27 22:31:05,881][106225] Updated weights for policy 1, policy_version 457524 (0.0008) [2023-12-27 22:31:05,934][106225] Updated weights for policy 1, policy_version 457534 (0.0006) [2023-12-27 22:31:06,001][106225] Updated weights for policy 1, policy_version 457544 (0.0007) [2023-12-27 22:31:06,005][106226] Updated weights for policy 0, policy_version 456177 (0.0010) [2023-12-27 22:31:06,058][106226] Updated weights for policy 0, policy_version 456187 (0.0007) [2023-12-27 22:31:06,124][106226] Updated weights for policy 0, policy_version 456197 (0.0007) [2023-12-27 22:31:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 233979904. Throughput: 0: 9839.6, 1: 9618.4. Samples: 233982928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:06,175][105115] Avg episode reward: [(0, '-5.127'), (1, '-5.136')] [2023-12-27 22:31:06,680][106225] Updated weights for policy 1, policy_version 457554 (0.0009) [2023-12-27 22:31:06,739][106225] Updated weights for policy 1, policy_version 457564 (0.0008) [2023-12-27 22:31:06,808][106225] Updated weights for policy 1, policy_version 457574 (0.0009) [2023-12-27 22:31:06,842][106226] Updated weights for policy 0, policy_version 456207 (0.0006) [2023-12-27 22:31:06,861][106225] Updated weights for policy 1, policy_version 457584 (0.0009) [2023-12-27 22:31:06,901][106226] Updated weights for policy 0, policy_version 456217 (0.0008) [2023-12-27 22:31:06,961][106226] Updated weights for policy 0, policy_version 456227 (0.0008) [2023-12-27 22:31:07,541][106226] Updated weights for policy 0, policy_version 456237 (0.0006) [2023-12-27 22:31:07,555][106225] Updated weights for policy 1, policy_version 457594 (0.0010) [2023-12-27 22:31:07,599][106226] Updated weights for policy 0, policy_version 456247 (0.0006) [2023-12-27 22:31:07,609][106225] Updated weights for policy 1, policy_version 457604 (0.0010) [2023-12-27 22:31:07,656][106226] Updated weights for policy 0, policy_version 456257 (0.0006) [2023-12-27 22:31:07,666][106225] Updated weights for policy 1, policy_version 457614 (0.0007) [2023-12-27 22:31:08,346][106225] Updated weights for policy 1, policy_version 457624 (0.0007) [2023-12-27 22:31:08,376][106226] Updated weights for policy 0, policy_version 456267 (0.0006) [2023-12-27 22:31:08,408][106225] Updated weights for policy 1, policy_version 457634 (0.0008) [2023-12-27 22:31:08,435][106226] Updated weights for policy 0, policy_version 456277 (0.0006) [2023-12-27 22:31:08,467][106225] Updated weights for policy 1, policy_version 457644 (0.0008) [2023-12-27 22:31:08,500][106226] Updated weights for policy 0, policy_version 456287 (0.0008) [2023-12-27 22:31:09,029][106225] Updated weights for policy 1, policy_version 457654 (0.0007) [2023-12-27 22:31:09,089][106225] Updated weights for policy 1, policy_version 457664 (0.0008) [2023-12-27 22:31:09,150][106225] Updated weights for policy 1, policy_version 457674 (0.0008) [2023-12-27 22:31:09,273][106226] Updated weights for policy 0, policy_version 456297 (0.0009) [2023-12-27 22:31:09,329][106226] Updated weights for policy 0, policy_version 456307 (0.0010) [2023-12-27 22:31:09,408][106226] Updated weights for policy 0, policy_version 456317 (0.0009) [2023-12-27 22:31:09,474][106226] Updated weights for policy 0, policy_version 456327 (0.0010) [2023-12-27 22:31:09,895][106225] Updated weights for policy 1, policy_version 457684 (0.0006) [2023-12-27 22:31:09,961][106225] Updated weights for policy 1, policy_version 457694 (0.0009) [2023-12-27 22:31:10,025][106225] Updated weights for policy 1, policy_version 457704 (0.0009) [2023-12-27 22:31:10,200][106226] Updated weights for policy 0, policy_version 456337 (0.0009) [2023-12-27 22:31:10,268][106226] Updated weights for policy 0, policy_version 456347 (0.0008) [2023-12-27 22:31:10,335][106226] Updated weights for policy 0, policy_version 456357 (0.0009) [2023-12-27 22:31:10,710][106225] Updated weights for policy 1, policy_version 457714 (0.0008) [2023-12-27 22:31:10,769][106225] Updated weights for policy 1, policy_version 457724 (0.0009) [2023-12-27 22:31:10,830][106225] Updated weights for policy 1, policy_version 457734 (0.0009) [2023-12-27 22:31:10,896][106225] Updated weights for policy 1, policy_version 457744 (0.0009) [2023-12-27 22:31:10,995][106226] Updated weights for policy 0, policy_version 456367 (0.0009) [2023-12-27 22:31:11,074][106226] Updated weights for policy 0, policy_version 456377 (0.0009) [2023-12-27 22:31:11,142][106226] Updated weights for policy 0, policy_version 456387 (0.0009) [2023-12-27 22:31:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19661.2, 300 sec: 19577.5). Total num frames: 234078208. Throughput: 0: 9879.4, 1: 9653.8. Samples: 234042856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:11,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.058')] [2023-12-27 22:31:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000457744_117211136.pth... [2023-12-27 22:31:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000456392_116867072.pth... [2023-12-27 22:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000455240_116572160.pth [2023-12-27 22:31:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000456624_116924416.pth [2023-12-27 22:31:11,737][106225] Updated weights for policy 1, policy_version 457754 (0.0008) [2023-12-27 22:31:11,806][106225] Updated weights for policy 1, policy_version 457764 (0.0008) [2023-12-27 22:31:11,866][106225] Updated weights for policy 1, policy_version 457774 (0.0009) [2023-12-27 22:31:11,891][106226] Updated weights for policy 0, policy_version 456397 (0.0008) [2023-12-27 22:31:11,947][106226] Updated weights for policy 0, policy_version 456407 (0.0009) [2023-12-27 22:31:12,006][106226] Updated weights for policy 0, policy_version 456417 (0.0008) [2023-12-27 22:31:12,605][106225] Updated weights for policy 1, policy_version 457784 (0.0009) [2023-12-27 22:31:12,668][106225] Updated weights for policy 1, policy_version 457794 (0.0010) [2023-12-27 22:31:12,723][106226] Updated weights for policy 0, policy_version 456427 (0.0008) [2023-12-27 22:31:12,727][106225] Updated weights for policy 1, policy_version 457804 (0.0010) [2023-12-27 22:31:12,784][106226] Updated weights for policy 0, policy_version 456437 (0.0006) [2023-12-27 22:31:12,835][106226] Updated weights for policy 0, policy_version 456447 (0.0009) [2023-12-27 22:31:13,411][106225] Updated weights for policy 1, policy_version 457814 (0.0007) [2023-12-27 22:31:13,473][106225] Updated weights for policy 1, policy_version 457824 (0.0010) [2023-12-27 22:31:13,504][106226] Updated weights for policy 0, policy_version 456457 (0.0010) [2023-12-27 22:31:13,537][106225] Updated weights for policy 1, policy_version 457834 (0.0010) [2023-12-27 22:31:13,550][106226] Updated weights for policy 0, policy_version 456467 (0.0010) [2023-12-27 22:31:13,597][106226] Updated weights for policy 0, policy_version 456477 (0.0010) [2023-12-27 22:31:13,647][106226] Updated weights for policy 0, policy_version 456487 (0.0010) [2023-12-27 22:31:14,100][106225] Updated weights for policy 1, policy_version 457844 (0.0008) [2023-12-27 22:31:14,149][106225] Updated weights for policy 1, policy_version 457854 (0.0010) [2023-12-27 22:31:14,203][106225] Updated weights for policy 1, policy_version 457864 (0.0005) [2023-12-27 22:31:14,269][106226] Updated weights for policy 0, policy_version 456497 (0.0006) [2023-12-27 22:31:14,318][106226] Updated weights for policy 0, policy_version 456507 (0.0005) [2023-12-27 22:31:14,380][106226] Updated weights for policy 0, policy_version 456517 (0.0008) [2023-12-27 22:31:14,903][106225] Updated weights for policy 1, policy_version 457874 (0.0007) [2023-12-27 22:31:14,964][106225] Updated weights for policy 1, policy_version 457884 (0.0010) [2023-12-27 22:31:15,030][106225] Updated weights for policy 1, policy_version 457894 (0.0009) [2023-12-27 22:31:15,051][106226] Updated weights for policy 0, policy_version 456527 (0.0007) [2023-12-27 22:31:15,097][106225] Updated weights for policy 1, policy_version 457904 (0.0008) [2023-12-27 22:31:15,118][106226] Updated weights for policy 0, policy_version 456537 (0.0008) [2023-12-27 22:31:15,181][106226] Updated weights for policy 0, policy_version 456547 (0.0008) [2023-12-27 22:31:15,757][106225] Updated weights for policy 1, policy_version 457914 (0.0010) [2023-12-27 22:31:15,812][106225] Updated weights for policy 1, policy_version 457924 (0.0009) [2023-12-27 22:31:15,860][106225] Updated weights for policy 1, policy_version 457934 (0.0005) [2023-12-27 22:31:15,892][106226] Updated weights for policy 0, policy_version 456557 (0.0008) [2023-12-27 22:31:15,944][106226] Updated weights for policy 0, policy_version 456567 (0.0005) [2023-12-27 22:31:16,001][106226] Updated weights for policy 0, policy_version 456577 (0.0008) [2023-12-27 22:31:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 234176512. Throughput: 0: 9884.7, 1: 9619.5. Samples: 234161720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:16,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.332')] [2023-12-27 22:31:16,434][106225] Updated weights for policy 1, policy_version 457944 (0.0009) [2023-12-27 22:31:16,480][106225] Updated weights for policy 1, policy_version 457954 (0.0010) [2023-12-27 22:31:16,527][106225] Updated weights for policy 1, policy_version 457964 (0.0008) [2023-12-27 22:31:16,697][106226] Updated weights for policy 0, policy_version 456587 (0.0010) [2023-12-27 22:31:16,756][106226] Updated weights for policy 0, policy_version 456597 (0.0010) [2023-12-27 22:31:16,818][106226] Updated weights for policy 0, policy_version 456607 (0.0010) [2023-12-27 22:31:17,201][106225] Updated weights for policy 1, policy_version 457974 (0.0007) [2023-12-27 22:31:17,263][106225] Updated weights for policy 1, policy_version 457984 (0.0007) [2023-12-27 22:31:17,328][106225] Updated weights for policy 1, policy_version 457994 (0.0008) [2023-12-27 22:31:17,462][106226] Updated weights for policy 0, policy_version 456617 (0.0010) [2023-12-27 22:31:17,531][106226] Updated weights for policy 0, policy_version 456627 (0.0006) [2023-12-27 22:31:17,597][106226] Updated weights for policy 0, policy_version 456637 (0.0006) [2023-12-27 22:31:17,668][106226] Updated weights for policy 0, policy_version 456647 (0.0006) [2023-12-27 22:31:17,984][106225] Updated weights for policy 1, policy_version 458004 (0.0007) [2023-12-27 22:31:18,044][106225] Updated weights for policy 1, policy_version 458014 (0.0005) [2023-12-27 22:31:18,112][106225] Updated weights for policy 1, policy_version 458024 (0.0005) [2023-12-27 22:31:18,181][106226] Updated weights for policy 0, policy_version 456657 (0.0008) [2023-12-27 22:31:18,246][106226] Updated weights for policy 0, policy_version 456667 (0.0008) [2023-12-27 22:31:18,295][106226] Updated weights for policy 0, policy_version 456677 (0.0009) [2023-12-27 22:31:18,778][106225] Updated weights for policy 1, policy_version 458034 (0.0006) [2023-12-27 22:31:18,839][106225] Updated weights for policy 1, policy_version 458044 (0.0009) [2023-12-27 22:31:18,898][106225] Updated weights for policy 1, policy_version 458054 (0.0008) [2023-12-27 22:31:18,958][106225] Updated weights for policy 1, policy_version 458064 (0.0009) [2023-12-27 22:31:18,994][106226] Updated weights for policy 0, policy_version 456687 (0.0006) [2023-12-27 22:31:19,045][106226] Updated weights for policy 0, policy_version 456697 (0.0005) [2023-12-27 22:31:19,094][106226] Updated weights for policy 0, policy_version 456707 (0.0005) [2023-12-27 22:31:19,760][106225] Updated weights for policy 1, policy_version 458074 (0.0009) [2023-12-27 22:31:19,797][106226] Updated weights for policy 0, policy_version 456717 (0.0006) [2023-12-27 22:31:19,820][106225] Updated weights for policy 1, policy_version 458084 (0.0009) [2023-12-27 22:31:19,860][106226] Updated weights for policy 0, policy_version 456727 (0.0007) [2023-12-27 22:31:19,894][106225] Updated weights for policy 1, policy_version 458094 (0.0011) [2023-12-27 22:31:19,919][106226] Updated weights for policy 0, policy_version 456737 (0.0007) [2023-12-27 22:31:20,558][106225] Updated weights for policy 1, policy_version 458104 (0.0011) [2023-12-27 22:31:20,626][106225] Updated weights for policy 1, policy_version 458114 (0.0011) [2023-12-27 22:31:20,689][106225] Updated weights for policy 1, policy_version 458124 (0.0011) [2023-12-27 22:31:20,701][106226] Updated weights for policy 0, policy_version 456747 (0.0009) [2023-12-27 22:31:20,770][106226] Updated weights for policy 0, policy_version 456757 (0.0008) [2023-12-27 22:31:20,835][106226] Updated weights for policy 0, policy_version 456767 (0.0008) [2023-12-27 22:31:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 234274816. Throughput: 0: 9892.9, 1: 9703.5. Samples: 234282160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:21,175][105115] Avg episode reward: [(0, '-5.000'), (1, '-5.475')] [2023-12-27 22:31:21,436][106225] Updated weights for policy 1, policy_version 458134 (0.0010) [2023-12-27 22:31:21,493][106225] Updated weights for policy 1, policy_version 458144 (0.0010) [2023-12-27 22:31:21,558][106225] Updated weights for policy 1, policy_version 458154 (0.0011) [2023-12-27 22:31:21,617][106226] Updated weights for policy 0, policy_version 456777 (0.0009) [2023-12-27 22:31:21,679][106226] Updated weights for policy 0, policy_version 456787 (0.0009) [2023-12-27 22:31:21,743][106226] Updated weights for policy 0, policy_version 456797 (0.0009) [2023-12-27 22:31:21,806][106226] Updated weights for policy 0, policy_version 456807 (0.0008) [2023-12-27 22:31:22,354][106225] Updated weights for policy 1, policy_version 458164 (0.0010) [2023-12-27 22:31:22,418][106225] Updated weights for policy 1, policy_version 458174 (0.0008) [2023-12-27 22:31:22,479][106225] Updated weights for policy 1, policy_version 458184 (0.0008) [2023-12-27 22:31:22,560][106226] Updated weights for policy 0, policy_version 456817 (0.0007) [2023-12-27 22:31:22,624][106226] Updated weights for policy 0, policy_version 456827 (0.0009) [2023-12-27 22:31:22,687][106226] Updated weights for policy 0, policy_version 456837 (0.0009) [2023-12-27 22:31:23,119][106225] Updated weights for policy 1, policy_version 458194 (0.0007) [2023-12-27 22:31:23,177][106225] Updated weights for policy 1, policy_version 458204 (0.0006) [2023-12-27 22:31:23,237][106225] Updated weights for policy 1, policy_version 458214 (0.0010) [2023-12-27 22:31:23,295][106225] Updated weights for policy 1, policy_version 458224 (0.0008) [2023-12-27 22:31:23,482][106226] Updated weights for policy 0, policy_version 456847 (0.0008) [2023-12-27 22:31:23,548][106226] Updated weights for policy 0, policy_version 456857 (0.0008) [2023-12-27 22:31:23,604][106226] Updated weights for policy 0, policy_version 456867 (0.0005) [2023-12-27 22:31:23,855][106225] Updated weights for policy 1, policy_version 458234 (0.0008) [2023-12-27 22:31:23,900][106225] Updated weights for policy 1, policy_version 458244 (0.0008) [2023-12-27 22:31:23,955][106225] Updated weights for policy 1, policy_version 458254 (0.0008) [2023-12-27 22:31:24,254][106226] Updated weights for policy 0, policy_version 456877 (0.0007) [2023-12-27 22:31:24,309][106226] Updated weights for policy 0, policy_version 456887 (0.0008) [2023-12-27 22:31:24,371][106226] Updated weights for policy 0, policy_version 456897 (0.0008) [2023-12-27 22:31:24,629][106225] Updated weights for policy 1, policy_version 458264 (0.0006) [2023-12-27 22:31:24,680][106225] Updated weights for policy 1, policy_version 458274 (0.0005) [2023-12-27 22:31:24,739][106225] Updated weights for policy 1, policy_version 458284 (0.0005) [2023-12-27 22:31:25,065][106226] Updated weights for policy 0, policy_version 456907 (0.0008) [2023-12-27 22:31:25,127][106226] Updated weights for policy 0, policy_version 456917 (0.0009) [2023-12-27 22:31:25,183][106226] Updated weights for policy 0, policy_version 456927 (0.0010) [2023-12-27 22:31:25,315][106225] Updated weights for policy 1, policy_version 458294 (0.0007) [2023-12-27 22:31:25,377][106225] Updated weights for policy 1, policy_version 458304 (0.0008) [2023-12-27 22:31:25,440][106225] Updated weights for policy 1, policy_version 458314 (0.0008) [2023-12-27 22:31:25,815][106226] Updated weights for policy 0, policy_version 456937 (0.0010) [2023-12-27 22:31:25,872][106226] Updated weights for policy 0, policy_version 456947 (0.0008) [2023-12-27 22:31:25,922][106226] Updated weights for policy 0, policy_version 456958 (0.0009) [2023-12-27 22:31:25,989][106226] Updated weights for policy 0, policy_version 456968 (0.0006) [2023-12-27 22:31:26,121][106225] Updated weights for policy 1, policy_version 458324 (0.0008) [2023-12-27 22:31:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 234373120. Throughput: 0: 9877.9, 1: 9749.9. Samples: 234340572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:26,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.350')] [2023-12-27 22:31:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000456968_117014528.pth... [2023-12-27 22:31:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000455816_116719616.pth [2023-12-27 22:31:26,185][106225] Updated weights for policy 1, policy_version 458334 (0.0009) [2023-12-27 22:31:26,235][106225] Updated weights for policy 1, policy_version 458344 (0.0008) [2023-12-27 22:31:26,276][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000458352_117366784.pth... [2023-12-27 22:31:26,280][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000457168_117063680.pth [2023-12-27 22:31:26,654][106226] Updated weights for policy 0, policy_version 456978 (0.0009) [2023-12-27 22:31:26,716][106226] Updated weights for policy 0, policy_version 456988 (0.0009) [2023-12-27 22:31:26,771][106226] Updated weights for policy 0, policy_version 456998 (0.0008) [2023-12-27 22:31:26,932][106225] Updated weights for policy 1, policy_version 458354 (0.0008) [2023-12-27 22:31:26,987][106225] Updated weights for policy 1, policy_version 458364 (0.0008) [2023-12-27 22:31:27,044][106225] Updated weights for policy 1, policy_version 458374 (0.0008) [2023-12-27 22:31:27,099][106225] Updated weights for policy 1, policy_version 458384 (0.0007) [2023-12-27 22:31:27,499][106226] Updated weights for policy 0, policy_version 457008 (0.0009) [2023-12-27 22:31:27,571][106226] Updated weights for policy 0, policy_version 457018 (0.0008) [2023-12-27 22:31:27,627][106226] Updated weights for policy 0, policy_version 457028 (0.0007) [2023-12-27 22:31:27,726][106225] Updated weights for policy 1, policy_version 458394 (0.0005) [2023-12-27 22:31:27,774][106225] Updated weights for policy 1, policy_version 458404 (0.0005) [2023-12-27 22:31:27,832][106225] Updated weights for policy 1, policy_version 458414 (0.0005) [2023-12-27 22:31:28,309][106226] Updated weights for policy 0, policy_version 457038 (0.0006) [2023-12-27 22:31:28,375][106226] Updated weights for policy 0, policy_version 457048 (0.0008) [2023-12-27 22:31:28,433][106226] Updated weights for policy 0, policy_version 457058 (0.0009) [2023-12-27 22:31:28,463][106225] Updated weights for policy 1, policy_version 458424 (0.0006) [2023-12-27 22:31:28,524][106225] Updated weights for policy 1, policy_version 458434 (0.0010) [2023-12-27 22:31:28,586][106225] Updated weights for policy 1, policy_version 458444 (0.0009) [2023-12-27 22:31:29,185][106226] Updated weights for policy 0, policy_version 457068 (0.0009) [2023-12-27 22:31:29,246][106226] Updated weights for policy 0, policy_version 457078 (0.0009) [2023-12-27 22:31:29,305][106226] Updated weights for policy 0, policy_version 457088 (0.0007) [2023-12-27 22:31:29,322][106225] Updated weights for policy 1, policy_version 458454 (0.0010) [2023-12-27 22:31:29,385][106225] Updated weights for policy 1, policy_version 458464 (0.0011) [2023-12-27 22:31:29,448][106225] Updated weights for policy 1, policy_version 458474 (0.0010) [2023-12-27 22:31:30,083][106226] Updated weights for policy 0, policy_version 457098 (0.0007) [2023-12-27 22:31:30,142][106226] Updated weights for policy 0, policy_version 457108 (0.0009) [2023-12-27 22:31:30,170][106225] Updated weights for policy 1, policy_version 458484 (0.0009) [2023-12-27 22:31:30,204][106226] Updated weights for policy 0, policy_version 457118 (0.0007) [2023-12-27 22:31:30,230][106225] Updated weights for policy 1, policy_version 458494 (0.0007) [2023-12-27 22:31:30,259][106226] Updated weights for policy 0, policy_version 457128 (0.0007) [2023-12-27 22:31:30,282][106225] Updated weights for policy 1, policy_version 458504 (0.0006) [2023-12-27 22:31:30,915][106225] Updated weights for policy 1, policy_version 458514 (0.0008) [2023-12-27 22:31:30,969][106225] Updated weights for policy 1, policy_version 458524 (0.0005) [2023-12-27 22:31:30,974][106226] Updated weights for policy 0, policy_version 457138 (0.0007) [2023-12-27 22:31:31,028][106225] Updated weights for policy 1, policy_version 458534 (0.0006) [2023-12-27 22:31:31,062][106226] Updated weights for policy 0, policy_version 457148 (0.0008) [2023-12-27 22:31:31,090][106225] Updated weights for policy 1, policy_version 458544 (0.0007) [2023-12-27 22:31:31,132][106226] Updated weights for policy 0, policy_version 457158 (0.0008) [2023-12-27 22:31:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19605.3). Total num frames: 234479616. Throughput: 0: 9834.8, 1: 9820.3. Samples: 234461760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:31,175][105115] Avg episode reward: [(0, '-4.799'), (1, '-5.627')] [2023-12-27 22:31:31,785][106225] Updated weights for policy 1, policy_version 458554 (0.0007) [2023-12-27 22:31:31,855][106225] Updated weights for policy 1, policy_version 458564 (0.0007) [2023-12-27 22:31:31,904][106226] Updated weights for policy 0, policy_version 457168 (0.0008) [2023-12-27 22:31:31,907][106225] Updated weights for policy 1, policy_version 458574 (0.0006) [2023-12-27 22:31:31,967][106226] Updated weights for policy 0, policy_version 457178 (0.0007) [2023-12-27 22:31:32,029][106226] Updated weights for policy 0, policy_version 457188 (0.0009) [2023-12-27 22:31:32,598][106225] Updated weights for policy 1, policy_version 458584 (0.0008) [2023-12-27 22:31:32,663][106225] Updated weights for policy 1, policy_version 458594 (0.0008) [2023-12-27 22:31:32,704][106226] Updated weights for policy 0, policy_version 457198 (0.0008) [2023-12-27 22:31:32,722][106225] Updated weights for policy 1, policy_version 458604 (0.0007) [2023-12-27 22:31:32,767][106226] Updated weights for policy 0, policy_version 457208 (0.0009) [2023-12-27 22:31:32,833][106226] Updated weights for policy 0, policy_version 457218 (0.0009) [2023-12-27 22:31:33,401][106225] Updated weights for policy 1, policy_version 458614 (0.0010) [2023-12-27 22:31:33,445][106225] Updated weights for policy 1, policy_version 458624 (0.0008) [2023-12-27 22:31:33,480][106226] Updated weights for policy 0, policy_version 457228 (0.0008) [2023-12-27 22:31:33,495][106225] Updated weights for policy 1, policy_version 458634 (0.0007) [2023-12-27 22:31:33,528][106226] Updated weights for policy 0, policy_version 457238 (0.0008) [2023-12-27 22:31:33,581][106226] Updated weights for policy 0, policy_version 457248 (0.0008) [2023-12-27 22:31:34,113][106225] Updated weights for policy 1, policy_version 458644 (0.0006) [2023-12-27 22:31:34,172][106225] Updated weights for policy 1, policy_version 458654 (0.0008) [2023-12-27 22:31:34,220][106226] Updated weights for policy 0, policy_version 457258 (0.0008) [2023-12-27 22:31:34,231][106225] Updated weights for policy 1, policy_version 458664 (0.0008) [2023-12-27 22:31:34,281][106226] Updated weights for policy 0, policy_version 457268 (0.0006) [2023-12-27 22:31:34,345][106226] Updated weights for policy 0, policy_version 457278 (0.0008) [2023-12-27 22:31:34,410][106226] Updated weights for policy 0, policy_version 457288 (0.0008) [2023-12-27 22:31:34,967][106225] Updated weights for policy 1, policy_version 458674 (0.0008) [2023-12-27 22:31:35,021][106225] Updated weights for policy 1, policy_version 458684 (0.0008) [2023-12-27 22:31:35,078][106225] Updated weights for policy 1, policy_version 458694 (0.0008) [2023-12-27 22:31:35,130][106226] Updated weights for policy 0, policy_version 457298 (0.0007) [2023-12-27 22:31:35,132][106225] Updated weights for policy 1, policy_version 458704 (0.0006) [2023-12-27 22:31:35,180][106226] Updated weights for policy 0, policy_version 457308 (0.0008) [2023-12-27 22:31:35,230][106226] Updated weights for policy 0, policy_version 457318 (0.0009) [2023-12-27 22:31:35,737][106225] Updated weights for policy 1, policy_version 458714 (0.0006) [2023-12-27 22:31:35,784][106225] Updated weights for policy 1, policy_version 458724 (0.0008) [2023-12-27 22:31:35,838][106225] Updated weights for policy 1, policy_version 458734 (0.0007) [2023-12-27 22:31:36,011][106226] Updated weights for policy 0, policy_version 457328 (0.0007) [2023-12-27 22:31:36,084][106226] Updated weights for policy 0, policy_version 457338 (0.0008) [2023-12-27 22:31:36,153][106226] Updated weights for policy 0, policy_version 457348 (0.0009) [2023-12-27 22:31:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 234569728. Throughput: 0: 9818.3, 1: 9893.6. Samples: 234582020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:36,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-5.653')] [2023-12-27 22:31:36,606][106225] Updated weights for policy 1, policy_version 458744 (0.0010) [2023-12-27 22:31:36,669][106225] Updated weights for policy 1, policy_version 458754 (0.0008) [2023-12-27 22:31:36,732][106225] Updated weights for policy 1, policy_version 458764 (0.0009) [2023-12-27 22:31:36,760][106226] Updated weights for policy 0, policy_version 457358 (0.0009) [2023-12-27 22:31:36,820][106226] Updated weights for policy 0, policy_version 457368 (0.0010) [2023-12-27 22:31:36,867][106226] Updated weights for policy 0, policy_version 457378 (0.0008) [2023-12-27 22:31:37,368][106225] Updated weights for policy 1, policy_version 458774 (0.0005) [2023-12-27 22:31:37,417][106225] Updated weights for policy 1, policy_version 458784 (0.0005) [2023-12-27 22:31:37,434][106226] Updated weights for policy 0, policy_version 457388 (0.0005) [2023-12-27 22:31:37,463][106225] Updated weights for policy 1, policy_version 458794 (0.0006) [2023-12-27 22:31:37,492][106226] Updated weights for policy 0, policy_version 457398 (0.0005) [2023-12-27 22:31:37,552][106226] Updated weights for policy 0, policy_version 457408 (0.0006) [2023-12-27 22:31:38,003][106225] Updated weights for policy 1, policy_version 458804 (0.0006) [2023-12-27 22:31:38,057][106225] Updated weights for policy 1, policy_version 458814 (0.0005) [2023-12-27 22:31:38,108][106225] Updated weights for policy 1, policy_version 458824 (0.0005) [2023-12-27 22:31:38,179][106226] Updated weights for policy 0, policy_version 457418 (0.0006) [2023-12-27 22:31:38,233][106226] Updated weights for policy 0, policy_version 457428 (0.0010) [2023-12-27 22:31:38,286][106226] Updated weights for policy 0, policy_version 457438 (0.0010) [2023-12-27 22:31:38,354][106226] Updated weights for policy 0, policy_version 457448 (0.0011) [2023-12-27 22:31:38,831][106225] Updated weights for policy 1, policy_version 458834 (0.0006) [2023-12-27 22:31:38,885][106225] Updated weights for policy 1, policy_version 458844 (0.0008) [2023-12-27 22:31:38,949][106225] Updated weights for policy 1, policy_version 458854 (0.0008) [2023-12-27 22:31:39,010][106225] Updated weights for policy 1, policy_version 458864 (0.0008) [2023-12-27 22:31:39,075][106226] Updated weights for policy 0, policy_version 457458 (0.0010) [2023-12-27 22:31:39,128][106226] Updated weights for policy 0, policy_version 457468 (0.0010) [2023-12-27 22:31:39,188][106226] Updated weights for policy 0, policy_version 457478 (0.0010) [2023-12-27 22:31:39,783][106225] Updated weights for policy 1, policy_version 458874 (0.0008) [2023-12-27 22:31:39,845][106225] Updated weights for policy 1, policy_version 458884 (0.0008) [2023-12-27 22:31:39,907][106225] Updated weights for policy 1, policy_version 458894 (0.0009) [2023-12-27 22:31:39,997][106226] Updated weights for policy 0, policy_version 457488 (0.0011) [2023-12-27 22:31:40,058][106226] Updated weights for policy 0, policy_version 457498 (0.0011) [2023-12-27 22:31:40,116][106226] Updated weights for policy 0, policy_version 457508 (0.0010) [2023-12-27 22:31:40,633][106225] Updated weights for policy 1, policy_version 458904 (0.0007) [2023-12-27 22:31:40,698][106225] Updated weights for policy 1, policy_version 458914 (0.0006) [2023-12-27 22:31:40,766][106225] Updated weights for policy 1, policy_version 458924 (0.0006) [2023-12-27 22:31:40,878][106226] Updated weights for policy 0, policy_version 457518 (0.0011) [2023-12-27 22:31:40,943][106226] Updated weights for policy 0, policy_version 457528 (0.0009) [2023-12-27 22:31:41,001][106226] Updated weights for policy 0, policy_version 457538 (0.0009) [2023-12-27 22:31:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19633.0). Total num frames: 234676224. Throughput: 0: 9892.5, 1: 9980.0. Samples: 234645500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-27 22:31:41,175][105115] Avg episode reward: [(0, '-5.053'), (1, '-5.437')] [2023-12-27 22:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000458928_117514240.pth... [2023-12-27 22:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000457544_117161984.pth... [2023-12-27 22:31:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000457744_117211136.pth [2023-12-27 22:31:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000456392_116867072.pth [2023-12-27 22:31:41,483][106225] Updated weights for policy 1, policy_version 458934 (0.0007) [2023-12-27 22:31:41,546][106225] Updated weights for policy 1, policy_version 458944 (0.0008) [2023-12-27 22:31:41,614][106225] Updated weights for policy 1, policy_version 458954 (0.0008) [2023-12-27 22:31:41,814][106226] Updated weights for policy 0, policy_version 457548 (0.0009) [2023-12-27 22:31:41,870][106226] Updated weights for policy 0, policy_version 457558 (0.0008) [2023-12-27 22:31:41,926][106226] Updated weights for policy 0, policy_version 457568 (0.0008) [2023-12-27 22:31:42,354][106225] Updated weights for policy 1, policy_version 458964 (0.0007) [2023-12-27 22:31:42,418][106225] Updated weights for policy 1, policy_version 458974 (0.0007) [2023-12-27 22:31:42,475][106225] Updated weights for policy 1, policy_version 458984 (0.0009) [2023-12-27 22:31:42,650][106226] Updated weights for policy 0, policy_version 457578 (0.0008) [2023-12-27 22:31:42,712][106226] Updated weights for policy 0, policy_version 457588 (0.0008) [2023-12-27 22:31:42,770][106226] Updated weights for policy 0, policy_version 457598 (0.0010) [2023-12-27 22:31:42,835][106226] Updated weights for policy 0, policy_version 457608 (0.0008) [2023-12-27 22:31:43,146][106225] Updated weights for policy 1, policy_version 458994 (0.0008) [2023-12-27 22:31:43,209][106225] Updated weights for policy 1, policy_version 459004 (0.0005) [2023-12-27 22:31:43,263][106225] Updated weights for policy 1, policy_version 459014 (0.0005) [2023-12-27 22:31:43,316][106225] Updated weights for policy 1, policy_version 459024 (0.0005) [2023-12-27 22:31:43,475][106226] Updated weights for policy 0, policy_version 457618 (0.0008) [2023-12-27 22:31:43,537][106226] Updated weights for policy 0, policy_version 457628 (0.0007) [2023-12-27 22:31:43,596][106226] Updated weights for policy 0, policy_version 457638 (0.0010) [2023-12-27 22:31:43,984][106225] Updated weights for policy 1, policy_version 459034 (0.0008) [2023-12-27 22:31:44,045][106225] Updated weights for policy 1, policy_version 459044 (0.0007) [2023-12-27 22:31:44,100][106225] Updated weights for policy 1, policy_version 459054 (0.0005) [2023-12-27 22:31:44,270][106226] Updated weights for policy 0, policy_version 457648 (0.0008) [2023-12-27 22:31:44,330][106226] Updated weights for policy 0, policy_version 457658 (0.0009) [2023-12-27 22:31:44,394][106226] Updated weights for policy 0, policy_version 457668 (0.0008) [2023-12-27 22:31:44,815][106225] Updated weights for policy 1, policy_version 459064 (0.0009) [2023-12-27 22:31:44,863][106225] Updated weights for policy 1, policy_version 459074 (0.0008) [2023-12-27 22:31:44,914][106225] Updated weights for policy 1, policy_version 459084 (0.0008) [2023-12-27 22:31:45,068][106226] Updated weights for policy 0, policy_version 457678 (0.0007) [2023-12-27 22:31:45,132][106226] Updated weights for policy 0, policy_version 457688 (0.0008) [2023-12-27 22:31:45,200][106226] Updated weights for policy 0, policy_version 457698 (0.0006) [2023-12-27 22:31:45,695][106225] Updated weights for policy 1, policy_version 459094 (0.0009) [2023-12-27 22:31:45,746][106225] Updated weights for policy 1, policy_version 459104 (0.0010) [2023-12-27 22:31:45,800][106225] Updated weights for policy 1, policy_version 459114 (0.0010) [2023-12-27 22:31:45,838][106226] Updated weights for policy 0, policy_version 457708 (0.0006) [2023-12-27 22:31:45,901][106226] Updated weights for policy 0, policy_version 457718 (0.0006) [2023-12-27 22:31:45,964][106226] Updated weights for policy 0, policy_version 457728 (0.0009) [2023-12-27 22:31:46,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19605.3). Total num frames: 234774528. Throughput: 0: 9882.8, 1: 10046.2. Samples: 234761004. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:31:46,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.484')] [2023-12-27 22:31:46,404][106225] Updated weights for policy 1, policy_version 459124 (0.0009) [2023-12-27 22:31:46,462][106225] Updated weights for policy 1, policy_version 459134 (0.0006) [2023-12-27 22:31:46,513][106225] Updated weights for policy 1, policy_version 459144 (0.0005) [2023-12-27 22:31:46,626][106226] Updated weights for policy 0, policy_version 457738 (0.0006) [2023-12-27 22:31:46,681][106226] Updated weights for policy 0, policy_version 457748 (0.0008) [2023-12-27 22:31:46,742][106226] Updated weights for policy 0, policy_version 457758 (0.0006) [2023-12-27 22:31:46,794][106226] Updated weights for policy 0, policy_version 457768 (0.0005) [2023-12-27 22:31:47,113][106225] Updated weights for policy 1, policy_version 459154 (0.0006) [2023-12-27 22:31:47,163][106225] Updated weights for policy 1, policy_version 459164 (0.0007) [2023-12-27 22:31:47,210][106225] Updated weights for policy 1, policy_version 459174 (0.0008) [2023-12-27 22:31:47,259][106225] Updated weights for policy 1, policy_version 459184 (0.0007) [2023-12-27 22:31:47,495][106226] Updated weights for policy 0, policy_version 457778 (0.0007) [2023-12-27 22:31:47,553][106226] Updated weights for policy 0, policy_version 457788 (0.0006) [2023-12-27 22:31:47,602][106226] Updated weights for policy 0, policy_version 457798 (0.0005) [2023-12-27 22:31:47,916][106225] Updated weights for policy 1, policy_version 459194 (0.0009) [2023-12-27 22:31:47,975][106225] Updated weights for policy 1, policy_version 459204 (0.0007) [2023-12-27 22:31:48,030][106225] Updated weights for policy 1, policy_version 459214 (0.0005) [2023-12-27 22:31:48,307][106226] Updated weights for policy 0, policy_version 457808 (0.0008) [2023-12-27 22:31:48,368][106226] Updated weights for policy 0, policy_version 457818 (0.0008) [2023-12-27 22:31:48,421][106226] Updated weights for policy 0, policy_version 457828 (0.0009) [2023-12-27 22:31:48,663][106225] Updated weights for policy 1, policy_version 459224 (0.0008) [2023-12-27 22:31:48,726][106225] Updated weights for policy 1, policy_version 459234 (0.0008) [2023-12-27 22:31:48,789][106225] Updated weights for policy 1, policy_version 459244 (0.0009) [2023-12-27 22:31:49,161][106226] Updated weights for policy 0, policy_version 457838 (0.0007) [2023-12-27 22:31:49,233][106226] Updated weights for policy 0, policy_version 457848 (0.0010) [2023-12-27 22:31:49,284][106226] Updated weights for policy 0, policy_version 457858 (0.0010) [2023-12-27 22:31:49,535][106225] Updated weights for policy 1, policy_version 459254 (0.0008) [2023-12-27 22:31:49,595][106225] Updated weights for policy 1, policy_version 459264 (0.0008) [2023-12-27 22:31:49,657][106225] Updated weights for policy 1, policy_version 459274 (0.0008) [2023-12-27 22:31:50,038][106226] Updated weights for policy 0, policy_version 457868 (0.0009) [2023-12-27 22:31:50,096][106226] Updated weights for policy 0, policy_version 457878 (0.0006) [2023-12-27 22:31:50,158][106226] Updated weights for policy 0, policy_version 457888 (0.0005) [2023-12-27 22:31:50,359][106225] Updated weights for policy 1, policy_version 459284 (0.0007) [2023-12-27 22:31:50,415][106225] Updated weights for policy 1, policy_version 459294 (0.0006) [2023-12-27 22:31:50,470][106225] Updated weights for policy 1, policy_version 459304 (0.0008) [2023-12-27 22:31:50,832][106226] Updated weights for policy 0, policy_version 457898 (0.0007) [2023-12-27 22:31:50,890][106226] Updated weights for policy 0, policy_version 457908 (0.0008) [2023-12-27 22:31:50,949][106226] Updated weights for policy 0, policy_version 457918 (0.0009) [2023-12-27 22:31:51,016][106226] Updated weights for policy 0, policy_version 457928 (0.0009) [2023-12-27 22:31:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19605.3). Total num frames: 234872832. Throughput: 0: 9835.8, 1: 10114.7. Samples: 234880700. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:31:51,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.630')] [2023-12-27 22:31:51,210][106225] Updated weights for policy 1, policy_version 459314 (0.0007) [2023-12-27 22:31:51,269][106225] Updated weights for policy 1, policy_version 459324 (0.0009) [2023-12-27 22:31:51,329][106225] Updated weights for policy 1, policy_version 459334 (0.0006) [2023-12-27 22:31:51,404][106225] Updated weights for policy 1, policy_version 459344 (0.0008) [2023-12-27 22:31:51,762][106226] Updated weights for policy 0, policy_version 457938 (0.0009) [2023-12-27 22:31:51,824][106226] Updated weights for policy 0, policy_version 457948 (0.0008) [2023-12-27 22:31:51,884][106226] Updated weights for policy 0, policy_version 457958 (0.0009) [2023-12-27 22:31:52,134][106225] Updated weights for policy 1, policy_version 459354 (0.0008) [2023-12-27 22:31:52,194][106225] Updated weights for policy 1, policy_version 459364 (0.0008) [2023-12-27 22:31:52,258][106225] Updated weights for policy 1, policy_version 459374 (0.0010) [2023-12-27 22:31:52,693][106226] Updated weights for policy 0, policy_version 457968 (0.0008) [2023-12-27 22:31:52,754][106226] Updated weights for policy 0, policy_version 457978 (0.0008) [2023-12-27 22:31:52,813][106226] Updated weights for policy 0, policy_version 457988 (0.0008) [2023-12-27 22:31:52,932][106225] Updated weights for policy 1, policy_version 459384 (0.0009) [2023-12-27 22:31:52,990][106225] Updated weights for policy 1, policy_version 459394 (0.0008) [2023-12-27 22:31:53,054][106225] Updated weights for policy 1, policy_version 459404 (0.0009) [2023-12-27 22:31:53,588][106226] Updated weights for policy 0, policy_version 457998 (0.0008) [2023-12-27 22:31:53,651][106226] Updated weights for policy 0, policy_version 458008 (0.0007) [2023-12-27 22:31:53,664][106225] Updated weights for policy 1, policy_version 459414 (0.0008) [2023-12-27 22:31:53,705][106226] Updated weights for policy 0, policy_version 458018 (0.0006) [2023-12-27 22:31:53,717][106225] Updated weights for policy 1, policy_version 459424 (0.0006) [2023-12-27 22:31:53,770][106225] Updated weights for policy 1, policy_version 459434 (0.0007) [2023-12-27 22:31:54,401][106226] Updated weights for policy 0, policy_version 458028 (0.0008) [2023-12-27 22:31:54,462][106226] Updated weights for policy 0, policy_version 458038 (0.0008) [2023-12-27 22:31:54,495][106225] Updated weights for policy 1, policy_version 459444 (0.0009) [2023-12-27 22:31:54,524][106226] Updated weights for policy 0, policy_version 458048 (0.0008) [2023-12-27 22:31:54,553][106225] Updated weights for policy 1, policy_version 459454 (0.0010) [2023-12-27 22:31:54,601][106225] Updated weights for policy 1, policy_version 459464 (0.0010) [2023-12-27 22:31:55,249][106226] Updated weights for policy 0, policy_version 458058 (0.0006) [2023-12-27 22:31:55,298][106226] Updated weights for policy 0, policy_version 458068 (0.0008) [2023-12-27 22:31:55,332][106225] Updated weights for policy 1, policy_version 459474 (0.0010) [2023-12-27 22:31:55,346][106226] Updated weights for policy 0, policy_version 458078 (0.0006) [2023-12-27 22:31:55,389][106225] Updated weights for policy 1, policy_version 459484 (0.0010) [2023-12-27 22:31:55,390][106226] Updated weights for policy 0, policy_version 458088 (0.0009) [2023-12-27 22:31:55,446][106225] Updated weights for policy 1, policy_version 459494 (0.0010) [2023-12-27 22:31:55,506][106225] Updated weights for policy 1, policy_version 459504 (0.0010) [2023-12-27 22:31:56,012][106226] Updated weights for policy 0, policy_version 458098 (0.0011) [2023-12-27 22:31:56,065][106226] Updated weights for policy 0, policy_version 458108 (0.0010) [2023-12-27 22:31:56,120][106226] Updated weights for policy 0, policy_version 458118 (0.0011) [2023-12-27 22:31:56,162][106225] Updated weights for policy 1, policy_version 459514 (0.0007) [2023-12-27 22:31:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19605.3). Total num frames: 234971136. Throughput: 0: 9794.9, 1: 10113.0. Samples: 234938708. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:31:56,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.631')] [2023-12-27 22:31:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000458120_117309440.pth... [2023-12-27 22:31:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000456968_117014528.pth [2023-12-27 22:31:56,232][106225] Updated weights for policy 1, policy_version 459524 (0.0008) [2023-12-27 22:31:56,291][106225] Updated weights for policy 1, policy_version 459534 (0.0007) [2023-12-27 22:31:56,297][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000459536_117669888.pth... [2023-12-27 22:31:56,300][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000458352_117366784.pth [2023-12-27 22:31:56,737][106226] Updated weights for policy 0, policy_version 458128 (0.0009) [2023-12-27 22:31:56,791][106226] Updated weights for policy 0, policy_version 458138 (0.0009) [2023-12-27 22:31:56,851][106226] Updated weights for policy 0, policy_version 458148 (0.0008) [2023-12-27 22:31:56,995][106225] Updated weights for policy 1, policy_version 459544 (0.0008) [2023-12-27 22:31:57,049][106225] Updated weights for policy 1, policy_version 459554 (0.0008) [2023-12-27 22:31:57,118][106225] Updated weights for policy 1, policy_version 459564 (0.0009) [2023-12-27 22:31:57,525][106226] Updated weights for policy 0, policy_version 458158 (0.0008) [2023-12-27 22:31:57,571][106226] Updated weights for policy 0, policy_version 458168 (0.0006) [2023-12-27 22:31:57,616][106226] Updated weights for policy 0, policy_version 458178 (0.0005) [2023-12-27 22:31:57,882][106225] Updated weights for policy 1, policy_version 459574 (0.0008) [2023-12-27 22:31:57,932][106225] Updated weights for policy 1, policy_version 459584 (0.0006) [2023-12-27 22:31:57,991][106225] Updated weights for policy 1, policy_version 459594 (0.0006) [2023-12-27 22:31:58,232][106226] Updated weights for policy 0, policy_version 458188 (0.0006) [2023-12-27 22:31:58,298][106226] Updated weights for policy 0, policy_version 458198 (0.0008) [2023-12-27 22:31:58,376][106226] Updated weights for policy 0, policy_version 458208 (0.0008) [2023-12-27 22:31:58,757][106225] Updated weights for policy 1, policy_version 459604 (0.0008) [2023-12-27 22:31:58,829][106225] Updated weights for policy 1, policy_version 459614 (0.0008) [2023-12-27 22:31:58,890][106225] Updated weights for policy 1, policy_version 459624 (0.0008) [2023-12-27 22:31:59,186][106226] Updated weights for policy 0, policy_version 458218 (0.0007) [2023-12-27 22:31:59,270][106226] Updated weights for policy 0, policy_version 458228 (0.0008) [2023-12-27 22:31:59,335][106226] Updated weights for policy 0, policy_version 458238 (0.0009) [2023-12-27 22:31:59,404][106226] Updated weights for policy 0, policy_version 458248 (0.0008) [2023-12-27 22:31:59,659][106225] Updated weights for policy 1, policy_version 459634 (0.0008) [2023-12-27 22:31:59,711][106225] Updated weights for policy 1, policy_version 459644 (0.0006) [2023-12-27 22:31:59,763][106225] Updated weights for policy 1, policy_version 459654 (0.0009) [2023-12-27 22:31:59,815][106225] Updated weights for policy 1, policy_version 459664 (0.0008) [2023-12-27 22:32:00,038][106226] Updated weights for policy 0, policy_version 458258 (0.0007) [2023-12-27 22:32:00,085][106226] Updated weights for policy 0, policy_version 458268 (0.0005) [2023-12-27 22:32:00,144][106226] Updated weights for policy 0, policy_version 458278 (0.0007) [2023-12-27 22:32:00,540][106225] Updated weights for policy 1, policy_version 459674 (0.0005) [2023-12-27 22:32:00,605][106225] Updated weights for policy 1, policy_version 459684 (0.0006) [2023-12-27 22:32:00,662][106225] Updated weights for policy 1, policy_version 459694 (0.0008) [2023-12-27 22:32:00,765][106226] Updated weights for policy 0, policy_version 458288 (0.0008) [2023-12-27 22:32:00,822][106226] Updated weights for policy 0, policy_version 458298 (0.0006) [2023-12-27 22:32:00,880][106226] Updated weights for policy 0, policy_version 458308 (0.0006) [2023-12-27 22:32:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19605.3). Total num frames: 235069440. Throughput: 0: 9831.4, 1: 10061.0. Samples: 235056880. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:01,175][105115] Avg episode reward: [(0, '-5.071'), (1, '-5.117')] [2023-12-27 22:32:01,409][106225] Updated weights for policy 1, policy_version 459704 (0.0008) [2023-12-27 22:32:01,465][106225] Updated weights for policy 1, policy_version 459714 (0.0008) [2023-12-27 22:32:01,523][106225] Updated weights for policy 1, policy_version 459724 (0.0008) [2023-12-27 22:32:01,568][106226] Updated weights for policy 0, policy_version 458318 (0.0006) [2023-12-27 22:32:01,637][106226] Updated weights for policy 0, policy_version 458328 (0.0008) [2023-12-27 22:32:01,703][106226] Updated weights for policy 0, policy_version 458338 (0.0009) [2023-12-27 22:32:02,290][106225] Updated weights for policy 1, policy_version 459734 (0.0008) [2023-12-27 22:32:02,350][106225] Updated weights for policy 1, policy_version 459744 (0.0009) [2023-12-27 22:32:02,393][106226] Updated weights for policy 0, policy_version 458348 (0.0010) [2023-12-27 22:32:02,414][106225] Updated weights for policy 1, policy_version 459754 (0.0008) [2023-12-27 22:32:02,455][106226] Updated weights for policy 0, policy_version 458358 (0.0008) [2023-12-27 22:32:02,517][106226] Updated weights for policy 0, policy_version 458368 (0.0008) [2023-12-27 22:32:03,090][106225] Updated weights for policy 1, policy_version 459764 (0.0007) [2023-12-27 22:32:03,147][106225] Updated weights for policy 1, policy_version 459774 (0.0006) [2023-12-27 22:32:03,196][106226] Updated weights for policy 0, policy_version 458378 (0.0007) [2023-12-27 22:32:03,210][106225] Updated weights for policy 1, policy_version 459784 (0.0006) [2023-12-27 22:32:03,256][106226] Updated weights for policy 0, policy_version 458388 (0.0009) [2023-12-27 22:32:03,313][106226] Updated weights for policy 0, policy_version 458398 (0.0009) [2023-12-27 22:32:03,373][106226] Updated weights for policy 0, policy_version 458408 (0.0005) [2023-12-27 22:32:03,893][106225] Updated weights for policy 1, policy_version 459794 (0.0010) [2023-12-27 22:32:03,909][106226] Updated weights for policy 0, policy_version 458418 (0.0007) [2023-12-27 22:32:03,955][106225] Updated weights for policy 1, policy_version 459804 (0.0010) [2023-12-27 22:32:03,970][106226] Updated weights for policy 0, policy_version 458428 (0.0008) [2023-12-27 22:32:04,014][106225] Updated weights for policy 1, policy_version 459814 (0.0007) [2023-12-27 22:32:04,024][106226] Updated weights for policy 0, policy_version 458438 (0.0008) [2023-12-27 22:32:04,071][106225] Updated weights for policy 1, policy_version 459824 (0.0006) [2023-12-27 22:32:04,692][106226] Updated weights for policy 0, policy_version 458448 (0.0009) [2023-12-27 22:32:04,732][106225] Updated weights for policy 1, policy_version 459834 (0.0010) [2023-12-27 22:32:04,752][106226] Updated weights for policy 0, policy_version 458458 (0.0010) [2023-12-27 22:32:04,792][106225] Updated weights for policy 1, policy_version 459844 (0.0010) [2023-12-27 22:32:04,806][106226] Updated weights for policy 0, policy_version 458468 (0.0010) [2023-12-27 22:32:04,846][106225] Updated weights for policy 1, policy_version 459854 (0.0010) [2023-12-27 22:32:05,504][106226] Updated weights for policy 0, policy_version 458478 (0.0009) [2023-12-27 22:32:05,510][106225] Updated weights for policy 1, policy_version 459864 (0.0007) [2023-12-27 22:32:05,552][106226] Updated weights for policy 0, policy_version 458488 (0.0008) [2023-12-27 22:32:05,562][106225] Updated weights for policy 1, policy_version 459874 (0.0006) [2023-12-27 22:32:05,604][106226] Updated weights for policy 0, policy_version 458498 (0.0005) [2023-12-27 22:32:05,618][106225] Updated weights for policy 1, policy_version 459884 (0.0009) [2023-12-27 22:32:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 235167744. Throughput: 0: 9905.5, 1: 10030.1. Samples: 235179256. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:06,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.555')] [2023-12-27 22:32:06,312][106226] Updated weights for policy 0, policy_version 458508 (0.0008) [2023-12-27 22:32:06,315][106225] Updated weights for policy 1, policy_version 459894 (0.0008) [2023-12-27 22:32:06,378][106226] Updated weights for policy 0, policy_version 458518 (0.0008) [2023-12-27 22:32:06,381][106225] Updated weights for policy 1, policy_version 459904 (0.0007) [2023-12-27 22:32:06,442][106225] Updated weights for policy 1, policy_version 459914 (0.0009) [2023-12-27 22:32:06,443][106226] Updated weights for policy 0, policy_version 458528 (0.0009) [2023-12-27 22:32:06,991][106226] Updated weights for policy 0, policy_version 458538 (0.0006) [2023-12-27 22:32:07,049][106226] Updated weights for policy 0, policy_version 458548 (0.0006) [2023-12-27 22:32:07,112][106226] Updated weights for policy 0, policy_version 458558 (0.0010) [2023-12-27 22:32:07,174][106225] Updated weights for policy 1, policy_version 459924 (0.0005) [2023-12-27 22:32:07,176][106226] Updated weights for policy 0, policy_version 458568 (0.0011) [2023-12-27 22:32:07,221][106225] Updated weights for policy 1, policy_version 459934 (0.0006) [2023-12-27 22:32:07,268][106225] Updated weights for policy 1, policy_version 459944 (0.0007) [2023-12-27 22:32:07,837][106226] Updated weights for policy 0, policy_version 458578 (0.0005) [2023-12-27 22:32:07,890][106226] Updated weights for policy 0, policy_version 458588 (0.0005) [2023-12-27 22:32:07,939][106226] Updated weights for policy 0, policy_version 458598 (0.0005) [2023-12-27 22:32:08,011][106225] Updated weights for policy 1, policy_version 459954 (0.0009) [2023-12-27 22:32:08,074][106225] Updated weights for policy 1, policy_version 459964 (0.0009) [2023-12-27 22:32:08,140][106225] Updated weights for policy 1, policy_version 459974 (0.0009) [2023-12-27 22:32:08,191][106225] Updated weights for policy 1, policy_version 459984 (0.0008) [2023-12-27 22:32:08,664][106226] Updated weights for policy 0, policy_version 458608 (0.0007) [2023-12-27 22:32:08,726][106226] Updated weights for policy 0, policy_version 458618 (0.0010) [2023-12-27 22:32:08,795][106226] Updated weights for policy 0, policy_version 458628 (0.0010) [2023-12-27 22:32:08,866][106225] Updated weights for policy 1, policy_version 459994 (0.0007) [2023-12-27 22:32:08,940][106225] Updated weights for policy 1, policy_version 460004 (0.0006) [2023-12-27 22:32:09,008][106225] Updated weights for policy 1, policy_version 460014 (0.0010) [2023-12-27 22:32:09,441][106226] Updated weights for policy 0, policy_version 458638 (0.0011) [2023-12-27 22:32:09,500][106226] Updated weights for policy 0, policy_version 458648 (0.0011) [2023-12-27 22:32:09,554][106226] Updated weights for policy 0, policy_version 458658 (0.0010) [2023-12-27 22:32:09,781][106225] Updated weights for policy 1, policy_version 460024 (0.0007) [2023-12-27 22:32:09,850][106225] Updated weights for policy 1, policy_version 460034 (0.0008) [2023-12-27 22:32:09,910][106225] Updated weights for policy 1, policy_version 460044 (0.0008) [2023-12-27 22:32:10,308][106226] Updated weights for policy 0, policy_version 458668 (0.0011) [2023-12-27 22:32:10,370][106226] Updated weights for policy 0, policy_version 458678 (0.0011) [2023-12-27 22:32:10,439][106226] Updated weights for policy 0, policy_version 458688 (0.0011) [2023-12-27 22:32:10,636][106225] Updated weights for policy 1, policy_version 460054 (0.0008) [2023-12-27 22:32:10,698][106225] Updated weights for policy 1, policy_version 460064 (0.0008) [2023-12-27 22:32:10,759][106225] Updated weights for policy 1, policy_version 460074 (0.0008) [2023-12-27 22:32:11,167][106226] Updated weights for policy 0, policy_version 458698 (0.0010) [2023-12-27 22:32:11,176][105115] Fps is (10 sec: 19658.3, 60 sec: 19797.0, 300 sec: 19605.2). Total num frames: 235266048. Throughput: 0: 9973.7, 1: 10014.5. Samples: 235240072. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:11,177][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.236')] [2023-12-27 22:32:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000460080_117809152.pth... [2023-12-27 22:32:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000458928_117514240.pth [2023-12-27 22:32:11,237][106226] Updated weights for policy 0, policy_version 458708 (0.0011) [2023-12-27 22:32:11,309][106226] Updated weights for policy 0, policy_version 458718 (0.0011) [2023-12-27 22:32:11,377][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000458728_117465088.pth... [2023-12-27 22:32:11,380][106226] Updated weights for policy 0, policy_version 458728 (0.0010) [2023-12-27 22:32:11,382][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000457544_117161984.pth [2023-12-27 22:32:11,492][106225] Updated weights for policy 1, policy_version 460084 (0.0008) [2023-12-27 22:32:11,562][106225] Updated weights for policy 1, policy_version 460094 (0.0008) [2023-12-27 22:32:11,630][106225] Updated weights for policy 1, policy_version 460104 (0.0008) [2023-12-27 22:32:12,143][106226] Updated weights for policy 0, policy_version 458738 (0.0009) [2023-12-27 22:32:12,190][106226] Updated weights for policy 0, policy_version 458748 (0.0010) [2023-12-27 22:32:12,242][106226] Updated weights for policy 0, policy_version 458758 (0.0011) [2023-12-27 22:32:12,352][106225] Updated weights for policy 1, policy_version 460114 (0.0008) [2023-12-27 22:32:12,412][106225] Updated weights for policy 1, policy_version 460124 (0.0008) [2023-12-27 22:32:12,476][106225] Updated weights for policy 1, policy_version 460134 (0.0010) [2023-12-27 22:32:12,538][106225] Updated weights for policy 1, policy_version 460144 (0.0008) [2023-12-27 22:32:12,963][106226] Updated weights for policy 0, policy_version 458768 (0.0009) [2023-12-27 22:32:13,016][106226] Updated weights for policy 0, policy_version 458778 (0.0008) [2023-12-27 22:32:13,066][106226] Updated weights for policy 0, policy_version 458788 (0.0008) [2023-12-27 22:32:13,267][106225] Updated weights for policy 1, policy_version 460154 (0.0008) [2023-12-27 22:32:13,328][106225] Updated weights for policy 1, policy_version 460164 (0.0008) [2023-12-27 22:32:13,394][106225] Updated weights for policy 1, policy_version 460174 (0.0008) [2023-12-27 22:32:13,764][106226] Updated weights for policy 0, policy_version 458798 (0.0008) [2023-12-27 22:32:13,820][106226] Updated weights for policy 0, policy_version 458808 (0.0008) [2023-12-27 22:32:13,874][106226] Updated weights for policy 0, policy_version 458818 (0.0008) [2023-12-27 22:32:14,073][106225] Updated weights for policy 1, policy_version 460184 (0.0006) [2023-12-27 22:32:14,120][106225] Updated weights for policy 1, policy_version 460194 (0.0006) [2023-12-27 22:32:14,169][106225] Updated weights for policy 1, policy_version 460204 (0.0005) [2023-12-27 22:32:14,464][106226] Updated weights for policy 0, policy_version 458828 (0.0005) [2023-12-27 22:32:14,519][106226] Updated weights for policy 0, policy_version 458838 (0.0005) [2023-12-27 22:32:14,580][106226] Updated weights for policy 0, policy_version 458848 (0.0008) [2023-12-27 22:32:14,792][106225] Updated weights for policy 1, policy_version 460216 (0.0007) [2023-12-27 22:32:14,853][106225] Updated weights for policy 1, policy_version 460226 (0.0007) [2023-12-27 22:32:14,920][106225] Updated weights for policy 1, policy_version 460236 (0.0006) [2023-12-27 22:32:15,311][106226] Updated weights for policy 0, policy_version 458858 (0.0008) [2023-12-27 22:32:15,364][106226] Updated weights for policy 0, policy_version 458868 (0.0008) [2023-12-27 22:32:15,420][106226] Updated weights for policy 0, policy_version 458878 (0.0008) [2023-12-27 22:32:15,471][106226] Updated weights for policy 0, policy_version 458888 (0.0009) [2023-12-27 22:32:15,577][106225] Updated weights for policy 1, policy_version 460246 (0.0007) [2023-12-27 22:32:15,639][106225] Updated weights for policy 1, policy_version 460256 (0.0005) [2023-12-27 22:32:15,692][106225] Updated weights for policy 1, policy_version 460266 (0.0005) [2023-12-27 22:32:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 235364352. Throughput: 0: 9968.0, 1: 9917.4. Samples: 235356604. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:16,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.444')] [2023-12-27 22:32:16,257][106226] Updated weights for policy 0, policy_version 458898 (0.0008) [2023-12-27 22:32:16,270][106225] Updated weights for policy 1, policy_version 460276 (0.0005) [2023-12-27 22:32:16,315][106226] Updated weights for policy 0, policy_version 458908 (0.0008) [2023-12-27 22:32:16,331][106225] Updated weights for policy 1, policy_version 460286 (0.0005) [2023-12-27 22:32:16,379][106226] Updated weights for policy 0, policy_version 458918 (0.0007) [2023-12-27 22:32:16,394][106225] Updated weights for policy 1, policy_version 460296 (0.0008) [2023-12-27 22:32:16,981][106225] Updated weights for policy 1, policy_version 460306 (0.0006) [2023-12-27 22:32:17,040][106225] Updated weights for policy 1, policy_version 460316 (0.0006) [2023-12-27 22:32:17,109][106225] Updated weights for policy 1, policy_version 460326 (0.0005) [2023-12-27 22:32:17,176][106225] Updated weights for policy 1, policy_version 460336 (0.0006) [2023-12-27 22:32:17,182][106226] Updated weights for policy 0, policy_version 458928 (0.0009) [2023-12-27 22:32:17,238][106226] Updated weights for policy 0, policy_version 458938 (0.0009) [2023-12-27 22:32:17,293][106226] Updated weights for policy 0, policy_version 458948 (0.0008) [2023-12-27 22:32:17,814][106225] Updated weights for policy 1, policy_version 460346 (0.0007) [2023-12-27 22:32:17,869][106225] Updated weights for policy 1, policy_version 460356 (0.0007) [2023-12-27 22:32:17,916][106225] Updated weights for policy 1, policy_version 460366 (0.0008) [2023-12-27 22:32:18,039][106226] Updated weights for policy 0, policy_version 458958 (0.0007) [2023-12-27 22:32:18,100][106226] Updated weights for policy 0, policy_version 458968 (0.0006) [2023-12-27 22:32:18,188][106226] Updated weights for policy 0, policy_version 458978 (0.0006) [2023-12-27 22:32:18,687][106225] Updated weights for policy 1, policy_version 460376 (0.0008) [2023-12-27 22:32:18,749][106225] Updated weights for policy 1, policy_version 460386 (0.0008) [2023-12-27 22:32:18,804][106225] Updated weights for policy 1, policy_version 460396 (0.0007) [2023-12-27 22:32:18,824][106226] Updated weights for policy 0, policy_version 458988 (0.0007) [2023-12-27 22:32:18,892][106226] Updated weights for policy 0, policy_version 458998 (0.0008) [2023-12-27 22:32:18,950][106226] Updated weights for policy 0, policy_version 459008 (0.0011) [2023-12-27 22:32:19,585][106225] Updated weights for policy 1, policy_version 460406 (0.0010) [2023-12-27 22:32:19,645][106225] Updated weights for policy 1, policy_version 460416 (0.0010) [2023-12-27 22:32:19,669][106226] Updated weights for policy 0, policy_version 459018 (0.0010) [2023-12-27 22:32:19,708][106225] Updated weights for policy 1, policy_version 460426 (0.0009) [2023-12-27 22:32:19,730][106226] Updated weights for policy 0, policy_version 459028 (0.0008) [2023-12-27 22:32:19,795][106226] Updated weights for policy 0, policy_version 459038 (0.0007) [2023-12-27 22:32:19,864][106226] Updated weights for policy 0, policy_version 459048 (0.0008) [2023-12-27 22:32:20,455][106225] Updated weights for policy 1, policy_version 460436 (0.0010) [2023-12-27 22:32:20,515][106225] Updated weights for policy 1, policy_version 460446 (0.0008) [2023-12-27 22:32:20,577][106225] Updated weights for policy 1, policy_version 460456 (0.0008) [2023-12-27 22:32:20,601][106226] Updated weights for policy 0, policy_version 459058 (0.0008) [2023-12-27 22:32:20,666][106226] Updated weights for policy 0, policy_version 459068 (0.0007) [2023-12-27 22:32:20,736][106226] Updated weights for policy 0, policy_version 459078 (0.0009) [2023-12-27 22:32:21,175][105115] Fps is (10 sec: 19663.4, 60 sec: 19797.4, 300 sec: 19633.0). Total num frames: 235462656. Throughput: 0: 9915.9, 1: 9891.2. Samples: 235473340. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:21,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-5.401')] [2023-12-27 22:32:21,390][106225] Updated weights for policy 1, policy_version 460466 (0.0007) [2023-12-27 22:32:21,453][106225] Updated weights for policy 1, policy_version 460476 (0.0007) [2023-12-27 22:32:21,484][106226] Updated weights for policy 0, policy_version 459088 (0.0007) [2023-12-27 22:32:21,508][106225] Updated weights for policy 1, policy_version 460486 (0.0008) [2023-12-27 22:32:21,551][106226] Updated weights for policy 0, policy_version 459098 (0.0010) [2023-12-27 22:32:21,567][106225] Updated weights for policy 1, policy_version 460496 (0.0009) [2023-12-27 22:32:21,618][106226] Updated weights for policy 0, policy_version 459108 (0.0010) [2023-12-27 22:32:22,329][106225] Updated weights for policy 1, policy_version 460506 (0.0008) [2023-12-27 22:32:22,360][106226] Updated weights for policy 0, policy_version 459118 (0.0009) [2023-12-27 22:32:22,398][106225] Updated weights for policy 1, policy_version 460516 (0.0008) [2023-12-27 22:32:22,420][106226] Updated weights for policy 0, policy_version 459128 (0.0007) [2023-12-27 22:32:22,453][106225] Updated weights for policy 1, policy_version 460526 (0.0008) [2023-12-27 22:32:22,482][106226] Updated weights for policy 0, policy_version 459138 (0.0007) [2023-12-27 22:32:23,096][106225] Updated weights for policy 1, policy_version 460536 (0.0010) [2023-12-27 22:32:23,144][106225] Updated weights for policy 1, policy_version 460546 (0.0010) [2023-12-27 22:32:23,192][106225] Updated weights for policy 1, policy_version 460556 (0.0010) [2023-12-27 22:32:23,284][106226] Updated weights for policy 0, policy_version 459148 (0.0009) [2023-12-27 22:32:23,337][106226] Updated weights for policy 0, policy_version 459158 (0.0010) [2023-12-27 22:32:23,393][106226] Updated weights for policy 0, policy_version 459168 (0.0010) [2023-12-27 22:32:23,914][106225] Updated weights for policy 1, policy_version 460566 (0.0009) [2023-12-27 22:32:23,977][106225] Updated weights for policy 1, policy_version 460576 (0.0007) [2023-12-27 22:32:24,030][106225] Updated weights for policy 1, policy_version 460586 (0.0008) [2023-12-27 22:32:24,086][106226] Updated weights for policy 0, policy_version 459178 (0.0010) [2023-12-27 22:32:24,142][106226] Updated weights for policy 0, policy_version 459188 (0.0010) [2023-12-27 22:32:24,199][106226] Updated weights for policy 0, policy_version 459198 (0.0011) [2023-12-27 22:32:24,249][106226] Updated weights for policy 0, policy_version 459208 (0.0010) [2023-12-27 22:32:24,677][106225] Updated weights for policy 1, policy_version 460596 (0.0007) [2023-12-27 22:32:24,731][106225] Updated weights for policy 1, policy_version 460606 (0.0007) [2023-12-27 22:32:24,789][106225] Updated weights for policy 1, policy_version 460616 (0.0009) [2023-12-27 22:32:24,860][106226] Updated weights for policy 0, policy_version 459218 (0.0005) [2023-12-27 22:32:24,916][106226] Updated weights for policy 0, policy_version 459228 (0.0005) [2023-12-27 22:32:24,970][106226] Updated weights for policy 0, policy_version 459238 (0.0005) [2023-12-27 22:32:25,541][106225] Updated weights for policy 1, policy_version 460626 (0.0008) [2023-12-27 22:32:25,569][106226] Updated weights for policy 0, policy_version 459248 (0.0009) [2023-12-27 22:32:25,586][106225] Updated weights for policy 1, policy_version 460636 (0.0006) [2023-12-27 22:32:25,625][106226] Updated weights for policy 0, policy_version 459258 (0.0010) [2023-12-27 22:32:25,630][106225] Updated weights for policy 1, policy_version 460646 (0.0005) [2023-12-27 22:32:25,675][106226] Updated weights for policy 0, policy_version 459268 (0.0010) [2023-12-27 22:32:25,676][106225] Updated weights for policy 1, policy_version 460656 (0.0005) [2023-12-27 22:32:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19605.3). Total num frames: 235560960. Throughput: 0: 9827.7, 1: 9824.0. Samples: 235529828. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:26,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.338')] [2023-12-27 22:32:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000460656_117956608.pth... [2023-12-27 22:32:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000459272_117604352.pth... [2023-12-27 22:32:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000458120_117309440.pth [2023-12-27 22:32:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000459536_117669888.pth [2023-12-27 22:32:26,269][106226] Updated weights for policy 0, policy_version 459278 (0.0008) [2023-12-27 22:32:26,323][106226] Updated weights for policy 0, policy_version 459288 (0.0006) [2023-12-27 22:32:26,325][106225] Updated weights for policy 1, policy_version 460666 (0.0007) [2023-12-27 22:32:26,380][106226] Updated weights for policy 0, policy_version 459298 (0.0005) [2023-12-27 22:32:26,382][106225] Updated weights for policy 1, policy_version 460676 (0.0010) [2023-12-27 22:32:26,442][106225] Updated weights for policy 1, policy_version 460686 (0.0010) [2023-12-27 22:32:26,924][106226] Updated weights for policy 0, policy_version 459308 (0.0006) [2023-12-27 22:32:26,981][106226] Updated weights for policy 0, policy_version 459318 (0.0005) [2023-12-27 22:32:27,036][106226] Updated weights for policy 0, policy_version 459328 (0.0005) [2023-12-27 22:32:27,138][106225] Updated weights for policy 1, policy_version 460696 (0.0010) [2023-12-27 22:32:27,209][106225] Updated weights for policy 1, policy_version 460706 (0.0010) [2023-12-27 22:32:27,262][106225] Updated weights for policy 1, policy_version 460716 (0.0010) [2023-12-27 22:32:27,729][106226] Updated weights for policy 0, policy_version 459338 (0.0006) [2023-12-27 22:32:27,800][106226] Updated weights for policy 0, policy_version 459348 (0.0006) [2023-12-27 22:32:27,850][106226] Updated weights for policy 0, policy_version 459358 (0.0005) [2023-12-27 22:32:27,893][106225] Updated weights for policy 1, policy_version 460726 (0.0007) [2023-12-27 22:32:27,899][106226] Updated weights for policy 0, policy_version 459368 (0.0007) [2023-12-27 22:32:27,949][106225] Updated weights for policy 1, policy_version 460736 (0.0005) [2023-12-27 22:32:28,007][106225] Updated weights for policy 1, policy_version 460746 (0.0006) [2023-12-27 22:32:28,629][106225] Updated weights for policy 1, policy_version 460756 (0.0010) [2023-12-27 22:32:28,646][106226] Updated weights for policy 0, policy_version 459378 (0.0006) [2023-12-27 22:32:28,682][106225] Updated weights for policy 1, policy_version 460766 (0.0010) [2023-12-27 22:32:28,700][106226] Updated weights for policy 0, policy_version 459388 (0.0006) [2023-12-27 22:32:28,749][106225] Updated weights for policy 1, policy_version 460776 (0.0010) [2023-12-27 22:32:28,760][106226] Updated weights for policy 0, policy_version 459398 (0.0009) [2023-12-27 22:32:29,444][106225] Updated weights for policy 1, policy_version 460786 (0.0008) [2023-12-27 22:32:29,493][106225] Updated weights for policy 1, policy_version 460796 (0.0008) [2023-12-27 22:32:29,535][106226] Updated weights for policy 0, policy_version 459408 (0.0009) [2023-12-27 22:32:29,541][106225] Updated weights for policy 1, policy_version 460806 (0.0006) [2023-12-27 22:32:29,590][106226] Updated weights for policy 0, policy_version 459418 (0.0006) [2023-12-27 22:32:29,596][106225] Updated weights for policy 1, policy_version 460816 (0.0007) [2023-12-27 22:32:29,648][106226] Updated weights for policy 0, policy_version 459428 (0.0008) [2023-12-27 22:32:30,362][106225] Updated weights for policy 1, policy_version 460826 (0.0008) [2023-12-27 22:32:30,388][106226] Updated weights for policy 0, policy_version 459438 (0.0007) [2023-12-27 22:32:30,417][106225] Updated weights for policy 1, policy_version 460836 (0.0006) [2023-12-27 22:32:30,443][106226] Updated weights for policy 0, policy_version 459448 (0.0009) [2023-12-27 22:32:30,470][106225] Updated weights for policy 1, policy_version 460846 (0.0006) [2023-12-27 22:32:30,507][106226] Updated weights for policy 0, policy_version 459458 (0.0008) [2023-12-27 22:32:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 235659264. Throughput: 0: 9939.7, 1: 9903.1. Samples: 235653928. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:31,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.422')] [2023-12-27 22:32:31,186][106225] Updated weights for policy 1, policy_version 460856 (0.0008) [2023-12-27 22:32:31,254][106226] Updated weights for policy 0, policy_version 459468 (0.0009) [2023-12-27 22:32:31,258][106225] Updated weights for policy 1, policy_version 460866 (0.0008) [2023-12-27 22:32:31,317][106226] Updated weights for policy 0, policy_version 459478 (0.0006) [2023-12-27 22:32:31,319][106225] Updated weights for policy 1, policy_version 460876 (0.0008) [2023-12-27 22:32:31,385][106226] Updated weights for policy 0, policy_version 459488 (0.0006) [2023-12-27 22:32:32,007][106226] Updated weights for policy 0, policy_version 459498 (0.0006) [2023-12-27 22:32:32,070][106226] Updated weights for policy 0, policy_version 459508 (0.0007) [2023-12-27 22:32:32,085][106225] Updated weights for policy 1, policy_version 460886 (0.0008) [2023-12-27 22:32:32,134][106226] Updated weights for policy 0, policy_version 459518 (0.0006) [2023-12-27 22:32:32,141][106225] Updated weights for policy 1, policy_version 460896 (0.0006) [2023-12-27 22:32:32,200][106226] Updated weights for policy 0, policy_version 459528 (0.0006) [2023-12-27 22:32:32,202][106225] Updated weights for policy 1, policy_version 460906 (0.0007) [2023-12-27 22:32:32,883][106225] Updated weights for policy 1, policy_version 460916 (0.0005) [2023-12-27 22:32:32,892][106226] Updated weights for policy 0, policy_version 459538 (0.0007) [2023-12-27 22:32:32,930][106225] Updated weights for policy 1, policy_version 460926 (0.0006) [2023-12-27 22:32:32,951][106226] Updated weights for policy 0, policy_version 459548 (0.0007) [2023-12-27 22:32:32,983][106225] Updated weights for policy 1, policy_version 460936 (0.0005) [2023-12-27 22:32:32,995][106226] Updated weights for policy 0, policy_version 459558 (0.0008) [2023-12-27 22:32:33,597][106225] Updated weights for policy 1, policy_version 460946 (0.0006) [2023-12-27 22:32:33,640][106225] Updated weights for policy 1, policy_version 460956 (0.0007) [2023-12-27 22:32:33,689][106225] Updated weights for policy 1, policy_version 460966 (0.0008) [2023-12-27 22:32:33,732][106225] Updated weights for policy 1, policy_version 460976 (0.0007) [2023-12-27 22:32:33,769][106226] Updated weights for policy 0, policy_version 459568 (0.0008) [2023-12-27 22:32:33,818][106226] Updated weights for policy 0, policy_version 459578 (0.0005) [2023-12-27 22:32:33,864][106226] Updated weights for policy 0, policy_version 459588 (0.0005) [2023-12-27 22:32:34,534][106225] Updated weights for policy 1, policy_version 460986 (0.0008) [2023-12-27 22:32:34,588][106226] Updated weights for policy 0, policy_version 459598 (0.0007) [2023-12-27 22:32:34,590][106225] Updated weights for policy 1, policy_version 460996 (0.0007) [2023-12-27 22:32:34,649][106225] Updated weights for policy 1, policy_version 461006 (0.0006) [2023-12-27 22:32:34,651][106226] Updated weights for policy 0, policy_version 459608 (0.0007) [2023-12-27 22:32:34,704][106226] Updated weights for policy 0, policy_version 459618 (0.0008) [2023-12-27 22:32:35,398][106225] Updated weights for policy 1, policy_version 461016 (0.0006) [2023-12-27 22:32:35,442][106226] Updated weights for policy 0, policy_version 459628 (0.0007) [2023-12-27 22:32:35,449][106225] Updated weights for policy 1, policy_version 461026 (0.0008) [2023-12-27 22:32:35,490][106226] Updated weights for policy 0, policy_version 459638 (0.0005) [2023-12-27 22:32:35,504][106225] Updated weights for policy 1, policy_version 461036 (0.0006) [2023-12-27 22:32:35,550][106226] Updated weights for policy 0, policy_version 459648 (0.0007) [2023-12-27 22:32:36,136][106225] Updated weights for policy 1, policy_version 461046 (0.0007) [2023-12-27 22:32:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19605.3). Total num frames: 235757568. Throughput: 0: 9922.7, 1: 9842.8. Samples: 235770148. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:36,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-5.543')] [2023-12-27 22:32:36,204][106225] Updated weights for policy 1, policy_version 461056 (0.0009) [2023-12-27 22:32:36,266][106225] Updated weights for policy 1, policy_version 461066 (0.0009) [2023-12-27 22:32:36,351][106226] Updated weights for policy 0, policy_version 459658 (0.0008) [2023-12-27 22:32:36,421][106226] Updated weights for policy 0, policy_version 459668 (0.0007) [2023-12-27 22:32:36,484][106226] Updated weights for policy 0, policy_version 459678 (0.0008) [2023-12-27 22:32:36,554][106226] Updated weights for policy 0, policy_version 459688 (0.0008) [2023-12-27 22:32:36,986][106225] Updated weights for policy 1, policy_version 461076 (0.0009) [2023-12-27 22:32:37,050][106225] Updated weights for policy 1, policy_version 461086 (0.0010) [2023-12-27 22:32:37,113][106225] Updated weights for policy 1, policy_version 461096 (0.0010) [2023-12-27 22:32:37,279][106226] Updated weights for policy 0, policy_version 459698 (0.0007) [2023-12-27 22:32:37,341][106226] Updated weights for policy 0, policy_version 459708 (0.0007) [2023-12-27 22:32:37,403][106226] Updated weights for policy 0, policy_version 459718 (0.0007) [2023-12-27 22:32:37,735][106225] Updated weights for policy 1, policy_version 461106 (0.0005) [2023-12-27 22:32:37,788][106225] Updated weights for policy 1, policy_version 461116 (0.0005) [2023-12-27 22:32:37,852][106225] Updated weights for policy 1, policy_version 461126 (0.0005) [2023-12-27 22:32:37,908][106225] Updated weights for policy 1, policy_version 461136 (0.0008) [2023-12-27 22:32:38,069][106226] Updated weights for policy 0, policy_version 459728 (0.0005) [2023-12-27 22:32:38,119][106226] Updated weights for policy 0, policy_version 459738 (0.0010) [2023-12-27 22:32:38,170][106226] Updated weights for policy 0, policy_version 459748 (0.0010) [2023-12-27 22:32:38,590][106225] Updated weights for policy 1, policy_version 461146 (0.0008) [2023-12-27 22:32:38,655][106225] Updated weights for policy 1, policy_version 461156 (0.0008) [2023-12-27 22:32:38,712][106225] Updated weights for policy 1, policy_version 461166 (0.0008) [2023-12-27 22:32:38,919][106226] Updated weights for policy 0, policy_version 459758 (0.0010) [2023-12-27 22:32:38,983][106226] Updated weights for policy 0, policy_version 459768 (0.0008) [2023-12-27 22:32:39,038][106226] Updated weights for policy 0, policy_version 459778 (0.0009) [2023-12-27 22:32:39,448][106225] Updated weights for policy 1, policy_version 461176 (0.0008) [2023-12-27 22:32:39,504][106225] Updated weights for policy 1, policy_version 461186 (0.0008) [2023-12-27 22:32:39,567][106225] Updated weights for policy 1, policy_version 461196 (0.0008) [2023-12-27 22:32:39,810][106226] Updated weights for policy 0, policy_version 459788 (0.0009) [2023-12-27 22:32:39,879][106226] Updated weights for policy 0, policy_version 459798 (0.0008) [2023-12-27 22:32:39,947][106226] Updated weights for policy 0, policy_version 459808 (0.0009) [2023-12-27 22:32:40,359][106225] Updated weights for policy 1, policy_version 461206 (0.0009) [2023-12-27 22:32:40,426][106225] Updated weights for policy 1, policy_version 461216 (0.0009) [2023-12-27 22:32:40,486][106225] Updated weights for policy 1, policy_version 461226 (0.0008) [2023-12-27 22:32:40,688][106226] Updated weights for policy 0, policy_version 459818 (0.0007) [2023-12-27 22:32:40,754][106226] Updated weights for policy 0, policy_version 459828 (0.0005) [2023-12-27 22:32:40,815][106226] Updated weights for policy 0, policy_version 459838 (0.0008) [2023-12-27 22:32:40,865][106226] Updated weights for policy 0, policy_version 459848 (0.0008) [2023-12-27 22:32:41,128][106225] Updated weights for policy 1, policy_version 461236 (0.0009) [2023-12-27 22:32:41,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19605.3). Total num frames: 235855872. Throughput: 0: 9941.4, 1: 9853.9. Samples: 235829492. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:41,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-5.654')] [2023-12-27 22:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000459848_117751808.pth... [2023-12-27 22:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000458728_117465088.pth [2023-12-27 22:32:41,196][106225] Updated weights for policy 1, policy_version 461246 (0.0007) [2023-12-27 22:32:41,255][106225] Updated weights for policy 1, policy_version 461256 (0.0006) [2023-12-27 22:32:41,305][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000461264_118112256.pth... [2023-12-27 22:32:41,308][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000460080_117809152.pth [2023-12-27 22:32:41,649][106226] Updated weights for policy 0, policy_version 459858 (0.0010) [2023-12-27 22:32:41,704][106226] Updated weights for policy 0, policy_version 459868 (0.0009) [2023-12-27 22:32:41,773][106226] Updated weights for policy 0, policy_version 459878 (0.0009) [2023-12-27 22:32:42,037][106225] Updated weights for policy 1, policy_version 461266 (0.0008) [2023-12-27 22:32:42,098][106225] Updated weights for policy 1, policy_version 461276 (0.0008) [2023-12-27 22:32:42,159][106225] Updated weights for policy 1, policy_version 461286 (0.0009) [2023-12-27 22:32:42,211][106225] Updated weights for policy 1, policy_version 461296 (0.0008) [2023-12-27 22:32:42,560][106226] Updated weights for policy 0, policy_version 459888 (0.0010) [2023-12-27 22:32:42,625][106226] Updated weights for policy 0, policy_version 459898 (0.0010) [2023-12-27 22:32:42,691][106226] Updated weights for policy 0, policy_version 459908 (0.0011) [2023-12-27 22:32:42,951][106225] Updated weights for policy 1, policy_version 461306 (0.0008) [2023-12-27 22:32:43,004][106225] Updated weights for policy 1, policy_version 461316 (0.0009) [2023-12-27 22:32:43,060][106225] Updated weights for policy 1, policy_version 461326 (0.0007) [2023-12-27 22:32:43,366][106226] Updated weights for policy 0, policy_version 459918 (0.0011) [2023-12-27 22:32:43,421][106226] Updated weights for policy 0, policy_version 459928 (0.0009) [2023-12-27 22:32:43,470][106226] Updated weights for policy 0, policy_version 459938 (0.0005) [2023-12-27 22:32:43,727][106225] Updated weights for policy 1, policy_version 461336 (0.0010) [2023-12-27 22:32:43,785][106225] Updated weights for policy 1, policy_version 461346 (0.0008) [2023-12-27 22:32:43,843][106225] Updated weights for policy 1, policy_version 461356 (0.0005) [2023-12-27 22:32:44,166][106226] Updated weights for policy 0, policy_version 459948 (0.0007) [2023-12-27 22:32:44,219][106226] Updated weights for policy 0, policy_version 459958 (0.0005) [2023-12-27 22:32:44,272][106226] Updated weights for policy 0, policy_version 459968 (0.0005) [2023-12-27 22:32:44,505][106225] Updated weights for policy 1, policy_version 461366 (0.0008) [2023-12-27 22:32:44,555][106225] Updated weights for policy 1, policy_version 461376 (0.0010) [2023-12-27 22:32:44,612][106225] Updated weights for policy 1, policy_version 461386 (0.0010) [2023-12-27 22:32:44,962][106226] Updated weights for policy 0, policy_version 459978 (0.0006) [2023-12-27 22:32:45,024][106226] Updated weights for policy 0, policy_version 459988 (0.0007) [2023-12-27 22:32:45,083][106226] Updated weights for policy 0, policy_version 459998 (0.0008) [2023-12-27 22:32:45,143][106226] Updated weights for policy 0, policy_version 460008 (0.0008) [2023-12-27 22:32:45,391][106225] Updated weights for policy 1, policy_version 461396 (0.0008) [2023-12-27 22:32:45,449][106225] Updated weights for policy 1, policy_version 461406 (0.0006) [2023-12-27 22:32:45,510][106225] Updated weights for policy 1, policy_version 461416 (0.0006) [2023-12-27 22:32:45,893][106226] Updated weights for policy 0, policy_version 460018 (0.0010) [2023-12-27 22:32:45,959][106226] Updated weights for policy 0, policy_version 460028 (0.0006) [2023-12-27 22:32:46,019][106226] Updated weights for policy 0, policy_version 460038 (0.0011) [2023-12-27 22:32:46,124][106225] Updated weights for policy 1, policy_version 461426 (0.0008) [2023-12-27 22:32:46,173][106225] Updated weights for policy 1, policy_version 461436 (0.0008) [2023-12-27 22:32:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19633.0). Total num frames: 235954176. Throughput: 0: 9852.0, 1: 9864.0. Samples: 235944100. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:46,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-5.599')] [2023-12-27 22:32:46,223][106225] Updated weights for policy 1, policy_version 461446 (0.0007) [2023-12-27 22:32:46,275][106225] Updated weights for policy 1, policy_version 461456 (0.0007) [2023-12-27 22:32:46,694][106226] Updated weights for policy 0, policy_version 460048 (0.0011) [2023-12-27 22:32:46,756][106226] Updated weights for policy 0, policy_version 460058 (0.0011) [2023-12-27 22:32:46,813][106226] Updated weights for policy 0, policy_version 460068 (0.0010) [2023-12-27 22:32:46,928][106225] Updated weights for policy 1, policy_version 461466 (0.0006) [2023-12-27 22:32:46,984][106225] Updated weights for policy 1, policy_version 461476 (0.0006) [2023-12-27 22:32:47,039][106225] Updated weights for policy 1, policy_version 461486 (0.0005) [2023-12-27 22:32:47,569][106226] Updated weights for policy 0, policy_version 460078 (0.0010) [2023-12-27 22:32:47,613][106225] Updated weights for policy 1, policy_version 461496 (0.0005) [2023-12-27 22:32:47,632][106226] Updated weights for policy 0, policy_version 460088 (0.0010) [2023-12-27 22:32:47,671][106225] Updated weights for policy 1, policy_version 461506 (0.0007) [2023-12-27 22:32:47,689][106226] Updated weights for policy 0, policy_version 460098 (0.0010) [2023-12-27 22:32:47,731][106225] Updated weights for policy 1, policy_version 461516 (0.0007) [2023-12-27 22:32:48,309][106225] Updated weights for policy 1, policy_version 461526 (0.0005) [2023-12-27 22:32:48,377][106225] Updated weights for policy 1, policy_version 461536 (0.0008) [2023-12-27 22:32:48,399][106226] Updated weights for policy 0, policy_version 460108 (0.0011) [2023-12-27 22:32:48,439][106225] Updated weights for policy 1, policy_version 461546 (0.0007) [2023-12-27 22:32:48,457][106226] Updated weights for policy 0, policy_version 460118 (0.0008) [2023-12-27 22:32:48,515][106226] Updated weights for policy 0, policy_version 460128 (0.0008) [2023-12-27 22:32:49,128][106225] Updated weights for policy 1, policy_version 461556 (0.0007) [2023-12-27 22:32:49,182][106225] Updated weights for policy 1, policy_version 461566 (0.0006) [2023-12-27 22:32:49,243][106225] Updated weights for policy 1, policy_version 461576 (0.0007) [2023-12-27 22:32:49,260][106226] Updated weights for policy 0, policy_version 460138 (0.0009) [2023-12-27 22:32:49,324][106226] Updated weights for policy 0, policy_version 460148 (0.0008) [2023-12-27 22:32:49,394][106226] Updated weights for policy 0, policy_version 460158 (0.0008) [2023-12-27 22:32:49,449][106226] Updated weights for policy 0, policy_version 460168 (0.0009) [2023-12-27 22:32:50,032][106225] Updated weights for policy 1, policy_version 461586 (0.0007) [2023-12-27 22:32:50,096][106225] Updated weights for policy 1, policy_version 461596 (0.0009) [2023-12-27 22:32:50,162][106225] Updated weights for policy 1, policy_version 461606 (0.0008) [2023-12-27 22:32:50,225][106225] Updated weights for policy 1, policy_version 461616 (0.0008) [2023-12-27 22:32:50,236][106226] Updated weights for policy 0, policy_version 460178 (0.0007) [2023-12-27 22:32:50,296][106226] Updated weights for policy 0, policy_version 460188 (0.0008) [2023-12-27 22:32:50,358][106226] Updated weights for policy 0, policy_version 460198 (0.0009) [2023-12-27 22:32:50,955][106225] Updated weights for policy 1, policy_version 461626 (0.0008) [2023-12-27 22:32:51,017][106225] Updated weights for policy 1, policy_version 461636 (0.0008) [2023-12-27 22:32:51,045][106226] Updated weights for policy 0, policy_version 460208 (0.0010) [2023-12-27 22:32:51,083][106225] Updated weights for policy 1, policy_version 461646 (0.0008) [2023-12-27 22:32:51,111][106226] Updated weights for policy 0, policy_version 460218 (0.0012) [2023-12-27 22:32:51,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 236052480. Throughput: 0: 9726.1, 1: 9923.1. Samples: 236063472. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:51,175][105115] Avg episode reward: [(0, '-5.104'), (1, '-5.496')] [2023-12-27 22:32:51,182][106226] Updated weights for policy 0, policy_version 460228 (0.0009) [2023-12-27 22:32:51,862][106225] Updated weights for policy 1, policy_version 461656 (0.0010) [2023-12-27 22:32:51,934][106225] Updated weights for policy 1, policy_version 461666 (0.0011) [2023-12-27 22:32:51,998][106226] Updated weights for policy 0, policy_version 460238 (0.0008) [2023-12-27 22:32:52,003][106225] Updated weights for policy 1, policy_version 461676 (0.0010) [2023-12-27 22:32:52,052][106226] Updated weights for policy 0, policy_version 460248 (0.0007) [2023-12-27 22:32:52,114][106226] Updated weights for policy 0, policy_version 460258 (0.0008) [2023-12-27 22:32:52,710][106225] Updated weights for policy 1, policy_version 461686 (0.0009) [2023-12-27 22:32:52,769][106225] Updated weights for policy 1, policy_version 461696 (0.0008) [2023-12-27 22:32:52,832][106225] Updated weights for policy 1, policy_version 461706 (0.0009) [2023-12-27 22:32:52,862][106226] Updated weights for policy 0, policy_version 460268 (0.0008) [2023-12-27 22:32:52,921][106226] Updated weights for policy 0, policy_version 460278 (0.0008) [2023-12-27 22:32:52,978][106226] Updated weights for policy 0, policy_version 460288 (0.0008) [2023-12-27 22:32:53,571][106225] Updated weights for policy 1, policy_version 461716 (0.0006) [2023-12-27 22:32:53,622][106225] Updated weights for policy 1, policy_version 461726 (0.0005) [2023-12-27 22:32:53,630][106226] Updated weights for policy 0, policy_version 460298 (0.0008) [2023-12-27 22:32:53,667][106225] Updated weights for policy 1, policy_version 461736 (0.0005) [2023-12-27 22:32:53,691][106226] Updated weights for policy 0, policy_version 460308 (0.0008) [2023-12-27 22:32:53,756][106226] Updated weights for policy 0, policy_version 460318 (0.0010) [2023-12-27 22:32:53,819][106226] Updated weights for policy 0, policy_version 460328 (0.0008) [2023-12-27 22:32:54,302][106225] Updated weights for policy 1, policy_version 461746 (0.0005) [2023-12-27 22:32:54,360][106225] Updated weights for policy 1, policy_version 461756 (0.0006) [2023-12-27 22:32:54,417][106225] Updated weights for policy 1, policy_version 461766 (0.0005) [2023-12-27 22:32:54,469][106225] Updated weights for policy 1, policy_version 461776 (0.0005) [2023-12-27 22:32:54,562][106226] Updated weights for policy 0, policy_version 460338 (0.0005) [2023-12-27 22:32:54,630][106226] Updated weights for policy 0, policy_version 460348 (0.0005) [2023-12-27 22:32:54,686][106226] Updated weights for policy 0, policy_version 460358 (0.0005) [2023-12-27 22:32:55,068][106225] Updated weights for policy 1, policy_version 461786 (0.0009) [2023-12-27 22:32:55,129][106225] Updated weights for policy 1, policy_version 461796 (0.0009) [2023-12-27 22:32:55,184][106225] Updated weights for policy 1, policy_version 461806 (0.0009) [2023-12-27 22:32:55,254][106226] Updated weights for policy 0, policy_version 460368 (0.0008) [2023-12-27 22:32:55,315][106226] Updated weights for policy 0, policy_version 460378 (0.0009) [2023-12-27 22:32:55,367][106226] Updated weights for policy 0, policy_version 460388 (0.0008) [2023-12-27 22:32:55,837][106225] Updated weights for policy 1, policy_version 461816 (0.0006) [2023-12-27 22:32:55,899][106225] Updated weights for policy 1, policy_version 461826 (0.0007) [2023-12-27 22:32:55,966][106225] Updated weights for policy 1, policy_version 461836 (0.0006) [2023-12-27 22:32:55,973][106226] Updated weights for policy 0, policy_version 460398 (0.0007) [2023-12-27 22:32:56,026][106226] Updated weights for policy 0, policy_version 460408 (0.0005) [2023-12-27 22:32:56,085][106226] Updated weights for policy 0, policy_version 460418 (0.0009) [2023-12-27 22:32:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 236158976. Throughput: 0: 9650.8, 1: 9891.4. Samples: 236119444. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:32:56,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-5.645')] [2023-12-27 22:32:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000461840_118259712.pth... [2023-12-27 22:32:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000460424_117899264.pth... [2023-12-27 22:32:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000460656_117956608.pth [2023-12-27 22:32:56,202][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000459272_117604352.pth [2023-12-27 22:32:56,615][106225] Updated weights for policy 1, policy_version 461846 (0.0006) [2023-12-27 22:32:56,663][106225] Updated weights for policy 1, policy_version 461856 (0.0005) [2023-12-27 22:32:56,722][106225] Updated weights for policy 1, policy_version 461866 (0.0008) [2023-12-27 22:32:56,749][106226] Updated weights for policy 0, policy_version 460428 (0.0008) [2023-12-27 22:32:56,797][106226] Updated weights for policy 0, policy_version 460438 (0.0009) [2023-12-27 22:32:56,842][106226] Updated weights for policy 0, policy_version 460448 (0.0008) [2023-12-27 22:32:57,418][106225] Updated weights for policy 1, policy_version 461876 (0.0008) [2023-12-27 22:32:57,475][106225] Updated weights for policy 1, policy_version 461886 (0.0008) [2023-12-27 22:32:57,529][106225] Updated weights for policy 1, policy_version 461896 (0.0007) [2023-12-27 22:32:57,565][106226] Updated weights for policy 0, policy_version 460458 (0.0008) [2023-12-27 22:32:57,618][106226] Updated weights for policy 0, policy_version 460468 (0.0005) [2023-12-27 22:32:57,683][106226] Updated weights for policy 0, policy_version 460478 (0.0008) [2023-12-27 22:32:57,733][106226] Updated weights for policy 0, policy_version 460488 (0.0007) [2023-12-27 22:32:58,275][106225] Updated weights for policy 1, policy_version 461906 (0.0008) [2023-12-27 22:32:58,348][106225] Updated weights for policy 1, policy_version 461916 (0.0011) [2023-12-27 22:32:58,412][106225] Updated weights for policy 1, policy_version 461927 (0.0008) [2023-12-27 22:32:58,431][106226] Updated weights for policy 0, policy_version 460498 (0.0009) [2023-12-27 22:32:58,490][106226] Updated weights for policy 0, policy_version 460508 (0.0009) [2023-12-27 22:32:58,559][106226] Updated weights for policy 0, policy_version 460518 (0.0009) [2023-12-27 22:32:59,240][106225] Updated weights for policy 1, policy_version 461937 (0.0008) [2023-12-27 22:32:59,321][106225] Updated weights for policy 1, policy_version 461947 (0.0008) [2023-12-27 22:32:59,404][106225] Updated weights for policy 1, policy_version 461957 (0.0009) [2023-12-27 22:32:59,473][106225] Updated weights for policy 1, policy_version 461967 (0.0008) [2023-12-27 22:32:59,505][106226] Updated weights for policy 0, policy_version 460528 (0.0009) [2023-12-27 22:32:59,565][106226] Updated weights for policy 0, policy_version 460538 (0.0011) [2023-12-27 22:32:59,629][106226] Updated weights for policy 0, policy_version 460548 (0.0009) [2023-12-27 22:33:00,250][106225] Updated weights for policy 1, policy_version 461977 (0.0006) [2023-12-27 22:33:00,315][106225] Updated weights for policy 1, policy_version 461987 (0.0008) [2023-12-27 22:33:00,335][106226] Updated weights for policy 0, policy_version 460558 (0.0005) [2023-12-27 22:33:00,377][106225] Updated weights for policy 1, policy_version 461997 (0.0007) [2023-12-27 22:33:00,397][106226] Updated weights for policy 0, policy_version 460568 (0.0007) [2023-12-27 22:33:00,447][106226] Updated weights for policy 0, policy_version 460578 (0.0005) [2023-12-27 22:33:01,012][106225] Updated weights for policy 1, policy_version 462007 (0.0007) [2023-12-27 22:33:01,073][106225] Updated weights for policy 1, policy_version 462017 (0.0009) [2023-12-27 22:33:01,135][106225] Updated weights for policy 1, policy_version 462027 (0.0008) [2023-12-27 22:33:01,144][106226] Updated weights for policy 0, policy_version 460588 (0.0007) [2023-12-27 22:33:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 236249088. Throughput: 0: 9657.4, 1: 9919.2. Samples: 236237552. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:33:01,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-5.277')] [2023-12-27 22:33:01,204][106226] Updated weights for policy 0, policy_version 460598 (0.0007) [2023-12-27 22:33:01,260][106226] Updated weights for policy 0, policy_version 460608 (0.0008) [2023-12-27 22:33:01,849][106225] Updated weights for policy 1, policy_version 462037 (0.0007) [2023-12-27 22:33:01,912][106225] Updated weights for policy 1, policy_version 462047 (0.0010) [2023-12-27 22:33:01,960][106226] Updated weights for policy 0, policy_version 460618 (0.0008) [2023-12-27 22:33:01,977][106225] Updated weights for policy 1, policy_version 462057 (0.0011) [2023-12-27 22:33:02,028][106226] Updated weights for policy 0, policy_version 460629 (0.0007) [2023-12-27 22:33:02,095][106226] Updated weights for policy 0, policy_version 460639 (0.0008) [2023-12-27 22:33:02,704][106225] Updated weights for policy 1, policy_version 462067 (0.0009) [2023-12-27 22:33:02,768][106225] Updated weights for policy 1, policy_version 462077 (0.0010) [2023-12-27 22:33:02,784][106226] Updated weights for policy 0, policy_version 460649 (0.0008) [2023-12-27 22:33:02,825][106225] Updated weights for policy 1, policy_version 462087 (0.0010) [2023-12-27 22:33:02,839][106226] Updated weights for policy 0, policy_version 460659 (0.0005) [2023-12-27 22:33:02,896][106226] Updated weights for policy 0, policy_version 460669 (0.0006) [2023-12-27 22:33:02,955][106226] Updated weights for policy 0, policy_version 460679 (0.0007) [2023-12-27 22:33:03,523][106225] Updated weights for policy 1, policy_version 462097 (0.0010) [2023-12-27 22:33:03,565][106225] Updated weights for policy 1, policy_version 462107 (0.0007) [2023-12-27 22:33:03,616][106225] Updated weights for policy 1, policy_version 462117 (0.0009) [2023-12-27 22:33:03,666][106225] Updated weights for policy 1, policy_version 462127 (0.0010) [2023-12-27 22:33:03,676][106226] Updated weights for policy 0, policy_version 460689 (0.0006) [2023-12-27 22:33:03,718][106226] Updated weights for policy 0, policy_version 460699 (0.0008) [2023-12-27 22:33:03,763][106226] Updated weights for policy 0, policy_version 460709 (0.0007) [2023-12-27 22:33:04,441][106225] Updated weights for policy 1, policy_version 462137 (0.0011) [2023-12-27 22:33:04,502][106226] Updated weights for policy 0, policy_version 460719 (0.0008) [2023-12-27 22:33:04,503][106225] Updated weights for policy 1, policy_version 462147 (0.0010) [2023-12-27 22:33:04,554][106226] Updated weights for policy 0, policy_version 460729 (0.0007) [2023-12-27 22:33:04,560][106225] Updated weights for policy 1, policy_version 462157 (0.0010) [2023-12-27 22:33:04,613][106226] Updated weights for policy 0, policy_version 460739 (0.0006) [2023-12-27 22:33:05,187][106225] Updated weights for policy 1, policy_version 462167 (0.0010) [2023-12-27 22:33:05,200][106226] Updated weights for policy 0, policy_version 460749 (0.0007) [2023-12-27 22:33:05,240][106225] Updated weights for policy 1, policy_version 462177 (0.0010) [2023-12-27 22:33:05,254][106226] Updated weights for policy 0, policy_version 460759 (0.0005) [2023-12-27 22:33:05,290][106225] Updated weights for policy 1, policy_version 462187 (0.0010) [2023-12-27 22:33:05,308][106226] Updated weights for policy 0, policy_version 460769 (0.0005) [2023-12-27 22:33:06,026][106225] Updated weights for policy 1, policy_version 462197 (0.0010) [2023-12-27 22:33:06,062][106226] Updated weights for policy 0, policy_version 460779 (0.0007) [2023-12-27 22:33:06,084][106225] Updated weights for policy 1, policy_version 462207 (0.0006) [2023-12-27 22:33:06,152][106225] Updated weights for policy 1, policy_version 462217 (0.0009) [2023-12-27 22:33:06,164][106226] Updated weights for policy 0, policy_version 460789 (0.0008) [2023-12-27 22:33:06,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19524.2, 300 sec: 19605.3). Total num frames: 236339200. Throughput: 0: 9735.4, 1: 9897.2. Samples: 236356808. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-27 22:33:06,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-5.329')] [2023-12-27 22:33:06,226][106226] Updated weights for policy 0, policy_version 460799 (0.0011) [2023-12-27 22:33:06,898][106225] Updated weights for policy 1, policy_version 462227 (0.0009) [2023-12-27 22:33:06,949][106226] Updated weights for policy 0, policy_version 460809 (0.0011) [2023-12-27 22:33:06,963][106225] Updated weights for policy 1, policy_version 462237 (0.0008) [2023-12-27 22:33:07,008][106226] Updated weights for policy 0, policy_version 460819 (0.0011) [2023-12-27 22:33:07,021][106225] Updated weights for policy 1, policy_version 462247 (0.0008) [2023-12-27 22:33:07,063][106226] Updated weights for policy 0, policy_version 460829 (0.0011) [2023-12-27 22:33:07,114][106226] Updated weights for policy 0, policy_version 460839 (0.0010) [2023-12-27 22:33:07,689][106225] Updated weights for policy 1, policy_version 462257 (0.0008) [2023-12-27 22:33:07,751][106225] Updated weights for policy 1, policy_version 462267 (0.0011) [2023-12-27 22:33:07,766][106226] Updated weights for policy 0, policy_version 460849 (0.0009) [2023-12-27 22:33:07,811][106225] Updated weights for policy 1, policy_version 462277 (0.0008) [2023-12-27 22:33:07,813][106226] Updated weights for policy 0, policy_version 460859 (0.0008) [2023-12-27 22:33:07,863][106226] Updated weights for policy 0, policy_version 460869 (0.0010) [2023-12-27 22:33:07,871][106225] Updated weights for policy 1, policy_version 462287 (0.0009) [2023-12-27 22:33:08,532][106226] Updated weights for policy 0, policy_version 460879 (0.0007) [2023-12-27 22:33:08,548][106225] Updated weights for policy 1, policy_version 462297 (0.0010) [2023-12-27 22:33:08,595][106226] Updated weights for policy 0, policy_version 460889 (0.0007) [2023-12-27 22:33:08,611][106225] Updated weights for policy 1, policy_version 462307 (0.0007) [2023-12-27 22:33:08,651][106226] Updated weights for policy 0, policy_version 460899 (0.0007) [2023-12-27 22:33:08,672][106225] Updated weights for policy 1, policy_version 462317 (0.0010) [2023-12-27 22:33:09,316][106226] Updated weights for policy 0, policy_version 460909 (0.0009) [2023-12-27 22:33:09,370][106225] Updated weights for policy 1, policy_version 462327 (0.0010) [2023-12-27 22:33:09,390][106226] Updated weights for policy 0, policy_version 460919 (0.0010) [2023-12-27 22:33:09,437][106225] Updated weights for policy 1, policy_version 462337 (0.0009) [2023-12-27 22:33:09,458][106226] Updated weights for policy 0, policy_version 460929 (0.0009) [2023-12-27 22:33:09,497][106225] Updated weights for policy 1, policy_version 462347 (0.0006) [2023-12-27 22:33:10,187][106226] Updated weights for policy 0, policy_version 460939 (0.0010) [2023-12-27 22:33:10,214][106225] Updated weights for policy 1, policy_version 462357 (0.0010) [2023-12-27 22:33:10,243][106226] Updated weights for policy 0, policy_version 460949 (0.0006) [2023-12-27 22:33:10,272][106225] Updated weights for policy 1, policy_version 462367 (0.0010) [2023-12-27 22:33:10,302][106226] Updated weights for policy 0, policy_version 460959 (0.0007) [2023-12-27 22:33:10,335][106225] Updated weights for policy 1, policy_version 462377 (0.0008) [2023-12-27 22:33:10,932][106226] Updated weights for policy 0, policy_version 460969 (0.0009) [2023-12-27 22:33:10,985][106226] Updated weights for policy 0, policy_version 460979 (0.0010) [2023-12-27 22:33:11,055][106226] Updated weights for policy 0, policy_version 460989 (0.0011) [2023-12-27 22:33:11,072][106225] Updated weights for policy 1, policy_version 462387 (0.0008) [2023-12-27 22:33:11,120][106226] Updated weights for policy 0, policy_version 460999 (0.0010) [2023-12-27 22:33:11,145][106225] Updated weights for policy 1, policy_version 462397 (0.0008) [2023-12-27 22:33:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19661.2, 300 sec: 19633.0). Total num frames: 236445696. Throughput: 0: 9785.1, 1: 9916.9. Samples: 236416416. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:11,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-5.527')] [2023-12-27 22:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000461000_118046720.pth... [2023-12-27 22:33:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000459848_117751808.pth [2023-12-27 22:33:11,211][106225] Updated weights for policy 1, policy_version 462407 (0.0008) [2023-12-27 22:33:11,271][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000462416_118407168.pth... [2023-12-27 22:33:11,276][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000461264_118112256.pth [2023-12-27 22:33:11,906][106226] Updated weights for policy 0, policy_version 461009 (0.0006) [2023-12-27 22:33:11,963][106226] Updated weights for policy 0, policy_version 461019 (0.0005) [2023-12-27 22:33:11,982][106225] Updated weights for policy 1, policy_version 462417 (0.0008) [2023-12-27 22:33:12,018][106226] Updated weights for policy 0, policy_version 461029 (0.0006) [2023-12-27 22:33:12,046][106225] Updated weights for policy 1, policy_version 462427 (0.0010) [2023-12-27 22:33:12,108][106225] Updated weights for policy 1, policy_version 462437 (0.0010) [2023-12-27 22:33:12,162][106225] Updated weights for policy 1, policy_version 462447 (0.0010) [2023-12-27 22:33:12,694][106226] Updated weights for policy 0, policy_version 461039 (0.0010) [2023-12-27 22:33:12,758][106226] Updated weights for policy 0, policy_version 461049 (0.0011) [2023-12-27 22:33:12,826][106226] Updated weights for policy 0, policy_version 461059 (0.0011) [2023-12-27 22:33:12,828][106225] Updated weights for policy 1, policy_version 462457 (0.0006) [2023-12-27 22:33:12,889][106225] Updated weights for policy 1, policy_version 462467 (0.0010) [2023-12-27 22:33:12,947][106225] Updated weights for policy 1, policy_version 462477 (0.0010) [2023-12-27 22:33:13,513][106226] Updated weights for policy 0, policy_version 461069 (0.0010) [2023-12-27 22:33:13,571][106226] Updated weights for policy 0, policy_version 461079 (0.0011) [2023-12-27 22:33:13,582][106225] Updated weights for policy 1, policy_version 462487 (0.0007) [2023-12-27 22:33:13,631][106226] Updated weights for policy 0, policy_version 461089 (0.0010) [2023-12-27 22:33:13,646][106225] Updated weights for policy 1, policy_version 462497 (0.0005) [2023-12-27 22:33:13,696][106225] Updated weights for policy 1, policy_version 462507 (0.0005) [2023-12-27 22:33:14,199][106226] Updated weights for policy 0, policy_version 461099 (0.0009) [2023-12-27 22:33:14,263][106226] Updated weights for policy 0, policy_version 461109 (0.0010) [2023-12-27 22:33:14,279][106225] Updated weights for policy 1, policy_version 462517 (0.0005) [2023-12-27 22:33:14,313][106226] Updated weights for policy 0, policy_version 461119 (0.0010) [2023-12-27 22:33:14,337][106225] Updated weights for policy 1, policy_version 462527 (0.0007) [2023-12-27 22:33:14,396][106225] Updated weights for policy 1, policy_version 462537 (0.0010) [2023-12-27 22:33:14,961][106226] Updated weights for policy 0, policy_version 461129 (0.0010) [2023-12-27 22:33:15,024][106226] Updated weights for policy 0, policy_version 461139 (0.0009) [2023-12-27 22:33:15,089][106225] Updated weights for policy 1, policy_version 462547 (0.0009) [2023-12-27 22:33:15,092][106226] Updated weights for policy 0, policy_version 461149 (0.0008) [2023-12-27 22:33:15,150][106225] Updated weights for policy 1, policy_version 462557 (0.0006) [2023-12-27 22:33:15,158][106226] Updated weights for policy 0, policy_version 461159 (0.0008) [2023-12-27 22:33:15,216][106225] Updated weights for policy 1, policy_version 462567 (0.0009) [2023-12-27 22:33:15,837][106225] Updated weights for policy 1, policy_version 462577 (0.0007) [2023-12-27 22:33:15,853][106226] Updated weights for policy 0, policy_version 461169 (0.0006) [2023-12-27 22:33:15,888][106225] Updated weights for policy 1, policy_version 462587 (0.0005) [2023-12-27 22:33:15,906][106226] Updated weights for policy 0, policy_version 461179 (0.0005) [2023-12-27 22:33:15,937][106225] Updated weights for policy 1, policy_version 462597 (0.0008) [2023-12-27 22:33:15,964][106226] Updated weights for policy 0, policy_version 461189 (0.0010) [2023-12-27 22:33:15,987][106225] Updated weights for policy 1, policy_version 462607 (0.0010) [2023-12-27 22:33:16,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 236552192. Throughput: 0: 9732.5, 1: 9875.2. Samples: 236536276. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:16,175][105115] Avg episode reward: [(0, '-4.926'), (1, '-5.417')] [2023-12-27 22:33:16,567][106226] Updated weights for policy 0, policy_version 461199 (0.0009) [2023-12-27 22:33:16,634][106226] Updated weights for policy 0, policy_version 461209 (0.0007) [2023-12-27 22:33:16,669][106225] Updated weights for policy 1, policy_version 462617 (0.0010) [2023-12-27 22:33:16,698][106226] Updated weights for policy 0, policy_version 461219 (0.0010) [2023-12-27 22:33:16,728][106225] Updated weights for policy 1, policy_version 462627 (0.0006) [2023-12-27 22:33:16,791][106225] Updated weights for policy 1, policy_version 462637 (0.0006) [2023-12-27 22:33:17,305][106226] Updated weights for policy 0, policy_version 461229 (0.0008) [2023-12-27 22:33:17,354][106226] Updated weights for policy 0, policy_version 461239 (0.0005) [2023-12-27 22:33:17,412][106226] Updated weights for policy 0, policy_version 461249 (0.0006) [2023-12-27 22:33:17,430][106225] Updated weights for policy 1, policy_version 462647 (0.0007) [2023-12-27 22:33:17,482][106225] Updated weights for policy 1, policy_version 462657 (0.0010) [2023-12-27 22:33:17,533][106225] Updated weights for policy 1, policy_version 462667 (0.0010) [2023-12-27 22:33:18,014][106226] Updated weights for policy 0, policy_version 461259 (0.0008) [2023-12-27 22:33:18,075][106226] Updated weights for policy 0, policy_version 461269 (0.0007) [2023-12-27 22:33:18,131][106226] Updated weights for policy 0, policy_version 461279 (0.0007) [2023-12-27 22:33:18,178][106225] Updated weights for policy 1, policy_version 462677 (0.0009) [2023-12-27 22:33:18,236][106225] Updated weights for policy 1, policy_version 462687 (0.0010) [2023-12-27 22:33:18,298][106225] Updated weights for policy 1, policy_version 462697 (0.0010) [2023-12-27 22:33:18,851][106226] Updated weights for policy 0, policy_version 461289 (0.0010) [2023-12-27 22:33:18,900][106225] Updated weights for policy 1, policy_version 462707 (0.0010) [2023-12-27 22:33:18,916][106226] Updated weights for policy 0, policy_version 461299 (0.0011) [2023-12-27 22:33:18,957][106225] Updated weights for policy 1, policy_version 462717 (0.0010) [2023-12-27 22:33:18,976][106226] Updated weights for policy 0, policy_version 461309 (0.0010) [2023-12-27 22:33:19,014][106225] Updated weights for policy 1, policy_version 462727 (0.0010) [2023-12-27 22:33:19,039][106226] Updated weights for policy 0, policy_version 461319 (0.0011) [2023-12-27 22:33:19,767][106225] Updated weights for policy 1, policy_version 462737 (0.0010) [2023-12-27 22:33:19,816][106226] Updated weights for policy 0, policy_version 461329 (0.0006) [2023-12-27 22:33:19,826][106225] Updated weights for policy 1, policy_version 462747 (0.0010) [2023-12-27 22:33:19,880][106226] Updated weights for policy 0, policy_version 461339 (0.0008) [2023-12-27 22:33:19,888][106225] Updated weights for policy 1, policy_version 462757 (0.0008) [2023-12-27 22:33:19,949][106226] Updated weights for policy 0, policy_version 461349 (0.0008) [2023-12-27 22:33:19,953][106225] Updated weights for policy 1, policy_version 462767 (0.0009) [2023-12-27 22:33:20,675][106225] Updated weights for policy 1, policy_version 462777 (0.0007) [2023-12-27 22:33:20,696][106226] Updated weights for policy 0, policy_version 461359 (0.0008) [2023-12-27 22:33:20,731][106225] Updated weights for policy 1, policy_version 462787 (0.0005) [2023-12-27 22:33:20,751][106226] Updated weights for policy 0, policy_version 461369 (0.0007) [2023-12-27 22:33:20,790][106225] Updated weights for policy 1, policy_version 462797 (0.0008) [2023-12-27 22:33:20,812][106226] Updated weights for policy 0, policy_version 461379 (0.0006) [2023-12-27 22:33:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 236650496. Throughput: 0: 9786.4, 1: 9956.8. Samples: 236658592. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:21,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.561')] [2023-12-27 22:33:21,544][106225] Updated weights for policy 1, policy_version 462807 (0.0006) [2023-12-27 22:33:21,556][106226] Updated weights for policy 0, policy_version 461389 (0.0008) [2023-12-27 22:33:21,609][106225] Updated weights for policy 1, policy_version 462817 (0.0006) [2023-12-27 22:33:21,630][106226] Updated weights for policy 0, policy_version 461399 (0.0009) [2023-12-27 22:33:21,678][106225] Updated weights for policy 1, policy_version 462827 (0.0008) [2023-12-27 22:33:21,707][106226] Updated weights for policy 0, policy_version 461409 (0.0009) [2023-12-27 22:33:22,366][106226] Updated weights for policy 0, policy_version 461419 (0.0009) [2023-12-27 22:33:22,424][106226] Updated weights for policy 0, policy_version 461429 (0.0008) [2023-12-27 22:33:22,483][106226] Updated weights for policy 0, policy_version 461439 (0.0008) [2023-12-27 22:33:22,488][106225] Updated weights for policy 1, policy_version 462837 (0.0008) [2023-12-27 22:33:22,546][106225] Updated weights for policy 1, policy_version 462847 (0.0009) [2023-12-27 22:33:22,609][106225] Updated weights for policy 1, policy_version 462857 (0.0010) [2023-12-27 22:33:23,207][106226] Updated weights for policy 0, policy_version 461449 (0.0006) [2023-12-27 22:33:23,266][106226] Updated weights for policy 0, policy_version 461459 (0.0008) [2023-12-27 22:33:23,307][106225] Updated weights for policy 1, policy_version 462867 (0.0009) [2023-12-27 22:33:23,322][106226] Updated weights for policy 0, policy_version 461469 (0.0006) [2023-12-27 22:33:23,359][106225] Updated weights for policy 1, policy_version 462877 (0.0007) [2023-12-27 22:33:23,378][106226] Updated weights for policy 0, policy_version 461479 (0.0006) [2023-12-27 22:33:23,419][106225] Updated weights for policy 1, policy_version 462887 (0.0009) [2023-12-27 22:33:24,067][106226] Updated weights for policy 0, policy_version 461489 (0.0010) [2023-12-27 22:33:24,123][106226] Updated weights for policy 0, policy_version 461499 (0.0011) [2023-12-27 22:33:24,135][106225] Updated weights for policy 1, policy_version 462897 (0.0009) [2023-12-27 22:33:24,187][106226] Updated weights for policy 0, policy_version 461509 (0.0007) [2023-12-27 22:33:24,205][106225] Updated weights for policy 1, policy_version 462907 (0.0009) [2023-12-27 22:33:24,264][106225] Updated weights for policy 1, policy_version 462917 (0.0010) [2023-12-27 22:33:24,322][106225] Updated weights for policy 1, policy_version 462927 (0.0010) [2023-12-27 22:33:24,826][106226] Updated weights for policy 0, policy_version 461519 (0.0006) [2023-12-27 22:33:24,874][106226] Updated weights for policy 0, policy_version 461529 (0.0010) [2023-12-27 22:33:24,931][106226] Updated weights for policy 0, policy_version 461539 (0.0008) [2023-12-27 22:33:24,936][106225] Updated weights for policy 1, policy_version 462937 (0.0007) [2023-12-27 22:33:24,984][106225] Updated weights for policy 1, policy_version 462947 (0.0005) [2023-12-27 22:33:25,036][106225] Updated weights for policy 1, policy_version 462957 (0.0005) [2023-12-27 22:33:25,563][106226] Updated weights for policy 0, policy_version 461549 (0.0009) [2023-12-27 22:33:25,585][106225] Updated weights for policy 1, policy_version 462967 (0.0005) [2023-12-27 22:33:25,614][106226] Updated weights for policy 0, policy_version 461559 (0.0007) [2023-12-27 22:33:25,638][106225] Updated weights for policy 1, policy_version 462977 (0.0008) [2023-12-27 22:33:25,671][106226] Updated weights for policy 0, policy_version 461569 (0.0008) [2023-12-27 22:33:25,689][106225] Updated weights for policy 1, policy_version 462987 (0.0006) [2023-12-27 22:33:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 236748800. Throughput: 0: 9804.9, 1: 9884.8. Samples: 236715528. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:26,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.478')] [2023-12-27 22:33:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000461576_118194176.pth... [2023-12-27 22:33:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000460424_117899264.pth [2023-12-27 22:33:26,221][106225] Updated weights for policy 1, policy_version 462997 (0.0005) [2023-12-27 22:33:26,294][106225] Updated weights for policy 1, policy_version 463007 (0.0006) [2023-12-27 22:33:26,346][106225] Updated weights for policy 1, policy_version 463017 (0.0005) [2023-12-27 22:33:26,378][106226] Updated weights for policy 0, policy_version 461579 (0.0008) [2023-12-27 22:33:26,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000463024_118562816.pth... [2023-12-27 22:33:26,382][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000461840_118259712.pth [2023-12-27 22:33:26,429][106226] Updated weights for policy 0, policy_version 461589 (0.0005) [2023-12-27 22:33:26,482][106226] Updated weights for policy 0, policy_version 461599 (0.0005) [2023-12-27 22:33:26,917][106225] Updated weights for policy 1, policy_version 463027 (0.0005) [2023-12-27 22:33:26,973][106225] Updated weights for policy 1, policy_version 463037 (0.0005) [2023-12-27 22:33:27,035][106225] Updated weights for policy 1, policy_version 463047 (0.0006) [2023-12-27 22:33:27,136][106226] Updated weights for policy 0, policy_version 461609 (0.0005) [2023-12-27 22:33:27,197][106226] Updated weights for policy 0, policy_version 461619 (0.0008) [2023-12-27 22:33:27,251][106226] Updated weights for policy 0, policy_version 461629 (0.0008) [2023-12-27 22:33:27,299][106226] Updated weights for policy 0, policy_version 461639 (0.0007) [2023-12-27 22:33:27,635][106225] Updated weights for policy 1, policy_version 463057 (0.0008) [2023-12-27 22:33:27,701][106225] Updated weights for policy 1, policy_version 463067 (0.0007) [2023-12-27 22:33:27,758][106225] Updated weights for policy 1, policy_version 463077 (0.0006) [2023-12-27 22:33:27,814][106225] Updated weights for policy 1, policy_version 463087 (0.0005) [2023-12-27 22:33:28,119][106226] Updated weights for policy 0, policy_version 461649 (0.0005) [2023-12-27 22:33:28,185][106226] Updated weights for policy 0, policy_version 461659 (0.0005) [2023-12-27 22:33:28,248][106226] Updated weights for policy 0, policy_version 461669 (0.0005) [2023-12-27 22:33:28,355][106225] Updated weights for policy 1, policy_version 463097 (0.0007) [2023-12-27 22:33:28,413][106225] Updated weights for policy 1, policy_version 463107 (0.0008) [2023-12-27 22:33:28,471][106225] Updated weights for policy 1, policy_version 463117 (0.0008) [2023-12-27 22:33:28,784][106226] Updated weights for policy 0, policy_version 461679 (0.0007) [2023-12-27 22:33:28,838][106226] Updated weights for policy 0, policy_version 461689 (0.0007) [2023-12-27 22:33:28,889][106226] Updated weights for policy 0, policy_version 461699 (0.0008) [2023-12-27 22:33:29,173][106225] Updated weights for policy 1, policy_version 463127 (0.0008) [2023-12-27 22:33:29,229][106225] Updated weights for policy 1, policy_version 463137 (0.0008) [2023-12-27 22:33:29,290][106225] Updated weights for policy 1, policy_version 463147 (0.0008) [2023-12-27 22:33:29,627][106226] Updated weights for policy 0, policy_version 461709 (0.0007) [2023-12-27 22:33:29,686][106226] Updated weights for policy 0, policy_version 461719 (0.0008) [2023-12-27 22:33:29,753][106226] Updated weights for policy 0, policy_version 461729 (0.0009) [2023-12-27 22:33:29,956][106225] Updated weights for policy 1, policy_version 463157 (0.0007) [2023-12-27 22:33:30,016][106225] Updated weights for policy 1, policy_version 463167 (0.0006) [2023-12-27 22:33:30,076][106225] Updated weights for policy 1, policy_version 463177 (0.0005) [2023-12-27 22:33:30,527][106226] Updated weights for policy 0, policy_version 461739 (0.0007) [2023-12-27 22:33:30,595][106226] Updated weights for policy 0, policy_version 461749 (0.0006) [2023-12-27 22:33:30,652][106226] Updated weights for policy 0, policy_version 461759 (0.0009) [2023-12-27 22:33:30,669][106225] Updated weights for policy 1, policy_version 463187 (0.0005) [2023-12-27 22:33:30,720][106225] Updated weights for policy 1, policy_version 463197 (0.0008) [2023-12-27 22:33:30,776][106225] Updated weights for policy 1, policy_version 463207 (0.0007) [2023-12-27 22:33:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 236855296. Throughput: 0: 9882.9, 1: 10109.7. Samples: 236843768. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:31,175][105115] Avg episode reward: [(0, '-4.944'), (1, '-5.591')] [2023-12-27 22:33:31,365][106226] Updated weights for policy 0, policy_version 461769 (0.0008) [2023-12-27 22:33:31,433][106226] Updated weights for policy 0, policy_version 461779 (0.0008) [2023-12-27 22:33:31,497][106226] Updated weights for policy 0, policy_version 461789 (0.0008) [2023-12-27 22:33:31,504][106225] Updated weights for policy 1, policy_version 463217 (0.0007) [2023-12-27 22:33:31,553][106226] Updated weights for policy 0, policy_version 461799 (0.0006) [2023-12-27 22:33:31,561][106225] Updated weights for policy 1, policy_version 463227 (0.0010) [2023-12-27 22:33:31,615][106225] Updated weights for policy 1, policy_version 463237 (0.0010) [2023-12-27 22:33:31,682][106225] Updated weights for policy 1, policy_version 463247 (0.0010) [2023-12-27 22:33:32,296][106226] Updated weights for policy 0, policy_version 461809 (0.0008) [2023-12-27 22:33:32,366][106226] Updated weights for policy 0, policy_version 461819 (0.0008) [2023-12-27 22:33:32,436][106226] Updated weights for policy 0, policy_version 461829 (0.0007) [2023-12-27 22:33:32,437][106225] Updated weights for policy 1, policy_version 463257 (0.0010) [2023-12-27 22:33:32,499][106225] Updated weights for policy 1, policy_version 463267 (0.0010) [2023-12-27 22:33:32,561][106225] Updated weights for policy 1, policy_version 463277 (0.0010) [2023-12-27 22:33:33,151][106226] Updated weights for policy 0, policy_version 461839 (0.0007) [2023-12-27 22:33:33,199][106226] Updated weights for policy 0, policy_version 461849 (0.0007) [2023-12-27 22:33:33,252][106226] Updated weights for policy 0, policy_version 461859 (0.0007) [2023-12-27 22:33:33,261][106225] Updated weights for policy 1, policy_version 463287 (0.0010) [2023-12-27 22:33:33,316][106225] Updated weights for policy 1, policy_version 463297 (0.0010) [2023-12-27 22:33:33,373][106225] Updated weights for policy 1, policy_version 463307 (0.0008) [2023-12-27 22:33:33,841][106226] Updated weights for policy 0, policy_version 461869 (0.0005) [2023-12-27 22:33:33,899][106226] Updated weights for policy 0, policy_version 461879 (0.0005) [2023-12-27 22:33:33,963][106226] Updated weights for policy 0, policy_version 461889 (0.0007) [2023-12-27 22:33:33,966][106225] Updated weights for policy 1, policy_version 463317 (0.0007) [2023-12-27 22:33:34,019][106225] Updated weights for policy 1, policy_version 463327 (0.0005) [2023-12-27 22:33:34,072][106225] Updated weights for policy 1, policy_version 463337 (0.0005) [2023-12-27 22:33:34,615][106226] Updated weights for policy 0, policy_version 461899 (0.0008) [2023-12-27 22:33:34,674][106226] Updated weights for policy 0, policy_version 461909 (0.0008) [2023-12-27 22:33:34,689][106225] Updated weights for policy 1, policy_version 463347 (0.0007) [2023-12-27 22:33:34,735][106226] Updated weights for policy 0, policy_version 461919 (0.0007) [2023-12-27 22:33:34,740][106225] Updated weights for policy 1, policy_version 463357 (0.0010) [2023-12-27 22:33:34,805][106225] Updated weights for policy 1, policy_version 463367 (0.0010) [2023-12-27 22:33:35,389][106226] Updated weights for policy 0, policy_version 461929 (0.0006) [2023-12-27 22:33:35,439][106226] Updated weights for policy 0, policy_version 461939 (0.0005) [2023-12-27 22:33:35,497][106226] Updated weights for policy 0, policy_version 461949 (0.0006) [2023-12-27 22:33:35,521][106225] Updated weights for policy 1, policy_version 463377 (0.0010) [2023-12-27 22:33:35,555][106226] Updated weights for policy 0, policy_version 461959 (0.0005) [2023-12-27 22:33:35,583][106225] Updated weights for policy 1, policy_version 463387 (0.0008) [2023-12-27 22:33:35,651][106225] Updated weights for policy 1, policy_version 463397 (0.0006) [2023-12-27 22:33:35,714][106225] Updated weights for policy 1, policy_version 463407 (0.0008) [2023-12-27 22:33:36,103][106226] Updated weights for policy 0, policy_version 461969 (0.0007) [2023-12-27 22:33:36,166][106226] Updated weights for policy 0, policy_version 461979 (0.0007) [2023-12-27 22:33:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 236953600. Throughput: 0: 9975.6, 1: 10106.9. Samples: 236967188. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:36,175][105115] Avg episode reward: [(0, '-5.116'), (1, '-5.450')] [2023-12-27 22:33:36,223][106226] Updated weights for policy 0, policy_version 461989 (0.0005) [2023-12-27 22:33:36,391][106225] Updated weights for policy 1, policy_version 463417 (0.0011) [2023-12-27 22:33:36,463][106225] Updated weights for policy 1, policy_version 463427 (0.0011) [2023-12-27 22:33:36,526][106225] Updated weights for policy 1, policy_version 463437 (0.0011) [2023-12-27 22:33:36,870][106226] Updated weights for policy 0, policy_version 461999 (0.0008) [2023-12-27 22:33:36,936][106226] Updated weights for policy 0, policy_version 462009 (0.0009) [2023-12-27 22:33:37,000][106226] Updated weights for policy 0, policy_version 462019 (0.0008) [2023-12-27 22:33:37,239][106225] Updated weights for policy 1, policy_version 463447 (0.0009) [2023-12-27 22:33:37,305][106225] Updated weights for policy 1, policy_version 463457 (0.0008) [2023-12-27 22:33:37,370][106225] Updated weights for policy 1, policy_version 463467 (0.0009) [2023-12-27 22:33:37,806][106226] Updated weights for policy 0, policy_version 462029 (0.0009) [2023-12-27 22:33:37,863][106226] Updated weights for policy 0, policy_version 462039 (0.0008) [2023-12-27 22:33:37,918][106226] Updated weights for policy 0, policy_version 462049 (0.0008) [2023-12-27 22:33:38,035][106225] Updated weights for policy 1, policy_version 463477 (0.0010) [2023-12-27 22:33:38,082][106225] Updated weights for policy 1, policy_version 463487 (0.0010) [2023-12-27 22:33:38,129][106225] Updated weights for policy 1, policy_version 463497 (0.0010) [2023-12-27 22:33:38,684][106226] Updated weights for policy 0, policy_version 462059 (0.0008) [2023-12-27 22:33:38,741][106226] Updated weights for policy 0, policy_version 462069 (0.0008) [2023-12-27 22:33:38,800][106226] Updated weights for policy 0, policy_version 462079 (0.0008) [2023-12-27 22:33:38,834][106225] Updated weights for policy 1, policy_version 463507 (0.0009) [2023-12-27 22:33:38,895][106225] Updated weights for policy 1, policy_version 463517 (0.0006) [2023-12-27 22:33:38,955][106225] Updated weights for policy 1, policy_version 463527 (0.0005) [2023-12-27 22:33:39,483][106226] Updated weights for policy 0, policy_version 462089 (0.0008) [2023-12-27 22:33:39,545][106226] Updated weights for policy 0, policy_version 462099 (0.0011) [2023-12-27 22:33:39,610][106226] Updated weights for policy 0, policy_version 462109 (0.0011) [2023-12-27 22:33:39,646][106225] Updated weights for policy 1, policy_version 463537 (0.0005) [2023-12-27 22:33:39,665][106226] Updated weights for policy 0, policy_version 462119 (0.0010) [2023-12-27 22:33:39,703][106225] Updated weights for policy 1, policy_version 463547 (0.0007) [2023-12-27 22:33:39,767][106225] Updated weights for policy 1, policy_version 463557 (0.0011) [2023-12-27 22:33:39,835][106225] Updated weights for policy 1, policy_version 463567 (0.0010) [2023-12-27 22:33:40,419][106226] Updated weights for policy 0, policy_version 462129 (0.0009) [2023-12-27 22:33:40,484][106226] Updated weights for policy 0, policy_version 462139 (0.0011) [2023-12-27 22:33:40,549][106226] Updated weights for policy 0, policy_version 462149 (0.0011) [2023-12-27 22:33:40,558][106225] Updated weights for policy 1, policy_version 463577 (0.0008) [2023-12-27 22:33:40,615][106225] Updated weights for policy 1, policy_version 463587 (0.0009) [2023-12-27 22:33:40,672][106225] Updated weights for policy 1, policy_version 463597 (0.0010) [2023-12-27 22:33:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 237051904. Throughput: 0: 9987.3, 1: 10137.2. Samples: 237025048. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:41,176][105115] Avg episode reward: [(0, '-4.881'), (1, '-5.685')] [2023-12-27 22:33:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000463600_118710272.pth... [2023-12-27 22:33:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000462152_118341632.pth... [2023-12-27 22:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000462416_118407168.pth [2023-12-27 22:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000463600_118710272.pth [2023-12-27 22:33:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000461000_118046720.pth [2023-12-27 22:33:41,188][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000462152_118341632.pth [2023-12-27 22:33:41,263][106226] Updated weights for policy 0, policy_version 462159 (0.0010) [2023-12-27 22:33:41,328][106226] Updated weights for policy 0, policy_version 462169 (0.0011) [2023-12-27 22:33:41,397][106226] Updated weights for policy 0, policy_version 462179 (0.0009) [2023-12-27 22:33:41,460][106225] Updated weights for policy 1, policy_version 463607 (0.0008) [2023-12-27 22:33:41,510][106225] Updated weights for policy 1, policy_version 463617 (0.0008) [2023-12-27 22:33:41,560][106225] Updated weights for policy 1, policy_version 463627 (0.0008) [2023-12-27 22:33:42,059][106226] Updated weights for policy 0, policy_version 462189 (0.0009) [2023-12-27 22:33:42,123][106226] Updated weights for policy 0, policy_version 462199 (0.0008) [2023-12-27 22:33:42,177][106226] Updated weights for policy 0, policy_version 462209 (0.0007) [2023-12-27 22:33:42,387][106225] Updated weights for policy 1, policy_version 463637 (0.0008) [2023-12-27 22:33:42,444][106225] Updated weights for policy 1, policy_version 463647 (0.0008) [2023-12-27 22:33:42,499][106225] Updated weights for policy 1, policy_version 463657 (0.0007) [2023-12-27 22:33:42,896][106226] Updated weights for policy 0, policy_version 462219 (0.0007) [2023-12-27 22:33:42,954][106226] Updated weights for policy 0, policy_version 462229 (0.0008) [2023-12-27 22:33:43,005][106226] Updated weights for policy 0, policy_version 462239 (0.0008) [2023-12-27 22:33:43,246][106225] Updated weights for policy 1, policy_version 463667 (0.0008) [2023-12-27 22:33:43,297][106225] Updated weights for policy 1, policy_version 463677 (0.0008) [2023-12-27 22:33:43,354][106225] Updated weights for policy 1, policy_version 463687 (0.0005) [2023-12-27 22:33:43,715][106226] Updated weights for policy 0, policy_version 462249 (0.0009) [2023-12-27 22:33:43,769][106226] Updated weights for policy 0, policy_version 462259 (0.0008) [2023-12-27 22:33:43,828][106226] Updated weights for policy 0, policy_version 462269 (0.0008) [2023-12-27 22:33:43,893][106226] Updated weights for policy 0, policy_version 462279 (0.0006) [2023-12-27 22:33:44,044][106225] Updated weights for policy 1, policy_version 463697 (0.0007) [2023-12-27 22:33:44,106][106225] Updated weights for policy 1, policy_version 463707 (0.0006) [2023-12-27 22:33:44,161][106225] Updated weights for policy 1, policy_version 463717 (0.0007) [2023-12-27 22:33:44,212][106225] Updated weights for policy 1, policy_version 463727 (0.0005) [2023-12-27 22:33:44,651][106226] Updated weights for policy 0, policy_version 462289 (0.0006) [2023-12-27 22:33:44,723][106226] Updated weights for policy 0, policy_version 462299 (0.0007) [2023-12-27 22:33:44,776][106225] Updated weights for policy 1, policy_version 463737 (0.0008) [2023-12-27 22:33:44,781][106226] Updated weights for policy 0, policy_version 462309 (0.0007) [2023-12-27 22:33:44,827][106225] Updated weights for policy 1, policy_version 463747 (0.0009) [2023-12-27 22:33:44,883][106225] Updated weights for policy 1, policy_version 463757 (0.0009) [2023-12-27 22:33:45,439][106226] Updated weights for policy 0, policy_version 462319 (0.0009) [2023-12-27 22:33:45,486][106226] Updated weights for policy 0, policy_version 462329 (0.0008) [2023-12-27 22:33:45,531][106226] Updated weights for policy 0, policy_version 462339 (0.0008) [2023-12-27 22:33:45,652][106225] Updated weights for policy 1, policy_version 463767 (0.0009) [2023-12-27 22:33:45,714][106225] Updated weights for policy 1, policy_version 463777 (0.0008) [2023-12-27 22:33:45,769][106225] Updated weights for policy 1, policy_version 463787 (0.0008) [2023-12-27 22:33:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 237150208. Throughput: 0: 9972.3, 1: 10124.3. Samples: 237141904. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:46,176][105115] Avg episode reward: [(0, '-5.000'), (1, '-5.412')] [2023-12-27 22:33:46,255][106226] Updated weights for policy 0, policy_version 462349 (0.0008) [2023-12-27 22:33:46,310][106226] Updated weights for policy 0, policy_version 462359 (0.0009) [2023-12-27 22:33:46,365][106226] Updated weights for policy 0, policy_version 462369 (0.0008) [2023-12-27 22:33:46,503][106225] Updated weights for policy 1, policy_version 463797 (0.0007) [2023-12-27 22:33:46,558][106225] Updated weights for policy 1, policy_version 463807 (0.0005) [2023-12-27 22:33:46,615][106225] Updated weights for policy 1, policy_version 463817 (0.0005) [2023-12-27 22:33:47,116][106226] Updated weights for policy 0, policy_version 462379 (0.0009) [2023-12-27 22:33:47,168][106226] Updated weights for policy 0, policy_version 462389 (0.0009) [2023-12-27 22:33:47,221][106226] Updated weights for policy 0, policy_version 462399 (0.0008) [2023-12-27 22:33:47,278][106225] Updated weights for policy 1, policy_version 463827 (0.0007) [2023-12-27 22:33:47,325][106225] Updated weights for policy 1, policy_version 463837 (0.0008) [2023-12-27 22:33:47,377][106225] Updated weights for policy 1, policy_version 463847 (0.0008) [2023-12-27 22:33:47,883][106226] Updated weights for policy 0, policy_version 462409 (0.0008) [2023-12-27 22:33:47,940][106226] Updated weights for policy 0, policy_version 462419 (0.0009) [2023-12-27 22:33:48,003][106226] Updated weights for policy 0, policy_version 462429 (0.0009) [2023-12-27 22:33:48,064][106226] Updated weights for policy 0, policy_version 462439 (0.0008) [2023-12-27 22:33:48,127][106225] Updated weights for policy 1, policy_version 463857 (0.0005) [2023-12-27 22:33:48,191][106225] Updated weights for policy 1, policy_version 463867 (0.0009) [2023-12-27 22:33:48,251][106225] Updated weights for policy 1, policy_version 463877 (0.0008) [2023-12-27 22:33:48,307][106225] Updated weights for policy 1, policy_version 463887 (0.0009) [2023-12-27 22:33:48,785][106226] Updated weights for policy 0, policy_version 462449 (0.0008) [2023-12-27 22:33:48,829][106226] Updated weights for policy 0, policy_version 462459 (0.0008) [2023-12-27 22:33:48,889][106226] Updated weights for policy 0, policy_version 462469 (0.0008) [2023-12-27 22:33:49,052][106225] Updated weights for policy 1, policy_version 463897 (0.0006) [2023-12-27 22:33:49,108][106225] Updated weights for policy 1, policy_version 463907 (0.0008) [2023-12-27 22:33:49,159][106225] Updated weights for policy 1, policy_version 463917 (0.0008) [2023-12-27 22:33:49,673][106226] Updated weights for policy 0, policy_version 462479 (0.0009) [2023-12-27 22:33:49,735][106226] Updated weights for policy 0, policy_version 462489 (0.0008) [2023-12-27 22:33:49,798][106226] Updated weights for policy 0, policy_version 462499 (0.0009) [2023-12-27 22:33:49,895][106225] Updated weights for policy 1, policy_version 463927 (0.0009) [2023-12-27 22:33:49,962][106225] Updated weights for policy 1, policy_version 463937 (0.0009) [2023-12-27 22:33:50,025][106225] Updated weights for policy 1, policy_version 463947 (0.0008) [2023-12-27 22:33:50,559][106226] Updated weights for policy 0, policy_version 462509 (0.0009) [2023-12-27 22:33:50,623][106226] Updated weights for policy 0, policy_version 462519 (0.0009) [2023-12-27 22:33:50,686][106226] Updated weights for policy 0, policy_version 462529 (0.0007) [2023-12-27 22:33:50,767][106225] Updated weights for policy 1, policy_version 463957 (0.0009) [2023-12-27 22:33:50,827][106225] Updated weights for policy 1, policy_version 463967 (0.0008) [2023-12-27 22:33:50,887][106225] Updated weights for policy 1, policy_version 463977 (0.0007) [2023-12-27 22:33:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 237248512. Throughput: 0: 9922.2, 1: 10068.1. Samples: 237256368. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:51,175][105115] Avg episode reward: [(0, '-5.102'), (1, '-5.748')] [2023-12-27 22:33:51,456][106226] Updated weights for policy 0, policy_version 462539 (0.0007) [2023-12-27 22:33:51,516][106226] Updated weights for policy 0, policy_version 462549 (0.0009) [2023-12-27 22:33:51,566][106226] Updated weights for policy 0, policy_version 462559 (0.0008) [2023-12-27 22:33:51,573][106225] Updated weights for policy 1, policy_version 463987 (0.0006) [2023-12-27 22:33:51,638][106225] Updated weights for policy 1, policy_version 463997 (0.0007) [2023-12-27 22:33:51,705][106225] Updated weights for policy 1, policy_version 464007 (0.0009) [2023-12-27 22:33:52,339][106226] Updated weights for policy 0, policy_version 462569 (0.0009) [2023-12-27 22:33:52,402][106226] Updated weights for policy 0, policy_version 462579 (0.0008) [2023-12-27 22:33:52,468][106226] Updated weights for policy 0, policy_version 462589 (0.0008) [2023-12-27 22:33:52,483][106225] Updated weights for policy 1, policy_version 464017 (0.0009) [2023-12-27 22:33:52,538][106226] Updated weights for policy 0, policy_version 462599 (0.0008) [2023-12-27 22:33:52,545][106225] Updated weights for policy 1, policy_version 464027 (0.0006) [2023-12-27 22:33:52,602][106225] Updated weights for policy 1, policy_version 464037 (0.0005) [2023-12-27 22:33:52,662][106225] Updated weights for policy 1, policy_version 464047 (0.0007) [2023-12-27 22:33:53,252][106226] Updated weights for policy 0, policy_version 462609 (0.0011) [2023-12-27 22:33:53,256][106225] Updated weights for policy 1, policy_version 464057 (0.0010) [2023-12-27 22:33:53,309][106225] Updated weights for policy 1, policy_version 464067 (0.0010) [2023-12-27 22:33:53,312][106226] Updated weights for policy 0, policy_version 462619 (0.0007) [2023-12-27 22:33:53,362][106225] Updated weights for policy 1, policy_version 464077 (0.0010) [2023-12-27 22:33:53,364][106226] Updated weights for policy 0, policy_version 462629 (0.0008) [2023-12-27 22:33:54,004][106226] Updated weights for policy 0, policy_version 462639 (0.0010) [2023-12-27 22:33:54,065][106225] Updated weights for policy 1, policy_version 464087 (0.0007) [2023-12-27 22:33:54,068][106226] Updated weights for policy 0, policy_version 462649 (0.0008) [2023-12-27 22:33:54,123][106225] Updated weights for policy 1, policy_version 464097 (0.0006) [2023-12-27 22:33:54,128][106226] Updated weights for policy 0, policy_version 462659 (0.0007) [2023-12-27 22:33:54,180][106225] Updated weights for policy 1, policy_version 464107 (0.0005) [2023-12-27 22:33:54,687][106225] Updated weights for policy 1, policy_version 464117 (0.0007) [2023-12-27 22:33:54,737][106225] Updated weights for policy 1, policy_version 464127 (0.0008) [2023-12-27 22:33:54,788][106225] Updated weights for policy 1, policy_version 464137 (0.0008) [2023-12-27 22:33:54,881][106226] Updated weights for policy 0, policy_version 462669 (0.0005) [2023-12-27 22:33:54,933][106226] Updated weights for policy 0, policy_version 462679 (0.0005) [2023-12-27 22:33:54,989][106226] Updated weights for policy 0, policy_version 462689 (0.0006) [2023-12-27 22:33:55,546][106225] Updated weights for policy 1, policy_version 464147 (0.0006) [2023-12-27 22:33:55,598][106225] Updated weights for policy 1, policy_version 464157 (0.0008) [2023-12-27 22:33:55,642][106226] Updated weights for policy 0, policy_version 462699 (0.0006) [2023-12-27 22:33:55,652][106225] Updated weights for policy 1, policy_version 464167 (0.0008) [2023-12-27 22:33:55,694][106226] Updated weights for policy 0, policy_version 462709 (0.0006) [2023-12-27 22:33:55,752][106226] Updated weights for policy 0, policy_version 462719 (0.0007) [2023-12-27 22:33:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 237346816. Throughput: 0: 9897.8, 1: 10077.9. Samples: 237315320. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:33:56,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.445')] [2023-12-27 22:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000464176_118857728.pth... [2023-12-27 22:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000462728_118489088.pth... [2023-12-27 22:33:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000463024_118562816.pth [2023-12-27 22:33:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000461576_118194176.pth [2023-12-27 22:33:56,366][106226] Updated weights for policy 0, policy_version 462729 (0.0008) [2023-12-27 22:33:56,417][106226] Updated weights for policy 0, policy_version 462739 (0.0005) [2023-12-27 22:33:56,442][106225] Updated weights for policy 1, policy_version 464177 (0.0007) [2023-12-27 22:33:56,498][106226] Updated weights for policy 0, policy_version 462749 (0.0006) [2023-12-27 22:33:56,503][106225] Updated weights for policy 1, policy_version 464187 (0.0009) [2023-12-27 22:33:56,554][106226] Updated weights for policy 0, policy_version 462759 (0.0005) [2023-12-27 22:33:56,557][106225] Updated weights for policy 1, policy_version 464197 (0.0008) [2023-12-27 22:33:56,605][106225] Updated weights for policy 1, policy_version 464207 (0.0008) [2023-12-27 22:33:57,167][106226] Updated weights for policy 0, policy_version 462769 (0.0008) [2023-12-27 22:33:57,211][106226] Updated weights for policy 0, policy_version 462779 (0.0008) [2023-12-27 22:33:57,268][106226] Updated weights for policy 0, policy_version 462789 (0.0008) [2023-12-27 22:33:57,350][106225] Updated weights for policy 1, policy_version 464217 (0.0008) [2023-12-27 22:33:57,404][106225] Updated weights for policy 1, policy_version 464227 (0.0008) [2023-12-27 22:33:57,457][106225] Updated weights for policy 1, policy_version 464237 (0.0009) [2023-12-27 22:33:57,942][106226] Updated weights for policy 0, policy_version 462799 (0.0008) [2023-12-27 22:33:58,003][106226] Updated weights for policy 0, policy_version 462809 (0.0008) [2023-12-27 22:33:58,068][106226] Updated weights for policy 0, policy_version 462819 (0.0006) [2023-12-27 22:33:58,225][106225] Updated weights for policy 1, policy_version 464247 (0.0009) [2023-12-27 22:33:58,284][106225] Updated weights for policy 1, policy_version 464257 (0.0008) [2023-12-27 22:33:58,358][106225] Updated weights for policy 1, policy_version 464267 (0.0008) [2023-12-27 22:33:58,804][106226] Updated weights for policy 0, policy_version 462829 (0.0007) [2023-12-27 22:33:58,879][106226] Updated weights for policy 0, policy_version 462839 (0.0009) [2023-12-27 22:33:58,934][106226] Updated weights for policy 0, policy_version 462849 (0.0009) [2023-12-27 22:33:59,275][106225] Updated weights for policy 1, policy_version 464277 (0.0008) [2023-12-27 22:33:59,342][106225] Updated weights for policy 1, policy_version 464287 (0.0011) [2023-12-27 22:33:59,409][106225] Updated weights for policy 1, policy_version 464297 (0.0011) [2023-12-27 22:33:59,747][106226] Updated weights for policy 0, policy_version 462859 (0.0009) [2023-12-27 22:33:59,808][106226] Updated weights for policy 0, policy_version 462869 (0.0008) [2023-12-27 22:33:59,876][106226] Updated weights for policy 0, policy_version 462879 (0.0008) [2023-12-27 22:34:00,111][106225] Updated weights for policy 1, policy_version 464307 (0.0009) [2023-12-27 22:34:00,165][106225] Updated weights for policy 1, policy_version 464317 (0.0005) [2023-12-27 22:34:00,225][106225] Updated weights for policy 1, policy_version 464327 (0.0005) [2023-12-27 22:34:00,721][106226] Updated weights for policy 0, policy_version 462889 (0.0008) [2023-12-27 22:34:00,766][106225] Updated weights for policy 1, policy_version 464337 (0.0007) [2023-12-27 22:34:00,776][106226] Updated weights for policy 0, policy_version 462899 (0.0005) [2023-12-27 22:34:00,825][106225] Updated weights for policy 1, policy_version 464347 (0.0006) [2023-12-27 22:34:00,825][106226] Updated weights for policy 0, policy_version 462909 (0.0005) [2023-12-27 22:34:00,876][106226] Updated weights for policy 0, policy_version 462919 (0.0005) [2023-12-27 22:34:00,878][106225] Updated weights for policy 1, policy_version 464357 (0.0008) [2023-12-27 22:34:00,929][106225] Updated weights for policy 1, policy_version 464367 (0.0006) [2023-12-27 22:34:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 237445120. Throughput: 0: 9873.7, 1: 10010.8. Samples: 237431076. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:01,175][105115] Avg episode reward: [(0, '-5.039'), (1, '-5.678')] [2023-12-27 22:34:01,584][106226] Updated weights for policy 0, policy_version 462929 (0.0005) [2023-12-27 22:34:01,650][106226] Updated weights for policy 0, policy_version 462939 (0.0008) [2023-12-27 22:34:01,702][106225] Updated weights for policy 1, policy_version 464377 (0.0008) [2023-12-27 22:34:01,712][106226] Updated weights for policy 0, policy_version 462949 (0.0008) [2023-12-27 22:34:01,771][106225] Updated weights for policy 1, policy_version 464387 (0.0007) [2023-12-27 22:34:01,837][106225] Updated weights for policy 1, policy_version 464397 (0.0005) [2023-12-27 22:34:02,383][106225] Updated weights for policy 1, policy_version 464407 (0.0007) [2023-12-27 22:34:02,444][106225] Updated weights for policy 1, policy_version 464417 (0.0007) [2023-12-27 22:34:02,465][106226] Updated weights for policy 0, policy_version 462959 (0.0009) [2023-12-27 22:34:02,499][106225] Updated weights for policy 1, policy_version 464427 (0.0006) [2023-12-27 22:34:02,524][106226] Updated weights for policy 0, policy_version 462969 (0.0007) [2023-12-27 22:34:02,578][106226] Updated weights for policy 0, policy_version 462979 (0.0007) [2023-12-27 22:34:03,114][106225] Updated weights for policy 1, policy_version 464437 (0.0006) [2023-12-27 22:34:03,169][106225] Updated weights for policy 1, policy_version 464447 (0.0005) [2023-12-27 22:34:03,225][106225] Updated weights for policy 1, policy_version 464457 (0.0008) [2023-12-27 22:34:03,380][106226] Updated weights for policy 0, policy_version 462989 (0.0009) [2023-12-27 22:34:03,435][106226] Updated weights for policy 0, policy_version 462999 (0.0009) [2023-12-27 22:34:03,485][106226] Updated weights for policy 0, policy_version 463009 (0.0009) [2023-12-27 22:34:03,825][106225] Updated weights for policy 1, policy_version 464467 (0.0006) [2023-12-27 22:34:03,889][106225] Updated weights for policy 1, policy_version 464477 (0.0008) [2023-12-27 22:34:03,950][106225] Updated weights for policy 1, policy_version 464487 (0.0006) [2023-12-27 22:34:04,277][106226] Updated weights for policy 0, policy_version 463019 (0.0008) [2023-12-27 22:34:04,340][106226] Updated weights for policy 0, policy_version 463029 (0.0009) [2023-12-27 22:34:04,400][106226] Updated weights for policy 0, policy_version 463039 (0.0008) [2023-12-27 22:34:04,620][106225] Updated weights for policy 1, policy_version 464497 (0.0010) [2023-12-27 22:34:04,666][106225] Updated weights for policy 1, policy_version 464507 (0.0007) [2023-12-27 22:34:04,720][106225] Updated weights for policy 1, policy_version 464517 (0.0008) [2023-12-27 22:34:04,787][106225] Updated weights for policy 1, policy_version 464527 (0.0008) [2023-12-27 22:34:05,059][106226] Updated weights for policy 0, policy_version 463049 (0.0009) [2023-12-27 22:34:05,111][106226] Updated weights for policy 0, policy_version 463059 (0.0005) [2023-12-27 22:34:05,172][106226] Updated weights for policy 0, policy_version 463069 (0.0005) [2023-12-27 22:34:05,238][106226] Updated weights for policy 0, policy_version 463079 (0.0005) [2023-12-27 22:34:05,482][106225] Updated weights for policy 1, policy_version 464537 (0.0010) [2023-12-27 22:34:05,531][106225] Updated weights for policy 1, policy_version 464547 (0.0010) [2023-12-27 22:34:05,577][106225] Updated weights for policy 1, policy_version 464557 (0.0010) [2023-12-27 22:34:05,867][106226] Updated weights for policy 0, policy_version 463089 (0.0006) [2023-12-27 22:34:05,925][106226] Updated weights for policy 0, policy_version 463099 (0.0006) [2023-12-27 22:34:05,984][106226] Updated weights for policy 0, policy_version 463109 (0.0007) [2023-12-27 22:34:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19688.6). Total num frames: 237543424. Throughput: 0: 9805.2, 1: 10056.3. Samples: 237552356. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:06,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.654')] [2023-12-27 22:34:06,316][106225] Updated weights for policy 1, policy_version 464567 (0.0009) [2023-12-27 22:34:06,368][106225] Updated weights for policy 1, policy_version 464577 (0.0008) [2023-12-27 22:34:06,424][106225] Updated weights for policy 1, policy_version 464587 (0.0008) [2023-12-27 22:34:06,668][106226] Updated weights for policy 0, policy_version 463119 (0.0008) [2023-12-27 22:34:06,733][106226] Updated weights for policy 0, policy_version 463129 (0.0007) [2023-12-27 22:34:06,797][106226] Updated weights for policy 0, policy_version 463139 (0.0009) [2023-12-27 22:34:07,136][106225] Updated weights for policy 1, policy_version 464597 (0.0007) [2023-12-27 22:34:07,201][106225] Updated weights for policy 1, policy_version 464607 (0.0009) [2023-12-27 22:34:07,259][106225] Updated weights for policy 1, policy_version 464617 (0.0010) [2023-12-27 22:34:07,549][106226] Updated weights for policy 0, policy_version 463149 (0.0009) [2023-12-27 22:34:07,611][106226] Updated weights for policy 0, policy_version 463159 (0.0008) [2023-12-27 22:34:07,675][106226] Updated weights for policy 0, policy_version 463169 (0.0008) [2023-12-27 22:34:07,952][106225] Updated weights for policy 1, policy_version 464627 (0.0009) [2023-12-27 22:34:08,008][106225] Updated weights for policy 1, policy_version 464637 (0.0010) [2023-12-27 22:34:08,075][106225] Updated weights for policy 1, policy_version 464647 (0.0010) [2023-12-27 22:34:08,409][106226] Updated weights for policy 0, policy_version 463179 (0.0009) [2023-12-27 22:34:08,467][106226] Updated weights for policy 0, policy_version 463189 (0.0011) [2023-12-27 22:34:08,531][106226] Updated weights for policy 0, policy_version 463199 (0.0011) [2023-12-27 22:34:08,810][106225] Updated weights for policy 1, policy_version 464657 (0.0008) [2023-12-27 22:34:08,871][106225] Updated weights for policy 1, policy_version 464667 (0.0007) [2023-12-27 22:34:08,934][106225] Updated weights for policy 1, policy_version 464677 (0.0007) [2023-12-27 22:34:08,991][106225] Updated weights for policy 1, policy_version 464687 (0.0009) [2023-12-27 22:34:09,192][106226] Updated weights for policy 0, policy_version 463209 (0.0011) [2023-12-27 22:34:09,249][106226] Updated weights for policy 0, policy_version 463219 (0.0008) [2023-12-27 22:34:09,321][106226] Updated weights for policy 0, policy_version 463229 (0.0009) [2023-12-27 22:34:09,395][106226] Updated weights for policy 0, policy_version 463239 (0.0010) [2023-12-27 22:34:09,739][106225] Updated weights for policy 1, policy_version 464697 (0.0009) [2023-12-27 22:34:09,802][106225] Updated weights for policy 1, policy_version 464707 (0.0009) [2023-12-27 22:34:09,868][106225] Updated weights for policy 1, policy_version 464717 (0.0008) [2023-12-27 22:34:10,111][106226] Updated weights for policy 0, policy_version 463249 (0.0011) [2023-12-27 22:34:10,165][106226] Updated weights for policy 0, policy_version 463259 (0.0010) [2023-12-27 22:34:10,222][106226] Updated weights for policy 0, policy_version 463269 (0.0007) [2023-12-27 22:34:10,640][106225] Updated weights for policy 1, policy_version 464727 (0.0008) [2023-12-27 22:34:10,692][106225] Updated weights for policy 1, policy_version 464737 (0.0008) [2023-12-27 22:34:10,742][106225] Updated weights for policy 1, policy_version 464747 (0.0007) [2023-12-27 22:34:10,904][106226] Updated weights for policy 0, policy_version 463279 (0.0006) [2023-12-27 22:34:10,953][106226] Updated weights for policy 0, policy_version 463289 (0.0006) [2023-12-27 22:34:11,006][106226] Updated weights for policy 0, policy_version 463299 (0.0005) [2023-12-27 22:34:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 237641728. Throughput: 0: 9791.5, 1: 10099.6. Samples: 237610624. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:11,175][105115] Avg episode reward: [(0, '-5.332'), (1, '-5.689')] [2023-12-27 22:34:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000464752_119005184.pth... [2023-12-27 22:34:11,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000463304_118636544.pth... [2023-12-27 22:34:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000463600_118710272.pth [2023-12-27 22:34:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000462152_118341632.pth [2023-12-27 22:34:11,561][106225] Updated weights for policy 1, policy_version 464757 (0.0009) [2023-12-27 22:34:11,626][106225] Updated weights for policy 1, policy_version 464767 (0.0008) [2023-12-27 22:34:11,690][106225] Updated weights for policy 1, policy_version 464777 (0.0008) [2023-12-27 22:34:11,745][106226] Updated weights for policy 0, policy_version 463309 (0.0007) [2023-12-27 22:34:11,811][106226] Updated weights for policy 0, policy_version 463319 (0.0010) [2023-12-27 22:34:11,873][106226] Updated weights for policy 0, policy_version 463329 (0.0011) [2023-12-27 22:34:12,492][106225] Updated weights for policy 1, policy_version 464787 (0.0009) [2023-12-27 22:34:12,541][106225] Updated weights for policy 1, policy_version 464797 (0.0008) [2023-12-27 22:34:12,556][106226] Updated weights for policy 0, policy_version 463339 (0.0011) [2023-12-27 22:34:12,601][106225] Updated weights for policy 1, policy_version 464807 (0.0006) [2023-12-27 22:34:12,607][106226] Updated weights for policy 0, policy_version 463349 (0.0010) [2023-12-27 22:34:12,668][106226] Updated weights for policy 0, policy_version 463359 (0.0011) [2023-12-27 22:34:13,356][106225] Updated weights for policy 1, policy_version 464817 (0.0009) [2023-12-27 22:34:13,393][106226] Updated weights for policy 0, policy_version 463369 (0.0011) [2023-12-27 22:34:13,415][106225] Updated weights for policy 1, policy_version 464827 (0.0007) [2023-12-27 22:34:13,452][106226] Updated weights for policy 0, policy_version 463379 (0.0011) [2023-12-27 22:34:13,466][106225] Updated weights for policy 1, policy_version 464837 (0.0006) [2023-12-27 22:34:13,512][106226] Updated weights for policy 0, policy_version 463389 (0.0010) [2023-12-27 22:34:13,521][106225] Updated weights for policy 1, policy_version 464847 (0.0009) [2023-12-27 22:34:13,572][106226] Updated weights for policy 0, policy_version 463399 (0.0010) [2023-12-27 22:34:14,249][106226] Updated weights for policy 0, policy_version 463409 (0.0009) [2023-12-27 22:34:14,278][106225] Updated weights for policy 1, policy_version 464857 (0.0005) [2023-12-27 22:34:14,299][106226] Updated weights for policy 0, policy_version 463419 (0.0010) [2023-12-27 22:34:14,339][106225] Updated weights for policy 1, policy_version 464867 (0.0007) [2023-12-27 22:34:14,348][106226] Updated weights for policy 0, policy_version 463429 (0.0010) [2023-12-27 22:34:14,393][106225] Updated weights for policy 1, policy_version 464877 (0.0005) [2023-12-27 22:34:15,062][106226] Updated weights for policy 0, policy_version 463439 (0.0009) [2023-12-27 22:34:15,122][106226] Updated weights for policy 0, policy_version 463449 (0.0007) [2023-12-27 22:34:15,127][106225] Updated weights for policy 1, policy_version 464887 (0.0008) [2023-12-27 22:34:15,183][106226] Updated weights for policy 0, policy_version 463459 (0.0007) [2023-12-27 22:34:15,189][106225] Updated weights for policy 1, policy_version 464897 (0.0009) [2023-12-27 22:34:15,239][106225] Updated weights for policy 1, policy_version 464907 (0.0007) [2023-12-27 22:34:15,893][106226] Updated weights for policy 0, policy_version 463469 (0.0008) [2023-12-27 22:34:15,942][106226] Updated weights for policy 0, policy_version 463479 (0.0008) [2023-12-27 22:34:15,967][106225] Updated weights for policy 1, policy_version 464917 (0.0007) [2023-12-27 22:34:16,010][106226] Updated weights for policy 0, policy_version 463489 (0.0009) [2023-12-27 22:34:16,021][106225] Updated weights for policy 1, policy_version 464927 (0.0005) [2023-12-27 22:34:16,074][106225] Updated weights for policy 1, policy_version 464937 (0.0005) [2023-12-27 22:34:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 237740032. Throughput: 0: 9777.4, 1: 9810.2. Samples: 237725204. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:16,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-5.881')] [2023-12-27 22:34:16,679][106226] Updated weights for policy 0, policy_version 463499 (0.0007) [2023-12-27 22:34:16,732][106226] Updated weights for policy 0, policy_version 463509 (0.0005) [2023-12-27 22:34:16,798][106226] Updated weights for policy 0, policy_version 463519 (0.0005) [2023-12-27 22:34:16,803][106225] Updated weights for policy 1, policy_version 464947 (0.0007) [2023-12-27 22:34:16,856][106225] Updated weights for policy 1, policy_version 464957 (0.0008) [2023-12-27 22:34:16,903][106225] Updated weights for policy 1, policy_version 464967 (0.0009) [2023-12-27 22:34:17,439][106226] Updated weights for policy 0, policy_version 463529 (0.0005) [2023-12-27 22:34:17,484][106226] Updated weights for policy 0, policy_version 463539 (0.0008) [2023-12-27 22:34:17,538][106226] Updated weights for policy 0, policy_version 463549 (0.0009) [2023-12-27 22:34:17,599][106226] Updated weights for policy 0, policy_version 463559 (0.0007) [2023-12-27 22:34:17,650][106225] Updated weights for policy 1, policy_version 464977 (0.0010) [2023-12-27 22:34:17,714][106225] Updated weights for policy 1, policy_version 464987 (0.0009) [2023-12-27 22:34:17,772][106225] Updated weights for policy 1, policy_version 464997 (0.0008) [2023-12-27 22:34:17,823][106225] Updated weights for policy 1, policy_version 465007 (0.0008) [2023-12-27 22:34:18,268][106226] Updated weights for policy 0, policy_version 463569 (0.0009) [2023-12-27 22:34:18,337][106226] Updated weights for policy 0, policy_version 463579 (0.0008) [2023-12-27 22:34:18,409][106226] Updated weights for policy 0, policy_version 463589 (0.0009) [2023-12-27 22:34:18,571][106225] Updated weights for policy 1, policy_version 465017 (0.0008) [2023-12-27 22:34:18,621][106225] Updated weights for policy 1, policy_version 465027 (0.0009) [2023-12-27 22:34:18,670][106225] Updated weights for policy 1, policy_version 465037 (0.0009) [2023-12-27 22:34:19,189][106226] Updated weights for policy 0, policy_version 463599 (0.0008) [2023-12-27 22:34:19,253][106226] Updated weights for policy 0, policy_version 463609 (0.0008) [2023-12-27 22:34:19,300][106226] Updated weights for policy 0, policy_version 463619 (0.0008) [2023-12-27 22:34:19,357][106225] Updated weights for policy 1, policy_version 465047 (0.0008) [2023-12-27 22:34:19,415][106225] Updated weights for policy 1, policy_version 465057 (0.0008) [2023-12-27 22:34:19,480][106225] Updated weights for policy 1, policy_version 465067 (0.0008) [2023-12-27 22:34:20,014][106226] Updated weights for policy 0, policy_version 463629 (0.0008) [2023-12-27 22:34:20,078][106226] Updated weights for policy 0, policy_version 463639 (0.0008) [2023-12-27 22:34:20,142][106226] Updated weights for policy 0, policy_version 463649 (0.0009) [2023-12-27 22:34:20,212][106225] Updated weights for policy 1, policy_version 465077 (0.0007) [2023-12-27 22:34:20,273][106225] Updated weights for policy 1, policy_version 465087 (0.0009) [2023-12-27 22:34:20,330][106225] Updated weights for policy 1, policy_version 465097 (0.0006) [2023-12-27 22:34:20,872][106226] Updated weights for policy 0, policy_version 463659 (0.0009) [2023-12-27 22:34:20,930][106226] Updated weights for policy 0, policy_version 463669 (0.0009) [2023-12-27 22:34:20,987][106226] Updated weights for policy 0, policy_version 463679 (0.0008) [2023-12-27 22:34:21,026][106225] Updated weights for policy 1, policy_version 465107 (0.0006) [2023-12-27 22:34:21,090][106225] Updated weights for policy 1, policy_version 465117 (0.0009) [2023-12-27 22:34:21,161][106225] Updated weights for policy 1, policy_version 465127 (0.0008) [2023-12-27 22:34:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 237830144. Throughput: 0: 9697.6, 1: 9720.2. Samples: 237840988. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:21,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.560')] [2023-12-27 22:34:21,677][106226] Updated weights for policy 0, policy_version 463689 (0.0007) [2023-12-27 22:34:21,755][106226] Updated weights for policy 0, policy_version 463699 (0.0008) [2023-12-27 22:34:21,826][106226] Updated weights for policy 0, policy_version 463709 (0.0006) [2023-12-27 22:34:21,851][106225] Updated weights for policy 1, policy_version 465137 (0.0009) [2023-12-27 22:34:21,892][106226] Updated weights for policy 0, policy_version 463719 (0.0007) [2023-12-27 22:34:21,908][106225] Updated weights for policy 1, policy_version 465147 (0.0008) [2023-12-27 22:34:21,978][106225] Updated weights for policy 1, policy_version 465157 (0.0009) [2023-12-27 22:34:22,030][106225] Updated weights for policy 1, policy_version 465167 (0.0008) [2023-12-27 22:34:22,560][106226] Updated weights for policy 0, policy_version 463729 (0.0007) [2023-12-27 22:34:22,621][106226] Updated weights for policy 0, policy_version 463739 (0.0008) [2023-12-27 22:34:22,688][106226] Updated weights for policy 0, policy_version 463749 (0.0007) [2023-12-27 22:34:22,746][106225] Updated weights for policy 1, policy_version 465177 (0.0008) [2023-12-27 22:34:22,808][106225] Updated weights for policy 1, policy_version 465187 (0.0009) [2023-12-27 22:34:22,871][106225] Updated weights for policy 1, policy_version 465197 (0.0008) [2023-12-27 22:34:23,249][106226] Updated weights for policy 0, policy_version 463759 (0.0006) [2023-12-27 22:34:23,314][106226] Updated weights for policy 0, policy_version 463769 (0.0006) [2023-12-27 22:34:23,375][106226] Updated weights for policy 0, policy_version 463779 (0.0005) [2023-12-27 22:34:23,646][106225] Updated weights for policy 1, policy_version 465207 (0.0010) [2023-12-27 22:34:23,702][106225] Updated weights for policy 1, policy_version 465217 (0.0008) [2023-12-27 22:34:23,751][106225] Updated weights for policy 1, policy_version 465227 (0.0008) [2023-12-27 22:34:24,006][106226] Updated weights for policy 0, policy_version 463789 (0.0007) [2023-12-27 22:34:24,071][106226] Updated weights for policy 0, policy_version 463799 (0.0009) [2023-12-27 22:34:24,131][106226] Updated weights for policy 0, policy_version 463809 (0.0008) [2023-12-27 22:34:24,465][106225] Updated weights for policy 1, policy_version 465237 (0.0007) [2023-12-27 22:34:24,521][106225] Updated weights for policy 1, policy_version 465247 (0.0005) [2023-12-27 22:34:24,576][106225] Updated weights for policy 1, policy_version 465257 (0.0006) [2023-12-27 22:34:24,884][106226] Updated weights for policy 0, policy_version 463819 (0.0009) [2023-12-27 22:34:24,938][106226] Updated weights for policy 0, policy_version 463829 (0.0009) [2023-12-27 22:34:24,993][106226] Updated weights for policy 0, policy_version 463839 (0.0008) [2023-12-27 22:34:25,252][106225] Updated weights for policy 1, policy_version 465267 (0.0009) [2023-12-27 22:34:25,316][106225] Updated weights for policy 1, policy_version 465277 (0.0009) [2023-12-27 22:34:25,379][106225] Updated weights for policy 1, policy_version 465287 (0.0007) [2023-12-27 22:34:25,690][106226] Updated weights for policy 0, policy_version 463849 (0.0009) [2023-12-27 22:34:25,759][106226] Updated weights for policy 0, policy_version 463859 (0.0009) [2023-12-27 22:34:25,829][106226] Updated weights for policy 0, policy_version 463869 (0.0010) [2023-12-27 22:34:25,890][106226] Updated weights for policy 0, policy_version 463879 (0.0008) [2023-12-27 22:34:26,003][106225] Updated weights for policy 1, policy_version 465297 (0.0007) [2023-12-27 22:34:26,069][106225] Updated weights for policy 1, policy_version 465307 (0.0008) [2023-12-27 22:34:26,121][106225] Updated weights for policy 1, policy_version 465317 (0.0009) [2023-12-27 22:34:26,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 237928448. Throughput: 0: 9765.1, 1: 9690.9. Samples: 237900564. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:26,175][105115] Avg episode reward: [(0, '-4.981'), (1, '-5.619')] [2023-12-27 22:34:26,177][106225] Updated weights for policy 1, policy_version 465327 (0.0009) [2023-12-27 22:34:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000463880_118784000.pth... [2023-12-27 22:34:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000465328_119152640.pth... [2023-12-27 22:34:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000464176_118857728.pth [2023-12-27 22:34:26,201][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000462728_118489088.pth [2023-12-27 22:34:26,613][106226] Updated weights for policy 0, policy_version 463889 (0.0009) [2023-12-27 22:34:26,665][106226] Updated weights for policy 0, policy_version 463899 (0.0008) [2023-12-27 22:34:26,723][106226] Updated weights for policy 0, policy_version 463909 (0.0009) [2023-12-27 22:34:26,813][106225] Updated weights for policy 1, policy_version 465337 (0.0008) [2023-12-27 22:34:26,873][106225] Updated weights for policy 1, policy_version 465347 (0.0009) [2023-12-27 22:34:26,924][106225] Updated weights for policy 1, policy_version 465357 (0.0008) [2023-12-27 22:34:27,436][106226] Updated weights for policy 0, policy_version 463919 (0.0008) [2023-12-27 22:34:27,493][106226] Updated weights for policy 0, policy_version 463929 (0.0008) [2023-12-27 22:34:27,540][106226] Updated weights for policy 0, policy_version 463939 (0.0008) [2023-12-27 22:34:27,658][106225] Updated weights for policy 1, policy_version 465367 (0.0007) [2023-12-27 22:34:27,717][106225] Updated weights for policy 1, policy_version 465377 (0.0008) [2023-12-27 22:34:27,767][106225] Updated weights for policy 1, policy_version 465387 (0.0008) [2023-12-27 22:34:28,194][106226] Updated weights for policy 0, policy_version 463949 (0.0009) [2023-12-27 22:34:28,262][106226] Updated weights for policy 0, policy_version 463959 (0.0007) [2023-12-27 22:34:28,328][106226] Updated weights for policy 0, policy_version 463969 (0.0008) [2023-12-27 22:34:28,463][106225] Updated weights for policy 1, policy_version 465397 (0.0007) [2023-12-27 22:34:28,513][106225] Updated weights for policy 1, policy_version 465407 (0.0007) [2023-12-27 22:34:28,561][106225] Updated weights for policy 1, policy_version 465417 (0.0008) [2023-12-27 22:34:29,089][106226] Updated weights for policy 0, policy_version 463979 (0.0008) [2023-12-27 22:34:29,138][106226] Updated weights for policy 0, policy_version 463989 (0.0008) [2023-12-27 22:34:29,188][106226] Updated weights for policy 0, policy_version 463999 (0.0007) [2023-12-27 22:34:29,201][106225] Updated weights for policy 1, policy_version 465427 (0.0007) [2023-12-27 22:34:29,268][106225] Updated weights for policy 1, policy_version 465437 (0.0009) [2023-12-27 22:34:29,320][106225] Updated weights for policy 1, policy_version 465447 (0.0008) [2023-12-27 22:34:29,910][106226] Updated weights for policy 0, policy_version 464009 (0.0007) [2023-12-27 22:34:29,969][106226] Updated weights for policy 0, policy_version 464019 (0.0008) [2023-12-27 22:34:30,022][106226] Updated weights for policy 0, policy_version 464029 (0.0007) [2023-12-27 22:34:30,084][106226] Updated weights for policy 0, policy_version 464039 (0.0008) [2023-12-27 22:34:30,101][106225] Updated weights for policy 1, policy_version 465457 (0.0008) [2023-12-27 22:34:30,166][106225] Updated weights for policy 1, policy_version 465467 (0.0010) [2023-12-27 22:34:30,227][106225] Updated weights for policy 1, policy_version 465477 (0.0010) [2023-12-27 22:34:30,287][106225] Updated weights for policy 1, policy_version 465487 (0.0010) [2023-12-27 22:34:30,846][106225] Updated weights for policy 1, policy_version 465497 (0.0007) [2023-12-27 22:34:30,848][106226] Updated weights for policy 0, policy_version 464049 (0.0007) [2023-12-27 22:34:30,894][106226] Updated weights for policy 0, policy_version 464059 (0.0006) [2023-12-27 22:34:30,902][106225] Updated weights for policy 1, policy_version 465507 (0.0010) [2023-12-27 22:34:30,944][106226] Updated weights for policy 0, policy_version 464069 (0.0008) [2023-12-27 22:34:30,953][106225] Updated weights for policy 1, policy_version 465517 (0.0010) [2023-12-27 22:34:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 238034944. Throughput: 0: 9766.1, 1: 9742.7. Samples: 238019796. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-27 22:34:31,175][105115] Avg episode reward: [(0, '-5.083'), (1, '-5.500')] [2023-12-27 22:34:31,689][106225] Updated weights for policy 1, policy_version 465527 (0.0009) [2023-12-27 22:34:31,749][106226] Updated weights for policy 0, policy_version 464079 (0.0009) [2023-12-27 22:34:31,755][106225] Updated weights for policy 1, policy_version 465537 (0.0007) [2023-12-27 22:34:31,810][106226] Updated weights for policy 0, policy_version 464089 (0.0006) [2023-12-27 22:34:31,815][106225] Updated weights for policy 1, policy_version 465547 (0.0008) [2023-12-27 22:34:31,875][106226] Updated weights for policy 0, policy_version 464099 (0.0005) [2023-12-27 22:34:32,412][106226] Updated weights for policy 0, policy_version 464109 (0.0007) [2023-12-27 22:34:32,471][106226] Updated weights for policy 0, policy_version 464119 (0.0010) [2023-12-27 22:34:32,528][106226] Updated weights for policy 0, policy_version 464129 (0.0010) [2023-12-27 22:34:32,583][106225] Updated weights for policy 1, policy_version 465557 (0.0006) [2023-12-27 22:34:32,643][106225] Updated weights for policy 1, policy_version 465567 (0.0007) [2023-12-27 22:34:32,704][106225] Updated weights for policy 1, policy_version 465577 (0.0009) [2023-12-27 22:34:33,112][106226] Updated weights for policy 0, policy_version 464139 (0.0010) [2023-12-27 22:34:33,175][106226] Updated weights for policy 0, policy_version 464149 (0.0008) [2023-12-27 22:34:33,223][106226] Updated weights for policy 0, policy_version 464159 (0.0008) [2023-12-27 22:34:33,416][106225] Updated weights for policy 1, policy_version 465587 (0.0009) [2023-12-27 22:34:33,473][106225] Updated weights for policy 1, policy_version 465597 (0.0009) [2023-12-27 22:34:33,527][106225] Updated weights for policy 1, policy_version 465607 (0.0008) [2023-12-27 22:34:33,905][106226] Updated weights for policy 0, policy_version 464169 (0.0008) [2023-12-27 22:34:33,964][106226] Updated weights for policy 0, policy_version 464179 (0.0006) [2023-12-27 22:34:34,025][106226] Updated weights for policy 0, policy_version 464189 (0.0009) [2023-12-27 22:34:34,085][106226] Updated weights for policy 0, policy_version 464199 (0.0008) [2023-12-27 22:34:34,222][106225] Updated weights for policy 1, policy_version 465617 (0.0009) [2023-12-27 22:34:34,293][106225] Updated weights for policy 1, policy_version 465627 (0.0005) [2023-12-27 22:34:34,363][106225] Updated weights for policy 1, policy_version 465637 (0.0008) [2023-12-27 22:34:34,430][106225] Updated weights for policy 1, policy_version 465647 (0.0009) [2023-12-27 22:34:34,719][106226] Updated weights for policy 0, policy_version 464209 (0.0008) [2023-12-27 22:34:34,777][106226] Updated weights for policy 0, policy_version 464219 (0.0008) [2023-12-27 22:34:34,837][106226] Updated weights for policy 0, policy_version 464229 (0.0006) [2023-12-27 22:34:35,102][106225] Updated weights for policy 1, policy_version 465657 (0.0008) [2023-12-27 22:34:35,164][106225] Updated weights for policy 1, policy_version 465667 (0.0008) [2023-12-27 22:34:35,220][106225] Updated weights for policy 1, policy_version 465677 (0.0009) [2023-12-27 22:34:35,493][106226] Updated weights for policy 0, policy_version 464239 (0.0008) [2023-12-27 22:34:35,559][106226] Updated weights for policy 0, policy_version 464249 (0.0009) [2023-12-27 22:34:35,623][106226] Updated weights for policy 0, policy_version 464259 (0.0010) [2023-12-27 22:34:35,870][106225] Updated weights for policy 1, policy_version 465687 (0.0007) [2023-12-27 22:34:35,921][106225] Updated weights for policy 1, policy_version 465697 (0.0006) [2023-12-27 22:34:35,983][106225] Updated weights for policy 1, policy_version 465707 (0.0005) [2023-12-27 22:34:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 238133248. Throughput: 0: 9862.7, 1: 9803.4. Samples: 238141340. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:34:36,175][105115] Avg episode reward: [(0, '-5.117'), (1, '-5.552')] [2023-12-27 22:34:36,369][106226] Updated weights for policy 0, policy_version 464269 (0.0010) [2023-12-27 22:34:36,431][106226] Updated weights for policy 0, policy_version 464279 (0.0011) [2023-12-27 22:34:36,488][106226] Updated weights for policy 0, policy_version 464289 (0.0012) [2023-12-27 22:34:36,671][106225] Updated weights for policy 1, policy_version 465717 (0.0008) [2023-12-27 22:34:36,722][106225] Updated weights for policy 1, policy_version 465727 (0.0008) [2023-12-27 22:34:36,779][106225] Updated weights for policy 1, policy_version 465737 (0.0009) [2023-12-27 22:34:37,169][106226] Updated weights for policy 0, policy_version 464299 (0.0009) [2023-12-27 22:34:37,232][106226] Updated weights for policy 0, policy_version 464309 (0.0010) [2023-12-27 22:34:37,281][106226] Updated weights for policy 0, policy_version 464319 (0.0008) [2023-12-27 22:34:37,474][106225] Updated weights for policy 1, policy_version 465747 (0.0009) [2023-12-27 22:34:37,541][106225] Updated weights for policy 1, policy_version 465757 (0.0009) [2023-12-27 22:34:37,604][106225] Updated weights for policy 1, policy_version 465767 (0.0009) [2023-12-27 22:34:38,000][106226] Updated weights for policy 0, policy_version 464329 (0.0010) [2023-12-27 22:34:38,063][106226] Updated weights for policy 0, policy_version 464339 (0.0008) [2023-12-27 22:34:38,121][106226] Updated weights for policy 0, policy_version 464349 (0.0008) [2023-12-27 22:34:38,184][106226] Updated weights for policy 0, policy_version 464359 (0.0008) [2023-12-27 22:34:38,301][106225] Updated weights for policy 1, policy_version 465777 (0.0008) [2023-12-27 22:34:38,370][106225] Updated weights for policy 1, policy_version 465787 (0.0008) [2023-12-27 22:34:38,424][106225] Updated weights for policy 1, policy_version 465797 (0.0007) [2023-12-27 22:34:38,484][106225] Updated weights for policy 1, policy_version 465807 (0.0008) [2023-12-27 22:34:38,953][106226] Updated weights for policy 0, policy_version 464369 (0.0008) [2023-12-27 22:34:39,020][106226] Updated weights for policy 0, policy_version 464379 (0.0008) [2023-12-27 22:34:39,085][106226] Updated weights for policy 0, policy_version 464389 (0.0007) [2023-12-27 22:34:39,137][106225] Updated weights for policy 1, policy_version 465817 (0.0009) [2023-12-27 22:34:39,203][106225] Updated weights for policy 1, policy_version 465827 (0.0010) [2023-12-27 22:34:39,272][106225] Updated weights for policy 1, policy_version 465837 (0.0008) [2023-12-27 22:34:39,847][106226] Updated weights for policy 0, policy_version 464399 (0.0007) [2023-12-27 22:34:39,919][106226] Updated weights for policy 0, policy_version 464409 (0.0009) [2023-12-27 22:34:39,990][106226] Updated weights for policy 0, policy_version 464419 (0.0009) [2023-12-27 22:34:40,045][106225] Updated weights for policy 1, policy_version 465847 (0.0006) [2023-12-27 22:34:40,099][106225] Updated weights for policy 1, policy_version 465857 (0.0006) [2023-12-27 22:34:40,167][106225] Updated weights for policy 1, policy_version 465867 (0.0005) [2023-12-27 22:34:40,726][106226] Updated weights for policy 0, policy_version 464429 (0.0008) [2023-12-27 22:34:40,791][106226] Updated weights for policy 0, policy_version 464439 (0.0006) [2023-12-27 22:34:40,818][106225] Updated weights for policy 1, policy_version 465877 (0.0007) [2023-12-27 22:34:40,848][106226] Updated weights for policy 0, policy_version 464449 (0.0006) [2023-12-27 22:34:40,866][106225] Updated weights for policy 1, policy_version 465887 (0.0006) [2023-12-27 22:34:40,924][106225] Updated weights for policy 1, policy_version 465897 (0.0008) [2023-12-27 22:34:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 238231552. Throughput: 0: 9840.9, 1: 9808.3. Samples: 238199532. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:34:41,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-5.677')] [2023-12-27 22:34:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000465904_119300096.pth... [2023-12-27 22:34:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000464456_118931456.pth... [2023-12-27 22:34:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000464752_119005184.pth [2023-12-27 22:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000463304_118636544.pth [2023-12-27 22:34:41,589][106226] Updated weights for policy 0, policy_version 464459 (0.0007) [2023-12-27 22:34:41,659][106226] Updated weights for policy 0, policy_version 464469 (0.0008) [2023-12-27 22:34:41,731][106226] Updated weights for policy 0, policy_version 464479 (0.0009) [2023-12-27 22:34:41,764][106225] Updated weights for policy 1, policy_version 465907 (0.0008) [2023-12-27 22:34:41,822][106225] Updated weights for policy 1, policy_version 465917 (0.0007) [2023-12-27 22:34:41,882][106225] Updated weights for policy 1, policy_version 465927 (0.0008) [2023-12-27 22:34:42,437][106226] Updated weights for policy 0, policy_version 464489 (0.0011) [2023-12-27 22:34:42,501][106226] Updated weights for policy 0, policy_version 464499 (0.0008) [2023-12-27 22:34:42,558][106226] Updated weights for policy 0, policy_version 464509 (0.0008) [2023-12-27 22:34:42,606][106226] Updated weights for policy 0, policy_version 464519 (0.0008) [2023-12-27 22:34:42,617][106225] Updated weights for policy 1, policy_version 465937 (0.0008) [2023-12-27 22:34:42,678][106225] Updated weights for policy 1, policy_version 465947 (0.0009) [2023-12-27 22:34:42,723][106225] Updated weights for policy 1, policy_version 465957 (0.0008) [2023-12-27 22:34:42,768][106225] Updated weights for policy 1, policy_version 465967 (0.0008) [2023-12-27 22:34:43,340][106226] Updated weights for policy 0, policy_version 464529 (0.0008) [2023-12-27 22:34:43,408][106226] Updated weights for policy 0, policy_version 464539 (0.0008) [2023-12-27 22:34:43,465][106226] Updated weights for policy 0, policy_version 464549 (0.0008) [2023-12-27 22:34:43,511][106225] Updated weights for policy 1, policy_version 465977 (0.0008) [2023-12-27 22:34:43,576][106225] Updated weights for policy 1, policy_version 465987 (0.0008) [2023-12-27 22:34:43,635][106225] Updated weights for policy 1, policy_version 465997 (0.0009) [2023-12-27 22:34:44,173][106226] Updated weights for policy 0, policy_version 464559 (0.0007) [2023-12-27 22:34:44,230][106226] Updated weights for policy 0, policy_version 464569 (0.0007) [2023-12-27 22:34:44,285][106226] Updated weights for policy 0, policy_version 464579 (0.0007) [2023-12-27 22:34:44,346][106225] Updated weights for policy 1, policy_version 466007 (0.0010) [2023-12-27 22:34:44,406][106225] Updated weights for policy 1, policy_version 466017 (0.0010) [2023-12-27 22:34:44,466][106225] Updated weights for policy 1, policy_version 466027 (0.0010) [2023-12-27 22:34:45,034][106226] Updated weights for policy 0, policy_version 464589 (0.0007) [2023-12-27 22:34:45,098][106226] Updated weights for policy 0, policy_version 464599 (0.0005) [2023-12-27 22:34:45,165][106226] Updated weights for policy 0, policy_version 464609 (0.0006) [2023-12-27 22:34:45,197][106225] Updated weights for policy 1, policy_version 466037 (0.0011) [2023-12-27 22:34:45,262][106225] Updated weights for policy 1, policy_version 466047 (0.0011) [2023-12-27 22:34:45,328][106225] Updated weights for policy 1, policy_version 466057 (0.0011) [2023-12-27 22:34:45,739][106226] Updated weights for policy 0, policy_version 464619 (0.0007) [2023-12-27 22:34:45,794][106226] Updated weights for policy 0, policy_version 464629 (0.0008) [2023-12-27 22:34:45,852][106226] Updated weights for policy 0, policy_version 464639 (0.0008) [2023-12-27 22:34:45,996][106225] Updated weights for policy 1, policy_version 466067 (0.0009) [2023-12-27 22:34:46,060][106225] Updated weights for policy 1, policy_version 466077 (0.0005) [2023-12-27 22:34:46,109][106225] Updated weights for policy 1, policy_version 466087 (0.0005) [2023-12-27 22:34:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 238329856. Throughput: 0: 9795.1, 1: 9819.2. Samples: 238313720. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:34:46,175][105115] Avg episode reward: [(0, '-5.047'), (1, '-5.378')] [2023-12-27 22:34:46,650][106225] Updated weights for policy 1, policy_version 466097 (0.0005) [2023-12-27 22:34:46,657][106226] Updated weights for policy 0, policy_version 464649 (0.0009) [2023-12-27 22:34:46,701][106225] Updated weights for policy 1, policy_version 466107 (0.0005) [2023-12-27 22:34:46,710][106226] Updated weights for policy 0, policy_version 464659 (0.0007) [2023-12-27 22:34:46,765][106225] Updated weights for policy 1, policy_version 466117 (0.0006) [2023-12-27 22:34:46,766][106226] Updated weights for policy 0, policy_version 464669 (0.0009) [2023-12-27 22:34:46,816][106225] Updated weights for policy 1, policy_version 466127 (0.0008) [2023-12-27 22:34:46,823][106226] Updated weights for policy 0, policy_version 464679 (0.0010) [2023-12-27 22:34:47,501][106225] Updated weights for policy 1, policy_version 466137 (0.0007) [2023-12-27 22:34:47,542][106226] Updated weights for policy 0, policy_version 464689 (0.0008) [2023-12-27 22:34:47,566][106225] Updated weights for policy 1, policy_version 466147 (0.0007) [2023-12-27 22:34:47,598][106226] Updated weights for policy 0, policy_version 464699 (0.0005) [2023-12-27 22:34:47,613][106225] Updated weights for policy 1, policy_version 466157 (0.0005) [2023-12-27 22:34:47,659][106226] Updated weights for policy 0, policy_version 464709 (0.0005) [2023-12-27 22:34:48,212][106225] Updated weights for policy 1, policy_version 466167 (0.0005) [2023-12-27 22:34:48,257][106225] Updated weights for policy 1, policy_version 466177 (0.0007) [2023-12-27 22:34:48,302][106225] Updated weights for policy 1, policy_version 466187 (0.0007) [2023-12-27 22:34:48,315][106226] Updated weights for policy 0, policy_version 464719 (0.0010) [2023-12-27 22:34:48,381][106226] Updated weights for policy 0, policy_version 464729 (0.0009) [2023-12-27 22:34:48,454][106226] Updated weights for policy 0, policy_version 464739 (0.0011) [2023-12-27 22:34:48,989][106225] Updated weights for policy 1, policy_version 466197 (0.0007) [2023-12-27 22:34:49,056][106225] Updated weights for policy 1, policy_version 466207 (0.0008) [2023-12-27 22:34:49,120][106225] Updated weights for policy 1, policy_version 466217 (0.0008) [2023-12-27 22:34:49,163][106226] Updated weights for policy 0, policy_version 464749 (0.0009) [2023-12-27 22:34:49,217][106226] Updated weights for policy 0, policy_version 464759 (0.0007) [2023-12-27 22:34:49,291][106226] Updated weights for policy 0, policy_version 464769 (0.0009) [2023-12-27 22:34:49,838][106225] Updated weights for policy 1, policy_version 466227 (0.0008) [2023-12-27 22:34:49,901][106225] Updated weights for policy 1, policy_version 466237 (0.0007) [2023-12-27 22:34:49,968][106225] Updated weights for policy 1, policy_version 466247 (0.0008) [2023-12-27 22:34:49,998][106226] Updated weights for policy 0, policy_version 464779 (0.0008) [2023-12-27 22:34:50,064][106226] Updated weights for policy 0, policy_version 464789 (0.0005) [2023-12-27 22:34:50,128][106226] Updated weights for policy 0, policy_version 464799 (0.0005) [2023-12-27 22:34:50,715][106225] Updated weights for policy 1, policy_version 466257 (0.0008) [2023-12-27 22:34:50,739][106226] Updated weights for policy 0, policy_version 464809 (0.0006) [2023-12-27 22:34:50,780][106225] Updated weights for policy 1, policy_version 466267 (0.0006) [2023-12-27 22:34:50,804][106226] Updated weights for policy 0, policy_version 464819 (0.0011) [2023-12-27 22:34:50,845][106225] Updated weights for policy 1, policy_version 466277 (0.0006) [2023-12-27 22:34:50,868][106226] Updated weights for policy 0, policy_version 464829 (0.0011) [2023-12-27 22:34:50,908][106225] Updated weights for policy 1, policy_version 466287 (0.0007) [2023-12-27 22:34:50,936][106226] Updated weights for policy 0, policy_version 464839 (0.0011) [2023-12-27 22:34:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 238428160. Throughput: 0: 9833.3, 1: 9766.7. Samples: 238434360. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:34:51,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-5.597')] [2023-12-27 22:34:51,578][106225] Updated weights for policy 1, policy_version 466297 (0.0006) [2023-12-27 22:34:51,648][106225] Updated weights for policy 1, policy_version 466307 (0.0008) [2023-12-27 22:34:51,712][106225] Updated weights for policy 1, policy_version 466317 (0.0007) [2023-12-27 22:34:51,818][106226] Updated weights for policy 0, policy_version 464849 (0.0008) [2023-12-27 22:34:51,878][106226] Updated weights for policy 0, policy_version 464859 (0.0007) [2023-12-27 22:34:51,944][106226] Updated weights for policy 0, policy_version 464869 (0.0007) [2023-12-27 22:34:52,356][106225] Updated weights for policy 1, policy_version 466327 (0.0008) [2023-12-27 22:34:52,420][106225] Updated weights for policy 1, policy_version 466337 (0.0006) [2023-12-27 22:34:52,479][106225] Updated weights for policy 1, policy_version 466347 (0.0005) [2023-12-27 22:34:52,695][106226] Updated weights for policy 0, policy_version 464879 (0.0006) [2023-12-27 22:34:52,765][106226] Updated weights for policy 0, policy_version 464889 (0.0006) [2023-12-27 22:34:52,825][106226] Updated weights for policy 0, policy_version 464899 (0.0009) [2023-12-27 22:34:53,187][106225] Updated weights for policy 1, policy_version 466357 (0.0007) [2023-12-27 22:34:53,243][106225] Updated weights for policy 1, policy_version 466367 (0.0008) [2023-12-27 22:34:53,295][106225] Updated weights for policy 1, policy_version 466377 (0.0009) [2023-12-27 22:34:53,422][106226] Updated weights for policy 0, policy_version 464909 (0.0009) [2023-12-27 22:34:53,471][106226] Updated weights for policy 0, policy_version 464919 (0.0009) [2023-12-27 22:34:53,532][106226] Updated weights for policy 0, policy_version 464929 (0.0008) [2023-12-27 22:34:54,045][106225] Updated weights for policy 1, policy_version 466387 (0.0008) [2023-12-27 22:34:54,101][106225] Updated weights for policy 1, policy_version 466397 (0.0008) [2023-12-27 22:34:54,164][106225] Updated weights for policy 1, policy_version 466407 (0.0008) [2023-12-27 22:34:54,190][106226] Updated weights for policy 0, policy_version 464939 (0.0009) [2023-12-27 22:34:54,247][106226] Updated weights for policy 0, policy_version 464949 (0.0007) [2023-12-27 22:34:54,298][106226] Updated weights for policy 0, policy_version 464959 (0.0008) [2023-12-27 22:34:54,889][106225] Updated weights for policy 1, policy_version 466417 (0.0007) [2023-12-27 22:34:54,949][106225] Updated weights for policy 1, policy_version 466427 (0.0009) [2023-12-27 22:34:55,016][106225] Updated weights for policy 1, policy_version 466437 (0.0007) [2023-12-27 22:34:55,034][106226] Updated weights for policy 0, policy_version 464969 (0.0009) [2023-12-27 22:34:55,078][106225] Updated weights for policy 1, policy_version 466447 (0.0007) [2023-12-27 22:34:55,084][106226] Updated weights for policy 0, policy_version 464979 (0.0007) [2023-12-27 22:34:55,133][106226] Updated weights for policy 0, policy_version 464989 (0.0009) [2023-12-27 22:34:55,189][106226] Updated weights for policy 0, policy_version 464999 (0.0008) [2023-12-27 22:34:55,774][106225] Updated weights for policy 1, policy_version 466457 (0.0009) [2023-12-27 22:34:55,819][106225] Updated weights for policy 1, policy_version 466467 (0.0008) [2023-12-27 22:34:55,877][106225] Updated weights for policy 1, policy_version 466477 (0.0009) [2023-12-27 22:34:55,920][106226] Updated weights for policy 0, policy_version 465009 (0.0008) [2023-12-27 22:34:55,979][106226] Updated weights for policy 0, policy_version 465019 (0.0008) [2023-12-27 22:34:56,041][106226] Updated weights for policy 0, policy_version 465029 (0.0008) [2023-12-27 22:34:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 238526464. Throughput: 0: 9839.0, 1: 9778.5. Samples: 238493416. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:34:56,176][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.541')] [2023-12-27 22:34:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000465032_119078912.pth... [2023-12-27 22:34:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000466480_119447552.pth... [2023-12-27 22:34:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000463880_118784000.pth [2023-12-27 22:34:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000465328_119152640.pth [2023-12-27 22:34:56,646][106226] Updated weights for policy 0, policy_version 465039 (0.0008) [2023-12-27 22:34:56,672][106225] Updated weights for policy 1, policy_version 466487 (0.0007) [2023-12-27 22:34:56,697][106226] Updated weights for policy 0, policy_version 465049 (0.0007) [2023-12-27 22:34:56,718][106225] Updated weights for policy 1, policy_version 466497 (0.0006) [2023-12-27 22:34:56,750][106226] Updated weights for policy 0, policy_version 465059 (0.0007) [2023-12-27 22:34:56,777][106225] Updated weights for policy 1, policy_version 466507 (0.0006) [2023-12-27 22:34:57,396][106226] Updated weights for policy 0, policy_version 465069 (0.0007) [2023-12-27 22:34:57,444][106226] Updated weights for policy 0, policy_version 465079 (0.0005) [2023-12-27 22:34:57,493][106226] Updated weights for policy 0, policy_version 465089 (0.0006) [2023-12-27 22:34:57,560][106225] Updated weights for policy 1, policy_version 466517 (0.0007) [2023-12-27 22:34:57,608][106225] Updated weights for policy 1, policy_version 466527 (0.0005) [2023-12-27 22:34:57,656][106225] Updated weights for policy 1, policy_version 466537 (0.0005) [2023-12-27 22:34:58,185][106225] Updated weights for policy 1, policy_version 466547 (0.0005) [2023-12-27 22:34:58,252][106225] Updated weights for policy 1, policy_version 466557 (0.0008) [2023-12-27 22:34:58,294][106226] Updated weights for policy 0, policy_version 465099 (0.0009) [2023-12-27 22:34:58,315][106225] Updated weights for policy 1, policy_version 466567 (0.0007) [2023-12-27 22:34:58,348][106226] Updated weights for policy 0, policy_version 465109 (0.0008) [2023-12-27 22:34:58,420][106226] Updated weights for policy 0, policy_version 465119 (0.0008) [2023-12-27 22:34:59,140][106225] Updated weights for policy 1, policy_version 466577 (0.0008) [2023-12-27 22:34:59,193][106225] Updated weights for policy 1, policy_version 466587 (0.0009) [2023-12-27 22:34:59,260][106225] Updated weights for policy 1, policy_version 466597 (0.0008) [2023-12-27 22:34:59,298][106226] Updated weights for policy 0, policy_version 465129 (0.0009) [2023-12-27 22:34:59,320][106225] Updated weights for policy 1, policy_version 466607 (0.0008) [2023-12-27 22:34:59,367][106226] Updated weights for policy 0, policy_version 465139 (0.0011) [2023-12-27 22:34:59,434][106226] Updated weights for policy 0, policy_version 465149 (0.0011) [2023-12-27 22:34:59,503][106226] Updated weights for policy 0, policy_version 465159 (0.0009) [2023-12-27 22:35:00,116][106225] Updated weights for policy 1, policy_version 466617 (0.0008) [2023-12-27 22:35:00,134][106226] Updated weights for policy 0, policy_version 465169 (0.0010) [2023-12-27 22:35:00,175][106225] Updated weights for policy 1, policy_version 466627 (0.0006) [2023-12-27 22:35:00,188][106226] Updated weights for policy 0, policy_version 465179 (0.0010) [2023-12-27 22:35:00,237][106225] Updated weights for policy 1, policy_version 466637 (0.0005) [2023-12-27 22:35:00,239][106226] Updated weights for policy 0, policy_version 465189 (0.0010) [2023-12-27 22:35:00,838][106226] Updated weights for policy 0, policy_version 465199 (0.0007) [2023-12-27 22:35:00,888][106226] Updated weights for policy 0, policy_version 465209 (0.0006) [2023-12-27 22:35:00,947][106226] Updated weights for policy 0, policy_version 465219 (0.0006) [2023-12-27 22:35:01,003][106225] Updated weights for policy 1, policy_version 466647 (0.0007) [2023-12-27 22:35:01,067][106225] Updated weights for policy 1, policy_version 466657 (0.0009) [2023-12-27 22:35:01,129][106225] Updated weights for policy 1, policy_version 466667 (0.0008) [2023-12-27 22:35:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 238624768. Throughput: 0: 9798.8, 1: 9821.6. Samples: 238608124. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:01,175][105115] Avg episode reward: [(0, '-5.109'), (1, '-5.512')] [2023-12-27 22:35:01,578][106226] Updated weights for policy 0, policy_version 465229 (0.0006) [2023-12-27 22:35:01,653][106226] Updated weights for policy 0, policy_version 465239 (0.0007) [2023-12-27 22:35:01,716][106226] Updated weights for policy 0, policy_version 465249 (0.0008) [2023-12-27 22:35:01,862][106225] Updated weights for policy 1, policy_version 466677 (0.0009) [2023-12-27 22:35:01,907][106225] Updated weights for policy 1, policy_version 466687 (0.0008) [2023-12-27 22:35:01,961][106225] Updated weights for policy 1, policy_version 466697 (0.0008) [2023-12-27 22:35:02,334][106226] Updated weights for policy 0, policy_version 465259 (0.0008) [2023-12-27 22:35:02,407][106226] Updated weights for policy 0, policy_version 465269 (0.0009) [2023-12-27 22:35:02,470][106226] Updated weights for policy 0, policy_version 465279 (0.0008) [2023-12-27 22:35:02,798][106225] Updated weights for policy 1, policy_version 466707 (0.0010) [2023-12-27 22:35:02,853][106225] Updated weights for policy 1, policy_version 466717 (0.0006) [2023-12-27 22:35:02,903][106225] Updated weights for policy 1, policy_version 466727 (0.0009) [2023-12-27 22:35:03,061][106226] Updated weights for policy 0, policy_version 465289 (0.0008) [2023-12-27 22:35:03,119][106226] Updated weights for policy 0, policy_version 465299 (0.0007) [2023-12-27 22:35:03,176][106226] Updated weights for policy 0, policy_version 465309 (0.0005) [2023-12-27 22:35:03,234][106226] Updated weights for policy 0, policy_version 465319 (0.0009) [2023-12-27 22:35:03,593][106225] Updated weights for policy 1, policy_version 466737 (0.0007) [2023-12-27 22:35:03,637][106225] Updated weights for policy 1, policy_version 466747 (0.0005) [2023-12-27 22:35:03,683][106225] Updated weights for policy 1, policy_version 466757 (0.0005) [2023-12-27 22:35:03,727][106225] Updated weights for policy 1, policy_version 466767 (0.0005) [2023-12-27 22:35:03,834][106226] Updated weights for policy 0, policy_version 465329 (0.0006) [2023-12-27 22:35:03,893][106226] Updated weights for policy 0, policy_version 465339 (0.0007) [2023-12-27 22:35:03,962][106226] Updated weights for policy 0, policy_version 465349 (0.0010) [2023-12-27 22:35:04,367][106225] Updated weights for policy 1, policy_version 466777 (0.0008) [2023-12-27 22:35:04,422][106225] Updated weights for policy 1, policy_version 466787 (0.0008) [2023-12-27 22:35:04,475][106225] Updated weights for policy 1, policy_version 466797 (0.0007) [2023-12-27 22:35:04,634][106226] Updated weights for policy 0, policy_version 465359 (0.0011) [2023-12-27 22:35:04,693][106226] Updated weights for policy 0, policy_version 465369 (0.0010) [2023-12-27 22:35:04,753][106226] Updated weights for policy 0, policy_version 465379 (0.0011) [2023-12-27 22:35:05,214][106225] Updated weights for policy 1, policy_version 466807 (0.0006) [2023-12-27 22:35:05,270][106225] Updated weights for policy 1, policy_version 466817 (0.0006) [2023-12-27 22:35:05,322][106225] Updated weights for policy 1, policy_version 466827 (0.0005) [2023-12-27 22:35:05,463][106226] Updated weights for policy 0, policy_version 465389 (0.0011) [2023-12-27 22:35:05,513][106226] Updated weights for policy 0, policy_version 465399 (0.0010) [2023-12-27 22:35:05,572][106226] Updated weights for policy 0, policy_version 465409 (0.0010) [2023-12-27 22:35:05,914][106225] Updated weights for policy 1, policy_version 466837 (0.0007) [2023-12-27 22:35:05,962][106225] Updated weights for policy 1, policy_version 466847 (0.0008) [2023-12-27 22:35:06,016][106225] Updated weights for policy 1, policy_version 466857 (0.0008) [2023-12-27 22:35:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19744.2). Total num frames: 238723072. Throughput: 0: 9937.4, 1: 9837.1. Samples: 238730840. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:06,175][105115] Avg episode reward: [(0, '-5.051'), (1, '-5.919')] [2023-12-27 22:35:06,205][106226] Updated weights for policy 0, policy_version 465419 (0.0011) [2023-12-27 22:35:06,270][106226] Updated weights for policy 0, policy_version 465429 (0.0011) [2023-12-27 22:35:06,325][106226] Updated weights for policy 0, policy_version 465439 (0.0010) [2023-12-27 22:35:06,808][106225] Updated weights for policy 1, policy_version 466867 (0.0009) [2023-12-27 22:35:06,885][106225] Updated weights for policy 1, policy_version 466877 (0.0008) [2023-12-27 22:35:06,944][106225] Updated weights for policy 1, policy_version 466887 (0.0006) [2023-12-27 22:35:07,037][106226] Updated weights for policy 0, policy_version 465449 (0.0011) [2023-12-27 22:35:07,086][106226] Updated weights for policy 0, policy_version 465459 (0.0008) [2023-12-27 22:35:07,140][106226] Updated weights for policy 0, policy_version 465469 (0.0008) [2023-12-27 22:35:07,196][106226] Updated weights for policy 0, policy_version 465479 (0.0010) [2023-12-27 22:35:07,595][106225] Updated weights for policy 1, policy_version 466897 (0.0008) [2023-12-27 22:35:07,668][106225] Updated weights for policy 1, policy_version 466907 (0.0009) [2023-12-27 22:35:07,737][106225] Updated weights for policy 1, policy_version 466917 (0.0007) [2023-12-27 22:35:07,795][106225] Updated weights for policy 1, policy_version 466927 (0.0007) [2023-12-27 22:35:07,903][106226] Updated weights for policy 0, policy_version 465489 (0.0006) [2023-12-27 22:35:07,956][106226] Updated weights for policy 0, policy_version 465499 (0.0006) [2023-12-27 22:35:08,025][106226] Updated weights for policy 0, policy_version 465509 (0.0006) [2023-12-27 22:35:08,585][106225] Updated weights for policy 1, policy_version 466937 (0.0008) [2023-12-27 22:35:08,657][106225] Updated weights for policy 1, policy_version 466947 (0.0008) [2023-12-27 22:35:08,662][106226] Updated weights for policy 0, policy_version 465519 (0.0006) [2023-12-27 22:35:08,715][106225] Updated weights for policy 1, policy_version 466957 (0.0009) [2023-12-27 22:35:08,729][106226] Updated weights for policy 0, policy_version 465529 (0.0006) [2023-12-27 22:35:08,790][106226] Updated weights for policy 0, policy_version 465539 (0.0008) [2023-12-27 22:35:09,471][106225] Updated weights for policy 1, policy_version 466967 (0.0009) [2023-12-27 22:35:09,477][106226] Updated weights for policy 0, policy_version 465549 (0.0008) [2023-12-27 22:35:09,520][106225] Updated weights for policy 1, policy_version 466977 (0.0007) [2023-12-27 22:35:09,539][106226] Updated weights for policy 0, policy_version 465559 (0.0007) [2023-12-27 22:35:09,573][106225] Updated weights for policy 1, policy_version 466987 (0.0006) [2023-12-27 22:35:09,601][106226] Updated weights for policy 0, policy_version 465569 (0.0009) [2023-12-27 22:35:10,297][106226] Updated weights for policy 0, policy_version 465579 (0.0008) [2023-12-27 22:35:10,358][106226] Updated weights for policy 0, policy_version 465589 (0.0006) [2023-12-27 22:35:10,417][106226] Updated weights for policy 0, policy_version 465599 (0.0007) [2023-12-27 22:35:10,439][106225] Updated weights for policy 1, policy_version 466997 (0.0007) [2023-12-27 22:35:10,502][106225] Updated weights for policy 1, policy_version 467007 (0.0008) [2023-12-27 22:35:10,562][106225] Updated weights for policy 1, policy_version 467017 (0.0010) [2023-12-27 22:35:11,103][106226] Updated weights for policy 0, policy_version 465609 (0.0007) [2023-12-27 22:35:11,173][106226] Updated weights for policy 0, policy_version 465619 (0.0010) [2023-12-27 22:35:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 238813184. Throughput: 0: 9911.7, 1: 9825.8. Samples: 238788752. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:11,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.412')] [2023-12-27 22:35:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000467024_119586816.pth... [2023-12-27 22:35:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000465904_119300096.pth [2023-12-27 22:35:11,235][106226] Updated weights for policy 0, policy_version 465629 (0.0009) [2023-12-27 22:35:11,301][106226] Updated weights for policy 0, policy_version 465639 (0.0009) [2023-12-27 22:35:11,305][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000465640_119234560.pth... [2023-12-27 22:35:11,309][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000464456_118931456.pth [2023-12-27 22:35:11,327][106225] Updated weights for policy 1, policy_version 467027 (0.0010) [2023-12-27 22:35:11,399][106225] Updated weights for policy 1, policy_version 467037 (0.0008) [2023-12-27 22:35:11,466][106225] Updated weights for policy 1, policy_version 467047 (0.0008) [2023-12-27 22:35:12,034][106226] Updated weights for policy 0, policy_version 465649 (0.0009) [2023-12-27 22:35:12,092][106226] Updated weights for policy 0, policy_version 465659 (0.0008) [2023-12-27 22:35:12,148][106226] Updated weights for policy 0, policy_version 465669 (0.0008) [2023-12-27 22:35:12,192][106225] Updated weights for policy 1, policy_version 467057 (0.0009) [2023-12-27 22:35:12,258][106225] Updated weights for policy 1, policy_version 467067 (0.0009) [2023-12-27 22:35:12,327][106225] Updated weights for policy 1, policy_version 467077 (0.0007) [2023-12-27 22:35:12,399][106225] Updated weights for policy 1, policy_version 467087 (0.0008) [2023-12-27 22:35:12,919][106226] Updated weights for policy 0, policy_version 465679 (0.0009) [2023-12-27 22:35:12,975][106226] Updated weights for policy 0, policy_version 465689 (0.0005) [2023-12-27 22:35:13,032][106226] Updated weights for policy 0, policy_version 465699 (0.0005) [2023-12-27 22:35:13,107][106225] Updated weights for policy 1, policy_version 467097 (0.0009) [2023-12-27 22:35:13,160][106225] Updated weights for policy 1, policy_version 467107 (0.0008) [2023-12-27 22:35:13,220][106225] Updated weights for policy 1, policy_version 467117 (0.0008) [2023-12-27 22:35:13,696][106226] Updated weights for policy 0, policy_version 465709 (0.0007) [2023-12-27 22:35:13,752][106226] Updated weights for policy 0, policy_version 465719 (0.0008) [2023-12-27 22:35:13,808][106226] Updated weights for policy 0, policy_version 465729 (0.0008) [2023-12-27 22:35:13,922][106225] Updated weights for policy 1, policy_version 467127 (0.0008) [2023-12-27 22:35:13,972][106225] Updated weights for policy 1, policy_version 467137 (0.0009) [2023-12-27 22:35:14,017][106225] Updated weights for policy 1, policy_version 467147 (0.0008) [2023-12-27 22:35:14,478][106226] Updated weights for policy 0, policy_version 465739 (0.0009) [2023-12-27 22:35:14,531][106226] Updated weights for policy 0, policy_version 465749 (0.0007) [2023-12-27 22:35:14,584][106226] Updated weights for policy 0, policy_version 465759 (0.0010) [2023-12-27 22:35:14,748][106225] Updated weights for policy 1, policy_version 467157 (0.0007) [2023-12-27 22:35:14,817][106225] Updated weights for policy 1, policy_version 467167 (0.0008) [2023-12-27 22:35:14,871][106225] Updated weights for policy 1, policy_version 467177 (0.0009) [2023-12-27 22:35:15,323][106226] Updated weights for policy 0, policy_version 465769 (0.0009) [2023-12-27 22:35:15,391][106226] Updated weights for policy 0, policy_version 465779 (0.0008) [2023-12-27 22:35:15,461][106226] Updated weights for policy 0, policy_version 465789 (0.0009) [2023-12-27 22:35:15,532][106226] Updated weights for policy 0, policy_version 465799 (0.0008) [2023-12-27 22:35:15,683][106225] Updated weights for policy 1, policy_version 467187 (0.0009) [2023-12-27 22:35:15,743][106225] Updated weights for policy 1, policy_version 467197 (0.0008) [2023-12-27 22:35:15,800][106225] Updated weights for policy 1, policy_version 467207 (0.0006) [2023-12-27 22:35:16,126][106226] Updated weights for policy 0, policy_version 465809 (0.0005) [2023-12-27 22:35:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 238911488. Throughput: 0: 9905.2, 1: 9715.4. Samples: 238902724. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:16,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-5.373')] [2023-12-27 22:35:16,186][106226] Updated weights for policy 0, policy_version 465819 (0.0007) [2023-12-27 22:35:16,234][106226] Updated weights for policy 0, policy_version 465829 (0.0008) [2023-12-27 22:35:16,538][106225] Updated weights for policy 1, policy_version 467217 (0.0005) [2023-12-27 22:35:16,595][106225] Updated weights for policy 1, policy_version 467227 (0.0005) [2023-12-27 22:35:16,658][106225] Updated weights for policy 1, policy_version 467237 (0.0006) [2023-12-27 22:35:16,708][106225] Updated weights for policy 1, policy_version 467247 (0.0008) [2023-12-27 22:35:16,787][106226] Updated weights for policy 0, policy_version 465839 (0.0008) [2023-12-27 22:35:16,849][106226] Updated weights for policy 0, policy_version 465849 (0.0010) [2023-12-27 22:35:16,905][106226] Updated weights for policy 0, policy_version 465859 (0.0010) [2023-12-27 22:35:17,432][106225] Updated weights for policy 1, policy_version 467257 (0.0008) [2023-12-27 22:35:17,460][106226] Updated weights for policy 0, policy_version 465869 (0.0010) [2023-12-27 22:35:17,480][106225] Updated weights for policy 1, policy_version 467267 (0.0007) [2023-12-27 22:35:17,515][106226] Updated weights for policy 0, policy_version 465879 (0.0009) [2023-12-27 22:35:17,536][106225] Updated weights for policy 1, policy_version 467277 (0.0006) [2023-12-27 22:35:17,575][106226] Updated weights for policy 0, policy_version 465889 (0.0010) [2023-12-27 22:35:18,290][106226] Updated weights for policy 0, policy_version 465899 (0.0010) [2023-12-27 22:35:18,303][106225] Updated weights for policy 1, policy_version 467287 (0.0007) [2023-12-27 22:35:18,355][106226] Updated weights for policy 0, policy_version 465909 (0.0010) [2023-12-27 22:35:18,369][106225] Updated weights for policy 1, policy_version 467297 (0.0007) [2023-12-27 22:35:18,418][106226] Updated weights for policy 0, policy_version 465919 (0.0008) [2023-12-27 22:35:18,426][106225] Updated weights for policy 1, policy_version 467307 (0.0007) [2023-12-27 22:35:19,069][106226] Updated weights for policy 0, policy_version 465929 (0.0008) [2023-12-27 22:35:19,127][106226] Updated weights for policy 0, policy_version 465939 (0.0005) [2023-12-27 22:35:19,180][106226] Updated weights for policy 0, policy_version 465949 (0.0005) [2023-12-27 22:35:19,230][106225] Updated weights for policy 1, policy_version 467317 (0.0007) [2023-12-27 22:35:19,248][106226] Updated weights for policy 0, policy_version 465959 (0.0009) [2023-12-27 22:35:19,291][106225] Updated weights for policy 1, policy_version 467327 (0.0007) [2023-12-27 22:35:19,359][106225] Updated weights for policy 1, policy_version 467337 (0.0009) [2023-12-27 22:35:20,039][106226] Updated weights for policy 0, policy_version 465969 (0.0011) [2023-12-27 22:35:20,106][106225] Updated weights for policy 1, policy_version 467347 (0.0008) [2023-12-27 22:35:20,108][106226] Updated weights for policy 0, policy_version 465979 (0.0011) [2023-12-27 22:35:20,159][106225] Updated weights for policy 1, policy_version 467357 (0.0007) [2023-12-27 22:35:20,170][106226] Updated weights for policy 0, policy_version 465989 (0.0011) [2023-12-27 22:35:20,217][106225] Updated weights for policy 1, policy_version 467367 (0.0007) [2023-12-27 22:35:20,892][106226] Updated weights for policy 0, policy_version 465999 (0.0007) [2023-12-27 22:35:20,953][106226] Updated weights for policy 0, policy_version 466009 (0.0006) [2023-12-27 22:35:21,000][106225] Updated weights for policy 1, policy_version 467377 (0.0008) [2023-12-27 22:35:21,018][106226] Updated weights for policy 0, policy_version 466019 (0.0006) [2023-12-27 22:35:21,069][106225] Updated weights for policy 1, policy_version 467387 (0.0007) [2023-12-27 22:35:21,138][106225] Updated weights for policy 1, policy_version 467397 (0.0009) [2023-12-27 22:35:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 239009792. Throughput: 0: 9925.5, 1: 9614.5. Samples: 239020640. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:21,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-5.526')] [2023-12-27 22:35:21,203][106225] Updated weights for policy 1, policy_version 467407 (0.0008) [2023-12-27 22:35:21,726][106226] Updated weights for policy 0, policy_version 466029 (0.0008) [2023-12-27 22:35:21,792][106226] Updated weights for policy 0, policy_version 466039 (0.0007) [2023-12-27 22:35:21,862][106226] Updated weights for policy 0, policy_version 466049 (0.0006) [2023-12-27 22:35:21,985][106225] Updated weights for policy 1, policy_version 467417 (0.0008) [2023-12-27 22:35:22,054][106225] Updated weights for policy 1, policy_version 467427 (0.0009) [2023-12-27 22:35:22,118][106225] Updated weights for policy 1, policy_version 467437 (0.0008) [2023-12-27 22:35:22,542][106226] Updated weights for policy 0, policy_version 466059 (0.0008) [2023-12-27 22:35:22,608][106226] Updated weights for policy 0, policy_version 466069 (0.0008) [2023-12-27 22:35:22,661][106226] Updated weights for policy 0, policy_version 466079 (0.0009) [2023-12-27 22:35:22,923][106225] Updated weights for policy 1, policy_version 467447 (0.0006) [2023-12-27 22:35:22,990][106225] Updated weights for policy 1, policy_version 467457 (0.0007) [2023-12-27 22:35:23,055][106225] Updated weights for policy 1, policy_version 467467 (0.0009) [2023-12-27 22:35:23,432][106226] Updated weights for policy 0, policy_version 466089 (0.0008) [2023-12-27 22:35:23,503][106226] Updated weights for policy 0, policy_version 466099 (0.0005) [2023-12-27 22:35:23,567][106226] Updated weights for policy 0, policy_version 466109 (0.0008) [2023-12-27 22:35:23,626][106226] Updated weights for policy 0, policy_version 466119 (0.0008) [2023-12-27 22:35:23,746][106225] Updated weights for policy 1, policy_version 467477 (0.0008) [2023-12-27 22:35:23,804][106225] Updated weights for policy 1, policy_version 467487 (0.0008) [2023-12-27 22:35:23,862][106225] Updated weights for policy 1, policy_version 467497 (0.0008) [2023-12-27 22:35:24,305][106226] Updated weights for policy 0, policy_version 466129 (0.0009) [2023-12-27 22:35:24,357][106226] Updated weights for policy 0, policy_version 466139 (0.0009) [2023-12-27 22:35:24,405][106226] Updated weights for policy 0, policy_version 466149 (0.0008) [2023-12-27 22:35:24,594][106225] Updated weights for policy 1, policy_version 467507 (0.0008) [2023-12-27 22:35:24,650][106225] Updated weights for policy 1, policy_version 467517 (0.0008) [2023-12-27 22:35:24,705][106225] Updated weights for policy 1, policy_version 467527 (0.0008) [2023-12-27 22:35:25,141][106226] Updated weights for policy 0, policy_version 466159 (0.0009) [2023-12-27 22:35:25,189][106226] Updated weights for policy 0, policy_version 466169 (0.0008) [2023-12-27 22:35:25,241][106226] Updated weights for policy 0, policy_version 466179 (0.0008) [2023-12-27 22:35:25,430][106225] Updated weights for policy 1, policy_version 467537 (0.0009) [2023-12-27 22:35:25,492][106225] Updated weights for policy 1, policy_version 467547 (0.0009) [2023-12-27 22:35:25,548][106225] Updated weights for policy 1, policy_version 467557 (0.0009) [2023-12-27 22:35:25,601][106225] Updated weights for policy 1, policy_version 467567 (0.0005) [2023-12-27 22:35:25,968][106226] Updated weights for policy 0, policy_version 466189 (0.0007) [2023-12-27 22:35:26,026][106226] Updated weights for policy 0, policy_version 466199 (0.0005) [2023-12-27 22:35:26,079][106226] Updated weights for policy 0, policy_version 466209 (0.0005) [2023-12-27 22:35:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 239108096. Throughput: 0: 9937.8, 1: 9552.2. Samples: 239076580. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:26,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-5.250')] [2023-12-27 22:35:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000467568_119726080.pth... [2023-12-27 22:35:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000466216_119382016.pth... [2023-12-27 22:35:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000466480_119447552.pth [2023-12-27 22:35:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000465032_119078912.pth [2023-12-27 22:35:26,370][106225] Updated weights for policy 1, policy_version 467577 (0.0009) [2023-12-27 22:35:26,422][106225] Updated weights for policy 1, policy_version 467587 (0.0006) [2023-12-27 22:35:26,469][106225] Updated weights for policy 1, policy_version 467597 (0.0006) [2023-12-27 22:35:26,586][106226] Updated weights for policy 0, policy_version 466219 (0.0005) [2023-12-27 22:35:26,646][106226] Updated weights for policy 0, policy_version 466229 (0.0005) [2023-12-27 22:35:26,708][106226] Updated weights for policy 0, policy_version 466239 (0.0006) [2023-12-27 22:35:27,108][106225] Updated weights for policy 1, policy_version 467607 (0.0005) [2023-12-27 22:35:27,172][106225] Updated weights for policy 1, policy_version 467617 (0.0005) [2023-12-27 22:35:27,239][106225] Updated weights for policy 1, policy_version 467627 (0.0005) [2023-12-27 22:35:27,271][106226] Updated weights for policy 0, policy_version 466249 (0.0005) [2023-12-27 22:35:27,332][106226] Updated weights for policy 0, policy_version 466259 (0.0007) [2023-12-27 22:35:27,382][106226] Updated weights for policy 0, policy_version 466269 (0.0010) [2023-12-27 22:35:27,432][106226] Updated weights for policy 0, policy_version 466279 (0.0008) [2023-12-27 22:35:27,756][106225] Updated weights for policy 1, policy_version 467637 (0.0007) [2023-12-27 22:35:27,819][106225] Updated weights for policy 1, policy_version 467647 (0.0010) [2023-12-27 22:35:27,868][106225] Updated weights for policy 1, policy_version 467657 (0.0007) [2023-12-27 22:35:28,202][106226] Updated weights for policy 0, policy_version 466289 (0.0007) [2023-12-27 22:35:28,260][106226] Updated weights for policy 0, policy_version 466299 (0.0008) [2023-12-27 22:35:28,316][106226] Updated weights for policy 0, policy_version 466309 (0.0008) [2023-12-27 22:35:28,472][106225] Updated weights for policy 1, policy_version 467667 (0.0007) [2023-12-27 22:35:28,541][106225] Updated weights for policy 1, policy_version 467677 (0.0010) [2023-12-27 22:35:28,604][106225] Updated weights for policy 1, policy_version 467687 (0.0010) [2023-12-27 22:35:29,004][106226] Updated weights for policy 0, policy_version 466319 (0.0008) [2023-12-27 22:35:29,066][106226] Updated weights for policy 0, policy_version 466329 (0.0008) [2023-12-27 22:35:29,126][106226] Updated weights for policy 0, policy_version 466339 (0.0007) [2023-12-27 22:35:29,302][106225] Updated weights for policy 1, policy_version 467697 (0.0010) [2023-12-27 22:35:29,375][106225] Updated weights for policy 1, policy_version 467707 (0.0008) [2023-12-27 22:35:29,426][106225] Updated weights for policy 1, policy_version 467717 (0.0005) [2023-12-27 22:35:29,483][106225] Updated weights for policy 1, policy_version 467727 (0.0006) [2023-12-27 22:35:29,900][106226] Updated weights for policy 0, policy_version 466349 (0.0009) [2023-12-27 22:35:29,968][106226] Updated weights for policy 0, policy_version 466359 (0.0008) [2023-12-27 22:35:30,027][106226] Updated weights for policy 0, policy_version 466369 (0.0006) [2023-12-27 22:35:30,067][106225] Updated weights for policy 1, policy_version 467737 (0.0006) [2023-12-27 22:35:30,133][106225] Updated weights for policy 1, policy_version 467747 (0.0008) [2023-12-27 22:35:30,201][106225] Updated weights for policy 1, policy_version 467757 (0.0008) [2023-12-27 22:35:30,709][106226] Updated weights for policy 0, policy_version 466379 (0.0007) [2023-12-27 22:35:30,761][106226] Updated weights for policy 0, policy_version 466389 (0.0009) [2023-12-27 22:35:30,811][106225] Updated weights for policy 1, policy_version 467767 (0.0006) [2023-12-27 22:35:30,822][106226] Updated weights for policy 0, policy_version 466399 (0.0007) [2023-12-27 22:35:30,868][106225] Updated weights for policy 1, policy_version 467777 (0.0005) [2023-12-27 22:35:30,920][106225] Updated weights for policy 1, policy_version 467787 (0.0005) [2023-12-27 22:35:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 239214592. Throughput: 0: 10027.7, 1: 9663.2. Samples: 239199808. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:31,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-5.555')] [2023-12-27 22:35:31,592][106225] Updated weights for policy 1, policy_version 467797 (0.0007) [2023-12-27 22:35:31,594][106226] Updated weights for policy 0, policy_version 466409 (0.0006) [2023-12-27 22:35:31,653][106225] Updated weights for policy 1, policy_version 467807 (0.0008) [2023-12-27 22:35:31,658][106226] Updated weights for policy 0, policy_version 466419 (0.0008) [2023-12-27 22:35:31,714][106225] Updated weights for policy 1, policy_version 467817 (0.0007) [2023-12-27 22:35:31,724][106226] Updated weights for policy 0, policy_version 466429 (0.0007) [2023-12-27 22:35:31,789][106226] Updated weights for policy 0, policy_version 466439 (0.0007) [2023-12-27 22:35:32,466][106225] Updated weights for policy 1, policy_version 467827 (0.0007) [2023-12-27 22:35:32,528][106225] Updated weights for policy 1, policy_version 467837 (0.0008) [2023-12-27 22:35:32,539][106226] Updated weights for policy 0, policy_version 466449 (0.0009) [2023-12-27 22:35:32,586][106225] Updated weights for policy 1, policy_version 467847 (0.0008) [2023-12-27 22:35:32,595][106226] Updated weights for policy 0, policy_version 466459 (0.0007) [2023-12-27 22:35:32,658][106226] Updated weights for policy 0, policy_version 466469 (0.0007) [2023-12-27 22:35:33,311][106225] Updated weights for policy 1, policy_version 467857 (0.0007) [2023-12-27 22:35:33,357][106226] Updated weights for policy 0, policy_version 466479 (0.0007) [2023-12-27 22:35:33,362][106225] Updated weights for policy 1, policy_version 467867 (0.0007) [2023-12-27 22:35:33,417][106226] Updated weights for policy 0, policy_version 466489 (0.0007) [2023-12-27 22:35:33,418][106225] Updated weights for policy 1, policy_version 467877 (0.0005) [2023-12-27 22:35:33,471][106226] Updated weights for policy 0, policy_version 466499 (0.0008) [2023-12-27 22:35:33,473][106225] Updated weights for policy 1, policy_version 467887 (0.0005) [2023-12-27 22:35:34,000][106225] Updated weights for policy 1, policy_version 467897 (0.0005) [2023-12-27 22:35:34,058][106225] Updated weights for policy 1, policy_version 467907 (0.0005) [2023-12-27 22:35:34,085][106226] Updated weights for policy 0, policy_version 466509 (0.0009) [2023-12-27 22:35:34,107][106225] Updated weights for policy 1, policy_version 467917 (0.0005) [2023-12-27 22:35:34,141][106226] Updated weights for policy 0, policy_version 466519 (0.0011) [2023-12-27 22:35:34,208][106226] Updated weights for policy 0, policy_version 466529 (0.0009) [2023-12-27 22:35:34,788][106225] Updated weights for policy 1, policy_version 467927 (0.0006) [2023-12-27 22:35:34,840][106225] Updated weights for policy 1, policy_version 467937 (0.0008) [2023-12-27 22:35:34,900][106225] Updated weights for policy 1, policy_version 467947 (0.0009) [2023-12-27 22:35:34,954][106226] Updated weights for policy 0, policy_version 466539 (0.0011) [2023-12-27 22:35:35,017][106226] Updated weights for policy 0, policy_version 466549 (0.0011) [2023-12-27 22:35:35,080][106226] Updated weights for policy 0, policy_version 466559 (0.0010) [2023-12-27 22:35:35,634][106225] Updated weights for policy 1, policy_version 467957 (0.0008) [2023-12-27 22:35:35,659][106226] Updated weights for policy 0, policy_version 466569 (0.0010) [2023-12-27 22:35:35,691][106225] Updated weights for policy 1, policy_version 467967 (0.0007) [2023-12-27 22:35:35,715][106226] Updated weights for policy 0, policy_version 466579 (0.0005) [2023-12-27 22:35:35,762][106225] Updated weights for policy 1, policy_version 467977 (0.0009) [2023-12-27 22:35:35,772][106226] Updated weights for policy 0, policy_version 466589 (0.0005) [2023-12-27 22:35:35,822][106226] Updated weights for policy 0, policy_version 466599 (0.0005) [2023-12-27 22:35:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 239312896. Throughput: 0: 10070.2, 1: 9664.6. Samples: 239322428. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:36,175][105115] Avg episode reward: [(0, '-5.076'), (1, '-5.628')] [2023-12-27 22:35:36,421][106226] Updated weights for policy 0, policy_version 466609 (0.0006) [2023-12-27 22:35:36,462][106225] Updated weights for policy 1, policy_version 467987 (0.0008) [2023-12-27 22:35:36,480][106226] Updated weights for policy 0, policy_version 466619 (0.0006) [2023-12-27 22:35:36,529][106225] Updated weights for policy 1, policy_version 467997 (0.0006) [2023-12-27 22:35:36,536][106226] Updated weights for policy 0, policy_version 466629 (0.0010) [2023-12-27 22:35:36,582][106225] Updated weights for policy 1, policy_version 468007 (0.0009) [2023-12-27 22:35:37,153][106226] Updated weights for policy 0, policy_version 466639 (0.0006) [2023-12-27 22:35:37,209][106226] Updated weights for policy 0, policy_version 466649 (0.0005) [2023-12-27 22:35:37,259][106226] Updated weights for policy 0, policy_version 466659 (0.0005) [2023-12-27 22:35:37,338][106225] Updated weights for policy 1, policy_version 468017 (0.0009) [2023-12-27 22:35:37,395][106225] Updated weights for policy 1, policy_version 468027 (0.0009) [2023-12-27 22:35:37,460][106225] Updated weights for policy 1, policy_version 468037 (0.0010) [2023-12-27 22:35:37,513][106225] Updated weights for policy 1, policy_version 468047 (0.0010) [2023-12-27 22:35:37,858][106226] Updated weights for policy 0, policy_version 466669 (0.0006) [2023-12-27 22:35:37,915][106226] Updated weights for policy 0, policy_version 466679 (0.0009) [2023-12-27 22:35:37,983][106226] Updated weights for policy 0, policy_version 466689 (0.0008) [2023-12-27 22:35:38,286][106225] Updated weights for policy 1, policy_version 468057 (0.0010) [2023-12-27 22:35:38,350][106225] Updated weights for policy 1, policy_version 468067 (0.0008) [2023-12-27 22:35:38,416][106225] Updated weights for policy 1, policy_version 468077 (0.0006) [2023-12-27 22:35:38,638][106226] Updated weights for policy 0, policy_version 466699 (0.0007) [2023-12-27 22:35:38,701][106226] Updated weights for policy 0, policy_version 466709 (0.0010) [2023-12-27 22:35:38,767][106226] Updated weights for policy 0, policy_version 466719 (0.0008) [2023-12-27 22:35:39,035][106225] Updated weights for policy 1, policy_version 468087 (0.0008) [2023-12-27 22:35:39,090][106225] Updated weights for policy 1, policy_version 468097 (0.0010) [2023-12-27 22:35:39,155][106225] Updated weights for policy 1, policy_version 468107 (0.0010) [2023-12-27 22:35:39,551][106226] Updated weights for policy 0, policy_version 466729 (0.0007) [2023-12-27 22:35:39,618][106226] Updated weights for policy 0, policy_version 466739 (0.0008) [2023-12-27 22:35:39,683][106226] Updated weights for policy 0, policy_version 466749 (0.0009) [2023-12-27 22:35:39,751][106226] Updated weights for policy 0, policy_version 466759 (0.0009) [2023-12-27 22:35:39,902][106225] Updated weights for policy 1, policy_version 468117 (0.0010) [2023-12-27 22:35:39,960][106225] Updated weights for policy 1, policy_version 468127 (0.0008) [2023-12-27 22:35:40,023][106225] Updated weights for policy 1, policy_version 468137 (0.0008) [2023-12-27 22:35:40,480][106226] Updated weights for policy 0, policy_version 466769 (0.0007) [2023-12-27 22:35:40,551][106226] Updated weights for policy 0, policy_version 466779 (0.0008) [2023-12-27 22:35:40,624][106226] Updated weights for policy 0, policy_version 466789 (0.0007) [2023-12-27 22:35:40,665][106225] Updated weights for policy 1, policy_version 468147 (0.0007) [2023-12-27 22:35:40,722][106225] Updated weights for policy 1, policy_version 468157 (0.0005) [2023-12-27 22:35:40,784][106225] Updated weights for policy 1, policy_version 468167 (0.0006) [2023-12-27 22:35:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 239411200. Throughput: 0: 10124.8, 1: 9643.0. Samples: 239382960. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:41,175][105115] Avg episode reward: [(0, '-4.982'), (1, '-5.683')] [2023-12-27 22:35:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000468176_119881728.pth... [2023-12-27 22:35:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000466792_119529472.pth... [2023-12-27 22:35:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000465640_119234560.pth [2023-12-27 22:35:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000467024_119586816.pth [2023-12-27 22:35:41,372][106226] Updated weights for policy 0, policy_version 466799 (0.0008) [2023-12-27 22:35:41,443][106226] Updated weights for policy 0, policy_version 466809 (0.0008) [2023-12-27 22:35:41,447][106225] Updated weights for policy 1, policy_version 468177 (0.0005) [2023-12-27 22:35:41,510][106226] Updated weights for policy 0, policy_version 466819 (0.0008) [2023-12-27 22:35:41,512][106225] Updated weights for policy 1, policy_version 468187 (0.0006) [2023-12-27 22:35:41,577][106225] Updated weights for policy 1, policy_version 468197 (0.0008) [2023-12-27 22:35:41,656][106225] Updated weights for policy 1, policy_version 468207 (0.0008) [2023-12-27 22:35:42,193][106226] Updated weights for policy 0, policy_version 466829 (0.0007) [2023-12-27 22:35:42,259][106226] Updated weights for policy 0, policy_version 466839 (0.0007) [2023-12-27 22:35:42,328][106226] Updated weights for policy 0, policy_version 466849 (0.0008) [2023-12-27 22:35:42,426][106225] Updated weights for policy 1, policy_version 468217 (0.0006) [2023-12-27 22:35:42,483][106225] Updated weights for policy 1, policy_version 468227 (0.0008) [2023-12-27 22:35:42,546][106225] Updated weights for policy 1, policy_version 468237 (0.0008) [2023-12-27 22:35:43,073][106226] Updated weights for policy 0, policy_version 466859 (0.0009) [2023-12-27 22:35:43,122][106226] Updated weights for policy 0, policy_version 466869 (0.0008) [2023-12-27 22:35:43,171][106226] Updated weights for policy 0, policy_version 466879 (0.0009) [2023-12-27 22:35:43,222][106225] Updated weights for policy 1, policy_version 468247 (0.0006) [2023-12-27 22:35:43,280][106225] Updated weights for policy 1, policy_version 468257 (0.0008) [2023-12-27 22:35:43,337][106225] Updated weights for policy 1, policy_version 468267 (0.0009) [2023-12-27 22:35:43,786][106226] Updated weights for policy 0, policy_version 466889 (0.0008) [2023-12-27 22:35:43,842][106226] Updated weights for policy 0, policy_version 466899 (0.0007) [2023-12-27 22:35:43,907][106226] Updated weights for policy 0, policy_version 466909 (0.0007) [2023-12-27 22:35:43,961][106226] Updated weights for policy 0, policy_version 466919 (0.0005) [2023-12-27 22:35:44,157][106225] Updated weights for policy 1, policy_version 468277 (0.0009) [2023-12-27 22:35:44,212][106225] Updated weights for policy 1, policy_version 468287 (0.0006) [2023-12-27 22:35:44,270][106225] Updated weights for policy 1, policy_version 468297 (0.0005) [2023-12-27 22:35:44,566][106226] Updated weights for policy 0, policy_version 466929 (0.0008) [2023-12-27 22:35:44,628][106226] Updated weights for policy 0, policy_version 466939 (0.0008) [2023-12-27 22:35:44,679][106226] Updated weights for policy 0, policy_version 466949 (0.0008) [2023-12-27 22:35:44,973][106225] Updated weights for policy 1, policy_version 468307 (0.0006) [2023-12-27 22:35:45,037][106225] Updated weights for policy 1, policy_version 468317 (0.0008) [2023-12-27 22:35:45,089][106225] Updated weights for policy 1, policy_version 468327 (0.0008) [2023-12-27 22:35:45,447][106226] Updated weights for policy 0, policy_version 466959 (0.0009) [2023-12-27 22:35:45,509][106226] Updated weights for policy 0, policy_version 466969 (0.0011) [2023-12-27 22:35:45,572][106226] Updated weights for policy 0, policy_version 466979 (0.0011) [2023-12-27 22:35:45,815][106225] Updated weights for policy 1, policy_version 468337 (0.0007) [2023-12-27 22:35:45,865][106225] Updated weights for policy 1, policy_version 468347 (0.0010) [2023-12-27 22:35:45,915][106225] Updated weights for policy 1, policy_version 468357 (0.0010) [2023-12-27 22:35:45,972][106225] Updated weights for policy 1, policy_version 468367 (0.0006) [2023-12-27 22:35:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 239509504. Throughput: 0: 10126.6, 1: 9679.4. Samples: 239499400. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:46,176][105115] Avg episode reward: [(0, '-4.933'), (1, '-5.650')] [2023-12-27 22:35:46,288][106226] Updated weights for policy 0, policy_version 466989 (0.0011) [2023-12-27 22:35:46,352][106226] Updated weights for policy 0, policy_version 466999 (0.0007) [2023-12-27 22:35:46,419][106226] Updated weights for policy 0, policy_version 467009 (0.0009) [2023-12-27 22:35:46,624][106225] Updated weights for policy 1, policy_version 468377 (0.0010) [2023-12-27 22:35:46,677][106225] Updated weights for policy 1, policy_version 468387 (0.0010) [2023-12-27 22:35:46,733][106225] Updated weights for policy 1, policy_version 468397 (0.0007) [2023-12-27 22:35:46,965][106226] Updated weights for policy 0, policy_version 467019 (0.0011) [2023-12-27 22:35:47,034][106226] Updated weights for policy 0, policy_version 467029 (0.0011) [2023-12-27 22:35:47,091][106226] Updated weights for policy 0, policy_version 467039 (0.0011) [2023-12-27 22:35:47,424][106225] Updated weights for policy 1, policy_version 468407 (0.0007) [2023-12-27 22:35:47,488][106225] Updated weights for policy 1, policy_version 468417 (0.0008) [2023-12-27 22:35:47,547][106225] Updated weights for policy 1, policy_version 468427 (0.0010) [2023-12-27 22:35:47,797][106226] Updated weights for policy 0, policy_version 467049 (0.0011) [2023-12-27 22:35:47,851][106226] Updated weights for policy 0, policy_version 467059 (0.0010) [2023-12-27 22:35:47,910][106226] Updated weights for policy 0, policy_version 467069 (0.0010) [2023-12-27 22:35:47,964][106226] Updated weights for policy 0, policy_version 467079 (0.0010) [2023-12-27 22:35:48,211][106225] Updated weights for policy 1, policy_version 468437 (0.0010) [2023-12-27 22:35:48,260][106225] Updated weights for policy 1, policy_version 468447 (0.0010) [2023-12-27 22:35:48,309][106225] Updated weights for policy 1, policy_version 468457 (0.0010) [2023-12-27 22:35:48,695][106226] Updated weights for policy 0, policy_version 467089 (0.0009) [2023-12-27 22:35:48,752][106226] Updated weights for policy 0, policy_version 467099 (0.0008) [2023-12-27 22:35:48,812][106226] Updated weights for policy 0, policy_version 467109 (0.0009) [2023-12-27 22:35:49,052][106225] Updated weights for policy 1, policy_version 468467 (0.0011) [2023-12-27 22:35:49,100][106225] Updated weights for policy 1, policy_version 468477 (0.0009) [2023-12-27 22:35:49,144][106225] Updated weights for policy 1, policy_version 468487 (0.0008) [2023-12-27 22:35:49,587][106226] Updated weights for policy 0, policy_version 467119 (0.0008) [2023-12-27 22:35:49,642][106226] Updated weights for policy 0, policy_version 467129 (0.0008) [2023-12-27 22:35:49,698][106226] Updated weights for policy 0, policy_version 467139 (0.0009) [2023-12-27 22:35:49,893][106225] Updated weights for policy 1, policy_version 468497 (0.0008) [2023-12-27 22:35:49,966][106225] Updated weights for policy 1, policy_version 468507 (0.0008) [2023-12-27 22:35:50,032][106225] Updated weights for policy 1, policy_version 468517 (0.0007) [2023-12-27 22:35:50,091][106225] Updated weights for policy 1, policy_version 468527 (0.0008) [2023-12-27 22:35:50,500][106226] Updated weights for policy 0, policy_version 467149 (0.0008) [2023-12-27 22:35:50,555][106226] Updated weights for policy 0, policy_version 467159 (0.0008) [2023-12-27 22:35:50,624][106226] Updated weights for policy 0, policy_version 467169 (0.0009) [2023-12-27 22:35:50,879][106225] Updated weights for policy 1, policy_version 468537 (0.0008) [2023-12-27 22:35:50,946][106225] Updated weights for policy 1, policy_version 468547 (0.0006) [2023-12-27 22:35:51,007][106225] Updated weights for policy 1, policy_version 468557 (0.0006) [2023-12-27 22:35:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 239607808. Throughput: 0: 9987.6, 1: 9685.5. Samples: 239616132. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:51,175][105115] Avg episode reward: [(0, '-4.997'), (1, '-5.663')] [2023-12-27 22:35:51,377][106226] Updated weights for policy 0, policy_version 467179 (0.0008) [2023-12-27 22:35:51,441][106226] Updated weights for policy 0, policy_version 467189 (0.0009) [2023-12-27 22:35:51,496][106226] Updated weights for policy 0, policy_version 467200 (0.0008) [2023-12-27 22:35:51,731][106225] Updated weights for policy 1, policy_version 468567 (0.0008) [2023-12-27 22:35:51,795][106225] Updated weights for policy 1, policy_version 468577 (0.0008) [2023-12-27 22:35:51,847][106225] Updated weights for policy 1, policy_version 468587 (0.0009) [2023-12-27 22:35:52,258][106226] Updated weights for policy 0, policy_version 467210 (0.0009) [2023-12-27 22:35:52,317][106226] Updated weights for policy 0, policy_version 467220 (0.0009) [2023-12-27 22:35:52,382][106226] Updated weights for policy 0, policy_version 467230 (0.0008) [2023-12-27 22:35:52,447][106226] Updated weights for policy 0, policy_version 467240 (0.0009) [2023-12-27 22:35:52,509][106225] Updated weights for policy 1, policy_version 468597 (0.0007) [2023-12-27 22:35:52,568][106225] Updated weights for policy 1, policy_version 468607 (0.0008) [2023-12-27 22:35:52,628][106225] Updated weights for policy 1, policy_version 468617 (0.0008) [2023-12-27 22:35:53,279][106226] Updated weights for policy 0, policy_version 467250 (0.0010) [2023-12-27 22:35:53,333][106225] Updated weights for policy 1, policy_version 468627 (0.0008) [2023-12-27 22:35:53,344][106226] Updated weights for policy 0, policy_version 467260 (0.0008) [2023-12-27 22:35:53,391][106225] Updated weights for policy 1, policy_version 468637 (0.0006) [2023-12-27 22:35:53,405][106226] Updated weights for policy 0, policy_version 467270 (0.0007) [2023-12-27 22:35:53,447][106225] Updated weights for policy 1, policy_version 468647 (0.0007) [2023-12-27 22:35:54,116][106226] Updated weights for policy 0, policy_version 467280 (0.0008) [2023-12-27 22:35:54,166][106225] Updated weights for policy 1, policy_version 468657 (0.0008) [2023-12-27 22:35:54,175][106226] Updated weights for policy 0, policy_version 467290 (0.0005) [2023-12-27 22:35:54,223][106225] Updated weights for policy 1, policy_version 468667 (0.0009) [2023-12-27 22:35:54,236][106226] Updated weights for policy 0, policy_version 467300 (0.0005) [2023-12-27 22:35:54,283][106225] Updated weights for policy 1, policy_version 468677 (0.0007) [2023-12-27 22:35:54,340][106225] Updated weights for policy 1, policy_version 468687 (0.0008) [2023-12-27 22:35:54,916][106226] Updated weights for policy 0, policy_version 467310 (0.0007) [2023-12-27 22:35:54,976][106226] Updated weights for policy 0, policy_version 467320 (0.0009) [2023-12-27 22:35:55,033][106226] Updated weights for policy 0, policy_version 467330 (0.0008) [2023-12-27 22:35:55,062][106225] Updated weights for policy 1, policy_version 468697 (0.0008) [2023-12-27 22:35:55,123][106225] Updated weights for policy 1, policy_version 468707 (0.0006) [2023-12-27 22:35:55,189][106225] Updated weights for policy 1, policy_version 468717 (0.0005) [2023-12-27 22:35:55,767][106226] Updated weights for policy 0, policy_version 467340 (0.0008) [2023-12-27 22:35:55,826][106225] Updated weights for policy 1, policy_version 468727 (0.0005) [2023-12-27 22:35:55,828][106226] Updated weights for policy 0, policy_version 467350 (0.0010) [2023-12-27 22:35:55,875][106225] Updated weights for policy 1, policy_version 468737 (0.0005) [2023-12-27 22:35:55,884][106226] Updated weights for policy 0, policy_version 467360 (0.0010) [2023-12-27 22:35:55,924][106225] Updated weights for policy 1, policy_version 468747 (0.0006) [2023-12-27 22:35:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 239706112. Throughput: 0: 9926.2, 1: 9721.8. Samples: 239672916. Policy #0 lag: (min: 31.0, avg: 31.2, max: 41.0) [2023-12-27 22:35:56,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.578')] [2023-12-27 22:35:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000468752_120029184.pth... [2023-12-27 22:35:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000467368_119676928.pth... [2023-12-27 22:35:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000467568_119726080.pth [2023-12-27 22:35:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000466216_119382016.pth [2023-12-27 22:35:56,595][106226] Updated weights for policy 0, policy_version 467370 (0.0010) [2023-12-27 22:35:56,601][106225] Updated weights for policy 1, policy_version 468757 (0.0008) [2023-12-27 22:35:56,650][106225] Updated weights for policy 1, policy_version 468767 (0.0007) [2023-12-27 22:35:56,656][106226] Updated weights for policy 0, policy_version 467380 (0.0011) [2023-12-27 22:35:56,714][106225] Updated weights for policy 1, policy_version 468777 (0.0007) [2023-12-27 22:35:56,718][106226] Updated weights for policy 0, policy_version 467390 (0.0010) [2023-12-27 22:35:56,783][106226] Updated weights for policy 0, policy_version 467400 (0.0009) [2023-12-27 22:35:57,402][106225] Updated weights for policy 1, policy_version 468787 (0.0009) [2023-12-27 22:35:57,419][106226] Updated weights for policy 0, policy_version 467410 (0.0010) [2023-12-27 22:35:57,447][106225] Updated weights for policy 1, policy_version 468797 (0.0005) [2023-12-27 22:35:57,478][106226] Updated weights for policy 0, policy_version 467420 (0.0008) [2023-12-27 22:35:57,515][106225] Updated weights for policy 1, policy_version 468807 (0.0005) [2023-12-27 22:35:57,534][106226] Updated weights for policy 0, policy_version 467430 (0.0006) [2023-12-27 22:35:58,121][106226] Updated weights for policy 0, policy_version 467440 (0.0005) [2023-12-27 22:35:58,168][106226] Updated weights for policy 0, policy_version 467450 (0.0005) [2023-12-27 22:35:58,225][106225] Updated weights for policy 1, policy_version 468817 (0.0005) [2023-12-27 22:35:58,230][106226] Updated weights for policy 0, policy_version 467460 (0.0008) [2023-12-27 22:35:58,288][106225] Updated weights for policy 1, policy_version 468827 (0.0008) [2023-12-27 22:35:58,355][106225] Updated weights for policy 1, policy_version 468837 (0.0008) [2023-12-27 22:35:58,423][106225] Updated weights for policy 1, policy_version 468847 (0.0007) [2023-12-27 22:35:59,066][106226] Updated weights for policy 0, policy_version 467470 (0.0008) [2023-12-27 22:35:59,130][106226] Updated weights for policy 0, policy_version 467480 (0.0008) [2023-12-27 22:35:59,194][106226] Updated weights for policy 0, policy_version 467490 (0.0008) [2023-12-27 22:35:59,209][106225] Updated weights for policy 1, policy_version 468857 (0.0008) [2023-12-27 22:35:59,283][106225] Updated weights for policy 1, policy_version 468867 (0.0009) [2023-12-27 22:35:59,352][106225] Updated weights for policy 1, policy_version 468877 (0.0007) [2023-12-27 22:35:59,941][106226] Updated weights for policy 0, policy_version 467500 (0.0008) [2023-12-27 22:36:00,009][106226] Updated weights for policy 0, policy_version 467510 (0.0009) [2023-12-27 22:36:00,058][106225] Updated weights for policy 1, policy_version 468887 (0.0009) [2023-12-27 22:36:00,070][106226] Updated weights for policy 0, policy_version 467520 (0.0010) [2023-12-27 22:36:00,123][106225] Updated weights for policy 1, policy_version 468897 (0.0008) [2023-12-27 22:36:00,191][106225] Updated weights for policy 1, policy_version 468907 (0.0008) [2023-12-27 22:36:00,728][106226] Updated weights for policy 0, policy_version 467530 (0.0010) [2023-12-27 22:36:00,780][106226] Updated weights for policy 0, policy_version 467540 (0.0010) [2023-12-27 22:36:00,820][106225] Updated weights for policy 1, policy_version 468917 (0.0007) [2023-12-27 22:36:00,834][106226] Updated weights for policy 0, policy_version 467550 (0.0010) [2023-12-27 22:36:00,877][106225] Updated weights for policy 1, policy_version 468927 (0.0007) [2023-12-27 22:36:00,891][106226] Updated weights for policy 0, policy_version 467560 (0.0010) [2023-12-27 22:36:00,937][106225] Updated weights for policy 1, policy_version 468937 (0.0007) [2023-12-27 22:36:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 239804416. Throughput: 0: 9950.4, 1: 9774.5. Samples: 239790344. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:01,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.525')] [2023-12-27 22:36:01,602][106226] Updated weights for policy 0, policy_version 467570 (0.0010) [2023-12-27 22:36:01,669][106226] Updated weights for policy 0, policy_version 467580 (0.0009) [2023-12-27 22:36:01,720][106225] Updated weights for policy 1, policy_version 468947 (0.0008) [2023-12-27 22:36:01,729][106226] Updated weights for policy 0, policy_version 467590 (0.0010) [2023-12-27 22:36:01,785][106225] Updated weights for policy 1, policy_version 468957 (0.0008) [2023-12-27 22:36:01,850][106225] Updated weights for policy 1, policy_version 468967 (0.0009) [2023-12-27 22:36:02,413][106226] Updated weights for policy 0, policy_version 467600 (0.0010) [2023-12-27 22:36:02,477][106226] Updated weights for policy 0, policy_version 467610 (0.0011) [2023-12-27 22:36:02,546][106226] Updated weights for policy 0, policy_version 467620 (0.0010) [2023-12-27 22:36:02,605][106225] Updated weights for policy 1, policy_version 468977 (0.0007) [2023-12-27 22:36:02,671][106225] Updated weights for policy 1, policy_version 468987 (0.0005) [2023-12-27 22:36:02,730][106225] Updated weights for policy 1, policy_version 468997 (0.0009) [2023-12-27 22:36:02,783][106225] Updated weights for policy 1, policy_version 469007 (0.0010) [2023-12-27 22:36:03,211][106226] Updated weights for policy 0, policy_version 467630 (0.0007) [2023-12-27 22:36:03,266][106226] Updated weights for policy 0, policy_version 467640 (0.0009) [2023-12-27 22:36:03,326][106226] Updated weights for policy 0, policy_version 467650 (0.0010) [2023-12-27 22:36:03,405][106225] Updated weights for policy 1, policy_version 469017 (0.0010) [2023-12-27 22:36:03,457][106225] Updated weights for policy 1, policy_version 469027 (0.0010) [2023-12-27 22:36:03,510][106225] Updated weights for policy 1, policy_version 469037 (0.0010) [2023-12-27 22:36:03,971][106226] Updated weights for policy 0, policy_version 467660 (0.0009) [2023-12-27 22:36:04,029][106226] Updated weights for policy 0, policy_version 467670 (0.0007) [2023-12-27 22:36:04,092][106226] Updated weights for policy 0, policy_version 467680 (0.0008) [2023-12-27 22:36:04,274][106225] Updated weights for policy 1, policy_version 469047 (0.0010) [2023-12-27 22:36:04,335][106225] Updated weights for policy 1, policy_version 469057 (0.0010) [2023-12-27 22:36:04,390][106225] Updated weights for policy 1, policy_version 469067 (0.0010) [2023-12-27 22:36:04,804][106226] Updated weights for policy 0, policy_version 467690 (0.0008) [2023-12-27 22:36:04,855][106226] Updated weights for policy 0, policy_version 467700 (0.0011) [2023-12-27 22:36:04,905][106226] Updated weights for policy 0, policy_version 467710 (0.0010) [2023-12-27 22:36:04,954][106226] Updated weights for policy 0, policy_version 467720 (0.0010) [2023-12-27 22:36:05,052][106225] Updated weights for policy 1, policy_version 469077 (0.0010) [2023-12-27 22:36:05,115][106225] Updated weights for policy 1, policy_version 469087 (0.0010) [2023-12-27 22:36:05,174][106225] Updated weights for policy 1, policy_version 469097 (0.0005) [2023-12-27 22:36:05,696][106226] Updated weights for policy 0, policy_version 467730 (0.0011) [2023-12-27 22:36:05,730][106225] Updated weights for policy 1, policy_version 469107 (0.0006) [2023-12-27 22:36:05,752][106226] Updated weights for policy 0, policy_version 467740 (0.0011) [2023-12-27 22:36:05,789][106225] Updated weights for policy 1, policy_version 469117 (0.0007) [2023-12-27 22:36:05,810][106226] Updated weights for policy 0, policy_version 467750 (0.0011) [2023-12-27 22:36:05,852][106225] Updated weights for policy 1, policy_version 469127 (0.0010) [2023-12-27 22:36:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 239902720. Throughput: 0: 9889.0, 1: 9887.6. Samples: 239910584. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:06,175][105115] Avg episode reward: [(0, '-5.040'), (1, '-5.595')] [2023-12-27 22:36:06,546][106225] Updated weights for policy 1, policy_version 469137 (0.0009) [2023-12-27 22:36:06,550][106226] Updated weights for policy 0, policy_version 467760 (0.0009) [2023-12-27 22:36:06,610][106225] Updated weights for policy 1, policy_version 469147 (0.0010) [2023-12-27 22:36:06,612][106226] Updated weights for policy 0, policy_version 467770 (0.0009) [2023-12-27 22:36:06,674][106225] Updated weights for policy 1, policy_version 469157 (0.0010) [2023-12-27 22:36:06,676][106226] Updated weights for policy 0, policy_version 467780 (0.0005) [2023-12-27 22:36:06,726][106225] Updated weights for policy 1, policy_version 469167 (0.0010) [2023-12-27 22:36:07,387][106226] Updated weights for policy 0, policy_version 467790 (0.0005) [2023-12-27 22:36:07,406][106225] Updated weights for policy 1, policy_version 469177 (0.0010) [2023-12-27 22:36:07,440][106226] Updated weights for policy 0, policy_version 467800 (0.0009) [2023-12-27 22:36:07,461][106225] Updated weights for policy 1, policy_version 469187 (0.0010) [2023-12-27 22:36:07,494][106226] Updated weights for policy 0, policy_version 467810 (0.0006) [2023-12-27 22:36:07,511][106225] Updated weights for policy 1, policy_version 469197 (0.0011) [2023-12-27 22:36:08,220][106226] Updated weights for policy 0, policy_version 467820 (0.0006) [2023-12-27 22:36:08,240][106225] Updated weights for policy 1, policy_version 469207 (0.0010) [2023-12-27 22:36:08,284][106226] Updated weights for policy 0, policy_version 467830 (0.0006) [2023-12-27 22:36:08,290][106225] Updated weights for policy 1, policy_version 469217 (0.0010) [2023-12-27 22:36:08,343][106226] Updated weights for policy 0, policy_version 467840 (0.0007) [2023-12-27 22:36:08,363][106225] Updated weights for policy 1, policy_version 469227 (0.0010) [2023-12-27 22:36:09,093][106225] Updated weights for policy 1, policy_version 469237 (0.0010) [2023-12-27 22:36:09,117][106226] Updated weights for policy 0, policy_version 467850 (0.0007) [2023-12-27 22:36:09,158][106225] Updated weights for policy 1, policy_version 469247 (0.0010) [2023-12-27 22:36:09,188][106226] Updated weights for policy 0, policy_version 467860 (0.0010) [2023-12-27 22:36:09,223][106225] Updated weights for policy 1, policy_version 469257 (0.0010) [2023-12-27 22:36:09,258][106226] Updated weights for policy 0, policy_version 467870 (0.0010) [2023-12-27 22:36:09,324][106226] Updated weights for policy 0, policy_version 467880 (0.0007) [2023-12-27 22:36:09,957][106225] Updated weights for policy 1, policy_version 469267 (0.0009) [2023-12-27 22:36:10,008][106225] Updated weights for policy 1, policy_version 469277 (0.0009) [2023-12-27 22:36:10,069][106225] Updated weights for policy 1, policy_version 469287 (0.0009) [2023-12-27 22:36:10,103][106226] Updated weights for policy 0, policy_version 467890 (0.0007) [2023-12-27 22:36:10,165][106226] Updated weights for policy 0, policy_version 467900 (0.0007) [2023-12-27 22:36:10,232][106226] Updated weights for policy 0, policy_version 467910 (0.0008) [2023-12-27 22:36:10,734][106225] Updated weights for policy 1, policy_version 469297 (0.0009) [2023-12-27 22:36:10,781][106225] Updated weights for policy 1, policy_version 469307 (0.0007) [2023-12-27 22:36:10,825][106225] Updated weights for policy 1, policy_version 469317 (0.0008) [2023-12-27 22:36:10,870][106225] Updated weights for policy 1, policy_version 469327 (0.0008) [2023-12-27 22:36:10,962][106226] Updated weights for policy 0, policy_version 467920 (0.0010) [2023-12-27 22:36:11,027][106226] Updated weights for policy 0, policy_version 467930 (0.0011) [2023-12-27 22:36:11,089][106226] Updated weights for policy 0, policy_version 467940 (0.0008) [2023-12-27 22:36:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 240001024. Throughput: 0: 9888.0, 1: 9925.4. Samples: 239968184. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:11,175][105115] Avg episode reward: [(0, '-5.051'), (1, '-5.203')] [2023-12-27 22:36:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000469328_120176640.pth... [2023-12-27 22:36:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000467944_119824384.pth... [2023-12-27 22:36:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000466792_119529472.pth [2023-12-27 22:36:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000468176_119881728.pth [2023-12-27 22:36:11,759][106225] Updated weights for policy 1, policy_version 469337 (0.0009) [2023-12-27 22:36:11,782][106226] Updated weights for policy 0, policy_version 467950 (0.0008) [2023-12-27 22:36:11,822][106225] Updated weights for policy 1, policy_version 469347 (0.0008) [2023-12-27 22:36:11,850][106226] Updated weights for policy 0, policy_version 467960 (0.0009) [2023-12-27 22:36:11,886][106225] Updated weights for policy 1, policy_version 469357 (0.0008) [2023-12-27 22:36:11,912][106226] Updated weights for policy 0, policy_version 467970 (0.0011) [2023-12-27 22:36:12,619][106226] Updated weights for policy 0, policy_version 467980 (0.0010) [2023-12-27 22:36:12,631][106225] Updated weights for policy 1, policy_version 469367 (0.0008) [2023-12-27 22:36:12,675][106226] Updated weights for policy 0, policy_version 467990 (0.0006) [2023-12-27 22:36:12,693][106225] Updated weights for policy 1, policy_version 469377 (0.0008) [2023-12-27 22:36:12,732][106226] Updated weights for policy 0, policy_version 468000 (0.0005) [2023-12-27 22:36:12,744][106225] Updated weights for policy 1, policy_version 469387 (0.0008) [2023-12-27 22:36:13,406][106226] Updated weights for policy 0, policy_version 468010 (0.0008) [2023-12-27 22:36:13,412][106225] Updated weights for policy 1, policy_version 469397 (0.0008) [2023-12-27 22:36:13,464][106226] Updated weights for policy 0, policy_version 468020 (0.0006) [2023-12-27 22:36:13,466][106225] Updated weights for policy 1, policy_version 469407 (0.0006) [2023-12-27 22:36:13,521][106225] Updated weights for policy 1, policy_version 469417 (0.0006) [2023-12-27 22:36:13,523][106226] Updated weights for policy 0, policy_version 468030 (0.0006) [2023-12-27 22:36:13,589][106226] Updated weights for policy 0, policy_version 468040 (0.0007) [2023-12-27 22:36:14,144][106225] Updated weights for policy 1, policy_version 469427 (0.0007) [2023-12-27 22:36:14,194][106225] Updated weights for policy 1, policy_version 469437 (0.0007) [2023-12-27 22:36:14,207][106226] Updated weights for policy 0, policy_version 468050 (0.0006) [2023-12-27 22:36:14,247][106225] Updated weights for policy 1, policy_version 469447 (0.0007) [2023-12-27 22:36:14,260][106226] Updated weights for policy 0, policy_version 468060 (0.0011) [2023-12-27 22:36:14,306][106226] Updated weights for policy 0, policy_version 468070 (0.0010) [2023-12-27 22:36:14,888][106225] Updated weights for policy 1, policy_version 469457 (0.0006) [2023-12-27 22:36:14,951][106225] Updated weights for policy 1, policy_version 469467 (0.0007) [2023-12-27 22:36:15,016][106225] Updated weights for policy 1, policy_version 469477 (0.0007) [2023-12-27 22:36:15,020][106226] Updated weights for policy 0, policy_version 468080 (0.0011) [2023-12-27 22:36:15,076][106225] Updated weights for policy 1, policy_version 469487 (0.0007) [2023-12-27 22:36:15,082][106226] Updated weights for policy 0, policy_version 468090 (0.0010) [2023-12-27 22:36:15,144][106226] Updated weights for policy 0, policy_version 468100 (0.0011) [2023-12-27 22:36:15,790][106225] Updated weights for policy 1, policy_version 469497 (0.0005) [2023-12-27 22:36:15,849][106226] Updated weights for policy 0, policy_version 468110 (0.0011) [2023-12-27 22:36:15,853][106225] Updated weights for policy 1, policy_version 469507 (0.0005) [2023-12-27 22:36:15,896][106226] Updated weights for policy 0, policy_version 468120 (0.0010) [2023-12-27 22:36:15,920][106225] Updated weights for policy 1, policy_version 469517 (0.0005) [2023-12-27 22:36:15,949][106226] Updated weights for policy 0, policy_version 468130 (0.0011) [2023-12-27 22:36:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 240099328. Throughput: 0: 9822.2, 1: 9867.5. Samples: 240085848. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:16,175][105115] Avg episode reward: [(0, '-5.116'), (1, '-5.662')] [2023-12-27 22:36:16,457][106225] Updated weights for policy 1, policy_version 469527 (0.0007) [2023-12-27 22:36:16,515][106225] Updated weights for policy 1, policy_version 469537 (0.0007) [2023-12-27 22:36:16,581][106225] Updated weights for policy 1, policy_version 469547 (0.0007) [2023-12-27 22:36:16,685][106226] Updated weights for policy 0, policy_version 468140 (0.0008) [2023-12-27 22:36:16,753][106226] Updated weights for policy 0, policy_version 468150 (0.0005) [2023-12-27 22:36:16,812][106226] Updated weights for policy 0, policy_version 468160 (0.0005) [2023-12-27 22:36:17,306][106225] Updated weights for policy 1, policy_version 469557 (0.0008) [2023-12-27 22:36:17,354][106225] Updated weights for policy 1, policy_version 469567 (0.0008) [2023-12-27 22:36:17,399][106225] Updated weights for policy 1, policy_version 469577 (0.0008) [2023-12-27 22:36:17,439][106226] Updated weights for policy 0, policy_version 468170 (0.0006) [2023-12-27 22:36:17,498][106226] Updated weights for policy 0, policy_version 468180 (0.0008) [2023-12-27 22:36:17,558][106226] Updated weights for policy 0, policy_version 468190 (0.0009) [2023-12-27 22:36:17,608][106226] Updated weights for policy 0, policy_version 468200 (0.0009) [2023-12-27 22:36:18,099][106225] Updated weights for policy 1, policy_version 469587 (0.0009) [2023-12-27 22:36:18,169][106225] Updated weights for policy 1, policy_version 469597 (0.0008) [2023-12-27 22:36:18,226][106225] Updated weights for policy 1, policy_version 469607 (0.0006) [2023-12-27 22:36:18,341][106226] Updated weights for policy 0, policy_version 468210 (0.0009) [2023-12-27 22:36:18,418][106226] Updated weights for policy 0, policy_version 468220 (0.0009) [2023-12-27 22:36:18,479][106226] Updated weights for policy 0, policy_version 468230 (0.0009) [2023-12-27 22:36:18,910][106225] Updated weights for policy 1, policy_version 469617 (0.0006) [2023-12-27 22:36:18,972][106225] Updated weights for policy 1, policy_version 469627 (0.0009) [2023-12-27 22:36:19,019][106225] Updated weights for policy 1, policy_version 469637 (0.0008) [2023-12-27 22:36:19,068][106225] Updated weights for policy 1, policy_version 469647 (0.0008) [2023-12-27 22:36:19,211][106226] Updated weights for policy 0, policy_version 468240 (0.0008) [2023-12-27 22:36:19,287][106226] Updated weights for policy 0, policy_version 468250 (0.0009) [2023-12-27 22:36:19,360][106226] Updated weights for policy 0, policy_version 468260 (0.0009) [2023-12-27 22:36:19,838][106225] Updated weights for policy 1, policy_version 469657 (0.0009) [2023-12-27 22:36:19,903][106225] Updated weights for policy 1, policy_version 469667 (0.0008) [2023-12-27 22:36:19,972][106225] Updated weights for policy 1, policy_version 469677 (0.0008) [2023-12-27 22:36:20,133][106226] Updated weights for policy 0, policy_version 468270 (0.0009) [2023-12-27 22:36:20,196][106226] Updated weights for policy 0, policy_version 468280 (0.0008) [2023-12-27 22:36:20,263][106226] Updated weights for policy 0, policy_version 468290 (0.0009) [2023-12-27 22:36:20,730][106225] Updated weights for policy 1, policy_version 469687 (0.0009) [2023-12-27 22:36:20,787][106225] Updated weights for policy 1, policy_version 469697 (0.0008) [2023-12-27 22:36:20,844][106225] Updated weights for policy 1, policy_version 469707 (0.0009) [2023-12-27 22:36:20,978][106226] Updated weights for policy 0, policy_version 468300 (0.0010) [2023-12-27 22:36:21,042][106226] Updated weights for policy 0, policy_version 468310 (0.0007) [2023-12-27 22:36:21,111][106226] Updated weights for policy 0, policy_version 468320 (0.0008) [2023-12-27 22:36:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 240197632. Throughput: 0: 9738.9, 1: 9815.9. Samples: 240202388. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:21,175][105115] Avg episode reward: [(0, '-5.137'), (1, '-5.466')] [2023-12-27 22:36:21,755][106225] Updated weights for policy 1, policy_version 469717 (0.0008) [2023-12-27 22:36:21,818][106225] Updated weights for policy 1, policy_version 469727 (0.0008) [2023-12-27 22:36:21,866][106225] Updated weights for policy 1, policy_version 469737 (0.0008) [2023-12-27 22:36:21,886][106226] Updated weights for policy 0, policy_version 468330 (0.0008) [2023-12-27 22:36:21,942][106226] Updated weights for policy 0, policy_version 468340 (0.0008) [2023-12-27 22:36:22,000][106226] Updated weights for policy 0, policy_version 468350 (0.0008) [2023-12-27 22:36:22,053][106226] Updated weights for policy 0, policy_version 468360 (0.0008) [2023-12-27 22:36:22,560][106225] Updated weights for policy 1, policy_version 469747 (0.0008) [2023-12-27 22:36:22,619][106225] Updated weights for policy 1, policy_version 469757 (0.0009) [2023-12-27 22:36:22,680][106225] Updated weights for policy 1, policy_version 469767 (0.0007) [2023-12-27 22:36:22,821][106226] Updated weights for policy 0, policy_version 468370 (0.0009) [2023-12-27 22:36:22,889][106226] Updated weights for policy 0, policy_version 468380 (0.0008) [2023-12-27 22:36:22,940][106226] Updated weights for policy 0, policy_version 468390 (0.0009) [2023-12-27 22:36:23,408][106225] Updated weights for policy 1, policy_version 469777 (0.0009) [2023-12-27 22:36:23,466][106225] Updated weights for policy 1, policy_version 469787 (0.0009) [2023-12-27 22:36:23,529][106225] Updated weights for policy 1, policy_version 469797 (0.0009) [2023-12-27 22:36:23,593][106225] Updated weights for policy 1, policy_version 469807 (0.0009) [2023-12-27 22:36:23,722][106226] Updated weights for policy 0, policy_version 468400 (0.0008) [2023-12-27 22:36:23,791][106226] Updated weights for policy 0, policy_version 468410 (0.0009) [2023-12-27 22:36:23,854][106226] Updated weights for policy 0, policy_version 468420 (0.0008) [2023-12-27 22:36:24,324][106225] Updated weights for policy 1, policy_version 469817 (0.0009) [2023-12-27 22:36:24,369][106225] Updated weights for policy 1, policy_version 469827 (0.0008) [2023-12-27 22:36:24,428][106225] Updated weights for policy 1, policy_version 469837 (0.0009) [2023-12-27 22:36:24,568][106226] Updated weights for policy 0, policy_version 468430 (0.0008) [2023-12-27 22:36:24,617][106226] Updated weights for policy 0, policy_version 468440 (0.0009) [2023-12-27 22:36:24,672][106226] Updated weights for policy 0, policy_version 468450 (0.0009) [2023-12-27 22:36:25,179][106225] Updated weights for policy 1, policy_version 469847 (0.0009) [2023-12-27 22:36:25,230][106225] Updated weights for policy 1, policy_version 469857 (0.0008) [2023-12-27 22:36:25,275][106225] Updated weights for policy 1, policy_version 469867 (0.0009) [2023-12-27 22:36:25,415][106226] Updated weights for policy 0, policy_version 468460 (0.0009) [2023-12-27 22:36:25,473][106226] Updated weights for policy 0, policy_version 468470 (0.0009) [2023-12-27 22:36:25,526][106226] Updated weights for policy 0, policy_version 468480 (0.0008) [2023-12-27 22:36:26,003][106225] Updated weights for policy 1, policy_version 469877 (0.0008) [2023-12-27 22:36:26,062][106225] Updated weights for policy 1, policy_version 469887 (0.0008) [2023-12-27 22:36:26,117][106225] Updated weights for policy 1, policy_version 469897 (0.0008) [2023-12-27 22:36:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 240287744. Throughput: 0: 9634.4, 1: 9781.8. Samples: 240256688. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:26,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-5.557')] [2023-12-27 22:36:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000469904_120324096.pth... [2023-12-27 22:36:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000468488_119963648.pth... [2023-12-27 22:36:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000467368_119676928.pth [2023-12-27 22:36:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000468752_120029184.pth [2023-12-27 22:36:26,243][106226] Updated weights for policy 0, policy_version 468490 (0.0009) [2023-12-27 22:36:26,298][106226] Updated weights for policy 0, policy_version 468500 (0.0009) [2023-12-27 22:36:26,346][106226] Updated weights for policy 0, policy_version 468510 (0.0008) [2023-12-27 22:36:26,396][106226] Updated weights for policy 0, policy_version 468520 (0.0008) [2023-12-27 22:36:26,745][106225] Updated weights for policy 1, policy_version 469907 (0.0009) [2023-12-27 22:36:26,805][106225] Updated weights for policy 1, policy_version 469917 (0.0008) [2023-12-27 22:36:26,862][106225] Updated weights for policy 1, policy_version 469927 (0.0008) [2023-12-27 22:36:27,177][106226] Updated weights for policy 0, policy_version 468530 (0.0009) [2023-12-27 22:36:27,238][106226] Updated weights for policy 0, policy_version 468540 (0.0009) [2023-12-27 22:36:27,293][106226] Updated weights for policy 0, policy_version 468550 (0.0010) [2023-12-27 22:36:27,562][106225] Updated weights for policy 1, policy_version 469937 (0.0008) [2023-12-27 22:36:27,617][106225] Updated weights for policy 1, policy_version 469947 (0.0008) [2023-12-27 22:36:27,664][106225] Updated weights for policy 1, policy_version 469957 (0.0009) [2023-12-27 22:36:27,715][106225] Updated weights for policy 1, policy_version 469967 (0.0009) [2023-12-27 22:36:27,965][106226] Updated weights for policy 0, policy_version 468560 (0.0008) [2023-12-27 22:36:28,028][106226] Updated weights for policy 0, policy_version 468570 (0.0009) [2023-12-27 22:36:28,084][106226] Updated weights for policy 0, policy_version 468580 (0.0008) [2023-12-27 22:36:28,464][106225] Updated weights for policy 1, policy_version 469977 (0.0008) [2023-12-27 22:36:28,524][106225] Updated weights for policy 1, policy_version 469987 (0.0007) [2023-12-27 22:36:28,578][106225] Updated weights for policy 1, policy_version 469997 (0.0007) [2023-12-27 22:36:28,841][106226] Updated weights for policy 0, policy_version 468590 (0.0008) [2023-12-27 22:36:28,891][106226] Updated weights for policy 0, policy_version 468600 (0.0009) [2023-12-27 22:36:28,941][106226] Updated weights for policy 0, policy_version 468610 (0.0009) [2023-12-27 22:36:29,259][106225] Updated weights for policy 1, policy_version 470007 (0.0008) [2023-12-27 22:36:29,318][106225] Updated weights for policy 1, policy_version 470017 (0.0005) [2023-12-27 22:36:29,387][106225] Updated weights for policy 1, policy_version 470027 (0.0008) [2023-12-27 22:36:29,650][106226] Updated weights for policy 0, policy_version 468620 (0.0007) [2023-12-27 22:36:29,707][106226] Updated weights for policy 0, policy_version 468630 (0.0007) [2023-12-27 22:36:29,768][106226] Updated weights for policy 0, policy_version 468640 (0.0008) [2023-12-27 22:36:30,134][106225] Updated weights for policy 1, policy_version 470037 (0.0009) [2023-12-27 22:36:30,183][106225] Updated weights for policy 1, policy_version 470047 (0.0009) [2023-12-27 22:36:30,238][106225] Updated weights for policy 1, policy_version 470057 (0.0008) [2023-12-27 22:36:30,486][106226] Updated weights for policy 0, policy_version 468650 (0.0008) [2023-12-27 22:36:30,533][106226] Updated weights for policy 0, policy_version 468660 (0.0008) [2023-12-27 22:36:30,583][106226] Updated weights for policy 0, policy_version 468670 (0.0010) [2023-12-27 22:36:30,647][106226] Updated weights for policy 0, policy_version 468680 (0.0011) [2023-12-27 22:36:30,988][106225] Updated weights for policy 1, policy_version 470067 (0.0008) [2023-12-27 22:36:31,056][106225] Updated weights for policy 1, policy_version 470077 (0.0008) [2023-12-27 22:36:31,123][106225] Updated weights for policy 1, policy_version 470087 (0.0008) [2023-12-27 22:36:31,175][105115] Fps is (10 sec: 18022.1, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 240377856. Throughput: 0: 9626.1, 1: 9805.8. Samples: 240373832. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:31,175][105115] Avg episode reward: [(0, '-5.058'), (1, '-5.698')] [2023-12-27 22:36:31,380][106226] Updated weights for policy 0, policy_version 468690 (0.0010) [2023-12-27 22:36:31,437][106226] Updated weights for policy 0, policy_version 468700 (0.0011) [2023-12-27 22:36:31,498][106226] Updated weights for policy 0, policy_version 468710 (0.0010) [2023-12-27 22:36:31,911][106225] Updated weights for policy 1, policy_version 470097 (0.0009) [2023-12-27 22:36:31,981][106225] Updated weights for policy 1, policy_version 470107 (0.0010) [2023-12-27 22:36:32,041][106225] Updated weights for policy 1, policy_version 470117 (0.0010) [2023-12-27 22:36:32,100][106225] Updated weights for policy 1, policy_version 470127 (0.0010) [2023-12-27 22:36:32,194][106226] Updated weights for policy 0, policy_version 468720 (0.0010) [2023-12-27 22:36:32,252][106226] Updated weights for policy 0, policy_version 468730 (0.0011) [2023-12-27 22:36:32,318][106226] Updated weights for policy 0, policy_version 468740 (0.0011) [2023-12-27 22:36:32,781][106225] Updated weights for policy 1, policy_version 470137 (0.0010) [2023-12-27 22:36:32,831][106225] Updated weights for policy 1, policy_version 470147 (0.0010) [2023-12-27 22:36:32,894][106225] Updated weights for policy 1, policy_version 470157 (0.0010) [2023-12-27 22:36:32,979][106226] Updated weights for policy 0, policy_version 468750 (0.0007) [2023-12-27 22:36:33,036][106226] Updated weights for policy 0, policy_version 468760 (0.0006) [2023-12-27 22:36:33,093][106226] Updated weights for policy 0, policy_version 468770 (0.0010) [2023-12-27 22:36:33,604][106225] Updated weights for policy 1, policy_version 470167 (0.0007) [2023-12-27 22:36:33,664][106225] Updated weights for policy 1, policy_version 470177 (0.0006) [2023-12-27 22:36:33,729][106225] Updated weights for policy 1, policy_version 470187 (0.0006) [2023-12-27 22:36:33,735][106226] Updated weights for policy 0, policy_version 468780 (0.0011) [2023-12-27 22:36:33,793][106226] Updated weights for policy 0, policy_version 468790 (0.0010) [2023-12-27 22:36:33,852][106226] Updated weights for policy 0, policy_version 468800 (0.0010) [2023-12-27 22:36:34,262][106225] Updated weights for policy 1, policy_version 470197 (0.0008) [2023-12-27 22:36:34,318][106225] Updated weights for policy 1, policy_version 470207 (0.0010) [2023-12-27 22:36:34,376][106225] Updated weights for policy 1, policy_version 470217 (0.0010) [2023-12-27 22:36:34,570][106226] Updated weights for policy 0, policy_version 468810 (0.0010) [2023-12-27 22:36:34,628][106226] Updated weights for policy 0, policy_version 468820 (0.0010) [2023-12-27 22:36:34,685][106226] Updated weights for policy 0, policy_version 468830 (0.0011) [2023-12-27 22:36:34,735][106226] Updated weights for policy 0, policy_version 468840 (0.0010) [2023-12-27 22:36:35,066][106225] Updated weights for policy 1, policy_version 470227 (0.0009) [2023-12-27 22:36:35,124][106225] Updated weights for policy 1, policy_version 470237 (0.0005) [2023-12-27 22:36:35,181][106225] Updated weights for policy 1, policy_version 470247 (0.0005) [2023-12-27 22:36:35,441][106226] Updated weights for policy 0, policy_version 468850 (0.0011) [2023-12-27 22:36:35,517][106226] Updated weights for policy 0, policy_version 468860 (0.0010) [2023-12-27 22:36:35,584][106226] Updated weights for policy 0, policy_version 468870 (0.0011) [2023-12-27 22:36:35,711][106225] Updated weights for policy 1, policy_version 470257 (0.0005) [2023-12-27 22:36:35,770][106225] Updated weights for policy 1, policy_version 470267 (0.0005) [2023-12-27 22:36:35,829][106225] Updated weights for policy 1, policy_version 470277 (0.0005) [2023-12-27 22:36:35,878][106225] Updated weights for policy 1, policy_version 470287 (0.0005) [2023-12-27 22:36:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 240484352. Throughput: 0: 9666.9, 1: 9862.6. Samples: 240494956. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:36,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.927')] [2023-12-27 22:36:36,285][106226] Updated weights for policy 0, policy_version 468880 (0.0011) [2023-12-27 22:36:36,350][106226] Updated weights for policy 0, policy_version 468890 (0.0011) [2023-12-27 22:36:36,411][106226] Updated weights for policy 0, policy_version 468900 (0.0011) [2023-12-27 22:36:36,480][106225] Updated weights for policy 1, policy_version 470297 (0.0008) [2023-12-27 22:36:36,544][106225] Updated weights for policy 1, policy_version 470307 (0.0008) [2023-12-27 22:36:36,614][106225] Updated weights for policy 1, policy_version 470317 (0.0008) [2023-12-27 22:36:37,117][106226] Updated weights for policy 0, policy_version 468910 (0.0011) [2023-12-27 22:36:37,174][106226] Updated weights for policy 0, policy_version 468920 (0.0010) [2023-12-27 22:36:37,238][106226] Updated weights for policy 0, policy_version 468930 (0.0011) [2023-12-27 22:36:37,252][106225] Updated weights for policy 1, policy_version 470327 (0.0006) [2023-12-27 22:36:37,311][106225] Updated weights for policy 1, policy_version 470337 (0.0008) [2023-12-27 22:36:37,363][106225] Updated weights for policy 1, policy_version 470347 (0.0008) [2023-12-27 22:36:37,919][106226] Updated weights for policy 0, policy_version 468940 (0.0009) [2023-12-27 22:36:37,981][106226] Updated weights for policy 0, policy_version 468950 (0.0006) [2023-12-27 22:36:38,035][106226] Updated weights for policy 0, policy_version 468960 (0.0009) [2023-12-27 22:36:38,118][106225] Updated weights for policy 1, policy_version 470357 (0.0009) [2023-12-27 22:36:38,168][106225] Updated weights for policy 1, policy_version 470367 (0.0010) [2023-12-27 22:36:38,228][106225] Updated weights for policy 1, policy_version 470377 (0.0010) [2023-12-27 22:36:38,775][106226] Updated weights for policy 0, policy_version 468970 (0.0009) [2023-12-27 22:36:38,840][106226] Updated weights for policy 0, policy_version 468980 (0.0008) [2023-12-27 22:36:38,903][106226] Updated weights for policy 0, policy_version 468990 (0.0006) [2023-12-27 22:36:38,958][106225] Updated weights for policy 1, policy_version 470387 (0.0010) [2023-12-27 22:36:38,969][106226] Updated weights for policy 0, policy_version 469000 (0.0005) [2023-12-27 22:36:39,005][106225] Updated weights for policy 1, policy_version 470397 (0.0010) [2023-12-27 22:36:39,064][106225] Updated weights for policy 1, policy_version 470407 (0.0010) [2023-12-27 22:36:39,628][106226] Updated weights for policy 0, policy_version 469010 (0.0008) [2023-12-27 22:36:39,689][106226] Updated weights for policy 0, policy_version 469020 (0.0008) [2023-12-27 22:36:39,750][106226] Updated weights for policy 0, policy_version 469030 (0.0008) [2023-12-27 22:36:39,828][106225] Updated weights for policy 1, policy_version 470417 (0.0010) [2023-12-27 22:36:39,893][106225] Updated weights for policy 1, policy_version 470427 (0.0009) [2023-12-27 22:36:39,964][106225] Updated weights for policy 1, policy_version 470437 (0.0009) [2023-12-27 22:36:40,023][106225] Updated weights for policy 1, policy_version 470447 (0.0011) [2023-12-27 22:36:40,444][106226] Updated weights for policy 0, policy_version 469040 (0.0006) [2023-12-27 22:36:40,494][106226] Updated weights for policy 0, policy_version 469050 (0.0005) [2023-12-27 22:36:40,546][106226] Updated weights for policy 0, policy_version 469060 (0.0008) [2023-12-27 22:36:40,764][106225] Updated weights for policy 1, policy_version 470457 (0.0009) [2023-12-27 22:36:40,831][106225] Updated weights for policy 1, policy_version 470467 (0.0010) [2023-12-27 22:36:40,878][106225] Updated weights for policy 1, policy_version 470477 (0.0010) [2023-12-27 22:36:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 240582656. Throughput: 0: 9704.6, 1: 9883.0. Samples: 240554360. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:41,175][105115] Avg episode reward: [(0, '-5.148'), (1, '-5.546')] [2023-12-27 22:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000470480_120471552.pth... [2023-12-27 22:36:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000469064_120111104.pth... [2023-12-27 22:36:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000469328_120176640.pth [2023-12-27 22:36:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000467944_119824384.pth [2023-12-27 22:36:41,233][106226] Updated weights for policy 0, policy_version 469070 (0.0007) [2023-12-27 22:36:41,306][106226] Updated weights for policy 0, policy_version 469080 (0.0006) [2023-12-27 22:36:41,382][106226] Updated weights for policy 0, policy_version 469090 (0.0008) [2023-12-27 22:36:41,654][106225] Updated weights for policy 1, policy_version 470487 (0.0009) [2023-12-27 22:36:41,723][106225] Updated weights for policy 1, policy_version 470497 (0.0008) [2023-12-27 22:36:41,782][106225] Updated weights for policy 1, policy_version 470507 (0.0009) [2023-12-27 22:36:42,078][106226] Updated weights for policy 0, policy_version 469100 (0.0007) [2023-12-27 22:36:42,143][106226] Updated weights for policy 0, policy_version 469110 (0.0007) [2023-12-27 22:36:42,203][106226] Updated weights for policy 0, policy_version 469120 (0.0009) [2023-12-27 22:36:42,559][106225] Updated weights for policy 1, policy_version 470517 (0.0009) [2023-12-27 22:36:42,610][106225] Updated weights for policy 1, policy_version 470527 (0.0006) [2023-12-27 22:36:42,668][106225] Updated weights for policy 1, policy_version 470537 (0.0005) [2023-12-27 22:36:42,925][106226] Updated weights for policy 0, policy_version 469130 (0.0009) [2023-12-27 22:36:42,988][106226] Updated weights for policy 0, policy_version 469140 (0.0008) [2023-12-27 22:36:43,041][106226] Updated weights for policy 0, policy_version 469150 (0.0009) [2023-12-27 22:36:43,096][106226] Updated weights for policy 0, policy_version 469160 (0.0008) [2023-12-27 22:36:43,358][106225] Updated weights for policy 1, policy_version 470547 (0.0008) [2023-12-27 22:36:43,415][106225] Updated weights for policy 1, policy_version 470557 (0.0010) [2023-12-27 22:36:43,475][106225] Updated weights for policy 1, policy_version 470567 (0.0010) [2023-12-27 22:36:43,837][106226] Updated weights for policy 0, policy_version 469170 (0.0007) [2023-12-27 22:36:43,891][106226] Updated weights for policy 0, policy_version 469180 (0.0007) [2023-12-27 22:36:43,941][106226] Updated weights for policy 0, policy_version 469190 (0.0008) [2023-12-27 22:36:44,174][106225] Updated weights for policy 1, policy_version 470577 (0.0010) [2023-12-27 22:36:44,228][106225] Updated weights for policy 1, policy_version 470587 (0.0005) [2023-12-27 22:36:44,285][106225] Updated weights for policy 1, policy_version 470597 (0.0005) [2023-12-27 22:36:44,345][106225] Updated weights for policy 1, policy_version 470607 (0.0005) [2023-12-27 22:36:44,736][106226] Updated weights for policy 0, policy_version 469200 (0.0008) [2023-12-27 22:36:44,811][106226] Updated weights for policy 0, policy_version 469210 (0.0008) [2023-12-27 22:36:44,881][106226] Updated weights for policy 0, policy_version 469220 (0.0006) [2023-12-27 22:36:44,943][106225] Updated weights for policy 1, policy_version 470617 (0.0007) [2023-12-27 22:36:45,011][106225] Updated weights for policy 1, policy_version 470627 (0.0009) [2023-12-27 22:36:45,080][106225] Updated weights for policy 1, policy_version 470637 (0.0010) [2023-12-27 22:36:45,556][106226] Updated weights for policy 0, policy_version 469230 (0.0009) [2023-12-27 22:36:45,618][106226] Updated weights for policy 0, policy_version 469240 (0.0008) [2023-12-27 22:36:45,673][106226] Updated weights for policy 0, policy_version 469250 (0.0009) [2023-12-27 22:36:45,766][106225] Updated weights for policy 1, policy_version 470647 (0.0006) [2023-12-27 22:36:45,826][106225] Updated weights for policy 1, policy_version 470657 (0.0005) [2023-12-27 22:36:45,891][106225] Updated weights for policy 1, policy_version 470667 (0.0005) [2023-12-27 22:36:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 240680960. Throughput: 0: 9691.8, 1: 9865.3. Samples: 240670416. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:46,175][105115] Avg episode reward: [(0, '-5.071'), (1, '-5.754')] [2023-12-27 22:36:46,351][106226] Updated weights for policy 0, policy_version 469260 (0.0007) [2023-12-27 22:36:46,399][106226] Updated weights for policy 0, policy_version 469270 (0.0008) [2023-12-27 22:36:46,460][106226] Updated weights for policy 0, policy_version 469280 (0.0008) [2023-12-27 22:36:46,470][106225] Updated weights for policy 1, policy_version 470677 (0.0007) [2023-12-27 22:36:46,523][106225] Updated weights for policy 1, policy_version 470687 (0.0008) [2023-12-27 22:36:46,578][106225] Updated weights for policy 1, policy_version 470697 (0.0008) [2023-12-27 22:36:47,066][106226] Updated weights for policy 0, policy_version 469290 (0.0007) [2023-12-27 22:36:47,115][106226] Updated weights for policy 0, policy_version 469300 (0.0005) [2023-12-27 22:36:47,173][106226] Updated weights for policy 0, policy_version 469310 (0.0005) [2023-12-27 22:36:47,240][106226] Updated weights for policy 0, policy_version 469320 (0.0011) [2023-12-27 22:36:47,373][106225] Updated weights for policy 1, policy_version 470707 (0.0008) [2023-12-27 22:36:47,430][106225] Updated weights for policy 1, policy_version 470717 (0.0009) [2023-12-27 22:36:47,485][106225] Updated weights for policy 1, policy_version 470727 (0.0008) [2023-12-27 22:36:47,902][106226] Updated weights for policy 0, policy_version 469330 (0.0011) [2023-12-27 22:36:47,962][106226] Updated weights for policy 0, policy_version 469340 (0.0011) [2023-12-27 22:36:48,014][106226] Updated weights for policy 0, policy_version 469350 (0.0011) [2023-12-27 22:36:48,186][106225] Updated weights for policy 1, policy_version 470737 (0.0008) [2023-12-27 22:36:48,239][106225] Updated weights for policy 1, policy_version 470747 (0.0010) [2023-12-27 22:36:48,295][106225] Updated weights for policy 1, policy_version 470757 (0.0010) [2023-12-27 22:36:48,358][106225] Updated weights for policy 1, policy_version 470767 (0.0009) [2023-12-27 22:36:48,729][106226] Updated weights for policy 0, policy_version 469360 (0.0009) [2023-12-27 22:36:48,796][106226] Updated weights for policy 0, policy_version 469370 (0.0005) [2023-12-27 22:36:48,857][106226] Updated weights for policy 0, policy_version 469380 (0.0010) [2023-12-27 22:36:49,096][106225] Updated weights for policy 1, policy_version 470777 (0.0010) [2023-12-27 22:36:49,152][106225] Updated weights for policy 1, policy_version 470787 (0.0010) [2023-12-27 22:36:49,210][106225] Updated weights for policy 1, policy_version 470797 (0.0010) [2023-12-27 22:36:49,475][106226] Updated weights for policy 0, policy_version 469390 (0.0008) [2023-12-27 22:36:49,538][106226] Updated weights for policy 0, policy_version 469400 (0.0009) [2023-12-27 22:36:49,596][106226] Updated weights for policy 0, policy_version 469410 (0.0009) [2023-12-27 22:36:49,996][106225] Updated weights for policy 1, policy_version 470807 (0.0008) [2023-12-27 22:36:50,049][106225] Updated weights for policy 1, policy_version 470817 (0.0008) [2023-12-27 22:36:50,099][106225] Updated weights for policy 1, policy_version 470827 (0.0007) [2023-12-27 22:36:50,363][106226] Updated weights for policy 0, policy_version 469420 (0.0008) [2023-12-27 22:36:50,420][106226] Updated weights for policy 0, policy_version 469430 (0.0008) [2023-12-27 22:36:50,476][106226] Updated weights for policy 0, policy_version 469440 (0.0008) [2023-12-27 22:36:50,767][106225] Updated weights for policy 1, policy_version 470837 (0.0008) [2023-12-27 22:36:50,818][106225] Updated weights for policy 1, policy_version 470847 (0.0009) [2023-12-27 22:36:50,871][106225] Updated weights for policy 1, policy_version 470857 (0.0010) [2023-12-27 22:36:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 240779264. Throughput: 0: 9714.7, 1: 9832.6. Samples: 240790212. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:51,175][105115] Avg episode reward: [(0, '-5.211'), (1, '-5.651')] [2023-12-27 22:36:51,206][106226] Updated weights for policy 0, policy_version 469450 (0.0009) [2023-12-27 22:36:51,261][106226] Updated weights for policy 0, policy_version 469460 (0.0008) [2023-12-27 22:36:51,323][106226] Updated weights for policy 0, policy_version 469470 (0.0010) [2023-12-27 22:36:51,391][106226] Updated weights for policy 0, policy_version 469480 (0.0011) [2023-12-27 22:36:51,666][106225] Updated weights for policy 1, policy_version 470867 (0.0009) [2023-12-27 22:36:51,740][106225] Updated weights for policy 1, policy_version 470877 (0.0009) [2023-12-27 22:36:51,799][106225] Updated weights for policy 1, policy_version 470887 (0.0006) [2023-12-27 22:36:52,190][106226] Updated weights for policy 0, policy_version 469490 (0.0009) [2023-12-27 22:36:52,246][106226] Updated weights for policy 0, policy_version 469500 (0.0008) [2023-12-27 22:36:52,315][106226] Updated weights for policy 0, policy_version 469510 (0.0009) [2023-12-27 22:36:52,525][106225] Updated weights for policy 1, policy_version 470897 (0.0008) [2023-12-27 22:36:52,588][106225] Updated weights for policy 1, policy_version 470907 (0.0009) [2023-12-27 22:36:52,659][106225] Updated weights for policy 1, policy_version 470917 (0.0010) [2023-12-27 22:36:52,720][106225] Updated weights for policy 1, policy_version 470927 (0.0009) [2023-12-27 22:36:52,968][106226] Updated weights for policy 0, policy_version 469520 (0.0008) [2023-12-27 22:36:53,018][106226] Updated weights for policy 0, policy_version 469530 (0.0006) [2023-12-27 22:36:53,069][106226] Updated weights for policy 0, policy_version 469540 (0.0005) [2023-12-27 22:36:53,360][106225] Updated weights for policy 1, policy_version 470937 (0.0006) [2023-12-27 22:36:53,415][106225] Updated weights for policy 1, policy_version 470947 (0.0005) [2023-12-27 22:36:53,464][106225] Updated weights for policy 1, policy_version 470957 (0.0009) [2023-12-27 22:36:53,822][106226] Updated weights for policy 0, policy_version 469550 (0.0008) [2023-12-27 22:36:53,879][106226] Updated weights for policy 0, policy_version 469560 (0.0009) [2023-12-27 22:36:53,931][106226] Updated weights for policy 0, policy_version 469570 (0.0008) [2023-12-27 22:36:54,148][106225] Updated weights for policy 1, policy_version 470967 (0.0008) [2023-12-27 22:36:54,207][106225] Updated weights for policy 1, policy_version 470977 (0.0008) [2023-12-27 22:36:54,271][106225] Updated weights for policy 1, policy_version 470987 (0.0008) [2023-12-27 22:36:54,689][106226] Updated weights for policy 0, policy_version 469580 (0.0009) [2023-12-27 22:36:54,744][106226] Updated weights for policy 0, policy_version 469590 (0.0008) [2023-12-27 22:36:54,792][106226] Updated weights for policy 0, policy_version 469600 (0.0008) [2023-12-27 22:36:55,005][106225] Updated weights for policy 1, policy_version 470997 (0.0009) [2023-12-27 22:36:55,064][106225] Updated weights for policy 1, policy_version 471007 (0.0009) [2023-12-27 22:36:55,120][106225] Updated weights for policy 1, policy_version 471017 (0.0008) [2023-12-27 22:36:55,525][106226] Updated weights for policy 0, policy_version 469610 (0.0008) [2023-12-27 22:36:55,571][106226] Updated weights for policy 0, policy_version 469620 (0.0007) [2023-12-27 22:36:55,617][106226] Updated weights for policy 0, policy_version 469630 (0.0005) [2023-12-27 22:36:55,668][106226] Updated weights for policy 0, policy_version 469640 (0.0005) [2023-12-27 22:36:55,897][106225] Updated weights for policy 1, policy_version 471027 (0.0009) [2023-12-27 22:36:55,954][106225] Updated weights for policy 1, policy_version 471037 (0.0008) [2023-12-27 22:36:56,009][106225] Updated weights for policy 1, policy_version 471047 (0.0008) [2023-12-27 22:36:56,175][105115] Fps is (10 sec: 19659.9, 60 sec: 19524.1, 300 sec: 19688.5). Total num frames: 240877568. Throughput: 0: 9706.5, 1: 9834.8. Samples: 240847552. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:36:56,176][105115] Avg episode reward: [(0, '-5.098'), (1, '-5.707')] [2023-12-27 22:36:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000469640_120258560.pth... [2023-12-27 22:36:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000471056_120619008.pth... [2023-12-27 22:36:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000468488_119963648.pth [2023-12-27 22:36:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000469904_120324096.pth [2023-12-27 22:36:56,311][106226] Updated weights for policy 0, policy_version 469650 (0.0006) [2023-12-27 22:36:56,365][106226] Updated weights for policy 0, policy_version 469660 (0.0007) [2023-12-27 22:36:56,424][106226] Updated weights for policy 0, policy_version 469670 (0.0010) [2023-12-27 22:36:56,625][106225] Updated weights for policy 1, policy_version 471057 (0.0007) [2023-12-27 22:36:56,681][106225] Updated weights for policy 1, policy_version 471067 (0.0005) [2023-12-27 22:36:56,726][106225] Updated weights for policy 1, policy_version 471077 (0.0006) [2023-12-27 22:36:56,776][106225] Updated weights for policy 1, policy_version 471087 (0.0006) [2023-12-27 22:36:57,110][106226] Updated weights for policy 0, policy_version 469680 (0.0006) [2023-12-27 22:36:57,172][106226] Updated weights for policy 0, policy_version 469690 (0.0005) [2023-12-27 22:36:57,237][106226] Updated weights for policy 0, policy_version 469700 (0.0005) [2023-12-27 22:36:57,311][106225] Updated weights for policy 1, policy_version 471097 (0.0006) [2023-12-27 22:36:57,363][106225] Updated weights for policy 1, policy_version 471107 (0.0010) [2023-12-27 22:36:57,419][106225] Updated weights for policy 1, policy_version 471117 (0.0010) [2023-12-27 22:36:57,868][106226] Updated weights for policy 0, policy_version 469710 (0.0008) [2023-12-27 22:36:57,930][106226] Updated weights for policy 0, policy_version 469720 (0.0010) [2023-12-27 22:36:57,989][106226] Updated weights for policy 0, policy_version 469730 (0.0010) [2023-12-27 22:36:58,083][106225] Updated weights for policy 1, policy_version 471127 (0.0010) [2023-12-27 22:36:58,133][106225] Updated weights for policy 1, policy_version 471137 (0.0010) [2023-12-27 22:36:58,182][106225] Updated weights for policy 1, policy_version 471147 (0.0010) [2023-12-27 22:36:58,773][106226] Updated weights for policy 0, policy_version 469740 (0.0009) [2023-12-27 22:36:58,840][106226] Updated weights for policy 0, policy_version 469750 (0.0009) [2023-12-27 22:36:58,911][106226] Updated weights for policy 0, policy_version 469760 (0.0008) [2023-12-27 22:36:58,996][106225] Updated weights for policy 1, policy_version 471157 (0.0009) [2023-12-27 22:36:59,058][106225] Updated weights for policy 1, policy_version 471167 (0.0010) [2023-12-27 22:36:59,121][106225] Updated weights for policy 1, policy_version 471177 (0.0010) [2023-12-27 22:36:59,734][106226] Updated weights for policy 0, policy_version 469770 (0.0007) [2023-12-27 22:36:59,792][106226] Updated weights for policy 0, policy_version 469780 (0.0007) [2023-12-27 22:36:59,856][106226] Updated weights for policy 0, policy_version 469790 (0.0007) [2023-12-27 22:36:59,894][106225] Updated weights for policy 1, policy_version 471187 (0.0010) [2023-12-27 22:36:59,919][106226] Updated weights for policy 0, policy_version 469800 (0.0006) [2023-12-27 22:36:59,958][106225] Updated weights for policy 1, policy_version 471197 (0.0010) [2023-12-27 22:37:00,027][106225] Updated weights for policy 1, policy_version 471207 (0.0006) [2023-12-27 22:37:00,615][106226] Updated weights for policy 0, policy_version 469810 (0.0010) [2023-12-27 22:37:00,651][106225] Updated weights for policy 1, policy_version 471217 (0.0005) [2023-12-27 22:37:00,674][106226] Updated weights for policy 0, policy_version 469821 (0.0009) [2023-12-27 22:37:00,700][106225] Updated weights for policy 1, policy_version 471227 (0.0005) [2023-12-27 22:37:00,726][106226] Updated weights for policy 0, policy_version 469831 (0.0008) [2023-12-27 22:37:00,756][106225] Updated weights for policy 1, policy_version 471237 (0.0007) [2023-12-27 22:37:00,799][106225] Updated weights for policy 1, policy_version 471247 (0.0008) [2023-12-27 22:37:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 240975872. Throughput: 0: 9724.9, 1: 9832.9. Samples: 240965948. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:37:01,175][105115] Avg episode reward: [(0, '-5.294'), (1, '-5.516')] [2023-12-27 22:37:01,444][106225] Updated weights for policy 1, policy_version 471257 (0.0008) [2023-12-27 22:37:01,482][106226] Updated weights for policy 0, policy_version 469841 (0.0007) [2023-12-27 22:37:01,499][106225] Updated weights for policy 1, policy_version 471267 (0.0008) [2023-12-27 22:37:01,538][106226] Updated weights for policy 0, policy_version 469851 (0.0006) [2023-12-27 22:37:01,553][106225] Updated weights for policy 1, policy_version 471277 (0.0008) [2023-12-27 22:37:01,598][106226] Updated weights for policy 0, policy_version 469861 (0.0007) [2023-12-27 22:37:02,218][106225] Updated weights for policy 1, policy_version 471287 (0.0008) [2023-12-27 22:37:02,280][106225] Updated weights for policy 1, policy_version 471297 (0.0009) [2023-12-27 22:37:02,336][106225] Updated weights for policy 1, policy_version 471307 (0.0008) [2023-12-27 22:37:02,376][106226] Updated weights for policy 0, policy_version 469871 (0.0009) [2023-12-27 22:37:02,440][106226] Updated weights for policy 0, policy_version 469881 (0.0005) [2023-12-27 22:37:02,498][106226] Updated weights for policy 0, policy_version 469891 (0.0007) [2023-12-27 22:37:03,101][106225] Updated weights for policy 1, policy_version 471317 (0.0008) [2023-12-27 22:37:03,159][106225] Updated weights for policy 1, policy_version 471327 (0.0008) [2023-12-27 22:37:03,212][106226] Updated weights for policy 0, policy_version 469901 (0.0009) [2023-12-27 22:37:03,215][106225] Updated weights for policy 1, policy_version 471337 (0.0006) [2023-12-27 22:37:03,269][106226] Updated weights for policy 0, policy_version 469911 (0.0008) [2023-12-27 22:37:03,334][106226] Updated weights for policy 0, policy_version 469921 (0.0010) [2023-12-27 22:37:03,780][106225] Updated weights for policy 1, policy_version 471347 (0.0007) [2023-12-27 22:37:03,870][106225] Updated weights for policy 1, policy_version 471357 (0.0007) [2023-12-27 22:37:03,934][106225] Updated weights for policy 1, policy_version 471367 (0.0007) [2023-12-27 22:37:03,988][106226] Updated weights for policy 0, policy_version 469931 (0.0008) [2023-12-27 22:37:04,045][106226] Updated weights for policy 0, policy_version 469941 (0.0009) [2023-12-27 22:37:04,108][106226] Updated weights for policy 0, policy_version 469951 (0.0008) [2023-12-27 22:37:04,587][106225] Updated weights for policy 1, policy_version 471377 (0.0010) [2023-12-27 22:37:04,649][106225] Updated weights for policy 1, policy_version 471387 (0.0005) [2023-12-27 22:37:04,708][106225] Updated weights for policy 1, policy_version 471397 (0.0006) [2023-12-27 22:37:04,769][106225] Updated weights for policy 1, policy_version 471407 (0.0008) [2023-12-27 22:37:04,847][106226] Updated weights for policy 0, policy_version 469961 (0.0008) [2023-12-27 22:37:04,907][106226] Updated weights for policy 0, policy_version 469971 (0.0005) [2023-12-27 22:37:04,961][106226] Updated weights for policy 0, policy_version 469981 (0.0006) [2023-12-27 22:37:05,019][106226] Updated weights for policy 0, policy_version 469991 (0.0006) [2023-12-27 22:37:05,383][106225] Updated weights for policy 1, policy_version 471417 (0.0008) [2023-12-27 22:37:05,440][106225] Updated weights for policy 1, policy_version 471427 (0.0008) [2023-12-27 22:37:05,488][106225] Updated weights for policy 1, policy_version 471437 (0.0008) [2023-12-27 22:37:05,602][106226] Updated weights for policy 0, policy_version 470001 (0.0009) [2023-12-27 22:37:05,651][106226] Updated weights for policy 0, policy_version 470011 (0.0009) [2023-12-27 22:37:05,700][106226] Updated weights for policy 0, policy_version 470021 (0.0008) [2023-12-27 22:37:06,159][106225] Updated weights for policy 1, policy_version 471447 (0.0009) [2023-12-27 22:37:06,175][105115] Fps is (10 sec: 19661.7, 60 sec: 19524.3, 300 sec: 19688.7). Total num frames: 241074176. Throughput: 0: 9760.3, 1: 9916.9. Samples: 241087864. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:37:06,175][105115] Avg episode reward: [(0, '-5.226'), (1, '-5.804')] [2023-12-27 22:37:06,220][106225] Updated weights for policy 1, policy_version 471457 (0.0008) [2023-12-27 22:37:06,273][106225] Updated weights for policy 1, policy_version 471467 (0.0007) [2023-12-27 22:37:06,426][106226] Updated weights for policy 0, policy_version 470031 (0.0008) [2023-12-27 22:37:06,493][106226] Updated weights for policy 0, policy_version 470041 (0.0009) [2023-12-27 22:37:06,558][106226] Updated weights for policy 0, policy_version 470051 (0.0009) [2023-12-27 22:37:07,035][106225] Updated weights for policy 1, policy_version 471477 (0.0008) [2023-12-27 22:37:07,088][106225] Updated weights for policy 1, policy_version 471487 (0.0009) [2023-12-27 22:37:07,142][106225] Updated weights for policy 1, policy_version 471497 (0.0009) [2023-12-27 22:37:07,193][106226] Updated weights for policy 0, policy_version 470061 (0.0008) [2023-12-27 22:37:07,254][106226] Updated weights for policy 0, policy_version 470071 (0.0009) [2023-12-27 22:37:07,310][106226] Updated weights for policy 0, policy_version 470081 (0.0008) [2023-12-27 22:37:07,873][106225] Updated weights for policy 1, policy_version 471507 (0.0007) [2023-12-27 22:37:07,918][106225] Updated weights for policy 1, policy_version 471517 (0.0008) [2023-12-27 22:37:07,965][106225] Updated weights for policy 1, policy_version 471527 (0.0008) [2023-12-27 22:37:08,044][106226] Updated weights for policy 0, policy_version 470091 (0.0009) [2023-12-27 22:37:08,103][106226] Updated weights for policy 0, policy_version 470101 (0.0009) [2023-12-27 22:37:08,160][106226] Updated weights for policy 0, policy_version 470111 (0.0009) [2023-12-27 22:37:08,686][106225] Updated weights for policy 1, policy_version 471537 (0.0008) [2023-12-27 22:37:08,749][106225] Updated weights for policy 1, policy_version 471547 (0.0009) [2023-12-27 22:37:08,816][106225] Updated weights for policy 1, policy_version 471557 (0.0008) [2023-12-27 22:37:08,881][106225] Updated weights for policy 1, policy_version 471567 (0.0009) [2023-12-27 22:37:08,895][106226] Updated weights for policy 0, policy_version 470121 (0.0009) [2023-12-27 22:37:08,943][106226] Updated weights for policy 0, policy_version 470131 (0.0008) [2023-12-27 22:37:09,001][106226] Updated weights for policy 0, policy_version 470141 (0.0008) [2023-12-27 22:37:09,062][106226] Updated weights for policy 0, policy_version 470151 (0.0009) [2023-12-27 22:37:09,672][106225] Updated weights for policy 1, policy_version 471577 (0.0008) [2023-12-27 22:37:09,735][106225] Updated weights for policy 1, policy_version 471587 (0.0009) [2023-12-27 22:37:09,797][106225] Updated weights for policy 1, policy_version 471597 (0.0009) [2023-12-27 22:37:09,814][106226] Updated weights for policy 0, policy_version 470161 (0.0006) [2023-12-27 22:37:09,885][106226] Updated weights for policy 0, policy_version 470171 (0.0009) [2023-12-27 22:37:09,950][106226] Updated weights for policy 0, policy_version 470181 (0.0008) [2023-12-27 22:37:10,579][106226] Updated weights for policy 0, policy_version 470191 (0.0006) [2023-12-27 22:37:10,593][106225] Updated weights for policy 1, policy_version 471607 (0.0009) [2023-12-27 22:37:10,631][106226] Updated weights for policy 0, policy_version 470201 (0.0005) [2023-12-27 22:37:10,652][106225] Updated weights for policy 1, policy_version 471617 (0.0008) [2023-12-27 22:37:10,697][106226] Updated weights for policy 0, policy_version 470211 (0.0006) [2023-12-27 22:37:10,709][106225] Updated weights for policy 1, policy_version 471627 (0.0008) [2023-12-27 22:37:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 241172480. Throughput: 0: 9807.7, 1: 9958.0. Samples: 241146140. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:37:11,175][105115] Avg episode reward: [(0, '-5.246'), (1, '-5.695')] [2023-12-27 22:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000471632_120766464.pth... [2023-12-27 22:37:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000470216_120406016.pth... [2023-12-27 22:37:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000469064_120111104.pth [2023-12-27 22:37:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000470480_120471552.pth [2023-12-27 22:37:11,412][106226] Updated weights for policy 0, policy_version 470221 (0.0009) [2023-12-27 22:37:11,449][106225] Updated weights for policy 1, policy_version 471637 (0.0006) [2023-12-27 22:37:11,475][106226] Updated weights for policy 0, policy_version 470231 (0.0007) [2023-12-27 22:37:11,514][106225] Updated weights for policy 1, policy_version 471647 (0.0006) [2023-12-27 22:37:11,541][106226] Updated weights for policy 0, policy_version 470241 (0.0005) [2023-12-27 22:37:11,575][106225] Updated weights for policy 1, policy_version 471657 (0.0006) [2023-12-27 22:37:12,249][106226] Updated weights for policy 0, policy_version 470251 (0.0007) [2023-12-27 22:37:12,307][106226] Updated weights for policy 0, policy_version 470261 (0.0009) [2023-12-27 22:37:12,329][106225] Updated weights for policy 1, policy_version 471667 (0.0008) [2023-12-27 22:37:12,378][106226] Updated weights for policy 0, policy_version 470271 (0.0008) [2023-12-27 22:37:12,394][106225] Updated weights for policy 1, policy_version 471677 (0.0007) [2023-12-27 22:37:12,451][106225] Updated weights for policy 1, policy_version 471687 (0.0007) [2023-12-27 22:37:13,107][106225] Updated weights for policy 1, policy_version 471697 (0.0006) [2023-12-27 22:37:13,163][106226] Updated weights for policy 0, policy_version 470281 (0.0007) [2023-12-27 22:37:13,172][106225] Updated weights for policy 1, policy_version 471707 (0.0008) [2023-12-27 22:37:13,223][106226] Updated weights for policy 0, policy_version 470291 (0.0005) [2023-12-27 22:37:13,230][106225] Updated weights for policy 1, policy_version 471717 (0.0010) [2023-12-27 22:37:13,276][106225] Updated weights for policy 1, policy_version 471727 (0.0010) [2023-12-27 22:37:13,283][106226] Updated weights for policy 0, policy_version 470301 (0.0005) [2023-12-27 22:37:13,346][106226] Updated weights for policy 0, policy_version 470311 (0.0005) [2023-12-27 22:37:13,983][106225] Updated weights for policy 1, policy_version 471737 (0.0007) [2023-12-27 22:37:13,989][106226] Updated weights for policy 0, policy_version 470321 (0.0007) [2023-12-27 22:37:14,041][106226] Updated weights for policy 0, policy_version 470331 (0.0008) [2023-12-27 22:37:14,042][106225] Updated weights for policy 1, policy_version 471747 (0.0008) [2023-12-27 22:37:14,091][106226] Updated weights for policy 0, policy_version 470341 (0.0005) [2023-12-27 22:37:14,101][106225] Updated weights for policy 1, policy_version 471757 (0.0007) [2023-12-27 22:37:14,823][106226] Updated weights for policy 0, policy_version 470351 (0.0008) [2023-12-27 22:37:14,849][106225] Updated weights for policy 1, policy_version 471767 (0.0006) [2023-12-27 22:37:14,879][106226] Updated weights for policy 0, policy_version 470361 (0.0006) [2023-12-27 22:37:14,916][106225] Updated weights for policy 1, policy_version 471777 (0.0008) [2023-12-27 22:37:14,939][106226] Updated weights for policy 0, policy_version 470371 (0.0007) [2023-12-27 22:37:14,981][106225] Updated weights for policy 1, policy_version 471787 (0.0008) [2023-12-27 22:37:15,624][106225] Updated weights for policy 1, policy_version 471797 (0.0009) [2023-12-27 22:37:15,681][106225] Updated weights for policy 1, policy_version 471807 (0.0005) [2023-12-27 22:37:15,730][106226] Updated weights for policy 0, policy_version 470381 (0.0007) [2023-12-27 22:37:15,736][106225] Updated weights for policy 1, policy_version 471817 (0.0007) [2023-12-27 22:37:15,779][106226] Updated weights for policy 0, policy_version 470391 (0.0007) [2023-12-27 22:37:15,828][106226] Updated weights for policy 0, policy_version 470401 (0.0008) [2023-12-27 22:37:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 241270784. Throughput: 0: 9799.5, 1: 9897.6. Samples: 241260200. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:37:16,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-5.603')] [2023-12-27 22:37:16,389][106225] Updated weights for policy 1, policy_version 471827 (0.0007) [2023-12-27 22:37:16,434][106226] Updated weights for policy 0, policy_version 470411 (0.0008) [2023-12-27 22:37:16,443][106225] Updated weights for policy 1, policy_version 471837 (0.0005) [2023-12-27 22:37:16,491][106226] Updated weights for policy 0, policy_version 470421 (0.0005) [2023-12-27 22:37:16,500][106225] Updated weights for policy 1, policy_version 471847 (0.0006) [2023-12-27 22:37:16,545][106226] Updated weights for policy 0, policy_version 470431 (0.0005) [2023-12-27 22:37:17,137][106226] Updated weights for policy 0, policy_version 470441 (0.0005) [2023-12-27 22:37:17,181][106225] Updated weights for policy 1, policy_version 471857 (0.0008) [2023-12-27 22:37:17,185][106226] Updated weights for policy 0, policy_version 470451 (0.0006) [2023-12-27 22:37:17,237][106226] Updated weights for policy 0, policy_version 470461 (0.0008) [2023-12-27 22:37:17,245][106225] Updated weights for policy 1, policy_version 471867 (0.0006) [2023-12-27 22:37:17,290][106226] Updated weights for policy 0, policy_version 470471 (0.0006) [2023-12-27 22:37:17,303][106225] Updated weights for policy 1, policy_version 471877 (0.0006) [2023-12-27 22:37:17,356][106225] Updated weights for policy 1, policy_version 471887 (0.0010) [2023-12-27 22:37:17,852][106226] Updated weights for policy 0, policy_version 470481 (0.0006) [2023-12-27 22:37:17,886][106225] Updated weights for policy 1, policy_version 471897 (0.0010) [2023-12-27 22:37:17,914][106226] Updated weights for policy 0, policy_version 470491 (0.0005) [2023-12-27 22:37:17,944][106225] Updated weights for policy 1, policy_version 471907 (0.0010) [2023-12-27 22:37:17,968][106226] Updated weights for policy 0, policy_version 470501 (0.0005) [2023-12-27 22:37:18,001][106225] Updated weights for policy 1, policy_version 471917 (0.0010) [2023-12-27 22:37:18,590][106226] Updated weights for policy 0, policy_version 470511 (0.0006) [2023-12-27 22:37:18,653][106226] Updated weights for policy 0, policy_version 470521 (0.0008) [2023-12-27 22:37:18,723][106226] Updated weights for policy 0, policy_version 470531 (0.0006) [2023-12-27 22:37:18,726][106225] Updated weights for policy 1, policy_version 471927 (0.0010) [2023-12-27 22:37:18,779][106225] Updated weights for policy 1, policy_version 471937 (0.0010) [2023-12-27 22:37:18,836][106225] Updated weights for policy 1, policy_version 471947 (0.0010) [2023-12-27 22:37:19,442][106226] Updated weights for policy 0, policy_version 470541 (0.0006) [2023-12-27 22:37:19,508][106226] Updated weights for policy 0, policy_version 470551 (0.0007) [2023-12-27 22:37:19,542][106225] Updated weights for policy 1, policy_version 471957 (0.0009) [2023-12-27 22:37:19,571][106226] Updated weights for policy 0, policy_version 470561 (0.0007) [2023-12-27 22:37:19,599][106225] Updated weights for policy 1, policy_version 471967 (0.0007) [2023-12-27 22:37:19,654][106225] Updated weights for policy 1, policy_version 471977 (0.0008) [2023-12-27 22:37:20,264][106226] Updated weights for policy 0, policy_version 470571 (0.0009) [2023-12-27 22:37:20,327][106226] Updated weights for policy 0, policy_version 470581 (0.0006) [2023-12-27 22:37:20,390][106226] Updated weights for policy 0, policy_version 470591 (0.0007) [2023-12-27 22:37:20,478][106225] Updated weights for policy 1, policy_version 471987 (0.0009) [2023-12-27 22:37:20,532][106225] Updated weights for policy 1, policy_version 471997 (0.0010) [2023-12-27 22:37:20,588][106225] Updated weights for policy 1, policy_version 472007 (0.0007) [2023-12-27 22:37:20,963][106226] Updated weights for policy 0, policy_version 470601 (0.0006) [2023-12-27 22:37:21,022][106226] Updated weights for policy 0, policy_version 470611 (0.0006) [2023-12-27 22:37:21,087][106226] Updated weights for policy 0, policy_version 470621 (0.0008) [2023-12-27 22:37:21,150][106226] Updated weights for policy 0, policy_version 470631 (0.0009) [2023-12-27 22:37:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 241377280. Throughput: 0: 9889.5, 1: 9863.2. Samples: 241383828. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-27 22:37:21,175][105115] Avg episode reward: [(0, '-4.981'), (1, '-5.610')] [2023-12-27 22:37:21,302][106225] Updated weights for policy 1, policy_version 472017 (0.0009) [2023-12-27 22:37:21,393][106225] Updated weights for policy 1, policy_version 472030 (0.0007) [2023-12-27 22:37:21,460][106225] Updated weights for policy 1, policy_version 472040 (0.0007) [2023-12-27 22:37:21,956][106226] Updated weights for policy 0, policy_version 470641 (0.0006) [2023-12-27 22:37:22,013][106226] Updated weights for policy 0, policy_version 470651 (0.0007) [2023-12-27 22:37:22,068][106226] Updated weights for policy 0, policy_version 470661 (0.0005) [2023-12-27 22:37:22,167][106225] Updated weights for policy 1, policy_version 472050 (0.0007) [2023-12-27 22:37:22,236][106225] Updated weights for policy 1, policy_version 472060 (0.0010) [2023-12-27 22:37:22,308][106225] Updated weights for policy 1, policy_version 472070 (0.0009) [2023-12-27 22:37:22,371][106225] Updated weights for policy 1, policy_version 472080 (0.0009) [2023-12-27 22:37:22,755][106226] Updated weights for policy 0, policy_version 470671 (0.0008) [2023-12-27 22:37:22,811][106226] Updated weights for policy 0, policy_version 470681 (0.0008) [2023-12-27 22:37:22,872][106226] Updated weights for policy 0, policy_version 470691 (0.0008) [2023-12-27 22:37:23,121][106225] Updated weights for policy 1, policy_version 472090 (0.0009) [2023-12-27 22:37:23,184][106225] Updated weights for policy 1, policy_version 472100 (0.0007) [2023-12-27 22:37:23,231][106225] Updated weights for policy 1, policy_version 472110 (0.0010) [2023-12-27 22:37:23,664][106226] Updated weights for policy 0, policy_version 470701 (0.0008) [2023-12-27 22:37:23,714][106226] Updated weights for policy 0, policy_version 470711 (0.0009) [2023-12-27 22:37:23,764][106226] Updated weights for policy 0, policy_version 470721 (0.0008) [2023-12-27 22:37:23,815][106225] Updated weights for policy 1, policy_version 472120 (0.0010) [2023-12-27 22:37:23,861][106225] Updated weights for policy 1, policy_version 472130 (0.0010) [2023-12-27 22:37:23,921][106225] Updated weights for policy 1, policy_version 472140 (0.0010) [2023-12-27 22:37:24,507][106226] Updated weights for policy 0, policy_version 470731 (0.0007) [2023-12-27 22:37:24,561][106226] Updated weights for policy 0, policy_version 470741 (0.0008) [2023-12-27 22:37:24,619][106226] Updated weights for policy 0, policy_version 470751 (0.0008) [2023-12-27 22:37:24,651][106225] Updated weights for policy 1, policy_version 472150 (0.0012) [2023-12-27 22:37:24,708][106225] Updated weights for policy 1, policy_version 472160 (0.0010) [2023-12-27 22:37:24,770][106225] Updated weights for policy 1, policy_version 472170 (0.0010) [2023-12-27 22:37:25,262][106226] Updated weights for policy 0, policy_version 470761 (0.0007) [2023-12-27 22:37:25,313][106226] Updated weights for policy 0, policy_version 470771 (0.0005) [2023-12-27 22:37:25,362][106226] Updated weights for policy 0, policy_version 470781 (0.0005) [2023-12-27 22:37:25,411][106226] Updated weights for policy 0, policy_version 470791 (0.0005) [2023-12-27 22:37:25,475][106225] Updated weights for policy 1, policy_version 472180 (0.0010) [2023-12-27 22:37:25,522][106225] Updated weights for policy 1, policy_version 472190 (0.0010) [2023-12-27 22:37:25,575][106225] Updated weights for policy 1, policy_version 472200 (0.0007) [2023-12-27 22:37:26,026][106226] Updated weights for policy 0, policy_version 470801 (0.0008) [2023-12-27 22:37:26,086][106226] Updated weights for policy 0, policy_version 470811 (0.0010) [2023-12-27 22:37:26,150][106226] Updated weights for policy 0, policy_version 470821 (0.0009) [2023-12-27 22:37:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 241475584. Throughput: 0: 9849.2, 1: 9868.9. Samples: 241441672. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:26,175][105115] Avg episode reward: [(0, '-5.133'), (1, '-5.498')] [2023-12-27 22:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000470824_120561664.pth... [2023-12-27 22:37:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000472208_120913920.pth... [2023-12-27 22:37:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000471056_120619008.pth [2023-12-27 22:37:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000469640_120258560.pth [2023-12-27 22:37:26,232][106225] Updated weights for policy 1, policy_version 472210 (0.0006) [2023-12-27 22:37:26,280][106225] Updated weights for policy 1, policy_version 472220 (0.0010) [2023-12-27 22:37:26,333][106225] Updated weights for policy 1, policy_version 472230 (0.0010) [2023-12-27 22:37:26,390][106225] Updated weights for policy 1, policy_version 472240 (0.0007) [2023-12-27 22:37:26,753][106226] Updated weights for policy 0, policy_version 470831 (0.0005) [2023-12-27 22:37:26,802][106226] Updated weights for policy 0, policy_version 470841 (0.0005) [2023-12-27 22:37:26,849][106226] Updated weights for policy 0, policy_version 470851 (0.0007) [2023-12-27 22:37:26,967][106225] Updated weights for policy 1, policy_version 472250 (0.0006) [2023-12-27 22:37:27,031][106225] Updated weights for policy 1, policy_version 472260 (0.0006) [2023-12-27 22:37:27,092][106225] Updated weights for policy 1, policy_version 472270 (0.0008) [2023-12-27 22:37:27,472][106226] Updated weights for policy 0, policy_version 470861 (0.0009) [2023-12-27 22:37:27,523][106226] Updated weights for policy 0, policy_version 470871 (0.0009) [2023-12-27 22:37:27,576][106226] Updated weights for policy 0, policy_version 470881 (0.0009) [2023-12-27 22:37:27,706][106225] Updated weights for policy 1, policy_version 472280 (0.0008) [2023-12-27 22:37:27,752][106225] Updated weights for policy 1, policy_version 472290 (0.0008) [2023-12-27 22:37:27,806][106225] Updated weights for policy 1, policy_version 472300 (0.0008) [2023-12-27 22:37:28,357][106226] Updated weights for policy 0, policy_version 470891 (0.0008) [2023-12-27 22:37:28,419][106226] Updated weights for policy 0, policy_version 470901 (0.0009) [2023-12-27 22:37:28,454][106225] Updated weights for policy 1, policy_version 472310 (0.0007) [2023-12-27 22:37:28,478][106226] Updated weights for policy 0, policy_version 470911 (0.0007) [2023-12-27 22:37:28,515][106225] Updated weights for policy 1, policy_version 472320 (0.0008) [2023-12-27 22:37:28,574][106225] Updated weights for policy 1, policy_version 472330 (0.0008) [2023-12-27 22:37:29,186][106225] Updated weights for policy 1, policy_version 472340 (0.0007) [2023-12-27 22:37:29,201][106226] Updated weights for policy 0, policy_version 470921 (0.0006) [2023-12-27 22:37:29,249][106225] Updated weights for policy 1, policy_version 472350 (0.0006) [2023-12-27 22:37:29,267][106226] Updated weights for policy 0, policy_version 470931 (0.0007) [2023-12-27 22:37:29,312][106225] Updated weights for policy 1, policy_version 472360 (0.0008) [2023-12-27 22:37:29,333][106226] Updated weights for policy 0, policy_version 470941 (0.0007) [2023-12-27 22:37:29,399][106226] Updated weights for policy 0, policy_version 470951 (0.0009) [2023-12-27 22:37:30,053][106225] Updated weights for policy 1, policy_version 472370 (0.0008) [2023-12-27 22:37:30,113][106225] Updated weights for policy 1, policy_version 472380 (0.0009) [2023-12-27 22:37:30,136][106226] Updated weights for policy 0, policy_version 470961 (0.0010) [2023-12-27 22:37:30,169][106225] Updated weights for policy 1, policy_version 472390 (0.0007) [2023-12-27 22:37:30,198][106226] Updated weights for policy 0, policy_version 470971 (0.0009) [2023-12-27 22:37:30,229][106225] Updated weights for policy 1, policy_version 472400 (0.0008) [2023-12-27 22:37:30,262][106226] Updated weights for policy 0, policy_version 470981 (0.0009) [2023-12-27 22:37:30,932][106225] Updated weights for policy 1, policy_version 472410 (0.0009) [2023-12-27 22:37:30,974][106226] Updated weights for policy 0, policy_version 470991 (0.0007) [2023-12-27 22:37:30,976][106225] Updated weights for policy 1, policy_version 472420 (0.0005) [2023-12-27 22:37:31,027][106225] Updated weights for policy 1, policy_version 472430 (0.0006) [2023-12-27 22:37:31,058][106226] Updated weights for policy 0, policy_version 471001 (0.0007) [2023-12-27 22:37:31,122][106226] Updated weights for policy 0, policy_version 471011 (0.0008) [2023-12-27 22:37:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 241582080. Throughput: 0: 9925.2, 1: 9991.8. Samples: 241566676. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:31,175][105115] Avg episode reward: [(0, '-5.015'), (1, '-5.590')] [2023-12-27 22:37:31,809][106225] Updated weights for policy 1, policy_version 472440 (0.0008) [2023-12-27 22:37:31,865][106225] Updated weights for policy 1, policy_version 472450 (0.0007) [2023-12-27 22:37:31,881][106226] Updated weights for policy 0, policy_version 471021 (0.0009) [2023-12-27 22:37:31,924][106225] Updated weights for policy 1, policy_version 472460 (0.0005) [2023-12-27 22:37:31,937][106226] Updated weights for policy 0, policy_version 471031 (0.0008) [2023-12-27 22:37:32,002][106226] Updated weights for policy 0, policy_version 471041 (0.0009) [2023-12-27 22:37:32,642][106225] Updated weights for policy 1, policy_version 472470 (0.0007) [2023-12-27 22:37:32,690][106225] Updated weights for policy 1, policy_version 472480 (0.0008) [2023-12-27 22:37:32,740][106225] Updated weights for policy 1, policy_version 472491 (0.0009) [2023-12-27 22:37:32,751][106226] Updated weights for policy 0, policy_version 471051 (0.0008) [2023-12-27 22:37:32,815][106226] Updated weights for policy 0, policy_version 471061 (0.0009) [2023-12-27 22:37:32,881][106226] Updated weights for policy 0, policy_version 471071 (0.0009) [2023-12-27 22:37:33,437][106225] Updated weights for policy 1, policy_version 472501 (0.0008) [2023-12-27 22:37:33,499][106225] Updated weights for policy 1, policy_version 472511 (0.0008) [2023-12-27 22:37:33,553][106225] Updated weights for policy 1, policy_version 472521 (0.0008) [2023-12-27 22:37:33,612][106226] Updated weights for policy 0, policy_version 471081 (0.0009) [2023-12-27 22:37:33,672][106226] Updated weights for policy 0, policy_version 471091 (0.0009) [2023-12-27 22:37:33,728][106226] Updated weights for policy 0, policy_version 471101 (0.0010) [2023-12-27 22:37:33,784][106226] Updated weights for policy 0, policy_version 471111 (0.0009) [2023-12-27 22:37:34,250][106225] Updated weights for policy 1, policy_version 472531 (0.0008) [2023-12-27 22:37:34,308][106225] Updated weights for policy 1, policy_version 472541 (0.0008) [2023-12-27 22:37:34,376][106225] Updated weights for policy 1, policy_version 472551 (0.0008) [2023-12-27 22:37:34,472][106226] Updated weights for policy 0, policy_version 471121 (0.0008) [2023-12-27 22:37:34,535][106226] Updated weights for policy 0, policy_version 471131 (0.0008) [2023-12-27 22:37:34,601][106226] Updated weights for policy 0, policy_version 471141 (0.0008) [2023-12-27 22:37:35,136][106225] Updated weights for policy 1, policy_version 472561 (0.0008) [2023-12-27 22:37:35,197][106225] Updated weights for policy 1, policy_version 472571 (0.0008) [2023-12-27 22:37:35,257][106225] Updated weights for policy 1, policy_version 472581 (0.0008) [2023-12-27 22:37:35,290][106226] Updated weights for policy 0, policy_version 471151 (0.0007) [2023-12-27 22:37:35,308][106225] Updated weights for policy 1, policy_version 472591 (0.0006) [2023-12-27 22:37:35,352][106226] Updated weights for policy 0, policy_version 471161 (0.0008) [2023-12-27 22:37:35,411][106226] Updated weights for policy 0, policy_version 471171 (0.0009) [2023-12-27 22:37:36,018][106226] Updated weights for policy 0, policy_version 471181 (0.0007) [2023-12-27 22:37:36,028][106225] Updated weights for policy 1, policy_version 472601 (0.0006) [2023-12-27 22:37:36,078][106226] Updated weights for policy 0, policy_version 471191 (0.0005) [2023-12-27 22:37:36,092][106225] Updated weights for policy 1, policy_version 472611 (0.0006) [2023-12-27 22:37:36,142][106226] Updated weights for policy 0, policy_version 471201 (0.0007) [2023-12-27 22:37:36,157][106225] Updated weights for policy 1, policy_version 472621 (0.0007) [2023-12-27 22:37:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 241672192. Throughput: 0: 9872.6, 1: 9957.6. Samples: 241682572. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:36,175][105115] Avg episode reward: [(0, '-5.226'), (1, '-5.631')] [2023-12-27 22:37:36,781][106226] Updated weights for policy 0, policy_version 471211 (0.0010) [2023-12-27 22:37:36,820][106225] Updated weights for policy 1, policy_version 472631 (0.0007) [2023-12-27 22:37:36,830][106226] Updated weights for policy 0, policy_version 471221 (0.0007) [2023-12-27 22:37:36,871][106225] Updated weights for policy 1, policy_version 472641 (0.0006) [2023-12-27 22:37:36,886][106226] Updated weights for policy 0, policy_version 471231 (0.0006) [2023-12-27 22:37:36,920][106225] Updated weights for policy 1, policy_version 472651 (0.0007) [2023-12-27 22:37:37,481][106226] Updated weights for policy 0, policy_version 471241 (0.0006) [2023-12-27 22:37:37,540][106226] Updated weights for policy 0, policy_version 471251 (0.0006) [2023-12-27 22:37:37,602][106226] Updated weights for policy 0, policy_version 471261 (0.0006) [2023-12-27 22:37:37,658][106226] Updated weights for policy 0, policy_version 471271 (0.0006) [2023-12-27 22:37:37,675][106225] Updated weights for policy 1, policy_version 472661 (0.0007) [2023-12-27 22:37:37,746][106225] Updated weights for policy 1, policy_version 472671 (0.0009) [2023-12-27 22:37:37,797][106225] Updated weights for policy 1, policy_version 472681 (0.0008) [2023-12-27 22:37:38,168][106226] Updated weights for policy 0, policy_version 471281 (0.0006) [2023-12-27 22:37:38,227][106226] Updated weights for policy 0, policy_version 471291 (0.0009) [2023-12-27 22:37:38,285][106226] Updated weights for policy 0, policy_version 471301 (0.0008) [2023-12-27 22:37:38,621][106225] Updated weights for policy 1, policy_version 472691 (0.0008) [2023-12-27 22:37:38,667][106225] Updated weights for policy 1, policy_version 472701 (0.0008) [2023-12-27 22:37:38,728][106225] Updated weights for policy 1, policy_version 472711 (0.0008) [2023-12-27 22:37:39,015][106226] Updated weights for policy 0, policy_version 471311 (0.0006) [2023-12-27 22:37:39,087][106226] Updated weights for policy 0, policy_version 471321 (0.0006) [2023-12-27 22:37:39,143][106226] Updated weights for policy 0, policy_version 471331 (0.0009) [2023-12-27 22:37:39,518][106225] Updated weights for policy 1, policy_version 472721 (0.0009) [2023-12-27 22:37:39,586][106225] Updated weights for policy 1, policy_version 472731 (0.0009) [2023-12-27 22:37:39,650][106225] Updated weights for policy 1, policy_version 472741 (0.0009) [2023-12-27 22:37:39,712][106225] Updated weights for policy 1, policy_version 472751 (0.0006) [2023-12-27 22:37:39,860][106226] Updated weights for policy 0, policy_version 471341 (0.0008) [2023-12-27 22:37:39,912][106226] Updated weights for policy 0, policy_version 471351 (0.0005) [2023-12-27 22:37:39,976][106226] Updated weights for policy 0, policy_version 471361 (0.0008) [2023-12-27 22:37:40,444][106225] Updated weights for policy 1, policy_version 472761 (0.0010) [2023-12-27 22:37:40,506][106225] Updated weights for policy 1, policy_version 472771 (0.0010) [2023-12-27 22:37:40,570][106225] Updated weights for policy 1, policy_version 472781 (0.0010) [2023-12-27 22:37:40,720][106226] Updated weights for policy 0, policy_version 471371 (0.0008) [2023-12-27 22:37:40,782][106226] Updated weights for policy 0, policy_version 471381 (0.0008) [2023-12-27 22:37:40,835][106226] Updated weights for policy 0, policy_version 471391 (0.0006) [2023-12-27 22:37:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 241770496. Throughput: 0: 9977.5, 1: 9941.1. Samples: 241743884. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:41,176][105115] Avg episode reward: [(0, '-4.867'), (1, '-5.454')] [2023-12-27 22:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000472784_121061376.pth... [2023-12-27 22:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000471400_120709120.pth... [2023-12-27 22:37:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000471632_120766464.pth [2023-12-27 22:37:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000470216_120406016.pth [2023-12-27 22:37:41,330][106225] Updated weights for policy 1, policy_version 472791 (0.0011) [2023-12-27 22:37:41,400][106225] Updated weights for policy 1, policy_version 472801 (0.0011) [2023-12-27 22:37:41,456][106225] Updated weights for policy 1, policy_version 472811 (0.0010) [2023-12-27 22:37:41,549][106226] Updated weights for policy 0, policy_version 471401 (0.0008) [2023-12-27 22:37:41,605][106226] Updated weights for policy 0, policy_version 471411 (0.0011) [2023-12-27 22:37:41,674][106226] Updated weights for policy 0, policy_version 471421 (0.0011) [2023-12-27 22:37:41,733][106226] Updated weights for policy 0, policy_version 471431 (0.0009) [2023-12-27 22:37:42,211][106225] Updated weights for policy 1, policy_version 472821 (0.0010) [2023-12-27 22:37:42,270][106225] Updated weights for policy 1, policy_version 472831 (0.0011) [2023-12-27 22:37:42,329][106225] Updated weights for policy 1, policy_version 472841 (0.0011) [2023-12-27 22:37:42,464][106226] Updated weights for policy 0, policy_version 471441 (0.0008) [2023-12-27 22:37:42,521][106226] Updated weights for policy 0, policy_version 471451 (0.0008) [2023-12-27 22:37:42,582][106226] Updated weights for policy 0, policy_version 471461 (0.0006) [2023-12-27 22:37:43,072][106225] Updated weights for policy 1, policy_version 472851 (0.0011) [2023-12-27 22:37:43,122][106225] Updated weights for policy 1, policy_version 472861 (0.0010) [2023-12-27 22:37:43,136][106226] Updated weights for policy 0, policy_version 471471 (0.0007) [2023-12-27 22:37:43,182][106225] Updated weights for policy 1, policy_version 472871 (0.0010) [2023-12-27 22:37:43,187][106226] Updated weights for policy 0, policy_version 471481 (0.0008) [2023-12-27 22:37:43,232][106226] Updated weights for policy 0, policy_version 471491 (0.0007) [2023-12-27 22:37:43,839][106225] Updated weights for policy 1, policy_version 472881 (0.0007) [2023-12-27 22:37:43,895][106225] Updated weights for policy 1, policy_version 472891 (0.0008) [2023-12-27 22:37:43,953][106225] Updated weights for policy 1, policy_version 472901 (0.0007) [2023-12-27 22:37:43,965][106226] Updated weights for policy 0, policy_version 471501 (0.0008) [2023-12-27 22:37:44,012][106225] Updated weights for policy 1, policy_version 472911 (0.0007) [2023-12-27 22:37:44,021][106226] Updated weights for policy 0, policy_version 471511 (0.0010) [2023-12-27 22:37:44,082][106226] Updated weights for policy 0, policy_version 471521 (0.0008) [2023-12-27 22:37:44,739][106225] Updated weights for policy 1, policy_version 472921 (0.0009) [2023-12-27 22:37:44,754][106226] Updated weights for policy 0, policy_version 471531 (0.0011) [2023-12-27 22:37:44,819][106226] Updated weights for policy 0, policy_version 471541 (0.0008) [2023-12-27 22:37:44,825][106225] Updated weights for policy 1, policy_version 472931 (0.0007) [2023-12-27 22:37:44,878][106226] Updated weights for policy 0, policy_version 471551 (0.0010) [2023-12-27 22:37:44,887][106225] Updated weights for policy 1, policy_version 472941 (0.0006) [2023-12-27 22:37:45,526][106226] Updated weights for policy 0, policy_version 471561 (0.0010) [2023-12-27 22:37:45,590][106226] Updated weights for policy 0, policy_version 471571 (0.0011) [2023-12-27 22:37:45,638][106225] Updated weights for policy 1, policy_version 472951 (0.0007) [2023-12-27 22:37:45,643][106226] Updated weights for policy 0, policy_version 471581 (0.0010) [2023-12-27 22:37:45,694][106225] Updated weights for policy 1, policy_version 472961 (0.0006) [2023-12-27 22:37:45,700][106226] Updated weights for policy 0, policy_version 471591 (0.0010) [2023-12-27 22:37:45,750][106225] Updated weights for policy 1, policy_version 472971 (0.0008) [2023-12-27 22:37:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 241868800. Throughput: 0: 9984.5, 1: 9880.3. Samples: 241859868. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:46,175][105115] Avg episode reward: [(0, '-4.930'), (1, '-5.528')] [2023-12-27 22:37:46,345][106226] Updated weights for policy 0, policy_version 471601 (0.0010) [2023-12-27 22:37:46,392][106226] Updated weights for policy 0, policy_version 471611 (0.0009) [2023-12-27 22:37:46,448][106226] Updated weights for policy 0, policy_version 471621 (0.0005) [2023-12-27 22:37:46,480][106225] Updated weights for policy 1, policy_version 472981 (0.0010) [2023-12-27 22:37:46,543][106225] Updated weights for policy 1, policy_version 472991 (0.0010) [2023-12-27 22:37:46,614][106225] Updated weights for policy 1, policy_version 473001 (0.0008) [2023-12-27 22:37:47,073][106226] Updated weights for policy 0, policy_version 471631 (0.0009) [2023-12-27 22:37:47,127][106226] Updated weights for policy 0, policy_version 471641 (0.0010) [2023-12-27 22:37:47,163][106225] Updated weights for policy 1, policy_version 473011 (0.0008) [2023-12-27 22:37:47,194][106226] Updated weights for policy 0, policy_version 471651 (0.0011) [2023-12-27 22:37:47,210][106225] Updated weights for policy 1, policy_version 473021 (0.0006) [2023-12-27 22:37:47,256][106225] Updated weights for policy 1, policy_version 473031 (0.0005) [2023-12-27 22:37:47,902][106225] Updated weights for policy 1, policy_version 473041 (0.0007) [2023-12-27 22:37:47,904][106226] Updated weights for policy 0, policy_version 471661 (0.0010) [2023-12-27 22:37:47,963][106225] Updated weights for policy 1, policy_version 473051 (0.0009) [2023-12-27 22:37:47,964][106226] Updated weights for policy 0, policy_version 471671 (0.0010) [2023-12-27 22:37:48,016][106225] Updated weights for policy 1, policy_version 473061 (0.0008) [2023-12-27 22:37:48,016][106226] Updated weights for policy 0, policy_version 471681 (0.0005) [2023-12-27 22:37:48,066][106225] Updated weights for policy 1, policy_version 473071 (0.0010) [2023-12-27 22:37:48,601][106226] Updated weights for policy 0, policy_version 471691 (0.0007) [2023-12-27 22:37:48,662][106226] Updated weights for policy 0, policy_version 471701 (0.0009) [2023-12-27 22:37:48,730][106226] Updated weights for policy 0, policy_version 471711 (0.0010) [2023-12-27 22:37:48,735][106225] Updated weights for policy 1, policy_version 473081 (0.0011) [2023-12-27 22:37:48,797][106225] Updated weights for policy 1, policy_version 473091 (0.0012) [2023-12-27 22:37:48,854][106225] Updated weights for policy 1, policy_version 473101 (0.0010) [2023-12-27 22:37:49,444][106226] Updated weights for policy 0, policy_version 471721 (0.0010) [2023-12-27 22:37:49,507][106226] Updated weights for policy 0, policy_version 471731 (0.0005) [2023-12-27 22:37:49,572][106225] Updated weights for policy 1, policy_version 473111 (0.0010) [2023-12-27 22:37:49,573][106226] Updated weights for policy 0, policy_version 471741 (0.0006) [2023-12-27 22:37:49,635][106225] Updated weights for policy 1, policy_version 473121 (0.0010) [2023-12-27 22:37:49,636][106226] Updated weights for policy 0, policy_version 471751 (0.0008) [2023-12-27 22:37:49,699][106225] Updated weights for policy 1, policy_version 473131 (0.0010) [2023-12-27 22:37:50,321][106226] Updated weights for policy 0, policy_version 471761 (0.0008) [2023-12-27 22:37:50,387][106226] Updated weights for policy 0, policy_version 471771 (0.0009) [2023-12-27 22:37:50,421][106225] Updated weights for policy 1, policy_version 473141 (0.0008) [2023-12-27 22:37:50,446][106226] Updated weights for policy 0, policy_version 471781 (0.0007) [2023-12-27 22:37:50,476][106225] Updated weights for policy 1, policy_version 473151 (0.0009) [2023-12-27 22:37:50,539][106225] Updated weights for policy 1, policy_version 473161 (0.0010) [2023-12-27 22:37:51,145][106226] Updated weights for policy 0, policy_version 471791 (0.0009) [2023-12-27 22:37:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 241967104. Throughput: 0: 10042.2, 1: 9821.9. Samples: 241981748. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:51,175][105115] Avg episode reward: [(0, '-5.161'), (1, '-5.586')] [2023-12-27 22:37:51,207][106226] Updated weights for policy 0, policy_version 471801 (0.0010) [2023-12-27 22:37:51,233][106225] Updated weights for policy 1, policy_version 473171 (0.0009) [2023-12-27 22:37:51,276][106226] Updated weights for policy 0, policy_version 471811 (0.0011) [2023-12-27 22:37:51,296][106225] Updated weights for policy 1, policy_version 473181 (0.0010) [2023-12-27 22:37:51,360][106225] Updated weights for policy 1, policy_version 473191 (0.0009) [2023-12-27 22:37:52,031][106225] Updated weights for policy 1, policy_version 473201 (0.0007) [2023-12-27 22:37:52,053][106226] Updated weights for policy 0, policy_version 471821 (0.0006) [2023-12-27 22:37:52,089][106225] Updated weights for policy 1, policy_version 473211 (0.0009) [2023-12-27 22:37:52,114][106226] Updated weights for policy 0, policy_version 471831 (0.0008) [2023-12-27 22:37:52,151][106225] Updated weights for policy 1, policy_version 473221 (0.0008) [2023-12-27 22:37:52,172][106226] Updated weights for policy 0, policy_version 471841 (0.0005) [2023-12-27 22:37:52,208][106225] Updated weights for policy 1, policy_version 473231 (0.0008) [2023-12-27 22:37:52,886][106226] Updated weights for policy 0, policy_version 471851 (0.0005) [2023-12-27 22:37:52,937][106225] Updated weights for policy 1, policy_version 473241 (0.0008) [2023-12-27 22:37:52,945][106226] Updated weights for policy 0, policy_version 471861 (0.0006) [2023-12-27 22:37:52,989][106225] Updated weights for policy 1, policy_version 473251 (0.0008) [2023-12-27 22:37:52,995][106226] Updated weights for policy 0, policy_version 471871 (0.0005) [2023-12-27 22:37:53,050][106225] Updated weights for policy 1, policy_version 473261 (0.0007) [2023-12-27 22:37:53,643][106226] Updated weights for policy 0, policy_version 471881 (0.0007) [2023-12-27 22:37:53,652][106225] Updated weights for policy 1, policy_version 473271 (0.0009) [2023-12-27 22:37:53,698][106226] Updated weights for policy 0, policy_version 471891 (0.0007) [2023-12-27 22:37:53,711][106225] Updated weights for policy 1, policy_version 473281 (0.0007) [2023-12-27 22:37:53,748][106226] Updated weights for policy 0, policy_version 471901 (0.0005) [2023-12-27 22:37:53,771][106225] Updated weights for policy 1, policy_version 473291 (0.0007) [2023-12-27 22:37:53,805][106226] Updated weights for policy 0, policy_version 471911 (0.0008) [2023-12-27 22:37:54,488][106225] Updated weights for policy 1, policy_version 473301 (0.0009) [2023-12-27 22:37:54,527][106226] Updated weights for policy 0, policy_version 471921 (0.0007) [2023-12-27 22:37:54,543][106225] Updated weights for policy 1, policy_version 473311 (0.0008) [2023-12-27 22:37:54,598][106226] Updated weights for policy 0, policy_version 471931 (0.0006) [2023-12-27 22:37:54,605][106225] Updated weights for policy 1, policy_version 473321 (0.0008) [2023-12-27 22:37:54,662][106226] Updated weights for policy 0, policy_version 471941 (0.0006) [2023-12-27 22:37:55,223][106226] Updated weights for policy 0, policy_version 471951 (0.0009) [2023-12-27 22:37:55,291][106226] Updated weights for policy 0, policy_version 471961 (0.0009) [2023-12-27 22:37:55,350][106226] Updated weights for policy 0, policy_version 471971 (0.0009) [2023-12-27 22:37:55,368][106225] Updated weights for policy 1, policy_version 473331 (0.0008) [2023-12-27 22:37:55,421][106225] Updated weights for policy 1, policy_version 473341 (0.0008) [2023-12-27 22:37:55,470][106225] Updated weights for policy 1, policy_version 473351 (0.0008) [2023-12-27 22:37:56,061][106226] Updated weights for policy 0, policy_version 471981 (0.0007) [2023-12-27 22:37:56,107][106226] Updated weights for policy 0, policy_version 471991 (0.0009) [2023-12-27 22:37:56,156][106226] Updated weights for policy 0, policy_version 472001 (0.0008) [2023-12-27 22:37:56,162][106225] Updated weights for policy 1, policy_version 473361 (0.0008) [2023-12-27 22:37:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.5, 300 sec: 19716.3). Total num frames: 242065408. Throughput: 0: 10050.3, 1: 9843.6. Samples: 242041364. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:37:56,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.747')] [2023-12-27 22:37:56,199][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000472008_120864768.pth... [2023-12-27 22:37:56,202][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000470824_120561664.pth [2023-12-27 22:37:56,217][106225] Updated weights for policy 1, policy_version 473371 (0.0006) [2023-12-27 22:37:56,274][106225] Updated weights for policy 1, policy_version 473381 (0.0006) [2023-12-27 22:37:56,331][106225] Updated weights for policy 1, policy_version 473391 (0.0005) [2023-12-27 22:37:56,337][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000473392_121217024.pth... [2023-12-27 22:37:56,344][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000472208_120913920.pth [2023-12-27 22:37:56,878][106225] Updated weights for policy 1, policy_version 473401 (0.0005) [2023-12-27 22:37:56,928][106225] Updated weights for policy 1, policy_version 473411 (0.0008) [2023-12-27 22:37:56,972][106225] Updated weights for policy 1, policy_version 473421 (0.0008) [2023-12-27 22:37:56,995][106226] Updated weights for policy 0, policy_version 472011 (0.0008) [2023-12-27 22:37:57,042][106226] Updated weights for policy 0, policy_version 472021 (0.0008) [2023-12-27 22:37:57,092][106226] Updated weights for policy 0, policy_version 472031 (0.0008) [2023-12-27 22:37:57,600][106225] Updated weights for policy 1, policy_version 473431 (0.0008) [2023-12-27 22:37:57,660][106225] Updated weights for policy 1, policy_version 473441 (0.0007) [2023-12-27 22:37:57,707][106226] Updated weights for policy 0, policy_version 472041 (0.0009) [2023-12-27 22:37:57,722][106225] Updated weights for policy 1, policy_version 473451 (0.0008) [2023-12-27 22:37:57,763][106226] Updated weights for policy 0, policy_version 472051 (0.0007) [2023-12-27 22:37:57,818][106226] Updated weights for policy 0, policy_version 472061 (0.0008) [2023-12-27 22:37:57,875][106226] Updated weights for policy 0, policy_version 472071 (0.0009) [2023-12-27 22:37:58,320][106225] Updated weights for policy 1, policy_version 473461 (0.0007) [2023-12-27 22:37:58,402][106225] Updated weights for policy 1, policy_version 473471 (0.0009) [2023-12-27 22:37:58,464][106225] Updated weights for policy 1, policy_version 473481 (0.0009) [2023-12-27 22:37:58,695][106226] Updated weights for policy 0, policy_version 472081 (0.0008) [2023-12-27 22:37:58,760][106226] Updated weights for policy 0, policy_version 472091 (0.0009) [2023-12-27 22:37:58,824][106226] Updated weights for policy 0, policy_version 472101 (0.0008) [2023-12-27 22:37:59,254][106225] Updated weights for policy 1, policy_version 473491 (0.0008) [2023-12-27 22:37:59,336][106225] Updated weights for policy 1, policy_version 473501 (0.0008) [2023-12-27 22:37:59,409][106225] Updated weights for policy 1, policy_version 473511 (0.0009) [2023-12-27 22:37:59,648][106226] Updated weights for policy 0, policy_version 472111 (0.0008) [2023-12-27 22:37:59,709][106226] Updated weights for policy 0, policy_version 472121 (0.0009) [2023-12-27 22:37:59,773][106226] Updated weights for policy 0, policy_version 472131 (0.0010) [2023-12-27 22:38:00,142][106225] Updated weights for policy 1, policy_version 473521 (0.0008) [2023-12-27 22:38:00,202][106225] Updated weights for policy 1, policy_version 473531 (0.0005) [2023-12-27 22:38:00,265][106225] Updated weights for policy 1, policy_version 473541 (0.0006) [2023-12-27 22:38:00,327][106225] Updated weights for policy 1, policy_version 473551 (0.0005) [2023-12-27 22:38:00,476][106226] Updated weights for policy 0, policy_version 472141 (0.0008) [2023-12-27 22:38:00,532][106226] Updated weights for policy 0, policy_version 472151 (0.0010) [2023-12-27 22:38:00,597][106226] Updated weights for policy 0, policy_version 472161 (0.0009) [2023-12-27 22:38:00,921][106225] Updated weights for policy 1, policy_version 473561 (0.0006) [2023-12-27 22:38:00,976][106225] Updated weights for policy 1, policy_version 473571 (0.0005) [2023-12-27 22:38:01,041][106225] Updated weights for policy 1, policy_version 473581 (0.0008) [2023-12-27 22:38:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 242171904. Throughput: 0: 10061.1, 1: 9920.3. Samples: 242159360. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:01,175][105115] Avg episode reward: [(0, '-5.055'), (1, '-5.290')] [2023-12-27 22:38:01,302][106226] Updated weights for policy 0, policy_version 472171 (0.0006) [2023-12-27 22:38:01,370][106226] Updated weights for policy 0, policy_version 472181 (0.0009) [2023-12-27 22:38:01,441][106226] Updated weights for policy 0, policy_version 472192 (0.0008) [2023-12-27 22:38:01,752][106225] Updated weights for policy 1, policy_version 473591 (0.0008) [2023-12-27 22:38:01,808][106225] Updated weights for policy 1, policy_version 473601 (0.0005) [2023-12-27 22:38:01,863][106225] Updated weights for policy 1, policy_version 473611 (0.0005) [2023-12-27 22:38:02,185][106226] Updated weights for policy 0, policy_version 472202 (0.0009) [2023-12-27 22:38:02,246][106226] Updated weights for policy 0, policy_version 472212 (0.0008) [2023-12-27 22:38:02,306][106226] Updated weights for policy 0, policy_version 472222 (0.0008) [2023-12-27 22:38:02,372][106226] Updated weights for policy 0, policy_version 472232 (0.0009) [2023-12-27 22:38:02,545][106225] Updated weights for policy 1, policy_version 473621 (0.0008) [2023-12-27 22:38:02,610][106225] Updated weights for policy 1, policy_version 473631 (0.0005) [2023-12-27 22:38:02,675][106225] Updated weights for policy 1, policy_version 473641 (0.0005) [2023-12-27 22:38:03,132][106226] Updated weights for policy 0, policy_version 472242 (0.0005) [2023-12-27 22:38:03,179][106226] Updated weights for policy 0, policy_version 472252 (0.0005) [2023-12-27 22:38:03,230][106226] Updated weights for policy 0, policy_version 472262 (0.0005) [2023-12-27 22:38:03,311][106225] Updated weights for policy 1, policy_version 473651 (0.0006) [2023-12-27 22:38:03,369][106225] Updated weights for policy 1, policy_version 473661 (0.0008) [2023-12-27 22:38:03,429][106225] Updated weights for policy 1, policy_version 473671 (0.0007) [2023-12-27 22:38:03,931][106226] Updated weights for policy 0, policy_version 472272 (0.0007) [2023-12-27 22:38:03,982][106226] Updated weights for policy 0, policy_version 472282 (0.0008) [2023-12-27 22:38:04,038][106226] Updated weights for policy 0, policy_version 472292 (0.0008) [2023-12-27 22:38:04,073][106225] Updated weights for policy 1, policy_version 473681 (0.0008) [2023-12-27 22:38:04,134][106225] Updated weights for policy 1, policy_version 473691 (0.0010) [2023-12-27 22:38:04,203][106225] Updated weights for policy 1, policy_version 473701 (0.0011) [2023-12-27 22:38:04,267][106225] Updated weights for policy 1, policy_version 473711 (0.0010) [2023-12-27 22:38:04,818][106226] Updated weights for policy 0, policy_version 472302 (0.0008) [2023-12-27 22:38:04,880][106226] Updated weights for policy 0, policy_version 472312 (0.0007) [2023-12-27 22:38:04,888][106225] Updated weights for policy 1, policy_version 473721 (0.0010) [2023-12-27 22:38:04,937][106226] Updated weights for policy 0, policy_version 472322 (0.0008) [2023-12-27 22:38:04,948][106225] Updated weights for policy 1, policy_version 473731 (0.0007) [2023-12-27 22:38:04,998][106225] Updated weights for policy 1, policy_version 473741 (0.0010) [2023-12-27 22:38:05,658][106226] Updated weights for policy 0, policy_version 472332 (0.0007) [2023-12-27 22:38:05,708][106226] Updated weights for policy 0, policy_version 472342 (0.0007) [2023-12-27 22:38:05,713][106225] Updated weights for policy 1, policy_version 473751 (0.0006) [2023-12-27 22:38:05,765][106226] Updated weights for policy 0, policy_version 472352 (0.0007) [2023-12-27 22:38:05,771][106225] Updated weights for policy 1, policy_version 473761 (0.0008) [2023-12-27 22:38:05,831][106225] Updated weights for policy 1, policy_version 473771 (0.0006) [2023-12-27 22:38:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 242270208. Throughput: 0: 9902.3, 1: 9983.5. Samples: 242278688. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:06,175][105115] Avg episode reward: [(0, '-5.229'), (1, '-5.416')] [2023-12-27 22:38:06,430][106225] Updated weights for policy 1, policy_version 473781 (0.0008) [2023-12-27 22:38:06,488][106225] Updated weights for policy 1, policy_version 473791 (0.0010) [2023-12-27 22:38:06,547][106225] Updated weights for policy 1, policy_version 473801 (0.0010) [2023-12-27 22:38:06,559][106226] Updated weights for policy 0, policy_version 472362 (0.0008) [2023-12-27 22:38:06,621][106226] Updated weights for policy 0, policy_version 472372 (0.0007) [2023-12-27 22:38:06,686][106226] Updated weights for policy 0, policy_version 472382 (0.0008) [2023-12-27 22:38:06,738][106226] Updated weights for policy 0, policy_version 472392 (0.0007) [2023-12-27 22:38:07,287][106225] Updated weights for policy 1, policy_version 473811 (0.0010) [2023-12-27 22:38:07,346][106225] Updated weights for policy 1, policy_version 473821 (0.0010) [2023-12-27 22:38:07,366][106226] Updated weights for policy 0, policy_version 472402 (0.0008) [2023-12-27 22:38:07,396][106225] Updated weights for policy 1, policy_version 473831 (0.0010) [2023-12-27 22:38:07,414][106226] Updated weights for policy 0, policy_version 472412 (0.0005) [2023-12-27 22:38:07,467][106226] Updated weights for policy 0, policy_version 472422 (0.0006) [2023-12-27 22:38:08,117][106225] Updated weights for policy 1, policy_version 473841 (0.0010) [2023-12-27 22:38:08,167][106225] Updated weights for policy 1, policy_version 473851 (0.0010) [2023-12-27 22:38:08,186][106226] Updated weights for policy 0, policy_version 472432 (0.0008) [2023-12-27 22:38:08,226][106225] Updated weights for policy 1, policy_version 473861 (0.0010) [2023-12-27 22:38:08,239][106226] Updated weights for policy 0, policy_version 472442 (0.0006) [2023-12-27 22:38:08,279][106225] Updated weights for policy 1, policy_version 473871 (0.0010) [2023-12-27 22:38:08,289][106226] Updated weights for policy 0, policy_version 472452 (0.0006) [2023-12-27 22:38:08,899][106225] Updated weights for policy 1, policy_version 473881 (0.0006) [2023-12-27 22:38:08,946][106225] Updated weights for policy 1, policy_version 473891 (0.0005) [2023-12-27 22:38:09,009][106225] Updated weights for policy 1, policy_version 473901 (0.0007) [2023-12-27 22:38:09,083][106226] Updated weights for policy 0, policy_version 472462 (0.0010) [2023-12-27 22:38:09,139][106226] Updated weights for policy 0, policy_version 472472 (0.0008) [2023-12-27 22:38:09,188][106226] Updated weights for policy 0, policy_version 472482 (0.0008) [2023-12-27 22:38:09,688][106225] Updated weights for policy 1, policy_version 473911 (0.0008) [2023-12-27 22:38:09,749][106225] Updated weights for policy 1, policy_version 473921 (0.0007) [2023-12-27 22:38:09,810][106225] Updated weights for policy 1, policy_version 473931 (0.0009) [2023-12-27 22:38:09,948][106226] Updated weights for policy 0, policy_version 472492 (0.0007) [2023-12-27 22:38:10,016][106226] Updated weights for policy 0, policy_version 472502 (0.0009) [2023-12-27 22:38:10,085][106226] Updated weights for policy 0, policy_version 472512 (0.0008) [2023-12-27 22:38:10,559][106225] Updated weights for policy 1, policy_version 473941 (0.0007) [2023-12-27 22:38:10,608][106225] Updated weights for policy 1, policy_version 473951 (0.0005) [2023-12-27 22:38:10,668][106226] Updated weights for policy 0, policy_version 472522 (0.0007) [2023-12-27 22:38:10,698][106225] Updated weights for policy 1, policy_version 473961 (0.0005) [2023-12-27 22:38:10,728][106226] Updated weights for policy 0, policy_version 472532 (0.0007) [2023-12-27 22:38:10,784][106226] Updated weights for policy 0, policy_version 472542 (0.0009) [2023-12-27 22:38:10,843][106226] Updated weights for policy 0, policy_version 472552 (0.0009) [2023-12-27 22:38:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 242368512. Throughput: 0: 9940.0, 1: 9980.6. Samples: 242338100. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:11,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-5.625')] [2023-12-27 22:38:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000473968_121364480.pth... [2023-12-27 22:38:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000472552_121004032.pth... [2023-12-27 22:38:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000472784_121061376.pth [2023-12-27 22:38:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000471400_120709120.pth [2023-12-27 22:38:11,279][106225] Updated weights for policy 1, policy_version 473972 (0.0007) [2023-12-27 22:38:11,343][106225] Updated weights for policy 1, policy_version 473982 (0.0009) [2023-12-27 22:38:11,417][106225] Updated weights for policy 1, policy_version 473992 (0.0007) [2023-12-27 22:38:11,665][106226] Updated weights for policy 0, policy_version 472562 (0.0010) [2023-12-27 22:38:11,732][106226] Updated weights for policy 0, policy_version 472572 (0.0010) [2023-12-27 22:38:11,793][106226] Updated weights for policy 0, policy_version 472582 (0.0006) [2023-12-27 22:38:12,159][106225] Updated weights for policy 1, policy_version 474002 (0.0008) [2023-12-27 22:38:12,211][106225] Updated weights for policy 1, policy_version 474012 (0.0010) [2023-12-27 22:38:12,265][106225] Updated weights for policy 1, policy_version 474022 (0.0010) [2023-12-27 22:38:12,328][106225] Updated weights for policy 1, policy_version 474032 (0.0010) [2023-12-27 22:38:12,517][106226] Updated weights for policy 0, policy_version 472592 (0.0010) [2023-12-27 22:38:12,579][106226] Updated weights for policy 0, policy_version 472602 (0.0011) [2023-12-27 22:38:12,641][106226] Updated weights for policy 0, policy_version 472612 (0.0011) [2023-12-27 22:38:13,059][106225] Updated weights for policy 1, policy_version 474042 (0.0010) [2023-12-27 22:38:13,112][106225] Updated weights for policy 1, policy_version 474052 (0.0010) [2023-12-27 22:38:13,162][106225] Updated weights for policy 1, policy_version 474062 (0.0010) [2023-12-27 22:38:13,306][106226] Updated weights for policy 0, policy_version 472622 (0.0011) [2023-12-27 22:38:13,358][106226] Updated weights for policy 0, policy_version 472632 (0.0010) [2023-12-27 22:38:13,411][106226] Updated weights for policy 0, policy_version 472642 (0.0010) [2023-12-27 22:38:13,891][106225] Updated weights for policy 1, policy_version 474072 (0.0010) [2023-12-27 22:38:13,937][106225] Updated weights for policy 1, policy_version 474082 (0.0010) [2023-12-27 22:38:13,996][106225] Updated weights for policy 1, policy_version 474092 (0.0010) [2023-12-27 22:38:14,133][106226] Updated weights for policy 0, policy_version 472652 (0.0011) [2023-12-27 22:38:14,196][106226] Updated weights for policy 0, policy_version 472662 (0.0010) [2023-12-27 22:38:14,246][106226] Updated weights for policy 0, policy_version 472672 (0.0010) [2023-12-27 22:38:14,714][106225] Updated weights for policy 1, policy_version 474102 (0.0010) [2023-12-27 22:38:14,777][106225] Updated weights for policy 1, policy_version 474112 (0.0010) [2023-12-27 22:38:14,843][106225] Updated weights for policy 1, policy_version 474122 (0.0010) [2023-12-27 22:38:14,980][106226] Updated weights for policy 0, policy_version 472682 (0.0010) [2023-12-27 22:38:15,048][106226] Updated weights for policy 0, policy_version 472692 (0.0011) [2023-12-27 22:38:15,103][106226] Updated weights for policy 0, policy_version 472702 (0.0010) [2023-12-27 22:38:15,151][106226] Updated weights for policy 0, policy_version 472712 (0.0011) [2023-12-27 22:38:15,583][106225] Updated weights for policy 1, policy_version 474132 (0.0010) [2023-12-27 22:38:15,637][106225] Updated weights for policy 1, policy_version 474142 (0.0010) [2023-12-27 22:38:15,708][106225] Updated weights for policy 1, policy_version 474152 (0.0010) [2023-12-27 22:38:15,812][106226] Updated weights for policy 0, policy_version 472722 (0.0005) [2023-12-27 22:38:15,858][106226] Updated weights for policy 0, policy_version 472732 (0.0005) [2023-12-27 22:38:15,910][106226] Updated weights for policy 0, policy_version 472742 (0.0006) [2023-12-27 22:38:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 242466816. Throughput: 0: 9855.5, 1: 9894.4. Samples: 242455420. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:16,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-5.423')] [2023-12-27 22:38:16,430][106225] Updated weights for policy 1, policy_version 474162 (0.0010) [2023-12-27 22:38:16,491][106225] Updated weights for policy 1, policy_version 474172 (0.0008) [2023-12-27 22:38:16,511][106226] Updated weights for policy 0, policy_version 472752 (0.0006) [2023-12-27 22:38:16,542][106225] Updated weights for policy 1, policy_version 474182 (0.0007) [2023-12-27 22:38:16,556][106226] Updated weights for policy 0, policy_version 472762 (0.0009) [2023-12-27 22:38:16,593][106225] Updated weights for policy 1, policy_version 474192 (0.0007) [2023-12-27 22:38:16,604][106226] Updated weights for policy 0, policy_version 472772 (0.0005) [2023-12-27 22:38:17,235][106225] Updated weights for policy 1, policy_version 474202 (0.0006) [2023-12-27 22:38:17,253][106226] Updated weights for policy 0, policy_version 472782 (0.0005) [2023-12-27 22:38:17,300][106225] Updated weights for policy 1, policy_version 474212 (0.0005) [2023-12-27 22:38:17,319][106226] Updated weights for policy 0, policy_version 472792 (0.0008) [2023-12-27 22:38:17,344][106225] Updated weights for policy 1, policy_version 474222 (0.0005) [2023-12-27 22:38:17,369][106226] Updated weights for policy 0, policy_version 472802 (0.0010) [2023-12-27 22:38:17,927][106225] Updated weights for policy 1, policy_version 474232 (0.0006) [2023-12-27 22:38:17,991][106225] Updated weights for policy 1, policy_version 474242 (0.0010) [2023-12-27 22:38:18,056][106225] Updated weights for policy 1, policy_version 474252 (0.0007) [2023-12-27 22:38:18,060][106226] Updated weights for policy 0, policy_version 472812 (0.0010) [2023-12-27 22:38:18,115][106226] Updated weights for policy 0, policy_version 472822 (0.0007) [2023-12-27 22:38:18,176][106226] Updated weights for policy 0, policy_version 472832 (0.0008) [2023-12-27 22:38:18,626][106225] Updated weights for policy 1, policy_version 474262 (0.0009) [2023-12-27 22:38:18,684][106225] Updated weights for policy 1, policy_version 474272 (0.0010) [2023-12-27 22:38:18,735][106225] Updated weights for policy 1, policy_version 474282 (0.0010) [2023-12-27 22:38:18,895][106226] Updated weights for policy 0, policy_version 472842 (0.0009) [2023-12-27 22:38:18,952][106226] Updated weights for policy 0, policy_version 472852 (0.0011) [2023-12-27 22:38:19,018][106226] Updated weights for policy 0, policy_version 472862 (0.0010) [2023-12-27 22:38:19,088][106226] Updated weights for policy 0, policy_version 472872 (0.0011) [2023-12-27 22:38:19,398][106225] Updated weights for policy 1, policy_version 474292 (0.0010) [2023-12-27 22:38:19,462][106225] Updated weights for policy 1, policy_version 474302 (0.0010) [2023-12-27 22:38:19,525][106225] Updated weights for policy 1, policy_version 474312 (0.0010) [2023-12-27 22:38:19,863][106226] Updated weights for policy 0, policy_version 472882 (0.0007) [2023-12-27 22:38:19,923][106226] Updated weights for policy 0, policy_version 472892 (0.0008) [2023-12-27 22:38:19,984][106226] Updated weights for policy 0, policy_version 472902 (0.0008) [2023-12-27 22:38:20,239][106225] Updated weights for policy 1, policy_version 474322 (0.0010) [2023-12-27 22:38:20,303][106225] Updated weights for policy 1, policy_version 474332 (0.0008) [2023-12-27 22:38:20,371][106225] Updated weights for policy 1, policy_version 474342 (0.0009) [2023-12-27 22:38:20,436][106225] Updated weights for policy 1, policy_version 474352 (0.0011) [2023-12-27 22:38:20,711][106226] Updated weights for policy 0, policy_version 472912 (0.0008) [2023-12-27 22:38:20,784][106226] Updated weights for policy 0, policy_version 472922 (0.0008) [2023-12-27 22:38:20,839][106226] Updated weights for policy 0, policy_version 472932 (0.0008) [2023-12-27 22:38:21,173][106225] Updated weights for policy 1, policy_version 474362 (0.0009) [2023-12-27 22:38:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 242565120. Throughput: 0: 9889.5, 1: 9986.5. Samples: 242576996. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:21,175][105115] Avg episode reward: [(0, '-5.258'), (1, '-5.733')] [2023-12-27 22:38:21,238][106225] Updated weights for policy 1, policy_version 474372 (0.0009) [2023-12-27 22:38:21,307][106225] Updated weights for policy 1, policy_version 474382 (0.0011) [2023-12-27 22:38:21,656][106226] Updated weights for policy 0, policy_version 472942 (0.0008) [2023-12-27 22:38:21,724][106226] Updated weights for policy 0, policy_version 472952 (0.0009) [2023-12-27 22:38:21,790][106226] Updated weights for policy 0, policy_version 472962 (0.0009) [2023-12-27 22:38:22,066][106225] Updated weights for policy 1, policy_version 474392 (0.0011) [2023-12-27 22:38:22,124][106225] Updated weights for policy 1, policy_version 474402 (0.0010) [2023-12-27 22:38:22,182][106225] Updated weights for policy 1, policy_version 474412 (0.0010) [2023-12-27 22:38:22,544][106226] Updated weights for policy 0, policy_version 472972 (0.0008) [2023-12-27 22:38:22,603][106226] Updated weights for policy 0, policy_version 472982 (0.0008) [2023-12-27 22:38:22,671][106226] Updated weights for policy 0, policy_version 472992 (0.0009) [2023-12-27 22:38:22,939][106225] Updated weights for policy 1, policy_version 474422 (0.0010) [2023-12-27 22:38:23,003][106225] Updated weights for policy 1, policy_version 474432 (0.0010) [2023-12-27 22:38:23,061][106225] Updated weights for policy 1, policy_version 474442 (0.0010) [2023-12-27 22:38:23,404][106226] Updated weights for policy 0, policy_version 473002 (0.0011) [2023-12-27 22:38:23,455][106226] Updated weights for policy 0, policy_version 473012 (0.0010) [2023-12-27 22:38:23,510][106226] Updated weights for policy 0, policy_version 473022 (0.0010) [2023-12-27 22:38:23,561][106226] Updated weights for policy 0, policy_version 473032 (0.0010) [2023-12-27 22:38:23,749][106225] Updated weights for policy 1, policy_version 474452 (0.0010) [2023-12-27 22:38:23,800][106225] Updated weights for policy 1, policy_version 474462 (0.0010) [2023-12-27 22:38:23,851][106225] Updated weights for policy 1, policy_version 474472 (0.0010) [2023-12-27 22:38:24,218][106226] Updated weights for policy 0, policy_version 473042 (0.0006) [2023-12-27 22:38:24,283][106226] Updated weights for policy 0, policy_version 473052 (0.0006) [2023-12-27 22:38:24,344][106226] Updated weights for policy 0, policy_version 473062 (0.0010) [2023-12-27 22:38:24,519][106225] Updated weights for policy 1, policy_version 474482 (0.0010) [2023-12-27 22:38:24,577][106225] Updated weights for policy 1, policy_version 474492 (0.0010) [2023-12-27 22:38:24,638][106225] Updated weights for policy 1, policy_version 474502 (0.0011) [2023-12-27 22:38:24,695][106225] Updated weights for policy 1, policy_version 474512 (0.0010) [2023-12-27 22:38:25,040][106226] Updated weights for policy 0, policy_version 473072 (0.0008) [2023-12-27 22:38:25,090][106226] Updated weights for policy 0, policy_version 473082 (0.0007) [2023-12-27 22:38:25,139][106226] Updated weights for policy 0, policy_version 473092 (0.0008) [2023-12-27 22:38:25,433][106225] Updated weights for policy 1, policy_version 474522 (0.0010) [2023-12-27 22:38:25,499][106225] Updated weights for policy 1, policy_version 474532 (0.0010) [2023-12-27 22:38:25,541][106225] Updated weights for policy 1, policy_version 474542 (0.0010) [2023-12-27 22:38:25,745][106226] Updated weights for policy 0, policy_version 473102 (0.0007) [2023-12-27 22:38:25,807][106226] Updated weights for policy 0, policy_version 473112 (0.0007) [2023-12-27 22:38:25,870][106226] Updated weights for policy 0, policy_version 473122 (0.0006) [2023-12-27 22:38:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 242663424. Throughput: 0: 9782.2, 1: 9978.2. Samples: 242633104. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:26,176][105115] Avg episode reward: [(0, '-5.167'), (1, '-5.377')] [2023-12-27 22:38:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000473128_121151488.pth... [2023-12-27 22:38:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000472008_120864768.pth [2023-12-27 22:38:26,209][106225] Updated weights for policy 1, policy_version 474552 (0.0008) [2023-12-27 22:38:26,269][106225] Updated weights for policy 1, policy_version 474562 (0.0007) [2023-12-27 22:38:26,325][106225] Updated weights for policy 1, policy_version 474572 (0.0005) [2023-12-27 22:38:26,343][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000474576_121520128.pth... [2023-12-27 22:38:26,346][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000473392_121217024.pth [2023-12-27 22:38:26,487][106226] Updated weights for policy 0, policy_version 473132 (0.0007) [2023-12-27 22:38:26,535][106226] Updated weights for policy 0, policy_version 473142 (0.0007) [2023-12-27 22:38:26,583][106226] Updated weights for policy 0, policy_version 473152 (0.0006) [2023-12-27 22:38:26,864][106225] Updated weights for policy 1, policy_version 474582 (0.0007) [2023-12-27 22:38:26,918][106225] Updated weights for policy 1, policy_version 474592 (0.0009) [2023-12-27 22:38:26,971][106225] Updated weights for policy 1, policy_version 474602 (0.0008) [2023-12-27 22:38:27,247][106226] Updated weights for policy 0, policy_version 473163 (0.0009) [2023-12-27 22:38:27,301][106226] Updated weights for policy 0, policy_version 473173 (0.0007) [2023-12-27 22:38:27,352][106226] Updated weights for policy 0, policy_version 473183 (0.0007) [2023-12-27 22:38:27,607][106225] Updated weights for policy 1, policy_version 474612 (0.0009) [2023-12-27 22:38:27,665][106225] Updated weights for policy 1, policy_version 474622 (0.0010) [2023-12-27 22:38:27,715][106225] Updated weights for policy 1, policy_version 474632 (0.0010) [2023-12-27 22:38:27,962][106226] Updated weights for policy 0, policy_version 473193 (0.0008) [2023-12-27 22:38:28,022][106226] Updated weights for policy 0, policy_version 473203 (0.0005) [2023-12-27 22:38:28,079][106226] Updated weights for policy 0, policy_version 473213 (0.0005) [2023-12-27 22:38:28,137][106226] Updated weights for policy 0, policy_version 473223 (0.0005) [2023-12-27 22:38:28,469][106225] Updated weights for policy 1, policy_version 474642 (0.0010) [2023-12-27 22:38:28,527][106225] Updated weights for policy 1, policy_version 474652 (0.0011) [2023-12-27 22:38:28,584][106225] Updated weights for policy 1, policy_version 474662 (0.0010) [2023-12-27 22:38:28,637][106225] Updated weights for policy 1, policy_version 474672 (0.0010) [2023-12-27 22:38:28,696][106226] Updated weights for policy 0, policy_version 473233 (0.0006) [2023-12-27 22:38:28,750][106226] Updated weights for policy 0, policy_version 473243 (0.0007) [2023-12-27 22:38:28,808][106226] Updated weights for policy 0, policy_version 473253 (0.0007) [2023-12-27 22:38:29,382][106226] Updated weights for policy 0, policy_version 473263 (0.0007) [2023-12-27 22:38:29,423][106225] Updated weights for policy 1, policy_version 474682 (0.0009) [2023-12-27 22:38:29,438][106226] Updated weights for policy 0, policy_version 473273 (0.0006) [2023-12-27 22:38:29,484][106225] Updated weights for policy 1, policy_version 474692 (0.0008) [2023-12-27 22:38:29,493][106226] Updated weights for policy 0, policy_version 473283 (0.0009) [2023-12-27 22:38:29,544][106225] Updated weights for policy 1, policy_version 474702 (0.0006) [2023-12-27 22:38:30,150][106225] Updated weights for policy 1, policy_version 474712 (0.0005) [2023-12-27 22:38:30,199][106225] Updated weights for policy 1, policy_version 474722 (0.0006) [2023-12-27 22:38:30,228][106226] Updated weights for policy 0, policy_version 473293 (0.0007) [2023-12-27 22:38:30,249][106225] Updated weights for policy 1, policy_version 474732 (0.0006) [2023-12-27 22:38:30,291][106226] Updated weights for policy 0, policy_version 473303 (0.0008) [2023-12-27 22:38:30,349][106226] Updated weights for policy 0, policy_version 473313 (0.0008) [2023-12-27 22:38:30,868][106225] Updated weights for policy 1, policy_version 474742 (0.0005) [2023-12-27 22:38:30,925][106225] Updated weights for policy 1, policy_version 474752 (0.0007) [2023-12-27 22:38:30,977][106225] Updated weights for policy 1, policy_version 474762 (0.0009) [2023-12-27 22:38:31,113][106226] Updated weights for policy 0, policy_version 473323 (0.0009) [2023-12-27 22:38:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 242769920. Throughput: 0: 9927.8, 1: 10087.0. Samples: 242760528. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:31,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-5.662')] [2023-12-27 22:38:31,186][106226] Updated weights for policy 0, policy_version 473333 (0.0009) [2023-12-27 22:38:31,242][106226] Updated weights for policy 0, policy_version 473343 (0.0007) [2023-12-27 22:38:31,607][106225] Updated weights for policy 1, policy_version 474772 (0.0007) [2023-12-27 22:38:31,672][106225] Updated weights for policy 1, policy_version 474782 (0.0009) [2023-12-27 22:38:31,752][106225] Updated weights for policy 1, policy_version 474792 (0.0008) [2023-12-27 22:38:31,897][106226] Updated weights for policy 0, policy_version 473353 (0.0007) [2023-12-27 22:38:31,957][106226] Updated weights for policy 0, policy_version 473363 (0.0007) [2023-12-27 22:38:32,018][106226] Updated weights for policy 0, policy_version 473373 (0.0008) [2023-12-27 22:38:32,082][106226] Updated weights for policy 0, policy_version 473383 (0.0008) [2023-12-27 22:38:32,455][106225] Updated weights for policy 1, policy_version 474802 (0.0010) [2023-12-27 22:38:32,515][106225] Updated weights for policy 1, policy_version 474812 (0.0011) [2023-12-27 22:38:32,568][106225] Updated weights for policy 1, policy_version 474822 (0.0010) [2023-12-27 22:38:32,618][106225] Updated weights for policy 1, policy_version 474832 (0.0010) [2023-12-27 22:38:32,788][106226] Updated weights for policy 0, policy_version 473393 (0.0008) [2023-12-27 22:38:32,852][106226] Updated weights for policy 0, policy_version 473403 (0.0006) [2023-12-27 22:38:32,915][106226] Updated weights for policy 0, policy_version 473413 (0.0007) [2023-12-27 22:38:33,335][106225] Updated weights for policy 1, policy_version 474842 (0.0010) [2023-12-27 22:38:33,393][106225] Updated weights for policy 1, policy_version 474852 (0.0010) [2023-12-27 22:38:33,446][106225] Updated weights for policy 1, policy_version 474862 (0.0010) [2023-12-27 22:38:33,587][106226] Updated weights for policy 0, policy_version 473423 (0.0007) [2023-12-27 22:38:33,642][106226] Updated weights for policy 0, policy_version 473433 (0.0007) [2023-12-27 22:38:33,704][106226] Updated weights for policy 0, policy_version 473443 (0.0006) [2023-12-27 22:38:34,055][106225] Updated weights for policy 1, policy_version 474872 (0.0006) [2023-12-27 22:38:34,100][106225] Updated weights for policy 1, policy_version 474882 (0.0005) [2023-12-27 22:38:34,180][106225] Updated weights for policy 1, policy_version 474892 (0.0007) [2023-12-27 22:38:34,369][106226] Updated weights for policy 0, policy_version 473453 (0.0007) [2023-12-27 22:38:34,437][106226] Updated weights for policy 0, policy_version 473463 (0.0009) [2023-12-27 22:38:34,495][106226] Updated weights for policy 0, policy_version 473473 (0.0010) [2023-12-27 22:38:34,812][106225] Updated weights for policy 1, policy_version 474902 (0.0005) [2023-12-27 22:38:34,873][106225] Updated weights for policy 1, policy_version 474912 (0.0005) [2023-12-27 22:38:34,926][106225] Updated weights for policy 1, policy_version 474922 (0.0005) [2023-12-27 22:38:35,168][106226] Updated weights for policy 0, policy_version 473483 (0.0010) [2023-12-27 22:38:35,222][106226] Updated weights for policy 0, policy_version 473493 (0.0010) [2023-12-27 22:38:35,278][106226] Updated weights for policy 0, policy_version 473503 (0.0010) [2023-12-27 22:38:35,502][106225] Updated weights for policy 1, policy_version 474932 (0.0007) [2023-12-27 22:38:35,558][106225] Updated weights for policy 1, policy_version 474942 (0.0010) [2023-12-27 22:38:35,621][106225] Updated weights for policy 1, policy_version 474952 (0.0006) [2023-12-27 22:38:35,943][106226] Updated weights for policy 0, policy_version 473513 (0.0007) [2023-12-27 22:38:35,996][106226] Updated weights for policy 0, policy_version 473523 (0.0010) [2023-12-27 22:38:36,049][106226] Updated weights for policy 0, policy_version 473533 (0.0010) [2023-12-27 22:38:36,118][106226] Updated weights for policy 0, policy_version 473543 (0.0011) [2023-12-27 22:38:36,175][105115] Fps is (10 sec: 21299.6, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 242876416. Throughput: 0: 9895.3, 1: 10167.5. Samples: 242884576. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:36,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-5.810')] [2023-12-27 22:38:36,254][106225] Updated weights for policy 1, policy_version 474962 (0.0005) [2023-12-27 22:38:36,318][106225] Updated weights for policy 1, policy_version 474972 (0.0006) [2023-12-27 22:38:36,384][106225] Updated weights for policy 1, policy_version 474982 (0.0008) [2023-12-27 22:38:36,450][106225] Updated weights for policy 1, policy_version 474992 (0.0009) [2023-12-27 22:38:36,937][106226] Updated weights for policy 0, policy_version 473553 (0.0009) [2023-12-27 22:38:36,980][106225] Updated weights for policy 1, policy_version 475002 (0.0010) [2023-12-27 22:38:36,994][106226] Updated weights for policy 0, policy_version 473563 (0.0008) [2023-12-27 22:38:37,033][106225] Updated weights for policy 1, policy_version 475012 (0.0010) [2023-12-27 22:38:37,045][106226] Updated weights for policy 0, policy_version 473573 (0.0008) [2023-12-27 22:38:37,093][106225] Updated weights for policy 1, policy_version 475022 (0.0010) [2023-12-27 22:38:37,727][106225] Updated weights for policy 1, policy_version 475032 (0.0008) [2023-12-27 22:38:37,790][106225] Updated weights for policy 1, policy_version 475042 (0.0010) [2023-12-27 22:38:37,844][106225] Updated weights for policy 1, policy_version 475052 (0.0010) [2023-12-27 22:38:37,853][106226] Updated weights for policy 0, policy_version 473583 (0.0006) [2023-12-27 22:38:37,907][106226] Updated weights for policy 0, policy_version 473593 (0.0008) [2023-12-27 22:38:37,957][106226] Updated weights for policy 0, policy_version 473603 (0.0009) [2023-12-27 22:38:38,494][106225] Updated weights for policy 1, policy_version 475062 (0.0007) [2023-12-27 22:38:38,561][106225] Updated weights for policy 1, policy_version 475072 (0.0006) [2023-12-27 22:38:38,621][106225] Updated weights for policy 1, policy_version 475082 (0.0005) [2023-12-27 22:38:38,803][106226] Updated weights for policy 0, policy_version 473613 (0.0009) [2023-12-27 22:38:38,867][106226] Updated weights for policy 0, policy_version 473623 (0.0010) [2023-12-27 22:38:38,927][106226] Updated weights for policy 0, policy_version 473633 (0.0010) [2023-12-27 22:38:39,177][106225] Updated weights for policy 1, policy_version 475092 (0.0006) [2023-12-27 22:38:39,234][106225] Updated weights for policy 1, policy_version 475102 (0.0009) [2023-12-27 22:38:39,292][106225] Updated weights for policy 1, policy_version 475112 (0.0009) [2023-12-27 22:38:39,710][106226] Updated weights for policy 0, policy_version 473643 (0.0009) [2023-12-27 22:38:39,768][106226] Updated weights for policy 0, policy_version 473653 (0.0009) [2023-12-27 22:38:39,831][106226] Updated weights for policy 0, policy_version 473663 (0.0008) [2023-12-27 22:38:40,098][106225] Updated weights for policy 1, policy_version 475122 (0.0008) [2023-12-27 22:38:40,151][106225] Updated weights for policy 1, policy_version 475132 (0.0008) [2023-12-27 22:38:40,208][106225] Updated weights for policy 1, policy_version 475142 (0.0008) [2023-12-27 22:38:40,268][106225] Updated weights for policy 1, policy_version 475152 (0.0009) [2023-12-27 22:38:40,570][106226] Updated weights for policy 0, policy_version 473673 (0.0009) [2023-12-27 22:38:40,639][106226] Updated weights for policy 0, policy_version 473683 (0.0009) [2023-12-27 22:38:40,703][106226] Updated weights for policy 0, policy_version 473693 (0.0009) [2023-12-27 22:38:40,764][106226] Updated weights for policy 0, policy_version 473703 (0.0006) [2023-12-27 22:38:40,972][106225] Updated weights for policy 1, policy_version 475162 (0.0007) [2023-12-27 22:38:41,024][106225] Updated weights for policy 1, policy_version 475172 (0.0008) [2023-12-27 22:38:41,089][106225] Updated weights for policy 1, policy_version 475182 (0.0007) [2023-12-27 22:38:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 242974720. Throughput: 0: 9814.8, 1: 10234.1. Samples: 242943568. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:41,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-5.608')] [2023-12-27 22:38:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000473704_121298944.pth... [2023-12-27 22:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000475184_121675776.pth... [2023-12-27 22:38:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000472552_121004032.pth [2023-12-27 22:38:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000473968_121364480.pth [2023-12-27 22:38:41,526][106226] Updated weights for policy 0, policy_version 473713 (0.0008) [2023-12-27 22:38:41,590][106226] Updated weights for policy 0, policy_version 473723 (0.0008) [2023-12-27 22:38:41,658][106226] Updated weights for policy 0, policy_version 473733 (0.0009) [2023-12-27 22:38:41,885][106225] Updated weights for policy 1, policy_version 475192 (0.0008) [2023-12-27 22:38:41,946][106225] Updated weights for policy 1, policy_version 475202 (0.0010) [2023-12-27 22:38:42,008][106225] Updated weights for policy 1, policy_version 475212 (0.0011) [2023-12-27 22:38:42,395][106226] Updated weights for policy 0, policy_version 473743 (0.0008) [2023-12-27 22:38:42,460][106226] Updated weights for policy 0, policy_version 473753 (0.0009) [2023-12-27 22:38:42,523][106226] Updated weights for policy 0, policy_version 473763 (0.0008) [2023-12-27 22:38:42,778][106225] Updated weights for policy 1, policy_version 475222 (0.0007) [2023-12-27 22:38:42,841][106225] Updated weights for policy 1, policy_version 475232 (0.0006) [2023-12-27 22:38:42,907][106225] Updated weights for policy 1, policy_version 475242 (0.0005) [2023-12-27 22:38:43,299][106226] Updated weights for policy 0, policy_version 473773 (0.0007) [2023-12-27 22:38:43,357][106226] Updated weights for policy 0, policy_version 473783 (0.0008) [2023-12-27 22:38:43,406][106226] Updated weights for policy 0, policy_version 473793 (0.0008) [2023-12-27 22:38:43,521][106225] Updated weights for policy 1, policy_version 475252 (0.0008) [2023-12-27 22:38:43,580][106225] Updated weights for policy 1, policy_version 475262 (0.0005) [2023-12-27 22:38:43,643][106225] Updated weights for policy 1, policy_version 475272 (0.0005) [2023-12-27 22:38:44,205][106226] Updated weights for policy 0, policy_version 473803 (0.0007) [2023-12-27 22:38:44,224][106225] Updated weights for policy 1, policy_version 475282 (0.0006) [2023-12-27 22:38:44,262][106226] Updated weights for policy 0, policy_version 473813 (0.0008) [2023-12-27 22:38:44,288][106225] Updated weights for policy 1, policy_version 475292 (0.0010) [2023-12-27 22:38:44,313][106226] Updated weights for policy 0, policy_version 473823 (0.0006) [2023-12-27 22:38:44,348][106225] Updated weights for policy 1, policy_version 475302 (0.0010) [2023-12-27 22:38:44,408][106225] Updated weights for policy 1, policy_version 475312 (0.0010) [2023-12-27 22:38:45,085][106225] Updated weights for policy 1, policy_version 475322 (0.0011) [2023-12-27 22:38:45,087][106226] Updated weights for policy 0, policy_version 473833 (0.0008) [2023-12-27 22:38:45,151][106226] Updated weights for policy 0, policy_version 473843 (0.0007) [2023-12-27 22:38:45,152][106225] Updated weights for policy 1, policy_version 475332 (0.0010) [2023-12-27 22:38:45,212][106226] Updated weights for policy 0, policy_version 473853 (0.0008) [2023-12-27 22:38:45,217][106225] Updated weights for policy 1, policy_version 475342 (0.0011) [2023-12-27 22:38:45,272][106226] Updated weights for policy 0, policy_version 473863 (0.0008) [2023-12-27 22:38:45,841][106225] Updated weights for policy 1, policy_version 475352 (0.0007) [2023-12-27 22:38:45,870][106226] Updated weights for policy 0, policy_version 473873 (0.0006) [2023-12-27 22:38:45,907][106225] Updated weights for policy 1, policy_version 475362 (0.0006) [2023-12-27 22:38:45,935][106226] Updated weights for policy 0, policy_version 473883 (0.0009) [2023-12-27 22:38:45,964][106225] Updated weights for policy 1, policy_version 475372 (0.0006) [2023-12-27 22:38:45,991][106226] Updated weights for policy 0, policy_version 473893 (0.0006) [2023-12-27 22:38:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 243073024. Throughput: 0: 9742.9, 1: 10229.9. Samples: 243058140. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-27 22:38:46,175][105115] Avg episode reward: [(0, '-4.946'), (1, '-5.742')] [2023-12-27 22:38:46,533][106226] Updated weights for policy 0, policy_version 473903 (0.0005) [2023-12-27 22:38:46,594][106226] Updated weights for policy 0, policy_version 473913 (0.0006) [2023-12-27 22:38:46,662][106226] Updated weights for policy 0, policy_version 473923 (0.0006) [2023-12-27 22:38:46,686][106225] Updated weights for policy 1, policy_version 475382 (0.0007) [2023-12-27 22:38:46,735][106225] Updated weights for policy 1, policy_version 475392 (0.0009) [2023-12-27 22:38:46,781][106225] Updated weights for policy 1, policy_version 475402 (0.0007) [2023-12-27 22:38:47,194][106226] Updated weights for policy 0, policy_version 473933 (0.0007) [2023-12-27 22:38:47,252][106226] Updated weights for policy 0, policy_version 473943 (0.0008) [2023-12-27 22:38:47,320][106226] Updated weights for policy 0, policy_version 473953 (0.0009) [2023-12-27 22:38:47,459][106225] Updated weights for policy 1, policy_version 475412 (0.0007) [2023-12-27 22:38:47,517][106225] Updated weights for policy 1, policy_version 475422 (0.0009) [2023-12-27 22:38:47,567][106225] Updated weights for policy 1, policy_version 475432 (0.0009) [2023-12-27 22:38:48,002][106226] Updated weights for policy 0, policy_version 473963 (0.0009) [2023-12-27 22:38:48,051][106226] Updated weights for policy 0, policy_version 473973 (0.0009) [2023-12-27 22:38:48,107][106226] Updated weights for policy 0, policy_version 473983 (0.0006) [2023-12-27 22:38:48,199][106225] Updated weights for policy 1, policy_version 475442 (0.0009) [2023-12-27 22:38:48,253][106225] Updated weights for policy 1, policy_version 475452 (0.0008) [2023-12-27 22:38:48,303][106225] Updated weights for policy 1, policy_version 475462 (0.0008) [2023-12-27 22:38:48,366][106225] Updated weights for policy 1, policy_version 475472 (0.0009) [2023-12-27 22:38:48,758][106226] Updated weights for policy 0, policy_version 473993 (0.0008) [2023-12-27 22:38:48,816][106226] Updated weights for policy 0, policy_version 474003 (0.0006) [2023-12-27 22:38:48,883][106226] Updated weights for policy 0, policy_version 474013 (0.0006) [2023-12-27 22:38:48,939][106226] Updated weights for policy 0, policy_version 474023 (0.0006) [2023-12-27 22:38:49,162][106225] Updated weights for policy 1, policy_version 475482 (0.0011) [2023-12-27 22:38:49,224][106225] Updated weights for policy 1, policy_version 475492 (0.0010) [2023-12-27 22:38:49,293][106225] Updated weights for policy 1, policy_version 475502 (0.0006) [2023-12-27 22:38:49,531][106226] Updated weights for policy 0, policy_version 474033 (0.0010) [2023-12-27 22:38:49,591][106226] Updated weights for policy 0, policy_version 474043 (0.0010) [2023-12-27 22:38:49,652][106226] Updated weights for policy 0, policy_version 474053 (0.0008) [2023-12-27 22:38:49,988][106225] Updated weights for policy 1, policy_version 475512 (0.0011) [2023-12-27 22:38:50,045][106225] Updated weights for policy 1, policy_version 475522 (0.0008) [2023-12-27 22:38:50,103][106225] Updated weights for policy 1, policy_version 475532 (0.0007) [2023-12-27 22:38:50,453][106226] Updated weights for policy 0, policy_version 474063 (0.0009) [2023-12-27 22:38:50,502][106226] Updated weights for policy 0, policy_version 474073 (0.0008) [2023-12-27 22:38:50,552][106226] Updated weights for policy 0, policy_version 474083 (0.0008) [2023-12-27 22:38:50,784][106225] Updated weights for policy 1, policy_version 475542 (0.0007) [2023-12-27 22:38:50,850][106225] Updated weights for policy 1, policy_version 475552 (0.0006) [2023-12-27 22:38:50,906][106225] Updated weights for policy 1, policy_version 475562 (0.0009) [2023-12-27 22:38:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 243171328. Throughput: 0: 9888.3, 1: 10178.1. Samples: 243181676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:38:51,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-5.767')] [2023-12-27 22:38:51,334][106226] Updated weights for policy 0, policy_version 474093 (0.0009) [2023-12-27 22:38:51,429][106226] Updated weights for policy 0, policy_version 474103 (0.0009) [2023-12-27 22:38:51,495][106226] Updated weights for policy 0, policy_version 474113 (0.0008) [2023-12-27 22:38:51,653][106225] Updated weights for policy 1, policy_version 475572 (0.0009) [2023-12-27 22:38:51,717][106225] Updated weights for policy 1, policy_version 475582 (0.0009) [2023-12-27 22:38:51,771][106225] Updated weights for policy 1, policy_version 475592 (0.0007) [2023-12-27 22:38:52,205][106226] Updated weights for policy 0, policy_version 474123 (0.0007) [2023-12-27 22:38:52,275][106226] Updated weights for policy 0, policy_version 474133 (0.0007) [2023-12-27 22:38:52,339][106226] Updated weights for policy 0, policy_version 474143 (0.0007) [2023-12-27 22:38:52,504][106225] Updated weights for policy 1, policy_version 475602 (0.0008) [2023-12-27 22:38:52,570][106225] Updated weights for policy 1, policy_version 475612 (0.0008) [2023-12-27 22:38:52,632][106225] Updated weights for policy 1, policy_version 475622 (0.0008) [2023-12-27 22:38:52,696][106225] Updated weights for policy 1, policy_version 475632 (0.0008) [2023-12-27 22:38:53,035][106226] Updated weights for policy 0, policy_version 474153 (0.0008) [2023-12-27 22:38:53,085][106226] Updated weights for policy 0, policy_version 474163 (0.0010) [2023-12-27 22:38:53,135][106226] Updated weights for policy 0, policy_version 474173 (0.0010) [2023-12-27 22:38:53,192][106226] Updated weights for policy 0, policy_version 474183 (0.0010) [2023-12-27 22:38:53,360][106225] Updated weights for policy 1, policy_version 475642 (0.0010) [2023-12-27 22:38:53,413][106225] Updated weights for policy 1, policy_version 475652 (0.0010) [2023-12-27 22:38:53,462][106225] Updated weights for policy 1, policy_version 475662 (0.0010) [2023-12-27 22:38:53,866][106226] Updated weights for policy 0, policy_version 474193 (0.0009) [2023-12-27 22:38:53,926][106226] Updated weights for policy 0, policy_version 474203 (0.0010) [2023-12-27 22:38:53,980][106226] Updated weights for policy 0, policy_version 474213 (0.0010) [2023-12-27 22:38:54,097][106225] Updated weights for policy 1, policy_version 475672 (0.0010) [2023-12-27 22:38:54,154][106225] Updated weights for policy 1, policy_version 475682 (0.0008) [2023-12-27 22:38:54,223][106225] Updated weights for policy 1, policy_version 475692 (0.0008) [2023-12-27 22:38:54,625][106226] Updated weights for policy 0, policy_version 474223 (0.0007) [2023-12-27 22:38:54,675][106226] Updated weights for policy 0, policy_version 474233 (0.0006) [2023-12-27 22:38:54,733][106226] Updated weights for policy 0, policy_version 474243 (0.0007) [2023-12-27 22:38:54,937][106225] Updated weights for policy 1, policy_version 475702 (0.0007) [2023-12-27 22:38:55,005][106225] Updated weights for policy 1, policy_version 475712 (0.0008) [2023-12-27 22:38:55,074][106225] Updated weights for policy 1, policy_version 475722 (0.0011) [2023-12-27 22:38:55,390][106226] Updated weights for policy 0, policy_version 474253 (0.0010) [2023-12-27 22:38:55,456][106226] Updated weights for policy 0, policy_version 474263 (0.0010) [2023-12-27 22:38:55,512][106226] Updated weights for policy 0, policy_version 474273 (0.0010) [2023-12-27 22:38:55,650][106225] Updated weights for policy 1, policy_version 475732 (0.0008) [2023-12-27 22:38:55,720][106225] Updated weights for policy 1, policy_version 475742 (0.0006) [2023-12-27 22:38:55,769][106225] Updated weights for policy 1, policy_version 475752 (0.0006) [2023-12-27 22:38:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 243269632. Throughput: 0: 9881.6, 1: 10144.2. Samples: 243239260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:38:56,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.468')] [2023-12-27 22:38:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000475760_121823232.pth... [2023-12-27 22:38:56,184][106226] Updated weights for policy 0, policy_version 474283 (0.0009) [2023-12-27 22:38:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000474576_121520128.pth [2023-12-27 22:38:56,239][106226] Updated weights for policy 0, policy_version 474293 (0.0007) [2023-12-27 22:38:56,301][106226] Updated weights for policy 0, policy_version 474303 (0.0005) [2023-12-27 22:38:56,348][106225] Updated weights for policy 1, policy_version 475762 (0.0006) [2023-12-27 22:38:56,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000474312_121454592.pth... [2023-12-27 22:38:56,356][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000473128_121151488.pth [2023-12-27 22:38:56,408][106225] Updated weights for policy 1, policy_version 475772 (0.0007) [2023-12-27 22:38:56,476][106225] Updated weights for policy 1, policy_version 475782 (0.0009) [2023-12-27 22:38:56,542][106225] Updated weights for policy 1, policy_version 475792 (0.0006) [2023-12-27 22:38:56,884][106226] Updated weights for policy 0, policy_version 474313 (0.0007) [2023-12-27 22:38:56,945][106226] Updated weights for policy 0, policy_version 474323 (0.0008) [2023-12-27 22:38:57,000][106226] Updated weights for policy 0, policy_version 474333 (0.0008) [2023-12-27 22:38:57,054][106226] Updated weights for policy 0, policy_version 474343 (0.0008) [2023-12-27 22:38:57,130][106225] Updated weights for policy 1, policy_version 475802 (0.0008) [2023-12-27 22:38:57,190][106225] Updated weights for policy 1, policy_version 475812 (0.0008) [2023-12-27 22:38:57,244][106225] Updated weights for policy 1, policy_version 475822 (0.0008) [2023-12-27 22:38:57,754][106226] Updated weights for policy 0, policy_version 474353 (0.0010) [2023-12-27 22:38:57,801][106226] Updated weights for policy 0, policy_version 474363 (0.0010) [2023-12-27 22:38:57,840][106225] Updated weights for policy 1, policy_version 475832 (0.0006) [2023-12-27 22:38:57,846][106226] Updated weights for policy 0, policy_version 474373 (0.0010) [2023-12-27 22:38:57,901][106225] Updated weights for policy 1, policy_version 475842 (0.0007) [2023-12-27 22:38:57,950][106225] Updated weights for policy 1, policy_version 475852 (0.0006) [2023-12-27 22:38:58,614][106226] Updated weights for policy 0, policy_version 474383 (0.0008) [2023-12-27 22:38:58,679][106226] Updated weights for policy 0, policy_version 474393 (0.0007) [2023-12-27 22:38:58,686][106225] Updated weights for policy 1, policy_version 475862 (0.0009) [2023-12-27 22:38:58,749][106226] Updated weights for policy 0, policy_version 474403 (0.0011) [2023-12-27 22:38:58,749][106225] Updated weights for policy 1, policy_version 475872 (0.0009) [2023-12-27 22:38:58,818][106225] Updated weights for policy 1, policy_version 475882 (0.0007) [2023-12-27 22:38:59,530][106226] Updated weights for policy 0, policy_version 474413 (0.0009) [2023-12-27 22:38:59,580][106226] Updated weights for policy 0, policy_version 474423 (0.0007) [2023-12-27 22:38:59,628][106225] Updated weights for policy 1, policy_version 475892 (0.0008) [2023-12-27 22:38:59,638][106226] Updated weights for policy 0, policy_version 474433 (0.0006) [2023-12-27 22:38:59,688][106225] Updated weights for policy 1, policy_version 475902 (0.0010) [2023-12-27 22:38:59,745][106225] Updated weights for policy 1, policy_version 475912 (0.0010) [2023-12-27 22:39:00,383][106226] Updated weights for policy 0, policy_version 474443 (0.0006) [2023-12-27 22:39:00,445][106226] Updated weights for policy 0, policy_version 474453 (0.0007) [2023-12-27 22:39:00,446][106225] Updated weights for policy 1, policy_version 475922 (0.0010) [2023-12-27 22:39:00,503][106225] Updated weights for policy 1, policy_version 475932 (0.0007) [2023-12-27 22:39:00,508][106226] Updated weights for policy 0, policy_version 474463 (0.0006) [2023-12-27 22:39:00,562][106225] Updated weights for policy 1, policy_version 475942 (0.0007) [2023-12-27 22:39:00,612][106225] Updated weights for policy 1, policy_version 475952 (0.0008) [2023-12-27 22:39:01,125][106226] Updated weights for policy 0, policy_version 474473 (0.0006) [2023-12-27 22:39:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 243367936. Throughput: 0: 9947.3, 1: 10207.8. Samples: 243362400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:01,175][105115] Avg episode reward: [(0, '-5.181'), (1, '-5.578')] [2023-12-27 22:39:01,192][106226] Updated weights for policy 0, policy_version 474483 (0.0010) [2023-12-27 22:39:01,217][106225] Updated weights for policy 1, policy_version 475962 (0.0008) [2023-12-27 22:39:01,257][106226] Updated weights for policy 0, policy_version 474493 (0.0007) [2023-12-27 22:39:01,284][106225] Updated weights for policy 1, policy_version 475972 (0.0007) [2023-12-27 22:39:01,314][106226] Updated weights for policy 0, policy_version 474503 (0.0011) [2023-12-27 22:39:01,342][106225] Updated weights for policy 1, policy_version 475982 (0.0008) [2023-12-27 22:39:02,015][106225] Updated weights for policy 1, policy_version 475992 (0.0009) [2023-12-27 22:39:02,018][106226] Updated weights for policy 0, policy_version 474513 (0.0010) [2023-12-27 22:39:02,069][106226] Updated weights for policy 0, policy_version 474523 (0.0010) [2023-12-27 22:39:02,077][106225] Updated weights for policy 1, policy_version 476002 (0.0007) [2023-12-27 22:39:02,116][106226] Updated weights for policy 0, policy_version 474533 (0.0010) [2023-12-27 22:39:02,131][106225] Updated weights for policy 1, policy_version 476012 (0.0005) [2023-12-27 22:39:02,759][106225] Updated weights for policy 1, policy_version 476022 (0.0008) [2023-12-27 22:39:02,817][106225] Updated weights for policy 1, policy_version 476032 (0.0005) [2023-12-27 22:39:02,855][106226] Updated weights for policy 0, policy_version 474543 (0.0009) [2023-12-27 22:39:02,877][106225] Updated weights for policy 1, policy_version 476042 (0.0006) [2023-12-27 22:39:02,903][106226] Updated weights for policy 0, policy_version 474553 (0.0008) [2023-12-27 22:39:02,958][106226] Updated weights for policy 0, policy_version 474563 (0.0008) [2023-12-27 22:39:03,440][106225] Updated weights for policy 1, policy_version 476052 (0.0005) [2023-12-27 22:39:03,494][106225] Updated weights for policy 1, policy_version 476062 (0.0005) [2023-12-27 22:39:03,544][106225] Updated weights for policy 1, policy_version 476072 (0.0005) [2023-12-27 22:39:03,791][106226] Updated weights for policy 0, policy_version 474573 (0.0009) [2023-12-27 22:39:03,856][106226] Updated weights for policy 0, policy_version 474583 (0.0008) [2023-12-27 22:39:03,918][106226] Updated weights for policy 0, policy_version 474593 (0.0009) [2023-12-27 22:39:04,131][106225] Updated weights for policy 1, policy_version 476082 (0.0006) [2023-12-27 22:39:04,198][106225] Updated weights for policy 1, policy_version 476092 (0.0008) [2023-12-27 22:39:04,258][106225] Updated weights for policy 1, policy_version 476102 (0.0008) [2023-12-27 22:39:04,318][106225] Updated weights for policy 1, policy_version 476112 (0.0008) [2023-12-27 22:39:04,662][106226] Updated weights for policy 0, policy_version 474603 (0.0009) [2023-12-27 22:39:04,726][106226] Updated weights for policy 0, policy_version 474613 (0.0008) [2023-12-27 22:39:04,791][106226] Updated weights for policy 0, policy_version 474623 (0.0008) [2023-12-27 22:39:05,037][106225] Updated weights for policy 1, policy_version 476122 (0.0010) [2023-12-27 22:39:05,090][106225] Updated weights for policy 1, policy_version 476132 (0.0010) [2023-12-27 22:39:05,163][106225] Updated weights for policy 1, policy_version 476142 (0.0008) [2023-12-27 22:39:05,412][106226] Updated weights for policy 0, policy_version 474633 (0.0008) [2023-12-27 22:39:05,469][106226] Updated weights for policy 0, policy_version 474643 (0.0009) [2023-12-27 22:39:05,529][106226] Updated weights for policy 0, policy_version 474653 (0.0008) [2023-12-27 22:39:05,584][106226] Updated weights for policy 0, policy_version 474663 (0.0008) [2023-12-27 22:39:05,793][106225] Updated weights for policy 1, policy_version 476152 (0.0008) [2023-12-27 22:39:05,841][106225] Updated weights for policy 1, policy_version 476162 (0.0008) [2023-12-27 22:39:05,900][106225] Updated weights for policy 1, policy_version 476172 (0.0008) [2023-12-27 22:39:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 243474432. Throughput: 0: 9900.8, 1: 10263.6. Samples: 243484388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:06,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.355')] [2023-12-27 22:39:06,328][106226] Updated weights for policy 0, policy_version 474673 (0.0009) [2023-12-27 22:39:06,389][106226] Updated weights for policy 0, policy_version 474683 (0.0009) [2023-12-27 22:39:06,456][106226] Updated weights for policy 0, policy_version 474693 (0.0008) [2023-12-27 22:39:06,631][106225] Updated weights for policy 1, policy_version 476182 (0.0008) [2023-12-27 22:39:06,695][106225] Updated weights for policy 1, policy_version 476192 (0.0008) [2023-12-27 22:39:06,752][106225] Updated weights for policy 1, policy_version 476202 (0.0008) [2023-12-27 22:39:07,125][106226] Updated weights for policy 0, policy_version 474703 (0.0009) [2023-12-27 22:39:07,184][106226] Updated weights for policy 0, policy_version 474713 (0.0008) [2023-12-27 22:39:07,235][106226] Updated weights for policy 0, policy_version 474723 (0.0007) [2023-12-27 22:39:07,536][106225] Updated weights for policy 1, policy_version 476212 (0.0009) [2023-12-27 22:39:07,591][106225] Updated weights for policy 1, policy_version 476222 (0.0008) [2023-12-27 22:39:07,648][106225] Updated weights for policy 1, policy_version 476232 (0.0008) [2023-12-27 22:39:07,820][106226] Updated weights for policy 0, policy_version 474733 (0.0005) [2023-12-27 22:39:07,866][106226] Updated weights for policy 0, policy_version 474743 (0.0005) [2023-12-27 22:39:07,926][106226] Updated weights for policy 0, policy_version 474753 (0.0005) [2023-12-27 22:39:08,496][106226] Updated weights for policy 0, policy_version 474763 (0.0006) [2023-12-27 22:39:08,507][106225] Updated weights for policy 1, policy_version 476242 (0.0008) [2023-12-27 22:39:08,558][106226] Updated weights for policy 0, policy_version 474773 (0.0006) [2023-12-27 22:39:08,567][106225] Updated weights for policy 1, policy_version 476252 (0.0006) [2023-12-27 22:39:08,617][106226] Updated weights for policy 0, policy_version 474783 (0.0006) [2023-12-27 22:39:08,630][106225] Updated weights for policy 1, policy_version 476262 (0.0008) [2023-12-27 22:39:08,692][106225] Updated weights for policy 1, policy_version 476272 (0.0008) [2023-12-27 22:39:09,254][106226] Updated weights for policy 0, policy_version 474793 (0.0006) [2023-12-27 22:39:09,317][106226] Updated weights for policy 0, policy_version 474803 (0.0008) [2023-12-27 22:39:09,386][106226] Updated weights for policy 0, policy_version 474813 (0.0008) [2023-12-27 22:39:09,456][106226] Updated weights for policy 0, policy_version 474823 (0.0008) [2023-12-27 22:39:09,490][106225] Updated weights for policy 1, policy_version 476282 (0.0009) [2023-12-27 22:39:09,552][106225] Updated weights for policy 1, policy_version 476292 (0.0009) [2023-12-27 22:39:09,615][106225] Updated weights for policy 1, policy_version 476302 (0.0006) [2023-12-27 22:39:10,169][106226] Updated weights for policy 0, policy_version 474833 (0.0008) [2023-12-27 22:39:10,234][106226] Updated weights for policy 0, policy_version 474843 (0.0009) [2023-12-27 22:39:10,295][106226] Updated weights for policy 0, policy_version 474853 (0.0008) [2023-12-27 22:39:10,318][106225] Updated weights for policy 1, policy_version 476312 (0.0006) [2023-12-27 22:39:10,383][106225] Updated weights for policy 1, policy_version 476322 (0.0007) [2023-12-27 22:39:10,451][106225] Updated weights for policy 1, policy_version 476332 (0.0008) [2023-12-27 22:39:10,960][106226] Updated weights for policy 0, policy_version 474863 (0.0008) [2023-12-27 22:39:11,009][106226] Updated weights for policy 0, policy_version 474873 (0.0007) [2023-12-27 22:39:11,085][106226] Updated weights for policy 0, policy_version 474883 (0.0008) [2023-12-27 22:39:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 243572736. Throughput: 0: 10010.5, 1: 10237.0. Samples: 243544236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:11,175][105115] Avg episode reward: [(0, '-5.212'), (1, '-5.603')] [2023-12-27 22:39:11,177][106225] Updated weights for policy 1, policy_version 476342 (0.0008) [2023-12-27 22:39:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000474888_121602048.pth... [2023-12-27 22:39:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000473704_121298944.pth [2023-12-27 22:39:11,239][106225] Updated weights for policy 1, policy_version 476352 (0.0008) [2023-12-27 22:39:11,302][106225] Updated weights for policy 1, policy_version 476362 (0.0007) [2023-12-27 22:39:11,336][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000476368_121978880.pth... [2023-12-27 22:39:11,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000475184_121675776.pth [2023-12-27 22:39:11,849][106226] Updated weights for policy 0, policy_version 474893 (0.0008) [2023-12-27 22:39:11,903][106226] Updated weights for policy 0, policy_version 474903 (0.0009) [2023-12-27 22:39:11,960][106226] Updated weights for policy 0, policy_version 474913 (0.0009) [2023-12-27 22:39:12,001][106225] Updated weights for policy 1, policy_version 476372 (0.0009) [2023-12-27 22:39:12,063][106225] Updated weights for policy 1, policy_version 476382 (0.0007) [2023-12-27 22:39:12,123][106225] Updated weights for policy 1, policy_version 476392 (0.0008) [2023-12-27 22:39:12,691][106226] Updated weights for policy 0, policy_version 474923 (0.0007) [2023-12-27 22:39:12,752][106226] Updated weights for policy 0, policy_version 474933 (0.0011) [2023-12-27 22:39:12,824][106225] Updated weights for policy 1, policy_version 476402 (0.0008) [2023-12-27 22:39:12,832][106226] Updated weights for policy 0, policy_version 474943 (0.0010) [2023-12-27 22:39:12,880][106225] Updated weights for policy 1, policy_version 476412 (0.0009) [2023-12-27 22:39:12,938][106225] Updated weights for policy 1, policy_version 476422 (0.0006) [2023-12-27 22:39:12,998][106225] Updated weights for policy 1, policy_version 476432 (0.0006) [2023-12-27 22:39:13,482][106226] Updated weights for policy 0, policy_version 474953 (0.0010) [2023-12-27 22:39:13,531][106226] Updated weights for policy 0, policy_version 474963 (0.0010) [2023-12-27 22:39:13,594][106226] Updated weights for policy 0, policy_version 474973 (0.0011) [2023-12-27 22:39:13,608][106225] Updated weights for policy 1, policy_version 476443 (0.0009) [2023-12-27 22:39:13,650][106226] Updated weights for policy 0, policy_version 474983 (0.0010) [2023-12-27 22:39:13,661][106225] Updated weights for policy 1, policy_version 476453 (0.0008) [2023-12-27 22:39:13,717][106225] Updated weights for policy 1, policy_version 476463 (0.0008) [2023-12-27 22:39:14,226][106226] Updated weights for policy 0, policy_version 474993 (0.0006) [2023-12-27 22:39:14,273][106226] Updated weights for policy 0, policy_version 475003 (0.0006) [2023-12-27 22:39:14,326][106226] Updated weights for policy 0, policy_version 475013 (0.0008) [2023-12-27 22:39:14,500][106225] Updated weights for policy 1, policy_version 476473 (0.0010) [2023-12-27 22:39:14,560][106225] Updated weights for policy 1, policy_version 476483 (0.0010) [2023-12-27 22:39:14,618][106225] Updated weights for policy 1, policy_version 476493 (0.0010) [2023-12-27 22:39:15,000][106226] Updated weights for policy 0, policy_version 475023 (0.0006) [2023-12-27 22:39:15,056][106226] Updated weights for policy 0, policy_version 475033 (0.0006) [2023-12-27 22:39:15,119][106226] Updated weights for policy 0, policy_version 475043 (0.0007) [2023-12-27 22:39:15,309][106225] Updated weights for policy 1, policy_version 476503 (0.0011) [2023-12-27 22:39:15,376][106225] Updated weights for policy 1, policy_version 476513 (0.0009) [2023-12-27 22:39:15,440][106225] Updated weights for policy 1, policy_version 476523 (0.0011) [2023-12-27 22:39:15,694][106226] Updated weights for policy 0, policy_version 475053 (0.0008) [2023-12-27 22:39:15,752][106226] Updated weights for policy 0, policy_version 475063 (0.0007) [2023-12-27 22:39:15,801][106226] Updated weights for policy 0, policy_version 475073 (0.0006) [2023-12-27 22:39:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 243671040. Throughput: 0: 9874.2, 1: 10151.4. Samples: 243661684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:16,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-5.521')] [2023-12-27 22:39:16,185][106225] Updated weights for policy 1, policy_version 476533 (0.0008) [2023-12-27 22:39:16,250][106225] Updated weights for policy 1, policy_version 476543 (0.0005) [2023-12-27 22:39:16,316][106225] Updated weights for policy 1, policy_version 476553 (0.0005) [2023-12-27 22:39:16,500][106226] Updated weights for policy 0, policy_version 475083 (0.0007) [2023-12-27 22:39:16,556][106226] Updated weights for policy 0, policy_version 475093 (0.0009) [2023-12-27 22:39:16,621][106226] Updated weights for policy 0, policy_version 475103 (0.0009) [2023-12-27 22:39:16,878][106225] Updated weights for policy 1, policy_version 476563 (0.0008) [2023-12-27 22:39:16,938][106225] Updated weights for policy 1, policy_version 476573 (0.0009) [2023-12-27 22:39:17,004][106225] Updated weights for policy 1, policy_version 476583 (0.0009) [2023-12-27 22:39:17,320][106226] Updated weights for policy 0, policy_version 475113 (0.0009) [2023-12-27 22:39:17,376][106226] Updated weights for policy 0, policy_version 475123 (0.0008) [2023-12-27 22:39:17,431][106226] Updated weights for policy 0, policy_version 475133 (0.0008) [2023-12-27 22:39:17,495][106226] Updated weights for policy 0, policy_version 475143 (0.0008) [2023-12-27 22:39:17,695][106225] Updated weights for policy 1, policy_version 476593 (0.0008) [2023-12-27 22:39:17,758][106225] Updated weights for policy 1, policy_version 476603 (0.0005) [2023-12-27 22:39:17,820][106225] Updated weights for policy 1, policy_version 476613 (0.0006) [2023-12-27 22:39:17,870][106225] Updated weights for policy 1, policy_version 476623 (0.0005) [2023-12-27 22:39:18,202][106226] Updated weights for policy 0, policy_version 475153 (0.0006) [2023-12-27 22:39:18,253][106226] Updated weights for policy 0, policy_version 475163 (0.0009) [2023-12-27 22:39:18,304][106226] Updated weights for policy 0, policy_version 475173 (0.0008) [2023-12-27 22:39:18,498][106225] Updated weights for policy 1, policy_version 476633 (0.0008) [2023-12-27 22:39:18,557][106225] Updated weights for policy 1, policy_version 476643 (0.0008) [2023-12-27 22:39:18,613][106225] Updated weights for policy 1, policy_version 476653 (0.0008) [2023-12-27 22:39:19,091][106226] Updated weights for policy 0, policy_version 475183 (0.0008) [2023-12-27 22:39:19,149][106226] Updated weights for policy 0, policy_version 475193 (0.0008) [2023-12-27 22:39:19,208][106226] Updated weights for policy 0, policy_version 475203 (0.0008) [2023-12-27 22:39:19,307][106225] Updated weights for policy 1, policy_version 476663 (0.0008) [2023-12-27 22:39:19,366][106225] Updated weights for policy 1, policy_version 476673 (0.0008) [2023-12-27 22:39:19,433][106225] Updated weights for policy 1, policy_version 476683 (0.0009) [2023-12-27 22:39:20,023][106226] Updated weights for policy 0, policy_version 475213 (0.0008) [2023-12-27 22:39:20,088][106226] Updated weights for policy 0, policy_version 475223 (0.0007) [2023-12-27 22:39:20,152][106226] Updated weights for policy 0, policy_version 475233 (0.0006) [2023-12-27 22:39:20,197][106225] Updated weights for policy 1, policy_version 476693 (0.0007) [2023-12-27 22:39:20,254][106225] Updated weights for policy 1, policy_version 476703 (0.0008) [2023-12-27 22:39:20,313][106225] Updated weights for policy 1, policy_version 476713 (0.0009) [2023-12-27 22:39:20,814][106226] Updated weights for policy 0, policy_version 475243 (0.0007) [2023-12-27 22:39:20,876][106226] Updated weights for policy 0, policy_version 475253 (0.0010) [2023-12-27 22:39:20,947][106226] Updated weights for policy 0, policy_version 475263 (0.0010) [2023-12-27 22:39:21,058][106225] Updated weights for policy 1, policy_version 476723 (0.0009) [2023-12-27 22:39:21,121][106225] Updated weights for policy 1, policy_version 476733 (0.0008) [2023-12-27 22:39:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 243769344. Throughput: 0: 9833.3, 1: 10051.9. Samples: 243779412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:21,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-5.636')] [2023-12-27 22:39:21,186][106225] Updated weights for policy 1, policy_version 476743 (0.0009) [2023-12-27 22:39:21,686][106226] Updated weights for policy 0, policy_version 475273 (0.0009) [2023-12-27 22:39:21,750][106226] Updated weights for policy 0, policy_version 475283 (0.0010) [2023-12-27 22:39:21,817][106226] Updated weights for policy 0, policy_version 475293 (0.0007) [2023-12-27 22:39:21,885][106226] Updated weights for policy 0, policy_version 475303 (0.0008) [2023-12-27 22:39:22,050][106225] Updated weights for policy 1, policy_version 476753 (0.0008) [2023-12-27 22:39:22,117][106225] Updated weights for policy 1, policy_version 476763 (0.0009) [2023-12-27 22:39:22,181][106225] Updated weights for policy 1, policy_version 476773 (0.0008) [2023-12-27 22:39:22,248][106225] Updated weights for policy 1, policy_version 476783 (0.0008) [2023-12-27 22:39:22,527][106226] Updated weights for policy 0, policy_version 475313 (0.0009) [2023-12-27 22:39:22,591][106226] Updated weights for policy 0, policy_version 475323 (0.0009) [2023-12-27 22:39:22,654][106226] Updated weights for policy 0, policy_version 475333 (0.0009) [2023-12-27 22:39:22,917][106225] Updated weights for policy 1, policy_version 476793 (0.0008) [2023-12-27 22:39:22,963][106225] Updated weights for policy 1, policy_version 476803 (0.0008) [2023-12-27 22:39:23,019][106225] Updated weights for policy 1, policy_version 476813 (0.0008) [2023-12-27 22:39:23,379][106226] Updated weights for policy 0, policy_version 475343 (0.0009) [2023-12-27 22:39:23,428][106226] Updated weights for policy 0, policy_version 475353 (0.0009) [2023-12-27 22:39:23,476][106226] Updated weights for policy 0, policy_version 475363 (0.0008) [2023-12-27 22:39:23,772][106225] Updated weights for policy 1, policy_version 476823 (0.0007) [2023-12-27 22:39:23,836][106225] Updated weights for policy 1, policy_version 476833 (0.0006) [2023-12-27 22:39:23,910][106225] Updated weights for policy 1, policy_version 476843 (0.0006) [2023-12-27 22:39:24,180][106226] Updated weights for policy 0, policy_version 475373 (0.0009) [2023-12-27 22:39:24,235][106226] Updated weights for policy 0, policy_version 475383 (0.0007) [2023-12-27 22:39:24,283][106226] Updated weights for policy 0, policy_version 475393 (0.0010) [2023-12-27 22:39:24,589][106225] Updated weights for policy 1, policy_version 476853 (0.0008) [2023-12-27 22:39:24,639][106225] Updated weights for policy 1, policy_version 476863 (0.0008) [2023-12-27 22:39:24,700][106225] Updated weights for policy 1, policy_version 476873 (0.0008) [2023-12-27 22:39:24,989][106226] Updated weights for policy 0, policy_version 475403 (0.0010) [2023-12-27 22:39:25,058][106226] Updated weights for policy 0, policy_version 475413 (0.0007) [2023-12-27 22:39:25,117][106226] Updated weights for policy 0, policy_version 475423 (0.0006) [2023-12-27 22:39:25,406][106225] Updated weights for policy 1, policy_version 476883 (0.0007) [2023-12-27 22:39:25,471][106225] Updated weights for policy 1, policy_version 476893 (0.0008) [2023-12-27 22:39:25,532][106225] Updated weights for policy 1, policy_version 476903 (0.0008) [2023-12-27 22:39:25,732][106226] Updated weights for policy 0, policy_version 475433 (0.0006) [2023-12-27 22:39:25,781][106226] Updated weights for policy 0, policy_version 475443 (0.0005) [2023-12-27 22:39:25,830][106226] Updated weights for policy 0, policy_version 475453 (0.0005) [2023-12-27 22:39:25,887][106226] Updated weights for policy 0, policy_version 475463 (0.0005) [2023-12-27 22:39:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 243867648. Throughput: 0: 9917.6, 1: 9947.1. Samples: 243837480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:26,175][105115] Avg episode reward: [(0, '-5.166'), (1, '-5.513')] [2023-12-27 22:39:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000476912_122118144.pth... [2023-12-27 22:39:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000475464_121749504.pth... [2023-12-27 22:39:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000475760_121823232.pth [2023-12-27 22:39:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000474312_121454592.pth [2023-12-27 22:39:26,325][106225] Updated weights for policy 1, policy_version 476913 (0.0008) [2023-12-27 22:39:26,379][106225] Updated weights for policy 1, policy_version 476923 (0.0009) [2023-12-27 22:39:26,433][106225] Updated weights for policy 1, policy_version 476933 (0.0007) [2023-12-27 22:39:26,446][106226] Updated weights for policy 0, policy_version 475473 (0.0006) [2023-12-27 22:39:26,493][106225] Updated weights for policy 1, policy_version 476943 (0.0007) [2023-12-27 22:39:26,499][106226] Updated weights for policy 0, policy_version 475483 (0.0007) [2023-12-27 22:39:26,550][106226] Updated weights for policy 0, policy_version 475493 (0.0008) [2023-12-27 22:39:27,234][106225] Updated weights for policy 1, policy_version 476953 (0.0007) [2023-12-27 22:39:27,262][106226] Updated weights for policy 0, policy_version 475503 (0.0009) [2023-12-27 22:39:27,291][106225] Updated weights for policy 1, policy_version 476963 (0.0006) [2023-12-27 22:39:27,319][106226] Updated weights for policy 0, policy_version 475513 (0.0006) [2023-12-27 22:39:27,344][106225] Updated weights for policy 1, policy_version 476973 (0.0007) [2023-12-27 22:39:27,379][106226] Updated weights for policy 0, policy_version 475523 (0.0006) [2023-12-27 22:39:27,940][106226] Updated weights for policy 0, policy_version 475533 (0.0008) [2023-12-27 22:39:27,997][106226] Updated weights for policy 0, policy_version 475543 (0.0008) [2023-12-27 22:39:28,044][106226] Updated weights for policy 0, policy_version 475553 (0.0009) [2023-12-27 22:39:28,063][106225] Updated weights for policy 1, policy_version 476983 (0.0007) [2023-12-27 22:39:28,110][106225] Updated weights for policy 1, policy_version 476993 (0.0008) [2023-12-27 22:39:28,159][106225] Updated weights for policy 1, policy_version 477003 (0.0008) [2023-12-27 22:39:28,782][106226] Updated weights for policy 0, policy_version 475563 (0.0009) [2023-12-27 22:39:28,834][106225] Updated weights for policy 1, policy_version 477013 (0.0007) [2023-12-27 22:39:28,844][106226] Updated weights for policy 0, policy_version 475573 (0.0008) [2023-12-27 22:39:28,893][106225] Updated weights for policy 1, policy_version 477023 (0.0007) [2023-12-27 22:39:28,904][106226] Updated weights for policy 0, policy_version 475583 (0.0007) [2023-12-27 22:39:28,945][106225] Updated weights for policy 1, policy_version 477033 (0.0007) [2023-12-27 22:39:29,514][106226] Updated weights for policy 0, policy_version 475593 (0.0006) [2023-12-27 22:39:29,560][106226] Updated weights for policy 0, policy_version 475603 (0.0008) [2023-12-27 22:39:29,612][106226] Updated weights for policy 0, policy_version 475613 (0.0008) [2023-12-27 22:39:29,655][106226] Updated weights for policy 0, policy_version 475623 (0.0008) [2023-12-27 22:39:29,742][106225] Updated weights for policy 1, policy_version 477043 (0.0009) [2023-12-27 22:39:29,794][106225] Updated weights for policy 1, policy_version 477053 (0.0010) [2023-12-27 22:39:29,877][106225] Updated weights for policy 1, policy_version 477063 (0.0009) [2023-12-27 22:39:30,446][106226] Updated weights for policy 0, policy_version 475633 (0.0006) [2023-12-27 22:39:30,506][106226] Updated weights for policy 0, policy_version 475643 (0.0007) [2023-12-27 22:39:30,556][106226] Updated weights for policy 0, policy_version 475653 (0.0010) [2023-12-27 22:39:30,583][106225] Updated weights for policy 1, policy_version 477073 (0.0009) [2023-12-27 22:39:30,640][106225] Updated weights for policy 1, policy_version 477083 (0.0010) [2023-12-27 22:39:30,695][106225] Updated weights for policy 1, policy_version 477093 (0.0010) [2023-12-27 22:39:30,751][106225] Updated weights for policy 1, policy_version 477103 (0.0010) [2023-12-27 22:39:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 243965952. Throughput: 0: 10101.2, 1: 9892.1. Samples: 243957836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:31,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.438')] [2023-12-27 22:39:31,230][106226] Updated weights for policy 0, policy_version 475663 (0.0009) [2023-12-27 22:39:31,293][106226] Updated weights for policy 0, policy_version 475673 (0.0008) [2023-12-27 22:39:31,351][106226] Updated weights for policy 0, policy_version 475683 (0.0008) [2023-12-27 22:39:31,504][106225] Updated weights for policy 1, policy_version 477113 (0.0008) [2023-12-27 22:39:31,563][106225] Updated weights for policy 1, policy_version 477123 (0.0008) [2023-12-27 22:39:31,631][106225] Updated weights for policy 1, policy_version 477133 (0.0009) [2023-12-27 22:39:32,104][106226] Updated weights for policy 0, policy_version 475693 (0.0009) [2023-12-27 22:39:32,152][106226] Updated weights for policy 0, policy_version 475703 (0.0008) [2023-12-27 22:39:32,202][106226] Updated weights for policy 0, policy_version 475713 (0.0008) [2023-12-27 22:39:32,396][106225] Updated weights for policy 1, policy_version 477143 (0.0007) [2023-12-27 22:39:32,455][106225] Updated weights for policy 1, policy_version 477153 (0.0008) [2023-12-27 22:39:32,514][106225] Updated weights for policy 1, policy_version 477163 (0.0008) [2023-12-27 22:39:32,957][106226] Updated weights for policy 0, policy_version 475723 (0.0009) [2023-12-27 22:39:33,007][106226] Updated weights for policy 0, policy_version 475733 (0.0008) [2023-12-27 22:39:33,065][106226] Updated weights for policy 0, policy_version 475743 (0.0009) [2023-12-27 22:39:33,212][106225] Updated weights for policy 1, policy_version 477173 (0.0008) [2023-12-27 22:39:33,266][106225] Updated weights for policy 1, policy_version 477183 (0.0009) [2023-12-27 22:39:33,314][106225] Updated weights for policy 1, policy_version 477193 (0.0008) [2023-12-27 22:39:33,725][106226] Updated weights for policy 0, policy_version 475753 (0.0008) [2023-12-27 22:39:33,784][106226] Updated weights for policy 0, policy_version 475763 (0.0007) [2023-12-27 22:39:33,848][106226] Updated weights for policy 0, policy_version 475773 (0.0009) [2023-12-27 22:39:33,914][106226] Updated weights for policy 0, policy_version 475783 (0.0009) [2023-12-27 22:39:34,061][106225] Updated weights for policy 1, policy_version 477203 (0.0008) [2023-12-27 22:39:34,115][106225] Updated weights for policy 1, policy_version 477213 (0.0008) [2023-12-27 22:39:34,182][106225] Updated weights for policy 1, policy_version 477223 (0.0009) [2023-12-27 22:39:34,622][106226] Updated weights for policy 0, policy_version 475793 (0.0006) [2023-12-27 22:39:34,692][106226] Updated weights for policy 0, policy_version 475803 (0.0006) [2023-12-27 22:39:34,763][106226] Updated weights for policy 0, policy_version 475813 (0.0006) [2023-12-27 22:39:34,905][106225] Updated weights for policy 1, policy_version 477233 (0.0008) [2023-12-27 22:39:34,954][106225] Updated weights for policy 1, policy_version 477243 (0.0007) [2023-12-27 22:39:35,008][106225] Updated weights for policy 1, policy_version 477253 (0.0007) [2023-12-27 22:39:35,065][106225] Updated weights for policy 1, policy_version 477263 (0.0006) [2023-12-27 22:39:35,340][106226] Updated weights for policy 0, policy_version 475823 (0.0009) [2023-12-27 22:39:35,404][106226] Updated weights for policy 0, policy_version 475833 (0.0011) [2023-12-27 22:39:35,477][106226] Updated weights for policy 0, policy_version 475843 (0.0011) [2023-12-27 22:39:35,731][106225] Updated weights for policy 1, policy_version 477273 (0.0010) [2023-12-27 22:39:35,781][106225] Updated weights for policy 1, policy_version 477283 (0.0009) [2023-12-27 22:39:35,836][106225] Updated weights for policy 1, policy_version 477293 (0.0005) [2023-12-27 22:39:36,079][106226] Updated weights for policy 0, policy_version 475853 (0.0008) [2023-12-27 22:39:36,146][106226] Updated weights for policy 0, policy_version 475863 (0.0007) [2023-12-27 22:39:36,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 244064256. Throughput: 0: 10047.9, 1: 9844.0. Samples: 244076812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:36,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.642')] [2023-12-27 22:39:36,204][106226] Updated weights for policy 0, policy_version 475873 (0.0007) [2023-12-27 22:39:36,472][106225] Updated weights for policy 1, policy_version 477303 (0.0009) [2023-12-27 22:39:36,534][106225] Updated weights for policy 1, policy_version 477313 (0.0011) [2023-12-27 22:39:36,598][106225] Updated weights for policy 1, policy_version 477323 (0.0010) [2023-12-27 22:39:36,929][106226] Updated weights for policy 0, policy_version 475883 (0.0008) [2023-12-27 22:39:36,986][106226] Updated weights for policy 0, policy_version 475893 (0.0007) [2023-12-27 22:39:37,051][106226] Updated weights for policy 0, policy_version 475903 (0.0005) [2023-12-27 22:39:37,282][106225] Updated weights for policy 1, policy_version 477333 (0.0010) [2023-12-27 22:39:37,347][106225] Updated weights for policy 1, policy_version 477343 (0.0011) [2023-12-27 22:39:37,403][106225] Updated weights for policy 1, policy_version 477353 (0.0010) [2023-12-27 22:39:37,700][106226] Updated weights for policy 0, policy_version 475913 (0.0005) [2023-12-27 22:39:37,758][106226] Updated weights for policy 0, policy_version 475923 (0.0010) [2023-12-27 22:39:37,812][106226] Updated weights for policy 0, policy_version 475933 (0.0011) [2023-12-27 22:39:37,873][106226] Updated weights for policy 0, policy_version 475943 (0.0010) [2023-12-27 22:39:38,131][106225] Updated weights for policy 1, policy_version 477363 (0.0010) [2023-12-27 22:39:38,190][106225] Updated weights for policy 1, policy_version 477373 (0.0010) [2023-12-27 22:39:38,236][106225] Updated weights for policy 1, policy_version 477383 (0.0010) [2023-12-27 22:39:38,538][106226] Updated weights for policy 0, policy_version 475953 (0.0010) [2023-12-27 22:39:38,609][106226] Updated weights for policy 0, policy_version 475963 (0.0011) [2023-12-27 22:39:38,675][106226] Updated weights for policy 0, policy_version 475973 (0.0011) [2023-12-27 22:39:38,941][106225] Updated weights for policy 1, policy_version 477393 (0.0010) [2023-12-27 22:39:38,996][106225] Updated weights for policy 1, policy_version 477403 (0.0008) [2023-12-27 22:39:39,053][106225] Updated weights for policy 1, policy_version 477413 (0.0010) [2023-12-27 22:39:39,110][106225] Updated weights for policy 1, policy_version 477423 (0.0010) [2023-12-27 22:39:39,438][106226] Updated weights for policy 0, policy_version 475983 (0.0009) [2023-12-27 22:39:39,508][106226] Updated weights for policy 0, policy_version 475993 (0.0008) [2023-12-27 22:39:39,570][106226] Updated weights for policy 0, policy_version 476003 (0.0008) [2023-12-27 22:39:39,953][106225] Updated weights for policy 1, policy_version 477433 (0.0010) [2023-12-27 22:39:40,004][106225] Updated weights for policy 1, policy_version 477443 (0.0010) [2023-12-27 22:39:40,068][106225] Updated weights for policy 1, policy_version 477453 (0.0010) [2023-12-27 22:39:40,263][106226] Updated weights for policy 0, policy_version 476013 (0.0007) [2023-12-27 22:39:40,311][106226] Updated weights for policy 0, policy_version 476023 (0.0008) [2023-12-27 22:39:40,373][106226] Updated weights for policy 0, policy_version 476033 (0.0008) [2023-12-27 22:39:40,820][106225] Updated weights for policy 1, policy_version 477463 (0.0011) [2023-12-27 22:39:40,882][106225] Updated weights for policy 1, policy_version 477473 (0.0011) [2023-12-27 22:39:40,942][106225] Updated weights for policy 1, policy_version 477483 (0.0010) [2023-12-27 22:39:41,161][106226] Updated weights for policy 0, policy_version 476043 (0.0007) [2023-12-27 22:39:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 244162560. Throughput: 0: 10070.0, 1: 9877.9. Samples: 244136920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:41,176][105115] Avg episode reward: [(0, '-5.090'), (1, '-5.640')] [2023-12-27 22:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000477488_122265600.pth... [2023-12-27 22:39:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000476368_121978880.pth [2023-12-27 22:39:41,223][106226] Updated weights for policy 0, policy_version 476053 (0.0009) [2023-12-27 22:39:41,294][106226] Updated weights for policy 0, policy_version 476063 (0.0008) [2023-12-27 22:39:41,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000476072_121905152.pth... [2023-12-27 22:39:41,362][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000474888_121602048.pth [2023-12-27 22:39:41,677][106225] Updated weights for policy 1, policy_version 477493 (0.0010) [2023-12-27 22:39:41,742][106225] Updated weights for policy 1, policy_version 477503 (0.0007) [2023-12-27 22:39:41,811][106225] Updated weights for policy 1, policy_version 477513 (0.0008) [2023-12-27 22:39:42,113][106226] Updated weights for policy 0, policy_version 476073 (0.0009) [2023-12-27 22:39:42,179][106226] Updated weights for policy 0, policy_version 476083 (0.0011) [2023-12-27 22:39:42,244][106226] Updated weights for policy 0, policy_version 476093 (0.0011) [2023-12-27 22:39:42,315][106226] Updated weights for policy 0, policy_version 476103 (0.0011) [2023-12-27 22:39:42,605][106225] Updated weights for policy 1, policy_version 477523 (0.0007) [2023-12-27 22:39:42,672][106225] Updated weights for policy 1, policy_version 477533 (0.0007) [2023-12-27 22:39:42,736][106225] Updated weights for policy 1, policy_version 477543 (0.0007) [2023-12-27 22:39:43,027][106226] Updated weights for policy 0, policy_version 476113 (0.0008) [2023-12-27 22:39:43,093][106226] Updated weights for policy 0, policy_version 476123 (0.0006) [2023-12-27 22:39:43,155][106226] Updated weights for policy 0, policy_version 476133 (0.0006) [2023-12-27 22:39:43,390][106225] Updated weights for policy 1, policy_version 477553 (0.0008) [2023-12-27 22:39:43,448][106225] Updated weights for policy 1, policy_version 477563 (0.0008) [2023-12-27 22:39:43,511][106225] Updated weights for policy 1, policy_version 477573 (0.0008) [2023-12-27 22:39:43,574][106225] Updated weights for policy 1, policy_version 477583 (0.0005) [2023-12-27 22:39:43,842][106226] Updated weights for policy 0, policy_version 476143 (0.0005) [2023-12-27 22:39:43,909][106226] Updated weights for policy 0, policy_version 476153 (0.0007) [2023-12-27 22:39:43,971][106226] Updated weights for policy 0, policy_version 476163 (0.0006) [2023-12-27 22:39:44,198][106225] Updated weights for policy 1, policy_version 477593 (0.0008) [2023-12-27 22:39:44,246][106225] Updated weights for policy 1, policy_version 477603 (0.0008) [2023-12-27 22:39:44,307][106225] Updated weights for policy 1, policy_version 477613 (0.0008) [2023-12-27 22:39:44,605][106226] Updated weights for policy 0, policy_version 476173 (0.0006) [2023-12-27 22:39:44,658][106226] Updated weights for policy 0, policy_version 476183 (0.0005) [2023-12-27 22:39:44,714][106226] Updated weights for policy 0, policy_version 476193 (0.0005) [2023-12-27 22:39:45,094][106225] Updated weights for policy 1, policy_version 477623 (0.0009) [2023-12-27 22:39:45,157][106225] Updated weights for policy 1, policy_version 477633 (0.0008) [2023-12-27 22:39:45,213][106225] Updated weights for policy 1, policy_version 477643 (0.0008) [2023-12-27 22:39:45,320][106226] Updated weights for policy 0, policy_version 476203 (0.0006) [2023-12-27 22:39:45,385][106226] Updated weights for policy 0, policy_version 476213 (0.0009) [2023-12-27 22:39:45,449][106226] Updated weights for policy 0, policy_version 476223 (0.0005) [2023-12-27 22:39:45,900][106225] Updated weights for policy 1, policy_version 477653 (0.0008) [2023-12-27 22:39:45,963][106225] Updated weights for policy 1, policy_version 477663 (0.0010) [2023-12-27 22:39:45,986][106226] Updated weights for policy 0, policy_version 476233 (0.0005) [2023-12-27 22:39:46,027][106225] Updated weights for policy 1, policy_version 477673 (0.0009) [2023-12-27 22:39:46,037][106226] Updated weights for policy 0, policy_version 476243 (0.0005) [2023-12-27 22:39:46,107][106226] Updated weights for policy 0, policy_version 476253 (0.0008) [2023-12-27 22:39:46,167][106226] Updated weights for policy 0, policy_version 476263 (0.0009) [2023-12-27 22:39:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 244269056. Throughput: 0: 10011.8, 1: 9756.7. Samples: 244251984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:46,176][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.806')] [2023-12-27 22:39:46,686][106225] Updated weights for policy 1, policy_version 477683 (0.0006) [2023-12-27 22:39:46,735][106225] Updated weights for policy 1, policy_version 477693 (0.0008) [2023-12-27 22:39:46,787][106225] Updated weights for policy 1, policy_version 477703 (0.0008) [2023-12-27 22:39:46,858][106226] Updated weights for policy 0, policy_version 476273 (0.0007) [2023-12-27 22:39:46,910][106226] Updated weights for policy 0, policy_version 476283 (0.0009) [2023-12-27 22:39:46,971][106226] Updated weights for policy 0, policy_version 476293 (0.0009) [2023-12-27 22:39:47,530][106225] Updated weights for policy 1, policy_version 477713 (0.0008) [2023-12-27 22:39:47,583][106225] Updated weights for policy 1, policy_version 477723 (0.0006) [2023-12-27 22:39:47,596][106226] Updated weights for policy 0, policy_version 476303 (0.0008) [2023-12-27 22:39:47,638][106225] Updated weights for policy 1, policy_version 477733 (0.0006) [2023-12-27 22:39:47,656][106226] Updated weights for policy 0, policy_version 476313 (0.0010) [2023-12-27 22:39:47,689][106225] Updated weights for policy 1, policy_version 477743 (0.0006) [2023-12-27 22:39:47,718][106226] Updated weights for policy 0, policy_version 476323 (0.0011) [2023-12-27 22:39:48,261][106226] Updated weights for policy 0, policy_version 476333 (0.0007) [2023-12-27 22:39:48,318][106226] Updated weights for policy 0, policy_version 476343 (0.0006) [2023-12-27 22:39:48,389][106226] Updated weights for policy 0, policy_version 476353 (0.0009) [2023-12-27 22:39:48,422][106225] Updated weights for policy 1, policy_version 477753 (0.0006) [2023-12-27 22:39:48,476][106225] Updated weights for policy 1, policy_version 477763 (0.0008) [2023-12-27 22:39:48,528][106225] Updated weights for policy 1, policy_version 477773 (0.0009) [2023-12-27 22:39:49,018][106226] Updated weights for policy 0, policy_version 476363 (0.0010) [2023-12-27 22:39:49,084][106226] Updated weights for policy 0, policy_version 476373 (0.0007) [2023-12-27 22:39:49,140][106226] Updated weights for policy 0, policy_version 476383 (0.0010) [2023-12-27 22:39:49,263][106225] Updated weights for policy 1, policy_version 477783 (0.0009) [2023-12-27 22:39:49,332][106225] Updated weights for policy 1, policy_version 477793 (0.0006) [2023-12-27 22:39:49,403][106225] Updated weights for policy 1, policy_version 477803 (0.0008) [2023-12-27 22:39:49,873][106226] Updated weights for policy 0, policy_version 476393 (0.0010) [2023-12-27 22:39:49,940][106226] Updated weights for policy 0, policy_version 476403 (0.0011) [2023-12-27 22:39:50,001][106226] Updated weights for policy 0, policy_version 476413 (0.0008) [2023-12-27 22:39:50,066][106225] Updated weights for policy 1, policy_version 477813 (0.0007) [2023-12-27 22:39:50,067][106226] Updated weights for policy 0, policy_version 476423 (0.0009) [2023-12-27 22:39:50,124][106225] Updated weights for policy 1, policy_version 477823 (0.0009) [2023-12-27 22:39:50,182][106225] Updated weights for policy 1, policy_version 477833 (0.0007) [2023-12-27 22:39:50,756][106226] Updated weights for policy 0, policy_version 476433 (0.0006) [2023-12-27 22:39:50,824][106226] Updated weights for policy 0, policy_version 476443 (0.0009) [2023-12-27 22:39:50,882][106226] Updated weights for policy 0, policy_version 476453 (0.0011) [2023-12-27 22:39:50,950][106225] Updated weights for policy 1, policy_version 477843 (0.0008) [2023-12-27 22:39:51,018][106225] Updated weights for policy 1, policy_version 477853 (0.0008) [2023-12-27 22:39:51,091][106225] Updated weights for policy 1, policy_version 477863 (0.0008) [2023-12-27 22:39:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 244367360. Throughput: 0: 10121.1, 1: 9629.0. Samples: 244373148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:51,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-5.556')] [2023-12-27 22:39:51,582][106226] Updated weights for policy 0, policy_version 476463 (0.0009) [2023-12-27 22:39:51,651][106226] Updated weights for policy 0, policy_version 476473 (0.0008) [2023-12-27 22:39:51,715][106226] Updated weights for policy 0, policy_version 476483 (0.0007) [2023-12-27 22:39:51,816][106225] Updated weights for policy 1, policy_version 477873 (0.0008) [2023-12-27 22:39:51,882][106225] Updated weights for policy 1, policy_version 477883 (0.0007) [2023-12-27 22:39:51,939][106225] Updated weights for policy 1, policy_version 477893 (0.0005) [2023-12-27 22:39:52,001][106225] Updated weights for policy 1, policy_version 477903 (0.0005) [2023-12-27 22:39:52,482][106226] Updated weights for policy 0, policy_version 476493 (0.0011) [2023-12-27 22:39:52,543][106226] Updated weights for policy 0, policy_version 476503 (0.0011) [2023-12-27 22:39:52,611][106226] Updated weights for policy 0, policy_version 476513 (0.0011) [2023-12-27 22:39:52,683][106225] Updated weights for policy 1, policy_version 477913 (0.0007) [2023-12-27 22:39:52,745][106225] Updated weights for policy 1, policy_version 477923 (0.0008) [2023-12-27 22:39:52,800][106225] Updated weights for policy 1, policy_version 477933 (0.0008) [2023-12-27 22:39:53,318][106226] Updated weights for policy 0, policy_version 476523 (0.0011) [2023-12-27 22:39:53,364][106226] Updated weights for policy 0, policy_version 476533 (0.0010) [2023-12-27 22:39:53,413][106226] Updated weights for policy 0, policy_version 476543 (0.0010) [2023-12-27 22:39:53,516][106225] Updated weights for policy 1, policy_version 477943 (0.0007) [2023-12-27 22:39:53,570][106225] Updated weights for policy 1, policy_version 477953 (0.0008) [2023-12-27 22:39:53,621][106225] Updated weights for policy 1, policy_version 477963 (0.0008) [2023-12-27 22:39:54,152][106226] Updated weights for policy 0, policy_version 476553 (0.0010) [2023-12-27 22:39:54,198][106226] Updated weights for policy 0, policy_version 476563 (0.0007) [2023-12-27 22:39:54,258][106226] Updated weights for policy 0, policy_version 476573 (0.0010) [2023-12-27 22:39:54,321][106226] Updated weights for policy 0, policy_version 476583 (0.0010) [2023-12-27 22:39:54,366][106225] Updated weights for policy 1, policy_version 477973 (0.0008) [2023-12-27 22:39:54,414][106225] Updated weights for policy 1, policy_version 477983 (0.0008) [2023-12-27 22:39:54,463][106225] Updated weights for policy 1, policy_version 477993 (0.0007) [2023-12-27 22:39:55,037][106226] Updated weights for policy 0, policy_version 476593 (0.0011) [2023-12-27 22:39:55,093][106226] Updated weights for policy 0, policy_version 476603 (0.0010) [2023-12-27 22:39:55,147][106226] Updated weights for policy 0, policy_version 476613 (0.0010) [2023-12-27 22:39:55,219][106225] Updated weights for policy 1, policy_version 478003 (0.0008) [2023-12-27 22:39:55,284][106225] Updated weights for policy 1, policy_version 478013 (0.0007) [2023-12-27 22:39:55,346][106225] Updated weights for policy 1, policy_version 478023 (0.0008) [2023-12-27 22:39:55,879][106226] Updated weights for policy 0, policy_version 476623 (0.0011) [2023-12-27 22:39:55,941][106226] Updated weights for policy 0, policy_version 476633 (0.0011) [2023-12-27 22:39:55,998][106226] Updated weights for policy 0, policy_version 476643 (0.0010) [2023-12-27 22:39:56,083][106225] Updated weights for policy 1, policy_version 478033 (0.0008) [2023-12-27 22:39:56,143][106225] Updated weights for policy 1, policy_version 478043 (0.0008) [2023-12-27 22:39:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 244457472. Throughput: 0: 10023.5, 1: 9662.1. Samples: 244430088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:39:56,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.637')] [2023-12-27 22:39:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000476648_122052608.pth... [2023-12-27 22:39:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000475464_121749504.pth [2023-12-27 22:39:56,197][106225] Updated weights for policy 1, policy_version 478053 (0.0008) [2023-12-27 22:39:56,255][106225] Updated weights for policy 1, policy_version 478063 (0.0008) [2023-12-27 22:39:56,260][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000478064_122413056.pth... [2023-12-27 22:39:56,263][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000476912_122118144.pth [2023-12-27 22:39:56,718][106226] Updated weights for policy 0, policy_version 476653 (0.0010) [2023-12-27 22:39:56,779][106226] Updated weights for policy 0, policy_version 476663 (0.0010) [2023-12-27 22:39:56,826][106226] Updated weights for policy 0, policy_version 476673 (0.0010) [2023-12-27 22:39:56,984][106225] Updated weights for policy 1, policy_version 478073 (0.0008) [2023-12-27 22:39:57,040][106225] Updated weights for policy 1, policy_version 478083 (0.0008) [2023-12-27 22:39:57,085][106225] Updated weights for policy 1, policy_version 478093 (0.0008) [2023-12-27 22:39:57,531][106226] Updated weights for policy 0, policy_version 476683 (0.0010) [2023-12-27 22:39:57,577][106226] Updated weights for policy 0, policy_version 476693 (0.0010) [2023-12-27 22:39:57,624][106226] Updated weights for policy 0, policy_version 476703 (0.0010) [2023-12-27 22:39:57,820][106225] Updated weights for policy 1, policy_version 478103 (0.0007) [2023-12-27 22:39:57,869][106225] Updated weights for policy 1, policy_version 478113 (0.0007) [2023-12-27 22:39:57,914][106225] Updated weights for policy 1, policy_version 478123 (0.0008) [2023-12-27 22:39:58,333][106226] Updated weights for policy 0, policy_version 476713 (0.0010) [2023-12-27 22:39:58,395][106226] Updated weights for policy 0, policy_version 476723 (0.0008) [2023-12-27 22:39:58,464][106226] Updated weights for policy 0, policy_version 476733 (0.0008) [2023-12-27 22:39:58,522][106226] Updated weights for policy 0, policy_version 476743 (0.0008) [2023-12-27 22:39:58,731][106225] Updated weights for policy 1, policy_version 478133 (0.0009) [2023-12-27 22:39:58,796][106225] Updated weights for policy 1, policy_version 478143 (0.0008) [2023-12-27 22:39:58,866][106225] Updated weights for policy 1, policy_version 478153 (0.0008) [2023-12-27 22:39:59,399][106226] Updated weights for policy 0, policy_version 476753 (0.0009) [2023-12-27 22:39:59,458][106226] Updated weights for policy 0, policy_version 476763 (0.0008) [2023-12-27 22:39:59,515][106226] Updated weights for policy 0, policy_version 476773 (0.0008) [2023-12-27 22:39:59,614][106225] Updated weights for policy 1, policy_version 478163 (0.0008) [2023-12-27 22:39:59,673][106225] Updated weights for policy 1, policy_version 478173 (0.0008) [2023-12-27 22:39:59,726][106225] Updated weights for policy 1, policy_version 478183 (0.0008) [2023-12-27 22:40:00,303][106226] Updated weights for policy 0, policy_version 476783 (0.0010) [2023-12-27 22:40:00,363][106226] Updated weights for policy 0, policy_version 476793 (0.0009) [2023-12-27 22:40:00,421][106225] Updated weights for policy 1, policy_version 478193 (0.0009) [2023-12-27 22:40:00,423][106226] Updated weights for policy 0, policy_version 476803 (0.0008) [2023-12-27 22:40:00,478][106225] Updated weights for policy 1, policy_version 478203 (0.0007) [2023-12-27 22:40:00,536][106225] Updated weights for policy 1, policy_version 478213 (0.0005) [2023-12-27 22:40:00,581][106225] Updated weights for policy 1, policy_version 478223 (0.0005) [2023-12-27 22:40:01,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 244547584. Throughput: 0: 9963.9, 1: 9636.2. Samples: 244543688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:40:01,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-5.826')] [2023-12-27 22:40:01,199][106226] Updated weights for policy 0, policy_version 476813 (0.0007) [2023-12-27 22:40:01,206][106225] Updated weights for policy 1, policy_version 478233 (0.0006) [2023-12-27 22:40:01,253][106226] Updated weights for policy 0, policy_version 476823 (0.0006) [2023-12-27 22:40:01,268][106225] Updated weights for policy 1, policy_version 478243 (0.0007) [2023-12-27 22:40:01,316][106226] Updated weights for policy 0, policy_version 476833 (0.0008) [2023-12-27 22:40:01,323][106225] Updated weights for policy 1, policy_version 478253 (0.0007) [2023-12-27 22:40:02,025][106225] Updated weights for policy 1, policy_version 478263 (0.0009) [2023-12-27 22:40:02,076][106226] Updated weights for policy 0, policy_version 476843 (0.0009) [2023-12-27 22:40:02,083][106225] Updated weights for policy 1, policy_version 478273 (0.0007) [2023-12-27 22:40:02,137][106226] Updated weights for policy 0, policy_version 476853 (0.0007) [2023-12-27 22:40:02,142][106225] Updated weights for policy 1, policy_version 478283 (0.0008) [2023-12-27 22:40:02,193][106226] Updated weights for policy 0, policy_version 476863 (0.0007) [2023-12-27 22:40:02,856][106225] Updated weights for policy 1, policy_version 478293 (0.0008) [2023-12-27 22:40:02,911][106225] Updated weights for policy 1, policy_version 478303 (0.0008) [2023-12-27 22:40:02,937][106226] Updated weights for policy 0, policy_version 476873 (0.0008) [2023-12-27 22:40:02,975][106225] Updated weights for policy 1, policy_version 478313 (0.0008) [2023-12-27 22:40:02,985][106226] Updated weights for policy 0, policy_version 476883 (0.0007) [2023-12-27 22:40:03,035][106226] Updated weights for policy 0, policy_version 476893 (0.0007) [2023-12-27 22:40:03,085][106226] Updated weights for policy 0, policy_version 476903 (0.0005) [2023-12-27 22:40:03,713][106225] Updated weights for policy 1, policy_version 478323 (0.0006) [2023-12-27 22:40:03,761][106226] Updated weights for policy 0, policy_version 476913 (0.0007) [2023-12-27 22:40:03,763][106225] Updated weights for policy 1, policy_version 478333 (0.0007) [2023-12-27 22:40:03,809][106226] Updated weights for policy 0, policy_version 476923 (0.0007) [2023-12-27 22:40:03,811][106225] Updated weights for policy 1, policy_version 478343 (0.0006) [2023-12-27 22:40:03,866][106226] Updated weights for policy 0, policy_version 476933 (0.0007) [2023-12-27 22:40:04,530][106225] Updated weights for policy 1, policy_version 478353 (0.0007) [2023-12-27 22:40:04,592][106225] Updated weights for policy 1, policy_version 478363 (0.0006) [2023-12-27 22:40:04,636][106226] Updated weights for policy 0, policy_version 476943 (0.0008) [2023-12-27 22:40:04,653][106225] Updated weights for policy 1, policy_version 478373 (0.0005) [2023-12-27 22:40:04,699][106226] Updated weights for policy 0, policy_version 476953 (0.0008) [2023-12-27 22:40:04,713][106225] Updated weights for policy 1, policy_version 478383 (0.0005) [2023-12-27 22:40:04,767][106226] Updated weights for policy 0, policy_version 476963 (0.0009) [2023-12-27 22:40:05,342][106225] Updated weights for policy 1, policy_version 478393 (0.0009) [2023-12-27 22:40:05,391][106225] Updated weights for policy 1, policy_version 478403 (0.0008) [2023-12-27 22:40:05,449][106225] Updated weights for policy 1, policy_version 478413 (0.0008) [2023-12-27 22:40:05,459][106226] Updated weights for policy 0, policy_version 476973 (0.0008) [2023-12-27 22:40:05,520][106226] Updated weights for policy 0, policy_version 476983 (0.0008) [2023-12-27 22:40:05,578][106226] Updated weights for policy 0, policy_version 476993 (0.0008) [2023-12-27 22:40:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 244645888. Throughput: 0: 9928.2, 1: 9652.3. Samples: 244660532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:40:06,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-5.628')] [2023-12-27 22:40:06,193][106225] Updated weights for policy 1, policy_version 478423 (0.0007) [2023-12-27 22:40:06,258][106225] Updated weights for policy 1, policy_version 478433 (0.0008) [2023-12-27 22:40:06,306][106226] Updated weights for policy 0, policy_version 477003 (0.0009) [2023-12-27 22:40:06,320][106225] Updated weights for policy 1, policy_version 478443 (0.0007) [2023-12-27 22:40:06,371][106226] Updated weights for policy 0, policy_version 477013 (0.0008) [2023-12-27 22:40:06,428][106226] Updated weights for policy 0, policy_version 477023 (0.0009) [2023-12-27 22:40:07,096][106225] Updated weights for policy 1, policy_version 478453 (0.0008) [2023-12-27 22:40:07,107][106226] Updated weights for policy 0, policy_version 477033 (0.0008) [2023-12-27 22:40:07,150][106225] Updated weights for policy 1, policy_version 478463 (0.0007) [2023-12-27 22:40:07,164][106226] Updated weights for policy 0, policy_version 477043 (0.0011) [2023-12-27 22:40:07,208][106225] Updated weights for policy 1, policy_version 478473 (0.0007) [2023-12-27 22:40:07,221][106226] Updated weights for policy 0, policy_version 477053 (0.0007) [2023-12-27 22:40:07,280][106226] Updated weights for policy 0, policy_version 477063 (0.0006) [2023-12-27 22:40:07,905][106226] Updated weights for policy 0, policy_version 477073 (0.0008) [2023-12-27 22:40:07,961][106226] Updated weights for policy 0, policy_version 477083 (0.0008) [2023-12-27 22:40:07,987][106225] Updated weights for policy 1, policy_version 478483 (0.0008) [2023-12-27 22:40:08,026][106226] Updated weights for policy 0, policy_version 477093 (0.0007) [2023-12-27 22:40:08,039][106225] Updated weights for policy 1, policy_version 478493 (0.0008) [2023-12-27 22:40:08,086][106225] Updated weights for policy 1, policy_version 478503 (0.0009) [2023-12-27 22:40:08,668][106226] Updated weights for policy 0, policy_version 477103 (0.0007) [2023-12-27 22:40:08,728][106226] Updated weights for policy 0, policy_version 477113 (0.0009) [2023-12-27 22:40:08,789][106226] Updated weights for policy 0, policy_version 477123 (0.0008) [2023-12-27 22:40:08,889][106225] Updated weights for policy 1, policy_version 478513 (0.0008) [2023-12-27 22:40:08,949][106225] Updated weights for policy 1, policy_version 478523 (0.0008) [2023-12-27 22:40:09,001][106225] Updated weights for policy 1, policy_version 478533 (0.0008) [2023-12-27 22:40:09,063][106225] Updated weights for policy 1, policy_version 478543 (0.0009) [2023-12-27 22:40:09,593][106226] Updated weights for policy 0, policy_version 477133 (0.0009) [2023-12-27 22:40:09,660][106226] Updated weights for policy 0, policy_version 477143 (0.0009) [2023-12-27 22:40:09,721][106226] Updated weights for policy 0, policy_version 477153 (0.0007) [2023-12-27 22:40:09,851][106225] Updated weights for policy 1, policy_version 478553 (0.0009) [2023-12-27 22:40:09,919][106225] Updated weights for policy 1, policy_version 478563 (0.0006) [2023-12-27 22:40:09,990][106225] Updated weights for policy 1, policy_version 478573 (0.0008) [2023-12-27 22:40:10,457][106226] Updated weights for policy 0, policy_version 477163 (0.0007) [2023-12-27 22:40:10,518][106226] Updated weights for policy 0, policy_version 477173 (0.0008) [2023-12-27 22:40:10,582][106226] Updated weights for policy 0, policy_version 477183 (0.0008) [2023-12-27 22:40:10,762][106225] Updated weights for policy 1, policy_version 478583 (0.0008) [2023-12-27 22:40:10,828][106225] Updated weights for policy 1, policy_version 478593 (0.0008) [2023-12-27 22:40:10,895][106225] Updated weights for policy 1, policy_version 478603 (0.0008) [2023-12-27 22:40:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 244744192. Throughput: 0: 9948.4, 1: 9622.8. Samples: 244718188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:40:11,175][105115] Avg episode reward: [(0, '-4.843'), (1, '-5.543')] [2023-12-27 22:40:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000477192_122191872.pth... [2023-12-27 22:40:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000478608_122552320.pth... [2023-12-27 22:40:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000476072_121905152.pth [2023-12-27 22:40:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000477488_122265600.pth [2023-12-27 22:40:11,354][106226] Updated weights for policy 0, policy_version 477193 (0.0009) [2023-12-27 22:40:11,420][106226] Updated weights for policy 0, policy_version 477203 (0.0011) [2023-12-27 22:40:11,483][106226] Updated weights for policy 0, policy_version 477213 (0.0011) [2023-12-27 22:40:11,545][106226] Updated weights for policy 0, policy_version 477223 (0.0011) [2023-12-27 22:40:11,723][106225] Updated weights for policy 1, policy_version 478613 (0.0008) [2023-12-27 22:40:11,795][106225] Updated weights for policy 1, policy_version 478623 (0.0006) [2023-12-27 22:40:11,864][106225] Updated weights for policy 1, policy_version 478633 (0.0006) [2023-12-27 22:40:12,337][106226] Updated weights for policy 0, policy_version 477233 (0.0010) [2023-12-27 22:40:12,407][106226] Updated weights for policy 0, policy_version 477244 (0.0009) [2023-12-27 22:40:12,473][106226] Updated weights for policy 0, policy_version 477254 (0.0010) [2023-12-27 22:40:12,506][106225] Updated weights for policy 1, policy_version 478643 (0.0006) [2023-12-27 22:40:12,568][106225] Updated weights for policy 1, policy_version 478653 (0.0008) [2023-12-27 22:40:12,627][106225] Updated weights for policy 1, policy_version 478663 (0.0008) [2023-12-27 22:40:13,194][106226] Updated weights for policy 0, policy_version 477264 (0.0009) [2023-12-27 22:40:13,254][106226] Updated weights for policy 0, policy_version 477274 (0.0009) [2023-12-27 22:40:13,313][106226] Updated weights for policy 0, policy_version 477284 (0.0009) [2023-12-27 22:40:13,334][106225] Updated weights for policy 1, policy_version 478673 (0.0008) [2023-12-27 22:40:13,393][106225] Updated weights for policy 1, policy_version 478683 (0.0009) [2023-12-27 22:40:13,457][106225] Updated weights for policy 1, policy_version 478693 (0.0006) [2023-12-27 22:40:13,509][106225] Updated weights for policy 1, policy_version 478703 (0.0010) [2023-12-27 22:40:13,911][106226] Updated weights for policy 0, policy_version 477294 (0.0007) [2023-12-27 22:40:13,967][106226] Updated weights for policy 0, policy_version 477304 (0.0008) [2023-12-27 22:40:14,032][106226] Updated weights for policy 0, policy_version 477314 (0.0008) [2023-12-27 22:40:14,227][106225] Updated weights for policy 1, policy_version 478713 (0.0010) [2023-12-27 22:40:14,283][106225] Updated weights for policy 1, policy_version 478723 (0.0010) [2023-12-27 22:40:14,344][106225] Updated weights for policy 1, policy_version 478733 (0.0010) [2023-12-27 22:40:14,784][106226] Updated weights for policy 0, policy_version 477324 (0.0007) [2023-12-27 22:40:14,839][106226] Updated weights for policy 0, policy_version 477334 (0.0007) [2023-12-27 22:40:14,890][106226] Updated weights for policy 0, policy_version 477344 (0.0009) [2023-12-27 22:40:14,963][106225] Updated weights for policy 1, policy_version 478743 (0.0010) [2023-12-27 22:40:15,031][106225] Updated weights for policy 1, policy_version 478753 (0.0009) [2023-12-27 22:40:15,093][106225] Updated weights for policy 1, policy_version 478763 (0.0010) [2023-12-27 22:40:15,592][106226] Updated weights for policy 0, policy_version 477354 (0.0006) [2023-12-27 22:40:15,647][106226] Updated weights for policy 0, policy_version 477364 (0.0005) [2023-12-27 22:40:15,701][106226] Updated weights for policy 0, policy_version 477374 (0.0005) [2023-12-27 22:40:15,742][106225] Updated weights for policy 1, policy_version 478773 (0.0007) [2023-12-27 22:40:15,757][106226] Updated weights for policy 0, policy_version 477384 (0.0008) [2023-12-27 22:40:15,801][106225] Updated weights for policy 1, policy_version 478783 (0.0005) [2023-12-27 22:40:15,861][106225] Updated weights for policy 1, policy_version 478793 (0.0008) [2023-12-27 22:40:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 244842496. Throughput: 0: 9802.6, 1: 9611.6. Samples: 244831472. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:16,175][105115] Avg episode reward: [(0, '-5.157'), (1, '-5.879')] [2023-12-27 22:40:16,368][106226] Updated weights for policy 0, policy_version 477394 (0.0009) [2023-12-27 22:40:16,429][106226] Updated weights for policy 0, policy_version 477404 (0.0010) [2023-12-27 22:40:16,490][106225] Updated weights for policy 1, policy_version 478803 (0.0010) [2023-12-27 22:40:16,491][106226] Updated weights for policy 0, policy_version 477414 (0.0008) [2023-12-27 22:40:16,539][106225] Updated weights for policy 1, policy_version 478813 (0.0010) [2023-12-27 22:40:16,590][106225] Updated weights for policy 1, policy_version 478823 (0.0008) [2023-12-27 22:40:17,226][106226] Updated weights for policy 0, policy_version 477424 (0.0009) [2023-12-27 22:40:17,254][106225] Updated weights for policy 1, policy_version 478833 (0.0010) [2023-12-27 22:40:17,278][106226] Updated weights for policy 0, policy_version 477434 (0.0010) [2023-12-27 22:40:17,311][106225] Updated weights for policy 1, policy_version 478843 (0.0010) [2023-12-27 22:40:17,338][106226] Updated weights for policy 0, policy_version 477444 (0.0006) [2023-12-27 22:40:17,369][106225] Updated weights for policy 1, policy_version 478853 (0.0009) [2023-12-27 22:40:17,429][106225] Updated weights for policy 1, policy_version 478863 (0.0010) [2023-12-27 22:40:18,024][106226] Updated weights for policy 0, policy_version 477454 (0.0006) [2023-12-27 22:40:18,078][106226] Updated weights for policy 0, policy_version 477464 (0.0007) [2023-12-27 22:40:18,115][106225] Updated weights for policy 1, policy_version 478873 (0.0010) [2023-12-27 22:40:18,132][106226] Updated weights for policy 0, policy_version 477474 (0.0006) [2023-12-27 22:40:18,162][106225] Updated weights for policy 1, policy_version 478883 (0.0009) [2023-12-27 22:40:18,213][106225] Updated weights for policy 1, policy_version 478893 (0.0005) [2023-12-27 22:40:18,911][106226] Updated weights for policy 0, policy_version 477484 (0.0007) [2023-12-27 22:40:18,932][106225] Updated weights for policy 1, policy_version 478903 (0.0010) [2023-12-27 22:40:18,982][106226] Updated weights for policy 0, policy_version 477494 (0.0008) [2023-12-27 22:40:18,993][106225] Updated weights for policy 1, policy_version 478913 (0.0010) [2023-12-27 22:40:19,048][106226] Updated weights for policy 0, policy_version 477504 (0.0009) [2023-12-27 22:40:19,055][106225] Updated weights for policy 1, policy_version 478923 (0.0010) [2023-12-27 22:40:19,709][106226] Updated weights for policy 0, policy_version 477514 (0.0011) [2023-12-27 22:40:19,765][106226] Updated weights for policy 0, policy_version 477524 (0.0009) [2023-12-27 22:40:19,829][106226] Updated weights for policy 0, policy_version 477534 (0.0008) [2023-12-27 22:40:19,836][106225] Updated weights for policy 1, policy_version 478933 (0.0009) [2023-12-27 22:40:19,894][106226] Updated weights for policy 0, policy_version 477544 (0.0007) [2023-12-27 22:40:19,900][106225] Updated weights for policy 1, policy_version 478943 (0.0010) [2023-12-27 22:40:19,964][106225] Updated weights for policy 1, policy_version 478953 (0.0008) [2023-12-27 22:40:20,629][106226] Updated weights for policy 0, policy_version 477554 (0.0009) [2023-12-27 22:40:20,694][106226] Updated weights for policy 0, policy_version 477564 (0.0008) [2023-12-27 22:40:20,746][106225] Updated weights for policy 1, policy_version 478963 (0.0009) [2023-12-27 22:40:20,757][106226] Updated weights for policy 0, policy_version 477574 (0.0008) [2023-12-27 22:40:20,802][106225] Updated weights for policy 1, policy_version 478973 (0.0010) [2023-12-27 22:40:20,866][106225] Updated weights for policy 1, policy_version 478983 (0.0010) [2023-12-27 22:40:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 244940800. Throughput: 0: 9760.8, 1: 9647.1. Samples: 244950168. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:21,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-5.464')] [2023-12-27 22:40:21,563][106226] Updated weights for policy 0, policy_version 477584 (0.0008) [2023-12-27 22:40:21,607][106225] Updated weights for policy 1, policy_version 478993 (0.0010) [2023-12-27 22:40:21,619][106226] Updated weights for policy 0, policy_version 477594 (0.0008) [2023-12-27 22:40:21,675][106225] Updated weights for policy 1, policy_version 479003 (0.0008) [2023-12-27 22:40:21,681][106226] Updated weights for policy 0, policy_version 477604 (0.0008) [2023-12-27 22:40:21,744][106225] Updated weights for policy 1, policy_version 479013 (0.0013) [2023-12-27 22:40:21,806][106225] Updated weights for policy 1, policy_version 479023 (0.0007) [2023-12-27 22:40:22,466][106226] Updated weights for policy 0, policy_version 477614 (0.0010) [2023-12-27 22:40:22,533][106226] Updated weights for policy 0, policy_version 477624 (0.0008) [2023-12-27 22:40:22,549][106225] Updated weights for policy 1, policy_version 479033 (0.0006) [2023-12-27 22:40:22,586][106226] Updated weights for policy 0, policy_version 477634 (0.0010) [2023-12-27 22:40:22,615][106225] Updated weights for policy 1, policy_version 479043 (0.0006) [2023-12-27 22:40:22,678][106225] Updated weights for policy 1, policy_version 479053 (0.0005) [2023-12-27 22:40:23,261][106225] Updated weights for policy 1, policy_version 479063 (0.0009) [2023-12-27 22:40:23,280][106226] Updated weights for policy 0, policy_version 477644 (0.0011) [2023-12-27 22:40:23,319][106225] Updated weights for policy 1, policy_version 479073 (0.0006) [2023-12-27 22:40:23,339][106226] Updated weights for policy 0, policy_version 477654 (0.0010) [2023-12-27 22:40:23,375][106225] Updated weights for policy 1, policy_version 479083 (0.0005) [2023-12-27 22:40:23,392][106226] Updated weights for policy 0, policy_version 477664 (0.0010) [2023-12-27 22:40:24,075][106226] Updated weights for policy 0, policy_version 477674 (0.0006) [2023-12-27 22:40:24,080][106225] Updated weights for policy 1, policy_version 479093 (0.0009) [2023-12-27 22:40:24,129][106225] Updated weights for policy 1, policy_version 479103 (0.0008) [2023-12-27 22:40:24,135][106226] Updated weights for policy 0, policy_version 477684 (0.0006) [2023-12-27 22:40:24,183][106225] Updated weights for policy 1, policy_version 479113 (0.0006) [2023-12-27 22:40:24,195][106226] Updated weights for policy 0, policy_version 477694 (0.0010) [2023-12-27 22:40:24,252][106226] Updated weights for policy 0, policy_version 477704 (0.0011) [2023-12-27 22:40:24,894][106226] Updated weights for policy 0, policy_version 477714 (0.0007) [2023-12-27 22:40:24,920][106225] Updated weights for policy 1, policy_version 479123 (0.0008) [2023-12-27 22:40:24,954][106226] Updated weights for policy 0, policy_version 477724 (0.0009) [2023-12-27 22:40:24,973][106225] Updated weights for policy 1, policy_version 479133 (0.0010) [2023-12-27 22:40:25,011][106226] Updated weights for policy 0, policy_version 477734 (0.0007) [2023-12-27 22:40:25,022][106225] Updated weights for policy 1, policy_version 479143 (0.0009) [2023-12-27 22:40:25,716][106225] Updated weights for policy 1, policy_version 479153 (0.0010) [2023-12-27 22:40:25,734][106226] Updated weights for policy 0, policy_version 477744 (0.0007) [2023-12-27 22:40:25,775][106225] Updated weights for policy 1, policy_version 479163 (0.0006) [2023-12-27 22:40:25,795][106226] Updated weights for policy 0, policy_version 477754 (0.0008) [2023-12-27 22:40:25,823][106225] Updated weights for policy 1, policy_version 479173 (0.0008) [2023-12-27 22:40:25,848][106226] Updated weights for policy 0, policy_version 477764 (0.0007) [2023-12-27 22:40:25,873][106225] Updated weights for policy 1, policy_version 479183 (0.0006) [2023-12-27 22:40:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 245039104. Throughput: 0: 9732.8, 1: 9622.8. Samples: 245007924. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:26,176][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.598')] [2023-12-27 22:40:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000477768_122339328.pth... [2023-12-27 22:40:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000479184_122699776.pth... [2023-12-27 22:40:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000476648_122052608.pth [2023-12-27 22:40:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000478064_122413056.pth [2023-12-27 22:40:26,551][106226] Updated weights for policy 0, policy_version 477774 (0.0005) [2023-12-27 22:40:26,620][106226] Updated weights for policy 0, policy_version 477784 (0.0006) [2023-12-27 22:40:26,650][106225] Updated weights for policy 1, policy_version 479193 (0.0006) [2023-12-27 22:40:26,678][106226] Updated weights for policy 0, policy_version 477794 (0.0005) [2023-12-27 22:40:26,708][106225] Updated weights for policy 1, policy_version 479203 (0.0008) [2023-12-27 22:40:26,761][106225] Updated weights for policy 1, policy_version 479213 (0.0007) [2023-12-27 22:40:27,319][106226] Updated weights for policy 0, policy_version 477804 (0.0008) [2023-12-27 22:40:27,333][106225] Updated weights for policy 1, policy_version 479223 (0.0005) [2023-12-27 22:40:27,375][106226] Updated weights for policy 0, policy_version 477814 (0.0009) [2023-12-27 22:40:27,388][106225] Updated weights for policy 1, policy_version 479233 (0.0006) [2023-12-27 22:40:27,440][106226] Updated weights for policy 0, policy_version 477824 (0.0005) [2023-12-27 22:40:27,446][106225] Updated weights for policy 1, policy_version 479243 (0.0005) [2023-12-27 22:40:27,981][106225] Updated weights for policy 1, policy_version 479253 (0.0005) [2023-12-27 22:40:27,992][106226] Updated weights for policy 0, policy_version 477834 (0.0006) [2023-12-27 22:40:28,032][106225] Updated weights for policy 1, policy_version 479263 (0.0006) [2023-12-27 22:40:28,052][106226] Updated weights for policy 0, policy_version 477844 (0.0011) [2023-12-27 22:40:28,084][106225] Updated weights for policy 1, policy_version 479273 (0.0005) [2023-12-27 22:40:28,103][106226] Updated weights for policy 0, policy_version 477854 (0.0010) [2023-12-27 22:40:28,160][106226] Updated weights for policy 0, policy_version 477864 (0.0011) [2023-12-27 22:40:28,734][106225] Updated weights for policy 1, policy_version 479283 (0.0007) [2023-12-27 22:40:28,792][106225] Updated weights for policy 1, policy_version 479293 (0.0010) [2023-12-27 22:40:28,854][106225] Updated weights for policy 1, policy_version 479303 (0.0010) [2023-12-27 22:40:28,871][106226] Updated weights for policy 0, policy_version 477874 (0.0011) [2023-12-27 22:40:28,931][106226] Updated weights for policy 0, policy_version 477884 (0.0010) [2023-12-27 22:40:28,983][106226] Updated weights for policy 0, policy_version 477894 (0.0010) [2023-12-27 22:40:29,564][106225] Updated weights for policy 1, policy_version 479313 (0.0010) [2023-12-27 22:40:29,626][106225] Updated weights for policy 1, policy_version 479323 (0.0009) [2023-12-27 22:40:29,686][106225] Updated weights for policy 1, policy_version 479333 (0.0007) [2023-12-27 22:40:29,744][106226] Updated weights for policy 0, policy_version 477904 (0.0011) [2023-12-27 22:40:29,750][106225] Updated weights for policy 1, policy_version 479343 (0.0008) [2023-12-27 22:40:29,801][106226] Updated weights for policy 0, policy_version 477914 (0.0010) [2023-12-27 22:40:29,866][106226] Updated weights for policy 0, policy_version 477924 (0.0009) [2023-12-27 22:40:30,493][106225] Updated weights for policy 1, policy_version 479353 (0.0007) [2023-12-27 22:40:30,544][106225] Updated weights for policy 1, policy_version 479363 (0.0005) [2023-12-27 22:40:30,582][106226] Updated weights for policy 0, policy_version 477934 (0.0011) [2023-12-27 22:40:30,605][106225] Updated weights for policy 1, policy_version 479373 (0.0005) [2023-12-27 22:40:30,638][106226] Updated weights for policy 0, policy_version 477944 (0.0010) [2023-12-27 22:40:30,694][106226] Updated weights for policy 0, policy_version 477954 (0.0010) [2023-12-27 22:40:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 245137408. Throughput: 0: 9785.0, 1: 9737.4. Samples: 245130488. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:31,175][105115] Avg episode reward: [(0, '-5.109'), (1, '-5.646')] [2023-12-27 22:40:31,194][106225] Updated weights for policy 1, policy_version 479383 (0.0008) [2023-12-27 22:40:31,248][106225] Updated weights for policy 1, policy_version 479393 (0.0008) [2023-12-27 22:40:31,304][106225] Updated weights for policy 1, policy_version 479403 (0.0009) [2023-12-27 22:40:31,325][106226] Updated weights for policy 0, policy_version 477964 (0.0010) [2023-12-27 22:40:31,394][106226] Updated weights for policy 0, policy_version 477974 (0.0009) [2023-12-27 22:40:31,455][106226] Updated weights for policy 0, policy_version 477984 (0.0009) [2023-12-27 22:40:32,075][106225] Updated weights for policy 1, policy_version 479413 (0.0008) [2023-12-27 22:40:32,129][106225] Updated weights for policy 1, policy_version 479423 (0.0008) [2023-12-27 22:40:32,182][106225] Updated weights for policy 1, policy_version 479433 (0.0008) [2023-12-27 22:40:32,199][106226] Updated weights for policy 0, policy_version 477994 (0.0009) [2023-12-27 22:40:32,249][106226] Updated weights for policy 0, policy_version 478004 (0.0007) [2023-12-27 22:40:32,311][106226] Updated weights for policy 0, policy_version 478014 (0.0009) [2023-12-27 22:40:32,373][106226] Updated weights for policy 0, policy_version 478024 (0.0008) [2023-12-27 22:40:32,910][106225] Updated weights for policy 1, policy_version 479443 (0.0008) [2023-12-27 22:40:32,972][106225] Updated weights for policy 1, policy_version 479453 (0.0009) [2023-12-27 22:40:33,036][106225] Updated weights for policy 1, policy_version 479463 (0.0008) [2023-12-27 22:40:33,066][106226] Updated weights for policy 0, policy_version 478034 (0.0007) [2023-12-27 22:40:33,131][106226] Updated weights for policy 0, policy_version 478044 (0.0005) [2023-12-27 22:40:33,190][106226] Updated weights for policy 0, policy_version 478054 (0.0005) [2023-12-27 22:40:33,682][106225] Updated weights for policy 1, policy_version 479473 (0.0008) [2023-12-27 22:40:33,749][106225] Updated weights for policy 1, policy_version 479483 (0.0009) [2023-12-27 22:40:33,754][106226] Updated weights for policy 0, policy_version 478064 (0.0006) [2023-12-27 22:40:33,799][106226] Updated weights for policy 0, policy_version 478074 (0.0006) [2023-12-27 22:40:33,809][106225] Updated weights for policy 1, policy_version 479493 (0.0009) [2023-12-27 22:40:33,851][106226] Updated weights for policy 0, policy_version 478084 (0.0007) [2023-12-27 22:40:33,863][106225] Updated weights for policy 1, policy_version 479503 (0.0007) [2023-12-27 22:40:34,432][106225] Updated weights for policy 1, policy_version 479513 (0.0007) [2023-12-27 22:40:34,468][106226] Updated weights for policy 0, policy_version 478094 (0.0007) [2023-12-27 22:40:34,496][106225] Updated weights for policy 1, policy_version 479523 (0.0006) [2023-12-27 22:40:34,535][106226] Updated weights for policy 0, policy_version 478104 (0.0006) [2023-12-27 22:40:34,557][106225] Updated weights for policy 1, policy_version 479533 (0.0007) [2023-12-27 22:40:34,593][106226] Updated weights for policy 0, policy_version 478114 (0.0007) [2023-12-27 22:40:35,135][106226] Updated weights for policy 0, policy_version 478124 (0.0010) [2023-12-27 22:40:35,209][106226] Updated weights for policy 0, policy_version 478134 (0.0008) [2023-12-27 22:40:35,228][106225] Updated weights for policy 1, policy_version 479543 (0.0007) [2023-12-27 22:40:35,268][106226] Updated weights for policy 0, policy_version 478144 (0.0006) [2023-12-27 22:40:35,284][106225] Updated weights for policy 1, policy_version 479553 (0.0008) [2023-12-27 22:40:35,337][106225] Updated weights for policy 1, policy_version 479563 (0.0008) [2023-12-27 22:40:35,810][106226] Updated weights for policy 0, policy_version 478154 (0.0007) [2023-12-27 22:40:35,868][106226] Updated weights for policy 0, policy_version 478164 (0.0008) [2023-12-27 22:40:35,925][106226] Updated weights for policy 0, policy_version 478174 (0.0008) [2023-12-27 22:40:35,949][106225] Updated weights for policy 1, policy_version 479573 (0.0009) [2023-12-27 22:40:35,981][106226] Updated weights for policy 0, policy_version 478184 (0.0006) [2023-12-27 22:40:36,016][106225] Updated weights for policy 1, policy_version 479583 (0.0010) [2023-12-27 22:40:36,067][106225] Updated weights for policy 1, policy_version 479593 (0.0010) [2023-12-27 22:40:36,174][105115] Fps is (10 sec: 21299.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 245252096. Throughput: 0: 9826.8, 1: 9810.9. Samples: 245256844. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:36,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.796')] [2023-12-27 22:40:36,733][106225] Updated weights for policy 1, policy_version 479603 (0.0009) [2023-12-27 22:40:36,765][106226] Updated weights for policy 0, policy_version 478194 (0.0008) [2023-12-27 22:40:36,797][106225] Updated weights for policy 1, policy_version 479613 (0.0010) [2023-12-27 22:40:36,821][106226] Updated weights for policy 0, policy_version 478204 (0.0009) [2023-12-27 22:40:36,858][106225] Updated weights for policy 1, policy_version 479623 (0.0010) [2023-12-27 22:40:36,879][106226] Updated weights for policy 0, policy_version 478214 (0.0005) [2023-12-27 22:40:37,570][106225] Updated weights for policy 1, policy_version 479633 (0.0010) [2023-12-27 22:40:37,615][106226] Updated weights for policy 0, policy_version 478224 (0.0006) [2023-12-27 22:40:37,625][106225] Updated weights for policy 1, policy_version 479643 (0.0010) [2023-12-27 22:40:37,670][106226] Updated weights for policy 0, policy_version 478234 (0.0006) [2023-12-27 22:40:37,687][106225] Updated weights for policy 1, policy_version 479653 (0.0010) [2023-12-27 22:40:37,733][106226] Updated weights for policy 0, policy_version 478244 (0.0007) [2023-12-27 22:40:37,753][106225] Updated weights for policy 1, policy_version 479663 (0.0008) [2023-12-27 22:40:38,474][106225] Updated weights for policy 1, policy_version 479673 (0.0009) [2023-12-27 22:40:38,492][106226] Updated weights for policy 0, policy_version 478254 (0.0008) [2023-12-27 22:40:38,533][106225] Updated weights for policy 1, policy_version 479683 (0.0010) [2023-12-27 22:40:38,559][106226] Updated weights for policy 0, policy_version 478264 (0.0006) [2023-12-27 22:40:38,592][106225] Updated weights for policy 1, policy_version 479693 (0.0008) [2023-12-27 22:40:38,618][106226] Updated weights for policy 0, policy_version 478274 (0.0008) [2023-12-27 22:40:39,193][106225] Updated weights for policy 1, policy_version 479703 (0.0006) [2023-12-27 22:40:39,252][106225] Updated weights for policy 1, policy_version 479713 (0.0010) [2023-12-27 22:40:39,318][106225] Updated weights for policy 1, policy_version 479723 (0.0011) [2023-12-27 22:40:39,399][106226] Updated weights for policy 0, policy_version 478284 (0.0009) [2023-12-27 22:40:39,464][106226] Updated weights for policy 0, policy_version 478294 (0.0008) [2023-12-27 22:40:39,530][106226] Updated weights for policy 0, policy_version 478304 (0.0008) [2023-12-27 22:40:40,060][106225] Updated weights for policy 1, policy_version 479733 (0.0008) [2023-12-27 22:40:40,121][106225] Updated weights for policy 1, policy_version 479743 (0.0008) [2023-12-27 22:40:40,181][106225] Updated weights for policy 1, policy_version 479753 (0.0008) [2023-12-27 22:40:40,277][106226] Updated weights for policy 0, policy_version 478314 (0.0008) [2023-12-27 22:40:40,346][106226] Updated weights for policy 0, policy_version 478324 (0.0008) [2023-12-27 22:40:40,404][106226] Updated weights for policy 0, policy_version 478334 (0.0007) [2023-12-27 22:40:40,460][106226] Updated weights for policy 0, policy_version 478344 (0.0008) [2023-12-27 22:40:40,853][106225] Updated weights for policy 1, policy_version 479763 (0.0008) [2023-12-27 22:40:40,906][106225] Updated weights for policy 1, policy_version 479773 (0.0007) [2023-12-27 22:40:40,970][106225] Updated weights for policy 1, policy_version 479783 (0.0008) [2023-12-27 22:40:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 245342208. Throughput: 0: 9793.2, 1: 9858.3. Samples: 245314404. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:41,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.487')] [2023-12-27 22:40:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000479792_122855424.pth... [2023-12-27 22:40:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000478608_122552320.pth [2023-12-27 22:40:41,239][106226] Updated weights for policy 0, policy_version 478354 (0.0008) [2023-12-27 22:40:41,303][106226] Updated weights for policy 0, policy_version 478364 (0.0008) [2023-12-27 22:40:41,380][106226] Updated weights for policy 0, policy_version 478374 (0.0008) [2023-12-27 22:40:41,392][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000478376_122494976.pth... [2023-12-27 22:40:41,397][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000477192_122191872.pth [2023-12-27 22:40:41,713][106225] Updated weights for policy 1, policy_version 479793 (0.0007) [2023-12-27 22:40:41,782][106225] Updated weights for policy 1, policy_version 479803 (0.0006) [2023-12-27 22:40:41,846][106225] Updated weights for policy 1, policy_version 479813 (0.0008) [2023-12-27 22:40:41,909][106225] Updated weights for policy 1, policy_version 479823 (0.0008) [2023-12-27 22:40:42,204][106226] Updated weights for policy 0, policy_version 478384 (0.0009) [2023-12-27 22:40:42,259][106226] Updated weights for policy 0, policy_version 478394 (0.0009) [2023-12-27 22:40:42,319][106226] Updated weights for policy 0, policy_version 478404 (0.0009) [2023-12-27 22:40:42,590][106225] Updated weights for policy 1, policy_version 479833 (0.0009) [2023-12-27 22:40:42,660][106225] Updated weights for policy 1, policy_version 479843 (0.0008) [2023-12-27 22:40:42,724][106225] Updated weights for policy 1, policy_version 479853 (0.0006) [2023-12-27 22:40:42,958][106226] Updated weights for policy 0, policy_version 478414 (0.0008) [2023-12-27 22:40:43,018][106226] Updated weights for policy 0, policy_version 478424 (0.0009) [2023-12-27 22:40:43,079][106226] Updated weights for policy 0, policy_version 478434 (0.0008) [2023-12-27 22:40:43,405][106225] Updated weights for policy 1, policy_version 479863 (0.0006) [2023-12-27 22:40:43,449][106225] Updated weights for policy 1, policy_version 479873 (0.0005) [2023-12-27 22:40:43,496][106225] Updated weights for policy 1, policy_version 479883 (0.0008) [2023-12-27 22:40:43,827][106226] Updated weights for policy 0, policy_version 478444 (0.0009) [2023-12-27 22:40:43,889][106226] Updated weights for policy 0, policy_version 478454 (0.0008) [2023-12-27 22:40:43,949][106226] Updated weights for policy 0, policy_version 478464 (0.0009) [2023-12-27 22:40:44,132][106225] Updated weights for policy 1, policy_version 479893 (0.0010) [2023-12-27 22:40:44,188][106225] Updated weights for policy 1, policy_version 479903 (0.0009) [2023-12-27 22:40:44,249][106225] Updated weights for policy 1, policy_version 479913 (0.0006) [2023-12-27 22:40:44,700][106226] Updated weights for policy 0, policy_version 478474 (0.0009) [2023-12-27 22:40:44,787][106226] Updated weights for policy 0, policy_version 478484 (0.0006) [2023-12-27 22:40:44,846][106226] Updated weights for policy 0, policy_version 478494 (0.0007) [2023-12-27 22:40:44,910][106226] Updated weights for policy 0, policy_version 478504 (0.0010) [2023-12-27 22:40:44,910][106225] Updated weights for policy 1, policy_version 479923 (0.0007) [2023-12-27 22:40:45,003][106225] Updated weights for policy 1, policy_version 479933 (0.0010) [2023-12-27 22:40:45,065][106225] Updated weights for policy 1, policy_version 479943 (0.0010) [2023-12-27 22:40:45,509][106226] Updated weights for policy 0, policy_version 478514 (0.0008) [2023-12-27 22:40:45,572][106226] Updated weights for policy 0, policy_version 478524 (0.0011) [2023-12-27 22:40:45,627][106226] Updated weights for policy 0, policy_version 478534 (0.0011) [2023-12-27 22:40:45,829][106225] Updated weights for policy 1, policy_version 479953 (0.0009) [2023-12-27 22:40:45,893][106225] Updated weights for policy 1, policy_version 479963 (0.0008) [2023-12-27 22:40:45,954][106225] Updated weights for policy 1, policy_version 479973 (0.0009) [2023-12-27 22:40:46,012][106225] Updated weights for policy 1, policy_version 479983 (0.0008) [2023-12-27 22:40:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 245440512. Throughput: 0: 9770.4, 1: 9935.0. Samples: 245430432. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:46,176][105115] Avg episode reward: [(0, '-5.129'), (1, '-5.558')] [2023-12-27 22:40:46,234][106226] Updated weights for policy 0, policy_version 478544 (0.0006) [2023-12-27 22:40:46,296][106226] Updated weights for policy 0, policy_version 478554 (0.0007) [2023-12-27 22:40:46,354][106226] Updated weights for policy 0, policy_version 478564 (0.0009) [2023-12-27 22:40:46,670][106225] Updated weights for policy 1, policy_version 479993 (0.0007) [2023-12-27 22:40:46,715][106225] Updated weights for policy 1, policy_version 480003 (0.0007) [2023-12-27 22:40:46,772][106225] Updated weights for policy 1, policy_version 480013 (0.0007) [2023-12-27 22:40:46,904][106226] Updated weights for policy 0, policy_version 478574 (0.0008) [2023-12-27 22:40:46,963][106226] Updated weights for policy 0, policy_version 478584 (0.0010) [2023-12-27 22:40:47,020][106226] Updated weights for policy 0, policy_version 478594 (0.0011) [2023-12-27 22:40:47,507][106225] Updated weights for policy 1, policy_version 480023 (0.0008) [2023-12-27 22:40:47,553][106225] Updated weights for policy 1, policy_version 480033 (0.0008) [2023-12-27 22:40:47,606][106225] Updated weights for policy 1, policy_version 480043 (0.0007) [2023-12-27 22:40:47,724][106226] Updated weights for policy 0, policy_version 478604 (0.0011) [2023-12-27 22:40:47,779][106226] Updated weights for policy 0, policy_version 478614 (0.0010) [2023-12-27 22:40:47,833][106226] Updated weights for policy 0, policy_version 478624 (0.0010) [2023-12-27 22:40:48,393][106225] Updated weights for policy 1, policy_version 480053 (0.0008) [2023-12-27 22:40:48,456][106225] Updated weights for policy 1, policy_version 480063 (0.0008) [2023-12-27 22:40:48,512][106225] Updated weights for policy 1, policy_version 480073 (0.0007) [2023-12-27 22:40:48,559][106226] Updated weights for policy 0, policy_version 478634 (0.0011) [2023-12-27 22:40:48,619][106226] Updated weights for policy 0, policy_version 478644 (0.0008) [2023-12-27 22:40:48,684][106226] Updated weights for policy 0, policy_version 478654 (0.0009) [2023-12-27 22:40:48,751][106226] Updated weights for policy 0, policy_version 478664 (0.0009) [2023-12-27 22:40:49,235][106225] Updated weights for policy 1, policy_version 480083 (0.0007) [2023-12-27 22:40:49,303][106225] Updated weights for policy 1, policy_version 480093 (0.0008) [2023-12-27 22:40:49,373][106225] Updated weights for policy 1, policy_version 480103 (0.0008) [2023-12-27 22:40:49,533][106226] Updated weights for policy 0, policy_version 478674 (0.0011) [2023-12-27 22:40:49,591][106226] Updated weights for policy 0, policy_version 478684 (0.0011) [2023-12-27 22:40:49,638][106226] Updated weights for policy 0, policy_version 478694 (0.0011) [2023-12-27 22:40:50,000][106225] Updated weights for policy 1, policy_version 480113 (0.0007) [2023-12-27 22:40:50,064][106225] Updated weights for policy 1, policy_version 480123 (0.0008) [2023-12-27 22:40:50,131][106225] Updated weights for policy 1, policy_version 480133 (0.0008) [2023-12-27 22:40:50,184][106225] Updated weights for policy 1, policy_version 480143 (0.0009) [2023-12-27 22:40:50,352][106226] Updated weights for policy 0, policy_version 478704 (0.0010) [2023-12-27 22:40:50,418][106226] Updated weights for policy 0, policy_version 478714 (0.0007) [2023-12-27 22:40:50,475][106226] Updated weights for policy 0, policy_version 478724 (0.0008) [2023-12-27 22:40:50,875][106225] Updated weights for policy 1, policy_version 480153 (0.0006) [2023-12-27 22:40:50,946][106225] Updated weights for policy 1, policy_version 480163 (0.0006) [2023-12-27 22:40:51,010][106225] Updated weights for policy 1, policy_version 480173 (0.0007) [2023-12-27 22:40:51,168][106226] Updated weights for policy 0, policy_version 478734 (0.0007) [2023-12-27 22:40:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 245538816. Throughput: 0: 9867.3, 1: 9883.2. Samples: 245549308. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:51,176][105115] Avg episode reward: [(0, '-5.075'), (1, '-5.541')] [2023-12-27 22:40:51,231][106226] Updated weights for policy 0, policy_version 478744 (0.0008) [2023-12-27 22:40:51,299][106226] Updated weights for policy 0, policy_version 478754 (0.0008) [2023-12-27 22:40:51,618][106225] Updated weights for policy 1, policy_version 480183 (0.0009) [2023-12-27 22:40:51,682][106225] Updated weights for policy 1, policy_version 480193 (0.0009) [2023-12-27 22:40:51,745][106225] Updated weights for policy 1, policy_version 480203 (0.0009) [2023-12-27 22:40:51,987][106226] Updated weights for policy 0, policy_version 478764 (0.0007) [2023-12-27 22:40:52,049][106226] Updated weights for policy 0, policy_version 478774 (0.0006) [2023-12-27 22:40:52,113][106226] Updated weights for policy 0, policy_version 478784 (0.0008) [2023-12-27 22:40:52,610][106225] Updated weights for policy 1, policy_version 480213 (0.0008) [2023-12-27 22:40:52,675][106225] Updated weights for policy 1, policy_version 480223 (0.0008) [2023-12-27 22:40:52,739][106225] Updated weights for policy 1, policy_version 480233 (0.0008) [2023-12-27 22:40:52,772][106226] Updated weights for policy 0, policy_version 478794 (0.0009) [2023-12-27 22:40:52,830][106226] Updated weights for policy 0, policy_version 478804 (0.0011) [2023-12-27 22:40:52,877][106226] Updated weights for policy 0, policy_version 478814 (0.0010) [2023-12-27 22:40:52,923][106226] Updated weights for policy 0, policy_version 478824 (0.0010) [2023-12-27 22:40:53,512][106225] Updated weights for policy 1, policy_version 480243 (0.0009) [2023-12-27 22:40:53,546][106226] Updated weights for policy 0, policy_version 478834 (0.0008) [2023-12-27 22:40:53,578][106225] Updated weights for policy 1, policy_version 480253 (0.0010) [2023-12-27 22:40:53,607][106226] Updated weights for policy 0, policy_version 478844 (0.0010) [2023-12-27 22:40:53,632][106225] Updated weights for policy 1, policy_version 480263 (0.0010) [2023-12-27 22:40:53,670][106226] Updated weights for policy 0, policy_version 478854 (0.0010) [2023-12-27 22:40:54,291][106225] Updated weights for policy 1, policy_version 480273 (0.0010) [2023-12-27 22:40:54,344][106226] Updated weights for policy 0, policy_version 478864 (0.0008) [2023-12-27 22:40:54,346][106225] Updated weights for policy 1, policy_version 480283 (0.0006) [2023-12-27 22:40:54,393][106226] Updated weights for policy 0, policy_version 478874 (0.0008) [2023-12-27 22:40:54,401][106225] Updated weights for policy 1, policy_version 480293 (0.0006) [2023-12-27 22:40:54,437][106226] Updated weights for policy 0, policy_version 478884 (0.0010) [2023-12-27 22:40:54,450][106225] Updated weights for policy 1, policy_version 480303 (0.0005) [2023-12-27 22:40:55,019][106225] Updated weights for policy 1, policy_version 480313 (0.0006) [2023-12-27 22:40:55,070][106225] Updated weights for policy 1, policy_version 480323 (0.0005) [2023-12-27 22:40:55,128][106225] Updated weights for policy 1, policy_version 480333 (0.0005) [2023-12-27 22:40:55,151][106226] Updated weights for policy 0, policy_version 478894 (0.0010) [2023-12-27 22:40:55,210][106226] Updated weights for policy 0, policy_version 478904 (0.0010) [2023-12-27 22:40:55,268][106226] Updated weights for policy 0, policy_version 478914 (0.0008) [2023-12-27 22:40:55,687][106225] Updated weights for policy 1, policy_version 480343 (0.0007) [2023-12-27 22:40:55,741][106225] Updated weights for policy 1, policy_version 480353 (0.0006) [2023-12-27 22:40:55,796][106225] Updated weights for policy 1, policy_version 480363 (0.0005) [2023-12-27 22:40:56,064][106226] Updated weights for policy 0, policy_version 478924 (0.0009) [2023-12-27 22:40:56,126][106226] Updated weights for policy 0, policy_version 478934 (0.0009) [2023-12-27 22:40:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 245637120. Throughput: 0: 9870.2, 1: 9897.1. Samples: 245607720. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:40:56,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-5.555')] [2023-12-27 22:40:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000480368_123002880.pth... [2023-12-27 22:40:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000479184_122699776.pth [2023-12-27 22:40:56,188][106226] Updated weights for policy 0, policy_version 478944 (0.0009) [2023-12-27 22:40:56,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000478952_122642432.pth... [2023-12-27 22:40:56,244][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000477768_122339328.pth [2023-12-27 22:40:56,459][106225] Updated weights for policy 1, policy_version 480373 (0.0007) [2023-12-27 22:40:56,523][106225] Updated weights for policy 1, policy_version 480383 (0.0006) [2023-12-27 22:40:56,582][106225] Updated weights for policy 1, policy_version 480393 (0.0009) [2023-12-27 22:40:56,946][106226] Updated weights for policy 0, policy_version 478954 (0.0008) [2023-12-27 22:40:57,008][106226] Updated weights for policy 0, policy_version 478964 (0.0007) [2023-12-27 22:40:57,064][106226] Updated weights for policy 0, policy_version 478974 (0.0009) [2023-12-27 22:40:57,124][106226] Updated weights for policy 0, policy_version 478984 (0.0010) [2023-12-27 22:40:57,225][106225] Updated weights for policy 1, policy_version 480403 (0.0008) [2023-12-27 22:40:57,272][106225] Updated weights for policy 1, policy_version 480413 (0.0009) [2023-12-27 22:40:57,321][106225] Updated weights for policy 1, policy_version 480423 (0.0007) [2023-12-27 22:40:57,905][106225] Updated weights for policy 1, policy_version 480433 (0.0007) [2023-12-27 22:40:57,912][106226] Updated weights for policy 0, policy_version 478994 (0.0006) [2023-12-27 22:40:57,949][106225] Updated weights for policy 1, policy_version 480443 (0.0005) [2023-12-27 22:40:57,960][106226] Updated weights for policy 0, policy_version 479004 (0.0007) [2023-12-27 22:40:57,996][106225] Updated weights for policy 1, policy_version 480453 (0.0005) [2023-12-27 22:40:58,011][106226] Updated weights for policy 0, policy_version 479014 (0.0008) [2023-12-27 22:40:58,047][106225] Updated weights for policy 1, policy_version 480463 (0.0007) [2023-12-27 22:40:58,831][106226] Updated weights for policy 0, policy_version 479024 (0.0009) [2023-12-27 22:40:58,896][106225] Updated weights for policy 1, policy_version 480473 (0.0008) [2023-12-27 22:40:58,898][106226] Updated weights for policy 0, policy_version 479034 (0.0007) [2023-12-27 22:40:58,961][106225] Updated weights for policy 1, policy_version 480483 (0.0006) [2023-12-27 22:40:58,963][106226] Updated weights for policy 0, policy_version 479044 (0.0008) [2023-12-27 22:40:59,027][106225] Updated weights for policy 1, policy_version 480493 (0.0008) [2023-12-27 22:40:59,713][106226] Updated weights for policy 0, policy_version 479054 (0.0007) [2023-12-27 22:40:59,772][106226] Updated weights for policy 0, policy_version 479064 (0.0008) [2023-12-27 22:40:59,805][106225] Updated weights for policy 1, policy_version 480503 (0.0006) [2023-12-27 22:40:59,826][106226] Updated weights for policy 0, policy_version 479074 (0.0008) [2023-12-27 22:40:59,872][106225] Updated weights for policy 1, policy_version 480513 (0.0008) [2023-12-27 22:40:59,929][106225] Updated weights for policy 1, policy_version 480523 (0.0010) [2023-12-27 22:41:00,569][106226] Updated weights for policy 0, policy_version 479084 (0.0007) [2023-12-27 22:41:00,616][106226] Updated weights for policy 0, policy_version 479094 (0.0008) [2023-12-27 22:41:00,638][106225] Updated weights for policy 1, policy_version 480534 (0.0009) [2023-12-27 22:41:00,663][106226] Updated weights for policy 0, policy_version 479104 (0.0005) [2023-12-27 22:41:00,688][106225] Updated weights for policy 1, policy_version 480544 (0.0010) [2023-12-27 22:41:00,743][106225] Updated weights for policy 1, policy_version 480554 (0.0010) [2023-12-27 22:41:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 245735424. Throughput: 0: 9841.8, 1: 10051.5. Samples: 245726676. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:01,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.679')] [2023-12-27 22:41:01,344][106226] Updated weights for policy 0, policy_version 479114 (0.0006) [2023-12-27 22:41:01,408][106226] Updated weights for policy 0, policy_version 479124 (0.0008) [2023-12-27 22:41:01,438][106225] Updated weights for policy 1, policy_version 480564 (0.0008) [2023-12-27 22:41:01,475][106226] Updated weights for policy 0, policy_version 479134 (0.0008) [2023-12-27 22:41:01,498][106225] Updated weights for policy 1, policy_version 480574 (0.0007) [2023-12-27 22:41:01,531][106226] Updated weights for policy 0, policy_version 479144 (0.0008) [2023-12-27 22:41:01,562][106225] Updated weights for policy 1, policy_version 480584 (0.0009) [2023-12-27 22:41:02,262][106225] Updated weights for policy 1, policy_version 480594 (0.0010) [2023-12-27 22:41:02,280][106226] Updated weights for policy 0, policy_version 479154 (0.0011) [2023-12-27 22:41:02,317][106225] Updated weights for policy 1, policy_version 480604 (0.0008) [2023-12-27 22:41:02,350][106226] Updated weights for policy 0, policy_version 479164 (0.0011) [2023-12-27 22:41:02,381][106225] Updated weights for policy 1, policy_version 480614 (0.0010) [2023-12-27 22:41:02,405][106226] Updated weights for policy 0, policy_version 479174 (0.0010) [2023-12-27 22:41:02,442][106225] Updated weights for policy 1, policy_version 480624 (0.0010) [2023-12-27 22:41:03,062][106225] Updated weights for policy 1, policy_version 480634 (0.0007) [2023-12-27 22:41:03,120][106226] Updated weights for policy 0, policy_version 479184 (0.0010) [2023-12-27 22:41:03,124][106225] Updated weights for policy 1, policy_version 480644 (0.0009) [2023-12-27 22:41:03,184][106226] Updated weights for policy 0, policy_version 479194 (0.0010) [2023-12-27 22:41:03,192][106225] Updated weights for policy 1, policy_version 480654 (0.0005) [2023-12-27 22:41:03,234][106226] Updated weights for policy 0, policy_version 479204 (0.0010) [2023-12-27 22:41:03,805][106225] Updated weights for policy 1, policy_version 480664 (0.0009) [2023-12-27 22:41:03,869][106226] Updated weights for policy 0, policy_version 479214 (0.0010) [2023-12-27 22:41:03,869][106225] Updated weights for policy 1, policy_version 480674 (0.0011) [2023-12-27 22:41:03,933][106226] Updated weights for policy 0, policy_version 479224 (0.0011) [2023-12-27 22:41:03,939][106225] Updated weights for policy 1, policy_version 480684 (0.0008) [2023-12-27 22:41:03,997][106226] Updated weights for policy 0, policy_version 479234 (0.0008) [2023-12-27 22:41:04,614][106225] Updated weights for policy 1, policy_version 480694 (0.0007) [2023-12-27 22:41:04,665][106226] Updated weights for policy 0, policy_version 479244 (0.0008) [2023-12-27 22:41:04,677][106225] Updated weights for policy 1, policy_version 480704 (0.0006) [2023-12-27 22:41:04,716][106226] Updated weights for policy 0, policy_version 479254 (0.0010) [2023-12-27 22:41:04,741][106225] Updated weights for policy 1, policy_version 480714 (0.0006) [2023-12-27 22:41:04,772][106226] Updated weights for policy 0, policy_version 479264 (0.0010) [2023-12-27 22:41:05,358][106226] Updated weights for policy 0, policy_version 479274 (0.0010) [2023-12-27 22:41:05,368][106225] Updated weights for policy 1, policy_version 480724 (0.0007) [2023-12-27 22:41:05,404][106226] Updated weights for policy 0, policy_version 479284 (0.0010) [2023-12-27 22:41:05,427][106225] Updated weights for policy 1, policy_version 480734 (0.0010) [2023-12-27 22:41:05,460][106226] Updated weights for policy 0, policy_version 479294 (0.0010) [2023-12-27 22:41:05,484][106225] Updated weights for policy 1, policy_version 480744 (0.0010) [2023-12-27 22:41:05,517][106226] Updated weights for policy 0, policy_version 479304 (0.0010) [2023-12-27 22:41:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 245833728. Throughput: 0: 9895.3, 1: 10079.4. Samples: 245849028. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:06,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-5.623')] [2023-12-27 22:41:06,194][106225] Updated weights for policy 1, policy_version 480754 (0.0010) [2023-12-27 22:41:06,197][106226] Updated weights for policy 0, policy_version 479314 (0.0009) [2023-12-27 22:41:06,249][106226] Updated weights for policy 0, policy_version 479324 (0.0009) [2023-12-27 22:41:06,255][106225] Updated weights for policy 1, policy_version 480764 (0.0009) [2023-12-27 22:41:06,311][106226] Updated weights for policy 0, policy_version 479334 (0.0009) [2023-12-27 22:41:06,312][106225] Updated weights for policy 1, policy_version 480774 (0.0009) [2023-12-27 22:41:06,373][106225] Updated weights for policy 1, policy_version 480784 (0.0009) [2023-12-27 22:41:07,048][106226] Updated weights for policy 0, policy_version 479344 (0.0007) [2023-12-27 22:41:07,058][106225] Updated weights for policy 1, policy_version 480794 (0.0010) [2023-12-27 22:41:07,114][106226] Updated weights for policy 0, policy_version 479354 (0.0005) [2023-12-27 22:41:07,117][106225] Updated weights for policy 1, policy_version 480804 (0.0010) [2023-12-27 22:41:07,165][106225] Updated weights for policy 1, policy_version 480814 (0.0010) [2023-12-27 22:41:07,171][106226] Updated weights for policy 0, policy_version 479364 (0.0005) [2023-12-27 22:41:07,715][106226] Updated weights for policy 0, policy_version 479374 (0.0006) [2023-12-27 22:41:07,766][106226] Updated weights for policy 0, policy_version 479384 (0.0005) [2023-12-27 22:41:07,798][106225] Updated weights for policy 1, policy_version 480824 (0.0008) [2023-12-27 22:41:07,815][106226] Updated weights for policy 0, policy_version 479394 (0.0005) [2023-12-27 22:41:07,852][106225] Updated weights for policy 1, policy_version 480834 (0.0009) [2023-12-27 22:41:07,911][106225] Updated weights for policy 1, policy_version 480844 (0.0009) [2023-12-27 22:41:08,397][106226] Updated weights for policy 0, policy_version 479404 (0.0007) [2023-12-27 22:41:08,456][106226] Updated weights for policy 0, policy_version 479414 (0.0006) [2023-12-27 22:41:08,529][106226] Updated weights for policy 0, policy_version 479424 (0.0006) [2023-12-27 22:41:08,598][106225] Updated weights for policy 1, policy_version 480854 (0.0007) [2023-12-27 22:41:08,660][106225] Updated weights for policy 1, policy_version 480864 (0.0007) [2023-12-27 22:41:08,715][106225] Updated weights for policy 1, policy_version 480874 (0.0009) [2023-12-27 22:41:09,131][106226] Updated weights for policy 0, policy_version 479434 (0.0007) [2023-12-27 22:41:09,195][106226] Updated weights for policy 0, policy_version 479444 (0.0011) [2023-12-27 22:41:09,264][106226] Updated weights for policy 0, policy_version 479454 (0.0011) [2023-12-27 22:41:09,325][106226] Updated weights for policy 0, policy_version 479464 (0.0009) [2023-12-27 22:41:09,412][106225] Updated weights for policy 1, policy_version 480884 (0.0009) [2023-12-27 22:41:09,479][106225] Updated weights for policy 1, policy_version 480894 (0.0006) [2023-12-27 22:41:09,546][106225] Updated weights for policy 1, policy_version 480904 (0.0006) [2023-12-27 22:41:10,103][106226] Updated weights for policy 0, policy_version 479474 (0.0008) [2023-12-27 22:41:10,165][106226] Updated weights for policy 0, policy_version 479484 (0.0008) [2023-12-27 22:41:10,208][106225] Updated weights for policy 1, policy_version 480914 (0.0006) [2023-12-27 22:41:10,252][106226] Updated weights for policy 0, policy_version 479494 (0.0008) [2023-12-27 22:41:10,272][106225] Updated weights for policy 1, policy_version 480924 (0.0009) [2023-12-27 22:41:10,339][106225] Updated weights for policy 1, policy_version 480934 (0.0006) [2023-12-27 22:41:10,402][106225] Updated weights for policy 1, policy_version 480944 (0.0009) [2023-12-27 22:41:10,913][106226] Updated weights for policy 0, policy_version 479504 (0.0007) [2023-12-27 22:41:10,980][106226] Updated weights for policy 0, policy_version 479514 (0.0008) [2023-12-27 22:41:11,051][106226] Updated weights for policy 0, policy_version 479524 (0.0009) [2023-12-27 22:41:11,143][106225] Updated weights for policy 1, policy_version 480954 (0.0008) [2023-12-27 22:41:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 245940224. Throughput: 0: 9986.8, 1: 10112.6. Samples: 245912392. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:11,175][105115] Avg episode reward: [(0, '-5.224'), (1, '-5.674')] [2023-12-27 22:41:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000479528_122789888.pth... [2023-12-27 22:41:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000478376_122494976.pth [2023-12-27 22:41:11,194][106225] Updated weights for policy 1, policy_version 480964 (0.0008) [2023-12-27 22:41:11,260][106225] Updated weights for policy 1, policy_version 480974 (0.0008) [2023-12-27 22:41:11,272][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000480976_123158528.pth... [2023-12-27 22:41:11,277][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000479792_122855424.pth [2023-12-27 22:41:11,807][106226] Updated weights for policy 0, policy_version 479534 (0.0009) [2023-12-27 22:41:11,871][106226] Updated weights for policy 0, policy_version 479544 (0.0009) [2023-12-27 22:41:11,935][106226] Updated weights for policy 0, policy_version 479554 (0.0008) [2023-12-27 22:41:12,097][106225] Updated weights for policy 1, policy_version 480984 (0.0008) [2023-12-27 22:41:12,164][106225] Updated weights for policy 1, policy_version 480994 (0.0009) [2023-12-27 22:41:12,224][106225] Updated weights for policy 1, policy_version 481004 (0.0008) [2023-12-27 22:41:12,714][106226] Updated weights for policy 0, policy_version 479564 (0.0009) [2023-12-27 22:41:12,778][106226] Updated weights for policy 0, policy_version 479574 (0.0009) [2023-12-27 22:41:12,838][106226] Updated weights for policy 0, policy_version 479584 (0.0009) [2023-12-27 22:41:12,920][106225] Updated weights for policy 1, policy_version 481014 (0.0008) [2023-12-27 22:41:12,987][106225] Updated weights for policy 1, policy_version 481024 (0.0007) [2023-12-27 22:41:13,054][106225] Updated weights for policy 1, policy_version 481034 (0.0009) [2023-12-27 22:41:13,408][106226] Updated weights for policy 0, policy_version 479594 (0.0008) [2023-12-27 22:41:13,465][106226] Updated weights for policy 0, policy_version 479604 (0.0008) [2023-12-27 22:41:13,523][106226] Updated weights for policy 0, policy_version 479614 (0.0011) [2023-12-27 22:41:13,580][106226] Updated weights for policy 0, policy_version 479624 (0.0011) [2023-12-27 22:41:13,841][106225] Updated weights for policy 1, policy_version 481044 (0.0009) [2023-12-27 22:41:13,901][106225] Updated weights for policy 1, policy_version 481054 (0.0005) [2023-12-27 22:41:13,959][106225] Updated weights for policy 1, policy_version 481064 (0.0009) [2023-12-27 22:41:14,285][106226] Updated weights for policy 0, policy_version 479634 (0.0007) [2023-12-27 22:41:14,341][106226] Updated weights for policy 0, policy_version 479644 (0.0005) [2023-12-27 22:41:14,392][106226] Updated weights for policy 0, policy_version 479654 (0.0005) [2023-12-27 22:41:14,540][106225] Updated weights for policy 1, policy_version 481074 (0.0010) [2023-12-27 22:41:14,597][106225] Updated weights for policy 1, policy_version 481084 (0.0008) [2023-12-27 22:41:14,655][106225] Updated weights for policy 1, policy_version 481094 (0.0008) [2023-12-27 22:41:14,705][106225] Updated weights for policy 1, policy_version 481104 (0.0008) [2023-12-27 22:41:15,045][106226] Updated weights for policy 0, policy_version 479664 (0.0009) [2023-12-27 22:41:15,111][106226] Updated weights for policy 0, policy_version 479674 (0.0011) [2023-12-27 22:41:15,180][106226] Updated weights for policy 0, policy_version 479684 (0.0011) [2023-12-27 22:41:15,434][106225] Updated weights for policy 1, policy_version 481114 (0.0008) [2023-12-27 22:41:15,491][106225] Updated weights for policy 1, policy_version 481124 (0.0008) [2023-12-27 22:41:15,541][106225] Updated weights for policy 1, policy_version 481134 (0.0008) [2023-12-27 22:41:15,851][106226] Updated weights for policy 0, policy_version 479694 (0.0011) [2023-12-27 22:41:15,918][106226] Updated weights for policy 0, policy_version 479704 (0.0011) [2023-12-27 22:41:15,977][106226] Updated weights for policy 0, policy_version 479714 (0.0011) [2023-12-27 22:41:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 246038528. Throughput: 0: 9935.6, 1: 10012.1. Samples: 246028132. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:16,175][105115] Avg episode reward: [(0, '-4.964'), (1, '-5.570')] [2023-12-27 22:41:16,281][106225] Updated weights for policy 1, policy_version 481144 (0.0009) [2023-12-27 22:41:16,344][106225] Updated weights for policy 1, policy_version 481154 (0.0010) [2023-12-27 22:41:16,408][106225] Updated weights for policy 1, policy_version 481164 (0.0009) [2023-12-27 22:41:16,672][106226] Updated weights for policy 0, policy_version 479724 (0.0010) [2023-12-27 22:41:16,721][106226] Updated weights for policy 0, policy_version 479734 (0.0010) [2023-12-27 22:41:16,778][106226] Updated weights for policy 0, policy_version 479744 (0.0009) [2023-12-27 22:41:17,063][106225] Updated weights for policy 1, policy_version 481174 (0.0005) [2023-12-27 22:41:17,126][106225] Updated weights for policy 1, policy_version 481184 (0.0006) [2023-12-27 22:41:17,184][106225] Updated weights for policy 1, policy_version 481194 (0.0006) [2023-12-27 22:41:17,511][106226] Updated weights for policy 0, policy_version 479754 (0.0010) [2023-12-27 22:41:17,570][106226] Updated weights for policy 0, policy_version 479764 (0.0006) [2023-12-27 22:41:17,632][106226] Updated weights for policy 0, policy_version 479774 (0.0006) [2023-12-27 22:41:17,700][106226] Updated weights for policy 0, policy_version 479784 (0.0006) [2023-12-27 22:41:17,790][106225] Updated weights for policy 1, policy_version 481204 (0.0008) [2023-12-27 22:41:17,851][106225] Updated weights for policy 1, policy_version 481214 (0.0010) [2023-12-27 22:41:17,911][106225] Updated weights for policy 1, policy_version 481224 (0.0010) [2023-12-27 22:41:18,355][106226] Updated weights for policy 0, policy_version 479794 (0.0008) [2023-12-27 22:41:18,413][106226] Updated weights for policy 0, policy_version 479804 (0.0006) [2023-12-27 22:41:18,462][106226] Updated weights for policy 0, policy_version 479814 (0.0006) [2023-12-27 22:41:18,617][106225] Updated weights for policy 1, policy_version 481234 (0.0009) [2023-12-27 22:41:18,684][106225] Updated weights for policy 1, policy_version 481244 (0.0007) [2023-12-27 22:41:18,745][106225] Updated weights for policy 1, policy_version 481254 (0.0008) [2023-12-27 22:41:18,810][106225] Updated weights for policy 1, policy_version 481264 (0.0007) [2023-12-27 22:41:19,105][106226] Updated weights for policy 0, policy_version 479824 (0.0008) [2023-12-27 22:41:19,164][106226] Updated weights for policy 0, policy_version 479834 (0.0009) [2023-12-27 22:41:19,212][106226] Updated weights for policy 0, policy_version 479844 (0.0008) [2023-12-27 22:41:19,496][106225] Updated weights for policy 1, policy_version 481274 (0.0008) [2023-12-27 22:41:19,557][106225] Updated weights for policy 1, policy_version 481284 (0.0008) [2023-12-27 22:41:19,616][106225] Updated weights for policy 1, policy_version 481294 (0.0009) [2023-12-27 22:41:19,984][106226] Updated weights for policy 0, policy_version 479854 (0.0008) [2023-12-27 22:41:20,045][106226] Updated weights for policy 0, policy_version 479864 (0.0009) [2023-12-27 22:41:20,111][106226] Updated weights for policy 0, policy_version 479874 (0.0009) [2023-12-27 22:41:20,358][106225] Updated weights for policy 1, policy_version 481304 (0.0008) [2023-12-27 22:41:20,421][106225] Updated weights for policy 1, policy_version 481314 (0.0009) [2023-12-27 22:41:20,481][106225] Updated weights for policy 1, policy_version 481324 (0.0008) [2023-12-27 22:41:20,885][106226] Updated weights for policy 0, policy_version 479884 (0.0008) [2023-12-27 22:41:20,944][106226] Updated weights for policy 0, policy_version 479894 (0.0009) [2023-12-27 22:41:21,004][106226] Updated weights for policy 0, policy_version 479904 (0.0008) [2023-12-27 22:41:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 246136832. Throughput: 0: 9783.8, 1: 9965.5. Samples: 246145564. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:21,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-5.683')] [2023-12-27 22:41:21,185][106225] Updated weights for policy 1, policy_version 481334 (0.0009) [2023-12-27 22:41:21,247][106225] Updated weights for policy 1, policy_version 481344 (0.0009) [2023-12-27 22:41:21,305][106225] Updated weights for policy 1, policy_version 481354 (0.0009) [2023-12-27 22:41:21,798][106226] Updated weights for policy 0, policy_version 479914 (0.0009) [2023-12-27 22:41:21,861][106226] Updated weights for policy 0, policy_version 479924 (0.0009) [2023-12-27 22:41:21,922][106226] Updated weights for policy 0, policy_version 479934 (0.0009) [2023-12-27 22:41:21,989][106226] Updated weights for policy 0, policy_version 479944 (0.0009) [2023-12-27 22:41:22,078][106225] Updated weights for policy 1, policy_version 481364 (0.0009) [2023-12-27 22:41:22,140][106225] Updated weights for policy 1, policy_version 481374 (0.0009) [2023-12-27 22:41:22,209][106225] Updated weights for policy 1, policy_version 481384 (0.0007) [2023-12-27 22:41:22,738][106226] Updated weights for policy 0, policy_version 479954 (0.0009) [2023-12-27 22:41:22,799][106226] Updated weights for policy 0, policy_version 479964 (0.0009) [2023-12-27 22:41:22,849][106226] Updated weights for policy 0, policy_version 479974 (0.0009) [2023-12-27 22:41:22,986][106225] Updated weights for policy 1, policy_version 481394 (0.0008) [2023-12-27 22:41:23,047][106225] Updated weights for policy 1, policy_version 481404 (0.0009) [2023-12-27 22:41:23,099][106225] Updated weights for policy 1, policy_version 481414 (0.0008) [2023-12-27 22:41:23,162][106225] Updated weights for policy 1, policy_version 481424 (0.0009) [2023-12-27 22:41:23,549][106226] Updated weights for policy 0, policy_version 479984 (0.0009) [2023-12-27 22:41:23,603][106226] Updated weights for policy 0, policy_version 479994 (0.0008) [2023-12-27 22:41:23,651][106226] Updated weights for policy 0, policy_version 480004 (0.0005) [2023-12-27 22:41:23,944][106225] Updated weights for policy 1, policy_version 481434 (0.0008) [2023-12-27 22:41:24,003][106225] Updated weights for policy 1, policy_version 481444 (0.0009) [2023-12-27 22:41:24,064][106225] Updated weights for policy 1, policy_version 481454 (0.0008) [2023-12-27 22:41:24,287][106226] Updated weights for policy 0, policy_version 480014 (0.0006) [2023-12-27 22:41:24,348][106226] Updated weights for policy 0, policy_version 480024 (0.0007) [2023-12-27 22:41:24,412][106226] Updated weights for policy 0, policy_version 480034 (0.0008) [2023-12-27 22:41:24,833][106225] Updated weights for policy 1, policy_version 481464 (0.0008) [2023-12-27 22:41:24,894][106225] Updated weights for policy 1, policy_version 481474 (0.0009) [2023-12-27 22:41:24,958][106225] Updated weights for policy 1, policy_version 481484 (0.0009) [2023-12-27 22:41:24,987][106226] Updated weights for policy 0, policy_version 480044 (0.0009) [2023-12-27 22:41:25,043][106226] Updated weights for policy 0, policy_version 480054 (0.0010) [2023-12-27 22:41:25,096][106226] Updated weights for policy 0, policy_version 480064 (0.0010) [2023-12-27 22:41:25,639][106226] Updated weights for policy 0, policy_version 480074 (0.0009) [2023-12-27 22:41:25,709][106226] Updated weights for policy 0, policy_version 480084 (0.0005) [2023-12-27 22:41:25,772][106226] Updated weights for policy 0, policy_version 480094 (0.0005) [2023-12-27 22:41:25,775][106225] Updated weights for policy 1, policy_version 481494 (0.0007) [2023-12-27 22:41:25,830][106226] Updated weights for policy 0, policy_version 480104 (0.0006) [2023-12-27 22:41:25,833][106225] Updated weights for policy 1, policy_version 481504 (0.0008) [2023-12-27 22:41:25,891][106225] Updated weights for policy 1, policy_version 481514 (0.0010) [2023-12-27 22:41:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 246235136. Throughput: 0: 9831.3, 1: 9901.8. Samples: 246202392. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:26,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-5.498')] [2023-12-27 22:41:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000481520_123297792.pth... [2023-12-27 22:41:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000480104_122937344.pth... [2023-12-27 22:41:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000480368_123002880.pth [2023-12-27 22:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000478952_122642432.pth [2023-12-27 22:41:26,415][106226] Updated weights for policy 0, policy_version 480114 (0.0008) [2023-12-27 22:41:26,466][106226] Updated weights for policy 0, policy_version 480124 (0.0008) [2023-12-27 22:41:26,524][106226] Updated weights for policy 0, policy_version 480134 (0.0008) [2023-12-27 22:41:26,651][106225] Updated weights for policy 1, policy_version 481524 (0.0009) [2023-12-27 22:41:26,712][106225] Updated weights for policy 1, policy_version 481534 (0.0007) [2023-12-27 22:41:26,760][106225] Updated weights for policy 1, policy_version 481545 (0.0007) [2023-12-27 22:41:27,192][106226] Updated weights for policy 0, policy_version 480144 (0.0006) [2023-12-27 22:41:27,242][106226] Updated weights for policy 0, policy_version 480154 (0.0005) [2023-12-27 22:41:27,298][106226] Updated weights for policy 0, policy_version 480164 (0.0006) [2023-12-27 22:41:27,560][106225] Updated weights for policy 1, policy_version 481555 (0.0007) [2023-12-27 22:41:27,617][106225] Updated weights for policy 1, policy_version 481565 (0.0008) [2023-12-27 22:41:27,675][106225] Updated weights for policy 1, policy_version 481575 (0.0006) [2023-12-27 22:41:27,876][106226] Updated weights for policy 0, policy_version 480174 (0.0009) [2023-12-27 22:41:27,927][106226] Updated weights for policy 0, policy_version 480184 (0.0008) [2023-12-27 22:41:27,988][106226] Updated weights for policy 0, policy_version 480194 (0.0009) [2023-12-27 22:41:28,421][106225] Updated weights for policy 1, policy_version 481585 (0.0008) [2023-12-27 22:41:28,482][106225] Updated weights for policy 1, policy_version 481595 (0.0008) [2023-12-27 22:41:28,535][106225] Updated weights for policy 1, policy_version 481605 (0.0008) [2023-12-27 22:41:28,586][106225] Updated weights for policy 1, policy_version 481615 (0.0008) [2023-12-27 22:41:28,715][106226] Updated weights for policy 0, policy_version 480204 (0.0007) [2023-12-27 22:41:28,774][106226] Updated weights for policy 0, policy_version 480214 (0.0008) [2023-12-27 22:41:28,836][106226] Updated weights for policy 0, policy_version 480224 (0.0008) [2023-12-27 22:41:29,357][106225] Updated weights for policy 1, policy_version 481625 (0.0008) [2023-12-27 22:41:29,418][106225] Updated weights for policy 1, policy_version 481635 (0.0006) [2023-12-27 22:41:29,480][106225] Updated weights for policy 1, policy_version 481645 (0.0007) [2023-12-27 22:41:29,544][106226] Updated weights for policy 0, policy_version 480234 (0.0008) [2023-12-27 22:41:29,602][106226] Updated weights for policy 0, policy_version 480244 (0.0009) [2023-12-27 22:41:29,657][106226] Updated weights for policy 0, policy_version 480254 (0.0008) [2023-12-27 22:41:29,705][106226] Updated weights for policy 0, policy_version 480264 (0.0008) [2023-12-27 22:41:30,142][106225] Updated weights for policy 1, policy_version 481655 (0.0009) [2023-12-27 22:41:30,197][106225] Updated weights for policy 1, policy_version 481665 (0.0008) [2023-12-27 22:41:30,256][106225] Updated weights for policy 1, policy_version 481675 (0.0008) [2023-12-27 22:41:30,428][106226] Updated weights for policy 0, policy_version 480274 (0.0008) [2023-12-27 22:41:30,477][106226] Updated weights for policy 0, policy_version 480284 (0.0008) [2023-12-27 22:41:30,526][106226] Updated weights for policy 0, policy_version 480294 (0.0008) [2023-12-27 22:41:31,057][106225] Updated weights for policy 1, policy_version 481685 (0.0008) [2023-12-27 22:41:31,118][106225] Updated weights for policy 1, policy_version 481695 (0.0008) [2023-12-27 22:41:31,145][106226] Updated weights for policy 0, policy_version 480304 (0.0008) [2023-12-27 22:41:31,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 246325248. Throughput: 0: 10010.7, 1: 9786.5. Samples: 246321304. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:31,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-5.507')] [2023-12-27 22:41:31,179][106225] Updated weights for policy 1, policy_version 481705 (0.0007) [2023-12-27 22:41:31,196][106226] Updated weights for policy 0, policy_version 480314 (0.0008) [2023-12-27 22:41:31,250][106226] Updated weights for policy 0, policy_version 480324 (0.0008) [2023-12-27 22:41:31,923][106225] Updated weights for policy 1, policy_version 481715 (0.0008) [2023-12-27 22:41:31,962][106226] Updated weights for policy 0, policy_version 480334 (0.0006) [2023-12-27 22:41:31,983][106225] Updated weights for policy 1, policy_version 481725 (0.0009) [2023-12-27 22:41:32,022][106226] Updated weights for policy 0, policy_version 480344 (0.0006) [2023-12-27 22:41:32,050][106225] Updated weights for policy 1, policy_version 481735 (0.0008) [2023-12-27 22:41:32,083][106226] Updated weights for policy 0, policy_version 480354 (0.0006) [2023-12-27 22:41:32,762][106225] Updated weights for policy 1, policy_version 481745 (0.0008) [2023-12-27 22:41:32,779][106226] Updated weights for policy 0, policy_version 480364 (0.0007) [2023-12-27 22:41:32,821][106225] Updated weights for policy 1, policy_version 481755 (0.0009) [2023-12-27 22:41:32,839][106226] Updated weights for policy 0, policy_version 480374 (0.0006) [2023-12-27 22:41:32,874][106225] Updated weights for policy 1, policy_version 481765 (0.0008) [2023-12-27 22:41:32,894][106226] Updated weights for policy 0, policy_version 480384 (0.0007) [2023-12-27 22:41:32,931][106225] Updated weights for policy 1, policy_version 481775 (0.0008) [2023-12-27 22:41:33,517][106226] Updated weights for policy 0, policy_version 480394 (0.0007) [2023-12-27 22:41:33,568][106226] Updated weights for policy 0, policy_version 480404 (0.0008) [2023-12-27 22:41:33,619][106226] Updated weights for policy 0, policy_version 480414 (0.0009) [2023-12-27 22:41:33,664][106226] Updated weights for policy 0, policy_version 480424 (0.0008) [2023-12-27 22:41:33,690][106225] Updated weights for policy 1, policy_version 481785 (0.0008) [2023-12-27 22:41:33,741][106225] Updated weights for policy 1, policy_version 481795 (0.0008) [2023-12-27 22:41:33,798][106225] Updated weights for policy 1, policy_version 481805 (0.0008) [2023-12-27 22:41:34,402][106226] Updated weights for policy 0, policy_version 480434 (0.0008) [2023-12-27 22:41:34,463][106226] Updated weights for policy 0, policy_version 480444 (0.0011) [2023-12-27 22:41:34,528][106226] Updated weights for policy 0, policy_version 480454 (0.0011) [2023-12-27 22:41:34,532][106225] Updated weights for policy 1, policy_version 481815 (0.0009) [2023-12-27 22:41:34,603][106225] Updated weights for policy 1, policy_version 481825 (0.0008) [2023-12-27 22:41:34,667][106225] Updated weights for policy 1, policy_version 481835 (0.0007) [2023-12-27 22:41:35,261][106226] Updated weights for policy 0, policy_version 480464 (0.0008) [2023-12-27 22:41:35,318][106226] Updated weights for policy 0, policy_version 480474 (0.0005) [2023-12-27 22:41:35,365][106226] Updated weights for policy 0, policy_version 480484 (0.0005) [2023-12-27 22:41:35,401][106225] Updated weights for policy 1, policy_version 481845 (0.0009) [2023-12-27 22:41:35,466][106225] Updated weights for policy 1, policy_version 481855 (0.0007) [2023-12-27 22:41:35,520][106225] Updated weights for policy 1, policy_version 481865 (0.0008) [2023-12-27 22:41:35,941][106226] Updated weights for policy 0, policy_version 480494 (0.0007) [2023-12-27 22:41:35,996][106226] Updated weights for policy 0, policy_version 480504 (0.0005) [2023-12-27 22:41:36,045][106226] Updated weights for policy 0, policy_version 480514 (0.0005) [2023-12-27 22:41:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 246431744. Throughput: 0: 10041.8, 1: 9737.8. Samples: 246439388. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-27 22:41:36,175][105115] Avg episode reward: [(0, '-5.134'), (1, '-5.715')] [2023-12-27 22:41:36,298][106225] Updated weights for policy 1, policy_version 481875 (0.0009) [2023-12-27 22:41:36,363][106225] Updated weights for policy 1, policy_version 481885 (0.0007) [2023-12-27 22:41:36,425][106225] Updated weights for policy 1, policy_version 481895 (0.0008) [2023-12-27 22:41:36,756][106226] Updated weights for policy 0, policy_version 480524 (0.0007) [2023-12-27 22:41:36,816][106226] Updated weights for policy 0, policy_version 480534 (0.0011) [2023-12-27 22:41:36,876][106226] Updated weights for policy 0, policy_version 480544 (0.0011) [2023-12-27 22:41:37,155][106225] Updated weights for policy 1, policy_version 481905 (0.0009) [2023-12-27 22:41:37,216][106225] Updated weights for policy 1, policy_version 481915 (0.0008) [2023-12-27 22:41:37,282][106225] Updated weights for policy 1, policy_version 481925 (0.0008) [2023-12-27 22:41:37,332][106225] Updated weights for policy 1, policy_version 481935 (0.0007) [2023-12-27 22:41:37,589][106226] Updated weights for policy 0, policy_version 480554 (0.0011) [2023-12-27 22:41:37,649][106226] Updated weights for policy 0, policy_version 480564 (0.0011) [2023-12-27 22:41:37,717][106226] Updated weights for policy 0, policy_version 480574 (0.0011) [2023-12-27 22:41:37,765][106226] Updated weights for policy 0, policy_version 480584 (0.0005) [2023-12-27 22:41:38,079][106225] Updated weights for policy 1, policy_version 481945 (0.0008) [2023-12-27 22:41:38,140][106225] Updated weights for policy 1, policy_version 481955 (0.0007) [2023-12-27 22:41:38,198][106225] Updated weights for policy 1, policy_version 481965 (0.0008) [2023-12-27 22:41:38,398][106226] Updated weights for policy 0, policy_version 480594 (0.0010) [2023-12-27 22:41:38,453][106226] Updated weights for policy 0, policy_version 480604 (0.0011) [2023-12-27 22:41:38,518][106226] Updated weights for policy 0, policy_version 480614 (0.0011) [2023-12-27 22:41:38,956][106225] Updated weights for policy 1, policy_version 481975 (0.0008) [2023-12-27 22:41:39,020][106225] Updated weights for policy 1, policy_version 481985 (0.0008) [2023-12-27 22:41:39,077][106225] Updated weights for policy 1, policy_version 481995 (0.0008) [2023-12-27 22:41:39,254][106226] Updated weights for policy 0, policy_version 480624 (0.0009) [2023-12-27 22:41:39,312][106226] Updated weights for policy 0, policy_version 480634 (0.0008) [2023-12-27 22:41:39,382][106226] Updated weights for policy 0, policy_version 480644 (0.0009) [2023-12-27 22:41:39,888][106225] Updated weights for policy 1, policy_version 482005 (0.0008) [2023-12-27 22:41:39,962][106225] Updated weights for policy 1, policy_version 482015 (0.0009) [2023-12-27 22:41:40,031][106225] Updated weights for policy 1, policy_version 482025 (0.0008) [2023-12-27 22:41:40,158][106226] Updated weights for policy 0, policy_version 480654 (0.0009) [2023-12-27 22:41:40,217][106226] Updated weights for policy 0, policy_version 480664 (0.0008) [2023-12-27 22:41:40,269][106226] Updated weights for policy 0, policy_version 480674 (0.0008) [2023-12-27 22:41:40,745][106225] Updated weights for policy 1, policy_version 482035 (0.0008) [2023-12-27 22:41:40,791][106225] Updated weights for policy 1, policy_version 482045 (0.0009) [2023-12-27 22:41:40,846][106225] Updated weights for policy 1, policy_version 482055 (0.0008) [2023-12-27 22:41:40,990][106226] Updated weights for policy 0, policy_version 480684 (0.0008) [2023-12-27 22:41:41,074][106226] Updated weights for policy 0, policy_version 480696 (0.0007) [2023-12-27 22:41:41,139][106226] Updated weights for policy 0, policy_version 480706 (0.0009) [2023-12-27 22:41:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 246521856. Throughput: 0: 10023.2, 1: 9744.7. Samples: 246497276. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:41:41,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.876')] [2023-12-27 22:41:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000480712_123092992.pth... [2023-12-27 22:41:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000482064_123437056.pth... [2023-12-27 22:41:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000479528_122789888.pth [2023-12-27 22:41:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000480976_123158528.pth [2023-12-27 22:41:41,661][106225] Updated weights for policy 1, policy_version 482065 (0.0008) [2023-12-27 22:41:41,729][106225] Updated weights for policy 1, policy_version 482075 (0.0008) [2023-12-27 22:41:41,797][106225] Updated weights for policy 1, policy_version 482085 (0.0010) [2023-12-27 22:41:41,857][106225] Updated weights for policy 1, policy_version 482095 (0.0008) [2023-12-27 22:41:41,904][106226] Updated weights for policy 0, policy_version 480716 (0.0008) [2023-12-27 22:41:41,966][106226] Updated weights for policy 0, policy_version 480726 (0.0008) [2023-12-27 22:41:42,021][106226] Updated weights for policy 0, policy_version 480736 (0.0009) [2023-12-27 22:41:42,630][106225] Updated weights for policy 1, policy_version 482105 (0.0006) [2023-12-27 22:41:42,692][106226] Updated weights for policy 0, policy_version 480746 (0.0008) [2023-12-27 22:41:42,694][106225] Updated weights for policy 1, policy_version 482115 (0.0009) [2023-12-27 22:41:42,753][106226] Updated weights for policy 0, policy_version 480756 (0.0006) [2023-12-27 22:41:42,758][106225] Updated weights for policy 1, policy_version 482125 (0.0009) [2023-12-27 22:41:42,809][106226] Updated weights for policy 0, policy_version 480766 (0.0009) [2023-12-27 22:41:42,858][106226] Updated weights for policy 0, policy_version 480776 (0.0008) [2023-12-27 22:41:43,437][106225] Updated weights for policy 1, policy_version 482135 (0.0009) [2023-12-27 22:41:43,502][106225] Updated weights for policy 1, policy_version 482145 (0.0009) [2023-12-27 22:41:43,552][106226] Updated weights for policy 0, policy_version 480786 (0.0008) [2023-12-27 22:41:43,561][106225] Updated weights for policy 1, policy_version 482155 (0.0007) [2023-12-27 22:41:43,615][106226] Updated weights for policy 0, policy_version 480796 (0.0007) [2023-12-27 22:41:43,676][106226] Updated weights for policy 0, policy_version 480806 (0.0008) [2023-12-27 22:41:44,299][106225] Updated weights for policy 1, policy_version 482165 (0.0007) [2023-12-27 22:41:44,318][106226] Updated weights for policy 0, policy_version 480816 (0.0007) [2023-12-27 22:41:44,360][106225] Updated weights for policy 1, policy_version 482175 (0.0005) [2023-12-27 22:41:44,374][106226] Updated weights for policy 0, policy_version 480826 (0.0007) [2023-12-27 22:41:44,416][106225] Updated weights for policy 1, policy_version 482185 (0.0006) [2023-12-27 22:41:44,436][106226] Updated weights for policy 0, policy_version 480836 (0.0006) [2023-12-27 22:41:45,084][106226] Updated weights for policy 0, policy_version 480846 (0.0006) [2023-12-27 22:41:45,147][106226] Updated weights for policy 0, policy_version 480856 (0.0007) [2023-12-27 22:41:45,181][106225] Updated weights for policy 1, policy_version 482195 (0.0006) [2023-12-27 22:41:45,214][106226] Updated weights for policy 0, policy_version 480866 (0.0006) [2023-12-27 22:41:45,249][106225] Updated weights for policy 1, policy_version 482205 (0.0008) [2023-12-27 22:41:45,302][106225] Updated weights for policy 1, policy_version 482215 (0.0008) [2023-12-27 22:41:45,742][106226] Updated weights for policy 0, policy_version 480876 (0.0007) [2023-12-27 22:41:45,803][106226] Updated weights for policy 0, policy_version 480886 (0.0005) [2023-12-27 22:41:45,860][106226] Updated weights for policy 0, policy_version 480896 (0.0006) [2023-12-27 22:41:46,130][106225] Updated weights for policy 1, policy_version 482225 (0.0008) [2023-12-27 22:41:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 246620160. Throughput: 0: 10111.4, 1: 9563.9. Samples: 246612064. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:41:46,175][105115] Avg episode reward: [(0, '-5.212'), (1, '-5.809')] [2023-12-27 22:41:46,182][106225] Updated weights for policy 1, policy_version 482235 (0.0008) [2023-12-27 22:41:46,226][106225] Updated weights for policy 1, policy_version 482245 (0.0008) [2023-12-27 22:41:46,279][106225] Updated weights for policy 1, policy_version 482255 (0.0008) [2023-12-27 22:41:46,459][106226] Updated weights for policy 0, policy_version 480906 (0.0006) [2023-12-27 22:41:46,524][106226] Updated weights for policy 0, policy_version 480916 (0.0005) [2023-12-27 22:41:46,581][106226] Updated weights for policy 0, policy_version 480926 (0.0005) [2023-12-27 22:41:46,643][106226] Updated weights for policy 0, policy_version 480936 (0.0005) [2023-12-27 22:41:47,125][106225] Updated weights for policy 1, policy_version 482265 (0.0007) [2023-12-27 22:41:47,134][106226] Updated weights for policy 0, policy_version 480946 (0.0011) [2023-12-27 22:41:47,178][106225] Updated weights for policy 1, policy_version 482275 (0.0005) [2023-12-27 22:41:47,188][106226] Updated weights for policy 0, policy_version 480956 (0.0010) [2023-12-27 22:41:47,240][106225] Updated weights for policy 1, policy_version 482285 (0.0005) [2023-12-27 22:41:47,249][106226] Updated weights for policy 0, policy_version 480966 (0.0011) [2023-12-27 22:41:47,867][106226] Updated weights for policy 0, policy_version 480976 (0.0010) [2023-12-27 22:41:47,916][106226] Updated weights for policy 0, policy_version 480986 (0.0010) [2023-12-27 22:41:47,973][106226] Updated weights for policy 0, policy_version 480996 (0.0011) [2023-12-27 22:41:47,991][106225] Updated weights for policy 1, policy_version 482295 (0.0006) [2023-12-27 22:41:48,041][106225] Updated weights for policy 1, policy_version 482305 (0.0008) [2023-12-27 22:41:48,102][106225] Updated weights for policy 1, policy_version 482315 (0.0008) [2023-12-27 22:41:48,667][106226] Updated weights for policy 0, policy_version 481006 (0.0010) [2023-12-27 22:41:48,741][106226] Updated weights for policy 0, policy_version 481016 (0.0008) [2023-12-27 22:41:48,802][106226] Updated weights for policy 0, policy_version 481026 (0.0008) [2023-12-27 22:41:48,862][106225] Updated weights for policy 1, policy_version 482325 (0.0008) [2023-12-27 22:41:48,924][106225] Updated weights for policy 1, policy_version 482335 (0.0008) [2023-12-27 22:41:48,981][106225] Updated weights for policy 1, policy_version 482345 (0.0007) [2023-12-27 22:41:49,479][106226] Updated weights for policy 0, policy_version 481036 (0.0009) [2023-12-27 22:41:49,548][106226] Updated weights for policy 0, policy_version 481046 (0.0011) [2023-12-27 22:41:49,624][106226] Updated weights for policy 0, policy_version 481056 (0.0011) [2023-12-27 22:41:49,656][106225] Updated weights for policy 1, policy_version 482355 (0.0007) [2023-12-27 22:41:49,709][106225] Updated weights for policy 1, policy_version 482365 (0.0007) [2023-12-27 22:41:49,763][106225] Updated weights for policy 1, policy_version 482375 (0.0008) [2023-12-27 22:41:50,358][106226] Updated weights for policy 0, policy_version 481066 (0.0011) [2023-12-27 22:41:50,412][106226] Updated weights for policy 0, policy_version 481076 (0.0007) [2023-12-27 22:41:50,479][106226] Updated weights for policy 0, policy_version 481086 (0.0007) [2023-12-27 22:41:50,507][106225] Updated weights for policy 1, policy_version 482385 (0.0007) [2023-12-27 22:41:50,534][106226] Updated weights for policy 0, policy_version 481096 (0.0007) [2023-12-27 22:41:50,574][106225] Updated weights for policy 1, policy_version 482395 (0.0008) [2023-12-27 22:41:50,640][106225] Updated weights for policy 1, policy_version 482405 (0.0007) [2023-12-27 22:41:50,686][106225] Updated weights for policy 1, policy_version 482415 (0.0007) [2023-12-27 22:41:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 246718464. Throughput: 0: 10169.4, 1: 9422.0. Samples: 246730644. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:41:51,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-6.047')] [2023-12-27 22:41:51,236][106226] Updated weights for policy 0, policy_version 481106 (0.0006) [2023-12-27 22:41:51,303][106226] Updated weights for policy 0, policy_version 481116 (0.0011) [2023-12-27 22:41:51,373][106226] Updated weights for policy 0, policy_version 481126 (0.0008) [2023-12-27 22:41:51,392][106225] Updated weights for policy 1, policy_version 482425 (0.0008) [2023-12-27 22:41:51,456][106225] Updated weights for policy 1, policy_version 482435 (0.0007) [2023-12-27 22:41:51,518][106225] Updated weights for policy 1, policy_version 482445 (0.0008) [2023-12-27 22:41:52,119][106226] Updated weights for policy 0, policy_version 481136 (0.0009) [2023-12-27 22:41:52,151][106225] Updated weights for policy 1, policy_version 482455 (0.0006) [2023-12-27 22:41:52,166][106226] Updated weights for policy 0, policy_version 481146 (0.0009) [2023-12-27 22:41:52,200][106225] Updated weights for policy 1, policy_version 482465 (0.0005) [2023-12-27 22:41:52,224][106226] Updated weights for policy 0, policy_version 481156 (0.0008) [2023-12-27 22:41:52,257][106225] Updated weights for policy 1, policy_version 482475 (0.0005) [2023-12-27 22:41:52,900][106225] Updated weights for policy 1, policy_version 482485 (0.0007) [2023-12-27 22:41:52,965][106225] Updated weights for policy 1, policy_version 482495 (0.0008) [2023-12-27 22:41:52,990][106226] Updated weights for policy 0, policy_version 481166 (0.0009) [2023-12-27 22:41:53,020][106225] Updated weights for policy 1, policy_version 482505 (0.0007) [2023-12-27 22:41:53,039][106226] Updated weights for policy 0, policy_version 481176 (0.0008) [2023-12-27 22:41:53,099][106226] Updated weights for policy 0, policy_version 481186 (0.0008) [2023-12-27 22:41:53,585][106225] Updated weights for policy 1, policy_version 482515 (0.0005) [2023-12-27 22:41:53,647][106225] Updated weights for policy 1, policy_version 482525 (0.0007) [2023-12-27 22:41:53,707][106225] Updated weights for policy 1, policy_version 482535 (0.0008) [2023-12-27 22:41:53,819][106226] Updated weights for policy 0, policy_version 481196 (0.0008) [2023-12-27 22:41:53,869][106226] Updated weights for policy 0, policy_version 481206 (0.0008) [2023-12-27 22:41:53,918][106226] Updated weights for policy 0, policy_version 481216 (0.0008) [2023-12-27 22:41:54,382][106225] Updated weights for policy 1, policy_version 482545 (0.0008) [2023-12-27 22:41:54,445][106225] Updated weights for policy 1, policy_version 482555 (0.0010) [2023-12-27 22:41:54,496][106225] Updated weights for policy 1, policy_version 482565 (0.0009) [2023-12-27 22:41:54,554][106225] Updated weights for policy 1, policy_version 482575 (0.0006) [2023-12-27 22:41:54,679][106226] Updated weights for policy 0, policy_version 481226 (0.0009) [2023-12-27 22:41:54,738][106226] Updated weights for policy 0, policy_version 481236 (0.0009) [2023-12-27 22:41:54,804][106226] Updated weights for policy 0, policy_version 481246 (0.0009) [2023-12-27 22:41:54,862][106226] Updated weights for policy 0, policy_version 481256 (0.0009) [2023-12-27 22:41:55,161][106225] Updated weights for policy 1, policy_version 482585 (0.0008) [2023-12-27 22:41:55,212][106225] Updated weights for policy 1, policy_version 482595 (0.0009) [2023-12-27 22:41:55,263][106225] Updated weights for policy 1, policy_version 482605 (0.0008) [2023-12-27 22:41:55,661][106226] Updated weights for policy 0, policy_version 481266 (0.0009) [2023-12-27 22:41:55,710][106226] Updated weights for policy 0, policy_version 481276 (0.0007) [2023-12-27 22:41:55,762][106226] Updated weights for policy 0, policy_version 481286 (0.0008) [2023-12-27 22:41:55,851][106225] Updated weights for policy 1, policy_version 482615 (0.0008) [2023-12-27 22:41:55,909][106225] Updated weights for policy 1, policy_version 482625 (0.0008) [2023-12-27 22:41:55,957][106225] Updated weights for policy 1, policy_version 482635 (0.0008) [2023-12-27 22:41:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 246824960. Throughput: 0: 10066.8, 1: 9460.2. Samples: 246791112. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:41:56,175][105115] Avg episode reward: [(0, '-4.938'), (1, '-5.460')] [2023-12-27 22:41:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000481288_123240448.pth... [2023-12-27 22:41:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000482640_123584512.pth... [2023-12-27 22:41:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000480104_122937344.pth [2023-12-27 22:41:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000481520_123297792.pth [2023-12-27 22:41:56,506][106226] Updated weights for policy 0, policy_version 481296 (0.0009) [2023-12-27 22:41:56,561][106226] Updated weights for policy 0, policy_version 481306 (0.0008) [2023-12-27 22:41:56,610][106226] Updated weights for policy 0, policy_version 481316 (0.0009) [2023-12-27 22:41:56,680][106225] Updated weights for policy 1, policy_version 482645 (0.0008) [2023-12-27 22:41:56,732][106225] Updated weights for policy 1, policy_version 482655 (0.0008) [2023-12-27 22:41:56,784][106225] Updated weights for policy 1, policy_version 482665 (0.0008) [2023-12-27 22:41:57,372][106226] Updated weights for policy 0, policy_version 481326 (0.0009) [2023-12-27 22:41:57,424][106226] Updated weights for policy 0, policy_version 481336 (0.0008) [2023-12-27 22:41:57,465][106225] Updated weights for policy 1, policy_version 482675 (0.0008) [2023-12-27 22:41:57,471][106226] Updated weights for policy 0, policy_version 481346 (0.0007) [2023-12-27 22:41:57,524][106225] Updated weights for policy 1, policy_version 482685 (0.0007) [2023-12-27 22:41:57,592][106225] Updated weights for policy 1, policy_version 482695 (0.0009) [2023-12-27 22:41:58,153][106226] Updated weights for policy 0, policy_version 481356 (0.0007) [2023-12-27 22:41:58,218][106226] Updated weights for policy 0, policy_version 481366 (0.0009) [2023-12-27 22:41:58,280][106226] Updated weights for policy 0, policy_version 481376 (0.0008) [2023-12-27 22:41:58,306][106225] Updated weights for policy 1, policy_version 482705 (0.0008) [2023-12-27 22:41:58,371][106225] Updated weights for policy 1, policy_version 482715 (0.0008) [2023-12-27 22:41:58,437][106225] Updated weights for policy 1, policy_version 482725 (0.0007) [2023-12-27 22:41:58,504][106225] Updated weights for policy 1, policy_version 482735 (0.0008) [2023-12-27 22:41:59,121][106226] Updated weights for policy 0, policy_version 481386 (0.0009) [2023-12-27 22:41:59,185][106226] Updated weights for policy 0, policy_version 481396 (0.0009) [2023-12-27 22:41:59,266][106226] Updated weights for policy 0, policy_version 481406 (0.0008) [2023-12-27 22:41:59,332][106226] Updated weights for policy 0, policy_version 481416 (0.0008) [2023-12-27 22:41:59,346][106225] Updated weights for policy 1, policy_version 482745 (0.0007) [2023-12-27 22:41:59,412][106225] Updated weights for policy 1, policy_version 482755 (0.0007) [2023-12-27 22:41:59,483][106225] Updated weights for policy 1, policy_version 482765 (0.0005) [2023-12-27 22:42:00,123][106225] Updated weights for policy 1, policy_version 482775 (0.0008) [2023-12-27 22:42:00,142][106226] Updated weights for policy 0, policy_version 481426 (0.0008) [2023-12-27 22:42:00,180][106225] Updated weights for policy 1, policy_version 482785 (0.0008) [2023-12-27 22:42:00,199][106226] Updated weights for policy 0, policy_version 481436 (0.0006) [2023-12-27 22:42:00,240][106225] Updated weights for policy 1, policy_version 482795 (0.0007) [2023-12-27 22:42:00,254][106226] Updated weights for policy 0, policy_version 481446 (0.0008) [2023-12-27 22:42:00,937][106225] Updated weights for policy 1, policy_version 482805 (0.0007) [2023-12-27 22:42:00,977][106226] Updated weights for policy 0, policy_version 481456 (0.0008) [2023-12-27 22:42:00,994][106225] Updated weights for policy 1, policy_version 482815 (0.0007) [2023-12-27 22:42:01,045][106226] Updated weights for policy 0, policy_version 481466 (0.0009) [2023-12-27 22:42:01,057][106225] Updated weights for policy 1, policy_version 482825 (0.0007) [2023-12-27 22:42:01,103][106226] Updated weights for policy 0, policy_version 481476 (0.0008) [2023-12-27 22:42:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 246923264. Throughput: 0: 9995.7, 1: 9524.4. Samples: 246906540. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:01,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-5.676')] [2023-12-27 22:42:01,822][106225] Updated weights for policy 1, policy_version 482835 (0.0008) [2023-12-27 22:42:01,828][106226] Updated weights for policy 0, policy_version 481486 (0.0007) [2023-12-27 22:42:01,877][106226] Updated weights for policy 0, policy_version 481496 (0.0008) [2023-12-27 22:42:01,878][106225] Updated weights for policy 1, policy_version 482845 (0.0007) [2023-12-27 22:42:01,933][106225] Updated weights for policy 1, policy_version 482855 (0.0006) [2023-12-27 22:42:01,938][106226] Updated weights for policy 0, policy_version 481506 (0.0007) [2023-12-27 22:42:02,569][106225] Updated weights for policy 1, policy_version 482865 (0.0005) [2023-12-27 22:42:02,585][106226] Updated weights for policy 0, policy_version 481516 (0.0008) [2023-12-27 22:42:02,617][106225] Updated weights for policy 1, policy_version 482875 (0.0005) [2023-12-27 22:42:02,636][106226] Updated weights for policy 0, policy_version 481526 (0.0008) [2023-12-27 22:42:02,665][106225] Updated weights for policy 1, policy_version 482885 (0.0005) [2023-12-27 22:42:02,688][106226] Updated weights for policy 0, policy_version 481536 (0.0007) [2023-12-27 22:42:02,716][106225] Updated weights for policy 1, policy_version 482895 (0.0010) [2023-12-27 22:42:03,294][106226] Updated weights for policy 0, policy_version 481546 (0.0009) [2023-12-27 22:42:03,346][106226] Updated weights for policy 0, policy_version 481556 (0.0010) [2023-12-27 22:42:03,397][106226] Updated weights for policy 0, policy_version 481566 (0.0010) [2023-12-27 22:42:03,417][106225] Updated weights for policy 1, policy_version 482905 (0.0006) [2023-12-27 22:42:03,447][106226] Updated weights for policy 0, policy_version 481576 (0.0010) [2023-12-27 22:42:03,478][106225] Updated weights for policy 1, policy_version 482915 (0.0005) [2023-12-27 22:42:03,543][106225] Updated weights for policy 1, policy_version 482925 (0.0006) [2023-12-27 22:42:04,187][106225] Updated weights for policy 1, policy_version 482935 (0.0009) [2023-12-27 22:42:04,206][106226] Updated weights for policy 0, policy_version 481586 (0.0011) [2023-12-27 22:42:04,243][106225] Updated weights for policy 1, policy_version 482945 (0.0006) [2023-12-27 22:42:04,269][106226] Updated weights for policy 0, policy_version 481596 (0.0011) [2023-12-27 22:42:04,302][106225] Updated weights for policy 1, policy_version 482955 (0.0006) [2023-12-27 22:42:04,330][106226] Updated weights for policy 0, policy_version 481606 (0.0011) [2023-12-27 22:42:04,917][106225] Updated weights for policy 1, policy_version 482965 (0.0007) [2023-12-27 22:42:04,972][106225] Updated weights for policy 1, policy_version 482975 (0.0007) [2023-12-27 22:42:04,988][106226] Updated weights for policy 0, policy_version 481616 (0.0011) [2023-12-27 22:42:05,035][106225] Updated weights for policy 1, policy_version 482985 (0.0007) [2023-12-27 22:42:05,042][106226] Updated weights for policy 0, policy_version 481626 (0.0011) [2023-12-27 22:42:05,099][106226] Updated weights for policy 0, policy_version 481636 (0.0010) [2023-12-27 22:42:05,696][106226] Updated weights for policy 0, policy_version 481646 (0.0010) [2023-12-27 22:42:05,753][106226] Updated weights for policy 0, policy_version 481656 (0.0011) [2023-12-27 22:42:05,769][106225] Updated weights for policy 1, policy_version 482995 (0.0006) [2023-12-27 22:42:05,814][106226] Updated weights for policy 0, policy_version 481666 (0.0010) [2023-12-27 22:42:05,819][106225] Updated weights for policy 1, policy_version 483005 (0.0007) [2023-12-27 22:42:05,865][106225] Updated weights for policy 1, policy_version 483015 (0.0006) [2023-12-27 22:42:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 247021568. Throughput: 0: 10081.7, 1: 9558.7. Samples: 247029380. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:06,175][105115] Avg episode reward: [(0, '-4.835'), (1, '-5.754')] [2023-12-27 22:42:06,483][106226] Updated weights for policy 0, policy_version 481676 (0.0009) [2023-12-27 22:42:06,493][106225] Updated weights for policy 1, policy_version 483025 (0.0005) [2023-12-27 22:42:06,550][106226] Updated weights for policy 0, policy_version 481686 (0.0009) [2023-12-27 22:42:06,552][106225] Updated weights for policy 1, policy_version 483035 (0.0006) [2023-12-27 22:42:06,603][106225] Updated weights for policy 1, policy_version 483045 (0.0007) [2023-12-27 22:42:06,620][106226] Updated weights for policy 0, policy_version 481696 (0.0009) [2023-12-27 22:42:06,658][106225] Updated weights for policy 1, policy_version 483055 (0.0006) [2023-12-27 22:42:07,230][106226] Updated weights for policy 0, policy_version 481706 (0.0007) [2023-12-27 22:42:07,286][106226] Updated weights for policy 0, policy_version 481716 (0.0009) [2023-12-27 22:42:07,344][106226] Updated weights for policy 0, policy_version 481726 (0.0008) [2023-12-27 22:42:07,401][106226] Updated weights for policy 0, policy_version 481736 (0.0007) [2023-12-27 22:42:07,437][106225] Updated weights for policy 1, policy_version 483065 (0.0008) [2023-12-27 22:42:07,501][106225] Updated weights for policy 1, policy_version 483075 (0.0008) [2023-12-27 22:42:07,559][106225] Updated weights for policy 1, policy_version 483085 (0.0008) [2023-12-27 22:42:08,125][106226] Updated weights for policy 0, policy_version 481746 (0.0008) [2023-12-27 22:42:08,184][106226] Updated weights for policy 0, policy_version 481756 (0.0008) [2023-12-27 22:42:08,240][106226] Updated weights for policy 0, policy_version 481766 (0.0007) [2023-12-27 22:42:08,294][106225] Updated weights for policy 1, policy_version 483095 (0.0007) [2023-12-27 22:42:08,354][106225] Updated weights for policy 1, policy_version 483105 (0.0009) [2023-12-27 22:42:08,415][106225] Updated weights for policy 1, policy_version 483115 (0.0009) [2023-12-27 22:42:09,012][106226] Updated weights for policy 0, policy_version 481776 (0.0008) [2023-12-27 22:42:09,077][106226] Updated weights for policy 0, policy_version 481786 (0.0008) [2023-12-27 22:42:09,140][106226] Updated weights for policy 0, policy_version 481796 (0.0008) [2023-12-27 22:42:09,149][106225] Updated weights for policy 1, policy_version 483125 (0.0007) [2023-12-27 22:42:09,205][106225] Updated weights for policy 1, policy_version 483135 (0.0006) [2023-12-27 22:42:09,280][106225] Updated weights for policy 1, policy_version 483145 (0.0008) [2023-12-27 22:42:09,955][106226] Updated weights for policy 0, policy_version 481806 (0.0009) [2023-12-27 22:42:10,003][106225] Updated weights for policy 1, policy_version 483155 (0.0010) [2023-12-27 22:42:10,020][106226] Updated weights for policy 0, policy_version 481816 (0.0007) [2023-12-27 22:42:10,067][106225] Updated weights for policy 1, policy_version 483165 (0.0008) [2023-12-27 22:42:10,088][106226] Updated weights for policy 0, policy_version 481826 (0.0008) [2023-12-27 22:42:10,131][106225] Updated weights for policy 1, policy_version 483175 (0.0010) [2023-12-27 22:42:10,832][106225] Updated weights for policy 1, policy_version 483185 (0.0011) [2023-12-27 22:42:10,863][106226] Updated weights for policy 0, policy_version 481836 (0.0006) [2023-12-27 22:42:10,890][106225] Updated weights for policy 1, policy_version 483195 (0.0007) [2023-12-27 22:42:10,917][106226] Updated weights for policy 0, policy_version 481846 (0.0008) [2023-12-27 22:42:10,953][106225] Updated weights for policy 1, policy_version 483205 (0.0008) [2023-12-27 22:42:10,972][106226] Updated weights for policy 0, policy_version 481856 (0.0006) [2023-12-27 22:42:11,015][106225] Updated weights for policy 1, policy_version 483215 (0.0006) [2023-12-27 22:42:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 247119872. Throughput: 0: 10085.5, 1: 9588.4. Samples: 247087712. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:11,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-5.568')] [2023-12-27 22:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000481864_123387904.pth... [2023-12-27 22:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000483216_123731968.pth... [2023-12-27 22:42:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000480712_123092992.pth [2023-12-27 22:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000482064_123437056.pth [2023-12-27 22:42:11,740][106226] Updated weights for policy 0, policy_version 481866 (0.0008) [2023-12-27 22:42:11,800][106225] Updated weights for policy 1, policy_version 483225 (0.0008) [2023-12-27 22:42:11,803][106226] Updated weights for policy 0, policy_version 481876 (0.0007) [2023-12-27 22:42:11,859][106225] Updated weights for policy 1, policy_version 483235 (0.0008) [2023-12-27 22:42:11,861][106226] Updated weights for policy 0, policy_version 481886 (0.0007) [2023-12-27 22:42:11,919][106226] Updated weights for policy 0, policy_version 481896 (0.0007) [2023-12-27 22:42:11,922][106225] Updated weights for policy 1, policy_version 483245 (0.0008) [2023-12-27 22:42:12,655][106226] Updated weights for policy 0, policy_version 481906 (0.0008) [2023-12-27 22:42:12,694][106225] Updated weights for policy 1, policy_version 483255 (0.0008) [2023-12-27 22:42:12,713][106226] Updated weights for policy 0, policy_version 481916 (0.0007) [2023-12-27 22:42:12,754][106225] Updated weights for policy 1, policy_version 483265 (0.0008) [2023-12-27 22:42:12,775][106226] Updated weights for policy 0, policy_version 481926 (0.0008) [2023-12-27 22:42:12,810][106225] Updated weights for policy 1, policy_version 483275 (0.0008) [2023-12-27 22:42:13,406][106225] Updated weights for policy 1, policy_version 483285 (0.0007) [2023-12-27 22:42:13,442][106226] Updated weights for policy 0, policy_version 481936 (0.0007) [2023-12-27 22:42:13,462][106225] Updated weights for policy 1, policy_version 483295 (0.0007) [2023-12-27 22:42:13,505][106226] Updated weights for policy 0, policy_version 481946 (0.0007) [2023-12-27 22:42:13,515][106225] Updated weights for policy 1, policy_version 483305 (0.0005) [2023-12-27 22:42:13,561][106226] Updated weights for policy 0, policy_version 481956 (0.0006) [2023-12-27 22:42:14,117][106226] Updated weights for policy 0, policy_version 481966 (0.0007) [2023-12-27 22:42:14,151][106225] Updated weights for policy 1, policy_version 483315 (0.0005) [2023-12-27 22:42:14,164][106226] Updated weights for policy 0, policy_version 481976 (0.0008) [2023-12-27 22:42:14,212][106225] Updated weights for policy 1, policy_version 483325 (0.0005) [2023-12-27 22:42:14,214][106226] Updated weights for policy 0, policy_version 481986 (0.0008) [2023-12-27 22:42:14,273][106225] Updated weights for policy 1, policy_version 483335 (0.0006) [2023-12-27 22:42:14,829][106225] Updated weights for policy 1, policy_version 483345 (0.0006) [2023-12-27 22:42:14,893][106225] Updated weights for policy 1, policy_version 483355 (0.0007) [2023-12-27 22:42:14,960][106225] Updated weights for policy 1, policy_version 483365 (0.0006) [2023-12-27 22:42:15,030][106225] Updated weights for policy 1, policy_version 483375 (0.0006) [2023-12-27 22:42:15,055][106226] Updated weights for policy 0, policy_version 481996 (0.0007) [2023-12-27 22:42:15,123][106226] Updated weights for policy 0, policy_version 482006 (0.0007) [2023-12-27 22:42:15,190][106226] Updated weights for policy 0, policy_version 482016 (0.0006) [2023-12-27 22:42:15,705][106225] Updated weights for policy 1, policy_version 483385 (0.0006) [2023-12-27 22:42:15,764][106225] Updated weights for policy 1, policy_version 483395 (0.0005) [2023-12-27 22:42:15,815][106225] Updated weights for policy 1, policy_version 483405 (0.0006) [2023-12-27 22:42:15,899][106226] Updated weights for policy 0, policy_version 482026 (0.0008) [2023-12-27 22:42:15,953][106226] Updated weights for policy 0, policy_version 482036 (0.0009) [2023-12-27 22:42:16,008][106226] Updated weights for policy 0, policy_version 482046 (0.0009) [2023-12-27 22:42:16,058][106226] Updated weights for policy 0, policy_version 482056 (0.0009) [2023-12-27 22:42:16,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 247218176. Throughput: 0: 9925.3, 1: 9693.4. Samples: 247204156. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:16,176][105115] Avg episode reward: [(0, '-4.988'), (1, '-6.002')] [2023-12-27 22:42:16,477][106225] Updated weights for policy 1, policy_version 483415 (0.0009) [2023-12-27 22:42:16,526][106225] Updated weights for policy 1, policy_version 483425 (0.0008) [2023-12-27 22:42:16,586][106225] Updated weights for policy 1, policy_version 483435 (0.0008) [2023-12-27 22:42:16,739][106226] Updated weights for policy 0, policy_version 482066 (0.0007) [2023-12-27 22:42:16,795][106226] Updated weights for policy 0, policy_version 482076 (0.0009) [2023-12-27 22:42:16,852][106226] Updated weights for policy 0, policy_version 482086 (0.0008) [2023-12-27 22:42:17,340][106225] Updated weights for policy 1, policy_version 483445 (0.0007) [2023-12-27 22:42:17,388][106225] Updated weights for policy 1, policy_version 483455 (0.0006) [2023-12-27 22:42:17,436][106225] Updated weights for policy 1, policy_version 483465 (0.0008) [2023-12-27 22:42:17,578][106226] Updated weights for policy 0, policy_version 482096 (0.0008) [2023-12-27 22:42:17,640][106226] Updated weights for policy 0, policy_version 482106 (0.0009) [2023-12-27 22:42:17,698][106226] Updated weights for policy 0, policy_version 482116 (0.0008) [2023-12-27 22:42:18,172][106225] Updated weights for policy 1, policy_version 483475 (0.0007) [2023-12-27 22:42:18,226][106225] Updated weights for policy 1, policy_version 483485 (0.0006) [2023-12-27 22:42:18,277][106225] Updated weights for policy 1, policy_version 483495 (0.0008) [2023-12-27 22:42:18,404][106226] Updated weights for policy 0, policy_version 482126 (0.0010) [2023-12-27 22:42:18,471][106226] Updated weights for policy 0, policy_version 482136 (0.0011) [2023-12-27 22:42:18,534][106226] Updated weights for policy 0, policy_version 482146 (0.0009) [2023-12-27 22:42:19,068][106225] Updated weights for policy 1, policy_version 483505 (0.0008) [2023-12-27 22:42:19,074][106226] Updated weights for policy 0, policy_version 482156 (0.0005) [2023-12-27 22:42:19,117][106225] Updated weights for policy 1, policy_version 483515 (0.0008) [2023-12-27 22:42:19,130][106226] Updated weights for policy 0, policy_version 482166 (0.0005) [2023-12-27 22:42:19,167][106225] Updated weights for policy 1, policy_version 483525 (0.0008) [2023-12-27 22:42:19,183][106226] Updated weights for policy 0, policy_version 482176 (0.0005) [2023-12-27 22:42:19,223][106225] Updated weights for policy 1, policy_version 483535 (0.0008) [2023-12-27 22:42:19,845][106226] Updated weights for policy 0, policy_version 482186 (0.0008) [2023-12-27 22:42:19,902][106226] Updated weights for policy 0, policy_version 482196 (0.0008) [2023-12-27 22:42:19,967][106226] Updated weights for policy 0, policy_version 482206 (0.0009) [2023-12-27 22:42:20,029][106226] Updated weights for policy 0, policy_version 482216 (0.0009) [2023-12-27 22:42:20,040][106225] Updated weights for policy 1, policy_version 483545 (0.0009) [2023-12-27 22:42:20,102][106225] Updated weights for policy 1, policy_version 483555 (0.0009) [2023-12-27 22:42:20,167][106225] Updated weights for policy 1, policy_version 483565 (0.0008) [2023-12-27 22:42:20,795][106226] Updated weights for policy 0, policy_version 482226 (0.0006) [2023-12-27 22:42:20,858][106226] Updated weights for policy 0, policy_version 482236 (0.0006) [2023-12-27 22:42:20,926][106226] Updated weights for policy 0, policy_version 482246 (0.0008) [2023-12-27 22:42:20,947][106225] Updated weights for policy 1, policy_version 483575 (0.0007) [2023-12-27 22:42:21,014][106225] Updated weights for policy 1, policy_version 483585 (0.0006) [2023-12-27 22:42:21,086][106225] Updated weights for policy 1, policy_version 483595 (0.0007) [2023-12-27 22:42:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 247316480. Throughput: 0: 9878.4, 1: 9714.5. Samples: 247321068. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:21,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-5.786')] [2023-12-27 22:42:21,677][106226] Updated weights for policy 0, policy_version 482256 (0.0009) [2023-12-27 22:42:21,754][106226] Updated weights for policy 0, policy_version 482266 (0.0009) [2023-12-27 22:42:21,813][106225] Updated weights for policy 1, policy_version 483605 (0.0006) [2023-12-27 22:42:21,820][106226] Updated weights for policy 0, policy_version 482276 (0.0007) [2023-12-27 22:42:21,875][106225] Updated weights for policy 1, policy_version 483615 (0.0007) [2023-12-27 22:42:21,943][106225] Updated weights for policy 1, policy_version 483625 (0.0006) [2023-12-27 22:42:22,566][106226] Updated weights for policy 0, policy_version 482286 (0.0010) [2023-12-27 22:42:22,625][106226] Updated weights for policy 0, policy_version 482296 (0.0010) [2023-12-27 22:42:22,667][106225] Updated weights for policy 1, policy_version 483635 (0.0008) [2023-12-27 22:42:22,687][106226] Updated weights for policy 0, policy_version 482306 (0.0007) [2023-12-27 22:42:22,728][106225] Updated weights for policy 1, policy_version 483645 (0.0009) [2023-12-27 22:42:22,782][106225] Updated weights for policy 1, policy_version 483655 (0.0010) [2023-12-27 22:42:23,340][106226] Updated weights for policy 0, policy_version 482316 (0.0008) [2023-12-27 22:42:23,399][106226] Updated weights for policy 0, policy_version 482326 (0.0009) [2023-12-27 22:42:23,464][106226] Updated weights for policy 0, policy_version 482336 (0.0009) [2023-12-27 22:42:23,467][106225] Updated weights for policy 1, policy_version 483665 (0.0007) [2023-12-27 22:42:23,528][106225] Updated weights for policy 1, policy_version 483675 (0.0008) [2023-12-27 22:42:23,582][106225] Updated weights for policy 1, policy_version 483685 (0.0010) [2023-12-27 22:42:23,644][106225] Updated weights for policy 1, policy_version 483695 (0.0010) [2023-12-27 22:42:24,170][106226] Updated weights for policy 0, policy_version 482346 (0.0006) [2023-12-27 22:42:24,225][106226] Updated weights for policy 0, policy_version 482356 (0.0008) [2023-12-27 22:42:24,286][106226] Updated weights for policy 0, policy_version 482366 (0.0007) [2023-12-27 22:42:24,346][106226] Updated weights for policy 0, policy_version 482376 (0.0007) [2023-12-27 22:42:24,359][106225] Updated weights for policy 1, policy_version 483705 (0.0010) [2023-12-27 22:42:24,405][106225] Updated weights for policy 1, policy_version 483715 (0.0010) [2023-12-27 22:42:24,455][106225] Updated weights for policy 1, policy_version 483725 (0.0010) [2023-12-27 22:42:25,016][106226] Updated weights for policy 0, policy_version 482386 (0.0006) [2023-12-27 22:42:25,079][106226] Updated weights for policy 0, policy_version 482396 (0.0006) [2023-12-27 22:42:25,135][106225] Updated weights for policy 1, policy_version 483735 (0.0010) [2023-12-27 22:42:25,148][106226] Updated weights for policy 0, policy_version 482406 (0.0005) [2023-12-27 22:42:25,185][106225] Updated weights for policy 1, policy_version 483745 (0.0010) [2023-12-27 22:42:25,228][106225] Updated weights for policy 1, policy_version 483755 (0.0010) [2023-12-27 22:42:25,735][106226] Updated weights for policy 0, policy_version 482416 (0.0005) [2023-12-27 22:42:25,796][106226] Updated weights for policy 0, policy_version 482426 (0.0006) [2023-12-27 22:42:25,850][106225] Updated weights for policy 1, policy_version 483765 (0.0007) [2023-12-27 22:42:25,859][106226] Updated weights for policy 0, policy_version 482436 (0.0006) [2023-12-27 22:42:25,904][106225] Updated weights for policy 1, policy_version 483775 (0.0009) [2023-12-27 22:42:25,964][106225] Updated weights for policy 1, policy_version 483785 (0.0005) [2023-12-27 22:42:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 247414784. Throughput: 0: 9853.6, 1: 9729.3. Samples: 247378508. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:26,176][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.869')] [2023-12-27 22:42:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000483792_123879424.pth... [2023-12-27 22:42:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000482440_123535360.pth... [2023-12-27 22:42:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000481288_123240448.pth [2023-12-27 22:42:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000482640_123584512.pth [2023-12-27 22:42:26,506][106225] Updated weights for policy 1, policy_version 483795 (0.0005) [2023-12-27 22:42:26,547][106226] Updated weights for policy 0, policy_version 482446 (0.0007) [2023-12-27 22:42:26,564][106225] Updated weights for policy 1, policy_version 483805 (0.0006) [2023-12-27 22:42:26,595][106226] Updated weights for policy 0, policy_version 482456 (0.0006) [2023-12-27 22:42:26,631][106225] Updated weights for policy 1, policy_version 483815 (0.0006) [2023-12-27 22:42:26,655][106226] Updated weights for policy 0, policy_version 482466 (0.0007) [2023-12-27 22:42:27,349][106225] Updated weights for policy 1, policy_version 483825 (0.0008) [2023-12-27 22:42:27,364][106226] Updated weights for policy 0, policy_version 482476 (0.0007) [2023-12-27 22:42:27,408][106225] Updated weights for policy 1, policy_version 483835 (0.0005) [2023-12-27 22:42:27,415][106226] Updated weights for policy 0, policy_version 482486 (0.0009) [2023-12-27 22:42:27,464][106225] Updated weights for policy 1, policy_version 483845 (0.0006) [2023-12-27 22:42:27,478][106226] Updated weights for policy 0, policy_version 482496 (0.0009) [2023-12-27 22:42:27,526][106225] Updated weights for policy 1, policy_version 483855 (0.0006) [2023-12-27 22:42:28,183][106226] Updated weights for policy 0, policy_version 482506 (0.0006) [2023-12-27 22:42:28,210][106225] Updated weights for policy 1, policy_version 483865 (0.0008) [2023-12-27 22:42:28,246][106226] Updated weights for policy 0, policy_version 482516 (0.0007) [2023-12-27 22:42:28,263][106225] Updated weights for policy 1, policy_version 483875 (0.0010) [2023-12-27 22:42:28,292][106226] Updated weights for policy 0, policy_version 482526 (0.0005) [2023-12-27 22:42:28,321][106225] Updated weights for policy 1, policy_version 483885 (0.0010) [2023-12-27 22:42:28,352][106226] Updated weights for policy 0, policy_version 482536 (0.0007) [2023-12-27 22:42:29,042][106225] Updated weights for policy 1, policy_version 483895 (0.0010) [2023-12-27 22:42:29,045][106226] Updated weights for policy 0, policy_version 482546 (0.0006) [2023-12-27 22:42:29,089][106225] Updated weights for policy 1, policy_version 483905 (0.0010) [2023-12-27 22:42:29,099][106226] Updated weights for policy 0, policy_version 482556 (0.0005) [2023-12-27 22:42:29,136][106225] Updated weights for policy 1, policy_version 483915 (0.0010) [2023-12-27 22:42:29,148][106226] Updated weights for policy 0, policy_version 482566 (0.0006) [2023-12-27 22:42:29,889][106225] Updated weights for policy 1, policy_version 483925 (0.0010) [2023-12-27 22:42:29,952][106225] Updated weights for policy 1, policy_version 483935 (0.0010) [2023-12-27 22:42:29,962][106226] Updated weights for policy 0, policy_version 482576 (0.0009) [2023-12-27 22:42:30,013][106225] Updated weights for policy 1, policy_version 483945 (0.0008) [2023-12-27 22:42:30,020][106226] Updated weights for policy 0, policy_version 482586 (0.0008) [2023-12-27 22:42:30,074][106226] Updated weights for policy 0, policy_version 482596 (0.0009) [2023-12-27 22:42:30,612][106225] Updated weights for policy 1, policy_version 483955 (0.0007) [2023-12-27 22:42:30,661][106225] Updated weights for policy 1, policy_version 483965 (0.0005) [2023-12-27 22:42:30,718][106225] Updated weights for policy 1, policy_version 483975 (0.0005) [2023-12-27 22:42:30,916][106226] Updated weights for policy 0, policy_version 482606 (0.0009) [2023-12-27 22:42:30,965][106226] Updated weights for policy 0, policy_version 482616 (0.0008) [2023-12-27 22:42:31,016][106226] Updated weights for policy 0, policy_version 482626 (0.0008) [2023-12-27 22:42:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 247513088. Throughput: 0: 9871.8, 1: 9871.2. Samples: 247500496. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:31,175][105115] Avg episode reward: [(0, '-5.308'), (1, '-5.943')] [2023-12-27 22:42:31,294][106225] Updated weights for policy 1, policy_version 483985 (0.0006) [2023-12-27 22:42:31,356][106225] Updated weights for policy 1, policy_version 483995 (0.0008) [2023-12-27 22:42:31,419][106225] Updated weights for policy 1, policy_version 484005 (0.0008) [2023-12-27 22:42:31,466][106225] Updated weights for policy 1, policy_version 484015 (0.0008) [2023-12-27 22:42:31,836][106226] Updated weights for policy 0, policy_version 482639 (0.0007) [2023-12-27 22:42:31,904][106226] Updated weights for policy 0, policy_version 482649 (0.0008) [2023-12-27 22:42:31,966][106226] Updated weights for policy 0, policy_version 482659 (0.0008) [2023-12-27 22:42:32,306][106225] Updated weights for policy 1, policy_version 484025 (0.0008) [2023-12-27 22:42:32,369][106225] Updated weights for policy 1, policy_version 484035 (0.0008) [2023-12-27 22:42:32,430][106225] Updated weights for policy 1, policy_version 484045 (0.0007) [2023-12-27 22:42:32,624][106226] Updated weights for policy 0, policy_version 482669 (0.0006) [2023-12-27 22:42:32,681][106226] Updated weights for policy 0, policy_version 482679 (0.0005) [2023-12-27 22:42:32,736][106226] Updated weights for policy 0, policy_version 482689 (0.0005) [2023-12-27 22:42:33,159][106225] Updated weights for policy 1, policy_version 484055 (0.0010) [2023-12-27 22:42:33,216][106225] Updated weights for policy 1, policy_version 484065 (0.0010) [2023-12-27 22:42:33,273][106225] Updated weights for policy 1, policy_version 484075 (0.0009) [2023-12-27 22:42:33,402][106226] Updated weights for policy 0, policy_version 482699 (0.0006) [2023-12-27 22:42:33,463][106226] Updated weights for policy 0, policy_version 482709 (0.0005) [2023-12-27 22:42:33,531][106226] Updated weights for policy 0, policy_version 482719 (0.0006) [2023-12-27 22:42:33,985][106225] Updated weights for policy 1, policy_version 484085 (0.0010) [2023-12-27 22:42:34,044][106225] Updated weights for policy 1, policy_version 484095 (0.0010) [2023-12-27 22:42:34,103][106225] Updated weights for policy 1, policy_version 484105 (0.0010) [2023-12-27 22:42:34,115][106226] Updated weights for policy 0, policy_version 482729 (0.0010) [2023-12-27 22:42:34,176][106226] Updated weights for policy 0, policy_version 482739 (0.0008) [2023-12-27 22:42:34,232][106226] Updated weights for policy 0, policy_version 482749 (0.0008) [2023-12-27 22:42:34,293][106226] Updated weights for policy 0, policy_version 482759 (0.0008) [2023-12-27 22:42:34,842][106225] Updated weights for policy 1, policy_version 484115 (0.0010) [2023-12-27 22:42:34,885][106225] Updated weights for policy 1, policy_version 484125 (0.0010) [2023-12-27 22:42:34,941][106225] Updated weights for policy 1, policy_version 484135 (0.0010) [2023-12-27 22:42:35,022][106226] Updated weights for policy 0, policy_version 482769 (0.0010) [2023-12-27 22:42:35,078][106226] Updated weights for policy 0, policy_version 482779 (0.0010) [2023-12-27 22:42:35,136][106226] Updated weights for policy 0, policy_version 482789 (0.0010) [2023-12-27 22:42:35,588][106225] Updated weights for policy 1, policy_version 484145 (0.0010) [2023-12-27 22:42:35,641][106225] Updated weights for policy 1, policy_version 484155 (0.0010) [2023-12-27 22:42:35,694][106225] Updated weights for policy 1, policy_version 484165 (0.0010) [2023-12-27 22:42:35,747][106225] Updated weights for policy 1, policy_version 484175 (0.0010) [2023-12-27 22:42:35,824][106226] Updated weights for policy 0, policy_version 482799 (0.0008) [2023-12-27 22:42:35,885][106226] Updated weights for policy 0, policy_version 482809 (0.0008) [2023-12-27 22:42:35,951][106226] Updated weights for policy 0, policy_version 482819 (0.0006) [2023-12-27 22:42:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 247611392. Throughput: 0: 9761.7, 1: 10003.8. Samples: 247620092. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:36,176][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.794')] [2023-12-27 22:42:36,444][106225] Updated weights for policy 1, policy_version 484185 (0.0010) [2023-12-27 22:42:36,507][106225] Updated weights for policy 1, policy_version 484195 (0.0011) [2023-12-27 22:42:36,570][106225] Updated weights for policy 1, policy_version 484205 (0.0008) [2023-12-27 22:42:36,619][106226] Updated weights for policy 0, policy_version 482829 (0.0008) [2023-12-27 22:42:36,683][106226] Updated weights for policy 0, policy_version 482839 (0.0011) [2023-12-27 22:42:36,737][106226] Updated weights for policy 0, policy_version 482849 (0.0010) [2023-12-27 22:42:37,248][106225] Updated weights for policy 1, policy_version 484215 (0.0007) [2023-12-27 22:42:37,311][106225] Updated weights for policy 1, policy_version 484225 (0.0009) [2023-12-27 22:42:37,364][106225] Updated weights for policy 1, policy_version 484235 (0.0007) [2023-12-27 22:42:37,393][106226] Updated weights for policy 0, policy_version 482859 (0.0009) [2023-12-27 22:42:37,447][106226] Updated weights for policy 0, policy_version 482869 (0.0005) [2023-12-27 22:42:37,505][106226] Updated weights for policy 0, policy_version 482879 (0.0005) [2023-12-27 22:42:38,001][106225] Updated weights for policy 1, policy_version 484245 (0.0008) [2023-12-27 22:42:38,064][106225] Updated weights for policy 1, policy_version 484255 (0.0006) [2023-12-27 22:42:38,132][106225] Updated weights for policy 1, policy_version 484265 (0.0008) [2023-12-27 22:42:38,188][106226] Updated weights for policy 0, policy_version 482889 (0.0010) [2023-12-27 22:42:38,250][106226] Updated weights for policy 0, policy_version 482899 (0.0008) [2023-12-27 22:42:38,300][106226] Updated weights for policy 0, policy_version 482909 (0.0010) [2023-12-27 22:42:38,366][106226] Updated weights for policy 0, policy_version 482919 (0.0008) [2023-12-27 22:42:38,769][106225] Updated weights for policy 1, policy_version 484275 (0.0010) [2023-12-27 22:42:38,830][106225] Updated weights for policy 1, policy_version 484285 (0.0010) [2023-12-27 22:42:38,891][106225] Updated weights for policy 1, policy_version 484295 (0.0010) [2023-12-27 22:42:39,088][106226] Updated weights for policy 0, policy_version 482929 (0.0008) [2023-12-27 22:42:39,146][106226] Updated weights for policy 0, policy_version 482939 (0.0006) [2023-12-27 22:42:39,205][106226] Updated weights for policy 0, policy_version 482949 (0.0007) [2023-12-27 22:42:39,624][106225] Updated weights for policy 1, policy_version 484305 (0.0010) [2023-12-27 22:42:39,690][106225] Updated weights for policy 1, policy_version 484315 (0.0009) [2023-12-27 22:42:39,755][106225] Updated weights for policy 1, policy_version 484325 (0.0011) [2023-12-27 22:42:39,824][106225] Updated weights for policy 1, policy_version 484335 (0.0010) [2023-12-27 22:42:39,951][106226] Updated weights for policy 0, policy_version 482959 (0.0007) [2023-12-27 22:42:40,008][106226] Updated weights for policy 0, policy_version 482969 (0.0008) [2023-12-27 22:42:40,076][106226] Updated weights for policy 0, policy_version 482979 (0.0007) [2023-12-27 22:42:40,563][106225] Updated weights for policy 1, policy_version 484345 (0.0011) [2023-12-27 22:42:40,631][106225] Updated weights for policy 1, policy_version 484355 (0.0011) [2023-12-27 22:42:40,693][106225] Updated weights for policy 1, policy_version 484365 (0.0011) [2023-12-27 22:42:40,747][106226] Updated weights for policy 0, policy_version 482989 (0.0007) [2023-12-27 22:42:40,819][106226] Updated weights for policy 0, policy_version 482999 (0.0008) [2023-12-27 22:42:40,872][106226] Updated weights for policy 0, policy_version 483009 (0.0005) [2023-12-27 22:42:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 247709696. Throughput: 0: 9803.7, 1: 9974.1. Samples: 247681112. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:41,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.747')] [2023-12-27 22:42:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000484368_124026880.pth... [2023-12-27 22:42:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000483016_123682816.pth... [2023-12-27 22:42:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000483216_123731968.pth [2023-12-27 22:42:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000481864_123387904.pth [2023-12-27 22:42:41,450][106225] Updated weights for policy 1, policy_version 484375 (0.0009) [2023-12-27 22:42:41,498][106225] Updated weights for policy 1, policy_version 484385 (0.0010) [2023-12-27 22:42:41,546][106225] Updated weights for policy 1, policy_version 484395 (0.0010) [2023-12-27 22:42:41,603][106226] Updated weights for policy 0, policy_version 483019 (0.0007) [2023-12-27 22:42:41,675][106226] Updated weights for policy 0, policy_version 483029 (0.0008) [2023-12-27 22:42:41,748][106226] Updated weights for policy 0, policy_version 483039 (0.0008) [2023-12-27 22:42:42,391][106226] Updated weights for policy 0, policy_version 483049 (0.0009) [2023-12-27 22:42:42,411][106225] Updated weights for policy 1, policy_version 484405 (0.0010) [2023-12-27 22:42:42,448][106226] Updated weights for policy 0, policy_version 483059 (0.0006) [2023-12-27 22:42:42,477][106225] Updated weights for policy 1, policy_version 484415 (0.0008) [2023-12-27 22:42:42,505][106226] Updated weights for policy 0, policy_version 483069 (0.0006) [2023-12-27 22:42:42,546][106225] Updated weights for policy 1, policy_version 484425 (0.0008) [2023-12-27 22:42:42,564][106226] Updated weights for policy 0, policy_version 483079 (0.0007) [2023-12-27 22:42:43,228][106226] Updated weights for policy 0, policy_version 483089 (0.0008) [2023-12-27 22:42:43,263][106225] Updated weights for policy 1, policy_version 484435 (0.0007) [2023-12-27 22:42:43,274][106226] Updated weights for policy 0, policy_version 483099 (0.0007) [2023-12-27 22:42:43,315][106225] Updated weights for policy 1, policy_version 484445 (0.0007) [2023-12-27 22:42:43,335][106226] Updated weights for policy 0, policy_version 483109 (0.0008) [2023-12-27 22:42:43,375][106225] Updated weights for policy 1, policy_version 484455 (0.0009) [2023-12-27 22:42:44,003][106225] Updated weights for policy 1, policy_version 484465 (0.0008) [2023-12-27 22:42:44,061][106225] Updated weights for policy 1, policy_version 484475 (0.0005) [2023-12-27 22:42:44,099][106226] Updated weights for policy 0, policy_version 483119 (0.0009) [2023-12-27 22:42:44,118][106225] Updated weights for policy 1, policy_version 484485 (0.0006) [2023-12-27 22:42:44,156][106226] Updated weights for policy 0, policy_version 483129 (0.0008) [2023-12-27 22:42:44,164][106225] Updated weights for policy 1, policy_version 484495 (0.0007) [2023-12-27 22:42:44,215][106226] Updated weights for policy 0, policy_version 483139 (0.0008) [2023-12-27 22:42:44,874][106225] Updated weights for policy 1, policy_version 484505 (0.0008) [2023-12-27 22:42:44,905][106226] Updated weights for policy 0, policy_version 483149 (0.0007) [2023-12-27 22:42:44,937][106225] Updated weights for policy 1, policy_version 484515 (0.0008) [2023-12-27 22:42:44,969][106226] Updated weights for policy 0, policy_version 483159 (0.0009) [2023-12-27 22:42:44,996][106225] Updated weights for policy 1, policy_version 484525 (0.0008) [2023-12-27 22:42:45,029][106226] Updated weights for policy 0, policy_version 483169 (0.0007) [2023-12-27 22:42:45,665][106226] Updated weights for policy 0, policy_version 483179 (0.0006) [2023-12-27 22:42:45,718][106225] Updated weights for policy 1, policy_version 484535 (0.0009) [2023-12-27 22:42:45,722][106226] Updated weights for policy 0, policy_version 483189 (0.0008) [2023-12-27 22:42:45,767][106225] Updated weights for policy 1, policy_version 484545 (0.0008) [2023-12-27 22:42:45,769][106226] Updated weights for policy 0, policy_version 483199 (0.0006) [2023-12-27 22:42:45,818][106225] Updated weights for policy 1, policy_version 484555 (0.0008) [2023-12-27 22:42:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 247808000. Throughput: 0: 9882.8, 1: 9891.7. Samples: 247796392. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:46,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-5.772')] [2023-12-27 22:42:46,396][106226] Updated weights for policy 0, policy_version 483209 (0.0009) [2023-12-27 22:42:46,463][106226] Updated weights for policy 0, policy_version 483219 (0.0006) [2023-12-27 22:42:46,525][106226] Updated weights for policy 0, policy_version 483229 (0.0005) [2023-12-27 22:42:46,549][106225] Updated weights for policy 1, policy_version 484565 (0.0008) [2023-12-27 22:42:46,579][106226] Updated weights for policy 0, policy_version 483239 (0.0005) [2023-12-27 22:42:46,604][106225] Updated weights for policy 1, policy_version 484575 (0.0009) [2023-12-27 22:42:46,656][106225] Updated weights for policy 1, policy_version 484585 (0.0008) [2023-12-27 22:42:47,235][106226] Updated weights for policy 0, policy_version 483249 (0.0007) [2023-12-27 22:42:47,298][106226] Updated weights for policy 0, policy_version 483259 (0.0009) [2023-12-27 22:42:47,367][106226] Updated weights for policy 0, policy_version 483269 (0.0008) [2023-12-27 22:42:47,397][106225] Updated weights for policy 1, policy_version 484595 (0.0007) [2023-12-27 22:42:47,452][106225] Updated weights for policy 1, policy_version 484605 (0.0009) [2023-12-27 22:42:47,496][106225] Updated weights for policy 1, policy_version 484615 (0.0008) [2023-12-27 22:42:48,112][106225] Updated weights for policy 1, policy_version 484625 (0.0008) [2023-12-27 22:42:48,113][106226] Updated weights for policy 0, policy_version 483279 (0.0006) [2023-12-27 22:42:48,162][106225] Updated weights for policy 1, policy_version 484635 (0.0008) [2023-12-27 22:42:48,172][106226] Updated weights for policy 0, policy_version 483289 (0.0005) [2023-12-27 22:42:48,222][106225] Updated weights for policy 1, policy_version 484645 (0.0009) [2023-12-27 22:42:48,239][106226] Updated weights for policy 0, policy_version 483299 (0.0007) [2023-12-27 22:42:48,280][106225] Updated weights for policy 1, policy_version 484655 (0.0006) [2023-12-27 22:42:48,906][106226] Updated weights for policy 0, policy_version 483309 (0.0007) [2023-12-27 22:42:48,958][106226] Updated weights for policy 0, policy_version 483319 (0.0005) [2023-12-27 22:42:48,999][106225] Updated weights for policy 1, policy_version 484665 (0.0009) [2023-12-27 22:42:49,020][106226] Updated weights for policy 0, policy_version 483329 (0.0005) [2023-12-27 22:42:49,059][106225] Updated weights for policy 1, policy_version 484675 (0.0011) [2023-12-27 22:42:49,122][106225] Updated weights for policy 1, policy_version 484685 (0.0010) [2023-12-27 22:42:49,637][106226] Updated weights for policy 0, policy_version 483339 (0.0007) [2023-12-27 22:42:49,697][106226] Updated weights for policy 0, policy_version 483349 (0.0010) [2023-12-27 22:42:49,760][106226] Updated weights for policy 0, policy_version 483359 (0.0009) [2023-12-27 22:42:49,781][106225] Updated weights for policy 1, policy_version 484695 (0.0008) [2023-12-27 22:42:49,845][106225] Updated weights for policy 1, policy_version 484705 (0.0007) [2023-12-27 22:42:49,910][106225] Updated weights for policy 1, policy_version 484715 (0.0008) [2023-12-27 22:42:50,504][106226] Updated weights for policy 0, policy_version 483369 (0.0010) [2023-12-27 22:42:50,561][106226] Updated weights for policy 0, policy_version 483379 (0.0006) [2023-12-27 22:42:50,588][106225] Updated weights for policy 1, policy_version 484725 (0.0008) [2023-12-27 22:42:50,627][106226] Updated weights for policy 0, policy_version 483389 (0.0008) [2023-12-27 22:42:50,634][106225] Updated weights for policy 1, policy_version 484735 (0.0009) [2023-12-27 22:42:50,688][106225] Updated weights for policy 1, policy_version 484745 (0.0005) [2023-12-27 22:42:50,690][106226] Updated weights for policy 0, policy_version 483399 (0.0007) [2023-12-27 22:42:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 247906304. Throughput: 0: 9851.4, 1: 9873.3. Samples: 247916992. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:51,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.737')] [2023-12-27 22:42:51,349][106225] Updated weights for policy 1, policy_version 484755 (0.0006) [2023-12-27 22:42:51,419][106225] Updated weights for policy 1, policy_version 484765 (0.0008) [2023-12-27 22:42:51,441][106226] Updated weights for policy 0, policy_version 483409 (0.0010) [2023-12-27 22:42:51,478][106225] Updated weights for policy 1, policy_version 484775 (0.0008) [2023-12-27 22:42:51,495][106226] Updated weights for policy 0, policy_version 483419 (0.0011) [2023-12-27 22:42:51,557][106226] Updated weights for policy 0, policy_version 483429 (0.0010) [2023-12-27 22:42:52,207][106225] Updated weights for policy 1, policy_version 484785 (0.0008) [2023-12-27 22:42:52,271][106225] Updated weights for policy 1, policy_version 484795 (0.0008) [2023-12-27 22:42:52,308][106226] Updated weights for policy 0, policy_version 483439 (0.0011) [2023-12-27 22:42:52,334][106225] Updated weights for policy 1, policy_version 484805 (0.0006) [2023-12-27 22:42:52,371][106226] Updated weights for policy 0, policy_version 483449 (0.0010) [2023-12-27 22:42:52,408][106225] Updated weights for policy 1, policy_version 484815 (0.0007) [2023-12-27 22:42:52,432][106226] Updated weights for policy 0, policy_version 483459 (0.0010) [2023-12-27 22:42:53,059][106226] Updated weights for policy 0, policy_version 483469 (0.0008) [2023-12-27 22:42:53,101][106225] Updated weights for policy 1, policy_version 484825 (0.0006) [2023-12-27 22:42:53,128][106226] Updated weights for policy 0, policy_version 483479 (0.0008) [2023-12-27 22:42:53,157][106225] Updated weights for policy 1, policy_version 484835 (0.0005) [2023-12-27 22:42:53,185][106226] Updated weights for policy 0, policy_version 483489 (0.0008) [2023-12-27 22:42:53,210][106225] Updated weights for policy 1, policy_version 484845 (0.0010) [2023-12-27 22:42:53,762][106226] Updated weights for policy 0, policy_version 483499 (0.0006) [2023-12-27 22:42:53,822][106226] Updated weights for policy 0, policy_version 483509 (0.0006) [2023-12-27 22:42:53,867][106225] Updated weights for policy 1, policy_version 484855 (0.0007) [2023-12-27 22:42:53,888][106226] Updated weights for policy 0, policy_version 483519 (0.0006) [2023-12-27 22:42:53,928][106225] Updated weights for policy 1, policy_version 484865 (0.0005) [2023-12-27 22:42:53,981][106225] Updated weights for policy 1, policy_version 484875 (0.0006) [2023-12-27 22:42:54,503][106226] Updated weights for policy 0, policy_version 483529 (0.0008) [2023-12-27 22:42:54,549][106226] Updated weights for policy 0, policy_version 483539 (0.0007) [2023-12-27 22:42:54,596][106226] Updated weights for policy 0, policy_version 483549 (0.0006) [2023-12-27 22:42:54,638][106225] Updated weights for policy 1, policy_version 484885 (0.0006) [2023-12-27 22:42:54,643][106226] Updated weights for policy 0, policy_version 483559 (0.0006) [2023-12-27 22:42:54,684][106225] Updated weights for policy 1, policy_version 484895 (0.0007) [2023-12-27 22:42:54,736][106225] Updated weights for policy 1, policy_version 484905 (0.0006) [2023-12-27 22:42:55,333][106226] Updated weights for policy 0, policy_version 483569 (0.0005) [2023-12-27 22:42:55,388][106226] Updated weights for policy 0, policy_version 483579 (0.0005) [2023-12-27 22:42:55,443][106226] Updated weights for policy 0, policy_version 483589 (0.0006) [2023-12-27 22:42:55,445][106225] Updated weights for policy 1, policy_version 484915 (0.0006) [2023-12-27 22:42:55,494][106225] Updated weights for policy 1, policy_version 484925 (0.0007) [2023-12-27 22:42:55,543][106225] Updated weights for policy 1, policy_version 484935 (0.0008) [2023-12-27 22:42:56,066][106226] Updated weights for policy 0, policy_version 483599 (0.0009) [2023-12-27 22:42:56,130][106226] Updated weights for policy 0, policy_version 483609 (0.0010) [2023-12-27 22:42:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 248004608. Throughput: 0: 9886.5, 1: 9899.6. Samples: 247978092. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:42:56,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-5.683')] [2023-12-27 22:42:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000484944_124174336.pth... [2023-12-27 22:42:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000483792_123879424.pth [2023-12-27 22:42:56,194][106226] Updated weights for policy 0, policy_version 483619 (0.0010) [2023-12-27 22:42:56,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000483624_123838464.pth... [2023-12-27 22:42:56,229][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000482440_123535360.pth [2023-12-27 22:42:56,304][106225] Updated weights for policy 1, policy_version 484945 (0.0008) [2023-12-27 22:42:56,359][106225] Updated weights for policy 1, policy_version 484955 (0.0010) [2023-12-27 22:42:56,406][106225] Updated weights for policy 1, policy_version 484965 (0.0010) [2023-12-27 22:42:56,448][106225] Updated weights for policy 1, policy_version 484975 (0.0010) [2023-12-27 22:42:56,800][106226] Updated weights for policy 0, policy_version 483629 (0.0010) [2023-12-27 22:42:56,855][106226] Updated weights for policy 0, policy_version 483639 (0.0010) [2023-12-27 22:42:56,904][106226] Updated weights for policy 0, policy_version 483649 (0.0010) [2023-12-27 22:42:57,118][106225] Updated weights for policy 1, policy_version 484985 (0.0006) [2023-12-27 22:42:57,184][106225] Updated weights for policy 1, policy_version 484995 (0.0008) [2023-12-27 22:42:57,240][106225] Updated weights for policy 1, policy_version 485005 (0.0010) [2023-12-27 22:42:57,648][106226] Updated weights for policy 0, policy_version 483659 (0.0010) [2023-12-27 22:42:57,708][106226] Updated weights for policy 0, policy_version 483669 (0.0010) [2023-12-27 22:42:57,770][106226] Updated weights for policy 0, policy_version 483679 (0.0007) [2023-12-27 22:42:57,915][106225] Updated weights for policy 1, policy_version 485015 (0.0010) [2023-12-27 22:42:57,960][106225] Updated weights for policy 1, policy_version 485025 (0.0010) [2023-12-27 22:42:58,009][106225] Updated weights for policy 1, policy_version 485035 (0.0010) [2023-12-27 22:42:58,424][106226] Updated weights for policy 0, policy_version 483689 (0.0005) [2023-12-27 22:42:58,489][106226] Updated weights for policy 0, policy_version 483699 (0.0010) [2023-12-27 22:42:58,555][106226] Updated weights for policy 0, policy_version 483709 (0.0008) [2023-12-27 22:42:58,617][106226] Updated weights for policy 0, policy_version 483719 (0.0008) [2023-12-27 22:42:58,791][106225] Updated weights for policy 1, policy_version 485045 (0.0009) [2023-12-27 22:42:58,854][106225] Updated weights for policy 1, policy_version 485055 (0.0007) [2023-12-27 22:42:58,907][106225] Updated weights for policy 1, policy_version 485065 (0.0008) [2023-12-27 22:42:59,503][106226] Updated weights for policy 0, policy_version 483729 (0.0006) [2023-12-27 22:42:59,563][106226] Updated weights for policy 0, policy_version 483739 (0.0008) [2023-12-27 22:42:59,633][106226] Updated weights for policy 0, policy_version 483749 (0.0006) [2023-12-27 22:42:59,666][106225] Updated weights for policy 1, policy_version 485075 (0.0008) [2023-12-27 22:42:59,726][106225] Updated weights for policy 1, policy_version 485085 (0.0010) [2023-12-27 22:42:59,778][106225] Updated weights for policy 1, policy_version 485095 (0.0009) [2023-12-27 22:43:00,355][106226] Updated weights for policy 0, policy_version 483759 (0.0008) [2023-12-27 22:43:00,420][106226] Updated weights for policy 0, policy_version 483769 (0.0009) [2023-12-27 22:43:00,439][106225] Updated weights for policy 1, policy_version 485105 (0.0008) [2023-12-27 22:43:00,481][106226] Updated weights for policy 0, policy_version 483779 (0.0007) [2023-12-27 22:43:00,488][106225] Updated weights for policy 1, policy_version 485115 (0.0008) [2023-12-27 22:43:00,543][106225] Updated weights for policy 1, policy_version 485125 (0.0008) [2023-12-27 22:43:00,607][106225] Updated weights for policy 1, policy_version 485135 (0.0007) [2023-12-27 22:43:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 248102912. Throughput: 0: 9958.4, 1: 9878.6. Samples: 248096816. Policy #0 lag: (min: 14.0, avg: 16.1, max: 46.0) [2023-12-27 22:43:01,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.721')] [2023-12-27 22:43:01,241][106226] Updated weights for policy 0, policy_version 483789 (0.0008) [2023-12-27 22:43:01,262][106225] Updated weights for policy 1, policy_version 485145 (0.0006) [2023-12-27 22:43:01,301][106226] Updated weights for policy 0, policy_version 483799 (0.0007) [2023-12-27 22:43:01,323][106225] Updated weights for policy 1, policy_version 485155 (0.0006) [2023-12-27 22:43:01,373][106226] Updated weights for policy 0, policy_version 483809 (0.0007) [2023-12-27 22:43:01,391][106225] Updated weights for policy 1, policy_version 485165 (0.0007) [2023-12-27 22:43:01,996][106225] Updated weights for policy 1, policy_version 485175 (0.0007) [2023-12-27 22:43:02,043][106226] Updated weights for policy 0, policy_version 483819 (0.0008) [2023-12-27 22:43:02,060][106225] Updated weights for policy 1, policy_version 485185 (0.0005) [2023-12-27 22:43:02,097][106226] Updated weights for policy 0, policy_version 483829 (0.0008) [2023-12-27 22:43:02,117][106225] Updated weights for policy 1, policy_version 485195 (0.0006) [2023-12-27 22:43:02,157][106226] Updated weights for policy 0, policy_version 483839 (0.0006) [2023-12-27 22:43:02,690][106225] Updated weights for policy 1, policy_version 485205 (0.0006) [2023-12-27 22:43:02,755][106225] Updated weights for policy 1, policy_version 485215 (0.0006) [2023-12-27 22:43:02,817][106225] Updated weights for policy 1, policy_version 485225 (0.0005) [2023-12-27 22:43:02,871][106226] Updated weights for policy 0, policy_version 483849 (0.0006) [2023-12-27 22:43:02,928][106226] Updated weights for policy 0, policy_version 483859 (0.0010) [2023-12-27 22:43:02,977][106226] Updated weights for policy 0, policy_version 483869 (0.0010) [2023-12-27 22:43:03,027][106226] Updated weights for policy 0, policy_version 483879 (0.0007) [2023-12-27 22:43:03,333][106225] Updated weights for policy 1, policy_version 485235 (0.0005) [2023-12-27 22:43:03,393][106225] Updated weights for policy 1, policy_version 485245 (0.0005) [2023-12-27 22:43:03,438][106225] Updated weights for policy 1, policy_version 485255 (0.0005) [2023-12-27 22:43:03,636][106226] Updated weights for policy 0, policy_version 483889 (0.0006) [2023-12-27 22:43:03,691][106226] Updated weights for policy 0, policy_version 483899 (0.0006) [2023-12-27 22:43:03,749][106226] Updated weights for policy 0, policy_version 483909 (0.0006) [2023-12-27 22:43:03,948][106225] Updated weights for policy 1, policy_version 485265 (0.0005) [2023-12-27 22:43:04,007][106225] Updated weights for policy 1, policy_version 485275 (0.0005) [2023-12-27 22:43:04,067][106225] Updated weights for policy 1, policy_version 485285 (0.0006) [2023-12-27 22:43:04,128][106225] Updated weights for policy 1, policy_version 485295 (0.0006) [2023-12-27 22:43:04,473][106226] Updated weights for policy 0, policy_version 483919 (0.0005) [2023-12-27 22:43:04,538][106226] Updated weights for policy 0, policy_version 483929 (0.0008) [2023-12-27 22:43:04,606][106226] Updated weights for policy 0, policy_version 483939 (0.0009) [2023-12-27 22:43:04,741][106225] Updated weights for policy 1, policy_version 485305 (0.0005) [2023-12-27 22:43:04,807][106225] Updated weights for policy 1, policy_version 485315 (0.0005) [2023-12-27 22:43:04,872][106225] Updated weights for policy 1, policy_version 485325 (0.0009) [2023-12-27 22:43:05,299][106226] Updated weights for policy 0, policy_version 483949 (0.0007) [2023-12-27 22:43:05,349][106226] Updated weights for policy 0, policy_version 483959 (0.0008) [2023-12-27 22:43:05,396][106226] Updated weights for policy 0, policy_version 483969 (0.0007) [2023-12-27 22:43:05,428][106225] Updated weights for policy 1, policy_version 485335 (0.0010) [2023-12-27 22:43:05,484][106225] Updated weights for policy 1, policy_version 485345 (0.0010) [2023-12-27 22:43:05,530][106225] Updated weights for policy 1, policy_version 485355 (0.0010) [2023-12-27 22:43:05,980][106226] Updated weights for policy 0, policy_version 483979 (0.0007) [2023-12-27 22:43:06,027][106226] Updated weights for policy 0, policy_version 483989 (0.0007) [2023-12-27 22:43:06,081][106226] Updated weights for policy 0, policy_version 483999 (0.0007) [2023-12-27 22:43:06,175][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 248217600. Throughput: 0: 9957.9, 1: 10131.7. Samples: 248225096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:06,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.591')] [2023-12-27 22:43:06,243][106225] Updated weights for policy 1, policy_version 485365 (0.0008) [2023-12-27 22:43:06,301][106225] Updated weights for policy 1, policy_version 485375 (0.0010) [2023-12-27 22:43:06,359][106225] Updated weights for policy 1, policy_version 485385 (0.0010) [2023-12-27 22:43:06,808][106226] Updated weights for policy 0, policy_version 484009 (0.0008) [2023-12-27 22:43:06,869][106226] Updated weights for policy 0, policy_version 484019 (0.0009) [2023-12-27 22:43:06,930][106226] Updated weights for policy 0, policy_version 484029 (0.0008) [2023-12-27 22:43:06,985][106226] Updated weights for policy 0, policy_version 484039 (0.0009) [2023-12-27 22:43:07,066][106225] Updated weights for policy 1, policy_version 485395 (0.0010) [2023-12-27 22:43:07,122][106225] Updated weights for policy 1, policy_version 485405 (0.0008) [2023-12-27 22:43:07,179][106225] Updated weights for policy 1, policy_version 485415 (0.0008) [2023-12-27 22:43:07,757][106226] Updated weights for policy 0, policy_version 484049 (0.0007) [2023-12-27 22:43:07,811][106226] Updated weights for policy 0, policy_version 484059 (0.0008) [2023-12-27 22:43:07,831][106225] Updated weights for policy 1, policy_version 485425 (0.0009) [2023-12-27 22:43:07,872][106226] Updated weights for policy 0, policy_version 484069 (0.0007) [2023-12-27 22:43:07,891][106225] Updated weights for policy 1, policy_version 485435 (0.0010) [2023-12-27 22:43:07,948][106225] Updated weights for policy 1, policy_version 485445 (0.0010) [2023-12-27 22:43:08,011][106225] Updated weights for policy 1, policy_version 485455 (0.0010) [2023-12-27 22:43:08,576][106226] Updated weights for policy 0, policy_version 484079 (0.0008) [2023-12-27 22:43:08,646][106226] Updated weights for policy 0, policy_version 484089 (0.0006) [2023-12-27 22:43:08,718][106226] Updated weights for policy 0, policy_version 484099 (0.0006) [2023-12-27 22:43:08,740][106225] Updated weights for policy 1, policy_version 485465 (0.0010) [2023-12-27 22:43:08,801][106225] Updated weights for policy 1, policy_version 485475 (0.0010) [2023-12-27 22:43:08,865][106225] Updated weights for policy 1, policy_version 485485 (0.0010) [2023-12-27 22:43:09,391][106226] Updated weights for policy 0, policy_version 484109 (0.0007) [2023-12-27 22:43:09,460][106226] Updated weights for policy 0, policy_version 484119 (0.0008) [2023-12-27 22:43:09,519][106226] Updated weights for policy 0, policy_version 484129 (0.0008) [2023-12-27 22:43:09,605][106225] Updated weights for policy 1, policy_version 485495 (0.0010) [2023-12-27 22:43:09,666][106225] Updated weights for policy 1, policy_version 485505 (0.0010) [2023-12-27 22:43:09,731][106225] Updated weights for policy 1, policy_version 485515 (0.0010) [2023-12-27 22:43:10,286][106226] Updated weights for policy 0, policy_version 484139 (0.0008) [2023-12-27 22:43:10,337][106226] Updated weights for policy 0, policy_version 484149 (0.0008) [2023-12-27 22:43:10,401][106226] Updated weights for policy 0, policy_version 484159 (0.0008) [2023-12-27 22:43:10,456][106225] Updated weights for policy 1, policy_version 485525 (0.0011) [2023-12-27 22:43:10,517][106225] Updated weights for policy 1, policy_version 485535 (0.0011) [2023-12-27 22:43:10,574][106225] Updated weights for policy 1, policy_version 485545 (0.0010) [2023-12-27 22:43:11,126][106226] Updated weights for policy 0, policy_version 484169 (0.0007) [2023-12-27 22:43:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 248307712. Throughput: 0: 9965.6, 1: 10159.6. Samples: 248284140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:11,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.593')] [2023-12-27 22:43:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000485552_124329984.pth... [2023-12-27 22:43:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000484368_124026880.pth [2023-12-27 22:43:11,192][106226] Updated weights for policy 0, policy_version 484179 (0.0008) [2023-12-27 22:43:11,257][106226] Updated weights for policy 0, policy_version 484189 (0.0008) [2023-12-27 22:43:11,266][106225] Updated weights for policy 1, policy_version 485555 (0.0008) [2023-12-27 22:43:11,319][106226] Updated weights for policy 0, policy_version 484199 (0.0006) [2023-12-27 22:43:11,325][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000484200_123985920.pth... [2023-12-27 22:43:11,329][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000483016_123682816.pth [2023-12-27 22:43:11,331][106225] Updated weights for policy 1, policy_version 485565 (0.0009) [2023-12-27 22:43:11,405][106225] Updated weights for policy 1, policy_version 485575 (0.0009) [2023-12-27 22:43:12,158][106226] Updated weights for policy 0, policy_version 484209 (0.0008) [2023-12-27 22:43:12,161][106225] Updated weights for policy 1, policy_version 485585 (0.0008) [2023-12-27 22:43:12,214][106225] Updated weights for policy 1, policy_version 485595 (0.0008) [2023-12-27 22:43:12,218][106226] Updated weights for policy 0, policy_version 484219 (0.0008) [2023-12-27 22:43:12,277][106225] Updated weights for policy 1, policy_version 485605 (0.0010) [2023-12-27 22:43:12,279][106226] Updated weights for policy 0, policy_version 484229 (0.0008) [2023-12-27 22:43:12,345][106225] Updated weights for policy 1, policy_version 485615 (0.0007) [2023-12-27 22:43:12,982][106226] Updated weights for policy 0, policy_version 484239 (0.0009) [2023-12-27 22:43:13,032][106226] Updated weights for policy 0, policy_version 484249 (0.0005) [2023-12-27 22:43:13,078][106225] Updated weights for policy 1, policy_version 485625 (0.0008) [2023-12-27 22:43:13,084][106226] Updated weights for policy 0, policy_version 484259 (0.0006) [2023-12-27 22:43:13,138][106225] Updated weights for policy 1, policy_version 485635 (0.0009) [2023-12-27 22:43:13,201][106225] Updated weights for policy 1, policy_version 485645 (0.0008) [2023-12-27 22:43:13,748][106226] Updated weights for policy 0, policy_version 484269 (0.0008) [2023-12-27 22:43:13,796][106226] Updated weights for policy 0, policy_version 484279 (0.0008) [2023-12-27 22:43:13,851][106226] Updated weights for policy 0, policy_version 484289 (0.0008) [2023-12-27 22:43:13,945][106225] Updated weights for policy 1, policy_version 485655 (0.0010) [2023-12-27 22:43:13,998][106225] Updated weights for policy 1, policy_version 485665 (0.0010) [2023-12-27 22:43:14,054][106225] Updated weights for policy 1, policy_version 485675 (0.0010) [2023-12-27 22:43:14,597][106226] Updated weights for policy 0, policy_version 484299 (0.0008) [2023-12-27 22:43:14,656][106226] Updated weights for policy 0, policy_version 484309 (0.0008) [2023-12-27 22:43:14,715][106226] Updated weights for policy 0, policy_version 484319 (0.0008) [2023-12-27 22:43:14,778][106225] Updated weights for policy 1, policy_version 485685 (0.0010) [2023-12-27 22:43:14,843][106225] Updated weights for policy 1, policy_version 485695 (0.0009) [2023-12-27 22:43:14,901][106225] Updated weights for policy 1, policy_version 485705 (0.0006) [2023-12-27 22:43:15,472][106226] Updated weights for policy 0, policy_version 484329 (0.0008) [2023-12-27 22:43:15,521][106226] Updated weights for policy 0, policy_version 484339 (0.0008) [2023-12-27 22:43:15,573][106226] Updated weights for policy 0, policy_version 484349 (0.0008) [2023-12-27 22:43:15,621][106225] Updated weights for policy 1, policy_version 485715 (0.0006) [2023-12-27 22:43:15,624][106226] Updated weights for policy 0, policy_version 484359 (0.0007) [2023-12-27 22:43:15,673][106225] Updated weights for policy 1, policy_version 485725 (0.0008) [2023-12-27 22:43:15,728][106225] Updated weights for policy 1, policy_version 485735 (0.0009) [2023-12-27 22:43:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.5, 300 sec: 19799.7). Total num frames: 248406016. Throughput: 0: 9892.9, 1: 10036.4. Samples: 248397312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:16,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-5.528')] [2023-12-27 22:43:16,377][106225] Updated weights for policy 1, policy_version 485745 (0.0008) [2023-12-27 22:43:16,398][106226] Updated weights for policy 0, policy_version 484369 (0.0007) [2023-12-27 22:43:16,440][106225] Updated weights for policy 1, policy_version 485755 (0.0006) [2023-12-27 22:43:16,446][106226] Updated weights for policy 0, policy_version 484379 (0.0008) [2023-12-27 22:43:16,503][106226] Updated weights for policy 0, policy_version 484389 (0.0007) [2023-12-27 22:43:16,509][106225] Updated weights for policy 1, policy_version 485765 (0.0006) [2023-12-27 22:43:16,561][106225] Updated weights for policy 1, policy_version 485775 (0.0008) [2023-12-27 22:43:17,130][106226] Updated weights for policy 0, policy_version 484399 (0.0005) [2023-12-27 22:43:17,183][106226] Updated weights for policy 0, policy_version 484409 (0.0005) [2023-12-27 22:43:17,241][106226] Updated weights for policy 0, policy_version 484419 (0.0005) [2023-12-27 22:43:17,331][106225] Updated weights for policy 1, policy_version 485785 (0.0009) [2023-12-27 22:43:17,387][106225] Updated weights for policy 1, policy_version 485795 (0.0008) [2023-12-27 22:43:17,432][106225] Updated weights for policy 1, policy_version 485805 (0.0008) [2023-12-27 22:43:17,871][106226] Updated weights for policy 0, policy_version 484429 (0.0007) [2023-12-27 22:43:17,930][106226] Updated weights for policy 0, policy_version 484439 (0.0009) [2023-12-27 22:43:17,988][106226] Updated weights for policy 0, policy_version 484449 (0.0008) [2023-12-27 22:43:18,154][106225] Updated weights for policy 1, policy_version 485815 (0.0008) [2023-12-27 22:43:18,208][106225] Updated weights for policy 1, policy_version 485825 (0.0009) [2023-12-27 22:43:18,267][106225] Updated weights for policy 1, policy_version 485835 (0.0009) [2023-12-27 22:43:18,648][106226] Updated weights for policy 0, policy_version 484459 (0.0008) [2023-12-27 22:43:18,708][106226] Updated weights for policy 0, policy_version 484469 (0.0009) [2023-12-27 22:43:18,772][106226] Updated weights for policy 0, policy_version 484479 (0.0009) [2023-12-27 22:43:19,032][106225] Updated weights for policy 1, policy_version 485845 (0.0008) [2023-12-27 22:43:19,088][106225] Updated weights for policy 1, policy_version 485855 (0.0008) [2023-12-27 22:43:19,140][106225] Updated weights for policy 1, policy_version 485865 (0.0008) [2023-12-27 22:43:19,511][106226] Updated weights for policy 0, policy_version 484489 (0.0009) [2023-12-27 22:43:19,569][106226] Updated weights for policy 0, policy_version 484499 (0.0011) [2023-12-27 22:43:19,632][106226] Updated weights for policy 0, policy_version 484509 (0.0011) [2023-12-27 22:43:19,702][106226] Updated weights for policy 0, policy_version 484519 (0.0010) [2023-12-27 22:43:19,955][106225] Updated weights for policy 1, policy_version 485875 (0.0008) [2023-12-27 22:43:20,018][106225] Updated weights for policy 1, policy_version 485885 (0.0008) [2023-12-27 22:43:20,080][106225] Updated weights for policy 1, policy_version 485895 (0.0006) [2023-12-27 22:43:20,391][106226] Updated weights for policy 0, policy_version 484529 (0.0010) [2023-12-27 22:43:20,444][106226] Updated weights for policy 0, policy_version 484539 (0.0008) [2023-12-27 22:43:20,496][106226] Updated weights for policy 0, policy_version 484549 (0.0008) [2023-12-27 22:43:20,810][106225] Updated weights for policy 1, policy_version 485905 (0.0007) [2023-12-27 22:43:20,886][106225] Updated weights for policy 1, policy_version 485915 (0.0008) [2023-12-27 22:43:20,938][106225] Updated weights for policy 1, policy_version 485925 (0.0007) [2023-12-27 22:43:20,996][106225] Updated weights for policy 1, policy_version 485935 (0.0008) [2023-12-27 22:43:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 248504320. Throughput: 0: 9892.4, 1: 9958.8. Samples: 248513396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:21,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-5.544')] [2023-12-27 22:43:21,309][106226] Updated weights for policy 0, policy_version 484559 (0.0008) [2023-12-27 22:43:21,374][106226] Updated weights for policy 0, policy_version 484569 (0.0008) [2023-12-27 22:43:21,440][106226] Updated weights for policy 0, policy_version 484579 (0.0008) [2023-12-27 22:43:21,759][106225] Updated weights for policy 1, policy_version 485945 (0.0009) [2023-12-27 22:43:21,813][106225] Updated weights for policy 1, policy_version 485955 (0.0009) [2023-12-27 22:43:21,874][106225] Updated weights for policy 1, policy_version 485965 (0.0009) [2023-12-27 22:43:22,263][106226] Updated weights for policy 0, policy_version 484589 (0.0009) [2023-12-27 22:43:22,328][106226] Updated weights for policy 0, policy_version 484599 (0.0010) [2023-12-27 22:43:22,397][106226] Updated weights for policy 0, policy_version 484609 (0.0006) [2023-12-27 22:43:22,663][106225] Updated weights for policy 1, policy_version 485975 (0.0010) [2023-12-27 22:43:22,731][106225] Updated weights for policy 1, policy_version 485985 (0.0010) [2023-12-27 22:43:22,797][106225] Updated weights for policy 1, policy_version 485995 (0.0010) [2023-12-27 22:43:23,082][106226] Updated weights for policy 0, policy_version 484619 (0.0007) [2023-12-27 22:43:23,140][106226] Updated weights for policy 0, policy_version 484629 (0.0011) [2023-12-27 22:43:23,200][106226] Updated weights for policy 0, policy_version 484639 (0.0010) [2023-12-27 22:43:23,500][106225] Updated weights for policy 1, policy_version 486005 (0.0010) [2023-12-27 22:43:23,562][106225] Updated weights for policy 1, policy_version 486015 (0.0010) [2023-12-27 22:43:23,614][106225] Updated weights for policy 1, policy_version 486025 (0.0010) [2023-12-27 22:43:23,885][106226] Updated weights for policy 0, policy_version 484649 (0.0010) [2023-12-27 22:43:23,936][106226] Updated weights for policy 0, policy_version 484659 (0.0009) [2023-12-27 22:43:23,986][106226] Updated weights for policy 0, policy_version 484669 (0.0008) [2023-12-27 22:43:24,041][106226] Updated weights for policy 0, policy_version 484679 (0.0009) [2023-12-27 22:43:24,265][106225] Updated weights for policy 1, policy_version 486035 (0.0009) [2023-12-27 22:43:24,315][106225] Updated weights for policy 1, policy_version 486045 (0.0008) [2023-12-27 22:43:24,361][106225] Updated weights for policy 1, policy_version 486055 (0.0007) [2023-12-27 22:43:24,777][106226] Updated weights for policy 0, policy_version 484689 (0.0008) [2023-12-27 22:43:24,846][106226] Updated weights for policy 0, policy_version 484699 (0.0007) [2023-12-27 22:43:24,906][106226] Updated weights for policy 0, policy_version 484709 (0.0006) [2023-12-27 22:43:25,100][106225] Updated weights for policy 1, policy_version 486065 (0.0008) [2023-12-27 22:43:25,161][106225] Updated weights for policy 1, policy_version 486075 (0.0008) [2023-12-27 22:43:25,211][106225] Updated weights for policy 1, policy_version 486085 (0.0006) [2023-12-27 22:43:25,267][106225] Updated weights for policy 1, policy_version 486095 (0.0006) [2023-12-27 22:43:25,515][106226] Updated weights for policy 0, policy_version 484719 (0.0010) [2023-12-27 22:43:25,563][106226] Updated weights for policy 0, policy_version 484729 (0.0008) [2023-12-27 22:43:25,609][106226] Updated weights for policy 0, policy_version 484739 (0.0008) [2023-12-27 22:43:25,865][106225] Updated weights for policy 1, policy_version 486105 (0.0010) [2023-12-27 22:43:25,925][106225] Updated weights for policy 1, policy_version 486115 (0.0010) [2023-12-27 22:43:25,985][106225] Updated weights for policy 1, policy_version 486125 (0.0008) [2023-12-27 22:43:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 248602624. Throughput: 0: 9836.8, 1: 9873.3. Samples: 248568064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:26,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-5.791')] [2023-12-27 22:43:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000486128_124477440.pth... [2023-12-27 22:43:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000484744_124125184.pth... [2023-12-27 22:43:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000484944_124174336.pth [2023-12-27 22:43:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000483624_123838464.pth [2023-12-27 22:43:26,335][106226] Updated weights for policy 0, policy_version 484749 (0.0006) [2023-12-27 22:43:26,398][106226] Updated weights for policy 0, policy_version 484759 (0.0009) [2023-12-27 22:43:26,455][106226] Updated weights for policy 0, policy_version 484769 (0.0009) [2023-12-27 22:43:26,541][106225] Updated weights for policy 1, policy_version 486135 (0.0005) [2023-12-27 22:43:26,596][106225] Updated weights for policy 1, policy_version 486145 (0.0006) [2023-12-27 22:43:26,645][106225] Updated weights for policy 1, policy_version 486155 (0.0010) [2023-12-27 22:43:26,988][106226] Updated weights for policy 0, policy_version 484779 (0.0006) [2023-12-27 22:43:27,041][106226] Updated weights for policy 0, policy_version 484789 (0.0005) [2023-12-27 22:43:27,093][106226] Updated weights for policy 0, policy_version 484799 (0.0005) [2023-12-27 22:43:27,307][106225] Updated weights for policy 1, policy_version 486165 (0.0006) [2023-12-27 22:43:27,370][106225] Updated weights for policy 1, policy_version 486175 (0.0008) [2023-12-27 22:43:27,428][106225] Updated weights for policy 1, policy_version 486185 (0.0007) [2023-12-27 22:43:27,767][106226] Updated weights for policy 0, policy_version 484809 (0.0008) [2023-12-27 22:43:27,824][106226] Updated weights for policy 0, policy_version 484819 (0.0010) [2023-12-27 22:43:27,876][106226] Updated weights for policy 0, policy_version 484829 (0.0010) [2023-12-27 22:43:27,928][106226] Updated weights for policy 0, policy_version 484839 (0.0010) [2023-12-27 22:43:28,131][106225] Updated weights for policy 1, policy_version 486195 (0.0008) [2023-12-27 22:43:28,188][106225] Updated weights for policy 1, policy_version 486205 (0.0010) [2023-12-27 22:43:28,231][106225] Updated weights for policy 1, policy_version 486215 (0.0010) [2023-12-27 22:43:28,645][106226] Updated weights for policy 0, policy_version 484849 (0.0009) [2023-12-27 22:43:28,706][106226] Updated weights for policy 0, policy_version 484859 (0.0007) [2023-12-27 22:43:28,771][106226] Updated weights for policy 0, policy_version 484869 (0.0008) [2023-12-27 22:43:28,982][106225] Updated weights for policy 1, policy_version 486225 (0.0010) [2023-12-27 22:43:29,038][106225] Updated weights for policy 1, policy_version 486235 (0.0010) [2023-12-27 22:43:29,090][106225] Updated weights for policy 1, policy_version 486245 (0.0010) [2023-12-27 22:43:29,151][106225] Updated weights for policy 1, policy_version 486255 (0.0010) [2023-12-27 22:43:29,492][106226] Updated weights for policy 0, policy_version 484879 (0.0008) [2023-12-27 22:43:29,557][106226] Updated weights for policy 0, policy_version 484889 (0.0008) [2023-12-27 22:43:29,619][106226] Updated weights for policy 0, policy_version 484899 (0.0009) [2023-12-27 22:43:29,870][106225] Updated weights for policy 1, policy_version 486265 (0.0015) [2023-12-27 22:43:29,928][106225] Updated weights for policy 1, policy_version 486275 (0.0013) [2023-12-27 22:43:29,993][106225] Updated weights for policy 1, policy_version 486285 (0.0010) [2023-12-27 22:43:30,400][106226] Updated weights for policy 0, policy_version 484909 (0.0007) [2023-12-27 22:43:30,463][106226] Updated weights for policy 0, policy_version 484919 (0.0008) [2023-12-27 22:43:30,522][106226] Updated weights for policy 0, policy_version 484929 (0.0008) [2023-12-27 22:43:30,738][106225] Updated weights for policy 1, policy_version 486295 (0.0010) [2023-12-27 22:43:30,797][106225] Updated weights for policy 1, policy_version 486305 (0.0010) [2023-12-27 22:43:30,857][106225] Updated weights for policy 1, policy_version 486315 (0.0010) [2023-12-27 22:43:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 248700928. Throughput: 0: 9893.4, 1: 9995.8. Samples: 248691408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:31,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-6.081')] [2023-12-27 22:43:31,233][106226] Updated weights for policy 0, policy_version 484939 (0.0007) [2023-12-27 22:43:31,290][106226] Updated weights for policy 0, policy_version 484949 (0.0009) [2023-12-27 22:43:31,350][106226] Updated weights for policy 0, policy_version 484959 (0.0008) [2023-12-27 22:43:31,612][106225] Updated weights for policy 1, policy_version 486325 (0.0009) [2023-12-27 22:43:31,677][106225] Updated weights for policy 1, policy_version 486335 (0.0011) [2023-12-27 22:43:31,742][106225] Updated weights for policy 1, policy_version 486345 (0.0011) [2023-12-27 22:43:32,104][106226] Updated weights for policy 0, policy_version 484969 (0.0007) [2023-12-27 22:43:32,173][106226] Updated weights for policy 0, policy_version 484979 (0.0008) [2023-12-27 22:43:32,240][106226] Updated weights for policy 0, policy_version 484989 (0.0008) [2023-12-27 22:43:32,306][106226] Updated weights for policy 0, policy_version 484999 (0.0008) [2023-12-27 22:43:32,482][106225] Updated weights for policy 1, policy_version 486355 (0.0010) [2023-12-27 22:43:32,536][106225] Updated weights for policy 1, policy_version 486365 (0.0008) [2023-12-27 22:43:32,587][106225] Updated weights for policy 1, policy_version 486375 (0.0008) [2023-12-27 22:43:32,986][106226] Updated weights for policy 0, policy_version 485009 (0.0007) [2023-12-27 22:43:33,036][106226] Updated weights for policy 0, policy_version 485019 (0.0007) [2023-12-27 22:43:33,085][106226] Updated weights for policy 0, policy_version 485029 (0.0007) [2023-12-27 22:43:33,277][106225] Updated weights for policy 1, policy_version 486385 (0.0007) [2023-12-27 22:43:33,330][106225] Updated weights for policy 1, policy_version 486395 (0.0005) [2023-12-27 22:43:33,388][106225] Updated weights for policy 1, policy_version 486405 (0.0005) [2023-12-27 22:43:33,442][106225] Updated weights for policy 1, policy_version 486415 (0.0006) [2023-12-27 22:43:33,837][106226] Updated weights for policy 0, policy_version 485039 (0.0008) [2023-12-27 22:43:33,886][106226] Updated weights for policy 0, policy_version 485049 (0.0008) [2023-12-27 22:43:33,942][106226] Updated weights for policy 0, policy_version 485059 (0.0008) [2023-12-27 22:43:34,080][106225] Updated weights for policy 1, policy_version 486425 (0.0008) [2023-12-27 22:43:34,134][106225] Updated weights for policy 1, policy_version 486435 (0.0008) [2023-12-27 22:43:34,194][106225] Updated weights for policy 1, policy_version 486445 (0.0008) [2023-12-27 22:43:34,683][106226] Updated weights for policy 0, policy_version 485069 (0.0008) [2023-12-27 22:43:34,743][106226] Updated weights for policy 0, policy_version 485079 (0.0008) [2023-12-27 22:43:34,793][106226] Updated weights for policy 0, policy_version 485089 (0.0009) [2023-12-27 22:43:34,881][106225] Updated weights for policy 1, policy_version 486455 (0.0006) [2023-12-27 22:43:34,940][106225] Updated weights for policy 1, policy_version 486465 (0.0005) [2023-12-27 22:43:35,004][106225] Updated weights for policy 1, policy_version 486475 (0.0005) [2023-12-27 22:43:35,536][106226] Updated weights for policy 0, policy_version 485099 (0.0009) [2023-12-27 22:43:35,588][106226] Updated weights for policy 0, policy_version 485109 (0.0010) [2023-12-27 22:43:35,629][106225] Updated weights for policy 1, policy_version 486485 (0.0005) [2023-12-27 22:43:35,648][106226] Updated weights for policy 0, policy_version 485119 (0.0011) [2023-12-27 22:43:35,680][106225] Updated weights for policy 1, policy_version 486495 (0.0007) [2023-12-27 22:43:35,733][106225] Updated weights for policy 1, policy_version 486505 (0.0008) [2023-12-27 22:43:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 248799232. Throughput: 0: 9838.9, 1: 9983.6. Samples: 248809000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:36,175][105115] Avg episode reward: [(0, '-4.866'), (1, '-6.084')] [2023-12-27 22:43:36,323][106226] Updated weights for policy 0, policy_version 485129 (0.0011) [2023-12-27 22:43:36,382][106226] Updated weights for policy 0, policy_version 485139 (0.0007) [2023-12-27 22:43:36,449][106226] Updated weights for policy 0, policy_version 485149 (0.0005) [2023-12-27 22:43:36,513][106225] Updated weights for policy 1, policy_version 486515 (0.0008) [2023-12-27 22:43:36,518][106226] Updated weights for policy 0, policy_version 485159 (0.0006) [2023-12-27 22:43:36,565][106225] Updated weights for policy 1, policy_version 486525 (0.0008) [2023-12-27 22:43:36,615][106225] Updated weights for policy 1, policy_version 486535 (0.0008) [2023-12-27 22:43:37,163][106226] Updated weights for policy 0, policy_version 485169 (0.0010) [2023-12-27 22:43:37,214][106226] Updated weights for policy 0, policy_version 485179 (0.0010) [2023-12-27 22:43:37,261][106225] Updated weights for policy 1, policy_version 486545 (0.0007) [2023-12-27 22:43:37,264][106226] Updated weights for policy 0, policy_version 485189 (0.0011) [2023-12-27 22:43:37,318][106225] Updated weights for policy 1, policy_version 486555 (0.0007) [2023-12-27 22:43:37,373][106225] Updated weights for policy 1, policy_version 486565 (0.0006) [2023-12-27 22:43:37,431][106225] Updated weights for policy 1, policy_version 486575 (0.0006) [2023-12-27 22:43:37,945][106226] Updated weights for policy 0, policy_version 485199 (0.0010) [2023-12-27 22:43:37,991][106226] Updated weights for policy 0, policy_version 485209 (0.0010) [2023-12-27 22:43:38,054][106226] Updated weights for policy 0, policy_version 485219 (0.0010) [2023-12-27 22:43:38,136][106225] Updated weights for policy 1, policy_version 486585 (0.0007) [2023-12-27 22:43:38,193][106225] Updated weights for policy 1, policy_version 486595 (0.0007) [2023-12-27 22:43:38,247][106225] Updated weights for policy 1, policy_version 486605 (0.0008) [2023-12-27 22:43:38,766][106226] Updated weights for policy 0, policy_version 485229 (0.0011) [2023-12-27 22:43:38,826][106226] Updated weights for policy 0, policy_version 485239 (0.0011) [2023-12-27 22:43:38,890][106226] Updated weights for policy 0, policy_version 485249 (0.0011) [2023-12-27 22:43:38,950][106225] Updated weights for policy 1, policy_version 486615 (0.0009) [2023-12-27 22:43:39,006][106225] Updated weights for policy 1, policy_version 486625 (0.0008) [2023-12-27 22:43:39,064][106225] Updated weights for policy 1, policy_version 486635 (0.0007) [2023-12-27 22:43:39,661][106226] Updated weights for policy 0, policy_version 485259 (0.0010) [2023-12-27 22:43:39,728][106226] Updated weights for policy 0, policy_version 485269 (0.0009) [2023-12-27 22:43:39,797][106226] Updated weights for policy 0, policy_version 485279 (0.0007) [2023-12-27 22:43:39,805][106225] Updated weights for policy 1, policy_version 486645 (0.0007) [2023-12-27 22:43:39,878][106225] Updated weights for policy 1, policy_version 486655 (0.0008) [2023-12-27 22:43:39,945][106225] Updated weights for policy 1, policy_version 486665 (0.0010) [2023-12-27 22:43:40,503][106226] Updated weights for policy 0, policy_version 485289 (0.0007) [2023-12-27 22:43:40,562][106226] Updated weights for policy 0, policy_version 485299 (0.0009) [2023-12-27 22:43:40,618][106226] Updated weights for policy 0, policy_version 485309 (0.0008) [2023-12-27 22:43:40,671][106226] Updated weights for policy 0, policy_version 485319 (0.0007) [2023-12-27 22:43:40,733][106225] Updated weights for policy 1, policy_version 486675 (0.0008) [2023-12-27 22:43:40,789][106225] Updated weights for policy 1, policy_version 486685 (0.0005) [2023-12-27 22:43:40,853][106225] Updated weights for policy 1, policy_version 486695 (0.0005) [2023-12-27 22:43:41,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 248897536. Throughput: 0: 9824.9, 1: 9974.1. Samples: 248869044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:41,175][105115] Avg episode reward: [(0, '-5.110'), (1, '-5.878')] [2023-12-27 22:43:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000486704_124624896.pth... [2023-12-27 22:43:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000485320_124272640.pth... [2023-12-27 22:43:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000485552_124329984.pth [2023-12-27 22:43:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000484200_123985920.pth [2023-12-27 22:43:41,388][106226] Updated weights for policy 0, policy_version 485329 (0.0008) [2023-12-27 22:43:41,454][106226] Updated weights for policy 0, policy_version 485339 (0.0008) [2023-12-27 22:43:41,513][106226] Updated weights for policy 0, policy_version 485349 (0.0008) [2023-12-27 22:43:41,617][106225] Updated weights for policy 1, policy_version 486705 (0.0006) [2023-12-27 22:43:41,685][106225] Updated weights for policy 1, policy_version 486715 (0.0008) [2023-12-27 22:43:41,755][106225] Updated weights for policy 1, policy_version 486725 (0.0009) [2023-12-27 22:43:41,817][106225] Updated weights for policy 1, policy_version 486735 (0.0009) [2023-12-27 22:43:42,313][106226] Updated weights for policy 0, policy_version 485359 (0.0008) [2023-12-27 22:43:42,387][106226] Updated weights for policy 0, policy_version 485372 (0.0008) [2023-12-27 22:43:42,451][106226] Updated weights for policy 0, policy_version 485382 (0.0007) [2023-12-27 22:43:42,568][106225] Updated weights for policy 1, policy_version 486745 (0.0008) [2023-12-27 22:43:42,623][106225] Updated weights for policy 1, policy_version 486755 (0.0008) [2023-12-27 22:43:42,684][106225] Updated weights for policy 1, policy_version 486765 (0.0008) [2023-12-27 22:43:43,113][106226] Updated weights for policy 0, policy_version 485392 (0.0006) [2023-12-27 22:43:43,176][106226] Updated weights for policy 0, policy_version 485402 (0.0008) [2023-12-27 22:43:43,236][106226] Updated weights for policy 0, policy_version 485412 (0.0011) [2023-12-27 22:43:43,450][106225] Updated weights for policy 1, policy_version 486775 (0.0008) [2023-12-27 22:43:43,492][106225] Updated weights for policy 1, policy_version 486785 (0.0007) [2023-12-27 22:43:43,538][106225] Updated weights for policy 1, policy_version 486795 (0.0007) [2023-12-27 22:43:43,918][106226] Updated weights for policy 0, policy_version 485422 (0.0011) [2023-12-27 22:43:43,972][106226] Updated weights for policy 0, policy_version 485432 (0.0010) [2023-12-27 22:43:44,028][106226] Updated weights for policy 0, policy_version 485442 (0.0011) [2023-12-27 22:43:44,302][106225] Updated weights for policy 1, policy_version 486805 (0.0008) [2023-12-27 22:43:44,365][106225] Updated weights for policy 1, policy_version 486815 (0.0008) [2023-12-27 22:43:44,426][106225] Updated weights for policy 1, policy_version 486825 (0.0008) [2023-12-27 22:43:44,726][106226] Updated weights for policy 0, policy_version 485452 (0.0008) [2023-12-27 22:43:44,811][106226] Updated weights for policy 0, policy_version 485462 (0.0006) [2023-12-27 22:43:44,870][106226] Updated weights for policy 0, policy_version 485472 (0.0010) [2023-12-27 22:43:45,148][106225] Updated weights for policy 1, policy_version 486835 (0.0007) [2023-12-27 22:43:45,209][106225] Updated weights for policy 1, policy_version 486845 (0.0009) [2023-12-27 22:43:45,262][106225] Updated weights for policy 1, policy_version 486855 (0.0009) [2023-12-27 22:43:45,574][106226] Updated weights for policy 0, policy_version 485482 (0.0011) [2023-12-27 22:43:45,624][106226] Updated weights for policy 0, policy_version 485492 (0.0010) [2023-12-27 22:43:45,671][106226] Updated weights for policy 0, policy_version 485502 (0.0010) [2023-12-27 22:43:45,724][106226] Updated weights for policy 0, policy_version 485512 (0.0010) [2023-12-27 22:43:45,952][106225] Updated weights for policy 1, policy_version 486865 (0.0009) [2023-12-27 22:43:46,002][106225] Updated weights for policy 1, policy_version 486875 (0.0008) [2023-12-27 22:43:46,048][106225] Updated weights for policy 1, policy_version 486885 (0.0008) [2023-12-27 22:43:46,099][106225] Updated weights for policy 1, policy_version 486895 (0.0008) [2023-12-27 22:43:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 248995840. Throughput: 0: 9779.6, 1: 9913.1. Samples: 248982988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:46,175][105115] Avg episode reward: [(0, '-5.132'), (1, '-5.597')] [2023-12-27 22:43:46,454][106226] Updated weights for policy 0, policy_version 485522 (0.0011) [2023-12-27 22:43:46,506][106226] Updated weights for policy 0, policy_version 485532 (0.0006) [2023-12-27 22:43:46,560][106226] Updated weights for policy 0, policy_version 485542 (0.0005) [2023-12-27 22:43:46,779][106225] Updated weights for policy 1, policy_version 486905 (0.0005) [2023-12-27 22:43:46,826][106225] Updated weights for policy 1, policy_version 486915 (0.0007) [2023-12-27 22:43:46,875][106225] Updated weights for policy 1, policy_version 486925 (0.0007) [2023-12-27 22:43:47,214][106226] Updated weights for policy 0, policy_version 485552 (0.0010) [2023-12-27 22:43:47,271][106226] Updated weights for policy 0, policy_version 485562 (0.0010) [2023-12-27 22:43:47,318][106226] Updated weights for policy 0, policy_version 485572 (0.0010) [2023-12-27 22:43:47,590][106225] Updated weights for policy 1, policy_version 486935 (0.0008) [2023-12-27 22:43:47,647][106225] Updated weights for policy 1, policy_version 486945 (0.0008) [2023-12-27 22:43:47,714][106225] Updated weights for policy 1, policy_version 486955 (0.0007) [2023-12-27 22:43:48,046][106226] Updated weights for policy 0, policy_version 485582 (0.0010) [2023-12-27 22:43:48,103][106226] Updated weights for policy 0, policy_version 485592 (0.0010) [2023-12-27 22:43:48,159][106226] Updated weights for policy 0, policy_version 485602 (0.0010) [2023-12-27 22:43:48,447][106225] Updated weights for policy 1, policy_version 486965 (0.0008) [2023-12-27 22:43:48,499][106225] Updated weights for policy 1, policy_version 486975 (0.0008) [2023-12-27 22:43:48,560][106225] Updated weights for policy 1, policy_version 486985 (0.0008) [2023-12-27 22:43:48,886][106226] Updated weights for policy 0, policy_version 485612 (0.0011) [2023-12-27 22:43:48,951][106226] Updated weights for policy 0, policy_version 485622 (0.0011) [2023-12-27 22:43:49,015][106226] Updated weights for policy 0, policy_version 485632 (0.0011) [2023-12-27 22:43:49,312][106225] Updated weights for policy 1, policy_version 486995 (0.0008) [2023-12-27 22:43:49,392][106225] Updated weights for policy 1, policy_version 487005 (0.0009) [2023-12-27 22:43:49,453][106225] Updated weights for policy 1, policy_version 487015 (0.0008) [2023-12-27 22:43:49,743][106226] Updated weights for policy 0, policy_version 485642 (0.0010) [2023-12-27 22:43:49,789][106226] Updated weights for policy 0, policy_version 485652 (0.0010) [2023-12-27 22:43:49,849][106226] Updated weights for policy 0, policy_version 485662 (0.0011) [2023-12-27 22:43:49,914][106226] Updated weights for policy 0, policy_version 485672 (0.0011) [2023-12-27 22:43:50,179][106225] Updated weights for policy 1, policy_version 487025 (0.0007) [2023-12-27 22:43:50,231][106225] Updated weights for policy 1, policy_version 487035 (0.0008) [2023-12-27 22:43:50,286][106225] Updated weights for policy 1, policy_version 487045 (0.0008) [2023-12-27 22:43:50,347][106225] Updated weights for policy 1, policy_version 487055 (0.0008) [2023-12-27 22:43:50,660][106226] Updated weights for policy 0, policy_version 485682 (0.0011) [2023-12-27 22:43:50,725][106226] Updated weights for policy 0, policy_version 485692 (0.0011) [2023-12-27 22:43:50,790][106226] Updated weights for policy 0, policy_version 485702 (0.0011) [2023-12-27 22:43:51,168][106225] Updated weights for policy 1, policy_version 487065 (0.0006) [2023-12-27 22:43:51,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 249085952. Throughput: 0: 9721.4, 1: 9682.0. Samples: 249098248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:51,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.708')] [2023-12-27 22:43:51,224][106225] Updated weights for policy 1, policy_version 487075 (0.0007) [2023-12-27 22:43:51,280][106225] Updated weights for policy 1, policy_version 487085 (0.0007) [2023-12-27 22:43:51,515][106226] Updated weights for policy 0, policy_version 485712 (0.0006) [2023-12-27 22:43:51,571][106226] Updated weights for policy 0, policy_version 485722 (0.0005) [2023-12-27 22:43:51,636][106226] Updated weights for policy 0, policy_version 485732 (0.0007) [2023-12-27 22:43:52,022][106225] Updated weights for policy 1, policy_version 487095 (0.0006) [2023-12-27 22:43:52,097][106225] Updated weights for policy 1, policy_version 487105 (0.0006) [2023-12-27 22:43:52,145][106225] Updated weights for policy 1, policy_version 487115 (0.0007) [2023-12-27 22:43:52,345][106226] Updated weights for policy 0, policy_version 485742 (0.0009) [2023-12-27 22:43:52,411][106226] Updated weights for policy 0, policy_version 485752 (0.0009) [2023-12-27 22:43:52,473][106226] Updated weights for policy 0, policy_version 485762 (0.0009) [2023-12-27 22:43:52,771][106225] Updated weights for policy 1, policy_version 487125 (0.0007) [2023-12-27 22:43:52,831][106225] Updated weights for policy 1, policy_version 487135 (0.0008) [2023-12-27 22:43:52,891][106225] Updated weights for policy 1, policy_version 487145 (0.0008) [2023-12-27 22:43:53,208][106226] Updated weights for policy 0, policy_version 485772 (0.0009) [2023-12-27 22:43:53,270][106226] Updated weights for policy 0, policy_version 485782 (0.0008) [2023-12-27 22:43:53,332][106226] Updated weights for policy 0, policy_version 485792 (0.0009) [2023-12-27 22:43:53,590][106225] Updated weights for policy 1, policy_version 487155 (0.0008) [2023-12-27 22:43:53,643][106225] Updated weights for policy 1, policy_version 487165 (0.0008) [2023-12-27 22:43:53,703][106225] Updated weights for policy 1, policy_version 487175 (0.0009) [2023-12-27 22:43:53,978][106226] Updated weights for policy 0, policy_version 485802 (0.0008) [2023-12-27 22:43:54,038][106226] Updated weights for policy 0, policy_version 485812 (0.0005) [2023-12-27 22:43:54,099][106226] Updated weights for policy 0, policy_version 485822 (0.0006) [2023-12-27 22:43:54,145][106226] Updated weights for policy 0, policy_version 485832 (0.0006) [2023-12-27 22:43:54,346][106225] Updated weights for policy 1, policy_version 487185 (0.0008) [2023-12-27 22:43:54,398][106225] Updated weights for policy 1, policy_version 487195 (0.0007) [2023-12-27 22:43:54,453][106225] Updated weights for policy 1, policy_version 487205 (0.0008) [2023-12-27 22:43:54,508][106225] Updated weights for policy 1, policy_version 487215 (0.0007) [2023-12-27 22:43:54,782][106226] Updated weights for policy 0, policy_version 485842 (0.0010) [2023-12-27 22:43:54,831][106226] Updated weights for policy 0, policy_version 485852 (0.0010) [2023-12-27 22:43:54,881][106226] Updated weights for policy 0, policy_version 485862 (0.0010) [2023-12-27 22:43:55,220][106225] Updated weights for policy 1, policy_version 487225 (0.0006) [2023-12-27 22:43:55,274][106225] Updated weights for policy 1, policy_version 487235 (0.0008) [2023-12-27 22:43:55,340][106225] Updated weights for policy 1, policy_version 487245 (0.0008) [2023-12-27 22:43:55,599][106226] Updated weights for policy 0, policy_version 485872 (0.0006) [2023-12-27 22:43:55,661][106226] Updated weights for policy 0, policy_version 485882 (0.0007) [2023-12-27 22:43:55,725][106226] Updated weights for policy 0, policy_version 485892 (0.0009) [2023-12-27 22:43:56,058][106225] Updated weights for policy 1, policy_version 487255 (0.0006) [2023-12-27 22:43:56,123][106225] Updated weights for policy 1, policy_version 487265 (0.0007) [2023-12-27 22:43:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 249184256. Throughput: 0: 9729.6, 1: 9669.4. Samples: 249157096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:43:56,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.586')] [2023-12-27 22:43:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000485896_124420096.pth... [2023-12-27 22:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000484744_124125184.pth [2023-12-27 22:43:56,187][106225] Updated weights for policy 1, policy_version 487275 (0.0008) [2023-12-27 22:43:56,223][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000487280_124772352.pth... [2023-12-27 22:43:56,228][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000486128_124477440.pth [2023-12-27 22:43:56,412][106226] Updated weights for policy 0, policy_version 485902 (0.0009) [2023-12-27 22:43:56,465][106226] Updated weights for policy 0, policy_version 485912 (0.0010) [2023-12-27 22:43:56,517][106226] Updated weights for policy 0, policy_version 485922 (0.0010) [2023-12-27 22:43:56,870][106225] Updated weights for policy 1, policy_version 487285 (0.0008) [2023-12-27 22:43:56,922][106225] Updated weights for policy 1, policy_version 487295 (0.0007) [2023-12-27 22:43:56,978][106225] Updated weights for policy 1, policy_version 487305 (0.0008) [2023-12-27 22:43:57,207][106226] Updated weights for policy 0, policy_version 485932 (0.0008) [2023-12-27 22:43:57,257][106226] Updated weights for policy 0, policy_version 485942 (0.0005) [2023-12-27 22:43:57,315][106226] Updated weights for policy 0, policy_version 485952 (0.0005) [2023-12-27 22:43:57,679][106225] Updated weights for policy 1, policy_version 487315 (0.0008) [2023-12-27 22:43:57,737][106225] Updated weights for policy 1, policy_version 487325 (0.0008) [2023-12-27 22:43:57,792][106225] Updated weights for policy 1, policy_version 487335 (0.0009) [2023-12-27 22:43:57,982][106226] Updated weights for policy 0, policy_version 485962 (0.0009) [2023-12-27 22:43:58,046][106226] Updated weights for policy 0, policy_version 485972 (0.0009) [2023-12-27 22:43:58,111][106226] Updated weights for policy 0, policy_version 485982 (0.0008) [2023-12-27 22:43:58,180][106226] Updated weights for policy 0, policy_version 485992 (0.0009) [2023-12-27 22:43:58,534][106225] Updated weights for policy 1, policy_version 487345 (0.0008) [2023-12-27 22:43:58,598][106225] Updated weights for policy 1, policy_version 487355 (0.0011) [2023-12-27 22:43:58,667][106225] Updated weights for policy 1, policy_version 487365 (0.0010) [2023-12-27 22:43:58,738][106225] Updated weights for policy 1, policy_version 487375 (0.0008) [2023-12-27 22:43:59,051][106226] Updated weights for policy 0, policy_version 486002 (0.0007) [2023-12-27 22:43:59,113][106226] Updated weights for policy 0, policy_version 486012 (0.0008) [2023-12-27 22:43:59,179][106226] Updated weights for policy 0, policy_version 486022 (0.0007) [2023-12-27 22:43:59,507][106225] Updated weights for policy 1, policy_version 487385 (0.0006) [2023-12-27 22:43:59,573][106225] Updated weights for policy 1, policy_version 487395 (0.0005) [2023-12-27 22:43:59,640][106225] Updated weights for policy 1, policy_version 487405 (0.0009) [2023-12-27 22:43:59,982][106226] Updated weights for policy 0, policy_version 486032 (0.0008) [2023-12-27 22:44:00,052][106226] Updated weights for policy 0, policy_version 486042 (0.0006) [2023-12-27 22:44:00,112][106226] Updated weights for policy 0, policy_version 486052 (0.0009) [2023-12-27 22:44:00,308][106225] Updated weights for policy 1, policy_version 487415 (0.0007) [2023-12-27 22:44:00,370][106225] Updated weights for policy 1, policy_version 487425 (0.0005) [2023-12-27 22:44:00,435][106225] Updated weights for policy 1, policy_version 487435 (0.0006) [2023-12-27 22:44:00,789][106226] Updated weights for policy 0, policy_version 486062 (0.0009) [2023-12-27 22:44:00,849][106226] Updated weights for policy 0, policy_version 486072 (0.0009) [2023-12-27 22:44:00,902][106226] Updated weights for policy 0, policy_version 486082 (0.0009) [2023-12-27 22:44:01,124][106225] Updated weights for policy 1, policy_version 487445 (0.0009) [2023-12-27 22:44:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 249282560. Throughput: 0: 9751.5, 1: 9716.1. Samples: 249273356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:01,175][105115] Avg episode reward: [(0, '-5.100'), (1, '-5.571')] [2023-12-27 22:44:01,190][106225] Updated weights for policy 1, policy_version 487455 (0.0008) [2023-12-27 22:44:01,260][106225] Updated weights for policy 1, policy_version 487465 (0.0007) [2023-12-27 22:44:01,687][106226] Updated weights for policy 0, policy_version 486092 (0.0008) [2023-12-27 22:44:01,753][106226] Updated weights for policy 0, policy_version 486102 (0.0009) [2023-12-27 22:44:01,811][106226] Updated weights for policy 0, policy_version 486112 (0.0008) [2023-12-27 22:44:01,896][106225] Updated weights for policy 1, policy_version 487475 (0.0008) [2023-12-27 22:44:01,959][106225] Updated weights for policy 1, policy_version 487485 (0.0009) [2023-12-27 22:44:02,020][106225] Updated weights for policy 1, policy_version 487495 (0.0008) [2023-12-27 22:44:02,593][106226] Updated weights for policy 0, policy_version 486122 (0.0008) [2023-12-27 22:44:02,646][106226] Updated weights for policy 0, policy_version 486132 (0.0005) [2023-12-27 22:44:02,697][106226] Updated weights for policy 0, policy_version 486142 (0.0005) [2023-12-27 22:44:02,752][106226] Updated weights for policy 0, policy_version 486152 (0.0007) [2023-12-27 22:44:02,815][106225] Updated weights for policy 1, policy_version 487505 (0.0008) [2023-12-27 22:44:02,875][106225] Updated weights for policy 1, policy_version 487515 (0.0010) [2023-12-27 22:44:02,932][106225] Updated weights for policy 1, policy_version 487525 (0.0007) [2023-12-27 22:44:02,992][106225] Updated weights for policy 1, policy_version 487535 (0.0005) [2023-12-27 22:44:03,478][106226] Updated weights for policy 0, policy_version 486162 (0.0005) [2023-12-27 22:44:03,544][106226] Updated weights for policy 0, policy_version 486172 (0.0005) [2023-12-27 22:44:03,565][106225] Updated weights for policy 1, policy_version 487545 (0.0005) [2023-12-27 22:44:03,590][106226] Updated weights for policy 0, policy_version 486182 (0.0005) [2023-12-27 22:44:03,616][106225] Updated weights for policy 1, policy_version 487555 (0.0005) [2023-12-27 22:44:03,677][106225] Updated weights for policy 1, policy_version 487565 (0.0009) [2023-12-27 22:44:04,248][106226] Updated weights for policy 0, policy_version 486192 (0.0007) [2023-12-27 22:44:04,253][106225] Updated weights for policy 1, policy_version 487575 (0.0007) [2023-12-27 22:44:04,307][106225] Updated weights for policy 1, policy_version 487585 (0.0007) [2023-12-27 22:44:04,313][106226] Updated weights for policy 0, policy_version 486202 (0.0007) [2023-12-27 22:44:04,365][106225] Updated weights for policy 1, policy_version 487595 (0.0008) [2023-12-27 22:44:04,371][106226] Updated weights for policy 0, policy_version 486212 (0.0006) [2023-12-27 22:44:05,023][106225] Updated weights for policy 1, policy_version 487605 (0.0010) [2023-12-27 22:44:05,076][106225] Updated weights for policy 1, policy_version 487615 (0.0010) [2023-12-27 22:44:05,129][106225] Updated weights for policy 1, policy_version 487625 (0.0010) [2023-12-27 22:44:05,131][106226] Updated weights for policy 0, policy_version 486222 (0.0005) [2023-12-27 22:44:05,190][106226] Updated weights for policy 0, policy_version 486232 (0.0007) [2023-12-27 22:44:05,243][106226] Updated weights for policy 0, policy_version 486242 (0.0008) [2023-12-27 22:44:05,820][106225] Updated weights for policy 1, policy_version 487635 (0.0010) [2023-12-27 22:44:05,873][106225] Updated weights for policy 1, policy_version 487645 (0.0010) [2023-12-27 22:44:05,923][106225] Updated weights for policy 1, policy_version 487655 (0.0010) [2023-12-27 22:44:05,977][106226] Updated weights for policy 0, policy_version 486252 (0.0007) [2023-12-27 22:44:06,030][106226] Updated weights for policy 0, policy_version 486262 (0.0007) [2023-12-27 22:44:06,084][106226] Updated weights for policy 0, policy_version 486272 (0.0009) [2023-12-27 22:44:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 249389056. Throughput: 0: 9704.9, 1: 9839.8. Samples: 249392908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:06,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-5.423')] [2023-12-27 22:44:06,707][106225] Updated weights for policy 1, policy_version 487665 (0.0010) [2023-12-27 22:44:06,754][106225] Updated weights for policy 1, policy_version 487675 (0.0009) [2023-12-27 22:44:06,808][106225] Updated weights for policy 1, policy_version 487685 (0.0007) [2023-12-27 22:44:06,817][106226] Updated weights for policy 0, policy_version 486282 (0.0008) [2023-12-27 22:44:06,859][106225] Updated weights for policy 1, policy_version 487695 (0.0010) [2023-12-27 22:44:06,872][106226] Updated weights for policy 0, policy_version 486292 (0.0006) [2023-12-27 22:44:06,933][106226] Updated weights for policy 0, policy_version 486302 (0.0008) [2023-12-27 22:44:06,994][106226] Updated weights for policy 0, policy_version 486312 (0.0008) [2023-12-27 22:44:07,537][106225] Updated weights for policy 1, policy_version 487705 (0.0006) [2023-12-27 22:44:07,583][106225] Updated weights for policy 1, policy_version 487715 (0.0009) [2023-12-27 22:44:07,630][106225] Updated weights for policy 1, policy_version 487725 (0.0010) [2023-12-27 22:44:07,753][106226] Updated weights for policy 0, policy_version 486322 (0.0008) [2023-12-27 22:44:07,812][106226] Updated weights for policy 0, policy_version 486332 (0.0008) [2023-12-27 22:44:07,863][106226] Updated weights for policy 0, policy_version 486342 (0.0008) [2023-12-27 22:44:08,249][106225] Updated weights for policy 1, policy_version 487735 (0.0007) [2023-12-27 22:44:08,305][106225] Updated weights for policy 1, policy_version 487745 (0.0005) [2023-12-27 22:44:08,403][106225] Updated weights for policy 1, policy_version 487755 (0.0006) [2023-12-27 22:44:08,539][106226] Updated weights for policy 0, policy_version 486352 (0.0006) [2023-12-27 22:44:08,600][106226] Updated weights for policy 0, policy_version 486362 (0.0007) [2023-12-27 22:44:08,656][106226] Updated weights for policy 0, policy_version 486372 (0.0006) [2023-12-27 22:44:09,059][106225] Updated weights for policy 1, policy_version 487765 (0.0006) [2023-12-27 22:44:09,110][106225] Updated weights for policy 1, policy_version 487775 (0.0005) [2023-12-27 22:44:09,160][106225] Updated weights for policy 1, policy_version 487785 (0.0005) [2023-12-27 22:44:09,372][106226] Updated weights for policy 0, policy_version 486382 (0.0007) [2023-12-27 22:44:09,438][106226] Updated weights for policy 0, policy_version 486392 (0.0009) [2023-12-27 22:44:09,497][106226] Updated weights for policy 0, policy_version 486402 (0.0008) [2023-12-27 22:44:09,872][106225] Updated weights for policy 1, policy_version 487795 (0.0006) [2023-12-27 22:44:09,942][106225] Updated weights for policy 1, policy_version 487805 (0.0009) [2023-12-27 22:44:10,009][106225] Updated weights for policy 1, policy_version 487815 (0.0008) [2023-12-27 22:44:10,267][106226] Updated weights for policy 0, policy_version 486412 (0.0008) [2023-12-27 22:44:10,325][106226] Updated weights for policy 0, policy_version 486422 (0.0008) [2023-12-27 22:44:10,385][106226] Updated weights for policy 0, policy_version 486432 (0.0009) [2023-12-27 22:44:10,734][106225] Updated weights for policy 1, policy_version 487825 (0.0007) [2023-12-27 22:44:10,790][106225] Updated weights for policy 1, policy_version 487835 (0.0009) [2023-12-27 22:44:10,851][106225] Updated weights for policy 1, policy_version 487845 (0.0008) [2023-12-27 22:44:10,910][106225] Updated weights for policy 1, policy_version 487855 (0.0009) [2023-12-27 22:44:11,069][106226] Updated weights for policy 0, policy_version 486442 (0.0008) [2023-12-27 22:44:11,130][106226] Updated weights for policy 0, policy_version 486452 (0.0009) [2023-12-27 22:44:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 249479168. Throughput: 0: 9746.3, 1: 9911.6. Samples: 249452672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:11,175][105115] Avg episode reward: [(0, '-5.397'), (1, '-5.766')] [2023-12-27 22:44:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000487856_124919808.pth... [2023-12-27 22:44:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000486704_124624896.pth [2023-12-27 22:44:11,200][106226] Updated weights for policy 0, policy_version 486462 (0.0011) [2023-12-27 22:44:11,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000486472_124567552.pth... [2023-12-27 22:44:11,267][106226] Updated weights for policy 0, policy_version 486472 (0.0011) [2023-12-27 22:44:11,270][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000485320_124272640.pth [2023-12-27 22:44:11,733][106225] Updated weights for policy 1, policy_version 487865 (0.0007) [2023-12-27 22:44:11,801][106225] Updated weights for policy 1, policy_version 487875 (0.0009) [2023-12-27 22:44:11,867][106225] Updated weights for policy 1, policy_version 487885 (0.0009) [2023-12-27 22:44:11,978][106226] Updated weights for policy 0, policy_version 486482 (0.0006) [2023-12-27 22:44:12,041][106226] Updated weights for policy 0, policy_version 486492 (0.0006) [2023-12-27 22:44:12,103][106226] Updated weights for policy 0, policy_version 486502 (0.0006) [2023-12-27 22:44:12,598][106225] Updated weights for policy 1, policy_version 487895 (0.0010) [2023-12-27 22:44:12,664][106225] Updated weights for policy 1, policy_version 487905 (0.0010) [2023-12-27 22:44:12,733][106225] Updated weights for policy 1, policy_version 487915 (0.0011) [2023-12-27 22:44:12,750][106226] Updated weights for policy 0, policy_version 486512 (0.0009) [2023-12-27 22:44:12,812][106226] Updated weights for policy 0, policy_version 486522 (0.0008) [2023-12-27 22:44:12,874][106226] Updated weights for policy 0, policy_version 486532 (0.0009) [2023-12-27 22:44:13,436][106225] Updated weights for policy 1, policy_version 487925 (0.0008) [2023-12-27 22:44:13,495][106225] Updated weights for policy 1, policy_version 487935 (0.0005) [2023-12-27 22:44:13,558][106225] Updated weights for policy 1, policy_version 487945 (0.0005) [2023-12-27 22:44:13,591][106226] Updated weights for policy 0, policy_version 486542 (0.0009) [2023-12-27 22:44:13,659][106226] Updated weights for policy 0, policy_version 486552 (0.0009) [2023-12-27 22:44:13,722][106226] Updated weights for policy 0, policy_version 486562 (0.0010) [2023-12-27 22:44:14,171][106225] Updated weights for policy 1, policy_version 487955 (0.0007) [2023-12-27 22:44:14,231][106225] Updated weights for policy 1, policy_version 487965 (0.0006) [2023-12-27 22:44:14,295][106225] Updated weights for policy 1, policy_version 487975 (0.0010) [2023-12-27 22:44:14,412][106226] Updated weights for policy 0, policy_version 486572 (0.0007) [2023-12-27 22:44:14,480][106226] Updated weights for policy 0, policy_version 486582 (0.0006) [2023-12-27 22:44:14,536][106226] Updated weights for policy 0, policy_version 486592 (0.0007) [2023-12-27 22:44:15,016][106225] Updated weights for policy 1, policy_version 487985 (0.0010) [2023-12-27 22:44:15,082][106225] Updated weights for policy 1, policy_version 487995 (0.0011) [2023-12-27 22:44:15,130][106225] Updated weights for policy 1, policy_version 488005 (0.0011) [2023-12-27 22:44:15,183][106225] Updated weights for policy 1, policy_version 488015 (0.0010) [2023-12-27 22:44:15,261][106226] Updated weights for policy 0, policy_version 486602 (0.0008) [2023-12-27 22:44:15,312][106226] Updated weights for policy 0, policy_version 486612 (0.0008) [2023-12-27 22:44:15,363][106226] Updated weights for policy 0, policy_version 486622 (0.0008) [2023-12-27 22:44:15,420][106226] Updated weights for policy 0, policy_version 486632 (0.0008) [2023-12-27 22:44:15,889][106225] Updated weights for policy 1, policy_version 488025 (0.0006) [2023-12-27 22:44:15,945][106225] Updated weights for policy 1, policy_version 488035 (0.0005) [2023-12-27 22:44:16,008][106225] Updated weights for policy 1, policy_version 488045 (0.0005) [2023-12-27 22:44:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 249577472. Throughput: 0: 9670.7, 1: 9803.3. Samples: 249567736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:16,176][105115] Avg episode reward: [(0, '-4.725'), (1, '-5.313')] [2023-12-27 22:44:16,202][106226] Updated weights for policy 0, policy_version 486642 (0.0008) [2023-12-27 22:44:16,258][106226] Updated weights for policy 0, policy_version 486652 (0.0008) [2023-12-27 22:44:16,307][106226] Updated weights for policy 0, policy_version 486662 (0.0008) [2023-12-27 22:44:16,655][106225] Updated weights for policy 1, policy_version 488055 (0.0007) [2023-12-27 22:44:16,710][106225] Updated weights for policy 1, policy_version 488065 (0.0010) [2023-12-27 22:44:16,768][106225] Updated weights for policy 1, policy_version 488075 (0.0010) [2023-12-27 22:44:17,031][106226] Updated weights for policy 0, policy_version 486672 (0.0009) [2023-12-27 22:44:17,105][106226] Updated weights for policy 0, policy_version 486682 (0.0010) [2023-12-27 22:44:17,162][106226] Updated weights for policy 0, policy_version 486692 (0.0007) [2023-12-27 22:44:17,313][106225] Updated weights for policy 1, policy_version 488085 (0.0007) [2023-12-27 22:44:17,374][106225] Updated weights for policy 1, policy_version 488095 (0.0010) [2023-12-27 22:44:17,430][106225] Updated weights for policy 1, policy_version 488105 (0.0010) [2023-12-27 22:44:17,823][106226] Updated weights for policy 0, policy_version 486702 (0.0010) [2023-12-27 22:44:17,879][106226] Updated weights for policy 0, policy_version 486712 (0.0010) [2023-12-27 22:44:17,933][106226] Updated weights for policy 0, policy_version 486722 (0.0010) [2023-12-27 22:44:18,117][106225] Updated weights for policy 1, policy_version 488115 (0.0010) [2023-12-27 22:44:18,163][106225] Updated weights for policy 1, policy_version 488125 (0.0010) [2023-12-27 22:44:18,209][106225] Updated weights for policy 1, policy_version 488135 (0.0010) [2023-12-27 22:44:18,657][106226] Updated weights for policy 0, policy_version 486732 (0.0010) [2023-12-27 22:44:18,708][106226] Updated weights for policy 0, policy_version 486742 (0.0008) [2023-12-27 22:44:18,760][106226] Updated weights for policy 0, policy_version 486752 (0.0008) [2023-12-27 22:44:18,970][106225] Updated weights for policy 1, policy_version 488145 (0.0010) [2023-12-27 22:44:19,032][106225] Updated weights for policy 1, policy_version 488155 (0.0010) [2023-12-27 22:44:19,091][106225] Updated weights for policy 1, policy_version 488165 (0.0008) [2023-12-27 22:44:19,147][106225] Updated weights for policy 1, policy_version 488175 (0.0005) [2023-12-27 22:44:19,526][106226] Updated weights for policy 0, policy_version 486762 (0.0010) [2023-12-27 22:44:19,591][106226] Updated weights for policy 0, policy_version 486772 (0.0006) [2023-12-27 22:44:19,647][106226] Updated weights for policy 0, policy_version 486782 (0.0006) [2023-12-27 22:44:19,708][106226] Updated weights for policy 0, policy_version 486792 (0.0008) [2023-12-27 22:44:19,878][106225] Updated weights for policy 1, policy_version 488185 (0.0010) [2023-12-27 22:44:19,940][106225] Updated weights for policy 1, policy_version 488195 (0.0010) [2023-12-27 22:44:19,994][106225] Updated weights for policy 1, policy_version 488205 (0.0010) [2023-12-27 22:44:20,429][106226] Updated weights for policy 0, policy_version 486802 (0.0006) [2023-12-27 22:44:20,498][106226] Updated weights for policy 0, policy_version 486812 (0.0006) [2023-12-27 22:44:20,564][106226] Updated weights for policy 0, policy_version 486822 (0.0008) [2023-12-27 22:44:20,727][106225] Updated weights for policy 1, policy_version 488215 (0.0009) [2023-12-27 22:44:20,796][106225] Updated weights for policy 1, policy_version 488225 (0.0009) [2023-12-27 22:44:20,864][106225] Updated weights for policy 1, policy_version 488235 (0.0008) [2023-12-27 22:44:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 249675776. Throughput: 0: 9660.2, 1: 9827.4. Samples: 249685940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:21,175][105115] Avg episode reward: [(0, '-5.096'), (1, '-5.731')] [2023-12-27 22:44:21,286][106226] Updated weights for policy 0, policy_version 486832 (0.0009) [2023-12-27 22:44:21,346][106226] Updated weights for policy 0, policy_version 486842 (0.0008) [2023-12-27 22:44:21,418][106226] Updated weights for policy 0, policy_version 486852 (0.0008) [2023-12-27 22:44:21,566][106225] Updated weights for policy 1, policy_version 488245 (0.0007) [2023-12-27 22:44:21,637][106225] Updated weights for policy 1, policy_version 488255 (0.0008) [2023-12-27 22:44:21,702][106225] Updated weights for policy 1, policy_version 488265 (0.0009) [2023-12-27 22:44:22,143][106226] Updated weights for policy 0, policy_version 486862 (0.0007) [2023-12-27 22:44:22,206][106226] Updated weights for policy 0, policy_version 486872 (0.0006) [2023-12-27 22:44:22,271][106226] Updated weights for policy 0, policy_version 486882 (0.0008) [2023-12-27 22:44:22,429][106225] Updated weights for policy 1, policy_version 488275 (0.0009) [2023-12-27 22:44:22,489][106225] Updated weights for policy 1, policy_version 488285 (0.0010) [2023-12-27 22:44:22,554][106225] Updated weights for policy 1, policy_version 488295 (0.0011) [2023-12-27 22:44:22,992][106226] Updated weights for policy 0, policy_version 486892 (0.0009) [2023-12-27 22:44:23,048][106226] Updated weights for policy 0, policy_version 486902 (0.0008) [2023-12-27 22:44:23,105][106226] Updated weights for policy 0, policy_version 486912 (0.0005) [2023-12-27 22:44:23,231][106225] Updated weights for policy 1, policy_version 488305 (0.0010) [2023-12-27 22:44:23,286][106225] Updated weights for policy 1, policy_version 488315 (0.0005) [2023-12-27 22:44:23,338][106225] Updated weights for policy 1, policy_version 488325 (0.0005) [2023-12-27 22:44:23,381][106225] Updated weights for policy 1, policy_version 488335 (0.0005) [2023-12-27 22:44:23,663][106226] Updated weights for policy 0, policy_version 486922 (0.0006) [2023-12-27 22:44:23,726][106226] Updated weights for policy 0, policy_version 486932 (0.0008) [2023-12-27 22:44:23,782][106226] Updated weights for policy 0, policy_version 486942 (0.0005) [2023-12-27 22:44:23,836][106226] Updated weights for policy 0, policy_version 486952 (0.0006) [2023-12-27 22:44:24,047][106225] Updated weights for policy 1, policy_version 488345 (0.0009) [2023-12-27 22:44:24,107][106225] Updated weights for policy 1, policy_version 488355 (0.0007) [2023-12-27 22:44:24,174][106225] Updated weights for policy 1, policy_version 488365 (0.0008) [2023-12-27 22:44:24,515][106226] Updated weights for policy 0, policy_version 486962 (0.0010) [2023-12-27 22:44:24,572][106226] Updated weights for policy 0, policy_version 486972 (0.0011) [2023-12-27 22:44:24,632][106226] Updated weights for policy 0, policy_version 486982 (0.0007) [2023-12-27 22:44:24,897][106225] Updated weights for policy 1, policy_version 488375 (0.0006) [2023-12-27 22:44:24,959][106225] Updated weights for policy 1, policy_version 488385 (0.0005) [2023-12-27 22:44:25,028][106225] Updated weights for policy 1, policy_version 488395 (0.0007) [2023-12-27 22:44:25,257][106226] Updated weights for policy 0, policy_version 486992 (0.0009) [2023-12-27 22:44:25,311][106226] Updated weights for policy 0, policy_version 487002 (0.0009) [2023-12-27 22:44:25,360][106226] Updated weights for policy 0, policy_version 487012 (0.0008) [2023-12-27 22:44:25,566][106225] Updated weights for policy 1, policy_version 488405 (0.0008) [2023-12-27 22:44:25,638][106225] Updated weights for policy 1, policy_version 488415 (0.0005) [2023-12-27 22:44:25,701][106225] Updated weights for policy 1, policy_version 488425 (0.0005) [2023-12-27 22:44:26,106][106226] Updated weights for policy 0, policy_version 487022 (0.0010) [2023-12-27 22:44:26,164][106226] Updated weights for policy 0, policy_version 487032 (0.0011) [2023-12-27 22:44:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 249774080. Throughput: 0: 9673.3, 1: 9815.8. Samples: 249746048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:26,175][105115] Avg episode reward: [(0, '-4.853'), (1, '-5.300')] [2023-12-27 22:44:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000488432_125067264.pth... [2023-12-27 22:44:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000487280_124772352.pth [2023-12-27 22:44:26,218][106226] Updated weights for policy 0, policy_version 487042 (0.0011) [2023-12-27 22:44:26,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000487048_124715008.pth... [2023-12-27 22:44:26,258][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000485896_124420096.pth [2023-12-27 22:44:26,300][106225] Updated weights for policy 1, policy_version 488435 (0.0005) [2023-12-27 22:44:26,357][106225] Updated weights for policy 1, policy_version 488445 (0.0010) [2023-12-27 22:44:26,420][106225] Updated weights for policy 1, policy_version 488455 (0.0007) [2023-12-27 22:44:26,833][106226] Updated weights for policy 0, policy_version 487052 (0.0009) [2023-12-27 22:44:26,890][106226] Updated weights for policy 0, policy_version 487062 (0.0011) [2023-12-27 22:44:26,952][106226] Updated weights for policy 0, policy_version 487072 (0.0010) [2023-12-27 22:44:27,052][106225] Updated weights for policy 1, policy_version 488465 (0.0011) [2023-12-27 22:44:27,100][106225] Updated weights for policy 1, policy_version 488475 (0.0010) [2023-12-27 22:44:27,150][106225] Updated weights for policy 1, policy_version 488485 (0.0010) [2023-12-27 22:44:27,204][106225] Updated weights for policy 1, policy_version 488495 (0.0010) [2023-12-27 22:44:27,621][106226] Updated weights for policy 0, policy_version 487082 (0.0010) [2023-12-27 22:44:27,674][106226] Updated weights for policy 0, policy_version 487092 (0.0010) [2023-12-27 22:44:27,743][106226] Updated weights for policy 0, policy_version 487102 (0.0010) [2023-12-27 22:44:27,807][106226] Updated weights for policy 0, policy_version 487112 (0.0010) [2023-12-27 22:44:27,942][106225] Updated weights for policy 1, policy_version 488505 (0.0010) [2023-12-27 22:44:27,989][106225] Updated weights for policy 1, policy_version 488515 (0.0010) [2023-12-27 22:44:28,049][106225] Updated weights for policy 1, policy_version 488525 (0.0010) [2023-12-27 22:44:28,522][106226] Updated weights for policy 0, policy_version 487122 (0.0011) [2023-12-27 22:44:28,579][106226] Updated weights for policy 0, policy_version 487132 (0.0010) [2023-12-27 22:44:28,635][106226] Updated weights for policy 0, policy_version 487142 (0.0010) [2023-12-27 22:44:28,700][106225] Updated weights for policy 1, policy_version 488535 (0.0010) [2023-12-27 22:44:28,756][106225] Updated weights for policy 1, policy_version 488545 (0.0010) [2023-12-27 22:44:28,821][106225] Updated weights for policy 1, policy_version 488555 (0.0010) [2023-12-27 22:44:29,373][106226] Updated weights for policy 0, policy_version 487152 (0.0009) [2023-12-27 22:44:29,439][106226] Updated weights for policy 0, policy_version 487162 (0.0008) [2023-12-27 22:44:29,499][106226] Updated weights for policy 0, policy_version 487172 (0.0008) [2023-12-27 22:44:29,521][106225] Updated weights for policy 1, policy_version 488565 (0.0010) [2023-12-27 22:44:29,582][106225] Updated weights for policy 1, policy_version 488575 (0.0010) [2023-12-27 22:44:29,642][106225] Updated weights for policy 1, policy_version 488585 (0.0010) [2023-12-27 22:44:30,268][106226] Updated weights for policy 0, policy_version 487182 (0.0009) [2023-12-27 22:44:30,303][106225] Updated weights for policy 1, policy_version 488595 (0.0009) [2023-12-27 22:44:30,329][106226] Updated weights for policy 0, policy_version 487192 (0.0008) [2023-12-27 22:44:30,362][106225] Updated weights for policy 1, policy_version 488605 (0.0007) [2023-12-27 22:44:30,387][106226] Updated weights for policy 0, policy_version 487202 (0.0006) [2023-12-27 22:44:30,418][106225] Updated weights for policy 1, policy_version 488615 (0.0006) [2023-12-27 22:44:31,041][106225] Updated weights for policy 1, policy_version 488625 (0.0008) [2023-12-27 22:44:31,106][106225] Updated weights for policy 1, policy_version 488635 (0.0009) [2023-12-27 22:44:31,174][106225] Updated weights for policy 1, policy_version 488645 (0.0009) [2023-12-27 22:44:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 249872384. Throughput: 0: 9703.8, 1: 9953.2. Samples: 249867556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:44:31,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.461')] [2023-12-27 22:44:31,187][106226] Updated weights for policy 0, policy_version 487212 (0.0007) [2023-12-27 22:44:31,237][106225] Updated weights for policy 1, policy_version 488655 (0.0007) [2023-12-27 22:44:31,244][106226] Updated weights for policy 0, policy_version 487222 (0.0006) [2023-12-27 22:44:31,308][106226] Updated weights for policy 0, policy_version 487232 (0.0008) [2023-12-27 22:44:32,005][106225] Updated weights for policy 1, policy_version 488665 (0.0009) [2023-12-27 22:44:32,057][106226] Updated weights for policy 0, policy_version 487242 (0.0008) [2023-12-27 22:44:32,059][106225] Updated weights for policy 1, policy_version 488675 (0.0008) [2023-12-27 22:44:32,111][106225] Updated weights for policy 1, policy_version 488685 (0.0006) [2023-12-27 22:44:32,112][106226] Updated weights for policy 0, policy_version 487252 (0.0008) [2023-12-27 22:44:32,160][106226] Updated weights for policy 0, policy_version 487262 (0.0008) [2023-12-27 22:44:32,832][106225] Updated weights for policy 1, policy_version 488695 (0.0006) [2023-12-27 22:44:32,861][106226] Updated weights for policy 0, policy_version 487273 (0.0010) [2023-12-27 22:44:32,889][106225] Updated weights for policy 1, policy_version 488705 (0.0007) [2023-12-27 22:44:32,923][106226] Updated weights for policy 0, policy_version 487283 (0.0011) [2023-12-27 22:44:32,945][106225] Updated weights for policy 1, policy_version 488715 (0.0006) [2023-12-27 22:44:32,979][106226] Updated weights for policy 0, policy_version 487293 (0.0010) [2023-12-27 22:44:33,039][106226] Updated weights for policy 0, policy_version 487303 (0.0010) [2023-12-27 22:44:33,623][106226] Updated weights for policy 0, policy_version 487313 (0.0006) [2023-12-27 22:44:33,629][106225] Updated weights for policy 1, policy_version 488725 (0.0006) [2023-12-27 22:44:33,676][106225] Updated weights for policy 1, policy_version 488735 (0.0006) [2023-12-27 22:44:33,682][106226] Updated weights for policy 0, policy_version 487323 (0.0005) [2023-12-27 22:44:33,739][106225] Updated weights for policy 1, policy_version 488745 (0.0005) [2023-12-27 22:44:33,740][106226] Updated weights for policy 0, policy_version 487333 (0.0005) [2023-12-27 22:44:34,291][106225] Updated weights for policy 1, policy_version 488755 (0.0006) [2023-12-27 22:44:34,353][106225] Updated weights for policy 1, policy_version 488765 (0.0006) [2023-12-27 22:44:34,379][106226] Updated weights for policy 0, policy_version 487343 (0.0006) [2023-12-27 22:44:34,410][106225] Updated weights for policy 1, policy_version 488775 (0.0006) [2023-12-27 22:44:34,434][106226] Updated weights for policy 0, policy_version 487353 (0.0006) [2023-12-27 22:44:34,492][106226] Updated weights for policy 0, policy_version 487363 (0.0007) [2023-12-27 22:44:35,023][106225] Updated weights for policy 1, policy_version 488785 (0.0007) [2023-12-27 22:44:35,086][106225] Updated weights for policy 1, policy_version 488795 (0.0010) [2023-12-27 22:44:35,137][106225] Updated weights for policy 1, policy_version 488805 (0.0010) [2023-12-27 22:44:35,190][106225] Updated weights for policy 1, policy_version 488815 (0.0010) [2023-12-27 22:44:35,207][106226] Updated weights for policy 0, policy_version 487373 (0.0010) [2023-12-27 22:44:35,263][106226] Updated weights for policy 0, policy_version 487383 (0.0006) [2023-12-27 22:44:35,322][106226] Updated weights for policy 0, policy_version 487393 (0.0005) [2023-12-27 22:44:35,890][106225] Updated weights for policy 1, policy_version 488825 (0.0006) [2023-12-27 22:44:35,954][106225] Updated weights for policy 1, policy_version 488835 (0.0006) [2023-12-27 22:44:35,959][106226] Updated weights for policy 0, policy_version 487403 (0.0007) [2023-12-27 22:44:36,008][106226] Updated weights for policy 0, policy_version 487413 (0.0009) [2023-12-27 22:44:36,018][106225] Updated weights for policy 1, policy_version 488845 (0.0006) [2023-12-27 22:44:36,061][106226] Updated weights for policy 0, policy_version 487423 (0.0005) [2023-12-27 22:44:36,175][105115] Fps is (10 sec: 21298.6, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 249987072. Throughput: 0: 9759.1, 1: 10055.5. Samples: 249989908. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:44:36,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.619')] [2023-12-27 22:44:36,673][106225] Updated weights for policy 1, policy_version 488855 (0.0008) [2023-12-27 22:44:36,731][106225] Updated weights for policy 1, policy_version 488865 (0.0007) [2023-12-27 22:44:36,789][106225] Updated weights for policy 1, policy_version 488875 (0.0009) [2023-12-27 22:44:36,800][106226] Updated weights for policy 0, policy_version 487433 (0.0009) [2023-12-27 22:44:36,864][106226] Updated weights for policy 0, policy_version 487443 (0.0006) [2023-12-27 22:44:36,926][106226] Updated weights for policy 0, policy_version 487453 (0.0009) [2023-12-27 22:44:36,981][106226] Updated weights for policy 0, policy_version 487463 (0.0008) [2023-12-27 22:44:37,491][106225] Updated weights for policy 1, policy_version 488885 (0.0008) [2023-12-27 22:44:37,552][106225] Updated weights for policy 1, policy_version 488895 (0.0010) [2023-12-27 22:44:37,603][106225] Updated weights for policy 1, policy_version 488905 (0.0010) [2023-12-27 22:44:37,673][106226] Updated weights for policy 0, policy_version 487473 (0.0010) [2023-12-27 22:44:37,731][106226] Updated weights for policy 0, policy_version 487483 (0.0010) [2023-12-27 22:44:37,792][106226] Updated weights for policy 0, policy_version 487493 (0.0009) [2023-12-27 22:44:38,235][106225] Updated weights for policy 1, policy_version 488915 (0.0006) [2023-12-27 22:44:38,286][106225] Updated weights for policy 1, policy_version 488925 (0.0005) [2023-12-27 22:44:38,344][106225] Updated weights for policy 1, policy_version 488935 (0.0007) [2023-12-27 22:44:38,638][106226] Updated weights for policy 0, policy_version 487503 (0.0008) [2023-12-27 22:44:38,699][106226] Updated weights for policy 0, policy_version 487513 (0.0009) [2023-12-27 22:44:38,755][106226] Updated weights for policy 0, policy_version 487523 (0.0008) [2023-12-27 22:44:38,972][106225] Updated weights for policy 1, policy_version 488945 (0.0006) [2023-12-27 22:44:39,032][106225] Updated weights for policy 1, policy_version 488955 (0.0006) [2023-12-27 22:44:39,104][106225] Updated weights for policy 1, policy_version 488965 (0.0009) [2023-12-27 22:44:39,153][106225] Updated weights for policy 1, policy_version 488975 (0.0008) [2023-12-27 22:44:39,508][106226] Updated weights for policy 0, policy_version 487533 (0.0008) [2023-12-27 22:44:39,571][106226] Updated weights for policy 0, policy_version 487543 (0.0009) [2023-12-27 22:44:39,622][106226] Updated weights for policy 0, policy_version 487553 (0.0009) [2023-12-27 22:44:39,881][106225] Updated weights for policy 1, policy_version 488985 (0.0010) [2023-12-27 22:44:39,943][106225] Updated weights for policy 1, policy_version 488995 (0.0008) [2023-12-27 22:44:40,007][106225] Updated weights for policy 1, policy_version 489005 (0.0009) [2023-12-27 22:44:40,397][106226] Updated weights for policy 0, policy_version 487563 (0.0008) [2023-12-27 22:44:40,461][106226] Updated weights for policy 0, policy_version 487573 (0.0009) [2023-12-27 22:44:40,526][106226] Updated weights for policy 0, policy_version 487583 (0.0009) [2023-12-27 22:44:40,728][106225] Updated weights for policy 1, policy_version 489015 (0.0006) [2023-12-27 22:44:40,795][106225] Updated weights for policy 1, policy_version 489025 (0.0008) [2023-12-27 22:44:40,849][106225] Updated weights for policy 1, policy_version 489035 (0.0008) [2023-12-27 22:44:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 250077184. Throughput: 0: 9721.3, 1: 10104.1. Samples: 250049240. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:44:41,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-5.632')] [2023-12-27 22:44:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000489040_125222912.pth... [2023-12-27 22:44:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000487592_124854272.pth... [2023-12-27 22:44:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000486472_124567552.pth [2023-12-27 22:44:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000487856_124919808.pth [2023-12-27 22:44:41,278][106226] Updated weights for policy 0, policy_version 487593 (0.0009) [2023-12-27 22:44:41,342][106226] Updated weights for policy 0, policy_version 487603 (0.0008) [2023-12-27 22:44:41,415][106226] Updated weights for policy 0, policy_version 487613 (0.0008) [2023-12-27 22:44:41,482][106226] Updated weights for policy 0, policy_version 487623 (0.0008) [2023-12-27 22:44:41,545][106225] Updated weights for policy 1, policy_version 489045 (0.0008) [2023-12-27 22:44:41,611][106225] Updated weights for policy 1, policy_version 489055 (0.0008) [2023-12-27 22:44:41,680][106225] Updated weights for policy 1, policy_version 489065 (0.0009) [2023-12-27 22:44:42,227][106226] Updated weights for policy 0, policy_version 487633 (0.0008) [2023-12-27 22:44:42,293][106226] Updated weights for policy 0, policy_version 487643 (0.0007) [2023-12-27 22:44:42,359][106226] Updated weights for policy 0, policy_version 487653 (0.0006) [2023-12-27 22:44:42,409][106225] Updated weights for policy 1, policy_version 489075 (0.0008) [2023-12-27 22:44:42,466][106225] Updated weights for policy 1, policy_version 489085 (0.0006) [2023-12-27 22:44:42,524][106225] Updated weights for policy 1, policy_version 489095 (0.0007) [2023-12-27 22:44:43,067][106226] Updated weights for policy 0, policy_version 487663 (0.0007) [2023-12-27 22:44:43,134][106226] Updated weights for policy 0, policy_version 487673 (0.0006) [2023-12-27 22:44:43,199][106226] Updated weights for policy 0, policy_version 487683 (0.0006) [2023-12-27 22:44:43,237][106225] Updated weights for policy 1, policy_version 489105 (0.0008) [2023-12-27 22:44:43,298][106225] Updated weights for policy 1, policy_version 489115 (0.0010) [2023-12-27 22:44:43,362][106225] Updated weights for policy 1, policy_version 489125 (0.0010) [2023-12-27 22:44:43,420][106225] Updated weights for policy 1, policy_version 489135 (0.0010) [2023-12-27 22:44:43,864][106226] Updated weights for policy 0, policy_version 487693 (0.0009) [2023-12-27 22:44:43,924][106226] Updated weights for policy 0, policy_version 487703 (0.0011) [2023-12-27 22:44:43,993][106226] Updated weights for policy 0, policy_version 487713 (0.0011) [2023-12-27 22:44:44,087][106225] Updated weights for policy 1, policy_version 489145 (0.0006) [2023-12-27 22:44:44,146][106225] Updated weights for policy 1, policy_version 489155 (0.0006) [2023-12-27 22:44:44,207][106225] Updated weights for policy 1, policy_version 489165 (0.0009) [2023-12-27 22:44:44,689][106226] Updated weights for policy 0, policy_version 487723 (0.0011) [2023-12-27 22:44:44,746][106226] Updated weights for policy 0, policy_version 487733 (0.0011) [2023-12-27 22:44:44,818][106226] Updated weights for policy 0, policy_version 487743 (0.0011) [2023-12-27 22:44:44,856][106225] Updated weights for policy 1, policy_version 489175 (0.0010) [2023-12-27 22:44:44,924][106225] Updated weights for policy 1, policy_version 489185 (0.0008) [2023-12-27 22:44:44,994][106225] Updated weights for policy 1, policy_version 489195 (0.0008) [2023-12-27 22:44:45,590][106226] Updated weights for policy 0, policy_version 487753 (0.0011) [2023-12-27 22:44:45,653][106226] Updated weights for policy 0, policy_version 487763 (0.0011) [2023-12-27 22:44:45,692][106225] Updated weights for policy 1, policy_version 489205 (0.0010) [2023-12-27 22:44:45,713][106226] Updated weights for policy 0, policy_version 487773 (0.0007) [2023-12-27 22:44:45,757][106225] Updated weights for policy 1, policy_version 489215 (0.0008) [2023-12-27 22:44:45,766][106226] Updated weights for policy 0, policy_version 487783 (0.0005) [2023-12-27 22:44:45,818][106225] Updated weights for policy 1, policy_version 489225 (0.0009) [2023-12-27 22:44:46,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 250175488. Throughput: 0: 9689.0, 1: 10103.8. Samples: 250164032. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:44:46,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.616')] [2023-12-27 22:44:46,329][106226] Updated weights for policy 0, policy_version 487793 (0.0006) [2023-12-27 22:44:46,388][106226] Updated weights for policy 0, policy_version 487803 (0.0005) [2023-12-27 22:44:46,436][106226] Updated weights for policy 0, policy_version 487813 (0.0005) [2023-12-27 22:44:46,635][106225] Updated weights for policy 1, policy_version 489235 (0.0008) [2023-12-27 22:44:46,701][106225] Updated weights for policy 1, policy_version 489245 (0.0008) [2023-12-27 22:44:46,755][106225] Updated weights for policy 1, policy_version 489255 (0.0008) [2023-12-27 22:44:47,043][106226] Updated weights for policy 0, policy_version 487823 (0.0007) [2023-12-27 22:44:47,097][106226] Updated weights for policy 0, policy_version 487833 (0.0008) [2023-12-27 22:44:47,160][106226] Updated weights for policy 0, policy_version 487843 (0.0008) [2023-12-27 22:44:47,499][106225] Updated weights for policy 1, policy_version 489265 (0.0008) [2023-12-27 22:44:47,549][106225] Updated weights for policy 1, policy_version 489275 (0.0010) [2023-12-27 22:44:47,601][106225] Updated weights for policy 1, policy_version 489285 (0.0010) [2023-12-27 22:44:47,657][106225] Updated weights for policy 1, policy_version 489295 (0.0010) [2023-12-27 22:44:47,856][106226] Updated weights for policy 0, policy_version 487853 (0.0007) [2023-12-27 22:44:47,924][106226] Updated weights for policy 0, policy_version 487863 (0.0005) [2023-12-27 22:44:47,987][106226] Updated weights for policy 0, policy_version 487873 (0.0005) [2023-12-27 22:44:48,308][106225] Updated weights for policy 1, policy_version 489305 (0.0006) [2023-12-27 22:44:48,391][106225] Updated weights for policy 1, policy_version 489318 (0.0008) [2023-12-27 22:44:48,450][106225] Updated weights for policy 1, policy_version 489328 (0.0006) [2023-12-27 22:44:48,536][106226] Updated weights for policy 0, policy_version 487883 (0.0006) [2023-12-27 22:44:48,593][106226] Updated weights for policy 0, policy_version 487893 (0.0009) [2023-12-27 22:44:48,642][106226] Updated weights for policy 0, policy_version 487903 (0.0009) [2023-12-27 22:44:49,129][106225] Updated weights for policy 1, policy_version 489338 (0.0008) [2023-12-27 22:44:49,180][106225] Updated weights for policy 1, policy_version 489348 (0.0008) [2023-12-27 22:44:49,244][106225] Updated weights for policy 1, policy_version 489358 (0.0013) [2023-12-27 22:44:49,357][106226] Updated weights for policy 0, policy_version 487913 (0.0008) [2023-12-27 22:44:49,424][106226] Updated weights for policy 0, policy_version 487923 (0.0010) [2023-12-27 22:44:49,475][106226] Updated weights for policy 0, policy_version 487933 (0.0010) [2023-12-27 22:44:49,526][106226] Updated weights for policy 0, policy_version 487943 (0.0010) [2023-12-27 22:44:50,030][106225] Updated weights for policy 1, policy_version 489368 (0.0006) [2023-12-27 22:44:50,092][106225] Updated weights for policy 1, policy_version 489378 (0.0007) [2023-12-27 22:44:50,151][106225] Updated weights for policy 1, policy_version 489388 (0.0010) [2023-12-27 22:44:50,297][106226] Updated weights for policy 0, policy_version 487953 (0.0011) [2023-12-27 22:44:50,367][106226] Updated weights for policy 0, policy_version 487963 (0.0011) [2023-12-27 22:44:50,434][106226] Updated weights for policy 0, policy_version 487973 (0.0010) [2023-12-27 22:44:50,775][106225] Updated weights for policy 1, policy_version 489398 (0.0008) [2023-12-27 22:44:50,830][106225] Updated weights for policy 1, policy_version 489408 (0.0005) [2023-12-27 22:44:50,889][106225] Updated weights for policy 1, policy_version 489418 (0.0005) [2023-12-27 22:44:51,175][106226] Updated weights for policy 0, policy_version 487983 (0.0009) [2023-12-27 22:44:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 250273792. Throughput: 0: 9792.6, 1: 10005.5. Samples: 250283824. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:44:51,175][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.711')] [2023-12-27 22:44:51,237][106226] Updated weights for policy 0, policy_version 487993 (0.0008) [2023-12-27 22:44:51,295][106226] Updated weights for policy 0, policy_version 488003 (0.0008) [2023-12-27 22:44:51,581][106225] Updated weights for policy 1, policy_version 489428 (0.0008) [2023-12-27 22:44:51,640][106225] Updated weights for policy 1, policy_version 489438 (0.0011) [2023-12-27 22:44:51,703][106225] Updated weights for policy 1, policy_version 489448 (0.0006) [2023-12-27 22:44:52,033][106226] Updated weights for policy 0, policy_version 488013 (0.0009) [2023-12-27 22:44:52,094][106226] Updated weights for policy 0, policy_version 488023 (0.0010) [2023-12-27 22:44:52,158][106226] Updated weights for policy 0, policy_version 488033 (0.0010) [2023-12-27 22:44:52,389][106225] Updated weights for policy 1, policy_version 489458 (0.0008) [2023-12-27 22:44:52,440][106225] Updated weights for policy 1, policy_version 489468 (0.0009) [2023-12-27 22:44:52,499][106225] Updated weights for policy 1, policy_version 489478 (0.0008) [2023-12-27 22:44:52,563][106225] Updated weights for policy 1, policy_version 489488 (0.0008) [2023-12-27 22:44:52,880][106226] Updated weights for policy 0, policy_version 488043 (0.0010) [2023-12-27 22:44:52,946][106226] Updated weights for policy 0, policy_version 488053 (0.0006) [2023-12-27 22:44:52,994][106226] Updated weights for policy 0, policy_version 488063 (0.0009) [2023-12-27 22:44:53,258][106225] Updated weights for policy 1, policy_version 489498 (0.0009) [2023-12-27 22:44:53,318][106225] Updated weights for policy 1, policy_version 489508 (0.0008) [2023-12-27 22:44:53,371][106225] Updated weights for policy 1, policy_version 489518 (0.0005) [2023-12-27 22:44:53,668][106226] Updated weights for policy 0, policy_version 488073 (0.0010) [2023-12-27 22:44:53,729][106226] Updated weights for policy 0, policy_version 488083 (0.0008) [2023-12-27 22:44:53,783][106226] Updated weights for policy 0, policy_version 488093 (0.0007) [2023-12-27 22:44:53,840][106226] Updated weights for policy 0, policy_version 488103 (0.0005) [2023-12-27 22:44:54,002][106225] Updated weights for policy 1, policy_version 489528 (0.0007) [2023-12-27 22:44:54,055][106225] Updated weights for policy 1, policy_version 489538 (0.0008) [2023-12-27 22:44:54,114][106225] Updated weights for policy 1, policy_version 489548 (0.0006) [2023-12-27 22:44:54,388][106226] Updated weights for policy 0, policy_version 488113 (0.0005) [2023-12-27 22:44:54,447][106226] Updated weights for policy 0, policy_version 488123 (0.0005) [2023-12-27 22:44:54,512][106226] Updated weights for policy 0, policy_version 488133 (0.0005) [2023-12-27 22:44:54,811][106225] Updated weights for policy 1, policy_version 489558 (0.0008) [2023-12-27 22:44:54,862][106225] Updated weights for policy 1, policy_version 489568 (0.0006) [2023-12-27 22:44:54,908][106225] Updated weights for policy 1, policy_version 489578 (0.0008) [2023-12-27 22:44:55,099][106226] Updated weights for policy 0, policy_version 488143 (0.0009) [2023-12-27 22:44:55,153][106226] Updated weights for policy 0, policy_version 488153 (0.0010) [2023-12-27 22:44:55,203][106226] Updated weights for policy 0, policy_version 488163 (0.0010) [2023-12-27 22:44:55,647][106225] Updated weights for policy 1, policy_version 489588 (0.0008) [2023-12-27 22:44:55,699][106225] Updated weights for policy 1, policy_version 489598 (0.0007) [2023-12-27 22:44:55,745][106225] Updated weights for policy 1, policy_version 489608 (0.0008) [2023-12-27 22:44:55,915][106226] Updated weights for policy 0, policy_version 488173 (0.0010) [2023-12-27 22:44:55,965][106226] Updated weights for policy 0, policy_version 488183 (0.0010) [2023-12-27 22:44:56,012][106226] Updated weights for policy 0, policy_version 488193 (0.0010) [2023-12-27 22:44:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 250380288. Throughput: 0: 9798.3, 1: 10012.4. Samples: 250344152. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:44:56,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.702')] [2023-12-27 22:44:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000489616_125370368.pth... [2023-12-27 22:44:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000488200_125009920.pth... [2023-12-27 22:44:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000488432_125067264.pth [2023-12-27 22:44:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000487048_124715008.pth [2023-12-27 22:44:56,464][106225] Updated weights for policy 1, policy_version 489618 (0.0007) [2023-12-27 22:44:56,518][106225] Updated weights for policy 1, policy_version 489628 (0.0008) [2023-12-27 22:44:56,563][106225] Updated weights for policy 1, policy_version 489638 (0.0006) [2023-12-27 22:44:56,610][106225] Updated weights for policy 1, policy_version 489648 (0.0007) [2023-12-27 22:44:56,728][106226] Updated weights for policy 0, policy_version 488203 (0.0011) [2023-12-27 22:44:56,785][106226] Updated weights for policy 0, policy_version 488213 (0.0010) [2023-12-27 22:44:56,845][106226] Updated weights for policy 0, policy_version 488223 (0.0009) [2023-12-27 22:44:57,356][106225] Updated weights for policy 1, policy_version 489658 (0.0006) [2023-12-27 22:44:57,401][106225] Updated weights for policy 1, policy_version 489668 (0.0008) [2023-12-27 22:44:57,461][106225] Updated weights for policy 1, policy_version 489678 (0.0007) [2023-12-27 22:44:57,549][106226] Updated weights for policy 0, policy_version 488233 (0.0010) [2023-12-27 22:44:57,607][106226] Updated weights for policy 0, policy_version 488243 (0.0010) [2023-12-27 22:44:57,667][106226] Updated weights for policy 0, policy_version 488253 (0.0011) [2023-12-27 22:44:57,719][106226] Updated weights for policy 0, policy_version 488263 (0.0010) [2023-12-27 22:44:58,195][106225] Updated weights for policy 1, policy_version 489688 (0.0008) [2023-12-27 22:44:58,262][106225] Updated weights for policy 1, policy_version 489698 (0.0008) [2023-12-27 22:44:58,326][106225] Updated weights for policy 1, policy_version 489708 (0.0008) [2023-12-27 22:44:58,449][106226] Updated weights for policy 0, policy_version 488273 (0.0007) [2023-12-27 22:44:58,517][106226] Updated weights for policy 0, policy_version 488283 (0.0008) [2023-12-27 22:44:58,589][106226] Updated weights for policy 0, policy_version 488293 (0.0008) [2023-12-27 22:44:59,110][106225] Updated weights for policy 1, policy_version 489718 (0.0008) [2023-12-27 22:44:59,168][106225] Updated weights for policy 1, policy_version 489728 (0.0007) [2023-12-27 22:44:59,231][106225] Updated weights for policy 1, policy_version 489738 (0.0008) [2023-12-27 22:44:59,389][106226] Updated weights for policy 0, policy_version 488303 (0.0008) [2023-12-27 22:44:59,455][106226] Updated weights for policy 0, policy_version 488313 (0.0007) [2023-12-27 22:44:59,505][106226] Updated weights for policy 0, policy_version 488323 (0.0008) [2023-12-27 22:45:00,013][106225] Updated weights for policy 1, policy_version 489748 (0.0008) [2023-12-27 22:45:00,070][106225] Updated weights for policy 1, policy_version 489758 (0.0005) [2023-12-27 22:45:00,128][106225] Updated weights for policy 1, policy_version 489768 (0.0006) [2023-12-27 22:45:00,255][106226] Updated weights for policy 0, policy_version 488333 (0.0010) [2023-12-27 22:45:00,324][106226] Updated weights for policy 0, policy_version 488343 (0.0011) [2023-12-27 22:45:00,380][106226] Updated weights for policy 0, policy_version 488353 (0.0010) [2023-12-27 22:45:00,770][106225] Updated weights for policy 1, policy_version 489778 (0.0006) [2023-12-27 22:45:00,830][106225] Updated weights for policy 1, policy_version 489788 (0.0007) [2023-12-27 22:45:00,883][106225] Updated weights for policy 1, policy_version 489798 (0.0007) [2023-12-27 22:45:00,932][106225] Updated weights for policy 1, policy_version 489808 (0.0008) [2023-12-27 22:45:01,066][106226] Updated weights for policy 0, policy_version 488363 (0.0009) [2023-12-27 22:45:01,137][106226] Updated weights for policy 0, policy_version 488373 (0.0009) [2023-12-27 22:45:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 250470400. Throughput: 0: 9837.9, 1: 10023.3. Samples: 250461488. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:01,175][105115] Avg episode reward: [(0, '-5.032'), (1, '-5.906')] [2023-12-27 22:45:01,204][106226] Updated weights for policy 0, policy_version 488383 (0.0009) [2023-12-27 22:45:01,753][106225] Updated weights for policy 1, policy_version 489818 (0.0007) [2023-12-27 22:45:01,815][106225] Updated weights for policy 1, policy_version 489828 (0.0008) [2023-12-27 22:45:01,876][106225] Updated weights for policy 1, policy_version 489838 (0.0006) [2023-12-27 22:45:01,919][106226] Updated weights for policy 0, policy_version 488393 (0.0008) [2023-12-27 22:45:01,990][106226] Updated weights for policy 0, policy_version 488403 (0.0009) [2023-12-27 22:45:02,053][106226] Updated weights for policy 0, policy_version 488413 (0.0008) [2023-12-27 22:45:02,112][106226] Updated weights for policy 0, policy_version 488423 (0.0009) [2023-12-27 22:45:02,547][106225] Updated weights for policy 1, policy_version 489848 (0.0007) [2023-12-27 22:45:02,602][106225] Updated weights for policy 1, policy_version 489858 (0.0009) [2023-12-27 22:45:02,658][106225] Updated weights for policy 1, policy_version 489868 (0.0008) [2023-12-27 22:45:02,850][106226] Updated weights for policy 0, policy_version 488433 (0.0006) [2023-12-27 22:45:02,917][106226] Updated weights for policy 0, policy_version 488443 (0.0005) [2023-12-27 22:45:02,975][106226] Updated weights for policy 0, policy_version 488453 (0.0005) [2023-12-27 22:45:03,425][106225] Updated weights for policy 1, policy_version 489878 (0.0009) [2023-12-27 22:45:03,482][106225] Updated weights for policy 1, policy_version 489888 (0.0007) [2023-12-27 22:45:03,533][106225] Updated weights for policy 1, policy_version 489898 (0.0007) [2023-12-27 22:45:03,542][106226] Updated weights for policy 0, policy_version 488463 (0.0007) [2023-12-27 22:45:03,594][106226] Updated weights for policy 0, policy_version 488473 (0.0008) [2023-12-27 22:45:03,642][106226] Updated weights for policy 0, policy_version 488483 (0.0008) [2023-12-27 22:45:04,297][106225] Updated weights for policy 1, policy_version 489908 (0.0007) [2023-12-27 22:45:04,359][106225] Updated weights for policy 1, policy_version 489918 (0.0008) [2023-12-27 22:45:04,389][106226] Updated weights for policy 0, policy_version 488493 (0.0008) [2023-12-27 22:45:04,422][106225] Updated weights for policy 1, policy_version 489928 (0.0007) [2023-12-27 22:45:04,448][106226] Updated weights for policy 0, policy_version 488503 (0.0006) [2023-12-27 22:45:04,506][106226] Updated weights for policy 0, policy_version 488513 (0.0007) [2023-12-27 22:45:05,117][106225] Updated weights for policy 1, policy_version 489938 (0.0009) [2023-12-27 22:45:05,169][106225] Updated weights for policy 1, policy_version 489948 (0.0008) [2023-12-27 22:45:05,221][106225] Updated weights for policy 1, policy_version 489958 (0.0010) [2023-12-27 22:45:05,249][106226] Updated weights for policy 0, policy_version 488523 (0.0009) [2023-12-27 22:45:05,268][106225] Updated weights for policy 1, policy_version 489968 (0.0010) [2023-12-27 22:45:05,299][106226] Updated weights for policy 0, policy_version 488533 (0.0007) [2023-12-27 22:45:05,349][106226] Updated weights for policy 0, policy_version 488543 (0.0008) [2023-12-27 22:45:05,864][106225] Updated weights for policy 1, policy_version 489978 (0.0006) [2023-12-27 22:45:05,912][106225] Updated weights for policy 1, policy_version 489988 (0.0005) [2023-12-27 22:45:05,967][106225] Updated weights for policy 1, policy_version 489998 (0.0005) [2023-12-27 22:45:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 250568704. Throughput: 0: 9844.9, 1: 9983.0. Samples: 250578200. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:06,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.710')] [2023-12-27 22:45:06,196][106226] Updated weights for policy 0, policy_version 488553 (0.0007) [2023-12-27 22:45:06,259][106226] Updated weights for policy 0, policy_version 488563 (0.0009) [2023-12-27 22:45:06,309][106226] Updated weights for policy 0, policy_version 488573 (0.0007) [2023-12-27 22:45:06,361][106226] Updated weights for policy 0, policy_version 488583 (0.0008) [2023-12-27 22:45:06,604][106225] Updated weights for policy 1, policy_version 490008 (0.0008) [2023-12-27 22:45:06,661][106225] Updated weights for policy 1, policy_version 490018 (0.0009) [2023-12-27 22:45:06,720][106225] Updated weights for policy 1, policy_version 490028 (0.0006) [2023-12-27 22:45:07,080][106226] Updated weights for policy 0, policy_version 488593 (0.0006) [2023-12-27 22:45:07,140][106226] Updated weights for policy 0, policy_version 488603 (0.0006) [2023-12-27 22:45:07,203][106226] Updated weights for policy 0, policy_version 488613 (0.0009) [2023-12-27 22:45:07,391][106225] Updated weights for policy 1, policy_version 490038 (0.0005) [2023-12-27 22:45:07,448][106225] Updated weights for policy 1, policy_version 490048 (0.0005) [2023-12-27 22:45:07,496][106225] Updated weights for policy 1, policy_version 490058 (0.0005) [2023-12-27 22:45:07,806][106226] Updated weights for policy 0, policy_version 488623 (0.0011) [2023-12-27 22:45:07,859][106226] Updated weights for policy 0, policy_version 488633 (0.0010) [2023-12-27 22:45:07,902][106226] Updated weights for policy 0, policy_version 488643 (0.0010) [2023-12-27 22:45:08,112][106225] Updated weights for policy 1, policy_version 490068 (0.0007) [2023-12-27 22:45:08,166][106225] Updated weights for policy 1, policy_version 490078 (0.0009) [2023-12-27 22:45:08,216][106225] Updated weights for policy 1, policy_version 490088 (0.0009) [2023-12-27 22:45:08,510][106226] Updated weights for policy 0, policy_version 488653 (0.0011) [2023-12-27 22:45:08,577][106226] Updated weights for policy 0, policy_version 488663 (0.0010) [2023-12-27 22:45:08,645][106226] Updated weights for policy 0, policy_version 488673 (0.0009) [2023-12-27 22:45:09,036][106225] Updated weights for policy 1, policy_version 490098 (0.0008) [2023-12-27 22:45:09,085][106225] Updated weights for policy 1, policy_version 490108 (0.0008) [2023-12-27 22:45:09,138][106225] Updated weights for policy 1, policy_version 490118 (0.0007) [2023-12-27 22:45:09,201][106225] Updated weights for policy 1, policy_version 490128 (0.0008) [2023-12-27 22:45:09,386][106226] Updated weights for policy 0, policy_version 488683 (0.0006) [2023-12-27 22:45:09,458][106226] Updated weights for policy 0, policy_version 488693 (0.0009) [2023-12-27 22:45:09,523][106226] Updated weights for policy 0, policy_version 488703 (0.0009) [2023-12-27 22:45:10,018][106225] Updated weights for policy 1, policy_version 490138 (0.0010) [2023-12-27 22:45:10,069][106225] Updated weights for policy 1, policy_version 490148 (0.0009) [2023-12-27 22:45:10,127][106225] Updated weights for policy 1, policy_version 490158 (0.0009) [2023-12-27 22:45:10,240][106226] Updated weights for policy 0, policy_version 488713 (0.0009) [2023-12-27 22:45:10,308][106226] Updated weights for policy 0, policy_version 488723 (0.0010) [2023-12-27 22:45:10,366][106226] Updated weights for policy 0, policy_version 488733 (0.0008) [2023-12-27 22:45:10,424][106226] Updated weights for policy 0, policy_version 488743 (0.0009) [2023-12-27 22:45:10,867][106225] Updated weights for policy 1, policy_version 490168 (0.0008) [2023-12-27 22:45:10,924][106225] Updated weights for policy 1, policy_version 490178 (0.0009) [2023-12-27 22:45:10,987][106225] Updated weights for policy 1, policy_version 490188 (0.0009) [2023-12-27 22:45:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 250667008. Throughput: 0: 9860.0, 1: 10021.3. Samples: 250640708. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:11,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-5.588')] [2023-12-27 22:45:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000490192_125517824.pth... [2023-12-27 22:45:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000489040_125222912.pth [2023-12-27 22:45:11,233][106226] Updated weights for policy 0, policy_version 488753 (0.0007) [2023-12-27 22:45:11,306][106226] Updated weights for policy 0, policy_version 488763 (0.0008) [2023-12-27 22:45:11,378][106226] Updated weights for policy 0, policy_version 488773 (0.0009) [2023-12-27 22:45:11,396][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000488776_125157376.pth... [2023-12-27 22:45:11,401][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000487592_124854272.pth [2023-12-27 22:45:11,831][106225] Updated weights for policy 1, policy_version 490198 (0.0008) [2023-12-27 22:45:11,891][106225] Updated weights for policy 1, policy_version 490208 (0.0008) [2023-12-27 22:45:11,951][106225] Updated weights for policy 1, policy_version 490218 (0.0008) [2023-12-27 22:45:12,062][106226] Updated weights for policy 0, policy_version 488783 (0.0008) [2023-12-27 22:45:12,120][106226] Updated weights for policy 0, policy_version 488793 (0.0008) [2023-12-27 22:45:12,180][106226] Updated weights for policy 0, policy_version 488803 (0.0007) [2023-12-27 22:45:12,682][106225] Updated weights for policy 1, policy_version 490228 (0.0007) [2023-12-27 22:45:12,737][106225] Updated weights for policy 1, policy_version 490238 (0.0006) [2023-12-27 22:45:12,795][106225] Updated weights for policy 1, policy_version 490248 (0.0007) [2023-12-27 22:45:12,875][106226] Updated weights for policy 0, policy_version 488813 (0.0009) [2023-12-27 22:45:12,925][106226] Updated weights for policy 0, policy_version 488823 (0.0010) [2023-12-27 22:45:12,972][106226] Updated weights for policy 0, policy_version 488833 (0.0008) [2023-12-27 22:45:13,428][106225] Updated weights for policy 1, policy_version 490258 (0.0007) [2023-12-27 22:45:13,495][106225] Updated weights for policy 1, policy_version 490268 (0.0010) [2023-12-27 22:45:13,553][106225] Updated weights for policy 1, policy_version 490278 (0.0011) [2023-12-27 22:45:13,615][106225] Updated weights for policy 1, policy_version 490288 (0.0006) [2023-12-27 22:45:13,696][106226] Updated weights for policy 0, policy_version 488843 (0.0007) [2023-12-27 22:45:13,746][106226] Updated weights for policy 0, policy_version 488853 (0.0009) [2023-12-27 22:45:13,799][106226] Updated weights for policy 0, policy_version 488863 (0.0008) [2023-12-27 22:45:14,310][106225] Updated weights for policy 1, policy_version 490298 (0.0006) [2023-12-27 22:45:14,366][106225] Updated weights for policy 1, policy_version 490308 (0.0005) [2023-12-27 22:45:14,430][106225] Updated weights for policy 1, policy_version 490318 (0.0007) [2023-12-27 22:45:14,492][106226] Updated weights for policy 0, policy_version 488873 (0.0006) [2023-12-27 22:45:14,545][106226] Updated weights for policy 0, policy_version 488883 (0.0008) [2023-12-27 22:45:14,591][106226] Updated weights for policy 0, policy_version 488893 (0.0010) [2023-12-27 22:45:14,648][106226] Updated weights for policy 0, policy_version 488903 (0.0011) [2023-12-27 22:45:15,167][106225] Updated weights for policy 1, policy_version 490328 (0.0010) [2023-12-27 22:45:15,230][106225] Updated weights for policy 1, policy_version 490338 (0.0010) [2023-12-27 22:45:15,286][106225] Updated weights for policy 1, policy_version 490348 (0.0008) [2023-12-27 22:45:15,386][106226] Updated weights for policy 0, policy_version 488913 (0.0006) [2023-12-27 22:45:15,456][106226] Updated weights for policy 0, policy_version 488923 (0.0005) [2023-12-27 22:45:15,523][106226] Updated weights for policy 0, policy_version 488933 (0.0006) [2023-12-27 22:45:15,960][106225] Updated weights for policy 1, policy_version 490358 (0.0008) [2023-12-27 22:45:16,019][106225] Updated weights for policy 1, policy_version 490368 (0.0006) [2023-12-27 22:45:16,071][106225] Updated weights for policy 1, policy_version 490378 (0.0008) [2023-12-27 22:45:16,145][106226] Updated weights for policy 0, policy_version 488943 (0.0009) [2023-12-27 22:45:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 250765312. Throughput: 0: 9818.5, 1: 9900.2. Samples: 250754896. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:16,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-5.596')] [2023-12-27 22:45:16,208][106226] Updated weights for policy 0, policy_version 488953 (0.0009) [2023-12-27 22:45:16,268][106226] Updated weights for policy 0, policy_version 488963 (0.0008) [2023-12-27 22:45:16,723][106225] Updated weights for policy 1, policy_version 490388 (0.0007) [2023-12-27 22:45:16,786][106225] Updated weights for policy 1, policy_version 490398 (0.0009) [2023-12-27 22:45:16,844][106225] Updated weights for policy 1, policy_version 490408 (0.0008) [2023-12-27 22:45:17,009][106226] Updated weights for policy 0, policy_version 488973 (0.0009) [2023-12-27 22:45:17,070][106226] Updated weights for policy 0, policy_version 488983 (0.0009) [2023-12-27 22:45:17,129][106226] Updated weights for policy 0, policy_version 488993 (0.0010) [2023-12-27 22:45:17,563][106225] Updated weights for policy 1, policy_version 490418 (0.0009) [2023-12-27 22:45:17,613][106225] Updated weights for policy 1, policy_version 490428 (0.0010) [2023-12-27 22:45:17,662][106225] Updated weights for policy 1, policy_version 490438 (0.0010) [2023-12-27 22:45:17,716][106225] Updated weights for policy 1, policy_version 490448 (0.0010) [2023-12-27 22:45:17,791][106226] Updated weights for policy 0, policy_version 489003 (0.0005) [2023-12-27 22:45:17,845][106226] Updated weights for policy 0, policy_version 489013 (0.0007) [2023-12-27 22:45:17,895][106226] Updated weights for policy 0, policy_version 489023 (0.0010) [2023-12-27 22:45:18,477][106225] Updated weights for policy 1, policy_version 490458 (0.0008) [2023-12-27 22:45:18,540][106225] Updated weights for policy 1, policy_version 490468 (0.0007) [2023-12-27 22:45:18,565][106226] Updated weights for policy 0, policy_version 489033 (0.0010) [2023-12-27 22:45:18,602][106225] Updated weights for policy 1, policy_version 490478 (0.0008) [2023-12-27 22:45:18,621][106226] Updated weights for policy 0, policy_version 489043 (0.0006) [2023-12-27 22:45:18,681][106226] Updated weights for policy 0, policy_version 489053 (0.0009) [2023-12-27 22:45:18,744][106226] Updated weights for policy 0, policy_version 489063 (0.0010) [2023-12-27 22:45:19,239][106225] Updated weights for policy 1, policy_version 490488 (0.0007) [2023-12-27 22:45:19,298][106225] Updated weights for policy 1, policy_version 490498 (0.0008) [2023-12-27 22:45:19,363][106225] Updated weights for policy 1, policy_version 490508 (0.0008) [2023-12-27 22:45:19,411][106226] Updated weights for policy 0, policy_version 489073 (0.0008) [2023-12-27 22:45:19,480][106226] Updated weights for policy 0, policy_version 489083 (0.0008) [2023-12-27 22:45:19,547][106226] Updated weights for policy 0, policy_version 489093 (0.0008) [2023-12-27 22:45:20,082][106225] Updated weights for policy 1, policy_version 490518 (0.0010) [2023-12-27 22:45:20,147][106225] Updated weights for policy 1, policy_version 490528 (0.0011) [2023-12-27 22:45:20,198][106225] Updated weights for policy 1, policy_version 490538 (0.0010) [2023-12-27 22:45:20,297][106226] Updated weights for policy 0, policy_version 489103 (0.0008) [2023-12-27 22:45:20,358][106226] Updated weights for policy 0, policy_version 489113 (0.0008) [2023-12-27 22:45:20,423][106226] Updated weights for policy 0, policy_version 489123 (0.0008) [2023-12-27 22:45:20,899][106225] Updated weights for policy 1, policy_version 490548 (0.0009) [2023-12-27 22:45:20,962][106225] Updated weights for policy 1, policy_version 490558 (0.0009) [2023-12-27 22:45:21,014][106225] Updated weights for policy 1, policy_version 490568 (0.0010) [2023-12-27 22:45:21,136][106226] Updated weights for policy 0, policy_version 489133 (0.0007) [2023-12-27 22:45:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 250863616. Throughput: 0: 9798.5, 1: 9825.0. Samples: 250872964. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:21,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.363')] [2023-12-27 22:45:21,203][106226] Updated weights for policy 0, policy_version 489143 (0.0008) [2023-12-27 22:45:21,273][106226] Updated weights for policy 0, policy_version 489153 (0.0007) [2023-12-27 22:45:21,776][106225] Updated weights for policy 1, policy_version 490578 (0.0009) [2023-12-27 22:45:21,842][106225] Updated weights for policy 1, policy_version 490588 (0.0008) [2023-12-27 22:45:21,904][106225] Updated weights for policy 1, policy_version 490598 (0.0008) [2023-12-27 22:45:21,963][106225] Updated weights for policy 1, policy_version 490608 (0.0008) [2023-12-27 22:45:22,105][106226] Updated weights for policy 0, policy_version 489163 (0.0009) [2023-12-27 22:45:22,158][106226] Updated weights for policy 0, policy_version 489173 (0.0008) [2023-12-27 22:45:22,212][106226] Updated weights for policy 0, policy_version 489183 (0.0008) [2023-12-27 22:45:22,695][106225] Updated weights for policy 1, policy_version 490618 (0.0009) [2023-12-27 22:45:22,747][106225] Updated weights for policy 1, policy_version 490628 (0.0008) [2023-12-27 22:45:22,807][106225] Updated weights for policy 1, policy_version 490638 (0.0009) [2023-12-27 22:45:22,958][106226] Updated weights for policy 0, policy_version 489193 (0.0009) [2023-12-27 22:45:23,025][106226] Updated weights for policy 0, policy_version 489203 (0.0009) [2023-12-27 22:45:23,092][106226] Updated weights for policy 0, policy_version 489213 (0.0007) [2023-12-27 22:45:23,164][106226] Updated weights for policy 0, policy_version 489223 (0.0006) [2023-12-27 22:45:23,543][106225] Updated weights for policy 1, policy_version 490648 (0.0008) [2023-12-27 22:45:23,599][106225] Updated weights for policy 1, policy_version 490658 (0.0009) [2023-12-27 22:45:23,658][106225] Updated weights for policy 1, policy_version 490668 (0.0009) [2023-12-27 22:45:23,856][106226] Updated weights for policy 0, policy_version 489233 (0.0009) [2023-12-27 22:45:23,917][106226] Updated weights for policy 0, policy_version 489243 (0.0008) [2023-12-27 22:45:23,972][106226] Updated weights for policy 0, policy_version 489253 (0.0009) [2023-12-27 22:45:24,365][106225] Updated weights for policy 1, policy_version 490678 (0.0008) [2023-12-27 22:45:24,427][106225] Updated weights for policy 1, policy_version 490688 (0.0008) [2023-12-27 22:45:24,485][106225] Updated weights for policy 1, policy_version 490698 (0.0008) [2023-12-27 22:45:24,714][106226] Updated weights for policy 0, policy_version 489263 (0.0008) [2023-12-27 22:45:24,759][106226] Updated weights for policy 0, policy_version 489273 (0.0008) [2023-12-27 22:45:24,805][106226] Updated weights for policy 0, policy_version 489283 (0.0008) [2023-12-27 22:45:25,155][106225] Updated weights for policy 1, policy_version 490708 (0.0008) [2023-12-27 22:45:25,214][106225] Updated weights for policy 1, policy_version 490718 (0.0007) [2023-12-27 22:45:25,268][106225] Updated weights for policy 1, policy_version 490728 (0.0008) [2023-12-27 22:45:25,595][106226] Updated weights for policy 0, policy_version 489293 (0.0009) [2023-12-27 22:45:25,654][106226] Updated weights for policy 0, policy_version 489303 (0.0008) [2023-12-27 22:45:25,717][106226] Updated weights for policy 0, policy_version 489313 (0.0008) [2023-12-27 22:45:25,955][106225] Updated weights for policy 1, policy_version 490738 (0.0009) [2023-12-27 22:45:26,009][106225] Updated weights for policy 1, policy_version 490748 (0.0008) [2023-12-27 22:45:26,061][106225] Updated weights for policy 1, policy_version 490758 (0.0008) [2023-12-27 22:45:26,113][106225] Updated weights for policy 1, policy_version 490768 (0.0009) [2023-12-27 22:45:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 250961920. Throughput: 0: 9797.0, 1: 9732.1. Samples: 250928048. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:26,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.346')] [2023-12-27 22:45:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000490768_125665280.pth... [2023-12-27 22:45:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000489320_125296640.pth... [2023-12-27 22:45:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000489616_125370368.pth [2023-12-27 22:45:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000488200_125009920.pth [2023-12-27 22:45:26,371][106226] Updated weights for policy 0, policy_version 489323 (0.0008) [2023-12-27 22:45:26,420][106226] Updated weights for policy 0, policy_version 489333 (0.0008) [2023-12-27 22:45:26,474][106226] Updated weights for policy 0, policy_version 489343 (0.0005) [2023-12-27 22:45:26,903][106225] Updated weights for policy 1, policy_version 490778 (0.0008) [2023-12-27 22:45:26,957][106225] Updated weights for policy 1, policy_version 490788 (0.0008) [2023-12-27 22:45:27,013][106225] Updated weights for policy 1, policy_version 490798 (0.0008) [2023-12-27 22:45:27,066][106226] Updated weights for policy 0, policy_version 489353 (0.0005) [2023-12-27 22:45:27,132][106226] Updated weights for policy 0, policy_version 489363 (0.0005) [2023-12-27 22:45:27,194][106226] Updated weights for policy 0, policy_version 489373 (0.0008) [2023-12-27 22:45:27,255][106226] Updated weights for policy 0, policy_version 489383 (0.0007) [2023-12-27 22:45:27,694][106225] Updated weights for policy 1, policy_version 490808 (0.0005) [2023-12-27 22:45:27,749][106225] Updated weights for policy 1, policy_version 490818 (0.0007) [2023-12-27 22:45:27,801][106225] Updated weights for policy 1, policy_version 490828 (0.0008) [2023-12-27 22:45:27,851][106226] Updated weights for policy 0, policy_version 489393 (0.0006) [2023-12-27 22:45:27,907][106226] Updated weights for policy 0, policy_version 489403 (0.0007) [2023-12-27 22:45:27,964][106226] Updated weights for policy 0, policy_version 489413 (0.0006) [2023-12-27 22:45:28,490][106225] Updated weights for policy 1, policy_version 490838 (0.0009) [2023-12-27 22:45:28,551][106225] Updated weights for policy 1, policy_version 490849 (0.0006) [2023-12-27 22:45:28,602][106226] Updated weights for policy 0, policy_version 489423 (0.0008) [2023-12-27 22:45:28,611][106225] Updated weights for policy 1, policy_version 490859 (0.0006) [2023-12-27 22:45:28,665][106226] Updated weights for policy 0, policy_version 489433 (0.0009) [2023-12-27 22:45:28,727][106226] Updated weights for policy 0, policy_version 489443 (0.0008) [2023-12-27 22:45:29,217][106225] Updated weights for policy 1, policy_version 490869 (0.0007) [2023-12-27 22:45:29,282][106225] Updated weights for policy 1, policy_version 490879 (0.0010) [2023-12-27 22:45:29,337][106225] Updated weights for policy 1, policy_version 490889 (0.0008) [2023-12-27 22:45:29,498][106226] Updated weights for policy 0, policy_version 489453 (0.0008) [2023-12-27 22:45:29,567][106226] Updated weights for policy 0, policy_version 489463 (0.0008) [2023-12-27 22:45:29,628][106226] Updated weights for policy 0, policy_version 489473 (0.0008) [2023-12-27 22:45:30,087][106225] Updated weights for policy 1, policy_version 490899 (0.0009) [2023-12-27 22:45:30,141][106225] Updated weights for policy 1, policy_version 490909 (0.0010) [2023-12-27 22:45:30,197][106225] Updated weights for policy 1, policy_version 490919 (0.0010) [2023-12-27 22:45:30,357][106226] Updated weights for policy 0, policy_version 489483 (0.0008) [2023-12-27 22:45:30,412][106226] Updated weights for policy 0, policy_version 489493 (0.0008) [2023-12-27 22:45:30,472][106226] Updated weights for policy 0, policy_version 489503 (0.0008) [2023-12-27 22:45:30,920][106225] Updated weights for policy 1, policy_version 490929 (0.0010) [2023-12-27 22:45:30,966][106225] Updated weights for policy 1, policy_version 490939 (0.0010) [2023-12-27 22:45:31,012][106225] Updated weights for policy 1, policy_version 490949 (0.0010) [2023-12-27 22:45:31,080][106225] Updated weights for policy 1, policy_version 490959 (0.0008) [2023-12-27 22:45:31,085][106226] Updated weights for policy 0, policy_version 489513 (0.0007) [2023-12-27 22:45:31,146][106226] Updated weights for policy 0, policy_version 489523 (0.0009) [2023-12-27 22:45:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 251060224. Throughput: 0: 9885.4, 1: 9777.1. Samples: 251048848. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:31,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-5.661')] [2023-12-27 22:45:31,205][106226] Updated weights for policy 0, policy_version 489533 (0.0008) [2023-12-27 22:45:31,264][106226] Updated weights for policy 0, policy_version 489543 (0.0008) [2023-12-27 22:45:31,826][106225] Updated weights for policy 1, policy_version 490969 (0.0006) [2023-12-27 22:45:31,882][106225] Updated weights for policy 1, policy_version 490979 (0.0009) [2023-12-27 22:45:31,937][106225] Updated weights for policy 1, policy_version 490989 (0.0008) [2023-12-27 22:45:32,059][106226] Updated weights for policy 0, policy_version 489553 (0.0009) [2023-12-27 22:45:32,113][106226] Updated weights for policy 0, policy_version 489563 (0.0009) [2023-12-27 22:45:32,177][106226] Updated weights for policy 0, policy_version 489573 (0.0009) [2023-12-27 22:45:32,679][106225] Updated weights for policy 1, policy_version 490999 (0.0008) [2023-12-27 22:45:32,748][106225] Updated weights for policy 1, policy_version 491009 (0.0009) [2023-12-27 22:45:32,801][106225] Updated weights for policy 1, policy_version 491019 (0.0008) [2023-12-27 22:45:32,921][106226] Updated weights for policy 0, policy_version 489583 (0.0010) [2023-12-27 22:45:32,972][106226] Updated weights for policy 0, policy_version 489593 (0.0010) [2023-12-27 22:45:33,025][106226] Updated weights for policy 0, policy_version 489603 (0.0010) [2023-12-27 22:45:33,431][106225] Updated weights for policy 1, policy_version 491029 (0.0006) [2023-12-27 22:45:33,497][106225] Updated weights for policy 1, policy_version 491039 (0.0005) [2023-12-27 22:45:33,555][106225] Updated weights for policy 1, policy_version 491049 (0.0005) [2023-12-27 22:45:33,612][106226] Updated weights for policy 0, policy_version 489613 (0.0008) [2023-12-27 22:45:33,661][106226] Updated weights for policy 0, policy_version 489623 (0.0005) [2023-12-27 22:45:33,709][106226] Updated weights for policy 0, policy_version 489633 (0.0005) [2023-12-27 22:45:34,100][106225] Updated weights for policy 1, policy_version 491059 (0.0007) [2023-12-27 22:45:34,165][106225] Updated weights for policy 1, policy_version 491069 (0.0009) [2023-12-27 22:45:34,219][106225] Updated weights for policy 1, policy_version 491079 (0.0008) [2023-12-27 22:45:34,327][106226] Updated weights for policy 0, policy_version 489643 (0.0006) [2023-12-27 22:45:34,390][106226] Updated weights for policy 0, policy_version 489653 (0.0007) [2023-12-27 22:45:34,452][106226] Updated weights for policy 0, policy_version 489663 (0.0007) [2023-12-27 22:45:34,968][106225] Updated weights for policy 1, policy_version 491089 (0.0008) [2023-12-27 22:45:35,027][106225] Updated weights for policy 1, policy_version 491099 (0.0006) [2023-12-27 22:45:35,084][106225] Updated weights for policy 1, policy_version 491109 (0.0010) [2023-12-27 22:45:35,129][106226] Updated weights for policy 0, policy_version 489673 (0.0008) [2023-12-27 22:45:35,144][106225] Updated weights for policy 1, policy_version 491119 (0.0010) [2023-12-27 22:45:35,187][106226] Updated weights for policy 0, policy_version 489683 (0.0007) [2023-12-27 22:45:35,245][106226] Updated weights for policy 0, policy_version 489693 (0.0008) [2023-12-27 22:45:35,306][106226] Updated weights for policy 0, policy_version 489703 (0.0008) [2023-12-27 22:45:35,722][106225] Updated weights for policy 1, policy_version 491129 (0.0008) [2023-12-27 22:45:35,787][106225] Updated weights for policy 1, policy_version 491139 (0.0009) [2023-12-27 22:45:35,849][106225] Updated weights for policy 1, policy_version 491149 (0.0010) [2023-12-27 22:45:35,910][106226] Updated weights for policy 0, policy_version 489713 (0.0008) [2023-12-27 22:45:35,975][106226] Updated weights for policy 0, policy_version 489723 (0.0008) [2023-12-27 22:45:36,034][106226] Updated weights for policy 0, policy_version 489733 (0.0007) [2023-12-27 22:45:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 251166720. Throughput: 0: 9889.5, 1: 9842.4. Samples: 251171756. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:36,175][105115] Avg episode reward: [(0, '-5.067'), (1, '-5.888')] [2023-12-27 22:45:36,571][106225] Updated weights for policy 1, policy_version 491159 (0.0010) [2023-12-27 22:45:36,634][106225] Updated weights for policy 1, policy_version 491169 (0.0011) [2023-12-27 22:45:36,657][106226] Updated weights for policy 0, policy_version 489743 (0.0009) [2023-12-27 22:45:36,692][106225] Updated weights for policy 1, policy_version 491179 (0.0010) [2023-12-27 22:45:36,719][106226] Updated weights for policy 0, policy_version 489753 (0.0011) [2023-12-27 22:45:36,786][106226] Updated weights for policy 0, policy_version 489763 (0.0011) [2023-12-27 22:45:37,317][106225] Updated weights for policy 1, policy_version 491189 (0.0009) [2023-12-27 22:45:37,378][106225] Updated weights for policy 1, policy_version 491199 (0.0008) [2023-12-27 22:45:37,409][106226] Updated weights for policy 0, policy_version 489773 (0.0010) [2023-12-27 22:45:37,438][106225] Updated weights for policy 1, policy_version 491209 (0.0005) [2023-12-27 22:45:37,466][106226] Updated weights for policy 0, policy_version 489783 (0.0011) [2023-12-27 22:45:37,469][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000006 [2023-12-27 22:45:37,998][106225] Updated weights for policy 1, policy_version 491219 (0.0005) [2023-12-27 22:45:38,051][106225] Updated weights for policy 1, policy_version 491229 (0.0005) [2023-12-27 22:45:38,098][106225] Updated weights for policy 1, policy_version 491239 (0.0006) [2023-12-27 22:45:38,247][106226] Updated weights for policy 0, policy_version 489793 (0.0011) [2023-12-27 22:45:38,306][106226] Updated weights for policy 0, policy_version 489803 (0.0011) [2023-12-27 22:45:38,371][106226] Updated weights for policy 0, policy_version 489813 (0.0011) [2023-12-27 22:45:38,823][106225] Updated weights for policy 1, policy_version 491249 (0.0008) [2023-12-27 22:45:38,887][106225] Updated weights for policy 1, policy_version 491259 (0.0010) [2023-12-27 22:45:38,942][106225] Updated weights for policy 1, policy_version 491269 (0.0010) [2023-12-27 22:45:38,989][106225] Updated weights for policy 1, policy_version 491279 (0.0005) [2023-12-27 22:45:39,011][106226] Updated weights for policy 0, policy_version 489823 (0.0010) [2023-12-27 22:45:39,083][106226] Updated weights for policy 0, policy_version 489833 (0.0008) [2023-12-27 22:45:39,147][106226] Updated weights for policy 0, policy_version 489843 (0.0008) [2023-12-27 22:45:39,749][106225] Updated weights for policy 1, policy_version 491289 (0.0008) [2023-12-27 22:45:39,812][106225] Updated weights for policy 1, policy_version 491299 (0.0009) [2023-12-27 22:45:39,880][106225] Updated weights for policy 1, policy_version 491309 (0.0009) [2023-12-27 22:45:39,901][106226] Updated weights for policy 0, policy_version 489853 (0.0006) [2023-12-27 22:45:39,985][106226] Updated weights for policy 0, policy_version 489863 (0.0007) [2023-12-27 22:45:40,043][106226] Updated weights for policy 0, policy_version 489873 (0.0008) [2023-12-27 22:45:40,673][106225] Updated weights for policy 1, policy_version 491319 (0.0008) [2023-12-27 22:45:40,692][106226] Updated weights for policy 0, policy_version 489883 (0.0007) [2023-12-27 22:45:40,724][106225] Updated weights for policy 1, policy_version 491329 (0.0009) [2023-12-27 22:45:40,750][106226] Updated weights for policy 0, policy_version 489893 (0.0008) [2023-12-27 22:45:40,784][106225] Updated weights for policy 1, policy_version 491339 (0.0006) [2023-12-27 22:45:40,798][106226] Updated weights for policy 0, policy_version 489903 (0.0007) [2023-12-27 22:45:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 251265024. Throughput: 0: 9936.5, 1: 9850.6. Samples: 251234572. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:41,175][105115] Avg episode reward: [(0, '-5.076'), (1, '-5.519')] [2023-12-27 22:45:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000491344_125812736.pth... [2023-12-27 22:45:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000489912_125452288.pth... [2023-12-27 22:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000490192_125517824.pth [2023-12-27 22:45:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000488776_125157376.pth [2023-12-27 22:45:41,595][106226] Updated weights for policy 0, policy_version 489913 (0.0008) [2023-12-27 22:45:41,664][106226] Updated weights for policy 0, policy_version 489923 (0.0008) [2023-12-27 22:45:41,665][106225] Updated weights for policy 1, policy_version 491349 (0.0007) [2023-12-27 22:45:41,731][106225] Updated weights for policy 1, policy_version 491359 (0.0008) [2023-12-27 22:45:41,744][106226] Updated weights for policy 0, policy_version 489933 (0.0007) [2023-12-27 22:45:41,789][106225] Updated weights for policy 1, policy_version 491369 (0.0007) [2023-12-27 22:45:41,807][106226] Updated weights for policy 0, policy_version 489943 (0.0008) [2023-12-27 22:45:42,515][106226] Updated weights for policy 0, policy_version 489953 (0.0008) [2023-12-27 22:45:42,576][106226] Updated weights for policy 0, policy_version 489963 (0.0008) [2023-12-27 22:45:42,579][106225] Updated weights for policy 1, policy_version 491379 (0.0009) [2023-12-27 22:45:42,632][106226] Updated weights for policy 0, policy_version 489973 (0.0006) [2023-12-27 22:45:42,641][106225] Updated weights for policy 1, policy_version 491389 (0.0011) [2023-12-27 22:45:42,692][106225] Updated weights for policy 1, policy_version 491399 (0.0010) [2023-12-27 22:45:43,300][106226] Updated weights for policy 0, policy_version 489983 (0.0007) [2023-12-27 22:45:43,362][106226] Updated weights for policy 0, policy_version 489993 (0.0008) [2023-12-27 22:45:43,416][106225] Updated weights for policy 1, policy_version 491409 (0.0010) [2023-12-27 22:45:43,419][106226] Updated weights for policy 0, policy_version 490003 (0.0008) [2023-12-27 22:45:43,471][106225] Updated weights for policy 1, policy_version 491419 (0.0006) [2023-12-27 22:45:43,523][106225] Updated weights for policy 1, policy_version 491429 (0.0005) [2023-12-27 22:45:43,580][106225] Updated weights for policy 1, policy_version 491439 (0.0005) [2023-12-27 22:45:44,201][106225] Updated weights for policy 1, policy_version 491449 (0.0010) [2023-12-27 22:45:44,234][106226] Updated weights for policy 0, policy_version 490013 (0.0006) [2023-12-27 22:45:44,259][106225] Updated weights for policy 1, policy_version 491459 (0.0010) [2023-12-27 22:45:44,285][106226] Updated weights for policy 0, policy_version 490023 (0.0008) [2023-12-27 22:45:44,302][106225] Updated weights for policy 1, policy_version 491469 (0.0010) [2023-12-27 22:45:44,340][106226] Updated weights for policy 0, policy_version 490033 (0.0008) [2023-12-27 22:45:45,039][106225] Updated weights for policy 1, policy_version 491479 (0.0010) [2023-12-27 22:45:45,061][106226] Updated weights for policy 0, policy_version 490043 (0.0008) [2023-12-27 22:45:45,097][106225] Updated weights for policy 1, policy_version 491489 (0.0008) [2023-12-27 22:45:45,128][106226] Updated weights for policy 0, policy_version 490053 (0.0008) [2023-12-27 22:45:45,155][106225] Updated weights for policy 1, policy_version 491499 (0.0006) [2023-12-27 22:45:45,190][106226] Updated weights for policy 0, policy_version 490063 (0.0009) [2023-12-27 22:45:45,820][106225] Updated weights for policy 1, policy_version 491509 (0.0008) [2023-12-27 22:45:45,889][106225] Updated weights for policy 1, policy_version 491519 (0.0010) [2023-12-27 22:45:45,891][106226] Updated weights for policy 0, policy_version 490073 (0.0008) [2023-12-27 22:45:45,948][106225] Updated weights for policy 1, policy_version 491529 (0.0007) [2023-12-27 22:45:45,955][106226] Updated weights for policy 0, policy_version 490083 (0.0006) [2023-12-27 22:45:46,013][106226] Updated weights for policy 0, policy_version 490093 (0.0006) [2023-12-27 22:45:46,068][106226] Updated weights for policy 0, policy_version 490103 (0.0005) [2023-12-27 22:45:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 251363328. Throughput: 0: 9881.7, 1: 9826.8. Samples: 251348368. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:46,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-5.804')] [2023-12-27 22:45:46,541][106225] Updated weights for policy 1, policy_version 491539 (0.0007) [2023-12-27 22:45:46,602][106225] Updated weights for policy 1, policy_version 491549 (0.0007) [2023-12-27 22:45:46,646][106225] Updated weights for policy 1, policy_version 491559 (0.0007) [2023-12-27 22:45:46,659][106226] Updated weights for policy 0, policy_version 490113 (0.0006) [2023-12-27 22:45:46,718][106226] Updated weights for policy 0, policy_version 490123 (0.0006) [2023-12-27 22:45:46,779][106226] Updated weights for policy 0, policy_version 490133 (0.0006) [2023-12-27 22:45:47,317][106225] Updated weights for policy 1, policy_version 491569 (0.0007) [2023-12-27 22:45:47,371][106225] Updated weights for policy 1, policy_version 491579 (0.0005) [2023-12-27 22:45:47,387][106226] Updated weights for policy 0, policy_version 490143 (0.0006) [2023-12-27 22:45:47,439][106225] Updated weights for policy 1, policy_version 491589 (0.0006) [2023-12-27 22:45:47,446][106226] Updated weights for policy 0, policy_version 490153 (0.0009) [2023-12-27 22:45:47,499][106226] Updated weights for policy 0, policy_version 490163 (0.0008) [2023-12-27 22:45:47,508][106225] Updated weights for policy 1, policy_version 491599 (0.0007) [2023-12-27 22:45:48,117][106225] Updated weights for policy 1, policy_version 491609 (0.0006) [2023-12-27 22:45:48,168][106225] Updated weights for policy 1, policy_version 491619 (0.0005) [2023-12-27 22:45:48,225][106225] Updated weights for policy 1, policy_version 491629 (0.0005) [2023-12-27 22:45:48,239][106226] Updated weights for policy 0, policy_version 490173 (0.0007) [2023-12-27 22:45:48,299][106226] Updated weights for policy 0, policy_version 490183 (0.0009) [2023-12-27 22:45:48,374][106226] Updated weights for policy 0, policy_version 490193 (0.0007) [2023-12-27 22:45:48,883][106225] Updated weights for policy 1, policy_version 491639 (0.0009) [2023-12-27 22:45:48,938][106225] Updated weights for policy 1, policy_version 491649 (0.0010) [2023-12-27 22:45:48,989][106225] Updated weights for policy 1, policy_version 491659 (0.0010) [2023-12-27 22:45:49,092][106226] Updated weights for policy 0, policy_version 490203 (0.0007) [2023-12-27 22:45:49,140][106226] Updated weights for policy 0, policy_version 490213 (0.0008) [2023-12-27 22:45:49,192][106226] Updated weights for policy 0, policy_version 490223 (0.0008) [2023-12-27 22:45:49,709][106225] Updated weights for policy 1, policy_version 491669 (0.0010) [2023-12-27 22:45:49,760][106225] Updated weights for policy 1, policy_version 491679 (0.0010) [2023-12-27 22:45:49,821][106225] Updated weights for policy 1, policy_version 491689 (0.0010) [2023-12-27 22:45:49,957][106226] Updated weights for policy 0, policy_version 490233 (0.0008) [2023-12-27 22:45:50,018][106226] Updated weights for policy 0, policy_version 490243 (0.0011) [2023-12-27 22:45:50,083][106226] Updated weights for policy 0, policy_version 490253 (0.0011) [2023-12-27 22:45:50,152][106226] Updated weights for policy 0, policy_version 490263 (0.0011) [2023-12-27 22:45:50,602][106225] Updated weights for policy 1, policy_version 491699 (0.0010) [2023-12-27 22:45:50,669][106225] Updated weights for policy 1, policy_version 491709 (0.0008) [2023-12-27 22:45:50,736][106225] Updated weights for policy 1, policy_version 491719 (0.0008) [2023-12-27 22:45:50,869][106226] Updated weights for policy 0, policy_version 490273 (0.0008) [2023-12-27 22:45:50,933][106226] Updated weights for policy 0, policy_version 490283 (0.0008) [2023-12-27 22:45:51,003][106226] Updated weights for policy 0, policy_version 490293 (0.0008) [2023-12-27 22:45:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 251461632. Throughput: 0: 9906.6, 1: 9888.2. Samples: 251468964. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:51,175][105115] Avg episode reward: [(0, '-5.008'), (1, '-5.607')] [2023-12-27 22:45:51,485][106225] Updated weights for policy 1, policy_version 491729 (0.0007) [2023-12-27 22:45:51,544][106225] Updated weights for policy 1, policy_version 491739 (0.0006) [2023-12-27 22:45:51,609][106225] Updated weights for policy 1, policy_version 491749 (0.0006) [2023-12-27 22:45:51,669][106225] Updated weights for policy 1, policy_version 491759 (0.0007) [2023-12-27 22:45:51,814][106226] Updated weights for policy 0, policy_version 490303 (0.0010) [2023-12-27 22:45:51,876][106226] Updated weights for policy 0, policy_version 490313 (0.0011) [2023-12-27 22:45:51,939][106226] Updated weights for policy 0, policy_version 490323 (0.0011) [2023-12-27 22:45:52,405][106225] Updated weights for policy 1, policy_version 491769 (0.0010) [2023-12-27 22:45:52,467][106225] Updated weights for policy 1, policy_version 491779 (0.0011) [2023-12-27 22:45:52,535][106225] Updated weights for policy 1, policy_version 491789 (0.0011) [2023-12-27 22:45:52,689][106226] Updated weights for policy 0, policy_version 490333 (0.0010) [2023-12-27 22:45:52,754][106226] Updated weights for policy 0, policy_version 490343 (0.0011) [2023-12-27 22:45:52,815][106226] Updated weights for policy 0, policy_version 490353 (0.0011) [2023-12-27 22:45:53,244][106225] Updated weights for policy 1, policy_version 491799 (0.0010) [2023-12-27 22:45:53,301][106225] Updated weights for policy 1, policy_version 491809 (0.0010) [2023-12-27 22:45:53,357][106225] Updated weights for policy 1, policy_version 491819 (0.0010) [2023-12-27 22:45:53,536][106226] Updated weights for policy 0, policy_version 490363 (0.0011) [2023-12-27 22:45:53,595][106226] Updated weights for policy 0, policy_version 490373 (0.0008) [2023-12-27 22:45:53,662][106226] Updated weights for policy 0, policy_version 490383 (0.0007) [2023-12-27 22:45:54,105][106225] Updated weights for policy 1, policy_version 491829 (0.0010) [2023-12-27 22:45:54,164][106225] Updated weights for policy 1, policy_version 491839 (0.0009) [2023-12-27 22:45:54,222][106225] Updated weights for policy 1, policy_version 491849 (0.0009) [2023-12-27 22:45:54,381][106226] Updated weights for policy 0, policy_version 490393 (0.0008) [2023-12-27 22:45:54,447][106226] Updated weights for policy 0, policy_version 490403 (0.0008) [2023-12-27 22:45:54,501][106226] Updated weights for policy 0, policy_version 490413 (0.0008) [2023-12-27 22:45:54,562][106226] Updated weights for policy 0, policy_version 490423 (0.0006) [2023-12-27 22:45:54,991][106225] Updated weights for policy 1, policy_version 491859 (0.0008) [2023-12-27 22:45:55,050][106225] Updated weights for policy 1, policy_version 491869 (0.0008) [2023-12-27 22:45:55,107][106225] Updated weights for policy 1, policy_version 491879 (0.0009) [2023-12-27 22:45:55,220][106226] Updated weights for policy 0, policy_version 490433 (0.0007) [2023-12-27 22:45:55,292][106226] Updated weights for policy 0, policy_version 490443 (0.0005) [2023-12-27 22:45:55,356][106226] Updated weights for policy 0, policy_version 490453 (0.0006) [2023-12-27 22:45:55,813][106225] Updated weights for policy 1, policy_version 491889 (0.0008) [2023-12-27 22:45:55,867][106225] Updated weights for policy 1, policy_version 491899 (0.0008) [2023-12-27 22:45:55,922][106225] Updated weights for policy 1, policy_version 491909 (0.0008) [2023-12-27 22:45:55,972][106225] Updated weights for policy 1, policy_version 491919 (0.0008) [2023-12-27 22:45:56,048][106226] Updated weights for policy 0, policy_version 490463 (0.0009) [2023-12-27 22:45:56,110][106226] Updated weights for policy 0, policy_version 490473 (0.0008) [2023-12-27 22:45:56,169][106226] Updated weights for policy 0, policy_version 490483 (0.0010) [2023-12-27 22:45:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 251551744. Throughput: 0: 9824.7, 1: 9836.3. Samples: 251525452. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-27 22:45:56,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.293')] [2023-12-27 22:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000491920_125960192.pth... [2023-12-27 22:45:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000490768_125665280.pth [2023-12-27 22:45:56,201][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000490488_125599744.pth... [2023-12-27 22:45:56,204][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000489320_125296640.pth [2023-12-27 22:45:56,686][106225] Updated weights for policy 1, policy_version 491929 (0.0008) [2023-12-27 22:45:56,746][106225] Updated weights for policy 1, policy_version 491939 (0.0007) [2023-12-27 22:45:56,793][106225] Updated weights for policy 1, policy_version 491949 (0.0008) [2023-12-27 22:45:56,884][106226] Updated weights for policy 0, policy_version 490493 (0.0010) [2023-12-27 22:45:56,930][106226] Updated weights for policy 0, policy_version 490503 (0.0010) [2023-12-27 22:45:56,977][106226] Updated weights for policy 0, policy_version 490513 (0.0010) [2023-12-27 22:45:57,574][106225] Updated weights for policy 1, policy_version 491959 (0.0008) [2023-12-27 22:45:57,639][106225] Updated weights for policy 1, policy_version 491969 (0.0008) [2023-12-27 22:45:57,693][106226] Updated weights for policy 0, policy_version 490523 (0.0011) [2023-12-27 22:45:57,706][106225] Updated weights for policy 1, policy_version 491979 (0.0005) [2023-12-27 22:45:57,757][106226] Updated weights for policy 0, policy_version 490533 (0.0010) [2023-12-27 22:45:57,825][106226] Updated weights for policy 0, policy_version 490543 (0.0008) [2023-12-27 22:45:58,251][106225] Updated weights for policy 1, policy_version 491989 (0.0007) [2023-12-27 22:45:58,313][106225] Updated weights for policy 1, policy_version 491999 (0.0008) [2023-12-27 22:45:58,382][106225] Updated weights for policy 1, policy_version 492009 (0.0008) [2023-12-27 22:45:58,607][106226] Updated weights for policy 0, policy_version 490553 (0.0008) [2023-12-27 22:45:58,673][106226] Updated weights for policy 0, policy_version 490563 (0.0008) [2023-12-27 22:45:58,750][106226] Updated weights for policy 0, policy_version 490573 (0.0009) [2023-12-27 22:45:58,823][106226] Updated weights for policy 0, policy_version 490583 (0.0009) [2023-12-27 22:45:59,221][106225] Updated weights for policy 1, policy_version 492019 (0.0007) [2023-12-27 22:45:59,292][106225] Updated weights for policy 1, policy_version 492029 (0.0008) [2023-12-27 22:45:59,361][106225] Updated weights for policy 1, policy_version 492039 (0.0008) [2023-12-27 22:45:59,577][106226] Updated weights for policy 0, policy_version 490593 (0.0010) [2023-12-27 22:45:59,635][106226] Updated weights for policy 0, policy_version 490603 (0.0006) [2023-12-27 22:45:59,685][106226] Updated weights for policy 0, policy_version 490613 (0.0008) [2023-12-27 22:46:00,076][106225] Updated weights for policy 1, policy_version 492049 (0.0007) [2023-12-27 22:46:00,137][106225] Updated weights for policy 1, policy_version 492059 (0.0009) [2023-12-27 22:46:00,197][106225] Updated weights for policy 1, policy_version 492069 (0.0009) [2023-12-27 22:46:00,256][106225] Updated weights for policy 1, policy_version 492079 (0.0008) [2023-12-27 22:46:00,448][106226] Updated weights for policy 0, policy_version 490623 (0.0008) [2023-12-27 22:46:00,492][106226] Updated weights for policy 0, policy_version 490633 (0.0008) [2023-12-27 22:46:00,545][106226] Updated weights for policy 0, policy_version 490643 (0.0005) [2023-12-27 22:46:00,981][106225] Updated weights for policy 1, policy_version 492089 (0.0008) [2023-12-27 22:46:01,046][106225] Updated weights for policy 1, policy_version 492099 (0.0008) [2023-12-27 22:46:01,108][106225] Updated weights for policy 1, policy_version 492109 (0.0009) [2023-12-27 22:46:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 251650048. Throughput: 0: 9811.6, 1: 9841.0. Samples: 251639264. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:01,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.520')] [2023-12-27 22:46:01,214][106226] Updated weights for policy 0, policy_version 490653 (0.0006) [2023-12-27 22:46:01,281][106226] Updated weights for policy 0, policy_version 490663 (0.0007) [2023-12-27 22:46:01,353][106226] Updated weights for policy 0, policy_version 490673 (0.0007) [2023-12-27 22:46:01,925][106225] Updated weights for policy 1, policy_version 492119 (0.0009) [2023-12-27 22:46:01,986][106225] Updated weights for policy 1, policy_version 492129 (0.0010) [2023-12-27 22:46:02,030][106226] Updated weights for policy 0, policy_version 490683 (0.0007) [2023-12-27 22:46:02,044][106225] Updated weights for policy 1, policy_version 492139 (0.0010) [2023-12-27 22:46:02,090][106226] Updated weights for policy 0, policy_version 490693 (0.0006) [2023-12-27 22:46:02,151][106226] Updated weights for policy 0, policy_version 490703 (0.0010) [2023-12-27 22:46:02,728][106225] Updated weights for policy 1, policy_version 492149 (0.0007) [2023-12-27 22:46:02,778][106225] Updated weights for policy 1, policy_version 492159 (0.0007) [2023-12-27 22:46:02,822][106225] Updated weights for policy 1, policy_version 492169 (0.0007) [2023-12-27 22:46:02,909][106226] Updated weights for policy 0, policy_version 490713 (0.0008) [2023-12-27 22:46:02,969][106226] Updated weights for policy 0, policy_version 490723 (0.0009) [2023-12-27 22:46:03,027][106226] Updated weights for policy 0, policy_version 490733 (0.0009) [2023-12-27 22:46:03,095][106226] Updated weights for policy 0, policy_version 490743 (0.0006) [2023-12-27 22:46:03,542][106225] Updated weights for policy 1, policy_version 492179 (0.0007) [2023-12-27 22:46:03,601][106225] Updated weights for policy 1, policy_version 492189 (0.0005) [2023-12-27 22:46:03,659][106225] Updated weights for policy 1, policy_version 492199 (0.0005) [2023-12-27 22:46:03,772][106226] Updated weights for policy 0, policy_version 490753 (0.0008) [2023-12-27 22:46:03,823][106226] Updated weights for policy 0, policy_version 490763 (0.0008) [2023-12-27 22:46:03,892][106226] Updated weights for policy 0, policy_version 490773 (0.0010) [2023-12-27 22:46:04,345][106225] Updated weights for policy 1, policy_version 492209 (0.0010) [2023-12-27 22:46:04,407][106225] Updated weights for policy 1, policy_version 492219 (0.0010) [2023-12-27 22:46:04,471][106225] Updated weights for policy 1, policy_version 492229 (0.0010) [2023-12-27 22:46:04,530][106225] Updated weights for policy 1, policy_version 492239 (0.0010) [2023-12-27 22:46:04,644][106226] Updated weights for policy 0, policy_version 490783 (0.0008) [2023-12-27 22:46:04,703][106226] Updated weights for policy 0, policy_version 490793 (0.0006) [2023-12-27 22:46:04,760][106226] Updated weights for policy 0, policy_version 490803 (0.0005) [2023-12-27 22:46:05,252][106225] Updated weights for policy 1, policy_version 492249 (0.0010) [2023-12-27 22:46:05,302][106225] Updated weights for policy 1, policy_version 492259 (0.0010) [2023-12-27 22:46:05,316][106226] Updated weights for policy 0, policy_version 490813 (0.0006) [2023-12-27 22:46:05,349][106225] Updated weights for policy 1, policy_version 492269 (0.0010) [2023-12-27 22:46:05,362][106226] Updated weights for policy 0, policy_version 490823 (0.0005) [2023-12-27 22:46:05,416][106226] Updated weights for policy 0, policy_version 490833 (0.0007) [2023-12-27 22:46:06,058][106225] Updated weights for policy 1, policy_version 492279 (0.0007) [2023-12-27 22:46:06,131][106225] Updated weights for policy 1, policy_version 492289 (0.0008) [2023-12-27 22:46:06,138][106226] Updated weights for policy 0, policy_version 490843 (0.0008) [2023-12-27 22:46:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 251740160. Throughput: 0: 9835.9, 1: 9818.7. Samples: 251757420. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:06,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-5.934')] [2023-12-27 22:46:06,190][106225] Updated weights for policy 1, policy_version 492299 (0.0009) [2023-12-27 22:46:06,200][106226] Updated weights for policy 0, policy_version 490853 (0.0006) [2023-12-27 22:46:06,259][106226] Updated weights for policy 0, policy_version 490863 (0.0007) [2023-12-27 22:46:06,921][106225] Updated weights for policy 1, policy_version 492309 (0.0010) [2023-12-27 22:46:06,936][106226] Updated weights for policy 0, policy_version 490873 (0.0008) [2023-12-27 22:46:06,977][106225] Updated weights for policy 1, policy_version 492319 (0.0008) [2023-12-27 22:46:06,995][106226] Updated weights for policy 0, policy_version 490883 (0.0006) [2023-12-27 22:46:07,035][106225] Updated weights for policy 1, policy_version 492329 (0.0005) [2023-12-27 22:46:07,050][106226] Updated weights for policy 0, policy_version 490893 (0.0008) [2023-12-27 22:46:07,101][106226] Updated weights for policy 0, policy_version 490903 (0.0009) [2023-12-27 22:46:07,690][106225] Updated weights for policy 1, policy_version 492339 (0.0005) [2023-12-27 22:46:07,740][106225] Updated weights for policy 1, policy_version 492349 (0.0006) [2023-12-27 22:46:07,794][106225] Updated weights for policy 1, policy_version 492359 (0.0008) [2023-12-27 22:46:07,837][106226] Updated weights for policy 0, policy_version 490913 (0.0007) [2023-12-27 22:46:07,889][106226] Updated weights for policy 0, policy_version 490923 (0.0008) [2023-12-27 22:46:07,935][106226] Updated weights for policy 0, policy_version 490933 (0.0009) [2023-12-27 22:46:08,460][106225] Updated weights for policy 1, policy_version 492369 (0.0009) [2023-12-27 22:46:08,523][106225] Updated weights for policy 1, policy_version 492379 (0.0006) [2023-12-27 22:46:08,581][106225] Updated weights for policy 1, policy_version 492389 (0.0008) [2023-12-27 22:46:08,637][106225] Updated weights for policy 1, policy_version 492399 (0.0008) [2023-12-27 22:46:08,693][106226] Updated weights for policy 0, policy_version 490943 (0.0008) [2023-12-27 22:46:08,759][106226] Updated weights for policy 0, policy_version 490953 (0.0008) [2023-12-27 22:46:08,818][106226] Updated weights for policy 0, policy_version 490963 (0.0009) [2023-12-27 22:46:09,356][106225] Updated weights for policy 1, policy_version 492409 (0.0008) [2023-12-27 22:46:09,427][106225] Updated weights for policy 1, policy_version 492419 (0.0008) [2023-12-27 22:46:09,489][106225] Updated weights for policy 1, policy_version 492429 (0.0005) [2023-12-27 22:46:09,584][106226] Updated weights for policy 0, policy_version 490973 (0.0009) [2023-12-27 22:46:09,645][106226] Updated weights for policy 0, policy_version 490983 (0.0011) [2023-12-27 22:46:09,710][106226] Updated weights for policy 0, policy_version 490993 (0.0011) [2023-12-27 22:46:10,204][106225] Updated weights for policy 1, policy_version 492439 (0.0007) [2023-12-27 22:46:10,262][106225] Updated weights for policy 1, policy_version 492449 (0.0007) [2023-12-27 22:46:10,335][106225] Updated weights for policy 1, policy_version 492459 (0.0008) [2023-12-27 22:46:10,445][106226] Updated weights for policy 0, policy_version 491003 (0.0008) [2023-12-27 22:46:10,497][106226] Updated weights for policy 0, policy_version 491013 (0.0009) [2023-12-27 22:46:10,553][106226] Updated weights for policy 0, policy_version 491023 (0.0009) [2023-12-27 22:46:11,114][106225] Updated weights for policy 1, policy_version 492469 (0.0008) [2023-12-27 22:46:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 251838464. Throughput: 0: 9851.0, 1: 9883.1. Samples: 251816080. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:11,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.604')] [2023-12-27 22:46:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000491032_125739008.pth... [2023-12-27 22:46:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000489912_125452288.pth [2023-12-27 22:46:11,185][106225] Updated weights for policy 1, policy_version 492479 (0.0008) [2023-12-27 22:46:11,237][106226] Updated weights for policy 0, policy_version 491033 (0.0008) [2023-12-27 22:46:11,256][106225] Updated weights for policy 1, policy_version 492489 (0.0009) [2023-12-27 22:46:11,303][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000492496_126107648.pth... [2023-12-27 22:46:11,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000491344_125812736.pth [2023-12-27 22:46:11,309][106226] Updated weights for policy 0, policy_version 491043 (0.0008) [2023-12-27 22:46:11,383][106226] Updated weights for policy 0, policy_version 491053 (0.0008) [2023-12-27 22:46:11,449][106226] Updated weights for policy 0, policy_version 491063 (0.0010) [2023-12-27 22:46:11,971][106225] Updated weights for policy 1, policy_version 492499 (0.0008) [2023-12-27 22:46:12,038][106225] Updated weights for policy 1, policy_version 492509 (0.0009) [2023-12-27 22:46:12,108][106225] Updated weights for policy 1, policy_version 492519 (0.0008) [2023-12-27 22:46:12,189][106226] Updated weights for policy 0, policy_version 491073 (0.0007) [2023-12-27 22:46:12,249][106226] Updated weights for policy 0, policy_version 491083 (0.0006) [2023-12-27 22:46:12,316][106226] Updated weights for policy 0, policy_version 491093 (0.0007) [2023-12-27 22:46:12,832][106225] Updated weights for policy 1, policy_version 492529 (0.0008) [2023-12-27 22:46:12,895][106225] Updated weights for policy 1, policy_version 492539 (0.0008) [2023-12-27 22:46:12,955][106225] Updated weights for policy 1, policy_version 492549 (0.0008) [2023-12-27 22:46:13,004][106225] Updated weights for policy 1, policy_version 492559 (0.0007) [2023-12-27 22:46:13,012][106226] Updated weights for policy 0, policy_version 491103 (0.0009) [2023-12-27 22:46:13,070][106226] Updated weights for policy 0, policy_version 491113 (0.0008) [2023-12-27 22:46:13,124][106226] Updated weights for policy 0, policy_version 491123 (0.0007) [2023-12-27 22:46:13,720][106225] Updated weights for policy 1, policy_version 492569 (0.0008) [2023-12-27 22:46:13,784][106226] Updated weights for policy 0, policy_version 491133 (0.0007) [2023-12-27 22:46:13,785][106225] Updated weights for policy 1, policy_version 492579 (0.0008) [2023-12-27 22:46:13,841][106226] Updated weights for policy 0, policy_version 491143 (0.0007) [2023-12-27 22:46:13,845][106225] Updated weights for policy 1, policy_version 492589 (0.0008) [2023-12-27 22:46:13,896][106226] Updated weights for policy 0, policy_version 491153 (0.0007) [2023-12-27 22:46:14,531][106225] Updated weights for policy 1, policy_version 492599 (0.0008) [2023-12-27 22:46:14,582][106225] Updated weights for policy 1, policy_version 492609 (0.0009) [2023-12-27 22:46:14,637][106226] Updated weights for policy 0, policy_version 491163 (0.0008) [2023-12-27 22:46:14,638][106225] Updated weights for policy 1, policy_version 492619 (0.0008) [2023-12-27 22:46:14,686][106226] Updated weights for policy 0, policy_version 491173 (0.0008) [2023-12-27 22:46:14,735][106226] Updated weights for policy 0, policy_version 491183 (0.0007) [2023-12-27 22:46:15,254][106225] Updated weights for policy 1, policy_version 492629 (0.0009) [2023-12-27 22:46:15,317][106225] Updated weights for policy 1, policy_version 492639 (0.0009) [2023-12-27 22:46:15,363][106225] Updated weights for policy 1, policy_version 492649 (0.0010) [2023-12-27 22:46:15,569][106226] Updated weights for policy 0, policy_version 491193 (0.0008) [2023-12-27 22:46:15,631][106226] Updated weights for policy 0, policy_version 491203 (0.0008) [2023-12-27 22:46:15,692][106226] Updated weights for policy 0, policy_version 491213 (0.0008) [2023-12-27 22:46:15,756][106226] Updated weights for policy 0, policy_version 491223 (0.0008) [2023-12-27 22:46:16,065][106225] Updated weights for policy 1, policy_version 492659 (0.0009) [2023-12-27 22:46:16,133][106225] Updated weights for policy 1, policy_version 492669 (0.0005) [2023-12-27 22:46:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 251936768. Throughput: 0: 9786.8, 1: 9792.8. Samples: 251929932. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:16,175][105115] Avg episode reward: [(0, '-4.944'), (1, '-5.849')] [2023-12-27 22:46:16,196][106225] Updated weights for policy 1, policy_version 492679 (0.0005) [2023-12-27 22:46:16,516][106226] Updated weights for policy 0, policy_version 491233 (0.0009) [2023-12-27 22:46:16,574][106226] Updated weights for policy 0, policy_version 491243 (0.0009) [2023-12-27 22:46:16,637][106226] Updated weights for policy 0, policy_version 491253 (0.0009) [2023-12-27 22:46:16,732][106225] Updated weights for policy 1, policy_version 492689 (0.0005) [2023-12-27 22:46:16,797][106225] Updated weights for policy 1, policy_version 492699 (0.0006) [2023-12-27 22:46:16,849][106225] Updated weights for policy 1, policy_version 492709 (0.0006) [2023-12-27 22:46:16,905][106225] Updated weights for policy 1, policy_version 492719 (0.0005) [2023-12-27 22:46:17,395][106226] Updated weights for policy 0, policy_version 491263 (0.0008) [2023-12-27 22:46:17,457][106226] Updated weights for policy 0, policy_version 491273 (0.0009) [2023-12-27 22:46:17,513][106226] Updated weights for policy 0, policy_version 491283 (0.0009) [2023-12-27 22:46:17,546][106225] Updated weights for policy 1, policy_version 492729 (0.0007) [2023-12-27 22:46:17,605][106225] Updated weights for policy 1, policy_version 492739 (0.0008) [2023-12-27 22:46:17,655][106225] Updated weights for policy 1, policy_version 492749 (0.0010) [2023-12-27 22:46:18,269][106226] Updated weights for policy 0, policy_version 491293 (0.0008) [2023-12-27 22:46:18,328][106226] Updated weights for policy 0, policy_version 491303 (0.0007) [2023-12-27 22:46:18,334][106225] Updated weights for policy 1, policy_version 492759 (0.0011) [2023-12-27 22:46:18,391][106226] Updated weights for policy 0, policy_version 491313 (0.0007) [2023-12-27 22:46:18,403][106225] Updated weights for policy 1, policy_version 492769 (0.0008) [2023-12-27 22:46:18,451][106225] Updated weights for policy 1, policy_version 492779 (0.0008) [2023-12-27 22:46:19,039][106226] Updated weights for policy 0, policy_version 491323 (0.0008) [2023-12-27 22:46:19,106][106226] Updated weights for policy 0, policy_version 491333 (0.0010) [2023-12-27 22:46:19,167][106225] Updated weights for policy 1, policy_version 492789 (0.0010) [2023-12-27 22:46:19,182][106226] Updated weights for policy 0, policy_version 491343 (0.0010) [2023-12-27 22:46:19,227][106225] Updated weights for policy 1, policy_version 492799 (0.0010) [2023-12-27 22:46:19,292][106225] Updated weights for policy 1, policy_version 492809 (0.0008) [2023-12-27 22:46:20,038][106226] Updated weights for policy 0, policy_version 491353 (0.0010) [2023-12-27 22:46:20,098][106226] Updated weights for policy 0, policy_version 491363 (0.0009) [2023-12-27 22:46:20,128][106225] Updated weights for policy 1, policy_version 492819 (0.0009) [2023-12-27 22:46:20,152][106226] Updated weights for policy 0, policy_version 491373 (0.0009) [2023-12-27 22:46:20,177][106225] Updated weights for policy 1, policy_version 492829 (0.0009) [2023-12-27 22:46:20,213][106226] Updated weights for policy 0, policy_version 491383 (0.0009) [2023-12-27 22:46:20,232][106225] Updated weights for policy 1, policy_version 492839 (0.0009) [2023-12-27 22:46:20,920][106226] Updated weights for policy 0, policy_version 491393 (0.0008) [2023-12-27 22:46:20,984][106226] Updated weights for policy 0, policy_version 491403 (0.0006) [2023-12-27 22:46:21,028][106225] Updated weights for policy 1, policy_version 492849 (0.0009) [2023-12-27 22:46:21,053][106226] Updated weights for policy 0, policy_version 491413 (0.0007) [2023-12-27 22:46:21,098][106225] Updated weights for policy 1, policy_version 492859 (0.0009) [2023-12-27 22:46:21,168][106225] Updated weights for policy 1, policy_version 492869 (0.0010) [2023-12-27 22:46:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 252035072. Throughput: 0: 9655.9, 1: 9773.0. Samples: 252046056. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:21,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-5.672')] [2023-12-27 22:46:21,233][106225] Updated weights for policy 1, policy_version 492879 (0.0011) [2023-12-27 22:46:21,737][106226] Updated weights for policy 0, policy_version 491423 (0.0007) [2023-12-27 22:46:21,793][106226] Updated weights for policy 0, policy_version 491433 (0.0006) [2023-12-27 22:46:21,854][106226] Updated weights for policy 0, policy_version 491443 (0.0006) [2023-12-27 22:46:21,930][106225] Updated weights for policy 1, policy_version 492889 (0.0008) [2023-12-27 22:46:21,982][106225] Updated weights for policy 1, policy_version 492899 (0.0009) [2023-12-27 22:46:22,041][106225] Updated weights for policy 1, policy_version 492909 (0.0008) [2023-12-27 22:46:22,498][106226] Updated weights for policy 0, policy_version 491453 (0.0008) [2023-12-27 22:46:22,558][106226] Updated weights for policy 0, policy_version 491463 (0.0009) [2023-12-27 22:46:22,621][106226] Updated weights for policy 0, policy_version 491473 (0.0009) [2023-12-27 22:46:22,847][106225] Updated weights for policy 1, policy_version 492919 (0.0008) [2023-12-27 22:46:22,903][106225] Updated weights for policy 1, policy_version 492929 (0.0009) [2023-12-27 22:46:22,957][106225] Updated weights for policy 1, policy_version 492939 (0.0009) [2023-12-27 22:46:23,334][106226] Updated weights for policy 0, policy_version 491483 (0.0008) [2023-12-27 22:46:23,392][106226] Updated weights for policy 0, policy_version 491493 (0.0010) [2023-12-27 22:46:23,445][106226] Updated weights for policy 0, policy_version 491503 (0.0009) [2023-12-27 22:46:23,611][106225] Updated weights for policy 1, policy_version 492949 (0.0006) [2023-12-27 22:46:23,673][106225] Updated weights for policy 1, policy_version 492959 (0.0005) [2023-12-27 22:46:23,721][106225] Updated weights for policy 1, policy_version 492969 (0.0005) [2023-12-27 22:46:24,194][106226] Updated weights for policy 0, policy_version 491513 (0.0010) [2023-12-27 22:46:24,255][106226] Updated weights for policy 0, policy_version 491523 (0.0009) [2023-12-27 22:46:24,286][106225] Updated weights for policy 1, policy_version 492979 (0.0006) [2023-12-27 22:46:24,318][106226] Updated weights for policy 0, policy_version 491533 (0.0008) [2023-12-27 22:46:24,347][106225] Updated weights for policy 1, policy_version 492989 (0.0006) [2023-12-27 22:46:24,371][106226] Updated weights for policy 0, policy_version 491543 (0.0007) [2023-12-27 22:46:24,406][106225] Updated weights for policy 1, policy_version 492999 (0.0006) [2023-12-27 22:46:25,050][106225] Updated weights for policy 1, policy_version 493009 (0.0005) [2023-12-27 22:46:25,115][106225] Updated weights for policy 1, policy_version 493019 (0.0006) [2023-12-27 22:46:25,142][106226] Updated weights for policy 0, policy_version 491553 (0.0008) [2023-12-27 22:46:25,177][106225] Updated weights for policy 1, policy_version 493029 (0.0007) [2023-12-27 22:46:25,203][106226] Updated weights for policy 0, policy_version 491563 (0.0006) [2023-12-27 22:46:25,233][106225] Updated weights for policy 1, policy_version 493039 (0.0007) [2023-12-27 22:46:25,258][106226] Updated weights for policy 0, policy_version 491573 (0.0006) [2023-12-27 22:46:25,908][106225] Updated weights for policy 1, policy_version 493049 (0.0006) [2023-12-27 22:46:25,956][106226] Updated weights for policy 0, policy_version 491583 (0.0009) [2023-12-27 22:46:25,967][106225] Updated weights for policy 1, policy_version 493059 (0.0006) [2023-12-27 22:46:26,022][106226] Updated weights for policy 0, policy_version 491593 (0.0007) [2023-12-27 22:46:26,026][106225] Updated weights for policy 1, policy_version 493069 (0.0008) [2023-12-27 22:46:26,082][106226] Updated weights for policy 0, policy_version 491603 (0.0009) [2023-12-27 22:46:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 252141568. Throughput: 0: 9601.6, 1: 9728.8. Samples: 252104440. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:26,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-5.602')] [2023-12-27 22:46:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000493072_126255104.pth... [2023-12-27 22:46:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000491608_125886464.pth... [2023-12-27 22:46:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000491920_125960192.pth [2023-12-27 22:46:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000490488_125599744.pth [2023-12-27 22:46:26,707][106225] Updated weights for policy 1, policy_version 493079 (0.0010) [2023-12-27 22:46:26,759][106225] Updated weights for policy 1, policy_version 493089 (0.0010) [2023-12-27 22:46:26,814][106225] Updated weights for policy 1, policy_version 493099 (0.0010) [2023-12-27 22:46:26,815][106226] Updated weights for policy 0, policy_version 491613 (0.0007) [2023-12-27 22:46:26,872][106226] Updated weights for policy 0, policy_version 491623 (0.0007) [2023-12-27 22:46:26,924][106226] Updated weights for policy 0, policy_version 491633 (0.0007) [2023-12-27 22:46:27,450][106225] Updated weights for policy 1, policy_version 493109 (0.0007) [2023-12-27 22:46:27,502][106225] Updated weights for policy 1, policy_version 493119 (0.0006) [2023-12-27 22:46:27,564][106225] Updated weights for policy 1, policy_version 493129 (0.0008) [2023-12-27 22:46:27,694][106226] Updated weights for policy 0, policy_version 491643 (0.0008) [2023-12-27 22:46:27,743][106226] Updated weights for policy 0, policy_version 491653 (0.0009) [2023-12-27 22:46:27,791][106226] Updated weights for policy 0, policy_version 491663 (0.0008) [2023-12-27 22:46:28,236][106225] Updated weights for policy 1, policy_version 493139 (0.0008) [2023-12-27 22:46:28,287][106225] Updated weights for policy 1, policy_version 493149 (0.0008) [2023-12-27 22:46:28,354][106225] Updated weights for policy 1, policy_version 493159 (0.0009) [2023-12-27 22:46:28,452][106226] Updated weights for policy 0, policy_version 491673 (0.0005) [2023-12-27 22:46:28,516][106226] Updated weights for policy 0, policy_version 491683 (0.0005) [2023-12-27 22:46:28,576][106226] Updated weights for policy 0, policy_version 491693 (0.0008) [2023-12-27 22:46:28,642][106226] Updated weights for policy 0, policy_version 491703 (0.0009) [2023-12-27 22:46:29,106][106225] Updated weights for policy 1, policy_version 493169 (0.0009) [2023-12-27 22:46:29,159][106225] Updated weights for policy 1, policy_version 493179 (0.0009) [2023-12-27 22:46:29,208][106225] Updated weights for policy 1, policy_version 493189 (0.0009) [2023-12-27 22:46:29,276][106225] Updated weights for policy 1, policy_version 493199 (0.0008) [2023-12-27 22:46:29,328][106226] Updated weights for policy 0, policy_version 491713 (0.0008) [2023-12-27 22:46:29,395][106226] Updated weights for policy 0, policy_version 491723 (0.0007) [2023-12-27 22:46:29,460][106226] Updated weights for policy 0, policy_version 491733 (0.0009) [2023-12-27 22:46:29,960][106225] Updated weights for policy 1, policy_version 493209 (0.0008) [2023-12-27 22:46:30,030][106225] Updated weights for policy 1, policy_version 493219 (0.0008) [2023-12-27 22:46:30,099][106225] Updated weights for policy 1, policy_version 493229 (0.0008) [2023-12-27 22:46:30,151][106226] Updated weights for policy 0, policy_version 491743 (0.0007) [2023-12-27 22:46:30,217][106226] Updated weights for policy 0, policy_version 491753 (0.0008) [2023-12-27 22:46:30,264][106226] Updated weights for policy 0, policy_version 491763 (0.0008) [2023-12-27 22:46:30,829][106225] Updated weights for policy 1, policy_version 493239 (0.0006) [2023-12-27 22:46:30,884][106225] Updated weights for policy 1, policy_version 493249 (0.0005) [2023-12-27 22:46:30,939][106225] Updated weights for policy 1, policy_version 493259 (0.0007) [2023-12-27 22:46:31,014][106226] Updated weights for policy 0, policy_version 491773 (0.0008) [2023-12-27 22:46:31,094][106226] Updated weights for policy 0, policy_version 491783 (0.0007) [2023-12-27 22:46:31,166][106226] Updated weights for policy 0, policy_version 491793 (0.0008) [2023-12-27 22:46:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 252231680. Throughput: 0: 9624.9, 1: 9836.6. Samples: 252224136. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:31,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-5.470')] [2023-12-27 22:46:31,634][106225] Updated weights for policy 1, policy_version 493269 (0.0008) [2023-12-27 22:46:31,698][106225] Updated weights for policy 1, policy_version 493279 (0.0010) [2023-12-27 22:46:31,768][106225] Updated weights for policy 1, policy_version 493289 (0.0010) [2023-12-27 22:46:31,925][106226] Updated weights for policy 0, policy_version 491803 (0.0007) [2023-12-27 22:46:31,992][106226] Updated weights for policy 0, policy_version 491813 (0.0009) [2023-12-27 22:46:32,055][106226] Updated weights for policy 0, policy_version 491823 (0.0009) [2023-12-27 22:46:32,370][106225] Updated weights for policy 1, policy_version 493299 (0.0010) [2023-12-27 22:46:32,427][106225] Updated weights for policy 1, policy_version 493309 (0.0010) [2023-12-27 22:46:32,485][106225] Updated weights for policy 1, policy_version 493319 (0.0010) [2023-12-27 22:46:32,820][106226] Updated weights for policy 0, policy_version 491833 (0.0008) [2023-12-27 22:46:32,882][106226] Updated weights for policy 0, policy_version 491843 (0.0007) [2023-12-27 22:46:32,944][106226] Updated weights for policy 0, policy_version 491853 (0.0010) [2023-12-27 22:46:32,994][106226] Updated weights for policy 0, policy_version 491863 (0.0008) [2023-12-27 22:46:33,100][106225] Updated weights for policy 1, policy_version 493329 (0.0010) [2023-12-27 22:46:33,165][106225] Updated weights for policy 1, policy_version 493339 (0.0010) [2023-12-27 22:46:33,222][106225] Updated weights for policy 1, policy_version 493349 (0.0011) [2023-12-27 22:46:33,269][106225] Updated weights for policy 1, policy_version 493359 (0.0010) [2023-12-27 22:46:33,763][106226] Updated weights for policy 0, policy_version 491873 (0.0008) [2023-12-27 22:46:33,814][106226] Updated weights for policy 0, policy_version 491883 (0.0008) [2023-12-27 22:46:33,857][106226] Updated weights for policy 0, policy_version 491893 (0.0008) [2023-12-27 22:46:33,977][106225] Updated weights for policy 1, policy_version 493369 (0.0011) [2023-12-27 22:46:34,041][106225] Updated weights for policy 1, policy_version 493379 (0.0010) [2023-12-27 22:46:34,102][106225] Updated weights for policy 1, policy_version 493389 (0.0010) [2023-12-27 22:46:34,578][106226] Updated weights for policy 0, policy_version 491903 (0.0008) [2023-12-27 22:46:34,638][106226] Updated weights for policy 0, policy_version 491913 (0.0008) [2023-12-27 22:46:34,696][106226] Updated weights for policy 0, policy_version 491923 (0.0008) [2023-12-27 22:46:34,807][106225] Updated weights for policy 1, policy_version 493399 (0.0011) [2023-12-27 22:46:34,865][106225] Updated weights for policy 1, policy_version 493409 (0.0011) [2023-12-27 22:46:34,924][106225] Updated weights for policy 1, policy_version 493419 (0.0008) [2023-12-27 22:46:35,474][106226] Updated weights for policy 0, policy_version 491933 (0.0008) [2023-12-27 22:46:35,502][106225] Updated weights for policy 1, policy_version 493429 (0.0005) [2023-12-27 22:46:35,529][106226] Updated weights for policy 0, policy_version 491943 (0.0005) [2023-12-27 22:46:35,563][106225] Updated weights for policy 1, policy_version 493439 (0.0010) [2023-12-27 22:46:35,588][106226] Updated weights for policy 0, policy_version 491953 (0.0005) [2023-12-27 22:46:35,620][106225] Updated weights for policy 1, policy_version 493449 (0.0010) [2023-12-27 22:46:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 252329984. Throughput: 0: 9557.5, 1: 9839.0. Samples: 252341808. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:36,175][105115] Avg episode reward: [(0, '-4.950'), (1, '-5.453')] [2023-12-27 22:46:36,300][106226] Updated weights for policy 0, policy_version 491963 (0.0007) [2023-12-27 22:46:36,315][106225] Updated weights for policy 1, policy_version 493459 (0.0010) [2023-12-27 22:46:36,364][106226] Updated weights for policy 0, policy_version 491973 (0.0006) [2023-12-27 22:46:36,377][106225] Updated weights for policy 1, policy_version 493469 (0.0011) [2023-12-27 22:46:36,423][106226] Updated weights for policy 0, policy_version 491983 (0.0005) [2023-12-27 22:46:36,440][106225] Updated weights for policy 1, policy_version 493479 (0.0010) [2023-12-27 22:46:37,153][106226] Updated weights for policy 0, policy_version 491993 (0.0006) [2023-12-27 22:46:37,159][106225] Updated weights for policy 1, policy_version 493489 (0.0011) [2023-12-27 22:46:37,208][106226] Updated weights for policy 0, policy_version 492003 (0.0008) [2023-12-27 22:46:37,212][106225] Updated weights for policy 1, policy_version 493499 (0.0010) [2023-12-27 22:46:37,263][106225] Updated weights for policy 1, policy_version 493509 (0.0010) [2023-12-27 22:46:37,265][106226] Updated weights for policy 0, policy_version 492013 (0.0006) [2023-12-27 22:46:37,322][106226] Updated weights for policy 0, policy_version 492023 (0.0006) [2023-12-27 22:46:37,323][106225] Updated weights for policy 1, policy_version 493519 (0.0010) [2023-12-27 22:46:37,989][106225] Updated weights for policy 1, policy_version 493529 (0.0010) [2023-12-27 22:46:38,043][106225] Updated weights for policy 1, policy_version 493539 (0.0010) [2023-12-27 22:46:38,065][106226] Updated weights for policy 0, policy_version 492033 (0.0006) [2023-12-27 22:46:38,100][106225] Updated weights for policy 1, policy_version 493549 (0.0010) [2023-12-27 22:46:38,115][106226] Updated weights for policy 0, policy_version 492043 (0.0008) [2023-12-27 22:46:38,165][106226] Updated weights for policy 0, policy_version 492053 (0.0008) [2023-12-27 22:46:38,805][106226] Updated weights for policy 0, policy_version 492063 (0.0006) [2023-12-27 22:46:38,859][106226] Updated weights for policy 0, policy_version 492073 (0.0009) [2023-12-27 22:46:38,877][106225] Updated weights for policy 1, policy_version 493559 (0.0010) [2023-12-27 22:46:38,908][106226] Updated weights for policy 0, policy_version 492083 (0.0009) [2023-12-27 22:46:38,937][106225] Updated weights for policy 1, policy_version 493569 (0.0008) [2023-12-27 22:46:38,999][106225] Updated weights for policy 1, policy_version 493579 (0.0005) [2023-12-27 22:46:39,584][106226] Updated weights for policy 0, policy_version 492093 (0.0007) [2023-12-27 22:46:39,626][106225] Updated weights for policy 1, policy_version 493589 (0.0006) [2023-12-27 22:46:39,647][106226] Updated weights for policy 0, policy_version 492103 (0.0008) [2023-12-27 22:46:39,687][106225] Updated weights for policy 1, policy_version 493599 (0.0006) [2023-12-27 22:46:39,709][106226] Updated weights for policy 0, policy_version 492113 (0.0008) [2023-12-27 22:46:39,755][106225] Updated weights for policy 1, policy_version 493609 (0.0006) [2023-12-27 22:46:40,404][106225] Updated weights for policy 1, policy_version 493619 (0.0008) [2023-12-27 22:46:40,468][106225] Updated weights for policy 1, policy_version 493629 (0.0008) [2023-12-27 22:46:40,478][106226] Updated weights for policy 0, policy_version 492123 (0.0007) [2023-12-27 22:46:40,522][106225] Updated weights for policy 1, policy_version 493639 (0.0010) [2023-12-27 22:46:40,539][106226] Updated weights for policy 0, policy_version 492133 (0.0006) [2023-12-27 22:46:40,597][106226] Updated weights for policy 0, policy_version 492143 (0.0006) [2023-12-27 22:46:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 252428288. Throughput: 0: 9598.7, 1: 9856.4. Samples: 252400928. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:41,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.558')] [2023-12-27 22:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000493648_126402560.pth... [2023-12-27 22:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000492152_126025728.pth... [2023-12-27 22:46:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000491032_125739008.pth [2023-12-27 22:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000492496_126107648.pth [2023-12-27 22:46:41,279][106226] Updated weights for policy 0, policy_version 492153 (0.0008) [2023-12-27 22:46:41,299][106225] Updated weights for policy 1, policy_version 493649 (0.0010) [2023-12-27 22:46:41,342][106226] Updated weights for policy 0, policy_version 492163 (0.0007) [2023-12-27 22:46:41,364][106225] Updated weights for policy 1, policy_version 493659 (0.0007) [2023-12-27 22:46:41,404][106226] Updated weights for policy 0, policy_version 492173 (0.0008) [2023-12-27 22:46:41,426][106225] Updated weights for policy 1, policy_version 493669 (0.0008) [2023-12-27 22:46:41,467][106226] Updated weights for policy 0, policy_version 492183 (0.0009) [2023-12-27 22:46:41,483][106225] Updated weights for policy 1, policy_version 493679 (0.0005) [2023-12-27 22:46:42,173][106225] Updated weights for policy 1, policy_version 493689 (0.0008) [2023-12-27 22:46:42,238][106225] Updated weights for policy 1, policy_version 493699 (0.0009) [2023-12-27 22:46:42,257][106226] Updated weights for policy 0, policy_version 492193 (0.0007) [2023-12-27 22:46:42,301][106225] Updated weights for policy 1, policy_version 493709 (0.0007) [2023-12-27 22:46:42,311][106226] Updated weights for policy 0, policy_version 492203 (0.0007) [2023-12-27 22:46:42,384][106226] Updated weights for policy 0, policy_version 492213 (0.0009) [2023-12-27 22:46:43,052][106225] Updated weights for policy 1, policy_version 493719 (0.0006) [2023-12-27 22:46:43,056][106226] Updated weights for policy 0, policy_version 492223 (0.0006) [2023-12-27 22:46:43,115][106225] Updated weights for policy 1, policy_version 493729 (0.0008) [2023-12-27 22:46:43,115][106226] Updated weights for policy 0, policy_version 492233 (0.0005) [2023-12-27 22:46:43,163][106225] Updated weights for policy 1, policy_version 493739 (0.0008) [2023-12-27 22:46:43,175][106226] Updated weights for policy 0, policy_version 492243 (0.0006) [2023-12-27 22:46:43,713][106226] Updated weights for policy 0, policy_version 492253 (0.0007) [2023-12-27 22:46:43,761][106226] Updated weights for policy 0, policy_version 492263 (0.0008) [2023-12-27 22:46:43,800][106225] Updated weights for policy 1, policy_version 493749 (0.0007) [2023-12-27 22:46:43,814][106226] Updated weights for policy 0, policy_version 492273 (0.0008) [2023-12-27 22:46:43,858][106225] Updated weights for policy 1, policy_version 493759 (0.0008) [2023-12-27 22:46:43,916][106225] Updated weights for policy 1, policy_version 493769 (0.0009) [2023-12-27 22:46:44,543][106226] Updated weights for policy 0, policy_version 492283 (0.0007) [2023-12-27 22:46:44,591][106226] Updated weights for policy 0, policy_version 492293 (0.0010) [2023-12-27 22:46:44,609][106225] Updated weights for policy 1, policy_version 493779 (0.0008) [2023-12-27 22:46:44,656][106226] Updated weights for policy 0, policy_version 492303 (0.0011) [2023-12-27 22:46:44,674][106225] Updated weights for policy 1, policy_version 493789 (0.0006) [2023-12-27 22:46:44,732][106225] Updated weights for policy 1, policy_version 493799 (0.0007) [2023-12-27 22:46:45,393][106225] Updated weights for policy 1, policy_version 493809 (0.0007) [2023-12-27 22:46:45,402][106226] Updated weights for policy 0, policy_version 492313 (0.0011) [2023-12-27 22:46:45,438][106225] Updated weights for policy 1, policy_version 493819 (0.0007) [2023-12-27 22:46:45,459][106226] Updated weights for policy 0, policy_version 492323 (0.0010) [2023-12-27 22:46:45,489][106225] Updated weights for policy 1, policy_version 493829 (0.0006) [2023-12-27 22:46:45,518][106226] Updated weights for policy 0, policy_version 492333 (0.0011) [2023-12-27 22:46:45,555][106225] Updated weights for policy 1, policy_version 493839 (0.0006) [2023-12-27 22:46:45,577][106226] Updated weights for policy 0, policy_version 492343 (0.0011) [2023-12-27 22:46:46,173][106225] Updated weights for policy 1, policy_version 493849 (0.0010) [2023-12-27 22:46:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 252526592. Throughput: 0: 9634.3, 1: 9915.8. Samples: 252519020. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:46,175][105115] Avg episode reward: [(0, '-5.058'), (1, '-5.529')] [2023-12-27 22:46:46,222][106226] Updated weights for policy 0, policy_version 492353 (0.0011) [2023-12-27 22:46:46,232][106225] Updated weights for policy 1, policy_version 493859 (0.0007) [2023-12-27 22:46:46,275][106226] Updated weights for policy 0, policy_version 492363 (0.0011) [2023-12-27 22:46:46,292][106225] Updated weights for policy 1, policy_version 493869 (0.0005) [2023-12-27 22:46:46,330][106226] Updated weights for policy 0, policy_version 492373 (0.0010) [2023-12-27 22:46:46,853][106225] Updated weights for policy 1, policy_version 493879 (0.0005) [2023-12-27 22:46:46,913][106225] Updated weights for policy 1, policy_version 493889 (0.0006) [2023-12-27 22:46:46,973][106225] Updated weights for policy 1, policy_version 493899 (0.0007) [2023-12-27 22:46:47,016][106226] Updated weights for policy 0, policy_version 492383 (0.0010) [2023-12-27 22:46:47,062][106226] Updated weights for policy 0, policy_version 492393 (0.0006) [2023-12-27 22:46:47,109][106226] Updated weights for policy 0, policy_version 492403 (0.0005) [2023-12-27 22:46:47,555][106225] Updated weights for policy 1, policy_version 493909 (0.0006) [2023-12-27 22:46:47,619][106225] Updated weights for policy 1, policy_version 493919 (0.0006) [2023-12-27 22:46:47,672][106226] Updated weights for policy 0, policy_version 492413 (0.0007) [2023-12-27 22:46:47,676][106225] Updated weights for policy 1, policy_version 493929 (0.0005) [2023-12-27 22:46:47,733][106226] Updated weights for policy 0, policy_version 492423 (0.0008) [2023-12-27 22:46:47,792][106226] Updated weights for policy 0, policy_version 492433 (0.0008) [2023-12-27 22:46:48,277][106225] Updated weights for policy 1, policy_version 493939 (0.0007) [2023-12-27 22:46:48,331][106225] Updated weights for policy 1, policy_version 493949 (0.0009) [2023-12-27 22:46:48,399][106225] Updated weights for policy 1, policy_version 493959 (0.0009) [2023-12-27 22:46:48,522][106226] Updated weights for policy 0, policy_version 492443 (0.0006) [2023-12-27 22:46:48,589][106226] Updated weights for policy 0, policy_version 492453 (0.0007) [2023-12-27 22:46:48,652][106226] Updated weights for policy 0, policy_version 492463 (0.0008) [2023-12-27 22:46:49,061][106225] Updated weights for policy 1, policy_version 493969 (0.0008) [2023-12-27 22:46:49,116][106225] Updated weights for policy 1, policy_version 493979 (0.0008) [2023-12-27 22:46:49,177][106225] Updated weights for policy 1, policy_version 493989 (0.0010) [2023-12-27 22:46:49,248][106225] Updated weights for policy 1, policy_version 493999 (0.0009) [2023-12-27 22:46:49,302][106226] Updated weights for policy 0, policy_version 492473 (0.0008) [2023-12-27 22:46:49,373][106226] Updated weights for policy 0, policy_version 492483 (0.0010) [2023-12-27 22:46:49,437][106226] Updated weights for policy 0, policy_version 492493 (0.0011) [2023-12-27 22:46:49,501][106226] Updated weights for policy 0, policy_version 492503 (0.0010) [2023-12-27 22:46:49,953][106225] Updated weights for policy 1, policy_version 494009 (0.0010) [2023-12-27 22:46:50,019][106225] Updated weights for policy 1, policy_version 494019 (0.0010) [2023-12-27 22:46:50,077][106225] Updated weights for policy 1, policy_version 494029 (0.0008) [2023-12-27 22:46:50,214][106226] Updated weights for policy 0, policy_version 492513 (0.0008) [2023-12-27 22:46:50,279][106226] Updated weights for policy 0, policy_version 492523 (0.0011) [2023-12-27 22:46:50,346][106226] Updated weights for policy 0, policy_version 492533 (0.0010) [2023-12-27 22:46:50,783][106225] Updated weights for policy 1, policy_version 494039 (0.0008) [2023-12-27 22:46:50,842][106225] Updated weights for policy 1, policy_version 494049 (0.0007) [2023-12-27 22:46:50,896][106225] Updated weights for policy 1, policy_version 494059 (0.0007) [2023-12-27 22:46:51,038][106226] Updated weights for policy 0, policy_version 492543 (0.0011) [2023-12-27 22:46:51,105][106226] Updated weights for policy 0, policy_version 492553 (0.0010) [2023-12-27 22:46:51,166][106226] Updated weights for policy 0, policy_version 492563 (0.0008) [2023-12-27 22:46:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 252633088. Throughput: 0: 9659.5, 1: 10063.7. Samples: 252644968. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:51,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-5.702')] [2023-12-27 22:46:51,625][106225] Updated weights for policy 1, policy_version 494069 (0.0008) [2023-12-27 22:46:51,691][106225] Updated weights for policy 1, policy_version 494079 (0.0007) [2023-12-27 22:46:51,755][106225] Updated weights for policy 1, policy_version 494089 (0.0008) [2023-12-27 22:46:51,885][106226] Updated weights for policy 0, policy_version 492573 (0.0008) [2023-12-27 22:46:51,935][106226] Updated weights for policy 0, policy_version 492583 (0.0008) [2023-12-27 22:46:51,985][106226] Updated weights for policy 0, policy_version 492593 (0.0008) [2023-12-27 22:46:52,493][106225] Updated weights for policy 1, policy_version 494099 (0.0010) [2023-12-27 22:46:52,551][106225] Updated weights for policy 1, policy_version 494109 (0.0009) [2023-12-27 22:46:52,604][106225] Updated weights for policy 1, policy_version 494119 (0.0009) [2023-12-27 22:46:52,653][106226] Updated weights for policy 0, policy_version 492603 (0.0008) [2023-12-27 22:46:52,699][106226] Updated weights for policy 0, policy_version 492613 (0.0007) [2023-12-27 22:46:52,753][106226] Updated weights for policy 0, policy_version 492623 (0.0008) [2023-12-27 22:46:53,285][106225] Updated weights for policy 1, policy_version 494129 (0.0010) [2023-12-27 22:46:53,334][106225] Updated weights for policy 1, policy_version 494139 (0.0005) [2023-12-27 22:46:53,351][106226] Updated weights for policy 0, policy_version 492633 (0.0007) [2023-12-27 22:46:53,403][106225] Updated weights for policy 1, policy_version 494149 (0.0005) [2023-12-27 22:46:53,417][106226] Updated weights for policy 0, policy_version 492643 (0.0005) [2023-12-27 22:46:53,462][106225] Updated weights for policy 1, policy_version 494159 (0.0005) [2023-12-27 22:46:53,480][106226] Updated weights for policy 0, policy_version 492653 (0.0005) [2023-12-27 22:46:53,533][106226] Updated weights for policy 0, policy_version 492663 (0.0008) [2023-12-27 22:46:54,051][106225] Updated weights for policy 1, policy_version 494169 (0.0010) [2023-12-27 22:46:54,105][106225] Updated weights for policy 1, policy_version 494179 (0.0010) [2023-12-27 22:46:54,158][106225] Updated weights for policy 1, policy_version 494189 (0.0010) [2023-12-27 22:46:54,204][106226] Updated weights for policy 0, policy_version 492673 (0.0008) [2023-12-27 22:46:54,261][106226] Updated weights for policy 0, policy_version 492683 (0.0008) [2023-12-27 22:46:54,311][106226] Updated weights for policy 0, policy_version 492693 (0.0008) [2023-12-27 22:46:54,893][106225] Updated weights for policy 1, policy_version 494199 (0.0010) [2023-12-27 22:46:54,943][106225] Updated weights for policy 1, policy_version 494209 (0.0010) [2023-12-27 22:46:55,008][106225] Updated weights for policy 1, policy_version 494219 (0.0010) [2023-12-27 22:46:55,053][106226] Updated weights for policy 0, policy_version 492703 (0.0007) [2023-12-27 22:46:55,114][106226] Updated weights for policy 0, policy_version 492713 (0.0008) [2023-12-27 22:46:55,175][106226] Updated weights for policy 0, policy_version 492723 (0.0008) [2023-12-27 22:46:55,720][106225] Updated weights for policy 1, policy_version 494229 (0.0010) [2023-12-27 22:46:55,772][106225] Updated weights for policy 1, policy_version 494239 (0.0010) [2023-12-27 22:46:55,825][106225] Updated weights for policy 1, policy_version 494249 (0.0010) [2023-12-27 22:46:55,904][106226] Updated weights for policy 0, policy_version 492733 (0.0008) [2023-12-27 22:46:55,964][106226] Updated weights for policy 0, policy_version 492743 (0.0008) [2023-12-27 22:46:56,018][106226] Updated weights for policy 0, policy_version 492753 (0.0008) [2023-12-27 22:46:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 252739584. Throughput: 0: 9728.4, 1: 10054.6. Samples: 252706312. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:46:56,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-5.749')] [2023-12-27 22:46:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000492760_126181376.pth... [2023-12-27 22:46:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000494256_126558208.pth... [2023-12-27 22:46:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000491608_125886464.pth [2023-12-27 22:46:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000493072_126255104.pth [2023-12-27 22:46:56,563][106225] Updated weights for policy 1, policy_version 494259 (0.0010) [2023-12-27 22:46:56,612][106225] Updated weights for policy 1, policy_version 494269 (0.0010) [2023-12-27 22:46:56,655][106225] Updated weights for policy 1, policy_version 494279 (0.0010) [2023-12-27 22:46:56,751][106226] Updated weights for policy 0, policy_version 492763 (0.0008) [2023-12-27 22:46:56,817][106226] Updated weights for policy 0, policy_version 492773 (0.0008) [2023-12-27 22:46:56,877][106226] Updated weights for policy 0, policy_version 492783 (0.0008) [2023-12-27 22:46:57,377][106225] Updated weights for policy 1, policy_version 494289 (0.0010) [2023-12-27 22:46:57,441][106225] Updated weights for policy 1, policy_version 494299 (0.0007) [2023-12-27 22:46:57,497][106225] Updated weights for policy 1, policy_version 494309 (0.0005) [2023-12-27 22:46:57,564][106225] Updated weights for policy 1, policy_version 494319 (0.0005) [2023-12-27 22:46:57,580][106226] Updated weights for policy 0, policy_version 492793 (0.0008) [2023-12-27 22:46:57,634][106226] Updated weights for policy 0, policy_version 492803 (0.0009) [2023-12-27 22:46:57,688][106226] Updated weights for policy 0, policy_version 492813 (0.0007) [2023-12-27 22:46:57,749][106226] Updated weights for policy 0, policy_version 492823 (0.0010) [2023-12-27 22:46:58,154][106225] Updated weights for policy 1, policy_version 494329 (0.0010) [2023-12-27 22:46:58,207][106225] Updated weights for policy 1, policy_version 494339 (0.0010) [2023-12-27 22:46:58,266][106225] Updated weights for policy 1, policy_version 494349 (0.0006) [2023-12-27 22:46:58,470][106226] Updated weights for policy 0, policy_version 492833 (0.0011) [2023-12-27 22:46:58,536][106226] Updated weights for policy 0, policy_version 492843 (0.0007) [2023-12-27 22:46:58,602][106226] Updated weights for policy 0, policy_version 492853 (0.0011) [2023-12-27 22:46:59,123][106225] Updated weights for policy 1, policy_version 494359 (0.0008) [2023-12-27 22:46:59,183][106225] Updated weights for policy 1, policy_version 494369 (0.0008) [2023-12-27 22:46:59,251][106225] Updated weights for policy 1, policy_version 494379 (0.0011) [2023-12-27 22:46:59,462][106226] Updated weights for policy 0, policy_version 492863 (0.0007) [2023-12-27 22:46:59,534][106226] Updated weights for policy 0, policy_version 492873 (0.0006) [2023-12-27 22:46:59,591][106226] Updated weights for policy 0, policy_version 492883 (0.0005) [2023-12-27 22:46:59,951][106225] Updated weights for policy 1, policy_version 494390 (0.0008) [2023-12-27 22:46:59,997][106225] Updated weights for policy 1, policy_version 494400 (0.0007) [2023-12-27 22:47:00,052][106225] Updated weights for policy 1, policy_version 494410 (0.0008) [2023-12-27 22:47:00,268][106226] Updated weights for policy 0, policy_version 492893 (0.0010) [2023-12-27 22:47:00,327][106226] Updated weights for policy 0, policy_version 492903 (0.0011) [2023-12-27 22:47:00,382][106226] Updated weights for policy 0, policy_version 492913 (0.0007) [2023-12-27 22:47:00,828][106225] Updated weights for policy 1, policy_version 494420 (0.0008) [2023-12-27 22:47:00,884][106225] Updated weights for policy 1, policy_version 494430 (0.0008) [2023-12-27 22:47:00,943][106225] Updated weights for policy 1, policy_version 494440 (0.0007) [2023-12-27 22:47:01,042][106226] Updated weights for policy 0, policy_version 492923 (0.0009) [2023-12-27 22:47:01,100][106226] Updated weights for policy 0, policy_version 492933 (0.0010) [2023-12-27 22:47:01,164][106226] Updated weights for policy 0, policy_version 492943 (0.0009) [2023-12-27 22:47:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 252829696. Throughput: 0: 9710.4, 1: 10095.8. Samples: 252821212. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:47:01,175][105115] Avg episode reward: [(0, '-5.063'), (1, '-5.737')] [2023-12-27 22:47:01,632][106225] Updated weights for policy 1, policy_version 494450 (0.0008) [2023-12-27 22:47:01,693][106225] Updated weights for policy 1, policy_version 494460 (0.0007) [2023-12-27 22:47:01,763][106225] Updated weights for policy 1, policy_version 494470 (0.0007) [2023-12-27 22:47:01,822][106225] Updated weights for policy 1, policy_version 494480 (0.0007) [2023-12-27 22:47:01,884][106226] Updated weights for policy 0, policy_version 492953 (0.0011) [2023-12-27 22:47:01,945][106226] Updated weights for policy 0, policy_version 492963 (0.0011) [2023-12-27 22:47:02,002][106226] Updated weights for policy 0, policy_version 492973 (0.0011) [2023-12-27 22:47:02,063][106226] Updated weights for policy 0, policy_version 492983 (0.0011) [2023-12-27 22:47:02,528][106225] Updated weights for policy 1, policy_version 494490 (0.0005) [2023-12-27 22:47:02,581][106225] Updated weights for policy 1, policy_version 494500 (0.0005) [2023-12-27 22:47:02,636][106225] Updated weights for policy 1, policy_version 494510 (0.0007) [2023-12-27 22:47:02,731][106226] Updated weights for policy 0, policy_version 492993 (0.0011) [2023-12-27 22:47:02,790][106226] Updated weights for policy 0, policy_version 493003 (0.0011) [2023-12-27 22:47:02,851][106226] Updated weights for policy 0, policy_version 493013 (0.0005) [2023-12-27 22:47:03,249][106225] Updated weights for policy 1, policy_version 494520 (0.0006) [2023-12-27 22:47:03,306][106225] Updated weights for policy 1, policy_version 494530 (0.0007) [2023-12-27 22:47:03,359][106225] Updated weights for policy 1, policy_version 494540 (0.0005) [2023-12-27 22:47:03,475][106226] Updated weights for policy 0, policy_version 493023 (0.0006) [2023-12-27 22:47:03,522][106226] Updated weights for policy 0, policy_version 493033 (0.0005) [2023-12-27 22:47:03,575][106226] Updated weights for policy 0, policy_version 493043 (0.0005) [2023-12-27 22:47:03,901][106225] Updated weights for policy 1, policy_version 494550 (0.0007) [2023-12-27 22:47:03,967][106225] Updated weights for policy 1, policy_version 494560 (0.0008) [2023-12-27 22:47:04,027][106225] Updated weights for policy 1, policy_version 494570 (0.0008) [2023-12-27 22:47:04,220][106226] Updated weights for policy 0, policy_version 493053 (0.0007) [2023-12-27 22:47:04,286][106226] Updated weights for policy 0, policy_version 493063 (0.0011) [2023-12-27 22:47:04,349][106226] Updated weights for policy 0, policy_version 493073 (0.0009) [2023-12-27 22:47:04,825][106225] Updated weights for policy 1, policy_version 494580 (0.0008) [2023-12-27 22:47:04,879][106225] Updated weights for policy 1, policy_version 494590 (0.0008) [2023-12-27 22:47:04,923][106226] Updated weights for policy 0, policy_version 493083 (0.0006) [2023-12-27 22:47:04,926][106225] Updated weights for policy 1, policy_version 494600 (0.0008) [2023-12-27 22:47:04,978][106226] Updated weights for policy 0, policy_version 493093 (0.0006) [2023-12-27 22:47:05,042][106226] Updated weights for policy 0, policy_version 493103 (0.0009) [2023-12-27 22:47:05,659][106226] Updated weights for policy 0, policy_version 493113 (0.0009) [2023-12-27 22:47:05,710][106225] Updated weights for policy 1, policy_version 494610 (0.0008) [2023-12-27 22:47:05,715][106226] Updated weights for policy 0, policy_version 493123 (0.0008) [2023-12-27 22:47:05,768][106226] Updated weights for policy 0, policy_version 493133 (0.0008) [2023-12-27 22:47:05,768][106225] Updated weights for policy 1, policy_version 494620 (0.0008) [2023-12-27 22:47:05,827][106225] Updated weights for policy 1, policy_version 494630 (0.0010) [2023-12-27 22:47:05,829][106226] Updated weights for policy 0, policy_version 493143 (0.0008) [2023-12-27 22:47:05,881][106225] Updated weights for policy 1, policy_version 494640 (0.0008) [2023-12-27 22:47:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 252936192. Throughput: 0: 9858.0, 1: 10087.9. Samples: 252943620. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:47:06,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-5.625')] [2023-12-27 22:47:06,584][106226] Updated weights for policy 0, policy_version 493153 (0.0007) [2023-12-27 22:47:06,618][106225] Updated weights for policy 1, policy_version 494650 (0.0008) [2023-12-27 22:47:06,642][106226] Updated weights for policy 0, policy_version 493163 (0.0008) [2023-12-27 22:47:06,679][106225] Updated weights for policy 1, policy_version 494660 (0.0006) [2023-12-27 22:47:06,700][106226] Updated weights for policy 0, policy_version 493173 (0.0010) [2023-12-27 22:47:06,742][106225] Updated weights for policy 1, policy_version 494670 (0.0006) [2023-12-27 22:47:07,407][106225] Updated weights for policy 1, policy_version 494680 (0.0007) [2023-12-27 22:47:07,420][106226] Updated weights for policy 0, policy_version 493183 (0.0011) [2023-12-27 22:47:07,467][106225] Updated weights for policy 1, policy_version 494690 (0.0005) [2023-12-27 22:47:07,480][106226] Updated weights for policy 0, policy_version 493193 (0.0011) [2023-12-27 22:47:07,528][106225] Updated weights for policy 1, policy_version 494700 (0.0005) [2023-12-27 22:47:07,541][106226] Updated weights for policy 0, policy_version 493203 (0.0011) [2023-12-27 22:47:08,245][106226] Updated weights for policy 0, policy_version 493213 (0.0011) [2023-12-27 22:47:08,257][106225] Updated weights for policy 1, policy_version 494710 (0.0008) [2023-12-27 22:47:08,305][106226] Updated weights for policy 0, policy_version 493223 (0.0010) [2023-12-27 22:47:08,315][106225] Updated weights for policy 1, policy_version 494720 (0.0006) [2023-12-27 22:47:08,374][106226] Updated weights for policy 0, policy_version 493234 (0.0009) [2023-12-27 22:47:08,379][106225] Updated weights for policy 1, policy_version 494730 (0.0008) [2023-12-27 22:47:09,086][106226] Updated weights for policy 0, policy_version 493244 (0.0007) [2023-12-27 22:47:09,136][106225] Updated weights for policy 1, policy_version 494740 (0.0007) [2023-12-27 22:47:09,137][106226] Updated weights for policy 0, policy_version 493254 (0.0005) [2023-12-27 22:47:09,187][106226] Updated weights for policy 0, policy_version 493264 (0.0005) [2023-12-27 22:47:09,191][106225] Updated weights for policy 1, policy_version 494750 (0.0008) [2023-12-27 22:47:09,251][106225] Updated weights for policy 1, policy_version 494760 (0.0008) [2023-12-27 22:47:09,827][106226] Updated weights for policy 0, policy_version 493274 (0.0008) [2023-12-27 22:47:09,902][106226] Updated weights for policy 0, policy_version 493284 (0.0009) [2023-12-27 22:47:09,977][106226] Updated weights for policy 0, policy_version 493294 (0.0006) [2023-12-27 22:47:10,043][106226] Updated weights for policy 0, policy_version 493304 (0.0006) [2023-12-27 22:47:10,067][106225] Updated weights for policy 1, policy_version 494770 (0.0007) [2023-12-27 22:47:10,124][106225] Updated weights for policy 1, policy_version 494780 (0.0008) [2023-12-27 22:47:10,196][106225] Updated weights for policy 1, policy_version 494790 (0.0009) [2023-12-27 22:47:10,258][106225] Updated weights for policy 1, policy_version 494800 (0.0008) [2023-12-27 22:47:10,665][106226] Updated weights for policy 0, policy_version 493314 (0.0009) [2023-12-27 22:47:10,727][106226] Updated weights for policy 0, policy_version 493324 (0.0007) [2023-12-27 22:47:10,782][106226] Updated weights for policy 0, policy_version 493334 (0.0006) [2023-12-27 22:47:10,927][106225] Updated weights for policy 1, policy_version 494810 (0.0005) [2023-12-27 22:47:10,990][106225] Updated weights for policy 1, policy_version 494820 (0.0005) [2023-12-27 22:47:11,062][106225] Updated weights for policy 1, policy_version 494830 (0.0008) [2023-12-27 22:47:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 253034496. Throughput: 0: 9850.0, 1: 10079.1. Samples: 253001252. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:47:11,175][105115] Avg episode reward: [(0, '-4.997'), (1, '-5.784')] [2023-12-27 22:47:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000494832_126705664.pth... [2023-12-27 22:47:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000493336_126328832.pth... [2023-12-27 22:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000493648_126402560.pth [2023-12-27 22:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000492152_126025728.pth [2023-12-27 22:47:11,551][106226] Updated weights for policy 0, policy_version 493344 (0.0007) [2023-12-27 22:47:11,620][106226] Updated weights for policy 0, policy_version 493354 (0.0007) [2023-12-27 22:47:11,693][106226] Updated weights for policy 0, policy_version 493364 (0.0007) [2023-12-27 22:47:11,821][106225] Updated weights for policy 1, policy_version 494840 (0.0006) [2023-12-27 22:47:11,883][106225] Updated weights for policy 1, policy_version 494850 (0.0007) [2023-12-27 22:47:11,940][106225] Updated weights for policy 1, policy_version 494860 (0.0008) [2023-12-27 22:47:12,383][106226] Updated weights for policy 0, policy_version 493374 (0.0008) [2023-12-27 22:47:12,446][106226] Updated weights for policy 0, policy_version 493384 (0.0008) [2023-12-27 22:47:12,508][106226] Updated weights for policy 0, policy_version 493394 (0.0009) [2023-12-27 22:47:12,670][106225] Updated weights for policy 1, policy_version 494870 (0.0009) [2023-12-27 22:47:12,725][106225] Updated weights for policy 1, policy_version 494880 (0.0009) [2023-12-27 22:47:12,785][106225] Updated weights for policy 1, policy_version 494890 (0.0009) [2023-12-27 22:47:13,235][106226] Updated weights for policy 0, policy_version 493404 (0.0009) [2023-12-27 22:47:13,301][106226] Updated weights for policy 0, policy_version 493414 (0.0009) [2023-12-27 22:47:13,356][106226] Updated weights for policy 0, policy_version 493424 (0.0009) [2023-12-27 22:47:13,476][106225] Updated weights for policy 1, policy_version 494900 (0.0007) [2023-12-27 22:47:13,542][106225] Updated weights for policy 1, policy_version 494910 (0.0006) [2023-12-27 22:47:13,600][106225] Updated weights for policy 1, policy_version 494920 (0.0008) [2023-12-27 22:47:14,090][106226] Updated weights for policy 0, policy_version 493435 (0.0008) [2023-12-27 22:47:14,143][106226] Updated weights for policy 0, policy_version 493445 (0.0005) [2023-12-27 22:47:14,197][106226] Updated weights for policy 0, policy_version 493455 (0.0005) [2023-12-27 22:47:14,325][106225] Updated weights for policy 1, policy_version 494930 (0.0008) [2023-12-27 22:47:14,389][106225] Updated weights for policy 1, policy_version 494940 (0.0009) [2023-12-27 22:47:14,455][106225] Updated weights for policy 1, policy_version 494950 (0.0008) [2023-12-27 22:47:14,511][106225] Updated weights for policy 1, policy_version 494960 (0.0009) [2023-12-27 22:47:14,796][106226] Updated weights for policy 0, policy_version 493465 (0.0006) [2023-12-27 22:47:14,845][106226] Updated weights for policy 0, policy_version 493475 (0.0008) [2023-12-27 22:47:14,903][106226] Updated weights for policy 0, policy_version 493485 (0.0009) [2023-12-27 22:47:14,964][106226] Updated weights for policy 0, policy_version 493495 (0.0009) [2023-12-27 22:47:15,223][106225] Updated weights for policy 1, policy_version 494970 (0.0006) [2023-12-27 22:47:15,272][106225] Updated weights for policy 1, policy_version 494980 (0.0008) [2023-12-27 22:47:15,316][106225] Updated weights for policy 1, policy_version 494990 (0.0009) [2023-12-27 22:47:15,718][106226] Updated weights for policy 0, policy_version 493505 (0.0010) [2023-12-27 22:47:15,771][106226] Updated weights for policy 0, policy_version 493515 (0.0010) [2023-12-27 22:47:15,815][106226] Updated weights for policy 0, policy_version 493525 (0.0007) [2023-12-27 22:47:16,036][106225] Updated weights for policy 1, policy_version 495000 (0.0008) [2023-12-27 22:47:16,098][106225] Updated weights for policy 1, policy_version 495010 (0.0008) [2023-12-27 22:47:16,162][106225] Updated weights for policy 1, policy_version 495020 (0.0008) [2023-12-27 22:47:16,175][105115] Fps is (10 sec: 18840.9, 60 sec: 19797.2, 300 sec: 19688.6). Total num frames: 253124608. Throughput: 0: 9876.6, 1: 9957.4. Samples: 253116668. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:47:16,176][105115] Avg episode reward: [(0, '-4.824'), (1, '-5.799')] [2023-12-27 22:47:16,488][106226] Updated weights for policy 0, policy_version 493535 (0.0009) [2023-12-27 22:47:16,547][106226] Updated weights for policy 0, policy_version 493545 (0.0009) [2023-12-27 22:47:16,601][106226] Updated weights for policy 0, policy_version 493555 (0.0009) [2023-12-27 22:47:16,880][106225] Updated weights for policy 1, policy_version 495030 (0.0009) [2023-12-27 22:47:16,928][106225] Updated weights for policy 1, policy_version 495040 (0.0008) [2023-12-27 22:47:16,973][106225] Updated weights for policy 1, policy_version 495050 (0.0008) [2023-12-27 22:47:17,258][106226] Updated weights for policy 0, policy_version 493565 (0.0007) [2023-12-27 22:47:17,315][106226] Updated weights for policy 0, policy_version 493575 (0.0005) [2023-12-27 22:47:17,375][106226] Updated weights for policy 0, policy_version 493585 (0.0005) [2023-12-27 22:47:17,792][106225] Updated weights for policy 1, policy_version 495060 (0.0008) [2023-12-27 22:47:17,850][106225] Updated weights for policy 1, policy_version 495070 (0.0008) [2023-12-27 22:47:17,896][106225] Updated weights for policy 1, policy_version 495080 (0.0009) [2023-12-27 22:47:17,945][106226] Updated weights for policy 0, policy_version 493595 (0.0006) [2023-12-27 22:47:18,011][106226] Updated weights for policy 0, policy_version 493605 (0.0006) [2023-12-27 22:47:18,066][106226] Updated weights for policy 0, policy_version 493615 (0.0008) [2023-12-27 22:47:18,702][106226] Updated weights for policy 0, policy_version 493625 (0.0007) [2023-12-27 22:47:18,714][106225] Updated weights for policy 1, policy_version 495091 (0.0009) [2023-12-27 22:47:18,767][106226] Updated weights for policy 0, policy_version 493635 (0.0006) [2023-12-27 22:47:18,778][106225] Updated weights for policy 1, policy_version 495101 (0.0008) [2023-12-27 22:47:18,829][106226] Updated weights for policy 0, policy_version 493645 (0.0008) [2023-12-27 22:47:18,830][106225] Updated weights for policy 1, policy_version 495111 (0.0008) [2023-12-27 22:47:18,900][106226] Updated weights for policy 0, policy_version 493655 (0.0007) [2023-12-27 22:47:19,573][106226] Updated weights for policy 0, policy_version 493665 (0.0009) [2023-12-27 22:47:19,575][106225] Updated weights for policy 1, policy_version 495121 (0.0007) [2023-12-27 22:47:19,622][106226] Updated weights for policy 0, policy_version 493675 (0.0006) [2023-12-27 22:47:19,641][106225] Updated weights for policy 1, policy_version 495131 (0.0007) [2023-12-27 22:47:19,686][106226] Updated weights for policy 0, policy_version 493685 (0.0008) [2023-12-27 22:47:19,704][106225] Updated weights for policy 1, policy_version 495141 (0.0006) [2023-12-27 22:47:19,767][106225] Updated weights for policy 1, policy_version 495151 (0.0009) [2023-12-27 22:47:20,443][106226] Updated weights for policy 0, policy_version 493695 (0.0008) [2023-12-27 22:47:20,499][106226] Updated weights for policy 0, policy_version 493705 (0.0007) [2023-12-27 22:47:20,537][106225] Updated weights for policy 1, policy_version 495161 (0.0008) [2023-12-27 22:47:20,562][106226] Updated weights for policy 0, policy_version 493715 (0.0006) [2023-12-27 22:47:20,604][106225] Updated weights for policy 1, policy_version 495171 (0.0007) [2023-12-27 22:47:20,662][106225] Updated weights for policy 1, policy_version 495181 (0.0009) [2023-12-27 22:47:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 253222912. Throughput: 0: 10001.2, 1: 9825.9. Samples: 253234032. Policy #0 lag: (min: 31.0, avg: 31.8, max: 55.0) [2023-12-27 22:47:21,175][105115] Avg episode reward: [(0, '-5.284'), (1, '-5.608')] [2023-12-27 22:47:21,306][106226] Updated weights for policy 0, policy_version 493725 (0.0007) [2023-12-27 22:47:21,383][106226] Updated weights for policy 0, policy_version 493735 (0.0008) [2023-12-27 22:47:21,453][106226] Updated weights for policy 0, policy_version 493745 (0.0008) [2023-12-27 22:47:21,481][106225] Updated weights for policy 1, policy_version 495191 (0.0009) [2023-12-27 22:47:21,532][106225] Updated weights for policy 1, policy_version 495201 (0.0007) [2023-12-27 22:47:21,589][106225] Updated weights for policy 1, policy_version 495211 (0.0009) [2023-12-27 22:47:22,153][106226] Updated weights for policy 0, policy_version 493755 (0.0007) [2023-12-27 22:47:22,216][106226] Updated weights for policy 0, policy_version 493765 (0.0008) [2023-12-27 22:47:22,285][106226] Updated weights for policy 0, policy_version 493775 (0.0008) [2023-12-27 22:47:22,353][106225] Updated weights for policy 1, policy_version 495221 (0.0009) [2023-12-27 22:47:22,415][106225] Updated weights for policy 1, policy_version 495231 (0.0009) [2023-12-27 22:47:22,485][106225] Updated weights for policy 1, policy_version 495241 (0.0010) [2023-12-27 22:47:22,923][106226] Updated weights for policy 0, policy_version 493785 (0.0009) [2023-12-27 22:47:22,985][106226] Updated weights for policy 0, policy_version 493795 (0.0005) [2023-12-27 22:47:23,044][106226] Updated weights for policy 0, policy_version 493805 (0.0005) [2023-12-27 22:47:23,108][106226] Updated weights for policy 0, policy_version 493815 (0.0006) [2023-12-27 22:47:23,320][106225] Updated weights for policy 1, policy_version 495251 (0.0010) [2023-12-27 22:47:23,367][106225] Updated weights for policy 1, policy_version 495261 (0.0007) [2023-12-27 22:47:23,416][106225] Updated weights for policy 1, policy_version 495271 (0.0009) [2023-12-27 22:47:23,634][106226] Updated weights for policy 0, policy_version 493825 (0.0006) [2023-12-27 22:47:23,698][106226] Updated weights for policy 0, policy_version 493835 (0.0005) [2023-12-27 22:47:23,750][106226] Updated weights for policy 0, policy_version 493845 (0.0005) [2023-12-27 22:47:24,093][106225] Updated weights for policy 1, policy_version 495281 (0.0009) [2023-12-27 22:47:24,146][106225] Updated weights for policy 1, policy_version 495291 (0.0010) [2023-12-27 22:47:24,194][106225] Updated weights for policy 1, policy_version 495301 (0.0008) [2023-12-27 22:47:24,253][106225] Updated weights for policy 1, policy_version 495311 (0.0007) [2023-12-27 22:47:24,274][106226] Updated weights for policy 0, policy_version 493855 (0.0006) [2023-12-27 22:47:24,340][106226] Updated weights for policy 0, policy_version 493865 (0.0006) [2023-12-27 22:47:24,401][106226] Updated weights for policy 0, policy_version 493875 (0.0010) [2023-12-27 22:47:24,965][106225] Updated weights for policy 1, policy_version 495321 (0.0007) [2023-12-27 22:47:25,015][106225] Updated weights for policy 1, policy_version 495331 (0.0010) [2023-12-27 22:47:25,075][106225] Updated weights for policy 1, policy_version 495341 (0.0010) [2023-12-27 22:47:25,086][106226] Updated weights for policy 0, policy_version 493885 (0.0010) [2023-12-27 22:47:25,142][106226] Updated weights for policy 0, policy_version 493895 (0.0010) [2023-12-27 22:47:25,187][106226] Updated weights for policy 0, policy_version 493905 (0.0010) [2023-12-27 22:47:25,720][106225] Updated weights for policy 1, policy_version 495351 (0.0007) [2023-12-27 22:47:25,782][106225] Updated weights for policy 1, policy_version 495361 (0.0005) [2023-12-27 22:47:25,845][106225] Updated weights for policy 1, policy_version 495371 (0.0005) [2023-12-27 22:47:25,902][106226] Updated weights for policy 0, policy_version 493915 (0.0010) [2023-12-27 22:47:25,958][106226] Updated weights for policy 0, policy_version 493925 (0.0010) [2023-12-27 22:47:26,007][106226] Updated weights for policy 0, policy_version 493935 (0.0010) [2023-12-27 22:47:26,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 253329408. Throughput: 0: 10056.4, 1: 9775.1. Samples: 253293348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:26,175][105115] Avg episode reward: [(0, '-5.129'), (1, '-5.558')] [2023-12-27 22:47:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000495376_126844928.pth... [2023-12-27 22:47:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000493944_126484480.pth... [2023-12-27 22:47:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000494256_126558208.pth [2023-12-27 22:47:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000492760_126181376.pth [2023-12-27 22:47:26,462][106225] Updated weights for policy 1, policy_version 495381 (0.0006) [2023-12-27 22:47:26,517][106225] Updated weights for policy 1, policy_version 495391 (0.0005) [2023-12-27 22:47:26,582][106225] Updated weights for policy 1, policy_version 495401 (0.0005) [2023-12-27 22:47:26,727][106226] Updated weights for policy 0, policy_version 493945 (0.0010) [2023-12-27 22:47:26,789][106226] Updated weights for policy 0, policy_version 493955 (0.0010) [2023-12-27 22:47:26,845][106226] Updated weights for policy 0, policy_version 493965 (0.0010) [2023-12-27 22:47:26,905][106226] Updated weights for policy 0, policy_version 493975 (0.0005) [2023-12-27 22:47:27,259][106225] Updated weights for policy 1, policy_version 495411 (0.0006) [2023-12-27 22:47:27,322][106225] Updated weights for policy 1, policy_version 495421 (0.0008) [2023-12-27 22:47:27,379][106225] Updated weights for policy 1, policy_version 495431 (0.0008) [2023-12-27 22:47:27,562][106226] Updated weights for policy 0, policy_version 493985 (0.0010) [2023-12-27 22:47:27,618][106226] Updated weights for policy 0, policy_version 493995 (0.0010) [2023-12-27 22:47:27,678][106226] Updated weights for policy 0, policy_version 494005 (0.0010) [2023-12-27 22:47:27,975][106225] Updated weights for policy 1, policy_version 495441 (0.0007) [2023-12-27 22:47:28,030][106225] Updated weights for policy 1, policy_version 495451 (0.0007) [2023-12-27 22:47:28,076][106225] Updated weights for policy 1, policy_version 495461 (0.0008) [2023-12-27 22:47:28,119][106225] Updated weights for policy 1, policy_version 495471 (0.0007) [2023-12-27 22:47:28,422][106226] Updated weights for policy 0, policy_version 494016 (0.0011) [2023-12-27 22:47:28,480][106226] Updated weights for policy 0, policy_version 494026 (0.0009) [2023-12-27 22:47:28,540][106226] Updated weights for policy 0, policy_version 494036 (0.0009) [2023-12-27 22:47:28,801][106225] Updated weights for policy 1, policy_version 495481 (0.0010) [2023-12-27 22:47:28,863][106225] Updated weights for policy 1, policy_version 495491 (0.0007) [2023-12-27 22:47:28,921][106225] Updated weights for policy 1, policy_version 495501 (0.0010) [2023-12-27 22:47:29,187][106226] Updated weights for policy 0, policy_version 494046 (0.0005) [2023-12-27 22:47:29,251][106226] Updated weights for policy 0, policy_version 494056 (0.0007) [2023-12-27 22:47:29,317][106226] Updated weights for policy 0, policy_version 494066 (0.0008) [2023-12-27 22:47:29,565][106225] Updated weights for policy 1, policy_version 495511 (0.0007) [2023-12-27 22:47:29,624][106225] Updated weights for policy 1, policy_version 495521 (0.0007) [2023-12-27 22:47:29,687][106225] Updated weights for policy 1, policy_version 495531 (0.0009) [2023-12-27 22:47:30,067][106226] Updated weights for policy 0, policy_version 494076 (0.0008) [2023-12-27 22:47:30,126][106226] Updated weights for policy 0, policy_version 494086 (0.0008) [2023-12-27 22:47:30,192][106226] Updated weights for policy 0, policy_version 494096 (0.0006) [2023-12-27 22:47:30,379][106225] Updated weights for policy 1, policy_version 495541 (0.0008) [2023-12-27 22:47:30,448][106225] Updated weights for policy 1, policy_version 495551 (0.0006) [2023-12-27 22:47:30,506][106225] Updated weights for policy 1, policy_version 495561 (0.0005) [2023-12-27 22:47:30,789][106226] Updated weights for policy 0, policy_version 494106 (0.0007) [2023-12-27 22:47:30,838][106226] Updated weights for policy 0, policy_version 494116 (0.0010) [2023-12-27 22:47:30,891][106226] Updated weights for policy 0, policy_version 494126 (0.0010) [2023-12-27 22:47:30,950][106226] Updated weights for policy 0, policy_version 494136 (0.0008) [2023-12-27 22:47:31,093][106225] Updated weights for policy 1, policy_version 495571 (0.0006) [2023-12-27 22:47:31,158][106225] Updated weights for policy 1, policy_version 495581 (0.0008) [2023-12-27 22:47:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 253427712. Throughput: 0: 10087.5, 1: 9848.6. Samples: 253416144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:31,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.464')] [2023-12-27 22:47:31,222][106225] Updated weights for policy 1, policy_version 495591 (0.0007) [2023-12-27 22:47:31,719][106226] Updated weights for policy 0, policy_version 494146 (0.0009) [2023-12-27 22:47:31,784][106226] Updated weights for policy 0, policy_version 494156 (0.0009) [2023-12-27 22:47:31,846][106226] Updated weights for policy 0, policy_version 494166 (0.0008) [2023-12-27 22:47:31,972][106225] Updated weights for policy 1, policy_version 495601 (0.0007) [2023-12-27 22:47:32,034][106225] Updated weights for policy 1, policy_version 495611 (0.0006) [2023-12-27 22:47:32,093][106225] Updated weights for policy 1, policy_version 495621 (0.0006) [2023-12-27 22:47:32,160][106225] Updated weights for policy 1, policy_version 495631 (0.0006) [2023-12-27 22:47:32,655][106226] Updated weights for policy 0, policy_version 494176 (0.0008) [2023-12-27 22:47:32,713][106226] Updated weights for policy 0, policy_version 494186 (0.0008) [2023-12-27 22:47:32,770][106226] Updated weights for policy 0, policy_version 494196 (0.0010) [2023-12-27 22:47:32,799][106225] Updated weights for policy 1, policy_version 495641 (0.0007) [2023-12-27 22:47:32,861][106225] Updated weights for policy 1, policy_version 495651 (0.0008) [2023-12-27 22:47:32,918][106225] Updated weights for policy 1, policy_version 495661 (0.0008) [2023-12-27 22:47:33,455][106226] Updated weights for policy 0, policy_version 494206 (0.0007) [2023-12-27 22:47:33,514][106226] Updated weights for policy 0, policy_version 494216 (0.0006) [2023-12-27 22:47:33,573][106226] Updated weights for policy 0, policy_version 494226 (0.0010) [2023-12-27 22:47:33,628][106225] Updated weights for policy 1, policy_version 495671 (0.0008) [2023-12-27 22:47:33,686][106225] Updated weights for policy 1, policy_version 495681 (0.0008) [2023-12-27 22:47:33,743][106225] Updated weights for policy 1, policy_version 495691 (0.0008) [2023-12-27 22:47:34,180][106226] Updated weights for policy 0, policy_version 494236 (0.0010) [2023-12-27 22:47:34,238][106226] Updated weights for policy 0, policy_version 494246 (0.0007) [2023-12-27 22:47:34,300][106226] Updated weights for policy 0, policy_version 494256 (0.0008) [2023-12-27 22:47:34,467][106225] Updated weights for policy 1, policy_version 495701 (0.0009) [2023-12-27 22:47:34,519][106225] Updated weights for policy 1, policy_version 495711 (0.0009) [2023-12-27 22:47:34,571][106225] Updated weights for policy 1, policy_version 495721 (0.0010) [2023-12-27 22:47:34,989][106226] Updated weights for policy 0, policy_version 494266 (0.0009) [2023-12-27 22:47:35,047][106226] Updated weights for policy 0, policy_version 494276 (0.0007) [2023-12-27 22:47:35,104][106226] Updated weights for policy 0, policy_version 494286 (0.0008) [2023-12-27 22:47:35,167][106226] Updated weights for policy 0, policy_version 494296 (0.0006) [2023-12-27 22:47:35,235][106225] Updated weights for policy 1, policy_version 495731 (0.0009) [2023-12-27 22:47:35,305][106225] Updated weights for policy 1, policy_version 495741 (0.0006) [2023-12-27 22:47:35,375][106225] Updated weights for policy 1, policy_version 495751 (0.0006) [2023-12-27 22:47:35,741][106226] Updated weights for policy 0, policy_version 494306 (0.0005) [2023-12-27 22:47:35,801][106226] Updated weights for policy 0, policy_version 494316 (0.0007) [2023-12-27 22:47:35,862][106226] Updated weights for policy 0, policy_version 494326 (0.0006) [2023-12-27 22:47:36,074][106225] Updated weights for policy 1, policy_version 495761 (0.0007) [2023-12-27 22:47:36,137][106225] Updated weights for policy 1, policy_version 495771 (0.0008) [2023-12-27 22:47:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 253526016. Throughput: 0: 10109.7, 1: 9759.8. Samples: 253539092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:36,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.447')] [2023-12-27 22:47:36,200][106225] Updated weights for policy 1, policy_version 495781 (0.0006) [2023-12-27 22:47:36,265][106225] Updated weights for policy 1, policy_version 495791 (0.0007) [2023-12-27 22:47:36,473][106226] Updated weights for policy 0, policy_version 494336 (0.0010) [2023-12-27 22:47:36,538][106226] Updated weights for policy 0, policy_version 494346 (0.0011) [2023-12-27 22:47:36,595][106226] Updated weights for policy 0, policy_version 494356 (0.0010) [2023-12-27 22:47:36,921][106225] Updated weights for policy 1, policy_version 495801 (0.0008) [2023-12-27 22:47:36,987][106225] Updated weights for policy 1, policy_version 495811 (0.0008) [2023-12-27 22:47:37,047][106225] Updated weights for policy 1, policy_version 495821 (0.0008) [2023-12-27 22:47:37,257][106226] Updated weights for policy 0, policy_version 494366 (0.0008) [2023-12-27 22:47:37,305][106226] Updated weights for policy 0, policy_version 494376 (0.0008) [2023-12-27 22:47:37,360][106226] Updated weights for policy 0, policy_version 494386 (0.0005) [2023-12-27 22:47:37,779][106225] Updated weights for policy 1, policy_version 495831 (0.0009) [2023-12-27 22:47:37,841][106225] Updated weights for policy 1, policy_version 495841 (0.0007) [2023-12-27 22:47:37,903][106225] Updated weights for policy 1, policy_version 495851 (0.0007) [2023-12-27 22:47:37,937][106226] Updated weights for policy 0, policy_version 494396 (0.0007) [2023-12-27 22:47:37,990][106226] Updated weights for policy 0, policy_version 494406 (0.0010) [2023-12-27 22:47:38,036][106226] Updated weights for policy 0, policy_version 494416 (0.0010) [2023-12-27 22:47:38,620][106225] Updated weights for policy 1, policy_version 495861 (0.0007) [2023-12-27 22:47:38,673][106225] Updated weights for policy 1, policy_version 495871 (0.0006) [2023-12-27 22:47:38,720][106225] Updated weights for policy 1, policy_version 495881 (0.0007) [2023-12-27 22:47:38,766][106226] Updated weights for policy 0, policy_version 494426 (0.0010) [2023-12-27 22:47:38,823][106226] Updated weights for policy 0, policy_version 494436 (0.0010) [2023-12-27 22:47:38,877][106226] Updated weights for policy 0, policy_version 494446 (0.0010) [2023-12-27 22:47:38,931][106226] Updated weights for policy 0, policy_version 494456 (0.0010) [2023-12-27 22:47:39,489][106225] Updated weights for policy 1, policy_version 495891 (0.0008) [2023-12-27 22:47:39,552][106225] Updated weights for policy 1, policy_version 495901 (0.0008) [2023-12-27 22:47:39,617][106225] Updated weights for policy 1, policy_version 495911 (0.0006) [2023-12-27 22:47:39,630][106226] Updated weights for policy 0, policy_version 494466 (0.0011) [2023-12-27 22:47:39,691][106226] Updated weights for policy 0, policy_version 494476 (0.0008) [2023-12-27 22:47:39,746][106226] Updated weights for policy 0, policy_version 494486 (0.0005) [2023-12-27 22:47:40,396][106226] Updated weights for policy 0, policy_version 494496 (0.0007) [2023-12-27 22:47:40,421][106225] Updated weights for policy 1, policy_version 495921 (0.0006) [2023-12-27 22:47:40,461][106226] Updated weights for policy 0, policy_version 494506 (0.0011) [2023-12-27 22:47:40,485][106225] Updated weights for policy 1, policy_version 495931 (0.0008) [2023-12-27 22:47:40,522][106226] Updated weights for policy 0, policy_version 494516 (0.0011) [2023-12-27 22:47:40,535][106225] Updated weights for policy 1, policy_version 495941 (0.0005) [2023-12-27 22:47:40,585][106225] Updated weights for policy 1, policy_version 495951 (0.0007) [2023-12-27 22:47:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 253624320. Throughput: 0: 10093.3, 1: 9746.7. Samples: 253599116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:41,175][105115] Avg episode reward: [(0, '-5.337'), (1, '-5.699')] [2023-12-27 22:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000495952_126992384.pth... [2023-12-27 22:47:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000494520_126631936.pth... [2023-12-27 22:47:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000493336_126328832.pth [2023-12-27 22:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000494832_126705664.pth [2023-12-27 22:47:41,284][106226] Updated weights for policy 0, policy_version 494526 (0.0009) [2023-12-27 22:47:41,306][106225] Updated weights for policy 1, policy_version 495961 (0.0008) [2023-12-27 22:47:41,349][106226] Updated weights for policy 0, policy_version 494536 (0.0007) [2023-12-27 22:47:41,375][106225] Updated weights for policy 1, policy_version 495971 (0.0007) [2023-12-27 22:47:41,416][106226] Updated weights for policy 0, policy_version 494546 (0.0008) [2023-12-27 22:47:41,440][106225] Updated weights for policy 1, policy_version 495981 (0.0008) [2023-12-27 22:47:42,076][106226] Updated weights for policy 0, policy_version 494556 (0.0007) [2023-12-27 22:47:42,138][106226] Updated weights for policy 0, policy_version 494566 (0.0009) [2023-12-27 22:47:42,198][106226] Updated weights for policy 0, policy_version 494576 (0.0008) [2023-12-27 22:47:42,256][106225] Updated weights for policy 1, policy_version 495991 (0.0007) [2023-12-27 22:47:42,323][106225] Updated weights for policy 1, policy_version 496001 (0.0007) [2023-12-27 22:47:42,388][106225] Updated weights for policy 1, policy_version 496011 (0.0008) [2023-12-27 22:47:42,939][106226] Updated weights for policy 0, policy_version 494586 (0.0009) [2023-12-27 22:47:42,990][106226] Updated weights for policy 0, policy_version 494596 (0.0008) [2023-12-27 22:47:43,048][106226] Updated weights for policy 0, policy_version 494606 (0.0009) [2023-12-27 22:47:43,102][106226] Updated weights for policy 0, policy_version 494616 (0.0007) [2023-12-27 22:47:43,104][106225] Updated weights for policy 1, policy_version 496021 (0.0007) [2023-12-27 22:47:43,172][106225] Updated weights for policy 1, policy_version 496031 (0.0009) [2023-12-27 22:47:43,226][106225] Updated weights for policy 1, policy_version 496041 (0.0009) [2023-12-27 22:47:43,736][106226] Updated weights for policy 0, policy_version 494626 (0.0006) [2023-12-27 22:47:43,793][106226] Updated weights for policy 0, policy_version 494636 (0.0006) [2023-12-27 22:47:43,850][106226] Updated weights for policy 0, policy_version 494646 (0.0008) [2023-12-27 22:47:43,917][106225] Updated weights for policy 1, policy_version 496051 (0.0006) [2023-12-27 22:47:43,968][106225] Updated weights for policy 1, policy_version 496061 (0.0006) [2023-12-27 22:47:44,025][106225] Updated weights for policy 1, policy_version 496071 (0.0005) [2023-12-27 22:47:44,606][106226] Updated weights for policy 0, policy_version 494656 (0.0008) [2023-12-27 22:47:44,653][106225] Updated weights for policy 1, policy_version 496081 (0.0006) [2023-12-27 22:47:44,656][106226] Updated weights for policy 0, policy_version 494666 (0.0008) [2023-12-27 22:47:44,707][106226] Updated weights for policy 0, policy_version 494676 (0.0010) [2023-12-27 22:47:44,711][106225] Updated weights for policy 1, policy_version 496091 (0.0010) [2023-12-27 22:47:44,776][106225] Updated weights for policy 1, policy_version 496101 (0.0010) [2023-12-27 22:47:44,838][106225] Updated weights for policy 1, policy_version 496111 (0.0010) [2023-12-27 22:47:45,487][106225] Updated weights for policy 1, policy_version 496121 (0.0008) [2023-12-27 22:47:45,491][106226] Updated weights for policy 0, policy_version 494686 (0.0006) [2023-12-27 22:47:45,538][106225] Updated weights for policy 1, policy_version 496131 (0.0010) [2023-12-27 22:47:45,548][106226] Updated weights for policy 0, policy_version 494696 (0.0005) [2023-12-27 22:47:45,593][106225] Updated weights for policy 1, policy_version 496141 (0.0010) [2023-12-27 22:47:45,608][106226] Updated weights for policy 0, policy_version 494706 (0.0005) [2023-12-27 22:47:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 253722624. Throughput: 0: 10146.2, 1: 9710.1. Samples: 253714748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:46,175][105115] Avg episode reward: [(0, '-5.188'), (1, '-5.629')] [2023-12-27 22:47:46,212][106225] Updated weights for policy 1, policy_version 496151 (0.0007) [2023-12-27 22:47:46,264][106225] Updated weights for policy 1, policy_version 496161 (0.0005) [2023-12-27 22:47:46,297][106226] Updated weights for policy 0, policy_version 494716 (0.0006) [2023-12-27 22:47:46,313][106225] Updated weights for policy 1, policy_version 496171 (0.0005) [2023-12-27 22:47:46,353][106226] Updated weights for policy 0, policy_version 494726 (0.0007) [2023-12-27 22:47:46,409][106226] Updated weights for policy 0, policy_version 494736 (0.0009) [2023-12-27 22:47:46,991][106225] Updated weights for policy 1, policy_version 496181 (0.0009) [2023-12-27 22:47:47,037][106225] Updated weights for policy 1, policy_version 496191 (0.0009) [2023-12-27 22:47:47,086][106225] Updated weights for policy 1, policy_version 496201 (0.0008) [2023-12-27 22:47:47,115][106226] Updated weights for policy 0, policy_version 494746 (0.0009) [2023-12-27 22:47:47,178][106226] Updated weights for policy 0, policy_version 494756 (0.0008) [2023-12-27 22:47:47,241][106226] Updated weights for policy 0, policy_version 494766 (0.0008) [2023-12-27 22:47:47,301][106226] Updated weights for policy 0, policy_version 494776 (0.0007) [2023-12-27 22:47:47,680][106225] Updated weights for policy 1, policy_version 496211 (0.0006) [2023-12-27 22:47:47,732][106225] Updated weights for policy 1, policy_version 496221 (0.0005) [2023-12-27 22:47:47,797][106225] Updated weights for policy 1, policy_version 496231 (0.0006) [2023-12-27 22:47:47,962][106226] Updated weights for policy 0, policy_version 494786 (0.0008) [2023-12-27 22:47:48,018][106226] Updated weights for policy 0, policy_version 494796 (0.0006) [2023-12-27 22:47:48,069][106226] Updated weights for policy 0, policy_version 494806 (0.0010) [2023-12-27 22:47:48,354][106225] Updated weights for policy 1, policy_version 496241 (0.0006) [2023-12-27 22:47:48,419][106225] Updated weights for policy 1, policy_version 496251 (0.0007) [2023-12-27 22:47:48,479][106225] Updated weights for policy 1, policy_version 496261 (0.0007) [2023-12-27 22:47:48,536][106225] Updated weights for policy 1, policy_version 496271 (0.0008) [2023-12-27 22:47:48,880][106226] Updated weights for policy 0, policy_version 494816 (0.0006) [2023-12-27 22:47:48,945][106226] Updated weights for policy 0, policy_version 494826 (0.0011) [2023-12-27 22:47:49,007][106226] Updated weights for policy 0, policy_version 494836 (0.0011) [2023-12-27 22:47:49,289][106225] Updated weights for policy 1, policy_version 496281 (0.0009) [2023-12-27 22:47:49,354][106225] Updated weights for policy 1, policy_version 496291 (0.0009) [2023-12-27 22:47:49,423][106225] Updated weights for policy 1, policy_version 496301 (0.0008) [2023-12-27 22:47:49,649][106226] Updated weights for policy 0, policy_version 494846 (0.0011) [2023-12-27 22:47:49,707][106226] Updated weights for policy 0, policy_version 494856 (0.0006) [2023-12-27 22:47:49,764][106226] Updated weights for policy 0, policy_version 494866 (0.0005) [2023-12-27 22:47:50,179][106225] Updated weights for policy 1, policy_version 496311 (0.0006) [2023-12-27 22:47:50,246][106225] Updated weights for policy 1, policy_version 496321 (0.0006) [2023-12-27 22:47:50,304][106225] Updated weights for policy 1, policy_version 496331 (0.0010) [2023-12-27 22:47:50,482][106226] Updated weights for policy 0, policy_version 494876 (0.0007) [2023-12-27 22:47:50,540][106226] Updated weights for policy 0, policy_version 494886 (0.0009) [2023-12-27 22:47:50,608][106226] Updated weights for policy 0, policy_version 494896 (0.0008) [2023-12-27 22:47:50,970][106225] Updated weights for policy 1, policy_version 496341 (0.0010) [2023-12-27 22:47:51,028][106225] Updated weights for policy 1, policy_version 496351 (0.0009) [2023-12-27 22:47:51,093][106225] Updated weights for policy 1, policy_version 496361 (0.0010) [2023-12-27 22:47:51,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 253829120. Throughput: 0: 10038.4, 1: 9770.6. Samples: 253835024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:51,175][105115] Avg episode reward: [(0, '-5.439'), (1, '-5.542')] [2023-12-27 22:47:51,382][106226] Updated weights for policy 0, policy_version 494906 (0.0008) [2023-12-27 22:47:51,444][106226] Updated weights for policy 0, policy_version 494916 (0.0008) [2023-12-27 22:47:51,498][106226] Updated weights for policy 0, policy_version 494926 (0.0008) [2023-12-27 22:47:51,559][106226] Updated weights for policy 0, policy_version 494936 (0.0008) [2023-12-27 22:47:51,853][106225] Updated weights for policy 1, policy_version 496371 (0.0012) [2023-12-27 22:47:51,917][106225] Updated weights for policy 1, policy_version 496381 (0.0010) [2023-12-27 22:47:51,974][106225] Updated weights for policy 1, policy_version 496391 (0.0010) [2023-12-27 22:47:52,301][106226] Updated weights for policy 0, policy_version 494946 (0.0010) [2023-12-27 22:47:52,363][106226] Updated weights for policy 0, policy_version 494956 (0.0011) [2023-12-27 22:47:52,424][106226] Updated weights for policy 0, policy_version 494966 (0.0011) [2023-12-27 22:47:52,701][106225] Updated weights for policy 1, policy_version 496401 (0.0010) [2023-12-27 22:47:52,753][106225] Updated weights for policy 1, policy_version 496411 (0.0010) [2023-12-27 22:47:52,811][106225] Updated weights for policy 1, policy_version 496421 (0.0010) [2023-12-27 22:47:52,868][106225] Updated weights for policy 1, policy_version 496431 (0.0007) [2023-12-27 22:47:53,080][106226] Updated weights for policy 0, policy_version 494976 (0.0006) [2023-12-27 22:47:53,128][106226] Updated weights for policy 0, policy_version 494986 (0.0005) [2023-12-27 22:47:53,190][106226] Updated weights for policy 0, policy_version 494996 (0.0005) [2023-12-27 22:47:53,642][106225] Updated weights for policy 1, policy_version 496441 (0.0006) [2023-12-27 22:47:53,700][106225] Updated weights for policy 1, policy_version 496451 (0.0005) [2023-12-27 22:47:53,763][106225] Updated weights for policy 1, policy_version 496461 (0.0005) [2023-12-27 22:47:53,791][106226] Updated weights for policy 0, policy_version 495006 (0.0005) [2023-12-27 22:47:53,847][106226] Updated weights for policy 0, policy_version 495016 (0.0005) [2023-12-27 22:47:53,913][106226] Updated weights for policy 0, policy_version 495026 (0.0005) [2023-12-27 22:47:54,348][106225] Updated weights for policy 1, policy_version 496471 (0.0008) [2023-12-27 22:47:54,407][106225] Updated weights for policy 1, policy_version 496481 (0.0008) [2023-12-27 22:47:54,464][106225] Updated weights for policy 1, policy_version 496491 (0.0008) [2023-12-27 22:47:54,494][106226] Updated weights for policy 0, policy_version 495036 (0.0005) [2023-12-27 22:47:54,557][106226] Updated weights for policy 0, policy_version 495046 (0.0006) [2023-12-27 22:47:54,625][106226] Updated weights for policy 0, policy_version 495056 (0.0005) [2023-12-27 22:47:55,131][106225] Updated weights for policy 1, policy_version 496501 (0.0006) [2023-12-27 22:47:55,180][106225] Updated weights for policy 1, policy_version 496511 (0.0008) [2023-12-27 22:47:55,242][106225] Updated weights for policy 1, policy_version 496521 (0.0006) [2023-12-27 22:47:55,244][106226] Updated weights for policy 0, policy_version 495066 (0.0006) [2023-12-27 22:47:55,302][106226] Updated weights for policy 0, policy_version 495076 (0.0008) [2023-12-27 22:47:55,356][106226] Updated weights for policy 0, policy_version 495086 (0.0009) [2023-12-27 22:47:55,409][106226] Updated weights for policy 0, policy_version 495096 (0.0009) [2023-12-27 22:47:55,953][106225] Updated weights for policy 1, policy_version 496531 (0.0007) [2023-12-27 22:47:56,008][106226] Updated weights for policy 0, policy_version 495106 (0.0011) [2023-12-27 22:47:56,010][106225] Updated weights for policy 1, policy_version 496541 (0.0009) [2023-12-27 22:47:56,059][106226] Updated weights for policy 0, policy_version 495116 (0.0010) [2023-12-27 22:47:56,059][106225] Updated weights for policy 1, policy_version 496551 (0.0008) [2023-12-27 22:47:56,108][106226] Updated weights for policy 0, policy_version 495126 (0.0010) [2023-12-27 22:47:56,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 253935616. Throughput: 0: 10077.5, 1: 9757.7. Samples: 253893832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:47:56,175][105115] Avg episode reward: [(0, '-5.094'), (1, '-5.967')] [2023-12-27 22:47:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000496560_127148032.pth... [2023-12-27 22:47:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000495128_126787584.pth... [2023-12-27 22:47:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000495376_126844928.pth [2023-12-27 22:47:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000493944_126484480.pth [2023-12-27 22:47:56,662][106225] Updated weights for policy 1, policy_version 496561 (0.0006) [2023-12-27 22:47:56,721][106225] Updated weights for policy 1, policy_version 496572 (0.0008) [2023-12-27 22:47:56,775][106225] Updated weights for policy 1, policy_version 496582 (0.0009) [2023-12-27 22:47:56,785][106226] Updated weights for policy 0, policy_version 495136 (0.0008) [2023-12-27 22:47:56,828][106225] Updated weights for policy 1, policy_version 496592 (0.0010) [2023-12-27 22:47:56,845][106226] Updated weights for policy 0, policy_version 495146 (0.0006) [2023-12-27 22:47:56,901][106226] Updated weights for policy 0, policy_version 495156 (0.0007) [2023-12-27 22:47:57,420][106225] Updated weights for policy 1, policy_version 496602 (0.0010) [2023-12-27 22:47:57,471][106225] Updated weights for policy 1, policy_version 496612 (0.0010) [2023-12-27 22:47:57,527][106225] Updated weights for policy 1, policy_version 496622 (0.0010) [2023-12-27 22:47:57,676][106226] Updated weights for policy 0, policy_version 495166 (0.0007) [2023-12-27 22:47:57,726][106226] Updated weights for policy 0, policy_version 495176 (0.0008) [2023-12-27 22:47:57,786][106226] Updated weights for policy 0, policy_version 495186 (0.0008) [2023-12-27 22:47:58,236][106225] Updated weights for policy 1, policy_version 496632 (0.0008) [2023-12-27 22:47:58,302][106225] Updated weights for policy 1, policy_version 496642 (0.0007) [2023-12-27 22:47:58,385][106225] Updated weights for policy 1, policy_version 496653 (0.0008) [2023-12-27 22:47:58,489][106226] Updated weights for policy 0, policy_version 495196 (0.0008) [2023-12-27 22:47:58,559][106226] Updated weights for policy 0, policy_version 495206 (0.0009) [2023-12-27 22:47:58,629][106226] Updated weights for policy 0, policy_version 495216 (0.0009) [2023-12-27 22:47:59,218][106225] Updated weights for policy 1, policy_version 496663 (0.0008) [2023-12-27 22:47:59,293][106225] Updated weights for policy 1, policy_version 496673 (0.0009) [2023-12-27 22:47:59,376][106225] Updated weights for policy 1, policy_version 496683 (0.0008) [2023-12-27 22:47:59,545][106226] Updated weights for policy 0, policy_version 495226 (0.0008) [2023-12-27 22:47:59,613][106226] Updated weights for policy 0, policy_version 495236 (0.0007) [2023-12-27 22:47:59,677][106226] Updated weights for policy 0, policy_version 495246 (0.0007) [2023-12-27 22:47:59,735][106226] Updated weights for policy 0, policy_version 495256 (0.0008) [2023-12-27 22:48:00,145][106225] Updated weights for policy 1, policy_version 496693 (0.0008) [2023-12-27 22:48:00,202][106225] Updated weights for policy 1, policy_version 496703 (0.0009) [2023-12-27 22:48:00,264][106225] Updated weights for policy 1, policy_version 496713 (0.0008) [2023-12-27 22:48:00,427][106226] Updated weights for policy 0, policy_version 495266 (0.0005) [2023-12-27 22:48:00,493][106226] Updated weights for policy 0, policy_version 495276 (0.0006) [2023-12-27 22:48:00,541][106226] Updated weights for policy 0, policy_version 495286 (0.0009) [2023-12-27 22:48:00,934][106225] Updated weights for policy 1, policy_version 496723 (0.0009) [2023-12-27 22:48:00,987][106225] Updated weights for policy 1, policy_version 496733 (0.0010) [2023-12-27 22:48:01,049][106225] Updated weights for policy 1, policy_version 496743 (0.0010) [2023-12-27 22:48:01,103][106226] Updated weights for policy 0, policy_version 495296 (0.0008) [2023-12-27 22:48:01,166][106226] Updated weights for policy 0, policy_version 495306 (0.0008) [2023-12-27 22:48:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 254025728. Throughput: 0: 10071.3, 1: 9853.2. Samples: 254013260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:01,175][105115] Avg episode reward: [(0, '-5.096'), (1, '-5.656')] [2023-12-27 22:48:01,224][106226] Updated weights for policy 0, policy_version 495316 (0.0008) [2023-12-27 22:48:01,824][106225] Updated weights for policy 1, policy_version 496753 (0.0006) [2023-12-27 22:48:01,882][106225] Updated weights for policy 1, policy_version 496763 (0.0009) [2023-12-27 22:48:01,904][106226] Updated weights for policy 0, policy_version 495326 (0.0009) [2023-12-27 22:48:01,942][106225] Updated weights for policy 1, policy_version 496773 (0.0009) [2023-12-27 22:48:01,963][106226] Updated weights for policy 0, policy_version 495336 (0.0008) [2023-12-27 22:48:02,007][106225] Updated weights for policy 1, policy_version 496783 (0.0009) [2023-12-27 22:48:02,025][106226] Updated weights for policy 0, policy_version 495346 (0.0007) [2023-12-27 22:48:02,680][106226] Updated weights for policy 0, policy_version 495356 (0.0005) [2023-12-27 22:48:02,686][106225] Updated weights for policy 1, policy_version 496793 (0.0006) [2023-12-27 22:48:02,737][106226] Updated weights for policy 0, policy_version 495366 (0.0007) [2023-12-27 22:48:02,748][106225] Updated weights for policy 1, policy_version 496803 (0.0006) [2023-12-27 22:48:02,793][106226] Updated weights for policy 0, policy_version 495376 (0.0009) [2023-12-27 22:48:02,812][106225] Updated weights for policy 1, policy_version 496813 (0.0007) [2023-12-27 22:48:03,353][106225] Updated weights for policy 1, policy_version 496823 (0.0006) [2023-12-27 22:48:03,402][106225] Updated weights for policy 1, policy_version 496833 (0.0008) [2023-12-27 22:48:03,454][106225] Updated weights for policy 1, policy_version 496843 (0.0007) [2023-12-27 22:48:03,503][106226] Updated weights for policy 0, policy_version 495386 (0.0008) [2023-12-27 22:48:03,556][106226] Updated weights for policy 0, policy_version 495396 (0.0007) [2023-12-27 22:48:03,610][106226] Updated weights for policy 0, policy_version 495406 (0.0006) [2023-12-27 22:48:03,668][106226] Updated weights for policy 0, policy_version 495416 (0.0005) [2023-12-27 22:48:04,194][106225] Updated weights for policy 1, policy_version 496853 (0.0009) [2023-12-27 22:48:04,253][106225] Updated weights for policy 1, policy_version 496863 (0.0010) [2023-12-27 22:48:04,306][106225] Updated weights for policy 1, policy_version 496873 (0.0011) [2023-12-27 22:48:04,370][106226] Updated weights for policy 0, policy_version 495426 (0.0006) [2023-12-27 22:48:04,428][106226] Updated weights for policy 0, policy_version 495436 (0.0008) [2023-12-27 22:48:04,486][106226] Updated weights for policy 0, policy_version 495446 (0.0008) [2023-12-27 22:48:04,996][106225] Updated weights for policy 1, policy_version 496883 (0.0010) [2023-12-27 22:48:05,063][106225] Updated weights for policy 1, policy_version 496893 (0.0010) [2023-12-27 22:48:05,090][106226] Updated weights for policy 0, policy_version 495456 (0.0005) [2023-12-27 22:48:05,122][106225] Updated weights for policy 1, policy_version 496903 (0.0009) [2023-12-27 22:48:05,154][106226] Updated weights for policy 0, policy_version 495466 (0.0006) [2023-12-27 22:48:05,223][106226] Updated weights for policy 0, policy_version 495476 (0.0011) [2023-12-27 22:48:05,707][106225] Updated weights for policy 1, policy_version 496913 (0.0005) [2023-12-27 22:48:05,763][106225] Updated weights for policy 1, policy_version 496923 (0.0009) [2023-12-27 22:48:05,825][106225] Updated weights for policy 1, policy_version 496933 (0.0006) [2023-12-27 22:48:05,891][106225] Updated weights for policy 1, policy_version 496943 (0.0006) [2023-12-27 22:48:05,995][106226] Updated weights for policy 0, policy_version 495486 (0.0007) [2023-12-27 22:48:06,058][106226] Updated weights for policy 0, policy_version 495496 (0.0009) [2023-12-27 22:48:06,118][106226] Updated weights for policy 0, policy_version 495506 (0.0008) [2023-12-27 22:48:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 254132224. Throughput: 0: 10072.5, 1: 9976.9. Samples: 254136252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:06,175][105115] Avg episode reward: [(0, '-4.907'), (1, '-5.531')] [2023-12-27 22:48:06,486][106225] Updated weights for policy 1, policy_version 496953 (0.0009) [2023-12-27 22:48:06,547][106225] Updated weights for policy 1, policy_version 496963 (0.0008) [2023-12-27 22:48:06,611][106225] Updated weights for policy 1, policy_version 496973 (0.0009) [2023-12-27 22:48:06,893][106226] Updated weights for policy 0, policy_version 495516 (0.0007) [2023-12-27 22:48:06,958][106226] Updated weights for policy 0, policy_version 495526 (0.0005) [2023-12-27 22:48:07,011][106226] Updated weights for policy 0, policy_version 495536 (0.0005) [2023-12-27 22:48:07,380][106225] Updated weights for policy 1, policy_version 496983 (0.0010) [2023-12-27 22:48:07,440][106225] Updated weights for policy 1, policy_version 496993 (0.0010) [2023-12-27 22:48:07,491][106225] Updated weights for policy 1, policy_version 497003 (0.0010) [2023-12-27 22:48:07,691][106226] Updated weights for policy 0, policy_version 495546 (0.0008) [2023-12-27 22:48:07,750][106226] Updated weights for policy 0, policy_version 495556 (0.0008) [2023-12-27 22:48:07,796][106226] Updated weights for policy 0, policy_version 495566 (0.0008) [2023-12-27 22:48:07,843][106226] Updated weights for policy 0, policy_version 495576 (0.0008) [2023-12-27 22:48:08,207][106225] Updated weights for policy 1, policy_version 497013 (0.0009) [2023-12-27 22:48:08,263][106225] Updated weights for policy 1, policy_version 497023 (0.0005) [2023-12-27 22:48:08,322][106225] Updated weights for policy 1, policy_version 497033 (0.0005) [2023-12-27 22:48:08,586][106226] Updated weights for policy 0, policy_version 495586 (0.0009) [2023-12-27 22:48:08,650][106226] Updated weights for policy 0, policy_version 495596 (0.0009) [2023-12-27 22:48:08,703][106226] Updated weights for policy 0, policy_version 495606 (0.0008) [2023-12-27 22:48:09,043][106225] Updated weights for policy 1, policy_version 497043 (0.0009) [2023-12-27 22:48:09,100][106225] Updated weights for policy 1, policy_version 497053 (0.0009) [2023-12-27 22:48:09,151][106225] Updated weights for policy 1, policy_version 497064 (0.0009) [2023-12-27 22:48:09,388][106226] Updated weights for policy 0, policy_version 495616 (0.0008) [2023-12-27 22:48:09,457][106226] Updated weights for policy 0, policy_version 495626 (0.0009) [2023-12-27 22:48:09,522][106226] Updated weights for policy 0, policy_version 495636 (0.0009) [2023-12-27 22:48:09,904][106225] Updated weights for policy 1, policy_version 497074 (0.0005) [2023-12-27 22:48:09,967][106225] Updated weights for policy 1, policy_version 497084 (0.0009) [2023-12-27 22:48:10,030][106225] Updated weights for policy 1, policy_version 497094 (0.0008) [2023-12-27 22:48:10,093][106225] Updated weights for policy 1, policy_version 497104 (0.0009) [2023-12-27 22:48:10,273][106226] Updated weights for policy 0, policy_version 495646 (0.0009) [2023-12-27 22:48:10,330][106226] Updated weights for policy 0, policy_version 495656 (0.0008) [2023-12-27 22:48:10,389][106226] Updated weights for policy 0, policy_version 495666 (0.0008) [2023-12-27 22:48:10,830][106225] Updated weights for policy 1, policy_version 497114 (0.0008) [2023-12-27 22:48:10,886][106225] Updated weights for policy 1, policy_version 497124 (0.0008) [2023-12-27 22:48:10,946][106225] Updated weights for policy 1, policy_version 497134 (0.0009) [2023-12-27 22:48:11,133][106226] Updated weights for policy 0, policy_version 495676 (0.0007) [2023-12-27 22:48:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 254222336. Throughput: 0: 10006.2, 1: 10034.7. Samples: 254195192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:11,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-5.686')] [2023-12-27 22:48:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000497136_127295488.pth... [2023-12-27 22:48:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000495952_126992384.pth [2023-12-27 22:48:11,208][106226] Updated weights for policy 0, policy_version 495686 (0.0009) [2023-12-27 22:48:11,274][106226] Updated weights for policy 0, policy_version 495696 (0.0009) [2023-12-27 22:48:11,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000495704_126935040.pth... [2023-12-27 22:48:11,331][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000494520_126631936.pth [2023-12-27 22:48:11,745][106225] Updated weights for policy 1, policy_version 497144 (0.0009) [2023-12-27 22:48:11,816][106225] Updated weights for policy 1, policy_version 497154 (0.0008) [2023-12-27 22:48:11,886][106225] Updated weights for policy 1, policy_version 497164 (0.0007) [2023-12-27 22:48:11,966][106226] Updated weights for policy 0, policy_version 495706 (0.0009) [2023-12-27 22:48:12,016][106226] Updated weights for policy 0, policy_version 495716 (0.0009) [2023-12-27 22:48:12,074][106226] Updated weights for policy 0, policy_version 495726 (0.0010) [2023-12-27 22:48:12,133][106226] Updated weights for policy 0, policy_version 495736 (0.0008) [2023-12-27 22:48:12,581][106225] Updated weights for policy 1, policy_version 497174 (0.0009) [2023-12-27 22:48:12,644][106225] Updated weights for policy 1, policy_version 497184 (0.0010) [2023-12-27 22:48:12,703][106225] Updated weights for policy 1, policy_version 497194 (0.0008) [2023-12-27 22:48:12,858][106226] Updated weights for policy 0, policy_version 495746 (0.0009) [2023-12-27 22:48:12,911][106226] Updated weights for policy 0, policy_version 495756 (0.0007) [2023-12-27 22:48:12,968][106226] Updated weights for policy 0, policy_version 495766 (0.0010) [2023-12-27 22:48:13,465][106225] Updated weights for policy 1, policy_version 497204 (0.0008) [2023-12-27 22:48:13,527][106225] Updated weights for policy 1, policy_version 497214 (0.0008) [2023-12-27 22:48:13,586][106225] Updated weights for policy 1, policy_version 497224 (0.0009) [2023-12-27 22:48:13,619][106226] Updated weights for policy 0, policy_version 495776 (0.0006) [2023-12-27 22:48:13,670][106226] Updated weights for policy 0, policy_version 495786 (0.0005) [2023-12-27 22:48:13,726][106226] Updated weights for policy 0, policy_version 495796 (0.0008) [2023-12-27 22:48:14,220][106225] Updated weights for policy 1, policy_version 497234 (0.0007) [2023-12-27 22:48:14,280][106225] Updated weights for policy 1, policy_version 497244 (0.0008) [2023-12-27 22:48:14,342][106225] Updated weights for policy 1, policy_version 497254 (0.0008) [2023-12-27 22:48:14,408][106225] Updated weights for policy 1, policy_version 497264 (0.0009) [2023-12-27 22:48:14,450][106226] Updated weights for policy 0, policy_version 495806 (0.0006) [2023-12-27 22:48:14,496][106226] Updated weights for policy 0, policy_version 495816 (0.0008) [2023-12-27 22:48:14,556][106226] Updated weights for policy 0, policy_version 495826 (0.0008) [2023-12-27 22:48:15,204][106226] Updated weights for policy 0, policy_version 495836 (0.0007) [2023-12-27 22:48:15,232][106225] Updated weights for policy 1, policy_version 497274 (0.0008) [2023-12-27 22:48:15,268][106226] Updated weights for policy 0, policy_version 495846 (0.0008) [2023-12-27 22:48:15,293][106225] Updated weights for policy 1, policy_version 497284 (0.0009) [2023-12-27 22:48:15,327][106226] Updated weights for policy 0, policy_version 495856 (0.0006) [2023-12-27 22:48:15,352][106225] Updated weights for policy 1, policy_version 497294 (0.0009) [2023-12-27 22:48:15,976][106226] Updated weights for policy 0, policy_version 495866 (0.0007) [2023-12-27 22:48:16,033][106226] Updated weights for policy 0, policy_version 495876 (0.0008) [2023-12-27 22:48:16,066][106225] Updated weights for policy 1, policy_version 497304 (0.0008) [2023-12-27 22:48:16,080][106226] Updated weights for policy 0, policy_version 495886 (0.0006) [2023-12-27 22:48:16,118][106225] Updated weights for policy 1, policy_version 497314 (0.0007) [2023-12-27 22:48:16,135][106226] Updated weights for policy 0, policy_version 495896 (0.0006) [2023-12-27 22:48:16,169][106225] Updated weights for policy 1, policy_version 497324 (0.0007) [2023-12-27 22:48:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19934.0, 300 sec: 19716.3). Total num frames: 254320640. Throughput: 0: 9974.7, 1: 9889.1. Samples: 254310012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:16,175][105115] Avg episode reward: [(0, '-4.796'), (1, '-5.505')] [2023-12-27 22:48:16,782][106226] Updated weights for policy 0, policy_version 495906 (0.0005) [2023-12-27 22:48:16,838][106226] Updated weights for policy 0, policy_version 495916 (0.0005) [2023-12-27 22:48:16,902][106226] Updated weights for policy 0, policy_version 495926 (0.0006) [2023-12-27 22:48:16,919][106225] Updated weights for policy 1, policy_version 497334 (0.0006) [2023-12-27 22:48:16,963][106225] Updated weights for policy 1, policy_version 497344 (0.0005) [2023-12-27 22:48:17,013][106225] Updated weights for policy 1, policy_version 497354 (0.0007) [2023-12-27 22:48:17,465][106226] Updated weights for policy 0, policy_version 495936 (0.0007) [2023-12-27 22:48:17,525][106226] Updated weights for policy 0, policy_version 495946 (0.0009) [2023-12-27 22:48:17,575][106226] Updated weights for policy 0, policy_version 495956 (0.0007) [2023-12-27 22:48:17,753][106225] Updated weights for policy 1, policy_version 497364 (0.0009) [2023-12-27 22:48:17,808][106225] Updated weights for policy 1, policy_version 497374 (0.0008) [2023-12-27 22:48:17,866][106225] Updated weights for policy 1, policy_version 497384 (0.0008) [2023-12-27 22:48:18,303][106226] Updated weights for policy 0, policy_version 495966 (0.0007) [2023-12-27 22:48:18,365][106226] Updated weights for policy 0, policy_version 495976 (0.0009) [2023-12-27 22:48:18,437][106226] Updated weights for policy 0, policy_version 495986 (0.0008) [2023-12-27 22:48:18,544][106225] Updated weights for policy 1, policy_version 497394 (0.0009) [2023-12-27 22:48:18,606][106225] Updated weights for policy 1, policy_version 497404 (0.0006) [2023-12-27 22:48:18,671][106225] Updated weights for policy 1, policy_version 497414 (0.0009) [2023-12-27 22:48:18,729][106225] Updated weights for policy 1, policy_version 497424 (0.0009) [2023-12-27 22:48:19,221][106226] Updated weights for policy 0, policy_version 495996 (0.0008) [2023-12-27 22:48:19,292][106226] Updated weights for policy 0, policy_version 496006 (0.0007) [2023-12-27 22:48:19,354][106225] Updated weights for policy 1, policy_version 497434 (0.0007) [2023-12-27 22:48:19,369][106226] Updated weights for policy 0, policy_version 496016 (0.0009) [2023-12-27 22:48:19,414][106225] Updated weights for policy 1, policy_version 497444 (0.0008) [2023-12-27 22:48:19,465][106225] Updated weights for policy 1, policy_version 497454 (0.0009) [2023-12-27 22:48:20,043][106226] Updated weights for policy 0, policy_version 496026 (0.0008) [2023-12-27 22:48:20,106][106226] Updated weights for policy 0, policy_version 496036 (0.0006) [2023-12-27 22:48:20,165][106226] Updated weights for policy 0, policy_version 496046 (0.0009) [2023-12-27 22:48:20,227][106226] Updated weights for policy 0, policy_version 496056 (0.0007) [2023-12-27 22:48:20,286][106225] Updated weights for policy 1, policy_version 497464 (0.0008) [2023-12-27 22:48:20,348][106225] Updated weights for policy 1, policy_version 497474 (0.0008) [2023-12-27 22:48:20,414][106225] Updated weights for policy 1, policy_version 497484 (0.0010) [2023-12-27 22:48:20,881][106226] Updated weights for policy 0, policy_version 496066 (0.0006) [2023-12-27 22:48:20,944][106226] Updated weights for policy 0, policy_version 496076 (0.0006) [2023-12-27 22:48:21,007][106226] Updated weights for policy 0, policy_version 496086 (0.0008) [2023-12-27 22:48:21,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 254418944. Throughput: 0: 9953.1, 1: 9818.5. Samples: 254428812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:21,175][105115] Avg episode reward: [(0, '-4.973'), (1, '-5.610')] [2023-12-27 22:48:21,196][106225] Updated weights for policy 1, policy_version 497494 (0.0009) [2023-12-27 22:48:21,267][106225] Updated weights for policy 1, policy_version 497504 (0.0008) [2023-12-27 22:48:21,338][106225] Updated weights for policy 1, policy_version 497514 (0.0008) [2023-12-27 22:48:21,749][106226] Updated weights for policy 0, policy_version 496096 (0.0009) [2023-12-27 22:48:21,814][106226] Updated weights for policy 0, policy_version 496106 (0.0007) [2023-12-27 22:48:21,870][106226] Updated weights for policy 0, policy_version 496116 (0.0006) [2023-12-27 22:48:22,124][106225] Updated weights for policy 1, policy_version 497524 (0.0008) [2023-12-27 22:48:22,177][106225] Updated weights for policy 1, policy_version 497534 (0.0008) [2023-12-27 22:48:22,237][106225] Updated weights for policy 1, policy_version 497544 (0.0008) [2023-12-27 22:48:22,541][106226] Updated weights for policy 0, policy_version 496126 (0.0006) [2023-12-27 22:48:22,606][106226] Updated weights for policy 0, policy_version 496136 (0.0008) [2023-12-27 22:48:22,672][106226] Updated weights for policy 0, policy_version 496146 (0.0009) [2023-12-27 22:48:23,005][106225] Updated weights for policy 1, policy_version 497555 (0.0009) [2023-12-27 22:48:23,064][106225] Updated weights for policy 1, policy_version 497565 (0.0007) [2023-12-27 22:48:23,124][106225] Updated weights for policy 1, policy_version 497575 (0.0006) [2023-12-27 22:48:23,337][106226] Updated weights for policy 0, policy_version 496156 (0.0009) [2023-12-27 22:48:23,394][106226] Updated weights for policy 0, policy_version 496166 (0.0008) [2023-12-27 22:48:23,454][106226] Updated weights for policy 0, policy_version 496176 (0.0008) [2023-12-27 22:48:23,777][106225] Updated weights for policy 1, policy_version 497585 (0.0008) [2023-12-27 22:48:23,840][106225] Updated weights for policy 1, policy_version 497595 (0.0010) [2023-12-27 22:48:23,886][106225] Updated weights for policy 1, policy_version 497605 (0.0010) [2023-12-27 22:48:23,933][106225] Updated weights for policy 1, policy_version 497615 (0.0010) [2023-12-27 22:48:24,196][106226] Updated weights for policy 0, policy_version 496186 (0.0007) [2023-12-27 22:48:24,252][106226] Updated weights for policy 0, policy_version 496196 (0.0008) [2023-12-27 22:48:24,305][106226] Updated weights for policy 0, policy_version 496206 (0.0008) [2023-12-27 22:48:24,361][106226] Updated weights for policy 0, policy_version 496216 (0.0007) [2023-12-27 22:48:24,623][106225] Updated weights for policy 1, policy_version 497625 (0.0006) [2023-12-27 22:48:24,668][106225] Updated weights for policy 1, policy_version 497635 (0.0005) [2023-12-27 22:48:24,716][106225] Updated weights for policy 1, policy_version 497645 (0.0005) [2023-12-27 22:48:25,135][106226] Updated weights for policy 0, policy_version 496226 (0.0008) [2023-12-27 22:48:25,195][106226] Updated weights for policy 0, policy_version 496236 (0.0007) [2023-12-27 22:48:25,253][106226] Updated weights for policy 0, policy_version 496246 (0.0008) [2023-12-27 22:48:25,370][106225] Updated weights for policy 1, policy_version 497655 (0.0009) [2023-12-27 22:48:25,430][106225] Updated weights for policy 1, policy_version 497665 (0.0010) [2023-12-27 22:48:25,486][106225] Updated weights for policy 1, policy_version 497675 (0.0010) [2023-12-27 22:48:25,978][106226] Updated weights for policy 0, policy_version 496256 (0.0008) [2023-12-27 22:48:26,032][106226] Updated weights for policy 0, policy_version 496266 (0.0008) [2023-12-27 22:48:26,091][106226] Updated weights for policy 0, policy_version 496276 (0.0008) [2023-12-27 22:48:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 254517248. Throughput: 0: 9924.4, 1: 9793.6. Samples: 254486424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:26,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-5.488')] [2023-12-27 22:48:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000496280_127082496.pth... [2023-12-27 22:48:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000495128_126787584.pth [2023-12-27 22:48:26,197][106225] Updated weights for policy 1, policy_version 497685 (0.0010) [2023-12-27 22:48:26,244][106225] Updated weights for policy 1, policy_version 497695 (0.0010) [2023-12-27 22:48:26,303][106225] Updated weights for policy 1, policy_version 497705 (0.0010) [2023-12-27 22:48:26,337][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000497712_127442944.pth... [2023-12-27 22:48:26,340][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000496560_127148032.pth [2023-12-27 22:48:26,696][106226] Updated weights for policy 0, policy_version 496286 (0.0007) [2023-12-27 22:48:26,745][106226] Updated weights for policy 0, policy_version 496296 (0.0006) [2023-12-27 22:48:26,795][106226] Updated weights for policy 0, policy_version 496306 (0.0006) [2023-12-27 22:48:27,020][106225] Updated weights for policy 1, policy_version 497715 (0.0010) [2023-12-27 22:48:27,075][106225] Updated weights for policy 1, policy_version 497725 (0.0010) [2023-12-27 22:48:27,121][106225] Updated weights for policy 1, policy_version 497735 (0.0010) [2023-12-27 22:48:27,394][106226] Updated weights for policy 0, policy_version 496316 (0.0008) [2023-12-27 22:48:27,445][106226] Updated weights for policy 0, policy_version 496326 (0.0006) [2023-12-27 22:48:27,508][106226] Updated weights for policy 0, policy_version 496336 (0.0005) [2023-12-27 22:48:27,840][106225] Updated weights for policy 1, policy_version 497745 (0.0010) [2023-12-27 22:48:27,903][106225] Updated weights for policy 1, policy_version 497755 (0.0010) [2023-12-27 22:48:27,953][106225] Updated weights for policy 1, policy_version 497765 (0.0010) [2023-12-27 22:48:28,002][106225] Updated weights for policy 1, policy_version 497775 (0.0010) [2023-12-27 22:48:28,096][106226] Updated weights for policy 0, policy_version 496346 (0.0005) [2023-12-27 22:48:28,146][106226] Updated weights for policy 0, policy_version 496356 (0.0007) [2023-12-27 22:48:28,200][106226] Updated weights for policy 0, policy_version 496366 (0.0008) [2023-12-27 22:48:28,259][106226] Updated weights for policy 0, policy_version 496376 (0.0008) [2023-12-27 22:48:28,722][106225] Updated weights for policy 1, policy_version 497785 (0.0010) [2023-12-27 22:48:28,769][106225] Updated weights for policy 1, policy_version 497795 (0.0010) [2023-12-27 22:48:28,816][106225] Updated weights for policy 1, policy_version 497805 (0.0010) [2023-12-27 22:48:28,989][106226] Updated weights for policy 0, policy_version 496386 (0.0005) [2023-12-27 22:48:29,050][106226] Updated weights for policy 0, policy_version 496396 (0.0010) [2023-12-27 22:48:29,103][106226] Updated weights for policy 0, policy_version 496406 (0.0005) [2023-12-27 22:48:29,557][106225] Updated weights for policy 1, policy_version 497815 (0.0008) [2023-12-27 22:48:29,607][106225] Updated weights for policy 1, policy_version 497825 (0.0007) [2023-12-27 22:48:29,657][106225] Updated weights for policy 1, policy_version 497835 (0.0008) [2023-12-27 22:48:29,790][106226] Updated weights for policy 0, policy_version 496416 (0.0010) [2023-12-27 22:48:29,850][106226] Updated weights for policy 0, policy_version 496426 (0.0009) [2023-12-27 22:48:29,915][106226] Updated weights for policy 0, policy_version 496436 (0.0008) [2023-12-27 22:48:30,385][106225] Updated weights for policy 1, policy_version 497845 (0.0011) [2023-12-27 22:48:30,452][106225] Updated weights for policy 1, policy_version 497855 (0.0010) [2023-12-27 22:48:30,511][106225] Updated weights for policy 1, policy_version 497865 (0.0010) [2023-12-27 22:48:30,701][106226] Updated weights for policy 0, policy_version 496446 (0.0008) [2023-12-27 22:48:30,762][106226] Updated weights for policy 0, policy_version 496456 (0.0008) [2023-12-27 22:48:30,821][106226] Updated weights for policy 0, policy_version 496466 (0.0006) [2023-12-27 22:48:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 254615552. Throughput: 0: 9976.9, 1: 9856.3. Samples: 254607240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:31,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-5.682')] [2023-12-27 22:48:31,213][106225] Updated weights for policy 1, policy_version 497875 (0.0010) [2023-12-27 22:48:31,274][106225] Updated weights for policy 1, policy_version 497885 (0.0009) [2023-12-27 22:48:31,331][106225] Updated weights for policy 1, policy_version 497895 (0.0010) [2023-12-27 22:48:31,549][106226] Updated weights for policy 0, policy_version 496476 (0.0006) [2023-12-27 22:48:31,613][106226] Updated weights for policy 0, policy_version 496486 (0.0006) [2023-12-27 22:48:31,680][106226] Updated weights for policy 0, policy_version 496496 (0.0006) [2023-12-27 22:48:32,084][106225] Updated weights for policy 1, policy_version 497905 (0.0010) [2023-12-27 22:48:32,143][106225] Updated weights for policy 1, policy_version 497915 (0.0009) [2023-12-27 22:48:32,198][106225] Updated weights for policy 1, policy_version 497925 (0.0008) [2023-12-27 22:48:32,264][106225] Updated weights for policy 1, policy_version 497935 (0.0006) [2023-12-27 22:48:32,336][106226] Updated weights for policy 0, policy_version 496506 (0.0007) [2023-12-27 22:48:32,403][106226] Updated weights for policy 0, policy_version 496516 (0.0006) [2023-12-27 22:48:32,457][106226] Updated weights for policy 0, policy_version 496526 (0.0007) [2023-12-27 22:48:32,502][106226] Updated weights for policy 0, policy_version 496536 (0.0008) [2023-12-27 22:48:32,968][106225] Updated weights for policy 1, policy_version 497945 (0.0008) [2023-12-27 22:48:33,018][106225] Updated weights for policy 1, policy_version 497955 (0.0008) [2023-12-27 22:48:33,065][106225] Updated weights for policy 1, policy_version 497965 (0.0008) [2023-12-27 22:48:33,175][106226] Updated weights for policy 0, policy_version 496546 (0.0009) [2023-12-27 22:48:33,229][106226] Updated weights for policy 0, policy_version 496556 (0.0009) [2023-12-27 22:48:33,283][106226] Updated weights for policy 0, policy_version 496566 (0.0009) [2023-12-27 22:48:33,733][106225] Updated weights for policy 1, policy_version 497975 (0.0010) [2023-12-27 22:48:33,788][106225] Updated weights for policy 1, policy_version 497985 (0.0010) [2023-12-27 22:48:33,839][106226] Updated weights for policy 0, policy_version 496576 (0.0008) [2023-12-27 22:48:33,845][106225] Updated weights for policy 1, policy_version 497995 (0.0006) [2023-12-27 22:48:33,889][106226] Updated weights for policy 0, policy_version 496586 (0.0007) [2023-12-27 22:48:33,934][106226] Updated weights for policy 0, policy_version 496596 (0.0007) [2023-12-27 22:48:34,548][106225] Updated weights for policy 1, policy_version 498005 (0.0009) [2023-12-27 22:48:34,606][106225] Updated weights for policy 1, policy_version 498015 (0.0009) [2023-12-27 22:48:34,667][106225] Updated weights for policy 1, policy_version 498025 (0.0006) [2023-12-27 22:48:34,707][106226] Updated weights for policy 0, policy_version 496606 (0.0008) [2023-12-27 22:48:34,768][106226] Updated weights for policy 0, policy_version 496616 (0.0009) [2023-12-27 22:48:34,818][106226] Updated weights for policy 0, policy_version 496626 (0.0009) [2023-12-27 22:48:35,214][106225] Updated weights for policy 1, policy_version 498035 (0.0005) [2023-12-27 22:48:35,273][106225] Updated weights for policy 1, policy_version 498045 (0.0010) [2023-12-27 22:48:35,332][106225] Updated weights for policy 1, policy_version 498055 (0.0010) [2023-12-27 22:48:35,576][106226] Updated weights for policy 0, policy_version 496636 (0.0008) [2023-12-27 22:48:35,636][106226] Updated weights for policy 0, policy_version 496646 (0.0005) [2023-12-27 22:48:35,695][106226] Updated weights for policy 0, policy_version 496656 (0.0007) [2023-12-27 22:48:36,019][106225] Updated weights for policy 1, policy_version 498065 (0.0010) [2023-12-27 22:48:36,077][106225] Updated weights for policy 1, policy_version 498075 (0.0011) [2023-12-27 22:48:36,140][106225] Updated weights for policy 1, policy_version 498085 (0.0010) [2023-12-27 22:48:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 254713856. Throughput: 0: 10029.1, 1: 9824.6. Samples: 254728440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:36,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.636')] [2023-12-27 22:48:36,193][106225] Updated weights for policy 1, policy_version 498095 (0.0007) [2023-12-27 22:48:36,392][106226] Updated weights for policy 0, policy_version 496666 (0.0007) [2023-12-27 22:48:36,461][106226] Updated weights for policy 0, policy_version 496676 (0.0010) [2023-12-27 22:48:36,522][106226] Updated weights for policy 0, policy_version 496686 (0.0009) [2023-12-27 22:48:36,591][106226] Updated weights for policy 0, policy_version 496696 (0.0007) [2023-12-27 22:48:36,849][106225] Updated weights for policy 1, policy_version 498105 (0.0009) [2023-12-27 22:48:36,907][106225] Updated weights for policy 1, policy_version 498115 (0.0010) [2023-12-27 22:48:36,964][106225] Updated weights for policy 1, policy_version 498125 (0.0008) [2023-12-27 22:48:37,260][106226] Updated weights for policy 0, policy_version 496706 (0.0006) [2023-12-27 22:48:37,333][106226] Updated weights for policy 0, policy_version 496716 (0.0006) [2023-12-27 22:48:37,398][106226] Updated weights for policy 0, policy_version 496726 (0.0007) [2023-12-27 22:48:37,654][106225] Updated weights for policy 1, policy_version 498135 (0.0010) [2023-12-27 22:48:37,705][106225] Updated weights for policy 1, policy_version 498145 (0.0009) [2023-12-27 22:48:37,759][106225] Updated weights for policy 1, policy_version 498155 (0.0009) [2023-12-27 22:48:38,042][106226] Updated weights for policy 0, policy_version 496736 (0.0010) [2023-12-27 22:48:38,096][106226] Updated weights for policy 0, policy_version 496746 (0.0010) [2023-12-27 22:48:38,142][106226] Updated weights for policy 0, policy_version 496756 (0.0010) [2023-12-27 22:48:38,459][106225] Updated weights for policy 1, policy_version 498165 (0.0008) [2023-12-27 22:48:38,520][106225] Updated weights for policy 1, policy_version 498175 (0.0009) [2023-12-27 22:48:38,579][106225] Updated weights for policy 1, policy_version 498185 (0.0010) [2023-12-27 22:48:38,866][106226] Updated weights for policy 0, policy_version 496766 (0.0011) [2023-12-27 22:48:38,936][106226] Updated weights for policy 0, policy_version 496776 (0.0011) [2023-12-27 22:48:38,998][106226] Updated weights for policy 0, policy_version 496786 (0.0011) [2023-12-27 22:48:39,344][106225] Updated weights for policy 1, policy_version 498195 (0.0008) [2023-12-27 22:48:39,433][106225] Updated weights for policy 1, policy_version 498205 (0.0007) [2023-12-27 22:48:39,490][106225] Updated weights for policy 1, policy_version 498215 (0.0008) [2023-12-27 22:48:39,668][106226] Updated weights for policy 0, policy_version 496796 (0.0008) [2023-12-27 22:48:39,739][106226] Updated weights for policy 0, policy_version 496806 (0.0006) [2023-12-27 22:48:39,808][106226] Updated weights for policy 0, policy_version 496816 (0.0011) [2023-12-27 22:48:40,138][106225] Updated weights for policy 1, policy_version 498225 (0.0007) [2023-12-27 22:48:40,203][106225] Updated weights for policy 1, policy_version 498235 (0.0010) [2023-12-27 22:48:40,258][106225] Updated weights for policy 1, policy_version 498245 (0.0010) [2023-12-27 22:48:40,316][106225] Updated weights for policy 1, policy_version 498255 (0.0010) [2023-12-27 22:48:40,515][106226] Updated weights for policy 0, policy_version 496826 (0.0010) [2023-12-27 22:48:40,565][106226] Updated weights for policy 0, policy_version 496836 (0.0011) [2023-12-27 22:48:40,622][106226] Updated weights for policy 0, policy_version 496846 (0.0011) [2023-12-27 22:48:40,679][106226] Updated weights for policy 0, policy_version 496856 (0.0011) [2023-12-27 22:48:41,056][106225] Updated weights for policy 1, policy_version 498265 (0.0010) [2023-12-27 22:48:41,111][106225] Updated weights for policy 1, policy_version 498275 (0.0008) [2023-12-27 22:48:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 254812160. Throughput: 0: 10004.9, 1: 9858.3. Samples: 254787676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:41,176][105115] Avg episode reward: [(0, '-4.960'), (1, '-5.828')] [2023-12-27 22:48:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000496856_127229952.pth... [2023-12-27 22:48:41,183][106225] Updated weights for policy 1, policy_version 498285 (0.0010) [2023-12-27 22:48:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000495704_126935040.pth [2023-12-27 22:48:41,202][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000498288_127590400.pth... [2023-12-27 22:48:41,205][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000497136_127295488.pth [2023-12-27 22:48:41,491][106226] Updated weights for policy 0, policy_version 496866 (0.0008) [2023-12-27 22:48:41,554][106226] Updated weights for policy 0, policy_version 496876 (0.0008) [2023-12-27 22:48:41,615][106226] Updated weights for policy 0, policy_version 496886 (0.0008) [2023-12-27 22:48:42,041][106225] Updated weights for policy 1, policy_version 498295 (0.0008) [2023-12-27 22:48:42,105][106225] Updated weights for policy 1, policy_version 498305 (0.0009) [2023-12-27 22:48:42,163][106225] Updated weights for policy 1, policy_version 498315 (0.0009) [2023-12-27 22:48:42,336][106226] Updated weights for policy 0, policy_version 496896 (0.0008) [2023-12-27 22:48:42,404][106226] Updated weights for policy 0, policy_version 496906 (0.0009) [2023-12-27 22:48:42,453][106226] Updated weights for policy 0, policy_version 496916 (0.0005) [2023-12-27 22:48:42,891][106225] Updated weights for policy 1, policy_version 498325 (0.0008) [2023-12-27 22:48:42,951][106225] Updated weights for policy 1, policy_version 498335 (0.0008) [2023-12-27 22:48:43,006][106225] Updated weights for policy 1, policy_version 498345 (0.0008) [2023-12-27 22:48:43,212][106226] Updated weights for policy 0, policy_version 496926 (0.0007) [2023-12-27 22:48:43,274][106226] Updated weights for policy 0, policy_version 496936 (0.0009) [2023-12-27 22:48:43,333][106226] Updated weights for policy 0, policy_version 496946 (0.0009) [2023-12-27 22:48:43,675][106225] Updated weights for policy 1, policy_version 498355 (0.0007) [2023-12-27 22:48:43,723][106225] Updated weights for policy 1, policy_version 498365 (0.0008) [2023-12-27 22:48:43,769][106225] Updated weights for policy 1, policy_version 498375 (0.0008) [2023-12-27 22:48:44,055][106226] Updated weights for policy 0, policy_version 496956 (0.0009) [2023-12-27 22:48:44,117][106226] Updated weights for policy 0, policy_version 496966 (0.0008) [2023-12-27 22:48:44,176][106226] Updated weights for policy 0, policy_version 496976 (0.0008) [2023-12-27 22:48:44,460][106225] Updated weights for policy 1, policy_version 498385 (0.0008) [2023-12-27 22:48:44,515][106225] Updated weights for policy 1, policy_version 498395 (0.0008) [2023-12-27 22:48:44,575][106225] Updated weights for policy 1, policy_version 498405 (0.0008) [2023-12-27 22:48:44,630][106225] Updated weights for policy 1, policy_version 498415 (0.0008) [2023-12-27 22:48:44,911][106226] Updated weights for policy 0, policy_version 496986 (0.0008) [2023-12-27 22:48:44,977][106226] Updated weights for policy 0, policy_version 496996 (0.0007) [2023-12-27 22:48:45,048][106226] Updated weights for policy 0, policy_version 497006 (0.0008) [2023-12-27 22:48:45,115][106226] Updated weights for policy 0, policy_version 497016 (0.0010) [2023-12-27 22:48:45,319][106225] Updated weights for policy 1, policy_version 498425 (0.0008) [2023-12-27 22:48:45,377][106225] Updated weights for policy 1, policy_version 498435 (0.0008) [2023-12-27 22:48:45,433][106225] Updated weights for policy 1, policy_version 498445 (0.0008) [2023-12-27 22:48:45,855][106226] Updated weights for policy 0, policy_version 497026 (0.0009) [2023-12-27 22:48:45,903][106226] Updated weights for policy 0, policy_version 497036 (0.0007) [2023-12-27 22:48:45,959][106226] Updated weights for policy 0, policy_version 497046 (0.0008) [2023-12-27 22:48:46,103][106225] Updated weights for policy 1, policy_version 498455 (0.0006) [2023-12-27 22:48:46,165][106225] Updated weights for policy 1, policy_version 498465 (0.0008) [2023-12-27 22:48:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 254910464. Throughput: 0: 9959.0, 1: 9793.7. Samples: 254902132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:46,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-5.449')] [2023-12-27 22:48:46,227][106225] Updated weights for policy 1, policy_version 498475 (0.0009) [2023-12-27 22:48:46,648][106226] Updated weights for policy 0, policy_version 497056 (0.0007) [2023-12-27 22:48:46,712][106226] Updated weights for policy 0, policy_version 497066 (0.0008) [2023-12-27 22:48:46,768][106226] Updated weights for policy 0, policy_version 497076 (0.0007) [2023-12-27 22:48:46,953][106225] Updated weights for policy 1, policy_version 498485 (0.0007) [2023-12-27 22:48:47,010][106225] Updated weights for policy 1, policy_version 498495 (0.0005) [2023-12-27 22:48:47,065][106225] Updated weights for policy 1, policy_version 498505 (0.0005) [2023-12-27 22:48:47,554][106226] Updated weights for policy 0, policy_version 497086 (0.0008) [2023-12-27 22:48:47,613][106226] Updated weights for policy 0, policy_version 497096 (0.0008) [2023-12-27 22:48:47,665][106225] Updated weights for policy 1, policy_version 498515 (0.0007) [2023-12-27 22:48:47,671][106226] Updated weights for policy 0, policy_version 497106 (0.0008) [2023-12-27 22:48:47,720][106225] Updated weights for policy 1, policy_version 498525 (0.0010) [2023-12-27 22:48:47,780][106225] Updated weights for policy 1, policy_version 498535 (0.0010) [2023-12-27 22:48:48,372][106225] Updated weights for policy 1, policy_version 498545 (0.0006) [2023-12-27 22:48:48,423][106225] Updated weights for policy 1, policy_version 498555 (0.0010) [2023-12-27 22:48:48,444][106226] Updated weights for policy 0, policy_version 497116 (0.0006) [2023-12-27 22:48:48,477][106225] Updated weights for policy 1, policy_version 498565 (0.0011) [2023-12-27 22:48:48,506][106226] Updated weights for policy 0, policy_version 497126 (0.0006) [2023-12-27 22:48:48,529][106225] Updated weights for policy 1, policy_version 498575 (0.0009) [2023-12-27 22:48:48,567][106226] Updated weights for policy 0, policy_version 497136 (0.0007) [2023-12-27 22:48:49,265][106226] Updated weights for policy 0, policy_version 497146 (0.0008) [2023-12-27 22:48:49,295][106225] Updated weights for policy 1, policy_version 498585 (0.0008) [2023-12-27 22:48:49,327][106226] Updated weights for policy 0, policy_version 497156 (0.0007) [2023-12-27 22:48:49,359][106225] Updated weights for policy 1, policy_version 498595 (0.0008) [2023-12-27 22:48:49,397][106226] Updated weights for policy 0, policy_version 497166 (0.0009) [2023-12-27 22:48:49,419][106225] Updated weights for policy 1, policy_version 498605 (0.0007) [2023-12-27 22:48:49,456][106226] Updated weights for policy 0, policy_version 497176 (0.0008) [2023-12-27 22:48:50,088][106225] Updated weights for policy 1, policy_version 498615 (0.0008) [2023-12-27 22:48:50,136][106225] Updated weights for policy 1, policy_version 498625 (0.0009) [2023-12-27 22:48:50,193][106225] Updated weights for policy 1, policy_version 498635 (0.0009) [2023-12-27 22:48:50,222][106226] Updated weights for policy 0, policy_version 497186 (0.0008) [2023-12-27 22:48:50,276][106226] Updated weights for policy 0, policy_version 497196 (0.0008) [2023-12-27 22:48:50,335][106226] Updated weights for policy 0, policy_version 497206 (0.0010) [2023-12-27 22:48:50,927][106225] Updated weights for policy 1, policy_version 498645 (0.0007) [2023-12-27 22:48:50,980][106225] Updated weights for policy 1, policy_version 498655 (0.0009) [2023-12-27 22:48:51,042][106225] Updated weights for policy 1, policy_version 498665 (0.0007) [2023-12-27 22:48:51,057][106226] Updated weights for policy 0, policy_version 497216 (0.0008) [2023-12-27 22:48:51,114][106226] Updated weights for policy 0, policy_version 497226 (0.0009) [2023-12-27 22:48:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 255008768. Throughput: 0: 9844.7, 1: 9796.7. Samples: 255020116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:48:51,175][105115] Avg episode reward: [(0, '-5.108'), (1, '-5.570')] [2023-12-27 22:48:51,184][106226] Updated weights for policy 0, policy_version 497236 (0.0008) [2023-12-27 22:48:51,791][106225] Updated weights for policy 1, policy_version 498675 (0.0007) [2023-12-27 22:48:51,862][106225] Updated weights for policy 1, policy_version 498685 (0.0008) [2023-12-27 22:48:51,925][106225] Updated weights for policy 1, policy_version 498695 (0.0009) [2023-12-27 22:48:51,949][106226] Updated weights for policy 0, policy_version 497246 (0.0008) [2023-12-27 22:48:51,996][106226] Updated weights for policy 0, policy_version 497256 (0.0007) [2023-12-27 22:48:52,050][106226] Updated weights for policy 0, policy_version 497266 (0.0007) [2023-12-27 22:48:52,635][106225] Updated weights for policy 1, policy_version 498705 (0.0008) [2023-12-27 22:48:52,694][106225] Updated weights for policy 1, policy_version 498715 (0.0010) [2023-12-27 22:48:52,735][106226] Updated weights for policy 0, policy_version 497276 (0.0007) [2023-12-27 22:48:52,757][106225] Updated weights for policy 1, policy_version 498725 (0.0009) [2023-12-27 22:48:52,802][106226] Updated weights for policy 0, policy_version 497286 (0.0005) [2023-12-27 22:48:52,817][106225] Updated weights for policy 1, policy_version 498735 (0.0007) [2023-12-27 22:48:52,874][106226] Updated weights for policy 0, policy_version 497296 (0.0005) [2023-12-27 22:48:53,451][106225] Updated weights for policy 1, policy_version 498745 (0.0007) [2023-12-27 22:48:53,504][106225] Updated weights for policy 1, policy_version 498755 (0.0008) [2023-12-27 22:48:53,550][106225] Updated weights for policy 1, policy_version 498765 (0.0008) [2023-12-27 22:48:53,596][106226] Updated weights for policy 0, policy_version 497306 (0.0007) [2023-12-27 22:48:53,665][106226] Updated weights for policy 0, policy_version 497316 (0.0010) [2023-12-27 22:48:53,718][106226] Updated weights for policy 0, policy_version 497326 (0.0010) [2023-12-27 22:48:53,774][106226] Updated weights for policy 0, policy_version 497336 (0.0010) [2023-12-27 22:48:54,321][106225] Updated weights for policy 1, policy_version 498775 (0.0006) [2023-12-27 22:48:54,375][106225] Updated weights for policy 1, policy_version 498785 (0.0007) [2023-12-27 22:48:54,393][106226] Updated weights for policy 0, policy_version 497346 (0.0006) [2023-12-27 22:48:54,430][106225] Updated weights for policy 1, policy_version 498795 (0.0005) [2023-12-27 22:48:54,462][106226] Updated weights for policy 0, policy_version 497356 (0.0008) [2023-12-27 22:48:54,523][106226] Updated weights for policy 0, policy_version 497366 (0.0008) [2023-12-27 22:48:55,129][106225] Updated weights for policy 1, policy_version 498805 (0.0007) [2023-12-27 22:48:55,184][106226] Updated weights for policy 0, policy_version 497376 (0.0008) [2023-12-27 22:48:55,187][106225] Updated weights for policy 1, policy_version 498815 (0.0006) [2023-12-27 22:48:55,245][106225] Updated weights for policy 1, policy_version 498825 (0.0008) [2023-12-27 22:48:55,247][106226] Updated weights for policy 0, policy_version 497386 (0.0008) [2023-12-27 22:48:55,293][106226] Updated weights for policy 0, policy_version 497396 (0.0007) [2023-12-27 22:48:55,890][106225] Updated weights for policy 1, policy_version 498835 (0.0005) [2023-12-27 22:48:55,948][106225] Updated weights for policy 1, policy_version 498845 (0.0007) [2023-12-27 22:48:56,008][106226] Updated weights for policy 0, policy_version 497406 (0.0008) [2023-12-27 22:48:56,013][106225] Updated weights for policy 1, policy_version 498855 (0.0009) [2023-12-27 22:48:56,059][106226] Updated weights for policy 0, policy_version 497416 (0.0006) [2023-12-27 22:48:56,123][106226] Updated weights for policy 0, policy_version 497426 (0.0006) [2023-12-27 22:48:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 255115264. Throughput: 0: 9844.0, 1: 9786.8. Samples: 255078576. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:48:56,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.456')] [2023-12-27 22:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000498864_127737856.pth... [2023-12-27 22:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000497432_127377408.pth... [2023-12-27 22:48:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000497712_127442944.pth [2023-12-27 22:48:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000496280_127082496.pth [2023-12-27 22:48:56,717][106225] Updated weights for policy 1, policy_version 498865 (0.0008) [2023-12-27 22:48:56,763][106226] Updated weights for policy 0, policy_version 497436 (0.0007) [2023-12-27 22:48:56,765][106225] Updated weights for policy 1, policy_version 498875 (0.0007) [2023-12-27 22:48:56,809][106225] Updated weights for policy 1, policy_version 498885 (0.0006) [2023-12-27 22:48:56,817][106226] Updated weights for policy 0, policy_version 497446 (0.0008) [2023-12-27 22:48:56,855][106225] Updated weights for policy 1, policy_version 498895 (0.0007) [2023-12-27 22:48:56,876][106226] Updated weights for policy 0, policy_version 497456 (0.0008) [2023-12-27 22:48:57,481][106225] Updated weights for policy 1, policy_version 498905 (0.0006) [2023-12-27 22:48:57,526][106225] Updated weights for policy 1, policy_version 498915 (0.0005) [2023-12-27 22:48:57,574][106225] Updated weights for policy 1, policy_version 498925 (0.0006) [2023-12-27 22:48:57,643][106226] Updated weights for policy 0, policy_version 497466 (0.0006) [2023-12-27 22:48:57,690][106226] Updated weights for policy 0, policy_version 497476 (0.0008) [2023-12-27 22:48:57,737][106226] Updated weights for policy 0, policy_version 497486 (0.0008) [2023-12-27 22:48:57,785][106226] Updated weights for policy 0, policy_version 497496 (0.0008) [2023-12-27 22:48:58,266][106225] Updated weights for policy 1, policy_version 498935 (0.0008) [2023-12-27 22:48:58,319][106225] Updated weights for policy 1, policy_version 498945 (0.0008) [2023-12-27 22:48:58,387][106225] Updated weights for policy 1, policy_version 498955 (0.0008) [2023-12-27 22:48:58,562][106226] Updated weights for policy 0, policy_version 497506 (0.0008) [2023-12-27 22:48:58,625][106226] Updated weights for policy 0, policy_version 497516 (0.0008) [2023-12-27 22:48:58,687][106226] Updated weights for policy 0, policy_version 497526 (0.0009) [2023-12-27 22:48:59,180][106225] Updated weights for policy 1, policy_version 498965 (0.0008) [2023-12-27 22:48:59,244][106225] Updated weights for policy 1, policy_version 498975 (0.0008) [2023-12-27 22:48:59,307][106225] Updated weights for policy 1, policy_version 498985 (0.0009) [2023-12-27 22:48:59,447][106226] Updated weights for policy 0, policy_version 497536 (0.0008) [2023-12-27 22:48:59,508][106226] Updated weights for policy 0, policy_version 497546 (0.0008) [2023-12-27 22:48:59,566][106226] Updated weights for policy 0, policy_version 497556 (0.0008) [2023-12-27 22:49:00,103][106225] Updated weights for policy 1, policy_version 498995 (0.0008) [2023-12-27 22:49:00,163][106225] Updated weights for policy 1, policy_version 499005 (0.0008) [2023-12-27 22:49:00,223][106226] Updated weights for policy 0, policy_version 497566 (0.0008) [2023-12-27 22:49:00,225][106225] Updated weights for policy 1, policy_version 499015 (0.0009) [2023-12-27 22:49:00,278][106226] Updated weights for policy 0, policy_version 497576 (0.0006) [2023-12-27 22:49:00,342][106226] Updated weights for policy 0, policy_version 497586 (0.0008) [2023-12-27 22:49:00,937][106226] Updated weights for policy 0, policy_version 497596 (0.0008) [2023-12-27 22:49:00,976][106225] Updated weights for policy 1, policy_version 499025 (0.0006) [2023-12-27 22:49:00,994][106226] Updated weights for policy 0, policy_version 497606 (0.0008) [2023-12-27 22:49:01,040][106225] Updated weights for policy 1, policy_version 499035 (0.0008) [2023-12-27 22:49:01,054][106226] Updated weights for policy 0, policy_version 497616 (0.0008) [2023-12-27 22:49:01,109][106225] Updated weights for policy 1, policy_version 499045 (0.0009) [2023-12-27 22:49:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 255205376. Throughput: 0: 9841.1, 1: 9842.5. Samples: 255195772. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:01,175][105115] Avg episode reward: [(0, '-4.931'), (1, '-5.509')] [2023-12-27 22:49:01,182][106225] Updated weights for policy 1, policy_version 499055 (0.0009) [2023-12-27 22:49:01,768][106226] Updated weights for policy 0, policy_version 497626 (0.0007) [2023-12-27 22:49:01,825][106226] Updated weights for policy 0, policy_version 497636 (0.0009) [2023-12-27 22:49:01,883][106226] Updated weights for policy 0, policy_version 497646 (0.0008) [2023-12-27 22:49:01,932][106225] Updated weights for policy 1, policy_version 499065 (0.0008) [2023-12-27 22:49:01,946][106226] Updated weights for policy 0, policy_version 497656 (0.0007) [2023-12-27 22:49:01,991][106225] Updated weights for policy 1, policy_version 499075 (0.0005) [2023-12-27 22:49:02,044][106225] Updated weights for policy 1, policy_version 499085 (0.0005) [2023-12-27 22:49:02,691][106226] Updated weights for policy 0, policy_version 497666 (0.0005) [2023-12-27 22:49:02,748][106225] Updated weights for policy 1, policy_version 499095 (0.0006) [2023-12-27 22:49:02,751][106226] Updated weights for policy 0, policy_version 497676 (0.0008) [2023-12-27 22:49:02,806][106226] Updated weights for policy 0, policy_version 497686 (0.0007) [2023-12-27 22:49:02,816][106225] Updated weights for policy 1, policy_version 499105 (0.0005) [2023-12-27 22:49:02,877][106225] Updated weights for policy 1, policy_version 499115 (0.0007) [2023-12-27 22:49:03,362][106226] Updated weights for policy 0, policy_version 497696 (0.0007) [2023-12-27 22:49:03,413][106226] Updated weights for policy 0, policy_version 497706 (0.0008) [2023-12-27 22:49:03,473][106226] Updated weights for policy 0, policy_version 497716 (0.0008) [2023-12-27 22:49:03,624][106225] Updated weights for policy 1, policy_version 499125 (0.0008) [2023-12-27 22:49:03,672][106225] Updated weights for policy 1, policy_version 499135 (0.0008) [2023-12-27 22:49:03,727][106225] Updated weights for policy 1, policy_version 499145 (0.0008) [2023-12-27 22:49:04,240][106226] Updated weights for policy 0, policy_version 497726 (0.0009) [2023-12-27 22:49:04,305][106226] Updated weights for policy 0, policy_version 497736 (0.0008) [2023-12-27 22:49:04,369][106226] Updated weights for policy 0, policy_version 497746 (0.0008) [2023-12-27 22:49:04,460][106225] Updated weights for policy 1, policy_version 499155 (0.0008) [2023-12-27 22:49:04,525][106225] Updated weights for policy 1, policy_version 499165 (0.0008) [2023-12-27 22:49:04,593][106225] Updated weights for policy 1, policy_version 499175 (0.0009) [2023-12-27 22:49:04,996][106226] Updated weights for policy 0, policy_version 497756 (0.0009) [2023-12-27 22:49:05,053][106226] Updated weights for policy 0, policy_version 497766 (0.0009) [2023-12-27 22:49:05,125][106226] Updated weights for policy 0, policy_version 497776 (0.0009) [2023-12-27 22:49:05,180][106225] Updated weights for policy 1, policy_version 499185 (0.0009) [2023-12-27 22:49:05,245][106225] Updated weights for policy 1, policy_version 499195 (0.0008) [2023-12-27 22:49:05,294][106225] Updated weights for policy 1, policy_version 499205 (0.0008) [2023-12-27 22:49:05,344][106225] Updated weights for policy 1, policy_version 499216 (0.0009) [2023-12-27 22:49:05,796][106226] Updated weights for policy 0, policy_version 497786 (0.0009) [2023-12-27 22:49:05,847][106226] Updated weights for policy 0, policy_version 497796 (0.0010) [2023-12-27 22:49:05,904][106226] Updated weights for policy 0, policy_version 497806 (0.0010) [2023-12-27 22:49:05,925][106225] Updated weights for policy 1, policy_version 499226 (0.0005) [2023-12-27 22:49:05,957][106226] Updated weights for policy 0, policy_version 497816 (0.0010) [2023-12-27 22:49:05,977][106225] Updated weights for policy 1, policy_version 499236 (0.0008) [2023-12-27 22:49:06,022][106225] Updated weights for policy 1, policy_version 499246 (0.0007) [2023-12-27 22:49:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 255311872. Throughput: 0: 9848.6, 1: 9865.5. Samples: 255315948. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:06,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.671')] [2023-12-27 22:49:06,741][106226] Updated weights for policy 0, policy_version 497826 (0.0009) [2023-12-27 22:49:06,774][106225] Updated weights for policy 1, policy_version 499256 (0.0006) [2023-12-27 22:49:06,813][106226] Updated weights for policy 0, policy_version 497836 (0.0008) [2023-12-27 22:49:06,839][106225] Updated weights for policy 1, policy_version 499266 (0.0006) [2023-12-27 22:49:06,874][106226] Updated weights for policy 0, policy_version 497846 (0.0009) [2023-12-27 22:49:06,901][106225] Updated weights for policy 1, policy_version 499276 (0.0008) [2023-12-27 22:49:07,586][106226] Updated weights for policy 0, policy_version 497856 (0.0008) [2023-12-27 22:49:07,588][106225] Updated weights for policy 1, policy_version 499286 (0.0007) [2023-12-27 22:49:07,634][106226] Updated weights for policy 0, policy_version 497866 (0.0006) [2023-12-27 22:49:07,647][106225] Updated weights for policy 1, policy_version 499296 (0.0008) [2023-12-27 22:49:07,684][106226] Updated weights for policy 0, policy_version 497876 (0.0009) [2023-12-27 22:49:07,706][106225] Updated weights for policy 1, policy_version 499306 (0.0008) [2023-12-27 22:49:08,409][106226] Updated weights for policy 0, policy_version 497886 (0.0009) [2023-12-27 22:49:08,426][106225] Updated weights for policy 1, policy_version 499316 (0.0007) [2023-12-27 22:49:08,471][106226] Updated weights for policy 0, policy_version 497896 (0.0011) [2023-12-27 22:49:08,484][106225] Updated weights for policy 1, policy_version 499326 (0.0006) [2023-12-27 22:49:08,536][106226] Updated weights for policy 0, policy_version 497906 (0.0011) [2023-12-27 22:49:08,546][106225] Updated weights for policy 1, policy_version 499336 (0.0005) [2023-12-27 22:49:09,196][106226] Updated weights for policy 0, policy_version 497916 (0.0008) [2023-12-27 22:49:09,269][106226] Updated weights for policy 0, policy_version 497926 (0.0010) [2023-12-27 22:49:09,309][106225] Updated weights for policy 1, policy_version 499346 (0.0006) [2023-12-27 22:49:09,337][106226] Updated weights for policy 0, policy_version 497936 (0.0011) [2023-12-27 22:49:09,377][106225] Updated weights for policy 1, policy_version 499356 (0.0007) [2023-12-27 22:49:09,440][106225] Updated weights for policy 1, policy_version 499366 (0.0009) [2023-12-27 22:49:09,493][106225] Updated weights for policy 1, policy_version 499376 (0.0008) [2023-12-27 22:49:09,986][106226] Updated weights for policy 0, policy_version 497946 (0.0011) [2023-12-27 22:49:10,055][106226] Updated weights for policy 0, policy_version 497956 (0.0008) [2023-12-27 22:49:10,122][106226] Updated weights for policy 0, policy_version 497966 (0.0006) [2023-12-27 22:49:10,188][106226] Updated weights for policy 0, policy_version 497976 (0.0006) [2023-12-27 22:49:10,307][106225] Updated weights for policy 1, policy_version 499386 (0.0008) [2023-12-27 22:49:10,373][106225] Updated weights for policy 1, policy_version 499396 (0.0008) [2023-12-27 22:49:10,443][106225] Updated weights for policy 1, policy_version 499406 (0.0008) [2023-12-27 22:49:10,741][106226] Updated weights for policy 0, policy_version 497986 (0.0008) [2023-12-27 22:49:10,791][106226] Updated weights for policy 0, policy_version 497996 (0.0007) [2023-12-27 22:49:10,844][106226] Updated weights for policy 0, policy_version 498006 (0.0008) [2023-12-27 22:49:11,144][106225] Updated weights for policy 1, policy_version 499416 (0.0007) [2023-12-27 22:49:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 255401984. Throughput: 0: 9837.2, 1: 9893.9. Samples: 255374320. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:11,175][105115] Avg episode reward: [(0, '-5.091'), (1, '-5.593')] [2023-12-27 22:49:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000498008_127524864.pth... [2023-12-27 22:49:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000496856_127229952.pth [2023-12-27 22:49:11,214][106225] Updated weights for policy 1, policy_version 499426 (0.0009) [2023-12-27 22:49:11,281][106225] Updated weights for policy 1, policy_version 499436 (0.0009) [2023-12-27 22:49:11,309][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000499440_127885312.pth... [2023-12-27 22:49:11,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000498288_127590400.pth [2023-12-27 22:49:11,653][106226] Updated weights for policy 0, policy_version 498016 (0.0009) [2023-12-27 22:49:11,724][106226] Updated weights for policy 0, policy_version 498026 (0.0009) [2023-12-27 22:49:11,789][106226] Updated weights for policy 0, policy_version 498036 (0.0007) [2023-12-27 22:49:12,042][106225] Updated weights for policy 1, policy_version 499446 (0.0007) [2023-12-27 22:49:12,109][106225] Updated weights for policy 1, policy_version 499456 (0.0007) [2023-12-27 22:49:12,174][106225] Updated weights for policy 1, policy_version 499466 (0.0008) [2023-12-27 22:49:12,486][106226] Updated weights for policy 0, policy_version 498046 (0.0007) [2023-12-27 22:49:12,547][106226] Updated weights for policy 0, policy_version 498056 (0.0006) [2023-12-27 22:49:12,608][106226] Updated weights for policy 0, policy_version 498066 (0.0006) [2023-12-27 22:49:12,869][106225] Updated weights for policy 1, policy_version 499476 (0.0008) [2023-12-27 22:49:12,922][106225] Updated weights for policy 1, policy_version 499486 (0.0009) [2023-12-27 22:49:12,979][106225] Updated weights for policy 1, policy_version 499496 (0.0007) [2023-12-27 22:49:13,238][106226] Updated weights for policy 0, policy_version 498076 (0.0008) [2023-12-27 22:49:13,293][106226] Updated weights for policy 0, policy_version 498086 (0.0008) [2023-12-27 22:49:13,346][106226] Updated weights for policy 0, policy_version 498096 (0.0007) [2023-12-27 22:49:13,746][106225] Updated weights for policy 1, policy_version 499506 (0.0008) [2023-12-27 22:49:13,807][106225] Updated weights for policy 1, policy_version 499516 (0.0008) [2023-12-27 22:49:13,867][106225] Updated weights for policy 1, policy_version 499526 (0.0009) [2023-12-27 22:49:13,922][106225] Updated weights for policy 1, policy_version 499536 (0.0008) [2023-12-27 22:49:13,937][106226] Updated weights for policy 0, policy_version 498106 (0.0006) [2023-12-27 22:49:14,014][106226] Updated weights for policy 0, policy_version 498116 (0.0009) [2023-12-27 22:49:14,072][106226] Updated weights for policy 0, policy_version 498126 (0.0008) [2023-12-27 22:49:14,130][106226] Updated weights for policy 0, policy_version 498136 (0.0006) [2023-12-27 22:49:14,618][106225] Updated weights for policy 1, policy_version 499546 (0.0009) [2023-12-27 22:49:14,671][106225] Updated weights for policy 1, policy_version 499556 (0.0008) [2023-12-27 22:49:14,720][106225] Updated weights for policy 1, policy_version 499566 (0.0008) [2023-12-27 22:49:14,830][106226] Updated weights for policy 0, policy_version 498146 (0.0008) [2023-12-27 22:49:14,887][106226] Updated weights for policy 0, policy_version 498156 (0.0008) [2023-12-27 22:49:14,942][106226] Updated weights for policy 0, policy_version 498166 (0.0008) [2023-12-27 22:49:15,466][106225] Updated weights for policy 1, policy_version 499576 (0.0008) [2023-12-27 22:49:15,532][106225] Updated weights for policy 1, policy_version 499586 (0.0009) [2023-12-27 22:49:15,595][106225] Updated weights for policy 1, policy_version 499596 (0.0009) [2023-12-27 22:49:15,715][106226] Updated weights for policy 0, policy_version 498176 (0.0008) [2023-12-27 22:49:15,772][106226] Updated weights for policy 0, policy_version 498186 (0.0008) [2023-12-27 22:49:15,829][106226] Updated weights for policy 0, policy_version 498196 (0.0008) [2023-12-27 22:49:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 255500288. Throughput: 0: 9828.2, 1: 9818.6. Samples: 255491344. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:16,175][105115] Avg episode reward: [(0, '-4.898'), (1, '-5.453')] [2023-12-27 22:49:16,276][106225] Updated weights for policy 1, policy_version 499606 (0.0008) [2023-12-27 22:49:16,334][106225] Updated weights for policy 1, policy_version 499616 (0.0008) [2023-12-27 22:49:16,387][106225] Updated weights for policy 1, policy_version 499626 (0.0009) [2023-12-27 22:49:16,557][106226] Updated weights for policy 0, policy_version 498206 (0.0009) [2023-12-27 22:49:16,603][106226] Updated weights for policy 0, policy_version 498216 (0.0007) [2023-12-27 22:49:16,652][106226] Updated weights for policy 0, policy_version 498226 (0.0008) [2023-12-27 22:49:17,095][106225] Updated weights for policy 1, policy_version 499636 (0.0010) [2023-12-27 22:49:17,144][106225] Updated weights for policy 1, policy_version 499646 (0.0009) [2023-12-27 22:49:17,189][106225] Updated weights for policy 1, policy_version 499656 (0.0005) [2023-12-27 22:49:17,411][106226] Updated weights for policy 0, policy_version 498236 (0.0008) [2023-12-27 22:49:17,465][106226] Updated weights for policy 0, policy_version 498246 (0.0009) [2023-12-27 22:49:17,522][106226] Updated weights for policy 0, policy_version 498256 (0.0010) [2023-12-27 22:49:17,750][106225] Updated weights for policy 1, policy_version 499666 (0.0006) [2023-12-27 22:49:17,811][106225] Updated weights for policy 1, policy_version 499676 (0.0010) [2023-12-27 22:49:17,858][106225] Updated weights for policy 1, policy_version 499686 (0.0010) [2023-12-27 22:49:17,914][106225] Updated weights for policy 1, policy_version 499696 (0.0009) [2023-12-27 22:49:18,295][106226] Updated weights for policy 0, policy_version 498266 (0.0007) [2023-12-27 22:49:18,361][106226] Updated weights for policy 0, policy_version 498276 (0.0008) [2023-12-27 22:49:18,427][106226] Updated weights for policy 0, policy_version 498286 (0.0008) [2023-12-27 22:49:18,491][106226] Updated weights for policy 0, policy_version 498296 (0.0008) [2023-12-27 22:49:18,688][106225] Updated weights for policy 1, policy_version 499706 (0.0011) [2023-12-27 22:49:18,753][106225] Updated weights for policy 1, policy_version 499716 (0.0010) [2023-12-27 22:49:18,817][106225] Updated weights for policy 1, policy_version 499726 (0.0010) [2023-12-27 22:49:19,184][106226] Updated weights for policy 0, policy_version 498306 (0.0009) [2023-12-27 22:49:19,251][106226] Updated weights for policy 0, policy_version 498316 (0.0009) [2023-12-27 22:49:19,317][106226] Updated weights for policy 0, policy_version 498326 (0.0007) [2023-12-27 22:49:19,463][106225] Updated weights for policy 1, policy_version 499736 (0.0010) [2023-12-27 22:49:19,537][106225] Updated weights for policy 1, policy_version 499746 (0.0007) [2023-12-27 22:49:19,597][106225] Updated weights for policy 1, policy_version 499756 (0.0007) [2023-12-27 22:49:20,153][106226] Updated weights for policy 0, policy_version 498336 (0.0009) [2023-12-27 22:49:20,211][106226] Updated weights for policy 0, policy_version 498346 (0.0008) [2023-12-27 22:49:20,279][106226] Updated weights for policy 0, policy_version 498356 (0.0009) [2023-12-27 22:49:20,317][106225] Updated weights for policy 1, policy_version 499766 (0.0007) [2023-12-27 22:49:20,372][106225] Updated weights for policy 1, policy_version 499776 (0.0009) [2023-12-27 22:49:20,434][106225] Updated weights for policy 1, policy_version 499786 (0.0008) [2023-12-27 22:49:21,023][106226] Updated weights for policy 0, policy_version 498366 (0.0007) [2023-12-27 22:49:21,097][106226] Updated weights for policy 0, policy_version 498376 (0.0009) [2023-12-27 22:49:21,165][106225] Updated weights for policy 1, policy_version 499796 (0.0009) [2023-12-27 22:49:21,171][106226] Updated weights for policy 0, policy_version 498386 (0.0009) [2023-12-27 22:49:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 255590400. Throughput: 0: 9725.1, 1: 9789.6. Samples: 255606604. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:21,175][105115] Avg episode reward: [(0, '-5.002'), (1, '-5.664')] [2023-12-27 22:49:21,227][106225] Updated weights for policy 1, policy_version 499806 (0.0006) [2023-12-27 22:49:21,301][106225] Updated weights for policy 1, policy_version 499816 (0.0009) [2023-12-27 22:49:21,904][106226] Updated weights for policy 0, policy_version 498396 (0.0008) [2023-12-27 22:49:21,971][106226] Updated weights for policy 0, policy_version 498406 (0.0006) [2023-12-27 22:49:22,004][106225] Updated weights for policy 1, policy_version 499826 (0.0010) [2023-12-27 22:49:22,032][106226] Updated weights for policy 0, policy_version 498416 (0.0008) [2023-12-27 22:49:22,070][106225] Updated weights for policy 1, policy_version 499836 (0.0007) [2023-12-27 22:49:22,127][106225] Updated weights for policy 1, policy_version 499846 (0.0007) [2023-12-27 22:49:22,188][106225] Updated weights for policy 1, policy_version 499856 (0.0008) [2023-12-27 22:49:22,770][106226] Updated weights for policy 0, policy_version 498426 (0.0008) [2023-12-27 22:49:22,828][106226] Updated weights for policy 0, policy_version 498436 (0.0008) [2023-12-27 22:49:22,883][106226] Updated weights for policy 0, policy_version 498446 (0.0007) [2023-12-27 22:49:22,908][106225] Updated weights for policy 1, policy_version 499866 (0.0007) [2023-12-27 22:49:22,946][106226] Updated weights for policy 0, policy_version 498456 (0.0007) [2023-12-27 22:49:22,958][106225] Updated weights for policy 1, policy_version 499876 (0.0008) [2023-12-27 22:49:23,011][106225] Updated weights for policy 1, policy_version 499886 (0.0008) [2023-12-27 22:49:23,625][106226] Updated weights for policy 0, policy_version 498466 (0.0010) [2023-12-27 22:49:23,688][106226] Updated weights for policy 0, policy_version 498476 (0.0011) [2023-12-27 22:49:23,746][106226] Updated weights for policy 0, policy_version 498486 (0.0005) [2023-12-27 22:49:23,763][106225] Updated weights for policy 1, policy_version 499896 (0.0010) [2023-12-27 22:49:23,826][106225] Updated weights for policy 1, policy_version 499906 (0.0010) [2023-12-27 22:49:23,898][106225] Updated weights for policy 1, policy_version 499916 (0.0010) [2023-12-27 22:49:24,341][106226] Updated weights for policy 0, policy_version 498496 (0.0005) [2023-12-27 22:49:24,402][106226] Updated weights for policy 0, policy_version 498506 (0.0005) [2023-12-27 22:49:24,464][106226] Updated weights for policy 0, policy_version 498516 (0.0007) [2023-12-27 22:49:24,611][106225] Updated weights for policy 1, policy_version 499926 (0.0009) [2023-12-27 22:49:24,661][106225] Updated weights for policy 1, policy_version 499936 (0.0007) [2023-12-27 22:49:24,711][106225] Updated weights for policy 1, policy_version 499946 (0.0007) [2023-12-27 22:49:25,121][106226] Updated weights for policy 0, policy_version 498526 (0.0010) [2023-12-27 22:49:25,170][106226] Updated weights for policy 0, policy_version 498536 (0.0010) [2023-12-27 22:49:25,229][106226] Updated weights for policy 0, policy_version 498546 (0.0010) [2023-12-27 22:49:25,468][106225] Updated weights for policy 1, policy_version 499956 (0.0007) [2023-12-27 22:49:25,523][106225] Updated weights for policy 1, policy_version 499966 (0.0008) [2023-12-27 22:49:25,571][106225] Updated weights for policy 1, policy_version 499976 (0.0008) [2023-12-27 22:49:25,882][106226] Updated weights for policy 0, policy_version 498556 (0.0008) [2023-12-27 22:49:25,942][106226] Updated weights for policy 0, policy_version 498566 (0.0006) [2023-12-27 22:49:26,007][106226] Updated weights for policy 0, policy_version 498576 (0.0007) [2023-12-27 22:49:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 255696896. Throughput: 0: 9730.6, 1: 9773.8. Samples: 255665380. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:26,176][105115] Avg episode reward: [(0, '-5.202'), (1, '-5.552')] [2023-12-27 22:49:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000499984_128024576.pth... [2023-12-27 22:49:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000498584_127672320.pth... [2023-12-27 22:49:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000498864_127737856.pth [2023-12-27 22:49:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000497432_127377408.pth [2023-12-27 22:49:26,348][106225] Updated weights for policy 1, policy_version 499986 (0.0008) [2023-12-27 22:49:26,398][106225] Updated weights for policy 1, policy_version 499996 (0.0009) [2023-12-27 22:49:26,448][106225] Updated weights for policy 1, policy_version 500006 (0.0009) [2023-12-27 22:49:26,496][106225] Updated weights for policy 1, policy_version 500016 (0.0007) [2023-12-27 22:49:26,539][106226] Updated weights for policy 0, policy_version 498586 (0.0009) [2023-12-27 22:49:26,591][106226] Updated weights for policy 0, policy_version 498596 (0.0010) [2023-12-27 22:49:26,645][106226] Updated weights for policy 0, policy_version 498606 (0.0010) [2023-12-27 22:49:26,704][106226] Updated weights for policy 0, policy_version 498616 (0.0010) [2023-12-27 22:49:27,219][106225] Updated weights for policy 1, policy_version 500026 (0.0008) [2023-12-27 22:49:27,280][106225] Updated weights for policy 1, policy_version 500036 (0.0010) [2023-12-27 22:49:27,329][106225] Updated weights for policy 1, policy_version 500046 (0.0007) [2023-12-27 22:49:27,373][106226] Updated weights for policy 0, policy_version 498626 (0.0007) [2023-12-27 22:49:27,439][106226] Updated weights for policy 0, policy_version 498636 (0.0005) [2023-12-27 22:49:27,502][106226] Updated weights for policy 0, policy_version 498646 (0.0005) [2023-12-27 22:49:28,056][106225] Updated weights for policy 1, policy_version 500056 (0.0007) [2023-12-27 22:49:28,108][106225] Updated weights for policy 1, policy_version 500066 (0.0007) [2023-12-27 22:49:28,134][106226] Updated weights for policy 0, policy_version 498656 (0.0006) [2023-12-27 22:49:28,159][106225] Updated weights for policy 1, policy_version 500076 (0.0006) [2023-12-27 22:49:28,188][106226] Updated weights for policy 0, policy_version 498666 (0.0006) [2023-12-27 22:49:28,250][106226] Updated weights for policy 0, policy_version 498676 (0.0005) [2023-12-27 22:49:28,911][106226] Updated weights for policy 0, policy_version 498686 (0.0005) [2023-12-27 22:49:28,967][106226] Updated weights for policy 0, policy_version 498696 (0.0005) [2023-12-27 22:49:28,982][106225] Updated weights for policy 1, policy_version 500086 (0.0008) [2023-12-27 22:49:29,029][106226] Updated weights for policy 0, policy_version 498706 (0.0005) [2023-12-27 22:49:29,040][106225] Updated weights for policy 1, policy_version 500096 (0.0008) [2023-12-27 22:49:29,095][106225] Updated weights for policy 1, policy_version 500106 (0.0008) [2023-12-27 22:49:29,702][106226] Updated weights for policy 0, policy_version 498716 (0.0007) [2023-12-27 22:49:29,769][106226] Updated weights for policy 0, policy_version 498726 (0.0008) [2023-12-27 22:49:29,832][106226] Updated weights for policy 0, policy_version 498736 (0.0008) [2023-12-27 22:49:29,868][106225] Updated weights for policy 1, policy_version 500116 (0.0009) [2023-12-27 22:49:29,924][106225] Updated weights for policy 1, policy_version 500126 (0.0010) [2023-12-27 22:49:29,987][106225] Updated weights for policy 1, policy_version 500136 (0.0010) [2023-12-27 22:49:30,580][106226] Updated weights for policy 0, policy_version 498746 (0.0008) [2023-12-27 22:49:30,635][106226] Updated weights for policy 0, policy_version 498756 (0.0008) [2023-12-27 22:49:30,670][106225] Updated weights for policy 1, policy_version 500146 (0.0009) [2023-12-27 22:49:30,695][106226] Updated weights for policy 0, policy_version 498766 (0.0006) [2023-12-27 22:49:30,723][106225] Updated weights for policy 1, policy_version 500156 (0.0009) [2023-12-27 22:49:30,759][106226] Updated weights for policy 0, policy_version 498776 (0.0008) [2023-12-27 22:49:30,781][106225] Updated weights for policy 1, policy_version 500166 (0.0010) [2023-12-27 22:49:30,839][106225] Updated weights for policy 1, policy_version 500176 (0.0010) [2023-12-27 22:49:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 255795200. Throughput: 0: 9869.9, 1: 9747.6. Samples: 255784916. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:31,175][105115] Avg episode reward: [(0, '-5.150'), (1, '-5.819')] [2023-12-27 22:49:31,498][106225] Updated weights for policy 1, policy_version 500186 (0.0009) [2023-12-27 22:49:31,515][106226] Updated weights for policy 0, policy_version 498786 (0.0008) [2023-12-27 22:49:31,549][106225] Updated weights for policy 1, policy_version 500196 (0.0008) [2023-12-27 22:49:31,574][106226] Updated weights for policy 0, policy_version 498796 (0.0008) [2023-12-27 22:49:31,606][106225] Updated weights for policy 1, policy_version 500206 (0.0009) [2023-12-27 22:49:31,633][106226] Updated weights for policy 0, policy_version 498806 (0.0008) [2023-12-27 22:49:32,331][106226] Updated weights for policy 0, policy_version 498816 (0.0006) [2023-12-27 22:49:32,384][106225] Updated weights for policy 1, policy_version 500216 (0.0012) [2023-12-27 22:49:32,395][106226] Updated weights for policy 0, policy_version 498826 (0.0007) [2023-12-27 22:49:32,445][106225] Updated weights for policy 1, policy_version 500226 (0.0008) [2023-12-27 22:49:32,449][106226] Updated weights for policy 0, policy_version 498836 (0.0009) [2023-12-27 22:49:32,502][106225] Updated weights for policy 1, policy_version 500236 (0.0007) [2023-12-27 22:49:33,062][106226] Updated weights for policy 0, policy_version 498846 (0.0007) [2023-12-27 22:49:33,122][106226] Updated weights for policy 0, policy_version 498856 (0.0007) [2023-12-27 22:49:33,191][106226] Updated weights for policy 0, policy_version 498866 (0.0006) [2023-12-27 22:49:33,208][106225] Updated weights for policy 1, policy_version 500246 (0.0009) [2023-12-27 22:49:33,258][106225] Updated weights for policy 1, policy_version 500256 (0.0010) [2023-12-27 22:49:33,308][106225] Updated weights for policy 1, policy_version 500266 (0.0010) [2023-12-27 22:49:33,874][106226] Updated weights for policy 0, policy_version 498876 (0.0008) [2023-12-27 22:49:33,946][106226] Updated weights for policy 0, policy_version 498886 (0.0011) [2023-12-27 22:49:33,957][106225] Updated weights for policy 1, policy_version 500276 (0.0007) [2023-12-27 22:49:34,006][106226] Updated weights for policy 0, policy_version 498896 (0.0011) [2023-12-27 22:49:34,018][106225] Updated weights for policy 1, policy_version 500286 (0.0010) [2023-12-27 22:49:34,068][106225] Updated weights for policy 1, policy_version 500296 (0.0010) [2023-12-27 22:49:34,654][106226] Updated weights for policy 0, policy_version 498906 (0.0010) [2023-12-27 22:49:34,720][106226] Updated weights for policy 0, policy_version 498916 (0.0011) [2023-12-27 22:49:34,761][106225] Updated weights for policy 1, policy_version 500306 (0.0010) [2023-12-27 22:49:34,780][106226] Updated weights for policy 0, policy_version 498926 (0.0011) [2023-12-27 22:49:34,814][106225] Updated weights for policy 1, policy_version 500316 (0.0010) [2023-12-27 22:49:34,835][106226] Updated weights for policy 0, policy_version 498936 (0.0008) [2023-12-27 22:49:34,874][106225] Updated weights for policy 1, policy_version 500326 (0.0010) [2023-12-27 22:49:34,930][106225] Updated weights for policy 1, policy_version 500336 (0.0010) [2023-12-27 22:49:35,498][106226] Updated weights for policy 0, policy_version 498946 (0.0010) [2023-12-27 22:49:35,544][106226] Updated weights for policy 0, policy_version 498956 (0.0010) [2023-12-27 22:49:35,586][106226] Updated weights for policy 0, policy_version 498966 (0.0010) [2023-12-27 22:49:35,648][106225] Updated weights for policy 1, policy_version 500346 (0.0010) [2023-12-27 22:49:35,696][106225] Updated weights for policy 1, policy_version 500356 (0.0010) [2023-12-27 22:49:35,768][106225] Updated weights for policy 1, policy_version 500366 (0.0007) [2023-12-27 22:49:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 255893504. Throughput: 0: 9954.3, 1: 9703.2. Samples: 255904704. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:36,175][105115] Avg episode reward: [(0, '-5.227'), (1, '-5.285')] [2023-12-27 22:49:36,334][106226] Updated weights for policy 0, policy_version 498976 (0.0008) [2023-12-27 22:49:36,372][106225] Updated weights for policy 1, policy_version 500376 (0.0007) [2023-12-27 22:49:36,402][106226] Updated weights for policy 0, policy_version 498986 (0.0007) [2023-12-27 22:49:36,433][106225] Updated weights for policy 1, policy_version 500386 (0.0006) [2023-12-27 22:49:36,467][106226] Updated weights for policy 0, policy_version 498996 (0.0007) [2023-12-27 22:49:36,494][106225] Updated weights for policy 1, policy_version 500396 (0.0006) [2023-12-27 22:49:37,187][106226] Updated weights for policy 0, policy_version 499006 (0.0008) [2023-12-27 22:49:37,209][106225] Updated weights for policy 1, policy_version 500406 (0.0008) [2023-12-27 22:49:37,248][106226] Updated weights for policy 0, policy_version 499016 (0.0006) [2023-12-27 22:49:37,272][106225] Updated weights for policy 1, policy_version 500416 (0.0008) [2023-12-27 22:49:37,306][106226] Updated weights for policy 0, policy_version 499026 (0.0007) [2023-12-27 22:49:37,328][106225] Updated weights for policy 1, policy_version 500426 (0.0006) [2023-12-27 22:49:37,937][106226] Updated weights for policy 0, policy_version 499036 (0.0008) [2023-12-27 22:49:37,997][106226] Updated weights for policy 0, policy_version 499046 (0.0008) [2023-12-27 22:49:38,044][106225] Updated weights for policy 1, policy_version 500436 (0.0007) [2023-12-27 22:49:38,049][106226] Updated weights for policy 0, policy_version 499056 (0.0008) [2023-12-27 22:49:38,104][106225] Updated weights for policy 1, policy_version 500446 (0.0007) [2023-12-27 22:49:38,163][106225] Updated weights for policy 1, policy_version 500456 (0.0009) [2023-12-27 22:49:38,779][106226] Updated weights for policy 0, policy_version 499066 (0.0008) [2023-12-27 22:49:38,841][106226] Updated weights for policy 0, policy_version 499076 (0.0005) [2023-12-27 22:49:38,888][106225] Updated weights for policy 1, policy_version 500466 (0.0009) [2023-12-27 22:49:38,903][106226] Updated weights for policy 0, policy_version 499086 (0.0007) [2023-12-27 22:49:38,948][106225] Updated weights for policy 1, policy_version 500476 (0.0008) [2023-12-27 22:49:38,951][106226] Updated weights for policy 0, policy_version 499096 (0.0006) [2023-12-27 22:49:39,006][106225] Updated weights for policy 1, policy_version 500486 (0.0009) [2023-12-27 22:49:39,061][106225] Updated weights for policy 1, policy_version 500496 (0.0008) [2023-12-27 22:49:39,674][106226] Updated weights for policy 0, policy_version 499106 (0.0010) [2023-12-27 22:49:39,740][106226] Updated weights for policy 0, policy_version 499116 (0.0011) [2023-12-27 22:49:39,800][106225] Updated weights for policy 1, policy_version 500506 (0.0009) [2023-12-27 22:49:39,801][106226] Updated weights for policy 0, policy_version 499126 (0.0008) [2023-12-27 22:49:39,864][106225] Updated weights for policy 1, policy_version 500516 (0.0007) [2023-12-27 22:49:39,951][106225] Updated weights for policy 1, policy_version 500526 (0.0008) [2023-12-27 22:49:40,559][106226] Updated weights for policy 0, policy_version 499136 (0.0007) [2023-12-27 22:49:40,615][106226] Updated weights for policy 0, policy_version 499146 (0.0005) [2023-12-27 22:49:40,679][106226] Updated weights for policy 0, policy_version 499156 (0.0005) [2023-12-27 22:49:40,685][106225] Updated weights for policy 1, policy_version 500536 (0.0008) [2023-12-27 22:49:40,742][106225] Updated weights for policy 1, policy_version 500546 (0.0009) [2023-12-27 22:49:40,808][106225] Updated weights for policy 1, policy_version 500556 (0.0008) [2023-12-27 22:49:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 255991808. Throughput: 0: 9966.8, 1: 9729.3. Samples: 255964900. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:41,175][105115] Avg episode reward: [(0, '-5.152'), (1, '-5.902')] [2023-12-27 22:49:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000500560_128172032.pth... [2023-12-27 22:49:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000499160_127819776.pth... [2023-12-27 22:49:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000498008_127524864.pth [2023-12-27 22:49:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000499440_127885312.pth [2023-12-27 22:49:41,304][106226] Updated weights for policy 0, policy_version 499166 (0.0007) [2023-12-27 22:49:41,379][106226] Updated weights for policy 0, policy_version 499176 (0.0009) [2023-12-27 22:49:41,438][106226] Updated weights for policy 0, policy_version 499186 (0.0008) [2023-12-27 22:49:41,600][106225] Updated weights for policy 1, policy_version 500566 (0.0007) [2023-12-27 22:49:41,673][106225] Updated weights for policy 1, policy_version 500576 (0.0008) [2023-12-27 22:49:41,742][106225] Updated weights for policy 1, policy_version 500586 (0.0009) [2023-12-27 22:49:42,136][106226] Updated weights for policy 0, policy_version 499196 (0.0009) [2023-12-27 22:49:42,196][106226] Updated weights for policy 0, policy_version 499206 (0.0006) [2023-12-27 22:49:42,263][106226] Updated weights for policy 0, policy_version 499216 (0.0007) [2023-12-27 22:49:42,539][106225] Updated weights for policy 1, policy_version 500596 (0.0010) [2023-12-27 22:49:42,598][106225] Updated weights for policy 1, policy_version 500606 (0.0008) [2023-12-27 22:49:42,657][106225] Updated weights for policy 1, policy_version 500616 (0.0008) [2023-12-27 22:49:42,966][106226] Updated weights for policy 0, policy_version 499226 (0.0008) [2023-12-27 22:49:43,028][106226] Updated weights for policy 0, policy_version 499236 (0.0009) [2023-12-27 22:49:43,084][106226] Updated weights for policy 0, policy_version 499246 (0.0008) [2023-12-27 22:49:43,139][106226] Updated weights for policy 0, policy_version 499256 (0.0008) [2023-12-27 22:49:43,415][106225] Updated weights for policy 1, policy_version 500626 (0.0008) [2023-12-27 22:49:43,477][106225] Updated weights for policy 1, policy_version 500636 (0.0009) [2023-12-27 22:49:43,540][106225] Updated weights for policy 1, policy_version 500646 (0.0009) [2023-12-27 22:49:43,602][106225] Updated weights for policy 1, policy_version 500656 (0.0010) [2023-12-27 22:49:43,718][106226] Updated weights for policy 0, policy_version 499266 (0.0005) [2023-12-27 22:49:43,777][106226] Updated weights for policy 0, policy_version 499276 (0.0007) [2023-12-27 22:49:43,832][106226] Updated weights for policy 0, policy_version 499286 (0.0007) [2023-12-27 22:49:44,364][106225] Updated weights for policy 1, policy_version 500666 (0.0010) [2023-12-27 22:49:44,425][106225] Updated weights for policy 1, policy_version 500676 (0.0010) [2023-12-27 22:49:44,483][106225] Updated weights for policy 1, policy_version 500686 (0.0010) [2023-12-27 22:49:44,535][106226] Updated weights for policy 0, policy_version 499296 (0.0008) [2023-12-27 22:49:44,593][106226] Updated weights for policy 0, policy_version 499306 (0.0007) [2023-12-27 22:49:44,648][106226] Updated weights for policy 0, policy_version 499316 (0.0008) [2023-12-27 22:49:45,246][106225] Updated weights for policy 1, policy_version 500696 (0.0011) [2023-12-27 22:49:45,303][106225] Updated weights for policy 1, policy_version 500706 (0.0011) [2023-12-27 22:49:45,321][106226] Updated weights for policy 0, policy_version 499326 (0.0006) [2023-12-27 22:49:45,354][106225] Updated weights for policy 1, policy_version 500716 (0.0010) [2023-12-27 22:49:45,384][106226] Updated weights for policy 0, policy_version 499336 (0.0005) [2023-12-27 22:49:45,435][106226] Updated weights for policy 0, policy_version 499346 (0.0005) [2023-12-27 22:49:46,014][106225] Updated weights for policy 1, policy_version 500726 (0.0009) [2023-12-27 22:49:46,072][106225] Updated weights for policy 1, policy_version 500736 (0.0007) [2023-12-27 22:49:46,138][106225] Updated weights for policy 1, policy_version 500746 (0.0008) [2023-12-27 22:49:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 256090112. Throughput: 0: 9997.6, 1: 9631.5. Samples: 256079080. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:46,175][105115] Avg episode reward: [(0, '-5.080'), (1, '-5.753')] [2023-12-27 22:49:46,184][106226] Updated weights for policy 0, policy_version 499356 (0.0006) [2023-12-27 22:49:46,254][106226] Updated weights for policy 0, policy_version 499366 (0.0005) [2023-12-27 22:49:46,322][106226] Updated weights for policy 0, policy_version 499376 (0.0005) [2023-12-27 22:49:46,858][106225] Updated weights for policy 1, policy_version 500756 (0.0007) [2023-12-27 22:49:46,913][106225] Updated weights for policy 1, policy_version 500766 (0.0008) [2023-12-27 22:49:46,914][106226] Updated weights for policy 0, policy_version 499386 (0.0007) [2023-12-27 22:49:46,964][106225] Updated weights for policy 1, policy_version 500776 (0.0007) [2023-12-27 22:49:46,973][106226] Updated weights for policy 0, policy_version 499396 (0.0006) [2023-12-27 22:49:47,030][106226] Updated weights for policy 0, policy_version 499406 (0.0007) [2023-12-27 22:49:47,086][106226] Updated weights for policy 0, policy_version 499416 (0.0008) [2023-12-27 22:49:47,697][106225] Updated weights for policy 1, policy_version 500786 (0.0006) [2023-12-27 22:49:47,761][106225] Updated weights for policy 1, policy_version 500796 (0.0008) [2023-12-27 22:49:47,805][106226] Updated weights for policy 0, policy_version 499426 (0.0010) [2023-12-27 22:49:47,818][106225] Updated weights for policy 1, policy_version 500806 (0.0008) [2023-12-27 22:49:47,858][106226] Updated weights for policy 0, policy_version 499436 (0.0005) [2023-12-27 22:49:47,878][106225] Updated weights for policy 1, policy_version 500816 (0.0009) [2023-12-27 22:49:47,904][106226] Updated weights for policy 0, policy_version 499446 (0.0008) [2023-12-27 22:49:48,546][106225] Updated weights for policy 1, policy_version 500826 (0.0006) [2023-12-27 22:49:48,602][106225] Updated weights for policy 1, policy_version 500836 (0.0008) [2023-12-27 22:49:48,631][106226] Updated weights for policy 0, policy_version 499456 (0.0008) [2023-12-27 22:49:48,650][106225] Updated weights for policy 1, policy_version 500846 (0.0006) [2023-12-27 22:49:48,698][106226] Updated weights for policy 0, policy_version 499466 (0.0008) [2023-12-27 22:49:48,774][106226] Updated weights for policy 0, policy_version 499476 (0.0008) [2023-12-27 22:49:49,378][106226] Updated weights for policy 0, policy_version 499486 (0.0009) [2023-12-27 22:49:49,399][106225] Updated weights for policy 1, policy_version 500856 (0.0009) [2023-12-27 22:49:49,441][106226] Updated weights for policy 0, policy_version 499496 (0.0008) [2023-12-27 22:49:49,449][106225] Updated weights for policy 1, policy_version 500866 (0.0007) [2023-12-27 22:49:49,499][106225] Updated weights for policy 1, policy_version 500876 (0.0007) [2023-12-27 22:49:49,500][106226] Updated weights for policy 0, policy_version 499506 (0.0008) [2023-12-27 22:49:50,197][106225] Updated weights for policy 1, policy_version 500886 (0.0006) [2023-12-27 22:49:50,226][106226] Updated weights for policy 0, policy_version 499516 (0.0007) [2023-12-27 22:49:50,260][106225] Updated weights for policy 1, policy_version 500896 (0.0006) [2023-12-27 22:49:50,288][106226] Updated weights for policy 0, policy_version 499526 (0.0008) [2023-12-27 22:49:50,325][106225] Updated weights for policy 1, policy_version 500906 (0.0007) [2023-12-27 22:49:50,340][106226] Updated weights for policy 0, policy_version 499536 (0.0006) [2023-12-27 22:49:50,950][106225] Updated weights for policy 1, policy_version 500916 (0.0008) [2023-12-27 22:49:51,004][106225] Updated weights for policy 1, policy_version 500926 (0.0008) [2023-12-27 22:49:51,073][106225] Updated weights for policy 1, policy_version 500936 (0.0008) [2023-12-27 22:49:51,163][106226] Updated weights for policy 0, policy_version 499546 (0.0009) [2023-12-27 22:49:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 256188416. Throughput: 0: 9939.8, 1: 9659.4. Samples: 256197912. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:51,175][105115] Avg episode reward: [(0, '-5.281'), (1, '-5.487')] [2023-12-27 22:49:51,222][106226] Updated weights for policy 0, policy_version 499556 (0.0011) [2023-12-27 22:49:51,287][106226] Updated weights for policy 0, policy_version 499566 (0.0009) [2023-12-27 22:49:51,357][106226] Updated weights for policy 0, policy_version 499576 (0.0007) [2023-12-27 22:49:51,739][106225] Updated weights for policy 1, policy_version 500946 (0.0006) [2023-12-27 22:49:51,802][106225] Updated weights for policy 1, policy_version 500956 (0.0008) [2023-12-27 22:49:51,859][106225] Updated weights for policy 1, policy_version 500966 (0.0008) [2023-12-27 22:49:51,914][106225] Updated weights for policy 1, policy_version 500976 (0.0009) [2023-12-27 22:49:52,044][106226] Updated weights for policy 0, policy_version 499586 (0.0006) [2023-12-27 22:49:52,109][106226] Updated weights for policy 0, policy_version 499596 (0.0006) [2023-12-27 22:49:52,171][106226] Updated weights for policy 0, policy_version 499606 (0.0006) [2023-12-27 22:49:52,658][106225] Updated weights for policy 1, policy_version 500986 (0.0006) [2023-12-27 22:49:52,715][106225] Updated weights for policy 1, policy_version 500996 (0.0006) [2023-12-27 22:49:52,752][106226] Updated weights for policy 0, policy_version 499616 (0.0006) [2023-12-27 22:49:52,774][106225] Updated weights for policy 1, policy_version 501006 (0.0006) [2023-12-27 22:49:52,803][106226] Updated weights for policy 0, policy_version 499626 (0.0007) [2023-12-27 22:49:52,868][106226] Updated weights for policy 0, policy_version 499636 (0.0006) [2023-12-27 22:49:53,390][106225] Updated weights for policy 1, policy_version 501016 (0.0005) [2023-12-27 22:49:53,425][106226] Updated weights for policy 0, policy_version 499646 (0.0006) [2023-12-27 22:49:53,450][106225] Updated weights for policy 1, policy_version 501026 (0.0005) [2023-12-27 22:49:53,478][106226] Updated weights for policy 0, policy_version 499656 (0.0006) [2023-12-27 22:49:53,502][106225] Updated weights for policy 1, policy_version 501036 (0.0006) [2023-12-27 22:49:53,529][106226] Updated weights for policy 0, policy_version 499666 (0.0006) [2023-12-27 22:49:54,083][106226] Updated weights for policy 0, policy_version 499676 (0.0007) [2023-12-27 22:49:54,134][106226] Updated weights for policy 0, policy_version 499686 (0.0005) [2023-12-27 22:49:54,196][106226] Updated weights for policy 0, policy_version 499696 (0.0009) [2023-12-27 22:49:54,236][106225] Updated weights for policy 1, policy_version 501046 (0.0007) [2023-12-27 22:49:54,285][106225] Updated weights for policy 1, policy_version 501056 (0.0009) [2023-12-27 22:49:54,334][106225] Updated weights for policy 1, policy_version 501066 (0.0008) [2023-12-27 22:49:54,823][106226] Updated weights for policy 0, policy_version 499706 (0.0007) [2023-12-27 22:49:54,888][106226] Updated weights for policy 0, policy_version 499716 (0.0008) [2023-12-27 22:49:54,950][106226] Updated weights for policy 0, policy_version 499726 (0.0009) [2023-12-27 22:49:55,018][106226] Updated weights for policy 0, policy_version 499736 (0.0008) [2023-12-27 22:49:55,088][106225] Updated weights for policy 1, policy_version 501076 (0.0008) [2023-12-27 22:49:55,156][106225] Updated weights for policy 1, policy_version 501086 (0.0008) [2023-12-27 22:49:55,215][106225] Updated weights for policy 1, policy_version 501096 (0.0008) [2023-12-27 22:49:55,630][106226] Updated weights for policy 0, policy_version 499746 (0.0005) [2023-12-27 22:49:55,688][106226] Updated weights for policy 0, policy_version 499756 (0.0005) [2023-12-27 22:49:55,747][106226] Updated weights for policy 0, policy_version 499766 (0.0008) [2023-12-27 22:49:55,954][106225] Updated weights for policy 1, policy_version 501106 (0.0008) [2023-12-27 22:49:56,011][106225] Updated weights for policy 1, policy_version 501116 (0.0009) [2023-12-27 22:49:56,064][106225] Updated weights for policy 1, policy_version 501126 (0.0007) [2023-12-27 22:49:56,113][106225] Updated weights for policy 1, policy_version 501136 (0.0006) [2023-12-27 22:49:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 256294912. Throughput: 0: 10044.7, 1: 9677.9. Samples: 256261836. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:49:56,175][105115] Avg episode reward: [(0, '-5.193'), (1, '-5.702')] [2023-12-27 22:49:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000501136_128319488.pth... [2023-12-27 22:49:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000499768_127975424.pth... [2023-12-27 22:49:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000499984_128024576.pth [2023-12-27 22:49:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000498584_127672320.pth [2023-12-27 22:49:56,444][106226] Updated weights for policy 0, policy_version 499776 (0.0009) [2023-12-27 22:49:56,510][106226] Updated weights for policy 0, policy_version 499786 (0.0010) [2023-12-27 22:49:56,575][106226] Updated weights for policy 0, policy_version 499796 (0.0009) [2023-12-27 22:49:56,703][106225] Updated weights for policy 1, policy_version 501146 (0.0006) [2023-12-27 22:49:56,749][106225] Updated weights for policy 1, policy_version 501156 (0.0008) [2023-12-27 22:49:56,805][106225] Updated weights for policy 1, policy_version 501166 (0.0008) [2023-12-27 22:49:57,333][106226] Updated weights for policy 0, policy_version 499806 (0.0008) [2023-12-27 22:49:57,396][106226] Updated weights for policy 0, policy_version 499816 (0.0005) [2023-12-27 22:49:57,460][106226] Updated weights for policy 0, policy_version 499826 (0.0007) [2023-12-27 22:49:57,461][106225] Updated weights for policy 1, policy_version 501176 (0.0010) [2023-12-27 22:49:57,510][106225] Updated weights for policy 1, policy_version 501186 (0.0010) [2023-12-27 22:49:57,562][106225] Updated weights for policy 1, policy_version 501196 (0.0010) [2023-12-27 22:49:58,079][106226] Updated weights for policy 0, policy_version 499836 (0.0010) [2023-12-27 22:49:58,132][106226] Updated weights for policy 0, policy_version 499846 (0.0010) [2023-12-27 22:49:58,191][106226] Updated weights for policy 0, policy_version 499856 (0.0010) [2023-12-27 22:49:58,295][106225] Updated weights for policy 1, policy_version 501206 (0.0009) [2023-12-27 22:49:58,369][106225] Updated weights for policy 1, policy_version 501217 (0.0008) [2023-12-27 22:49:58,447][106225] Updated weights for policy 1, policy_version 501227 (0.0008) [2023-12-27 22:49:58,952][106226] Updated weights for policy 0, policy_version 499866 (0.0010) [2023-12-27 22:49:59,017][106226] Updated weights for policy 0, policy_version 499876 (0.0008) [2023-12-27 22:49:59,083][106226] Updated weights for policy 0, policy_version 499886 (0.0008) [2023-12-27 22:49:59,154][106226] Updated weights for policy 0, policy_version 499896 (0.0008) [2023-12-27 22:49:59,254][106225] Updated weights for policy 1, policy_version 501237 (0.0009) [2023-12-27 22:49:59,318][106225] Updated weights for policy 1, policy_version 501247 (0.0007) [2023-12-27 22:49:59,388][106225] Updated weights for policy 1, policy_version 501257 (0.0011) [2023-12-27 22:49:59,897][106226] Updated weights for policy 0, policy_version 499906 (0.0009) [2023-12-27 22:49:59,968][106226] Updated weights for policy 0, policy_version 499916 (0.0008) [2023-12-27 22:50:00,033][106226] Updated weights for policy 0, policy_version 499926 (0.0009) [2023-12-27 22:50:00,127][106225] Updated weights for policy 1, policy_version 501267 (0.0010) [2023-12-27 22:50:00,187][106225] Updated weights for policy 1, policy_version 501277 (0.0009) [2023-12-27 22:50:00,241][106225] Updated weights for policy 1, policy_version 501287 (0.0009) [2023-12-27 22:50:00,674][106226] Updated weights for policy 0, policy_version 499936 (0.0009) [2023-12-27 22:50:00,737][106226] Updated weights for policy 0, policy_version 499946 (0.0006) [2023-12-27 22:50:00,792][106226] Updated weights for policy 0, policy_version 499956 (0.0006) [2023-12-27 22:50:00,879][106225] Updated weights for policy 1, policy_version 501297 (0.0006) [2023-12-27 22:50:00,933][106225] Updated weights for policy 1, policy_version 501307 (0.0007) [2023-12-27 22:50:00,989][106225] Updated weights for policy 1, policy_version 501317 (0.0008) [2023-12-27 22:50:01,053][106225] Updated weights for policy 1, policy_version 501327 (0.0007) [2023-12-27 22:50:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 256393216. Throughput: 0: 10009.7, 1: 9716.4. Samples: 256379016. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:50:01,175][105115] Avg episode reward: [(0, '-5.001'), (1, '-5.383')] [2023-12-27 22:50:01,456][106226] Updated weights for policy 0, policy_version 499966 (0.0009) [2023-12-27 22:50:01,518][106226] Updated weights for policy 0, policy_version 499976 (0.0007) [2023-12-27 22:50:01,579][106226] Updated weights for policy 0, policy_version 499986 (0.0011) [2023-12-27 22:50:01,797][106225] Updated weights for policy 1, policy_version 501337 (0.0007) [2023-12-27 22:50:01,856][106225] Updated weights for policy 1, policy_version 501347 (0.0009) [2023-12-27 22:50:01,913][106225] Updated weights for policy 1, policy_version 501357 (0.0010) [2023-12-27 22:50:02,316][106226] Updated weights for policy 0, policy_version 499996 (0.0010) [2023-12-27 22:50:02,384][106226] Updated weights for policy 0, policy_version 500006 (0.0009) [2023-12-27 22:50:02,443][106226] Updated weights for policy 0, policy_version 500016 (0.0008) [2023-12-27 22:50:02,620][106225] Updated weights for policy 1, policy_version 501367 (0.0008) [2023-12-27 22:50:02,676][106225] Updated weights for policy 1, policy_version 501377 (0.0005) [2023-12-27 22:50:02,729][106225] Updated weights for policy 1, policy_version 501387 (0.0006) [2023-12-27 22:50:03,079][106226] Updated weights for policy 0, policy_version 500026 (0.0007) [2023-12-27 22:50:03,129][106226] Updated weights for policy 0, policy_version 500036 (0.0010) [2023-12-27 22:50:03,181][106226] Updated weights for policy 0, policy_version 500046 (0.0010) [2023-12-27 22:50:03,228][106226] Updated weights for policy 0, policy_version 500056 (0.0010) [2023-12-27 22:50:03,470][106225] Updated weights for policy 1, policy_version 501397 (0.0007) [2023-12-27 22:50:03,537][106225] Updated weights for policy 1, policy_version 501407 (0.0005) [2023-12-27 22:50:03,589][106225] Updated weights for policy 1, policy_version 501417 (0.0006) [2023-12-27 22:50:03,939][106226] Updated weights for policy 0, policy_version 500066 (0.0011) [2023-12-27 22:50:03,995][106226] Updated weights for policy 0, policy_version 500076 (0.0011) [2023-12-27 22:50:04,045][106226] Updated weights for policy 0, policy_version 500086 (0.0010) [2023-12-27 22:50:04,267][106225] Updated weights for policy 1, policy_version 501427 (0.0008) [2023-12-27 22:50:04,329][106225] Updated weights for policy 1, policy_version 501437 (0.0007) [2023-12-27 22:50:04,391][106225] Updated weights for policy 1, policy_version 501447 (0.0008) [2023-12-27 22:50:04,777][106226] Updated weights for policy 0, policy_version 500096 (0.0010) [2023-12-27 22:50:04,827][106226] Updated weights for policy 0, policy_version 500106 (0.0010) [2023-12-27 22:50:04,873][106226] Updated weights for policy 0, policy_version 500116 (0.0010) [2023-12-27 22:50:05,013][106225] Updated weights for policy 1, policy_version 501457 (0.0008) [2023-12-27 22:50:05,061][106225] Updated weights for policy 1, policy_version 501467 (0.0007) [2023-12-27 22:50:05,104][106225] Updated weights for policy 1, policy_version 501477 (0.0010) [2023-12-27 22:50:05,150][106225] Updated weights for policy 1, policy_version 501487 (0.0010) [2023-12-27 22:50:05,576][106226] Updated weights for policy 0, policy_version 500126 (0.0007) [2023-12-27 22:50:05,634][106226] Updated weights for policy 0, policy_version 500136 (0.0005) [2023-12-27 22:50:05,685][106226] Updated weights for policy 0, policy_version 500146 (0.0005) [2023-12-27 22:50:05,866][106225] Updated weights for policy 1, policy_version 501497 (0.0010) [2023-12-27 22:50:05,923][106225] Updated weights for policy 1, policy_version 501507 (0.0010) [2023-12-27 22:50:05,977][106225] Updated weights for policy 1, policy_version 501517 (0.0009) [2023-12-27 22:50:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 256491520. Throughput: 0: 10160.3, 1: 9715.1. Samples: 256500992. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:50:06,175][105115] Avg episode reward: [(0, '-5.284'), (1, '-5.269')] [2023-12-27 22:50:06,209][106226] Updated weights for policy 0, policy_version 500156 (0.0007) [2023-12-27 22:50:06,274][106226] Updated weights for policy 0, policy_version 500166 (0.0011) [2023-12-27 22:50:06,339][106226] Updated weights for policy 0, policy_version 500176 (0.0011) [2023-12-27 22:50:06,711][106225] Updated weights for policy 1, policy_version 501527 (0.0010) [2023-12-27 22:50:06,768][106225] Updated weights for policy 1, policy_version 501537 (0.0010) [2023-12-27 22:50:06,827][106225] Updated weights for policy 1, policy_version 501547 (0.0010) [2023-12-27 22:50:07,029][106226] Updated weights for policy 0, policy_version 500186 (0.0008) [2023-12-27 22:50:07,091][106226] Updated weights for policy 0, policy_version 500196 (0.0007) [2023-12-27 22:50:07,142][106226] Updated weights for policy 0, policy_version 500206 (0.0008) [2023-12-27 22:50:07,202][106226] Updated weights for policy 0, policy_version 500216 (0.0008) [2023-12-27 22:50:07,560][106225] Updated weights for policy 1, policy_version 501557 (0.0008) [2023-12-27 22:50:07,617][106225] Updated weights for policy 1, policy_version 501567 (0.0005) [2023-12-27 22:50:07,672][106225] Updated weights for policy 1, policy_version 501577 (0.0005) [2023-12-27 22:50:07,825][106226] Updated weights for policy 0, policy_version 500226 (0.0005) [2023-12-27 22:50:07,889][106226] Updated weights for policy 0, policy_version 500236 (0.0005) [2023-12-27 22:50:07,956][106226] Updated weights for policy 0, policy_version 500247 (0.0006) [2023-12-27 22:50:08,290][106225] Updated weights for policy 1, policy_version 501587 (0.0008) [2023-12-27 22:50:08,359][106225] Updated weights for policy 1, policy_version 501597 (0.0008) [2023-12-27 22:50:08,423][106225] Updated weights for policy 1, policy_version 501607 (0.0011) [2023-12-27 22:50:08,611][106226] Updated weights for policy 0, policy_version 500257 (0.0007) [2023-12-27 22:50:08,666][106226] Updated weights for policy 0, policy_version 500267 (0.0008) [2023-12-27 22:50:08,735][106226] Updated weights for policy 0, policy_version 500277 (0.0007) [2023-12-27 22:50:09,091][106225] Updated weights for policy 1, policy_version 501617 (0.0010) [2023-12-27 22:50:09,145][106225] Updated weights for policy 1, policy_version 501627 (0.0010) [2023-12-27 22:50:09,211][106225] Updated weights for policy 1, policy_version 501637 (0.0011) [2023-12-27 22:50:09,283][106225] Updated weights for policy 1, policy_version 501647 (0.0012) [2023-12-27 22:50:09,529][106226] Updated weights for policy 0, policy_version 500287 (0.0010) [2023-12-27 22:50:09,588][106226] Updated weights for policy 0, policy_version 500297 (0.0011) [2023-12-27 22:50:09,651][106226] Updated weights for policy 0, policy_version 500307 (0.0011) [2023-12-27 22:50:10,045][106225] Updated weights for policy 1, policy_version 501657 (0.0008) [2023-12-27 22:50:10,104][106225] Updated weights for policy 1, policy_version 501667 (0.0008) [2023-12-27 22:50:10,153][106225] Updated weights for policy 1, policy_version 501677 (0.0008) [2023-12-27 22:50:10,400][106226] Updated weights for policy 0, policy_version 500317 (0.0011) [2023-12-27 22:50:10,460][106226] Updated weights for policy 0, policy_version 500327 (0.0011) [2023-12-27 22:50:10,518][106226] Updated weights for policy 0, policy_version 500337 (0.0010) [2023-12-27 22:50:10,952][106225] Updated weights for policy 1, policy_version 501687 (0.0008) [2023-12-27 22:50:10,999][106225] Updated weights for policy 1, policy_version 501697 (0.0008) [2023-12-27 22:50:11,066][106225] Updated weights for policy 1, policy_version 501707 (0.0008) [2023-12-27 22:50:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 256589824. Throughput: 0: 10179.1, 1: 9735.3. Samples: 256561528. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:50:11,175][105115] Avg episode reward: [(0, '-5.266'), (1, '-5.610')] [2023-12-27 22:50:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000501712_128466944.pth... [2023-12-27 22:50:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000500344_128122880.pth... [2023-12-27 22:50:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000499160_127819776.pth [2023-12-27 22:50:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000500560_128172032.pth [2023-12-27 22:50:11,264][106226] Updated weights for policy 0, policy_version 500347 (0.0011) [2023-12-27 22:50:11,329][106226] Updated weights for policy 0, policy_version 500357 (0.0010) [2023-12-27 22:50:11,401][106226] Updated weights for policy 0, policy_version 500367 (0.0009) [2023-12-27 22:50:11,887][106225] Updated weights for policy 1, policy_version 501717 (0.0008) [2023-12-27 22:50:11,948][106225] Updated weights for policy 1, policy_version 501727 (0.0007) [2023-12-27 22:50:12,012][106225] Updated weights for policy 1, policy_version 501737 (0.0007) [2023-12-27 22:50:12,159][106226] Updated weights for policy 0, policy_version 500377 (0.0009) [2023-12-27 22:50:12,230][106226] Updated weights for policy 0, policy_version 500387 (0.0006) [2023-12-27 22:50:12,304][106226] Updated weights for policy 0, policy_version 500397 (0.0008) [2023-12-27 22:50:12,377][106226] Updated weights for policy 0, policy_version 500407 (0.0008) [2023-12-27 22:50:12,701][106225] Updated weights for policy 1, policy_version 501747 (0.0007) [2023-12-27 22:50:12,750][106225] Updated weights for policy 1, policy_version 501757 (0.0008) [2023-12-27 22:50:12,811][106225] Updated weights for policy 1, policy_version 501767 (0.0009) [2023-12-27 22:50:12,991][106226] Updated weights for policy 0, policy_version 500417 (0.0007) [2023-12-27 22:50:13,045][106226] Updated weights for policy 0, policy_version 500427 (0.0009) [2023-12-27 22:50:13,100][106226] Updated weights for policy 0, policy_version 500438 (0.0009) [2023-12-27 22:50:13,579][106225] Updated weights for policy 1, policy_version 501777 (0.0010) [2023-12-27 22:50:13,634][106225] Updated weights for policy 1, policy_version 501787 (0.0008) [2023-12-27 22:50:13,686][106225] Updated weights for policy 1, policy_version 501797 (0.0008) [2023-12-27 22:50:13,741][106226] Updated weights for policy 0, policy_version 500448 (0.0009) [2023-12-27 22:50:13,747][106225] Updated weights for policy 1, policy_version 501807 (0.0008) [2023-12-27 22:50:13,793][106226] Updated weights for policy 0, policy_version 500458 (0.0008) [2023-12-27 22:50:13,847][106226] Updated weights for policy 0, policy_version 500468 (0.0005) [2023-12-27 22:50:14,361][106225] Updated weights for policy 1, policy_version 501817 (0.0005) [2023-12-27 22:50:14,425][106225] Updated weights for policy 1, policy_version 501827 (0.0009) [2023-12-27 22:50:14,488][106225] Updated weights for policy 1, policy_version 501837 (0.0008) [2023-12-27 22:50:14,519][106226] Updated weights for policy 0, policy_version 500478 (0.0007) [2023-12-27 22:50:14,587][106226] Updated weights for policy 0, policy_version 500488 (0.0008) [2023-12-27 22:50:14,654][106226] Updated weights for policy 0, policy_version 500498 (0.0009) [2023-12-27 22:50:15,160][106225] Updated weights for policy 1, policy_version 501847 (0.0008) [2023-12-27 22:50:15,230][106225] Updated weights for policy 1, policy_version 501857 (0.0008) [2023-12-27 22:50:15,294][106225] Updated weights for policy 1, policy_version 501867 (0.0009) [2023-12-27 22:50:15,370][106226] Updated weights for policy 0, policy_version 500508 (0.0007) [2023-12-27 22:50:15,421][106226] Updated weights for policy 0, policy_version 500518 (0.0009) [2023-12-27 22:50:15,471][106226] Updated weights for policy 0, policy_version 500528 (0.0009) [2023-12-27 22:50:15,907][106225] Updated weights for policy 1, policy_version 501877 (0.0008) [2023-12-27 22:50:15,971][106225] Updated weights for policy 1, policy_version 501887 (0.0011) [2023-12-27 22:50:16,029][106225] Updated weights for policy 1, policy_version 501897 (0.0008) [2023-12-27 22:50:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 256688128. Throughput: 0: 10058.8, 1: 9760.4. Samples: 256676784. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-27 22:50:16,176][105115] Avg episode reward: [(0, '-5.205'), (1, '-5.497')] [2023-12-27 22:50:16,289][106226] Updated weights for policy 0, policy_version 500538 (0.0007) [2023-12-27 22:50:16,361][106226] Updated weights for policy 0, policy_version 500548 (0.0008) [2023-12-27 22:50:16,426][106226] Updated weights for policy 0, policy_version 500558 (0.0008) [2023-12-27 22:50:16,490][106226] Updated weights for policy 0, policy_version 500568 (0.0007) [2023-12-27 22:50:16,722][106225] Updated weights for policy 1, policy_version 501907 (0.0009) [2023-12-27 22:50:16,775][106225] Updated weights for policy 1, policy_version 501917 (0.0010) [2023-12-27 22:50:16,825][106225] Updated weights for policy 1, policy_version 501927 (0.0010) [2023-12-27 22:50:17,143][106226] Updated weights for policy 0, policy_version 500578 (0.0008) [2023-12-27 22:50:17,194][106226] Updated weights for policy 0, policy_version 500588 (0.0007) [2023-12-27 22:50:17,259][106226] Updated weights for policy 0, policy_version 500598 (0.0008) [2023-12-27 22:50:17,529][106225] Updated weights for policy 1, policy_version 501937 (0.0010) [2023-12-27 22:50:17,582][106225] Updated weights for policy 1, policy_version 501947 (0.0010) [2023-12-27 22:50:17,642][106225] Updated weights for policy 1, policy_version 501957 (0.0010) [2023-12-27 22:50:17,705][106225] Updated weights for policy 1, policy_version 501967 (0.0010) [2023-12-27 22:50:17,958][106226] Updated weights for policy 0, policy_version 500608 (0.0007) [2023-12-27 22:50:18,018][106226] Updated weights for policy 0, policy_version 500618 (0.0008) [2023-12-27 22:50:18,070][106226] Updated weights for policy 0, policy_version 500628 (0.0008) [2023-12-27 22:50:18,428][106225] Updated weights for policy 1, policy_version 501977 (0.0006) [2023-12-27 22:50:18,488][106225] Updated weights for policy 1, policy_version 501987 (0.0005) [2023-12-27 22:50:18,542][106225] Updated weights for policy 1, policy_version 501997 (0.0009) [2023-12-27 22:50:18,856][106226] Updated weights for policy 0, policy_version 500638 (0.0007) [2023-12-27 22:50:18,918][106226] Updated weights for policy 0, policy_version 500648 (0.0006) [2023-12-27 22:50:18,979][106226] Updated weights for policy 0, policy_version 500658 (0.0007) [2023-12-27 22:50:19,222][106225] Updated weights for policy 1, policy_version 502007 (0.0007) [2023-12-27 22:50:19,290][106225] Updated weights for policy 1, policy_version 502017 (0.0007) [2023-12-27 22:50:19,362][106225] Updated weights for policy 1, policy_version 502027 (0.0008) [2023-12-27 22:50:19,675][106226] Updated weights for policy 0, policy_version 500668 (0.0008) [2023-12-27 22:50:19,740][106226] Updated weights for policy 0, policy_version 500678 (0.0009) [2023-12-27 22:50:19,802][106226] Updated weights for policy 0, policy_version 500688 (0.0007) [2023-12-27 22:50:20,183][106225] Updated weights for policy 1, policy_version 502037 (0.0008) [2023-12-27 22:50:20,244][106225] Updated weights for policy 1, policy_version 502047 (0.0006) [2023-12-27 22:50:20,312][106225] Updated weights for policy 1, policy_version 502057 (0.0006) [2023-12-27 22:50:20,605][106226] Updated weights for policy 0, policy_version 500698 (0.0008) [2023-12-27 22:50:20,669][106226] Updated weights for policy 0, policy_version 500708 (0.0008) [2023-12-27 22:50:20,743][106226] Updated weights for policy 0, policy_version 500718 (0.0008) [2023-12-27 22:50:20,807][106226] Updated weights for policy 0, policy_version 500728 (0.0009) [2023-12-27 22:50:20,939][106225] Updated weights for policy 1, policy_version 502067 (0.0006) [2023-12-27 22:50:21,007][106225] Updated weights for policy 1, policy_version 502077 (0.0006) [2023-12-27 22:50:21,073][106225] Updated weights for policy 1, policy_version 502087 (0.0008) [2023-12-27 22:50:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 256786432. Throughput: 0: 9950.6, 1: 9758.2. Samples: 256791596. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:21,175][105115] Avg episode reward: [(0, '-5.366'), (1, '-5.598')] [2023-12-27 22:50:21,592][106226] Updated weights for policy 0, policy_version 500738 (0.0010) [2023-12-27 22:50:21,657][106226] Updated weights for policy 0, policy_version 500748 (0.0010) [2023-12-27 22:50:21,721][106226] Updated weights for policy 0, policy_version 500758 (0.0009) [2023-12-27 22:50:21,854][106225] Updated weights for policy 1, policy_version 502097 (0.0008) [2023-12-27 22:50:21,916][106225] Updated weights for policy 1, policy_version 502107 (0.0008) [2023-12-27 22:50:21,975][106225] Updated weights for policy 1, policy_version 502117 (0.0008) [2023-12-27 22:50:22,038][106225] Updated weights for policy 1, policy_version 502127 (0.0008) [2023-12-27 22:50:22,544][106226] Updated weights for policy 0, policy_version 500768 (0.0010) [2023-12-27 22:50:22,605][106226] Updated weights for policy 0, policy_version 500778 (0.0009) [2023-12-27 22:50:22,669][106226] Updated weights for policy 0, policy_version 500788 (0.0009) [2023-12-27 22:50:22,762][106225] Updated weights for policy 1, policy_version 502137 (0.0006) [2023-12-27 22:50:22,827][106225] Updated weights for policy 1, policy_version 502147 (0.0005) [2023-12-27 22:50:22,885][106225] Updated weights for policy 1, policy_version 502157 (0.0005) [2023-12-27 22:50:23,389][106226] Updated weights for policy 0, policy_version 500798 (0.0007) [2023-12-27 22:50:23,442][106226] Updated weights for policy 0, policy_version 500808 (0.0005) [2023-12-27 22:50:23,491][106226] Updated weights for policy 0, policy_version 500818 (0.0005) [2023-12-27 22:50:23,546][106225] Updated weights for policy 1, policy_version 502167 (0.0008) [2023-12-27 22:50:23,608][106225] Updated weights for policy 1, policy_version 502177 (0.0009) [2023-12-27 22:50:23,656][106225] Updated weights for policy 1, policy_version 502187 (0.0008) [2023-12-27 22:50:24,165][106226] Updated weights for policy 0, policy_version 500828 (0.0008) [2023-12-27 22:50:24,215][106226] Updated weights for policy 0, policy_version 500838 (0.0008) [2023-12-27 22:50:24,272][106226] Updated weights for policy 0, policy_version 500848 (0.0008) [2023-12-27 22:50:24,386][106225] Updated weights for policy 1, policy_version 502197 (0.0008) [2023-12-27 22:50:24,435][106225] Updated weights for policy 1, policy_version 502207 (0.0009) [2023-12-27 22:50:24,480][106225] Updated weights for policy 1, policy_version 502217 (0.0008) [2023-12-27 22:50:24,943][106226] Updated weights for policy 0, policy_version 500858 (0.0008) [2023-12-27 22:50:24,998][106226] Updated weights for policy 0, policy_version 500868 (0.0005) [2023-12-27 22:50:25,058][106226] Updated weights for policy 0, policy_version 500878 (0.0005) [2023-12-27 22:50:25,114][106226] Updated weights for policy 0, policy_version 500888 (0.0005) [2023-12-27 22:50:25,284][106225] Updated weights for policy 1, policy_version 502227 (0.0008) [2023-12-27 22:50:25,333][106225] Updated weights for policy 1, policy_version 502237 (0.0009) [2023-12-27 22:50:25,386][106225] Updated weights for policy 1, policy_version 502247 (0.0007) [2023-12-27 22:50:25,627][106226] Updated weights for policy 0, policy_version 500898 (0.0009) [2023-12-27 22:50:25,676][106226] Updated weights for policy 0, policy_version 500908 (0.0010) [2023-12-27 22:50:25,729][106226] Updated weights for policy 0, policy_version 500918 (0.0010) [2023-12-27 22:50:26,065][106225] Updated weights for policy 1, policy_version 502257 (0.0009) [2023-12-27 22:50:26,132][106225] Updated weights for policy 1, policy_version 502267 (0.0005) [2023-12-27 22:50:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 256876544. Throughput: 0: 9916.9, 1: 9715.6. Samples: 256848368. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:26,176][105115] Avg episode reward: [(0, '-5.002'), (1, '-5.556')] [2023-12-27 22:50:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000500920_128270336.pth... [2023-12-27 22:50:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000499768_127975424.pth [2023-12-27 22:50:26,200][106225] Updated weights for policy 1, policy_version 502277 (0.0007) [2023-12-27 22:50:26,262][106225] Updated weights for policy 1, policy_version 502287 (0.0008) [2023-12-27 22:50:26,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000502288_128614400.pth... [2023-12-27 22:50:26,271][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000501136_128319488.pth [2023-12-27 22:50:26,485][106226] Updated weights for policy 0, policy_version 500928 (0.0009) [2023-12-27 22:50:26,544][106226] Updated weights for policy 0, policy_version 500938 (0.0008) [2023-12-27 22:50:26,598][106226] Updated weights for policy 0, policy_version 500948 (0.0007) [2023-12-27 22:50:26,940][106225] Updated weights for policy 1, policy_version 502297 (0.0009) [2023-12-27 22:50:26,993][106225] Updated weights for policy 1, policy_version 502307 (0.0009) [2023-12-27 22:50:27,044][106225] Updated weights for policy 1, policy_version 502317 (0.0008) [2023-12-27 22:50:27,183][106226] Updated weights for policy 0, policy_version 500958 (0.0009) [2023-12-27 22:50:27,235][106226] Updated weights for policy 0, policy_version 500968 (0.0009) [2023-12-27 22:50:27,292][106226] Updated weights for policy 0, policy_version 500978 (0.0009) [2023-12-27 22:50:27,689][106225] Updated weights for policy 1, policy_version 502327 (0.0006) [2023-12-27 22:50:27,757][106225] Updated weights for policy 1, policy_version 502337 (0.0006) [2023-12-27 22:50:27,825][106225] Updated weights for policy 1, policy_version 502347 (0.0005) [2023-12-27 22:50:27,923][106226] Updated weights for policy 0, policy_version 500988 (0.0008) [2023-12-27 22:50:27,985][106226] Updated weights for policy 0, policy_version 500998 (0.0006) [2023-12-27 22:50:28,037][106226] Updated weights for policy 0, policy_version 501008 (0.0010) [2023-12-27 22:50:28,373][106225] Updated weights for policy 1, policy_version 502357 (0.0007) [2023-12-27 22:50:28,436][106225] Updated weights for policy 1, policy_version 502367 (0.0008) [2023-12-27 22:50:28,489][106225] Updated weights for policy 1, policy_version 502377 (0.0009) [2023-12-27 22:50:28,692][106226] Updated weights for policy 0, policy_version 501018 (0.0010) [2023-12-27 22:50:28,759][106226] Updated weights for policy 0, policy_version 501028 (0.0008) [2023-12-27 22:50:28,819][106226] Updated weights for policy 0, policy_version 501038 (0.0006) [2023-12-27 22:50:28,890][106226] Updated weights for policy 0, policy_version 501048 (0.0007) [2023-12-27 22:50:29,286][106225] Updated weights for policy 1, policy_version 502387 (0.0007) [2023-12-27 22:50:29,346][106225] Updated weights for policy 1, policy_version 502397 (0.0008) [2023-12-27 22:50:29,414][106225] Updated weights for policy 1, policy_version 502407 (0.0008) [2023-12-27 22:50:29,463][106226] Updated weights for policy 0, policy_version 501058 (0.0008) [2023-12-27 22:50:29,526][106226] Updated weights for policy 0, policy_version 501068 (0.0010) [2023-12-27 22:50:29,588][106226] Updated weights for policy 0, policy_version 501078 (0.0010) [2023-12-27 22:50:30,214][106225] Updated weights for policy 1, policy_version 502417 (0.0008) [2023-12-27 22:50:30,236][106226] Updated weights for policy 0, policy_version 501088 (0.0010) [2023-12-27 22:50:30,273][106225] Updated weights for policy 1, policy_version 502427 (0.0005) [2023-12-27 22:50:30,293][106226] Updated weights for policy 0, policy_version 501098 (0.0010) [2023-12-27 22:50:30,329][106225] Updated weights for policy 1, policy_version 502437 (0.0006) [2023-12-27 22:50:30,349][106226] Updated weights for policy 0, policy_version 501108 (0.0009) [2023-12-27 22:50:30,385][106225] Updated weights for policy 1, policy_version 502447 (0.0008) [2023-12-27 22:50:30,993][106226] Updated weights for policy 0, policy_version 501118 (0.0008) [2023-12-27 22:50:31,052][106226] Updated weights for policy 0, policy_version 501128 (0.0009) [2023-12-27 22:50:31,111][106226] Updated weights for policy 0, policy_version 501138 (0.0006) [2023-12-27 22:50:31,135][106225] Updated weights for policy 1, policy_version 502457 (0.0007) [2023-12-27 22:50:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 256983040. Throughput: 0: 10032.9, 1: 9821.1. Samples: 256972508. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:31,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.639')] [2023-12-27 22:50:31,191][106225] Updated weights for policy 1, policy_version 502467 (0.0008) [2023-12-27 22:50:31,247][106225] Updated weights for policy 1, policy_version 502477 (0.0008) [2023-12-27 22:50:31,804][106226] Updated weights for policy 0, policy_version 501148 (0.0006) [2023-12-27 22:50:31,853][106226] Updated weights for policy 0, policy_version 501158 (0.0006) [2023-12-27 22:50:31,917][106226] Updated weights for policy 0, policy_version 501168 (0.0006) [2023-12-27 22:50:31,942][106225] Updated weights for policy 1, policy_version 502487 (0.0009) [2023-12-27 22:50:31,999][106225] Updated weights for policy 1, policy_version 502497 (0.0007) [2023-12-27 22:50:32,051][106225] Updated weights for policy 1, policy_version 502507 (0.0009) [2023-12-27 22:50:32,625][106226] Updated weights for policy 0, policy_version 501178 (0.0007) [2023-12-27 22:50:32,676][106226] Updated weights for policy 0, policy_version 501188 (0.0008) [2023-12-27 22:50:32,732][106226] Updated weights for policy 0, policy_version 501198 (0.0009) [2023-12-27 22:50:32,792][106226] Updated weights for policy 0, policy_version 501208 (0.0008) [2023-12-27 22:50:32,832][106225] Updated weights for policy 1, policy_version 502517 (0.0009) [2023-12-27 22:50:32,878][106225] Updated weights for policy 1, policy_version 502527 (0.0008) [2023-12-27 22:50:32,928][106225] Updated weights for policy 1, policy_version 502537 (0.0008) [2023-12-27 22:50:33,432][106226] Updated weights for policy 0, policy_version 501218 (0.0007) [2023-12-27 22:50:33,497][106226] Updated weights for policy 0, policy_version 501228 (0.0005) [2023-12-27 22:50:33,542][106226] Updated weights for policy 0, policy_version 501238 (0.0007) [2023-12-27 22:50:33,663][106225] Updated weights for policy 1, policy_version 502547 (0.0008) [2023-12-27 22:50:33,727][106225] Updated weights for policy 1, policy_version 502557 (0.0009) [2023-12-27 22:50:33,787][106225] Updated weights for policy 1, policy_version 502567 (0.0010) [2023-12-27 22:50:34,062][106226] Updated weights for policy 0, policy_version 501248 (0.0007) [2023-12-27 22:50:34,128][106226] Updated weights for policy 0, policy_version 501258 (0.0011) [2023-12-27 22:50:34,192][106226] Updated weights for policy 0, policy_version 501268 (0.0009) [2023-12-27 22:50:34,378][106225] Updated weights for policy 1, policy_version 502577 (0.0007) [2023-12-27 22:50:34,446][106225] Updated weights for policy 1, policy_version 502587 (0.0006) [2023-12-27 22:50:34,512][106225] Updated weights for policy 1, policy_version 502597 (0.0006) [2023-12-27 22:50:34,578][106225] Updated weights for policy 1, policy_version 502607 (0.0006) [2023-12-27 22:50:34,834][106226] Updated weights for policy 0, policy_version 501278 (0.0007) [2023-12-27 22:50:34,892][106226] Updated weights for policy 0, policy_version 501288 (0.0007) [2023-12-27 22:50:34,952][106226] Updated weights for policy 0, policy_version 501298 (0.0010) [2023-12-27 22:50:35,105][106225] Updated weights for policy 1, policy_version 502617 (0.0007) [2023-12-27 22:50:35,158][106225] Updated weights for policy 1, policy_version 502627 (0.0008) [2023-12-27 22:50:35,208][106225] Updated weights for policy 1, policy_version 502637 (0.0008) [2023-12-27 22:50:35,642][106226] Updated weights for policy 0, policy_version 501308 (0.0010) [2023-12-27 22:50:35,705][106226] Updated weights for policy 0, policy_version 501318 (0.0010) [2023-12-27 22:50:35,762][106226] Updated weights for policy 0, policy_version 501328 (0.0010) [2023-12-27 22:50:35,944][106225] Updated weights for policy 1, policy_version 502647 (0.0008) [2023-12-27 22:50:35,998][106225] Updated weights for policy 1, policy_version 502657 (0.0007) [2023-12-27 22:50:36,050][106225] Updated weights for policy 1, policy_version 502667 (0.0006) [2023-12-27 22:50:36,174][105115] Fps is (10 sec: 21299.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 257089536. Throughput: 0: 10117.3, 1: 9830.2. Samples: 257095544. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:36,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-5.482')] [2023-12-27 22:50:36,557][106226] Updated weights for policy 0, policy_version 501338 (0.0011) [2023-12-27 22:50:36,622][106226] Updated weights for policy 0, policy_version 501348 (0.0011) [2023-12-27 22:50:36,659][106225] Updated weights for policy 1, policy_version 502677 (0.0005) [2023-12-27 22:50:36,683][106226] Updated weights for policy 0, policy_version 501358 (0.0011) [2023-12-27 22:50:36,726][106225] Updated weights for policy 1, policy_version 502687 (0.0006) [2023-12-27 22:50:36,745][106226] Updated weights for policy 0, policy_version 501368 (0.0010) [2023-12-27 22:50:36,785][106225] Updated weights for policy 1, policy_version 502697 (0.0006) [2023-12-27 22:50:37,397][106225] Updated weights for policy 1, policy_version 502707 (0.0007) [2023-12-27 22:50:37,451][106225] Updated weights for policy 1, policy_version 502717 (0.0006) [2023-12-27 22:50:37,462][106226] Updated weights for policy 0, policy_version 501378 (0.0009) [2023-12-27 22:50:37,499][106225] Updated weights for policy 1, policy_version 502727 (0.0008) [2023-12-27 22:50:37,516][106226] Updated weights for policy 0, policy_version 501388 (0.0007) [2023-12-27 22:50:37,578][106226] Updated weights for policy 0, policy_version 501398 (0.0007) [2023-12-27 22:50:38,159][106225] Updated weights for policy 1, policy_version 502737 (0.0007) [2023-12-27 22:50:38,189][106226] Updated weights for policy 0, policy_version 501408 (0.0007) [2023-12-27 22:50:38,219][106225] Updated weights for policy 1, policy_version 502747 (0.0011) [2023-12-27 22:50:38,249][106226] Updated weights for policy 0, policy_version 501418 (0.0006) [2023-12-27 22:50:38,277][106225] Updated weights for policy 1, policy_version 502757 (0.0010) [2023-12-27 22:50:38,303][106226] Updated weights for policy 0, policy_version 501428 (0.0009) [2023-12-27 22:50:38,344][106225] Updated weights for policy 1, policy_version 502767 (0.0007) [2023-12-27 22:50:39,049][106226] Updated weights for policy 0, policy_version 501438 (0.0007) [2023-12-27 22:50:39,059][106225] Updated weights for policy 1, policy_version 502777 (0.0010) [2023-12-27 22:50:39,105][106226] Updated weights for policy 0, policy_version 501448 (0.0008) [2023-12-27 22:50:39,114][106225] Updated weights for policy 1, policy_version 502787 (0.0010) [2023-12-27 22:50:39,159][106226] Updated weights for policy 0, policy_version 501458 (0.0005) [2023-12-27 22:50:39,168][106225] Updated weights for policy 1, policy_version 502797 (0.0010) [2023-12-27 22:50:39,969][106225] Updated weights for policy 1, policy_version 502807 (0.0008) [2023-12-27 22:50:39,996][106226] Updated weights for policy 0, policy_version 501468 (0.0006) [2023-12-27 22:50:40,028][106225] Updated weights for policy 1, policy_version 502817 (0.0009) [2023-12-27 22:50:40,059][106226] Updated weights for policy 0, policy_version 501478 (0.0011) [2023-12-27 22:50:40,082][106225] Updated weights for policy 1, policy_version 502827 (0.0008) [2023-12-27 22:50:40,123][106226] Updated weights for policy 0, policy_version 501488 (0.0010) [2023-12-27 22:50:40,748][106225] Updated weights for policy 1, policy_version 502837 (0.0011) [2023-12-27 22:50:40,798][106225] Updated weights for policy 1, policy_version 502847 (0.0010) [2023-12-27 22:50:40,826][106226] Updated weights for policy 0, policy_version 501498 (0.0010) [2023-12-27 22:50:40,855][106225] Updated weights for policy 1, policy_version 502857 (0.0010) [2023-12-27 22:50:40,887][106226] Updated weights for policy 0, policy_version 501508 (0.0006) [2023-12-27 22:50:40,937][106226] Updated weights for policy 0, policy_version 501518 (0.0008) [2023-12-27 22:50:40,993][106226] Updated weights for policy 0, policy_version 501528 (0.0008) [2023-12-27 22:50:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 257187840. Throughput: 0: 10020.4, 1: 9856.9. Samples: 257156316. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:41,175][105115] Avg episode reward: [(0, '-4.942'), (1, '-5.602')] [2023-12-27 22:50:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000502864_128761856.pth... [2023-12-27 22:50:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000501528_128425984.pth... [2023-12-27 22:50:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000501712_128466944.pth [2023-12-27 22:50:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000500344_128122880.pth [2023-12-27 22:50:41,694][106225] Updated weights for policy 1, policy_version 502867 (0.0010) [2023-12-27 22:50:41,763][106225] Updated weights for policy 1, policy_version 502877 (0.0009) [2023-12-27 22:50:41,781][106226] Updated weights for policy 0, policy_version 501538 (0.0007) [2023-12-27 22:50:41,823][106225] Updated weights for policy 1, policy_version 502887 (0.0009) [2023-12-27 22:50:41,847][106226] Updated weights for policy 0, policy_version 501548 (0.0008) [2023-12-27 22:50:41,919][106226] Updated weights for policy 0, policy_version 501558 (0.0006) [2023-12-27 22:50:42,580][106225] Updated weights for policy 1, policy_version 502897 (0.0006) [2023-12-27 22:50:42,581][106226] Updated weights for policy 0, policy_version 501568 (0.0008) [2023-12-27 22:50:42,636][106225] Updated weights for policy 1, policy_version 502907 (0.0009) [2023-12-27 22:50:42,641][106226] Updated weights for policy 0, policy_version 501578 (0.0006) [2023-12-27 22:50:42,701][106225] Updated weights for policy 1, policy_version 502917 (0.0010) [2023-12-27 22:50:42,706][106226] Updated weights for policy 0, policy_version 501588 (0.0005) [2023-12-27 22:50:42,752][106225] Updated weights for policy 1, policy_version 502927 (0.0010) [2023-12-27 22:50:43,415][106226] Updated weights for policy 0, policy_version 501598 (0.0008) [2023-12-27 22:50:43,468][106226] Updated weights for policy 0, policy_version 501608 (0.0006) [2023-12-27 22:50:43,491][106225] Updated weights for policy 1, policy_version 502937 (0.0010) [2023-12-27 22:50:43,519][106226] Updated weights for policy 0, policy_version 501618 (0.0005) [2023-12-27 22:50:43,541][106225] Updated weights for policy 1, policy_version 502947 (0.0010) [2023-12-27 22:50:43,588][106225] Updated weights for policy 1, policy_version 502957 (0.0005) [2023-12-27 22:50:44,114][106226] Updated weights for policy 0, policy_version 501628 (0.0007) [2023-12-27 22:50:44,174][106226] Updated weights for policy 0, policy_version 501638 (0.0007) [2023-12-27 22:50:44,237][106226] Updated weights for policy 0, policy_version 501648 (0.0010) [2023-12-27 22:50:44,262][106225] Updated weights for policy 1, policy_version 502967 (0.0008) [2023-12-27 22:50:44,322][106225] Updated weights for policy 1, policy_version 502977 (0.0010) [2023-12-27 22:50:44,375][106225] Updated weights for policy 1, policy_version 502987 (0.0010) [2023-12-27 22:50:44,816][106226] Updated weights for policy 0, policy_version 501658 (0.0008) [2023-12-27 22:50:44,875][106226] Updated weights for policy 0, policy_version 501668 (0.0009) [2023-12-27 22:50:44,936][106226] Updated weights for policy 0, policy_version 501678 (0.0005) [2023-12-27 22:50:45,001][106226] Updated weights for policy 0, policy_version 501688 (0.0011) [2023-12-27 22:50:45,105][106225] Updated weights for policy 1, policy_version 502997 (0.0010) [2023-12-27 22:50:45,168][106225] Updated weights for policy 1, policy_version 503007 (0.0011) [2023-12-27 22:50:45,232][106225] Updated weights for policy 1, policy_version 503017 (0.0011) [2023-12-27 22:50:45,652][106226] Updated weights for policy 0, policy_version 501698 (0.0007) [2023-12-27 22:50:45,707][106226] Updated weights for policy 0, policy_version 501708 (0.0008) [2023-12-27 22:50:45,764][106226] Updated weights for policy 0, policy_version 501718 (0.0008) [2023-12-27 22:50:45,921][106225] Updated weights for policy 1, policy_version 503027 (0.0010) [2023-12-27 22:50:45,972][106225] Updated weights for policy 1, policy_version 503037 (0.0008) [2023-12-27 22:50:46,024][106225] Updated weights for policy 1, policy_version 503047 (0.0008) [2023-12-27 22:50:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 257286144. Throughput: 0: 10027.5, 1: 9844.6. Samples: 257273264. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:46,176][105115] Avg episode reward: [(0, '-5.280'), (1, '-5.450')] [2023-12-27 22:50:46,455][106226] Updated weights for policy 0, policy_version 501728 (0.0009) [2023-12-27 22:50:46,520][106226] Updated weights for policy 0, policy_version 501738 (0.0010) [2023-12-27 22:50:46,581][106226] Updated weights for policy 0, policy_version 501748 (0.0011) [2023-12-27 22:50:46,788][106225] Updated weights for policy 1, policy_version 503057 (0.0009) [2023-12-27 22:50:46,835][106225] Updated weights for policy 1, policy_version 503067 (0.0009) [2023-12-27 22:50:46,887][106225] Updated weights for policy 1, policy_version 503077 (0.0009) [2023-12-27 22:50:46,937][106225] Updated weights for policy 1, policy_version 503087 (0.0010) [2023-12-27 22:50:47,262][106226] Updated weights for policy 0, policy_version 501758 (0.0011) [2023-12-27 22:50:47,317][106226] Updated weights for policy 0, policy_version 501768 (0.0008) [2023-12-27 22:50:47,366][106226] Updated weights for policy 0, policy_version 501778 (0.0008) [2023-12-27 22:50:47,574][106225] Updated weights for policy 1, policy_version 503097 (0.0008) [2023-12-27 22:50:47,631][106225] Updated weights for policy 1, policy_version 503107 (0.0010) [2023-12-27 22:50:47,696][106225] Updated weights for policy 1, policy_version 503117 (0.0010) [2023-12-27 22:50:48,119][106226] Updated weights for policy 0, policy_version 501788 (0.0007) [2023-12-27 22:50:48,180][106226] Updated weights for policy 0, policy_version 501798 (0.0008) [2023-12-27 22:50:48,238][106226] Updated weights for policy 0, policy_version 501808 (0.0007) [2023-12-27 22:50:48,387][106225] Updated weights for policy 1, policy_version 503127 (0.0010) [2023-12-27 22:50:48,455][106225] Updated weights for policy 1, policy_version 503137 (0.0011) [2023-12-27 22:50:48,522][106225] Updated weights for policy 1, policy_version 503147 (0.0010) [2023-12-27 22:50:48,913][106226] Updated weights for policy 0, policy_version 501818 (0.0008) [2023-12-27 22:50:48,976][106226] Updated weights for policy 0, policy_version 501828 (0.0011) [2023-12-27 22:50:49,043][106226] Updated weights for policy 0, policy_version 501838 (0.0010) [2023-12-27 22:50:49,107][106226] Updated weights for policy 0, policy_version 501848 (0.0009) [2023-12-27 22:50:49,214][106225] Updated weights for policy 1, policy_version 503157 (0.0010) [2023-12-27 22:50:49,282][106225] Updated weights for policy 1, policy_version 503167 (0.0012) [2023-12-27 22:50:49,350][106225] Updated weights for policy 1, policy_version 503177 (0.0012) [2023-12-27 22:50:49,720][106226] Updated weights for policy 0, policy_version 501858 (0.0008) [2023-12-27 22:50:49,781][106226] Updated weights for policy 0, policy_version 501868 (0.0009) [2023-12-27 22:50:49,842][106226] Updated weights for policy 0, policy_version 501878 (0.0008) [2023-12-27 22:50:50,137][106225] Updated weights for policy 1, policy_version 503187 (0.0009) [2023-12-27 22:50:50,192][106225] Updated weights for policy 1, policy_version 503197 (0.0008) [2023-12-27 22:50:50,255][106225] Updated weights for policy 1, policy_version 503207 (0.0008) [2023-12-27 22:50:50,598][106226] Updated weights for policy 0, policy_version 501888 (0.0008) [2023-12-27 22:50:50,658][106226] Updated weights for policy 0, policy_version 501898 (0.0011) [2023-12-27 22:50:50,721][106226] Updated weights for policy 0, policy_version 501908 (0.0009) [2023-12-27 22:50:50,970][106225] Updated weights for policy 1, policy_version 503217 (0.0008) [2023-12-27 22:50:51,036][106225] Updated weights for policy 1, policy_version 503227 (0.0007) [2023-12-27 22:50:51,096][106225] Updated weights for policy 1, policy_version 503237 (0.0008) [2023-12-27 22:50:51,163][106225] Updated weights for policy 1, policy_version 503247 (0.0008) [2023-12-27 22:50:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 257384448. Throughput: 0: 9967.8, 1: 9806.7. Samples: 257390848. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:51,175][105115] Avg episode reward: [(0, '-4.967'), (1, '-5.603')] [2023-12-27 22:50:51,476][106226] Updated weights for policy 0, policy_version 501918 (0.0009) [2023-12-27 22:50:51,547][106226] Updated weights for policy 0, policy_version 501928 (0.0011) [2023-12-27 22:50:51,612][106226] Updated weights for policy 0, policy_version 501938 (0.0011) [2023-12-27 22:50:51,900][106225] Updated weights for policy 1, policy_version 503257 (0.0008) [2023-12-27 22:50:51,970][106225] Updated weights for policy 1, policy_version 503267 (0.0008) [2023-12-27 22:50:52,029][106225] Updated weights for policy 1, policy_version 503277 (0.0008) [2023-12-27 22:50:52,358][106226] Updated weights for policy 0, policy_version 501948 (0.0009) [2023-12-27 22:50:52,416][106226] Updated weights for policy 0, policy_version 501958 (0.0006) [2023-12-27 22:50:52,466][106226] Updated weights for policy 0, policy_version 501968 (0.0009) [2023-12-27 22:50:52,817][106225] Updated weights for policy 1, policy_version 503287 (0.0008) [2023-12-27 22:50:52,875][106225] Updated weights for policy 1, policy_version 503297 (0.0008) [2023-12-27 22:50:52,927][106225] Updated weights for policy 1, policy_version 503307 (0.0008) [2023-12-27 22:50:53,116][106226] Updated weights for policy 0, policy_version 501978 (0.0009) [2023-12-27 22:50:53,179][106226] Updated weights for policy 0, policy_version 501988 (0.0008) [2023-12-27 22:50:53,246][106226] Updated weights for policy 0, policy_version 501998 (0.0005) [2023-12-27 22:50:53,306][106226] Updated weights for policy 0, policy_version 502008 (0.0008) [2023-12-27 22:50:53,698][106225] Updated weights for policy 1, policy_version 503317 (0.0009) [2023-12-27 22:50:53,752][106225] Updated weights for policy 1, policy_version 503327 (0.0010) [2023-12-27 22:50:53,805][106225] Updated weights for policy 1, policy_version 503337 (0.0010) [2023-12-27 22:50:53,949][106226] Updated weights for policy 0, policy_version 502018 (0.0008) [2023-12-27 22:50:53,996][106226] Updated weights for policy 0, policy_version 502028 (0.0008) [2023-12-27 22:50:54,046][106226] Updated weights for policy 0, policy_version 502038 (0.0007) [2023-12-27 22:50:54,520][106225] Updated weights for policy 1, policy_version 503347 (0.0009) [2023-12-27 22:50:54,573][106225] Updated weights for policy 1, policy_version 503357 (0.0009) [2023-12-27 22:50:54,619][106225] Updated weights for policy 1, policy_version 503367 (0.0008) [2023-12-27 22:50:54,683][106226] Updated weights for policy 0, policy_version 502048 (0.0007) [2023-12-27 22:50:54,746][106226] Updated weights for policy 0, policy_version 502058 (0.0009) [2023-12-27 22:50:54,809][106226] Updated weights for policy 0, policy_version 502068 (0.0008) [2023-12-27 22:50:55,354][106225] Updated weights for policy 1, policy_version 503377 (0.0007) [2023-12-27 22:50:55,413][106225] Updated weights for policy 1, policy_version 503387 (0.0010) [2023-12-27 22:50:55,463][106225] Updated weights for policy 1, policy_version 503397 (0.0010) [2023-12-27 22:50:55,522][106225] Updated weights for policy 1, policy_version 503407 (0.0010) [2023-12-27 22:50:55,532][106226] Updated weights for policy 0, policy_version 502078 (0.0006) [2023-12-27 22:50:55,583][106226] Updated weights for policy 0, policy_version 502088 (0.0008) [2023-12-27 22:50:55,628][106226] Updated weights for policy 0, policy_version 502098 (0.0007) [2023-12-27 22:50:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 257474560. Throughput: 0: 9937.0, 1: 9764.4. Samples: 257448092. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:50:56,176][105115] Avg episode reward: [(0, '-4.983'), (1, '-5.598')] [2023-12-27 22:50:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000502104_128573440.pth... [2023-12-27 22:50:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000500920_128270336.pth [2023-12-27 22:50:56,241][106225] Updated weights for policy 1, policy_version 503417 (0.0010) [2023-12-27 22:50:56,291][106225] Updated weights for policy 1, policy_version 503427 (0.0010) [2023-12-27 22:50:56,346][106225] Updated weights for policy 1, policy_version 503437 (0.0010) [2023-12-27 22:50:56,358][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000503440_128909312.pth... [2023-12-27 22:50:56,361][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000502288_128614400.pth [2023-12-27 22:50:56,367][106226] Updated weights for policy 0, policy_version 502108 (0.0006) [2023-12-27 22:50:56,418][106226] Updated weights for policy 0, policy_version 502118 (0.0008) [2023-12-27 22:50:56,471][106226] Updated weights for policy 0, policy_version 502128 (0.0007) [2023-12-27 22:50:57,064][106225] Updated weights for policy 1, policy_version 503447 (0.0010) [2023-12-27 22:50:57,111][106225] Updated weights for policy 1, policy_version 503457 (0.0009) [2023-12-27 22:50:57,156][106225] Updated weights for policy 1, policy_version 503467 (0.0009) [2023-12-27 22:50:57,204][106226] Updated weights for policy 0, policy_version 502138 (0.0008) [2023-12-27 22:50:57,272][106226] Updated weights for policy 0, policy_version 502148 (0.0008) [2023-12-27 22:50:57,337][106226] Updated weights for policy 0, policy_version 502158 (0.0007) [2023-12-27 22:50:57,396][106226] Updated weights for policy 0, policy_version 502168 (0.0009) [2023-12-27 22:50:57,846][106225] Updated weights for policy 1, policy_version 503477 (0.0007) [2023-12-27 22:50:57,905][106225] Updated weights for policy 1, policy_version 503487 (0.0010) [2023-12-27 22:50:57,968][106225] Updated weights for policy 1, policy_version 503497 (0.0010) [2023-12-27 22:50:58,117][106226] Updated weights for policy 0, policy_version 502178 (0.0006) [2023-12-27 22:50:58,173][106226] Updated weights for policy 0, policy_version 502188 (0.0008) [2023-12-27 22:50:58,242][106226] Updated weights for policy 0, policy_version 502198 (0.0008) [2023-12-27 22:50:58,687][106225] Updated weights for policy 1, policy_version 503507 (0.0009) [2023-12-27 22:50:58,757][106225] Updated weights for policy 1, policy_version 503517 (0.0007) [2023-12-27 22:50:58,828][106225] Updated weights for policy 1, policy_version 503527 (0.0008) [2023-12-27 22:50:59,050][106226] Updated weights for policy 0, policy_version 502208 (0.0008) [2023-12-27 22:50:59,116][106226] Updated weights for policy 0, policy_version 502218 (0.0008) [2023-12-27 22:50:59,175][106226] Updated weights for policy 0, policy_version 502228 (0.0007) [2023-12-27 22:50:59,547][106225] Updated weights for policy 1, policy_version 503537 (0.0009) [2023-12-27 22:50:59,602][106225] Updated weights for policy 1, policy_version 503547 (0.0008) [2023-12-27 22:50:59,662][106225] Updated weights for policy 1, policy_version 503557 (0.0008) [2023-12-27 22:50:59,718][106225] Updated weights for policy 1, policy_version 503567 (0.0008) [2023-12-27 22:50:59,881][106226] Updated weights for policy 0, policy_version 502238 (0.0008) [2023-12-27 22:50:59,943][106226] Updated weights for policy 0, policy_version 502248 (0.0008) [2023-12-27 22:51:00,003][106226] Updated weights for policy 0, policy_version 502258 (0.0008) [2023-12-27 22:51:00,408][106225] Updated weights for policy 1, policy_version 503577 (0.0008) [2023-12-27 22:51:00,461][106225] Updated weights for policy 1, policy_version 503587 (0.0008) [2023-12-27 22:51:00,511][106225] Updated weights for policy 1, policy_version 503598 (0.0010) [2023-12-27 22:51:00,619][106226] Updated weights for policy 0, policy_version 502268 (0.0008) [2023-12-27 22:51:00,664][106226] Updated weights for policy 0, policy_version 502278 (0.0008) [2023-12-27 22:51:00,719][106226] Updated weights for policy 0, policy_version 502288 (0.0008) [2023-12-27 22:51:01,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 257572864. Throughput: 0: 9920.8, 1: 9771.0. Samples: 257562916. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:01,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.441')] [2023-12-27 22:51:01,264][106225] Updated weights for policy 1, policy_version 503608 (0.0007) [2023-12-27 22:51:01,313][106225] Updated weights for policy 1, policy_version 503618 (0.0008) [2023-12-27 22:51:01,387][106225] Updated weights for policy 1, policy_version 503628 (0.0009) [2023-12-27 22:51:01,459][106226] Updated weights for policy 0, policy_version 502298 (0.0008) [2023-12-27 22:51:01,509][106226] Updated weights for policy 0, policy_version 502308 (0.0008) [2023-12-27 22:51:01,559][106226] Updated weights for policy 0, policy_version 502318 (0.0009) [2023-12-27 22:51:01,621][106226] Updated weights for policy 0, policy_version 502328 (0.0008) [2023-12-27 22:51:02,129][106225] Updated weights for policy 1, policy_version 503638 (0.0008) [2023-12-27 22:51:02,186][106225] Updated weights for policy 1, policy_version 503648 (0.0008) [2023-12-27 22:51:02,250][106225] Updated weights for policy 1, policy_version 503658 (0.0008) [2023-12-27 22:51:02,423][106226] Updated weights for policy 0, policy_version 502338 (0.0006) [2023-12-27 22:51:02,483][106226] Updated weights for policy 0, policy_version 502348 (0.0006) [2023-12-27 22:51:02,544][106226] Updated weights for policy 0, policy_version 502358 (0.0005) [2023-12-27 22:51:02,911][106225] Updated weights for policy 1, policy_version 503668 (0.0007) [2023-12-27 22:51:02,965][106225] Updated weights for policy 1, policy_version 503678 (0.0008) [2023-12-27 22:51:03,011][106225] Updated weights for policy 1, policy_version 503688 (0.0009) [2023-12-27 22:51:03,059][106226] Updated weights for policy 0, policy_version 502368 (0.0009) [2023-12-27 22:51:03,109][106226] Updated weights for policy 0, policy_version 502378 (0.0010) [2023-12-27 22:51:03,163][106226] Updated weights for policy 0, policy_version 502388 (0.0007) [2023-12-27 22:51:03,677][106225] Updated weights for policy 1, policy_version 503698 (0.0006) [2023-12-27 22:51:03,729][106225] Updated weights for policy 1, policy_version 503708 (0.0010) [2023-12-27 22:51:03,778][106225] Updated weights for policy 1, policy_version 503718 (0.0009) [2023-12-27 22:51:03,825][106225] Updated weights for policy 1, policy_version 503728 (0.0007) [2023-12-27 22:51:03,880][106226] Updated weights for policy 0, policy_version 502398 (0.0007) [2023-12-27 22:51:03,944][106226] Updated weights for policy 0, policy_version 502408 (0.0006) [2023-12-27 22:51:04,009][106226] Updated weights for policy 0, policy_version 502418 (0.0007) [2023-12-27 22:51:04,568][106225] Updated weights for policy 1, policy_version 503738 (0.0006) [2023-12-27 22:51:04,628][106225] Updated weights for policy 1, policy_version 503748 (0.0006) [2023-12-27 22:51:04,686][106225] Updated weights for policy 1, policy_version 503758 (0.0006) [2023-12-27 22:51:04,719][106226] Updated weights for policy 0, policy_version 502428 (0.0011) [2023-12-27 22:51:04,780][106226] Updated weights for policy 0, policy_version 502438 (0.0010) [2023-12-27 22:51:04,836][106226] Updated weights for policy 0, policy_version 502448 (0.0011) [2023-12-27 22:51:05,338][106225] Updated weights for policy 1, policy_version 503768 (0.0007) [2023-12-27 22:51:05,392][106225] Updated weights for policy 1, policy_version 503778 (0.0006) [2023-12-27 22:51:05,447][106225] Updated weights for policy 1, policy_version 503788 (0.0005) [2023-12-27 22:51:05,496][106226] Updated weights for policy 0, policy_version 502458 (0.0009) [2023-12-27 22:51:05,570][106226] Updated weights for policy 0, policy_version 502468 (0.0005) [2023-12-27 22:51:05,635][106226] Updated weights for policy 0, policy_version 502478 (0.0005) [2023-12-27 22:51:05,697][106226] Updated weights for policy 0, policy_version 502488 (0.0009) [2023-12-27 22:51:06,089][106225] Updated weights for policy 1, policy_version 503798 (0.0007) [2023-12-27 22:51:06,153][106225] Updated weights for policy 1, policy_version 503808 (0.0008) [2023-12-27 22:51:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 257671168. Throughput: 0: 10071.3, 1: 9789.1. Samples: 257685312. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:06,175][105115] Avg episode reward: [(0, '-5.105'), (1, '-5.410')] [2023-12-27 22:51:06,218][106225] Updated weights for policy 1, policy_version 503818 (0.0009) [2023-12-27 22:51:06,340][106226] Updated weights for policy 0, policy_version 502498 (0.0010) [2023-12-27 22:51:06,401][106226] Updated weights for policy 0, policy_version 502508 (0.0008) [2023-12-27 22:51:06,463][106226] Updated weights for policy 0, policy_version 502518 (0.0007) [2023-12-27 22:51:07,012][106225] Updated weights for policy 1, policy_version 503828 (0.0008) [2023-12-27 22:51:07,067][106225] Updated weights for policy 1, policy_version 503838 (0.0008) [2023-12-27 22:51:07,135][106225] Updated weights for policy 1, policy_version 503848 (0.0008) [2023-12-27 22:51:07,192][106226] Updated weights for policy 0, policy_version 502528 (0.0010) [2023-12-27 22:51:07,254][106226] Updated weights for policy 0, policy_version 502538 (0.0011) [2023-12-27 22:51:07,305][106226] Updated weights for policy 0, policy_version 502548 (0.0010) [2023-12-27 22:51:07,840][106225] Updated weights for policy 1, policy_version 503858 (0.0008) [2023-12-27 22:51:07,893][106225] Updated weights for policy 1, policy_version 503868 (0.0010) [2023-12-27 22:51:07,897][106226] Updated weights for policy 0, policy_version 502558 (0.0007) [2023-12-27 22:51:07,947][106225] Updated weights for policy 1, policy_version 503878 (0.0010) [2023-12-27 22:51:07,953][106226] Updated weights for policy 0, policy_version 502568 (0.0005) [2023-12-27 22:51:08,004][106225] Updated weights for policy 1, policy_version 503888 (0.0010) [2023-12-27 22:51:08,016][106226] Updated weights for policy 0, policy_version 502578 (0.0011) [2023-12-27 22:51:08,673][106226] Updated weights for policy 0, policy_version 502588 (0.0010) [2023-12-27 22:51:08,728][106226] Updated weights for policy 0, policy_version 502598 (0.0011) [2023-12-27 22:51:08,771][106225] Updated weights for policy 1, policy_version 503898 (0.0010) [2023-12-27 22:51:08,790][106226] Updated weights for policy 0, policy_version 502608 (0.0011) [2023-12-27 22:51:08,833][106225] Updated weights for policy 1, policy_version 503908 (0.0007) [2023-12-27 22:51:08,893][106225] Updated weights for policy 1, policy_version 503918 (0.0008) [2023-12-27 22:51:09,452][106226] Updated weights for policy 0, policy_version 502618 (0.0010) [2023-12-27 22:51:09,513][106226] Updated weights for policy 0, policy_version 502628 (0.0008) [2023-12-27 22:51:09,570][106226] Updated weights for policy 0, policy_version 502638 (0.0008) [2023-12-27 22:51:09,630][106226] Updated weights for policy 0, policy_version 502648 (0.0008) [2023-12-27 22:51:09,630][106225] Updated weights for policy 1, policy_version 503928 (0.0010) [2023-12-27 22:51:09,695][106225] Updated weights for policy 1, policy_version 503938 (0.0010) [2023-12-27 22:51:09,761][106225] Updated weights for policy 1, policy_version 503948 (0.0008) [2023-12-27 22:51:10,461][106226] Updated weights for policy 0, policy_version 502658 (0.0007) [2023-12-27 22:51:10,510][106225] Updated weights for policy 1, policy_version 503958 (0.0010) [2023-12-27 22:51:10,534][106226] Updated weights for policy 0, policy_version 502668 (0.0006) [2023-12-27 22:51:10,577][106225] Updated weights for policy 1, policy_version 503968 (0.0005) [2023-12-27 22:51:10,601][106226] Updated weights for policy 0, policy_version 502678 (0.0008) [2023-12-27 22:51:10,647][106225] Updated weights for policy 1, policy_version 503978 (0.0005) [2023-12-27 22:51:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 257769472. Throughput: 0: 10125.2, 1: 9795.1. Samples: 257744776. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:11,175][105115] Avg episode reward: [(0, '-5.098'), (1, '-5.328')] [2023-12-27 22:51:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000503984_129048576.pth... [2023-12-27 22:51:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000502864_128761856.pth [2023-12-27 22:51:11,216][106226] Updated weights for policy 0, policy_version 502688 (0.0008) [2023-12-27 22:51:11,276][106226] Updated weights for policy 0, policy_version 502698 (0.0008) [2023-12-27 22:51:11,318][106225] Updated weights for policy 1, policy_version 503988 (0.0011) [2023-12-27 22:51:11,341][106226] Updated weights for policy 0, policy_version 502708 (0.0007) [2023-12-27 22:51:11,373][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000502712_128729088.pth... [2023-12-27 22:51:11,378][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000501528_128425984.pth [2023-12-27 22:51:11,392][106225] Updated weights for policy 1, policy_version 503998 (0.0010) [2023-12-27 22:51:11,462][106225] Updated weights for policy 1, policy_version 504008 (0.0010) [2023-12-27 22:51:12,187][106226] Updated weights for policy 0, policy_version 502718 (0.0007) [2023-12-27 22:51:12,225][106225] Updated weights for policy 1, policy_version 504018 (0.0009) [2023-12-27 22:51:12,252][106226] Updated weights for policy 0, policy_version 502728 (0.0008) [2023-12-27 22:51:12,293][106225] Updated weights for policy 1, policy_version 504028 (0.0011) [2023-12-27 22:51:12,316][106226] Updated weights for policy 0, policy_version 502738 (0.0009) [2023-12-27 22:51:12,359][106225] Updated weights for policy 1, policy_version 504038 (0.0011) [2023-12-27 22:51:12,418][106225] Updated weights for policy 1, policy_version 504048 (0.0010) [2023-12-27 22:51:12,983][106226] Updated weights for policy 0, policy_version 502748 (0.0008) [2023-12-27 22:51:13,034][106226] Updated weights for policy 0, policy_version 502758 (0.0007) [2023-12-27 22:51:13,083][106226] Updated weights for policy 0, policy_version 502768 (0.0008) [2023-12-27 22:51:13,156][106225] Updated weights for policy 1, policy_version 504058 (0.0010) [2023-12-27 22:51:13,208][106225] Updated weights for policy 1, policy_version 504068 (0.0010) [2023-12-27 22:51:13,265][106225] Updated weights for policy 1, policy_version 504078 (0.0010) [2023-12-27 22:51:13,872][106226] Updated weights for policy 0, policy_version 502778 (0.0007) [2023-12-27 22:51:13,884][106225] Updated weights for policy 1, policy_version 504088 (0.0009) [2023-12-27 22:51:13,927][106226] Updated weights for policy 0, policy_version 502788 (0.0006) [2023-12-27 22:51:13,943][106225] Updated weights for policy 1, policy_version 504098 (0.0010) [2023-12-27 22:51:13,987][106226] Updated weights for policy 0, policy_version 502798 (0.0006) [2023-12-27 22:51:14,006][106225] Updated weights for policy 1, policy_version 504108 (0.0010) [2023-12-27 22:51:14,044][106226] Updated weights for policy 0, policy_version 502808 (0.0008) [2023-12-27 22:51:14,662][106226] Updated weights for policy 0, policy_version 502818 (0.0005) [2023-12-27 22:51:14,708][106225] Updated weights for policy 1, policy_version 504118 (0.0010) [2023-12-27 22:51:14,726][106226] Updated weights for policy 0, policy_version 502828 (0.0007) [2023-12-27 22:51:14,768][106225] Updated weights for policy 1, policy_version 504128 (0.0010) [2023-12-27 22:51:14,794][106226] Updated weights for policy 0, policy_version 502838 (0.0008) [2023-12-27 22:51:14,837][106225] Updated weights for policy 1, policy_version 504139 (0.0007) [2023-12-27 22:51:15,461][106226] Updated weights for policy 0, policy_version 502848 (0.0008) [2023-12-27 22:51:15,508][106225] Updated weights for policy 1, policy_version 504149 (0.0006) [2023-12-27 22:51:15,515][106226] Updated weights for policy 0, policy_version 502858 (0.0008) [2023-12-27 22:51:15,568][106225] Updated weights for policy 1, policy_version 504159 (0.0006) [2023-12-27 22:51:15,574][106226] Updated weights for policy 0, policy_version 502868 (0.0008) [2023-12-27 22:51:15,624][106225] Updated weights for policy 1, policy_version 504169 (0.0007) [2023-12-27 22:51:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 257867776. Throughput: 0: 9978.1, 1: 9758.5. Samples: 257860656. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:16,175][105115] Avg episode reward: [(0, '-5.024'), (1, '-5.424')] [2023-12-27 22:51:16,199][106225] Updated weights for policy 1, policy_version 504179 (0.0006) [2023-12-27 22:51:16,246][106225] Updated weights for policy 1, policy_version 504189 (0.0005) [2023-12-27 22:51:16,296][106225] Updated weights for policy 1, policy_version 504199 (0.0007) [2023-12-27 22:51:16,375][106226] Updated weights for policy 0, policy_version 502878 (0.0007) [2023-12-27 22:51:16,432][106226] Updated weights for policy 0, policy_version 502888 (0.0009) [2023-12-27 22:51:16,482][106226] Updated weights for policy 0, policy_version 502898 (0.0007) [2023-12-27 22:51:17,028][106225] Updated weights for policy 1, policy_version 504209 (0.0010) [2023-12-27 22:51:17,081][106225] Updated weights for policy 1, policy_version 504219 (0.0010) [2023-12-27 22:51:17,120][106226] Updated weights for policy 0, policy_version 502908 (0.0006) [2023-12-27 22:51:17,129][106225] Updated weights for policy 1, policy_version 504229 (0.0010) [2023-12-27 22:51:17,179][106226] Updated weights for policy 0, policy_version 502918 (0.0005) [2023-12-27 22:51:17,187][106225] Updated weights for policy 1, policy_version 504239 (0.0010) [2023-12-27 22:51:17,238][106226] Updated weights for policy 0, policy_version 502928 (0.0010) [2023-12-27 22:51:17,921][106225] Updated weights for policy 1, policy_version 504249 (0.0010) [2023-12-27 22:51:17,924][106226] Updated weights for policy 0, policy_version 502938 (0.0010) [2023-12-27 22:51:17,974][106225] Updated weights for policy 1, policy_version 504259 (0.0010) [2023-12-27 22:51:17,978][106226] Updated weights for policy 0, policy_version 502948 (0.0011) [2023-12-27 22:51:18,024][106225] Updated weights for policy 1, policy_version 504269 (0.0009) [2023-12-27 22:51:18,039][106226] Updated weights for policy 0, policy_version 502958 (0.0011) [2023-12-27 22:51:18,106][106226] Updated weights for policy 0, policy_version 502968 (0.0010) [2023-12-27 22:51:18,638][106225] Updated weights for policy 1, policy_version 504279 (0.0007) [2023-12-27 22:51:18,694][106225] Updated weights for policy 1, policy_version 504289 (0.0007) [2023-12-27 22:51:18,741][106225] Updated weights for policy 1, policy_version 504299 (0.0005) [2023-12-27 22:51:18,841][106226] Updated weights for policy 0, policy_version 502978 (0.0011) [2023-12-27 22:51:18,899][106226] Updated weights for policy 0, policy_version 502988 (0.0010) [2023-12-27 22:51:18,964][106226] Updated weights for policy 0, policy_version 502998 (0.0010) [2023-12-27 22:51:19,423][106225] Updated weights for policy 1, policy_version 504309 (0.0008) [2023-12-27 22:51:19,488][106225] Updated weights for policy 1, policy_version 504319 (0.0008) [2023-12-27 22:51:19,558][106225] Updated weights for policy 1, policy_version 504329 (0.0008) [2023-12-27 22:51:19,648][106226] Updated weights for policy 0, policy_version 503008 (0.0007) [2023-12-27 22:51:19,711][106226] Updated weights for policy 0, policy_version 503018 (0.0007) [2023-12-27 22:51:19,775][106226] Updated weights for policy 0, policy_version 503028 (0.0009) [2023-12-27 22:51:20,265][106225] Updated weights for policy 1, policy_version 504339 (0.0008) [2023-12-27 22:51:20,325][106225] Updated weights for policy 1, policy_version 504349 (0.0008) [2023-12-27 22:51:20,394][106225] Updated weights for policy 1, policy_version 504359 (0.0009) [2023-12-27 22:51:20,540][106226] Updated weights for policy 0, policy_version 503038 (0.0009) [2023-12-27 22:51:20,612][106226] Updated weights for policy 0, policy_version 503048 (0.0008) [2023-12-27 22:51:20,678][106226] Updated weights for policy 0, policy_version 503058 (0.0009) [2023-12-27 22:51:21,140][106225] Updated weights for policy 1, policy_version 504369 (0.0009) [2023-12-27 22:51:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 257966080. Throughput: 0: 9832.6, 1: 9784.8. Samples: 257978328. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:21,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-5.512')] [2023-12-27 22:51:21,203][106225] Updated weights for policy 1, policy_version 504379 (0.0008) [2023-12-27 22:51:21,270][106225] Updated weights for policy 1, policy_version 504389 (0.0009) [2023-12-27 22:51:21,321][106225] Updated weights for policy 1, policy_version 504399 (0.0009) [2023-12-27 22:51:21,470][106226] Updated weights for policy 0, policy_version 503068 (0.0009) [2023-12-27 22:51:21,525][106226] Updated weights for policy 0, policy_version 503078 (0.0008) [2023-12-27 22:51:21,587][106226] Updated weights for policy 0, policy_version 503088 (0.0008) [2023-12-27 22:51:22,106][106225] Updated weights for policy 1, policy_version 504409 (0.0008) [2023-12-27 22:51:22,170][106225] Updated weights for policy 1, policy_version 504419 (0.0007) [2023-12-27 22:51:22,241][106225] Updated weights for policy 1, policy_version 504429 (0.0005) [2023-12-27 22:51:22,261][106226] Updated weights for policy 0, policy_version 503098 (0.0008) [2023-12-27 22:51:22,334][106226] Updated weights for policy 0, policy_version 503108 (0.0009) [2023-12-27 22:51:22,406][106226] Updated weights for policy 0, policy_version 503118 (0.0006) [2023-12-27 22:51:22,476][106226] Updated weights for policy 0, policy_version 503128 (0.0006) [2023-12-27 22:51:22,984][106225] Updated weights for policy 1, policy_version 504439 (0.0008) [2023-12-27 22:51:23,053][106225] Updated weights for policy 1, policy_version 504449 (0.0009) [2023-12-27 22:51:23,110][106226] Updated weights for policy 0, policy_version 503138 (0.0006) [2023-12-27 22:51:23,118][106225] Updated weights for policy 1, policy_version 504459 (0.0008) [2023-12-27 22:51:23,163][106226] Updated weights for policy 0, policy_version 503148 (0.0006) [2023-12-27 22:51:23,212][106226] Updated weights for policy 0, policy_version 503158 (0.0005) [2023-12-27 22:51:23,785][106226] Updated weights for policy 0, policy_version 503168 (0.0008) [2023-12-27 22:51:23,795][106225] Updated weights for policy 1, policy_version 504469 (0.0007) [2023-12-27 22:51:23,844][106226] Updated weights for policy 0, policy_version 503178 (0.0008) [2023-12-27 22:51:23,851][106225] Updated weights for policy 1, policy_version 504479 (0.0005) [2023-12-27 22:51:23,902][106226] Updated weights for policy 0, policy_version 503188 (0.0008) [2023-12-27 22:51:23,903][106225] Updated weights for policy 1, policy_version 504489 (0.0005) [2023-12-27 22:51:24,548][106226] Updated weights for policy 0, policy_version 503198 (0.0007) [2023-12-27 22:51:24,577][106225] Updated weights for policy 1, policy_version 504499 (0.0007) [2023-12-27 22:51:24,601][106226] Updated weights for policy 0, policy_version 503208 (0.0008) [2023-12-27 22:51:24,627][106225] Updated weights for policy 1, policy_version 504509 (0.0010) [2023-12-27 22:51:24,647][106226] Updated weights for policy 0, policy_version 503218 (0.0009) [2023-12-27 22:51:24,677][106225] Updated weights for policy 1, policy_version 504519 (0.0010) [2023-12-27 22:51:25,287][106226] Updated weights for policy 0, policy_version 503228 (0.0010) [2023-12-27 22:51:25,338][106226] Updated weights for policy 0, policy_version 503238 (0.0010) [2023-12-27 22:51:25,382][106225] Updated weights for policy 1, policy_version 504529 (0.0010) [2023-12-27 22:51:25,386][106226] Updated weights for policy 0, policy_version 503248 (0.0011) [2023-12-27 22:51:25,436][106225] Updated weights for policy 1, policy_version 504539 (0.0010) [2023-12-27 22:51:25,500][106225] Updated weights for policy 1, policy_version 504549 (0.0006) [2023-12-27 22:51:25,561][106225] Updated weights for policy 1, policy_version 504559 (0.0005) [2023-12-27 22:51:25,957][106226] Updated weights for policy 0, policy_version 503258 (0.0006) [2023-12-27 22:51:26,017][106226] Updated weights for policy 0, policy_version 503268 (0.0006) [2023-12-27 22:51:26,073][106226] Updated weights for policy 0, policy_version 503278 (0.0010) [2023-12-27 22:51:26,139][106226] Updated weights for policy 0, policy_version 503288 (0.0011) [2023-12-27 22:51:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19934.0, 300 sec: 19799.7). Total num frames: 258072576. Throughput: 0: 9864.3, 1: 9711.5. Samples: 258037224. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:26,175][105115] Avg episode reward: [(0, '-5.264'), (1, '-5.413')] [2023-12-27 22:51:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000503288_128876544.pth... [2023-12-27 22:51:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000504560_129196032.pth... [2023-12-27 22:51:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000502104_128573440.pth [2023-12-27 22:51:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000503440_128909312.pth [2023-12-27 22:51:26,253][106225] Updated weights for policy 1, policy_version 504569 (0.0010) [2023-12-27 22:51:26,316][106225] Updated weights for policy 1, policy_version 504579 (0.0010) [2023-12-27 22:51:26,382][106225] Updated weights for policy 1, policy_version 504589 (0.0010) [2023-12-27 22:51:26,812][106226] Updated weights for policy 0, policy_version 503298 (0.0008) [2023-12-27 22:51:26,876][106226] Updated weights for policy 0, policy_version 503308 (0.0008) [2023-12-27 22:51:26,943][106226] Updated weights for policy 0, policy_version 503318 (0.0008) [2023-12-27 22:51:27,071][106225] Updated weights for policy 1, policy_version 504599 (0.0010) [2023-12-27 22:51:27,120][106225] Updated weights for policy 1, policy_version 504609 (0.0010) [2023-12-27 22:51:27,173][106225] Updated weights for policy 1, policy_version 504619 (0.0010) [2023-12-27 22:51:27,621][106226] Updated weights for policy 0, policy_version 503328 (0.0007) [2023-12-27 22:51:27,664][106226] Updated weights for policy 0, policy_version 503338 (0.0008) [2023-12-27 22:51:27,727][106226] Updated weights for policy 0, policy_version 503348 (0.0008) [2023-12-27 22:51:27,895][106225] Updated weights for policy 1, policy_version 504629 (0.0010) [2023-12-27 22:51:27,954][106225] Updated weights for policy 1, policy_version 504639 (0.0010) [2023-12-27 22:51:28,013][106225] Updated weights for policy 1, policy_version 504649 (0.0010) [2023-12-27 22:51:28,380][106226] Updated weights for policy 0, policy_version 503358 (0.0008) [2023-12-27 22:51:28,442][106226] Updated weights for policy 0, policy_version 503368 (0.0008) [2023-12-27 22:51:28,501][106226] Updated weights for policy 0, policy_version 503378 (0.0008) [2023-12-27 22:51:28,680][106225] Updated weights for policy 1, policy_version 504659 (0.0010) [2023-12-27 22:51:28,733][106225] Updated weights for policy 1, policy_version 504669 (0.0010) [2023-12-27 22:51:28,787][106225] Updated weights for policy 1, policy_version 504679 (0.0010) [2023-12-27 22:51:29,204][106226] Updated weights for policy 0, policy_version 503388 (0.0008) [2023-12-27 22:51:29,273][106226] Updated weights for policy 0, policy_version 503398 (0.0009) [2023-12-27 22:51:29,331][106226] Updated weights for policy 0, policy_version 503408 (0.0007) [2023-12-27 22:51:29,531][106225] Updated weights for policy 1, policy_version 504689 (0.0010) [2023-12-27 22:51:29,585][106225] Updated weights for policy 1, policy_version 504699 (0.0010) [2023-12-27 22:51:29,648][106225] Updated weights for policy 1, policy_version 504709 (0.0010) [2023-12-27 22:51:29,712][106225] Updated weights for policy 1, policy_version 504719 (0.0005) [2023-12-27 22:51:30,089][106226] Updated weights for policy 0, policy_version 503418 (0.0010) [2023-12-27 22:51:30,149][106226] Updated weights for policy 0, policy_version 503428 (0.0010) [2023-12-27 22:51:30,205][106226] Updated weights for policy 0, policy_version 503438 (0.0011) [2023-12-27 22:51:30,257][106226] Updated weights for policy 0, policy_version 503448 (0.0007) [2023-12-27 22:51:30,442][106225] Updated weights for policy 1, policy_version 504729 (0.0005) [2023-12-27 22:51:30,504][106225] Updated weights for policy 1, policy_version 504739 (0.0008) [2023-12-27 22:51:30,572][106225] Updated weights for policy 1, policy_version 504749 (0.0011) [2023-12-27 22:51:30,945][106226] Updated weights for policy 0, policy_version 503458 (0.0010) [2023-12-27 22:51:31,001][106226] Updated weights for policy 0, policy_version 503468 (0.0010) [2023-12-27 22:51:31,064][106226] Updated weights for policy 0, policy_version 503478 (0.0010) [2023-12-27 22:51:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 258170880. Throughput: 0: 9938.6, 1: 9765.1. Samples: 258159928. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:31,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-5.294')] [2023-12-27 22:51:31,209][106225] Updated weights for policy 1, policy_version 504759 (0.0010) [2023-12-27 22:51:31,269][106225] Updated weights for policy 1, policy_version 504769 (0.0010) [2023-12-27 22:51:31,331][106225] Updated weights for policy 1, policy_version 504779 (0.0010) [2023-12-27 22:51:31,807][106226] Updated weights for policy 0, policy_version 503488 (0.0008) [2023-12-27 22:51:31,873][106226] Updated weights for policy 0, policy_version 503498 (0.0008) [2023-12-27 22:51:31,934][106226] Updated weights for policy 0, policy_version 503508 (0.0008) [2023-12-27 22:51:32,075][106225] Updated weights for policy 1, policy_version 504789 (0.0010) [2023-12-27 22:51:32,139][106225] Updated weights for policy 1, policy_version 504799 (0.0010) [2023-12-27 22:51:32,195][106225] Updated weights for policy 1, policy_version 504809 (0.0010) [2023-12-27 22:51:32,658][106226] Updated weights for policy 0, policy_version 503518 (0.0008) [2023-12-27 22:51:32,714][106226] Updated weights for policy 0, policy_version 503528 (0.0007) [2023-12-27 22:51:32,760][106226] Updated weights for policy 0, policy_version 503538 (0.0008) [2023-12-27 22:51:32,886][106225] Updated weights for policy 1, policy_version 504819 (0.0008) [2023-12-27 22:51:32,932][106225] Updated weights for policy 1, policy_version 504829 (0.0005) [2023-12-27 22:51:32,975][106225] Updated weights for policy 1, policy_version 504839 (0.0005) [2023-12-27 22:51:33,520][106225] Updated weights for policy 1, policy_version 504849 (0.0005) [2023-12-27 22:51:33,572][106225] Updated weights for policy 1, policy_version 504859 (0.0006) [2023-12-27 22:51:33,576][106226] Updated weights for policy 0, policy_version 503548 (0.0007) [2023-12-27 22:51:33,625][106225] Updated weights for policy 1, policy_version 504869 (0.0006) [2023-12-27 22:51:33,628][106226] Updated weights for policy 0, policy_version 503558 (0.0005) [2023-12-27 22:51:33,686][106226] Updated weights for policy 0, policy_version 503568 (0.0005) [2023-12-27 22:51:33,686][106225] Updated weights for policy 1, policy_version 504879 (0.0005) [2023-12-27 22:51:34,288][106225] Updated weights for policy 1, policy_version 504889 (0.0008) [2023-12-27 22:51:34,334][106226] Updated weights for policy 0, policy_version 503578 (0.0006) [2023-12-27 22:51:34,352][106225] Updated weights for policy 1, policy_version 504899 (0.0006) [2023-12-27 22:51:34,397][106226] Updated weights for policy 0, policy_version 503588 (0.0008) [2023-12-27 22:51:34,414][106225] Updated weights for policy 1, policy_version 504909 (0.0007) [2023-12-27 22:51:34,460][106226] Updated weights for policy 0, policy_version 503598 (0.0008) [2023-12-27 22:51:34,515][106226] Updated weights for policy 0, policy_version 503608 (0.0008) [2023-12-27 22:51:35,034][106225] Updated weights for policy 1, policy_version 504919 (0.0008) [2023-12-27 22:51:35,081][106225] Updated weights for policy 1, policy_version 504929 (0.0008) [2023-12-27 22:51:35,133][106225] Updated weights for policy 1, policy_version 504939 (0.0008) [2023-12-27 22:51:35,259][106226] Updated weights for policy 0, policy_version 503618 (0.0008) [2023-12-27 22:51:35,316][106226] Updated weights for policy 0, policy_version 503628 (0.0008) [2023-12-27 22:51:35,378][106226] Updated weights for policy 0, policy_version 503638 (0.0009) [2023-12-27 22:51:35,802][106225] Updated weights for policy 1, policy_version 504949 (0.0008) [2023-12-27 22:51:35,864][106225] Updated weights for policy 1, policy_version 504959 (0.0005) [2023-12-27 22:51:35,922][106225] Updated weights for policy 1, policy_version 504969 (0.0005) [2023-12-27 22:51:36,167][106226] Updated weights for policy 0, policy_version 503648 (0.0008) [2023-12-27 22:51:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 258269184. Throughput: 0: 9888.9, 1: 9883.1. Samples: 258280588. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:36,175][105115] Avg episode reward: [(0, '-5.220'), (1, '-5.489')] [2023-12-27 22:51:36,229][106226] Updated weights for policy 0, policy_version 503658 (0.0008) [2023-12-27 22:51:36,287][106226] Updated weights for policy 0, policy_version 503668 (0.0009) [2023-12-27 22:51:36,566][106225] Updated weights for policy 1, policy_version 504979 (0.0007) [2023-12-27 22:51:36,622][106225] Updated weights for policy 1, policy_version 504989 (0.0008) [2023-12-27 22:51:36,675][106225] Updated weights for policy 1, policy_version 504999 (0.0008) [2023-12-27 22:51:37,050][106226] Updated weights for policy 0, policy_version 503678 (0.0009) [2023-12-27 22:51:37,115][106226] Updated weights for policy 0, policy_version 503688 (0.0007) [2023-12-27 22:51:37,184][106226] Updated weights for policy 0, policy_version 503698 (0.0009) [2023-12-27 22:51:37,369][106225] Updated weights for policy 1, policy_version 505009 (0.0008) [2023-12-27 22:51:37,432][106225] Updated weights for policy 1, policy_version 505019 (0.0011) [2023-12-27 22:51:37,483][106225] Updated weights for policy 1, policy_version 505029 (0.0010) [2023-12-27 22:51:37,533][106225] Updated weights for policy 1, policy_version 505039 (0.0010) [2023-12-27 22:51:37,760][106226] Updated weights for policy 0, policy_version 503708 (0.0008) [2023-12-27 22:51:37,832][106226] Updated weights for policy 0, policy_version 503718 (0.0006) [2023-12-27 22:51:37,898][106226] Updated weights for policy 0, policy_version 503728 (0.0008) [2023-12-27 22:51:38,191][106225] Updated weights for policy 1, policy_version 505049 (0.0006) [2023-12-27 22:51:38,252][106225] Updated weights for policy 1, policy_version 505059 (0.0009) [2023-12-27 22:51:38,312][106225] Updated weights for policy 1, policy_version 505069 (0.0010) [2023-12-27 22:51:38,576][106226] Updated weights for policy 0, policy_version 503738 (0.0010) [2023-12-27 22:51:38,634][106226] Updated weights for policy 0, policy_version 503748 (0.0011) [2023-12-27 22:51:38,699][106226] Updated weights for policy 0, policy_version 503758 (0.0011) [2023-12-27 22:51:38,751][106226] Updated weights for policy 0, policy_version 503768 (0.0007) [2023-12-27 22:51:38,994][106225] Updated weights for policy 1, policy_version 505079 (0.0010) [2023-12-27 22:51:39,056][106225] Updated weights for policy 1, policy_version 505089 (0.0010) [2023-12-27 22:51:39,123][106225] Updated weights for policy 1, policy_version 505099 (0.0011) [2023-12-27 22:51:39,526][106226] Updated weights for policy 0, policy_version 503778 (0.0008) [2023-12-27 22:51:39,594][106226] Updated weights for policy 0, policy_version 503788 (0.0006) [2023-12-27 22:51:39,650][106226] Updated weights for policy 0, policy_version 503798 (0.0007) [2023-12-27 22:51:39,863][106225] Updated weights for policy 1, policy_version 505109 (0.0011) [2023-12-27 22:51:39,924][106225] Updated weights for policy 1, policy_version 505119 (0.0007) [2023-12-27 22:51:39,990][106225] Updated weights for policy 1, policy_version 505129 (0.0009) [2023-12-27 22:51:40,340][106226] Updated weights for policy 0, policy_version 503808 (0.0006) [2023-12-27 22:51:40,410][106226] Updated weights for policy 0, policy_version 503818 (0.0008) [2023-12-27 22:51:40,484][106226] Updated weights for policy 0, policy_version 503828 (0.0009) [2023-12-27 22:51:40,686][106225] Updated weights for policy 1, policy_version 505139 (0.0009) [2023-12-27 22:51:40,747][106225] Updated weights for policy 1, policy_version 505149 (0.0010) [2023-12-27 22:51:40,810][106225] Updated weights for policy 1, policy_version 505159 (0.0010) [2023-12-27 22:51:41,175][106226] Updated weights for policy 0, policy_version 503838 (0.0008) [2023-12-27 22:51:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 258367488. Throughput: 0: 9899.4, 1: 9947.9. Samples: 258341220. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:41,175][105115] Avg episode reward: [(0, '-5.136'), (1, '-5.393')] [2023-12-27 22:51:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000505168_129351680.pth... [2023-12-27 22:51:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000503984_129048576.pth [2023-12-27 22:51:41,244][106226] Updated weights for policy 0, policy_version 503848 (0.0007) [2023-12-27 22:51:41,332][106226] Updated weights for policy 0, policy_version 503858 (0.0009) [2023-12-27 22:51:41,374][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000503864_129024000.pth... [2023-12-27 22:51:41,378][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000502712_128729088.pth [2023-12-27 22:51:41,569][106225] Updated weights for policy 1, policy_version 505169 (0.0010) [2023-12-27 22:51:41,647][106225] Updated weights for policy 1, policy_version 505179 (0.0009) [2023-12-27 22:51:41,709][106225] Updated weights for policy 1, policy_version 505189 (0.0008) [2023-12-27 22:51:41,780][106225] Updated weights for policy 1, policy_version 505199 (0.0010) [2023-12-27 22:51:42,073][106226] Updated weights for policy 0, policy_version 503868 (0.0009) [2023-12-27 22:51:42,132][106226] Updated weights for policy 0, policy_version 503878 (0.0008) [2023-12-27 22:51:42,202][106226] Updated weights for policy 0, policy_version 503888 (0.0008) [2023-12-27 22:51:42,505][106225] Updated weights for policy 1, policy_version 505209 (0.0009) [2023-12-27 22:51:42,565][106225] Updated weights for policy 1, policy_version 505219 (0.0008) [2023-12-27 22:51:42,626][106225] Updated weights for policy 1, policy_version 505229 (0.0009) [2023-12-27 22:51:42,901][106226] Updated weights for policy 0, policy_version 503898 (0.0008) [2023-12-27 22:51:42,961][106226] Updated weights for policy 0, policy_version 503908 (0.0009) [2023-12-27 22:51:43,026][106226] Updated weights for policy 0, policy_version 503918 (0.0010) [2023-12-27 22:51:43,079][106226] Updated weights for policy 0, policy_version 503928 (0.0010) [2023-12-27 22:51:43,406][106225] Updated weights for policy 1, policy_version 505239 (0.0007) [2023-12-27 22:51:43,465][106225] Updated weights for policy 1, policy_version 505249 (0.0008) [2023-12-27 22:51:43,531][106225] Updated weights for policy 1, policy_version 505259 (0.0008) [2023-12-27 22:51:43,753][106226] Updated weights for policy 0, policy_version 503938 (0.0008) [2023-12-27 22:51:43,814][106226] Updated weights for policy 0, policy_version 503948 (0.0010) [2023-12-27 22:51:43,869][106226] Updated weights for policy 0, policy_version 503958 (0.0006) [2023-12-27 22:51:44,147][106225] Updated weights for policy 1, policy_version 505269 (0.0006) [2023-12-27 22:51:44,205][106225] Updated weights for policy 1, policy_version 505279 (0.0005) [2023-12-27 22:51:44,259][106225] Updated weights for policy 1, policy_version 505289 (0.0008) [2023-12-27 22:51:44,634][106226] Updated weights for policy 0, policy_version 503968 (0.0008) [2023-12-27 22:51:44,692][106226] Updated weights for policy 0, policy_version 503978 (0.0008) [2023-12-27 22:51:44,758][106226] Updated weights for policy 0, policy_version 503988 (0.0007) [2023-12-27 22:51:44,899][106225] Updated weights for policy 1, policy_version 505299 (0.0009) [2023-12-27 22:51:44,961][106225] Updated weights for policy 1, policy_version 505309 (0.0008) [2023-12-27 22:51:45,024][106225] Updated weights for policy 1, policy_version 505319 (0.0008) [2023-12-27 22:51:45,509][106226] Updated weights for policy 0, policy_version 503998 (0.0008) [2023-12-27 22:51:45,569][106226] Updated weights for policy 0, policy_version 504008 (0.0009) [2023-12-27 22:51:45,625][106226] Updated weights for policy 0, policy_version 504018 (0.0009) [2023-12-27 22:51:45,760][106225] Updated weights for policy 1, policy_version 505329 (0.0008) [2023-12-27 22:51:45,824][106225] Updated weights for policy 1, policy_version 505339 (0.0008) [2023-12-27 22:51:45,887][106225] Updated weights for policy 1, policy_version 505349 (0.0010) [2023-12-27 22:51:45,935][106225] Updated weights for policy 1, policy_version 505359 (0.0010) [2023-12-27 22:51:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 258465792. Throughput: 0: 9884.5, 1: 9949.9. Samples: 258455460. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 22:51:46,175][105115] Avg episode reward: [(0, '-5.235'), (1, '-5.519')] [2023-12-27 22:51:46,359][106226] Updated weights for policy 0, policy_version 504028 (0.0008) [2023-12-27 22:51:46,410][106226] Updated weights for policy 0, policy_version 504038 (0.0008) [2023-12-27 22:51:46,465][106226] Updated weights for policy 0, policy_version 504048 (0.0008) [2023-12-27 22:51:46,648][106225] Updated weights for policy 1, policy_version 505369 (0.0011) [2023-12-27 22:51:46,713][106225] Updated weights for policy 1, policy_version 505379 (0.0009) [2023-12-27 22:51:46,770][106225] Updated weights for policy 1, policy_version 505389 (0.0007) [2023-12-27 22:51:47,262][106226] Updated weights for policy 0, policy_version 504058 (0.0008) [2023-12-27 22:51:47,319][106226] Updated weights for policy 0, policy_version 504068 (0.0008) [2023-12-27 22:51:47,373][106226] Updated weights for policy 0, policy_version 504078 (0.0008) [2023-12-27 22:51:47,389][106225] Updated weights for policy 1, policy_version 505399 (0.0005) [2023-12-27 22:51:47,433][106226] Updated weights for policy 0, policy_version 504088 (0.0008) [2023-12-27 22:51:47,433][106225] Updated weights for policy 1, policy_version 505409 (0.0005) [2023-12-27 22:51:47,486][106225] Updated weights for policy 1, policy_version 505419 (0.0005) [2023-12-27 22:51:48,119][106225] Updated weights for policy 1, policy_version 505429 (0.0008) [2023-12-27 22:51:48,119][106226] Updated weights for policy 0, policy_version 504098 (0.0009) [2023-12-27 22:51:48,165][106226] Updated weights for policy 0, policy_version 504108 (0.0007) [2023-12-27 22:51:48,184][106225] Updated weights for policy 1, policy_version 505439 (0.0009) [2023-12-27 22:51:48,212][106226] Updated weights for policy 0, policy_version 504118 (0.0006) [2023-12-27 22:51:48,236][106225] Updated weights for policy 1, policy_version 505449 (0.0010) [2023-12-27 22:51:48,974][106226] Updated weights for policy 0, policy_version 504128 (0.0007) [2023-12-27 22:51:48,977][106225] Updated weights for policy 1, policy_version 505459 (0.0009) [2023-12-27 22:51:49,034][106226] Updated weights for policy 0, policy_version 504138 (0.0007) [2023-12-27 22:51:49,038][106225] Updated weights for policy 1, policy_version 505469 (0.0006) [2023-12-27 22:51:49,083][106226] Updated weights for policy 0, policy_version 504148 (0.0008) [2023-12-27 22:51:49,094][106225] Updated weights for policy 1, policy_version 505479 (0.0006) [2023-12-27 22:51:49,754][106225] Updated weights for policy 1, policy_version 505489 (0.0006) [2023-12-27 22:51:49,790][106226] Updated weights for policy 0, policy_version 504158 (0.0008) [2023-12-27 22:51:49,800][106225] Updated weights for policy 1, policy_version 505499 (0.0006) [2023-12-27 22:51:49,858][106226] Updated weights for policy 0, policy_version 504168 (0.0008) [2023-12-27 22:51:49,871][106225] Updated weights for policy 1, policy_version 505509 (0.0008) [2023-12-27 22:51:49,924][106226] Updated weights for policy 0, policy_version 504178 (0.0008) [2023-12-27 22:51:49,936][106225] Updated weights for policy 1, policy_version 505519 (0.0009) [2023-12-27 22:51:50,570][106225] Updated weights for policy 1, policy_version 505529 (0.0007) [2023-12-27 22:51:50,636][106225] Updated weights for policy 1, policy_version 505539 (0.0010) [2023-12-27 22:51:50,698][106225] Updated weights for policy 1, policy_version 505549 (0.0010) [2023-12-27 22:51:50,702][106226] Updated weights for policy 0, policy_version 504188 (0.0010) [2023-12-27 22:51:50,767][106226] Updated weights for policy 0, policy_version 504198 (0.0008) [2023-12-27 22:51:50,829][106226] Updated weights for policy 0, policy_version 504208 (0.0007) [2023-12-27 22:51:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 258564096. Throughput: 0: 9747.7, 1: 9954.0. Samples: 258571892. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:51:51,175][105115] Avg episode reward: [(0, '-5.484'), (1, '-5.315')] [2023-12-27 22:51:51,455][106225] Updated weights for policy 1, policy_version 505559 (0.0011) [2023-12-27 22:51:51,516][106225] Updated weights for policy 1, policy_version 505569 (0.0010) [2023-12-27 22:51:51,553][106226] Updated weights for policy 0, policy_version 504218 (0.0008) [2023-12-27 22:51:51,571][106225] Updated weights for policy 1, policy_version 505579 (0.0008) [2023-12-27 22:51:51,610][106226] Updated weights for policy 0, policy_version 504228 (0.0009) [2023-12-27 22:51:51,679][106226] Updated weights for policy 0, policy_version 504238 (0.0007) [2023-12-27 22:51:51,740][106226] Updated weights for policy 0, policy_version 504248 (0.0008) [2023-12-27 22:51:52,308][106225] Updated weights for policy 1, policy_version 505589 (0.0007) [2023-12-27 22:51:52,373][106225] Updated weights for policy 1, policy_version 505599 (0.0009) [2023-12-27 22:51:52,434][106225] Updated weights for policy 1, policy_version 505609 (0.0009) [2023-12-27 22:51:52,496][106226] Updated weights for policy 0, policy_version 504258 (0.0007) [2023-12-27 22:51:52,551][106226] Updated weights for policy 0, policy_version 504268 (0.0008) [2023-12-27 22:51:52,608][106226] Updated weights for policy 0, policy_version 504278 (0.0009) [2023-12-27 22:51:53,171][106226] Updated weights for policy 0, policy_version 504288 (0.0006) [2023-12-27 22:51:53,229][106226] Updated weights for policy 0, policy_version 504298 (0.0005) [2023-12-27 22:51:53,261][106225] Updated weights for policy 1, policy_version 505619 (0.0008) [2023-12-27 22:51:53,282][106226] Updated weights for policy 0, policy_version 504308 (0.0005) [2023-12-27 22:51:53,319][106225] Updated weights for policy 1, policy_version 505629 (0.0008) [2023-12-27 22:51:53,371][106225] Updated weights for policy 1, policy_version 505639 (0.0008) [2023-12-27 22:51:53,936][106226] Updated weights for policy 0, policy_version 504318 (0.0006) [2023-12-27 22:51:53,991][106226] Updated weights for policy 0, policy_version 504328 (0.0006) [2023-12-27 22:51:54,055][106226] Updated weights for policy 0, policy_version 504338 (0.0005) [2023-12-27 22:51:54,111][106225] Updated weights for policy 1, policy_version 505649 (0.0008) [2023-12-27 22:51:54,168][106225] Updated weights for policy 1, policy_version 505659 (0.0008) [2023-12-27 22:51:54,219][106225] Updated weights for policy 1, policy_version 505669 (0.0008) [2023-12-27 22:51:54,272][106225] Updated weights for policy 1, policy_version 505679 (0.0008) [2023-12-27 22:51:54,609][106226] Updated weights for policy 0, policy_version 504348 (0.0007) [2023-12-27 22:51:54,657][106226] Updated weights for policy 0, policy_version 504358 (0.0008) [2023-12-27 22:51:54,703][106226] Updated weights for policy 0, policy_version 504368 (0.0008) [2023-12-27 22:51:55,035][106225] Updated weights for policy 1, policy_version 505689 (0.0008) [2023-12-27 22:51:55,091][106225] Updated weights for policy 1, policy_version 505699 (0.0006) [2023-12-27 22:51:55,140][106225] Updated weights for policy 1, policy_version 505709 (0.0009) [2023-12-27 22:51:55,418][106226] Updated weights for policy 0, policy_version 504378 (0.0007) [2023-12-27 22:51:55,467][106226] Updated weights for policy 0, policy_version 504388 (0.0010) [2023-12-27 22:51:55,516][106226] Updated weights for policy 0, policy_version 504398 (0.0010) [2023-12-27 22:51:55,577][106226] Updated weights for policy 0, policy_version 504408 (0.0006) [2023-12-27 22:51:55,867][106225] Updated weights for policy 1, policy_version 505719 (0.0010) [2023-12-27 22:51:55,916][106225] Updated weights for policy 1, policy_version 505729 (0.0010) [2023-12-27 22:51:55,965][106225] Updated weights for policy 1, policy_version 505739 (0.0008) [2023-12-27 22:51:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 258662400. Throughput: 0: 9763.0, 1: 9917.8. Samples: 258630416. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:51:56,176][105115] Avg episode reward: [(0, '-5.160'), (1, '-5.337')] [2023-12-27 22:51:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000504408_129163264.pth... [2023-12-27 22:51:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000505744_129499136.pth... [2023-12-27 22:51:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000504560_129196032.pth [2023-12-27 22:51:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000503288_128876544.pth [2023-12-27 22:51:56,318][106226] Updated weights for policy 0, policy_version 504418 (0.0008) [2023-12-27 22:51:56,377][106226] Updated weights for policy 0, policy_version 504428 (0.0008) [2023-12-27 22:51:56,442][106226] Updated weights for policy 0, policy_version 504438 (0.0008) [2023-12-27 22:51:56,563][106225] Updated weights for policy 1, policy_version 505749 (0.0008) [2023-12-27 22:51:56,630][106225] Updated weights for policy 1, policy_version 505759 (0.0010) [2023-12-27 22:51:56,696][106225] Updated weights for policy 1, policy_version 505769 (0.0009) [2023-12-27 22:51:57,018][106226] Updated weights for policy 0, policy_version 504448 (0.0006) [2023-12-27 22:51:57,080][106226] Updated weights for policy 0, policy_version 504458 (0.0005) [2023-12-27 22:51:57,137][106226] Updated weights for policy 0, policy_version 504468 (0.0005) [2023-12-27 22:51:57,390][106225] Updated weights for policy 1, policy_version 505779 (0.0010) [2023-12-27 22:51:57,442][106225] Updated weights for policy 1, policy_version 505789 (0.0010) [2023-12-27 22:51:57,491][106225] Updated weights for policy 1, policy_version 505799 (0.0010) [2023-12-27 22:51:57,779][106226] Updated weights for policy 0, policy_version 504478 (0.0006) [2023-12-27 22:51:57,863][106226] Updated weights for policy 0, policy_version 504488 (0.0011) [2023-12-27 22:51:57,912][106226] Updated weights for policy 0, policy_version 504498 (0.0010) [2023-12-27 22:51:58,186][106225] Updated weights for policy 1, policy_version 505809 (0.0010) [2023-12-27 22:51:58,254][106225] Updated weights for policy 1, policy_version 505819 (0.0010) [2023-12-27 22:51:58,318][106225] Updated weights for policy 1, policy_version 505829 (0.0009) [2023-12-27 22:51:58,392][106225] Updated weights for policy 1, policy_version 505839 (0.0008) [2023-12-27 22:51:58,642][106226] Updated weights for policy 0, policy_version 504508 (0.0009) [2023-12-27 22:51:58,707][106226] Updated weights for policy 0, policy_version 504518 (0.0008) [2023-12-27 22:51:58,773][106226] Updated weights for policy 0, policy_version 504528 (0.0008) [2023-12-27 22:51:59,205][106225] Updated weights for policy 1, policy_version 505849 (0.0006) [2023-12-27 22:51:59,278][106225] Updated weights for policy 1, policy_version 505859 (0.0008) [2023-12-27 22:51:59,348][106225] Updated weights for policy 1, policy_version 505869 (0.0008) [2023-12-27 22:51:59,631][106226] Updated weights for policy 0, policy_version 504538 (0.0008) [2023-12-27 22:51:59,692][106226] Updated weights for policy 0, policy_version 504548 (0.0009) [2023-12-27 22:51:59,749][106226] Updated weights for policy 0, policy_version 504558 (0.0008) [2023-12-27 22:51:59,805][106226] Updated weights for policy 0, policy_version 504568 (0.0008) [2023-12-27 22:52:00,068][106225] Updated weights for policy 1, policy_version 505879 (0.0008) [2023-12-27 22:52:00,116][106225] Updated weights for policy 1, policy_version 505889 (0.0008) [2023-12-27 22:52:00,169][106225] Updated weights for policy 1, policy_version 505899 (0.0009) [2023-12-27 22:52:00,516][106226] Updated weights for policy 0, policy_version 504578 (0.0009) [2023-12-27 22:52:00,573][106226] Updated weights for policy 0, policy_version 504588 (0.0008) [2023-12-27 22:52:00,637][106226] Updated weights for policy 0, policy_version 504598 (0.0009) [2023-12-27 22:52:00,934][106225] Updated weights for policy 1, policy_version 505909 (0.0009) [2023-12-27 22:52:00,988][106225] Updated weights for policy 1, policy_version 505919 (0.0006) [2023-12-27 22:52:01,046][106225] Updated weights for policy 1, policy_version 505929 (0.0009) [2023-12-27 22:52:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 258760704. Throughput: 0: 9810.6, 1: 9934.7. Samples: 258749192. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:01,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-5.598')] [2023-12-27 22:52:01,299][106226] Updated weights for policy 0, policy_version 504608 (0.0009) [2023-12-27 22:52:01,361][106226] Updated weights for policy 0, policy_version 504618 (0.0009) [2023-12-27 22:52:01,423][106226] Updated weights for policy 0, policy_version 504628 (0.0008) [2023-12-27 22:52:01,791][106225] Updated weights for policy 1, policy_version 505939 (0.0006) [2023-12-27 22:52:01,849][106225] Updated weights for policy 1, policy_version 505949 (0.0007) [2023-12-27 22:52:01,909][106225] Updated weights for policy 1, policy_version 505959 (0.0008) [2023-12-27 22:52:02,091][106226] Updated weights for policy 0, policy_version 504638 (0.0007) [2023-12-27 22:52:02,153][106226] Updated weights for policy 0, policy_version 504648 (0.0008) [2023-12-27 22:52:02,213][106226] Updated weights for policy 0, policy_version 504658 (0.0009) [2023-12-27 22:52:02,738][106225] Updated weights for policy 1, policy_version 505969 (0.0009) [2023-12-27 22:52:02,788][106225] Updated weights for policy 1, policy_version 505979 (0.0009) [2023-12-27 22:52:02,815][106226] Updated weights for policy 0, policy_version 504668 (0.0007) [2023-12-27 22:52:02,846][106225] Updated weights for policy 1, policy_version 505989 (0.0008) [2023-12-27 22:52:02,866][106226] Updated weights for policy 0, policy_version 504678 (0.0005) [2023-12-27 22:52:02,910][106225] Updated weights for policy 1, policy_version 505999 (0.0008) [2023-12-27 22:52:02,916][106226] Updated weights for policy 0, policy_version 504688 (0.0005) [2023-12-27 22:52:03,597][106225] Updated weights for policy 1, policy_version 506009 (0.0008) [2023-12-27 22:52:03,624][106226] Updated weights for policy 0, policy_version 504698 (0.0007) [2023-12-27 22:52:03,649][106225] Updated weights for policy 1, policy_version 506019 (0.0007) [2023-12-27 22:52:03,689][106226] Updated weights for policy 0, policy_version 504708 (0.0007) [2023-12-27 22:52:03,714][106225] Updated weights for policy 1, policy_version 506029 (0.0005) [2023-12-27 22:52:03,743][106226] Updated weights for policy 0, policy_version 504718 (0.0008) [2023-12-27 22:52:03,805][106226] Updated weights for policy 0, policy_version 504728 (0.0009) [2023-12-27 22:52:04,394][106225] Updated weights for policy 1, policy_version 506039 (0.0007) [2023-12-27 22:52:04,463][106225] Updated weights for policy 1, policy_version 506049 (0.0008) [2023-12-27 22:52:04,519][106226] Updated weights for policy 0, policy_version 504738 (0.0007) [2023-12-27 22:52:04,533][106225] Updated weights for policy 1, policy_version 506059 (0.0008) [2023-12-27 22:52:04,569][106226] Updated weights for policy 0, policy_version 504748 (0.0006) [2023-12-27 22:52:04,631][106226] Updated weights for policy 0, policy_version 504758 (0.0005) [2023-12-27 22:52:05,277][106225] Updated weights for policy 1, policy_version 506069 (0.0008) [2023-12-27 22:52:05,307][106226] Updated weights for policy 0, policy_version 504768 (0.0007) [2023-12-27 22:52:05,332][106225] Updated weights for policy 1, policy_version 506079 (0.0005) [2023-12-27 22:52:05,364][106226] Updated weights for policy 0, policy_version 504778 (0.0009) [2023-12-27 22:52:05,389][106225] Updated weights for policy 1, policy_version 506089 (0.0007) [2023-12-27 22:52:05,426][106226] Updated weights for policy 0, policy_version 504788 (0.0008) [2023-12-27 22:52:06,062][106226] Updated weights for policy 0, policy_version 504798 (0.0007) [2023-12-27 22:52:06,118][106225] Updated weights for policy 1, policy_version 506099 (0.0006) [2023-12-27 22:52:06,126][106226] Updated weights for policy 0, policy_version 504808 (0.0007) [2023-12-27 22:52:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 258850816. Throughput: 0: 9917.8, 1: 9838.4. Samples: 258867356. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:06,175][105115] Avg episode reward: [(0, '-5.415'), (1, '-5.833')] [2023-12-27 22:52:06,181][106225] Updated weights for policy 1, policy_version 506109 (0.0006) [2023-12-27 22:52:06,186][106226] Updated weights for policy 0, policy_version 504818 (0.0011) [2023-12-27 22:52:06,233][106225] Updated weights for policy 1, policy_version 506119 (0.0007) [2023-12-27 22:52:06,848][106225] Updated weights for policy 1, policy_version 506129 (0.0007) [2023-12-27 22:52:06,912][106225] Updated weights for policy 1, policy_version 506139 (0.0006) [2023-12-27 22:52:06,945][106226] Updated weights for policy 0, policy_version 504828 (0.0009) [2023-12-27 22:52:06,972][106225] Updated weights for policy 1, policy_version 506149 (0.0005) [2023-12-27 22:52:06,996][106226] Updated weights for policy 0, policy_version 504838 (0.0005) [2023-12-27 22:52:07,029][106225] Updated weights for policy 1, policy_version 506159 (0.0007) [2023-12-27 22:52:07,046][106226] Updated weights for policy 0, policy_version 504848 (0.0005) [2023-12-27 22:52:07,715][106225] Updated weights for policy 1, policy_version 506169 (0.0006) [2023-12-27 22:52:07,721][106226] Updated weights for policy 0, policy_version 504858 (0.0006) [2023-12-27 22:52:07,768][106225] Updated weights for policy 1, policy_version 506179 (0.0007) [2023-12-27 22:52:07,774][106226] Updated weights for policy 0, policy_version 504868 (0.0006) [2023-12-27 22:52:07,824][106225] Updated weights for policy 1, policy_version 506189 (0.0006) [2023-12-27 22:52:07,829][106226] Updated weights for policy 0, policy_version 504878 (0.0007) [2023-12-27 22:52:07,881][106226] Updated weights for policy 0, policy_version 504888 (0.0008) [2023-12-27 22:52:08,556][106226] Updated weights for policy 0, policy_version 504898 (0.0008) [2023-12-27 22:52:08,606][106225] Updated weights for policy 1, policy_version 506199 (0.0007) [2023-12-27 22:52:08,615][106226] Updated weights for policy 0, policy_version 504908 (0.0009) [2023-12-27 22:52:08,655][106225] Updated weights for policy 1, policy_version 506209 (0.0007) [2023-12-27 22:52:08,670][106226] Updated weights for policy 0, policy_version 504918 (0.0008) [2023-12-27 22:52:08,711][106225] Updated weights for policy 1, policy_version 506219 (0.0006) [2023-12-27 22:52:09,291][106226] Updated weights for policy 0, policy_version 504928 (0.0007) [2023-12-27 22:52:09,356][106226] Updated weights for policy 0, policy_version 504938 (0.0008) [2023-12-27 22:52:09,424][106225] Updated weights for policy 1, policy_version 506229 (0.0007) [2023-12-27 22:52:09,431][106226] Updated weights for policy 0, policy_version 504948 (0.0009) [2023-12-27 22:52:09,491][106225] Updated weights for policy 1, policy_version 506239 (0.0010) [2023-12-27 22:52:09,554][106225] Updated weights for policy 1, policy_version 506249 (0.0011) [2023-12-27 22:52:10,202][106226] Updated weights for policy 0, policy_version 504958 (0.0008) [2023-12-27 22:52:10,276][106226] Updated weights for policy 0, policy_version 504968 (0.0009) [2023-12-27 22:52:10,342][106226] Updated weights for policy 0, policy_version 504978 (0.0010) [2023-12-27 22:52:10,375][106225] Updated weights for policy 1, policy_version 506259 (0.0009) [2023-12-27 22:52:10,432][106225] Updated weights for policy 1, policy_version 506269 (0.0005) [2023-12-27 22:52:10,489][106225] Updated weights for policy 1, policy_version 506279 (0.0006) [2023-12-27 22:52:11,096][106226] Updated weights for policy 0, policy_version 504988 (0.0008) [2023-12-27 22:52:11,171][106226] Updated weights for policy 0, policy_version 504998 (0.0008) [2023-12-27 22:52:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 258949120. Throughput: 0: 9905.2, 1: 9864.2. Samples: 258926852. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:11,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-5.371')] [2023-12-27 22:52:11,181][106225] Updated weights for policy 1, policy_version 506289 (0.0007) [2023-12-27 22:52:11,234][106226] Updated weights for policy 0, policy_version 505008 (0.0007) [2023-12-27 22:52:11,248][106225] Updated weights for policy 1, policy_version 506299 (0.0011) [2023-12-27 22:52:11,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000505016_129318912.pth... [2023-12-27 22:52:11,294][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000503864_129024000.pth [2023-12-27 22:52:11,307][106225] Updated weights for policy 1, policy_version 506309 (0.0010) [2023-12-27 22:52:11,373][106225] Updated weights for policy 1, policy_version 506319 (0.0011) [2023-12-27 22:52:11,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000506320_129646592.pth... [2023-12-27 22:52:11,384][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000505168_129351680.pth [2023-12-27 22:52:12,031][106226] Updated weights for policy 0, policy_version 505018 (0.0007) [2023-12-27 22:52:12,069][106225] Updated weights for policy 1, policy_version 506329 (0.0008) [2023-12-27 22:52:12,093][106226] Updated weights for policy 0, policy_version 505028 (0.0007) [2023-12-27 22:52:12,127][106225] Updated weights for policy 1, policy_version 506339 (0.0009) [2023-12-27 22:52:12,149][106226] Updated weights for policy 0, policy_version 505038 (0.0006) [2023-12-27 22:52:12,184][106225] Updated weights for policy 1, policy_version 506349 (0.0009) [2023-12-27 22:52:12,205][106226] Updated weights for policy 0, policy_version 505048 (0.0006) [2023-12-27 22:52:12,848][106226] Updated weights for policy 0, policy_version 505058 (0.0007) [2023-12-27 22:52:12,909][106226] Updated weights for policy 0, policy_version 505068 (0.0007) [2023-12-27 22:52:12,973][106226] Updated weights for policy 0, policy_version 505078 (0.0008) [2023-12-27 22:52:13,054][106225] Updated weights for policy 1, policy_version 506359 (0.0009) [2023-12-27 22:52:13,119][106225] Updated weights for policy 1, policy_version 506369 (0.0008) [2023-12-27 22:52:13,171][106225] Updated weights for policy 1, policy_version 506379 (0.0007) [2023-12-27 22:52:13,724][106226] Updated weights for policy 0, policy_version 505088 (0.0009) [2023-12-27 22:52:13,727][106225] Updated weights for policy 1, policy_version 506389 (0.0005) [2023-12-27 22:52:13,771][106225] Updated weights for policy 1, policy_version 506399 (0.0006) [2023-12-27 22:52:13,778][106226] Updated weights for policy 0, policy_version 505098 (0.0006) [2023-12-27 22:52:13,815][106225] Updated weights for policy 1, policy_version 506409 (0.0005) [2023-12-27 22:52:13,834][106226] Updated weights for policy 0, policy_version 505108 (0.0007) [2023-12-27 22:52:14,439][106225] Updated weights for policy 1, policy_version 506419 (0.0006) [2023-12-27 22:52:14,494][106225] Updated weights for policy 1, policy_version 506429 (0.0008) [2023-12-27 22:52:14,542][106225] Updated weights for policy 1, policy_version 506439 (0.0008) [2023-12-27 22:52:14,624][106226] Updated weights for policy 0, policy_version 505118 (0.0007) [2023-12-27 22:52:14,682][106226] Updated weights for policy 0, policy_version 505128 (0.0008) [2023-12-27 22:52:14,747][106226] Updated weights for policy 0, policy_version 505138 (0.0008) [2023-12-27 22:52:15,295][106225] Updated weights for policy 1, policy_version 506449 (0.0008) [2023-12-27 22:52:15,352][106225] Updated weights for policy 1, policy_version 506459 (0.0008) [2023-12-27 22:52:15,414][106225] Updated weights for policy 1, policy_version 506469 (0.0008) [2023-12-27 22:52:15,473][106225] Updated weights for policy 1, policy_version 506479 (0.0009) [2023-12-27 22:52:15,521][106226] Updated weights for policy 0, policy_version 505148 (0.0008) [2023-12-27 22:52:15,584][106226] Updated weights for policy 0, policy_version 505158 (0.0009) [2023-12-27 22:52:15,640][106226] Updated weights for policy 0, policy_version 505168 (0.0009) [2023-12-27 22:52:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 259047424. Throughput: 0: 9745.0, 1: 9835.0. Samples: 259041028. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:16,175][105115] Avg episode reward: [(0, '-5.253'), (1, '-5.412')] [2023-12-27 22:52:16,199][106225] Updated weights for policy 1, policy_version 506489 (0.0009) [2023-12-27 22:52:16,281][106225] Updated weights for policy 1, policy_version 506499 (0.0011) [2023-12-27 22:52:16,345][106225] Updated weights for policy 1, policy_version 506509 (0.0010) [2023-12-27 22:52:16,357][106226] Updated weights for policy 0, policy_version 505178 (0.0008) [2023-12-27 22:52:16,416][106226] Updated weights for policy 0, policy_version 505188 (0.0005) [2023-12-27 22:52:16,472][106226] Updated weights for policy 0, policy_version 505198 (0.0005) [2023-12-27 22:52:16,536][106226] Updated weights for policy 0, policy_version 505208 (0.0006) [2023-12-27 22:52:16,981][106225] Updated weights for policy 1, policy_version 506519 (0.0007) [2023-12-27 22:52:17,037][106225] Updated weights for policy 1, policy_version 506529 (0.0005) [2023-12-27 22:52:17,101][106225] Updated weights for policy 1, policy_version 506539 (0.0010) [2023-12-27 22:52:17,239][106226] Updated weights for policy 0, policy_version 505218 (0.0011) [2023-12-27 22:52:17,300][106226] Updated weights for policy 0, policy_version 505228 (0.0010) [2023-12-27 22:52:17,364][106226] Updated weights for policy 0, policy_version 505238 (0.0011) [2023-12-27 22:52:17,744][106225] Updated weights for policy 1, policy_version 506549 (0.0008) [2023-12-27 22:52:17,810][106225] Updated weights for policy 1, policy_version 506559 (0.0007) [2023-12-27 22:52:17,872][106225] Updated weights for policy 1, policy_version 506569 (0.0008) [2023-12-27 22:52:17,960][106226] Updated weights for policy 0, policy_version 505248 (0.0011) [2023-12-27 22:52:18,016][106226] Updated weights for policy 0, policy_version 505258 (0.0008) [2023-12-27 22:52:18,079][106226] Updated weights for policy 0, policy_version 505268 (0.0005) [2023-12-27 22:52:18,549][106225] Updated weights for policy 1, policy_version 506579 (0.0007) [2023-12-27 22:52:18,603][106225] Updated weights for policy 1, policy_version 506589 (0.0008) [2023-12-27 22:52:18,664][106225] Updated weights for policy 1, policy_version 506599 (0.0009) [2023-12-27 22:52:18,672][106226] Updated weights for policy 0, policy_version 505278 (0.0006) [2023-12-27 22:52:18,727][106226] Updated weights for policy 0, policy_version 505288 (0.0006) [2023-12-27 22:52:18,775][106226] Updated weights for policy 0, policy_version 505298 (0.0010) [2023-12-27 22:52:19,373][106225] Updated weights for policy 1, policy_version 506610 (0.0008) [2023-12-27 22:52:19,436][106225] Updated weights for policy 1, policy_version 506620 (0.0010) [2023-12-27 22:52:19,500][106225] Updated weights for policy 1, policy_version 506630 (0.0009) [2023-12-27 22:52:19,521][106226] Updated weights for policy 0, policy_version 505308 (0.0010) [2023-12-27 22:52:19,562][106225] Updated weights for policy 1, policy_version 506640 (0.0008) [2023-12-27 22:52:19,578][106226] Updated weights for policy 0, policy_version 505318 (0.0007) [2023-12-27 22:52:19,628][106226] Updated weights for policy 0, policy_version 505328 (0.0009) [2023-12-27 22:52:20,290][106225] Updated weights for policy 1, policy_version 506650 (0.0008) [2023-12-27 22:52:20,344][106225] Updated weights for policy 1, policy_version 506660 (0.0008) [2023-12-27 22:52:20,400][106225] Updated weights for policy 1, policy_version 506670 (0.0009) [2023-12-27 22:52:20,418][106226] Updated weights for policy 0, policy_version 505338 (0.0009) [2023-12-27 22:52:20,487][106226] Updated weights for policy 0, policy_version 505348 (0.0008) [2023-12-27 22:52:20,549][106226] Updated weights for policy 0, policy_version 505358 (0.0009) [2023-12-27 22:52:20,614][106226] Updated weights for policy 0, policy_version 505368 (0.0009) [2023-12-27 22:52:21,122][106225] Updated weights for policy 1, policy_version 506680 (0.0008) [2023-12-27 22:52:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 259145728. Throughput: 0: 9806.8, 1: 9736.4. Samples: 259160032. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:21,175][105115] Avg episode reward: [(0, '-5.416'), (1, '-5.242')] [2023-12-27 22:52:21,193][106225] Updated weights for policy 1, policy_version 506690 (0.0007) [2023-12-27 22:52:21,265][106225] Updated weights for policy 1, policy_version 506700 (0.0006) [2023-12-27 22:52:21,299][106226] Updated weights for policy 0, policy_version 505378 (0.0008) [2023-12-27 22:52:21,368][106226] Updated weights for policy 0, policy_version 505388 (0.0009) [2023-12-27 22:52:21,433][106226] Updated weights for policy 0, policy_version 505398 (0.0009) [2023-12-27 22:52:22,001][106225] Updated weights for policy 1, policy_version 506710 (0.0008) [2023-12-27 22:52:22,061][106225] Updated weights for policy 1, policy_version 506720 (0.0008) [2023-12-27 22:52:22,126][106225] Updated weights for policy 1, policy_version 506730 (0.0009) [2023-12-27 22:52:22,188][106226] Updated weights for policy 0, policy_version 505408 (0.0007) [2023-12-27 22:52:22,253][106226] Updated weights for policy 0, policy_version 505418 (0.0009) [2023-12-27 22:52:22,321][106226] Updated weights for policy 0, policy_version 505428 (0.0008) [2023-12-27 22:52:22,837][106225] Updated weights for policy 1, policy_version 506740 (0.0008) [2023-12-27 22:52:22,896][106225] Updated weights for policy 1, policy_version 506750 (0.0009) [2023-12-27 22:52:22,957][106225] Updated weights for policy 1, policy_version 506760 (0.0009) [2023-12-27 22:52:23,043][106226] Updated weights for policy 0, policy_version 505438 (0.0008) [2023-12-27 22:52:23,099][106226] Updated weights for policy 0, policy_version 505448 (0.0009) [2023-12-27 22:52:23,148][106226] Updated weights for policy 0, policy_version 505458 (0.0009) [2023-12-27 22:52:23,608][106225] Updated weights for policy 1, policy_version 506770 (0.0008) [2023-12-27 22:52:23,661][106225] Updated weights for policy 1, policy_version 506780 (0.0009) [2023-12-27 22:52:23,715][106225] Updated weights for policy 1, policy_version 506790 (0.0008) [2023-12-27 22:52:23,774][106225] Updated weights for policy 1, policy_version 506800 (0.0010) [2023-12-27 22:52:23,878][106226] Updated weights for policy 0, policy_version 505468 (0.0008) [2023-12-27 22:52:23,935][106226] Updated weights for policy 0, policy_version 505478 (0.0006) [2023-12-27 22:52:23,992][106226] Updated weights for policy 0, policy_version 505488 (0.0005) [2023-12-27 22:52:24,461][106225] Updated weights for policy 1, policy_version 506810 (0.0005) [2023-12-27 22:52:24,521][106225] Updated weights for policy 1, policy_version 506820 (0.0005) [2023-12-27 22:52:24,590][106225] Updated weights for policy 1, policy_version 506830 (0.0009) [2023-12-27 22:52:24,601][106226] Updated weights for policy 0, policy_version 505498 (0.0007) [2023-12-27 22:52:24,657][106226] Updated weights for policy 0, policy_version 505508 (0.0006) [2023-12-27 22:52:24,704][106226] Updated weights for policy 0, policy_version 505518 (0.0007) [2023-12-27 22:52:24,758][106226] Updated weights for policy 0, policy_version 505528 (0.0009) [2023-12-27 22:52:25,156][106225] Updated weights for policy 1, policy_version 506840 (0.0010) [2023-12-27 22:52:25,222][106225] Updated weights for policy 1, policy_version 506850 (0.0010) [2023-12-27 22:52:25,279][106225] Updated weights for policy 1, policy_version 506860 (0.0010) [2023-12-27 22:52:25,390][106226] Updated weights for policy 0, policy_version 505538 (0.0007) [2023-12-27 22:52:25,444][106226] Updated weights for policy 0, policy_version 505548 (0.0006) [2023-12-27 22:52:25,501][106226] Updated weights for policy 0, policy_version 505558 (0.0006) [2023-12-27 22:52:25,994][106225] Updated weights for policy 1, policy_version 506870 (0.0010) [2023-12-27 22:52:26,055][106225] Updated weights for policy 1, policy_version 506880 (0.0006) [2023-12-27 22:52:26,114][106225] Updated weights for policy 1, policy_version 506890 (0.0006) [2023-12-27 22:52:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 259252224. Throughput: 0: 9778.3, 1: 9709.6. Samples: 259218176. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:26,175][105115] Avg episode reward: [(0, '-5.100'), (1, '-5.337')] [2023-12-27 22:52:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000506896_129794048.pth... [2023-12-27 22:52:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000505744_129499136.pth [2023-12-27 22:52:26,212][106226] Updated weights for policy 0, policy_version 505568 (0.0009) [2023-12-27 22:52:26,269][106226] Updated weights for policy 0, policy_version 505578 (0.0008) [2023-12-27 22:52:26,327][106226] Updated weights for policy 0, policy_version 505588 (0.0008) [2023-12-27 22:52:26,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000505592_129466368.pth... [2023-12-27 22:52:26,351][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000504408_129163264.pth [2023-12-27 22:52:26,755][106225] Updated weights for policy 1, policy_version 506900 (0.0005) [2023-12-27 22:52:26,820][106225] Updated weights for policy 1, policy_version 506910 (0.0007) [2023-12-27 22:52:26,884][106225] Updated weights for policy 1, policy_version 506920 (0.0007) [2023-12-27 22:52:27,078][106226] Updated weights for policy 0, policy_version 505598 (0.0008) [2023-12-27 22:52:27,124][106226] Updated weights for policy 0, policy_version 505609 (0.0009) [2023-12-27 22:52:27,174][106226] Updated weights for policy 0, policy_version 505619 (0.0006) [2023-12-27 22:52:27,462][106225] Updated weights for policy 1, policy_version 506930 (0.0008) [2023-12-27 22:52:27,509][106225] Updated weights for policy 1, policy_version 506940 (0.0008) [2023-12-27 22:52:27,553][106225] Updated weights for policy 1, policy_version 506950 (0.0008) [2023-12-27 22:52:27,602][106225] Updated weights for policy 1, policy_version 506960 (0.0008) [2023-12-27 22:52:27,850][106226] Updated weights for policy 0, policy_version 505629 (0.0007) [2023-12-27 22:52:27,902][106226] Updated weights for policy 0, policy_version 505639 (0.0008) [2023-12-27 22:52:27,958][106226] Updated weights for policy 0, policy_version 505649 (0.0008) [2023-12-27 22:52:28,348][106225] Updated weights for policy 1, policy_version 506970 (0.0007) [2023-12-27 22:52:28,416][106225] Updated weights for policy 1, policy_version 506980 (0.0006) [2023-12-27 22:52:28,474][106225] Updated weights for policy 1, policy_version 506990 (0.0007) [2023-12-27 22:52:28,720][106226] Updated weights for policy 0, policy_version 505659 (0.0009) [2023-12-27 22:52:28,790][106226] Updated weights for policy 0, policy_version 505669 (0.0009) [2023-12-27 22:52:28,845][106226] Updated weights for policy 0, policy_version 505679 (0.0009) [2023-12-27 22:52:29,112][106225] Updated weights for policy 1, policy_version 507000 (0.0009) [2023-12-27 22:52:29,170][106225] Updated weights for policy 1, policy_version 507010 (0.0008) [2023-12-27 22:52:29,237][106225] Updated weights for policy 1, policy_version 507020 (0.0008) [2023-12-27 22:52:29,534][106226] Updated weights for policy 0, policy_version 505689 (0.0008) [2023-12-27 22:52:29,596][106226] Updated weights for policy 0, policy_version 505699 (0.0008) [2023-12-27 22:52:29,647][106226] Updated weights for policy 0, policy_version 505709 (0.0008) [2023-12-27 22:52:29,707][106226] Updated weights for policy 0, policy_version 505719 (0.0008) [2023-12-27 22:52:30,002][106225] Updated weights for policy 1, policy_version 507030 (0.0009) [2023-12-27 22:52:30,059][106225] Updated weights for policy 1, policy_version 507040 (0.0008) [2023-12-27 22:52:30,109][106225] Updated weights for policy 1, policy_version 507050 (0.0008) [2023-12-27 22:52:30,455][106226] Updated weights for policy 0, policy_version 505729 (0.0008) [2023-12-27 22:52:30,511][106226] Updated weights for policy 0, policy_version 505739 (0.0008) [2023-12-27 22:52:30,580][106226] Updated weights for policy 0, policy_version 505749 (0.0009) [2023-12-27 22:52:30,854][106225] Updated weights for policy 1, policy_version 507060 (0.0007) [2023-12-27 22:52:30,914][106225] Updated weights for policy 1, policy_version 507070 (0.0007) [2023-12-27 22:52:30,969][106225] Updated weights for policy 1, policy_version 507080 (0.0008) [2023-12-27 22:52:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 259350528. Throughput: 0: 9849.6, 1: 9805.3. Samples: 259339932. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:31,175][105115] Avg episode reward: [(0, '-5.313'), (1, '-5.410')] [2023-12-27 22:52:31,280][106226] Updated weights for policy 0, policy_version 505759 (0.0007) [2023-12-27 22:52:31,342][106226] Updated weights for policy 0, policy_version 505769 (0.0007) [2023-12-27 22:52:31,405][106226] Updated weights for policy 0, policy_version 505779 (0.0007) [2023-12-27 22:52:31,666][106225] Updated weights for policy 1, policy_version 507090 (0.0009) [2023-12-27 22:52:31,723][106225] Updated weights for policy 1, policy_version 507100 (0.0007) [2023-12-27 22:52:31,789][106225] Updated weights for policy 1, policy_version 507110 (0.0008) [2023-12-27 22:52:31,849][106225] Updated weights for policy 1, policy_version 507120 (0.0005) [2023-12-27 22:52:32,186][106226] Updated weights for policy 0, policy_version 505789 (0.0008) [2023-12-27 22:52:32,238][106226] Updated weights for policy 0, policy_version 505799 (0.0009) [2023-12-27 22:52:32,303][106226] Updated weights for policy 0, policy_version 505809 (0.0009) [2023-12-27 22:52:32,569][106225] Updated weights for policy 1, policy_version 507130 (0.0011) [2023-12-27 22:52:32,626][106225] Updated weights for policy 1, policy_version 507140 (0.0010) [2023-12-27 22:52:32,689][106225] Updated weights for policy 1, policy_version 507150 (0.0010) [2023-12-27 22:52:32,923][106226] Updated weights for policy 0, policy_version 505819 (0.0009) [2023-12-27 22:52:32,977][106226] Updated weights for policy 0, policy_version 505829 (0.0008) [2023-12-27 22:52:33,029][106226] Updated weights for policy 0, policy_version 505839 (0.0007) [2023-12-27 22:52:33,344][106225] Updated weights for policy 1, policy_version 507160 (0.0006) [2023-12-27 22:52:33,389][106225] Updated weights for policy 1, policy_version 507170 (0.0005) [2023-12-27 22:52:33,432][106225] Updated weights for policy 1, policy_version 507180 (0.0005) [2023-12-27 22:52:33,806][106226] Updated weights for policy 0, policy_version 505849 (0.0008) [2023-12-27 22:52:33,872][106226] Updated weights for policy 0, policy_version 505859 (0.0005) [2023-12-27 22:52:33,935][106226] Updated weights for policy 0, policy_version 505869 (0.0005) [2023-12-27 22:52:33,986][106226] Updated weights for policy 0, policy_version 505879 (0.0006) [2023-12-27 22:52:34,053][106225] Updated weights for policy 1, policy_version 507190 (0.0008) [2023-12-27 22:52:34,113][106225] Updated weights for policy 1, policy_version 507200 (0.0010) [2023-12-27 22:52:34,175][106225] Updated weights for policy 1, policy_version 507210 (0.0009) [2023-12-27 22:52:34,675][106226] Updated weights for policy 0, policy_version 505889 (0.0008) [2023-12-27 22:52:34,725][106226] Updated weights for policy 0, policy_version 505899 (0.0008) [2023-12-27 22:52:34,775][106226] Updated weights for policy 0, policy_version 505909 (0.0008) [2023-12-27 22:52:34,936][106225] Updated weights for policy 1, policy_version 507220 (0.0007) [2023-12-27 22:52:34,986][106225] Updated weights for policy 1, policy_version 507230 (0.0010) [2023-12-27 22:52:35,043][106225] Updated weights for policy 1, policy_version 507240 (0.0010) [2023-12-27 22:52:35,472][106226] Updated weights for policy 0, policy_version 505919 (0.0006) [2023-12-27 22:52:35,523][106226] Updated weights for policy 0, policy_version 505929 (0.0006) [2023-12-27 22:52:35,572][106226] Updated weights for policy 0, policy_version 505939 (0.0008) [2023-12-27 22:52:35,652][106225] Updated weights for policy 1, policy_version 507250 (0.0010) [2023-12-27 22:52:35,707][106225] Updated weights for policy 1, policy_version 507260 (0.0007) [2023-12-27 22:52:35,766][106225] Updated weights for policy 1, policy_version 507270 (0.0009) [2023-12-27 22:52:35,824][106225] Updated weights for policy 1, policy_version 507280 (0.0008) [2023-12-27 22:52:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 259448832. Throughput: 0: 9926.5, 1: 9795.5. Samples: 259459384. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:36,175][105115] Avg episode reward: [(0, '-5.359'), (1, '-5.273')] [2023-12-27 22:52:36,314][106226] Updated weights for policy 0, policy_version 505949 (0.0009) [2023-12-27 22:52:36,371][106226] Updated weights for policy 0, policy_version 505959 (0.0009) [2023-12-27 22:52:36,432][106226] Updated weights for policy 0, policy_version 505969 (0.0009) [2023-12-27 22:52:36,560][106225] Updated weights for policy 1, policy_version 507290 (0.0007) [2023-12-27 22:52:36,622][106225] Updated weights for policy 1, policy_version 507300 (0.0010) [2023-12-27 22:52:36,690][106225] Updated weights for policy 1, policy_version 507310 (0.0005) [2023-12-27 22:52:37,109][106226] Updated weights for policy 0, policy_version 505979 (0.0008) [2023-12-27 22:52:37,158][106226] Updated weights for policy 0, policy_version 505989 (0.0005) [2023-12-27 22:52:37,205][106226] Updated weights for policy 0, policy_version 505999 (0.0007) [2023-12-27 22:52:37,295][106225] Updated weights for policy 1, policy_version 507320 (0.0005) [2023-12-27 22:52:37,351][106225] Updated weights for policy 1, policy_version 507330 (0.0005) [2023-12-27 22:52:37,406][106225] Updated weights for policy 1, policy_version 507340 (0.0005) [2023-12-27 22:52:37,952][106226] Updated weights for policy 0, policy_version 506009 (0.0008) [2023-12-27 22:52:38,008][106226] Updated weights for policy 0, policy_version 506019 (0.0006) [2023-12-27 22:52:38,014][106225] Updated weights for policy 1, policy_version 507350 (0.0007) [2023-12-27 22:52:38,066][106226] Updated weights for policy 0, policy_version 506029 (0.0006) [2023-12-27 22:52:38,070][106225] Updated weights for policy 1, policy_version 507360 (0.0008) [2023-12-27 22:52:38,120][106226] Updated weights for policy 0, policy_version 506039 (0.0009) [2023-12-27 22:52:38,126][106225] Updated weights for policy 1, policy_version 507370 (0.0007) [2023-12-27 22:52:38,734][106226] Updated weights for policy 0, policy_version 506049 (0.0006) [2023-12-27 22:52:38,794][106226] Updated weights for policy 0, policy_version 506059 (0.0005) [2023-12-27 22:52:38,840][106225] Updated weights for policy 1, policy_version 507380 (0.0007) [2023-12-27 22:52:38,864][106226] Updated weights for policy 0, policy_version 506069 (0.0007) [2023-12-27 22:52:38,895][106225] Updated weights for policy 1, policy_version 507390 (0.0006) [2023-12-27 22:52:38,951][106225] Updated weights for policy 1, policy_version 507400 (0.0009) [2023-12-27 22:52:39,630][106226] Updated weights for policy 0, policy_version 506079 (0.0008) [2023-12-27 22:52:39,688][106226] Updated weights for policy 0, policy_version 506089 (0.0008) [2023-12-27 22:52:39,756][106225] Updated weights for policy 1, policy_version 507410 (0.0008) [2023-12-27 22:52:39,762][106226] Updated weights for policy 0, policy_version 506100 (0.0007) [2023-12-27 22:52:39,813][106225] Updated weights for policy 1, policy_version 507420 (0.0009) [2023-12-27 22:52:39,872][106225] Updated weights for policy 1, policy_version 507430 (0.0008) [2023-12-27 22:52:39,924][106225] Updated weights for policy 1, policy_version 507440 (0.0008) [2023-12-27 22:52:40,519][106226] Updated weights for policy 0, policy_version 506110 (0.0007) [2023-12-27 22:52:40,586][106226] Updated weights for policy 0, policy_version 506120 (0.0009) [2023-12-27 22:52:40,593][106225] Updated weights for policy 1, policy_version 507450 (0.0007) [2023-12-27 22:52:40,645][106226] Updated weights for policy 0, policy_version 506130 (0.0011) [2023-12-27 22:52:40,653][106225] Updated weights for policy 1, policy_version 507460 (0.0007) [2023-12-27 22:52:40,711][106225] Updated weights for policy 1, policy_version 507470 (0.0007) [2023-12-27 22:52:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 259547136. Throughput: 0: 9900.0, 1: 9884.7. Samples: 259520724. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:41,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-5.654')] [2023-12-27 22:52:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000507472_129941504.pth... [2023-12-27 22:52:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000506136_129605632.pth... [2023-12-27 22:52:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000506320_129646592.pth [2023-12-27 22:52:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000505016_129318912.pth [2023-12-27 22:52:41,411][106226] Updated weights for policy 0, policy_version 506140 (0.0010) [2023-12-27 22:52:41,449][106225] Updated weights for policy 1, policy_version 507480 (0.0009) [2023-12-27 22:52:41,473][106226] Updated weights for policy 0, policy_version 506150 (0.0010) [2023-12-27 22:52:41,514][106225] Updated weights for policy 1, policy_version 507490 (0.0009) [2023-12-27 22:52:41,536][106226] Updated weights for policy 0, policy_version 506160 (0.0006) [2023-12-27 22:52:41,576][106225] Updated weights for policy 1, policy_version 507500 (0.0008) [2023-12-27 22:52:42,278][106226] Updated weights for policy 0, policy_version 506170 (0.0007) [2023-12-27 22:52:42,342][106226] Updated weights for policy 0, policy_version 506180 (0.0008) [2023-12-27 22:52:42,385][106225] Updated weights for policy 1, policy_version 507510 (0.0008) [2023-12-27 22:52:42,412][106226] Updated weights for policy 0, policy_version 506190 (0.0007) [2023-12-27 22:52:42,442][106225] Updated weights for policy 1, policy_version 507520 (0.0006) [2023-12-27 22:52:42,475][106226] Updated weights for policy 0, policy_version 506200 (0.0007) [2023-12-27 22:52:42,500][106225] Updated weights for policy 1, policy_version 507530 (0.0007) [2023-12-27 22:52:43,185][106226] Updated weights for policy 0, policy_version 506210 (0.0005) [2023-12-27 22:52:43,237][106225] Updated weights for policy 1, policy_version 507540 (0.0008) [2023-12-27 22:52:43,252][106226] Updated weights for policy 0, policy_version 506220 (0.0005) [2023-12-27 22:52:43,290][106225] Updated weights for policy 1, policy_version 507550 (0.0008) [2023-12-27 22:52:43,311][106226] Updated weights for policy 0, policy_version 506230 (0.0005) [2023-12-27 22:52:43,337][106225] Updated weights for policy 1, policy_version 507560 (0.0008) [2023-12-27 22:52:43,830][106226] Updated weights for policy 0, policy_version 506240 (0.0008) [2023-12-27 22:52:43,901][106226] Updated weights for policy 0, policy_version 506250 (0.0008) [2023-12-27 22:52:43,964][106226] Updated weights for policy 0, policy_version 506260 (0.0008) [2023-12-27 22:52:44,008][106225] Updated weights for policy 1, policy_version 507570 (0.0009) [2023-12-27 22:52:44,054][106225] Updated weights for policy 1, policy_version 507580 (0.0010) [2023-12-27 22:52:44,101][106225] Updated weights for policy 1, policy_version 507590 (0.0010) [2023-12-27 22:52:44,150][106225] Updated weights for policy 1, policy_version 507600 (0.0010) [2023-12-27 22:52:44,680][106226] Updated weights for policy 0, policy_version 506270 (0.0008) [2023-12-27 22:52:44,742][106226] Updated weights for policy 0, policy_version 506280 (0.0009) [2023-12-27 22:52:44,808][106226] Updated weights for policy 0, policy_version 506290 (0.0008) [2023-12-27 22:52:44,844][106225] Updated weights for policy 1, policy_version 507610 (0.0008) [2023-12-27 22:52:44,898][106225] Updated weights for policy 1, policy_version 507620 (0.0008) [2023-12-27 22:52:44,945][106225] Updated weights for policy 1, policy_version 507630 (0.0008) [2023-12-27 22:52:45,540][106226] Updated weights for policy 0, policy_version 506300 (0.0007) [2023-12-27 22:52:45,594][106226] Updated weights for policy 0, policy_version 506310 (0.0008) [2023-12-27 22:52:45,646][106226] Updated weights for policy 0, policy_version 506320 (0.0010) [2023-12-27 22:52:45,675][106225] Updated weights for policy 1, policy_version 507640 (0.0010) [2023-12-27 22:52:45,737][106225] Updated weights for policy 1, policy_version 507650 (0.0010) [2023-12-27 22:52:45,790][106225] Updated weights for policy 1, policy_version 507660 (0.0010) [2023-12-27 22:52:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 259645440. Throughput: 0: 9825.2, 1: 9895.0. Samples: 259636604. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:46,175][105115] Avg episode reward: [(0, '-5.099'), (1, '-5.494')] [2023-12-27 22:52:46,374][106226] Updated weights for policy 0, policy_version 506330 (0.0011) [2023-12-27 22:52:46,379][106225] Updated weights for policy 1, policy_version 507670 (0.0008) [2023-12-27 22:52:46,421][106226] Updated weights for policy 0, policy_version 506340 (0.0010) [2023-12-27 22:52:46,430][106225] Updated weights for policy 1, policy_version 507680 (0.0010) [2023-12-27 22:52:46,474][106226] Updated weights for policy 0, policy_version 506350 (0.0010) [2023-12-27 22:52:46,484][106225] Updated weights for policy 1, policy_version 507690 (0.0010) [2023-12-27 22:52:46,526][106226] Updated weights for policy 0, policy_version 506360 (0.0010) [2023-12-27 22:52:47,131][106226] Updated weights for policy 0, policy_version 506370 (0.0006) [2023-12-27 22:52:47,143][106225] Updated weights for policy 1, policy_version 507700 (0.0008) [2023-12-27 22:52:47,191][106226] Updated weights for policy 0, policy_version 506380 (0.0007) [2023-12-27 22:52:47,197][106225] Updated weights for policy 1, policy_version 507710 (0.0006) [2023-12-27 22:52:47,254][106226] Updated weights for policy 0, policy_version 506390 (0.0009) [2023-12-27 22:52:47,262][106225] Updated weights for policy 1, policy_version 507720 (0.0007) [2023-12-27 22:52:47,953][106225] Updated weights for policy 1, policy_version 507730 (0.0005) [2023-12-27 22:52:47,969][106226] Updated weights for policy 0, policy_version 506400 (0.0008) [2023-12-27 22:52:48,011][106225] Updated weights for policy 1, policy_version 507740 (0.0005) [2023-12-27 22:52:48,030][106226] Updated weights for policy 0, policy_version 506410 (0.0007) [2023-12-27 22:52:48,066][106225] Updated weights for policy 1, policy_version 507750 (0.0005) [2023-12-27 22:52:48,096][106226] Updated weights for policy 0, policy_version 506420 (0.0008) [2023-12-27 22:52:48,113][106225] Updated weights for policy 1, policy_version 507760 (0.0006) [2023-12-27 22:52:48,729][106226] Updated weights for policy 0, policy_version 506430 (0.0008) [2023-12-27 22:52:48,739][106225] Updated weights for policy 1, policy_version 507770 (0.0006) [2023-12-27 22:52:48,790][106226] Updated weights for policy 0, policy_version 506440 (0.0008) [2023-12-27 22:52:48,803][106225] Updated weights for policy 1, policy_version 507780 (0.0008) [2023-12-27 22:52:48,852][106226] Updated weights for policy 0, policy_version 506450 (0.0007) [2023-12-27 22:52:48,862][106225] Updated weights for policy 1, policy_version 507790 (0.0009) [2023-12-27 22:52:49,468][106226] Updated weights for policy 0, policy_version 506460 (0.0008) [2023-12-27 22:52:49,503][106225] Updated weights for policy 1, policy_version 507800 (0.0010) [2023-12-27 22:52:49,522][106226] Updated weights for policy 0, policy_version 506470 (0.0010) [2023-12-27 22:52:49,557][106225] Updated weights for policy 1, policy_version 507810 (0.0007) [2023-12-27 22:52:49,584][106226] Updated weights for policy 0, policy_version 506480 (0.0010) [2023-12-27 22:52:49,618][106225] Updated weights for policy 1, policy_version 507820 (0.0006) [2023-12-27 22:52:50,297][106225] Updated weights for policy 1, policy_version 507830 (0.0008) [2023-12-27 22:52:50,347][106226] Updated weights for policy 0, policy_version 506490 (0.0010) [2023-12-27 22:52:50,361][106225] Updated weights for policy 1, policy_version 507840 (0.0011) [2023-12-27 22:52:50,413][106226] Updated weights for policy 0, policy_version 506500 (0.0005) [2023-12-27 22:52:50,430][106225] Updated weights for policy 1, policy_version 507850 (0.0010) [2023-12-27 22:52:50,467][106226] Updated weights for policy 0, policy_version 506510 (0.0006) [2023-12-27 22:52:50,520][106226] Updated weights for policy 0, policy_version 506520 (0.0007) [2023-12-27 22:52:51,165][106225] Updated weights for policy 1, policy_version 507860 (0.0010) [2023-12-27 22:52:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 259743744. Throughput: 0: 9804.9, 1: 10013.2. Samples: 259759172. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:51,175][105115] Avg episode reward: [(0, '-5.326'), (1, '-5.683')] [2023-12-27 22:52:51,212][106226] Updated weights for policy 0, policy_version 506530 (0.0006) [2023-12-27 22:52:51,236][106225] Updated weights for policy 1, policy_version 507870 (0.0008) [2023-12-27 22:52:51,276][106226] Updated weights for policy 0, policy_version 506540 (0.0006) [2023-12-27 22:52:51,304][106225] Updated weights for policy 1, policy_version 507880 (0.0009) [2023-12-27 22:52:51,344][106226] Updated weights for policy 0, policy_version 506550 (0.0007) [2023-12-27 22:52:52,020][106226] Updated weights for policy 0, policy_version 506560 (0.0009) [2023-12-27 22:52:52,063][106225] Updated weights for policy 1, policy_version 507890 (0.0008) [2023-12-27 22:52:52,088][106226] Updated weights for policy 0, policy_version 506570 (0.0009) [2023-12-27 22:52:52,122][106225] Updated weights for policy 1, policy_version 507900 (0.0006) [2023-12-27 22:52:52,156][106226] Updated weights for policy 0, policy_version 506580 (0.0008) [2023-12-27 22:52:52,188][106225] Updated weights for policy 1, policy_version 507910 (0.0006) [2023-12-27 22:52:52,248][106225] Updated weights for policy 1, policy_version 507920 (0.0007) [2023-12-27 22:52:52,912][106226] Updated weights for policy 0, policy_version 506590 (0.0008) [2023-12-27 22:52:52,915][106225] Updated weights for policy 1, policy_version 507930 (0.0007) [2023-12-27 22:52:52,967][106226] Updated weights for policy 0, policy_version 506600 (0.0007) [2023-12-27 22:52:52,975][106225] Updated weights for policy 1, policy_version 507940 (0.0006) [2023-12-27 22:52:53,021][106226] Updated weights for policy 0, policy_version 506610 (0.0009) [2023-12-27 22:52:53,033][106225] Updated weights for policy 1, policy_version 507950 (0.0008) [2023-12-27 22:52:53,710][106226] Updated weights for policy 0, policy_version 506620 (0.0006) [2023-12-27 22:52:53,711][106225] Updated weights for policy 1, policy_version 507960 (0.0009) [2023-12-27 22:52:53,758][106225] Updated weights for policy 1, policy_version 507970 (0.0010) [2023-12-27 22:52:53,763][106226] Updated weights for policy 0, policy_version 506630 (0.0006) [2023-12-27 22:52:53,802][106225] Updated weights for policy 1, policy_version 507980 (0.0010) [2023-12-27 22:52:53,826][106226] Updated weights for policy 0, policy_version 506640 (0.0006) [2023-12-27 22:52:54,382][106226] Updated weights for policy 0, policy_version 506650 (0.0005) [2023-12-27 22:52:54,432][106226] Updated weights for policy 0, policy_version 506660 (0.0005) [2023-12-27 22:52:54,498][106226] Updated weights for policy 0, policy_version 506670 (0.0009) [2023-12-27 22:52:54,550][106226] Updated weights for policy 0, policy_version 506680 (0.0011) [2023-12-27 22:52:54,579][106225] Updated weights for policy 1, policy_version 507990 (0.0006) [2023-12-27 22:52:54,641][106225] Updated weights for policy 1, policy_version 508000 (0.0006) [2023-12-27 22:52:54,710][106225] Updated weights for policy 1, policy_version 508010 (0.0005) [2023-12-27 22:52:55,117][106226] Updated weights for policy 0, policy_version 506690 (0.0005) [2023-12-27 22:52:55,177][106226] Updated weights for policy 0, policy_version 506700 (0.0006) [2023-12-27 22:52:55,238][106226] Updated weights for policy 0, policy_version 506710 (0.0007) [2023-12-27 22:52:55,372][106225] Updated weights for policy 1, policy_version 508020 (0.0006) [2023-12-27 22:52:55,433][106225] Updated weights for policy 1, policy_version 508030 (0.0008) [2023-12-27 22:52:55,480][106225] Updated weights for policy 1, policy_version 508040 (0.0006) [2023-12-27 22:52:55,828][106226] Updated weights for policy 0, policy_version 506720 (0.0006) [2023-12-27 22:52:55,886][106226] Updated weights for policy 0, policy_version 506730 (0.0005) [2023-12-27 22:52:55,945][106226] Updated weights for policy 0, policy_version 506740 (0.0006) [2023-12-27 22:52:56,052][106225] Updated weights for policy 1, policy_version 508050 (0.0005) [2023-12-27 22:52:56,102][106225] Updated weights for policy 1, policy_version 508060 (0.0005) [2023-12-27 22:52:56,161][106225] Updated weights for policy 1, policy_version 508070 (0.0005) [2023-12-27 22:52:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 259850240. Throughput: 0: 9805.5, 1: 10008.3. Samples: 259818476. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:52:56,175][105115] Avg episode reward: [(0, '-5.282'), (1, '-5.209')] [2023-12-27 22:52:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000506744_129761280.pth... [2023-12-27 22:52:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000505592_129466368.pth [2023-12-27 22:52:56,229][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000508080_130097152.pth... [2023-12-27 22:52:56,230][106225] Updated weights for policy 1, policy_version 508080 (0.0005) [2023-12-27 22:52:56,234][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000506896_129794048.pth [2023-12-27 22:52:56,471][106226] Updated weights for policy 0, policy_version 506750 (0.0010) [2023-12-27 22:52:56,522][106226] Updated weights for policy 0, policy_version 506760 (0.0010) [2023-12-27 22:52:56,575][106226] Updated weights for policy 0, policy_version 506770 (0.0010) [2023-12-27 22:52:56,783][106225] Updated weights for policy 1, policy_version 508090 (0.0005) [2023-12-27 22:52:56,847][106225] Updated weights for policy 1, policy_version 508100 (0.0006) [2023-12-27 22:52:56,913][106225] Updated weights for policy 1, policy_version 508110 (0.0006) [2023-12-27 22:52:57,218][106226] Updated weights for policy 0, policy_version 506780 (0.0009) [2023-12-27 22:52:57,272][106226] Updated weights for policy 0, policy_version 506790 (0.0010) [2023-12-27 22:52:57,329][106226] Updated weights for policy 0, policy_version 506800 (0.0010) [2023-12-27 22:52:57,432][106225] Updated weights for policy 1, policy_version 508120 (0.0005) [2023-12-27 22:52:57,491][106225] Updated weights for policy 1, policy_version 508130 (0.0005) [2023-12-27 22:52:57,546][106225] Updated weights for policy 1, policy_version 508140 (0.0005) [2023-12-27 22:52:57,932][106226] Updated weights for policy 0, policy_version 506810 (0.0008) [2023-12-27 22:52:57,984][106226] Updated weights for policy 0, policy_version 506820 (0.0005) [2023-12-27 22:52:58,039][106226] Updated weights for policy 0, policy_version 506830 (0.0006) [2023-12-27 22:52:58,086][106226] Updated weights for policy 0, policy_version 506840 (0.0005) [2023-12-27 22:52:58,138][106225] Updated weights for policy 1, policy_version 508150 (0.0006) [2023-12-27 22:52:58,199][106225] Updated weights for policy 1, policy_version 508160 (0.0009) [2023-12-27 22:52:58,260][106225] Updated weights for policy 1, policy_version 508170 (0.0007) [2023-12-27 22:52:58,778][106226] Updated weights for policy 0, policy_version 506850 (0.0008) [2023-12-27 22:52:58,846][106226] Updated weights for policy 0, policy_version 506860 (0.0008) [2023-12-27 22:52:58,905][106226] Updated weights for policy 0, policy_version 506870 (0.0008) [2023-12-27 22:52:59,068][106225] Updated weights for policy 1, policy_version 508180 (0.0009) [2023-12-27 22:52:59,132][106225] Updated weights for policy 1, policy_version 508190 (0.0010) [2023-12-27 22:52:59,198][106225] Updated weights for policy 1, policy_version 508200 (0.0010) [2023-12-27 22:52:59,703][106226] Updated weights for policy 0, policy_version 506880 (0.0009) [2023-12-27 22:52:59,763][106226] Updated weights for policy 0, policy_version 506890 (0.0011) [2023-12-27 22:52:59,829][106226] Updated weights for policy 0, policy_version 506900 (0.0011) [2023-12-27 22:52:59,954][106225] Updated weights for policy 1, policy_version 508210 (0.0009) [2023-12-27 22:53:00,024][106225] Updated weights for policy 1, policy_version 508220 (0.0007) [2023-12-27 22:53:00,084][106225] Updated weights for policy 1, policy_version 508230 (0.0005) [2023-12-27 22:53:00,148][106225] Updated weights for policy 1, policy_version 508240 (0.0005) [2023-12-27 22:53:00,447][106226] Updated weights for policy 0, policy_version 506910 (0.0014) [2023-12-27 22:53:00,512][106226] Updated weights for policy 0, policy_version 506920 (0.0011) [2023-12-27 22:53:00,571][106226] Updated weights for policy 0, policy_version 506930 (0.0009) [2023-12-27 22:53:00,708][106225] Updated weights for policy 1, policy_version 508250 (0.0009) [2023-12-27 22:53:00,753][106225] Updated weights for policy 1, policy_version 508260 (0.0005) [2023-12-27 22:53:00,807][106225] Updated weights for policy 1, policy_version 508270 (0.0005) [2023-12-27 22:53:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 259956736. Throughput: 0: 10011.0, 1: 10093.1. Samples: 259945712. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:53:01,175][105115] Avg episode reward: [(0, '-5.121'), (1, '-5.449')] [2023-12-27 22:53:01,204][106226] Updated weights for policy 0, policy_version 506940 (0.0006) [2023-12-27 22:53:01,266][106226] Updated weights for policy 0, policy_version 506950 (0.0008) [2023-12-27 22:53:01,332][106226] Updated weights for policy 0, policy_version 506960 (0.0008) [2023-12-27 22:53:01,470][106225] Updated weights for policy 1, policy_version 508280 (0.0009) [2023-12-27 22:53:01,529][106225] Updated weights for policy 1, policy_version 508290 (0.0010) [2023-12-27 22:53:01,595][106225] Updated weights for policy 1, policy_version 508300 (0.0011) [2023-12-27 22:53:02,045][106226] Updated weights for policy 0, policy_version 506970 (0.0008) [2023-12-27 22:53:02,096][106226] Updated weights for policy 0, policy_version 506980 (0.0009) [2023-12-27 22:53:02,146][106226] Updated weights for policy 0, policy_version 506990 (0.0008) [2023-12-27 22:53:02,207][106226] Updated weights for policy 0, policy_version 507000 (0.0007) [2023-12-27 22:53:02,244][106225] Updated weights for policy 1, policy_version 508310 (0.0009) [2023-12-27 22:53:02,309][106225] Updated weights for policy 1, policy_version 508320 (0.0006) [2023-12-27 22:53:02,381][106225] Updated weights for policy 1, policy_version 508330 (0.0008) [2023-12-27 22:53:02,965][106226] Updated weights for policy 0, policy_version 507010 (0.0008) [2023-12-27 22:53:02,981][106225] Updated weights for policy 1, policy_version 508340 (0.0008) [2023-12-27 22:53:03,015][106226] Updated weights for policy 0, policy_version 507020 (0.0007) [2023-12-27 22:53:03,037][106225] Updated weights for policy 1, policy_version 508350 (0.0007) [2023-12-27 22:53:03,069][106226] Updated weights for policy 0, policy_version 507030 (0.0009) [2023-12-27 22:53:03,099][106225] Updated weights for policy 1, policy_version 508360 (0.0006) [2023-12-27 22:53:03,738][106226] Updated weights for policy 0, policy_version 507040 (0.0009) [2023-12-27 22:53:03,800][106226] Updated weights for policy 0, policy_version 507050 (0.0008) [2023-12-27 22:53:03,823][106225] Updated weights for policy 1, policy_version 508370 (0.0006) [2023-12-27 22:53:03,863][106226] Updated weights for policy 0, policy_version 507060 (0.0008) [2023-12-27 22:53:03,889][106225] Updated weights for policy 1, policy_version 508380 (0.0007) [2023-12-27 22:53:03,956][106225] Updated weights for policy 1, policy_version 508390 (0.0007) [2023-12-27 22:53:04,025][106225] Updated weights for policy 1, policy_version 508400 (0.0006) [2023-12-27 22:53:04,564][106225] Updated weights for policy 1, policy_version 508410 (0.0007) [2023-12-27 22:53:04,566][106226] Updated weights for policy 0, policy_version 507070 (0.0010) [2023-12-27 22:53:04,610][106225] Updated weights for policy 1, policy_version 508420 (0.0005) [2023-12-27 22:53:04,623][106226] Updated weights for policy 0, policy_version 507080 (0.0010) [2023-12-27 22:53:04,660][106225] Updated weights for policy 1, policy_version 508430 (0.0006) [2023-12-27 22:53:04,684][106226] Updated weights for policy 0, policy_version 507090 (0.0011) [2023-12-27 22:53:05,319][106225] Updated weights for policy 1, policy_version 508440 (0.0005) [2023-12-27 22:53:05,384][106225] Updated weights for policy 1, policy_version 508450 (0.0006) [2023-12-27 22:53:05,395][106226] Updated weights for policy 0, policy_version 507100 (0.0010) [2023-12-27 22:53:05,443][106225] Updated weights for policy 1, policy_version 508460 (0.0006) [2023-12-27 22:53:05,450][106226] Updated weights for policy 0, policy_version 507110 (0.0011) [2023-12-27 22:53:05,496][106226] Updated weights for policy 0, policy_version 507120 (0.0010) [2023-12-27 22:53:06,016][106225] Updated weights for policy 1, policy_version 508470 (0.0008) [2023-12-27 22:53:06,066][106225] Updated weights for policy 1, policy_version 508480 (0.0009) [2023-12-27 22:53:06,114][106225] Updated weights for policy 1, policy_version 508490 (0.0007) [2023-12-27 22:53:06,116][106226] Updated weights for policy 0, policy_version 507130 (0.0010) [2023-12-27 22:53:06,174][105115] Fps is (10 sec: 21299.6, 60 sec: 20206.9, 300 sec: 19799.7). Total num frames: 260063232. Throughput: 0: 10037.7, 1: 10214.5. Samples: 260071380. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:53:06,175][105115] Avg episode reward: [(0, '-5.075'), (1, '-5.453')] [2023-12-27 22:53:06,177][106226] Updated weights for policy 0, policy_version 507140 (0.0008) [2023-12-27 22:53:06,239][106226] Updated weights for policy 0, policy_version 507150 (0.0009) [2023-12-27 22:53:06,296][106226] Updated weights for policy 0, policy_version 507160 (0.0009) [2023-12-27 22:53:06,873][106225] Updated weights for policy 1, policy_version 508500 (0.0007) [2023-12-27 22:53:06,935][106225] Updated weights for policy 1, policy_version 508510 (0.0008) [2023-12-27 22:53:06,991][106225] Updated weights for policy 1, policy_version 508520 (0.0009) [2023-12-27 22:53:07,046][106226] Updated weights for policy 0, policy_version 507170 (0.0006) [2023-12-27 22:53:07,111][106226] Updated weights for policy 0, policy_version 507180 (0.0009) [2023-12-27 22:53:07,177][106226] Updated weights for policy 0, policy_version 507190 (0.0009) [2023-12-27 22:53:07,730][106226] Updated weights for policy 0, policy_version 507200 (0.0006) [2023-12-27 22:53:07,785][106226] Updated weights for policy 0, policy_version 507210 (0.0005) [2023-12-27 22:53:07,803][106225] Updated weights for policy 1, policy_version 508530 (0.0008) [2023-12-27 22:53:07,845][106226] Updated weights for policy 0, policy_version 507220 (0.0006) [2023-12-27 22:53:07,865][106225] Updated weights for policy 1, policy_version 508540 (0.0007) [2023-12-27 22:53:07,917][106225] Updated weights for policy 1, policy_version 508550 (0.0008) [2023-12-27 22:53:07,972][106225] Updated weights for policy 1, policy_version 508560 (0.0008) [2023-12-27 22:53:08,391][106226] Updated weights for policy 0, policy_version 507230 (0.0007) [2023-12-27 22:53:08,462][106226] Updated weights for policy 0, policy_version 507240 (0.0008) [2023-12-27 22:53:08,529][106226] Updated weights for policy 0, policy_version 507250 (0.0008) [2023-12-27 22:53:08,774][106225] Updated weights for policy 1, policy_version 508570 (0.0009) [2023-12-27 22:53:08,838][106225] Updated weights for policy 1, policy_version 508580 (0.0009) [2023-12-27 22:53:08,908][106225] Updated weights for policy 1, policy_version 508590 (0.0009) [2023-12-27 22:53:09,116][106226] Updated weights for policy 0, policy_version 507260 (0.0008) [2023-12-27 22:53:09,169][106226] Updated weights for policy 0, policy_version 507270 (0.0008) [2023-12-27 22:53:09,220][106226] Updated weights for policy 0, policy_version 507280 (0.0008) [2023-12-27 22:53:09,700][106225] Updated weights for policy 1, policy_version 508600 (0.0008) [2023-12-27 22:53:09,765][106225] Updated weights for policy 1, policy_version 508610 (0.0007) [2023-12-27 22:53:09,841][106225] Updated weights for policy 1, policy_version 508620 (0.0008) [2023-12-27 22:53:10,001][106226] Updated weights for policy 0, policy_version 507290 (0.0009) [2023-12-27 22:53:10,071][106226] Updated weights for policy 0, policy_version 507300 (0.0010) [2023-12-27 22:53:10,134][106226] Updated weights for policy 0, policy_version 507310 (0.0011) [2023-12-27 22:53:10,194][106226] Updated weights for policy 0, policy_version 507320 (0.0011) [2023-12-27 22:53:10,562][106225] Updated weights for policy 1, policy_version 508630 (0.0007) [2023-12-27 22:53:10,624][106225] Updated weights for policy 1, policy_version 508640 (0.0005) [2023-12-27 22:53:10,696][106225] Updated weights for policy 1, policy_version 508650 (0.0008) [2023-12-27 22:53:10,886][106226] Updated weights for policy 0, policy_version 507330 (0.0006) [2023-12-27 22:53:10,954][106226] Updated weights for policy 0, policy_version 507340 (0.0008) [2023-12-27 22:53:11,019][106226] Updated weights for policy 0, policy_version 507350 (0.0008) [2023-12-27 22:53:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20207.0, 300 sec: 19799.6). Total num frames: 260161536. Throughput: 0: 10130.8, 1: 10163.7. Samples: 260131432. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-27 22:53:11,175][105115] Avg episode reward: [(0, '-5.394'), (1, '-5.392')] [2023-12-27 22:53:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000508656_130244608.pth... [2023-12-27 22:53:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000507352_129916928.pth... [2023-12-27 22:53:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000506136_129605632.pth [2023-12-27 22:53:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000507472_129941504.pth [2023-12-27 22:53:11,524][106225] Updated weights for policy 1, policy_version 508660 (0.0009) [2023-12-27 22:53:11,586][106225] Updated weights for policy 1, policy_version 508670 (0.0010) [2023-12-27 22:53:11,664][106225] Updated weights for policy 1, policy_version 508680 (0.0010) [2023-12-27 22:53:11,871][106226] Updated weights for policy 0, policy_version 507360 (0.0010) [2023-12-27 22:53:11,944][106226] Updated weights for policy 0, policy_version 507370 (0.0009) [2023-12-27 22:53:12,004][106226] Updated weights for policy 0, policy_version 507380 (0.0010) [2023-12-27 22:53:12,414][106225] Updated weights for policy 1, policy_version 508690 (0.0009) [2023-12-27 22:53:12,469][106225] Updated weights for policy 1, policy_version 508700 (0.0007) [2023-12-27 22:53:12,529][106225] Updated weights for policy 1, policy_version 508710 (0.0008) [2023-12-27 22:53:12,589][106225] Updated weights for policy 1, policy_version 508720 (0.0009) [2023-12-27 22:53:12,692][106226] Updated weights for policy 0, policy_version 507390 (0.0008) [2023-12-27 22:53:12,747][106226] Updated weights for policy 0, policy_version 507400 (0.0009) [2023-12-27 22:53:12,801][106226] Updated weights for policy 0, policy_version 507410 (0.0009) [2023-12-27 22:53:13,216][106225] Updated weights for policy 1, policy_version 508730 (0.0006) [2023-12-27 22:53:13,271][106225] Updated weights for policy 1, policy_version 508740 (0.0006) [2023-12-27 22:53:13,332][106225] Updated weights for policy 1, policy_version 508750 (0.0008) [2023-12-27 22:53:13,415][106226] Updated weights for policy 0, policy_version 507420 (0.0007) [2023-12-27 22:53:13,464][106226] Updated weights for policy 0, policy_version 507430 (0.0010) [2023-12-27 22:53:13,514][106226] Updated weights for policy 0, policy_version 507440 (0.0010) [2023-12-27 22:53:13,975][106225] Updated weights for policy 1, policy_version 508760 (0.0010) [2023-12-27 22:53:14,032][106225] Updated weights for policy 1, policy_version 508770 (0.0010) [2023-12-27 22:53:14,088][106225] Updated weights for policy 1, policy_version 508780 (0.0007) [2023-12-27 22:53:14,237][106226] Updated weights for policy 0, policy_version 507450 (0.0010) [2023-12-27 22:53:14,294][106226] Updated weights for policy 0, policy_version 507460 (0.0008) [2023-12-27 22:53:14,348][106226] Updated weights for policy 0, policy_version 507470 (0.0007) [2023-12-27 22:53:14,412][106226] Updated weights for policy 0, policy_version 507480 (0.0008) [2023-12-27 22:53:14,759][106225] Updated weights for policy 1, policy_version 508790 (0.0010) [2023-12-27 22:53:14,825][106225] Updated weights for policy 1, policy_version 508800 (0.0010) [2023-12-27 22:53:14,885][106225] Updated weights for policy 1, policy_version 508810 (0.0008) [2023-12-27 22:53:15,182][106226] Updated weights for policy 0, policy_version 507490 (0.0010) [2023-12-27 22:53:15,249][106226] Updated weights for policy 0, policy_version 507500 (0.0011) [2023-12-27 22:53:15,316][106226] Updated weights for policy 0, policy_version 507510 (0.0010) [2023-12-27 22:53:15,566][106225] Updated weights for policy 1, policy_version 508820 (0.0008) [2023-12-27 22:53:15,628][106225] Updated weights for policy 1, policy_version 508830 (0.0008) [2023-12-27 22:53:15,673][106225] Updated weights for policy 1, policy_version 508840 (0.0008) [2023-12-27 22:53:15,928][106226] Updated weights for policy 0, policy_version 507520 (0.0008) [2023-12-27 22:53:15,982][106226] Updated weights for policy 0, policy_version 507530 (0.0009) [2023-12-27 22:53:16,038][106226] Updated weights for policy 0, policy_version 507540 (0.0008) [2023-12-27 22:53:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19799.6). Total num frames: 260259840. Throughput: 0: 10076.4, 1: 10063.7. Samples: 260246236. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:16,175][105115] Avg episode reward: [(0, '-4.995'), (1, '-5.204')] [2023-12-27 22:53:16,396][106225] Updated weights for policy 1, policy_version 508850 (0.0008) [2023-12-27 22:53:16,458][106225] Updated weights for policy 1, policy_version 508860 (0.0008) [2023-12-27 22:53:16,526][106225] Updated weights for policy 1, policy_version 508870 (0.0007) [2023-12-27 22:53:16,590][106225] Updated weights for policy 1, policy_version 508880 (0.0008) [2023-12-27 22:53:16,797][106226] Updated weights for policy 0, policy_version 507550 (0.0007) [2023-12-27 22:53:16,857][106226] Updated weights for policy 0, policy_version 507560 (0.0005) [2023-12-27 22:53:16,920][106226] Updated weights for policy 0, policy_version 507570 (0.0007) [2023-12-27 22:53:17,215][106225] Updated weights for policy 1, policy_version 508890 (0.0008) [2023-12-27 22:53:17,279][106225] Updated weights for policy 1, policy_version 508900 (0.0009) [2023-12-27 22:53:17,326][106225] Updated weights for policy 1, policy_version 508910 (0.0006) [2023-12-27 22:53:17,605][106226] Updated weights for policy 0, policy_version 507580 (0.0008) [2023-12-27 22:53:17,657][106226] Updated weights for policy 0, policy_version 507590 (0.0009) [2023-12-27 22:53:17,711][106226] Updated weights for policy 0, policy_version 507600 (0.0010) [2023-12-27 22:53:17,916][106225] Updated weights for policy 1, policy_version 508920 (0.0006) [2023-12-27 22:53:17,984][106225] Updated weights for policy 1, policy_version 508930 (0.0008) [2023-12-27 22:53:18,045][106225] Updated weights for policy 1, policy_version 508940 (0.0008) [2023-12-27 22:53:18,512][106226] Updated weights for policy 0, policy_version 507610 (0.0009) [2023-12-27 22:53:18,572][106226] Updated weights for policy 0, policy_version 507620 (0.0009) [2023-12-27 22:53:18,634][106226] Updated weights for policy 0, policy_version 507630 (0.0009) [2023-12-27 22:53:18,684][106226] Updated weights for policy 0, policy_version 507640 (0.0009) [2023-12-27 22:53:18,766][106225] Updated weights for policy 1, policy_version 508950 (0.0008) [2023-12-27 22:53:18,818][106225] Updated weights for policy 1, policy_version 508960 (0.0008) [2023-12-27 22:53:18,877][106225] Updated weights for policy 1, policy_version 508970 (0.0008) [2023-12-27 22:53:19,417][106226] Updated weights for policy 0, policy_version 507650 (0.0008) [2023-12-27 22:53:19,481][106226] Updated weights for policy 0, policy_version 507660 (0.0010) [2023-12-27 22:53:19,541][106226] Updated weights for policy 0, policy_version 507670 (0.0008) [2023-12-27 22:53:19,542][106225] Updated weights for policy 1, policy_version 508980 (0.0008) [2023-12-27 22:53:19,601][106225] Updated weights for policy 1, policy_version 508990 (0.0008) [2023-12-27 22:53:19,661][106225] Updated weights for policy 1, policy_version 509000 (0.0008) [2023-12-27 22:53:20,234][106226] Updated weights for policy 0, policy_version 507680 (0.0007) [2023-12-27 22:53:20,289][106226] Updated weights for policy 0, policy_version 507690 (0.0007) [2023-12-27 22:53:20,347][106226] Updated weights for policy 0, policy_version 507700 (0.0009) [2023-12-27 22:53:20,446][106225] Updated weights for policy 1, policy_version 509010 (0.0009) [2023-12-27 22:53:20,501][106225] Updated weights for policy 1, policy_version 509020 (0.0009) [2023-12-27 22:53:20,561][106225] Updated weights for policy 1, policy_version 509030 (0.0010) [2023-12-27 22:53:20,624][106225] Updated weights for policy 1, policy_version 509040 (0.0009) [2023-12-27 22:53:21,003][106226] Updated weights for policy 0, policy_version 507710 (0.0008) [2023-12-27 22:53:21,072][106226] Updated weights for policy 0, policy_version 507720 (0.0008) [2023-12-27 22:53:21,140][106226] Updated weights for policy 0, policy_version 507730 (0.0008) [2023-12-27 22:53:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 260349952. Throughput: 0: 10064.1, 1: 10056.3. Samples: 260364800. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:21,175][105115] Avg episode reward: [(0, '-4.973'), (1, '-5.477')] [2023-12-27 22:53:21,367][106225] Updated weights for policy 1, policy_version 509050 (0.0007) [2023-12-27 22:53:21,436][106225] Updated weights for policy 1, policy_version 509060 (0.0009) [2023-12-27 22:53:21,492][106225] Updated weights for policy 1, policy_version 509070 (0.0009) [2023-12-27 22:53:21,906][106226] Updated weights for policy 0, policy_version 507740 (0.0008) [2023-12-27 22:53:21,976][106226] Updated weights for policy 0, policy_version 507750 (0.0009) [2023-12-27 22:53:22,035][106226] Updated weights for policy 0, policy_version 507760 (0.0007) [2023-12-27 22:53:22,185][106225] Updated weights for policy 1, policy_version 509080 (0.0006) [2023-12-27 22:53:22,239][106225] Updated weights for policy 1, policy_version 509090 (0.0006) [2023-12-27 22:53:22,311][106225] Updated weights for policy 1, policy_version 509100 (0.0007) [2023-12-27 22:53:22,819][106226] Updated weights for policy 0, policy_version 507770 (0.0008) [2023-12-27 22:53:22,870][106226] Updated weights for policy 0, policy_version 507780 (0.0007) [2023-12-27 22:53:22,930][106226] Updated weights for policy 0, policy_version 507790 (0.0008) [2023-12-27 22:53:22,988][106226] Updated weights for policy 0, policy_version 507800 (0.0008) [2023-12-27 22:53:23,016][106225] Updated weights for policy 1, policy_version 509110 (0.0007) [2023-12-27 22:53:23,066][106225] Updated weights for policy 1, policy_version 509120 (0.0008) [2023-12-27 22:53:23,115][106225] Updated weights for policy 1, policy_version 509130 (0.0007) [2023-12-27 22:53:23,693][106226] Updated weights for policy 0, policy_version 507810 (0.0008) [2023-12-27 22:53:23,752][106226] Updated weights for policy 0, policy_version 507820 (0.0006) [2023-12-27 22:53:23,774][106225] Updated weights for policy 1, policy_version 509140 (0.0006) [2023-12-27 22:53:23,801][106226] Updated weights for policy 0, policy_version 507830 (0.0007) [2023-12-27 22:53:23,835][106225] Updated weights for policy 1, policy_version 509150 (0.0007) [2023-12-27 22:53:23,905][106225] Updated weights for policy 1, policy_version 509160 (0.0006) [2023-12-27 22:53:24,433][106225] Updated weights for policy 1, policy_version 509170 (0.0006) [2023-12-27 22:53:24,487][106225] Updated weights for policy 1, policy_version 509180 (0.0005) [2023-12-27 22:53:24,491][106226] Updated weights for policy 0, policy_version 507840 (0.0008) [2023-12-27 22:53:24,540][106225] Updated weights for policy 1, policy_version 509190 (0.0006) [2023-12-27 22:53:24,546][106226] Updated weights for policy 0, policy_version 507850 (0.0008) [2023-12-27 22:53:24,592][106226] Updated weights for policy 0, policy_version 507860 (0.0005) [2023-12-27 22:53:24,602][106225] Updated weights for policy 1, policy_version 509200 (0.0007) [2023-12-27 22:53:25,224][106225] Updated weights for policy 1, policy_version 509210 (0.0007) [2023-12-27 22:53:25,256][106226] Updated weights for policy 0, policy_version 507870 (0.0006) [2023-12-27 22:53:25,270][106225] Updated weights for policy 1, policy_version 509220 (0.0008) [2023-12-27 22:53:25,316][106226] Updated weights for policy 0, policy_version 507880 (0.0005) [2023-12-27 22:53:25,327][106225] Updated weights for policy 1, policy_version 509230 (0.0008) [2023-12-27 22:53:25,373][106226] Updated weights for policy 0, policy_version 507890 (0.0005) [2023-12-27 22:53:25,949][106226] Updated weights for policy 0, policy_version 507900 (0.0007) [2023-12-27 22:53:25,997][106225] Updated weights for policy 1, policy_version 509240 (0.0006) [2023-12-27 22:53:26,003][106226] Updated weights for policy 0, policy_version 507910 (0.0007) [2023-12-27 22:53:26,046][106225] Updated weights for policy 1, policy_version 509250 (0.0007) [2023-12-27 22:53:26,051][106226] Updated weights for policy 0, policy_version 507920 (0.0007) [2023-12-27 22:53:26,102][106225] Updated weights for policy 1, policy_version 509260 (0.0007) [2023-12-27 22:53:26,175][105115] Fps is (10 sec: 20479.4, 60 sec: 20206.8, 300 sec: 19827.4). Total num frames: 260464640. Throughput: 0: 10019.7, 1: 10026.3. Samples: 260422796. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:26,176][105115] Avg episode reward: [(0, '-5.370'), (1, '-5.578')] [2023-12-27 22:53:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000509264_130400256.pth... [2023-12-27 22:53:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000507928_130064384.pth... [2023-12-27 22:53:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000508080_130097152.pth [2023-12-27 22:53:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000506744_129761280.pth [2023-12-27 22:53:26,626][106226] Updated weights for policy 0, policy_version 507930 (0.0005) [2023-12-27 22:53:26,688][106226] Updated weights for policy 0, policy_version 507940 (0.0005) [2023-12-27 22:53:26,728][106225] Updated weights for policy 1, policy_version 509270 (0.0005) [2023-12-27 22:53:26,745][106226] Updated weights for policy 0, policy_version 507950 (0.0006) [2023-12-27 22:53:26,788][106225] Updated weights for policy 1, policy_version 509280 (0.0005) [2023-12-27 22:53:26,793][106226] Updated weights for policy 0, policy_version 507960 (0.0009) [2023-12-27 22:53:26,841][106225] Updated weights for policy 1, policy_version 509290 (0.0005) [2023-12-27 22:53:27,388][106226] Updated weights for policy 0, policy_version 507970 (0.0010) [2023-12-27 22:53:27,426][106225] Updated weights for policy 1, policy_version 509300 (0.0007) [2023-12-27 22:53:27,434][106226] Updated weights for policy 0, policy_version 507980 (0.0010) [2023-12-27 22:53:27,472][106225] Updated weights for policy 1, policy_version 509310 (0.0010) [2023-12-27 22:53:27,481][106226] Updated weights for policy 0, policy_version 507990 (0.0010) [2023-12-27 22:53:27,519][106225] Updated weights for policy 1, policy_version 509320 (0.0010) [2023-12-27 22:53:28,101][106226] Updated weights for policy 0, policy_version 508000 (0.0006) [2023-12-27 22:53:28,120][106225] Updated weights for policy 1, policy_version 509330 (0.0010) [2023-12-27 22:53:28,150][106226] Updated weights for policy 0, policy_version 508010 (0.0005) [2023-12-27 22:53:28,168][106225] Updated weights for policy 1, policy_version 509340 (0.0008) [2023-12-27 22:53:28,209][106226] Updated weights for policy 0, policy_version 508020 (0.0005) [2023-12-27 22:53:28,214][106225] Updated weights for policy 1, policy_version 509350 (0.0008) [2023-12-27 22:53:28,262][106225] Updated weights for policy 1, policy_version 509360 (0.0007) [2023-12-27 22:53:28,877][106226] Updated weights for policy 0, policy_version 508030 (0.0008) [2023-12-27 22:53:28,879][106225] Updated weights for policy 1, policy_version 509370 (0.0007) [2023-12-27 22:53:28,939][106225] Updated weights for policy 1, policy_version 509380 (0.0007) [2023-12-27 22:53:28,942][106226] Updated weights for policy 0, policy_version 508040 (0.0008) [2023-12-27 22:53:28,989][106225] Updated weights for policy 1, policy_version 509390 (0.0007) [2023-12-27 22:53:29,002][106226] Updated weights for policy 0, policy_version 508050 (0.0008) [2023-12-27 22:53:29,696][106226] Updated weights for policy 0, policy_version 508060 (0.0010) [2023-12-27 22:53:29,748][106226] Updated weights for policy 0, policy_version 508070 (0.0006) [2023-12-27 22:53:29,753][106225] Updated weights for policy 1, policy_version 509400 (0.0007) [2023-12-27 22:53:29,806][106226] Updated weights for policy 0, policy_version 508080 (0.0005) [2023-12-27 22:53:29,812][106225] Updated weights for policy 1, policy_version 509410 (0.0007) [2023-12-27 22:53:29,885][106225] Updated weights for policy 1, policy_version 509420 (0.0008) [2023-12-27 22:53:30,438][106226] Updated weights for policy 0, policy_version 508090 (0.0006) [2023-12-27 22:53:30,498][106226] Updated weights for policy 0, policy_version 508100 (0.0005) [2023-12-27 22:53:30,524][106225] Updated weights for policy 1, policy_version 509430 (0.0009) [2023-12-27 22:53:30,557][106226] Updated weights for policy 0, policy_version 508110 (0.0006) [2023-12-27 22:53:30,591][106225] Updated weights for policy 1, policy_version 509440 (0.0006) [2023-12-27 22:53:30,618][106226] Updated weights for policy 0, policy_version 508120 (0.0008) [2023-12-27 22:53:30,657][106225] Updated weights for policy 1, policy_version 509450 (0.0005) [2023-12-27 22:53:31,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 260562944. Throughput: 0: 10193.7, 1: 10190.6. Samples: 260553896. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:31,175][105115] Avg episode reward: [(0, '-5.389'), (1, '-5.610')] [2023-12-27 22:53:31,210][106226] Updated weights for policy 0, policy_version 508130 (0.0008) [2023-12-27 22:53:31,223][106225] Updated weights for policy 1, policy_version 509460 (0.0006) [2023-12-27 22:53:31,264][106226] Updated weights for policy 0, policy_version 508140 (0.0008) [2023-12-27 22:53:31,292][106225] Updated weights for policy 1, policy_version 509470 (0.0008) [2023-12-27 22:53:31,334][106226] Updated weights for policy 0, policy_version 508150 (0.0007) [2023-12-27 22:53:31,350][106225] Updated weights for policy 1, policy_version 509480 (0.0008) [2023-12-27 22:53:32,018][106226] Updated weights for policy 0, policy_version 508160 (0.0006) [2023-12-27 22:53:32,053][106225] Updated weights for policy 1, policy_version 509490 (0.0007) [2023-12-27 22:53:32,076][106226] Updated weights for policy 0, policy_version 508170 (0.0006) [2023-12-27 22:53:32,113][106225] Updated weights for policy 1, policy_version 509500 (0.0006) [2023-12-27 22:53:32,138][106226] Updated weights for policy 0, policy_version 508180 (0.0007) [2023-12-27 22:53:32,169][106225] Updated weights for policy 1, policy_version 509510 (0.0006) [2023-12-27 22:53:32,232][106225] Updated weights for policy 1, policy_version 509520 (0.0008) [2023-12-27 22:53:32,828][106226] Updated weights for policy 0, policy_version 508190 (0.0010) [2023-12-27 22:53:32,885][106226] Updated weights for policy 0, policy_version 508200 (0.0010) [2023-12-27 22:53:32,943][106226] Updated weights for policy 0, policy_version 508210 (0.0009) [2023-12-27 22:53:33,004][106225] Updated weights for policy 1, policy_version 509530 (0.0007) [2023-12-27 22:53:33,056][106225] Updated weights for policy 1, policy_version 509540 (0.0009) [2023-12-27 22:53:33,109][106225] Updated weights for policy 1, policy_version 509550 (0.0008) [2023-12-27 22:53:33,498][106226] Updated weights for policy 0, policy_version 508220 (0.0009) [2023-12-27 22:53:33,552][106226] Updated weights for policy 0, policy_version 508230 (0.0005) [2023-12-27 22:53:33,608][106226] Updated weights for policy 0, policy_version 508240 (0.0005) [2023-12-27 22:53:33,779][106225] Updated weights for policy 1, policy_version 509560 (0.0008) [2023-12-27 22:53:33,830][106225] Updated weights for policy 1, policy_version 509570 (0.0007) [2023-12-27 22:53:33,890][106225] Updated weights for policy 1, policy_version 509580 (0.0006) [2023-12-27 22:53:34,115][106226] Updated weights for policy 0, policy_version 508250 (0.0005) [2023-12-27 22:53:34,183][106226] Updated weights for policy 0, policy_version 508260 (0.0009) [2023-12-27 22:53:34,252][106226] Updated weights for policy 0, policy_version 508270 (0.0011) [2023-12-27 22:53:34,317][106226] Updated weights for policy 0, policy_version 508280 (0.0011) [2023-12-27 22:53:34,658][106225] Updated weights for policy 1, policy_version 509590 (0.0008) [2023-12-27 22:53:34,721][106225] Updated weights for policy 1, policy_version 509600 (0.0008) [2023-12-27 22:53:34,788][106225] Updated weights for policy 1, policy_version 509610 (0.0008) [2023-12-27 22:53:34,961][106226] Updated weights for policy 0, policy_version 508290 (0.0005) [2023-12-27 22:53:35,019][106226] Updated weights for policy 0, policy_version 508300 (0.0005) [2023-12-27 22:53:35,074][106226] Updated weights for policy 0, policy_version 508310 (0.0006) [2023-12-27 22:53:35,546][106225] Updated weights for policy 1, policy_version 509620 (0.0009) [2023-12-27 22:53:35,603][106225] Updated weights for policy 1, policy_version 509630 (0.0009) [2023-12-27 22:53:35,661][106225] Updated weights for policy 1, policy_version 509640 (0.0008) [2023-12-27 22:53:35,696][106226] Updated weights for policy 0, policy_version 508320 (0.0010) [2023-12-27 22:53:35,743][106226] Updated weights for policy 0, policy_version 508330 (0.0007) [2023-12-27 22:53:35,791][106226] Updated weights for policy 0, policy_version 508340 (0.0006) [2023-12-27 22:53:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20343.5, 300 sec: 19855.2). Total num frames: 260669440. Throughput: 0: 10299.8, 1: 10122.2. Samples: 260678160. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:36,175][105115] Avg episode reward: [(0, '-5.104'), (1, '-5.226')] [2023-12-27 22:53:36,322][106225] Updated weights for policy 1, policy_version 509650 (0.0006) [2023-12-27 22:53:36,394][106225] Updated weights for policy 1, policy_version 509660 (0.0007) [2023-12-27 22:53:36,464][106225] Updated weights for policy 1, policy_version 509670 (0.0009) [2023-12-27 22:53:36,508][106226] Updated weights for policy 0, policy_version 508350 (0.0007) [2023-12-27 22:53:36,531][106225] Updated weights for policy 1, policy_version 509680 (0.0007) [2023-12-27 22:53:36,575][106226] Updated weights for policy 0, policy_version 508360 (0.0007) [2023-12-27 22:53:36,632][106226] Updated weights for policy 0, policy_version 508370 (0.0009) [2023-12-27 22:53:37,219][106225] Updated weights for policy 1, policy_version 509690 (0.0005) [2023-12-27 22:53:37,251][106226] Updated weights for policy 0, policy_version 508380 (0.0009) [2023-12-27 22:53:37,277][106225] Updated weights for policy 1, policy_version 509700 (0.0005) [2023-12-27 22:53:37,310][106226] Updated weights for policy 0, policy_version 508390 (0.0007) [2023-12-27 22:53:37,333][106225] Updated weights for policy 1, policy_version 509710 (0.0005) [2023-12-27 22:53:37,377][106226] Updated weights for policy 0, policy_version 508400 (0.0005) [2023-12-27 22:53:38,020][106226] Updated weights for policy 0, policy_version 508410 (0.0006) [2023-12-27 22:53:38,026][106225] Updated weights for policy 1, policy_version 509720 (0.0007) [2023-12-27 22:53:38,070][106226] Updated weights for policy 0, policy_version 508420 (0.0010) [2023-12-27 22:53:38,072][106225] Updated weights for policy 1, policy_version 509730 (0.0007) [2023-12-27 22:53:38,126][106225] Updated weights for policy 1, policy_version 509740 (0.0007) [2023-12-27 22:53:38,127][106226] Updated weights for policy 0, policy_version 508430 (0.0010) [2023-12-27 22:53:38,190][106226] Updated weights for policy 0, policy_version 508440 (0.0011) [2023-12-27 22:53:38,757][106225] Updated weights for policy 1, policy_version 509750 (0.0005) [2023-12-27 22:53:38,809][106225] Updated weights for policy 1, policy_version 509760 (0.0005) [2023-12-27 22:53:38,870][106225] Updated weights for policy 1, policy_version 509770 (0.0005) [2023-12-27 22:53:38,877][106226] Updated weights for policy 0, policy_version 508450 (0.0011) [2023-12-27 22:53:38,939][106226] Updated weights for policy 0, policy_version 508460 (0.0009) [2023-12-27 22:53:39,004][106226] Updated weights for policy 0, policy_version 508470 (0.0005) [2023-12-27 22:53:39,574][106225] Updated weights for policy 1, policy_version 509780 (0.0008) [2023-12-27 22:53:39,625][106225] Updated weights for policy 1, policy_version 509790 (0.0010) [2023-12-27 22:53:39,687][106225] Updated weights for policy 1, policy_version 509800 (0.0011) [2023-12-27 22:53:39,725][106226] Updated weights for policy 0, policy_version 508480 (0.0008) [2023-12-27 22:53:39,775][106226] Updated weights for policy 0, policy_version 508490 (0.0008) [2023-12-27 22:53:39,840][106226] Updated weights for policy 0, policy_version 508500 (0.0008) [2023-12-27 22:53:40,449][106225] Updated weights for policy 1, policy_version 509810 (0.0009) [2023-12-27 22:53:40,515][106225] Updated weights for policy 1, policy_version 509820 (0.0006) [2023-12-27 22:53:40,543][106226] Updated weights for policy 0, policy_version 508510 (0.0007) [2023-12-27 22:53:40,580][106225] Updated weights for policy 1, policy_version 509830 (0.0005) [2023-12-27 22:53:40,603][106226] Updated weights for policy 0, policy_version 508520 (0.0006) [2023-12-27 22:53:40,634][106225] Updated weights for policy 1, policy_version 509840 (0.0005) [2023-12-27 22:53:40,670][106226] Updated weights for policy 0, policy_version 508530 (0.0005) [2023-12-27 22:53:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20343.5, 300 sec: 19855.2). Total num frames: 260767744. Throughput: 0: 10324.2, 1: 10164.0. Samples: 260740444. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:41,175][105115] Avg episode reward: [(0, '-5.169'), (1, '-5.433')] [2023-12-27 22:53:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000508536_130220032.pth... [2023-12-27 22:53:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000507352_129916928.pth [2023-12-27 22:53:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000508536_130220032.pth [2023-12-27 22:53:41,209][106225] Updated weights for policy 1, policy_version 509850 (0.0011) [2023-12-27 22:53:41,273][106225] Updated weights for policy 1, policy_version 509860 (0.0010) [2023-12-27 22:53:41,339][106225] Updated weights for policy 1, policy_version 509870 (0.0009) [2023-12-27 22:53:41,351][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000509872_130555904.pth... [2023-12-27 22:53:41,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000508656_130244608.pth [2023-12-27 22:53:41,356][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000509872_130555904.pth [2023-12-27 22:53:41,475][106226] Updated weights for policy 0, policy_version 508540 (0.0006) [2023-12-27 22:53:41,533][106226] Updated weights for policy 0, policy_version 508550 (0.0007) [2023-12-27 22:53:41,593][106226] Updated weights for policy 0, policy_version 508560 (0.0008) [2023-12-27 22:53:42,171][106225] Updated weights for policy 1, policy_version 509880 (0.0008) [2023-12-27 22:53:42,226][106225] Updated weights for policy 1, policy_version 509890 (0.0008) [2023-12-27 22:53:42,293][106225] Updated weights for policy 1, policy_version 509900 (0.0010) [2023-12-27 22:53:42,408][106226] Updated weights for policy 0, policy_version 508570 (0.0009) [2023-12-27 22:53:42,475][106226] Updated weights for policy 0, policy_version 508580 (0.0007) [2023-12-27 22:53:42,546][106226] Updated weights for policy 0, policy_version 508590 (0.0006) [2023-12-27 22:53:42,616][106226] Updated weights for policy 0, policy_version 508600 (0.0006) [2023-12-27 22:53:43,020][106225] Updated weights for policy 1, policy_version 509910 (0.0007) [2023-12-27 22:53:43,087][106225] Updated weights for policy 1, policy_version 509920 (0.0007) [2023-12-27 22:53:43,146][106225] Updated weights for policy 1, policy_version 509930 (0.0006) [2023-12-27 22:53:43,317][106226] Updated weights for policy 0, policy_version 508610 (0.0010) [2023-12-27 22:53:43,370][106226] Updated weights for policy 0, policy_version 508620 (0.0006) [2023-12-27 22:53:43,422][106226] Updated weights for policy 0, policy_version 508630 (0.0007) [2023-12-27 22:53:43,694][106225] Updated weights for policy 1, policy_version 509940 (0.0005) [2023-12-27 22:53:43,760][106225] Updated weights for policy 1, policy_version 509950 (0.0007) [2023-12-27 22:53:43,814][106225] Updated weights for policy 1, policy_version 509960 (0.0008) [2023-12-27 22:53:44,066][106226] Updated weights for policy 0, policy_version 508640 (0.0010) [2023-12-27 22:53:44,138][106226] Updated weights for policy 0, policy_version 508650 (0.0011) [2023-12-27 22:53:44,202][106226] Updated weights for policy 0, policy_version 508660 (0.0009) [2023-12-27 22:53:44,509][106225] Updated weights for policy 1, policy_version 509970 (0.0007) [2023-12-27 22:53:44,566][106225] Updated weights for policy 1, policy_version 509980 (0.0007) [2023-12-27 22:53:44,622][106225] Updated weights for policy 1, policy_version 509990 (0.0008) [2023-12-27 22:53:44,672][106225] Updated weights for policy 1, policy_version 510000 (0.0009) [2023-12-27 22:53:44,854][106226] Updated weights for policy 0, policy_version 508670 (0.0006) [2023-12-27 22:53:44,909][106226] Updated weights for policy 0, policy_version 508680 (0.0009) [2023-12-27 22:53:44,975][106226] Updated weights for policy 0, policy_version 508690 (0.0006) [2023-12-27 22:53:45,450][106225] Updated weights for policy 1, policy_version 510010 (0.0009) [2023-12-27 22:53:45,509][106225] Updated weights for policy 1, policy_version 510020 (0.0008) [2023-12-27 22:53:45,569][106225] Updated weights for policy 1, policy_version 510030 (0.0010) [2023-12-27 22:53:45,640][106226] Updated weights for policy 0, policy_version 508700 (0.0006) [2023-12-27 22:53:45,701][106226] Updated weights for policy 0, policy_version 508710 (0.0005) [2023-12-27 22:53:45,759][106226] Updated weights for policy 0, policy_version 508720 (0.0006) [2023-12-27 22:53:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20343.4, 300 sec: 19855.2). Total num frames: 260866048. Throughput: 0: 10152.0, 1: 10098.8. Samples: 260857000. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:46,175][105115] Avg episode reward: [(0, '-5.173'), (1, '-5.514')] [2023-12-27 22:53:46,302][106226] Updated weights for policy 0, policy_version 508730 (0.0006) [2023-12-27 22:53:46,351][106226] Updated weights for policy 0, policy_version 508740 (0.0007) [2023-12-27 22:53:46,354][106225] Updated weights for policy 1, policy_version 510040 (0.0006) [2023-12-27 22:53:46,401][106226] Updated weights for policy 0, policy_version 508750 (0.0006) [2023-12-27 22:53:46,407][106225] Updated weights for policy 1, policy_version 510050 (0.0008) [2023-12-27 22:53:46,451][106225] Updated weights for policy 1, policy_version 510060 (0.0007) [2023-12-27 22:53:46,453][106226] Updated weights for policy 0, policy_version 508760 (0.0009) [2023-12-27 22:53:47,091][106225] Updated weights for policy 1, policy_version 510070 (0.0006) [2023-12-27 22:53:47,151][106225] Updated weights for policy 1, policy_version 510080 (0.0005) [2023-12-27 22:53:47,167][106226] Updated weights for policy 0, policy_version 508770 (0.0008) [2023-12-27 22:53:47,200][106225] Updated weights for policy 1, policy_version 510090 (0.0005) [2023-12-27 22:53:47,219][106226] Updated weights for policy 0, policy_version 508780 (0.0008) [2023-12-27 22:53:47,276][106226] Updated weights for policy 0, policy_version 508790 (0.0009) [2023-12-27 22:53:47,770][106225] Updated weights for policy 1, policy_version 510100 (0.0007) [2023-12-27 22:53:47,832][106225] Updated weights for policy 1, policy_version 510110 (0.0009) [2023-12-27 22:53:47,892][106225] Updated weights for policy 1, policy_version 510120 (0.0008) [2023-12-27 22:53:48,007][106226] Updated weights for policy 0, policy_version 508800 (0.0009) [2023-12-27 22:53:48,067][106226] Updated weights for policy 0, policy_version 508810 (0.0008) [2023-12-27 22:53:48,123][106226] Updated weights for policy 0, policy_version 508820 (0.0010) [2023-12-27 22:53:48,591][106225] Updated weights for policy 1, policy_version 510130 (0.0008) [2023-12-27 22:53:48,659][106225] Updated weights for policy 1, policy_version 510140 (0.0006) [2023-12-27 22:53:48,728][106225] Updated weights for policy 1, policy_version 510150 (0.0005) [2023-12-27 22:53:48,789][106225] Updated weights for policy 1, policy_version 510160 (0.0007) [2023-12-27 22:53:48,897][106226] Updated weights for policy 0, policy_version 508830 (0.0007) [2023-12-27 22:53:48,955][106226] Updated weights for policy 0, policy_version 508840 (0.0006) [2023-12-27 22:53:49,015][106226] Updated weights for policy 0, policy_version 508850 (0.0006) [2023-12-27 22:53:49,341][106225] Updated weights for policy 1, policy_version 510170 (0.0009) [2023-12-27 22:53:49,408][106225] Updated weights for policy 1, policy_version 510180 (0.0008) [2023-12-27 22:53:49,465][106225] Updated weights for policy 1, policy_version 510190 (0.0009) [2023-12-27 22:53:49,671][106226] Updated weights for policy 0, policy_version 508860 (0.0006) [2023-12-27 22:53:49,722][106226] Updated weights for policy 0, policy_version 508870 (0.0008) [2023-12-27 22:53:49,779][106226] Updated weights for policy 0, policy_version 508880 (0.0009) [2023-12-27 22:53:50,207][106225] Updated weights for policy 1, policy_version 510200 (0.0008) [2023-12-27 22:53:50,265][106225] Updated weights for policy 1, policy_version 510210 (0.0009) [2023-12-27 22:53:50,316][106225] Updated weights for policy 1, policy_version 510220 (0.0009) [2023-12-27 22:53:50,480][106226] Updated weights for policy 0, policy_version 508890 (0.0008) [2023-12-27 22:53:50,542][106226] Updated weights for policy 0, policy_version 508900 (0.0006) [2023-12-27 22:53:50,611][106226] Updated weights for policy 0, policy_version 508910 (0.0008) [2023-12-27 22:53:50,675][106226] Updated weights for policy 0, policy_version 508920 (0.0008) [2023-12-27 22:53:51,059][106225] Updated weights for policy 1, policy_version 510230 (0.0010) [2023-12-27 22:53:51,126][106225] Updated weights for policy 1, policy_version 510240 (0.0010) [2023-12-27 22:53:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20343.5, 300 sec: 19827.4). Total num frames: 260964352. Throughput: 0: 10142.9, 1: 10020.5. Samples: 260978736. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:51,175][105115] Avg episode reward: [(0, '-5.161'), (1, '-5.449')] [2023-12-27 22:53:51,193][106225] Updated weights for policy 1, policy_version 510250 (0.0009) [2023-12-27 22:53:51,419][106226] Updated weights for policy 0, policy_version 508930 (0.0007) [2023-12-27 22:53:51,479][106226] Updated weights for policy 0, policy_version 508940 (0.0008) [2023-12-27 22:53:51,536][106226] Updated weights for policy 0, policy_version 508950 (0.0008) [2023-12-27 22:53:51,955][106225] Updated weights for policy 1, policy_version 510260 (0.0009) [2023-12-27 22:53:52,022][106225] Updated weights for policy 1, policy_version 510270 (0.0006) [2023-12-27 22:53:52,086][106225] Updated weights for policy 1, policy_version 510280 (0.0009) [2023-12-27 22:53:52,278][106226] Updated weights for policy 0, policy_version 508960 (0.0010) [2023-12-27 22:53:52,352][106226] Updated weights for policy 0, policy_version 508970 (0.0009) [2023-12-27 22:53:52,422][106226] Updated weights for policy 0, policy_version 508980 (0.0011) [2023-12-27 22:53:52,711][106225] Updated weights for policy 1, policy_version 510290 (0.0009) [2023-12-27 22:53:52,770][106225] Updated weights for policy 1, policy_version 510300 (0.0005) [2023-12-27 22:53:52,830][106225] Updated weights for policy 1, policy_version 510310 (0.0005) [2023-12-27 22:53:52,892][106225] Updated weights for policy 1, policy_version 510320 (0.0005) [2023-12-27 22:53:53,093][106226] Updated weights for policy 0, policy_version 508990 (0.0008) [2023-12-27 22:53:53,147][106226] Updated weights for policy 0, policy_version 509000 (0.0005) [2023-12-27 22:53:53,196][106226] Updated weights for policy 0, policy_version 509010 (0.0007) [2023-12-27 22:53:53,509][106225] Updated weights for policy 1, policy_version 510330 (0.0005) [2023-12-27 22:53:53,566][106225] Updated weights for policy 1, policy_version 510340 (0.0005) [2023-12-27 22:53:53,625][106225] Updated weights for policy 1, policy_version 510350 (0.0005) [2023-12-27 22:53:53,865][106226] Updated weights for policy 0, policy_version 509020 (0.0010) [2023-12-27 22:53:53,922][106226] Updated weights for policy 0, policy_version 509030 (0.0009) [2023-12-27 22:53:53,977][106226] Updated weights for policy 0, policy_version 509040 (0.0008) [2023-12-27 22:53:54,177][106225] Updated weights for policy 1, policy_version 510360 (0.0009) [2023-12-27 22:53:54,228][106225] Updated weights for policy 1, policy_version 510370 (0.0010) [2023-12-27 22:53:54,277][106225] Updated weights for policy 1, policy_version 510380 (0.0010) [2023-12-27 22:53:54,624][106226] Updated weights for policy 0, policy_version 509050 (0.0008) [2023-12-27 22:53:54,679][106226] Updated weights for policy 0, policy_version 509060 (0.0008) [2023-12-27 22:53:54,737][106226] Updated weights for policy 0, policy_version 509070 (0.0009) [2023-12-27 22:53:54,793][106226] Updated weights for policy 0, policy_version 509080 (0.0008) [2023-12-27 22:53:55,045][106225] Updated weights for policy 1, policy_version 510390 (0.0007) [2023-12-27 22:53:55,108][106225] Updated weights for policy 1, policy_version 510400 (0.0005) [2023-12-27 22:53:55,160][106225] Updated weights for policy 1, policy_version 510410 (0.0008) [2023-12-27 22:53:55,462][106226] Updated weights for policy 0, policy_version 509090 (0.0008) [2023-12-27 22:53:55,524][106226] Updated weights for policy 0, policy_version 509100 (0.0008) [2023-12-27 22:53:55,583][106226] Updated weights for policy 0, policy_version 509110 (0.0008) [2023-12-27 22:53:55,857][106225] Updated weights for policy 1, policy_version 510420 (0.0009) [2023-12-27 22:53:55,910][106225] Updated weights for policy 1, policy_version 510430 (0.0008) [2023-12-27 22:53:55,976][106225] Updated weights for policy 1, policy_version 510440 (0.0009) [2023-12-27 22:53:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20343.5, 300 sec: 19883.0). Total num frames: 261070848. Throughput: 0: 10059.6, 1: 10094.5. Samples: 261038364. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:53:56,175][105115] Avg episode reward: [(0, '-5.029'), (1, '-5.438')] [2023-12-27 22:53:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000509112_130367488.pth... [2023-12-27 22:53:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000510448_130703360.pth... [2023-12-27 22:53:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000507928_130064384.pth [2023-12-27 22:53:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000509264_130400256.pth [2023-12-27 22:53:56,297][106226] Updated weights for policy 0, policy_version 509120 (0.0006) [2023-12-27 22:53:56,350][106226] Updated weights for policy 0, policy_version 509130 (0.0007) [2023-12-27 22:53:56,410][106226] Updated weights for policy 0, policy_version 509140 (0.0008) [2023-12-27 22:53:56,728][106225] Updated weights for policy 1, policy_version 510450 (0.0008) [2023-12-27 22:53:56,786][106225] Updated weights for policy 1, policy_version 510460 (0.0005) [2023-12-27 22:53:56,850][106225] Updated weights for policy 1, policy_version 510470 (0.0005) [2023-12-27 22:53:56,906][106225] Updated weights for policy 1, policy_version 510480 (0.0005) [2023-12-27 22:53:56,984][106226] Updated weights for policy 0, policy_version 509150 (0.0008) [2023-12-27 22:53:57,033][106226] Updated weights for policy 0, policy_version 509160 (0.0008) [2023-12-27 22:53:57,077][106226] Updated weights for policy 0, policy_version 509170 (0.0006) [2023-12-27 22:53:57,597][106225] Updated weights for policy 1, policy_version 510490 (0.0008) [2023-12-27 22:53:57,663][106225] Updated weights for policy 1, policy_version 510500 (0.0008) [2023-12-27 22:53:57,722][106226] Updated weights for policy 0, policy_version 509180 (0.0007) [2023-12-27 22:53:57,722][106225] Updated weights for policy 1, policy_version 510510 (0.0009) [2023-12-27 22:53:57,775][106226] Updated weights for policy 0, policy_version 509190 (0.0010) [2023-12-27 22:53:57,833][106226] Updated weights for policy 0, policy_version 509200 (0.0010) [2023-12-27 22:53:58,508][106225] Updated weights for policy 1, policy_version 510520 (0.0008) [2023-12-27 22:53:58,511][106226] Updated weights for policy 0, policy_version 509210 (0.0009) [2023-12-27 22:53:58,572][106225] Updated weights for policy 1, policy_version 510530 (0.0007) [2023-12-27 22:53:58,575][106226] Updated weights for policy 0, policy_version 509220 (0.0011) [2023-12-27 22:53:58,635][106226] Updated weights for policy 0, policy_version 509230 (0.0010) [2023-12-27 22:53:58,640][106225] Updated weights for policy 1, policy_version 510540 (0.0007) [2023-12-27 22:53:58,700][106226] Updated weights for policy 0, policy_version 509240 (0.0009) [2023-12-27 22:53:59,487][106225] Updated weights for policy 1, policy_version 510550 (0.0008) [2023-12-27 22:53:59,511][106226] Updated weights for policy 0, policy_version 509250 (0.0010) [2023-12-27 22:53:59,541][106225] Updated weights for policy 1, policy_version 510560 (0.0006) [2023-12-27 22:53:59,575][106226] Updated weights for policy 0, policy_version 509260 (0.0010) [2023-12-27 22:53:59,590][106225] Updated weights for policy 1, policy_version 510570 (0.0005) [2023-12-27 22:53:59,632][106226] Updated weights for policy 0, policy_version 509270 (0.0011) [2023-12-27 22:54:00,256][106225] Updated weights for policy 1, policy_version 510580 (0.0007) [2023-12-27 22:54:00,305][106225] Updated weights for policy 1, policy_version 510590 (0.0007) [2023-12-27 22:54:00,356][106225] Updated weights for policy 1, policy_version 510600 (0.0007) [2023-12-27 22:54:00,358][106226] Updated weights for policy 0, policy_version 509280 (0.0009) [2023-12-27 22:54:00,411][106226] Updated weights for policy 0, policy_version 509290 (0.0009) [2023-12-27 22:54:00,460][106226] Updated weights for policy 0, policy_version 509300 (0.0010) [2023-12-27 22:54:01,024][106225] Updated weights for policy 1, policy_version 510610 (0.0006) [2023-12-27 22:54:01,089][106225] Updated weights for policy 1, policy_version 510620 (0.0011) [2023-12-27 22:54:01,156][106225] Updated weights for policy 1, policy_version 510630 (0.0011) [2023-12-27 22:54:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 261160960. Throughput: 0: 10148.9, 1: 10090.1. Samples: 261156992. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:01,175][105115] Avg episode reward: [(0, '-5.329'), (1, '-5.773')] [2023-12-27 22:54:01,202][106225] Updated weights for policy 1, policy_version 510640 (0.0010) [2023-12-27 22:54:01,240][106226] Updated weights for policy 0, policy_version 509310 (0.0011) [2023-12-27 22:54:01,297][106226] Updated weights for policy 0, policy_version 509320 (0.0008) [2023-12-27 22:54:01,356][106226] Updated weights for policy 0, policy_version 509330 (0.0010) [2023-12-27 22:54:01,923][106225] Updated weights for policy 1, policy_version 510650 (0.0009) [2023-12-27 22:54:01,991][106225] Updated weights for policy 1, policy_version 510660 (0.0008) [2023-12-27 22:54:02,016][106226] Updated weights for policy 0, policy_version 509340 (0.0009) [2023-12-27 22:54:02,053][106225] Updated weights for policy 1, policy_version 510670 (0.0007) [2023-12-27 22:54:02,076][106226] Updated weights for policy 0, policy_version 509350 (0.0006) [2023-12-27 22:54:02,134][106226] Updated weights for policy 0, policy_version 509360 (0.0009) [2023-12-27 22:54:02,759][106225] Updated weights for policy 1, policy_version 510680 (0.0006) [2023-12-27 22:54:02,808][106225] Updated weights for policy 1, policy_version 510690 (0.0006) [2023-12-27 22:54:02,863][106226] Updated weights for policy 0, policy_version 509370 (0.0007) [2023-12-27 22:54:02,890][106225] Updated weights for policy 1, policy_version 510700 (0.0011) [2023-12-27 22:54:02,926][106226] Updated weights for policy 0, policy_version 509380 (0.0007) [2023-12-27 22:54:02,987][106226] Updated weights for policy 0, policy_version 509390 (0.0009) [2023-12-27 22:54:03,045][106226] Updated weights for policy 0, policy_version 509400 (0.0009) [2023-12-27 22:54:03,524][106225] Updated weights for policy 1, policy_version 510710 (0.0007) [2023-12-27 22:54:03,579][106225] Updated weights for policy 1, policy_version 510720 (0.0008) [2023-12-27 22:54:03,631][106225] Updated weights for policy 1, policy_version 510730 (0.0007) [2023-12-27 22:54:03,768][106226] Updated weights for policy 0, policy_version 509410 (0.0005) [2023-12-27 22:54:03,831][106226] Updated weights for policy 0, policy_version 509420 (0.0005) [2023-12-27 22:54:03,895][106226] Updated weights for policy 0, policy_version 509430 (0.0008) [2023-12-27 22:54:04,377][106225] Updated weights for policy 1, policy_version 510740 (0.0006) [2023-12-27 22:54:04,434][106225] Updated weights for policy 1, policy_version 510750 (0.0007) [2023-12-27 22:54:04,487][106225] Updated weights for policy 1, policy_version 510760 (0.0009) [2023-12-27 22:54:04,564][106226] Updated weights for policy 0, policy_version 509440 (0.0008) [2023-12-27 22:54:04,612][106226] Updated weights for policy 0, policy_version 509450 (0.0009) [2023-12-27 22:54:04,669][106226] Updated weights for policy 0, policy_version 509460 (0.0008) [2023-12-27 22:54:05,127][106225] Updated weights for policy 1, policy_version 510770 (0.0008) [2023-12-27 22:54:05,188][106225] Updated weights for policy 1, policy_version 510780 (0.0009) [2023-12-27 22:54:05,236][106225] Updated weights for policy 1, policy_version 510790 (0.0008) [2023-12-27 22:54:05,286][106225] Updated weights for policy 1, policy_version 510800 (0.0009) [2023-12-27 22:54:05,344][106226] Updated weights for policy 0, policy_version 509470 (0.0008) [2023-12-27 22:54:05,404][106226] Updated weights for policy 0, policy_version 509480 (0.0009) [2023-12-27 22:54:05,468][106226] Updated weights for policy 0, policy_version 509490 (0.0008) [2023-12-27 22:54:05,996][106225] Updated weights for policy 1, policy_version 510810 (0.0008) [2023-12-27 22:54:06,057][106225] Updated weights for policy 1, policy_version 510820 (0.0008) [2023-12-27 22:54:06,127][106225] Updated weights for policy 1, policy_version 510830 (0.0009) [2023-12-27 22:54:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 261267456. Throughput: 0: 10151.8, 1: 10096.4. Samples: 261275972. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:06,175][105115] Avg episode reward: [(0, '-4.933'), (1, '-5.896')] [2023-12-27 22:54:06,192][106226] Updated weights for policy 0, policy_version 509500 (0.0007) [2023-12-27 22:54:06,264][106226] Updated weights for policy 0, policy_version 509510 (0.0006) [2023-12-27 22:54:06,329][106226] Updated weights for policy 0, policy_version 509520 (0.0006) [2023-12-27 22:54:06,882][106225] Updated weights for policy 1, policy_version 510840 (0.0008) [2023-12-27 22:54:06,951][106225] Updated weights for policy 1, policy_version 510850 (0.0008) [2023-12-27 22:54:07,007][106226] Updated weights for policy 0, policy_version 509530 (0.0006) [2023-12-27 22:54:07,013][106225] Updated weights for policy 1, policy_version 510860 (0.0008) [2023-12-27 22:54:07,070][106226] Updated weights for policy 0, policy_version 509540 (0.0007) [2023-12-27 22:54:07,140][106226] Updated weights for policy 0, policy_version 509550 (0.0009) [2023-12-27 22:54:07,203][106226] Updated weights for policy 0, policy_version 509560 (0.0008) [2023-12-27 22:54:07,743][106225] Updated weights for policy 1, policy_version 510870 (0.0007) [2023-12-27 22:54:07,789][106225] Updated weights for policy 1, policy_version 510880 (0.0008) [2023-12-27 22:54:07,836][106225] Updated weights for policy 1, policy_version 510890 (0.0008) [2023-12-27 22:54:07,836][106226] Updated weights for policy 0, policy_version 509570 (0.0007) [2023-12-27 22:54:07,895][106226] Updated weights for policy 0, policy_version 509580 (0.0005) [2023-12-27 22:54:07,950][106226] Updated weights for policy 0, policy_version 509590 (0.0008) [2023-12-27 22:54:08,549][106225] Updated weights for policy 1, policy_version 510900 (0.0008) [2023-12-27 22:54:08,610][106225] Updated weights for policy 1, policy_version 510910 (0.0007) [2023-12-27 22:54:08,632][106226] Updated weights for policy 0, policy_version 509600 (0.0007) [2023-12-27 22:54:08,676][106225] Updated weights for policy 1, policy_version 510920 (0.0008) [2023-12-27 22:54:08,695][106226] Updated weights for policy 0, policy_version 509610 (0.0006) [2023-12-27 22:54:08,753][106226] Updated weights for policy 0, policy_version 509620 (0.0008) [2023-12-27 22:54:09,412][106226] Updated weights for policy 0, policy_version 509630 (0.0009) [2023-12-27 22:54:09,436][106225] Updated weights for policy 1, policy_version 510930 (0.0007) [2023-12-27 22:54:09,478][106226] Updated weights for policy 0, policy_version 509640 (0.0007) [2023-12-27 22:54:09,504][106225] Updated weights for policy 1, policy_version 510940 (0.0008) [2023-12-27 22:54:09,544][106226] Updated weights for policy 0, policy_version 509650 (0.0008) [2023-12-27 22:54:09,558][106225] Updated weights for policy 1, policy_version 510950 (0.0007) [2023-12-27 22:54:09,613][106225] Updated weights for policy 1, policy_version 510960 (0.0007) [2023-12-27 22:54:10,258][106226] Updated weights for policy 0, policy_version 509660 (0.0009) [2023-12-27 22:54:10,322][106226] Updated weights for policy 0, policy_version 509670 (0.0008) [2023-12-27 22:54:10,384][106226] Updated weights for policy 0, policy_version 509680 (0.0008) [2023-12-27 22:54:10,396][106225] Updated weights for policy 1, policy_version 510970 (0.0008) [2023-12-27 22:54:10,455][106225] Updated weights for policy 1, policy_version 510980 (0.0007) [2023-12-27 22:54:10,508][106225] Updated weights for policy 1, policy_version 510990 (0.0007) [2023-12-27 22:54:11,082][106226] Updated weights for policy 0, policy_version 509690 (0.0008) [2023-12-27 22:54:11,159][106226] Updated weights for policy 0, policy_version 509700 (0.0010) [2023-12-27 22:54:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 261357568. Throughput: 0: 10190.5, 1: 10070.5. Samples: 261334540. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:11,175][105115] Avg episode reward: [(0, '-5.414'), (1, '-5.521')] [2023-12-27 22:54:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000510992_130842624.pth... [2023-12-27 22:54:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000509872_130555904.pth [2023-12-27 22:54:11,226][106226] Updated weights for policy 0, policy_version 509710 (0.0010) [2023-12-27 22:54:11,272][106225] Updated weights for policy 1, policy_version 511000 (0.0008) [2023-12-27 22:54:11,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000509720_130523136.pth... [2023-12-27 22:54:11,290][106226] Updated weights for policy 0, policy_version 509720 (0.0007) [2023-12-27 22:54:11,294][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000508536_130220032.pth [2023-12-27 22:54:11,338][106225] Updated weights for policy 1, policy_version 511010 (0.0007) [2023-12-27 22:54:11,416][106225] Updated weights for policy 1, policy_version 511020 (0.0009) [2023-12-27 22:54:12,009][106226] Updated weights for policy 0, policy_version 509730 (0.0011) [2023-12-27 22:54:12,064][106226] Updated weights for policy 0, policy_version 509740 (0.0010) [2023-12-27 22:54:12,122][106226] Updated weights for policy 0, policy_version 509750 (0.0010) [2023-12-27 22:54:12,238][106225] Updated weights for policy 1, policy_version 511030 (0.0008) [2023-12-27 22:54:12,308][106225] Updated weights for policy 1, policy_version 511040 (0.0008) [2023-12-27 22:54:12,381][106225] Updated weights for policy 1, policy_version 511050 (0.0008) [2023-12-27 22:54:12,811][106226] Updated weights for policy 0, policy_version 509760 (0.0008) [2023-12-27 22:54:12,876][106226] Updated weights for policy 0, policy_version 509770 (0.0011) [2023-12-27 22:54:12,933][106226] Updated weights for policy 0, policy_version 509780 (0.0010) [2023-12-27 22:54:13,008][106225] Updated weights for policy 1, policy_version 511060 (0.0006) [2023-12-27 22:54:13,063][106225] Updated weights for policy 1, policy_version 511070 (0.0006) [2023-12-27 22:54:13,131][106225] Updated weights for policy 1, policy_version 511080 (0.0006) [2023-12-27 22:54:13,653][106225] Updated weights for policy 1, policy_version 511090 (0.0006) [2023-12-27 22:54:13,665][106226] Updated weights for policy 0, policy_version 509790 (0.0009) [2023-12-27 22:54:13,712][106226] Updated weights for policy 0, policy_version 509800 (0.0009) [2023-12-27 22:54:13,719][106225] Updated weights for policy 1, policy_version 511100 (0.0005) [2023-12-27 22:54:13,766][106226] Updated weights for policy 0, policy_version 509810 (0.0008) [2023-12-27 22:54:13,780][106225] Updated weights for policy 1, policy_version 511110 (0.0005) [2023-12-27 22:54:13,833][106225] Updated weights for policy 1, policy_version 511120 (0.0006) [2023-12-27 22:54:14,456][106225] Updated weights for policy 1, policy_version 511130 (0.0009) [2023-12-27 22:54:14,481][106226] Updated weights for policy 0, policy_version 509820 (0.0009) [2023-12-27 22:54:14,511][106225] Updated weights for policy 1, policy_version 511140 (0.0006) [2023-12-27 22:54:14,544][106226] Updated weights for policy 0, policy_version 509830 (0.0009) [2023-12-27 22:54:14,579][106225] Updated weights for policy 1, policy_version 511150 (0.0008) [2023-12-27 22:54:14,604][106226] Updated weights for policy 0, policy_version 509840 (0.0008) [2023-12-27 22:54:15,360][106225] Updated weights for policy 1, policy_version 511160 (0.0009) [2023-12-27 22:54:15,375][106226] Updated weights for policy 0, policy_version 509850 (0.0008) [2023-12-27 22:54:15,417][106225] Updated weights for policy 1, policy_version 511170 (0.0008) [2023-12-27 22:54:15,438][106226] Updated weights for policy 0, policy_version 509860 (0.0007) [2023-12-27 22:54:15,473][106225] Updated weights for policy 1, policy_version 511180 (0.0008) [2023-12-27 22:54:15,496][106226] Updated weights for policy 0, policy_version 509870 (0.0008) [2023-12-27 22:54:15,563][106226] Updated weights for policy 0, policy_version 509880 (0.0005) [2023-12-27 22:54:16,105][106225] Updated weights for policy 1, policy_version 511190 (0.0005) [2023-12-27 22:54:16,166][106225] Updated weights for policy 1, policy_version 511200 (0.0005) [2023-12-27 22:54:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 261455872. Throughput: 0: 10034.9, 1: 9906.1. Samples: 261451244. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:16,176][105115] Avg episode reward: [(0, '-5.125'), (1, '-5.659')] [2023-12-27 22:54:16,196][106226] Updated weights for policy 0, policy_version 509890 (0.0011) [2023-12-27 22:54:16,225][106225] Updated weights for policy 1, policy_version 511210 (0.0005) [2023-12-27 22:54:16,253][106226] Updated weights for policy 0, policy_version 509900 (0.0010) [2023-12-27 22:54:16,306][106226] Updated weights for policy 0, policy_version 509910 (0.0010) [2023-12-27 22:54:16,779][106225] Updated weights for policy 1, policy_version 511220 (0.0007) [2023-12-27 22:54:16,835][106225] Updated weights for policy 1, policy_version 511230 (0.0010) [2023-12-27 22:54:16,900][106225] Updated weights for policy 1, policy_version 511240 (0.0009) [2023-12-27 22:54:17,007][106226] Updated weights for policy 0, policy_version 509920 (0.0009) [2023-12-27 22:54:17,068][106226] Updated weights for policy 0, policy_version 509930 (0.0009) [2023-12-27 22:54:17,115][106226] Updated weights for policy 0, policy_version 509940 (0.0008) [2023-12-27 22:54:17,512][106225] Updated weights for policy 1, policy_version 511250 (0.0008) [2023-12-27 22:54:17,575][106225] Updated weights for policy 1, policy_version 511260 (0.0005) [2023-12-27 22:54:17,636][106225] Updated weights for policy 1, policy_version 511270 (0.0006) [2023-12-27 22:54:17,692][106225] Updated weights for policy 1, policy_version 511280 (0.0007) [2023-12-27 22:54:17,862][106226] Updated weights for policy 0, policy_version 509950 (0.0010) [2023-12-27 22:54:17,925][106226] Updated weights for policy 0, policy_version 509960 (0.0011) [2023-12-27 22:54:17,991][106226] Updated weights for policy 0, policy_version 509970 (0.0009) [2023-12-27 22:54:18,379][106225] Updated weights for policy 1, policy_version 511290 (0.0008) [2023-12-27 22:54:18,439][106225] Updated weights for policy 1, policy_version 511300 (0.0008) [2023-12-27 22:54:18,500][106225] Updated weights for policy 1, policy_version 511310 (0.0008) [2023-12-27 22:54:18,706][106226] Updated weights for policy 0, policy_version 509980 (0.0010) [2023-12-27 22:54:18,771][106226] Updated weights for policy 0, policy_version 509990 (0.0011) [2023-12-27 22:54:18,832][106226] Updated weights for policy 0, policy_version 510000 (0.0011) [2023-12-27 22:54:19,249][106225] Updated weights for policy 1, policy_version 511320 (0.0007) [2023-12-27 22:54:19,310][106225] Updated weights for policy 1, policy_version 511330 (0.0008) [2023-12-27 22:54:19,380][106225] Updated weights for policy 1, policy_version 511340 (0.0007) [2023-12-27 22:54:19,585][106226] Updated weights for policy 0, policy_version 510010 (0.0011) [2023-12-27 22:54:19,636][106226] Updated weights for policy 0, policy_version 510020 (0.0011) [2023-12-27 22:54:19,683][106226] Updated weights for policy 0, policy_version 510030 (0.0010) [2023-12-27 22:54:19,727][106226] Updated weights for policy 0, policy_version 510040 (0.0010) [2023-12-27 22:54:20,158][106225] Updated weights for policy 1, policy_version 511350 (0.0008) [2023-12-27 22:54:20,216][106225] Updated weights for policy 1, policy_version 511360 (0.0007) [2023-12-27 22:54:20,275][106225] Updated weights for policy 1, policy_version 511370 (0.0008) [2023-12-27 22:54:20,508][106226] Updated weights for policy 0, policy_version 510050 (0.0010) [2023-12-27 22:54:20,562][106226] Updated weights for policy 0, policy_version 510060 (0.0011) [2023-12-27 22:54:20,629][106226] Updated weights for policy 0, policy_version 510070 (0.0011) [2023-12-27 22:54:21,057][106225] Updated weights for policy 1, policy_version 511380 (0.0008) [2023-12-27 22:54:21,117][106225] Updated weights for policy 1, policy_version 511390 (0.0008) [2023-12-27 22:54:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 261554176. Throughput: 0: 9870.0, 1: 9927.7. Samples: 261569060. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:21,175][105115] Avg episode reward: [(0, '-5.117'), (1, '-5.248')] [2023-12-27 22:54:21,180][106225] Updated weights for policy 1, policy_version 511400 (0.0008) [2023-12-27 22:54:21,412][106226] Updated weights for policy 0, policy_version 510080 (0.0011) [2023-12-27 22:54:21,479][106226] Updated weights for policy 0, policy_version 510090 (0.0011) [2023-12-27 22:54:21,533][106226] Updated weights for policy 0, policy_version 510100 (0.0010) [2023-12-27 22:54:21,972][106225] Updated weights for policy 1, policy_version 511410 (0.0008) [2023-12-27 22:54:22,030][106225] Updated weights for policy 1, policy_version 511420 (0.0008) [2023-12-27 22:54:22,092][106225] Updated weights for policy 1, policy_version 511430 (0.0008) [2023-12-27 22:54:22,153][106225] Updated weights for policy 1, policy_version 511440 (0.0007) [2023-12-27 22:54:22,276][106226] Updated weights for policy 0, policy_version 510110 (0.0011) [2023-12-27 22:54:22,338][106226] Updated weights for policy 0, policy_version 510120 (0.0011) [2023-12-27 22:54:22,407][106226] Updated weights for policy 0, policy_version 510130 (0.0009) [2023-12-27 22:54:22,922][106225] Updated weights for policy 1, policy_version 511450 (0.0007) [2023-12-27 22:54:22,977][106225] Updated weights for policy 1, policy_version 511460 (0.0008) [2023-12-27 22:54:23,035][106225] Updated weights for policy 1, policy_version 511470 (0.0008) [2023-12-27 22:54:23,127][106226] Updated weights for policy 0, policy_version 510140 (0.0011) [2023-12-27 22:54:23,180][106226] Updated weights for policy 0, policy_version 510150 (0.0010) [2023-12-27 22:54:23,233][106226] Updated weights for policy 0, policy_version 510160 (0.0010) [2023-12-27 22:54:23,754][106225] Updated weights for policy 1, policy_version 511480 (0.0008) [2023-12-27 22:54:23,803][106225] Updated weights for policy 1, policy_version 511490 (0.0007) [2023-12-27 22:54:23,850][106225] Updated weights for policy 1, policy_version 511500 (0.0007) [2023-12-27 22:54:23,932][106226] Updated weights for policy 0, policy_version 510170 (0.0010) [2023-12-27 22:54:23,994][106226] Updated weights for policy 0, policy_version 510180 (0.0010) [2023-12-27 22:54:24,055][106226] Updated weights for policy 0, policy_version 510190 (0.0010) [2023-12-27 22:54:24,114][106226] Updated weights for policy 0, policy_version 510200 (0.0010) [2023-12-27 22:54:24,600][106225] Updated weights for policy 1, policy_version 511510 (0.0008) [2023-12-27 22:54:24,659][106225] Updated weights for policy 1, policy_version 511520 (0.0008) [2023-12-27 22:54:24,719][106225] Updated weights for policy 1, policy_version 511530 (0.0008) [2023-12-27 22:54:24,814][106226] Updated weights for policy 0, policy_version 510210 (0.0010) [2023-12-27 22:54:24,865][106226] Updated weights for policy 0, policy_version 510220 (0.0010) [2023-12-27 22:54:24,911][106226] Updated weights for policy 0, policy_version 510230 (0.0010) [2023-12-27 22:54:25,446][106225] Updated weights for policy 1, policy_version 511540 (0.0007) [2023-12-27 22:54:25,492][106225] Updated weights for policy 1, policy_version 511550 (0.0008) [2023-12-27 22:54:25,541][106225] Updated weights for policy 1, policy_version 511560 (0.0007) [2023-12-27 22:54:25,655][106226] Updated weights for policy 0, policy_version 510240 (0.0010) [2023-12-27 22:54:25,714][106226] Updated weights for policy 0, policy_version 510250 (0.0010) [2023-12-27 22:54:25,763][106226] Updated weights for policy 0, policy_version 510260 (0.0010) [2023-12-27 22:54:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 261652480. Throughput: 0: 9807.8, 1: 9843.7. Samples: 261624764. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:26,175][105115] Avg episode reward: [(0, '-5.130'), (1, '-5.546')] [2023-12-27 22:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000511568_130990080.pth... [2023-12-27 22:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000510264_130662400.pth... [2023-12-27 22:54:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000509112_130367488.pth [2023-12-27 22:54:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000510448_130703360.pth [2023-12-27 22:54:26,286][106225] Updated weights for policy 1, policy_version 511570 (0.0008) [2023-12-27 22:54:26,343][106225] Updated weights for policy 1, policy_version 511580 (0.0008) [2023-12-27 22:54:26,399][106225] Updated weights for policy 1, policy_version 511590 (0.0007) [2023-12-27 22:54:26,451][106225] Updated weights for policy 1, policy_version 511600 (0.0008) [2023-12-27 22:54:26,466][106226] Updated weights for policy 0, policy_version 510270 (0.0010) [2023-12-27 22:54:26,526][106226] Updated weights for policy 0, policy_version 510280 (0.0010) [2023-12-27 22:54:26,585][106226] Updated weights for policy 0, policy_version 510290 (0.0010) [2023-12-27 22:54:27,173][106225] Updated weights for policy 1, policy_version 511610 (0.0008) [2023-12-27 22:54:27,223][106225] Updated weights for policy 1, policy_version 511620 (0.0007) [2023-12-27 22:54:27,269][106225] Updated weights for policy 1, policy_version 511630 (0.0008) [2023-12-27 22:54:27,291][106226] Updated weights for policy 0, policy_version 510300 (0.0010) [2023-12-27 22:54:27,344][106226] Updated weights for policy 0, policy_version 510310 (0.0008) [2023-12-27 22:54:27,398][106226] Updated weights for policy 0, policy_version 510320 (0.0008) [2023-12-27 22:54:27,979][106226] Updated weights for policy 0, policy_version 510330 (0.0005) [2023-12-27 22:54:27,990][106225] Updated weights for policy 1, policy_version 511640 (0.0006) [2023-12-27 22:54:28,031][106226] Updated weights for policy 0, policy_version 510340 (0.0009) [2023-12-27 22:54:28,048][106225] Updated weights for policy 1, policy_version 511650 (0.0006) [2023-12-27 22:54:28,092][106226] Updated weights for policy 0, policy_version 510350 (0.0008) [2023-12-27 22:54:28,114][106225] Updated weights for policy 1, policy_version 511660 (0.0006) [2023-12-27 22:54:28,145][106226] Updated weights for policy 0, policy_version 510360 (0.0010) [2023-12-27 22:54:28,783][106226] Updated weights for policy 0, policy_version 510370 (0.0010) [2023-12-27 22:54:28,805][106225] Updated weights for policy 1, policy_version 511670 (0.0006) [2023-12-27 22:54:28,849][106226] Updated weights for policy 0, policy_version 510380 (0.0009) [2023-12-27 22:54:28,862][106225] Updated weights for policy 1, policy_version 511680 (0.0010) [2023-12-27 22:54:28,907][106226] Updated weights for policy 0, policy_version 510390 (0.0006) [2023-12-27 22:54:28,914][106225] Updated weights for policy 1, policy_version 511690 (0.0008) [2023-12-27 22:54:29,533][106225] Updated weights for policy 1, policy_version 511700 (0.0007) [2023-12-27 22:54:29,590][106225] Updated weights for policy 1, policy_version 511710 (0.0010) [2023-12-27 22:54:29,609][106226] Updated weights for policy 0, policy_version 510400 (0.0010) [2023-12-27 22:54:29,640][106225] Updated weights for policy 1, policy_version 511720 (0.0010) [2023-12-27 22:54:29,669][106226] Updated weights for policy 0, policy_version 510410 (0.0011) [2023-12-27 22:54:29,729][106226] Updated weights for policy 0, policy_version 510420 (0.0010) [2023-12-27 22:54:30,383][106225] Updated weights for policy 1, policy_version 511730 (0.0008) [2023-12-27 22:54:30,389][106226] Updated weights for policy 0, policy_version 510430 (0.0011) [2023-12-27 22:54:30,442][106225] Updated weights for policy 1, policy_version 511740 (0.0007) [2023-12-27 22:54:30,449][106226] Updated weights for policy 0, policy_version 510440 (0.0011) [2023-12-27 22:54:30,499][106225] Updated weights for policy 1, policy_version 511750 (0.0007) [2023-12-27 22:54:30,511][106226] Updated weights for policy 0, policy_version 510450 (0.0011) [2023-12-27 22:54:30,555][106225] Updated weights for policy 1, policy_version 511760 (0.0006) [2023-12-27 22:54:31,159][106225] Updated weights for policy 1, policy_version 511770 (0.0008) [2023-12-27 22:54:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 261750784. Throughput: 0: 9891.2, 1: 9848.8. Samples: 261745300. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:31,175][105115] Avg episode reward: [(0, '-5.286'), (1, '-5.729')] [2023-12-27 22:54:31,215][106225] Updated weights for policy 1, policy_version 511780 (0.0007) [2023-12-27 22:54:31,233][106226] Updated weights for policy 0, policy_version 510460 (0.0009) [2023-12-27 22:54:31,275][106225] Updated weights for policy 1, policy_version 511790 (0.0008) [2023-12-27 22:54:31,299][106226] Updated weights for policy 0, policy_version 510470 (0.0008) [2023-12-27 22:54:31,362][106226] Updated weights for policy 0, policy_version 510480 (0.0009) [2023-12-27 22:54:32,015][106226] Updated weights for policy 0, policy_version 510490 (0.0007) [2023-12-27 22:54:32,017][106225] Updated weights for policy 1, policy_version 511800 (0.0007) [2023-12-27 22:54:32,075][106226] Updated weights for policy 0, policy_version 510500 (0.0010) [2023-12-27 22:54:32,076][106225] Updated weights for policy 1, policy_version 511810 (0.0007) [2023-12-27 22:54:32,133][106225] Updated weights for policy 1, policy_version 511820 (0.0008) [2023-12-27 22:54:32,138][106226] Updated weights for policy 0, policy_version 510510 (0.0010) [2023-12-27 22:54:32,202][106226] Updated weights for policy 0, policy_version 510520 (0.0010) [2023-12-27 22:54:32,887][106225] Updated weights for policy 1, policy_version 511830 (0.0007) [2023-12-27 22:54:32,916][106226] Updated weights for policy 0, policy_version 510530 (0.0010) [2023-12-27 22:54:32,937][106225] Updated weights for policy 1, policy_version 511840 (0.0005) [2023-12-27 22:54:32,968][106226] Updated weights for policy 0, policy_version 510540 (0.0010) [2023-12-27 22:54:32,989][106225] Updated weights for policy 1, policy_version 511850 (0.0005) [2023-12-27 22:54:33,017][106226] Updated weights for policy 0, policy_version 510550 (0.0010) [2023-12-27 22:54:33,737][106225] Updated weights for policy 1, policy_version 511860 (0.0007) [2023-12-27 22:54:33,748][106226] Updated weights for policy 0, policy_version 510560 (0.0010) [2023-12-27 22:54:33,785][106225] Updated weights for policy 1, policy_version 511870 (0.0006) [2023-12-27 22:54:33,807][106226] Updated weights for policy 0, policy_version 510570 (0.0010) [2023-12-27 22:54:33,832][106225] Updated weights for policy 1, policy_version 511880 (0.0006) [2023-12-27 22:54:33,860][106226] Updated weights for policy 0, policy_version 510580 (0.0010) [2023-12-27 22:54:34,589][106226] Updated weights for policy 0, policy_version 510590 (0.0010) [2023-12-27 22:54:34,603][106225] Updated weights for policy 1, policy_version 511890 (0.0007) [2023-12-27 22:54:34,654][106226] Updated weights for policy 0, policy_version 510600 (0.0006) [2023-12-27 22:54:34,656][106225] Updated weights for policy 1, policy_version 511900 (0.0007) [2023-12-27 22:54:34,711][106226] Updated weights for policy 0, policy_version 510610 (0.0006) [2023-12-27 22:54:34,712][106225] Updated weights for policy 1, policy_version 511910 (0.0008) [2023-12-27 22:54:34,776][106225] Updated weights for policy 1, policy_version 511920 (0.0008) [2023-12-27 22:54:35,457][106226] Updated weights for policy 0, policy_version 510620 (0.0008) [2023-12-27 22:54:35,507][106225] Updated weights for policy 1, policy_version 511930 (0.0007) [2023-12-27 22:54:35,510][106226] Updated weights for policy 0, policy_version 510630 (0.0007) [2023-12-27 22:54:35,559][106226] Updated weights for policy 0, policy_version 510640 (0.0008) [2023-12-27 22:54:35,566][106225] Updated weights for policy 1, policy_version 511940 (0.0008) [2023-12-27 22:54:35,626][106225] Updated weights for policy 1, policy_version 511950 (0.0007) [2023-12-27 22:54:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 261849088. Throughput: 0: 9839.8, 1: 9769.8. Samples: 261861168. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:36,175][105115] Avg episode reward: [(0, '-5.161'), (1, '-5.359')] [2023-12-27 22:54:36,288][106226] Updated weights for policy 0, policy_version 510650 (0.0007) [2023-12-27 22:54:36,351][106226] Updated weights for policy 0, policy_version 510660 (0.0009) [2023-12-27 22:54:36,414][106226] Updated weights for policy 0, policy_version 510670 (0.0009) [2023-12-27 22:54:36,414][106225] Updated weights for policy 1, policy_version 511960 (0.0008) [2023-12-27 22:54:36,471][106226] Updated weights for policy 0, policy_version 510680 (0.0009) [2023-12-27 22:54:36,477][106225] Updated weights for policy 1, policy_version 511970 (0.0007) [2023-12-27 22:54:36,537][106225] Updated weights for policy 1, policy_version 511980 (0.0008) [2023-12-27 22:54:37,211][106226] Updated weights for policy 0, policy_version 510690 (0.0008) [2023-12-27 22:54:37,261][106225] Updated weights for policy 1, policy_version 511990 (0.0007) [2023-12-27 22:54:37,271][106226] Updated weights for policy 0, policy_version 510700 (0.0007) [2023-12-27 22:54:37,317][106225] Updated weights for policy 1, policy_version 512000 (0.0007) [2023-12-27 22:54:37,327][106226] Updated weights for policy 0, policy_version 510710 (0.0006) [2023-12-27 22:54:37,364][106225] Updated weights for policy 1, policy_version 512010 (0.0007) [2023-12-27 22:54:38,033][106225] Updated weights for policy 1, policy_version 512020 (0.0007) [2023-12-27 22:54:38,094][106225] Updated weights for policy 1, policy_version 512030 (0.0008) [2023-12-27 22:54:38,120][106226] Updated weights for policy 0, policy_version 510720 (0.0006) [2023-12-27 22:54:38,155][106225] Updated weights for policy 1, policy_version 512040 (0.0008) [2023-12-27 22:54:38,172][106226] Updated weights for policy 0, policy_version 510730 (0.0006) [2023-12-27 22:54:38,229][106226] Updated weights for policy 0, policy_version 510740 (0.0007) [2023-12-27 22:54:38,825][106225] Updated weights for policy 1, policy_version 512050 (0.0008) [2023-12-27 22:54:38,883][106225] Updated weights for policy 1, policy_version 512060 (0.0009) [2023-12-27 22:54:38,939][106225] Updated weights for policy 1, policy_version 512070 (0.0008) [2023-12-27 22:54:38,989][106225] Updated weights for policy 1, policy_version 512080 (0.0009) [2023-12-27 22:54:39,000][106226] Updated weights for policy 0, policy_version 510750 (0.0009) [2023-12-27 22:54:39,060][106226] Updated weights for policy 0, policy_version 510760 (0.0008) [2023-12-27 22:54:39,124][106226] Updated weights for policy 0, policy_version 510770 (0.0010) [2023-12-27 22:54:39,772][106225] Updated weights for policy 1, policy_version 512090 (0.0008) [2023-12-27 22:54:39,841][106225] Updated weights for policy 1, policy_version 512100 (0.0007) [2023-12-27 22:54:39,901][106225] Updated weights for policy 1, policy_version 512110 (0.0007) [2023-12-27 22:54:39,957][106226] Updated weights for policy 0, policy_version 510780 (0.0008) [2023-12-27 22:54:40,026][106226] Updated weights for policy 0, policy_version 510790 (0.0006) [2023-12-27 22:54:40,092][106226] Updated weights for policy 0, policy_version 510800 (0.0009) [2023-12-27 22:54:40,660][106225] Updated weights for policy 1, policy_version 512120 (0.0008) [2023-12-27 22:54:40,714][106225] Updated weights for policy 1, policy_version 512130 (0.0007) [2023-12-27 22:54:40,749][106226] Updated weights for policy 0, policy_version 510810 (0.0011) [2023-12-27 22:54:40,777][106225] Updated weights for policy 1, policy_version 512140 (0.0007) [2023-12-27 22:54:40,805][106226] Updated weights for policy 0, policy_version 510820 (0.0010) [2023-12-27 22:54:40,867][106226] Updated weights for policy 0, policy_version 510830 (0.0006) [2023-12-27 22:54:40,925][106226] Updated weights for policy 0, policy_version 510840 (0.0006) [2023-12-27 22:54:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 261947392. Throughput: 0: 9805.9, 1: 9750.8. Samples: 261918420. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-27 22:54:41,175][105115] Avg episode reward: [(0, '-5.207'), (1, '-5.388')] [2023-12-27 22:54:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000512144_131137536.pth... [2023-12-27 22:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000510840_130809856.pth... [2023-12-27 22:54:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000509720_130523136.pth [2023-12-27 22:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000510992_130842624.pth [2023-12-27 22:54:41,608][106225] Updated weights for policy 1, policy_version 512150 (0.0007) [2023-12-27 22:54:41,659][106226] Updated weights for policy 0, policy_version 510850 (0.0008) [2023-12-27 22:54:41,677][106225] Updated weights for policy 1, policy_version 512160 (0.0008) [2023-12-27 22:54:41,734][106225] Updated weights for policy 1, policy_version 512170 (0.0008) [2023-12-27 22:54:41,744][106226] Updated weights for policy 0, policy_version 510860 (0.0008) [2023-12-27 22:54:41,815][106226] Updated weights for policy 0, policy_version 510870 (0.0007) [2023-12-27 22:54:42,478][106226] Updated weights for policy 0, policy_version 510880 (0.0008) [2023-12-27 22:54:42,544][106225] Updated weights for policy 1, policy_version 512180 (0.0007) [2023-12-27 22:54:42,546][106226] Updated weights for policy 0, policy_version 510890 (0.0008) [2023-12-27 22:54:42,602][106225] Updated weights for policy 1, policy_version 512190 (0.0007) [2023-12-27 22:54:42,614][106226] Updated weights for policy 0, policy_version 510900 (0.0009) [2023-12-27 22:54:42,663][106225] Updated weights for policy 1, policy_version 512200 (0.0009) [2023-12-27 22:54:43,222][106226] Updated weights for policy 0, policy_version 510910 (0.0008) [2023-12-27 22:54:43,276][106226] Updated weights for policy 0, policy_version 510920 (0.0006) [2023-12-27 22:54:43,327][106226] Updated weights for policy 0, policy_version 510930 (0.0009) [2023-12-27 22:54:43,431][106225] Updated weights for policy 1, policy_version 512210 (0.0008) [2023-12-27 22:54:43,493][106225] Updated weights for policy 1, policy_version 512220 (0.0008) [2023-12-27 22:54:43,551][106225] Updated weights for policy 1, policy_version 512230 (0.0008) [2023-12-27 22:54:43,598][106225] Updated weights for policy 1, policy_version 512240 (0.0008) [2023-12-27 22:54:44,006][106226] Updated weights for policy 0, policy_version 510940 (0.0007) [2023-12-27 22:54:44,065][106226] Updated weights for policy 0, policy_version 510950 (0.0008) [2023-12-27 22:54:44,125][106226] Updated weights for policy 0, policy_version 510960 (0.0005) [2023-12-27 22:54:44,373][106225] Updated weights for policy 1, policy_version 512250 (0.0007) [2023-12-27 22:54:44,438][106225] Updated weights for policy 1, policy_version 512260 (0.0007) [2023-12-27 22:54:44,509][106225] Updated weights for policy 1, policy_version 512270 (0.0005) [2023-12-27 22:54:44,714][106226] Updated weights for policy 0, policy_version 510970 (0.0006) [2023-12-27 22:54:44,775][106226] Updated weights for policy 0, policy_version 510980 (0.0007) [2023-12-27 22:54:44,838][106226] Updated weights for policy 0, policy_version 510990 (0.0008) [2023-12-27 22:54:44,899][106226] Updated weights for policy 0, policy_version 511000 (0.0008) [2023-12-27 22:54:45,249][106225] Updated weights for policy 1, policy_version 512280 (0.0008) [2023-12-27 22:54:45,302][106225] Updated weights for policy 1, policy_version 512290 (0.0008) [2023-12-27 22:54:45,355][106225] Updated weights for policy 1, policy_version 512300 (0.0008) [2023-12-27 22:54:45,631][106226] Updated weights for policy 0, policy_version 511010 (0.0009) [2023-12-27 22:54:45,690][106226] Updated weights for policy 0, policy_version 511020 (0.0008) [2023-12-27 22:54:45,757][106226] Updated weights for policy 0, policy_version 511030 (0.0009) [2023-12-27 22:54:46,125][106225] Updated weights for policy 1, policy_version 512310 (0.0009) [2023-12-27 22:54:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 262037504. Throughput: 0: 9777.5, 1: 9670.6. Samples: 262032160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:54:46,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-5.356')] [2023-12-27 22:54:46,179][106225] Updated weights for policy 1, policy_version 512320 (0.0008) [2023-12-27 22:54:46,248][106225] Updated weights for policy 1, policy_version 512330 (0.0009) [2023-12-27 22:54:46,418][106226] Updated weights for policy 0, policy_version 511040 (0.0010) [2023-12-27 22:54:46,480][106226] Updated weights for policy 0, policy_version 511050 (0.0011) [2023-12-27 22:54:46,545][106226] Updated weights for policy 0, policy_version 511060 (0.0011) [2023-12-27 22:54:46,968][106225] Updated weights for policy 1, policy_version 512340 (0.0008) [2023-12-27 22:54:47,027][106225] Updated weights for policy 1, policy_version 512350 (0.0005) [2023-12-27 22:54:47,085][106225] Updated weights for policy 1, policy_version 512360 (0.0010) [2023-12-27 22:54:47,232][106226] Updated weights for policy 0, policy_version 511070 (0.0010) [2023-12-27 22:54:47,288][106226] Updated weights for policy 0, policy_version 511080 (0.0010) [2023-12-27 22:54:47,351][106226] Updated weights for policy 0, policy_version 511090 (0.0011) [2023-12-27 22:54:47,742][106225] Updated weights for policy 1, policy_version 512370 (0.0009) [2023-12-27 22:54:47,804][106225] Updated weights for policy 1, policy_version 512380 (0.0009) [2023-12-27 22:54:47,861][106225] Updated weights for policy 1, policy_version 512390 (0.0010) [2023-12-27 22:54:47,911][106225] Updated weights for policy 1, policy_version 512400 (0.0005) [2023-12-27 22:54:48,019][106226] Updated weights for policy 0, policy_version 511100 (0.0007) [2023-12-27 22:54:48,078][106226] Updated weights for policy 0, policy_version 511110 (0.0006) [2023-12-27 22:54:48,136][106226] Updated weights for policy 0, policy_version 511120 (0.0006) [2023-12-27 22:54:48,529][106225] Updated weights for policy 1, policy_version 512410 (0.0010) [2023-12-27 22:54:48,596][106225] Updated weights for policy 1, policy_version 512420 (0.0010) [2023-12-27 22:54:48,655][106225] Updated weights for policy 1, policy_version 512430 (0.0010) [2023-12-27 22:54:48,879][106226] Updated weights for policy 0, policy_version 511130 (0.0006) [2023-12-27 22:54:48,945][106226] Updated weights for policy 0, policy_version 511140 (0.0006) [2023-12-27 22:54:49,010][106226] Updated weights for policy 0, policy_version 511150 (0.0005) [2023-12-27 22:54:49,073][106226] Updated weights for policy 0, policy_version 511160 (0.0006) [2023-12-27 22:54:49,385][106225] Updated weights for policy 1, policy_version 512440 (0.0010) [2023-12-27 22:54:49,449][106225] Updated weights for policy 1, policy_version 512450 (0.0010) [2023-12-27 22:54:49,514][106225] Updated weights for policy 1, policy_version 512460 (0.0007) [2023-12-27 22:54:49,697][106226] Updated weights for policy 0, policy_version 511170 (0.0006) [2023-12-27 22:54:49,757][106226] Updated weights for policy 0, policy_version 511180 (0.0007) [2023-12-27 22:54:49,818][106226] Updated weights for policy 0, policy_version 511190 (0.0010) [2023-12-27 22:54:50,257][106225] Updated weights for policy 1, policy_version 512470 (0.0009) [2023-12-27 22:54:50,334][106225] Updated weights for policy 1, policy_version 512480 (0.0006) [2023-12-27 22:54:50,382][106225] Updated weights for policy 1, policy_version 512490 (0.0007) [2023-12-27 22:54:50,479][106226] Updated weights for policy 0, policy_version 511200 (0.0009) [2023-12-27 22:54:50,532][106226] Updated weights for policy 0, policy_version 511210 (0.0007) [2023-12-27 22:54:50,592][106226] Updated weights for policy 0, policy_version 511220 (0.0009) [2023-12-27 22:54:51,074][106225] Updated weights for policy 1, policy_version 512500 (0.0007) [2023-12-27 22:54:51,136][106225] Updated weights for policy 1, policy_version 512510 (0.0007) [2023-12-27 22:54:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 262135808. Throughput: 0: 9789.9, 1: 9641.5. Samples: 262150384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:54:51,175][105115] Avg episode reward: [(0, '-5.047'), (1, '-5.675')] [2023-12-27 22:54:51,198][106225] Updated weights for policy 1, policy_version 512520 (0.0010) [2023-12-27 22:54:51,390][106226] Updated weights for policy 0, policy_version 511230 (0.0009) [2023-12-27 22:54:51,461][106226] Updated weights for policy 0, policy_version 511240 (0.0008) [2023-12-27 22:54:51,528][106226] Updated weights for policy 0, policy_version 511250 (0.0008) [2023-12-27 22:54:51,940][106225] Updated weights for policy 1, policy_version 512530 (0.0009) [2023-12-27 22:54:52,004][106225] Updated weights for policy 1, policy_version 512540 (0.0009) [2023-12-27 22:54:52,066][106225] Updated weights for policy 1, policy_version 512550 (0.0007) [2023-12-27 22:54:52,129][106225] Updated weights for policy 1, policy_version 512560 (0.0007) [2023-12-27 22:54:52,249][106226] Updated weights for policy 0, policy_version 511260 (0.0008) [2023-12-27 22:54:52,317][106226] Updated weights for policy 0, policy_version 511270 (0.0007) [2023-12-27 22:54:52,388][106226] Updated weights for policy 0, policy_version 511280 (0.0007) [2023-12-27 22:54:52,863][106225] Updated weights for policy 1, policy_version 512570 (0.0010) [2023-12-27 22:54:52,929][106225] Updated weights for policy 1, policy_version 512580 (0.0010) [2023-12-27 22:54:52,970][106226] Updated weights for policy 0, policy_version 511290 (0.0007) [2023-12-27 22:54:52,992][106225] Updated weights for policy 1, policy_version 512590 (0.0009) [2023-12-27 22:54:53,023][106226] Updated weights for policy 0, policy_version 511300 (0.0007) [2023-12-27 22:54:53,072][106226] Updated weights for policy 0, policy_version 511310 (0.0008) [2023-12-27 22:54:53,132][106226] Updated weights for policy 0, policy_version 511320 (0.0007) [2023-12-27 22:54:53,662][106225] Updated weights for policy 1, policy_version 512600 (0.0005) [2023-12-27 22:54:53,719][106225] Updated weights for policy 1, policy_version 512610 (0.0005) [2023-12-27 22:54:53,777][106225] Updated weights for policy 1, policy_version 512620 (0.0006) [2023-12-27 22:54:53,831][106226] Updated weights for policy 0, policy_version 511330 (0.0008) [2023-12-27 22:54:53,884][106226] Updated weights for policy 0, policy_version 511340 (0.0010) [2023-12-27 22:54:53,938][106226] Updated weights for policy 0, policy_version 511350 (0.0011) [2023-12-27 22:54:54,437][106225] Updated weights for policy 1, policy_version 512630 (0.0009) [2023-12-27 22:54:54,494][106225] Updated weights for policy 1, policy_version 512640 (0.0010) [2023-12-27 22:54:54,513][106226] Updated weights for policy 0, policy_version 511360 (0.0007) [2023-12-27 22:54:54,554][106225] Updated weights for policy 1, policy_version 512650 (0.0010) [2023-12-27 22:54:54,567][106226] Updated weights for policy 0, policy_version 511370 (0.0005) [2023-12-27 22:54:54,631][106226] Updated weights for policy 0, policy_version 511380 (0.0005) [2023-12-27 22:54:55,111][106225] Updated weights for policy 1, policy_version 512660 (0.0008) [2023-12-27 22:54:55,173][106225] Updated weights for policy 1, policy_version 512670 (0.0007) [2023-12-27 22:54:55,218][106226] Updated weights for policy 0, policy_version 511390 (0.0008) [2023-12-27 22:54:55,234][106225] Updated weights for policy 1, policy_version 512680 (0.0007) [2023-12-27 22:54:55,278][106226] Updated weights for policy 0, policy_version 511400 (0.0007) [2023-12-27 22:54:55,331][106226] Updated weights for policy 0, policy_version 511410 (0.0008) [2023-12-27 22:54:55,732][106225] Updated weights for policy 1, policy_version 512690 (0.0005) [2023-12-27 22:54:55,788][106225] Updated weights for policy 1, policy_version 512700 (0.0005) [2023-12-27 22:54:55,845][106225] Updated weights for policy 1, policy_version 512710 (0.0005) [2023-12-27 22:54:55,903][106225] Updated weights for policy 1, policy_version 512720 (0.0005) [2023-12-27 22:54:56,054][106226] Updated weights for policy 0, policy_version 511420 (0.0010) [2023-12-27 22:54:56,112][106226] Updated weights for policy 0, policy_version 511430 (0.0007) [2023-12-27 22:54:56,169][106226] Updated weights for policy 0, policy_version 511440 (0.0005) [2023-12-27 22:54:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 262242304. Throughput: 0: 9807.0, 1: 9652.8. Samples: 262210228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:54:56,175][105115] Avg episode reward: [(0, '-5.044'), (1, '-5.403')] [2023-12-27 22:54:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000512720_131284992.pth... [2023-12-27 22:54:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000511568_130990080.pth [2023-12-27 22:54:56,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000511448_130965504.pth... [2023-12-27 22:54:56,225][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000510264_130662400.pth [2023-12-27 22:54:56,517][106225] Updated weights for policy 1, policy_version 512730 (0.0010) [2023-12-27 22:54:56,573][106225] Updated weights for policy 1, policy_version 512740 (0.0010) [2023-12-27 22:54:56,632][106225] Updated weights for policy 1, policy_version 512750 (0.0010) [2023-12-27 22:54:56,807][106226] Updated weights for policy 0, policy_version 511450 (0.0006) [2023-12-27 22:54:56,855][106226] Updated weights for policy 0, policy_version 511460 (0.0005) [2023-12-27 22:54:56,901][106226] Updated weights for policy 0, policy_version 511470 (0.0006) [2023-12-27 22:54:56,954][106226] Updated weights for policy 0, policy_version 511480 (0.0008) [2023-12-27 22:54:57,258][106225] Updated weights for policy 1, policy_version 512760 (0.0008) [2023-12-27 22:54:57,313][106225] Updated weights for policy 1, policy_version 512770 (0.0005) [2023-12-27 22:54:57,376][106225] Updated weights for policy 1, policy_version 512780 (0.0006) [2023-12-27 22:54:57,617][106226] Updated weights for policy 0, policy_version 511490 (0.0009) [2023-12-27 22:54:57,679][106226] Updated weights for policy 0, policy_version 511500 (0.0010) [2023-12-27 22:54:57,735][106226] Updated weights for policy 0, policy_version 511510 (0.0010) [2023-12-27 22:54:57,994][106225] Updated weights for policy 1, policy_version 512790 (0.0010) [2023-12-27 22:54:58,051][106225] Updated weights for policy 1, policy_version 512800 (0.0010) [2023-12-27 22:54:58,099][106225] Updated weights for policy 1, policy_version 512810 (0.0008) [2023-12-27 22:54:58,425][106226] Updated weights for policy 0, policy_version 511520 (0.0009) [2023-12-27 22:54:58,488][106226] Updated weights for policy 0, policy_version 511530 (0.0008) [2023-12-27 22:54:58,551][106226] Updated weights for policy 0, policy_version 511540 (0.0008) [2023-12-27 22:54:58,839][106225] Updated weights for policy 1, policy_version 512820 (0.0009) [2023-12-27 22:54:58,899][106225] Updated weights for policy 1, policy_version 512830 (0.0008) [2023-12-27 22:54:58,964][106225] Updated weights for policy 1, policy_version 512840 (0.0008) [2023-12-27 22:54:59,269][106226] Updated weights for policy 0, policy_version 511550 (0.0010) [2023-12-27 22:54:59,336][106226] Updated weights for policy 0, policy_version 511560 (0.0010) [2023-12-27 22:54:59,406][106226] Updated weights for policy 0, policy_version 511570 (0.0011) [2023-12-27 22:54:59,678][106225] Updated weights for policy 1, policy_version 512850 (0.0008) [2023-12-27 22:54:59,734][106225] Updated weights for policy 1, policy_version 512860 (0.0009) [2023-12-27 22:54:59,789][106225] Updated weights for policy 1, policy_version 512870 (0.0008) [2023-12-27 22:54:59,853][106225] Updated weights for policy 1, policy_version 512880 (0.0008) [2023-12-27 22:55:00,133][106226] Updated weights for policy 0, policy_version 511580 (0.0010) [2023-12-27 22:55:00,185][106226] Updated weights for policy 0, policy_version 511590 (0.0010) [2023-12-27 22:55:00,239][106226] Updated weights for policy 0, policy_version 511600 (0.0011) [2023-12-27 22:55:00,584][106225] Updated weights for policy 1, policy_version 512890 (0.0007) [2023-12-27 22:55:00,636][106225] Updated weights for policy 1, policy_version 512900 (0.0007) [2023-12-27 22:55:00,688][106225] Updated weights for policy 1, policy_version 512910 (0.0008) [2023-12-27 22:55:00,933][106226] Updated weights for policy 0, policy_version 511610 (0.0010) [2023-12-27 22:55:00,980][106226] Updated weights for policy 0, policy_version 511620 (0.0005) [2023-12-27 22:55:01,034][106226] Updated weights for policy 0, policy_version 511630 (0.0006) [2023-12-27 22:55:01,101][106226] Updated weights for policy 0, policy_version 511640 (0.0011) [2023-12-27 22:55:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 262348800. Throughput: 0: 9897.9, 1: 9779.2. Samples: 262336712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:01,175][105115] Avg episode reward: [(0, '-5.223'), (1, '-5.357')] [2023-12-27 22:55:01,437][106225] Updated weights for policy 1, policy_version 512920 (0.0006) [2023-12-27 22:55:01,499][106225] Updated weights for policy 1, policy_version 512930 (0.0006) [2023-12-27 22:55:01,563][106225] Updated weights for policy 1, policy_version 512940 (0.0008) [2023-12-27 22:55:01,817][106226] Updated weights for policy 0, policy_version 511650 (0.0008) [2023-12-27 22:55:01,871][106226] Updated weights for policy 0, policy_version 511660 (0.0008) [2023-12-27 22:55:01,931][106226] Updated weights for policy 0, policy_version 511670 (0.0009) [2023-12-27 22:55:02,238][106225] Updated weights for policy 1, policy_version 512950 (0.0009) [2023-12-27 22:55:02,297][106225] Updated weights for policy 1, policy_version 512960 (0.0009) [2023-12-27 22:55:02,360][106225] Updated weights for policy 1, policy_version 512970 (0.0009) [2023-12-27 22:55:02,697][106226] Updated weights for policy 0, policy_version 511680 (0.0009) [2023-12-27 22:55:02,755][106226] Updated weights for policy 0, policy_version 511690 (0.0008) [2023-12-27 22:55:02,814][106226] Updated weights for policy 0, policy_version 511700 (0.0008) [2023-12-27 22:55:03,080][106225] Updated weights for policy 1, policy_version 512980 (0.0007) [2023-12-27 22:55:03,142][106225] Updated weights for policy 1, policy_version 512990 (0.0008) [2023-12-27 22:55:03,197][106225] Updated weights for policy 1, policy_version 513000 (0.0005) [2023-12-27 22:55:03,558][106226] Updated weights for policy 0, policy_version 511710 (0.0009) [2023-12-27 22:55:03,622][106226] Updated weights for policy 0, policy_version 511720 (0.0008) [2023-12-27 22:55:03,684][106226] Updated weights for policy 0, policy_version 511730 (0.0009) [2023-12-27 22:55:03,841][106225] Updated weights for policy 1, policy_version 513010 (0.0009) [2023-12-27 22:55:03,906][106225] Updated weights for policy 1, policy_version 513020 (0.0008) [2023-12-27 22:55:03,964][106225] Updated weights for policy 1, policy_version 513030 (0.0008) [2023-12-27 22:55:04,021][106225] Updated weights for policy 1, policy_version 513040 (0.0009) [2023-12-27 22:55:04,399][106226] Updated weights for policy 0, policy_version 511740 (0.0008) [2023-12-27 22:55:04,459][106226] Updated weights for policy 0, policy_version 511750 (0.0007) [2023-12-27 22:55:04,507][106226] Updated weights for policy 0, policy_version 511760 (0.0008) [2023-12-27 22:55:04,757][106225] Updated weights for policy 1, policy_version 513050 (0.0008) [2023-12-27 22:55:04,805][106225] Updated weights for policy 1, policy_version 513060 (0.0008) [2023-12-27 22:55:04,854][106225] Updated weights for policy 1, policy_version 513070 (0.0008) [2023-12-27 22:55:05,273][106226] Updated weights for policy 0, policy_version 511770 (0.0008) [2023-12-27 22:55:05,322][106226] Updated weights for policy 0, policy_version 511780 (0.0008) [2023-12-27 22:55:05,369][106226] Updated weights for policy 0, policy_version 511790 (0.0008) [2023-12-27 22:55:05,422][106226] Updated weights for policy 0, policy_version 511800 (0.0008) [2023-12-27 22:55:05,504][106225] Updated weights for policy 1, policy_version 513080 (0.0007) [2023-12-27 22:55:05,565][106225] Updated weights for policy 1, policy_version 513090 (0.0008) [2023-12-27 22:55:05,622][106225] Updated weights for policy 1, policy_version 513100 (0.0009) [2023-12-27 22:55:06,169][106226] Updated weights for policy 0, policy_version 511810 (0.0009) [2023-12-27 22:55:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 262438912. Throughput: 0: 9882.1, 1: 9764.5. Samples: 262453152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:06,175][105115] Avg episode reward: [(0, '-5.357'), (1, '-5.489')] [2023-12-27 22:55:06,232][106226] Updated weights for policy 0, policy_version 511820 (0.0009) [2023-12-27 22:55:06,294][106226] Updated weights for policy 0, policy_version 511830 (0.0009) [2023-12-27 22:55:06,374][106225] Updated weights for policy 1, policy_version 513110 (0.0008) [2023-12-27 22:55:06,437][106225] Updated weights for policy 1, policy_version 513120 (0.0008) [2023-12-27 22:55:06,504][106225] Updated weights for policy 1, policy_version 513130 (0.0010) [2023-12-27 22:55:06,974][106226] Updated weights for policy 0, policy_version 511840 (0.0008) [2023-12-27 22:55:07,037][106226] Updated weights for policy 0, policy_version 511850 (0.0008) [2023-12-27 22:55:07,087][106226] Updated weights for policy 0, policy_version 511860 (0.0008) [2023-12-27 22:55:07,216][106225] Updated weights for policy 1, policy_version 513140 (0.0009) [2023-12-27 22:55:07,274][106225] Updated weights for policy 1, policy_version 513150 (0.0011) [2023-12-27 22:55:07,339][106225] Updated weights for policy 1, policy_version 513160 (0.0011) [2023-12-27 22:55:07,798][106226] Updated weights for policy 0, policy_version 511870 (0.0008) [2023-12-27 22:55:07,861][106226] Updated weights for policy 0, policy_version 511880 (0.0009) [2023-12-27 22:55:07,915][106226] Updated weights for policy 0, policy_version 511890 (0.0009) [2023-12-27 22:55:08,013][106225] Updated weights for policy 1, policy_version 513170 (0.0010) [2023-12-27 22:55:08,071][106225] Updated weights for policy 1, policy_version 513180 (0.0009) [2023-12-27 22:55:08,129][106225] Updated weights for policy 1, policy_version 513190 (0.0008) [2023-12-27 22:55:08,191][106225] Updated weights for policy 1, policy_version 513200 (0.0009) [2023-12-27 22:55:08,664][106226] Updated weights for policy 0, policy_version 511900 (0.0008) [2023-12-27 22:55:08,724][106226] Updated weights for policy 0, policy_version 511910 (0.0009) [2023-12-27 22:55:08,786][106226] Updated weights for policy 0, policy_version 511920 (0.0008) [2023-12-27 22:55:08,939][106225] Updated weights for policy 1, policy_version 513210 (0.0008) [2023-12-27 22:55:08,993][106225] Updated weights for policy 1, policy_version 513220 (0.0007) [2023-12-27 22:55:09,038][106225] Updated weights for policy 1, policy_version 513230 (0.0008) [2023-12-27 22:55:09,589][106226] Updated weights for policy 0, policy_version 511930 (0.0009) [2023-12-27 22:55:09,654][106226] Updated weights for policy 0, policy_version 511940 (0.0009) [2023-12-27 22:55:09,717][106226] Updated weights for policy 0, policy_version 511950 (0.0010) [2023-12-27 22:55:09,736][106225] Updated weights for policy 1, policy_version 513240 (0.0008) [2023-12-27 22:55:09,778][106226] Updated weights for policy 0, policy_version 511960 (0.0006) [2023-12-27 22:55:09,800][106225] Updated weights for policy 1, policy_version 513250 (0.0008) [2023-12-27 22:55:09,874][106225] Updated weights for policy 1, policy_version 513260 (0.0008) [2023-12-27 22:55:10,552][106226] Updated weights for policy 0, policy_version 511970 (0.0011) [2023-12-27 22:55:10,581][106225] Updated weights for policy 1, policy_version 513270 (0.0008) [2023-12-27 22:55:10,607][106226] Updated weights for policy 0, policy_version 511980 (0.0010) [2023-12-27 22:55:10,645][106225] Updated weights for policy 1, policy_version 513280 (0.0008) [2023-12-27 22:55:10,657][106226] Updated weights for policy 0, policy_version 511990 (0.0010) [2023-12-27 22:55:10,710][106225] Updated weights for policy 1, policy_version 513290 (0.0007) [2023-12-27 22:55:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 262537216. Throughput: 0: 9884.4, 1: 9805.7. Samples: 262510824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:11,175][105115] Avg episode reward: [(0, '-5.227'), (1, '-5.777')] [2023-12-27 22:55:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000513296_131432448.pth... [2023-12-27 22:55:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000511992_131104768.pth... [2023-12-27 22:55:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000512144_131137536.pth [2023-12-27 22:55:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000510840_130809856.pth [2023-12-27 22:55:11,431][106225] Updated weights for policy 1, policy_version 513300 (0.0007) [2023-12-27 22:55:11,468][106226] Updated weights for policy 0, policy_version 512000 (0.0009) [2023-12-27 22:55:11,490][106225] Updated weights for policy 1, policy_version 513310 (0.0006) [2023-12-27 22:55:11,535][106226] Updated weights for policy 0, policy_version 512010 (0.0007) [2023-12-27 22:55:11,555][106225] Updated weights for policy 1, policy_version 513320 (0.0006) [2023-12-27 22:55:11,601][106226] Updated weights for policy 0, policy_version 512020 (0.0008) [2023-12-27 22:55:12,299][106225] Updated weights for policy 1, policy_version 513330 (0.0006) [2023-12-27 22:55:12,326][106226] Updated weights for policy 0, policy_version 512030 (0.0007) [2023-12-27 22:55:12,361][106225] Updated weights for policy 1, policy_version 513340 (0.0007) [2023-12-27 22:55:12,400][106226] Updated weights for policy 0, policy_version 512040 (0.0008) [2023-12-27 22:55:12,428][106225] Updated weights for policy 1, policy_version 513350 (0.0008) [2023-12-27 22:55:12,466][106226] Updated weights for policy 0, policy_version 512050 (0.0006) [2023-12-27 22:55:12,495][106225] Updated weights for policy 1, policy_version 513360 (0.0008) [2023-12-27 22:55:13,157][106226] Updated weights for policy 0, policy_version 512060 (0.0007) [2023-12-27 22:55:13,203][106225] Updated weights for policy 1, policy_version 513370 (0.0008) [2023-12-27 22:55:13,217][106226] Updated weights for policy 0, policy_version 512070 (0.0007) [2023-12-27 22:55:13,264][106225] Updated weights for policy 1, policy_version 513380 (0.0007) [2023-12-27 22:55:13,271][106226] Updated weights for policy 0, policy_version 512080 (0.0005) [2023-12-27 22:55:13,314][106225] Updated weights for policy 1, policy_version 513390 (0.0007) [2023-12-27 22:55:13,965][106226] Updated weights for policy 0, policy_version 512090 (0.0006) [2023-12-27 22:55:14,019][106226] Updated weights for policy 0, policy_version 512100 (0.0005) [2023-12-27 22:55:14,044][106225] Updated weights for policy 1, policy_version 513400 (0.0007) [2023-12-27 22:55:14,072][106226] Updated weights for policy 0, policy_version 512110 (0.0005) [2023-12-27 22:55:14,093][106225] Updated weights for policy 1, policy_version 513410 (0.0008) [2023-12-27 22:55:14,123][106226] Updated weights for policy 0, policy_version 512120 (0.0005) [2023-12-27 22:55:14,151][106225] Updated weights for policy 1, policy_version 513420 (0.0008) [2023-12-27 22:55:14,759][106226] Updated weights for policy 0, policy_version 512130 (0.0006) [2023-12-27 22:55:14,829][106226] Updated weights for policy 0, policy_version 512140 (0.0007) [2023-12-27 22:55:14,833][106225] Updated weights for policy 1, policy_version 513430 (0.0008) [2023-12-27 22:55:14,896][106225] Updated weights for policy 1, policy_version 513440 (0.0007) [2023-12-27 22:55:14,899][106226] Updated weights for policy 0, policy_version 512150 (0.0008) [2023-12-27 22:55:14,965][106225] Updated weights for policy 1, policy_version 513450 (0.0008) [2023-12-27 22:55:15,491][106226] Updated weights for policy 0, policy_version 512160 (0.0006) [2023-12-27 22:55:15,549][106226] Updated weights for policy 0, policy_version 512170 (0.0005) [2023-12-27 22:55:15,610][106226] Updated weights for policy 0, policy_version 512180 (0.0006) [2023-12-27 22:55:15,767][106225] Updated weights for policy 1, policy_version 513460 (0.0009) [2023-12-27 22:55:15,833][106225] Updated weights for policy 1, policy_version 513470 (0.0008) [2023-12-27 22:55:15,884][106225] Updated weights for policy 1, policy_version 513480 (0.0008) [2023-12-27 22:55:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 262635520. Throughput: 0: 9797.5, 1: 9768.2. Samples: 262625756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:16,175][105115] Avg episode reward: [(0, '-5.017'), (1, '-5.485')] [2023-12-27 22:55:16,217][106226] Updated weights for policy 0, policy_version 512190 (0.0005) [2023-12-27 22:55:16,263][106226] Updated weights for policy 0, policy_version 512200 (0.0005) [2023-12-27 22:55:16,317][106226] Updated weights for policy 0, policy_version 512210 (0.0005) [2023-12-27 22:55:16,522][106225] Updated weights for policy 1, policy_version 513490 (0.0008) [2023-12-27 22:55:16,580][106225] Updated weights for policy 1, policy_version 513500 (0.0005) [2023-12-27 22:55:16,638][106225] Updated weights for policy 1, policy_version 513510 (0.0005) [2023-12-27 22:55:16,691][106225] Updated weights for policy 1, policy_version 513520 (0.0006) [2023-12-27 22:55:17,023][106226] Updated weights for policy 0, policy_version 512220 (0.0008) [2023-12-27 22:55:17,079][106226] Updated weights for policy 0, policy_version 512230 (0.0008) [2023-12-27 22:55:17,136][106226] Updated weights for policy 0, policy_version 512240 (0.0009) [2023-12-27 22:55:17,344][106225] Updated weights for policy 1, policy_version 513530 (0.0009) [2023-12-27 22:55:17,397][106225] Updated weights for policy 1, policy_version 513540 (0.0009) [2023-12-27 22:55:17,449][106225] Updated weights for policy 1, policy_version 513550 (0.0008) [2023-12-27 22:55:17,854][106226] Updated weights for policy 0, policy_version 512250 (0.0010) [2023-12-27 22:55:17,911][106226] Updated weights for policy 0, policy_version 512260 (0.0008) [2023-12-27 22:55:17,964][106226] Updated weights for policy 0, policy_version 512270 (0.0008) [2023-12-27 22:55:18,021][106226] Updated weights for policy 0, policy_version 512280 (0.0006) [2023-12-27 22:55:18,162][106225] Updated weights for policy 1, policy_version 513560 (0.0008) [2023-12-27 22:55:18,211][106225] Updated weights for policy 1, policy_version 513570 (0.0009) [2023-12-27 22:55:18,265][106225] Updated weights for policy 1, policy_version 513580 (0.0007) [2023-12-27 22:55:18,683][106226] Updated weights for policy 0, policy_version 512290 (0.0008) [2023-12-27 22:55:18,747][106226] Updated weights for policy 0, policy_version 512300 (0.0008) [2023-12-27 22:55:18,809][106226] Updated weights for policy 0, policy_version 512310 (0.0008) [2023-12-27 22:55:19,001][106225] Updated weights for policy 1, policy_version 513590 (0.0007) [2023-12-27 22:55:19,065][106225] Updated weights for policy 1, policy_version 513600 (0.0009) [2023-12-27 22:55:19,125][106225] Updated weights for policy 1, policy_version 513610 (0.0008) [2023-12-27 22:55:19,500][106226] Updated weights for policy 0, policy_version 512320 (0.0009) [2023-12-27 22:55:19,562][106226] Updated weights for policy 0, policy_version 512330 (0.0008) [2023-12-27 22:55:19,616][106226] Updated weights for policy 0, policy_version 512340 (0.0009) [2023-12-27 22:55:19,861][106225] Updated weights for policy 1, policy_version 513620 (0.0008) [2023-12-27 22:55:19,929][106225] Updated weights for policy 1, policy_version 513630 (0.0008) [2023-12-27 22:55:19,997][106225] Updated weights for policy 1, policy_version 513640 (0.0008) [2023-12-27 22:55:20,365][106226] Updated weights for policy 0, policy_version 512350 (0.0007) [2023-12-27 22:55:20,428][106226] Updated weights for policy 0, policy_version 512360 (0.0007) [2023-12-27 22:55:20,488][106226] Updated weights for policy 0, policy_version 512370 (0.0006) [2023-12-27 22:55:20,770][106225] Updated weights for policy 1, policy_version 513650 (0.0007) [2023-12-27 22:55:20,831][106225] Updated weights for policy 1, policy_version 513660 (0.0009) [2023-12-27 22:55:20,899][106225] Updated weights for policy 1, policy_version 513670 (0.0010) [2023-12-27 22:55:20,966][106225] Updated weights for policy 1, policy_version 513680 (0.0011) [2023-12-27 22:55:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 262733824. Throughput: 0: 9852.8, 1: 9772.4. Samples: 262744304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:21,175][105115] Avg episode reward: [(0, '-5.061'), (1, '-5.652')] [2023-12-27 22:55:21,216][106226] Updated weights for policy 0, policy_version 512380 (0.0006) [2023-12-27 22:55:21,275][106226] Updated weights for policy 0, policy_version 512390 (0.0006) [2023-12-27 22:55:21,347][106226] Updated weights for policy 0, policy_version 512400 (0.0007) [2023-12-27 22:55:21,756][106225] Updated weights for policy 1, policy_version 513690 (0.0009) [2023-12-27 22:55:21,822][106225] Updated weights for policy 1, policy_version 513700 (0.0009) [2023-12-27 22:55:21,887][106225] Updated weights for policy 1, policy_version 513710 (0.0008) [2023-12-27 22:55:22,016][106226] Updated weights for policy 0, policy_version 512410 (0.0009) [2023-12-27 22:55:22,073][106226] Updated weights for policy 0, policy_version 512420 (0.0009) [2023-12-27 22:55:22,126][106226] Updated weights for policy 0, policy_version 512430 (0.0009) [2023-12-27 22:55:22,177][106226] Updated weights for policy 0, policy_version 512440 (0.0008) [2023-12-27 22:55:22,635][106225] Updated weights for policy 1, policy_version 513720 (0.0008) [2023-12-27 22:55:22,683][106225] Updated weights for policy 1, policy_version 513730 (0.0008) [2023-12-27 22:55:22,735][106225] Updated weights for policy 1, policy_version 513740 (0.0008) [2023-12-27 22:55:22,919][106226] Updated weights for policy 0, policy_version 512450 (0.0008) [2023-12-27 22:55:22,977][106226] Updated weights for policy 0, policy_version 512460 (0.0008) [2023-12-27 22:55:23,039][106226] Updated weights for policy 0, policy_version 512470 (0.0008) [2023-12-27 22:55:23,392][106225] Updated weights for policy 1, policy_version 513750 (0.0009) [2023-12-27 22:55:23,441][106225] Updated weights for policy 1, policy_version 513760 (0.0008) [2023-12-27 22:55:23,498][106225] Updated weights for policy 1, policy_version 513770 (0.0008) [2023-12-27 22:55:23,700][106226] Updated weights for policy 0, policy_version 512480 (0.0009) [2023-12-27 22:55:23,747][106226] Updated weights for policy 0, policy_version 512490 (0.0008) [2023-12-27 22:55:23,794][106226] Updated weights for policy 0, policy_version 512500 (0.0008) [2023-12-27 22:55:24,222][106225] Updated weights for policy 1, policy_version 513780 (0.0009) [2023-12-27 22:55:24,279][106225] Updated weights for policy 1, policy_version 513790 (0.0010) [2023-12-27 22:55:24,328][106225] Updated weights for policy 1, policy_version 513800 (0.0010) [2023-12-27 22:55:24,568][106226] Updated weights for policy 0, policy_version 512510 (0.0008) [2023-12-27 22:55:24,623][106226] Updated weights for policy 0, policy_version 512520 (0.0007) [2023-12-27 22:55:24,674][106226] Updated weights for policy 0, policy_version 512530 (0.0009) [2023-12-27 22:55:24,975][106225] Updated weights for policy 1, policy_version 513810 (0.0010) [2023-12-27 22:55:25,038][106225] Updated weights for policy 1, policy_version 513820 (0.0010) [2023-12-27 22:55:25,091][106225] Updated weights for policy 1, policy_version 513830 (0.0010) [2023-12-27 22:55:25,141][106225] Updated weights for policy 1, policy_version 513840 (0.0010) [2023-12-27 22:55:25,439][106226] Updated weights for policy 0, policy_version 512540 (0.0008) [2023-12-27 22:55:25,499][106226] Updated weights for policy 0, policy_version 512550 (0.0006) [2023-12-27 22:55:25,555][106226] Updated weights for policy 0, policy_version 512560 (0.0006) [2023-12-27 22:55:25,865][106225] Updated weights for policy 1, policy_version 513850 (0.0010) [2023-12-27 22:55:25,923][106225] Updated weights for policy 1, policy_version 513860 (0.0006) [2023-12-27 22:55:25,979][106225] Updated weights for policy 1, policy_version 513870 (0.0005) [2023-12-27 22:55:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 262832128. Throughput: 0: 9885.8, 1: 9730.4. Samples: 262801152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:26,176][105115] Avg episode reward: [(0, '-5.058'), (1, '-5.605')] [2023-12-27 22:55:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000513872_131579904.pth... [2023-12-27 22:55:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000512568_131252224.pth... [2023-12-27 22:55:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000512720_131284992.pth [2023-12-27 22:55:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000511448_130965504.pth [2023-12-27 22:55:26,307][106226] Updated weights for policy 0, policy_version 512570 (0.0008) [2023-12-27 22:55:26,363][106226] Updated weights for policy 0, policy_version 512580 (0.0009) [2023-12-27 22:55:26,416][106226] Updated weights for policy 0, policy_version 512590 (0.0009) [2023-12-27 22:55:26,468][106226] Updated weights for policy 0, policy_version 512600 (0.0008) [2023-12-27 22:55:26,563][106225] Updated weights for policy 1, policy_version 513880 (0.0009) [2023-12-27 22:55:26,613][106225] Updated weights for policy 1, policy_version 513890 (0.0010) [2023-12-27 22:55:26,666][106225] Updated weights for policy 1, policy_version 513900 (0.0010) [2023-12-27 22:55:27,263][106226] Updated weights for policy 0, policy_version 512610 (0.0008) [2023-12-27 22:55:27,307][106225] Updated weights for policy 1, policy_version 513910 (0.0010) [2023-12-27 22:55:27,322][106226] Updated weights for policy 0, policy_version 512620 (0.0006) [2023-12-27 22:55:27,365][106225] Updated weights for policy 1, policy_version 513920 (0.0010) [2023-12-27 22:55:27,373][106226] Updated weights for policy 0, policy_version 512630 (0.0007) [2023-12-27 22:55:27,426][106225] Updated weights for policy 1, policy_version 513930 (0.0006) [2023-12-27 22:55:28,088][106225] Updated weights for policy 1, policy_version 513940 (0.0007) [2023-12-27 22:55:28,100][106226] Updated weights for policy 0, policy_version 512640 (0.0010) [2023-12-27 22:55:28,148][106225] Updated weights for policy 1, policy_version 513950 (0.0010) [2023-12-27 22:55:28,157][106226] Updated weights for policy 0, policy_version 512650 (0.0010) [2023-12-27 22:55:28,200][106225] Updated weights for policy 1, policy_version 513960 (0.0010) [2023-12-27 22:55:28,208][106226] Updated weights for policy 0, policy_version 512660 (0.0010) [2023-12-27 22:55:28,911][106226] Updated weights for policy 0, policy_version 512670 (0.0008) [2023-12-27 22:55:28,943][106225] Updated weights for policy 1, policy_version 513970 (0.0008) [2023-12-27 22:55:28,961][106226] Updated weights for policy 0, policy_version 512680 (0.0011) [2023-12-27 22:55:28,990][106225] Updated weights for policy 1, policy_version 513980 (0.0005) [2023-12-27 22:55:29,011][106226] Updated weights for policy 0, policy_version 512690 (0.0010) [2023-12-27 22:55:29,036][106225] Updated weights for policy 1, policy_version 513990 (0.0007) [2023-12-27 22:55:29,078][106225] Updated weights for policy 1, policy_version 514000 (0.0008) [2023-12-27 22:55:29,766][106226] Updated weights for policy 0, policy_version 512700 (0.0010) [2023-12-27 22:55:29,819][106226] Updated weights for policy 0, policy_version 512710 (0.0010) [2023-12-27 22:55:29,879][106225] Updated weights for policy 1, policy_version 514010 (0.0007) [2023-12-27 22:55:29,885][106226] Updated weights for policy 0, policy_version 512720 (0.0011) [2023-12-27 22:55:29,943][106225] Updated weights for policy 1, policy_version 514020 (0.0006) [2023-12-27 22:55:30,001][106225] Updated weights for policy 1, policy_version 514030 (0.0008) [2023-12-27 22:55:30,600][106226] Updated weights for policy 0, policy_version 512730 (0.0010) [2023-12-27 22:55:30,656][106226] Updated weights for policy 0, policy_version 512740 (0.0010) [2023-12-27 22:55:30,715][106226] Updated weights for policy 0, policy_version 512750 (0.0010) [2023-12-27 22:55:30,736][106225] Updated weights for policy 1, policy_version 514040 (0.0006) [2023-12-27 22:55:30,774][106226] Updated weights for policy 0, policy_version 512760 (0.0010) [2023-12-27 22:55:30,786][106225] Updated weights for policy 1, policy_version 514050 (0.0007) [2023-12-27 22:55:30,839][106225] Updated weights for policy 1, policy_version 514060 (0.0008) [2023-12-27 22:55:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 262930432. Throughput: 0: 9815.8, 1: 9904.4. Samples: 262919564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:31,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-5.545')] [2023-12-27 22:55:31,532][106226] Updated weights for policy 0, policy_version 512770 (0.0011) [2023-12-27 22:55:31,594][106226] Updated weights for policy 0, policy_version 512780 (0.0010) [2023-12-27 22:55:31,637][106225] Updated weights for policy 1, policy_version 514070 (0.0007) [2023-12-27 22:55:31,660][106226] Updated weights for policy 0, policy_version 512790 (0.0010) [2023-12-27 22:55:31,702][106225] Updated weights for policy 1, policy_version 514080 (0.0008) [2023-12-27 22:55:31,764][106225] Updated weights for policy 1, policy_version 514090 (0.0008) [2023-12-27 22:55:32,386][106226] Updated weights for policy 0, policy_version 512800 (0.0011) [2023-12-27 22:55:32,446][106226] Updated weights for policy 0, policy_version 512810 (0.0011) [2023-12-27 22:55:32,506][106226] Updated weights for policy 0, policy_version 512820 (0.0011) [2023-12-27 22:55:32,520][106225] Updated weights for policy 1, policy_version 514100 (0.0007) [2023-12-27 22:55:32,578][106225] Updated weights for policy 1, policy_version 514110 (0.0008) [2023-12-27 22:55:32,637][106225] Updated weights for policy 1, policy_version 514120 (0.0008) [2023-12-27 22:55:33,204][106226] Updated weights for policy 0, policy_version 512830 (0.0011) [2023-12-27 22:55:33,256][106226] Updated weights for policy 0, policy_version 512840 (0.0010) [2023-12-27 22:55:33,302][106226] Updated weights for policy 0, policy_version 512850 (0.0010) [2023-12-27 22:55:33,356][106225] Updated weights for policy 1, policy_version 514130 (0.0010) [2023-12-27 22:55:33,408][106225] Updated weights for policy 1, policy_version 514140 (0.0008) [2023-12-27 22:55:33,461][106225] Updated weights for policy 1, policy_version 514150 (0.0008) [2023-12-27 22:55:33,517][106225] Updated weights for policy 1, policy_version 514160 (0.0007) [2023-12-27 22:55:33,942][106226] Updated weights for policy 0, policy_version 512860 (0.0008) [2023-12-27 22:55:34,003][106226] Updated weights for policy 0, policy_version 512870 (0.0008) [2023-12-27 22:55:34,068][106226] Updated weights for policy 0, policy_version 512880 (0.0010) [2023-12-27 22:55:34,226][106225] Updated weights for policy 1, policy_version 514170 (0.0008) [2023-12-27 22:55:34,287][106225] Updated weights for policy 1, policy_version 514180 (0.0008) [2023-12-27 22:55:34,344][106225] Updated weights for policy 1, policy_version 514190 (0.0007) [2023-12-27 22:55:34,783][106226] Updated weights for policy 0, policy_version 512890 (0.0009) [2023-12-27 22:55:34,834][106226] Updated weights for policy 0, policy_version 512900 (0.0010) [2023-12-27 22:55:34,894][106226] Updated weights for policy 0, policy_version 512910 (0.0010) [2023-12-27 22:55:34,953][106226] Updated weights for policy 0, policy_version 512920 (0.0011) [2023-12-27 22:55:34,988][106225] Updated weights for policy 1, policy_version 514200 (0.0009) [2023-12-27 22:55:35,044][106225] Updated weights for policy 1, policy_version 514210 (0.0007) [2023-12-27 22:55:35,095][106225] Updated weights for policy 1, policy_version 514220 (0.0008) [2023-12-27 22:55:35,679][106226] Updated weights for policy 0, policy_version 512930 (0.0011) [2023-12-27 22:55:35,744][106226] Updated weights for policy 0, policy_version 512940 (0.0010) [2023-12-27 22:55:35,800][106226] Updated weights for policy 0, policy_version 512950 (0.0005) [2023-12-27 22:55:35,838][106225] Updated weights for policy 1, policy_version 514230 (0.0009) [2023-12-27 22:55:35,891][106225] Updated weights for policy 1, policy_version 514240 (0.0006) [2023-12-27 22:55:35,950][106225] Updated weights for policy 1, policy_version 514250 (0.0006) [2023-12-27 22:55:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 263028736. Throughput: 0: 9822.3, 1: 9877.9. Samples: 263036896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:36,175][105115] Avg episode reward: [(0, '-5.118'), (1, '-5.324')] [2023-12-27 22:55:36,366][106226] Updated weights for policy 0, policy_version 512960 (0.0005) [2023-12-27 22:55:36,429][106226] Updated weights for policy 0, policy_version 512970 (0.0006) [2023-12-27 22:55:36,493][106226] Updated weights for policy 0, policy_version 512980 (0.0009) [2023-12-27 22:55:36,751][106225] Updated weights for policy 1, policy_version 514260 (0.0009) [2023-12-27 22:55:36,806][106225] Updated weights for policy 1, policy_version 514270 (0.0007) [2023-12-27 22:55:36,863][106225] Updated weights for policy 1, policy_version 514280 (0.0009) [2023-12-27 22:55:37,150][106226] Updated weights for policy 0, policy_version 512990 (0.0009) [2023-12-27 22:55:37,197][106226] Updated weights for policy 0, policy_version 513000 (0.0008) [2023-12-27 22:55:37,251][106226] Updated weights for policy 0, policy_version 513010 (0.0008) [2023-12-27 22:55:37,611][106225] Updated weights for policy 1, policy_version 514290 (0.0008) [2023-12-27 22:55:37,671][106225] Updated weights for policy 1, policy_version 514300 (0.0010) [2023-12-27 22:55:37,725][106225] Updated weights for policy 1, policy_version 514310 (0.0009) [2023-12-27 22:55:37,783][106225] Updated weights for policy 1, policy_version 514320 (0.0010) [2023-12-27 22:55:37,962][106226] Updated weights for policy 0, policy_version 513020 (0.0007) [2023-12-27 22:55:38,017][106226] Updated weights for policy 0, policy_version 513030 (0.0005) [2023-12-27 22:55:38,070][106226] Updated weights for policy 0, policy_version 513040 (0.0005) [2023-12-27 22:55:38,420][106225] Updated weights for policy 1, policy_version 514330 (0.0008) [2023-12-27 22:55:38,479][106225] Updated weights for policy 1, policy_version 514340 (0.0008) [2023-12-27 22:55:38,541][106225] Updated weights for policy 1, policy_version 514350 (0.0008) [2023-12-27 22:55:38,703][106226] Updated weights for policy 0, policy_version 513050 (0.0005) [2023-12-27 22:55:38,756][106226] Updated weights for policy 0, policy_version 513060 (0.0008) [2023-12-27 22:55:38,807][106226] Updated weights for policy 0, policy_version 513070 (0.0008) [2023-12-27 22:55:38,857][106226] Updated weights for policy 0, policy_version 513080 (0.0005) [2023-12-27 22:55:39,300][106225] Updated weights for policy 1, policy_version 514360 (0.0008) [2023-12-27 22:55:39,367][106225] Updated weights for policy 1, policy_version 514370 (0.0008) [2023-12-27 22:55:39,436][106225] Updated weights for policy 1, policy_version 514380 (0.0008) [2023-12-27 22:55:39,600][106226] Updated weights for policy 0, policy_version 513090 (0.0011) [2023-12-27 22:55:39,669][106226] Updated weights for policy 0, policy_version 513100 (0.0011) [2023-12-27 22:55:39,738][106226] Updated weights for policy 0, policy_version 513110 (0.0011) [2023-12-27 22:55:40,109][106225] Updated weights for policy 1, policy_version 514390 (0.0007) [2023-12-27 22:55:40,167][106225] Updated weights for policy 1, policy_version 514400 (0.0008) [2023-12-27 22:55:40,229][106225] Updated weights for policy 1, policy_version 514410 (0.0008) [2023-12-27 22:55:40,470][106226] Updated weights for policy 0, policy_version 513120 (0.0010) [2023-12-27 22:55:40,521][106226] Updated weights for policy 0, policy_version 513130 (0.0010) [2023-12-27 22:55:40,585][106226] Updated weights for policy 0, policy_version 513140 (0.0010) [2023-12-27 22:55:40,871][106225] Updated weights for policy 1, policy_version 514420 (0.0008) [2023-12-27 22:55:40,930][106225] Updated weights for policy 1, policy_version 514430 (0.0008) [2023-12-27 22:55:41,000][106225] Updated weights for policy 1, policy_version 514440 (0.0005) [2023-12-27 22:55:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 263127040. Throughput: 0: 9836.8, 1: 9868.6. Samples: 263096972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:41,175][105115] Avg episode reward: [(0, '-5.061'), (1, '-5.534')] [2023-12-27 22:55:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000513144_131399680.pth... [2023-12-27 22:55:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000514448_131727360.pth... [2023-12-27 22:55:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000511992_131104768.pth [2023-12-27 22:55:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000513296_131432448.pth [2023-12-27 22:55:41,289][106226] Updated weights for policy 0, policy_version 513150 (0.0008) [2023-12-27 22:55:41,352][106226] Updated weights for policy 0, policy_version 513160 (0.0007) [2023-12-27 22:55:41,414][106226] Updated weights for policy 0, policy_version 513170 (0.0008) [2023-12-27 22:55:41,772][106225] Updated weights for policy 1, policy_version 514450 (0.0008) [2023-12-27 22:55:41,836][106225] Updated weights for policy 1, policy_version 514460 (0.0008) [2023-12-27 22:55:41,898][106225] Updated weights for policy 1, policy_version 514470 (0.0008) [2023-12-27 22:55:41,966][106225] Updated weights for policy 1, policy_version 514480 (0.0008) [2023-12-27 22:55:42,174][106226] Updated weights for policy 0, policy_version 513180 (0.0007) [2023-12-27 22:55:42,239][106226] Updated weights for policy 0, policy_version 513190 (0.0006) [2023-12-27 22:55:42,302][106226] Updated weights for policy 0, policy_version 513200 (0.0007) [2023-12-27 22:55:42,644][106225] Updated weights for policy 1, policy_version 514490 (0.0005) [2023-12-27 22:55:42,705][106225] Updated weights for policy 1, policy_version 514500 (0.0005) [2023-12-27 22:55:42,769][106225] Updated weights for policy 1, policy_version 514510 (0.0005) [2023-12-27 22:55:43,072][106226] Updated weights for policy 0, policy_version 513210 (0.0008) [2023-12-27 22:55:43,120][106226] Updated weights for policy 0, policy_version 513220 (0.0008) [2023-12-27 22:55:43,171][106226] Updated weights for policy 0, policy_version 513230 (0.0007) [2023-12-27 22:55:43,225][106226] Updated weights for policy 0, policy_version 513240 (0.0006) [2023-12-27 22:55:43,360][106225] Updated weights for policy 1, policy_version 514520 (0.0009) [2023-12-27 22:55:43,406][106225] Updated weights for policy 1, policy_version 514530 (0.0010) [2023-12-27 22:55:43,463][106225] Updated weights for policy 1, policy_version 514540 (0.0010) [2023-12-27 22:55:43,906][106226] Updated weights for policy 0, policy_version 513250 (0.0008) [2023-12-27 22:55:43,955][106226] Updated weights for policy 0, policy_version 513260 (0.0009) [2023-12-27 22:55:44,009][106226] Updated weights for policy 0, policy_version 513270 (0.0008) [2023-12-27 22:55:44,177][106225] Updated weights for policy 1, policy_version 514550 (0.0009) [2023-12-27 22:55:44,230][106225] Updated weights for policy 1, policy_version 514560 (0.0009) [2023-12-27 22:55:44,300][106225] Updated weights for policy 1, policy_version 514570 (0.0010) [2023-12-27 22:55:44,690][106226] Updated weights for policy 0, policy_version 513280 (0.0008) [2023-12-27 22:55:44,758][106226] Updated weights for policy 0, policy_version 513290 (0.0008) [2023-12-27 22:55:44,824][106226] Updated weights for policy 0, policy_version 513300 (0.0009) [2023-12-27 22:55:45,109][106225] Updated weights for policy 1, policy_version 514580 (0.0008) [2023-12-27 22:55:45,168][106225] Updated weights for policy 1, policy_version 514590 (0.0009) [2023-12-27 22:55:45,231][106225] Updated weights for policy 1, policy_version 514600 (0.0008) [2023-12-27 22:55:45,550][106226] Updated weights for policy 0, policy_version 513310 (0.0009) [2023-12-27 22:55:45,612][106226] Updated weights for policy 0, policy_version 513320 (0.0008) [2023-12-27 22:55:45,674][106226] Updated weights for policy 0, policy_version 513330 (0.0009) [2023-12-27 22:55:45,943][106225] Updated weights for policy 1, policy_version 514610 (0.0008) [2023-12-27 22:55:45,995][106225] Updated weights for policy 1, policy_version 514620 (0.0005) [2023-12-27 22:55:46,048][106225] Updated weights for policy 1, policy_version 514630 (0.0005) [2023-12-27 22:55:46,102][106225] Updated weights for policy 1, policy_version 514640 (0.0006) [2023-12-27 22:55:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 263225344. Throughput: 0: 9727.6, 1: 9741.3. Samples: 263212808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:46,175][105115] Avg episode reward: [(0, '-5.477'), (1, '-5.546')] [2023-12-27 22:55:46,445][106226] Updated weights for policy 0, policy_version 513340 (0.0007) [2023-12-27 22:55:46,499][106226] Updated weights for policy 0, policy_version 513350 (0.0005) [2023-12-27 22:55:46,560][106226] Updated weights for policy 0, policy_version 513360 (0.0005) [2023-12-27 22:55:46,697][106225] Updated weights for policy 1, policy_version 514650 (0.0006) [2023-12-27 22:55:46,746][106225] Updated weights for policy 1, policy_version 514660 (0.0005) [2023-12-27 22:55:46,793][106225] Updated weights for policy 1, policy_version 514670 (0.0005) [2023-12-27 22:55:47,147][106226] Updated weights for policy 0, policy_version 513370 (0.0006) [2023-12-27 22:55:47,236][106226] Updated weights for policy 0, policy_version 513380 (0.0008) [2023-12-27 22:55:47,299][106226] Updated weights for policy 0, policy_version 513390 (0.0009) [2023-12-27 22:55:47,360][106226] Updated weights for policy 0, policy_version 513400 (0.0009) [2023-12-27 22:55:47,397][106225] Updated weights for policy 1, policy_version 514680 (0.0005) [2023-12-27 22:55:47,464][106225] Updated weights for policy 1, policy_version 514690 (0.0006) [2023-12-27 22:55:47,529][106225] Updated weights for policy 1, policy_version 514700 (0.0005) [2023-12-27 22:55:48,014][106226] Updated weights for policy 0, policy_version 513410 (0.0009) [2023-12-27 22:55:48,079][106226] Updated weights for policy 0, policy_version 513420 (0.0006) [2023-12-27 22:55:48,092][106225] Updated weights for policy 1, policy_version 514710 (0.0007) [2023-12-27 22:55:48,133][106226] Updated weights for policy 0, policy_version 513430 (0.0010) [2023-12-27 22:55:48,154][106225] Updated weights for policy 1, policy_version 514720 (0.0010) [2023-12-27 22:55:48,228][106225] Updated weights for policy 1, policy_version 514730 (0.0010) [2023-12-27 22:55:48,796][106226] Updated weights for policy 0, policy_version 513440 (0.0009) [2023-12-27 22:55:48,860][106226] Updated weights for policy 0, policy_version 513450 (0.0007) [2023-12-27 22:55:48,909][106225] Updated weights for policy 1, policy_version 514740 (0.0008) [2023-12-27 22:55:48,927][106226] Updated weights for policy 0, policy_version 513460 (0.0006) [2023-12-27 22:55:48,973][106225] Updated weights for policy 1, policy_version 514750 (0.0010) [2023-12-27 22:55:49,041][106225] Updated weights for policy 1, policy_version 514760 (0.0009) [2023-12-27 22:55:49,649][106226] Updated weights for policy 0, policy_version 513470 (0.0008) [2023-12-27 22:55:49,717][106226] Updated weights for policy 0, policy_version 513480 (0.0009) [2023-12-27 22:55:49,780][106226] Updated weights for policy 0, policy_version 513490 (0.0009) [2023-12-27 22:55:49,825][106225] Updated weights for policy 1, policy_version 514770 (0.0010) [2023-12-27 22:55:49,896][106225] Updated weights for policy 1, policy_version 514780 (0.0008) [2023-12-27 22:55:49,961][106225] Updated weights for policy 1, policy_version 514790 (0.0008) [2023-12-27 22:55:50,036][106225] Updated weights for policy 1, policy_version 514800 (0.0008) [2023-12-27 22:55:50,530][106226] Updated weights for policy 0, policy_version 513500 (0.0007) [2023-12-27 22:55:50,596][106226] Updated weights for policy 0, policy_version 513510 (0.0009) [2023-12-27 22:55:50,662][106226] Updated weights for policy 0, policy_version 513520 (0.0009) [2023-12-27 22:55:50,800][106225] Updated weights for policy 1, policy_version 514810 (0.0009) [2023-12-27 22:55:50,864][106225] Updated weights for policy 1, policy_version 514820 (0.0008) [2023-12-27 22:55:50,925][106225] Updated weights for policy 1, policy_version 514830 (0.0009) [2023-12-27 22:55:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 263323648. Throughput: 0: 9780.4, 1: 9777.2. Samples: 263333248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:51,175][105115] Avg episode reward: [(0, '-5.466'), (1, '-5.314')] [2023-12-27 22:55:51,337][106226] Updated weights for policy 0, policy_version 513530 (0.0007) [2023-12-27 22:55:51,415][106226] Updated weights for policy 0, policy_version 513540 (0.0009) [2023-12-27 22:55:51,479][106226] Updated weights for policy 0, policy_version 513550 (0.0009) [2023-12-27 22:55:51,538][106226] Updated weights for policy 0, policy_version 513560 (0.0008) [2023-12-27 22:55:51,709][106225] Updated weights for policy 1, policy_version 514840 (0.0008) [2023-12-27 22:55:51,777][106225] Updated weights for policy 1, policy_version 514850 (0.0007) [2023-12-27 22:55:51,832][106225] Updated weights for policy 1, policy_version 514860 (0.0008) [2023-12-27 22:55:52,243][106226] Updated weights for policy 0, policy_version 513570 (0.0009) [2023-12-27 22:55:52,310][106226] Updated weights for policy 0, policy_version 513580 (0.0008) [2023-12-27 22:55:52,388][106226] Updated weights for policy 0, policy_version 513590 (0.0009) [2023-12-27 22:55:52,592][106225] Updated weights for policy 1, policy_version 514870 (0.0008) [2023-12-27 22:55:52,660][106225] Updated weights for policy 1, policy_version 514880 (0.0009) [2023-12-27 22:55:52,719][106225] Updated weights for policy 1, policy_version 514890 (0.0008) [2023-12-27 22:55:53,148][106226] Updated weights for policy 0, policy_version 513600 (0.0009) [2023-12-27 22:55:53,214][106226] Updated weights for policy 0, policy_version 513610 (0.0009) [2023-12-27 22:55:53,285][106226] Updated weights for policy 0, policy_version 513620 (0.0008) [2023-12-27 22:55:53,344][106225] Updated weights for policy 1, policy_version 514900 (0.0007) [2023-12-27 22:55:53,405][106225] Updated weights for policy 1, policy_version 514910 (0.0005) [2023-12-27 22:55:53,458][106225] Updated weights for policy 1, policy_version 514920 (0.0005) [2023-12-27 22:55:53,916][106226] Updated weights for policy 0, policy_version 513630 (0.0007) [2023-12-27 22:55:53,963][106226] Updated weights for policy 0, policy_version 513640 (0.0005) [2023-12-27 22:55:54,022][106226] Updated weights for policy 0, policy_version 513650 (0.0006) [2023-12-27 22:55:54,054][106225] Updated weights for policy 1, policy_version 514930 (0.0006) [2023-12-27 22:55:54,106][106225] Updated weights for policy 1, policy_version 514940 (0.0009) [2023-12-27 22:55:54,160][106225] Updated weights for policy 1, policy_version 514950 (0.0009) [2023-12-27 22:55:54,219][106225] Updated weights for policy 1, policy_version 514960 (0.0008) [2023-12-27 22:55:54,650][106226] Updated weights for policy 0, policy_version 513660 (0.0006) [2023-12-27 22:55:54,700][106226] Updated weights for policy 0, policy_version 513670 (0.0005) [2023-12-27 22:55:54,758][106226] Updated weights for policy 0, policy_version 513680 (0.0005) [2023-12-27 22:55:54,981][106225] Updated weights for policy 1, policy_version 514970 (0.0008) [2023-12-27 22:55:55,048][106225] Updated weights for policy 1, policy_version 514980 (0.0008) [2023-12-27 22:55:55,111][106225] Updated weights for policy 1, policy_version 514990 (0.0009) [2023-12-27 22:55:55,440][106226] Updated weights for policy 0, policy_version 513690 (0.0006) [2023-12-27 22:55:55,491][106226] Updated weights for policy 0, policy_version 513700 (0.0005) [2023-12-27 22:55:55,543][106226] Updated weights for policy 0, policy_version 513710 (0.0007) [2023-12-27 22:55:55,594][106226] Updated weights for policy 0, policy_version 513720 (0.0007) [2023-12-27 22:55:55,724][106225] Updated weights for policy 1, policy_version 515000 (0.0010) [2023-12-27 22:55:55,787][106225] Updated weights for policy 1, policy_version 515010 (0.0010) [2023-12-27 22:55:55,848][106225] Updated weights for policy 1, policy_version 515020 (0.0010) [2023-12-27 22:55:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 263421952. Throughput: 0: 9797.5, 1: 9785.5. Samples: 263392060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:55:56,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.388')] [2023-12-27 22:55:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000515024_131874816.pth... [2023-12-27 22:55:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000513720_131547136.pth... [2023-12-27 22:55:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000512568_131252224.pth [2023-12-27 22:55:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000513872_131579904.pth [2023-12-27 22:55:56,269][106226] Updated weights for policy 0, policy_version 513730 (0.0008) [2023-12-27 22:55:56,328][106226] Updated weights for policy 0, policy_version 513740 (0.0007) [2023-12-27 22:55:56,387][106226] Updated weights for policy 0, policy_version 513750 (0.0008) [2023-12-27 22:55:56,493][106225] Updated weights for policy 1, policy_version 515030 (0.0010) [2023-12-27 22:55:56,552][106225] Updated weights for policy 1, policy_version 515040 (0.0010) [2023-12-27 22:55:56,609][106225] Updated weights for policy 1, policy_version 515050 (0.0010) [2023-12-27 22:55:57,046][106226] Updated weights for policy 0, policy_version 513760 (0.0007) [2023-12-27 22:55:57,099][106226] Updated weights for policy 0, policy_version 513770 (0.0008) [2023-12-27 22:55:57,156][106226] Updated weights for policy 0, policy_version 513780 (0.0008) [2023-12-27 22:55:57,320][106225] Updated weights for policy 1, policy_version 515060 (0.0010) [2023-12-27 22:55:57,368][106225] Updated weights for policy 1, policy_version 515070 (0.0010) [2023-12-27 22:55:57,417][106225] Updated weights for policy 1, policy_version 515080 (0.0010) [2023-12-27 22:55:57,814][106226] Updated weights for policy 0, policy_version 513790 (0.0007) [2023-12-27 22:55:57,862][106226] Updated weights for policy 0, policy_version 513800 (0.0009) [2023-12-27 22:55:57,916][106226] Updated weights for policy 0, policy_version 513810 (0.0010) [2023-12-27 22:55:58,110][106225] Updated weights for policy 1, policy_version 515090 (0.0009) [2023-12-27 22:55:58,181][106225] Updated weights for policy 1, policy_version 515100 (0.0007) [2023-12-27 22:55:58,243][106225] Updated weights for policy 1, policy_version 515110 (0.0009) [2023-12-27 22:55:58,303][106225] Updated weights for policy 1, policy_version 515120 (0.0008) [2023-12-27 22:55:58,687][106226] Updated weights for policy 0, policy_version 513820 (0.0009) [2023-12-27 22:55:58,759][106226] Updated weights for policy 0, policy_version 513830 (0.0008) [2023-12-27 22:55:58,827][106226] Updated weights for policy 0, policy_version 513840 (0.0014) [2023-12-27 22:55:59,135][106225] Updated weights for policy 1, policy_version 515130 (0.0008) [2023-12-27 22:55:59,196][106225] Updated weights for policy 1, policy_version 515140 (0.0008) [2023-12-27 22:55:59,285][106225] Updated weights for policy 1, policy_version 515150 (0.0009) [2023-12-27 22:55:59,555][106226] Updated weights for policy 0, policy_version 513850 (0.0009) [2023-12-27 22:55:59,612][106226] Updated weights for policy 0, policy_version 513860 (0.0008) [2023-12-27 22:55:59,668][106226] Updated weights for policy 0, policy_version 513870 (0.0005) [2023-12-27 22:55:59,722][106226] Updated weights for policy 0, policy_version 513880 (0.0009) [2023-12-27 22:55:59,993][106225] Updated weights for policy 1, policy_version 515160 (0.0007) [2023-12-27 22:56:00,059][106225] Updated weights for policy 1, policy_version 515170 (0.0008) [2023-12-27 22:56:00,119][106225] Updated weights for policy 1, policy_version 515180 (0.0010) [2023-12-27 22:56:00,353][106226] Updated weights for policy 0, policy_version 513890 (0.0006) [2023-12-27 22:56:00,410][106226] Updated weights for policy 0, policy_version 513900 (0.0006) [2023-12-27 22:56:00,477][106226] Updated weights for policy 0, policy_version 513910 (0.0006) [2023-12-27 22:56:00,803][106225] Updated weights for policy 1, policy_version 515190 (0.0010) [2023-12-27 22:56:00,856][106225] Updated weights for policy 1, policy_version 515200 (0.0010) [2023-12-27 22:56:00,918][106225] Updated weights for policy 1, policy_version 515210 (0.0010) [2023-12-27 22:56:01,085][106226] Updated weights for policy 0, policy_version 513920 (0.0009) [2023-12-27 22:56:01,146][106226] Updated weights for policy 0, policy_version 513930 (0.0011) [2023-12-27 22:56:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 263520256. Throughput: 0: 9859.0, 1: 9791.6. Samples: 263510032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:01,175][105115] Avg episode reward: [(0, '-5.239'), (1, '-5.675')] [2023-12-27 22:56:01,217][106226] Updated weights for policy 0, policy_version 513940 (0.0007) [2023-12-27 22:56:01,597][106225] Updated weights for policy 1, policy_version 515220 (0.0010) [2023-12-27 22:56:01,665][106225] Updated weights for policy 1, policy_version 515230 (0.0010) [2023-12-27 22:56:01,727][106225] Updated weights for policy 1, policy_version 515240 (0.0010) [2023-12-27 22:56:01,948][106226] Updated weights for policy 0, policy_version 513950 (0.0009) [2023-12-27 22:56:02,005][106226] Updated weights for policy 0, policy_version 513960 (0.0007) [2023-12-27 22:56:02,060][106226] Updated weights for policy 0, policy_version 513970 (0.0008) [2023-12-27 22:56:02,474][106225] Updated weights for policy 1, policy_version 515250 (0.0010) [2023-12-27 22:56:02,541][106225] Updated weights for policy 1, policy_version 515260 (0.0006) [2023-12-27 22:56:02,604][106225] Updated weights for policy 1, policy_version 515270 (0.0007) [2023-12-27 22:56:02,660][106225] Updated weights for policy 1, policy_version 515280 (0.0005) [2023-12-27 22:56:02,863][106226] Updated weights for policy 0, policy_version 513980 (0.0008) [2023-12-27 22:56:02,922][106226] Updated weights for policy 0, policy_version 513990 (0.0009) [2023-12-27 22:56:02,975][106226] Updated weights for policy 0, policy_version 514000 (0.0009) [2023-12-27 22:56:03,222][106225] Updated weights for policy 1, policy_version 515290 (0.0006) [2023-12-27 22:56:03,284][106225] Updated weights for policy 1, policy_version 515300 (0.0005) [2023-12-27 22:56:03,348][106225] Updated weights for policy 1, policy_version 515310 (0.0005) [2023-12-27 22:56:03,720][106226] Updated weights for policy 0, policy_version 514010 (0.0008) [2023-12-27 22:56:03,774][106226] Updated weights for policy 0, policy_version 514020 (0.0005) [2023-12-27 22:56:03,834][106226] Updated weights for policy 0, policy_version 514030 (0.0006) [2023-12-27 22:56:03,865][106225] Updated weights for policy 1, policy_version 515320 (0.0007) [2023-12-27 22:56:03,895][106226] Updated weights for policy 0, policy_version 514040 (0.0009) [2023-12-27 22:56:03,925][106225] Updated weights for policy 1, policy_version 515330 (0.0007) [2023-12-27 22:56:03,993][106225] Updated weights for policy 1, policy_version 515340 (0.0009) [2023-12-27 22:56:04,626][106226] Updated weights for policy 0, policy_version 514050 (0.0008) [2023-12-27 22:56:04,677][106226] Updated weights for policy 0, policy_version 514060 (0.0008) [2023-12-27 22:56:04,726][106225] Updated weights for policy 1, policy_version 515350 (0.0011) [2023-12-27 22:56:04,733][106226] Updated weights for policy 0, policy_version 514070 (0.0008) [2023-12-27 22:56:04,790][106225] Updated weights for policy 1, policy_version 515360 (0.0010) [2023-12-27 22:56:04,852][106225] Updated weights for policy 1, policy_version 515370 (0.0010) [2023-12-27 22:56:05,356][106226] Updated weights for policy 0, policy_version 514080 (0.0007) [2023-12-27 22:56:05,409][106226] Updated weights for policy 0, policy_version 514090 (0.0007) [2023-12-27 22:56:05,461][106226] Updated weights for policy 0, policy_version 514100 (0.0008) [2023-12-27 22:56:05,562][106225] Updated weights for policy 1, policy_version 515380 (0.0010) [2023-12-27 22:56:05,621][106225] Updated weights for policy 1, policy_version 515390 (0.0010) [2023-12-27 22:56:05,680][106225] Updated weights for policy 1, policy_version 515400 (0.0010) [2023-12-27 22:56:06,155][106226] Updated weights for policy 0, policy_version 514110 (0.0008) [2023-12-27 22:56:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 263618560. Throughput: 0: 9839.9, 1: 9884.4. Samples: 263631896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:06,175][105115] Avg episode reward: [(0, '-5.318'), (1, '-5.359')] [2023-12-27 22:56:06,216][106226] Updated weights for policy 0, policy_version 514120 (0.0006) [2023-12-27 22:56:06,276][106226] Updated weights for policy 0, policy_version 514130 (0.0008) [2023-12-27 22:56:06,393][106225] Updated weights for policy 1, policy_version 515410 (0.0010) [2023-12-27 22:56:06,451][106225] Updated weights for policy 1, policy_version 515420 (0.0010) [2023-12-27 22:56:06,512][106225] Updated weights for policy 1, policy_version 515430 (0.0010) [2023-12-27 22:56:06,573][106225] Updated weights for policy 1, policy_version 515440 (0.0010) [2023-12-27 22:56:06,886][106226] Updated weights for policy 0, policy_version 514140 (0.0006) [2023-12-27 22:56:06,947][106226] Updated weights for policy 0, policy_version 514150 (0.0008) [2023-12-27 22:56:07,009][106226] Updated weights for policy 0, policy_version 514160 (0.0008) [2023-12-27 22:56:07,295][106225] Updated weights for policy 1, policy_version 515450 (0.0008) [2023-12-27 22:56:07,355][106225] Updated weights for policy 1, policy_version 515460 (0.0010) [2023-12-27 22:56:07,415][106225] Updated weights for policy 1, policy_version 515470 (0.0006) [2023-12-27 22:56:07,716][106226] Updated weights for policy 0, policy_version 514170 (0.0008) [2023-12-27 22:56:07,770][106226] Updated weights for policy 0, policy_version 514180 (0.0005) [2023-12-27 22:56:07,831][106226] Updated weights for policy 0, policy_version 514190 (0.0008) [2023-12-27 22:56:07,885][106226] Updated weights for policy 0, policy_version 514200 (0.0010) [2023-12-27 22:56:08,051][106225] Updated weights for policy 1, policy_version 515480 (0.0005) [2023-12-27 22:56:08,099][106225] Updated weights for policy 1, policy_version 515490 (0.0005) [2023-12-27 22:56:08,157][106225] Updated weights for policy 1, policy_version 515500 (0.0007) [2023-12-27 22:56:08,543][106226] Updated weights for policy 0, policy_version 514210 (0.0009) [2023-12-27 22:56:08,606][106226] Updated weights for policy 0, policy_version 514220 (0.0007) [2023-12-27 22:56:08,661][106226] Updated weights for policy 0, policy_version 514230 (0.0006) [2023-12-27 22:56:08,810][106225] Updated weights for policy 1, policy_version 515510 (0.0009) [2023-12-27 22:56:08,872][106225] Updated weights for policy 1, policy_version 515520 (0.0008) [2023-12-27 22:56:08,933][106225] Updated weights for policy 1, policy_version 515530 (0.0009) [2023-12-27 22:56:09,347][106226] Updated weights for policy 0, policy_version 514240 (0.0009) [2023-12-27 22:56:09,421][106226] Updated weights for policy 0, policy_version 514250 (0.0009) [2023-12-27 22:56:09,483][106226] Updated weights for policy 0, policy_version 514260 (0.0009) [2023-12-27 22:56:09,682][106225] Updated weights for policy 1, policy_version 515540 (0.0009) [2023-12-27 22:56:09,743][106225] Updated weights for policy 1, policy_version 515550 (0.0008) [2023-12-27 22:56:09,798][106225] Updated weights for policy 1, policy_version 515560 (0.0007) [2023-12-27 22:56:10,271][106226] Updated weights for policy 0, policy_version 514270 (0.0008) [2023-12-27 22:56:10,337][106226] Updated weights for policy 0, policy_version 514280 (0.0005) [2023-12-27 22:56:10,405][106226] Updated weights for policy 0, policy_version 514290 (0.0008) [2023-12-27 22:56:10,537][106225] Updated weights for policy 1, policy_version 515570 (0.0009) [2023-12-27 22:56:10,595][106225] Updated weights for policy 1, policy_version 515580 (0.0008) [2023-12-27 22:56:10,658][106225] Updated weights for policy 1, policy_version 515590 (0.0008) [2023-12-27 22:56:10,715][106225] Updated weights for policy 1, policy_version 515600 (0.0008) [2023-12-27 22:56:11,099][106226] Updated weights for policy 0, policy_version 514300 (0.0008) [2023-12-27 22:56:11,172][106226] Updated weights for policy 0, policy_version 514310 (0.0009) [2023-12-27 22:56:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 263716864. Throughput: 0: 9891.0, 1: 9938.4. Samples: 263693476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:11,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-5.553')] [2023-12-27 22:56:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000515600_132022272.pth... [2023-12-27 22:56:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000514448_131727360.pth [2023-12-27 22:56:11,237][106226] Updated weights for policy 0, policy_version 514320 (0.0009) [2023-12-27 22:56:11,307][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000514328_131702784.pth... [2023-12-27 22:56:11,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000513144_131399680.pth [2023-12-27 22:56:11,502][106225] Updated weights for policy 1, policy_version 515610 (0.0008) [2023-12-27 22:56:11,551][106225] Updated weights for policy 1, policy_version 515620 (0.0008) [2023-12-27 22:56:11,608][106225] Updated weights for policy 1, policy_version 515630 (0.0008) [2023-12-27 22:56:12,002][106226] Updated weights for policy 0, policy_version 514330 (0.0009) [2023-12-27 22:56:12,060][106226] Updated weights for policy 0, policy_version 514340 (0.0008) [2023-12-27 22:56:12,121][106226] Updated weights for policy 0, policy_version 514350 (0.0008) [2023-12-27 22:56:12,168][106226] Updated weights for policy 0, policy_version 514360 (0.0009) [2023-12-27 22:56:12,397][106225] Updated weights for policy 1, policy_version 515640 (0.0008) [2023-12-27 22:56:12,448][106225] Updated weights for policy 1, policy_version 515650 (0.0007) [2023-12-27 22:56:12,508][106225] Updated weights for policy 1, policy_version 515660 (0.0008) [2023-12-27 22:56:13,020][106226] Updated weights for policy 0, policy_version 514370 (0.0009) [2023-12-27 22:56:13,081][106226] Updated weights for policy 0, policy_version 514380 (0.0008) [2023-12-27 22:56:13,140][106226] Updated weights for policy 0, policy_version 514390 (0.0006) [2023-12-27 22:56:13,228][106225] Updated weights for policy 1, policy_version 515670 (0.0008) [2023-12-27 22:56:13,286][106225] Updated weights for policy 1, policy_version 515680 (0.0008) [2023-12-27 22:56:13,344][106225] Updated weights for policy 1, policy_version 515690 (0.0008) [2023-12-27 22:56:13,774][106226] Updated weights for policy 0, policy_version 514400 (0.0006) [2023-12-27 22:56:13,822][106226] Updated weights for policy 0, policy_version 514410 (0.0005) [2023-12-27 22:56:13,871][106226] Updated weights for policy 0, policy_version 514420 (0.0005) [2023-12-27 22:56:13,981][106225] Updated weights for policy 1, policy_version 515700 (0.0009) [2023-12-27 22:56:14,039][106225] Updated weights for policy 1, policy_version 515710 (0.0008) [2023-12-27 22:56:14,084][106225] Updated weights for policy 1, policy_version 515720 (0.0008) [2023-12-27 22:56:14,459][106226] Updated weights for policy 0, policy_version 514430 (0.0007) [2023-12-27 22:56:14,521][106226] Updated weights for policy 0, policy_version 514440 (0.0008) [2023-12-27 22:56:14,588][106226] Updated weights for policy 0, policy_version 514450 (0.0009) [2023-12-27 22:56:14,746][106225] Updated weights for policy 1, policy_version 515730 (0.0007) [2023-12-27 22:56:14,808][106225] Updated weights for policy 1, policy_version 515740 (0.0008) [2023-12-27 22:56:14,871][106225] Updated weights for policy 1, policy_version 515750 (0.0006) [2023-12-27 22:56:14,919][106225] Updated weights for policy 1, policy_version 515760 (0.0008) [2023-12-27 22:56:15,381][106226] Updated weights for policy 0, policy_version 514460 (0.0008) [2023-12-27 22:56:15,447][106226] Updated weights for policy 0, policy_version 514470 (0.0008) [2023-12-27 22:56:15,516][106226] Updated weights for policy 0, policy_version 514480 (0.0008) [2023-12-27 22:56:15,620][106225] Updated weights for policy 1, policy_version 515770 (0.0006) [2023-12-27 22:56:15,669][106225] Updated weights for policy 1, policy_version 515780 (0.0005) [2023-12-27 22:56:15,713][106225] Updated weights for policy 1, policy_version 515790 (0.0005) [2023-12-27 22:56:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 263815168. Throughput: 0: 9913.0, 1: 9850.3. Samples: 263808912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:16,175][105115] Avg episode reward: [(0, '-4.995'), (1, '-5.719')] [2023-12-27 22:56:16,306][106226] Updated weights for policy 0, policy_version 514490 (0.0009) [2023-12-27 22:56:16,350][106225] Updated weights for policy 1, policy_version 515800 (0.0006) [2023-12-27 22:56:16,363][106226] Updated weights for policy 0, policy_version 514500 (0.0008) [2023-12-27 22:56:16,405][106225] Updated weights for policy 1, policy_version 515810 (0.0006) [2023-12-27 22:56:16,424][106226] Updated weights for policy 0, policy_version 514510 (0.0008) [2023-12-27 22:56:16,461][106225] Updated weights for policy 1, policy_version 515820 (0.0009) [2023-12-27 22:56:16,482][106226] Updated weights for policy 0, policy_version 514520 (0.0007) [2023-12-27 22:56:17,098][106225] Updated weights for policy 1, policy_version 515830 (0.0008) [2023-12-27 22:56:17,124][106226] Updated weights for policy 0, policy_version 514530 (0.0007) [2023-12-27 22:56:17,150][106225] Updated weights for policy 1, policy_version 515840 (0.0009) [2023-12-27 22:56:17,177][106226] Updated weights for policy 0, policy_version 514540 (0.0005) [2023-12-27 22:56:17,210][106225] Updated weights for policy 1, policy_version 515850 (0.0006) [2023-12-27 22:56:17,228][106226] Updated weights for policy 0, policy_version 514550 (0.0005) [2023-12-27 22:56:17,887][106226] Updated weights for policy 0, policy_version 514560 (0.0007) [2023-12-27 22:56:17,928][106225] Updated weights for policy 1, policy_version 515860 (0.0007) [2023-12-27 22:56:17,945][106226] Updated weights for policy 0, policy_version 514570 (0.0008) [2023-12-27 22:56:17,986][106225] Updated weights for policy 1, policy_version 515870 (0.0007) [2023-12-27 22:56:18,000][106226] Updated weights for policy 0, policy_version 514580 (0.0005) [2023-12-27 22:56:18,042][106225] Updated weights for policy 1, policy_version 515880 (0.0008) [2023-12-27 22:56:18,645][106226] Updated weights for policy 0, policy_version 514590 (0.0005) [2023-12-27 22:56:18,698][106226] Updated weights for policy 0, policy_version 514600 (0.0006) [2023-12-27 22:56:18,709][106225] Updated weights for policy 1, policy_version 515890 (0.0009) [2023-12-27 22:56:18,753][106226] Updated weights for policy 0, policy_version 514610 (0.0005) [2023-12-27 22:56:18,765][106225] Updated weights for policy 1, policy_version 515900 (0.0008) [2023-12-27 22:56:18,824][106225] Updated weights for policy 1, policy_version 515910 (0.0008) [2023-12-27 22:56:18,892][106225] Updated weights for policy 1, policy_version 515920 (0.0009) [2023-12-27 22:56:19,461][106226] Updated weights for policy 0, policy_version 514620 (0.0007) [2023-12-27 22:56:19,532][106226] Updated weights for policy 0, policy_version 514630 (0.0007) [2023-12-27 22:56:19,578][106225] Updated weights for policy 1, policy_version 515930 (0.0008) [2023-12-27 22:56:19,592][106226] Updated weights for policy 0, policy_version 514640 (0.0007) [2023-12-27 22:56:19,634][106225] Updated weights for policy 1, policy_version 515940 (0.0006) [2023-12-27 22:56:19,696][106225] Updated weights for policy 1, policy_version 515950 (0.0009) [2023-12-27 22:56:20,316][106226] Updated weights for policy 0, policy_version 514650 (0.0007) [2023-12-27 22:56:20,375][106226] Updated weights for policy 0, policy_version 514660 (0.0006) [2023-12-27 22:56:20,437][106226] Updated weights for policy 0, policy_version 514670 (0.0005) [2023-12-27 22:56:20,500][106226] Updated weights for policy 0, policy_version 514680 (0.0005) [2023-12-27 22:56:20,518][106225] Updated weights for policy 1, policy_version 515960 (0.0009) [2023-12-27 22:56:20,580][106225] Updated weights for policy 1, policy_version 515970 (0.0009) [2023-12-27 22:56:20,654][106225] Updated weights for policy 1, policy_version 515980 (0.0009) [2023-12-27 22:56:21,121][106226] Updated weights for policy 0, policy_version 514690 (0.0010) [2023-12-27 22:56:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 263913472. Throughput: 0: 9911.6, 1: 9884.7. Samples: 263927728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:21,175][105115] Avg episode reward: [(0, '-5.037'), (1, '-5.353')] [2023-12-27 22:56:21,186][106226] Updated weights for policy 0, policy_version 514700 (0.0007) [2023-12-27 22:56:21,246][106226] Updated weights for policy 0, policy_version 514710 (0.0006) [2023-12-27 22:56:21,430][106225] Updated weights for policy 1, policy_version 515990 (0.0009) [2023-12-27 22:56:21,494][106225] Updated weights for policy 1, policy_version 516000 (0.0008) [2023-12-27 22:56:21,556][106225] Updated weights for policy 1, policy_version 516010 (0.0008) [2023-12-27 22:56:21,985][106226] Updated weights for policy 0, policy_version 514720 (0.0008) [2023-12-27 22:56:22,045][106226] Updated weights for policy 0, policy_version 514730 (0.0010) [2023-12-27 22:56:22,104][106226] Updated weights for policy 0, policy_version 514741 (0.0010) [2023-12-27 22:56:22,260][106225] Updated weights for policy 1, policy_version 516020 (0.0007) [2023-12-27 22:56:22,329][106225] Updated weights for policy 1, policy_version 516030 (0.0006) [2023-12-27 22:56:22,397][106225] Updated weights for policy 1, policy_version 516040 (0.0008) [2023-12-27 22:56:22,876][106226] Updated weights for policy 0, policy_version 514751 (0.0008) [2023-12-27 22:56:22,922][106226] Updated weights for policy 0, policy_version 514761 (0.0008) [2023-12-27 22:56:22,969][106226] Updated weights for policy 0, policy_version 514771 (0.0008) [2023-12-27 22:56:23,059][106225] Updated weights for policy 1, policy_version 516050 (0.0009) [2023-12-27 22:56:23,123][106225] Updated weights for policy 1, policy_version 516060 (0.0010) [2023-12-27 22:56:23,191][106225] Updated weights for policy 1, policy_version 516070 (0.0010) [2023-12-27 22:56:23,253][106225] Updated weights for policy 1, policy_version 516080 (0.0010) [2023-12-27 22:56:23,640][106226] Updated weights for policy 0, policy_version 514781 (0.0009) [2023-12-27 22:56:23,696][106226] Updated weights for policy 0, policy_version 514791 (0.0010) [2023-12-27 22:56:23,764][106226] Updated weights for policy 0, policy_version 514801 (0.0011) [2023-12-27 22:56:23,927][106225] Updated weights for policy 1, policy_version 516090 (0.0010) [2023-12-27 22:56:23,984][106225] Updated weights for policy 1, policy_version 516100 (0.0010) [2023-12-27 22:56:24,027][106225] Updated weights for policy 1, policy_version 516110 (0.0008) [2023-12-27 22:56:24,484][106226] Updated weights for policy 0, policy_version 514811 (0.0010) [2023-12-27 22:56:24,545][106226] Updated weights for policy 0, policy_version 514821 (0.0010) [2023-12-27 22:56:24,598][106226] Updated weights for policy 0, policy_version 514831 (0.0010) [2023-12-27 22:56:24,624][106225] Updated weights for policy 1, policy_version 516120 (0.0008) [2023-12-27 22:56:24,682][106225] Updated weights for policy 1, policy_version 516130 (0.0010) [2023-12-27 22:56:24,742][106225] Updated weights for policy 1, policy_version 516140 (0.0010) [2023-12-27 22:56:25,307][106226] Updated weights for policy 0, policy_version 514841 (0.0011) [2023-12-27 22:56:25,360][106226] Updated weights for policy 0, policy_version 514851 (0.0010) [2023-12-27 22:56:25,410][106225] Updated weights for policy 1, policy_version 516150 (0.0009) [2023-12-27 22:56:25,418][106226] Updated weights for policy 0, policy_version 514861 (0.0010) [2023-12-27 22:56:25,460][106225] Updated weights for policy 1, policy_version 516160 (0.0010) [2023-12-27 22:56:25,484][106226] Updated weights for policy 0, policy_version 514871 (0.0010) [2023-12-27 22:56:25,510][106225] Updated weights for policy 1, policy_version 516170 (0.0010) [2023-12-27 22:56:26,137][106226] Updated weights for policy 0, policy_version 514881 (0.0006) [2023-12-27 22:56:26,170][106225] Updated weights for policy 1, policy_version 516180 (0.0010) [2023-12-27 22:56:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 264011776. Throughput: 0: 9846.4, 1: 9901.5. Samples: 263985628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:26,175][105115] Avg episode reward: [(0, '-5.227'), (1, '-5.589')] [2023-12-27 22:56:26,185][106226] Updated weights for policy 0, policy_version 514891 (0.0005) [2023-12-27 22:56:26,221][106225] Updated weights for policy 1, policy_version 516190 (0.0010) [2023-12-27 22:56:26,234][106226] Updated weights for policy 0, policy_version 514901 (0.0005) [2023-12-27 22:56:26,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000514904_131850240.pth... [2023-12-27 22:56:26,251][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000513720_131547136.pth [2023-12-27 22:56:26,267][106225] Updated weights for policy 1, policy_version 516200 (0.0010) [2023-12-27 22:56:26,317][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000516208_132177920.pth... [2023-12-27 22:56:26,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000515024_131874816.pth [2023-12-27 22:56:26,768][106226] Updated weights for policy 0, policy_version 514911 (0.0007) [2023-12-27 22:56:26,831][106226] Updated weights for policy 0, policy_version 514921 (0.0010) [2023-12-27 22:56:26,894][106226] Updated weights for policy 0, policy_version 514931 (0.0010) [2023-12-27 22:56:26,954][106225] Updated weights for policy 1, policy_version 516210 (0.0010) [2023-12-27 22:56:27,003][106225] Updated weights for policy 1, policy_version 516220 (0.0010) [2023-12-27 22:56:27,050][106225] Updated weights for policy 1, policy_version 516230 (0.0010) [2023-12-27 22:56:27,096][106225] Updated weights for policy 1, policy_version 516240 (0.0010) [2023-12-27 22:56:27,577][106226] Updated weights for policy 0, policy_version 514941 (0.0010) [2023-12-27 22:56:27,629][106226] Updated weights for policy 0, policy_version 514951 (0.0010) [2023-12-27 22:56:27,688][106226] Updated weights for policy 0, policy_version 514961 (0.0011) [2023-12-27 22:56:27,737][106225] Updated weights for policy 1, policy_version 516250 (0.0008) [2023-12-27 22:56:27,784][106225] Updated weights for policy 1, policy_version 516260 (0.0010) [2023-12-27 22:56:27,830][106225] Updated weights for policy 1, policy_version 516270 (0.0009) [2023-12-27 22:56:28,383][106226] Updated weights for policy 0, policy_version 514971 (0.0011) [2023-12-27 22:56:28,451][106226] Updated weights for policy 0, policy_version 514981 (0.0011) [2023-12-27 22:56:28,505][106226] Updated weights for policy 0, policy_version 514991 (0.0011) [2023-12-27 22:56:28,547][106225] Updated weights for policy 1, policy_version 516280 (0.0009) [2023-12-27 22:56:28,595][106225] Updated weights for policy 1, policy_version 516290 (0.0009) [2023-12-27 22:56:28,647][106225] Updated weights for policy 1, policy_version 516300 (0.0008) [2023-12-27 22:56:29,132][106226] Updated weights for policy 0, policy_version 515001 (0.0010) [2023-12-27 22:56:29,195][106226] Updated weights for policy 0, policy_version 515011 (0.0007) [2023-12-27 22:56:29,258][106226] Updated weights for policy 0, policy_version 515021 (0.0010) [2023-12-27 22:56:29,328][106226] Updated weights for policy 0, policy_version 515031 (0.0006) [2023-12-27 22:56:29,389][106225] Updated weights for policy 1, policy_version 516310 (0.0008) [2023-12-27 22:56:29,449][106225] Updated weights for policy 1, policy_version 516320 (0.0006) [2023-12-27 22:56:29,508][106225] Updated weights for policy 1, policy_version 516330 (0.0005) [2023-12-27 22:56:30,080][106226] Updated weights for policy 0, policy_version 515041 (0.0005) [2023-12-27 22:56:30,136][106226] Updated weights for policy 0, policy_version 515051 (0.0006) [2023-12-27 22:56:30,187][106226] Updated weights for policy 0, policy_version 515061 (0.0005) [2023-12-27 22:56:30,197][106225] Updated weights for policy 1, policy_version 516340 (0.0006) [2023-12-27 22:56:30,265][106225] Updated weights for policy 1, policy_version 516350 (0.0005) [2023-12-27 22:56:30,333][106225] Updated weights for policy 1, policy_version 516360 (0.0005) [2023-12-27 22:56:30,726][106226] Updated weights for policy 0, policy_version 515071 (0.0006) [2023-12-27 22:56:30,779][106226] Updated weights for policy 0, policy_version 515081 (0.0005) [2023-12-27 22:56:30,834][106226] Updated weights for policy 0, policy_version 515091 (0.0005) [2023-12-27 22:56:30,877][106225] Updated weights for policy 1, policy_version 516370 (0.0006) [2023-12-27 22:56:30,926][106225] Updated weights for policy 1, policy_version 516380 (0.0010) [2023-12-27 22:56:30,995][106225] Updated weights for policy 1, policy_version 516390 (0.0010) [2023-12-27 22:56:31,065][106225] Updated weights for policy 1, policy_version 516400 (0.0010) [2023-12-27 22:56:31,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 264126464. Throughput: 0: 9951.5, 1: 9999.5. Samples: 264110600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:31,175][105115] Avg episode reward: [(0, '-5.271'), (1, '-5.830')] [2023-12-27 22:56:31,480][106226] Updated weights for policy 0, policy_version 515101 (0.0006) [2023-12-27 22:56:31,537][106226] Updated weights for policy 0, policy_version 515111 (0.0008) [2023-12-27 22:56:31,590][106226] Updated weights for policy 0, policy_version 515121 (0.0008) [2023-12-27 22:56:31,844][106225] Updated weights for policy 1, policy_version 516410 (0.0008) [2023-12-27 22:56:31,916][106225] Updated weights for policy 1, policy_version 516420 (0.0008) [2023-12-27 22:56:31,984][106225] Updated weights for policy 1, policy_version 516430 (0.0008) [2023-12-27 22:56:32,208][106226] Updated weights for policy 0, policy_version 515131 (0.0007) [2023-12-27 22:56:32,278][106226] Updated weights for policy 0, policy_version 515141 (0.0008) [2023-12-27 22:56:32,326][106226] Updated weights for policy 0, policy_version 515151 (0.0008) [2023-12-27 22:56:32,671][106225] Updated weights for policy 1, policy_version 516440 (0.0008) [2023-12-27 22:56:32,735][106225] Updated weights for policy 1, policy_version 516450 (0.0008) [2023-12-27 22:56:32,795][106225] Updated weights for policy 1, policy_version 516460 (0.0008) [2023-12-27 22:56:32,951][106226] Updated weights for policy 0, policy_version 515161 (0.0009) [2023-12-27 22:56:33,000][106226] Updated weights for policy 0, policy_version 515171 (0.0009) [2023-12-27 22:56:33,049][106226] Updated weights for policy 0, policy_version 515181 (0.0009) [2023-12-27 22:56:33,111][106226] Updated weights for policy 0, policy_version 515191 (0.0007) [2023-12-27 22:56:33,385][106225] Updated weights for policy 1, policy_version 516471 (0.0008) [2023-12-27 22:56:33,441][106225] Updated weights for policy 1, policy_version 516481 (0.0006) [2023-12-27 22:56:33,492][106225] Updated weights for policy 1, policy_version 516491 (0.0005) [2023-12-27 22:56:33,856][106226] Updated weights for policy 0, policy_version 515201 (0.0010) [2023-12-27 22:56:33,908][106226] Updated weights for policy 0, policy_version 515211 (0.0010) [2023-12-27 22:56:33,966][106226] Updated weights for policy 0, policy_version 515221 (0.0008) [2023-12-27 22:56:34,195][106225] Updated weights for policy 1, policy_version 516501 (0.0012) [2023-12-27 22:56:34,259][106225] Updated weights for policy 1, policy_version 516511 (0.0010) [2023-12-27 22:56:34,316][106225] Updated weights for policy 1, policy_version 516521 (0.0010) [2023-12-27 22:56:34,682][106226] Updated weights for policy 0, policy_version 515231 (0.0005) [2023-12-27 22:56:34,729][106226] Updated weights for policy 0, policy_version 515241 (0.0005) [2023-12-27 22:56:34,793][106226] Updated weights for policy 0, policy_version 515251 (0.0006) [2023-12-27 22:56:35,009][106225] Updated weights for policy 1, policy_version 516531 (0.0009) [2023-12-27 22:56:35,055][106225] Updated weights for policy 1, policy_version 516541 (0.0005) [2023-12-27 22:56:35,099][106225] Updated weights for policy 1, policy_version 516551 (0.0005) [2023-12-27 22:56:35,540][106226] Updated weights for policy 0, policy_version 515261 (0.0009) [2023-12-27 22:56:35,597][106226] Updated weights for policy 0, policy_version 515271 (0.0010) [2023-12-27 22:56:35,652][106226] Updated weights for policy 0, policy_version 515281 (0.0007) [2023-12-27 22:56:35,660][106225] Updated weights for policy 1, policy_version 516561 (0.0005) [2023-12-27 22:56:35,733][106225] Updated weights for policy 1, policy_version 516571 (0.0008) [2023-12-27 22:56:35,800][106225] Updated weights for policy 1, policy_version 516581 (0.0010) [2023-12-27 22:56:35,870][106225] Updated weights for policy 1, policy_version 516591 (0.0010) [2023-12-27 22:56:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 264224768. Throughput: 0: 10030.0, 1: 10021.3. Samples: 264235552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:36,175][105115] Avg episode reward: [(0, '-5.159'), (1, '-5.335')] [2023-12-27 22:56:36,288][106226] Updated weights for policy 0, policy_version 515291 (0.0007) [2023-12-27 22:56:36,338][106226] Updated weights for policy 0, policy_version 515301 (0.0008) [2023-12-27 22:56:36,399][106226] Updated weights for policy 0, policy_version 515311 (0.0011) [2023-12-27 22:56:36,553][106225] Updated weights for policy 1, policy_version 516601 (0.0008) [2023-12-27 22:56:36,616][106225] Updated weights for policy 1, policy_version 516611 (0.0008) [2023-12-27 22:56:36,679][106225] Updated weights for policy 1, policy_version 516621 (0.0008) [2023-12-27 22:56:37,064][106226] Updated weights for policy 0, policy_version 515321 (0.0010) [2023-12-27 22:56:37,126][106226] Updated weights for policy 0, policy_version 515331 (0.0007) [2023-12-27 22:56:37,187][106226] Updated weights for policy 0, policy_version 515341 (0.0010) [2023-12-27 22:56:37,248][106226] Updated weights for policy 0, policy_version 515351 (0.0011) [2023-12-27 22:56:37,288][106225] Updated weights for policy 1, policy_version 516631 (0.0010) [2023-12-27 22:56:37,345][106225] Updated weights for policy 1, policy_version 516641 (0.0010) [2023-12-27 22:56:37,392][106225] Updated weights for policy 1, policy_version 516651 (0.0010) [2023-12-27 22:56:37,891][106226] Updated weights for policy 0, policy_version 515361 (0.0011) [2023-12-27 22:56:37,950][106226] Updated weights for policy 0, policy_version 515371 (0.0011) [2023-12-27 22:56:37,990][106225] Updated weights for policy 1, policy_version 516661 (0.0007) [2023-12-27 22:56:38,015][106226] Updated weights for policy 0, policy_version 515381 (0.0011) [2023-12-27 22:56:38,046][106225] Updated weights for policy 1, policy_version 516671 (0.0009) [2023-12-27 22:56:38,106][106225] Updated weights for policy 1, policy_version 516681 (0.0010) [2023-12-27 22:56:38,703][106226] Updated weights for policy 0, policy_version 515391 (0.0008) [2023-12-27 22:56:38,734][106225] Updated weights for policy 1, policy_version 516691 (0.0009) [2023-12-27 22:56:38,767][106226] Updated weights for policy 0, policy_version 515401 (0.0009) [2023-12-27 22:56:38,793][106225] Updated weights for policy 1, policy_version 516701 (0.0007) [2023-12-27 22:56:38,823][106226] Updated weights for policy 0, policy_version 515411 (0.0010) [2023-12-27 22:56:38,855][106225] Updated weights for policy 1, policy_version 516711 (0.0010) [2023-12-27 22:56:39,534][106226] Updated weights for policy 0, policy_version 515421 (0.0011) [2023-12-27 22:56:39,586][106225] Updated weights for policy 1, policy_version 516721 (0.0011) [2023-12-27 22:56:39,593][106226] Updated weights for policy 0, policy_version 515431 (0.0008) [2023-12-27 22:56:39,638][106225] Updated weights for policy 1, policy_version 516731 (0.0010) [2023-12-27 22:56:39,652][106226] Updated weights for policy 0, policy_version 515441 (0.0009) [2023-12-27 22:56:39,691][106225] Updated weights for policy 1, policy_version 516741 (0.0010) [2023-12-27 22:56:39,755][106225] Updated weights for policy 1, policy_version 516751 (0.0009) [2023-12-27 22:56:40,383][106226] Updated weights for policy 0, policy_version 515451 (0.0011) [2023-12-27 22:56:40,444][106226] Updated weights for policy 0, policy_version 515461 (0.0011) [2023-12-27 22:56:40,494][106225] Updated weights for policy 1, policy_version 516761 (0.0008) [2023-12-27 22:56:40,502][106226] Updated weights for policy 0, policy_version 515471 (0.0011) [2023-12-27 22:56:40,548][106225] Updated weights for policy 1, policy_version 516771 (0.0008) [2023-12-27 22:56:40,610][106225] Updated weights for policy 1, policy_version 516781 (0.0005) [2023-12-27 22:56:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 264323072. Throughput: 0: 10052.8, 1: 10079.9. Samples: 264298032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:41,175][105115] Avg episode reward: [(0, '-5.407'), (1, '-5.295')] [2023-12-27 22:56:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000516784_132325376.pth... [2023-12-27 22:56:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000515480_131997696.pth... [2023-12-27 22:56:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000514328_131702784.pth [2023-12-27 22:56:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000515600_132022272.pth [2023-12-27 22:56:41,209][106226] Updated weights for policy 0, policy_version 515481 (0.0010) [2023-12-27 22:56:41,257][106225] Updated weights for policy 1, policy_version 516791 (0.0008) [2023-12-27 22:56:41,279][106226] Updated weights for policy 0, policy_version 515491 (0.0010) [2023-12-27 22:56:41,318][106225] Updated weights for policy 1, policy_version 516801 (0.0007) [2023-12-27 22:56:41,345][106226] Updated weights for policy 0, policy_version 515501 (0.0006) [2023-12-27 22:56:41,386][106225] Updated weights for policy 1, policy_version 516811 (0.0010) [2023-12-27 22:56:41,413][106226] Updated weights for policy 0, policy_version 515511 (0.0008) [2023-12-27 22:56:42,069][106226] Updated weights for policy 0, policy_version 515521 (0.0006) [2023-12-27 22:56:42,124][106226] Updated weights for policy 0, policy_version 515531 (0.0008) [2023-12-27 22:56:42,179][106226] Updated weights for policy 0, policy_version 515541 (0.0008) [2023-12-27 22:56:42,214][106225] Updated weights for policy 1, policy_version 516821 (0.0009) [2023-12-27 22:56:42,264][106225] Updated weights for policy 1, policy_version 516831 (0.0008) [2023-12-27 22:56:42,321][106225] Updated weights for policy 1, policy_version 516841 (0.0007) [2023-12-27 22:56:42,923][106226] Updated weights for policy 0, policy_version 515551 (0.0009) [2023-12-27 22:56:42,991][106226] Updated weights for policy 0, policy_version 515561 (0.0007) [2023-12-27 22:56:43,004][106225] Updated weights for policy 1, policy_version 516851 (0.0008) [2023-12-27 22:56:43,055][106226] Updated weights for policy 0, policy_version 515571 (0.0007) [2023-12-27 22:56:43,058][106225] Updated weights for policy 1, policy_version 516861 (0.0007) [2023-12-27 22:56:43,115][106225] Updated weights for policy 1, policy_version 516871 (0.0007) [2023-12-27 22:56:43,705][106225] Updated weights for policy 1, policy_version 516881 (0.0007) [2023-12-27 22:56:43,716][106226] Updated weights for policy 0, policy_version 515581 (0.0009) [2023-12-27 22:56:43,760][106225] Updated weights for policy 1, policy_version 516891 (0.0005) [2023-12-27 22:56:43,769][106226] Updated weights for policy 0, policy_version 515591 (0.0008) [2023-12-27 22:56:43,817][106225] Updated weights for policy 1, policy_version 516901 (0.0006) [2023-12-27 22:56:43,825][106226] Updated weights for policy 0, policy_version 515601 (0.0010) [2023-12-27 22:56:43,878][106225] Updated weights for policy 1, policy_version 516911 (0.0006) [2023-12-27 22:56:44,444][106226] Updated weights for policy 0, policy_version 515611 (0.0010) [2023-12-27 22:56:44,474][106225] Updated weights for policy 1, policy_version 516921 (0.0006) [2023-12-27 22:56:44,503][106226] Updated weights for policy 0, policy_version 515621 (0.0010) [2023-12-27 22:56:44,535][106225] Updated weights for policy 1, policy_version 516931 (0.0005) [2023-12-27 22:56:44,557][106226] Updated weights for policy 0, policy_version 515631 (0.0007) [2023-12-27 22:56:44,593][106225] Updated weights for policy 1, policy_version 516941 (0.0006) [2023-12-27 22:56:45,183][106226] Updated weights for policy 0, policy_version 515641 (0.0009) [2023-12-27 22:56:45,251][106226] Updated weights for policy 0, policy_version 515651 (0.0008) [2023-12-27 22:56:45,258][106225] Updated weights for policy 1, policy_version 516951 (0.0006) [2023-12-27 22:56:45,311][106226] Updated weights for policy 0, policy_version 515661 (0.0010) [2023-12-27 22:56:45,313][106225] Updated weights for policy 1, policy_version 516961 (0.0006) [2023-12-27 22:56:45,367][106225] Updated weights for policy 1, policy_version 516971 (0.0009) [2023-12-27 22:56:45,371][106226] Updated weights for policy 0, policy_version 515671 (0.0010) [2023-12-27 22:56:46,051][106226] Updated weights for policy 0, policy_version 515681 (0.0008) [2023-12-27 22:56:46,110][106226] Updated weights for policy 0, policy_version 515691 (0.0007) [2023-12-27 22:56:46,114][106225] Updated weights for policy 1, policy_version 516981 (0.0008) [2023-12-27 22:56:46,162][106226] Updated weights for policy 0, policy_version 515701 (0.0006) [2023-12-27 22:56:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 264421376. Throughput: 0: 10056.1, 1: 10140.7. Samples: 264418888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:46,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-5.782')] [2023-12-27 22:56:46,177][106225] Updated weights for policy 1, policy_version 516991 (0.0007) [2023-12-27 22:56:46,236][106225] Updated weights for policy 1, policy_version 517001 (0.0009) [2023-12-27 22:56:46,855][106226] Updated weights for policy 0, policy_version 515711 (0.0009) [2023-12-27 22:56:46,921][106226] Updated weights for policy 0, policy_version 515721 (0.0011) [2023-12-27 22:56:46,961][106225] Updated weights for policy 1, policy_version 517011 (0.0008) [2023-12-27 22:56:46,981][106226] Updated weights for policy 0, policy_version 515731 (0.0010) [2023-12-27 22:56:47,006][106225] Updated weights for policy 1, policy_version 517021 (0.0005) [2023-12-27 22:56:47,052][106225] Updated weights for policy 1, policy_version 517031 (0.0005) [2023-12-27 22:56:47,688][106226] Updated weights for policy 0, policy_version 515741 (0.0010) [2023-12-27 22:56:47,726][106225] Updated weights for policy 1, policy_version 517041 (0.0008) [2023-12-27 22:56:47,742][106226] Updated weights for policy 0, policy_version 515751 (0.0010) [2023-12-27 22:56:47,779][106225] Updated weights for policy 1, policy_version 517051 (0.0008) [2023-12-27 22:56:47,793][106226] Updated weights for policy 0, policy_version 515761 (0.0010) [2023-12-27 22:56:47,838][106225] Updated weights for policy 1, policy_version 517061 (0.0005) [2023-12-27 22:56:47,895][106225] Updated weights for policy 1, policy_version 517071 (0.0008) [2023-12-27 22:56:48,526][106226] Updated weights for policy 0, policy_version 515771 (0.0011) [2023-12-27 22:56:48,564][106225] Updated weights for policy 1, policy_version 517081 (0.0006) [2023-12-27 22:56:48,584][106226] Updated weights for policy 0, policy_version 515781 (0.0011) [2023-12-27 22:56:48,615][106225] Updated weights for policy 1, policy_version 517091 (0.0008) [2023-12-27 22:56:48,636][106226] Updated weights for policy 0, policy_version 515791 (0.0011) [2023-12-27 22:56:48,676][106225] Updated weights for policy 1, policy_version 517101 (0.0006) [2023-12-27 22:56:49,385][106226] Updated weights for policy 0, policy_version 515801 (0.0009) [2023-12-27 22:56:49,437][106225] Updated weights for policy 1, policy_version 517111 (0.0008) [2023-12-27 22:56:49,448][106226] Updated weights for policy 0, policy_version 515811 (0.0007) [2023-12-27 22:56:49,499][106225] Updated weights for policy 1, policy_version 517121 (0.0008) [2023-12-27 22:56:49,508][106226] Updated weights for policy 0, policy_version 515821 (0.0006) [2023-12-27 22:56:49,556][106225] Updated weights for policy 1, policy_version 517131 (0.0009) [2023-12-27 22:56:49,564][106226] Updated weights for policy 0, policy_version 515831 (0.0006) [2023-12-27 22:56:50,231][106226] Updated weights for policy 0, policy_version 515841 (0.0009) [2023-12-27 22:56:50,293][106226] Updated weights for policy 0, policy_version 515851 (0.0009) [2023-12-27 22:56:50,322][106225] Updated weights for policy 1, policy_version 517141 (0.0008) [2023-12-27 22:56:50,357][106226] Updated weights for policy 0, policy_version 515861 (0.0007) [2023-12-27 22:56:50,385][106225] Updated weights for policy 1, policy_version 517151 (0.0009) [2023-12-27 22:56:50,442][106225] Updated weights for policy 1, policy_version 517161 (0.0009) [2023-12-27 22:56:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 264519680. Throughput: 0: 10008.8, 1: 10043.6. Samples: 264534256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:51,175][105115] Avg episode reward: [(0, '-5.055'), (1, '-5.400')] [2023-12-27 22:56:51,187][106226] Updated weights for policy 0, policy_version 515871 (0.0008) [2023-12-27 22:56:51,208][106225] Updated weights for policy 1, policy_version 517171 (0.0008) [2023-12-27 22:56:51,252][106226] Updated weights for policy 0, policy_version 515881 (0.0006) [2023-12-27 22:56:51,272][106225] Updated weights for policy 1, policy_version 517181 (0.0008) [2023-12-27 22:56:51,313][106226] Updated weights for policy 0, policy_version 515891 (0.0008) [2023-12-27 22:56:51,339][106225] Updated weights for policy 1, policy_version 517191 (0.0007) [2023-12-27 22:56:52,017][106226] Updated weights for policy 0, policy_version 515901 (0.0008) [2023-12-27 22:56:52,083][106226] Updated weights for policy 0, policy_version 515911 (0.0009) [2023-12-27 22:56:52,117][106225] Updated weights for policy 1, policy_version 517201 (0.0008) [2023-12-27 22:56:52,133][106226] Updated weights for policy 0, policy_version 515921 (0.0007) [2023-12-27 22:56:52,170][106225] Updated weights for policy 1, policy_version 517211 (0.0007) [2023-12-27 22:56:52,230][106225] Updated weights for policy 1, policy_version 517221 (0.0010) [2023-12-27 22:56:52,289][106225] Updated weights for policy 1, policy_version 517231 (0.0009) [2023-12-27 22:56:52,807][106226] Updated weights for policy 0, policy_version 515931 (0.0006) [2023-12-27 22:56:52,877][106226] Updated weights for policy 0, policy_version 515941 (0.0006) [2023-12-27 22:56:52,941][106226] Updated weights for policy 0, policy_version 515951 (0.0008) [2023-12-27 22:56:53,068][106225] Updated weights for policy 1, policy_version 517241 (0.0007) [2023-12-27 22:56:53,124][106225] Updated weights for policy 1, policy_version 517251 (0.0008) [2023-12-27 22:56:53,180][106225] Updated weights for policy 1, policy_version 517261 (0.0008) [2023-12-27 22:56:53,625][106226] Updated weights for policy 0, policy_version 515961 (0.0008) [2023-12-27 22:56:53,673][106226] Updated weights for policy 0, policy_version 515971 (0.0008) [2023-12-27 22:56:53,726][106226] Updated weights for policy 0, policy_version 515981 (0.0005) [2023-12-27 22:56:53,775][106226] Updated weights for policy 0, policy_version 515991 (0.0007) [2023-12-27 22:56:53,850][106225] Updated weights for policy 1, policy_version 517271 (0.0009) [2023-12-27 22:56:53,906][106225] Updated weights for policy 1, policy_version 517281 (0.0010) [2023-12-27 22:56:53,965][106225] Updated weights for policy 1, policy_version 517291 (0.0010) [2023-12-27 22:56:54,529][106226] Updated weights for policy 0, policy_version 516001 (0.0005) [2023-12-27 22:56:54,547][106225] Updated weights for policy 1, policy_version 517301 (0.0007) [2023-12-27 22:56:54,585][106226] Updated weights for policy 0, policy_version 516011 (0.0005) [2023-12-27 22:56:54,605][106225] Updated weights for policy 1, policy_version 517311 (0.0009) [2023-12-27 22:56:54,641][106226] Updated weights for policy 0, policy_version 516021 (0.0005) [2023-12-27 22:56:54,656][106225] Updated weights for policy 1, policy_version 517321 (0.0007) [2023-12-27 22:56:55,179][106226] Updated weights for policy 0, policy_version 516031 (0.0007) [2023-12-27 22:56:55,232][106226] Updated weights for policy 0, policy_version 516041 (0.0008) [2023-12-27 22:56:55,278][106226] Updated weights for policy 0, policy_version 516051 (0.0007) [2023-12-27 22:56:55,312][106225] Updated weights for policy 1, policy_version 517331 (0.0007) [2023-12-27 22:56:55,371][106225] Updated weights for policy 1, policy_version 517341 (0.0010) [2023-12-27 22:56:55,429][106225] Updated weights for policy 1, policy_version 517351 (0.0010) [2023-12-27 22:56:56,040][106226] Updated weights for policy 0, policy_version 516061 (0.0008) [2023-12-27 22:56:56,092][106226] Updated weights for policy 0, policy_version 516071 (0.0008) [2023-12-27 22:56:56,139][106225] Updated weights for policy 1, policy_version 517361 (0.0010) [2023-12-27 22:56:56,152][106226] Updated weights for policy 0, policy_version 516081 (0.0007) [2023-12-27 22:56:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 264617984. Throughput: 0: 9971.4, 1: 9994.7. Samples: 264591948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:56:56,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.539')] [2023-12-27 22:56:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000516088_132153344.pth... [2023-12-27 22:56:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000514904_131850240.pth [2023-12-27 22:56:56,193][106225] Updated weights for policy 1, policy_version 517371 (0.0010) [2023-12-27 22:56:56,253][106225] Updated weights for policy 1, policy_version 517381 (0.0010) [2023-12-27 22:56:56,317][106225] Updated weights for policy 1, policy_version 517391 (0.0010) [2023-12-27 22:56:56,321][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000517392_132481024.pth... [2023-12-27 22:56:56,325][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000516208_132177920.pth [2023-12-27 22:56:56,736][106226] Updated weights for policy 0, policy_version 516091 (0.0007) [2023-12-27 22:56:56,800][106226] Updated weights for policy 0, policy_version 516101 (0.0005) [2023-12-27 22:56:56,857][106226] Updated weights for policy 0, policy_version 516111 (0.0005) [2023-12-27 22:56:57,021][106225] Updated weights for policy 1, policy_version 517401 (0.0009) [2023-12-27 22:56:57,084][106225] Updated weights for policy 1, policy_version 517411 (0.0008) [2023-12-27 22:56:57,144][106225] Updated weights for policy 1, policy_version 517421 (0.0009) [2023-12-27 22:56:57,455][106226] Updated weights for policy 0, policy_version 516121 (0.0005) [2023-12-27 22:56:57,507][106226] Updated weights for policy 0, policy_version 516131 (0.0010) [2023-12-27 22:56:57,556][106226] Updated weights for policy 0, policy_version 516141 (0.0010) [2023-12-27 22:56:57,604][106226] Updated weights for policy 0, policy_version 516151 (0.0007) [2023-12-27 22:56:57,736][106225] Updated weights for policy 1, policy_version 517431 (0.0009) [2023-12-27 22:56:57,784][106225] Updated weights for policy 1, policy_version 517441 (0.0008) [2023-12-27 22:56:57,837][106225] Updated weights for policy 1, policy_version 517451 (0.0009) [2023-12-27 22:56:58,237][106226] Updated weights for policy 0, policy_version 516161 (0.0008) [2023-12-27 22:56:58,303][106226] Updated weights for policy 0, policy_version 516171 (0.0008) [2023-12-27 22:56:58,376][106226] Updated weights for policy 0, policy_version 516181 (0.0009) [2023-12-27 22:56:58,598][106225] Updated weights for policy 1, policy_version 517461 (0.0009) [2023-12-27 22:56:58,662][106225] Updated weights for policy 1, policy_version 517471 (0.0007) [2023-12-27 22:56:58,724][106225] Updated weights for policy 1, policy_version 517481 (0.0008) [2023-12-27 22:56:59,108][106226] Updated weights for policy 0, policy_version 516191 (0.0006) [2023-12-27 22:56:59,177][106226] Updated weights for policy 0, policy_version 516201 (0.0007) [2023-12-27 22:56:59,252][106226] Updated weights for policy 0, policy_version 516211 (0.0009) [2023-12-27 22:56:59,611][106225] Updated weights for policy 1, policy_version 517491 (0.0008) [2023-12-27 22:56:59,664][106225] Updated weights for policy 1, policy_version 517501 (0.0010) [2023-12-27 22:56:59,716][106225] Updated weights for policy 1, policy_version 517511 (0.0009) [2023-12-27 22:56:59,978][106226] Updated weights for policy 0, policy_version 516221 (0.0007) [2023-12-27 22:57:00,039][106226] Updated weights for policy 0, policy_version 516231 (0.0008) [2023-12-27 22:57:00,097][106226] Updated weights for policy 0, policy_version 516241 (0.0008) [2023-12-27 22:57:00,426][106225] Updated weights for policy 1, policy_version 517521 (0.0009) [2023-12-27 22:57:00,479][106225] Updated weights for policy 1, policy_version 517531 (0.0009) [2023-12-27 22:57:00,533][106225] Updated weights for policy 1, policy_version 517541 (0.0009) [2023-12-27 22:57:00,582][106225] Updated weights for policy 1, policy_version 517551 (0.0008) [2023-12-27 22:57:00,813][106226] Updated weights for policy 0, policy_version 516251 (0.0008) [2023-12-27 22:57:00,870][106226] Updated weights for policy 0, policy_version 516261 (0.0008) [2023-12-27 22:57:00,919][106226] Updated weights for policy 0, policy_version 516271 (0.0007) [2023-12-27 22:57:01,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 264724480. Throughput: 0: 10055.3, 1: 10029.1. Samples: 264712712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:01,175][105115] Avg episode reward: [(0, '-5.236'), (1, '-5.368')] [2023-12-27 22:57:01,324][106225] Updated weights for policy 1, policy_version 517561 (0.0010) [2023-12-27 22:57:01,396][106225] Updated weights for policy 1, policy_version 517571 (0.0009) [2023-12-27 22:57:01,453][106225] Updated weights for policy 1, policy_version 517581 (0.0005) [2023-12-27 22:57:01,682][106226] Updated weights for policy 0, policy_version 516281 (0.0006) [2023-12-27 22:57:01,744][106226] Updated weights for policy 0, policy_version 516291 (0.0009) [2023-12-27 22:57:01,802][106226] Updated weights for policy 0, policy_version 516301 (0.0009) [2023-12-27 22:57:01,868][106226] Updated weights for policy 0, policy_version 516311 (0.0009) [2023-12-27 22:57:02,147][106225] Updated weights for policy 1, policy_version 517591 (0.0008) [2023-12-27 22:57:02,209][106225] Updated weights for policy 1, policy_version 517601 (0.0008) [2023-12-27 22:57:02,267][106225] Updated weights for policy 1, policy_version 517611 (0.0008) [2023-12-27 22:57:02,602][106226] Updated weights for policy 0, policy_version 516321 (0.0009) [2023-12-27 22:57:02,656][106226] Updated weights for policy 0, policy_version 516331 (0.0009) [2023-12-27 22:57:02,711][106226] Updated weights for policy 0, policy_version 516341 (0.0009) [2023-12-27 22:57:02,989][106225] Updated weights for policy 1, policy_version 517621 (0.0007) [2023-12-27 22:57:03,033][106225] Updated weights for policy 1, policy_version 517631 (0.0006) [2023-12-27 22:57:03,078][106225] Updated weights for policy 1, policy_version 517641 (0.0005) [2023-12-27 22:57:03,482][106226] Updated weights for policy 0, policy_version 516351 (0.0008) [2023-12-27 22:57:03,531][106226] Updated weights for policy 0, policy_version 516361 (0.0009) [2023-12-27 22:57:03,583][106226] Updated weights for policy 0, policy_version 516371 (0.0008) [2023-12-27 22:57:03,673][106225] Updated weights for policy 1, policy_version 517651 (0.0005) [2023-12-27 22:57:03,718][106225] Updated weights for policy 1, policy_version 517661 (0.0007) [2023-12-27 22:57:03,766][106225] Updated weights for policy 1, policy_version 517671 (0.0008) [2023-12-27 22:57:04,344][106226] Updated weights for policy 0, policy_version 516381 (0.0009) [2023-12-27 22:57:04,409][106226] Updated weights for policy 0, policy_version 516391 (0.0008) [2023-12-27 22:57:04,462][106226] Updated weights for policy 0, policy_version 516401 (0.0008) [2023-12-27 22:57:04,521][106225] Updated weights for policy 1, policy_version 517681 (0.0007) [2023-12-27 22:57:04,585][106225] Updated weights for policy 1, policy_version 517691 (0.0008) [2023-12-27 22:57:04,652][106225] Updated weights for policy 1, policy_version 517701 (0.0006) [2023-12-27 22:57:04,709][106225] Updated weights for policy 1, policy_version 517711 (0.0007) [2023-12-27 22:57:05,066][106226] Updated weights for policy 0, policy_version 516411 (0.0009) [2023-12-27 22:57:05,112][106226] Updated weights for policy 0, policy_version 516421 (0.0010) [2023-12-27 22:57:05,166][106226] Updated weights for policy 0, policy_version 516431 (0.0005) [2023-12-27 22:57:05,263][106225] Updated weights for policy 1, policy_version 517721 (0.0005) [2023-12-27 22:57:05,328][106225] Updated weights for policy 1, policy_version 517731 (0.0005) [2023-12-27 22:57:05,383][106225] Updated weights for policy 1, policy_version 517741 (0.0005) [2023-12-27 22:57:05,782][106226] Updated weights for policy 0, policy_version 516441 (0.0009) [2023-12-27 22:57:05,830][106226] Updated weights for policy 0, policy_version 516451 (0.0005) [2023-12-27 22:57:05,880][106226] Updated weights for policy 0, policy_version 516461 (0.0005) [2023-12-27 22:57:05,947][106226] Updated weights for policy 0, policy_version 516471 (0.0006) [2023-12-27 22:57:06,019][106225] Updated weights for policy 1, policy_version 517751 (0.0008) [2023-12-27 22:57:06,070][106225] Updated weights for policy 1, policy_version 517761 (0.0009) [2023-12-27 22:57:06,133][106225] Updated weights for policy 1, policy_version 517771 (0.0009) [2023-12-27 22:57:06,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 264830976. Throughput: 0: 10064.3, 1: 10101.0. Samples: 264835164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:06,175][105115] Avg episode reward: [(0, '-5.412'), (1, '-5.616')] [2023-12-27 22:57:06,541][106226] Updated weights for policy 0, policy_version 516481 (0.0008) [2023-12-27 22:57:06,599][106226] Updated weights for policy 0, policy_version 516491 (0.0007) [2023-12-27 22:57:06,662][106226] Updated weights for policy 0, policy_version 516501 (0.0011) [2023-12-27 22:57:06,919][106225] Updated weights for policy 1, policy_version 517781 (0.0010) [2023-12-27 22:57:06,982][106225] Updated weights for policy 1, policy_version 517792 (0.0010) [2023-12-27 22:57:07,039][106225] Updated weights for policy 1, policy_version 517802 (0.0009) [2023-12-27 22:57:07,294][106226] Updated weights for policy 0, policy_version 516511 (0.0007) [2023-12-27 22:57:07,348][106226] Updated weights for policy 0, policy_version 516521 (0.0005) [2023-12-27 22:57:07,402][106226] Updated weights for policy 0, policy_version 516531 (0.0008) [2023-12-27 22:57:07,735][106225] Updated weights for policy 1, policy_version 517812 (0.0008) [2023-12-27 22:57:07,786][106225] Updated weights for policy 1, policy_version 517822 (0.0008) [2023-12-27 22:57:07,831][106225] Updated weights for policy 1, policy_version 517832 (0.0007) [2023-12-27 22:57:08,055][106226] Updated weights for policy 0, policy_version 516541 (0.0007) [2023-12-27 22:57:08,105][106226] Updated weights for policy 0, policy_version 516551 (0.0008) [2023-12-27 22:57:08,154][106226] Updated weights for policy 0, policy_version 516561 (0.0009) [2023-12-27 22:57:08,634][106225] Updated weights for policy 1, policy_version 517842 (0.0009) [2023-12-27 22:57:08,700][106225] Updated weights for policy 1, policy_version 517852 (0.0009) [2023-12-27 22:57:08,763][106225] Updated weights for policy 1, policy_version 517862 (0.0009) [2023-12-27 22:57:08,799][106226] Updated weights for policy 0, policy_version 516571 (0.0008) [2023-12-27 22:57:08,820][106225] Updated weights for policy 1, policy_version 517872 (0.0008) [2023-12-27 22:57:08,861][106226] Updated weights for policy 0, policy_version 516581 (0.0007) [2023-12-27 22:57:08,921][106226] Updated weights for policy 0, policy_version 516591 (0.0008) [2023-12-27 22:57:09,562][106225] Updated weights for policy 1, policy_version 517882 (0.0009) [2023-12-27 22:57:09,627][106225] Updated weights for policy 1, policy_version 517892 (0.0009) [2023-12-27 22:57:09,681][106225] Updated weights for policy 1, policy_version 517902 (0.0008) [2023-12-27 22:57:09,703][106226] Updated weights for policy 0, policy_version 516601 (0.0008) [2023-12-27 22:57:09,760][106226] Updated weights for policy 0, policy_version 516611 (0.0008) [2023-12-27 22:57:09,826][106226] Updated weights for policy 0, policy_version 516621 (0.0007) [2023-12-27 22:57:09,892][106226] Updated weights for policy 0, policy_version 516631 (0.0006) [2023-12-27 22:57:10,457][106225] Updated weights for policy 1, policy_version 517912 (0.0008) [2023-12-27 22:57:10,510][106225] Updated weights for policy 1, policy_version 517922 (0.0007) [2023-12-27 22:57:10,567][106225] Updated weights for policy 1, policy_version 517932 (0.0008) [2023-12-27 22:57:10,572][106226] Updated weights for policy 0, policy_version 516641 (0.0006) [2023-12-27 22:57:10,628][106226] Updated weights for policy 0, policy_version 516651 (0.0005) [2023-12-27 22:57:10,685][106226] Updated weights for policy 0, policy_version 516661 (0.0005) [2023-12-27 22:57:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 264921088. Throughput: 0: 10139.1, 1: 10065.9. Samples: 264894852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:11,175][105115] Avg episode reward: [(0, '-5.478'), (1, '-5.095')] [2023-12-27 22:57:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000517936_132620288.pth... [2023-12-27 22:57:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000516664_132300800.pth... [2023-12-27 22:57:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000515480_131997696.pth [2023-12-27 22:57:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000516784_132325376.pth [2023-12-27 22:57:11,295][106226] Updated weights for policy 0, policy_version 516671 (0.0007) [2023-12-27 22:57:11,380][106226] Updated weights for policy 0, policy_version 516681 (0.0008) [2023-12-27 22:57:11,395][106225] Updated weights for policy 1, policy_version 517942 (0.0008) [2023-12-27 22:57:11,443][106226] Updated weights for policy 0, policy_version 516691 (0.0007) [2023-12-27 22:57:11,460][106225] Updated weights for policy 1, policy_version 517952 (0.0008) [2023-12-27 22:57:11,523][106225] Updated weights for policy 1, policy_version 517962 (0.0008) [2023-12-27 22:57:12,237][106226] Updated weights for policy 0, policy_version 516701 (0.0007) [2023-12-27 22:57:12,293][106226] Updated weights for policy 0, policy_version 516711 (0.0008) [2023-12-27 22:57:12,307][106225] Updated weights for policy 1, policy_version 517972 (0.0009) [2023-12-27 22:57:12,365][106226] Updated weights for policy 0, policy_version 516721 (0.0007) [2023-12-27 22:57:12,370][106225] Updated weights for policy 1, policy_version 517982 (0.0008) [2023-12-27 22:57:12,434][106225] Updated weights for policy 1, policy_version 517992 (0.0008) [2023-12-27 22:57:13,105][106225] Updated weights for policy 1, policy_version 518002 (0.0008) [2023-12-27 22:57:13,108][106226] Updated weights for policy 0, policy_version 516731 (0.0008) [2023-12-27 22:57:13,159][106225] Updated weights for policy 1, policy_version 518012 (0.0009) [2023-12-27 22:57:13,165][106226] Updated weights for policy 0, policy_version 516741 (0.0006) [2023-12-27 22:57:13,211][106225] Updated weights for policy 1, policy_version 518022 (0.0006) [2023-12-27 22:57:13,221][106226] Updated weights for policy 0, policy_version 516751 (0.0009) [2023-12-27 22:57:13,260][106225] Updated weights for policy 1, policy_version 518032 (0.0005) [2023-12-27 22:57:13,866][106225] Updated weights for policy 1, policy_version 518042 (0.0005) [2023-12-27 22:57:13,914][106225] Updated weights for policy 1, policy_version 518052 (0.0005) [2023-12-27 22:57:13,945][106226] Updated weights for policy 0, policy_version 516761 (0.0008) [2023-12-27 22:57:13,963][106225] Updated weights for policy 1, policy_version 518062 (0.0005) [2023-12-27 22:57:14,000][106226] Updated weights for policy 0, policy_version 516771 (0.0006) [2023-12-27 22:57:14,056][106226] Updated weights for policy 0, policy_version 516781 (0.0005) [2023-12-27 22:57:14,116][106226] Updated weights for policy 0, policy_version 516791 (0.0005) [2023-12-27 22:57:14,530][106225] Updated weights for policy 1, policy_version 518072 (0.0007) [2023-12-27 22:57:14,589][106225] Updated weights for policy 1, policy_version 518082 (0.0008) [2023-12-27 22:57:14,638][106225] Updated weights for policy 1, policy_version 518092 (0.0008) [2023-12-27 22:57:14,754][106226] Updated weights for policy 0, policy_version 516801 (0.0010) [2023-12-27 22:57:14,823][106226] Updated weights for policy 0, policy_version 516811 (0.0011) [2023-12-27 22:57:14,885][106226] Updated weights for policy 0, policy_version 516821 (0.0008) [2023-12-27 22:57:15,412][106225] Updated weights for policy 1, policy_version 518102 (0.0007) [2023-12-27 22:57:15,473][106225] Updated weights for policy 1, policy_version 518112 (0.0008) [2023-12-27 22:57:15,509][106226] Updated weights for policy 0, policy_version 516831 (0.0007) [2023-12-27 22:57:15,531][106225] Updated weights for policy 1, policy_version 518122 (0.0008) [2023-12-27 22:57:15,574][106226] Updated weights for policy 0, policy_version 516841 (0.0009) [2023-12-27 22:57:15,632][106226] Updated weights for policy 0, policy_version 516851 (0.0009) [2023-12-27 22:57:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 265019392. Throughput: 0: 10065.9, 1: 9963.1. Samples: 265011908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:16,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-5.377')] [2023-12-27 22:57:16,254][106225] Updated weights for policy 1, policy_version 518132 (0.0008) [2023-12-27 22:57:16,306][106225] Updated weights for policy 1, policy_version 518142 (0.0009) [2023-12-27 22:57:16,307][106226] Updated weights for policy 0, policy_version 516861 (0.0007) [2023-12-27 22:57:16,352][106225] Updated weights for policy 1, policy_version 518152 (0.0009) [2023-12-27 22:57:16,360][106226] Updated weights for policy 0, policy_version 516871 (0.0005) [2023-12-27 22:57:16,420][106226] Updated weights for policy 0, policy_version 516881 (0.0006) [2023-12-27 22:57:17,041][106226] Updated weights for policy 0, policy_version 516891 (0.0011) [2023-12-27 22:57:17,059][106225] Updated weights for policy 1, policy_version 518162 (0.0008) [2023-12-27 22:57:17,102][106226] Updated weights for policy 0, policy_version 516901 (0.0011) [2023-12-27 22:57:17,119][106225] Updated weights for policy 1, policy_version 518172 (0.0007) [2023-12-27 22:57:17,159][106226] Updated weights for policy 0, policy_version 516911 (0.0011) [2023-12-27 22:57:17,179][106225] Updated weights for policy 1, policy_version 518182 (0.0006) [2023-12-27 22:57:17,224][106225] Updated weights for policy 1, policy_version 518192 (0.0008) [2023-12-27 22:57:17,833][106226] Updated weights for policy 0, policy_version 516921 (0.0011) [2023-12-27 22:57:17,889][106226] Updated weights for policy 0, policy_version 516931 (0.0009) [2023-12-27 22:57:17,896][106225] Updated weights for policy 1, policy_version 518202 (0.0005) [2023-12-27 22:57:17,940][106226] Updated weights for policy 0, policy_version 516941 (0.0010) [2023-12-27 22:57:17,941][106225] Updated weights for policy 1, policy_version 518212 (0.0005) [2023-12-27 22:57:18,000][106226] Updated weights for policy 0, policy_version 516951 (0.0008) [2023-12-27 22:57:18,008][106225] Updated weights for policy 1, policy_version 518222 (0.0008) [2023-12-27 22:57:18,630][106226] Updated weights for policy 0, policy_version 516961 (0.0006) [2023-12-27 22:57:18,695][106226] Updated weights for policy 0, policy_version 516971 (0.0006) [2023-12-27 22:57:18,746][106225] Updated weights for policy 1, policy_version 518232 (0.0010) [2023-12-27 22:57:18,764][106226] Updated weights for policy 0, policy_version 516981 (0.0006) [2023-12-27 22:57:18,809][106225] Updated weights for policy 1, policy_version 518242 (0.0009) [2023-12-27 22:57:18,872][106225] Updated weights for policy 1, policy_version 518252 (0.0010) [2023-12-27 22:57:19,317][106226] Updated weights for policy 0, policy_version 516991 (0.0006) [2023-12-27 22:57:19,384][106226] Updated weights for policy 0, policy_version 517001 (0.0014) [2023-12-27 22:57:19,432][106226] Updated weights for policy 0, policy_version 517011 (0.0009) [2023-12-27 22:57:19,578][106225] Updated weights for policy 1, policy_version 518262 (0.0009) [2023-12-27 22:57:19,641][106225] Updated weights for policy 1, policy_version 518272 (0.0008) [2023-12-27 22:57:19,699][106225] Updated weights for policy 1, policy_version 518282 (0.0008) [2023-12-27 22:57:20,174][106226] Updated weights for policy 0, policy_version 517021 (0.0009) [2023-12-27 22:57:20,237][106226] Updated weights for policy 0, policy_version 517031 (0.0008) [2023-12-27 22:57:20,299][106226] Updated weights for policy 0, policy_version 517041 (0.0008) [2023-12-27 22:57:20,452][106225] Updated weights for policy 1, policy_version 518292 (0.0008) [2023-12-27 22:57:20,499][106225] Updated weights for policy 1, policy_version 518302 (0.0008) [2023-12-27 22:57:20,548][106225] Updated weights for policy 1, policy_version 518312 (0.0008) [2023-12-27 22:57:21,122][106226] Updated weights for policy 0, policy_version 517051 (0.0009) [2023-12-27 22:57:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 265117696. Throughput: 0: 10039.0, 1: 9861.1. Samples: 265131060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:21,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-5.801')] [2023-12-27 22:57:21,183][106226] Updated weights for policy 0, policy_version 517061 (0.0009) [2023-12-27 22:57:21,249][106226] Updated weights for policy 0, policy_version 517071 (0.0007) [2023-12-27 22:57:21,404][106225] Updated weights for policy 1, policy_version 518322 (0.0009) [2023-12-27 22:57:21,471][106225] Updated weights for policy 1, policy_version 518332 (0.0006) [2023-12-27 22:57:21,539][106225] Updated weights for policy 1, policy_version 518342 (0.0005) [2023-12-27 22:57:21,600][106225] Updated weights for policy 1, policy_version 518352 (0.0006) [2023-12-27 22:57:22,009][106226] Updated weights for policy 0, policy_version 517081 (0.0008) [2023-12-27 22:57:22,076][106226] Updated weights for policy 0, policy_version 517091 (0.0008) [2023-12-27 22:57:22,140][106226] Updated weights for policy 0, policy_version 517101 (0.0008) [2023-12-27 22:57:22,201][106226] Updated weights for policy 0, policy_version 517111 (0.0007) [2023-12-27 22:57:22,291][106225] Updated weights for policy 1, policy_version 518362 (0.0009) [2023-12-27 22:57:22,357][106225] Updated weights for policy 1, policy_version 518372 (0.0007) [2023-12-27 22:57:22,426][106225] Updated weights for policy 1, policy_version 518382 (0.0006) [2023-12-27 22:57:22,914][106226] Updated weights for policy 0, policy_version 517121 (0.0009) [2023-12-27 22:57:22,978][106226] Updated weights for policy 0, policy_version 517131 (0.0009) [2023-12-27 22:57:23,044][106226] Updated weights for policy 0, policy_version 517141 (0.0009) [2023-12-27 22:57:23,107][106225] Updated weights for policy 1, policy_version 518392 (0.0008) [2023-12-27 22:57:23,173][106225] Updated weights for policy 1, policy_version 518402 (0.0009) [2023-12-27 22:57:23,235][106225] Updated weights for policy 1, policy_version 518412 (0.0007) [2023-12-27 22:57:23,802][106226] Updated weights for policy 0, policy_version 517151 (0.0009) [2023-12-27 22:57:23,860][106226] Updated weights for policy 0, policy_version 517161 (0.0008) [2023-12-27 22:57:23,871][106225] Updated weights for policy 1, policy_version 518422 (0.0006) [2023-12-27 22:57:23,922][106226] Updated weights for policy 0, policy_version 517171 (0.0008) [2023-12-27 22:57:23,932][106225] Updated weights for policy 1, policy_version 518432 (0.0006) [2023-12-27 22:57:23,977][106225] Updated weights for policy 1, policy_version 518442 (0.0006) [2023-12-27 22:57:24,610][106226] Updated weights for policy 0, policy_version 517181 (0.0006) [2023-12-27 22:57:24,642][106225] Updated weights for policy 1, policy_version 518452 (0.0006) [2023-12-27 22:57:24,664][106226] Updated weights for policy 0, policy_version 517191 (0.0006) [2023-12-27 22:57:24,691][106225] Updated weights for policy 1, policy_version 518462 (0.0007) [2023-12-27 22:57:24,716][106226] Updated weights for policy 0, policy_version 517201 (0.0008) [2023-12-27 22:57:24,741][106225] Updated weights for policy 1, policy_version 518472 (0.0007) [2023-12-27 22:57:25,431][106225] Updated weights for policy 1, policy_version 518482 (0.0008) [2023-12-27 22:57:25,433][106226] Updated weights for policy 0, policy_version 517211 (0.0006) [2023-12-27 22:57:25,493][106225] Updated weights for policy 1, policy_version 518492 (0.0008) [2023-12-27 22:57:25,509][106226] Updated weights for policy 0, policy_version 517221 (0.0006) [2023-12-27 22:57:25,559][106225] Updated weights for policy 1, policy_version 518502 (0.0009) [2023-12-27 22:57:25,575][106226] Updated weights for policy 0, policy_version 517231 (0.0005) [2023-12-27 22:57:25,604][106225] Updated weights for policy 1, policy_version 518512 (0.0006) [2023-12-27 22:57:26,162][106225] Updated weights for policy 1, policy_version 518522 (0.0005) [2023-12-27 22:57:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 265216000. Throughput: 0: 9984.4, 1: 9787.6. Samples: 265187772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:26,175][105115] Avg episode reward: [(0, '-5.199'), (1, '-4.992')] [2023-12-27 22:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000517240_132448256.pth... [2023-12-27 22:57:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000516088_132153344.pth [2023-12-27 22:57:26,211][106225] Updated weights for policy 1, policy_version 518532 (0.0005) [2023-12-27 22:57:26,273][106225] Updated weights for policy 1, policy_version 518542 (0.0005) [2023-12-27 22:57:26,287][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000518544_132775936.pth... [2023-12-27 22:57:26,290][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000517392_132481024.pth [2023-12-27 22:57:26,351][106226] Updated weights for policy 0, policy_version 517241 (0.0008) [2023-12-27 22:57:26,412][106226] Updated weights for policy 0, policy_version 517251 (0.0007) [2023-12-27 22:57:26,466][106226] Updated weights for policy 0, policy_version 517261 (0.0009) [2023-12-27 22:57:26,516][106226] Updated weights for policy 0, policy_version 517271 (0.0008) [2023-12-27 22:57:26,890][106225] Updated weights for policy 1, policy_version 518552 (0.0006) [2023-12-27 22:57:26,941][106225] Updated weights for policy 1, policy_version 518562 (0.0005) [2023-12-27 22:57:26,997][106225] Updated weights for policy 1, policy_version 518572 (0.0006) [2023-12-27 22:57:27,147][106226] Updated weights for policy 0, policy_version 517281 (0.0009) [2023-12-27 22:57:27,206][106226] Updated weights for policy 0, policy_version 517291 (0.0007) [2023-12-27 22:57:27,257][106226] Updated weights for policy 0, policy_version 517301 (0.0006) [2023-12-27 22:57:27,607][106225] Updated weights for policy 1, policy_version 518582 (0.0008) [2023-12-27 22:57:27,652][106225] Updated weights for policy 1, policy_version 518592 (0.0008) [2023-12-27 22:57:27,699][106225] Updated weights for policy 1, policy_version 518602 (0.0007) [2023-12-27 22:57:27,919][106226] Updated weights for policy 0, policy_version 517311 (0.0005) [2023-12-27 22:57:27,977][106226] Updated weights for policy 0, policy_version 517321 (0.0005) [2023-12-27 22:57:28,025][106226] Updated weights for policy 0, policy_version 517331 (0.0007) [2023-12-27 22:57:28,302][106225] Updated weights for policy 1, policy_version 518612 (0.0007) [2023-12-27 22:57:28,369][106225] Updated weights for policy 1, policy_version 518622 (0.0010) [2023-12-27 22:57:28,417][106225] Updated weights for policy 1, policy_version 518632 (0.0008) [2023-12-27 22:57:28,700][106226] Updated weights for policy 0, policy_version 517341 (0.0009) [2023-12-27 22:57:28,762][106226] Updated weights for policy 0, policy_version 517351 (0.0008) [2023-12-27 22:57:28,823][106226] Updated weights for policy 0, policy_version 517361 (0.0006) [2023-12-27 22:57:29,106][106225] Updated weights for policy 1, policy_version 518642 (0.0010) [2023-12-27 22:57:29,152][106225] Updated weights for policy 1, policy_version 518652 (0.0010) [2023-12-27 22:57:29,199][106225] Updated weights for policy 1, policy_version 518662 (0.0010) [2023-12-27 22:57:29,269][106225] Updated weights for policy 1, policy_version 518672 (0.0011) [2023-12-27 22:57:29,565][106226] Updated weights for policy 0, policy_version 517371 (0.0007) [2023-12-27 22:57:29,626][106226] Updated weights for policy 0, policy_version 517381 (0.0007) [2023-12-27 22:57:29,686][106226] Updated weights for policy 0, policy_version 517391 (0.0008) [2023-12-27 22:57:30,076][106225] Updated weights for policy 1, policy_version 518682 (0.0010) [2023-12-27 22:57:30,136][106225] Updated weights for policy 1, policy_version 518692 (0.0010) [2023-12-27 22:57:30,197][106225] Updated weights for policy 1, policy_version 518702 (0.0010) [2023-12-27 22:57:30,410][106226] Updated weights for policy 0, policy_version 517401 (0.0006) [2023-12-27 22:57:30,464][106226] Updated weights for policy 0, policy_version 517411 (0.0007) [2023-12-27 22:57:30,522][106226] Updated weights for policy 0, policy_version 517421 (0.0008) [2023-12-27 22:57:30,585][106226] Updated weights for policy 0, policy_version 517431 (0.0010) [2023-12-27 22:57:30,815][106225] Updated weights for policy 1, policy_version 518712 (0.0006) [2023-12-27 22:57:30,860][106225] Updated weights for policy 1, policy_version 518722 (0.0008) [2023-12-27 22:57:30,915][106225] Updated weights for policy 1, policy_version 518732 (0.0008) [2023-12-27 22:57:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 265322496. Throughput: 0: 9971.9, 1: 9869.2. Samples: 265311740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:31,175][105115] Avg episode reward: [(0, '-5.249'), (1, '-5.531')] [2023-12-27 22:57:31,418][106226] Updated weights for policy 0, policy_version 517441 (0.0010) [2023-12-27 22:57:31,475][106226] Updated weights for policy 0, policy_version 517451 (0.0008) [2023-12-27 22:57:31,536][106226] Updated weights for policy 0, policy_version 517461 (0.0009) [2023-12-27 22:57:31,538][106225] Updated weights for policy 1, policy_version 518742 (0.0007) [2023-12-27 22:57:31,607][106225] Updated weights for policy 1, policy_version 518752 (0.0008) [2023-12-27 22:57:31,672][106225] Updated weights for policy 1, policy_version 518762 (0.0007) [2023-12-27 22:57:32,287][106226] Updated weights for policy 0, policy_version 517471 (0.0008) [2023-12-27 22:57:32,350][106226] Updated weights for policy 0, policy_version 517481 (0.0008) [2023-12-27 22:57:32,375][106225] Updated weights for policy 1, policy_version 518772 (0.0007) [2023-12-27 22:57:32,410][106226] Updated weights for policy 0, policy_version 517491 (0.0007) [2023-12-27 22:57:32,432][106225] Updated weights for policy 1, policy_version 518782 (0.0008) [2023-12-27 22:57:32,479][106225] Updated weights for policy 1, policy_version 518792 (0.0010) [2023-12-27 22:57:33,118][106225] Updated weights for policy 1, policy_version 518802 (0.0009) [2023-12-27 22:57:33,118][106226] Updated weights for policy 0, policy_version 517501 (0.0007) [2023-12-27 22:57:33,169][106226] Updated weights for policy 0, policy_version 517511 (0.0006) [2023-12-27 22:57:33,174][106225] Updated weights for policy 1, policy_version 518812 (0.0010) [2023-12-27 22:57:33,221][106226] Updated weights for policy 0, policy_version 517521 (0.0008) [2023-12-27 22:57:33,230][106225] Updated weights for policy 1, policy_version 518822 (0.0010) [2023-12-27 22:57:33,289][106225] Updated weights for policy 1, policy_version 518832 (0.0010) [2023-12-27 22:57:33,798][106226] Updated weights for policy 0, policy_version 517531 (0.0005) [2023-12-27 22:57:33,853][106226] Updated weights for policy 0, policy_version 517541 (0.0005) [2023-12-27 22:57:33,918][106226] Updated weights for policy 0, policy_version 517551 (0.0007) [2023-12-27 22:57:33,961][106225] Updated weights for policy 1, policy_version 518842 (0.0008) [2023-12-27 22:57:34,013][106225] Updated weights for policy 1, policy_version 518852 (0.0010) [2023-12-27 22:57:34,069][106225] Updated weights for policy 1, policy_version 518862 (0.0010) [2023-12-27 22:57:34,525][106226] Updated weights for policy 0, policy_version 517561 (0.0007) [2023-12-27 22:57:34,593][106226] Updated weights for policy 0, policy_version 517571 (0.0006) [2023-12-27 22:57:34,661][106226] Updated weights for policy 0, policy_version 517581 (0.0007) [2023-12-27 22:57:34,722][106225] Updated weights for policy 1, policy_version 518872 (0.0009) [2023-12-27 22:57:34,724][106226] Updated weights for policy 0, policy_version 517591 (0.0007) [2023-12-27 22:57:34,783][106225] Updated weights for policy 1, policy_version 518882 (0.0007) [2023-12-27 22:57:34,845][106225] Updated weights for policy 1, policy_version 518892 (0.0009) [2023-12-27 22:57:35,324][106226] Updated weights for policy 0, policy_version 517601 (0.0009) [2023-12-27 22:57:35,375][106226] Updated weights for policy 0, policy_version 517611 (0.0009) [2023-12-27 22:57:35,434][106226] Updated weights for policy 0, policy_version 517621 (0.0009) [2023-12-27 22:57:35,514][106225] Updated weights for policy 1, policy_version 518902 (0.0009) [2023-12-27 22:57:35,579][106225] Updated weights for policy 1, policy_version 518912 (0.0008) [2023-12-27 22:57:35,634][106225] Updated weights for policy 1, policy_version 518922 (0.0008) [2023-12-27 22:57:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 265420800. Throughput: 0: 10003.9, 1: 9975.0. Samples: 265433304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 22:57:36,175][105115] Avg episode reward: [(0, '-4.972'), (1, '-5.405')] [2023-12-27 22:57:36,237][106226] Updated weights for policy 0, policy_version 517631 (0.0009) [2023-12-27 22:57:36,306][106225] Updated weights for policy 1, policy_version 518932 (0.0007) [2023-12-27 22:57:36,312][106226] Updated weights for policy 0, policy_version 517641 (0.0009) [2023-12-27 22:57:36,374][106225] Updated weights for policy 1, policy_version 518942 (0.0007) [2023-12-27 22:57:36,381][106226] Updated weights for policy 0, policy_version 517651 (0.0008) [2023-12-27 22:57:36,436][106225] Updated weights for policy 1, policy_version 518952 (0.0010) [2023-12-27 22:57:36,963][106226] Updated weights for policy 0, policy_version 517661 (0.0007) [2023-12-27 22:57:37,022][106226] Updated weights for policy 0, policy_version 517671 (0.0008) [2023-12-27 22:57:37,082][106226] Updated weights for policy 0, policy_version 517681 (0.0006) [2023-12-27 22:57:37,118][106225] Updated weights for policy 1, policy_version 518962 (0.0010) [2023-12-27 22:57:37,176][106225] Updated weights for policy 1, policy_version 518972 (0.0010) [2023-12-27 22:57:37,225][106225] Updated weights for policy 1, policy_version 518982 (0.0010) [2023-12-27 22:57:37,272][106225] Updated weights for policy 1, policy_version 518992 (0.0010) [2023-12-27 22:57:37,780][106226] Updated weights for policy 0, policy_version 517691 (0.0006) [2023-12-27 22:57:37,835][106226] Updated weights for policy 0, policy_version 517701 (0.0006) [2023-12-27 22:57:37,886][106226] Updated weights for policy 0, policy_version 517711 (0.0005) [2023-12-27 22:57:38,011][106225] Updated weights for policy 1, policy_version 519002 (0.0005) [2023-12-27 22:57:38,077][106225] Updated weights for policy 1, policy_version 519012 (0.0005) [2023-12-27 22:57:38,136][106225] Updated weights for policy 1, policy_version 519022 (0.0005) [2023-12-27 22:57:38,591][106226] Updated weights for policy 0, policy_version 517721 (0.0007) [2023-12-27 22:57:38,638][106226] Updated weights for policy 0, policy_version 517731 (0.0008) [2023-12-27 22:57:38,704][106226] Updated weights for policy 0, policy_version 517741 (0.0008) [2023-12-27 22:57:38,718][106225] Updated weights for policy 1, policy_version 519032 (0.0007) [2023-12-27 22:57:38,763][106226] Updated weights for policy 0, policy_version 517751 (0.0007) [2023-12-27 22:57:38,775][106225] Updated weights for policy 1, policy_version 519042 (0.0008) [2023-12-27 22:57:38,829][106225] Updated weights for policy 1, policy_version 519052 (0.0008) [2023-12-27 22:57:39,557][106226] Updated weights for policy 0, policy_version 517761 (0.0007) [2023-12-27 22:57:39,570][106225] Updated weights for policy 1, policy_version 519062 (0.0009) [2023-12-27 22:57:39,617][106226] Updated weights for policy 0, policy_version 517771 (0.0009) [2023-12-27 22:57:39,634][106225] Updated weights for policy 1, policy_version 519072 (0.0008) [2023-12-27 22:57:39,678][106226] Updated weights for policy 0, policy_version 517781 (0.0006) [2023-12-27 22:57:39,692][106225] Updated weights for policy 1, policy_version 519082 (0.0007) [2023-12-27 22:57:40,385][106226] Updated weights for policy 0, policy_version 517791 (0.0010) [2023-12-27 22:57:40,433][106225] Updated weights for policy 1, policy_version 519092 (0.0008) [2023-12-27 22:57:40,450][106226] Updated weights for policy 0, policy_version 517801 (0.0010) [2023-12-27 22:57:40,492][106225] Updated weights for policy 1, policy_version 519102 (0.0007) [2023-12-27 22:57:40,506][106226] Updated weights for policy 0, policy_version 517811 (0.0007) [2023-12-27 22:57:40,554][106225] Updated weights for policy 1, policy_version 519112 (0.0008) [2023-12-27 22:57:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 265519104. Throughput: 0: 10013.7, 1: 10044.5. Samples: 265494568. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:57:41,175][105115] Avg episode reward: [(0, '-5.239'), (1, '-5.556')] [2023-12-27 22:57:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000519120_132923392.pth... [2023-12-27 22:57:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000517816_132595712.pth... [2023-12-27 22:57:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000516664_132300800.pth [2023-12-27 22:57:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000517936_132620288.pth [2023-12-27 22:57:41,282][106225] Updated weights for policy 1, policy_version 519122 (0.0008) [2023-12-27 22:57:41,314][106226] Updated weights for policy 0, policy_version 517821 (0.0009) [2023-12-27 22:57:41,351][106225] Updated weights for policy 1, policy_version 519132 (0.0008) [2023-12-27 22:57:41,382][106226] Updated weights for policy 0, policy_version 517831 (0.0008) [2023-12-27 22:57:41,425][106225] Updated weights for policy 1, policy_version 519142 (0.0008) [2023-12-27 22:57:41,448][106226] Updated weights for policy 0, policy_version 517841 (0.0008) [2023-12-27 22:57:41,489][106225] Updated weights for policy 1, policy_version 519152 (0.0007) [2023-12-27 22:57:42,143][106225] Updated weights for policy 1, policy_version 519162 (0.0009) [2023-12-27 22:57:42,189][106225] Updated weights for policy 1, policy_version 519172 (0.0007) [2023-12-27 22:57:42,242][106225] Updated weights for policy 1, policy_version 519182 (0.0005) [2023-12-27 22:57:42,271][106226] Updated weights for policy 0, policy_version 517851 (0.0008) [2023-12-27 22:57:42,338][106226] Updated weights for policy 0, policy_version 517861 (0.0007) [2023-12-27 22:57:42,411][106226] Updated weights for policy 0, policy_version 517871 (0.0009) [2023-12-27 22:57:42,920][106225] Updated weights for policy 1, policy_version 519192 (0.0008) [2023-12-27 22:57:42,986][106225] Updated weights for policy 1, policy_version 519202 (0.0007) [2023-12-27 22:57:43,047][106225] Updated weights for policy 1, policy_version 519212 (0.0008) [2023-12-27 22:57:43,071][106226] Updated weights for policy 0, policy_version 517881 (0.0007) [2023-12-27 22:57:43,128][106226] Updated weights for policy 0, policy_version 517891 (0.0011) [2023-12-27 22:57:43,191][106226] Updated weights for policy 0, policy_version 517901 (0.0010) [2023-12-27 22:57:43,252][106226] Updated weights for policy 0, policy_version 517911 (0.0005) [2023-12-27 22:57:43,635][106225] Updated weights for policy 1, policy_version 519222 (0.0006) [2023-12-27 22:57:43,681][106225] Updated weights for policy 1, policy_version 519232 (0.0005) [2023-12-27 22:57:43,736][106225] Updated weights for policy 1, policy_version 519242 (0.0005) [2023-12-27 22:57:43,822][106226] Updated weights for policy 0, policy_version 517921 (0.0009) [2023-12-27 22:57:43,879][106226] Updated weights for policy 0, policy_version 517931 (0.0005) [2023-12-27 22:57:43,935][106226] Updated weights for policy 0, policy_version 517941 (0.0005) [2023-12-27 22:57:44,258][106225] Updated weights for policy 1, policy_version 519252 (0.0005) [2023-12-27 22:57:44,306][106225] Updated weights for policy 1, policy_version 519262 (0.0006) [2023-12-27 22:57:44,354][106225] Updated weights for policy 1, policy_version 519272 (0.0008) [2023-12-27 22:57:44,585][106226] Updated weights for policy 0, policy_version 517951 (0.0006) [2023-12-27 22:57:44,636][106226] Updated weights for policy 0, policy_version 517961 (0.0009) [2023-12-27 22:57:44,683][106226] Updated weights for policy 0, policy_version 517971 (0.0009) [2023-12-27 22:57:45,110][106225] Updated weights for policy 1, policy_version 519282 (0.0008) [2023-12-27 22:57:45,175][106225] Updated weights for policy 1, policy_version 519292 (0.0008) [2023-12-27 22:57:45,242][106225] Updated weights for policy 1, policy_version 519302 (0.0008) [2023-12-27 22:57:45,298][106225] Updated weights for policy 1, policy_version 519312 (0.0009) [2023-12-27 22:57:45,428][106226] Updated weights for policy 0, policy_version 517981 (0.0007) [2023-12-27 22:57:45,484][106226] Updated weights for policy 0, policy_version 517991 (0.0005) [2023-12-27 22:57:45,545][106226] Updated weights for policy 0, policy_version 518001 (0.0008) [2023-12-27 22:57:46,063][106225] Updated weights for policy 1, policy_version 519322 (0.0009) [2023-12-27 22:57:46,122][106225] Updated weights for policy 1, policy_version 519332 (0.0009) [2023-12-27 22:57:46,168][106225] Updated weights for policy 1, policy_version 519342 (0.0008) [2023-12-27 22:57:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 265617408. Throughput: 0: 9928.7, 1: 10092.1. Samples: 265613648. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:57:46,175][105115] Avg episode reward: [(0, '-5.089'), (1, '-5.189')] [2023-12-27 22:57:46,191][106226] Updated weights for policy 0, policy_version 518011 (0.0008) [2023-12-27 22:57:46,254][106226] Updated weights for policy 0, policy_version 518021 (0.0009) [2023-12-27 22:57:46,309][106226] Updated weights for policy 0, policy_version 518031 (0.0009) [2023-12-27 22:57:46,806][106225] Updated weights for policy 1, policy_version 519352 (0.0009) [2023-12-27 22:57:46,855][106225] Updated weights for policy 1, policy_version 519362 (0.0008) [2023-12-27 22:57:46,920][106225] Updated weights for policy 1, policy_version 519372 (0.0005) [2023-12-27 22:57:46,940][106226] Updated weights for policy 0, policy_version 518041 (0.0008) [2023-12-27 22:57:46,990][106226] Updated weights for policy 0, policy_version 518051 (0.0005) [2023-12-27 22:57:47,056][106226] Updated weights for policy 0, policy_version 518061 (0.0005) [2023-12-27 22:57:47,127][106226] Updated weights for policy 0, policy_version 518071 (0.0007) [2023-12-27 22:57:47,666][106225] Updated weights for policy 1, policy_version 519382 (0.0009) [2023-12-27 22:57:47,730][106225] Updated weights for policy 1, policy_version 519392 (0.0010) [2023-12-27 22:57:47,776][106226] Updated weights for policy 0, policy_version 518081 (0.0010) [2023-12-27 22:57:47,796][106225] Updated weights for policy 1, policy_version 519402 (0.0011) [2023-12-27 22:57:47,829][106226] Updated weights for policy 0, policy_version 518091 (0.0011) [2023-12-27 22:57:47,879][106226] Updated weights for policy 0, policy_version 518101 (0.0010) [2023-12-27 22:57:48,473][106225] Updated weights for policy 1, policy_version 519412 (0.0010) [2023-12-27 22:57:48,527][106225] Updated weights for policy 1, policy_version 519422 (0.0010) [2023-12-27 22:57:48,585][106225] Updated weights for policy 1, policy_version 519432 (0.0010) [2023-12-27 22:57:48,633][106226] Updated weights for policy 0, policy_version 518111 (0.0009) [2023-12-27 22:57:48,702][106226] Updated weights for policy 0, policy_version 518121 (0.0006) [2023-12-27 22:57:48,762][106226] Updated weights for policy 0, policy_version 518131 (0.0011) [2023-12-27 22:57:49,219][106225] Updated weights for policy 1, policy_version 519442 (0.0009) [2023-12-27 22:57:49,286][106225] Updated weights for policy 1, policy_version 519452 (0.0009) [2023-12-27 22:57:49,360][106225] Updated weights for policy 1, policy_version 519462 (0.0009) [2023-12-27 22:57:49,420][106225] Updated weights for policy 1, policy_version 519472 (0.0011) [2023-12-27 22:57:49,448][106226] Updated weights for policy 0, policy_version 518141 (0.0011) [2023-12-27 22:57:49,510][106226] Updated weights for policy 0, policy_version 518151 (0.0011) [2023-12-27 22:57:49,573][106226] Updated weights for policy 0, policy_version 518161 (0.0010) [2023-12-27 22:57:50,157][106225] Updated weights for policy 1, policy_version 519482 (0.0009) [2023-12-27 22:57:50,206][106225] Updated weights for policy 1, policy_version 519492 (0.0008) [2023-12-27 22:57:50,245][106226] Updated weights for policy 0, policy_version 518171 (0.0009) [2023-12-27 22:57:50,258][106225] Updated weights for policy 1, policy_version 519502 (0.0008) [2023-12-27 22:57:50,303][106226] Updated weights for policy 0, policy_version 518181 (0.0009) [2023-12-27 22:57:50,353][106226] Updated weights for policy 0, policy_version 518191 (0.0010) [2023-12-27 22:57:51,037][106226] Updated weights for policy 0, policy_version 518201 (0.0010) [2023-12-27 22:57:51,061][106225] Updated weights for policy 1, policy_version 519512 (0.0007) [2023-12-27 22:57:51,096][106226] Updated weights for policy 0, policy_version 518211 (0.0010) [2023-12-27 22:57:51,119][106225] Updated weights for policy 1, policy_version 519522 (0.0008) [2023-12-27 22:57:51,162][106226] Updated weights for policy 0, policy_version 518221 (0.0010) [2023-12-27 22:57:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 265715712. Throughput: 0: 9957.7, 1: 10003.6. Samples: 265733424. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:57:51,175][105115] Avg episode reward: [(0, '-4.979'), (1, '-5.241')] [2023-12-27 22:57:51,182][106225] Updated weights for policy 1, policy_version 519532 (0.0008) [2023-12-27 22:57:51,214][106226] Updated weights for policy 0, policy_version 518231 (0.0010) [2023-12-27 22:57:51,896][106225] Updated weights for policy 1, policy_version 519542 (0.0008) [2023-12-27 22:57:51,960][106225] Updated weights for policy 1, policy_version 519552 (0.0008) [2023-12-27 22:57:51,992][106226] Updated weights for policy 0, policy_version 518241 (0.0009) [2023-12-27 22:57:52,022][106225] Updated weights for policy 1, policy_version 519562 (0.0007) [2023-12-27 22:57:52,047][106226] Updated weights for policy 0, policy_version 518251 (0.0006) [2023-12-27 22:57:52,103][106226] Updated weights for policy 0, policy_version 518261 (0.0008) [2023-12-27 22:57:52,707][106225] Updated weights for policy 1, policy_version 519572 (0.0008) [2023-12-27 22:57:52,768][106225] Updated weights for policy 1, policy_version 519582 (0.0008) [2023-12-27 22:57:52,792][106226] Updated weights for policy 0, policy_version 518271 (0.0008) [2023-12-27 22:57:52,830][106225] Updated weights for policy 1, policy_version 519592 (0.0007) [2023-12-27 22:57:52,842][106226] Updated weights for policy 0, policy_version 518281 (0.0007) [2023-12-27 22:57:52,899][106226] Updated weights for policy 0, policy_version 518291 (0.0009) [2023-12-27 22:57:53,533][106226] Updated weights for policy 0, policy_version 518301 (0.0007) [2023-12-27 22:57:53,587][106225] Updated weights for policy 1, policy_version 519602 (0.0008) [2023-12-27 22:57:53,588][106226] Updated weights for policy 0, policy_version 518311 (0.0009) [2023-12-27 22:57:53,646][106225] Updated weights for policy 1, policy_version 519612 (0.0007) [2023-12-27 22:57:53,647][106226] Updated weights for policy 0, policy_version 518321 (0.0009) [2023-12-27 22:57:53,700][106225] Updated weights for policy 1, policy_version 519622 (0.0009) [2023-12-27 22:57:54,325][106226] Updated weights for policy 0, policy_version 518331 (0.0007) [2023-12-27 22:57:54,393][106226] Updated weights for policy 0, policy_version 518341 (0.0011) [2023-12-27 22:57:54,460][106226] Updated weights for policy 0, policy_version 518351 (0.0011) [2023-12-27 22:57:54,462][106225] Updated weights for policy 1, policy_version 519633 (0.0010) [2023-12-27 22:57:54,506][106225] Updated weights for policy 1, policy_version 519643 (0.0006) [2023-12-27 22:57:54,558][106225] Updated weights for policy 1, policy_version 519653 (0.0007) [2023-12-27 22:57:54,615][106225] Updated weights for policy 1, policy_version 519663 (0.0009) [2023-12-27 22:57:55,140][106226] Updated weights for policy 0, policy_version 518361 (0.0009) [2023-12-27 22:57:55,203][106226] Updated weights for policy 0, policy_version 518371 (0.0011) [2023-12-27 22:57:55,265][106226] Updated weights for policy 0, policy_version 518381 (0.0011) [2023-12-27 22:57:55,315][106226] Updated weights for policy 0, policy_version 518391 (0.0010) [2023-12-27 22:57:55,352][106225] Updated weights for policy 1, policy_version 519673 (0.0007) [2023-12-27 22:57:55,397][106225] Updated weights for policy 1, policy_version 519683 (0.0007) [2023-12-27 22:57:55,453][106225] Updated weights for policy 1, policy_version 519693 (0.0008) [2023-12-27 22:57:56,025][106226] Updated weights for policy 0, policy_version 518401 (0.0009) [2023-12-27 22:57:56,090][106226] Updated weights for policy 0, policy_version 518411 (0.0009) [2023-12-27 22:57:56,154][106226] Updated weights for policy 0, policy_version 518421 (0.0005) [2023-12-27 22:57:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 265822208. Throughput: 0: 9913.0, 1: 10016.1. Samples: 265791660. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:57:56,175][105115] Avg episode reward: [(0, '-5.259'), (1, '-5.327')] [2023-12-27 22:57:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000518424_132751360.pth... [2023-12-27 22:57:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000517240_132448256.pth [2023-12-27 22:57:56,210][106225] Updated weights for policy 1, policy_version 519703 (0.0008) [2023-12-27 22:57:56,270][106225] Updated weights for policy 1, policy_version 519713 (0.0007) [2023-12-27 22:57:56,326][106225] Updated weights for policy 1, policy_version 519723 (0.0009) [2023-12-27 22:57:56,353][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000519728_133079040.pth... [2023-12-27 22:57:56,357][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000518544_132775936.pth [2023-12-27 22:57:56,776][106226] Updated weights for policy 0, policy_version 518431 (0.0006) [2023-12-27 22:57:56,830][106226] Updated weights for policy 0, policy_version 518441 (0.0006) [2023-12-27 22:57:56,876][106226] Updated weights for policy 0, policy_version 518451 (0.0005) [2023-12-27 22:57:57,100][106225] Updated weights for policy 1, policy_version 519733 (0.0009) [2023-12-27 22:57:57,171][106225] Updated weights for policy 1, policy_version 519743 (0.0009) [2023-12-27 22:57:57,225][106225] Updated weights for policy 1, policy_version 519753 (0.0008) [2023-12-27 22:57:57,489][106226] Updated weights for policy 0, policy_version 518461 (0.0007) [2023-12-27 22:57:57,541][106226] Updated weights for policy 0, policy_version 518471 (0.0008) [2023-12-27 22:57:57,604][106226] Updated weights for policy 0, policy_version 518481 (0.0008) [2023-12-27 22:57:57,994][106225] Updated weights for policy 1, policy_version 519763 (0.0008) [2023-12-27 22:57:58,061][106225] Updated weights for policy 1, policy_version 519773 (0.0005) [2023-12-27 22:57:58,120][106225] Updated weights for policy 1, policy_version 519783 (0.0005) [2023-12-27 22:57:58,186][106226] Updated weights for policy 0, policy_version 518491 (0.0005) [2023-12-27 22:57:58,264][106226] Updated weights for policy 0, policy_version 518501 (0.0008) [2023-12-27 22:57:58,350][106226] Updated weights for policy 0, policy_version 518511 (0.0009) [2023-12-27 22:57:58,856][106225] Updated weights for policy 1, policy_version 519793 (0.0006) [2023-12-27 22:57:58,927][106225] Updated weights for policy 1, policy_version 519803 (0.0008) [2023-12-27 22:57:59,001][106225] Updated weights for policy 1, policy_version 519813 (0.0008) [2023-12-27 22:57:59,061][106225] Updated weights for policy 1, policy_version 519823 (0.0008) [2023-12-27 22:57:59,093][106226] Updated weights for policy 0, policy_version 518521 (0.0008) [2023-12-27 22:57:59,149][106226] Updated weights for policy 0, policy_version 518531 (0.0008) [2023-12-27 22:57:59,201][106226] Updated weights for policy 0, policy_version 518541 (0.0008) [2023-12-27 22:57:59,269][106226] Updated weights for policy 0, policy_version 518551 (0.0009) [2023-12-27 22:57:59,888][106225] Updated weights for policy 1, policy_version 519833 (0.0007) [2023-12-27 22:57:59,957][106225] Updated weights for policy 1, policy_version 519843 (0.0008) [2023-12-27 22:57:59,990][106226] Updated weights for policy 0, policy_version 518561 (0.0007) [2023-12-27 22:58:00,009][106225] Updated weights for policy 1, policy_version 519853 (0.0006) [2023-12-27 22:58:00,052][106226] Updated weights for policy 0, policy_version 518571 (0.0008) [2023-12-27 22:58:00,120][106226] Updated weights for policy 0, policy_version 518581 (0.0009) [2023-12-27 22:58:00,723][106226] Updated weights for policy 0, policy_version 518591 (0.0008) [2023-12-27 22:58:00,771][106226] Updated weights for policy 0, policy_version 518601 (0.0007) [2023-12-27 22:58:00,806][106225] Updated weights for policy 1, policy_version 519863 (0.0007) [2023-12-27 22:58:00,826][106226] Updated weights for policy 0, policy_version 518611 (0.0005) [2023-12-27 22:58:00,859][106225] Updated weights for policy 1, policy_version 519873 (0.0005) [2023-12-27 22:58:00,923][106225] Updated weights for policy 1, policy_version 519883 (0.0005) [2023-12-27 22:58:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 265920512. Throughput: 0: 9961.9, 1: 9940.6. Samples: 265907520. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:01,175][105115] Avg episode reward: [(0, '-5.091'), (1, '-5.480')] [2023-12-27 22:58:01,508][106226] Updated weights for policy 0, policy_version 518621 (0.0006) [2023-12-27 22:58:01,567][106226] Updated weights for policy 0, policy_version 518631 (0.0005) [2023-12-27 22:58:01,581][106225] Updated weights for policy 1, policy_version 519893 (0.0007) [2023-12-27 22:58:01,633][106226] Updated weights for policy 0, policy_version 518641 (0.0007) [2023-12-27 22:58:01,648][106225] Updated weights for policy 1, policy_version 519903 (0.0008) [2023-12-27 22:58:01,703][106225] Updated weights for policy 1, policy_version 519913 (0.0006) [2023-12-27 22:58:02,185][106226] Updated weights for policy 0, policy_version 518651 (0.0007) [2023-12-27 22:58:02,243][106226] Updated weights for policy 0, policy_version 518661 (0.0006) [2023-12-27 22:58:02,310][106226] Updated weights for policy 0, policy_version 518671 (0.0009) [2023-12-27 22:58:02,520][106225] Updated weights for policy 1, policy_version 519923 (0.0008) [2023-12-27 22:58:02,575][106225] Updated weights for policy 1, policy_version 519933 (0.0009) [2023-12-27 22:58:02,634][106225] Updated weights for policy 1, policy_version 519943 (0.0008) [2023-12-27 22:58:02,976][106226] Updated weights for policy 0, policy_version 518681 (0.0008) [2023-12-27 22:58:03,033][106226] Updated weights for policy 0, policy_version 518691 (0.0010) [2023-12-27 22:58:03,090][106226] Updated weights for policy 0, policy_version 518701 (0.0010) [2023-12-27 22:58:03,146][106226] Updated weights for policy 0, policy_version 518711 (0.0010) [2023-12-27 22:58:03,357][106225] Updated weights for policy 1, policy_version 519953 (0.0009) [2023-12-27 22:58:03,403][106225] Updated weights for policy 1, policy_version 519963 (0.0010) [2023-12-27 22:58:03,453][106225] Updated weights for policy 1, policy_version 519973 (0.0010) [2023-12-27 22:58:03,506][106225] Updated weights for policy 1, policy_version 519983 (0.0010) [2023-12-27 22:58:03,863][106226] Updated weights for policy 0, policy_version 518721 (0.0011) [2023-12-27 22:58:03,928][106226] Updated weights for policy 0, policy_version 518731 (0.0011) [2023-12-27 22:58:03,992][106226] Updated weights for policy 0, policy_version 518741 (0.0010) [2023-12-27 22:58:04,238][106225] Updated weights for policy 1, policy_version 519993 (0.0010) [2023-12-27 22:58:04,296][106225] Updated weights for policy 1, policy_version 520003 (0.0010) [2023-12-27 22:58:04,355][106225] Updated weights for policy 1, policy_version 520013 (0.0009) [2023-12-27 22:58:04,662][106226] Updated weights for policy 0, policy_version 518751 (0.0007) [2023-12-27 22:58:04,723][106226] Updated weights for policy 0, policy_version 518761 (0.0005) [2023-12-27 22:58:04,786][106226] Updated weights for policy 0, policy_version 518771 (0.0006) [2023-12-27 22:58:05,099][106225] Updated weights for policy 1, policy_version 520023 (0.0009) [2023-12-27 22:58:05,154][106225] Updated weights for policy 1, policy_version 520033 (0.0006) [2023-12-27 22:58:05,218][106225] Updated weights for policy 1, policy_version 520043 (0.0007) [2023-12-27 22:58:05,438][106226] Updated weights for policy 0, policy_version 518781 (0.0007) [2023-12-27 22:58:05,497][106226] Updated weights for policy 0, policy_version 518791 (0.0008) [2023-12-27 22:58:05,556][106226] Updated weights for policy 0, policy_version 518801 (0.0008) [2023-12-27 22:58:05,887][106225] Updated weights for policy 1, policy_version 520053 (0.0007) [2023-12-27 22:58:05,935][106225] Updated weights for policy 1, policy_version 520063 (0.0010) [2023-12-27 22:58:05,987][106225] Updated weights for policy 1, policy_version 520073 (0.0005) [2023-12-27 22:58:06,146][106226] Updated weights for policy 0, policy_version 518811 (0.0008) [2023-12-27 22:58:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 266018816. Throughput: 0: 10002.9, 1: 9940.3. Samples: 266028504. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:06,175][105115] Avg episode reward: [(0, '-5.340'), (1, '-5.597')] [2023-12-27 22:58:06,211][106226] Updated weights for policy 0, policy_version 518821 (0.0007) [2023-12-27 22:58:06,273][106226] Updated weights for policy 0, policy_version 518831 (0.0008) [2023-12-27 22:58:06,689][106225] Updated weights for policy 1, policy_version 520083 (0.0007) [2023-12-27 22:58:06,743][106225] Updated weights for policy 1, policy_version 520093 (0.0008) [2023-12-27 22:58:06,790][106225] Updated weights for policy 1, policy_version 520103 (0.0009) [2023-12-27 22:58:07,018][106226] Updated weights for policy 0, policy_version 518841 (0.0009) [2023-12-27 22:58:07,066][106226] Updated weights for policy 0, policy_version 518851 (0.0009) [2023-12-27 22:58:07,116][106226] Updated weights for policy 0, policy_version 518861 (0.0008) [2023-12-27 22:58:07,161][106226] Updated weights for policy 0, policy_version 518871 (0.0008) [2023-12-27 22:58:07,491][106225] Updated weights for policy 1, policy_version 520113 (0.0010) [2023-12-27 22:58:07,546][106225] Updated weights for policy 1, policy_version 520123 (0.0009) [2023-12-27 22:58:07,605][106225] Updated weights for policy 1, policy_version 520133 (0.0008) [2023-12-27 22:58:07,663][106225] Updated weights for policy 1, policy_version 520143 (0.0009) [2023-12-27 22:58:07,969][106226] Updated weights for policy 0, policy_version 518881 (0.0008) [2023-12-27 22:58:08,031][106226] Updated weights for policy 0, policy_version 518891 (0.0009) [2023-12-27 22:58:08,079][106226] Updated weights for policy 0, policy_version 518901 (0.0008) [2023-12-27 22:58:08,244][106225] Updated weights for policy 1, policy_version 520153 (0.0006) [2023-12-27 22:58:08,302][106225] Updated weights for policy 1, policy_version 520163 (0.0006) [2023-12-27 22:58:08,371][106225] Updated weights for policy 1, policy_version 520173 (0.0008) [2023-12-27 22:58:08,791][106226] Updated weights for policy 0, policy_version 518911 (0.0009) [2023-12-27 22:58:08,856][106226] Updated weights for policy 0, policy_version 518921 (0.0009) [2023-12-27 22:58:08,916][106226] Updated weights for policy 0, policy_version 518931 (0.0008) [2023-12-27 22:58:08,989][106225] Updated weights for policy 1, policy_version 520183 (0.0009) [2023-12-27 22:58:09,052][106225] Updated weights for policy 1, policy_version 520193 (0.0008) [2023-12-27 22:58:09,114][106225] Updated weights for policy 1, policy_version 520203 (0.0010) [2023-12-27 22:58:09,658][106226] Updated weights for policy 0, policy_version 518941 (0.0008) [2023-12-27 22:58:09,718][106226] Updated weights for policy 0, policy_version 518951 (0.0008) [2023-12-27 22:58:09,781][106226] Updated weights for policy 0, policy_version 518961 (0.0008) [2023-12-27 22:58:09,852][106225] Updated weights for policy 1, policy_version 520213 (0.0007) [2023-12-27 22:58:09,921][106225] Updated weights for policy 1, policy_version 520223 (0.0011) [2023-12-27 22:58:09,986][106225] Updated weights for policy 1, policy_version 520233 (0.0009) [2023-12-27 22:58:10,522][106226] Updated weights for policy 0, policy_version 518971 (0.0008) [2023-12-27 22:58:10,578][106226] Updated weights for policy 0, policy_version 518981 (0.0008) [2023-12-27 22:58:10,633][106226] Updated weights for policy 0, policy_version 518991 (0.0008) [2023-12-27 22:58:10,769][106225] Updated weights for policy 1, policy_version 520243 (0.0009) [2023-12-27 22:58:10,822][106225] Updated weights for policy 1, policy_version 520253 (0.0008) [2023-12-27 22:58:10,874][106225] Updated weights for policy 1, policy_version 520263 (0.0006) [2023-12-27 22:58:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 266117120. Throughput: 0: 10009.1, 1: 9990.3. Samples: 266087744. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:11,175][105115] Avg episode reward: [(0, '-5.078'), (1, '-5.482')] [2023-12-27 22:58:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000519000_132898816.pth... [2023-12-27 22:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000520272_133218304.pth... [2023-12-27 22:58:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000517816_132595712.pth [2023-12-27 22:58:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000519120_132923392.pth [2023-12-27 22:58:11,444][106226] Updated weights for policy 0, policy_version 519001 (0.0007) [2023-12-27 22:58:11,505][106226] Updated weights for policy 0, policy_version 519011 (0.0009) [2023-12-27 22:58:11,569][106226] Updated weights for policy 0, policy_version 519021 (0.0008) [2023-12-27 22:58:11,601][106225] Updated weights for policy 1, policy_version 520273 (0.0006) [2023-12-27 22:58:11,634][106226] Updated weights for policy 0, policy_version 519031 (0.0008) [2023-12-27 22:58:11,678][106225] Updated weights for policy 1, policy_version 520283 (0.0008) [2023-12-27 22:58:11,751][106225] Updated weights for policy 1, policy_version 520293 (0.0008) [2023-12-27 22:58:11,816][106225] Updated weights for policy 1, policy_version 520303 (0.0008) [2023-12-27 22:58:12,379][106226] Updated weights for policy 0, policy_version 519041 (0.0009) [2023-12-27 22:58:12,443][106226] Updated weights for policy 0, policy_version 519051 (0.0008) [2023-12-27 22:58:12,500][106226] Updated weights for policy 0, policy_version 519061 (0.0008) [2023-12-27 22:58:12,623][106225] Updated weights for policy 1, policy_version 520313 (0.0008) [2023-12-27 22:58:12,676][106225] Updated weights for policy 1, policy_version 520323 (0.0008) [2023-12-27 22:58:12,724][106225] Updated weights for policy 1, policy_version 520333 (0.0007) [2023-12-27 22:58:13,219][106226] Updated weights for policy 0, policy_version 519071 (0.0007) [2023-12-27 22:58:13,283][106226] Updated weights for policy 0, policy_version 519081 (0.0008) [2023-12-27 22:58:13,334][106226] Updated weights for policy 0, policy_version 519091 (0.0007) [2023-12-27 22:58:13,419][106225] Updated weights for policy 1, policy_version 520343 (0.0009) [2023-12-27 22:58:13,477][106225] Updated weights for policy 1, policy_version 520353 (0.0009) [2023-12-27 22:58:13,538][106225] Updated weights for policy 1, policy_version 520363 (0.0010) [2023-12-27 22:58:14,040][106226] Updated weights for policy 0, policy_version 519101 (0.0008) [2023-12-27 22:58:14,097][106226] Updated weights for policy 0, policy_version 519111 (0.0007) [2023-12-27 22:58:14,158][106226] Updated weights for policy 0, policy_version 519121 (0.0008) [2023-12-27 22:58:14,248][106225] Updated weights for policy 1, policy_version 520373 (0.0010) [2023-12-27 22:58:14,294][106225] Updated weights for policy 1, policy_version 520383 (0.0010) [2023-12-27 22:58:14,343][106225] Updated weights for policy 1, policy_version 520393 (0.0010) [2023-12-27 22:58:14,798][106226] Updated weights for policy 0, policy_version 519131 (0.0005) [2023-12-27 22:58:14,858][106226] Updated weights for policy 0, policy_version 519141 (0.0009) [2023-12-27 22:58:14,921][106226] Updated weights for policy 0, policy_version 519151 (0.0007) [2023-12-27 22:58:15,071][106225] Updated weights for policy 1, policy_version 520403 (0.0010) [2023-12-27 22:58:15,129][106225] Updated weights for policy 1, policy_version 520413 (0.0011) [2023-12-27 22:58:15,188][106225] Updated weights for policy 1, policy_version 520423 (0.0011) [2023-12-27 22:58:15,577][106226] Updated weights for policy 0, policy_version 519161 (0.0006) [2023-12-27 22:58:15,646][106226] Updated weights for policy 0, policy_version 519171 (0.0006) [2023-12-27 22:58:15,712][106226] Updated weights for policy 0, policy_version 519181 (0.0007) [2023-12-27 22:58:15,762][106226] Updated weights for policy 0, policy_version 519191 (0.0006) [2023-12-27 22:58:15,883][106225] Updated weights for policy 1, policy_version 520433 (0.0011) [2023-12-27 22:58:15,933][106225] Updated weights for policy 1, policy_version 520443 (0.0010) [2023-12-27 22:58:15,986][106225] Updated weights for policy 1, policy_version 520453 (0.0010) [2023-12-27 22:58:16,039][106225] Updated weights for policy 1, policy_version 520463 (0.0010) [2023-12-27 22:58:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 266215424. Throughput: 0: 9963.3, 1: 9820.2. Samples: 266201996. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:16,176][105115] Avg episode reward: [(0, '-5.254'), (1, '-5.452')] [2023-12-27 22:58:16,331][106226] Updated weights for policy 0, policy_version 519201 (0.0008) [2023-12-27 22:58:16,384][106226] Updated weights for policy 0, policy_version 519211 (0.0008) [2023-12-27 22:58:16,443][106226] Updated weights for policy 0, policy_version 519221 (0.0007) [2023-12-27 22:58:16,718][106225] Updated weights for policy 1, policy_version 520473 (0.0006) [2023-12-27 22:58:16,792][106225] Updated weights for policy 1, policy_version 520483 (0.0005) [2023-12-27 22:58:16,854][106225] Updated weights for policy 1, policy_version 520493 (0.0008) [2023-12-27 22:58:17,071][106226] Updated weights for policy 0, policy_version 519231 (0.0005) [2023-12-27 22:58:17,131][106226] Updated weights for policy 0, policy_version 519241 (0.0007) [2023-12-27 22:58:17,191][106226] Updated weights for policy 0, policy_version 519251 (0.0007) [2023-12-27 22:58:17,432][106225] Updated weights for policy 1, policy_version 520503 (0.0010) [2023-12-27 22:58:17,497][106225] Updated weights for policy 1, policy_version 520513 (0.0010) [2023-12-27 22:58:17,546][106225] Updated weights for policy 1, policy_version 520523 (0.0007) [2023-12-27 22:58:17,926][106226] Updated weights for policy 0, policy_version 519261 (0.0007) [2023-12-27 22:58:17,979][106226] Updated weights for policy 0, policy_version 519271 (0.0009) [2023-12-27 22:58:18,042][106226] Updated weights for policy 0, policy_version 519281 (0.0008) [2023-12-27 22:58:18,227][106225] Updated weights for policy 1, policy_version 520533 (0.0010) [2023-12-27 22:58:18,294][106225] Updated weights for policy 1, policy_version 520543 (0.0010) [2023-12-27 22:58:18,361][106225] Updated weights for policy 1, policy_version 520553 (0.0009) [2023-12-27 22:58:18,835][106226] Updated weights for policy 0, policy_version 519291 (0.0008) [2023-12-27 22:58:18,899][106226] Updated weights for policy 0, policy_version 519301 (0.0008) [2023-12-27 22:58:18,954][106226] Updated weights for policy 0, policy_version 519311 (0.0008) [2023-12-27 22:58:19,052][106225] Updated weights for policy 1, policy_version 520563 (0.0010) [2023-12-27 22:58:19,113][106225] Updated weights for policy 1, policy_version 520573 (0.0010) [2023-12-27 22:58:19,173][106225] Updated weights for policy 1, policy_version 520583 (0.0010) [2023-12-27 22:58:19,757][106226] Updated weights for policy 0, policy_version 519321 (0.0007) [2023-12-27 22:58:19,813][106226] Updated weights for policy 0, policy_version 519331 (0.0008) [2023-12-27 22:58:19,883][106226] Updated weights for policy 0, policy_version 519341 (0.0008) [2023-12-27 22:58:19,937][106225] Updated weights for policy 1, policy_version 520593 (0.0010) [2023-12-27 22:58:19,951][106226] Updated weights for policy 0, policy_version 519351 (0.0008) [2023-12-27 22:58:19,997][106225] Updated weights for policy 1, policy_version 520603 (0.0009) [2023-12-27 22:58:20,058][106225] Updated weights for policy 1, policy_version 520613 (0.0009) [2023-12-27 22:58:20,111][106225] Updated weights for policy 1, policy_version 520623 (0.0009) [2023-12-27 22:58:20,699][106226] Updated weights for policy 0, policy_version 519361 (0.0008) [2023-12-27 22:58:20,764][106226] Updated weights for policy 0, policy_version 519371 (0.0008) [2023-12-27 22:58:20,821][106226] Updated weights for policy 0, policy_version 519381 (0.0008) [2023-12-27 22:58:20,897][106225] Updated weights for policy 1, policy_version 520633 (0.0010) [2023-12-27 22:58:20,962][106225] Updated weights for policy 1, policy_version 520643 (0.0009) [2023-12-27 22:58:21,030][106225] Updated weights for policy 1, policy_version 520653 (0.0008) [2023-12-27 22:58:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 266313728. Throughput: 0: 9940.9, 1: 9769.4. Samples: 266320268. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:21,175][105115] Avg episode reward: [(0, '-5.455'), (1, '-5.408')] [2023-12-27 22:58:21,552][106226] Updated weights for policy 0, policy_version 519391 (0.0008) [2023-12-27 22:58:21,600][106226] Updated weights for policy 0, policy_version 519401 (0.0008) [2023-12-27 22:58:21,665][106226] Updated weights for policy 0, policy_version 519411 (0.0007) [2023-12-27 22:58:21,818][106225] Updated weights for policy 1, policy_version 520663 (0.0008) [2023-12-27 22:58:21,872][106225] Updated weights for policy 1, policy_version 520673 (0.0008) [2023-12-27 22:58:21,934][106225] Updated weights for policy 1, policy_version 520683 (0.0010) [2023-12-27 22:58:22,392][106226] Updated weights for policy 0, policy_version 519421 (0.0007) [2023-12-27 22:58:22,451][106226] Updated weights for policy 0, policy_version 519431 (0.0007) [2023-12-27 22:58:22,514][106226] Updated weights for policy 0, policy_version 519441 (0.0006) [2023-12-27 22:58:22,655][106225] Updated weights for policy 1, policy_version 520693 (0.0010) [2023-12-27 22:58:22,713][106225] Updated weights for policy 1, policy_version 520703 (0.0010) [2023-12-27 22:58:22,774][106225] Updated weights for policy 1, policy_version 520713 (0.0010) [2023-12-27 22:58:23,268][106226] Updated weights for policy 0, policy_version 519451 (0.0008) [2023-12-27 22:58:23,332][106226] Updated weights for policy 0, policy_version 519461 (0.0007) [2023-12-27 22:58:23,388][106226] Updated weights for policy 0, policy_version 519471 (0.0007) [2023-12-27 22:58:23,406][106225] Updated weights for policy 1, policy_version 520723 (0.0009) [2023-12-27 22:58:23,466][106225] Updated weights for policy 1, policy_version 520733 (0.0005) [2023-12-27 22:58:23,531][106225] Updated weights for policy 1, policy_version 520743 (0.0005) [2023-12-27 22:58:24,072][106226] Updated weights for policy 0, policy_version 519481 (0.0011) [2023-12-27 22:58:24,129][106225] Updated weights for policy 1, policy_version 520753 (0.0005) [2023-12-27 22:58:24,130][106226] Updated weights for policy 0, policy_version 519491 (0.0009) [2023-12-27 22:58:24,190][106225] Updated weights for policy 1, policy_version 520763 (0.0007) [2023-12-27 22:58:24,192][106226] Updated weights for policy 0, policy_version 519501 (0.0010) [2023-12-27 22:58:24,241][106225] Updated weights for policy 1, policy_version 520773 (0.0005) [2023-12-27 22:58:24,260][106226] Updated weights for policy 0, policy_version 519511 (0.0011) [2023-12-27 22:58:24,293][106225] Updated weights for policy 1, policy_version 520783 (0.0005) [2023-12-27 22:58:24,940][106226] Updated weights for policy 0, policy_version 519521 (0.0011) [2023-12-27 22:58:24,969][106225] Updated weights for policy 1, policy_version 520793 (0.0007) [2023-12-27 22:58:24,999][106226] Updated weights for policy 0, policy_version 519531 (0.0005) [2023-12-27 22:58:25,024][106225] Updated weights for policy 1, policy_version 520803 (0.0007) [2023-12-27 22:58:25,048][106226] Updated weights for policy 0, policy_version 519541 (0.0009) [2023-12-27 22:58:25,081][106225] Updated weights for policy 1, policy_version 520813 (0.0008) [2023-12-27 22:58:25,597][106226] Updated weights for policy 0, policy_version 519551 (0.0005) [2023-12-27 22:58:25,645][106226] Updated weights for policy 0, policy_version 519561 (0.0005) [2023-12-27 22:58:25,702][106226] Updated weights for policy 0, policy_version 519571 (0.0010) [2023-12-27 22:58:25,900][106225] Updated weights for policy 1, policy_version 520823 (0.0009) [2023-12-27 22:58:25,954][106225] Updated weights for policy 1, policy_version 520833 (0.0008) [2023-12-27 22:58:26,009][106225] Updated weights for policy 1, policy_version 520843 (0.0007) [2023-12-27 22:58:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 266412032. Throughput: 0: 9917.4, 1: 9734.1. Samples: 266378880. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:26,175][105115] Avg episode reward: [(0, '-5.121'), (1, '-5.664')] [2023-12-27 22:58:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000519576_133046272.pth... [2023-12-27 22:58:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000520848_133365760.pth... [2023-12-27 22:58:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000519728_133079040.pth [2023-12-27 22:58:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000518424_132751360.pth [2023-12-27 22:58:26,355][106226] Updated weights for policy 0, policy_version 519581 (0.0008) [2023-12-27 22:58:26,422][106226] Updated weights for policy 0, policy_version 519591 (0.0005) [2023-12-27 22:58:26,490][106226] Updated weights for policy 0, policy_version 519601 (0.0008) [2023-12-27 22:58:26,800][106225] Updated weights for policy 1, policy_version 520853 (0.0006) [2023-12-27 22:58:26,856][106225] Updated weights for policy 1, policy_version 520863 (0.0007) [2023-12-27 22:58:26,909][106225] Updated weights for policy 1, policy_version 520873 (0.0008) [2023-12-27 22:58:27,004][106226] Updated weights for policy 0, policy_version 519611 (0.0009) [2023-12-27 22:58:27,073][106226] Updated weights for policy 0, policy_version 519621 (0.0006) [2023-12-27 22:58:27,123][106226] Updated weights for policy 0, policy_version 519631 (0.0005) [2023-12-27 22:58:27,582][106225] Updated weights for policy 1, policy_version 520884 (0.0008) [2023-12-27 22:58:27,642][106225] Updated weights for policy 1, policy_version 520894 (0.0005) [2023-12-27 22:58:27,705][106225] Updated weights for policy 1, policy_version 520904 (0.0005) [2023-12-27 22:58:27,751][106226] Updated weights for policy 0, policy_version 519641 (0.0006) [2023-12-27 22:58:27,811][106226] Updated weights for policy 0, policy_version 519651 (0.0007) [2023-12-27 22:58:27,873][106226] Updated weights for policy 0, policy_version 519661 (0.0005) [2023-12-27 22:58:27,934][106226] Updated weights for policy 0, policy_version 519671 (0.0006) [2023-12-27 22:58:28,318][106225] Updated weights for policy 1, policy_version 520914 (0.0007) [2023-12-27 22:58:28,381][106225] Updated weights for policy 1, policy_version 520924 (0.0008) [2023-12-27 22:58:28,444][106225] Updated weights for policy 1, policy_version 520934 (0.0008) [2023-12-27 22:58:28,493][106225] Updated weights for policy 1, policy_version 520944 (0.0008) [2023-12-27 22:58:28,613][106226] Updated weights for policy 0, policy_version 519681 (0.0009) [2023-12-27 22:58:28,670][106226] Updated weights for policy 0, policy_version 519691 (0.0009) [2023-12-27 22:58:28,727][106226] Updated weights for policy 0, policy_version 519701 (0.0008) [2023-12-27 22:58:29,240][106225] Updated weights for policy 1, policy_version 520954 (0.0008) [2023-12-27 22:58:29,310][106225] Updated weights for policy 1, policy_version 520964 (0.0008) [2023-12-27 22:58:29,383][106225] Updated weights for policy 1, policy_version 520974 (0.0008) [2023-12-27 22:58:29,472][106226] Updated weights for policy 0, policy_version 519711 (0.0007) [2023-12-27 22:58:29,534][106226] Updated weights for policy 0, policy_version 519721 (0.0007) [2023-12-27 22:58:29,589][106226] Updated weights for policy 0, policy_version 519731 (0.0009) [2023-12-27 22:58:30,102][106225] Updated weights for policy 1, policy_version 520984 (0.0008) [2023-12-27 22:58:30,162][106225] Updated weights for policy 1, policy_version 520994 (0.0008) [2023-12-27 22:58:30,212][106225] Updated weights for policy 1, policy_version 521004 (0.0009) [2023-12-27 22:58:30,289][106226] Updated weights for policy 0, policy_version 519741 (0.0007) [2023-12-27 22:58:30,337][106226] Updated weights for policy 0, policy_version 519751 (0.0008) [2023-12-27 22:58:30,396][106226] Updated weights for policy 0, policy_version 519761 (0.0009) [2023-12-27 22:58:30,902][106225] Updated weights for policy 1, policy_version 521014 (0.0008) [2023-12-27 22:58:30,950][106225] Updated weights for policy 1, policy_version 521024 (0.0008) [2023-12-27 22:58:30,985][106226] Updated weights for policy 0, policy_version 519771 (0.0008) [2023-12-27 22:58:30,998][106225] Updated weights for policy 1, policy_version 521034 (0.0010) [2023-12-27 22:58:31,068][106226] Updated weights for policy 0, policy_version 519781 (0.0008) [2023-12-27 22:58:31,142][106226] Updated weights for policy 0, policy_version 519791 (0.0006) [2023-12-27 22:58:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 266510336. Throughput: 0: 10040.2, 1: 9673.5. Samples: 266500764. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:31,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-5.737')] [2023-12-27 22:58:31,710][106225] Updated weights for policy 1, policy_version 521044 (0.0009) [2023-12-27 22:58:31,777][106225] Updated weights for policy 1, policy_version 521054 (0.0008) [2023-12-27 22:58:31,822][106225] Updated weights for policy 1, policy_version 521064 (0.0008) [2023-12-27 22:58:31,922][106226] Updated weights for policy 0, policy_version 519801 (0.0009) [2023-12-27 22:58:31,971][106226] Updated weights for policy 0, policy_version 519811 (0.0008) [2023-12-27 22:58:32,025][106226] Updated weights for policy 0, policy_version 519821 (0.0009) [2023-12-27 22:58:32,092][106226] Updated weights for policy 0, policy_version 519831 (0.0008) [2023-12-27 22:58:32,502][106225] Updated weights for policy 1, policy_version 521074 (0.0008) [2023-12-27 22:58:32,557][106225] Updated weights for policy 1, policy_version 521084 (0.0005) [2023-12-27 22:58:32,608][106225] Updated weights for policy 1, policy_version 521094 (0.0005) [2023-12-27 22:58:32,681][106225] Updated weights for policy 1, policy_version 521104 (0.0010) [2023-12-27 22:58:32,787][106226] Updated weights for policy 0, policy_version 519841 (0.0006) [2023-12-27 22:58:32,846][106226] Updated weights for policy 0, policy_version 519851 (0.0006) [2023-12-27 22:58:32,903][106226] Updated weights for policy 0, policy_version 519861 (0.0006) [2023-12-27 22:58:33,267][106225] Updated weights for policy 1, policy_version 521114 (0.0007) [2023-12-27 22:58:33,331][106225] Updated weights for policy 1, policy_version 521124 (0.0005) [2023-12-27 22:58:33,384][106225] Updated weights for policy 1, policy_version 521134 (0.0005) [2023-12-27 22:58:33,514][106226] Updated weights for policy 0, policy_version 519871 (0.0007) [2023-12-27 22:58:33,565][106226] Updated weights for policy 0, policy_version 519881 (0.0008) [2023-12-27 22:58:33,616][106226] Updated weights for policy 0, policy_version 519891 (0.0009) [2023-12-27 22:58:33,897][106225] Updated weights for policy 1, policy_version 521144 (0.0005) [2023-12-27 22:58:33,955][106225] Updated weights for policy 1, policy_version 521154 (0.0005) [2023-12-27 22:58:34,011][106225] Updated weights for policy 1, policy_version 521164 (0.0005) [2023-12-27 22:58:34,442][106226] Updated weights for policy 0, policy_version 519901 (0.0010) [2023-12-27 22:58:34,507][106226] Updated weights for policy 0, policy_version 519911 (0.0011) [2023-12-27 22:58:34,568][106226] Updated weights for policy 0, policy_version 519921 (0.0011) [2023-12-27 22:58:34,610][106225] Updated weights for policy 1, policy_version 521174 (0.0006) [2023-12-27 22:58:34,664][106225] Updated weights for policy 1, policy_version 521184 (0.0008) [2023-12-27 22:58:34,719][106225] Updated weights for policy 1, policy_version 521194 (0.0007) [2023-12-27 22:58:35,171][106226] Updated weights for policy 0, policy_version 519931 (0.0011) [2023-12-27 22:58:35,229][106226] Updated weights for policy 0, policy_version 519941 (0.0009) [2023-12-27 22:58:35,282][106226] Updated weights for policy 0, policy_version 519951 (0.0011) [2023-12-27 22:58:35,392][106225] Updated weights for policy 1, policy_version 521204 (0.0008) [2023-12-27 22:58:35,458][106225] Updated weights for policy 1, policy_version 521214 (0.0008) [2023-12-27 22:58:35,520][106225] Updated weights for policy 1, policy_version 521224 (0.0008) [2023-12-27 22:58:35,980][106226] Updated weights for policy 0, policy_version 519961 (0.0010) [2023-12-27 22:58:36,035][106226] Updated weights for policy 0, policy_version 519971 (0.0005) [2023-12-27 22:58:36,084][106226] Updated weights for policy 0, policy_version 519981 (0.0005) [2023-12-27 22:58:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 266616832. Throughput: 0: 10030.0, 1: 9798.7. Samples: 266625712. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:36,175][105115] Avg episode reward: [(0, '-5.152'), (1, '-5.468')] [2023-12-27 22:58:36,187][106225] Updated weights for policy 1, policy_version 521234 (0.0009) [2023-12-27 22:58:36,249][106225] Updated weights for policy 1, policy_version 521244 (0.0009) [2023-12-27 22:58:36,312][106225] Updated weights for policy 1, policy_version 521254 (0.0008) [2023-12-27 22:58:36,375][106225] Updated weights for policy 1, policy_version 521264 (0.0008) [2023-12-27 22:58:36,744][106226] Updated weights for policy 0, policy_version 519995 (0.0008) [2023-12-27 22:58:36,802][106226] Updated weights for policy 0, policy_version 520005 (0.0011) [2023-12-27 22:58:36,856][106226] Updated weights for policy 0, policy_version 520015 (0.0010) [2023-12-27 22:58:37,156][106225] Updated weights for policy 1, policy_version 521274 (0.0007) [2023-12-27 22:58:37,209][106225] Updated weights for policy 1, policy_version 521284 (0.0005) [2023-12-27 22:58:37,255][106225] Updated weights for policy 1, policy_version 521294 (0.0005) [2023-12-27 22:58:37,573][106226] Updated weights for policy 0, policy_version 520025 (0.0010) [2023-12-27 22:58:37,630][106226] Updated weights for policy 0, policy_version 520035 (0.0010) [2023-12-27 22:58:37,693][106226] Updated weights for policy 0, policy_version 520045 (0.0010) [2023-12-27 22:58:37,743][106226] Updated weights for policy 0, policy_version 520055 (0.0008) [2023-12-27 22:58:37,819][106225] Updated weights for policy 1, policy_version 521304 (0.0005) [2023-12-27 22:58:37,871][106225] Updated weights for policy 1, policy_version 521314 (0.0007) [2023-12-27 22:58:37,932][106225] Updated weights for policy 1, policy_version 521324 (0.0008) [2023-12-27 22:58:38,447][106226] Updated weights for policy 0, policy_version 520065 (0.0006) [2023-12-27 22:58:38,517][106226] Updated weights for policy 0, policy_version 520075 (0.0006) [2023-12-27 22:58:38,574][106226] Updated weights for policy 0, policy_version 520085 (0.0009) [2023-12-27 22:58:38,681][106225] Updated weights for policy 1, policy_version 521334 (0.0008) [2023-12-27 22:58:38,745][106225] Updated weights for policy 1, policy_version 521344 (0.0009) [2023-12-27 22:58:38,802][106225] Updated weights for policy 1, policy_version 521354 (0.0009) [2023-12-27 22:58:39,213][106226] Updated weights for policy 0, policy_version 520095 (0.0010) [2023-12-27 22:58:39,279][106226] Updated weights for policy 0, policy_version 520105 (0.0008) [2023-12-27 22:58:39,342][106226] Updated weights for policy 0, policy_version 520115 (0.0008) [2023-12-27 22:58:39,608][106225] Updated weights for policy 1, policy_version 521364 (0.0008) [2023-12-27 22:58:39,669][106225] Updated weights for policy 1, policy_version 521374 (0.0008) [2023-12-27 22:58:39,729][106225] Updated weights for policy 1, policy_version 521384 (0.0009) [2023-12-27 22:58:40,078][106226] Updated weights for policy 0, policy_version 520125 (0.0009) [2023-12-27 22:58:40,132][106226] Updated weights for policy 0, policy_version 520135 (0.0008) [2023-12-27 22:58:40,186][106226] Updated weights for policy 0, policy_version 520145 (0.0009) [2023-12-27 22:58:40,473][106225] Updated weights for policy 1, policy_version 521394 (0.0009) [2023-12-27 22:58:40,521][106225] Updated weights for policy 1, policy_version 521404 (0.0008) [2023-12-27 22:58:40,569][106225] Updated weights for policy 1, policy_version 521414 (0.0005) [2023-12-27 22:58:40,623][106225] Updated weights for policy 1, policy_version 521424 (0.0005) [2023-12-27 22:58:40,890][106226] Updated weights for policy 0, policy_version 520155 (0.0008) [2023-12-27 22:58:40,945][106226] Updated weights for policy 0, policy_version 520165 (0.0005) [2023-12-27 22:58:40,994][106226] Updated weights for policy 0, policy_version 520175 (0.0006) [2023-12-27 22:58:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 266715136. Throughput: 0: 10043.4, 1: 9833.6. Samples: 266686128. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:41,175][105115] Avg episode reward: [(0, '-5.619'), (1, '-5.445')] [2023-12-27 22:58:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000521424_133513216.pth... [2023-12-27 22:58:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000520184_133201920.pth... [2023-12-27 22:58:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000519000_132898816.pth [2023-12-27 22:58:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000520272_133218304.pth [2023-12-27 22:58:41,268][106225] Updated weights for policy 1, policy_version 521434 (0.0009) [2023-12-27 22:58:41,329][106225] Updated weights for policy 1, policy_version 521444 (0.0009) [2023-12-27 22:58:41,409][106225] Updated weights for policy 1, policy_version 521454 (0.0008) [2023-12-27 22:58:41,805][106226] Updated weights for policy 0, policy_version 520185 (0.0009) [2023-12-27 22:58:41,871][106226] Updated weights for policy 0, policy_version 520195 (0.0008) [2023-12-27 22:58:41,931][106226] Updated weights for policy 0, policy_version 520205 (0.0008) [2023-12-27 22:58:41,990][106226] Updated weights for policy 0, policy_version 520215 (0.0008) [2023-12-27 22:58:42,170][106225] Updated weights for policy 1, policy_version 521464 (0.0009) [2023-12-27 22:58:42,228][106225] Updated weights for policy 1, policy_version 521474 (0.0009) [2023-12-27 22:58:42,290][106225] Updated weights for policy 1, policy_version 521484 (0.0009) [2023-12-27 22:58:42,769][106226] Updated weights for policy 0, policy_version 520225 (0.0009) [2023-12-27 22:58:42,822][106226] Updated weights for policy 0, policy_version 520235 (0.0009) [2023-12-27 22:58:42,879][106226] Updated weights for policy 0, policy_version 520245 (0.0005) [2023-12-27 22:58:43,051][106225] Updated weights for policy 1, policy_version 521494 (0.0007) [2023-12-27 22:58:43,099][106225] Updated weights for policy 1, policy_version 521504 (0.0009) [2023-12-27 22:58:43,148][106225] Updated weights for policy 1, policy_version 521514 (0.0008) [2023-12-27 22:58:43,537][106226] Updated weights for policy 0, policy_version 520255 (0.0007) [2023-12-27 22:58:43,594][106226] Updated weights for policy 0, policy_version 520265 (0.0007) [2023-12-27 22:58:43,651][106226] Updated weights for policy 0, policy_version 520275 (0.0009) [2023-12-27 22:58:43,823][106225] Updated weights for policy 1, policy_version 521524 (0.0006) [2023-12-27 22:58:43,876][106225] Updated weights for policy 1, policy_version 521534 (0.0005) [2023-12-27 22:58:43,928][106225] Updated weights for policy 1, policy_version 521544 (0.0008) [2023-12-27 22:58:44,258][106226] Updated weights for policy 0, policy_version 520285 (0.0007) [2023-12-27 22:58:44,322][106226] Updated weights for policy 0, policy_version 520295 (0.0008) [2023-12-27 22:58:44,382][106226] Updated weights for policy 0, policy_version 520305 (0.0008) [2023-12-27 22:58:44,613][106225] Updated weights for policy 1, policy_version 521554 (0.0008) [2023-12-27 22:58:44,679][106225] Updated weights for policy 1, policy_version 521564 (0.0010) [2023-12-27 22:58:44,748][106225] Updated weights for policy 1, policy_version 521574 (0.0008) [2023-12-27 22:58:44,813][106225] Updated weights for policy 1, policy_version 521584 (0.0010) [2023-12-27 22:58:45,048][106226] Updated weights for policy 0, policy_version 520315 (0.0009) [2023-12-27 22:58:45,113][106226] Updated weights for policy 0, policy_version 520325 (0.0010) [2023-12-27 22:58:45,176][106226] Updated weights for policy 0, policy_version 520335 (0.0010) [2023-12-27 22:58:45,501][106225] Updated weights for policy 1, policy_version 521594 (0.0010) [2023-12-27 22:58:45,560][106225] Updated weights for policy 1, policy_version 521604 (0.0010) [2023-12-27 22:58:45,620][106225] Updated weights for policy 1, policy_version 521614 (0.0010) [2023-12-27 22:58:45,882][106226] Updated weights for policy 0, policy_version 520345 (0.0011) [2023-12-27 22:58:45,946][106226] Updated weights for policy 0, policy_version 520355 (0.0010) [2023-12-27 22:58:45,999][106226] Updated weights for policy 0, policy_version 520365 (0.0007) [2023-12-27 22:58:46,046][106226] Updated weights for policy 0, policy_version 520375 (0.0005) [2023-12-27 22:58:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 266813440. Throughput: 0: 10008.4, 1: 9892.1. Samples: 266803040. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:46,175][105115] Avg episode reward: [(0, '-5.471'), (1, '-5.803')] [2023-12-27 22:58:46,342][106225] Updated weights for policy 1, policy_version 521624 (0.0010) [2023-12-27 22:58:46,392][106225] Updated weights for policy 1, policy_version 521634 (0.0010) [2023-12-27 22:58:46,456][106225] Updated weights for policy 1, policy_version 521644 (0.0010) [2023-12-27 22:58:46,752][106226] Updated weights for policy 0, policy_version 520385 (0.0010) [2023-12-27 22:58:46,798][106226] Updated weights for policy 0, policy_version 520395 (0.0010) [2023-12-27 22:58:46,855][106226] Updated weights for policy 0, policy_version 520405 (0.0010) [2023-12-27 22:58:47,093][106225] Updated weights for policy 1, policy_version 521654 (0.0006) [2023-12-27 22:58:47,144][106225] Updated weights for policy 1, policy_version 521664 (0.0007) [2023-12-27 22:58:47,192][106225] Updated weights for policy 1, policy_version 521674 (0.0008) [2023-12-27 22:58:47,576][106226] Updated weights for policy 0, policy_version 520415 (0.0011) [2023-12-27 22:58:47,632][106226] Updated weights for policy 0, policy_version 520425 (0.0010) [2023-12-27 22:58:47,694][106226] Updated weights for policy 0, policy_version 520435 (0.0010) [2023-12-27 22:58:47,833][106225] Updated weights for policy 1, policy_version 521684 (0.0009) [2023-12-27 22:58:47,895][106225] Updated weights for policy 1, policy_version 521694 (0.0008) [2023-12-27 22:58:47,951][106225] Updated weights for policy 1, policy_version 521704 (0.0010) [2023-12-27 22:58:48,305][106226] Updated weights for policy 0, policy_version 520445 (0.0011) [2023-12-27 22:58:48,379][106226] Updated weights for policy 0, policy_version 520455 (0.0008) [2023-12-27 22:58:48,438][106226] Updated weights for policy 0, policy_version 520465 (0.0008) [2023-12-27 22:58:48,659][106225] Updated weights for policy 1, policy_version 521714 (0.0010) [2023-12-27 22:58:48,714][106225] Updated weights for policy 1, policy_version 521724 (0.0010) [2023-12-27 22:58:48,779][106225] Updated weights for policy 1, policy_version 521734 (0.0011) [2023-12-27 22:58:48,837][106225] Updated weights for policy 1, policy_version 521744 (0.0010) [2023-12-27 22:58:49,180][106226] Updated weights for policy 0, policy_version 520475 (0.0009) [2023-12-27 22:58:49,258][106226] Updated weights for policy 0, policy_version 520485 (0.0010) [2023-12-27 22:58:49,320][106226] Updated weights for policy 0, policy_version 520495 (0.0008) [2023-12-27 22:58:49,622][106225] Updated weights for policy 1, policy_version 521754 (0.0008) [2023-12-27 22:58:49,689][106225] Updated weights for policy 1, policy_version 521764 (0.0008) [2023-12-27 22:58:49,756][106225] Updated weights for policy 1, policy_version 521774 (0.0009) [2023-12-27 22:58:49,974][106226] Updated weights for policy 0, policy_version 520505 (0.0008) [2023-12-27 22:58:50,039][106226] Updated weights for policy 0, policy_version 520515 (0.0006) [2023-12-27 22:58:50,091][106226] Updated weights for policy 0, policy_version 520525 (0.0008) [2023-12-27 22:58:50,143][106226] Updated weights for policy 0, policy_version 520535 (0.0008) [2023-12-27 22:58:50,445][106225] Updated weights for policy 1, policy_version 521784 (0.0008) [2023-12-27 22:58:50,498][106225] Updated weights for policy 1, policy_version 521794 (0.0008) [2023-12-27 22:58:50,553][106225] Updated weights for policy 1, policy_version 521804 (0.0009) [2023-12-27 22:58:50,847][106226] Updated weights for policy 0, policy_version 520545 (0.0009) [2023-12-27 22:58:50,908][106226] Updated weights for policy 0, policy_version 520555 (0.0006) [2023-12-27 22:58:50,966][106226] Updated weights for policy 0, policy_version 520565 (0.0009) [2023-12-27 22:58:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 266911744. Throughput: 0: 9905.2, 1: 9917.9. Samples: 266920540. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:51,175][105115] Avg episode reward: [(0, '-5.250'), (1, '-5.123')] [2023-12-27 22:58:51,298][106225] Updated weights for policy 1, policy_version 521814 (0.0009) [2023-12-27 22:58:51,360][106225] Updated weights for policy 1, policy_version 521824 (0.0008) [2023-12-27 22:58:51,435][106225] Updated weights for policy 1, policy_version 521834 (0.0009) [2023-12-27 22:58:51,663][106226] Updated weights for policy 0, policy_version 520575 (0.0008) [2023-12-27 22:58:51,714][106226] Updated weights for policy 0, policy_version 520585 (0.0007) [2023-12-27 22:58:51,783][106226] Updated weights for policy 0, policy_version 520595 (0.0007) [2023-12-27 22:58:52,246][106225] Updated weights for policy 1, policy_version 521844 (0.0010) [2023-12-27 22:58:52,308][106225] Updated weights for policy 1, policy_version 521854 (0.0007) [2023-12-27 22:58:52,372][106225] Updated weights for policy 1, policy_version 521864 (0.0009) [2023-12-27 22:58:52,438][106226] Updated weights for policy 0, policy_version 520605 (0.0008) [2023-12-27 22:58:52,496][106226] Updated weights for policy 0, policy_version 520615 (0.0009) [2023-12-27 22:58:52,553][106226] Updated weights for policy 0, policy_version 520625 (0.0009) [2023-12-27 22:58:53,046][106225] Updated weights for policy 1, policy_version 521874 (0.0008) [2023-12-27 22:58:53,116][106225] Updated weights for policy 1, policy_version 521884 (0.0008) [2023-12-27 22:58:53,188][106225] Updated weights for policy 1, policy_version 521894 (0.0008) [2023-12-27 22:58:53,249][106225] Updated weights for policy 1, policy_version 521904 (0.0008) [2023-12-27 22:58:53,283][106226] Updated weights for policy 0, policy_version 520635 (0.0009) [2023-12-27 22:58:53,342][106226] Updated weights for policy 0, policy_version 520645 (0.0008) [2023-12-27 22:58:53,389][106226] Updated weights for policy 0, policy_version 520655 (0.0009) [2023-12-27 22:58:53,885][106225] Updated weights for policy 1, policy_version 521914 (0.0009) [2023-12-27 22:58:53,934][106225] Updated weights for policy 1, policy_version 521924 (0.0009) [2023-12-27 22:58:53,978][106226] Updated weights for policy 0, policy_version 520665 (0.0008) [2023-12-27 22:58:53,987][106225] Updated weights for policy 1, policy_version 521934 (0.0010) [2023-12-27 22:58:54,032][106226] Updated weights for policy 0, policy_version 520675 (0.0009) [2023-12-27 22:58:54,081][106226] Updated weights for policy 0, policy_version 520686 (0.0009) [2023-12-27 22:58:54,135][106226] Updated weights for policy 0, policy_version 520696 (0.0008) [2023-12-27 22:58:54,627][106225] Updated weights for policy 1, policy_version 521944 (0.0010) [2023-12-27 22:58:54,677][106225] Updated weights for policy 1, policy_version 521954 (0.0010) [2023-12-27 22:58:54,724][106225] Updated weights for policy 1, policy_version 521964 (0.0007) [2023-12-27 22:58:54,850][106226] Updated weights for policy 0, policy_version 520706 (0.0011) [2023-12-27 22:58:54,907][106226] Updated weights for policy 0, policy_version 520716 (0.0010) [2023-12-27 22:58:54,973][106226] Updated weights for policy 0, policy_version 520726 (0.0010) [2023-12-27 22:58:55,464][106225] Updated weights for policy 1, policy_version 521974 (0.0007) [2023-12-27 22:58:55,519][106225] Updated weights for policy 1, policy_version 521984 (0.0008) [2023-12-27 22:58:55,567][106225] Updated weights for policy 1, policy_version 521994 (0.0007) [2023-12-27 22:58:55,593][106226] Updated weights for policy 0, policy_version 520736 (0.0011) [2023-12-27 22:58:55,659][106226] Updated weights for policy 0, policy_version 520746 (0.0011) [2023-12-27 22:58:55,716][106226] Updated weights for policy 0, policy_version 520756 (0.0010) [2023-12-27 22:58:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 267010048. Throughput: 0: 9972.3, 1: 9870.0. Samples: 266980652. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:58:56,176][105115] Avg episode reward: [(0, '-5.003'), (1, '-5.495')] [2023-12-27 22:58:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000520760_133349376.pth... [2023-12-27 22:58:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000522000_133660672.pth... [2023-12-27 22:58:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000519576_133046272.pth [2023-12-27 22:58:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000520848_133365760.pth [2023-12-27 22:58:56,313][106225] Updated weights for policy 1, policy_version 522004 (0.0006) [2023-12-27 22:58:56,376][106225] Updated weights for policy 1, policy_version 522014 (0.0008) [2023-12-27 22:58:56,433][106225] Updated weights for policy 1, policy_version 522024 (0.0007) [2023-12-27 22:58:56,435][106226] Updated weights for policy 0, policy_version 520766 (0.0011) [2023-12-27 22:58:56,491][106226] Updated weights for policy 0, policy_version 520776 (0.0010) [2023-12-27 22:58:56,550][106226] Updated weights for policy 0, policy_version 520786 (0.0010) [2023-12-27 22:58:57,112][106226] Updated weights for policy 0, policy_version 520796 (0.0010) [2023-12-27 22:58:57,151][106225] Updated weights for policy 1, policy_version 522034 (0.0007) [2023-12-27 22:58:57,161][106226] Updated weights for policy 0, policy_version 520806 (0.0010) [2023-12-27 22:58:57,208][106225] Updated weights for policy 1, policy_version 522044 (0.0010) [2023-12-27 22:58:57,210][106226] Updated weights for policy 0, policy_version 520816 (0.0010) [2023-12-27 22:58:57,267][106225] Updated weights for policy 1, policy_version 522054 (0.0010) [2023-12-27 22:58:57,327][106225] Updated weights for policy 1, policy_version 522064 (0.0010) [2023-12-27 22:58:57,836][106226] Updated weights for policy 0, policy_version 520826 (0.0010) [2023-12-27 22:58:57,899][106226] Updated weights for policy 0, policy_version 520836 (0.0011) [2023-12-27 22:58:57,965][106226] Updated weights for policy 0, policy_version 520846 (0.0011) [2023-12-27 22:58:57,976][106225] Updated weights for policy 1, policy_version 522074 (0.0010) [2023-12-27 22:58:58,018][106226] Updated weights for policy 0, policy_version 520856 (0.0010) [2023-12-27 22:58:58,023][106225] Updated weights for policy 1, policy_version 522084 (0.0010) [2023-12-27 22:58:58,073][106225] Updated weights for policy 1, policy_version 522094 (0.0010) [2023-12-27 22:58:58,728][106226] Updated weights for policy 0, policy_version 520866 (0.0007) [2023-12-27 22:58:58,810][106226] Updated weights for policy 0, policy_version 520876 (0.0008) [2023-12-27 22:58:58,845][106225] Updated weights for policy 1, policy_version 522104 (0.0013) [2023-12-27 22:58:58,880][106226] Updated weights for policy 0, policy_version 520886 (0.0008) [2023-12-27 22:58:58,916][106225] Updated weights for policy 1, policy_version 522114 (0.0009) [2023-12-27 22:58:58,984][106225] Updated weights for policy 1, policy_version 522124 (0.0008) [2023-12-27 22:58:59,610][106226] Updated weights for policy 0, policy_version 520896 (0.0006) [2023-12-27 22:58:59,662][106226] Updated weights for policy 0, policy_version 520906 (0.0005) [2023-12-27 22:58:59,714][106226] Updated weights for policy 0, policy_version 520916 (0.0007) [2023-12-27 22:58:59,760][106225] Updated weights for policy 1, policy_version 522134 (0.0008) [2023-12-27 22:58:59,816][106225] Updated weights for policy 1, policy_version 522144 (0.0008) [2023-12-27 22:58:59,888][106225] Updated weights for policy 1, policy_version 522155 (0.0007) [2023-12-27 22:59:00,386][106226] Updated weights for policy 0, policy_version 520926 (0.0008) [2023-12-27 22:59:00,450][106226] Updated weights for policy 0, policy_version 520936 (0.0008) [2023-12-27 22:59:00,512][106226] Updated weights for policy 0, policy_version 520946 (0.0010) [2023-12-27 22:59:00,701][106225] Updated weights for policy 1, policy_version 522165 (0.0008) [2023-12-27 22:59:00,756][106225] Updated weights for policy 1, policy_version 522175 (0.0007) [2023-12-27 22:59:00,808][106225] Updated weights for policy 1, policy_version 522185 (0.0009) [2023-12-27 22:59:01,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 267108352. Throughput: 0: 10070.5, 1: 9889.3. Samples: 267100188. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:59:01,176][105115] Avg episode reward: [(0, '-5.012'), (1, '-5.461')] [2023-12-27 22:59:01,220][106226] Updated weights for policy 0, policy_version 520956 (0.0010) [2023-12-27 22:59:01,285][106226] Updated weights for policy 0, policy_version 520966 (0.0010) [2023-12-27 22:59:01,340][106226] Updated weights for policy 0, policy_version 520976 (0.0010) [2023-12-27 22:59:01,516][106225] Updated weights for policy 1, policy_version 522195 (0.0008) [2023-12-27 22:59:01,575][106225] Updated weights for policy 1, policy_version 522205 (0.0006) [2023-12-27 22:59:01,638][106225] Updated weights for policy 1, policy_version 522215 (0.0008) [2023-12-27 22:59:02,092][106226] Updated weights for policy 0, policy_version 520986 (0.0011) [2023-12-27 22:59:02,147][106226] Updated weights for policy 0, policy_version 520996 (0.0009) [2023-12-27 22:59:02,206][106226] Updated weights for policy 0, policy_version 521006 (0.0010) [2023-12-27 22:59:02,267][106226] Updated weights for policy 0, policy_version 521016 (0.0009) [2023-12-27 22:59:02,303][106225] Updated weights for policy 1, policy_version 522225 (0.0010) [2023-12-27 22:59:02,361][106225] Updated weights for policy 1, policy_version 522235 (0.0010) [2023-12-27 22:59:02,418][106225] Updated weights for policy 1, policy_version 522245 (0.0007) [2023-12-27 22:59:02,476][106225] Updated weights for policy 1, policy_version 522255 (0.0005) [2023-12-27 22:59:03,002][106226] Updated weights for policy 0, policy_version 521026 (0.0005) [2023-12-27 22:59:03,049][106226] Updated weights for policy 0, policy_version 521036 (0.0005) [2023-12-27 22:59:03,097][106226] Updated weights for policy 0, policy_version 521046 (0.0007) [2023-12-27 22:59:03,131][106225] Updated weights for policy 1, policy_version 522265 (0.0006) [2023-12-27 22:59:03,181][106225] Updated weights for policy 1, policy_version 522275 (0.0010) [2023-12-27 22:59:03,238][106225] Updated weights for policy 1, policy_version 522285 (0.0010) [2023-12-27 22:59:03,800][106226] Updated weights for policy 0, policy_version 521056 (0.0010) [2023-12-27 22:59:03,850][106225] Updated weights for policy 1, policy_version 522295 (0.0010) [2023-12-27 22:59:03,878][106226] Updated weights for policy 0, policy_version 521066 (0.0011) [2023-12-27 22:59:03,905][106225] Updated weights for policy 1, policy_version 522305 (0.0010) [2023-12-27 22:59:03,929][106226] Updated weights for policy 0, policy_version 521076 (0.0011) [2023-12-27 22:59:03,960][106225] Updated weights for policy 1, policy_version 522315 (0.0010) [2023-12-27 22:59:04,627][106226] Updated weights for policy 0, policy_version 521086 (0.0008) [2023-12-27 22:59:04,685][106226] Updated weights for policy 0, policy_version 521096 (0.0005) [2023-12-27 22:59:04,729][106225] Updated weights for policy 1, policy_version 522325 (0.0009) [2023-12-27 22:59:04,742][106226] Updated weights for policy 0, policy_version 521106 (0.0005) [2023-12-27 22:59:04,788][106225] Updated weights for policy 1, policy_version 522335 (0.0005) [2023-12-27 22:59:04,839][106225] Updated weights for policy 1, policy_version 522345 (0.0005) [2023-12-27 22:59:05,295][106226] Updated weights for policy 0, policy_version 521116 (0.0006) [2023-12-27 22:59:05,364][106226] Updated weights for policy 0, policy_version 521126 (0.0005) [2023-12-27 22:59:05,426][106226] Updated weights for policy 0, policy_version 521136 (0.0006) [2023-12-27 22:59:05,471][106225] Updated weights for policy 1, policy_version 522355 (0.0007) [2023-12-27 22:59:05,542][106225] Updated weights for policy 1, policy_version 522365 (0.0010) [2023-12-27 22:59:05,602][106225] Updated weights for policy 1, policy_version 522375 (0.0011) [2023-12-27 22:59:06,058][106226] Updated weights for policy 0, policy_version 521146 (0.0008) [2023-12-27 22:59:06,123][106226] Updated weights for policy 0, policy_version 521156 (0.0010) [2023-12-27 22:59:06,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 267206656. Throughput: 0: 10121.9, 1: 9893.2. Samples: 267220944. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-27 22:59:06,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-5.411')] [2023-12-27 22:59:06,187][106226] Updated weights for policy 0, policy_version 521166 (0.0010) [2023-12-27 22:59:06,251][106226] Updated weights for policy 0, policy_version 521176 (0.0010) [2023-12-27 22:59:06,368][106225] Updated weights for policy 1, policy_version 522385 (0.0011) [2023-12-27 22:59:06,433][106225] Updated weights for policy 1, policy_version 522395 (0.0009) [2023-12-27 22:59:06,492][106225] Updated weights for policy 1, policy_version 522405 (0.0009) [2023-12-27 22:59:06,556][106225] Updated weights for policy 1, policy_version 522415 (0.0010) [2023-12-27 22:59:06,862][106226] Updated weights for policy 0, policy_version 521186 (0.0011) [2023-12-27 22:59:06,930][106226] Updated weights for policy 0, policy_version 521196 (0.0009) [2023-12-27 22:59:06,990][106226] Updated weights for policy 0, policy_version 521206 (0.0010) [2023-12-27 22:59:07,336][106225] Updated weights for policy 1, policy_version 522425 (0.0010) [2023-12-27 22:59:07,387][106225] Updated weights for policy 1, policy_version 522435 (0.0010) [2023-12-27 22:59:07,442][106225] Updated weights for policy 1, policy_version 522445 (0.0006) [2023-12-27 22:59:07,603][106226] Updated weights for policy 0, policy_version 521216 (0.0010) [2023-12-27 22:59:07,653][106226] Updated weights for policy 0, policy_version 521226 (0.0010) [2023-12-27 22:59:07,713][106226] Updated weights for policy 0, policy_version 521236 (0.0010) [2023-12-27 22:59:08,110][106225] Updated weights for policy 1, policy_version 522455 (0.0007) [2023-12-27 22:59:08,174][106225] Updated weights for policy 1, policy_version 522465 (0.0008) [2023-12-27 22:59:08,241][106225] Updated weights for policy 1, policy_version 522475 (0.0007) [2023-12-27 22:59:08,429][106226] Updated weights for policy 0, policy_version 521246 (0.0009) [2023-12-27 22:59:08,498][106226] Updated weights for policy 0, policy_version 521256 (0.0006) [2023-12-27 22:59:08,562][106226] Updated weights for policy 0, policy_version 521266 (0.0009) [2023-12-27 22:59:08,892][106225] Updated weights for policy 1, policy_version 522485 (0.0008) [2023-12-27 22:59:08,953][106225] Updated weights for policy 1, policy_version 522495 (0.0010) [2023-12-27 22:59:09,013][106225] Updated weights for policy 1, policy_version 522505 (0.0010) [2023-12-27 22:59:09,235][106226] Updated weights for policy 0, policy_version 521276 (0.0010) [2023-12-27 22:59:09,298][106226] Updated weights for policy 0, policy_version 521286 (0.0010) [2023-12-27 22:59:09,364][106226] Updated weights for policy 0, policy_version 521296 (0.0010) [2023-12-27 22:59:09,798][106225] Updated weights for policy 1, policy_version 522515 (0.0010) [2023-12-27 22:59:09,868][106225] Updated weights for policy 1, policy_version 522525 (0.0008) [2023-12-27 22:59:09,938][106225] Updated weights for policy 1, policy_version 522535 (0.0007) [2023-12-27 22:59:10,092][106226] Updated weights for policy 0, policy_version 521306 (0.0008) [2023-12-27 22:59:10,151][106226] Updated weights for policy 0, policy_version 521316 (0.0008) [2023-12-27 22:59:10,210][106226] Updated weights for policy 0, policy_version 521326 (0.0008) [2023-12-27 22:59:10,272][106226] Updated weights for policy 0, policy_version 521336 (0.0009) [2023-12-27 22:59:10,574][106225] Updated weights for policy 1, policy_version 522545 (0.0007) [2023-12-27 22:59:10,630][106225] Updated weights for policy 1, policy_version 522555 (0.0005) [2023-12-27 22:59:10,694][106225] Updated weights for policy 1, policy_version 522565 (0.0005) [2023-12-27 22:59:10,762][106225] Updated weights for policy 1, policy_version 522575 (0.0005) [2023-12-27 22:59:11,005][106226] Updated weights for policy 0, policy_version 521346 (0.0008) [2023-12-27 22:59:11,067][106226] Updated weights for policy 0, policy_version 521356 (0.0008) [2023-12-27 22:59:11,126][106226] Updated weights for policy 0, policy_version 521366 (0.0008) [2023-12-27 22:59:11,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 267313152. Throughput: 0: 10171.5, 1: 9889.3. Samples: 267281616. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:11,175][105115] Avg episode reward: [(0, '-5.318'), (1, '-5.434')] [2023-12-27 22:59:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000521368_133505024.pth... [2023-12-27 22:59:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000522576_133808128.pth... [2023-12-27 22:59:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000520184_133201920.pth [2023-12-27 22:59:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000521424_133513216.pth [2023-12-27 22:59:11,459][106225] Updated weights for policy 1, policy_version 522585 (0.0008) [2023-12-27 22:59:11,519][106225] Updated weights for policy 1, policy_version 522595 (0.0008) [2023-12-27 22:59:11,582][106225] Updated weights for policy 1, policy_version 522605 (0.0008) [2023-12-27 22:59:11,937][106226] Updated weights for policy 0, policy_version 521376 (0.0009) [2023-12-27 22:59:11,995][106226] Updated weights for policy 0, policy_version 521386 (0.0008) [2023-12-27 22:59:12,049][106226] Updated weights for policy 0, policy_version 521396 (0.0008) [2023-12-27 22:59:12,337][106225] Updated weights for policy 1, policy_version 522615 (0.0008) [2023-12-27 22:59:12,426][106225] Updated weights for policy 1, policy_version 522625 (0.0010) [2023-12-27 22:59:12,490][106225] Updated weights for policy 1, policy_version 522635 (0.0009) [2023-12-27 22:59:12,842][106226] Updated weights for policy 0, policy_version 521406 (0.0009) [2023-12-27 22:59:12,893][106226] Updated weights for policy 0, policy_version 521416 (0.0009) [2023-12-27 22:59:12,943][106226] Updated weights for policy 0, policy_version 521426 (0.0010) [2023-12-27 22:59:13,020][106225] Updated weights for policy 1, policy_version 522645 (0.0009) [2023-12-27 22:59:13,080][106225] Updated weights for policy 1, policy_version 522655 (0.0008) [2023-12-27 22:59:13,139][106225] Updated weights for policy 1, policy_version 522665 (0.0005) [2023-12-27 22:59:13,753][106226] Updated weights for policy 0, policy_version 521436 (0.0008) [2023-12-27 22:59:13,778][106225] Updated weights for policy 1, policy_version 522675 (0.0005) [2023-12-27 22:59:13,812][106226] Updated weights for policy 0, policy_version 521446 (0.0008) [2023-12-27 22:59:13,828][106225] Updated weights for policy 1, policy_version 522685 (0.0006) [2023-12-27 22:59:13,869][106226] Updated weights for policy 0, policy_version 521456 (0.0008) [2023-12-27 22:59:13,879][106225] Updated weights for policy 1, policy_version 522695 (0.0006) [2023-12-27 22:59:14,456][106225] Updated weights for policy 1, policy_version 522705 (0.0009) [2023-12-27 22:59:14,506][106225] Updated weights for policy 1, policy_version 522715 (0.0010) [2023-12-27 22:59:14,560][106225] Updated weights for policy 1, policy_version 522725 (0.0009) [2023-12-27 22:59:14,610][106225] Updated weights for policy 1, policy_version 522735 (0.0005) [2023-12-27 22:59:14,666][106226] Updated weights for policy 0, policy_version 521466 (0.0008) [2023-12-27 22:59:14,716][106226] Updated weights for policy 0, policy_version 521476 (0.0008) [2023-12-27 22:59:14,770][106226] Updated weights for policy 0, policy_version 521486 (0.0008) [2023-12-27 22:59:14,837][106226] Updated weights for policy 0, policy_version 521496 (0.0008) [2023-12-27 22:59:15,389][106225] Updated weights for policy 1, policy_version 522745 (0.0007) [2023-12-27 22:59:15,451][106225] Updated weights for policy 1, policy_version 522755 (0.0008) [2023-12-27 22:59:15,516][106225] Updated weights for policy 1, policy_version 522765 (0.0005) [2023-12-27 22:59:15,594][106226] Updated weights for policy 0, policy_version 521506 (0.0010) [2023-12-27 22:59:15,664][106226] Updated weights for policy 0, policy_version 521516 (0.0010) [2023-12-27 22:59:15,722][106226] Updated weights for policy 0, policy_version 521526 (0.0009) [2023-12-27 22:59:16,118][106225] Updated weights for policy 1, policy_version 522775 (0.0008) [2023-12-27 22:59:16,171][106225] Updated weights for policy 1, policy_version 522785 (0.0009) [2023-12-27 22:59:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 267403264. Throughput: 0: 9966.2, 1: 9956.8. Samples: 267397300. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:16,175][105115] Avg episode reward: [(0, '-5.060'), (1, '-5.297')] [2023-12-27 22:59:16,229][106225] Updated weights for policy 1, policy_version 522795 (0.0006) [2023-12-27 22:59:16,524][106226] Updated weights for policy 0, policy_version 521536 (0.0009) [2023-12-27 22:59:16,575][106226] Updated weights for policy 0, policy_version 521546 (0.0009) [2023-12-27 22:59:16,623][106226] Updated weights for policy 0, policy_version 521556 (0.0009) [2023-12-27 22:59:16,867][106225] Updated weights for policy 1, policy_version 522805 (0.0008) [2023-12-27 22:59:16,919][106225] Updated weights for policy 1, policy_version 522815 (0.0005) [2023-12-27 22:59:16,978][106225] Updated weights for policy 1, policy_version 522825 (0.0005) [2023-12-27 22:59:17,451][106226] Updated weights for policy 0, policy_version 521566 (0.0008) [2023-12-27 22:59:17,509][106226] Updated weights for policy 0, policy_version 521576 (0.0008) [2023-12-27 22:59:17,559][106225] Updated weights for policy 1, policy_version 522835 (0.0005) [2023-12-27 22:59:17,566][106226] Updated weights for policy 0, policy_version 521586 (0.0007) [2023-12-27 22:59:17,617][106225] Updated weights for policy 1, policy_version 522845 (0.0005) [2023-12-27 22:59:17,664][106225] Updated weights for policy 1, policy_version 522855 (0.0005) [2023-12-27 22:59:18,218][106225] Updated weights for policy 1, policy_version 522865 (0.0005) [2023-12-27 22:59:18,276][106226] Updated weights for policy 0, policy_version 521596 (0.0007) [2023-12-27 22:59:18,280][106225] Updated weights for policy 1, policy_version 522875 (0.0005) [2023-12-27 22:59:18,338][106225] Updated weights for policy 1, policy_version 522885 (0.0006) [2023-12-27 22:59:18,343][106226] Updated weights for policy 0, policy_version 521606 (0.0007) [2023-12-27 22:59:18,397][106225] Updated weights for policy 1, policy_version 522895 (0.0008) [2023-12-27 22:59:18,405][106226] Updated weights for policy 0, policy_version 521616 (0.0007) [2023-12-27 22:59:19,022][106226] Updated weights for policy 0, policy_version 521626 (0.0008) [2023-12-27 22:59:19,054][106225] Updated weights for policy 1, policy_version 522905 (0.0006) [2023-12-27 22:59:19,087][106226] Updated weights for policy 0, policy_version 521636 (0.0011) [2023-12-27 22:59:19,108][106225] Updated weights for policy 1, policy_version 522915 (0.0006) [2023-12-27 22:59:19,144][106226] Updated weights for policy 0, policy_version 521646 (0.0010) [2023-12-27 22:59:19,167][106225] Updated weights for policy 1, policy_version 522925 (0.0007) [2023-12-27 22:59:19,208][106226] Updated weights for policy 0, policy_version 521656 (0.0011) [2023-12-27 22:59:19,951][106225] Updated weights for policy 1, policy_version 522935 (0.0008) [2023-12-27 22:59:19,977][106226] Updated weights for policy 0, policy_version 521666 (0.0008) [2023-12-27 22:59:19,999][106225] Updated weights for policy 1, policy_version 522945 (0.0008) [2023-12-27 22:59:20,037][106226] Updated weights for policy 0, policy_version 521676 (0.0008) [2023-12-27 22:59:20,048][106225] Updated weights for policy 1, policy_version 522955 (0.0008) [2023-12-27 22:59:20,096][106226] Updated weights for policy 0, policy_version 521686 (0.0008) [2023-12-27 22:59:20,835][106225] Updated weights for policy 1, policy_version 522965 (0.0009) [2023-12-27 22:59:20,862][106226] Updated weights for policy 0, policy_version 521696 (0.0010) [2023-12-27 22:59:20,899][106225] Updated weights for policy 1, policy_version 522975 (0.0006) [2023-12-27 22:59:20,925][106226] Updated weights for policy 0, policy_version 521706 (0.0011) [2023-12-27 22:59:20,959][106225] Updated weights for policy 1, policy_version 522985 (0.0007) [2023-12-27 22:59:20,987][106226] Updated weights for policy 0, policy_version 521716 (0.0011) [2023-12-27 22:59:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 267509760. Throughput: 0: 9851.1, 1: 9918.8. Samples: 267515360. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:21,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.487')] [2023-12-27 22:59:21,686][106226] Updated weights for policy 0, policy_version 521726 (0.0009) [2023-12-27 22:59:21,754][106226] Updated weights for policy 0, policy_version 521736 (0.0009) [2023-12-27 22:59:21,790][106225] Updated weights for policy 1, policy_version 522995 (0.0007) [2023-12-27 22:59:21,817][106226] Updated weights for policy 0, policy_version 521746 (0.0008) [2023-12-27 22:59:21,853][106225] Updated weights for policy 1, policy_version 523005 (0.0008) [2023-12-27 22:59:21,916][106225] Updated weights for policy 1, policy_version 523015 (0.0008) [2023-12-27 22:59:22,557][106226] Updated weights for policy 0, policy_version 521756 (0.0007) [2023-12-27 22:59:22,618][106226] Updated weights for policy 0, policy_version 521766 (0.0008) [2023-12-27 22:59:22,688][106226] Updated weights for policy 0, policy_version 521776 (0.0006) [2023-12-27 22:59:22,699][106225] Updated weights for policy 1, policy_version 523025 (0.0008) [2023-12-27 22:59:22,764][106225] Updated weights for policy 1, policy_version 523035 (0.0007) [2023-12-27 22:59:22,827][106225] Updated weights for policy 1, policy_version 523045 (0.0006) [2023-12-27 22:59:22,889][106225] Updated weights for policy 1, policy_version 523055 (0.0006) [2023-12-27 22:59:23,437][106226] Updated weights for policy 0, policy_version 521786 (0.0007) [2023-12-27 22:59:23,483][106226] Updated weights for policy 0, policy_version 521796 (0.0007) [2023-12-27 22:59:23,490][106225] Updated weights for policy 1, policy_version 523065 (0.0006) [2023-12-27 22:59:23,531][106226] Updated weights for policy 0, policy_version 521806 (0.0005) [2023-12-27 22:59:23,535][106225] Updated weights for policy 1, policy_version 523075 (0.0008) [2023-12-27 22:59:23,584][106225] Updated weights for policy 1, policy_version 523085 (0.0008) [2023-12-27 22:59:23,589][106226] Updated weights for policy 0, policy_version 521816 (0.0005) [2023-12-27 22:59:24,240][106226] Updated weights for policy 0, policy_version 521826 (0.0009) [2023-12-27 22:59:24,301][106226] Updated weights for policy 0, policy_version 521836 (0.0009) [2023-12-27 22:59:24,306][106225] Updated weights for policy 1, policy_version 523095 (0.0008) [2023-12-27 22:59:24,361][106225] Updated weights for policy 1, policy_version 523105 (0.0006) [2023-12-27 22:59:24,361][106226] Updated weights for policy 0, policy_version 521846 (0.0007) [2023-12-27 22:59:24,416][106225] Updated weights for policy 1, policy_version 523115 (0.0008) [2023-12-27 22:59:25,073][106226] Updated weights for policy 0, policy_version 521856 (0.0008) [2023-12-27 22:59:25,121][106225] Updated weights for policy 1, policy_version 523125 (0.0005) [2023-12-27 22:59:25,123][106226] Updated weights for policy 0, policy_version 521866 (0.0007) [2023-12-27 22:59:25,168][106225] Updated weights for policy 1, policy_version 523135 (0.0008) [2023-12-27 22:59:25,186][106226] Updated weights for policy 0, policy_version 521876 (0.0008) [2023-12-27 22:59:25,220][106225] Updated weights for policy 1, policy_version 523145 (0.0007) [2023-12-27 22:59:25,819][106226] Updated weights for policy 0, policy_version 521886 (0.0009) [2023-12-27 22:59:25,876][106226] Updated weights for policy 0, policy_version 521896 (0.0007) [2023-12-27 22:59:25,937][106226] Updated weights for policy 0, policy_version 521906 (0.0008) [2023-12-27 22:59:25,990][106225] Updated weights for policy 1, policy_version 523155 (0.0008) [2023-12-27 22:59:26,049][106225] Updated weights for policy 1, policy_version 523165 (0.0008) [2023-12-27 22:59:26,111][106225] Updated weights for policy 1, policy_version 523175 (0.0009) [2023-12-27 22:59:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 267608064. Throughput: 0: 9840.0, 1: 9868.4. Samples: 267573004. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:26,175][105115] Avg episode reward: [(0, '-5.173'), (1, '-5.639')] [2023-12-27 22:59:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000523184_133963776.pth... [2023-12-27 22:59:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000521912_133644288.pth... [2023-12-27 22:59:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000520760_133349376.pth [2023-12-27 22:59:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000522000_133660672.pth [2023-12-27 22:59:26,509][106226] Updated weights for policy 0, policy_version 521916 (0.0009) [2023-12-27 22:59:26,572][106226] Updated weights for policy 0, policy_version 521926 (0.0010) [2023-12-27 22:59:26,628][106226] Updated weights for policy 0, policy_version 521936 (0.0010) [2023-12-27 22:59:26,751][106225] Updated weights for policy 1, policy_version 523185 (0.0010) [2023-12-27 22:59:26,800][106225] Updated weights for policy 1, policy_version 523195 (0.0007) [2023-12-27 22:59:26,854][106225] Updated weights for policy 1, policy_version 523205 (0.0005) [2023-12-27 22:59:26,911][106225] Updated weights for policy 1, policy_version 523215 (0.0005) [2023-12-27 22:59:27,221][106226] Updated weights for policy 0, policy_version 521946 (0.0011) [2023-12-27 22:59:27,274][106226] Updated weights for policy 0, policy_version 521956 (0.0010) [2023-12-27 22:59:27,328][106226] Updated weights for policy 0, policy_version 521966 (0.0010) [2023-12-27 22:59:27,382][106226] Updated weights for policy 0, policy_version 521976 (0.0010) [2023-12-27 22:59:27,512][106225] Updated weights for policy 1, policy_version 523225 (0.0010) [2023-12-27 22:59:27,562][106225] Updated weights for policy 1, policy_version 523235 (0.0010) [2023-12-27 22:59:27,631][106225] Updated weights for policy 1, policy_version 523245 (0.0010) [2023-12-27 22:59:28,061][106226] Updated weights for policy 0, policy_version 521986 (0.0009) [2023-12-27 22:59:28,121][106226] Updated weights for policy 0, policy_version 521996 (0.0010) [2023-12-27 22:59:28,182][106226] Updated weights for policy 0, policy_version 522006 (0.0010) [2023-12-27 22:59:28,364][106225] Updated weights for policy 1, policy_version 523255 (0.0008) [2023-12-27 22:59:28,422][106225] Updated weights for policy 1, policy_version 523265 (0.0006) [2023-12-27 22:59:28,486][106225] Updated weights for policy 1, policy_version 523275 (0.0005) [2023-12-27 22:59:28,895][106226] Updated weights for policy 0, policy_version 522016 (0.0011) [2023-12-27 22:59:28,955][106226] Updated weights for policy 0, policy_version 522026 (0.0010) [2023-12-27 22:59:28,999][106225] Updated weights for policy 1, policy_version 523285 (0.0008) [2023-12-27 22:59:29,010][106226] Updated weights for policy 0, policy_version 522036 (0.0010) [2023-12-27 22:59:29,048][106225] Updated weights for policy 1, policy_version 523295 (0.0010) [2023-12-27 22:59:29,097][106225] Updated weights for policy 1, policy_version 523305 (0.0010) [2023-12-27 22:59:29,772][106226] Updated weights for policy 0, policy_version 522046 (0.0009) [2023-12-27 22:59:29,840][106226] Updated weights for policy 0, policy_version 522056 (0.0011) [2023-12-27 22:59:29,842][106225] Updated weights for policy 1, policy_version 523315 (0.0010) [2023-12-27 22:59:29,898][106225] Updated weights for policy 1, policy_version 523325 (0.0009) [2023-12-27 22:59:29,903][106226] Updated weights for policy 0, policy_version 522066 (0.0010) [2023-12-27 22:59:29,961][106225] Updated weights for policy 1, policy_version 523335 (0.0010) [2023-12-27 22:59:30,622][106226] Updated weights for policy 0, policy_version 522076 (0.0009) [2023-12-27 22:59:30,682][106226] Updated weights for policy 0, policy_version 522086 (0.0009) [2023-12-27 22:59:30,691][106225] Updated weights for policy 1, policy_version 523345 (0.0010) [2023-12-27 22:59:30,740][106226] Updated weights for policy 0, policy_version 522096 (0.0005) [2023-12-27 22:59:30,746][106225] Updated weights for policy 1, policy_version 523355 (0.0006) [2023-12-27 22:59:30,809][106225] Updated weights for policy 1, policy_version 523365 (0.0007) [2023-12-27 22:59:30,865][106225] Updated weights for policy 1, policy_version 523375 (0.0008) [2023-12-27 22:59:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 267706368. Throughput: 0: 9892.1, 1: 9965.1. Samples: 267696616. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:31,175][105115] Avg episode reward: [(0, '-4.942'), (1, '-5.268')] [2023-12-27 22:59:31,491][106226] Updated weights for policy 0, policy_version 522106 (0.0007) [2023-12-27 22:59:31,553][106226] Updated weights for policy 0, policy_version 522116 (0.0008) [2023-12-27 22:59:31,606][106225] Updated weights for policy 1, policy_version 523385 (0.0008) [2023-12-27 22:59:31,612][106226] Updated weights for policy 0, policy_version 522126 (0.0008) [2023-12-27 22:59:31,669][106225] Updated weights for policy 1, policy_version 523395 (0.0008) [2023-12-27 22:59:31,673][106226] Updated weights for policy 0, policy_version 522136 (0.0008) [2023-12-27 22:59:31,730][106225] Updated weights for policy 1, policy_version 523405 (0.0007) [2023-12-27 22:59:32,383][106226] Updated weights for policy 0, policy_version 522146 (0.0009) [2023-12-27 22:59:32,444][106226] Updated weights for policy 0, policy_version 522156 (0.0008) [2023-12-27 22:59:32,459][106225] Updated weights for policy 1, policy_version 523415 (0.0007) [2023-12-27 22:59:32,504][106226] Updated weights for policy 0, policy_version 522166 (0.0007) [2023-12-27 22:59:32,525][106225] Updated weights for policy 1, policy_version 523425 (0.0007) [2023-12-27 22:59:32,588][106225] Updated weights for policy 1, policy_version 523435 (0.0009) [2023-12-27 22:59:33,228][106225] Updated weights for policy 1, policy_version 523445 (0.0008) [2023-12-27 22:59:33,260][106226] Updated weights for policy 0, policy_version 522176 (0.0006) [2023-12-27 22:59:33,281][106225] Updated weights for policy 1, policy_version 523455 (0.0009) [2023-12-27 22:59:33,311][106226] Updated weights for policy 0, policy_version 522186 (0.0005) [2023-12-27 22:59:33,336][106225] Updated weights for policy 1, policy_version 523465 (0.0007) [2023-12-27 22:59:33,361][106226] Updated weights for policy 0, policy_version 522196 (0.0005) [2023-12-27 22:59:33,947][106226] Updated weights for policy 0, policy_version 522206 (0.0006) [2023-12-27 22:59:33,996][106226] Updated weights for policy 0, policy_version 522216 (0.0009) [2023-12-27 22:59:34,047][106226] Updated weights for policy 0, policy_version 522226 (0.0005) [2023-12-27 22:59:34,084][106225] Updated weights for policy 1, policy_version 523475 (0.0009) [2023-12-27 22:59:34,154][106225] Updated weights for policy 1, policy_version 523485 (0.0008) [2023-12-27 22:59:34,215][106225] Updated weights for policy 1, policy_version 523495 (0.0007) [2023-12-27 22:59:34,766][106226] Updated weights for policy 0, policy_version 522236 (0.0007) [2023-12-27 22:59:34,824][106226] Updated weights for policy 0, policy_version 522246 (0.0008) [2023-12-27 22:59:34,827][106225] Updated weights for policy 1, policy_version 523505 (0.0006) [2023-12-27 22:59:34,872][106226] Updated weights for policy 0, policy_version 522256 (0.0007) [2023-12-27 22:59:34,878][106225] Updated weights for policy 1, policy_version 523515 (0.0006) [2023-12-27 22:59:34,925][106225] Updated weights for policy 1, policy_version 523525 (0.0008) [2023-12-27 22:59:34,968][106225] Updated weights for policy 1, policy_version 523535 (0.0007) [2023-12-27 22:59:35,599][106226] Updated weights for policy 0, policy_version 522266 (0.0008) [2023-12-27 22:59:35,655][106226] Updated weights for policy 0, policy_version 522276 (0.0009) [2023-12-27 22:59:35,661][106225] Updated weights for policy 1, policy_version 523545 (0.0008) [2023-12-27 22:59:35,718][106226] Updated weights for policy 0, policy_version 522286 (0.0007) [2023-12-27 22:59:35,724][106225] Updated weights for policy 1, policy_version 523555 (0.0007) [2023-12-27 22:59:35,779][106226] Updated weights for policy 0, policy_version 522296 (0.0006) [2023-12-27 22:59:35,794][106225] Updated weights for policy 1, policy_version 523565 (0.0008) [2023-12-27 22:59:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 267804672. Throughput: 0: 9900.7, 1: 9977.6. Samples: 267815064. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:36,175][105115] Avg episode reward: [(0, '-5.187'), (1, '-5.566')] [2023-12-27 22:59:36,497][106226] Updated weights for policy 0, policy_version 522306 (0.0009) [2023-12-27 22:59:36,551][106225] Updated weights for policy 1, policy_version 523575 (0.0007) [2023-12-27 22:59:36,566][106226] Updated weights for policy 0, policy_version 522316 (0.0008) [2023-12-27 22:59:36,610][106225] Updated weights for policy 1, policy_version 523585 (0.0006) [2023-12-27 22:59:36,640][106226] Updated weights for policy 0, policy_version 522326 (0.0009) [2023-12-27 22:59:36,672][106225] Updated weights for policy 1, policy_version 523595 (0.0005) [2023-12-27 22:59:37,224][106226] Updated weights for policy 0, policy_version 522336 (0.0008) [2023-12-27 22:59:37,275][106226] Updated weights for policy 0, policy_version 522346 (0.0009) [2023-12-27 22:59:37,338][106226] Updated weights for policy 0, policy_version 522356 (0.0009) [2023-12-27 22:59:37,384][106225] Updated weights for policy 1, policy_version 523605 (0.0007) [2023-12-27 22:59:37,434][106225] Updated weights for policy 1, policy_version 523615 (0.0009) [2023-12-27 22:59:37,484][106225] Updated weights for policy 1, policy_version 523625 (0.0009) [2023-12-27 22:59:37,952][106226] Updated weights for policy 0, policy_version 522366 (0.0009) [2023-12-27 22:59:38,013][106226] Updated weights for policy 0, policy_version 522376 (0.0010) [2023-12-27 22:59:38,073][106226] Updated weights for policy 0, policy_version 522386 (0.0010) [2023-12-27 22:59:38,236][106225] Updated weights for policy 1, policy_version 523635 (0.0008) [2023-12-27 22:59:38,289][106225] Updated weights for policy 1, policy_version 523645 (0.0007) [2023-12-27 22:59:38,347][106225] Updated weights for policy 1, policy_version 523655 (0.0008) [2023-12-27 22:59:38,713][106226] Updated weights for policy 0, policy_version 522396 (0.0011) [2023-12-27 22:59:38,783][106226] Updated weights for policy 0, policy_version 522406 (0.0011) [2023-12-27 22:59:38,849][106226] Updated weights for policy 0, policy_version 522416 (0.0009) [2023-12-27 22:59:39,051][106225] Updated weights for policy 1, policy_version 523665 (0.0009) [2023-12-27 22:59:39,115][106225] Updated weights for policy 1, policy_version 523675 (0.0008) [2023-12-27 22:59:39,165][106225] Updated weights for policy 1, policy_version 523685 (0.0007) [2023-12-27 22:59:39,212][106225] Updated weights for policy 1, policy_version 523695 (0.0007) [2023-12-27 22:59:39,501][106226] Updated weights for policy 0, policy_version 522426 (0.0006) [2023-12-27 22:59:39,576][106226] Updated weights for policy 0, policy_version 522436 (0.0008) [2023-12-27 22:59:39,664][106226] Updated weights for policy 0, policy_version 522446 (0.0010) [2023-12-27 22:59:39,722][106226] Updated weights for policy 0, policy_version 522456 (0.0011) [2023-12-27 22:59:39,966][106225] Updated weights for policy 1, policy_version 523705 (0.0008) [2023-12-27 22:59:40,030][106225] Updated weights for policy 1, policy_version 523715 (0.0007) [2023-12-27 22:59:40,093][106225] Updated weights for policy 1, policy_version 523725 (0.0008) [2023-12-27 22:59:40,419][106226] Updated weights for policy 0, policy_version 522467 (0.0009) [2023-12-27 22:59:40,473][106226] Updated weights for policy 0, policy_version 522477 (0.0008) [2023-12-27 22:59:40,519][106226] Updated weights for policy 0, policy_version 522487 (0.0009) [2023-12-27 22:59:40,799][106225] Updated weights for policy 1, policy_version 523735 (0.0006) [2023-12-27 22:59:40,860][106225] Updated weights for policy 1, policy_version 523745 (0.0008) [2023-12-27 22:59:40,919][106225] Updated weights for policy 1, policy_version 523755 (0.0007) [2023-12-27 22:59:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 267902976. Throughput: 0: 9916.2, 1: 9963.2. Samples: 267875224. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:41,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-5.529')] [2023-12-27 22:59:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000522488_133791744.pth... [2023-12-27 22:59:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000523760_134111232.pth... [2023-12-27 22:59:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000521368_133505024.pth [2023-12-27 22:59:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000522576_133808128.pth [2023-12-27 22:59:41,259][106226] Updated weights for policy 0, policy_version 522497 (0.0008) [2023-12-27 22:59:41,321][106226] Updated weights for policy 0, policy_version 522507 (0.0009) [2023-12-27 22:59:41,399][106226] Updated weights for policy 0, policy_version 522517 (0.0009) [2023-12-27 22:59:41,574][106225] Updated weights for policy 1, policy_version 523765 (0.0006) [2023-12-27 22:59:41,639][106225] Updated weights for policy 1, policy_version 523775 (0.0007) [2023-12-27 22:59:41,702][106225] Updated weights for policy 1, policy_version 523785 (0.0009) [2023-12-27 22:59:42,141][106226] Updated weights for policy 0, policy_version 522527 (0.0006) [2023-12-27 22:59:42,198][106226] Updated weights for policy 0, policy_version 522537 (0.0006) [2023-12-27 22:59:42,255][106226] Updated weights for policy 0, policy_version 522547 (0.0006) [2023-12-27 22:59:42,447][106225] Updated weights for policy 1, policy_version 523795 (0.0008) [2023-12-27 22:59:42,505][106225] Updated weights for policy 1, policy_version 523805 (0.0008) [2023-12-27 22:59:42,569][106225] Updated weights for policy 1, policy_version 523815 (0.0007) [2023-12-27 22:59:42,932][106226] Updated weights for policy 0, policy_version 522557 (0.0008) [2023-12-27 22:59:42,983][106226] Updated weights for policy 0, policy_version 522567 (0.0009) [2023-12-27 22:59:43,033][106226] Updated weights for policy 0, policy_version 522577 (0.0009) [2023-12-27 22:59:43,313][106225] Updated weights for policy 1, policy_version 523825 (0.0010) [2023-12-27 22:59:43,363][106225] Updated weights for policy 1, policy_version 523835 (0.0008) [2023-12-27 22:59:43,412][106225] Updated weights for policy 1, policy_version 523845 (0.0008) [2023-12-27 22:59:43,466][106225] Updated weights for policy 1, policy_version 523855 (0.0009) [2023-12-27 22:59:43,674][106226] Updated weights for policy 0, policy_version 522587 (0.0007) [2023-12-27 22:59:43,724][106226] Updated weights for policy 0, policy_version 522597 (0.0008) [2023-12-27 22:59:43,776][106226] Updated weights for policy 0, policy_version 522607 (0.0008) [2023-12-27 22:59:44,279][106225] Updated weights for policy 1, policy_version 523865 (0.0010) [2023-12-27 22:59:44,348][106225] Updated weights for policy 1, policy_version 523875 (0.0008) [2023-12-27 22:59:44,389][106226] Updated weights for policy 0, policy_version 522617 (0.0008) [2023-12-27 22:59:44,413][106225] Updated weights for policy 1, policy_version 523885 (0.0008) [2023-12-27 22:59:44,451][106226] Updated weights for policy 0, policy_version 522627 (0.0007) [2023-12-27 22:59:44,518][106226] Updated weights for policy 0, policy_version 522637 (0.0008) [2023-12-27 22:59:44,586][106226] Updated weights for policy 0, policy_version 522647 (0.0011) [2023-12-27 22:59:45,151][106225] Updated weights for policy 1, policy_version 523895 (0.0008) [2023-12-27 22:59:45,214][106225] Updated weights for policy 1, policy_version 523905 (0.0008) [2023-12-27 22:59:45,279][106225] Updated weights for policy 1, policy_version 523915 (0.0008) [2023-12-27 22:59:45,337][106226] Updated weights for policy 0, policy_version 522657 (0.0011) [2023-12-27 22:59:45,394][106226] Updated weights for policy 0, policy_version 522667 (0.0010) [2023-12-27 22:59:45,444][106226] Updated weights for policy 0, policy_version 522677 (0.0009) [2023-12-27 22:59:46,012][106225] Updated weights for policy 1, policy_version 523925 (0.0007) [2023-12-27 22:59:46,069][106225] Updated weights for policy 1, policy_version 523935 (0.0008) [2023-12-27 22:59:46,133][106225] Updated weights for policy 1, policy_version 523945 (0.0007) [2023-12-27 22:59:46,159][106226] Updated weights for policy 0, policy_version 522687 (0.0011) [2023-12-27 22:59:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 268001280. Throughput: 0: 9867.3, 1: 9966.8. Samples: 267992716. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:46,175][105115] Avg episode reward: [(0, '-5.005'), (1, '-5.376')] [2023-12-27 22:59:46,209][106226] Updated weights for policy 0, policy_version 522697 (0.0010) [2023-12-27 22:59:46,255][106226] Updated weights for policy 0, policy_version 522707 (0.0010) [2023-12-27 22:59:46,861][106225] Updated weights for policy 1, policy_version 523955 (0.0009) [2023-12-27 22:59:46,916][106225] Updated weights for policy 1, policy_version 523965 (0.0007) [2023-12-27 22:59:46,937][106226] Updated weights for policy 0, policy_version 522717 (0.0008) [2023-12-27 22:59:46,978][106225] Updated weights for policy 1, policy_version 523975 (0.0010) [2023-12-27 22:59:46,999][106226] Updated weights for policy 0, policy_version 522727 (0.0006) [2023-12-27 22:59:47,051][106226] Updated weights for policy 0, policy_version 522737 (0.0007) [2023-12-27 22:59:47,712][106225] Updated weights for policy 1, policy_version 523985 (0.0010) [2023-12-27 22:59:47,722][106226] Updated weights for policy 0, policy_version 522747 (0.0007) [2023-12-27 22:59:47,766][106225] Updated weights for policy 1, policy_version 523995 (0.0010) [2023-12-27 22:59:47,775][106226] Updated weights for policy 0, policy_version 522757 (0.0006) [2023-12-27 22:59:47,826][106225] Updated weights for policy 1, policy_version 524005 (0.0010) [2023-12-27 22:59:47,837][106226] Updated weights for policy 0, policy_version 522767 (0.0006) [2023-12-27 22:59:47,883][106225] Updated weights for policy 1, policy_version 524015 (0.0010) [2023-12-27 22:59:48,489][106225] Updated weights for policy 1, policy_version 524025 (0.0007) [2023-12-27 22:59:48,556][106226] Updated weights for policy 0, policy_version 522777 (0.0005) [2023-12-27 22:59:48,559][106225] Updated weights for policy 1, policy_version 524035 (0.0006) [2023-12-27 22:59:48,617][106226] Updated weights for policy 0, policy_version 522787 (0.0006) [2023-12-27 22:59:48,632][106225] Updated weights for policy 1, policy_version 524045 (0.0010) [2023-12-27 22:59:48,676][106226] Updated weights for policy 0, policy_version 522797 (0.0009) [2023-12-27 22:59:48,737][106226] Updated weights for policy 0, policy_version 522807 (0.0008) [2023-12-27 22:59:49,296][106225] Updated weights for policy 1, policy_version 524055 (0.0010) [2023-12-27 22:59:49,363][106225] Updated weights for policy 1, policy_version 524065 (0.0011) [2023-12-27 22:59:49,427][106225] Updated weights for policy 1, policy_version 524075 (0.0010) [2023-12-27 22:59:49,460][106226] Updated weights for policy 0, policy_version 522817 (0.0008) [2023-12-27 22:59:49,519][106226] Updated weights for policy 0, policy_version 522827 (0.0009) [2023-12-27 22:59:49,580][106226] Updated weights for policy 0, policy_version 522837 (0.0008) [2023-12-27 22:59:50,162][106225] Updated weights for policy 1, policy_version 524085 (0.0009) [2023-12-27 22:59:50,216][106225] Updated weights for policy 1, policy_version 524095 (0.0008) [2023-12-27 22:59:50,266][106226] Updated weights for policy 0, policy_version 522847 (0.0008) [2023-12-27 22:59:50,276][106225] Updated weights for policy 1, policy_version 524105 (0.0007) [2023-12-27 22:59:50,335][106226] Updated weights for policy 0, policy_version 522857 (0.0008) [2023-12-27 22:59:50,404][106226] Updated weights for policy 0, policy_version 522867 (0.0007) [2023-12-27 22:59:50,963][106225] Updated weights for policy 1, policy_version 524115 (0.0007) [2023-12-27 22:59:51,027][106225] Updated weights for policy 1, policy_version 524125 (0.0007) [2023-12-27 22:59:51,054][106226] Updated weights for policy 0, policy_version 522877 (0.0007) [2023-12-27 22:59:51,091][106225] Updated weights for policy 1, policy_version 524135 (0.0008) [2023-12-27 22:59:51,117][106226] Updated weights for policy 0, policy_version 522887 (0.0007) [2023-12-27 22:59:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 268099584. Throughput: 0: 9846.4, 1: 9934.8. Samples: 268111100. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:51,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.541')] [2023-12-27 22:59:51,181][106226] Updated weights for policy 0, policy_version 522897 (0.0006) [2023-12-27 22:59:51,879][106225] Updated weights for policy 1, policy_version 524145 (0.0007) [2023-12-27 22:59:51,935][106226] Updated weights for policy 0, policy_version 522907 (0.0006) [2023-12-27 22:59:51,937][106225] Updated weights for policy 1, policy_version 524155 (0.0007) [2023-12-27 22:59:51,994][106225] Updated weights for policy 1, policy_version 524165 (0.0008) [2023-12-27 22:59:51,999][106226] Updated weights for policy 0, policy_version 522917 (0.0007) [2023-12-27 22:59:52,049][106225] Updated weights for policy 1, policy_version 524175 (0.0006) [2023-12-27 22:59:52,063][106226] Updated weights for policy 0, policy_version 522927 (0.0008) [2023-12-27 22:59:52,779][106226] Updated weights for policy 0, policy_version 522937 (0.0008) [2023-12-27 22:59:52,820][106225] Updated weights for policy 1, policy_version 524185 (0.0008) [2023-12-27 22:59:52,840][106226] Updated weights for policy 0, policy_version 522947 (0.0010) [2023-12-27 22:59:52,883][106225] Updated weights for policy 1, policy_version 524195 (0.0008) [2023-12-27 22:59:52,904][106226] Updated weights for policy 0, policy_version 522957 (0.0009) [2023-12-27 22:59:52,938][106225] Updated weights for policy 1, policy_version 524205 (0.0010) [2023-12-27 22:59:52,964][106226] Updated weights for policy 0, policy_version 522967 (0.0007) [2023-12-27 22:59:53,604][106226] Updated weights for policy 0, policy_version 522977 (0.0008) [2023-12-27 22:59:53,659][106226] Updated weights for policy 0, policy_version 522987 (0.0007) [2023-12-27 22:59:53,676][106225] Updated weights for policy 1, policy_version 524215 (0.0010) [2023-12-27 22:59:53,716][106226] Updated weights for policy 0, policy_version 522997 (0.0006) [2023-12-27 22:59:53,742][106225] Updated weights for policy 1, policy_version 524225 (0.0008) [2023-12-27 22:59:53,798][106225] Updated weights for policy 1, policy_version 524235 (0.0010) [2023-12-27 22:59:54,301][106226] Updated weights for policy 0, policy_version 523007 (0.0007) [2023-12-27 22:59:54,351][106226] Updated weights for policy 0, policy_version 523017 (0.0008) [2023-12-27 22:59:54,400][106226] Updated weights for policy 0, policy_version 523027 (0.0009) [2023-12-27 22:59:54,476][106225] Updated weights for policy 1, policy_version 524245 (0.0008) [2023-12-27 22:59:54,526][106225] Updated weights for policy 1, policy_version 524255 (0.0006) [2023-12-27 22:59:54,587][106225] Updated weights for policy 1, policy_version 524265 (0.0008) [2023-12-27 22:59:55,143][106226] Updated weights for policy 0, policy_version 523037 (0.0010) [2023-12-27 22:59:55,192][106225] Updated weights for policy 1, policy_version 524275 (0.0007) [2023-12-27 22:59:55,197][106226] Updated weights for policy 0, policy_version 523047 (0.0010) [2023-12-27 22:59:55,248][106226] Updated weights for policy 0, policy_version 523057 (0.0006) [2023-12-27 22:59:55,252][106225] Updated weights for policy 1, policy_version 524285 (0.0010) [2023-12-27 22:59:55,302][106225] Updated weights for policy 1, policy_version 524295 (0.0010) [2023-12-27 22:59:55,851][106225] Updated weights for policy 1, policy_version 524305 (0.0007) [2023-12-27 22:59:55,883][106226] Updated weights for policy 0, policy_version 523067 (0.0007) [2023-12-27 22:59:55,917][106225] Updated weights for policy 1, policy_version 524315 (0.0005) [2023-12-27 22:59:55,954][106226] Updated weights for policy 0, policy_version 523077 (0.0010) [2023-12-27 22:59:55,979][106225] Updated weights for policy 1, policy_version 524325 (0.0008) [2023-12-27 22:59:56,013][106226] Updated weights for policy 0, policy_version 523087 (0.0011) [2023-12-27 22:59:56,032][106225] Updated weights for policy 1, policy_version 524335 (0.0010) [2023-12-27 22:59:56,174][105115] Fps is (10 sec: 20479.8, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 268206080. Throughput: 0: 9827.4, 1: 9895.5. Samples: 268169144. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 22:59:56,175][105115] Avg episode reward: [(0, '-5.213'), (1, '-5.549')] [2023-12-27 22:59:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000524336_134258688.pth... [2023-12-27 22:59:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000523096_133947392.pth... [2023-12-27 22:59:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000521912_133644288.pth [2023-12-27 22:59:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000523184_133963776.pth [2023-12-27 22:59:56,598][106226] Updated weights for policy 0, policy_version 523097 (0.0010) [2023-12-27 22:59:56,651][106226] Updated weights for policy 0, policy_version 523107 (0.0010) [2023-12-27 22:59:56,685][106225] Updated weights for policy 1, policy_version 524345 (0.0010) [2023-12-27 22:59:56,706][106226] Updated weights for policy 0, policy_version 523117 (0.0010) [2023-12-27 22:59:56,732][106225] Updated weights for policy 1, policy_version 524355 (0.0010) [2023-12-27 22:59:56,760][106226] Updated weights for policy 0, policy_version 523127 (0.0010) [2023-12-27 22:59:56,781][106225] Updated weights for policy 1, policy_version 524365 (0.0010) [2023-12-27 22:59:57,425][106226] Updated weights for policy 0, policy_version 523137 (0.0006) [2023-12-27 22:59:57,486][106226] Updated weights for policy 0, policy_version 523147 (0.0005) [2023-12-27 22:59:57,498][106225] Updated weights for policy 1, policy_version 524375 (0.0007) [2023-12-27 22:59:57,543][106226] Updated weights for policy 0, policy_version 523157 (0.0005) [2023-12-27 22:59:57,544][106225] Updated weights for policy 1, policy_version 524385 (0.0006) [2023-12-27 22:59:57,595][106225] Updated weights for policy 1, policy_version 524395 (0.0005) [2023-12-27 22:59:58,199][106226] Updated weights for policy 0, policy_version 523167 (0.0007) [2023-12-27 22:59:58,258][106225] Updated weights for policy 1, policy_version 524405 (0.0007) [2023-12-27 22:59:58,264][106226] Updated weights for policy 0, policy_version 523177 (0.0007) [2023-12-27 22:59:58,330][106226] Updated weights for policy 0, policy_version 523187 (0.0007) [2023-12-27 22:59:58,330][106225] Updated weights for policy 1, policy_version 524415 (0.0009) [2023-12-27 22:59:58,434][106225] Updated weights for policy 1, policy_version 524425 (0.0010) [2023-12-27 22:59:59,141][106226] Updated weights for policy 0, policy_version 523197 (0.0008) [2023-12-27 22:59:59,176][106225] Updated weights for policy 1, policy_version 524435 (0.0009) [2023-12-27 22:59:59,209][106226] Updated weights for policy 0, policy_version 523207 (0.0009) [2023-12-27 22:59:59,264][106225] Updated weights for policy 1, policy_version 524445 (0.0008) [2023-12-27 22:59:59,287][106226] Updated weights for policy 0, policy_version 523217 (0.0011) [2023-12-27 22:59:59,327][106225] Updated weights for policy 1, policy_version 524455 (0.0009) [2023-12-27 23:00:00,034][106225] Updated weights for policy 1, policy_version 524465 (0.0009) [2023-12-27 23:00:00,085][106226] Updated weights for policy 0, policy_version 523227 (0.0008) [2023-12-27 23:00:00,090][106225] Updated weights for policy 1, policy_version 524475 (0.0010) [2023-12-27 23:00:00,148][106225] Updated weights for policy 1, policy_version 524485 (0.0010) [2023-12-27 23:00:00,149][106226] Updated weights for policy 0, policy_version 523237 (0.0006) [2023-12-27 23:00:00,210][106226] Updated weights for policy 0, policy_version 523247 (0.0008) [2023-12-27 23:00:00,213][106225] Updated weights for policy 1, policy_version 524495 (0.0008) [2023-12-27 23:00:00,873][106225] Updated weights for policy 1, policy_version 524505 (0.0006) [2023-12-27 23:00:00,923][106225] Updated weights for policy 1, policy_version 524515 (0.0005) [2023-12-27 23:00:00,931][106226] Updated weights for policy 0, policy_version 523257 (0.0008) [2023-12-27 23:00:00,980][106225] Updated weights for policy 1, policy_version 524525 (0.0006) [2023-12-27 23:00:00,983][106226] Updated weights for policy 0, policy_version 523267 (0.0007) [2023-12-27 23:00:01,037][106226] Updated weights for policy 0, policy_version 523277 (0.0008) [2023-12-27 23:00:01,094][106226] Updated weights for policy 0, policy_version 523287 (0.0008) [2023-12-27 23:00:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 268304384. Throughput: 0: 9940.8, 1: 9888.0. Samples: 268289596. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:01,175][105115] Avg episode reward: [(0, '-5.061'), (1, '-5.242')] [2023-12-27 23:00:01,697][106225] Updated weights for policy 1, policy_version 524535 (0.0008) [2023-12-27 23:00:01,768][106225] Updated weights for policy 1, policy_version 524545 (0.0009) [2023-12-27 23:00:01,823][106225] Updated weights for policy 1, policy_version 524555 (0.0006) [2023-12-27 23:00:01,838][106226] Updated weights for policy 0, policy_version 523297 (0.0007) [2023-12-27 23:00:01,903][106226] Updated weights for policy 0, policy_version 523307 (0.0009) [2023-12-27 23:00:01,966][106226] Updated weights for policy 0, policy_version 523317 (0.0009) [2023-12-27 23:00:02,558][106225] Updated weights for policy 1, policy_version 524565 (0.0007) [2023-12-27 23:00:02,618][106225] Updated weights for policy 1, policy_version 524575 (0.0007) [2023-12-27 23:00:02,668][106226] Updated weights for policy 0, policy_version 523327 (0.0007) [2023-12-27 23:00:02,677][106225] Updated weights for policy 1, policy_version 524585 (0.0007) [2023-12-27 23:00:02,720][106226] Updated weights for policy 0, policy_version 523337 (0.0009) [2023-12-27 23:00:02,769][106226] Updated weights for policy 0, policy_version 523347 (0.0009) [2023-12-27 23:00:03,366][106225] Updated weights for policy 1, policy_version 524595 (0.0008) [2023-12-27 23:00:03,420][106225] Updated weights for policy 1, policy_version 524605 (0.0008) [2023-12-27 23:00:03,469][106225] Updated weights for policy 1, policy_version 524615 (0.0008) [2023-12-27 23:00:03,523][106226] Updated weights for policy 0, policy_version 523357 (0.0007) [2023-12-27 23:00:03,586][106226] Updated weights for policy 0, policy_version 523367 (0.0009) [2023-12-27 23:00:03,631][106226] Updated weights for policy 0, policy_version 523377 (0.0008) [2023-12-27 23:00:04,201][106225] Updated weights for policy 1, policy_version 524625 (0.0008) [2023-12-27 23:00:04,260][106225] Updated weights for policy 1, policy_version 524635 (0.0009) [2023-12-27 23:00:04,319][106225] Updated weights for policy 1, policy_version 524645 (0.0009) [2023-12-27 23:00:04,384][106225] Updated weights for policy 1, policy_version 524655 (0.0007) [2023-12-27 23:00:04,393][106226] Updated weights for policy 0, policy_version 523387 (0.0009) [2023-12-27 23:00:04,455][106226] Updated weights for policy 0, policy_version 523397 (0.0008) [2023-12-27 23:00:04,507][106226] Updated weights for policy 0, policy_version 523407 (0.0008) [2023-12-27 23:00:05,080][106225] Updated weights for policy 1, policy_version 524665 (0.0005) [2023-12-27 23:00:05,137][106225] Updated weights for policy 1, policy_version 524675 (0.0005) [2023-12-27 23:00:05,198][106225] Updated weights for policy 1, policy_version 524685 (0.0005) [2023-12-27 23:00:05,291][106226] Updated weights for policy 0, policy_version 523417 (0.0008) [2023-12-27 23:00:05,342][106226] Updated weights for policy 0, policy_version 523427 (0.0009) [2023-12-27 23:00:05,391][106226] Updated weights for policy 0, policy_version 523437 (0.0009) [2023-12-27 23:00:05,441][106226] Updated weights for policy 0, policy_version 523447 (0.0010) [2023-12-27 23:00:05,703][106225] Updated weights for policy 1, policy_version 524695 (0.0006) [2023-12-27 23:00:05,755][106225] Updated weights for policy 1, policy_version 524705 (0.0005) [2023-12-27 23:00:05,810][106225] Updated weights for policy 1, policy_version 524715 (0.0005) [2023-12-27 23:00:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 268394496. Throughput: 0: 9935.9, 1: 9872.3. Samples: 268406728. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:06,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-5.451')] [2023-12-27 23:00:06,287][106226] Updated weights for policy 0, policy_version 523457 (0.0008) [2023-12-27 23:00:06,353][106226] Updated weights for policy 0, policy_version 523467 (0.0008) [2023-12-27 23:00:06,404][106226] Updated weights for policy 0, policy_version 523477 (0.0008) [2023-12-27 23:00:06,465][106225] Updated weights for policy 1, policy_version 524725 (0.0008) [2023-12-27 23:00:06,530][106225] Updated weights for policy 1, policy_version 524735 (0.0010) [2023-12-27 23:00:06,587][106225] Updated weights for policy 1, policy_version 524745 (0.0010) [2023-12-27 23:00:07,109][106226] Updated weights for policy 0, policy_version 523487 (0.0008) [2023-12-27 23:00:07,158][106226] Updated weights for policy 0, policy_version 523497 (0.0007) [2023-12-27 23:00:07,227][106226] Updated weights for policy 0, policy_version 523507 (0.0006) [2023-12-27 23:00:07,273][106225] Updated weights for policy 1, policy_version 524755 (0.0009) [2023-12-27 23:00:07,337][106225] Updated weights for policy 1, policy_version 524765 (0.0005) [2023-12-27 23:00:07,406][106225] Updated weights for policy 1, policy_version 524775 (0.0005) [2023-12-27 23:00:07,912][106225] Updated weights for policy 1, policy_version 524785 (0.0008) [2023-12-27 23:00:07,912][106226] Updated weights for policy 0, policy_version 523517 (0.0006) [2023-12-27 23:00:07,972][106225] Updated weights for policy 1, policy_version 524795 (0.0007) [2023-12-27 23:00:07,973][106226] Updated weights for policy 0, policy_version 523527 (0.0005) [2023-12-27 23:00:08,028][106226] Updated weights for policy 0, policy_version 523537 (0.0005) [2023-12-27 23:00:08,032][106225] Updated weights for policy 1, policy_version 524805 (0.0010) [2023-12-27 23:00:08,092][106225] Updated weights for policy 1, policy_version 524815 (0.0010) [2023-12-27 23:00:08,621][106226] Updated weights for policy 0, policy_version 523547 (0.0007) [2023-12-27 23:00:08,688][106226] Updated weights for policy 0, policy_version 523557 (0.0009) [2023-12-27 23:00:08,751][106226] Updated weights for policy 0, policy_version 523567 (0.0008) [2023-12-27 23:00:08,800][106225] Updated weights for policy 1, policy_version 524825 (0.0008) [2023-12-27 23:00:08,863][106225] Updated weights for policy 1, policy_version 524835 (0.0008) [2023-12-27 23:00:08,926][106225] Updated weights for policy 1, policy_version 524845 (0.0009) [2023-12-27 23:00:09,483][106226] Updated weights for policy 0, policy_version 523577 (0.0007) [2023-12-27 23:00:09,551][106226] Updated weights for policy 0, policy_version 523587 (0.0006) [2023-12-27 23:00:09,623][106226] Updated weights for policy 0, policy_version 523597 (0.0006) [2023-12-27 23:00:09,688][106226] Updated weights for policy 0, policy_version 523607 (0.0008) [2023-12-27 23:00:09,729][106225] Updated weights for policy 1, policy_version 524855 (0.0008) [2023-12-27 23:00:09,795][106225] Updated weights for policy 1, policy_version 524865 (0.0009) [2023-12-27 23:00:09,867][106225] Updated weights for policy 1, policy_version 524875 (0.0009) [2023-12-27 23:00:10,360][106226] Updated weights for policy 0, policy_version 523617 (0.0011) [2023-12-27 23:00:10,423][106226] Updated weights for policy 0, policy_version 523627 (0.0009) [2023-12-27 23:00:10,472][106226] Updated weights for policy 0, policy_version 523637 (0.0008) [2023-12-27 23:00:10,622][106225] Updated weights for policy 1, policy_version 524885 (0.0008) [2023-12-27 23:00:10,669][106225] Updated weights for policy 1, policy_version 524895 (0.0009) [2023-12-27 23:00:10,726][106225] Updated weights for policy 1, policy_version 524905 (0.0009) [2023-12-27 23:00:11,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 268492800. Throughput: 0: 9948.8, 1: 9956.5. Samples: 268468740. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:11,175][105115] Avg episode reward: [(0, '-5.216'), (1, '-5.568')] [2023-12-27 23:00:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000524912_134406144.pth... [2023-12-27 23:00:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000523760_134111232.pth [2023-12-27 23:00:11,212][106226] Updated weights for policy 0, policy_version 523647 (0.0009) [2023-12-27 23:00:11,289][106226] Updated weights for policy 0, policy_version 523657 (0.0008) [2023-12-27 23:00:11,356][106226] Updated weights for policy 0, policy_version 523667 (0.0008) [2023-12-27 23:00:11,389][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000523672_134094848.pth... [2023-12-27 23:00:11,393][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000522488_133791744.pth [2023-12-27 23:00:11,462][106225] Updated weights for policy 1, policy_version 524915 (0.0008) [2023-12-27 23:00:11,519][106225] Updated weights for policy 1, policy_version 524925 (0.0007) [2023-12-27 23:00:11,578][106225] Updated weights for policy 1, policy_version 524935 (0.0008) [2023-12-27 23:00:12,131][106226] Updated weights for policy 0, policy_version 523677 (0.0009) [2023-12-27 23:00:12,185][106226] Updated weights for policy 0, policy_version 523687 (0.0007) [2023-12-27 23:00:12,242][106226] Updated weights for policy 0, policy_version 523697 (0.0007) [2023-12-27 23:00:12,323][106225] Updated weights for policy 1, policy_version 524945 (0.0009) [2023-12-27 23:00:12,390][106225] Updated weights for policy 1, policy_version 524955 (0.0008) [2023-12-27 23:00:12,458][106225] Updated weights for policy 1, policy_version 524965 (0.0007) [2023-12-27 23:00:12,512][106225] Updated weights for policy 1, policy_version 524975 (0.0010) [2023-12-27 23:00:12,856][106226] Updated weights for policy 0, policy_version 523707 (0.0007) [2023-12-27 23:00:12,909][106226] Updated weights for policy 0, policy_version 523717 (0.0009) [2023-12-27 23:00:12,956][106226] Updated weights for policy 0, policy_version 523727 (0.0007) [2023-12-27 23:00:13,146][106225] Updated weights for policy 1, policy_version 524985 (0.0005) [2023-12-27 23:00:13,199][106225] Updated weights for policy 1, policy_version 524995 (0.0005) [2023-12-27 23:00:13,267][106225] Updated weights for policy 1, policy_version 525005 (0.0005) [2023-12-27 23:00:13,554][106226] Updated weights for policy 0, policy_version 523737 (0.0006) [2023-12-27 23:00:13,609][106226] Updated weights for policy 0, policy_version 523747 (0.0008) [2023-12-27 23:00:13,668][106226] Updated weights for policy 0, policy_version 523757 (0.0009) [2023-12-27 23:00:13,723][106226] Updated weights for policy 0, policy_version 523767 (0.0009) [2023-12-27 23:00:13,868][106225] Updated weights for policy 1, policy_version 525015 (0.0008) [2023-12-27 23:00:13,923][106225] Updated weights for policy 1, policy_version 525025 (0.0009) [2023-12-27 23:00:13,968][106225] Updated weights for policy 1, policy_version 525035 (0.0008) [2023-12-27 23:00:14,357][106226] Updated weights for policy 0, policy_version 523777 (0.0006) [2023-12-27 23:00:14,414][106226] Updated weights for policy 0, policy_version 523787 (0.0005) [2023-12-27 23:00:14,463][106226] Updated weights for policy 0, policy_version 523797 (0.0005) [2023-12-27 23:00:14,561][106225] Updated weights for policy 1, policy_version 525045 (0.0007) [2023-12-27 23:00:14,619][106225] Updated weights for policy 1, policy_version 525055 (0.0009) [2023-12-27 23:00:14,674][106225] Updated weights for policy 1, policy_version 525065 (0.0009) [2023-12-27 23:00:15,121][106226] Updated weights for policy 0, policy_version 523807 (0.0009) [2023-12-27 23:00:15,176][106226] Updated weights for policy 0, policy_version 523817 (0.0009) [2023-12-27 23:00:15,232][106226] Updated weights for policy 0, policy_version 523827 (0.0009) [2023-12-27 23:00:15,431][106225] Updated weights for policy 1, policy_version 525075 (0.0007) [2023-12-27 23:00:15,488][106225] Updated weights for policy 1, policy_version 525085 (0.0005) [2023-12-27 23:00:15,545][106225] Updated weights for policy 1, policy_version 525095 (0.0005) [2023-12-27 23:00:16,016][106226] Updated weights for policy 0, policy_version 523837 (0.0008) [2023-12-27 23:00:16,064][106226] Updated weights for policy 0, policy_version 523847 (0.0008) [2023-12-27 23:00:16,114][106226] Updated weights for policy 0, policy_version 523857 (0.0009) [2023-12-27 23:00:16,128][106225] Updated weights for policy 1, policy_version 525105 (0.0008) [2023-12-27 23:00:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 268599296. Throughput: 0: 9938.2, 1: 9880.2. Samples: 268588440. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:16,175][105115] Avg episode reward: [(0, '-5.078'), (1, '-5.436')] [2023-12-27 23:00:16,181][106225] Updated weights for policy 1, policy_version 525115 (0.0006) [2023-12-27 23:00:16,241][106225] Updated weights for policy 1, policy_version 525125 (0.0008) [2023-12-27 23:00:16,299][106225] Updated weights for policy 1, policy_version 525135 (0.0008) [2023-12-27 23:00:16,775][106226] Updated weights for policy 0, policy_version 523867 (0.0007) [2023-12-27 23:00:16,827][106226] Updated weights for policy 0, policy_version 523877 (0.0009) [2023-12-27 23:00:16,887][106226] Updated weights for policy 0, policy_version 523887 (0.0008) [2023-12-27 23:00:16,964][106225] Updated weights for policy 1, policy_version 525145 (0.0007) [2023-12-27 23:00:17,028][106225] Updated weights for policy 1, policy_version 525155 (0.0008) [2023-12-27 23:00:17,089][106225] Updated weights for policy 1, policy_version 525165 (0.0009) [2023-12-27 23:00:17,629][106226] Updated weights for policy 0, policy_version 523897 (0.0007) [2023-12-27 23:00:17,690][106226] Updated weights for policy 0, policy_version 523907 (0.0005) [2023-12-27 23:00:17,760][106226] Updated weights for policy 0, policy_version 523917 (0.0006) [2023-12-27 23:00:17,783][106225] Updated weights for policy 1, policy_version 525175 (0.0008) [2023-12-27 23:00:17,819][106226] Updated weights for policy 0, policy_version 523927 (0.0006) [2023-12-27 23:00:17,836][106225] Updated weights for policy 1, policy_version 525185 (0.0008) [2023-12-27 23:00:17,891][106225] Updated weights for policy 1, policy_version 525195 (0.0008) [2023-12-27 23:00:18,488][106226] Updated weights for policy 0, policy_version 523937 (0.0008) [2023-12-27 23:00:18,545][106226] Updated weights for policy 0, policy_version 523947 (0.0009) [2023-12-27 23:00:18,603][106226] Updated weights for policy 0, policy_version 523957 (0.0009) [2023-12-27 23:00:18,642][106225] Updated weights for policy 1, policy_version 525205 (0.0009) [2023-12-27 23:00:18,702][106225] Updated weights for policy 1, policy_version 525215 (0.0007) [2023-12-27 23:00:18,757][106225] Updated weights for policy 1, policy_version 525225 (0.0006) [2023-12-27 23:00:19,379][106226] Updated weights for policy 0, policy_version 523967 (0.0007) [2023-12-27 23:00:19,443][106226] Updated weights for policy 0, policy_version 523977 (0.0008) [2023-12-27 23:00:19,468][106225] Updated weights for policy 1, policy_version 525235 (0.0006) [2023-12-27 23:00:19,508][106226] Updated weights for policy 0, policy_version 523987 (0.0008) [2023-12-27 23:00:19,532][106225] Updated weights for policy 1, policy_version 525245 (0.0008) [2023-12-27 23:00:19,595][106225] Updated weights for policy 1, policy_version 525255 (0.0008) [2023-12-27 23:00:20,277][106226] Updated weights for policy 0, policy_version 523997 (0.0008) [2023-12-27 23:00:20,336][106226] Updated weights for policy 0, policy_version 524007 (0.0006) [2023-12-27 23:00:20,370][106225] Updated weights for policy 1, policy_version 525265 (0.0008) [2023-12-27 23:00:20,391][106226] Updated weights for policy 0, policy_version 524017 (0.0008) [2023-12-27 23:00:20,429][106225] Updated weights for policy 1, policy_version 525275 (0.0007) [2023-12-27 23:00:20,477][106225] Updated weights for policy 1, policy_version 525285 (0.0008) [2023-12-27 23:00:20,540][106225] Updated weights for policy 1, policy_version 525295 (0.0009) [2023-12-27 23:00:21,140][106226] Updated weights for policy 0, policy_version 524027 (0.0007) [2023-12-27 23:00:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 268689408. Throughput: 0: 9894.5, 1: 9866.7. Samples: 268704316. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:21,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.356')] [2023-12-27 23:00:21,205][106226] Updated weights for policy 0, policy_version 524037 (0.0008) [2023-12-27 23:00:21,282][106226] Updated weights for policy 0, policy_version 524047 (0.0009) [2023-12-27 23:00:21,352][106225] Updated weights for policy 1, policy_version 525305 (0.0009) [2023-12-27 23:00:21,421][106225] Updated weights for policy 1, policy_version 525315 (0.0009) [2023-12-27 23:00:21,490][106225] Updated weights for policy 1, policy_version 525325 (0.0008) [2023-12-27 23:00:22,073][106226] Updated weights for policy 0, policy_version 524057 (0.0007) [2023-12-27 23:00:22,123][106226] Updated weights for policy 0, policy_version 524067 (0.0009) [2023-12-27 23:00:22,185][106226] Updated weights for policy 0, policy_version 524077 (0.0007) [2023-12-27 23:00:22,242][106226] Updated weights for policy 0, policy_version 524087 (0.0007) [2023-12-27 23:00:22,335][106225] Updated weights for policy 1, policy_version 525335 (0.0008) [2023-12-27 23:00:22,405][106225] Updated weights for policy 1, policy_version 525345 (0.0008) [2023-12-27 23:00:22,471][106225] Updated weights for policy 1, policy_version 525355 (0.0009) [2023-12-27 23:00:22,941][106226] Updated weights for policy 0, policy_version 524097 (0.0006) [2023-12-27 23:00:22,989][106226] Updated weights for policy 0, policy_version 524107 (0.0008) [2023-12-27 23:00:23,041][106226] Updated weights for policy 0, policy_version 524117 (0.0008) [2023-12-27 23:00:23,177][106225] Updated weights for policy 1, policy_version 525365 (0.0009) [2023-12-27 23:00:23,238][106225] Updated weights for policy 1, policy_version 525375 (0.0008) [2023-12-27 23:00:23,289][106225] Updated weights for policy 1, policy_version 525385 (0.0008) [2023-12-27 23:00:23,757][106226] Updated weights for policy 0, policy_version 524127 (0.0009) [2023-12-27 23:00:23,822][106226] Updated weights for policy 0, policy_version 524137 (0.0009) [2023-12-27 23:00:23,875][106226] Updated weights for policy 0, policy_version 524147 (0.0008) [2023-12-27 23:00:24,022][106225] Updated weights for policy 1, policy_version 525395 (0.0008) [2023-12-27 23:00:24,077][106225] Updated weights for policy 1, policy_version 525405 (0.0008) [2023-12-27 23:00:24,133][106225] Updated weights for policy 1, policy_version 525415 (0.0009) [2023-12-27 23:00:24,640][106226] Updated weights for policy 0, policy_version 524157 (0.0008) [2023-12-27 23:00:24,704][106226] Updated weights for policy 0, policy_version 524167 (0.0009) [2023-12-27 23:00:24,764][106226] Updated weights for policy 0, policy_version 524177 (0.0009) [2023-12-27 23:00:24,768][106225] Updated weights for policy 1, policy_version 525425 (0.0008) [2023-12-27 23:00:24,824][106225] Updated weights for policy 1, policy_version 525435 (0.0005) [2023-12-27 23:00:24,879][106225] Updated weights for policy 1, policy_version 525445 (0.0005) [2023-12-27 23:00:24,932][106225] Updated weights for policy 1, policy_version 525455 (0.0005) [2023-12-27 23:00:25,539][106226] Updated weights for policy 0, policy_version 524187 (0.0008) [2023-12-27 23:00:25,556][106225] Updated weights for policy 1, policy_version 525465 (0.0005) [2023-12-27 23:00:25,595][106226] Updated weights for policy 0, policy_version 524197 (0.0008) [2023-12-27 23:00:25,610][106225] Updated weights for policy 1, policy_version 525475 (0.0005) [2023-12-27 23:00:25,648][106226] Updated weights for policy 0, policy_version 524207 (0.0008) [2023-12-27 23:00:25,658][106225] Updated weights for policy 1, policy_version 525485 (0.0007) [2023-12-27 23:00:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 268787712. Throughput: 0: 9811.1, 1: 9847.9. Samples: 268759880. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:26,175][105115] Avg episode reward: [(0, '-5.232'), (1, '-5.413')] [2023-12-27 23:00:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000524216_134234112.pth... [2023-12-27 23:00:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000523096_133947392.pth [2023-12-27 23:00:26,194][106225] Updated weights for policy 1, policy_version 525495 (0.0005) [2023-12-27 23:00:26,251][106225] Updated weights for policy 1, policy_version 525505 (0.0005) [2023-12-27 23:00:26,314][106225] Updated weights for policy 1, policy_version 525515 (0.0005) [2023-12-27 23:00:26,338][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000525520_134561792.pth... [2023-12-27 23:00:26,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000524336_134258688.pth [2023-12-27 23:00:26,454][106226] Updated weights for policy 0, policy_version 524217 (0.0008) [2023-12-27 23:00:26,508][106226] Updated weights for policy 0, policy_version 524227 (0.0008) [2023-12-27 23:00:26,567][106226] Updated weights for policy 0, policy_version 524237 (0.0009) [2023-12-27 23:00:26,626][106226] Updated weights for policy 0, policy_version 524247 (0.0009) [2023-12-27 23:00:26,877][106225] Updated weights for policy 1, policy_version 525525 (0.0007) [2023-12-27 23:00:26,925][106225] Updated weights for policy 1, policy_version 525535 (0.0009) [2023-12-27 23:00:26,972][106225] Updated weights for policy 1, policy_version 525545 (0.0008) [2023-12-27 23:00:27,313][106226] Updated weights for policy 0, policy_version 524257 (0.0008) [2023-12-27 23:00:27,368][106226] Updated weights for policy 0, policy_version 524267 (0.0008) [2023-12-27 23:00:27,417][106226] Updated weights for policy 0, policy_version 524277 (0.0008) [2023-12-27 23:00:27,574][106225] Updated weights for policy 1, policy_version 525555 (0.0006) [2023-12-27 23:00:27,630][106225] Updated weights for policy 1, policy_version 525565 (0.0005) [2023-12-27 23:00:27,688][106225] Updated weights for policy 1, policy_version 525575 (0.0005) [2023-12-27 23:00:28,214][106226] Updated weights for policy 0, policy_version 524287 (0.0006) [2023-12-27 23:00:28,271][106226] Updated weights for policy 0, policy_version 524297 (0.0006) [2023-12-27 23:00:28,278][106225] Updated weights for policy 1, policy_version 525585 (0.0009) [2023-12-27 23:00:28,328][106225] Updated weights for policy 1, policy_version 525595 (0.0010) [2023-12-27 23:00:28,335][106226] Updated weights for policy 0, policy_version 524307 (0.0007) [2023-12-27 23:00:28,393][106225] Updated weights for policy 1, policy_version 525605 (0.0008) [2023-12-27 23:00:28,454][106225] Updated weights for policy 1, policy_version 525615 (0.0006) [2023-12-27 23:00:29,023][106226] Updated weights for policy 0, policy_version 524317 (0.0010) [2023-12-27 23:00:29,079][106226] Updated weights for policy 0, policy_version 524327 (0.0010) [2023-12-27 23:00:29,099][106225] Updated weights for policy 1, policy_version 525625 (0.0010) [2023-12-27 23:00:29,140][106226] Updated weights for policy 0, policy_version 524337 (0.0010) [2023-12-27 23:00:29,149][106225] Updated weights for policy 1, policy_version 525635 (0.0010) [2023-12-27 23:00:29,202][106225] Updated weights for policy 1, policy_version 525645 (0.0010) [2023-12-27 23:00:29,787][106226] Updated weights for policy 0, policy_version 524347 (0.0010) [2023-12-27 23:00:29,858][106226] Updated weights for policy 0, policy_version 524357 (0.0009) [2023-12-27 23:00:29,915][106225] Updated weights for policy 1, policy_version 525655 (0.0008) [2023-12-27 23:00:29,921][106226] Updated weights for policy 0, policy_version 524367 (0.0008) [2023-12-27 23:00:29,985][106225] Updated weights for policy 1, policy_version 525665 (0.0007) [2023-12-27 23:00:30,045][106225] Updated weights for policy 1, policy_version 525675 (0.0007) [2023-12-27 23:00:30,647][106226] Updated weights for policy 0, policy_version 524377 (0.0008) [2023-12-27 23:00:30,690][106225] Updated weights for policy 1, policy_version 525685 (0.0006) [2023-12-27 23:00:30,702][106226] Updated weights for policy 0, policy_version 524387 (0.0007) [2023-12-27 23:00:30,739][106225] Updated weights for policy 1, policy_version 525695 (0.0007) [2023-12-27 23:00:30,759][106226] Updated weights for policy 0, policy_version 524397 (0.0007) [2023-12-27 23:00:30,783][106225] Updated weights for policy 1, policy_version 525705 (0.0008) [2023-12-27 23:00:30,821][106226] Updated weights for policy 0, policy_version 524407 (0.0007) [2023-12-27 23:00:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 268894208. Throughput: 0: 9732.2, 1: 10052.7. Samples: 268883036. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:31,175][105115] Avg episode reward: [(0, '-4.917'), (1, '-5.570')] [2023-12-27 23:00:31,474][106226] Updated weights for policy 0, policy_version 524417 (0.0008) [2023-12-27 23:00:31,544][106226] Updated weights for policy 0, policy_version 524427 (0.0008) [2023-12-27 23:00:31,547][106225] Updated weights for policy 1, policy_version 525715 (0.0007) [2023-12-27 23:00:31,606][106225] Updated weights for policy 1, policy_version 525725 (0.0006) [2023-12-27 23:00:31,607][106226] Updated weights for policy 0, policy_version 524437 (0.0008) [2023-12-27 23:00:31,688][106225] Updated weights for policy 1, policy_version 525735 (0.0007) [2023-12-27 23:00:32,231][106225] Updated weights for policy 1, policy_version 525745 (0.0008) [2023-12-27 23:00:32,299][106225] Updated weights for policy 1, policy_version 525755 (0.0008) [2023-12-27 23:00:32,360][106225] Updated weights for policy 1, policy_version 525765 (0.0009) [2023-12-27 23:00:32,420][106225] Updated weights for policy 1, policy_version 525775 (0.0008) [2023-12-27 23:00:32,426][106226] Updated weights for policy 0, policy_version 524447 (0.0008) [2023-12-27 23:00:32,478][106226] Updated weights for policy 0, policy_version 524457 (0.0008) [2023-12-27 23:00:32,527][106226] Updated weights for policy 0, policy_version 524467 (0.0008) [2023-12-27 23:00:33,083][106225] Updated weights for policy 1, policy_version 525785 (0.0005) [2023-12-27 23:00:33,142][106225] Updated weights for policy 1, policy_version 525795 (0.0005) [2023-12-27 23:00:33,209][106225] Updated weights for policy 1, policy_version 525805 (0.0005) [2023-12-27 23:00:33,236][106226] Updated weights for policy 0, policy_version 524477 (0.0009) [2023-12-27 23:00:33,296][106226] Updated weights for policy 0, policy_version 524487 (0.0010) [2023-12-27 23:00:33,361][106226] Updated weights for policy 0, policy_version 524497 (0.0011) [2023-12-27 23:00:33,754][106225] Updated weights for policy 1, policy_version 525815 (0.0005) [2023-12-27 23:00:33,812][106225] Updated weights for policy 1, policy_version 525825 (0.0010) [2023-12-27 23:00:33,863][106225] Updated weights for policy 1, policy_version 525835 (0.0010) [2023-12-27 23:00:34,084][106226] Updated weights for policy 0, policy_version 524507 (0.0009) [2023-12-27 23:00:34,135][106226] Updated weights for policy 0, policy_version 524517 (0.0008) [2023-12-27 23:00:34,192][106226] Updated weights for policy 0, policy_version 524527 (0.0009) [2023-12-27 23:00:34,510][106225] Updated weights for policy 1, policy_version 525845 (0.0008) [2023-12-27 23:00:34,567][106225] Updated weights for policy 1, policy_version 525855 (0.0006) [2023-12-27 23:00:34,626][106225] Updated weights for policy 1, policy_version 525865 (0.0006) [2023-12-27 23:00:34,928][106226] Updated weights for policy 0, policy_version 524537 (0.0008) [2023-12-27 23:00:34,978][106226] Updated weights for policy 0, policy_version 524547 (0.0008) [2023-12-27 23:00:35,028][106226] Updated weights for policy 0, policy_version 524557 (0.0008) [2023-12-27 23:00:35,078][106226] Updated weights for policy 0, policy_version 524567 (0.0008) [2023-12-27 23:00:35,278][106225] Updated weights for policy 1, policy_version 525875 (0.0008) [2023-12-27 23:00:35,347][106225] Updated weights for policy 1, policy_version 525885 (0.0006) [2023-12-27 23:00:35,414][106225] Updated weights for policy 1, policy_version 525895 (0.0008) [2023-12-27 23:00:35,903][106226] Updated weights for policy 0, policy_version 524577 (0.0008) [2023-12-27 23:00:35,960][106226] Updated weights for policy 0, policy_version 524587 (0.0008) [2023-12-27 23:00:36,002][106225] Updated weights for policy 1, policy_version 525905 (0.0010) [2023-12-27 23:00:36,014][106226] Updated weights for policy 0, policy_version 524597 (0.0009) [2023-12-27 23:00:36,063][106225] Updated weights for policy 1, policy_version 525915 (0.0007) [2023-12-27 23:00:36,123][106225] Updated weights for policy 1, policy_version 525925 (0.0006) [2023-12-27 23:00:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 268992512. Throughput: 0: 9663.7, 1: 10172.7. Samples: 269003740. Policy #0 lag: (min: 1.0, avg: 28.7, max: 33.0) [2023-12-27 23:00:36,175][105115] Avg episode reward: [(0, '-5.191'), (1, '-5.660')] [2023-12-27 23:00:36,188][106225] Updated weights for policy 1, policy_version 525935 (0.0009) [2023-12-27 23:00:36,825][106226] Updated weights for policy 0, policy_version 524607 (0.0009) [2023-12-27 23:00:36,846][106225] Updated weights for policy 1, policy_version 525945 (0.0010) [2023-12-27 23:00:36,885][106226] Updated weights for policy 0, policy_version 524617 (0.0008) [2023-12-27 23:00:36,901][106225] Updated weights for policy 1, policy_version 525955 (0.0007) [2023-12-27 23:00:36,940][106226] Updated weights for policy 0, policy_version 524627 (0.0007) [2023-12-27 23:00:36,963][106225] Updated weights for policy 1, policy_version 525965 (0.0005) [2023-12-27 23:00:37,512][106225] Updated weights for policy 1, policy_version 525975 (0.0005) [2023-12-27 23:00:37,561][106225] Updated weights for policy 1, policy_version 525985 (0.0005) [2023-12-27 23:00:37,611][106225] Updated weights for policy 1, policy_version 525995 (0.0010) [2023-12-27 23:00:37,746][106226] Updated weights for policy 0, policy_version 524637 (0.0008) [2023-12-27 23:00:37,808][106226] Updated weights for policy 0, policy_version 524647 (0.0008) [2023-12-27 23:00:37,883][106226] Updated weights for policy 0, policy_version 524657 (0.0008) [2023-12-27 23:00:38,256][106225] Updated weights for policy 1, policy_version 526005 (0.0010) [2023-12-27 23:00:38,323][106225] Updated weights for policy 1, policy_version 526015 (0.0010) [2023-12-27 23:00:38,395][106225] Updated weights for policy 1, policy_version 526025 (0.0010) [2023-12-27 23:00:38,573][106226] Updated weights for policy 0, policy_version 524667 (0.0006) [2023-12-27 23:00:38,627][106226] Updated weights for policy 0, policy_version 524677 (0.0009) [2023-12-27 23:00:38,682][106226] Updated weights for policy 0, policy_version 524687 (0.0007) [2023-12-27 23:00:39,103][106225] Updated weights for policy 1, policy_version 526035 (0.0010) [2023-12-27 23:00:39,156][106225] Updated weights for policy 1, policy_version 526045 (0.0008) [2023-12-27 23:00:39,213][106225] Updated weights for policy 1, policy_version 526055 (0.0009) [2023-12-27 23:00:39,352][106226] Updated weights for policy 0, policy_version 524697 (0.0008) [2023-12-27 23:00:39,420][106226] Updated weights for policy 0, policy_version 524707 (0.0007) [2023-12-27 23:00:39,475][106226] Updated weights for policy 0, policy_version 524717 (0.0009) [2023-12-27 23:00:39,526][106226] Updated weights for policy 0, policy_version 524727 (0.0009) [2023-12-27 23:00:40,025][106225] Updated weights for policy 1, policy_version 526065 (0.0007) [2023-12-27 23:00:40,087][106225] Updated weights for policy 1, policy_version 526075 (0.0008) [2023-12-27 23:00:40,149][106225] Updated weights for policy 1, policy_version 526085 (0.0008) [2023-12-27 23:00:40,216][106225] Updated weights for policy 1, policy_version 526095 (0.0008) [2023-12-27 23:00:40,313][106226] Updated weights for policy 0, policy_version 524737 (0.0008) [2023-12-27 23:00:40,371][106226] Updated weights for policy 0, policy_version 524747 (0.0008) [2023-12-27 23:00:40,425][106226] Updated weights for policy 0, policy_version 524757 (0.0008) [2023-12-27 23:00:40,865][106225] Updated weights for policy 1, policy_version 526105 (0.0006) [2023-12-27 23:00:40,928][106225] Updated weights for policy 1, policy_version 526115 (0.0005) [2023-12-27 23:00:40,994][106225] Updated weights for policy 1, policy_version 526125 (0.0006) [2023-12-27 23:00:41,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 269090816. Throughput: 0: 9613.1, 1: 10276.2. Samples: 269064168. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:00:41,176][105115] Avg episode reward: [(0, '-4.907'), (1, '-5.105')] [2023-12-27 23:00:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000526128_134717440.pth... [2023-12-27 23:00:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000524760_134373376.pth... [2023-12-27 23:00:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000524912_134406144.pth [2023-12-27 23:00:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000523672_134094848.pth [2023-12-27 23:00:41,325][106226] Updated weights for policy 0, policy_version 524767 (0.0008) [2023-12-27 23:00:41,401][106226] Updated weights for policy 0, policy_version 524777 (0.0008) [2023-12-27 23:00:41,464][106226] Updated weights for policy 0, policy_version 524787 (0.0008) [2023-12-27 23:00:41,688][106225] Updated weights for policy 1, policy_version 526135 (0.0009) [2023-12-27 23:00:41,758][106225] Updated weights for policy 1, policy_version 526145 (0.0008) [2023-12-27 23:00:41,817][106225] Updated weights for policy 1, policy_version 526155 (0.0008) [2023-12-27 23:00:42,230][106226] Updated weights for policy 0, policy_version 524797 (0.0009) [2023-12-27 23:00:42,294][106226] Updated weights for policy 0, policy_version 524807 (0.0009) [2023-12-27 23:00:42,369][106226] Updated weights for policy 0, policy_version 524817 (0.0009) [2023-12-27 23:00:42,546][106225] Updated weights for policy 1, policy_version 526165 (0.0009) [2023-12-27 23:00:42,596][106225] Updated weights for policy 1, policy_version 526175 (0.0010) [2023-12-27 23:00:42,665][106225] Updated weights for policy 1, policy_version 526185 (0.0006) [2023-12-27 23:00:43,100][106226] Updated weights for policy 0, policy_version 524827 (0.0009) [2023-12-27 23:00:43,149][106226] Updated weights for policy 0, policy_version 524837 (0.0007) [2023-12-27 23:00:43,195][106226] Updated weights for policy 0, policy_version 524847 (0.0008) [2023-12-27 23:00:43,276][106225] Updated weights for policy 1, policy_version 526195 (0.0008) [2023-12-27 23:00:43,335][106225] Updated weights for policy 1, policy_version 526205 (0.0008) [2023-12-27 23:00:43,395][106225] Updated weights for policy 1, policy_version 526215 (0.0007) [2023-12-27 23:00:43,933][106225] Updated weights for policy 1, policy_version 526225 (0.0005) [2023-12-27 23:00:43,947][106226] Updated weights for policy 0, policy_version 524857 (0.0009) [2023-12-27 23:00:43,995][106225] Updated weights for policy 1, policy_version 526235 (0.0005) [2023-12-27 23:00:44,002][106226] Updated weights for policy 0, policy_version 524867 (0.0010) [2023-12-27 23:00:44,052][106225] Updated weights for policy 1, policy_version 526245 (0.0006) [2023-12-27 23:00:44,059][106226] Updated weights for policy 0, policy_version 524877 (0.0009) [2023-12-27 23:00:44,103][106225] Updated weights for policy 1, policy_version 526255 (0.0006) [2023-12-27 23:00:44,113][106226] Updated weights for policy 0, policy_version 524887 (0.0010) [2023-12-27 23:00:44,746][106226] Updated weights for policy 0, policy_version 524897 (0.0011) [2023-12-27 23:00:44,813][106226] Updated weights for policy 0, policy_version 524907 (0.0010) [2023-12-27 23:00:44,826][106225] Updated weights for policy 1, policy_version 526265 (0.0007) [2023-12-27 23:00:44,876][106226] Updated weights for policy 0, policy_version 524917 (0.0011) [2023-12-27 23:00:44,878][106225] Updated weights for policy 1, policy_version 526275 (0.0008) [2023-12-27 23:00:44,936][106225] Updated weights for policy 1, policy_version 526285 (0.0007) [2023-12-27 23:00:45,620][106226] Updated weights for policy 0, policy_version 524927 (0.0011) [2023-12-27 23:00:45,684][106226] Updated weights for policy 0, policy_version 524937 (0.0010) [2023-12-27 23:00:45,703][106225] Updated weights for policy 1, policy_version 526295 (0.0009) [2023-12-27 23:00:45,731][106226] Updated weights for policy 0, policy_version 524947 (0.0010) [2023-12-27 23:00:45,757][106225] Updated weights for policy 1, policy_version 526305 (0.0006) [2023-12-27 23:00:45,815][106225] Updated weights for policy 1, policy_version 526315 (0.0008) [2023-12-27 23:00:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.2, 300 sec: 19882.9). Total num frames: 269189120. Throughput: 0: 9547.3, 1: 10259.5. Samples: 269180908. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:00:46,176][105115] Avg episode reward: [(0, '-5.005'), (1, '-5.627')] [2023-12-27 23:00:46,414][106226] Updated weights for policy 0, policy_version 524957 (0.0008) [2023-12-27 23:00:46,475][106226] Updated weights for policy 0, policy_version 524967 (0.0005) [2023-12-27 23:00:46,533][106226] Updated weights for policy 0, policy_version 524977 (0.0010) [2023-12-27 23:00:46,540][106225] Updated weights for policy 1, policy_version 526325 (0.0007) [2023-12-27 23:00:46,590][106225] Updated weights for policy 1, policy_version 526335 (0.0006) [2023-12-27 23:00:46,642][106225] Updated weights for policy 1, policy_version 526345 (0.0008) [2023-12-27 23:00:47,113][106226] Updated weights for policy 0, policy_version 524987 (0.0009) [2023-12-27 23:00:47,171][106226] Updated weights for policy 0, policy_version 524997 (0.0005) [2023-12-27 23:00:47,233][106226] Updated weights for policy 0, policy_version 525007 (0.0007) [2023-12-27 23:00:47,417][106225] Updated weights for policy 1, policy_version 526355 (0.0008) [2023-12-27 23:00:47,474][106225] Updated weights for policy 1, policy_version 526365 (0.0009) [2023-12-27 23:00:47,529][106225] Updated weights for policy 1, policy_version 526375 (0.0008) [2023-12-27 23:00:47,888][106226] Updated weights for policy 0, policy_version 525017 (0.0009) [2023-12-27 23:00:47,947][106226] Updated weights for policy 0, policy_version 525027 (0.0008) [2023-12-27 23:00:48,002][106226] Updated weights for policy 0, policy_version 525037 (0.0008) [2023-12-27 23:00:48,063][106226] Updated weights for policy 0, policy_version 525047 (0.0009) [2023-12-27 23:00:48,251][106225] Updated weights for policy 1, policy_version 526385 (0.0009) [2023-12-27 23:00:48,314][106225] Updated weights for policy 1, policy_version 526395 (0.0009) [2023-12-27 23:00:48,383][106225] Updated weights for policy 1, policy_version 526405 (0.0007) [2023-12-27 23:00:48,448][106225] Updated weights for policy 1, policy_version 526415 (0.0008) [2023-12-27 23:00:48,845][106226] Updated weights for policy 0, policy_version 525057 (0.0009) [2023-12-27 23:00:48,909][106226] Updated weights for policy 0, policy_version 525067 (0.0009) [2023-12-27 23:00:48,973][106226] Updated weights for policy 0, policy_version 525077 (0.0008) [2023-12-27 23:00:49,199][106225] Updated weights for policy 1, policy_version 526425 (0.0009) [2023-12-27 23:00:49,277][106225] Updated weights for policy 1, policy_version 526435 (0.0009) [2023-12-27 23:00:49,343][106225] Updated weights for policy 1, policy_version 526445 (0.0009) [2023-12-27 23:00:49,702][106226] Updated weights for policy 0, policy_version 525087 (0.0010) [2023-12-27 23:00:49,773][106226] Updated weights for policy 0, policy_version 525097 (0.0006) [2023-12-27 23:00:49,839][106226] Updated weights for policy 0, policy_version 525107 (0.0007) [2023-12-27 23:00:50,097][106225] Updated weights for policy 1, policy_version 526455 (0.0008) [2023-12-27 23:00:50,157][106225] Updated weights for policy 1, policy_version 526465 (0.0008) [2023-12-27 23:00:50,213][106225] Updated weights for policy 1, policy_version 526475 (0.0008) [2023-12-27 23:00:50,591][106226] Updated weights for policy 0, policy_version 525117 (0.0008) [2023-12-27 23:00:50,660][106226] Updated weights for policy 0, policy_version 525127 (0.0008) [2023-12-27 23:00:50,725][106226] Updated weights for policy 0, policy_version 525137 (0.0009) [2023-12-27 23:00:50,977][106225] Updated weights for policy 1, policy_version 526485 (0.0008) [2023-12-27 23:00:51,048][106225] Updated weights for policy 1, policy_version 526495 (0.0008) [2023-12-27 23:00:51,113][106225] Updated weights for policy 1, policy_version 526505 (0.0009) [2023-12-27 23:00:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 269287424. Throughput: 0: 9606.9, 1: 10124.6. Samples: 269294648. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:00:51,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-5.396')] [2023-12-27 23:00:51,520][106226] Updated weights for policy 0, policy_version 525147 (0.0007) [2023-12-27 23:00:51,574][106226] Updated weights for policy 0, policy_version 525157 (0.0008) [2023-12-27 23:00:51,633][106226] Updated weights for policy 0, policy_version 525167 (0.0008) [2023-12-27 23:00:51,920][106225] Updated weights for policy 1, policy_version 526515 (0.0009) [2023-12-27 23:00:51,979][106225] Updated weights for policy 1, policy_version 526525 (0.0010) [2023-12-27 23:00:52,035][106225] Updated weights for policy 1, policy_version 526535 (0.0008) [2023-12-27 23:00:52,404][106226] Updated weights for policy 0, policy_version 525177 (0.0007) [2023-12-27 23:00:52,461][106226] Updated weights for policy 0, policy_version 525187 (0.0008) [2023-12-27 23:00:52,531][106226] Updated weights for policy 0, policy_version 525197 (0.0008) [2023-12-27 23:00:52,599][106226] Updated weights for policy 0, policy_version 525207 (0.0007) [2023-12-27 23:00:52,825][106225] Updated weights for policy 1, policy_version 526545 (0.0008) [2023-12-27 23:00:52,884][106225] Updated weights for policy 1, policy_version 526555 (0.0007) [2023-12-27 23:00:52,940][106225] Updated weights for policy 1, policy_version 526565 (0.0007) [2023-12-27 23:00:52,994][106225] Updated weights for policy 1, policy_version 526575 (0.0010) [2023-12-27 23:00:53,271][106226] Updated weights for policy 0, policy_version 525217 (0.0006) [2023-12-27 23:00:53,335][106226] Updated weights for policy 0, policy_version 525227 (0.0006) [2023-12-27 23:00:53,392][106226] Updated weights for policy 0, policy_version 525237 (0.0009) [2023-12-27 23:00:53,616][106225] Updated weights for policy 1, policy_version 526585 (0.0010) [2023-12-27 23:00:53,676][106225] Updated weights for policy 1, policy_version 526595 (0.0010) [2023-12-27 23:00:53,737][106225] Updated weights for policy 1, policy_version 526605 (0.0010) [2023-12-27 23:00:54,116][106226] Updated weights for policy 0, policy_version 525247 (0.0008) [2023-12-27 23:00:54,177][106226] Updated weights for policy 0, policy_version 525257 (0.0007) [2023-12-27 23:00:54,239][106226] Updated weights for policy 0, policy_version 525267 (0.0008) [2023-12-27 23:00:54,486][106225] Updated weights for policy 1, policy_version 526615 (0.0010) [2023-12-27 23:00:54,546][106225] Updated weights for policy 1, policy_version 526625 (0.0010) [2023-12-27 23:00:54,606][106225] Updated weights for policy 1, policy_version 526635 (0.0010) [2023-12-27 23:00:54,945][106226] Updated weights for policy 0, policy_version 525277 (0.0007) [2023-12-27 23:00:55,013][106226] Updated weights for policy 0, policy_version 525287 (0.0007) [2023-12-27 23:00:55,078][106226] Updated weights for policy 0, policy_version 525297 (0.0005) [2023-12-27 23:00:55,348][106225] Updated weights for policy 1, policy_version 526645 (0.0010) [2023-12-27 23:00:55,408][106225] Updated weights for policy 1, policy_version 526655 (0.0010) [2023-12-27 23:00:55,474][106225] Updated weights for policy 1, policy_version 526665 (0.0010) [2023-12-27 23:00:55,696][106226] Updated weights for policy 0, policy_version 525307 (0.0007) [2023-12-27 23:00:55,750][106226] Updated weights for policy 0, policy_version 525317 (0.0007) [2023-12-27 23:00:55,814][106226] Updated weights for policy 0, policy_version 525327 (0.0007) [2023-12-27 23:00:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 269377536. Throughput: 0: 9565.4, 1: 10047.2. Samples: 269351316. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:00:56,176][105115] Avg episode reward: [(0, '-5.251'), (1, '-5.578')] [2023-12-27 23:00:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000525336_134520832.pth... [2023-12-27 23:00:56,186][106225] Updated weights for policy 1, policy_version 526675 (0.0011) [2023-12-27 23:00:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000524216_134234112.pth [2023-12-27 23:00:56,244][106225] Updated weights for policy 1, policy_version 526685 (0.0008) [2023-12-27 23:00:56,302][106225] Updated weights for policy 1, policy_version 526695 (0.0009) [2023-12-27 23:00:56,356][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000526704_134864896.pth... [2023-12-27 23:00:56,360][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000525520_134561792.pth [2023-12-27 23:00:56,548][106226] Updated weights for policy 0, policy_version 525337 (0.0008) [2023-12-27 23:00:56,602][106226] Updated weights for policy 0, policy_version 525347 (0.0009) [2023-12-27 23:00:56,660][106226] Updated weights for policy 0, policy_version 525357 (0.0008) [2023-12-27 23:00:56,711][106226] Updated weights for policy 0, policy_version 525367 (0.0008) [2023-12-27 23:00:56,972][106225] Updated weights for policy 1, policy_version 526705 (0.0008) [2023-12-27 23:00:57,022][106225] Updated weights for policy 1, policy_version 526715 (0.0008) [2023-12-27 23:00:57,080][106225] Updated weights for policy 1, policy_version 526725 (0.0006) [2023-12-27 23:00:57,143][106225] Updated weights for policy 1, policy_version 526735 (0.0005) [2023-12-27 23:00:57,542][106226] Updated weights for policy 0, policy_version 525377 (0.0009) [2023-12-27 23:00:57,593][106226] Updated weights for policy 0, policy_version 525387 (0.0008) [2023-12-27 23:00:57,650][106226] Updated weights for policy 0, policy_version 525397 (0.0008) [2023-12-27 23:00:57,708][106225] Updated weights for policy 1, policy_version 526745 (0.0008) [2023-12-27 23:00:57,758][106225] Updated weights for policy 1, policy_version 526755 (0.0008) [2023-12-27 23:00:57,806][106225] Updated weights for policy 1, policy_version 526765 (0.0009) [2023-12-27 23:00:58,374][106226] Updated weights for policy 0, policy_version 525407 (0.0009) [2023-12-27 23:00:58,444][106226] Updated weights for policy 0, policy_version 525417 (0.0009) [2023-12-27 23:00:58,507][106226] Updated weights for policy 0, policy_version 525427 (0.0009) [2023-12-27 23:00:58,659][106225] Updated weights for policy 1, policy_version 526775 (0.0009) [2023-12-27 23:00:58,719][106225] Updated weights for policy 1, policy_version 526785 (0.0009) [2023-12-27 23:00:58,778][106225] Updated weights for policy 1, policy_version 526795 (0.0007) [2023-12-27 23:00:59,489][106226] Updated weights for policy 0, policy_version 525437 (0.0009) [2023-12-27 23:00:59,564][106226] Updated weights for policy 0, policy_version 525447 (0.0009) [2023-12-27 23:00:59,619][106226] Updated weights for policy 0, policy_version 525457 (0.0009) [2023-12-27 23:00:59,705][106225] Updated weights for policy 1, policy_version 526806 (0.0008) [2023-12-27 23:00:59,755][106225] Updated weights for policy 1, policy_version 526816 (0.0009) [2023-12-27 23:00:59,806][106225] Updated weights for policy 1, policy_version 526826 (0.0008) [2023-12-27 23:01:00,351][106226] Updated weights for policy 0, policy_version 525467 (0.0008) [2023-12-27 23:01:00,407][106226] Updated weights for policy 0, policy_version 525477 (0.0006) [2023-12-27 23:01:00,473][106226] Updated weights for policy 0, policy_version 525487 (0.0006) [2023-12-27 23:01:00,543][106225] Updated weights for policy 1, policy_version 526836 (0.0007) [2023-12-27 23:01:00,606][106225] Updated weights for policy 1, policy_version 526846 (0.0008) [2023-12-27 23:01:00,658][106225] Updated weights for policy 1, policy_version 526856 (0.0006) [2023-12-27 23:01:01,078][106226] Updated weights for policy 0, policy_version 525497 (0.0008) [2023-12-27 23:01:01,151][106226] Updated weights for policy 0, policy_version 525507 (0.0008) [2023-12-27 23:01:01,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 269467648. Throughput: 0: 9415.3, 1: 10002.9. Samples: 269462260. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:01,175][105115] Avg episode reward: [(0, '-5.270'), (1, '-5.691')] [2023-12-27 23:01:01,213][106226] Updated weights for policy 0, policy_version 525517 (0.0008) [2023-12-27 23:01:01,272][106226] Updated weights for policy 0, policy_version 525527 (0.0009) [2023-12-27 23:01:01,335][106225] Updated weights for policy 1, policy_version 526866 (0.0006) [2023-12-27 23:01:01,404][106225] Updated weights for policy 1, policy_version 526876 (0.0009) [2023-12-27 23:01:01,464][106225] Updated weights for policy 1, policy_version 526886 (0.0008) [2023-12-27 23:01:01,516][106225] Updated weights for policy 1, policy_version 526896 (0.0008) [2023-12-27 23:01:02,052][106226] Updated weights for policy 0, policy_version 525537 (0.0008) [2023-12-27 23:01:02,104][106226] Updated weights for policy 0, policy_version 525547 (0.0008) [2023-12-27 23:01:02,161][106226] Updated weights for policy 0, policy_version 525557 (0.0006) [2023-12-27 23:01:02,240][106225] Updated weights for policy 1, policy_version 526906 (0.0009) [2023-12-27 23:01:02,312][106225] Updated weights for policy 1, policy_version 526916 (0.0007) [2023-12-27 23:01:02,378][106225] Updated weights for policy 1, policy_version 526926 (0.0009) [2023-12-27 23:01:02,868][106226] Updated weights for policy 0, policy_version 525567 (0.0008) [2023-12-27 23:01:02,933][106226] Updated weights for policy 0, policy_version 525577 (0.0009) [2023-12-27 23:01:02,992][106226] Updated weights for policy 0, policy_version 525587 (0.0009) [2023-12-27 23:01:03,061][106225] Updated weights for policy 1, policy_version 526936 (0.0008) [2023-12-27 23:01:03,118][106225] Updated weights for policy 1, policy_version 526946 (0.0009) [2023-12-27 23:01:03,184][106225] Updated weights for policy 1, policy_version 526956 (0.0009) [2023-12-27 23:01:03,733][106226] Updated weights for policy 0, policy_version 525597 (0.0007) [2023-12-27 23:01:03,794][106226] Updated weights for policy 0, policy_version 525607 (0.0009) [2023-12-27 23:01:03,853][106226] Updated weights for policy 0, policy_version 525617 (0.0007) [2023-12-27 23:01:03,860][106225] Updated weights for policy 1, policy_version 526966 (0.0008) [2023-12-27 23:01:03,925][106225] Updated weights for policy 1, policy_version 526976 (0.0006) [2023-12-27 23:01:03,986][106225] Updated weights for policy 1, policy_version 526986 (0.0008) [2023-12-27 23:01:04,611][106226] Updated weights for policy 0, policy_version 525627 (0.0008) [2023-12-27 23:01:04,671][106226] Updated weights for policy 0, policy_version 525637 (0.0008) [2023-12-27 23:01:04,678][106225] Updated weights for policy 1, policy_version 526996 (0.0006) [2023-12-27 23:01:04,720][106226] Updated weights for policy 0, policy_version 525647 (0.0008) [2023-12-27 23:01:04,735][106225] Updated weights for policy 1, policy_version 527006 (0.0005) [2023-12-27 23:01:04,800][106225] Updated weights for policy 1, policy_version 527016 (0.0005) [2023-12-27 23:01:05,354][106225] Updated weights for policy 1, policy_version 527026 (0.0006) [2023-12-27 23:01:05,405][106225] Updated weights for policy 1, policy_version 527036 (0.0008) [2023-12-27 23:01:05,466][106225] Updated weights for policy 1, policy_version 527046 (0.0008) [2023-12-27 23:01:05,515][106226] Updated weights for policy 0, policy_version 525657 (0.0009) [2023-12-27 23:01:05,526][106225] Updated weights for policy 1, policy_version 527056 (0.0008) [2023-12-27 23:01:05,573][106226] Updated weights for policy 0, policy_version 525667 (0.0008) [2023-12-27 23:01:05,626][106226] Updated weights for policy 0, policy_version 525677 (0.0009) [2023-12-27 23:01:05,685][106226] Updated weights for policy 0, policy_version 525687 (0.0008) [2023-12-27 23:01:06,175][105115] Fps is (10 sec: 18842.1, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 269565952. Throughput: 0: 9392.2, 1: 10042.7. Samples: 269578888. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:06,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-5.369')] [2023-12-27 23:01:06,185][106225] Updated weights for policy 1, policy_version 527066 (0.0010) [2023-12-27 23:01:06,244][106225] Updated weights for policy 1, policy_version 527076 (0.0011) [2023-12-27 23:01:06,306][106225] Updated weights for policy 1, policy_version 527086 (0.0007) [2023-12-27 23:01:06,486][106226] Updated weights for policy 0, policy_version 525697 (0.0008) [2023-12-27 23:01:06,535][106226] Updated weights for policy 0, policy_version 525707 (0.0008) [2023-12-27 23:01:06,588][106226] Updated weights for policy 0, policy_version 525717 (0.0008) [2023-12-27 23:01:07,040][106225] Updated weights for policy 1, policy_version 527096 (0.0009) [2023-12-27 23:01:07,098][106225] Updated weights for policy 1, policy_version 527106 (0.0011) [2023-12-27 23:01:07,155][106225] Updated weights for policy 1, policy_version 527116 (0.0010) [2023-12-27 23:01:07,257][106226] Updated weights for policy 0, policy_version 525727 (0.0007) [2023-12-27 23:01:07,316][106226] Updated weights for policy 0, policy_version 525737 (0.0005) [2023-12-27 23:01:07,380][106226] Updated weights for policy 0, policy_version 525747 (0.0008) [2023-12-27 23:01:07,835][106225] Updated weights for policy 1, policy_version 527126 (0.0010) [2023-12-27 23:01:07,897][106225] Updated weights for policy 1, policy_version 527136 (0.0010) [2023-12-27 23:01:07,954][106225] Updated weights for policy 1, policy_version 527146 (0.0010) [2023-12-27 23:01:07,975][106226] Updated weights for policy 0, policy_version 525757 (0.0006) [2023-12-27 23:01:08,027][106226] Updated weights for policy 0, policy_version 525767 (0.0007) [2023-12-27 23:01:08,081][106226] Updated weights for policy 0, policy_version 525777 (0.0007) [2023-12-27 23:01:08,616][106225] Updated weights for policy 1, policy_version 527156 (0.0009) [2023-12-27 23:01:08,674][106225] Updated weights for policy 1, policy_version 527166 (0.0006) [2023-12-27 23:01:08,733][106225] Updated weights for policy 1, policy_version 527176 (0.0005) [2023-12-27 23:01:08,813][106226] Updated weights for policy 0, policy_version 525787 (0.0007) [2023-12-27 23:01:08,872][106226] Updated weights for policy 0, policy_version 525797 (0.0008) [2023-12-27 23:01:08,928][106226] Updated weights for policy 0, policy_version 525807 (0.0008) [2023-12-27 23:01:09,362][106225] Updated weights for policy 1, policy_version 527186 (0.0006) [2023-12-27 23:01:09,431][106225] Updated weights for policy 1, policy_version 527196 (0.0007) [2023-12-27 23:01:09,496][106225] Updated weights for policy 1, policy_version 527206 (0.0008) [2023-12-27 23:01:09,561][106225] Updated weights for policy 1, policy_version 527216 (0.0008) [2023-12-27 23:01:09,774][106226] Updated weights for policy 0, policy_version 525817 (0.0010) [2023-12-27 23:01:09,827][106226] Updated weights for policy 0, policy_version 525827 (0.0009) [2023-12-27 23:01:09,884][106226] Updated weights for policy 0, policy_version 525837 (0.0009) [2023-12-27 23:01:09,951][106226] Updated weights for policy 0, policy_version 525847 (0.0009) [2023-12-27 23:01:10,332][106225] Updated weights for policy 1, policy_version 527226 (0.0008) [2023-12-27 23:01:10,389][106225] Updated weights for policy 1, policy_version 527236 (0.0008) [2023-12-27 23:01:10,446][106225] Updated weights for policy 1, policy_version 527246 (0.0009) [2023-12-27 23:01:10,725][106226] Updated weights for policy 0, policy_version 525857 (0.0009) [2023-12-27 23:01:10,781][106226] Updated weights for policy 0, policy_version 525867 (0.0008) [2023-12-27 23:01:10,839][106226] Updated weights for policy 0, policy_version 525877 (0.0009) [2023-12-27 23:01:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 269664256. Throughput: 0: 9430.2, 1: 10111.3. Samples: 269639248. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:11,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-5.265')] [2023-12-27 23:01:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000525880_134660096.pth... [2023-12-27 23:01:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000524760_134373376.pth [2023-12-27 23:01:11,193][106225] Updated weights for policy 1, policy_version 527256 (0.0008) [2023-12-27 23:01:11,262][106225] Updated weights for policy 1, policy_version 527266 (0.0007) [2023-12-27 23:01:11,332][106225] Updated weights for policy 1, policy_version 527276 (0.0008) [2023-12-27 23:01:11,366][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000527280_135012352.pth... [2023-12-27 23:01:11,371][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000526128_134717440.pth [2023-12-27 23:01:11,667][106226] Updated weights for policy 0, policy_version 525887 (0.0009) [2023-12-27 23:01:11,739][106226] Updated weights for policy 0, policy_version 525897 (0.0008) [2023-12-27 23:01:11,797][106226] Updated weights for policy 0, policy_version 525907 (0.0010) [2023-12-27 23:01:12,010][106225] Updated weights for policy 1, policy_version 527286 (0.0008) [2023-12-27 23:01:12,072][106225] Updated weights for policy 1, policy_version 527296 (0.0008) [2023-12-27 23:01:12,126][106225] Updated weights for policy 1, policy_version 527306 (0.0009) [2023-12-27 23:01:12,558][106226] Updated weights for policy 0, policy_version 525917 (0.0008) [2023-12-27 23:01:12,624][106226] Updated weights for policy 0, policy_version 525927 (0.0008) [2023-12-27 23:01:12,689][106226] Updated weights for policy 0, policy_version 525937 (0.0006) [2023-12-27 23:01:12,887][106225] Updated weights for policy 1, policy_version 527316 (0.0008) [2023-12-27 23:01:12,957][106225] Updated weights for policy 1, policy_version 527326 (0.0008) [2023-12-27 23:01:13,023][106225] Updated weights for policy 1, policy_version 527336 (0.0008) [2023-12-27 23:01:13,315][106226] Updated weights for policy 0, policy_version 525947 (0.0009) [2023-12-27 23:01:13,370][106226] Updated weights for policy 0, policy_version 525957 (0.0005) [2023-12-27 23:01:13,425][106226] Updated weights for policy 0, policy_version 525967 (0.0005) [2023-12-27 23:01:13,632][106225] Updated weights for policy 1, policy_version 527346 (0.0007) [2023-12-27 23:01:13,685][106225] Updated weights for policy 1, policy_version 527356 (0.0005) [2023-12-27 23:01:13,754][106225] Updated weights for policy 1, policy_version 527366 (0.0006) [2023-12-27 23:01:13,815][106225] Updated weights for policy 1, policy_version 527376 (0.0009) [2023-12-27 23:01:14,036][106226] Updated weights for policy 0, policy_version 525977 (0.0006) [2023-12-27 23:01:14,091][106226] Updated weights for policy 0, policy_version 525987 (0.0005) [2023-12-27 23:01:14,152][106226] Updated weights for policy 0, policy_version 525997 (0.0009) [2023-12-27 23:01:14,215][106226] Updated weights for policy 0, policy_version 526007 (0.0009) [2023-12-27 23:01:14,480][106225] Updated weights for policy 1, policy_version 527386 (0.0009) [2023-12-27 23:01:14,532][106225] Updated weights for policy 1, policy_version 527396 (0.0008) [2023-12-27 23:01:14,588][106225] Updated weights for policy 1, policy_version 527406 (0.0009) [2023-12-27 23:01:14,920][106226] Updated weights for policy 0, policy_version 526017 (0.0008) [2023-12-27 23:01:15,001][106226] Updated weights for policy 0, policy_version 526027 (0.0009) [2023-12-27 23:01:15,062][106226] Updated weights for policy 0, policy_version 526037 (0.0009) [2023-12-27 23:01:15,330][106225] Updated weights for policy 1, policy_version 527416 (0.0009) [2023-12-27 23:01:15,390][106225] Updated weights for policy 1, policy_version 527426 (0.0008) [2023-12-27 23:01:15,440][106225] Updated weights for policy 1, policy_version 527436 (0.0008) [2023-12-27 23:01:15,715][106226] Updated weights for policy 0, policy_version 526047 (0.0008) [2023-12-27 23:01:15,781][106226] Updated weights for policy 0, policy_version 526057 (0.0010) [2023-12-27 23:01:15,831][106226] Updated weights for policy 0, policy_version 526067 (0.0009) [2023-12-27 23:01:16,121][106225] Updated weights for policy 1, policy_version 527446 (0.0008) [2023-12-27 23:01:16,170][106225] Updated weights for policy 1, policy_version 527456 (0.0008) [2023-12-27 23:01:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 269762560. Throughput: 0: 9450.7, 1: 9920.4. Samples: 269754736. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:16,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.733')] [2023-12-27 23:01:16,225][106225] Updated weights for policy 1, policy_version 527466 (0.0009) [2023-12-27 23:01:16,535][106226] Updated weights for policy 0, policy_version 526077 (0.0007) [2023-12-27 23:01:16,602][106226] Updated weights for policy 0, policy_version 526087 (0.0005) [2023-12-27 23:01:16,671][106226] Updated weights for policy 0, policy_version 526097 (0.0007) [2023-12-27 23:01:16,918][106225] Updated weights for policy 1, policy_version 527476 (0.0007) [2023-12-27 23:01:16,963][106225] Updated weights for policy 1, policy_version 527486 (0.0008) [2023-12-27 23:01:17,022][106225] Updated weights for policy 1, policy_version 527496 (0.0007) [2023-12-27 23:01:17,336][106226] Updated weights for policy 0, policy_version 526107 (0.0007) [2023-12-27 23:01:17,394][106226] Updated weights for policy 0, policy_version 526117 (0.0005) [2023-12-27 23:01:17,445][106226] Updated weights for policy 0, policy_version 526127 (0.0005) [2023-12-27 23:01:17,728][106225] Updated weights for policy 1, policy_version 527506 (0.0008) [2023-12-27 23:01:17,788][106225] Updated weights for policy 1, policy_version 527516 (0.0009) [2023-12-27 23:01:17,839][106225] Updated weights for policy 1, policy_version 527526 (0.0009) [2023-12-27 23:01:17,891][106225] Updated weights for policy 1, policy_version 527536 (0.0008) [2023-12-27 23:01:18,016][106226] Updated weights for policy 0, policy_version 526137 (0.0006) [2023-12-27 23:01:18,071][106226] Updated weights for policy 0, policy_version 526147 (0.0008) [2023-12-27 23:01:18,138][106226] Updated weights for policy 0, policy_version 526157 (0.0009) [2023-12-27 23:01:18,196][106226] Updated weights for policy 0, policy_version 526167 (0.0008) [2023-12-27 23:01:18,645][106225] Updated weights for policy 1, policy_version 527546 (0.0007) [2023-12-27 23:01:18,703][106225] Updated weights for policy 1, policy_version 527556 (0.0010) [2023-12-27 23:01:18,754][106225] Updated weights for policy 1, policy_version 527566 (0.0010) [2023-12-27 23:01:18,864][106226] Updated weights for policy 0, policy_version 526177 (0.0006) [2023-12-27 23:01:18,918][106226] Updated weights for policy 0, policy_version 526187 (0.0008) [2023-12-27 23:01:18,969][106226] Updated weights for policy 0, policy_version 526197 (0.0009) [2023-12-27 23:01:19,398][106225] Updated weights for policy 1, policy_version 527576 (0.0011) [2023-12-27 23:01:19,455][106225] Updated weights for policy 1, policy_version 527586 (0.0010) [2023-12-27 23:01:19,521][106225] Updated weights for policy 1, policy_version 527596 (0.0009) [2023-12-27 23:01:19,689][106226] Updated weights for policy 0, policy_version 526207 (0.0008) [2023-12-27 23:01:19,758][106226] Updated weights for policy 0, policy_version 526217 (0.0008) [2023-12-27 23:01:19,827][106226] Updated weights for policy 0, policy_version 526227 (0.0008) [2023-12-27 23:01:20,284][106225] Updated weights for policy 1, policy_version 527606 (0.0009) [2023-12-27 23:01:20,349][106225] Updated weights for policy 1, policy_version 527616 (0.0010) [2023-12-27 23:01:20,411][106225] Updated weights for policy 1, policy_version 527626 (0.0009) [2023-12-27 23:01:20,467][106226] Updated weights for policy 0, policy_version 526237 (0.0008) [2023-12-27 23:01:20,531][106226] Updated weights for policy 0, policy_version 526247 (0.0009) [2023-12-27 23:01:20,599][106226] Updated weights for policy 0, policy_version 526257 (0.0010) [2023-12-27 23:01:21,138][106225] Updated weights for policy 1, policy_version 527636 (0.0008) [2023-12-27 23:01:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 269860864. Throughput: 0: 9545.2, 1: 9807.5. Samples: 269874608. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:21,176][105115] Avg episode reward: [(0, '-5.241'), (1, '-5.749')] [2023-12-27 23:01:21,188][106225] Updated weights for policy 1, policy_version 527646 (0.0008) [2023-12-27 23:01:21,242][106225] Updated weights for policy 1, policy_version 527656 (0.0008) [2023-12-27 23:01:21,400][106226] Updated weights for policy 0, policy_version 526267 (0.0009) [2023-12-27 23:01:21,461][106226] Updated weights for policy 0, policy_version 526277 (0.0010) [2023-12-27 23:01:21,514][106226] Updated weights for policy 0, policy_version 526287 (0.0008) [2023-12-27 23:01:22,043][106225] Updated weights for policy 1, policy_version 527666 (0.0008) [2023-12-27 23:01:22,107][106225] Updated weights for policy 1, policy_version 527676 (0.0008) [2023-12-27 23:01:22,170][106225] Updated weights for policy 1, policy_version 527686 (0.0009) [2023-12-27 23:01:22,231][106225] Updated weights for policy 1, policy_version 527696 (0.0009) [2023-12-27 23:01:22,369][106226] Updated weights for policy 0, policy_version 526297 (0.0010) [2023-12-27 23:01:22,429][106226] Updated weights for policy 0, policy_version 526307 (0.0007) [2023-12-27 23:01:22,490][106226] Updated weights for policy 0, policy_version 526317 (0.0008) [2023-12-27 23:01:22,544][106226] Updated weights for policy 0, policy_version 526327 (0.0009) [2023-12-27 23:01:22,901][106225] Updated weights for policy 1, policy_version 527706 (0.0009) [2023-12-27 23:01:22,965][106225] Updated weights for policy 1, policy_version 527716 (0.0009) [2023-12-27 23:01:23,023][106225] Updated weights for policy 1, policy_version 527726 (0.0009) [2023-12-27 23:01:23,369][106226] Updated weights for policy 0, policy_version 526337 (0.0009) [2023-12-27 23:01:23,433][106226] Updated weights for policy 0, policy_version 526347 (0.0009) [2023-12-27 23:01:23,490][106226] Updated weights for policy 0, policy_version 526357 (0.0009) [2023-12-27 23:01:23,693][106225] Updated weights for policy 1, policy_version 527736 (0.0009) [2023-12-27 23:01:23,755][106225] Updated weights for policy 1, policy_version 527746 (0.0008) [2023-12-27 23:01:23,809][106225] Updated weights for policy 1, policy_version 527756 (0.0009) [2023-12-27 23:01:24,057][106226] Updated weights for policy 0, policy_version 526367 (0.0007) [2023-12-27 23:01:24,124][106226] Updated weights for policy 0, policy_version 526377 (0.0007) [2023-12-27 23:01:24,187][106226] Updated weights for policy 0, policy_version 526387 (0.0005) [2023-12-27 23:01:24,634][106225] Updated weights for policy 1, policy_version 527767 (0.0010) [2023-12-27 23:01:24,687][106225] Updated weights for policy 1, policy_version 527777 (0.0008) [2023-12-27 23:01:24,696][106226] Updated weights for policy 0, policy_version 526397 (0.0005) [2023-12-27 23:01:24,735][106225] Updated weights for policy 1, policy_version 527787 (0.0006) [2023-12-27 23:01:24,745][106226] Updated weights for policy 0, policy_version 526407 (0.0005) [2023-12-27 23:01:24,795][106226] Updated weights for policy 0, policy_version 526417 (0.0007) [2023-12-27 23:01:25,333][106225] Updated weights for policy 1, policy_version 527797 (0.0007) [2023-12-27 23:01:25,383][106225] Updated weights for policy 1, policy_version 527807 (0.0007) [2023-12-27 23:01:25,443][106225] Updated weights for policy 1, policy_version 527817 (0.0010) [2023-12-27 23:01:25,561][106226] Updated weights for policy 0, policy_version 526427 (0.0008) [2023-12-27 23:01:25,617][106226] Updated weights for policy 0, policy_version 526437 (0.0009) [2023-12-27 23:01:25,669][106226] Updated weights for policy 0, policy_version 526447 (0.0008) [2023-12-27 23:01:26,055][106225] Updated weights for policy 1, policy_version 527827 (0.0010) [2023-12-27 23:01:26,118][106225] Updated weights for policy 1, policy_version 527837 (0.0010) [2023-12-27 23:01:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 269959168. Throughput: 0: 9549.3, 1: 9722.7. Samples: 269931404. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:26,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-5.432')] [2023-12-27 23:01:26,179][106225] Updated weights for policy 1, policy_version 527847 (0.0010) [2023-12-27 23:01:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000526456_134807552.pth... [2023-12-27 23:01:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000525336_134520832.pth [2023-12-27 23:01:26,222][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000527856_135159808.pth... [2023-12-27 23:01:26,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000526704_134864896.pth [2023-12-27 23:01:26,360][106226] Updated weights for policy 0, policy_version 526457 (0.0009) [2023-12-27 23:01:26,410][106226] Updated weights for policy 0, policy_version 526467 (0.0010) [2023-12-27 23:01:26,459][106226] Updated weights for policy 0, policy_version 526477 (0.0010) [2023-12-27 23:01:26,506][106226] Updated weights for policy 0, policy_version 526487 (0.0010) [2023-12-27 23:01:26,855][106225] Updated weights for policy 1, policy_version 527857 (0.0008) [2023-12-27 23:01:26,915][106225] Updated weights for policy 1, policy_version 527867 (0.0007) [2023-12-27 23:01:26,971][106225] Updated weights for policy 1, policy_version 527877 (0.0005) [2023-12-27 23:01:27,022][106225] Updated weights for policy 1, policy_version 527887 (0.0005) [2023-12-27 23:01:27,258][106226] Updated weights for policy 0, policy_version 526497 (0.0010) [2023-12-27 23:01:27,307][106226] Updated weights for policy 0, policy_version 526507 (0.0010) [2023-12-27 23:01:27,368][106226] Updated weights for policy 0, policy_version 526517 (0.0010) [2023-12-27 23:01:27,633][106225] Updated weights for policy 1, policy_version 527897 (0.0007) [2023-12-27 23:01:27,684][106225] Updated weights for policy 1, policy_version 527907 (0.0007) [2023-12-27 23:01:27,730][106225] Updated weights for policy 1, policy_version 527917 (0.0008) [2023-12-27 23:01:28,062][106226] Updated weights for policy 0, policy_version 526527 (0.0008) [2023-12-27 23:01:28,113][106226] Updated weights for policy 0, policy_version 526537 (0.0010) [2023-12-27 23:01:28,163][106226] Updated weights for policy 0, policy_version 526547 (0.0010) [2023-12-27 23:01:28,402][106225] Updated weights for policy 1, policy_version 527927 (0.0008) [2023-12-27 23:01:28,465][106225] Updated weights for policy 1, policy_version 527937 (0.0006) [2023-12-27 23:01:28,526][106225] Updated weights for policy 1, policy_version 527947 (0.0008) [2023-12-27 23:01:28,893][106226] Updated weights for policy 0, policy_version 526557 (0.0010) [2023-12-27 23:01:28,946][106226] Updated weights for policy 0, policy_version 526567 (0.0010) [2023-12-27 23:01:29,005][106226] Updated weights for policy 0, policy_version 526577 (0.0010) [2023-12-27 23:01:29,138][106225] Updated weights for policy 1, policy_version 527957 (0.0009) [2023-12-27 23:01:29,194][106225] Updated weights for policy 1, policy_version 527967 (0.0010) [2023-12-27 23:01:29,260][106225] Updated weights for policy 1, policy_version 527977 (0.0009) [2023-12-27 23:01:29,759][106226] Updated weights for policy 0, policy_version 526587 (0.0010) [2023-12-27 23:01:29,814][106226] Updated weights for policy 0, policy_version 526597 (0.0009) [2023-12-27 23:01:29,884][106226] Updated weights for policy 0, policy_version 526607 (0.0009) [2023-12-27 23:01:29,935][106225] Updated weights for policy 1, policy_version 527987 (0.0008) [2023-12-27 23:01:30,004][106225] Updated weights for policy 1, policy_version 527997 (0.0008) [2023-12-27 23:01:30,067][106225] Updated weights for policy 1, policy_version 528007 (0.0008) [2023-12-27 23:01:30,503][106226] Updated weights for policy 0, policy_version 526617 (0.0008) [2023-12-27 23:01:30,572][106226] Updated weights for policy 0, policy_version 526627 (0.0005) [2023-12-27 23:01:30,635][106226] Updated weights for policy 0, policy_version 526637 (0.0007) [2023-12-27 23:01:30,664][106225] Updated weights for policy 1, policy_version 528017 (0.0007) [2023-12-27 23:01:30,688][106226] Updated weights for policy 0, policy_version 526647 (0.0006) [2023-12-27 23:01:30,711][106225] Updated weights for policy 1, policy_version 528027 (0.0005) [2023-12-27 23:01:30,769][106225] Updated weights for policy 1, policy_version 528037 (0.0005) [2023-12-27 23:01:30,823][106225] Updated weights for policy 1, policy_version 528047 (0.0005) [2023-12-27 23:01:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 270065664. Throughput: 0: 9619.1, 1: 9773.2. Samples: 270053556. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:31,175][105115] Avg episode reward: [(0, '-4.888'), (1, '-5.728')] [2023-12-27 23:01:31,212][106226] Updated weights for policy 0, policy_version 526657 (0.0008) [2023-12-27 23:01:31,273][106226] Updated weights for policy 0, policy_version 526667 (0.0010) [2023-12-27 23:01:31,341][106226] Updated weights for policy 0, policy_version 526677 (0.0011) [2023-12-27 23:01:31,486][106225] Updated weights for policy 1, policy_version 528057 (0.0007) [2023-12-27 23:01:31,549][106225] Updated weights for policy 1, policy_version 528067 (0.0005) [2023-12-27 23:01:31,609][106225] Updated weights for policy 1, policy_version 528077 (0.0007) [2023-12-27 23:01:32,083][106226] Updated weights for policy 0, policy_version 526687 (0.0008) [2023-12-27 23:01:32,147][106226] Updated weights for policy 0, policy_version 526697 (0.0009) [2023-12-27 23:01:32,210][106226] Updated weights for policy 0, policy_version 526707 (0.0009) [2023-12-27 23:01:32,313][106225] Updated weights for policy 1, policy_version 528087 (0.0008) [2023-12-27 23:01:32,373][106225] Updated weights for policy 1, policy_version 528097 (0.0008) [2023-12-27 23:01:32,439][106225] Updated weights for policy 1, policy_version 528107 (0.0006) [2023-12-27 23:01:32,770][106226] Updated weights for policy 0, policy_version 526717 (0.0008) [2023-12-27 23:01:32,833][106226] Updated weights for policy 0, policy_version 526727 (0.0010) [2023-12-27 23:01:32,899][106226] Updated weights for policy 0, policy_version 526737 (0.0006) [2023-12-27 23:01:33,098][106225] Updated weights for policy 1, policy_version 528117 (0.0006) [2023-12-27 23:01:33,144][106225] Updated weights for policy 1, policy_version 528127 (0.0006) [2023-12-27 23:01:33,209][106225] Updated weights for policy 1, policy_version 528137 (0.0005) [2023-12-27 23:01:33,538][106226] Updated weights for policy 0, policy_version 526747 (0.0007) [2023-12-27 23:01:33,603][106226] Updated weights for policy 0, policy_version 526757 (0.0011) [2023-12-27 23:01:33,673][106226] Updated weights for policy 0, policy_version 526767 (0.0011) [2023-12-27 23:01:33,827][106225] Updated weights for policy 1, policy_version 528147 (0.0005) [2023-12-27 23:01:33,877][106225] Updated weights for policy 1, policy_version 528157 (0.0005) [2023-12-27 23:01:33,924][106225] Updated weights for policy 1, policy_version 528167 (0.0005) [2023-12-27 23:01:34,379][106226] Updated weights for policy 0, policy_version 526777 (0.0011) [2023-12-27 23:01:34,445][106226] Updated weights for policy 0, policy_version 526787 (0.0011) [2023-12-27 23:01:34,509][106226] Updated weights for policy 0, policy_version 526797 (0.0011) [2023-12-27 23:01:34,574][106226] Updated weights for policy 0, policy_version 526807 (0.0011) [2023-12-27 23:01:34,622][106225] Updated weights for policy 1, policy_version 528177 (0.0006) [2023-12-27 23:01:34,684][106225] Updated weights for policy 1, policy_version 528187 (0.0010) [2023-12-27 23:01:34,745][106225] Updated weights for policy 1, policy_version 528197 (0.0010) [2023-12-27 23:01:34,808][106225] Updated weights for policy 1, policy_version 528207 (0.0010) [2023-12-27 23:01:35,275][106226] Updated weights for policy 0, policy_version 526817 (0.0010) [2023-12-27 23:01:35,318][106226] Updated weights for policy 0, policy_version 526827 (0.0011) [2023-12-27 23:01:35,366][106226] Updated weights for policy 0, policy_version 526837 (0.0005) [2023-12-27 23:01:35,529][106225] Updated weights for policy 1, policy_version 528217 (0.0010) [2023-12-27 23:01:35,596][106225] Updated weights for policy 1, policy_version 528227 (0.0010) [2023-12-27 23:01:35,646][106225] Updated weights for policy 1, policy_version 528237 (0.0010) [2023-12-27 23:01:35,951][106226] Updated weights for policy 0, policy_version 526847 (0.0005) [2023-12-27 23:01:36,009][106226] Updated weights for policy 0, policy_version 526857 (0.0005) [2023-12-27 23:01:36,067][106226] Updated weights for policy 0, policy_version 526867 (0.0006) [2023-12-27 23:01:36,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 270172160. Throughput: 0: 9751.1, 1: 9900.2. Samples: 270178956. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:36,175][105115] Avg episode reward: [(0, '-5.271'), (1, '-5.457')] [2023-12-27 23:01:36,363][106225] Updated weights for policy 1, policy_version 528247 (0.0010) [2023-12-27 23:01:36,431][106225] Updated weights for policy 1, policy_version 528257 (0.0011) [2023-12-27 23:01:36,490][106225] Updated weights for policy 1, policy_version 528267 (0.0011) [2023-12-27 23:01:36,688][106226] Updated weights for policy 0, policy_version 526877 (0.0008) [2023-12-27 23:01:36,757][106226] Updated weights for policy 0, policy_version 526887 (0.0011) [2023-12-27 23:01:36,822][106226] Updated weights for policy 0, policy_version 526897 (0.0011) [2023-12-27 23:01:37,246][106225] Updated weights for policy 1, policy_version 528277 (0.0010) [2023-12-27 23:01:37,296][106225] Updated weights for policy 1, policy_version 528287 (0.0008) [2023-12-27 23:01:37,348][106225] Updated weights for policy 1, policy_version 528297 (0.0007) [2023-12-27 23:01:37,534][106226] Updated weights for policy 0, policy_version 526907 (0.0011) [2023-12-27 23:01:37,595][106226] Updated weights for policy 0, policy_version 526917 (0.0011) [2023-12-27 23:01:37,648][106226] Updated weights for policy 0, policy_version 526927 (0.0011) [2023-12-27 23:01:37,950][106225] Updated weights for policy 1, policy_version 528307 (0.0006) [2023-12-27 23:01:38,000][106225] Updated weights for policy 1, policy_version 528317 (0.0006) [2023-12-27 23:01:38,061][106225] Updated weights for policy 1, policy_version 528327 (0.0010) [2023-12-27 23:01:38,356][106226] Updated weights for policy 0, policy_version 526937 (0.0010) [2023-12-27 23:01:38,414][106226] Updated weights for policy 0, policy_version 526947 (0.0008) [2023-12-27 23:01:38,477][106226] Updated weights for policy 0, policy_version 526957 (0.0008) [2023-12-27 23:01:38,541][106226] Updated weights for policy 0, policy_version 526967 (0.0008) [2023-12-27 23:01:38,797][106225] Updated weights for policy 1, policy_version 528337 (0.0010) [2023-12-27 23:01:38,859][106225] Updated weights for policy 1, policy_version 528347 (0.0010) [2023-12-27 23:01:38,914][106225] Updated weights for policy 1, policy_version 528357 (0.0010) [2023-12-27 23:01:38,979][106225] Updated weights for policy 1, policy_version 528367 (0.0010) [2023-12-27 23:01:39,268][106226] Updated weights for policy 0, policy_version 526977 (0.0009) [2023-12-27 23:01:39,327][106226] Updated weights for policy 0, policy_version 526987 (0.0009) [2023-12-27 23:01:39,393][106226] Updated weights for policy 0, policy_version 526997 (0.0008) [2023-12-27 23:01:39,747][106225] Updated weights for policy 1, policy_version 528377 (0.0011) [2023-12-27 23:01:39,809][106225] Updated weights for policy 1, policy_version 528387 (0.0011) [2023-12-27 23:01:39,886][106225] Updated weights for policy 1, policy_version 528397 (0.0010) [2023-12-27 23:01:40,156][106226] Updated weights for policy 0, policy_version 527007 (0.0008) [2023-12-27 23:01:40,209][106226] Updated weights for policy 0, policy_version 527017 (0.0008) [2023-12-27 23:01:40,275][106226] Updated weights for policy 0, policy_version 527027 (0.0008) [2023-12-27 23:01:40,579][106225] Updated weights for policy 1, policy_version 528407 (0.0007) [2023-12-27 23:01:40,642][106225] Updated weights for policy 1, policy_version 528417 (0.0008) [2023-12-27 23:01:40,707][106225] Updated weights for policy 1, policy_version 528427 (0.0005) [2023-12-27 23:01:41,034][106226] Updated weights for policy 0, policy_version 527037 (0.0009) [2023-12-27 23:01:41,101][106226] Updated weights for policy 0, policy_version 527047 (0.0010) [2023-12-27 23:01:41,167][106226] Updated weights for policy 0, policy_version 527057 (0.0009) [2023-12-27 23:01:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 270262272. Throughput: 0: 9770.3, 1: 9943.3. Samples: 270238428. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:41,176][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.990')] [2023-12-27 23:01:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000528432_135307264.pth... [2023-12-27 23:01:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000527280_135012352.pth [2023-12-27 23:01:41,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000527064_134963200.pth... [2023-12-27 23:01:41,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000525880_134660096.pth [2023-12-27 23:01:41,318][106225] Updated weights for policy 1, policy_version 528437 (0.0008) [2023-12-27 23:01:41,386][106225] Updated weights for policy 1, policy_version 528447 (0.0008) [2023-12-27 23:01:41,456][106225] Updated weights for policy 1, policy_version 528457 (0.0008) [2023-12-27 23:01:41,898][106226] Updated weights for policy 0, policy_version 527067 (0.0009) [2023-12-27 23:01:41,959][106226] Updated weights for policy 0, policy_version 527077 (0.0009) [2023-12-27 23:01:42,016][106226] Updated weights for policy 0, policy_version 527087 (0.0008) [2023-12-27 23:01:42,189][106225] Updated weights for policy 1, policy_version 528467 (0.0009) [2023-12-27 23:01:42,246][106225] Updated weights for policy 1, policy_version 528477 (0.0009) [2023-12-27 23:01:42,305][106225] Updated weights for policy 1, policy_version 528487 (0.0007) [2023-12-27 23:01:42,767][106226] Updated weights for policy 0, policy_version 527097 (0.0009) [2023-12-27 23:01:42,823][106226] Updated weights for policy 0, policy_version 527107 (0.0006) [2023-12-27 23:01:42,878][106226] Updated weights for policy 0, policy_version 527117 (0.0005) [2023-12-27 23:01:42,926][106226] Updated weights for policy 0, policy_version 527127 (0.0005) [2023-12-27 23:01:43,014][106225] Updated weights for policy 1, policy_version 528497 (0.0008) [2023-12-27 23:01:43,064][106225] Updated weights for policy 1, policy_version 528507 (0.0009) [2023-12-27 23:01:43,117][106225] Updated weights for policy 1, policy_version 528517 (0.0006) [2023-12-27 23:01:43,169][106225] Updated weights for policy 1, policy_version 528527 (0.0005) [2023-12-27 23:01:43,572][106226] Updated weights for policy 0, policy_version 527137 (0.0009) [2023-12-27 23:01:43,630][106226] Updated weights for policy 0, policy_version 527147 (0.0006) [2023-12-27 23:01:43,689][106226] Updated weights for policy 0, policy_version 527157 (0.0009) [2023-12-27 23:01:43,724][106225] Updated weights for policy 1, policy_version 528537 (0.0005) [2023-12-27 23:01:43,786][106225] Updated weights for policy 1, policy_version 528547 (0.0005) [2023-12-27 23:01:43,842][106225] Updated weights for policy 1, policy_version 528557 (0.0005) [2023-12-27 23:01:44,276][106226] Updated weights for policy 0, policy_version 527167 (0.0007) [2023-12-27 23:01:44,332][106226] Updated weights for policy 0, policy_version 527177 (0.0005) [2023-12-27 23:01:44,396][106226] Updated weights for policy 0, policy_version 527187 (0.0005) [2023-12-27 23:01:44,443][106225] Updated weights for policy 1, policy_version 528567 (0.0005) [2023-12-27 23:01:44,496][106225] Updated weights for policy 1, policy_version 528577 (0.0006) [2023-12-27 23:01:44,551][106225] Updated weights for policy 1, policy_version 528587 (0.0009) [2023-12-27 23:01:45,018][106226] Updated weights for policy 0, policy_version 527197 (0.0008) [2023-12-27 23:01:45,082][106226] Updated weights for policy 0, policy_version 527207 (0.0009) [2023-12-27 23:01:45,152][106226] Updated weights for policy 0, policy_version 527217 (0.0009) [2023-12-27 23:01:45,305][106225] Updated weights for policy 1, policy_version 528597 (0.0008) [2023-12-27 23:01:45,367][106225] Updated weights for policy 1, policy_version 528607 (0.0008) [2023-12-27 23:01:45,420][106225] Updated weights for policy 1, policy_version 528617 (0.0008) [2023-12-27 23:01:45,846][106226] Updated weights for policy 0, policy_version 527227 (0.0010) [2023-12-27 23:01:45,914][106226] Updated weights for policy 0, policy_version 527237 (0.0009) [2023-12-27 23:01:45,976][106226] Updated weights for policy 0, policy_version 527247 (0.0008) [2023-12-27 23:01:46,056][106225] Updated weights for policy 1, policy_version 528627 (0.0007) [2023-12-27 23:01:46,117][106225] Updated weights for policy 1, policy_version 528637 (0.0008) [2023-12-27 23:01:46,173][106225] Updated weights for policy 1, policy_version 528647 (0.0009) [2023-12-27 23:01:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 270368768. Throughput: 0: 9890.1, 1: 10026.0. Samples: 270358488. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:46,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.425')] [2023-12-27 23:01:46,647][106226] Updated weights for policy 0, policy_version 527257 (0.0009) [2023-12-27 23:01:46,697][106226] Updated weights for policy 0, policy_version 527267 (0.0010) [2023-12-27 23:01:46,750][106226] Updated weights for policy 0, policy_version 527277 (0.0010) [2023-12-27 23:01:46,806][106226] Updated weights for policy 0, policy_version 527287 (0.0010) [2023-12-27 23:01:46,908][106225] Updated weights for policy 1, policy_version 528657 (0.0008) [2023-12-27 23:01:46,966][106225] Updated weights for policy 1, policy_version 528667 (0.0008) [2023-12-27 23:01:47,020][106225] Updated weights for policy 1, policy_version 528677 (0.0008) [2023-12-27 23:01:47,074][106225] Updated weights for policy 1, policy_version 528687 (0.0008) [2023-12-27 23:01:47,523][106226] Updated weights for policy 0, policy_version 527297 (0.0009) [2023-12-27 23:01:47,583][106226] Updated weights for policy 0, policy_version 527307 (0.0005) [2023-12-27 23:01:47,658][106226] Updated weights for policy 0, policy_version 527317 (0.0008) [2023-12-27 23:01:47,768][106225] Updated weights for policy 1, policy_version 528697 (0.0009) [2023-12-27 23:01:47,821][106225] Updated weights for policy 1, policy_version 528707 (0.0008) [2023-12-27 23:01:47,867][106225] Updated weights for policy 1, policy_version 528717 (0.0008) [2023-12-27 23:01:48,310][106226] Updated weights for policy 0, policy_version 527327 (0.0007) [2023-12-27 23:01:48,372][106226] Updated weights for policy 0, policy_version 527337 (0.0008) [2023-12-27 23:01:48,431][106226] Updated weights for policy 0, policy_version 527347 (0.0008) [2023-12-27 23:01:48,585][106225] Updated weights for policy 1, policy_version 528727 (0.0010) [2023-12-27 23:01:48,643][106225] Updated weights for policy 1, policy_version 528737 (0.0010) [2023-12-27 23:01:48,702][106225] Updated weights for policy 1, policy_version 528747 (0.0009) [2023-12-27 23:01:49,027][106226] Updated weights for policy 0, policy_version 527357 (0.0007) [2023-12-27 23:01:49,084][106226] Updated weights for policy 0, policy_version 527367 (0.0009) [2023-12-27 23:01:49,143][106226] Updated weights for policy 0, policy_version 527377 (0.0008) [2023-12-27 23:01:49,506][106225] Updated weights for policy 1, policy_version 528757 (0.0007) [2023-12-27 23:01:49,565][106225] Updated weights for policy 1, policy_version 528767 (0.0007) [2023-12-27 23:01:49,629][106225] Updated weights for policy 1, policy_version 528777 (0.0008) [2023-12-27 23:01:49,928][106226] Updated weights for policy 0, policy_version 527387 (0.0007) [2023-12-27 23:01:49,986][106226] Updated weights for policy 0, policy_version 527397 (0.0008) [2023-12-27 23:01:50,045][106226] Updated weights for policy 0, policy_version 527407 (0.0008) [2023-12-27 23:01:50,340][106225] Updated weights for policy 1, policy_version 528787 (0.0008) [2023-12-27 23:01:50,399][106225] Updated weights for policy 1, policy_version 528797 (0.0006) [2023-12-27 23:01:50,468][106225] Updated weights for policy 1, policy_version 528807 (0.0005) [2023-12-27 23:01:50,818][106226] Updated weights for policy 0, policy_version 527417 (0.0008) [2023-12-27 23:01:50,884][106226] Updated weights for policy 0, policy_version 527427 (0.0008) [2023-12-27 23:01:50,940][106226] Updated weights for policy 0, policy_version 527437 (0.0007) [2023-12-27 23:01:51,010][106226] Updated weights for policy 0, policy_version 527447 (0.0006) [2023-12-27 23:01:51,047][106225] Updated weights for policy 1, policy_version 528817 (0.0006) [2023-12-27 23:01:51,111][106225] Updated weights for policy 1, policy_version 528827 (0.0008) [2023-12-27 23:01:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 270467072. Throughput: 0: 9942.7, 1: 9997.5. Samples: 270476196. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:51,175][105115] Avg episode reward: [(0, '-5.345'), (1, '-5.616')] [2023-12-27 23:01:51,177][106225] Updated weights for policy 1, policy_version 528837 (0.0010) [2023-12-27 23:01:51,238][106225] Updated weights for policy 1, policy_version 528847 (0.0007) [2023-12-27 23:01:51,697][106226] Updated weights for policy 0, policy_version 527457 (0.0007) [2023-12-27 23:01:51,767][106226] Updated weights for policy 0, policy_version 527467 (0.0008) [2023-12-27 23:01:51,813][106226] Updated weights for policy 0, policy_version 527477 (0.0008) [2023-12-27 23:01:52,003][106225] Updated weights for policy 1, policy_version 528857 (0.0008) [2023-12-27 23:01:52,069][106225] Updated weights for policy 1, policy_version 528867 (0.0008) [2023-12-27 23:01:52,128][106225] Updated weights for policy 1, policy_version 528877 (0.0008) [2023-12-27 23:01:52,597][106226] Updated weights for policy 0, policy_version 527487 (0.0007) [2023-12-27 23:01:52,667][106226] Updated weights for policy 0, policy_version 527497 (0.0008) [2023-12-27 23:01:52,735][106226] Updated weights for policy 0, policy_version 527507 (0.0009) [2023-12-27 23:01:52,881][106225] Updated weights for policy 1, policy_version 528887 (0.0008) [2023-12-27 23:01:52,943][106225] Updated weights for policy 1, policy_version 528897 (0.0009) [2023-12-27 23:01:53,003][106225] Updated weights for policy 1, policy_version 528907 (0.0009) [2023-12-27 23:01:53,428][106226] Updated weights for policy 0, policy_version 527517 (0.0008) [2023-12-27 23:01:53,486][106226] Updated weights for policy 0, policy_version 527527 (0.0006) [2023-12-27 23:01:53,543][106226] Updated weights for policy 0, policy_version 527537 (0.0005) [2023-12-27 23:01:53,736][106225] Updated weights for policy 1, policy_version 528917 (0.0008) [2023-12-27 23:01:53,797][106225] Updated weights for policy 1, policy_version 528927 (0.0009) [2023-12-27 23:01:53,853][106225] Updated weights for policy 1, policy_version 528937 (0.0008) [2023-12-27 23:01:54,182][106226] Updated weights for policy 0, policy_version 527547 (0.0006) [2023-12-27 23:01:54,245][106226] Updated weights for policy 0, policy_version 527557 (0.0008) [2023-12-27 23:01:54,312][106226] Updated weights for policy 0, policy_version 527567 (0.0008) [2023-12-27 23:01:54,564][106225] Updated weights for policy 1, policy_version 528947 (0.0007) [2023-12-27 23:01:54,619][106225] Updated weights for policy 1, policy_version 528957 (0.0008) [2023-12-27 23:01:54,667][106225] Updated weights for policy 1, policy_version 528967 (0.0008) [2023-12-27 23:01:55,060][106226] Updated weights for policy 0, policy_version 527577 (0.0008) [2023-12-27 23:01:55,123][106226] Updated weights for policy 0, policy_version 527587 (0.0005) [2023-12-27 23:01:55,190][106226] Updated weights for policy 0, policy_version 527597 (0.0005) [2023-12-27 23:01:55,253][106226] Updated weights for policy 0, policy_version 527607 (0.0006) [2023-12-27 23:01:55,341][106225] Updated weights for policy 1, policy_version 528977 (0.0009) [2023-12-27 23:01:55,391][106225] Updated weights for policy 1, policy_version 528987 (0.0008) [2023-12-27 23:01:55,451][106225] Updated weights for policy 1, policy_version 528997 (0.0009) [2023-12-27 23:01:55,510][106225] Updated weights for policy 1, policy_version 529007 (0.0008) [2023-12-27 23:01:55,803][106226] Updated weights for policy 0, policy_version 527617 (0.0008) [2023-12-27 23:01:55,869][106226] Updated weights for policy 0, policy_version 527627 (0.0005) [2023-12-27 23:01:55,926][106226] Updated weights for policy 0, policy_version 527637 (0.0005) [2023-12-27 23:01:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 270565376. Throughput: 0: 9931.7, 1: 9957.8. Samples: 270534272. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:01:56,175][105115] Avg episode reward: [(0, '-5.057'), (1, '-5.231')] [2023-12-27 23:01:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000529008_135454720.pth... [2023-12-27 23:01:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000527640_135110656.pth... [2023-12-27 23:01:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000526456_134807552.pth [2023-12-27 23:01:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000527856_135159808.pth [2023-12-27 23:01:56,274][106225] Updated weights for policy 1, policy_version 529017 (0.0008) [2023-12-27 23:01:56,333][106225] Updated weights for policy 1, policy_version 529027 (0.0008) [2023-12-27 23:01:56,388][106225] Updated weights for policy 1, policy_version 529037 (0.0008) [2023-12-27 23:01:56,525][106226] Updated weights for policy 0, policy_version 527647 (0.0005) [2023-12-27 23:01:56,587][106226] Updated weights for policy 0, policy_version 527657 (0.0006) [2023-12-27 23:01:56,648][106226] Updated weights for policy 0, policy_version 527667 (0.0008) [2023-12-27 23:01:57,043][106225] Updated weights for policy 1, policy_version 529047 (0.0006) [2023-12-27 23:01:57,100][106225] Updated weights for policy 1, policy_version 529057 (0.0005) [2023-12-27 23:01:57,152][106225] Updated weights for policy 1, policy_version 529067 (0.0005) [2023-12-27 23:01:57,256][106226] Updated weights for policy 0, policy_version 527677 (0.0007) [2023-12-27 23:01:57,307][106226] Updated weights for policy 0, policy_version 527687 (0.0005) [2023-12-27 23:01:57,361][106226] Updated weights for policy 0, policy_version 527697 (0.0005) [2023-12-27 23:01:57,749][106225] Updated weights for policy 1, policy_version 529077 (0.0006) [2023-12-27 23:01:57,802][106225] Updated weights for policy 1, policy_version 529087 (0.0008) [2023-12-27 23:01:57,855][106225] Updated weights for policy 1, policy_version 529097 (0.0009) [2023-12-27 23:01:57,959][106226] Updated weights for policy 0, policy_version 527707 (0.0007) [2023-12-27 23:01:58,013][106226] Updated weights for policy 0, policy_version 527717 (0.0008) [2023-12-27 23:01:58,062][106226] Updated weights for policy 0, policy_version 527727 (0.0008) [2023-12-27 23:01:58,640][106225] Updated weights for policy 1, policy_version 529107 (0.0009) [2023-12-27 23:01:58,705][106225] Updated weights for policy 1, policy_version 529117 (0.0007) [2023-12-27 23:01:58,771][106225] Updated weights for policy 1, policy_version 529127 (0.0008) [2023-12-27 23:01:58,853][106226] Updated weights for policy 0, policy_version 527737 (0.0008) [2023-12-27 23:01:58,921][106226] Updated weights for policy 0, policy_version 527747 (0.0008) [2023-12-27 23:01:58,993][106226] Updated weights for policy 0, policy_version 527757 (0.0007) [2023-12-27 23:01:59,061][106226] Updated weights for policy 0, policy_version 527767 (0.0007) [2023-12-27 23:01:59,638][106225] Updated weights for policy 1, policy_version 529137 (0.0007) [2023-12-27 23:01:59,697][106225] Updated weights for policy 1, policy_version 529147 (0.0008) [2023-12-27 23:01:59,751][106225] Updated weights for policy 1, policy_version 529157 (0.0008) [2023-12-27 23:01:59,786][106226] Updated weights for policy 0, policy_version 527777 (0.0006) [2023-12-27 23:01:59,818][106225] Updated weights for policy 1, policy_version 529167 (0.0008) [2023-12-27 23:01:59,849][106226] Updated weights for policy 0, policy_version 527787 (0.0007) [2023-12-27 23:01:59,908][106226] Updated weights for policy 0, policy_version 527797 (0.0008) [2023-12-27 23:02:00,570][106226] Updated weights for policy 0, policy_version 527807 (0.0007) [2023-12-27 23:02:00,591][106225] Updated weights for policy 1, policy_version 529177 (0.0007) [2023-12-27 23:02:00,624][106226] Updated weights for policy 0, policy_version 527817 (0.0006) [2023-12-27 23:02:00,651][106225] Updated weights for policy 1, policy_version 529187 (0.0008) [2023-12-27 23:02:00,672][106226] Updated weights for policy 0, policy_version 527827 (0.0005) [2023-12-27 23:02:00,699][106225] Updated weights for policy 1, policy_version 529197 (0.0007) [2023-12-27 23:02:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 270663680. Throughput: 0: 10030.4, 1: 9958.6. Samples: 270654244. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:02:01,175][105115] Avg episode reward: [(0, '-5.221'), (1, '-5.631')] [2023-12-27 23:02:01,354][106226] Updated weights for policy 0, policy_version 527837 (0.0008) [2023-12-27 23:02:01,420][106226] Updated weights for policy 0, policy_version 527847 (0.0010) [2023-12-27 23:02:01,472][106225] Updated weights for policy 1, policy_version 529207 (0.0007) [2023-12-27 23:02:01,481][106226] Updated weights for policy 0, policy_version 527857 (0.0007) [2023-12-27 23:02:01,530][106225] Updated weights for policy 1, policy_version 529217 (0.0009) [2023-12-27 23:02:01,589][106225] Updated weights for policy 1, policy_version 529227 (0.0008) [2023-12-27 23:02:02,189][106226] Updated weights for policy 0, policy_version 527867 (0.0008) [2023-12-27 23:02:02,239][106226] Updated weights for policy 0, policy_version 527877 (0.0007) [2023-12-27 23:02:02,305][106226] Updated weights for policy 0, policy_version 527887 (0.0009) [2023-12-27 23:02:02,308][106225] Updated weights for policy 1, policy_version 529237 (0.0007) [2023-12-27 23:02:02,388][106225] Updated weights for policy 1, policy_version 529247 (0.0007) [2023-12-27 23:02:02,450][106225] Updated weights for policy 1, policy_version 529257 (0.0008) [2023-12-27 23:02:03,000][106226] Updated weights for policy 0, policy_version 527897 (0.0009) [2023-12-27 23:02:03,060][106226] Updated weights for policy 0, policy_version 527907 (0.0008) [2023-12-27 23:02:03,106][106226] Updated weights for policy 0, policy_version 527917 (0.0009) [2023-12-27 23:02:03,153][106225] Updated weights for policy 1, policy_version 529267 (0.0007) [2023-12-27 23:02:03,163][106226] Updated weights for policy 0, policy_version 527927 (0.0007) [2023-12-27 23:02:03,202][106225] Updated weights for policy 1, policy_version 529277 (0.0007) [2023-12-27 23:02:03,258][106225] Updated weights for policy 1, policy_version 529287 (0.0006) [2023-12-27 23:02:03,909][106226] Updated weights for policy 0, policy_version 527937 (0.0008) [2023-12-27 23:02:03,934][106225] Updated weights for policy 1, policy_version 529297 (0.0008) [2023-12-27 23:02:03,969][106226] Updated weights for policy 0, policy_version 527947 (0.0007) [2023-12-27 23:02:03,996][106225] Updated weights for policy 1, policy_version 529307 (0.0006) [2023-12-27 23:02:04,028][106226] Updated weights for policy 0, policy_version 527957 (0.0009) [2023-12-27 23:02:04,057][106225] Updated weights for policy 1, policy_version 529317 (0.0006) [2023-12-27 23:02:04,121][106225] Updated weights for policy 1, policy_version 529327 (0.0007) [2023-12-27 23:02:04,802][106226] Updated weights for policy 0, policy_version 527967 (0.0008) [2023-12-27 23:02:04,813][106225] Updated weights for policy 1, policy_version 529337 (0.0006) [2023-12-27 23:02:04,861][106226] Updated weights for policy 0, policy_version 527977 (0.0008) [2023-12-27 23:02:04,868][106225] Updated weights for policy 1, policy_version 529347 (0.0005) [2023-12-27 23:02:04,923][106225] Updated weights for policy 1, policy_version 529357 (0.0005) [2023-12-27 23:02:04,923][106226] Updated weights for policy 0, policy_version 527987 (0.0009) [2023-12-27 23:02:05,576][106225] Updated weights for policy 1, policy_version 529367 (0.0009) [2023-12-27 23:02:05,622][106225] Updated weights for policy 1, policy_version 529377 (0.0010) [2023-12-27 23:02:05,672][106225] Updated weights for policy 1, policy_version 529387 (0.0010) [2023-12-27 23:02:05,690][106226] Updated weights for policy 0, policy_version 527997 (0.0007) [2023-12-27 23:02:05,741][106226] Updated weights for policy 0, policy_version 528007 (0.0007) [2023-12-27 23:02:05,791][106226] Updated weights for policy 0, policy_version 528017 (0.0008) [2023-12-27 23:02:06,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 270761984. Throughput: 0: 9964.8, 1: 9948.3. Samples: 270770704. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:06,176][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.277')] [2023-12-27 23:02:06,389][106225] Updated weights for policy 1, policy_version 529397 (0.0010) [2023-12-27 23:02:06,443][106225] Updated weights for policy 1, policy_version 529407 (0.0010) [2023-12-27 23:02:06,507][106225] Updated weights for policy 1, policy_version 529417 (0.0006) [2023-12-27 23:02:06,569][106226] Updated weights for policy 0, policy_version 528027 (0.0008) [2023-12-27 23:02:06,636][106226] Updated weights for policy 0, policy_version 528037 (0.0009) [2023-12-27 23:02:06,701][106226] Updated weights for policy 0, policy_version 528047 (0.0007) [2023-12-27 23:02:07,266][106225] Updated weights for policy 1, policy_version 529427 (0.0010) [2023-12-27 23:02:07,319][106225] Updated weights for policy 1, policy_version 529437 (0.0007) [2023-12-27 23:02:07,372][106225] Updated weights for policy 1, policy_version 529447 (0.0006) [2023-12-27 23:02:07,441][106226] Updated weights for policy 0, policy_version 528057 (0.0008) [2023-12-27 23:02:07,507][106226] Updated weights for policy 0, policy_version 528067 (0.0005) [2023-12-27 23:02:07,577][106226] Updated weights for policy 0, policy_version 528077 (0.0007) [2023-12-27 23:02:07,642][106226] Updated weights for policy 0, policy_version 528087 (0.0005) [2023-12-27 23:02:08,009][106225] Updated weights for policy 1, policy_version 529457 (0.0005) [2023-12-27 23:02:08,059][106225] Updated weights for policy 1, policy_version 529467 (0.0008) [2023-12-27 23:02:08,105][106225] Updated weights for policy 1, policy_version 529477 (0.0008) [2023-12-27 23:02:08,154][106225] Updated weights for policy 1, policy_version 529487 (0.0009) [2023-12-27 23:02:08,308][106226] Updated weights for policy 0, policy_version 528097 (0.0009) [2023-12-27 23:02:08,377][106226] Updated weights for policy 0, policy_version 528107 (0.0008) [2023-12-27 23:02:08,436][106226] Updated weights for policy 0, policy_version 528117 (0.0008) [2023-12-27 23:02:08,875][106225] Updated weights for policy 1, policy_version 529497 (0.0008) [2023-12-27 23:02:08,925][106225] Updated weights for policy 1, policy_version 529507 (0.0009) [2023-12-27 23:02:08,986][106225] Updated weights for policy 1, policy_version 529517 (0.0008) [2023-12-27 23:02:09,205][106226] Updated weights for policy 0, policy_version 528127 (0.0008) [2023-12-27 23:02:09,283][106226] Updated weights for policy 0, policy_version 528137 (0.0007) [2023-12-27 23:02:09,353][106226] Updated weights for policy 0, policy_version 528147 (0.0008) [2023-12-27 23:02:09,735][106225] Updated weights for policy 1, policy_version 529527 (0.0007) [2023-12-27 23:02:09,799][106225] Updated weights for policy 1, policy_version 529537 (0.0007) [2023-12-27 23:02:09,868][106225] Updated weights for policy 1, policy_version 529547 (0.0009) [2023-12-27 23:02:10,079][106226] Updated weights for policy 0, policy_version 528157 (0.0007) [2023-12-27 23:02:10,129][106226] Updated weights for policy 0, policy_version 528167 (0.0009) [2023-12-27 23:02:10,184][106226] Updated weights for policy 0, policy_version 528177 (0.0009) [2023-12-27 23:02:10,572][106225] Updated weights for policy 1, policy_version 529557 (0.0008) [2023-12-27 23:02:10,641][106225] Updated weights for policy 1, policy_version 529567 (0.0010) [2023-12-27 23:02:10,699][106225] Updated weights for policy 1, policy_version 529577 (0.0008) [2023-12-27 23:02:10,900][106226] Updated weights for policy 0, policy_version 528187 (0.0009) [2023-12-27 23:02:10,951][106226] Updated weights for policy 0, policy_version 528197 (0.0009) [2023-12-27 23:02:11,004][106226] Updated weights for policy 0, policy_version 528207 (0.0009) [2023-12-27 23:02:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 270860288. Throughput: 0: 9963.3, 1: 9984.5. Samples: 270829056. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:11,175][105115] Avg episode reward: [(0, '-5.532'), (1, '-5.377')] [2023-12-27 23:02:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000529584_135602176.pth... [2023-12-27 23:02:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000528216_135258112.pth... [2023-12-27 23:02:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000527064_134963200.pth [2023-12-27 23:02:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000528432_135307264.pth [2023-12-27 23:02:11,410][106225] Updated weights for policy 1, policy_version 529587 (0.0008) [2023-12-27 23:02:11,470][106225] Updated weights for policy 1, policy_version 529597 (0.0008) [2023-12-27 23:02:11,520][106225] Updated weights for policy 1, policy_version 529607 (0.0008) [2023-12-27 23:02:11,881][106226] Updated weights for policy 0, policy_version 528217 (0.0009) [2023-12-27 23:02:11,941][106226] Updated weights for policy 0, policy_version 528227 (0.0008) [2023-12-27 23:02:11,990][106226] Updated weights for policy 0, policy_version 528237 (0.0008) [2023-12-27 23:02:12,055][106226] Updated weights for policy 0, policy_version 528247 (0.0008) [2023-12-27 23:02:12,274][106225] Updated weights for policy 1, policy_version 529617 (0.0009) [2023-12-27 23:02:12,346][106225] Updated weights for policy 1, policy_version 529627 (0.0009) [2023-12-27 23:02:12,408][106225] Updated weights for policy 1, policy_version 529637 (0.0008) [2023-12-27 23:02:12,466][106225] Updated weights for policy 1, policy_version 529647 (0.0007) [2023-12-27 23:02:12,821][106226] Updated weights for policy 0, policy_version 528257 (0.0009) [2023-12-27 23:02:12,880][106226] Updated weights for policy 0, policy_version 528267 (0.0008) [2023-12-27 23:02:12,933][106226] Updated weights for policy 0, policy_version 528277 (0.0009) [2023-12-27 23:02:13,178][106225] Updated weights for policy 1, policy_version 529657 (0.0006) [2023-12-27 23:02:13,234][106225] Updated weights for policy 1, policy_version 529667 (0.0005) [2023-12-27 23:02:13,294][106225] Updated weights for policy 1, policy_version 529677 (0.0006) [2023-12-27 23:02:13,595][106226] Updated weights for policy 0, policy_version 528287 (0.0006) [2023-12-27 23:02:13,662][106226] Updated weights for policy 0, policy_version 528297 (0.0005) [2023-12-27 23:02:13,728][106226] Updated weights for policy 0, policy_version 528307 (0.0006) [2023-12-27 23:02:13,883][106225] Updated weights for policy 1, policy_version 529687 (0.0005) [2023-12-27 23:02:13,941][106225] Updated weights for policy 1, policy_version 529697 (0.0005) [2023-12-27 23:02:13,991][106225] Updated weights for policy 1, policy_version 529707 (0.0007) [2023-12-27 23:02:14,264][106226] Updated weights for policy 0, policy_version 528317 (0.0006) [2023-12-27 23:02:14,327][106226] Updated weights for policy 0, policy_version 528327 (0.0006) [2023-12-27 23:02:14,388][106226] Updated weights for policy 0, policy_version 528337 (0.0009) [2023-12-27 23:02:14,618][106225] Updated weights for policy 1, policy_version 529717 (0.0010) [2023-12-27 23:02:14,686][106225] Updated weights for policy 1, policy_version 529727 (0.0010) [2023-12-27 23:02:14,737][106225] Updated weights for policy 1, policy_version 529737 (0.0010) [2023-12-27 23:02:14,981][106226] Updated weights for policy 0, policy_version 528347 (0.0006) [2023-12-27 23:02:15,042][106226] Updated weights for policy 0, policy_version 528357 (0.0006) [2023-12-27 23:02:15,108][106226] Updated weights for policy 0, policy_version 528367 (0.0006) [2023-12-27 23:02:15,478][106225] Updated weights for policy 1, policy_version 529747 (0.0010) [2023-12-27 23:02:15,541][106225] Updated weights for policy 1, policy_version 529757 (0.0010) [2023-12-27 23:02:15,606][106225] Updated weights for policy 1, policy_version 529767 (0.0010) [2023-12-27 23:02:15,768][106226] Updated weights for policy 0, policy_version 528377 (0.0008) [2023-12-27 23:02:15,827][106226] Updated weights for policy 0, policy_version 528387 (0.0010) [2023-12-27 23:02:15,887][106226] Updated weights for policy 0, policy_version 528397 (0.0011) [2023-12-27 23:02:15,941][106226] Updated weights for policy 0, policy_version 528407 (0.0011) [2023-12-27 23:02:16,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 270958592. Throughput: 0: 9970.5, 1: 9900.5. Samples: 270947752. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:16,175][105115] Avg episode reward: [(0, '-5.164'), (1, '-5.597')] [2023-12-27 23:02:16,338][106225] Updated weights for policy 1, policy_version 529777 (0.0010) [2023-12-27 23:02:16,397][106225] Updated weights for policy 1, policy_version 529787 (0.0010) [2023-12-27 23:02:16,455][106225] Updated weights for policy 1, policy_version 529797 (0.0010) [2023-12-27 23:02:16,518][106225] Updated weights for policy 1, policy_version 529807 (0.0010) [2023-12-27 23:02:16,538][106226] Updated weights for policy 0, policy_version 528417 (0.0006) [2023-12-27 23:02:16,599][106226] Updated weights for policy 0, policy_version 528427 (0.0005) [2023-12-27 23:02:16,663][106226] Updated weights for policy 0, policy_version 528437 (0.0008) [2023-12-27 23:02:17,134][106225] Updated weights for policy 1, policy_version 529817 (0.0006) [2023-12-27 23:02:17,181][106225] Updated weights for policy 1, policy_version 529827 (0.0005) [2023-12-27 23:02:17,226][106225] Updated weights for policy 1, policy_version 529837 (0.0005) [2023-12-27 23:02:17,312][106226] Updated weights for policy 0, policy_version 528447 (0.0011) [2023-12-27 23:02:17,358][106226] Updated weights for policy 0, policy_version 528457 (0.0005) [2023-12-27 23:02:17,429][106226] Updated weights for policy 0, policy_version 528467 (0.0007) [2023-12-27 23:02:17,863][106225] Updated weights for policy 1, policy_version 529847 (0.0006) [2023-12-27 23:02:17,924][106225] Updated weights for policy 1, policy_version 529857 (0.0009) [2023-12-27 23:02:17,978][106225] Updated weights for policy 1, policy_version 529867 (0.0010) [2023-12-27 23:02:18,128][106226] Updated weights for policy 0, policy_version 528477 (0.0010) [2023-12-27 23:02:18,190][106226] Updated weights for policy 0, policy_version 528487 (0.0011) [2023-12-27 23:02:18,244][106226] Updated weights for policy 0, policy_version 528497 (0.0010) [2023-12-27 23:02:18,668][106225] Updated weights for policy 1, policy_version 529877 (0.0010) [2023-12-27 23:02:18,723][106225] Updated weights for policy 1, policy_version 529887 (0.0010) [2023-12-27 23:02:18,780][106225] Updated weights for policy 1, policy_version 529897 (0.0010) [2023-12-27 23:02:18,904][106226] Updated weights for policy 0, policy_version 528507 (0.0009) [2023-12-27 23:02:18,965][106226] Updated weights for policy 0, policy_version 528517 (0.0011) [2023-12-27 23:02:19,017][106226] Updated weights for policy 0, policy_version 528527 (0.0008) [2023-12-27 23:02:19,547][106225] Updated weights for policy 1, policy_version 529907 (0.0009) [2023-12-27 23:02:19,605][106225] Updated weights for policy 1, policy_version 529917 (0.0008) [2023-12-27 23:02:19,669][106225] Updated weights for policy 1, policy_version 529927 (0.0008) [2023-12-27 23:02:19,723][106226] Updated weights for policy 0, policy_version 528537 (0.0011) [2023-12-27 23:02:19,785][106226] Updated weights for policy 0, policy_version 528547 (0.0009) [2023-12-27 23:02:19,856][106226] Updated weights for policy 0, policy_version 528557 (0.0008) [2023-12-27 23:02:19,920][106226] Updated weights for policy 0, policy_version 528567 (0.0006) [2023-12-27 23:02:20,467][106225] Updated weights for policy 1, policy_version 529937 (0.0009) [2023-12-27 23:02:20,527][106225] Updated weights for policy 1, policy_version 529947 (0.0010) [2023-12-27 23:02:20,591][106225] Updated weights for policy 1, policy_version 529957 (0.0009) [2023-12-27 23:02:20,598][106226] Updated weights for policy 0, policy_version 528577 (0.0007) [2023-12-27 23:02:20,653][106225] Updated weights for policy 1, policy_version 529967 (0.0006) [2023-12-27 23:02:20,658][106226] Updated weights for policy 0, policy_version 528587 (0.0008) [2023-12-27 23:02:20,719][106226] Updated weights for policy 0, policy_version 528597 (0.0006) [2023-12-27 23:02:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 271056896. Throughput: 0: 9906.3, 1: 9843.8. Samples: 271067708. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:21,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-5.774')] [2023-12-27 23:02:21,413][106225] Updated weights for policy 1, policy_version 529977 (0.0007) [2023-12-27 23:02:21,440][106226] Updated weights for policy 0, policy_version 528607 (0.0007) [2023-12-27 23:02:21,471][106225] Updated weights for policy 1, policy_version 529987 (0.0006) [2023-12-27 23:02:21,503][106226] Updated weights for policy 0, policy_version 528617 (0.0008) [2023-12-27 23:02:21,527][106225] Updated weights for policy 1, policy_version 529997 (0.0006) [2023-12-27 23:02:21,562][106226] Updated weights for policy 0, policy_version 528627 (0.0008) [2023-12-27 23:02:22,155][106225] Updated weights for policy 1, policy_version 530007 (0.0008) [2023-12-27 23:02:22,224][106225] Updated weights for policy 1, policy_version 530017 (0.0007) [2023-12-27 23:02:22,296][106225] Updated weights for policy 1, policy_version 530027 (0.0008) [2023-12-27 23:02:22,469][106226] Updated weights for policy 0, policy_version 528637 (0.0008) [2023-12-27 23:02:22,530][106226] Updated weights for policy 0, policy_version 528647 (0.0009) [2023-12-27 23:02:22,595][106226] Updated weights for policy 0, policy_version 528657 (0.0009) [2023-12-27 23:02:23,044][106225] Updated weights for policy 1, policy_version 530037 (0.0009) [2023-12-27 23:02:23,104][106225] Updated weights for policy 1, policy_version 530047 (0.0009) [2023-12-27 23:02:23,153][106225] Updated weights for policy 1, policy_version 530057 (0.0006) [2023-12-27 23:02:23,341][106226] Updated weights for policy 0, policy_version 528667 (0.0008) [2023-12-27 23:02:23,397][106226] Updated weights for policy 0, policy_version 528677 (0.0009) [2023-12-27 23:02:23,450][106226] Updated weights for policy 0, policy_version 528687 (0.0008) [2023-12-27 23:02:23,815][106225] Updated weights for policy 1, policy_version 530067 (0.0007) [2023-12-27 23:02:23,861][106225] Updated weights for policy 1, policy_version 530077 (0.0005) [2023-12-27 23:02:23,907][106225] Updated weights for policy 1, policy_version 530087 (0.0007) [2023-12-27 23:02:24,236][106226] Updated weights for policy 0, policy_version 528697 (0.0009) [2023-12-27 23:02:24,292][106226] Updated weights for policy 0, policy_version 528707 (0.0006) [2023-12-27 23:02:24,353][106226] Updated weights for policy 0, policy_version 528717 (0.0008) [2023-12-27 23:02:24,408][106226] Updated weights for policy 0, policy_version 528727 (0.0008) [2023-12-27 23:02:24,519][106225] Updated weights for policy 1, policy_version 530097 (0.0009) [2023-12-27 23:02:24,575][106225] Updated weights for policy 1, policy_version 530107 (0.0005) [2023-12-27 23:02:24,629][106225] Updated weights for policy 1, policy_version 530117 (0.0006) [2023-12-27 23:02:24,683][106225] Updated weights for policy 1, policy_version 530127 (0.0006) [2023-12-27 23:02:25,073][106226] Updated weights for policy 0, policy_version 528737 (0.0006) [2023-12-27 23:02:25,140][106226] Updated weights for policy 0, policy_version 528747 (0.0005) [2023-12-27 23:02:25,208][106226] Updated weights for policy 0, policy_version 528757 (0.0010) [2023-12-27 23:02:25,257][106225] Updated weights for policy 1, policy_version 530137 (0.0005) [2023-12-27 23:02:25,312][106225] Updated weights for policy 1, policy_version 530147 (0.0005) [2023-12-27 23:02:25,358][106225] Updated weights for policy 1, policy_version 530157 (0.0005) [2023-12-27 23:02:25,867][106226] Updated weights for policy 0, policy_version 528767 (0.0010) [2023-12-27 23:02:25,889][106225] Updated weights for policy 1, policy_version 530167 (0.0005) [2023-12-27 23:02:25,917][106226] Updated weights for policy 0, policy_version 528777 (0.0010) [2023-12-27 23:02:25,949][106225] Updated weights for policy 1, policy_version 530177 (0.0006) [2023-12-27 23:02:25,973][106226] Updated weights for policy 0, policy_version 528787 (0.0010) [2023-12-27 23:02:26,002][106225] Updated weights for policy 1, policy_version 530187 (0.0009) [2023-12-27 23:02:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 271163392. Throughput: 0: 9843.5, 1: 9835.7. Samples: 271123988. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:26,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.628')] [2023-12-27 23:02:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000530192_135757824.pth... [2023-12-27 23:02:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000528792_135405568.pth... [2023-12-27 23:02:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000529008_135454720.pth [2023-12-27 23:02:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000527640_135110656.pth [2023-12-27 23:02:26,603][106225] Updated weights for policy 1, policy_version 530197 (0.0007) [2023-12-27 23:02:26,648][106225] Updated weights for policy 1, policy_version 530207 (0.0005) [2023-12-27 23:02:26,700][106225] Updated weights for policy 1, policy_version 530217 (0.0005) [2023-12-27 23:02:26,741][106226] Updated weights for policy 0, policy_version 528797 (0.0009) [2023-12-27 23:02:26,795][106226] Updated weights for policy 0, policy_version 528807 (0.0009) [2023-12-27 23:02:26,859][106226] Updated weights for policy 0, policy_version 528817 (0.0009) [2023-12-27 23:02:27,340][106225] Updated weights for policy 1, policy_version 530227 (0.0005) [2023-12-27 23:02:27,408][106225] Updated weights for policy 1, policy_version 530237 (0.0005) [2023-12-27 23:02:27,470][106225] Updated weights for policy 1, policy_version 530247 (0.0005) [2023-12-27 23:02:27,574][106226] Updated weights for policy 0, policy_version 528827 (0.0008) [2023-12-27 23:02:27,631][106226] Updated weights for policy 0, policy_version 528837 (0.0006) [2023-12-27 23:02:27,678][106226] Updated weights for policy 0, policy_version 528847 (0.0008) [2023-12-27 23:02:28,007][106225] Updated weights for policy 1, policy_version 530257 (0.0005) [2023-12-27 23:02:28,060][106225] Updated weights for policy 1, policy_version 530267 (0.0010) [2023-12-27 23:02:28,116][106225] Updated weights for policy 1, policy_version 530277 (0.0010) [2023-12-27 23:02:28,168][106225] Updated weights for policy 1, policy_version 530287 (0.0010) [2023-12-27 23:02:28,430][106226] Updated weights for policy 0, policy_version 528857 (0.0008) [2023-12-27 23:02:28,489][106226] Updated weights for policy 0, policy_version 528867 (0.0011) [2023-12-27 23:02:28,550][106226] Updated weights for policy 0, policy_version 528877 (0.0011) [2023-12-27 23:02:28,620][106226] Updated weights for policy 0, policy_version 528887 (0.0011) [2023-12-27 23:02:28,779][106225] Updated weights for policy 1, policy_version 530297 (0.0008) [2023-12-27 23:02:28,829][106225] Updated weights for policy 1, policy_version 530307 (0.0009) [2023-12-27 23:02:28,883][106225] Updated weights for policy 1, policy_version 530317 (0.0005) [2023-12-27 23:02:29,237][106226] Updated weights for policy 0, policy_version 528897 (0.0011) [2023-12-27 23:02:29,299][106226] Updated weights for policy 0, policy_version 528907 (0.0011) [2023-12-27 23:02:29,365][106226] Updated weights for policy 0, policy_version 528917 (0.0010) [2023-12-27 23:02:29,583][106225] Updated weights for policy 1, policy_version 530327 (0.0009) [2023-12-27 23:02:29,641][106225] Updated weights for policy 1, policy_version 530337 (0.0008) [2023-12-27 23:02:29,699][106225] Updated weights for policy 1, policy_version 530347 (0.0008) [2023-12-27 23:02:30,004][106226] Updated weights for policy 0, policy_version 528927 (0.0009) [2023-12-27 23:02:30,069][106226] Updated weights for policy 0, policy_version 528937 (0.0010) [2023-12-27 23:02:30,126][106226] Updated weights for policy 0, policy_version 528947 (0.0008) [2023-12-27 23:02:30,437][106225] Updated weights for policy 1, policy_version 530357 (0.0009) [2023-12-27 23:02:30,495][106225] Updated weights for policy 1, policy_version 530367 (0.0008) [2023-12-27 23:02:30,541][106225] Updated weights for policy 1, policy_version 530377 (0.0008) [2023-12-27 23:02:30,868][106226] Updated weights for policy 0, policy_version 528957 (0.0009) [2023-12-27 23:02:30,927][106226] Updated weights for policy 0, policy_version 528967 (0.0007) [2023-12-27 23:02:30,986][106226] Updated weights for policy 0, policy_version 528977 (0.0007) [2023-12-27 23:02:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 271261696. Throughput: 0: 9843.8, 1: 10005.2. Samples: 271251696. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:31,175][105115] Avg episode reward: [(0, '-4.931'), (1, '-5.852')] [2023-12-27 23:02:31,267][106225] Updated weights for policy 1, policy_version 530387 (0.0007) [2023-12-27 23:02:31,330][106225] Updated weights for policy 1, policy_version 530397 (0.0008) [2023-12-27 23:02:31,427][106225] Updated weights for policy 1, policy_version 530407 (0.0007) [2023-12-27 23:02:31,756][106226] Updated weights for policy 0, policy_version 528987 (0.0009) [2023-12-27 23:02:31,820][106226] Updated weights for policy 0, policy_version 528997 (0.0007) [2023-12-27 23:02:31,871][106226] Updated weights for policy 0, policy_version 529007 (0.0008) [2023-12-27 23:02:32,063][106225] Updated weights for policy 1, policy_version 530417 (0.0006) [2023-12-27 23:02:32,118][106225] Updated weights for policy 1, policy_version 530427 (0.0008) [2023-12-27 23:02:32,182][106225] Updated weights for policy 1, policy_version 530437 (0.0007) [2023-12-27 23:02:32,238][106225] Updated weights for policy 1, policy_version 530447 (0.0005) [2023-12-27 23:02:32,539][106226] Updated weights for policy 0, policy_version 529017 (0.0006) [2023-12-27 23:02:32,600][106226] Updated weights for policy 0, policy_version 529027 (0.0009) [2023-12-27 23:02:32,660][106226] Updated weights for policy 0, policy_version 529037 (0.0008) [2023-12-27 23:02:32,722][106226] Updated weights for policy 0, policy_version 529047 (0.0006) [2023-12-27 23:02:32,878][106225] Updated weights for policy 1, policy_version 530457 (0.0009) [2023-12-27 23:02:32,935][106225] Updated weights for policy 1, policy_version 530467 (0.0009) [2023-12-27 23:02:32,989][106225] Updated weights for policy 1, policy_version 530477 (0.0009) [2023-12-27 23:02:33,376][106226] Updated weights for policy 0, policy_version 529057 (0.0006) [2023-12-27 23:02:33,427][106226] Updated weights for policy 0, policy_version 529067 (0.0008) [2023-12-27 23:02:33,483][106226] Updated weights for policy 0, policy_version 529077 (0.0010) [2023-12-27 23:02:33,716][106225] Updated weights for policy 1, policy_version 530487 (0.0009) [2023-12-27 23:02:33,769][106225] Updated weights for policy 1, policy_version 530498 (0.0009) [2023-12-27 23:02:33,814][106225] Updated weights for policy 1, policy_version 530508 (0.0007) [2023-12-27 23:02:34,056][106226] Updated weights for policy 0, policy_version 529087 (0.0007) [2023-12-27 23:02:34,116][106226] Updated weights for policy 0, policy_version 529097 (0.0008) [2023-12-27 23:02:34,174][106226] Updated weights for policy 0, policy_version 529107 (0.0009) [2023-12-27 23:02:34,518][106225] Updated weights for policy 1, policy_version 530518 (0.0007) [2023-12-27 23:02:34,576][106225] Updated weights for policy 1, policy_version 530528 (0.0008) [2023-12-27 23:02:34,633][106225] Updated weights for policy 1, policy_version 530538 (0.0009) [2023-12-27 23:02:34,879][106226] Updated weights for policy 0, policy_version 529117 (0.0007) [2023-12-27 23:02:34,949][106226] Updated weights for policy 0, policy_version 529127 (0.0007) [2023-12-27 23:02:35,019][106226] Updated weights for policy 0, policy_version 529137 (0.0009) [2023-12-27 23:02:35,324][106225] Updated weights for policy 1, policy_version 530548 (0.0008) [2023-12-27 23:02:35,368][106225] Updated weights for policy 1, policy_version 530558 (0.0008) [2023-12-27 23:02:35,416][106225] Updated weights for policy 1, policy_version 530568 (0.0008) [2023-12-27 23:02:35,685][106226] Updated weights for policy 0, policy_version 529147 (0.0009) [2023-12-27 23:02:35,749][106226] Updated weights for policy 0, policy_version 529157 (0.0010) [2023-12-27 23:02:35,814][106226] Updated weights for policy 0, policy_version 529167 (0.0010) [2023-12-27 23:02:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 271360000. Throughput: 0: 9879.3, 1: 10021.1. Samples: 271371720. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:36,175][105115] Avg episode reward: [(0, '-5.319'), (1, '-5.036')] [2023-12-27 23:02:36,238][106225] Updated weights for policy 1, policy_version 530578 (0.0008) [2023-12-27 23:02:36,303][106225] Updated weights for policy 1, policy_version 530588 (0.0009) [2023-12-27 23:02:36,364][106225] Updated weights for policy 1, policy_version 530598 (0.0008) [2023-12-27 23:02:36,425][106225] Updated weights for policy 1, policy_version 530608 (0.0007) [2023-12-27 23:02:36,538][106226] Updated weights for policy 0, policy_version 529177 (0.0011) [2023-12-27 23:02:36,596][106226] Updated weights for policy 0, policy_version 529187 (0.0011) [2023-12-27 23:02:36,653][106226] Updated weights for policy 0, policy_version 529197 (0.0011) [2023-12-27 23:02:36,712][106226] Updated weights for policy 0, policy_version 529207 (0.0011) [2023-12-27 23:02:37,074][106225] Updated weights for policy 1, policy_version 530618 (0.0008) [2023-12-27 23:02:37,136][106225] Updated weights for policy 1, policy_version 530628 (0.0006) [2023-12-27 23:02:37,211][106225] Updated weights for policy 1, policy_version 530638 (0.0006) [2023-12-27 23:02:37,409][106226] Updated weights for policy 0, policy_version 529217 (0.0011) [2023-12-27 23:02:37,477][106226] Updated weights for policy 0, policy_version 529227 (0.0009) [2023-12-27 23:02:37,541][106226] Updated weights for policy 0, policy_version 529237 (0.0006) [2023-12-27 23:02:37,894][106225] Updated weights for policy 1, policy_version 530648 (0.0008) [2023-12-27 23:02:37,951][106225] Updated weights for policy 1, policy_version 530658 (0.0007) [2023-12-27 23:02:38,013][106225] Updated weights for policy 1, policy_version 530668 (0.0007) [2023-12-27 23:02:38,208][106226] Updated weights for policy 0, policy_version 529247 (0.0009) [2023-12-27 23:02:38,266][106226] Updated weights for policy 0, policy_version 529257 (0.0006) [2023-12-27 23:02:38,335][106226] Updated weights for policy 0, policy_version 529267 (0.0009) [2023-12-27 23:02:38,740][106225] Updated weights for policy 1, policy_version 530678 (0.0009) [2023-12-27 23:02:38,800][106225] Updated weights for policy 1, policy_version 530688 (0.0008) [2023-12-27 23:02:38,861][106225] Updated weights for policy 1, policy_version 530698 (0.0008) [2023-12-27 23:02:39,008][106226] Updated weights for policy 0, policy_version 529277 (0.0009) [2023-12-27 23:02:39,056][106226] Updated weights for policy 0, policy_version 529287 (0.0010) [2023-12-27 23:02:39,103][106226] Updated weights for policy 0, policy_version 529297 (0.0010) [2023-12-27 23:02:39,630][106225] Updated weights for policy 1, policy_version 530708 (0.0009) [2023-12-27 23:02:39,693][106225] Updated weights for policy 1, policy_version 530718 (0.0008) [2023-12-27 23:02:39,758][106225] Updated weights for policy 1, policy_version 530728 (0.0009) [2023-12-27 23:02:39,881][106226] Updated weights for policy 0, policy_version 529307 (0.0009) [2023-12-27 23:02:39,949][106226] Updated weights for policy 0, policy_version 529317 (0.0009) [2023-12-27 23:02:40,003][106226] Updated weights for policy 0, policy_version 529327 (0.0009) [2023-12-27 23:02:40,508][106225] Updated weights for policy 1, policy_version 530738 (0.0008) [2023-12-27 23:02:40,557][106225] Updated weights for policy 1, policy_version 530748 (0.0008) [2023-12-27 23:02:40,616][106225] Updated weights for policy 1, policy_version 530758 (0.0008) [2023-12-27 23:02:40,681][106225] Updated weights for policy 1, policy_version 530768 (0.0007) [2023-12-27 23:02:40,687][106226] Updated weights for policy 0, policy_version 529337 (0.0007) [2023-12-27 23:02:40,755][106226] Updated weights for policy 0, policy_version 529347 (0.0006) [2023-12-27 23:02:40,825][106226] Updated weights for policy 0, policy_version 529357 (0.0009) [2023-12-27 23:02:40,891][106226] Updated weights for policy 0, policy_version 529367 (0.0006) [2023-12-27 23:02:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 271458304. Throughput: 0: 9895.9, 1: 10033.8. Samples: 271431108. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:41,175][105115] Avg episode reward: [(0, '-5.275'), (1, '-5.392')] [2023-12-27 23:02:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000530768_135905280.pth... [2023-12-27 23:02:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000529368_135553024.pth... [2023-12-27 23:02:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000528216_135258112.pth [2023-12-27 23:02:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000529584_135602176.pth [2023-12-27 23:02:41,454][106225] Updated weights for policy 1, policy_version 530778 (0.0008) [2023-12-27 23:02:41,511][106225] Updated weights for policy 1, policy_version 530788 (0.0007) [2023-12-27 23:02:41,554][106226] Updated weights for policy 0, policy_version 529377 (0.0008) [2023-12-27 23:02:41,569][106225] Updated weights for policy 1, policy_version 530798 (0.0006) [2023-12-27 23:02:41,616][106226] Updated weights for policy 0, policy_version 529387 (0.0008) [2023-12-27 23:02:41,679][106226] Updated weights for policy 0, policy_version 529397 (0.0008) [2023-12-27 23:02:42,341][106225] Updated weights for policy 1, policy_version 530808 (0.0008) [2023-12-27 23:02:42,410][106225] Updated weights for policy 1, policy_version 530818 (0.0008) [2023-12-27 23:02:42,446][106226] Updated weights for policy 0, policy_version 529407 (0.0008) [2023-12-27 23:02:42,461][106225] Updated weights for policy 1, policy_version 530828 (0.0006) [2023-12-27 23:02:42,505][106226] Updated weights for policy 0, policy_version 529417 (0.0008) [2023-12-27 23:02:42,572][106226] Updated weights for policy 0, policy_version 529427 (0.0008) [2023-12-27 23:02:43,157][106225] Updated weights for policy 1, policy_version 530838 (0.0007) [2023-12-27 23:02:43,216][106225] Updated weights for policy 1, policy_version 530848 (0.0008) [2023-12-27 23:02:43,275][106225] Updated weights for policy 1, policy_version 530858 (0.0008) [2023-12-27 23:02:43,300][106226] Updated weights for policy 0, policy_version 529437 (0.0008) [2023-12-27 23:02:43,359][106226] Updated weights for policy 0, policy_version 529447 (0.0008) [2023-12-27 23:02:43,421][106226] Updated weights for policy 0, policy_version 529457 (0.0008) [2023-12-27 23:02:44,019][106225] Updated weights for policy 1, policy_version 530868 (0.0007) [2023-12-27 23:02:44,078][106225] Updated weights for policy 1, policy_version 530878 (0.0007) [2023-12-27 23:02:44,122][106226] Updated weights for policy 0, policy_version 529467 (0.0007) [2023-12-27 23:02:44,130][106225] Updated weights for policy 1, policy_version 530888 (0.0009) [2023-12-27 23:02:44,177][106226] Updated weights for policy 0, policy_version 529477 (0.0005) [2023-12-27 23:02:44,238][106226] Updated weights for policy 0, policy_version 529487 (0.0005) [2023-12-27 23:02:44,837][106226] Updated weights for policy 0, policy_version 529497 (0.0006) [2023-12-27 23:02:44,911][106226] Updated weights for policy 0, policy_version 529507 (0.0008) [2023-12-27 23:02:44,917][106225] Updated weights for policy 1, policy_version 530898 (0.0008) [2023-12-27 23:02:44,980][106225] Updated weights for policy 1, policy_version 530908 (0.0008) [2023-12-27 23:02:44,982][106226] Updated weights for policy 0, policy_version 529517 (0.0007) [2023-12-27 23:02:45,042][106225] Updated weights for policy 1, policy_version 530918 (0.0008) [2023-12-27 23:02:45,048][106226] Updated weights for policy 0, policy_version 529527 (0.0008) [2023-12-27 23:02:45,107][106225] Updated weights for policy 1, policy_version 530928 (0.0009) [2023-12-27 23:02:45,666][106225] Updated weights for policy 1, policy_version 530938 (0.0010) [2023-12-27 23:02:45,685][106226] Updated weights for policy 0, policy_version 529537 (0.0006) [2023-12-27 23:02:45,720][106225] Updated weights for policy 1, policy_version 530948 (0.0010) [2023-12-27 23:02:45,742][106226] Updated weights for policy 0, policy_version 529547 (0.0006) [2023-12-27 23:02:45,767][106225] Updated weights for policy 1, policy_version 530958 (0.0010) [2023-12-27 23:02:45,797][106226] Updated weights for policy 0, policy_version 529557 (0.0006) [2023-12-27 23:02:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 271556608. Throughput: 0: 9832.6, 1: 9966.8. Samples: 271545216. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:46,175][105115] Avg episode reward: [(0, '-4.816'), (1, '-5.494')] [2023-12-27 23:02:46,506][106225] Updated weights for policy 1, policy_version 530968 (0.0010) [2023-12-27 23:02:46,531][106226] Updated weights for policy 0, policy_version 529567 (0.0006) [2023-12-27 23:02:46,553][106225] Updated weights for policy 1, policy_version 530978 (0.0010) [2023-12-27 23:02:46,578][106226] Updated weights for policy 0, policy_version 529577 (0.0005) [2023-12-27 23:02:46,607][106225] Updated weights for policy 1, policy_version 530988 (0.0010) [2023-12-27 23:02:46,636][106226] Updated weights for policy 0, policy_version 529587 (0.0006) [2023-12-27 23:02:47,339][106225] Updated weights for policy 1, policy_version 530998 (0.0010) [2023-12-27 23:02:47,377][106226] Updated weights for policy 0, policy_version 529597 (0.0009) [2023-12-27 23:02:47,392][106225] Updated weights for policy 1, policy_version 531008 (0.0009) [2023-12-27 23:02:47,434][106226] Updated weights for policy 0, policy_version 529607 (0.0007) [2023-12-27 23:02:47,444][106225] Updated weights for policy 1, policy_version 531018 (0.0010) [2023-12-27 23:02:47,489][106226] Updated weights for policy 0, policy_version 529617 (0.0006) [2023-12-27 23:02:48,135][106225] Updated weights for policy 1, policy_version 531028 (0.0008) [2023-12-27 23:02:48,198][106225] Updated weights for policy 1, policy_version 531038 (0.0008) [2023-12-27 23:02:48,213][106226] Updated weights for policy 0, policy_version 529627 (0.0007) [2023-12-27 23:02:48,245][106225] Updated weights for policy 1, policy_version 531048 (0.0008) [2023-12-27 23:02:48,273][106226] Updated weights for policy 0, policy_version 529637 (0.0005) [2023-12-27 23:02:48,323][106226] Updated weights for policy 0, policy_version 529647 (0.0006) [2023-12-27 23:02:48,894][106225] Updated weights for policy 1, policy_version 531058 (0.0008) [2023-12-27 23:02:48,942][106225] Updated weights for policy 1, policy_version 531068 (0.0006) [2023-12-27 23:02:48,989][106225] Updated weights for policy 1, policy_version 531078 (0.0005) [2023-12-27 23:02:49,043][106226] Updated weights for policy 0, policy_version 529657 (0.0008) [2023-12-27 23:02:49,053][106225] Updated weights for policy 1, policy_version 531088 (0.0006) [2023-12-27 23:02:49,109][106226] Updated weights for policy 0, policy_version 529667 (0.0011) [2023-12-27 23:02:49,175][106226] Updated weights for policy 0, policy_version 529677 (0.0010) [2023-12-27 23:02:49,238][106226] Updated weights for policy 0, policy_version 529687 (0.0009) [2023-12-27 23:02:49,763][106225] Updated weights for policy 1, policy_version 531098 (0.0008) [2023-12-27 23:02:49,831][106225] Updated weights for policy 1, policy_version 531108 (0.0009) [2023-12-27 23:02:49,892][106225] Updated weights for policy 1, policy_version 531118 (0.0007) [2023-12-27 23:02:49,989][106226] Updated weights for policy 0, policy_version 529697 (0.0011) [2023-12-27 23:02:50,051][106226] Updated weights for policy 0, policy_version 529707 (0.0008) [2023-12-27 23:02:50,116][106226] Updated weights for policy 0, policy_version 529717 (0.0008) [2023-12-27 23:02:50,532][106225] Updated weights for policy 1, policy_version 531128 (0.0005) [2023-12-27 23:02:50,595][106225] Updated weights for policy 1, policy_version 531138 (0.0007) [2023-12-27 23:02:50,659][106225] Updated weights for policy 1, policy_version 531148 (0.0009) [2023-12-27 23:02:50,819][106226] Updated weights for policy 0, policy_version 529727 (0.0007) [2023-12-27 23:02:50,874][106226] Updated weights for policy 0, policy_version 529737 (0.0008) [2023-12-27 23:02:50,931][106226] Updated weights for policy 0, policy_version 529747 (0.0009) [2023-12-27 23:02:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 271654912. Throughput: 0: 9827.8, 1: 10026.9. Samples: 271664160. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:51,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-5.828')] [2023-12-27 23:02:51,379][106225] Updated weights for policy 1, policy_version 531158 (0.0008) [2023-12-27 23:02:51,436][106225] Updated weights for policy 1, policy_version 531168 (0.0006) [2023-12-27 23:02:51,485][106225] Updated weights for policy 1, policy_version 531178 (0.0005) [2023-12-27 23:02:51,725][106226] Updated weights for policy 0, policy_version 529757 (0.0008) [2023-12-27 23:02:51,791][106226] Updated weights for policy 0, policy_version 529767 (0.0008) [2023-12-27 23:02:51,853][106226] Updated weights for policy 0, policy_version 529777 (0.0008) [2023-12-27 23:02:52,149][106225] Updated weights for policy 1, policy_version 531188 (0.0006) [2023-12-27 23:02:52,212][106225] Updated weights for policy 1, policy_version 531198 (0.0008) [2023-12-27 23:02:52,272][106225] Updated weights for policy 1, policy_version 531208 (0.0008) [2023-12-27 23:02:52,586][106226] Updated weights for policy 0, policy_version 529787 (0.0008) [2023-12-27 23:02:52,643][106226] Updated weights for policy 0, policy_version 529797 (0.0008) [2023-12-27 23:02:52,708][106226] Updated weights for policy 0, policy_version 529807 (0.0008) [2023-12-27 23:02:53,013][106225] Updated weights for policy 1, policy_version 531218 (0.0007) [2023-12-27 23:02:53,076][106225] Updated weights for policy 1, policy_version 531228 (0.0005) [2023-12-27 23:02:53,135][106225] Updated weights for policy 1, policy_version 531238 (0.0009) [2023-12-27 23:02:53,185][106225] Updated weights for policy 1, policy_version 531248 (0.0010) [2023-12-27 23:02:53,431][106226] Updated weights for policy 0, policy_version 529817 (0.0008) [2023-12-27 23:02:53,502][106226] Updated weights for policy 0, policy_version 529827 (0.0011) [2023-12-27 23:02:53,570][106226] Updated weights for policy 0, policy_version 529837 (0.0007) [2023-12-27 23:02:53,626][106226] Updated weights for policy 0, policy_version 529847 (0.0009) [2023-12-27 23:02:53,820][106225] Updated weights for policy 1, policy_version 531258 (0.0006) [2023-12-27 23:02:53,879][106225] Updated weights for policy 1, policy_version 531268 (0.0005) [2023-12-27 23:02:53,942][106225] Updated weights for policy 1, policy_version 531278 (0.0005) [2023-12-27 23:02:54,335][106226] Updated weights for policy 0, policy_version 529857 (0.0008) [2023-12-27 23:02:54,390][106226] Updated weights for policy 0, policy_version 529867 (0.0007) [2023-12-27 23:02:54,458][106226] Updated weights for policy 0, policy_version 529877 (0.0008) [2023-12-27 23:02:54,549][106225] Updated weights for policy 1, policy_version 531288 (0.0005) [2023-12-27 23:02:54,616][106225] Updated weights for policy 1, policy_version 531298 (0.0007) [2023-12-27 23:02:54,683][106225] Updated weights for policy 1, policy_version 531308 (0.0009) [2023-12-27 23:02:55,028][106226] Updated weights for policy 0, policy_version 529887 (0.0007) [2023-12-27 23:02:55,093][106226] Updated weights for policy 0, policy_version 529897 (0.0011) [2023-12-27 23:02:55,156][106226] Updated weights for policy 0, policy_version 529907 (0.0010) [2023-12-27 23:02:55,365][106225] Updated weights for policy 1, policy_version 531318 (0.0007) [2023-12-27 23:02:55,417][106225] Updated weights for policy 1, policy_version 531328 (0.0006) [2023-12-27 23:02:55,476][106225] Updated weights for policy 1, policy_version 531338 (0.0005) [2023-12-27 23:02:55,854][106226] Updated weights for policy 0, policy_version 529917 (0.0009) [2023-12-27 23:02:55,901][106226] Updated weights for policy 0, policy_version 529927 (0.0008) [2023-12-27 23:02:55,953][106226] Updated weights for policy 0, policy_version 529937 (0.0008) [2023-12-27 23:02:56,091][106225] Updated weights for policy 1, policy_version 531348 (0.0007) [2023-12-27 23:02:56,139][106225] Updated weights for policy 1, policy_version 531358 (0.0005) [2023-12-27 23:02:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 271753216. Throughput: 0: 9829.5, 1: 10015.6. Samples: 271722088. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:02:56,175][105115] Avg episode reward: [(0, '-4.990'), (1, '-5.372')] [2023-12-27 23:02:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000529944_135700480.pth... [2023-12-27 23:02:56,185][106225] Updated weights for policy 1, policy_version 531368 (0.0005) [2023-12-27 23:02:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000528792_135405568.pth [2023-12-27 23:02:56,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000531376_136060928.pth... [2023-12-27 23:02:56,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000530192_135757824.pth [2023-12-27 23:02:56,685][106226] Updated weights for policy 0, policy_version 529947 (0.0007) [2023-12-27 23:02:56,747][106226] Updated weights for policy 0, policy_version 529957 (0.0005) [2023-12-27 23:02:56,799][106226] Updated weights for policy 0, policy_version 529967 (0.0005) [2023-12-27 23:02:56,921][106225] Updated weights for policy 1, policy_version 531378 (0.0006) [2023-12-27 23:02:56,979][106225] Updated weights for policy 1, policy_version 531388 (0.0006) [2023-12-27 23:02:57,030][106225] Updated weights for policy 1, policy_version 531398 (0.0005) [2023-12-27 23:02:57,078][106225] Updated weights for policy 1, policy_version 531408 (0.0005) [2023-12-27 23:02:57,449][106226] Updated weights for policy 0, policy_version 529977 (0.0006) [2023-12-27 23:02:57,510][106226] Updated weights for policy 0, policy_version 529987 (0.0008) [2023-12-27 23:02:57,564][106226] Updated weights for policy 0, policy_version 529997 (0.0008) [2023-12-27 23:02:57,622][106226] Updated weights for policy 0, policy_version 530007 (0.0009) [2023-12-27 23:02:57,688][106225] Updated weights for policy 1, policy_version 531418 (0.0008) [2023-12-27 23:02:57,740][106225] Updated weights for policy 1, policy_version 531428 (0.0006) [2023-12-27 23:02:57,785][106225] Updated weights for policy 1, policy_version 531438 (0.0005) [2023-12-27 23:02:58,399][106226] Updated weights for policy 0, policy_version 530017 (0.0008) [2023-12-27 23:02:58,461][106226] Updated weights for policy 0, policy_version 530027 (0.0009) [2023-12-27 23:02:58,524][106226] Updated weights for policy 0, policy_version 530037 (0.0008) [2023-12-27 23:02:58,535][106225] Updated weights for policy 1, policy_version 531448 (0.0008) [2023-12-27 23:02:58,602][106225] Updated weights for policy 1, policy_version 531458 (0.0008) [2023-12-27 23:02:58,665][106225] Updated weights for policy 1, policy_version 531468 (0.0009) [2023-12-27 23:02:59,278][106226] Updated weights for policy 0, policy_version 530047 (0.0010) [2023-12-27 23:02:59,343][106226] Updated weights for policy 0, policy_version 530057 (0.0011) [2023-12-27 23:02:59,409][106226] Updated weights for policy 0, policy_version 530067 (0.0009) [2023-12-27 23:02:59,466][106225] Updated weights for policy 1, policy_version 531478 (0.0007) [2023-12-27 23:02:59,517][106225] Updated weights for policy 1, policy_version 531488 (0.0008) [2023-12-27 23:02:59,568][106225] Updated weights for policy 1, policy_version 531498 (0.0008) [2023-12-27 23:03:00,049][106226] Updated weights for policy 0, policy_version 530077 (0.0006) [2023-12-27 23:03:00,117][106226] Updated weights for policy 0, policy_version 530087 (0.0006) [2023-12-27 23:03:00,187][106226] Updated weights for policy 0, policy_version 530097 (0.0005) [2023-12-27 23:03:00,426][106225] Updated weights for policy 1, policy_version 531508 (0.0009) [2023-12-27 23:03:00,478][106225] Updated weights for policy 1, policy_version 531518 (0.0008) [2023-12-27 23:03:00,530][106225] Updated weights for policy 1, policy_version 531528 (0.0007) [2023-12-27 23:03:00,789][106226] Updated weights for policy 0, policy_version 530107 (0.0007) [2023-12-27 23:03:00,845][106226] Updated weights for policy 0, policy_version 530117 (0.0010) [2023-12-27 23:03:00,907][106226] Updated weights for policy 0, policy_version 530127 (0.0010) [2023-12-27 23:03:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 271851520. Throughput: 0: 9820.9, 1: 10034.1. Samples: 271841228. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:01,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.305')] [2023-12-27 23:03:01,299][106225] Updated weights for policy 1, policy_version 531538 (0.0007) [2023-12-27 23:03:01,365][106225] Updated weights for policy 1, policy_version 531548 (0.0007) [2023-12-27 23:03:01,429][106225] Updated weights for policy 1, policy_version 531558 (0.0007) [2023-12-27 23:03:01,491][106225] Updated weights for policy 1, policy_version 531568 (0.0008) [2023-12-27 23:03:01,596][106226] Updated weights for policy 0, policy_version 530137 (0.0007) [2023-12-27 23:03:01,664][106226] Updated weights for policy 0, policy_version 530147 (0.0011) [2023-12-27 23:03:01,726][106226] Updated weights for policy 0, policy_version 530157 (0.0011) [2023-12-27 23:03:01,795][106226] Updated weights for policy 0, policy_version 530167 (0.0011) [2023-12-27 23:03:02,257][106225] Updated weights for policy 1, policy_version 531578 (0.0008) [2023-12-27 23:03:02,308][106225] Updated weights for policy 1, policy_version 531588 (0.0008) [2023-12-27 23:03:02,372][106225] Updated weights for policy 1, policy_version 531598 (0.0008) [2023-12-27 23:03:02,515][106226] Updated weights for policy 0, policy_version 530177 (0.0011) [2023-12-27 23:03:02,576][106226] Updated weights for policy 0, policy_version 530187 (0.0010) [2023-12-27 23:03:02,636][106226] Updated weights for policy 0, policy_version 530197 (0.0010) [2023-12-27 23:03:03,126][106225] Updated weights for policy 1, policy_version 531608 (0.0009) [2023-12-27 23:03:03,181][106225] Updated weights for policy 1, policy_version 531619 (0.0009) [2023-12-27 23:03:03,231][106225] Updated weights for policy 1, policy_version 531629 (0.0008) [2023-12-27 23:03:03,282][106226] Updated weights for policy 0, policy_version 530207 (0.0008) [2023-12-27 23:03:03,335][106226] Updated weights for policy 0, policy_version 530217 (0.0009) [2023-12-27 23:03:03,390][106226] Updated weights for policy 0, policy_version 530227 (0.0009) [2023-12-27 23:03:03,926][106225] Updated weights for policy 1, policy_version 531639 (0.0009) [2023-12-27 23:03:03,982][106225] Updated weights for policy 1, policy_version 531649 (0.0009) [2023-12-27 23:03:04,038][106225] Updated weights for policy 1, policy_version 531659 (0.0008) [2023-12-27 23:03:04,144][106226] Updated weights for policy 0, policy_version 530237 (0.0008) [2023-12-27 23:03:04,208][106226] Updated weights for policy 0, policy_version 530247 (0.0008) [2023-12-27 23:03:04,273][106226] Updated weights for policy 0, policy_version 530257 (0.0008) [2023-12-27 23:03:04,806][106225] Updated weights for policy 1, policy_version 531669 (0.0008) [2023-12-27 23:03:04,851][106225] Updated weights for policy 1, policy_version 531679 (0.0008) [2023-12-27 23:03:04,896][106225] Updated weights for policy 1, policy_version 531689 (0.0008) [2023-12-27 23:03:04,996][106226] Updated weights for policy 0, policy_version 530267 (0.0008) [2023-12-27 23:03:05,062][106226] Updated weights for policy 0, policy_version 530277 (0.0009) [2023-12-27 23:03:05,121][106226] Updated weights for policy 0, policy_version 530287 (0.0009) [2023-12-27 23:03:05,652][106225] Updated weights for policy 1, policy_version 531699 (0.0009) [2023-12-27 23:03:05,713][106225] Updated weights for policy 1, policy_version 531709 (0.0010) [2023-12-27 23:03:05,762][106225] Updated weights for policy 1, policy_version 531719 (0.0009) [2023-12-27 23:03:05,809][106226] Updated weights for policy 0, policy_version 530297 (0.0008) [2023-12-27 23:03:05,861][106226] Updated weights for policy 0, policy_version 530307 (0.0010) [2023-12-27 23:03:05,919][106226] Updated weights for policy 0, policy_version 530317 (0.0008) [2023-12-27 23:03:05,980][106226] Updated weights for policy 0, policy_version 530327 (0.0006) [2023-12-27 23:03:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 271949824. Throughput: 0: 9782.8, 1: 9977.5. Samples: 271956924. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:06,175][105115] Avg episode reward: [(0, '-4.981'), (1, '-5.315')] [2023-12-27 23:03:06,518][106225] Updated weights for policy 1, policy_version 531729 (0.0008) [2023-12-27 23:03:06,584][106225] Updated weights for policy 1, policy_version 531739 (0.0009) [2023-12-27 23:03:06,652][106225] Updated weights for policy 1, policy_version 531749 (0.0007) [2023-12-27 23:03:06,664][106226] Updated weights for policy 0, policy_version 530337 (0.0008) [2023-12-27 23:03:06,716][106225] Updated weights for policy 1, policy_version 531759 (0.0009) [2023-12-27 23:03:06,730][106226] Updated weights for policy 0, policy_version 530347 (0.0011) [2023-12-27 23:03:06,798][106226] Updated weights for policy 0, policy_version 530357 (0.0011) [2023-12-27 23:03:07,458][106225] Updated weights for policy 1, policy_version 531769 (0.0010) [2023-12-27 23:03:07,517][106225] Updated weights for policy 1, policy_version 531779 (0.0010) [2023-12-27 23:03:07,536][106226] Updated weights for policy 0, policy_version 530367 (0.0011) [2023-12-27 23:03:07,575][106225] Updated weights for policy 1, policy_version 531789 (0.0010) [2023-12-27 23:03:07,597][106226] Updated weights for policy 0, policy_version 530377 (0.0011) [2023-12-27 23:03:07,652][106226] Updated weights for policy 0, policy_version 530387 (0.0008) [2023-12-27 23:03:08,240][106225] Updated weights for policy 1, policy_version 531799 (0.0007) [2023-12-27 23:03:08,297][106225] Updated weights for policy 1, policy_version 531809 (0.0009) [2023-12-27 23:03:08,339][106226] Updated weights for policy 0, policy_version 530397 (0.0009) [2023-12-27 23:03:08,359][106225] Updated weights for policy 1, policy_version 531819 (0.0008) [2023-12-27 23:03:08,403][106226] Updated weights for policy 0, policy_version 530407 (0.0009) [2023-12-27 23:03:08,465][106226] Updated weights for policy 0, policy_version 530417 (0.0009) [2023-12-27 23:03:09,093][106226] Updated weights for policy 0, policy_version 530427 (0.0006) [2023-12-27 23:03:09,132][106225] Updated weights for policy 1, policy_version 531829 (0.0007) [2023-12-27 23:03:09,147][106226] Updated weights for policy 0, policy_version 530437 (0.0005) [2023-12-27 23:03:09,191][106225] Updated weights for policy 1, policy_version 531839 (0.0006) [2023-12-27 23:03:09,193][106226] Updated weights for policy 0, policy_version 530447 (0.0008) [2023-12-27 23:03:09,263][106225] Updated weights for policy 1, policy_version 531849 (0.0007) [2023-12-27 23:03:09,883][106225] Updated weights for policy 1, policy_version 531859 (0.0006) [2023-12-27 23:03:09,956][106225] Updated weights for policy 1, policy_version 531869 (0.0008) [2023-12-27 23:03:09,961][106226] Updated weights for policy 0, policy_version 530457 (0.0010) [2023-12-27 23:03:10,017][106225] Updated weights for policy 1, policy_version 531879 (0.0007) [2023-12-27 23:03:10,033][106226] Updated weights for policy 0, policy_version 530467 (0.0011) [2023-12-27 23:03:10,101][106226] Updated weights for policy 0, policy_version 530477 (0.0011) [2023-12-27 23:03:10,170][106226] Updated weights for policy 0, policy_version 530487 (0.0011) [2023-12-27 23:03:10,734][106225] Updated weights for policy 1, policy_version 531889 (0.0009) [2023-12-27 23:03:10,802][106225] Updated weights for policy 1, policy_version 531899 (0.0008) [2023-12-27 23:03:10,863][106225] Updated weights for policy 1, policy_version 531909 (0.0008) [2023-12-27 23:03:10,886][106226] Updated weights for policy 0, policy_version 530497 (0.0007) [2023-12-27 23:03:10,921][106225] Updated weights for policy 1, policy_version 531919 (0.0007) [2023-12-27 23:03:10,942][106226] Updated weights for policy 0, policy_version 530507 (0.0007) [2023-12-27 23:03:10,998][106226] Updated weights for policy 0, policy_version 530517 (0.0008) [2023-12-27 23:03:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 272048128. Throughput: 0: 9862.5, 1: 9956.2. Samples: 272015832. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:11,175][105115] Avg episode reward: [(0, '-5.097'), (1, '-5.644')] [2023-12-27 23:03:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000531920_136200192.pth... [2023-12-27 23:03:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000530520_135847936.pth... [2023-12-27 23:03:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000530768_135905280.pth [2023-12-27 23:03:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000529368_135553024.pth [2023-12-27 23:03:11,630][106225] Updated weights for policy 1, policy_version 531929 (0.0008) [2023-12-27 23:03:11,694][106225] Updated weights for policy 1, policy_version 531939 (0.0008) [2023-12-27 23:03:11,760][106225] Updated weights for policy 1, policy_version 531949 (0.0008) [2023-12-27 23:03:11,840][106226] Updated weights for policy 0, policy_version 530527 (0.0009) [2023-12-27 23:03:11,896][106226] Updated weights for policy 0, policy_version 530537 (0.0009) [2023-12-27 23:03:11,951][106226] Updated weights for policy 0, policy_version 530547 (0.0008) [2023-12-27 23:03:12,471][106225] Updated weights for policy 1, policy_version 531959 (0.0009) [2023-12-27 23:03:12,532][106225] Updated weights for policy 1, policy_version 531969 (0.0009) [2023-12-27 23:03:12,590][106225] Updated weights for policy 1, policy_version 531979 (0.0010) [2023-12-27 23:03:12,669][106226] Updated weights for policy 0, policy_version 530557 (0.0009) [2023-12-27 23:03:12,733][106226] Updated weights for policy 0, policy_version 530567 (0.0011) [2023-12-27 23:03:12,798][106226] Updated weights for policy 0, policy_version 530577 (0.0011) [2023-12-27 23:03:13,316][106225] Updated weights for policy 1, policy_version 531989 (0.0008) [2023-12-27 23:03:13,363][106225] Updated weights for policy 1, policy_version 531999 (0.0005) [2023-12-27 23:03:13,412][106225] Updated weights for policy 1, policy_version 532009 (0.0005) [2023-12-27 23:03:13,486][106226] Updated weights for policy 0, policy_version 530587 (0.0009) [2023-12-27 23:03:13,543][106226] Updated weights for policy 0, policy_version 530597 (0.0011) [2023-12-27 23:03:13,603][106226] Updated weights for policy 0, policy_version 530607 (0.0010) [2023-12-27 23:03:14,056][106225] Updated weights for policy 1, policy_version 532019 (0.0006) [2023-12-27 23:03:14,109][106225] Updated weights for policy 1, policy_version 532029 (0.0009) [2023-12-27 23:03:14,157][106225] Updated weights for policy 1, policy_version 532039 (0.0008) [2023-12-27 23:03:14,278][106226] Updated weights for policy 0, policy_version 530617 (0.0010) [2023-12-27 23:03:14,331][106226] Updated weights for policy 0, policy_version 530627 (0.0009) [2023-12-27 23:03:14,381][106226] Updated weights for policy 0, policy_version 530637 (0.0009) [2023-12-27 23:03:14,428][106226] Updated weights for policy 0, policy_version 530647 (0.0007) [2023-12-27 23:03:14,972][106225] Updated weights for policy 1, policy_version 532049 (0.0008) [2023-12-27 23:03:15,035][106225] Updated weights for policy 1, policy_version 532059 (0.0008) [2023-12-27 23:03:15,093][106225] Updated weights for policy 1, policy_version 532069 (0.0008) [2023-12-27 23:03:15,110][106226] Updated weights for policy 0, policy_version 530657 (0.0009) [2023-12-27 23:03:15,155][106225] Updated weights for policy 1, policy_version 532079 (0.0007) [2023-12-27 23:03:15,172][106226] Updated weights for policy 0, policy_version 530667 (0.0011) [2023-12-27 23:03:15,238][106226] Updated weights for policy 0, policy_version 530677 (0.0007) [2023-12-27 23:03:15,804][106225] Updated weights for policy 1, policy_version 532089 (0.0009) [2023-12-27 23:03:15,818][106226] Updated weights for policy 0, policy_version 530687 (0.0009) [2023-12-27 23:03:15,855][106225] Updated weights for policy 1, policy_version 532099 (0.0010) [2023-12-27 23:03:15,871][106226] Updated weights for policy 0, policy_version 530697 (0.0007) [2023-12-27 23:03:15,905][106225] Updated weights for policy 1, policy_version 532109 (0.0010) [2023-12-27 23:03:15,927][106226] Updated weights for policy 0, policy_version 530707 (0.0007) [2023-12-27 23:03:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 272146432. Throughput: 0: 9816.5, 1: 9750.6. Samples: 272132216. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:16,175][105115] Avg episode reward: [(0, '-5.032'), (1, '-5.744')] [2023-12-27 23:03:16,515][106225] Updated weights for policy 1, policy_version 532119 (0.0007) [2023-12-27 23:03:16,561][106226] Updated weights for policy 0, policy_version 530717 (0.0010) [2023-12-27 23:03:16,575][106225] Updated weights for policy 1, policy_version 532129 (0.0007) [2023-12-27 23:03:16,609][106226] Updated weights for policy 0, policy_version 530727 (0.0005) [2023-12-27 23:03:16,627][106225] Updated weights for policy 1, policy_version 532139 (0.0007) [2023-12-27 23:03:16,666][106226] Updated weights for policy 0, policy_version 530737 (0.0006) [2023-12-27 23:03:17,272][106225] Updated weights for policy 1, policy_version 532149 (0.0006) [2023-12-27 23:03:17,280][106226] Updated weights for policy 0, policy_version 530747 (0.0007) [2023-12-27 23:03:17,322][106225] Updated weights for policy 1, policy_version 532159 (0.0006) [2023-12-27 23:03:17,336][106226] Updated weights for policy 0, policy_version 530757 (0.0006) [2023-12-27 23:03:17,371][106225] Updated weights for policy 1, policy_version 532169 (0.0007) [2023-12-27 23:03:17,395][106226] Updated weights for policy 0, policy_version 530767 (0.0010) [2023-12-27 23:03:17,983][106225] Updated weights for policy 1, policy_version 532179 (0.0005) [2023-12-27 23:03:18,044][106225] Updated weights for policy 1, policy_version 532189 (0.0008) [2023-12-27 23:03:18,110][106225] Updated weights for policy 1, policy_version 532199 (0.0008) [2023-12-27 23:03:18,132][106226] Updated weights for policy 0, policy_version 530777 (0.0010) [2023-12-27 23:03:18,195][106226] Updated weights for policy 0, policy_version 530787 (0.0007) [2023-12-27 23:03:18,260][106226] Updated weights for policy 0, policy_version 530797 (0.0009) [2023-12-27 23:03:18,319][106226] Updated weights for policy 0, policy_version 530807 (0.0008) [2023-12-27 23:03:18,858][106225] Updated weights for policy 1, policy_version 532209 (0.0008) [2023-12-27 23:03:18,914][106225] Updated weights for policy 1, policy_version 532219 (0.0009) [2023-12-27 23:03:18,970][106225] Updated weights for policy 1, policy_version 532229 (0.0008) [2023-12-27 23:03:19,009][106226] Updated weights for policy 0, policy_version 530817 (0.0008) [2023-12-27 23:03:19,029][106225] Updated weights for policy 1, policy_version 532239 (0.0010) [2023-12-27 23:03:19,066][106226] Updated weights for policy 0, policy_version 530827 (0.0008) [2023-12-27 23:03:19,118][106226] Updated weights for policy 0, policy_version 530837 (0.0009) [2023-12-27 23:03:19,768][106225] Updated weights for policy 1, policy_version 532249 (0.0009) [2023-12-27 23:03:19,829][106225] Updated weights for policy 1, policy_version 532259 (0.0009) [2023-12-27 23:03:19,893][106225] Updated weights for policy 1, policy_version 532269 (0.0007) [2023-12-27 23:03:19,903][106226] Updated weights for policy 0, policy_version 530847 (0.0008) [2023-12-27 23:03:19,968][106226] Updated weights for policy 0, policy_version 530857 (0.0009) [2023-12-27 23:03:20,022][106226] Updated weights for policy 0, policy_version 530867 (0.0009) [2023-12-27 23:03:20,591][106225] Updated weights for policy 1, policy_version 532279 (0.0007) [2023-12-27 23:03:20,655][106225] Updated weights for policy 1, policy_version 532289 (0.0008) [2023-12-27 23:03:20,717][106225] Updated weights for policy 1, policy_version 532299 (0.0008) [2023-12-27 23:03:20,797][106226] Updated weights for policy 0, policy_version 530877 (0.0009) [2023-12-27 23:03:20,851][106226] Updated weights for policy 0, policy_version 530887 (0.0009) [2023-12-27 23:03:20,907][106226] Updated weights for policy 0, policy_version 530897 (0.0009) [2023-12-27 23:03:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 272244736. Throughput: 0: 9798.9, 1: 9773.3. Samples: 272252464. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:21,175][105115] Avg episode reward: [(0, '-5.233'), (1, '-5.411')] [2023-12-27 23:03:21,366][106225] Updated weights for policy 1, policy_version 532309 (0.0008) [2023-12-27 23:03:21,434][106225] Updated weights for policy 1, policy_version 532319 (0.0009) [2023-12-27 23:03:21,491][106225] Updated weights for policy 1, policy_version 532329 (0.0009) [2023-12-27 23:03:21,770][106226] Updated weights for policy 0, policy_version 530907 (0.0009) [2023-12-27 23:03:21,836][106226] Updated weights for policy 0, policy_version 530917 (0.0008) [2023-12-27 23:03:21,905][106226] Updated weights for policy 0, policy_version 530927 (0.0008) [2023-12-27 23:03:22,242][106225] Updated weights for policy 1, policy_version 532339 (0.0009) [2023-12-27 23:03:22,301][106225] Updated weights for policy 1, policy_version 532349 (0.0008) [2023-12-27 23:03:22,366][106225] Updated weights for policy 1, policy_version 532359 (0.0007) [2023-12-27 23:03:22,639][106226] Updated weights for policy 0, policy_version 530937 (0.0008) [2023-12-27 23:03:22,701][106226] Updated weights for policy 0, policy_version 530947 (0.0008) [2023-12-27 23:03:22,767][106226] Updated weights for policy 0, policy_version 530957 (0.0008) [2023-12-27 23:03:22,829][106226] Updated weights for policy 0, policy_version 530967 (0.0008) [2023-12-27 23:03:23,093][106225] Updated weights for policy 1, policy_version 532369 (0.0008) [2023-12-27 23:03:23,160][106225] Updated weights for policy 1, policy_version 532379 (0.0009) [2023-12-27 23:03:23,224][106225] Updated weights for policy 1, policy_version 532389 (0.0008) [2023-12-27 23:03:23,272][106225] Updated weights for policy 1, policy_version 532399 (0.0005) [2023-12-27 23:03:23,627][106226] Updated weights for policy 0, policy_version 530977 (0.0008) [2023-12-27 23:03:23,703][106226] Updated weights for policy 0, policy_version 530987 (0.0006) [2023-12-27 23:03:23,754][106226] Updated weights for policy 0, policy_version 530997 (0.0008) [2023-12-27 23:03:23,864][106225] Updated weights for policy 1, policy_version 532409 (0.0008) [2023-12-27 23:03:23,911][106225] Updated weights for policy 1, policy_version 532419 (0.0009) [2023-12-27 23:03:23,955][106225] Updated weights for policy 1, policy_version 532429 (0.0008) [2023-12-27 23:03:24,425][106226] Updated weights for policy 0, policy_version 531007 (0.0010) [2023-12-27 23:03:24,493][106226] Updated weights for policy 0, policy_version 531017 (0.0008) [2023-12-27 23:03:24,565][106226] Updated weights for policy 0, policy_version 531027 (0.0009) [2023-12-27 23:03:24,734][106225] Updated weights for policy 1, policy_version 532439 (0.0009) [2023-12-27 23:03:24,789][106225] Updated weights for policy 1, policy_version 532449 (0.0008) [2023-12-27 23:03:24,847][106225] Updated weights for policy 1, policy_version 532459 (0.0008) [2023-12-27 23:03:25,294][106226] Updated weights for policy 0, policy_version 531037 (0.0010) [2023-12-27 23:03:25,358][106226] Updated weights for policy 0, policy_version 531047 (0.0009) [2023-12-27 23:03:25,421][106226] Updated weights for policy 0, policy_version 531057 (0.0008) [2023-12-27 23:03:25,532][106225] Updated weights for policy 1, policy_version 532469 (0.0008) [2023-12-27 23:03:25,583][106225] Updated weights for policy 1, policy_version 532479 (0.0009) [2023-12-27 23:03:25,636][106225] Updated weights for policy 1, policy_version 532490 (0.0008) [2023-12-27 23:03:26,060][106226] Updated weights for policy 0, policy_version 531067 (0.0007) [2023-12-27 23:03:26,112][106226] Updated weights for policy 0, policy_version 531077 (0.0009) [2023-12-27 23:03:26,167][106226] Updated weights for policy 0, policy_version 531087 (0.0009) [2023-12-27 23:03:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 272334848. Throughput: 0: 9735.0, 1: 9793.3. Samples: 272309884. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:26,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-5.556')] [2023-12-27 23:03:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000532496_136347648.pth... [2023-12-27 23:03:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000531376_136060928.pth [2023-12-27 23:03:26,209][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000531096_135995392.pth... [2023-12-27 23:03:26,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000529944_135700480.pth [2023-12-27 23:03:26,378][106225] Updated weights for policy 1, policy_version 532500 (0.0008) [2023-12-27 23:03:26,428][106225] Updated weights for policy 1, policy_version 532510 (0.0008) [2023-12-27 23:03:26,481][106225] Updated weights for policy 1, policy_version 532520 (0.0008) [2023-12-27 23:03:26,918][106226] Updated weights for policy 0, policy_version 531097 (0.0009) [2023-12-27 23:03:26,978][106226] Updated weights for policy 0, policy_version 531107 (0.0009) [2023-12-27 23:03:27,030][106226] Updated weights for policy 0, policy_version 531117 (0.0008) [2023-12-27 23:03:27,088][106226] Updated weights for policy 0, policy_version 531127 (0.0008) [2023-12-27 23:03:27,204][106225] Updated weights for policy 1, policy_version 532530 (0.0008) [2023-12-27 23:03:27,252][106225] Updated weights for policy 1, policy_version 532540 (0.0008) [2023-12-27 23:03:27,301][106225] Updated weights for policy 1, policy_version 532550 (0.0008) [2023-12-27 23:03:27,353][106225] Updated weights for policy 1, policy_version 532560 (0.0008) [2023-12-27 23:03:27,803][106226] Updated weights for policy 0, policy_version 531137 (0.0008) [2023-12-27 23:03:27,854][106226] Updated weights for policy 0, policy_version 531147 (0.0008) [2023-12-27 23:03:27,913][106226] Updated weights for policy 0, policy_version 531157 (0.0009) [2023-12-27 23:03:28,098][106225] Updated weights for policy 1, policy_version 532570 (0.0008) [2023-12-27 23:03:28,149][106225] Updated weights for policy 1, policy_version 532580 (0.0008) [2023-12-27 23:03:28,193][106225] Updated weights for policy 1, policy_version 532590 (0.0008) [2023-12-27 23:03:28,641][106226] Updated weights for policy 0, policy_version 531167 (0.0009) [2023-12-27 23:03:28,696][106226] Updated weights for policy 0, policy_version 531177 (0.0008) [2023-12-27 23:03:28,749][106226] Updated weights for policy 0, policy_version 531187 (0.0008) [2023-12-27 23:03:28,912][106225] Updated weights for policy 1, policy_version 532600 (0.0007) [2023-12-27 23:03:28,967][106225] Updated weights for policy 1, policy_version 532610 (0.0008) [2023-12-27 23:03:29,022][106225] Updated weights for policy 1, policy_version 532620 (0.0010) [2023-12-27 23:03:29,396][106226] Updated weights for policy 0, policy_version 531197 (0.0009) [2023-12-27 23:03:29,456][106226] Updated weights for policy 0, policy_version 531207 (0.0008) [2023-12-27 23:03:29,519][106226] Updated weights for policy 0, policy_version 531217 (0.0009) [2023-12-27 23:03:29,802][106225] Updated weights for policy 1, policy_version 532630 (0.0008) [2023-12-27 23:03:29,871][106225] Updated weights for policy 1, policy_version 532640 (0.0008) [2023-12-27 23:03:29,950][106225] Updated weights for policy 1, policy_version 532650 (0.0006) [2023-12-27 23:03:30,266][106226] Updated weights for policy 0, policy_version 531227 (0.0007) [2023-12-27 23:03:30,330][106226] Updated weights for policy 0, policy_version 531237 (0.0009) [2023-12-27 23:03:30,392][106226] Updated weights for policy 0, policy_version 531247 (0.0008) [2023-12-27 23:03:30,483][106225] Updated weights for policy 1, policy_version 532660 (0.0006) [2023-12-27 23:03:30,535][106225] Updated weights for policy 1, policy_version 532670 (0.0007) [2023-12-27 23:03:30,590][106225] Updated weights for policy 1, policy_version 532680 (0.0008) [2023-12-27 23:03:31,032][106226] Updated weights for policy 0, policy_version 531257 (0.0009) [2023-12-27 23:03:31,095][106226] Updated weights for policy 0, policy_version 531267 (0.0007) [2023-12-27 23:03:31,160][106226] Updated weights for policy 0, policy_version 531277 (0.0008) [2023-12-27 23:03:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 272433152. Throughput: 0: 9731.0, 1: 9847.6. Samples: 272426252. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-27 23:03:31,175][105115] Avg episode reward: [(0, '-4.774'), (1, '-5.186')] [2023-12-27 23:03:31,222][106226] Updated weights for policy 0, policy_version 531287 (0.0007) [2023-12-27 23:03:31,330][106225] Updated weights for policy 1, policy_version 532690 (0.0008) [2023-12-27 23:03:31,403][106225] Updated weights for policy 1, policy_version 532700 (0.0008) [2023-12-27 23:03:31,450][106225] Updated weights for policy 1, policy_version 532710 (0.0008) [2023-12-27 23:03:31,502][106225] Updated weights for policy 1, policy_version 532720 (0.0008) [2023-12-27 23:03:31,870][106226] Updated weights for policy 0, policy_version 531297 (0.0009) [2023-12-27 23:03:31,941][106226] Updated weights for policy 0, policy_version 531307 (0.0009) [2023-12-27 23:03:32,002][106226] Updated weights for policy 0, policy_version 531317 (0.0009) [2023-12-27 23:03:32,208][106225] Updated weights for policy 1, policy_version 532730 (0.0008) [2023-12-27 23:03:32,272][106225] Updated weights for policy 1, policy_version 532740 (0.0007) [2023-12-27 23:03:32,334][106225] Updated weights for policy 1, policy_version 532750 (0.0008) [2023-12-27 23:03:32,689][106226] Updated weights for policy 0, policy_version 531327 (0.0009) [2023-12-27 23:03:32,746][106226] Updated weights for policy 0, policy_version 531337 (0.0009) [2023-12-27 23:03:32,804][106226] Updated weights for policy 0, policy_version 531347 (0.0008) [2023-12-27 23:03:32,991][106225] Updated weights for policy 1, policy_version 532760 (0.0006) [2023-12-27 23:03:33,037][106225] Updated weights for policy 1, policy_version 532770 (0.0005) [2023-12-27 23:03:33,088][106225] Updated weights for policy 1, policy_version 532780 (0.0005) [2023-12-27 23:03:33,469][106226] Updated weights for policy 0, policy_version 531357 (0.0009) [2023-12-27 23:03:33,530][106226] Updated weights for policy 0, policy_version 531367 (0.0008) [2023-12-27 23:03:33,590][106226] Updated weights for policy 0, policy_version 531377 (0.0007) [2023-12-27 23:03:33,753][106225] Updated weights for policy 1, policy_version 532790 (0.0007) [2023-12-27 23:03:33,811][106225] Updated weights for policy 1, policy_version 532800 (0.0008) [2023-12-27 23:03:33,864][106225] Updated weights for policy 1, policy_version 532810 (0.0008) [2023-12-27 23:03:34,281][106226] Updated weights for policy 0, policy_version 531387 (0.0009) [2023-12-27 23:03:34,344][106226] Updated weights for policy 0, policy_version 531397 (0.0009) [2023-12-27 23:03:34,408][106226] Updated weights for policy 0, policy_version 531407 (0.0009) [2023-12-27 23:03:34,545][106225] Updated weights for policy 1, policy_version 532820 (0.0007) [2023-12-27 23:03:34,605][106225] Updated weights for policy 1, policy_version 532830 (0.0005) [2023-12-27 23:03:34,669][106225] Updated weights for policy 1, policy_version 532840 (0.0007) [2023-12-27 23:03:35,054][106226] Updated weights for policy 0, policy_version 531417 (0.0008) [2023-12-27 23:03:35,111][106226] Updated weights for policy 0, policy_version 531427 (0.0005) [2023-12-27 23:03:35,171][106226] Updated weights for policy 0, policy_version 531437 (0.0005) [2023-12-27 23:03:35,233][106226] Updated weights for policy 0, policy_version 531447 (0.0006) [2023-12-27 23:03:35,245][106225] Updated weights for policy 1, policy_version 532850 (0.0008) [2023-12-27 23:03:35,291][106225] Updated weights for policy 1, policy_version 532860 (0.0005) [2023-12-27 23:03:35,336][106225] Updated weights for policy 1, policy_version 532870 (0.0005) [2023-12-27 23:03:35,390][106225] Updated weights for policy 1, policy_version 532880 (0.0005) [2023-12-27 23:03:35,884][106226] Updated weights for policy 0, policy_version 531457 (0.0009) [2023-12-27 23:03:35,932][106226] Updated weights for policy 0, policy_version 531467 (0.0008) [2023-12-27 23:03:35,992][106226] Updated weights for policy 0, policy_version 531477 (0.0009) [2023-12-27 23:03:36,066][106225] Updated weights for policy 1, policy_version 532890 (0.0008) [2023-12-27 23:03:36,120][106225] Updated weights for policy 1, policy_version 532900 (0.0009) [2023-12-27 23:03:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 272539648. Throughput: 0: 9808.3, 1: 9885.7. Samples: 272550388. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:03:36,175][105115] Avg episode reward: [(0, '-5.387'), (1, '-5.135')] [2023-12-27 23:03:36,180][106225] Updated weights for policy 1, policy_version 532910 (0.0009) [2023-12-27 23:03:36,760][106226] Updated weights for policy 0, policy_version 531487 (0.0010) [2023-12-27 23:03:36,810][106226] Updated weights for policy 0, policy_version 531497 (0.0010) [2023-12-27 23:03:36,865][106226] Updated weights for policy 0, policy_version 531507 (0.0010) [2023-12-27 23:03:36,951][106225] Updated weights for policy 1, policy_version 532920 (0.0008) [2023-12-27 23:03:37,002][106225] Updated weights for policy 1, policy_version 532930 (0.0008) [2023-12-27 23:03:37,056][106225] Updated weights for policy 1, policy_version 532940 (0.0007) [2023-12-27 23:03:37,610][106226] Updated weights for policy 0, policy_version 531517 (0.0011) [2023-12-27 23:03:37,670][106226] Updated weights for policy 0, policy_version 531527 (0.0011) [2023-12-27 23:03:37,727][106226] Updated weights for policy 0, policy_version 531537 (0.0010) [2023-12-27 23:03:37,818][106225] Updated weights for policy 1, policy_version 532950 (0.0007) [2023-12-27 23:03:37,874][106225] Updated weights for policy 1, policy_version 532960 (0.0008) [2023-12-27 23:03:37,936][106225] Updated weights for policy 1, policy_version 532970 (0.0008) [2023-12-27 23:03:38,500][106226] Updated weights for policy 0, policy_version 531547 (0.0008) [2023-12-27 23:03:38,566][106226] Updated weights for policy 0, policy_version 531557 (0.0009) [2023-12-27 23:03:38,632][106226] Updated weights for policy 0, policy_version 531567 (0.0009) [2023-12-27 23:03:38,666][106225] Updated weights for policy 1, policy_version 532980 (0.0009) [2023-12-27 23:03:38,718][106225] Updated weights for policy 1, policy_version 532990 (0.0008) [2023-12-27 23:03:38,764][106225] Updated weights for policy 1, policy_version 533000 (0.0008) [2023-12-27 23:03:39,438][106226] Updated weights for policy 0, policy_version 531577 (0.0007) [2023-12-27 23:03:39,480][106225] Updated weights for policy 1, policy_version 533010 (0.0007) [2023-12-27 23:03:39,496][106226] Updated weights for policy 0, policy_version 531587 (0.0007) [2023-12-27 23:03:39,541][106225] Updated weights for policy 1, policy_version 533020 (0.0008) [2023-12-27 23:03:39,559][106226] Updated weights for policy 0, policy_version 531597 (0.0007) [2023-12-27 23:03:39,604][106225] Updated weights for policy 1, policy_version 533030 (0.0007) [2023-12-27 23:03:39,625][106226] Updated weights for policy 0, policy_version 531607 (0.0007) [2023-12-27 23:03:39,662][106225] Updated weights for policy 1, policy_version 533040 (0.0007) [2023-12-27 23:03:40,305][106225] Updated weights for policy 1, policy_version 533050 (0.0008) [2023-12-27 23:03:40,371][106225] Updated weights for policy 1, policy_version 533060 (0.0008) [2023-12-27 23:03:40,406][106226] Updated weights for policy 0, policy_version 531617 (0.0008) [2023-12-27 23:03:40,439][106225] Updated weights for policy 1, policy_version 533070 (0.0009) [2023-12-27 23:03:40,468][106226] Updated weights for policy 0, policy_version 531627 (0.0009) [2023-12-27 23:03:40,530][106226] Updated weights for policy 0, policy_version 531637 (0.0010) [2023-12-27 23:03:41,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 272629760. Throughput: 0: 9801.4, 1: 9849.4. Samples: 272606376. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:03:41,176][105115] Avg episode reward: [(0, '-5.182'), (1, '-5.552')] [2023-12-27 23:03:41,180][106225] Updated weights for policy 1, policy_version 533080 (0.0007) [2023-12-27 23:03:41,208][106226] Updated weights for policy 0, policy_version 531647 (0.0009) [2023-12-27 23:03:41,239][106225] Updated weights for policy 1, policy_version 533090 (0.0006) [2023-12-27 23:03:41,277][106226] Updated weights for policy 0, policy_version 531657 (0.0008) [2023-12-27 23:03:41,306][106225] Updated weights for policy 1, policy_version 533100 (0.0007) [2023-12-27 23:03:41,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000533104_136503296.pth... [2023-12-27 23:03:41,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000531920_136200192.pth [2023-12-27 23:03:41,341][106226] Updated weights for policy 0, policy_version 531667 (0.0008) [2023-12-27 23:03:41,376][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000531672_136142848.pth... [2023-12-27 23:03:41,381][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000530520_135847936.pth [2023-12-27 23:03:42,043][106226] Updated weights for policy 0, policy_version 531677 (0.0008) [2023-12-27 23:03:42,111][106226] Updated weights for policy 0, policy_version 531687 (0.0008) [2023-12-27 23:03:42,142][106225] Updated weights for policy 1, policy_version 533110 (0.0007) [2023-12-27 23:03:42,171][106226] Updated weights for policy 0, policy_version 531697 (0.0005) [2023-12-27 23:03:42,193][106225] Updated weights for policy 1, policy_version 533120 (0.0007) [2023-12-27 23:03:42,242][106225] Updated weights for policy 1, policy_version 533130 (0.0007) [2023-12-27 23:03:42,891][106226] Updated weights for policy 0, policy_version 531707 (0.0008) [2023-12-27 23:03:42,956][106226] Updated weights for policy 0, policy_version 531717 (0.0006) [2023-12-27 23:03:42,968][106225] Updated weights for policy 1, policy_version 533140 (0.0007) [2023-12-27 23:03:43,020][106226] Updated weights for policy 0, policy_version 531727 (0.0005) [2023-12-27 23:03:43,028][106225] Updated weights for policy 1, policy_version 533150 (0.0008) [2023-12-27 23:03:43,083][106225] Updated weights for policy 1, policy_version 533160 (0.0008) [2023-12-27 23:03:43,582][106226] Updated weights for policy 0, policy_version 531737 (0.0006) [2023-12-27 23:03:43,638][106226] Updated weights for policy 0, policy_version 531747 (0.0006) [2023-12-27 23:03:43,701][106226] Updated weights for policy 0, policy_version 531757 (0.0009) [2023-12-27 23:03:43,765][106226] Updated weights for policy 0, policy_version 531767 (0.0010) [2023-12-27 23:03:43,795][106225] Updated weights for policy 1, policy_version 533170 (0.0006) [2023-12-27 23:03:43,852][106225] Updated weights for policy 1, policy_version 533180 (0.0008) [2023-12-27 23:03:43,909][106225] Updated weights for policy 1, policy_version 533190 (0.0008) [2023-12-27 23:03:43,966][106225] Updated weights for policy 1, policy_version 533200 (0.0008) [2023-12-27 23:03:44,413][106226] Updated weights for policy 0, policy_version 531777 (0.0009) [2023-12-27 23:03:44,464][106226] Updated weights for policy 0, policy_version 531787 (0.0005) [2023-12-27 23:03:44,538][106226] Updated weights for policy 0, policy_version 531797 (0.0005) [2023-12-27 23:03:44,604][106225] Updated weights for policy 1, policy_version 533210 (0.0006) [2023-12-27 23:03:44,675][106225] Updated weights for policy 1, policy_version 533220 (0.0005) [2023-12-27 23:03:44,733][106225] Updated weights for policy 1, policy_version 533230 (0.0005) [2023-12-27 23:03:45,122][106226] Updated weights for policy 0, policy_version 531807 (0.0009) [2023-12-27 23:03:45,186][106226] Updated weights for policy 0, policy_version 531817 (0.0006) [2023-12-27 23:03:45,250][106226] Updated weights for policy 0, policy_version 531827 (0.0006) [2023-12-27 23:03:45,405][106225] Updated weights for policy 1, policy_version 533240 (0.0007) [2023-12-27 23:03:45,458][106225] Updated weights for policy 1, policy_version 533250 (0.0008) [2023-12-27 23:03:45,515][106225] Updated weights for policy 1, policy_version 533260 (0.0008) [2023-12-27 23:03:45,851][106226] Updated weights for policy 0, policy_version 531837 (0.0007) [2023-12-27 23:03:45,909][106226] Updated weights for policy 0, policy_version 531847 (0.0005) [2023-12-27 23:03:45,976][106226] Updated weights for policy 0, policy_version 531857 (0.0005) [2023-12-27 23:03:46,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 272736256. Throughput: 0: 9826.5, 1: 9838.0. Samples: 272726136. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:03:46,176][105115] Avg episode reward: [(0, '-4.901'), (1, '-5.897')] [2023-12-27 23:03:46,239][106225] Updated weights for policy 1, policy_version 533270 (0.0007) [2023-12-27 23:03:46,309][106225] Updated weights for policy 1, policy_version 533280 (0.0006) [2023-12-27 23:03:46,359][106225] Updated weights for policy 1, policy_version 533290 (0.0010) [2023-12-27 23:03:46,602][106226] Updated weights for policy 0, policy_version 531867 (0.0007) [2023-12-27 23:03:46,661][106226] Updated weights for policy 0, policy_version 531877 (0.0010) [2023-12-27 23:03:46,717][106226] Updated weights for policy 0, policy_version 531887 (0.0010) [2023-12-27 23:03:46,993][106225] Updated weights for policy 1, policy_version 533300 (0.0010) [2023-12-27 23:03:47,049][106225] Updated weights for policy 1, policy_version 533310 (0.0009) [2023-12-27 23:03:47,098][106225] Updated weights for policy 1, policy_version 533320 (0.0008) [2023-12-27 23:03:47,336][106226] Updated weights for policy 0, policy_version 531897 (0.0008) [2023-12-27 23:03:47,388][106226] Updated weights for policy 0, policy_version 531907 (0.0008) [2023-12-27 23:03:47,439][106226] Updated weights for policy 0, policy_version 531917 (0.0006) [2023-12-27 23:03:47,488][106226] Updated weights for policy 0, policy_version 531927 (0.0005) [2023-12-27 23:03:47,877][106225] Updated weights for policy 1, policy_version 533330 (0.0008) [2023-12-27 23:03:47,931][106225] Updated weights for policy 1, policy_version 533340 (0.0008) [2023-12-27 23:03:47,986][106225] Updated weights for policy 1, policy_version 533350 (0.0008) [2023-12-27 23:03:48,045][106225] Updated weights for policy 1, policy_version 533360 (0.0008) [2023-12-27 23:03:48,102][106226] Updated weights for policy 0, policy_version 531937 (0.0006) [2023-12-27 23:03:48,163][106226] Updated weights for policy 0, policy_version 531947 (0.0005) [2023-12-27 23:03:48,219][106226] Updated weights for policy 0, policy_version 531957 (0.0005) [2023-12-27 23:03:48,833][106225] Updated weights for policy 1, policy_version 533370 (0.0010) [2023-12-27 23:03:48,867][106226] Updated weights for policy 0, policy_version 531967 (0.0007) [2023-12-27 23:03:48,893][106225] Updated weights for policy 1, policy_version 533380 (0.0010) [2023-12-27 23:03:48,912][106226] Updated weights for policy 0, policy_version 531977 (0.0006) [2023-12-27 23:03:48,949][106225] Updated weights for policy 1, policy_version 533390 (0.0009) [2023-12-27 23:03:48,960][106226] Updated weights for policy 0, policy_version 531987 (0.0008) [2023-12-27 23:03:49,673][106225] Updated weights for policy 1, policy_version 533400 (0.0008) [2023-12-27 23:03:49,725][106225] Updated weights for policy 1, policy_version 533410 (0.0006) [2023-12-27 23:03:49,728][106226] Updated weights for policy 0, policy_version 531997 (0.0007) [2023-12-27 23:03:49,777][106225] Updated weights for policy 1, policy_version 533420 (0.0008) [2023-12-27 23:03:49,788][106226] Updated weights for policy 0, policy_version 532007 (0.0006) [2023-12-27 23:03:49,855][106226] Updated weights for policy 0, policy_version 532017 (0.0010) [2023-12-27 23:03:50,491][106225] Updated weights for policy 1, policy_version 533430 (0.0006) [2023-12-27 23:03:50,542][106225] Updated weights for policy 1, policy_version 533440 (0.0008) [2023-12-27 23:03:50,609][106225] Updated weights for policy 1, policy_version 533450 (0.0008) [2023-12-27 23:03:50,622][106226] Updated weights for policy 0, policy_version 532027 (0.0008) [2023-12-27 23:03:50,680][106226] Updated weights for policy 0, policy_version 532037 (0.0007) [2023-12-27 23:03:50,743][106226] Updated weights for policy 0, policy_version 532047 (0.0008) [2023-12-27 23:03:51,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 272834560. Throughput: 0: 9858.6, 1: 9865.1. Samples: 272844488. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:03:51,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-5.293')] [2023-12-27 23:03:51,392][106225] Updated weights for policy 1, policy_version 533460 (0.0009) [2023-12-27 23:03:51,446][106225] Updated weights for policy 1, policy_version 533470 (0.0009) [2023-12-27 23:03:51,478][106226] Updated weights for policy 0, policy_version 532057 (0.0008) [2023-12-27 23:03:51,503][106225] Updated weights for policy 1, policy_version 533480 (0.0006) [2023-12-27 23:03:51,539][106226] Updated weights for policy 0, policy_version 532067 (0.0008) [2023-12-27 23:03:51,597][106226] Updated weights for policy 0, policy_version 532077 (0.0008) [2023-12-27 23:03:51,670][106226] Updated weights for policy 0, policy_version 532087 (0.0009) [2023-12-27 23:03:52,279][106225] Updated weights for policy 1, policy_version 533490 (0.0006) [2023-12-27 23:03:52,345][106225] Updated weights for policy 1, policy_version 533500 (0.0008) [2023-12-27 23:03:52,415][106225] Updated weights for policy 1, policy_version 533510 (0.0008) [2023-12-27 23:03:52,451][106226] Updated weights for policy 0, policy_version 532097 (0.0006) [2023-12-27 23:03:52,475][106225] Updated weights for policy 1, policy_version 533520 (0.0008) [2023-12-27 23:03:52,510][106226] Updated weights for policy 0, policy_version 532107 (0.0006) [2023-12-27 23:03:52,573][106226] Updated weights for policy 0, policy_version 532117 (0.0006) [2023-12-27 23:03:53,162][106225] Updated weights for policy 1, policy_version 533530 (0.0009) [2023-12-27 23:03:53,226][106225] Updated weights for policy 1, policy_version 533540 (0.0009) [2023-12-27 23:03:53,294][106225] Updated weights for policy 1, policy_version 533550 (0.0007) [2023-12-27 23:03:53,329][106226] Updated weights for policy 0, policy_version 532127 (0.0008) [2023-12-27 23:03:53,394][106226] Updated weights for policy 0, policy_version 532137 (0.0007) [2023-12-27 23:03:53,453][106226] Updated weights for policy 0, policy_version 532147 (0.0010) [2023-12-27 23:03:53,962][106225] Updated weights for policy 1, policy_version 533560 (0.0010) [2023-12-27 23:03:54,014][106225] Updated weights for policy 1, policy_version 533570 (0.0010) [2023-12-27 23:03:54,057][106225] Updated weights for policy 1, policy_version 533580 (0.0010) [2023-12-27 23:03:54,177][106226] Updated weights for policy 0, policy_version 532157 (0.0010) [2023-12-27 23:03:54,231][106226] Updated weights for policy 0, policy_version 532167 (0.0010) [2023-12-27 23:03:54,281][106226] Updated weights for policy 0, policy_version 532177 (0.0010) [2023-12-27 23:03:54,719][106225] Updated weights for policy 1, policy_version 533590 (0.0010) [2023-12-27 23:03:54,775][106225] Updated weights for policy 1, policy_version 533600 (0.0010) [2023-12-27 23:03:54,838][106225] Updated weights for policy 1, policy_version 533610 (0.0010) [2023-12-27 23:03:54,912][106226] Updated weights for policy 0, policy_version 532187 (0.0009) [2023-12-27 23:03:54,960][106226] Updated weights for policy 0, policy_version 532197 (0.0007) [2023-12-27 23:03:55,019][106226] Updated weights for policy 0, policy_version 532207 (0.0010) [2023-12-27 23:03:55,481][106225] Updated weights for policy 1, policy_version 533620 (0.0010) [2023-12-27 23:03:55,546][106225] Updated weights for policy 1, policy_version 533630 (0.0009) [2023-12-27 23:03:55,610][106225] Updated weights for policy 1, policy_version 533640 (0.0007) [2023-12-27 23:03:55,817][106226] Updated weights for policy 0, policy_version 532217 (0.0009) [2023-12-27 23:03:55,880][106226] Updated weights for policy 0, policy_version 532227 (0.0009) [2023-12-27 23:03:55,946][106226] Updated weights for policy 0, policy_version 532237 (0.0009) [2023-12-27 23:03:55,994][106226] Updated weights for policy 0, policy_version 532247 (0.0009) [2023-12-27 23:03:56,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 272932864. Throughput: 0: 9815.5, 1: 9875.1. Samples: 272901908. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:03:56,175][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.332')] [2023-12-27 23:03:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000532248_136290304.pth... [2023-12-27 23:03:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000533648_136642560.pth... [2023-12-27 23:03:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000531096_135995392.pth [2023-12-27 23:03:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000532496_136347648.pth [2023-12-27 23:03:56,213][106225] Updated weights for policy 1, policy_version 533650 (0.0006) [2023-12-27 23:03:56,270][106225] Updated weights for policy 1, policy_version 533660 (0.0010) [2023-12-27 23:03:56,327][106225] Updated weights for policy 1, policy_version 533670 (0.0010) [2023-12-27 23:03:56,392][106225] Updated weights for policy 1, policy_version 533680 (0.0010) [2023-12-27 23:03:56,739][106226] Updated weights for policy 0, policy_version 532257 (0.0008) [2023-12-27 23:03:56,786][106226] Updated weights for policy 0, policy_version 532267 (0.0008) [2023-12-27 23:03:56,841][106226] Updated weights for policy 0, policy_version 532278 (0.0009) [2023-12-27 23:03:57,008][106225] Updated weights for policy 1, policy_version 533690 (0.0005) [2023-12-27 23:03:57,062][106225] Updated weights for policy 1, policy_version 533700 (0.0010) [2023-12-27 23:03:57,117][106225] Updated weights for policy 1, policy_version 533710 (0.0010) [2023-12-27 23:03:57,620][106226] Updated weights for policy 0, policy_version 532288 (0.0008) [2023-12-27 23:03:57,663][106226] Updated weights for policy 0, policy_version 532298 (0.0008) [2023-12-27 23:03:57,722][106226] Updated weights for policy 0, policy_version 532308 (0.0007) [2023-12-27 23:03:57,793][106225] Updated weights for policy 1, policy_version 533720 (0.0010) [2023-12-27 23:03:57,852][106225] Updated weights for policy 1, policy_version 533730 (0.0010) [2023-12-27 23:03:57,901][106225] Updated weights for policy 1, policy_version 533740 (0.0010) [2023-12-27 23:03:58,372][106226] Updated weights for policy 0, policy_version 532318 (0.0009) [2023-12-27 23:03:58,437][106226] Updated weights for policy 0, policy_version 532328 (0.0008) [2023-12-27 23:03:58,508][106226] Updated weights for policy 0, policy_version 532338 (0.0008) [2023-12-27 23:03:58,618][106225] Updated weights for policy 1, policy_version 533750 (0.0009) [2023-12-27 23:03:58,683][106225] Updated weights for policy 1, policy_version 533760 (0.0008) [2023-12-27 23:03:58,750][106225] Updated weights for policy 1, policy_version 533770 (0.0008) [2023-12-27 23:03:59,275][106226] Updated weights for policy 0, policy_version 532348 (0.0008) [2023-12-27 23:03:59,337][106226] Updated weights for policy 0, policy_version 532358 (0.0008) [2023-12-27 23:03:59,411][106226] Updated weights for policy 0, policy_version 532368 (0.0009) [2023-12-27 23:03:59,516][106225] Updated weights for policy 1, policy_version 533780 (0.0008) [2023-12-27 23:03:59,571][106225] Updated weights for policy 1, policy_version 533790 (0.0008) [2023-12-27 23:03:59,619][106225] Updated weights for policy 1, policy_version 533800 (0.0008) [2023-12-27 23:04:00,119][106226] Updated weights for policy 0, policy_version 532378 (0.0010) [2023-12-27 23:04:00,181][106226] Updated weights for policy 0, policy_version 532388 (0.0007) [2023-12-27 23:04:00,234][106226] Updated weights for policy 0, policy_version 532398 (0.0008) [2023-12-27 23:04:00,287][106226] Updated weights for policy 0, policy_version 532408 (0.0007) [2023-12-27 23:04:00,358][106225] Updated weights for policy 1, policy_version 533810 (0.0008) [2023-12-27 23:04:00,418][106225] Updated weights for policy 1, policy_version 533820 (0.0009) [2023-12-27 23:04:00,474][106225] Updated weights for policy 1, policy_version 533830 (0.0008) [2023-12-27 23:04:00,535][106225] Updated weights for policy 1, policy_version 533840 (0.0006) [2023-12-27 23:04:01,043][106226] Updated weights for policy 0, policy_version 532418 (0.0009) [2023-12-27 23:04:01,100][106226] Updated weights for policy 0, policy_version 532428 (0.0008) [2023-12-27 23:04:01,164][106226] Updated weights for policy 0, policy_version 532438 (0.0008) [2023-12-27 23:04:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 273022976. Throughput: 0: 9812.5, 1: 9922.1. Samples: 273020268. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:01,175][105115] Avg episode reward: [(0, '-5.357'), (1, '-5.310')] [2023-12-27 23:04:01,232][106225] Updated weights for policy 1, policy_version 533850 (0.0007) [2023-12-27 23:04:01,297][106225] Updated weights for policy 1, policy_version 533860 (0.0008) [2023-12-27 23:04:01,356][106225] Updated weights for policy 1, policy_version 533870 (0.0009) [2023-12-27 23:04:01,938][106226] Updated weights for policy 0, policy_version 532448 (0.0008) [2023-12-27 23:04:01,998][106226] Updated weights for policy 0, policy_version 532458 (0.0008) [2023-12-27 23:04:02,024][106225] Updated weights for policy 1, policy_version 533880 (0.0007) [2023-12-27 23:04:02,061][106226] Updated weights for policy 0, policy_version 532468 (0.0007) [2023-12-27 23:04:02,084][106225] Updated weights for policy 1, policy_version 533890 (0.0007) [2023-12-27 23:04:02,136][106225] Updated weights for policy 1, policy_version 533900 (0.0008) [2023-12-27 23:04:02,675][106226] Updated weights for policy 0, policy_version 532478 (0.0006) [2023-12-27 23:04:02,738][106226] Updated weights for policy 0, policy_version 532488 (0.0005) [2023-12-27 23:04:02,797][106226] Updated weights for policy 0, policy_version 532498 (0.0006) [2023-12-27 23:04:02,953][106225] Updated weights for policy 1, policy_version 533910 (0.0010) [2023-12-27 23:04:03,002][106225] Updated weights for policy 1, policy_version 533920 (0.0010) [2023-12-27 23:04:03,055][106225] Updated weights for policy 1, policy_version 533930 (0.0010) [2023-12-27 23:04:03,450][106226] Updated weights for policy 0, policy_version 532508 (0.0010) [2023-12-27 23:04:03,512][106226] Updated weights for policy 0, policy_version 532518 (0.0010) [2023-12-27 23:04:03,564][106226] Updated weights for policy 0, policy_version 532528 (0.0010) [2023-12-27 23:04:03,774][106225] Updated weights for policy 1, policy_version 533940 (0.0010) [2023-12-27 23:04:03,820][106225] Updated weights for policy 1, policy_version 533950 (0.0010) [2023-12-27 23:04:03,889][106225] Updated weights for policy 1, policy_version 533960 (0.0009) [2023-12-27 23:04:04,180][106226] Updated weights for policy 0, policy_version 532538 (0.0009) [2023-12-27 23:04:04,238][106226] Updated weights for policy 0, policy_version 532548 (0.0010) [2023-12-27 23:04:04,302][106226] Updated weights for policy 0, policy_version 532558 (0.0009) [2023-12-27 23:04:04,355][106226] Updated weights for policy 0, policy_version 532568 (0.0008) [2023-12-27 23:04:04,615][106225] Updated weights for policy 1, policy_version 533970 (0.0007) [2023-12-27 23:04:04,686][106225] Updated weights for policy 1, policy_version 533980 (0.0007) [2023-12-27 23:04:04,739][106225] Updated weights for policy 1, policy_version 533990 (0.0009) [2023-12-27 23:04:04,794][106225] Updated weights for policy 1, policy_version 534000 (0.0008) [2023-12-27 23:04:05,059][106226] Updated weights for policy 0, policy_version 532578 (0.0008) [2023-12-27 23:04:05,108][106226] Updated weights for policy 0, policy_version 532588 (0.0008) [2023-12-27 23:04:05,164][106226] Updated weights for policy 0, policy_version 532598 (0.0008) [2023-12-27 23:04:05,487][106225] Updated weights for policy 1, policy_version 534010 (0.0008) [2023-12-27 23:04:05,536][106225] Updated weights for policy 1, policy_version 534020 (0.0008) [2023-12-27 23:04:05,590][106225] Updated weights for policy 1, policy_version 534030 (0.0008) [2023-12-27 23:04:05,764][106226] Updated weights for policy 0, policy_version 532608 (0.0008) [2023-12-27 23:04:05,815][106226] Updated weights for policy 0, policy_version 532618 (0.0008) [2023-12-27 23:04:05,866][106226] Updated weights for policy 0, policy_version 532628 (0.0006) [2023-12-27 23:04:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 273129472. Throughput: 0: 9834.2, 1: 9853.9. Samples: 273138428. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:06,175][105115] Avg episode reward: [(0, '-5.326'), (1, '-5.393')] [2023-12-27 23:04:06,332][106225] Updated weights for policy 1, policy_version 534040 (0.0010) [2023-12-27 23:04:06,386][106225] Updated weights for policy 1, policy_version 534050 (0.0009) [2023-12-27 23:04:06,447][106225] Updated weights for policy 1, policy_version 534060 (0.0008) [2023-12-27 23:04:06,627][106226] Updated weights for policy 0, policy_version 532638 (0.0007) [2023-12-27 23:04:06,694][106226] Updated weights for policy 0, policy_version 532648 (0.0007) [2023-12-27 23:04:06,755][106226] Updated weights for policy 0, policy_version 532658 (0.0009) [2023-12-27 23:04:07,101][106225] Updated weights for policy 1, policy_version 534070 (0.0008) [2023-12-27 23:04:07,162][106225] Updated weights for policy 1, policy_version 534080 (0.0007) [2023-12-27 23:04:07,218][106225] Updated weights for policy 1, policy_version 534090 (0.0008) [2023-12-27 23:04:07,355][106226] Updated weights for policy 0, policy_version 532668 (0.0007) [2023-12-27 23:04:07,414][106226] Updated weights for policy 0, policy_version 532678 (0.0010) [2023-12-27 23:04:07,471][106226] Updated weights for policy 0, policy_version 532688 (0.0010) [2023-12-27 23:04:07,904][106225] Updated weights for policy 1, policy_version 534100 (0.0007) [2023-12-27 23:04:07,957][106225] Updated weights for policy 1, policy_version 534110 (0.0005) [2023-12-27 23:04:08,013][106225] Updated weights for policy 1, policy_version 534120 (0.0006) [2023-12-27 23:04:08,211][106226] Updated weights for policy 0, policy_version 532698 (0.0010) [2023-12-27 23:04:08,279][106226] Updated weights for policy 0, policy_version 532708 (0.0010) [2023-12-27 23:04:08,349][106226] Updated weights for policy 0, policy_version 532718 (0.0008) [2023-12-27 23:04:08,410][106226] Updated weights for policy 0, policy_version 532728 (0.0009) [2023-12-27 23:04:08,664][106225] Updated weights for policy 1, policy_version 534130 (0.0007) [2023-12-27 23:04:08,725][106225] Updated weights for policy 1, policy_version 534140 (0.0008) [2023-12-27 23:04:08,788][106225] Updated weights for policy 1, policy_version 534150 (0.0005) [2023-12-27 23:04:08,857][106225] Updated weights for policy 1, policy_version 534160 (0.0006) [2023-12-27 23:04:09,095][106226] Updated weights for policy 0, policy_version 532738 (0.0009) [2023-12-27 23:04:09,161][106226] Updated weights for policy 0, policy_version 532748 (0.0009) [2023-12-27 23:04:09,226][106226] Updated weights for policy 0, policy_version 532758 (0.0008) [2023-12-27 23:04:09,526][106225] Updated weights for policy 1, policy_version 534170 (0.0006) [2023-12-27 23:04:09,592][106225] Updated weights for policy 1, policy_version 534180 (0.0006) [2023-12-27 23:04:09,660][106225] Updated weights for policy 1, policy_version 534190 (0.0009) [2023-12-27 23:04:09,980][106226] Updated weights for policy 0, policy_version 532768 (0.0007) [2023-12-27 23:04:10,047][106226] Updated weights for policy 0, policy_version 532778 (0.0006) [2023-12-27 23:04:10,108][106226] Updated weights for policy 0, policy_version 532788 (0.0006) [2023-12-27 23:04:10,326][106225] Updated weights for policy 1, policy_version 534200 (0.0007) [2023-12-27 23:04:10,389][106225] Updated weights for policy 1, policy_version 534210 (0.0007) [2023-12-27 23:04:10,447][106225] Updated weights for policy 1, policy_version 534220 (0.0008) [2023-12-27 23:04:10,786][106226] Updated weights for policy 0, policy_version 532798 (0.0008) [2023-12-27 23:04:10,853][106226] Updated weights for policy 0, policy_version 532808 (0.0006) [2023-12-27 23:04:10,913][106226] Updated weights for policy 0, policy_version 532818 (0.0006) [2023-12-27 23:04:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 273227776. Throughput: 0: 9900.5, 1: 9872.0. Samples: 273199644. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:11,175][105115] Avg episode reward: [(0, '-5.093'), (1, '-5.724')] [2023-12-27 23:04:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000532824_136437760.pth... [2023-12-27 23:04:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000531672_136142848.pth [2023-12-27 23:04:11,205][106225] Updated weights for policy 1, policy_version 534230 (0.0007) [2023-12-27 23:04:11,272][106225] Updated weights for policy 1, policy_version 534240 (0.0008) [2023-12-27 23:04:11,342][106225] Updated weights for policy 1, policy_version 534250 (0.0008) [2023-12-27 23:04:11,381][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000534256_136798208.pth... [2023-12-27 23:04:11,385][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000533104_136503296.pth [2023-12-27 23:04:11,672][106226] Updated weights for policy 0, policy_version 532828 (0.0008) [2023-12-27 23:04:11,733][106226] Updated weights for policy 0, policy_version 532838 (0.0008) [2023-12-27 23:04:11,800][106226] Updated weights for policy 0, policy_version 532848 (0.0008) [2023-12-27 23:04:12,072][106225] Updated weights for policy 1, policy_version 534260 (0.0007) [2023-12-27 23:04:12,130][106225] Updated weights for policy 1, policy_version 534270 (0.0008) [2023-12-27 23:04:12,194][106225] Updated weights for policy 1, policy_version 534280 (0.0008) [2023-12-27 23:04:12,628][106226] Updated weights for policy 0, policy_version 532858 (0.0008) [2023-12-27 23:04:12,686][106226] Updated weights for policy 0, policy_version 532868 (0.0008) [2023-12-27 23:04:12,741][106226] Updated weights for policy 0, policy_version 532878 (0.0009) [2023-12-27 23:04:12,796][106226] Updated weights for policy 0, policy_version 532888 (0.0008) [2023-12-27 23:04:12,846][106225] Updated weights for policy 1, policy_version 534290 (0.0008) [2023-12-27 23:04:12,903][106225] Updated weights for policy 1, policy_version 534300 (0.0005) [2023-12-27 23:04:12,959][106225] Updated weights for policy 1, policy_version 534310 (0.0005) [2023-12-27 23:04:13,008][106225] Updated weights for policy 1, policy_version 534320 (0.0005) [2023-12-27 23:04:13,568][106226] Updated weights for policy 0, policy_version 532898 (0.0010) [2023-12-27 23:04:13,615][106226] Updated weights for policy 0, policy_version 532908 (0.0010) [2023-12-27 23:04:13,646][106225] Updated weights for policy 1, policy_version 534330 (0.0005) [2023-12-27 23:04:13,672][106226] Updated weights for policy 0, policy_version 532918 (0.0007) [2023-12-27 23:04:13,694][106225] Updated weights for policy 1, policy_version 534340 (0.0007) [2023-12-27 23:04:13,747][106225] Updated weights for policy 1, policy_version 534350 (0.0007) [2023-12-27 23:04:14,337][106226] Updated weights for policy 0, policy_version 532928 (0.0011) [2023-12-27 23:04:14,399][106226] Updated weights for policy 0, policy_version 532938 (0.0007) [2023-12-27 23:04:14,420][106225] Updated weights for policy 1, policy_version 534360 (0.0009) [2023-12-27 23:04:14,462][106226] Updated weights for policy 0, policy_version 532948 (0.0005) [2023-12-27 23:04:14,484][106225] Updated weights for policy 1, policy_version 534370 (0.0010) [2023-12-27 23:04:14,532][106225] Updated weights for policy 1, policy_version 534380 (0.0007) [2023-12-27 23:04:15,054][106226] Updated weights for policy 0, policy_version 532958 (0.0008) [2023-12-27 23:04:15,118][106226] Updated weights for policy 0, policy_version 532968 (0.0008) [2023-12-27 23:04:15,165][106225] Updated weights for policy 1, policy_version 534390 (0.0008) [2023-12-27 23:04:15,178][106226] Updated weights for policy 0, policy_version 532978 (0.0008) [2023-12-27 23:04:15,231][106225] Updated weights for policy 1, policy_version 534400 (0.0011) [2023-12-27 23:04:15,294][106225] Updated weights for policy 1, policy_version 534410 (0.0011) [2023-12-27 23:04:15,784][106226] Updated weights for policy 0, policy_version 532988 (0.0007) [2023-12-27 23:04:15,842][106226] Updated weights for policy 0, policy_version 532998 (0.0008) [2023-12-27 23:04:15,892][106226] Updated weights for policy 0, policy_version 533008 (0.0009) [2023-12-27 23:04:15,936][106225] Updated weights for policy 1, policy_version 534420 (0.0009) [2023-12-27 23:04:15,985][106225] Updated weights for policy 1, policy_version 534430 (0.0005) [2023-12-27 23:04:16,031][106225] Updated weights for policy 1, policy_version 534440 (0.0005) [2023-12-27 23:04:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 273334272. Throughput: 0: 9879.9, 1: 9933.8. Samples: 273317868. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:16,175][105115] Avg episode reward: [(0, '-5.127'), (1, '-5.434')] [2023-12-27 23:04:16,496][106226] Updated weights for policy 0, policy_version 533018 (0.0009) [2023-12-27 23:04:16,561][106226] Updated weights for policy 0, policy_version 533028 (0.0011) [2023-12-27 23:04:16,620][106226] Updated weights for policy 0, policy_version 533038 (0.0010) [2023-12-27 23:04:16,676][106226] Updated weights for policy 0, policy_version 533048 (0.0010) [2023-12-27 23:04:16,713][106225] Updated weights for policy 1, policy_version 534450 (0.0006) [2023-12-27 23:04:16,779][106225] Updated weights for policy 1, policy_version 534460 (0.0010) [2023-12-27 23:04:16,835][106225] Updated weights for policy 1, policy_version 534470 (0.0010) [2023-12-27 23:04:16,891][106225] Updated weights for policy 1, policy_version 534480 (0.0010) [2023-12-27 23:04:17,302][106226] Updated weights for policy 0, policy_version 533058 (0.0005) [2023-12-27 23:04:17,355][106226] Updated weights for policy 0, policy_version 533068 (0.0005) [2023-12-27 23:04:17,413][106226] Updated weights for policy 0, policy_version 533078 (0.0007) [2023-12-27 23:04:17,490][106225] Updated weights for policy 1, policy_version 534490 (0.0010) [2023-12-27 23:04:17,545][106225] Updated weights for policy 1, policy_version 534500 (0.0010) [2023-12-27 23:04:17,611][106225] Updated weights for policy 1, policy_version 534510 (0.0010) [2023-12-27 23:04:18,046][106226] Updated weights for policy 0, policy_version 533088 (0.0011) [2023-12-27 23:04:18,100][106226] Updated weights for policy 0, policy_version 533098 (0.0010) [2023-12-27 23:04:18,159][106226] Updated weights for policy 0, policy_version 533108 (0.0008) [2023-12-27 23:04:18,337][106225] Updated weights for policy 1, policy_version 534520 (0.0010) [2023-12-27 23:04:18,403][106225] Updated weights for policy 1, policy_version 534530 (0.0010) [2023-12-27 23:04:18,468][106225] Updated weights for policy 1, policy_version 534540 (0.0010) [2023-12-27 23:04:18,988][106226] Updated weights for policy 0, policy_version 533118 (0.0010) [2023-12-27 23:04:19,054][106226] Updated weights for policy 0, policy_version 533128 (0.0006) [2023-12-27 23:04:19,124][106226] Updated weights for policy 0, policy_version 533138 (0.0011) [2023-12-27 23:04:19,159][106225] Updated weights for policy 1, policy_version 534550 (0.0010) [2023-12-27 23:04:19,245][106225] Updated weights for policy 1, policy_version 534560 (0.0010) [2023-12-27 23:04:19,307][106225] Updated weights for policy 1, policy_version 534570 (0.0009) [2023-12-27 23:04:19,761][106226] Updated weights for policy 0, policy_version 533148 (0.0011) [2023-12-27 23:04:19,820][106226] Updated weights for policy 0, policy_version 533158 (0.0009) [2023-12-27 23:04:19,888][106226] Updated weights for policy 0, policy_version 533168 (0.0008) [2023-12-27 23:04:20,018][106225] Updated weights for policy 1, policy_version 534580 (0.0010) [2023-12-27 23:04:20,073][106225] Updated weights for policy 1, policy_version 534590 (0.0010) [2023-12-27 23:04:20,125][106225] Updated weights for policy 1, policy_version 534600 (0.0011) [2023-12-27 23:04:20,619][106226] Updated weights for policy 0, policy_version 533178 (0.0009) [2023-12-27 23:04:20,682][106226] Updated weights for policy 0, policy_version 533188 (0.0010) [2023-12-27 23:04:20,741][106226] Updated weights for policy 0, policy_version 533198 (0.0008) [2023-12-27 23:04:20,805][106226] Updated weights for policy 0, policy_version 533208 (0.0006) [2023-12-27 23:04:20,844][106225] Updated weights for policy 1, policy_version 534610 (0.0010) [2023-12-27 23:04:20,910][106225] Updated weights for policy 1, policy_version 534620 (0.0010) [2023-12-27 23:04:20,969][106225] Updated weights for policy 1, policy_version 534630 (0.0008) [2023-12-27 23:04:21,039][106225] Updated weights for policy 1, policy_version 534640 (0.0009) [2023-12-27 23:04:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 273432576. Throughput: 0: 9886.8, 1: 9884.9. Samples: 273440112. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:21,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.295')] [2023-12-27 23:04:21,496][106226] Updated weights for policy 0, policy_version 533218 (0.0008) [2023-12-27 23:04:21,554][106226] Updated weights for policy 0, policy_version 533228 (0.0008) [2023-12-27 23:04:21,616][106226] Updated weights for policy 0, policy_version 533238 (0.0008) [2023-12-27 23:04:21,822][106225] Updated weights for policy 1, policy_version 534650 (0.0006) [2023-12-27 23:04:21,880][106225] Updated weights for policy 1, policy_version 534660 (0.0009) [2023-12-27 23:04:21,934][106225] Updated weights for policy 1, policy_version 534670 (0.0009) [2023-12-27 23:04:22,405][106226] Updated weights for policy 0, policy_version 533248 (0.0012) [2023-12-27 23:04:22,480][106226] Updated weights for policy 0, policy_version 533258 (0.0009) [2023-12-27 23:04:22,553][106226] Updated weights for policy 0, policy_version 533268 (0.0011) [2023-12-27 23:04:22,599][106225] Updated weights for policy 1, policy_version 534680 (0.0007) [2023-12-27 23:04:22,664][106225] Updated weights for policy 1, policy_version 534690 (0.0008) [2023-12-27 23:04:22,727][106225] Updated weights for policy 1, policy_version 534700 (0.0008) [2023-12-27 23:04:23,240][106226] Updated weights for policy 0, policy_version 533278 (0.0010) [2023-12-27 23:04:23,303][106226] Updated weights for policy 0, policy_version 533288 (0.0009) [2023-12-27 23:04:23,361][106226] Updated weights for policy 0, policy_version 533298 (0.0009) [2023-12-27 23:04:23,478][106225] Updated weights for policy 1, policy_version 534710 (0.0008) [2023-12-27 23:04:23,538][106225] Updated weights for policy 1, policy_version 534720 (0.0009) [2023-12-27 23:04:23,604][106225] Updated weights for policy 1, policy_version 534730 (0.0008) [2023-12-27 23:04:24,058][106226] Updated weights for policy 0, policy_version 533308 (0.0008) [2023-12-27 23:04:24,108][106226] Updated weights for policy 0, policy_version 533318 (0.0005) [2023-12-27 23:04:24,164][106226] Updated weights for policy 0, policy_version 533328 (0.0005) [2023-12-27 23:04:24,225][106225] Updated weights for policy 1, policy_version 534740 (0.0008) [2023-12-27 23:04:24,276][106225] Updated weights for policy 1, policy_version 534750 (0.0006) [2023-12-27 23:04:24,331][106225] Updated weights for policy 1, policy_version 534760 (0.0005) [2023-12-27 23:04:24,735][106226] Updated weights for policy 0, policy_version 533338 (0.0007) [2023-12-27 23:04:24,784][106226] Updated weights for policy 0, policy_version 533348 (0.0009) [2023-12-27 23:04:24,830][106226] Updated weights for policy 0, policy_version 533358 (0.0009) [2023-12-27 23:04:24,885][106226] Updated weights for policy 0, policy_version 533368 (0.0009) [2023-12-27 23:04:24,957][106225] Updated weights for policy 1, policy_version 534770 (0.0005) [2023-12-27 23:04:25,017][106225] Updated weights for policy 1, policy_version 534780 (0.0005) [2023-12-27 23:04:25,073][106225] Updated weights for policy 1, policy_version 534790 (0.0005) [2023-12-27 23:04:25,134][106225] Updated weights for policy 1, policy_version 534800 (0.0008) [2023-12-27 23:04:25,578][106226] Updated weights for policy 0, policy_version 533378 (0.0009) [2023-12-27 23:04:25,634][106226] Updated weights for policy 0, policy_version 533388 (0.0006) [2023-12-27 23:04:25,652][106225] Updated weights for policy 1, policy_version 534810 (0.0008) [2023-12-27 23:04:25,698][106226] Updated weights for policy 0, policy_version 533398 (0.0005) [2023-12-27 23:04:25,706][106225] Updated weights for policy 1, policy_version 534820 (0.0008) [2023-12-27 23:04:25,766][106225] Updated weights for policy 1, policy_version 534830 (0.0008) [2023-12-27 23:04:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 273530880. Throughput: 0: 9906.0, 1: 9887.4. Samples: 273497076. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:26,176][105115] Avg episode reward: [(0, '-5.342'), (1, '-5.486')] [2023-12-27 23:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000533400_136585216.pth... [2023-12-27 23:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000534832_136945664.pth... [2023-12-27 23:04:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000532248_136290304.pth [2023-12-27 23:04:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000533648_136642560.pth [2023-12-27 23:04:26,426][106226] Updated weights for policy 0, policy_version 533408 (0.0008) [2023-12-27 23:04:26,468][106225] Updated weights for policy 1, policy_version 534840 (0.0007) [2023-12-27 23:04:26,493][106226] Updated weights for policy 0, policy_version 533418 (0.0008) [2023-12-27 23:04:26,518][106225] Updated weights for policy 1, policy_version 534850 (0.0007) [2023-12-27 23:04:26,561][106226] Updated weights for policy 0, policy_version 533428 (0.0008) [2023-12-27 23:04:26,565][106225] Updated weights for policy 1, policy_version 534860 (0.0006) [2023-12-27 23:04:27,106][106225] Updated weights for policy 1, policy_version 534870 (0.0005) [2023-12-27 23:04:27,162][106225] Updated weights for policy 1, policy_version 534880 (0.0005) [2023-12-27 23:04:27,222][106225] Updated weights for policy 1, policy_version 534890 (0.0005) [2023-12-27 23:04:27,280][106226] Updated weights for policy 0, policy_version 533438 (0.0006) [2023-12-27 23:04:27,344][106226] Updated weights for policy 0, policy_version 533448 (0.0008) [2023-12-27 23:04:27,400][106226] Updated weights for policy 0, policy_version 533458 (0.0005) [2023-12-27 23:04:27,757][106225] Updated weights for policy 1, policy_version 534900 (0.0007) [2023-12-27 23:04:27,808][106225] Updated weights for policy 1, policy_version 534910 (0.0010) [2023-12-27 23:04:27,862][106225] Updated weights for policy 1, policy_version 534920 (0.0007) [2023-12-27 23:04:28,004][106226] Updated weights for policy 0, policy_version 533468 (0.0007) [2023-12-27 23:04:28,062][106226] Updated weights for policy 0, policy_version 533478 (0.0010) [2023-12-27 23:04:28,118][106226] Updated weights for policy 0, policy_version 533488 (0.0010) [2023-12-27 23:04:28,445][106225] Updated weights for policy 1, policy_version 534930 (0.0006) [2023-12-27 23:04:28,502][106225] Updated weights for policy 1, policy_version 534940 (0.0008) [2023-12-27 23:04:28,553][106225] Updated weights for policy 1, policy_version 534950 (0.0009) [2023-12-27 23:04:28,610][106225] Updated weights for policy 1, policy_version 534960 (0.0008) [2023-12-27 23:04:28,796][106226] Updated weights for policy 0, policy_version 533498 (0.0009) [2023-12-27 23:04:28,851][106226] Updated weights for policy 0, policy_version 533508 (0.0005) [2023-12-27 23:04:28,915][106226] Updated weights for policy 0, policy_version 533518 (0.0010) [2023-12-27 23:04:28,977][106226] Updated weights for policy 0, policy_version 533528 (0.0009) [2023-12-27 23:04:29,392][106225] Updated weights for policy 1, policy_version 534970 (0.0008) [2023-12-27 23:04:29,451][106225] Updated weights for policy 1, policy_version 534980 (0.0008) [2023-12-27 23:04:29,501][106225] Updated weights for policy 1, policy_version 534990 (0.0008) [2023-12-27 23:04:29,636][106226] Updated weights for policy 0, policy_version 533538 (0.0005) [2023-12-27 23:04:29,698][106226] Updated weights for policy 0, policy_version 533548 (0.0007) [2023-12-27 23:04:29,759][106226] Updated weights for policy 0, policy_version 533558 (0.0005) [2023-12-27 23:04:30,332][106226] Updated weights for policy 0, policy_version 533568 (0.0010) [2023-12-27 23:04:30,334][106225] Updated weights for policy 1, policy_version 535000 (0.0008) [2023-12-27 23:04:30,384][106226] Updated weights for policy 0, policy_version 533578 (0.0010) [2023-12-27 23:04:30,392][106225] Updated weights for policy 1, policy_version 535010 (0.0009) [2023-12-27 23:04:30,439][106226] Updated weights for policy 0, policy_version 533588 (0.0010) [2023-12-27 23:04:30,449][106225] Updated weights for policy 1, policy_version 535020 (0.0008) [2023-12-27 23:04:31,093][106226] Updated weights for policy 0, policy_version 533598 (0.0008) [2023-12-27 23:04:31,156][106226] Updated weights for policy 0, policy_version 533608 (0.0008) [2023-12-27 23:04:31,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 273629184. Throughput: 0: 9960.2, 1: 10042.7. Samples: 273626256. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:31,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-5.582')] [2023-12-27 23:04:31,209][106225] Updated weights for policy 1, policy_version 535030 (0.0006) [2023-12-27 23:04:31,223][106226] Updated weights for policy 0, policy_version 533618 (0.0008) [2023-12-27 23:04:31,265][106225] Updated weights for policy 1, policy_version 535040 (0.0006) [2023-12-27 23:04:31,322][106225] Updated weights for policy 1, policy_version 535050 (0.0007) [2023-12-27 23:04:31,942][106226] Updated weights for policy 0, policy_version 533628 (0.0007) [2023-12-27 23:04:32,002][106226] Updated weights for policy 0, policy_version 533638 (0.0008) [2023-12-27 23:04:32,047][106226] Updated weights for policy 0, policy_version 533648 (0.0008) [2023-12-27 23:04:32,087][106225] Updated weights for policy 1, policy_version 535060 (0.0008) [2023-12-27 23:04:32,142][106225] Updated weights for policy 1, policy_version 535070 (0.0008) [2023-12-27 23:04:32,197][106225] Updated weights for policy 1, policy_version 535080 (0.0008) [2023-12-27 23:04:32,750][106226] Updated weights for policy 0, policy_version 533658 (0.0008) [2023-12-27 23:04:32,810][106226] Updated weights for policy 0, policy_version 533668 (0.0008) [2023-12-27 23:04:32,876][106226] Updated weights for policy 0, policy_version 533678 (0.0008) [2023-12-27 23:04:32,939][106226] Updated weights for policy 0, policy_version 533688 (0.0008) [2023-12-27 23:04:32,945][106225] Updated weights for policy 1, policy_version 535090 (0.0009) [2023-12-27 23:04:33,008][106225] Updated weights for policy 1, policy_version 535100 (0.0009) [2023-12-27 23:04:33,070][106225] Updated weights for policy 1, policy_version 535110 (0.0009) [2023-12-27 23:04:33,126][106225] Updated weights for policy 1, policy_version 535120 (0.0008) [2023-12-27 23:04:33,644][106226] Updated weights for policy 0, policy_version 533698 (0.0009) [2023-12-27 23:04:33,700][106226] Updated weights for policy 0, policy_version 533708 (0.0009) [2023-12-27 23:04:33,759][106226] Updated weights for policy 0, policy_version 533718 (0.0008) [2023-12-27 23:04:33,874][106225] Updated weights for policy 1, policy_version 535130 (0.0008) [2023-12-27 23:04:33,923][106225] Updated weights for policy 1, policy_version 535140 (0.0009) [2023-12-27 23:04:33,979][106225] Updated weights for policy 1, policy_version 535150 (0.0008) [2023-12-27 23:04:34,503][106226] Updated weights for policy 0, policy_version 533728 (0.0007) [2023-12-27 23:04:34,557][106226] Updated weights for policy 0, policy_version 533738 (0.0006) [2023-12-27 23:04:34,620][106226] Updated weights for policy 0, policy_version 533748 (0.0006) [2023-12-27 23:04:34,649][106225] Updated weights for policy 1, policy_version 535160 (0.0008) [2023-12-27 23:04:34,712][106225] Updated weights for policy 1, policy_version 535170 (0.0010) [2023-12-27 23:04:34,765][106225] Updated weights for policy 1, policy_version 535180 (0.0009) [2023-12-27 23:04:35,203][106226] Updated weights for policy 0, policy_version 533758 (0.0009) [2023-12-27 23:04:35,262][106226] Updated weights for policy 0, policy_version 533768 (0.0010) [2023-12-27 23:04:35,319][106226] Updated weights for policy 0, policy_version 533778 (0.0010) [2023-12-27 23:04:35,565][106225] Updated weights for policy 1, policy_version 535190 (0.0006) [2023-12-27 23:04:35,632][106225] Updated weights for policy 1, policy_version 535200 (0.0008) [2023-12-27 23:04:35,695][106225] Updated weights for policy 1, policy_version 535210 (0.0009) [2023-12-27 23:04:35,935][106226] Updated weights for policy 0, policy_version 533788 (0.0010) [2023-12-27 23:04:35,988][106226] Updated weights for policy 0, policy_version 533798 (0.0010) [2023-12-27 23:04:36,052][106226] Updated weights for policy 0, policy_version 533808 (0.0010) [2023-12-27 23:04:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 273735680. Throughput: 0: 9960.9, 1: 10004.0. Samples: 273742908. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:36,175][105115] Avg episode reward: [(0, '-5.077'), (1, '-5.501')] [2023-12-27 23:04:36,441][106225] Updated weights for policy 1, policy_version 535220 (0.0007) [2023-12-27 23:04:36,504][106225] Updated weights for policy 1, policy_version 535230 (0.0008) [2023-12-27 23:04:36,563][106225] Updated weights for policy 1, policy_version 535240 (0.0008) [2023-12-27 23:04:36,775][106226] Updated weights for policy 0, policy_version 533818 (0.0010) [2023-12-27 23:04:36,832][106226] Updated weights for policy 0, policy_version 533828 (0.0007) [2023-12-27 23:04:36,894][106226] Updated weights for policy 0, policy_version 533838 (0.0008) [2023-12-27 23:04:36,948][106226] Updated weights for policy 0, policy_version 533848 (0.0010) [2023-12-27 23:04:37,364][106225] Updated weights for policy 1, policy_version 535250 (0.0008) [2023-12-27 23:04:37,419][106225] Updated weights for policy 1, policy_version 535260 (0.0009) [2023-12-27 23:04:37,474][106225] Updated weights for policy 1, policy_version 535270 (0.0009) [2023-12-27 23:04:37,499][106226] Updated weights for policy 0, policy_version 533858 (0.0009) [2023-12-27 23:04:37,535][106225] Updated weights for policy 1, policy_version 535280 (0.0006) [2023-12-27 23:04:37,563][106226] Updated weights for policy 0, policy_version 533868 (0.0010) [2023-12-27 23:04:37,630][106226] Updated weights for policy 0, policy_version 533878 (0.0009) [2023-12-27 23:04:38,269][106226] Updated weights for policy 0, policy_version 533888 (0.0009) [2023-12-27 23:04:38,323][106225] Updated weights for policy 1, policy_version 535290 (0.0007) [2023-12-27 23:04:38,334][106226] Updated weights for policy 0, policy_version 533898 (0.0008) [2023-12-27 23:04:38,390][106225] Updated weights for policy 1, policy_version 535300 (0.0007) [2023-12-27 23:04:38,401][106226] Updated weights for policy 0, policy_version 533908 (0.0008) [2023-12-27 23:04:38,456][106225] Updated weights for policy 1, policy_version 535310 (0.0009) [2023-12-27 23:04:39,157][106225] Updated weights for policy 1, policy_version 535320 (0.0006) [2023-12-27 23:04:39,166][106226] Updated weights for policy 0, policy_version 533918 (0.0007) [2023-12-27 23:04:39,216][106225] Updated weights for policy 1, policy_version 535330 (0.0006) [2023-12-27 23:04:39,233][106226] Updated weights for policy 0, policy_version 533928 (0.0008) [2023-12-27 23:04:39,281][106225] Updated weights for policy 1, policy_version 535340 (0.0009) [2023-12-27 23:04:39,294][106226] Updated weights for policy 0, policy_version 533938 (0.0008) [2023-12-27 23:04:39,967][106225] Updated weights for policy 1, policy_version 535350 (0.0009) [2023-12-27 23:04:40,028][106225] Updated weights for policy 1, policy_version 535360 (0.0009) [2023-12-27 23:04:40,068][106226] Updated weights for policy 0, policy_version 533948 (0.0008) [2023-12-27 23:04:40,082][106225] Updated weights for policy 1, policy_version 535370 (0.0006) [2023-12-27 23:04:40,130][106226] Updated weights for policy 0, policy_version 533958 (0.0008) [2023-12-27 23:04:40,193][106226] Updated weights for policy 0, policy_version 533968 (0.0008) [2023-12-27 23:04:40,814][106225] Updated weights for policy 1, policy_version 535380 (0.0007) [2023-12-27 23:04:40,878][106225] Updated weights for policy 1, policy_version 535390 (0.0007) [2023-12-27 23:04:40,928][106226] Updated weights for policy 0, policy_version 533978 (0.0008) [2023-12-27 23:04:40,930][106225] Updated weights for policy 1, policy_version 535400 (0.0009) [2023-12-27 23:04:40,990][106226] Updated weights for policy 0, policy_version 533988 (0.0005) [2023-12-27 23:04:41,058][106226] Updated weights for policy 0, policy_version 533998 (0.0007) [2023-12-27 23:04:41,128][106226] Updated weights for policy 0, policy_version 534008 (0.0008) [2023-12-27 23:04:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 273833984. Throughput: 0: 10018.2, 1: 9965.8. Samples: 273801188. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:41,175][105115] Avg episode reward: [(0, '-5.165'), (1, '-5.856')] [2023-12-27 23:04:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000535408_137093120.pth... [2023-12-27 23:04:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000534008_136740864.pth... [2023-12-27 23:04:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000532824_136437760.pth [2023-12-27 23:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000534256_136798208.pth [2023-12-27 23:04:41,708][106225] Updated weights for policy 1, policy_version 535410 (0.0008) [2023-12-27 23:04:41,784][106225] Updated weights for policy 1, policy_version 535420 (0.0008) [2023-12-27 23:04:41,846][106225] Updated weights for policy 1, policy_version 535430 (0.0008) [2023-12-27 23:04:41,900][106225] Updated weights for policy 1, policy_version 535440 (0.0008) [2023-12-27 23:04:41,917][106226] Updated weights for policy 0, policy_version 534018 (0.0011) [2023-12-27 23:04:41,986][106226] Updated weights for policy 0, policy_version 534028 (0.0011) [2023-12-27 23:04:42,044][106226] Updated weights for policy 0, policy_version 534038 (0.0011) [2023-12-27 23:04:42,664][106225] Updated weights for policy 1, policy_version 535450 (0.0008) [2023-12-27 23:04:42,725][106225] Updated weights for policy 1, policy_version 535460 (0.0008) [2023-12-27 23:04:42,790][106226] Updated weights for policy 0, policy_version 534048 (0.0009) [2023-12-27 23:04:42,791][106225] Updated weights for policy 1, policy_version 535470 (0.0007) [2023-12-27 23:04:42,845][106226] Updated weights for policy 0, policy_version 534058 (0.0007) [2023-12-27 23:04:42,903][106226] Updated weights for policy 0, policy_version 534068 (0.0009) [2023-12-27 23:04:43,452][106225] Updated weights for policy 1, policy_version 535480 (0.0010) [2023-12-27 23:04:43,510][106225] Updated weights for policy 1, policy_version 535490 (0.0008) [2023-12-27 23:04:43,563][106225] Updated weights for policy 1, policy_version 535500 (0.0008) [2023-12-27 23:04:43,657][106226] Updated weights for policy 0, policy_version 534078 (0.0007) [2023-12-27 23:04:43,709][106226] Updated weights for policy 0, policy_version 534088 (0.0007) [2023-12-27 23:04:43,758][106226] Updated weights for policy 0, policy_version 534098 (0.0005) [2023-12-27 23:04:44,266][106225] Updated weights for policy 1, policy_version 535510 (0.0008) [2023-12-27 23:04:44,312][106225] Updated weights for policy 1, policy_version 535520 (0.0008) [2023-12-27 23:04:44,362][106225] Updated weights for policy 1, policy_version 535530 (0.0007) [2023-12-27 23:04:44,388][106226] Updated weights for policy 0, policy_version 534108 (0.0007) [2023-12-27 23:04:44,444][106226] Updated weights for policy 0, policy_version 534118 (0.0011) [2023-12-27 23:04:44,504][106226] Updated weights for policy 0, policy_version 534128 (0.0010) [2023-12-27 23:04:45,045][106225] Updated weights for policy 1, policy_version 535540 (0.0007) [2023-12-27 23:04:45,101][106225] Updated weights for policy 1, policy_version 535550 (0.0009) [2023-12-27 23:04:45,151][106225] Updated weights for policy 1, policy_version 535560 (0.0007) [2023-12-27 23:04:45,201][106226] Updated weights for policy 0, policy_version 534138 (0.0009) [2023-12-27 23:04:45,254][106226] Updated weights for policy 0, policy_version 534148 (0.0006) [2023-12-27 23:04:45,321][106226] Updated weights for policy 0, policy_version 534158 (0.0008) [2023-12-27 23:04:45,380][106226] Updated weights for policy 0, policy_version 534168 (0.0009) [2023-12-27 23:04:45,800][106225] Updated weights for policy 1, policy_version 535570 (0.0007) [2023-12-27 23:04:45,849][106225] Updated weights for policy 1, policy_version 535580 (0.0005) [2023-12-27 23:04:45,896][106225] Updated weights for policy 1, policy_version 535590 (0.0009) [2023-12-27 23:04:45,952][106225] Updated weights for policy 1, policy_version 535600 (0.0006) [2023-12-27 23:04:45,977][106226] Updated weights for policy 0, policy_version 534178 (0.0009) [2023-12-27 23:04:46,031][106226] Updated weights for policy 0, policy_version 534188 (0.0006) [2023-12-27 23:04:46,089][106226] Updated weights for policy 0, policy_version 534198 (0.0005) [2023-12-27 23:04:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19771.9). Total num frames: 273932288. Throughput: 0: 9986.8, 1: 9897.9. Samples: 273915080. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:46,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.253')] [2023-12-27 23:04:46,611][106225] Updated weights for policy 1, policy_version 535610 (0.0005) [2023-12-27 23:04:46,626][106226] Updated weights for policy 0, policy_version 534208 (0.0006) [2023-12-27 23:04:46,667][106225] Updated weights for policy 1, policy_version 535620 (0.0005) [2023-12-27 23:04:46,678][106226] Updated weights for policy 0, policy_version 534218 (0.0005) [2023-12-27 23:04:46,723][106225] Updated weights for policy 1, policy_version 535630 (0.0005) [2023-12-27 23:04:46,726][106226] Updated weights for policy 0, policy_version 534228 (0.0006) [2023-12-27 23:04:47,254][106226] Updated weights for policy 0, policy_version 534238 (0.0005) [2023-12-27 23:04:47,290][106225] Updated weights for policy 1, policy_version 535640 (0.0005) [2023-12-27 23:04:47,312][106226] Updated weights for policy 0, policy_version 534248 (0.0008) [2023-12-27 23:04:47,337][106225] Updated weights for policy 1, policy_version 535650 (0.0005) [2023-12-27 23:04:47,365][106226] Updated weights for policy 0, policy_version 534258 (0.0010) [2023-12-27 23:04:47,393][106225] Updated weights for policy 1, policy_version 535660 (0.0005) [2023-12-27 23:04:47,960][106225] Updated weights for policy 1, policy_version 535670 (0.0008) [2023-12-27 23:04:48,001][106226] Updated weights for policy 0, policy_version 534268 (0.0009) [2023-12-27 23:04:48,008][106225] Updated weights for policy 1, policy_version 535680 (0.0009) [2023-12-27 23:04:48,051][106226] Updated weights for policy 0, policy_version 534278 (0.0005) [2023-12-27 23:04:48,061][106225] Updated weights for policy 1, policy_version 535690 (0.0008) [2023-12-27 23:04:48,100][106226] Updated weights for policy 0, policy_version 534288 (0.0005) [2023-12-27 23:04:48,786][106226] Updated weights for policy 0, policy_version 534298 (0.0006) [2023-12-27 23:04:48,846][106226] Updated weights for policy 0, policy_version 534308 (0.0008) [2023-12-27 23:04:48,855][106225] Updated weights for policy 1, policy_version 535700 (0.0008) [2023-12-27 23:04:48,907][106226] Updated weights for policy 0, policy_version 534318 (0.0007) [2023-12-27 23:04:48,917][106225] Updated weights for policy 1, policy_version 535710 (0.0006) [2023-12-27 23:04:48,969][106226] Updated weights for policy 0, policy_version 534328 (0.0007) [2023-12-27 23:04:48,976][106225] Updated weights for policy 1, policy_version 535720 (0.0007) [2023-12-27 23:04:49,688][106225] Updated weights for policy 1, policy_version 535730 (0.0008) [2023-12-27 23:04:49,754][106225] Updated weights for policy 1, policy_version 535740 (0.0007) [2023-12-27 23:04:49,768][106226] Updated weights for policy 0, policy_version 534338 (0.0006) [2023-12-27 23:04:49,812][106225] Updated weights for policy 1, policy_version 535750 (0.0006) [2023-12-27 23:04:49,827][106226] Updated weights for policy 0, policy_version 534348 (0.0007) [2023-12-27 23:04:49,885][106225] Updated weights for policy 1, policy_version 535760 (0.0009) [2023-12-27 23:04:49,891][106226] Updated weights for policy 0, policy_version 534358 (0.0007) [2023-12-27 23:04:50,513][106226] Updated weights for policy 0, policy_version 534368 (0.0010) [2023-12-27 23:04:50,584][106226] Updated weights for policy 0, policy_version 534378 (0.0010) [2023-12-27 23:04:50,624][106225] Updated weights for policy 1, policy_version 535770 (0.0007) [2023-12-27 23:04:50,647][106226] Updated weights for policy 0, policy_version 534388 (0.0008) [2023-12-27 23:04:50,681][106225] Updated weights for policy 1, policy_version 535780 (0.0008) [2023-12-27 23:04:50,740][106225] Updated weights for policy 1, policy_version 535790 (0.0008) [2023-12-27 23:04:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 274030592. Throughput: 0: 10077.7, 1: 10000.7. Samples: 274041956. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:51,175][105115] Avg episode reward: [(0, '-5.263'), (1, '-5.524')] [2023-12-27 23:04:51,307][106226] Updated weights for policy 0, policy_version 534398 (0.0009) [2023-12-27 23:04:51,380][106226] Updated weights for policy 0, policy_version 534408 (0.0008) [2023-12-27 23:04:51,448][106226] Updated weights for policy 0, policy_version 534418 (0.0010) [2023-12-27 23:04:51,515][106225] Updated weights for policy 1, policy_version 535800 (0.0006) [2023-12-27 23:04:51,579][106225] Updated weights for policy 1, policy_version 535810 (0.0005) [2023-12-27 23:04:51,630][106225] Updated weights for policy 1, policy_version 535820 (0.0007) [2023-12-27 23:04:52,253][106226] Updated weights for policy 0, policy_version 534428 (0.0009) [2023-12-27 23:04:52,319][106226] Updated weights for policy 0, policy_version 534438 (0.0006) [2023-12-27 23:04:52,352][106225] Updated weights for policy 1, policy_version 535830 (0.0007) [2023-12-27 23:04:52,382][106226] Updated weights for policy 0, policy_version 534448 (0.0009) [2023-12-27 23:04:52,415][106225] Updated weights for policy 1, policy_version 535840 (0.0006) [2023-12-27 23:04:52,475][106225] Updated weights for policy 1, policy_version 535850 (0.0008) [2023-12-27 23:04:53,007][106226] Updated weights for policy 0, policy_version 534458 (0.0007) [2023-12-27 23:04:53,066][106226] Updated weights for policy 0, policy_version 534468 (0.0009) [2023-12-27 23:04:53,125][106226] Updated weights for policy 0, policy_version 534478 (0.0010) [2023-12-27 23:04:53,189][106226] Updated weights for policy 0, policy_version 534488 (0.0010) [2023-12-27 23:04:53,211][106225] Updated weights for policy 1, policy_version 535860 (0.0008) [2023-12-27 23:04:53,260][106225] Updated weights for policy 1, policy_version 535870 (0.0007) [2023-12-27 23:04:53,310][106225] Updated weights for policy 1, policy_version 535880 (0.0005) [2023-12-27 23:04:53,884][106226] Updated weights for policy 0, policy_version 534498 (0.0011) [2023-12-27 23:04:53,945][106226] Updated weights for policy 0, policy_version 534508 (0.0011) [2023-12-27 23:04:53,996][106225] Updated weights for policy 1, policy_version 535890 (0.0005) [2023-12-27 23:04:54,009][106226] Updated weights for policy 0, policy_version 534518 (0.0011) [2023-12-27 23:04:54,061][106225] Updated weights for policy 1, policy_version 535900 (0.0007) [2023-12-27 23:04:54,115][106225] Updated weights for policy 1, policy_version 535910 (0.0008) [2023-12-27 23:04:54,170][106225] Updated weights for policy 1, policy_version 535920 (0.0008) [2023-12-27 23:04:54,729][106226] Updated weights for policy 0, policy_version 534528 (0.0006) [2023-12-27 23:04:54,782][106226] Updated weights for policy 0, policy_version 534538 (0.0007) [2023-12-27 23:04:54,826][106226] Updated weights for policy 0, policy_version 534548 (0.0010) [2023-12-27 23:04:54,832][106225] Updated weights for policy 1, policy_version 535930 (0.0005) [2023-12-27 23:04:54,885][106225] Updated weights for policy 1, policy_version 535940 (0.0007) [2023-12-27 23:04:54,937][106225] Updated weights for policy 1, policy_version 535950 (0.0005) [2023-12-27 23:04:55,402][106226] Updated weights for policy 0, policy_version 534558 (0.0007) [2023-12-27 23:04:55,475][106226] Updated weights for policy 0, policy_version 534568 (0.0005) [2023-12-27 23:04:55,527][106226] Updated weights for policy 0, policy_version 534578 (0.0005) [2023-12-27 23:04:55,691][106225] Updated weights for policy 1, policy_version 535960 (0.0005) [2023-12-27 23:04:55,754][106225] Updated weights for policy 1, policy_version 535970 (0.0006) [2023-12-27 23:04:55,810][106225] Updated weights for policy 1, policy_version 535980 (0.0007) [2023-12-27 23:04:56,155][106226] Updated weights for policy 0, policy_version 534588 (0.0007) [2023-12-27 23:04:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 274128896. Throughput: 0: 10045.4, 1: 9949.3. Samples: 274099408. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:04:56,175][105115] Avg episode reward: [(0, '-5.151'), (1, '-5.681')] [2023-12-27 23:04:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000535984_137240576.pth... [2023-12-27 23:04:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000534832_136945664.pth [2023-12-27 23:04:56,209][106226] Updated weights for policy 0, policy_version 534598 (0.0011) [2023-12-27 23:04:56,257][106226] Updated weights for policy 0, policy_version 534608 (0.0010) [2023-12-27 23:04:56,307][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000534616_136896512.pth... [2023-12-27 23:04:56,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000533400_136585216.pth [2023-12-27 23:04:56,344][106225] Updated weights for policy 1, policy_version 535990 (0.0006) [2023-12-27 23:04:56,396][106225] Updated weights for policy 1, policy_version 536000 (0.0006) [2023-12-27 23:04:56,454][106225] Updated weights for policy 1, policy_version 536010 (0.0005) [2023-12-27 23:04:56,971][106226] Updated weights for policy 0, policy_version 534618 (0.0010) [2023-12-27 23:04:57,038][106226] Updated weights for policy 0, policy_version 534628 (0.0005) [2023-12-27 23:04:57,063][106225] Updated weights for policy 1, policy_version 536020 (0.0006) [2023-12-27 23:04:57,099][106226] Updated weights for policy 0, policy_version 534638 (0.0006) [2023-12-27 23:04:57,112][106225] Updated weights for policy 1, policy_version 536030 (0.0008) [2023-12-27 23:04:57,164][106225] Updated weights for policy 1, policy_version 536040 (0.0008) [2023-12-27 23:04:57,164][106226] Updated weights for policy 0, policy_version 534648 (0.0005) [2023-12-27 23:04:57,745][106226] Updated weights for policy 0, policy_version 534658 (0.0008) [2023-12-27 23:04:57,801][106226] Updated weights for policy 0, policy_version 534668 (0.0007) [2023-12-27 23:04:57,853][106226] Updated weights for policy 0, policy_version 534678 (0.0009) [2023-12-27 23:04:57,872][106225] Updated weights for policy 1, policy_version 536050 (0.0008) [2023-12-27 23:04:57,917][106225] Updated weights for policy 1, policy_version 536060 (0.0006) [2023-12-27 23:04:57,970][106225] Updated weights for policy 1, policy_version 536070 (0.0007) [2023-12-27 23:04:58,016][106225] Updated weights for policy 1, policy_version 536080 (0.0007) [2023-12-27 23:04:58,641][106226] Updated weights for policy 0, policy_version 534688 (0.0008) [2023-12-27 23:04:58,712][106226] Updated weights for policy 0, policy_version 534698 (0.0008) [2023-12-27 23:04:58,771][106225] Updated weights for policy 1, policy_version 536090 (0.0008) [2023-12-27 23:04:58,776][106226] Updated weights for policy 0, policy_version 534708 (0.0008) [2023-12-27 23:04:58,846][106225] Updated weights for policy 1, policy_version 536100 (0.0008) [2023-12-27 23:04:58,908][106225] Updated weights for policy 1, policy_version 536110 (0.0007) [2023-12-27 23:04:59,626][106225] Updated weights for policy 1, policy_version 536120 (0.0007) [2023-12-27 23:04:59,635][106226] Updated weights for policy 0, policy_version 534718 (0.0007) [2023-12-27 23:04:59,680][106225] Updated weights for policy 1, policy_version 536130 (0.0008) [2023-12-27 23:04:59,687][106226] Updated weights for policy 0, policy_version 534728 (0.0006) [2023-12-27 23:04:59,739][106225] Updated weights for policy 1, policy_version 536140 (0.0007) [2023-12-27 23:04:59,741][106226] Updated weights for policy 0, policy_version 534738 (0.0007) [2023-12-27 23:05:00,419][106225] Updated weights for policy 1, policy_version 536150 (0.0008) [2023-12-27 23:05:00,468][106225] Updated weights for policy 1, policy_version 536160 (0.0007) [2023-12-27 23:05:00,469][106226] Updated weights for policy 0, policy_version 534748 (0.0007) [2023-12-27 23:05:00,518][106225] Updated weights for policy 1, policy_version 536170 (0.0007) [2023-12-27 23:05:00,528][106226] Updated weights for policy 0, policy_version 534758 (0.0008) [2023-12-27 23:05:00,587][106226] Updated weights for policy 0, policy_version 534768 (0.0008) [2023-12-27 23:05:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 274227200. Throughput: 0: 10104.7, 1: 9949.8. Samples: 274220320. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:05:01,175][105115] Avg episode reward: [(0, '-5.219'), (1, '-5.763')] [2023-12-27 23:05:01,236][106226] Updated weights for policy 0, policy_version 534778 (0.0008) [2023-12-27 23:05:01,288][106225] Updated weights for policy 1, policy_version 536180 (0.0007) [2023-12-27 23:05:01,299][106226] Updated weights for policy 0, policy_version 534788 (0.0010) [2023-12-27 23:05:01,346][106225] Updated weights for policy 1, policy_version 536190 (0.0007) [2023-12-27 23:05:01,348][106226] Updated weights for policy 0, policy_version 534798 (0.0008) [2023-12-27 23:05:01,415][106225] Updated weights for policy 1, policy_version 536200 (0.0008) [2023-12-27 23:05:01,418][106226] Updated weights for policy 0, policy_version 534808 (0.0007) [2023-12-27 23:05:02,078][106226] Updated weights for policy 0, policy_version 534818 (0.0007) [2023-12-27 23:05:02,132][106226] Updated weights for policy 0, policy_version 534828 (0.0005) [2023-12-27 23:05:02,171][106225] Updated weights for policy 1, policy_version 536210 (0.0008) [2023-12-27 23:05:02,194][106226] Updated weights for policy 0, policy_version 534838 (0.0005) [2023-12-27 23:05:02,226][106225] Updated weights for policy 1, policy_version 536220 (0.0008) [2023-12-27 23:05:02,284][106225] Updated weights for policy 1, policy_version 536230 (0.0009) [2023-12-27 23:05:02,347][106225] Updated weights for policy 1, policy_version 536240 (0.0009) [2023-12-27 23:05:02,827][106226] Updated weights for policy 0, policy_version 534848 (0.0009) [2023-12-27 23:05:02,889][106226] Updated weights for policy 0, policy_version 534858 (0.0008) [2023-12-27 23:05:02,946][106226] Updated weights for policy 0, policy_version 534868 (0.0010) [2023-12-27 23:05:03,049][106225] Updated weights for policy 1, policy_version 536250 (0.0010) [2023-12-27 23:05:03,098][106225] Updated weights for policy 1, policy_version 536260 (0.0010) [2023-12-27 23:05:03,155][106225] Updated weights for policy 1, policy_version 536270 (0.0010) [2023-12-27 23:05:03,560][106226] Updated weights for policy 0, policy_version 534878 (0.0009) [2023-12-27 23:05:03,609][106226] Updated weights for policy 0, policy_version 534888 (0.0008) [2023-12-27 23:05:03,666][106226] Updated weights for policy 0, policy_version 534898 (0.0007) [2023-12-27 23:05:03,826][106225] Updated weights for policy 1, policy_version 536280 (0.0006) [2023-12-27 23:05:03,886][106225] Updated weights for policy 1, policy_version 536290 (0.0007) [2023-12-27 23:05:03,948][106225] Updated weights for policy 1, policy_version 536300 (0.0008) [2023-12-27 23:05:04,307][106226] Updated weights for policy 0, policy_version 534908 (0.0005) [2023-12-27 23:05:04,376][106226] Updated weights for policy 0, policy_version 534918 (0.0007) [2023-12-27 23:05:04,440][106226] Updated weights for policy 0, policy_version 534928 (0.0008) [2023-12-27 23:05:04,705][106225] Updated weights for policy 1, policy_version 536310 (0.0007) [2023-12-27 23:05:04,772][106225] Updated weights for policy 1, policy_version 536320 (0.0005) [2023-12-27 23:05:04,826][106225] Updated weights for policy 1, policy_version 536330 (0.0007) [2023-12-27 23:05:05,106][106226] Updated weights for policy 0, policy_version 534938 (0.0006) [2023-12-27 23:05:05,158][106226] Updated weights for policy 0, policy_version 534948 (0.0008) [2023-12-27 23:05:05,217][106226] Updated weights for policy 0, policy_version 534958 (0.0009) [2023-12-27 23:05:05,269][106226] Updated weights for policy 0, policy_version 534968 (0.0008) [2023-12-27 23:05:05,447][106225] Updated weights for policy 1, policy_version 536340 (0.0007) [2023-12-27 23:05:05,497][106225] Updated weights for policy 1, policy_version 536350 (0.0007) [2023-12-27 23:05:05,545][106225] Updated weights for policy 1, policy_version 536360 (0.0008) [2023-12-27 23:05:06,053][106226] Updated weights for policy 0, policy_version 534978 (0.0010) [2023-12-27 23:05:06,108][106226] Updated weights for policy 0, policy_version 534988 (0.0006) [2023-12-27 23:05:06,162][106225] Updated weights for policy 1, policy_version 536370 (0.0008) [2023-12-27 23:05:06,174][106226] Updated weights for policy 0, policy_version 534998 (0.0010) [2023-12-27 23:05:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 274325504. Throughput: 0: 10123.8, 1: 9921.1. Samples: 274342136. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:06,175][105115] Avg episode reward: [(0, '-5.092'), (1, '-5.425')] [2023-12-27 23:05:06,221][106225] Updated weights for policy 1, policy_version 536380 (0.0008) [2023-12-27 23:05:06,287][106225] Updated weights for policy 1, policy_version 536390 (0.0008) [2023-12-27 23:05:06,353][106225] Updated weights for policy 1, policy_version 536400 (0.0008) [2023-12-27 23:05:06,884][106226] Updated weights for policy 0, policy_version 535008 (0.0012) [2023-12-27 23:05:06,952][106226] Updated weights for policy 0, policy_version 535018 (0.0007) [2023-12-27 23:05:07,020][106226] Updated weights for policy 0, policy_version 535028 (0.0006) [2023-12-27 23:05:07,122][106225] Updated weights for policy 1, policy_version 536410 (0.0010) [2023-12-27 23:05:07,179][106225] Updated weights for policy 1, policy_version 536420 (0.0010) [2023-12-27 23:05:07,237][106225] Updated weights for policy 1, policy_version 536430 (0.0005) [2023-12-27 23:05:07,644][106226] Updated weights for policy 0, policy_version 535038 (0.0010) [2023-12-27 23:05:07,695][106226] Updated weights for policy 0, policy_version 535048 (0.0010) [2023-12-27 23:05:07,759][106226] Updated weights for policy 0, policy_version 535058 (0.0008) [2023-12-27 23:05:07,856][106225] Updated weights for policy 1, policy_version 536440 (0.0007) [2023-12-27 23:05:07,925][106225] Updated weights for policy 1, policy_version 536450 (0.0005) [2023-12-27 23:05:07,985][106225] Updated weights for policy 1, policy_version 536460 (0.0006) [2023-12-27 23:05:08,413][106226] Updated weights for policy 0, policy_version 535068 (0.0007) [2023-12-27 23:05:08,474][106226] Updated weights for policy 0, policy_version 535078 (0.0009) [2023-12-27 23:05:08,527][106226] Updated weights for policy 0, policy_version 535088 (0.0009) [2023-12-27 23:05:08,541][106225] Updated weights for policy 1, policy_version 536470 (0.0007) [2023-12-27 23:05:08,604][106225] Updated weights for policy 1, policy_version 536480 (0.0009) [2023-12-27 23:05:08,658][106225] Updated weights for policy 1, policy_version 536490 (0.0009) [2023-12-27 23:05:09,290][106226] Updated weights for policy 0, policy_version 535098 (0.0009) [2023-12-27 23:05:09,375][106226] Updated weights for policy 0, policy_version 535108 (0.0008) [2023-12-27 23:05:09,378][106225] Updated weights for policy 1, policy_version 536500 (0.0008) [2023-12-27 23:05:09,448][106225] Updated weights for policy 1, policy_version 536510 (0.0008) [2023-12-27 23:05:09,450][106226] Updated weights for policy 0, policy_version 535118 (0.0009) [2023-12-27 23:05:09,512][106225] Updated weights for policy 1, policy_version 536520 (0.0008) [2023-12-27 23:05:09,514][106226] Updated weights for policy 0, policy_version 535128 (0.0009) [2023-12-27 23:05:10,294][106225] Updated weights for policy 1, policy_version 536530 (0.0008) [2023-12-27 23:05:10,352][106226] Updated weights for policy 0, policy_version 535138 (0.0009) [2023-12-27 23:05:10,355][106225] Updated weights for policy 1, policy_version 536540 (0.0009) [2023-12-27 23:05:10,404][106226] Updated weights for policy 0, policy_version 535148 (0.0007) [2023-12-27 23:05:10,413][106225] Updated weights for policy 1, policy_version 536550 (0.0007) [2023-12-27 23:05:10,460][106226] Updated weights for policy 0, policy_version 535158 (0.0009) [2023-12-27 23:05:10,471][106225] Updated weights for policy 1, policy_version 536560 (0.0006) [2023-12-27 23:05:11,160][106226] Updated weights for policy 0, policy_version 535168 (0.0007) [2023-12-27 23:05:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 274423808. Throughput: 0: 10131.9, 1: 9983.5. Samples: 274402268. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:11,175][105115] Avg episode reward: [(0, '-5.105'), (1, '-5.648')] [2023-12-27 23:05:11,227][106226] Updated weights for policy 0, policy_version 535178 (0.0008) [2023-12-27 23:05:11,246][106225] Updated weights for policy 1, policy_version 536570 (0.0008) [2023-12-27 23:05:11,294][106226] Updated weights for policy 0, policy_version 535188 (0.0008) [2023-12-27 23:05:11,312][106225] Updated weights for policy 1, policy_version 536580 (0.0007) [2023-12-27 23:05:11,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000535192_137043968.pth... [2023-12-27 23:05:11,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000534008_136740864.pth [2023-12-27 23:05:11,378][106225] Updated weights for policy 1, policy_version 536590 (0.0009) [2023-12-27 23:05:11,394][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000536592_137396224.pth... [2023-12-27 23:05:11,398][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000535408_137093120.pth [2023-12-27 23:05:12,034][106226] Updated weights for policy 0, policy_version 535198 (0.0007) [2023-12-27 23:05:12,103][106226] Updated weights for policy 0, policy_version 535208 (0.0006) [2023-12-27 23:05:12,158][106226] Updated weights for policy 0, policy_version 535218 (0.0005) [2023-12-27 23:05:12,203][106225] Updated weights for policy 1, policy_version 536600 (0.0008) [2023-12-27 23:05:12,257][106225] Updated weights for policy 1, policy_version 536610 (0.0007) [2023-12-27 23:05:12,325][106225] Updated weights for policy 1, policy_version 536620 (0.0008) [2023-12-27 23:05:12,779][106226] Updated weights for policy 0, policy_version 535228 (0.0007) [2023-12-27 23:05:12,853][106226] Updated weights for policy 0, policy_version 535238 (0.0008) [2023-12-27 23:05:12,913][106226] Updated weights for policy 0, policy_version 535248 (0.0009) [2023-12-27 23:05:13,081][106225] Updated weights for policy 1, policy_version 536630 (0.0007) [2023-12-27 23:05:13,141][106225] Updated weights for policy 1, policy_version 536640 (0.0005) [2023-12-27 23:05:13,203][106225] Updated weights for policy 1, policy_version 536650 (0.0006) [2023-12-27 23:05:13,533][106226] Updated weights for policy 0, policy_version 535258 (0.0007) [2023-12-27 23:05:13,602][106226] Updated weights for policy 0, policy_version 535268 (0.0007) [2023-12-27 23:05:13,672][106226] Updated weights for policy 0, policy_version 535278 (0.0005) [2023-12-27 23:05:13,735][106226] Updated weights for policy 0, policy_version 535288 (0.0005) [2023-12-27 23:05:13,739][106225] Updated weights for policy 1, policy_version 536660 (0.0007) [2023-12-27 23:05:13,800][106225] Updated weights for policy 1, policy_version 536670 (0.0010) [2023-12-27 23:05:13,854][106225] Updated weights for policy 1, policy_version 536680 (0.0006) [2023-12-27 23:05:14,375][106226] Updated weights for policy 0, policy_version 535298 (0.0006) [2023-12-27 23:05:14,440][106226] Updated weights for policy 0, policy_version 535308 (0.0009) [2023-12-27 23:05:14,478][106225] Updated weights for policy 1, policy_version 536690 (0.0007) [2023-12-27 23:05:14,496][106226] Updated weights for policy 0, policy_version 535318 (0.0007) [2023-12-27 23:05:14,538][106225] Updated weights for policy 1, policy_version 536700 (0.0008) [2023-12-27 23:05:14,599][106225] Updated weights for policy 1, policy_version 536710 (0.0010) [2023-12-27 23:05:14,651][106225] Updated weights for policy 1, policy_version 536720 (0.0010) [2023-12-27 23:05:15,112][106226] Updated weights for policy 0, policy_version 535328 (0.0006) [2023-12-27 23:05:15,178][106226] Updated weights for policy 0, policy_version 535338 (0.0006) [2023-12-27 23:05:15,240][106226] Updated weights for policy 0, policy_version 535348 (0.0008) [2023-12-27 23:05:15,373][106225] Updated weights for policy 1, policy_version 536730 (0.0008) [2023-12-27 23:05:15,433][106225] Updated weights for policy 1, policy_version 536740 (0.0008) [2023-12-27 23:05:15,488][106225] Updated weights for policy 1, policy_version 536750 (0.0008) [2023-12-27 23:05:15,968][106226] Updated weights for policy 0, policy_version 535358 (0.0008) [2023-12-27 23:05:16,019][106226] Updated weights for policy 0, policy_version 535368 (0.0009) [2023-12-27 23:05:16,075][106226] Updated weights for policy 0, policy_version 535378 (0.0008) [2023-12-27 23:05:16,128][106225] Updated weights for policy 1, policy_version 536760 (0.0006) [2023-12-27 23:05:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 274530304. Throughput: 0: 10064.4, 1: 9810.8. Samples: 274520644. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:16,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.608')] [2023-12-27 23:05:16,187][106225] Updated weights for policy 1, policy_version 536770 (0.0005) [2023-12-27 23:05:16,250][106225] Updated weights for policy 1, policy_version 536780 (0.0008) [2023-12-27 23:05:16,825][106226] Updated weights for policy 0, policy_version 535388 (0.0009) [2023-12-27 23:05:16,846][106225] Updated weights for policy 1, policy_version 536790 (0.0007) [2023-12-27 23:05:16,889][106226] Updated weights for policy 0, policy_version 535398 (0.0009) [2023-12-27 23:05:16,899][106225] Updated weights for policy 1, policy_version 536800 (0.0005) [2023-12-27 23:05:16,948][106226] Updated weights for policy 0, policy_version 535408 (0.0008) [2023-12-27 23:05:16,957][106225] Updated weights for policy 1, policy_version 536810 (0.0006) [2023-12-27 23:05:17,528][106225] Updated weights for policy 1, policy_version 536820 (0.0006) [2023-12-27 23:05:17,588][106225] Updated weights for policy 1, policy_version 536830 (0.0006) [2023-12-27 23:05:17,642][106225] Updated weights for policy 1, policy_version 536840 (0.0005) [2023-12-27 23:05:17,729][106226] Updated weights for policy 0, policy_version 535418 (0.0007) [2023-12-27 23:05:17,781][106226] Updated weights for policy 0, policy_version 535428 (0.0005) [2023-12-27 23:05:17,832][106226] Updated weights for policy 0, policy_version 535438 (0.0005) [2023-12-27 23:05:17,888][106226] Updated weights for policy 0, policy_version 535448 (0.0005) [2023-12-27 23:05:18,323][106225] Updated weights for policy 1, policy_version 536850 (0.0009) [2023-12-27 23:05:18,385][106225] Updated weights for policy 1, policy_version 536860 (0.0011) [2023-12-27 23:05:18,447][106225] Updated weights for policy 1, policy_version 536870 (0.0010) [2023-12-27 23:05:18,504][106225] Updated weights for policy 1, policy_version 536880 (0.0010) [2023-12-27 23:05:18,550][106226] Updated weights for policy 0, policy_version 535458 (0.0011) [2023-12-27 23:05:18,612][106226] Updated weights for policy 0, policy_version 535468 (0.0011) [2023-12-27 23:05:18,666][106226] Updated weights for policy 0, policy_version 535478 (0.0010) [2023-12-27 23:05:19,215][106225] Updated weights for policy 1, policy_version 536890 (0.0006) [2023-12-27 23:05:19,279][106226] Updated weights for policy 0, policy_version 535488 (0.0010) [2023-12-27 23:05:19,279][106225] Updated weights for policy 1, policy_version 536900 (0.0008) [2023-12-27 23:05:19,343][106225] Updated weights for policy 1, policy_version 536910 (0.0009) [2023-12-27 23:05:19,345][106226] Updated weights for policy 0, policy_version 535498 (0.0009) [2023-12-27 23:05:19,403][106226] Updated weights for policy 0, policy_version 535508 (0.0011) [2023-12-27 23:05:20,048][106225] Updated weights for policy 1, policy_version 536920 (0.0010) [2023-12-27 23:05:20,095][106226] Updated weights for policy 0, policy_version 535518 (0.0009) [2023-12-27 23:05:20,109][106225] Updated weights for policy 1, policy_version 536930 (0.0010) [2023-12-27 23:05:20,158][106226] Updated weights for policy 0, policy_version 535528 (0.0011) [2023-12-27 23:05:20,173][106225] Updated weights for policy 1, policy_version 536940 (0.0008) [2023-12-27 23:05:20,217][106226] Updated weights for policy 0, policy_version 535538 (0.0011) [2023-12-27 23:05:20,877][106225] Updated weights for policy 1, policy_version 536950 (0.0009) [2023-12-27 23:05:20,916][106226] Updated weights for policy 0, policy_version 535548 (0.0011) [2023-12-27 23:05:20,939][106225] Updated weights for policy 1, policy_version 536960 (0.0010) [2023-12-27 23:05:20,981][106226] Updated weights for policy 0, policy_version 535558 (0.0011) [2023-12-27 23:05:21,001][106225] Updated weights for policy 1, policy_version 536970 (0.0011) [2023-12-27 23:05:21,046][106226] Updated weights for policy 0, policy_version 535568 (0.0010) [2023-12-27 23:05:21,174][105115] Fps is (10 sec: 21299.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 274636800. Throughput: 0: 10013.0, 1: 9959.7. Samples: 274641680. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:21,175][105115] Avg episode reward: [(0, '-5.256'), (1, '-5.297')] [2023-12-27 23:05:21,736][106225] Updated weights for policy 1, policy_version 536980 (0.0010) [2023-12-27 23:05:21,800][106225] Updated weights for policy 1, policy_version 536990 (0.0008) [2023-12-27 23:05:21,839][106226] Updated weights for policy 0, policy_version 535578 (0.0009) [2023-12-27 23:05:21,866][106225] Updated weights for policy 1, policy_version 537000 (0.0008) [2023-12-27 23:05:21,903][106226] Updated weights for policy 0, policy_version 535588 (0.0008) [2023-12-27 23:05:21,967][106226] Updated weights for policy 0, policy_version 535598 (0.0006) [2023-12-27 23:05:22,032][106226] Updated weights for policy 0, policy_version 535608 (0.0006) [2023-12-27 23:05:22,567][106225] Updated weights for policy 1, policy_version 537010 (0.0006) [2023-12-27 23:05:22,636][106225] Updated weights for policy 1, policy_version 537020 (0.0006) [2023-12-27 23:05:22,694][106226] Updated weights for policy 0, policy_version 535618 (0.0007) [2023-12-27 23:05:22,702][106225] Updated weights for policy 1, policy_version 537030 (0.0008) [2023-12-27 23:05:22,749][106226] Updated weights for policy 0, policy_version 535628 (0.0005) [2023-12-27 23:05:22,753][106225] Updated weights for policy 1, policy_version 537040 (0.0008) [2023-12-27 23:05:22,813][106226] Updated weights for policy 0, policy_version 535638 (0.0006) [2023-12-27 23:05:23,392][106225] Updated weights for policy 1, policy_version 537050 (0.0009) [2023-12-27 23:05:23,402][106226] Updated weights for policy 0, policy_version 535648 (0.0006) [2023-12-27 23:05:23,446][106225] Updated weights for policy 1, policy_version 537060 (0.0008) [2023-12-27 23:05:23,454][106226] Updated weights for policy 0, policy_version 535658 (0.0005) [2023-12-27 23:05:23,501][106225] Updated weights for policy 1, policy_version 537070 (0.0007) [2023-12-27 23:05:23,511][106226] Updated weights for policy 0, policy_version 535668 (0.0006) [2023-12-27 23:05:24,243][106225] Updated weights for policy 1, policy_version 537080 (0.0010) [2023-12-27 23:05:24,268][106226] Updated weights for policy 0, policy_version 535678 (0.0007) [2023-12-27 23:05:24,301][106225] Updated weights for policy 1, policy_version 537090 (0.0011) [2023-12-27 23:05:24,318][106226] Updated weights for policy 0, policy_version 535688 (0.0009) [2023-12-27 23:05:24,358][106225] Updated weights for policy 1, policy_version 537100 (0.0010) [2023-12-27 23:05:24,367][106226] Updated weights for policy 0, policy_version 535698 (0.0008) [2023-12-27 23:05:25,060][106225] Updated weights for policy 1, policy_version 537110 (0.0010) [2023-12-27 23:05:25,116][106225] Updated weights for policy 1, policy_version 537120 (0.0010) [2023-12-27 23:05:25,134][106226] Updated weights for policy 0, policy_version 535708 (0.0006) [2023-12-27 23:05:25,171][106225] Updated weights for policy 1, policy_version 537130 (0.0007) [2023-12-27 23:05:25,185][106226] Updated weights for policy 0, policy_version 535718 (0.0007) [2023-12-27 23:05:25,238][106226] Updated weights for policy 0, policy_version 535728 (0.0007) [2023-12-27 23:05:25,824][106225] Updated weights for policy 1, policy_version 537140 (0.0009) [2023-12-27 23:05:25,890][106225] Updated weights for policy 1, policy_version 537150 (0.0005) [2023-12-27 23:05:25,953][106225] Updated weights for policy 1, policy_version 537160 (0.0008) [2023-12-27 23:05:26,031][106226] Updated weights for policy 0, policy_version 535738 (0.0007) [2023-12-27 23:05:26,092][106226] Updated weights for policy 0, policy_version 535748 (0.0005) [2023-12-27 23:05:26,147][106226] Updated weights for policy 0, policy_version 535758 (0.0005) [2023-12-27 23:05:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 274726912. Throughput: 0: 9993.2, 1: 9998.9. Samples: 274700828. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:26,175][105115] Avg episode reward: [(0, '-5.315'), (1, '-5.374')] [2023-12-27 23:05:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000537168_137543680.pth... [2023-12-27 23:05:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000535984_137240576.pth [2023-12-27 23:05:26,202][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000535768_137191424.pth... [2023-12-27 23:05:26,202][106226] Updated weights for policy 0, policy_version 535768 (0.0005) [2023-12-27 23:05:26,207][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000534616_136896512.pth [2023-12-27 23:05:26,521][106225] Updated weights for policy 1, policy_version 537170 (0.0005) [2023-12-27 23:05:26,580][106225] Updated weights for policy 1, policy_version 537180 (0.0005) [2023-12-27 23:05:26,631][106225] Updated weights for policy 1, policy_version 537190 (0.0005) [2023-12-27 23:05:26,682][106225] Updated weights for policy 1, policy_version 537200 (0.0005) [2023-12-27 23:05:26,897][106226] Updated weights for policy 0, policy_version 535778 (0.0009) [2023-12-27 23:05:26,955][106226] Updated weights for policy 0, policy_version 535788 (0.0009) [2023-12-27 23:05:27,011][106226] Updated weights for policy 0, policy_version 535798 (0.0009) [2023-12-27 23:05:27,229][106225] Updated weights for policy 1, policy_version 537210 (0.0005) [2023-12-27 23:05:27,291][106225] Updated weights for policy 1, policy_version 537220 (0.0008) [2023-12-27 23:05:27,347][106225] Updated weights for policy 1, policy_version 537230 (0.0007) [2023-12-27 23:05:27,707][106226] Updated weights for policy 0, policy_version 535808 (0.0007) [2023-12-27 23:05:27,759][106226] Updated weights for policy 0, policy_version 535818 (0.0006) [2023-12-27 23:05:27,811][106226] Updated weights for policy 0, policy_version 535828 (0.0006) [2023-12-27 23:05:28,009][106225] Updated weights for policy 1, policy_version 537240 (0.0007) [2023-12-27 23:05:28,069][106225] Updated weights for policy 1, policy_version 537250 (0.0008) [2023-12-27 23:05:28,129][106225] Updated weights for policy 1, policy_version 537260 (0.0010) [2023-12-27 23:05:28,410][106226] Updated weights for policy 0, policy_version 535838 (0.0008) [2023-12-27 23:05:28,472][106226] Updated weights for policy 0, policy_version 535848 (0.0011) [2023-12-27 23:05:28,529][106226] Updated weights for policy 0, policy_version 535858 (0.0011) [2023-12-27 23:05:28,833][106225] Updated weights for policy 1, policy_version 537270 (0.0009) [2023-12-27 23:05:28,894][106225] Updated weights for policy 1, policy_version 537280 (0.0008) [2023-12-27 23:05:28,956][106225] Updated weights for policy 1, policy_version 537290 (0.0008) [2023-12-27 23:05:29,180][106226] Updated weights for policy 0, policy_version 535868 (0.0008) [2023-12-27 23:05:29,255][106226] Updated weights for policy 0, policy_version 535878 (0.0011) [2023-12-27 23:05:29,319][106226] Updated weights for policy 0, policy_version 535888 (0.0007) [2023-12-27 23:05:29,684][106225] Updated weights for policy 1, policy_version 537300 (0.0007) [2023-12-27 23:05:29,746][106225] Updated weights for policy 1, policy_version 537310 (0.0007) [2023-12-27 23:05:29,797][106225] Updated weights for policy 1, policy_version 537320 (0.0008) [2023-12-27 23:05:29,966][106226] Updated weights for policy 0, policy_version 535898 (0.0009) [2023-12-27 23:05:30,030][106226] Updated weights for policy 0, policy_version 535908 (0.0006) [2023-12-27 23:05:30,091][106226] Updated weights for policy 0, policy_version 535918 (0.0007) [2023-12-27 23:05:30,149][106226] Updated weights for policy 0, policy_version 535928 (0.0008) [2023-12-27 23:05:30,500][106225] Updated weights for policy 1, policy_version 537330 (0.0008) [2023-12-27 23:05:30,549][106225] Updated weights for policy 1, policy_version 537340 (0.0008) [2023-12-27 23:05:30,600][106225] Updated weights for policy 1, policy_version 537350 (0.0008) [2023-12-27 23:05:30,651][106225] Updated weights for policy 1, policy_version 537360 (0.0008) [2023-12-27 23:05:30,692][106226] Updated weights for policy 0, policy_version 535938 (0.0005) [2023-12-27 23:05:30,750][106226] Updated weights for policy 0, policy_version 535948 (0.0007) [2023-12-27 23:05:30,831][106226] Updated weights for policy 0, policy_version 535958 (0.0010) [2023-12-27 23:05:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 274833408. Throughput: 0: 10080.3, 1: 10104.0. Samples: 274823372. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:31,175][105115] Avg episode reward: [(0, '-5.112'), (1, '-5.753')] [2023-12-27 23:05:31,437][106226] Updated weights for policy 0, policy_version 535968 (0.0006) [2023-12-27 23:05:31,489][106226] Updated weights for policy 0, policy_version 535978 (0.0006) [2023-12-27 23:05:31,489][106225] Updated weights for policy 1, policy_version 537370 (0.0008) [2023-12-27 23:05:31,541][106226] Updated weights for policy 0, policy_version 535988 (0.0005) [2023-12-27 23:05:31,552][106225] Updated weights for policy 1, policy_version 537380 (0.0008) [2023-12-27 23:05:31,613][106225] Updated weights for policy 1, policy_version 537390 (0.0009) [2023-12-27 23:05:32,207][106226] Updated weights for policy 0, policy_version 535998 (0.0008) [2023-12-27 23:05:32,271][106226] Updated weights for policy 0, policy_version 536008 (0.0010) [2023-12-27 23:05:32,334][106226] Updated weights for policy 0, policy_version 536018 (0.0010) [2023-12-27 23:05:32,336][106225] Updated weights for policy 1, policy_version 537400 (0.0008) [2023-12-27 23:05:32,398][106225] Updated weights for policy 1, policy_version 537410 (0.0010) [2023-12-27 23:05:32,456][106225] Updated weights for policy 1, policy_version 537420 (0.0010) [2023-12-27 23:05:33,000][106226] Updated weights for policy 0, policy_version 536028 (0.0008) [2023-12-27 23:05:33,060][106226] Updated weights for policy 0, policy_version 536038 (0.0009) [2023-12-27 23:05:33,113][106226] Updated weights for policy 0, policy_version 536048 (0.0010) [2023-12-27 23:05:33,192][106225] Updated weights for policy 1, policy_version 537430 (0.0010) [2023-12-27 23:05:33,252][106225] Updated weights for policy 1, policy_version 537440 (0.0010) [2023-12-27 23:05:33,308][106225] Updated weights for policy 1, policy_version 537450 (0.0010) [2023-12-27 23:05:33,701][106226] Updated weights for policy 0, policy_version 536058 (0.0009) [2023-12-27 23:05:33,761][106226] Updated weights for policy 0, policy_version 536068 (0.0006) [2023-12-27 23:05:33,818][106226] Updated weights for policy 0, policy_version 536078 (0.0006) [2023-12-27 23:05:33,889][106226] Updated weights for policy 0, policy_version 536088 (0.0005) [2023-12-27 23:05:34,001][106225] Updated weights for policy 1, policy_version 537460 (0.0010) [2023-12-27 23:05:34,046][106225] Updated weights for policy 1, policy_version 537470 (0.0010) [2023-12-27 23:05:34,099][106225] Updated weights for policy 1, policy_version 537480 (0.0008) [2023-12-27 23:05:34,541][106226] Updated weights for policy 0, policy_version 536098 (0.0008) [2023-12-27 23:05:34,598][106226] Updated weights for policy 0, policy_version 536108 (0.0008) [2023-12-27 23:05:34,661][106226] Updated weights for policy 0, policy_version 536118 (0.0005) [2023-12-27 23:05:34,844][106225] Updated weights for policy 1, policy_version 537490 (0.0009) [2023-12-27 23:05:34,891][106225] Updated weights for policy 1, policy_version 537500 (0.0005) [2023-12-27 23:05:34,938][106225] Updated weights for policy 1, policy_version 537510 (0.0005) [2023-12-27 23:05:34,991][106225] Updated weights for policy 1, policy_version 537520 (0.0006) [2023-12-27 23:05:35,327][106226] Updated weights for policy 0, policy_version 536128 (0.0005) [2023-12-27 23:05:35,385][106226] Updated weights for policy 0, policy_version 536138 (0.0005) [2023-12-27 23:05:35,444][106226] Updated weights for policy 0, policy_version 536148 (0.0005) [2023-12-27 23:05:35,678][106225] Updated weights for policy 1, policy_version 537530 (0.0010) [2023-12-27 23:05:35,736][106225] Updated weights for policy 1, policy_version 537540 (0.0010) [2023-12-27 23:05:35,802][106225] Updated weights for policy 1, policy_version 537550 (0.0009) [2023-12-27 23:05:35,956][106226] Updated weights for policy 0, policy_version 536158 (0.0007) [2023-12-27 23:05:36,005][106226] Updated weights for policy 0, policy_version 536168 (0.0007) [2023-12-27 23:05:36,058][106226] Updated weights for policy 0, policy_version 536178 (0.0007) [2023-12-27 23:05:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 274939904. Throughput: 0: 10094.5, 1: 9998.7. Samples: 274946152. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:36,175][105115] Avg episode reward: [(0, '-4.990'), (1, '-5.626')] [2023-12-27 23:05:36,508][106225] Updated weights for policy 1, policy_version 537560 (0.0007) [2023-12-27 23:05:36,569][106225] Updated weights for policy 1, policy_version 537570 (0.0006) [2023-12-27 23:05:36,628][106225] Updated weights for policy 1, policy_version 537580 (0.0010) [2023-12-27 23:05:36,855][106226] Updated weights for policy 0, policy_version 536188 (0.0010) [2023-12-27 23:05:36,922][106226] Updated weights for policy 0, policy_version 536198 (0.0010) [2023-12-27 23:05:36,992][106226] Updated weights for policy 0, policy_version 536208 (0.0009) [2023-12-27 23:05:37,202][106225] Updated weights for policy 1, policy_version 537590 (0.0010) [2023-12-27 23:05:37,249][106225] Updated weights for policy 1, policy_version 537600 (0.0010) [2023-12-27 23:05:37,305][106225] Updated weights for policy 1, policy_version 537610 (0.0007) [2023-12-27 23:05:37,741][106226] Updated weights for policy 0, policy_version 536218 (0.0009) [2023-12-27 23:05:37,795][106226] Updated weights for policy 0, policy_version 536228 (0.0006) [2023-12-27 23:05:37,861][106226] Updated weights for policy 0, policy_version 536238 (0.0005) [2023-12-27 23:05:37,930][106226] Updated weights for policy 0, policy_version 536248 (0.0006) [2023-12-27 23:05:37,969][106225] Updated weights for policy 1, policy_version 537620 (0.0007) [2023-12-27 23:05:38,021][106225] Updated weights for policy 1, policy_version 537630 (0.0008) [2023-12-27 23:05:38,069][106225] Updated weights for policy 1, policy_version 537640 (0.0008) [2023-12-27 23:05:38,563][106226] Updated weights for policy 0, policy_version 536258 (0.0006) [2023-12-27 23:05:38,624][106226] Updated weights for policy 0, policy_version 536268 (0.0008) [2023-12-27 23:05:38,681][106226] Updated weights for policy 0, policy_version 536278 (0.0006) [2023-12-27 23:05:38,848][106225] Updated weights for policy 1, policy_version 537650 (0.0010) [2023-12-27 23:05:38,919][106225] Updated weights for policy 1, policy_version 537660 (0.0010) [2023-12-27 23:05:38,979][106225] Updated weights for policy 1, policy_version 537670 (0.0010) [2023-12-27 23:05:39,038][106225] Updated weights for policy 1, policy_version 537680 (0.0010) [2023-12-27 23:05:39,366][106226] Updated weights for policy 0, policy_version 536288 (0.0009) [2023-12-27 23:05:39,435][106226] Updated weights for policy 0, policy_version 536298 (0.0009) [2023-12-27 23:05:39,497][106226] Updated weights for policy 0, policy_version 536308 (0.0006) [2023-12-27 23:05:39,786][106225] Updated weights for policy 1, policy_version 537690 (0.0010) [2023-12-27 23:05:39,856][106225] Updated weights for policy 1, policy_version 537700 (0.0009) [2023-12-27 23:05:39,912][106225] Updated weights for policy 1, policy_version 537710 (0.0009) [2023-12-27 23:05:40,125][106226] Updated weights for policy 0, policy_version 536318 (0.0006) [2023-12-27 23:05:40,186][106226] Updated weights for policy 0, policy_version 536328 (0.0006) [2023-12-27 23:05:40,246][106226] Updated weights for policy 0, policy_version 536338 (0.0006) [2023-12-27 23:05:40,651][106225] Updated weights for policy 1, policy_version 537720 (0.0006) [2023-12-27 23:05:40,715][106225] Updated weights for policy 1, policy_version 537730 (0.0007) [2023-12-27 23:05:40,777][106225] Updated weights for policy 1, policy_version 537740 (0.0007) [2023-12-27 23:05:40,880][106226] Updated weights for policy 0, policy_version 536348 (0.0006) [2023-12-27 23:05:40,942][106226] Updated weights for policy 0, policy_version 536358 (0.0005) [2023-12-27 23:05:40,991][106226] Updated weights for policy 0, policy_version 536368 (0.0005) [2023-12-27 23:05:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 275038208. Throughput: 0: 10099.9, 1: 10039.4. Samples: 275005676. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:41,175][105115] Avg episode reward: [(0, '-5.011'), (1, '-5.438')] [2023-12-27 23:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000537744_137691136.pth... [2023-12-27 23:05:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000536376_137347072.pth... [2023-12-27 23:05:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000535192_137043968.pth [2023-12-27 23:05:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000536592_137396224.pth [2023-12-27 23:05:41,570][106225] Updated weights for policy 1, policy_version 537750 (0.0008) [2023-12-27 23:05:41,633][106225] Updated weights for policy 1, policy_version 537760 (0.0008) [2023-12-27 23:05:41,700][106225] Updated weights for policy 1, policy_version 537770 (0.0007) [2023-12-27 23:05:41,754][106226] Updated weights for policy 0, policy_version 536378 (0.0006) [2023-12-27 23:05:41,828][106226] Updated weights for policy 0, policy_version 536388 (0.0009) [2023-12-27 23:05:41,900][106226] Updated weights for policy 0, policy_version 536398 (0.0009) [2023-12-27 23:05:41,964][106226] Updated weights for policy 0, policy_version 536408 (0.0010) [2023-12-27 23:05:42,499][106225] Updated weights for policy 1, policy_version 537780 (0.0008) [2023-12-27 23:05:42,558][106225] Updated weights for policy 1, policy_version 537790 (0.0006) [2023-12-27 23:05:42,620][106225] Updated weights for policy 1, policy_version 537800 (0.0006) [2023-12-27 23:05:42,715][106226] Updated weights for policy 0, policy_version 536418 (0.0006) [2023-12-27 23:05:42,779][106226] Updated weights for policy 0, policy_version 536428 (0.0005) [2023-12-27 23:05:42,849][106226] Updated weights for policy 0, policy_version 536438 (0.0010) [2023-12-27 23:05:43,284][106225] Updated weights for policy 1, policy_version 537810 (0.0006) [2023-12-27 23:05:43,339][106225] Updated weights for policy 1, policy_version 537820 (0.0007) [2023-12-27 23:05:43,391][106225] Updated weights for policy 1, policy_version 537830 (0.0006) [2023-12-27 23:05:43,450][106226] Updated weights for policy 0, policy_version 536448 (0.0007) [2023-12-27 23:05:43,454][106225] Updated weights for policy 1, policy_version 537840 (0.0007) [2023-12-27 23:05:43,515][106226] Updated weights for policy 0, policy_version 536458 (0.0007) [2023-12-27 23:05:43,571][106226] Updated weights for policy 0, policy_version 536468 (0.0006) [2023-12-27 23:05:44,130][106225] Updated weights for policy 1, policy_version 537850 (0.0008) [2023-12-27 23:05:44,192][106225] Updated weights for policy 1, policy_version 537860 (0.0009) [2023-12-27 23:05:44,211][106226] Updated weights for policy 0, policy_version 536478 (0.0008) [2023-12-27 23:05:44,241][106225] Updated weights for policy 1, policy_version 537870 (0.0008) [2023-12-27 23:05:44,264][106226] Updated weights for policy 0, policy_version 536488 (0.0006) [2023-12-27 23:05:44,313][106226] Updated weights for policy 0, policy_version 536498 (0.0008) [2023-12-27 23:05:45,002][106225] Updated weights for policy 1, policy_version 537880 (0.0008) [2023-12-27 23:05:45,016][106226] Updated weights for policy 0, policy_version 536508 (0.0007) [2023-12-27 23:05:45,068][106225] Updated weights for policy 1, policy_version 537890 (0.0008) [2023-12-27 23:05:45,081][106226] Updated weights for policy 0, policy_version 536518 (0.0006) [2023-12-27 23:05:45,132][106225] Updated weights for policy 1, policy_version 537900 (0.0009) [2023-12-27 23:05:45,142][106226] Updated weights for policy 0, policy_version 536528 (0.0009) [2023-12-27 23:05:45,839][106226] Updated weights for policy 0, policy_version 536538 (0.0008) [2023-12-27 23:05:45,861][106225] Updated weights for policy 1, policy_version 537910 (0.0007) [2023-12-27 23:05:45,901][106226] Updated weights for policy 0, policy_version 536548 (0.0010) [2023-12-27 23:05:45,910][106225] Updated weights for policy 1, policy_version 537920 (0.0006) [2023-12-27 23:05:45,958][106226] Updated weights for policy 0, policy_version 536558 (0.0006) [2023-12-27 23:05:45,964][106225] Updated weights for policy 1, policy_version 537930 (0.0007) [2023-12-27 23:05:46,015][106226] Updated weights for policy 0, policy_version 536568 (0.0005) [2023-12-27 23:05:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 275136512. Throughput: 0: 10107.8, 1: 9951.1. Samples: 275122972. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:46,176][105115] Avg episode reward: [(0, '-5.214'), (1, '-5.476')] [2023-12-27 23:05:46,595][106225] Updated weights for policy 1, policy_version 537940 (0.0007) [2023-12-27 23:05:46,639][106226] Updated weights for policy 0, policy_version 536578 (0.0009) [2023-12-27 23:05:46,651][106225] Updated weights for policy 1, policy_version 537950 (0.0005) [2023-12-27 23:05:46,706][106226] Updated weights for policy 0, policy_version 536588 (0.0008) [2023-12-27 23:05:46,709][106225] Updated weights for policy 1, policy_version 537960 (0.0006) [2023-12-27 23:05:46,761][106226] Updated weights for policy 0, policy_version 536598 (0.0007) [2023-12-27 23:05:47,325][106225] Updated weights for policy 1, policy_version 537970 (0.0007) [2023-12-27 23:05:47,388][106225] Updated weights for policy 1, policy_version 537980 (0.0009) [2023-12-27 23:05:47,426][106226] Updated weights for policy 0, policy_version 536608 (0.0006) [2023-12-27 23:05:47,442][106225] Updated weights for policy 1, policy_version 537990 (0.0007) [2023-12-27 23:05:47,485][106226] Updated weights for policy 0, policy_version 536618 (0.0005) [2023-12-27 23:05:47,489][106225] Updated weights for policy 1, policy_version 538000 (0.0008) [2023-12-27 23:05:47,535][106226] Updated weights for policy 0, policy_version 536628 (0.0008) [2023-12-27 23:05:48,145][106225] Updated weights for policy 1, policy_version 538010 (0.0007) [2023-12-27 23:05:48,205][106225] Updated weights for policy 1, policy_version 538020 (0.0007) [2023-12-27 23:05:48,258][106225] Updated weights for policy 1, policy_version 538030 (0.0008) [2023-12-27 23:05:48,269][106226] Updated weights for policy 0, policy_version 536638 (0.0009) [2023-12-27 23:05:48,319][106226] Updated weights for policy 0, policy_version 536648 (0.0010) [2023-12-27 23:05:48,382][106226] Updated weights for policy 0, policy_version 536658 (0.0011) [2023-12-27 23:05:48,938][106225] Updated weights for policy 1, policy_version 538040 (0.0008) [2023-12-27 23:05:49,002][106225] Updated weights for policy 1, policy_version 538050 (0.0007) [2023-12-27 23:05:49,045][106226] Updated weights for policy 0, policy_version 536668 (0.0008) [2023-12-27 23:05:49,069][106225] Updated weights for policy 1, policy_version 538060 (0.0009) [2023-12-27 23:05:49,101][106226] Updated weights for policy 0, policy_version 536678 (0.0006) [2023-12-27 23:05:49,152][106226] Updated weights for policy 0, policy_version 536688 (0.0008) [2023-12-27 23:05:49,838][106226] Updated weights for policy 0, policy_version 536698 (0.0006) [2023-12-27 23:05:49,878][106225] Updated weights for policy 1, policy_version 538070 (0.0008) [2023-12-27 23:05:49,908][106226] Updated weights for policy 0, policy_version 536708 (0.0009) [2023-12-27 23:05:49,943][106225] Updated weights for policy 1, policy_version 538080 (0.0009) [2023-12-27 23:05:49,973][106226] Updated weights for policy 0, policy_version 536718 (0.0008) [2023-12-27 23:05:49,995][106225] Updated weights for policy 1, policy_version 538090 (0.0007) [2023-12-27 23:05:50,037][106226] Updated weights for policy 0, policy_version 536728 (0.0007) [2023-12-27 23:05:50,723][106226] Updated weights for policy 0, policy_version 536738 (0.0009) [2023-12-27 23:05:50,776][106225] Updated weights for policy 1, policy_version 538100 (0.0007) [2023-12-27 23:05:50,786][106226] Updated weights for policy 0, policy_version 536748 (0.0007) [2023-12-27 23:05:50,836][106225] Updated weights for policy 1, policy_version 538110 (0.0006) [2023-12-27 23:05:50,845][106226] Updated weights for policy 0, policy_version 536758 (0.0008) [2023-12-27 23:05:50,892][106225] Updated weights for policy 1, policy_version 538120 (0.0007) [2023-12-27 23:05:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 275234816. Throughput: 0: 10050.8, 1: 9949.3. Samples: 275242144. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:51,175][105115] Avg episode reward: [(0, '-4.946'), (1, '-5.197')] [2023-12-27 23:05:51,632][106225] Updated weights for policy 1, policy_version 538130 (0.0007) [2023-12-27 23:05:51,644][106226] Updated weights for policy 0, policy_version 536768 (0.0008) [2023-12-27 23:05:51,693][106225] Updated weights for policy 1, policy_version 538140 (0.0007) [2023-12-27 23:05:51,708][106226] Updated weights for policy 0, policy_version 536778 (0.0009) [2023-12-27 23:05:51,761][106225] Updated weights for policy 1, policy_version 538150 (0.0007) [2023-12-27 23:05:51,775][106226] Updated weights for policy 0, policy_version 536788 (0.0009) [2023-12-27 23:05:51,821][106225] Updated weights for policy 1, policy_version 538160 (0.0007) [2023-12-27 23:05:52,473][106225] Updated weights for policy 1, policy_version 538170 (0.0008) [2023-12-27 23:05:52,526][106226] Updated weights for policy 0, policy_version 536798 (0.0008) [2023-12-27 23:05:52,536][106225] Updated weights for policy 1, policy_version 538180 (0.0007) [2023-12-27 23:05:52,590][106225] Updated weights for policy 1, policy_version 538190 (0.0008) [2023-12-27 23:05:52,592][106226] Updated weights for policy 0, policy_version 536808 (0.0007) [2023-12-27 23:05:52,657][106226] Updated weights for policy 0, policy_version 536818 (0.0009) [2023-12-27 23:05:53,299][106225] Updated weights for policy 1, policy_version 538200 (0.0010) [2023-12-27 23:05:53,355][106225] Updated weights for policy 1, policy_version 538210 (0.0010) [2023-12-27 23:05:53,388][106226] Updated weights for policy 0, policy_version 536828 (0.0008) [2023-12-27 23:05:53,414][106225] Updated weights for policy 1, policy_version 538220 (0.0009) [2023-12-27 23:05:53,439][106226] Updated weights for policy 0, policy_version 536838 (0.0005) [2023-12-27 23:05:53,492][106226] Updated weights for policy 0, policy_version 536848 (0.0008) [2023-12-27 23:05:54,128][106225] Updated weights for policy 1, policy_version 538230 (0.0007) [2023-12-27 23:05:54,192][106225] Updated weights for policy 1, policy_version 538240 (0.0007) [2023-12-27 23:05:54,239][106226] Updated weights for policy 0, policy_version 536858 (0.0008) [2023-12-27 23:05:54,259][106225] Updated weights for policy 1, policy_version 538250 (0.0010) [2023-12-27 23:05:54,305][106226] Updated weights for policy 0, policy_version 536868 (0.0006) [2023-12-27 23:05:54,371][106226] Updated weights for policy 0, policy_version 536878 (0.0005) [2023-12-27 23:05:54,436][106226] Updated weights for policy 0, policy_version 536888 (0.0007) [2023-12-27 23:05:54,889][106225] Updated weights for policy 1, policy_version 538260 (0.0009) [2023-12-27 23:05:54,933][106225] Updated weights for policy 1, policy_version 538270 (0.0007) [2023-12-27 23:05:54,984][106225] Updated weights for policy 1, policy_version 538280 (0.0006) [2023-12-27 23:05:55,136][106226] Updated weights for policy 0, policy_version 536898 (0.0008) [2023-12-27 23:05:55,194][106226] Updated weights for policy 0, policy_version 536908 (0.0007) [2023-12-27 23:05:55,246][106226] Updated weights for policy 0, policy_version 536918 (0.0010) [2023-12-27 23:05:55,614][106225] Updated weights for policy 1, policy_version 538290 (0.0008) [2023-12-27 23:05:55,672][106225] Updated weights for policy 1, policy_version 538300 (0.0007) [2023-12-27 23:05:55,724][106225] Updated weights for policy 1, policy_version 538310 (0.0005) [2023-12-27 23:05:55,790][106225] Updated weights for policy 1, policy_version 538320 (0.0005) [2023-12-27 23:05:56,034][106226] Updated weights for policy 0, policy_version 536928 (0.0010) [2023-12-27 23:05:56,103][106226] Updated weights for policy 0, policy_version 536938 (0.0010) [2023-12-27 23:05:56,166][106226] Updated weights for policy 0, policy_version 536948 (0.0010) [2023-12-27 23:05:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 275324928. Throughput: 0: 10029.2, 1: 9900.9. Samples: 275299124. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:05:56,176][105115] Avg episode reward: [(0, '-5.047'), (1, '-5.858')] [2023-12-27 23:05:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000538320_137838592.pth... [2023-12-27 23:05:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000537168_137543680.pth [2023-12-27 23:05:56,190][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000536952_137494528.pth... [2023-12-27 23:05:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000535768_137191424.pth [2023-12-27 23:05:56,372][106225] Updated weights for policy 1, policy_version 538330 (0.0005) [2023-12-27 23:05:56,427][106225] Updated weights for policy 1, policy_version 538340 (0.0005) [2023-12-27 23:05:56,485][106225] Updated weights for policy 1, policy_version 538350 (0.0005) [2023-12-27 23:05:56,799][106226] Updated weights for policy 0, policy_version 536958 (0.0010) [2023-12-27 23:05:56,845][106226] Updated weights for policy 0, policy_version 536968 (0.0010) [2023-12-27 23:05:56,897][106226] Updated weights for policy 0, policy_version 536978 (0.0010) [2023-12-27 23:05:56,982][106225] Updated weights for policy 1, policy_version 538360 (0.0005) [2023-12-27 23:05:57,033][106225] Updated weights for policy 1, policy_version 538370 (0.0005) [2023-12-27 23:05:57,083][106225] Updated weights for policy 1, policy_version 538380 (0.0005) [2023-12-27 23:05:57,607][106226] Updated weights for policy 0, policy_version 536988 (0.0009) [2023-12-27 23:05:57,648][106225] Updated weights for policy 1, policy_version 538390 (0.0008) [2023-12-27 23:05:57,666][106226] Updated weights for policy 0, policy_version 536998 (0.0005) [2023-12-27 23:05:57,695][106225] Updated weights for policy 1, policy_version 538400 (0.0010) [2023-12-27 23:05:57,727][106226] Updated weights for policy 0, policy_version 537008 (0.0005) [2023-12-27 23:05:57,746][106225] Updated weights for policy 1, policy_version 538410 (0.0010) [2023-12-27 23:05:58,303][106226] Updated weights for policy 0, policy_version 537018 (0.0006) [2023-12-27 23:05:58,362][106226] Updated weights for policy 0, policy_version 537028 (0.0007) [2023-12-27 23:05:58,432][106226] Updated weights for policy 0, policy_version 537038 (0.0006) [2023-12-27 23:05:58,506][106226] Updated weights for policy 0, policy_version 537048 (0.0007) [2023-12-27 23:05:58,530][106225] Updated weights for policy 1, policy_version 538420 (0.0010) [2023-12-27 23:05:58,597][106225] Updated weights for policy 1, policy_version 538430 (0.0008) [2023-12-27 23:05:58,669][106225] Updated weights for policy 1, policy_version 538440 (0.0008) [2023-12-27 23:05:59,307][106226] Updated weights for policy 0, policy_version 537058 (0.0008) [2023-12-27 23:05:59,387][106226] Updated weights for policy 0, policy_version 537068 (0.0008) [2023-12-27 23:05:59,450][106226] Updated weights for policy 0, policy_version 537078 (0.0006) [2023-12-27 23:05:59,502][106225] Updated weights for policy 1, policy_version 538450 (0.0008) [2023-12-27 23:05:59,569][106225] Updated weights for policy 1, policy_version 538460 (0.0007) [2023-12-27 23:05:59,628][106225] Updated weights for policy 1, policy_version 538470 (0.0009) [2023-12-27 23:05:59,678][106225] Updated weights for policy 1, policy_version 538480 (0.0009) [2023-12-27 23:06:00,090][106226] Updated weights for policy 0, policy_version 537088 (0.0005) [2023-12-27 23:06:00,158][106226] Updated weights for policy 0, policy_version 537098 (0.0006) [2023-12-27 23:06:00,217][106226] Updated weights for policy 0, policy_version 537108 (0.0007) [2023-12-27 23:06:00,440][106225] Updated weights for policy 1, policy_version 538490 (0.0010) [2023-12-27 23:06:00,505][106225] Updated weights for policy 1, policy_version 538500 (0.0009) [2023-12-27 23:06:00,564][106225] Updated weights for policy 1, policy_version 538510 (0.0008) [2023-12-27 23:06:00,885][106226] Updated weights for policy 0, policy_version 537118 (0.0009) [2023-12-27 23:06:00,945][106226] Updated weights for policy 0, policy_version 537128 (0.0010) [2023-12-27 23:06:00,995][106226] Updated weights for policy 0, policy_version 537138 (0.0010) [2023-12-27 23:06:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 275431424. Throughput: 0: 10018.7, 1: 9989.3. Samples: 275421000. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:01,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.695')] [2023-12-27 23:06:01,291][106225] Updated weights for policy 1, policy_version 538520 (0.0008) [2023-12-27 23:06:01,340][106225] Updated weights for policy 1, policy_version 538530 (0.0007) [2023-12-27 23:06:01,406][106225] Updated weights for policy 1, policy_version 538540 (0.0009) [2023-12-27 23:06:01,740][106226] Updated weights for policy 0, policy_version 537149 (0.0010) [2023-12-27 23:06:01,797][106226] Updated weights for policy 0, policy_version 537159 (0.0007) [2023-12-27 23:06:01,852][106226] Updated weights for policy 0, policy_version 537169 (0.0008) [2023-12-27 23:06:02,092][106225] Updated weights for policy 1, policy_version 538550 (0.0010) [2023-12-27 23:06:02,156][106225] Updated weights for policy 1, policy_version 538560 (0.0010) [2023-12-27 23:06:02,223][106225] Updated weights for policy 1, policy_version 538570 (0.0010) [2023-12-27 23:06:02,541][106226] Updated weights for policy 0, policy_version 537179 (0.0009) [2023-12-27 23:06:02,605][106226] Updated weights for policy 0, policy_version 537189 (0.0009) [2023-12-27 23:06:02,668][106226] Updated weights for policy 0, policy_version 537199 (0.0009) [2023-12-27 23:06:02,832][106225] Updated weights for policy 1, policy_version 538580 (0.0009) [2023-12-27 23:06:02,901][106225] Updated weights for policy 1, policy_version 538590 (0.0006) [2023-12-27 23:06:02,952][106225] Updated weights for policy 1, policy_version 538600 (0.0008) [2023-12-27 23:06:03,331][106226] Updated weights for policy 0, policy_version 537209 (0.0009) [2023-12-27 23:06:03,381][106226] Updated weights for policy 0, policy_version 537219 (0.0006) [2023-12-27 23:06:03,434][106226] Updated weights for policy 0, policy_version 537229 (0.0008) [2023-12-27 23:06:03,481][106226] Updated weights for policy 0, policy_version 537239 (0.0009) [2023-12-27 23:06:03,624][106225] Updated weights for policy 1, policy_version 538610 (0.0009) [2023-12-27 23:06:03,685][106225] Updated weights for policy 1, policy_version 538620 (0.0010) [2023-12-27 23:06:03,739][106225] Updated weights for policy 1, policy_version 538630 (0.0010) [2023-12-27 23:06:03,792][106225] Updated weights for policy 1, policy_version 538640 (0.0010) [2023-12-27 23:06:04,153][106226] Updated weights for policy 0, policy_version 537249 (0.0009) [2023-12-27 23:06:04,208][106226] Updated weights for policy 0, policy_version 537259 (0.0008) [2023-12-27 23:06:04,268][106226] Updated weights for policy 0, policy_version 537269 (0.0008) [2023-12-27 23:06:04,510][106225] Updated weights for policy 1, policy_version 538650 (0.0009) [2023-12-27 23:06:04,569][106225] Updated weights for policy 1, policy_version 538660 (0.0008) [2023-12-27 23:06:04,627][106225] Updated weights for policy 1, policy_version 538670 (0.0010) [2023-12-27 23:06:04,988][106226] Updated weights for policy 0, policy_version 537279 (0.0006) [2023-12-27 23:06:05,049][106226] Updated weights for policy 0, policy_version 537289 (0.0006) [2023-12-27 23:06:05,115][106226] Updated weights for policy 0, policy_version 537299 (0.0005) [2023-12-27 23:06:05,343][106225] Updated weights for policy 1, policy_version 538680 (0.0007) [2023-12-27 23:06:05,400][106225] Updated weights for policy 1, policy_version 538690 (0.0010) [2023-12-27 23:06:05,457][106225] Updated weights for policy 1, policy_version 538700 (0.0010) [2023-12-27 23:06:05,642][106226] Updated weights for policy 0, policy_version 537309 (0.0006) [2023-12-27 23:06:05,708][106226] Updated weights for policy 0, policy_version 537319 (0.0006) [2023-12-27 23:06:05,773][106226] Updated weights for policy 0, policy_version 537329 (0.0005) [2023-12-27 23:06:06,111][106225] Updated weights for policy 1, policy_version 538710 (0.0009) [2023-12-27 23:06:06,167][106225] Updated weights for policy 1, policy_version 538720 (0.0008) [2023-12-27 23:06:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 275529728. Throughput: 0: 10096.1, 1: 9933.8. Samples: 275543024. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:06,175][105115] Avg episode reward: [(0, '-5.169'), (1, '-5.605')] [2023-12-27 23:06:06,225][106225] Updated weights for policy 1, policy_version 538730 (0.0006) [2023-12-27 23:06:06,401][106226] Updated weights for policy 0, policy_version 537339 (0.0006) [2023-12-27 23:06:06,467][106226] Updated weights for policy 0, policy_version 537349 (0.0010) [2023-12-27 23:06:06,525][106226] Updated weights for policy 0, policy_version 537359 (0.0011) [2023-12-27 23:06:06,879][106225] Updated weights for policy 1, policy_version 538740 (0.0006) [2023-12-27 23:06:06,930][106225] Updated weights for policy 1, policy_version 538750 (0.0008) [2023-12-27 23:06:06,981][106225] Updated weights for policy 1, policy_version 538760 (0.0008) [2023-12-27 23:06:07,235][106226] Updated weights for policy 0, policy_version 537369 (0.0010) [2023-12-27 23:06:07,291][106226] Updated weights for policy 0, policy_version 537379 (0.0005) [2023-12-27 23:06:07,343][106226] Updated weights for policy 0, policy_version 537389 (0.0005) [2023-12-27 23:06:07,399][106226] Updated weights for policy 0, policy_version 537399 (0.0005) [2023-12-27 23:06:07,770][106225] Updated weights for policy 1, policy_version 538770 (0.0008) [2023-12-27 23:06:07,829][106225] Updated weights for policy 1, policy_version 538780 (0.0007) [2023-12-27 23:06:07,883][106225] Updated weights for policy 1, policy_version 538790 (0.0008) [2023-12-27 23:06:07,936][106225] Updated weights for policy 1, policy_version 538800 (0.0008) [2023-12-27 23:06:08,062][106226] Updated weights for policy 0, policy_version 537409 (0.0006) [2023-12-27 23:06:08,118][106226] Updated weights for policy 0, policy_version 537419 (0.0009) [2023-12-27 23:06:08,168][106226] Updated weights for policy 0, policy_version 537429 (0.0011) [2023-12-27 23:06:08,678][106225] Updated weights for policy 1, policy_version 538810 (0.0008) [2023-12-27 23:06:08,723][106225] Updated weights for policy 1, policy_version 538820 (0.0008) [2023-12-27 23:06:08,770][106225] Updated weights for policy 1, policy_version 538830 (0.0007) [2023-12-27 23:06:08,864][106226] Updated weights for policy 0, policy_version 537439 (0.0007) [2023-12-27 23:06:08,922][106226] Updated weights for policy 0, policy_version 537449 (0.0006) [2023-12-27 23:06:08,973][106226] Updated weights for policy 0, policy_version 537459 (0.0006) [2023-12-27 23:06:09,671][106225] Updated weights for policy 1, policy_version 538840 (0.0009) [2023-12-27 23:06:09,698][106226] Updated weights for policy 0, policy_version 537469 (0.0008) [2023-12-27 23:06:09,738][106225] Updated weights for policy 1, policy_version 538850 (0.0007) [2023-12-27 23:06:09,768][106226] Updated weights for policy 0, policy_version 537479 (0.0006) [2023-12-27 23:06:09,805][106225] Updated weights for policy 1, policy_version 538860 (0.0009) [2023-12-27 23:06:09,862][106226] Updated weights for policy 0, policy_version 537489 (0.0008) [2023-12-27 23:06:10,558][106226] Updated weights for policy 0, policy_version 537499 (0.0008) [2023-12-27 23:06:10,599][106225] Updated weights for policy 1, policy_version 538870 (0.0010) [2023-12-27 23:06:10,619][106226] Updated weights for policy 0, policy_version 537509 (0.0008) [2023-12-27 23:06:10,669][106225] Updated weights for policy 1, policy_version 538880 (0.0008) [2023-12-27 23:06:10,687][106226] Updated weights for policy 0, policy_version 537519 (0.0006) [2023-12-27 23:06:10,740][106225] Updated weights for policy 1, policy_version 538890 (0.0006) [2023-12-27 23:06:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 275628032. Throughput: 0: 10098.6, 1: 9932.3. Samples: 275602220. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:11,175][105115] Avg episode reward: [(0, '-5.142'), (1, '-5.463')] [2023-12-27 23:06:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000538896_137986048.pth... [2023-12-27 23:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000537528_137641984.pth... [2023-12-27 23:06:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000537744_137691136.pth [2023-12-27 23:06:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000536376_137347072.pth [2023-12-27 23:06:11,432][106226] Updated weights for policy 0, policy_version 537529 (0.0008) [2023-12-27 23:06:11,486][106225] Updated weights for policy 1, policy_version 538900 (0.0008) [2023-12-27 23:06:11,499][106226] Updated weights for policy 0, policy_version 537539 (0.0008) [2023-12-27 23:06:11,546][106225] Updated weights for policy 1, policy_version 538910 (0.0007) [2023-12-27 23:06:11,566][106226] Updated weights for policy 0, policy_version 537549 (0.0008) [2023-12-27 23:06:11,597][106225] Updated weights for policy 1, policy_version 538920 (0.0007) [2023-12-27 23:06:11,641][106226] Updated weights for policy 0, policy_version 537559 (0.0008) [2023-12-27 23:06:12,353][106225] Updated weights for policy 1, policy_version 538930 (0.0007) [2023-12-27 23:06:12,383][106226] Updated weights for policy 0, policy_version 537569 (0.0010) [2023-12-27 23:06:12,418][106225] Updated weights for policy 1, policy_version 538940 (0.0007) [2023-12-27 23:06:12,445][106226] Updated weights for policy 0, policy_version 537579 (0.0007) [2023-12-27 23:06:12,476][106225] Updated weights for policy 1, policy_version 538950 (0.0008) [2023-12-27 23:06:12,508][106226] Updated weights for policy 0, policy_version 537589 (0.0006) [2023-12-27 23:06:12,537][106225] Updated weights for policy 1, policy_version 538960 (0.0007) [2023-12-27 23:06:13,231][106226] Updated weights for policy 0, policy_version 537599 (0.0010) [2023-12-27 23:06:13,260][106225] Updated weights for policy 1, policy_version 538970 (0.0006) [2023-12-27 23:06:13,291][106226] Updated weights for policy 0, policy_version 537609 (0.0011) [2023-12-27 23:06:13,321][106225] Updated weights for policy 1, policy_version 538980 (0.0008) [2023-12-27 23:06:13,346][106226] Updated weights for policy 0, policy_version 537619 (0.0011) [2023-12-27 23:06:13,384][106225] Updated weights for policy 1, policy_version 538990 (0.0006) [2023-12-27 23:06:14,067][106226] Updated weights for policy 0, policy_version 537629 (0.0011) [2023-12-27 23:06:14,112][106225] Updated weights for policy 1, policy_version 539000 (0.0009) [2023-12-27 23:06:14,120][106226] Updated weights for policy 0, policy_version 537639 (0.0010) [2023-12-27 23:06:14,164][106225] Updated weights for policy 1, policy_version 539010 (0.0007) [2023-12-27 23:06:14,174][106226] Updated weights for policy 0, policy_version 537649 (0.0010) [2023-12-27 23:06:14,214][106225] Updated weights for policy 1, policy_version 539020 (0.0005) [2023-12-27 23:06:14,807][106226] Updated weights for policy 0, policy_version 537659 (0.0011) [2023-12-27 23:06:14,870][106226] Updated weights for policy 0, policy_version 537669 (0.0011) [2023-12-27 23:06:14,934][106226] Updated weights for policy 0, policy_version 537679 (0.0007) [2023-12-27 23:06:14,991][106225] Updated weights for policy 1, policy_version 539030 (0.0008) [2023-12-27 23:06:15,055][106225] Updated weights for policy 1, policy_version 539040 (0.0009) [2023-12-27 23:06:15,125][106225] Updated weights for policy 1, policy_version 539050 (0.0008) [2023-12-27 23:06:15,661][106226] Updated weights for policy 0, policy_version 537689 (0.0010) [2023-12-27 23:06:15,719][106226] Updated weights for policy 0, policy_version 537699 (0.0011) [2023-12-27 23:06:15,776][106226] Updated weights for policy 0, policy_version 537709 (0.0010) [2023-12-27 23:06:15,832][106225] Updated weights for policy 1, policy_version 539060 (0.0008) [2023-12-27 23:06:15,841][106226] Updated weights for policy 0, policy_version 537719 (0.0007) [2023-12-27 23:06:15,890][106225] Updated weights for policy 1, policy_version 539070 (0.0007) [2023-12-27 23:06:15,945][106225] Updated weights for policy 1, policy_version 539080 (0.0007) [2023-12-27 23:06:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 275726336. Throughput: 0: 10042.6, 1: 9760.4. Samples: 275714504. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:16,175][105115] Avg episode reward: [(0, '-5.153'), (1, '-5.214')] [2023-12-27 23:06:16,462][106226] Updated weights for policy 0, policy_version 537729 (0.0008) [2023-12-27 23:06:16,529][106226] Updated weights for policy 0, policy_version 537739 (0.0009) [2023-12-27 23:06:16,576][106225] Updated weights for policy 1, policy_version 539090 (0.0008) [2023-12-27 23:06:16,589][106226] Updated weights for policy 0, policy_version 537749 (0.0009) [2023-12-27 23:06:16,633][106225] Updated weights for policy 1, policy_version 539100 (0.0005) [2023-12-27 23:06:16,680][106225] Updated weights for policy 1, policy_version 539110 (0.0006) [2023-12-27 23:06:16,736][106225] Updated weights for policy 1, policy_version 539120 (0.0008) [2023-12-27 23:06:17,326][106225] Updated weights for policy 1, policy_version 539130 (0.0008) [2023-12-27 23:06:17,345][106226] Updated weights for policy 0, policy_version 537759 (0.0009) [2023-12-27 23:06:17,390][106225] Updated weights for policy 1, policy_version 539140 (0.0008) [2023-12-27 23:06:17,396][106226] Updated weights for policy 0, policy_version 537769 (0.0007) [2023-12-27 23:06:17,453][106226] Updated weights for policy 0, policy_version 537779 (0.0006) [2023-12-27 23:06:17,453][106225] Updated weights for policy 1, policy_version 539150 (0.0008) [2023-12-27 23:06:18,019][106225] Updated weights for policy 1, policy_version 539160 (0.0007) [2023-12-27 23:06:18,072][106225] Updated weights for policy 1, policy_version 539170 (0.0009) [2023-12-27 23:06:18,134][106225] Updated weights for policy 1, policy_version 539180 (0.0008) [2023-12-27 23:06:18,184][106226] Updated weights for policy 0, policy_version 537789 (0.0009) [2023-12-27 23:06:18,240][106226] Updated weights for policy 0, policy_version 537799 (0.0008) [2023-12-27 23:06:18,295][106226] Updated weights for policy 0, policy_version 537809 (0.0009) [2023-12-27 23:06:18,800][106225] Updated weights for policy 1, policy_version 539190 (0.0008) [2023-12-27 23:06:18,857][106225] Updated weights for policy 1, policy_version 539200 (0.0007) [2023-12-27 23:06:18,923][106225] Updated weights for policy 1, policy_version 539210 (0.0005) [2023-12-27 23:06:19,043][106226] Updated weights for policy 0, policy_version 537819 (0.0009) [2023-12-27 23:06:19,092][106226] Updated weights for policy 0, policy_version 537829 (0.0010) [2023-12-27 23:06:19,144][106226] Updated weights for policy 0, policy_version 537839 (0.0005) [2023-12-27 23:06:19,633][106225] Updated weights for policy 1, policy_version 539220 (0.0007) [2023-12-27 23:06:19,693][106225] Updated weights for policy 1, policy_version 539230 (0.0009) [2023-12-27 23:06:19,753][106225] Updated weights for policy 1, policy_version 539240 (0.0008) [2023-12-27 23:06:19,895][106226] Updated weights for policy 0, policy_version 537849 (0.0006) [2023-12-27 23:06:19,955][106226] Updated weights for policy 0, policy_version 537859 (0.0009) [2023-12-27 23:06:20,007][106226] Updated weights for policy 0, policy_version 537869 (0.0009) [2023-12-27 23:06:20,068][106226] Updated weights for policy 0, policy_version 537879 (0.0009) [2023-12-27 23:06:20,534][106225] Updated weights for policy 1, policy_version 539250 (0.0008) [2023-12-27 23:06:20,612][106225] Updated weights for policy 1, policy_version 539260 (0.0008) [2023-12-27 23:06:20,661][106225] Updated weights for policy 1, policy_version 539270 (0.0008) [2023-12-27 23:06:20,723][106225] Updated weights for policy 1, policy_version 539280 (0.0008) [2023-12-27 23:06:20,846][106226] Updated weights for policy 0, policy_version 537889 (0.0008) [2023-12-27 23:06:20,909][106226] Updated weights for policy 0, policy_version 537899 (0.0009) [2023-12-27 23:06:20,967][106226] Updated weights for policy 0, policy_version 537909 (0.0009) [2023-12-27 23:06:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 275824640. Throughput: 0: 9861.8, 1: 9835.0. Samples: 275832508. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:21,175][105115] Avg episode reward: [(0, '-5.237'), (1, '-5.525')] [2023-12-27 23:06:21,476][106225] Updated weights for policy 1, policy_version 539290 (0.0010) [2023-12-27 23:06:21,527][106225] Updated weights for policy 1, policy_version 539300 (0.0010) [2023-12-27 23:06:21,585][106225] Updated weights for policy 1, policy_version 539310 (0.0010) [2023-12-27 23:06:21,746][106226] Updated weights for policy 0, policy_version 537919 (0.0008) [2023-12-27 23:06:21,804][106226] Updated weights for policy 0, policy_version 537929 (0.0008) [2023-12-27 23:06:21,860][106226] Updated weights for policy 0, policy_version 537939 (0.0008) [2023-12-27 23:06:22,374][106225] Updated weights for policy 1, policy_version 539320 (0.0010) [2023-12-27 23:06:22,435][106225] Updated weights for policy 1, policy_version 539330 (0.0010) [2023-12-27 23:06:22,487][106225] Updated weights for policy 1, policy_version 539340 (0.0010) [2023-12-27 23:06:22,647][106226] Updated weights for policy 0, policy_version 537949 (0.0008) [2023-12-27 23:06:22,705][106226] Updated weights for policy 0, policy_version 537959 (0.0008) [2023-12-27 23:06:22,756][106226] Updated weights for policy 0, policy_version 537969 (0.0009) [2023-12-27 23:06:23,177][106225] Updated weights for policy 1, policy_version 539350 (0.0010) [2023-12-27 23:06:23,238][106225] Updated weights for policy 1, policy_version 539360 (0.0010) [2023-12-27 23:06:23,308][106225] Updated weights for policy 1, policy_version 539370 (0.0008) [2023-12-27 23:06:23,463][106226] Updated weights for policy 0, policy_version 537979 (0.0011) [2023-12-27 23:06:23,516][106226] Updated weights for policy 0, policy_version 537989 (0.0007) [2023-12-27 23:06:23,581][106226] Updated weights for policy 0, policy_version 537999 (0.0007) [2023-12-27 23:06:23,937][106225] Updated weights for policy 1, policy_version 539380 (0.0007) [2023-12-27 23:06:23,983][106225] Updated weights for policy 1, policy_version 539390 (0.0010) [2023-12-27 23:06:24,046][106225] Updated weights for policy 1, policy_version 539400 (0.0008) [2023-12-27 23:06:24,340][106226] Updated weights for policy 0, policy_version 538009 (0.0008) [2023-12-27 23:06:24,400][106226] Updated weights for policy 0, policy_version 538019 (0.0007) [2023-12-27 23:06:24,470][106226] Updated weights for policy 0, policy_version 538029 (0.0010) [2023-12-27 23:06:24,521][106226] Updated weights for policy 0, policy_version 538039 (0.0011) [2023-12-27 23:06:24,708][106225] Updated weights for policy 1, policy_version 539410 (0.0007) [2023-12-27 23:06:24,775][106225] Updated weights for policy 1, policy_version 539420 (0.0010) [2023-12-27 23:06:24,839][106225] Updated weights for policy 1, policy_version 539430 (0.0010) [2023-12-27 23:06:24,899][106225] Updated weights for policy 1, policy_version 539440 (0.0010) [2023-12-27 23:06:25,179][106226] Updated weights for policy 0, policy_version 538049 (0.0008) [2023-12-27 23:06:25,233][106226] Updated weights for policy 0, policy_version 538059 (0.0008) [2023-12-27 23:06:25,276][106226] Updated weights for policy 0, policy_version 538069 (0.0008) [2023-12-27 23:06:25,581][106225] Updated weights for policy 1, policy_version 539450 (0.0005) [2023-12-27 23:06:25,641][106225] Updated weights for policy 1, policy_version 539460 (0.0005) [2023-12-27 23:06:25,696][106225] Updated weights for policy 1, policy_version 539470 (0.0005) [2023-12-27 23:06:26,013][106226] Updated weights for policy 0, policy_version 538079 (0.0006) [2023-12-27 23:06:26,063][106226] Updated weights for policy 0, policy_version 538089 (0.0005) [2023-12-27 23:06:26,120][106226] Updated weights for policy 0, policy_version 538099 (0.0005) [2023-12-27 23:06:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 275922944. Throughput: 0: 9843.0, 1: 9798.4. Samples: 275889544. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:26,176][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.531')] [2023-12-27 23:06:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000539472_138133504.pth... [2023-12-27 23:06:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000538104_137789440.pth... [2023-12-27 23:06:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000536952_137494528.pth [2023-12-27 23:06:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000538320_137838592.pth [2023-12-27 23:06:26,257][106225] Updated weights for policy 1, policy_version 539480 (0.0005) [2023-12-27 23:06:26,303][106225] Updated weights for policy 1, policy_version 539490 (0.0005) [2023-12-27 23:06:26,354][106225] Updated weights for policy 1, policy_version 539500 (0.0009) [2023-12-27 23:06:26,788][106226] Updated weights for policy 0, policy_version 538109 (0.0007) [2023-12-27 23:06:26,842][106226] Updated weights for policy 0, policy_version 538119 (0.0008) [2023-12-27 23:06:26,903][106226] Updated weights for policy 0, policy_version 538129 (0.0007) [2023-12-27 23:06:27,021][106225] Updated weights for policy 1, policy_version 539510 (0.0010) [2023-12-27 23:06:27,090][106225] Updated weights for policy 1, policy_version 539520 (0.0010) [2023-12-27 23:06:27,142][106225] Updated weights for policy 1, policy_version 539530 (0.0010) [2023-12-27 23:06:27,562][106226] Updated weights for policy 0, policy_version 538139 (0.0008) [2023-12-27 23:06:27,616][106226] Updated weights for policy 0, policy_version 538149 (0.0008) [2023-12-27 23:06:27,671][106226] Updated weights for policy 0, policy_version 538159 (0.0006) [2023-12-27 23:06:27,823][106225] Updated weights for policy 1, policy_version 539540 (0.0009) [2023-12-27 23:06:27,878][106225] Updated weights for policy 1, policy_version 539550 (0.0007) [2023-12-27 23:06:27,927][106225] Updated weights for policy 1, policy_version 539560 (0.0006) [2023-12-27 23:06:28,374][106226] Updated weights for policy 0, policy_version 538169 (0.0008) [2023-12-27 23:06:28,432][106226] Updated weights for policy 0, policy_version 538179 (0.0009) [2023-12-27 23:06:28,481][106226] Updated weights for policy 0, policy_version 538189 (0.0008) [2023-12-27 23:06:28,522][106225] Updated weights for policy 1, policy_version 539570 (0.0009) [2023-12-27 23:06:28,543][106226] Updated weights for policy 0, policy_version 538199 (0.0007) [2023-12-27 23:06:28,583][106225] Updated weights for policy 1, policy_version 539580 (0.0009) [2023-12-27 23:06:28,648][106225] Updated weights for policy 1, policy_version 539590 (0.0010) [2023-12-27 23:06:28,706][106225] Updated weights for policy 1, policy_version 539600 (0.0010) [2023-12-27 23:06:29,309][106226] Updated weights for policy 0, policy_version 538209 (0.0008) [2023-12-27 23:06:29,383][106226] Updated weights for policy 0, policy_version 538219 (0.0007) [2023-12-27 23:06:29,445][106226] Updated weights for policy 0, policy_version 538229 (0.0007) [2023-12-27 23:06:29,463][106225] Updated weights for policy 1, policy_version 539610 (0.0011) [2023-12-27 23:06:29,529][106225] Updated weights for policy 1, policy_version 539620 (0.0011) [2023-12-27 23:06:29,596][106225] Updated weights for policy 1, policy_version 539630 (0.0010) [2023-12-27 23:06:30,133][106226] Updated weights for policy 0, policy_version 538239 (0.0007) [2023-12-27 23:06:30,192][106226] Updated weights for policy 0, policy_version 538249 (0.0007) [2023-12-27 23:06:30,250][106226] Updated weights for policy 0, policy_version 538259 (0.0008) [2023-12-27 23:06:30,306][106225] Updated weights for policy 1, policy_version 539640 (0.0010) [2023-12-27 23:06:30,359][106225] Updated weights for policy 1, policy_version 539650 (0.0010) [2023-12-27 23:06:30,417][106225] Updated weights for policy 1, policy_version 539660 (0.0010) [2023-12-27 23:06:30,924][106226] Updated weights for policy 0, policy_version 538269 (0.0007) [2023-12-27 23:06:30,977][106226] Updated weights for policy 0, policy_version 538279 (0.0008) [2023-12-27 23:06:31,022][106226] Updated weights for policy 0, policy_version 538289 (0.0008) [2023-12-27 23:06:31,106][106225] Updated weights for policy 1, policy_version 539670 (0.0009) [2023-12-27 23:06:31,172][106225] Updated weights for policy 1, policy_version 539680 (0.0009) [2023-12-27 23:06:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 276021248. Throughput: 0: 9817.6, 1: 9918.7. Samples: 276011100. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-27 23:06:31,175][105115] Avg episode reward: [(0, '-5.092'), (1, '-5.541')] [2023-12-27 23:06:31,228][106225] Updated weights for policy 1, policy_version 539690 (0.0009) [2023-12-27 23:06:31,676][106226] Updated weights for policy 0, policy_version 538299 (0.0006) [2023-12-27 23:06:31,736][106226] Updated weights for policy 0, policy_version 538309 (0.0007) [2023-12-27 23:06:31,796][106226] Updated weights for policy 0, policy_version 538319 (0.0008) [2023-12-27 23:06:32,030][106225] Updated weights for policy 1, policy_version 539700 (0.0008) [2023-12-27 23:06:32,085][106225] Updated weights for policy 1, policy_version 539710 (0.0009) [2023-12-27 23:06:32,142][106225] Updated weights for policy 1, policy_version 539720 (0.0008) [2023-12-27 23:06:32,509][106226] Updated weights for policy 0, policy_version 538329 (0.0008) [2023-12-27 23:06:32,574][106226] Updated weights for policy 0, policy_version 538339 (0.0007) [2023-12-27 23:06:32,633][106226] Updated weights for policy 0, policy_version 538349 (0.0007) [2023-12-27 23:06:32,693][106226] Updated weights for policy 0, policy_version 538359 (0.0008) [2023-12-27 23:06:32,907][106225] Updated weights for policy 1, policy_version 539730 (0.0009) [2023-12-27 23:06:32,956][106225] Updated weights for policy 1, policy_version 539740 (0.0010) [2023-12-27 23:06:33,009][106225] Updated weights for policy 1, policy_version 539750 (0.0010) [2023-12-27 23:06:33,058][106225] Updated weights for policy 1, policy_version 539760 (0.0010) [2023-12-27 23:06:33,426][106226] Updated weights for policy 0, policy_version 538369 (0.0008) [2023-12-27 23:06:33,482][106226] Updated weights for policy 0, policy_version 538379 (0.0006) [2023-12-27 23:06:33,539][106226] Updated weights for policy 0, policy_version 538389 (0.0005) [2023-12-27 23:06:33,731][106225] Updated weights for policy 1, policy_version 539770 (0.0010) [2023-12-27 23:06:33,787][106225] Updated weights for policy 1, policy_version 539780 (0.0010) [2023-12-27 23:06:33,839][106225] Updated weights for policy 1, policy_version 539790 (0.0010) [2023-12-27 23:06:34,090][106226] Updated weights for policy 0, policy_version 538399 (0.0009) [2023-12-27 23:06:34,137][106226] Updated weights for policy 0, policy_version 538409 (0.0010) [2023-12-27 23:06:34,204][106226] Updated weights for policy 0, policy_version 538419 (0.0009) [2023-12-27 23:06:34,482][106225] Updated weights for policy 1, policy_version 539800 (0.0007) [2023-12-27 23:06:34,549][106225] Updated weights for policy 1, policy_version 539810 (0.0007) [2023-12-27 23:06:34,608][106225] Updated weights for policy 1, policy_version 539820 (0.0008) [2023-12-27 23:06:34,937][106226] Updated weights for policy 0, policy_version 538429 (0.0009) [2023-12-27 23:06:34,991][106226] Updated weights for policy 0, policy_version 538439 (0.0008) [2023-12-27 23:06:35,044][106226] Updated weights for policy 0, policy_version 538449 (0.0009) [2023-12-27 23:06:35,257][106225] Updated weights for policy 1, policy_version 539830 (0.0009) [2023-12-27 23:06:35,305][106225] Updated weights for policy 1, policy_version 539840 (0.0008) [2023-12-27 23:06:35,359][106225] Updated weights for policy 1, policy_version 539850 (0.0005) [2023-12-27 23:06:35,781][106226] Updated weights for policy 0, policy_version 538459 (0.0009) [2023-12-27 23:06:35,832][106226] Updated weights for policy 0, policy_version 538469 (0.0008) [2023-12-27 23:06:35,889][106226] Updated weights for policy 0, policy_version 538479 (0.0009) [2023-12-27 23:06:35,944][106225] Updated weights for policy 1, policy_version 539860 (0.0006) [2023-12-27 23:06:36,005][106225] Updated weights for policy 1, policy_version 539870 (0.0008) [2023-12-27 23:06:36,064][106225] Updated weights for policy 1, policy_version 539880 (0.0009) [2023-12-27 23:06:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 276127744. Throughput: 0: 9835.1, 1: 9948.3. Samples: 276132396. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:06:36,175][105115] Avg episode reward: [(0, '-5.227'), (1, '-5.685')] [2023-12-27 23:06:36,489][106226] Updated weights for policy 0, policy_version 538489 (0.0007) [2023-12-27 23:06:36,558][106226] Updated weights for policy 0, policy_version 538499 (0.0007) [2023-12-27 23:06:36,611][106226] Updated weights for policy 0, policy_version 538509 (0.0006) [2023-12-27 23:06:36,660][106226] Updated weights for policy 0, policy_version 538519 (0.0008) [2023-12-27 23:06:36,828][106225] Updated weights for policy 1, policy_version 539890 (0.0008) [2023-12-27 23:06:36,886][106225] Updated weights for policy 1, policy_version 539900 (0.0005) [2023-12-27 23:06:36,943][106225] Updated weights for policy 1, policy_version 539910 (0.0007) [2023-12-27 23:06:37,013][106225] Updated weights for policy 1, policy_version 539920 (0.0005) [2023-12-27 23:06:37,329][106226] Updated weights for policy 0, policy_version 538529 (0.0006) [2023-12-27 23:06:37,394][106226] Updated weights for policy 0, policy_version 538539 (0.0005) [2023-12-27 23:06:37,463][106226] Updated weights for policy 0, policy_version 538549 (0.0006) [2023-12-27 23:06:37,646][106225] Updated weights for policy 1, policy_version 539930 (0.0010) [2023-12-27 23:06:37,710][106225] Updated weights for policy 1, policy_version 539940 (0.0010) [2023-12-27 23:06:37,773][106225] Updated weights for policy 1, policy_version 539950 (0.0010) [2023-12-27 23:06:38,033][106226] Updated weights for policy 0, policy_version 538559 (0.0009) [2023-12-27 23:06:38,090][106226] Updated weights for policy 0, policy_version 538569 (0.0010) [2023-12-27 23:06:38,147][106226] Updated weights for policy 0, policy_version 538579 (0.0010) [2023-12-27 23:06:38,360][106225] Updated weights for policy 1, policy_version 539960 (0.0010) [2023-12-27 23:06:38,424][106225] Updated weights for policy 1, policy_version 539970 (0.0010) [2023-12-27 23:06:38,484][106225] Updated weights for policy 1, policy_version 539980 (0.0010) [2023-12-27 23:06:38,877][106226] Updated weights for policy 0, policy_version 538589 (0.0009) [2023-12-27 23:06:38,936][106226] Updated weights for policy 0, policy_version 538599 (0.0008) [2023-12-27 23:06:38,997][106226] Updated weights for policy 0, policy_version 538609 (0.0008) [2023-12-27 23:06:39,138][106225] Updated weights for policy 1, policy_version 539990 (0.0008) [2023-12-27 23:06:39,185][106225] Updated weights for policy 1, policy_version 540000 (0.0005) [2023-12-27 23:06:39,253][106225] Updated weights for policy 1, policy_version 540010 (0.0007) [2023-12-27 23:06:39,739][106226] Updated weights for policy 0, policy_version 538619 (0.0010) [2023-12-27 23:06:39,804][106226] Updated weights for policy 0, policy_version 538629 (0.0010) [2023-12-27 23:06:39,873][106226] Updated weights for policy 0, policy_version 538639 (0.0011) [2023-12-27 23:06:40,003][106225] Updated weights for policy 1, policy_version 540020 (0.0007) [2023-12-27 23:06:40,068][106225] Updated weights for policy 1, policy_version 540030 (0.0006) [2023-12-27 23:06:40,133][106225] Updated weights for policy 1, policy_version 540040 (0.0006) [2023-12-27 23:06:40,544][106226] Updated weights for policy 0, policy_version 538649 (0.0011) [2023-12-27 23:06:40,611][106226] Updated weights for policy 0, policy_version 538659 (0.0009) [2023-12-27 23:06:40,674][106226] Updated weights for policy 0, policy_version 538669 (0.0009) [2023-12-27 23:06:40,741][106226] Updated weights for policy 0, policy_version 538679 (0.0008) [2023-12-27 23:06:40,816][106225] Updated weights for policy 1, policy_version 540050 (0.0008) [2023-12-27 23:06:40,874][106225] Updated weights for policy 1, policy_version 540060 (0.0008) [2023-12-27 23:06:40,933][106225] Updated weights for policy 1, policy_version 540070 (0.0010) [2023-12-27 23:06:40,993][106225] Updated weights for policy 1, policy_version 540080 (0.0006) [2023-12-27 23:06:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 276226048. Throughput: 0: 9902.7, 1: 9986.5. Samples: 276194136. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:06:41,176][105115] Avg episode reward: [(0, '-5.088'), (1, '-5.391')] [2023-12-27 23:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000540080_138289152.pth... [2023-12-27 23:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000538680_137936896.pth... [2023-12-27 23:06:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000537528_137641984.pth [2023-12-27 23:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000538896_137986048.pth [2023-12-27 23:06:41,563][106226] Updated weights for policy 0, policy_version 538689 (0.0008) [2023-12-27 23:06:41,626][106226] Updated weights for policy 0, policy_version 538699 (0.0009) [2023-12-27 23:06:41,692][106226] Updated weights for policy 0, policy_version 538709 (0.0007) [2023-12-27 23:06:41,761][106225] Updated weights for policy 1, policy_version 540090 (0.0008) [2023-12-27 23:06:41,834][106225] Updated weights for policy 1, policy_version 540100 (0.0010) [2023-12-27 23:06:41,900][106225] Updated weights for policy 1, policy_version 540110 (0.0009) [2023-12-27 23:06:42,300][106226] Updated weights for policy 0, policy_version 538719 (0.0008) [2023-12-27 23:06:42,361][106226] Updated weights for policy 0, policy_version 538729 (0.0008) [2023-12-27 23:06:42,434][106226] Updated weights for policy 0, policy_version 538739 (0.0008) [2023-12-27 23:06:42,734][106225] Updated weights for policy 1, policy_version 540120 (0.0006) [2023-12-27 23:06:42,800][106225] Updated weights for policy 1, policy_version 540130 (0.0005) [2023-12-27 23:06:42,863][106225] Updated weights for policy 1, policy_version 540140 (0.0006) [2023-12-27 23:06:43,077][106226] Updated weights for policy 0, policy_version 538749 (0.0007) [2023-12-27 23:06:43,128][106226] Updated weights for policy 0, policy_version 538759 (0.0005) [2023-12-27 23:06:43,184][106226] Updated weights for policy 0, policy_version 538769 (0.0005) [2023-12-27 23:06:43,573][106225] Updated weights for policy 1, policy_version 540150 (0.0009) [2023-12-27 23:06:43,623][106225] Updated weights for policy 1, policy_version 540160 (0.0009) [2023-12-27 23:06:43,685][106225] Updated weights for policy 1, policy_version 540170 (0.0010) [2023-12-27 23:06:43,790][106226] Updated weights for policy 0, policy_version 538779 (0.0007) [2023-12-27 23:06:43,841][106226] Updated weights for policy 0, policy_version 538789 (0.0005) [2023-12-27 23:06:43,901][106226] Updated weights for policy 0, policy_version 538799 (0.0005) [2023-12-27 23:06:44,479][106226] Updated weights for policy 0, policy_version 538809 (0.0006) [2023-12-27 23:06:44,507][106225] Updated weights for policy 1, policy_version 540180 (0.0009) [2023-12-27 23:06:44,535][106226] Updated weights for policy 0, policy_version 538819 (0.0007) [2023-12-27 23:06:44,575][106225] Updated weights for policy 1, policy_version 540190 (0.0008) [2023-12-27 23:06:44,584][106226] Updated weights for policy 0, policy_version 538829 (0.0005) [2023-12-27 23:06:44,626][106225] Updated weights for policy 1, policy_version 540200 (0.0007) [2023-12-27 23:06:44,632][106226] Updated weights for policy 0, policy_version 538839 (0.0007) [2023-12-27 23:06:45,343][106225] Updated weights for policy 1, policy_version 540210 (0.0008) [2023-12-27 23:06:45,367][106226] Updated weights for policy 0, policy_version 538849 (0.0007) [2023-12-27 23:06:45,404][106225] Updated weights for policy 1, policy_version 540220 (0.0008) [2023-12-27 23:06:45,427][106226] Updated weights for policy 0, policy_version 538859 (0.0008) [2023-12-27 23:06:45,464][106225] Updated weights for policy 1, policy_version 540230 (0.0009) [2023-12-27 23:06:45,489][106226] Updated weights for policy 0, policy_version 538869 (0.0006) [2023-12-27 23:06:45,530][106225] Updated weights for policy 1, policy_version 540240 (0.0008) [2023-12-27 23:06:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 276316160. Throughput: 0: 9947.3, 1: 9818.6. Samples: 276310464. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:06:46,175][105115] Avg episode reward: [(0, '-4.999'), (1, '-5.352')] [2023-12-27 23:06:46,221][106225] Updated weights for policy 1, policy_version 540250 (0.0009) [2023-12-27 23:06:46,232][106226] Updated weights for policy 0, policy_version 538879 (0.0007) [2023-12-27 23:06:46,283][106225] Updated weights for policy 1, policy_version 540260 (0.0010) [2023-12-27 23:06:46,300][106226] Updated weights for policy 0, policy_version 538889 (0.0006) [2023-12-27 23:06:46,346][106225] Updated weights for policy 1, policy_version 540270 (0.0010) [2023-12-27 23:06:46,360][106226] Updated weights for policy 0, policy_version 538899 (0.0006) [2023-12-27 23:06:46,924][106226] Updated weights for policy 0, policy_version 538909 (0.0008) [2023-12-27 23:06:46,971][106225] Updated weights for policy 1, policy_version 540280 (0.0010) [2023-12-27 23:06:46,982][106226] Updated weights for policy 0, policy_version 538919 (0.0010) [2023-12-27 23:06:47,028][106225] Updated weights for policy 1, policy_version 540290 (0.0010) [2023-12-27 23:06:47,042][106226] Updated weights for policy 0, policy_version 538929 (0.0010) [2023-12-27 23:06:47,086][106225] Updated weights for policy 1, policy_version 540300 (0.0010) [2023-12-27 23:06:47,735][106226] Updated weights for policy 0, policy_version 538939 (0.0009) [2023-12-27 23:06:47,784][106226] Updated weights for policy 0, policy_version 538949 (0.0007) [2023-12-27 23:06:47,795][106225] Updated weights for policy 1, policy_version 540310 (0.0010) [2023-12-27 23:06:47,832][106226] Updated weights for policy 0, policy_version 538959 (0.0006) [2023-12-27 23:06:47,848][106225] Updated weights for policy 1, policy_version 540320 (0.0008) [2023-12-27 23:06:47,908][106225] Updated weights for policy 1, policy_version 540330 (0.0005) [2023-12-27 23:06:48,442][106226] Updated weights for policy 0, policy_version 538969 (0.0006) [2023-12-27 23:06:48,504][106226] Updated weights for policy 0, policy_version 538979 (0.0005) [2023-12-27 23:06:48,562][106226] Updated weights for policy 0, policy_version 538989 (0.0006) [2023-12-27 23:06:48,622][106226] Updated weights for policy 0, policy_version 538999 (0.0010) [2023-12-27 23:06:48,626][106225] Updated weights for policy 1, policy_version 540340 (0.0008) [2023-12-27 23:06:48,680][106225] Updated weights for policy 1, policy_version 540350 (0.0010) [2023-12-27 23:06:48,744][106225] Updated weights for policy 1, policy_version 540360 (0.0011) [2023-12-27 23:06:49,245][106226] Updated weights for policy 0, policy_version 539009 (0.0010) [2023-12-27 23:06:49,307][106226] Updated weights for policy 0, policy_version 539019 (0.0010) [2023-12-27 23:06:49,374][106226] Updated weights for policy 0, policy_version 539029 (0.0011) [2023-12-27 23:06:49,505][106225] Updated weights for policy 1, policy_version 540370 (0.0010) [2023-12-27 23:06:49,568][106225] Updated weights for policy 1, policy_version 540380 (0.0008) [2023-12-27 23:06:49,628][106225] Updated weights for policy 1, policy_version 540390 (0.0008) [2023-12-27 23:06:49,679][106225] Updated weights for policy 1, policy_version 540400 (0.0006) [2023-12-27 23:06:50,088][106226] Updated weights for policy 0, policy_version 539039 (0.0007) [2023-12-27 23:06:50,150][106226] Updated weights for policy 0, policy_version 539049 (0.0005) [2023-12-27 23:06:50,224][106226] Updated weights for policy 0, policy_version 539059 (0.0006) [2023-12-27 23:06:50,385][106225] Updated weights for policy 1, policy_version 540410 (0.0006) [2023-12-27 23:06:50,456][106225] Updated weights for policy 1, policy_version 540420 (0.0008) [2023-12-27 23:06:50,520][106225] Updated weights for policy 1, policy_version 540430 (0.0011) [2023-12-27 23:06:50,883][106226] Updated weights for policy 0, policy_version 539069 (0.0008) [2023-12-27 23:06:50,944][106226] Updated weights for policy 0, policy_version 539079 (0.0009) [2023-12-27 23:06:51,005][106226] Updated weights for policy 0, policy_version 539089 (0.0008) [2023-12-27 23:06:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 276422656. Throughput: 0: 9919.5, 1: 9819.3. Samples: 276431268. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:06:51,175][105115] Avg episode reward: [(0, '-5.327'), (1, '-5.084')] [2023-12-27 23:06:51,211][106225] Updated weights for policy 1, policy_version 540440 (0.0010) [2023-12-27 23:06:51,274][106225] Updated weights for policy 1, policy_version 540450 (0.0008) [2023-12-27 23:06:51,335][106225] Updated weights for policy 1, policy_version 540460 (0.0006) [2023-12-27 23:06:51,660][106226] Updated weights for policy 0, policy_version 539099 (0.0007) [2023-12-27 23:06:51,723][106226] Updated weights for policy 0, policy_version 539109 (0.0008) [2023-12-27 23:06:51,796][106226] Updated weights for policy 0, policy_version 539119 (0.0007) [2023-12-27 23:06:52,073][106225] Updated weights for policy 1, policy_version 540470 (0.0006) [2023-12-27 23:06:52,132][106225] Updated weights for policy 1, policy_version 540480 (0.0005) [2023-12-27 23:06:52,193][106225] Updated weights for policy 1, policy_version 540490 (0.0006) [2023-12-27 23:06:52,516][106226] Updated weights for policy 0, policy_version 539129 (0.0006) [2023-12-27 23:06:52,576][106226] Updated weights for policy 0, policy_version 539139 (0.0009) [2023-12-27 23:06:52,641][106226] Updated weights for policy 0, policy_version 539149 (0.0009) [2023-12-27 23:06:52,708][106226] Updated weights for policy 0, policy_version 539159 (0.0009) [2023-12-27 23:06:52,853][106225] Updated weights for policy 1, policy_version 540500 (0.0007) [2023-12-27 23:06:52,915][106225] Updated weights for policy 1, policy_version 540510 (0.0009) [2023-12-27 23:06:52,963][106225] Updated weights for policy 1, policy_version 540520 (0.0008) [2023-12-27 23:06:53,436][106226] Updated weights for policy 0, policy_version 539169 (0.0008) [2023-12-27 23:06:53,492][106226] Updated weights for policy 0, policy_version 539179 (0.0007) [2023-12-27 23:06:53,548][106226] Updated weights for policy 0, policy_version 539189 (0.0005) [2023-12-27 23:06:53,702][106225] Updated weights for policy 1, policy_version 540530 (0.0008) [2023-12-27 23:06:53,759][106225] Updated weights for policy 1, policy_version 540540 (0.0008) [2023-12-27 23:06:53,815][106225] Updated weights for policy 1, policy_version 540550 (0.0008) [2023-12-27 23:06:53,869][106225] Updated weights for policy 1, policy_version 540560 (0.0008) [2023-12-27 23:06:54,155][106226] Updated weights for policy 0, policy_version 539199 (0.0007) [2023-12-27 23:06:54,206][106226] Updated weights for policy 0, policy_version 539209 (0.0005) [2023-12-27 23:06:54,263][106226] Updated weights for policy 0, policy_version 539219 (0.0006) [2023-12-27 23:06:54,623][106225] Updated weights for policy 1, policy_version 540570 (0.0007) [2023-12-27 23:06:54,685][106225] Updated weights for policy 1, policy_version 540580 (0.0008) [2023-12-27 23:06:54,746][106225] Updated weights for policy 1, policy_version 540590 (0.0009) [2023-12-27 23:06:54,949][106226] Updated weights for policy 0, policy_version 539229 (0.0007) [2023-12-27 23:06:55,010][106226] Updated weights for policy 0, policy_version 539239 (0.0008) [2023-12-27 23:06:55,075][106226] Updated weights for policy 0, policy_version 539249 (0.0008) [2023-12-27 23:06:55,536][106225] Updated weights for policy 1, policy_version 540600 (0.0009) [2023-12-27 23:06:55,590][106225] Updated weights for policy 1, policy_version 540610 (0.0009) [2023-12-27 23:06:55,621][106226] Updated weights for policy 0, policy_version 539259 (0.0006) [2023-12-27 23:06:55,639][106225] Updated weights for policy 1, policy_version 540620 (0.0007) [2023-12-27 23:06:55,674][106226] Updated weights for policy 0, policy_version 539269 (0.0007) [2023-12-27 23:06:55,737][106226] Updated weights for policy 0, policy_version 539279 (0.0006) [2023-12-27 23:06:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 276520960. Throughput: 0: 9925.1, 1: 9817.6. Samples: 276490640. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:06:56,175][105115] Avg episode reward: [(0, '-5.009'), (1, '-5.396')] [2023-12-27 23:06:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000539288_138092544.pth... [2023-12-27 23:06:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000540624_138428416.pth... [2023-12-27 23:06:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000538104_137789440.pth [2023-12-27 23:06:56,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000539472_138133504.pth [2023-12-27 23:06:56,388][106225] Updated weights for policy 1, policy_version 540630 (0.0007) [2023-12-27 23:06:56,426][106226] Updated weights for policy 0, policy_version 539289 (0.0009) [2023-12-27 23:06:56,448][106225] Updated weights for policy 1, policy_version 540640 (0.0005) [2023-12-27 23:06:56,483][106226] Updated weights for policy 0, policy_version 539299 (0.0008) [2023-12-27 23:06:56,508][106225] Updated weights for policy 1, policy_version 540650 (0.0005) [2023-12-27 23:06:56,532][106226] Updated weights for policy 0, policy_version 539309 (0.0009) [2023-12-27 23:06:56,586][106226] Updated weights for policy 0, policy_version 539320 (0.0010) [2023-12-27 23:06:57,197][106225] Updated weights for policy 1, policy_version 540660 (0.0006) [2023-12-27 23:06:57,249][106226] Updated weights for policy 0, policy_version 539330 (0.0010) [2023-12-27 23:06:57,250][106225] Updated weights for policy 1, policy_version 540670 (0.0006) [2023-12-27 23:06:57,300][106225] Updated weights for policy 1, policy_version 540680 (0.0005) [2023-12-27 23:06:57,302][106226] Updated weights for policy 0, policy_version 539340 (0.0010) [2023-12-27 23:06:57,355][106226] Updated weights for policy 0, policy_version 539350 (0.0008) [2023-12-27 23:06:57,937][106225] Updated weights for policy 1, policy_version 540690 (0.0005) [2023-12-27 23:06:57,992][106225] Updated weights for policy 1, policy_version 540700 (0.0005) [2023-12-27 23:06:58,050][106225] Updated weights for policy 1, policy_version 540710 (0.0008) [2023-12-27 23:06:58,088][106226] Updated weights for policy 0, policy_version 539360 (0.0007) [2023-12-27 23:06:58,106][106225] Updated weights for policy 1, policy_version 540720 (0.0007) [2023-12-27 23:06:58,136][106226] Updated weights for policy 0, policy_version 539370 (0.0008) [2023-12-27 23:06:58,180][106226] Updated weights for policy 0, policy_version 539380 (0.0008) [2023-12-27 23:06:58,954][106225] Updated weights for policy 1, policy_version 540730 (0.0007) [2023-12-27 23:06:59,022][106225] Updated weights for policy 1, policy_version 540740 (0.0007) [2023-12-27 23:06:59,024][106226] Updated weights for policy 0, policy_version 539390 (0.0008) [2023-12-27 23:06:59,077][106225] Updated weights for policy 1, policy_version 540750 (0.0007) [2023-12-27 23:06:59,083][106226] Updated weights for policy 0, policy_version 539400 (0.0007) [2023-12-27 23:06:59,139][106226] Updated weights for policy 0, policy_version 539410 (0.0008) [2023-12-27 23:06:59,831][106225] Updated weights for policy 1, policy_version 540760 (0.0007) [2023-12-27 23:06:59,900][106225] Updated weights for policy 1, policy_version 540770 (0.0008) [2023-12-27 23:06:59,950][106226] Updated weights for policy 0, policy_version 539420 (0.0009) [2023-12-27 23:06:59,966][106225] Updated weights for policy 1, policy_version 540780 (0.0008) [2023-12-27 23:07:00,007][106226] Updated weights for policy 0, policy_version 539430 (0.0007) [2023-12-27 23:07:00,078][106226] Updated weights for policy 0, policy_version 539440 (0.0008) [2023-12-27 23:07:00,649][106225] Updated weights for policy 1, policy_version 540790 (0.0008) [2023-12-27 23:07:00,667][106226] Updated weights for policy 0, policy_version 539450 (0.0006) [2023-12-27 23:07:00,700][106225] Updated weights for policy 1, policy_version 540800 (0.0005) [2023-12-27 23:07:00,732][106226] Updated weights for policy 0, policy_version 539460 (0.0010) [2023-12-27 23:07:00,750][106225] Updated weights for policy 1, policy_version 540810 (0.0006) [2023-12-27 23:07:00,788][106226] Updated weights for policy 0, policy_version 539470 (0.0010) [2023-12-27 23:07:00,842][106226] Updated weights for policy 0, policy_version 539480 (0.0010) [2023-12-27 23:07:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 276619264. Throughput: 0: 9974.4, 1: 9867.8. Samples: 276607404. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:01,175][105115] Avg episode reward: [(0, '-5.135'), (1, '-5.504')] [2023-12-27 23:07:01,506][106225] Updated weights for policy 1, policy_version 540820 (0.0007) [2023-12-27 23:07:01,556][106226] Updated weights for policy 0, policy_version 539490 (0.0008) [2023-12-27 23:07:01,560][106225] Updated weights for policy 1, policy_version 540830 (0.0005) [2023-12-27 23:07:01,616][106225] Updated weights for policy 1, policy_version 540840 (0.0006) [2023-12-27 23:07:01,639][106226] Updated weights for policy 0, policy_version 539500 (0.0008) [2023-12-27 23:07:01,703][106226] Updated weights for policy 0, policy_version 539510 (0.0007) [2023-12-27 23:07:02,196][106225] Updated weights for policy 1, policy_version 540850 (0.0008) [2023-12-27 23:07:02,255][106225] Updated weights for policy 1, policy_version 540860 (0.0007) [2023-12-27 23:07:02,316][106225] Updated weights for policy 1, policy_version 540870 (0.0007) [2023-12-27 23:07:02,379][106225] Updated weights for policy 1, policy_version 540880 (0.0006) [2023-12-27 23:07:02,391][106226] Updated weights for policy 0, policy_version 539520 (0.0009) [2023-12-27 23:07:02,449][106226] Updated weights for policy 0, policy_version 539530 (0.0010) [2023-12-27 23:07:02,498][106226] Updated weights for policy 0, policy_version 539540 (0.0008) [2023-12-27 23:07:03,006][106225] Updated weights for policy 1, policy_version 540890 (0.0008) [2023-12-27 23:07:03,058][106225] Updated weights for policy 1, policy_version 540900 (0.0007) [2023-12-27 23:07:03,106][106225] Updated weights for policy 1, policy_version 540910 (0.0008) [2023-12-27 23:07:03,259][106226] Updated weights for policy 0, policy_version 539550 (0.0006) [2023-12-27 23:07:03,324][106226] Updated weights for policy 0, policy_version 539560 (0.0005) [2023-12-27 23:07:03,383][106226] Updated weights for policy 0, policy_version 539570 (0.0005) [2023-12-27 23:07:03,752][106225] Updated weights for policy 1, policy_version 540920 (0.0006) [2023-12-27 23:07:03,809][106225] Updated weights for policy 1, policy_version 540930 (0.0005) [2023-12-27 23:07:03,880][106225] Updated weights for policy 1, policy_version 540940 (0.0009) [2023-12-27 23:07:04,049][106226] Updated weights for policy 0, policy_version 539580 (0.0006) [2023-12-27 23:07:04,108][106226] Updated weights for policy 0, policy_version 539590 (0.0008) [2023-12-27 23:07:04,173][106226] Updated weights for policy 0, policy_version 539600 (0.0008) [2023-12-27 23:07:04,466][106225] Updated weights for policy 1, policy_version 540950 (0.0005) [2023-12-27 23:07:04,538][106225] Updated weights for policy 1, policy_version 540960 (0.0006) [2023-12-27 23:07:04,601][106225] Updated weights for policy 1, policy_version 540970 (0.0010) [2023-12-27 23:07:04,899][106226] Updated weights for policy 0, policy_version 539610 (0.0009) [2023-12-27 23:07:04,964][106226] Updated weights for policy 0, policy_version 539620 (0.0008) [2023-12-27 23:07:05,029][106226] Updated weights for policy 0, policy_version 539630 (0.0009) [2023-12-27 23:07:05,078][106226] Updated weights for policy 0, policy_version 539640 (0.0010) [2023-12-27 23:07:05,186][106225] Updated weights for policy 1, policy_version 540980 (0.0008) [2023-12-27 23:07:05,248][106225] Updated weights for policy 1, policy_version 540990 (0.0005) [2023-12-27 23:07:05,316][106225] Updated weights for policy 1, policy_version 541000 (0.0005) [2023-12-27 23:07:05,651][106226] Updated weights for policy 0, policy_version 539650 (0.0010) [2023-12-27 23:07:05,702][106226] Updated weights for policy 0, policy_version 539660 (0.0010) [2023-12-27 23:07:05,751][106226] Updated weights for policy 0, policy_version 539670 (0.0010) [2023-12-27 23:07:05,837][106225] Updated weights for policy 1, policy_version 541010 (0.0005) [2023-12-27 23:07:05,900][106225] Updated weights for policy 1, policy_version 541020 (0.0005) [2023-12-27 23:07:05,963][106225] Updated weights for policy 1, policy_version 541030 (0.0005) [2023-12-27 23:07:06,021][106225] Updated weights for policy 1, policy_version 541040 (0.0010) [2023-12-27 23:07:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 276725760. Throughput: 0: 10048.4, 1: 9957.6. Samples: 276732776. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:06,175][105115] Avg episode reward: [(0, '-5.402'), (1, '-5.424')] [2023-12-27 23:07:06,493][106226] Updated weights for policy 0, policy_version 539680 (0.0009) [2023-12-27 23:07:06,554][106226] Updated weights for policy 0, policy_version 539690 (0.0008) [2023-12-27 23:07:06,616][106226] Updated weights for policy 0, policy_version 539700 (0.0006) [2023-12-27 23:07:06,678][106225] Updated weights for policy 1, policy_version 541050 (0.0008) [2023-12-27 23:07:06,741][106225] Updated weights for policy 1, policy_version 541060 (0.0008) [2023-12-27 23:07:06,801][106225] Updated weights for policy 1, policy_version 541070 (0.0007) [2023-12-27 23:07:07,321][106226] Updated weights for policy 0, policy_version 539710 (0.0008) [2023-12-27 23:07:07,370][106226] Updated weights for policy 0, policy_version 539720 (0.0007) [2023-12-27 23:07:07,424][106226] Updated weights for policy 0, policy_version 539730 (0.0008) [2023-12-27 23:07:07,504][106225] Updated weights for policy 1, policy_version 541080 (0.0007) [2023-12-27 23:07:07,561][106225] Updated weights for policy 1, policy_version 541090 (0.0010) [2023-12-27 23:07:07,615][106225] Updated weights for policy 1, policy_version 541100 (0.0010) [2023-12-27 23:07:08,225][106226] Updated weights for policy 0, policy_version 539740 (0.0008) [2023-12-27 23:07:08,283][106225] Updated weights for policy 1, policy_version 541110 (0.0008) [2023-12-27 23:07:08,283][106226] Updated weights for policy 0, policy_version 539750 (0.0005) [2023-12-27 23:07:08,347][106226] Updated weights for policy 0, policy_version 539760 (0.0007) [2023-12-27 23:07:08,354][106225] Updated weights for policy 1, policy_version 541120 (0.0008) [2023-12-27 23:07:08,420][106225] Updated weights for policy 1, policy_version 541130 (0.0008) [2023-12-27 23:07:09,087][106226] Updated weights for policy 0, policy_version 539770 (0.0007) [2023-12-27 23:07:09,135][106226] Updated weights for policy 0, policy_version 539780 (0.0008) [2023-12-27 23:07:09,137][106225] Updated weights for policy 1, policy_version 541140 (0.0008) [2023-12-27 23:07:09,190][106226] Updated weights for policy 0, policy_version 539790 (0.0006) [2023-12-27 23:07:09,192][106225] Updated weights for policy 1, policy_version 541150 (0.0005) [2023-12-27 23:07:09,245][106226] Updated weights for policy 0, policy_version 539800 (0.0007) [2023-12-27 23:07:09,258][106225] Updated weights for policy 1, policy_version 541160 (0.0007) [2023-12-27 23:07:09,944][106225] Updated weights for policy 1, policy_version 541170 (0.0008) [2023-12-27 23:07:09,995][106225] Updated weights for policy 1, policy_version 541180 (0.0005) [2023-12-27 23:07:10,056][106225] Updated weights for policy 1, policy_version 541190 (0.0007) [2023-12-27 23:07:10,088][106226] Updated weights for policy 0, policy_version 539810 (0.0007) [2023-12-27 23:07:10,115][106225] Updated weights for policy 1, policy_version 541200 (0.0008) [2023-12-27 23:07:10,140][106226] Updated weights for policy 0, policy_version 539820 (0.0008) [2023-12-27 23:07:10,194][106226] Updated weights for policy 0, policy_version 539830 (0.0008) [2023-12-27 23:07:10,747][106225] Updated weights for policy 1, policy_version 541210 (0.0011) [2023-12-27 23:07:10,801][106225] Updated weights for policy 1, policy_version 541220 (0.0009) [2023-12-27 23:07:10,855][106225] Updated weights for policy 1, policy_version 541230 (0.0005) [2023-12-27 23:07:10,966][106226] Updated weights for policy 0, policy_version 539840 (0.0010) [2023-12-27 23:07:11,017][106226] Updated weights for policy 0, policy_version 539850 (0.0010) [2023-12-27 23:07:11,083][106226] Updated weights for policy 0, policy_version 539860 (0.0009) [2023-12-27 23:07:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 276824064. Throughput: 0: 10051.8, 1: 9978.6. Samples: 276790908. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:11,175][105115] Avg episode reward: [(0, '-5.007'), (1, '-5.309')] [2023-12-27 23:07:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000541232_138584064.pth... [2023-12-27 23:07:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000539864_138240000.pth... [2023-12-27 23:07:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000540080_138289152.pth [2023-12-27 23:07:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000538680_137936896.pth [2023-12-27 23:07:11,580][106225] Updated weights for policy 1, policy_version 541240 (0.0008) [2023-12-27 23:07:11,658][106225] Updated weights for policy 1, policy_version 541250 (0.0009) [2023-12-27 23:07:11,711][106225] Updated weights for policy 1, policy_version 541260 (0.0008) [2023-12-27 23:07:11,931][106226] Updated weights for policy 0, policy_version 539870 (0.0009) [2023-12-27 23:07:11,987][106226] Updated weights for policy 0, policy_version 539880 (0.0008) [2023-12-27 23:07:12,040][106226] Updated weights for policy 0, policy_version 539890 (0.0008) [2023-12-27 23:07:12,490][106225] Updated weights for policy 1, policy_version 541270 (0.0008) [2023-12-27 23:07:12,566][106225] Updated weights for policy 1, policy_version 541280 (0.0009) [2023-12-27 23:07:12,626][106225] Updated weights for policy 1, policy_version 541290 (0.0008) [2023-12-27 23:07:12,780][106226] Updated weights for policy 0, policy_version 539900 (0.0008) [2023-12-27 23:07:12,837][106226] Updated weights for policy 0, policy_version 539910 (0.0008) [2023-12-27 23:07:12,898][106226] Updated weights for policy 0, policy_version 539920 (0.0007) [2023-12-27 23:07:13,341][106225] Updated weights for policy 1, policy_version 541300 (0.0007) [2023-12-27 23:07:13,403][106225] Updated weights for policy 1, policy_version 541310 (0.0007) [2023-12-27 23:07:13,452][106225] Updated weights for policy 1, policy_version 541320 (0.0007) [2023-12-27 23:07:13,515][106226] Updated weights for policy 0, policy_version 539930 (0.0009) [2023-12-27 23:07:13,568][106226] Updated weights for policy 0, policy_version 539940 (0.0005) [2023-12-27 23:07:13,616][106226] Updated weights for policy 0, policy_version 539950 (0.0005) [2023-12-27 23:07:13,663][106226] Updated weights for policy 0, policy_version 539960 (0.0005) [2023-12-27 23:07:14,025][106225] Updated weights for policy 1, policy_version 541330 (0.0005) [2023-12-27 23:07:14,083][106225] Updated weights for policy 1, policy_version 541340 (0.0005) [2023-12-27 23:07:14,137][106225] Updated weights for policy 1, policy_version 541350 (0.0006) [2023-12-27 23:07:14,188][106225] Updated weights for policy 1, policy_version 541360 (0.0005) [2023-12-27 23:07:14,277][106226] Updated weights for policy 0, policy_version 539970 (0.0010) [2023-12-27 23:07:14,335][106226] Updated weights for policy 0, policy_version 539980 (0.0009) [2023-12-27 23:07:14,393][106226] Updated weights for policy 0, policy_version 539990 (0.0009) [2023-12-27 23:07:14,747][106225] Updated weights for policy 1, policy_version 541370 (0.0008) [2023-12-27 23:07:14,815][106225] Updated weights for policy 1, policy_version 541380 (0.0008) [2023-12-27 23:07:14,876][106225] Updated weights for policy 1, policy_version 541390 (0.0009) [2023-12-27 23:07:15,148][106226] Updated weights for policy 0, policy_version 540000 (0.0009) [2023-12-27 23:07:15,212][106226] Updated weights for policy 0, policy_version 540010 (0.0009) [2023-12-27 23:07:15,274][106226] Updated weights for policy 0, policy_version 540020 (0.0010) [2023-12-27 23:07:15,551][106225] Updated weights for policy 1, policy_version 541400 (0.0006) [2023-12-27 23:07:15,607][106225] Updated weights for policy 1, policy_version 541410 (0.0006) [2023-12-27 23:07:15,656][106225] Updated weights for policy 1, policy_version 541420 (0.0005) [2023-12-27 23:07:16,084][106226] Updated weights for policy 0, policy_version 540030 (0.0008) [2023-12-27 23:07:16,134][106226] Updated weights for policy 0, policy_version 540040 (0.0009) [2023-12-27 23:07:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 276914176. Throughput: 0: 10007.4, 1: 9962.7. Samples: 276909752. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:16,175][105115] Avg episode reward: [(0, '-5.268'), (1, '-5.564')] [2023-12-27 23:07:16,187][106226] Updated weights for policy 0, policy_version 540050 (0.0008) [2023-12-27 23:07:16,196][106225] Updated weights for policy 1, policy_version 541430 (0.0005) [2023-12-27 23:07:16,253][106225] Updated weights for policy 1, policy_version 541440 (0.0005) [2023-12-27 23:07:16,315][106225] Updated weights for policy 1, policy_version 541450 (0.0005) [2023-12-27 23:07:16,888][106226] Updated weights for policy 0, policy_version 540060 (0.0009) [2023-12-27 23:07:16,901][106225] Updated weights for policy 1, policy_version 541460 (0.0006) [2023-12-27 23:07:16,946][106226] Updated weights for policy 0, policy_version 540070 (0.0011) [2023-12-27 23:07:16,963][106225] Updated weights for policy 1, policy_version 541470 (0.0005) [2023-12-27 23:07:17,001][106226] Updated weights for policy 0, policy_version 540080 (0.0010) [2023-12-27 23:07:17,019][106225] Updated weights for policy 1, policy_version 541480 (0.0006) [2023-12-27 23:07:17,746][106226] Updated weights for policy 0, policy_version 540090 (0.0009) [2023-12-27 23:07:17,760][106225] Updated weights for policy 1, policy_version 541490 (0.0008) [2023-12-27 23:07:17,808][106226] Updated weights for policy 0, policy_version 540100 (0.0006) [2023-12-27 23:07:17,826][106225] Updated weights for policy 1, policy_version 541500 (0.0009) [2023-12-27 23:07:17,869][106226] Updated weights for policy 0, policy_version 540110 (0.0006) [2023-12-27 23:07:17,884][106225] Updated weights for policy 1, policy_version 541510 (0.0008) [2023-12-27 23:07:17,929][106226] Updated weights for policy 0, policy_version 540120 (0.0008) [2023-12-27 23:07:17,946][106225] Updated weights for policy 1, policy_version 541520 (0.0007) [2023-12-27 23:07:18,659][106225] Updated weights for policy 1, policy_version 541530 (0.0007) [2023-12-27 23:07:18,676][106226] Updated weights for policy 0, policy_version 540130 (0.0009) [2023-12-27 23:07:18,722][106225] Updated weights for policy 1, policy_version 541540 (0.0007) [2023-12-27 23:07:18,725][106226] Updated weights for policy 0, policy_version 540140 (0.0007) [2023-12-27 23:07:18,777][106226] Updated weights for policy 0, policy_version 540150 (0.0007) [2023-12-27 23:07:18,782][106225] Updated weights for policy 1, policy_version 541550 (0.0008) [2023-12-27 23:07:19,519][106225] Updated weights for policy 1, policy_version 541560 (0.0008) [2023-12-27 23:07:19,557][106226] Updated weights for policy 0, policy_version 540160 (0.0007) [2023-12-27 23:07:19,577][106225] Updated weights for policy 1, policy_version 541570 (0.0008) [2023-12-27 23:07:19,618][106226] Updated weights for policy 0, policy_version 540170 (0.0006) [2023-12-27 23:07:19,638][106225] Updated weights for policy 1, policy_version 541580 (0.0011) [2023-12-27 23:07:19,681][106226] Updated weights for policy 0, policy_version 540180 (0.0006) [2023-12-27 23:07:20,391][106225] Updated weights for policy 1, policy_version 541590 (0.0011) [2023-12-27 23:07:20,453][106225] Updated weights for policy 1, policy_version 541600 (0.0011) [2023-12-27 23:07:20,466][106226] Updated weights for policy 0, policy_version 540190 (0.0007) [2023-12-27 23:07:20,508][106225] Updated weights for policy 1, policy_version 541610 (0.0010) [2023-12-27 23:07:20,521][106226] Updated weights for policy 0, policy_version 540200 (0.0006) [2023-12-27 23:07:20,578][106226] Updated weights for policy 0, policy_version 540210 (0.0007) [2023-12-27 23:07:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 277012480. Throughput: 0: 9891.7, 1: 9958.7. Samples: 277025664. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:21,175][105115] Avg episode reward: [(0, '-5.186'), (1, '-5.647')] [2023-12-27 23:07:21,257][106225] Updated weights for policy 1, policy_version 541620 (0.0011) [2023-12-27 23:07:21,325][106225] Updated weights for policy 1, policy_version 541630 (0.0010) [2023-12-27 23:07:21,335][106226] Updated weights for policy 0, policy_version 540220 (0.0007) [2023-12-27 23:07:21,396][106225] Updated weights for policy 1, policy_version 541640 (0.0009) [2023-12-27 23:07:21,413][106226] Updated weights for policy 0, policy_version 540230 (0.0008) [2023-12-27 23:07:21,468][106226] Updated weights for policy 0, policy_version 540240 (0.0008) [2023-12-27 23:07:22,183][106226] Updated weights for policy 0, policy_version 540250 (0.0008) [2023-12-27 23:07:22,193][106225] Updated weights for policy 1, policy_version 541650 (0.0008) [2023-12-27 23:07:22,230][106226] Updated weights for policy 0, policy_version 540260 (0.0007) [2023-12-27 23:07:22,250][106225] Updated weights for policy 1, policy_version 541660 (0.0010) [2023-12-27 23:07:22,291][106226] Updated weights for policy 0, policy_version 540270 (0.0009) [2023-12-27 23:07:22,317][106225] Updated weights for policy 1, policy_version 541670 (0.0009) [2023-12-27 23:07:22,358][106226] Updated weights for policy 0, policy_version 540280 (0.0009) [2023-12-27 23:07:22,386][106225] Updated weights for policy 1, policy_version 541680 (0.0011) [2023-12-27 23:07:23,081][106226] Updated weights for policy 0, policy_version 540290 (0.0006) [2023-12-27 23:07:23,098][106225] Updated weights for policy 1, policy_version 541690 (0.0008) [2023-12-27 23:07:23,143][106226] Updated weights for policy 0, policy_version 540300 (0.0007) [2023-12-27 23:07:23,153][106225] Updated weights for policy 1, policy_version 541700 (0.0009) [2023-12-27 23:07:23,194][106226] Updated weights for policy 0, policy_version 540310 (0.0007) [2023-12-27 23:07:23,207][106225] Updated weights for policy 1, policy_version 541710 (0.0007) [2023-12-27 23:07:23,879][106226] Updated weights for policy 0, policy_version 540320 (0.0006) [2023-12-27 23:07:23,928][106225] Updated weights for policy 1, policy_version 541720 (0.0010) [2023-12-27 23:07:23,939][106226] Updated weights for policy 0, policy_version 540330 (0.0006) [2023-12-27 23:07:23,986][106225] Updated weights for policy 1, policy_version 541730 (0.0010) [2023-12-27 23:07:23,988][106226] Updated weights for policy 0, policy_version 540340 (0.0005) [2023-12-27 23:07:24,039][106225] Updated weights for policy 1, policy_version 541740 (0.0010) [2023-12-27 23:07:24,675][106226] Updated weights for policy 0, policy_version 540350 (0.0007) [2023-12-27 23:07:24,719][106225] Updated weights for policy 1, policy_version 541750 (0.0009) [2023-12-27 23:07:24,736][106226] Updated weights for policy 0, policy_version 540360 (0.0008) [2023-12-27 23:07:24,774][106225] Updated weights for policy 1, policy_version 541760 (0.0006) [2023-12-27 23:07:24,794][106226] Updated weights for policy 0, policy_version 540370 (0.0007) [2023-12-27 23:07:24,826][106225] Updated weights for policy 1, policy_version 541770 (0.0006) [2023-12-27 23:07:25,523][106226] Updated weights for policy 0, policy_version 540380 (0.0008) [2023-12-27 23:07:25,554][106225] Updated weights for policy 1, policy_version 541780 (0.0007) [2023-12-27 23:07:25,579][106226] Updated weights for policy 0, policy_version 540390 (0.0007) [2023-12-27 23:07:25,605][106225] Updated weights for policy 1, policy_version 541790 (0.0006) [2023-12-27 23:07:25,636][106226] Updated weights for policy 0, policy_version 540400 (0.0007) [2023-12-27 23:07:25,659][106225] Updated weights for policy 1, policy_version 541800 (0.0008) [2023-12-27 23:07:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 277110784. Throughput: 0: 9852.2, 1: 9899.2. Samples: 277082944. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:26,175][105115] Avg episode reward: [(0, '-5.138'), (1, '-5.317')] [2023-12-27 23:07:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000540408_138379264.pth... [2023-12-27 23:07:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000541808_138731520.pth... [2023-12-27 23:07:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000539288_138092544.pth [2023-12-27 23:07:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000540624_138428416.pth [2023-12-27 23:07:26,373][106226] Updated weights for policy 0, policy_version 540410 (0.0009) [2023-12-27 23:07:26,377][106225] Updated weights for policy 1, policy_version 541810 (0.0008) [2023-12-27 23:07:26,426][106225] Updated weights for policy 1, policy_version 541820 (0.0010) [2023-12-27 23:07:26,430][106226] Updated weights for policy 0, policy_version 540420 (0.0009) [2023-12-27 23:07:26,482][106225] Updated weights for policy 1, policy_version 541830 (0.0010) [2023-12-27 23:07:26,484][106226] Updated weights for policy 0, policy_version 540430 (0.0005) [2023-12-27 23:07:26,534][106225] Updated weights for policy 1, policy_version 541840 (0.0010) [2023-12-27 23:07:26,540][106226] Updated weights for policy 0, policy_version 540440 (0.0005) [2023-12-27 23:07:27,106][106226] Updated weights for policy 0, policy_version 540450 (0.0005) [2023-12-27 23:07:27,170][106226] Updated weights for policy 0, policy_version 540460 (0.0005) [2023-12-27 23:07:27,229][106226] Updated weights for policy 0, policy_version 540470 (0.0005) [2023-12-27 23:07:27,239][106225] Updated weights for policy 1, policy_version 541850 (0.0010) [2023-12-27 23:07:27,292][106225] Updated weights for policy 1, policy_version 541860 (0.0010) [2023-12-27 23:07:27,352][106225] Updated weights for policy 1, policy_version 541870 (0.0010) [2023-12-27 23:07:27,800][106226] Updated weights for policy 0, policy_version 540480 (0.0008) [2023-12-27 23:07:27,852][106226] Updated weights for policy 0, policy_version 540490 (0.0009) [2023-12-27 23:07:27,901][106226] Updated weights for policy 0, policy_version 540500 (0.0007) [2023-12-27 23:07:28,031][106225] Updated weights for policy 1, policy_version 541880 (0.0010) [2023-12-27 23:07:28,080][106225] Updated weights for policy 1, policy_version 541890 (0.0010) [2023-12-27 23:07:28,134][106225] Updated weights for policy 1, policy_version 541900 (0.0010) [2023-12-27 23:07:28,596][106226] Updated weights for policy 0, policy_version 540510 (0.0008) [2023-12-27 23:07:28,654][106226] Updated weights for policy 0, policy_version 540520 (0.0008) [2023-12-27 23:07:28,708][106226] Updated weights for policy 0, policy_version 540530 (0.0007) [2023-12-27 23:07:28,830][106225] Updated weights for policy 1, policy_version 541910 (0.0009) [2023-12-27 23:07:28,888][106225] Updated weights for policy 1, policy_version 541920 (0.0008) [2023-12-27 23:07:28,940][106225] Updated weights for policy 1, policy_version 541930 (0.0009) [2023-12-27 23:07:29,455][106226] Updated weights for policy 0, policy_version 540540 (0.0008) [2023-12-27 23:07:29,518][106226] Updated weights for policy 0, policy_version 540550 (0.0009) [2023-12-27 23:07:29,576][106226] Updated weights for policy 0, policy_version 540560 (0.0009) [2023-12-27 23:07:29,701][106225] Updated weights for policy 1, policy_version 541940 (0.0008) [2023-12-27 23:07:29,758][106225] Updated weights for policy 1, policy_version 541950 (0.0008) [2023-12-27 23:07:29,813][106225] Updated weights for policy 1, policy_version 541960 (0.0008) [2023-12-27 23:07:30,392][106226] Updated weights for policy 0, policy_version 540570 (0.0006) [2023-12-27 23:07:30,449][106226] Updated weights for policy 0, policy_version 540580 (0.0008) [2023-12-27 23:07:30,487][106225] Updated weights for policy 1, policy_version 541970 (0.0008) [2023-12-27 23:07:30,505][106226] Updated weights for policy 0, policy_version 540590 (0.0007) [2023-12-27 23:07:30,544][106225] Updated weights for policy 1, policy_version 541980 (0.0006) [2023-12-27 23:07:30,555][106226] Updated weights for policy 0, policy_version 540600 (0.0007) [2023-12-27 23:07:30,607][106225] Updated weights for policy 1, policy_version 541990 (0.0006) [2023-12-27 23:07:30,670][106225] Updated weights for policy 1, policy_version 542000 (0.0010) [2023-12-27 23:07:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 277209088. Throughput: 0: 9828.7, 1: 9992.8. Samples: 277202432. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:31,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-5.279')] [2023-12-27 23:07:31,251][106226] Updated weights for policy 0, policy_version 540610 (0.0008) [2023-12-27 23:07:31,315][106226] Updated weights for policy 0, policy_version 540620 (0.0008) [2023-12-27 23:07:31,373][106226] Updated weights for policy 0, policy_version 540630 (0.0007) [2023-12-27 23:07:31,380][106225] Updated weights for policy 1, policy_version 542010 (0.0008) [2023-12-27 23:07:31,444][106225] Updated weights for policy 1, policy_version 542020 (0.0008) [2023-12-27 23:07:31,494][106225] Updated weights for policy 1, policy_version 542030 (0.0009) [2023-12-27 23:07:32,036][106226] Updated weights for policy 0, policy_version 540640 (0.0008) [2023-12-27 23:07:32,100][106226] Updated weights for policy 0, policy_version 540650 (0.0008) [2023-12-27 23:07:32,171][106226] Updated weights for policy 0, policy_version 540660 (0.0008) [2023-12-27 23:07:32,203][106225] Updated weights for policy 1, policy_version 542040 (0.0006) [2023-12-27 23:07:32,265][106225] Updated weights for policy 1, policy_version 542050 (0.0008) [2023-12-27 23:07:32,321][106225] Updated weights for policy 1, policy_version 542060 (0.0006) [2023-12-27 23:07:32,860][106226] Updated weights for policy 0, policy_version 540670 (0.0007) [2023-12-27 23:07:32,920][106226] Updated weights for policy 0, policy_version 540680 (0.0008) [2023-12-27 23:07:32,971][106226] Updated weights for policy 0, policy_version 540690 (0.0007) [2023-12-27 23:07:32,981][106225] Updated weights for policy 1, policy_version 542070 (0.0007) [2023-12-27 23:07:33,040][106225] Updated weights for policy 1, policy_version 542080 (0.0005) [2023-12-27 23:07:33,087][106225] Updated weights for policy 1, policy_version 542090 (0.0007) [2023-12-27 23:07:33,630][106226] Updated weights for policy 0, policy_version 540700 (0.0006) [2023-12-27 23:07:33,676][106226] Updated weights for policy 0, policy_version 540710 (0.0005) [2023-12-27 23:07:33,731][106225] Updated weights for policy 1, policy_version 542100 (0.0006) [2023-12-27 23:07:33,733][106226] Updated weights for policy 0, policy_version 540720 (0.0005) [2023-12-27 23:07:33,786][106225] Updated weights for policy 1, policy_version 542110 (0.0010) [2023-12-27 23:07:33,846][106225] Updated weights for policy 1, policy_version 542120 (0.0010) [2023-12-27 23:07:34,249][106226] Updated weights for policy 0, policy_version 540730 (0.0006) [2023-12-27 23:07:34,309][106226] Updated weights for policy 0, policy_version 540740 (0.0011) [2023-12-27 23:07:34,375][106226] Updated weights for policy 0, policy_version 540750 (0.0009) [2023-12-27 23:07:34,432][106226] Updated weights for policy 0, policy_version 540760 (0.0008) [2023-12-27 23:07:34,470][106225] Updated weights for policy 1, policy_version 542130 (0.0007) [2023-12-27 23:07:34,524][106225] Updated weights for policy 1, policy_version 542140 (0.0010) [2023-12-27 23:07:34,588][106225] Updated weights for policy 1, policy_version 542150 (0.0006) [2023-12-27 23:07:34,649][106225] Updated weights for policy 1, policy_version 542160 (0.0010) [2023-12-27 23:07:35,066][106226] Updated weights for policy 0, policy_version 540770 (0.0005) [2023-12-27 23:07:35,120][106226] Updated weights for policy 0, policy_version 540780 (0.0005) [2023-12-27 23:07:35,171][106226] Updated weights for policy 0, policy_version 540790 (0.0005) [2023-12-27 23:07:35,292][106225] Updated weights for policy 1, policy_version 542170 (0.0005) [2023-12-27 23:07:35,342][106225] Updated weights for policy 1, policy_version 542180 (0.0006) [2023-12-27 23:07:35,392][106225] Updated weights for policy 1, policy_version 542190 (0.0010) [2023-12-27 23:07:35,695][106226] Updated weights for policy 0, policy_version 540800 (0.0005) [2023-12-27 23:07:35,750][106226] Updated weights for policy 0, policy_version 540810 (0.0007) [2023-12-27 23:07:35,810][106226] Updated weights for policy 0, policy_version 540820 (0.0010) [2023-12-27 23:07:36,075][106225] Updated weights for policy 1, policy_version 542200 (0.0010) [2023-12-27 23:07:36,132][106225] Updated weights for policy 1, policy_version 542210 (0.0010) [2023-12-27 23:07:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 277315584. Throughput: 0: 9898.2, 1: 10041.8. Samples: 277328568. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:36,175][105115] Avg episode reward: [(0, '-5.113'), (1, '-5.781')] [2023-12-27 23:07:36,190][106225] Updated weights for policy 1, policy_version 542220 (0.0009) [2023-12-27 23:07:36,549][106226] Updated weights for policy 0, policy_version 540830 (0.0008) [2023-12-27 23:07:36,619][106226] Updated weights for policy 0, policy_version 540840 (0.0009) [2023-12-27 23:07:36,688][106226] Updated weights for policy 0, policy_version 540850 (0.0007) [2023-12-27 23:07:36,889][106225] Updated weights for policy 1, policy_version 542230 (0.0008) [2023-12-27 23:07:36,950][106225] Updated weights for policy 1, policy_version 542240 (0.0011) [2023-12-27 23:07:37,010][106225] Updated weights for policy 1, policy_version 542250 (0.0011) [2023-12-27 23:07:37,377][106226] Updated weights for policy 0, policy_version 540860 (0.0007) [2023-12-27 23:07:37,445][106226] Updated weights for policy 0, policy_version 540870 (0.0008) [2023-12-27 23:07:37,501][106226] Updated weights for policy 0, policy_version 540880 (0.0009) [2023-12-27 23:07:37,680][106225] Updated weights for policy 1, policy_version 542260 (0.0010) [2023-12-27 23:07:37,737][106225] Updated weights for policy 1, policy_version 542270 (0.0009) [2023-12-27 23:07:37,786][106225] Updated weights for policy 1, policy_version 542280 (0.0008) [2023-12-27 23:07:38,238][106226] Updated weights for policy 0, policy_version 540890 (0.0008) [2023-12-27 23:07:38,298][106226] Updated weights for policy 0, policy_version 540900 (0.0008) [2023-12-27 23:07:38,359][106226] Updated weights for policy 0, policy_version 540910 (0.0009) [2023-12-27 23:07:38,416][106225] Updated weights for policy 1, policy_version 542290 (0.0006) [2023-12-27 23:07:38,421][106226] Updated weights for policy 0, policy_version 540920 (0.0009) [2023-12-27 23:07:38,467][106225] Updated weights for policy 1, policy_version 542300 (0.0006) [2023-12-27 23:07:38,523][106225] Updated weights for policy 1, policy_version 542310 (0.0005) [2023-12-27 23:07:38,584][106225] Updated weights for policy 1, policy_version 542320 (0.0008) [2023-12-27 23:07:39,204][106226] Updated weights for policy 0, policy_version 540930 (0.0007) [2023-12-27 23:07:39,265][106226] Updated weights for policy 0, policy_version 540940 (0.0008) [2023-12-27 23:07:39,266][106225] Updated weights for policy 1, policy_version 542330 (0.0008) [2023-12-27 23:07:39,326][106226] Updated weights for policy 0, policy_version 540950 (0.0009) [2023-12-27 23:07:39,330][106225] Updated weights for policy 1, policy_version 542340 (0.0008) [2023-12-27 23:07:39,413][106225] Updated weights for policy 1, policy_version 542350 (0.0008) [2023-12-27 23:07:40,156][106225] Updated weights for policy 1, policy_version 542360 (0.0008) [2023-12-27 23:07:40,188][106226] Updated weights for policy 0, policy_version 540960 (0.0008) [2023-12-27 23:07:40,226][106225] Updated weights for policy 1, policy_version 542370 (0.0006) [2023-12-27 23:07:40,251][106226] Updated weights for policy 0, policy_version 540970 (0.0007) [2023-12-27 23:07:40,292][106225] Updated weights for policy 1, policy_version 542380 (0.0007) [2023-12-27 23:07:40,313][106226] Updated weights for policy 0, policy_version 540980 (0.0007) [2023-12-27 23:07:40,948][106225] Updated weights for policy 1, policy_version 542390 (0.0006) [2023-12-27 23:07:41,015][106225] Updated weights for policy 1, policy_version 542400 (0.0010) [2023-12-27 23:07:41,080][106226] Updated weights for policy 0, policy_version 540990 (0.0007) [2023-12-27 23:07:41,083][106225] Updated weights for policy 1, policy_version 542410 (0.0011) [2023-12-27 23:07:41,143][106226] Updated weights for policy 0, policy_version 541000 (0.0007) [2023-12-27 23:07:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 277413888. Throughput: 0: 9844.6, 1: 10086.9. Samples: 277387560. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:41,175][105115] Avg episode reward: [(0, '-5.459'), (1, '-5.459')] [2023-12-27 23:07:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000542416_138887168.pth... [2023-12-27 23:07:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000541232_138584064.pth [2023-12-27 23:07:41,220][106226] Updated weights for policy 0, policy_version 541010 (0.0008) [2023-12-27 23:07:41,259][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000541016_138534912.pth... [2023-12-27 23:07:41,264][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000539864_138240000.pth [2023-12-27 23:07:41,855][106225] Updated weights for policy 1, policy_version 542420 (0.0011) [2023-12-27 23:07:41,914][106225] Updated weights for policy 1, policy_version 542430 (0.0009) [2023-12-27 23:07:41,933][106226] Updated weights for policy 0, policy_version 541020 (0.0008) [2023-12-27 23:07:41,968][106225] Updated weights for policy 1, policy_version 542440 (0.0007) [2023-12-27 23:07:41,997][106226] Updated weights for policy 0, policy_version 541030 (0.0006) [2023-12-27 23:07:42,058][106226] Updated weights for policy 0, policy_version 541040 (0.0007) [2023-12-27 23:07:42,681][106225] Updated weights for policy 1, policy_version 542450 (0.0008) [2023-12-27 23:07:42,744][106225] Updated weights for policy 1, policy_version 542460 (0.0008) [2023-12-27 23:07:42,780][106226] Updated weights for policy 0, policy_version 541050 (0.0008) [2023-12-27 23:07:42,805][106225] Updated weights for policy 1, policy_version 542470 (0.0008) [2023-12-27 23:07:42,843][106226] Updated weights for policy 0, policy_version 541060 (0.0011) [2023-12-27 23:07:42,864][106225] Updated weights for policy 1, policy_version 542480 (0.0008) [2023-12-27 23:07:42,903][106226] Updated weights for policy 0, policy_version 541070 (0.0010) [2023-12-27 23:07:42,965][106226] Updated weights for policy 0, policy_version 541080 (0.0009) [2023-12-27 23:07:43,569][106225] Updated weights for policy 1, policy_version 542490 (0.0008) [2023-12-27 23:07:43,616][106225] Updated weights for policy 1, policy_version 542500 (0.0007) [2023-12-27 23:07:43,640][106226] Updated weights for policy 0, policy_version 541090 (0.0009) [2023-12-27 23:07:43,670][106225] Updated weights for policy 1, policy_version 542510 (0.0006) [2023-12-27 23:07:43,703][106226] Updated weights for policy 0, policy_version 541100 (0.0008) [2023-12-27 23:07:43,764][106226] Updated weights for policy 0, policy_version 541110 (0.0008) [2023-12-27 23:07:44,376][106225] Updated weights for policy 1, policy_version 542520 (0.0008) [2023-12-27 23:07:44,385][106226] Updated weights for policy 0, policy_version 541120 (0.0006) [2023-12-27 23:07:44,425][106225] Updated weights for policy 1, policy_version 542530 (0.0006) [2023-12-27 23:07:44,442][106226] Updated weights for policy 0, policy_version 541130 (0.0010) [2023-12-27 23:07:44,475][106225] Updated weights for policy 1, policy_version 542540 (0.0005) [2023-12-27 23:07:44,496][106226] Updated weights for policy 0, policy_version 541140 (0.0010) [2023-12-27 23:07:45,105][106226] Updated weights for policy 0, policy_version 541150 (0.0008) [2023-12-27 23:07:45,168][106226] Updated weights for policy 0, policy_version 541160 (0.0006) [2023-12-27 23:07:45,232][106226] Updated weights for policy 0, policy_version 541170 (0.0006) [2023-12-27 23:07:45,286][106225] Updated weights for policy 1, policy_version 542550 (0.0007) [2023-12-27 23:07:45,356][106225] Updated weights for policy 1, policy_version 542560 (0.0008) [2023-12-27 23:07:45,408][106225] Updated weights for policy 1, policy_version 542570 (0.0009) [2023-12-27 23:07:45,800][106226] Updated weights for policy 0, policy_version 541180 (0.0006) [2023-12-27 23:07:45,866][106226] Updated weights for policy 0, policy_version 541190 (0.0005) [2023-12-27 23:07:45,931][106226] Updated weights for policy 0, policy_version 541200 (0.0006) [2023-12-27 23:07:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 277512192. Throughput: 0: 9817.3, 1: 10095.5. Samples: 277503484. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:46,176][105115] Avg episode reward: [(0, '-5.121'), (1, '-5.739')] [2023-12-27 23:07:46,240][106225] Updated weights for policy 1, policy_version 542580 (0.0009) [2023-12-27 23:07:46,300][106225] Updated weights for policy 1, policy_version 542590 (0.0009) [2023-12-27 23:07:46,358][106225] Updated weights for policy 1, policy_version 542600 (0.0009) [2023-12-27 23:07:46,430][106226] Updated weights for policy 0, policy_version 541210 (0.0005) [2023-12-27 23:07:46,495][106226] Updated weights for policy 0, policy_version 541220 (0.0007) [2023-12-27 23:07:46,555][106226] Updated weights for policy 0, policy_version 541230 (0.0007) [2023-12-27 23:07:46,609][106226] Updated weights for policy 0, policy_version 541240 (0.0005) [2023-12-27 23:07:47,011][106225] Updated weights for policy 1, policy_version 542610 (0.0008) [2023-12-27 23:07:47,057][106225] Updated weights for policy 1, policy_version 542620 (0.0005) [2023-12-27 23:07:47,113][106225] Updated weights for policy 1, policy_version 542630 (0.0006) [2023-12-27 23:07:47,160][106225] Updated weights for policy 1, policy_version 542640 (0.0009) [2023-12-27 23:07:47,186][106226] Updated weights for policy 0, policy_version 541250 (0.0005) [2023-12-27 23:07:47,239][106226] Updated weights for policy 0, policy_version 541260 (0.0005) [2023-12-27 23:07:47,297][106226] Updated weights for policy 0, policy_version 541270 (0.0008) [2023-12-27 23:07:47,885][106225] Updated weights for policy 1, policy_version 542650 (0.0006) [2023-12-27 23:07:47,941][106225] Updated weights for policy 1, policy_version 542660 (0.0006) [2023-12-27 23:07:47,992][106226] Updated weights for policy 0, policy_version 541280 (0.0009) [2023-12-27 23:07:47,998][106225] Updated weights for policy 1, policy_version 542670 (0.0005) [2023-12-27 23:07:48,047][106226] Updated weights for policy 0, policy_version 541290 (0.0011) [2023-12-27 23:07:48,121][106226] Updated weights for policy 0, policy_version 541300 (0.0009) [2023-12-27 23:07:48,636][106225] Updated weights for policy 1, policy_version 542680 (0.0010) [2023-12-27 23:07:48,709][106225] Updated weights for policy 1, policy_version 542690 (0.0010) [2023-12-27 23:07:48,777][106225] Updated weights for policy 1, policy_version 542700 (0.0011) [2023-12-27 23:07:48,785][106226] Updated weights for policy 0, policy_version 541310 (0.0009) [2023-12-27 23:07:48,852][106226] Updated weights for policy 0, policy_version 541320 (0.0007) [2023-12-27 23:07:48,912][106226] Updated weights for policy 0, policy_version 541330 (0.0008) [2023-12-27 23:07:49,510][106225] Updated weights for policy 1, policy_version 542710 (0.0011) [2023-12-27 23:07:49,562][106225] Updated weights for policy 1, policy_version 542720 (0.0010) [2023-12-27 23:07:49,585][106226] Updated weights for policy 0, policy_version 541340 (0.0008) [2023-12-27 23:07:49,617][106225] Updated weights for policy 1, policy_version 542730 (0.0010) [2023-12-27 23:07:49,641][106226] Updated weights for policy 0, policy_version 541350 (0.0010) [2023-12-27 23:07:49,704][106226] Updated weights for policy 0, policy_version 541360 (0.0008) [2023-12-27 23:07:50,277][106225] Updated weights for policy 1, policy_version 542740 (0.0008) [2023-12-27 23:07:50,344][106225] Updated weights for policy 1, policy_version 542750 (0.0006) [2023-12-27 23:07:50,345][106226] Updated weights for policy 0, policy_version 541370 (0.0008) [2023-12-27 23:07:50,412][106225] Updated weights for policy 1, policy_version 542760 (0.0009) [2023-12-27 23:07:50,415][106226] Updated weights for policy 0, policy_version 541380 (0.0007) [2023-12-27 23:07:50,475][106226] Updated weights for policy 0, policy_version 541390 (0.0006) [2023-12-27 23:07:50,534][106226] Updated weights for policy 0, policy_version 541400 (0.0008) [2023-12-27 23:07:51,158][106226] Updated weights for policy 0, policy_version 541410 (0.0011) [2023-12-27 23:07:51,163][106225] Updated weights for policy 1, policy_version 542770 (0.0009) [2023-12-27 23:07:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 277610496. Throughput: 0: 9917.9, 1: 9947.3. Samples: 277626708. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:51,175][105115] Avg episode reward: [(0, '-4.955'), (1, '-5.583')] [2023-12-27 23:07:51,217][106226] Updated weights for policy 0, policy_version 541420 (0.0011) [2023-12-27 23:07:51,223][106225] Updated weights for policy 1, policy_version 542780 (0.0006) [2023-12-27 23:07:51,277][106226] Updated weights for policy 0, policy_version 541430 (0.0011) [2023-12-27 23:07:51,284][106225] Updated weights for policy 1, policy_version 542790 (0.0006) [2023-12-27 23:07:51,345][106225] Updated weights for policy 1, policy_version 542800 (0.0008) [2023-12-27 23:07:52,016][106226] Updated weights for policy 0, policy_version 541440 (0.0010) [2023-12-27 23:07:52,064][106226] Updated weights for policy 0, policy_version 541450 (0.0009) [2023-12-27 23:07:52,110][106225] Updated weights for policy 1, policy_version 542810 (0.0007) [2023-12-27 23:07:52,123][106226] Updated weights for policy 0, policy_version 541460 (0.0009) [2023-12-27 23:07:52,163][106225] Updated weights for policy 1, policy_version 542820 (0.0007) [2023-12-27 23:07:52,226][106225] Updated weights for policy 1, policy_version 542830 (0.0009) [2023-12-27 23:07:52,932][106226] Updated weights for policy 0, policy_version 541470 (0.0007) [2023-12-27 23:07:52,945][106225] Updated weights for policy 1, policy_version 542840 (0.0010) [2023-12-27 23:07:52,994][106226] Updated weights for policy 0, policy_version 541480 (0.0007) [2023-12-27 23:07:52,999][106225] Updated weights for policy 1, policy_version 542850 (0.0010) [2023-12-27 23:07:53,056][106226] Updated weights for policy 0, policy_version 541490 (0.0006) [2023-12-27 23:07:53,058][106225] Updated weights for policy 1, policy_version 542860 (0.0011) [2023-12-27 23:07:53,746][106225] Updated weights for policy 1, policy_version 542870 (0.0007) [2023-12-27 23:07:53,755][106226] Updated weights for policy 0, policy_version 541500 (0.0007) [2023-12-27 23:07:53,808][106226] Updated weights for policy 0, policy_version 541510 (0.0009) [2023-12-27 23:07:53,810][106225] Updated weights for policy 1, policy_version 542880 (0.0006) [2023-12-27 23:07:53,865][106226] Updated weights for policy 0, policy_version 541520 (0.0006) [2023-12-27 23:07:53,870][106225] Updated weights for policy 1, policy_version 542890 (0.0010) [2023-12-27 23:07:54,555][106225] Updated weights for policy 1, policy_version 542900 (0.0010) [2023-12-27 23:07:54,595][106226] Updated weights for policy 0, policy_version 541530 (0.0007) [2023-12-27 23:07:54,617][106225] Updated weights for policy 1, policy_version 542910 (0.0010) [2023-12-27 23:07:54,654][106226] Updated weights for policy 0, policy_version 541540 (0.0008) [2023-12-27 23:07:54,672][106225] Updated weights for policy 1, policy_version 542920 (0.0010) [2023-12-27 23:07:54,701][106226] Updated weights for policy 0, policy_version 541550 (0.0005) [2023-12-27 23:07:54,754][106226] Updated weights for policy 0, policy_version 541560 (0.0009) [2023-12-27 23:07:55,403][106225] Updated weights for policy 1, policy_version 542930 (0.0010) [2023-12-27 23:07:55,460][106225] Updated weights for policy 1, policy_version 542940 (0.0010) [2023-12-27 23:07:55,515][106226] Updated weights for policy 0, policy_version 541570 (0.0007) [2023-12-27 23:07:55,519][106225] Updated weights for policy 1, policy_version 542950 (0.0007) [2023-12-27 23:07:55,572][106226] Updated weights for policy 0, policy_version 541580 (0.0008) [2023-12-27 23:07:55,582][106225] Updated weights for policy 1, policy_version 542960 (0.0005) [2023-12-27 23:07:55,635][106226] Updated weights for policy 0, policy_version 541590 (0.0007) [2023-12-27 23:07:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 277708800. Throughput: 0: 9904.3, 1: 9911.7. Samples: 277682628. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:07:56,175][105115] Avg episode reward: [(0, '-5.341'), (1, '-5.393')] [2023-12-27 23:07:56,233][106226] Updated weights for policy 0, policy_version 541600 (0.0007) [2023-12-27 23:07:56,234][106225] Updated weights for policy 1, policy_version 542970 (0.0007) [2023-12-27 23:07:56,292][106225] Updated weights for policy 1, policy_version 542980 (0.0010) [2023-12-27 23:07:56,294][106226] Updated weights for policy 0, policy_version 541610 (0.0006) [2023-12-27 23:07:56,349][106225] Updated weights for policy 1, policy_version 542990 (0.0010) [2023-12-27 23:07:56,356][106226] Updated weights for policy 0, policy_version 541620 (0.0009) [2023-12-27 23:07:56,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000542992_139034624.pth... [2023-12-27 23:07:56,363][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000541808_138731520.pth [2023-12-27 23:07:56,377][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000541624_138690560.pth... [2023-12-27 23:07:56,381][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000540408_138379264.pth [2023-12-27 23:07:57,046][106225] Updated weights for policy 1, policy_version 543000 (0.0009) [2023-12-27 23:07:57,054][106226] Updated weights for policy 0, policy_version 541630 (0.0007) [2023-12-27 23:07:57,106][106225] Updated weights for policy 1, policy_version 543010 (0.0010) [2023-12-27 23:07:57,109][106226] Updated weights for policy 0, policy_version 541640 (0.0006) [2023-12-27 23:07:57,152][106225] Updated weights for policy 1, policy_version 543020 (0.0010) [2023-12-27 23:07:57,162][106226] Updated weights for policy 0, policy_version 541650 (0.0005) [2023-12-27 23:07:57,756][106225] Updated weights for policy 1, policy_version 543030 (0.0009) [2023-12-27 23:07:57,812][106225] Updated weights for policy 1, policy_version 543040 (0.0010) [2023-12-27 23:07:57,865][106225] Updated weights for policy 1, policy_version 543050 (0.0010) [2023-12-27 23:07:57,883][106226] Updated weights for policy 0, policy_version 541660 (0.0006) [2023-12-27 23:07:57,934][106226] Updated weights for policy 0, policy_version 541670 (0.0007) [2023-12-27 23:07:57,982][106226] Updated weights for policy 0, policy_version 541680 (0.0007) [2023-12-27 23:07:58,584][106225] Updated weights for policy 1, policy_version 543060 (0.0009) [2023-12-27 23:07:58,650][106225] Updated weights for policy 1, policy_version 543070 (0.0008) [2023-12-27 23:07:58,709][106225] Updated weights for policy 1, policy_version 543080 (0.0008) [2023-12-27 23:07:58,738][106226] Updated weights for policy 0, policy_version 541690 (0.0007) [2023-12-27 23:07:58,810][106226] Updated weights for policy 0, policy_version 541700 (0.0007) [2023-12-27 23:07:58,883][106226] Updated weights for policy 0, policy_version 541710 (0.0008) [2023-12-27 23:07:58,948][106226] Updated weights for policy 0, policy_version 541720 (0.0007) [2023-12-27 23:07:59,521][106225] Updated weights for policy 1, policy_version 543090 (0.0007) [2023-12-27 23:07:59,587][106225] Updated weights for policy 1, policy_version 543100 (0.0008) [2023-12-27 23:07:59,647][106225] Updated weights for policy 1, policy_version 543110 (0.0009) [2023-12-27 23:07:59,705][106225] Updated weights for policy 1, policy_version 543120 (0.0007) [2023-12-27 23:07:59,706][106226] Updated weights for policy 0, policy_version 541730 (0.0006) [2023-12-27 23:07:59,769][106226] Updated weights for policy 0, policy_version 541740 (0.0006) [2023-12-27 23:07:59,832][106226] Updated weights for policy 0, policy_version 541750 (0.0008) [2023-12-27 23:08:00,435][106225] Updated weights for policy 1, policy_version 543130 (0.0005) [2023-12-27 23:08:00,486][106225] Updated weights for policy 1, policy_version 543140 (0.0005) [2023-12-27 23:08:00,536][106225] Updated weights for policy 1, policy_version 543150 (0.0005) [2023-12-27 23:08:00,565][106226] Updated weights for policy 0, policy_version 541760 (0.0009) [2023-12-27 23:08:00,615][106226] Updated weights for policy 0, policy_version 541770 (0.0009) [2023-12-27 23:08:00,677][106226] Updated weights for policy 0, policy_version 541780 (0.0009) [2023-12-27 23:08:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 277807104. Throughput: 0: 9926.0, 1: 9861.9. Samples: 277800208. Policy #0 lag: (min: 26.0, avg: 49.3, max: 58.0) [2023-12-27 23:08:01,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.403')] [2023-12-27 23:08:01,195][106225] Updated weights for policy 1, policy_version 543160 (0.0012) [2023-12-27 23:08:01,261][106225] Updated weights for policy 1, policy_version 543170 (0.0008) [2023-12-27 23:08:01,322][106225] Updated weights for policy 1, policy_version 543180 (0.0006) [2023-12-27 23:08:01,487][106226] Updated weights for policy 0, policy_version 541790 (0.0006) [2023-12-27 23:08:01,550][106226] Updated weights for policy 0, policy_version 541800 (0.0006) [2023-12-27 23:08:01,615][106226] Updated weights for policy 0, policy_version 541810 (0.0011) [2023-12-27 23:08:02,046][106225] Updated weights for policy 1, policy_version 543190 (0.0006) [2023-12-27 23:08:02,107][106225] Updated weights for policy 1, policy_version 543200 (0.0009) [2023-12-27 23:08:02,169][106225] Updated weights for policy 1, policy_version 543210 (0.0008) [2023-12-27 23:08:02,253][106226] Updated weights for policy 0, policy_version 541820 (0.0008) [2023-12-27 23:08:02,322][106226] Updated weights for policy 0, policy_version 541830 (0.0008) [2023-12-27 23:08:02,391][106226] Updated weights for policy 0, policy_version 541840 (0.0009) [2023-12-27 23:08:02,868][106225] Updated weights for policy 1, policy_version 543220 (0.0007) [2023-12-27 23:08:02,933][106225] Updated weights for policy 1, policy_version 543230 (0.0005) [2023-12-27 23:08:02,981][106225] Updated weights for policy 1, policy_version 543240 (0.0005) [2023-12-27 23:08:03,037][106226] Updated weights for policy 0, policy_version 541850 (0.0009) [2023-12-27 23:08:03,086][106226] Updated weights for policy 0, policy_version 541860 (0.0008) [2023-12-27 23:08:03,135][106226] Updated weights for policy 0, policy_version 541870 (0.0009) [2023-12-27 23:08:03,186][106226] Updated weights for policy 0, policy_version 541880 (0.0009) [2023-12-27 23:08:03,577][106225] Updated weights for policy 1, policy_version 543250 (0.0007) [2023-12-27 23:08:03,642][106225] Updated weights for policy 1, policy_version 543260 (0.0009) [2023-12-27 23:08:03,714][106225] Updated weights for policy 1, policy_version 543270 (0.0007) [2023-12-27 23:08:03,776][106225] Updated weights for policy 1, policy_version 543280 (0.0005) [2023-12-27 23:08:03,830][106226] Updated weights for policy 0, policy_version 541890 (0.0006) [2023-12-27 23:08:03,901][106226] Updated weights for policy 0, policy_version 541900 (0.0008) [2023-12-27 23:08:03,962][106226] Updated weights for policy 0, policy_version 541910 (0.0009) [2023-12-27 23:08:04,464][106225] Updated weights for policy 1, policy_version 543290 (0.0007) [2023-12-27 23:08:04,527][106225] Updated weights for policy 1, policy_version 543300 (0.0006) [2023-12-27 23:08:04,585][106225] Updated weights for policy 1, policy_version 543310 (0.0006) [2023-12-27 23:08:04,656][106226] Updated weights for policy 0, policy_version 541920 (0.0009) [2023-12-27 23:08:04,712][106226] Updated weights for policy 0, policy_version 541930 (0.0008) [2023-12-27 23:08:04,798][106226] Updated weights for policy 0, policy_version 541940 (0.0008) [2023-12-27 23:08:05,310][106225] Updated weights for policy 1, policy_version 543320 (0.0009) [2023-12-27 23:08:05,366][106225] Updated weights for policy 1, policy_version 543330 (0.0007) [2023-12-27 23:08:05,386][106226] Updated weights for policy 0, policy_version 541950 (0.0009) [2023-12-27 23:08:05,425][106225] Updated weights for policy 1, policy_version 543340 (0.0007) [2023-12-27 23:08:05,442][106226] Updated weights for policy 0, policy_version 541960 (0.0008) [2023-12-27 23:08:05,499][106226] Updated weights for policy 0, policy_version 541970 (0.0008) [2023-12-27 23:08:06,125][106225] Updated weights for policy 1, policy_version 543350 (0.0009) [2023-12-27 23:08:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 277905408. Throughput: 0: 10032.9, 1: 9865.4. Samples: 277921084. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:06,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-5.216')] [2023-12-27 23:08:06,185][106225] Updated weights for policy 1, policy_version 543360 (0.0009) [2023-12-27 23:08:06,217][106226] Updated weights for policy 0, policy_version 541980 (0.0007) [2023-12-27 23:08:06,253][106225] Updated weights for policy 1, policy_version 543370 (0.0007) [2023-12-27 23:08:06,281][106226] Updated weights for policy 0, policy_version 541990 (0.0006) [2023-12-27 23:08:06,351][106226] Updated weights for policy 0, policy_version 542000 (0.0009) [2023-12-27 23:08:06,908][106225] Updated weights for policy 1, policy_version 543380 (0.0008) [2023-12-27 23:08:06,971][106225] Updated weights for policy 1, policy_version 543390 (0.0008) [2023-12-27 23:08:07,019][106225] Updated weights for policy 1, policy_version 543400 (0.0008) [2023-12-27 23:08:07,085][106226] Updated weights for policy 0, policy_version 542010 (0.0009) [2023-12-27 23:08:07,142][106226] Updated weights for policy 0, policy_version 542020 (0.0008) [2023-12-27 23:08:07,197][106226] Updated weights for policy 0, policy_version 542030 (0.0008) [2023-12-27 23:08:07,256][106226] Updated weights for policy 0, policy_version 542040 (0.0008) [2023-12-27 23:08:07,731][106225] Updated weights for policy 1, policy_version 543410 (0.0008) [2023-12-27 23:08:07,786][106225] Updated weights for policy 1, policy_version 543420 (0.0009) [2023-12-27 23:08:07,837][106225] Updated weights for policy 1, policy_version 543430 (0.0008) [2023-12-27 23:08:07,882][106225] Updated weights for policy 1, policy_version 543440 (0.0008) [2023-12-27 23:08:07,983][106226] Updated weights for policy 0, policy_version 542050 (0.0011) [2023-12-27 23:08:08,047][106226] Updated weights for policy 0, policy_version 542060 (0.0011) [2023-12-27 23:08:08,117][106226] Updated weights for policy 0, policy_version 542070 (0.0010) [2023-12-27 23:08:08,520][106225] Updated weights for policy 1, policy_version 543450 (0.0008) [2023-12-27 23:08:08,582][106225] Updated weights for policy 1, policy_version 543460 (0.0009) [2023-12-27 23:08:08,639][106225] Updated weights for policy 1, policy_version 543470 (0.0008) [2023-12-27 23:08:08,762][106226] Updated weights for policy 0, policy_version 542080 (0.0011) [2023-12-27 23:08:08,816][106226] Updated weights for policy 0, policy_version 542090 (0.0006) [2023-12-27 23:08:08,875][106226] Updated weights for policy 0, policy_version 542100 (0.0005) [2023-12-27 23:08:09,332][106225] Updated weights for policy 1, policy_version 543480 (0.0009) [2023-12-27 23:08:09,393][106225] Updated weights for policy 1, policy_version 543490 (0.0009) [2023-12-27 23:08:09,455][106225] Updated weights for policy 1, policy_version 543500 (0.0009) [2023-12-27 23:08:09,625][106226] Updated weights for policy 0, policy_version 542110 (0.0006) [2023-12-27 23:08:09,692][106226] Updated weights for policy 0, policy_version 542120 (0.0008) [2023-12-27 23:08:09,760][106226] Updated weights for policy 0, policy_version 542130 (0.0008) [2023-12-27 23:08:10,184][106225] Updated weights for policy 1, policy_version 543510 (0.0007) [2023-12-27 23:08:10,250][106225] Updated weights for policy 1, policy_version 543520 (0.0007) [2023-12-27 23:08:10,321][106225] Updated weights for policy 1, policy_version 543530 (0.0008) [2023-12-27 23:08:10,468][106226] Updated weights for policy 0, policy_version 542140 (0.0008) [2023-12-27 23:08:10,532][106226] Updated weights for policy 0, policy_version 542150 (0.0009) [2023-12-27 23:08:10,593][106226] Updated weights for policy 0, policy_version 542160 (0.0009) [2023-12-27 23:08:11,061][106225] Updated weights for policy 1, policy_version 543540 (0.0012) [2023-12-27 23:08:11,140][106225] Updated weights for policy 1, policy_version 543550 (0.0009) [2023-12-27 23:08:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 278003712. Throughput: 0: 10033.6, 1: 9921.0. Samples: 277980900. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:11,175][105115] Avg episode reward: [(0, '-5.221'), (1, '-5.576')] [2023-12-27 23:08:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000542168_138829824.pth... [2023-12-27 23:08:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000541016_138534912.pth [2023-12-27 23:08:11,212][106225] Updated weights for policy 1, policy_version 543560 (0.0008) [2023-12-27 23:08:11,262][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000543568_139182080.pth... [2023-12-27 23:08:11,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000542416_138887168.pth [2023-12-27 23:08:11,315][106226] Updated weights for policy 0, policy_version 542170 (0.0009) [2023-12-27 23:08:11,405][106226] Updated weights for policy 0, policy_version 542180 (0.0009) [2023-12-27 23:08:11,455][106226] Updated weights for policy 0, policy_version 542190 (0.0008) [2023-12-27 23:08:11,513][106226] Updated weights for policy 0, policy_version 542200 (0.0008) [2023-12-27 23:08:12,003][106225] Updated weights for policy 1, policy_version 543570 (0.0010) [2023-12-27 23:08:12,065][106225] Updated weights for policy 1, policy_version 543580 (0.0011) [2023-12-27 23:08:12,126][106225] Updated weights for policy 1, policy_version 543590 (0.0010) [2023-12-27 23:08:12,196][106225] Updated weights for policy 1, policy_version 543600 (0.0011) [2023-12-27 23:08:12,265][106226] Updated weights for policy 0, policy_version 542210 (0.0007) [2023-12-27 23:08:12,324][106226] Updated weights for policy 0, policy_version 542220 (0.0008) [2023-12-27 23:08:12,391][106226] Updated weights for policy 0, policy_version 542230 (0.0008) [2023-12-27 23:08:12,844][106225] Updated weights for policy 1, policy_version 543610 (0.0008) [2023-12-27 23:08:12,905][106225] Updated weights for policy 1, policy_version 543620 (0.0008) [2023-12-27 23:08:12,954][106225] Updated weights for policy 1, policy_version 543630 (0.0008) [2023-12-27 23:08:13,126][106226] Updated weights for policy 0, policy_version 542240 (0.0006) [2023-12-27 23:08:13,182][106226] Updated weights for policy 0, policy_version 542250 (0.0005) [2023-12-27 23:08:13,233][106226] Updated weights for policy 0, policy_version 542260 (0.0005) [2023-12-27 23:08:13,679][106225] Updated weights for policy 1, policy_version 543640 (0.0008) [2023-12-27 23:08:13,747][106225] Updated weights for policy 1, policy_version 543650 (0.0007) [2023-12-27 23:08:13,783][106226] Updated weights for policy 0, policy_version 542270 (0.0007) [2023-12-27 23:08:13,811][106225] Updated weights for policy 1, policy_version 543660 (0.0005) [2023-12-27 23:08:13,839][106226] Updated weights for policy 0, policy_version 542280 (0.0008) [2023-12-27 23:08:13,891][106226] Updated weights for policy 0, policy_version 542290 (0.0009) [2023-12-27 23:08:14,459][106226] Updated weights for policy 0, policy_version 542300 (0.0006) [2023-12-27 23:08:14,473][106225] Updated weights for policy 1, policy_version 543670 (0.0007) [2023-12-27 23:08:14,505][106226] Updated weights for policy 0, policy_version 542310 (0.0005) [2023-12-27 23:08:14,530][106225] Updated weights for policy 1, policy_version 543680 (0.0008) [2023-12-27 23:08:14,555][106226] Updated weights for policy 0, policy_version 542320 (0.0006) [2023-12-27 23:08:14,589][106225] Updated weights for policy 1, policy_version 543690 (0.0007) [2023-12-27 23:08:15,236][106226] Updated weights for policy 0, policy_version 542330 (0.0008) [2023-12-27 23:08:15,295][106226] Updated weights for policy 0, policy_version 542340 (0.0011) [2023-12-27 23:08:15,359][106226] Updated weights for policy 0, policy_version 542350 (0.0007) [2023-12-27 23:08:15,361][106225] Updated weights for policy 1, policy_version 543700 (0.0008) [2023-12-27 23:08:15,411][106225] Updated weights for policy 1, policy_version 543710 (0.0009) [2023-12-27 23:08:15,416][106226] Updated weights for policy 0, policy_version 542360 (0.0009) [2023-12-27 23:08:15,460][106225] Updated weights for policy 1, policy_version 543720 (0.0008) [2023-12-27 23:08:15,971][106226] Updated weights for policy 0, policy_version 542370 (0.0007) [2023-12-27 23:08:16,031][106226] Updated weights for policy 0, policy_version 542380 (0.0008) [2023-12-27 23:08:16,089][106226] Updated weights for policy 0, policy_version 542390 (0.0008) [2023-12-27 23:08:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 278110208. Throughput: 0: 10029.5, 1: 9882.8. Samples: 278098488. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:16,175][105115] Avg episode reward: [(0, '-5.348'), (1, '-5.223')] [2023-12-27 23:08:16,245][106225] Updated weights for policy 1, policy_version 543730 (0.0009) [2023-12-27 23:08:16,302][106225] Updated weights for policy 1, policy_version 543740 (0.0008) [2023-12-27 23:08:16,369][106225] Updated weights for policy 1, policy_version 543750 (0.0009) [2023-12-27 23:08:16,421][106225] Updated weights for policy 1, policy_version 543760 (0.0008) [2023-12-27 23:08:16,744][106226] Updated weights for policy 0, policy_version 542400 (0.0006) [2023-12-27 23:08:16,800][106226] Updated weights for policy 0, policy_version 542410 (0.0005) [2023-12-27 23:08:16,858][106226] Updated weights for policy 0, policy_version 542420 (0.0008) [2023-12-27 23:08:17,037][106225] Updated weights for policy 1, policy_version 543770 (0.0008) [2023-12-27 23:08:17,081][106225] Updated weights for policy 1, policy_version 543780 (0.0007) [2023-12-27 23:08:17,137][106225] Updated weights for policy 1, policy_version 543790 (0.0009) [2023-12-27 23:08:17,441][106226] Updated weights for policy 0, policy_version 542430 (0.0009) [2023-12-27 23:08:17,497][106226] Updated weights for policy 0, policy_version 542440 (0.0010) [2023-12-27 23:08:17,561][106226] Updated weights for policy 0, policy_version 542450 (0.0011) [2023-12-27 23:08:17,931][106225] Updated weights for policy 1, policy_version 543800 (0.0008) [2023-12-27 23:08:17,981][106225] Updated weights for policy 1, policy_version 543810 (0.0008) [2023-12-27 23:08:18,042][106225] Updated weights for policy 1, policy_version 543820 (0.0007) [2023-12-27 23:08:18,189][106226] Updated weights for policy 0, policy_version 542460 (0.0006) [2023-12-27 23:08:18,250][106226] Updated weights for policy 0, policy_version 542470 (0.0007) [2023-12-27 23:08:18,317][106226] Updated weights for policy 0, policy_version 542480 (0.0007) [2023-12-27 23:08:18,792][106225] Updated weights for policy 1, policy_version 543830 (0.0008) [2023-12-27 23:08:18,859][106225] Updated weights for policy 1, policy_version 543840 (0.0009) [2023-12-27 23:08:18,921][106225] Updated weights for policy 1, policy_version 543850 (0.0008) [2023-12-27 23:08:19,008][106226] Updated weights for policy 0, policy_version 542490 (0.0009) [2023-12-27 23:08:19,071][106226] Updated weights for policy 0, policy_version 542500 (0.0008) [2023-12-27 23:08:19,126][106226] Updated weights for policy 0, policy_version 542510 (0.0005) [2023-12-27 23:08:19,175][106226] Updated weights for policy 0, policy_version 542520 (0.0007) [2023-12-27 23:08:19,717][106225] Updated weights for policy 1, policy_version 543860 (0.0009) [2023-12-27 23:08:19,771][106225] Updated weights for policy 1, policy_version 543870 (0.0008) [2023-12-27 23:08:19,838][106225] Updated weights for policy 1, policy_version 543880 (0.0009) [2023-12-27 23:08:19,899][106226] Updated weights for policy 0, policy_version 542530 (0.0009) [2023-12-27 23:08:19,976][106226] Updated weights for policy 0, policy_version 542540 (0.0008) [2023-12-27 23:08:20,032][106226] Updated weights for policy 0, policy_version 542550 (0.0009) [2023-12-27 23:08:20,613][106225] Updated weights for policy 1, policy_version 543890 (0.0008) [2023-12-27 23:08:20,670][106225] Updated weights for policy 1, policy_version 543900 (0.0009) [2023-12-27 23:08:20,731][106225] Updated weights for policy 1, policy_version 543910 (0.0008) [2023-12-27 23:08:20,795][106225] Updated weights for policy 1, policy_version 543920 (0.0007) [2023-12-27 23:08:20,802][106226] Updated weights for policy 0, policy_version 542560 (0.0011) [2023-12-27 23:08:20,875][106226] Updated weights for policy 0, policy_version 542570 (0.0011) [2023-12-27 23:08:20,951][106226] Updated weights for policy 0, policy_version 542580 (0.0008) [2023-12-27 23:08:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 278208512. Throughput: 0: 9986.1, 1: 9739.5. Samples: 278216224. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:21,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-5.410')] [2023-12-27 23:08:21,578][106225] Updated weights for policy 1, policy_version 543930 (0.0010) [2023-12-27 23:08:21,628][106226] Updated weights for policy 0, policy_version 542590 (0.0009) [2023-12-27 23:08:21,645][106225] Updated weights for policy 1, policy_version 543940 (0.0011) [2023-12-27 23:08:21,692][106226] Updated weights for policy 0, policy_version 542600 (0.0008) [2023-12-27 23:08:21,714][106225] Updated weights for policy 1, policy_version 543950 (0.0011) [2023-12-27 23:08:21,771][106226] Updated weights for policy 0, policy_version 542610 (0.0008) [2023-12-27 23:08:22,412][106225] Updated weights for policy 1, policy_version 543960 (0.0009) [2023-12-27 23:08:22,464][106225] Updated weights for policy 1, policy_version 543970 (0.0010) [2023-12-27 23:08:22,476][106226] Updated weights for policy 0, policy_version 542620 (0.0009) [2023-12-27 23:08:22,529][106225] Updated weights for policy 1, policy_version 543980 (0.0010) [2023-12-27 23:08:22,541][106226] Updated weights for policy 0, policy_version 542630 (0.0008) [2023-12-27 23:08:22,598][106226] Updated weights for policy 0, policy_version 542640 (0.0009) [2023-12-27 23:08:23,269][106226] Updated weights for policy 0, policy_version 542650 (0.0009) [2023-12-27 23:08:23,284][106225] Updated weights for policy 1, policy_version 543990 (0.0009) [2023-12-27 23:08:23,330][106226] Updated weights for policy 0, policy_version 542660 (0.0010) [2023-12-27 23:08:23,339][106225] Updated weights for policy 1, policy_version 544000 (0.0009) [2023-12-27 23:08:23,387][106226] Updated weights for policy 0, policy_version 542670 (0.0010) [2023-12-27 23:08:23,394][106225] Updated weights for policy 1, policy_version 544010 (0.0006) [2023-12-27 23:08:23,438][106226] Updated weights for policy 0, policy_version 542680 (0.0010) [2023-12-27 23:08:24,064][106225] Updated weights for policy 1, policy_version 544020 (0.0007) [2023-12-27 23:08:24,098][106226] Updated weights for policy 0, policy_version 542690 (0.0006) [2023-12-27 23:08:24,109][106225] Updated weights for policy 1, policy_version 544030 (0.0006) [2023-12-27 23:08:24,157][106226] Updated weights for policy 0, policy_version 542700 (0.0005) [2023-12-27 23:08:24,159][106225] Updated weights for policy 1, policy_version 544040 (0.0008) [2023-12-27 23:08:24,211][106226] Updated weights for policy 0, policy_version 542710 (0.0006) [2023-12-27 23:08:24,806][106226] Updated weights for policy 0, policy_version 542720 (0.0008) [2023-12-27 23:08:24,854][106225] Updated weights for policy 1, policy_version 544050 (0.0011) [2023-12-27 23:08:24,861][106226] Updated weights for policy 0, policy_version 542730 (0.0006) [2023-12-27 23:08:24,905][106225] Updated weights for policy 1, policy_version 544060 (0.0010) [2023-12-27 23:08:24,916][106226] Updated weights for policy 0, policy_version 542740 (0.0005) [2023-12-27 23:08:24,956][106225] Updated weights for policy 1, policy_version 544070 (0.0010) [2023-12-27 23:08:25,010][106225] Updated weights for policy 1, policy_version 544080 (0.0009) [2023-12-27 23:08:25,494][106226] Updated weights for policy 0, policy_version 542750 (0.0006) [2023-12-27 23:08:25,555][106226] Updated weights for policy 0, policy_version 542760 (0.0005) [2023-12-27 23:08:25,613][106226] Updated weights for policy 0, policy_version 542770 (0.0008) [2023-12-27 23:08:25,670][106225] Updated weights for policy 1, policy_version 544090 (0.0009) [2023-12-27 23:08:25,734][106225] Updated weights for policy 1, policy_version 544100 (0.0010) [2023-12-27 23:08:25,797][106225] Updated weights for policy 1, policy_version 544110 (0.0007) [2023-12-27 23:08:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 278306816. Throughput: 0: 10027.5, 1: 9674.2. Samples: 278274132. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:26,175][105115] Avg episode reward: [(0, '-5.143'), (1, '-5.639')] [2023-12-27 23:08:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000542776_138985472.pth... [2023-12-27 23:08:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000544112_139321344.pth... [2023-12-27 23:08:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000541624_138690560.pth [2023-12-27 23:08:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000542992_139034624.pth [2023-12-27 23:08:26,317][106226] Updated weights for policy 0, policy_version 542780 (0.0008) [2023-12-27 23:08:26,373][106226] Updated weights for policy 0, policy_version 542790 (0.0010) [2023-12-27 23:08:26,435][106225] Updated weights for policy 1, policy_version 544120 (0.0005) [2023-12-27 23:08:26,437][106226] Updated weights for policy 0, policy_version 542800 (0.0010) [2023-12-27 23:08:26,487][106225] Updated weights for policy 1, policy_version 544130 (0.0010) [2023-12-27 23:08:26,534][106225] Updated weights for policy 1, policy_version 544140 (0.0010) [2023-12-27 23:08:27,076][106226] Updated weights for policy 0, policy_version 542810 (0.0009) [2023-12-27 23:08:27,132][106226] Updated weights for policy 0, policy_version 542820 (0.0005) [2023-12-27 23:08:27,160][106225] Updated weights for policy 1, policy_version 544150 (0.0010) [2023-12-27 23:08:27,190][106226] Updated weights for policy 0, policy_version 542830 (0.0005) [2023-12-27 23:08:27,223][106225] Updated weights for policy 1, policy_version 544160 (0.0010) [2023-12-27 23:08:27,253][106226] Updated weights for policy 0, policy_version 542840 (0.0010) [2023-12-27 23:08:27,283][106225] Updated weights for policy 1, policy_version 544170 (0.0010) [2023-12-27 23:08:27,903][106226] Updated weights for policy 0, policy_version 542850 (0.0010) [2023-12-27 23:08:27,950][106225] Updated weights for policy 1, policy_version 544180 (0.0009) [2023-12-27 23:08:27,953][106226] Updated weights for policy 0, policy_version 542860 (0.0005) [2023-12-27 23:08:28,002][106226] Updated weights for policy 0, policy_version 542870 (0.0005) [2023-12-27 23:08:28,011][106225] Updated weights for policy 1, policy_version 544190 (0.0006) [2023-12-27 23:08:28,066][106225] Updated weights for policy 1, policy_version 544200 (0.0006) [2023-12-27 23:08:28,601][106226] Updated weights for policy 0, policy_version 542880 (0.0009) [2023-12-27 23:08:28,663][106226] Updated weights for policy 0, policy_version 542890 (0.0007) [2023-12-27 23:08:28,702][106225] Updated weights for policy 1, policy_version 544210 (0.0007) [2023-12-27 23:08:28,714][106226] Updated weights for policy 0, policy_version 542900 (0.0005) [2023-12-27 23:08:28,759][106225] Updated weights for policy 1, policy_version 544220 (0.0010) [2023-12-27 23:08:28,822][106225] Updated weights for policy 1, policy_version 544230 (0.0010) [2023-12-27 23:08:28,882][106225] Updated weights for policy 1, policy_version 544240 (0.0010) [2023-12-27 23:08:29,386][106226] Updated weights for policy 0, policy_version 542910 (0.0008) [2023-12-27 23:08:29,441][106226] Updated weights for policy 0, policy_version 542920 (0.0010) [2023-12-27 23:08:29,497][106226] Updated weights for policy 0, policy_version 542930 (0.0010) [2023-12-27 23:08:29,589][106225] Updated weights for policy 1, policy_version 544250 (0.0006) [2023-12-27 23:08:29,651][106225] Updated weights for policy 1, policy_version 544260 (0.0006) [2023-12-27 23:08:29,714][106225] Updated weights for policy 1, policy_version 544270 (0.0010) [2023-12-27 23:08:30,207][106226] Updated weights for policy 0, policy_version 542940 (0.0008) [2023-12-27 23:08:30,254][106226] Updated weights for policy 0, policy_version 542950 (0.0005) [2023-12-27 23:08:30,302][106226] Updated weights for policy 0, policy_version 542960 (0.0010) [2023-12-27 23:08:30,419][106225] Updated weights for policy 1, policy_version 544280 (0.0008) [2023-12-27 23:08:30,465][106225] Updated weights for policy 1, policy_version 544290 (0.0008) [2023-12-27 23:08:30,511][106225] Updated weights for policy 1, policy_version 544300 (0.0007) [2023-12-27 23:08:30,979][106226] Updated weights for policy 0, policy_version 542970 (0.0009) [2023-12-27 23:08:31,044][106226] Updated weights for policy 0, policy_version 542980 (0.0007) [2023-12-27 23:08:31,113][106226] Updated weights for policy 0, policy_version 542990 (0.0009) [2023-12-27 23:08:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 278405120. Throughput: 0: 10161.8, 1: 9791.4. Samples: 278401376. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:31,175][105115] Avg episode reward: [(0, '-4.956'), (1, '-5.441')] [2023-12-27 23:08:31,187][106226] Updated weights for policy 0, policy_version 543000 (0.0011) [2023-12-27 23:08:31,299][106225] Updated weights for policy 1, policy_version 544310 (0.0008) [2023-12-27 23:08:31,372][106225] Updated weights for policy 1, policy_version 544320 (0.0008) [2023-12-27 23:08:31,443][106225] Updated weights for policy 1, policy_version 544330 (0.0007) [2023-12-27 23:08:31,946][106226] Updated weights for policy 0, policy_version 543010 (0.0011) [2023-12-27 23:08:32,015][106226] Updated weights for policy 0, policy_version 543020 (0.0008) [2023-12-27 23:08:32,078][106226] Updated weights for policy 0, policy_version 543030 (0.0005) [2023-12-27 23:08:32,150][106225] Updated weights for policy 1, policy_version 544340 (0.0006) [2023-12-27 23:08:32,219][106225] Updated weights for policy 1, policy_version 544350 (0.0007) [2023-12-27 23:08:32,281][106225] Updated weights for policy 1, policy_version 544360 (0.0008) [2023-12-27 23:08:32,718][106226] Updated weights for policy 0, policy_version 543040 (0.0010) [2023-12-27 23:08:32,779][106226] Updated weights for policy 0, policy_version 543050 (0.0011) [2023-12-27 23:08:32,841][106226] Updated weights for policy 0, policy_version 543060 (0.0011) [2023-12-27 23:08:33,009][106225] Updated weights for policy 1, policy_version 544370 (0.0007) [2023-12-27 23:08:33,076][106225] Updated weights for policy 1, policy_version 544380 (0.0010) [2023-12-27 23:08:33,141][106225] Updated weights for policy 1, policy_version 544390 (0.0010) [2023-12-27 23:08:33,197][106225] Updated weights for policy 1, policy_version 544400 (0.0010) [2023-12-27 23:08:33,569][106226] Updated weights for policy 0, policy_version 543070 (0.0008) [2023-12-27 23:08:33,616][106226] Updated weights for policy 0, policy_version 543080 (0.0005) [2023-12-27 23:08:33,672][106226] Updated weights for policy 0, policy_version 543090 (0.0005) [2023-12-27 23:08:33,824][106225] Updated weights for policy 1, policy_version 544410 (0.0010) [2023-12-27 23:08:33,870][106225] Updated weights for policy 1, policy_version 544420 (0.0010) [2023-12-27 23:08:33,929][106225] Updated weights for policy 1, policy_version 544430 (0.0010) [2023-12-27 23:08:34,169][106226] Updated weights for policy 0, policy_version 543100 (0.0007) [2023-12-27 23:08:34,224][106226] Updated weights for policy 0, policy_version 543110 (0.0010) [2023-12-27 23:08:34,274][106226] Updated weights for policy 0, policy_version 543120 (0.0010) [2023-12-27 23:08:34,640][106225] Updated weights for policy 1, policy_version 544440 (0.0010) [2023-12-27 23:08:34,691][106225] Updated weights for policy 1, policy_version 544450 (0.0010) [2023-12-27 23:08:34,752][106225] Updated weights for policy 1, policy_version 544460 (0.0010) [2023-12-27 23:08:34,913][106226] Updated weights for policy 0, policy_version 543130 (0.0011) [2023-12-27 23:08:34,969][106226] Updated weights for policy 0, policy_version 543140 (0.0010) [2023-12-27 23:08:35,031][106226] Updated weights for policy 0, policy_version 543150 (0.0009) [2023-12-27 23:08:35,089][106226] Updated weights for policy 0, policy_version 543160 (0.0008) [2023-12-27 23:08:35,471][106225] Updated weights for policy 1, policy_version 544470 (0.0010) [2023-12-27 23:08:35,517][106225] Updated weights for policy 1, policy_version 544480 (0.0010) [2023-12-27 23:08:35,566][106225] Updated weights for policy 1, policy_version 544490 (0.0010) [2023-12-27 23:08:35,806][106226] Updated weights for policy 0, policy_version 543170 (0.0008) [2023-12-27 23:08:35,855][106226] Updated weights for policy 0, policy_version 543180 (0.0006) [2023-12-27 23:08:35,913][106226] Updated weights for policy 0, policy_version 543190 (0.0008) [2023-12-27 23:08:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 278511616. Throughput: 0: 10080.3, 1: 9793.3. Samples: 278521024. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:36,175][105115] Avg episode reward: [(0, '-5.305'), (1, '-5.688')] [2023-12-27 23:08:36,325][106225] Updated weights for policy 1, policy_version 544500 (0.0010) [2023-12-27 23:08:36,397][106225] Updated weights for policy 1, policy_version 544510 (0.0010) [2023-12-27 23:08:36,463][106225] Updated weights for policy 1, policy_version 544520 (0.0010) [2023-12-27 23:08:36,664][106226] Updated weights for policy 0, policy_version 543200 (0.0008) [2023-12-27 23:08:36,725][106226] Updated weights for policy 0, policy_version 543210 (0.0008) [2023-12-27 23:08:36,786][106226] Updated weights for policy 0, policy_version 543220 (0.0008) [2023-12-27 23:08:37,180][106225] Updated weights for policy 1, policy_version 544530 (0.0010) [2023-12-27 23:08:37,237][106225] Updated weights for policy 1, policy_version 544540 (0.0010) [2023-12-27 23:08:37,293][106225] Updated weights for policy 1, policy_version 544550 (0.0010) [2023-12-27 23:08:37,346][106225] Updated weights for policy 1, policy_version 544560 (0.0010) [2023-12-27 23:08:37,535][106226] Updated weights for policy 0, policy_version 543230 (0.0008) [2023-12-27 23:08:37,593][106226] Updated weights for policy 0, policy_version 543240 (0.0008) [2023-12-27 23:08:37,641][106226] Updated weights for policy 0, policy_version 543250 (0.0008) [2023-12-27 23:08:37,976][106225] Updated weights for policy 1, policy_version 544570 (0.0005) [2023-12-27 23:08:38,038][106225] Updated weights for policy 1, policy_version 544580 (0.0005) [2023-12-27 23:08:38,097][106225] Updated weights for policy 1, policy_version 544590 (0.0005) [2023-12-27 23:08:38,375][106226] Updated weights for policy 0, policy_version 543260 (0.0009) [2023-12-27 23:08:38,440][106226] Updated weights for policy 0, policy_version 543270 (0.0007) [2023-12-27 23:08:38,501][106226] Updated weights for policy 0, policy_version 543280 (0.0005) [2023-12-27 23:08:38,783][106225] Updated weights for policy 1, policy_version 544600 (0.0008) [2023-12-27 23:08:38,844][106225] Updated weights for policy 1, policy_version 544610 (0.0009) [2023-12-27 23:08:38,898][106225] Updated weights for policy 1, policy_version 544620 (0.0008) [2023-12-27 23:08:39,063][106226] Updated weights for policy 0, policy_version 543290 (0.0006) [2023-12-27 23:08:39,112][106226] Updated weights for policy 0, policy_version 543300 (0.0006) [2023-12-27 23:08:39,168][106226] Updated weights for policy 0, policy_version 543310 (0.0006) [2023-12-27 23:08:39,222][106226] Updated weights for policy 0, policy_version 543320 (0.0008) [2023-12-27 23:08:39,714][106225] Updated weights for policy 1, policy_version 544630 (0.0008) [2023-12-27 23:08:39,771][106225] Updated weights for policy 1, policy_version 544640 (0.0008) [2023-12-27 23:08:39,827][106225] Updated weights for policy 1, policy_version 544650 (0.0008) [2023-12-27 23:08:39,995][106226] Updated weights for policy 0, policy_version 543330 (0.0007) [2023-12-27 23:08:40,059][106226] Updated weights for policy 0, policy_version 543340 (0.0007) [2023-12-27 23:08:40,127][106226] Updated weights for policy 0, policy_version 543350 (0.0008) [2023-12-27 23:08:40,615][106225] Updated weights for policy 1, policy_version 544660 (0.0008) [2023-12-27 23:08:40,684][106225] Updated weights for policy 1, policy_version 544670 (0.0008) [2023-12-27 23:08:40,746][106225] Updated weights for policy 1, policy_version 544680 (0.0008) [2023-12-27 23:08:40,814][106226] Updated weights for policy 0, policy_version 543360 (0.0007) [2023-12-27 23:08:40,864][106226] Updated weights for policy 0, policy_version 543370 (0.0008) [2023-12-27 23:08:40,917][106226] Updated weights for policy 0, policy_version 543380 (0.0008) [2023-12-27 23:08:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 278609920. Throughput: 0: 10129.0, 1: 9834.5. Samples: 278580988. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:41,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-5.782')] [2023-12-27 23:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000544688_139468800.pth... [2023-12-27 23:08:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000543384_139141120.pth... [2023-12-27 23:08:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000543568_139182080.pth [2023-12-27 23:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000542168_138829824.pth [2023-12-27 23:08:41,515][106225] Updated weights for policy 1, policy_version 544690 (0.0008) [2023-12-27 23:08:41,574][106225] Updated weights for policy 1, policy_version 544700 (0.0008) [2023-12-27 23:08:41,632][106225] Updated weights for policy 1, policy_version 544710 (0.0008) [2023-12-27 23:08:41,696][106225] Updated weights for policy 1, policy_version 544720 (0.0007) [2023-12-27 23:08:41,756][106226] Updated weights for policy 0, policy_version 543390 (0.0008) [2023-12-27 23:08:41,821][106226] Updated weights for policy 0, policy_version 543400 (0.0009) [2023-12-27 23:08:41,879][106226] Updated weights for policy 0, policy_version 543410 (0.0009) [2023-12-27 23:08:42,458][106225] Updated weights for policy 1, policy_version 544730 (0.0009) [2023-12-27 23:08:42,524][106225] Updated weights for policy 1, policy_version 544740 (0.0009) [2023-12-27 23:08:42,581][106225] Updated weights for policy 1, policy_version 544750 (0.0009) [2023-12-27 23:08:42,637][106226] Updated weights for policy 0, policy_version 543420 (0.0007) [2023-12-27 23:08:42,700][106226] Updated weights for policy 0, policy_version 543430 (0.0005) [2023-12-27 23:08:42,751][106226] Updated weights for policy 0, policy_version 543440 (0.0006) [2023-12-27 23:08:43,244][106225] Updated weights for policy 1, policy_version 544760 (0.0007) [2023-12-27 23:08:43,302][106225] Updated weights for policy 1, policy_version 544770 (0.0009) [2023-12-27 23:08:43,364][106225] Updated weights for policy 1, policy_version 544780 (0.0009) [2023-12-27 23:08:43,389][106226] Updated weights for policy 0, policy_version 543450 (0.0009) [2023-12-27 23:08:43,438][106226] Updated weights for policy 0, policy_version 543460 (0.0005) [2023-12-27 23:08:43,494][106226] Updated weights for policy 0, policy_version 543470 (0.0005) [2023-12-27 23:08:43,556][106226] Updated weights for policy 0, policy_version 543480 (0.0008) [2023-12-27 23:08:44,086][106225] Updated weights for policy 1, policy_version 544790 (0.0009) [2023-12-27 23:08:44,143][106225] Updated weights for policy 1, policy_version 544800 (0.0010) [2023-12-27 23:08:44,197][106225] Updated weights for policy 1, policy_version 544810 (0.0010) [2023-12-27 23:08:44,222][106226] Updated weights for policy 0, policy_version 543490 (0.0006) [2023-12-27 23:08:44,268][106226] Updated weights for policy 0, policy_version 543500 (0.0007) [2023-12-27 23:08:44,326][106226] Updated weights for policy 0, policy_version 543510 (0.0008) [2023-12-27 23:08:44,921][106225] Updated weights for policy 1, policy_version 544820 (0.0008) [2023-12-27 23:08:44,985][106226] Updated weights for policy 0, policy_version 543520 (0.0010) [2023-12-27 23:08:44,985][106225] Updated weights for policy 1, policy_version 544830 (0.0010) [2023-12-27 23:08:45,040][106226] Updated weights for policy 0, policy_version 543530 (0.0011) [2023-12-27 23:08:45,047][106225] Updated weights for policy 1, policy_version 544840 (0.0009) [2023-12-27 23:08:45,107][106226] Updated weights for policy 0, policy_version 543540 (0.0010) [2023-12-27 23:08:45,707][106225] Updated weights for policy 1, policy_version 544850 (0.0009) [2023-12-27 23:08:45,767][106225] Updated weights for policy 1, policy_version 544860 (0.0010) [2023-12-27 23:08:45,827][106225] Updated weights for policy 1, policy_version 544870 (0.0010) [2023-12-27 23:08:45,836][106226] Updated weights for policy 0, policy_version 543550 (0.0010) [2023-12-27 23:08:45,874][106225] Updated weights for policy 1, policy_version 544880 (0.0010) [2023-12-27 23:08:45,879][106226] Updated weights for policy 0, policy_version 543560 (0.0010) [2023-12-27 23:08:45,929][106226] Updated weights for policy 0, policy_version 543570 (0.0010) [2023-12-27 23:08:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 278708224. Throughput: 0: 10128.3, 1: 9753.3. Samples: 278694884. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:46,176][105115] Avg episode reward: [(0, '-5.167'), (1, '-5.572')] [2023-12-27 23:08:46,504][106225] Updated weights for policy 1, policy_version 544890 (0.0005) [2023-12-27 23:08:46,568][106225] Updated weights for policy 1, policy_version 544900 (0.0008) [2023-12-27 23:08:46,630][106226] Updated weights for policy 0, policy_version 543580 (0.0008) [2023-12-27 23:08:46,631][106225] Updated weights for policy 1, policy_version 544910 (0.0010) [2023-12-27 23:08:46,697][106226] Updated weights for policy 0, policy_version 543590 (0.0007) [2023-12-27 23:08:46,743][106226] Updated weights for policy 0, policy_version 543600 (0.0010) [2023-12-27 23:08:47,175][106225] Updated weights for policy 1, policy_version 544920 (0.0006) [2023-12-27 23:08:47,240][106225] Updated weights for policy 1, policy_version 544930 (0.0009) [2023-12-27 23:08:47,302][106225] Updated weights for policy 1, policy_version 544940 (0.0008) [2023-12-27 23:08:47,431][106226] Updated weights for policy 0, policy_version 543610 (0.0010) [2023-12-27 23:08:47,484][106226] Updated weights for policy 0, policy_version 543620 (0.0010) [2023-12-27 23:08:47,547][106226] Updated weights for policy 0, policy_version 543630 (0.0010) [2023-12-27 23:08:47,606][106226] Updated weights for policy 0, policy_version 543640 (0.0010) [2023-12-27 23:08:47,966][106225] Updated weights for policy 1, policy_version 544950 (0.0007) [2023-12-27 23:08:48,028][106225] Updated weights for policy 1, policy_version 544960 (0.0005) [2023-12-27 23:08:48,084][106225] Updated weights for policy 1, policy_version 544970 (0.0006) [2023-12-27 23:08:48,313][106226] Updated weights for policy 0, policy_version 543650 (0.0010) [2023-12-27 23:08:48,380][106226] Updated weights for policy 0, policy_version 543660 (0.0011) [2023-12-27 23:08:48,439][106226] Updated weights for policy 0, policy_version 543670 (0.0011) [2023-12-27 23:08:48,787][106225] Updated weights for policy 1, policy_version 544980 (0.0010) [2023-12-27 23:08:48,848][106225] Updated weights for policy 1, policy_version 544990 (0.0011) [2023-12-27 23:08:48,908][106225] Updated weights for policy 1, policy_version 545000 (0.0010) [2023-12-27 23:08:49,138][106226] Updated weights for policy 0, policy_version 543680 (0.0011) [2023-12-27 23:08:49,191][106226] Updated weights for policy 0, policy_version 543690 (0.0010) [2023-12-27 23:08:49,258][106226] Updated weights for policy 0, policy_version 543700 (0.0011) [2023-12-27 23:08:49,547][106225] Updated weights for policy 1, policy_version 545010 (0.0010) [2023-12-27 23:08:49,608][106225] Updated weights for policy 1, policy_version 545020 (0.0010) [2023-12-27 23:08:49,669][106225] Updated weights for policy 1, policy_version 545030 (0.0010) [2023-12-27 23:08:49,727][106225] Updated weights for policy 1, policy_version 545040 (0.0006) [2023-12-27 23:08:49,998][106226] Updated weights for policy 0, policy_version 543710 (0.0010) [2023-12-27 23:08:50,059][106226] Updated weights for policy 0, policy_version 543720 (0.0011) [2023-12-27 23:08:50,123][106226] Updated weights for policy 0, policy_version 543730 (0.0010) [2023-12-27 23:08:50,415][106225] Updated weights for policy 1, policy_version 545050 (0.0008) [2023-12-27 23:08:50,479][106225] Updated weights for policy 1, policy_version 545060 (0.0008) [2023-12-27 23:08:50,539][106225] Updated weights for policy 1, policy_version 545070 (0.0008) [2023-12-27 23:08:50,849][106226] Updated weights for policy 0, policy_version 543740 (0.0008) [2023-12-27 23:08:50,901][106226] Updated weights for policy 0, policy_version 543750 (0.0007) [2023-12-27 23:08:50,971][106226] Updated weights for policy 0, policy_version 543760 (0.0009) [2023-12-27 23:08:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 278806528. Throughput: 0: 10071.8, 1: 9799.4. Samples: 278815288. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:51,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-5.701')] [2023-12-27 23:08:51,191][106225] Updated weights for policy 1, policy_version 545080 (0.0008) [2023-12-27 23:08:51,256][106225] Updated weights for policy 1, policy_version 545090 (0.0007) [2023-12-27 23:08:51,329][106225] Updated weights for policy 1, policy_version 545100 (0.0008) [2023-12-27 23:08:51,810][106226] Updated weights for policy 0, policy_version 543770 (0.0008) [2023-12-27 23:08:51,870][106226] Updated weights for policy 0, policy_version 543780 (0.0008) [2023-12-27 23:08:51,936][106226] Updated weights for policy 0, policy_version 543790 (0.0011) [2023-12-27 23:08:51,990][106226] Updated weights for policy 0, policy_version 543800 (0.0011) [2023-12-27 23:08:52,068][106225] Updated weights for policy 1, policy_version 545110 (0.0006) [2023-12-27 23:08:52,129][106225] Updated weights for policy 1, policy_version 545120 (0.0008) [2023-12-27 23:08:52,186][106225] Updated weights for policy 1, policy_version 545130 (0.0007) [2023-12-27 23:08:52,762][106226] Updated weights for policy 0, policy_version 543810 (0.0010) [2023-12-27 23:08:52,820][106226] Updated weights for policy 0, policy_version 543820 (0.0010) [2023-12-27 23:08:52,879][106226] Updated weights for policy 0, policy_version 543830 (0.0010) [2023-12-27 23:08:52,910][106225] Updated weights for policy 1, policy_version 545140 (0.0008) [2023-12-27 23:08:52,970][106225] Updated weights for policy 1, policy_version 545150 (0.0010) [2023-12-27 23:08:53,029][106225] Updated weights for policy 1, policy_version 545160 (0.0008) [2023-12-27 23:08:53,589][106225] Updated weights for policy 1, policy_version 545170 (0.0006) [2023-12-27 23:08:53,597][106226] Updated weights for policy 0, policy_version 543840 (0.0011) [2023-12-27 23:08:53,649][106225] Updated weights for policy 1, policy_version 545180 (0.0007) [2023-12-27 23:08:53,666][106226] Updated weights for policy 0, policy_version 543850 (0.0011) [2023-12-27 23:08:53,700][106225] Updated weights for policy 1, policy_version 545190 (0.0005) [2023-12-27 23:08:53,717][106226] Updated weights for policy 0, policy_version 543860 (0.0011) [2023-12-27 23:08:53,763][106225] Updated weights for policy 1, policy_version 545200 (0.0005) [2023-12-27 23:08:54,332][106225] Updated weights for policy 1, policy_version 545210 (0.0005) [2023-12-27 23:08:54,384][106225] Updated weights for policy 1, policy_version 545220 (0.0005) [2023-12-27 23:08:54,426][106226] Updated weights for policy 0, policy_version 543870 (0.0007) [2023-12-27 23:08:54,441][106225] Updated weights for policy 1, policy_version 545230 (0.0008) [2023-12-27 23:08:54,480][106226] Updated weights for policy 0, policy_version 543880 (0.0009) [2023-12-27 23:08:54,531][106226] Updated weights for policy 0, policy_version 543890 (0.0010) [2023-12-27 23:08:55,075][106225] Updated weights for policy 1, policy_version 545240 (0.0009) [2023-12-27 23:08:55,129][106225] Updated weights for policy 1, policy_version 545250 (0.0009) [2023-12-27 23:08:55,178][106225] Updated weights for policy 1, policy_version 545260 (0.0009) [2023-12-27 23:08:55,194][106226] Updated weights for policy 0, policy_version 543900 (0.0008) [2023-12-27 23:08:55,263][106226] Updated weights for policy 0, policy_version 543910 (0.0005) [2023-12-27 23:08:55,317][106226] Updated weights for policy 0, policy_version 543920 (0.0005) [2023-12-27 23:08:55,932][106225] Updated weights for policy 1, policy_version 545270 (0.0008) [2023-12-27 23:08:55,939][106226] Updated weights for policy 0, policy_version 543930 (0.0007) [2023-12-27 23:08:55,990][106225] Updated weights for policy 1, policy_version 545280 (0.0007) [2023-12-27 23:08:55,997][106226] Updated weights for policy 0, policy_version 543940 (0.0008) [2023-12-27 23:08:56,047][106225] Updated weights for policy 1, policy_version 545290 (0.0007) [2023-12-27 23:08:56,058][106226] Updated weights for policy 0, policy_version 543950 (0.0008) [2023-12-27 23:08:56,116][106226] Updated weights for policy 0, policy_version 543960 (0.0007) [2023-12-27 23:08:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 278913024. Throughput: 0: 10038.6, 1: 9800.2. Samples: 278873648. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:08:56,175][105115] Avg episode reward: [(0, '-5.079'), (1, '-5.329')] [2023-12-27 23:08:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000545296_139624448.pth... [2023-12-27 23:08:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000543960_139288576.pth... [2023-12-27 23:08:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000542776_138985472.pth [2023-12-27 23:08:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000544112_139321344.pth [2023-12-27 23:08:56,795][106225] Updated weights for policy 1, policy_version 545300 (0.0008) [2023-12-27 23:08:56,816][106226] Updated weights for policy 0, policy_version 543970 (0.0005) [2023-12-27 23:08:56,850][106225] Updated weights for policy 1, policy_version 545310 (0.0005) [2023-12-27 23:08:56,883][106226] Updated weights for policy 0, policy_version 543980 (0.0005) [2023-12-27 23:08:56,903][106225] Updated weights for policy 1, policy_version 545320 (0.0009) [2023-12-27 23:08:56,949][106226] Updated weights for policy 0, policy_version 543990 (0.0006) [2023-12-27 23:08:57,479][106225] Updated weights for policy 1, policy_version 545330 (0.0007) [2023-12-27 23:08:57,485][106226] Updated weights for policy 0, policy_version 544000 (0.0010) [2023-12-27 23:08:57,530][106225] Updated weights for policy 1, policy_version 545340 (0.0008) [2023-12-27 23:08:57,544][106226] Updated weights for policy 0, policy_version 544010 (0.0010) [2023-12-27 23:08:57,579][106225] Updated weights for policy 1, policy_version 545350 (0.0005) [2023-12-27 23:08:57,605][106226] Updated weights for policy 0, policy_version 544020 (0.0011) [2023-12-27 23:08:57,631][106225] Updated weights for policy 1, policy_version 545360 (0.0006) [2023-12-27 23:08:58,295][106225] Updated weights for policy 1, policy_version 545370 (0.0007) [2023-12-27 23:08:58,307][106226] Updated weights for policy 0, policy_version 544030 (0.0010) [2023-12-27 23:08:58,377][106226] Updated weights for policy 0, policy_version 544040 (0.0009) [2023-12-27 23:08:58,378][106225] Updated weights for policy 1, policy_version 545380 (0.0009) [2023-12-27 23:08:58,439][106225] Updated weights for policy 1, policy_version 545390 (0.0009) [2023-12-27 23:08:58,446][106226] Updated weights for policy 0, policy_version 544050 (0.0010) [2023-12-27 23:08:59,260][106225] Updated weights for policy 1, policy_version 545400 (0.0009) [2023-12-27 23:08:59,289][106226] Updated weights for policy 0, policy_version 544060 (0.0010) [2023-12-27 23:08:59,324][106225] Updated weights for policy 1, policy_version 545410 (0.0007) [2023-12-27 23:08:59,355][106226] Updated weights for policy 0, policy_version 544070 (0.0008) [2023-12-27 23:08:59,390][106225] Updated weights for policy 1, policy_version 545420 (0.0007) [2023-12-27 23:08:59,425][106226] Updated weights for policy 0, policy_version 544080 (0.0008) [2023-12-27 23:09:00,090][106226] Updated weights for policy 0, policy_version 544090 (0.0009) [2023-12-27 23:09:00,142][106226] Updated weights for policy 0, policy_version 544100 (0.0010) [2023-12-27 23:09:00,163][106225] Updated weights for policy 1, policy_version 545430 (0.0007) [2023-12-27 23:09:00,196][106226] Updated weights for policy 0, policy_version 544110 (0.0011) [2023-12-27 23:09:00,214][106225] Updated weights for policy 1, policy_version 545440 (0.0006) [2023-12-27 23:09:00,247][106226] Updated weights for policy 0, policy_version 544120 (0.0008) [2023-12-27 23:09:00,269][106225] Updated weights for policy 1, policy_version 545450 (0.0007) [2023-12-27 23:09:00,964][106226] Updated weights for policy 0, policy_version 544130 (0.0010) [2023-12-27 23:09:01,004][106225] Updated weights for policy 1, policy_version 545460 (0.0008) [2023-12-27 23:09:01,014][106226] Updated weights for policy 0, policy_version 544140 (0.0010) [2023-12-27 23:09:01,059][106225] Updated weights for policy 1, policy_version 545470 (0.0008) [2023-12-27 23:09:01,078][106226] Updated weights for policy 0, policy_version 544150 (0.0011) [2023-12-27 23:09:01,121][106225] Updated weights for policy 1, policy_version 545480 (0.0009) [2023-12-27 23:09:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 279011328. Throughput: 0: 10046.8, 1: 9861.2. Samples: 278994344. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:01,175][105115] Avg episode reward: [(0, '-5.251'), (1, '-5.539')] [2023-12-27 23:09:01,878][106226] Updated weights for policy 0, policy_version 544160 (0.0011) [2023-12-27 23:09:01,924][106225] Updated weights for policy 1, policy_version 545490 (0.0009) [2023-12-27 23:09:01,940][106226] Updated weights for policy 0, policy_version 544170 (0.0010) [2023-12-27 23:09:01,982][106225] Updated weights for policy 1, policy_version 545500 (0.0006) [2023-12-27 23:09:01,997][106226] Updated weights for policy 0, policy_version 544180 (0.0007) [2023-12-27 23:09:02,046][106225] Updated weights for policy 1, policy_version 545510 (0.0008) [2023-12-27 23:09:02,104][106225] Updated weights for policy 1, policy_version 545520 (0.0007) [2023-12-27 23:09:02,686][106226] Updated weights for policy 0, policy_version 544190 (0.0008) [2023-12-27 23:09:02,749][106226] Updated weights for policy 0, policy_version 544200 (0.0009) [2023-12-27 23:09:02,814][106226] Updated weights for policy 0, policy_version 544210 (0.0007) [2023-12-27 23:09:02,836][106225] Updated weights for policy 1, policy_version 545530 (0.0007) [2023-12-27 23:09:02,890][106225] Updated weights for policy 1, policy_version 545540 (0.0009) [2023-12-27 23:09:02,944][106225] Updated weights for policy 1, policy_version 545550 (0.0007) [2023-12-27 23:09:03,513][106226] Updated weights for policy 0, policy_version 544220 (0.0007) [2023-12-27 23:09:03,565][106226] Updated weights for policy 0, policy_version 544230 (0.0005) [2023-12-27 23:09:03,573][106225] Updated weights for policy 1, policy_version 545560 (0.0005) [2023-12-27 23:09:03,616][106226] Updated weights for policy 0, policy_version 544240 (0.0005) [2023-12-27 23:09:03,636][106225] Updated weights for policy 1, policy_version 545570 (0.0005) [2023-12-27 23:09:03,704][106225] Updated weights for policy 1, policy_version 545580 (0.0006) [2023-12-27 23:09:04,256][106226] Updated weights for policy 0, policy_version 544250 (0.0006) [2023-12-27 23:09:04,302][106225] Updated weights for policy 1, policy_version 545590 (0.0008) [2023-12-27 23:09:04,318][106226] Updated weights for policy 0, policy_version 544260 (0.0011) [2023-12-27 23:09:04,366][106225] Updated weights for policy 1, policy_version 545600 (0.0006) [2023-12-27 23:09:04,383][106226] Updated weights for policy 0, policy_version 544270 (0.0011) [2023-12-27 23:09:04,434][106225] Updated weights for policy 1, policy_version 545610 (0.0006) [2023-12-27 23:09:04,447][106226] Updated weights for policy 0, policy_version 544280 (0.0010) [2023-12-27 23:09:05,108][106226] Updated weights for policy 0, policy_version 544290 (0.0005) [2023-12-27 23:09:05,111][106225] Updated weights for policy 1, policy_version 545620 (0.0006) [2023-12-27 23:09:05,158][106225] Updated weights for policy 1, policy_version 545630 (0.0005) [2023-12-27 23:09:05,166][106226] Updated weights for policy 0, policy_version 544300 (0.0005) [2023-12-27 23:09:05,212][106225] Updated weights for policy 1, policy_version 545640 (0.0006) [2023-12-27 23:09:05,225][106226] Updated weights for policy 0, policy_version 544310 (0.0006) [2023-12-27 23:09:05,874][106226] Updated weights for policy 0, policy_version 544320 (0.0010) [2023-12-27 23:09:05,924][106225] Updated weights for policy 1, policy_version 545650 (0.0006) [2023-12-27 23:09:05,936][106226] Updated weights for policy 0, policy_version 544330 (0.0010) [2023-12-27 23:09:05,986][106225] Updated weights for policy 1, policy_version 545660 (0.0008) [2023-12-27 23:09:05,989][106226] Updated weights for policy 0, policy_version 544340 (0.0010) [2023-12-27 23:09:06,042][106225] Updated weights for policy 1, policy_version 545670 (0.0007) [2023-12-27 23:09:06,107][106225] Updated weights for policy 1, policy_version 545680 (0.0008) [2023-12-27 23:09:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 279109632. Throughput: 0: 9991.0, 1: 9940.5. Samples: 279113136. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:06,175][105115] Avg episode reward: [(0, '-5.041'), (1, '-5.537')] [2023-12-27 23:09:06,705][106226] Updated weights for policy 0, policy_version 544350 (0.0009) [2023-12-27 23:09:06,767][106226] Updated weights for policy 0, policy_version 544360 (0.0008) [2023-12-27 23:09:06,822][106226] Updated weights for policy 0, policy_version 544370 (0.0008) [2023-12-27 23:09:06,886][106225] Updated weights for policy 1, policy_version 545690 (0.0008) [2023-12-27 23:09:06,937][106225] Updated weights for policy 1, policy_version 545700 (0.0008) [2023-12-27 23:09:06,984][106225] Updated weights for policy 1, policy_version 545710 (0.0007) [2023-12-27 23:09:07,476][106226] Updated weights for policy 0, policy_version 544380 (0.0011) [2023-12-27 23:09:07,532][106226] Updated weights for policy 0, policy_version 544390 (0.0010) [2023-12-27 23:09:07,577][106226] Updated weights for policy 0, policy_version 544400 (0.0010) [2023-12-27 23:09:07,747][106225] Updated weights for policy 1, policy_version 545720 (0.0010) [2023-12-27 23:09:07,793][106225] Updated weights for policy 1, policy_version 545730 (0.0010) [2023-12-27 23:09:07,848][106225] Updated weights for policy 1, policy_version 545740 (0.0010) [2023-12-27 23:09:08,255][106226] Updated weights for policy 0, policy_version 544410 (0.0006) [2023-12-27 23:09:08,313][106226] Updated weights for policy 0, policy_version 544420 (0.0006) [2023-12-27 23:09:08,384][106226] Updated weights for policy 0, policy_version 544430 (0.0010) [2023-12-27 23:09:08,447][106226] Updated weights for policy 0, policy_version 544440 (0.0009) [2023-12-27 23:09:08,516][106225] Updated weights for policy 1, policy_version 545750 (0.0009) [2023-12-27 23:09:08,575][106225] Updated weights for policy 1, policy_version 545760 (0.0008) [2023-12-27 23:09:08,641][106225] Updated weights for policy 1, policy_version 545770 (0.0009) [2023-12-27 23:09:09,122][106226] Updated weights for policy 0, policy_version 544450 (0.0009) [2023-12-27 23:09:09,177][106226] Updated weights for policy 0, policy_version 544460 (0.0009) [2023-12-27 23:09:09,238][106226] Updated weights for policy 0, policy_version 544470 (0.0009) [2023-12-27 23:09:09,405][106225] Updated weights for policy 1, policy_version 545780 (0.0008) [2023-12-27 23:09:09,466][106225] Updated weights for policy 1, policy_version 545790 (0.0006) [2023-12-27 23:09:09,524][106225] Updated weights for policy 1, policy_version 545800 (0.0006) [2023-12-27 23:09:10,055][106226] Updated weights for policy 0, policy_version 544480 (0.0008) [2023-12-27 23:09:10,120][106226] Updated weights for policy 0, policy_version 544490 (0.0008) [2023-12-27 23:09:10,159][106225] Updated weights for policy 1, policy_version 545810 (0.0006) [2023-12-27 23:09:10,178][106226] Updated weights for policy 0, policy_version 544500 (0.0008) [2023-12-27 23:09:10,216][106225] Updated weights for policy 1, policy_version 545820 (0.0006) [2023-12-27 23:09:10,277][106225] Updated weights for policy 1, policy_version 545830 (0.0005) [2023-12-27 23:09:10,344][106225] Updated weights for policy 1, policy_version 545840 (0.0006) [2023-12-27 23:09:10,912][106226] Updated weights for policy 0, policy_version 544510 (0.0008) [2023-12-27 23:09:10,979][106226] Updated weights for policy 0, policy_version 544520 (0.0008) [2023-12-27 23:09:11,047][106226] Updated weights for policy 0, policy_version 544530 (0.0007) [2023-12-27 23:09:11,060][106225] Updated weights for policy 1, policy_version 545850 (0.0007) [2023-12-27 23:09:11,122][106225] Updated weights for policy 1, policy_version 545860 (0.0008) [2023-12-27 23:09:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 279199744. Throughput: 0: 10004.1, 1: 9953.6. Samples: 279172228. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:11,175][105115] Avg episode reward: [(0, '-5.174'), (1, '-5.497')] [2023-12-27 23:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000544536_139436032.pth... [2023-12-27 23:09:11,186][106225] Updated weights for policy 1, policy_version 545870 (0.0008) [2023-12-27 23:09:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000543384_139141120.pth [2023-12-27 23:09:11,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000545872_139771904.pth... [2023-12-27 23:09:11,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000544688_139468800.pth [2023-12-27 23:09:11,819][106226] Updated weights for policy 0, policy_version 544540 (0.0006) [2023-12-27 23:09:11,878][106226] Updated weights for policy 0, policy_version 544550 (0.0008) [2023-12-27 23:09:11,945][106226] Updated weights for policy 0, policy_version 544560 (0.0006) [2023-12-27 23:09:11,947][106225] Updated weights for policy 1, policy_version 545880 (0.0009) [2023-12-27 23:09:12,002][106225] Updated weights for policy 1, policy_version 545890 (0.0010) [2023-12-27 23:09:12,065][106225] Updated weights for policy 1, policy_version 545900 (0.0011) [2023-12-27 23:09:12,674][106226] Updated weights for policy 0, policy_version 544570 (0.0006) [2023-12-27 23:09:12,727][106226] Updated weights for policy 0, policy_version 544580 (0.0008) [2023-12-27 23:09:12,779][106225] Updated weights for policy 1, policy_version 545910 (0.0010) [2023-12-27 23:09:12,784][106226] Updated weights for policy 0, policy_version 544590 (0.0010) [2023-12-27 23:09:12,843][106226] Updated weights for policy 0, policy_version 544600 (0.0007) [2023-12-27 23:09:12,844][106225] Updated weights for policy 1, policy_version 545920 (0.0010) [2023-12-27 23:09:12,899][106225] Updated weights for policy 1, policy_version 545930 (0.0008) [2023-12-27 23:09:13,552][106226] Updated weights for policy 0, policy_version 544610 (0.0005) [2023-12-27 23:09:13,611][106226] Updated weights for policy 0, policy_version 544620 (0.0006) [2023-12-27 23:09:13,621][106225] Updated weights for policy 1, policy_version 545940 (0.0007) [2023-12-27 23:09:13,670][106225] Updated weights for policy 1, policy_version 545950 (0.0006) [2023-12-27 23:09:13,677][106226] Updated weights for policy 0, policy_version 544630 (0.0007) [2023-12-27 23:09:13,720][106225] Updated weights for policy 1, policy_version 545960 (0.0008) [2023-12-27 23:09:14,367][106226] Updated weights for policy 0, policy_version 544640 (0.0008) [2023-12-27 23:09:14,420][106226] Updated weights for policy 0, policy_version 544650 (0.0009) [2023-12-27 23:09:14,461][106225] Updated weights for policy 1, policy_version 545970 (0.0008) [2023-12-27 23:09:14,485][106226] Updated weights for policy 0, policy_version 544660 (0.0009) [2023-12-27 23:09:14,520][106225] Updated weights for policy 1, policy_version 545980 (0.0006) [2023-12-27 23:09:14,574][106225] Updated weights for policy 1, policy_version 545990 (0.0008) [2023-12-27 23:09:14,628][106225] Updated weights for policy 1, policy_version 546000 (0.0009) [2023-12-27 23:09:15,216][106226] Updated weights for policy 0, policy_version 544670 (0.0008) [2023-12-27 23:09:15,277][106226] Updated weights for policy 0, policy_version 544680 (0.0009) [2023-12-27 23:09:15,336][106226] Updated weights for policy 0, policy_version 544690 (0.0008) [2023-12-27 23:09:15,352][106225] Updated weights for policy 1, policy_version 546010 (0.0006) [2023-12-27 23:09:15,408][106225] Updated weights for policy 1, policy_version 546020 (0.0006) [2023-12-27 23:09:15,470][106225] Updated weights for policy 1, policy_version 546030 (0.0005) [2023-12-27 23:09:16,081][106225] Updated weights for policy 1, policy_version 546040 (0.0008) [2023-12-27 23:09:16,112][106226] Updated weights for policy 0, policy_version 544700 (0.0007) [2023-12-27 23:09:16,130][106225] Updated weights for policy 1, policy_version 546050 (0.0007) [2023-12-27 23:09:16,160][106226] Updated weights for policy 0, policy_version 544710 (0.0006) [2023-12-27 23:09:16,174][105115] Fps is (10 sec: 18022.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 279289856. Throughput: 0: 9838.9, 1: 9839.6. Samples: 279286912. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:16,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-5.663')] [2023-12-27 23:09:16,178][106225] Updated weights for policy 1, policy_version 546060 (0.0006) [2023-12-27 23:09:16,213][106226] Updated weights for policy 0, policy_version 544720 (0.0006) [2023-12-27 23:09:16,924][106225] Updated weights for policy 1, policy_version 546070 (0.0007) [2023-12-27 23:09:16,948][106226] Updated weights for policy 0, policy_version 544730 (0.0008) [2023-12-27 23:09:16,975][106225] Updated weights for policy 1, policy_version 546080 (0.0007) [2023-12-27 23:09:17,007][106226] Updated weights for policy 0, policy_version 544740 (0.0008) [2023-12-27 23:09:17,027][106225] Updated weights for policy 1, policy_version 546090 (0.0008) [2023-12-27 23:09:17,067][106226] Updated weights for policy 0, policy_version 544750 (0.0008) [2023-12-27 23:09:17,122][106226] Updated weights for policy 0, policy_version 544760 (0.0008) [2023-12-27 23:09:17,770][106225] Updated weights for policy 1, policy_version 546100 (0.0006) [2023-12-27 23:09:17,803][106226] Updated weights for policy 0, policy_version 544770 (0.0008) [2023-12-27 23:09:17,821][106225] Updated weights for policy 1, policy_version 546110 (0.0006) [2023-12-27 23:09:17,858][106226] Updated weights for policy 0, policy_version 544780 (0.0008) [2023-12-27 23:09:17,868][106225] Updated weights for policy 1, policy_version 546120 (0.0006) [2023-12-27 23:09:17,905][106226] Updated weights for policy 0, policy_version 544790 (0.0006) [2023-12-27 23:09:18,597][106225] Updated weights for policy 1, policy_version 546130 (0.0005) [2023-12-27 23:09:18,659][106225] Updated weights for policy 1, policy_version 546140 (0.0005) [2023-12-27 23:09:18,672][106226] Updated weights for policy 0, policy_version 544800 (0.0008) [2023-12-27 23:09:18,722][106225] Updated weights for policy 1, policy_version 546150 (0.0006) [2023-12-27 23:09:18,733][106226] Updated weights for policy 0, policy_version 544810 (0.0008) [2023-12-27 23:09:18,778][106225] Updated weights for policy 1, policy_version 546160 (0.0008) [2023-12-27 23:09:18,796][106226] Updated weights for policy 0, policy_version 544820 (0.0008) [2023-12-27 23:09:19,499][106225] Updated weights for policy 1, policy_version 546170 (0.0008) [2023-12-27 23:09:19,565][106225] Updated weights for policy 1, policy_version 546180 (0.0007) [2023-12-27 23:09:19,578][106226] Updated weights for policy 0, policy_version 544830 (0.0010) [2023-12-27 23:09:19,622][106225] Updated weights for policy 1, policy_version 546190 (0.0007) [2023-12-27 23:09:19,650][106226] Updated weights for policy 0, policy_version 544841 (0.0009) [2023-12-27 23:09:19,711][106226] Updated weights for policy 0, policy_version 544851 (0.0010) [2023-12-27 23:09:20,426][106226] Updated weights for policy 0, policy_version 544861 (0.0008) [2023-12-27 23:09:20,480][106225] Updated weights for policy 1, policy_version 546200 (0.0009) [2023-12-27 23:09:20,488][106226] Updated weights for policy 0, policy_version 544871 (0.0006) [2023-12-27 23:09:20,544][106225] Updated weights for policy 1, policy_version 546210 (0.0009) [2023-12-27 23:09:20,551][106226] Updated weights for policy 0, policy_version 544881 (0.0006) [2023-12-27 23:09:20,614][106225] Updated weights for policy 1, policy_version 546220 (0.0007) [2023-12-27 23:09:21,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 279388160. Throughput: 0: 9728.1, 1: 9837.9. Samples: 279401492. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:21,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-5.279')] [2023-12-27 23:09:21,235][106226] Updated weights for policy 0, policy_version 544891 (0.0009) [2023-12-27 23:09:21,270][106225] Updated weights for policy 1, policy_version 546230 (0.0008) [2023-12-27 23:09:21,301][106226] Updated weights for policy 0, policy_version 544901 (0.0011) [2023-12-27 23:09:21,335][106225] Updated weights for policy 1, policy_version 546240 (0.0007) [2023-12-27 23:09:21,372][106226] Updated weights for policy 0, policy_version 544911 (0.0011) [2023-12-27 23:09:21,403][106225] Updated weights for policy 1, policy_version 546250 (0.0008) [2023-12-27 23:09:22,048][106225] Updated weights for policy 1, policy_version 546260 (0.0007) [2023-12-27 23:09:22,120][106225] Updated weights for policy 1, policy_version 546270 (0.0005) [2023-12-27 23:09:22,181][106225] Updated weights for policy 1, policy_version 546280 (0.0006) [2023-12-27 23:09:22,196][106226] Updated weights for policy 0, policy_version 544921 (0.0010) [2023-12-27 23:09:22,257][106226] Updated weights for policy 0, policy_version 544931 (0.0009) [2023-12-27 23:09:22,321][106226] Updated weights for policy 0, policy_version 544941 (0.0009) [2023-12-27 23:09:22,391][106226] Updated weights for policy 0, policy_version 544951 (0.0008) [2023-12-27 23:09:22,837][106225] Updated weights for policy 1, policy_version 546290 (0.0006) [2023-12-27 23:09:22,905][106225] Updated weights for policy 1, policy_version 546300 (0.0007) [2023-12-27 23:09:22,963][106225] Updated weights for policy 1, policy_version 546310 (0.0009) [2023-12-27 23:09:23,031][106225] Updated weights for policy 1, policy_version 546320 (0.0010) [2023-12-27 23:09:23,127][106226] Updated weights for policy 0, policy_version 544961 (0.0008) [2023-12-27 23:09:23,187][106226] Updated weights for policy 0, policy_version 544971 (0.0006) [2023-12-27 23:09:23,247][106226] Updated weights for policy 0, policy_version 544981 (0.0006) [2023-12-27 23:09:23,688][106225] Updated weights for policy 1, policy_version 546330 (0.0008) [2023-12-27 23:09:23,741][106225] Updated weights for policy 1, policy_version 546340 (0.0008) [2023-12-27 23:09:23,794][106225] Updated weights for policy 1, policy_version 546350 (0.0008) [2023-12-27 23:09:23,906][106226] Updated weights for policy 0, policy_version 544991 (0.0008) [2023-12-27 23:09:23,958][106226] Updated weights for policy 0, policy_version 545001 (0.0008) [2023-12-27 23:09:24,008][106226] Updated weights for policy 0, policy_version 545011 (0.0008) [2023-12-27 23:09:24,414][106225] Updated weights for policy 1, policy_version 546360 (0.0006) [2023-12-27 23:09:24,474][106225] Updated weights for policy 1, policy_version 546370 (0.0009) [2023-12-27 23:09:24,543][106225] Updated weights for policy 1, policy_version 546380 (0.0009) [2023-12-27 23:09:24,798][106226] Updated weights for policy 0, policy_version 545021 (0.0009) [2023-12-27 23:09:24,850][106226] Updated weights for policy 0, policy_version 545031 (0.0008) [2023-12-27 23:09:24,900][106226] Updated weights for policy 0, policy_version 545041 (0.0009) [2023-12-27 23:09:25,225][106225] Updated weights for policy 1, policy_version 546390 (0.0008) [2023-12-27 23:09:25,288][106225] Updated weights for policy 1, policy_version 546400 (0.0005) [2023-12-27 23:09:25,355][106225] Updated weights for policy 1, policy_version 546410 (0.0005) [2023-12-27 23:09:25,556][106226] Updated weights for policy 0, policy_version 545051 (0.0008) [2023-12-27 23:09:25,610][106226] Updated weights for policy 0, policy_version 545061 (0.0008) [2023-12-27 23:09:25,655][106226] Updated weights for policy 0, policy_version 545071 (0.0008) [2023-12-27 23:09:25,972][106225] Updated weights for policy 1, policy_version 546420 (0.0008) [2023-12-27 23:09:26,029][106225] Updated weights for policy 1, policy_version 546430 (0.0008) [2023-12-27 23:09:26,094][106225] Updated weights for policy 1, policy_version 546440 (0.0008) [2023-12-27 23:09:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 279494656. Throughput: 0: 9685.1, 1: 9853.8. Samples: 279460236. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:26,175][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.484')] [2023-12-27 23:09:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000545080_139575296.pth... [2023-12-27 23:09:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000546448_139919360.pth... [2023-12-27 23:09:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000545296_139624448.pth [2023-12-27 23:09:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000543960_139288576.pth [2023-12-27 23:09:26,417][106226] Updated weights for policy 0, policy_version 545081 (0.0008) [2023-12-27 23:09:26,480][106226] Updated weights for policy 0, policy_version 545091 (0.0009) [2023-12-27 23:09:26,539][106226] Updated weights for policy 0, policy_version 545101 (0.0008) [2023-12-27 23:09:26,594][106226] Updated weights for policy 0, policy_version 545111 (0.0009) [2023-12-27 23:09:26,766][106225] Updated weights for policy 1, policy_version 546450 (0.0007) [2023-12-27 23:09:26,821][106225] Updated weights for policy 1, policy_version 546460 (0.0005) [2023-12-27 23:09:26,883][106225] Updated weights for policy 1, policy_version 546470 (0.0005) [2023-12-27 23:09:26,951][106225] Updated weights for policy 1, policy_version 546480 (0.0007) [2023-12-27 23:09:27,337][106226] Updated weights for policy 0, policy_version 545121 (0.0008) [2023-12-27 23:09:27,402][106226] Updated weights for policy 0, policy_version 545131 (0.0010) [2023-12-27 23:09:27,467][106226] Updated weights for policy 0, policy_version 545141 (0.0010) [2023-12-27 23:09:27,530][106225] Updated weights for policy 1, policy_version 546490 (0.0005) [2023-12-27 23:09:27,590][106225] Updated weights for policy 1, policy_version 546500 (0.0005) [2023-12-27 23:09:27,652][106225] Updated weights for policy 1, policy_version 546510 (0.0005) [2023-12-27 23:09:28,131][106226] Updated weights for policy 0, policy_version 545151 (0.0011) [2023-12-27 23:09:28,162][106225] Updated weights for policy 1, policy_version 546520 (0.0005) [2023-12-27 23:09:28,188][106226] Updated weights for policy 0, policy_version 545161 (0.0011) [2023-12-27 23:09:28,222][106225] Updated weights for policy 1, policy_version 546530 (0.0009) [2023-12-27 23:09:28,240][106226] Updated weights for policy 0, policy_version 545171 (0.0010) [2023-12-27 23:09:28,268][106225] Updated weights for policy 1, policy_version 546540 (0.0008) [2023-12-27 23:09:28,896][106225] Updated weights for policy 1, policy_version 546550 (0.0008) [2023-12-27 23:09:28,948][106225] Updated weights for policy 1, policy_version 546560 (0.0007) [2023-12-27 23:09:28,950][106226] Updated weights for policy 0, policy_version 545181 (0.0011) [2023-12-27 23:09:28,996][106225] Updated weights for policy 1, policy_version 546570 (0.0007) [2023-12-27 23:09:29,010][106226] Updated weights for policy 0, policy_version 545191 (0.0010) [2023-12-27 23:09:29,068][106226] Updated weights for policy 0, policy_version 545201 (0.0010) [2023-12-27 23:09:29,660][106225] Updated weights for policy 1, policy_version 546580 (0.0005) [2023-12-27 23:09:29,716][106225] Updated weights for policy 1, policy_version 546590 (0.0009) [2023-12-27 23:09:29,771][106225] Updated weights for policy 1, policy_version 546600 (0.0010) [2023-12-27 23:09:29,786][106226] Updated weights for policy 0, policy_version 545211 (0.0011) [2023-12-27 23:09:29,848][106226] Updated weights for policy 0, policy_version 545221 (0.0011) [2023-12-27 23:09:29,912][106226] Updated weights for policy 0, policy_version 545231 (0.0010) [2023-12-27 23:09:30,413][106225] Updated weights for policy 1, policy_version 546610 (0.0010) [2023-12-27 23:09:30,466][106225] Updated weights for policy 1, policy_version 546620 (0.0010) [2023-12-27 23:09:30,525][106225] Updated weights for policy 1, policy_version 546630 (0.0010) [2023-12-27 23:09:30,587][106225] Updated weights for policy 1, policy_version 546640 (0.0009) [2023-12-27 23:09:30,612][106226] Updated weights for policy 0, policy_version 545241 (0.0008) [2023-12-27 23:09:30,665][106226] Updated weights for policy 0, policy_version 545251 (0.0010) [2023-12-27 23:09:30,714][106226] Updated weights for policy 0, policy_version 545261 (0.0010) [2023-12-27 23:09:30,769][106226] Updated weights for policy 0, policy_version 545271 (0.0010) [2023-12-27 23:09:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 279592960. Throughput: 0: 9682.8, 1: 10072.3. Samples: 279583860. Policy #0 lag: (min: 1.0, avg: 15.4, max: 33.0) [2023-12-27 23:09:31,175][105115] Avg episode reward: [(0, '-5.077'), (1, '-5.404')] [2023-12-27 23:09:31,192][106225] Updated weights for policy 1, policy_version 546650 (0.0008) [2023-12-27 23:09:31,251][106225] Updated weights for policy 1, policy_version 546660 (0.0007) [2023-12-27 23:09:31,309][106225] Updated weights for policy 1, policy_version 546670 (0.0008) [2023-12-27 23:09:31,531][106226] Updated weights for policy 0, policy_version 545281 (0.0011) [2023-12-27 23:09:31,587][106226] Updated weights for policy 0, policy_version 545291 (0.0010) [2023-12-27 23:09:31,652][106226] Updated weights for policy 0, policy_version 545301 (0.0010) [2023-12-27 23:09:32,059][106225] Updated weights for policy 1, policy_version 546680 (0.0010) [2023-12-27 23:09:32,109][106225] Updated weights for policy 1, policy_version 546690 (0.0010) [2023-12-27 23:09:32,175][106225] Updated weights for policy 1, policy_version 546700 (0.0010) [2023-12-27 23:09:32,305][106226] Updated weights for policy 0, policy_version 545311 (0.0008) [2023-12-27 23:09:32,367][106226] Updated weights for policy 0, policy_version 545321 (0.0008) [2023-12-27 23:09:32,426][106226] Updated weights for policy 0, policy_version 545331 (0.0009) [2023-12-27 23:09:32,903][106225] Updated weights for policy 1, policy_version 546710 (0.0008) [2023-12-27 23:09:32,969][106225] Updated weights for policy 1, policy_version 546720 (0.0005) [2023-12-27 23:09:33,027][106225] Updated weights for policy 1, policy_version 546730 (0.0005) [2023-12-27 23:09:33,048][106226] Updated weights for policy 0, policy_version 545341 (0.0008) [2023-12-27 23:09:33,104][106226] Updated weights for policy 0, policy_version 545351 (0.0010) [2023-12-27 23:09:33,147][106226] Updated weights for policy 0, policy_version 545361 (0.0008) [2023-12-27 23:09:33,636][106225] Updated weights for policy 1, policy_version 546740 (0.0007) [2023-12-27 23:09:33,688][106225] Updated weights for policy 1, policy_version 546750 (0.0005) [2023-12-27 23:09:33,742][106225] Updated weights for policy 1, policy_version 546760 (0.0005) [2023-12-27 23:09:33,779][106226] Updated weights for policy 0, policy_version 545371 (0.0007) [2023-12-27 23:09:33,833][106226] Updated weights for policy 0, policy_version 545381 (0.0009) [2023-12-27 23:09:33,887][106226] Updated weights for policy 0, policy_version 545391 (0.0009) [2023-12-27 23:09:34,362][106225] Updated weights for policy 1, policy_version 546770 (0.0005) [2023-12-27 23:09:34,426][106225] Updated weights for policy 1, policy_version 546780 (0.0008) [2023-12-27 23:09:34,490][106225] Updated weights for policy 1, policy_version 546790 (0.0008) [2023-12-27 23:09:34,556][106225] Updated weights for policy 1, policy_version 546800 (0.0009) [2023-12-27 23:09:34,639][106226] Updated weights for policy 0, policy_version 545401 (0.0008) [2023-12-27 23:09:34,700][106226] Updated weights for policy 0, policy_version 545411 (0.0009) [2023-12-27 23:09:34,765][106226] Updated weights for policy 0, policy_version 545421 (0.0009) [2023-12-27 23:09:34,832][106226] Updated weights for policy 0, policy_version 545431 (0.0009) [2023-12-27 23:09:35,224][106225] Updated weights for policy 1, policy_version 546810 (0.0005) [2023-12-27 23:09:35,286][106225] Updated weights for policy 1, policy_version 546820 (0.0005) [2023-12-27 23:09:35,340][106225] Updated weights for policy 1, policy_version 546830 (0.0005) [2023-12-27 23:09:35,584][106226] Updated weights for policy 0, policy_version 545441 (0.0008) [2023-12-27 23:09:35,648][106226] Updated weights for policy 0, policy_version 545451 (0.0009) [2023-12-27 23:09:35,708][106226] Updated weights for policy 0, policy_version 545461 (0.0008) [2023-12-27 23:09:35,976][106225] Updated weights for policy 1, policy_version 546840 (0.0008) [2023-12-27 23:09:36,036][106225] Updated weights for policy 1, policy_version 546850 (0.0008) [2023-12-27 23:09:36,089][106225] Updated weights for policy 1, policy_version 546860 (0.0008) [2023-12-27 23:09:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 279699456. Throughput: 0: 9716.2, 1: 10066.6. Samples: 279705512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:09:36,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-5.540')] [2023-12-27 23:09:36,477][106226] Updated weights for policy 0, policy_version 545471 (0.0011) [2023-12-27 23:09:36,542][106226] Updated weights for policy 0, policy_version 545481 (0.0011) [2023-12-27 23:09:36,606][106226] Updated weights for policy 0, policy_version 545491 (0.0011) [2023-12-27 23:09:36,812][106225] Updated weights for policy 1, policy_version 546870 (0.0010) [2023-12-27 23:09:36,858][106225] Updated weights for policy 1, policy_version 546880 (0.0010) [2023-12-27 23:09:36,918][106225] Updated weights for policy 1, policy_version 546890 (0.0007) [2023-12-27 23:09:37,315][106226] Updated weights for policy 0, policy_version 545501 (0.0009) [2023-12-27 23:09:37,372][106226] Updated weights for policy 0, policy_version 545511 (0.0008) [2023-12-27 23:09:37,429][106226] Updated weights for policy 0, policy_version 545521 (0.0009) [2023-12-27 23:09:37,581][106225] Updated weights for policy 1, policy_version 546900 (0.0007) [2023-12-27 23:09:37,640][106225] Updated weights for policy 1, policy_version 546910 (0.0009) [2023-12-27 23:09:37,702][106225] Updated weights for policy 1, policy_version 546920 (0.0005) [2023-12-27 23:09:38,196][106226] Updated weights for policy 0, policy_version 545531 (0.0009) [2023-12-27 23:09:38,256][106226] Updated weights for policy 0, policy_version 545541 (0.0010) [2023-12-27 23:09:38,307][106225] Updated weights for policy 1, policy_version 546930 (0.0006) [2023-12-27 23:09:38,317][106226] Updated weights for policy 0, policy_version 545551 (0.0011) [2023-12-27 23:09:38,374][106225] Updated weights for policy 1, policy_version 546940 (0.0009) [2023-12-27 23:09:38,435][106225] Updated weights for policy 1, policy_version 546950 (0.0010) [2023-12-27 23:09:38,499][106225] Updated weights for policy 1, policy_version 546960 (0.0009) [2023-12-27 23:09:39,048][106226] Updated weights for policy 0, policy_version 545561 (0.0011) [2023-12-27 23:09:39,112][106226] Updated weights for policy 0, policy_version 545571 (0.0010) [2023-12-27 23:09:39,118][106225] Updated weights for policy 1, policy_version 546970 (0.0005) [2023-12-27 23:09:39,171][106226] Updated weights for policy 0, policy_version 545581 (0.0007) [2023-12-27 23:09:39,179][106225] Updated weights for policy 1, policy_version 546980 (0.0006) [2023-12-27 23:09:39,235][106226] Updated weights for policy 0, policy_version 545591 (0.0008) [2023-12-27 23:09:39,244][106225] Updated weights for policy 1, policy_version 546990 (0.0008) [2023-12-27 23:09:39,972][106225] Updated weights for policy 1, policy_version 547000 (0.0007) [2023-12-27 23:09:40,002][106226] Updated weights for policy 0, policy_version 545601 (0.0010) [2023-12-27 23:09:40,032][106225] Updated weights for policy 1, policy_version 547010 (0.0006) [2023-12-27 23:09:40,058][106226] Updated weights for policy 0, policy_version 545611 (0.0011) [2023-12-27 23:09:40,087][106225] Updated weights for policy 1, policy_version 547020 (0.0005) [2023-12-27 23:09:40,120][106226] Updated weights for policy 0, policy_version 545621 (0.0011) [2023-12-27 23:09:40,843][106225] Updated weights for policy 1, policy_version 547030 (0.0008) [2023-12-27 23:09:40,848][106226] Updated weights for policy 0, policy_version 545631 (0.0011) [2023-12-27 23:09:40,897][106225] Updated weights for policy 1, policy_version 547040 (0.0006) [2023-12-27 23:09:40,899][106226] Updated weights for policy 0, policy_version 545641 (0.0008) [2023-12-27 23:09:40,949][106225] Updated weights for policy 1, policy_version 547050 (0.0006) [2023-12-27 23:09:40,951][106226] Updated weights for policy 0, policy_version 545651 (0.0008) [2023-12-27 23:09:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 279797760. Throughput: 0: 9725.0, 1: 10079.1. Samples: 279764832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:09:41,175][105115] Avg episode reward: [(0, '-5.360'), (1, '-5.705')] [2023-12-27 23:09:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000545656_139722752.pth... [2023-12-27 23:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000547056_140075008.pth... [2023-12-27 23:09:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000544536_139436032.pth [2023-12-27 23:09:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000545872_139771904.pth [2023-12-27 23:09:41,728][106226] Updated weights for policy 0, policy_version 545661 (0.0012) [2023-12-27 23:09:41,792][106225] Updated weights for policy 1, policy_version 547060 (0.0007) [2023-12-27 23:09:41,797][106226] Updated weights for policy 0, policy_version 545671 (0.0008) [2023-12-27 23:09:41,851][106225] Updated weights for policy 1, policy_version 547070 (0.0007) [2023-12-27 23:09:41,861][106226] Updated weights for policy 0, policy_version 545681 (0.0008) [2023-12-27 23:09:41,911][106225] Updated weights for policy 1, policy_version 547080 (0.0006) [2023-12-27 23:09:42,652][106226] Updated weights for policy 0, policy_version 545691 (0.0009) [2023-12-27 23:09:42,674][106225] Updated weights for policy 1, policy_version 547090 (0.0008) [2023-12-27 23:09:42,715][106226] Updated weights for policy 0, policy_version 545701 (0.0007) [2023-12-27 23:09:42,729][106225] Updated weights for policy 1, policy_version 547100 (0.0006) [2023-12-27 23:09:42,774][106226] Updated weights for policy 0, policy_version 545711 (0.0007) [2023-12-27 23:09:42,792][106225] Updated weights for policy 1, policy_version 547110 (0.0006) [2023-12-27 23:09:42,851][106225] Updated weights for policy 1, policy_version 547120 (0.0008) [2023-12-27 23:09:43,490][106226] Updated weights for policy 0, policy_version 545721 (0.0007) [2023-12-27 23:09:43,546][106226] Updated weights for policy 0, policy_version 545731 (0.0009) [2023-12-27 23:09:43,576][106225] Updated weights for policy 1, policy_version 547130 (0.0008) [2023-12-27 23:09:43,600][106226] Updated weights for policy 0, policy_version 545741 (0.0007) [2023-12-27 23:09:43,630][106225] Updated weights for policy 1, policy_version 547140 (0.0008) [2023-12-27 23:09:43,653][106226] Updated weights for policy 0, policy_version 545751 (0.0009) [2023-12-27 23:09:43,689][106225] Updated weights for policy 1, policy_version 547150 (0.0009) [2023-12-27 23:09:44,271][106226] Updated weights for policy 0, policy_version 545761 (0.0008) [2023-12-27 23:09:44,322][106226] Updated weights for policy 0, policy_version 545771 (0.0008) [2023-12-27 23:09:44,380][106226] Updated weights for policy 0, policy_version 545781 (0.0008) [2023-12-27 23:09:44,443][106225] Updated weights for policy 1, policy_version 547160 (0.0008) [2023-12-27 23:09:44,489][106225] Updated weights for policy 1, policy_version 547170 (0.0009) [2023-12-27 23:09:44,541][106225] Updated weights for policy 1, policy_version 547180 (0.0008) [2023-12-27 23:09:45,180][106226] Updated weights for policy 0, policy_version 545791 (0.0008) [2023-12-27 23:09:45,250][106226] Updated weights for policy 0, policy_version 545801 (0.0008) [2023-12-27 23:09:45,257][106225] Updated weights for policy 1, policy_version 547190 (0.0008) [2023-12-27 23:09:45,312][106226] Updated weights for policy 0, policy_version 545811 (0.0007) [2023-12-27 23:09:45,325][106225] Updated weights for policy 1, policy_version 547200 (0.0009) [2023-12-27 23:09:45,386][106225] Updated weights for policy 1, policy_version 547210 (0.0009) [2023-12-27 23:09:45,966][106226] Updated weights for policy 0, policy_version 545821 (0.0009) [2023-12-27 23:09:46,023][106226] Updated weights for policy 0, policy_version 545831 (0.0008) [2023-12-27 23:09:46,081][106226] Updated weights for policy 0, policy_version 545841 (0.0008) [2023-12-27 23:09:46,129][106225] Updated weights for policy 1, policy_version 547220 (0.0007) [2023-12-27 23:09:46,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 279887872. Throughput: 0: 9637.0, 1: 9993.5. Samples: 279877716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:09:46,175][105115] Avg episode reward: [(0, '-5.110'), (1, '-5.452')] [2023-12-27 23:09:46,187][106225] Updated weights for policy 1, policy_version 547230 (0.0005) [2023-12-27 23:09:46,247][106225] Updated weights for policy 1, policy_version 547240 (0.0007) [2023-12-27 23:09:46,847][106226] Updated weights for policy 0, policy_version 545851 (0.0007) [2023-12-27 23:09:46,894][106226] Updated weights for policy 0, policy_version 545861 (0.0008) [2023-12-27 23:09:46,916][106225] Updated weights for policy 1, policy_version 547250 (0.0008) [2023-12-27 23:09:46,942][106226] Updated weights for policy 0, policy_version 545871 (0.0008) [2023-12-27 23:09:46,963][106225] Updated weights for policy 1, policy_version 547260 (0.0009) [2023-12-27 23:09:47,012][106225] Updated weights for policy 1, policy_version 547270 (0.0010) [2023-12-27 23:09:47,068][106225] Updated weights for policy 1, policy_version 547280 (0.0009) [2023-12-27 23:09:47,692][106226] Updated weights for policy 0, policy_version 545881 (0.0006) [2023-12-27 23:09:47,749][106226] Updated weights for policy 0, policy_version 545891 (0.0007) [2023-12-27 23:09:47,761][106225] Updated weights for policy 1, policy_version 547290 (0.0010) [2023-12-27 23:09:47,809][106226] Updated weights for policy 0, policy_version 545901 (0.0006) [2023-12-27 23:09:47,812][106225] Updated weights for policy 1, policy_version 547300 (0.0010) [2023-12-27 23:09:47,862][106226] Updated weights for policy 0, policy_version 545911 (0.0005) [2023-12-27 23:09:47,872][106225] Updated weights for policy 1, policy_version 547310 (0.0010) [2023-12-27 23:09:48,494][106225] Updated weights for policy 1, policy_version 547320 (0.0006) [2023-12-27 23:09:48,546][106225] Updated weights for policy 1, policy_version 547330 (0.0006) [2023-12-27 23:09:48,604][106225] Updated weights for policy 1, policy_version 547340 (0.0006) [2023-12-27 23:09:48,662][106226] Updated weights for policy 0, policy_version 545921 (0.0007) [2023-12-27 23:09:48,725][106226] Updated weights for policy 0, policy_version 545931 (0.0009) [2023-12-27 23:09:48,780][106226] Updated weights for policy 0, policy_version 545941 (0.0009) [2023-12-27 23:09:49,196][106225] Updated weights for policy 1, policy_version 547350 (0.0010) [2023-12-27 23:09:49,267][106225] Updated weights for policy 1, policy_version 547360 (0.0011) [2023-12-27 23:09:49,330][106225] Updated weights for policy 1, policy_version 547370 (0.0008) [2023-12-27 23:09:49,488][106226] Updated weights for policy 0, policy_version 545951 (0.0010) [2023-12-27 23:09:49,556][106226] Updated weights for policy 0, policy_version 545961 (0.0010) [2023-12-27 23:09:49,618][106226] Updated weights for policy 0, policy_version 545971 (0.0008) [2023-12-27 23:09:50,002][106225] Updated weights for policy 1, policy_version 547380 (0.0009) [2023-12-27 23:09:50,067][106225] Updated weights for policy 1, policy_version 547390 (0.0011) [2023-12-27 23:09:50,129][106225] Updated weights for policy 1, policy_version 547400 (0.0010) [2023-12-27 23:09:50,383][106226] Updated weights for policy 0, policy_version 545981 (0.0008) [2023-12-27 23:09:50,443][106226] Updated weights for policy 0, policy_version 545991 (0.0006) [2023-12-27 23:09:50,509][106226] Updated weights for policy 0, policy_version 546001 (0.0008) [2023-12-27 23:09:50,857][106225] Updated weights for policy 1, policy_version 547410 (0.0011) [2023-12-27 23:09:50,922][106225] Updated weights for policy 1, policy_version 547420 (0.0010) [2023-12-27 23:09:50,988][106225] Updated weights for policy 1, policy_version 547430 (0.0010) [2023-12-27 23:09:51,056][106225] Updated weights for policy 1, policy_version 547440 (0.0009) [2023-12-27 23:09:51,150][106226] Updated weights for policy 0, policy_version 546011 (0.0008) [2023-12-27 23:09:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 279986176. Throughput: 0: 9584.2, 1: 10046.9. Samples: 279996536. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:09:51,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.324')] [2023-12-27 23:09:51,205][106226] Updated weights for policy 0, policy_version 546021 (0.0006) [2023-12-27 23:09:51,266][106226] Updated weights for policy 0, policy_version 546031 (0.0006) [2023-12-27 23:09:51,788][106225] Updated weights for policy 1, policy_version 547450 (0.0008) [2023-12-27 23:09:51,840][106225] Updated weights for policy 1, policy_version 547460 (0.0008) [2023-12-27 23:09:51,898][106225] Updated weights for policy 1, policy_version 547470 (0.0008) [2023-12-27 23:09:51,939][106226] Updated weights for policy 0, policy_version 546041 (0.0007) [2023-12-27 23:09:52,001][106226] Updated weights for policy 0, policy_version 546051 (0.0008) [2023-12-27 23:09:52,064][106226] Updated weights for policy 0, policy_version 546061 (0.0009) [2023-12-27 23:09:52,117][106226] Updated weights for policy 0, policy_version 546071 (0.0008) [2023-12-27 23:09:52,669][106225] Updated weights for policy 1, policy_version 547480 (0.0010) [2023-12-27 23:09:52,730][106225] Updated weights for policy 1, policy_version 547490 (0.0010) [2023-12-27 23:09:52,799][106225] Updated weights for policy 1, policy_version 547500 (0.0011) [2023-12-27 23:09:52,887][106226] Updated weights for policy 0, policy_version 546081 (0.0008) [2023-12-27 23:09:52,942][106226] Updated weights for policy 0, policy_version 546091 (0.0008) [2023-12-27 23:09:52,989][106226] Updated weights for policy 0, policy_version 546101 (0.0007) [2023-12-27 23:09:53,483][106225] Updated weights for policy 1, policy_version 547510 (0.0010) [2023-12-27 23:09:53,528][106225] Updated weights for policy 1, policy_version 547520 (0.0008) [2023-12-27 23:09:53,585][106225] Updated weights for policy 1, policy_version 547530 (0.0008) [2023-12-27 23:09:53,739][106226] Updated weights for policy 0, policy_version 546111 (0.0008) [2023-12-27 23:09:53,793][106226] Updated weights for policy 0, policy_version 546121 (0.0007) [2023-12-27 23:09:53,850][106226] Updated weights for policy 0, policy_version 546131 (0.0008) [2023-12-27 23:09:54,346][106225] Updated weights for policy 1, policy_version 547540 (0.0009) [2023-12-27 23:09:54,399][106225] Updated weights for policy 1, policy_version 547550 (0.0010) [2023-12-27 23:09:54,453][106225] Updated weights for policy 1, policy_version 547560 (0.0009) [2023-12-27 23:09:54,555][106226] Updated weights for policy 0, policy_version 546141 (0.0009) [2023-12-27 23:09:54,620][106226] Updated weights for policy 0, policy_version 546151 (0.0008) [2023-12-27 23:09:54,674][106226] Updated weights for policy 0, policy_version 546161 (0.0008) [2023-12-27 23:09:55,151][106225] Updated weights for policy 1, policy_version 547570 (0.0006) [2023-12-27 23:09:55,209][106225] Updated weights for policy 1, policy_version 547580 (0.0010) [2023-12-27 23:09:55,256][106225] Updated weights for policy 1, policy_version 547590 (0.0010) [2023-12-27 23:09:55,314][106225] Updated weights for policy 1, policy_version 547600 (0.0010) [2023-12-27 23:09:55,343][106226] Updated weights for policy 0, policy_version 546171 (0.0008) [2023-12-27 23:09:55,391][106226] Updated weights for policy 0, policy_version 546181 (0.0008) [2023-12-27 23:09:55,444][106226] Updated weights for policy 0, policy_version 546191 (0.0008) [2023-12-27 23:09:56,046][106225] Updated weights for policy 1, policy_version 547610 (0.0010) [2023-12-27 23:09:56,102][106225] Updated weights for policy 1, policy_version 547620 (0.0007) [2023-12-27 23:09:56,161][106225] Updated weights for policy 1, policy_version 547630 (0.0008) [2023-12-27 23:09:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 280084480. Throughput: 0: 9547.2, 1: 10033.6. Samples: 280053364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:09:56,176][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.833')] [2023-12-27 23:09:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000547632_140222464.pth... [2023-12-27 23:09:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000546448_139919360.pth [2023-12-27 23:09:56,199][106226] Updated weights for policy 0, policy_version 546201 (0.0008) [2023-12-27 23:09:56,264][106226] Updated weights for policy 0, policy_version 546211 (0.0009) [2023-12-27 23:09:56,327][106226] Updated weights for policy 0, policy_version 546221 (0.0006) [2023-12-27 23:09:56,395][106226] Updated weights for policy 0, policy_version 546231 (0.0007) [2023-12-27 23:09:56,400][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000546232_139870208.pth... [2023-12-27 23:09:56,405][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000545080_139575296.pth [2023-12-27 23:09:56,783][106225] Updated weights for policy 1, policy_version 547640 (0.0006) [2023-12-27 23:09:56,837][106225] Updated weights for policy 1, policy_version 547650 (0.0009) [2023-12-27 23:09:56,890][106225] Updated weights for policy 1, policy_version 547660 (0.0010) [2023-12-27 23:09:57,106][106226] Updated weights for policy 0, policy_version 546241 (0.0008) [2023-12-27 23:09:57,154][106226] Updated weights for policy 0, policy_version 546251 (0.0005) [2023-12-27 23:09:57,199][106226] Updated weights for policy 0, policy_version 546261 (0.0005) [2023-12-27 23:09:57,571][106225] Updated weights for policy 1, policy_version 547670 (0.0010) [2023-12-27 23:09:57,617][106225] Updated weights for policy 1, policy_version 547680 (0.0010) [2023-12-27 23:09:57,662][106225] Updated weights for policy 1, policy_version 547690 (0.0009) [2023-12-27 23:09:57,781][106226] Updated weights for policy 0, policy_version 546271 (0.0005) [2023-12-27 23:09:57,834][106226] Updated weights for policy 0, policy_version 546281 (0.0007) [2023-12-27 23:09:57,877][106226] Updated weights for policy 0, policy_version 546291 (0.0005) [2023-12-27 23:09:58,290][106225] Updated weights for policy 1, policy_version 547700 (0.0007) [2023-12-27 23:09:58,353][106225] Updated weights for policy 1, policy_version 547710 (0.0007) [2023-12-27 23:09:58,426][106225] Updated weights for policy 1, policy_version 547720 (0.0007) [2023-12-27 23:09:58,610][106226] Updated weights for policy 0, policy_version 546301 (0.0007) [2023-12-27 23:09:58,680][106226] Updated weights for policy 0, policy_version 546311 (0.0008) [2023-12-27 23:09:58,743][106226] Updated weights for policy 0, policy_version 546321 (0.0008) [2023-12-27 23:09:59,112][106225] Updated weights for policy 1, policy_version 547730 (0.0008) [2023-12-27 23:09:59,172][106225] Updated weights for policy 1, policy_version 547740 (0.0009) [2023-12-27 23:09:59,247][106225] Updated weights for policy 1, policy_version 547750 (0.0008) [2023-12-27 23:09:59,305][106225] Updated weights for policy 1, policy_version 547760 (0.0008) [2023-12-27 23:09:59,598][106226] Updated weights for policy 0, policy_version 546331 (0.0008) [2023-12-27 23:09:59,660][106226] Updated weights for policy 0, policy_version 546341 (0.0007) [2023-12-27 23:09:59,720][106226] Updated weights for policy 0, policy_version 546351 (0.0006) [2023-12-27 23:10:00,066][106225] Updated weights for policy 1, policy_version 547770 (0.0006) [2023-12-27 23:10:00,120][106225] Updated weights for policy 1, policy_version 547780 (0.0006) [2023-12-27 23:10:00,173][106225] Updated weights for policy 1, policy_version 547790 (0.0006) [2023-12-27 23:10:00,369][106226] Updated weights for policy 0, policy_version 546361 (0.0006) [2023-12-27 23:10:00,430][106226] Updated weights for policy 0, policy_version 546371 (0.0009) [2023-12-27 23:10:00,487][106226] Updated weights for policy 0, policy_version 546381 (0.0007) [2023-12-27 23:10:00,552][106226] Updated weights for policy 0, policy_version 546391 (0.0009) [2023-12-27 23:10:00,748][106225] Updated weights for policy 1, policy_version 547800 (0.0006) [2023-12-27 23:10:00,796][106225] Updated weights for policy 1, policy_version 547810 (0.0009) [2023-12-27 23:10:00,845][106225] Updated weights for policy 1, policy_version 547820 (0.0010) [2023-12-27 23:10:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 280182784. Throughput: 0: 9592.6, 1: 10091.3. Samples: 280172688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:01,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.103')] [2023-12-27 23:10:01,298][106226] Updated weights for policy 0, policy_version 546401 (0.0009) [2023-12-27 23:10:01,366][106226] Updated weights for policy 0, policy_version 546411 (0.0008) [2023-12-27 23:10:01,428][106226] Updated weights for policy 0, policy_version 546421 (0.0009) [2023-12-27 23:10:01,620][106225] Updated weights for policy 1, policy_version 547830 (0.0008) [2023-12-27 23:10:01,688][106225] Updated weights for policy 1, policy_version 547840 (0.0008) [2023-12-27 23:10:01,754][106225] Updated weights for policy 1, policy_version 547850 (0.0007) [2023-12-27 23:10:02,251][106226] Updated weights for policy 0, policy_version 546431 (0.0010) [2023-12-27 23:10:02,316][106226] Updated weights for policy 0, policy_version 546441 (0.0008) [2023-12-27 23:10:02,326][106225] Updated weights for policy 1, policy_version 547860 (0.0007) [2023-12-27 23:10:02,380][106226] Updated weights for policy 0, policy_version 546451 (0.0008) [2023-12-27 23:10:02,385][106225] Updated weights for policy 1, policy_version 547870 (0.0006) [2023-12-27 23:10:02,448][106225] Updated weights for policy 1, policy_version 547880 (0.0007) [2023-12-27 23:10:02,966][106226] Updated weights for policy 0, policy_version 546461 (0.0007) [2023-12-27 23:10:03,029][106226] Updated weights for policy 0, policy_version 546471 (0.0005) [2023-12-27 23:10:03,088][106226] Updated weights for policy 0, policy_version 546481 (0.0005) [2023-12-27 23:10:03,166][106225] Updated weights for policy 1, policy_version 547890 (0.0006) [2023-12-27 23:10:03,215][106225] Updated weights for policy 1, policy_version 547900 (0.0005) [2023-12-27 23:10:03,276][106225] Updated weights for policy 1, policy_version 547910 (0.0008) [2023-12-27 23:10:03,335][106225] Updated weights for policy 1, policy_version 547920 (0.0008) [2023-12-27 23:10:03,702][106226] Updated weights for policy 0, policy_version 546491 (0.0009) [2023-12-27 23:10:03,772][106226] Updated weights for policy 0, policy_version 546501 (0.0011) [2023-12-27 23:10:03,836][106226] Updated weights for policy 0, policy_version 546511 (0.0010) [2023-12-27 23:10:03,997][106225] Updated weights for policy 1, policy_version 547930 (0.0009) [2023-12-27 23:10:04,061][106225] Updated weights for policy 1, policy_version 547940 (0.0010) [2023-12-27 23:10:04,128][106225] Updated weights for policy 1, policy_version 547950 (0.0010) [2023-12-27 23:10:04,536][106226] Updated weights for policy 0, policy_version 546521 (0.0007) [2023-12-27 23:10:04,594][106226] Updated weights for policy 0, policy_version 546531 (0.0010) [2023-12-27 23:10:04,654][106226] Updated weights for policy 0, policy_version 546541 (0.0010) [2023-12-27 23:10:04,711][106226] Updated weights for policy 0, policy_version 546551 (0.0011) [2023-12-27 23:10:04,762][106225] Updated weights for policy 1, policy_version 547960 (0.0010) [2023-12-27 23:10:04,819][106225] Updated weights for policy 1, policy_version 547970 (0.0010) [2023-12-27 23:10:04,871][106225] Updated weights for policy 1, policy_version 547980 (0.0010) [2023-12-27 23:10:05,408][106226] Updated weights for policy 0, policy_version 546561 (0.0010) [2023-12-27 23:10:05,467][106226] Updated weights for policy 0, policy_version 546571 (0.0010) [2023-12-27 23:10:05,527][106225] Updated weights for policy 1, policy_version 547990 (0.0009) [2023-12-27 23:10:05,527][106226] Updated weights for policy 0, policy_version 546581 (0.0010) [2023-12-27 23:10:05,584][106225] Updated weights for policy 1, policy_version 548000 (0.0010) [2023-12-27 23:10:05,633][106225] Updated weights for policy 1, policy_version 548010 (0.0010) [2023-12-27 23:10:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 280281088. Throughput: 0: 9666.0, 1: 10184.5. Samples: 280294768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:06,175][105115] Avg episode reward: [(0, '-5.350'), (1, '-5.404')] [2023-12-27 23:10:06,198][106226] Updated weights for policy 0, policy_version 546591 (0.0011) [2023-12-27 23:10:06,264][106226] Updated weights for policy 0, policy_version 546601 (0.0006) [2023-12-27 23:10:06,331][106226] Updated weights for policy 0, policy_version 546611 (0.0007) [2023-12-27 23:10:06,346][106225] Updated weights for policy 1, policy_version 548020 (0.0010) [2023-12-27 23:10:06,418][106225] Updated weights for policy 1, policy_version 548030 (0.0010) [2023-12-27 23:10:06,512][106225] Updated weights for policy 1, policy_version 548040 (0.0011) [2023-12-27 23:10:06,939][106226] Updated weights for policy 0, policy_version 546621 (0.0007) [2023-12-27 23:10:06,992][106226] Updated weights for policy 0, policy_version 546631 (0.0010) [2023-12-27 23:10:07,039][106226] Updated weights for policy 0, policy_version 546641 (0.0010) [2023-12-27 23:10:07,132][106225] Updated weights for policy 1, policy_version 548050 (0.0008) [2023-12-27 23:10:07,186][106225] Updated weights for policy 1, policy_version 548060 (0.0010) [2023-12-27 23:10:07,237][106225] Updated weights for policy 1, policy_version 548070 (0.0010) [2023-12-27 23:10:07,290][106225] Updated weights for policy 1, policy_version 548080 (0.0010) [2023-12-27 23:10:07,716][106226] Updated weights for policy 0, policy_version 546651 (0.0010) [2023-12-27 23:10:07,767][106226] Updated weights for policy 0, policy_version 546661 (0.0009) [2023-12-27 23:10:07,816][106226] Updated weights for policy 0, policy_version 546671 (0.0008) [2023-12-27 23:10:07,931][106225] Updated weights for policy 1, policy_version 548090 (0.0010) [2023-12-27 23:10:07,980][106225] Updated weights for policy 1, policy_version 548100 (0.0010) [2023-12-27 23:10:08,032][106225] Updated weights for policy 1, policy_version 548110 (0.0010) [2023-12-27 23:10:08,562][106226] Updated weights for policy 0, policy_version 546681 (0.0008) [2023-12-27 23:10:08,624][106226] Updated weights for policy 0, policy_version 546691 (0.0008) [2023-12-27 23:10:08,679][106226] Updated weights for policy 0, policy_version 546701 (0.0009) [2023-12-27 23:10:08,736][106226] Updated weights for policy 0, policy_version 546711 (0.0007) [2023-12-27 23:10:08,780][106225] Updated weights for policy 1, policy_version 548120 (0.0010) [2023-12-27 23:10:08,830][106225] Updated weights for policy 1, policy_version 548130 (0.0010) [2023-12-27 23:10:08,887][106225] Updated weights for policy 1, policy_version 548140 (0.0010) [2023-12-27 23:10:09,520][106226] Updated weights for policy 0, policy_version 546721 (0.0009) [2023-12-27 23:10:09,581][106225] Updated weights for policy 1, policy_version 548150 (0.0008) [2023-12-27 23:10:09,586][106226] Updated weights for policy 0, policy_version 546731 (0.0008) [2023-12-27 23:10:09,647][106225] Updated weights for policy 1, policy_version 548160 (0.0008) [2023-12-27 23:10:09,648][106226] Updated weights for policy 0, policy_version 546741 (0.0007) [2023-12-27 23:10:09,708][106225] Updated weights for policy 1, policy_version 548170 (0.0008) [2023-12-27 23:10:10,465][106226] Updated weights for policy 0, policy_version 546751 (0.0008) [2023-12-27 23:10:10,522][106225] Updated weights for policy 1, policy_version 548180 (0.0007) [2023-12-27 23:10:10,528][106226] Updated weights for policy 0, policy_version 546761 (0.0008) [2023-12-27 23:10:10,582][106225] Updated weights for policy 1, policy_version 548190 (0.0007) [2023-12-27 23:10:10,584][106226] Updated weights for policy 0, policy_version 546771 (0.0006) [2023-12-27 23:10:10,645][106225] Updated weights for policy 1, policy_version 548200 (0.0006) [2023-12-27 23:10:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 280379392. Throughput: 0: 9710.2, 1: 10171.9. Samples: 280354932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:11,175][105115] Avg episode reward: [(0, '-5.040'), (1, '-5.244')] [2023-12-27 23:10:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000548208_140369920.pth... [2023-12-27 23:10:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000546776_140009472.pth... [2023-12-27 23:10:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000547056_140075008.pth [2023-12-27 23:10:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000545656_139722752.pth [2023-12-27 23:10:11,284][106225] Updated weights for policy 1, policy_version 548210 (0.0005) [2023-12-27 23:10:11,344][106225] Updated weights for policy 1, policy_version 548220 (0.0007) [2023-12-27 23:10:11,365][106226] Updated weights for policy 0, policy_version 546781 (0.0007) [2023-12-27 23:10:11,415][106225] Updated weights for policy 1, policy_version 548230 (0.0007) [2023-12-27 23:10:11,447][106226] Updated weights for policy 0, policy_version 546791 (0.0010) [2023-12-27 23:10:11,487][106225] Updated weights for policy 1, policy_version 548240 (0.0007) [2023-12-27 23:10:11,502][106226] Updated weights for policy 0, policy_version 546801 (0.0007) [2023-12-27 23:10:12,259][106225] Updated weights for policy 1, policy_version 548250 (0.0009) [2023-12-27 23:10:12,271][106226] Updated weights for policy 0, policy_version 546811 (0.0009) [2023-12-27 23:10:12,319][106225] Updated weights for policy 1, policy_version 548260 (0.0007) [2023-12-27 23:10:12,341][106226] Updated weights for policy 0, policy_version 546821 (0.0008) [2023-12-27 23:10:12,385][106225] Updated weights for policy 1, policy_version 548270 (0.0008) [2023-12-27 23:10:12,397][106226] Updated weights for policy 0, policy_version 546831 (0.0008) [2023-12-27 23:10:13,041][106225] Updated weights for policy 1, policy_version 548280 (0.0006) [2023-12-27 23:10:13,094][106226] Updated weights for policy 0, policy_version 546841 (0.0007) [2023-12-27 23:10:13,100][106225] Updated weights for policy 1, policy_version 548290 (0.0006) [2023-12-27 23:10:13,141][106226] Updated weights for policy 0, policy_version 546851 (0.0006) [2023-12-27 23:10:13,154][106225] Updated weights for policy 1, policy_version 548300 (0.0007) [2023-12-27 23:10:13,193][106226] Updated weights for policy 0, policy_version 546861 (0.0006) [2023-12-27 23:10:13,242][106226] Updated weights for policy 0, policy_version 546871 (0.0008) [2023-12-27 23:10:13,747][106225] Updated weights for policy 1, policy_version 548310 (0.0007) [2023-12-27 23:10:13,794][106225] Updated weights for policy 1, policy_version 548320 (0.0007) [2023-12-27 23:10:13,851][106225] Updated weights for policy 1, policy_version 548330 (0.0010) [2023-12-27 23:10:13,881][106226] Updated weights for policy 0, policy_version 546881 (0.0006) [2023-12-27 23:10:13,930][106226] Updated weights for policy 0, policy_version 546891 (0.0005) [2023-12-27 23:10:13,990][106226] Updated weights for policy 0, policy_version 546901 (0.0005) [2023-12-27 23:10:14,538][106226] Updated weights for policy 0, policy_version 546911 (0.0005) [2023-12-27 23:10:14,538][106225] Updated weights for policy 1, policy_version 548340 (0.0010) [2023-12-27 23:10:14,601][106226] Updated weights for policy 0, policy_version 546921 (0.0007) [2023-12-27 23:10:14,604][106225] Updated weights for policy 1, policy_version 548350 (0.0009) [2023-12-27 23:10:14,657][106226] Updated weights for policy 0, policy_version 546931 (0.0005) [2023-12-27 23:10:14,661][106225] Updated weights for policy 1, policy_version 548360 (0.0010) [2023-12-27 23:10:15,304][106226] Updated weights for policy 0, policy_version 546941 (0.0006) [2023-12-27 23:10:15,357][106226] Updated weights for policy 0, policy_version 546951 (0.0007) [2023-12-27 23:10:15,409][106225] Updated weights for policy 1, policy_version 548370 (0.0010) [2023-12-27 23:10:15,416][106226] Updated weights for policy 0, policy_version 546961 (0.0008) [2023-12-27 23:10:15,468][106225] Updated weights for policy 1, policy_version 548380 (0.0010) [2023-12-27 23:10:15,529][106225] Updated weights for policy 1, policy_version 548390 (0.0010) [2023-12-27 23:10:15,592][106225] Updated weights for policy 1, policy_version 548400 (0.0010) [2023-12-27 23:10:16,142][106226] Updated weights for policy 0, policy_version 546971 (0.0010) [2023-12-27 23:10:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 280477696. Throughput: 0: 9729.4, 1: 10036.2. Samples: 280473316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:16,176][105115] Avg episode reward: [(0, '-5.051'), (1, '-5.428')] [2023-12-27 23:10:16,206][106226] Updated weights for policy 0, policy_version 546981 (0.0008) [2023-12-27 23:10:16,242][106225] Updated weights for policy 1, policy_version 548410 (0.0007) [2023-12-27 23:10:16,263][106226] Updated weights for policy 0, policy_version 546991 (0.0007) [2023-12-27 23:10:16,296][106225] Updated weights for policy 1, policy_version 548420 (0.0010) [2023-12-27 23:10:16,339][106225] Updated weights for policy 1, policy_version 548430 (0.0010) [2023-12-27 23:10:16,962][106226] Updated weights for policy 0, policy_version 547001 (0.0006) [2023-12-27 23:10:16,983][106225] Updated weights for policy 1, policy_version 548440 (0.0008) [2023-12-27 23:10:17,011][106226] Updated weights for policy 0, policy_version 547011 (0.0010) [2023-12-27 23:10:17,034][106225] Updated weights for policy 1, policy_version 548450 (0.0008) [2023-12-27 23:10:17,062][106226] Updated weights for policy 0, policy_version 547021 (0.0007) [2023-12-27 23:10:17,096][106225] Updated weights for policy 1, policy_version 548460 (0.0005) [2023-12-27 23:10:17,108][106226] Updated weights for policy 0, policy_version 547031 (0.0008) [2023-12-27 23:10:17,708][106225] Updated weights for policy 1, policy_version 548470 (0.0007) [2023-12-27 23:10:17,758][106225] Updated weights for policy 1, policy_version 548480 (0.0009) [2023-12-27 23:10:17,803][106225] Updated weights for policy 1, policy_version 548490 (0.0008) [2023-12-27 23:10:17,873][106226] Updated weights for policy 0, policy_version 547041 (0.0008) [2023-12-27 23:10:17,919][106226] Updated weights for policy 0, policy_version 547051 (0.0008) [2023-12-27 23:10:17,971][106226] Updated weights for policy 0, policy_version 547061 (0.0009) [2023-12-27 23:10:18,488][106225] Updated weights for policy 1, policy_version 548500 (0.0007) [2023-12-27 23:10:18,543][106225] Updated weights for policy 1, policy_version 548510 (0.0008) [2023-12-27 23:10:18,603][106225] Updated weights for policy 1, policy_version 548520 (0.0008) [2023-12-27 23:10:18,758][106226] Updated weights for policy 0, policy_version 547071 (0.0008) [2023-12-27 23:10:18,826][106226] Updated weights for policy 0, policy_version 547081 (0.0007) [2023-12-27 23:10:18,883][106226] Updated weights for policy 0, policy_version 547091 (0.0009) [2023-12-27 23:10:19,327][106225] Updated weights for policy 1, policy_version 548530 (0.0007) [2023-12-27 23:10:19,396][106225] Updated weights for policy 1, policy_version 548540 (0.0008) [2023-12-27 23:10:19,458][106225] Updated weights for policy 1, policy_version 548550 (0.0007) [2023-12-27 23:10:19,520][106225] Updated weights for policy 1, policy_version 548560 (0.0008) [2023-12-27 23:10:19,648][106226] Updated weights for policy 0, policy_version 547101 (0.0009) [2023-12-27 23:10:19,707][106226] Updated weights for policy 0, policy_version 547111 (0.0010) [2023-12-27 23:10:19,761][106226] Updated weights for policy 0, policy_version 547121 (0.0010) [2023-12-27 23:10:20,150][106225] Updated weights for policy 1, policy_version 548570 (0.0007) [2023-12-27 23:10:20,207][106225] Updated weights for policy 1, policy_version 548580 (0.0008) [2023-12-27 23:10:20,276][106225] Updated weights for policy 1, policy_version 548590 (0.0006) [2023-12-27 23:10:20,579][106226] Updated weights for policy 0, policy_version 547131 (0.0009) [2023-12-27 23:10:20,637][106226] Updated weights for policy 0, policy_version 547141 (0.0009) [2023-12-27 23:10:20,691][106226] Updated weights for policy 0, policy_version 547151 (0.0009) [2023-12-27 23:10:20,941][106225] Updated weights for policy 1, policy_version 548600 (0.0008) [2023-12-27 23:10:21,009][106225] Updated weights for policy 1, policy_version 548610 (0.0008) [2023-12-27 23:10:21,078][106225] Updated weights for policy 1, policy_version 548620 (0.0008) [2023-12-27 23:10:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 280584192. Throughput: 0: 9649.2, 1: 10034.7. Samples: 280591288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:21,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-5.433')] [2023-12-27 23:10:21,452][106226] Updated weights for policy 0, policy_version 547161 (0.0009) [2023-12-27 23:10:21,512][106226] Updated weights for policy 0, policy_version 547171 (0.0009) [2023-12-27 23:10:21,572][106226] Updated weights for policy 0, policy_version 547181 (0.0008) [2023-12-27 23:10:21,643][106226] Updated weights for policy 0, policy_version 547191 (0.0007) [2023-12-27 23:10:21,878][106225] Updated weights for policy 1, policy_version 548630 (0.0009) [2023-12-27 23:10:21,928][106225] Updated weights for policy 1, policy_version 548640 (0.0010) [2023-12-27 23:10:21,986][106225] Updated weights for policy 1, policy_version 548650 (0.0008) [2023-12-27 23:10:22,386][106226] Updated weights for policy 0, policy_version 547201 (0.0009) [2023-12-27 23:10:22,445][106226] Updated weights for policy 0, policy_version 547211 (0.0008) [2023-12-27 23:10:22,502][106226] Updated weights for policy 0, policy_version 547221 (0.0009) [2023-12-27 23:10:22,713][106225] Updated weights for policy 1, policy_version 548660 (0.0008) [2023-12-27 23:10:22,775][106225] Updated weights for policy 1, policy_version 548670 (0.0008) [2023-12-27 23:10:22,837][106225] Updated weights for policy 1, policy_version 548680 (0.0008) [2023-12-27 23:10:23,285][106226] Updated weights for policy 0, policy_version 547231 (0.0010) [2023-12-27 23:10:23,336][106226] Updated weights for policy 0, policy_version 547241 (0.0009) [2023-12-27 23:10:23,393][106226] Updated weights for policy 0, policy_version 547251 (0.0009) [2023-12-27 23:10:23,458][106225] Updated weights for policy 1, policy_version 548690 (0.0008) [2023-12-27 23:10:23,513][106225] Updated weights for policy 1, policy_version 548700 (0.0008) [2023-12-27 23:10:23,570][106225] Updated weights for policy 1, policy_version 548710 (0.0008) [2023-12-27 23:10:23,626][106225] Updated weights for policy 1, policy_version 548720 (0.0006) [2023-12-27 23:10:24,155][106226] Updated weights for policy 0, policy_version 547261 (0.0010) [2023-12-27 23:10:24,202][106226] Updated weights for policy 0, policy_version 547271 (0.0010) [2023-12-27 23:10:24,255][106226] Updated weights for policy 0, policy_version 547281 (0.0010) [2023-12-27 23:10:24,344][106225] Updated weights for policy 1, policy_version 548730 (0.0008) [2023-12-27 23:10:24,397][106225] Updated weights for policy 1, policy_version 548740 (0.0007) [2023-12-27 23:10:24,451][106225] Updated weights for policy 1, policy_version 548750 (0.0008) [2023-12-27 23:10:24,981][106226] Updated weights for policy 0, policy_version 547291 (0.0011) [2023-12-27 23:10:25,042][106226] Updated weights for policy 0, policy_version 547301 (0.0010) [2023-12-27 23:10:25,099][106226] Updated weights for policy 0, policy_version 547311 (0.0010) [2023-12-27 23:10:25,188][106225] Updated weights for policy 1, policy_version 548760 (0.0009) [2023-12-27 23:10:25,246][106225] Updated weights for policy 1, policy_version 548770 (0.0009) [2023-12-27 23:10:25,302][106225] Updated weights for policy 1, policy_version 548780 (0.0009) [2023-12-27 23:10:25,724][106226] Updated weights for policy 0, policy_version 547321 (0.0009) [2023-12-27 23:10:25,781][106226] Updated weights for policy 0, policy_version 547331 (0.0009) [2023-12-27 23:10:25,827][106226] Updated weights for policy 0, policy_version 547341 (0.0009) [2023-12-27 23:10:25,877][106226] Updated weights for policy 0, policy_version 547351 (0.0008) [2023-12-27 23:10:26,045][106225] Updated weights for policy 1, policy_version 548790 (0.0008) [2023-12-27 23:10:26,102][106225] Updated weights for policy 1, policy_version 548800 (0.0008) [2023-12-27 23:10:26,153][106225] Updated weights for policy 1, policy_version 548810 (0.0008) [2023-12-27 23:10:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 280674304. Throughput: 0: 9629.7, 1: 9982.4. Samples: 280647376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:26,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-5.707')] [2023-12-27 23:10:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000547352_140156928.pth... [2023-12-27 23:10:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000548816_140525568.pth... [2023-12-27 23:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000546232_139870208.pth [2023-12-27 23:10:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000547632_140222464.pth [2023-12-27 23:10:26,645][106226] Updated weights for policy 0, policy_version 547361 (0.0006) [2023-12-27 23:10:26,703][106226] Updated weights for policy 0, policy_version 547371 (0.0006) [2023-12-27 23:10:26,755][106226] Updated weights for policy 0, policy_version 547381 (0.0010) [2023-12-27 23:10:26,853][106225] Updated weights for policy 1, policy_version 548820 (0.0008) [2023-12-27 23:10:26,911][106225] Updated weights for policy 1, policy_version 548830 (0.0007) [2023-12-27 23:10:26,968][106225] Updated weights for policy 1, policy_version 548840 (0.0008) [2023-12-27 23:10:27,452][106226] Updated weights for policy 0, policy_version 547391 (0.0010) [2023-12-27 23:10:27,517][106226] Updated weights for policy 0, policy_version 547401 (0.0010) [2023-12-27 23:10:27,573][106226] Updated weights for policy 0, policy_version 547411 (0.0010) [2023-12-27 23:10:27,694][106225] Updated weights for policy 1, policy_version 548850 (0.0008) [2023-12-27 23:10:27,748][106225] Updated weights for policy 1, policy_version 548860 (0.0008) [2023-12-27 23:10:27,801][106225] Updated weights for policy 1, policy_version 548870 (0.0007) [2023-12-27 23:10:27,855][106225] Updated weights for policy 1, policy_version 548880 (0.0007) [2023-12-27 23:10:28,281][106226] Updated weights for policy 0, policy_version 547421 (0.0010) [2023-12-27 23:10:28,332][106226] Updated weights for policy 0, policy_version 547431 (0.0010) [2023-12-27 23:10:28,392][106226] Updated weights for policy 0, policy_version 547441 (0.0010) [2023-12-27 23:10:28,620][106225] Updated weights for policy 1, policy_version 548890 (0.0007) [2023-12-27 23:10:28,678][106225] Updated weights for policy 1, policy_version 548900 (0.0008) [2023-12-27 23:10:28,733][106225] Updated weights for policy 1, policy_version 548910 (0.0008) [2023-12-27 23:10:29,109][106226] Updated weights for policy 0, policy_version 547451 (0.0010) [2023-12-27 23:10:29,161][106226] Updated weights for policy 0, policy_version 547461 (0.0010) [2023-12-27 23:10:29,216][106226] Updated weights for policy 0, policy_version 547471 (0.0010) [2023-12-27 23:10:29,444][106225] Updated weights for policy 1, policy_version 548920 (0.0007) [2023-12-27 23:10:29,493][106225] Updated weights for policy 1, policy_version 548930 (0.0008) [2023-12-27 23:10:29,546][106225] Updated weights for policy 1, policy_version 548940 (0.0006) [2023-12-27 23:10:29,995][106226] Updated weights for policy 0, policy_version 547481 (0.0008) [2023-12-27 23:10:30,058][106226] Updated weights for policy 0, policy_version 547491 (0.0007) [2023-12-27 23:10:30,112][106226] Updated weights for policy 0, policy_version 547501 (0.0006) [2023-12-27 23:10:30,170][106226] Updated weights for policy 0, policy_version 547511 (0.0005) [2023-12-27 23:10:30,198][106225] Updated weights for policy 1, policy_version 548950 (0.0007) [2023-12-27 23:10:30,248][106225] Updated weights for policy 1, policy_version 548960 (0.0008) [2023-12-27 23:10:30,301][106225] Updated weights for policy 1, policy_version 548970 (0.0007) [2023-12-27 23:10:30,854][106226] Updated weights for policy 0, policy_version 547521 (0.0006) [2023-12-27 23:10:30,914][106226] Updated weights for policy 0, policy_version 547531 (0.0008) [2023-12-27 23:10:30,960][106226] Updated weights for policy 0, policy_version 547541 (0.0009) [2023-12-27 23:10:31,047][106225] Updated weights for policy 1, policy_version 548980 (0.0009) [2023-12-27 23:10:31,119][106225] Updated weights for policy 1, policy_version 548990 (0.0008) [2023-12-27 23:10:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 280772608. Throughput: 0: 9676.7, 1: 10021.7. Samples: 280764144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:31,175][105115] Avg episode reward: [(0, '-5.192'), (1, '-5.529')] [2023-12-27 23:10:31,184][106225] Updated weights for policy 1, policy_version 549000 (0.0008) [2023-12-27 23:10:31,706][106226] Updated weights for policy 0, policy_version 547551 (0.0009) [2023-12-27 23:10:31,774][106226] Updated weights for policy 0, policy_version 547561 (0.0010) [2023-12-27 23:10:31,830][106226] Updated weights for policy 0, policy_version 547571 (0.0006) [2023-12-27 23:10:31,928][106225] Updated weights for policy 1, policy_version 549010 (0.0008) [2023-12-27 23:10:31,994][106225] Updated weights for policy 1, policy_version 549020 (0.0011) [2023-12-27 23:10:32,056][106225] Updated weights for policy 1, policy_version 549030 (0.0010) [2023-12-27 23:10:32,119][106225] Updated weights for policy 1, policy_version 549040 (0.0010) [2023-12-27 23:10:32,584][106226] Updated weights for policy 0, policy_version 547581 (0.0008) [2023-12-27 23:10:32,633][106226] Updated weights for policy 0, policy_version 547591 (0.0008) [2023-12-27 23:10:32,682][106226] Updated weights for policy 0, policy_version 547601 (0.0007) [2023-12-27 23:10:32,802][106225] Updated weights for policy 1, policy_version 549050 (0.0010) [2023-12-27 23:10:32,864][106225] Updated weights for policy 1, policy_version 549060 (0.0010) [2023-12-27 23:10:32,916][106225] Updated weights for policy 1, policy_version 549070 (0.0005) [2023-12-27 23:10:33,421][106226] Updated weights for policy 0, policy_version 547611 (0.0007) [2023-12-27 23:10:33,479][106226] Updated weights for policy 0, policy_version 547621 (0.0005) [2023-12-27 23:10:33,529][106226] Updated weights for policy 0, policy_version 547631 (0.0009) [2023-12-27 23:10:33,532][106225] Updated weights for policy 1, policy_version 549080 (0.0009) [2023-12-27 23:10:33,581][106225] Updated weights for policy 1, policy_version 549090 (0.0010) [2023-12-27 23:10:33,633][106225] Updated weights for policy 1, policy_version 549100 (0.0010) [2023-12-27 23:10:34,200][106226] Updated weights for policy 0, policy_version 547641 (0.0010) [2023-12-27 23:10:34,262][106226] Updated weights for policy 0, policy_version 547651 (0.0011) [2023-12-27 23:10:34,328][106226] Updated weights for policy 0, policy_version 547661 (0.0011) [2023-12-27 23:10:34,373][106225] Updated weights for policy 1, policy_version 549110 (0.0010) [2023-12-27 23:10:34,388][106226] Updated weights for policy 0, policy_version 547671 (0.0010) [2023-12-27 23:10:34,434][106225] Updated weights for policy 1, policy_version 549120 (0.0010) [2023-12-27 23:10:34,499][106225] Updated weights for policy 1, policy_version 549130 (0.0011) [2023-12-27 23:10:35,104][106226] Updated weights for policy 0, policy_version 547681 (0.0006) [2023-12-27 23:10:35,168][106226] Updated weights for policy 0, policy_version 547691 (0.0007) [2023-12-27 23:10:35,221][106225] Updated weights for policy 1, policy_version 549140 (0.0010) [2023-12-27 23:10:35,229][106226] Updated weights for policy 0, policy_version 547701 (0.0010) [2023-12-27 23:10:35,281][106225] Updated weights for policy 1, policy_version 549150 (0.0010) [2023-12-27 23:10:35,337][106225] Updated weights for policy 1, policy_version 549160 (0.0010) [2023-12-27 23:10:35,904][106226] Updated weights for policy 0, policy_version 547711 (0.0010) [2023-12-27 23:10:35,967][106226] Updated weights for policy 0, policy_version 547721 (0.0010) [2023-12-27 23:10:36,026][106226] Updated weights for policy 0, policy_version 547731 (0.0011) [2023-12-27 23:10:36,059][106225] Updated weights for policy 1, policy_version 549170 (0.0010) [2023-12-27 23:10:36,127][106225] Updated weights for policy 1, policy_version 549180 (0.0010) [2023-12-27 23:10:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 280870912. Throughput: 0: 9698.9, 1: 9961.3. Samples: 280881248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:36,175][105115] Avg episode reward: [(0, '-5.290'), (1, '-5.622')] [2023-12-27 23:10:36,191][106225] Updated weights for policy 1, policy_version 549190 (0.0010) [2023-12-27 23:10:36,256][106225] Updated weights for policy 1, policy_version 549200 (0.0006) [2023-12-27 23:10:36,785][106226] Updated weights for policy 0, policy_version 547741 (0.0010) [2023-12-27 23:10:36,841][106226] Updated weights for policy 0, policy_version 547751 (0.0010) [2023-12-27 23:10:36,894][106226] Updated weights for policy 0, policy_version 547761 (0.0010) [2023-12-27 23:10:36,909][106225] Updated weights for policy 1, policy_version 549210 (0.0010) [2023-12-27 23:10:36,966][106225] Updated weights for policy 1, policy_version 549220 (0.0010) [2023-12-27 23:10:37,027][106225] Updated weights for policy 1, policy_version 549230 (0.0010) [2023-12-27 23:10:37,625][106226] Updated weights for policy 0, policy_version 547771 (0.0011) [2023-12-27 23:10:37,686][106226] Updated weights for policy 0, policy_version 547781 (0.0011) [2023-12-27 23:10:37,745][106226] Updated weights for policy 0, policy_version 547791 (0.0011) [2023-12-27 23:10:37,755][106225] Updated weights for policy 1, policy_version 549240 (0.0010) [2023-12-27 23:10:37,810][106225] Updated weights for policy 1, policy_version 549250 (0.0010) [2023-12-27 23:10:37,874][106225] Updated weights for policy 1, policy_version 549260 (0.0010) [2023-12-27 23:10:38,387][106226] Updated weights for policy 0, policy_version 547801 (0.0006) [2023-12-27 23:10:38,437][106226] Updated weights for policy 0, policy_version 547811 (0.0011) [2023-12-27 23:10:38,501][106226] Updated weights for policy 0, policy_version 547821 (0.0011) [2023-12-27 23:10:38,552][106226] Updated weights for policy 0, policy_version 547831 (0.0010) [2023-12-27 23:10:38,571][106225] Updated weights for policy 1, policy_version 549270 (0.0009) [2023-12-27 23:10:38,629][106225] Updated weights for policy 1, policy_version 549280 (0.0008) [2023-12-27 23:10:38,686][106225] Updated weights for policy 1, policy_version 549290 (0.0008) [2023-12-27 23:10:39,305][106226] Updated weights for policy 0, policy_version 547841 (0.0009) [2023-12-27 23:10:39,343][106225] Updated weights for policy 1, policy_version 549300 (0.0008) [2023-12-27 23:10:39,376][106226] Updated weights for policy 0, policy_version 547851 (0.0011) [2023-12-27 23:10:39,410][106225] Updated weights for policy 1, policy_version 549310 (0.0008) [2023-12-27 23:10:39,443][106226] Updated weights for policy 0, policy_version 547861 (0.0011) [2023-12-27 23:10:39,478][106225] Updated weights for policy 1, policy_version 549320 (0.0007) [2023-12-27 23:10:40,176][106225] Updated weights for policy 1, policy_version 549330 (0.0008) [2023-12-27 23:10:40,223][106226] Updated weights for policy 0, policy_version 547871 (0.0010) [2023-12-27 23:10:40,232][106225] Updated weights for policy 1, policy_version 549340 (0.0006) [2023-12-27 23:10:40,285][106226] Updated weights for policy 0, policy_version 547881 (0.0011) [2023-12-27 23:10:40,293][106225] Updated weights for policy 1, policy_version 549350 (0.0010) [2023-12-27 23:10:40,348][106225] Updated weights for policy 1, policy_version 549360 (0.0009) [2023-12-27 23:10:40,348][106226] Updated weights for policy 0, policy_version 547891 (0.0011) [2023-12-27 23:10:40,941][106226] Updated weights for policy 0, policy_version 547901 (0.0011) [2023-12-27 23:10:40,998][106226] Updated weights for policy 0, policy_version 547911 (0.0010) [2023-12-27 23:10:41,054][106225] Updated weights for policy 1, policy_version 549370 (0.0007) [2023-12-27 23:10:41,094][106226] Updated weights for policy 0, policy_version 547921 (0.0009) [2023-12-27 23:10:41,120][106225] Updated weights for policy 1, policy_version 549380 (0.0008) [2023-12-27 23:10:41,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 280969216. Throughput: 0: 9716.5, 1: 9983.9. Samples: 280939876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:41,175][105115] Avg episode reward: [(0, '-5.149'), (1, '-5.309')] [2023-12-27 23:10:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000547928_140304384.pth... [2023-12-27 23:10:41,184][106225] Updated weights for policy 1, policy_version 549390 (0.0007) [2023-12-27 23:10:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000546776_140009472.pth [2023-12-27 23:10:41,196][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000549392_140673024.pth... [2023-12-27 23:10:41,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000548208_140369920.pth [2023-12-27 23:10:41,875][106226] Updated weights for policy 0, policy_version 547931 (0.0008) [2023-12-27 23:10:41,876][106225] Updated weights for policy 1, policy_version 549400 (0.0008) [2023-12-27 23:10:41,934][106226] Updated weights for policy 0, policy_version 547941 (0.0007) [2023-12-27 23:10:41,940][106225] Updated weights for policy 1, policy_version 549410 (0.0006) [2023-12-27 23:10:41,993][106226] Updated weights for policy 0, policy_version 547951 (0.0009) [2023-12-27 23:10:42,000][106225] Updated weights for policy 1, policy_version 549420 (0.0006) [2023-12-27 23:10:42,694][106226] Updated weights for policy 0, policy_version 547961 (0.0007) [2023-12-27 23:10:42,755][106226] Updated weights for policy 0, policy_version 547971 (0.0006) [2023-12-27 23:10:42,796][106225] Updated weights for policy 1, policy_version 549430 (0.0007) [2023-12-27 23:10:42,809][106226] Updated weights for policy 0, policy_version 547981 (0.0008) [2023-12-27 23:10:42,854][106225] Updated weights for policy 1, policy_version 549440 (0.0008) [2023-12-27 23:10:42,860][106226] Updated weights for policy 0, policy_version 547991 (0.0006) [2023-12-27 23:10:42,909][106225] Updated weights for policy 1, policy_version 549450 (0.0007) [2023-12-27 23:10:43,519][106226] Updated weights for policy 0, policy_version 548001 (0.0009) [2023-12-27 23:10:43,580][106226] Updated weights for policy 0, policy_version 548011 (0.0010) [2023-12-27 23:10:43,604][106225] Updated weights for policy 1, policy_version 549460 (0.0006) [2023-12-27 23:10:43,634][106226] Updated weights for policy 0, policy_version 548021 (0.0008) [2023-12-27 23:10:43,655][106225] Updated weights for policy 1, policy_version 549470 (0.0005) [2023-12-27 23:10:43,710][106225] Updated weights for policy 1, policy_version 549480 (0.0009) [2023-12-27 23:10:44,338][106226] Updated weights for policy 0, policy_version 548031 (0.0008) [2023-12-27 23:10:44,400][106226] Updated weights for policy 0, policy_version 548041 (0.0009) [2023-12-27 23:10:44,432][106225] Updated weights for policy 1, policy_version 549490 (0.0009) [2023-12-27 23:10:44,453][106226] Updated weights for policy 0, policy_version 548051 (0.0009) [2023-12-27 23:10:44,482][106225] Updated weights for policy 1, policy_version 549500 (0.0005) [2023-12-27 23:10:44,533][106225] Updated weights for policy 1, policy_version 549510 (0.0005) [2023-12-27 23:10:44,586][106225] Updated weights for policy 1, policy_version 549520 (0.0007) [2023-12-27 23:10:45,235][106226] Updated weights for policy 0, policy_version 548061 (0.0007) [2023-12-27 23:10:45,247][106225] Updated weights for policy 1, policy_version 549530 (0.0011) [2023-12-27 23:10:45,300][106226] Updated weights for policy 0, policy_version 548071 (0.0006) [2023-12-27 23:10:45,311][106225] Updated weights for policy 1, policy_version 549540 (0.0012) [2023-12-27 23:10:45,360][106226] Updated weights for policy 0, policy_version 548081 (0.0007) [2023-12-27 23:10:45,368][106225] Updated weights for policy 1, policy_version 549550 (0.0008) [2023-12-27 23:10:45,960][106225] Updated weights for policy 1, policy_version 549560 (0.0009) [2023-12-27 23:10:46,023][106225] Updated weights for policy 1, policy_version 549570 (0.0010) [2023-12-27 23:10:46,086][106225] Updated weights for policy 1, policy_version 549580 (0.0010) [2023-12-27 23:10:46,129][106226] Updated weights for policy 0, policy_version 548091 (0.0008) [2023-12-27 23:10:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 281067520. Throughput: 0: 9696.1, 1: 9956.6. Samples: 281057060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:46,176][105115] Avg episode reward: [(0, '-5.373'), (1, '-5.503')] [2023-12-27 23:10:46,193][106226] Updated weights for policy 0, policy_version 548101 (0.0008) [2023-12-27 23:10:46,247][106226] Updated weights for policy 0, policy_version 548111 (0.0005) [2023-12-27 23:10:46,772][106225] Updated weights for policy 1, policy_version 549590 (0.0007) [2023-12-27 23:10:46,838][106225] Updated weights for policy 1, policy_version 549600 (0.0006) [2023-12-27 23:10:46,887][106225] Updated weights for policy 1, policy_version 549610 (0.0008) [2023-12-27 23:10:46,941][106226] Updated weights for policy 0, policy_version 548121 (0.0006) [2023-12-27 23:10:46,998][106226] Updated weights for policy 0, policy_version 548131 (0.0010) [2023-12-27 23:10:47,047][106226] Updated weights for policy 0, policy_version 548141 (0.0009) [2023-12-27 23:10:47,101][106226] Updated weights for policy 0, policy_version 548151 (0.0010) [2023-12-27 23:10:47,492][106225] Updated weights for policy 1, policy_version 549620 (0.0007) [2023-12-27 23:10:47,544][106225] Updated weights for policy 1, policy_version 549630 (0.0005) [2023-12-27 23:10:47,594][106225] Updated weights for policy 1, policy_version 549640 (0.0005) [2023-12-27 23:10:47,924][106226] Updated weights for policy 0, policy_version 548161 (0.0008) [2023-12-27 23:10:47,977][106226] Updated weights for policy 0, policy_version 548171 (0.0008) [2023-12-27 23:10:48,025][106226] Updated weights for policy 0, policy_version 548181 (0.0008) [2023-12-27 23:10:48,149][106225] Updated weights for policy 1, policy_version 549650 (0.0005) [2023-12-27 23:10:48,207][106225] Updated weights for policy 1, policy_version 549660 (0.0008) [2023-12-27 23:10:48,264][106225] Updated weights for policy 1, policy_version 549670 (0.0008) [2023-12-27 23:10:48,314][106225] Updated weights for policy 1, policy_version 549680 (0.0008) [2023-12-27 23:10:48,821][106226] Updated weights for policy 0, policy_version 548191 (0.0007) [2023-12-27 23:10:48,888][106226] Updated weights for policy 0, policy_version 548201 (0.0009) [2023-12-27 23:10:48,947][106226] Updated weights for policy 0, policy_version 548211 (0.0009) [2023-12-27 23:10:49,043][106225] Updated weights for policy 1, policy_version 549690 (0.0007) [2023-12-27 23:10:49,088][106225] Updated weights for policy 1, policy_version 549700 (0.0008) [2023-12-27 23:10:49,136][106225] Updated weights for policy 1, policy_version 549710 (0.0008) [2023-12-27 23:10:49,679][106226] Updated weights for policy 0, policy_version 548221 (0.0009) [2023-12-27 23:10:49,741][106226] Updated weights for policy 0, policy_version 548231 (0.0008) [2023-12-27 23:10:49,803][106226] Updated weights for policy 0, policy_version 548241 (0.0008) [2023-12-27 23:10:49,844][106225] Updated weights for policy 1, policy_version 549720 (0.0007) [2023-12-27 23:10:49,912][106225] Updated weights for policy 1, policy_version 549730 (0.0008) [2023-12-27 23:10:49,977][106225] Updated weights for policy 1, policy_version 549740 (0.0007) [2023-12-27 23:10:50,590][106226] Updated weights for policy 0, policy_version 548251 (0.0008) [2023-12-27 23:10:50,636][106225] Updated weights for policy 1, policy_version 549750 (0.0008) [2023-12-27 23:10:50,650][106226] Updated weights for policy 0, policy_version 548261 (0.0010) [2023-12-27 23:10:50,692][106225] Updated weights for policy 1, policy_version 549760 (0.0006) [2023-12-27 23:10:50,702][106226] Updated weights for policy 0, policy_version 548271 (0.0007) [2023-12-27 23:10:50,748][106225] Updated weights for policy 1, policy_version 549770 (0.0006) [2023-12-27 23:10:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 281165824. Throughput: 0: 9585.5, 1: 9975.8. Samples: 281175028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:51,175][105115] Avg episode reward: [(0, '-5.413'), (1, '-5.558')] [2023-12-27 23:10:51,395][106225] Updated weights for policy 1, policy_version 549780 (0.0008) [2023-12-27 23:10:51,455][106225] Updated weights for policy 1, policy_version 549790 (0.0008) [2023-12-27 23:10:51,505][106226] Updated weights for policy 0, policy_version 548281 (0.0008) [2023-12-27 23:10:51,506][106225] Updated weights for policy 1, policy_version 549800 (0.0008) [2023-12-27 23:10:51,556][106226] Updated weights for policy 0, policy_version 548291 (0.0007) [2023-12-27 23:10:51,614][106226] Updated weights for policy 0, policy_version 548301 (0.0008) [2023-12-27 23:10:51,690][106226] Updated weights for policy 0, policy_version 548311 (0.0008) [2023-12-27 23:10:52,316][106225] Updated weights for policy 1, policy_version 549810 (0.0008) [2023-12-27 23:10:52,385][106225] Updated weights for policy 1, policy_version 549820 (0.0007) [2023-12-27 23:10:52,391][106226] Updated weights for policy 0, policy_version 548321 (0.0010) [2023-12-27 23:10:52,444][106225] Updated weights for policy 1, policy_version 549830 (0.0006) [2023-12-27 23:10:52,453][106226] Updated weights for policy 0, policy_version 548331 (0.0011) [2023-12-27 23:10:52,501][106225] Updated weights for policy 1, policy_version 549840 (0.0007) [2023-12-27 23:10:52,513][106226] Updated weights for policy 0, policy_version 548341 (0.0011) [2023-12-27 23:10:53,229][106226] Updated weights for policy 0, policy_version 548351 (0.0010) [2023-12-27 23:10:53,234][106225] Updated weights for policy 1, policy_version 549850 (0.0006) [2023-12-27 23:10:53,286][106226] Updated weights for policy 0, policy_version 548361 (0.0007) [2023-12-27 23:10:53,288][106225] Updated weights for policy 1, policy_version 549860 (0.0006) [2023-12-27 23:10:53,337][106226] Updated weights for policy 0, policy_version 548371 (0.0006) [2023-12-27 23:10:53,339][106225] Updated weights for policy 1, policy_version 549870 (0.0006) [2023-12-27 23:10:54,021][106225] Updated weights for policy 1, policy_version 549880 (0.0008) [2023-12-27 23:10:54,082][106225] Updated weights for policy 1, policy_version 549890 (0.0007) [2023-12-27 23:10:54,108][106226] Updated weights for policy 0, policy_version 548381 (0.0007) [2023-12-27 23:10:54,142][106225] Updated weights for policy 1, policy_version 549900 (0.0008) [2023-12-27 23:10:54,164][106226] Updated weights for policy 0, policy_version 548391 (0.0006) [2023-12-27 23:10:54,220][106226] Updated weights for policy 0, policy_version 548401 (0.0008) [2023-12-27 23:10:54,852][106225] Updated weights for policy 1, policy_version 549910 (0.0007) [2023-12-27 23:10:54,901][106226] Updated weights for policy 0, policy_version 548411 (0.0008) [2023-12-27 23:10:54,906][106225] Updated weights for policy 1, policy_version 549920 (0.0005) [2023-12-27 23:10:54,958][106225] Updated weights for policy 1, policy_version 549930 (0.0005) [2023-12-27 23:10:54,961][106226] Updated weights for policy 0, policy_version 548421 (0.0007) [2023-12-27 23:10:55,015][106226] Updated weights for policy 0, policy_version 548431 (0.0008) [2023-12-27 23:10:55,614][106225] Updated weights for policy 1, policy_version 549940 (0.0007) [2023-12-27 23:10:55,672][106225] Updated weights for policy 1, policy_version 549950 (0.0005) [2023-12-27 23:10:55,691][106226] Updated weights for policy 0, policy_version 548441 (0.0007) [2023-12-27 23:10:55,740][106225] Updated weights for policy 1, policy_version 549960 (0.0006) [2023-12-27 23:10:55,754][106226] Updated weights for policy 0, policy_version 548451 (0.0008) [2023-12-27 23:10:55,810][106226] Updated weights for policy 0, policy_version 548461 (0.0011) [2023-12-27 23:10:55,867][106226] Updated weights for policy 0, policy_version 548471 (0.0011) [2023-12-27 23:10:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 281264128. Throughput: 0: 9549.4, 1: 9948.9. Samples: 281232364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:10:56,176][105115] Avg episode reward: [(0, '-5.394'), (1, '-5.245')] [2023-12-27 23:10:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000548472_140443648.pth... [2023-12-27 23:10:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000549968_140820480.pth... [2023-12-27 23:10:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000548816_140525568.pth [2023-12-27 23:10:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000547352_140156928.pth [2023-12-27 23:10:56,364][106225] Updated weights for policy 1, policy_version 549970 (0.0006) [2023-12-27 23:10:56,423][106225] Updated weights for policy 1, policy_version 549980 (0.0008) [2023-12-27 23:10:56,480][106225] Updated weights for policy 1, policy_version 549990 (0.0008) [2023-12-27 23:10:56,536][106225] Updated weights for policy 1, policy_version 550000 (0.0007) [2023-12-27 23:10:56,595][106226] Updated weights for policy 0, policy_version 548481 (0.0009) [2023-12-27 23:10:56,646][106226] Updated weights for policy 0, policy_version 548491 (0.0009) [2023-12-27 23:10:56,695][106226] Updated weights for policy 0, policy_version 548501 (0.0009) [2023-12-27 23:10:57,285][106225] Updated weights for policy 1, policy_version 550010 (0.0008) [2023-12-27 23:10:57,346][106225] Updated weights for policy 1, policy_version 550020 (0.0008) [2023-12-27 23:10:57,393][106226] Updated weights for policy 0, policy_version 548511 (0.0006) [2023-12-27 23:10:57,402][106225] Updated weights for policy 1, policy_version 550030 (0.0006) [2023-12-27 23:10:57,445][106226] Updated weights for policy 0, policy_version 548521 (0.0005) [2023-12-27 23:10:57,507][106226] Updated weights for policy 0, policy_version 548531 (0.0005) [2023-12-27 23:10:58,019][106226] Updated weights for policy 0, policy_version 548541 (0.0007) [2023-12-27 23:10:58,065][106225] Updated weights for policy 1, policy_version 550040 (0.0007) [2023-12-27 23:10:58,075][106226] Updated weights for policy 0, policy_version 548551 (0.0011) [2023-12-27 23:10:58,112][106225] Updated weights for policy 1, policy_version 550050 (0.0005) [2023-12-27 23:10:58,121][106226] Updated weights for policy 0, policy_version 548561 (0.0010) [2023-12-27 23:10:58,164][106225] Updated weights for policy 1, policy_version 550060 (0.0007) [2023-12-27 23:10:58,911][106226] Updated weights for policy 0, policy_version 548571 (0.0008) [2023-12-27 23:10:58,981][106226] Updated weights for policy 0, policy_version 548581 (0.0009) [2023-12-27 23:10:59,003][106225] Updated weights for policy 1, policy_version 550070 (0.0008) [2023-12-27 23:10:59,038][106226] Updated weights for policy 0, policy_version 548591 (0.0007) [2023-12-27 23:10:59,063][106225] Updated weights for policy 1, policy_version 550080 (0.0006) [2023-12-27 23:10:59,124][106225] Updated weights for policy 1, policy_version 550090 (0.0009) [2023-12-27 23:10:59,725][106226] Updated weights for policy 0, policy_version 548601 (0.0009) [2023-12-27 23:10:59,777][106226] Updated weights for policy 0, policy_version 548611 (0.0009) [2023-12-27 23:10:59,834][106226] Updated weights for policy 0, policy_version 548621 (0.0009) [2023-12-27 23:10:59,896][106226] Updated weights for policy 0, policy_version 548631 (0.0007) [2023-12-27 23:10:59,969][106225] Updated weights for policy 1, policy_version 550100 (0.0008) [2023-12-27 23:11:00,020][106225] Updated weights for policy 1, policy_version 550110 (0.0007) [2023-12-27 23:11:00,066][106225] Updated weights for policy 1, policy_version 550120 (0.0007) [2023-12-27 23:11:00,636][106226] Updated weights for policy 0, policy_version 548641 (0.0007) [2023-12-27 23:11:00,697][106226] Updated weights for policy 0, policy_version 548651 (0.0008) [2023-12-27 23:11:00,753][106226] Updated weights for policy 0, policy_version 548661 (0.0008) [2023-12-27 23:11:00,791][106225] Updated weights for policy 1, policy_version 550130 (0.0007) [2023-12-27 23:11:00,834][106225] Updated weights for policy 1, policy_version 550140 (0.0005) [2023-12-27 23:11:00,880][106225] Updated weights for policy 1, policy_version 550150 (0.0006) [2023-12-27 23:11:00,925][106225] Updated weights for policy 1, policy_version 550160 (0.0008) [2023-12-27 23:11:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 281362432. Throughput: 0: 9577.6, 1: 9922.5. Samples: 281350816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:11:01,175][105115] Avg episode reward: [(0, '-5.177'), (1, '-5.798')] [2023-12-27 23:11:01,485][106226] Updated weights for policy 0, policy_version 548671 (0.0008) [2023-12-27 23:11:01,548][106226] Updated weights for policy 0, policy_version 548681 (0.0007) [2023-12-27 23:11:01,615][106226] Updated weights for policy 0, policy_version 548691 (0.0006) [2023-12-27 23:11:01,657][106225] Updated weights for policy 1, policy_version 550170 (0.0009) [2023-12-27 23:11:01,716][106225] Updated weights for policy 1, policy_version 550180 (0.0008) [2023-12-27 23:11:01,786][106225] Updated weights for policy 1, policy_version 550190 (0.0007) [2023-12-27 23:11:02,359][106226] Updated weights for policy 0, policy_version 548701 (0.0008) [2023-12-27 23:11:02,422][106225] Updated weights for policy 1, policy_version 550200 (0.0007) [2023-12-27 23:11:02,425][106226] Updated weights for policy 0, policy_version 548711 (0.0006) [2023-12-27 23:11:02,484][106225] Updated weights for policy 1, policy_version 550210 (0.0006) [2023-12-27 23:11:02,490][106226] Updated weights for policy 0, policy_version 548721 (0.0009) [2023-12-27 23:11:02,545][106225] Updated weights for policy 1, policy_version 550220 (0.0006) [2023-12-27 23:11:03,120][106225] Updated weights for policy 1, policy_version 550230 (0.0006) [2023-12-27 23:11:03,174][106225] Updated weights for policy 1, policy_version 550240 (0.0008) [2023-12-27 23:11:03,222][106225] Updated weights for policy 1, policy_version 550250 (0.0008) [2023-12-27 23:11:03,260][106226] Updated weights for policy 0, policy_version 548731 (0.0008) [2023-12-27 23:11:03,312][106226] Updated weights for policy 0, policy_version 548741 (0.0008) [2023-12-27 23:11:03,368][106226] Updated weights for policy 0, policy_version 548751 (0.0008) [2023-12-27 23:11:03,890][106225] Updated weights for policy 1, policy_version 550260 (0.0009) [2023-12-27 23:11:03,942][106225] Updated weights for policy 1, policy_version 550270 (0.0008) [2023-12-27 23:11:04,004][106225] Updated weights for policy 1, policy_version 550280 (0.0008) [2023-12-27 23:11:04,101][106226] Updated weights for policy 0, policy_version 548761 (0.0008) [2023-12-27 23:11:04,168][106226] Updated weights for policy 0, policy_version 548771 (0.0006) [2023-12-27 23:11:04,240][106226] Updated weights for policy 0, policy_version 548781 (0.0008) [2023-12-27 23:11:04,304][106226] Updated weights for policy 0, policy_version 548791 (0.0009) [2023-12-27 23:11:04,783][106225] Updated weights for policy 1, policy_version 550290 (0.0007) [2023-12-27 23:11:04,841][106225] Updated weights for policy 1, policy_version 550300 (0.0007) [2023-12-27 23:11:04,893][106225] Updated weights for policy 1, policy_version 550310 (0.0009) [2023-12-27 23:11:04,944][106225] Updated weights for policy 1, policy_version 550320 (0.0008) [2023-12-27 23:11:05,013][106226] Updated weights for policy 0, policy_version 548801 (0.0006) [2023-12-27 23:11:05,078][106226] Updated weights for policy 0, policy_version 548811 (0.0008) [2023-12-27 23:11:05,133][106226] Updated weights for policy 0, policy_version 548821 (0.0008) [2023-12-27 23:11:05,619][106225] Updated weights for policy 1, policy_version 550330 (0.0005) [2023-12-27 23:11:05,663][106225] Updated weights for policy 1, policy_version 550340 (0.0008) [2023-12-27 23:11:05,726][106225] Updated weights for policy 1, policy_version 550350 (0.0009) [2023-12-27 23:11:05,867][106226] Updated weights for policy 0, policy_version 548831 (0.0009) [2023-12-27 23:11:05,922][106226] Updated weights for policy 0, policy_version 548841 (0.0009) [2023-12-27 23:11:05,980][106226] Updated weights for policy 0, policy_version 548851 (0.0009) [2023-12-27 23:11:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.6, 300 sec: 19771.9). Total num frames: 281460736. Throughput: 0: 9593.4, 1: 9881.6. Samples: 281467672. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:06,176][105115] Avg episode reward: [(0, '-5.036'), (1, '-5.505')] [2023-12-27 23:11:06,393][106225] Updated weights for policy 1, policy_version 550360 (0.0007) [2023-12-27 23:11:06,454][106225] Updated weights for policy 1, policy_version 550370 (0.0006) [2023-12-27 23:11:06,518][106225] Updated weights for policy 1, policy_version 550380 (0.0007) [2023-12-27 23:11:06,682][106226] Updated weights for policy 0, policy_version 548861 (0.0008) [2023-12-27 23:11:06,734][106226] Updated weights for policy 0, policy_version 548871 (0.0005) [2023-12-27 23:11:06,785][106226] Updated weights for policy 0, policy_version 548881 (0.0006) [2023-12-27 23:11:07,243][106225] Updated weights for policy 1, policy_version 550390 (0.0007) [2023-12-27 23:11:07,290][106225] Updated weights for policy 1, policy_version 550400 (0.0008) [2023-12-27 23:11:07,343][106225] Updated weights for policy 1, policy_version 550410 (0.0008) [2023-12-27 23:11:07,381][106226] Updated weights for policy 0, policy_version 548891 (0.0006) [2023-12-27 23:11:07,430][106226] Updated weights for policy 0, policy_version 548901 (0.0005) [2023-12-27 23:11:07,480][106226] Updated weights for policy 0, policy_version 548911 (0.0005) [2023-12-27 23:11:08,022][106226] Updated weights for policy 0, policy_version 548921 (0.0005) [2023-12-27 23:11:08,086][106226] Updated weights for policy 0, policy_version 548931 (0.0006) [2023-12-27 23:11:08,143][106226] Updated weights for policy 0, policy_version 548941 (0.0006) [2023-12-27 23:11:08,183][106225] Updated weights for policy 1, policy_version 550420 (0.0010) [2023-12-27 23:11:08,205][106226] Updated weights for policy 0, policy_version 548951 (0.0006) [2023-12-27 23:11:08,229][106225] Updated weights for policy 1, policy_version 550430 (0.0007) [2023-12-27 23:11:08,278][106225] Updated weights for policy 1, policy_version 550440 (0.0008) [2023-12-27 23:11:08,808][106226] Updated weights for policy 0, policy_version 548961 (0.0009) [2023-12-27 23:11:08,872][106226] Updated weights for policy 0, policy_version 548971 (0.0009) [2023-12-27 23:11:08,935][106226] Updated weights for policy 0, policy_version 548981 (0.0008) [2023-12-27 23:11:09,071][106225] Updated weights for policy 1, policy_version 550450 (0.0008) [2023-12-27 23:11:09,119][106225] Updated weights for policy 1, policy_version 550460 (0.0009) [2023-12-27 23:11:09,170][106225] Updated weights for policy 1, policy_version 550470 (0.0008) [2023-12-27 23:11:09,227][106225] Updated weights for policy 1, policy_version 550480 (0.0008) [2023-12-27 23:11:09,688][106226] Updated weights for policy 0, policy_version 548991 (0.0009) [2023-12-27 23:11:09,756][106226] Updated weights for policy 0, policy_version 549001 (0.0009) [2023-12-27 23:11:09,819][106226] Updated weights for policy 0, policy_version 549011 (0.0009) [2023-12-27 23:11:10,037][106225] Updated weights for policy 1, policy_version 550490 (0.0009) [2023-12-27 23:11:10,105][106225] Updated weights for policy 1, policy_version 550500 (0.0008) [2023-12-27 23:11:10,169][106225] Updated weights for policy 1, policy_version 550510 (0.0008) [2023-12-27 23:11:10,548][106226] Updated weights for policy 0, policy_version 549021 (0.0009) [2023-12-27 23:11:10,605][106226] Updated weights for policy 0, policy_version 549031 (0.0009) [2023-12-27 23:11:10,664][106226] Updated weights for policy 0, policy_version 549041 (0.0009) [2023-12-27 23:11:10,891][106225] Updated weights for policy 1, policy_version 550520 (0.0006) [2023-12-27 23:11:10,949][106225] Updated weights for policy 1, policy_version 550530 (0.0005) [2023-12-27 23:11:11,013][106225] Updated weights for policy 1, policy_version 550540 (0.0006) [2023-12-27 23:11:11,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 281559040. Throughput: 0: 9731.1, 1: 9865.1. Samples: 281529204. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:11,175][105115] Avg episode reward: [(0, '-5.050'), (1, '-5.476')] [2023-12-27 23:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000550544_140967936.pth... [2023-12-27 23:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000549048_140591104.pth... [2023-12-27 23:11:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000549392_140673024.pth [2023-12-27 23:11:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000547928_140304384.pth [2023-12-27 23:11:11,406][106226] Updated weights for policy 0, policy_version 549051 (0.0009) [2023-12-27 23:11:11,467][106226] Updated weights for policy 0, policy_version 549061 (0.0008) [2023-12-27 23:11:11,530][106226] Updated weights for policy 0, policy_version 549071 (0.0008) [2023-12-27 23:11:11,758][106225] Updated weights for policy 1, policy_version 550550 (0.0008) [2023-12-27 23:11:11,814][106225] Updated weights for policy 1, policy_version 550560 (0.0008) [2023-12-27 23:11:11,877][106225] Updated weights for policy 1, policy_version 550570 (0.0008) [2023-12-27 23:11:12,223][106226] Updated weights for policy 0, policy_version 549081 (0.0008) [2023-12-27 23:11:12,288][106226] Updated weights for policy 0, policy_version 549091 (0.0006) [2023-12-27 23:11:12,354][106226] Updated weights for policy 0, policy_version 549101 (0.0010) [2023-12-27 23:11:12,421][106226] Updated weights for policy 0, policy_version 549111 (0.0011) [2023-12-27 23:11:12,647][106225] Updated weights for policy 1, policy_version 550580 (0.0008) [2023-12-27 23:11:12,710][106225] Updated weights for policy 1, policy_version 550590 (0.0011) [2023-12-27 23:11:12,764][106225] Updated weights for policy 1, policy_version 550600 (0.0010) [2023-12-27 23:11:13,110][106226] Updated weights for policy 0, policy_version 549121 (0.0011) [2023-12-27 23:11:13,160][106226] Updated weights for policy 0, policy_version 549131 (0.0011) [2023-12-27 23:11:13,224][106226] Updated weights for policy 0, policy_version 549141 (0.0008) [2023-12-27 23:11:13,397][106225] Updated weights for policy 1, policy_version 550610 (0.0010) [2023-12-27 23:11:13,447][106225] Updated weights for policy 1, policy_version 550620 (0.0007) [2023-12-27 23:11:13,494][106225] Updated weights for policy 1, policy_version 550630 (0.0007) [2023-12-27 23:11:13,538][106225] Updated weights for policy 1, policy_version 550640 (0.0008) [2023-12-27 23:11:13,945][106226] Updated weights for policy 0, policy_version 549151 (0.0010) [2023-12-27 23:11:13,994][106226] Updated weights for policy 0, policy_version 549161 (0.0010) [2023-12-27 23:11:14,045][106226] Updated weights for policy 0, policy_version 549171 (0.0010) [2023-12-27 23:11:14,292][106225] Updated weights for policy 1, policy_version 550650 (0.0005) [2023-12-27 23:11:14,351][106225] Updated weights for policy 1, policy_version 550660 (0.0006) [2023-12-27 23:11:14,405][106225] Updated weights for policy 1, policy_version 550670 (0.0005) [2023-12-27 23:11:14,711][106226] Updated weights for policy 0, policy_version 549181 (0.0008) [2023-12-27 23:11:14,769][106226] Updated weights for policy 0, policy_version 549191 (0.0006) [2023-12-27 23:11:14,837][106226] Updated weights for policy 0, policy_version 549201 (0.0007) [2023-12-27 23:11:15,024][106225] Updated weights for policy 1, policy_version 550680 (0.0008) [2023-12-27 23:11:15,073][106225] Updated weights for policy 1, policy_version 550690 (0.0009) [2023-12-27 23:11:15,123][106225] Updated weights for policy 1, policy_version 550700 (0.0010) [2023-12-27 23:11:15,527][106226] Updated weights for policy 0, policy_version 549211 (0.0007) [2023-12-27 23:11:15,584][106226] Updated weights for policy 0, policy_version 549221 (0.0008) [2023-12-27 23:11:15,642][106226] Updated weights for policy 0, policy_version 549231 (0.0009) [2023-12-27 23:11:15,818][106225] Updated weights for policy 1, policy_version 550710 (0.0009) [2023-12-27 23:11:15,869][106225] Updated weights for policy 1, policy_version 550720 (0.0010) [2023-12-27 23:11:15,916][106225] Updated weights for policy 1, policy_version 550730 (0.0010) [2023-12-27 23:11:16,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 281657344. Throughput: 0: 9719.7, 1: 9886.5. Samples: 281646424. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:16,175][105115] Avg episode reward: [(0, '-5.309'), (1, '-5.373')] [2023-12-27 23:11:16,317][106226] Updated weights for policy 0, policy_version 549241 (0.0008) [2023-12-27 23:11:16,365][106226] Updated weights for policy 0, policy_version 549251 (0.0005) [2023-12-27 23:11:16,419][106226] Updated weights for policy 0, policy_version 549261 (0.0005) [2023-12-27 23:11:16,479][106226] Updated weights for policy 0, policy_version 549271 (0.0005) [2023-12-27 23:11:16,631][106225] Updated weights for policy 1, policy_version 550740 (0.0010) [2023-12-27 23:11:16,687][106225] Updated weights for policy 1, policy_version 550750 (0.0010) [2023-12-27 23:11:16,743][106225] Updated weights for policy 1, policy_version 550760 (0.0010) [2023-12-27 23:11:17,119][106226] Updated weights for policy 0, policy_version 549281 (0.0008) [2023-12-27 23:11:17,166][106226] Updated weights for policy 0, policy_version 549291 (0.0008) [2023-12-27 23:11:17,213][106226] Updated weights for policy 0, policy_version 549301 (0.0008) [2023-12-27 23:11:17,441][106225] Updated weights for policy 1, policy_version 550770 (0.0010) [2023-12-27 23:11:17,492][106225] Updated weights for policy 1, policy_version 550780 (0.0010) [2023-12-27 23:11:17,545][106225] Updated weights for policy 1, policy_version 550790 (0.0010) [2023-12-27 23:11:17,602][106225] Updated weights for policy 1, policy_version 550800 (0.0010) [2023-12-27 23:11:17,786][106226] Updated weights for policy 0, policy_version 549311 (0.0008) [2023-12-27 23:11:17,836][106226] Updated weights for policy 0, policy_version 549321 (0.0007) [2023-12-27 23:11:17,893][106226] Updated weights for policy 0, policy_version 549331 (0.0007) [2023-12-27 23:11:18,359][106225] Updated weights for policy 1, policy_version 550810 (0.0009) [2023-12-27 23:11:18,423][106225] Updated weights for policy 1, policy_version 550820 (0.0008) [2023-12-27 23:11:18,495][106225] Updated weights for policy 1, policy_version 550830 (0.0006) [2023-12-27 23:11:18,565][106226] Updated weights for policy 0, policy_version 549341 (0.0009) [2023-12-27 23:11:18,626][106226] Updated weights for policy 0, policy_version 549351 (0.0011) [2023-12-27 23:11:18,687][106226] Updated weights for policy 0, policy_version 549361 (0.0010) [2023-12-27 23:11:19,211][106225] Updated weights for policy 1, policy_version 550840 (0.0008) [2023-12-27 23:11:19,275][106225] Updated weights for policy 1, policy_version 550850 (0.0008) [2023-12-27 23:11:19,338][106225] Updated weights for policy 1, policy_version 550860 (0.0009) [2023-12-27 23:11:19,362][106226] Updated weights for policy 0, policy_version 549371 (0.0007) [2023-12-27 23:11:19,417][106226] Updated weights for policy 0, policy_version 549381 (0.0008) [2023-12-27 23:11:19,476][106226] Updated weights for policy 0, policy_version 549391 (0.0008) [2023-12-27 23:11:20,084][106225] Updated weights for policy 1, policy_version 550870 (0.0007) [2023-12-27 23:11:20,149][106225] Updated weights for policy 1, policy_version 550880 (0.0006) [2023-12-27 23:11:20,215][106225] Updated weights for policy 1, policy_version 550890 (0.0010) [2023-12-27 23:11:20,278][106226] Updated weights for policy 0, policy_version 549401 (0.0008) [2023-12-27 23:11:20,345][106226] Updated weights for policy 0, policy_version 549411 (0.0009) [2023-12-27 23:11:20,414][106226] Updated weights for policy 0, policy_version 549421 (0.0009) [2023-12-27 23:11:20,477][106226] Updated weights for policy 0, policy_version 549431 (0.0009) [2023-12-27 23:11:20,823][106225] Updated weights for policy 1, policy_version 550900 (0.0008) [2023-12-27 23:11:20,888][106225] Updated weights for policy 1, policy_version 550910 (0.0010) [2023-12-27 23:11:20,947][106225] Updated weights for policy 1, policy_version 550920 (0.0011) [2023-12-27 23:11:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 281755648. Throughput: 0: 9770.8, 1: 9886.2. Samples: 281765816. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:21,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.141')] [2023-12-27 23:11:21,256][106226] Updated weights for policy 0, policy_version 549441 (0.0009) [2023-12-27 23:11:21,320][106226] Updated weights for policy 0, policy_version 549451 (0.0010) [2023-12-27 23:11:21,388][106226] Updated weights for policy 0, policy_version 549461 (0.0008) [2023-12-27 23:11:21,659][106225] Updated weights for policy 1, policy_version 550930 (0.0011) [2023-12-27 23:11:21,720][106225] Updated weights for policy 1, policy_version 550940 (0.0011) [2023-12-27 23:11:21,783][106225] Updated weights for policy 1, policy_version 550950 (0.0009) [2023-12-27 23:11:21,849][106225] Updated weights for policy 1, policy_version 550960 (0.0008) [2023-12-27 23:11:22,069][106226] Updated weights for policy 0, policy_version 549471 (0.0006) [2023-12-27 23:11:22,135][106226] Updated weights for policy 0, policy_version 549481 (0.0006) [2023-12-27 23:11:22,195][106226] Updated weights for policy 0, policy_version 549491 (0.0007) [2023-12-27 23:11:22,609][106225] Updated weights for policy 1, policy_version 550970 (0.0009) [2023-12-27 23:11:22,668][106225] Updated weights for policy 1, policy_version 550980 (0.0008) [2023-12-27 23:11:22,729][106225] Updated weights for policy 1, policy_version 550990 (0.0006) [2023-12-27 23:11:22,970][106226] Updated weights for policy 0, policy_version 549501 (0.0008) [2023-12-27 23:11:23,034][106226] Updated weights for policy 0, policy_version 549511 (0.0009) [2023-12-27 23:11:23,088][106226] Updated weights for policy 0, policy_version 549521 (0.0009) [2023-12-27 23:11:23,370][106225] Updated weights for policy 1, policy_version 551000 (0.0009) [2023-12-27 23:11:23,430][106225] Updated weights for policy 1, policy_version 551010 (0.0009) [2023-12-27 23:11:23,488][106225] Updated weights for policy 1, policy_version 551020 (0.0010) [2023-12-27 23:11:23,816][106226] Updated weights for policy 0, policy_version 549531 (0.0011) [2023-12-27 23:11:23,873][106226] Updated weights for policy 0, policy_version 549541 (0.0008) [2023-12-27 23:11:23,934][106226] Updated weights for policy 0, policy_version 549551 (0.0007) [2023-12-27 23:11:24,116][106225] Updated weights for policy 1, policy_version 551030 (0.0010) [2023-12-27 23:11:24,173][106225] Updated weights for policy 1, policy_version 551040 (0.0009) [2023-12-27 23:11:24,234][106225] Updated weights for policy 1, policy_version 551050 (0.0008) [2023-12-27 23:11:24,538][106226] Updated weights for policy 0, policy_version 549561 (0.0008) [2023-12-27 23:11:24,596][106226] Updated weights for policy 0, policy_version 549571 (0.0007) [2023-12-27 23:11:24,646][106226] Updated weights for policy 0, policy_version 549581 (0.0008) [2023-12-27 23:11:24,705][106226] Updated weights for policy 0, policy_version 549591 (0.0008) [2023-12-27 23:11:24,957][106225] Updated weights for policy 1, policy_version 551060 (0.0009) [2023-12-27 23:11:25,017][106225] Updated weights for policy 1, policy_version 551070 (0.0010) [2023-12-27 23:11:25,073][106225] Updated weights for policy 1, policy_version 551080 (0.0010) [2023-12-27 23:11:25,454][106226] Updated weights for policy 0, policy_version 549601 (0.0008) [2023-12-27 23:11:25,501][106226] Updated weights for policy 0, policy_version 549611 (0.0008) [2023-12-27 23:11:25,552][106226] Updated weights for policy 0, policy_version 549621 (0.0008) [2023-12-27 23:11:25,749][106225] Updated weights for policy 1, policy_version 551090 (0.0009) [2023-12-27 23:11:25,807][106225] Updated weights for policy 1, policy_version 551100 (0.0009) [2023-12-27 23:11:25,863][106225] Updated weights for policy 1, policy_version 551110 (0.0011) [2023-12-27 23:11:25,929][106225] Updated weights for policy 1, policy_version 551120 (0.0006) [2023-12-27 23:11:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 281853952. Throughput: 0: 9750.4, 1: 9898.8. Samples: 281824092. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:26,175][105115] Avg episode reward: [(0, '-4.967'), (1, '-5.372')] [2023-12-27 23:11:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000549624_140738560.pth... [2023-12-27 23:11:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000551120_141115392.pth... [2023-12-27 23:11:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000548472_140443648.pth [2023-12-27 23:11:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000549968_140820480.pth [2023-12-27 23:11:26,400][106226] Updated weights for policy 0, policy_version 549631 (0.0008) [2023-12-27 23:11:26,451][106226] Updated weights for policy 0, policy_version 549641 (0.0009) [2023-12-27 23:11:26,497][106225] Updated weights for policy 1, policy_version 551130 (0.0010) [2023-12-27 23:11:26,509][106226] Updated weights for policy 0, policy_version 549651 (0.0008) [2023-12-27 23:11:26,549][106225] Updated weights for policy 1, policy_version 551140 (0.0010) [2023-12-27 23:11:26,598][106225] Updated weights for policy 1, policy_version 551150 (0.0010) [2023-12-27 23:11:27,235][106226] Updated weights for policy 0, policy_version 549661 (0.0007) [2023-12-27 23:11:27,289][106226] Updated weights for policy 0, policy_version 549671 (0.0007) [2023-12-27 23:11:27,317][106225] Updated weights for policy 1, policy_version 551160 (0.0009) [2023-12-27 23:11:27,346][106226] Updated weights for policy 0, policy_version 549681 (0.0008) [2023-12-27 23:11:27,375][106225] Updated weights for policy 1, policy_version 551170 (0.0010) [2023-12-27 23:11:27,429][106225] Updated weights for policy 1, policy_version 551180 (0.0010) [2023-12-27 23:11:28,033][106225] Updated weights for policy 1, policy_version 551190 (0.0010) [2023-12-27 23:11:28,085][106225] Updated weights for policy 1, policy_version 551200 (0.0010) [2023-12-27 23:11:28,140][106226] Updated weights for policy 0, policy_version 549691 (0.0005) [2023-12-27 23:11:28,142][106225] Updated weights for policy 1, policy_version 551210 (0.0009) [2023-12-27 23:11:28,200][106226] Updated weights for policy 0, policy_version 549701 (0.0007) [2023-12-27 23:11:28,258][106226] Updated weights for policy 0, policy_version 549711 (0.0005) [2023-12-27 23:11:28,788][106225] Updated weights for policy 1, policy_version 551220 (0.0008) [2023-12-27 23:11:28,844][106225] Updated weights for policy 1, policy_version 551230 (0.0010) [2023-12-27 23:11:28,895][106225] Updated weights for policy 1, policy_version 551240 (0.0010) [2023-12-27 23:11:28,966][106226] Updated weights for policy 0, policy_version 549721 (0.0005) [2023-12-27 23:11:29,027][106226] Updated weights for policy 0, policy_version 549731 (0.0008) [2023-12-27 23:11:29,080][106226] Updated weights for policy 0, policy_version 549741 (0.0008) [2023-12-27 23:11:29,129][106226] Updated weights for policy 0, policy_version 549751 (0.0008) [2023-12-27 23:11:29,613][106225] Updated weights for policy 1, policy_version 551250 (0.0010) [2023-12-27 23:11:29,663][106225] Updated weights for policy 1, policy_version 551260 (0.0008) [2023-12-27 23:11:29,713][106225] Updated weights for policy 1, policy_version 551270 (0.0009) [2023-12-27 23:11:29,772][106225] Updated weights for policy 1, policy_version 551280 (0.0009) [2023-12-27 23:11:29,871][106226] Updated weights for policy 0, policy_version 549761 (0.0008) [2023-12-27 23:11:29,930][106226] Updated weights for policy 0, policy_version 549771 (0.0008) [2023-12-27 23:11:30,001][106226] Updated weights for policy 0, policy_version 549781 (0.0006) [2023-12-27 23:11:30,541][106225] Updated weights for policy 1, policy_version 551290 (0.0005) [2023-12-27 23:11:30,605][106225] Updated weights for policy 1, policy_version 551300 (0.0005) [2023-12-27 23:11:30,668][106225] Updated weights for policy 1, policy_version 551310 (0.0005) [2023-12-27 23:11:30,705][106226] Updated weights for policy 0, policy_version 549791 (0.0007) [2023-12-27 23:11:30,754][106226] Updated weights for policy 0, policy_version 549801 (0.0009) [2023-12-27 23:11:30,806][106226] Updated weights for policy 0, policy_version 549811 (0.0010) [2023-12-27 23:11:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 281952256. Throughput: 0: 9725.3, 1: 9973.4. Samples: 281943496. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:31,175][105115] Avg episode reward: [(0, '-5.021'), (1, '-5.465')] [2023-12-27 23:11:31,300][106225] Updated weights for policy 1, policy_version 551320 (0.0008) [2023-12-27 23:11:31,365][106225] Updated weights for policy 1, policy_version 551330 (0.0008) [2023-12-27 23:11:31,431][106225] Updated weights for policy 1, policy_version 551340 (0.0008) [2023-12-27 23:11:31,597][106226] Updated weights for policy 0, policy_version 549821 (0.0010) [2023-12-27 23:11:31,671][106226] Updated weights for policy 0, policy_version 549831 (0.0011) [2023-12-27 23:11:31,735][106226] Updated weights for policy 0, policy_version 549841 (0.0009) [2023-12-27 23:11:32,117][106225] Updated weights for policy 1, policy_version 551350 (0.0006) [2023-12-27 23:11:32,171][106225] Updated weights for policy 1, policy_version 551360 (0.0005) [2023-12-27 23:11:32,224][106225] Updated weights for policy 1, policy_version 551370 (0.0007) [2023-12-27 23:11:32,412][106226] Updated weights for policy 0, policy_version 549851 (0.0008) [2023-12-27 23:11:32,472][106226] Updated weights for policy 0, policy_version 549861 (0.0008) [2023-12-27 23:11:32,534][106226] Updated weights for policy 0, policy_version 549871 (0.0009) [2023-12-27 23:11:32,912][106225] Updated weights for policy 1, policy_version 551380 (0.0008) [2023-12-27 23:11:32,963][106225] Updated weights for policy 1, policy_version 551390 (0.0008) [2023-12-27 23:11:33,014][106225] Updated weights for policy 1, policy_version 551400 (0.0008) [2023-12-27 23:11:33,281][106226] Updated weights for policy 0, policy_version 549881 (0.0008) [2023-12-27 23:11:33,334][106226] Updated weights for policy 0, policy_version 549891 (0.0006) [2023-12-27 23:11:33,389][106226] Updated weights for policy 0, policy_version 549901 (0.0008) [2023-12-27 23:11:33,448][106226] Updated weights for policy 0, policy_version 549911 (0.0008) [2023-12-27 23:11:33,690][106225] Updated weights for policy 1, policy_version 551410 (0.0008) [2023-12-27 23:11:33,752][106225] Updated weights for policy 1, policy_version 551420 (0.0010) [2023-12-27 23:11:33,811][106225] Updated weights for policy 1, policy_version 551430 (0.0010) [2023-12-27 23:11:33,861][106225] Updated weights for policy 1, policy_version 551440 (0.0009) [2023-12-27 23:11:34,202][106226] Updated weights for policy 0, policy_version 549921 (0.0007) [2023-12-27 23:11:34,262][106226] Updated weights for policy 0, policy_version 549931 (0.0009) [2023-12-27 23:11:34,327][106226] Updated weights for policy 0, policy_version 549941 (0.0008) [2023-12-27 23:11:34,476][106225] Updated weights for policy 1, policy_version 551450 (0.0006) [2023-12-27 23:11:34,533][106225] Updated weights for policy 1, policy_version 551460 (0.0005) [2023-12-27 23:11:34,589][106225] Updated weights for policy 1, policy_version 551470 (0.0005) [2023-12-27 23:11:35,127][106226] Updated weights for policy 0, policy_version 549951 (0.0008) [2023-12-27 23:11:35,158][106225] Updated weights for policy 1, policy_version 551480 (0.0007) [2023-12-27 23:11:35,183][106226] Updated weights for policy 0, policy_version 549961 (0.0007) [2023-12-27 23:11:35,212][106225] Updated weights for policy 1, policy_version 551490 (0.0008) [2023-12-27 23:11:35,250][106226] Updated weights for policy 0, policy_version 549971 (0.0005) [2023-12-27 23:11:35,263][106225] Updated weights for policy 1, policy_version 551500 (0.0008) [2023-12-27 23:11:35,773][106226] Updated weights for policy 0, policy_version 549981 (0.0005) [2023-12-27 23:11:35,835][106226] Updated weights for policy 0, policy_version 549991 (0.0005) [2023-12-27 23:11:35,897][106226] Updated weights for policy 0, policy_version 550001 (0.0006) [2023-12-27 23:11:36,017][106225] Updated weights for policy 1, policy_version 551510 (0.0007) [2023-12-27 23:11:36,082][106225] Updated weights for policy 1, policy_version 551520 (0.0006) [2023-12-27 23:11:36,149][106225] Updated weights for policy 1, policy_version 551530 (0.0008) [2023-12-27 23:11:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 282050560. Throughput: 0: 9804.1, 1: 9948.6. Samples: 282063900. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:36,175][105115] Avg episode reward: [(0, '-5.273'), (1, '-5.687')] [2023-12-27 23:11:36,578][106226] Updated weights for policy 0, policy_version 550011 (0.0009) [2023-12-27 23:11:36,645][106226] Updated weights for policy 0, policy_version 550021 (0.0010) [2023-12-27 23:11:36,709][106226] Updated weights for policy 0, policy_version 550031 (0.0010) [2023-12-27 23:11:36,853][106225] Updated weights for policy 1, policy_version 551540 (0.0009) [2023-12-27 23:11:36,901][106225] Updated weights for policy 1, policy_version 551550 (0.0006) [2023-12-27 23:11:36,957][106225] Updated weights for policy 1, policy_version 551560 (0.0005) [2023-12-27 23:11:37,336][106226] Updated weights for policy 0, policy_version 550041 (0.0007) [2023-12-27 23:11:37,402][106226] Updated weights for policy 0, policy_version 550051 (0.0008) [2023-12-27 23:11:37,471][106226] Updated weights for policy 0, policy_version 550061 (0.0008) [2023-12-27 23:11:37,559][106226] Updated weights for policy 0, policy_version 550071 (0.0008) [2023-12-27 23:11:37,643][106225] Updated weights for policy 1, policy_version 551570 (0.0005) [2023-12-27 23:11:37,700][106225] Updated weights for policy 1, policy_version 551580 (0.0007) [2023-12-27 23:11:37,751][106225] Updated weights for policy 1, policy_version 551590 (0.0008) [2023-12-27 23:11:37,812][106225] Updated weights for policy 1, policy_version 551600 (0.0008) [2023-12-27 23:11:38,206][106226] Updated weights for policy 0, policy_version 550081 (0.0007) [2023-12-27 23:11:38,268][106226] Updated weights for policy 0, policy_version 550091 (0.0006) [2023-12-27 23:11:38,327][106226] Updated weights for policy 0, policy_version 550101 (0.0009) [2023-12-27 23:11:38,499][106225] Updated weights for policy 1, policy_version 551610 (0.0009) [2023-12-27 23:11:38,556][106225] Updated weights for policy 1, policy_version 551620 (0.0009) [2023-12-27 23:11:38,603][106225] Updated weights for policy 1, policy_version 551630 (0.0008) [2023-12-27 23:11:39,062][106226] Updated weights for policy 0, policy_version 550111 (0.0008) [2023-12-27 23:11:39,110][106226] Updated weights for policy 0, policy_version 550121 (0.0008) [2023-12-27 23:11:39,169][106226] Updated weights for policy 0, policy_version 550131 (0.0007) [2023-12-27 23:11:39,389][106225] Updated weights for policy 1, policy_version 551640 (0.0008) [2023-12-27 23:11:39,453][106225] Updated weights for policy 1, policy_version 551650 (0.0008) [2023-12-27 23:11:39,517][106225] Updated weights for policy 1, policy_version 551660 (0.0009) [2023-12-27 23:11:39,956][106226] Updated weights for policy 0, policy_version 550141 (0.0007) [2023-12-27 23:11:40,022][106226] Updated weights for policy 0, policy_version 550151 (0.0007) [2023-12-27 23:11:40,091][106226] Updated weights for policy 0, policy_version 550161 (0.0010) [2023-12-27 23:11:40,237][106225] Updated weights for policy 1, policy_version 551670 (0.0009) [2023-12-27 23:11:40,294][106225] Updated weights for policy 1, policy_version 551680 (0.0008) [2023-12-27 23:11:40,361][106225] Updated weights for policy 1, policy_version 551690 (0.0009) [2023-12-27 23:11:40,823][106226] Updated weights for policy 0, policy_version 550171 (0.0008) [2023-12-27 23:11:40,882][106226] Updated weights for policy 0, policy_version 550181 (0.0008) [2023-12-27 23:11:40,944][106226] Updated weights for policy 0, policy_version 550191 (0.0007) [2023-12-27 23:11:41,104][106225] Updated weights for policy 1, policy_version 551700 (0.0008) [2023-12-27 23:11:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 282148864. Throughput: 0: 9839.8, 1: 9961.6. Samples: 282123424. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:41,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-5.545')] [2023-12-27 23:11:41,177][106225] Updated weights for policy 1, policy_version 551710 (0.0008) [2023-12-27 23:11:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000550200_140886016.pth... [2023-12-27 23:11:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000549048_140591104.pth [2023-12-27 23:11:41,239][106225] Updated weights for policy 1, policy_version 551720 (0.0007) [2023-12-27 23:11:41,278][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000551728_141271040.pth... [2023-12-27 23:11:41,282][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000550544_140967936.pth [2023-12-27 23:11:41,701][106226] Updated weights for policy 0, policy_version 550201 (0.0009) [2023-12-27 23:11:41,774][106226] Updated weights for policy 0, policy_version 550211 (0.0009) [2023-12-27 23:11:41,837][106226] Updated weights for policy 0, policy_version 550221 (0.0009) [2023-12-27 23:11:41,897][106226] Updated weights for policy 0, policy_version 550231 (0.0008) [2023-12-27 23:11:41,992][106225] Updated weights for policy 1, policy_version 551730 (0.0009) [2023-12-27 23:11:42,051][106225] Updated weights for policy 1, policy_version 551740 (0.0009) [2023-12-27 23:11:42,111][106225] Updated weights for policy 1, policy_version 551750 (0.0009) [2023-12-27 23:11:42,178][106225] Updated weights for policy 1, policy_version 551760 (0.0008) [2023-12-27 23:11:42,624][106226] Updated weights for policy 0, policy_version 550241 (0.0008) [2023-12-27 23:11:42,687][106226] Updated weights for policy 0, policy_version 550251 (0.0009) [2023-12-27 23:11:42,745][106226] Updated weights for policy 0, policy_version 550261 (0.0009) [2023-12-27 23:11:42,930][106225] Updated weights for policy 1, policy_version 551770 (0.0008) [2023-12-27 23:11:42,989][106225] Updated weights for policy 1, policy_version 551780 (0.0009) [2023-12-27 23:11:43,047][106225] Updated weights for policy 1, policy_version 551790 (0.0008) [2023-12-27 23:11:43,439][106226] Updated weights for policy 0, policy_version 550271 (0.0006) [2023-12-27 23:11:43,493][106226] Updated weights for policy 0, policy_version 550281 (0.0008) [2023-12-27 23:11:43,542][106226] Updated weights for policy 0, policy_version 550291 (0.0009) [2023-12-27 23:11:43,685][106225] Updated weights for policy 1, policy_version 551800 (0.0006) [2023-12-27 23:11:43,738][106225] Updated weights for policy 1, policy_version 551810 (0.0005) [2023-12-27 23:11:43,791][106225] Updated weights for policy 1, policy_version 551820 (0.0006) [2023-12-27 23:11:44,140][106226] Updated weights for policy 0, policy_version 550301 (0.0008) [2023-12-27 23:11:44,209][106226] Updated weights for policy 0, policy_version 550311 (0.0006) [2023-12-27 23:11:44,282][106226] Updated weights for policy 0, policy_version 550321 (0.0007) [2023-12-27 23:11:44,406][106225] Updated weights for policy 1, policy_version 551830 (0.0006) [2023-12-27 23:11:44,456][106225] Updated weights for policy 1, policy_version 551840 (0.0005) [2023-12-27 23:11:44,514][106225] Updated weights for policy 1, policy_version 551850 (0.0005) [2023-12-27 23:11:44,997][106226] Updated weights for policy 0, policy_version 550331 (0.0009) [2023-12-27 23:11:45,053][106226] Updated weights for policy 0, policy_version 550341 (0.0006) [2023-12-27 23:11:45,115][106226] Updated weights for policy 0, policy_version 550351 (0.0007) [2023-12-27 23:11:45,194][106225] Updated weights for policy 1, policy_version 551860 (0.0008) [2023-12-27 23:11:45,253][106225] Updated weights for policy 1, policy_version 551870 (0.0011) [2023-12-27 23:11:45,308][106225] Updated weights for policy 1, policy_version 551880 (0.0011) [2023-12-27 23:11:45,799][106226] Updated weights for policy 0, policy_version 550361 (0.0008) [2023-12-27 23:11:45,862][106226] Updated weights for policy 0, policy_version 550371 (0.0010) [2023-12-27 23:11:45,893][106225] Updated weights for policy 1, policy_version 551890 (0.0009) [2023-12-27 23:11:45,918][106226] Updated weights for policy 0, policy_version 550381 (0.0007) [2023-12-27 23:11:45,947][106225] Updated weights for policy 1, policy_version 551900 (0.0009) [2023-12-27 23:11:45,979][106226] Updated weights for policy 0, policy_version 550391 (0.0005) [2023-12-27 23:11:45,997][106225] Updated weights for policy 1, policy_version 551910 (0.0010) [2023-12-27 23:11:46,043][106225] Updated weights for policy 1, policy_version 551920 (0.0010) [2023-12-27 23:11:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 282255360. Throughput: 0: 9786.7, 1: 9971.5. Samples: 282239940. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:46,175][105115] Avg episode reward: [(0, '-5.051'), (1, '-5.451')] [2023-12-27 23:11:46,691][106226] Updated weights for policy 0, policy_version 550401 (0.0008) [2023-12-27 23:11:46,750][106226] Updated weights for policy 0, policy_version 550411 (0.0007) [2023-12-27 23:11:46,768][106225] Updated weights for policy 1, policy_version 551930 (0.0010) [2023-12-27 23:11:46,797][106226] Updated weights for policy 0, policy_version 550421 (0.0006) [2023-12-27 23:11:46,828][106225] Updated weights for policy 1, policy_version 551940 (0.0010) [2023-12-27 23:11:46,878][106225] Updated weights for policy 1, policy_version 551950 (0.0010) [2023-12-27 23:11:47,479][106226] Updated weights for policy 0, policy_version 550431 (0.0008) [2023-12-27 23:11:47,529][106226] Updated weights for policy 0, policy_version 550441 (0.0010) [2023-12-27 23:11:47,556][106225] Updated weights for policy 1, policy_version 551960 (0.0009) [2023-12-27 23:11:47,575][106226] Updated weights for policy 0, policy_version 550451 (0.0010) [2023-12-27 23:11:47,613][106225] Updated weights for policy 1, policy_version 551970 (0.0010) [2023-12-27 23:11:47,669][106225] Updated weights for policy 1, policy_version 551980 (0.0010) [2023-12-27 23:11:48,204][106226] Updated weights for policy 0, policy_version 550461 (0.0008) [2023-12-27 23:11:48,267][106226] Updated weights for policy 0, policy_version 550471 (0.0005) [2023-12-27 23:11:48,344][106225] Updated weights for policy 1, policy_version 551990 (0.0009) [2023-12-27 23:11:48,345][106226] Updated weights for policy 0, policy_version 550483 (0.0009) [2023-12-27 23:11:48,408][106225] Updated weights for policy 1, policy_version 552000 (0.0006) [2023-12-27 23:11:48,470][106225] Updated weights for policy 1, policy_version 552010 (0.0010) [2023-12-27 23:11:48,975][106226] Updated weights for policy 0, policy_version 550493 (0.0007) [2023-12-27 23:11:49,028][106226] Updated weights for policy 0, policy_version 550503 (0.0005) [2023-12-27 23:11:49,075][106226] Updated weights for policy 0, policy_version 550513 (0.0005) [2023-12-27 23:11:49,122][106225] Updated weights for policy 1, policy_version 552020 (0.0010) [2023-12-27 23:11:49,189][106225] Updated weights for policy 1, policy_version 552030 (0.0010) [2023-12-27 23:11:49,263][106225] Updated weights for policy 1, policy_version 552040 (0.0009) [2023-12-27 23:11:49,731][106226] Updated weights for policy 0, policy_version 550523 (0.0006) [2023-12-27 23:11:49,792][106226] Updated weights for policy 0, policy_version 550533 (0.0008) [2023-12-27 23:11:49,857][106226] Updated weights for policy 0, policy_version 550543 (0.0008) [2023-12-27 23:11:50,040][106225] Updated weights for policy 1, policy_version 552050 (0.0010) [2023-12-27 23:11:50,104][106225] Updated weights for policy 1, policy_version 552060 (0.0011) [2023-12-27 23:11:50,169][106225] Updated weights for policy 1, policy_version 552070 (0.0011) [2023-12-27 23:11:50,238][106225] Updated weights for policy 1, policy_version 552080 (0.0011) [2023-12-27 23:11:50,558][106226] Updated weights for policy 0, policy_version 550553 (0.0008) [2023-12-27 23:11:50,630][106226] Updated weights for policy 0, policy_version 550563 (0.0009) [2023-12-27 23:11:50,699][106226] Updated weights for policy 0, policy_version 550573 (0.0009) [2023-12-27 23:11:50,761][106226] Updated weights for policy 0, policy_version 550583 (0.0009) [2023-12-27 23:11:50,850][106225] Updated weights for policy 1, policy_version 552090 (0.0006) [2023-12-27 23:11:50,913][106225] Updated weights for policy 1, policy_version 552100 (0.0006) [2023-12-27 23:11:50,978][106225] Updated weights for policy 1, policy_version 552110 (0.0007) [2023-12-27 23:11:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 282353664. Throughput: 0: 9896.2, 1: 9985.9. Samples: 282362356. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:51,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.371')] [2023-12-27 23:11:51,483][106226] Updated weights for policy 0, policy_version 550593 (0.0008) [2023-12-27 23:11:51,544][106226] Updated weights for policy 0, policy_version 550603 (0.0008) [2023-12-27 23:11:51,607][106226] Updated weights for policy 0, policy_version 550613 (0.0008) [2023-12-27 23:11:51,650][106225] Updated weights for policy 1, policy_version 552120 (0.0008) [2023-12-27 23:11:51,701][106225] Updated weights for policy 1, policy_version 552130 (0.0009) [2023-12-27 23:11:51,770][106225] Updated weights for policy 1, policy_version 552140 (0.0009) [2023-12-27 23:11:52,368][106226] Updated weights for policy 0, policy_version 550623 (0.0009) [2023-12-27 23:11:52,437][106226] Updated weights for policy 0, policy_version 550633 (0.0008) [2023-12-27 23:11:52,497][106226] Updated weights for policy 0, policy_version 550643 (0.0008) [2023-12-27 23:11:52,548][106225] Updated weights for policy 1, policy_version 552150 (0.0008) [2023-12-27 23:11:52,597][106225] Updated weights for policy 1, policy_version 552160 (0.0008) [2023-12-27 23:11:52,653][106225] Updated weights for policy 1, policy_version 552170 (0.0008) [2023-12-27 23:11:53,176][106226] Updated weights for policy 0, policy_version 550653 (0.0007) [2023-12-27 23:11:53,236][106226] Updated weights for policy 0, policy_version 550663 (0.0005) [2023-12-27 23:11:53,292][106226] Updated weights for policy 0, policy_version 550673 (0.0005) [2023-12-27 23:11:53,467][106225] Updated weights for policy 1, policy_version 552180 (0.0007) [2023-12-27 23:11:53,519][106225] Updated weights for policy 1, policy_version 552190 (0.0005) [2023-12-27 23:11:53,564][106225] Updated weights for policy 1, policy_version 552200 (0.0005) [2023-12-27 23:11:53,901][106226] Updated weights for policy 0, policy_version 550683 (0.0006) [2023-12-27 23:11:53,956][106226] Updated weights for policy 0, policy_version 550693 (0.0009) [2023-12-27 23:11:54,014][106226] Updated weights for policy 0, policy_version 550703 (0.0007) [2023-12-27 23:11:54,212][106225] Updated weights for policy 1, policy_version 552210 (0.0005) [2023-12-27 23:11:54,260][106225] Updated weights for policy 1, policy_version 552220 (0.0008) [2023-12-27 23:11:54,311][106225] Updated weights for policy 1, policy_version 552230 (0.0009) [2023-12-27 23:11:54,360][106225] Updated weights for policy 1, policy_version 552240 (0.0008) [2023-12-27 23:11:54,631][106226] Updated weights for policy 0, policy_version 550713 (0.0006) [2023-12-27 23:11:54,695][106226] Updated weights for policy 0, policy_version 550723 (0.0010) [2023-12-27 23:11:54,748][106226] Updated weights for policy 0, policy_version 550733 (0.0010) [2023-12-27 23:11:54,804][106226] Updated weights for policy 0, policy_version 550743 (0.0010) [2023-12-27 23:11:55,063][106225] Updated weights for policy 1, policy_version 552250 (0.0008) [2023-12-27 23:11:55,123][106225] Updated weights for policy 1, policy_version 552260 (0.0008) [2023-12-27 23:11:55,184][106225] Updated weights for policy 1, policy_version 552270 (0.0007) [2023-12-27 23:11:55,521][106226] Updated weights for policy 0, policy_version 550753 (0.0009) [2023-12-27 23:11:55,585][106226] Updated weights for policy 0, policy_version 550763 (0.0008) [2023-12-27 23:11:55,641][106226] Updated weights for policy 0, policy_version 550773 (0.0009) [2023-12-27 23:11:55,814][106225] Updated weights for policy 1, policy_version 552280 (0.0006) [2023-12-27 23:11:55,872][106225] Updated weights for policy 1, policy_version 552290 (0.0006) [2023-12-27 23:11:55,929][106225] Updated weights for policy 1, policy_version 552300 (0.0006) [2023-12-27 23:11:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.5, 300 sec: 19771.9). Total num frames: 282451968. Throughput: 0: 9813.8, 1: 9999.7. Samples: 282420812. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:11:56,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-5.657')] [2023-12-27 23:11:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000552304_141418496.pth... [2023-12-27 23:11:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000550776_141033472.pth... [2023-12-27 23:11:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000551120_141115392.pth [2023-12-27 23:11:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000549624_140738560.pth [2023-12-27 23:11:56,247][106226] Updated weights for policy 0, policy_version 550783 (0.0006) [2023-12-27 23:11:56,302][106226] Updated weights for policy 0, policy_version 550793 (0.0005) [2023-12-27 23:11:56,354][106226] Updated weights for policy 0, policy_version 550803 (0.0006) [2023-12-27 23:11:56,652][106225] Updated weights for policy 1, policy_version 552310 (0.0009) [2023-12-27 23:11:56,701][106225] Updated weights for policy 1, policy_version 552320 (0.0010) [2023-12-27 23:11:56,760][106225] Updated weights for policy 1, policy_version 552330 (0.0007) [2023-12-27 23:11:56,934][106226] Updated weights for policy 0, policy_version 550813 (0.0007) [2023-12-27 23:11:56,985][106226] Updated weights for policy 0, policy_version 550823 (0.0005) [2023-12-27 23:11:57,048][106226] Updated weights for policy 0, policy_version 550833 (0.0009) [2023-12-27 23:11:57,415][106225] Updated weights for policy 1, policy_version 552340 (0.0008) [2023-12-27 23:11:57,470][106225] Updated weights for policy 1, policy_version 552350 (0.0005) [2023-12-27 23:11:57,528][106225] Updated weights for policy 1, policy_version 552360 (0.0006) [2023-12-27 23:11:57,778][106226] Updated weights for policy 0, policy_version 550843 (0.0010) [2023-12-27 23:11:57,830][106226] Updated weights for policy 0, policy_version 550853 (0.0008) [2023-12-27 23:11:57,885][106226] Updated weights for policy 0, policy_version 550863 (0.0009) [2023-12-27 23:11:58,161][106225] Updated weights for policy 1, policy_version 552370 (0.0006) [2023-12-27 23:11:58,222][106225] Updated weights for policy 1, policy_version 552380 (0.0009) [2023-12-27 23:11:58,285][106225] Updated weights for policy 1, policy_version 552390 (0.0008) [2023-12-27 23:11:58,378][106225] Updated weights for policy 1, policy_version 552400 (0.0008) [2023-12-27 23:11:58,634][106226] Updated weights for policy 0, policy_version 550873 (0.0009) [2023-12-27 23:11:58,698][106226] Updated weights for policy 0, policy_version 550883 (0.0009) [2023-12-27 23:11:58,760][106226] Updated weights for policy 0, policy_version 550893 (0.0010) [2023-12-27 23:11:58,829][106226] Updated weights for policy 0, policy_version 550903 (0.0008) [2023-12-27 23:11:59,197][106225] Updated weights for policy 1, policy_version 552410 (0.0009) [2023-12-27 23:11:59,278][106225] Updated weights for policy 1, policy_version 552420 (0.0008) [2023-12-27 23:11:59,351][106225] Updated weights for policy 1, policy_version 552430 (0.0010) [2023-12-27 23:11:59,623][106226] Updated weights for policy 0, policy_version 550913 (0.0006) [2023-12-27 23:11:59,697][106226] Updated weights for policy 0, policy_version 550923 (0.0005) [2023-12-27 23:11:59,769][106226] Updated weights for policy 0, policy_version 550933 (0.0006) [2023-12-27 23:12:00,065][106225] Updated weights for policy 1, policy_version 552440 (0.0009) [2023-12-27 23:12:00,123][106225] Updated weights for policy 1, policy_version 552450 (0.0010) [2023-12-27 23:12:00,179][106225] Updated weights for policy 1, policy_version 552460 (0.0008) [2023-12-27 23:12:00,364][106226] Updated weights for policy 0, policy_version 550943 (0.0009) [2023-12-27 23:12:00,419][106226] Updated weights for policy 0, policy_version 550953 (0.0010) [2023-12-27 23:12:00,484][106226] Updated weights for policy 0, policy_version 550963 (0.0011) [2023-12-27 23:12:00,891][106225] Updated weights for policy 1, policy_version 552470 (0.0008) [2023-12-27 23:12:00,942][106225] Updated weights for policy 1, policy_version 552480 (0.0009) [2023-12-27 23:12:00,993][106225] Updated weights for policy 1, policy_version 552490 (0.0007) [2023-12-27 23:12:01,169][106226] Updated weights for policy 0, policy_version 550973 (0.0009) [2023-12-27 23:12:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 282550272. Throughput: 0: 9867.9, 1: 9996.3. Samples: 282540308. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:01,175][105115] Avg episode reward: [(0, '-5.228'), (1, '-5.668')] [2023-12-27 23:12:01,223][106226] Updated weights for policy 0, policy_version 550983 (0.0008) [2023-12-27 23:12:01,288][106226] Updated weights for policy 0, policy_version 550993 (0.0009) [2023-12-27 23:12:01,839][106225] Updated weights for policy 1, policy_version 552500 (0.0008) [2023-12-27 23:12:01,892][106225] Updated weights for policy 1, policy_version 552510 (0.0007) [2023-12-27 23:12:01,946][106225] Updated weights for policy 1, policy_version 552520 (0.0008) [2023-12-27 23:12:02,032][106226] Updated weights for policy 0, policy_version 551003 (0.0009) [2023-12-27 23:12:02,095][106226] Updated weights for policy 0, policy_version 551013 (0.0010) [2023-12-27 23:12:02,159][106226] Updated weights for policy 0, policy_version 551023 (0.0011) [2023-12-27 23:12:02,696][106225] Updated weights for policy 1, policy_version 552530 (0.0007) [2023-12-27 23:12:02,752][106225] Updated weights for policy 1, policy_version 552540 (0.0009) [2023-12-27 23:12:02,808][106225] Updated weights for policy 1, policy_version 552550 (0.0009) [2023-12-27 23:12:02,859][106226] Updated weights for policy 0, policy_version 551033 (0.0010) [2023-12-27 23:12:02,870][106225] Updated weights for policy 1, policy_version 552560 (0.0010) [2023-12-27 23:12:02,920][106226] Updated weights for policy 0, policy_version 551043 (0.0011) [2023-12-27 23:12:02,979][106226] Updated weights for policy 0, policy_version 551053 (0.0007) [2023-12-27 23:12:03,045][106226] Updated weights for policy 0, policy_version 551063 (0.0007) [2023-12-27 23:12:03,530][106225] Updated weights for policy 1, policy_version 552570 (0.0008) [2023-12-27 23:12:03,577][106225] Updated weights for policy 1, policy_version 552580 (0.0005) [2023-12-27 23:12:03,626][106225] Updated weights for policy 1, policy_version 552590 (0.0005) [2023-12-27 23:12:03,695][106226] Updated weights for policy 0, policy_version 551073 (0.0010) [2023-12-27 23:12:03,748][106226] Updated weights for policy 0, policy_version 551083 (0.0010) [2023-12-27 23:12:03,820][106226] Updated weights for policy 0, policy_version 551093 (0.0011) [2023-12-27 23:12:04,253][106225] Updated weights for policy 1, policy_version 552600 (0.0010) [2023-12-27 23:12:04,317][106225] Updated weights for policy 1, policy_version 552610 (0.0011) [2023-12-27 23:12:04,382][106225] Updated weights for policy 1, policy_version 552620 (0.0009) [2023-12-27 23:12:04,546][106226] Updated weights for policy 0, policy_version 551103 (0.0011) [2023-12-27 23:12:04,606][106226] Updated weights for policy 0, policy_version 551113 (0.0010) [2023-12-27 23:12:04,662][106226] Updated weights for policy 0, policy_version 551123 (0.0009) [2023-12-27 23:12:05,041][106225] Updated weights for policy 1, policy_version 552630 (0.0007) [2023-12-27 23:12:05,108][106225] Updated weights for policy 1, policy_version 552640 (0.0006) [2023-12-27 23:12:05,175][106225] Updated weights for policy 1, policy_version 552650 (0.0007) [2023-12-27 23:12:05,294][106226] Updated weights for policy 0, policy_version 551133 (0.0007) [2023-12-27 23:12:05,347][106226] Updated weights for policy 0, policy_version 551143 (0.0011) [2023-12-27 23:12:05,408][106226] Updated weights for policy 0, policy_version 551153 (0.0010) [2023-12-27 23:12:05,767][106225] Updated weights for policy 1, policy_version 552660 (0.0007) [2023-12-27 23:12:05,824][106225] Updated weights for policy 1, policy_version 552670 (0.0006) [2023-12-27 23:12:05,886][106225] Updated weights for policy 1, policy_version 552680 (0.0008) [2023-12-27 23:12:06,078][106226] Updated weights for policy 0, policy_version 551163 (0.0011) [2023-12-27 23:12:06,141][106226] Updated weights for policy 0, policy_version 551173 (0.0009) [2023-12-27 23:12:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.5, 300 sec: 19744.1). Total num frames: 282648576. Throughput: 0: 9864.6, 1: 10032.0. Samples: 282661164. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:06,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-5.570')] [2023-12-27 23:12:06,206][106226] Updated weights for policy 0, policy_version 551183 (0.0011) [2023-12-27 23:12:06,522][106225] Updated weights for policy 1, policy_version 552690 (0.0007) [2023-12-27 23:12:06,584][106225] Updated weights for policy 1, policy_version 552700 (0.0010) [2023-12-27 23:12:06,646][106225] Updated weights for policy 1, policy_version 552710 (0.0010) [2023-12-27 23:12:06,702][106225] Updated weights for policy 1, policy_version 552720 (0.0009) [2023-12-27 23:12:06,931][106226] Updated weights for policy 0, policy_version 551193 (0.0011) [2023-12-27 23:12:07,000][106226] Updated weights for policy 0, policy_version 551203 (0.0010) [2023-12-27 23:12:07,061][106226] Updated weights for policy 0, policy_version 551213 (0.0009) [2023-12-27 23:12:07,122][106226] Updated weights for policy 0, policy_version 551223 (0.0011) [2023-12-27 23:12:07,319][106225] Updated weights for policy 1, policy_version 552730 (0.0005) [2023-12-27 23:12:07,378][106225] Updated weights for policy 1, policy_version 552740 (0.0007) [2023-12-27 23:12:07,435][106225] Updated weights for policy 1, policy_version 552750 (0.0010) [2023-12-27 23:12:07,851][106226] Updated weights for policy 0, policy_version 551233 (0.0007) [2023-12-27 23:12:07,904][106226] Updated weights for policy 0, policy_version 551243 (0.0007) [2023-12-27 23:12:07,949][106226] Updated weights for policy 0, policy_version 551253 (0.0008) [2023-12-27 23:12:08,034][106225] Updated weights for policy 1, policy_version 552760 (0.0007) [2023-12-27 23:12:08,089][106225] Updated weights for policy 1, policy_version 552770 (0.0005) [2023-12-27 23:12:08,147][106225] Updated weights for policy 1, policy_version 552780 (0.0008) [2023-12-27 23:12:08,634][106226] Updated weights for policy 0, policy_version 551263 (0.0008) [2023-12-27 23:12:08,697][106226] Updated weights for policy 0, policy_version 551273 (0.0009) [2023-12-27 23:12:08,758][106226] Updated weights for policy 0, policy_version 551283 (0.0007) [2023-12-27 23:12:08,800][106225] Updated weights for policy 1, policy_version 552790 (0.0010) [2023-12-27 23:12:08,864][106225] Updated weights for policy 1, policy_version 552800 (0.0010) [2023-12-27 23:12:08,915][106225] Updated weights for policy 1, policy_version 552810 (0.0006) [2023-12-27 23:12:09,454][106226] Updated weights for policy 0, policy_version 551293 (0.0008) [2023-12-27 23:12:09,526][106226] Updated weights for policy 0, policy_version 551303 (0.0008) [2023-12-27 23:12:09,589][106226] Updated weights for policy 0, policy_version 551313 (0.0007) [2023-12-27 23:12:09,623][106225] Updated weights for policy 1, policy_version 552820 (0.0007) [2023-12-27 23:12:09,680][106225] Updated weights for policy 1, policy_version 552830 (0.0009) [2023-12-27 23:12:09,746][106225] Updated weights for policy 1, policy_version 552840 (0.0007) [2023-12-27 23:12:10,346][106226] Updated weights for policy 0, policy_version 551323 (0.0008) [2023-12-27 23:12:10,410][106226] Updated weights for policy 0, policy_version 551333 (0.0010) [2023-12-27 23:12:10,459][106225] Updated weights for policy 1, policy_version 552850 (0.0008) [2023-12-27 23:12:10,466][106226] Updated weights for policy 0, policy_version 551343 (0.0008) [2023-12-27 23:12:10,532][106225] Updated weights for policy 1, policy_version 552860 (0.0007) [2023-12-27 23:12:10,594][106225] Updated weights for policy 1, policy_version 552870 (0.0009) [2023-12-27 23:12:10,652][106225] Updated weights for policy 1, policy_version 552880 (0.0009) [2023-12-27 23:12:11,110][106226] Updated weights for policy 0, policy_version 551353 (0.0007) [2023-12-27 23:12:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 282746880. Throughput: 0: 9879.8, 1: 10092.7. Samples: 282722856. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:11,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-5.211')] [2023-12-27 23:12:11,180][106226] Updated weights for policy 0, policy_version 551363 (0.0009) [2023-12-27 23:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000552880_141565952.pth... [2023-12-27 23:12:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000551728_141271040.pth [2023-12-27 23:12:11,250][106226] Updated weights for policy 0, policy_version 551373 (0.0009) [2023-12-27 23:12:11,303][106226] Updated weights for policy 0, policy_version 551383 (0.0007) [2023-12-27 23:12:11,307][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000551384_141189120.pth... [2023-12-27 23:12:11,312][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000550200_140886016.pth [2023-12-27 23:12:11,423][106225] Updated weights for policy 1, policy_version 552890 (0.0008) [2023-12-27 23:12:11,488][106225] Updated weights for policy 1, policy_version 552900 (0.0009) [2023-12-27 23:12:11,551][106225] Updated weights for policy 1, policy_version 552910 (0.0009) [2023-12-27 23:12:11,994][106226] Updated weights for policy 0, policy_version 551393 (0.0009) [2023-12-27 23:12:12,051][106226] Updated weights for policy 0, policy_version 551403 (0.0009) [2023-12-27 23:12:12,109][106226] Updated weights for policy 0, policy_version 551413 (0.0008) [2023-12-27 23:12:12,257][106225] Updated weights for policy 1, policy_version 552920 (0.0008) [2023-12-27 23:12:12,324][106225] Updated weights for policy 1, policy_version 552930 (0.0009) [2023-12-27 23:12:12,393][106225] Updated weights for policy 1, policy_version 552940 (0.0008) [2023-12-27 23:12:12,899][106226] Updated weights for policy 0, policy_version 551423 (0.0008) [2023-12-27 23:12:12,955][106226] Updated weights for policy 0, policy_version 551433 (0.0009) [2023-12-27 23:12:13,009][106226] Updated weights for policy 0, policy_version 551443 (0.0008) [2023-12-27 23:12:13,074][106225] Updated weights for policy 1, policy_version 552950 (0.0008) [2023-12-27 23:12:13,126][106225] Updated weights for policy 1, policy_version 552960 (0.0008) [2023-12-27 23:12:13,188][106225] Updated weights for policy 1, policy_version 552970 (0.0009) [2023-12-27 23:12:13,735][106226] Updated weights for policy 0, policy_version 551453 (0.0008) [2023-12-27 23:12:13,787][106226] Updated weights for policy 0, policy_version 551463 (0.0008) [2023-12-27 23:12:13,837][106226] Updated weights for policy 0, policy_version 551473 (0.0008) [2023-12-27 23:12:13,921][106225] Updated weights for policy 1, policy_version 552980 (0.0008) [2023-12-27 23:12:13,971][106225] Updated weights for policy 1, policy_version 552990 (0.0008) [2023-12-27 23:12:14,020][106225] Updated weights for policy 1, policy_version 553000 (0.0006) [2023-12-27 23:12:14,621][106225] Updated weights for policy 1, policy_version 553010 (0.0006) [2023-12-27 23:12:14,644][106226] Updated weights for policy 0, policy_version 551483 (0.0008) [2023-12-27 23:12:14,673][106225] Updated weights for policy 1, policy_version 553020 (0.0007) [2023-12-27 23:12:14,695][106226] Updated weights for policy 0, policy_version 551493 (0.0006) [2023-12-27 23:12:14,730][106225] Updated weights for policy 1, policy_version 553030 (0.0007) [2023-12-27 23:12:14,752][106226] Updated weights for policy 0, policy_version 551503 (0.0007) [2023-12-27 23:12:14,789][106225] Updated weights for policy 1, policy_version 553040 (0.0007) [2023-12-27 23:12:15,484][106225] Updated weights for policy 1, policy_version 553050 (0.0009) [2023-12-27 23:12:15,519][106226] Updated weights for policy 0, policy_version 551513 (0.0009) [2023-12-27 23:12:15,536][106225] Updated weights for policy 1, policy_version 553060 (0.0006) [2023-12-27 23:12:15,575][106226] Updated weights for policy 0, policy_version 551523 (0.0009) [2023-12-27 23:12:15,583][106225] Updated weights for policy 1, policy_version 553070 (0.0008) [2023-12-27 23:12:15,636][106226] Updated weights for policy 0, policy_version 551533 (0.0009) [2023-12-27 23:12:15,690][106226] Updated weights for policy 0, policy_version 551543 (0.0009) [2023-12-27 23:12:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 282845184. Throughput: 0: 9860.8, 1: 10016.2. Samples: 282837964. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:16,175][105115] Avg episode reward: [(0, '-5.086'), (1, '-5.518')] [2023-12-27 23:12:16,246][106226] Updated weights for policy 0, policy_version 551553 (0.0005) [2023-12-27 23:12:16,299][106226] Updated weights for policy 0, policy_version 551563 (0.0005) [2023-12-27 23:12:16,354][106226] Updated weights for policy 0, policy_version 551573 (0.0005) [2023-12-27 23:12:16,425][106225] Updated weights for policy 1, policy_version 553080 (0.0009) [2023-12-27 23:12:16,490][106225] Updated weights for policy 1, policy_version 553090 (0.0008) [2023-12-27 23:12:16,552][106225] Updated weights for policy 1, policy_version 553100 (0.0009) [2023-12-27 23:12:16,943][106226] Updated weights for policy 0, policy_version 551583 (0.0007) [2023-12-27 23:12:17,001][106226] Updated weights for policy 0, policy_version 551593 (0.0008) [2023-12-27 23:12:17,057][106226] Updated weights for policy 0, policy_version 551603 (0.0008) [2023-12-27 23:12:17,294][106225] Updated weights for policy 1, policy_version 553110 (0.0008) [2023-12-27 23:12:17,357][106225] Updated weights for policy 1, policy_version 553120 (0.0008) [2023-12-27 23:12:17,422][106225] Updated weights for policy 1, policy_version 553130 (0.0009) [2023-12-27 23:12:17,780][106226] Updated weights for policy 0, policy_version 551613 (0.0009) [2023-12-27 23:12:17,846][106226] Updated weights for policy 0, policy_version 551623 (0.0009) [2023-12-27 23:12:17,907][106226] Updated weights for policy 0, policy_version 551633 (0.0008) [2023-12-27 23:12:18,148][106225] Updated weights for policy 1, policy_version 553140 (0.0008) [2023-12-27 23:12:18,215][106225] Updated weights for policy 1, policy_version 553150 (0.0006) [2023-12-27 23:12:18,266][106225] Updated weights for policy 1, policy_version 553160 (0.0008) [2023-12-27 23:12:18,534][106226] Updated weights for policy 0, policy_version 551643 (0.0009) [2023-12-27 23:12:18,606][106226] Updated weights for policy 0, policy_version 551653 (0.0009) [2023-12-27 23:12:18,671][106226] Updated weights for policy 0, policy_version 551663 (0.0007) [2023-12-27 23:12:19,010][106225] Updated weights for policy 1, policy_version 553170 (0.0008) [2023-12-27 23:12:19,062][106225] Updated weights for policy 1, policy_version 553180 (0.0005) [2023-12-27 23:12:19,120][106225] Updated weights for policy 1, policy_version 553190 (0.0005) [2023-12-27 23:12:19,168][106225] Updated weights for policy 1, policy_version 553200 (0.0005) [2023-12-27 23:12:19,271][106226] Updated weights for policy 0, policy_version 551673 (0.0008) [2023-12-27 23:12:19,336][106226] Updated weights for policy 0, policy_version 551683 (0.0005) [2023-12-27 23:12:19,403][106226] Updated weights for policy 0, policy_version 551693 (0.0008) [2023-12-27 23:12:19,460][106226] Updated weights for policy 0, policy_version 551703 (0.0008) [2023-12-27 23:12:19,895][106225] Updated weights for policy 1, policy_version 553210 (0.0010) [2023-12-27 23:12:19,961][106225] Updated weights for policy 1, policy_version 553220 (0.0014) [2023-12-27 23:12:20,027][106225] Updated weights for policy 1, policy_version 553230 (0.0011) [2023-12-27 23:12:20,140][106226] Updated weights for policy 0, policy_version 551713 (0.0008) [2023-12-27 23:12:20,203][106226] Updated weights for policy 0, policy_version 551723 (0.0008) [2023-12-27 23:12:20,264][106226] Updated weights for policy 0, policy_version 551733 (0.0008) [2023-12-27 23:12:20,764][106225] Updated weights for policy 1, policy_version 553240 (0.0010) [2023-12-27 23:12:20,826][106225] Updated weights for policy 1, policy_version 553250 (0.0010) [2023-12-27 23:12:20,891][106225] Updated weights for policy 1, policy_version 553260 (0.0011) [2023-12-27 23:12:20,893][106226] Updated weights for policy 0, policy_version 551743 (0.0006) [2023-12-27 23:12:20,961][106226] Updated weights for policy 0, policy_version 551753 (0.0009) [2023-12-27 23:12:21,031][106226] Updated weights for policy 0, policy_version 551763 (0.0009) [2023-12-27 23:12:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 282951680. Throughput: 0: 9972.7, 1: 9884.2. Samples: 282957460. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:21,175][105115] Avg episode reward: [(0, '-5.209'), (1, '-5.243')] [2023-12-27 23:12:21,680][106225] Updated weights for policy 1, policy_version 553270 (0.0008) [2023-12-27 23:12:21,760][106225] Updated weights for policy 1, policy_version 553281 (0.0009) [2023-12-27 23:12:21,796][106226] Updated weights for policy 0, policy_version 551773 (0.0008) [2023-12-27 23:12:21,830][106225] Updated weights for policy 1, policy_version 553291 (0.0008) [2023-12-27 23:12:21,858][106226] Updated weights for policy 0, policy_version 551783 (0.0008) [2023-12-27 23:12:21,921][106226] Updated weights for policy 0, policy_version 551793 (0.0008) [2023-12-27 23:12:22,616][106226] Updated weights for policy 0, policy_version 551803 (0.0008) [2023-12-27 23:12:22,618][106225] Updated weights for policy 1, policy_version 553301 (0.0010) [2023-12-27 23:12:22,671][106226] Updated weights for policy 0, policy_version 551813 (0.0006) [2023-12-27 23:12:22,681][106225] Updated weights for policy 1, policy_version 553311 (0.0011) [2023-12-27 23:12:22,727][106226] Updated weights for policy 0, policy_version 551823 (0.0006) [2023-12-27 23:12:22,740][106225] Updated weights for policy 1, policy_version 553321 (0.0011) [2023-12-27 23:12:23,471][106226] Updated weights for policy 0, policy_version 551833 (0.0006) [2023-12-27 23:12:23,480][106225] Updated weights for policy 1, policy_version 553331 (0.0010) [2023-12-27 23:12:23,528][106226] Updated weights for policy 0, policy_version 551843 (0.0006) [2023-12-27 23:12:23,534][106225] Updated weights for policy 1, policy_version 553341 (0.0010) [2023-12-27 23:12:23,590][106226] Updated weights for policy 0, policy_version 551853 (0.0005) [2023-12-27 23:12:23,591][106225] Updated weights for policy 1, policy_version 553351 (0.0010) [2023-12-27 23:12:23,649][106226] Updated weights for policy 0, policy_version 551863 (0.0006) [2023-12-27 23:12:24,334][106225] Updated weights for policy 1, policy_version 553361 (0.0010) [2023-12-27 23:12:24,378][106226] Updated weights for policy 0, policy_version 551873 (0.0006) [2023-12-27 23:12:24,385][106225] Updated weights for policy 1, policy_version 553371 (0.0010) [2023-12-27 23:12:24,430][106226] Updated weights for policy 0, policy_version 551883 (0.0006) [2023-12-27 23:12:24,432][106225] Updated weights for policy 1, policy_version 553381 (0.0010) [2023-12-27 23:12:24,479][106225] Updated weights for policy 1, policy_version 553391 (0.0010) [2023-12-27 23:12:24,489][106226] Updated weights for policy 0, policy_version 551893 (0.0007) [2023-12-27 23:12:25,221][106226] Updated weights for policy 0, policy_version 551903 (0.0007) [2023-12-27 23:12:25,226][106225] Updated weights for policy 1, policy_version 553401 (0.0010) [2023-12-27 23:12:25,278][106225] Updated weights for policy 1, policy_version 553411 (0.0010) [2023-12-27 23:12:25,281][106226] Updated weights for policy 0, policy_version 551913 (0.0007) [2023-12-27 23:12:25,336][106226] Updated weights for policy 0, policy_version 551923 (0.0005) [2023-12-27 23:12:25,341][106225] Updated weights for policy 1, policy_version 553421 (0.0010) [2023-12-27 23:12:25,931][106225] Updated weights for policy 1, policy_version 553431 (0.0006) [2023-12-27 23:12:25,963][106226] Updated weights for policy 0, policy_version 551933 (0.0010) [2023-12-27 23:12:25,985][106225] Updated weights for policy 1, policy_version 553441 (0.0006) [2023-12-27 23:12:26,015][106226] Updated weights for policy 0, policy_version 551943 (0.0011) [2023-12-27 23:12:26,036][106225] Updated weights for policy 1, policy_version 553451 (0.0005) [2023-12-27 23:12:26,073][106226] Updated weights for policy 0, policy_version 551953 (0.0009) [2023-12-27 23:12:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 283049984. Throughput: 0: 9937.7, 1: 9834.3. Samples: 283013164. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:26,175][105115] Avg episode reward: [(0, '-5.309'), (1, '-5.322')] [2023-12-27 23:12:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000553456_141713408.pth... [2023-12-27 23:12:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000551960_141336576.pth... [2023-12-27 23:12:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000550776_141033472.pth [2023-12-27 23:12:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000552304_141418496.pth [2023-12-27 23:12:26,635][106225] Updated weights for policy 1, policy_version 553461 (0.0008) [2023-12-27 23:12:26,688][106226] Updated weights for policy 0, policy_version 551963 (0.0008) [2023-12-27 23:12:26,695][106225] Updated weights for policy 1, policy_version 553471 (0.0010) [2023-12-27 23:12:26,739][106226] Updated weights for policy 0, policy_version 551973 (0.0005) [2023-12-27 23:12:26,751][106225] Updated weights for policy 1, policy_version 553481 (0.0010) [2023-12-27 23:12:26,791][106226] Updated weights for policy 0, policy_version 551983 (0.0005) [2023-12-27 23:12:27,392][106226] Updated weights for policy 0, policy_version 551993 (0.0006) [2023-12-27 23:12:27,437][106225] Updated weights for policy 1, policy_version 553491 (0.0008) [2023-12-27 23:12:27,445][106226] Updated weights for policy 0, policy_version 552003 (0.0010) [2023-12-27 23:12:27,491][106225] Updated weights for policy 1, policy_version 553501 (0.0010) [2023-12-27 23:12:27,494][106226] Updated weights for policy 0, policy_version 552013 (0.0010) [2023-12-27 23:12:27,537][106225] Updated weights for policy 1, policy_version 553511 (0.0010) [2023-12-27 23:12:27,546][106226] Updated weights for policy 0, policy_version 552023 (0.0010) [2023-12-27 23:12:28,238][106225] Updated weights for policy 1, policy_version 553521 (0.0009) [2023-12-27 23:12:28,293][106225] Updated weights for policy 1, policy_version 553531 (0.0006) [2023-12-27 23:12:28,311][106226] Updated weights for policy 0, policy_version 552033 (0.0008) [2023-12-27 23:12:28,353][106225] Updated weights for policy 1, policy_version 553541 (0.0006) [2023-12-27 23:12:28,378][106226] Updated weights for policy 0, policy_version 552043 (0.0008) [2023-12-27 23:12:28,409][106225] Updated weights for policy 1, policy_version 553551 (0.0007) [2023-12-27 23:12:28,447][106226] Updated weights for policy 0, policy_version 552053 (0.0007) [2023-12-27 23:12:29,007][106225] Updated weights for policy 1, policy_version 553561 (0.0006) [2023-12-27 23:12:29,061][106225] Updated weights for policy 1, policy_version 553571 (0.0005) [2023-12-27 23:12:29,116][106225] Updated weights for policy 1, policy_version 553581 (0.0005) [2023-12-27 23:12:29,172][106226] Updated weights for policy 0, policy_version 552063 (0.0007) [2023-12-27 23:12:29,245][106226] Updated weights for policy 0, policy_version 552073 (0.0007) [2023-12-27 23:12:29,308][106226] Updated weights for policy 0, policy_version 552083 (0.0007) [2023-12-27 23:12:29,791][106225] Updated weights for policy 1, policy_version 553591 (0.0008) [2023-12-27 23:12:29,849][106225] Updated weights for policy 1, policy_version 553601 (0.0007) [2023-12-27 23:12:29,917][106225] Updated weights for policy 1, policy_version 553611 (0.0008) [2023-12-27 23:12:30,018][106226] Updated weights for policy 0, policy_version 552093 (0.0008) [2023-12-27 23:12:30,070][106226] Updated weights for policy 0, policy_version 552103 (0.0009) [2023-12-27 23:12:30,124][106226] Updated weights for policy 0, policy_version 552113 (0.0008) [2023-12-27 23:12:30,544][106225] Updated weights for policy 1, policy_version 553621 (0.0007) [2023-12-27 23:12:30,593][106225] Updated weights for policy 1, policy_version 553631 (0.0005) [2023-12-27 23:12:30,649][106225] Updated weights for policy 1, policy_version 553641 (0.0005) [2023-12-27 23:12:30,944][106226] Updated weights for policy 0, policy_version 552123 (0.0008) [2023-12-27 23:12:31,008][106226] Updated weights for policy 0, policy_version 552133 (0.0010) [2023-12-27 23:12:31,075][106226] Updated weights for policy 0, policy_version 552143 (0.0009) [2023-12-27 23:12:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 283148288. Throughput: 0: 9996.0, 1: 9934.5. Samples: 283136812. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-27 23:12:31,175][105115] Avg episode reward: [(0, '-5.041'), (1, '-5.223')] [2023-12-27 23:12:31,250][106225] Updated weights for policy 1, policy_version 553651 (0.0006) [2023-12-27 23:12:31,316][106225] Updated weights for policy 1, policy_version 553661 (0.0006) [2023-12-27 23:12:31,375][106225] Updated weights for policy 1, policy_version 553671 (0.0007) [2023-12-27 23:12:31,870][106226] Updated weights for policy 0, policy_version 552153 (0.0010) [2023-12-27 23:12:31,924][106226] Updated weights for policy 0, policy_version 552163 (0.0008) [2023-12-27 23:12:31,976][106226] Updated weights for policy 0, policy_version 552173 (0.0007) [2023-12-27 23:12:32,034][106226] Updated weights for policy 0, policy_version 552183 (0.0005) [2023-12-27 23:12:32,088][106225] Updated weights for policy 1, policy_version 553681 (0.0011) [2023-12-27 23:12:32,149][106225] Updated weights for policy 1, policy_version 553691 (0.0010) [2023-12-27 23:12:32,212][106225] Updated weights for policy 1, policy_version 553701 (0.0010) [2023-12-27 23:12:32,280][106225] Updated weights for policy 1, policy_version 553711 (0.0010) [2023-12-27 23:12:32,684][106226] Updated weights for policy 0, policy_version 552193 (0.0007) [2023-12-27 23:12:32,746][106226] Updated weights for policy 0, policy_version 552203 (0.0007) [2023-12-27 23:12:32,806][106226] Updated weights for policy 0, policy_version 552213 (0.0008) [2023-12-27 23:12:32,988][106225] Updated weights for policy 1, policy_version 553721 (0.0008) [2023-12-27 23:12:33,038][106225] Updated weights for policy 1, policy_version 553731 (0.0005) [2023-12-27 23:12:33,083][106225] Updated weights for policy 1, policy_version 553741 (0.0005) [2023-12-27 23:12:33,448][106226] Updated weights for policy 0, policy_version 552223 (0.0006) [2023-12-27 23:12:33,492][106226] Updated weights for policy 0, policy_version 552233 (0.0005) [2023-12-27 23:12:33,539][106226] Updated weights for policy 0, policy_version 552243 (0.0006) [2023-12-27 23:12:33,609][106225] Updated weights for policy 1, policy_version 553751 (0.0005) [2023-12-27 23:12:33,670][106225] Updated weights for policy 1, policy_version 553761 (0.0005) [2023-12-27 23:12:33,732][106225] Updated weights for policy 1, policy_version 553771 (0.0005) [2023-12-27 23:12:34,233][106226] Updated weights for policy 0, policy_version 552253 (0.0008) [2023-12-27 23:12:34,295][106226] Updated weights for policy 0, policy_version 552263 (0.0010) [2023-12-27 23:12:34,359][106226] Updated weights for policy 0, policy_version 552273 (0.0008) [2023-12-27 23:12:34,365][106225] Updated weights for policy 1, policy_version 553781 (0.0005) [2023-12-27 23:12:34,426][106225] Updated weights for policy 1, policy_version 553791 (0.0008) [2023-12-27 23:12:34,483][106225] Updated weights for policy 1, policy_version 553801 (0.0008) [2023-12-27 23:12:35,076][106226] Updated weights for policy 0, policy_version 552283 (0.0007) [2023-12-27 23:12:35,142][106226] Updated weights for policy 0, policy_version 552293 (0.0007) [2023-12-27 23:12:35,150][106225] Updated weights for policy 1, policy_version 553811 (0.0007) [2023-12-27 23:12:35,199][106226] Updated weights for policy 0, policy_version 552303 (0.0008) [2023-12-27 23:12:35,211][106225] Updated weights for policy 1, policy_version 553821 (0.0005) [2023-12-27 23:12:35,265][106225] Updated weights for policy 1, policy_version 553831 (0.0008) [2023-12-27 23:12:35,898][106225] Updated weights for policy 1, policy_version 553841 (0.0007) [2023-12-27 23:12:35,911][106226] Updated weights for policy 0, policy_version 552313 (0.0007) [2023-12-27 23:12:35,959][106226] Updated weights for policy 0, policy_version 552323 (0.0006) [2023-12-27 23:12:35,960][106225] Updated weights for policy 1, policy_version 553851 (0.0008) [2023-12-27 23:12:36,019][106225] Updated weights for policy 1, policy_version 553861 (0.0006) [2023-12-27 23:12:36,024][106226] Updated weights for policy 0, policy_version 552333 (0.0008) [2023-12-27 23:12:36,077][106225] Updated weights for policy 1, policy_version 553871 (0.0007) [2023-12-27 23:12:36,083][106226] Updated weights for policy 0, policy_version 552343 (0.0006) [2023-12-27 23:12:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 283254784. Throughput: 0: 9921.0, 1: 10001.5. Samples: 283258868. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:12:36,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-5.237')] [2023-12-27 23:12:36,733][106226] Updated weights for policy 0, policy_version 552353 (0.0008) [2023-12-27 23:12:36,791][106226] Updated weights for policy 0, policy_version 552363 (0.0008) [2023-12-27 23:12:36,821][106225] Updated weights for policy 1, policy_version 553881 (0.0007) [2023-12-27 23:12:36,851][106226] Updated weights for policy 0, policy_version 552373 (0.0007) [2023-12-27 23:12:36,883][106225] Updated weights for policy 1, policy_version 553891 (0.0008) [2023-12-27 23:12:36,939][106225] Updated weights for policy 1, policy_version 553901 (0.0005) [2023-12-27 23:12:37,584][106226] Updated weights for policy 0, policy_version 552383 (0.0008) [2023-12-27 23:12:37,593][106225] Updated weights for policy 1, policy_version 553911 (0.0005) [2023-12-27 23:12:37,633][106226] Updated weights for policy 0, policy_version 552393 (0.0008) [2023-12-27 23:12:37,652][106225] Updated weights for policy 1, policy_version 553921 (0.0005) [2023-12-27 23:12:37,691][106226] Updated weights for policy 0, policy_version 552403 (0.0008) [2023-12-27 23:12:37,712][106225] Updated weights for policy 1, policy_version 553931 (0.0005) [2023-12-27 23:12:38,285][106225] Updated weights for policy 1, policy_version 553941 (0.0007) [2023-12-27 23:12:38,349][106225] Updated weights for policy 1, policy_version 553951 (0.0008) [2023-12-27 23:12:38,412][106225] Updated weights for policy 1, policy_version 553961 (0.0008) [2023-12-27 23:12:38,464][106226] Updated weights for policy 0, policy_version 552413 (0.0007) [2023-12-27 23:12:38,527][106226] Updated weights for policy 0, policy_version 552423 (0.0009) [2023-12-27 23:12:38,589][106226] Updated weights for policy 0, policy_version 552433 (0.0009) [2023-12-27 23:12:39,107][106225] Updated weights for policy 1, policy_version 553971 (0.0007) [2023-12-27 23:12:39,171][106225] Updated weights for policy 1, policy_version 553981 (0.0006) [2023-12-27 23:12:39,231][106225] Updated weights for policy 1, policy_version 553991 (0.0008) [2023-12-27 23:12:39,406][106226] Updated weights for policy 0, policy_version 552443 (0.0008) [2023-12-27 23:12:39,468][106226] Updated weights for policy 0, policy_version 552453 (0.0006) [2023-12-27 23:12:39,531][106226] Updated weights for policy 0, policy_version 552463 (0.0006) [2023-12-27 23:12:39,956][106225] Updated weights for policy 1, policy_version 554001 (0.0008) [2023-12-27 23:12:40,050][106225] Updated weights for policy 1, policy_version 554011 (0.0008) [2023-12-27 23:12:40,096][106225] Updated weights for policy 1, policy_version 554021 (0.0009) [2023-12-27 23:12:40,146][106225] Updated weights for policy 1, policy_version 554031 (0.0009) [2023-12-27 23:12:40,170][106226] Updated weights for policy 0, policy_version 552473 (0.0006) [2023-12-27 23:12:40,237][106226] Updated weights for policy 0, policy_version 552483 (0.0008) [2023-12-27 23:12:40,304][106226] Updated weights for policy 0, policy_version 552493 (0.0008) [2023-12-27 23:12:40,361][106226] Updated weights for policy 0, policy_version 552503 (0.0006) [2023-12-27 23:12:40,778][106225] Updated weights for policy 1, policy_version 554041 (0.0009) [2023-12-27 23:12:40,835][106225] Updated weights for policy 1, policy_version 554051 (0.0009) [2023-12-27 23:12:40,888][106225] Updated weights for policy 1, policy_version 554061 (0.0008) [2023-12-27 23:12:41,102][106226] Updated weights for policy 0, policy_version 552513 (0.0008) [2023-12-27 23:12:41,169][106226] Updated weights for policy 0, policy_version 552523 (0.0009) [2023-12-27 23:12:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 283344896. Throughput: 0: 9896.2, 1: 10039.2. Samples: 283317904. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:12:41,175][105115] Avg episode reward: [(0, '-5.522'), (1, '-5.345')] [2023-12-27 23:12:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000554064_141869056.pth... [2023-12-27 23:12:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000552880_141565952.pth [2023-12-27 23:12:41,232][106226] Updated weights for policy 0, policy_version 552533 (0.0007) [2023-12-27 23:12:41,254][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000552536_141484032.pth... [2023-12-27 23:12:41,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000551384_141189120.pth [2023-12-27 23:12:41,757][106225] Updated weights for policy 1, policy_version 554071 (0.0010) [2023-12-27 23:12:41,819][106225] Updated weights for policy 1, policy_version 554081 (0.0006) [2023-12-27 23:12:41,888][106225] Updated weights for policy 1, policy_version 554091 (0.0007) [2023-12-27 23:12:41,952][106226] Updated weights for policy 0, policy_version 552543 (0.0008) [2023-12-27 23:12:42,004][106226] Updated weights for policy 0, policy_version 552553 (0.0008) [2023-12-27 23:12:42,052][106226] Updated weights for policy 0, policy_version 552563 (0.0007) [2023-12-27 23:12:42,668][106225] Updated weights for policy 1, policy_version 554101 (0.0008) [2023-12-27 23:12:42,711][106226] Updated weights for policy 0, policy_version 552573 (0.0007) [2023-12-27 23:12:42,729][106225] Updated weights for policy 1, policy_version 554111 (0.0007) [2023-12-27 23:12:42,776][106226] Updated weights for policy 0, policy_version 552583 (0.0007) [2023-12-27 23:12:42,790][106225] Updated weights for policy 1, policy_version 554121 (0.0006) [2023-12-27 23:12:42,840][106226] Updated weights for policy 0, policy_version 552593 (0.0007) [2023-12-27 23:12:43,561][106226] Updated weights for policy 0, policy_version 552603 (0.0006) [2023-12-27 23:12:43,567][106225] Updated weights for policy 1, policy_version 554131 (0.0008) [2023-12-27 23:12:43,619][106226] Updated weights for policy 0, policy_version 552613 (0.0005) [2023-12-27 23:12:43,624][106225] Updated weights for policy 1, policy_version 554141 (0.0008) [2023-12-27 23:12:43,680][106226] Updated weights for policy 0, policy_version 552623 (0.0006) [2023-12-27 23:12:43,688][106225] Updated weights for policy 1, policy_version 554151 (0.0008) [2023-12-27 23:12:44,336][106225] Updated weights for policy 1, policy_version 554161 (0.0008) [2023-12-27 23:12:44,373][106226] Updated weights for policy 0, policy_version 552633 (0.0006) [2023-12-27 23:12:44,390][106225] Updated weights for policy 1, policy_version 554171 (0.0008) [2023-12-27 23:12:44,435][106226] Updated weights for policy 0, policy_version 552643 (0.0007) [2023-12-27 23:12:44,449][106225] Updated weights for policy 1, policy_version 554181 (0.0005) [2023-12-27 23:12:44,504][106226] Updated weights for policy 0, policy_version 552653 (0.0008) [2023-12-27 23:12:44,517][106225] Updated weights for policy 1, policy_version 554191 (0.0005) [2023-12-27 23:12:44,556][106226] Updated weights for policy 0, policy_version 552663 (0.0009) [2023-12-27 23:12:45,191][106225] Updated weights for policy 1, policy_version 554201 (0.0010) [2023-12-27 23:12:45,254][106225] Updated weights for policy 1, policy_version 554211 (0.0011) [2023-12-27 23:12:45,264][106226] Updated weights for policy 0, policy_version 552673 (0.0006) [2023-12-27 23:12:45,314][106225] Updated weights for policy 1, policy_version 554221 (0.0011) [2023-12-27 23:12:45,327][106226] Updated weights for policy 0, policy_version 552683 (0.0006) [2023-12-27 23:12:45,389][106226] Updated weights for policy 0, policy_version 552693 (0.0008) [2023-12-27 23:12:46,030][106226] Updated weights for policy 0, policy_version 552703 (0.0008) [2023-12-27 23:12:46,031][106225] Updated weights for policy 1, policy_version 554231 (0.0010) [2023-12-27 23:12:46,078][106225] Updated weights for policy 1, policy_version 554241 (0.0010) [2023-12-27 23:12:46,087][106226] Updated weights for policy 0, policy_version 552713 (0.0006) [2023-12-27 23:12:46,127][106225] Updated weights for policy 1, policy_version 554251 (0.0010) [2023-12-27 23:12:46,141][106226] Updated weights for policy 0, policy_version 552723 (0.0005) [2023-12-27 23:12:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 283451392. Throughput: 0: 9857.2, 1: 10002.7. Samples: 283434004. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:12:46,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-5.628')] [2023-12-27 23:12:46,805][106226] Updated weights for policy 0, policy_version 552733 (0.0009) [2023-12-27 23:12:46,838][106225] Updated weights for policy 1, policy_version 554261 (0.0010) [2023-12-27 23:12:46,852][106226] Updated weights for policy 0, policy_version 552743 (0.0010) [2023-12-27 23:12:46,895][106225] Updated weights for policy 1, policy_version 554271 (0.0010) [2023-12-27 23:12:46,905][106226] Updated weights for policy 0, policy_version 552753 (0.0010) [2023-12-27 23:12:46,949][106225] Updated weights for policy 1, policy_version 554281 (0.0010) [2023-12-27 23:12:47,627][106226] Updated weights for policy 0, policy_version 552763 (0.0008) [2023-12-27 23:12:47,652][106225] Updated weights for policy 1, policy_version 554291 (0.0009) [2023-12-27 23:12:47,687][106226] Updated weights for policy 0, policy_version 552773 (0.0011) [2023-12-27 23:12:47,709][106225] Updated weights for policy 1, policy_version 554301 (0.0005) [2023-12-27 23:12:47,744][106226] Updated weights for policy 0, policy_version 552783 (0.0011) [2023-12-27 23:12:47,766][106225] Updated weights for policy 1, policy_version 554311 (0.0007) [2023-12-27 23:12:48,453][106225] Updated weights for policy 1, policy_version 554321 (0.0010) [2023-12-27 23:12:48,466][106226] Updated weights for policy 0, policy_version 552793 (0.0010) [2023-12-27 23:12:48,518][106225] Updated weights for policy 1, policy_version 554331 (0.0011) [2023-12-27 23:12:48,529][106226] Updated weights for policy 0, policy_version 552803 (0.0011) [2023-12-27 23:12:48,584][106225] Updated weights for policy 1, policy_version 554341 (0.0010) [2023-12-27 23:12:48,584][106226] Updated weights for policy 0, policy_version 552813 (0.0010) [2023-12-27 23:12:48,636][106226] Updated weights for policy 0, policy_version 552823 (0.0009) [2023-12-27 23:12:48,646][106225] Updated weights for policy 1, policy_version 554351 (0.0010) [2023-12-27 23:12:49,347][106226] Updated weights for policy 0, policy_version 552833 (0.0010) [2023-12-27 23:12:49,392][106225] Updated weights for policy 1, policy_version 554361 (0.0010) [2023-12-27 23:12:49,410][106226] Updated weights for policy 0, policy_version 552843 (0.0011) [2023-12-27 23:12:49,454][106225] Updated weights for policy 1, policy_version 554371 (0.0007) [2023-12-27 23:12:49,471][106226] Updated weights for policy 0, policy_version 552853 (0.0010) [2023-12-27 23:12:49,513][106225] Updated weights for policy 1, policy_version 554381 (0.0006) [2023-12-27 23:12:50,241][106226] Updated weights for policy 0, policy_version 552863 (0.0010) [2023-12-27 23:12:50,265][106225] Updated weights for policy 1, policy_version 554391 (0.0006) [2023-12-27 23:12:50,308][106226] Updated weights for policy 0, policy_version 552873 (0.0010) [2023-12-27 23:12:50,313][106225] Updated weights for policy 1, policy_version 554401 (0.0007) [2023-12-27 23:12:50,370][106225] Updated weights for policy 1, policy_version 554411 (0.0007) [2023-12-27 23:12:50,370][106226] Updated weights for policy 0, policy_version 552883 (0.0011) [2023-12-27 23:12:51,025][106226] Updated weights for policy 0, policy_version 552893 (0.0010) [2023-12-27 23:12:51,029][106225] Updated weights for policy 1, policy_version 554421 (0.0007) [2023-12-27 23:12:51,093][106226] Updated weights for policy 0, policy_version 552903 (0.0008) [2023-12-27 23:12:51,099][106225] Updated weights for policy 1, policy_version 554431 (0.0008) [2023-12-27 23:12:51,156][106226] Updated weights for policy 0, policy_version 552913 (0.0010) [2023-12-27 23:12:51,162][106225] Updated weights for policy 1, policy_version 554441 (0.0008) [2023-12-27 23:12:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 283533312. Throughput: 0: 9842.7, 1: 9952.7. Samples: 283551960. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:12:51,175][105115] Avg episode reward: [(0, '-5.135'), (1, '-5.542')] [2023-12-27 23:12:51,867][106225] Updated weights for policy 1, policy_version 554451 (0.0007) [2023-12-27 23:12:51,900][106226] Updated weights for policy 0, policy_version 552923 (0.0011) [2023-12-27 23:12:51,929][106225] Updated weights for policy 1, policy_version 554461 (0.0006) [2023-12-27 23:12:51,954][106226] Updated weights for policy 0, policy_version 552933 (0.0011) [2023-12-27 23:12:51,985][106225] Updated weights for policy 1, policy_version 554471 (0.0006) [2023-12-27 23:12:52,015][106226] Updated weights for policy 0, policy_version 552943 (0.0010) [2023-12-27 23:12:52,658][106225] Updated weights for policy 1, policy_version 554481 (0.0008) [2023-12-27 23:12:52,712][106225] Updated weights for policy 1, policy_version 554491 (0.0008) [2023-12-27 23:12:52,723][106226] Updated weights for policy 0, policy_version 552953 (0.0006) [2023-12-27 23:12:52,772][106225] Updated weights for policy 1, policy_version 554501 (0.0009) [2023-12-27 23:12:52,777][106226] Updated weights for policy 0, policy_version 552963 (0.0010) [2023-12-27 23:12:52,827][106226] Updated weights for policy 0, policy_version 552973 (0.0010) [2023-12-27 23:12:52,836][106225] Updated weights for policy 1, policy_version 554511 (0.0010) [2023-12-27 23:12:52,872][106226] Updated weights for policy 0, policy_version 552983 (0.0009) [2023-12-27 23:12:53,487][106225] Updated weights for policy 1, policy_version 554521 (0.0006) [2023-12-27 23:12:53,547][106226] Updated weights for policy 0, policy_version 552993 (0.0011) [2023-12-27 23:12:53,549][106225] Updated weights for policy 1, policy_version 554531 (0.0008) [2023-12-27 23:12:53,594][106226] Updated weights for policy 0, policy_version 553003 (0.0010) [2023-12-27 23:12:53,607][106225] Updated weights for policy 1, policy_version 554541 (0.0010) [2023-12-27 23:12:53,651][106226] Updated weights for policy 0, policy_version 553013 (0.0010) [2023-12-27 23:12:54,186][106225] Updated weights for policy 1, policy_version 554551 (0.0007) [2023-12-27 23:12:54,248][106225] Updated weights for policy 1, policy_version 554561 (0.0008) [2023-12-27 23:12:54,300][106225] Updated weights for policy 1, policy_version 554571 (0.0005) [2023-12-27 23:12:54,303][106226] Updated weights for policy 0, policy_version 553023 (0.0010) [2023-12-27 23:12:54,362][106226] Updated weights for policy 0, policy_version 553033 (0.0005) [2023-12-27 23:12:54,413][106226] Updated weights for policy 0, policy_version 553043 (0.0005) [2023-12-27 23:12:55,002][106225] Updated weights for policy 1, policy_version 554581 (0.0007) [2023-12-27 23:12:55,066][106225] Updated weights for policy 1, policy_version 554591 (0.0009) [2023-12-27 23:12:55,076][106226] Updated weights for policy 0, policy_version 553053 (0.0008) [2023-12-27 23:12:55,126][106225] Updated weights for policy 1, policy_version 554601 (0.0006) [2023-12-27 23:12:55,131][106226] Updated weights for policy 0, policy_version 553063 (0.0010) [2023-12-27 23:12:55,183][106226] Updated weights for policy 0, policy_version 553073 (0.0009) [2023-12-27 23:12:55,839][106225] Updated weights for policy 1, policy_version 554611 (0.0008) [2023-12-27 23:12:55,868][106226] Updated weights for policy 0, policy_version 553083 (0.0006) [2023-12-27 23:12:55,894][106225] Updated weights for policy 1, policy_version 554621 (0.0008) [2023-12-27 23:12:55,929][106226] Updated weights for policy 0, policy_version 553093 (0.0011) [2023-12-27 23:12:55,954][106225] Updated weights for policy 1, policy_version 554631 (0.0006) [2023-12-27 23:12:55,993][106226] Updated weights for policy 0, policy_version 553103 (0.0011) [2023-12-27 23:12:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 283648000. Throughput: 0: 9863.3, 1: 9913.6. Samples: 283612816. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:12:56,176][105115] Avg episode reward: [(0, '-4.910'), (1, '-5.411')] [2023-12-27 23:12:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000554640_142016512.pth... [2023-12-27 23:12:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000553112_141631488.pth... [2023-12-27 23:12:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000553456_141713408.pth [2023-12-27 23:12:56,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000551960_141336576.pth [2023-12-27 23:12:56,598][106225] Updated weights for policy 1, policy_version 554641 (0.0006) [2023-12-27 23:12:56,624][106226] Updated weights for policy 0, policy_version 553113 (0.0010) [2023-12-27 23:12:56,665][106225] Updated weights for policy 1, policy_version 554651 (0.0008) [2023-12-27 23:12:56,678][106226] Updated weights for policy 0, policy_version 553123 (0.0006) [2023-12-27 23:12:56,720][106225] Updated weights for policy 1, policy_version 554661 (0.0010) [2023-12-27 23:12:56,734][106226] Updated weights for policy 0, policy_version 553133 (0.0010) [2023-12-27 23:12:56,767][106225] Updated weights for policy 1, policy_version 554671 (0.0005) [2023-12-27 23:12:56,790][106226] Updated weights for policy 0, policy_version 553143 (0.0010) [2023-12-27 23:12:57,470][106225] Updated weights for policy 1, policy_version 554681 (0.0007) [2023-12-27 23:12:57,483][106226] Updated weights for policy 0, policy_version 553153 (0.0010) [2023-12-27 23:12:57,526][106225] Updated weights for policy 1, policy_version 554691 (0.0007) [2023-12-27 23:12:57,540][106226] Updated weights for policy 0, policy_version 553163 (0.0011) [2023-12-27 23:12:57,583][106225] Updated weights for policy 1, policy_version 554701 (0.0006) [2023-12-27 23:12:57,593][106226] Updated weights for policy 0, policy_version 553173 (0.0010) [2023-12-27 23:12:58,330][106226] Updated weights for policy 0, policy_version 553183 (0.0010) [2023-12-27 23:12:58,362][106225] Updated weights for policy 1, policy_version 554711 (0.0008) [2023-12-27 23:12:58,403][106226] Updated weights for policy 0, policy_version 553193 (0.0010) [2023-12-27 23:12:58,431][106225] Updated weights for policy 1, policy_version 554721 (0.0008) [2023-12-27 23:12:58,473][106226] Updated weights for policy 0, policy_version 553203 (0.0009) [2023-12-27 23:12:58,496][106225] Updated weights for policy 1, policy_version 554731 (0.0009) [2023-12-27 23:12:59,230][106225] Updated weights for policy 1, policy_version 554741 (0.0008) [2023-12-27 23:12:59,235][106226] Updated weights for policy 0, policy_version 553213 (0.0010) [2023-12-27 23:12:59,299][106225] Updated weights for policy 1, policy_version 554751 (0.0008) [2023-12-27 23:12:59,304][106226] Updated weights for policy 0, policy_version 553223 (0.0008) [2023-12-27 23:12:59,364][106225] Updated weights for policy 1, policy_version 554761 (0.0009) [2023-12-27 23:12:59,375][106226] Updated weights for policy 0, policy_version 553233 (0.0009) [2023-12-27 23:13:00,098][106226] Updated weights for policy 0, policy_version 553243 (0.0008) [2023-12-27 23:13:00,131][106225] Updated weights for policy 1, policy_version 554771 (0.0009) [2023-12-27 23:13:00,153][106226] Updated weights for policy 0, policy_version 553253 (0.0008) [2023-12-27 23:13:00,195][106225] Updated weights for policy 1, policy_version 554781 (0.0008) [2023-12-27 23:13:00,211][106226] Updated weights for policy 0, policy_version 553263 (0.0006) [2023-12-27 23:13:00,249][106225] Updated weights for policy 1, policy_version 554791 (0.0006) [2023-12-27 23:13:00,859][106225] Updated weights for policy 1, policy_version 554801 (0.0008) [2023-12-27 23:13:00,907][106225] Updated weights for policy 1, policy_version 554811 (0.0007) [2023-12-27 23:13:00,943][106226] Updated weights for policy 0, policy_version 553273 (0.0007) [2023-12-27 23:13:00,966][106225] Updated weights for policy 1, policy_version 554821 (0.0009) [2023-12-27 23:13:01,000][106226] Updated weights for policy 0, policy_version 553283 (0.0008) [2023-12-27 23:13:01,027][106225] Updated weights for policy 1, policy_version 554831 (0.0008) [2023-12-27 23:13:01,060][106226] Updated weights for policy 0, policy_version 553293 (0.0008) [2023-12-27 23:13:01,129][106226] Updated weights for policy 0, policy_version 553303 (0.0008) [2023-12-27 23:13:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 283746304. Throughput: 0: 9935.9, 1: 9903.8. Samples: 283730752. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:01,175][105115] Avg episode reward: [(0, '-5.237'), (1, '-5.581')] [2023-12-27 23:13:01,692][106225] Updated weights for policy 1, policy_version 554841 (0.0006) [2023-12-27 23:13:01,751][106225] Updated weights for policy 1, policy_version 554851 (0.0007) [2023-12-27 23:13:01,809][106225] Updated weights for policy 1, policy_version 554861 (0.0007) [2023-12-27 23:13:01,816][106226] Updated weights for policy 0, policy_version 553313 (0.0006) [2023-12-27 23:13:01,880][106226] Updated weights for policy 0, policy_version 553323 (0.0009) [2023-12-27 23:13:01,945][106226] Updated weights for policy 0, policy_version 553333 (0.0009) [2023-12-27 23:13:02,454][106225] Updated weights for policy 1, policy_version 554871 (0.0006) [2023-12-27 23:13:02,514][106225] Updated weights for policy 1, policy_version 554881 (0.0007) [2023-12-27 23:13:02,568][106225] Updated weights for policy 1, policy_version 554891 (0.0009) [2023-12-27 23:13:02,726][106226] Updated weights for policy 0, policy_version 553343 (0.0008) [2023-12-27 23:13:02,787][106226] Updated weights for policy 0, policy_version 553353 (0.0008) [2023-12-27 23:13:02,852][106226] Updated weights for policy 0, policy_version 553363 (0.0008) [2023-12-27 23:13:03,230][106225] Updated weights for policy 1, policy_version 554901 (0.0008) [2023-12-27 23:13:03,278][106225] Updated weights for policy 1, policy_version 554911 (0.0008) [2023-12-27 23:13:03,326][106225] Updated weights for policy 1, policy_version 554921 (0.0006) [2023-12-27 23:13:03,622][106226] Updated weights for policy 0, policy_version 553373 (0.0008) [2023-12-27 23:13:03,676][106226] Updated weights for policy 0, policy_version 553383 (0.0009) [2023-12-27 23:13:03,733][106226] Updated weights for policy 0, policy_version 553393 (0.0010) [2023-12-27 23:13:03,944][106225] Updated weights for policy 1, policy_version 554931 (0.0006) [2023-12-27 23:13:04,003][106225] Updated weights for policy 1, policy_version 554941 (0.0008) [2023-12-27 23:13:04,063][106225] Updated weights for policy 1, policy_version 554951 (0.0006) [2023-12-27 23:13:04,538][106226] Updated weights for policy 0, policy_version 553403 (0.0008) [2023-12-27 23:13:04,600][106226] Updated weights for policy 0, policy_version 553413 (0.0009) [2023-12-27 23:13:04,652][106226] Updated weights for policy 0, policy_version 553423 (0.0008) [2023-12-27 23:13:04,709][106225] Updated weights for policy 1, policy_version 554961 (0.0006) [2023-12-27 23:13:04,776][106225] Updated weights for policy 1, policy_version 554971 (0.0010) [2023-12-27 23:13:04,825][106225] Updated weights for policy 1, policy_version 554981 (0.0010) [2023-12-27 23:13:04,879][106225] Updated weights for policy 1, policy_version 554991 (0.0010) [2023-12-27 23:13:05,323][106226] Updated weights for policy 0, policy_version 553433 (0.0007) [2023-12-27 23:13:05,372][106226] Updated weights for policy 0, policy_version 553443 (0.0008) [2023-12-27 23:13:05,426][106226] Updated weights for policy 0, policy_version 553453 (0.0008) [2023-12-27 23:13:05,490][106226] Updated weights for policy 0, policy_version 553463 (0.0007) [2023-12-27 23:13:05,597][106225] Updated weights for policy 1, policy_version 555001 (0.0010) [2023-12-27 23:13:05,650][106225] Updated weights for policy 1, policy_version 555011 (0.0010) [2023-12-27 23:13:05,714][106225] Updated weights for policy 1, policy_version 555021 (0.0010) [2023-12-27 23:13:06,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 283836416. Throughput: 0: 9773.5, 1: 10034.7. Samples: 283848828. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:06,175][105115] Avg episode reward: [(0, '-5.053'), (1, '-5.026')] [2023-12-27 23:13:06,225][106226] Updated weights for policy 0, policy_version 553473 (0.0008) [2023-12-27 23:13:06,286][106226] Updated weights for policy 0, policy_version 553483 (0.0008) [2023-12-27 23:13:06,349][106226] Updated weights for policy 0, policy_version 553493 (0.0008) [2023-12-27 23:13:06,442][106225] Updated weights for policy 1, policy_version 555031 (0.0010) [2023-12-27 23:13:06,505][106225] Updated weights for policy 1, policy_version 555041 (0.0011) [2023-12-27 23:13:06,568][106225] Updated weights for policy 1, policy_version 555051 (0.0010) [2023-12-27 23:13:07,094][106226] Updated weights for policy 0, policy_version 553503 (0.0011) [2023-12-27 23:13:07,158][106226] Updated weights for policy 0, policy_version 553513 (0.0011) [2023-12-27 23:13:07,198][106225] Updated weights for policy 1, policy_version 555061 (0.0008) [2023-12-27 23:13:07,220][106226] Updated weights for policy 0, policy_version 553523 (0.0011) [2023-12-27 23:13:07,260][106225] Updated weights for policy 1, policy_version 555071 (0.0006) [2023-12-27 23:13:07,315][106225] Updated weights for policy 1, policy_version 555081 (0.0005) [2023-12-27 23:13:07,869][106225] Updated weights for policy 1, policy_version 555091 (0.0005) [2023-12-27 23:13:07,927][106226] Updated weights for policy 0, policy_version 553533 (0.0011) [2023-12-27 23:13:07,933][106225] Updated weights for policy 1, policy_version 555101 (0.0005) [2023-12-27 23:13:07,981][106226] Updated weights for policy 0, policy_version 553543 (0.0010) [2023-12-27 23:13:07,991][106225] Updated weights for policy 1, policy_version 555111 (0.0005) [2023-12-27 23:13:08,039][106226] Updated weights for policy 0, policy_version 553553 (0.0011) [2023-12-27 23:13:08,686][106225] Updated weights for policy 1, policy_version 555121 (0.0010) [2023-12-27 23:13:08,723][106226] Updated weights for policy 0, policy_version 553563 (0.0009) [2023-12-27 23:13:08,751][106225] Updated weights for policy 1, policy_version 555131 (0.0010) [2023-12-27 23:13:08,777][106226] Updated weights for policy 0, policy_version 553573 (0.0006) [2023-12-27 23:13:08,813][106225] Updated weights for policy 1, policy_version 555141 (0.0010) [2023-12-27 23:13:08,840][106226] Updated weights for policy 0, policy_version 553583 (0.0006) [2023-12-27 23:13:08,877][106225] Updated weights for policy 1, policy_version 555151 (0.0010) [2023-12-27 23:13:09,496][106226] Updated weights for policy 0, policy_version 553593 (0.0007) [2023-12-27 23:13:09,554][106226] Updated weights for policy 0, policy_version 553603 (0.0011) [2023-12-27 23:13:09,589][106225] Updated weights for policy 1, policy_version 555161 (0.0010) [2023-12-27 23:13:09,616][106226] Updated weights for policy 0, policy_version 553613 (0.0011) [2023-12-27 23:13:09,651][106225] Updated weights for policy 1, policy_version 555171 (0.0007) [2023-12-27 23:13:09,678][106226] Updated weights for policy 0, policy_version 553623 (0.0011) [2023-12-27 23:13:09,715][106225] Updated weights for policy 1, policy_version 555181 (0.0006) [2023-12-27 23:13:10,343][106225] Updated weights for policy 1, policy_version 555191 (0.0007) [2023-12-27 23:13:10,380][106226] Updated weights for policy 0, policy_version 553633 (0.0011) [2023-12-27 23:13:10,405][106225] Updated weights for policy 1, policy_version 555201 (0.0011) [2023-12-27 23:13:10,445][106226] Updated weights for policy 0, policy_version 553643 (0.0011) [2023-12-27 23:13:10,462][106225] Updated weights for policy 1, policy_version 555211 (0.0010) [2023-12-27 23:13:10,506][106226] Updated weights for policy 0, policy_version 553653 (0.0011) [2023-12-27 23:13:11,134][106225] Updated weights for policy 1, policy_version 555221 (0.0009) [2023-12-27 23:13:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 283934720. Throughput: 0: 9796.0, 1: 10130.5. Samples: 283909856. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:11,175][105115] Avg episode reward: [(0, '-5.065'), (1, '-5.469')] [2023-12-27 23:13:11,202][106225] Updated weights for policy 1, policy_version 555231 (0.0010) [2023-12-27 23:13:11,229][106226] Updated weights for policy 0, policy_version 553663 (0.0009) [2023-12-27 23:13:11,265][106225] Updated weights for policy 1, policy_version 555241 (0.0011) [2023-12-27 23:13:11,291][106226] Updated weights for policy 0, policy_version 553673 (0.0008) [2023-12-27 23:13:11,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000555248_142172160.pth... [2023-12-27 23:13:11,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000554064_141869056.pth [2023-12-27 23:13:11,358][106226] Updated weights for policy 0, policy_version 553683 (0.0010) [2023-12-27 23:13:11,397][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000553688_141778944.pth... [2023-12-27 23:13:11,401][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000552536_141484032.pth [2023-12-27 23:13:12,002][106225] Updated weights for policy 1, policy_version 555251 (0.0009) [2023-12-27 23:13:12,064][106225] Updated weights for policy 1, policy_version 555261 (0.0010) [2023-12-27 23:13:12,128][106225] Updated weights for policy 1, policy_version 555271 (0.0008) [2023-12-27 23:13:12,183][106226] Updated weights for policy 0, policy_version 553693 (0.0009) [2023-12-27 23:13:12,232][106226] Updated weights for policy 0, policy_version 553703 (0.0008) [2023-12-27 23:13:12,301][106226] Updated weights for policy 0, policy_version 553713 (0.0009) [2023-12-27 23:13:12,851][106225] Updated weights for policy 1, policy_version 555281 (0.0007) [2023-12-27 23:13:12,912][106225] Updated weights for policy 1, policy_version 555291 (0.0005) [2023-12-27 23:13:12,973][106225] Updated weights for policy 1, policy_version 555301 (0.0005) [2023-12-27 23:13:13,026][106226] Updated weights for policy 0, policy_version 553723 (0.0008) [2023-12-27 23:13:13,040][106225] Updated weights for policy 1, policy_version 555311 (0.0008) [2023-12-27 23:13:13,083][106226] Updated weights for policy 0, policy_version 553733 (0.0008) [2023-12-27 23:13:13,148][106226] Updated weights for policy 0, policy_version 553743 (0.0008) [2023-12-27 23:13:13,706][106225] Updated weights for policy 1, policy_version 555321 (0.0010) [2023-12-27 23:13:13,757][106225] Updated weights for policy 1, policy_version 555331 (0.0010) [2023-12-27 23:13:13,808][106225] Updated weights for policy 1, policy_version 555341 (0.0010) [2023-12-27 23:13:13,885][106226] Updated weights for policy 0, policy_version 553753 (0.0008) [2023-12-27 23:13:13,943][106226] Updated weights for policy 0, policy_version 553763 (0.0008) [2023-12-27 23:13:14,001][106226] Updated weights for policy 0, policy_version 553773 (0.0008) [2023-12-27 23:13:14,055][106226] Updated weights for policy 0, policy_version 553783 (0.0008) [2023-12-27 23:13:14,534][106225] Updated weights for policy 1, policy_version 555351 (0.0010) [2023-12-27 23:13:14,585][106225] Updated weights for policy 1, policy_version 555361 (0.0010) [2023-12-27 23:13:14,636][106225] Updated weights for policy 1, policy_version 555371 (0.0010) [2023-12-27 23:13:14,773][106226] Updated weights for policy 0, policy_version 553793 (0.0007) [2023-12-27 23:13:14,832][106226] Updated weights for policy 0, policy_version 553803 (0.0008) [2023-12-27 23:13:14,894][106226] Updated weights for policy 0, policy_version 553813 (0.0008) [2023-12-27 23:13:15,396][106225] Updated weights for policy 1, policy_version 555381 (0.0010) [2023-12-27 23:13:15,459][106225] Updated weights for policy 1, policy_version 555391 (0.0010) [2023-12-27 23:13:15,517][106225] Updated weights for policy 1, policy_version 555401 (0.0010) [2023-12-27 23:13:15,618][106226] Updated weights for policy 0, policy_version 553823 (0.0007) [2023-12-27 23:13:15,679][106226] Updated weights for policy 0, policy_version 553833 (0.0008) [2023-12-27 23:13:15,747][106226] Updated weights for policy 0, policy_version 553843 (0.0008) [2023-12-27 23:13:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 284033024. Throughput: 0: 9704.6, 1: 10035.4. Samples: 284025112. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:16,175][105115] Avg episode reward: [(0, '-5.022'), (1, '-5.678')] [2023-12-27 23:13:16,235][106225] Updated weights for policy 1, policy_version 555411 (0.0010) [2023-12-27 23:13:16,287][106225] Updated weights for policy 1, policy_version 555421 (0.0008) [2023-12-27 23:13:16,345][106225] Updated weights for policy 1, policy_version 555431 (0.0009) [2023-12-27 23:13:16,395][106226] Updated weights for policy 0, policy_version 553853 (0.0008) [2023-12-27 23:13:16,460][106226] Updated weights for policy 0, policy_version 553863 (0.0008) [2023-12-27 23:13:16,528][106226] Updated weights for policy 0, policy_version 553873 (0.0008) [2023-12-27 23:13:17,061][106226] Updated weights for policy 0, policy_version 553883 (0.0007) [2023-12-27 23:13:17,091][106225] Updated weights for policy 1, policy_version 555441 (0.0005) [2023-12-27 23:13:17,121][106226] Updated weights for policy 0, policy_version 553893 (0.0007) [2023-12-27 23:13:17,150][106225] Updated weights for policy 1, policy_version 555451 (0.0007) [2023-12-27 23:13:17,199][106225] Updated weights for policy 1, policy_version 555461 (0.0006) [2023-12-27 23:13:17,201][106226] Updated weights for policy 0, policy_version 553903 (0.0007) [2023-12-27 23:13:17,254][106225] Updated weights for policy 1, policy_version 555471 (0.0007) [2023-12-27 23:13:17,784][106226] Updated weights for policy 0, policy_version 553913 (0.0005) [2023-12-27 23:13:17,835][106226] Updated weights for policy 0, policy_version 553923 (0.0005) [2023-12-27 23:13:17,889][106226] Updated weights for policy 0, policy_version 553933 (0.0005) [2023-12-27 23:13:17,941][106226] Updated weights for policy 0, policy_version 553943 (0.0007) [2023-12-27 23:13:17,974][106225] Updated weights for policy 1, policy_version 555481 (0.0007) [2023-12-27 23:13:18,031][106225] Updated weights for policy 1, policy_version 555491 (0.0005) [2023-12-27 23:13:18,087][106225] Updated weights for policy 1, policy_version 555501 (0.0005) [2023-12-27 23:13:18,614][106226] Updated weights for policy 0, policy_version 553953 (0.0008) [2023-12-27 23:13:18,675][106226] Updated weights for policy 0, policy_version 553963 (0.0009) [2023-12-27 23:13:18,737][106226] Updated weights for policy 0, policy_version 553973 (0.0007) [2023-12-27 23:13:18,739][106225] Updated weights for policy 1, policy_version 555511 (0.0006) [2023-12-27 23:13:18,802][106225] Updated weights for policy 1, policy_version 555521 (0.0008) [2023-12-27 23:13:18,867][106225] Updated weights for policy 1, policy_version 555531 (0.0006) [2023-12-27 23:13:19,540][106226] Updated weights for policy 0, policy_version 553983 (0.0008) [2023-12-27 23:13:19,567][106225] Updated weights for policy 1, policy_version 555541 (0.0007) [2023-12-27 23:13:19,603][106226] Updated weights for policy 0, policy_version 553993 (0.0008) [2023-12-27 23:13:19,627][106225] Updated weights for policy 1, policy_version 555551 (0.0009) [2023-12-27 23:13:19,666][106226] Updated weights for policy 0, policy_version 554003 (0.0008) [2023-12-27 23:13:19,688][106225] Updated weights for policy 1, policy_version 555561 (0.0008) [2023-12-27 23:13:20,394][106226] Updated weights for policy 0, policy_version 554013 (0.0008) [2023-12-27 23:13:20,439][106225] Updated weights for policy 1, policy_version 555571 (0.0008) [2023-12-27 23:13:20,457][106226] Updated weights for policy 0, policy_version 554023 (0.0007) [2023-12-27 23:13:20,490][106225] Updated weights for policy 1, policy_version 555581 (0.0010) [2023-12-27 23:13:20,516][106226] Updated weights for policy 0, policy_version 554033 (0.0006) [2023-12-27 23:13:20,535][106225] Updated weights for policy 1, policy_version 555591 (0.0010) [2023-12-27 23:13:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 284131328. Throughput: 0: 9757.6, 1: 9886.2. Samples: 284142840. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:21,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.608')] [2023-12-27 23:13:21,253][106225] Updated weights for policy 1, policy_version 555601 (0.0009) [2023-12-27 23:13:21,275][106226] Updated weights for policy 0, policy_version 554043 (0.0008) [2023-12-27 23:13:21,330][106225] Updated weights for policy 1, policy_version 555611 (0.0007) [2023-12-27 23:13:21,341][106226] Updated weights for policy 0, policy_version 554053 (0.0007) [2023-12-27 23:13:21,398][106225] Updated weights for policy 1, policy_version 555621 (0.0008) [2023-12-27 23:13:21,416][106226] Updated weights for policy 0, policy_version 554063 (0.0008) [2023-12-27 23:13:21,465][106225] Updated weights for policy 1, policy_version 555631 (0.0008) [2023-12-27 23:13:22,144][106225] Updated weights for policy 1, policy_version 555641 (0.0007) [2023-12-27 23:13:22,204][106225] Updated weights for policy 1, policy_version 555651 (0.0008) [2023-12-27 23:13:22,222][106226] Updated weights for policy 0, policy_version 554073 (0.0006) [2023-12-27 23:13:22,265][106225] Updated weights for policy 1, policy_version 555661 (0.0009) [2023-12-27 23:13:22,285][106226] Updated weights for policy 0, policy_version 554083 (0.0007) [2023-12-27 23:13:22,347][106226] Updated weights for policy 0, policy_version 554093 (0.0006) [2023-12-27 23:13:22,417][106226] Updated weights for policy 0, policy_version 554103 (0.0008) [2023-12-27 23:13:23,039][106226] Updated weights for policy 0, policy_version 554113 (0.0010) [2023-12-27 23:13:23,064][106225] Updated weights for policy 1, policy_version 555671 (0.0006) [2023-12-27 23:13:23,096][106226] Updated weights for policy 0, policy_version 554123 (0.0011) [2023-12-27 23:13:23,121][106225] Updated weights for policy 1, policy_version 555681 (0.0006) [2023-12-27 23:13:23,148][106226] Updated weights for policy 0, policy_version 554133 (0.0007) [2023-12-27 23:13:23,182][106225] Updated weights for policy 1, policy_version 555691 (0.0007) [2023-12-27 23:13:23,791][106226] Updated weights for policy 0, policy_version 554143 (0.0008) [2023-12-27 23:13:23,837][106226] Updated weights for policy 0, policy_version 554153 (0.0010) [2023-12-27 23:13:23,887][106226] Updated weights for policy 0, policy_version 554163 (0.0010) [2023-12-27 23:13:23,948][106225] Updated weights for policy 1, policy_version 555701 (0.0009) [2023-12-27 23:13:24,008][106225] Updated weights for policy 1, policy_version 555711 (0.0008) [2023-12-27 23:13:24,058][106225] Updated weights for policy 1, policy_version 555721 (0.0007) [2023-12-27 23:13:24,559][106226] Updated weights for policy 0, policy_version 554173 (0.0008) [2023-12-27 23:13:24,622][106226] Updated weights for policy 0, policy_version 554183 (0.0009) [2023-12-27 23:13:24,684][106226] Updated weights for policy 0, policy_version 554193 (0.0008) [2023-12-27 23:13:24,806][106225] Updated weights for policy 1, policy_version 555731 (0.0008) [2023-12-27 23:13:24,870][106225] Updated weights for policy 1, policy_version 555741 (0.0009) [2023-12-27 23:13:24,926][106225] Updated weights for policy 1, policy_version 555751 (0.0006) [2023-12-27 23:13:25,344][106226] Updated weights for policy 0, policy_version 554203 (0.0009) [2023-12-27 23:13:25,398][106226] Updated weights for policy 0, policy_version 554213 (0.0008) [2023-12-27 23:13:25,449][106226] Updated weights for policy 0, policy_version 554223 (0.0008) [2023-12-27 23:13:25,472][106225] Updated weights for policy 1, policy_version 555761 (0.0006) [2023-12-27 23:13:25,524][106225] Updated weights for policy 1, policy_version 555771 (0.0008) [2023-12-27 23:13:25,580][106225] Updated weights for policy 1, policy_version 555781 (0.0009) [2023-12-27 23:13:25,635][106225] Updated weights for policy 1, policy_version 555791 (0.0008) [2023-12-27 23:13:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 284229632. Throughput: 0: 9775.1, 1: 9849.4. Samples: 284201008. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:26,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-5.139')] [2023-12-27 23:13:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000555792_142311424.pth... [2023-12-27 23:13:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000554232_141918208.pth... [2023-12-27 23:13:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000553112_141631488.pth [2023-12-27 23:13:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000554640_142016512.pth [2023-12-27 23:13:26,253][106226] Updated weights for policy 0, policy_version 554233 (0.0007) [2023-12-27 23:13:26,280][106225] Updated weights for policy 1, policy_version 555801 (0.0005) [2023-12-27 23:13:26,313][106226] Updated weights for policy 0, policy_version 554243 (0.0008) [2023-12-27 23:13:26,328][106225] Updated weights for policy 1, policy_version 555811 (0.0005) [2023-12-27 23:13:26,373][106226] Updated weights for policy 0, policy_version 554253 (0.0008) [2023-12-27 23:13:26,378][106225] Updated weights for policy 1, policy_version 555821 (0.0005) [2023-12-27 23:13:26,437][106226] Updated weights for policy 0, policy_version 554263 (0.0008) [2023-12-27 23:13:27,046][106226] Updated weights for policy 0, policy_version 554273 (0.0006) [2023-12-27 23:13:27,048][106225] Updated weights for policy 1, policy_version 555831 (0.0007) [2023-12-27 23:13:27,097][106226] Updated weights for policy 0, policy_version 554283 (0.0007) [2023-12-27 23:13:27,103][106225] Updated weights for policy 1, policy_version 555841 (0.0008) [2023-12-27 23:13:27,152][106226] Updated weights for policy 0, policy_version 554293 (0.0006) [2023-12-27 23:13:27,153][106225] Updated weights for policy 1, policy_version 555851 (0.0006) [2023-12-27 23:13:27,854][106226] Updated weights for policy 0, policy_version 554303 (0.0008) [2023-12-27 23:13:27,887][106225] Updated weights for policy 1, policy_version 555861 (0.0006) [2023-12-27 23:13:27,912][106226] Updated weights for policy 0, policy_version 554313 (0.0007) [2023-12-27 23:13:27,935][106225] Updated weights for policy 1, policy_version 555871 (0.0006) [2023-12-27 23:13:27,974][106226] Updated weights for policy 0, policy_version 554323 (0.0008) [2023-12-27 23:13:27,993][106225] Updated weights for policy 1, policy_version 555881 (0.0005) [2023-12-27 23:13:28,606][106225] Updated weights for policy 1, policy_version 555891 (0.0006) [2023-12-27 23:13:28,664][106225] Updated weights for policy 1, policy_version 555901 (0.0008) [2023-12-27 23:13:28,710][106225] Updated weights for policy 1, policy_version 555911 (0.0008) [2023-12-27 23:13:28,773][106226] Updated weights for policy 0, policy_version 554333 (0.0008) [2023-12-27 23:13:28,823][106226] Updated weights for policy 0, policy_version 554343 (0.0009) [2023-12-27 23:13:28,878][106226] Updated weights for policy 0, policy_version 554353 (0.0008) [2023-12-27 23:13:29,468][106225] Updated weights for policy 1, policy_version 555921 (0.0007) [2023-12-27 23:13:29,517][106225] Updated weights for policy 1, policy_version 555931 (0.0009) [2023-12-27 23:13:29,571][106225] Updated weights for policy 1, policy_version 555941 (0.0008) [2023-12-27 23:13:29,633][106225] Updated weights for policy 1, policy_version 555951 (0.0009) [2023-12-27 23:13:29,657][106226] Updated weights for policy 0, policy_version 554363 (0.0008) [2023-12-27 23:13:29,716][106226] Updated weights for policy 0, policy_version 554373 (0.0008) [2023-12-27 23:13:29,765][106226] Updated weights for policy 0, policy_version 554383 (0.0008) [2023-12-27 23:13:30,362][106225] Updated weights for policy 1, policy_version 555961 (0.0006) [2023-12-27 23:13:30,423][106225] Updated weights for policy 1, policy_version 555971 (0.0008) [2023-12-27 23:13:30,487][106225] Updated weights for policy 1, policy_version 555981 (0.0007) [2023-12-27 23:13:30,560][106226] Updated weights for policy 0, policy_version 554393 (0.0008) [2023-12-27 23:13:30,622][106226] Updated weights for policy 0, policy_version 554403 (0.0008) [2023-12-27 23:13:30,679][106226] Updated weights for policy 0, policy_version 554413 (0.0008) [2023-12-27 23:13:30,731][106226] Updated weights for policy 0, policy_version 554423 (0.0009) [2023-12-27 23:13:31,163][106225] Updated weights for policy 1, policy_version 555991 (0.0009) [2023-12-27 23:13:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 284327936. Throughput: 0: 9755.0, 1: 9939.0. Samples: 284320236. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:31,175][105115] Avg episode reward: [(0, '-5.467'), (1, '-5.548')] [2023-12-27 23:13:31,224][106225] Updated weights for policy 1, policy_version 556001 (0.0009) [2023-12-27 23:13:31,291][106225] Updated weights for policy 1, policy_version 556011 (0.0008) [2023-12-27 23:13:31,450][106226] Updated weights for policy 0, policy_version 554433 (0.0009) [2023-12-27 23:13:31,499][106226] Updated weights for policy 0, policy_version 554443 (0.0009) [2023-12-27 23:13:31,554][106226] Updated weights for policy 0, policy_version 554453 (0.0009) [2023-12-27 23:13:31,995][106225] Updated weights for policy 1, policy_version 556021 (0.0010) [2023-12-27 23:13:32,060][106225] Updated weights for policy 1, policy_version 556031 (0.0009) [2023-12-27 23:13:32,127][106225] Updated weights for policy 1, policy_version 556041 (0.0008) [2023-12-27 23:13:32,226][106226] Updated weights for policy 0, policy_version 554463 (0.0006) [2023-12-27 23:13:32,291][106226] Updated weights for policy 0, policy_version 554473 (0.0008) [2023-12-27 23:13:32,356][106226] Updated weights for policy 0, policy_version 554483 (0.0007) [2023-12-27 23:13:32,805][106225] Updated weights for policy 1, policy_version 556051 (0.0009) [2023-12-27 23:13:32,871][106225] Updated weights for policy 1, policy_version 556061 (0.0010) [2023-12-27 23:13:32,932][106225] Updated weights for policy 1, policy_version 556071 (0.0008) [2023-12-27 23:13:33,129][106226] Updated weights for policy 0, policy_version 554493 (0.0008) [2023-12-27 23:13:33,188][106226] Updated weights for policy 0, policy_version 554503 (0.0007) [2023-12-27 23:13:33,238][106226] Updated weights for policy 0, policy_version 554513 (0.0008) [2023-12-27 23:13:33,584][106225] Updated weights for policy 1, policy_version 556081 (0.0006) [2023-12-27 23:13:33,636][106225] Updated weights for policy 1, policy_version 556091 (0.0010) [2023-12-27 23:13:33,686][106225] Updated weights for policy 1, policy_version 556101 (0.0010) [2023-12-27 23:13:33,734][106225] Updated weights for policy 1, policy_version 556111 (0.0010) [2023-12-27 23:13:33,972][106226] Updated weights for policy 0, policy_version 554523 (0.0008) [2023-12-27 23:13:34,026][106226] Updated weights for policy 0, policy_version 554533 (0.0008) [2023-12-27 23:13:34,072][106226] Updated weights for policy 0, policy_version 554543 (0.0008) [2023-12-27 23:13:34,527][106225] Updated weights for policy 1, policy_version 556121 (0.0009) [2023-12-27 23:13:34,592][106225] Updated weights for policy 1, policy_version 556131 (0.0007) [2023-12-27 23:13:34,655][106225] Updated weights for policy 1, policy_version 556141 (0.0008) [2023-12-27 23:13:34,778][106226] Updated weights for policy 0, policy_version 554553 (0.0008) [2023-12-27 23:13:34,841][106226] Updated weights for policy 0, policy_version 554563 (0.0006) [2023-12-27 23:13:34,904][106226] Updated weights for policy 0, policy_version 554573 (0.0009) [2023-12-27 23:13:34,968][106226] Updated weights for policy 0, policy_version 554583 (0.0009) [2023-12-27 23:13:35,292][106225] Updated weights for policy 1, policy_version 556151 (0.0008) [2023-12-27 23:13:35,354][106225] Updated weights for policy 1, policy_version 556161 (0.0006) [2023-12-27 23:13:35,409][106225] Updated weights for policy 1, policy_version 556171 (0.0005) [2023-12-27 23:13:35,731][106226] Updated weights for policy 0, policy_version 554593 (0.0009) [2023-12-27 23:13:35,783][106226] Updated weights for policy 0, policy_version 554603 (0.0008) [2023-12-27 23:13:35,836][106226] Updated weights for policy 0, policy_version 554613 (0.0008) [2023-12-27 23:13:35,988][106225] Updated weights for policy 1, policy_version 556181 (0.0007) [2023-12-27 23:13:36,046][106225] Updated weights for policy 1, policy_version 556191 (0.0008) [2023-12-27 23:13:36,100][106225] Updated weights for policy 1, policy_version 556201 (0.0008) [2023-12-27 23:13:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 284434432. Throughput: 0: 9692.5, 1: 10002.7. Samples: 284438240. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:36,175][105115] Avg episode reward: [(0, '-4.896'), (1, '-5.444')] [2023-12-27 23:13:36,613][106226] Updated weights for policy 0, policy_version 554623 (0.0008) [2023-12-27 23:13:36,676][106226] Updated weights for policy 0, policy_version 554633 (0.0009) [2023-12-27 23:13:36,740][106226] Updated weights for policy 0, policy_version 554643 (0.0009) [2023-12-27 23:13:36,780][106225] Updated weights for policy 1, policy_version 556211 (0.0008) [2023-12-27 23:13:36,828][106225] Updated weights for policy 1, policy_version 556221 (0.0009) [2023-12-27 23:13:36,879][106225] Updated weights for policy 1, policy_version 556231 (0.0008) [2023-12-27 23:13:37,472][106226] Updated weights for policy 0, policy_version 554653 (0.0009) [2023-12-27 23:13:37,543][106226] Updated weights for policy 0, policy_version 554663 (0.0009) [2023-12-27 23:13:37,604][106226] Updated weights for policy 0, policy_version 554673 (0.0009) [2023-12-27 23:13:37,638][106225] Updated weights for policy 1, policy_version 556241 (0.0008) [2023-12-27 23:13:37,688][106225] Updated weights for policy 1, policy_version 556251 (0.0005) [2023-12-27 23:13:37,739][106225] Updated weights for policy 1, policy_version 556261 (0.0008) [2023-12-27 23:13:37,787][106225] Updated weights for policy 1, policy_version 556271 (0.0008) [2023-12-27 23:13:38,366][106226] Updated weights for policy 0, policy_version 554683 (0.0009) [2023-12-27 23:13:38,430][106226] Updated weights for policy 0, policy_version 554693 (0.0009) [2023-12-27 23:13:38,497][106226] Updated weights for policy 0, policy_version 554703 (0.0008) [2023-12-27 23:13:38,512][106225] Updated weights for policy 1, policy_version 556281 (0.0007) [2023-12-27 23:13:38,573][106225] Updated weights for policy 1, policy_version 556291 (0.0006) [2023-12-27 23:13:38,639][106225] Updated weights for policy 1, policy_version 556301 (0.0006) [2023-12-27 23:13:39,238][106225] Updated weights for policy 1, policy_version 556311 (0.0008) [2023-12-27 23:13:39,288][106226] Updated weights for policy 0, policy_version 554713 (0.0008) [2023-12-27 23:13:39,305][106225] Updated weights for policy 1, policy_version 556321 (0.0007) [2023-12-27 23:13:39,357][106226] Updated weights for policy 0, policy_version 554723 (0.0008) [2023-12-27 23:13:39,374][106225] Updated weights for policy 1, policy_version 556331 (0.0008) [2023-12-27 23:13:39,433][106226] Updated weights for policy 0, policy_version 554733 (0.0008) [2023-12-27 23:13:39,492][106226] Updated weights for policy 0, policy_version 554743 (0.0006) [2023-12-27 23:13:40,159][106225] Updated weights for policy 1, policy_version 556341 (0.0007) [2023-12-27 23:13:40,168][106226] Updated weights for policy 0, policy_version 554753 (0.0007) [2023-12-27 23:13:40,222][106225] Updated weights for policy 1, policy_version 556351 (0.0006) [2023-12-27 23:13:40,234][106226] Updated weights for policy 0, policy_version 554763 (0.0007) [2023-12-27 23:13:40,279][106225] Updated weights for policy 1, policy_version 556361 (0.0008) [2023-12-27 23:13:40,293][106226] Updated weights for policy 0, policy_version 554773 (0.0007) [2023-12-27 23:13:40,980][106225] Updated weights for policy 1, policy_version 556371 (0.0007) [2023-12-27 23:13:40,993][106226] Updated weights for policy 0, policy_version 554783 (0.0006) [2023-12-27 23:13:41,042][106225] Updated weights for policy 1, policy_version 556381 (0.0007) [2023-12-27 23:13:41,072][106226] Updated weights for policy 0, policy_version 554793 (0.0007) [2023-12-27 23:13:41,103][106225] Updated weights for policy 1, policy_version 556391 (0.0008) [2023-12-27 23:13:41,143][106226] Updated weights for policy 0, policy_version 554803 (0.0006) [2023-12-27 23:13:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 284532736. Throughput: 0: 9634.6, 1: 9985.2. Samples: 284495704. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:41,175][105115] Avg episode reward: [(0, '-4.961'), (1, '-5.179')] [2023-12-27 23:13:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000556400_142467072.pth... [2023-12-27 23:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000554808_142065664.pth... [2023-12-27 23:13:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000553688_141778944.pth [2023-12-27 23:13:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000555248_142172160.pth [2023-12-27 23:13:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000554808_142065664.pth [2023-12-27 23:13:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000556400_142467072.pth [2023-12-27 23:13:41,824][106225] Updated weights for policy 1, policy_version 556401 (0.0008) [2023-12-27 23:13:41,884][106225] Updated weights for policy 1, policy_version 556411 (0.0009) [2023-12-27 23:13:41,940][106225] Updated weights for policy 1, policy_version 556421 (0.0008) [2023-12-27 23:13:41,958][106226] Updated weights for policy 0, policy_version 554813 (0.0008) [2023-12-27 23:13:41,999][106225] Updated weights for policy 1, policy_version 556431 (0.0007) [2023-12-27 23:13:42,026][106226] Updated weights for policy 0, policy_version 554823 (0.0007) [2023-12-27 23:13:42,090][106226] Updated weights for policy 0, policy_version 554833 (0.0008) [2023-12-27 23:13:42,756][106225] Updated weights for policy 1, policy_version 556441 (0.0008) [2023-12-27 23:13:42,815][106225] Updated weights for policy 1, policy_version 556451 (0.0008) [2023-12-27 23:13:42,820][106226] Updated weights for policy 0, policy_version 554843 (0.0008) [2023-12-27 23:13:42,870][106225] Updated weights for policy 1, policy_version 556461 (0.0006) [2023-12-27 23:13:42,880][106226] Updated weights for policy 0, policy_version 554853 (0.0008) [2023-12-27 23:13:42,941][106226] Updated weights for policy 0, policy_version 554863 (0.0008) [2023-12-27 23:13:43,578][106226] Updated weights for policy 0, policy_version 554873 (0.0008) [2023-12-27 23:13:43,591][106225] Updated weights for policy 1, policy_version 556471 (0.0006) [2023-12-27 23:13:43,640][106226] Updated weights for policy 0, policy_version 554883 (0.0006) [2023-12-27 23:13:43,655][106225] Updated weights for policy 1, policy_version 556481 (0.0006) [2023-12-27 23:13:43,701][106226] Updated weights for policy 0, policy_version 554893 (0.0006) [2023-12-27 23:13:43,716][106225] Updated weights for policy 1, policy_version 556491 (0.0006) [2023-12-27 23:13:43,768][106226] Updated weights for policy 0, policy_version 554903 (0.0006) [2023-12-27 23:13:44,267][106225] Updated weights for policy 1, policy_version 556501 (0.0006) [2023-12-27 23:13:44,313][106225] Updated weights for policy 1, policy_version 556511 (0.0005) [2023-12-27 23:13:44,358][106225] Updated weights for policy 1, policy_version 556521 (0.0007) [2023-12-27 23:13:44,370][106226] Updated weights for policy 0, policy_version 554913 (0.0005) [2023-12-27 23:13:44,428][106226] Updated weights for policy 0, policy_version 554923 (0.0007) [2023-12-27 23:13:44,491][106226] Updated weights for policy 0, policy_version 554933 (0.0008) [2023-12-27 23:13:45,080][106225] Updated weights for policy 1, policy_version 556531 (0.0008) [2023-12-27 23:13:45,139][106225] Updated weights for policy 1, policy_version 556541 (0.0008) [2023-12-27 23:13:45,154][106226] Updated weights for policy 0, policy_version 554943 (0.0007) [2023-12-27 23:13:45,200][106225] Updated weights for policy 1, policy_version 556551 (0.0007) [2023-12-27 23:13:45,218][106226] Updated weights for policy 0, policy_version 554953 (0.0007) [2023-12-27 23:13:45,277][106226] Updated weights for policy 0, policy_version 554963 (0.0006) [2023-12-27 23:13:45,859][106226] Updated weights for policy 0, policy_version 554973 (0.0007) [2023-12-27 23:13:45,911][106226] Updated weights for policy 0, policy_version 554983 (0.0010) [2023-12-27 23:13:45,921][106225] Updated weights for policy 1, policy_version 556561 (0.0007) [2023-12-27 23:13:45,966][106226] Updated weights for policy 0, policy_version 554993 (0.0010) [2023-12-27 23:13:45,973][106225] Updated weights for policy 1, policy_version 556571 (0.0005) [2023-12-27 23:13:46,027][106225] Updated weights for policy 1, policy_version 556581 (0.0005) [2023-12-27 23:13:46,080][106225] Updated weights for policy 1, policy_version 556591 (0.0005) [2023-12-27 23:13:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 284631040. Throughput: 0: 9618.3, 1: 10007.6. Samples: 284613920. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:46,176][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.737')] [2023-12-27 23:13:46,663][106226] Updated weights for policy 0, policy_version 555003 (0.0011) [2023-12-27 23:13:46,678][106225] Updated weights for policy 1, policy_version 556601 (0.0010) [2023-12-27 23:13:46,714][106226] Updated weights for policy 0, policy_version 555013 (0.0006) [2023-12-27 23:13:46,734][106225] Updated weights for policy 1, policy_version 556611 (0.0010) [2023-12-27 23:13:46,763][106226] Updated weights for policy 0, policy_version 555023 (0.0008) [2023-12-27 23:13:46,791][106225] Updated weights for policy 1, policy_version 556621 (0.0010) [2023-12-27 23:13:47,403][106225] Updated weights for policy 1, policy_version 556631 (0.0010) [2023-12-27 23:13:47,460][106225] Updated weights for policy 1, policy_version 556641 (0.0010) [2023-12-27 23:13:47,498][106226] Updated weights for policy 0, policy_version 555033 (0.0005) [2023-12-27 23:13:47,510][106225] Updated weights for policy 1, policy_version 556651 (0.0010) [2023-12-27 23:13:47,553][106226] Updated weights for policy 0, policy_version 555043 (0.0005) [2023-12-27 23:13:47,610][106226] Updated weights for policy 0, policy_version 555053 (0.0006) [2023-12-27 23:13:47,660][106226] Updated weights for policy 0, policy_version 555063 (0.0005) [2023-12-27 23:13:48,093][106225] Updated weights for policy 1, policy_version 556661 (0.0008) [2023-12-27 23:13:48,154][106225] Updated weights for policy 1, policy_version 556671 (0.0006) [2023-12-27 23:13:48,210][106225] Updated weights for policy 1, policy_version 556681 (0.0008) [2023-12-27 23:13:48,211][106226] Updated weights for policy 0, policy_version 555073 (0.0008) [2023-12-27 23:13:48,266][106226] Updated weights for policy 0, policy_version 555083 (0.0008) [2023-12-27 23:13:48,327][106226] Updated weights for policy 0, policy_version 555093 (0.0008) [2023-12-27 23:13:48,874][106225] Updated weights for policy 1, policy_version 556691 (0.0006) [2023-12-27 23:13:48,934][106225] Updated weights for policy 1, policy_version 556701 (0.0007) [2023-12-27 23:13:48,991][106225] Updated weights for policy 1, policy_version 556711 (0.0008) [2023-12-27 23:13:49,067][106226] Updated weights for policy 0, policy_version 555103 (0.0009) [2023-12-27 23:13:49,128][106226] Updated weights for policy 0, policy_version 555113 (0.0009) [2023-12-27 23:13:49,197][106226] Updated weights for policy 0, policy_version 555123 (0.0007) [2023-12-27 23:13:49,717][106225] Updated weights for policy 1, policy_version 556721 (0.0007) [2023-12-27 23:13:49,782][106225] Updated weights for policy 1, policy_version 556731 (0.0005) [2023-12-27 23:13:49,851][106225] Updated weights for policy 1, policy_version 556741 (0.0008) [2023-12-27 23:13:49,917][106225] Updated weights for policy 1, policy_version 556751 (0.0008) [2023-12-27 23:13:49,968][106226] Updated weights for policy 0, policy_version 555133 (0.0009) [2023-12-27 23:13:50,031][106226] Updated weights for policy 0, policy_version 555143 (0.0009) [2023-12-27 23:13:50,096][106226] Updated weights for policy 0, policy_version 555153 (0.0006) [2023-12-27 23:13:50,616][106225] Updated weights for policy 1, policy_version 556761 (0.0008) [2023-12-27 23:13:50,687][106225] Updated weights for policy 1, policy_version 556771 (0.0008) [2023-12-27 23:13:50,753][106225] Updated weights for policy 1, policy_version 556781 (0.0009) [2023-12-27 23:13:50,784][106226] Updated weights for policy 0, policy_version 555163 (0.0007) [2023-12-27 23:13:50,847][106226] Updated weights for policy 0, policy_version 555173 (0.0006) [2023-12-27 23:13:50,919][106226] Updated weights for policy 0, policy_version 555183 (0.0006) [2023-12-27 23:13:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 284729344. Throughput: 0: 9727.0, 1: 10005.2. Samples: 284736776. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:51,175][105115] Avg episode reward: [(0, '-5.087'), (1, '-5.260')] [2023-12-27 23:13:51,437][106225] Updated weights for policy 1, policy_version 556791 (0.0007) [2023-12-27 23:13:51,497][106225] Updated weights for policy 1, policy_version 556801 (0.0006) [2023-12-27 23:13:51,556][106225] Updated weights for policy 1, policy_version 556811 (0.0009) [2023-12-27 23:13:51,577][106226] Updated weights for policy 0, policy_version 555193 (0.0007) [2023-12-27 23:13:51,643][106226] Updated weights for policy 0, policy_version 555203 (0.0007) [2023-12-27 23:13:51,715][106226] Updated weights for policy 0, policy_version 555213 (0.0008) [2023-12-27 23:13:51,783][106226] Updated weights for policy 0, policy_version 555223 (0.0009) [2023-12-27 23:13:52,252][106225] Updated weights for policy 1, policy_version 556821 (0.0008) [2023-12-27 23:13:52,313][106225] Updated weights for policy 1, policy_version 556831 (0.0009) [2023-12-27 23:13:52,370][106225] Updated weights for policy 1, policy_version 556841 (0.0008) [2023-12-27 23:13:52,575][106226] Updated weights for policy 0, policy_version 555233 (0.0009) [2023-12-27 23:13:52,640][106226] Updated weights for policy 0, policy_version 555243 (0.0008) [2023-12-27 23:13:52,710][106226] Updated weights for policy 0, policy_version 555253 (0.0009) [2023-12-27 23:13:52,976][106225] Updated weights for policy 1, policy_version 556851 (0.0008) [2023-12-27 23:13:53,042][106225] Updated weights for policy 1, policy_version 556861 (0.0006) [2023-12-27 23:13:53,108][106225] Updated weights for policy 1, policy_version 556871 (0.0009) [2023-12-27 23:13:53,518][106226] Updated weights for policy 0, policy_version 555263 (0.0009) [2023-12-27 23:13:53,568][106226] Updated weights for policy 0, policy_version 555273 (0.0009) [2023-12-27 23:13:53,618][106226] Updated weights for policy 0, policy_version 555283 (0.0009) [2023-12-27 23:13:53,638][106225] Updated weights for policy 1, policy_version 556881 (0.0009) [2023-12-27 23:13:53,687][106225] Updated weights for policy 1, policy_version 556891 (0.0010) [2023-12-27 23:13:53,734][106225] Updated weights for policy 1, policy_version 556901 (0.0010) [2023-12-27 23:13:53,788][106225] Updated weights for policy 1, policy_version 556911 (0.0011) [2023-12-27 23:13:54,417][106226] Updated weights for policy 0, policy_version 555293 (0.0008) [2023-12-27 23:13:54,458][106225] Updated weights for policy 1, policy_version 556921 (0.0006) [2023-12-27 23:13:54,465][106226] Updated weights for policy 0, policy_version 555303 (0.0009) [2023-12-27 23:13:54,513][106226] Updated weights for policy 0, policy_version 555313 (0.0007) [2023-12-27 23:13:54,515][106225] Updated weights for policy 1, policy_version 556931 (0.0007) [2023-12-27 23:13:54,575][106225] Updated weights for policy 1, policy_version 556941 (0.0008) [2023-12-27 23:13:55,188][106225] Updated weights for policy 1, policy_version 556951 (0.0007) [2023-12-27 23:13:55,242][106225] Updated weights for policy 1, policy_version 556961 (0.0005) [2023-12-27 23:13:55,249][106226] Updated weights for policy 0, policy_version 555323 (0.0007) [2023-12-27 23:13:55,304][106226] Updated weights for policy 0, policy_version 555333 (0.0007) [2023-12-27 23:13:55,305][106225] Updated weights for policy 1, policy_version 556971 (0.0005) [2023-12-27 23:13:55,369][106226] Updated weights for policy 0, policy_version 555343 (0.0005) [2023-12-27 23:13:55,966][106225] Updated weights for policy 1, policy_version 556981 (0.0008) [2023-12-27 23:13:56,007][106226] Updated weights for policy 0, policy_version 555353 (0.0005) [2023-12-27 23:13:56,028][106225] Updated weights for policy 1, policy_version 556991 (0.0011) [2023-12-27 23:13:56,061][106226] Updated weights for policy 0, policy_version 555363 (0.0007) [2023-12-27 23:13:56,082][106225] Updated weights for policy 1, policy_version 557001 (0.0010) [2023-12-27 23:13:56,116][106226] Updated weights for policy 0, policy_version 555373 (0.0006) [2023-12-27 23:13:56,170][106226] Updated weights for policy 0, policy_version 555383 (0.0008) [2023-12-27 23:13:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 284835840. Throughput: 0: 9672.1, 1: 10015.1. Samples: 284795780. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:13:56,175][105115] Avg episode reward: [(0, '-5.101'), (1, '-5.553')] [2023-12-27 23:13:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000557008_142622720.pth... [2023-12-27 23:13:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000555384_142213120.pth... [2023-12-27 23:13:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000554232_141918208.pth [2023-12-27 23:13:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000555792_142311424.pth [2023-12-27 23:13:56,682][106225] Updated weights for policy 1, policy_version 557011 (0.0010) [2023-12-27 23:13:56,734][106225] Updated weights for policy 1, policy_version 557021 (0.0008) [2023-12-27 23:13:56,791][106225] Updated weights for policy 1, policy_version 557031 (0.0010) [2023-12-27 23:13:56,935][106226] Updated weights for policy 0, policy_version 555393 (0.0008) [2023-12-27 23:13:57,001][106226] Updated weights for policy 0, policy_version 555403 (0.0007) [2023-12-27 23:13:57,056][106226] Updated weights for policy 0, policy_version 555413 (0.0008) [2023-12-27 23:13:57,514][106225] Updated weights for policy 1, policy_version 557041 (0.0010) [2023-12-27 23:13:57,563][106225] Updated weights for policy 1, policy_version 557051 (0.0010) [2023-12-27 23:13:57,609][106225] Updated weights for policy 1, policy_version 557061 (0.0010) [2023-12-27 23:13:57,658][106225] Updated weights for policy 1, policy_version 557071 (0.0010) [2023-12-27 23:13:57,798][106226] Updated weights for policy 0, policy_version 555423 (0.0007) [2023-12-27 23:13:57,854][106226] Updated weights for policy 0, policy_version 555433 (0.0008) [2023-12-27 23:13:57,896][106226] Updated weights for policy 0, policy_version 555443 (0.0007) [2023-12-27 23:13:58,379][106225] Updated weights for policy 1, policy_version 557081 (0.0009) [2023-12-27 23:13:58,450][106225] Updated weights for policy 1, policy_version 557091 (0.0008) [2023-12-27 23:13:58,517][106225] Updated weights for policy 1, policy_version 557101 (0.0011) [2023-12-27 23:13:58,720][106226] Updated weights for policy 0, policy_version 555453 (0.0008) [2023-12-27 23:13:58,784][106226] Updated weights for policy 0, policy_version 555463 (0.0008) [2023-12-27 23:13:58,848][106226] Updated weights for policy 0, policy_version 555473 (0.0008) [2023-12-27 23:13:59,371][106225] Updated weights for policy 1, policy_version 557111 (0.0009) [2023-12-27 23:13:59,446][106225] Updated weights for policy 1, policy_version 557121 (0.0008) [2023-12-27 23:13:59,506][106225] Updated weights for policy 1, policy_version 557131 (0.0008) [2023-12-27 23:13:59,715][106226] Updated weights for policy 0, policy_version 555483 (0.0007) [2023-12-27 23:13:59,777][106226] Updated weights for policy 0, policy_version 555493 (0.0008) [2023-12-27 23:13:59,842][106226] Updated weights for policy 0, policy_version 555503 (0.0008) [2023-12-27 23:14:00,253][106225] Updated weights for policy 1, policy_version 557141 (0.0010) [2023-12-27 23:14:00,307][106225] Updated weights for policy 1, policy_version 557151 (0.0010) [2023-12-27 23:14:00,369][106225] Updated weights for policy 1, policy_version 557161 (0.0007) [2023-12-27 23:14:00,579][106226] Updated weights for policy 0, policy_version 555513 (0.0009) [2023-12-27 23:14:00,641][106226] Updated weights for policy 0, policy_version 555523 (0.0011) [2023-12-27 23:14:00,704][106226] Updated weights for policy 0, policy_version 555533 (0.0010) [2023-12-27 23:14:00,756][106226] Updated weights for policy 0, policy_version 555543 (0.0006) [2023-12-27 23:14:00,974][106225] Updated weights for policy 1, policy_version 557171 (0.0005) [2023-12-27 23:14:01,046][106225] Updated weights for policy 1, policy_version 557181 (0.0006) [2023-12-27 23:14:01,112][106225] Updated weights for policy 1, policy_version 557191 (0.0006) [2023-12-27 23:14:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 284925952. Throughput: 0: 9655.2, 1: 10033.9. Samples: 284911120. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:14:01,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.626')] [2023-12-27 23:14:01,472][106226] Updated weights for policy 0, policy_version 555553 (0.0010) [2023-12-27 23:14:01,529][106226] Updated weights for policy 0, policy_version 555563 (0.0011) [2023-12-27 23:14:01,592][106226] Updated weights for policy 0, policy_version 555573 (0.0011) [2023-12-27 23:14:01,752][106225] Updated weights for policy 1, policy_version 557201 (0.0008) [2023-12-27 23:14:01,804][106225] Updated weights for policy 1, policy_version 557211 (0.0008) [2023-12-27 23:14:01,852][106225] Updated weights for policy 1, policy_version 557221 (0.0008) [2023-12-27 23:14:01,906][106225] Updated weights for policy 1, policy_version 557231 (0.0010) [2023-12-27 23:14:02,317][106226] Updated weights for policy 0, policy_version 555583 (0.0011) [2023-12-27 23:14:02,386][106226] Updated weights for policy 0, policy_version 555593 (0.0011) [2023-12-27 23:14:02,439][106226] Updated weights for policy 0, policy_version 555603 (0.0010) [2023-12-27 23:14:02,657][106225] Updated weights for policy 1, policy_version 557241 (0.0010) [2023-12-27 23:14:02,715][106225] Updated weights for policy 1, policy_version 557251 (0.0010) [2023-12-27 23:14:02,769][106225] Updated weights for policy 1, policy_version 557261 (0.0010) [2023-12-27 23:14:03,141][106226] Updated weights for policy 0, policy_version 555613 (0.0010) [2023-12-27 23:14:03,194][106226] Updated weights for policy 0, policy_version 555623 (0.0010) [2023-12-27 23:14:03,243][106226] Updated weights for policy 0, policy_version 555633 (0.0010) [2023-12-27 23:14:03,345][106225] Updated weights for policy 1, policy_version 557271 (0.0007) [2023-12-27 23:14:03,395][106225] Updated weights for policy 1, policy_version 557281 (0.0005) [2023-12-27 23:14:03,450][106225] Updated weights for policy 1, policy_version 557291 (0.0007) [2023-12-27 23:14:03,963][106226] Updated weights for policy 0, policy_version 555643 (0.0010) [2023-12-27 23:14:04,020][106226] Updated weights for policy 0, policy_version 555653 (0.0011) [2023-12-27 23:14:04,085][106226] Updated weights for policy 0, policy_version 555663 (0.0011) [2023-12-27 23:14:04,105][106225] Updated weights for policy 1, policy_version 557301 (0.0009) [2023-12-27 23:14:04,167][106225] Updated weights for policy 1, policy_version 557311 (0.0011) [2023-12-27 23:14:04,232][106225] Updated weights for policy 1, policy_version 557321 (0.0009) [2023-12-27 23:14:04,819][106226] Updated weights for policy 0, policy_version 555673 (0.0011) [2023-12-27 23:14:04,875][106226] Updated weights for policy 0, policy_version 555683 (0.0010) [2023-12-27 23:14:04,938][106226] Updated weights for policy 0, policy_version 555693 (0.0011) [2023-12-27 23:14:04,969][106225] Updated weights for policy 1, policy_version 557331 (0.0010) [2023-12-27 23:14:04,998][106226] Updated weights for policy 0, policy_version 555703 (0.0011) [2023-12-27 23:14:05,013][106225] Updated weights for policy 1, policy_version 557341 (0.0010) [2023-12-27 23:14:05,063][106225] Updated weights for policy 1, policy_version 557351 (0.0010) [2023-12-27 23:14:05,645][106226] Updated weights for policy 0, policy_version 555713 (0.0010) [2023-12-27 23:14:05,699][106226] Updated weights for policy 0, policy_version 555723 (0.0010) [2023-12-27 23:14:05,759][106226] Updated weights for policy 0, policy_version 555733 (0.0011) [2023-12-27 23:14:05,808][106225] Updated weights for policy 1, policy_version 557361 (0.0010) [2023-12-27 23:14:05,862][106225] Updated weights for policy 1, policy_version 557371 (0.0010) [2023-12-27 23:14:05,923][106225] Updated weights for policy 1, policy_version 557381 (0.0007) [2023-12-27 23:14:05,978][106225] Updated weights for policy 1, policy_version 557391 (0.0005) [2023-12-27 23:14:06,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 285024256. Throughput: 0: 9616.1, 1: 10128.8. Samples: 285031360. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-27 23:14:06,175][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.610')] [2023-12-27 23:14:06,475][106226] Updated weights for policy 0, policy_version 555743 (0.0010) [2023-12-27 23:14:06,533][106226] Updated weights for policy 0, policy_version 555753 (0.0011) [2023-12-27 23:14:06,594][106226] Updated weights for policy 0, policy_version 555763 (0.0011) [2023-12-27 23:14:06,651][106225] Updated weights for policy 1, policy_version 557401 (0.0010) [2023-12-27 23:14:06,705][106225] Updated weights for policy 1, policy_version 557411 (0.0010) [2023-12-27 23:14:06,756][106225] Updated weights for policy 1, policy_version 557421 (0.0010) [2023-12-27 23:14:07,252][106226] Updated weights for policy 0, policy_version 555773 (0.0011) [2023-12-27 23:14:07,301][106226] Updated weights for policy 0, policy_version 555783 (0.0007) [2023-12-27 23:14:07,350][106226] Updated weights for policy 0, policy_version 555793 (0.0005) [2023-12-27 23:14:07,441][106225] Updated weights for policy 1, policy_version 557431 (0.0009) [2023-12-27 23:14:07,492][106225] Updated weights for policy 1, policy_version 557441 (0.0010) [2023-12-27 23:14:07,546][106225] Updated weights for policy 1, policy_version 557451 (0.0010) [2023-12-27 23:14:07,957][106226] Updated weights for policy 0, policy_version 555803 (0.0007) [2023-12-27 23:14:08,018][106226] Updated weights for policy 0, policy_version 555813 (0.0009) [2023-12-27 23:14:08,078][106226] Updated weights for policy 0, policy_version 555823 (0.0007) [2023-12-27 23:14:08,228][106225] Updated weights for policy 1, policy_version 557461 (0.0009) [2023-12-27 23:14:08,296][106225] Updated weights for policy 1, policy_version 557471 (0.0008) [2023-12-27 23:14:08,366][106225] Updated weights for policy 1, policy_version 557481 (0.0010) [2023-12-27 23:14:08,774][106226] Updated weights for policy 0, policy_version 555833 (0.0009) [2023-12-27 23:14:08,835][106226] Updated weights for policy 0, policy_version 555843 (0.0006) [2023-12-27 23:14:08,905][106226] Updated weights for policy 0, policy_version 555853 (0.0007) [2023-12-27 23:14:08,971][106226] Updated weights for policy 0, policy_version 555863 (0.0008) [2023-12-27 23:14:08,982][106225] Updated weights for policy 1, policy_version 557491 (0.0011) [2023-12-27 23:14:09,033][106225] Updated weights for policy 1, policy_version 557501 (0.0010) [2023-12-27 23:14:09,096][106225] Updated weights for policy 1, policy_version 557511 (0.0008) [2023-12-27 23:14:09,637][106226] Updated weights for policy 0, policy_version 555873 (0.0010) [2023-12-27 23:14:09,702][106226] Updated weights for policy 0, policy_version 555883 (0.0007) [2023-12-27 23:14:09,768][106226] Updated weights for policy 0, policy_version 555893 (0.0006) [2023-12-27 23:14:09,806][106225] Updated weights for policy 1, policy_version 557521 (0.0006) [2023-12-27 23:14:09,876][106225] Updated weights for policy 1, policy_version 557531 (0.0008) [2023-12-27 23:14:09,943][106225] Updated weights for policy 1, policy_version 557541 (0.0007) [2023-12-27 23:14:10,010][106225] Updated weights for policy 1, policy_version 557551 (0.0009) [2023-12-27 23:14:10,497][106226] Updated weights for policy 0, policy_version 555903 (0.0009) [2023-12-27 23:14:10,553][106226] Updated weights for policy 0, policy_version 555913 (0.0009) [2023-12-27 23:14:10,613][106226] Updated weights for policy 0, policy_version 555923 (0.0010) [2023-12-27 23:14:10,738][106225] Updated weights for policy 1, policy_version 557561 (0.0008) [2023-12-27 23:14:10,798][106225] Updated weights for policy 1, policy_version 557571 (0.0008) [2023-12-27 23:14:10,858][106225] Updated weights for policy 1, policy_version 557581 (0.0008) [2023-12-27 23:14:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 285122560. Throughput: 0: 9659.3, 1: 10179.5. Samples: 285093752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:11,175][105115] Avg episode reward: [(0, '-4.962'), (1, '-5.138')] [2023-12-27 23:14:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000557584_142770176.pth... [2023-12-27 23:14:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000555928_142352384.pth... [2023-12-27 23:14:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000556400_142467072.pth [2023-12-27 23:14:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000554808_142065664.pth [2023-12-27 23:14:11,368][106226] Updated weights for policy 0, policy_version 555933 (0.0009) [2023-12-27 23:14:11,439][106226] Updated weights for policy 0, policy_version 555943 (0.0008) [2023-12-27 23:14:11,503][106226] Updated weights for policy 0, policy_version 555953 (0.0008) [2023-12-27 23:14:11,656][106225] Updated weights for policy 1, policy_version 557591 (0.0009) [2023-12-27 23:14:11,710][106225] Updated weights for policy 1, policy_version 557601 (0.0007) [2023-12-27 23:14:11,779][106225] Updated weights for policy 1, policy_version 557611 (0.0007) [2023-12-27 23:14:12,248][106226] Updated weights for policy 0, policy_version 555963 (0.0008) [2023-12-27 23:14:12,313][106226] Updated weights for policy 0, policy_version 555973 (0.0009) [2023-12-27 23:14:12,377][106226] Updated weights for policy 0, policy_version 555983 (0.0008) [2023-12-27 23:14:12,521][106225] Updated weights for policy 1, policy_version 557621 (0.0009) [2023-12-27 23:14:12,581][106225] Updated weights for policy 1, policy_version 557631 (0.0010) [2023-12-27 23:14:12,644][106225] Updated weights for policy 1, policy_version 557641 (0.0010) [2023-12-27 23:14:13,141][106226] Updated weights for policy 0, policy_version 555993 (0.0007) [2023-12-27 23:14:13,197][106226] Updated weights for policy 0, policy_version 556003 (0.0008) [2023-12-27 23:14:13,247][106226] Updated weights for policy 0, policy_version 556013 (0.0008) [2023-12-27 23:14:13,301][106226] Updated weights for policy 0, policy_version 556023 (0.0008) [2023-12-27 23:14:13,365][106225] Updated weights for policy 1, policy_version 557651 (0.0009) [2023-12-27 23:14:13,428][106225] Updated weights for policy 1, policy_version 557661 (0.0006) [2023-12-27 23:14:13,485][106225] Updated weights for policy 1, policy_version 557671 (0.0006) [2023-12-27 23:14:14,049][106225] Updated weights for policy 1, policy_version 557681 (0.0010) [2023-12-27 23:14:14,071][106226] Updated weights for policy 0, policy_version 556033 (0.0006) [2023-12-27 23:14:14,104][106225] Updated weights for policy 1, policy_version 557691 (0.0010) [2023-12-27 23:14:14,130][106226] Updated weights for policy 0, policy_version 556043 (0.0006) [2023-12-27 23:14:14,165][106225] Updated weights for policy 1, policy_version 557701 (0.0010) [2023-12-27 23:14:14,192][106226] Updated weights for policy 0, policy_version 556053 (0.0007) [2023-12-27 23:14:14,222][106225] Updated weights for policy 1, policy_version 557711 (0.0010) [2023-12-27 23:14:14,893][106226] Updated weights for policy 0, policy_version 556063 (0.0007) [2023-12-27 23:14:14,923][106225] Updated weights for policy 1, policy_version 557721 (0.0011) [2023-12-27 23:14:14,965][106226] Updated weights for policy 0, policy_version 556073 (0.0006) [2023-12-27 23:14:14,988][106225] Updated weights for policy 1, policy_version 557731 (0.0007) [2023-12-27 23:14:15,029][106226] Updated weights for policy 0, policy_version 556083 (0.0007) [2023-12-27 23:14:15,048][106225] Updated weights for policy 1, policy_version 557741 (0.0007) [2023-12-27 23:14:15,704][106226] Updated weights for policy 0, policy_version 556093 (0.0007) [2023-12-27 23:14:15,767][106226] Updated weights for policy 0, policy_version 556103 (0.0008) [2023-12-27 23:14:15,788][106225] Updated weights for policy 1, policy_version 557751 (0.0007) [2023-12-27 23:14:15,826][106226] Updated weights for policy 0, policy_version 556113 (0.0007) [2023-12-27 23:14:15,841][106225] Updated weights for policy 1, policy_version 557761 (0.0008) [2023-12-27 23:14:15,901][106225] Updated weights for policy 1, policy_version 557771 (0.0007) [2023-12-27 23:14:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 285220864. Throughput: 0: 9628.9, 1: 10120.1. Samples: 285208940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:16,176][105115] Avg episode reward: [(0, '-4.767'), (1, '-5.580')] [2023-12-27 23:14:16,521][106226] Updated weights for policy 0, policy_version 556123 (0.0008) [2023-12-27 23:14:16,579][106226] Updated weights for policy 0, policy_version 556133 (0.0008) [2023-12-27 23:14:16,626][106226] Updated weights for policy 0, policy_version 556143 (0.0008) [2023-12-27 23:14:16,637][106225] Updated weights for policy 1, policy_version 557781 (0.0008) [2023-12-27 23:14:16,699][106225] Updated weights for policy 1, policy_version 557791 (0.0007) [2023-12-27 23:14:16,750][106225] Updated weights for policy 1, policy_version 557801 (0.0008) [2023-12-27 23:14:17,308][106226] Updated weights for policy 0, policy_version 556153 (0.0008) [2023-12-27 23:14:17,369][106226] Updated weights for policy 0, policy_version 556163 (0.0005) [2023-12-27 23:14:17,419][106226] Updated weights for policy 0, policy_version 556173 (0.0005) [2023-12-27 23:14:17,477][106226] Updated weights for policy 0, policy_version 556183 (0.0005) [2023-12-27 23:14:17,494][106225] Updated weights for policy 1, policy_version 557811 (0.0008) [2023-12-27 23:14:17,544][106225] Updated weights for policy 1, policy_version 557821 (0.0009) [2023-12-27 23:14:17,591][106225] Updated weights for policy 1, policy_version 557831 (0.0005) [2023-12-27 23:14:18,062][106226] Updated weights for policy 0, policy_version 556193 (0.0010) [2023-12-27 23:14:18,118][106226] Updated weights for policy 0, policy_version 556203 (0.0010) [2023-12-27 23:14:18,188][106226] Updated weights for policy 0, policy_version 556213 (0.0010) [2023-12-27 23:14:18,258][106225] Updated weights for policy 1, policy_version 557841 (0.0009) [2023-12-27 23:14:18,318][106225] Updated weights for policy 1, policy_version 557851 (0.0007) [2023-12-27 23:14:18,389][106225] Updated weights for policy 1, policy_version 557861 (0.0007) [2023-12-27 23:14:18,452][106225] Updated weights for policy 1, policy_version 557871 (0.0010) [2023-12-27 23:14:18,878][106226] Updated weights for policy 0, policy_version 556223 (0.0011) [2023-12-27 23:14:18,938][106226] Updated weights for policy 0, policy_version 556233 (0.0010) [2023-12-27 23:14:18,986][106226] Updated weights for policy 0, policy_version 556243 (0.0010) [2023-12-27 23:14:19,136][106225] Updated weights for policy 1, policy_version 557881 (0.0006) [2023-12-27 23:14:19,186][106225] Updated weights for policy 1, policy_version 557891 (0.0009) [2023-12-27 23:14:19,253][106225] Updated weights for policy 1, policy_version 557901 (0.0008) [2023-12-27 23:14:19,689][106226] Updated weights for policy 0, policy_version 556253 (0.0011) [2023-12-27 23:14:19,758][106226] Updated weights for policy 0, policy_version 556263 (0.0011) [2023-12-27 23:14:19,844][106226] Updated weights for policy 0, policy_version 556273 (0.0010) [2023-12-27 23:14:20,001][106225] Updated weights for policy 1, policy_version 557911 (0.0008) [2023-12-27 23:14:20,063][106225] Updated weights for policy 1, policy_version 557921 (0.0006) [2023-12-27 23:14:20,130][106225] Updated weights for policy 1, policy_version 557931 (0.0007) [2023-12-27 23:14:20,586][106226] Updated weights for policy 0, policy_version 556283 (0.0010) [2023-12-27 23:14:20,650][106226] Updated weights for policy 0, policy_version 556293 (0.0009) [2023-12-27 23:14:20,712][106226] Updated weights for policy 0, policy_version 556303 (0.0009) [2023-12-27 23:14:20,817][106225] Updated weights for policy 1, policy_version 557941 (0.0006) [2023-12-27 23:14:20,878][106225] Updated weights for policy 1, policy_version 557951 (0.0006) [2023-12-27 23:14:20,941][106225] Updated weights for policy 1, policy_version 557961 (0.0007) [2023-12-27 23:14:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 285319168. Throughput: 0: 9672.9, 1: 10071.5. Samples: 285326736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:21,175][105115] Avg episode reward: [(0, '-4.952'), (1, '-5.662')] [2023-12-27 23:14:21,529][106226] Updated weights for policy 0, policy_version 556313 (0.0009) [2023-12-27 23:14:21,580][106225] Updated weights for policy 1, policy_version 557971 (0.0006) [2023-12-27 23:14:21,593][106226] Updated weights for policy 0, policy_version 556323 (0.0009) [2023-12-27 23:14:21,652][106225] Updated weights for policy 1, policy_version 557981 (0.0007) [2023-12-27 23:14:21,662][106226] Updated weights for policy 0, policy_version 556333 (0.0008) [2023-12-27 23:14:21,716][106225] Updated weights for policy 1, policy_version 557991 (0.0008) [2023-12-27 23:14:21,730][106226] Updated weights for policy 0, policy_version 556343 (0.0007) [2023-12-27 23:14:22,420][106226] Updated weights for policy 0, policy_version 556353 (0.0009) [2023-12-27 23:14:22,465][106225] Updated weights for policy 1, policy_version 558001 (0.0008) [2023-12-27 23:14:22,480][106226] Updated weights for policy 0, policy_version 556363 (0.0008) [2023-12-27 23:14:22,524][106225] Updated weights for policy 1, policy_version 558011 (0.0008) [2023-12-27 23:14:22,541][106226] Updated weights for policy 0, policy_version 556373 (0.0007) [2023-12-27 23:14:22,585][106225] Updated weights for policy 1, policy_version 558021 (0.0008) [2023-12-27 23:14:22,648][106225] Updated weights for policy 1, policy_version 558031 (0.0009) [2023-12-27 23:14:23,292][106225] Updated weights for policy 1, policy_version 558041 (0.0005) [2023-12-27 23:14:23,334][106226] Updated weights for policy 0, policy_version 556383 (0.0007) [2023-12-27 23:14:23,339][106225] Updated weights for policy 1, policy_version 558051 (0.0006) [2023-12-27 23:14:23,391][106225] Updated weights for policy 1, policy_version 558061 (0.0006) [2023-12-27 23:14:23,397][106226] Updated weights for policy 0, policy_version 556393 (0.0007) [2023-12-27 23:14:23,455][106226] Updated weights for policy 0, policy_version 556403 (0.0006) [2023-12-27 23:14:24,068][106225] Updated weights for policy 1, policy_version 558071 (0.0010) [2023-12-27 23:14:24,126][106225] Updated weights for policy 1, policy_version 558081 (0.0010) [2023-12-27 23:14:24,144][106226] Updated weights for policy 0, policy_version 556413 (0.0006) [2023-12-27 23:14:24,186][106225] Updated weights for policy 1, policy_version 558091 (0.0010) [2023-12-27 23:14:24,204][106226] Updated weights for policy 0, policy_version 556423 (0.0005) [2023-12-27 23:14:24,266][106226] Updated weights for policy 0, policy_version 556433 (0.0006) [2023-12-27 23:14:24,865][106225] Updated weights for policy 1, policy_version 558101 (0.0010) [2023-12-27 23:14:24,925][106225] Updated weights for policy 1, policy_version 558111 (0.0010) [2023-12-27 23:14:24,975][106225] Updated weights for policy 1, policy_version 558121 (0.0010) [2023-12-27 23:14:24,981][106226] Updated weights for policy 0, policy_version 556443 (0.0007) [2023-12-27 23:14:25,037][106226] Updated weights for policy 0, policy_version 556453 (0.0008) [2023-12-27 23:14:25,094][106226] Updated weights for policy 0, policy_version 556463 (0.0008) [2023-12-27 23:14:25,675][106225] Updated weights for policy 1, policy_version 558131 (0.0010) [2023-12-27 23:14:25,734][106225] Updated weights for policy 1, policy_version 558141 (0.0010) [2023-12-27 23:14:25,794][106225] Updated weights for policy 1, policy_version 558151 (0.0010) [2023-12-27 23:14:25,818][106226] Updated weights for policy 0, policy_version 556473 (0.0007) [2023-12-27 23:14:25,873][106226] Updated weights for policy 0, policy_version 556483 (0.0007) [2023-12-27 23:14:25,927][106226] Updated weights for policy 0, policy_version 556493 (0.0008) [2023-12-27 23:14:25,982][106226] Updated weights for policy 0, policy_version 556503 (0.0008) [2023-12-27 23:14:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 285417472. Throughput: 0: 9686.9, 1: 10070.4. Samples: 285384788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:26,176][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.249')] [2023-12-27 23:14:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000556504_142499840.pth... [2023-12-27 23:14:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000558160_142917632.pth... [2023-12-27 23:14:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000555384_142213120.pth [2023-12-27 23:14:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000557008_142622720.pth [2023-12-27 23:14:26,508][106225] Updated weights for policy 1, policy_version 558161 (0.0010) [2023-12-27 23:14:26,560][106225] Updated weights for policy 1, policy_version 558171 (0.0010) [2023-12-27 23:14:26,616][106225] Updated weights for policy 1, policy_version 558181 (0.0010) [2023-12-27 23:14:26,668][106225] Updated weights for policy 1, policy_version 558191 (0.0010) [2023-12-27 23:14:26,717][106226] Updated weights for policy 0, policy_version 556513 (0.0007) [2023-12-27 23:14:26,760][106226] Updated weights for policy 0, policy_version 556523 (0.0008) [2023-12-27 23:14:26,802][106226] Updated weights for policy 0, policy_version 556533 (0.0007) [2023-12-27 23:14:27,380][106225] Updated weights for policy 1, policy_version 558201 (0.0010) [2023-12-27 23:14:27,439][106225] Updated weights for policy 1, policy_version 558211 (0.0010) [2023-12-27 23:14:27,498][106225] Updated weights for policy 1, policy_version 558221 (0.0010) [2023-12-27 23:14:27,579][106226] Updated weights for policy 0, policy_version 556543 (0.0009) [2023-12-27 23:14:27,627][106226] Updated weights for policy 0, policy_version 556553 (0.0008) [2023-12-27 23:14:27,680][106226] Updated weights for policy 0, policy_version 556564 (0.0008) [2023-12-27 23:14:28,160][106225] Updated weights for policy 1, policy_version 558231 (0.0009) [2023-12-27 23:14:28,216][106225] Updated weights for policy 1, policy_version 558241 (0.0008) [2023-12-27 23:14:28,281][106225] Updated weights for policy 1, policy_version 558251 (0.0005) [2023-12-27 23:14:28,302][106226] Updated weights for policy 0, policy_version 556574 (0.0006) [2023-12-27 23:14:28,362][106226] Updated weights for policy 0, policy_version 556584 (0.0007) [2023-12-27 23:14:28,418][106226] Updated weights for policy 0, policy_version 556594 (0.0008) [2023-12-27 23:14:29,005][106225] Updated weights for policy 1, policy_version 558261 (0.0008) [2023-12-27 23:14:29,038][106226] Updated weights for policy 0, policy_version 556604 (0.0008) [2023-12-27 23:14:29,056][106225] Updated weights for policy 1, policy_version 558271 (0.0006) [2023-12-27 23:14:29,093][106226] Updated weights for policy 0, policy_version 556614 (0.0009) [2023-12-27 23:14:29,107][106225] Updated weights for policy 1, policy_version 558281 (0.0007) [2023-12-27 23:14:29,147][106226] Updated weights for policy 0, policy_version 556624 (0.0010) [2023-12-27 23:14:29,826][106225] Updated weights for policy 1, policy_version 558291 (0.0008) [2023-12-27 23:14:29,892][106225] Updated weights for policy 1, policy_version 558301 (0.0007) [2023-12-27 23:14:29,897][106226] Updated weights for policy 0, policy_version 556634 (0.0011) [2023-12-27 23:14:29,964][106226] Updated weights for policy 0, policy_version 556644 (0.0010) [2023-12-27 23:14:29,981][106225] Updated weights for policy 1, policy_version 558311 (0.0006) [2023-12-27 23:14:30,026][106226] Updated weights for policy 0, policy_version 556654 (0.0010) [2023-12-27 23:14:30,081][106226] Updated weights for policy 0, policy_version 556664 (0.0010) [2023-12-27 23:14:30,669][106225] Updated weights for policy 1, policy_version 558321 (0.0006) [2023-12-27 23:14:30,732][106225] Updated weights for policy 1, policy_version 558331 (0.0008) [2023-12-27 23:14:30,785][106226] Updated weights for policy 0, policy_version 556674 (0.0011) [2023-12-27 23:14:30,792][106225] Updated weights for policy 1, policy_version 558341 (0.0006) [2023-12-27 23:14:30,843][106226] Updated weights for policy 0, policy_version 556684 (0.0009) [2023-12-27 23:14:30,849][106225] Updated weights for policy 1, policy_version 558351 (0.0007) [2023-12-27 23:14:30,890][106226] Updated weights for policy 0, policy_version 556694 (0.0007) [2023-12-27 23:14:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 285515776. Throughput: 0: 9698.9, 1: 10070.9. Samples: 285503556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:31,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.435')] [2023-12-27 23:14:31,568][106226] Updated weights for policy 0, policy_version 556704 (0.0008) [2023-12-27 23:14:31,630][106226] Updated weights for policy 0, policy_version 556714 (0.0008) [2023-12-27 23:14:31,678][106225] Updated weights for policy 1, policy_version 558361 (0.0008) [2023-12-27 23:14:31,695][106226] Updated weights for policy 0, policy_version 556724 (0.0006) [2023-12-27 23:14:31,738][106225] Updated weights for policy 1, policy_version 558371 (0.0007) [2023-12-27 23:14:31,795][106225] Updated weights for policy 1, policy_version 558381 (0.0008) [2023-12-27 23:14:32,356][106226] Updated weights for policy 0, policy_version 556734 (0.0008) [2023-12-27 23:14:32,423][106226] Updated weights for policy 0, policy_version 556744 (0.0008) [2023-12-27 23:14:32,471][106226] Updated weights for policy 0, policy_version 556754 (0.0008) [2023-12-27 23:14:32,569][106225] Updated weights for policy 1, policy_version 558391 (0.0009) [2023-12-27 23:14:32,632][106225] Updated weights for policy 1, policy_version 558401 (0.0009) [2023-12-27 23:14:32,696][106225] Updated weights for policy 1, policy_version 558411 (0.0010) [2023-12-27 23:14:33,207][106226] Updated weights for policy 0, policy_version 556764 (0.0009) [2023-12-27 23:14:33,255][106226] Updated weights for policy 0, policy_version 556774 (0.0008) [2023-12-27 23:14:33,312][106226] Updated weights for policy 0, policy_version 556784 (0.0009) [2023-12-27 23:14:33,355][106225] Updated weights for policy 1, policy_version 558421 (0.0007) [2023-12-27 23:14:33,412][106225] Updated weights for policy 1, policy_version 558431 (0.0005) [2023-12-27 23:14:33,470][106225] Updated weights for policy 1, policy_version 558441 (0.0005) [2023-12-27 23:14:33,945][106226] Updated weights for policy 0, policy_version 556794 (0.0008) [2023-12-27 23:14:33,995][106226] Updated weights for policy 0, policy_version 556804 (0.0005) [2023-12-27 23:14:34,042][106226] Updated weights for policy 0, policy_version 556814 (0.0007) [2023-12-27 23:14:34,089][106226] Updated weights for policy 0, policy_version 556824 (0.0008) [2023-12-27 23:14:34,192][106225] Updated weights for policy 1, policy_version 558451 (0.0007) [2023-12-27 23:14:34,258][106225] Updated weights for policy 1, policy_version 558461 (0.0008) [2023-12-27 23:14:34,316][106225] Updated weights for policy 1, policy_version 558471 (0.0008) [2023-12-27 23:14:34,789][106226] Updated weights for policy 0, policy_version 556834 (0.0010) [2023-12-27 23:14:34,845][106226] Updated weights for policy 0, policy_version 556844 (0.0010) [2023-12-27 23:14:34,896][106226] Updated weights for policy 0, policy_version 556854 (0.0006) [2023-12-27 23:14:35,110][106225] Updated weights for policy 1, policy_version 558481 (0.0008) [2023-12-27 23:14:35,161][106225] Updated weights for policy 1, policy_version 558491 (0.0007) [2023-12-27 23:14:35,212][106225] Updated weights for policy 1, policy_version 558501 (0.0007) [2023-12-27 23:14:35,262][106225] Updated weights for policy 1, policy_version 558511 (0.0008) [2023-12-27 23:14:35,472][106226] Updated weights for policy 0, policy_version 556864 (0.0005) [2023-12-27 23:14:35,525][106226] Updated weights for policy 0, policy_version 556874 (0.0005) [2023-12-27 23:14:35,580][106226] Updated weights for policy 0, policy_version 556884 (0.0005) [2023-12-27 23:14:35,951][106225] Updated weights for policy 1, policy_version 558521 (0.0010) [2023-12-27 23:14:36,017][106225] Updated weights for policy 1, policy_version 558531 (0.0008) [2023-12-27 23:14:36,090][106225] Updated weights for policy 1, policy_version 558541 (0.0008) [2023-12-27 23:14:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 285614080. Throughput: 0: 9750.7, 1: 9959.4. Samples: 285623728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:36,175][105115] Avg episode reward: [(0, '-5.050'), (1, '-5.536')] [2023-12-27 23:14:36,260][106226] Updated weights for policy 0, policy_version 556894 (0.0007) [2023-12-27 23:14:36,315][106226] Updated weights for policy 0, policy_version 556904 (0.0008) [2023-12-27 23:14:36,371][106226] Updated weights for policy 0, policy_version 556914 (0.0008) [2023-12-27 23:14:36,789][106225] Updated weights for policy 1, policy_version 558551 (0.0010) [2023-12-27 23:14:36,843][106225] Updated weights for policy 1, policy_version 558561 (0.0010) [2023-12-27 23:14:36,904][106225] Updated weights for policy 1, policy_version 558571 (0.0007) [2023-12-27 23:14:37,114][106226] Updated weights for policy 0, policy_version 556924 (0.0007) [2023-12-27 23:14:37,183][106226] Updated weights for policy 0, policy_version 556934 (0.0009) [2023-12-27 23:14:37,244][106226] Updated weights for policy 0, policy_version 556944 (0.0011) [2023-12-27 23:14:37,525][106225] Updated weights for policy 1, policy_version 558581 (0.0010) [2023-12-27 23:14:37,585][106225] Updated weights for policy 1, policy_version 558591 (0.0009) [2023-12-27 23:14:37,642][106225] Updated weights for policy 1, policy_version 558601 (0.0009) [2023-12-27 23:14:37,929][106226] Updated weights for policy 0, policy_version 556954 (0.0009) [2023-12-27 23:14:37,974][106226] Updated weights for policy 0, policy_version 556964 (0.0008) [2023-12-27 23:14:38,023][106226] Updated weights for policy 0, policy_version 556974 (0.0007) [2023-12-27 23:14:38,074][106226] Updated weights for policy 0, policy_version 556984 (0.0008) [2023-12-27 23:14:38,348][106225] Updated weights for policy 1, policy_version 558611 (0.0010) [2023-12-27 23:14:38,413][106225] Updated weights for policy 1, policy_version 558621 (0.0009) [2023-12-27 23:14:38,472][106225] Updated weights for policy 1, policy_version 558631 (0.0010) [2023-12-27 23:14:38,827][106226] Updated weights for policy 0, policy_version 556994 (0.0008) [2023-12-27 23:14:38,889][106226] Updated weights for policy 0, policy_version 557004 (0.0008) [2023-12-27 23:14:38,949][106226] Updated weights for policy 0, policy_version 557014 (0.0008) [2023-12-27 23:14:39,151][106225] Updated weights for policy 1, policy_version 558641 (0.0010) [2023-12-27 23:14:39,212][106225] Updated weights for policy 1, policy_version 558651 (0.0007) [2023-12-27 23:14:39,282][106225] Updated weights for policy 1, policy_version 558661 (0.0008) [2023-12-27 23:14:39,343][106225] Updated weights for policy 1, policy_version 558671 (0.0010) [2023-12-27 23:14:39,748][106226] Updated weights for policy 0, policy_version 557024 (0.0008) [2023-12-27 23:14:39,816][106226] Updated weights for policy 0, policy_version 557034 (0.0009) [2023-12-27 23:14:39,882][106226] Updated weights for policy 0, policy_version 557044 (0.0009) [2023-12-27 23:14:40,099][106225] Updated weights for policy 1, policy_version 558681 (0.0007) [2023-12-27 23:14:40,154][106225] Updated weights for policy 1, policy_version 558691 (0.0007) [2023-12-27 23:14:40,211][106225] Updated weights for policy 1, policy_version 558701 (0.0009) [2023-12-27 23:14:40,586][106226] Updated weights for policy 0, policy_version 557054 (0.0007) [2023-12-27 23:14:40,646][106226] Updated weights for policy 0, policy_version 557064 (0.0006) [2023-12-27 23:14:40,707][106226] Updated weights for policy 0, policy_version 557074 (0.0007) [2023-12-27 23:14:40,880][106225] Updated weights for policy 1, policy_version 558711 (0.0007) [2023-12-27 23:14:40,933][106225] Updated weights for policy 1, policy_version 558721 (0.0009) [2023-12-27 23:14:40,984][106225] Updated weights for policy 1, policy_version 558731 (0.0007) [2023-12-27 23:14:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 285712384. Throughput: 0: 9782.4, 1: 9909.9. Samples: 285681928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:41,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.603')] [2023-12-27 23:14:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000558736_143065088.pth... [2023-12-27 23:14:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000557080_142647296.pth... [2023-12-27 23:14:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000557584_142770176.pth [2023-12-27 23:14:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000555928_142352384.pth [2023-12-27 23:14:41,436][106226] Updated weights for policy 0, policy_version 557084 (0.0007) [2023-12-27 23:14:41,495][106226] Updated weights for policy 0, policy_version 557094 (0.0008) [2023-12-27 23:14:41,560][106226] Updated weights for policy 0, policy_version 557104 (0.0008) [2023-12-27 23:14:41,698][106225] Updated weights for policy 1, policy_version 558741 (0.0007) [2023-12-27 23:14:41,773][106225] Updated weights for policy 1, policy_version 558751 (0.0009) [2023-12-27 23:14:41,838][106225] Updated weights for policy 1, policy_version 558761 (0.0010) [2023-12-27 23:14:42,322][106226] Updated weights for policy 0, policy_version 557114 (0.0009) [2023-12-27 23:14:42,394][106226] Updated weights for policy 0, policy_version 557124 (0.0007) [2023-12-27 23:14:42,456][106226] Updated weights for policy 0, policy_version 557134 (0.0008) [2023-12-27 23:14:42,509][106226] Updated weights for policy 0, policy_version 557144 (0.0007) [2023-12-27 23:14:42,563][106225] Updated weights for policy 1, policy_version 558771 (0.0010) [2023-12-27 23:14:42,624][106225] Updated weights for policy 1, policy_version 558781 (0.0010) [2023-12-27 23:14:42,686][106225] Updated weights for policy 1, policy_version 558791 (0.0010) [2023-12-27 23:14:43,254][106226] Updated weights for policy 0, policy_version 557154 (0.0009) [2023-12-27 23:14:43,312][106226] Updated weights for policy 0, policy_version 557164 (0.0009) [2023-12-27 23:14:43,343][106225] Updated weights for policy 1, policy_version 558801 (0.0010) [2023-12-27 23:14:43,378][106226] Updated weights for policy 0, policy_version 557174 (0.0009) [2023-12-27 23:14:43,403][106225] Updated weights for policy 1, policy_version 558811 (0.0005) [2023-12-27 23:14:43,463][106225] Updated weights for policy 1, policy_version 558821 (0.0007) [2023-12-27 23:14:43,516][106225] Updated weights for policy 1, policy_version 558831 (0.0010) [2023-12-27 23:14:44,135][106226] Updated weights for policy 0, policy_version 557184 (0.0008) [2023-12-27 23:14:44,141][106225] Updated weights for policy 1, policy_version 558841 (0.0010) [2023-12-27 23:14:44,190][106226] Updated weights for policy 0, policy_version 557194 (0.0006) [2023-12-27 23:14:44,199][106225] Updated weights for policy 1, policy_version 558851 (0.0010) [2023-12-27 23:14:44,251][106226] Updated weights for policy 0, policy_version 557204 (0.0005) [2023-12-27 23:14:44,260][106225] Updated weights for policy 1, policy_version 558861 (0.0010) [2023-12-27 23:14:44,853][106225] Updated weights for policy 1, policy_version 558871 (0.0011) [2023-12-27 23:14:44,910][106225] Updated weights for policy 1, policy_version 558881 (0.0010) [2023-12-27 23:14:44,975][106225] Updated weights for policy 1, policy_version 558891 (0.0010) [2023-12-27 23:14:45,045][106226] Updated weights for policy 0, policy_version 557214 (0.0007) [2023-12-27 23:14:45,101][106226] Updated weights for policy 0, policy_version 557224 (0.0008) [2023-12-27 23:14:45,160][106226] Updated weights for policy 0, policy_version 557234 (0.0008) [2023-12-27 23:14:45,601][106225] Updated weights for policy 1, policy_version 558901 (0.0010) [2023-12-27 23:14:45,665][106225] Updated weights for policy 1, policy_version 558911 (0.0010) [2023-12-27 23:14:45,716][106225] Updated weights for policy 1, policy_version 558921 (0.0010) [2023-12-27 23:14:45,926][106226] Updated weights for policy 0, policy_version 557244 (0.0008) [2023-12-27 23:14:45,987][106226] Updated weights for policy 0, policy_version 557254 (0.0005) [2023-12-27 23:14:46,042][106226] Updated weights for policy 0, policy_version 557264 (0.0005) [2023-12-27 23:14:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 285810688. Throughput: 0: 9773.8, 1: 9938.5. Samples: 285798172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:46,175][105115] Avg episode reward: [(0, '-5.343'), (1, '-5.389')] [2023-12-27 23:14:46,411][106225] Updated weights for policy 1, policy_version 558931 (0.0009) [2023-12-27 23:14:46,471][106225] Updated weights for policy 1, policy_version 558941 (0.0005) [2023-12-27 23:14:46,532][106225] Updated weights for policy 1, policy_version 558951 (0.0005) [2023-12-27 23:14:46,783][106226] Updated weights for policy 0, policy_version 557274 (0.0008) [2023-12-27 23:14:46,843][106226] Updated weights for policy 0, policy_version 557284 (0.0007) [2023-12-27 23:14:46,906][106226] Updated weights for policy 0, policy_version 557294 (0.0007) [2023-12-27 23:14:46,963][106226] Updated weights for policy 0, policy_version 557304 (0.0008) [2023-12-27 23:14:47,111][106225] Updated weights for policy 1, policy_version 558961 (0.0006) [2023-12-27 23:14:47,174][106225] Updated weights for policy 1, policy_version 558971 (0.0010) [2023-12-27 23:14:47,234][106225] Updated weights for policy 1, policy_version 558981 (0.0010) [2023-12-27 23:14:47,294][106225] Updated weights for policy 1, policy_version 558991 (0.0010) [2023-12-27 23:14:47,700][106226] Updated weights for policy 0, policy_version 557314 (0.0009) [2023-12-27 23:14:47,764][106226] Updated weights for policy 0, policy_version 557324 (0.0006) [2023-12-27 23:14:47,825][106226] Updated weights for policy 0, policy_version 557334 (0.0005) [2023-12-27 23:14:47,953][106225] Updated weights for policy 1, policy_version 559001 (0.0006) [2023-12-27 23:14:48,006][106225] Updated weights for policy 1, policy_version 559011 (0.0006) [2023-12-27 23:14:48,053][106225] Updated weights for policy 1, policy_version 559021 (0.0005) [2023-12-27 23:14:48,545][106226] Updated weights for policy 0, policy_version 557344 (0.0006) [2023-12-27 23:14:48,598][106226] Updated weights for policy 0, policy_version 557354 (0.0009) [2023-12-27 23:14:48,650][106226] Updated weights for policy 0, policy_version 557364 (0.0007) [2023-12-27 23:14:48,673][106225] Updated weights for policy 1, policy_version 559031 (0.0008) [2023-12-27 23:14:48,729][106225] Updated weights for policy 1, policy_version 559041 (0.0005) [2023-12-27 23:14:48,784][106225] Updated weights for policy 1, policy_version 559051 (0.0007) [2023-12-27 23:14:49,411][106225] Updated weights for policy 1, policy_version 559061 (0.0009) [2023-12-27 23:14:49,438][106226] Updated weights for policy 0, policy_version 557374 (0.0007) [2023-12-27 23:14:49,470][106225] Updated weights for policy 1, policy_version 559071 (0.0007) [2023-12-27 23:14:49,502][106226] Updated weights for policy 0, policy_version 557384 (0.0007) [2023-12-27 23:14:49,525][106225] Updated weights for policy 1, policy_version 559081 (0.0007) [2023-12-27 23:14:49,567][106226] Updated weights for policy 0, policy_version 557394 (0.0011) [2023-12-27 23:14:50,255][106226] Updated weights for policy 0, policy_version 557404 (0.0010) [2023-12-27 23:14:50,306][106225] Updated weights for policy 1, policy_version 559091 (0.0007) [2023-12-27 23:14:50,317][106226] Updated weights for policy 0, policy_version 557414 (0.0011) [2023-12-27 23:14:50,372][106225] Updated weights for policy 1, policy_version 559101 (0.0008) [2023-12-27 23:14:50,375][106226] Updated weights for policy 0, policy_version 557424 (0.0010) [2023-12-27 23:14:50,430][106225] Updated weights for policy 1, policy_version 559111 (0.0008) [2023-12-27 23:14:51,123][106226] Updated weights for policy 0, policy_version 557434 (0.0010) [2023-12-27 23:14:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 285900800. Throughput: 0: 9726.5, 1: 9938.0. Samples: 285916264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:51,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.548')] [2023-12-27 23:14:51,185][106225] Updated weights for policy 1, policy_version 559121 (0.0008) [2023-12-27 23:14:51,190][106226] Updated weights for policy 0, policy_version 557444 (0.0008) [2023-12-27 23:14:51,242][106225] Updated weights for policy 1, policy_version 559131 (0.0007) [2023-12-27 23:14:51,256][106226] Updated weights for policy 0, policy_version 557454 (0.0008) [2023-12-27 23:14:51,303][106225] Updated weights for policy 1, policy_version 559141 (0.0009) [2023-12-27 23:14:51,311][106226] Updated weights for policy 0, policy_version 557464 (0.0008) [2023-12-27 23:14:51,369][106225] Updated weights for policy 1, policy_version 559151 (0.0011) [2023-12-27 23:14:52,026][106226] Updated weights for policy 0, policy_version 557474 (0.0008) [2023-12-27 23:14:52,090][106226] Updated weights for policy 0, policy_version 557484 (0.0009) [2023-12-27 23:14:52,149][106226] Updated weights for policy 0, policy_version 557494 (0.0009) [2023-12-27 23:14:52,189][106225] Updated weights for policy 1, policy_version 559161 (0.0007) [2023-12-27 23:14:52,258][106225] Updated weights for policy 1, policy_version 559171 (0.0008) [2023-12-27 23:14:52,327][106225] Updated weights for policy 1, policy_version 559181 (0.0006) [2023-12-27 23:14:52,875][106226] Updated weights for policy 0, policy_version 557504 (0.0009) [2023-12-27 23:14:52,937][106226] Updated weights for policy 0, policy_version 557514 (0.0009) [2023-12-27 23:14:52,984][106225] Updated weights for policy 1, policy_version 559191 (0.0008) [2023-12-27 23:14:52,991][106226] Updated weights for policy 0, policy_version 557524 (0.0007) [2023-12-27 23:14:53,039][106225] Updated weights for policy 1, policy_version 559201 (0.0007) [2023-12-27 23:14:53,103][106225] Updated weights for policy 1, policy_version 559211 (0.0008) [2023-12-27 23:14:53,722][106225] Updated weights for policy 1, policy_version 559221 (0.0008) [2023-12-27 23:14:53,755][106226] Updated weights for policy 0, policy_version 557534 (0.0008) [2023-12-27 23:14:53,776][106225] Updated weights for policy 1, policy_version 559231 (0.0005) [2023-12-27 23:14:53,810][106226] Updated weights for policy 0, policy_version 557544 (0.0007) [2023-12-27 23:14:53,827][106225] Updated weights for policy 1, policy_version 559241 (0.0005) [2023-12-27 23:14:53,867][106226] Updated weights for policy 0, policy_version 557554 (0.0008) [2023-12-27 23:14:54,527][106225] Updated weights for policy 1, policy_version 559251 (0.0008) [2023-12-27 23:14:54,581][106225] Updated weights for policy 1, policy_version 559261 (0.0008) [2023-12-27 23:14:54,617][106226] Updated weights for policy 0, policy_version 557564 (0.0009) [2023-12-27 23:14:54,633][106225] Updated weights for policy 1, policy_version 559271 (0.0008) [2023-12-27 23:14:54,683][106226] Updated weights for policy 0, policy_version 557574 (0.0007) [2023-12-27 23:14:54,735][106226] Updated weights for policy 0, policy_version 557584 (0.0009) [2023-12-27 23:14:55,268][106225] Updated weights for policy 1, policy_version 559281 (0.0006) [2023-12-27 23:14:55,324][106225] Updated weights for policy 1, policy_version 559291 (0.0005) [2023-12-27 23:14:55,379][106225] Updated weights for policy 1, policy_version 559301 (0.0009) [2023-12-27 23:14:55,435][106225] Updated weights for policy 1, policy_version 559311 (0.0010) [2023-12-27 23:14:55,470][106226] Updated weights for policy 0, policy_version 557594 (0.0008) [2023-12-27 23:14:55,526][106226] Updated weights for policy 0, policy_version 557604 (0.0005) [2023-12-27 23:14:55,579][106226] Updated weights for policy 0, policy_version 557614 (0.0005) [2023-12-27 23:14:55,631][106226] Updated weights for policy 0, policy_version 557624 (0.0005) [2023-12-27 23:14:56,146][106225] Updated weights for policy 1, policy_version 559321 (0.0006) [2023-12-27 23:14:56,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.8, 300 sec: 19716.3). Total num frames: 285999104. Throughput: 0: 9644.3, 1: 9906.8. Samples: 285973552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:14:56,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-5.756')] [2023-12-27 23:14:56,207][106225] Updated weights for policy 1, policy_version 559331 (0.0006) [2023-12-27 23:14:56,225][106226] Updated weights for policy 0, policy_version 557634 (0.0008) [2023-12-27 23:14:56,264][106225] Updated weights for policy 1, policy_version 559341 (0.0006) [2023-12-27 23:14:56,278][106226] Updated weights for policy 0, policy_version 557644 (0.0008) [2023-12-27 23:14:56,279][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000559344_143220736.pth... [2023-12-27 23:14:56,283][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000558160_142917632.pth [2023-12-27 23:14:56,331][106226] Updated weights for policy 0, policy_version 557654 (0.0005) [2023-12-27 23:14:56,339][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000557656_142794752.pth... [2023-12-27 23:14:56,342][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000556504_142499840.pth [2023-12-27 23:14:56,759][106225] Updated weights for policy 1, policy_version 559351 (0.0007) [2023-12-27 23:14:56,807][106225] Updated weights for policy 1, policy_version 559361 (0.0009) [2023-12-27 23:14:56,862][106225] Updated weights for policy 1, policy_version 559371 (0.0009) [2023-12-27 23:14:57,056][106226] Updated weights for policy 0, policy_version 557664 (0.0007) [2023-12-27 23:14:57,108][106226] Updated weights for policy 0, policy_version 557674 (0.0008) [2023-12-27 23:14:57,165][106226] Updated weights for policy 0, policy_version 557684 (0.0008) [2023-12-27 23:14:57,602][106225] Updated weights for policy 1, policy_version 559381 (0.0010) [2023-12-27 23:14:57,651][106225] Updated weights for policy 1, policy_version 559391 (0.0010) [2023-12-27 23:14:57,693][106225] Updated weights for policy 1, policy_version 559401 (0.0010) [2023-12-27 23:14:57,889][106226] Updated weights for policy 0, policy_version 557694 (0.0007) [2023-12-27 23:14:57,937][106226] Updated weights for policy 0, policy_version 557704 (0.0007) [2023-12-27 23:14:57,983][106226] Updated weights for policy 0, policy_version 557714 (0.0008) [2023-12-27 23:14:58,439][106225] Updated weights for policy 1, policy_version 559411 (0.0010) [2023-12-27 23:14:58,502][106225] Updated weights for policy 1, policy_version 559421 (0.0010) [2023-12-27 23:14:58,562][106225] Updated weights for policy 1, policy_version 559431 (0.0008) [2023-12-27 23:14:58,776][106226] Updated weights for policy 0, policy_version 557724 (0.0008) [2023-12-27 23:14:58,847][106226] Updated weights for policy 0, policy_version 557734 (0.0009) [2023-12-27 23:14:58,921][106226] Updated weights for policy 0, policy_version 557744 (0.0008) [2023-12-27 23:14:59,426][106225] Updated weights for policy 1, policy_version 559441 (0.0008) [2023-12-27 23:14:59,486][106225] Updated weights for policy 1, policy_version 559451 (0.0008) [2023-12-27 23:14:59,540][106225] Updated weights for policy 1, policy_version 559461 (0.0007) [2023-12-27 23:14:59,601][106225] Updated weights for policy 1, policy_version 559471 (0.0007) [2023-12-27 23:14:59,681][106226] Updated weights for policy 0, policy_version 557754 (0.0008) [2023-12-27 23:14:59,750][106226] Updated weights for policy 0, policy_version 557764 (0.0010) [2023-12-27 23:14:59,814][106226] Updated weights for policy 0, policy_version 557774 (0.0010) [2023-12-27 23:14:59,882][106226] Updated weights for policy 0, policy_version 557784 (0.0009) [2023-12-27 23:15:00,328][106225] Updated weights for policy 1, policy_version 559481 (0.0010) [2023-12-27 23:15:00,380][106225] Updated weights for policy 1, policy_version 559491 (0.0010) [2023-12-27 23:15:00,439][106225] Updated weights for policy 1, policy_version 559501 (0.0010) [2023-12-27 23:15:00,554][106226] Updated weights for policy 0, policy_version 557794 (0.0011) [2023-12-27 23:15:00,611][106226] Updated weights for policy 0, policy_version 557805 (0.0009) [2023-12-27 23:15:00,663][106226] Updated weights for policy 0, policy_version 557815 (0.0006) [2023-12-27 23:15:01,076][106225] Updated weights for policy 1, policy_version 559511 (0.0007) [2023-12-27 23:15:01,142][106225] Updated weights for policy 1, policy_version 559521 (0.0007) [2023-12-27 23:15:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 286097408. Throughput: 0: 9687.3, 1: 9929.7. Samples: 286091700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:01,175][105115] Avg episode reward: [(0, '-5.040'), (1, '-5.429')] [2023-12-27 23:15:01,213][106225] Updated weights for policy 1, policy_version 559531 (0.0007) [2023-12-27 23:15:01,395][106226] Updated weights for policy 0, policy_version 557825 (0.0009) [2023-12-27 23:15:01,448][106226] Updated weights for policy 0, policy_version 557835 (0.0008) [2023-12-27 23:15:01,501][106226] Updated weights for policy 0, policy_version 557845 (0.0008) [2023-12-27 23:15:01,936][106225] Updated weights for policy 1, policy_version 559541 (0.0008) [2023-12-27 23:15:01,989][106225] Updated weights for policy 1, policy_version 559551 (0.0008) [2023-12-27 23:15:02,050][106225] Updated weights for policy 1, policy_version 559561 (0.0008) [2023-12-27 23:15:02,224][106226] Updated weights for policy 0, policy_version 557855 (0.0009) [2023-12-27 23:15:02,289][106226] Updated weights for policy 0, policy_version 557865 (0.0006) [2023-12-27 23:15:02,353][106226] Updated weights for policy 0, policy_version 557875 (0.0011) [2023-12-27 23:15:02,833][106225] Updated weights for policy 1, policy_version 559571 (0.0008) [2023-12-27 23:15:02,892][106225] Updated weights for policy 1, policy_version 559581 (0.0005) [2023-12-27 23:15:02,949][106225] Updated weights for policy 1, policy_version 559591 (0.0007) [2023-12-27 23:15:02,958][106226] Updated weights for policy 0, policy_version 557885 (0.0011) [2023-12-27 23:15:03,017][106226] Updated weights for policy 0, policy_version 557895 (0.0010) [2023-12-27 23:15:03,073][106226] Updated weights for policy 0, policy_version 557905 (0.0008) [2023-12-27 23:15:03,677][106225] Updated weights for policy 1, policy_version 559601 (0.0006) [2023-12-27 23:15:03,682][106226] Updated weights for policy 0, policy_version 557915 (0.0006) [2023-12-27 23:15:03,736][106225] Updated weights for policy 1, policy_version 559611 (0.0005) [2023-12-27 23:15:03,741][106226] Updated weights for policy 0, policy_version 557925 (0.0010) [2023-12-27 23:15:03,792][106225] Updated weights for policy 1, policy_version 559621 (0.0005) [2023-12-27 23:15:03,804][106226] Updated weights for policy 0, policy_version 557935 (0.0010) [2023-12-27 23:15:03,850][106225] Updated weights for policy 1, policy_version 559631 (0.0007) [2023-12-27 23:15:04,520][106226] Updated weights for policy 0, policy_version 557945 (0.0011) [2023-12-27 23:15:04,522][106225] Updated weights for policy 1, policy_version 559641 (0.0007) [2023-12-27 23:15:04,572][106225] Updated weights for policy 1, policy_version 559651 (0.0009) [2023-12-27 23:15:04,581][106226] Updated weights for policy 0, policy_version 557955 (0.0011) [2023-12-27 23:15:04,632][106226] Updated weights for policy 0, policy_version 557965 (0.0010) [2023-12-27 23:15:04,633][106225] Updated weights for policy 1, policy_version 559661 (0.0005) [2023-12-27 23:15:04,682][106226] Updated weights for policy 0, policy_version 557975 (0.0010) [2023-12-27 23:15:05,305][106225] Updated weights for policy 1, policy_version 559671 (0.0005) [2023-12-27 23:15:05,370][106225] Updated weights for policy 1, policy_version 559681 (0.0006) [2023-12-27 23:15:05,396][106226] Updated weights for policy 0, policy_version 557985 (0.0006) [2023-12-27 23:15:05,427][106225] Updated weights for policy 1, policy_version 559691 (0.0006) [2023-12-27 23:15:05,450][106226] Updated weights for policy 0, policy_version 557995 (0.0005) [2023-12-27 23:15:05,502][106226] Updated weights for policy 0, policy_version 558005 (0.0008) [2023-12-27 23:15:06,002][106225] Updated weights for policy 1, policy_version 559701 (0.0010) [2023-12-27 23:15:06,060][106225] Updated weights for policy 1, policy_version 559711 (0.0010) [2023-12-27 23:15:06,063][106226] Updated weights for policy 0, policy_version 558015 (0.0006) [2023-12-27 23:15:06,111][106225] Updated weights for policy 1, policy_version 559721 (0.0006) [2023-12-27 23:15:06,149][106226] Updated weights for policy 0, policy_version 558025 (0.0009) [2023-12-27 23:15:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 286203904. Throughput: 0: 9754.2, 1: 9971.7. Samples: 286214400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:06,175][105115] Avg episode reward: [(0, '-5.113'), (1, '-5.328')] [2023-12-27 23:15:06,211][106226] Updated weights for policy 0, policy_version 558035 (0.0010) [2023-12-27 23:15:06,788][106225] Updated weights for policy 1, policy_version 559731 (0.0008) [2023-12-27 23:15:06,845][106225] Updated weights for policy 1, policy_version 559741 (0.0010) [2023-12-27 23:15:06,895][106225] Updated weights for policy 1, policy_version 559751 (0.0009) [2023-12-27 23:15:06,902][106226] Updated weights for policy 0, policy_version 558045 (0.0011) [2023-12-27 23:15:06,956][106226] Updated weights for policy 0, policy_version 558055 (0.0011) [2023-12-27 23:15:07,010][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000005 [2023-12-27 23:15:07,608][106225] Updated weights for policy 1, policy_version 559761 (0.0010) [2023-12-27 23:15:07,662][106225] Updated weights for policy 1, policy_version 559771 (0.0007) [2023-12-27 23:15:07,719][106225] Updated weights for policy 1, policy_version 559781 (0.0008) [2023-12-27 23:15:07,722][106226] Updated weights for policy 0, policy_version 558065 (0.0010) [2023-12-27 23:15:07,776][106225] Updated weights for policy 1, policy_version 559791 (0.0006) [2023-12-27 23:15:07,783][106226] Updated weights for policy 0, policy_version 558075 (0.0011) [2023-12-27 23:15:07,838][106226] Updated weights for policy 0, policy_version 558085 (0.0011) [2023-12-27 23:15:07,886][106226] Updated weights for policy 0, policy_version 558095 (0.0011) [2023-12-27 23:15:08,475][106225] Updated weights for policy 1, policy_version 559801 (0.0006) [2023-12-27 23:15:08,541][106225] Updated weights for policy 1, policy_version 559811 (0.0006) [2023-12-27 23:15:08,604][106225] Updated weights for policy 1, policy_version 559821 (0.0007) [2023-12-27 23:15:08,650][106226] Updated weights for policy 0, policy_version 558105 (0.0008) [2023-12-27 23:15:08,713][106226] Updated weights for policy 0, policy_version 558115 (0.0011) [2023-12-27 23:15:08,778][106226] Updated weights for policy 0, policy_version 558125 (0.0007) [2023-12-27 23:15:09,350][106225] Updated weights for policy 1, policy_version 559831 (0.0008) [2023-12-27 23:15:09,435][106225] Updated weights for policy 1, policy_version 559841 (0.0008) [2023-12-27 23:15:09,463][106226] Updated weights for policy 0, policy_version 558135 (0.0007) [2023-12-27 23:15:09,497][106225] Updated weights for policy 1, policy_version 559851 (0.0007) [2023-12-27 23:15:09,527][106226] Updated weights for policy 0, policy_version 558145 (0.0006) [2023-12-27 23:15:09,583][106226] Updated weights for policy 0, policy_version 558155 (0.0008) [2023-12-27 23:15:10,222][106225] Updated weights for policy 1, policy_version 559861 (0.0008) [2023-12-27 23:15:10,285][106225] Updated weights for policy 1, policy_version 559871 (0.0006) [2023-12-27 23:15:10,351][106225] Updated weights for policy 1, policy_version 559881 (0.0007) [2023-12-27 23:15:10,404][106226] Updated weights for policy 0, policy_version 558165 (0.0008) [2023-12-27 23:15:10,468][106226] Updated weights for policy 0, policy_version 558175 (0.0009) [2023-12-27 23:15:10,530][106226] Updated weights for policy 0, policy_version 558185 (0.0008) [2023-12-27 23:15:10,988][106225] Updated weights for policy 1, policy_version 559891 (0.0008) [2023-12-27 23:15:11,074][106225] Updated weights for policy 1, policy_version 559901 (0.0010) [2023-12-27 23:15:11,143][106225] Updated weights for policy 1, policy_version 559911 (0.0009) [2023-12-27 23:15:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 286294016. Throughput: 0: 9762.6, 1: 9985.4. Samples: 286273444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:11,175][105115] Avg episode reward: [(0, '-5.447'), (1, '-5.630')] [2023-12-27 23:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000558192_142934016.pth... [2023-12-27 23:15:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000557080_142647296.pth [2023-12-27 23:15:11,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000559920_143368192.pth... [2023-12-27 23:15:11,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000558736_143065088.pth [2023-12-27 23:15:11,257][106226] Updated weights for policy 0, policy_version 558195 (0.0007) [2023-12-27 23:15:11,321][106226] Updated weights for policy 0, policy_version 558205 (0.0008) [2023-12-27 23:15:11,389][106226] Updated weights for policy 0, policy_version 558215 (0.0009) [2023-12-27 23:15:11,951][106225] Updated weights for policy 1, policy_version 559921 (0.0010) [2023-12-27 23:15:12,013][106225] Updated weights for policy 1, policy_version 559931 (0.0009) [2023-12-27 23:15:12,081][106225] Updated weights for policy 1, policy_version 559941 (0.0010) [2023-12-27 23:15:12,144][106225] Updated weights for policy 1, policy_version 559951 (0.0011) [2023-12-27 23:15:12,198][106226] Updated weights for policy 0, policy_version 558225 (0.0006) [2023-12-27 23:15:12,252][106226] Updated weights for policy 0, policy_version 558235 (0.0008) [2023-12-27 23:15:12,318][106226] Updated weights for policy 0, policy_version 558245 (0.0008) [2023-12-27 23:15:12,386][106226] Updated weights for policy 0, policy_version 558255 (0.0008) [2023-12-27 23:15:12,802][106225] Updated weights for policy 1, policy_version 559961 (0.0010) [2023-12-27 23:15:12,860][106225] Updated weights for policy 1, policy_version 559971 (0.0008) [2023-12-27 23:15:12,916][106225] Updated weights for policy 1, policy_version 559981 (0.0006) [2023-12-27 23:15:12,997][106226] Updated weights for policy 0, policy_version 558265 (0.0010) [2023-12-27 23:15:13,051][106226] Updated weights for policy 0, policy_version 558275 (0.0010) [2023-12-27 23:15:13,109][106226] Updated weights for policy 0, policy_version 558285 (0.0011) [2023-12-27 23:15:13,609][106225] Updated weights for policy 1, policy_version 559991 (0.0009) [2023-12-27 23:15:13,674][106225] Updated weights for policy 1, policy_version 560001 (0.0010) [2023-12-27 23:15:13,682][106226] Updated weights for policy 0, policy_version 558295 (0.0010) [2023-12-27 23:15:13,719][106225] Updated weights for policy 1, policy_version 560011 (0.0010) [2023-12-27 23:15:13,739][106226] Updated weights for policy 0, policy_version 558305 (0.0010) [2023-12-27 23:15:13,789][106226] Updated weights for policy 0, policy_version 558315 (0.0009) [2023-12-27 23:15:14,453][106225] Updated weights for policy 1, policy_version 560021 (0.0010) [2023-12-27 23:15:14,488][106226] Updated weights for policy 0, policy_version 558325 (0.0008) [2023-12-27 23:15:14,514][106225] Updated weights for policy 1, policy_version 560031 (0.0010) [2023-12-27 23:15:14,549][106226] Updated weights for policy 0, policy_version 558335 (0.0011) [2023-12-27 23:15:14,576][106225] Updated weights for policy 1, policy_version 560041 (0.0010) [2023-12-27 23:15:14,615][106226] Updated weights for policy 0, policy_version 558345 (0.0009) [2023-12-27 23:15:15,292][106226] Updated weights for policy 0, policy_version 558355 (0.0011) [2023-12-27 23:15:15,306][106225] Updated weights for policy 1, policy_version 560051 (0.0007) [2023-12-27 23:15:15,346][106226] Updated weights for policy 0, policy_version 558365 (0.0011) [2023-12-27 23:15:15,361][106225] Updated weights for policy 1, policy_version 560061 (0.0010) [2023-12-27 23:15:15,393][106226] Updated weights for policy 0, policy_version 558375 (0.0010) [2023-12-27 23:15:15,420][106225] Updated weights for policy 1, policy_version 560071 (0.0010) [2023-12-27 23:15:16,033][106225] Updated weights for policy 1, policy_version 560081 (0.0008) [2023-12-27 23:15:16,052][106226] Updated weights for policy 0, policy_version 558385 (0.0010) [2023-12-27 23:15:16,091][106225] Updated weights for policy 1, policy_version 560091 (0.0005) [2023-12-27 23:15:16,106][106226] Updated weights for policy 0, policy_version 558395 (0.0011) [2023-12-27 23:15:16,144][106225] Updated weights for policy 1, policy_version 560101 (0.0005) [2023-12-27 23:15:16,156][106226] Updated weights for policy 0, policy_version 558405 (0.0010) [2023-12-27 23:15:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.4, 300 sec: 19688.6). Total num frames: 286392320. Throughput: 0: 9751.7, 1: 9933.4. Samples: 286389388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:16,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-5.333')] [2023-12-27 23:15:16,196][106225] Updated weights for policy 1, policy_version 560111 (0.0007) [2023-12-27 23:15:16,219][106226] Updated weights for policy 0, policy_version 558415 (0.0006) [2023-12-27 23:15:16,728][106225] Updated weights for policy 1, policy_version 560121 (0.0006) [2023-12-27 23:15:16,794][106225] Updated weights for policy 1, policy_version 560131 (0.0007) [2023-12-27 23:15:16,852][106225] Updated weights for policy 1, policy_version 560141 (0.0008) [2023-12-27 23:15:16,904][106226] Updated weights for policy 0, policy_version 558425 (0.0010) [2023-12-27 23:15:16,955][106226] Updated weights for policy 0, policy_version 558435 (0.0011) [2023-12-27 23:15:17,012][106226] Updated weights for policy 0, policy_version 558445 (0.0011) [2023-12-27 23:15:17,412][106225] Updated weights for policy 1, policy_version 560151 (0.0005) [2023-12-27 23:15:17,465][106225] Updated weights for policy 1, policy_version 560161 (0.0005) [2023-12-27 23:15:17,522][106225] Updated weights for policy 1, policy_version 560171 (0.0005) [2023-12-27 23:15:17,653][106226] Updated weights for policy 0, policy_version 558455 (0.0007) [2023-12-27 23:15:17,707][106226] Updated weights for policy 0, policy_version 558465 (0.0006) [2023-12-27 23:15:17,777][106226] Updated weights for policy 0, policy_version 558475 (0.0005) [2023-12-27 23:15:18,127][106225] Updated weights for policy 1, policy_version 560181 (0.0006) [2023-12-27 23:15:18,192][106225] Updated weights for policy 1, policy_version 560191 (0.0008) [2023-12-27 23:15:18,253][106225] Updated weights for policy 1, policy_version 560201 (0.0009) [2023-12-27 23:15:18,359][106226] Updated weights for policy 0, policy_version 558485 (0.0007) [2023-12-27 23:15:18,420][106226] Updated weights for policy 0, policy_version 558495 (0.0010) [2023-12-27 23:15:18,487][106226] Updated weights for policy 0, policy_version 558505 (0.0007) [2023-12-27 23:15:18,895][106225] Updated weights for policy 1, policy_version 560211 (0.0009) [2023-12-27 23:15:18,950][106225] Updated weights for policy 1, policy_version 560221 (0.0007) [2023-12-27 23:15:19,007][106225] Updated weights for policy 1, policy_version 560231 (0.0009) [2023-12-27 23:15:19,105][106226] Updated weights for policy 0, policy_version 558515 (0.0005) [2023-12-27 23:15:19,164][106226] Updated weights for policy 0, policy_version 558525 (0.0005) [2023-12-27 23:15:19,214][106226] Updated weights for policy 0, policy_version 558535 (0.0006) [2023-12-27 23:15:19,714][106225] Updated weights for policy 1, policy_version 560241 (0.0009) [2023-12-27 23:15:19,783][106225] Updated weights for policy 1, policy_version 560251 (0.0008) [2023-12-27 23:15:19,855][106225] Updated weights for policy 1, policy_version 560261 (0.0007) [2023-12-27 23:15:19,909][106226] Updated weights for policy 0, policy_version 558545 (0.0009) [2023-12-27 23:15:19,911][106225] Updated weights for policy 1, policy_version 560271 (0.0006) [2023-12-27 23:15:19,973][106226] Updated weights for policy 0, policy_version 558555 (0.0009) [2023-12-27 23:15:20,033][106226] Updated weights for policy 0, policy_version 558565 (0.0008) [2023-12-27 23:15:20,095][106226] Updated weights for policy 0, policy_version 558575 (0.0011) [2023-12-27 23:15:20,593][106225] Updated weights for policy 1, policy_version 560281 (0.0009) [2023-12-27 23:15:20,649][106225] Updated weights for policy 1, policy_version 560291 (0.0009) [2023-12-27 23:15:20,698][106225] Updated weights for policy 1, policy_version 560301 (0.0008) [2023-12-27 23:15:20,829][106226] Updated weights for policy 0, policy_version 558585 (0.0008) [2023-12-27 23:15:20,892][106226] Updated weights for policy 0, policy_version 558595 (0.0008) [2023-12-27 23:15:20,952][106226] Updated weights for policy 0, policy_version 558605 (0.0008) [2023-12-27 23:15:21,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 286507008. Throughput: 0: 9714.6, 1: 10081.7. Samples: 286514560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:21,175][105115] Avg episode reward: [(0, '-5.072'), (1, '-5.146')] [2023-12-27 23:15:21,432][106225] Updated weights for policy 1, policy_version 560311 (0.0007) [2023-12-27 23:15:21,494][106225] Updated weights for policy 1, policy_version 560321 (0.0008) [2023-12-27 23:15:21,558][106225] Updated weights for policy 1, policy_version 560331 (0.0006) [2023-12-27 23:15:21,705][106226] Updated weights for policy 0, policy_version 558615 (0.0010) [2023-12-27 23:15:21,786][106226] Updated weights for policy 0, policy_version 558625 (0.0009) [2023-12-27 23:15:21,855][106226] Updated weights for policy 0, policy_version 558635 (0.0007) [2023-12-27 23:15:22,256][106225] Updated weights for policy 1, policy_version 560341 (0.0006) [2023-12-27 23:15:22,325][106225] Updated weights for policy 1, policy_version 560351 (0.0007) [2023-12-27 23:15:22,393][106225] Updated weights for policy 1, policy_version 560361 (0.0008) [2023-12-27 23:15:22,592][106226] Updated weights for policy 0, policy_version 558645 (0.0008) [2023-12-27 23:15:22,650][106226] Updated weights for policy 0, policy_version 558655 (0.0011) [2023-12-27 23:15:22,711][106226] Updated weights for policy 0, policy_version 558665 (0.0011) [2023-12-27 23:15:23,026][106225] Updated weights for policy 1, policy_version 560371 (0.0008) [2023-12-27 23:15:23,082][106225] Updated weights for policy 1, policy_version 560381 (0.0006) [2023-12-27 23:15:23,138][106225] Updated weights for policy 1, policy_version 560391 (0.0007) [2023-12-27 23:15:23,326][106226] Updated weights for policy 0, policy_version 558675 (0.0009) [2023-12-27 23:15:23,383][106226] Updated weights for policy 0, policy_version 558685 (0.0005) [2023-12-27 23:15:23,450][106226] Updated weights for policy 0, policy_version 558695 (0.0007) [2023-12-27 23:15:23,787][106225] Updated weights for policy 1, policy_version 560401 (0.0008) [2023-12-27 23:15:23,837][106225] Updated weights for policy 1, policy_version 560411 (0.0009) [2023-12-27 23:15:23,883][106225] Updated weights for policy 1, policy_version 560421 (0.0005) [2023-12-27 23:15:23,931][106225] Updated weights for policy 1, policy_version 560431 (0.0006) [2023-12-27 23:15:24,028][106226] Updated weights for policy 0, policy_version 558705 (0.0007) [2023-12-27 23:15:24,095][106226] Updated weights for policy 0, policy_version 558715 (0.0009) [2023-12-27 23:15:24,160][106226] Updated weights for policy 0, policy_version 558725 (0.0008) [2023-12-27 23:15:24,220][106226] Updated weights for policy 0, policy_version 558735 (0.0009) [2023-12-27 23:15:24,656][106225] Updated weights for policy 1, policy_version 560441 (0.0009) [2023-12-27 23:15:24,708][106225] Updated weights for policy 1, policy_version 560451 (0.0009) [2023-12-27 23:15:24,762][106225] Updated weights for policy 1, policy_version 560461 (0.0008) [2023-12-27 23:15:24,856][106226] Updated weights for policy 0, policy_version 558745 (0.0010) [2023-12-27 23:15:24,914][106226] Updated weights for policy 0, policy_version 558755 (0.0007) [2023-12-27 23:15:24,976][106226] Updated weights for policy 0, policy_version 558765 (0.0006) [2023-12-27 23:15:25,488][106225] Updated weights for policy 1, policy_version 560471 (0.0006) [2023-12-27 23:15:25,559][106225] Updated weights for policy 1, policy_version 560481 (0.0005) [2023-12-27 23:15:25,625][106225] Updated weights for policy 1, policy_version 560491 (0.0006) [2023-12-27 23:15:25,654][106226] Updated weights for policy 0, policy_version 558775 (0.0006) [2023-12-27 23:15:25,707][106226] Updated weights for policy 0, policy_version 558785 (0.0008) [2023-12-27 23:15:25,761][106226] Updated weights for policy 0, policy_version 558795 (0.0006) [2023-12-27 23:15:26,175][105115] Fps is (10 sec: 21298.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 286605312. Throughput: 0: 9765.7, 1: 10105.6. Samples: 286576136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:26,175][105115] Avg episode reward: [(0, '-5.208'), (1, '-5.465')] [2023-12-27 23:15:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000560496_143515648.pth... [2023-12-27 23:15:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000558800_143089664.pth... [2023-12-27 23:15:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000559344_143220736.pth [2023-12-27 23:15:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000557656_142794752.pth [2023-12-27 23:15:26,258][106225] Updated weights for policy 1, policy_version 560501 (0.0010) [2023-12-27 23:15:26,315][106225] Updated weights for policy 1, policy_version 560511 (0.0010) [2023-12-27 23:15:26,362][106225] Updated weights for policy 1, policy_version 560521 (0.0010) [2023-12-27 23:15:26,431][106226] Updated weights for policy 0, policy_version 558805 (0.0007) [2023-12-27 23:15:26,477][106226] Updated weights for policy 0, policy_version 558815 (0.0008) [2023-12-27 23:15:26,535][106226] Updated weights for policy 0, policy_version 558825 (0.0007) [2023-12-27 23:15:27,024][106225] Updated weights for policy 1, policy_version 560531 (0.0009) [2023-12-27 23:15:27,073][106225] Updated weights for policy 1, policy_version 560541 (0.0005) [2023-12-27 23:15:27,120][106225] Updated weights for policy 1, policy_version 560551 (0.0005) [2023-12-27 23:15:27,166][106226] Updated weights for policy 0, policy_version 558835 (0.0007) [2023-12-27 23:15:27,213][106226] Updated weights for policy 0, policy_version 558845 (0.0005) [2023-12-27 23:15:27,265][106226] Updated weights for policy 0, policy_version 558855 (0.0005) [2023-12-27 23:15:27,781][106225] Updated weights for policy 1, policy_version 560561 (0.0006) [2023-12-27 23:15:27,848][106225] Updated weights for policy 1, policy_version 560571 (0.0008) [2023-12-27 23:15:27,902][106225] Updated weights for policy 1, policy_version 560581 (0.0006) [2023-12-27 23:15:27,957][106226] Updated weights for policy 0, policy_version 558865 (0.0006) [2023-12-27 23:15:27,961][106225] Updated weights for policy 1, policy_version 560591 (0.0005) [2023-12-27 23:15:28,017][106226] Updated weights for policy 0, policy_version 558875 (0.0008) [2023-12-27 23:15:28,066][106226] Updated weights for policy 0, policy_version 558885 (0.0009) [2023-12-27 23:15:28,116][106226] Updated weights for policy 0, policy_version 558895 (0.0009) [2023-12-27 23:15:28,500][106225] Updated weights for policy 1, policy_version 560601 (0.0008) [2023-12-27 23:15:28,568][106225] Updated weights for policy 1, policy_version 560611 (0.0009) [2023-12-27 23:15:28,637][106225] Updated weights for policy 1, policy_version 560621 (0.0010) [2023-12-27 23:15:28,877][106226] Updated weights for policy 0, policy_version 558905 (0.0008) [2023-12-27 23:15:28,941][106226] Updated weights for policy 0, policy_version 558915 (0.0009) [2023-12-27 23:15:29,003][106226] Updated weights for policy 0, policy_version 558925 (0.0009) [2023-12-27 23:15:29,346][106225] Updated weights for policy 1, policy_version 560631 (0.0009) [2023-12-27 23:15:29,396][106225] Updated weights for policy 1, policy_version 560641 (0.0008) [2023-12-27 23:15:29,460][106225] Updated weights for policy 1, policy_version 560651 (0.0009) [2023-12-27 23:15:29,703][106226] Updated weights for policy 0, policy_version 558935 (0.0008) [2023-12-27 23:15:29,757][106226] Updated weights for policy 0, policy_version 558945 (0.0007) [2023-12-27 23:15:29,825][106226] Updated weights for policy 0, policy_version 558955 (0.0008) [2023-12-27 23:15:30,139][106225] Updated weights for policy 1, policy_version 560661 (0.0007) [2023-12-27 23:15:30,206][106225] Updated weights for policy 1, policy_version 560671 (0.0006) [2023-12-27 23:15:30,271][106225] Updated weights for policy 1, policy_version 560681 (0.0009) [2023-12-27 23:15:30,547][106226] Updated weights for policy 0, policy_version 558965 (0.0007) [2023-12-27 23:15:30,600][106226] Updated weights for policy 0, policy_version 558975 (0.0005) [2023-12-27 23:15:30,656][106226] Updated weights for policy 0, policy_version 558985 (0.0005) [2023-12-27 23:15:30,915][106225] Updated weights for policy 1, policy_version 560691 (0.0009) [2023-12-27 23:15:30,961][106225] Updated weights for policy 1, policy_version 560701 (0.0005) [2023-12-27 23:15:31,025][106225] Updated weights for policy 1, policy_version 560711 (0.0006) [2023-12-27 23:15:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 286711808. Throughput: 0: 9879.8, 1: 10119.9. Samples: 286698160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:31,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.832')] [2023-12-27 23:15:31,317][106226] Updated weights for policy 0, policy_version 558995 (0.0009) [2023-12-27 23:15:31,375][106226] Updated weights for policy 0, policy_version 559005 (0.0010) [2023-12-27 23:15:31,441][106226] Updated weights for policy 0, policy_version 559015 (0.0010) [2023-12-27 23:15:31,721][106225] Updated weights for policy 1, policy_version 560721 (0.0008) [2023-12-27 23:15:31,777][106225] Updated weights for policy 1, policy_version 560731 (0.0007) [2023-12-27 23:15:31,839][106225] Updated weights for policy 1, policy_version 560741 (0.0006) [2023-12-27 23:15:31,903][106225] Updated weights for policy 1, policy_version 560751 (0.0005) [2023-12-27 23:15:32,114][106226] Updated weights for policy 0, policy_version 559025 (0.0011) [2023-12-27 23:15:32,179][106226] Updated weights for policy 0, policy_version 559035 (0.0011) [2023-12-27 23:15:32,245][106226] Updated weights for policy 0, policy_version 559045 (0.0011) [2023-12-27 23:15:32,308][106226] Updated weights for policy 0, policy_version 559055 (0.0008) [2023-12-27 23:15:32,626][106225] Updated weights for policy 1, policy_version 560761 (0.0005) [2023-12-27 23:15:32,674][106225] Updated weights for policy 1, policy_version 560771 (0.0008) [2023-12-27 23:15:32,722][106225] Updated weights for policy 1, policy_version 560781 (0.0007) [2023-12-27 23:15:33,002][106226] Updated weights for policy 0, policy_version 559065 (0.0006) [2023-12-27 23:15:33,053][106226] Updated weights for policy 0, policy_version 559075 (0.0005) [2023-12-27 23:15:33,098][106226] Updated weights for policy 0, policy_version 559085 (0.0005) [2023-12-27 23:15:33,411][106225] Updated weights for policy 1, policy_version 560791 (0.0006) [2023-12-27 23:15:33,471][106225] Updated weights for policy 1, policy_version 560801 (0.0008) [2023-12-27 23:15:33,519][106225] Updated weights for policy 1, policy_version 560811 (0.0008) [2023-12-27 23:15:33,621][106226] Updated weights for policy 0, policy_version 559095 (0.0005) [2023-12-27 23:15:33,670][106226] Updated weights for policy 0, policy_version 559105 (0.0005) [2023-12-27 23:15:33,724][106226] Updated weights for policy 0, policy_version 559115 (0.0007) [2023-12-27 23:15:34,239][106225] Updated weights for policy 1, policy_version 560822 (0.0008) [2023-12-27 23:15:34,299][106225] Updated weights for policy 1, policy_version 560832 (0.0008) [2023-12-27 23:15:34,359][106225] Updated weights for policy 1, policy_version 560842 (0.0008) [2023-12-27 23:15:34,376][106226] Updated weights for policy 0, policy_version 559125 (0.0008) [2023-12-27 23:15:34,443][106226] Updated weights for policy 0, policy_version 559135 (0.0008) [2023-12-27 23:15:34,509][106226] Updated weights for policy 0, policy_version 559145 (0.0006) [2023-12-27 23:15:35,099][106225] Updated weights for policy 1, policy_version 560852 (0.0009) [2023-12-27 23:15:35,139][106226] Updated weights for policy 0, policy_version 559155 (0.0006) [2023-12-27 23:15:35,156][106225] Updated weights for policy 1, policy_version 560862 (0.0010) [2023-12-27 23:15:35,190][106226] Updated weights for policy 0, policy_version 559165 (0.0006) [2023-12-27 23:15:35,214][106225] Updated weights for policy 1, policy_version 560872 (0.0010) [2023-12-27 23:15:35,240][106226] Updated weights for policy 0, policy_version 559175 (0.0008) [2023-12-27 23:15:35,917][106225] Updated weights for policy 1, policy_version 560882 (0.0009) [2023-12-27 23:15:35,970][106226] Updated weights for policy 0, policy_version 559185 (0.0007) [2023-12-27 23:15:35,974][106225] Updated weights for policy 1, policy_version 560892 (0.0005) [2023-12-27 23:15:36,031][106225] Updated weights for policy 1, policy_version 560902 (0.0005) [2023-12-27 23:15:36,032][106226] Updated weights for policy 0, policy_version 559195 (0.0008) [2023-12-27 23:15:36,092][106226] Updated weights for policy 0, policy_version 559205 (0.0008) [2023-12-27 23:15:36,094][106225] Updated weights for policy 1, policy_version 560912 (0.0006) [2023-12-27 23:15:36,154][106226] Updated weights for policy 0, policy_version 559215 (0.0007) [2023-12-27 23:15:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 286818304. Throughput: 0: 10026.0, 1: 10075.2. Samples: 286820816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:36,175][105115] Avg episode reward: [(0, '-5.209'), (1, '-5.663')] [2023-12-27 23:15:36,799][106226] Updated weights for policy 0, policy_version 559225 (0.0006) [2023-12-27 23:15:36,801][106225] Updated weights for policy 1, policy_version 560922 (0.0006) [2023-12-27 23:15:36,855][106226] Updated weights for policy 0, policy_version 559235 (0.0005) [2023-12-27 23:15:36,860][106225] Updated weights for policy 1, policy_version 560932 (0.0007) [2023-12-27 23:15:36,916][106225] Updated weights for policy 1, policy_version 560942 (0.0005) [2023-12-27 23:15:36,921][106226] Updated weights for policy 0, policy_version 559245 (0.0008) [2023-12-27 23:15:37,561][106225] Updated weights for policy 1, policy_version 560952 (0.0008) [2023-12-27 23:15:37,619][106225] Updated weights for policy 1, policy_version 560962 (0.0007) [2023-12-27 23:15:37,635][106226] Updated weights for policy 0, policy_version 559255 (0.0009) [2023-12-27 23:15:37,671][106225] Updated weights for policy 1, policy_version 560972 (0.0007) [2023-12-27 23:15:37,697][106226] Updated weights for policy 0, policy_version 559265 (0.0008) [2023-12-27 23:15:37,755][106226] Updated weights for policy 0, policy_version 559275 (0.0010) [2023-12-27 23:15:38,317][106225] Updated weights for policy 1, policy_version 560982 (0.0005) [2023-12-27 23:15:38,380][106225] Updated weights for policy 1, policy_version 560992 (0.0009) [2023-12-27 23:15:38,386][106226] Updated weights for policy 0, policy_version 559285 (0.0009) [2023-12-27 23:15:38,440][106225] Updated weights for policy 1, policy_version 561002 (0.0006) [2023-12-27 23:15:38,449][106226] Updated weights for policy 0, policy_version 559295 (0.0008) [2023-12-27 23:15:38,506][106226] Updated weights for policy 0, policy_version 559305 (0.0007) [2023-12-27 23:15:39,143][106225] Updated weights for policy 1, policy_version 561012 (0.0007) [2023-12-27 23:15:39,190][106225] Updated weights for policy 1, policy_version 561022 (0.0008) [2023-12-27 23:15:39,243][106226] Updated weights for policy 0, policy_version 559315 (0.0009) [2023-12-27 23:15:39,260][106225] Updated weights for policy 1, policy_version 561032 (0.0008) [2023-12-27 23:15:39,307][106226] Updated weights for policy 0, policy_version 559325 (0.0008) [2023-12-27 23:15:39,403][106226] Updated weights for policy 0, policy_version 559337 (0.0019) [2023-12-27 23:15:40,156][106225] Updated weights for policy 1, policy_version 561042 (0.0008) [2023-12-27 23:15:40,220][106225] Updated weights for policy 1, policy_version 561052 (0.0009) [2023-12-27 23:15:40,241][106226] Updated weights for policy 0, policy_version 559347 (0.0010) [2023-12-27 23:15:40,277][106225] Updated weights for policy 1, policy_version 561062 (0.0006) [2023-12-27 23:15:40,297][106226] Updated weights for policy 0, policy_version 559357 (0.0008) [2023-12-27 23:15:40,335][106225] Updated weights for policy 1, policy_version 561072 (0.0010) [2023-12-27 23:15:40,354][106226] Updated weights for policy 0, policy_version 559367 (0.0008) [2023-12-27 23:15:41,062][106225] Updated weights for policy 1, policy_version 561082 (0.0011) [2023-12-27 23:15:41,125][106226] Updated weights for policy 0, policy_version 559377 (0.0008) [2023-12-27 23:15:41,132][106225] Updated weights for policy 1, policy_version 561092 (0.0009) [2023-12-27 23:15:41,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 286900224. Throughput: 0: 10079.3, 1: 10098.4. Samples: 286881552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:41,175][105115] Avg episode reward: [(0, '-5.184'), (1, '-5.658')] [2023-12-27 23:15:41,195][106226] Updated weights for policy 0, policy_version 559387 (0.0007) [2023-12-27 23:15:41,195][106225] Updated weights for policy 1, policy_version 561102 (0.0008) [2023-12-27 23:15:41,207][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000561104_143671296.pth... [2023-12-27 23:15:41,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000559920_143368192.pth [2023-12-27 23:15:41,266][106226] Updated weights for policy 0, policy_version 559397 (0.0006) [2023-12-27 23:15:41,331][106226] Updated weights for policy 0, policy_version 559407 (0.0006) [2023-12-27 23:15:41,336][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000559408_143245312.pth... [2023-12-27 23:15:41,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000558192_142934016.pth [2023-12-27 23:15:41,983][106226] Updated weights for policy 0, policy_version 559417 (0.0009) [2023-12-27 23:15:42,045][106226] Updated weights for policy 0, policy_version 559427 (0.0006) [2023-12-27 23:15:42,058][106225] Updated weights for policy 1, policy_version 561112 (0.0010) [2023-12-27 23:15:42,099][106226] Updated weights for policy 0, policy_version 559437 (0.0008) [2023-12-27 23:15:42,113][106225] Updated weights for policy 1, policy_version 561122 (0.0011) [2023-12-27 23:15:42,167][106225] Updated weights for policy 1, policy_version 561132 (0.0010) [2023-12-27 23:15:42,822][106226] Updated weights for policy 0, policy_version 559447 (0.0006) [2023-12-27 23:15:42,878][106226] Updated weights for policy 0, policy_version 559457 (0.0007) [2023-12-27 23:15:42,920][106225] Updated weights for policy 1, policy_version 561142 (0.0008) [2023-12-27 23:15:42,937][106226] Updated weights for policy 0, policy_version 559467 (0.0010) [2023-12-27 23:15:42,980][106225] Updated weights for policy 1, policy_version 561152 (0.0006) [2023-12-27 23:15:43,054][106225] Updated weights for policy 1, policy_version 561162 (0.0009) [2023-12-27 23:15:43,520][106226] Updated weights for policy 0, policy_version 559477 (0.0006) [2023-12-27 23:15:43,568][106226] Updated weights for policy 0, policy_version 559487 (0.0005) [2023-12-27 23:15:43,628][106226] Updated weights for policy 0, policy_version 559497 (0.0005) [2023-12-27 23:15:43,864][106225] Updated weights for policy 1, policy_version 561172 (0.0008) [2023-12-27 23:15:43,922][106225] Updated weights for policy 1, policy_version 561182 (0.0008) [2023-12-27 23:15:43,981][106225] Updated weights for policy 1, policy_version 561192 (0.0007) [2023-12-27 23:15:44,277][106226] Updated weights for policy 0, policy_version 559507 (0.0006) [2023-12-27 23:15:44,345][106226] Updated weights for policy 0, policy_version 559517 (0.0008) [2023-12-27 23:15:44,411][106226] Updated weights for policy 0, policy_version 559527 (0.0009) [2023-12-27 23:15:44,595][106225] Updated weights for policy 1, policy_version 561202 (0.0005) [2023-12-27 23:15:44,662][106225] Updated weights for policy 1, policy_version 561212 (0.0007) [2023-12-27 23:15:44,729][106225] Updated weights for policy 1, policy_version 561222 (0.0006) [2023-12-27 23:15:44,795][106225] Updated weights for policy 1, policy_version 561232 (0.0008) [2023-12-27 23:15:45,261][106226] Updated weights for policy 0, policy_version 559537 (0.0009) [2023-12-27 23:15:45,316][106226] Updated weights for policy 0, policy_version 559547 (0.0008) [2023-12-27 23:15:45,366][106226] Updated weights for policy 0, policy_version 559557 (0.0007) [2023-12-27 23:15:45,377][106225] Updated weights for policy 1, policy_version 561242 (0.0008) [2023-12-27 23:15:45,417][106226] Updated weights for policy 0, policy_version 559567 (0.0008) [2023-12-27 23:15:45,428][106225] Updated weights for policy 1, policy_version 561252 (0.0005) [2023-12-27 23:15:45,484][106225] Updated weights for policy 1, policy_version 561262 (0.0005) [2023-12-27 23:15:46,127][106225] Updated weights for policy 1, policy_version 561272 (0.0008) [2023-12-27 23:15:46,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 286998528. Throughput: 0: 10070.9, 1: 9995.0. Samples: 286994668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:46,175][105115] Avg episode reward: [(0, '-5.117'), (1, '-5.609')] [2023-12-27 23:15:46,182][106225] Updated weights for policy 1, policy_version 561282 (0.0008) [2023-12-27 23:15:46,204][106226] Updated weights for policy 0, policy_version 559577 (0.0007) [2023-12-27 23:15:46,244][106225] Updated weights for policy 1, policy_version 561292 (0.0009) [2023-12-27 23:15:46,250][106226] Updated weights for policy 0, policy_version 559587 (0.0007) [2023-12-27 23:15:46,296][106226] Updated weights for policy 0, policy_version 559597 (0.0009) [2023-12-27 23:15:46,959][106225] Updated weights for policy 1, policy_version 561302 (0.0009) [2023-12-27 23:15:47,008][106225] Updated weights for policy 1, policy_version 561312 (0.0007) [2023-12-27 23:15:47,018][106226] Updated weights for policy 0, policy_version 559607 (0.0007) [2023-12-27 23:15:47,068][106226] Updated weights for policy 0, policy_version 559617 (0.0007) [2023-12-27 23:15:47,074][106225] Updated weights for policy 1, policy_version 561322 (0.0007) [2023-12-27 23:15:47,124][106226] Updated weights for policy 0, policy_version 559627 (0.0007) [2023-12-27 23:15:47,795][106225] Updated weights for policy 1, policy_version 561332 (0.0007) [2023-12-27 23:15:47,849][106225] Updated weights for policy 1, policy_version 561342 (0.0008) [2023-12-27 23:15:47,855][106226] Updated weights for policy 0, policy_version 559637 (0.0008) [2023-12-27 23:15:47,900][106225] Updated weights for policy 1, policy_version 561352 (0.0007) [2023-12-27 23:15:47,906][106226] Updated weights for policy 0, policy_version 559647 (0.0008) [2023-12-27 23:15:47,959][106226] Updated weights for policy 0, policy_version 559657 (0.0007) [2023-12-27 23:15:48,533][106225] Updated weights for policy 1, policy_version 561362 (0.0007) [2023-12-27 23:15:48,599][106225] Updated weights for policy 1, policy_version 561372 (0.0007) [2023-12-27 23:15:48,659][106225] Updated weights for policy 1, policy_version 561382 (0.0008) [2023-12-27 23:15:48,719][106225] Updated weights for policy 1, policy_version 561392 (0.0007) [2023-12-27 23:15:48,740][106226] Updated weights for policy 0, policy_version 559667 (0.0008) [2023-12-27 23:15:48,792][106226] Updated weights for policy 0, policy_version 559677 (0.0009) [2023-12-27 23:15:48,851][106226] Updated weights for policy 0, policy_version 559687 (0.0009) [2023-12-27 23:15:49,385][106225] Updated weights for policy 1, policy_version 561402 (0.0008) [2023-12-27 23:15:49,453][106225] Updated weights for policy 1, policy_version 561412 (0.0009) [2023-12-27 23:15:49,515][106225] Updated weights for policy 1, policy_version 561422 (0.0009) [2023-12-27 23:15:49,605][106226] Updated weights for policy 0, policy_version 559697 (0.0009) [2023-12-27 23:15:49,670][106226] Updated weights for policy 0, policy_version 559707 (0.0009) [2023-12-27 23:15:49,730][106226] Updated weights for policy 0, policy_version 559717 (0.0009) [2023-12-27 23:15:49,794][106226] Updated weights for policy 0, policy_version 559727 (0.0009) [2023-12-27 23:15:50,302][106225] Updated weights for policy 1, policy_version 561432 (0.0009) [2023-12-27 23:15:50,359][106225] Updated weights for policy 1, policy_version 561442 (0.0008) [2023-12-27 23:15:50,420][106225] Updated weights for policy 1, policy_version 561452 (0.0009) [2023-12-27 23:15:50,578][106226] Updated weights for policy 0, policy_version 559737 (0.0009) [2023-12-27 23:15:50,645][106226] Updated weights for policy 0, policy_version 559747 (0.0009) [2023-12-27 23:15:50,705][106226] Updated weights for policy 0, policy_version 559757 (0.0009) [2023-12-27 23:15:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 287096832. Throughput: 0: 9927.8, 1: 9979.4. Samples: 287110224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:51,175][105115] Avg episode reward: [(0, '-5.056'), (1, '-5.450')] [2023-12-27 23:15:51,205][106225] Updated weights for policy 1, policy_version 561462 (0.0008) [2023-12-27 23:15:51,270][106225] Updated weights for policy 1, policy_version 561472 (0.0007) [2023-12-27 23:15:51,336][106225] Updated weights for policy 1, policy_version 561482 (0.0008) [2023-12-27 23:15:51,475][106226] Updated weights for policy 0, policy_version 559767 (0.0008) [2023-12-27 23:15:51,536][106226] Updated weights for policy 0, policy_version 559777 (0.0008) [2023-12-27 23:15:51,595][106226] Updated weights for policy 0, policy_version 559787 (0.0008) [2023-12-27 23:15:52,125][106225] Updated weights for policy 1, policy_version 561492 (0.0007) [2023-12-27 23:15:52,184][106225] Updated weights for policy 1, policy_version 561502 (0.0008) [2023-12-27 23:15:52,242][106225] Updated weights for policy 1, policy_version 561512 (0.0009) [2023-12-27 23:15:52,384][106226] Updated weights for policy 0, policy_version 559797 (0.0008) [2023-12-27 23:15:52,444][106226] Updated weights for policy 0, policy_version 559807 (0.0006) [2023-12-27 23:15:52,503][106226] Updated weights for policy 0, policy_version 559817 (0.0007) [2023-12-27 23:15:53,004][106225] Updated weights for policy 1, policy_version 561522 (0.0007) [2023-12-27 23:15:53,070][106225] Updated weights for policy 1, policy_version 561532 (0.0005) [2023-12-27 23:15:53,126][106225] Updated weights for policy 1, policy_version 561542 (0.0007) [2023-12-27 23:15:53,176][106225] Updated weights for policy 1, policy_version 561552 (0.0008) [2023-12-27 23:15:53,206][106226] Updated weights for policy 0, policy_version 559827 (0.0006) [2023-12-27 23:15:53,264][106226] Updated weights for policy 0, policy_version 559837 (0.0006) [2023-12-27 23:15:53,324][106226] Updated weights for policy 0, policy_version 559847 (0.0006) [2023-12-27 23:15:53,743][106225] Updated weights for policy 1, policy_version 561562 (0.0008) [2023-12-27 23:15:53,808][106225] Updated weights for policy 1, policy_version 561572 (0.0005) [2023-12-27 23:15:53,869][106225] Updated weights for policy 1, policy_version 561582 (0.0008) [2023-12-27 23:15:54,002][106226] Updated weights for policy 0, policy_version 559857 (0.0006) [2023-12-27 23:15:54,061][106226] Updated weights for policy 0, policy_version 559867 (0.0008) [2023-12-27 23:15:54,145][106226] Updated weights for policy 0, policy_version 559877 (0.0009) [2023-12-27 23:15:54,208][106226] Updated weights for policy 0, policy_version 559887 (0.0008) [2023-12-27 23:15:54,492][106225] Updated weights for policy 1, policy_version 561592 (0.0008) [2023-12-27 23:15:54,551][106225] Updated weights for policy 1, policy_version 561602 (0.0006) [2023-12-27 23:15:54,611][106225] Updated weights for policy 1, policy_version 561612 (0.0007) [2023-12-27 23:15:54,995][106226] Updated weights for policy 0, policy_version 559897 (0.0008) [2023-12-27 23:15:55,057][106226] Updated weights for policy 0, policy_version 559907 (0.0008) [2023-12-27 23:15:55,122][106226] Updated weights for policy 0, policy_version 559917 (0.0008) [2023-12-27 23:15:55,214][106225] Updated weights for policy 1, policy_version 561622 (0.0008) [2023-12-27 23:15:55,277][106225] Updated weights for policy 1, policy_version 561632 (0.0011) [2023-12-27 23:15:55,336][106225] Updated weights for policy 1, policy_version 561642 (0.0010) [2023-12-27 23:15:55,872][106226] Updated weights for policy 0, policy_version 559927 (0.0008) [2023-12-27 23:15:55,929][106226] Updated weights for policy 0, policy_version 559937 (0.0008) [2023-12-27 23:15:55,986][106226] Updated weights for policy 0, policy_version 559947 (0.0008) [2023-12-27 23:15:56,070][106225] Updated weights for policy 1, policy_version 561652 (0.0010) [2023-12-27 23:15:56,123][106225] Updated weights for policy 1, policy_version 561662 (0.0010) [2023-12-27 23:15:56,173][106225] Updated weights for policy 1, policy_version 561672 (0.0010) [2023-12-27 23:15:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 287195136. Throughput: 0: 9917.6, 1: 9957.5. Samples: 287167824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:15:56,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-5.360')] [2023-12-27 23:15:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000559952_143384576.pth... [2023-12-27 23:15:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000558800_143089664.pth [2023-12-27 23:15:56,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000561680_143818752.pth... [2023-12-27 23:15:56,221][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000560496_143515648.pth [2023-12-27 23:15:56,764][106226] Updated weights for policy 0, policy_version 559957 (0.0008) [2023-12-27 23:15:56,808][106225] Updated weights for policy 1, policy_version 561682 (0.0010) [2023-12-27 23:15:56,817][106226] Updated weights for policy 0, policy_version 559967 (0.0008) [2023-12-27 23:15:56,863][106225] Updated weights for policy 1, policy_version 561692 (0.0009) [2023-12-27 23:15:56,873][106226] Updated weights for policy 0, policy_version 559977 (0.0007) [2023-12-27 23:15:56,919][106225] Updated weights for policy 1, policy_version 561702 (0.0007) [2023-12-27 23:15:56,976][106225] Updated weights for policy 1, policy_version 561712 (0.0010) [2023-12-27 23:15:57,641][106225] Updated weights for policy 1, policy_version 561722 (0.0006) [2023-12-27 23:15:57,643][106226] Updated weights for policy 0, policy_version 559987 (0.0008) [2023-12-27 23:15:57,694][106225] Updated weights for policy 1, policy_version 561732 (0.0006) [2023-12-27 23:15:57,702][106226] Updated weights for policy 0, policy_version 559997 (0.0007) [2023-12-27 23:15:57,738][106225] Updated weights for policy 1, policy_version 561742 (0.0006) [2023-12-27 23:15:57,767][106226] Updated weights for policy 0, policy_version 560007 (0.0008) [2023-12-27 23:15:58,454][106225] Updated weights for policy 1, policy_version 561752 (0.0007) [2023-12-27 23:15:58,527][106225] Updated weights for policy 1, policy_version 561762 (0.0008) [2023-12-27 23:15:58,574][106226] Updated weights for policy 0, policy_version 560017 (0.0009) [2023-12-27 23:15:58,592][106225] Updated weights for policy 1, policy_version 561772 (0.0009) [2023-12-27 23:15:58,640][106226] Updated weights for policy 0, policy_version 560027 (0.0008) [2023-12-27 23:15:58,709][106226] Updated weights for policy 0, policy_version 560037 (0.0008) [2023-12-27 23:15:58,772][106226] Updated weights for policy 0, policy_version 560047 (0.0007) [2023-12-27 23:15:59,488][106225] Updated weights for policy 1, policy_version 561782 (0.0008) [2023-12-27 23:15:59,551][106225] Updated weights for policy 1, policy_version 561792 (0.0008) [2023-12-27 23:15:59,614][106225] Updated weights for policy 1, policy_version 561802 (0.0007) [2023-12-27 23:15:59,622][106226] Updated weights for policy 0, policy_version 560057 (0.0007) [2023-12-27 23:15:59,697][106226] Updated weights for policy 0, policy_version 560067 (0.0007) [2023-12-27 23:15:59,763][106226] Updated weights for policy 0, policy_version 560077 (0.0008) [2023-12-27 23:16:00,326][106225] Updated weights for policy 1, policy_version 561812 (0.0009) [2023-12-27 23:16:00,380][106225] Updated weights for policy 1, policy_version 561822 (0.0009) [2023-12-27 23:16:00,435][106225] Updated weights for policy 1, policy_version 561832 (0.0009) [2023-12-27 23:16:00,461][106226] Updated weights for policy 0, policy_version 560087 (0.0008) [2023-12-27 23:16:00,522][106226] Updated weights for policy 0, policy_version 560097 (0.0006) [2023-12-27 23:16:00,586][106226] Updated weights for policy 0, policy_version 560107 (0.0007) [2023-12-27 23:16:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 287285248. Throughput: 0: 9794.3, 1: 9990.7. Samples: 287279712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:01,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.677')] [2023-12-27 23:16:01,203][106225] Updated weights for policy 1, policy_version 561842 (0.0007) [2023-12-27 23:16:01,268][106225] Updated weights for policy 1, policy_version 561852 (0.0009) [2023-12-27 23:16:01,277][106226] Updated weights for policy 0, policy_version 560117 (0.0007) [2023-12-27 23:16:01,326][106225] Updated weights for policy 1, policy_version 561862 (0.0007) [2023-12-27 23:16:01,336][106226] Updated weights for policy 0, policy_version 560127 (0.0007) [2023-12-27 23:16:01,395][106225] Updated weights for policy 1, policy_version 561872 (0.0008) [2023-12-27 23:16:01,408][106226] Updated weights for policy 0, policy_version 560137 (0.0009) [2023-12-27 23:16:02,090][106225] Updated weights for policy 1, policy_version 561882 (0.0005) [2023-12-27 23:16:02,151][106226] Updated weights for policy 0, policy_version 560147 (0.0007) [2023-12-27 23:16:02,153][106225] Updated weights for policy 1, policy_version 561892 (0.0010) [2023-12-27 23:16:02,205][106226] Updated weights for policy 0, policy_version 560157 (0.0006) [2023-12-27 23:16:02,211][106225] Updated weights for policy 1, policy_version 561902 (0.0010) [2023-12-27 23:16:02,264][106226] Updated weights for policy 0, policy_version 560167 (0.0007) [2023-12-27 23:16:02,893][106225] Updated weights for policy 1, policy_version 561912 (0.0010) [2023-12-27 23:16:02,939][106225] Updated weights for policy 1, policy_version 561922 (0.0010) [2023-12-27 23:16:02,969][106226] Updated weights for policy 0, policy_version 560177 (0.0008) [2023-12-27 23:16:02,986][106225] Updated weights for policy 1, policy_version 561932 (0.0006) [2023-12-27 23:16:03,028][106226] Updated weights for policy 0, policy_version 560187 (0.0008) [2023-12-27 23:16:03,075][106226] Updated weights for policy 0, policy_version 560197 (0.0008) [2023-12-27 23:16:03,129][106226] Updated weights for policy 0, policy_version 560207 (0.0009) [2023-12-27 23:16:03,663][106225] Updated weights for policy 1, policy_version 561942 (0.0007) [2023-12-27 23:16:03,715][106225] Updated weights for policy 1, policy_version 561952 (0.0008) [2023-12-27 23:16:03,767][106225] Updated weights for policy 1, policy_version 561962 (0.0008) [2023-12-27 23:16:03,852][106226] Updated weights for policy 0, policy_version 560217 (0.0008) [2023-12-27 23:16:03,918][106226] Updated weights for policy 0, policy_version 560227 (0.0009) [2023-12-27 23:16:03,971][106226] Updated weights for policy 0, policy_version 560237 (0.0008) [2023-12-27 23:16:04,518][106225] Updated weights for policy 1, policy_version 561972 (0.0008) [2023-12-27 23:16:04,574][106225] Updated weights for policy 1, policy_version 561982 (0.0009) [2023-12-27 23:16:04,630][106225] Updated weights for policy 1, policy_version 561992 (0.0009) [2023-12-27 23:16:04,668][106226] Updated weights for policy 0, policy_version 560247 (0.0007) [2023-12-27 23:16:04,727][106226] Updated weights for policy 0, policy_version 560257 (0.0009) [2023-12-27 23:16:04,788][106226] Updated weights for policy 0, policy_version 560267 (0.0009) [2023-12-27 23:16:05,319][106225] Updated weights for policy 1, policy_version 562002 (0.0008) [2023-12-27 23:16:05,384][106225] Updated weights for policy 1, policy_version 562012 (0.0009) [2023-12-27 23:16:05,439][106225] Updated weights for policy 1, policy_version 562022 (0.0008) [2023-12-27 23:16:05,487][106225] Updated weights for policy 1, policy_version 562032 (0.0008) [2023-12-27 23:16:05,536][106226] Updated weights for policy 0, policy_version 560277 (0.0008) [2023-12-27 23:16:05,583][106226] Updated weights for policy 0, policy_version 560287 (0.0008) [2023-12-27 23:16:05,639][106226] Updated weights for policy 0, policy_version 560297 (0.0009) [2023-12-27 23:16:06,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 287383552. Throughput: 0: 9705.8, 1: 9878.8. Samples: 287395864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:06,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.461')] [2023-12-27 23:16:06,235][106225] Updated weights for policy 1, policy_version 562042 (0.0009) [2023-12-27 23:16:06,295][106225] Updated weights for policy 1, policy_version 562052 (0.0009) [2023-12-27 23:16:06,355][106225] Updated weights for policy 1, policy_version 562062 (0.0008) [2023-12-27 23:16:06,390][106226] Updated weights for policy 0, policy_version 560307 (0.0009) [2023-12-27 23:16:06,445][106226] Updated weights for policy 0, policy_version 560317 (0.0008) [2023-12-27 23:16:06,498][106226] Updated weights for policy 0, policy_version 560327 (0.0008) [2023-12-27 23:16:07,093][106225] Updated weights for policy 1, policy_version 562072 (0.0009) [2023-12-27 23:16:07,150][106225] Updated weights for policy 1, policy_version 562082 (0.0008) [2023-12-27 23:16:07,208][106225] Updated weights for policy 1, policy_version 562092 (0.0006) [2023-12-27 23:16:07,241][106226] Updated weights for policy 0, policy_version 560337 (0.0009) [2023-12-27 23:16:07,303][106226] Updated weights for policy 0, policy_version 560347 (0.0009) [2023-12-27 23:16:07,357][106226] Updated weights for policy 0, policy_version 560358 (0.0009) [2023-12-27 23:16:07,406][106226] Updated weights for policy 0, policy_version 560368 (0.0008) [2023-12-27 23:16:07,872][106225] Updated weights for policy 1, policy_version 562102 (0.0008) [2023-12-27 23:16:07,920][106225] Updated weights for policy 1, policy_version 562112 (0.0008) [2023-12-27 23:16:07,975][106225] Updated weights for policy 1, policy_version 562122 (0.0008) [2023-12-27 23:16:08,191][106226] Updated weights for policy 0, policy_version 560378 (0.0009) [2023-12-27 23:16:08,250][106226] Updated weights for policy 0, policy_version 560388 (0.0008) [2023-12-27 23:16:08,315][106226] Updated weights for policy 0, policy_version 560398 (0.0009) [2023-12-27 23:16:08,698][106225] Updated weights for policy 1, policy_version 562132 (0.0009) [2023-12-27 23:16:08,753][106225] Updated weights for policy 1, policy_version 562142 (0.0008) [2023-12-27 23:16:08,812][106225] Updated weights for policy 1, policy_version 562152 (0.0008) [2023-12-27 23:16:09,038][106226] Updated weights for policy 0, policy_version 560408 (0.0009) [2023-12-27 23:16:09,085][106226] Updated weights for policy 0, policy_version 560418 (0.0009) [2023-12-27 23:16:09,132][106226] Updated weights for policy 0, policy_version 560428 (0.0008) [2023-12-27 23:16:09,591][106225] Updated weights for policy 1, policy_version 562162 (0.0008) [2023-12-27 23:16:09,650][106225] Updated weights for policy 1, policy_version 562172 (0.0005) [2023-12-27 23:16:09,713][106225] Updated weights for policy 1, policy_version 562182 (0.0008) [2023-12-27 23:16:09,778][106225] Updated weights for policy 1, policy_version 562192 (0.0008) [2023-12-27 23:16:09,992][106226] Updated weights for policy 0, policy_version 560438 (0.0007) [2023-12-27 23:16:10,058][106226] Updated weights for policy 0, policy_version 560448 (0.0007) [2023-12-27 23:16:10,127][106226] Updated weights for policy 0, policy_version 560458 (0.0007) [2023-12-27 23:16:10,485][106225] Updated weights for policy 1, policy_version 562202 (0.0006) [2023-12-27 23:16:10,554][106225] Updated weights for policy 1, policy_version 562212 (0.0006) [2023-12-27 23:16:10,614][106225] Updated weights for policy 1, policy_version 562222 (0.0006) [2023-12-27 23:16:10,791][106226] Updated weights for policy 0, policy_version 560468 (0.0007) [2023-12-27 23:16:10,854][106226] Updated weights for policy 0, policy_version 560478 (0.0009) [2023-12-27 23:16:10,911][106226] Updated weights for policy 0, policy_version 560488 (0.0009) [2023-12-27 23:16:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 287481856. Throughput: 0: 9653.9, 1: 9839.2. Samples: 287453328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:11,175][105115] Avg episode reward: [(0, '-5.203'), (1, '-5.535')] [2023-12-27 23:16:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000562224_143958016.pth... [2023-12-27 23:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000560496_143523840.pth... [2023-12-27 23:16:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000561104_143671296.pth [2023-12-27 23:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000559408_143245312.pth [2023-12-27 23:16:11,271][106225] Updated weights for policy 1, policy_version 562233 (0.0008) [2023-12-27 23:16:11,339][106225] Updated weights for policy 1, policy_version 562243 (0.0008) [2023-12-27 23:16:11,416][106225] Updated weights for policy 1, policy_version 562253 (0.0008) [2023-12-27 23:16:11,752][106226] Updated weights for policy 0, policy_version 560498 (0.0009) [2023-12-27 23:16:11,815][106226] Updated weights for policy 0, policy_version 560508 (0.0008) [2023-12-27 23:16:11,880][106226] Updated weights for policy 0, policy_version 560518 (0.0008) [2023-12-27 23:16:11,942][106226] Updated weights for policy 0, policy_version 560528 (0.0008) [2023-12-27 23:16:12,173][106225] Updated weights for policy 1, policy_version 562263 (0.0006) [2023-12-27 23:16:12,238][106225] Updated weights for policy 1, policy_version 562273 (0.0007) [2023-12-27 23:16:12,306][106225] Updated weights for policy 1, policy_version 562283 (0.0007) [2023-12-27 23:16:12,704][106226] Updated weights for policy 0, policy_version 560538 (0.0007) [2023-12-27 23:16:12,771][106226] Updated weights for policy 0, policy_version 560548 (0.0006) [2023-12-27 23:16:12,830][106226] Updated weights for policy 0, policy_version 560558 (0.0006) [2023-12-27 23:16:12,977][106225] Updated weights for policy 1, policy_version 562293 (0.0007) [2023-12-27 23:16:13,038][106225] Updated weights for policy 1, policy_version 562303 (0.0005) [2023-12-27 23:16:13,095][106225] Updated weights for policy 1, policy_version 562313 (0.0010) [2023-12-27 23:16:13,496][106226] Updated weights for policy 0, policy_version 560568 (0.0008) [2023-12-27 23:16:13,554][106226] Updated weights for policy 0, policy_version 560578 (0.0009) [2023-12-27 23:16:13,618][106226] Updated weights for policy 0, policy_version 560588 (0.0008) [2023-12-27 23:16:13,635][106225] Updated weights for policy 1, policy_version 562323 (0.0010) [2023-12-27 23:16:13,691][106225] Updated weights for policy 1, policy_version 562333 (0.0010) [2023-12-27 23:16:13,747][106225] Updated weights for policy 1, policy_version 562343 (0.0010) [2023-12-27 23:16:14,244][106226] Updated weights for policy 0, policy_version 560598 (0.0008) [2023-12-27 23:16:14,290][106226] Updated weights for policy 0, policy_version 560608 (0.0005) [2023-12-27 23:16:14,336][106226] Updated weights for policy 0, policy_version 560618 (0.0005) [2023-12-27 23:16:14,434][106225] Updated weights for policy 1, policy_version 562353 (0.0010) [2023-12-27 23:16:14,500][106225] Updated weights for policy 1, policy_version 562363 (0.0010) [2023-12-27 23:16:14,565][106225] Updated weights for policy 1, policy_version 562373 (0.0011) [2023-12-27 23:16:14,628][106225] Updated weights for policy 1, policy_version 562383 (0.0006) [2023-12-27 23:16:15,056][106226] Updated weights for policy 0, policy_version 560628 (0.0005) [2023-12-27 23:16:15,114][106226] Updated weights for policy 0, policy_version 560638 (0.0006) [2023-12-27 23:16:15,171][106226] Updated weights for policy 0, policy_version 560648 (0.0006) [2023-12-27 23:16:15,269][106225] Updated weights for policy 1, policy_version 562393 (0.0008) [2023-12-27 23:16:15,334][106225] Updated weights for policy 1, policy_version 562403 (0.0010) [2023-12-27 23:16:15,382][106225] Updated weights for policy 1, policy_version 562413 (0.0008) [2023-12-27 23:16:15,849][106226] Updated weights for policy 0, policy_version 560658 (0.0009) [2023-12-27 23:16:15,901][106226] Updated weights for policy 0, policy_version 560668 (0.0008) [2023-12-27 23:16:15,954][106226] Updated weights for policy 0, policy_version 560678 (0.0008) [2023-12-27 23:16:16,009][106226] Updated weights for policy 0, policy_version 560688 (0.0009) [2023-12-27 23:16:16,078][106225] Updated weights for policy 1, policy_version 562423 (0.0006) [2023-12-27 23:16:16,132][106225] Updated weights for policy 1, policy_version 562433 (0.0006) [2023-12-27 23:16:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 287580160. Throughput: 0: 9583.7, 1: 9811.1. Samples: 287570928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:16,175][105115] Avg episode reward: [(0, '-5.067'), (1, '-5.432')] [2023-12-27 23:16:16,189][106225] Updated weights for policy 1, policy_version 562443 (0.0006) [2023-12-27 23:16:16,612][106226] Updated weights for policy 0, policy_version 560698 (0.0006) [2023-12-27 23:16:16,665][106226] Updated weights for policy 0, policy_version 560708 (0.0005) [2023-12-27 23:16:16,730][106226] Updated weights for policy 0, policy_version 560718 (0.0005) [2023-12-27 23:16:16,828][106225] Updated weights for policy 1, policy_version 562453 (0.0009) [2023-12-27 23:16:16,874][106225] Updated weights for policy 1, policy_version 562463 (0.0010) [2023-12-27 23:16:16,924][106225] Updated weights for policy 1, policy_version 562473 (0.0010) [2023-12-27 23:16:17,330][106226] Updated weights for policy 0, policy_version 560728 (0.0007) [2023-12-27 23:16:17,379][106226] Updated weights for policy 0, policy_version 560738 (0.0009) [2023-12-27 23:16:17,435][106226] Updated weights for policy 0, policy_version 560748 (0.0009) [2023-12-27 23:16:17,645][106225] Updated weights for policy 1, policy_version 562483 (0.0008) [2023-12-27 23:16:17,691][106225] Updated weights for policy 1, policy_version 562493 (0.0005) [2023-12-27 23:16:17,738][106225] Updated weights for policy 1, policy_version 562503 (0.0006) [2023-12-27 23:16:18,106][106226] Updated weights for policy 0, policy_version 560758 (0.0008) [2023-12-27 23:16:18,176][106226] Updated weights for policy 0, policy_version 560768 (0.0006) [2023-12-27 23:16:18,247][106226] Updated weights for policy 0, policy_version 560778 (0.0006) [2023-12-27 23:16:18,350][106225] Updated weights for policy 1, policy_version 562513 (0.0006) [2023-12-27 23:16:18,413][106225] Updated weights for policy 1, policy_version 562523 (0.0008) [2023-12-27 23:16:18,467][106225] Updated weights for policy 1, policy_version 562533 (0.0009) [2023-12-27 23:16:18,528][106225] Updated weights for policy 1, policy_version 562543 (0.0009) [2023-12-27 23:16:18,924][106226] Updated weights for policy 0, policy_version 560788 (0.0007) [2023-12-27 23:16:18,991][106226] Updated weights for policy 0, policy_version 560798 (0.0008) [2023-12-27 23:16:19,049][106226] Updated weights for policy 0, policy_version 560808 (0.0009) [2023-12-27 23:16:19,258][106225] Updated weights for policy 1, policy_version 562553 (0.0008) [2023-12-27 23:16:19,310][106225] Updated weights for policy 1, policy_version 562563 (0.0008) [2023-12-27 23:16:19,372][106225] Updated weights for policy 1, policy_version 562573 (0.0008) [2023-12-27 23:16:19,676][106226] Updated weights for policy 0, policy_version 560818 (0.0008) [2023-12-27 23:16:19,741][106226] Updated weights for policy 0, policy_version 560828 (0.0008) [2023-12-27 23:16:19,804][106226] Updated weights for policy 0, policy_version 560838 (0.0009) [2023-12-27 23:16:19,871][106226] Updated weights for policy 0, policy_version 560848 (0.0009) [2023-12-27 23:16:20,151][106225] Updated weights for policy 1, policy_version 562583 (0.0009) [2023-12-27 23:16:20,207][106225] Updated weights for policy 1, policy_version 562593 (0.0006) [2023-12-27 23:16:20,277][106225] Updated weights for policy 1, policy_version 562603 (0.0006) [2023-12-27 23:16:20,551][106226] Updated weights for policy 0, policy_version 560858 (0.0007) [2023-12-27 23:16:20,620][106226] Updated weights for policy 0, policy_version 560868 (0.0009) [2023-12-27 23:16:20,680][106226] Updated weights for policy 0, policy_version 560878 (0.0009) [2023-12-27 23:16:21,017][106225] Updated weights for policy 1, policy_version 562613 (0.0007) [2023-12-27 23:16:21,085][106225] Updated weights for policy 1, policy_version 562623 (0.0008) [2023-12-27 23:16:21,156][106225] Updated weights for policy 1, policy_version 562633 (0.0007) [2023-12-27 23:16:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 287678464. Throughput: 0: 9576.3, 1: 9824.1. Samples: 287693832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:21,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-5.395')] [2023-12-27 23:16:21,455][106226] Updated weights for policy 0, policy_version 560888 (0.0009) [2023-12-27 23:16:21,519][106226] Updated weights for policy 0, policy_version 560898 (0.0009) [2023-12-27 23:16:21,582][106226] Updated weights for policy 0, policy_version 560908 (0.0009) [2023-12-27 23:16:21,901][106225] Updated weights for policy 1, policy_version 562643 (0.0008) [2023-12-27 23:16:21,967][106225] Updated weights for policy 1, policy_version 562653 (0.0006) [2023-12-27 23:16:22,027][106225] Updated weights for policy 1, policy_version 562663 (0.0009) [2023-12-27 23:16:22,369][106226] Updated weights for policy 0, policy_version 560918 (0.0008) [2023-12-27 23:16:22,442][106226] Updated weights for policy 0, policy_version 560928 (0.0008) [2023-12-27 23:16:22,522][106226] Updated weights for policy 0, policy_version 560938 (0.0010) [2023-12-27 23:16:22,682][106225] Updated weights for policy 1, policy_version 562673 (0.0008) [2023-12-27 23:16:22,748][106225] Updated weights for policy 1, policy_version 562683 (0.0007) [2023-12-27 23:16:22,815][106225] Updated weights for policy 1, policy_version 562693 (0.0009) [2023-12-27 23:16:22,878][106225] Updated weights for policy 1, policy_version 562703 (0.0008) [2023-12-27 23:16:23,247][106226] Updated weights for policy 0, policy_version 560948 (0.0009) [2023-12-27 23:16:23,307][106226] Updated weights for policy 0, policy_version 560958 (0.0005) [2023-12-27 23:16:23,363][106226] Updated weights for policy 0, policy_version 560968 (0.0008) [2023-12-27 23:16:23,530][106225] Updated weights for policy 1, policy_version 562713 (0.0009) [2023-12-27 23:16:23,577][106225] Updated weights for policy 1, policy_version 562723 (0.0006) [2023-12-27 23:16:23,628][106225] Updated weights for policy 1, policy_version 562733 (0.0005) [2023-12-27 23:16:24,010][106226] Updated weights for policy 0, policy_version 560978 (0.0006) [2023-12-27 23:16:24,060][106226] Updated weights for policy 0, policy_version 560988 (0.0008) [2023-12-27 23:16:24,107][106226] Updated weights for policy 0, policy_version 560998 (0.0006) [2023-12-27 23:16:24,166][106226] Updated weights for policy 0, policy_version 561008 (0.0005) [2023-12-27 23:16:24,399][106225] Updated weights for policy 1, policy_version 562743 (0.0009) [2023-12-27 23:16:24,450][106225] Updated weights for policy 1, policy_version 562753 (0.0009) [2023-12-27 23:16:24,525][106225] Updated weights for policy 1, policy_version 562763 (0.0009) [2023-12-27 23:16:24,747][106226] Updated weights for policy 0, policy_version 561018 (0.0005) [2023-12-27 23:16:24,801][106226] Updated weights for policy 0, policy_version 561028 (0.0006) [2023-12-27 23:16:24,857][106226] Updated weights for policy 0, policy_version 561038 (0.0008) [2023-12-27 23:16:25,203][106225] Updated weights for policy 1, policy_version 562773 (0.0007) [2023-12-27 23:16:25,260][106225] Updated weights for policy 1, policy_version 562783 (0.0006) [2023-12-27 23:16:25,319][106225] Updated weights for policy 1, policy_version 562793 (0.0007) [2023-12-27 23:16:25,598][106226] Updated weights for policy 0, policy_version 561048 (0.0006) [2023-12-27 23:16:25,652][106226] Updated weights for policy 0, policy_version 561058 (0.0005) [2023-12-27 23:16:25,709][106226] Updated weights for policy 0, policy_version 561068 (0.0006) [2023-12-27 23:16:26,012][106225] Updated weights for policy 1, policy_version 562803 (0.0008) [2023-12-27 23:16:26,066][106225] Updated weights for policy 1, policy_version 562813 (0.0008) [2023-12-27 23:16:26,113][106225] Updated weights for policy 1, policy_version 562823 (0.0009) [2023-12-27 23:16:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 287784960. Throughput: 0: 9528.6, 1: 9790.1. Samples: 287750888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:26,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-5.357')] [2023-12-27 23:16:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000562832_144113664.pth... [2023-12-27 23:16:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000561072_143671296.pth... [2023-12-27 23:16:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000561680_143818752.pth [2023-12-27 23:16:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000559952_143384576.pth [2023-12-27 23:16:26,326][106226] Updated weights for policy 0, policy_version 561078 (0.0007) [2023-12-27 23:16:26,382][106226] Updated weights for policy 0, policy_version 561088 (0.0006) [2023-12-27 23:16:26,439][106226] Updated weights for policy 0, policy_version 561098 (0.0007) [2023-12-27 23:16:26,832][106225] Updated weights for policy 1, policy_version 562833 (0.0007) [2023-12-27 23:16:26,889][106225] Updated weights for policy 1, policy_version 562843 (0.0009) [2023-12-27 23:16:26,935][106225] Updated weights for policy 1, policy_version 562853 (0.0008) [2023-12-27 23:16:26,989][106225] Updated weights for policy 1, policy_version 562863 (0.0008) [2023-12-27 23:16:26,996][106226] Updated weights for policy 0, policy_version 561108 (0.0008) [2023-12-27 23:16:27,047][106226] Updated weights for policy 0, policy_version 561118 (0.0008) [2023-12-27 23:16:27,093][106226] Updated weights for policy 0, policy_version 561128 (0.0008) [2023-12-27 23:16:27,694][106225] Updated weights for policy 1, policy_version 562873 (0.0008) [2023-12-27 23:16:27,747][106225] Updated weights for policy 1, policy_version 562883 (0.0008) [2023-12-27 23:16:27,797][106225] Updated weights for policy 1, policy_version 562893 (0.0009) [2023-12-27 23:16:27,826][106226] Updated weights for policy 0, policy_version 561138 (0.0008) [2023-12-27 23:16:27,884][106226] Updated weights for policy 0, policy_version 561148 (0.0008) [2023-12-27 23:16:27,939][106226] Updated weights for policy 0, policy_version 561158 (0.0009) [2023-12-27 23:16:27,983][106226] Updated weights for policy 0, policy_version 561168 (0.0008) [2023-12-27 23:16:28,486][106225] Updated weights for policy 1, policy_version 562903 (0.0008) [2023-12-27 23:16:28,548][106225] Updated weights for policy 1, policy_version 562913 (0.0008) [2023-12-27 23:16:28,610][106225] Updated weights for policy 1, policy_version 562923 (0.0006) [2023-12-27 23:16:28,756][106226] Updated weights for policy 0, policy_version 561178 (0.0009) [2023-12-27 23:16:28,817][106226] Updated weights for policy 0, policy_version 561188 (0.0009) [2023-12-27 23:16:28,886][106226] Updated weights for policy 0, policy_version 561198 (0.0009) [2023-12-27 23:16:29,254][106225] Updated weights for policy 1, policy_version 562933 (0.0008) [2023-12-27 23:16:29,317][106225] Updated weights for policy 1, policy_version 562943 (0.0008) [2023-12-27 23:16:29,388][106225] Updated weights for policy 1, policy_version 562953 (0.0008) [2023-12-27 23:16:29,634][106226] Updated weights for policy 0, policy_version 561208 (0.0008) [2023-12-27 23:16:29,706][106226] Updated weights for policy 0, policy_version 561218 (0.0009) [2023-12-27 23:16:29,774][106226] Updated weights for policy 0, policy_version 561228 (0.0010) [2023-12-27 23:16:30,041][106225] Updated weights for policy 1, policy_version 562963 (0.0008) [2023-12-27 23:16:30,099][106225] Updated weights for policy 1, policy_version 562973 (0.0008) [2023-12-27 23:16:30,151][106225] Updated weights for policy 1, policy_version 562983 (0.0008) [2023-12-27 23:16:30,517][106226] Updated weights for policy 0, policy_version 561238 (0.0008) [2023-12-27 23:16:30,569][106226] Updated weights for policy 0, policy_version 561248 (0.0008) [2023-12-27 23:16:30,627][106226] Updated weights for policy 0, policy_version 561258 (0.0009) [2023-12-27 23:16:30,849][106225] Updated weights for policy 1, policy_version 562993 (0.0009) [2023-12-27 23:16:30,913][106225] Updated weights for policy 1, policy_version 563003 (0.0008) [2023-12-27 23:16:30,975][106225] Updated weights for policy 1, policy_version 563013 (0.0009) [2023-12-27 23:16:31,029][106225] Updated weights for policy 1, policy_version 563023 (0.0008) [2023-12-27 23:16:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 287883264. Throughput: 0: 9584.2, 1: 9896.1. Samples: 287871280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:31,175][105115] Avg episode reward: [(0, '-5.137'), (1, '-5.480')] [2023-12-27 23:16:31,336][106226] Updated weights for policy 0, policy_version 561268 (0.0008) [2023-12-27 23:16:31,409][106226] Updated weights for policy 0, policy_version 561278 (0.0008) [2023-12-27 23:16:31,475][106226] Updated weights for policy 0, policy_version 561288 (0.0006) [2023-12-27 23:16:31,754][106225] Updated weights for policy 1, policy_version 563033 (0.0009) [2023-12-27 23:16:31,814][106225] Updated weights for policy 1, policy_version 563043 (0.0008) [2023-12-27 23:16:31,865][106225] Updated weights for policy 1, policy_version 563053 (0.0006) [2023-12-27 23:16:32,204][106226] Updated weights for policy 0, policy_version 561298 (0.0008) [2023-12-27 23:16:32,263][106226] Updated weights for policy 0, policy_version 561308 (0.0009) [2023-12-27 23:16:32,320][106226] Updated weights for policy 0, policy_version 561318 (0.0008) [2023-12-27 23:16:32,394][106226] Updated weights for policy 0, policy_version 561328 (0.0009) [2023-12-27 23:16:32,537][106225] Updated weights for policy 1, policy_version 563063 (0.0007) [2023-12-27 23:16:32,584][106225] Updated weights for policy 1, policy_version 563073 (0.0009) [2023-12-27 23:16:32,633][106225] Updated weights for policy 1, policy_version 563083 (0.0008) [2023-12-27 23:16:33,145][106226] Updated weights for policy 0, policy_version 561338 (0.0008) [2023-12-27 23:16:33,189][106226] Updated weights for policy 0, policy_version 561348 (0.0007) [2023-12-27 23:16:33,244][106226] Updated weights for policy 0, policy_version 561358 (0.0005) [2023-12-27 23:16:33,381][106225] Updated weights for policy 1, policy_version 563093 (0.0007) [2023-12-27 23:16:33,436][106225] Updated weights for policy 1, policy_version 563103 (0.0005) [2023-12-27 23:16:33,482][106225] Updated weights for policy 1, policy_version 563113 (0.0008) [2023-12-27 23:16:33,993][106226] Updated weights for policy 0, policy_version 561368 (0.0008) [2023-12-27 23:16:34,042][106226] Updated weights for policy 0, policy_version 561378 (0.0005) [2023-12-27 23:16:34,050][106225] Updated weights for policy 1, policy_version 563123 (0.0007) [2023-12-27 23:16:34,099][106225] Updated weights for policy 1, policy_version 563133 (0.0009) [2023-12-27 23:16:34,099][106226] Updated weights for policy 0, policy_version 561388 (0.0005) [2023-12-27 23:16:34,153][106225] Updated weights for policy 1, policy_version 563143 (0.0010) [2023-12-27 23:16:34,840][106226] Updated weights for policy 0, policy_version 561398 (0.0007) [2023-12-27 23:16:34,896][106226] Updated weights for policy 0, policy_version 561408 (0.0007) [2023-12-27 23:16:34,897][106225] Updated weights for policy 1, policy_version 563153 (0.0010) [2023-12-27 23:16:34,944][106225] Updated weights for policy 1, policy_version 563163 (0.0010) [2023-12-27 23:16:34,960][106226] Updated weights for policy 0, policy_version 561418 (0.0005) [2023-12-27 23:16:34,998][106225] Updated weights for policy 1, policy_version 563173 (0.0010) [2023-12-27 23:16:35,051][106225] Updated weights for policy 1, policy_version 563183 (0.0010) [2023-12-27 23:16:35,670][106226] Updated weights for policy 0, policy_version 561428 (0.0007) [2023-12-27 23:16:35,729][106226] Updated weights for policy 0, policy_version 561438 (0.0008) [2023-12-27 23:16:35,781][106225] Updated weights for policy 1, policy_version 563193 (0.0010) [2023-12-27 23:16:35,783][106226] Updated weights for policy 0, policy_version 561448 (0.0006) [2023-12-27 23:16:35,841][106225] Updated weights for policy 1, policy_version 563203 (0.0008) [2023-12-27 23:16:35,886][106225] Updated weights for policy 1, policy_version 563213 (0.0005) [2023-12-27 23:16:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 287981568. Throughput: 0: 9616.3, 1: 9912.8. Samples: 287989036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:36,175][105115] Avg episode reward: [(0, '-5.204'), (1, '-5.539')] [2023-12-27 23:16:36,493][106225] Updated weights for policy 1, policy_version 563223 (0.0009) [2023-12-27 23:16:36,552][106225] Updated weights for policy 1, policy_version 563233 (0.0011) [2023-12-27 23:16:36,569][106226] Updated weights for policy 0, policy_version 561458 (0.0008) [2023-12-27 23:16:36,614][106225] Updated weights for policy 1, policy_version 563243 (0.0011) [2023-12-27 23:16:36,628][106226] Updated weights for policy 0, policy_version 561468 (0.0006) [2023-12-27 23:16:36,683][106226] Updated weights for policy 0, policy_version 561478 (0.0008) [2023-12-27 23:16:36,735][106226] Updated weights for policy 0, policy_version 561488 (0.0008) [2023-12-27 23:16:37,222][106225] Updated weights for policy 1, policy_version 563253 (0.0008) [2023-12-27 23:16:37,285][106225] Updated weights for policy 1, policy_version 563263 (0.0005) [2023-12-27 23:16:37,348][106225] Updated weights for policy 1, policy_version 563273 (0.0005) [2023-12-27 23:16:37,552][106226] Updated weights for policy 0, policy_version 561498 (0.0009) [2023-12-27 23:16:37,604][106226] Updated weights for policy 0, policy_version 561508 (0.0007) [2023-12-27 23:16:37,662][106226] Updated weights for policy 0, policy_version 561518 (0.0008) [2023-12-27 23:16:37,882][106225] Updated weights for policy 1, policy_version 563283 (0.0006) [2023-12-27 23:16:37,931][106225] Updated weights for policy 1, policy_version 563293 (0.0007) [2023-12-27 23:16:37,984][106225] Updated weights for policy 1, policy_version 563303 (0.0005) [2023-12-27 23:16:38,491][106226] Updated weights for policy 0, policy_version 561528 (0.0009) [2023-12-27 23:16:38,554][106226] Updated weights for policy 0, policy_version 561538 (0.0009) [2023-12-27 23:16:38,605][106225] Updated weights for policy 1, policy_version 563313 (0.0006) [2023-12-27 23:16:38,618][106226] Updated weights for policy 0, policy_version 561548 (0.0009) [2023-12-27 23:16:38,658][106225] Updated weights for policy 1, policy_version 563323 (0.0007) [2023-12-27 23:16:38,709][106225] Updated weights for policy 1, policy_version 563333 (0.0006) [2023-12-27 23:16:38,766][106225] Updated weights for policy 1, policy_version 563343 (0.0007) [2023-12-27 23:16:39,407][106226] Updated weights for policy 0, policy_version 561558 (0.0008) [2023-12-27 23:16:39,457][106225] Updated weights for policy 1, policy_version 563353 (0.0008) [2023-12-27 23:16:39,472][106226] Updated weights for policy 0, policy_version 561568 (0.0008) [2023-12-27 23:16:39,514][106225] Updated weights for policy 1, policy_version 563363 (0.0006) [2023-12-27 23:16:39,535][106226] Updated weights for policy 0, policy_version 561578 (0.0008) [2023-12-27 23:16:39,570][106225] Updated weights for policy 1, policy_version 563373 (0.0006) [2023-12-27 23:16:40,238][106225] Updated weights for policy 1, policy_version 563383 (0.0008) [2023-12-27 23:16:40,304][106225] Updated weights for policy 1, policy_version 563393 (0.0009) [2023-12-27 23:16:40,367][106225] Updated weights for policy 1, policy_version 563403 (0.0008) [2023-12-27 23:16:40,373][106226] Updated weights for policy 0, policy_version 561588 (0.0007) [2023-12-27 23:16:40,441][106226] Updated weights for policy 0, policy_version 561598 (0.0007) [2023-12-27 23:16:40,505][106226] Updated weights for policy 0, policy_version 561608 (0.0007) [2023-12-27 23:16:41,136][106225] Updated weights for policy 1, policy_version 563413 (0.0008) [2023-12-27 23:16:41,147][106226] Updated weights for policy 0, policy_version 561618 (0.0006) [2023-12-27 23:16:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 288071680. Throughput: 0: 9587.4, 1: 10009.8. Samples: 288049704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:41,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.660')] [2023-12-27 23:16:41,200][106225] Updated weights for policy 1, policy_version 563423 (0.0008) [2023-12-27 23:16:41,207][106226] Updated weights for policy 0, policy_version 561628 (0.0008) [2023-12-27 23:16:41,263][106225] Updated weights for policy 1, policy_version 563433 (0.0008) [2023-12-27 23:16:41,266][106226] Updated weights for policy 0, policy_version 561638 (0.0006) [2023-12-27 23:16:41,305][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000563440_144269312.pth... [2023-12-27 23:16:41,309][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000562224_143958016.pth [2023-12-27 23:16:41,333][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000561648_143818752.pth... [2023-12-27 23:16:41,334][106226] Updated weights for policy 0, policy_version 561648 (0.0007) [2023-12-27 23:16:41,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000560496_143523840.pth [2023-12-27 23:16:42,053][106225] Updated weights for policy 1, policy_version 563443 (0.0007) [2023-12-27 23:16:42,102][106226] Updated weights for policy 0, policy_version 561658 (0.0009) [2023-12-27 23:16:42,119][106225] Updated weights for policy 1, policy_version 563453 (0.0007) [2023-12-27 23:16:42,168][106226] Updated weights for policy 0, policy_version 561668 (0.0009) [2023-12-27 23:16:42,181][106225] Updated weights for policy 1, policy_version 563463 (0.0007) [2023-12-27 23:16:42,237][106226] Updated weights for policy 0, policy_version 561678 (0.0008) [2023-12-27 23:16:42,917][106225] Updated weights for policy 1, policy_version 563473 (0.0006) [2023-12-27 23:16:42,937][106226] Updated weights for policy 0, policy_version 561688 (0.0008) [2023-12-27 23:16:42,965][106225] Updated weights for policy 1, policy_version 563483 (0.0009) [2023-12-27 23:16:42,995][106226] Updated weights for policy 0, policy_version 561698 (0.0007) [2023-12-27 23:16:43,017][106225] Updated weights for policy 1, policy_version 563493 (0.0006) [2023-12-27 23:16:43,055][106226] Updated weights for policy 0, policy_version 561708 (0.0007) [2023-12-27 23:16:43,069][106225] Updated weights for policy 1, policy_version 563503 (0.0005) [2023-12-27 23:16:43,717][106226] Updated weights for policy 0, policy_version 561718 (0.0007) [2023-12-27 23:16:43,781][106226] Updated weights for policy 0, policy_version 561728 (0.0006) [2023-12-27 23:16:43,839][106226] Updated weights for policy 0, policy_version 561738 (0.0009) [2023-12-27 23:16:43,850][106225] Updated weights for policy 1, policy_version 563513 (0.0006) [2023-12-27 23:16:43,907][106225] Updated weights for policy 1, policy_version 563523 (0.0005) [2023-12-27 23:16:43,967][106225] Updated weights for policy 1, policy_version 563533 (0.0006) [2023-12-27 23:16:44,402][106226] Updated weights for policy 0, policy_version 561748 (0.0007) [2023-12-27 23:16:44,475][106226] Updated weights for policy 0, policy_version 561758 (0.0008) [2023-12-27 23:16:44,541][106226] Updated weights for policy 0, policy_version 561768 (0.0008) [2023-12-27 23:16:44,546][106225] Updated weights for policy 1, policy_version 563543 (0.0010) [2023-12-27 23:16:44,602][106225] Updated weights for policy 1, policy_version 563553 (0.0010) [2023-12-27 23:16:44,655][106225] Updated weights for policy 1, policy_version 563563 (0.0010) [2023-12-27 23:16:45,171][106226] Updated weights for policy 0, policy_version 561778 (0.0010) [2023-12-27 23:16:45,235][106226] Updated weights for policy 0, policy_version 561788 (0.0011) [2023-12-27 23:16:45,303][106226] Updated weights for policy 0, policy_version 561798 (0.0011) [2023-12-27 23:16:45,372][106226] Updated weights for policy 0, policy_version 561808 (0.0011) [2023-12-27 23:16:45,412][106225] Updated weights for policy 1, policy_version 563573 (0.0010) [2023-12-27 23:16:45,472][106225] Updated weights for policy 1, policy_version 563583 (0.0010) [2023-12-27 23:16:45,532][106225] Updated weights for policy 1, policy_version 563593 (0.0010) [2023-12-27 23:16:46,068][106226] Updated weights for policy 0, policy_version 561818 (0.0010) [2023-12-27 23:16:46,127][106226] Updated weights for policy 0, policy_version 561828 (0.0010) [2023-12-27 23:16:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 288169984. Throughput: 0: 9710.5, 1: 9999.3. Samples: 288166660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:46,175][105115] Avg episode reward: [(0, '-5.084'), (1, '-5.508')] [2023-12-27 23:16:46,189][106226] Updated weights for policy 0, policy_version 561838 (0.0010) [2023-12-27 23:16:46,234][106225] Updated weights for policy 1, policy_version 563603 (0.0010) [2023-12-27 23:16:46,284][106225] Updated weights for policy 1, policy_version 563613 (0.0010) [2023-12-27 23:16:46,337][106225] Updated weights for policy 1, policy_version 563623 (0.0010) [2023-12-27 23:16:46,888][106226] Updated weights for policy 0, policy_version 561848 (0.0010) [2023-12-27 23:16:46,954][106226] Updated weights for policy 0, policy_version 561858 (0.0010) [2023-12-27 23:16:47,015][106226] Updated weights for policy 0, policy_version 561868 (0.0010) [2023-12-27 23:16:47,064][106225] Updated weights for policy 1, policy_version 563633 (0.0010) [2023-12-27 23:16:47,127][106225] Updated weights for policy 1, policy_version 563643 (0.0010) [2023-12-27 23:16:47,191][106225] Updated weights for policy 1, policy_version 563653 (0.0010) [2023-12-27 23:16:47,250][106225] Updated weights for policy 1, policy_version 563663 (0.0010) [2023-12-27 23:16:47,651][106226] Updated weights for policy 0, policy_version 561878 (0.0009) [2023-12-27 23:16:47,716][106226] Updated weights for policy 0, policy_version 561888 (0.0011) [2023-12-27 23:16:47,778][106226] Updated weights for policy 0, policy_version 561898 (0.0010) [2023-12-27 23:16:47,959][106225] Updated weights for policy 1, policy_version 563673 (0.0006) [2023-12-27 23:16:48,024][106225] Updated weights for policy 1, policy_version 563683 (0.0005) [2023-12-27 23:16:48,091][106225] Updated weights for policy 1, policy_version 563693 (0.0007) [2023-12-27 23:16:48,478][106226] Updated weights for policy 0, policy_version 561908 (0.0011) [2023-12-27 23:16:48,541][106226] Updated weights for policy 0, policy_version 561918 (0.0011) [2023-12-27 23:16:48,606][106226] Updated weights for policy 0, policy_version 561928 (0.0011) [2023-12-27 23:16:48,754][106225] Updated weights for policy 1, policy_version 563703 (0.0007) [2023-12-27 23:16:48,816][106225] Updated weights for policy 1, policy_version 563713 (0.0007) [2023-12-27 23:16:48,870][106225] Updated weights for policy 1, policy_version 563723 (0.0008) [2023-12-27 23:16:49,305][106226] Updated weights for policy 0, policy_version 561938 (0.0010) [2023-12-27 23:16:49,376][106226] Updated weights for policy 0, policy_version 561948 (0.0009) [2023-12-27 23:16:49,440][106226] Updated weights for policy 0, policy_version 561958 (0.0006) [2023-12-27 23:16:49,507][106226] Updated weights for policy 0, policy_version 561968 (0.0005) [2023-12-27 23:16:49,620][106225] Updated weights for policy 1, policy_version 563733 (0.0007) [2023-12-27 23:16:49,686][106225] Updated weights for policy 1, policy_version 563743 (0.0005) [2023-12-27 23:16:49,754][106225] Updated weights for policy 1, policy_version 563753 (0.0005) [2023-12-27 23:16:50,152][106226] Updated weights for policy 0, policy_version 561978 (0.0008) [2023-12-27 23:16:50,214][106226] Updated weights for policy 0, policy_version 561988 (0.0008) [2023-12-27 23:16:50,269][106226] Updated weights for policy 0, policy_version 561998 (0.0008) [2023-12-27 23:16:50,399][106225] Updated weights for policy 1, policy_version 563763 (0.0007) [2023-12-27 23:16:50,456][106225] Updated weights for policy 1, policy_version 563773 (0.0006) [2023-12-27 23:16:50,521][106225] Updated weights for policy 1, policy_version 563783 (0.0006) [2023-12-27 23:16:51,060][106226] Updated weights for policy 0, policy_version 562008 (0.0009) [2023-12-27 23:16:51,119][106226] Updated weights for policy 0, policy_version 562018 (0.0008) [2023-12-27 23:16:51,130][106225] Updated weights for policy 1, policy_version 563793 (0.0007) [2023-12-27 23:16:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 288268288. Throughput: 0: 9734.7, 1: 10006.2. Samples: 288284204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:51,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-5.858')] [2023-12-27 23:16:51,183][106226] Updated weights for policy 0, policy_version 562028 (0.0008) [2023-12-27 23:16:51,189][106225] Updated weights for policy 1, policy_version 563803 (0.0008) [2023-12-27 23:16:51,238][106225] Updated weights for policy 1, policy_version 563813 (0.0007) [2023-12-27 23:16:51,304][106225] Updated weights for policy 1, policy_version 563823 (0.0008) [2023-12-27 23:16:51,947][106226] Updated weights for policy 0, policy_version 562038 (0.0008) [2023-12-27 23:16:52,007][106226] Updated weights for policy 0, policy_version 562048 (0.0010) [2023-12-27 23:16:52,066][106226] Updated weights for policy 0, policy_version 562058 (0.0007) [2023-12-27 23:16:52,068][106225] Updated weights for policy 1, policy_version 563833 (0.0007) [2023-12-27 23:16:52,124][106225] Updated weights for policy 1, policy_version 563843 (0.0006) [2023-12-27 23:16:52,189][106225] Updated weights for policy 1, policy_version 563853 (0.0009) [2023-12-27 23:16:52,742][106226] Updated weights for policy 0, policy_version 562068 (0.0006) [2023-12-27 23:16:52,808][106226] Updated weights for policy 0, policy_version 562078 (0.0007) [2023-12-27 23:16:52,875][106226] Updated weights for policy 0, policy_version 562088 (0.0006) [2023-12-27 23:16:52,964][106225] Updated weights for policy 1, policy_version 563863 (0.0010) [2023-12-27 23:16:53,024][106225] Updated weights for policy 1, policy_version 563873 (0.0010) [2023-12-27 23:16:53,074][106225] Updated weights for policy 1, policy_version 563883 (0.0006) [2023-12-27 23:16:53,581][106226] Updated weights for policy 0, policy_version 562098 (0.0006) [2023-12-27 23:16:53,641][106226] Updated weights for policy 0, policy_version 562108 (0.0008) [2023-12-27 23:16:53,648][106225] Updated weights for policy 1, policy_version 563893 (0.0008) [2023-12-27 23:16:53,698][106226] Updated weights for policy 0, policy_version 562118 (0.0007) [2023-12-27 23:16:53,708][106225] Updated weights for policy 1, policy_version 563903 (0.0008) [2023-12-27 23:16:53,758][106226] Updated weights for policy 0, policy_version 562128 (0.0006) [2023-12-27 23:16:53,765][106225] Updated weights for policy 1, policy_version 563913 (0.0008) [2023-12-27 23:16:54,431][106225] Updated weights for policy 1, policy_version 563923 (0.0007) [2023-12-27 23:16:54,485][106225] Updated weights for policy 1, policy_version 563933 (0.0006) [2023-12-27 23:16:54,502][106226] Updated weights for policy 0, policy_version 562138 (0.0008) [2023-12-27 23:16:54,544][106225] Updated weights for policy 1, policy_version 563943 (0.0007) [2023-12-27 23:16:54,561][106226] Updated weights for policy 0, policy_version 562148 (0.0006) [2023-12-27 23:16:54,625][106226] Updated weights for policy 0, policy_version 562158 (0.0006) [2023-12-27 23:16:55,103][106225] Updated weights for policy 1, policy_version 563953 (0.0008) [2023-12-27 23:16:55,171][106225] Updated weights for policy 1, policy_version 563963 (0.0005) [2023-12-27 23:16:55,233][106225] Updated weights for policy 1, policy_version 563973 (0.0006) [2023-12-27 23:16:55,288][106225] Updated weights for policy 1, policy_version 563983 (0.0005) [2023-12-27 23:16:55,339][106226] Updated weights for policy 0, policy_version 562168 (0.0009) [2023-12-27 23:16:55,384][106226] Updated weights for policy 0, policy_version 562178 (0.0008) [2023-12-27 23:16:55,429][106226] Updated weights for policy 0, policy_version 562188 (0.0008) [2023-12-27 23:16:55,835][106225] Updated weights for policy 1, policy_version 563993 (0.0008) [2023-12-27 23:16:55,885][106225] Updated weights for policy 1, policy_version 564003 (0.0008) [2023-12-27 23:16:55,944][106225] Updated weights for policy 1, policy_version 564013 (0.0005) [2023-12-27 23:16:56,078][106226] Updated weights for policy 0, policy_version 562198 (0.0008) [2023-12-27 23:16:56,129][106226] Updated weights for policy 0, policy_version 562208 (0.0009) [2023-12-27 23:16:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 288374784. Throughput: 0: 9739.0, 1: 10022.9. Samples: 288342608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:16:56,175][105115] Avg episode reward: [(0, '-5.119'), (1, '-5.198')] [2023-12-27 23:16:56,178][106226] Updated weights for policy 0, policy_version 562218 (0.0009) [2023-12-27 23:16:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000564016_144416768.pth... [2023-12-27 23:16:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000562832_144113664.pth [2023-12-27 23:16:56,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000562224_143966208.pth... [2023-12-27 23:16:56,217][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000561072_143671296.pth [2023-12-27 23:16:56,626][106225] Updated weights for policy 1, policy_version 564023 (0.0007) [2023-12-27 23:16:56,681][106225] Updated weights for policy 1, policy_version 564033 (0.0005) [2023-12-27 23:16:56,751][106225] Updated weights for policy 1, policy_version 564043 (0.0005) [2023-12-27 23:16:56,842][106226] Updated weights for policy 0, policy_version 562228 (0.0008) [2023-12-27 23:16:56,891][106226] Updated weights for policy 0, policy_version 562238 (0.0009) [2023-12-27 23:16:56,936][106226] Updated weights for policy 0, policy_version 562248 (0.0007) [2023-12-27 23:16:57,261][106225] Updated weights for policy 1, policy_version 564053 (0.0005) [2023-12-27 23:16:57,322][106225] Updated weights for policy 1, policy_version 564063 (0.0007) [2023-12-27 23:16:57,378][106225] Updated weights for policy 1, policy_version 564073 (0.0006) [2023-12-27 23:16:57,603][106226] Updated weights for policy 0, policy_version 562258 (0.0005) [2023-12-27 23:16:57,660][106226] Updated weights for policy 0, policy_version 562268 (0.0005) [2023-12-27 23:16:57,718][106226] Updated weights for policy 0, policy_version 562278 (0.0005) [2023-12-27 23:16:57,780][106226] Updated weights for policy 0, policy_version 562288 (0.0005) [2023-12-27 23:16:57,981][106225] Updated weights for policy 1, policy_version 564083 (0.0009) [2023-12-27 23:16:58,031][106225] Updated weights for policy 1, policy_version 564093 (0.0007) [2023-12-27 23:16:58,092][106225] Updated weights for policy 1, policy_version 564103 (0.0006) [2023-12-27 23:16:58,301][106226] Updated weights for policy 0, policy_version 562298 (0.0011) [2023-12-27 23:16:58,370][106226] Updated weights for policy 0, policy_version 562308 (0.0010) [2023-12-27 23:16:58,429][106226] Updated weights for policy 0, policy_version 562318 (0.0009) [2023-12-27 23:16:58,835][106225] Updated weights for policy 1, policy_version 564113 (0.0006) [2023-12-27 23:16:58,908][106225] Updated weights for policy 1, policy_version 564123 (0.0008) [2023-12-27 23:16:58,971][106225] Updated weights for policy 1, policy_version 564133 (0.0007) [2023-12-27 23:16:59,036][106225] Updated weights for policy 1, policy_version 564143 (0.0008) [2023-12-27 23:16:59,251][106226] Updated weights for policy 0, policy_version 562328 (0.0009) [2023-12-27 23:16:59,317][106226] Updated weights for policy 0, policy_version 562338 (0.0008) [2023-12-27 23:16:59,382][106226] Updated weights for policy 0, policy_version 562348 (0.0009) [2023-12-27 23:16:59,702][106225] Updated weights for policy 1, policy_version 564153 (0.0008) [2023-12-27 23:16:59,752][106225] Updated weights for policy 1, policy_version 564163 (0.0009) [2023-12-27 23:16:59,816][106225] Updated weights for policy 1, policy_version 564173 (0.0009) [2023-12-27 23:17:00,033][106226] Updated weights for policy 0, policy_version 562358 (0.0008) [2023-12-27 23:17:00,101][106226] Updated weights for policy 0, policy_version 562368 (0.0006) [2023-12-27 23:17:00,162][106226] Updated weights for policy 0, policy_version 562378 (0.0006) [2023-12-27 23:17:00,514][106225] Updated weights for policy 1, policy_version 564183 (0.0008) [2023-12-27 23:17:00,565][106225] Updated weights for policy 1, policy_version 564193 (0.0008) [2023-12-27 23:17:00,610][106225] Updated weights for policy 1, policy_version 564203 (0.0007) [2023-12-27 23:17:00,791][106226] Updated weights for policy 0, policy_version 562388 (0.0010) [2023-12-27 23:17:00,847][106226] Updated weights for policy 0, policy_version 562398 (0.0010) [2023-12-27 23:17:00,902][106226] Updated weights for policy 0, policy_version 562408 (0.0010) [2023-12-27 23:17:01,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 288481280. Throughput: 0: 9838.7, 1: 10132.8. Samples: 288469648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:17:01,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-5.355')] [2023-12-27 23:17:01,359][106225] Updated weights for policy 1, policy_version 564213 (0.0008) [2023-12-27 23:17:01,423][106225] Updated weights for policy 1, policy_version 564223 (0.0007) [2023-12-27 23:17:01,478][106225] Updated weights for policy 1, policy_version 564233 (0.0005) [2023-12-27 23:17:01,676][106226] Updated weights for policy 0, policy_version 562418 (0.0010) [2023-12-27 23:17:01,742][106226] Updated weights for policy 0, policy_version 562428 (0.0010) [2023-12-27 23:17:01,800][106226] Updated weights for policy 0, policy_version 562438 (0.0011) [2023-12-27 23:17:01,847][106226] Updated weights for policy 0, policy_version 562448 (0.0010) [2023-12-27 23:17:02,104][106225] Updated weights for policy 1, policy_version 564243 (0.0007) [2023-12-27 23:17:02,170][106225] Updated weights for policy 1, policy_version 564253 (0.0006) [2023-12-27 23:17:02,232][106225] Updated weights for policy 1, policy_version 564263 (0.0007) [2023-12-27 23:17:02,608][106226] Updated weights for policy 0, policy_version 562458 (0.0011) [2023-12-27 23:17:02,671][106226] Updated weights for policy 0, policy_version 562468 (0.0011) [2023-12-27 23:17:02,731][106226] Updated weights for policy 0, policy_version 562478 (0.0010) [2023-12-27 23:17:02,903][106225] Updated weights for policy 1, policy_version 564273 (0.0010) [2023-12-27 23:17:02,956][106225] Updated weights for policy 1, policy_version 564283 (0.0008) [2023-12-27 23:17:03,002][106225] Updated weights for policy 1, policy_version 564293 (0.0007) [2023-12-27 23:17:03,044][106225] Updated weights for policy 1, policy_version 564303 (0.0006) [2023-12-27 23:17:03,418][106226] Updated weights for policy 0, policy_version 562488 (0.0010) [2023-12-27 23:17:03,480][106226] Updated weights for policy 0, policy_version 562498 (0.0010) [2023-12-27 23:17:03,532][106226] Updated weights for policy 0, policy_version 562508 (0.0010) [2023-12-27 23:17:03,705][106225] Updated weights for policy 1, policy_version 564313 (0.0008) [2023-12-27 23:17:03,752][106225] Updated weights for policy 1, policy_version 564323 (0.0007) [2023-12-27 23:17:03,807][106225] Updated weights for policy 1, policy_version 564333 (0.0008) [2023-12-27 23:17:04,202][106226] Updated weights for policy 0, policy_version 562518 (0.0009) [2023-12-27 23:17:04,267][106226] Updated weights for policy 0, policy_version 562528 (0.0008) [2023-12-27 23:17:04,322][106226] Updated weights for policy 0, policy_version 562538 (0.0009) [2023-12-27 23:17:04,601][106225] Updated weights for policy 1, policy_version 564343 (0.0008) [2023-12-27 23:17:04,660][106225] Updated weights for policy 1, policy_version 564353 (0.0008) [2023-12-27 23:17:04,715][106225] Updated weights for policy 1, policy_version 564363 (0.0008) [2023-12-27 23:17:05,029][106226] Updated weights for policy 0, policy_version 562548 (0.0008) [2023-12-27 23:17:05,092][106226] Updated weights for policy 0, policy_version 562558 (0.0006) [2023-12-27 23:17:05,171][106226] Updated weights for policy 0, policy_version 562568 (0.0006) [2023-12-27 23:17:05,481][106225] Updated weights for policy 1, policy_version 564373 (0.0008) [2023-12-27 23:17:05,530][106225] Updated weights for policy 1, policy_version 564383 (0.0008) [2023-12-27 23:17:05,592][106225] Updated weights for policy 1, policy_version 564393 (0.0008) [2023-12-27 23:17:05,795][106226] Updated weights for policy 0, policy_version 562578 (0.0006) [2023-12-27 23:17:05,847][106226] Updated weights for policy 0, policy_version 562588 (0.0006) [2023-12-27 23:17:05,894][106226] Updated weights for policy 0, policy_version 562598 (0.0005) [2023-12-27 23:17:05,956][106226] Updated weights for policy 0, policy_version 562608 (0.0005) [2023-12-27 23:17:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 288579584. Throughput: 0: 9778.9, 1: 10109.0. Samples: 288588784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:17:06,175][105115] Avg episode reward: [(0, '-5.129'), (1, '-5.648')] [2023-12-27 23:17:06,401][106225] Updated weights for policy 1, policy_version 564403 (0.0009) [2023-12-27 23:17:06,464][106225] Updated weights for policy 1, policy_version 564413 (0.0008) [2023-12-27 23:17:06,517][106225] Updated weights for policy 1, policy_version 564423 (0.0008) [2023-12-27 23:17:06,570][106226] Updated weights for policy 0, policy_version 562618 (0.0007) [2023-12-27 23:17:06,628][106226] Updated weights for policy 0, policy_version 562628 (0.0009) [2023-12-27 23:17:06,691][106226] Updated weights for policy 0, policy_version 562638 (0.0009) [2023-12-27 23:17:07,257][106225] Updated weights for policy 1, policy_version 564433 (0.0007) [2023-12-27 23:17:07,319][106225] Updated weights for policy 1, policy_version 564443 (0.0009) [2023-12-27 23:17:07,382][106225] Updated weights for policy 1, policy_version 564453 (0.0007) [2023-12-27 23:17:07,396][106226] Updated weights for policy 0, policy_version 562648 (0.0007) [2023-12-27 23:17:07,430][106225] Updated weights for policy 1, policy_version 564463 (0.0006) [2023-12-27 23:17:07,449][106226] Updated weights for policy 0, policy_version 562658 (0.0007) [2023-12-27 23:17:07,501][106226] Updated weights for policy 0, policy_version 562668 (0.0009) [2023-12-27 23:17:08,166][106226] Updated weights for policy 0, policy_version 562678 (0.0009) [2023-12-27 23:17:08,191][106225] Updated weights for policy 1, policy_version 564473 (0.0006) [2023-12-27 23:17:08,225][106226] Updated weights for policy 0, policy_version 562688 (0.0009) [2023-12-27 23:17:08,247][106225] Updated weights for policy 1, policy_version 564483 (0.0009) [2023-12-27 23:17:08,279][106226] Updated weights for policy 0, policy_version 562698 (0.0008) [2023-12-27 23:17:08,308][106225] Updated weights for policy 1, policy_version 564493 (0.0007) [2023-12-27 23:17:09,022][106226] Updated weights for policy 0, policy_version 562708 (0.0009) [2023-12-27 23:17:09,034][106225] Updated weights for policy 1, policy_version 564503 (0.0009) [2023-12-27 23:17:09,080][106226] Updated weights for policy 0, policy_version 562718 (0.0008) [2023-12-27 23:17:09,091][106225] Updated weights for policy 1, policy_version 564513 (0.0007) [2023-12-27 23:17:09,145][106226] Updated weights for policy 0, policy_version 562728 (0.0008) [2023-12-27 23:17:09,145][106225] Updated weights for policy 1, policy_version 564523 (0.0007) [2023-12-27 23:17:09,823][106226] Updated weights for policy 0, policy_version 562738 (0.0008) [2023-12-27 23:17:09,893][106226] Updated weights for policy 0, policy_version 562748 (0.0007) [2023-12-27 23:17:09,933][106225] Updated weights for policy 1, policy_version 564533 (0.0008) [2023-12-27 23:17:09,966][106226] Updated weights for policy 0, policy_version 562758 (0.0008) [2023-12-27 23:17:09,996][106225] Updated weights for policy 1, policy_version 564543 (0.0006) [2023-12-27 23:17:10,033][106226] Updated weights for policy 0, policy_version 562768 (0.0008) [2023-12-27 23:17:10,062][106225] Updated weights for policy 1, policy_version 564553 (0.0006) [2023-12-27 23:17:10,751][106226] Updated weights for policy 0, policy_version 562778 (0.0008) [2023-12-27 23:17:10,780][106225] Updated weights for policy 1, policy_version 564563 (0.0007) [2023-12-27 23:17:10,802][106226] Updated weights for policy 0, policy_version 562788 (0.0007) [2023-12-27 23:17:10,838][106225] Updated weights for policy 1, policy_version 564573 (0.0009) [2023-12-27 23:17:10,853][106226] Updated weights for policy 0, policy_version 562798 (0.0008) [2023-12-27 23:17:10,889][106225] Updated weights for policy 1, policy_version 564583 (0.0008) [2023-12-27 23:17:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 288677888. Throughput: 0: 9829.5, 1: 10085.2. Samples: 288647052. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:11,175][105115] Avg episode reward: [(0, '-4.974'), (1, '-5.581')] [2023-12-27 23:17:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000564592_144564224.pth... [2023-12-27 23:17:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000562800_144113664.pth... [2023-12-27 23:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000563440_144269312.pth [2023-12-27 23:17:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000561648_143818752.pth [2023-12-27 23:17:11,630][106226] Updated weights for policy 0, policy_version 562808 (0.0007) [2023-12-27 23:17:11,706][106226] Updated weights for policy 0, policy_version 562818 (0.0008) [2023-12-27 23:17:11,708][106225] Updated weights for policy 1, policy_version 564593 (0.0008) [2023-12-27 23:17:11,773][106226] Updated weights for policy 0, policy_version 562828 (0.0009) [2023-12-27 23:17:11,773][106225] Updated weights for policy 1, policy_version 564603 (0.0008) [2023-12-27 23:17:11,832][106225] Updated weights for policy 1, policy_version 564613 (0.0008) [2023-12-27 23:17:11,889][106225] Updated weights for policy 1, policy_version 564623 (0.0009) [2023-12-27 23:17:12,522][106226] Updated weights for policy 0, policy_version 562838 (0.0008) [2023-12-27 23:17:12,585][106226] Updated weights for policy 0, policy_version 562848 (0.0008) [2023-12-27 23:17:12,642][106226] Updated weights for policy 0, policy_version 562858 (0.0008) [2023-12-27 23:17:12,645][106225] Updated weights for policy 1, policy_version 564633 (0.0007) [2023-12-27 23:17:12,706][106225] Updated weights for policy 1, policy_version 564643 (0.0005) [2023-12-27 23:17:12,760][106225] Updated weights for policy 1, policy_version 564653 (0.0008) [2023-12-27 23:17:13,391][106226] Updated weights for policy 0, policy_version 562868 (0.0009) [2023-12-27 23:17:13,454][106226] Updated weights for policy 0, policy_version 562878 (0.0008) [2023-12-27 23:17:13,457][106225] Updated weights for policy 1, policy_version 564663 (0.0007) [2023-12-27 23:17:13,514][106225] Updated weights for policy 1, policy_version 564673 (0.0006) [2023-12-27 23:17:13,516][106226] Updated weights for policy 0, policy_version 562888 (0.0007) [2023-12-27 23:17:13,569][106225] Updated weights for policy 1, policy_version 564683 (0.0007) [2023-12-27 23:17:14,188][106225] Updated weights for policy 1, policy_version 564693 (0.0008) [2023-12-27 23:17:14,225][106226] Updated weights for policy 0, policy_version 562898 (0.0007) [2023-12-27 23:17:14,236][106225] Updated weights for policy 1, policy_version 564703 (0.0007) [2023-12-27 23:17:14,279][106226] Updated weights for policy 0, policy_version 562908 (0.0005) [2023-12-27 23:17:14,288][106225] Updated weights for policy 1, policy_version 564713 (0.0008) [2023-12-27 23:17:14,334][106226] Updated weights for policy 0, policy_version 562918 (0.0006) [2023-12-27 23:17:14,392][106226] Updated weights for policy 0, policy_version 562928 (0.0008) [2023-12-27 23:17:15,039][106226] Updated weights for policy 0, policy_version 562938 (0.0010) [2023-12-27 23:17:15,070][106225] Updated weights for policy 1, policy_version 564723 (0.0008) [2023-12-27 23:17:15,110][106226] Updated weights for policy 0, policy_version 562948 (0.0007) [2023-12-27 23:17:15,141][106225] Updated weights for policy 1, policy_version 564733 (0.0007) [2023-12-27 23:17:15,170][106226] Updated weights for policy 0, policy_version 562958 (0.0007) [2023-12-27 23:17:15,209][106225] Updated weights for policy 1, policy_version 564743 (0.0006) [2023-12-27 23:17:15,746][106225] Updated weights for policy 1, policy_version 564753 (0.0006) [2023-12-27 23:17:15,796][106225] Updated weights for policy 1, policy_version 564763 (0.0008) [2023-12-27 23:17:15,847][106225] Updated weights for policy 1, policy_version 564773 (0.0009) [2023-12-27 23:17:15,898][106225] Updated weights for policy 1, policy_version 564783 (0.0008) [2023-12-27 23:17:15,931][106226] Updated weights for policy 0, policy_version 562968 (0.0008) [2023-12-27 23:17:15,979][106226] Updated weights for policy 0, policy_version 562978 (0.0008) [2023-12-27 23:17:16,026][106226] Updated weights for policy 0, policy_version 562988 (0.0008) [2023-12-27 23:17:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 288776192. Throughput: 0: 9752.5, 1: 10024.7. Samples: 288761256. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:16,175][105115] Avg episode reward: [(0, '-4.863'), (1, '-5.168')] [2023-12-27 23:17:16,672][106226] Updated weights for policy 0, policy_version 562998 (0.0006) [2023-12-27 23:17:16,678][106225] Updated weights for policy 1, policy_version 564793 (0.0010) [2023-12-27 23:17:16,728][106225] Updated weights for policy 1, policy_version 564803 (0.0010) [2023-12-27 23:17:16,730][106226] Updated weights for policy 0, policy_version 563008 (0.0005) [2023-12-27 23:17:16,780][106226] Updated weights for policy 0, policy_version 563018 (0.0006) [2023-12-27 23:17:16,788][106225] Updated weights for policy 1, policy_version 564813 (0.0010) [2023-12-27 23:17:17,390][106226] Updated weights for policy 0, policy_version 563028 (0.0007) [2023-12-27 23:17:17,446][106225] Updated weights for policy 1, policy_version 564823 (0.0007) [2023-12-27 23:17:17,447][106226] Updated weights for policy 0, policy_version 563038 (0.0010) [2023-12-27 23:17:17,495][106225] Updated weights for policy 1, policy_version 564833 (0.0007) [2023-12-27 23:17:17,506][106226] Updated weights for policy 0, policy_version 563048 (0.0007) [2023-12-27 23:17:17,545][106225] Updated weights for policy 1, policy_version 564843 (0.0008) [2023-12-27 23:17:18,125][106226] Updated weights for policy 0, policy_version 563058 (0.0006) [2023-12-27 23:17:18,181][106226] Updated weights for policy 0, policy_version 563068 (0.0009) [2023-12-27 23:17:18,186][106225] Updated weights for policy 1, policy_version 564853 (0.0008) [2023-12-27 23:17:18,228][106226] Updated weights for policy 0, policy_version 563078 (0.0009) [2023-12-27 23:17:18,237][106225] Updated weights for policy 1, policy_version 564863 (0.0005) [2023-12-27 23:17:18,279][106226] Updated weights for policy 0, policy_version 563088 (0.0008) [2023-12-27 23:17:18,290][106225] Updated weights for policy 1, policy_version 564873 (0.0005) [2023-12-27 23:17:18,903][106225] Updated weights for policy 1, policy_version 564883 (0.0007) [2023-12-27 23:17:18,966][106225] Updated weights for policy 1, policy_version 564893 (0.0009) [2023-12-27 23:17:19,019][106225] Updated weights for policy 1, policy_version 564903 (0.0007) [2023-12-27 23:17:19,112][106226] Updated weights for policy 0, policy_version 563098 (0.0009) [2023-12-27 23:17:19,165][106226] Updated weights for policy 0, policy_version 563108 (0.0008) [2023-12-27 23:17:19,229][106226] Updated weights for policy 0, policy_version 563118 (0.0009) [2023-12-27 23:17:19,641][106225] Updated weights for policy 1, policy_version 564913 (0.0007) [2023-12-27 23:17:19,702][106225] Updated weights for policy 1, policy_version 564923 (0.0011) [2023-12-27 23:17:19,764][106225] Updated weights for policy 1, policy_version 564933 (0.0010) [2023-12-27 23:17:19,832][106225] Updated weights for policy 1, policy_version 564943 (0.0009) [2023-12-27 23:17:19,974][106226] Updated weights for policy 0, policy_version 563128 (0.0009) [2023-12-27 23:17:20,038][106226] Updated weights for policy 0, policy_version 563138 (0.0009) [2023-12-27 23:17:20,110][106226] Updated weights for policy 0, policy_version 563148 (0.0010) [2023-12-27 23:17:20,518][106225] Updated weights for policy 1, policy_version 564953 (0.0009) [2023-12-27 23:17:20,577][106225] Updated weights for policy 1, policy_version 564963 (0.0009) [2023-12-27 23:17:20,644][106225] Updated weights for policy 1, policy_version 564973 (0.0007) [2023-12-27 23:17:20,839][106226] Updated weights for policy 0, policy_version 563158 (0.0008) [2023-12-27 23:17:20,915][106226] Updated weights for policy 0, policy_version 563168 (0.0009) [2023-12-27 23:17:20,984][106226] Updated weights for policy 0, policy_version 563178 (0.0006) [2023-12-27 23:17:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 288874496. Throughput: 0: 9791.3, 1: 10059.5. Samples: 288882320. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:21,175][105115] Avg episode reward: [(0, '-4.858'), (1, '-5.477')] [2023-12-27 23:17:21,458][106225] Updated weights for policy 1, policy_version 564983 (0.0008) [2023-12-27 23:17:21,523][106225] Updated weights for policy 1, policy_version 564993 (0.0007) [2023-12-27 23:17:21,589][106225] Updated weights for policy 1, policy_version 565003 (0.0006) [2023-12-27 23:17:21,685][106226] Updated weights for policy 0, policy_version 563188 (0.0007) [2023-12-27 23:17:21,756][106226] Updated weights for policy 0, policy_version 563198 (0.0008) [2023-12-27 23:17:21,822][106226] Updated weights for policy 0, policy_version 563208 (0.0009) [2023-12-27 23:17:22,247][106225] Updated weights for policy 1, policy_version 565013 (0.0008) [2023-12-27 23:17:22,309][106225] Updated weights for policy 1, policy_version 565023 (0.0009) [2023-12-27 23:17:22,377][106225] Updated weights for policy 1, policy_version 565033 (0.0007) [2023-12-27 23:17:22,605][106226] Updated weights for policy 0, policy_version 563218 (0.0009) [2023-12-27 23:17:22,659][106226] Updated weights for policy 0, policy_version 563228 (0.0008) [2023-12-27 23:17:22,715][106226] Updated weights for policy 0, policy_version 563238 (0.0009) [2023-12-27 23:17:22,764][106226] Updated weights for policy 0, policy_version 563248 (0.0009) [2023-12-27 23:17:23,042][106225] Updated weights for policy 1, policy_version 565043 (0.0009) [2023-12-27 23:17:23,101][106225] Updated weights for policy 1, policy_version 565053 (0.0008) [2023-12-27 23:17:23,155][106225] Updated weights for policy 1, policy_version 565063 (0.0009) [2023-12-27 23:17:23,525][106226] Updated weights for policy 0, policy_version 563258 (0.0005) [2023-12-27 23:17:23,582][106226] Updated weights for policy 0, policy_version 563268 (0.0005) [2023-12-27 23:17:23,643][106226] Updated weights for policy 0, policy_version 563278 (0.0008) [2023-12-27 23:17:23,842][106225] Updated weights for policy 1, policy_version 565073 (0.0009) [2023-12-27 23:17:23,896][106225] Updated weights for policy 1, policy_version 565083 (0.0005) [2023-12-27 23:17:23,957][106225] Updated weights for policy 1, policy_version 565093 (0.0006) [2023-12-27 23:17:24,013][106225] Updated weights for policy 1, policy_version 565103 (0.0005) [2023-12-27 23:17:24,272][106226] Updated weights for policy 0, policy_version 563288 (0.0009) [2023-12-27 23:17:24,328][106226] Updated weights for policy 0, policy_version 563298 (0.0009) [2023-12-27 23:17:24,379][106226] Updated weights for policy 0, policy_version 563308 (0.0009) [2023-12-27 23:17:24,624][106225] Updated weights for policy 1, policy_version 565113 (0.0009) [2023-12-27 23:17:24,672][106225] Updated weights for policy 1, policy_version 565123 (0.0007) [2023-12-27 23:17:24,732][106225] Updated weights for policy 1, policy_version 565133 (0.0005) [2023-12-27 23:17:24,974][106226] Updated weights for policy 0, policy_version 563318 (0.0006) [2023-12-27 23:17:25,025][106226] Updated weights for policy 0, policy_version 563328 (0.0005) [2023-12-27 23:17:25,073][106226] Updated weights for policy 0, policy_version 563338 (0.0005) [2023-12-27 23:17:25,384][106225] Updated weights for policy 1, policy_version 565143 (0.0007) [2023-12-27 23:17:25,432][106225] Updated weights for policy 1, policy_version 565153 (0.0008) [2023-12-27 23:17:25,489][106225] Updated weights for policy 1, policy_version 565163 (0.0008) [2023-12-27 23:17:25,783][106226] Updated weights for policy 0, policy_version 563348 (0.0006) [2023-12-27 23:17:25,832][106226] Updated weights for policy 0, policy_version 563358 (0.0008) [2023-12-27 23:17:25,890][106226] Updated weights for policy 0, policy_version 563368 (0.0008) [2023-12-27 23:17:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 288972800. Throughput: 0: 9837.2, 1: 9960.0. Samples: 288940576. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:26,176][105115] Avg episode reward: [(0, '-4.934'), (1, '-5.794')] [2023-12-27 23:17:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000563376_144261120.pth... [2023-12-27 23:17:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000565168_144711680.pth... [2023-12-27 23:17:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000562224_143966208.pth [2023-12-27 23:17:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000564016_144416768.pth [2023-12-27 23:17:26,229][106225] Updated weights for policy 1, policy_version 565173 (0.0009) [2023-12-27 23:17:26,279][106225] Updated weights for policy 1, policy_version 565183 (0.0009) [2023-12-27 23:17:26,335][106225] Updated weights for policy 1, policy_version 565193 (0.0009) [2023-12-27 23:17:26,596][106226] Updated weights for policy 0, policy_version 563378 (0.0008) [2023-12-27 23:17:26,646][106226] Updated weights for policy 0, policy_version 563388 (0.0005) [2023-12-27 23:17:26,703][106226] Updated weights for policy 0, policy_version 563398 (0.0005) [2023-12-27 23:17:26,759][106226] Updated weights for policy 0, policy_version 563408 (0.0008) [2023-12-27 23:17:27,077][106225] Updated weights for policy 1, policy_version 565203 (0.0007) [2023-12-27 23:17:27,128][106225] Updated weights for policy 1, policy_version 565213 (0.0008) [2023-12-27 23:17:27,177][106225] Updated weights for policy 1, policy_version 565223 (0.0009) [2023-12-27 23:17:27,433][106226] Updated weights for policy 0, policy_version 563418 (0.0008) [2023-12-27 23:17:27,494][106226] Updated weights for policy 0, policy_version 563428 (0.0008) [2023-12-27 23:17:27,552][106226] Updated weights for policy 0, policy_version 563438 (0.0008) [2023-12-27 23:17:27,923][106225] Updated weights for policy 1, policy_version 565233 (0.0008) [2023-12-27 23:17:27,966][106225] Updated weights for policy 1, policy_version 565243 (0.0008) [2023-12-27 23:17:28,017][106225] Updated weights for policy 1, policy_version 565253 (0.0008) [2023-12-27 23:17:28,068][106225] Updated weights for policy 1, policy_version 565263 (0.0008) [2023-12-27 23:17:28,193][106226] Updated weights for policy 0, policy_version 563448 (0.0008) [2023-12-27 23:17:28,242][106226] Updated weights for policy 0, policy_version 563458 (0.0010) [2023-12-27 23:17:28,291][106226] Updated weights for policy 0, policy_version 563468 (0.0010) [2023-12-27 23:17:28,831][106225] Updated weights for policy 1, policy_version 565273 (0.0008) [2023-12-27 23:17:28,890][106225] Updated weights for policy 1, policy_version 565283 (0.0008) [2023-12-27 23:17:28,938][106225] Updated weights for policy 1, policy_version 565293 (0.0008) [2023-12-27 23:17:29,029][106226] Updated weights for policy 0, policy_version 563478 (0.0010) [2023-12-27 23:17:29,091][106226] Updated weights for policy 0, policy_version 563488 (0.0010) [2023-12-27 23:17:29,147][106226] Updated weights for policy 0, policy_version 563498 (0.0010) [2023-12-27 23:17:29,732][106225] Updated weights for policy 1, policy_version 565303 (0.0008) [2023-12-27 23:17:29,792][106225] Updated weights for policy 1, policy_version 565313 (0.0007) [2023-12-27 23:17:29,858][106225] Updated weights for policy 1, policy_version 565323 (0.0008) [2023-12-27 23:17:29,872][106226] Updated weights for policy 0, policy_version 563508 (0.0010) [2023-12-27 23:17:29,942][106226] Updated weights for policy 0, policy_version 563518 (0.0007) [2023-12-27 23:17:29,998][106226] Updated weights for policy 0, policy_version 563528 (0.0009) [2023-12-27 23:17:30,541][106225] Updated weights for policy 1, policy_version 565333 (0.0006) [2023-12-27 23:17:30,610][106225] Updated weights for policy 1, policy_version 565343 (0.0008) [2023-12-27 23:17:30,676][106225] Updated weights for policy 1, policy_version 565353 (0.0010) [2023-12-27 23:17:30,735][106226] Updated weights for policy 0, policy_version 563538 (0.0010) [2023-12-27 23:17:30,788][106226] Updated weights for policy 0, policy_version 563548 (0.0010) [2023-12-27 23:17:30,831][106226] Updated weights for policy 0, policy_version 563558 (0.0009) [2023-12-27 23:17:30,884][106226] Updated weights for policy 0, policy_version 563568 (0.0008) [2023-12-27 23:17:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 289071104. Throughput: 0: 9879.4, 1: 9986.9. Samples: 289060640. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:31,175][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.448')] [2023-12-27 23:17:31,390][106225] Updated weights for policy 1, policy_version 565363 (0.0010) [2023-12-27 23:17:31,447][106225] Updated weights for policy 1, policy_version 565373 (0.0010) [2023-12-27 23:17:31,494][106225] Updated weights for policy 1, policy_version 565383 (0.0010) [2023-12-27 23:17:31,639][106226] Updated weights for policy 0, policy_version 563578 (0.0009) [2023-12-27 23:17:31,701][106226] Updated weights for policy 0, policy_version 563588 (0.0009) [2023-12-27 23:17:31,767][106226] Updated weights for policy 0, policy_version 563598 (0.0007) [2023-12-27 23:17:32,203][106225] Updated weights for policy 1, policy_version 565393 (0.0010) [2023-12-27 23:17:32,264][106225] Updated weights for policy 1, policy_version 565403 (0.0010) [2023-12-27 23:17:32,325][106225] Updated weights for policy 1, policy_version 565413 (0.0009) [2023-12-27 23:17:32,389][106225] Updated weights for policy 1, policy_version 565423 (0.0010) [2023-12-27 23:17:32,462][106226] Updated weights for policy 0, policy_version 563608 (0.0009) [2023-12-27 23:17:32,520][106226] Updated weights for policy 0, policy_version 563618 (0.0009) [2023-12-27 23:17:32,582][106226] Updated weights for policy 0, policy_version 563628 (0.0008) [2023-12-27 23:17:33,018][106225] Updated weights for policy 1, policy_version 565433 (0.0010) [2023-12-27 23:17:33,076][106225] Updated weights for policy 1, policy_version 565443 (0.0009) [2023-12-27 23:17:33,136][106225] Updated weights for policy 1, policy_version 565453 (0.0005) [2023-12-27 23:17:33,265][106226] Updated weights for policy 0, policy_version 563638 (0.0006) [2023-12-27 23:17:33,317][106226] Updated weights for policy 0, policy_version 563648 (0.0005) [2023-12-27 23:17:33,371][106226] Updated weights for policy 0, policy_version 563658 (0.0008) [2023-12-27 23:17:33,665][106225] Updated weights for policy 1, policy_version 565463 (0.0005) [2023-12-27 23:17:33,735][106225] Updated weights for policy 1, policy_version 565473 (0.0010) [2023-12-27 23:17:33,793][106225] Updated weights for policy 1, policy_version 565483 (0.0010) [2023-12-27 23:17:34,095][106226] Updated weights for policy 0, policy_version 563668 (0.0008) [2023-12-27 23:17:34,146][106226] Updated weights for policy 0, policy_version 563678 (0.0008) [2023-12-27 23:17:34,207][106226] Updated weights for policy 0, policy_version 563688 (0.0008) [2023-12-27 23:17:34,461][106225] Updated weights for policy 1, policy_version 565493 (0.0010) [2023-12-27 23:17:34,516][106225] Updated weights for policy 1, policy_version 565503 (0.0010) [2023-12-27 23:17:34,568][106225] Updated weights for policy 1, policy_version 565513 (0.0010) [2023-12-27 23:17:34,961][106226] Updated weights for policy 0, policy_version 563698 (0.0008) [2023-12-27 23:17:35,009][106226] Updated weights for policy 0, policy_version 563708 (0.0008) [2023-12-27 23:17:35,059][106226] Updated weights for policy 0, policy_version 563718 (0.0008) [2023-12-27 23:17:35,111][106226] Updated weights for policy 0, policy_version 563728 (0.0007) [2023-12-27 23:17:35,255][106225] Updated weights for policy 1, policy_version 565523 (0.0010) [2023-12-27 23:17:35,309][106225] Updated weights for policy 1, policy_version 565533 (0.0010) [2023-12-27 23:17:35,373][106225] Updated weights for policy 1, policy_version 565543 (0.0010) [2023-12-27 23:17:35,872][106226] Updated weights for policy 0, policy_version 563738 (0.0008) [2023-12-27 23:17:35,936][106226] Updated weights for policy 0, policy_version 563748 (0.0007) [2023-12-27 23:17:35,999][106226] Updated weights for policy 0, policy_version 563758 (0.0008) [2023-12-27 23:17:36,106][106225] Updated weights for policy 1, policy_version 565553 (0.0010) [2023-12-27 23:17:36,170][106225] Updated weights for policy 1, policy_version 565563 (0.0010) [2023-12-27 23:17:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 289169408. Throughput: 0: 9873.1, 1: 10035.9. Samples: 289180108. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:36,175][105115] Avg episode reward: [(0, '-5.024'), (1, '-5.510')] [2023-12-27 23:17:36,239][106225] Updated weights for policy 1, policy_version 565573 (0.0010) [2023-12-27 23:17:36,294][106225] Updated weights for policy 1, policy_version 565583 (0.0011) [2023-12-27 23:17:36,709][106226] Updated weights for policy 0, policy_version 563768 (0.0008) [2023-12-27 23:17:36,775][106226] Updated weights for policy 0, policy_version 563778 (0.0009) [2023-12-27 23:17:36,839][106226] Updated weights for policy 0, policy_version 563788 (0.0008) [2023-12-27 23:17:37,026][106225] Updated weights for policy 1, policy_version 565593 (0.0010) [2023-12-27 23:17:37,087][106225] Updated weights for policy 1, policy_version 565603 (0.0010) [2023-12-27 23:17:37,138][106225] Updated weights for policy 1, policy_version 565613 (0.0010) [2023-12-27 23:17:37,499][106226] Updated weights for policy 0, policy_version 563798 (0.0010) [2023-12-27 23:17:37,560][106226] Updated weights for policy 0, policy_version 563808 (0.0011) [2023-12-27 23:17:37,620][106226] Updated weights for policy 0, policy_version 563818 (0.0011) [2023-12-27 23:17:37,859][106225] Updated weights for policy 1, policy_version 565623 (0.0011) [2023-12-27 23:17:37,916][106225] Updated weights for policy 1, policy_version 565633 (0.0011) [2023-12-27 23:17:37,973][106225] Updated weights for policy 1, policy_version 565643 (0.0010) [2023-12-27 23:17:38,306][106226] Updated weights for policy 0, policy_version 563828 (0.0009) [2023-12-27 23:17:38,372][106226] Updated weights for policy 0, policy_version 563838 (0.0009) [2023-12-27 23:17:38,439][106226] Updated weights for policy 0, policy_version 563848 (0.0008) [2023-12-27 23:17:38,629][106225] Updated weights for policy 1, policy_version 565653 (0.0010) [2023-12-27 23:17:38,694][106225] Updated weights for policy 1, policy_version 565663 (0.0010) [2023-12-27 23:17:38,756][106225] Updated weights for policy 1, policy_version 565673 (0.0010) [2023-12-27 23:17:39,146][106226] Updated weights for policy 0, policy_version 563858 (0.0011) [2023-12-27 23:17:39,207][106226] Updated weights for policy 0, policy_version 563868 (0.0011) [2023-12-27 23:17:39,274][106226] Updated weights for policy 0, policy_version 563878 (0.0010) [2023-12-27 23:17:39,340][106226] Updated weights for policy 0, policy_version 563888 (0.0010) [2023-12-27 23:17:39,503][106225] Updated weights for policy 1, policy_version 565683 (0.0010) [2023-12-27 23:17:39,563][106225] Updated weights for policy 1, policy_version 565693 (0.0007) [2023-12-27 23:17:39,628][106225] Updated weights for policy 1, policy_version 565703 (0.0005) [2023-12-27 23:17:40,122][106226] Updated weights for policy 0, policy_version 563898 (0.0010) [2023-12-27 23:17:40,182][106226] Updated weights for policy 0, policy_version 563908 (0.0008) [2023-12-27 23:17:40,257][106226] Updated weights for policy 0, policy_version 563918 (0.0009) [2023-12-27 23:17:40,273][106225] Updated weights for policy 1, policy_version 565713 (0.0006) [2023-12-27 23:17:40,327][106225] Updated weights for policy 1, policy_version 565723 (0.0006) [2023-12-27 23:17:40,394][106225] Updated weights for policy 1, policy_version 565733 (0.0006) [2023-12-27 23:17:40,460][106225] Updated weights for policy 1, policy_version 565743 (0.0009) [2023-12-27 23:17:41,041][106225] Updated weights for policy 1, policy_version 565753 (0.0008) [2023-12-27 23:17:41,088][106226] Updated weights for policy 0, policy_version 563928 (0.0008) [2023-12-27 23:17:41,111][106225] Updated weights for policy 1, policy_version 565763 (0.0008) [2023-12-27 23:17:41,160][106226] Updated weights for policy 0, policy_version 563938 (0.0007) [2023-12-27 23:17:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 289259520. Throughput: 0: 9907.6, 1: 10015.4. Samples: 289239144. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:41,175][105115] Avg episode reward: [(0, '-4.991'), (1, '-5.673')] [2023-12-27 23:17:41,181][106225] Updated weights for policy 1, policy_version 565773 (0.0008) [2023-12-27 23:17:41,202][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000565776_144867328.pth... [2023-12-27 23:17:41,207][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000564592_144564224.pth [2023-12-27 23:17:41,229][106226] Updated weights for policy 0, policy_version 563948 (0.0007) [2023-12-27 23:17:41,257][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000563952_144408576.pth... [2023-12-27 23:17:41,261][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000562800_144113664.pth [2023-12-27 23:17:41,930][106225] Updated weights for policy 1, policy_version 565783 (0.0009) [2023-12-27 23:17:41,985][106226] Updated weights for policy 0, policy_version 563958 (0.0007) [2023-12-27 23:17:41,999][106225] Updated weights for policy 1, policy_version 565793 (0.0008) [2023-12-27 23:17:42,054][106226] Updated weights for policy 0, policy_version 563968 (0.0008) [2023-12-27 23:17:42,064][106225] Updated weights for policy 1, policy_version 565803 (0.0007) [2023-12-27 23:17:42,114][106226] Updated weights for policy 0, policy_version 563978 (0.0007) [2023-12-27 23:17:42,734][106226] Updated weights for policy 0, policy_version 563988 (0.0006) [2023-12-27 23:17:42,781][106225] Updated weights for policy 1, policy_version 565813 (0.0006) [2023-12-27 23:17:42,790][106226] Updated weights for policy 0, policy_version 563998 (0.0008) [2023-12-27 23:17:42,839][106225] Updated weights for policy 1, policy_version 565823 (0.0008) [2023-12-27 23:17:42,845][106226] Updated weights for policy 0, policy_version 564008 (0.0006) [2023-12-27 23:17:42,898][106225] Updated weights for policy 1, policy_version 565833 (0.0007) [2023-12-27 23:17:43,565][106226] Updated weights for policy 0, policy_version 564018 (0.0006) [2023-12-27 23:17:43,568][106225] Updated weights for policy 1, policy_version 565843 (0.0007) [2023-12-27 23:17:43,622][106226] Updated weights for policy 0, policy_version 564028 (0.0006) [2023-12-27 23:17:43,627][106225] Updated weights for policy 1, policy_version 565853 (0.0008) [2023-12-27 23:17:43,680][106226] Updated weights for policy 0, policy_version 564038 (0.0009) [2023-12-27 23:17:43,689][106225] Updated weights for policy 1, policy_version 565863 (0.0005) [2023-12-27 23:17:43,741][106226] Updated weights for policy 0, policy_version 564048 (0.0009) [2023-12-27 23:17:44,309][106225] Updated weights for policy 1, policy_version 565873 (0.0006) [2023-12-27 23:17:44,368][106225] Updated weights for policy 1, policy_version 565883 (0.0008) [2023-12-27 23:17:44,417][106225] Updated weights for policy 1, policy_version 565893 (0.0008) [2023-12-27 23:17:44,439][106226] Updated weights for policy 0, policy_version 564058 (0.0008) [2023-12-27 23:17:44,472][106225] Updated weights for policy 1, policy_version 565903 (0.0006) [2023-12-27 23:17:44,500][106226] Updated weights for policy 0, policy_version 564068 (0.0007) [2023-12-27 23:17:44,559][106226] Updated weights for policy 0, policy_version 564078 (0.0009) [2023-12-27 23:17:45,225][106225] Updated weights for policy 1, policy_version 565913 (0.0010) [2023-12-27 23:17:45,299][106226] Updated weights for policy 0, policy_version 564088 (0.0007) [2023-12-27 23:17:45,312][106225] Updated weights for policy 1, policy_version 565923 (0.0009) [2023-12-27 23:17:45,369][106226] Updated weights for policy 0, policy_version 564098 (0.0008) [2023-12-27 23:17:45,378][106225] Updated weights for policy 1, policy_version 565933 (0.0010) [2023-12-27 23:17:45,440][106226] Updated weights for policy 0, policy_version 564108 (0.0009) [2023-12-27 23:17:46,029][106225] Updated weights for policy 1, policy_version 565943 (0.0009) [2023-12-27 23:17:46,082][106225] Updated weights for policy 1, policy_version 565953 (0.0010) [2023-12-27 23:17:46,095][106226] Updated weights for policy 0, policy_version 564118 (0.0008) [2023-12-27 23:17:46,144][106226] Updated weights for policy 0, policy_version 564128 (0.0005) [2023-12-27 23:17:46,166][106225] Updated weights for policy 1, policy_version 565963 (0.0010) [2023-12-27 23:17:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 289357824. Throughput: 0: 9787.2, 1: 9896.7. Samples: 289355420. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:46,175][105115] Avg episode reward: [(0, '-5.196'), (1, '-5.680')] [2023-12-27 23:17:46,198][106226] Updated weights for policy 0, policy_version 564138 (0.0006) [2023-12-27 23:17:46,786][106225] Updated weights for policy 1, policy_version 565973 (0.0008) [2023-12-27 23:17:46,842][106225] Updated weights for policy 1, policy_version 565983 (0.0010) [2023-12-27 23:17:46,902][106226] Updated weights for policy 0, policy_version 564148 (0.0007) [2023-12-27 23:17:46,906][106225] Updated weights for policy 1, policy_version 565993 (0.0008) [2023-12-27 23:17:46,950][106226] Updated weights for policy 0, policy_version 564158 (0.0006) [2023-12-27 23:17:46,997][106226] Updated weights for policy 0, policy_version 564168 (0.0008) [2023-12-27 23:17:47,554][106225] Updated weights for policy 1, policy_version 566003 (0.0010) [2023-12-27 23:17:47,615][106225] Updated weights for policy 1, policy_version 566013 (0.0008) [2023-12-27 23:17:47,671][106225] Updated weights for policy 1, policy_version 566023 (0.0007) [2023-12-27 23:17:47,742][106226] Updated weights for policy 0, policy_version 564178 (0.0008) [2023-12-27 23:17:47,799][106226] Updated weights for policy 0, policy_version 564188 (0.0011) [2023-12-27 23:17:47,850][106226] Updated weights for policy 0, policy_version 564198 (0.0011) [2023-12-27 23:17:47,912][106226] Updated weights for policy 0, policy_version 564208 (0.0010) [2023-12-27 23:17:48,449][106225] Updated weights for policy 1, policy_version 566033 (0.0008) [2023-12-27 23:17:48,496][106225] Updated weights for policy 1, policy_version 566043 (0.0008) [2023-12-27 23:17:48,547][106225] Updated weights for policy 1, policy_version 566053 (0.0008) [2023-12-27 23:17:48,602][106225] Updated weights for policy 1, policy_version 566063 (0.0007) [2023-12-27 23:17:48,650][106226] Updated weights for policy 0, policy_version 564218 (0.0010) [2023-12-27 23:17:48,719][106226] Updated weights for policy 0, policy_version 564228 (0.0006) [2023-12-27 23:17:48,785][106226] Updated weights for policy 0, policy_version 564238 (0.0006) [2023-12-27 23:17:49,239][106225] Updated weights for policy 1, policy_version 566073 (0.0008) [2023-12-27 23:17:49,299][106225] Updated weights for policy 1, policy_version 566083 (0.0007) [2023-12-27 23:17:49,361][106225] Updated weights for policy 1, policy_version 566093 (0.0009) [2023-12-27 23:17:49,435][106226] Updated weights for policy 0, policy_version 564248 (0.0009) [2023-12-27 23:17:49,495][106226] Updated weights for policy 0, policy_version 564258 (0.0009) [2023-12-27 23:17:49,545][106226] Updated weights for policy 0, policy_version 564268 (0.0008) [2023-12-27 23:17:50,097][106225] Updated weights for policy 1, policy_version 566103 (0.0008) [2023-12-27 23:17:50,150][106225] Updated weights for policy 1, policy_version 566113 (0.0009) [2023-12-27 23:17:50,205][106225] Updated weights for policy 1, policy_version 566123 (0.0008) [2023-12-27 23:17:50,316][106226] Updated weights for policy 0, policy_version 564278 (0.0009) [2023-12-27 23:17:50,376][106226] Updated weights for policy 0, policy_version 564288 (0.0009) [2023-12-27 23:17:50,432][106226] Updated weights for policy 0, policy_version 564298 (0.0009) [2023-12-27 23:17:50,895][106225] Updated weights for policy 1, policy_version 566133 (0.0007) [2023-12-27 23:17:50,948][106225] Updated weights for policy 1, policy_version 566143 (0.0006) [2023-12-27 23:17:50,993][106225] Updated weights for policy 1, policy_version 566153 (0.0009) [2023-12-27 23:17:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 289464320. Throughput: 0: 9738.8, 1: 9908.4. Samples: 289472908. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:51,175][105115] Avg episode reward: [(0, '-5.084'), (1, '-5.407')] [2023-12-27 23:17:51,195][106226] Updated weights for policy 0, policy_version 564308 (0.0008) [2023-12-27 23:17:51,255][106226] Updated weights for policy 0, policy_version 564318 (0.0006) [2023-12-27 23:17:51,307][106226] Updated weights for policy 0, policy_version 564328 (0.0008) [2023-12-27 23:17:51,706][106225] Updated weights for policy 1, policy_version 566164 (0.0009) [2023-12-27 23:17:51,777][106225] Updated weights for policy 1, policy_version 566174 (0.0009) [2023-12-27 23:17:51,837][106225] Updated weights for policy 1, policy_version 566184 (0.0008) [2023-12-27 23:17:52,125][106226] Updated weights for policy 0, policy_version 564338 (0.0008) [2023-12-27 23:17:52,188][106226] Updated weights for policy 0, policy_version 564348 (0.0007) [2023-12-27 23:17:52,256][106226] Updated weights for policy 0, policy_version 564358 (0.0009) [2023-12-27 23:17:52,319][106226] Updated weights for policy 0, policy_version 564368 (0.0009) [2023-12-27 23:17:52,622][106225] Updated weights for policy 1, policy_version 566194 (0.0008) [2023-12-27 23:17:52,679][106225] Updated weights for policy 1, policy_version 566204 (0.0010) [2023-12-27 23:17:52,726][106225] Updated weights for policy 1, policy_version 566214 (0.0010) [2023-12-27 23:17:52,770][106225] Updated weights for policy 1, policy_version 566224 (0.0010) [2023-12-27 23:17:53,036][106226] Updated weights for policy 0, policy_version 564378 (0.0006) [2023-12-27 23:17:53,085][106226] Updated weights for policy 0, policy_version 564388 (0.0007) [2023-12-27 23:17:53,145][106226] Updated weights for policy 0, policy_version 564398 (0.0005) [2023-12-27 23:17:53,457][106225] Updated weights for policy 1, policy_version 566234 (0.0010) [2023-12-27 23:17:53,504][106225] Updated weights for policy 1, policy_version 566244 (0.0010) [2023-12-27 23:17:53,547][106225] Updated weights for policy 1, policy_version 566254 (0.0010) [2023-12-27 23:17:53,792][106226] Updated weights for policy 0, policy_version 564408 (0.0007) [2023-12-27 23:17:53,852][106226] Updated weights for policy 0, policy_version 564418 (0.0008) [2023-12-27 23:17:53,914][106226] Updated weights for policy 0, policy_version 564428 (0.0008) [2023-12-27 23:17:54,302][106225] Updated weights for policy 1, policy_version 566264 (0.0009) [2023-12-27 23:17:54,366][106225] Updated weights for policy 1, policy_version 566274 (0.0010) [2023-12-27 23:17:54,418][106225] Updated weights for policy 1, policy_version 566284 (0.0007) [2023-12-27 23:17:54,632][106226] Updated weights for policy 0, policy_version 564438 (0.0006) [2023-12-27 23:17:54,702][106226] Updated weights for policy 0, policy_version 564448 (0.0011) [2023-12-27 23:17:54,769][106226] Updated weights for policy 0, policy_version 564458 (0.0011) [2023-12-27 23:17:55,015][106225] Updated weights for policy 1, policy_version 566294 (0.0006) [2023-12-27 23:17:55,069][106225] Updated weights for policy 1, policy_version 566304 (0.0005) [2023-12-27 23:17:55,122][106225] Updated weights for policy 1, policy_version 566314 (0.0006) [2023-12-27 23:17:55,433][106226] Updated weights for policy 0, policy_version 564468 (0.0010) [2023-12-27 23:17:55,486][106226] Updated weights for policy 0, policy_version 564478 (0.0007) [2023-12-27 23:17:55,538][106226] Updated weights for policy 0, policy_version 564488 (0.0009) [2023-12-27 23:17:55,771][106225] Updated weights for policy 1, policy_version 566324 (0.0007) [2023-12-27 23:17:55,824][106225] Updated weights for policy 1, policy_version 566334 (0.0010) [2023-12-27 23:17:55,873][106225] Updated weights for policy 1, policy_version 566344 (0.0010) [2023-12-27 23:17:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 289562624. Throughput: 0: 9701.1, 1: 9939.0. Samples: 289530852. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:17:56,175][105115] Avg episode reward: [(0, '-5.261'), (1, '-5.908')] [2023-12-27 23:17:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000566352_145014784.pth... [2023-12-27 23:17:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000565168_144711680.pth [2023-12-27 23:17:56,194][106226] Updated weights for policy 0, policy_version 564498 (0.0009) [2023-12-27 23:17:56,248][106226] Updated weights for policy 0, policy_version 564508 (0.0010) [2023-12-27 23:17:56,297][106226] Updated weights for policy 0, policy_version 564518 (0.0010) [2023-12-27 23:17:56,341][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000564528_144556032.pth... [2023-12-27 23:17:56,344][106226] Updated weights for policy 0, policy_version 564528 (0.0010) [2023-12-27 23:17:56,344][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000563376_144261120.pth [2023-12-27 23:17:56,598][106225] Updated weights for policy 1, policy_version 566354 (0.0010) [2023-12-27 23:17:56,651][106225] Updated weights for policy 1, policy_version 566364 (0.0010) [2023-12-27 23:17:56,708][106225] Updated weights for policy 1, policy_version 566374 (0.0010) [2023-12-27 23:17:56,756][106225] Updated weights for policy 1, policy_version 566384 (0.0010) [2023-12-27 23:17:57,056][106226] Updated weights for policy 0, policy_version 564538 (0.0011) [2023-12-27 23:17:57,106][106226] Updated weights for policy 0, policy_version 564548 (0.0010) [2023-12-27 23:17:57,157][106226] Updated weights for policy 0, policy_version 564558 (0.0010) [2023-12-27 23:17:57,479][106225] Updated weights for policy 1, policy_version 566394 (0.0010) [2023-12-27 23:17:57,525][106225] Updated weights for policy 1, policy_version 566404 (0.0010) [2023-12-27 23:17:57,571][106225] Updated weights for policy 1, policy_version 566414 (0.0010) [2023-12-27 23:17:57,882][106226] Updated weights for policy 0, policy_version 564568 (0.0008) [2023-12-27 23:17:57,936][106226] Updated weights for policy 0, policy_version 564578 (0.0005) [2023-12-27 23:17:57,989][106226] Updated weights for policy 0, policy_version 564588 (0.0006) [2023-12-27 23:17:58,297][106225] Updated weights for policy 1, policy_version 566424 (0.0008) [2023-12-27 23:17:58,365][106225] Updated weights for policy 1, policy_version 566434 (0.0008) [2023-12-27 23:17:58,432][106225] Updated weights for policy 1, policy_version 566444 (0.0007) [2023-12-27 23:17:58,739][106226] Updated weights for policy 0, policy_version 564598 (0.0009) [2023-12-27 23:17:58,812][106226] Updated weights for policy 0, policy_version 564608 (0.0008) [2023-12-27 23:17:58,885][106226] Updated weights for policy 0, policy_version 564618 (0.0008) [2023-12-27 23:17:59,211][106225] Updated weights for policy 1, policy_version 566454 (0.0009) [2023-12-27 23:17:59,284][106225] Updated weights for policy 1, policy_version 566464 (0.0009) [2023-12-27 23:17:59,347][106225] Updated weights for policy 1, policy_version 566474 (0.0009) [2023-12-27 23:17:59,615][106226] Updated weights for policy 0, policy_version 564628 (0.0007) [2023-12-27 23:17:59,672][106226] Updated weights for policy 0, policy_version 564638 (0.0008) [2023-12-27 23:17:59,724][106226] Updated weights for policy 0, policy_version 564648 (0.0008) [2023-12-27 23:18:00,101][106225] Updated weights for policy 1, policy_version 566484 (0.0009) [2023-12-27 23:18:00,163][106225] Updated weights for policy 1, policy_version 566494 (0.0008) [2023-12-27 23:18:00,219][106225] Updated weights for policy 1, policy_version 566504 (0.0008) [2023-12-27 23:18:00,481][106226] Updated weights for policy 0, policy_version 564658 (0.0008) [2023-12-27 23:18:00,533][106226] Updated weights for policy 0, policy_version 564668 (0.0008) [2023-12-27 23:18:00,589][106226] Updated weights for policy 0, policy_version 564678 (0.0008) [2023-12-27 23:18:00,645][106226] Updated weights for policy 0, policy_version 564688 (0.0007) [2023-12-27 23:18:00,951][106225] Updated weights for policy 1, policy_version 566514 (0.0006) [2023-12-27 23:18:01,012][106225] Updated weights for policy 1, policy_version 566524 (0.0009) [2023-12-27 23:18:01,089][106225] Updated weights for policy 1, policy_version 566534 (0.0009) [2023-12-27 23:18:01,155][106225] Updated weights for policy 1, policy_version 566544 (0.0009) [2023-12-27 23:18:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 289660928. Throughput: 0: 9741.5, 1: 9978.2. Samples: 289648644. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:01,175][105115] Avg episode reward: [(0, '-5.022'), (1, '-5.580')] [2023-12-27 23:18:01,380][106226] Updated weights for policy 0, policy_version 564698 (0.0010) [2023-12-27 23:18:01,442][106226] Updated weights for policy 0, policy_version 564708 (0.0008) [2023-12-27 23:18:01,499][106226] Updated weights for policy 0, policy_version 564718 (0.0009) [2023-12-27 23:18:01,801][106225] Updated weights for policy 1, policy_version 566554 (0.0006) [2023-12-27 23:18:01,857][106225] Updated weights for policy 1, policy_version 566564 (0.0006) [2023-12-27 23:18:01,913][106225] Updated weights for policy 1, policy_version 566574 (0.0005) [2023-12-27 23:18:02,304][106226] Updated weights for policy 0, policy_version 564728 (0.0009) [2023-12-27 23:18:02,372][106226] Updated weights for policy 0, policy_version 564738 (0.0008) [2023-12-27 23:18:02,434][106226] Updated weights for policy 0, policy_version 564748 (0.0009) [2023-12-27 23:18:02,621][106225] Updated weights for policy 1, policy_version 566584 (0.0008) [2023-12-27 23:18:02,676][106225] Updated weights for policy 1, policy_version 566594 (0.0008) [2023-12-27 23:18:02,732][106225] Updated weights for policy 1, policy_version 566604 (0.0008) [2023-12-27 23:18:03,130][106226] Updated weights for policy 0, policy_version 564758 (0.0007) [2023-12-27 23:18:03,185][106226] Updated weights for policy 0, policy_version 564768 (0.0005) [2023-12-27 23:18:03,244][106226] Updated weights for policy 0, policy_version 564778 (0.0005) [2023-12-27 23:18:03,515][106225] Updated weights for policy 1, policy_version 566614 (0.0008) [2023-12-27 23:18:03,569][106225] Updated weights for policy 1, policy_version 566624 (0.0008) [2023-12-27 23:18:03,626][106225] Updated weights for policy 1, policy_version 566634 (0.0008) [2023-12-27 23:18:03,862][106226] Updated weights for policy 0, policy_version 564788 (0.0006) [2023-12-27 23:18:03,925][106226] Updated weights for policy 0, policy_version 564798 (0.0009) [2023-12-27 23:18:03,985][106226] Updated weights for policy 0, policy_version 564808 (0.0008) [2023-12-27 23:18:04,387][106225] Updated weights for policy 1, policy_version 566644 (0.0008) [2023-12-27 23:18:04,445][106225] Updated weights for policy 1, policy_version 566654 (0.0008) [2023-12-27 23:18:04,498][106225] Updated weights for policy 1, policy_version 566664 (0.0008) [2023-12-27 23:18:04,743][106226] Updated weights for policy 0, policy_version 564818 (0.0008) [2023-12-27 23:18:04,798][106226] Updated weights for policy 0, policy_version 564828 (0.0009) [2023-12-27 23:18:04,847][106226] Updated weights for policy 0, policy_version 564838 (0.0008) [2023-12-27 23:18:04,894][106226] Updated weights for policy 0, policy_version 564848 (0.0008) [2023-12-27 23:18:05,194][106225] Updated weights for policy 1, policy_version 566674 (0.0008) [2023-12-27 23:18:05,248][106225] Updated weights for policy 1, policy_version 566684 (0.0005) [2023-12-27 23:18:05,300][106225] Updated weights for policy 1, policy_version 566694 (0.0005) [2023-12-27 23:18:05,354][106225] Updated weights for policy 1, policy_version 566704 (0.0005) [2023-12-27 23:18:05,665][106226] Updated weights for policy 0, policy_version 564858 (0.0008) [2023-12-27 23:18:05,711][106226] Updated weights for policy 0, policy_version 564868 (0.0008) [2023-12-27 23:18:05,760][106226] Updated weights for policy 0, policy_version 564878 (0.0008) [2023-12-27 23:18:05,987][106225] Updated weights for policy 1, policy_version 566714 (0.0009) [2023-12-27 23:18:06,032][106225] Updated weights for policy 1, policy_version 566724 (0.0008) [2023-12-27 23:18:06,080][106225] Updated weights for policy 1, policy_version 566734 (0.0008) [2023-12-27 23:18:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 289759232. Throughput: 0: 9708.6, 1: 9907.6. Samples: 289765044. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:06,175][105115] Avg episode reward: [(0, '-5.025'), (1, '-5.436')] [2023-12-27 23:18:06,514][106226] Updated weights for policy 0, policy_version 564888 (0.0008) [2023-12-27 23:18:06,575][106226] Updated weights for policy 0, policy_version 564898 (0.0009) [2023-12-27 23:18:06,644][106226] Updated weights for policy 0, policy_version 564908 (0.0009) [2023-12-27 23:18:06,820][106225] Updated weights for policy 1, policy_version 566744 (0.0008) [2023-12-27 23:18:06,882][106225] Updated weights for policy 1, policy_version 566754 (0.0008) [2023-12-27 23:18:06,937][106225] Updated weights for policy 1, policy_version 566764 (0.0006) [2023-12-27 23:18:07,385][106226] Updated weights for policy 0, policy_version 564918 (0.0008) [2023-12-27 23:18:07,430][106226] Updated weights for policy 0, policy_version 564928 (0.0008) [2023-12-27 23:18:07,479][106226] Updated weights for policy 0, policy_version 564938 (0.0008) [2023-12-27 23:18:07,623][106225] Updated weights for policy 1, policy_version 566774 (0.0007) [2023-12-27 23:18:07,679][106225] Updated weights for policy 1, policy_version 566784 (0.0008) [2023-12-27 23:18:07,741][106225] Updated weights for policy 1, policy_version 566794 (0.0007) [2023-12-27 23:18:08,269][106226] Updated weights for policy 0, policy_version 564948 (0.0008) [2023-12-27 23:18:08,353][106226] Updated weights for policy 0, policy_version 564958 (0.0008) [2023-12-27 23:18:08,409][106226] Updated weights for policy 0, policy_version 564968 (0.0008) [2023-12-27 23:18:08,421][106225] Updated weights for policy 1, policy_version 566804 (0.0007) [2023-12-27 23:18:08,477][106225] Updated weights for policy 1, policy_version 566814 (0.0007) [2023-12-27 23:18:08,526][106225] Updated weights for policy 1, policy_version 566824 (0.0008) [2023-12-27 23:18:09,180][106226] Updated weights for policy 0, policy_version 564978 (0.0009) [2023-12-27 23:18:09,192][106225] Updated weights for policy 1, policy_version 566834 (0.0008) [2023-12-27 23:18:09,244][106226] Updated weights for policy 0, policy_version 564988 (0.0008) [2023-12-27 23:18:09,263][106225] Updated weights for policy 1, policy_version 566844 (0.0008) [2023-12-27 23:18:09,309][106226] Updated weights for policy 0, policy_version 564998 (0.0008) [2023-12-27 23:18:09,326][106225] Updated weights for policy 1, policy_version 566854 (0.0007) [2023-12-27 23:18:09,378][106226] Updated weights for policy 0, policy_version 565008 (0.0009) [2023-12-27 23:18:09,397][106225] Updated weights for policy 1, policy_version 566864 (0.0008) [2023-12-27 23:18:10,132][106225] Updated weights for policy 1, policy_version 566874 (0.0008) [2023-12-27 23:18:10,180][106226] Updated weights for policy 0, policy_version 565018 (0.0008) [2023-12-27 23:18:10,195][106225] Updated weights for policy 1, policy_version 566884 (0.0006) [2023-12-27 23:18:10,240][106226] Updated weights for policy 0, policy_version 565028 (0.0008) [2023-12-27 23:18:10,252][106225] Updated weights for policy 1, policy_version 566894 (0.0006) [2023-12-27 23:18:10,296][106226] Updated weights for policy 0, policy_version 565038 (0.0008) [2023-12-27 23:18:10,908][106225] Updated weights for policy 1, policy_version 566904 (0.0009) [2023-12-27 23:18:10,960][106225] Updated weights for policy 1, policy_version 566914 (0.0006) [2023-12-27 23:18:11,022][106225] Updated weights for policy 1, policy_version 566924 (0.0006) [2023-12-27 23:18:11,024][106226] Updated weights for policy 0, policy_version 565048 (0.0007) [2023-12-27 23:18:11,091][106226] Updated weights for policy 0, policy_version 565058 (0.0009) [2023-12-27 23:18:11,160][106226] Updated weights for policy 0, policy_version 565068 (0.0008) [2023-12-27 23:18:11,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 289849344. Throughput: 0: 9674.8, 1: 9907.5. Samples: 289821776. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:11,175][105115] Avg episode reward: [(0, '-4.991'), (1, '-5.521')] [2023-12-27 23:18:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000566928_145162240.pth... [2023-12-27 23:18:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000565072_144695296.pth... [2023-12-27 23:18:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000565776_144867328.pth [2023-12-27 23:18:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000563952_144408576.pth [2023-12-27 23:18:11,764][106225] Updated weights for policy 1, policy_version 566934 (0.0008) [2023-12-27 23:18:11,830][106225] Updated weights for policy 1, policy_version 566944 (0.0009) [2023-12-27 23:18:11,896][106225] Updated weights for policy 1, policy_version 566954 (0.0008) [2023-12-27 23:18:11,940][106226] Updated weights for policy 0, policy_version 565078 (0.0009) [2023-12-27 23:18:11,999][106226] Updated weights for policy 0, policy_version 565088 (0.0008) [2023-12-27 23:18:12,058][106226] Updated weights for policy 0, policy_version 565098 (0.0005) [2023-12-27 23:18:12,665][106225] Updated weights for policy 1, policy_version 566964 (0.0009) [2023-12-27 23:18:12,731][106225] Updated weights for policy 1, policy_version 566974 (0.0009) [2023-12-27 23:18:12,746][106226] Updated weights for policy 0, policy_version 565108 (0.0006) [2023-12-27 23:18:12,791][106225] Updated weights for policy 1, policy_version 566984 (0.0008) [2023-12-27 23:18:12,806][106226] Updated weights for policy 0, policy_version 565118 (0.0006) [2023-12-27 23:18:12,870][106226] Updated weights for policy 0, policy_version 565128 (0.0009) [2023-12-27 23:18:13,478][106225] Updated weights for policy 1, policy_version 566994 (0.0007) [2023-12-27 23:18:13,525][106225] Updated weights for policy 1, policy_version 567004 (0.0008) [2023-12-27 23:18:13,568][106225] Updated weights for policy 1, policy_version 567014 (0.0008) [2023-12-27 23:18:13,609][106226] Updated weights for policy 0, policy_version 565138 (0.0009) [2023-12-27 23:18:13,627][106225] Updated weights for policy 1, policy_version 567024 (0.0008) [2023-12-27 23:18:13,656][106226] Updated weights for policy 0, policy_version 565148 (0.0007) [2023-12-27 23:18:13,712][106226] Updated weights for policy 0, policy_version 565158 (0.0007) [2023-12-27 23:18:13,768][106226] Updated weights for policy 0, policy_version 565168 (0.0009) [2023-12-27 23:18:14,376][106225] Updated weights for policy 1, policy_version 567034 (0.0009) [2023-12-27 23:18:14,426][106225] Updated weights for policy 1, policy_version 567044 (0.0007) [2023-12-27 23:18:14,483][106225] Updated weights for policy 1, policy_version 567054 (0.0006) [2023-12-27 23:18:14,505][106226] Updated weights for policy 0, policy_version 565178 (0.0008) [2023-12-27 23:18:14,559][106226] Updated weights for policy 0, policy_version 565188 (0.0009) [2023-12-27 23:18:14,613][106226] Updated weights for policy 0, policy_version 565199 (0.0009) [2023-12-27 23:18:15,090][106225] Updated weights for policy 1, policy_version 567064 (0.0006) [2023-12-27 23:18:15,150][106225] Updated weights for policy 1, policy_version 567074 (0.0008) [2023-12-27 23:18:15,216][106225] Updated weights for policy 1, policy_version 567084 (0.0006) [2023-12-27 23:18:15,419][106226] Updated weights for policy 0, policy_version 565209 (0.0006) [2023-12-27 23:18:15,484][106226] Updated weights for policy 0, policy_version 565219 (0.0006) [2023-12-27 23:18:15,557][106226] Updated weights for policy 0, policy_version 565229 (0.0006) [2023-12-27 23:18:15,930][106225] Updated weights for policy 1, policy_version 567094 (0.0007) [2023-12-27 23:18:15,992][106225] Updated weights for policy 1, policy_version 567104 (0.0007) [2023-12-27 23:18:16,055][106225] Updated weights for policy 1, policy_version 567114 (0.0006) [2023-12-27 23:18:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 289947648. Throughput: 0: 9544.2, 1: 9914.8. Samples: 289936300. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:16,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-5.486')] [2023-12-27 23:18:16,231][106226] Updated weights for policy 0, policy_version 565239 (0.0008) [2023-12-27 23:18:16,291][106226] Updated weights for policy 0, policy_version 565249 (0.0007) [2023-12-27 23:18:16,356][106226] Updated weights for policy 0, policy_version 565259 (0.0011) [2023-12-27 23:18:16,648][106225] Updated weights for policy 1, policy_version 567124 (0.0008) [2023-12-27 23:18:16,697][106225] Updated weights for policy 1, policy_version 567134 (0.0009) [2023-12-27 23:18:16,745][106225] Updated weights for policy 1, policy_version 567144 (0.0008) [2023-12-27 23:18:16,896][106226] Updated weights for policy 0, policy_version 565269 (0.0008) [2023-12-27 23:18:16,948][106226] Updated weights for policy 0, policy_version 565279 (0.0005) [2023-12-27 23:18:17,000][106226] Updated weights for policy 0, policy_version 565289 (0.0006) [2023-12-27 23:18:17,416][106225] Updated weights for policy 1, policy_version 567154 (0.0006) [2023-12-27 23:18:17,484][106225] Updated weights for policy 1, policy_version 567164 (0.0008) [2023-12-27 23:18:17,550][106225] Updated weights for policy 1, policy_version 567174 (0.0007) [2023-12-27 23:18:17,614][106225] Updated weights for policy 1, policy_version 567184 (0.0009) [2023-12-27 23:18:17,635][106226] Updated weights for policy 0, policy_version 565299 (0.0007) [2023-12-27 23:18:17,691][106226] Updated weights for policy 0, policy_version 565309 (0.0008) [2023-12-27 23:18:17,753][106226] Updated weights for policy 0, policy_version 565319 (0.0007) [2023-12-27 23:18:18,243][106225] Updated weights for policy 1, policy_version 567194 (0.0007) [2023-12-27 23:18:18,300][106225] Updated weights for policy 1, policy_version 567204 (0.0005) [2023-12-27 23:18:18,363][106225] Updated weights for policy 1, policy_version 567214 (0.0008) [2023-12-27 23:18:18,440][106226] Updated weights for policy 0, policy_version 565329 (0.0010) [2023-12-27 23:18:18,503][106226] Updated weights for policy 0, policy_version 565339 (0.0011) [2023-12-27 23:18:18,567][106226] Updated weights for policy 0, policy_version 565349 (0.0011) [2023-12-27 23:18:18,636][106226] Updated weights for policy 0, policy_version 565359 (0.0009) [2023-12-27 23:18:18,994][106225] Updated weights for policy 1, policy_version 567224 (0.0008) [2023-12-27 23:18:19,052][106225] Updated weights for policy 1, policy_version 567234 (0.0008) [2023-12-27 23:18:19,107][106225] Updated weights for policy 1, policy_version 567244 (0.0009) [2023-12-27 23:18:19,174][106226] Updated weights for policy 0, policy_version 565369 (0.0006) [2023-12-27 23:18:19,232][106226] Updated weights for policy 0, policy_version 565379 (0.0010) [2023-12-27 23:18:19,295][106226] Updated weights for policy 0, policy_version 565389 (0.0007) [2023-12-27 23:18:19,801][106225] Updated weights for policy 1, policy_version 567254 (0.0006) [2023-12-27 23:18:19,869][106225] Updated weights for policy 1, policy_version 567264 (0.0006) [2023-12-27 23:18:19,943][106225] Updated weights for policy 1, policy_version 567274 (0.0008) [2023-12-27 23:18:20,003][106226] Updated weights for policy 0, policy_version 565399 (0.0007) [2023-12-27 23:18:20,065][106226] Updated weights for policy 0, policy_version 565409 (0.0006) [2023-12-27 23:18:20,123][106226] Updated weights for policy 0, policy_version 565419 (0.0006) [2023-12-27 23:18:20,612][106225] Updated weights for policy 1, policy_version 567284 (0.0008) [2023-12-27 23:18:20,669][106225] Updated weights for policy 1, policy_version 567294 (0.0008) [2023-12-27 23:18:20,736][106225] Updated weights for policy 1, policy_version 567304 (0.0008) [2023-12-27 23:18:20,781][106226] Updated weights for policy 0, policy_version 565429 (0.0006) [2023-12-27 23:18:20,837][106226] Updated weights for policy 0, policy_version 565439 (0.0009) [2023-12-27 23:18:20,899][106226] Updated weights for policy 0, policy_version 565449 (0.0008) [2023-12-27 23:18:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 290054144. Throughput: 0: 9645.0, 1: 9925.0. Samples: 290060756. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:21,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.686')] [2023-12-27 23:18:21,496][106225] Updated weights for policy 1, policy_version 567314 (0.0008) [2023-12-27 23:18:21,564][106225] Updated weights for policy 1, policy_version 567324 (0.0009) [2023-12-27 23:18:21,634][106225] Updated weights for policy 1, policy_version 567334 (0.0008) [2023-12-27 23:18:21,636][106226] Updated weights for policy 0, policy_version 565459 (0.0006) [2023-12-27 23:18:21,702][106225] Updated weights for policy 1, policy_version 567344 (0.0009) [2023-12-27 23:18:21,704][106226] Updated weights for policy 0, policy_version 565469 (0.0006) [2023-12-27 23:18:21,784][106226] Updated weights for policy 0, policy_version 565479 (0.0006) [2023-12-27 23:18:22,361][106226] Updated weights for policy 0, policy_version 565489 (0.0006) [2023-12-27 23:18:22,426][106226] Updated weights for policy 0, policy_version 565499 (0.0006) [2023-12-27 23:18:22,488][106226] Updated weights for policy 0, policy_version 565509 (0.0006) [2023-12-27 23:18:22,504][106225] Updated weights for policy 1, policy_version 567354 (0.0006) [2023-12-27 23:18:22,542][106226] Updated weights for policy 0, policy_version 565519 (0.0008) [2023-12-27 23:18:22,564][106225] Updated weights for policy 1, policy_version 567364 (0.0007) [2023-12-27 23:18:22,634][106225] Updated weights for policy 1, policy_version 567374 (0.0009) [2023-12-27 23:18:23,281][106226] Updated weights for policy 0, policy_version 565529 (0.0010) [2023-12-27 23:18:23,300][106225] Updated weights for policy 1, policy_version 567384 (0.0009) [2023-12-27 23:18:23,338][106226] Updated weights for policy 0, policy_version 565539 (0.0010) [2023-12-27 23:18:23,358][106225] Updated weights for policy 1, policy_version 567394 (0.0010) [2023-12-27 23:18:23,405][106225] Updated weights for policy 1, policy_version 567404 (0.0010) [2023-12-27 23:18:23,405][106226] Updated weights for policy 0, policy_version 565549 (0.0011) [2023-12-27 23:18:24,072][106225] Updated weights for policy 1, policy_version 567414 (0.0009) [2023-12-27 23:18:24,086][106226] Updated weights for policy 0, policy_version 565559 (0.0008) [2023-12-27 23:18:24,125][106225] Updated weights for policy 1, policy_version 567424 (0.0008) [2023-12-27 23:18:24,147][106226] Updated weights for policy 0, policy_version 565569 (0.0006) [2023-12-27 23:18:24,184][106225] Updated weights for policy 1, policy_version 567434 (0.0008) [2023-12-27 23:18:24,207][106226] Updated weights for policy 0, policy_version 565579 (0.0006) [2023-12-27 23:18:24,773][106226] Updated weights for policy 0, policy_version 565589 (0.0007) [2023-12-27 23:18:24,821][106226] Updated weights for policy 0, policy_version 565599 (0.0009) [2023-12-27 23:18:24,871][106226] Updated weights for policy 0, policy_version 565609 (0.0010) [2023-12-27 23:18:24,928][106225] Updated weights for policy 1, policy_version 567444 (0.0008) [2023-12-27 23:18:24,997][106225] Updated weights for policy 1, policy_version 567454 (0.0007) [2023-12-27 23:18:25,068][106225] Updated weights for policy 1, policy_version 567464 (0.0008) [2023-12-27 23:18:25,529][106226] Updated weights for policy 0, policy_version 565619 (0.0009) [2023-12-27 23:18:25,585][106226] Updated weights for policy 0, policy_version 565629 (0.0006) [2023-12-27 23:18:25,624][106225] Updated weights for policy 1, policy_version 567474 (0.0005) [2023-12-27 23:18:25,650][106226] Updated weights for policy 0, policy_version 565639 (0.0007) [2023-12-27 23:18:25,680][106225] Updated weights for policy 1, policy_version 567484 (0.0006) [2023-12-27 23:18:25,732][106225] Updated weights for policy 1, policy_version 567494 (0.0006) [2023-12-27 23:18:25,779][106225] Updated weights for policy 1, policy_version 567504 (0.0006) [2023-12-27 23:18:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 290152448. Throughput: 0: 9656.1, 1: 9904.2. Samples: 290119364. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:26,176][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.770')] [2023-12-27 23:18:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000567504_145309696.pth... [2023-12-27 23:18:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000565648_144842752.pth... [2023-12-27 23:18:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000564528_144556032.pth [2023-12-27 23:18:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000566352_145014784.pth [2023-12-27 23:18:26,351][106225] Updated weights for policy 1, policy_version 567514 (0.0008) [2023-12-27 23:18:26,371][106226] Updated weights for policy 0, policy_version 565649 (0.0007) [2023-12-27 23:18:26,403][106225] Updated weights for policy 1, policy_version 567524 (0.0009) [2023-12-27 23:18:26,421][106226] Updated weights for policy 0, policy_version 565659 (0.0006) [2023-12-27 23:18:26,462][106225] Updated weights for policy 1, policy_version 567534 (0.0008) [2023-12-27 23:18:26,481][106226] Updated weights for policy 0, policy_version 565669 (0.0006) [2023-12-27 23:18:26,542][106226] Updated weights for policy 0, policy_version 565679 (0.0008) [2023-12-27 23:18:27,190][106225] Updated weights for policy 1, policy_version 567544 (0.0006) [2023-12-27 23:18:27,239][106226] Updated weights for policy 0, policy_version 565689 (0.0007) [2023-12-27 23:18:27,243][106225] Updated weights for policy 1, policy_version 567554 (0.0005) [2023-12-27 23:18:27,292][106226] Updated weights for policy 0, policy_version 565699 (0.0008) [2023-12-27 23:18:27,306][106225] Updated weights for policy 1, policy_version 567564 (0.0006) [2023-12-27 23:18:27,353][106226] Updated weights for policy 0, policy_version 565709 (0.0007) [2023-12-27 23:18:27,808][106225] Updated weights for policy 1, policy_version 567574 (0.0007) [2023-12-27 23:18:27,862][106225] Updated weights for policy 1, policy_version 567584 (0.0005) [2023-12-27 23:18:27,929][106225] Updated weights for policy 1, policy_version 567594 (0.0005) [2023-12-27 23:18:28,105][106226] Updated weights for policy 0, policy_version 565719 (0.0008) [2023-12-27 23:18:28,164][106226] Updated weights for policy 0, policy_version 565729 (0.0008) [2023-12-27 23:18:28,215][106226] Updated weights for policy 0, policy_version 565739 (0.0007) [2023-12-27 23:18:28,541][106225] Updated weights for policy 1, policy_version 567604 (0.0007) [2023-12-27 23:18:28,598][106225] Updated weights for policy 1, policy_version 567614 (0.0007) [2023-12-27 23:18:28,654][106225] Updated weights for policy 1, policy_version 567624 (0.0007) [2023-12-27 23:18:28,928][106226] Updated weights for policy 0, policy_version 565749 (0.0006) [2023-12-27 23:18:28,990][106226] Updated weights for policy 0, policy_version 565759 (0.0007) [2023-12-27 23:18:29,041][106226] Updated weights for policy 0, policy_version 565769 (0.0005) [2023-12-27 23:18:29,425][106225] Updated weights for policy 1, policy_version 567634 (0.0008) [2023-12-27 23:18:29,487][106225] Updated weights for policy 1, policy_version 567644 (0.0006) [2023-12-27 23:18:29,548][106225] Updated weights for policy 1, policy_version 567654 (0.0008) [2023-12-27 23:18:29,605][106225] Updated weights for policy 1, policy_version 567664 (0.0007) [2023-12-27 23:18:29,741][106226] Updated weights for policy 0, policy_version 565779 (0.0005) [2023-12-27 23:18:29,804][106226] Updated weights for policy 0, policy_version 565789 (0.0005) [2023-12-27 23:18:29,871][106226] Updated weights for policy 0, policy_version 565799 (0.0008) [2023-12-27 23:18:30,249][106225] Updated weights for policy 1, policy_version 567674 (0.0007) [2023-12-27 23:18:30,302][106225] Updated weights for policy 1, policy_version 567684 (0.0007) [2023-12-27 23:18:30,363][106225] Updated weights for policy 1, policy_version 567694 (0.0008) [2023-12-27 23:18:30,551][106226] Updated weights for policy 0, policy_version 565809 (0.0008) [2023-12-27 23:18:30,607][106226] Updated weights for policy 0, policy_version 565819 (0.0010) [2023-12-27 23:18:30,668][106226] Updated weights for policy 0, policy_version 565829 (0.0009) [2023-12-27 23:18:30,725][106226] Updated weights for policy 0, policy_version 565839 (0.0010) [2023-12-27 23:18:31,126][106225] Updated weights for policy 1, policy_version 567704 (0.0007) [2023-12-27 23:18:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 290250752. Throughput: 0: 9751.8, 1: 10007.1. Samples: 290244572. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:31,175][105115] Avg episode reward: [(0, '-5.117'), (1, '-5.454')] [2023-12-27 23:18:31,193][106225] Updated weights for policy 1, policy_version 567714 (0.0007) [2023-12-27 23:18:31,257][106225] Updated weights for policy 1, policy_version 567724 (0.0006) [2023-12-27 23:18:31,484][106226] Updated weights for policy 0, policy_version 565849 (0.0006) [2023-12-27 23:18:31,571][106226] Updated weights for policy 0, policy_version 565859 (0.0007) [2023-12-27 23:18:31,631][106226] Updated weights for policy 0, policy_version 565869 (0.0011) [2023-12-27 23:18:31,946][106225] Updated weights for policy 1, policy_version 567734 (0.0007) [2023-12-27 23:18:32,007][106225] Updated weights for policy 1, policy_version 567744 (0.0008) [2023-12-27 23:18:32,075][106225] Updated weights for policy 1, policy_version 567754 (0.0008) [2023-12-27 23:18:32,287][106226] Updated weights for policy 0, policy_version 565879 (0.0012) [2023-12-27 23:18:32,350][106226] Updated weights for policy 0, policy_version 565889 (0.0011) [2023-12-27 23:18:32,415][106226] Updated weights for policy 0, policy_version 565899 (0.0010) [2023-12-27 23:18:32,769][106225] Updated weights for policy 1, policy_version 567764 (0.0008) [2023-12-27 23:18:32,829][106225] Updated weights for policy 1, policy_version 567774 (0.0006) [2023-12-27 23:18:32,891][106225] Updated weights for policy 1, policy_version 567784 (0.0006) [2023-12-27 23:18:33,096][106226] Updated weights for policy 0, policy_version 565909 (0.0010) [2023-12-27 23:18:33,156][106226] Updated weights for policy 0, policy_version 565919 (0.0011) [2023-12-27 23:18:33,209][106226] Updated weights for policy 0, policy_version 565929 (0.0010) [2023-12-27 23:18:33,545][106225] Updated weights for policy 1, policy_version 567794 (0.0006) [2023-12-27 23:18:33,593][106225] Updated weights for policy 1, policy_version 567804 (0.0008) [2023-12-27 23:18:33,651][106225] Updated weights for policy 1, policy_version 567814 (0.0006) [2023-12-27 23:18:33,717][106225] Updated weights for policy 1, policy_version 567824 (0.0005) [2023-12-27 23:18:33,902][106226] Updated weights for policy 0, policy_version 565939 (0.0009) [2023-12-27 23:18:33,959][106226] Updated weights for policy 0, policy_version 565949 (0.0006) [2023-12-27 23:18:34,015][106226] Updated weights for policy 0, policy_version 565959 (0.0006) [2023-12-27 23:18:34,408][106225] Updated weights for policy 1, policy_version 567834 (0.0008) [2023-12-27 23:18:34,462][106225] Updated weights for policy 1, policy_version 567844 (0.0008) [2023-12-27 23:18:34,517][106225] Updated weights for policy 1, policy_version 567854 (0.0008) [2023-12-27 23:18:34,713][106226] Updated weights for policy 0, policy_version 565969 (0.0010) [2023-12-27 23:18:34,780][106226] Updated weights for policy 0, policy_version 565979 (0.0008) [2023-12-27 23:18:34,841][106226] Updated weights for policy 0, policy_version 565989 (0.0008) [2023-12-27 23:18:34,899][106226] Updated weights for policy 0, policy_version 565999 (0.0008) [2023-12-27 23:18:35,223][106225] Updated weights for policy 1, policy_version 567864 (0.0006) [2023-12-27 23:18:35,271][106225] Updated weights for policy 1, policy_version 567874 (0.0005) [2023-12-27 23:18:35,322][106225] Updated weights for policy 1, policy_version 567884 (0.0005) [2023-12-27 23:18:35,668][106226] Updated weights for policy 0, policy_version 566009 (0.0006) [2023-12-27 23:18:35,732][106226] Updated weights for policy 0, policy_version 566019 (0.0005) [2023-12-27 23:18:35,805][106226] Updated weights for policy 0, policy_version 566029 (0.0005) [2023-12-27 23:18:35,862][106225] Updated weights for policy 1, policy_version 567894 (0.0005) [2023-12-27 23:18:35,907][106225] Updated weights for policy 1, policy_version 567904 (0.0005) [2023-12-27 23:18:35,964][106225] Updated weights for policy 1, policy_version 567914 (0.0007) [2023-12-27 23:18:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 290357248. Throughput: 0: 9781.0, 1: 10041.1. Samples: 290364904. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-27 23:18:36,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-5.613')] [2023-12-27 23:18:36,449][106226] Updated weights for policy 0, policy_version 566039 (0.0009) [2023-12-27 23:18:36,510][106226] Updated weights for policy 0, policy_version 566049 (0.0009) [2023-12-27 23:18:36,571][106226] Updated weights for policy 0, policy_version 566059 (0.0010) [2023-12-27 23:18:36,592][106225] Updated weights for policy 1, policy_version 567924 (0.0007) [2023-12-27 23:18:36,659][106225] Updated weights for policy 1, policy_version 567934 (0.0008) [2023-12-27 23:18:36,717][106225] Updated weights for policy 1, policy_version 567944 (0.0008) [2023-12-27 23:18:37,225][106226] Updated weights for policy 0, policy_version 566069 (0.0010) [2023-12-27 23:18:37,282][106226] Updated weights for policy 0, policy_version 566079 (0.0010) [2023-12-27 23:18:37,332][106226] Updated weights for policy 0, policy_version 566089 (0.0008) [2023-12-27 23:18:37,472][106225] Updated weights for policy 1, policy_version 567954 (0.0008) [2023-12-27 23:18:37,532][106225] Updated weights for policy 1, policy_version 567964 (0.0005) [2023-12-27 23:18:37,596][106225] Updated weights for policy 1, policy_version 567974 (0.0006) [2023-12-27 23:18:37,659][106225] Updated weights for policy 1, policy_version 567984 (0.0009) [2023-12-27 23:18:37,999][106226] Updated weights for policy 0, policy_version 566099 (0.0007) [2023-12-27 23:18:38,057][106226] Updated weights for policy 0, policy_version 566109 (0.0005) [2023-12-27 23:18:38,114][106226] Updated weights for policy 0, policy_version 566119 (0.0006) [2023-12-27 23:18:38,303][106225] Updated weights for policy 1, policy_version 567994 (0.0010) [2023-12-27 23:18:38,361][106225] Updated weights for policy 1, policy_version 568004 (0.0010) [2023-12-27 23:18:38,424][106225] Updated weights for policy 1, policy_version 568014 (0.0010) [2023-12-27 23:18:38,788][106226] Updated weights for policy 0, policy_version 566129 (0.0010) [2023-12-27 23:18:38,848][106226] Updated weights for policy 0, policy_version 566139 (0.0005) [2023-12-27 23:18:38,917][106226] Updated weights for policy 0, policy_version 566149 (0.0006) [2023-12-27 23:18:38,978][106226] Updated weights for policy 0, policy_version 566159 (0.0006) [2023-12-27 23:18:39,205][106225] Updated weights for policy 1, policy_version 568024 (0.0008) [2023-12-27 23:18:39,277][106225] Updated weights for policy 1, policy_version 568034 (0.0008) [2023-12-27 23:18:39,337][106225] Updated weights for policy 1, policy_version 568044 (0.0008) [2023-12-27 23:18:39,656][106226] Updated weights for policy 0, policy_version 566169 (0.0009) [2023-12-27 23:18:39,728][106226] Updated weights for policy 0, policy_version 566179 (0.0009) [2023-12-27 23:18:39,794][106226] Updated weights for policy 0, policy_version 566189 (0.0009) [2023-12-27 23:18:39,967][106225] Updated weights for policy 1, policy_version 568054 (0.0007) [2023-12-27 23:18:40,028][106225] Updated weights for policy 1, policy_version 568064 (0.0007) [2023-12-27 23:18:40,088][106225] Updated weights for policy 1, policy_version 568074 (0.0007) [2023-12-27 23:18:40,450][106226] Updated weights for policy 0, policy_version 566199 (0.0011) [2023-12-27 23:18:40,504][106226] Updated weights for policy 0, policy_version 566209 (0.0011) [2023-12-27 23:18:40,558][106226] Updated weights for policy 0, policy_version 566219 (0.0011) [2023-12-27 23:18:40,802][106225] Updated weights for policy 1, policy_version 568084 (0.0006) [2023-12-27 23:18:40,852][106225] Updated weights for policy 1, policy_version 568094 (0.0009) [2023-12-27 23:18:40,914][106225] Updated weights for policy 1, policy_version 568104 (0.0008) [2023-12-27 23:18:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 290455552. Throughput: 0: 9829.7, 1: 10051.3. Samples: 290425504. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:18:41,175][105115] Avg episode reward: [(0, '-5.091'), (1, '-5.585')] [2023-12-27 23:18:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000568112_145465344.pth... [2023-12-27 23:18:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000566224_144990208.pth... [2023-12-27 23:18:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000565072_144695296.pth [2023-12-27 23:18:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000566928_145162240.pth [2023-12-27 23:18:41,313][106226] Updated weights for policy 0, policy_version 566229 (0.0009) [2023-12-27 23:18:41,386][106226] Updated weights for policy 0, policy_version 566239 (0.0008) [2023-12-27 23:18:41,437][106226] Updated weights for policy 0, policy_version 566249 (0.0008) [2023-12-27 23:18:41,687][106225] Updated weights for policy 1, policy_version 568114 (0.0008) [2023-12-27 23:18:41,744][106225] Updated weights for policy 1, policy_version 568124 (0.0007) [2023-12-27 23:18:41,811][106225] Updated weights for policy 1, policy_version 568134 (0.0008) [2023-12-27 23:18:41,877][106225] Updated weights for policy 1, policy_version 568144 (0.0008) [2023-12-27 23:18:42,233][106226] Updated weights for policy 0, policy_version 566259 (0.0008) [2023-12-27 23:18:42,295][106226] Updated weights for policy 0, policy_version 566269 (0.0009) [2023-12-27 23:18:42,364][106226] Updated weights for policy 0, policy_version 566279 (0.0009) [2023-12-27 23:18:42,655][106225] Updated weights for policy 1, policy_version 568154 (0.0007) [2023-12-27 23:18:42,724][106225] Updated weights for policy 1, policy_version 568164 (0.0008) [2023-12-27 23:18:42,791][106225] Updated weights for policy 1, policy_version 568174 (0.0008) [2023-12-27 23:18:43,046][106226] Updated weights for policy 0, policy_version 566289 (0.0008) [2023-12-27 23:18:43,108][106226] Updated weights for policy 0, policy_version 566299 (0.0005) [2023-12-27 23:18:43,157][106226] Updated weights for policy 0, policy_version 566309 (0.0008) [2023-12-27 23:18:43,215][106226] Updated weights for policy 0, policy_version 566319 (0.0010) [2023-12-27 23:18:43,555][106225] Updated weights for policy 1, policy_version 568184 (0.0008) [2023-12-27 23:18:43,611][106225] Updated weights for policy 1, policy_version 568194 (0.0008) [2023-12-27 23:18:43,669][106225] Updated weights for policy 1, policy_version 568204 (0.0009) [2023-12-27 23:18:43,881][106226] Updated weights for policy 0, policy_version 566329 (0.0006) [2023-12-27 23:18:43,950][106226] Updated weights for policy 0, policy_version 566339 (0.0009) [2023-12-27 23:18:44,009][106226] Updated weights for policy 0, policy_version 566349 (0.0010) [2023-12-27 23:18:44,335][106225] Updated weights for policy 1, policy_version 568214 (0.0010) [2023-12-27 23:18:44,395][106225] Updated weights for policy 1, policy_version 568224 (0.0010) [2023-12-27 23:18:44,449][106225] Updated weights for policy 1, policy_version 568234 (0.0010) [2023-12-27 23:18:44,660][106226] Updated weights for policy 0, policy_version 566359 (0.0011) [2023-12-27 23:18:44,717][106226] Updated weights for policy 0, policy_version 566369 (0.0011) [2023-12-27 23:18:44,783][106226] Updated weights for policy 0, policy_version 566379 (0.0010) [2023-12-27 23:18:45,193][106225] Updated weights for policy 1, policy_version 568244 (0.0010) [2023-12-27 23:18:45,249][106225] Updated weights for policy 1, policy_version 568254 (0.0010) [2023-12-27 23:18:45,301][106225] Updated weights for policy 1, policy_version 568264 (0.0010) [2023-12-27 23:18:45,431][106226] Updated weights for policy 0, policy_version 566389 (0.0009) [2023-12-27 23:18:45,493][106226] Updated weights for policy 0, policy_version 566399 (0.0010) [2023-12-27 23:18:45,558][106226] Updated weights for policy 0, policy_version 566409 (0.0009) [2023-12-27 23:18:46,016][106225] Updated weights for policy 1, policy_version 568274 (0.0011) [2023-12-27 23:18:46,063][106225] Updated weights for policy 1, policy_version 568284 (0.0010) [2023-12-27 23:18:46,114][106225] Updated weights for policy 1, policy_version 568294 (0.0010) [2023-12-27 23:18:46,162][106225] Updated weights for policy 1, policy_version 568304 (0.0010) [2023-12-27 23:18:46,166][106226] Updated weights for policy 0, policy_version 566419 (0.0008) [2023-12-27 23:18:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 290553856. Throughput: 0: 9813.4, 1: 10015.3. Samples: 290540936. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:18:46,175][105115] Avg episode reward: [(0, '-4.924'), (1, '-5.366')] [2023-12-27 23:18:46,231][106226] Updated weights for policy 0, policy_version 566429 (0.0011) [2023-12-27 23:18:46,295][106226] Updated weights for policy 0, policy_version 566439 (0.0011) [2023-12-27 23:18:46,911][106225] Updated weights for policy 1, policy_version 568314 (0.0010) [2023-12-27 23:18:46,957][106225] Updated weights for policy 1, policy_version 568324 (0.0010) [2023-12-27 23:18:47,003][106225] Updated weights for policy 1, policy_version 568334 (0.0010) [2023-12-27 23:18:47,012][106226] Updated weights for policy 0, policy_version 566449 (0.0011) [2023-12-27 23:18:47,062][106226] Updated weights for policy 0, policy_version 566459 (0.0011) [2023-12-27 23:18:47,122][106226] Updated weights for policy 0, policy_version 566469 (0.0010) [2023-12-27 23:18:47,180][106226] Updated weights for policy 0, policy_version 566479 (0.0011) [2023-12-27 23:18:47,621][106225] Updated weights for policy 1, policy_version 568344 (0.0010) [2023-12-27 23:18:47,681][106225] Updated weights for policy 1, policy_version 568354 (0.0010) [2023-12-27 23:18:47,743][106225] Updated weights for policy 1, policy_version 568364 (0.0010) [2023-12-27 23:18:47,894][106226] Updated weights for policy 0, policy_version 566489 (0.0011) [2023-12-27 23:18:47,956][106226] Updated weights for policy 0, policy_version 566499 (0.0011) [2023-12-27 23:18:48,013][106226] Updated weights for policy 0, policy_version 566509 (0.0010) [2023-12-27 23:18:48,442][106225] Updated weights for policy 1, policy_version 568374 (0.0011) [2023-12-27 23:18:48,499][106225] Updated weights for policy 1, policy_version 568384 (0.0010) [2023-12-27 23:18:48,561][106225] Updated weights for policy 1, policy_version 568394 (0.0011) [2023-12-27 23:18:48,719][106226] Updated weights for policy 0, policy_version 566519 (0.0009) [2023-12-27 23:18:48,781][106226] Updated weights for policy 0, policy_version 566529 (0.0011) [2023-12-27 23:18:48,839][106226] Updated weights for policy 0, policy_version 566539 (0.0011) [2023-12-27 23:18:49,249][106225] Updated weights for policy 1, policy_version 568404 (0.0010) [2023-12-27 23:18:49,311][106225] Updated weights for policy 1, policy_version 568414 (0.0006) [2023-12-27 23:18:49,379][106225] Updated weights for policy 1, policy_version 568424 (0.0007) [2023-12-27 23:18:49,506][106226] Updated weights for policy 0, policy_version 566549 (0.0009) [2023-12-27 23:18:49,563][106226] Updated weights for policy 0, policy_version 566559 (0.0008) [2023-12-27 23:18:49,615][106226] Updated weights for policy 0, policy_version 566569 (0.0009) [2023-12-27 23:18:50,078][106225] Updated weights for policy 1, policy_version 568434 (0.0010) [2023-12-27 23:18:50,135][106225] Updated weights for policy 1, policy_version 568444 (0.0009) [2023-12-27 23:18:50,197][106225] Updated weights for policy 1, policy_version 568454 (0.0009) [2023-12-27 23:18:50,256][106225] Updated weights for policy 1, policy_version 568464 (0.0008) [2023-12-27 23:18:50,400][106226] Updated weights for policy 0, policy_version 566579 (0.0008) [2023-12-27 23:18:50,452][106226] Updated weights for policy 0, policy_version 566589 (0.0007) [2023-12-27 23:18:50,503][106226] Updated weights for policy 0, policy_version 566599 (0.0008) [2023-12-27 23:18:51,070][106225] Updated weights for policy 1, policy_version 568474 (0.0010) [2023-12-27 23:18:51,134][106225] Updated weights for policy 1, policy_version 568484 (0.0008) [2023-12-27 23:18:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 290643968. Throughput: 0: 9861.1, 1: 10008.5. Samples: 290659180. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:18:51,175][105115] Avg episode reward: [(0, '-5.166'), (1, '-5.381')] [2023-12-27 23:18:51,192][106225] Updated weights for policy 1, policy_version 568494 (0.0008) [2023-12-27 23:18:51,253][106226] Updated weights for policy 0, policy_version 566609 (0.0008) [2023-12-27 23:18:51,316][106226] Updated weights for policy 0, policy_version 566619 (0.0008) [2023-12-27 23:18:51,380][106226] Updated weights for policy 0, policy_version 566629 (0.0008) [2023-12-27 23:18:51,441][106226] Updated weights for policy 0, policy_version 566639 (0.0008) [2023-12-27 23:18:51,974][106225] Updated weights for policy 1, policy_version 568504 (0.0009) [2023-12-27 23:18:52,033][106225] Updated weights for policy 1, policy_version 568514 (0.0008) [2023-12-27 23:18:52,093][106225] Updated weights for policy 1, policy_version 568524 (0.0009) [2023-12-27 23:18:52,235][106226] Updated weights for policy 0, policy_version 566649 (0.0008) [2023-12-27 23:18:52,300][106226] Updated weights for policy 0, policy_version 566659 (0.0008) [2023-12-27 23:18:52,357][106226] Updated weights for policy 0, policy_version 566669 (0.0008) [2023-12-27 23:18:52,834][106225] Updated weights for policy 1, policy_version 568534 (0.0008) [2023-12-27 23:18:52,891][106225] Updated weights for policy 1, policy_version 568544 (0.0005) [2023-12-27 23:18:52,940][106225] Updated weights for policy 1, policy_version 568554 (0.0008) [2023-12-27 23:18:53,146][106226] Updated weights for policy 0, policy_version 566679 (0.0009) [2023-12-27 23:18:53,199][106226] Updated weights for policy 0, policy_version 566689 (0.0009) [2023-12-27 23:18:53,258][106226] Updated weights for policy 0, policy_version 566699 (0.0008) [2023-12-27 23:18:53,582][106225] Updated weights for policy 1, policy_version 568564 (0.0008) [2023-12-27 23:18:53,636][106225] Updated weights for policy 1, policy_version 568574 (0.0008) [2023-12-27 23:18:53,687][106225] Updated weights for policy 1, policy_version 568584 (0.0008) [2023-12-27 23:18:54,012][106226] Updated weights for policy 0, policy_version 566709 (0.0009) [2023-12-27 23:18:54,063][106226] Updated weights for policy 0, policy_version 566720 (0.0008) [2023-12-27 23:18:54,113][106226] Updated weights for policy 0, policy_version 566730 (0.0007) [2023-12-27 23:18:54,375][106225] Updated weights for policy 1, policy_version 568594 (0.0008) [2023-12-27 23:18:54,435][106225] Updated weights for policy 1, policy_version 568604 (0.0009) [2023-12-27 23:18:54,485][106225] Updated weights for policy 1, policy_version 568614 (0.0008) [2023-12-27 23:18:54,541][106225] Updated weights for policy 1, policy_version 568624 (0.0008) [2023-12-27 23:18:54,874][106226] Updated weights for policy 0, policy_version 566740 (0.0008) [2023-12-27 23:18:54,930][106226] Updated weights for policy 0, policy_version 566750 (0.0008) [2023-12-27 23:18:54,978][106226] Updated weights for policy 0, policy_version 566760 (0.0008) [2023-12-27 23:18:55,232][106225] Updated weights for policy 1, policy_version 568634 (0.0010) [2023-12-27 23:18:55,290][106225] Updated weights for policy 1, policy_version 568644 (0.0010) [2023-12-27 23:18:55,351][106225] Updated weights for policy 1, policy_version 568654 (0.0010) [2023-12-27 23:18:55,754][106226] Updated weights for policy 0, policy_version 566770 (0.0008) [2023-12-27 23:18:55,815][106226] Updated weights for policy 0, policy_version 566780 (0.0009) [2023-12-27 23:18:55,862][106226] Updated weights for policy 0, policy_version 566790 (0.0010) [2023-12-27 23:18:55,918][106226] Updated weights for policy 0, policy_version 566800 (0.0010) [2023-12-27 23:18:56,062][106225] Updated weights for policy 1, policy_version 568664 (0.0010) [2023-12-27 23:18:56,112][106225] Updated weights for policy 1, policy_version 568674 (0.0010) [2023-12-27 23:18:56,166][106225] Updated weights for policy 1, policy_version 568684 (0.0010) [2023-12-27 23:18:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 290742272. Throughput: 0: 9866.4, 1: 9993.5. Samples: 290715472. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:18:56,175][105115] Avg episode reward: [(0, '-5.260'), (1, '-5.509')] [2023-12-27 23:18:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000566800_145137664.pth... [2023-12-27 23:18:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000568688_145612800.pth... [2023-12-27 23:18:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000567504_145309696.pth [2023-12-27 23:18:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000565648_144842752.pth [2023-12-27 23:18:56,632][106226] Updated weights for policy 0, policy_version 566810 (0.0010) [2023-12-27 23:18:56,688][106226] Updated weights for policy 0, policy_version 566820 (0.0010) [2023-12-27 23:18:56,748][106226] Updated weights for policy 0, policy_version 566830 (0.0006) [2023-12-27 23:18:56,815][106225] Updated weights for policy 1, policy_version 568694 (0.0010) [2023-12-27 23:18:56,880][106225] Updated weights for policy 1, policy_version 568704 (0.0010) [2023-12-27 23:18:56,939][106225] Updated weights for policy 1, policy_version 568714 (0.0010) [2023-12-27 23:18:57,372][106226] Updated weights for policy 0, policy_version 566840 (0.0005) [2023-12-27 23:18:57,441][106226] Updated weights for policy 0, policy_version 566850 (0.0009) [2023-12-27 23:18:57,496][106226] Updated weights for policy 0, policy_version 566860 (0.0010) [2023-12-27 23:18:57,590][106225] Updated weights for policy 1, policy_version 568724 (0.0010) [2023-12-27 23:18:57,636][106225] Updated weights for policy 1, policy_version 568734 (0.0010) [2023-12-27 23:18:57,682][106225] Updated weights for policy 1, policy_version 568744 (0.0010) [2023-12-27 23:18:58,130][106226] Updated weights for policy 0, policy_version 566870 (0.0010) [2023-12-27 23:18:58,186][106226] Updated weights for policy 0, policy_version 566880 (0.0010) [2023-12-27 23:18:58,262][106226] Updated weights for policy 0, policy_version 566890 (0.0010) [2023-12-27 23:18:58,426][106225] Updated weights for policy 1, policy_version 568754 (0.0010) [2023-12-27 23:18:58,491][106225] Updated weights for policy 1, policy_version 568764 (0.0008) [2023-12-27 23:18:58,558][106225] Updated weights for policy 1, policy_version 568774 (0.0008) [2023-12-27 23:18:58,623][106225] Updated weights for policy 1, policy_version 568784 (0.0008) [2023-12-27 23:18:59,010][106226] Updated weights for policy 0, policy_version 566900 (0.0009) [2023-12-27 23:18:59,072][106226] Updated weights for policy 0, policy_version 566910 (0.0007) [2023-12-27 23:18:59,130][106226] Updated weights for policy 0, policy_version 566920 (0.0008) [2023-12-27 23:18:59,424][106225] Updated weights for policy 1, policy_version 568794 (0.0008) [2023-12-27 23:18:59,477][106225] Updated weights for policy 1, policy_version 568804 (0.0006) [2023-12-27 23:18:59,537][106225] Updated weights for policy 1, policy_version 568814 (0.0008) [2023-12-27 23:18:59,868][106226] Updated weights for policy 0, policy_version 566930 (0.0007) [2023-12-27 23:18:59,940][106226] Updated weights for policy 0, policy_version 566940 (0.0008) [2023-12-27 23:18:59,991][106226] Updated weights for policy 0, policy_version 566950 (0.0010) [2023-12-27 23:19:00,043][106226] Updated weights for policy 0, policy_version 566960 (0.0010) [2023-12-27 23:19:00,289][106225] Updated weights for policy 1, policy_version 568824 (0.0010) [2023-12-27 23:19:00,343][106225] Updated weights for policy 1, policy_version 568834 (0.0010) [2023-12-27 23:19:00,413][106225] Updated weights for policy 1, policy_version 568844 (0.0006) [2023-12-27 23:19:00,743][106226] Updated weights for policy 0, policy_version 566970 (0.0011) [2023-12-27 23:19:00,816][106226] Updated weights for policy 0, policy_version 566980 (0.0009) [2023-12-27 23:19:00,884][106226] Updated weights for policy 0, policy_version 566990 (0.0010) [2023-12-27 23:19:01,038][106225] Updated weights for policy 1, policy_version 568854 (0.0007) [2023-12-27 23:19:01,105][106225] Updated weights for policy 1, policy_version 568864 (0.0008) [2023-12-27 23:19:01,151][106225] Updated weights for policy 1, policy_version 568874 (0.0008) [2023-12-27 23:19:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 290840576. Throughput: 0: 9941.8, 1: 9981.1. Samples: 290832828. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:01,176][105115] Avg episode reward: [(0, '-4.953'), (1, '-5.749')] [2023-12-27 23:19:01,657][106226] Updated weights for policy 0, policy_version 567000 (0.0011) [2023-12-27 23:19:01,727][106226] Updated weights for policy 0, policy_version 567010 (0.0009) [2023-12-27 23:19:01,778][106226] Updated weights for policy 0, policy_version 567020 (0.0008) [2023-12-27 23:19:01,915][106225] Updated weights for policy 1, policy_version 568884 (0.0008) [2023-12-27 23:19:01,962][106225] Updated weights for policy 1, policy_version 568894 (0.0007) [2023-12-27 23:19:02,026][106225] Updated weights for policy 1, policy_version 568904 (0.0008) [2023-12-27 23:19:02,497][106226] Updated weights for policy 0, policy_version 567030 (0.0006) [2023-12-27 23:19:02,557][106226] Updated weights for policy 0, policy_version 567040 (0.0006) [2023-12-27 23:19:02,620][106226] Updated weights for policy 0, policy_version 567050 (0.0008) [2023-12-27 23:19:02,772][106225] Updated weights for policy 1, policy_version 568914 (0.0009) [2023-12-27 23:19:02,828][106225] Updated weights for policy 1, policy_version 568924 (0.0009) [2023-12-27 23:19:02,882][106225] Updated weights for policy 1, policy_version 568934 (0.0010) [2023-12-27 23:19:02,939][106225] Updated weights for policy 1, policy_version 568944 (0.0007) [2023-12-27 23:19:03,256][106226] Updated weights for policy 0, policy_version 567060 (0.0008) [2023-12-27 23:19:03,312][106226] Updated weights for policy 0, policy_version 567070 (0.0008) [2023-12-27 23:19:03,363][106226] Updated weights for policy 0, policy_version 567080 (0.0006) [2023-12-27 23:19:03,638][106225] Updated weights for policy 1, policy_version 568954 (0.0010) [2023-12-27 23:19:03,697][106225] Updated weights for policy 1, policy_version 568964 (0.0010) [2023-12-27 23:19:03,746][106225] Updated weights for policy 1, policy_version 568974 (0.0010) [2023-12-27 23:19:04,082][106226] Updated weights for policy 0, policy_version 567090 (0.0006) [2023-12-27 23:19:04,143][106226] Updated weights for policy 0, policy_version 567100 (0.0009) [2023-12-27 23:19:04,202][106226] Updated weights for policy 0, policy_version 567110 (0.0009) [2023-12-27 23:19:04,253][106226] Updated weights for policy 0, policy_version 567120 (0.0009) [2023-12-27 23:19:04,445][106225] Updated weights for policy 1, policy_version 568984 (0.0011) [2023-12-27 23:19:04,507][106225] Updated weights for policy 1, policy_version 568994 (0.0011) [2023-12-27 23:19:04,560][106225] Updated weights for policy 1, policy_version 569004 (0.0010) [2023-12-27 23:19:04,908][106226] Updated weights for policy 0, policy_version 567130 (0.0005) [2023-12-27 23:19:04,971][106226] Updated weights for policy 0, policy_version 567140 (0.0006) [2023-12-27 23:19:05,040][106226] Updated weights for policy 0, policy_version 567150 (0.0007) [2023-12-27 23:19:05,215][106225] Updated weights for policy 1, policy_version 569014 (0.0007) [2023-12-27 23:19:05,287][106225] Updated weights for policy 1, policy_version 569024 (0.0006) [2023-12-27 23:19:05,351][106225] Updated weights for policy 1, policy_version 569034 (0.0005) [2023-12-27 23:19:05,601][106226] Updated weights for policy 0, policy_version 567160 (0.0006) [2023-12-27 23:19:05,651][106226] Updated weights for policy 0, policy_version 567170 (0.0006) [2023-12-27 23:19:05,706][106226] Updated weights for policy 0, policy_version 567180 (0.0008) [2023-12-27 23:19:05,944][106225] Updated weights for policy 1, policy_version 569044 (0.0008) [2023-12-27 23:19:05,994][106225] Updated weights for policy 1, policy_version 569054 (0.0009) [2023-12-27 23:19:06,046][106225] Updated weights for policy 1, policy_version 569064 (0.0008) [2023-12-27 23:19:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 290947072. Throughput: 0: 9894.0, 1: 9959.5. Samples: 290954160. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:06,175][105115] Avg episode reward: [(0, '-5.080'), (1, '-5.591')] [2023-12-27 23:19:06,430][106226] Updated weights for policy 0, policy_version 567190 (0.0009) [2023-12-27 23:19:06,493][106226] Updated weights for policy 0, policy_version 567200 (0.0009) [2023-12-27 23:19:06,556][106226] Updated weights for policy 0, policy_version 567210 (0.0009) [2023-12-27 23:19:06,686][106225] Updated weights for policy 1, policy_version 569074 (0.0006) [2023-12-27 23:19:06,750][106225] Updated weights for policy 1, policy_version 569084 (0.0006) [2023-12-27 23:19:06,812][106225] Updated weights for policy 1, policy_version 569094 (0.0005) [2023-12-27 23:19:06,873][106225] Updated weights for policy 1, policy_version 569104 (0.0010) [2023-12-27 23:19:07,318][106226] Updated weights for policy 0, policy_version 567220 (0.0008) [2023-12-27 23:19:07,377][106226] Updated weights for policy 0, policy_version 567230 (0.0008) [2023-12-27 23:19:07,435][106226] Updated weights for policy 0, policy_version 567240 (0.0007) [2023-12-27 23:19:07,537][106225] Updated weights for policy 1, policy_version 569114 (0.0010) [2023-12-27 23:19:07,602][106225] Updated weights for policy 1, policy_version 569124 (0.0010) [2023-12-27 23:19:07,662][106225] Updated weights for policy 1, policy_version 569134 (0.0010) [2023-12-27 23:19:08,165][106226] Updated weights for policy 0, policy_version 567250 (0.0008) [2023-12-27 23:19:08,233][106226] Updated weights for policy 0, policy_version 567260 (0.0009) [2023-12-27 23:19:08,292][106225] Updated weights for policy 1, policy_version 569144 (0.0006) [2023-12-27 23:19:08,302][106226] Updated weights for policy 0, policy_version 567270 (0.0009) [2023-12-27 23:19:08,367][106226] Updated weights for policy 0, policy_version 567280 (0.0007) [2023-12-27 23:19:08,372][106225] Updated weights for policy 1, policy_version 569154 (0.0007) [2023-12-27 23:19:08,436][106225] Updated weights for policy 1, policy_version 569164 (0.0008) [2023-12-27 23:19:09,024][106225] Updated weights for policy 1, policy_version 569174 (0.0009) [2023-12-27 23:19:09,076][106225] Updated weights for policy 1, policy_version 569184 (0.0008) [2023-12-27 23:19:09,136][106225] Updated weights for policy 1, policy_version 569194 (0.0007) [2023-12-27 23:19:09,138][106226] Updated weights for policy 0, policy_version 567290 (0.0006) [2023-12-27 23:19:09,195][106226] Updated weights for policy 0, policy_version 567300 (0.0008) [2023-12-27 23:19:09,280][106226] Updated weights for policy 0, policy_version 567310 (0.0008) [2023-12-27 23:19:09,880][106225] Updated weights for policy 1, policy_version 569204 (0.0007) [2023-12-27 23:19:09,948][106225] Updated weights for policy 1, policy_version 569214 (0.0008) [2023-12-27 23:19:10,013][106225] Updated weights for policy 1, policy_version 569224 (0.0006) [2023-12-27 23:19:10,016][106226] Updated weights for policy 0, policy_version 567320 (0.0008) [2023-12-27 23:19:10,074][106226] Updated weights for policy 0, policy_version 567330 (0.0008) [2023-12-27 23:19:10,137][106226] Updated weights for policy 0, policy_version 567340 (0.0008) [2023-12-27 23:19:10,655][106225] Updated weights for policy 1, policy_version 569234 (0.0007) [2023-12-27 23:19:10,719][106225] Updated weights for policy 1, policy_version 569244 (0.0006) [2023-12-27 23:19:10,792][106225] Updated weights for policy 1, policy_version 569254 (0.0007) [2023-12-27 23:19:10,861][106225] Updated weights for policy 1, policy_version 569264 (0.0006) [2023-12-27 23:19:10,885][106226] Updated weights for policy 0, policy_version 567350 (0.0009) [2023-12-27 23:19:10,940][106226] Updated weights for policy 0, policy_version 567360 (0.0006) [2023-12-27 23:19:10,998][106226] Updated weights for policy 0, policy_version 567370 (0.0005) [2023-12-27 23:19:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 291045376. Throughput: 0: 9834.5, 1: 10025.6. Samples: 291013068. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:11,175][105115] Avg episode reward: [(0, '-4.955'), (1, '-5.529')] [2023-12-27 23:19:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000569264_145760256.pth... [2023-12-27 23:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000567376_145285120.pth... [2023-12-27 23:19:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000568112_145465344.pth [2023-12-27 23:19:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000566224_144990208.pth [2023-12-27 23:19:11,515][106225] Updated weights for policy 1, policy_version 569274 (0.0009) [2023-12-27 23:19:11,573][106225] Updated weights for policy 1, policy_version 569284 (0.0009) [2023-12-27 23:19:11,632][106225] Updated weights for policy 1, policy_version 569294 (0.0009) [2023-12-27 23:19:11,734][106226] Updated weights for policy 0, policy_version 567380 (0.0008) [2023-12-27 23:19:11,797][106226] Updated weights for policy 0, policy_version 567390 (0.0008) [2023-12-27 23:19:11,862][106226] Updated weights for policy 0, policy_version 567400 (0.0009) [2023-12-27 23:19:12,371][106225] Updated weights for policy 1, policy_version 569304 (0.0008) [2023-12-27 23:19:12,427][106225] Updated weights for policy 1, policy_version 569314 (0.0009) [2023-12-27 23:19:12,485][106225] Updated weights for policy 1, policy_version 569324 (0.0009) [2023-12-27 23:19:12,621][106226] Updated weights for policy 0, policy_version 567410 (0.0009) [2023-12-27 23:19:12,684][106226] Updated weights for policy 0, policy_version 567420 (0.0008) [2023-12-27 23:19:12,745][106226] Updated weights for policy 0, policy_version 567430 (0.0008) [2023-12-27 23:19:12,804][106226] Updated weights for policy 0, policy_version 567440 (0.0008) [2023-12-27 23:19:13,165][106225] Updated weights for policy 1, policy_version 569334 (0.0007) [2023-12-27 23:19:13,229][106225] Updated weights for policy 1, policy_version 569344 (0.0008) [2023-12-27 23:19:13,280][106225] Updated weights for policy 1, policy_version 569354 (0.0007) [2023-12-27 23:19:13,531][106226] Updated weights for policy 0, policy_version 567450 (0.0007) [2023-12-27 23:19:13,592][106226] Updated weights for policy 0, policy_version 567460 (0.0011) [2023-12-27 23:19:13,655][106226] Updated weights for policy 0, policy_version 567470 (0.0010) [2023-12-27 23:19:14,057][106225] Updated weights for policy 1, policy_version 569364 (0.0007) [2023-12-27 23:19:14,104][106225] Updated weights for policy 1, policy_version 569374 (0.0008) [2023-12-27 23:19:14,151][106225] Updated weights for policy 1, policy_version 569384 (0.0008) [2023-12-27 23:19:14,250][106226] Updated weights for policy 0, policy_version 567480 (0.0010) [2023-12-27 23:19:14,310][106226] Updated weights for policy 0, policy_version 567490 (0.0009) [2023-12-27 23:19:14,369][106226] Updated weights for policy 0, policy_version 567500 (0.0010) [2023-12-27 23:19:14,871][106225] Updated weights for policy 1, policy_version 569394 (0.0008) [2023-12-27 23:19:14,933][106225] Updated weights for policy 1, policy_version 569404 (0.0006) [2023-12-27 23:19:14,999][106225] Updated weights for policy 1, policy_version 569414 (0.0009) [2023-12-27 23:19:15,061][106225] Updated weights for policy 1, policy_version 569424 (0.0009) [2023-12-27 23:19:15,087][106226] Updated weights for policy 0, policy_version 567510 (0.0009) [2023-12-27 23:19:15,153][106226] Updated weights for policy 0, policy_version 567520 (0.0009) [2023-12-27 23:19:15,221][106226] Updated weights for policy 0, policy_version 567530 (0.0009) [2023-12-27 23:19:15,744][106225] Updated weights for policy 1, policy_version 569434 (0.0007) [2023-12-27 23:19:15,803][106225] Updated weights for policy 1, policy_version 569444 (0.0008) [2023-12-27 23:19:15,863][106225] Updated weights for policy 1, policy_version 569454 (0.0008) [2023-12-27 23:19:15,914][106226] Updated weights for policy 0, policy_version 567540 (0.0007) [2023-12-27 23:19:15,968][106226] Updated weights for policy 0, policy_version 567550 (0.0007) [2023-12-27 23:19:16,019][106226] Updated weights for policy 0, policy_version 567560 (0.0008) [2023-12-27 23:19:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 291143680. Throughput: 0: 9752.3, 1: 9904.1. Samples: 291129108. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:16,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.528')] [2023-12-27 23:19:16,618][106225] Updated weights for policy 1, policy_version 569464 (0.0010) [2023-12-27 23:19:16,673][106226] Updated weights for policy 0, policy_version 567571 (0.0007) [2023-12-27 23:19:16,679][106225] Updated weights for policy 1, policy_version 569474 (0.0007) [2023-12-27 23:19:16,737][106225] Updated weights for policy 1, policy_version 569484 (0.0006) [2023-12-27 23:19:16,738][106226] Updated weights for policy 0, policy_version 567581 (0.0008) [2023-12-27 23:19:16,805][106226] Updated weights for policy 0, policy_version 567591 (0.0008) [2023-12-27 23:19:17,346][106226] Updated weights for policy 0, policy_version 567601 (0.0006) [2023-12-27 23:19:17,397][106226] Updated weights for policy 0, policy_version 567611 (0.0005) [2023-12-27 23:19:17,452][106226] Updated weights for policy 0, policy_version 567621 (0.0005) [2023-12-27 23:19:17,507][106226] Updated weights for policy 0, policy_version 567631 (0.0005) [2023-12-27 23:19:17,542][106225] Updated weights for policy 1, policy_version 569494 (0.0008) [2023-12-27 23:19:17,591][106225] Updated weights for policy 1, policy_version 569504 (0.0008) [2023-12-27 23:19:17,642][106225] Updated weights for policy 1, policy_version 569514 (0.0009) [2023-12-27 23:19:18,029][106226] Updated weights for policy 0, policy_version 567641 (0.0007) [2023-12-27 23:19:18,086][106226] Updated weights for policy 0, policy_version 567651 (0.0008) [2023-12-27 23:19:18,150][106226] Updated weights for policy 0, policy_version 567661 (0.0006) [2023-12-27 23:19:18,409][106225] Updated weights for policy 1, policy_version 569524 (0.0009) [2023-12-27 23:19:18,473][106225] Updated weights for policy 1, policy_version 569534 (0.0009) [2023-12-27 23:19:18,545][106225] Updated weights for policy 1, policy_version 569544 (0.0009) [2023-12-27 23:19:18,810][106226] Updated weights for policy 0, policy_version 567671 (0.0008) [2023-12-27 23:19:18,876][106226] Updated weights for policy 0, policy_version 567681 (0.0007) [2023-12-27 23:19:18,928][106226] Updated weights for policy 0, policy_version 567691 (0.0007) [2023-12-27 23:19:19,305][106225] Updated weights for policy 1, policy_version 569554 (0.0009) [2023-12-27 23:19:19,381][106225] Updated weights for policy 1, policy_version 569564 (0.0011) [2023-12-27 23:19:19,444][106225] Updated weights for policy 1, policy_version 569574 (0.0011) [2023-12-27 23:19:19,512][106225] Updated weights for policy 1, policy_version 569584 (0.0011) [2023-12-27 23:19:19,621][106226] Updated weights for policy 0, policy_version 567701 (0.0008) [2023-12-27 23:19:19,687][106226] Updated weights for policy 0, policy_version 567711 (0.0007) [2023-12-27 23:19:19,749][106226] Updated weights for policy 0, policy_version 567721 (0.0006) [2023-12-27 23:19:20,180][106225] Updated weights for policy 1, policy_version 569594 (0.0008) [2023-12-27 23:19:20,236][106225] Updated weights for policy 1, policy_version 569604 (0.0005) [2023-12-27 23:19:20,297][106225] Updated weights for policy 1, policy_version 569614 (0.0005) [2023-12-27 23:19:20,447][106226] Updated weights for policy 0, policy_version 567731 (0.0007) [2023-12-27 23:19:20,515][106226] Updated weights for policy 0, policy_version 567741 (0.0009) [2023-12-27 23:19:20,586][106226] Updated weights for policy 0, policy_version 567751 (0.0009) [2023-12-27 23:19:20,991][106225] Updated weights for policy 1, policy_version 569624 (0.0008) [2023-12-27 23:19:21,060][106225] Updated weights for policy 1, policy_version 569634 (0.0008) [2023-12-27 23:19:21,130][106225] Updated weights for policy 1, policy_version 569644 (0.0011) [2023-12-27 23:19:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 291241984. Throughput: 0: 9850.3, 1: 9803.7. Samples: 291249336. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:21,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.529')] [2023-12-27 23:19:21,322][106226] Updated weights for policy 0, policy_version 567761 (0.0008) [2023-12-27 23:19:21,390][106226] Updated weights for policy 0, policy_version 567771 (0.0009) [2023-12-27 23:19:21,457][106226] Updated weights for policy 0, policy_version 567781 (0.0010) [2023-12-27 23:19:21,512][106226] Updated weights for policy 0, policy_version 567791 (0.0008) [2023-12-27 23:19:21,894][106225] Updated weights for policy 1, policy_version 569654 (0.0010) [2023-12-27 23:19:21,959][106225] Updated weights for policy 1, policy_version 569664 (0.0011) [2023-12-27 23:19:22,020][106225] Updated weights for policy 1, policy_version 569674 (0.0010) [2023-12-27 23:19:22,284][106226] Updated weights for policy 0, policy_version 567801 (0.0008) [2023-12-27 23:19:22,348][106226] Updated weights for policy 0, policy_version 567811 (0.0008) [2023-12-27 23:19:22,419][106226] Updated weights for policy 0, policy_version 567821 (0.0008) [2023-12-27 23:19:22,727][106225] Updated weights for policy 1, policy_version 569684 (0.0010) [2023-12-27 23:19:22,782][106225] Updated weights for policy 1, policy_version 569694 (0.0010) [2023-12-27 23:19:22,840][106225] Updated weights for policy 1, policy_version 569704 (0.0011) [2023-12-27 23:19:23,124][106226] Updated weights for policy 0, policy_version 567831 (0.0006) [2023-12-27 23:19:23,190][106226] Updated weights for policy 0, policy_version 567841 (0.0009) [2023-12-27 23:19:23,256][106226] Updated weights for policy 0, policy_version 567851 (0.0011) [2023-12-27 23:19:23,522][106225] Updated weights for policy 1, policy_version 569714 (0.0009) [2023-12-27 23:19:23,581][106225] Updated weights for policy 1, policy_version 569724 (0.0005) [2023-12-27 23:19:23,635][106225] Updated weights for policy 1, policy_version 569734 (0.0007) [2023-12-27 23:19:23,684][106225] Updated weights for policy 1, policy_version 569744 (0.0008) [2023-12-27 23:19:23,920][106226] Updated weights for policy 0, policy_version 567861 (0.0010) [2023-12-27 23:19:23,974][106226] Updated weights for policy 0, policy_version 567871 (0.0010) [2023-12-27 23:19:24,024][106226] Updated weights for policy 0, policy_version 567881 (0.0010) [2023-12-27 23:19:24,261][106225] Updated weights for policy 1, policy_version 569754 (0.0006) [2023-12-27 23:19:24,321][106225] Updated weights for policy 1, policy_version 569764 (0.0007) [2023-12-27 23:19:24,373][106225] Updated weights for policy 1, policy_version 569774 (0.0008) [2023-12-27 23:19:24,754][106226] Updated weights for policy 0, policy_version 567891 (0.0010) [2023-12-27 23:19:24,798][106226] Updated weights for policy 0, policy_version 567901 (0.0008) [2023-12-27 23:19:24,845][106226] Updated weights for policy 0, policy_version 567911 (0.0009) [2023-12-27 23:19:25,077][106225] Updated weights for policy 1, policy_version 569784 (0.0008) [2023-12-27 23:19:25,133][106225] Updated weights for policy 1, policy_version 569794 (0.0008) [2023-12-27 23:19:25,195][106225] Updated weights for policy 1, policy_version 569804 (0.0006) [2023-12-27 23:19:25,542][106226] Updated weights for policy 0, policy_version 567921 (0.0005) [2023-12-27 23:19:25,610][106226] Updated weights for policy 0, policy_version 567931 (0.0005) [2023-12-27 23:19:25,660][106226] Updated weights for policy 0, policy_version 567941 (0.0005) [2023-12-27 23:19:25,714][106226] Updated weights for policy 0, policy_version 567951 (0.0009) [2023-12-27 23:19:25,752][106225] Updated weights for policy 1, policy_version 569814 (0.0005) [2023-12-27 23:19:25,798][106225] Updated weights for policy 1, policy_version 569824 (0.0005) [2023-12-27 23:19:25,852][106225] Updated weights for policy 1, policy_version 569834 (0.0008) [2023-12-27 23:19:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 291340288. Throughput: 0: 9796.2, 1: 9774.9. Samples: 291306204. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:26,176][105115] Avg episode reward: [(0, '-4.933'), (1, '-5.712')] [2023-12-27 23:19:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000567952_145432576.pth... [2023-12-27 23:19:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000569840_145907712.pth... [2023-12-27 23:19:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000566800_145137664.pth [2023-12-27 23:19:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000568688_145612800.pth [2023-12-27 23:19:26,396][106226] Updated weights for policy 0, policy_version 567961 (0.0009) [2023-12-27 23:19:26,452][106226] Updated weights for policy 0, policy_version 567971 (0.0008) [2023-12-27 23:19:26,512][106226] Updated weights for policy 0, policy_version 567981 (0.0009) [2023-12-27 23:19:26,527][106225] Updated weights for policy 1, policy_version 569844 (0.0007) [2023-12-27 23:19:26,593][106225] Updated weights for policy 1, policy_version 569854 (0.0008) [2023-12-27 23:19:26,651][106225] Updated weights for policy 1, policy_version 569864 (0.0008) [2023-12-27 23:19:27,254][106226] Updated weights for policy 0, policy_version 567991 (0.0008) [2023-12-27 23:19:27,290][106225] Updated weights for policy 1, policy_version 569874 (0.0009) [2023-12-27 23:19:27,314][106226] Updated weights for policy 0, policy_version 568001 (0.0009) [2023-12-27 23:19:27,346][106225] Updated weights for policy 1, policy_version 569884 (0.0009) [2023-12-27 23:19:27,375][106226] Updated weights for policy 0, policy_version 568011 (0.0009) [2023-12-27 23:19:27,402][106225] Updated weights for policy 1, policy_version 569894 (0.0010) [2023-12-27 23:19:27,459][106225] Updated weights for policy 1, policy_version 569904 (0.0010) [2023-12-27 23:19:28,088][106225] Updated weights for policy 1, policy_version 569914 (0.0009) [2023-12-27 23:19:28,117][106226] Updated weights for policy 0, policy_version 568021 (0.0008) [2023-12-27 23:19:28,140][106225] Updated weights for policy 1, policy_version 569924 (0.0006) [2023-12-27 23:19:28,172][106226] Updated weights for policy 0, policy_version 568031 (0.0006) [2023-12-27 23:19:28,185][106225] Updated weights for policy 1, policy_version 569934 (0.0010) [2023-12-27 23:19:28,223][106226] Updated weights for policy 0, policy_version 568041 (0.0007) [2023-12-27 23:19:28,864][106225] Updated weights for policy 1, policy_version 569944 (0.0009) [2023-12-27 23:19:28,926][106225] Updated weights for policy 1, policy_version 569954 (0.0010) [2023-12-27 23:19:28,985][106225] Updated weights for policy 1, policy_version 569964 (0.0010) [2023-12-27 23:19:29,018][106226] Updated weights for policy 0, policy_version 568051 (0.0007) [2023-12-27 23:19:29,074][106226] Updated weights for policy 0, policy_version 568061 (0.0007) [2023-12-27 23:19:29,132][106226] Updated weights for policy 0, policy_version 568071 (0.0007) [2023-12-27 23:19:29,692][106225] Updated weights for policy 1, policy_version 569974 (0.0010) [2023-12-27 23:19:29,753][106225] Updated weights for policy 1, policy_version 569984 (0.0010) [2023-12-27 23:19:29,798][106226] Updated weights for policy 0, policy_version 568081 (0.0006) [2023-12-27 23:19:29,816][106225] Updated weights for policy 1, policy_version 569994 (0.0010) [2023-12-27 23:19:29,869][106226] Updated weights for policy 0, policy_version 568091 (0.0008) [2023-12-27 23:19:29,939][106226] Updated weights for policy 0, policy_version 568101 (0.0008) [2023-12-27 23:19:30,001][106226] Updated weights for policy 0, policy_version 568111 (0.0010) [2023-12-27 23:19:30,585][106225] Updated weights for policy 1, policy_version 570004 (0.0009) [2023-12-27 23:19:30,641][106225] Updated weights for policy 1, policy_version 570014 (0.0010) [2023-12-27 23:19:30,666][106226] Updated weights for policy 0, policy_version 568121 (0.0006) [2023-12-27 23:19:30,698][106225] Updated weights for policy 1, policy_version 570024 (0.0008) [2023-12-27 23:19:30,720][106226] Updated weights for policy 0, policy_version 568131 (0.0005) [2023-12-27 23:19:30,775][106226] Updated weights for policy 0, policy_version 568141 (0.0005) [2023-12-27 23:19:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 291438592. Throughput: 0: 9802.2, 1: 9927.4. Samples: 291428768. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:31,175][105115] Avg episode reward: [(0, '-5.084'), (1, '-5.644')] [2023-12-27 23:19:31,456][106226] Updated weights for policy 0, policy_version 568151 (0.0008) [2023-12-27 23:19:31,467][106225] Updated weights for policy 1, policy_version 570034 (0.0008) [2023-12-27 23:19:31,515][106226] Updated weights for policy 0, policy_version 568161 (0.0008) [2023-12-27 23:19:31,525][106225] Updated weights for policy 1, policy_version 570044 (0.0006) [2023-12-27 23:19:31,574][106226] Updated weights for policy 0, policy_version 568171 (0.0006) [2023-12-27 23:19:31,584][106225] Updated weights for policy 1, policy_version 570054 (0.0006) [2023-12-27 23:19:31,652][106225] Updated weights for policy 1, policy_version 570064 (0.0008) [2023-12-27 23:19:32,196][106226] Updated weights for policy 0, policy_version 568181 (0.0006) [2023-12-27 23:19:32,254][106226] Updated weights for policy 0, policy_version 568191 (0.0007) [2023-12-27 23:19:32,320][106226] Updated weights for policy 0, policy_version 568201 (0.0006) [2023-12-27 23:19:32,452][106225] Updated weights for policy 1, policy_version 570074 (0.0007) [2023-12-27 23:19:32,516][106225] Updated weights for policy 1, policy_version 570084 (0.0007) [2023-12-27 23:19:32,580][106225] Updated weights for policy 1, policy_version 570094 (0.0008) [2023-12-27 23:19:33,002][106226] Updated weights for policy 0, policy_version 568211 (0.0009) [2023-12-27 23:19:33,052][106226] Updated weights for policy 0, policy_version 568221 (0.0008) [2023-12-27 23:19:33,111][106226] Updated weights for policy 0, policy_version 568231 (0.0006) [2023-12-27 23:19:33,217][106225] Updated weights for policy 1, policy_version 570104 (0.0008) [2023-12-27 23:19:33,271][106225] Updated weights for policy 1, policy_version 570114 (0.0006) [2023-12-27 23:19:33,321][106225] Updated weights for policy 1, policy_version 570124 (0.0005) [2023-12-27 23:19:33,814][106226] Updated weights for policy 0, policy_version 568241 (0.0008) [2023-12-27 23:19:33,842][106225] Updated weights for policy 1, policy_version 570134 (0.0007) [2023-12-27 23:19:33,870][106226] Updated weights for policy 0, policy_version 568251 (0.0006) [2023-12-27 23:19:33,888][106225] Updated weights for policy 1, policy_version 570144 (0.0007) [2023-12-27 23:19:33,930][106226] Updated weights for policy 0, policy_version 568261 (0.0009) [2023-12-27 23:19:33,944][106225] Updated weights for policy 1, policy_version 570154 (0.0007) [2023-12-27 23:19:33,984][106226] Updated weights for policy 0, policy_version 568271 (0.0006) [2023-12-27 23:19:34,650][106225] Updated weights for policy 1, policy_version 570164 (0.0007) [2023-12-27 23:19:34,704][106225] Updated weights for policy 1, policy_version 570174 (0.0007) [2023-12-27 23:19:34,725][106226] Updated weights for policy 0, policy_version 568281 (0.0007) [2023-12-27 23:19:34,762][106225] Updated weights for policy 1, policy_version 570184 (0.0008) [2023-12-27 23:19:34,792][106226] Updated weights for policy 0, policy_version 568291 (0.0008) [2023-12-27 23:19:34,851][106226] Updated weights for policy 0, policy_version 568301 (0.0008) [2023-12-27 23:19:35,457][106226] Updated weights for policy 0, policy_version 568311 (0.0009) [2023-12-27 23:19:35,490][106225] Updated weights for policy 1, policy_version 570194 (0.0006) [2023-12-27 23:19:35,512][106226] Updated weights for policy 0, policy_version 568321 (0.0007) [2023-12-27 23:19:35,542][106225] Updated weights for policy 1, policy_version 570204 (0.0007) [2023-12-27 23:19:35,560][106226] Updated weights for policy 0, policy_version 568331 (0.0006) [2023-12-27 23:19:35,589][106225] Updated weights for policy 1, policy_version 570214 (0.0008) [2023-12-27 23:19:35,640][106225] Updated weights for policy 1, policy_version 570224 (0.0006) [2023-12-27 23:19:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 291536896. Throughput: 0: 9823.0, 1: 9939.0. Samples: 291548472. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:36,175][105115] Avg episode reward: [(0, '-5.342'), (1, '-5.253')] [2023-12-27 23:19:36,253][106225] Updated weights for policy 1, policy_version 570234 (0.0009) [2023-12-27 23:19:36,311][106225] Updated weights for policy 1, policy_version 570244 (0.0010) [2023-12-27 23:19:36,337][106226] Updated weights for policy 0, policy_version 568341 (0.0008) [2023-12-27 23:19:36,373][106225] Updated weights for policy 1, policy_version 570254 (0.0010) [2023-12-27 23:19:36,391][106226] Updated weights for policy 0, policy_version 568351 (0.0006) [2023-12-27 23:19:36,454][106226] Updated weights for policy 0, policy_version 568361 (0.0008) [2023-12-27 23:19:37,112][106225] Updated weights for policy 1, policy_version 570264 (0.0010) [2023-12-27 23:19:37,141][106226] Updated weights for policy 0, policy_version 568371 (0.0007) [2023-12-27 23:19:37,171][106225] Updated weights for policy 1, policy_version 570274 (0.0009) [2023-12-27 23:19:37,204][106226] Updated weights for policy 0, policy_version 568381 (0.0007) [2023-12-27 23:19:37,228][106225] Updated weights for policy 1, policy_version 570284 (0.0008) [2023-12-27 23:19:37,269][106226] Updated weights for policy 0, policy_version 568391 (0.0006) [2023-12-27 23:19:37,954][106225] Updated weights for policy 1, policy_version 570294 (0.0010) [2023-12-27 23:19:37,980][106226] Updated weights for policy 0, policy_version 568401 (0.0008) [2023-12-27 23:19:38,001][106225] Updated weights for policy 1, policy_version 570304 (0.0010) [2023-12-27 23:19:38,041][106226] Updated weights for policy 0, policy_version 568411 (0.0005) [2023-12-27 23:19:38,058][106225] Updated weights for policy 1, policy_version 570314 (0.0010) [2023-12-27 23:19:38,102][106226] Updated weights for policy 0, policy_version 568421 (0.0009) [2023-12-27 23:19:38,162][106226] Updated weights for policy 0, policy_version 568431 (0.0010) [2023-12-27 23:19:38,833][106225] Updated weights for policy 1, policy_version 570324 (0.0010) [2023-12-27 23:19:38,889][106225] Updated weights for policy 1, policy_version 570334 (0.0010) [2023-12-27 23:19:38,897][106226] Updated weights for policy 0, policy_version 568441 (0.0009) [2023-12-27 23:19:38,940][106225] Updated weights for policy 1, policy_version 570344 (0.0010) [2023-12-27 23:19:38,951][106226] Updated weights for policy 0, policy_version 568451 (0.0008) [2023-12-27 23:19:39,006][106226] Updated weights for policy 0, policy_version 568461 (0.0007) [2023-12-27 23:19:39,671][106225] Updated weights for policy 1, policy_version 570354 (0.0010) [2023-12-27 23:19:39,738][106225] Updated weights for policy 1, policy_version 570364 (0.0008) [2023-12-27 23:19:39,766][106226] Updated weights for policy 0, policy_version 568471 (0.0010) [2023-12-27 23:19:39,800][106225] Updated weights for policy 1, policy_version 570374 (0.0009) [2023-12-27 23:19:39,823][106226] Updated weights for policy 0, policy_version 568481 (0.0006) [2023-12-27 23:19:39,867][106225] Updated weights for policy 1, policy_version 570384 (0.0008) [2023-12-27 23:19:39,888][106226] Updated weights for policy 0, policy_version 568491 (0.0007) [2023-12-27 23:19:40,635][106226] Updated weights for policy 0, policy_version 568501 (0.0007) [2023-12-27 23:19:40,653][106225] Updated weights for policy 1, policy_version 570394 (0.0009) [2023-12-27 23:19:40,687][106226] Updated weights for policy 0, policy_version 568511 (0.0008) [2023-12-27 23:19:40,705][106225] Updated weights for policy 1, policy_version 570404 (0.0007) [2023-12-27 23:19:40,741][106226] Updated weights for policy 0, policy_version 568521 (0.0009) [2023-12-27 23:19:40,767][106225] Updated weights for policy 1, policy_version 570414 (0.0006) [2023-12-27 23:19:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 291635200. Throughput: 0: 9848.9, 1: 9961.3. Samples: 291606932. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:41,175][105115] Avg episode reward: [(0, '-5.269'), (1, '-5.697')] [2023-12-27 23:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000568528_145580032.pth... [2023-12-27 23:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000570416_146055168.pth... [2023-12-27 23:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000567376_145285120.pth [2023-12-27 23:19:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000569264_145760256.pth [2023-12-27 23:19:41,512][106225] Updated weights for policy 1, policy_version 570424 (0.0008) [2023-12-27 23:19:41,543][106226] Updated weights for policy 0, policy_version 568531 (0.0010) [2023-12-27 23:19:41,561][106225] Updated weights for policy 1, policy_version 570434 (0.0009) [2023-12-27 23:19:41,608][106226] Updated weights for policy 0, policy_version 568541 (0.0009) [2023-12-27 23:19:41,610][106225] Updated weights for policy 1, policy_version 570444 (0.0009) [2023-12-27 23:19:41,679][106226] Updated weights for policy 0, policy_version 568551 (0.0011) [2023-12-27 23:19:42,429][106225] Updated weights for policy 1, policy_version 570454 (0.0008) [2023-12-27 23:19:42,452][106226] Updated weights for policy 0, policy_version 568561 (0.0010) [2023-12-27 23:19:42,480][106225] Updated weights for policy 1, policy_version 570464 (0.0007) [2023-12-27 23:19:42,517][106226] Updated weights for policy 0, policy_version 568571 (0.0010) [2023-12-27 23:19:42,541][106225] Updated weights for policy 1, policy_version 570474 (0.0007) [2023-12-27 23:19:42,587][106226] Updated weights for policy 0, policy_version 568581 (0.0009) [2023-12-27 23:19:42,654][106226] Updated weights for policy 0, policy_version 568591 (0.0011) [2023-12-27 23:19:43,275][106225] Updated weights for policy 1, policy_version 570484 (0.0008) [2023-12-27 23:19:43,308][106226] Updated weights for policy 0, policy_version 568601 (0.0010) [2023-12-27 23:19:43,332][106225] Updated weights for policy 1, policy_version 570494 (0.0006) [2023-12-27 23:19:43,365][106226] Updated weights for policy 0, policy_version 568611 (0.0008) [2023-12-27 23:19:43,390][106225] Updated weights for policy 1, policy_version 570504 (0.0006) [2023-12-27 23:19:43,424][106226] Updated weights for policy 0, policy_version 568621 (0.0010) [2023-12-27 23:19:44,083][106226] Updated weights for policy 0, policy_version 568631 (0.0011) [2023-12-27 23:19:44,132][106225] Updated weights for policy 1, policy_version 570514 (0.0007) [2023-12-27 23:19:44,142][106226] Updated weights for policy 0, policy_version 568641 (0.0009) [2023-12-27 23:19:44,195][106225] Updated weights for policy 1, policy_version 570524 (0.0006) [2023-12-27 23:19:44,197][106226] Updated weights for policy 0, policy_version 568651 (0.0011) [2023-12-27 23:19:44,258][106225] Updated weights for policy 1, policy_version 570534 (0.0007) [2023-12-27 23:19:44,321][106225] Updated weights for policy 1, policy_version 570544 (0.0006) [2023-12-27 23:19:44,911][106226] Updated weights for policy 0, policy_version 568661 (0.0011) [2023-12-27 23:19:44,976][106226] Updated weights for policy 0, policy_version 568671 (0.0011) [2023-12-27 23:19:45,021][106225] Updated weights for policy 1, policy_version 570554 (0.0009) [2023-12-27 23:19:45,045][106226] Updated weights for policy 0, policy_version 568681 (0.0011) [2023-12-27 23:19:45,079][106225] Updated weights for policy 1, policy_version 570564 (0.0006) [2023-12-27 23:19:45,133][106225] Updated weights for policy 1, policy_version 570574 (0.0007) [2023-12-27 23:19:45,754][106225] Updated weights for policy 1, policy_version 570584 (0.0008) [2023-12-27 23:19:45,790][106226] Updated weights for policy 0, policy_version 568691 (0.0010) [2023-12-27 23:19:45,800][106225] Updated weights for policy 1, policy_version 570594 (0.0007) [2023-12-27 23:19:45,853][106226] Updated weights for policy 0, policy_version 568701 (0.0007) [2023-12-27 23:19:45,856][106225] Updated weights for policy 1, policy_version 570604 (0.0006) [2023-12-27 23:19:45,921][106226] Updated weights for policy 0, policy_version 568711 (0.0006) [2023-12-27 23:19:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 291733504. Throughput: 0: 9817.4, 1: 9889.2. Samples: 291719620. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:46,175][105115] Avg episode reward: [(0, '-5.179'), (1, '-5.463')] [2023-12-27 23:19:46,604][106225] Updated weights for policy 1, policy_version 570614 (0.0008) [2023-12-27 23:19:46,630][106226] Updated weights for policy 0, policy_version 568721 (0.0007) [2023-12-27 23:19:46,653][106225] Updated weights for policy 1, policy_version 570624 (0.0007) [2023-12-27 23:19:46,690][106226] Updated weights for policy 0, policy_version 568731 (0.0008) [2023-12-27 23:19:46,706][106225] Updated weights for policy 1, policy_version 570634 (0.0006) [2023-12-27 23:19:46,746][106226] Updated weights for policy 0, policy_version 568741 (0.0007) [2023-12-27 23:19:46,814][106226] Updated weights for policy 0, policy_version 568751 (0.0009) [2023-12-27 23:19:47,397][106225] Updated weights for policy 1, policy_version 570644 (0.0007) [2023-12-27 23:19:47,457][106225] Updated weights for policy 1, policy_version 570654 (0.0005) [2023-12-27 23:19:47,491][106226] Updated weights for policy 0, policy_version 568761 (0.0009) [2023-12-27 23:19:47,508][106225] Updated weights for policy 1, policy_version 570664 (0.0005) [2023-12-27 23:19:47,540][106226] Updated weights for policy 0, policy_version 568771 (0.0007) [2023-12-27 23:19:47,601][106226] Updated weights for policy 0, policy_version 568781 (0.0009) [2023-12-27 23:19:48,084][106225] Updated weights for policy 1, policy_version 570674 (0.0005) [2023-12-27 23:19:48,140][106225] Updated weights for policy 1, policy_version 570684 (0.0008) [2023-12-27 23:19:48,201][106225] Updated weights for policy 1, policy_version 570694 (0.0008) [2023-12-27 23:19:48,248][106225] Updated weights for policy 1, policy_version 570704 (0.0006) [2023-12-27 23:19:48,386][106226] Updated weights for policy 0, policy_version 568791 (0.0009) [2023-12-27 23:19:48,450][106226] Updated weights for policy 0, policy_version 568801 (0.0008) [2023-12-27 23:19:48,510][106226] Updated weights for policy 0, policy_version 568811 (0.0009) [2023-12-27 23:19:49,002][106225] Updated weights for policy 1, policy_version 570714 (0.0006) [2023-12-27 23:19:49,060][106225] Updated weights for policy 1, policy_version 570724 (0.0008) [2023-12-27 23:19:49,110][106225] Updated weights for policy 1, policy_version 570734 (0.0008) [2023-12-27 23:19:49,154][106226] Updated weights for policy 0, policy_version 568821 (0.0007) [2023-12-27 23:19:49,209][106226] Updated weights for policy 0, policy_version 568831 (0.0008) [2023-12-27 23:19:49,273][106226] Updated weights for policy 0, policy_version 568841 (0.0006) [2023-12-27 23:19:49,896][106225] Updated weights for policy 1, policy_version 570744 (0.0010) [2023-12-27 23:19:49,959][106225] Updated weights for policy 1, policy_version 570754 (0.0009) [2023-12-27 23:19:50,024][106225] Updated weights for policy 1, policy_version 570764 (0.0011) [2023-12-27 23:19:50,047][106226] Updated weights for policy 0, policy_version 568851 (0.0006) [2023-12-27 23:19:50,111][106226] Updated weights for policy 0, policy_version 568861 (0.0007) [2023-12-27 23:19:50,162][106226] Updated weights for policy 0, policy_version 568871 (0.0007) [2023-12-27 23:19:50,751][106225] Updated weights for policy 1, policy_version 570774 (0.0009) [2023-12-27 23:19:50,818][106225] Updated weights for policy 1, policy_version 570784 (0.0010) [2023-12-27 23:19:50,873][106225] Updated weights for policy 1, policy_version 570794 (0.0010) [2023-12-27 23:19:50,896][106226] Updated weights for policy 0, policy_version 568881 (0.0008) [2023-12-27 23:19:50,962][106226] Updated weights for policy 0, policy_version 568891 (0.0007) [2023-12-27 23:19:51,036][106226] Updated weights for policy 0, policy_version 568901 (0.0009) [2023-12-27 23:19:51,102][106226] Updated weights for policy 0, policy_version 568911 (0.0008) [2023-12-27 23:19:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 291831808. Throughput: 0: 9753.4, 1: 9867.8. Samples: 291837112. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:51,175][105115] Avg episode reward: [(0, '-5.186'), (1, '-5.991')] [2023-12-27 23:19:51,598][106225] Updated weights for policy 1, policy_version 570804 (0.0009) [2023-12-27 23:19:51,667][106225] Updated weights for policy 1, policy_version 570814 (0.0011) [2023-12-27 23:19:51,734][106225] Updated weights for policy 1, policy_version 570824 (0.0011) [2023-12-27 23:19:51,815][106226] Updated weights for policy 0, policy_version 568921 (0.0008) [2023-12-27 23:19:51,877][106226] Updated weights for policy 0, policy_version 568931 (0.0008) [2023-12-27 23:19:51,935][106226] Updated weights for policy 0, policy_version 568941 (0.0008) [2023-12-27 23:19:52,500][106225] Updated weights for policy 1, policy_version 570834 (0.0010) [2023-12-27 23:19:52,553][106225] Updated weights for policy 1, policy_version 570844 (0.0009) [2023-12-27 23:19:52,613][106225] Updated weights for policy 1, policy_version 570854 (0.0009) [2023-12-27 23:19:52,677][106225] Updated weights for policy 1, policy_version 570864 (0.0007) [2023-12-27 23:19:52,679][106226] Updated weights for policy 0, policy_version 568951 (0.0007) [2023-12-27 23:19:52,735][106226] Updated weights for policy 0, policy_version 568961 (0.0008) [2023-12-27 23:19:52,784][106226] Updated weights for policy 0, policy_version 568971 (0.0009) [2023-12-27 23:19:53,334][106225] Updated weights for policy 1, policy_version 570874 (0.0008) [2023-12-27 23:19:53,389][106225] Updated weights for policy 1, policy_version 570884 (0.0008) [2023-12-27 23:19:53,445][106225] Updated weights for policy 1, policy_version 570894 (0.0009) [2023-12-27 23:19:53,530][106226] Updated weights for policy 0, policy_version 568981 (0.0008) [2023-12-27 23:19:53,581][106226] Updated weights for policy 0, policy_version 568991 (0.0009) [2023-12-27 23:19:53,628][106226] Updated weights for policy 0, policy_version 569001 (0.0005) [2023-12-27 23:19:54,081][106225] Updated weights for policy 1, policy_version 570904 (0.0008) [2023-12-27 23:19:54,135][106225] Updated weights for policy 1, policy_version 570914 (0.0009) [2023-12-27 23:19:54,191][106225] Updated weights for policy 1, policy_version 570924 (0.0008) [2023-12-27 23:19:54,357][106226] Updated weights for policy 0, policy_version 569011 (0.0006) [2023-12-27 23:19:54,412][106226] Updated weights for policy 0, policy_version 569021 (0.0005) [2023-12-27 23:19:54,457][106226] Updated weights for policy 0, policy_version 569031 (0.0005) [2023-12-27 23:19:54,934][106225] Updated weights for policy 1, policy_version 570934 (0.0007) [2023-12-27 23:19:54,987][106225] Updated weights for policy 1, policy_version 570944 (0.0008) [2023-12-27 23:19:55,042][106225] Updated weights for policy 1, policy_version 570954 (0.0009) [2023-12-27 23:19:55,110][106226] Updated weights for policy 0, policy_version 569041 (0.0008) [2023-12-27 23:19:55,170][106226] Updated weights for policy 0, policy_version 569051 (0.0006) [2023-12-27 23:19:55,236][106226] Updated weights for policy 0, policy_version 569061 (0.0008) [2023-12-27 23:19:55,297][106226] Updated weights for policy 0, policy_version 569071 (0.0009) [2023-12-27 23:19:55,713][106225] Updated weights for policy 1, policy_version 570964 (0.0007) [2023-12-27 23:19:55,765][106225] Updated weights for policy 1, policy_version 570974 (0.0005) [2023-12-27 23:19:55,826][106225] Updated weights for policy 1, policy_version 570984 (0.0005) [2023-12-27 23:19:56,026][106226] Updated weights for policy 0, policy_version 569081 (0.0010) [2023-12-27 23:19:56,094][106226] Updated weights for policy 0, policy_version 569091 (0.0011) [2023-12-27 23:19:56,163][106226] Updated weights for policy 0, policy_version 569101 (0.0011) [2023-12-27 23:19:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 291921920. Throughput: 0: 9760.4, 1: 9822.1. Samples: 291894276. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:19:56,175][105115] Avg episode reward: [(0, '-5.232'), (1, '-5.508')] [2023-12-27 23:19:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000569104_145727488.pth... [2023-12-27 23:19:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000570992_146202624.pth... [2023-12-27 23:19:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000567952_145432576.pth [2023-12-27 23:19:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000569840_145907712.pth [2023-12-27 23:19:56,432][106225] Updated weights for policy 1, policy_version 570994 (0.0006) [2023-12-27 23:19:56,486][106225] Updated weights for policy 1, policy_version 571004 (0.0008) [2023-12-27 23:19:56,534][106225] Updated weights for policy 1, policy_version 571014 (0.0008) [2023-12-27 23:19:56,595][106225] Updated weights for policy 1, policy_version 571024 (0.0010) [2023-12-27 23:19:56,778][106226] Updated weights for policy 0, policy_version 569111 (0.0008) [2023-12-27 23:19:56,829][106226] Updated weights for policy 0, policy_version 569121 (0.0010) [2023-12-27 23:19:56,883][106226] Updated weights for policy 0, policy_version 569131 (0.0008) [2023-12-27 23:19:57,271][106225] Updated weights for policy 1, policy_version 571034 (0.0010) [2023-12-27 23:19:57,337][106225] Updated weights for policy 1, policy_version 571044 (0.0009) [2023-12-27 23:19:57,395][106225] Updated weights for policy 1, policy_version 571054 (0.0010) [2023-12-27 23:19:57,624][106226] Updated weights for policy 0, policy_version 569141 (0.0010) [2023-12-27 23:19:57,680][106226] Updated weights for policy 0, policy_version 569151 (0.0010) [2023-12-27 23:19:57,737][106226] Updated weights for policy 0, policy_version 569161 (0.0011) [2023-12-27 23:19:58,060][106225] Updated weights for policy 1, policy_version 571064 (0.0008) [2023-12-27 23:19:58,110][106225] Updated weights for policy 1, policy_version 571074 (0.0005) [2023-12-27 23:19:58,156][106225] Updated weights for policy 1, policy_version 571084 (0.0005) [2023-12-27 23:19:58,443][106226] Updated weights for policy 0, policy_version 569171 (0.0010) [2023-12-27 23:19:58,507][106226] Updated weights for policy 0, policy_version 569181 (0.0008) [2023-12-27 23:19:58,570][106226] Updated weights for policy 0, policy_version 569191 (0.0008) [2023-12-27 23:19:58,939][106225] Updated weights for policy 1, policy_version 571094 (0.0008) [2023-12-27 23:19:59,001][106225] Updated weights for policy 1, policy_version 571104 (0.0009) [2023-12-27 23:19:59,064][106225] Updated weights for policy 1, policy_version 571114 (0.0007) [2023-12-27 23:19:59,394][106226] Updated weights for policy 0, policy_version 569201 (0.0008) [2023-12-27 23:19:59,442][106226] Updated weights for policy 0, policy_version 569211 (0.0005) [2023-12-27 23:19:59,504][106226] Updated weights for policy 0, policy_version 569221 (0.0006) [2023-12-27 23:19:59,556][106226] Updated weights for policy 0, policy_version 569231 (0.0007) [2023-12-27 23:19:59,887][106225] Updated weights for policy 1, policy_version 571124 (0.0008) [2023-12-27 23:19:59,950][106225] Updated weights for policy 1, policy_version 571134 (0.0010) [2023-12-27 23:20:00,015][106225] Updated weights for policy 1, policy_version 571144 (0.0007) [2023-12-27 23:20:00,245][106226] Updated weights for policy 0, policy_version 569241 (0.0008) [2023-12-27 23:20:00,309][106226] Updated weights for policy 0, policy_version 569251 (0.0008) [2023-12-27 23:20:00,369][106226] Updated weights for policy 0, policy_version 569261 (0.0008) [2023-12-27 23:20:00,712][106225] Updated weights for policy 1, policy_version 571154 (0.0010) [2023-12-27 23:20:00,769][106225] Updated weights for policy 1, policy_version 571164 (0.0005) [2023-12-27 23:20:00,814][106225] Updated weights for policy 1, policy_version 571174 (0.0005) [2023-12-27 23:20:00,860][106225] Updated weights for policy 1, policy_version 571184 (0.0005) [2023-12-27 23:20:01,104][106226] Updated weights for policy 0, policy_version 569271 (0.0008) [2023-12-27 23:20:01,171][106226] Updated weights for policy 0, policy_version 569281 (0.0008) [2023-12-27 23:20:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 292020224. Throughput: 0: 9819.5, 1: 9839.1. Samples: 292013744. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:20:01,175][105115] Avg episode reward: [(0, '-5.213'), (1, '-5.611')] [2023-12-27 23:20:01,239][106226] Updated weights for policy 0, policy_version 569291 (0.0006) [2023-12-27 23:20:01,575][106225] Updated weights for policy 1, policy_version 571194 (0.0010) [2023-12-27 23:20:01,639][106225] Updated weights for policy 1, policy_version 571204 (0.0010) [2023-12-27 23:20:01,698][106225] Updated weights for policy 1, policy_version 571214 (0.0010) [2023-12-27 23:20:01,968][106226] Updated weights for policy 0, policy_version 569301 (0.0009) [2023-12-27 23:20:02,026][106226] Updated weights for policy 0, policy_version 569311 (0.0008) [2023-12-27 23:20:02,078][106226] Updated weights for policy 0, policy_version 569321 (0.0005) [2023-12-27 23:20:02,400][106225] Updated weights for policy 1, policy_version 571224 (0.0010) [2023-12-27 23:20:02,467][106225] Updated weights for policy 1, policy_version 571234 (0.0010) [2023-12-27 23:20:02,524][106225] Updated weights for policy 1, policy_version 571244 (0.0010) [2023-12-27 23:20:02,674][106226] Updated weights for policy 0, policy_version 569331 (0.0005) [2023-12-27 23:20:02,739][106226] Updated weights for policy 0, policy_version 569341 (0.0006) [2023-12-27 23:20:02,802][106226] Updated weights for policy 0, policy_version 569351 (0.0008) [2023-12-27 23:20:03,188][106225] Updated weights for policy 1, policy_version 571254 (0.0010) [2023-12-27 23:20:03,254][106225] Updated weights for policy 1, policy_version 571264 (0.0010) [2023-12-27 23:20:03,309][106225] Updated weights for policy 1, policy_version 571274 (0.0010) [2023-12-27 23:20:03,497][106226] Updated weights for policy 0, policy_version 569361 (0.0010) [2023-12-27 23:20:03,560][106226] Updated weights for policy 0, policy_version 569371 (0.0009) [2023-12-27 23:20:03,622][106226] Updated weights for policy 0, policy_version 569381 (0.0010) [2023-12-27 23:20:03,668][106226] Updated weights for policy 0, policy_version 569391 (0.0010) [2023-12-27 23:20:03,938][106225] Updated weights for policy 1, policy_version 571284 (0.0010) [2023-12-27 23:20:04,009][106225] Updated weights for policy 1, policy_version 571294 (0.0006) [2023-12-27 23:20:04,076][106225] Updated weights for policy 1, policy_version 571304 (0.0007) [2023-12-27 23:20:04,329][106226] Updated weights for policy 0, policy_version 569401 (0.0011) [2023-12-27 23:20:04,391][106226] Updated weights for policy 0, policy_version 569411 (0.0011) [2023-12-27 23:20:04,448][106226] Updated weights for policy 0, policy_version 569421 (0.0010) [2023-12-27 23:20:04,736][106225] Updated weights for policy 1, policy_version 571314 (0.0010) [2023-12-27 23:20:04,786][106225] Updated weights for policy 1, policy_version 571324 (0.0010) [2023-12-27 23:20:04,839][106225] Updated weights for policy 1, policy_version 571334 (0.0010) [2023-12-27 23:20:04,898][106225] Updated weights for policy 1, policy_version 571344 (0.0010) [2023-12-27 23:20:05,131][106226] Updated weights for policy 0, policy_version 569431 (0.0011) [2023-12-27 23:20:05,184][106226] Updated weights for policy 0, policy_version 569441 (0.0010) [2023-12-27 23:20:05,238][106226] Updated weights for policy 0, policy_version 569451 (0.0010) [2023-12-27 23:20:05,545][106225] Updated weights for policy 1, policy_version 571354 (0.0010) [2023-12-27 23:20:05,605][106225] Updated weights for policy 1, policy_version 571364 (0.0010) [2023-12-27 23:20:05,656][106225] Updated weights for policy 1, policy_version 571374 (0.0010) [2023-12-27 23:20:05,849][106226] Updated weights for policy 0, policy_version 569461 (0.0008) [2023-12-27 23:20:05,905][106226] Updated weights for policy 0, policy_version 569471 (0.0005) [2023-12-27 23:20:05,964][106226] Updated weights for policy 0, policy_version 569481 (0.0006) [2023-12-27 23:20:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 292126720. Throughput: 0: 9768.3, 1: 9930.3. Samples: 292135772. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:20:06,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.256')] [2023-12-27 23:20:06,362][106225] Updated weights for policy 1, policy_version 571384 (0.0010) [2023-12-27 23:20:06,417][106225] Updated weights for policy 1, policy_version 571394 (0.0010) [2023-12-27 23:20:06,480][106225] Updated weights for policy 1, policy_version 571404 (0.0010) [2023-12-27 23:20:06,551][106226] Updated weights for policy 0, policy_version 569491 (0.0006) [2023-12-27 23:20:06,614][106226] Updated weights for policy 0, policy_version 569501 (0.0008) [2023-12-27 23:20:06,676][106226] Updated weights for policy 0, policy_version 569511 (0.0008) [2023-12-27 23:20:07,221][106225] Updated weights for policy 1, policy_version 571414 (0.0011) [2023-12-27 23:20:07,282][106225] Updated weights for policy 1, policy_version 571424 (0.0010) [2023-12-27 23:20:07,338][106225] Updated weights for policy 1, policy_version 571434 (0.0010) [2023-12-27 23:20:07,383][106226] Updated weights for policy 0, policy_version 569521 (0.0009) [2023-12-27 23:20:07,440][106226] Updated weights for policy 0, policy_version 569531 (0.0008) [2023-12-27 23:20:07,497][106226] Updated weights for policy 0, policy_version 569541 (0.0007) [2023-12-27 23:20:07,556][106226] Updated weights for policy 0, policy_version 569551 (0.0008) [2023-12-27 23:20:07,954][106225] Updated weights for policy 1, policy_version 571444 (0.0010) [2023-12-27 23:20:08,007][106225] Updated weights for policy 1, policy_version 571454 (0.0010) [2023-12-27 23:20:08,058][106225] Updated weights for policy 1, policy_version 571464 (0.0010) [2023-12-27 23:20:08,293][106226] Updated weights for policy 0, policy_version 569561 (0.0006) [2023-12-27 23:20:08,366][106226] Updated weights for policy 0, policy_version 569571 (0.0008) [2023-12-27 23:20:08,418][106226] Updated weights for policy 0, policy_version 569581 (0.0011) [2023-12-27 23:20:08,731][106225] Updated weights for policy 1, policy_version 571474 (0.0009) [2023-12-27 23:20:08,786][106225] Updated weights for policy 1, policy_version 571484 (0.0010) [2023-12-27 23:20:08,847][106225] Updated weights for policy 1, policy_version 571494 (0.0010) [2023-12-27 23:20:08,897][106225] Updated weights for policy 1, policy_version 571504 (0.0009) [2023-12-27 23:20:09,076][106226] Updated weights for policy 0, policy_version 569591 (0.0011) [2023-12-27 23:20:09,141][106226] Updated weights for policy 0, policy_version 569601 (0.0011) [2023-12-27 23:20:09,206][106226] Updated weights for policy 0, policy_version 569611 (0.0011) [2023-12-27 23:20:09,585][106225] Updated weights for policy 1, policy_version 571514 (0.0009) [2023-12-27 23:20:09,645][106225] Updated weights for policy 1, policy_version 571524 (0.0009) [2023-12-27 23:20:09,696][106225] Updated weights for policy 1, policy_version 571534 (0.0008) [2023-12-27 23:20:09,930][106226] Updated weights for policy 0, policy_version 569621 (0.0010) [2023-12-27 23:20:10,004][106226] Updated weights for policy 0, policy_version 569631 (0.0011) [2023-12-27 23:20:10,066][106226] Updated weights for policy 0, policy_version 569641 (0.0011) [2023-12-27 23:20:10,464][106225] Updated weights for policy 1, policy_version 571544 (0.0008) [2023-12-27 23:20:10,524][106225] Updated weights for policy 1, policy_version 571554 (0.0008) [2023-12-27 23:20:10,580][106225] Updated weights for policy 1, policy_version 571564 (0.0009) [2023-12-27 23:20:10,758][106226] Updated weights for policy 0, policy_version 569651 (0.0010) [2023-12-27 23:20:10,818][106226] Updated weights for policy 0, policy_version 569661 (0.0009) [2023-12-27 23:20:10,884][106226] Updated weights for policy 0, policy_version 569671 (0.0010) [2023-12-27 23:20:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 292225024. Throughput: 0: 9814.1, 1: 9979.2. Samples: 292196896. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-27 23:20:11,175][105115] Avg episode reward: [(0, '-5.055'), (1, '-5.450')] [2023-12-27 23:20:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000569680_145874944.pth... [2023-12-27 23:20:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000571568_146350080.pth... [2023-12-27 23:20:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000568528_145580032.pth [2023-12-27 23:20:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000570416_146055168.pth [2023-12-27 23:20:11,289][106225] Updated weights for policy 1, policy_version 571574 (0.0009) [2023-12-27 23:20:11,341][106225] Updated weights for policy 1, policy_version 571584 (0.0010) [2023-12-27 23:20:11,412][106225] Updated weights for policy 1, policy_version 571594 (0.0012) [2023-12-27 23:20:11,637][106226] Updated weights for policy 0, policy_version 569681 (0.0010) [2023-12-27 23:20:11,695][106226] Updated weights for policy 0, policy_version 569691 (0.0009) [2023-12-27 23:20:11,762][106226] Updated weights for policy 0, policy_version 569701 (0.0009) [2023-12-27 23:20:11,816][106226] Updated weights for policy 0, policy_version 569711 (0.0009) [2023-12-27 23:20:12,254][106225] Updated weights for policy 1, policy_version 571604 (0.0010) [2023-12-27 23:20:12,321][106225] Updated weights for policy 1, policy_version 571614 (0.0011) [2023-12-27 23:20:12,386][106225] Updated weights for policy 1, policy_version 571624 (0.0010) [2023-12-27 23:20:12,587][106226] Updated weights for policy 0, policy_version 569721 (0.0011) [2023-12-27 23:20:12,645][106226] Updated weights for policy 0, policy_version 569731 (0.0010) [2023-12-27 23:20:12,710][106226] Updated weights for policy 0, policy_version 569741 (0.0011) [2023-12-27 23:20:13,044][106225] Updated weights for policy 1, policy_version 571634 (0.0010) [2023-12-27 23:20:13,087][106225] Updated weights for policy 1, policy_version 571644 (0.0010) [2023-12-27 23:20:13,144][106225] Updated weights for policy 1, policy_version 571654 (0.0008) [2023-12-27 23:20:13,202][106225] Updated weights for policy 1, policy_version 571664 (0.0008) [2023-12-27 23:20:13,385][106226] Updated weights for policy 0, policy_version 569751 (0.0010) [2023-12-27 23:20:13,431][106226] Updated weights for policy 0, policy_version 569761 (0.0008) [2023-12-27 23:20:13,478][106226] Updated weights for policy 0, policy_version 569771 (0.0005) [2023-12-27 23:20:14,015][106225] Updated weights for policy 1, policy_version 571674 (0.0008) [2023-12-27 23:20:14,046][106226] Updated weights for policy 0, policy_version 569781 (0.0006) [2023-12-27 23:20:14,072][106225] Updated weights for policy 1, policy_version 571684 (0.0008) [2023-12-27 23:20:14,103][106226] Updated weights for policy 0, policy_version 569791 (0.0008) [2023-12-27 23:20:14,129][106225] Updated weights for policy 1, policy_version 571694 (0.0008) [2023-12-27 23:20:14,156][106226] Updated weights for policy 0, policy_version 569801 (0.0010) [2023-12-27 23:20:14,881][106225] Updated weights for policy 1, policy_version 571704 (0.0010) [2023-12-27 23:20:14,894][106226] Updated weights for policy 0, policy_version 569811 (0.0009) [2023-12-27 23:20:14,944][106225] Updated weights for policy 1, policy_version 571714 (0.0010) [2023-12-27 23:20:14,957][106226] Updated weights for policy 0, policy_version 569821 (0.0009) [2023-12-27 23:20:15,015][106225] Updated weights for policy 1, policy_version 571724 (0.0011) [2023-12-27 23:20:15,027][106226] Updated weights for policy 0, policy_version 569831 (0.0011) [2023-12-27 23:20:15,727][106226] Updated weights for policy 0, policy_version 569841 (0.0010) [2023-12-27 23:20:15,733][106225] Updated weights for policy 1, policy_version 571734 (0.0010) [2023-12-27 23:20:15,780][106225] Updated weights for policy 1, policy_version 571744 (0.0010) [2023-12-27 23:20:15,791][106226] Updated weights for policy 0, policy_version 569851 (0.0005) [2023-12-27 23:20:15,823][106225] Updated weights for policy 1, policy_version 571754 (0.0008) [2023-12-27 23:20:15,849][106226] Updated weights for policy 0, policy_version 569861 (0.0005) [2023-12-27 23:20:15,914][106226] Updated weights for policy 0, policy_version 569871 (0.0008) [2023-12-27 23:20:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 292323328. Throughput: 0: 9816.0, 1: 9808.4. Samples: 292311868. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:16,176][105115] Avg episode reward: [(0, '-5.150'), (1, '-5.531')] [2023-12-27 23:20:16,547][106226] Updated weights for policy 0, policy_version 569881 (0.0009) [2023-12-27 23:20:16,565][106225] Updated weights for policy 1, policy_version 571764 (0.0010) [2023-12-27 23:20:16,595][106226] Updated weights for policy 0, policy_version 569891 (0.0005) [2023-12-27 23:20:16,608][106225] Updated weights for policy 1, policy_version 571774 (0.0010) [2023-12-27 23:20:16,655][106226] Updated weights for policy 0, policy_version 569901 (0.0007) [2023-12-27 23:20:16,682][106225] Updated weights for policy 1, policy_version 571784 (0.0009) [2023-12-27 23:20:17,330][106225] Updated weights for policy 1, policy_version 571794 (0.0008) [2023-12-27 23:20:17,391][106225] Updated weights for policy 1, policy_version 571804 (0.0005) [2023-12-27 23:20:17,443][106225] Updated weights for policy 1, policy_version 571814 (0.0005) [2023-12-27 23:20:17,464][106226] Updated weights for policy 0, policy_version 569911 (0.0009) [2023-12-27 23:20:17,498][106225] Updated weights for policy 1, policy_version 571824 (0.0006) [2023-12-27 23:20:17,518][106226] Updated weights for policy 0, policy_version 569921 (0.0007) [2023-12-27 23:20:17,569][106226] Updated weights for policy 0, policy_version 569931 (0.0008) [2023-12-27 23:20:18,108][106225] Updated weights for policy 1, policy_version 571834 (0.0008) [2023-12-27 23:20:18,166][106225] Updated weights for policy 1, policy_version 571844 (0.0008) [2023-12-27 23:20:18,223][106225] Updated weights for policy 1, policy_version 571854 (0.0008) [2023-12-27 23:20:18,323][106226] Updated weights for policy 0, policy_version 569941 (0.0008) [2023-12-27 23:20:18,393][106226] Updated weights for policy 0, policy_version 569951 (0.0009) [2023-12-27 23:20:18,446][106226] Updated weights for policy 0, policy_version 569961 (0.0008) [2023-12-27 23:20:18,951][106225] Updated weights for policy 1, policy_version 571864 (0.0009) [2023-12-27 23:20:19,013][106225] Updated weights for policy 1, policy_version 571874 (0.0008) [2023-12-27 23:20:19,061][106225] Updated weights for policy 1, policy_version 571884 (0.0008) [2023-12-27 23:20:19,196][106226] Updated weights for policy 0, policy_version 569971 (0.0009) [2023-12-27 23:20:19,258][106226] Updated weights for policy 0, policy_version 569981 (0.0009) [2023-12-27 23:20:19,315][106226] Updated weights for policy 0, policy_version 569991 (0.0011) [2023-12-27 23:20:19,872][106225] Updated weights for policy 1, policy_version 571894 (0.0008) [2023-12-27 23:20:19,936][106225] Updated weights for policy 1, policy_version 571904 (0.0006) [2023-12-27 23:20:19,996][106225] Updated weights for policy 1, policy_version 571914 (0.0008) [2023-12-27 23:20:20,087][106226] Updated weights for policy 0, policy_version 570001 (0.0011) [2023-12-27 23:20:20,152][106226] Updated weights for policy 0, policy_version 570011 (0.0011) [2023-12-27 23:20:20,220][106226] Updated weights for policy 0, policy_version 570021 (0.0011) [2023-12-27 23:20:20,289][106226] Updated weights for policy 0, policy_version 570031 (0.0011) [2023-12-27 23:20:20,670][106225] Updated weights for policy 1, policy_version 571924 (0.0008) [2023-12-27 23:20:20,740][106225] Updated weights for policy 1, policy_version 571934 (0.0008) [2023-12-27 23:20:20,830][106225] Updated weights for policy 1, policy_version 571944 (0.0007) [2023-12-27 23:20:21,008][106226] Updated weights for policy 0, policy_version 570041 (0.0011) [2023-12-27 23:20:21,078][106226] Updated weights for policy 0, policy_version 570051 (0.0011) [2023-12-27 23:20:21,156][106226] Updated weights for policy 0, policy_version 570061 (0.0009) [2023-12-27 23:20:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 292421632. Throughput: 0: 9729.4, 1: 9805.9. Samples: 292427564. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:21,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.637')] [2023-12-27 23:20:21,496][106225] Updated weights for policy 1, policy_version 571954 (0.0007) [2023-12-27 23:20:21,558][106225] Updated weights for policy 1, policy_version 571964 (0.0008) [2023-12-27 23:20:21,624][106225] Updated weights for policy 1, policy_version 571974 (0.0007) [2023-12-27 23:20:21,689][106225] Updated weights for policy 1, policy_version 571984 (0.0008) [2023-12-27 23:20:21,941][106226] Updated weights for policy 0, policy_version 570071 (0.0009) [2023-12-27 23:20:22,004][106226] Updated weights for policy 0, policy_version 570081 (0.0010) [2023-12-27 23:20:22,067][106226] Updated weights for policy 0, policy_version 570091 (0.0011) [2023-12-27 23:20:22,405][106225] Updated weights for policy 1, policy_version 571994 (0.0010) [2023-12-27 23:20:22,460][106225] Updated weights for policy 1, policy_version 572004 (0.0010) [2023-12-27 23:20:22,518][106225] Updated weights for policy 1, policy_version 572014 (0.0010) [2023-12-27 23:20:22,822][106226] Updated weights for policy 0, policy_version 570101 (0.0011) [2023-12-27 23:20:22,879][106226] Updated weights for policy 0, policy_version 570111 (0.0011) [2023-12-27 23:20:22,940][106226] Updated weights for policy 0, policy_version 570121 (0.0010) [2023-12-27 23:20:23,231][106225] Updated weights for policy 1, policy_version 572024 (0.0008) [2023-12-27 23:20:23,301][106225] Updated weights for policy 1, policy_version 572034 (0.0010) [2023-12-27 23:20:23,358][106225] Updated weights for policy 1, policy_version 572044 (0.0010) [2023-12-27 23:20:23,558][106226] Updated weights for policy 0, policy_version 570131 (0.0009) [2023-12-27 23:20:23,619][106226] Updated weights for policy 0, policy_version 570141 (0.0005) [2023-12-27 23:20:23,672][106226] Updated weights for policy 0, policy_version 570151 (0.0008) [2023-12-27 23:20:24,056][106225] Updated weights for policy 1, policy_version 572054 (0.0010) [2023-12-27 23:20:24,113][106225] Updated weights for policy 1, policy_version 572064 (0.0010) [2023-12-27 23:20:24,174][106225] Updated weights for policy 1, policy_version 572074 (0.0005) [2023-12-27 23:20:24,301][106226] Updated weights for policy 0, policy_version 570161 (0.0010) [2023-12-27 23:20:24,354][106226] Updated weights for policy 0, policy_version 570171 (0.0010) [2023-12-27 23:20:24,401][106226] Updated weights for policy 0, policy_version 570181 (0.0010) [2023-12-27 23:20:24,466][106226] Updated weights for policy 0, policy_version 570191 (0.0009) [2023-12-27 23:20:24,881][106225] Updated weights for policy 1, policy_version 572084 (0.0006) [2023-12-27 23:20:24,934][106225] Updated weights for policy 1, policy_version 572094 (0.0008) [2023-12-27 23:20:24,984][106225] Updated weights for policy 1, policy_version 572104 (0.0007) [2023-12-27 23:20:25,065][106226] Updated weights for policy 0, policy_version 570201 (0.0010) [2023-12-27 23:20:25,118][106226] Updated weights for policy 0, policy_version 570211 (0.0010) [2023-12-27 23:20:25,174][106226] Updated weights for policy 0, policy_version 570221 (0.0010) [2023-12-27 23:20:25,737][106225] Updated weights for policy 1, policy_version 572115 (0.0009) [2023-12-27 23:20:25,785][106225] Updated weights for policy 1, policy_version 572125 (0.0007) [2023-12-27 23:20:25,832][106225] Updated weights for policy 1, policy_version 572135 (0.0008) [2023-12-27 23:20:25,861][106226] Updated weights for policy 0, policy_version 570231 (0.0008) [2023-12-27 23:20:25,927][106226] Updated weights for policy 0, policy_version 570241 (0.0008) [2023-12-27 23:20:25,986][106226] Updated weights for policy 0, policy_version 570251 (0.0008) [2023-12-27 23:20:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 292519936. Throughput: 0: 9737.7, 1: 9788.4. Samples: 292485604. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:26,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.440')] [2023-12-27 23:20:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000572144_146497536.pth... [2023-12-27 23:20:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000570256_146022400.pth... [2023-12-27 23:20:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000569104_145727488.pth [2023-12-27 23:20:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000570992_146202624.pth [2023-12-27 23:20:26,556][106225] Updated weights for policy 1, policy_version 572145 (0.0006) [2023-12-27 23:20:26,613][106225] Updated weights for policy 1, policy_version 572155 (0.0008) [2023-12-27 23:20:26,646][106226] Updated weights for policy 0, policy_version 570261 (0.0008) [2023-12-27 23:20:26,664][106225] Updated weights for policy 1, policy_version 572165 (0.0007) [2023-12-27 23:20:26,704][106226] Updated weights for policy 0, policy_version 570271 (0.0006) [2023-12-27 23:20:26,719][106225] Updated weights for policy 1, policy_version 572175 (0.0005) [2023-12-27 23:20:26,758][106226] Updated weights for policy 0, policy_version 570281 (0.0008) [2023-12-27 23:20:27,429][106225] Updated weights for policy 1, policy_version 572185 (0.0008) [2023-12-27 23:20:27,469][106226] Updated weights for policy 0, policy_version 570291 (0.0007) [2023-12-27 23:20:27,493][106225] Updated weights for policy 1, policy_version 572195 (0.0008) [2023-12-27 23:20:27,522][106226] Updated weights for policy 0, policy_version 570301 (0.0006) [2023-12-27 23:20:27,544][106225] Updated weights for policy 1, policy_version 572205 (0.0006) [2023-12-27 23:20:27,577][106226] Updated weights for policy 0, policy_version 570311 (0.0007) [2023-12-27 23:20:28,187][106225] Updated weights for policy 1, policy_version 572215 (0.0006) [2023-12-27 23:20:28,236][106225] Updated weights for policy 1, policy_version 572225 (0.0007) [2023-12-27 23:20:28,288][106225] Updated weights for policy 1, policy_version 572235 (0.0010) [2023-12-27 23:20:28,309][106226] Updated weights for policy 0, policy_version 570321 (0.0008) [2023-12-27 23:20:28,373][106226] Updated weights for policy 0, policy_version 570331 (0.0011) [2023-12-27 23:20:28,430][106226] Updated weights for policy 0, policy_version 570341 (0.0011) [2023-12-27 23:20:28,476][106226] Updated weights for policy 0, policy_version 570351 (0.0010) [2023-12-27 23:20:29,042][106225] Updated weights for policy 1, policy_version 572245 (0.0010) [2023-12-27 23:20:29,095][106225] Updated weights for policy 1, policy_version 572255 (0.0010) [2023-12-27 23:20:29,143][106225] Updated weights for policy 1, policy_version 572265 (0.0010) [2023-12-27 23:20:29,186][106226] Updated weights for policy 0, policy_version 570361 (0.0010) [2023-12-27 23:20:29,245][106226] Updated weights for policy 0, policy_version 570371 (0.0010) [2023-12-27 23:20:29,303][106226] Updated weights for policy 0, policy_version 570381 (0.0010) [2023-12-27 23:20:29,886][106225] Updated weights for policy 1, policy_version 572275 (0.0010) [2023-12-27 23:20:29,954][106225] Updated weights for policy 1, policy_version 572285 (0.0010) [2023-12-27 23:20:30,014][106225] Updated weights for policy 1, policy_version 572295 (0.0007) [2023-12-27 23:20:30,014][106226] Updated weights for policy 0, policy_version 570391 (0.0009) [2023-12-27 23:20:30,071][106226] Updated weights for policy 0, policy_version 570401 (0.0008) [2023-12-27 23:20:30,132][106226] Updated weights for policy 0, policy_version 570411 (0.0006) [2023-12-27 23:20:30,761][106225] Updated weights for policy 1, policy_version 572305 (0.0009) [2023-12-27 23:20:30,792][106226] Updated weights for policy 0, policy_version 570421 (0.0008) [2023-12-27 23:20:30,807][106225] Updated weights for policy 1, policy_version 572315 (0.0007) [2023-12-27 23:20:30,847][106226] Updated weights for policy 0, policy_version 570431 (0.0007) [2023-12-27 23:20:30,850][106225] Updated weights for policy 1, policy_version 572325 (0.0006) [2023-12-27 23:20:30,902][106225] Updated weights for policy 1, policy_version 572335 (0.0007) [2023-12-27 23:20:30,905][106226] Updated weights for policy 0, policy_version 570441 (0.0006) [2023-12-27 23:20:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 292618240. Throughput: 0: 9822.6, 1: 9854.9. Samples: 292605104. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:31,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-5.690')] [2023-12-27 23:20:31,610][106225] Updated weights for policy 1, policy_version 572345 (0.0008) [2023-12-27 23:20:31,660][106226] Updated weights for policy 0, policy_version 570451 (0.0006) [2023-12-27 23:20:31,679][106225] Updated weights for policy 1, policy_version 572355 (0.0008) [2023-12-27 23:20:31,724][106226] Updated weights for policy 0, policy_version 570461 (0.0007) [2023-12-27 23:20:31,747][106225] Updated weights for policy 1, policy_version 572365 (0.0008) [2023-12-27 23:20:31,793][106226] Updated weights for policy 0, policy_version 570471 (0.0008) [2023-12-27 23:20:32,490][106225] Updated weights for policy 1, policy_version 572375 (0.0006) [2023-12-27 23:20:32,509][106226] Updated weights for policy 0, policy_version 570481 (0.0008) [2023-12-27 23:20:32,554][106225] Updated weights for policy 1, policy_version 572385 (0.0010) [2023-12-27 23:20:32,564][106226] Updated weights for policy 0, policy_version 570491 (0.0006) [2023-12-27 23:20:32,619][106225] Updated weights for policy 1, policy_version 572395 (0.0010) [2023-12-27 23:20:32,625][106226] Updated weights for policy 0, policy_version 570501 (0.0005) [2023-12-27 23:20:32,677][106226] Updated weights for policy 0, policy_version 570511 (0.0006) [2023-12-27 23:20:33,283][106226] Updated weights for policy 0, policy_version 570521 (0.0006) [2023-12-27 23:20:33,306][106225] Updated weights for policy 1, policy_version 572405 (0.0010) [2023-12-27 23:20:33,340][106226] Updated weights for policy 0, policy_version 570531 (0.0007) [2023-12-27 23:20:33,363][106225] Updated weights for policy 1, policy_version 572415 (0.0010) [2023-12-27 23:20:33,395][106226] Updated weights for policy 0, policy_version 570541 (0.0005) [2023-12-27 23:20:33,415][106225] Updated weights for policy 1, policy_version 572425 (0.0010) [2023-12-27 23:20:34,005][106226] Updated weights for policy 0, policy_version 570551 (0.0008) [2023-12-27 23:20:34,063][106226] Updated weights for policy 0, policy_version 570561 (0.0005) [2023-12-27 23:20:34,128][106225] Updated weights for policy 1, policy_version 572435 (0.0010) [2023-12-27 23:20:34,131][106226] Updated weights for policy 0, policy_version 570571 (0.0006) [2023-12-27 23:20:34,198][106225] Updated weights for policy 1, policy_version 572445 (0.0010) [2023-12-27 23:20:34,256][106225] Updated weights for policy 1, policy_version 572455 (0.0010) [2023-12-27 23:20:34,754][106226] Updated weights for policy 0, policy_version 570581 (0.0007) [2023-12-27 23:20:34,810][106226] Updated weights for policy 0, policy_version 570591 (0.0008) [2023-12-27 23:20:34,857][106226] Updated weights for policy 0, policy_version 570601 (0.0010) [2023-12-27 23:20:34,979][106225] Updated weights for policy 1, policy_version 572465 (0.0010) [2023-12-27 23:20:35,032][106225] Updated weights for policy 1, policy_version 572475 (0.0010) [2023-12-27 23:20:35,086][106225] Updated weights for policy 1, policy_version 572485 (0.0010) [2023-12-27 23:20:35,135][106225] Updated weights for policy 1, policy_version 572495 (0.0010) [2023-12-27 23:20:35,559][106226] Updated weights for policy 0, policy_version 570611 (0.0010) [2023-12-27 23:20:35,615][106226] Updated weights for policy 0, policy_version 570621 (0.0010) [2023-12-27 23:20:35,668][106226] Updated weights for policy 0, policy_version 570631 (0.0010) [2023-12-27 23:20:35,841][106225] Updated weights for policy 1, policy_version 572505 (0.0006) [2023-12-27 23:20:35,903][106225] Updated weights for policy 1, policy_version 572515 (0.0006) [2023-12-27 23:20:35,968][106225] Updated weights for policy 1, policy_version 572525 (0.0010) [2023-12-27 23:20:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 292716544. Throughput: 0: 9920.0, 1: 9816.6. Samples: 292725260. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:36,175][105115] Avg episode reward: [(0, '-4.955'), (1, '-5.150')] [2023-12-27 23:20:36,328][106226] Updated weights for policy 0, policy_version 570641 (0.0010) [2023-12-27 23:20:36,382][106226] Updated weights for policy 0, policy_version 570651 (0.0011) [2023-12-27 23:20:36,446][106226] Updated weights for policy 0, policy_version 570661 (0.0010) [2023-12-27 23:20:36,511][106226] Updated weights for policy 0, policy_version 570671 (0.0011) [2023-12-27 23:20:36,671][106225] Updated weights for policy 1, policy_version 572535 (0.0010) [2023-12-27 23:20:36,734][106225] Updated weights for policy 1, policy_version 572545 (0.0008) [2023-12-27 23:20:36,796][106225] Updated weights for policy 1, policy_version 572555 (0.0008) [2023-12-27 23:20:37,206][106226] Updated weights for policy 0, policy_version 570681 (0.0006) [2023-12-27 23:20:37,253][106226] Updated weights for policy 0, policy_version 570691 (0.0006) [2023-12-27 23:20:37,313][106226] Updated weights for policy 0, policy_version 570701 (0.0010) [2023-12-27 23:20:37,408][106225] Updated weights for policy 1, policy_version 572565 (0.0007) [2023-12-27 23:20:37,472][106225] Updated weights for policy 1, policy_version 572575 (0.0005) [2023-12-27 23:20:37,538][106225] Updated weights for policy 1, policy_version 572585 (0.0005) [2023-12-27 23:20:37,903][106226] Updated weights for policy 0, policy_version 570711 (0.0007) [2023-12-27 23:20:37,955][106226] Updated weights for policy 0, policy_version 570721 (0.0005) [2023-12-27 23:20:38,009][106226] Updated weights for policy 0, policy_version 570731 (0.0006) [2023-12-27 23:20:38,088][106225] Updated weights for policy 1, policy_version 572595 (0.0005) [2023-12-27 23:20:38,155][106225] Updated weights for policy 1, policy_version 572605 (0.0006) [2023-12-27 23:20:38,217][106225] Updated weights for policy 1, policy_version 572615 (0.0008) [2023-12-27 23:20:38,645][106226] Updated weights for policy 0, policy_version 570741 (0.0008) [2023-12-27 23:20:38,706][106226] Updated weights for policy 0, policy_version 570751 (0.0011) [2023-12-27 23:20:38,765][106226] Updated weights for policy 0, policy_version 570761 (0.0010) [2023-12-27 23:20:38,853][106225] Updated weights for policy 1, policy_version 572625 (0.0006) [2023-12-27 23:20:38,910][106225] Updated weights for policy 1, policy_version 572635 (0.0008) [2023-12-27 23:20:38,971][106225] Updated weights for policy 1, policy_version 572645 (0.0008) [2023-12-27 23:20:39,028][106225] Updated weights for policy 1, policy_version 572655 (0.0008) [2023-12-27 23:20:39,540][106226] Updated weights for policy 0, policy_version 570771 (0.0011) [2023-12-27 23:20:39,605][106226] Updated weights for policy 0, policy_version 570781 (0.0008) [2023-12-27 23:20:39,677][106226] Updated weights for policy 0, policy_version 570791 (0.0008) [2023-12-27 23:20:39,792][106225] Updated weights for policy 1, policy_version 572665 (0.0008) [2023-12-27 23:20:39,874][106225] Updated weights for policy 1, policy_version 572675 (0.0007) [2023-12-27 23:20:39,930][106225] Updated weights for policy 1, policy_version 572685 (0.0008) [2023-12-27 23:20:40,379][106226] Updated weights for policy 0, policy_version 570801 (0.0010) [2023-12-27 23:20:40,451][106226] Updated weights for policy 0, policy_version 570811 (0.0006) [2023-12-27 23:20:40,512][106226] Updated weights for policy 0, policy_version 570821 (0.0005) [2023-12-27 23:20:40,578][106226] Updated weights for policy 0, policy_version 570831 (0.0007) [2023-12-27 23:20:40,646][106225] Updated weights for policy 1, policy_version 572695 (0.0008) [2023-12-27 23:20:40,708][106225] Updated weights for policy 1, policy_version 572705 (0.0007) [2023-12-27 23:20:40,764][106225] Updated weights for policy 1, policy_version 572715 (0.0006) [2023-12-27 23:20:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 292814848. Throughput: 0: 9988.0, 1: 9887.3. Samples: 292788668. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:41,176][105115] Avg episode reward: [(0, '-5.060'), (1, '-5.676')] [2023-12-27 23:20:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000570832_146169856.pth... [2023-12-27 23:20:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000572720_146644992.pth... [2023-12-27 23:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000569680_145874944.pth [2023-12-27 23:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000571568_146350080.pth [2023-12-27 23:20:41,306][106226] Updated weights for policy 0, policy_version 570841 (0.0008) [2023-12-27 23:20:41,375][106226] Updated weights for policy 0, policy_version 570851 (0.0008) [2023-12-27 23:20:41,441][106226] Updated weights for policy 0, policy_version 570861 (0.0008) [2023-12-27 23:20:41,455][106225] Updated weights for policy 1, policy_version 572725 (0.0008) [2023-12-27 23:20:41,509][106225] Updated weights for policy 1, policy_version 572735 (0.0007) [2023-12-27 23:20:41,569][106225] Updated weights for policy 1, policy_version 572745 (0.0007) [2023-12-27 23:20:42,171][106226] Updated weights for policy 0, policy_version 570871 (0.0010) [2023-12-27 23:20:42,228][106226] Updated weights for policy 0, policy_version 570881 (0.0010) [2023-12-27 23:20:42,295][106226] Updated weights for policy 0, policy_version 570891 (0.0009) [2023-12-27 23:20:42,389][106225] Updated weights for policy 1, policy_version 572755 (0.0009) [2023-12-27 23:20:42,450][106225] Updated weights for policy 1, policy_version 572765 (0.0006) [2023-12-27 23:20:42,511][106225] Updated weights for policy 1, policy_version 572775 (0.0007) [2023-12-27 23:20:42,999][106226] Updated weights for policy 0, policy_version 570901 (0.0007) [2023-12-27 23:20:43,050][106226] Updated weights for policy 0, policy_version 570911 (0.0005) [2023-12-27 23:20:43,095][106226] Updated weights for policy 0, policy_version 570921 (0.0005) [2023-12-27 23:20:43,236][106225] Updated weights for policy 1, policy_version 572785 (0.0008) [2023-12-27 23:20:43,289][106225] Updated weights for policy 1, policy_version 572795 (0.0008) [2023-12-27 23:20:43,332][106225] Updated weights for policy 1, policy_version 572805 (0.0007) [2023-12-27 23:20:43,385][106225] Updated weights for policy 1, policy_version 572815 (0.0007) [2023-12-27 23:20:43,760][106226] Updated weights for policy 0, policy_version 570931 (0.0007) [2023-12-27 23:20:43,824][106226] Updated weights for policy 0, policy_version 570941 (0.0010) [2023-12-27 23:20:43,886][106226] Updated weights for policy 0, policy_version 570951 (0.0010) [2023-12-27 23:20:44,044][106225] Updated weights for policy 1, policy_version 572825 (0.0008) [2023-12-27 23:20:44,098][106225] Updated weights for policy 1, policy_version 572835 (0.0008) [2023-12-27 23:20:44,143][106225] Updated weights for policy 1, policy_version 572845 (0.0007) [2023-12-27 23:20:44,580][106226] Updated weights for policy 0, policy_version 570961 (0.0010) [2023-12-27 23:20:44,642][106226] Updated weights for policy 0, policy_version 570971 (0.0010) [2023-12-27 23:20:44,691][106226] Updated weights for policy 0, policy_version 570981 (0.0010) [2023-12-27 23:20:44,741][106226] Updated weights for policy 0, policy_version 570991 (0.0010) [2023-12-27 23:20:44,846][106225] Updated weights for policy 1, policy_version 572855 (0.0009) [2023-12-27 23:20:44,907][106225] Updated weights for policy 1, policy_version 572865 (0.0010) [2023-12-27 23:20:44,975][106225] Updated weights for policy 1, policy_version 572875 (0.0007) [2023-12-27 23:20:45,486][106226] Updated weights for policy 0, policy_version 571001 (0.0008) [2023-12-27 23:20:45,545][106226] Updated weights for policy 0, policy_version 571011 (0.0009) [2023-12-27 23:20:45,607][106226] Updated weights for policy 0, policy_version 571021 (0.0009) [2023-12-27 23:20:45,694][106225] Updated weights for policy 1, policy_version 572885 (0.0007) [2023-12-27 23:20:45,755][106225] Updated weights for policy 1, policy_version 572895 (0.0005) [2023-12-27 23:20:45,816][106225] Updated weights for policy 1, policy_version 572905 (0.0006) [2023-12-27 23:20:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 292913152. Throughput: 0: 9950.0, 1: 9845.4. Samples: 292904540. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:46,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-5.664')] [2023-12-27 23:20:46,305][106226] Updated weights for policy 0, policy_version 571031 (0.0010) [2023-12-27 23:20:46,351][106226] Updated weights for policy 0, policy_version 571041 (0.0010) [2023-12-27 23:20:46,403][106226] Updated weights for policy 0, policy_version 571051 (0.0010) [2023-12-27 23:20:46,492][106225] Updated weights for policy 1, policy_version 572915 (0.0008) [2023-12-27 23:20:46,560][106225] Updated weights for policy 1, policy_version 572925 (0.0005) [2023-12-27 23:20:46,628][106225] Updated weights for policy 1, policy_version 572935 (0.0006) [2023-12-27 23:20:47,147][106226] Updated weights for policy 0, policy_version 571061 (0.0010) [2023-12-27 23:20:47,216][106226] Updated weights for policy 0, policy_version 571071 (0.0011) [2023-12-27 23:20:47,220][106225] Updated weights for policy 1, policy_version 572945 (0.0010) [2023-12-27 23:20:47,278][106226] Updated weights for policy 0, policy_version 571081 (0.0011) [2023-12-27 23:20:47,284][106225] Updated weights for policy 1, policy_version 572955 (0.0007) [2023-12-27 23:20:47,339][106225] Updated weights for policy 1, policy_version 572965 (0.0006) [2023-12-27 23:20:47,396][106225] Updated weights for policy 1, policy_version 572975 (0.0008) [2023-12-27 23:20:47,885][106226] Updated weights for policy 0, policy_version 571091 (0.0009) [2023-12-27 23:20:47,940][106226] Updated weights for policy 0, policy_version 571101 (0.0005) [2023-12-27 23:20:47,986][106226] Updated weights for policy 0, policy_version 571111 (0.0005) [2023-12-27 23:20:48,183][106225] Updated weights for policy 1, policy_version 572985 (0.0008) [2023-12-27 23:20:48,235][106225] Updated weights for policy 1, policy_version 572995 (0.0010) [2023-12-27 23:20:48,286][106225] Updated weights for policy 1, policy_version 573005 (0.0007) [2023-12-27 23:20:48,596][106226] Updated weights for policy 0, policy_version 571121 (0.0009) [2023-12-27 23:20:48,660][106226] Updated weights for policy 0, policy_version 571131 (0.0010) [2023-12-27 23:20:48,721][106226] Updated weights for policy 0, policy_version 571141 (0.0010) [2023-12-27 23:20:48,778][106226] Updated weights for policy 0, policy_version 571151 (0.0010) [2023-12-27 23:20:49,083][106225] Updated weights for policy 1, policy_version 573015 (0.0009) [2023-12-27 23:20:49,141][106225] Updated weights for policy 1, policy_version 573025 (0.0010) [2023-12-27 23:20:49,205][106225] Updated weights for policy 1, policy_version 573035 (0.0009) [2023-12-27 23:20:49,492][106226] Updated weights for policy 0, policy_version 571161 (0.0011) [2023-12-27 23:20:49,549][106226] Updated weights for policy 0, policy_version 571171 (0.0010) [2023-12-27 23:20:49,602][106226] Updated weights for policy 0, policy_version 571181 (0.0009) [2023-12-27 23:20:49,964][106225] Updated weights for policy 1, policy_version 573045 (0.0008) [2023-12-27 23:20:50,022][106225] Updated weights for policy 1, policy_version 573055 (0.0008) [2023-12-27 23:20:50,080][106225] Updated weights for policy 1, policy_version 573065 (0.0008) [2023-12-27 23:20:50,375][106226] Updated weights for policy 0, policy_version 571191 (0.0009) [2023-12-27 23:20:50,435][106226] Updated weights for policy 0, policy_version 571201 (0.0011) [2023-12-27 23:20:50,498][106226] Updated weights for policy 0, policy_version 571211 (0.0011) [2023-12-27 23:20:50,747][106225] Updated weights for policy 1, policy_version 573075 (0.0008) [2023-12-27 23:20:50,803][106225] Updated weights for policy 1, policy_version 573085 (0.0008) [2023-12-27 23:20:50,848][106225] Updated weights for policy 1, policy_version 573095 (0.0008) [2023-12-27 23:20:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 293011456. Throughput: 0: 9919.4, 1: 9772.3. Samples: 293021896. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:51,175][105115] Avg episode reward: [(0, '-4.916'), (1, '-5.771')] [2023-12-27 23:20:51,239][106226] Updated weights for policy 0, policy_version 571221 (0.0010) [2023-12-27 23:20:51,300][106226] Updated weights for policy 0, policy_version 571231 (0.0009) [2023-12-27 23:20:51,363][106226] Updated weights for policy 0, policy_version 571241 (0.0009) [2023-12-27 23:20:51,599][106225] Updated weights for policy 1, policy_version 573105 (0.0007) [2023-12-27 23:20:51,668][106225] Updated weights for policy 1, policy_version 573115 (0.0009) [2023-12-27 23:20:51,721][106225] Updated weights for policy 1, policy_version 573125 (0.0008) [2023-12-27 23:20:51,786][106225] Updated weights for policy 1, policy_version 573135 (0.0008) [2023-12-27 23:20:52,220][106226] Updated weights for policy 0, policy_version 571251 (0.0010) [2023-12-27 23:20:52,283][106226] Updated weights for policy 0, policy_version 571261 (0.0009) [2023-12-27 23:20:52,347][106226] Updated weights for policy 0, policy_version 571271 (0.0009) [2023-12-27 23:20:52,502][106225] Updated weights for policy 1, policy_version 573145 (0.0009) [2023-12-27 23:20:52,566][106225] Updated weights for policy 1, policy_version 573155 (0.0008) [2023-12-27 23:20:52,629][106225] Updated weights for policy 1, policy_version 573165 (0.0008) [2023-12-27 23:20:53,131][106226] Updated weights for policy 0, policy_version 571281 (0.0009) [2023-12-27 23:20:53,191][106226] Updated weights for policy 0, policy_version 571291 (0.0008) [2023-12-27 23:20:53,243][106226] Updated weights for policy 0, policy_version 571301 (0.0008) [2023-12-27 23:20:53,267][106225] Updated weights for policy 1, policy_version 573175 (0.0007) [2023-12-27 23:20:53,302][106226] Updated weights for policy 0, policy_version 571311 (0.0006) [2023-12-27 23:20:53,320][106225] Updated weights for policy 1, policy_version 573185 (0.0007) [2023-12-27 23:20:53,367][106225] Updated weights for policy 1, policy_version 573195 (0.0008) [2023-12-27 23:20:53,990][106226] Updated weights for policy 0, policy_version 571321 (0.0008) [2023-12-27 23:20:54,043][106226] Updated weights for policy 0, policy_version 571331 (0.0007) [2023-12-27 23:20:54,101][106226] Updated weights for policy 0, policy_version 571341 (0.0009) [2023-12-27 23:20:54,108][106225] Updated weights for policy 1, policy_version 573205 (0.0007) [2023-12-27 23:20:54,157][106225] Updated weights for policy 1, policy_version 573215 (0.0007) [2023-12-27 23:20:54,209][106225] Updated weights for policy 1, policy_version 573225 (0.0008) [2023-12-27 23:20:54,851][106226] Updated weights for policy 0, policy_version 571352 (0.0008) [2023-12-27 23:20:54,903][106226] Updated weights for policy 0, policy_version 571362 (0.0006) [2023-12-27 23:20:54,935][106225] Updated weights for policy 1, policy_version 573235 (0.0008) [2023-12-27 23:20:54,956][106226] Updated weights for policy 0, policy_version 571372 (0.0011) [2023-12-27 23:20:55,001][106225] Updated weights for policy 1, policy_version 573245 (0.0006) [2023-12-27 23:20:55,070][106225] Updated weights for policy 1, policy_version 573255 (0.0005) [2023-12-27 23:20:55,579][106226] Updated weights for policy 0, policy_version 571382 (0.0011) [2023-12-27 23:20:55,632][106226] Updated weights for policy 0, policy_version 571392 (0.0010) [2023-12-27 23:20:55,676][106226] Updated weights for policy 0, policy_version 571402 (0.0010) [2023-12-27 23:20:55,720][106225] Updated weights for policy 1, policy_version 573265 (0.0006) [2023-12-27 23:20:55,769][106225] Updated weights for policy 1, policy_version 573275 (0.0009) [2023-12-27 23:20:55,818][106225] Updated weights for policy 1, policy_version 573285 (0.0008) [2023-12-27 23:20:55,868][106225] Updated weights for policy 1, policy_version 573296 (0.0009) [2023-12-27 23:20:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 293109760. Throughput: 0: 9845.6, 1: 9750.2. Samples: 293078708. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:20:56,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-5.815')] [2023-12-27 23:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000573296_146792448.pth... [2023-12-27 23:20:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000571408_146317312.pth... [2023-12-27 23:20:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000572144_146497536.pth [2023-12-27 23:20:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000570256_146022400.pth [2023-12-27 23:20:56,356][106226] Updated weights for policy 0, policy_version 571412 (0.0009) [2023-12-27 23:20:56,419][106226] Updated weights for policy 0, policy_version 571422 (0.0010) [2023-12-27 23:20:56,478][106226] Updated weights for policy 0, policy_version 571432 (0.0010) [2023-12-27 23:20:56,644][106225] Updated weights for policy 1, policy_version 573306 (0.0008) [2023-12-27 23:20:56,694][106225] Updated weights for policy 1, policy_version 573316 (0.0010) [2023-12-27 23:20:56,745][106225] Updated weights for policy 1, policy_version 573326 (0.0010) [2023-12-27 23:20:57,053][106226] Updated weights for policy 0, policy_version 571442 (0.0009) [2023-12-27 23:20:57,109][106226] Updated weights for policy 0, policy_version 571452 (0.0005) [2023-12-27 23:20:57,168][106226] Updated weights for policy 0, policy_version 571462 (0.0005) [2023-12-27 23:20:57,228][106226] Updated weights for policy 0, policy_version 571472 (0.0006) [2023-12-27 23:20:57,342][106225] Updated weights for policy 1, policy_version 573336 (0.0006) [2023-12-27 23:20:57,391][106225] Updated weights for policy 1, policy_version 573346 (0.0005) [2023-12-27 23:20:57,438][106225] Updated weights for policy 1, policy_version 573356 (0.0006) [2023-12-27 23:20:57,808][106226] Updated weights for policy 0, policy_version 571482 (0.0007) [2023-12-27 23:20:57,869][106226] Updated weights for policy 0, policy_version 571492 (0.0008) [2023-12-27 23:20:57,924][106226] Updated weights for policy 0, policy_version 571502 (0.0008) [2023-12-27 23:20:58,107][106225] Updated weights for policy 1, policy_version 573366 (0.0007) [2023-12-27 23:20:58,158][106225] Updated weights for policy 1, policy_version 573376 (0.0005) [2023-12-27 23:20:58,219][106225] Updated weights for policy 1, policy_version 573386 (0.0006) [2023-12-27 23:20:58,686][106226] Updated weights for policy 0, policy_version 571512 (0.0009) [2023-12-27 23:20:58,753][106226] Updated weights for policy 0, policy_version 571522 (0.0009) [2023-12-27 23:20:58,828][106226] Updated weights for policy 0, policy_version 571532 (0.0009) [2023-12-27 23:20:58,967][106225] Updated weights for policy 1, policy_version 573396 (0.0010) [2023-12-27 23:20:59,034][106225] Updated weights for policy 1, policy_version 573406 (0.0008) [2023-12-27 23:20:59,103][106225] Updated weights for policy 1, policy_version 573416 (0.0008) [2023-12-27 23:20:59,603][106226] Updated weights for policy 0, policy_version 571542 (0.0008) [2023-12-27 23:20:59,662][106226] Updated weights for policy 0, policy_version 571552 (0.0009) [2023-12-27 23:20:59,715][106226] Updated weights for policy 0, policy_version 571562 (0.0008) [2023-12-27 23:20:59,765][106225] Updated weights for policy 1, policy_version 573426 (0.0008) [2023-12-27 23:20:59,845][106225] Updated weights for policy 1, policy_version 573436 (0.0006) [2023-12-27 23:20:59,906][106225] Updated weights for policy 1, policy_version 573446 (0.0008) [2023-12-27 23:20:59,970][106225] Updated weights for policy 1, policy_version 573456 (0.0009) [2023-12-27 23:21:00,464][106226] Updated weights for policy 0, policy_version 571572 (0.0010) [2023-12-27 23:21:00,528][106226] Updated weights for policy 0, policy_version 571582 (0.0008) [2023-12-27 23:21:00,590][106226] Updated weights for policy 0, policy_version 571592 (0.0009) [2023-12-27 23:21:00,609][106225] Updated weights for policy 1, policy_version 573466 (0.0006) [2023-12-27 23:21:00,666][106225] Updated weights for policy 1, policy_version 573477 (0.0007) [2023-12-27 23:21:00,717][106225] Updated weights for policy 1, policy_version 573487 (0.0009) [2023-12-27 23:21:01,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 293208064. Throughput: 0: 9874.5, 1: 9828.7. Samples: 293198512. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:01,175][105115] Avg episode reward: [(0, '-4.957'), (1, '-5.716')] [2023-12-27 23:21:01,276][106226] Updated weights for policy 0, policy_version 571602 (0.0008) [2023-12-27 23:21:01,340][106226] Updated weights for policy 0, policy_version 571612 (0.0009) [2023-12-27 23:21:01,406][106226] Updated weights for policy 0, policy_version 571622 (0.0009) [2023-12-27 23:21:01,461][106226] Updated weights for policy 0, policy_version 571632 (0.0007) [2023-12-27 23:21:01,475][106225] Updated weights for policy 1, policy_version 573497 (0.0007) [2023-12-27 23:21:01,534][106225] Updated weights for policy 1, policy_version 573507 (0.0008) [2023-12-27 23:21:01,583][106225] Updated weights for policy 1, policy_version 573517 (0.0008) [2023-12-27 23:21:02,241][106226] Updated weights for policy 0, policy_version 571642 (0.0009) [2023-12-27 23:21:02,303][106226] Updated weights for policy 0, policy_version 571652 (0.0009) [2023-12-27 23:21:02,371][106225] Updated weights for policy 1, policy_version 573527 (0.0008) [2023-12-27 23:21:02,378][106226] Updated weights for policy 0, policy_version 571662 (0.0008) [2023-12-27 23:21:02,438][106225] Updated weights for policy 1, policy_version 573537 (0.0007) [2023-12-27 23:21:02,500][106225] Updated weights for policy 1, policy_version 573547 (0.0011) [2023-12-27 23:21:03,109][106225] Updated weights for policy 1, policy_version 573557 (0.0008) [2023-12-27 23:21:03,162][106225] Updated weights for policy 1, policy_version 573567 (0.0006) [2023-12-27 23:21:03,163][106226] Updated weights for policy 0, policy_version 571672 (0.0008) [2023-12-27 23:21:03,214][106225] Updated weights for policy 1, policy_version 573577 (0.0007) [2023-12-27 23:21:03,220][106226] Updated weights for policy 0, policy_version 571682 (0.0007) [2023-12-27 23:21:03,275][106226] Updated weights for policy 0, policy_version 571692 (0.0007) [2023-12-27 23:21:03,888][106225] Updated weights for policy 1, policy_version 573587 (0.0010) [2023-12-27 23:21:03,942][106225] Updated weights for policy 1, policy_version 573597 (0.0010) [2023-12-27 23:21:03,996][106225] Updated weights for policy 1, policy_version 573607 (0.0010) [2023-12-27 23:21:04,029][106226] Updated weights for policy 0, policy_version 571702 (0.0007) [2023-12-27 23:21:04,098][106226] Updated weights for policy 0, policy_version 571712 (0.0008) [2023-12-27 23:21:04,164][106226] Updated weights for policy 0, policy_version 571722 (0.0008) [2023-12-27 23:21:04,651][106225] Updated weights for policy 1, policy_version 573617 (0.0008) [2023-12-27 23:21:04,704][106225] Updated weights for policy 1, policy_version 573627 (0.0007) [2023-12-27 23:21:04,763][106225] Updated weights for policy 1, policy_version 573637 (0.0008) [2023-12-27 23:21:04,821][106225] Updated weights for policy 1, policy_version 573647 (0.0008) [2023-12-27 23:21:04,865][106226] Updated weights for policy 0, policy_version 571732 (0.0009) [2023-12-27 23:21:04,920][106226] Updated weights for policy 0, policy_version 571742 (0.0009) [2023-12-27 23:21:04,963][106226] Updated weights for policy 0, policy_version 571752 (0.0008) [2023-12-27 23:21:05,519][106225] Updated weights for policy 1, policy_version 573657 (0.0006) [2023-12-27 23:21:05,572][106225] Updated weights for policy 1, policy_version 573667 (0.0005) [2023-12-27 23:21:05,618][106225] Updated weights for policy 1, policy_version 573677 (0.0009) [2023-12-27 23:21:05,725][106226] Updated weights for policy 0, policy_version 571762 (0.0008) [2023-12-27 23:21:05,786][106226] Updated weights for policy 0, policy_version 571772 (0.0009) [2023-12-27 23:21:05,844][106226] Updated weights for policy 0, policy_version 571782 (0.0009) [2023-12-27 23:21:05,897][106226] Updated weights for policy 0, policy_version 571792 (0.0008) [2023-12-27 23:21:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 293306368. Throughput: 0: 9861.2, 1: 9861.1. Samples: 293315068. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:06,175][105115] Avg episode reward: [(0, '-4.774'), (1, '-5.490')] [2023-12-27 23:21:06,234][106225] Updated weights for policy 1, policy_version 573687 (0.0008) [2023-12-27 23:21:06,297][106225] Updated weights for policy 1, policy_version 573697 (0.0009) [2023-12-27 23:21:06,364][106225] Updated weights for policy 1, policy_version 573707 (0.0009) [2023-12-27 23:21:06,660][106226] Updated weights for policy 0, policy_version 571802 (0.0009) [2023-12-27 23:21:06,722][106226] Updated weights for policy 0, policy_version 571812 (0.0007) [2023-12-27 23:21:06,786][106226] Updated weights for policy 0, policy_version 571822 (0.0006) [2023-12-27 23:21:07,116][106225] Updated weights for policy 1, policy_version 573717 (0.0008) [2023-12-27 23:21:07,170][106225] Updated weights for policy 1, policy_version 573727 (0.0008) [2023-12-27 23:21:07,224][106225] Updated weights for policy 1, policy_version 573737 (0.0010) [2023-12-27 23:21:07,499][106226] Updated weights for policy 0, policy_version 571832 (0.0006) [2023-12-27 23:21:07,572][106226] Updated weights for policy 0, policy_version 571842 (0.0009) [2023-12-27 23:21:07,625][106226] Updated weights for policy 0, policy_version 571852 (0.0010) [2023-12-27 23:21:07,863][106225] Updated weights for policy 1, policy_version 573747 (0.0008) [2023-12-27 23:21:07,916][106225] Updated weights for policy 1, policy_version 573757 (0.0010) [2023-12-27 23:21:07,981][106225] Updated weights for policy 1, policy_version 573767 (0.0010) [2023-12-27 23:21:08,172][106226] Updated weights for policy 0, policy_version 571862 (0.0008) [2023-12-27 23:21:08,234][106226] Updated weights for policy 0, policy_version 571872 (0.0006) [2023-12-27 23:21:08,285][106226] Updated weights for policy 0, policy_version 571882 (0.0005) [2023-12-27 23:21:08,716][106225] Updated weights for policy 1, policy_version 573777 (0.0010) [2023-12-27 23:21:08,774][106225] Updated weights for policy 1, policy_version 573787 (0.0008) [2023-12-27 23:21:08,836][106225] Updated weights for policy 1, policy_version 573797 (0.0008) [2023-12-27 23:21:08,896][106225] Updated weights for policy 1, policy_version 573807 (0.0009) [2023-12-27 23:21:08,906][106226] Updated weights for policy 0, policy_version 571892 (0.0006) [2023-12-27 23:21:08,956][106226] Updated weights for policy 0, policy_version 571902 (0.0005) [2023-12-27 23:21:09,004][106226] Updated weights for policy 0, policy_version 571912 (0.0005) [2023-12-27 23:21:09,645][106226] Updated weights for policy 0, policy_version 571922 (0.0007) [2023-12-27 23:21:09,666][106225] Updated weights for policy 1, policy_version 573817 (0.0009) [2023-12-27 23:21:09,707][106226] Updated weights for policy 0, policy_version 571932 (0.0010) [2023-12-27 23:21:09,721][106225] Updated weights for policy 1, policy_version 573827 (0.0011) [2023-12-27 23:21:09,765][106226] Updated weights for policy 0, policy_version 571942 (0.0005) [2023-12-27 23:21:09,777][106225] Updated weights for policy 1, policy_version 573837 (0.0010) [2023-12-27 23:21:09,816][106226] Updated weights for policy 0, policy_version 571952 (0.0006) [2023-12-27 23:21:10,527][106226] Updated weights for policy 0, policy_version 571962 (0.0008) [2023-12-27 23:21:10,589][106225] Updated weights for policy 1, policy_version 573847 (0.0007) [2023-12-27 23:21:10,598][106226] Updated weights for policy 0, policy_version 571972 (0.0008) [2023-12-27 23:21:10,656][106225] Updated weights for policy 1, policy_version 573857 (0.0006) [2023-12-27 23:21:10,659][106226] Updated weights for policy 0, policy_version 571982 (0.0011) [2023-12-27 23:21:10,725][106225] Updated weights for policy 1, policy_version 573867 (0.0006) [2023-12-27 23:21:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 293404672. Throughput: 0: 9930.5, 1: 9893.8. Samples: 293377704. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:11,176][105115] Avg episode reward: [(0, '-5.184'), (1, '-5.603')] [2023-12-27 23:21:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000573872_146939904.pth... [2023-12-27 23:21:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000571984_146464768.pth... [2023-12-27 23:21:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000572720_146644992.pth [2023-12-27 23:21:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000570832_146169856.pth [2023-12-27 23:21:11,373][106226] Updated weights for policy 0, policy_version 571992 (0.0010) [2023-12-27 23:21:11,405][106225] Updated weights for policy 1, policy_version 573877 (0.0007) [2023-12-27 23:21:11,436][106226] Updated weights for policy 0, policy_version 572002 (0.0008) [2023-12-27 23:21:11,466][106225] Updated weights for policy 1, policy_version 573887 (0.0007) [2023-12-27 23:21:11,501][106226] Updated weights for policy 0, policy_version 572012 (0.0011) [2023-12-27 23:21:11,526][106225] Updated weights for policy 1, policy_version 573897 (0.0006) [2023-12-27 23:21:12,215][106225] Updated weights for policy 1, policy_version 573907 (0.0008) [2023-12-27 23:21:12,247][106226] Updated weights for policy 0, policy_version 572022 (0.0008) [2023-12-27 23:21:12,280][106225] Updated weights for policy 1, policy_version 573917 (0.0008) [2023-12-27 23:21:12,312][106226] Updated weights for policy 0, policy_version 572032 (0.0008) [2023-12-27 23:21:12,341][106225] Updated weights for policy 1, policy_version 573927 (0.0008) [2023-12-27 23:21:12,379][106226] Updated weights for policy 0, policy_version 572042 (0.0008) [2023-12-27 23:21:13,056][106225] Updated weights for policy 1, policy_version 573937 (0.0008) [2023-12-27 23:21:13,109][106225] Updated weights for policy 1, policy_version 573947 (0.0008) [2023-12-27 23:21:13,129][106226] Updated weights for policy 0, policy_version 572052 (0.0008) [2023-12-27 23:21:13,151][106225] Updated weights for policy 1, policy_version 573957 (0.0007) [2023-12-27 23:21:13,183][106226] Updated weights for policy 0, policy_version 572062 (0.0008) [2023-12-27 23:21:13,208][106225] Updated weights for policy 1, policy_version 573967 (0.0006) [2023-12-27 23:21:13,245][106226] Updated weights for policy 0, policy_version 572072 (0.0006) [2023-12-27 23:21:13,812][106225] Updated weights for policy 1, policy_version 573977 (0.0007) [2023-12-27 23:21:13,861][106225] Updated weights for policy 1, policy_version 573987 (0.0008) [2023-12-27 23:21:13,910][106225] Updated weights for policy 1, policy_version 573997 (0.0008) [2023-12-27 23:21:14,016][106226] Updated weights for policy 0, policy_version 572082 (0.0008) [2023-12-27 23:21:14,071][106226] Updated weights for policy 0, policy_version 572092 (0.0008) [2023-12-27 23:21:14,138][106226] Updated weights for policy 0, policy_version 572102 (0.0011) [2023-12-27 23:21:14,200][106226] Updated weights for policy 0, policy_version 572112 (0.0010) [2023-12-27 23:21:14,664][106225] Updated weights for policy 1, policy_version 574007 (0.0008) [2023-12-27 23:21:14,714][106225] Updated weights for policy 1, policy_version 574017 (0.0007) [2023-12-27 23:21:14,767][106225] Updated weights for policy 1, policy_version 574027 (0.0006) [2023-12-27 23:21:14,820][106226] Updated weights for policy 0, policy_version 572122 (0.0008) [2023-12-27 23:21:14,883][106226] Updated weights for policy 0, policy_version 572132 (0.0008) [2023-12-27 23:21:14,945][106226] Updated weights for policy 0, policy_version 572142 (0.0008) [2023-12-27 23:21:15,528][106225] Updated weights for policy 1, policy_version 574037 (0.0009) [2023-12-27 23:21:15,590][106225] Updated weights for policy 1, policy_version 574047 (0.0009) [2023-12-27 23:21:15,650][106225] Updated weights for policy 1, policy_version 574057 (0.0008) [2023-12-27 23:21:15,679][106226] Updated weights for policy 0, policy_version 572152 (0.0008) [2023-12-27 23:21:15,745][106226] Updated weights for policy 0, policy_version 572162 (0.0009) [2023-12-27 23:21:15,816][106226] Updated weights for policy 0, policy_version 572172 (0.0008) [2023-12-27 23:21:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 293502976. Throughput: 0: 9875.5, 1: 9868.5. Samples: 293493584. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:16,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.864')] [2023-12-27 23:21:16,357][106225] Updated weights for policy 1, policy_version 574067 (0.0008) [2023-12-27 23:21:16,408][106225] Updated weights for policy 1, policy_version 574077 (0.0005) [2023-12-27 23:21:16,468][106225] Updated weights for policy 1, policy_version 574087 (0.0005) [2023-12-27 23:21:16,512][106226] Updated weights for policy 0, policy_version 572182 (0.0007) [2023-12-27 23:21:16,560][106226] Updated weights for policy 0, policy_version 572192 (0.0005) [2023-12-27 23:21:16,615][106226] Updated weights for policy 0, policy_version 572202 (0.0005) [2023-12-27 23:21:17,206][106226] Updated weights for policy 0, policy_version 572212 (0.0007) [2023-12-27 23:21:17,243][106225] Updated weights for policy 1, policy_version 574097 (0.0008) [2023-12-27 23:21:17,275][106226] Updated weights for policy 0, policy_version 572222 (0.0008) [2023-12-27 23:21:17,302][106225] Updated weights for policy 1, policy_version 574107 (0.0006) [2023-12-27 23:21:17,333][106226] Updated weights for policy 0, policy_version 572232 (0.0009) [2023-12-27 23:21:17,362][106225] Updated weights for policy 1, policy_version 574117 (0.0007) [2023-12-27 23:21:17,414][106225] Updated weights for policy 1, policy_version 574127 (0.0007) [2023-12-27 23:21:18,062][106225] Updated weights for policy 1, policy_version 574137 (0.0009) [2023-12-27 23:21:18,113][106225] Updated weights for policy 1, policy_version 574147 (0.0008) [2023-12-27 23:21:18,116][106226] Updated weights for policy 0, policy_version 572242 (0.0009) [2023-12-27 23:21:18,163][106225] Updated weights for policy 1, policy_version 574157 (0.0007) [2023-12-27 23:21:18,168][106226] Updated weights for policy 0, policy_version 572252 (0.0007) [2023-12-27 23:21:18,215][106226] Updated weights for policy 0, policy_version 572262 (0.0007) [2023-12-27 23:21:18,270][106226] Updated weights for policy 0, policy_version 572272 (0.0008) [2023-12-27 23:21:18,934][106226] Updated weights for policy 0, policy_version 572282 (0.0009) [2023-12-27 23:21:18,983][106226] Updated weights for policy 0, policy_version 572292 (0.0007) [2023-12-27 23:21:18,985][106225] Updated weights for policy 1, policy_version 574167 (0.0006) [2023-12-27 23:21:19,032][106226] Updated weights for policy 0, policy_version 572302 (0.0006) [2023-12-27 23:21:19,034][106225] Updated weights for policy 1, policy_version 574177 (0.0008) [2023-12-27 23:21:19,081][106225] Updated weights for policy 1, policy_version 574187 (0.0006) [2023-12-27 23:21:19,803][106226] Updated weights for policy 0, policy_version 572312 (0.0007) [2023-12-27 23:21:19,875][106226] Updated weights for policy 0, policy_version 572322 (0.0007) [2023-12-27 23:21:19,892][106225] Updated weights for policy 1, policy_version 574197 (0.0009) [2023-12-27 23:21:19,941][106226] Updated weights for policy 0, policy_version 572332 (0.0007) [2023-12-27 23:21:19,961][106225] Updated weights for policy 1, policy_version 574207 (0.0008) [2023-12-27 23:21:20,028][106225] Updated weights for policy 1, policy_version 574217 (0.0008) [2023-12-27 23:21:20,612][106226] Updated weights for policy 0, policy_version 572342 (0.0008) [2023-12-27 23:21:20,664][106226] Updated weights for policy 0, policy_version 572352 (0.0008) [2023-12-27 23:21:20,726][106226] Updated weights for policy 0, policy_version 572362 (0.0008) [2023-12-27 23:21:20,746][106225] Updated weights for policy 1, policy_version 574227 (0.0009) [2023-12-27 23:21:20,812][106225] Updated weights for policy 1, policy_version 574237 (0.0011) [2023-12-27 23:21:20,878][106225] Updated weights for policy 1, policy_version 574247 (0.0011) [2023-12-27 23:21:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 293601280. Throughput: 0: 9807.1, 1: 9847.4. Samples: 293609716. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:21,175][105115] Avg episode reward: [(0, '-5.082'), (1, '-5.942')] [2023-12-27 23:21:21,465][106226] Updated weights for policy 0, policy_version 572372 (0.0010) [2023-12-27 23:21:21,530][106226] Updated weights for policy 0, policy_version 572382 (0.0007) [2023-12-27 23:21:21,593][106226] Updated weights for policy 0, policy_version 572392 (0.0006) [2023-12-27 23:21:21,655][106225] Updated weights for policy 1, policy_version 574257 (0.0010) [2023-12-27 23:21:21,719][106225] Updated weights for policy 1, policy_version 574267 (0.0009) [2023-12-27 23:21:21,784][106225] Updated weights for policy 1, policy_version 574277 (0.0009) [2023-12-27 23:21:21,843][106225] Updated weights for policy 1, policy_version 574287 (0.0007) [2023-12-27 23:21:22,308][106226] Updated weights for policy 0, policy_version 572402 (0.0009) [2023-12-27 23:21:22,382][106226] Updated weights for policy 0, policy_version 572412 (0.0008) [2023-12-27 23:21:22,448][106226] Updated weights for policy 0, policy_version 572422 (0.0006) [2023-12-27 23:21:22,511][106226] Updated weights for policy 0, policy_version 572432 (0.0009) [2023-12-27 23:21:22,566][106225] Updated weights for policy 1, policy_version 574297 (0.0008) [2023-12-27 23:21:22,624][106225] Updated weights for policy 1, policy_version 574307 (0.0010) [2023-12-27 23:21:22,680][106225] Updated weights for policy 1, policy_version 574317 (0.0010) [2023-12-27 23:21:23,154][106226] Updated weights for policy 0, policy_version 572442 (0.0006) [2023-12-27 23:21:23,200][106226] Updated weights for policy 0, policy_version 572452 (0.0005) [2023-12-27 23:21:23,248][106226] Updated weights for policy 0, policy_version 572462 (0.0005) [2023-12-27 23:21:23,416][106225] Updated weights for policy 1, policy_version 574327 (0.0009) [2023-12-27 23:21:23,477][106225] Updated weights for policy 1, policy_version 574337 (0.0009) [2023-12-27 23:21:23,538][106225] Updated weights for policy 1, policy_version 574347 (0.0009) [2023-12-27 23:21:23,853][106226] Updated weights for policy 0, policy_version 572472 (0.0008) [2023-12-27 23:21:23,901][106226] Updated weights for policy 0, policy_version 572482 (0.0008) [2023-12-27 23:21:23,953][106226] Updated weights for policy 0, policy_version 572492 (0.0008) [2023-12-27 23:21:24,214][106225] Updated weights for policy 1, policy_version 574357 (0.0009) [2023-12-27 23:21:24,280][106225] Updated weights for policy 1, policy_version 574367 (0.0006) [2023-12-27 23:21:24,346][106225] Updated weights for policy 1, policy_version 574377 (0.0006) [2023-12-27 23:21:24,713][106226] Updated weights for policy 0, policy_version 572502 (0.0010) [2023-12-27 23:21:24,771][106226] Updated weights for policy 0, policy_version 572512 (0.0008) [2023-12-27 23:21:24,833][106226] Updated weights for policy 0, policy_version 572522 (0.0009) [2023-12-27 23:21:24,932][106225] Updated weights for policy 1, policy_version 574387 (0.0008) [2023-12-27 23:21:24,993][106225] Updated weights for policy 1, policy_version 574397 (0.0008) [2023-12-27 23:21:25,056][106225] Updated weights for policy 1, policy_version 574407 (0.0009) [2023-12-27 23:21:25,419][106226] Updated weights for policy 0, policy_version 572532 (0.0009) [2023-12-27 23:21:25,469][106226] Updated weights for policy 0, policy_version 572542 (0.0010) [2023-12-27 23:21:25,530][106226] Updated weights for policy 0, policy_version 572552 (0.0009) [2023-12-27 23:21:25,711][106225] Updated weights for policy 1, policy_version 574417 (0.0009) [2023-12-27 23:21:25,762][106225] Updated weights for policy 1, policy_version 574427 (0.0006) [2023-12-27 23:21:25,826][106225] Updated weights for policy 1, policy_version 574437 (0.0005) [2023-12-27 23:21:25,881][106225] Updated weights for policy 1, policy_version 574447 (0.0005) [2023-12-27 23:21:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 293699584. Throughput: 0: 9787.5, 1: 9743.1. Samples: 293667544. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:26,175][105115] Avg episode reward: [(0, '-5.073'), (1, '-5.225')] [2023-12-27 23:21:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000572560_146612224.pth... [2023-12-27 23:21:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000574448_147087360.pth... [2023-12-27 23:21:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000573296_146792448.pth [2023-12-27 23:21:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000571408_146317312.pth [2023-12-27 23:21:26,227][106226] Updated weights for policy 0, policy_version 572562 (0.0007) [2023-12-27 23:21:26,281][106226] Updated weights for policy 0, policy_version 572572 (0.0011) [2023-12-27 23:21:26,337][106226] Updated weights for policy 0, policy_version 572582 (0.0010) [2023-12-27 23:21:26,397][106226] Updated weights for policy 0, policy_version 572592 (0.0011) [2023-12-27 23:21:26,499][106225] Updated weights for policy 1, policy_version 574457 (0.0008) [2023-12-27 23:21:26,547][106225] Updated weights for policy 1, policy_version 574467 (0.0006) [2023-12-27 23:21:26,595][106225] Updated weights for policy 1, policy_version 574477 (0.0005) [2023-12-27 23:21:27,106][106226] Updated weights for policy 0, policy_version 572602 (0.0011) [2023-12-27 23:21:27,159][106225] Updated weights for policy 1, policy_version 574487 (0.0005) [2023-12-27 23:21:27,169][106226] Updated weights for policy 0, policy_version 572612 (0.0011) [2023-12-27 23:21:27,212][106225] Updated weights for policy 1, policy_version 574497 (0.0005) [2023-12-27 23:21:27,226][106226] Updated weights for policy 0, policy_version 572622 (0.0011) [2023-12-27 23:21:27,264][106225] Updated weights for policy 1, policy_version 574507 (0.0005) [2023-12-27 23:21:27,866][106226] Updated weights for policy 0, policy_version 572632 (0.0006) [2023-12-27 23:21:27,919][106226] Updated weights for policy 0, policy_version 572642 (0.0005) [2023-12-27 23:21:27,935][106225] Updated weights for policy 1, policy_version 574517 (0.0009) [2023-12-27 23:21:27,972][106226] Updated weights for policy 0, policy_version 572652 (0.0006) [2023-12-27 23:21:27,989][106225] Updated weights for policy 1, policy_version 574527 (0.0010) [2023-12-27 23:21:28,042][106225] Updated weights for policy 1, policy_version 574537 (0.0010) [2023-12-27 23:21:28,542][106226] Updated weights for policy 0, policy_version 572662 (0.0008) [2023-12-27 23:21:28,595][106226] Updated weights for policy 0, policy_version 572672 (0.0010) [2023-12-27 23:21:28,656][106226] Updated weights for policy 0, policy_version 572682 (0.0010) [2023-12-27 23:21:28,766][106225] Updated weights for policy 1, policy_version 574547 (0.0010) [2023-12-27 23:21:28,824][106225] Updated weights for policy 1, policy_version 574557 (0.0008) [2023-12-27 23:21:28,876][106225] Updated weights for policy 1, policy_version 574567 (0.0008) [2023-12-27 23:21:29,327][106226] Updated weights for policy 0, policy_version 572692 (0.0010) [2023-12-27 23:21:29,395][106226] Updated weights for policy 0, policy_version 572702 (0.0008) [2023-12-27 23:21:29,456][106226] Updated weights for policy 0, policy_version 572712 (0.0008) [2023-12-27 23:21:29,606][106225] Updated weights for policy 1, policy_version 574577 (0.0008) [2023-12-27 23:21:29,661][106225] Updated weights for policy 1, policy_version 574587 (0.0008) [2023-12-27 23:21:29,713][106225] Updated weights for policy 1, policy_version 574597 (0.0008) [2023-12-27 23:21:29,778][106225] Updated weights for policy 1, policy_version 574607 (0.0009) [2023-12-27 23:21:30,215][106226] Updated weights for policy 0, policy_version 572722 (0.0008) [2023-12-27 23:21:30,280][106226] Updated weights for policy 0, policy_version 572732 (0.0010) [2023-12-27 23:21:30,343][106226] Updated weights for policy 0, policy_version 572742 (0.0009) [2023-12-27 23:21:30,404][106226] Updated weights for policy 0, policy_version 572752 (0.0009) [2023-12-27 23:21:30,467][106225] Updated weights for policy 1, policy_version 574617 (0.0009) [2023-12-27 23:21:30,524][106225] Updated weights for policy 1, policy_version 574627 (0.0009) [2023-12-27 23:21:30,576][106225] Updated weights for policy 1, policy_version 574637 (0.0009) [2023-12-27 23:21:30,989][106226] Updated weights for policy 0, policy_version 572762 (0.0005) [2023-12-27 23:21:31,056][106226] Updated weights for policy 0, policy_version 572772 (0.0008) [2023-12-27 23:21:31,119][106226] Updated weights for policy 0, policy_version 572782 (0.0008) [2023-12-27 23:21:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 293806080. Throughput: 0: 9888.5, 1: 9857.4. Samples: 293793108. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:31,175][105115] Avg episode reward: [(0, '-5.141'), (1, '-5.813')] [2023-12-27 23:21:31,404][106225] Updated weights for policy 1, policy_version 574647 (0.0009) [2023-12-27 23:21:31,469][106225] Updated weights for policy 1, policy_version 574657 (0.0006) [2023-12-27 23:21:31,535][106225] Updated weights for policy 1, policy_version 574667 (0.0005) [2023-12-27 23:21:31,844][106226] Updated weights for policy 0, policy_version 572792 (0.0008) [2023-12-27 23:21:31,907][106226] Updated weights for policy 0, policy_version 572802 (0.0008) [2023-12-27 23:21:31,968][106226] Updated weights for policy 0, policy_version 572812 (0.0007) [2023-12-27 23:21:32,190][106225] Updated weights for policy 1, policy_version 574677 (0.0008) [2023-12-27 23:21:32,246][106225] Updated weights for policy 1, policy_version 574687 (0.0010) [2023-12-27 23:21:32,310][106225] Updated weights for policy 1, policy_version 574697 (0.0007) [2023-12-27 23:21:32,644][106226] Updated weights for policy 0, policy_version 572822 (0.0006) [2023-12-27 23:21:32,702][106226] Updated weights for policy 0, policy_version 572832 (0.0006) [2023-12-27 23:21:32,766][106226] Updated weights for policy 0, policy_version 572842 (0.0006) [2023-12-27 23:21:33,044][106225] Updated weights for policy 1, policy_version 574710 (0.0008) [2023-12-27 23:21:33,103][106225] Updated weights for policy 1, policy_version 574720 (0.0007) [2023-12-27 23:21:33,154][106225] Updated weights for policy 1, policy_version 574730 (0.0006) [2023-12-27 23:21:33,386][106226] Updated weights for policy 0, policy_version 572852 (0.0011) [2023-12-27 23:21:33,445][106226] Updated weights for policy 0, policy_version 572862 (0.0010) [2023-12-27 23:21:33,500][106226] Updated weights for policy 0, policy_version 572872 (0.0010) [2023-12-27 23:21:33,780][106225] Updated weights for policy 1, policy_version 574740 (0.0005) [2023-12-27 23:21:33,824][106225] Updated weights for policy 1, policy_version 574750 (0.0007) [2023-12-27 23:21:33,872][106225] Updated weights for policy 1, policy_version 574760 (0.0007) [2023-12-27 23:21:34,166][106226] Updated weights for policy 0, policy_version 572882 (0.0010) [2023-12-27 23:21:34,236][106226] Updated weights for policy 0, policy_version 572892 (0.0009) [2023-12-27 23:21:34,303][106226] Updated weights for policy 0, policy_version 572902 (0.0009) [2023-12-27 23:21:34,368][106226] Updated weights for policy 0, policy_version 572912 (0.0009) [2023-12-27 23:21:34,626][106225] Updated weights for policy 1, policy_version 574770 (0.0008) [2023-12-27 23:21:34,694][106225] Updated weights for policy 1, policy_version 574780 (0.0010) [2023-12-27 23:21:34,759][106225] Updated weights for policy 1, policy_version 574790 (0.0011) [2023-12-27 23:21:34,806][106225] Updated weights for policy 1, policy_version 574800 (0.0010) [2023-12-27 23:21:35,035][106226] Updated weights for policy 0, policy_version 572922 (0.0006) [2023-12-27 23:21:35,091][106226] Updated weights for policy 0, policy_version 572932 (0.0005) [2023-12-27 23:21:35,143][106226] Updated weights for policy 0, policy_version 572942 (0.0005) [2023-12-27 23:21:35,529][106225] Updated weights for policy 1, policy_version 574810 (0.0010) [2023-12-27 23:21:35,578][106225] Updated weights for policy 1, policy_version 574820 (0.0010) [2023-12-27 23:21:35,638][106225] Updated weights for policy 1, policy_version 574830 (0.0010) [2023-12-27 23:21:35,735][106226] Updated weights for policy 0, policy_version 572952 (0.0009) [2023-12-27 23:21:35,792][106226] Updated weights for policy 0, policy_version 572962 (0.0010) [2023-12-27 23:21:35,841][106226] Updated weights for policy 0, policy_version 572972 (0.0009) [2023-12-27 23:21:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 293904384. Throughput: 0: 9935.8, 1: 9886.2. Samples: 293913888. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:36,175][105115] Avg episode reward: [(0, '-4.876'), (1, '-5.788')] [2023-12-27 23:21:36,225][106225] Updated weights for policy 1, policy_version 574840 (0.0010) [2023-12-27 23:21:36,291][106225] Updated weights for policy 1, policy_version 574850 (0.0010) [2023-12-27 23:21:36,349][106225] Updated weights for policy 1, policy_version 574860 (0.0010) [2023-12-27 23:21:36,565][106226] Updated weights for policy 0, policy_version 572982 (0.0010) [2023-12-27 23:21:36,612][106226] Updated weights for policy 0, policy_version 572992 (0.0006) [2023-12-27 23:21:36,668][106226] Updated weights for policy 0, policy_version 573002 (0.0008) [2023-12-27 23:21:37,059][106225] Updated weights for policy 1, policy_version 574870 (0.0010) [2023-12-27 23:21:37,124][106225] Updated weights for policy 1, policy_version 574880 (0.0011) [2023-12-27 23:21:37,183][106225] Updated weights for policy 1, policy_version 574890 (0.0010) [2023-12-27 23:21:37,337][106226] Updated weights for policy 0, policy_version 573012 (0.0007) [2023-12-27 23:21:37,396][106226] Updated weights for policy 0, policy_version 573022 (0.0008) [2023-12-27 23:21:37,451][106226] Updated weights for policy 0, policy_version 573032 (0.0007) [2023-12-27 23:21:37,810][106225] Updated weights for policy 1, policy_version 574900 (0.0011) [2023-12-27 23:21:37,861][106225] Updated weights for policy 1, policy_version 574910 (0.0010) [2023-12-27 23:21:37,923][106225] Updated weights for policy 1, policy_version 574920 (0.0008) [2023-12-27 23:21:38,057][106226] Updated weights for policy 0, policy_version 573042 (0.0006) [2023-12-27 23:21:38,114][106226] Updated weights for policy 0, policy_version 573052 (0.0009) [2023-12-27 23:21:38,162][106226] Updated weights for policy 0, policy_version 573062 (0.0008) [2023-12-27 23:21:38,518][106225] Updated weights for policy 1, policy_version 574930 (0.0006) [2023-12-27 23:21:38,578][106225] Updated weights for policy 1, policy_version 574940 (0.0010) [2023-12-27 23:21:38,635][106225] Updated weights for policy 1, policy_version 574950 (0.0010) [2023-12-27 23:21:38,696][106225] Updated weights for policy 1, policy_version 574960 (0.0009) [2023-12-27 23:21:38,957][106226] Updated weights for policy 0, policy_version 573073 (0.0009) [2023-12-27 23:21:39,012][106226] Updated weights for policy 0, policy_version 573083 (0.0009) [2023-12-27 23:21:39,070][106226] Updated weights for policy 0, policy_version 573093 (0.0008) [2023-12-27 23:21:39,133][106226] Updated weights for policy 0, policy_version 573103 (0.0007) [2023-12-27 23:21:39,299][106225] Updated weights for policy 1, policy_version 574970 (0.0008) [2023-12-27 23:21:39,367][106225] Updated weights for policy 1, policy_version 574980 (0.0009) [2023-12-27 23:21:39,440][106225] Updated weights for policy 1, policy_version 574990 (0.0009) [2023-12-27 23:21:39,961][106226] Updated weights for policy 0, policy_version 573113 (0.0008) [2023-12-27 23:21:40,019][106226] Updated weights for policy 0, policy_version 573123 (0.0008) [2023-12-27 23:21:40,080][106226] Updated weights for policy 0, policy_version 573133 (0.0009) [2023-12-27 23:21:40,124][106225] Updated weights for policy 1, policy_version 575000 (0.0010) [2023-12-27 23:21:40,182][106225] Updated weights for policy 1, policy_version 575010 (0.0010) [2023-12-27 23:21:40,244][106225] Updated weights for policy 1, policy_version 575020 (0.0010) [2023-12-27 23:21:40,783][106226] Updated weights for policy 0, policy_version 573143 (0.0007) [2023-12-27 23:21:40,838][106226] Updated weights for policy 0, policy_version 573153 (0.0008) [2023-12-27 23:21:40,888][106226] Updated weights for policy 0, policy_version 573163 (0.0007) [2023-12-27 23:21:40,899][106225] Updated weights for policy 1, policy_version 575030 (0.0010) [2023-12-27 23:21:40,960][106225] Updated weights for policy 1, policy_version 575040 (0.0010) [2023-12-27 23:21:41,027][106225] Updated weights for policy 1, policy_version 575050 (0.0010) [2023-12-27 23:21:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 294010880. Throughput: 0: 10006.7, 1: 9938.3. Samples: 293976236. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:21:41,175][105115] Avg episode reward: [(0, '-5.063'), (1, '-5.612')] [2023-12-27 23:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000573168_146767872.pth... [2023-12-27 23:21:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000575056_147243008.pth... [2023-12-27 23:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000571984_146464768.pth [2023-12-27 23:21:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000573872_146939904.pth [2023-12-27 23:21:41,613][106226] Updated weights for policy 0, policy_version 573173 (0.0010) [2023-12-27 23:21:41,683][106226] Updated weights for policy 0, policy_version 573183 (0.0007) [2023-12-27 23:21:41,756][106226] Updated weights for policy 0, policy_version 573193 (0.0007) [2023-12-27 23:21:41,826][106225] Updated weights for policy 1, policy_version 575060 (0.0008) [2023-12-27 23:21:41,888][106225] Updated weights for policy 1, policy_version 575070 (0.0008) [2023-12-27 23:21:41,947][106225] Updated weights for policy 1, policy_version 575080 (0.0009) [2023-12-27 23:21:42,418][106226] Updated weights for policy 0, policy_version 573203 (0.0008) [2023-12-27 23:21:42,482][106226] Updated weights for policy 0, policy_version 573213 (0.0008) [2023-12-27 23:21:42,545][106226] Updated weights for policy 0, policy_version 573223 (0.0006) [2023-12-27 23:21:42,690][106225] Updated weights for policy 1, policy_version 575090 (0.0009) [2023-12-27 23:21:42,755][106225] Updated weights for policy 1, policy_version 575100 (0.0009) [2023-12-27 23:21:42,812][106225] Updated weights for policy 1, policy_version 575110 (0.0007) [2023-12-27 23:21:42,874][106225] Updated weights for policy 1, policy_version 575120 (0.0007) [2023-12-27 23:21:43,198][106226] Updated weights for policy 0, policy_version 573233 (0.0005) [2023-12-27 23:21:43,262][106226] Updated weights for policy 0, policy_version 573243 (0.0005) [2023-12-27 23:21:43,317][106226] Updated weights for policy 0, policy_version 573253 (0.0006) [2023-12-27 23:21:43,373][106226] Updated weights for policy 0, policy_version 573263 (0.0008) [2023-12-27 23:21:43,573][106225] Updated weights for policy 1, policy_version 575130 (0.0005) [2023-12-27 23:21:43,616][106225] Updated weights for policy 1, policy_version 575140 (0.0005) [2023-12-27 23:21:43,659][106225] Updated weights for policy 1, policy_version 575150 (0.0005) [2023-12-27 23:21:44,093][106226] Updated weights for policy 0, policy_version 573273 (0.0008) [2023-12-27 23:21:44,149][106226] Updated weights for policy 0, policy_version 573283 (0.0008) [2023-12-27 23:21:44,214][106226] Updated weights for policy 0, policy_version 573293 (0.0008) [2023-12-27 23:21:44,315][106225] Updated weights for policy 1, policy_version 575160 (0.0005) [2023-12-27 23:21:44,374][106225] Updated weights for policy 1, policy_version 575170 (0.0006) [2023-12-27 23:21:44,440][106225] Updated weights for policy 1, policy_version 575180 (0.0010) [2023-12-27 23:21:44,906][106226] Updated weights for policy 0, policy_version 573303 (0.0009) [2023-12-27 23:21:44,974][106226] Updated weights for policy 0, policy_version 573313 (0.0008) [2023-12-27 23:21:45,037][106226] Updated weights for policy 0, policy_version 573323 (0.0007) [2023-12-27 23:21:45,187][106225] Updated weights for policy 1, policy_version 575190 (0.0010) [2023-12-27 23:21:45,256][106225] Updated weights for policy 1, policy_version 575200 (0.0011) [2023-12-27 23:21:45,311][106225] Updated weights for policy 1, policy_version 575210 (0.0008) [2023-12-27 23:21:45,733][106226] Updated weights for policy 0, policy_version 573333 (0.0008) [2023-12-27 23:21:45,780][106226] Updated weights for policy 0, policy_version 573343 (0.0008) [2023-12-27 23:21:45,828][106226] Updated weights for policy 0, policy_version 573353 (0.0009) [2023-12-27 23:21:45,904][106225] Updated weights for policy 1, policy_version 575220 (0.0005) [2023-12-27 23:21:45,964][106225] Updated weights for policy 1, policy_version 575230 (0.0005) [2023-12-27 23:21:46,029][106225] Updated weights for policy 1, policy_version 575240 (0.0008) [2023-12-27 23:21:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 294109184. Throughput: 0: 9975.8, 1: 9941.4. Samples: 294094780. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:21:46,175][105115] Avg episode reward: [(0, '-5.097'), (1, '-5.901')] [2023-12-27 23:21:46,568][106226] Updated weights for policy 0, policy_version 573363 (0.0008) [2023-12-27 23:21:46,631][106226] Updated weights for policy 0, policy_version 573373 (0.0005) [2023-12-27 23:21:46,664][106225] Updated weights for policy 1, policy_version 575250 (0.0009) [2023-12-27 23:21:46,697][106226] Updated weights for policy 0, policy_version 573383 (0.0005) [2023-12-27 23:21:46,726][106225] Updated weights for policy 1, policy_version 575260 (0.0006) [2023-12-27 23:21:46,783][106225] Updated weights for policy 1, policy_version 575270 (0.0005) [2023-12-27 23:21:46,842][106225] Updated weights for policy 1, policy_version 575280 (0.0006) [2023-12-27 23:21:47,343][106226] Updated weights for policy 0, policy_version 573393 (0.0006) [2023-12-27 23:21:47,412][106226] Updated weights for policy 0, policy_version 573403 (0.0009) [2023-12-27 23:21:47,416][106225] Updated weights for policy 1, policy_version 575290 (0.0006) [2023-12-27 23:21:47,474][106226] Updated weights for policy 0, policy_version 573413 (0.0008) [2023-12-27 23:21:47,477][106225] Updated weights for policy 1, policy_version 575300 (0.0007) [2023-12-27 23:21:47,538][106226] Updated weights for policy 0, policy_version 573423 (0.0008) [2023-12-27 23:21:47,541][106225] Updated weights for policy 1, policy_version 575310 (0.0007) [2023-12-27 23:21:48,142][106225] Updated weights for policy 1, policy_version 575320 (0.0008) [2023-12-27 23:21:48,189][106225] Updated weights for policy 1, policy_version 575330 (0.0010) [2023-12-27 23:21:48,246][106225] Updated weights for policy 1, policy_version 575340 (0.0010) [2023-12-27 23:21:48,364][106226] Updated weights for policy 0, policy_version 573433 (0.0008) [2023-12-27 23:21:48,427][106226] Updated weights for policy 0, policy_version 573443 (0.0009) [2023-12-27 23:21:48,487][106226] Updated weights for policy 0, policy_version 573453 (0.0009) [2023-12-27 23:21:48,984][106225] Updated weights for policy 1, policy_version 575350 (0.0009) [2023-12-27 23:21:49,042][106225] Updated weights for policy 1, policy_version 575360 (0.0008) [2023-12-27 23:21:49,093][106225] Updated weights for policy 1, policy_version 575370 (0.0005) [2023-12-27 23:21:49,210][106226] Updated weights for policy 0, policy_version 573463 (0.0008) [2023-12-27 23:21:49,276][106226] Updated weights for policy 0, policy_version 573473 (0.0009) [2023-12-27 23:21:49,350][106226] Updated weights for policy 0, policy_version 573483 (0.0007) [2023-12-27 23:21:49,784][106225] Updated weights for policy 1, policy_version 575380 (0.0006) [2023-12-27 23:21:49,836][106225] Updated weights for policy 1, policy_version 575390 (0.0007) [2023-12-27 23:21:49,902][106225] Updated weights for policy 1, policy_version 575400 (0.0008) [2023-12-27 23:21:50,080][106226] Updated weights for policy 0, policy_version 573493 (0.0009) [2023-12-27 23:21:50,145][106226] Updated weights for policy 0, policy_version 573503 (0.0011) [2023-12-27 23:21:50,210][106226] Updated weights for policy 0, policy_version 573513 (0.0011) [2023-12-27 23:21:50,644][106225] Updated weights for policy 1, policy_version 575410 (0.0007) [2023-12-27 23:21:50,702][106225] Updated weights for policy 1, policy_version 575420 (0.0006) [2023-12-27 23:21:50,753][106225] Updated weights for policy 1, policy_version 575430 (0.0008) [2023-12-27 23:21:50,798][106225] Updated weights for policy 1, policy_version 575440 (0.0008) [2023-12-27 23:21:50,915][106226] Updated weights for policy 0, policy_version 573523 (0.0011) [2023-12-27 23:21:50,975][106226] Updated weights for policy 0, policy_version 573533 (0.0006) [2023-12-27 23:21:51,045][106226] Updated weights for policy 0, policy_version 573543 (0.0007) [2023-12-27 23:21:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 294207488. Throughput: 0: 10005.6, 1: 9962.3. Samples: 294213620. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:21:51,175][105115] Avg episode reward: [(0, '-5.295'), (1, '-5.476')] [2023-12-27 23:21:51,633][106225] Updated weights for policy 1, policy_version 575450 (0.0009) [2023-12-27 23:21:51,695][106225] Updated weights for policy 1, policy_version 575460 (0.0008) [2023-12-27 23:21:51,702][106226] Updated weights for policy 0, policy_version 573553 (0.0008) [2023-12-27 23:21:51,763][106225] Updated weights for policy 1, policy_version 575470 (0.0008) [2023-12-27 23:21:51,772][106226] Updated weights for policy 0, policy_version 573563 (0.0007) [2023-12-27 23:21:51,834][106226] Updated weights for policy 0, policy_version 573573 (0.0008) [2023-12-27 23:21:51,894][106226] Updated weights for policy 0, policy_version 573583 (0.0008) [2023-12-27 23:21:52,474][106225] Updated weights for policy 1, policy_version 575480 (0.0008) [2023-12-27 23:21:52,529][106225] Updated weights for policy 1, policy_version 575490 (0.0009) [2023-12-27 23:21:52,588][106225] Updated weights for policy 1, policy_version 575500 (0.0008) [2023-12-27 23:21:52,655][106226] Updated weights for policy 0, policy_version 573593 (0.0007) [2023-12-27 23:21:52,716][106226] Updated weights for policy 0, policy_version 573603 (0.0008) [2023-12-27 23:21:52,778][106226] Updated weights for policy 0, policy_version 573613 (0.0007) [2023-12-27 23:21:53,218][106225] Updated weights for policy 1, policy_version 575510 (0.0007) [2023-12-27 23:21:53,276][106225] Updated weights for policy 1, policy_version 575520 (0.0006) [2023-12-27 23:21:53,340][106225] Updated weights for policy 1, policy_version 575530 (0.0005) [2023-12-27 23:21:53,436][106226] Updated weights for policy 0, policy_version 573623 (0.0008) [2023-12-27 23:21:53,486][106226] Updated weights for policy 0, policy_version 573633 (0.0009) [2023-12-27 23:21:53,537][106226] Updated weights for policy 0, policy_version 573643 (0.0009) [2023-12-27 23:21:53,943][106225] Updated weights for policy 1, policy_version 575540 (0.0007) [2023-12-27 23:21:53,994][106225] Updated weights for policy 1, policy_version 575550 (0.0008) [2023-12-27 23:21:54,041][106225] Updated weights for policy 1, policy_version 575560 (0.0008) [2023-12-27 23:21:54,322][106226] Updated weights for policy 0, policy_version 573653 (0.0008) [2023-12-27 23:21:54,370][106226] Updated weights for policy 0, policy_version 573663 (0.0008) [2023-12-27 23:21:54,427][106226] Updated weights for policy 0, policy_version 573673 (0.0005) [2023-12-27 23:21:54,671][106225] Updated weights for policy 1, policy_version 575570 (0.0007) [2023-12-27 23:21:54,735][106225] Updated weights for policy 1, policy_version 575580 (0.0007) [2023-12-27 23:21:54,797][106225] Updated weights for policy 1, policy_version 575590 (0.0010) [2023-12-27 23:21:54,858][106225] Updated weights for policy 1, policy_version 575600 (0.0007) [2023-12-27 23:21:55,079][106226] Updated weights for policy 0, policy_version 573683 (0.0009) [2023-12-27 23:21:55,149][106226] Updated weights for policy 0, policy_version 573693 (0.0009) [2023-12-27 23:21:55,219][106226] Updated weights for policy 0, policy_version 573703 (0.0009) [2023-12-27 23:21:55,501][106225] Updated weights for policy 1, policy_version 575610 (0.0007) [2023-12-27 23:21:55,549][106225] Updated weights for policy 1, policy_version 575620 (0.0008) [2023-12-27 23:21:55,604][106225] Updated weights for policy 1, policy_version 575630 (0.0008) [2023-12-27 23:21:55,911][106226] Updated weights for policy 0, policy_version 573713 (0.0008) [2023-12-27 23:21:55,972][106226] Updated weights for policy 0, policy_version 573723 (0.0005) [2023-12-27 23:21:56,030][106226] Updated weights for policy 0, policy_version 573733 (0.0006) [2023-12-27 23:21:56,091][106226] Updated weights for policy 0, policy_version 573743 (0.0007) [2023-12-27 23:21:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294305792. Throughput: 0: 9933.4, 1: 9950.8. Samples: 294272488. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:21:56,175][105115] Avg episode reward: [(0, '-5.082'), (1, '-5.723')] [2023-12-27 23:21:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000575632_147390464.pth... [2023-12-27 23:21:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000573744_146915328.pth... [2023-12-27 23:21:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000574448_147087360.pth [2023-12-27 23:21:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000572560_146612224.pth [2023-12-27 23:21:56,336][106225] Updated weights for policy 1, policy_version 575640 (0.0009) [2023-12-27 23:21:56,383][106225] Updated weights for policy 1, policy_version 575650 (0.0007) [2023-12-27 23:21:56,442][106225] Updated weights for policy 1, policy_version 575660 (0.0006) [2023-12-27 23:21:56,770][106226] Updated weights for policy 0, policy_version 573753 (0.0008) [2023-12-27 23:21:56,818][106226] Updated weights for policy 0, policy_version 573763 (0.0008) [2023-12-27 23:21:56,867][106226] Updated weights for policy 0, policy_version 573773 (0.0008) [2023-12-27 23:21:57,127][106225] Updated weights for policy 1, policy_version 575670 (0.0009) [2023-12-27 23:21:57,185][106225] Updated weights for policy 1, policy_version 575680 (0.0009) [2023-12-27 23:21:57,232][106225] Updated weights for policy 1, policy_version 575690 (0.0008) [2023-12-27 23:21:57,616][106226] Updated weights for policy 0, policy_version 573783 (0.0008) [2023-12-27 23:21:57,661][106226] Updated weights for policy 0, policy_version 573793 (0.0008) [2023-12-27 23:21:57,709][106226] Updated weights for policy 0, policy_version 573803 (0.0008) [2023-12-27 23:21:57,929][106225] Updated weights for policy 1, policy_version 575700 (0.0008) [2023-12-27 23:21:57,987][106225] Updated weights for policy 1, policy_version 575710 (0.0005) [2023-12-27 23:21:58,042][106225] Updated weights for policy 1, policy_version 575720 (0.0005) [2023-12-27 23:21:58,531][106226] Updated weights for policy 0, policy_version 573813 (0.0009) [2023-12-27 23:21:58,599][106226] Updated weights for policy 0, policy_version 573823 (0.0009) [2023-12-27 23:21:58,661][106226] Updated weights for policy 0, policy_version 573833 (0.0009) [2023-12-27 23:21:58,745][106225] Updated weights for policy 1, policy_version 575730 (0.0006) [2023-12-27 23:21:58,815][106225] Updated weights for policy 1, policy_version 575740 (0.0007) [2023-12-27 23:21:58,878][106225] Updated weights for policy 1, policy_version 575750 (0.0006) [2023-12-27 23:21:58,944][106225] Updated weights for policy 1, policy_version 575760 (0.0006) [2023-12-27 23:21:59,437][106226] Updated weights for policy 0, policy_version 573843 (0.0009) [2023-12-27 23:21:59,489][106226] Updated weights for policy 0, policy_version 573853 (0.0008) [2023-12-27 23:21:59,547][106226] Updated weights for policy 0, policy_version 573863 (0.0008) [2023-12-27 23:21:59,679][106225] Updated weights for policy 1, policy_version 575770 (0.0010) [2023-12-27 23:21:59,732][106225] Updated weights for policy 1, policy_version 575780 (0.0008) [2023-12-27 23:21:59,787][106225] Updated weights for policy 1, policy_version 575790 (0.0009) [2023-12-27 23:22:00,170][106226] Updated weights for policy 0, policy_version 573873 (0.0005) [2023-12-27 23:22:00,235][106226] Updated weights for policy 0, policy_version 573883 (0.0008) [2023-12-27 23:22:00,285][106226] Updated weights for policy 0, policy_version 573893 (0.0007) [2023-12-27 23:22:00,336][106226] Updated weights for policy 0, policy_version 573903 (0.0005) [2023-12-27 23:22:00,571][106225] Updated weights for policy 1, policy_version 575800 (0.0008) [2023-12-27 23:22:00,627][106225] Updated weights for policy 1, policy_version 575810 (0.0009) [2023-12-27 23:22:00,686][106225] Updated weights for policy 1, policy_version 575820 (0.0008) [2023-12-27 23:22:01,002][106226] Updated weights for policy 0, policy_version 573913 (0.0008) [2023-12-27 23:22:01,068][106226] Updated weights for policy 0, policy_version 573923 (0.0008) [2023-12-27 23:22:01,141][106226] Updated weights for policy 0, policy_version 573933 (0.0008) [2023-12-27 23:22:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294404096. Throughput: 0: 9927.5, 1: 10012.5. Samples: 294390888. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:01,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.896')] [2023-12-27 23:22:01,437][106225] Updated weights for policy 1, policy_version 575830 (0.0007) [2023-12-27 23:22:01,482][106225] Updated weights for policy 1, policy_version 575840 (0.0006) [2023-12-27 23:22:01,533][106225] Updated weights for policy 1, policy_version 575850 (0.0005) [2023-12-27 23:22:01,904][106226] Updated weights for policy 0, policy_version 573943 (0.0007) [2023-12-27 23:22:01,969][106226] Updated weights for policy 0, policy_version 573953 (0.0008) [2023-12-27 23:22:02,037][106226] Updated weights for policy 0, policy_version 573963 (0.0007) [2023-12-27 23:22:02,214][106225] Updated weights for policy 1, policy_version 575860 (0.0007) [2023-12-27 23:22:02,270][106225] Updated weights for policy 1, policy_version 575870 (0.0009) [2023-12-27 23:22:02,322][106225] Updated weights for policy 1, policy_version 575880 (0.0008) [2023-12-27 23:22:02,751][106226] Updated weights for policy 0, policy_version 573973 (0.0008) [2023-12-27 23:22:02,806][106226] Updated weights for policy 0, policy_version 573983 (0.0010) [2023-12-27 23:22:02,868][106226] Updated weights for policy 0, policy_version 573993 (0.0008) [2023-12-27 23:22:02,963][106225] Updated weights for policy 1, policy_version 575890 (0.0008) [2023-12-27 23:22:03,011][106225] Updated weights for policy 1, policy_version 575900 (0.0008) [2023-12-27 23:22:03,068][106225] Updated weights for policy 1, policy_version 575910 (0.0008) [2023-12-27 23:22:03,125][106225] Updated weights for policy 1, policy_version 575920 (0.0005) [2023-12-27 23:22:03,672][106225] Updated weights for policy 1, policy_version 575930 (0.0005) [2023-12-27 23:22:03,681][106226] Updated weights for policy 0, policy_version 574003 (0.0009) [2023-12-27 23:22:03,722][106225] Updated weights for policy 1, policy_version 575940 (0.0005) [2023-12-27 23:22:03,733][106226] Updated weights for policy 0, policy_version 574013 (0.0008) [2023-12-27 23:22:03,773][106225] Updated weights for policy 1, policy_version 575950 (0.0005) [2023-12-27 23:22:03,778][106226] Updated weights for policy 0, policy_version 574023 (0.0008) [2023-12-27 23:22:04,430][106225] Updated weights for policy 1, policy_version 575960 (0.0007) [2023-12-27 23:22:04,480][106225] Updated weights for policy 1, policy_version 575970 (0.0008) [2023-12-27 23:22:04,530][106225] Updated weights for policy 1, policy_version 575980 (0.0008) [2023-12-27 23:22:04,555][106226] Updated weights for policy 0, policy_version 574033 (0.0010) [2023-12-27 23:22:04,613][106226] Updated weights for policy 0, policy_version 574043 (0.0008) [2023-12-27 23:22:04,681][106226] Updated weights for policy 0, policy_version 574053 (0.0008) [2023-12-27 23:22:04,738][106226] Updated weights for policy 0, policy_version 574063 (0.0006) [2023-12-27 23:22:05,175][106225] Updated weights for policy 1, policy_version 575990 (0.0008) [2023-12-27 23:22:05,230][106225] Updated weights for policy 1, policy_version 576000 (0.0006) [2023-12-27 23:22:05,278][106225] Updated weights for policy 1, policy_version 576010 (0.0005) [2023-12-27 23:22:05,346][106226] Updated weights for policy 0, policy_version 574073 (0.0008) [2023-12-27 23:22:05,400][106226] Updated weights for policy 0, policy_version 574083 (0.0010) [2023-12-27 23:22:05,450][106226] Updated weights for policy 0, policy_version 574093 (0.0010) [2023-12-27 23:22:05,875][106225] Updated weights for policy 1, policy_version 576020 (0.0005) [2023-12-27 23:22:05,924][106225] Updated weights for policy 1, policy_version 576030 (0.0005) [2023-12-27 23:22:05,985][106225] Updated weights for policy 1, policy_version 576040 (0.0006) [2023-12-27 23:22:06,173][106226] Updated weights for policy 0, policy_version 574103 (0.0009) [2023-12-27 23:22:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294502400. Throughput: 0: 9903.1, 1: 10139.0. Samples: 294511612. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:06,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-5.649')] [2023-12-27 23:22:06,235][106226] Updated weights for policy 0, policy_version 574113 (0.0009) [2023-12-27 23:22:06,286][106226] Updated weights for policy 0, policy_version 574123 (0.0007) [2023-12-27 23:22:06,624][106225] Updated weights for policy 1, policy_version 576050 (0.0008) [2023-12-27 23:22:06,683][106225] Updated weights for policy 1, policy_version 576060 (0.0006) [2023-12-27 23:22:06,748][106225] Updated weights for policy 1, policy_version 576070 (0.0005) [2023-12-27 23:22:06,818][106225] Updated weights for policy 1, policy_version 576080 (0.0005) [2023-12-27 23:22:07,100][106226] Updated weights for policy 0, policy_version 574133 (0.0007) [2023-12-27 23:22:07,163][106226] Updated weights for policy 0, policy_version 574143 (0.0010) [2023-12-27 23:22:07,220][106226] Updated weights for policy 0, policy_version 574153 (0.0009) [2023-12-27 23:22:07,324][106225] Updated weights for policy 1, policy_version 576090 (0.0008) [2023-12-27 23:22:07,388][106225] Updated weights for policy 1, policy_version 576100 (0.0008) [2023-12-27 23:22:07,438][106225] Updated weights for policy 1, policy_version 576110 (0.0009) [2023-12-27 23:22:07,962][106226] Updated weights for policy 0, policy_version 574163 (0.0008) [2023-12-27 23:22:08,027][106226] Updated weights for policy 0, policy_version 574173 (0.0006) [2023-12-27 23:22:08,088][106226] Updated weights for policy 0, policy_version 574183 (0.0006) [2023-12-27 23:22:08,125][106225] Updated weights for policy 1, policy_version 576120 (0.0008) [2023-12-27 23:22:08,179][106225] Updated weights for policy 1, policy_version 576130 (0.0005) [2023-12-27 23:22:08,232][106225] Updated weights for policy 1, policy_version 576140 (0.0006) [2023-12-27 23:22:08,782][106226] Updated weights for policy 0, policy_version 574193 (0.0007) [2023-12-27 23:22:08,843][106226] Updated weights for policy 0, policy_version 574203 (0.0008) [2023-12-27 23:22:08,908][106226] Updated weights for policy 0, policy_version 574213 (0.0007) [2023-12-27 23:22:08,960][106225] Updated weights for policy 1, policy_version 576150 (0.0008) [2023-12-27 23:22:08,960][106226] Updated weights for policy 0, policy_version 574223 (0.0005) [2023-12-27 23:22:09,018][106225] Updated weights for policy 1, policy_version 576160 (0.0009) [2023-12-27 23:22:09,079][106225] Updated weights for policy 1, policy_version 576170 (0.0005) [2023-12-27 23:22:09,661][106226] Updated weights for policy 0, policy_version 574233 (0.0008) [2023-12-27 23:22:09,715][106226] Updated weights for policy 0, policy_version 574243 (0.0009) [2023-12-27 23:22:09,775][106226] Updated weights for policy 0, policy_version 574253 (0.0008) [2023-12-27 23:22:09,847][106225] Updated weights for policy 1, policy_version 576180 (0.0006) [2023-12-27 23:22:09,906][106225] Updated weights for policy 1, policy_version 576190 (0.0009) [2023-12-27 23:22:09,971][106225] Updated weights for policy 1, policy_version 576200 (0.0009) [2023-12-27 23:22:10,545][106226] Updated weights for policy 0, policy_version 574263 (0.0007) [2023-12-27 23:22:10,613][106226] Updated weights for policy 0, policy_version 574273 (0.0009) [2023-12-27 23:22:10,683][106226] Updated weights for policy 0, policy_version 574283 (0.0005) [2023-12-27 23:22:10,703][106225] Updated weights for policy 1, policy_version 576210 (0.0008) [2023-12-27 23:22:10,775][106225] Updated weights for policy 1, policy_version 576220 (0.0005) [2023-12-27 23:22:10,833][106225] Updated weights for policy 1, policy_version 576230 (0.0006) [2023-12-27 23:22:10,892][106225] Updated weights for policy 1, policy_version 576240 (0.0008) [2023-12-27 23:22:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294600704. Throughput: 0: 9856.3, 1: 10245.6. Samples: 294572132. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:11,175][105115] Avg episode reward: [(0, '-5.120'), (1, '-5.632')] [2023-12-27 23:22:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000576240_147546112.pth... [2023-12-27 23:22:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000574288_147054592.pth... [2023-12-27 23:22:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000575056_147243008.pth [2023-12-27 23:22:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000573168_146767872.pth [2023-12-27 23:22:11,318][106226] Updated weights for policy 0, policy_version 574293 (0.0008) [2023-12-27 23:22:11,394][106226] Updated weights for policy 0, policy_version 574303 (0.0008) [2023-12-27 23:22:11,458][106226] Updated weights for policy 0, policy_version 574313 (0.0008) [2023-12-27 23:22:11,637][106225] Updated weights for policy 1, policy_version 576250 (0.0009) [2023-12-27 23:22:11,701][106225] Updated weights for policy 1, policy_version 576260 (0.0006) [2023-12-27 23:22:11,767][106225] Updated weights for policy 1, policy_version 576270 (0.0008) [2023-12-27 23:22:12,252][106226] Updated weights for policy 0, policy_version 574323 (0.0008) [2023-12-27 23:22:12,319][106226] Updated weights for policy 0, policy_version 574333 (0.0006) [2023-12-27 23:22:12,384][106226] Updated weights for policy 0, policy_version 574343 (0.0009) [2023-12-27 23:22:12,521][106225] Updated weights for policy 1, policy_version 576280 (0.0008) [2023-12-27 23:22:12,578][106225] Updated weights for policy 1, policy_version 576290 (0.0008) [2023-12-27 23:22:12,629][106225] Updated weights for policy 1, policy_version 576300 (0.0007) [2023-12-27 23:22:13,084][106226] Updated weights for policy 0, policy_version 574353 (0.0011) [2023-12-27 23:22:13,138][106226] Updated weights for policy 0, policy_version 574363 (0.0011) [2023-12-27 23:22:13,185][106226] Updated weights for policy 0, policy_version 574373 (0.0010) [2023-12-27 23:22:13,246][106226] Updated weights for policy 0, policy_version 574383 (0.0011) [2023-12-27 23:22:13,359][106225] Updated weights for policy 1, policy_version 576310 (0.0007) [2023-12-27 23:22:13,414][106225] Updated weights for policy 1, policy_version 576320 (0.0006) [2023-12-27 23:22:13,474][106225] Updated weights for policy 1, policy_version 576330 (0.0010) [2023-12-27 23:22:13,983][106226] Updated weights for policy 0, policy_version 574393 (0.0010) [2023-12-27 23:22:14,044][106226] Updated weights for policy 0, policy_version 574403 (0.0009) [2023-12-27 23:22:14,062][106225] Updated weights for policy 1, policy_version 576340 (0.0007) [2023-12-27 23:22:14,102][106226] Updated weights for policy 0, policy_version 574413 (0.0010) [2023-12-27 23:22:14,108][106225] Updated weights for policy 1, policy_version 576350 (0.0010) [2023-12-27 23:22:14,169][106225] Updated weights for policy 1, policy_version 576360 (0.0010) [2023-12-27 23:22:14,801][106226] Updated weights for policy 0, policy_version 574423 (0.0010) [2023-12-27 23:22:14,859][106225] Updated weights for policy 1, policy_version 576370 (0.0010) [2023-12-27 23:22:14,861][106226] Updated weights for policy 0, policy_version 574433 (0.0007) [2023-12-27 23:22:14,920][106225] Updated weights for policy 1, policy_version 576380 (0.0010) [2023-12-27 23:22:14,928][106226] Updated weights for policy 0, policy_version 574443 (0.0006) [2023-12-27 23:22:14,987][106225] Updated weights for policy 1, policy_version 576390 (0.0009) [2023-12-27 23:22:15,048][106225] Updated weights for policy 1, policy_version 576400 (0.0009) [2023-12-27 23:22:15,505][106226] Updated weights for policy 0, policy_version 574453 (0.0009) [2023-12-27 23:22:15,564][106226] Updated weights for policy 0, policy_version 574463 (0.0007) [2023-12-27 23:22:15,616][106226] Updated weights for policy 0, policy_version 574473 (0.0005) [2023-12-27 23:22:15,691][106225] Updated weights for policy 1, policy_version 576410 (0.0010) [2023-12-27 23:22:15,745][106225] Updated weights for policy 1, policy_version 576420 (0.0010) [2023-12-27 23:22:15,799][106225] Updated weights for policy 1, policy_version 576430 (0.0010) [2023-12-27 23:22:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294699008. Throughput: 0: 9759.0, 1: 10142.0. Samples: 294688652. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:16,175][105115] Avg episode reward: [(0, '-5.140'), (1, '-5.647')] [2023-12-27 23:22:16,194][106226] Updated weights for policy 0, policy_version 574483 (0.0005) [2023-12-27 23:22:16,259][106226] Updated weights for policy 0, policy_version 574493 (0.0006) [2023-12-27 23:22:16,319][106226] Updated weights for policy 0, policy_version 574503 (0.0005) [2023-12-27 23:22:16,407][106225] Updated weights for policy 1, policy_version 576440 (0.0006) [2023-12-27 23:22:16,457][106225] Updated weights for policy 1, policy_version 576450 (0.0006) [2023-12-27 23:22:16,512][106225] Updated weights for policy 1, policy_version 576460 (0.0008) [2023-12-27 23:22:16,915][106226] Updated weights for policy 0, policy_version 574513 (0.0006) [2023-12-27 23:22:16,981][106226] Updated weights for policy 0, policy_version 574523 (0.0009) [2023-12-27 23:22:17,048][106226] Updated weights for policy 0, policy_version 574533 (0.0009) [2023-12-27 23:22:17,098][106225] Updated weights for policy 1, policy_version 576470 (0.0007) [2023-12-27 23:22:17,112][106226] Updated weights for policy 0, policy_version 574543 (0.0010) [2023-12-27 23:22:17,154][106225] Updated weights for policy 1, policy_version 576480 (0.0005) [2023-12-27 23:22:17,213][106225] Updated weights for policy 1, policy_version 576490 (0.0005) [2023-12-27 23:22:17,803][106225] Updated weights for policy 1, policy_version 576500 (0.0007) [2023-12-27 23:22:17,855][106225] Updated weights for policy 1, policy_version 576510 (0.0008) [2023-12-27 23:22:17,922][106226] Updated weights for policy 0, policy_version 574553 (0.0007) [2023-12-27 23:22:17,925][106225] Updated weights for policy 1, policy_version 576520 (0.0009) [2023-12-27 23:22:17,986][106226] Updated weights for policy 0, policy_version 574563 (0.0009) [2023-12-27 23:22:18,047][106226] Updated weights for policy 0, policy_version 574573 (0.0008) [2023-12-27 23:22:18,714][106225] Updated weights for policy 1, policy_version 576530 (0.0009) [2023-12-27 23:22:18,760][106226] Updated weights for policy 0, policy_version 574583 (0.0007) [2023-12-27 23:22:18,767][106225] Updated weights for policy 1, policy_version 576540 (0.0007) [2023-12-27 23:22:18,816][106225] Updated weights for policy 1, policy_version 576550 (0.0007) [2023-12-27 23:22:18,822][106226] Updated weights for policy 0, policy_version 574593 (0.0007) [2023-12-27 23:22:18,870][106225] Updated weights for policy 1, policy_version 576560 (0.0006) [2023-12-27 23:22:18,881][106226] Updated weights for policy 0, policy_version 574603 (0.0007) [2023-12-27 23:22:19,602][106226] Updated weights for policy 0, policy_version 574613 (0.0009) [2023-12-27 23:22:19,657][106226] Updated weights for policy 0, policy_version 574623 (0.0007) [2023-12-27 23:22:19,683][106225] Updated weights for policy 1, policy_version 576570 (0.0007) [2023-12-27 23:22:19,709][106226] Updated weights for policy 0, policy_version 574633 (0.0006) [2023-12-27 23:22:19,741][106225] Updated weights for policy 1, policy_version 576580 (0.0006) [2023-12-27 23:22:19,803][106225] Updated weights for policy 1, policy_version 576590 (0.0008) [2023-12-27 23:22:20,450][106226] Updated weights for policy 0, policy_version 574643 (0.0008) [2023-12-27 23:22:20,512][106226] Updated weights for policy 0, policy_version 574653 (0.0007) [2023-12-27 23:22:20,577][106226] Updated weights for policy 0, policy_version 574663 (0.0007) [2023-12-27 23:22:20,585][106225] Updated weights for policy 1, policy_version 576600 (0.0009) [2023-12-27 23:22:20,648][106225] Updated weights for policy 1, policy_version 576610 (0.0009) [2023-12-27 23:22:20,711][106225] Updated weights for policy 1, policy_version 576620 (0.0007) [2023-12-27 23:22:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 294797312. Throughput: 0: 9722.7, 1: 10175.0. Samples: 294809280. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:21,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.643')] [2023-12-27 23:22:21,259][106226] Updated weights for policy 0, policy_version 574673 (0.0007) [2023-12-27 23:22:21,330][106226] Updated weights for policy 0, policy_version 574683 (0.0009) [2023-12-27 23:22:21,402][106226] Updated weights for policy 0, policy_version 574693 (0.0008) [2023-12-27 23:22:21,409][106225] Updated weights for policy 1, policy_version 576630 (0.0008) [2023-12-27 23:22:21,463][106225] Updated weights for policy 1, policy_version 576640 (0.0006) [2023-12-27 23:22:21,465][106226] Updated weights for policy 0, policy_version 574703 (0.0008) [2023-12-27 23:22:21,525][106225] Updated weights for policy 1, policy_version 576650 (0.0007) [2023-12-27 23:22:22,190][106226] Updated weights for policy 0, policy_version 574713 (0.0009) [2023-12-27 23:22:22,245][106226] Updated weights for policy 0, policy_version 574723 (0.0008) [2023-12-27 23:22:22,257][106225] Updated weights for policy 1, policy_version 576660 (0.0009) [2023-12-27 23:22:22,312][106226] Updated weights for policy 0, policy_version 574733 (0.0008) [2023-12-27 23:22:22,320][106225] Updated weights for policy 1, policy_version 576670 (0.0008) [2023-12-27 23:22:22,384][106225] Updated weights for policy 1, policy_version 576680 (0.0010) [2023-12-27 23:22:23,084][106225] Updated weights for policy 1, policy_version 576690 (0.0011) [2023-12-27 23:22:23,122][106226] Updated weights for policy 0, policy_version 574743 (0.0006) [2023-12-27 23:22:23,129][106225] Updated weights for policy 1, policy_version 576700 (0.0010) [2023-12-27 23:22:23,179][106225] Updated weights for policy 1, policy_version 576710 (0.0007) [2023-12-27 23:22:23,186][106226] Updated weights for policy 0, policy_version 574753 (0.0005) [2023-12-27 23:22:23,227][106225] Updated weights for policy 1, policy_version 576720 (0.0006) [2023-12-27 23:22:23,248][106226] Updated weights for policy 0, policy_version 574763 (0.0007) [2023-12-27 23:22:23,801][106225] Updated weights for policy 1, policy_version 576730 (0.0005) [2023-12-27 23:22:23,847][106225] Updated weights for policy 1, policy_version 576740 (0.0007) [2023-12-27 23:22:23,889][106225] Updated weights for policy 1, policy_version 576750 (0.0006) [2023-12-27 23:22:23,994][106226] Updated weights for policy 0, policy_version 574773 (0.0008) [2023-12-27 23:22:24,043][106226] Updated weights for policy 0, policy_version 574783 (0.0008) [2023-12-27 23:22:24,101][106226] Updated weights for policy 0, policy_version 574793 (0.0009) [2023-12-27 23:22:24,532][106225] Updated weights for policy 1, policy_version 576760 (0.0007) [2023-12-27 23:22:24,582][106225] Updated weights for policy 1, policy_version 576770 (0.0009) [2023-12-27 23:22:24,636][106225] Updated weights for policy 1, policy_version 576781 (0.0009) [2023-12-27 23:22:24,774][106226] Updated weights for policy 0, policy_version 574803 (0.0008) [2023-12-27 23:22:24,838][106226] Updated weights for policy 0, policy_version 574813 (0.0008) [2023-12-27 23:22:24,886][106226] Updated weights for policy 0, policy_version 574823 (0.0009) [2023-12-27 23:22:25,258][106225] Updated weights for policy 1, policy_version 576791 (0.0007) [2023-12-27 23:22:25,308][106225] Updated weights for policy 1, policy_version 576801 (0.0005) [2023-12-27 23:22:25,359][106225] Updated weights for policy 1, policy_version 576811 (0.0005) [2023-12-27 23:22:25,641][106226] Updated weights for policy 0, policy_version 574833 (0.0009) [2023-12-27 23:22:25,695][106226] Updated weights for policy 0, policy_version 574843 (0.0010) [2023-12-27 23:22:25,758][106226] Updated weights for policy 0, policy_version 574853 (0.0011) [2023-12-27 23:22:25,808][106226] Updated weights for policy 0, policy_version 574863 (0.0010) [2023-12-27 23:22:26,010][106225] Updated weights for policy 1, policy_version 576821 (0.0008) [2023-12-27 23:22:26,063][106225] Updated weights for policy 1, policy_version 576831 (0.0010) [2023-12-27 23:22:26,112][106225] Updated weights for policy 1, policy_version 576841 (0.0010) [2023-12-27 23:22:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19771.9). Total num frames: 294903808. Throughput: 0: 9654.1, 1: 10145.3. Samples: 294867212. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:26,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-5.945')] [2023-12-27 23:22:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000576848_147701760.pth... [2023-12-27 23:22:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000574864_147202048.pth... [2023-12-27 23:22:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000575632_147390464.pth [2023-12-27 23:22:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000573744_146915328.pth [2023-12-27 23:22:26,530][106226] Updated weights for policy 0, policy_version 574873 (0.0006) [2023-12-27 23:22:26,590][106226] Updated weights for policy 0, policy_version 574883 (0.0005) [2023-12-27 23:22:26,649][106226] Updated weights for policy 0, policy_version 574893 (0.0005) [2023-12-27 23:22:26,844][106225] Updated weights for policy 1, policy_version 576851 (0.0010) [2023-12-27 23:22:26,905][106225] Updated weights for policy 1, policy_version 576861 (0.0008) [2023-12-27 23:22:26,975][106225] Updated weights for policy 1, policy_version 576871 (0.0006) [2023-12-27 23:22:27,212][106226] Updated weights for policy 0, policy_version 574903 (0.0007) [2023-12-27 23:22:27,259][106226] Updated weights for policy 0, policy_version 574913 (0.0008) [2023-12-27 23:22:27,309][106226] Updated weights for policy 0, policy_version 574923 (0.0008) [2023-12-27 23:22:27,642][106225] Updated weights for policy 1, policy_version 576881 (0.0006) [2023-12-27 23:22:27,695][106225] Updated weights for policy 1, policy_version 576891 (0.0010) [2023-12-27 23:22:27,751][106225] Updated weights for policy 1, policy_version 576901 (0.0010) [2023-12-27 23:22:27,812][106225] Updated weights for policy 1, policy_version 576911 (0.0010) [2023-12-27 23:22:28,074][106226] Updated weights for policy 0, policy_version 574933 (0.0008) [2023-12-27 23:22:28,123][106226] Updated weights for policy 0, policy_version 574943 (0.0008) [2023-12-27 23:22:28,166][106226] Updated weights for policy 0, policy_version 574953 (0.0008) [2023-12-27 23:22:28,537][106225] Updated weights for policy 1, policy_version 576921 (0.0011) [2023-12-27 23:22:28,594][106225] Updated weights for policy 1, policy_version 576931 (0.0010) [2023-12-27 23:22:28,645][106225] Updated weights for policy 1, policy_version 576941 (0.0010) [2023-12-27 23:22:28,825][106226] Updated weights for policy 0, policy_version 574963 (0.0008) [2023-12-27 23:22:28,892][106226] Updated weights for policy 0, policy_version 574973 (0.0009) [2023-12-27 23:22:28,951][106226] Updated weights for policy 0, policy_version 574983 (0.0010) [2023-12-27 23:22:29,396][106225] Updated weights for policy 1, policy_version 576951 (0.0008) [2023-12-27 23:22:29,456][106225] Updated weights for policy 1, policy_version 576961 (0.0007) [2023-12-27 23:22:29,510][106225] Updated weights for policy 1, policy_version 576971 (0.0008) [2023-12-27 23:22:29,677][106226] Updated weights for policy 0, policy_version 574993 (0.0011) [2023-12-27 23:22:29,733][106226] Updated weights for policy 0, policy_version 575003 (0.0011) [2023-12-27 23:22:29,795][106226] Updated weights for policy 0, policy_version 575013 (0.0008) [2023-12-27 23:22:29,863][106226] Updated weights for policy 0, policy_version 575023 (0.0007) [2023-12-27 23:22:30,228][106225] Updated weights for policy 1, policy_version 576981 (0.0009) [2023-12-27 23:22:30,278][106225] Updated weights for policy 1, policy_version 576991 (0.0009) [2023-12-27 23:22:30,324][106225] Updated weights for policy 1, policy_version 577001 (0.0007) [2023-12-27 23:22:30,505][106226] Updated weights for policy 0, policy_version 575033 (0.0008) [2023-12-27 23:22:30,572][106226] Updated weights for policy 0, policy_version 575043 (0.0006) [2023-12-27 23:22:30,642][106226] Updated weights for policy 0, policy_version 575053 (0.0007) [2023-12-27 23:22:30,935][106225] Updated weights for policy 1, policy_version 577011 (0.0007) [2023-12-27 23:22:30,991][106225] Updated weights for policy 1, policy_version 577021 (0.0005) [2023-12-27 23:22:31,054][106225] Updated weights for policy 1, policy_version 577031 (0.0007) [2023-12-27 23:22:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 295002112. Throughput: 0: 9691.6, 1: 10163.8. Samples: 294988272. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:31,175][105115] Avg episode reward: [(0, '-5.162'), (1, '-5.513')] [2023-12-27 23:22:31,246][106226] Updated weights for policy 0, policy_version 575063 (0.0007) [2023-12-27 23:22:31,312][106226] Updated weights for policy 0, policy_version 575073 (0.0008) [2023-12-27 23:22:31,384][106226] Updated weights for policy 0, policy_version 575083 (0.0008) [2023-12-27 23:22:31,742][106225] Updated weights for policy 1, policy_version 577041 (0.0006) [2023-12-27 23:22:31,805][106225] Updated weights for policy 1, policy_version 577051 (0.0006) [2023-12-27 23:22:31,861][106225] Updated weights for policy 1, policy_version 577061 (0.0005) [2023-12-27 23:22:31,915][106225] Updated weights for policy 1, policy_version 577071 (0.0005) [2023-12-27 23:22:32,109][106226] Updated weights for policy 0, policy_version 575093 (0.0010) [2023-12-27 23:22:32,163][106226] Updated weights for policy 0, policy_version 575103 (0.0011) [2023-12-27 23:22:32,213][106226] Updated weights for policy 0, policy_version 575113 (0.0010) [2023-12-27 23:22:32,499][106225] Updated weights for policy 1, policy_version 577081 (0.0008) [2023-12-27 23:22:32,561][106225] Updated weights for policy 1, policy_version 577091 (0.0009) [2023-12-27 23:22:32,612][106225] Updated weights for policy 1, policy_version 577101 (0.0009) [2023-12-27 23:22:32,917][106226] Updated weights for policy 0, policy_version 575123 (0.0011) [2023-12-27 23:22:32,978][106226] Updated weights for policy 0, policy_version 575133 (0.0011) [2023-12-27 23:22:33,035][106226] Updated weights for policy 0, policy_version 575143 (0.0010) [2023-12-27 23:22:33,272][106225] Updated weights for policy 1, policy_version 577111 (0.0006) [2023-12-27 23:22:33,337][106225] Updated weights for policy 1, policy_version 577121 (0.0008) [2023-12-27 23:22:33,392][106225] Updated weights for policy 1, policy_version 577131 (0.0010) [2023-12-27 23:22:33,730][106226] Updated weights for policy 0, policy_version 575153 (0.0008) [2023-12-27 23:22:33,774][106226] Updated weights for policy 0, policy_version 575163 (0.0010) [2023-12-27 23:22:33,820][106226] Updated weights for policy 0, policy_version 575173 (0.0010) [2023-12-27 23:22:33,867][106226] Updated weights for policy 0, policy_version 575183 (0.0010) [2023-12-27 23:22:34,034][106225] Updated weights for policy 1, policy_version 577141 (0.0008) [2023-12-27 23:22:34,090][106225] Updated weights for policy 1, policy_version 577151 (0.0010) [2023-12-27 23:22:34,152][106225] Updated weights for policy 1, policy_version 577161 (0.0010) [2023-12-27 23:22:34,593][106226] Updated weights for policy 0, policy_version 575193 (0.0011) [2023-12-27 23:22:34,657][106226] Updated weights for policy 0, policy_version 575203 (0.0011) [2023-12-27 23:22:34,714][106226] Updated weights for policy 0, policy_version 575213 (0.0011) [2023-12-27 23:22:34,816][106225] Updated weights for policy 1, policy_version 577171 (0.0011) [2023-12-27 23:22:34,872][106225] Updated weights for policy 1, policy_version 577181 (0.0009) [2023-12-27 23:22:34,930][106225] Updated weights for policy 1, policy_version 577191 (0.0006) [2023-12-27 23:22:35,414][106226] Updated weights for policy 0, policy_version 575223 (0.0011) [2023-12-27 23:22:35,467][106226] Updated weights for policy 0, policy_version 575233 (0.0010) [2023-12-27 23:22:35,532][106226] Updated weights for policy 0, policy_version 575243 (0.0011) [2023-12-27 23:22:35,643][106225] Updated weights for policy 1, policy_version 577201 (0.0008) [2023-12-27 23:22:35,695][106225] Updated weights for policy 1, policy_version 577211 (0.0008) [2023-12-27 23:22:35,752][106225] Updated weights for policy 1, policy_version 577221 (0.0005) [2023-12-27 23:22:35,813][106225] Updated weights for policy 1, policy_version 577231 (0.0007) [2023-12-27 23:22:36,171][106226] Updated weights for policy 0, policy_version 575253 (0.0009) [2023-12-27 23:22:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 295100416. Throughput: 0: 9776.0, 1: 10195.7. Samples: 295112348. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:36,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.843')] [2023-12-27 23:22:36,230][106226] Updated weights for policy 0, policy_version 575263 (0.0008) [2023-12-27 23:22:36,297][106226] Updated weights for policy 0, policy_version 575273 (0.0008) [2023-12-27 23:22:36,441][106225] Updated weights for policy 1, policy_version 577241 (0.0009) [2023-12-27 23:22:36,501][106225] Updated weights for policy 1, policy_version 577251 (0.0008) [2023-12-27 23:22:36,564][106225] Updated weights for policy 1, policy_version 577261 (0.0008) [2023-12-27 23:22:37,072][106226] Updated weights for policy 0, policy_version 575283 (0.0008) [2023-12-27 23:22:37,129][106226] Updated weights for policy 0, policy_version 575293 (0.0009) [2023-12-27 23:22:37,190][106226] Updated weights for policy 0, policy_version 575303 (0.0008) [2023-12-27 23:22:37,206][106225] Updated weights for policy 1, policy_version 577271 (0.0006) [2023-12-27 23:22:37,265][106225] Updated weights for policy 1, policy_version 577281 (0.0010) [2023-12-27 23:22:37,319][106225] Updated weights for policy 1, policy_version 577291 (0.0010) [2023-12-27 23:22:37,898][106225] Updated weights for policy 1, policy_version 577301 (0.0008) [2023-12-27 23:22:37,947][106225] Updated weights for policy 1, policy_version 577311 (0.0005) [2023-12-27 23:22:37,980][106226] Updated weights for policy 0, policy_version 575313 (0.0007) [2023-12-27 23:22:38,006][106225] Updated weights for policy 1, policy_version 577321 (0.0009) [2023-12-27 23:22:38,040][106226] Updated weights for policy 0, policy_version 575323 (0.0006) [2023-12-27 23:22:38,096][106226] Updated weights for policy 0, policy_version 575333 (0.0007) [2023-12-27 23:22:38,152][106226] Updated weights for policy 0, policy_version 575343 (0.0008) [2023-12-27 23:22:38,694][106225] Updated weights for policy 1, policy_version 577331 (0.0008) [2023-12-27 23:22:38,744][106225] Updated weights for policy 1, policy_version 577341 (0.0005) [2023-12-27 23:22:38,794][106225] Updated weights for policy 1, policy_version 577351 (0.0008) [2023-12-27 23:22:38,893][106226] Updated weights for policy 0, policy_version 575353 (0.0007) [2023-12-27 23:22:38,951][106226] Updated weights for policy 0, policy_version 575363 (0.0011) [2023-12-27 23:22:39,005][106226] Updated weights for policy 0, policy_version 575373 (0.0010) [2023-12-27 23:22:39,540][106225] Updated weights for policy 1, policy_version 577361 (0.0011) [2023-12-27 23:22:39,605][106225] Updated weights for policy 1, policy_version 577371 (0.0011) [2023-12-27 23:22:39,666][106225] Updated weights for policy 1, policy_version 577381 (0.0010) [2023-12-27 23:22:39,710][106226] Updated weights for policy 0, policy_version 575383 (0.0006) [2023-12-27 23:22:39,731][106225] Updated weights for policy 1, policy_version 577391 (0.0010) [2023-12-27 23:22:39,774][106226] Updated weights for policy 0, policy_version 575393 (0.0005) [2023-12-27 23:22:39,843][106226] Updated weights for policy 0, policy_version 575403 (0.0010) [2023-12-27 23:22:40,451][106225] Updated weights for policy 1, policy_version 577401 (0.0006) [2023-12-27 23:22:40,462][106226] Updated weights for policy 0, policy_version 575413 (0.0009) [2023-12-27 23:22:40,513][106225] Updated weights for policy 1, policy_version 577411 (0.0009) [2023-12-27 23:22:40,517][106226] Updated weights for policy 0, policy_version 575423 (0.0010) [2023-12-27 23:22:40,570][106226] Updated weights for policy 0, policy_version 575433 (0.0010) [2023-12-27 23:22:40,571][106225] Updated weights for policy 1, policy_version 577421 (0.0010) [2023-12-27 23:22:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 295198720. Throughput: 0: 9741.1, 1: 10251.5. Samples: 295172156. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:41,175][105115] Avg episode reward: [(0, '-5.124'), (1, '-5.725')] [2023-12-27 23:22:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000575440_147349504.pth... [2023-12-27 23:22:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000577424_147849216.pth... [2023-12-27 23:22:41,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000574288_147054592.pth [2023-12-27 23:22:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000576240_147546112.pth [2023-12-27 23:22:41,240][106225] Updated weights for policy 1, policy_version 577431 (0.0010) [2023-12-27 23:22:41,301][106226] Updated weights for policy 0, policy_version 575443 (0.0008) [2023-12-27 23:22:41,310][106225] Updated weights for policy 1, policy_version 577441 (0.0009) [2023-12-27 23:22:41,371][106226] Updated weights for policy 0, policy_version 575453 (0.0007) [2023-12-27 23:22:41,376][106225] Updated weights for policy 1, policy_version 577451 (0.0008) [2023-12-27 23:22:41,444][106226] Updated weights for policy 0, policy_version 575463 (0.0008) [2023-12-27 23:22:42,134][106225] Updated weights for policy 1, policy_version 577461 (0.0007) [2023-12-27 23:22:42,179][106226] Updated weights for policy 0, policy_version 575473 (0.0008) [2023-12-27 23:22:42,203][106225] Updated weights for policy 1, policy_version 577471 (0.0008) [2023-12-27 23:22:42,240][106226] Updated weights for policy 0, policy_version 575483 (0.0006) [2023-12-27 23:22:42,270][106225] Updated weights for policy 1, policy_version 577481 (0.0008) [2023-12-27 23:22:42,305][106226] Updated weights for policy 0, policy_version 575493 (0.0006) [2023-12-27 23:22:42,369][106226] Updated weights for policy 0, policy_version 575503 (0.0008) [2023-12-27 23:22:42,968][106225] Updated weights for policy 1, policy_version 577491 (0.0008) [2023-12-27 23:22:43,025][106225] Updated weights for policy 1, policy_version 577501 (0.0008) [2023-12-27 23:22:43,078][106226] Updated weights for policy 0, policy_version 575513 (0.0007) [2023-12-27 23:22:43,084][106225] Updated weights for policy 1, policy_version 577511 (0.0007) [2023-12-27 23:22:43,138][106226] Updated weights for policy 0, policy_version 575523 (0.0009) [2023-12-27 23:22:43,192][106226] Updated weights for policy 0, policy_version 575533 (0.0010) [2023-12-27 23:22:43,823][106225] Updated weights for policy 1, policy_version 577521 (0.0006) [2023-12-27 23:22:43,861][106226] Updated weights for policy 0, policy_version 575543 (0.0010) [2023-12-27 23:22:43,883][106225] Updated weights for policy 1, policy_version 577531 (0.0007) [2023-12-27 23:22:43,922][106226] Updated weights for policy 0, policy_version 575553 (0.0008) [2023-12-27 23:22:43,940][106225] Updated weights for policy 1, policy_version 577541 (0.0007) [2023-12-27 23:22:43,973][106226] Updated weights for policy 0, policy_version 575563 (0.0010) [2023-12-27 23:22:43,995][106225] Updated weights for policy 1, policy_version 577551 (0.0007) [2023-12-27 23:22:44,600][106225] Updated weights for policy 1, policy_version 577561 (0.0006) [2023-12-27 23:22:44,651][106226] Updated weights for policy 0, policy_version 575573 (0.0008) [2023-12-27 23:22:44,656][106225] Updated weights for policy 1, policy_version 577571 (0.0007) [2023-12-27 23:22:44,709][106225] Updated weights for policy 1, policy_version 577581 (0.0005) [2023-12-27 23:22:44,709][106226] Updated weights for policy 0, policy_version 575583 (0.0005) [2023-12-27 23:22:44,773][106226] Updated weights for policy 0, policy_version 575593 (0.0008) [2023-12-27 23:22:45,389][106225] Updated weights for policy 1, policy_version 577591 (0.0007) [2023-12-27 23:22:45,440][106225] Updated weights for policy 1, policy_version 577601 (0.0008) [2023-12-27 23:22:45,462][106226] Updated weights for policy 0, policy_version 575603 (0.0010) [2023-12-27 23:22:45,484][106225] Updated weights for policy 1, policy_version 577611 (0.0006) [2023-12-27 23:22:45,508][106226] Updated weights for policy 0, policy_version 575613 (0.0005) [2023-12-27 23:22:45,564][106226] Updated weights for policy 0, policy_version 575623 (0.0005) [2023-12-27 23:22:46,090][106226] Updated weights for policy 0, policy_version 575633 (0.0006) [2023-12-27 23:22:46,160][106226] Updated weights for policy 0, policy_version 575643 (0.0005) [2023-12-27 23:22:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 295297024. Throughput: 0: 9760.4, 1: 10223.4. Samples: 295290164. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:46,176][105115] Avg episode reward: [(0, '-4.943'), (1, '-5.773')] [2023-12-27 23:22:46,223][106226] Updated weights for policy 0, policy_version 575653 (0.0008) [2023-12-27 23:22:46,281][106226] Updated weights for policy 0, policy_version 575663 (0.0008) [2023-12-27 23:22:46,325][106225] Updated weights for policy 1, policy_version 577621 (0.0008) [2023-12-27 23:22:46,375][106225] Updated weights for policy 1, policy_version 577631 (0.0006) [2023-12-27 23:22:46,432][106225] Updated weights for policy 1, policy_version 577641 (0.0005) [2023-12-27 23:22:46,894][106226] Updated weights for policy 0, policy_version 575673 (0.0008) [2023-12-27 23:22:46,940][106226] Updated weights for policy 0, policy_version 575683 (0.0009) [2023-12-27 23:22:46,988][106226] Updated weights for policy 0, policy_version 575693 (0.0008) [2023-12-27 23:22:47,160][106225] Updated weights for policy 1, policy_version 577651 (0.0008) [2023-12-27 23:22:47,225][106225] Updated weights for policy 1, policy_version 577661 (0.0007) [2023-12-27 23:22:47,287][106225] Updated weights for policy 1, policy_version 577671 (0.0008) [2023-12-27 23:22:47,691][106226] Updated weights for policy 0, policy_version 575703 (0.0010) [2023-12-27 23:22:47,742][106226] Updated weights for policy 0, policy_version 575713 (0.0011) [2023-12-27 23:22:47,803][106226] Updated weights for policy 0, policy_version 575723 (0.0011) [2023-12-27 23:22:47,974][106225] Updated weights for policy 1, policy_version 577681 (0.0009) [2023-12-27 23:22:48,032][106225] Updated weights for policy 1, policy_version 577691 (0.0007) [2023-12-27 23:22:48,092][106225] Updated weights for policy 1, policy_version 577701 (0.0007) [2023-12-27 23:22:48,155][106225] Updated weights for policy 1, policy_version 577711 (0.0009) [2023-12-27 23:22:48,515][106226] Updated weights for policy 0, policy_version 575733 (0.0007) [2023-12-27 23:22:48,578][106226] Updated weights for policy 0, policy_version 575743 (0.0006) [2023-12-27 23:22:48,648][106226] Updated weights for policy 0, policy_version 575753 (0.0006) [2023-12-27 23:22:48,917][106225] Updated weights for policy 1, policy_version 577721 (0.0010) [2023-12-27 23:22:48,965][106225] Updated weights for policy 1, policy_version 577731 (0.0009) [2023-12-27 23:22:49,013][106225] Updated weights for policy 1, policy_version 577741 (0.0008) [2023-12-27 23:22:49,202][106226] Updated weights for policy 0, policy_version 575763 (0.0007) [2023-12-27 23:22:49,276][106226] Updated weights for policy 0, policy_version 575773 (0.0010) [2023-12-27 23:22:49,347][106226] Updated weights for policy 0, policy_version 575783 (0.0009) [2023-12-27 23:22:49,797][106225] Updated weights for policy 1, policy_version 577751 (0.0007) [2023-12-27 23:22:49,867][106225] Updated weights for policy 1, policy_version 577761 (0.0008) [2023-12-27 23:22:49,927][106225] Updated weights for policy 1, policy_version 577771 (0.0010) [2023-12-27 23:22:50,069][106226] Updated weights for policy 0, policy_version 575793 (0.0007) [2023-12-27 23:22:50,130][106226] Updated weights for policy 0, policy_version 575803 (0.0008) [2023-12-27 23:22:50,197][106226] Updated weights for policy 0, policy_version 575813 (0.0008) [2023-12-27 23:22:50,259][106226] Updated weights for policy 0, policy_version 575823 (0.0009) [2023-12-27 23:22:50,630][106225] Updated weights for policy 1, policy_version 577781 (0.0008) [2023-12-27 23:22:50,682][106225] Updated weights for policy 1, policy_version 577791 (0.0009) [2023-12-27 23:22:50,731][106225] Updated weights for policy 1, policy_version 577801 (0.0008) [2023-12-27 23:22:51,013][106226] Updated weights for policy 0, policy_version 575833 (0.0008) [2023-12-27 23:22:51,079][106226] Updated weights for policy 0, policy_version 575843 (0.0009) [2023-12-27 23:22:51,140][106226] Updated weights for policy 0, policy_version 575853 (0.0009) [2023-12-27 23:22:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 295403520. Throughput: 0: 9849.2, 1: 10074.7. Samples: 295408184. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:51,175][105115] Avg episode reward: [(0, '-4.931'), (1, '-5.517')] [2023-12-27 23:22:51,509][106225] Updated weights for policy 1, policy_version 577811 (0.0008) [2023-12-27 23:22:51,566][106225] Updated weights for policy 1, policy_version 577821 (0.0010) [2023-12-27 23:22:51,629][106225] Updated weights for policy 1, policy_version 577831 (0.0008) [2023-12-27 23:22:52,003][106226] Updated weights for policy 0, policy_version 575863 (0.0008) [2023-12-27 23:22:52,064][106226] Updated weights for policy 0, policy_version 575873 (0.0009) [2023-12-27 23:22:52,129][106226] Updated weights for policy 0, policy_version 575883 (0.0010) [2023-12-27 23:22:52,303][106225] Updated weights for policy 1, policy_version 577841 (0.0008) [2023-12-27 23:22:52,365][106225] Updated weights for policy 1, policy_version 577851 (0.0008) [2023-12-27 23:22:52,427][106225] Updated weights for policy 1, policy_version 577861 (0.0008) [2023-12-27 23:22:52,479][106225] Updated weights for policy 1, policy_version 577871 (0.0008) [2023-12-27 23:22:52,882][106226] Updated weights for policy 0, policy_version 575893 (0.0008) [2023-12-27 23:22:52,940][106226] Updated weights for policy 0, policy_version 575903 (0.0009) [2023-12-27 23:22:52,993][106226] Updated weights for policy 0, policy_version 575913 (0.0009) [2023-12-27 23:22:53,209][106225] Updated weights for policy 1, policy_version 577881 (0.0008) [2023-12-27 23:22:53,261][106225] Updated weights for policy 1, policy_version 577891 (0.0009) [2023-12-27 23:22:53,309][106225] Updated weights for policy 1, policy_version 577901 (0.0009) [2023-12-27 23:22:53,713][106226] Updated weights for policy 0, policy_version 575923 (0.0008) [2023-12-27 23:22:53,767][106226] Updated weights for policy 0, policy_version 575933 (0.0008) [2023-12-27 23:22:53,823][106226] Updated weights for policy 0, policy_version 575943 (0.0009) [2023-12-27 23:22:54,093][106225] Updated weights for policy 1, policy_version 577911 (0.0008) [2023-12-27 23:22:54,154][106225] Updated weights for policy 1, policy_version 577921 (0.0007) [2023-12-27 23:22:54,208][106225] Updated weights for policy 1, policy_version 577931 (0.0009) [2023-12-27 23:22:54,421][106226] Updated weights for policy 0, policy_version 575953 (0.0007) [2023-12-27 23:22:54,483][106226] Updated weights for policy 0, policy_version 575963 (0.0005) [2023-12-27 23:22:54,545][106226] Updated weights for policy 0, policy_version 575973 (0.0008) [2023-12-27 23:22:54,598][106226] Updated weights for policy 0, policy_version 575983 (0.0007) [2023-12-27 23:22:55,000][106225] Updated weights for policy 1, policy_version 577941 (0.0009) [2023-12-27 23:22:55,058][106225] Updated weights for policy 1, policy_version 577951 (0.0008) [2023-12-27 23:22:55,107][106225] Updated weights for policy 1, policy_version 577961 (0.0007) [2023-12-27 23:22:55,174][106226] Updated weights for policy 0, policy_version 575993 (0.0010) [2023-12-27 23:22:55,224][106226] Updated weights for policy 0, policy_version 576003 (0.0010) [2023-12-27 23:22:55,274][106226] Updated weights for policy 0, policy_version 576013 (0.0010) [2023-12-27 23:22:55,821][106225] Updated weights for policy 1, policy_version 577971 (0.0007) [2023-12-27 23:22:55,881][106225] Updated weights for policy 1, policy_version 577981 (0.0007) [2023-12-27 23:22:55,929][106226] Updated weights for policy 0, policy_version 576023 (0.0011) [2023-12-27 23:22:55,935][106225] Updated weights for policy 1, policy_version 577991 (0.0006) [2023-12-27 23:22:55,995][106226] Updated weights for policy 0, policy_version 576033 (0.0011) [2023-12-27 23:22:56,055][106226] Updated weights for policy 0, policy_version 576043 (0.0010) [2023-12-27 23:22:56,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 295501824. Throughput: 0: 9847.7, 1: 9990.7. Samples: 295464856. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:22:56,175][105115] Avg episode reward: [(0, '-5.047'), (1, '-5.498')] [2023-12-27 23:22:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000576048_147505152.pth... [2023-12-27 23:22:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000578000_147996672.pth... [2023-12-27 23:22:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000574864_147202048.pth [2023-12-27 23:22:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000576848_147701760.pth [2023-12-27 23:22:56,671][106225] Updated weights for policy 1, policy_version 578001 (0.0007) [2023-12-27 23:22:56,721][106225] Updated weights for policy 1, policy_version 578011 (0.0008) [2023-12-27 23:22:56,732][106226] Updated weights for policy 0, policy_version 576053 (0.0009) [2023-12-27 23:22:56,774][106225] Updated weights for policy 1, policy_version 578021 (0.0008) [2023-12-27 23:22:56,776][106226] Updated weights for policy 0, policy_version 576063 (0.0007) [2023-12-27 23:22:56,821][106226] Updated weights for policy 0, policy_version 576073 (0.0005) [2023-12-27 23:22:56,826][106225] Updated weights for policy 1, policy_version 578031 (0.0007) [2023-12-27 23:22:57,492][106226] Updated weights for policy 0, policy_version 576083 (0.0006) [2023-12-27 23:22:57,539][106226] Updated weights for policy 0, policy_version 576093 (0.0008) [2023-12-27 23:22:57,579][106225] Updated weights for policy 1, policy_version 578041 (0.0008) [2023-12-27 23:22:57,592][106226] Updated weights for policy 0, policy_version 576103 (0.0007) [2023-12-27 23:22:57,635][106225] Updated weights for policy 1, policy_version 578051 (0.0008) [2023-12-27 23:22:57,696][106225] Updated weights for policy 1, policy_version 578061 (0.0009) [2023-12-27 23:22:58,317][106226] Updated weights for policy 0, policy_version 576113 (0.0006) [2023-12-27 23:22:58,333][106225] Updated weights for policy 1, policy_version 578071 (0.0008) [2023-12-27 23:22:58,389][106226] Updated weights for policy 0, policy_version 576123 (0.0009) [2023-12-27 23:22:58,405][106225] Updated weights for policy 1, policy_version 578081 (0.0008) [2023-12-27 23:22:58,462][106226] Updated weights for policy 0, policy_version 576133 (0.0009) [2023-12-27 23:22:58,469][106225] Updated weights for policy 1, policy_version 578091 (0.0009) [2023-12-27 23:22:58,528][106226] Updated weights for policy 0, policy_version 576143 (0.0009) [2023-12-27 23:22:59,360][106225] Updated weights for policy 1, policy_version 578101 (0.0009) [2023-12-27 23:22:59,416][106226] Updated weights for policy 0, policy_version 576153 (0.0008) [2023-12-27 23:22:59,429][106225] Updated weights for policy 1, policy_version 578111 (0.0009) [2023-12-27 23:22:59,477][106226] Updated weights for policy 0, policy_version 576163 (0.0006) [2023-12-27 23:22:59,490][106225] Updated weights for policy 1, policy_version 578121 (0.0011) [2023-12-27 23:22:59,543][106226] Updated weights for policy 0, policy_version 576173 (0.0006) [2023-12-27 23:23:00,177][106226] Updated weights for policy 0, policy_version 576183 (0.0008) [2023-12-27 23:23:00,223][106225] Updated weights for policy 1, policy_version 578131 (0.0009) [2023-12-27 23:23:00,228][106226] Updated weights for policy 0, policy_version 576193 (0.0008) [2023-12-27 23:23:00,277][106226] Updated weights for policy 0, policy_version 576203 (0.0008) [2023-12-27 23:23:00,280][106225] Updated weights for policy 1, policy_version 578141 (0.0005) [2023-12-27 23:23:00,339][106225] Updated weights for policy 1, policy_version 578151 (0.0005) [2023-12-27 23:23:00,390][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000004 [2023-12-27 23:23:00,905][106225] Updated weights for policy 1, policy_version 578161 (0.0005) [2023-12-27 23:23:00,925][106226] Updated weights for policy 0, policy_version 576213 (0.0007) [2023-12-27 23:23:00,957][106225] Updated weights for policy 1, policy_version 578171 (0.0008) [2023-12-27 23:23:00,972][106226] Updated weights for policy 0, policy_version 576223 (0.0006) [2023-12-27 23:23:01,013][106225] Updated weights for policy 1, policy_version 578181 (0.0006) [2023-12-27 23:23:01,034][106226] Updated weights for policy 0, policy_version 576233 (0.0008) [2023-12-27 23:23:01,075][106225] Updated weights for policy 1, policy_version 578191 (0.0007) [2023-12-27 23:23:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 295600128. Throughput: 0: 9907.7, 1: 9924.9. Samples: 295581120. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:23:01,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.555')] [2023-12-27 23:23:01,826][106226] Updated weights for policy 0, policy_version 576243 (0.0007) [2023-12-27 23:23:01,827][106225] Updated weights for policy 1, policy_version 578201 (0.0008) [2023-12-27 23:23:01,871][106226] Updated weights for policy 0, policy_version 576253 (0.0008) [2023-12-27 23:23:01,875][106225] Updated weights for policy 1, policy_version 578211 (0.0008) [2023-12-27 23:23:01,921][106226] Updated weights for policy 0, policy_version 576263 (0.0008) [2023-12-27 23:23:01,926][106225] Updated weights for policy 1, policy_version 578221 (0.0008) [2023-12-27 23:23:02,646][106226] Updated weights for policy 0, policy_version 576273 (0.0008) [2023-12-27 23:23:02,658][106225] Updated weights for policy 1, policy_version 578231 (0.0006) [2023-12-27 23:23:02,695][106226] Updated weights for policy 0, policy_version 576283 (0.0007) [2023-12-27 23:23:02,709][106225] Updated weights for policy 1, policy_version 578241 (0.0006) [2023-12-27 23:23:02,740][106226] Updated weights for policy 0, policy_version 576293 (0.0008) [2023-12-27 23:23:02,761][106225] Updated weights for policy 1, policy_version 578251 (0.0005) [2023-12-27 23:23:02,793][106226] Updated weights for policy 0, policy_version 576303 (0.0008) [2023-12-27 23:23:03,371][106225] Updated weights for policy 1, policy_version 578261 (0.0007) [2023-12-27 23:23:03,423][106225] Updated weights for policy 1, policy_version 578271 (0.0009) [2023-12-27 23:23:03,480][106225] Updated weights for policy 1, policy_version 578281 (0.0008) [2023-12-27 23:23:03,545][106226] Updated weights for policy 0, policy_version 576313 (0.0008) [2023-12-27 23:23:03,595][106226] Updated weights for policy 0, policy_version 576323 (0.0007) [2023-12-27 23:23:03,649][106226] Updated weights for policy 0, policy_version 576333 (0.0008) [2023-12-27 23:23:04,185][106225] Updated weights for policy 1, policy_version 578291 (0.0007) [2023-12-27 23:23:04,246][106225] Updated weights for policy 1, policy_version 578301 (0.0011) [2023-12-27 23:23:04,308][106225] Updated weights for policy 1, policy_version 578311 (0.0010) [2023-12-27 23:23:04,425][106226] Updated weights for policy 0, policy_version 576343 (0.0008) [2023-12-27 23:23:04,492][106226] Updated weights for policy 0, policy_version 576353 (0.0008) [2023-12-27 23:23:04,547][106226] Updated weights for policy 0, policy_version 576363 (0.0009) [2023-12-27 23:23:04,976][106225] Updated weights for policy 1, policy_version 578321 (0.0010) [2023-12-27 23:23:05,039][106225] Updated weights for policy 1, policy_version 578331 (0.0007) [2023-12-27 23:23:05,098][106225] Updated weights for policy 1, policy_version 578341 (0.0008) [2023-12-27 23:23:05,159][106225] Updated weights for policy 1, policy_version 578351 (0.0007) [2023-12-27 23:23:05,254][106226] Updated weights for policy 0, policy_version 576373 (0.0008) [2023-12-27 23:23:05,305][106226] Updated weights for policy 0, policy_version 576383 (0.0008) [2023-12-27 23:23:05,369][106226] Updated weights for policy 0, policy_version 576393 (0.0008) [2023-12-27 23:23:05,817][106225] Updated weights for policy 1, policy_version 578361 (0.0009) [2023-12-27 23:23:05,867][106225] Updated weights for policy 1, policy_version 578371 (0.0009) [2023-12-27 23:23:05,918][106225] Updated weights for policy 1, policy_version 578381 (0.0008) [2023-12-27 23:23:06,070][106226] Updated weights for policy 0, policy_version 576403 (0.0009) [2023-12-27 23:23:06,137][106226] Updated weights for policy 0, policy_version 576413 (0.0009) [2023-12-27 23:23:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 295690240. Throughput: 0: 9864.5, 1: 9968.3. Samples: 295701760. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:23:06,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-5.884')] [2023-12-27 23:23:06,196][106226] Updated weights for policy 0, policy_version 576423 (0.0008) [2023-12-27 23:23:06,715][106225] Updated weights for policy 1, policy_version 578391 (0.0008) [2023-12-27 23:23:06,768][106225] Updated weights for policy 1, policy_version 578401 (0.0008) [2023-12-27 23:23:06,794][106226] Updated weights for policy 0, policy_version 576433 (0.0008) [2023-12-27 23:23:06,825][106225] Updated weights for policy 1, policy_version 578411 (0.0009) [2023-12-27 23:23:06,851][106226] Updated weights for policy 0, policy_version 576443 (0.0007) [2023-12-27 23:23:06,913][106226] Updated weights for policy 0, policy_version 576453 (0.0008) [2023-12-27 23:23:06,976][106226] Updated weights for policy 0, policy_version 576463 (0.0008) [2023-12-27 23:23:07,546][106225] Updated weights for policy 1, policy_version 578421 (0.0007) [2023-12-27 23:23:07,600][106225] Updated weights for policy 1, policy_version 578431 (0.0008) [2023-12-27 23:23:07,648][106225] Updated weights for policy 1, policy_version 578441 (0.0008) [2023-12-27 23:23:07,704][106226] Updated weights for policy 0, policy_version 576473 (0.0009) [2023-12-27 23:23:07,769][106226] Updated weights for policy 0, policy_version 576483 (0.0009) [2023-12-27 23:23:07,837][106226] Updated weights for policy 0, policy_version 576493 (0.0009) [2023-12-27 23:23:08,386][106225] Updated weights for policy 1, policy_version 578451 (0.0008) [2023-12-27 23:23:08,455][106225] Updated weights for policy 1, policy_version 578461 (0.0009) [2023-12-27 23:23:08,519][106225] Updated weights for policy 1, policy_version 578471 (0.0009) [2023-12-27 23:23:08,526][106226] Updated weights for policy 0, policy_version 576503 (0.0008) [2023-12-27 23:23:08,581][106226] Updated weights for policy 0, policy_version 576513 (0.0007) [2023-12-27 23:23:08,641][106226] Updated weights for policy 0, policy_version 576523 (0.0009) [2023-12-27 23:23:09,251][106225] Updated weights for policy 1, policy_version 578481 (0.0010) [2023-12-27 23:23:09,314][106225] Updated weights for policy 1, policy_version 578491 (0.0008) [2023-12-27 23:23:09,382][106225] Updated weights for policy 1, policy_version 578501 (0.0007) [2023-12-27 23:23:09,405][106226] Updated weights for policy 0, policy_version 576533 (0.0008) [2023-12-27 23:23:09,452][106225] Updated weights for policy 1, policy_version 578511 (0.0007) [2023-12-27 23:23:09,467][106226] Updated weights for policy 0, policy_version 576543 (0.0008) [2023-12-27 23:23:09,526][106226] Updated weights for policy 0, policy_version 576553 (0.0009) [2023-12-27 23:23:10,248][106225] Updated weights for policy 1, policy_version 578521 (0.0007) [2023-12-27 23:23:10,263][106226] Updated weights for policy 0, policy_version 576563 (0.0008) [2023-12-27 23:23:10,307][106225] Updated weights for policy 1, policy_version 578531 (0.0007) [2023-12-27 23:23:10,327][106226] Updated weights for policy 0, policy_version 576573 (0.0008) [2023-12-27 23:23:10,370][106225] Updated weights for policy 1, policy_version 578541 (0.0010) [2023-12-27 23:23:10,388][106226] Updated weights for policy 0, policy_version 576583 (0.0009) [2023-12-27 23:23:11,034][106226] Updated weights for policy 0, policy_version 576593 (0.0012) [2023-12-27 23:23:11,052][106225] Updated weights for policy 1, policy_version 578551 (0.0007) [2023-12-27 23:23:11,100][106226] Updated weights for policy 0, policy_version 576603 (0.0009) [2023-12-27 23:23:11,113][106225] Updated weights for policy 1, policy_version 578561 (0.0008) [2023-12-27 23:23:11,168][106226] Updated weights for policy 0, policy_version 576613 (0.0011) [2023-12-27 23:23:11,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 295780352. Throughput: 0: 9914.4, 1: 9908.8. Samples: 295759256. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:23:11,175][105115] Avg episode reward: [(0, '-5.306'), (1, '-6.143')] [2023-12-27 23:23:11,181][106225] Updated weights for policy 1, policy_version 578571 (0.0008) [2023-12-27 23:23:11,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000578576_148144128.pth... [2023-12-27 23:23:11,218][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000577424_147849216.pth [2023-12-27 23:23:11,227][106226] Updated weights for policy 0, policy_version 576623 (0.0010) [2023-12-27 23:23:11,232][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000576624_147652608.pth... [2023-12-27 23:23:11,235][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000575440_147349504.pth [2023-12-27 23:23:11,978][106226] Updated weights for policy 0, policy_version 576633 (0.0010) [2023-12-27 23:23:12,041][106226] Updated weights for policy 0, policy_version 576643 (0.0005) [2023-12-27 23:23:12,054][106225] Updated weights for policy 1, policy_version 578581 (0.0008) [2023-12-27 23:23:12,111][106226] Updated weights for policy 0, policy_version 576653 (0.0006) [2023-12-27 23:23:12,125][106225] Updated weights for policy 1, policy_version 578591 (0.0008) [2023-12-27 23:23:12,188][106225] Updated weights for policy 1, policy_version 578601 (0.0008) [2023-12-27 23:23:12,781][106226] Updated weights for policy 0, policy_version 576663 (0.0006) [2023-12-27 23:23:12,833][106226] Updated weights for policy 0, policy_version 576673 (0.0006) [2023-12-27 23:23:12,888][106225] Updated weights for policy 1, policy_version 578611 (0.0008) [2023-12-27 23:23:12,892][106226] Updated weights for policy 0, policy_version 576683 (0.0006) [2023-12-27 23:23:12,936][106225] Updated weights for policy 1, policy_version 578621 (0.0008) [2023-12-27 23:23:12,987][106225] Updated weights for policy 1, policy_version 578631 (0.0009) [2023-12-27 23:23:13,426][106226] Updated weights for policy 0, policy_version 576693 (0.0005) [2023-12-27 23:23:13,486][106226] Updated weights for policy 0, policy_version 576703 (0.0007) [2023-12-27 23:23:13,543][106226] Updated weights for policy 0, policy_version 576713 (0.0010) [2023-12-27 23:23:13,629][106225] Updated weights for policy 1, policy_version 578641 (0.0009) [2023-12-27 23:23:13,676][106225] Updated weights for policy 1, policy_version 578651 (0.0010) [2023-12-27 23:23:13,727][106225] Updated weights for policy 1, policy_version 578661 (0.0010) [2023-12-27 23:23:13,774][106225] Updated weights for policy 1, policy_version 578671 (0.0010) [2023-12-27 23:23:14,205][106226] Updated weights for policy 0, policy_version 576723 (0.0009) [2023-12-27 23:23:14,255][106226] Updated weights for policy 0, policy_version 576733 (0.0006) [2023-12-27 23:23:14,318][106226] Updated weights for policy 0, policy_version 576743 (0.0005) [2023-12-27 23:23:14,499][106225] Updated weights for policy 1, policy_version 578681 (0.0010) [2023-12-27 23:23:14,560][106225] Updated weights for policy 1, policy_version 578691 (0.0010) [2023-12-27 23:23:14,621][106225] Updated weights for policy 1, policy_version 578701 (0.0010) [2023-12-27 23:23:15,011][106226] Updated weights for policy 0, policy_version 576753 (0.0006) [2023-12-27 23:23:15,076][106226] Updated weights for policy 0, policy_version 576763 (0.0010) [2023-12-27 23:23:15,142][106226] Updated weights for policy 0, policy_version 576773 (0.0011) [2023-12-27 23:23:15,211][106226] Updated weights for policy 0, policy_version 576783 (0.0011) [2023-12-27 23:23:15,356][106225] Updated weights for policy 1, policy_version 578711 (0.0010) [2023-12-27 23:23:15,409][106225] Updated weights for policy 1, policy_version 578721 (0.0010) [2023-12-27 23:23:15,462][106225] Updated weights for policy 1, policy_version 578731 (0.0010) [2023-12-27 23:23:15,900][106226] Updated weights for policy 0, policy_version 576793 (0.0011) [2023-12-27 23:23:15,960][106226] Updated weights for policy 0, policy_version 576803 (0.0011) [2023-12-27 23:23:16,022][106226] Updated weights for policy 0, policy_version 576813 (0.0010) [2023-12-27 23:23:16,122][106225] Updated weights for policy 1, policy_version 578741 (0.0009) [2023-12-27 23:23:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 295886848. Throughput: 0: 9925.8, 1: 9820.3. Samples: 295876844. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-27 23:23:16,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.509')] [2023-12-27 23:23:16,178][106225] Updated weights for policy 1, policy_version 578751 (0.0008) [2023-12-27 23:23:16,229][106225] Updated weights for policy 1, policy_version 578761 (0.0008) [2023-12-27 23:23:16,728][106226] Updated weights for policy 0, policy_version 576823 (0.0011) [2023-12-27 23:23:16,780][106226] Updated weights for policy 0, policy_version 576833 (0.0010) [2023-12-27 23:23:16,843][106226] Updated weights for policy 0, policy_version 576843 (0.0010) [2023-12-27 23:23:16,953][106225] Updated weights for policy 1, policy_version 578771 (0.0008) [2023-12-27 23:23:17,013][106225] Updated weights for policy 1, policy_version 578781 (0.0006) [2023-12-27 23:23:17,062][106225] Updated weights for policy 1, policy_version 578791 (0.0005) [2023-12-27 23:23:17,543][106226] Updated weights for policy 0, policy_version 576853 (0.0011) [2023-12-27 23:23:17,602][106226] Updated weights for policy 0, policy_version 576863 (0.0010) [2023-12-27 23:23:17,658][106226] Updated weights for policy 0, policy_version 576873 (0.0010) [2023-12-27 23:23:17,720][106225] Updated weights for policy 1, policy_version 578801 (0.0006) [2023-12-27 23:23:17,780][106225] Updated weights for policy 1, policy_version 578811 (0.0010) [2023-12-27 23:23:17,841][106225] Updated weights for policy 1, policy_version 578821 (0.0010) [2023-12-27 23:23:17,906][106225] Updated weights for policy 1, policy_version 578831 (0.0008) [2023-12-27 23:23:18,396][106226] Updated weights for policy 0, policy_version 576883 (0.0010) [2023-12-27 23:23:18,450][106226] Updated weights for policy 0, policy_version 576893 (0.0008) [2023-12-27 23:23:18,505][106226] Updated weights for policy 0, policy_version 576903 (0.0008) [2023-12-27 23:23:18,593][106225] Updated weights for policy 1, policy_version 578841 (0.0008) [2023-12-27 23:23:18,640][106225] Updated weights for policy 1, policy_version 578851 (0.0008) [2023-12-27 23:23:18,689][106225] Updated weights for policy 1, policy_version 578861 (0.0009) [2023-12-27 23:23:19,247][106226] Updated weights for policy 0, policy_version 576913 (0.0009) [2023-12-27 23:23:19,313][106226] Updated weights for policy 0, policy_version 576923 (0.0008) [2023-12-27 23:23:19,384][106226] Updated weights for policy 0, policy_version 576933 (0.0008) [2023-12-27 23:23:19,452][106226] Updated weights for policy 0, policy_version 576943 (0.0008) [2023-12-27 23:23:19,479][106225] Updated weights for policy 1, policy_version 578871 (0.0008) [2023-12-27 23:23:19,549][106225] Updated weights for policy 1, policy_version 578881 (0.0009) [2023-12-27 23:23:19,610][106225] Updated weights for policy 1, policy_version 578891 (0.0007) [2023-12-27 23:23:20,233][106226] Updated weights for policy 0, policy_version 576953 (0.0006) [2023-12-27 23:23:20,300][106226] Updated weights for policy 0, policy_version 576963 (0.0008) [2023-12-27 23:23:20,318][106225] Updated weights for policy 1, policy_version 578901 (0.0006) [2023-12-27 23:23:20,364][106226] Updated weights for policy 0, policy_version 576973 (0.0007) [2023-12-27 23:23:20,379][106225] Updated weights for policy 1, policy_version 578911 (0.0006) [2023-12-27 23:23:20,445][106225] Updated weights for policy 1, policy_version 578921 (0.0007) [2023-12-27 23:23:21,139][106225] Updated weights for policy 1, policy_version 578931 (0.0009) [2023-12-27 23:23:21,148][106226] Updated weights for policy 0, policy_version 576983 (0.0008) [2023-12-27 23:23:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 295976960. Throughput: 0: 9830.8, 1: 9719.1. Samples: 295992092. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:21,175][105115] Avg episode reward: [(0, '-5.185'), (1, '-5.602')] [2023-12-27 23:23:21,196][106225] Updated weights for policy 1, policy_version 578941 (0.0007) [2023-12-27 23:23:21,211][106226] Updated weights for policy 0, policy_version 576993 (0.0007) [2023-12-27 23:23:21,254][106225] Updated weights for policy 1, policy_version 578951 (0.0007) [2023-12-27 23:23:21,281][106226] Updated weights for policy 0, policy_version 577003 (0.0008) [2023-12-27 23:23:21,962][106226] Updated weights for policy 0, policy_version 577013 (0.0008) [2023-12-27 23:23:22,024][106226] Updated weights for policy 0, policy_version 577023 (0.0008) [2023-12-27 23:23:22,060][106225] Updated weights for policy 1, policy_version 578961 (0.0008) [2023-12-27 23:23:22,090][106226] Updated weights for policy 0, policy_version 577033 (0.0007) [2023-12-27 23:23:22,123][106225] Updated weights for policy 1, policy_version 578971 (0.0006) [2023-12-27 23:23:22,191][106225] Updated weights for policy 1, policy_version 578981 (0.0007) [2023-12-27 23:23:22,255][106225] Updated weights for policy 1, policy_version 578991 (0.0007) [2023-12-27 23:23:22,861][106226] Updated weights for policy 0, policy_version 577043 (0.0009) [2023-12-27 23:23:22,920][106226] Updated weights for policy 0, policy_version 577053 (0.0008) [2023-12-27 23:23:22,979][106226] Updated weights for policy 0, policy_version 577063 (0.0007) [2023-12-27 23:23:23,004][106225] Updated weights for policy 1, policy_version 579001 (0.0008) [2023-12-27 23:23:23,059][106225] Updated weights for policy 1, policy_version 579011 (0.0008) [2023-12-27 23:23:23,109][106225] Updated weights for policy 1, policy_version 579021 (0.0009) [2023-12-27 23:23:23,646][106226] Updated weights for policy 0, policy_version 577073 (0.0007) [2023-12-27 23:23:23,705][106226] Updated weights for policy 0, policy_version 577083 (0.0008) [2023-12-27 23:23:23,766][106226] Updated weights for policy 0, policy_version 577093 (0.0007) [2023-12-27 23:23:23,825][106226] Updated weights for policy 0, policy_version 577103 (0.0008) [2023-12-27 23:23:23,871][106225] Updated weights for policy 1, policy_version 579031 (0.0009) [2023-12-27 23:23:23,921][106225] Updated weights for policy 1, policy_version 579041 (0.0009) [2023-12-27 23:23:23,980][106225] Updated weights for policy 1, policy_version 579051 (0.0009) [2023-12-27 23:23:24,416][106226] Updated weights for policy 0, policy_version 577113 (0.0008) [2023-12-27 23:23:24,463][106226] Updated weights for policy 0, policy_version 577123 (0.0008) [2023-12-27 23:23:24,515][106226] Updated weights for policy 0, policy_version 577133 (0.0009) [2023-12-27 23:23:24,766][106225] Updated weights for policy 1, policy_version 579061 (0.0009) [2023-12-27 23:23:24,824][106225] Updated weights for policy 1, policy_version 579071 (0.0008) [2023-12-27 23:23:24,887][106225] Updated weights for policy 1, policy_version 579081 (0.0008) [2023-12-27 23:23:25,149][106226] Updated weights for policy 0, policy_version 577143 (0.0009) [2023-12-27 23:23:25,208][106226] Updated weights for policy 0, policy_version 577153 (0.0008) [2023-12-27 23:23:25,274][106226] Updated weights for policy 0, policy_version 577163 (0.0009) [2023-12-27 23:23:25,654][106225] Updated weights for policy 1, policy_version 579091 (0.0009) [2023-12-27 23:23:25,707][106225] Updated weights for policy 1, policy_version 579101 (0.0008) [2023-12-27 23:23:25,757][106225] Updated weights for policy 1, policy_version 579111 (0.0008) [2023-12-27 23:23:26,003][106226] Updated weights for policy 0, policy_version 577173 (0.0008) [2023-12-27 23:23:26,066][106226] Updated weights for policy 0, policy_version 577183 (0.0008) [2023-12-27 23:23:26,127][106226] Updated weights for policy 0, policy_version 577193 (0.0008) [2023-12-27 23:23:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 296083456. Throughput: 0: 9865.0, 1: 9624.4. Samples: 296049184. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:26,176][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.727')] [2023-12-27 23:23:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000577200_147800064.pth... [2023-12-27 23:23:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000579120_148283392.pth... [2023-12-27 23:23:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000576048_147505152.pth [2023-12-27 23:23:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000578000_147996672.pth [2023-12-27 23:23:26,412][106225] Updated weights for policy 1, policy_version 579121 (0.0007) [2023-12-27 23:23:26,474][106225] Updated weights for policy 1, policy_version 579131 (0.0010) [2023-12-27 23:23:26,523][106225] Updated weights for policy 1, policy_version 579141 (0.0010) [2023-12-27 23:23:26,568][106225] Updated weights for policy 1, policy_version 579151 (0.0005) [2023-12-27 23:23:26,887][106226] Updated weights for policy 0, policy_version 577203 (0.0008) [2023-12-27 23:23:26,940][106226] Updated weights for policy 0, policy_version 577213 (0.0008) [2023-12-27 23:23:26,998][106226] Updated weights for policy 0, policy_version 577223 (0.0007) [2023-12-27 23:23:27,168][106225] Updated weights for policy 1, policy_version 579161 (0.0010) [2023-12-27 23:23:27,221][106225] Updated weights for policy 1, policy_version 579171 (0.0010) [2023-12-27 23:23:27,277][106225] Updated weights for policy 1, policy_version 579181 (0.0010) [2023-12-27 23:23:27,722][106226] Updated weights for policy 0, policy_version 577233 (0.0008) [2023-12-27 23:23:27,786][106226] Updated weights for policy 0, policy_version 577243 (0.0005) [2023-12-27 23:23:27,846][106226] Updated weights for policy 0, policy_version 577253 (0.0005) [2023-12-27 23:23:27,899][106226] Updated weights for policy 0, policy_version 577263 (0.0005) [2023-12-27 23:23:27,908][106225] Updated weights for policy 1, policy_version 579191 (0.0010) [2023-12-27 23:23:27,960][106225] Updated weights for policy 1, policy_version 579201 (0.0010) [2023-12-27 23:23:28,026][106225] Updated weights for policy 1, policy_version 579211 (0.0010) [2023-12-27 23:23:28,448][106226] Updated weights for policy 0, policy_version 577273 (0.0005) [2023-12-27 23:23:28,521][106226] Updated weights for policy 0, policy_version 577283 (0.0005) [2023-12-27 23:23:28,583][106226] Updated weights for policy 0, policy_version 577293 (0.0006) [2023-12-27 23:23:28,692][106225] Updated weights for policy 1, policy_version 579221 (0.0008) [2023-12-27 23:23:28,760][106225] Updated weights for policy 1, policy_version 579231 (0.0006) [2023-12-27 23:23:28,817][106225] Updated weights for policy 1, policy_version 579241 (0.0008) [2023-12-27 23:23:29,167][106226] Updated weights for policy 0, policy_version 577303 (0.0006) [2023-12-27 23:23:29,219][106226] Updated weights for policy 0, policy_version 577313 (0.0006) [2023-12-27 23:23:29,288][106226] Updated weights for policy 0, policy_version 577323 (0.0007) [2023-12-27 23:23:29,545][106225] Updated weights for policy 1, policy_version 579251 (0.0009) [2023-12-27 23:23:29,603][106225] Updated weights for policy 1, policy_version 579261 (0.0010) [2023-12-27 23:23:29,663][106225] Updated weights for policy 1, policy_version 579271 (0.0008) [2023-12-27 23:23:30,024][106226] Updated weights for policy 0, policy_version 577333 (0.0007) [2023-12-27 23:23:30,089][106226] Updated weights for policy 0, policy_version 577343 (0.0008) [2023-12-27 23:23:30,146][106226] Updated weights for policy 0, policy_version 577353 (0.0008) [2023-12-27 23:23:30,369][106225] Updated weights for policy 1, policy_version 579281 (0.0006) [2023-12-27 23:23:30,423][106225] Updated weights for policy 1, policy_version 579291 (0.0009) [2023-12-27 23:23:30,473][106225] Updated weights for policy 1, policy_version 579301 (0.0010) [2023-12-27 23:23:30,527][106225] Updated weights for policy 1, policy_version 579311 (0.0010) [2023-12-27 23:23:30,886][106226] Updated weights for policy 0, policy_version 577363 (0.0008) [2023-12-27 23:23:30,942][106226] Updated weights for policy 0, policy_version 577373 (0.0008) [2023-12-27 23:23:30,999][106226] Updated weights for policy 0, policy_version 577383 (0.0008) [2023-12-27 23:23:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 296181760. Throughput: 0: 9933.1, 1: 9647.3. Samples: 296171280. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:31,175][105115] Avg episode reward: [(0, '-4.948'), (1, '-5.861')] [2023-12-27 23:23:31,296][106225] Updated weights for policy 1, policy_version 579321 (0.0007) [2023-12-27 23:23:31,365][106225] Updated weights for policy 1, policy_version 579331 (0.0007) [2023-12-27 23:23:31,434][106225] Updated weights for policy 1, policy_version 579341 (0.0008) [2023-12-27 23:23:31,771][106226] Updated weights for policy 0, policy_version 577393 (0.0008) [2023-12-27 23:23:31,828][106226] Updated weights for policy 0, policy_version 577403 (0.0008) [2023-12-27 23:23:31,879][106226] Updated weights for policy 0, policy_version 577413 (0.0008) [2023-12-27 23:23:31,931][106226] Updated weights for policy 0, policy_version 577423 (0.0006) [2023-12-27 23:23:32,122][106225] Updated weights for policy 1, policy_version 579351 (0.0010) [2023-12-27 23:23:32,178][106225] Updated weights for policy 1, policy_version 579361 (0.0010) [2023-12-27 23:23:32,235][106225] Updated weights for policy 1, policy_version 579371 (0.0010) [2023-12-27 23:23:32,667][106226] Updated weights for policy 0, policy_version 577433 (0.0006) [2023-12-27 23:23:32,726][106226] Updated weights for policy 0, policy_version 577443 (0.0007) [2023-12-27 23:23:32,779][106226] Updated weights for policy 0, policy_version 577453 (0.0008) [2023-12-27 23:23:32,986][106225] Updated weights for policy 1, policy_version 579381 (0.0010) [2023-12-27 23:23:33,036][106225] Updated weights for policy 1, policy_version 579391 (0.0008) [2023-12-27 23:23:33,090][106225] Updated weights for policy 1, policy_version 579401 (0.0009) [2023-12-27 23:23:33,450][106226] Updated weights for policy 0, policy_version 577463 (0.0009) [2023-12-27 23:23:33,503][106226] Updated weights for policy 0, policy_version 577473 (0.0008) [2023-12-27 23:23:33,561][106226] Updated weights for policy 0, policy_version 577483 (0.0008) [2023-12-27 23:23:33,826][106225] Updated weights for policy 1, policy_version 579411 (0.0009) [2023-12-27 23:23:33,883][106225] Updated weights for policy 1, policy_version 579421 (0.0009) [2023-12-27 23:23:33,939][106225] Updated weights for policy 1, policy_version 579431 (0.0009) [2023-12-27 23:23:34,288][106226] Updated weights for policy 0, policy_version 577493 (0.0008) [2023-12-27 23:23:34,355][106226] Updated weights for policy 0, policy_version 577503 (0.0008) [2023-12-27 23:23:34,418][106226] Updated weights for policy 0, policy_version 577513 (0.0008) [2023-12-27 23:23:34,693][106225] Updated weights for policy 1, policy_version 579441 (0.0008) [2023-12-27 23:23:34,756][106225] Updated weights for policy 1, policy_version 579451 (0.0008) [2023-12-27 23:23:34,813][106225] Updated weights for policy 1, policy_version 579461 (0.0008) [2023-12-27 23:23:34,869][106225] Updated weights for policy 1, policy_version 579471 (0.0007) [2023-12-27 23:23:35,094][106226] Updated weights for policy 0, policy_version 577523 (0.0008) [2023-12-27 23:23:35,143][106226] Updated weights for policy 0, policy_version 577533 (0.0005) [2023-12-27 23:23:35,194][106226] Updated weights for policy 0, policy_version 577543 (0.0005) [2023-12-27 23:23:35,678][106225] Updated weights for policy 1, policy_version 579481 (0.0009) [2023-12-27 23:23:35,733][106225] Updated weights for policy 1, policy_version 579491 (0.0008) [2023-12-27 23:23:35,760][106226] Updated weights for policy 0, policy_version 577553 (0.0005) [2023-12-27 23:23:35,788][106225] Updated weights for policy 1, policy_version 579501 (0.0009) [2023-12-27 23:23:35,825][106226] Updated weights for policy 0, policy_version 577563 (0.0009) [2023-12-27 23:23:35,882][106226] Updated weights for policy 0, policy_version 577573 (0.0011) [2023-12-27 23:23:35,949][106226] Updated weights for policy 0, policy_version 577583 (0.0010) [2023-12-27 23:23:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 296280064. Throughput: 0: 9885.8, 1: 9653.9. Samples: 296287476. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:36,176][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.888')] [2023-12-27 23:23:36,558][106225] Updated weights for policy 1, policy_version 579511 (0.0008) [2023-12-27 23:23:36,607][106225] Updated weights for policy 1, policy_version 579521 (0.0010) [2023-12-27 23:23:36,669][106225] Updated weights for policy 1, policy_version 579531 (0.0007) [2023-12-27 23:23:36,698][106226] Updated weights for policy 0, policy_version 577593 (0.0009) [2023-12-27 23:23:36,758][106226] Updated weights for policy 0, policy_version 577603 (0.0009) [2023-12-27 23:23:36,824][106226] Updated weights for policy 0, policy_version 577613 (0.0009) [2023-12-27 23:23:37,448][106226] Updated weights for policy 0, policy_version 577623 (0.0009) [2023-12-27 23:23:37,466][106225] Updated weights for policy 1, policy_version 579541 (0.0005) [2023-12-27 23:23:37,501][106226] Updated weights for policy 0, policy_version 577633 (0.0008) [2023-12-27 23:23:37,515][106225] Updated weights for policy 1, policy_version 579551 (0.0007) [2023-12-27 23:23:37,562][106226] Updated weights for policy 0, policy_version 577643 (0.0007) [2023-12-27 23:23:37,571][106225] Updated weights for policy 1, policy_version 579561 (0.0009) [2023-12-27 23:23:38,223][106225] Updated weights for policy 1, policy_version 579571 (0.0006) [2023-12-27 23:23:38,268][106226] Updated weights for policy 0, policy_version 577653 (0.0007) [2023-12-27 23:23:38,287][106225] Updated weights for policy 1, policy_version 579581 (0.0006) [2023-12-27 23:23:38,325][106226] Updated weights for policy 0, policy_version 577663 (0.0008) [2023-12-27 23:23:38,353][106225] Updated weights for policy 1, policy_version 579591 (0.0007) [2023-12-27 23:23:38,418][106226] Updated weights for policy 0, policy_version 577673 (0.0009) [2023-12-27 23:23:39,002][106225] Updated weights for policy 1, policy_version 579601 (0.0006) [2023-12-27 23:23:39,062][106226] Updated weights for policy 0, policy_version 577683 (0.0006) [2023-12-27 23:23:39,070][106225] Updated weights for policy 1, policy_version 579611 (0.0005) [2023-12-27 23:23:39,116][106226] Updated weights for policy 0, policy_version 577693 (0.0008) [2023-12-27 23:23:39,132][106225] Updated weights for policy 1, policy_version 579621 (0.0005) [2023-12-27 23:23:39,172][106226] Updated weights for policy 0, policy_version 577703 (0.0007) [2023-12-27 23:23:39,194][106225] Updated weights for policy 1, policy_version 579631 (0.0008) [2023-12-27 23:23:39,843][106225] Updated weights for policy 1, policy_version 579641 (0.0009) [2023-12-27 23:23:39,905][106225] Updated weights for policy 1, policy_version 579651 (0.0010) [2023-12-27 23:23:39,962][106225] Updated weights for policy 1, policy_version 579661 (0.0008) [2023-12-27 23:23:40,023][106226] Updated weights for policy 0, policy_version 577713 (0.0009) [2023-12-27 23:23:40,089][106226] Updated weights for policy 0, policy_version 577723 (0.0008) [2023-12-27 23:23:40,146][106226] Updated weights for policy 0, policy_version 577733 (0.0007) [2023-12-27 23:23:40,203][106226] Updated weights for policy 0, policy_version 577743 (0.0008) [2023-12-27 23:23:40,686][106225] Updated weights for policy 1, policy_version 579671 (0.0006) [2023-12-27 23:23:40,746][106225] Updated weights for policy 1, policy_version 579681 (0.0008) [2023-12-27 23:23:40,796][106225] Updated weights for policy 1, policy_version 579691 (0.0010) [2023-12-27 23:23:40,995][106226] Updated weights for policy 0, policy_version 577753 (0.0008) [2023-12-27 23:23:41,083][106226] Updated weights for policy 0, policy_version 577763 (0.0009) [2023-12-27 23:23:41,149][106226] Updated weights for policy 0, policy_version 577773 (0.0008) [2023-12-27 23:23:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 296378368. Throughput: 0: 9932.9, 1: 9664.1. Samples: 296346720. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:41,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-5.530')] [2023-12-27 23:23:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000579696_148430848.pth... [2023-12-27 23:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000577776_147947520.pth... [2023-12-27 23:23:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000578576_148144128.pth [2023-12-27 23:23:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000576624_147652608.pth [2023-12-27 23:23:41,551][106225] Updated weights for policy 1, policy_version 579701 (0.0010) [2023-12-27 23:23:41,618][106225] Updated weights for policy 1, policy_version 579711 (0.0007) [2023-12-27 23:23:41,683][106225] Updated weights for policy 1, policy_version 579721 (0.0009) [2023-12-27 23:23:41,954][106226] Updated weights for policy 0, policy_version 577783 (0.0009) [2023-12-27 23:23:42,016][106226] Updated weights for policy 0, policy_version 577793 (0.0010) [2023-12-27 23:23:42,079][106226] Updated weights for policy 0, policy_version 577803 (0.0009) [2023-12-27 23:23:42,341][106225] Updated weights for policy 1, policy_version 579731 (0.0008) [2023-12-27 23:23:42,409][106225] Updated weights for policy 1, policy_version 579741 (0.0008) [2023-12-27 23:23:42,474][106225] Updated weights for policy 1, policy_version 579751 (0.0009) [2023-12-27 23:23:42,790][106226] Updated weights for policy 0, policy_version 577813 (0.0008) [2023-12-27 23:23:42,867][106226] Updated weights for policy 0, policy_version 577823 (0.0005) [2023-12-27 23:23:42,916][106226] Updated weights for policy 0, policy_version 577833 (0.0005) [2023-12-27 23:23:43,320][106225] Updated weights for policy 1, policy_version 579761 (0.0007) [2023-12-27 23:23:43,381][106225] Updated weights for policy 1, policy_version 579771 (0.0008) [2023-12-27 23:23:43,426][106226] Updated weights for policy 0, policy_version 577843 (0.0007) [2023-12-27 23:23:43,444][106225] Updated weights for policy 1, policy_version 579781 (0.0008) [2023-12-27 23:23:43,481][106226] Updated weights for policy 0, policy_version 577853 (0.0006) [2023-12-27 23:23:43,504][106225] Updated weights for policy 1, policy_version 579791 (0.0009) [2023-12-27 23:23:43,538][106226] Updated weights for policy 0, policy_version 577863 (0.0008) [2023-12-27 23:23:44,114][106225] Updated weights for policy 1, policy_version 579801 (0.0008) [2023-12-27 23:23:44,158][106225] Updated weights for policy 1, policy_version 579811 (0.0008) [2023-12-27 23:23:44,212][106225] Updated weights for policy 1, policy_version 579821 (0.0007) [2023-12-27 23:23:44,293][106226] Updated weights for policy 0, policy_version 577873 (0.0008) [2023-12-27 23:23:44,356][106226] Updated weights for policy 0, policy_version 577883 (0.0008) [2023-12-27 23:23:44,412][106226] Updated weights for policy 0, policy_version 577893 (0.0009) [2023-12-27 23:23:44,465][106226] Updated weights for policy 0, policy_version 577903 (0.0009) [2023-12-27 23:23:44,967][106225] Updated weights for policy 1, policy_version 579831 (0.0009) [2023-12-27 23:23:45,025][106225] Updated weights for policy 1, policy_version 579841 (0.0008) [2023-12-27 23:23:45,091][106225] Updated weights for policy 1, policy_version 579851 (0.0009) [2023-12-27 23:23:45,159][106226] Updated weights for policy 0, policy_version 577913 (0.0007) [2023-12-27 23:23:45,227][106226] Updated weights for policy 0, policy_version 577923 (0.0007) [2023-12-27 23:23:45,287][106226] Updated weights for policy 0, policy_version 577933 (0.0007) [2023-12-27 23:23:45,857][106225] Updated weights for policy 1, policy_version 579861 (0.0007) [2023-12-27 23:23:45,911][106225] Updated weights for policy 1, policy_version 579871 (0.0005) [2023-12-27 23:23:45,954][106226] Updated weights for policy 0, policy_version 577943 (0.0006) [2023-12-27 23:23:45,967][106225] Updated weights for policy 1, policy_version 579881 (0.0006) [2023-12-27 23:23:46,014][106226] Updated weights for policy 0, policy_version 577953 (0.0006) [2023-12-27 23:23:46,067][106226] Updated weights for policy 0, policy_version 577963 (0.0005) [2023-12-27 23:23:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 296476672. Throughput: 0: 9842.6, 1: 9736.2. Samples: 296462164. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:46,176][105115] Avg episode reward: [(0, '-5.054'), (1, '-5.492')] [2023-12-27 23:23:46,492][106225] Updated weights for policy 1, policy_version 579891 (0.0005) [2023-12-27 23:23:46,541][106225] Updated weights for policy 1, policy_version 579901 (0.0006) [2023-12-27 23:23:46,602][106225] Updated weights for policy 1, policy_version 579911 (0.0007) [2023-12-27 23:23:46,721][106226] Updated weights for policy 0, policy_version 577973 (0.0006) [2023-12-27 23:23:46,791][106226] Updated weights for policy 0, policy_version 577983 (0.0009) [2023-12-27 23:23:46,852][106226] Updated weights for policy 0, policy_version 577993 (0.0008) [2023-12-27 23:23:47,229][106225] Updated weights for policy 1, policy_version 579921 (0.0006) [2023-12-27 23:23:47,287][106225] Updated weights for policy 1, policy_version 579931 (0.0007) [2023-12-27 23:23:47,339][106225] Updated weights for policy 1, policy_version 579941 (0.0008) [2023-12-27 23:23:47,398][106225] Updated weights for policy 1, policy_version 579951 (0.0007) [2023-12-27 23:23:47,601][106226] Updated weights for policy 0, policy_version 578003 (0.0007) [2023-12-27 23:23:47,657][106226] Updated weights for policy 0, policy_version 578013 (0.0005) [2023-12-27 23:23:47,708][106226] Updated weights for policy 0, policy_version 578023 (0.0007) [2023-12-27 23:23:48,096][106225] Updated weights for policy 1, policy_version 579961 (0.0007) [2023-12-27 23:23:48,156][106225] Updated weights for policy 1, policy_version 579971 (0.0008) [2023-12-27 23:23:48,206][106225] Updated weights for policy 1, policy_version 579981 (0.0007) [2023-12-27 23:23:48,395][106226] Updated weights for policy 0, policy_version 578033 (0.0008) [2023-12-27 23:23:48,457][106226] Updated weights for policy 0, policy_version 578043 (0.0008) [2023-12-27 23:23:48,508][106226] Updated weights for policy 0, policy_version 578053 (0.0008) [2023-12-27 23:23:48,579][106226] Updated weights for policy 0, policy_version 578063 (0.0007) [2023-12-27 23:23:49,007][106225] Updated weights for policy 1, policy_version 579991 (0.0009) [2023-12-27 23:23:49,065][106225] Updated weights for policy 1, policy_version 580001 (0.0008) [2023-12-27 23:23:49,120][106225] Updated weights for policy 1, policy_version 580011 (0.0008) [2023-12-27 23:23:49,297][106226] Updated weights for policy 0, policy_version 578073 (0.0008) [2023-12-27 23:23:49,366][106226] Updated weights for policy 0, policy_version 578083 (0.0008) [2023-12-27 23:23:49,434][106226] Updated weights for policy 0, policy_version 578093 (0.0006) [2023-12-27 23:23:49,902][106225] Updated weights for policy 1, policy_version 580021 (0.0009) [2023-12-27 23:23:49,967][106225] Updated weights for policy 1, policy_version 580031 (0.0009) [2023-12-27 23:23:50,034][106225] Updated weights for policy 1, policy_version 580041 (0.0008) [2023-12-27 23:23:50,087][106226] Updated weights for policy 0, policy_version 578103 (0.0006) [2023-12-27 23:23:50,155][106226] Updated weights for policy 0, policy_version 578113 (0.0007) [2023-12-27 23:23:50,219][106226] Updated weights for policy 0, policy_version 578123 (0.0009) [2023-12-27 23:23:50,660][106225] Updated weights for policy 1, policy_version 580051 (0.0007) [2023-12-27 23:23:50,722][106225] Updated weights for policy 1, policy_version 580061 (0.0007) [2023-12-27 23:23:50,774][106225] Updated weights for policy 1, policy_version 580071 (0.0008) [2023-12-27 23:23:50,977][106226] Updated weights for policy 0, policy_version 578133 (0.0008) [2023-12-27 23:23:51,047][106226] Updated weights for policy 0, policy_version 578143 (0.0008) [2023-12-27 23:23:51,113][106226] Updated weights for policy 0, policy_version 578153 (0.0009) [2023-12-27 23:23:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 296574976. Throughput: 0: 9844.5, 1: 9682.3. Samples: 296580468. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:51,175][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.762')] [2023-12-27 23:23:51,537][106225] Updated weights for policy 1, policy_version 580081 (0.0009) [2023-12-27 23:23:51,599][106225] Updated weights for policy 1, policy_version 580091 (0.0008) [2023-12-27 23:23:51,668][106225] Updated weights for policy 1, policy_version 580101 (0.0008) [2023-12-27 23:23:51,736][106225] Updated weights for policy 1, policy_version 580111 (0.0008) [2023-12-27 23:23:51,945][106226] Updated weights for policy 0, policy_version 578163 (0.0010) [2023-12-27 23:23:52,007][106226] Updated weights for policy 0, policy_version 578173 (0.0008) [2023-12-27 23:23:52,070][106226] Updated weights for policy 0, policy_version 578183 (0.0008) [2023-12-27 23:23:52,513][106225] Updated weights for policy 1, policy_version 580121 (0.0008) [2023-12-27 23:23:52,564][106225] Updated weights for policy 1, policy_version 580131 (0.0009) [2023-12-27 23:23:52,625][106225] Updated weights for policy 1, policy_version 580141 (0.0010) [2023-12-27 23:23:52,809][106226] Updated weights for policy 0, policy_version 578193 (0.0008) [2023-12-27 23:23:52,870][106226] Updated weights for policy 0, policy_version 578203 (0.0009) [2023-12-27 23:23:52,927][106226] Updated weights for policy 0, policy_version 578213 (0.0009) [2023-12-27 23:23:52,989][106226] Updated weights for policy 0, policy_version 578223 (0.0009) [2023-12-27 23:23:53,370][106225] Updated weights for policy 1, policy_version 580151 (0.0009) [2023-12-27 23:23:53,431][106225] Updated weights for policy 1, policy_version 580161 (0.0008) [2023-12-27 23:23:53,488][106225] Updated weights for policy 1, policy_version 580171 (0.0008) [2023-12-27 23:23:53,683][106226] Updated weights for policy 0, policy_version 578233 (0.0009) [2023-12-27 23:23:53,733][106226] Updated weights for policy 0, policy_version 578243 (0.0009) [2023-12-27 23:23:53,784][106226] Updated weights for policy 0, policy_version 578253 (0.0009) [2023-12-27 23:23:54,146][106225] Updated weights for policy 1, policy_version 580181 (0.0008) [2023-12-27 23:23:54,201][106225] Updated weights for policy 1, policy_version 580191 (0.0008) [2023-12-27 23:23:54,264][106225] Updated weights for policy 1, policy_version 580201 (0.0009) [2023-12-27 23:23:54,550][106226] Updated weights for policy 0, policy_version 578263 (0.0009) [2023-12-27 23:23:54,609][106226] Updated weights for policy 0, policy_version 578273 (0.0009) [2023-12-27 23:23:54,661][106226] Updated weights for policy 0, policy_version 578283 (0.0009) [2023-12-27 23:23:54,983][106225] Updated weights for policy 1, policy_version 580211 (0.0009) [2023-12-27 23:23:55,043][106225] Updated weights for policy 1, policy_version 580221 (0.0007) [2023-12-27 23:23:55,090][106225] Updated weights for policy 1, policy_version 580231 (0.0008) [2023-12-27 23:23:55,351][106226] Updated weights for policy 0, policy_version 578293 (0.0010) [2023-12-27 23:23:55,397][106226] Updated weights for policy 0, policy_version 578303 (0.0010) [2023-12-27 23:23:55,450][106226] Updated weights for policy 0, policy_version 578313 (0.0010) [2023-12-27 23:23:55,823][106225] Updated weights for policy 1, policy_version 580241 (0.0007) [2023-12-27 23:23:55,868][106225] Updated weights for policy 1, policy_version 580251 (0.0007) [2023-12-27 23:23:55,911][106225] Updated weights for policy 1, policy_version 580261 (0.0005) [2023-12-27 23:23:55,960][106225] Updated weights for policy 1, policy_version 580271 (0.0007) [2023-12-27 23:23:56,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 296665088. Throughput: 0: 9799.0, 1: 9684.7. Samples: 296636024. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:23:56,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-5.647')] [2023-12-27 23:23:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000580272_148578304.pth... [2023-12-27 23:23:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000579120_148283392.pth [2023-12-27 23:23:56,189][106226] Updated weights for policy 0, policy_version 578323 (0.0010) [2023-12-27 23:23:56,245][106226] Updated weights for policy 0, policy_version 578333 (0.0010) [2023-12-27 23:23:56,309][106226] Updated weights for policy 0, policy_version 578343 (0.0008) [2023-12-27 23:23:56,371][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000578352_148094976.pth... [2023-12-27 23:23:56,377][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000577200_147800064.pth [2023-12-27 23:23:56,605][106225] Updated weights for policy 1, policy_version 580281 (0.0006) [2023-12-27 23:23:56,670][106225] Updated weights for policy 1, policy_version 580291 (0.0008) [2023-12-27 23:23:56,734][106225] Updated weights for policy 1, policy_version 580301 (0.0008) [2023-12-27 23:23:56,875][106226] Updated weights for policy 0, policy_version 578353 (0.0008) [2023-12-27 23:23:56,933][106226] Updated weights for policy 0, policy_version 578363 (0.0007) [2023-12-27 23:23:56,996][106226] Updated weights for policy 0, policy_version 578373 (0.0007) [2023-12-27 23:23:57,053][106226] Updated weights for policy 0, policy_version 578383 (0.0007) [2023-12-27 23:23:57,288][106225] Updated weights for policy 1, policy_version 580311 (0.0007) [2023-12-27 23:23:57,361][106225] Updated weights for policy 1, policy_version 580321 (0.0008) [2023-12-27 23:23:57,432][106225] Updated weights for policy 1, policy_version 580331 (0.0008) [2023-12-27 23:23:57,613][106226] Updated weights for policy 0, policy_version 578393 (0.0005) [2023-12-27 23:23:57,685][106226] Updated weights for policy 0, policy_version 578403 (0.0005) [2023-12-27 23:23:57,746][106226] Updated weights for policy 0, policy_version 578413 (0.0005) [2023-12-27 23:23:58,081][106225] Updated weights for policy 1, policy_version 580341 (0.0008) [2023-12-27 23:23:58,142][106225] Updated weights for policy 1, policy_version 580351 (0.0009) [2023-12-27 23:23:58,209][106225] Updated weights for policy 1, policy_version 580361 (0.0008) [2023-12-27 23:23:58,241][106226] Updated weights for policy 0, policy_version 578423 (0.0007) [2023-12-27 23:23:58,309][106226] Updated weights for policy 0, policy_version 578433 (0.0011) [2023-12-27 23:23:58,383][106226] Updated weights for policy 0, policy_version 578443 (0.0010) [2023-12-27 23:23:58,971][106225] Updated weights for policy 1, policy_version 580371 (0.0007) [2023-12-27 23:23:59,030][106225] Updated weights for policy 1, policy_version 580381 (0.0007) [2023-12-27 23:23:59,086][106225] Updated weights for policy 1, policy_version 580391 (0.0007) [2023-12-27 23:23:59,152][106226] Updated weights for policy 0, policy_version 578453 (0.0011) [2023-12-27 23:23:59,206][106226] Updated weights for policy 0, policy_version 578463 (0.0010) [2023-12-27 23:23:59,287][106226] Updated weights for policy 0, policy_version 578473 (0.0008) [2023-12-27 23:23:59,886][106225] Updated weights for policy 1, policy_version 580401 (0.0007) [2023-12-27 23:23:59,965][106225] Updated weights for policy 1, policy_version 580411 (0.0008) [2023-12-27 23:23:59,966][106226] Updated weights for policy 0, policy_version 578483 (0.0009) [2023-12-27 23:24:00,027][106226] Updated weights for policy 0, policy_version 578493 (0.0007) [2023-12-27 23:24:00,028][106225] Updated weights for policy 1, policy_version 580421 (0.0006) [2023-12-27 23:24:00,080][106226] Updated weights for policy 0, policy_version 578503 (0.0008) [2023-12-27 23:24:00,086][106225] Updated weights for policy 1, policy_version 580431 (0.0007) [2023-12-27 23:24:00,794][106225] Updated weights for policy 1, policy_version 580441 (0.0011) [2023-12-27 23:24:00,812][106226] Updated weights for policy 0, policy_version 578513 (0.0008) [2023-12-27 23:24:00,852][106225] Updated weights for policy 1, policy_version 580451 (0.0010) [2023-12-27 23:24:00,866][106226] Updated weights for policy 0, policy_version 578523 (0.0005) [2023-12-27 23:24:00,913][106225] Updated weights for policy 1, policy_version 580461 (0.0007) [2023-12-27 23:24:00,919][106226] Updated weights for policy 0, policy_version 578533 (0.0007) [2023-12-27 23:24:00,972][106226] Updated weights for policy 0, policy_version 578543 (0.0006) [2023-12-27 23:24:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 296771584. Throughput: 0: 9846.1, 1: 9750.9. Samples: 296758708. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:01,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-5.410')] [2023-12-27 23:24:01,620][106225] Updated weights for policy 1, policy_version 580471 (0.0009) [2023-12-27 23:24:01,673][106226] Updated weights for policy 0, policy_version 578553 (0.0008) [2023-12-27 23:24:01,684][106225] Updated weights for policy 1, policy_version 580481 (0.0007) [2023-12-27 23:24:01,740][106226] Updated weights for policy 0, policy_version 578563 (0.0008) [2023-12-27 23:24:01,753][106225] Updated weights for policy 1, policy_version 580491 (0.0007) [2023-12-27 23:24:01,802][106226] Updated weights for policy 0, policy_version 578573 (0.0005) [2023-12-27 23:24:02,389][106226] Updated weights for policy 0, policy_version 578583 (0.0007) [2023-12-27 23:24:02,445][106226] Updated weights for policy 0, policy_version 578593 (0.0006) [2023-12-27 23:24:02,494][106226] Updated weights for policy 0, policy_version 578603 (0.0006) [2023-12-27 23:24:02,502][106225] Updated weights for policy 1, policy_version 580501 (0.0006) [2023-12-27 23:24:02,554][106225] Updated weights for policy 1, policy_version 580511 (0.0005) [2023-12-27 23:24:02,618][106225] Updated weights for policy 1, policy_version 580521 (0.0006) [2023-12-27 23:24:03,138][106225] Updated weights for policy 1, policy_version 580531 (0.0006) [2023-12-27 23:24:03,190][106225] Updated weights for policy 1, policy_version 580541 (0.0006) [2023-12-27 23:24:03,199][106226] Updated weights for policy 0, policy_version 578613 (0.0008) [2023-12-27 23:24:03,244][106225] Updated weights for policy 1, policy_version 580551 (0.0006) [2023-12-27 23:24:03,252][106226] Updated weights for policy 0, policy_version 578623 (0.0010) [2023-12-27 23:24:03,308][106226] Updated weights for policy 0, policy_version 578633 (0.0010) [2023-12-27 23:24:03,908][106225] Updated weights for policy 1, policy_version 580561 (0.0006) [2023-12-27 23:24:03,965][106225] Updated weights for policy 1, policy_version 580571 (0.0010) [2023-12-27 23:24:04,023][106225] Updated weights for policy 1, policy_version 580581 (0.0010) [2023-12-27 23:24:04,027][106226] Updated weights for policy 0, policy_version 578643 (0.0010) [2023-12-27 23:24:04,074][106225] Updated weights for policy 1, policy_version 580591 (0.0010) [2023-12-27 23:24:04,078][106226] Updated weights for policy 0, policy_version 578653 (0.0010) [2023-12-27 23:24:04,136][106226] Updated weights for policy 0, policy_version 578663 (0.0011) [2023-12-27 23:24:04,795][106225] Updated weights for policy 1, policy_version 580601 (0.0009) [2023-12-27 23:24:04,845][106225] Updated weights for policy 1, policy_version 580611 (0.0007) [2023-12-27 23:24:04,850][106226] Updated weights for policy 0, policy_version 578673 (0.0010) [2023-12-27 23:24:04,894][106225] Updated weights for policy 1, policy_version 580621 (0.0007) [2023-12-27 23:24:04,901][106226] Updated weights for policy 0, policy_version 578683 (0.0007) [2023-12-27 23:24:04,951][106226] Updated weights for policy 0, policy_version 578693 (0.0005) [2023-12-27 23:24:05,009][106226] Updated weights for policy 0, policy_version 578703 (0.0009) [2023-12-27 23:24:05,607][106226] Updated weights for policy 0, policy_version 578713 (0.0009) [2023-12-27 23:24:05,667][106226] Updated weights for policy 0, policy_version 578723 (0.0010) [2023-12-27 23:24:05,688][106225] Updated weights for policy 1, policy_version 580631 (0.0006) [2023-12-27 23:24:05,729][106226] Updated weights for policy 0, policy_version 578733 (0.0008) [2023-12-27 23:24:05,756][106225] Updated weights for policy 1, policy_version 580641 (0.0010) [2023-12-27 23:24:05,812][106225] Updated weights for policy 1, policy_version 580651 (0.0008) [2023-12-27 23:24:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 296869888. Throughput: 0: 9947.1, 1: 9770.3. Samples: 296879372. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:06,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-5.587')] [2023-12-27 23:24:06,436][106226] Updated weights for policy 0, policy_version 578743 (0.0010) [2023-12-27 23:24:06,508][106226] Updated weights for policy 0, policy_version 578753 (0.0011) [2023-12-27 23:24:06,510][106225] Updated weights for policy 1, policy_version 580661 (0.0006) [2023-12-27 23:24:06,570][106226] Updated weights for policy 0, policy_version 578763 (0.0011) [2023-12-27 23:24:06,573][106225] Updated weights for policy 1, policy_version 580671 (0.0006) [2023-12-27 23:24:06,636][106225] Updated weights for policy 1, policy_version 580681 (0.0008) [2023-12-27 23:24:07,242][106225] Updated weights for policy 1, policy_version 580691 (0.0006) [2023-12-27 23:24:07,253][106226] Updated weights for policy 0, policy_version 578773 (0.0011) [2023-12-27 23:24:07,301][106225] Updated weights for policy 1, policy_version 580701 (0.0010) [2023-12-27 23:24:07,308][106226] Updated weights for policy 0, policy_version 578783 (0.0011) [2023-12-27 23:24:07,348][106225] Updated weights for policy 1, policy_version 580711 (0.0010) [2023-12-27 23:24:07,359][106226] Updated weights for policy 0, policy_version 578793 (0.0010) [2023-12-27 23:24:07,898][106225] Updated weights for policy 1, policy_version 580721 (0.0008) [2023-12-27 23:24:07,960][106225] Updated weights for policy 1, policy_version 580731 (0.0009) [2023-12-27 23:24:08,025][106225] Updated weights for policy 1, policy_version 580741 (0.0009) [2023-12-27 23:24:08,088][106225] Updated weights for policy 1, policy_version 580751 (0.0010) [2023-12-27 23:24:08,090][106226] Updated weights for policy 0, policy_version 578803 (0.0010) [2023-12-27 23:24:08,144][106226] Updated weights for policy 0, policy_version 578813 (0.0010) [2023-12-27 23:24:08,202][106226] Updated weights for policy 0, policy_version 578823 (0.0010) [2023-12-27 23:24:08,715][106225] Updated weights for policy 1, policy_version 580761 (0.0006) [2023-12-27 23:24:08,779][106225] Updated weights for policy 1, policy_version 580771 (0.0010) [2023-12-27 23:24:08,832][106225] Updated weights for policy 1, policy_version 580781 (0.0010) [2023-12-27 23:24:08,963][106226] Updated weights for policy 0, policy_version 578833 (0.0011) [2023-12-27 23:24:09,026][106226] Updated weights for policy 0, policy_version 578843 (0.0006) [2023-12-27 23:24:09,081][106226] Updated weights for policy 0, policy_version 578853 (0.0007) [2023-12-27 23:24:09,142][106226] Updated weights for policy 0, policy_version 578863 (0.0007) [2023-12-27 23:24:09,547][106225] Updated weights for policy 1, policy_version 580791 (0.0006) [2023-12-27 23:24:09,616][106225] Updated weights for policy 1, policy_version 580801 (0.0007) [2023-12-27 23:24:09,677][106225] Updated weights for policy 1, policy_version 580811 (0.0010) [2023-12-27 23:24:09,866][106226] Updated weights for policy 0, policy_version 578873 (0.0010) [2023-12-27 23:24:09,932][106226] Updated weights for policy 0, policy_version 578883 (0.0009) [2023-12-27 23:24:09,993][106226] Updated weights for policy 0, policy_version 578893 (0.0008) [2023-12-27 23:24:10,355][106225] Updated weights for policy 1, policy_version 580821 (0.0011) [2023-12-27 23:24:10,414][106225] Updated weights for policy 1, policy_version 580831 (0.0010) [2023-12-27 23:24:10,479][106225] Updated weights for policy 1, policy_version 580841 (0.0010) [2023-12-27 23:24:10,745][106226] Updated weights for policy 0, policy_version 578903 (0.0008) [2023-12-27 23:24:10,806][106226] Updated weights for policy 0, policy_version 578913 (0.0008) [2023-12-27 23:24:10,865][106226] Updated weights for policy 0, policy_version 578923 (0.0008) [2023-12-27 23:24:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 296968192. Throughput: 0: 9947.1, 1: 9876.3. Samples: 296941236. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:11,175][105115] Avg episode reward: [(0, '-5.096'), (1, '-5.596')] [2023-12-27 23:24:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000578928_148242432.pth... [2023-12-27 23:24:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000580848_148725760.pth... [2023-12-27 23:24:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000577776_147947520.pth [2023-12-27 23:24:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000579696_148430848.pth [2023-12-27 23:24:11,231][106225] Updated weights for policy 1, policy_version 580851 (0.0008) [2023-12-27 23:24:11,296][106225] Updated weights for policy 1, policy_version 580861 (0.0009) [2023-12-27 23:24:11,355][106225] Updated weights for policy 1, policy_version 580871 (0.0007) [2023-12-27 23:24:11,640][106226] Updated weights for policy 0, policy_version 578933 (0.0008) [2023-12-27 23:24:11,697][106226] Updated weights for policy 0, policy_version 578943 (0.0008) [2023-12-27 23:24:11,771][106226] Updated weights for policy 0, policy_version 578953 (0.0008) [2023-12-27 23:24:12,137][106225] Updated weights for policy 1, policy_version 580881 (0.0011) [2023-12-27 23:24:12,195][106225] Updated weights for policy 1, policy_version 580891 (0.0010) [2023-12-27 23:24:12,260][106225] Updated weights for policy 1, policy_version 580901 (0.0011) [2023-12-27 23:24:12,326][106225] Updated weights for policy 1, policy_version 580911 (0.0010) [2023-12-27 23:24:12,543][106226] Updated weights for policy 0, policy_version 578963 (0.0009) [2023-12-27 23:24:12,601][106226] Updated weights for policy 0, policy_version 578973 (0.0008) [2023-12-27 23:24:12,671][106226] Updated weights for policy 0, policy_version 578983 (0.0008) [2023-12-27 23:24:13,065][106225] Updated weights for policy 1, policy_version 580921 (0.0010) [2023-12-27 23:24:13,126][106225] Updated weights for policy 1, policy_version 580931 (0.0010) [2023-12-27 23:24:13,193][106225] Updated weights for policy 1, policy_version 580941 (0.0010) [2023-12-27 23:24:13,415][106226] Updated weights for policy 0, policy_version 578993 (0.0007) [2023-12-27 23:24:13,478][106226] Updated weights for policy 0, policy_version 579003 (0.0008) [2023-12-27 23:24:13,535][106226] Updated weights for policy 0, policy_version 579013 (0.0008) [2023-12-27 23:24:13,590][106226] Updated weights for policy 0, policy_version 579023 (0.0006) [2023-12-27 23:24:13,896][106225] Updated weights for policy 1, policy_version 580951 (0.0010) [2023-12-27 23:24:13,951][106225] Updated weights for policy 1, policy_version 580961 (0.0008) [2023-12-27 23:24:13,997][106225] Updated weights for policy 1, policy_version 580971 (0.0010) [2023-12-27 23:24:14,293][106226] Updated weights for policy 0, policy_version 579033 (0.0008) [2023-12-27 23:24:14,353][106226] Updated weights for policy 0, policy_version 579043 (0.0007) [2023-12-27 23:24:14,415][106226] Updated weights for policy 0, policy_version 579053 (0.0008) [2023-12-27 23:24:14,743][106225] Updated weights for policy 1, policy_version 580981 (0.0010) [2023-12-27 23:24:14,805][106225] Updated weights for policy 1, policy_version 580991 (0.0010) [2023-12-27 23:24:14,867][106225] Updated weights for policy 1, policy_version 581001 (0.0010) [2023-12-27 23:24:15,139][106226] Updated weights for policy 0, policy_version 579063 (0.0008) [2023-12-27 23:24:15,202][106226] Updated weights for policy 0, policy_version 579073 (0.0008) [2023-12-27 23:24:15,267][106226] Updated weights for policy 0, policy_version 579083 (0.0009) [2023-12-27 23:24:15,586][106225] Updated weights for policy 1, policy_version 581011 (0.0010) [2023-12-27 23:24:15,634][106225] Updated weights for policy 1, policy_version 581021 (0.0008) [2023-12-27 23:24:15,686][106225] Updated weights for policy 1, policy_version 581031 (0.0009) [2023-12-27 23:24:15,961][106226] Updated weights for policy 0, policy_version 579093 (0.0008) [2023-12-27 23:24:16,016][106226] Updated weights for policy 0, policy_version 579103 (0.0008) [2023-12-27 23:24:16,069][106226] Updated weights for policy 0, policy_version 579113 (0.0009) [2023-12-27 23:24:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 297066496. Throughput: 0: 9819.4, 1: 9790.7. Samples: 297053736. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:16,175][105115] Avg episode reward: [(0, '-5.088'), (1, '-5.803')] [2023-12-27 23:24:16,426][106225] Updated weights for policy 1, policy_version 581041 (0.0008) [2023-12-27 23:24:16,483][106225] Updated weights for policy 1, policy_version 581051 (0.0008) [2023-12-27 23:24:16,542][106225] Updated weights for policy 1, policy_version 581061 (0.0010) [2023-12-27 23:24:16,603][106225] Updated weights for policy 1, policy_version 581071 (0.0007) [2023-12-27 23:24:16,773][106226] Updated weights for policy 0, policy_version 579123 (0.0007) [2023-12-27 23:24:16,831][106226] Updated weights for policy 0, policy_version 579133 (0.0006) [2023-12-27 23:24:16,884][106226] Updated weights for policy 0, policy_version 579143 (0.0009) [2023-12-27 23:24:17,211][106225] Updated weights for policy 1, policy_version 581081 (0.0010) [2023-12-27 23:24:17,277][106225] Updated weights for policy 1, policy_version 581091 (0.0010) [2023-12-27 23:24:17,327][106225] Updated weights for policy 1, policy_version 581101 (0.0010) [2023-12-27 23:24:17,544][106226] Updated weights for policy 0, policy_version 579153 (0.0008) [2023-12-27 23:24:17,598][106226] Updated weights for policy 0, policy_version 579163 (0.0008) [2023-12-27 23:24:17,649][106226] Updated weights for policy 0, policy_version 579173 (0.0008) [2023-12-27 23:24:17,695][106226] Updated weights for policy 0, policy_version 579183 (0.0007) [2023-12-27 23:24:18,046][106225] Updated weights for policy 1, policy_version 581111 (0.0010) [2023-12-27 23:24:18,098][106225] Updated weights for policy 1, policy_version 581121 (0.0008) [2023-12-27 23:24:18,155][106225] Updated weights for policy 1, policy_version 581131 (0.0006) [2023-12-27 23:24:18,462][106226] Updated weights for policy 0, policy_version 579193 (0.0007) [2023-12-27 23:24:18,529][106226] Updated weights for policy 0, policy_version 579203 (0.0008) [2023-12-27 23:24:18,590][106226] Updated weights for policy 0, policy_version 579213 (0.0008) [2023-12-27 23:24:18,870][106225] Updated weights for policy 1, policy_version 581141 (0.0009) [2023-12-27 23:24:18,938][106225] Updated weights for policy 1, policy_version 581151 (0.0010) [2023-12-27 23:24:19,006][106225] Updated weights for policy 1, policy_version 581161 (0.0010) [2023-12-27 23:24:19,317][106226] Updated weights for policy 0, policy_version 579223 (0.0007) [2023-12-27 23:24:19,389][106226] Updated weights for policy 0, policy_version 579233 (0.0011) [2023-12-27 23:24:19,456][106226] Updated weights for policy 0, policy_version 579243 (0.0009) [2023-12-27 23:24:19,790][106225] Updated weights for policy 1, policy_version 581171 (0.0010) [2023-12-27 23:24:19,856][106225] Updated weights for policy 1, policy_version 581181 (0.0010) [2023-12-27 23:24:19,926][106225] Updated weights for policy 1, policy_version 581191 (0.0009) [2023-12-27 23:24:20,290][106226] Updated weights for policy 0, policy_version 579253 (0.0009) [2023-12-27 23:24:20,351][106226] Updated weights for policy 0, policy_version 579263 (0.0009) [2023-12-27 23:24:20,410][106226] Updated weights for policy 0, policy_version 579273 (0.0008) [2023-12-27 23:24:20,765][106225] Updated weights for policy 1, policy_version 581201 (0.0009) [2023-12-27 23:24:20,821][106225] Updated weights for policy 1, policy_version 581211 (0.0010) [2023-12-27 23:24:20,883][106225] Updated weights for policy 1, policy_version 581221 (0.0011) [2023-12-27 23:24:20,949][106225] Updated weights for policy 1, policy_version 581231 (0.0011) [2023-12-27 23:24:21,169][106226] Updated weights for policy 0, policy_version 579283 (0.0007) [2023-12-27 23:24:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 297156608. Throughput: 0: 9751.5, 1: 9804.0. Samples: 297167472. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:21,175][105115] Avg episode reward: [(0, '-5.050'), (1, '-5.888')] [2023-12-27 23:24:21,232][106226] Updated weights for policy 0, policy_version 579293 (0.0008) [2023-12-27 23:24:21,297][106226] Updated weights for policy 0, policy_version 579303 (0.0008) [2023-12-27 23:24:21,683][106225] Updated weights for policy 1, policy_version 581241 (0.0009) [2023-12-27 23:24:21,747][106225] Updated weights for policy 1, policy_version 581251 (0.0010) [2023-12-27 23:24:21,810][106225] Updated weights for policy 1, policy_version 581261 (0.0011) [2023-12-27 23:24:22,097][106226] Updated weights for policy 0, policy_version 579313 (0.0008) [2023-12-27 23:24:22,152][106226] Updated weights for policy 0, policy_version 579323 (0.0008) [2023-12-27 23:24:22,212][106226] Updated weights for policy 0, policy_version 579333 (0.0009) [2023-12-27 23:24:22,271][106226] Updated weights for policy 0, policy_version 579343 (0.0008) [2023-12-27 23:24:22,535][106225] Updated weights for policy 1, policy_version 581271 (0.0009) [2023-12-27 23:24:22,600][106225] Updated weights for policy 1, policy_version 581281 (0.0007) [2023-12-27 23:24:22,662][106225] Updated weights for policy 1, policy_version 581291 (0.0006) [2023-12-27 23:24:23,056][106226] Updated weights for policy 0, policy_version 579353 (0.0010) [2023-12-27 23:24:23,121][106226] Updated weights for policy 0, policy_version 579363 (0.0011) [2023-12-27 23:24:23,176][106226] Updated weights for policy 0, policy_version 579373 (0.0011) [2023-12-27 23:24:23,278][106225] Updated weights for policy 1, policy_version 581301 (0.0007) [2023-12-27 23:24:23,336][106225] Updated weights for policy 1, policy_version 581311 (0.0008) [2023-12-27 23:24:23,391][106225] Updated weights for policy 1, policy_version 581321 (0.0007) [2023-12-27 23:24:23,787][106226] Updated weights for policy 0, policy_version 579383 (0.0007) [2023-12-27 23:24:23,841][106226] Updated weights for policy 0, policy_version 579393 (0.0006) [2023-12-27 23:24:23,903][106226] Updated weights for policy 0, policy_version 579403 (0.0008) [2023-12-27 23:24:24,117][106225] Updated weights for policy 1, policy_version 581331 (0.0008) [2023-12-27 23:24:24,171][106225] Updated weights for policy 1, policy_version 581341 (0.0010) [2023-12-27 23:24:24,227][106225] Updated weights for policy 1, policy_version 581351 (0.0010) [2023-12-27 23:24:24,599][106226] Updated weights for policy 0, policy_version 579413 (0.0009) [2023-12-27 23:24:24,667][106226] Updated weights for policy 0, policy_version 579423 (0.0009) [2023-12-27 23:24:24,725][106226] Updated weights for policy 0, policy_version 579433 (0.0009) [2023-12-27 23:24:24,831][106225] Updated weights for policy 1, policy_version 581361 (0.0010) [2023-12-27 23:24:24,894][106225] Updated weights for policy 1, policy_version 581371 (0.0006) [2023-12-27 23:24:24,946][106225] Updated weights for policy 1, policy_version 581381 (0.0008) [2023-12-27 23:24:25,003][106225] Updated weights for policy 1, policy_version 581391 (0.0008) [2023-12-27 23:24:25,499][106226] Updated weights for policy 0, policy_version 579443 (0.0009) [2023-12-27 23:24:25,555][106226] Updated weights for policy 0, policy_version 579453 (0.0009) [2023-12-27 23:24:25,609][106226] Updated weights for policy 0, policy_version 579463 (0.0008) [2023-12-27 23:24:25,674][106225] Updated weights for policy 1, policy_version 581401 (0.0007) [2023-12-27 23:24:25,728][106225] Updated weights for policy 1, policy_version 581411 (0.0008) [2023-12-27 23:24:25,782][106225] Updated weights for policy 1, policy_version 581421 (0.0006) [2023-12-27 23:24:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 297254912. Throughput: 0: 9712.3, 1: 9816.7. Samples: 297225524. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:26,175][105115] Avg episode reward: [(0, '-4.948'), (1, '-5.830')] [2023-12-27 23:24:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000581424_148873216.pth... [2023-12-27 23:24:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000579472_148381696.pth... [2023-12-27 23:24:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000580272_148578304.pth [2023-12-27 23:24:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000578352_148094976.pth [2023-12-27 23:24:26,388][106225] Updated weights for policy 1, policy_version 581431 (0.0009) [2023-12-27 23:24:26,409][106226] Updated weights for policy 0, policy_version 579473 (0.0007) [2023-12-27 23:24:26,448][106225] Updated weights for policy 1, policy_version 581441 (0.0011) [2023-12-27 23:24:26,470][106226] Updated weights for policy 0, policy_version 579483 (0.0006) [2023-12-27 23:24:26,498][106225] Updated weights for policy 1, policy_version 581451 (0.0010) [2023-12-27 23:24:26,531][106226] Updated weights for policy 0, policy_version 579493 (0.0006) [2023-12-27 23:24:26,595][106226] Updated weights for policy 0, policy_version 579503 (0.0008) [2023-12-27 23:24:27,132][106225] Updated weights for policy 1, policy_version 581461 (0.0008) [2023-12-27 23:24:27,176][106225] Updated weights for policy 1, policy_version 581471 (0.0008) [2023-12-27 23:24:27,228][106225] Updated weights for policy 1, policy_version 581481 (0.0007) [2023-12-27 23:24:27,349][106226] Updated weights for policy 0, policy_version 579513 (0.0008) [2023-12-27 23:24:27,405][106226] Updated weights for policy 0, policy_version 579523 (0.0008) [2023-12-27 23:24:27,459][106226] Updated weights for policy 0, policy_version 579533 (0.0008) [2023-12-27 23:24:27,923][106225] Updated weights for policy 1, policy_version 581491 (0.0005) [2023-12-27 23:24:27,972][106225] Updated weights for policy 1, policy_version 581501 (0.0006) [2023-12-27 23:24:28,026][106225] Updated weights for policy 1, policy_version 581512 (0.0008) [2023-12-27 23:24:28,110][106226] Updated weights for policy 0, policy_version 579543 (0.0006) [2023-12-27 23:24:28,174][106226] Updated weights for policy 0, policy_version 579553 (0.0005) [2023-12-27 23:24:28,241][106226] Updated weights for policy 0, policy_version 579563 (0.0006) [2023-12-27 23:24:28,597][106225] Updated weights for policy 1, policy_version 581522 (0.0005) [2023-12-27 23:24:28,669][106225] Updated weights for policy 1, policy_version 581532 (0.0010) [2023-12-27 23:24:28,734][106225] Updated weights for policy 1, policy_version 581542 (0.0008) [2023-12-27 23:24:28,800][106225] Updated weights for policy 1, policy_version 581552 (0.0006) [2023-12-27 23:24:28,837][106226] Updated weights for policy 0, policy_version 579573 (0.0008) [2023-12-27 23:24:28,894][106226] Updated weights for policy 0, policy_version 579583 (0.0008) [2023-12-27 23:24:28,952][106226] Updated weights for policy 0, policy_version 579593 (0.0008) [2023-12-27 23:24:29,412][106225] Updated weights for policy 1, policy_version 581562 (0.0009) [2023-12-27 23:24:29,466][106225] Updated weights for policy 1, policy_version 581572 (0.0009) [2023-12-27 23:24:29,530][106225] Updated weights for policy 1, policy_version 581582 (0.0010) [2023-12-27 23:24:29,621][106226] Updated weights for policy 0, policy_version 579603 (0.0007) [2023-12-27 23:24:29,685][106226] Updated weights for policy 0, policy_version 579613 (0.0005) [2023-12-27 23:24:29,745][106226] Updated weights for policy 0, policy_version 579623 (0.0006) [2023-12-27 23:24:30,224][106225] Updated weights for policy 1, policy_version 581592 (0.0007) [2023-12-27 23:24:30,290][106225] Updated weights for policy 1, policy_version 581602 (0.0006) [2023-12-27 23:24:30,343][106226] Updated weights for policy 0, policy_version 579633 (0.0007) [2023-12-27 23:24:30,354][106225] Updated weights for policy 1, policy_version 581612 (0.0009) [2023-12-27 23:24:30,408][106226] Updated weights for policy 0, policy_version 579643 (0.0005) [2023-12-27 23:24:30,464][106226] Updated weights for policy 0, policy_version 579653 (0.0005) [2023-12-27 23:24:30,516][106226] Updated weights for policy 0, policy_version 579663 (0.0005) [2023-12-27 23:24:30,937][106225] Updated weights for policy 1, policy_version 581622 (0.0010) [2023-12-27 23:24:30,983][106225] Updated weights for policy 1, policy_version 581632 (0.0010) [2023-12-27 23:24:31,027][106226] Updated weights for policy 0, policy_version 579673 (0.0006) [2023-12-27 23:24:31,039][106225] Updated weights for policy 1, policy_version 581642 (0.0010) [2023-12-27 23:24:31,091][106226] Updated weights for policy 0, policy_version 579683 (0.0008) [2023-12-27 23:24:31,150][106226] Updated weights for policy 0, policy_version 579693 (0.0008) [2023-12-27 23:24:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 297369600. Throughput: 0: 9756.5, 1: 9946.4. Samples: 297348796. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:31,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-5.340')] [2023-12-27 23:24:31,856][106225] Updated weights for policy 1, policy_version 581652 (0.0010) [2023-12-27 23:24:31,878][106226] Updated weights for policy 0, policy_version 579703 (0.0007) [2023-12-27 23:24:31,921][106225] Updated weights for policy 1, policy_version 581662 (0.0009) [2023-12-27 23:24:31,936][106226] Updated weights for policy 0, policy_version 579713 (0.0007) [2023-12-27 23:24:31,983][106225] Updated weights for policy 1, policy_version 581672 (0.0010) [2023-12-27 23:24:31,993][106226] Updated weights for policy 0, policy_version 579723 (0.0008) [2023-12-27 23:24:32,635][106226] Updated weights for policy 0, policy_version 579733 (0.0006) [2023-12-27 23:24:32,697][106226] Updated weights for policy 0, policy_version 579743 (0.0005) [2023-12-27 23:24:32,756][106226] Updated weights for policy 0, policy_version 579753 (0.0006) [2023-12-27 23:24:32,811][106225] Updated weights for policy 1, policy_version 581682 (0.0009) [2023-12-27 23:24:32,871][106225] Updated weights for policy 1, policy_version 581692 (0.0008) [2023-12-27 23:24:32,928][106225] Updated weights for policy 1, policy_version 581702 (0.0008) [2023-12-27 23:24:32,977][106225] Updated weights for policy 1, policy_version 581712 (0.0009) [2023-12-27 23:24:33,408][106226] Updated weights for policy 0, policy_version 579763 (0.0006) [2023-12-27 23:24:33,468][106226] Updated weights for policy 0, policy_version 579773 (0.0008) [2023-12-27 23:24:33,526][106226] Updated weights for policy 0, policy_version 579783 (0.0009) [2023-12-27 23:24:33,680][106225] Updated weights for policy 1, policy_version 581722 (0.0008) [2023-12-27 23:24:33,728][106225] Updated weights for policy 1, policy_version 581732 (0.0008) [2023-12-27 23:24:33,780][106225] Updated weights for policy 1, policy_version 581742 (0.0008) [2023-12-27 23:24:34,256][106226] Updated weights for policy 0, policy_version 579793 (0.0008) [2023-12-27 23:24:34,320][106226] Updated weights for policy 0, policy_version 579803 (0.0005) [2023-12-27 23:24:34,383][106226] Updated weights for policy 0, policy_version 579813 (0.0006) [2023-12-27 23:24:34,445][106226] Updated weights for policy 0, policy_version 579823 (0.0008) [2023-12-27 23:24:34,490][106225] Updated weights for policy 1, policy_version 581752 (0.0008) [2023-12-27 23:24:34,552][106225] Updated weights for policy 1, policy_version 581762 (0.0008) [2023-12-27 23:24:34,604][106225] Updated weights for policy 1, policy_version 581772 (0.0008) [2023-12-27 23:24:35,147][106226] Updated weights for policy 0, policy_version 579833 (0.0008) [2023-12-27 23:24:35,198][106226] Updated weights for policy 0, policy_version 579843 (0.0009) [2023-12-27 23:24:35,261][106226] Updated weights for policy 0, policy_version 579853 (0.0009) [2023-12-27 23:24:35,285][106225] Updated weights for policy 1, policy_version 581782 (0.0007) [2023-12-27 23:24:35,334][106225] Updated weights for policy 1, policy_version 581792 (0.0005) [2023-12-27 23:24:35,383][106225] Updated weights for policy 1, policy_version 581802 (0.0005) [2023-12-27 23:24:36,003][106225] Updated weights for policy 1, policy_version 581812 (0.0005) [2023-12-27 23:24:36,033][106226] Updated weights for policy 0, policy_version 579863 (0.0008) [2023-12-27 23:24:36,063][106225] Updated weights for policy 1, policy_version 581822 (0.0007) [2023-12-27 23:24:36,081][106226] Updated weights for policy 0, policy_version 579873 (0.0007) [2023-12-27 23:24:36,115][106225] Updated weights for policy 1, policy_version 581832 (0.0009) [2023-12-27 23:24:36,141][106226] Updated weights for policy 0, policy_version 579883 (0.0008) [2023-12-27 23:24:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 297467904. Throughput: 0: 9821.1, 1: 9926.4. Samples: 297469104. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:36,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-5.891')] [2023-12-27 23:24:36,770][106225] Updated weights for policy 1, policy_version 581842 (0.0007) [2023-12-27 23:24:36,822][106225] Updated weights for policy 1, policy_version 581852 (0.0007) [2023-12-27 23:24:36,880][106225] Updated weights for policy 1, policy_version 581862 (0.0006) [2023-12-27 23:24:36,925][106226] Updated weights for policy 0, policy_version 579893 (0.0007) [2023-12-27 23:24:36,943][106225] Updated weights for policy 1, policy_version 581872 (0.0007) [2023-12-27 23:24:36,983][106226] Updated weights for policy 0, policy_version 579903 (0.0008) [2023-12-27 23:24:37,036][106226] Updated weights for policy 0, policy_version 579913 (0.0008) [2023-12-27 23:24:37,653][106225] Updated weights for policy 1, policy_version 581882 (0.0008) [2023-12-27 23:24:37,697][106226] Updated weights for policy 0, policy_version 579923 (0.0008) [2023-12-27 23:24:37,707][106225] Updated weights for policy 1, policy_version 581892 (0.0008) [2023-12-27 23:24:37,757][106226] Updated weights for policy 0, policy_version 579933 (0.0007) [2023-12-27 23:24:37,763][106225] Updated weights for policy 1, policy_version 581902 (0.0005) [2023-12-27 23:24:37,822][106226] Updated weights for policy 0, policy_version 579943 (0.0010) [2023-12-27 23:24:38,406][106225] Updated weights for policy 1, policy_version 581912 (0.0008) [2023-12-27 23:24:38,466][106225] Updated weights for policy 1, policy_version 581922 (0.0008) [2023-12-27 23:24:38,518][106225] Updated weights for policy 1, policy_version 581932 (0.0008) [2023-12-27 23:24:38,552][106226] Updated weights for policy 0, policy_version 579953 (0.0009) [2023-12-27 23:24:38,613][106226] Updated weights for policy 0, policy_version 579963 (0.0006) [2023-12-27 23:24:38,680][106226] Updated weights for policy 0, policy_version 579973 (0.0005) [2023-12-27 23:24:38,752][106226] Updated weights for policy 0, policy_version 579983 (0.0006) [2023-12-27 23:24:39,271][106225] Updated weights for policy 1, policy_version 581942 (0.0008) [2023-12-27 23:24:39,334][106225] Updated weights for policy 1, policy_version 581952 (0.0008) [2023-12-27 23:24:39,421][106225] Updated weights for policy 1, policy_version 581962 (0.0008) [2023-12-27 23:24:39,555][106226] Updated weights for policy 0, policy_version 579993 (0.0008) [2023-12-27 23:24:39,615][106226] Updated weights for policy 0, policy_version 580003 (0.0009) [2023-12-27 23:24:39,677][106226] Updated weights for policy 0, policy_version 580013 (0.0008) [2023-12-27 23:24:40,146][106225] Updated weights for policy 1, policy_version 581972 (0.0008) [2023-12-27 23:24:40,206][106225] Updated weights for policy 1, policy_version 581982 (0.0009) [2023-12-27 23:24:40,257][106225] Updated weights for policy 1, policy_version 581992 (0.0008) [2023-12-27 23:24:40,413][106226] Updated weights for policy 0, policy_version 580023 (0.0007) [2023-12-27 23:24:40,474][106226] Updated weights for policy 0, policy_version 580033 (0.0008) [2023-12-27 23:24:40,536][106226] Updated weights for policy 0, policy_version 580043 (0.0008) [2023-12-27 23:24:40,977][106225] Updated weights for policy 1, policy_version 582002 (0.0007) [2023-12-27 23:24:41,027][106225] Updated weights for policy 1, policy_version 582012 (0.0009) [2023-12-27 23:24:41,095][106225] Updated weights for policy 1, policy_version 582022 (0.0008) [2023-12-27 23:24:41,169][106225] Updated weights for policy 1, policy_version 582032 (0.0008) [2023-12-27 23:24:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 297558016. Throughput: 0: 9845.8, 1: 9991.2. Samples: 297528692. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:41,175][105115] Avg episode reward: [(0, '-4.959'), (1, '-5.474')] [2023-12-27 23:24:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000582032_149028864.pth... [2023-12-27 23:24:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000580848_148725760.pth [2023-12-27 23:24:41,199][106226] Updated weights for policy 0, policy_version 580053 (0.0009) [2023-12-27 23:24:41,262][106226] Updated weights for policy 0, policy_version 580063 (0.0009) [2023-12-27 23:24:41,314][106226] Updated weights for policy 0, policy_version 580073 (0.0008) [2023-12-27 23:24:41,361][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000580080_148537344.pth... [2023-12-27 23:24:41,366][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000578928_148242432.pth [2023-12-27 23:24:41,900][106225] Updated weights for policy 1, policy_version 582042 (0.0007) [2023-12-27 23:24:41,964][106225] Updated weights for policy 1, policy_version 582052 (0.0008) [2023-12-27 23:24:42,027][106225] Updated weights for policy 1, policy_version 582062 (0.0008) [2023-12-27 23:24:42,108][106226] Updated weights for policy 0, policy_version 580083 (0.0010) [2023-12-27 23:24:42,168][106226] Updated weights for policy 0, policy_version 580093 (0.0011) [2023-12-27 23:24:42,226][106226] Updated weights for policy 0, policy_version 580103 (0.0011) [2023-12-27 23:24:42,781][106225] Updated weights for policy 1, policy_version 582072 (0.0008) [2023-12-27 23:24:42,836][106225] Updated weights for policy 1, policy_version 582082 (0.0008) [2023-12-27 23:24:42,887][106225] Updated weights for policy 1, policy_version 582092 (0.0008) [2023-12-27 23:24:42,957][106226] Updated weights for policy 0, policy_version 580113 (0.0011) [2023-12-27 23:24:43,014][106226] Updated weights for policy 0, policy_version 580123 (0.0011) [2023-12-27 23:24:43,068][106226] Updated weights for policy 0, policy_version 580133 (0.0010) [2023-12-27 23:24:43,120][106226] Updated weights for policy 0, policy_version 580143 (0.0010) [2023-12-27 23:24:43,631][106225] Updated weights for policy 1, policy_version 582102 (0.0008) [2023-12-27 23:24:43,677][106225] Updated weights for policy 1, policy_version 582112 (0.0007) [2023-12-27 23:24:43,723][106225] Updated weights for policy 1, policy_version 582122 (0.0008) [2023-12-27 23:24:43,833][106226] Updated weights for policy 0, policy_version 580153 (0.0011) [2023-12-27 23:24:43,904][106226] Updated weights for policy 0, policy_version 580163 (0.0011) [2023-12-27 23:24:43,964][106226] Updated weights for policy 0, policy_version 580173 (0.0011) [2023-12-27 23:24:44,477][106225] Updated weights for policy 1, policy_version 582132 (0.0007) [2023-12-27 23:24:44,535][106225] Updated weights for policy 1, policy_version 582142 (0.0008) [2023-12-27 23:24:44,596][106225] Updated weights for policy 1, policy_version 582152 (0.0008) [2023-12-27 23:24:44,684][106226] Updated weights for policy 0, policy_version 580183 (0.0010) [2023-12-27 23:24:44,736][106226] Updated weights for policy 0, policy_version 580193 (0.0010) [2023-12-27 23:24:44,799][106226] Updated weights for policy 0, policy_version 580203 (0.0008) [2023-12-27 23:24:45,306][106225] Updated weights for policy 1, policy_version 582162 (0.0007) [2023-12-27 23:24:45,366][106225] Updated weights for policy 1, policy_version 582172 (0.0006) [2023-12-27 23:24:45,416][106225] Updated weights for policy 1, policy_version 582182 (0.0006) [2023-12-27 23:24:45,485][106225] Updated weights for policy 1, policy_version 582192 (0.0005) [2023-12-27 23:24:45,532][106226] Updated weights for policy 0, policy_version 580213 (0.0007) [2023-12-27 23:24:45,585][106226] Updated weights for policy 0, policy_version 580223 (0.0007) [2023-12-27 23:24:45,638][106226] Updated weights for policy 0, policy_version 580233 (0.0008) [2023-12-27 23:24:46,131][106225] Updated weights for policy 1, policy_version 582202 (0.0005) [2023-12-27 23:24:46,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 297648128. Throughput: 0: 9711.8, 1: 9896.0. Samples: 297641060. Policy #0 lag: (min: 18.0, avg: 32.3, max: 50.0) [2023-12-27 23:24:46,175][105115] Avg episode reward: [(0, '-5.092'), (1, '-5.750')] [2023-12-27 23:24:46,186][106225] Updated weights for policy 1, policy_version 582212 (0.0005) [2023-12-27 23:24:46,245][106225] Updated weights for policy 1, policy_version 582222 (0.0005) [2023-12-27 23:24:46,344][106226] Updated weights for policy 0, policy_version 580243 (0.0010) [2023-12-27 23:24:46,404][106226] Updated weights for policy 0, policy_version 580253 (0.0007) [2023-12-27 23:24:46,460][106226] Updated weights for policy 0, policy_version 580263 (0.0010) [2023-12-27 23:24:46,841][106225] Updated weights for policy 1, policy_version 582232 (0.0009) [2023-12-27 23:24:46,902][106225] Updated weights for policy 1, policy_version 582242 (0.0005) [2023-12-27 23:24:46,974][106225] Updated weights for policy 1, policy_version 582252 (0.0005) [2023-12-27 23:24:47,098][106226] Updated weights for policy 0, policy_version 580273 (0.0006) [2023-12-27 23:24:47,158][106226] Updated weights for policy 0, policy_version 580283 (0.0010) [2023-12-27 23:24:47,221][106226] Updated weights for policy 0, policy_version 580293 (0.0010) [2023-12-27 23:24:47,277][106226] Updated weights for policy 0, policy_version 580303 (0.0010) [2023-12-27 23:24:47,528][106225] Updated weights for policy 1, policy_version 582262 (0.0005) [2023-12-27 23:24:47,591][106225] Updated weights for policy 1, policy_version 582272 (0.0007) [2023-12-27 23:24:47,657][106225] Updated weights for policy 1, policy_version 582282 (0.0010) [2023-12-27 23:24:47,956][106226] Updated weights for policy 0, policy_version 580313 (0.0009) [2023-12-27 23:24:48,006][106226] Updated weights for policy 0, policy_version 580323 (0.0008) [2023-12-27 23:24:48,058][106226] Updated weights for policy 0, policy_version 580333 (0.0008) [2023-12-27 23:24:48,260][106225] Updated weights for policy 1, policy_version 582292 (0.0008) [2023-12-27 23:24:48,323][106225] Updated weights for policy 1, policy_version 582302 (0.0008) [2023-12-27 23:24:48,385][106225] Updated weights for policy 1, policy_version 582312 (0.0009) [2023-12-27 23:24:48,881][106226] Updated weights for policy 0, policy_version 580343 (0.0008) [2023-12-27 23:24:48,942][106226] Updated weights for policy 0, policy_version 580353 (0.0009) [2023-12-27 23:24:48,981][106225] Updated weights for policy 1, policy_version 582322 (0.0009) [2023-12-27 23:24:49,002][106226] Updated weights for policy 0, policy_version 580363 (0.0008) [2023-12-27 23:24:49,042][106225] Updated weights for policy 1, policy_version 582332 (0.0007) [2023-12-27 23:24:49,109][106225] Updated weights for policy 1, policy_version 582342 (0.0009) [2023-12-27 23:24:49,170][106225] Updated weights for policy 1, policy_version 582352 (0.0008) [2023-12-27 23:24:49,764][106226] Updated weights for policy 0, policy_version 580373 (0.0008) [2023-12-27 23:24:49,833][106226] Updated weights for policy 0, policy_version 580383 (0.0008) [2023-12-27 23:24:49,904][106226] Updated weights for policy 0, policy_version 580393 (0.0009) [2023-12-27 23:24:49,906][106225] Updated weights for policy 1, policy_version 582362 (0.0007) [2023-12-27 23:24:49,971][106225] Updated weights for policy 1, policy_version 582372 (0.0009) [2023-12-27 23:24:50,028][106225] Updated weights for policy 1, policy_version 582382 (0.0010) [2023-12-27 23:24:50,622][106226] Updated weights for policy 0, policy_version 580403 (0.0008) [2023-12-27 23:24:50,686][106226] Updated weights for policy 0, policy_version 580413 (0.0008) [2023-12-27 23:24:50,757][106226] Updated weights for policy 0, policy_version 580423 (0.0008) [2023-12-27 23:24:50,799][106225] Updated weights for policy 1, policy_version 582392 (0.0011) [2023-12-27 23:24:50,850][106225] Updated weights for policy 1, policy_version 582402 (0.0010) [2023-12-27 23:24:50,910][106225] Updated weights for policy 1, policy_version 582412 (0.0010) [2023-12-27 23:24:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 297754624. Throughput: 0: 9628.3, 1: 9974.7. Samples: 297761512. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:24:51,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.584')] [2023-12-27 23:24:51,492][106226] Updated weights for policy 0, policy_version 580433 (0.0006) [2023-12-27 23:24:51,551][106226] Updated weights for policy 0, policy_version 580443 (0.0008) [2023-12-27 23:24:51,608][106226] Updated weights for policy 0, policy_version 580453 (0.0009) [2023-12-27 23:24:51,679][106226] Updated weights for policy 0, policy_version 580463 (0.0008) [2023-12-27 23:24:51,704][106225] Updated weights for policy 1, policy_version 582422 (0.0009) [2023-12-27 23:24:51,769][106225] Updated weights for policy 1, policy_version 582432 (0.0008) [2023-12-27 23:24:51,828][106225] Updated weights for policy 1, policy_version 582442 (0.0006) [2023-12-27 23:24:52,404][106226] Updated weights for policy 0, policy_version 580473 (0.0009) [2023-12-27 23:24:52,473][106226] Updated weights for policy 0, policy_version 580483 (0.0010) [2023-12-27 23:24:52,526][106225] Updated weights for policy 1, policy_version 582452 (0.0006) [2023-12-27 23:24:52,532][106226] Updated weights for policy 0, policy_version 580493 (0.0007) [2023-12-27 23:24:52,587][106225] Updated weights for policy 1, policy_version 582462 (0.0008) [2023-12-27 23:24:52,639][106225] Updated weights for policy 1, policy_version 582472 (0.0009) [2023-12-27 23:24:53,277][106226] Updated weights for policy 0, policy_version 580503 (0.0008) [2023-12-27 23:24:53,334][106225] Updated weights for policy 1, policy_version 582482 (0.0008) [2023-12-27 23:24:53,340][106226] Updated weights for policy 0, policy_version 580513 (0.0007) [2023-12-27 23:24:53,389][106225] Updated weights for policy 1, policy_version 582492 (0.0007) [2023-12-27 23:24:53,397][106226] Updated weights for policy 0, policy_version 580523 (0.0008) [2023-12-27 23:24:53,435][106225] Updated weights for policy 1, policy_version 582502 (0.0007) [2023-12-27 23:24:53,483][106225] Updated weights for policy 1, policy_version 582512 (0.0008) [2023-12-27 23:24:54,131][106226] Updated weights for policy 0, policy_version 580533 (0.0007) [2023-12-27 23:24:54,183][106225] Updated weights for policy 1, policy_version 582522 (0.0006) [2023-12-27 23:24:54,192][106226] Updated weights for policy 0, policy_version 580543 (0.0007) [2023-12-27 23:24:54,243][106225] Updated weights for policy 1, policy_version 582532 (0.0005) [2023-12-27 23:24:54,246][106226] Updated weights for policy 0, policy_version 580553 (0.0008) [2023-12-27 23:24:54,311][106225] Updated weights for policy 1, policy_version 582542 (0.0005) [2023-12-27 23:24:54,972][106226] Updated weights for policy 0, policy_version 580563 (0.0008) [2023-12-27 23:24:54,987][106225] Updated weights for policy 1, policy_version 582552 (0.0007) [2023-12-27 23:24:55,038][106226] Updated weights for policy 0, policy_version 580573 (0.0009) [2023-12-27 23:24:55,046][106225] Updated weights for policy 1, policy_version 582562 (0.0007) [2023-12-27 23:24:55,093][106226] Updated weights for policy 0, policy_version 580583 (0.0007) [2023-12-27 23:24:55,106][106225] Updated weights for policy 1, policy_version 582572 (0.0008) [2023-12-27 23:24:55,746][106225] Updated weights for policy 1, policy_version 582582 (0.0006) [2023-12-27 23:24:55,800][106225] Updated weights for policy 1, policy_version 582592 (0.0005) [2023-12-27 23:24:55,841][106226] Updated weights for policy 0, policy_version 580593 (0.0007) [2023-12-27 23:24:55,853][106225] Updated weights for policy 1, policy_version 582602 (0.0005) [2023-12-27 23:24:55,891][106226] Updated weights for policy 0, policy_version 580603 (0.0008) [2023-12-27 23:24:55,940][106226] Updated weights for policy 0, policy_version 580613 (0.0008) [2023-12-27 23:24:55,989][106226] Updated weights for policy 0, policy_version 580623 (0.0008) [2023-12-27 23:24:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 297852928. Throughput: 0: 9605.9, 1: 9888.0. Samples: 297818460. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:24:56,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-5.373')] [2023-12-27 23:24:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000582608_149176320.pth... [2023-12-27 23:24:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000580624_148676608.pth... [2023-12-27 23:24:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000581424_148873216.pth [2023-12-27 23:24:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000579472_148381696.pth [2023-12-27 23:24:56,494][106225] Updated weights for policy 1, policy_version 582612 (0.0006) [2023-12-27 23:24:56,555][106225] Updated weights for policy 1, policy_version 582622 (0.0008) [2023-12-27 23:24:56,612][106225] Updated weights for policy 1, policy_version 582632 (0.0008) [2023-12-27 23:24:56,698][106226] Updated weights for policy 0, policy_version 580633 (0.0008) [2023-12-27 23:24:56,752][106226] Updated weights for policy 0, policy_version 580643 (0.0008) [2023-12-27 23:24:56,799][106226] Updated weights for policy 0, policy_version 580653 (0.0008) [2023-12-27 23:24:57,319][106225] Updated weights for policy 1, policy_version 582642 (0.0007) [2023-12-27 23:24:57,367][106225] Updated weights for policy 1, policy_version 582652 (0.0008) [2023-12-27 23:24:57,413][106225] Updated weights for policy 1, policy_version 582662 (0.0008) [2023-12-27 23:24:57,457][106225] Updated weights for policy 1, policy_version 582672 (0.0008) [2023-12-27 23:24:57,527][106226] Updated weights for policy 0, policy_version 580663 (0.0009) [2023-12-27 23:24:57,580][106226] Updated weights for policy 0, policy_version 580673 (0.0009) [2023-12-27 23:24:57,634][106226] Updated weights for policy 0, policy_version 580683 (0.0008) [2023-12-27 23:24:58,201][106225] Updated weights for policy 1, policy_version 582682 (0.0008) [2023-12-27 23:24:58,270][106225] Updated weights for policy 1, policy_version 582692 (0.0008) [2023-12-27 23:24:58,334][106225] Updated weights for policy 1, policy_version 582702 (0.0009) [2023-12-27 23:24:58,371][106226] Updated weights for policy 0, policy_version 580693 (0.0008) [2023-12-27 23:24:58,438][106226] Updated weights for policy 0, policy_version 580703 (0.0009) [2023-12-27 23:24:58,506][106226] Updated weights for policy 0, policy_version 580713 (0.0008) [2023-12-27 23:24:59,167][106225] Updated weights for policy 1, policy_version 582712 (0.0008) [2023-12-27 23:24:59,234][106225] Updated weights for policy 1, policy_version 582722 (0.0008) [2023-12-27 23:24:59,292][106226] Updated weights for policy 0, policy_version 580723 (0.0007) [2023-12-27 23:24:59,298][106225] Updated weights for policy 1, policy_version 582732 (0.0008) [2023-12-27 23:24:59,361][106226] Updated weights for policy 0, policy_version 580733 (0.0008) [2023-12-27 23:24:59,431][106226] Updated weights for policy 0, policy_version 580743 (0.0009) [2023-12-27 23:25:00,003][106225] Updated weights for policy 1, policy_version 582742 (0.0007) [2023-12-27 23:25:00,069][106225] Updated weights for policy 1, policy_version 582752 (0.0009) [2023-12-27 23:25:00,128][106225] Updated weights for policy 1, policy_version 582762 (0.0010) [2023-12-27 23:25:00,237][106226] Updated weights for policy 0, policy_version 580753 (0.0008) [2023-12-27 23:25:00,300][106226] Updated weights for policy 0, policy_version 580763 (0.0010) [2023-12-27 23:25:00,359][106226] Updated weights for policy 0, policy_version 580773 (0.0008) [2023-12-27 23:25:00,427][106226] Updated weights for policy 0, policy_version 580783 (0.0008) [2023-12-27 23:25:00,810][106225] Updated weights for policy 1, policy_version 582772 (0.0008) [2023-12-27 23:25:00,854][106225] Updated weights for policy 1, policy_version 582782 (0.0005) [2023-12-27 23:25:00,909][106225] Updated weights for policy 1, policy_version 582792 (0.0005) [2023-12-27 23:25:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 297943040. Throughput: 0: 9617.6, 1: 9935.6. Samples: 297933628. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:01,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-5.438')] [2023-12-27 23:25:01,179][106226] Updated weights for policy 0, policy_version 580793 (0.0006) [2023-12-27 23:25:01,236][106226] Updated weights for policy 0, policy_version 580803 (0.0008) [2023-12-27 23:25:01,297][106226] Updated weights for policy 0, policy_version 580813 (0.0006) [2023-12-27 23:25:01,628][106225] Updated weights for policy 1, policy_version 582802 (0.0006) [2023-12-27 23:25:01,688][106225] Updated weights for policy 1, policy_version 582812 (0.0010) [2023-12-27 23:25:01,754][106225] Updated weights for policy 1, policy_version 582822 (0.0010) [2023-12-27 23:25:01,814][106225] Updated weights for policy 1, policy_version 582832 (0.0008) [2023-12-27 23:25:01,970][106226] Updated weights for policy 0, policy_version 580823 (0.0006) [2023-12-27 23:25:02,030][106226] Updated weights for policy 0, policy_version 580833 (0.0007) [2023-12-27 23:25:02,099][106226] Updated weights for policy 0, policy_version 580843 (0.0008) [2023-12-27 23:25:02,543][106225] Updated weights for policy 1, policy_version 582842 (0.0006) [2023-12-27 23:25:02,606][106225] Updated weights for policy 1, policy_version 582852 (0.0008) [2023-12-27 23:25:02,655][106225] Updated weights for policy 1, policy_version 582862 (0.0006) [2023-12-27 23:25:02,756][106226] Updated weights for policy 0, policy_version 580853 (0.0008) [2023-12-27 23:25:02,814][106226] Updated weights for policy 0, policy_version 580863 (0.0005) [2023-12-27 23:25:02,870][106226] Updated weights for policy 0, policy_version 580873 (0.0005) [2023-12-27 23:25:03,289][106225] Updated weights for policy 1, policy_version 582872 (0.0007) [2023-12-27 23:25:03,349][106225] Updated weights for policy 1, policy_version 582882 (0.0007) [2023-12-27 23:25:03,405][106225] Updated weights for policy 1, policy_version 582892 (0.0007) [2023-12-27 23:25:03,428][106226] Updated weights for policy 0, policy_version 580883 (0.0008) [2023-12-27 23:25:03,488][106226] Updated weights for policy 0, policy_version 580893 (0.0006) [2023-12-27 23:25:03,542][106226] Updated weights for policy 0, policy_version 580903 (0.0006) [2023-12-27 23:25:04,162][106226] Updated weights for policy 0, policy_version 580913 (0.0006) [2023-12-27 23:25:04,215][106225] Updated weights for policy 1, policy_version 582902 (0.0009) [2023-12-27 23:25:04,239][106226] Updated weights for policy 0, policy_version 580923 (0.0008) [2023-12-27 23:25:04,278][106225] Updated weights for policy 1, policy_version 582912 (0.0007) [2023-12-27 23:25:04,304][106226] Updated weights for policy 0, policy_version 580933 (0.0008) [2023-12-27 23:25:04,338][106225] Updated weights for policy 1, policy_version 582922 (0.0007) [2023-12-27 23:25:04,371][106226] Updated weights for policy 0, policy_version 580943 (0.0006) [2023-12-27 23:25:04,993][106225] Updated weights for policy 1, policy_version 582932 (0.0007) [2023-12-27 23:25:05,059][106225] Updated weights for policy 1, policy_version 582942 (0.0006) [2023-12-27 23:25:05,112][106225] Updated weights for policy 1, policy_version 582952 (0.0005) [2023-12-27 23:25:05,133][106226] Updated weights for policy 0, policy_version 580953 (0.0006) [2023-12-27 23:25:05,190][106226] Updated weights for policy 0, policy_version 580963 (0.0009) [2023-12-27 23:25:05,247][106226] Updated weights for policy 0, policy_version 580973 (0.0010) [2023-12-27 23:25:05,728][106225] Updated weights for policy 1, policy_version 582962 (0.0005) [2023-12-27 23:25:05,782][106225] Updated weights for policy 1, policy_version 582972 (0.0009) [2023-12-27 23:25:05,843][106225] Updated weights for policy 1, policy_version 582982 (0.0008) [2023-12-27 23:25:05,893][106225] Updated weights for policy 1, policy_version 582992 (0.0008) [2023-12-27 23:25:05,970][106226] Updated weights for policy 0, policy_version 580983 (0.0009) [2023-12-27 23:25:06,017][106226] Updated weights for policy 0, policy_version 580993 (0.0008) [2023-12-27 23:25:06,066][106226] Updated weights for policy 0, policy_version 581003 (0.0008) [2023-12-27 23:25:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 298049536. Throughput: 0: 9687.3, 1: 10008.5. Samples: 298053784. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:06,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.284')] [2023-12-27 23:25:06,610][106225] Updated weights for policy 1, policy_version 583002 (0.0009) [2023-12-27 23:25:06,670][106225] Updated weights for policy 1, policy_version 583012 (0.0009) [2023-12-27 23:25:06,731][106225] Updated weights for policy 1, policy_version 583022 (0.0008) [2023-12-27 23:25:06,841][106226] Updated weights for policy 0, policy_version 581013 (0.0008) [2023-12-27 23:25:06,896][106226] Updated weights for policy 0, policy_version 581023 (0.0008) [2023-12-27 23:25:06,954][106226] Updated weights for policy 0, policy_version 581033 (0.0008) [2023-12-27 23:25:07,444][106225] Updated weights for policy 1, policy_version 583032 (0.0007) [2023-12-27 23:25:07,493][106225] Updated weights for policy 1, policy_version 583042 (0.0008) [2023-12-27 23:25:07,548][106225] Updated weights for policy 1, policy_version 583052 (0.0008) [2023-12-27 23:25:07,685][106226] Updated weights for policy 0, policy_version 581043 (0.0009) [2023-12-27 23:25:07,741][106226] Updated weights for policy 0, policy_version 581053 (0.0008) [2023-12-27 23:25:07,794][106226] Updated weights for policy 0, policy_version 581063 (0.0009) [2023-12-27 23:25:08,166][106225] Updated weights for policy 1, policy_version 583062 (0.0006) [2023-12-27 23:25:08,215][106225] Updated weights for policy 1, policy_version 583072 (0.0006) [2023-12-27 23:25:08,270][106225] Updated weights for policy 1, policy_version 583082 (0.0005) [2023-12-27 23:25:08,450][106226] Updated weights for policy 0, policy_version 581073 (0.0010) [2023-12-27 23:25:08,508][106226] Updated weights for policy 0, policy_version 581083 (0.0008) [2023-12-27 23:25:08,572][106226] Updated weights for policy 0, policy_version 581093 (0.0011) [2023-12-27 23:25:08,632][106226] Updated weights for policy 0, policy_version 581103 (0.0010) [2023-12-27 23:25:08,942][106225] Updated weights for policy 1, policy_version 583092 (0.0006) [2023-12-27 23:25:08,997][106225] Updated weights for policy 1, policy_version 583102 (0.0005) [2023-12-27 23:25:09,061][106225] Updated weights for policy 1, policy_version 583112 (0.0005) [2023-12-27 23:25:09,252][106226] Updated weights for policy 0, policy_version 581113 (0.0008) [2023-12-27 23:25:09,319][106226] Updated weights for policy 0, policy_version 581123 (0.0008) [2023-12-27 23:25:09,391][106226] Updated weights for policy 0, policy_version 581133 (0.0008) [2023-12-27 23:25:09,786][106225] Updated weights for policy 1, policy_version 583122 (0.0007) [2023-12-27 23:25:09,862][106225] Updated weights for policy 1, policy_version 583132 (0.0009) [2023-12-27 23:25:09,923][106225] Updated weights for policy 1, policy_version 583142 (0.0008) [2023-12-27 23:25:09,987][106225] Updated weights for policy 1, policy_version 583152 (0.0006) [2023-12-27 23:25:10,149][106226] Updated weights for policy 0, policy_version 581143 (0.0009) [2023-12-27 23:25:10,214][106226] Updated weights for policy 0, policy_version 581153 (0.0009) [2023-12-27 23:25:10,275][106226] Updated weights for policy 0, policy_version 581163 (0.0009) [2023-12-27 23:25:10,682][106225] Updated weights for policy 1, policy_version 583162 (0.0008) [2023-12-27 23:25:10,733][106225] Updated weights for policy 1, policy_version 583172 (0.0008) [2023-12-27 23:25:10,789][106225] Updated weights for policy 1, policy_version 583182 (0.0008) [2023-12-27 23:25:10,962][106226] Updated weights for policy 0, policy_version 581173 (0.0007) [2023-12-27 23:25:11,035][106226] Updated weights for policy 0, policy_version 581183 (0.0006) [2023-12-27 23:25:11,107][106226] Updated weights for policy 0, policy_version 581193 (0.0008) [2023-12-27 23:25:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 298147840. Throughput: 0: 9731.7, 1: 10029.4. Samples: 298114776. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:11,175][105115] Avg episode reward: [(0, '-4.858'), (1, '-5.781')] [2023-12-27 23:25:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000583184_149323776.pth... [2023-12-27 23:25:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000581200_148824064.pth... [2023-12-27 23:25:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000580080_148537344.pth [2023-12-27 23:25:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000582032_149028864.pth [2023-12-27 23:25:11,598][106225] Updated weights for policy 1, policy_version 583192 (0.0007) [2023-12-27 23:25:11,684][106225] Updated weights for policy 1, policy_version 583202 (0.0007) [2023-12-27 23:25:11,749][106225] Updated weights for policy 1, policy_version 583212 (0.0010) [2023-12-27 23:25:11,817][106226] Updated weights for policy 0, policy_version 581203 (0.0009) [2023-12-27 23:25:11,871][106226] Updated weights for policy 0, policy_version 581213 (0.0009) [2023-12-27 23:25:11,929][106226] Updated weights for policy 0, policy_version 581223 (0.0008) [2023-12-27 23:25:12,463][106225] Updated weights for policy 1, policy_version 583222 (0.0011) [2023-12-27 23:25:12,521][106225] Updated weights for policy 1, policy_version 583232 (0.0008) [2023-12-27 23:25:12,576][106225] Updated weights for policy 1, policy_version 583242 (0.0009) [2023-12-27 23:25:12,718][106226] Updated weights for policy 0, policy_version 581233 (0.0009) [2023-12-27 23:25:12,776][106226] Updated weights for policy 0, policy_version 581243 (0.0010) [2023-12-27 23:25:12,834][106226] Updated weights for policy 0, policy_version 581253 (0.0009) [2023-12-27 23:25:12,895][106226] Updated weights for policy 0, policy_version 581263 (0.0009) [2023-12-27 23:25:13,291][106225] Updated weights for policy 1, policy_version 583252 (0.0008) [2023-12-27 23:25:13,352][106225] Updated weights for policy 1, policy_version 583262 (0.0008) [2023-12-27 23:25:13,409][106225] Updated weights for policy 1, policy_version 583272 (0.0007) [2023-12-27 23:25:13,617][106226] Updated weights for policy 0, policy_version 581273 (0.0006) [2023-12-27 23:25:13,678][106226] Updated weights for policy 0, policy_version 581283 (0.0005) [2023-12-27 23:25:13,732][106226] Updated weights for policy 0, policy_version 581293 (0.0005) [2023-12-27 23:25:14,131][106225] Updated weights for policy 1, policy_version 583282 (0.0008) [2023-12-27 23:25:14,191][106225] Updated weights for policy 1, policy_version 583292 (0.0010) [2023-12-27 23:25:14,251][106225] Updated weights for policy 1, policy_version 583302 (0.0010) [2023-12-27 23:25:14,312][106225] Updated weights for policy 1, policy_version 583312 (0.0010) [2023-12-27 23:25:14,357][106226] Updated weights for policy 0, policy_version 581303 (0.0008) [2023-12-27 23:25:14,417][106226] Updated weights for policy 0, policy_version 581313 (0.0008) [2023-12-27 23:25:14,475][106226] Updated weights for policy 0, policy_version 581323 (0.0008) [2023-12-27 23:25:14,939][106225] Updated weights for policy 1, policy_version 583322 (0.0009) [2023-12-27 23:25:15,003][106225] Updated weights for policy 1, policy_version 583332 (0.0008) [2023-12-27 23:25:15,067][106225] Updated weights for policy 1, policy_version 583342 (0.0008) [2023-12-27 23:25:15,267][106226] Updated weights for policy 0, policy_version 581333 (0.0008) [2023-12-27 23:25:15,323][106226] Updated weights for policy 0, policy_version 581343 (0.0008) [2023-12-27 23:25:15,383][106226] Updated weights for policy 0, policy_version 581353 (0.0009) [2023-12-27 23:25:15,720][106225] Updated weights for policy 1, policy_version 583352 (0.0009) [2023-12-27 23:25:15,781][106225] Updated weights for policy 1, policy_version 583362 (0.0009) [2023-12-27 23:25:15,839][106225] Updated weights for policy 1, policy_version 583372 (0.0006) [2023-12-27 23:25:16,075][106226] Updated weights for policy 0, policy_version 581363 (0.0007) [2023-12-27 23:25:16,140][106226] Updated weights for policy 0, policy_version 581373 (0.0005) [2023-12-27 23:25:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 298237952. Throughput: 0: 9696.9, 1: 9878.0. Samples: 298229668. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:16,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-5.603')] [2023-12-27 23:25:16,195][106226] Updated weights for policy 0, policy_version 581383 (0.0006) [2023-12-27 23:25:16,480][106225] Updated weights for policy 1, policy_version 583382 (0.0006) [2023-12-27 23:25:16,538][106225] Updated weights for policy 1, policy_version 583392 (0.0008) [2023-12-27 23:25:16,587][106225] Updated weights for policy 1, policy_version 583402 (0.0009) [2023-12-27 23:25:16,763][106226] Updated weights for policy 0, policy_version 581393 (0.0008) [2023-12-27 23:25:16,817][106226] Updated weights for policy 0, policy_version 581403 (0.0009) [2023-12-27 23:25:16,865][106226] Updated weights for policy 0, policy_version 581413 (0.0008) [2023-12-27 23:25:16,920][106226] Updated weights for policy 0, policy_version 581423 (0.0008) [2023-12-27 23:25:17,207][106225] Updated weights for policy 1, policy_version 583412 (0.0008) [2023-12-27 23:25:17,258][106225] Updated weights for policy 1, policy_version 583422 (0.0008) [2023-12-27 23:25:17,319][106225] Updated weights for policy 1, policy_version 583432 (0.0005) [2023-12-27 23:25:17,658][106226] Updated weights for policy 0, policy_version 581433 (0.0010) [2023-12-27 23:25:17,721][106226] Updated weights for policy 0, policy_version 581443 (0.0011) [2023-12-27 23:25:17,773][106226] Updated weights for policy 0, policy_version 581453 (0.0010) [2023-12-27 23:25:17,920][106225] Updated weights for policy 1, policy_version 583442 (0.0006) [2023-12-27 23:25:17,978][106225] Updated weights for policy 1, policy_version 583452 (0.0006) [2023-12-27 23:25:18,045][106225] Updated weights for policy 1, policy_version 583462 (0.0006) [2023-12-27 23:25:18,105][106225] Updated weights for policy 1, policy_version 583472 (0.0008) [2023-12-27 23:25:18,411][106226] Updated weights for policy 0, policy_version 581463 (0.0010) [2023-12-27 23:25:18,465][106226] Updated weights for policy 0, policy_version 581473 (0.0011) [2023-12-27 23:25:18,516][106226] Updated weights for policy 0, policy_version 581483 (0.0010) [2023-12-27 23:25:18,673][106225] Updated weights for policy 1, policy_version 583482 (0.0007) [2023-12-27 23:25:18,733][106225] Updated weights for policy 1, policy_version 583492 (0.0005) [2023-12-27 23:25:18,795][106225] Updated weights for policy 1, policy_version 583502 (0.0005) [2023-12-27 23:25:19,241][106226] Updated weights for policy 0, policy_version 581493 (0.0009) [2023-12-27 23:25:19,306][106226] Updated weights for policy 0, policy_version 581503 (0.0007) [2023-12-27 23:25:19,376][106226] Updated weights for policy 0, policy_version 581513 (0.0009) [2023-12-27 23:25:19,564][106225] Updated weights for policy 1, policy_version 583512 (0.0008) [2023-12-27 23:25:19,628][106225] Updated weights for policy 1, policy_version 583522 (0.0008) [2023-12-27 23:25:19,687][106225] Updated weights for policy 1, policy_version 583532 (0.0008) [2023-12-27 23:25:20,083][106226] Updated weights for policy 0, policy_version 581523 (0.0009) [2023-12-27 23:25:20,150][106226] Updated weights for policy 0, policy_version 581533 (0.0008) [2023-12-27 23:25:20,218][106226] Updated weights for policy 0, policy_version 581543 (0.0010) [2023-12-27 23:25:20,390][106225] Updated weights for policy 1, policy_version 583542 (0.0011) [2023-12-27 23:25:20,456][106225] Updated weights for policy 1, policy_version 583552 (0.0011) [2023-12-27 23:25:20,515][106225] Updated weights for policy 1, policy_version 583562 (0.0011) [2023-12-27 23:25:21,020][106226] Updated weights for policy 0, policy_version 581553 (0.0009) [2023-12-27 23:25:21,083][106226] Updated weights for policy 0, policy_version 581563 (0.0009) [2023-12-27 23:25:21,150][106226] Updated weights for policy 0, policy_version 581573 (0.0009) [2023-12-27 23:25:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 298336256. Throughput: 0: 9650.7, 1: 9954.5. Samples: 298351340. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:21,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-5.364')] [2023-12-27 23:25:21,205][106226] Updated weights for policy 0, policy_version 581583 (0.0009) [2023-12-27 23:25:21,299][106225] Updated weights for policy 1, policy_version 583572 (0.0010) [2023-12-27 23:25:21,362][106225] Updated weights for policy 1, policy_version 583582 (0.0009) [2023-12-27 23:25:21,439][106225] Updated weights for policy 1, policy_version 583592 (0.0009) [2023-12-27 23:25:22,040][106226] Updated weights for policy 0, policy_version 581593 (0.0008) [2023-12-27 23:25:22,103][106226] Updated weights for policy 0, policy_version 581603 (0.0009) [2023-12-27 23:25:22,160][106226] Updated weights for policy 0, policy_version 581613 (0.0008) [2023-12-27 23:25:22,230][106225] Updated weights for policy 1, policy_version 583602 (0.0008) [2023-12-27 23:25:22,296][106225] Updated weights for policy 1, policy_version 583612 (0.0011) [2023-12-27 23:25:22,370][106225] Updated weights for policy 1, policy_version 583622 (0.0017) [2023-12-27 23:25:22,432][106225] Updated weights for policy 1, policy_version 583632 (0.0011) [2023-12-27 23:25:22,936][106226] Updated weights for policy 0, policy_version 581623 (0.0008) [2023-12-27 23:25:22,987][106226] Updated weights for policy 0, policy_version 581633 (0.0008) [2023-12-27 23:25:23,034][106226] Updated weights for policy 0, policy_version 581643 (0.0008) [2023-12-27 23:25:23,181][106225] Updated weights for policy 1, policy_version 583642 (0.0011) [2023-12-27 23:25:23,232][106225] Updated weights for policy 1, policy_version 583652 (0.0010) [2023-12-27 23:25:23,296][106225] Updated weights for policy 1, policy_version 583662 (0.0010) [2023-12-27 23:25:23,808][106226] Updated weights for policy 0, policy_version 581653 (0.0008) [2023-12-27 23:25:23,854][106226] Updated weights for policy 0, policy_version 581663 (0.0008) [2023-12-27 23:25:23,907][106226] Updated weights for policy 0, policy_version 581673 (0.0007) [2023-12-27 23:25:23,973][106225] Updated weights for policy 1, policy_version 583672 (0.0006) [2023-12-27 23:25:24,023][106225] Updated weights for policy 1, policy_version 583682 (0.0005) [2023-12-27 23:25:24,074][106225] Updated weights for policy 1, policy_version 583692 (0.0005) [2023-12-27 23:25:24,699][106226] Updated weights for policy 0, policy_version 581683 (0.0008) [2023-12-27 23:25:24,720][106225] Updated weights for policy 1, policy_version 583702 (0.0005) [2023-12-27 23:25:24,754][106226] Updated weights for policy 0, policy_version 581693 (0.0008) [2023-12-27 23:25:24,776][106225] Updated weights for policy 1, policy_version 583712 (0.0007) [2023-12-27 23:25:24,808][106226] Updated weights for policy 0, policy_version 581703 (0.0007) [2023-12-27 23:25:24,827][106225] Updated weights for policy 1, policy_version 583722 (0.0007) [2023-12-27 23:25:25,454][106226] Updated weights for policy 0, policy_version 581713 (0.0008) [2023-12-27 23:25:25,513][106226] Updated weights for policy 0, policy_version 581723 (0.0009) [2023-12-27 23:25:25,572][106225] Updated weights for policy 1, policy_version 583732 (0.0007) [2023-12-27 23:25:25,573][106226] Updated weights for policy 0, policy_version 581733 (0.0009) [2023-12-27 23:25:25,627][106226] Updated weights for policy 0, policy_version 581743 (0.0008) [2023-12-27 23:25:25,631][106225] Updated weights for policy 1, policy_version 583742 (0.0005) [2023-12-27 23:25:25,683][106225] Updated weights for policy 1, policy_version 583752 (0.0005) [2023-12-27 23:25:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 298434560. Throughput: 0: 9604.3, 1: 9875.8. Samples: 298405292. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:26,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.530')] [2023-12-27 23:25:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000583760_149471232.pth... [2023-12-27 23:25:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000581744_148963328.pth... [2023-12-27 23:25:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000582608_149176320.pth [2023-12-27 23:25:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000580624_148676608.pth [2023-12-27 23:25:26,312][106225] Updated weights for policy 1, policy_version 583762 (0.0006) [2023-12-27 23:25:26,362][106226] Updated weights for policy 0, policy_version 581753 (0.0006) [2023-12-27 23:25:26,365][106225] Updated weights for policy 1, policy_version 583772 (0.0010) [2023-12-27 23:25:26,420][106226] Updated weights for policy 0, policy_version 581763 (0.0007) [2023-12-27 23:25:26,421][106225] Updated weights for policy 1, policy_version 583782 (0.0010) [2023-12-27 23:25:26,472][106226] Updated weights for policy 0, policy_version 581773 (0.0007) [2023-12-27 23:25:26,476][106225] Updated weights for policy 1, policy_version 583792 (0.0010) [2023-12-27 23:25:27,104][106225] Updated weights for policy 1, policy_version 583802 (0.0010) [2023-12-27 23:25:27,143][106226] Updated weights for policy 0, policy_version 581783 (0.0009) [2023-12-27 23:25:27,153][106225] Updated weights for policy 1, policy_version 583812 (0.0009) [2023-12-27 23:25:27,197][106225] Updated weights for policy 1, policy_version 583822 (0.0007) [2023-12-27 23:25:27,201][106226] Updated weights for policy 0, policy_version 581793 (0.0010) [2023-12-27 23:25:27,260][106226] Updated weights for policy 0, policy_version 581803 (0.0010) [2023-12-27 23:25:27,841][106225] Updated weights for policy 1, policy_version 583832 (0.0009) [2023-12-27 23:25:27,853][106226] Updated weights for policy 0, policy_version 581813 (0.0010) [2023-12-27 23:25:27,901][106225] Updated weights for policy 1, policy_version 583842 (0.0010) [2023-12-27 23:25:27,903][106226] Updated weights for policy 0, policy_version 581823 (0.0010) [2023-12-27 23:25:27,949][106226] Updated weights for policy 0, policy_version 581833 (0.0010) [2023-12-27 23:25:27,956][106225] Updated weights for policy 1, policy_version 583852 (0.0010) [2023-12-27 23:25:28,649][106226] Updated weights for policy 0, policy_version 581843 (0.0010) [2023-12-27 23:25:28,654][106225] Updated weights for policy 1, policy_version 583862 (0.0009) [2023-12-27 23:25:28,706][106226] Updated weights for policy 0, policy_version 581853 (0.0011) [2023-12-27 23:25:28,712][106225] Updated weights for policy 1, policy_version 583872 (0.0005) [2023-12-27 23:25:28,761][106226] Updated weights for policy 0, policy_version 581863 (0.0011) [2023-12-27 23:25:28,770][106225] Updated weights for policy 1, policy_version 583882 (0.0006) [2023-12-27 23:25:29,495][106225] Updated weights for policy 1, policy_version 583892 (0.0008) [2023-12-27 23:25:29,498][106226] Updated weights for policy 0, policy_version 581873 (0.0010) [2023-12-27 23:25:29,550][106225] Updated weights for policy 1, policy_version 583902 (0.0006) [2023-12-27 23:25:29,555][106226] Updated weights for policy 0, policy_version 581883 (0.0011) [2023-12-27 23:25:29,607][106225] Updated weights for policy 1, policy_version 583912 (0.0005) [2023-12-27 23:25:29,609][106226] Updated weights for policy 0, policy_version 581893 (0.0010) [2023-12-27 23:25:29,660][106226] Updated weights for policy 0, policy_version 581903 (0.0010) [2023-12-27 23:25:30,369][106226] Updated weights for policy 0, policy_version 581913 (0.0010) [2023-12-27 23:25:30,397][106225] Updated weights for policy 1, policy_version 583922 (0.0006) [2023-12-27 23:25:30,431][106226] Updated weights for policy 0, policy_version 581923 (0.0011) [2023-12-27 23:25:30,460][106225] Updated weights for policy 1, policy_version 583932 (0.0006) [2023-12-27 23:25:30,487][106226] Updated weights for policy 0, policy_version 581933 (0.0010) [2023-12-27 23:25:30,514][106225] Updated weights for policy 1, policy_version 583942 (0.0006) [2023-12-27 23:25:30,573][106225] Updated weights for policy 1, policy_version 583952 (0.0005) [2023-12-27 23:25:31,087][106225] Updated weights for policy 1, policy_version 583962 (0.0006) [2023-12-27 23:25:31,156][106225] Updated weights for policy 1, policy_version 583972 (0.0006) [2023-12-27 23:25:31,171][106226] Updated weights for policy 0, policy_version 581943 (0.0011) [2023-12-27 23:25:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 298532864. Throughput: 0: 9684.7, 1: 10003.2. Samples: 298527016. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:31,175][105115] Avg episode reward: [(0, '-5.090'), (1, '-5.530')] [2023-12-27 23:25:31,216][106225] Updated weights for policy 1, policy_version 583982 (0.0009) [2023-12-27 23:25:31,231][106226] Updated weights for policy 0, policy_version 581953 (0.0006) [2023-12-27 23:25:31,292][106226] Updated weights for policy 0, policy_version 581963 (0.0009) [2023-12-27 23:25:31,936][106226] Updated weights for policy 0, policy_version 581973 (0.0008) [2023-12-27 23:25:31,958][106225] Updated weights for policy 1, policy_version 583992 (0.0007) [2023-12-27 23:25:31,997][106226] Updated weights for policy 0, policy_version 581983 (0.0009) [2023-12-27 23:25:32,023][106225] Updated weights for policy 1, policy_version 584002 (0.0006) [2023-12-27 23:25:32,056][106226] Updated weights for policy 0, policy_version 581993 (0.0008) [2023-12-27 23:25:32,089][106225] Updated weights for policy 1, policy_version 584012 (0.0006) [2023-12-27 23:25:32,730][106226] Updated weights for policy 0, policy_version 582003 (0.0008) [2023-12-27 23:25:32,793][106226] Updated weights for policy 0, policy_version 582013 (0.0009) [2023-12-27 23:25:32,815][106225] Updated weights for policy 1, policy_version 584022 (0.0006) [2023-12-27 23:25:32,855][106226] Updated weights for policy 0, policy_version 582023 (0.0006) [2023-12-27 23:25:32,872][106225] Updated weights for policy 1, policy_version 584032 (0.0008) [2023-12-27 23:25:32,925][106225] Updated weights for policy 1, policy_version 584042 (0.0008) [2023-12-27 23:25:33,598][106226] Updated weights for policy 0, policy_version 582033 (0.0006) [2023-12-27 23:25:33,607][106225] Updated weights for policy 1, policy_version 584052 (0.0007) [2023-12-27 23:25:33,655][106226] Updated weights for policy 0, policy_version 582043 (0.0006) [2023-12-27 23:25:33,657][106225] Updated weights for policy 1, policy_version 584062 (0.0010) [2023-12-27 23:25:33,706][106225] Updated weights for policy 1, policy_version 584072 (0.0005) [2023-12-27 23:25:33,707][106226] Updated weights for policy 0, policy_version 582053 (0.0008) [2023-12-27 23:25:33,758][106226] Updated weights for policy 0, policy_version 582063 (0.0009) [2023-12-27 23:25:34,323][106225] Updated weights for policy 1, policy_version 584082 (0.0006) [2023-12-27 23:25:34,390][106225] Updated weights for policy 1, policy_version 584092 (0.0008) [2023-12-27 23:25:34,452][106225] Updated weights for policy 1, policy_version 584102 (0.0008) [2023-12-27 23:25:34,518][106225] Updated weights for policy 1, policy_version 584112 (0.0007) [2023-12-27 23:25:34,543][106226] Updated weights for policy 0, policy_version 582073 (0.0010) [2023-12-27 23:25:34,609][106226] Updated weights for policy 0, policy_version 582083 (0.0010) [2023-12-27 23:25:34,677][106226] Updated weights for policy 0, policy_version 582093 (0.0011) [2023-12-27 23:25:35,209][106225] Updated weights for policy 1, policy_version 584122 (0.0010) [2023-12-27 23:25:35,270][106225] Updated weights for policy 1, policy_version 584132 (0.0010) [2023-12-27 23:25:35,328][106225] Updated weights for policy 1, policy_version 584142 (0.0010) [2023-12-27 23:25:35,340][106226] Updated weights for policy 0, policy_version 582103 (0.0007) [2023-12-27 23:25:35,398][106226] Updated weights for policy 0, policy_version 582113 (0.0005) [2023-12-27 23:25:35,451][106226] Updated weights for policy 0, policy_version 582123 (0.0009) [2023-12-27 23:25:35,933][106225] Updated weights for policy 1, policy_version 584152 (0.0008) [2023-12-27 23:25:35,994][106225] Updated weights for policy 1, policy_version 584162 (0.0007) [2023-12-27 23:25:36,057][106225] Updated weights for policy 1, policy_version 584172 (0.0006) [2023-12-27 23:25:36,107][106226] Updated weights for policy 0, policy_version 582133 (0.0010) [2023-12-27 23:25:36,170][106226] Updated weights for policy 0, policy_version 582143 (0.0009) [2023-12-27 23:25:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 298639360. Throughput: 0: 9737.3, 1: 9972.2. Samples: 298648440. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:36,175][105115] Avg episode reward: [(0, '-4.930'), (1, '-5.839')] [2023-12-27 23:25:36,235][106226] Updated weights for policy 0, policy_version 582153 (0.0008) [2023-12-27 23:25:36,717][106225] Updated weights for policy 1, policy_version 584182 (0.0009) [2023-12-27 23:25:36,775][106225] Updated weights for policy 1, policy_version 584192 (0.0010) [2023-12-27 23:25:36,832][106225] Updated weights for policy 1, policy_version 584202 (0.0010) [2023-12-27 23:25:37,017][106226] Updated weights for policy 0, policy_version 582163 (0.0008) [2023-12-27 23:25:37,067][106226] Updated weights for policy 0, policy_version 582173 (0.0008) [2023-12-27 23:25:37,124][106226] Updated weights for policy 0, policy_version 582183 (0.0007) [2023-12-27 23:25:37,496][106225] Updated weights for policy 1, policy_version 584212 (0.0008) [2023-12-27 23:25:37,551][106225] Updated weights for policy 1, policy_version 584222 (0.0008) [2023-12-27 23:25:37,606][106225] Updated weights for policy 1, policy_version 584232 (0.0009) [2023-12-27 23:25:37,884][106226] Updated weights for policy 0, policy_version 582193 (0.0008) [2023-12-27 23:25:37,942][106226] Updated weights for policy 0, policy_version 582203 (0.0009) [2023-12-27 23:25:37,995][106226] Updated weights for policy 0, policy_version 582213 (0.0008) [2023-12-27 23:25:38,053][106226] Updated weights for policy 0, policy_version 582223 (0.0008) [2023-12-27 23:25:38,261][106225] Updated weights for policy 1, policy_version 584242 (0.0010) [2023-12-27 23:25:38,317][106225] Updated weights for policy 1, policy_version 584252 (0.0006) [2023-12-27 23:25:38,385][106225] Updated weights for policy 1, policy_version 584262 (0.0007) [2023-12-27 23:25:38,451][106225] Updated weights for policy 1, policy_version 584272 (0.0005) [2023-12-27 23:25:38,850][106226] Updated weights for policy 0, policy_version 582233 (0.0010) [2023-12-27 23:25:38,904][106226] Updated weights for policy 0, policy_version 582243 (0.0009) [2023-12-27 23:25:38,960][106226] Updated weights for policy 0, policy_version 582253 (0.0009) [2023-12-27 23:25:38,986][106225] Updated weights for policy 1, policy_version 584282 (0.0008) [2023-12-27 23:25:39,042][106225] Updated weights for policy 1, policy_version 584292 (0.0008) [2023-12-27 23:25:39,106][106225] Updated weights for policy 1, policy_version 584302 (0.0005) [2023-12-27 23:25:39,723][106225] Updated weights for policy 1, policy_version 584312 (0.0005) [2023-12-27 23:25:39,790][106225] Updated weights for policy 1, policy_version 584322 (0.0006) [2023-12-27 23:25:39,804][106226] Updated weights for policy 0, policy_version 582263 (0.0009) [2023-12-27 23:25:39,855][106225] Updated weights for policy 1, policy_version 584332 (0.0009) [2023-12-27 23:25:39,876][106226] Updated weights for policy 0, policy_version 582273 (0.0010) [2023-12-27 23:25:39,944][106226] Updated weights for policy 0, policy_version 582283 (0.0009) [2023-12-27 23:25:40,501][106225] Updated weights for policy 1, policy_version 584342 (0.0007) [2023-12-27 23:25:40,561][106225] Updated weights for policy 1, policy_version 584352 (0.0008) [2023-12-27 23:25:40,614][106225] Updated weights for policy 1, policy_version 584362 (0.0006) [2023-12-27 23:25:40,717][106226] Updated weights for policy 0, policy_version 582293 (0.0008) [2023-12-27 23:25:40,783][106226] Updated weights for policy 0, policy_version 582303 (0.0011) [2023-12-27 23:25:40,845][106226] Updated weights for policy 0, policy_version 582313 (0.0009) [2023-12-27 23:25:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 298737664. Throughput: 0: 9715.3, 1: 10043.9. Samples: 298707624. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:41,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-5.846')] [2023-12-27 23:25:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000582320_149110784.pth... [2023-12-27 23:25:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000581200_148824064.pth [2023-12-27 23:25:41,208][106225] Updated weights for policy 1, policy_version 584372 (0.0007) [2023-12-27 23:25:41,274][106225] Updated weights for policy 1, policy_version 584382 (0.0009) [2023-12-27 23:25:41,338][106225] Updated weights for policy 1, policy_version 584392 (0.0008) [2023-12-27 23:25:41,397][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000584400_149635072.pth... [2023-12-27 23:25:41,402][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000583184_149323776.pth [2023-12-27 23:25:41,660][106226] Updated weights for policy 0, policy_version 582323 (0.0009) [2023-12-27 23:25:41,723][106226] Updated weights for policy 0, policy_version 582333 (0.0007) [2023-12-27 23:25:41,794][106226] Updated weights for policy 0, policy_version 582343 (0.0009) [2023-12-27 23:25:42,089][106225] Updated weights for policy 1, policy_version 584402 (0.0008) [2023-12-27 23:25:42,142][106225] Updated weights for policy 1, policy_version 584412 (0.0008) [2023-12-27 23:25:42,201][106225] Updated weights for policy 1, policy_version 584422 (0.0009) [2023-12-27 23:25:42,262][106225] Updated weights for policy 1, policy_version 584432 (0.0009) [2023-12-27 23:25:42,548][106226] Updated weights for policy 0, policy_version 582353 (0.0009) [2023-12-27 23:25:42,610][106226] Updated weights for policy 0, policy_version 582363 (0.0009) [2023-12-27 23:25:42,672][106226] Updated weights for policy 0, policy_version 582373 (0.0009) [2023-12-27 23:25:42,733][106226] Updated weights for policy 0, policy_version 582383 (0.0009) [2023-12-27 23:25:42,992][106225] Updated weights for policy 1, policy_version 584442 (0.0009) [2023-12-27 23:25:43,040][106225] Updated weights for policy 1, policy_version 584452 (0.0008) [2023-12-27 23:25:43,090][106225] Updated weights for policy 1, policy_version 584462 (0.0008) [2023-12-27 23:25:43,481][106226] Updated weights for policy 0, policy_version 582393 (0.0008) [2023-12-27 23:25:43,541][106226] Updated weights for policy 0, policy_version 582403 (0.0009) [2023-12-27 23:25:43,594][106226] Updated weights for policy 0, policy_version 582413 (0.0008) [2023-12-27 23:25:43,781][106225] Updated weights for policy 1, policy_version 584472 (0.0006) [2023-12-27 23:25:43,832][106225] Updated weights for policy 1, policy_version 584482 (0.0008) [2023-12-27 23:25:43,899][106225] Updated weights for policy 1, policy_version 584492 (0.0009) [2023-12-27 23:25:44,330][106226] Updated weights for policy 0, policy_version 582423 (0.0008) [2023-12-27 23:25:44,381][106226] Updated weights for policy 0, policy_version 582433 (0.0008) [2023-12-27 23:25:44,428][106226] Updated weights for policy 0, policy_version 582443 (0.0008) [2023-12-27 23:25:44,583][106225] Updated weights for policy 1, policy_version 584502 (0.0009) [2023-12-27 23:25:44,638][106225] Updated weights for policy 1, policy_version 584512 (0.0010) [2023-12-27 23:25:44,684][106225] Updated weights for policy 1, policy_version 584522 (0.0010) [2023-12-27 23:25:45,222][106226] Updated weights for policy 0, policy_version 582453 (0.0007) [2023-12-27 23:25:45,286][106226] Updated weights for policy 0, policy_version 582463 (0.0007) [2023-12-27 23:25:45,350][106226] Updated weights for policy 0, policy_version 582473 (0.0008) [2023-12-27 23:25:45,374][106225] Updated weights for policy 1, policy_version 584532 (0.0010) [2023-12-27 23:25:45,421][106225] Updated weights for policy 1, policy_version 584542 (0.0010) [2023-12-27 23:25:45,468][106225] Updated weights for policy 1, policy_version 584552 (0.0010) [2023-12-27 23:25:45,967][106226] Updated weights for policy 0, policy_version 582483 (0.0008) [2023-12-27 23:25:46,026][106226] Updated weights for policy 0, policy_version 582493 (0.0008) [2023-12-27 23:25:46,089][106226] Updated weights for policy 0, policy_version 582503 (0.0008) [2023-12-27 23:25:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 298835968. Throughput: 0: 9660.2, 1: 10106.6. Samples: 298823132. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:46,175][105115] Avg episode reward: [(0, '-5.187'), (1, '-5.235')] [2023-12-27 23:25:46,212][106225] Updated weights for policy 1, policy_version 584562 (0.0010) [2023-12-27 23:25:46,267][106225] Updated weights for policy 1, policy_version 584572 (0.0010) [2023-12-27 23:25:46,316][106225] Updated weights for policy 1, policy_version 584582 (0.0010) [2023-12-27 23:25:46,366][106225] Updated weights for policy 1, policy_version 584592 (0.0010) [2023-12-27 23:25:46,828][106226] Updated weights for policy 0, policy_version 582513 (0.0007) [2023-12-27 23:25:46,895][106226] Updated weights for policy 0, policy_version 582523 (0.0005) [2023-12-27 23:25:46,958][106226] Updated weights for policy 0, policy_version 582533 (0.0006) [2023-12-27 23:25:46,998][106225] Updated weights for policy 1, policy_version 584602 (0.0009) [2023-12-27 23:25:47,024][106226] Updated weights for policy 0, policy_version 582543 (0.0006) [2023-12-27 23:25:47,052][106225] Updated weights for policy 1, policy_version 584612 (0.0009) [2023-12-27 23:25:47,106][106225] Updated weights for policy 1, policy_version 584622 (0.0008) [2023-12-27 23:25:47,672][106226] Updated weights for policy 0, policy_version 582553 (0.0005) [2023-12-27 23:25:47,731][106226] Updated weights for policy 0, policy_version 582563 (0.0006) [2023-12-27 23:25:47,791][106226] Updated weights for policy 0, policy_version 582573 (0.0008) [2023-12-27 23:25:47,819][106225] Updated weights for policy 1, policy_version 584632 (0.0008) [2023-12-27 23:25:47,881][106225] Updated weights for policy 1, policy_version 584642 (0.0006) [2023-12-27 23:25:47,945][106225] Updated weights for policy 1, policy_version 584652 (0.0006) [2023-12-27 23:25:48,391][106226] Updated weights for policy 0, policy_version 582583 (0.0007) [2023-12-27 23:25:48,460][106226] Updated weights for policy 0, policy_version 582593 (0.0009) [2023-12-27 23:25:48,516][106226] Updated weights for policy 0, policy_version 582603 (0.0008) [2023-12-27 23:25:48,588][106225] Updated weights for policy 1, policy_version 584662 (0.0008) [2023-12-27 23:25:48,652][106225] Updated weights for policy 1, policy_version 584672 (0.0006) [2023-12-27 23:25:48,708][106225] Updated weights for policy 1, policy_version 584682 (0.0010) [2023-12-27 23:25:49,241][106226] Updated weights for policy 0, policy_version 582613 (0.0009) [2023-12-27 23:25:49,300][106226] Updated weights for policy 0, policy_version 582623 (0.0009) [2023-12-27 23:25:49,369][106226] Updated weights for policy 0, policy_version 582633 (0.0009) [2023-12-27 23:25:49,425][106225] Updated weights for policy 1, policy_version 584692 (0.0009) [2023-12-27 23:25:49,481][106225] Updated weights for policy 1, policy_version 584702 (0.0008) [2023-12-27 23:25:49,543][106225] Updated weights for policy 1, policy_version 584712 (0.0008) [2023-12-27 23:25:50,160][106226] Updated weights for policy 0, policy_version 582643 (0.0007) [2023-12-27 23:25:50,212][106226] Updated weights for policy 0, policy_version 582653 (0.0006) [2023-12-27 23:25:50,264][106226] Updated weights for policy 0, policy_version 582663 (0.0006) [2023-12-27 23:25:50,357][106225] Updated weights for policy 1, policy_version 584722 (0.0009) [2023-12-27 23:25:50,418][106225] Updated weights for policy 1, policy_version 584732 (0.0011) [2023-12-27 23:25:50,479][106225] Updated weights for policy 1, policy_version 584742 (0.0010) [2023-12-27 23:25:50,530][106225] Updated weights for policy 1, policy_version 584752 (0.0010) [2023-12-27 23:25:50,984][106226] Updated weights for policy 0, policy_version 582673 (0.0007) [2023-12-27 23:25:51,050][106226] Updated weights for policy 0, policy_version 582683 (0.0008) [2023-12-27 23:25:51,116][106226] Updated weights for policy 0, policy_version 582693 (0.0008) [2023-12-27 23:25:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 298926080. Throughput: 0: 9646.9, 1: 10089.8. Samples: 298941932. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:51,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-5.547')] [2023-12-27 23:25:51,186][106226] Updated weights for policy 0, policy_version 582703 (0.0008) [2023-12-27 23:25:51,344][106225] Updated weights for policy 1, policy_version 584762 (0.0009) [2023-12-27 23:25:51,417][106225] Updated weights for policy 1, policy_version 584772 (0.0009) [2023-12-27 23:25:51,480][106225] Updated weights for policy 1, policy_version 584782 (0.0008) [2023-12-27 23:25:51,946][106226] Updated weights for policy 0, policy_version 582713 (0.0006) [2023-12-27 23:25:52,009][106226] Updated weights for policy 0, policy_version 582723 (0.0005) [2023-12-27 23:25:52,079][106226] Updated weights for policy 0, policy_version 582733 (0.0007) [2023-12-27 23:25:52,224][106225] Updated weights for policy 1, policy_version 584792 (0.0008) [2023-12-27 23:25:52,285][106225] Updated weights for policy 1, policy_version 584802 (0.0008) [2023-12-27 23:25:52,353][106225] Updated weights for policy 1, policy_version 584812 (0.0007) [2023-12-27 23:25:52,748][106226] Updated weights for policy 0, policy_version 582743 (0.0010) [2023-12-27 23:25:52,808][106226] Updated weights for policy 0, policy_version 582753 (0.0011) [2023-12-27 23:25:52,881][106226] Updated weights for policy 0, policy_version 582763 (0.0011) [2023-12-27 23:25:53,094][106225] Updated weights for policy 1, policy_version 584822 (0.0008) [2023-12-27 23:25:53,148][106225] Updated weights for policy 1, policy_version 584832 (0.0008) [2023-12-27 23:25:53,206][106225] Updated weights for policy 1, policy_version 584842 (0.0008) [2023-12-27 23:25:53,609][106226] Updated weights for policy 0, policy_version 582773 (0.0011) [2023-12-27 23:25:53,666][106226] Updated weights for policy 0, policy_version 582783 (0.0011) [2023-12-27 23:25:53,722][106226] Updated weights for policy 0, policy_version 582793 (0.0011) [2023-12-27 23:25:53,878][106225] Updated weights for policy 1, policy_version 584852 (0.0008) [2023-12-27 23:25:53,934][106225] Updated weights for policy 1, policy_version 584862 (0.0006) [2023-12-27 23:25:53,989][106225] Updated weights for policy 1, policy_version 584872 (0.0007) [2023-12-27 23:25:54,446][106226] Updated weights for policy 0, policy_version 582803 (0.0010) [2023-12-27 23:25:54,509][106226] Updated weights for policy 0, policy_version 582813 (0.0009) [2023-12-27 23:25:54,569][106226] Updated weights for policy 0, policy_version 582823 (0.0008) [2023-12-27 23:25:54,604][106225] Updated weights for policy 1, policy_version 584882 (0.0009) [2023-12-27 23:25:54,661][106225] Updated weights for policy 1, policy_version 584892 (0.0007) [2023-12-27 23:25:54,720][106225] Updated weights for policy 1, policy_version 584902 (0.0008) [2023-12-27 23:25:54,778][106225] Updated weights for policy 1, policy_version 584912 (0.0007) [2023-12-27 23:25:55,206][106226] Updated weights for policy 0, policy_version 582833 (0.0007) [2023-12-27 23:25:55,266][106226] Updated weights for policy 0, policy_version 582843 (0.0009) [2023-12-27 23:25:55,314][106226] Updated weights for policy 0, policy_version 582853 (0.0009) [2023-12-27 23:25:55,359][106226] Updated weights for policy 0, policy_version 582863 (0.0006) [2023-12-27 23:25:55,443][106225] Updated weights for policy 1, policy_version 584922 (0.0005) [2023-12-27 23:25:55,498][106225] Updated weights for policy 1, policy_version 584932 (0.0005) [2023-12-27 23:25:55,552][106225] Updated weights for policy 1, policy_version 584942 (0.0008) [2023-12-27 23:25:55,983][106226] Updated weights for policy 0, policy_version 582873 (0.0008) [2023-12-27 23:25:56,044][106226] Updated weights for policy 0, policy_version 582883 (0.0010) [2023-12-27 23:25:56,104][106226] Updated weights for policy 0, policy_version 582893 (0.0010) [2023-12-27 23:25:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 299032576. Throughput: 0: 9611.4, 1: 10037.7. Samples: 298998984. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:25:56,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.932')] [2023-12-27 23:25:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000584944_149774336.pth... [2023-12-27 23:25:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000582896_149258240.pth... [2023-12-27 23:25:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000583760_149471232.pth [2023-12-27 23:25:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000581744_148963328.pth [2023-12-27 23:25:56,237][106225] Updated weights for policy 1, policy_version 584952 (0.0010) [2023-12-27 23:25:56,296][106225] Updated weights for policy 1, policy_version 584963 (0.0009) [2023-12-27 23:25:56,350][106225] Updated weights for policy 1, policy_version 584973 (0.0009) [2023-12-27 23:25:56,664][106226] Updated weights for policy 0, policy_version 582903 (0.0007) [2023-12-27 23:25:56,719][106226] Updated weights for policy 0, policy_version 582913 (0.0005) [2023-12-27 23:25:56,782][106226] Updated weights for policy 0, policy_version 582923 (0.0005) [2023-12-27 23:25:57,111][106225] Updated weights for policy 1, policy_version 584983 (0.0008) [2023-12-27 23:25:57,166][106225] Updated weights for policy 1, policy_version 584993 (0.0008) [2023-12-27 23:25:57,227][106225] Updated weights for policy 1, policy_version 585003 (0.0008) [2023-12-27 23:25:57,431][106226] Updated weights for policy 0, policy_version 582933 (0.0006) [2023-12-27 23:25:57,490][106226] Updated weights for policy 0, policy_version 582943 (0.0005) [2023-12-27 23:25:57,554][106226] Updated weights for policy 0, policy_version 582953 (0.0005) [2023-12-27 23:25:57,903][106225] Updated weights for policy 1, policy_version 585013 (0.0008) [2023-12-27 23:25:57,958][106225] Updated weights for policy 1, policy_version 585023 (0.0009) [2023-12-27 23:25:58,013][106225] Updated weights for policy 1, policy_version 585033 (0.0007) [2023-12-27 23:25:58,139][106226] Updated weights for policy 0, policy_version 582963 (0.0005) [2023-12-27 23:25:58,209][106226] Updated weights for policy 0, policy_version 582973 (0.0006) [2023-12-27 23:25:58,274][106226] Updated weights for policy 0, policy_version 582983 (0.0009) [2023-12-27 23:25:58,694][106225] Updated weights for policy 1, policy_version 585043 (0.0006) [2023-12-27 23:25:58,756][106225] Updated weights for policy 1, policy_version 585053 (0.0008) [2023-12-27 23:25:58,826][106225] Updated weights for policy 1, policy_version 585063 (0.0007) [2023-12-27 23:25:59,068][106226] Updated weights for policy 0, policy_version 582993 (0.0010) [2023-12-27 23:25:59,128][106226] Updated weights for policy 0, policy_version 583003 (0.0011) [2023-12-27 23:25:59,188][106226] Updated weights for policy 0, policy_version 583013 (0.0010) [2023-12-27 23:25:59,257][106226] Updated weights for policy 0, policy_version 583023 (0.0010) [2023-12-27 23:25:59,631][106225] Updated weights for policy 1, policy_version 585073 (0.0007) [2023-12-27 23:25:59,693][106225] Updated weights for policy 1, policy_version 585083 (0.0007) [2023-12-27 23:25:59,761][106225] Updated weights for policy 1, policy_version 585093 (0.0006) [2023-12-27 23:25:59,835][106225] Updated weights for policy 1, policy_version 585103 (0.0010) [2023-12-27 23:25:59,952][106226] Updated weights for policy 0, policy_version 583033 (0.0007) [2023-12-27 23:26:00,021][106226] Updated weights for policy 0, policy_version 583043 (0.0009) [2023-12-27 23:26:00,090][106226] Updated weights for policy 0, policy_version 583053 (0.0008) [2023-12-27 23:26:00,492][106225] Updated weights for policy 1, policy_version 585113 (0.0010) [2023-12-27 23:26:00,554][106225] Updated weights for policy 1, policy_version 585123 (0.0010) [2023-12-27 23:26:00,614][106225] Updated weights for policy 1, policy_version 585133 (0.0010) [2023-12-27 23:26:00,699][106226] Updated weights for policy 0, policy_version 583063 (0.0009) [2023-12-27 23:26:00,758][106226] Updated weights for policy 0, policy_version 583073 (0.0010) [2023-12-27 23:26:00,819][106226] Updated weights for policy 0, policy_version 583083 (0.0010) [2023-12-27 23:26:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 299130880. Throughput: 0: 9722.1, 1: 10071.6. Samples: 299120388. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:26:01,175][105115] Avg episode reward: [(0, '-4.866'), (1, '-5.890')] [2023-12-27 23:26:01,328][106225] Updated weights for policy 1, policy_version 585143 (0.0008) [2023-12-27 23:26:01,393][106225] Updated weights for policy 1, policy_version 585153 (0.0007) [2023-12-27 23:26:01,461][106225] Updated weights for policy 1, policy_version 585163 (0.0007) [2023-12-27 23:26:01,521][106226] Updated weights for policy 0, policy_version 583093 (0.0006) [2023-12-27 23:26:01,585][106226] Updated weights for policy 0, policy_version 583103 (0.0006) [2023-12-27 23:26:01,655][106226] Updated weights for policy 0, policy_version 583113 (0.0009) [2023-12-27 23:26:02,208][106225] Updated weights for policy 1, policy_version 585173 (0.0007) [2023-12-27 23:26:02,266][106225] Updated weights for policy 1, policy_version 585183 (0.0008) [2023-12-27 23:26:02,272][106226] Updated weights for policy 0, policy_version 583123 (0.0008) [2023-12-27 23:26:02,326][106225] Updated weights for policy 1, policy_version 585193 (0.0008) [2023-12-27 23:26:02,327][106226] Updated weights for policy 0, policy_version 583133 (0.0005) [2023-12-27 23:26:02,391][106226] Updated weights for policy 0, policy_version 583143 (0.0007) [2023-12-27 23:26:02,933][106226] Updated weights for policy 0, policy_version 583153 (0.0005) [2023-12-27 23:26:02,992][106226] Updated weights for policy 0, policy_version 583163 (0.0008) [2023-12-27 23:26:03,048][106226] Updated weights for policy 0, policy_version 583173 (0.0009) [2023-12-27 23:26:03,111][106226] Updated weights for policy 0, policy_version 583183 (0.0009) [2023-12-27 23:26:03,130][106225] Updated weights for policy 1, policy_version 585203 (0.0006) [2023-12-27 23:26:03,184][106225] Updated weights for policy 1, policy_version 585213 (0.0006) [2023-12-27 23:26:03,237][106225] Updated weights for policy 1, policy_version 585223 (0.0005) [2023-12-27 23:26:03,775][106226] Updated weights for policy 0, policy_version 583193 (0.0006) [2023-12-27 23:26:03,820][106225] Updated weights for policy 1, policy_version 585233 (0.0005) [2023-12-27 23:26:03,826][106226] Updated weights for policy 0, policy_version 583203 (0.0006) [2023-12-27 23:26:03,885][106225] Updated weights for policy 1, policy_version 585243 (0.0008) [2023-12-27 23:26:03,889][106226] Updated weights for policy 0, policy_version 583213 (0.0008) [2023-12-27 23:26:03,953][106225] Updated weights for policy 1, policy_version 585253 (0.0007) [2023-12-27 23:26:04,019][106225] Updated weights for policy 1, policy_version 585263 (0.0006) [2023-12-27 23:26:04,620][106226] Updated weights for policy 0, policy_version 583223 (0.0008) [2023-12-27 23:26:04,676][106225] Updated weights for policy 1, policy_version 585273 (0.0007) [2023-12-27 23:26:04,682][106226] Updated weights for policy 0, policy_version 583233 (0.0008) [2023-12-27 23:26:04,736][106225] Updated weights for policy 1, policy_version 585283 (0.0007) [2023-12-27 23:26:04,746][106226] Updated weights for policy 0, policy_version 583243 (0.0006) [2023-12-27 23:26:04,798][106225] Updated weights for policy 1, policy_version 585293 (0.0007) [2023-12-27 23:26:05,485][106225] Updated weights for policy 1, policy_version 585303 (0.0008) [2023-12-27 23:26:05,503][106226] Updated weights for policy 0, policy_version 583253 (0.0006) [2023-12-27 23:26:05,545][106225] Updated weights for policy 1, policy_version 585313 (0.0008) [2023-12-27 23:26:05,557][106226] Updated weights for policy 0, policy_version 583263 (0.0007) [2023-12-27 23:26:05,601][106225] Updated weights for policy 1, policy_version 585323 (0.0008) [2023-12-27 23:26:05,611][106226] Updated weights for policy 0, policy_version 583273 (0.0007) [2023-12-27 23:26:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 299229184. Throughput: 0: 9770.2, 1: 9997.8. Samples: 299240900. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:26:06,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-5.831')] [2023-12-27 23:26:06,327][106226] Updated weights for policy 0, policy_version 583283 (0.0008) [2023-12-27 23:26:06,351][106225] Updated weights for policy 1, policy_version 585333 (0.0008) [2023-12-27 23:26:06,393][106226] Updated weights for policy 0, policy_version 583293 (0.0008) [2023-12-27 23:26:06,408][106225] Updated weights for policy 1, policy_version 585343 (0.0007) [2023-12-27 23:26:06,452][106226] Updated weights for policy 0, policy_version 583303 (0.0008) [2023-12-27 23:26:06,467][106225] Updated weights for policy 1, policy_version 585353 (0.0006) [2023-12-27 23:26:07,117][106226] Updated weights for policy 0, policy_version 583313 (0.0007) [2023-12-27 23:26:07,178][106225] Updated weights for policy 1, policy_version 585363 (0.0006) [2023-12-27 23:26:07,185][106226] Updated weights for policy 0, policy_version 583323 (0.0007) [2023-12-27 23:26:07,224][106225] Updated weights for policy 1, policy_version 585373 (0.0006) [2023-12-27 23:26:07,237][106226] Updated weights for policy 0, policy_version 583333 (0.0007) [2023-12-27 23:26:07,276][106225] Updated weights for policy 1, policy_version 585383 (0.0006) [2023-12-27 23:26:07,285][106226] Updated weights for policy 0, policy_version 583343 (0.0006) [2023-12-27 23:26:07,883][106226] Updated weights for policy 0, policy_version 583353 (0.0008) [2023-12-27 23:26:07,936][106226] Updated weights for policy 0, policy_version 583363 (0.0009) [2023-12-27 23:26:07,994][106226] Updated weights for policy 0, policy_version 583373 (0.0008) [2023-12-27 23:26:08,076][106225] Updated weights for policy 1, policy_version 585394 (0.0009) [2023-12-27 23:26:08,124][106225] Updated weights for policy 1, policy_version 585404 (0.0008) [2023-12-27 23:26:08,188][106225] Updated weights for policy 1, policy_version 585414 (0.0005) [2023-12-27 23:26:08,250][106225] Updated weights for policy 1, policy_version 585424 (0.0005) [2023-12-27 23:26:08,674][106226] Updated weights for policy 0, policy_version 583383 (0.0009) [2023-12-27 23:26:08,733][106226] Updated weights for policy 0, policy_version 583393 (0.0007) [2023-12-27 23:26:08,803][106226] Updated weights for policy 0, policy_version 583403 (0.0008) [2023-12-27 23:26:08,955][106225] Updated weights for policy 1, policy_version 585434 (0.0009) [2023-12-27 23:26:09,009][106225] Updated weights for policy 1, policy_version 585444 (0.0010) [2023-12-27 23:26:09,062][106225] Updated weights for policy 1, policy_version 585454 (0.0008) [2023-12-27 23:26:09,419][106226] Updated weights for policy 0, policy_version 583413 (0.0009) [2023-12-27 23:26:09,483][106226] Updated weights for policy 0, policy_version 583423 (0.0009) [2023-12-27 23:26:09,544][106226] Updated weights for policy 0, policy_version 583433 (0.0009) [2023-12-27 23:26:09,887][106225] Updated weights for policy 1, policy_version 585464 (0.0008) [2023-12-27 23:26:09,957][106225] Updated weights for policy 1, policy_version 585474 (0.0008) [2023-12-27 23:26:10,021][106225] Updated weights for policy 1, policy_version 585484 (0.0006) [2023-12-27 23:26:10,204][106226] Updated weights for policy 0, policy_version 583443 (0.0008) [2023-12-27 23:26:10,265][106226] Updated weights for policy 0, policy_version 583453 (0.0008) [2023-12-27 23:26:10,324][106226] Updated weights for policy 0, policy_version 583463 (0.0008) [2023-12-27 23:26:10,685][106225] Updated weights for policy 1, policy_version 585494 (0.0007) [2023-12-27 23:26:10,743][106225] Updated weights for policy 1, policy_version 585504 (0.0006) [2023-12-27 23:26:10,800][106225] Updated weights for policy 1, policy_version 585514 (0.0005) [2023-12-27 23:26:11,118][106226] Updated weights for policy 0, policy_version 583473 (0.0008) [2023-12-27 23:26:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 299327488. Throughput: 0: 9884.3, 1: 10024.5. Samples: 299301192. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:26:11,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.406')] [2023-12-27 23:26:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000585520_149921792.pth... [2023-12-27 23:26:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000584400_149635072.pth [2023-12-27 23:26:11,197][106226] Updated weights for policy 0, policy_version 583483 (0.0008) [2023-12-27 23:26:11,265][106226] Updated weights for policy 0, policy_version 583493 (0.0008) [2023-12-27 23:26:11,319][106226] Updated weights for policy 0, policy_version 583503 (0.0009) [2023-12-27 23:26:11,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000583504_149413888.pth... [2023-12-27 23:26:11,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000582320_149110784.pth [2023-12-27 23:26:11,510][106225] Updated weights for policy 1, policy_version 585524 (0.0007) [2023-12-27 23:26:11,573][106225] Updated weights for policy 1, policy_version 585534 (0.0009) [2023-12-27 23:26:11,633][106225] Updated weights for policy 1, policy_version 585544 (0.0009) [2023-12-27 23:26:12,069][106226] Updated weights for policy 0, policy_version 583513 (0.0008) [2023-12-27 23:26:12,127][106226] Updated weights for policy 0, policy_version 583523 (0.0009) [2023-12-27 23:26:12,190][106226] Updated weights for policy 0, policy_version 583533 (0.0008) [2023-12-27 23:26:12,403][106225] Updated weights for policy 1, policy_version 585554 (0.0008) [2023-12-27 23:26:12,469][106225] Updated weights for policy 1, policy_version 585564 (0.0007) [2023-12-27 23:26:12,533][106225] Updated weights for policy 1, policy_version 585574 (0.0009) [2023-12-27 23:26:12,590][106225] Updated weights for policy 1, policy_version 585584 (0.0008) [2023-12-27 23:26:12,972][106226] Updated weights for policy 0, policy_version 583543 (0.0008) [2023-12-27 23:26:13,017][106226] Updated weights for policy 0, policy_version 583553 (0.0008) [2023-12-27 23:26:13,069][106226] Updated weights for policy 0, policy_version 583563 (0.0008) [2023-12-27 23:26:13,207][106225] Updated weights for policy 1, policy_version 585594 (0.0007) [2023-12-27 23:26:13,270][106225] Updated weights for policy 1, policy_version 585604 (0.0008) [2023-12-27 23:26:13,325][106225] Updated weights for policy 1, policy_version 585614 (0.0008) [2023-12-27 23:26:13,821][106226] Updated weights for policy 0, policy_version 583573 (0.0009) [2023-12-27 23:26:13,866][106226] Updated weights for policy 0, policy_version 583583 (0.0008) [2023-12-27 23:26:13,920][106226] Updated weights for policy 0, policy_version 583593 (0.0006) [2023-12-27 23:26:14,055][106225] Updated weights for policy 1, policy_version 585624 (0.0008) [2023-12-27 23:26:14,135][106225] Updated weights for policy 1, policy_version 585635 (0.0008) [2023-12-27 23:26:14,199][106225] Updated weights for policy 1, policy_version 585645 (0.0007) [2023-12-27 23:26:14,588][106226] Updated weights for policy 0, policy_version 583603 (0.0006) [2023-12-27 23:26:14,650][106226] Updated weights for policy 0, policy_version 583613 (0.0009) [2023-12-27 23:26:14,719][106226] Updated weights for policy 0, policy_version 583623 (0.0010) [2023-12-27 23:26:14,860][106225] Updated weights for policy 1, policy_version 585655 (0.0009) [2023-12-27 23:26:14,934][106225] Updated weights for policy 1, policy_version 585665 (0.0006) [2023-12-27 23:26:15,003][106225] Updated weights for policy 1, policy_version 585675 (0.0011) [2023-12-27 23:26:15,462][106226] Updated weights for policy 0, policy_version 583633 (0.0009) [2023-12-27 23:26:15,513][106226] Updated weights for policy 0, policy_version 583643 (0.0007) [2023-12-27 23:26:15,552][106225] Updated weights for policy 1, policy_version 585685 (0.0008) [2023-12-27 23:26:15,575][106226] Updated weights for policy 0, policy_version 583653 (0.0007) [2023-12-27 23:26:15,603][106225] Updated weights for policy 1, policy_version 585695 (0.0005) [2023-12-27 23:26:15,628][106226] Updated weights for policy 0, policy_version 583663 (0.0009) [2023-12-27 23:26:15,657][106225] Updated weights for policy 1, policy_version 585705 (0.0007) [2023-12-27 23:26:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 299425792. Throughput: 0: 9812.9, 1: 9953.6. Samples: 299416508. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:26:16,176][105115] Avg episode reward: [(0, '-5.022'), (1, '-5.702')] [2023-12-27 23:26:16,276][106226] Updated weights for policy 0, policy_version 583673 (0.0007) [2023-12-27 23:26:16,305][106225] Updated weights for policy 1, policy_version 585715 (0.0009) [2023-12-27 23:26:16,325][106226] Updated weights for policy 0, policy_version 583683 (0.0006) [2023-12-27 23:26:16,356][106225] Updated weights for policy 1, policy_version 585725 (0.0010) [2023-12-27 23:26:16,373][106226] Updated weights for policy 0, policy_version 583693 (0.0008) [2023-12-27 23:26:16,415][106225] Updated weights for policy 1, policy_version 585735 (0.0010) [2023-12-27 23:26:17,056][106226] Updated weights for policy 0, policy_version 583703 (0.0009) [2023-12-27 23:26:17,106][106226] Updated weights for policy 0, policy_version 583713 (0.0010) [2023-12-27 23:26:17,137][106225] Updated weights for policy 1, policy_version 585745 (0.0010) [2023-12-27 23:26:17,155][106226] Updated weights for policy 0, policy_version 583723 (0.0010) [2023-12-27 23:26:17,187][106225] Updated weights for policy 1, policy_version 585755 (0.0010) [2023-12-27 23:26:17,233][106225] Updated weights for policy 1, policy_version 585765 (0.0010) [2023-12-27 23:26:17,286][106225] Updated weights for policy 1, policy_version 585775 (0.0010) [2023-12-27 23:26:17,885][106226] Updated weights for policy 0, policy_version 583733 (0.0010) [2023-12-27 23:26:17,932][106226] Updated weights for policy 0, policy_version 583743 (0.0010) [2023-12-27 23:26:17,978][106226] Updated weights for policy 0, policy_version 583753 (0.0010) [2023-12-27 23:26:18,026][106225] Updated weights for policy 1, policy_version 585785 (0.0010) [2023-12-27 23:26:18,076][106225] Updated weights for policy 1, policy_version 585795 (0.0010) [2023-12-27 23:26:18,136][106225] Updated weights for policy 1, policy_version 585805 (0.0010) [2023-12-27 23:26:18,739][106226] Updated weights for policy 0, policy_version 583763 (0.0009) [2023-12-27 23:26:18,790][106226] Updated weights for policy 0, policy_version 583773 (0.0010) [2023-12-27 23:26:18,846][106226] Updated weights for policy 0, policy_version 583783 (0.0010) [2023-12-27 23:26:18,857][106225] Updated weights for policy 1, policy_version 585815 (0.0011) [2023-12-27 23:26:18,915][106225] Updated weights for policy 1, policy_version 585825 (0.0010) [2023-12-27 23:26:18,966][106225] Updated weights for policy 1, policy_version 585835 (0.0008) [2023-12-27 23:26:19,637][106226] Updated weights for policy 0, policy_version 583793 (0.0011) [2023-12-27 23:26:19,706][106226] Updated weights for policy 0, policy_version 583803 (0.0011) [2023-12-27 23:26:19,764][106225] Updated weights for policy 1, policy_version 585845 (0.0006) [2023-12-27 23:26:19,770][106226] Updated weights for policy 0, policy_version 583813 (0.0009) [2023-12-27 23:26:19,837][106226] Updated weights for policy 0, policy_version 583823 (0.0007) [2023-12-27 23:26:19,837][106225] Updated weights for policy 1, policy_version 585855 (0.0007) [2023-12-27 23:26:19,904][106225] Updated weights for policy 1, policy_version 585865 (0.0010) [2023-12-27 23:26:20,445][106226] Updated weights for policy 0, policy_version 583833 (0.0006) [2023-12-27 23:26:20,510][106226] Updated weights for policy 0, policy_version 583843 (0.0011) [2023-12-27 23:26:20,583][106226] Updated weights for policy 0, policy_version 583853 (0.0011) [2023-12-27 23:26:20,654][106225] Updated weights for policy 1, policy_version 585875 (0.0008) [2023-12-27 23:26:20,720][106225] Updated weights for policy 1, policy_version 585885 (0.0007) [2023-12-27 23:26:20,785][106225] Updated weights for policy 1, policy_version 585895 (0.0007) [2023-12-27 23:26:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 299524096. Throughput: 0: 9808.4, 1: 9909.2. Samples: 299535736. Policy #0 lag: (min: 22.0, avg: 24.4, max: 54.0) [2023-12-27 23:26:21,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-5.587')] [2023-12-27 23:26:21,251][106226] Updated weights for policy 0, policy_version 583863 (0.0009) [2023-12-27 23:26:21,321][106226] Updated weights for policy 0, policy_version 583873 (0.0008) [2023-12-27 23:26:21,393][106226] Updated weights for policy 0, policy_version 583883 (0.0008) [2023-12-27 23:26:21,558][106225] Updated weights for policy 1, policy_version 585905 (0.0007) [2023-12-27 23:26:21,621][106225] Updated weights for policy 1, policy_version 585915 (0.0008) [2023-12-27 23:26:21,698][106225] Updated weights for policy 1, policy_version 585925 (0.0009) [2023-12-27 23:26:21,772][106225] Updated weights for policy 1, policy_version 585935 (0.0009) [2023-12-27 23:26:22,137][106226] Updated weights for policy 0, policy_version 583893 (0.0007) [2023-12-27 23:26:22,194][106226] Updated weights for policy 0, policy_version 583903 (0.0008) [2023-12-27 23:26:22,272][106226] Updated weights for policy 0, policy_version 583913 (0.0008) [2023-12-27 23:26:22,550][106225] Updated weights for policy 1, policy_version 585945 (0.0008) [2023-12-27 23:26:22,617][106225] Updated weights for policy 1, policy_version 585955 (0.0009) [2023-12-27 23:26:22,670][106225] Updated weights for policy 1, policy_version 585965 (0.0009) [2023-12-27 23:26:23,049][106226] Updated weights for policy 0, policy_version 583923 (0.0009) [2023-12-27 23:26:23,120][106226] Updated weights for policy 0, policy_version 583933 (0.0009) [2023-12-27 23:26:23,182][106226] Updated weights for policy 0, policy_version 583943 (0.0009) [2023-12-27 23:26:23,310][106225] Updated weights for policy 1, policy_version 585975 (0.0007) [2023-12-27 23:26:23,374][106225] Updated weights for policy 1, policy_version 585985 (0.0006) [2023-12-27 23:26:23,438][106225] Updated weights for policy 1, policy_version 585995 (0.0006) [2023-12-27 23:26:23,922][106226] Updated weights for policy 0, policy_version 583953 (0.0010) [2023-12-27 23:26:23,980][106226] Updated weights for policy 0, policy_version 583963 (0.0011) [2023-12-27 23:26:23,994][106225] Updated weights for policy 1, policy_version 586005 (0.0005) [2023-12-27 23:26:24,037][106226] Updated weights for policy 0, policy_version 583973 (0.0009) [2023-12-27 23:26:24,051][106225] Updated weights for policy 1, policy_version 586015 (0.0005) [2023-12-27 23:26:24,096][106226] Updated weights for policy 0, policy_version 583983 (0.0010) [2023-12-27 23:26:24,109][106225] Updated weights for policy 1, policy_version 586025 (0.0006) [2023-12-27 23:26:24,747][106225] Updated weights for policy 1, policy_version 586035 (0.0006) [2023-12-27 23:26:24,764][106226] Updated weights for policy 0, policy_version 583993 (0.0008) [2023-12-27 23:26:24,820][106225] Updated weights for policy 1, policy_version 586045 (0.0006) [2023-12-27 23:26:24,825][106226] Updated weights for policy 0, policy_version 584003 (0.0008) [2023-12-27 23:26:24,872][106226] Updated weights for policy 0, policy_version 584013 (0.0006) [2023-12-27 23:26:24,891][106225] Updated weights for policy 1, policy_version 586055 (0.0007) [2023-12-27 23:26:25,459][106226] Updated weights for policy 0, policy_version 584023 (0.0007) [2023-12-27 23:26:25,516][106226] Updated weights for policy 0, policy_version 584033 (0.0010) [2023-12-27 23:26:25,542][106225] Updated weights for policy 1, policy_version 586065 (0.0007) [2023-12-27 23:26:25,566][106226] Updated weights for policy 0, policy_version 584043 (0.0010) [2023-12-27 23:26:25,606][106225] Updated weights for policy 1, policy_version 586075 (0.0006) [2023-12-27 23:26:25,672][106225] Updated weights for policy 1, policy_version 586085 (0.0006) [2023-12-27 23:26:25,720][106225] Updated weights for policy 1, policy_version 586095 (0.0005) [2023-12-27 23:26:26,169][106226] Updated weights for policy 0, policy_version 584053 (0.0008) [2023-12-27 23:26:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 299622400. Throughput: 0: 9811.7, 1: 9841.7. Samples: 299592028. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:26,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-6.011')] [2023-12-27 23:26:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000586096_150069248.pth... [2023-12-27 23:26:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000584944_149774336.pth [2023-12-27 23:26:26,222][106226] Updated weights for policy 0, policy_version 584063 (0.0005) [2023-12-27 23:26:26,288][106226] Updated weights for policy 0, policy_version 584073 (0.0005) [2023-12-27 23:26:26,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000584080_149561344.pth... [2023-12-27 23:26:26,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000582896_149258240.pth [2023-12-27 23:26:26,464][106225] Updated weights for policy 1, policy_version 586105 (0.0006) [2023-12-27 23:26:26,523][106225] Updated weights for policy 1, policy_version 586115 (0.0008) [2023-12-27 23:26:26,580][106225] Updated weights for policy 1, policy_version 586125 (0.0005) [2023-12-27 23:26:26,888][106226] Updated weights for policy 0, policy_version 584083 (0.0005) [2023-12-27 23:26:26,945][106226] Updated weights for policy 0, policy_version 584093 (0.0005) [2023-12-27 23:26:27,003][106226] Updated weights for policy 0, policy_version 584103 (0.0010) [2023-12-27 23:26:27,144][106225] Updated weights for policy 1, policy_version 586135 (0.0005) [2023-12-27 23:26:27,194][106225] Updated weights for policy 1, policy_version 586145 (0.0005) [2023-12-27 23:26:27,254][106225] Updated weights for policy 1, policy_version 586155 (0.0005) [2023-12-27 23:26:27,732][106226] Updated weights for policy 0, policy_version 584113 (0.0010) [2023-12-27 23:26:27,786][106226] Updated weights for policy 0, policy_version 584123 (0.0009) [2023-12-27 23:26:27,852][106226] Updated weights for policy 0, policy_version 584133 (0.0010) [2023-12-27 23:26:27,870][106225] Updated weights for policy 1, policy_version 586165 (0.0005) [2023-12-27 23:26:27,917][106225] Updated weights for policy 1, policy_version 586175 (0.0005) [2023-12-27 23:26:27,919][106226] Updated weights for policy 0, policy_version 584143 (0.0008) [2023-12-27 23:26:27,981][106225] Updated weights for policy 1, policy_version 586185 (0.0005) [2023-12-27 23:26:28,563][106225] Updated weights for policy 1, policy_version 586195 (0.0008) [2023-12-27 23:26:28,626][106225] Updated weights for policy 1, policy_version 586205 (0.0008) [2023-12-27 23:26:28,645][106226] Updated weights for policy 0, policy_version 584153 (0.0008) [2023-12-27 23:26:28,682][106225] Updated weights for policy 1, policy_version 586215 (0.0007) [2023-12-27 23:26:28,700][106226] Updated weights for policy 0, policy_version 584163 (0.0006) [2023-12-27 23:26:28,757][106226] Updated weights for policy 0, policy_version 584173 (0.0006) [2023-12-27 23:26:29,399][106225] Updated weights for policy 1, policy_version 586225 (0.0007) [2023-12-27 23:26:29,402][106226] Updated weights for policy 0, policy_version 584183 (0.0008) [2023-12-27 23:26:29,455][106226] Updated weights for policy 0, policy_version 584193 (0.0006) [2023-12-27 23:26:29,455][106225] Updated weights for policy 1, policy_version 586235 (0.0008) [2023-12-27 23:26:29,515][106225] Updated weights for policy 1, policy_version 586245 (0.0008) [2023-12-27 23:26:29,515][106226] Updated weights for policy 0, policy_version 584203 (0.0006) [2023-12-27 23:26:29,574][106225] Updated weights for policy 1, policy_version 586255 (0.0009) [2023-12-27 23:26:30,207][106226] Updated weights for policy 0, policy_version 584213 (0.0007) [2023-12-27 23:26:30,259][106226] Updated weights for policy 0, policy_version 584223 (0.0008) [2023-12-27 23:26:30,307][106226] Updated weights for policy 0, policy_version 584233 (0.0008) [2023-12-27 23:26:30,349][106225] Updated weights for policy 1, policy_version 586265 (0.0010) [2023-12-27 23:26:30,411][106225] Updated weights for policy 1, policy_version 586275 (0.0008) [2023-12-27 23:26:30,469][106225] Updated weights for policy 1, policy_version 586285 (0.0008) [2023-12-27 23:26:31,031][106226] Updated weights for policy 0, policy_version 584243 (0.0009) [2023-12-27 23:26:31,094][106226] Updated weights for policy 0, policy_version 584253 (0.0008) [2023-12-27 23:26:31,165][106226] Updated weights for policy 0, policy_version 584263 (0.0009) [2023-12-27 23:26:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 299720704. Throughput: 0: 10011.8, 1: 9874.0. Samples: 299717996. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:31,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.746')] [2023-12-27 23:26:31,197][106225] Updated weights for policy 1, policy_version 586295 (0.0008) [2023-12-27 23:26:31,263][106225] Updated weights for policy 1, policy_version 586305 (0.0007) [2023-12-27 23:26:31,325][106225] Updated weights for policy 1, policy_version 586315 (0.0007) [2023-12-27 23:26:31,938][106226] Updated weights for policy 0, policy_version 584273 (0.0008) [2023-12-27 23:26:31,993][106226] Updated weights for policy 0, policy_version 584283 (0.0008) [2023-12-27 23:26:32,049][106226] Updated weights for policy 0, policy_version 584293 (0.0006) [2023-12-27 23:26:32,068][106225] Updated weights for policy 1, policy_version 586325 (0.0008) [2023-12-27 23:26:32,104][106226] Updated weights for policy 0, policy_version 584303 (0.0005) [2023-12-27 23:26:32,123][106225] Updated weights for policy 1, policy_version 586335 (0.0008) [2023-12-27 23:26:32,188][106225] Updated weights for policy 1, policy_version 586345 (0.0008) [2023-12-27 23:26:32,748][106226] Updated weights for policy 0, policy_version 584313 (0.0010) [2023-12-27 23:26:32,805][106226] Updated weights for policy 0, policy_version 584323 (0.0010) [2023-12-27 23:26:32,855][106226] Updated weights for policy 0, policy_version 584333 (0.0010) [2023-12-27 23:26:32,904][106225] Updated weights for policy 1, policy_version 586355 (0.0008) [2023-12-27 23:26:32,956][106225] Updated weights for policy 1, policy_version 586365 (0.0007) [2023-12-27 23:26:33,005][106225] Updated weights for policy 1, policy_version 586375 (0.0007) [2023-12-27 23:26:33,574][106226] Updated weights for policy 0, policy_version 584343 (0.0011) [2023-12-27 23:26:33,626][106226] Updated weights for policy 0, policy_version 584353 (0.0008) [2023-12-27 23:26:33,672][106225] Updated weights for policy 1, policy_version 586385 (0.0008) [2023-12-27 23:26:33,677][106226] Updated weights for policy 0, policy_version 584363 (0.0005) [2023-12-27 23:26:33,729][106225] Updated weights for policy 1, policy_version 586395 (0.0010) [2023-12-27 23:26:33,785][106225] Updated weights for policy 1, policy_version 586405 (0.0010) [2023-12-27 23:26:33,846][106225] Updated weights for policy 1, policy_version 586415 (0.0010) [2023-12-27 23:26:34,318][106226] Updated weights for policy 0, policy_version 584373 (0.0005) [2023-12-27 23:26:34,393][106226] Updated weights for policy 0, policy_version 584383 (0.0008) [2023-12-27 23:26:34,461][106226] Updated weights for policy 0, policy_version 584393 (0.0007) [2023-12-27 23:26:34,529][106225] Updated weights for policy 1, policy_version 586425 (0.0006) [2023-12-27 23:26:34,592][106225] Updated weights for policy 1, policy_version 586435 (0.0007) [2023-12-27 23:26:34,655][106225] Updated weights for policy 1, policy_version 586445 (0.0008) [2023-12-27 23:26:35,088][106226] Updated weights for policy 0, policy_version 584403 (0.0008) [2023-12-27 23:26:35,150][106226] Updated weights for policy 0, policy_version 584413 (0.0009) [2023-12-27 23:26:35,216][106226] Updated weights for policy 0, policy_version 584423 (0.0009) [2023-12-27 23:26:35,290][106225] Updated weights for policy 1, policy_version 586455 (0.0009) [2023-12-27 23:26:35,344][106225] Updated weights for policy 1, policy_version 586465 (0.0009) [2023-12-27 23:26:35,404][106225] Updated weights for policy 1, policy_version 586475 (0.0008) [2023-12-27 23:26:35,899][106226] Updated weights for policy 0, policy_version 584433 (0.0007) [2023-12-27 23:26:35,952][106226] Updated weights for policy 0, policy_version 584443 (0.0006) [2023-12-27 23:26:36,007][106226] Updated weights for policy 0, policy_version 584453 (0.0005) [2023-12-27 23:26:36,063][106226] Updated weights for policy 0, policy_version 584463 (0.0007) [2023-12-27 23:26:36,145][106225] Updated weights for policy 1, policy_version 586485 (0.0008) [2023-12-27 23:26:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 299827200. Throughput: 0: 10025.0, 1: 9879.7. Samples: 299837648. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:36,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.546')] [2023-12-27 23:26:36,209][106225] Updated weights for policy 1, policy_version 586495 (0.0007) [2023-12-27 23:26:36,275][106225] Updated weights for policy 1, policy_version 586505 (0.0009) [2023-12-27 23:26:36,819][106226] Updated weights for policy 0, policy_version 584473 (0.0008) [2023-12-27 23:26:36,879][106226] Updated weights for policy 0, policy_version 584483 (0.0009) [2023-12-27 23:26:36,938][106226] Updated weights for policy 0, policy_version 584493 (0.0008) [2023-12-27 23:26:36,949][106225] Updated weights for policy 1, policy_version 586515 (0.0008) [2023-12-27 23:26:37,008][106225] Updated weights for policy 1, policy_version 586525 (0.0008) [2023-12-27 23:26:37,071][106225] Updated weights for policy 1, policy_version 586535 (0.0007) [2023-12-27 23:26:37,694][106226] Updated weights for policy 0, policy_version 584503 (0.0008) [2023-12-27 23:26:37,748][106226] Updated weights for policy 0, policy_version 584513 (0.0010) [2023-12-27 23:26:37,768][106225] Updated weights for policy 1, policy_version 586545 (0.0006) [2023-12-27 23:26:37,805][106226] Updated weights for policy 0, policy_version 584523 (0.0011) [2023-12-27 23:26:37,819][106225] Updated weights for policy 1, policy_version 586555 (0.0007) [2023-12-27 23:26:37,868][106225] Updated weights for policy 1, policy_version 586565 (0.0007) [2023-12-27 23:26:37,921][106225] Updated weights for policy 1, policy_version 586575 (0.0010) [2023-12-27 23:26:38,503][106226] Updated weights for policy 0, policy_version 584533 (0.0008) [2023-12-27 23:26:38,567][106226] Updated weights for policy 0, policy_version 584543 (0.0011) [2023-12-27 23:26:38,631][106226] Updated weights for policy 0, policy_version 584553 (0.0011) [2023-12-27 23:26:38,680][106225] Updated weights for policy 1, policy_version 586585 (0.0007) [2023-12-27 23:26:38,731][106225] Updated weights for policy 1, policy_version 586595 (0.0008) [2023-12-27 23:26:38,780][106225] Updated weights for policy 1, policy_version 586605 (0.0008) [2023-12-27 23:26:39,335][106226] Updated weights for policy 0, policy_version 584563 (0.0010) [2023-12-27 23:26:39,403][106226] Updated weights for policy 0, policy_version 584573 (0.0009) [2023-12-27 23:26:39,467][106226] Updated weights for policy 0, policy_version 584583 (0.0010) [2023-12-27 23:26:39,509][106225] Updated weights for policy 1, policy_version 586615 (0.0007) [2023-12-27 23:26:39,563][106225] Updated weights for policy 1, policy_version 586625 (0.0005) [2023-12-27 23:26:39,632][106225] Updated weights for policy 1, policy_version 586635 (0.0008) [2023-12-27 23:26:40,207][106226] Updated weights for policy 0, policy_version 584593 (0.0009) [2023-12-27 23:26:40,273][106226] Updated weights for policy 0, policy_version 584603 (0.0009) [2023-12-27 23:26:40,332][106226] Updated weights for policy 0, policy_version 584613 (0.0009) [2023-12-27 23:26:40,350][106225] Updated weights for policy 1, policy_version 586645 (0.0007) [2023-12-27 23:26:40,390][106226] Updated weights for policy 0, policy_version 584623 (0.0009) [2023-12-27 23:26:40,418][106225] Updated weights for policy 1, policy_version 586655 (0.0008) [2023-12-27 23:26:40,477][106225] Updated weights for policy 1, policy_version 586665 (0.0010) [2023-12-27 23:26:41,075][106226] Updated weights for policy 0, policy_version 584633 (0.0008) [2023-12-27 23:26:41,146][106226] Updated weights for policy 0, policy_version 584643 (0.0008) [2023-12-27 23:26:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 299917312. Throughput: 0: 10023.1, 1: 9896.9. Samples: 299895384. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:41,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.828')] [2023-12-27 23:26:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000586672_150216704.pth... [2023-12-27 23:26:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000585520_149921792.pth [2023-12-27 23:26:41,215][106226] Updated weights for policy 0, policy_version 584653 (0.0008) [2023-12-27 23:26:41,226][106225] Updated weights for policy 1, policy_version 586675 (0.0007) [2023-12-27 23:26:41,234][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000584656_149708800.pth... [2023-12-27 23:26:41,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000583504_149413888.pth [2023-12-27 23:26:41,292][106225] Updated weights for policy 1, policy_version 586685 (0.0007) [2023-12-27 23:26:41,365][106225] Updated weights for policy 1, policy_version 586695 (0.0009) [2023-12-27 23:26:42,026][106226] Updated weights for policy 0, policy_version 584663 (0.0009) [2023-12-27 23:26:42,088][106226] Updated weights for policy 0, policy_version 584673 (0.0009) [2023-12-27 23:26:42,154][106226] Updated weights for policy 0, policy_version 584683 (0.0010) [2023-12-27 23:26:42,172][106225] Updated weights for policy 1, policy_version 586705 (0.0009) [2023-12-27 23:26:42,229][106225] Updated weights for policy 1, policy_version 586715 (0.0007) [2023-12-27 23:26:42,301][106225] Updated weights for policy 1, policy_version 586725 (0.0007) [2023-12-27 23:26:42,372][106225] Updated weights for policy 1, policy_version 586735 (0.0010) [2023-12-27 23:26:42,908][106226] Updated weights for policy 0, policy_version 584693 (0.0011) [2023-12-27 23:26:42,955][106226] Updated weights for policy 0, policy_version 584703 (0.0010) [2023-12-27 23:26:43,006][106226] Updated weights for policy 0, policy_version 584713 (0.0011) [2023-12-27 23:26:43,051][106225] Updated weights for policy 1, policy_version 586745 (0.0008) [2023-12-27 23:26:43,101][106225] Updated weights for policy 1, policy_version 586755 (0.0008) [2023-12-27 23:26:43,150][106225] Updated weights for policy 1, policy_version 586765 (0.0008) [2023-12-27 23:26:43,712][106226] Updated weights for policy 0, policy_version 584723 (0.0010) [2023-12-27 23:26:43,765][106226] Updated weights for policy 0, policy_version 584733 (0.0009) [2023-12-27 23:26:43,813][106226] Updated weights for policy 0, policy_version 584743 (0.0008) [2023-12-27 23:26:43,914][106225] Updated weights for policy 1, policy_version 586775 (0.0009) [2023-12-27 23:26:43,975][106225] Updated weights for policy 1, policy_version 586785 (0.0008) [2023-12-27 23:26:44,039][106225] Updated weights for policy 1, policy_version 586795 (0.0008) [2023-12-27 23:26:44,428][106226] Updated weights for policy 0, policy_version 584753 (0.0007) [2023-12-27 23:26:44,493][106226] Updated weights for policy 0, policy_version 584763 (0.0005) [2023-12-27 23:26:44,560][106226] Updated weights for policy 0, policy_version 584773 (0.0006) [2023-12-27 23:26:44,620][106226] Updated weights for policy 0, policy_version 584783 (0.0006) [2023-12-27 23:26:44,849][106225] Updated weights for policy 1, policy_version 586805 (0.0008) [2023-12-27 23:26:44,912][106225] Updated weights for policy 1, policy_version 586815 (0.0006) [2023-12-27 23:26:44,979][106225] Updated weights for policy 1, policy_version 586825 (0.0008) [2023-12-27 23:26:45,253][106226] Updated weights for policy 0, policy_version 584793 (0.0007) [2023-12-27 23:26:45,319][106226] Updated weights for policy 0, policy_version 584803 (0.0010) [2023-12-27 23:26:45,380][106226] Updated weights for policy 0, policy_version 584813 (0.0011) [2023-12-27 23:26:45,672][106225] Updated weights for policy 1, policy_version 586835 (0.0008) [2023-12-27 23:26:45,727][106225] Updated weights for policy 1, policy_version 586845 (0.0008) [2023-12-27 23:26:45,786][106225] Updated weights for policy 1, policy_version 586855 (0.0008) [2023-12-27 23:26:46,072][106226] Updated weights for policy 0, policy_version 584823 (0.0008) [2023-12-27 23:26:46,118][106226] Updated weights for policy 0, policy_version 584833 (0.0008) [2023-12-27 23:26:46,166][106226] Updated weights for policy 0, policy_version 584843 (0.0008) [2023-12-27 23:26:46,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 300015616. Throughput: 0: 9939.0, 1: 9807.1. Samples: 300008960. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:46,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-5.421')] [2023-12-27 23:26:46,506][106225] Updated weights for policy 1, policy_version 586865 (0.0009) [2023-12-27 23:26:46,557][106225] Updated weights for policy 1, policy_version 586875 (0.0008) [2023-12-27 23:26:46,604][106225] Updated weights for policy 1, policy_version 586885 (0.0008) [2023-12-27 23:26:46,658][106225] Updated weights for policy 1, policy_version 586895 (0.0009) [2023-12-27 23:26:46,893][106226] Updated weights for policy 0, policy_version 584853 (0.0008) [2023-12-27 23:26:46,946][106226] Updated weights for policy 0, policy_version 584863 (0.0009) [2023-12-27 23:26:47,005][106226] Updated weights for policy 0, policy_version 584873 (0.0010) [2023-12-27 23:26:47,351][106225] Updated weights for policy 1, policy_version 586905 (0.0005) [2023-12-27 23:26:47,415][106225] Updated weights for policy 1, policy_version 586915 (0.0009) [2023-12-27 23:26:47,471][106225] Updated weights for policy 1, policy_version 586925 (0.0008) [2023-12-27 23:26:47,642][106226] Updated weights for policy 0, policy_version 584883 (0.0009) [2023-12-27 23:26:47,703][106226] Updated weights for policy 0, policy_version 584893 (0.0006) [2023-12-27 23:26:47,760][106226] Updated weights for policy 0, policy_version 584903 (0.0006) [2023-12-27 23:26:48,203][106225] Updated weights for policy 1, policy_version 586935 (0.0008) [2023-12-27 23:26:48,265][106225] Updated weights for policy 1, policy_version 586945 (0.0009) [2023-12-27 23:26:48,318][106225] Updated weights for policy 1, policy_version 586955 (0.0009) [2023-12-27 23:26:48,417][106226] Updated weights for policy 0, policy_version 584913 (0.0007) [2023-12-27 23:26:48,476][106226] Updated weights for policy 0, policy_version 584923 (0.0008) [2023-12-27 23:26:48,531][106226] Updated weights for policy 0, policy_version 584933 (0.0008) [2023-12-27 23:26:48,581][106226] Updated weights for policy 0, policy_version 584943 (0.0008) [2023-12-27 23:26:49,068][106225] Updated weights for policy 1, policy_version 586965 (0.0008) [2023-12-27 23:26:49,123][106225] Updated weights for policy 1, policy_version 586975 (0.0008) [2023-12-27 23:26:49,167][106225] Updated weights for policy 1, policy_version 586985 (0.0008) [2023-12-27 23:26:49,314][106226] Updated weights for policy 0, policy_version 584953 (0.0006) [2023-12-27 23:26:49,374][106226] Updated weights for policy 0, policy_version 584963 (0.0007) [2023-12-27 23:26:49,444][106226] Updated weights for policy 0, policy_version 584973 (0.0008) [2023-12-27 23:26:49,877][106225] Updated weights for policy 1, policy_version 586995 (0.0007) [2023-12-27 23:26:49,944][106225] Updated weights for policy 1, policy_version 587005 (0.0007) [2023-12-27 23:26:50,006][106225] Updated weights for policy 1, policy_version 587015 (0.0008) [2023-12-27 23:26:50,161][106226] Updated weights for policy 0, policy_version 584983 (0.0006) [2023-12-27 23:26:50,226][106226] Updated weights for policy 0, policy_version 584993 (0.0008) [2023-12-27 23:26:50,280][106226] Updated weights for policy 0, policy_version 585003 (0.0005) [2023-12-27 23:26:50,771][106225] Updated weights for policy 1, policy_version 587025 (0.0008) [2023-12-27 23:26:50,839][106225] Updated weights for policy 1, policy_version 587035 (0.0009) [2023-12-27 23:26:50,874][106226] Updated weights for policy 0, policy_version 585013 (0.0008) [2023-12-27 23:26:50,905][106225] Updated weights for policy 1, policy_version 587045 (0.0008) [2023-12-27 23:26:50,941][106226] Updated weights for policy 0, policy_version 585023 (0.0009) [2023-12-27 23:26:50,973][106225] Updated weights for policy 1, policy_version 587055 (0.0007) [2023-12-27 23:26:51,011][106226] Updated weights for policy 0, policy_version 585033 (0.0010) [2023-12-27 23:26:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 300122112. Throughput: 0: 9926.2, 1: 9779.6. Samples: 300127656. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:51,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-5.997')] [2023-12-27 23:26:51,673][106225] Updated weights for policy 1, policy_version 587065 (0.0009) [2023-12-27 23:26:51,722][106226] Updated weights for policy 0, policy_version 585043 (0.0007) [2023-12-27 23:26:51,742][106225] Updated weights for policy 1, policy_version 587075 (0.0009) [2023-12-27 23:26:51,797][106226] Updated weights for policy 0, policy_version 585053 (0.0007) [2023-12-27 23:26:51,823][106225] Updated weights for policy 1, policy_version 587085 (0.0009) [2023-12-27 23:26:51,862][106226] Updated weights for policy 0, policy_version 585063 (0.0007) [2023-12-27 23:26:52,535][106225] Updated weights for policy 1, policy_version 587095 (0.0008) [2023-12-27 23:26:52,592][106225] Updated weights for policy 1, policy_version 587105 (0.0009) [2023-12-27 23:26:52,612][106226] Updated weights for policy 0, policy_version 585073 (0.0008) [2023-12-27 23:26:52,652][106225] Updated weights for policy 1, policy_version 587115 (0.0009) [2023-12-27 23:26:52,675][106226] Updated weights for policy 0, policy_version 585083 (0.0006) [2023-12-27 23:26:52,741][106226] Updated weights for policy 0, policy_version 585093 (0.0008) [2023-12-27 23:26:52,807][106226] Updated weights for policy 0, policy_version 585103 (0.0007) [2023-12-27 23:26:53,377][106225] Updated weights for policy 1, policy_version 587125 (0.0008) [2023-12-27 23:26:53,407][106226] Updated weights for policy 0, policy_version 585113 (0.0010) [2023-12-27 23:26:53,427][106225] Updated weights for policy 1, policy_version 587135 (0.0010) [2023-12-27 23:26:53,460][106226] Updated weights for policy 0, policy_version 585123 (0.0010) [2023-12-27 23:26:53,474][106225] Updated weights for policy 1, policy_version 587145 (0.0010) [2023-12-27 23:26:53,517][106226] Updated weights for policy 0, policy_version 585133 (0.0010) [2023-12-27 23:26:54,163][106225] Updated weights for policy 1, policy_version 587155 (0.0010) [2023-12-27 23:26:54,183][106226] Updated weights for policy 0, policy_version 585143 (0.0010) [2023-12-27 23:26:54,218][106225] Updated weights for policy 1, policy_version 587165 (0.0010) [2023-12-27 23:26:54,241][106226] Updated weights for policy 0, policy_version 585153 (0.0011) [2023-12-27 23:26:54,280][106225] Updated weights for policy 1, policy_version 587175 (0.0007) [2023-12-27 23:26:54,299][106226] Updated weights for policy 0, policy_version 585163 (0.0011) [2023-12-27 23:26:54,930][106225] Updated weights for policy 1, policy_version 587185 (0.0010) [2023-12-27 23:26:54,945][106226] Updated weights for policy 0, policy_version 585173 (0.0008) [2023-12-27 23:26:54,991][106225] Updated weights for policy 1, policy_version 587195 (0.0011) [2023-12-27 23:26:55,025][106226] Updated weights for policy 0, policy_version 585183 (0.0006) [2023-12-27 23:26:55,050][106225] Updated weights for policy 1, policy_version 587205 (0.0011) [2023-12-27 23:26:55,087][106226] Updated weights for policy 0, policy_version 585193 (0.0007) [2023-12-27 23:26:55,111][106225] Updated weights for policy 1, policy_version 587215 (0.0010) [2023-12-27 23:26:55,761][106226] Updated weights for policy 0, policy_version 585203 (0.0008) [2023-12-27 23:26:55,810][106226] Updated weights for policy 0, policy_version 585213 (0.0007) [2023-12-27 23:26:55,840][106225] Updated weights for policy 1, policy_version 587225 (0.0010) [2023-12-27 23:26:55,862][106226] Updated weights for policy 0, policy_version 585223 (0.0007) [2023-12-27 23:26:55,901][106225] Updated weights for policy 1, policy_version 587235 (0.0010) [2023-12-27 23:26:55,957][106225] Updated weights for policy 1, policy_version 587245 (0.0010) [2023-12-27 23:26:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 300220416. Throughput: 0: 9893.8, 1: 9773.9. Samples: 300186236. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:26:56,175][105115] Avg episode reward: [(0, '-4.965'), (1, '-5.511')] [2023-12-27 23:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000585232_149856256.pth... [2023-12-27 23:26:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000587248_150364160.pth... [2023-12-27 23:26:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000584080_149561344.pth [2023-12-27 23:26:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000586096_150069248.pth [2023-12-27 23:26:56,605][106226] Updated weights for policy 0, policy_version 585233 (0.0007) [2023-12-27 23:26:56,665][106226] Updated weights for policy 0, policy_version 585243 (0.0006) [2023-12-27 23:26:56,670][106225] Updated weights for policy 1, policy_version 587255 (0.0010) [2023-12-27 23:26:56,723][106226] Updated weights for policy 0, policy_version 585253 (0.0005) [2023-12-27 23:26:56,727][106225] Updated weights for policy 1, policy_version 587265 (0.0010) [2023-12-27 23:26:56,786][106226] Updated weights for policy 0, policy_version 585263 (0.0005) [2023-12-27 23:26:56,787][106225] Updated weights for policy 1, policy_version 587275 (0.0010) [2023-12-27 23:26:57,390][106225] Updated weights for policy 1, policy_version 587285 (0.0010) [2023-12-27 23:26:57,416][106226] Updated weights for policy 0, policy_version 585273 (0.0007) [2023-12-27 23:26:57,440][106225] Updated weights for policy 1, policy_version 587295 (0.0005) [2023-12-27 23:26:57,464][106226] Updated weights for policy 0, policy_version 585283 (0.0008) [2023-12-27 23:26:57,490][106225] Updated weights for policy 1, policy_version 587305 (0.0006) [2023-12-27 23:26:57,510][106226] Updated weights for policy 0, policy_version 585293 (0.0007) [2023-12-27 23:26:58,177][106226] Updated weights for policy 0, policy_version 585303 (0.0007) [2023-12-27 23:26:58,178][106225] Updated weights for policy 1, policy_version 587315 (0.0010) [2023-12-27 23:26:58,240][106225] Updated weights for policy 1, policy_version 587325 (0.0009) [2023-12-27 23:26:58,241][106226] Updated weights for policy 0, policy_version 585313 (0.0008) [2023-12-27 23:26:58,298][106225] Updated weights for policy 1, policy_version 587335 (0.0010) [2023-12-27 23:26:58,301][106226] Updated weights for policy 0, policy_version 585323 (0.0007) [2023-12-27 23:26:59,105][106225] Updated weights for policy 1, policy_version 587345 (0.0008) [2023-12-27 23:26:59,132][106226] Updated weights for policy 0, policy_version 585333 (0.0008) [2023-12-27 23:26:59,171][106225] Updated weights for policy 1, policy_version 587355 (0.0006) [2023-12-27 23:26:59,192][106226] Updated weights for policy 0, policy_version 585343 (0.0007) [2023-12-27 23:26:59,237][106225] Updated weights for policy 1, policy_version 587365 (0.0009) [2023-12-27 23:26:59,266][106226] Updated weights for policy 0, policy_version 585353 (0.0008) [2023-12-27 23:26:59,303][106225] Updated weights for policy 1, policy_version 587375 (0.0007) [2023-12-27 23:26:59,966][106225] Updated weights for policy 1, policy_version 587385 (0.0009) [2023-12-27 23:27:00,018][106226] Updated weights for policy 0, policy_version 585363 (0.0008) [2023-12-27 23:27:00,030][106225] Updated weights for policy 1, policy_version 587395 (0.0009) [2023-12-27 23:27:00,078][106226] Updated weights for policy 0, policy_version 585373 (0.0009) [2023-12-27 23:27:00,088][106225] Updated weights for policy 1, policy_version 587405 (0.0008) [2023-12-27 23:27:00,134][106226] Updated weights for policy 0, policy_version 585383 (0.0009) [2023-12-27 23:27:00,693][106225] Updated weights for policy 1, policy_version 587415 (0.0005) [2023-12-27 23:27:00,739][106225] Updated weights for policy 1, policy_version 587425 (0.0009) [2023-12-27 23:27:00,794][106225] Updated weights for policy 1, policy_version 587435 (0.0008) [2023-12-27 23:27:00,929][106226] Updated weights for policy 0, policy_version 585393 (0.0009) [2023-12-27 23:27:00,985][106226] Updated weights for policy 0, policy_version 585403 (0.0009) [2023-12-27 23:27:01,043][106226] Updated weights for policy 0, policy_version 585413 (0.0009) [2023-12-27 23:27:01,106][106226] Updated weights for policy 0, policy_version 585423 (0.0009) [2023-12-27 23:27:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 300318720. Throughput: 0: 9933.9, 1: 9818.7. Samples: 300305372. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:01,175][105115] Avg episode reward: [(0, '-5.047'), (1, '-5.767')] [2023-12-27 23:27:01,499][106225] Updated weights for policy 1, policy_version 587445 (0.0008) [2023-12-27 23:27:01,560][106225] Updated weights for policy 1, policy_version 587455 (0.0009) [2023-12-27 23:27:01,624][106225] Updated weights for policy 1, policy_version 587465 (0.0008) [2023-12-27 23:27:01,893][106226] Updated weights for policy 0, policy_version 585433 (0.0007) [2023-12-27 23:27:01,951][106226] Updated weights for policy 0, policy_version 585443 (0.0005) [2023-12-27 23:27:02,014][106226] Updated weights for policy 0, policy_version 585453 (0.0005) [2023-12-27 23:27:02,303][106225] Updated weights for policy 1, policy_version 587475 (0.0008) [2023-12-27 23:27:02,372][106225] Updated weights for policy 1, policy_version 587485 (0.0007) [2023-12-27 23:27:02,436][106225] Updated weights for policy 1, policy_version 587495 (0.0008) [2023-12-27 23:27:02,613][106226] Updated weights for policy 0, policy_version 585463 (0.0008) [2023-12-27 23:27:02,665][106226] Updated weights for policy 0, policy_version 585473 (0.0009) [2023-12-27 23:27:02,714][106226] Updated weights for policy 0, policy_version 585483 (0.0008) [2023-12-27 23:27:03,062][106225] Updated weights for policy 1, policy_version 587505 (0.0008) [2023-12-27 23:27:03,124][106225] Updated weights for policy 1, policy_version 587515 (0.0010) [2023-12-27 23:27:03,174][106225] Updated weights for policy 1, policy_version 587525 (0.0006) [2023-12-27 23:27:03,228][106225] Updated weights for policy 1, policy_version 587535 (0.0008) [2023-12-27 23:27:03,438][106226] Updated weights for policy 0, policy_version 585493 (0.0007) [2023-12-27 23:27:03,488][106226] Updated weights for policy 0, policy_version 585503 (0.0006) [2023-12-27 23:27:03,536][106226] Updated weights for policy 0, policy_version 585513 (0.0005) [2023-12-27 23:27:03,921][106225] Updated weights for policy 1, policy_version 587545 (0.0011) [2023-12-27 23:27:03,983][106225] Updated weights for policy 1, policy_version 587555 (0.0010) [2023-12-27 23:27:04,051][106225] Updated weights for policy 1, policy_version 587565 (0.0011) [2023-12-27 23:27:04,142][106226] Updated weights for policy 0, policy_version 585523 (0.0006) [2023-12-27 23:27:04,201][106226] Updated weights for policy 0, policy_version 585533 (0.0008) [2023-12-27 23:27:04,261][106226] Updated weights for policy 0, policy_version 585543 (0.0007) [2023-12-27 23:27:04,703][106225] Updated weights for policy 1, policy_version 587575 (0.0009) [2023-12-27 23:27:04,770][106225] Updated weights for policy 1, policy_version 587585 (0.0010) [2023-12-27 23:27:04,836][106225] Updated weights for policy 1, policy_version 587595 (0.0010) [2023-12-27 23:27:05,005][106226] Updated weights for policy 0, policy_version 585553 (0.0008) [2023-12-27 23:27:05,052][106226] Updated weights for policy 0, policy_version 585563 (0.0007) [2023-12-27 23:27:05,108][106226] Updated weights for policy 0, policy_version 585573 (0.0006) [2023-12-27 23:27:05,170][106226] Updated weights for policy 0, policy_version 585583 (0.0005) [2023-12-27 23:27:05,606][106225] Updated weights for policy 1, policy_version 587605 (0.0010) [2023-12-27 23:27:05,671][106225] Updated weights for policy 1, policy_version 587615 (0.0010) [2023-12-27 23:27:05,732][106225] Updated weights for policy 1, policy_version 587625 (0.0010) [2023-12-27 23:27:05,799][106226] Updated weights for policy 0, policy_version 585593 (0.0006) [2023-12-27 23:27:05,855][106226] Updated weights for policy 0, policy_version 585603 (0.0007) [2023-12-27 23:27:05,901][106226] Updated weights for policy 0, policy_version 585613 (0.0008) [2023-12-27 23:27:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 300417024. Throughput: 0: 9934.9, 1: 9851.8. Samples: 300426132. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:06,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-5.756')] [2023-12-27 23:27:06,429][106225] Updated weights for policy 1, policy_version 587635 (0.0009) [2023-12-27 23:27:06,497][106225] Updated weights for policy 1, policy_version 587645 (0.0009) [2023-12-27 23:27:06,562][106225] Updated weights for policy 1, policy_version 587655 (0.0011) [2023-12-27 23:27:06,591][106226] Updated weights for policy 0, policy_version 585623 (0.0006) [2023-12-27 23:27:06,653][106226] Updated weights for policy 0, policy_version 585633 (0.0007) [2023-12-27 23:27:06,717][106226] Updated weights for policy 0, policy_version 585643 (0.0008) [2023-12-27 23:27:07,223][106225] Updated weights for policy 1, policy_version 587665 (0.0010) [2023-12-27 23:27:07,274][106225] Updated weights for policy 1, policy_version 587675 (0.0008) [2023-12-27 23:27:07,336][106225] Updated weights for policy 1, policy_version 587685 (0.0009) [2023-12-27 23:27:07,375][106226] Updated weights for policy 0, policy_version 585653 (0.0007) [2023-12-27 23:27:07,397][106225] Updated weights for policy 1, policy_version 587695 (0.0008) [2023-12-27 23:27:07,424][106226] Updated weights for policy 0, policy_version 585663 (0.0005) [2023-12-27 23:27:07,473][106226] Updated weights for policy 0, policy_version 585673 (0.0005) [2023-12-27 23:27:08,093][106225] Updated weights for policy 1, policy_version 587705 (0.0008) [2023-12-27 23:27:08,156][106225] Updated weights for policy 1, policy_version 587715 (0.0007) [2023-12-27 23:27:08,171][106226] Updated weights for policy 0, policy_version 585683 (0.0009) [2023-12-27 23:27:08,217][106225] Updated weights for policy 1, policy_version 587725 (0.0008) [2023-12-27 23:27:08,222][106226] Updated weights for policy 0, policy_version 585693 (0.0011) [2023-12-27 23:27:08,278][106226] Updated weights for policy 0, policy_version 585703 (0.0009) [2023-12-27 23:27:08,975][106225] Updated weights for policy 1, policy_version 587735 (0.0007) [2023-12-27 23:27:09,018][106226] Updated weights for policy 0, policy_version 585713 (0.0007) [2023-12-27 23:27:09,032][106225] Updated weights for policy 1, policy_version 587745 (0.0007) [2023-12-27 23:27:09,087][106226] Updated weights for policy 0, policy_version 585723 (0.0010) [2023-12-27 23:27:09,096][106225] Updated weights for policy 1, policy_version 587755 (0.0006) [2023-12-27 23:27:09,152][106226] Updated weights for policy 0, policy_version 585733 (0.0011) [2023-12-27 23:27:09,216][106226] Updated weights for policy 0, policy_version 585743 (0.0012) [2023-12-27 23:27:09,954][106225] Updated weights for policy 1, policy_version 587765 (0.0007) [2023-12-27 23:27:10,005][106226] Updated weights for policy 0, policy_version 585753 (0.0008) [2023-12-27 23:27:10,023][106225] Updated weights for policy 1, policy_version 587775 (0.0010) [2023-12-27 23:27:10,064][106226] Updated weights for policy 0, policy_version 585763 (0.0007) [2023-12-27 23:27:10,093][106225] Updated weights for policy 1, policy_version 587785 (0.0007) [2023-12-27 23:27:10,127][106226] Updated weights for policy 0, policy_version 585773 (0.0006) [2023-12-27 23:27:10,791][106225] Updated weights for policy 1, policy_version 587795 (0.0007) [2023-12-27 23:27:10,847][106225] Updated weights for policy 1, policy_version 587805 (0.0008) [2023-12-27 23:27:10,901][106226] Updated weights for policy 0, policy_version 585783 (0.0009) [2023-12-27 23:27:10,902][106225] Updated weights for policy 1, policy_version 587815 (0.0007) [2023-12-27 23:27:10,956][106226] Updated weights for policy 0, policy_version 585793 (0.0009) [2023-12-27 23:27:11,005][106226] Updated weights for policy 0, policy_version 585803 (0.0009) [2023-12-27 23:27:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 300515328. Throughput: 0: 10004.3, 1: 9853.9. Samples: 300485648. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:11,175][105115] Avg episode reward: [(0, '-5.001'), (1, '-5.389')] [2023-12-27 23:27:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000587824_150511616.pth... [2023-12-27 23:27:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000585808_150003712.pth... [2023-12-27 23:27:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000584656_149708800.pth [2023-12-27 23:27:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000586672_150216704.pth [2023-12-27 23:27:11,583][106225] Updated weights for policy 1, policy_version 587825 (0.0009) [2023-12-27 23:27:11,659][106225] Updated weights for policy 1, policy_version 587835 (0.0009) [2023-12-27 23:27:11,728][106225] Updated weights for policy 1, policy_version 587845 (0.0009) [2023-12-27 23:27:11,796][106225] Updated weights for policy 1, policy_version 587855 (0.0008) [2023-12-27 23:27:11,816][106226] Updated weights for policy 0, policy_version 585813 (0.0012) [2023-12-27 23:27:11,886][106226] Updated weights for policy 0, policy_version 585823 (0.0008) [2023-12-27 23:27:11,957][106226] Updated weights for policy 0, policy_version 585833 (0.0007) [2023-12-27 23:27:12,517][106225] Updated weights for policy 1, policy_version 587865 (0.0006) [2023-12-27 23:27:12,580][106225] Updated weights for policy 1, policy_version 587875 (0.0008) [2023-12-27 23:27:12,644][106225] Updated weights for policy 1, policy_version 587885 (0.0009) [2023-12-27 23:27:12,674][106226] Updated weights for policy 0, policy_version 585843 (0.0009) [2023-12-27 23:27:12,725][106226] Updated weights for policy 0, policy_version 585853 (0.0009) [2023-12-27 23:27:12,774][106226] Updated weights for policy 0, policy_version 585863 (0.0009) [2023-12-27 23:27:13,308][106225] Updated weights for policy 1, policy_version 587895 (0.0008) [2023-12-27 23:27:13,367][106225] Updated weights for policy 1, policy_version 587905 (0.0008) [2023-12-27 23:27:13,419][106225] Updated weights for policy 1, policy_version 587915 (0.0008) [2023-12-27 23:27:13,556][106226] Updated weights for policy 0, policy_version 585873 (0.0008) [2023-12-27 23:27:13,617][106226] Updated weights for policy 0, policy_version 585883 (0.0006) [2023-12-27 23:27:13,674][106226] Updated weights for policy 0, policy_version 585893 (0.0006) [2023-12-27 23:27:13,728][106226] Updated weights for policy 0, policy_version 585903 (0.0009) [2023-12-27 23:27:13,996][106225] Updated weights for policy 1, policy_version 587925 (0.0006) [2023-12-27 23:27:14,051][106225] Updated weights for policy 1, policy_version 587935 (0.0005) [2023-12-27 23:27:14,106][106225] Updated weights for policy 1, policy_version 587945 (0.0005) [2023-12-27 23:27:14,369][106226] Updated weights for policy 0, policy_version 585913 (0.0008) [2023-12-27 23:27:14,421][106226] Updated weights for policy 0, policy_version 585923 (0.0006) [2023-12-27 23:27:14,470][106226] Updated weights for policy 0, policy_version 585933 (0.0008) [2023-12-27 23:27:14,720][106225] Updated weights for policy 1, policy_version 587955 (0.0006) [2023-12-27 23:27:14,787][106225] Updated weights for policy 1, policy_version 587965 (0.0008) [2023-12-27 23:27:14,859][106225] Updated weights for policy 1, policy_version 587975 (0.0010) [2023-12-27 23:27:15,150][106226] Updated weights for policy 0, policy_version 585943 (0.0010) [2023-12-27 23:27:15,209][106226] Updated weights for policy 0, policy_version 585953 (0.0011) [2023-12-27 23:27:15,275][106226] Updated weights for policy 0, policy_version 585963 (0.0008) [2023-12-27 23:27:15,499][106225] Updated weights for policy 1, policy_version 587985 (0.0010) [2023-12-27 23:27:15,559][106225] Updated weights for policy 1, policy_version 587995 (0.0008) [2023-12-27 23:27:15,613][106225] Updated weights for policy 1, policy_version 588005 (0.0007) [2023-12-27 23:27:15,663][106225] Updated weights for policy 1, policy_version 588015 (0.0006) [2023-12-27 23:27:15,922][106226] Updated weights for policy 0, policy_version 585973 (0.0006) [2023-12-27 23:27:15,986][106226] Updated weights for policy 0, policy_version 585983 (0.0006) [2023-12-27 23:27:16,045][106226] Updated weights for policy 0, policy_version 585993 (0.0006) [2023-12-27 23:27:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 300613632. Throughput: 0: 9848.5, 1: 9782.0. Samples: 300601372. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:16,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-5.723')] [2023-12-27 23:27:16,292][106225] Updated weights for policy 1, policy_version 588025 (0.0005) [2023-12-27 23:27:16,349][106225] Updated weights for policy 1, policy_version 588035 (0.0009) [2023-12-27 23:27:16,397][106225] Updated weights for policy 1, policy_version 588045 (0.0007) [2023-12-27 23:27:16,579][106226] Updated weights for policy 0, policy_version 586003 (0.0005) [2023-12-27 23:27:16,627][106226] Updated weights for policy 0, policy_version 586013 (0.0005) [2023-12-27 23:27:16,680][106226] Updated weights for policy 0, policy_version 586023 (0.0006) [2023-12-27 23:27:17,067][106225] Updated weights for policy 1, policy_version 588055 (0.0005) [2023-12-27 23:27:17,118][106225] Updated weights for policy 1, policy_version 588065 (0.0008) [2023-12-27 23:27:17,169][106225] Updated weights for policy 1, policy_version 588075 (0.0007) [2023-12-27 23:27:17,302][106226] Updated weights for policy 0, policy_version 586033 (0.0010) [2023-12-27 23:27:17,362][106226] Updated weights for policy 0, policy_version 586043 (0.0007) [2023-12-27 23:27:17,427][106226] Updated weights for policy 0, policy_version 586053 (0.0009) [2023-12-27 23:27:17,491][106226] Updated weights for policy 0, policy_version 586063 (0.0007) [2023-12-27 23:27:17,876][106225] Updated weights for policy 1, policy_version 588085 (0.0010) [2023-12-27 23:27:17,927][106225] Updated weights for policy 1, policy_version 588095 (0.0008) [2023-12-27 23:27:17,981][106225] Updated weights for policy 1, policy_version 588105 (0.0009) [2023-12-27 23:27:18,069][106226] Updated weights for policy 0, policy_version 586073 (0.0006) [2023-12-27 23:27:18,131][106226] Updated weights for policy 0, policy_version 586083 (0.0005) [2023-12-27 23:27:18,203][106226] Updated weights for policy 0, policy_version 586093 (0.0005) [2023-12-27 23:27:18,803][106225] Updated weights for policy 1, policy_version 588115 (0.0009) [2023-12-27 23:27:18,813][106226] Updated weights for policy 0, policy_version 586103 (0.0006) [2023-12-27 23:27:18,852][106225] Updated weights for policy 1, policy_version 588125 (0.0007) [2023-12-27 23:27:18,858][106226] Updated weights for policy 0, policy_version 586113 (0.0006) [2023-12-27 23:27:18,897][106225] Updated weights for policy 1, policy_version 588135 (0.0007) [2023-12-27 23:27:18,903][106226] Updated weights for policy 0, policy_version 586123 (0.0008) [2023-12-27 23:27:19,636][106226] Updated weights for policy 0, policy_version 586133 (0.0009) [2023-12-27 23:27:19,638][106225] Updated weights for policy 1, policy_version 588145 (0.0007) [2023-12-27 23:27:19,688][106226] Updated weights for policy 0, policy_version 586143 (0.0007) [2023-12-27 23:27:19,696][106225] Updated weights for policy 1, policy_version 588155 (0.0010) [2023-12-27 23:27:19,739][106226] Updated weights for policy 0, policy_version 586153 (0.0009) [2023-12-27 23:27:19,754][106225] Updated weights for policy 1, policy_version 588165 (0.0006) [2023-12-27 23:27:19,820][106225] Updated weights for policy 1, policy_version 588175 (0.0007) [2023-12-27 23:27:20,531][106225] Updated weights for policy 1, policy_version 588185 (0.0010) [2023-12-27 23:27:20,540][106226] Updated weights for policy 0, policy_version 586163 (0.0008) [2023-12-27 23:27:20,596][106225] Updated weights for policy 1, policy_version 588195 (0.0010) [2023-12-27 23:27:20,602][106226] Updated weights for policy 0, policy_version 586173 (0.0008) [2023-12-27 23:27:20,650][106225] Updated weights for policy 1, policy_version 588205 (0.0007) [2023-12-27 23:27:20,673][106226] Updated weights for policy 0, policy_version 586183 (0.0008) [2023-12-27 23:27:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 300711936. Throughput: 0: 9909.1, 1: 9768.5. Samples: 300723140. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:21,175][105115] Avg episode reward: [(0, '-5.122'), (1, '-5.629')] [2023-12-27 23:27:21,425][106226] Updated weights for policy 0, policy_version 586193 (0.0007) [2023-12-27 23:27:21,428][106225] Updated weights for policy 1, policy_version 588215 (0.0009) [2023-12-27 23:27:21,489][106225] Updated weights for policy 1, policy_version 588225 (0.0008) [2023-12-27 23:27:21,492][106226] Updated weights for policy 0, policy_version 586203 (0.0008) [2023-12-27 23:27:21,558][106226] Updated weights for policy 0, policy_version 586213 (0.0006) [2023-12-27 23:27:21,560][106225] Updated weights for policy 1, policy_version 588235 (0.0008) [2023-12-27 23:27:21,622][106226] Updated weights for policy 0, policy_version 586223 (0.0007) [2023-12-27 23:27:22,274][106225] Updated weights for policy 1, policy_version 588245 (0.0009) [2023-12-27 23:27:22,340][106225] Updated weights for policy 1, policy_version 588255 (0.0008) [2023-12-27 23:27:22,392][106226] Updated weights for policy 0, policy_version 586233 (0.0008) [2023-12-27 23:27:22,405][106225] Updated weights for policy 1, policy_version 588265 (0.0008) [2023-12-27 23:27:22,449][106226] Updated weights for policy 0, policy_version 586243 (0.0006) [2023-12-27 23:27:22,510][106226] Updated weights for policy 0, policy_version 586253 (0.0008) [2023-12-27 23:27:23,123][106225] Updated weights for policy 1, policy_version 588275 (0.0008) [2023-12-27 23:27:23,174][106225] Updated weights for policy 1, policy_version 588285 (0.0008) [2023-12-27 23:27:23,215][106226] Updated weights for policy 0, policy_version 586263 (0.0010) [2023-12-27 23:27:23,226][106225] Updated weights for policy 1, policy_version 588295 (0.0006) [2023-12-27 23:27:23,267][106226] Updated weights for policy 0, policy_version 586273 (0.0011) [2023-12-27 23:27:23,315][106226] Updated weights for policy 0, policy_version 586283 (0.0010) [2023-12-27 23:27:23,963][106225] Updated weights for policy 1, policy_version 588305 (0.0006) [2023-12-27 23:27:24,030][106225] Updated weights for policy 1, policy_version 588315 (0.0008) [2023-12-27 23:27:24,051][106226] Updated weights for policy 0, policy_version 586293 (0.0008) [2023-12-27 23:27:24,091][106225] Updated weights for policy 1, policy_version 588325 (0.0009) [2023-12-27 23:27:24,114][106226] Updated weights for policy 0, policy_version 586303 (0.0005) [2023-12-27 23:27:24,151][106225] Updated weights for policy 1, policy_version 588335 (0.0008) [2023-12-27 23:27:24,172][106226] Updated weights for policy 0, policy_version 586313 (0.0005) [2023-12-27 23:27:24,780][106225] Updated weights for policy 1, policy_version 588345 (0.0005) [2023-12-27 23:27:24,808][106226] Updated weights for policy 0, policy_version 586323 (0.0007) [2023-12-27 23:27:24,837][106225] Updated weights for policy 1, policy_version 588355 (0.0005) [2023-12-27 23:27:24,869][106226] Updated weights for policy 0, policy_version 586333 (0.0010) [2023-12-27 23:27:24,894][106225] Updated weights for policy 1, policy_version 588365 (0.0005) [2023-12-27 23:27:24,925][106226] Updated weights for policy 0, policy_version 586343 (0.0011) [2023-12-27 23:27:25,546][106226] Updated weights for policy 0, policy_version 586353 (0.0010) [2023-12-27 23:27:25,564][106225] Updated weights for policy 1, policy_version 588375 (0.0006) [2023-12-27 23:27:25,607][106226] Updated weights for policy 0, policy_version 586363 (0.0008) [2023-12-27 23:27:25,609][106225] Updated weights for policy 1, policy_version 588385 (0.0006) [2023-12-27 23:27:25,656][106225] Updated weights for policy 1, policy_version 588395 (0.0008) [2023-12-27 23:27:25,663][106226] Updated weights for policy 0, policy_version 586373 (0.0009) [2023-12-27 23:27:25,712][106226] Updated weights for policy 0, policy_version 586383 (0.0008) [2023-12-27 23:27:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 300810240. Throughput: 0: 9896.8, 1: 9755.4. Samples: 300779732. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:26,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.935')] [2023-12-27 23:27:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000586384_150151168.pth... [2023-12-27 23:27:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000588400_150659072.pth... [2023-12-27 23:27:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000585232_149856256.pth [2023-12-27 23:27:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000587248_150364160.pth [2023-12-27 23:27:26,405][106226] Updated weights for policy 0, policy_version 586393 (0.0009) [2023-12-27 23:27:26,431][106225] Updated weights for policy 1, policy_version 588405 (0.0006) [2023-12-27 23:27:26,464][106226] Updated weights for policy 0, policy_version 586403 (0.0007) [2023-12-27 23:27:26,488][106225] Updated weights for policy 1, policy_version 588415 (0.0005) [2023-12-27 23:27:26,517][106226] Updated weights for policy 0, policy_version 586413 (0.0009) [2023-12-27 23:27:26,543][106225] Updated weights for policy 1, policy_version 588425 (0.0005) [2023-12-27 23:27:27,157][106226] Updated weights for policy 0, policy_version 586423 (0.0006) [2023-12-27 23:27:27,203][106226] Updated weights for policy 0, policy_version 586433 (0.0005) [2023-12-27 23:27:27,251][106226] Updated weights for policy 0, policy_version 586443 (0.0005) [2023-12-27 23:27:27,257][106225] Updated weights for policy 1, policy_version 588435 (0.0005) [2023-12-27 23:27:27,314][106225] Updated weights for policy 1, policy_version 588445 (0.0009) [2023-12-27 23:27:27,364][106225] Updated weights for policy 1, policy_version 588455 (0.0010) [2023-12-27 23:27:27,799][106226] Updated weights for policy 0, policy_version 586453 (0.0007) [2023-12-27 23:27:27,866][106226] Updated weights for policy 0, policy_version 586463 (0.0007) [2023-12-27 23:27:27,924][106226] Updated weights for policy 0, policy_version 586473 (0.0009) [2023-12-27 23:27:28,021][106225] Updated weights for policy 1, policy_version 588465 (0.0009) [2023-12-27 23:27:28,081][106225] Updated weights for policy 1, policy_version 588475 (0.0007) [2023-12-27 23:27:28,133][106225] Updated weights for policy 1, policy_version 588485 (0.0008) [2023-12-27 23:27:28,184][106225] Updated weights for policy 1, policy_version 588495 (0.0008) [2023-12-27 23:27:28,592][106226] Updated weights for policy 0, policy_version 586483 (0.0006) [2023-12-27 23:27:28,657][106226] Updated weights for policy 0, policy_version 586493 (0.0008) [2023-12-27 23:27:28,720][106226] Updated weights for policy 0, policy_version 586503 (0.0008) [2023-12-27 23:27:28,957][106225] Updated weights for policy 1, policy_version 588505 (0.0008) [2023-12-27 23:27:29,025][106225] Updated weights for policy 1, policy_version 588515 (0.0009) [2023-12-27 23:27:29,083][106225] Updated weights for policy 1, policy_version 588525 (0.0008) [2023-12-27 23:27:29,379][106226] Updated weights for policy 0, policy_version 586513 (0.0009) [2023-12-27 23:27:29,442][106226] Updated weights for policy 0, policy_version 586523 (0.0006) [2023-12-27 23:27:29,501][106226] Updated weights for policy 0, policy_version 586533 (0.0010) [2023-12-27 23:27:29,558][106226] Updated weights for policy 0, policy_version 586543 (0.0006) [2023-12-27 23:27:29,770][106225] Updated weights for policy 1, policy_version 588535 (0.0010) [2023-12-27 23:27:29,825][106225] Updated weights for policy 1, policy_version 588545 (0.0009) [2023-12-27 23:27:29,884][106225] Updated weights for policy 1, policy_version 588555 (0.0008) [2023-12-27 23:27:30,225][106226] Updated weights for policy 0, policy_version 586553 (0.0005) [2023-12-27 23:27:30,280][106226] Updated weights for policy 0, policy_version 586563 (0.0006) [2023-12-27 23:27:30,332][106226] Updated weights for policy 0, policy_version 586573 (0.0009) [2023-12-27 23:27:30,627][106225] Updated weights for policy 1, policy_version 588565 (0.0007) [2023-12-27 23:27:30,680][106225] Updated weights for policy 1, policy_version 588575 (0.0007) [2023-12-27 23:27:30,731][106225] Updated weights for policy 1, policy_version 588585 (0.0008) [2023-12-27 23:27:31,018][106226] Updated weights for policy 0, policy_version 586583 (0.0007) [2023-12-27 23:27:31,084][106226] Updated weights for policy 0, policy_version 586593 (0.0009) [2023-12-27 23:27:31,141][106226] Updated weights for policy 0, policy_version 586603 (0.0009) [2023-12-27 23:27:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 300916736. Throughput: 0: 10030.2, 1: 9854.6. Samples: 300903776. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:31,175][105115] Avg episode reward: [(0, '-4.677'), (1, '-5.481')] [2023-12-27 23:27:31,474][106225] Updated weights for policy 1, policy_version 588595 (0.0007) [2023-12-27 23:27:31,534][106225] Updated weights for policy 1, policy_version 588605 (0.0006) [2023-12-27 23:27:31,600][106225] Updated weights for policy 1, policy_version 588615 (0.0008) [2023-12-27 23:27:31,865][106226] Updated weights for policy 0, policy_version 586613 (0.0008) [2023-12-27 23:27:31,925][106226] Updated weights for policy 0, policy_version 586623 (0.0009) [2023-12-27 23:27:31,987][106226] Updated weights for policy 0, policy_version 586633 (0.0009) [2023-12-27 23:27:32,305][106225] Updated weights for policy 1, policy_version 588625 (0.0008) [2023-12-27 23:27:32,365][106225] Updated weights for policy 1, policy_version 588635 (0.0007) [2023-12-27 23:27:32,422][106225] Updated weights for policy 1, policy_version 588645 (0.0009) [2023-12-27 23:27:32,474][106225] Updated weights for policy 1, policy_version 588655 (0.0008) [2023-12-27 23:27:32,699][106226] Updated weights for policy 0, policy_version 586643 (0.0008) [2023-12-27 23:27:32,760][106226] Updated weights for policy 0, policy_version 586653 (0.0007) [2023-12-27 23:27:32,820][106226] Updated weights for policy 0, policy_version 586663 (0.0009) [2023-12-27 23:27:33,192][106225] Updated weights for policy 1, policy_version 588665 (0.0008) [2023-12-27 23:27:33,245][106225] Updated weights for policy 1, policy_version 588675 (0.0008) [2023-12-27 23:27:33,301][106225] Updated weights for policy 1, policy_version 588685 (0.0009) [2023-12-27 23:27:33,497][106226] Updated weights for policy 0, policy_version 586673 (0.0008) [2023-12-27 23:27:33,547][106226] Updated weights for policy 0, policy_version 586683 (0.0005) [2023-12-27 23:27:33,596][106226] Updated weights for policy 0, policy_version 586693 (0.0005) [2023-12-27 23:27:33,645][106226] Updated weights for policy 0, policy_version 586703 (0.0005) [2023-12-27 23:27:34,020][106225] Updated weights for policy 1, policy_version 588695 (0.0006) [2023-12-27 23:27:34,079][106225] Updated weights for policy 1, policy_version 588705 (0.0005) [2023-12-27 23:27:34,136][106225] Updated weights for policy 1, policy_version 588715 (0.0006) [2023-12-27 23:27:34,302][106226] Updated weights for policy 0, policy_version 586713 (0.0007) [2023-12-27 23:27:34,366][106226] Updated weights for policy 0, policy_version 586723 (0.0008) [2023-12-27 23:27:34,435][106226] Updated weights for policy 0, policy_version 586733 (0.0010) [2023-12-27 23:27:34,680][106225] Updated weights for policy 1, policy_version 588725 (0.0009) [2023-12-27 23:27:34,745][106225] Updated weights for policy 1, policy_version 588735 (0.0010) [2023-12-27 23:27:34,795][106225] Updated weights for policy 1, policy_version 588745 (0.0010) [2023-12-27 23:27:35,161][106226] Updated weights for policy 0, policy_version 586743 (0.0008) [2023-12-27 23:27:35,225][106226] Updated weights for policy 0, policy_version 586753 (0.0009) [2023-12-27 23:27:35,281][106226] Updated weights for policy 0, policy_version 586763 (0.0008) [2023-12-27 23:27:35,435][106225] Updated weights for policy 1, policy_version 588755 (0.0010) [2023-12-27 23:27:35,488][106225] Updated weights for policy 1, policy_version 588765 (0.0010) [2023-12-27 23:27:35,553][106225] Updated weights for policy 1, policy_version 588775 (0.0010) [2023-12-27 23:27:36,058][106226] Updated weights for policy 0, policy_version 586773 (0.0009) [2023-12-27 23:27:36,115][106226] Updated weights for policy 0, policy_version 586783 (0.0007) [2023-12-27 23:27:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 301006848. Throughput: 0: 9978.9, 1: 9898.6. Samples: 301022148. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:36,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-5.593')] [2023-12-27 23:27:36,177][106226] Updated weights for policy 0, policy_version 586793 (0.0006) [2023-12-27 23:27:36,247][106225] Updated weights for policy 1, policy_version 588785 (0.0010) [2023-12-27 23:27:36,307][106225] Updated weights for policy 1, policy_version 588795 (0.0008) [2023-12-27 23:27:36,368][106225] Updated weights for policy 1, policy_version 588805 (0.0009) [2023-12-27 23:27:36,428][106225] Updated weights for policy 1, policy_version 588815 (0.0008) [2023-12-27 23:27:36,871][106226] Updated weights for policy 0, policy_version 586803 (0.0008) [2023-12-27 23:27:36,926][106226] Updated weights for policy 0, policy_version 586813 (0.0009) [2023-12-27 23:27:36,995][106226] Updated weights for policy 0, policy_version 586823 (0.0008) [2023-12-27 23:27:37,104][106225] Updated weights for policy 1, policy_version 588825 (0.0007) [2023-12-27 23:27:37,155][106225] Updated weights for policy 1, policy_version 588835 (0.0005) [2023-12-27 23:27:37,214][106225] Updated weights for policy 1, policy_version 588845 (0.0005) [2023-12-27 23:27:37,780][106226] Updated weights for policy 0, policy_version 586833 (0.0009) [2023-12-27 23:27:37,826][106225] Updated weights for policy 1, policy_version 588855 (0.0009) [2023-12-27 23:27:37,832][106226] Updated weights for policy 0, policy_version 586843 (0.0006) [2023-12-27 23:27:37,873][106225] Updated weights for policy 1, policy_version 588865 (0.0010) [2023-12-27 23:27:37,891][106226] Updated weights for policy 0, policy_version 586853 (0.0007) [2023-12-27 23:27:37,924][106225] Updated weights for policy 1, policy_version 588875 (0.0010) [2023-12-27 23:27:37,942][106226] Updated weights for policy 0, policy_version 586863 (0.0006) [2023-12-27 23:27:38,623][106225] Updated weights for policy 1, policy_version 588885 (0.0009) [2023-12-27 23:27:38,680][106225] Updated weights for policy 1, policy_version 588895 (0.0007) [2023-12-27 23:27:38,715][106226] Updated weights for policy 0, policy_version 586873 (0.0009) [2023-12-27 23:27:38,744][106225] Updated weights for policy 1, policy_version 588905 (0.0008) [2023-12-27 23:27:38,780][106226] Updated weights for policy 0, policy_version 586883 (0.0007) [2023-12-27 23:27:38,846][106226] Updated weights for policy 0, policy_version 586893 (0.0009) [2023-12-27 23:27:39,367][106225] Updated weights for policy 1, policy_version 588915 (0.0007) [2023-12-27 23:27:39,435][106225] Updated weights for policy 1, policy_version 588925 (0.0007) [2023-12-27 23:27:39,489][106225] Updated weights for policy 1, policy_version 588935 (0.0006) [2023-12-27 23:27:39,659][106226] Updated weights for policy 0, policy_version 586903 (0.0009) [2023-12-27 23:27:39,730][106226] Updated weights for policy 0, policy_version 586913 (0.0009) [2023-12-27 23:27:39,801][106226] Updated weights for policy 0, policy_version 586923 (0.0009) [2023-12-27 23:27:40,279][106225] Updated weights for policy 1, policy_version 588945 (0.0009) [2023-12-27 23:27:40,343][106225] Updated weights for policy 1, policy_version 588955 (0.0009) [2023-12-27 23:27:40,405][106225] Updated weights for policy 1, policy_version 588965 (0.0011) [2023-12-27 23:27:40,465][106225] Updated weights for policy 1, policy_version 588975 (0.0010) [2023-12-27 23:27:40,568][106226] Updated weights for policy 0, policy_version 586933 (0.0008) [2023-12-27 23:27:40,632][106226] Updated weights for policy 0, policy_version 586943 (0.0008) [2023-12-27 23:27:40,695][106226] Updated weights for policy 0, policy_version 586953 (0.0009) [2023-12-27 23:27:41,132][106225] Updated weights for policy 1, policy_version 588985 (0.0007) [2023-12-27 23:27:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 301105152. Throughput: 0: 9918.1, 1: 9959.6. Samples: 301080736. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:41,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-5.438')] [2023-12-27 23:27:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000586960_150298624.pth... [2023-12-27 23:27:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000585808_150003712.pth [2023-12-27 23:27:41,201][106225] Updated weights for policy 1, policy_version 588995 (0.0009) [2023-12-27 23:27:41,258][106225] Updated weights for policy 1, policy_version 589005 (0.0009) [2023-12-27 23:27:41,275][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000589008_150814720.pth... [2023-12-27 23:27:41,280][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000587824_150511616.pth [2023-12-27 23:27:41,508][106226] Updated weights for policy 0, policy_version 586963 (0.0010) [2023-12-27 23:27:41,577][106226] Updated weights for policy 0, policy_version 586973 (0.0008) [2023-12-27 23:27:41,652][106226] Updated weights for policy 0, policy_version 586983 (0.0008) [2023-12-27 23:27:41,982][106225] Updated weights for policy 1, policy_version 589015 (0.0009) [2023-12-27 23:27:42,041][106225] Updated weights for policy 1, policy_version 589025 (0.0011) [2023-12-27 23:27:42,100][106225] Updated weights for policy 1, policy_version 589035 (0.0011) [2023-12-27 23:27:42,434][106226] Updated weights for policy 0, policy_version 586993 (0.0009) [2023-12-27 23:27:42,488][106226] Updated weights for policy 0, policy_version 587003 (0.0008) [2023-12-27 23:27:42,550][106226] Updated weights for policy 0, policy_version 587013 (0.0008) [2023-12-27 23:27:42,604][106226] Updated weights for policy 0, policy_version 587023 (0.0008) [2023-12-27 23:27:42,824][106225] Updated weights for policy 1, policy_version 589045 (0.0009) [2023-12-27 23:27:42,889][106225] Updated weights for policy 1, policy_version 589055 (0.0008) [2023-12-27 23:27:42,944][106225] Updated weights for policy 1, policy_version 589065 (0.0008) [2023-12-27 23:27:43,384][106226] Updated weights for policy 0, policy_version 587033 (0.0008) [2023-12-27 23:27:43,435][106226] Updated weights for policy 0, policy_version 587043 (0.0008) [2023-12-27 23:27:43,481][106226] Updated weights for policy 0, policy_version 587053 (0.0005) [2023-12-27 23:27:43,577][106225] Updated weights for policy 1, policy_version 589075 (0.0008) [2023-12-27 23:27:43,623][106225] Updated weights for policy 1, policy_version 589085 (0.0005) [2023-12-27 23:27:43,672][106225] Updated weights for policy 1, policy_version 589095 (0.0005) [2023-12-27 23:27:44,175][106226] Updated weights for policy 0, policy_version 587063 (0.0008) [2023-12-27 23:27:44,229][106226] Updated weights for policy 0, policy_version 587073 (0.0009) [2023-12-27 23:27:44,284][106226] Updated weights for policy 0, policy_version 587083 (0.0009) [2023-12-27 23:27:44,353][106225] Updated weights for policy 1, policy_version 589105 (0.0006) [2023-12-27 23:27:44,411][106225] Updated weights for policy 1, policy_version 589115 (0.0008) [2023-12-27 23:27:44,470][106225] Updated weights for policy 1, policy_version 589125 (0.0008) [2023-12-27 23:27:44,531][106225] Updated weights for policy 1, policy_version 589135 (0.0008) [2023-12-27 23:27:45,008][106226] Updated weights for policy 0, policy_version 587093 (0.0008) [2023-12-27 23:27:45,070][106226] Updated weights for policy 0, policy_version 587103 (0.0006) [2023-12-27 23:27:45,133][106226] Updated weights for policy 0, policy_version 587113 (0.0006) [2023-12-27 23:27:45,309][106225] Updated weights for policy 1, policy_version 589145 (0.0010) [2023-12-27 23:27:45,371][106225] Updated weights for policy 1, policy_version 589155 (0.0008) [2023-12-27 23:27:45,429][106225] Updated weights for policy 1, policy_version 589165 (0.0008) [2023-12-27 23:27:45,776][106226] Updated weights for policy 0, policy_version 587123 (0.0006) [2023-12-27 23:27:45,847][106226] Updated weights for policy 0, policy_version 587133 (0.0010) [2023-12-27 23:27:45,898][106226] Updated weights for policy 0, policy_version 587144 (0.0009) [2023-12-27 23:27:46,031][106225] Updated weights for policy 1, policy_version 589175 (0.0006) [2023-12-27 23:27:46,092][106225] Updated weights for policy 1, policy_version 589185 (0.0005) [2023-12-27 23:27:46,155][106225] Updated weights for policy 1, policy_version 589195 (0.0005) [2023-12-27 23:27:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 301203456. Throughput: 0: 9825.9, 1: 9944.3. Samples: 301195032. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:46,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.650')] [2023-12-27 23:27:46,625][106226] Updated weights for policy 0, policy_version 587154 (0.0007) [2023-12-27 23:27:46,672][106226] Updated weights for policy 0, policy_version 587164 (0.0005) [2023-12-27 23:27:46,723][106226] Updated weights for policy 0, policy_version 587174 (0.0010) [2023-12-27 23:27:46,747][106225] Updated weights for policy 1, policy_version 589205 (0.0007) [2023-12-27 23:27:46,770][106226] Updated weights for policy 0, policy_version 587184 (0.0007) [2023-12-27 23:27:46,796][106225] Updated weights for policy 1, policy_version 589215 (0.0005) [2023-12-27 23:27:46,852][106225] Updated weights for policy 1, policy_version 589225 (0.0009) [2023-12-27 23:27:47,340][106226] Updated weights for policy 0, policy_version 587194 (0.0006) [2023-12-27 23:27:47,390][106226] Updated weights for policy 0, policy_version 587204 (0.0005) [2023-12-27 23:27:47,438][106226] Updated weights for policy 0, policy_version 587214 (0.0005) [2023-12-27 23:27:47,613][106225] Updated weights for policy 1, policy_version 589235 (0.0007) [2023-12-27 23:27:47,672][106225] Updated weights for policy 1, policy_version 589245 (0.0008) [2023-12-27 23:27:47,741][106225] Updated weights for policy 1, policy_version 589255 (0.0009) [2023-12-27 23:27:47,989][106226] Updated weights for policy 0, policy_version 587224 (0.0009) [2023-12-27 23:27:48,046][106226] Updated weights for policy 0, policy_version 587234 (0.0011) [2023-12-27 23:27:48,100][106226] Updated weights for policy 0, policy_version 587244 (0.0010) [2023-12-27 23:27:48,481][106225] Updated weights for policy 1, policy_version 589265 (0.0008) [2023-12-27 23:27:48,544][106225] Updated weights for policy 1, policy_version 589275 (0.0009) [2023-12-27 23:27:48,606][106225] Updated weights for policy 1, policy_version 589285 (0.0008) [2023-12-27 23:27:48,664][106225] Updated weights for policy 1, policy_version 589295 (0.0006) [2023-12-27 23:27:48,831][106226] Updated weights for policy 0, policy_version 587254 (0.0010) [2023-12-27 23:27:48,894][106226] Updated weights for policy 0, policy_version 587264 (0.0011) [2023-12-27 23:27:48,956][106226] Updated weights for policy 0, policy_version 587274 (0.0010) [2023-12-27 23:27:49,394][106225] Updated weights for policy 1, policy_version 589305 (0.0009) [2023-12-27 23:27:49,454][106225] Updated weights for policy 1, policy_version 589315 (0.0010) [2023-12-27 23:27:49,512][106225] Updated weights for policy 1, policy_version 589325 (0.0010) [2023-12-27 23:27:49,674][106226] Updated weights for policy 0, policy_version 587284 (0.0010) [2023-12-27 23:27:49,729][106226] Updated weights for policy 0, policy_version 587294 (0.0008) [2023-12-27 23:27:49,786][106226] Updated weights for policy 0, policy_version 587304 (0.0008) [2023-12-27 23:27:50,272][106225] Updated weights for policy 1, policy_version 589335 (0.0009) [2023-12-27 23:27:50,331][106225] Updated weights for policy 1, policy_version 589345 (0.0008) [2023-12-27 23:27:50,388][106225] Updated weights for policy 1, policy_version 589355 (0.0008) [2023-12-27 23:27:50,523][106226] Updated weights for policy 0, policy_version 587314 (0.0008) [2023-12-27 23:27:50,584][106226] Updated weights for policy 0, policy_version 587324 (0.0009) [2023-12-27 23:27:50,655][106226] Updated weights for policy 0, policy_version 587334 (0.0007) [2023-12-27 23:27:50,716][106226] Updated weights for policy 0, policy_version 587344 (0.0009) [2023-12-27 23:27:51,060][106225] Updated weights for policy 1, policy_version 589365 (0.0008) [2023-12-27 23:27:51,114][106225] Updated weights for policy 1, policy_version 589375 (0.0006) [2023-12-27 23:27:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 301301760. Throughput: 0: 9857.7, 1: 9879.7. Samples: 301314316. Policy #0 lag: (min: 3.0, avg: 7.3, max: 35.0) [2023-12-27 23:27:51,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.236')] [2023-12-27 23:27:51,185][106225] Updated weights for policy 1, policy_version 589385 (0.0008) [2023-12-27 23:27:51,543][106226] Updated weights for policy 0, policy_version 587354 (0.0010) [2023-12-27 23:27:51,606][106226] Updated weights for policy 0, policy_version 587364 (0.0010) [2023-12-27 23:27:51,678][106226] Updated weights for policy 0, policy_version 587374 (0.0009) [2023-12-27 23:27:51,851][106225] Updated weights for policy 1, policy_version 589395 (0.0008) [2023-12-27 23:27:51,919][106225] Updated weights for policy 1, policy_version 589405 (0.0008) [2023-12-27 23:27:51,984][106225] Updated weights for policy 1, policy_version 589415 (0.0008) [2023-12-27 23:27:52,453][106226] Updated weights for policy 0, policy_version 587384 (0.0006) [2023-12-27 23:27:52,514][106226] Updated weights for policy 0, policy_version 587394 (0.0006) [2023-12-27 23:27:52,576][106226] Updated weights for policy 0, policy_version 587404 (0.0006) [2023-12-27 23:27:52,700][106225] Updated weights for policy 1, policy_version 589425 (0.0008) [2023-12-27 23:27:52,753][106225] Updated weights for policy 1, policy_version 589435 (0.0006) [2023-12-27 23:27:52,812][106225] Updated weights for policy 1, policy_version 589445 (0.0005) [2023-12-27 23:27:52,871][106225] Updated weights for policy 1, policy_version 589455 (0.0010) [2023-12-27 23:27:53,198][106226] Updated weights for policy 0, policy_version 587414 (0.0008) [2023-12-27 23:27:53,254][106226] Updated weights for policy 0, policy_version 587424 (0.0008) [2023-12-27 23:27:53,310][106226] Updated weights for policy 0, policy_version 587434 (0.0008) [2023-12-27 23:27:53,503][106225] Updated weights for policy 1, policy_version 589465 (0.0009) [2023-12-27 23:27:53,554][106225] Updated weights for policy 1, policy_version 589475 (0.0008) [2023-12-27 23:27:53,598][106225] Updated weights for policy 1, policy_version 589485 (0.0008) [2023-12-27 23:27:54,044][106226] Updated weights for policy 0, policy_version 587444 (0.0009) [2023-12-27 23:27:54,105][106226] Updated weights for policy 0, policy_version 587454 (0.0008) [2023-12-27 23:27:54,170][106226] Updated weights for policy 0, policy_version 587464 (0.0006) [2023-12-27 23:27:54,241][106225] Updated weights for policy 1, policy_version 589495 (0.0008) [2023-12-27 23:27:54,296][106225] Updated weights for policy 1, policy_version 589505 (0.0008) [2023-12-27 23:27:54,352][106225] Updated weights for policy 1, policy_version 589515 (0.0009) [2023-12-27 23:27:54,853][106226] Updated weights for policy 0, policy_version 587474 (0.0007) [2023-12-27 23:27:54,903][106226] Updated weights for policy 0, policy_version 587484 (0.0010) [2023-12-27 23:27:54,957][106226] Updated weights for policy 0, policy_version 587494 (0.0010) [2023-12-27 23:27:55,010][106225] Updated weights for policy 1, policy_version 589525 (0.0007) [2023-12-27 23:27:55,013][106226] Updated weights for policy 0, policy_version 587504 (0.0010) [2023-12-27 23:27:55,066][106225] Updated weights for policy 1, policy_version 589535 (0.0007) [2023-12-27 23:27:55,127][106225] Updated weights for policy 1, policy_version 589545 (0.0007) [2023-12-27 23:27:55,699][106226] Updated weights for policy 0, policy_version 587514 (0.0006) [2023-12-27 23:27:55,736][106225] Updated weights for policy 1, policy_version 589555 (0.0007) [2023-12-27 23:27:55,761][106226] Updated weights for policy 0, policy_version 587524 (0.0005) [2023-12-27 23:27:55,787][106225] Updated weights for policy 1, policy_version 589565 (0.0010) [2023-12-27 23:27:55,812][106226] Updated weights for policy 0, policy_version 587534 (0.0005) [2023-12-27 23:27:55,839][106225] Updated weights for policy 1, policy_version 589575 (0.0009) [2023-12-27 23:27:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.2, 300 sec: 19688.5). Total num frames: 301408256. Throughput: 0: 9819.3, 1: 9905.7. Samples: 301373272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:27:56,175][105115] Avg episode reward: [(0, '-4.982'), (1, '-5.932')] [2023-12-27 23:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000589584_150962176.pth... [2023-12-27 23:27:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000587536_150446080.pth... [2023-12-27 23:27:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000588400_150659072.pth [2023-12-27 23:27:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000586384_150151168.pth [2023-12-27 23:27:56,439][106226] Updated weights for policy 0, policy_version 587544 (0.0006) [2023-12-27 23:27:56,504][106226] Updated weights for policy 0, policy_version 587554 (0.0005) [2023-12-27 23:27:56,554][106225] Updated weights for policy 1, policy_version 589585 (0.0006) [2023-12-27 23:27:56,565][106226] Updated weights for policy 0, policy_version 587564 (0.0005) [2023-12-27 23:27:56,609][106225] Updated weights for policy 1, policy_version 589595 (0.0010) [2023-12-27 23:27:56,661][106225] Updated weights for policy 1, policy_version 589605 (0.0010) [2023-12-27 23:27:56,717][106225] Updated weights for policy 1, policy_version 589615 (0.0010) [2023-12-27 23:27:57,202][106226] Updated weights for policy 0, policy_version 587574 (0.0010) [2023-12-27 23:27:57,252][106226] Updated weights for policy 0, policy_version 587584 (0.0010) [2023-12-27 23:27:57,299][106226] Updated weights for policy 0, policy_version 587594 (0.0010) [2023-12-27 23:27:57,430][106225] Updated weights for policy 1, policy_version 589625 (0.0010) [2023-12-27 23:27:57,493][106225] Updated weights for policy 1, policy_version 589635 (0.0008) [2023-12-27 23:27:57,556][106225] Updated weights for policy 1, policy_version 589645 (0.0006) [2023-12-27 23:27:57,909][106226] Updated weights for policy 0, policy_version 587604 (0.0006) [2023-12-27 23:27:57,972][106226] Updated weights for policy 0, policy_version 587614 (0.0005) [2023-12-27 23:27:58,039][106226] Updated weights for policy 0, policy_version 587624 (0.0005) [2023-12-27 23:27:58,121][106225] Updated weights for policy 1, policy_version 589655 (0.0007) [2023-12-27 23:27:58,165][106225] Updated weights for policy 1, policy_version 589665 (0.0006) [2023-12-27 23:27:58,224][106225] Updated weights for policy 1, policy_version 589675 (0.0007) [2023-12-27 23:27:58,625][106226] Updated weights for policy 0, policy_version 587634 (0.0006) [2023-12-27 23:27:58,691][106226] Updated weights for policy 0, policy_version 587644 (0.0011) [2023-12-27 23:27:58,757][106226] Updated weights for policy 0, policy_version 587654 (0.0009) [2023-12-27 23:27:59,095][106225] Updated weights for policy 1, policy_version 589685 (0.0008) [2023-12-27 23:27:59,155][106225] Updated weights for policy 1, policy_version 589695 (0.0007) [2023-12-27 23:27:59,211][106225] Updated weights for policy 1, policy_version 589705 (0.0006) [2023-12-27 23:27:59,551][106226] Updated weights for policy 0, policy_version 587667 (0.0009) [2023-12-27 23:27:59,618][106226] Updated weights for policy 0, policy_version 587677 (0.0008) [2023-12-27 23:27:59,683][106226] Updated weights for policy 0, policy_version 587687 (0.0008) [2023-12-27 23:27:59,981][106225] Updated weights for policy 1, policy_version 589715 (0.0008) [2023-12-27 23:28:00,041][106225] Updated weights for policy 1, policy_version 589725 (0.0006) [2023-12-27 23:28:00,092][106225] Updated weights for policy 1, policy_version 589735 (0.0007) [2023-12-27 23:28:00,391][106226] Updated weights for policy 0, policy_version 587697 (0.0008) [2023-12-27 23:28:00,450][106226] Updated weights for policy 0, policy_version 587707 (0.0009) [2023-12-27 23:28:00,534][106226] Updated weights for policy 0, policy_version 587717 (0.0009) [2023-12-27 23:28:00,591][106226] Updated weights for policy 0, policy_version 587727 (0.0011) [2023-12-27 23:28:00,778][106225] Updated weights for policy 1, policy_version 589745 (0.0009) [2023-12-27 23:28:00,833][106225] Updated weights for policy 1, policy_version 589755 (0.0006) [2023-12-27 23:28:00,887][106225] Updated weights for policy 1, policy_version 589765 (0.0005) [2023-12-27 23:28:00,935][106225] Updated weights for policy 1, policy_version 589775 (0.0005) [2023-12-27 23:28:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 301506560. Throughput: 0: 9930.7, 1: 9952.3. Samples: 301496104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:01,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-5.322')] [2023-12-27 23:28:01,282][106226] Updated weights for policy 0, policy_version 587737 (0.0011) [2023-12-27 23:28:01,337][106226] Updated weights for policy 0, policy_version 587747 (0.0010) [2023-12-27 23:28:01,407][106226] Updated weights for policy 0, policy_version 587757 (0.0010) [2023-12-27 23:28:01,650][106225] Updated weights for policy 1, policy_version 589785 (0.0008) [2023-12-27 23:28:01,706][106225] Updated weights for policy 1, policy_version 589795 (0.0008) [2023-12-27 23:28:01,772][106225] Updated weights for policy 1, policy_version 589805 (0.0008) [2023-12-27 23:28:02,120][106226] Updated weights for policy 0, policy_version 587767 (0.0010) [2023-12-27 23:28:02,182][106226] Updated weights for policy 0, policy_version 587777 (0.0009) [2023-12-27 23:28:02,240][106226] Updated weights for policy 0, policy_version 587787 (0.0008) [2023-12-27 23:28:02,538][106225] Updated weights for policy 1, policy_version 589815 (0.0008) [2023-12-27 23:28:02,583][106225] Updated weights for policy 1, policy_version 589825 (0.0007) [2023-12-27 23:28:02,630][106225] Updated weights for policy 1, policy_version 589835 (0.0008) [2023-12-27 23:28:02,890][106226] Updated weights for policy 0, policy_version 587797 (0.0009) [2023-12-27 23:28:02,948][106226] Updated weights for policy 0, policy_version 587807 (0.0005) [2023-12-27 23:28:03,003][106226] Updated weights for policy 0, policy_version 587817 (0.0005) [2023-12-27 23:28:03,427][106225] Updated weights for policy 1, policy_version 589845 (0.0008) [2023-12-27 23:28:03,473][106225] Updated weights for policy 1, policy_version 589855 (0.0007) [2023-12-27 23:28:03,548][106225] Updated weights for policy 1, policy_version 589865 (0.0007) [2023-12-27 23:28:03,655][106226] Updated weights for policy 0, policy_version 587827 (0.0007) [2023-12-27 23:28:03,720][106226] Updated weights for policy 0, policy_version 587837 (0.0010) [2023-12-27 23:28:03,783][106226] Updated weights for policy 0, policy_version 587847 (0.0010) [2023-12-27 23:28:04,249][106225] Updated weights for policy 1, policy_version 589875 (0.0007) [2023-12-27 23:28:04,302][106225] Updated weights for policy 1, policy_version 589885 (0.0007) [2023-12-27 23:28:04,366][106225] Updated weights for policy 1, policy_version 589895 (0.0006) [2023-12-27 23:28:04,436][106226] Updated weights for policy 0, policy_version 587857 (0.0006) [2023-12-27 23:28:04,503][106226] Updated weights for policy 0, policy_version 587867 (0.0011) [2023-12-27 23:28:04,563][106226] Updated weights for policy 0, policy_version 587877 (0.0010) [2023-12-27 23:28:04,612][106226] Updated weights for policy 0, policy_version 587887 (0.0008) [2023-12-27 23:28:05,095][106225] Updated weights for policy 1, policy_version 589905 (0.0008) [2023-12-27 23:28:05,145][106225] Updated weights for policy 1, policy_version 589915 (0.0008) [2023-12-27 23:28:05,193][106225] Updated weights for policy 1, policy_version 589925 (0.0006) [2023-12-27 23:28:05,238][106226] Updated weights for policy 0, policy_version 587897 (0.0010) [2023-12-27 23:28:05,244][106225] Updated weights for policy 1, policy_version 589935 (0.0005) [2023-12-27 23:28:05,298][106226] Updated weights for policy 0, policy_version 587907 (0.0011) [2023-12-27 23:28:05,357][106226] Updated weights for policy 0, policy_version 587917 (0.0010) [2023-12-27 23:28:05,957][106226] Updated weights for policy 0, policy_version 587927 (0.0008) [2023-12-27 23:28:05,971][106225] Updated weights for policy 1, policy_version 589945 (0.0007) [2023-12-27 23:28:06,020][106226] Updated weights for policy 0, policy_version 587937 (0.0010) [2023-12-27 23:28:06,029][106225] Updated weights for policy 1, policy_version 589955 (0.0007) [2023-12-27 23:28:06,082][106225] Updated weights for policy 1, policy_version 589965 (0.0006) [2023-12-27 23:28:06,083][106226] Updated weights for policy 0, policy_version 587947 (0.0010) [2023-12-27 23:28:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 301613056. Throughput: 0: 9919.7, 1: 9923.8. Samples: 301616100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:06,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.672')] [2023-12-27 23:28:06,760][106226] Updated weights for policy 0, policy_version 587957 (0.0009) [2023-12-27 23:28:06,822][106226] Updated weights for policy 0, policy_version 587967 (0.0007) [2023-12-27 23:28:06,869][106225] Updated weights for policy 1, policy_version 589975 (0.0010) [2023-12-27 23:28:06,881][106226] Updated weights for policy 0, policy_version 587977 (0.0011) [2023-12-27 23:28:06,927][106225] Updated weights for policy 1, policy_version 589985 (0.0010) [2023-12-27 23:28:06,988][106225] Updated weights for policy 1, policy_version 589995 (0.0010) [2023-12-27 23:28:07,586][106226] Updated weights for policy 0, policy_version 587987 (0.0011) [2023-12-27 23:28:07,639][106226] Updated weights for policy 0, policy_version 587997 (0.0010) [2023-12-27 23:28:07,652][106225] Updated weights for policy 1, policy_version 590005 (0.0010) [2023-12-27 23:28:07,695][106226] Updated weights for policy 0, policy_version 588007 (0.0010) [2023-12-27 23:28:07,705][106225] Updated weights for policy 1, policy_version 590015 (0.0007) [2023-12-27 23:28:07,763][106225] Updated weights for policy 1, policy_version 590025 (0.0006) [2023-12-27 23:28:08,274][106225] Updated weights for policy 1, policy_version 590035 (0.0006) [2023-12-27 23:28:08,332][106225] Updated weights for policy 1, policy_version 590045 (0.0007) [2023-12-27 23:28:08,405][106225] Updated weights for policy 1, policy_version 590055 (0.0007) [2023-12-27 23:28:08,427][106226] Updated weights for policy 0, policy_version 588017 (0.0011) [2023-12-27 23:28:08,486][106226] Updated weights for policy 0, policy_version 588027 (0.0011) [2023-12-27 23:28:08,543][106226] Updated weights for policy 0, policy_version 588037 (0.0011) [2023-12-27 23:28:08,600][106226] Updated weights for policy 0, policy_version 588047 (0.0011) [2023-12-27 23:28:09,157][106225] Updated weights for policy 1, policy_version 590065 (0.0006) [2023-12-27 23:28:09,205][106225] Updated weights for policy 1, policy_version 590075 (0.0008) [2023-12-27 23:28:09,265][106226] Updated weights for policy 0, policy_version 588057 (0.0009) [2023-12-27 23:28:09,274][106225] Updated weights for policy 1, policy_version 590085 (0.0008) [2023-12-27 23:28:09,324][106226] Updated weights for policy 0, policy_version 588067 (0.0007) [2023-12-27 23:28:09,354][106225] Updated weights for policy 1, policy_version 590095 (0.0008) [2023-12-27 23:28:09,394][106226] Updated weights for policy 0, policy_version 588077 (0.0007) [2023-12-27 23:28:10,102][106225] Updated weights for policy 1, policy_version 590105 (0.0008) [2023-12-27 23:28:10,145][106226] Updated weights for policy 0, policy_version 588087 (0.0009) [2023-12-27 23:28:10,166][106225] Updated weights for policy 1, policy_version 590115 (0.0006) [2023-12-27 23:28:10,213][106226] Updated weights for policy 0, policy_version 588097 (0.0009) [2023-12-27 23:28:10,231][106225] Updated weights for policy 1, policy_version 590125 (0.0007) [2023-12-27 23:28:10,284][106226] Updated weights for policy 0, policy_version 588107 (0.0009) [2023-12-27 23:28:10,844][106225] Updated weights for policy 1, policy_version 590135 (0.0006) [2023-12-27 23:28:10,901][106225] Updated weights for policy 1, policy_version 590145 (0.0005) [2023-12-27 23:28:10,964][106225] Updated weights for policy 1, policy_version 590155 (0.0009) [2023-12-27 23:28:11,046][106226] Updated weights for policy 0, policy_version 588117 (0.0009) [2023-12-27 23:28:11,114][106226] Updated weights for policy 0, policy_version 588127 (0.0008) [2023-12-27 23:28:11,175][106226] Updated weights for policy 0, policy_version 588137 (0.0008) [2023-12-27 23:28:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 301703168. Throughput: 0: 9967.0, 1: 9972.0. Samples: 301676988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:11,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.470')] [2023-12-27 23:28:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000590160_151109632.pth... [2023-12-27 23:28:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000589008_150814720.pth [2023-12-27 23:28:11,216][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000588144_150601728.pth... [2023-12-27 23:28:11,220][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000586960_150298624.pth [2023-12-27 23:28:11,794][106225] Updated weights for policy 1, policy_version 590165 (0.0009) [2023-12-27 23:28:11,859][106226] Updated weights for policy 0, policy_version 588147 (0.0009) [2023-12-27 23:28:11,861][106225] Updated weights for policy 1, policy_version 590175 (0.0007) [2023-12-27 23:28:11,924][106226] Updated weights for policy 0, policy_version 588157 (0.0011) [2023-12-27 23:28:11,926][106225] Updated weights for policy 1, policy_version 590185 (0.0006) [2023-12-27 23:28:11,979][106226] Updated weights for policy 0, policy_version 588167 (0.0009) [2023-12-27 23:28:12,655][106225] Updated weights for policy 1, policy_version 590195 (0.0007) [2023-12-27 23:28:12,701][106226] Updated weights for policy 0, policy_version 588177 (0.0009) [2023-12-27 23:28:12,712][106225] Updated weights for policy 1, policy_version 590205 (0.0008) [2023-12-27 23:28:12,757][106226] Updated weights for policy 0, policy_version 588187 (0.0006) [2023-12-27 23:28:12,778][106225] Updated weights for policy 1, policy_version 590215 (0.0007) [2023-12-27 23:28:12,819][106226] Updated weights for policy 0, policy_version 588197 (0.0008) [2023-12-27 23:28:12,873][106226] Updated weights for policy 0, policy_version 588207 (0.0007) [2023-12-27 23:28:13,446][106225] Updated weights for policy 1, policy_version 590225 (0.0007) [2023-12-27 23:28:13,498][106225] Updated weights for policy 1, policy_version 590235 (0.0007) [2023-12-27 23:28:13,548][106225] Updated weights for policy 1, policy_version 590245 (0.0007) [2023-12-27 23:28:13,600][106225] Updated weights for policy 1, policy_version 590255 (0.0007) [2023-12-27 23:28:13,610][106226] Updated weights for policy 0, policy_version 588217 (0.0006) [2023-12-27 23:28:13,674][106226] Updated weights for policy 0, policy_version 588227 (0.0009) [2023-12-27 23:28:13,735][106226] Updated weights for policy 0, policy_version 588237 (0.0008) [2023-12-27 23:28:14,261][106225] Updated weights for policy 1, policy_version 590265 (0.0007) [2023-12-27 23:28:14,326][106225] Updated weights for policy 1, policy_version 590275 (0.0009) [2023-12-27 23:28:14,390][106225] Updated weights for policy 1, policy_version 590285 (0.0008) [2023-12-27 23:28:14,452][106226] Updated weights for policy 0, policy_version 588247 (0.0008) [2023-12-27 23:28:14,516][106226] Updated weights for policy 0, policy_version 588257 (0.0008) [2023-12-27 23:28:14,573][106226] Updated weights for policy 0, policy_version 588267 (0.0008) [2023-12-27 23:28:15,081][106225] Updated weights for policy 1, policy_version 590295 (0.0007) [2023-12-27 23:28:15,142][106225] Updated weights for policy 1, policy_version 590305 (0.0006) [2023-12-27 23:28:15,204][106225] Updated weights for policy 1, policy_version 590315 (0.0005) [2023-12-27 23:28:15,308][106226] Updated weights for policy 0, policy_version 588277 (0.0008) [2023-12-27 23:28:15,364][106226] Updated weights for policy 0, policy_version 588287 (0.0009) [2023-12-27 23:28:15,412][106226] Updated weights for policy 0, policy_version 588297 (0.0008) [2023-12-27 23:28:15,908][106225] Updated weights for policy 1, policy_version 590325 (0.0007) [2023-12-27 23:28:15,967][106225] Updated weights for policy 1, policy_version 590335 (0.0008) [2023-12-27 23:28:16,026][106225] Updated weights for policy 1, policy_version 590345 (0.0008) [2023-12-27 23:28:16,132][106226] Updated weights for policy 0, policy_version 588307 (0.0008) [2023-12-27 23:28:16,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 301801472. Throughput: 0: 9800.3, 1: 9934.0. Samples: 301791820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:16,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.491')] [2023-12-27 23:28:16,189][106226] Updated weights for policy 0, policy_version 588317 (0.0008) [2023-12-27 23:28:16,244][106226] Updated weights for policy 0, policy_version 588327 (0.0008) [2023-12-27 23:28:16,738][106225] Updated weights for policy 1, policy_version 590355 (0.0009) [2023-12-27 23:28:16,788][106225] Updated weights for policy 1, policy_version 590365 (0.0008) [2023-12-27 23:28:16,843][106225] Updated weights for policy 1, policy_version 590375 (0.0008) [2023-12-27 23:28:16,963][106226] Updated weights for policy 0, policy_version 588337 (0.0009) [2023-12-27 23:28:17,011][106226] Updated weights for policy 0, policy_version 588347 (0.0009) [2023-12-27 23:28:17,059][106226] Updated weights for policy 0, policy_version 588357 (0.0008) [2023-12-27 23:28:17,108][106226] Updated weights for policy 0, policy_version 588367 (0.0008) [2023-12-27 23:28:17,578][106225] Updated weights for policy 1, policy_version 590385 (0.0008) [2023-12-27 23:28:17,630][106225] Updated weights for policy 1, policy_version 590395 (0.0009) [2023-12-27 23:28:17,689][106225] Updated weights for policy 1, policy_version 590405 (0.0008) [2023-12-27 23:28:17,740][106225] Updated weights for policy 1, policy_version 590415 (0.0009) [2023-12-27 23:28:17,858][106226] Updated weights for policy 0, policy_version 588377 (0.0007) [2023-12-27 23:28:17,904][106226] Updated weights for policy 0, policy_version 588387 (0.0008) [2023-12-27 23:28:17,953][106226] Updated weights for policy 0, policy_version 588397 (0.0008) [2023-12-27 23:28:18,415][106225] Updated weights for policy 1, policy_version 590425 (0.0007) [2023-12-27 23:28:18,477][106225] Updated weights for policy 1, policy_version 590435 (0.0005) [2023-12-27 23:28:18,536][106225] Updated weights for policy 1, policy_version 590445 (0.0009) [2023-12-27 23:28:18,726][106226] Updated weights for policy 0, policy_version 588407 (0.0007) [2023-12-27 23:28:18,790][106226] Updated weights for policy 0, policy_version 588417 (0.0005) [2023-12-27 23:28:18,858][106226] Updated weights for policy 0, policy_version 588427 (0.0010) [2023-12-27 23:28:19,296][106225] Updated weights for policy 1, policy_version 590455 (0.0008) [2023-12-27 23:28:19,369][106225] Updated weights for policy 1, policy_version 590465 (0.0008) [2023-12-27 23:28:19,436][106225] Updated weights for policy 1, policy_version 590475 (0.0008) [2023-12-27 23:28:19,488][106226] Updated weights for policy 0, policy_version 588437 (0.0007) [2023-12-27 23:28:19,551][106226] Updated weights for policy 0, policy_version 588447 (0.0007) [2023-12-27 23:28:19,621][106226] Updated weights for policy 0, policy_version 588457 (0.0010) [2023-12-27 23:28:20,230][106225] Updated weights for policy 1, policy_version 590485 (0.0009) [2023-12-27 23:28:20,289][106225] Updated weights for policy 1, policy_version 590495 (0.0009) [2023-12-27 23:28:20,329][106226] Updated weights for policy 0, policy_version 588467 (0.0011) [2023-12-27 23:28:20,349][106225] Updated weights for policy 1, policy_version 590505 (0.0009) [2023-12-27 23:28:20,389][106226] Updated weights for policy 0, policy_version 588477 (0.0011) [2023-12-27 23:28:20,451][106226] Updated weights for policy 0, policy_version 588487 (0.0011) [2023-12-27 23:28:21,080][106225] Updated weights for policy 1, policy_version 590515 (0.0008) [2023-12-27 23:28:21,143][106225] Updated weights for policy 1, policy_version 590525 (0.0010) [2023-12-27 23:28:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 301891584. Throughput: 0: 9791.9, 1: 9872.8. Samples: 301907060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:21,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-5.643')] [2023-12-27 23:28:21,210][106225] Updated weights for policy 1, policy_version 590535 (0.0011) [2023-12-27 23:28:21,213][106226] Updated weights for policy 0, policy_version 588497 (0.0007) [2023-12-27 23:28:21,301][106226] Updated weights for policy 0, policy_version 588507 (0.0008) [2023-12-27 23:28:21,371][106226] Updated weights for policy 0, policy_version 588517 (0.0008) [2023-12-27 23:28:21,434][106226] Updated weights for policy 0, policy_version 588527 (0.0006) [2023-12-27 23:28:22,019][106225] Updated weights for policy 1, policy_version 590545 (0.0009) [2023-12-27 23:28:22,063][106226] Updated weights for policy 0, policy_version 588537 (0.0009) [2023-12-27 23:28:22,085][106225] Updated weights for policy 1, policy_version 590555 (0.0007) [2023-12-27 23:28:22,123][106226] Updated weights for policy 0, policy_version 588547 (0.0007) [2023-12-27 23:28:22,143][106225] Updated weights for policy 1, policy_version 590565 (0.0007) [2023-12-27 23:28:22,184][106226] Updated weights for policy 0, policy_version 588557 (0.0006) [2023-12-27 23:28:22,202][106225] Updated weights for policy 1, policy_version 590575 (0.0007) [2023-12-27 23:28:22,922][106226] Updated weights for policy 0, policy_version 588567 (0.0007) [2023-12-27 23:28:22,970][106225] Updated weights for policy 1, policy_version 590585 (0.0007) [2023-12-27 23:28:22,984][106226] Updated weights for policy 0, policy_version 588577 (0.0009) [2023-12-27 23:28:23,036][106225] Updated weights for policy 1, policy_version 590595 (0.0008) [2023-12-27 23:28:23,044][106226] Updated weights for policy 0, policy_version 588587 (0.0006) [2023-12-27 23:28:23,094][106225] Updated weights for policy 1, policy_version 590605 (0.0009) [2023-12-27 23:28:23,665][106226] Updated weights for policy 0, policy_version 588597 (0.0008) [2023-12-27 23:28:23,725][106226] Updated weights for policy 0, policy_version 588607 (0.0010) [2023-12-27 23:28:23,774][106226] Updated weights for policy 0, policy_version 588617 (0.0010) [2023-12-27 23:28:23,822][106225] Updated weights for policy 1, policy_version 590615 (0.0007) [2023-12-27 23:28:23,870][106225] Updated weights for policy 1, policy_version 590625 (0.0009) [2023-12-27 23:28:23,920][106225] Updated weights for policy 1, policy_version 590635 (0.0008) [2023-12-27 23:28:24,404][106226] Updated weights for policy 0, policy_version 588627 (0.0009) [2023-12-27 23:28:24,451][106226] Updated weights for policy 0, policy_version 588637 (0.0007) [2023-12-27 23:28:24,500][106226] Updated weights for policy 0, policy_version 588647 (0.0005) [2023-12-27 23:28:24,706][106225] Updated weights for policy 1, policy_version 590645 (0.0009) [2023-12-27 23:28:24,756][106225] Updated weights for policy 1, policy_version 590655 (0.0007) [2023-12-27 23:28:24,806][106225] Updated weights for policy 1, policy_version 590665 (0.0009) [2023-12-27 23:28:25,071][106226] Updated weights for policy 0, policy_version 588657 (0.0005) [2023-12-27 23:28:25,122][106226] Updated weights for policy 0, policy_version 588667 (0.0006) [2023-12-27 23:28:25,185][106226] Updated weights for policy 0, policy_version 588677 (0.0006) [2023-12-27 23:28:25,243][106226] Updated weights for policy 0, policy_version 588687 (0.0009) [2023-12-27 23:28:25,624][106225] Updated weights for policy 1, policy_version 590675 (0.0009) [2023-12-27 23:28:25,672][106225] Updated weights for policy 1, policy_version 590685 (0.0008) [2023-12-27 23:28:25,717][106225] Updated weights for policy 1, policy_version 590695 (0.0008) [2023-12-27 23:28:25,907][106226] Updated weights for policy 0, policy_version 588697 (0.0009) [2023-12-27 23:28:25,967][106226] Updated weights for policy 0, policy_version 588707 (0.0008) [2023-12-27 23:28:26,020][106226] Updated weights for policy 0, policy_version 588717 (0.0008) [2023-12-27 23:28:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 301998080. Throughput: 0: 9870.2, 1: 9787.2. Samples: 301965320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:26,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.728')] [2023-12-27 23:28:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000590704_151248896.pth... [2023-12-27 23:28:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000588720_150749184.pth... [2023-12-27 23:28:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000589584_150962176.pth [2023-12-27 23:28:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000587536_150446080.pth [2023-12-27 23:28:26,416][106225] Updated weights for policy 1, policy_version 590705 (0.0008) [2023-12-27 23:28:26,479][106225] Updated weights for policy 1, policy_version 590715 (0.0009) [2023-12-27 23:28:26,540][106225] Updated weights for policy 1, policy_version 590725 (0.0010) [2023-12-27 23:28:26,595][106225] Updated weights for policy 1, policy_version 590735 (0.0010) [2023-12-27 23:28:26,658][106226] Updated weights for policy 0, policy_version 588727 (0.0007) [2023-12-27 23:28:26,723][106226] Updated weights for policy 0, policy_version 588737 (0.0008) [2023-12-27 23:28:26,780][106226] Updated weights for policy 0, policy_version 588747 (0.0008) [2023-12-27 23:28:27,187][106225] Updated weights for policy 1, policy_version 590745 (0.0006) [2023-12-27 23:28:27,241][106225] Updated weights for policy 1, policy_version 590755 (0.0005) [2023-12-27 23:28:27,290][106225] Updated weights for policy 1, policy_version 590765 (0.0006) [2023-12-27 23:28:27,332][106226] Updated weights for policy 0, policy_version 588757 (0.0009) [2023-12-27 23:28:27,382][106226] Updated weights for policy 0, policy_version 588767 (0.0010) [2023-12-27 23:28:27,448][106226] Updated weights for policy 0, policy_version 588777 (0.0010) [2023-12-27 23:28:27,838][106225] Updated weights for policy 1, policy_version 590775 (0.0006) [2023-12-27 23:28:27,884][106225] Updated weights for policy 1, policy_version 590785 (0.0005) [2023-12-27 23:28:27,943][106225] Updated weights for policy 1, policy_version 590795 (0.0005) [2023-12-27 23:28:28,051][106226] Updated weights for policy 0, policy_version 588787 (0.0009) [2023-12-27 23:28:28,100][106226] Updated weights for policy 0, policy_version 588797 (0.0005) [2023-12-27 23:28:28,150][106226] Updated weights for policy 0, policy_version 588807 (0.0005) [2023-12-27 23:28:28,492][106225] Updated weights for policy 1, policy_version 590805 (0.0008) [2023-12-27 23:28:28,539][106225] Updated weights for policy 1, policy_version 590815 (0.0010) [2023-12-27 23:28:28,588][106225] Updated weights for policy 1, policy_version 590825 (0.0010) [2023-12-27 23:28:28,797][106226] Updated weights for policy 0, policy_version 588817 (0.0006) [2023-12-27 23:28:28,848][106226] Updated weights for policy 0, policy_version 588827 (0.0010) [2023-12-27 23:28:28,898][106226] Updated weights for policy 0, policy_version 588837 (0.0010) [2023-12-27 23:28:28,954][106226] Updated weights for policy 0, policy_version 588847 (0.0010) [2023-12-27 23:28:29,342][106225] Updated weights for policy 1, policy_version 590835 (0.0010) [2023-12-27 23:28:29,406][106225] Updated weights for policy 1, policy_version 590845 (0.0011) [2023-12-27 23:28:29,471][106225] Updated weights for policy 1, policy_version 590855 (0.0010) [2023-12-27 23:28:29,661][106226] Updated weights for policy 0, policy_version 588857 (0.0009) [2023-12-27 23:28:29,713][106226] Updated weights for policy 0, policy_version 588867 (0.0007) [2023-12-27 23:28:29,764][106226] Updated weights for policy 0, policy_version 588877 (0.0007) [2023-12-27 23:28:30,192][106225] Updated weights for policy 1, policy_version 590865 (0.0010) [2023-12-27 23:28:30,250][106225] Updated weights for policy 1, policy_version 590875 (0.0009) [2023-12-27 23:28:30,300][106225] Updated weights for policy 1, policy_version 590885 (0.0010) [2023-12-27 23:28:30,367][106225] Updated weights for policy 1, policy_version 590895 (0.0010) [2023-12-27 23:28:30,413][106226] Updated weights for policy 0, policy_version 588887 (0.0008) [2023-12-27 23:28:30,467][106226] Updated weights for policy 0, policy_version 588897 (0.0008) [2023-12-27 23:28:30,517][106226] Updated weights for policy 0, policy_version 588907 (0.0009) [2023-12-27 23:28:30,950][106225] Updated weights for policy 1, policy_version 590905 (0.0006) [2023-12-27 23:28:31,003][106225] Updated weights for policy 1, policy_version 590915 (0.0005) [2023-12-27 23:28:31,072][106225] Updated weights for policy 1, policy_version 590925 (0.0007) [2023-12-27 23:28:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 302104576. Throughput: 0: 10095.6, 1: 9835.7. Samples: 302091944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:31,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.712')] [2023-12-27 23:28:31,279][106226] Updated weights for policy 0, policy_version 588917 (0.0008) [2023-12-27 23:28:31,340][106226] Updated weights for policy 0, policy_version 588927 (0.0009) [2023-12-27 23:28:31,410][106226] Updated weights for policy 0, policy_version 588937 (0.0008) [2023-12-27 23:28:31,661][106225] Updated weights for policy 1, policy_version 590935 (0.0008) [2023-12-27 23:28:31,724][106225] Updated weights for policy 1, policy_version 590945 (0.0009) [2023-12-27 23:28:31,782][106225] Updated weights for policy 1, policy_version 590955 (0.0007) [2023-12-27 23:28:32,236][106226] Updated weights for policy 0, policy_version 588947 (0.0009) [2023-12-27 23:28:32,291][106226] Updated weights for policy 0, policy_version 588957 (0.0009) [2023-12-27 23:28:32,349][106226] Updated weights for policy 0, policy_version 588967 (0.0008) [2023-12-27 23:28:32,429][106225] Updated weights for policy 1, policy_version 590965 (0.0009) [2023-12-27 23:28:32,491][106225] Updated weights for policy 1, policy_version 590975 (0.0007) [2023-12-27 23:28:32,550][106225] Updated weights for policy 1, policy_version 590985 (0.0007) [2023-12-27 23:28:33,134][106226] Updated weights for policy 0, policy_version 588977 (0.0009) [2023-12-27 23:28:33,147][106225] Updated weights for policy 1, policy_version 590995 (0.0007) [2023-12-27 23:28:33,197][106226] Updated weights for policy 0, policy_version 588987 (0.0008) [2023-12-27 23:28:33,203][106225] Updated weights for policy 1, policy_version 591005 (0.0005) [2023-12-27 23:28:33,260][106225] Updated weights for policy 1, policy_version 591015 (0.0006) [2023-12-27 23:28:33,261][106226] Updated weights for policy 0, policy_version 588997 (0.0008) [2023-12-27 23:28:33,334][106226] Updated weights for policy 0, policy_version 589007 (0.0008) [2023-12-27 23:28:33,891][106225] Updated weights for policy 1, policy_version 591025 (0.0006) [2023-12-27 23:28:33,937][106225] Updated weights for policy 1, policy_version 591035 (0.0005) [2023-12-27 23:28:33,993][106225] Updated weights for policy 1, policy_version 591045 (0.0005) [2023-12-27 23:28:33,994][106226] Updated weights for policy 0, policy_version 589017 (0.0008) [2023-12-27 23:28:34,048][106225] Updated weights for policy 1, policy_version 591055 (0.0005) [2023-12-27 23:28:34,050][106226] Updated weights for policy 0, policy_version 589027 (0.0008) [2023-12-27 23:28:34,103][106226] Updated weights for policy 0, policy_version 589037 (0.0009) [2023-12-27 23:28:34,648][106225] Updated weights for policy 1, policy_version 591065 (0.0005) [2023-12-27 23:28:34,711][106225] Updated weights for policy 1, policy_version 591075 (0.0006) [2023-12-27 23:28:34,766][106225] Updated weights for policy 1, policy_version 591085 (0.0005) [2023-12-27 23:28:34,924][106226] Updated weights for policy 0, policy_version 589047 (0.0007) [2023-12-27 23:28:34,978][106226] Updated weights for policy 0, policy_version 589057 (0.0005) [2023-12-27 23:28:35,033][106226] Updated weights for policy 0, policy_version 589067 (0.0005) [2023-12-27 23:28:35,384][106225] Updated weights for policy 1, policy_version 591095 (0.0009) [2023-12-27 23:28:35,429][106225] Updated weights for policy 1, policy_version 591105 (0.0007) [2023-12-27 23:28:35,477][106225] Updated weights for policy 1, policy_version 591115 (0.0010) [2023-12-27 23:28:35,567][106226] Updated weights for policy 0, policy_version 589077 (0.0007) [2023-12-27 23:28:35,613][106226] Updated weights for policy 0, policy_version 589087 (0.0006) [2023-12-27 23:28:35,666][106226] Updated weights for policy 0, policy_version 589097 (0.0005) [2023-12-27 23:28:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 302202880. Throughput: 0: 10035.1, 1: 9989.2. Samples: 302215412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:36,175][105115] Avg episode reward: [(0, '-4.888'), (1, '-5.364')] [2023-12-27 23:28:36,205][106225] Updated weights for policy 1, policy_version 591125 (0.0010) [2023-12-27 23:28:36,268][106225] Updated weights for policy 1, policy_version 591135 (0.0010) [2023-12-27 23:28:36,326][106226] Updated weights for policy 0, policy_version 589107 (0.0005) [2023-12-27 23:28:36,337][106225] Updated weights for policy 1, policy_version 591145 (0.0010) [2023-12-27 23:28:36,386][106226] Updated weights for policy 0, policy_version 589117 (0.0007) [2023-12-27 23:28:36,462][106226] Updated weights for policy 0, policy_version 589127 (0.0009) [2023-12-27 23:28:37,000][106225] Updated weights for policy 1, policy_version 591155 (0.0007) [2023-12-27 23:28:37,049][106225] Updated weights for policy 1, policy_version 591165 (0.0008) [2023-12-27 23:28:37,099][106225] Updated weights for policy 1, policy_version 591175 (0.0007) [2023-12-27 23:28:37,210][106226] Updated weights for policy 0, policy_version 589137 (0.0008) [2023-12-27 23:28:37,263][106226] Updated weights for policy 0, policy_version 589147 (0.0006) [2023-12-27 23:28:37,325][106226] Updated weights for policy 0, policy_version 589157 (0.0008) [2023-12-27 23:28:37,388][106226] Updated weights for policy 0, policy_version 589167 (0.0006) [2023-12-27 23:28:37,883][106225] Updated weights for policy 1, policy_version 591185 (0.0006) [2023-12-27 23:28:37,941][106225] Updated weights for policy 1, policy_version 591195 (0.0008) [2023-12-27 23:28:37,942][106226] Updated weights for policy 0, policy_version 589177 (0.0006) [2023-12-27 23:28:37,989][106225] Updated weights for policy 1, policy_version 591205 (0.0008) [2023-12-27 23:28:37,991][106226] Updated weights for policy 0, policy_version 589187 (0.0006) [2023-12-27 23:28:38,047][106226] Updated weights for policy 0, policy_version 589197 (0.0006) [2023-12-27 23:28:38,049][106225] Updated weights for policy 1, policy_version 591215 (0.0009) [2023-12-27 23:28:38,722][106225] Updated weights for policy 1, policy_version 591225 (0.0005) [2023-12-27 23:28:38,748][106226] Updated weights for policy 0, policy_version 589207 (0.0007) [2023-12-27 23:28:38,788][106225] Updated weights for policy 1, policy_version 591235 (0.0006) [2023-12-27 23:28:38,802][106226] Updated weights for policy 0, policy_version 589217 (0.0008) [2023-12-27 23:28:38,852][106225] Updated weights for policy 1, policy_version 591245 (0.0005) [2023-12-27 23:28:38,864][106226] Updated weights for policy 0, policy_version 589227 (0.0008) [2023-12-27 23:28:39,565][106225] Updated weights for policy 1, policy_version 591255 (0.0007) [2023-12-27 23:28:39,623][106225] Updated weights for policy 1, policy_version 591265 (0.0008) [2023-12-27 23:28:39,661][106226] Updated weights for policy 0, policy_version 589237 (0.0010) [2023-12-27 23:28:39,672][106225] Updated weights for policy 1, policy_version 591275 (0.0006) [2023-12-27 23:28:39,713][106226] Updated weights for policy 0, policy_version 589247 (0.0011) [2023-12-27 23:28:39,774][106226] Updated weights for policy 0, policy_version 589257 (0.0010) [2023-12-27 23:28:40,445][106225] Updated weights for policy 1, policy_version 591285 (0.0008) [2023-12-27 23:28:40,500][106225] Updated weights for policy 1, policy_version 591295 (0.0010) [2023-12-27 23:28:40,508][106226] Updated weights for policy 0, policy_version 589267 (0.0011) [2023-12-27 23:28:40,556][106225] Updated weights for policy 1, policy_version 591305 (0.0007) [2023-12-27 23:28:40,565][106226] Updated weights for policy 0, policy_version 589277 (0.0011) [2023-12-27 23:28:40,615][106226] Updated weights for policy 0, policy_version 589287 (0.0010) [2023-12-27 23:28:41,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 302301184. Throughput: 0: 10078.1, 1: 9979.1. Samples: 302275840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:41,175][105115] Avg episode reward: [(0, '-5.052'), (1, '-5.482')] [2023-12-27 23:28:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000589296_150896640.pth... [2023-12-27 23:28:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000591312_151404544.pth... [2023-12-27 23:28:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000588144_150601728.pth [2023-12-27 23:28:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000590160_151109632.pth [2023-12-27 23:28:41,286][106225] Updated weights for policy 1, policy_version 591315 (0.0006) [2023-12-27 23:28:41,312][106226] Updated weights for policy 0, policy_version 589297 (0.0010) [2023-12-27 23:28:41,348][106225] Updated weights for policy 1, policy_version 591325 (0.0009) [2023-12-27 23:28:41,379][106226] Updated weights for policy 0, policy_version 589307 (0.0010) [2023-12-27 23:28:41,423][106225] Updated weights for policy 1, policy_version 591335 (0.0009) [2023-12-27 23:28:41,446][106226] Updated weights for policy 0, policy_version 589317 (0.0009) [2023-12-27 23:28:41,508][106226] Updated weights for policy 0, policy_version 589327 (0.0009) [2023-12-27 23:28:42,171][106225] Updated weights for policy 1, policy_version 591345 (0.0010) [2023-12-27 23:28:42,231][106225] Updated weights for policy 1, policy_version 591355 (0.0009) [2023-12-27 23:28:42,249][106226] Updated weights for policy 0, policy_version 589337 (0.0006) [2023-12-27 23:28:42,296][106225] Updated weights for policy 1, policy_version 591365 (0.0006) [2023-12-27 23:28:42,321][106226] Updated weights for policy 0, policy_version 589347 (0.0008) [2023-12-27 23:28:42,363][106225] Updated weights for policy 1, policy_version 591375 (0.0009) [2023-12-27 23:28:42,393][106226] Updated weights for policy 0, policy_version 589357 (0.0010) [2023-12-27 23:28:43,084][106225] Updated weights for policy 1, policy_version 591385 (0.0008) [2023-12-27 23:28:43,109][106226] Updated weights for policy 0, policy_version 589367 (0.0009) [2023-12-27 23:28:43,150][106225] Updated weights for policy 1, policy_version 591395 (0.0008) [2023-12-27 23:28:43,163][106226] Updated weights for policy 0, policy_version 589377 (0.0006) [2023-12-27 23:28:43,216][106225] Updated weights for policy 1, policy_version 591405 (0.0008) [2023-12-27 23:28:43,222][106226] Updated weights for policy 0, policy_version 589387 (0.0006) [2023-12-27 23:28:43,908][106226] Updated weights for policy 0, policy_version 589397 (0.0007) [2023-12-27 23:28:43,916][106225] Updated weights for policy 1, policy_version 591415 (0.0006) [2023-12-27 23:28:43,965][106226] Updated weights for policy 0, policy_version 589407 (0.0008) [2023-12-27 23:28:43,981][106225] Updated weights for policy 1, policy_version 591425 (0.0005) [2023-12-27 23:28:44,025][106226] Updated weights for policy 0, policy_version 589417 (0.0008) [2023-12-27 23:28:44,028][106225] Updated weights for policy 1, policy_version 591435 (0.0005) [2023-12-27 23:28:44,636][106225] Updated weights for policy 1, policy_version 591445 (0.0006) [2023-12-27 23:28:44,697][106225] Updated weights for policy 1, policy_version 591455 (0.0005) [2023-12-27 23:28:44,775][106225] Updated weights for policy 1, policy_version 591465 (0.0006) [2023-12-27 23:28:44,823][106226] Updated weights for policy 0, policy_version 589427 (0.0008) [2023-12-27 23:28:44,891][106226] Updated weights for policy 0, policy_version 589437 (0.0007) [2023-12-27 23:28:44,955][106226] Updated weights for policy 0, policy_version 589447 (0.0007) [2023-12-27 23:28:45,367][106225] Updated weights for policy 1, policy_version 591475 (0.0006) [2023-12-27 23:28:45,427][106225] Updated weights for policy 1, policy_version 591485 (0.0007) [2023-12-27 23:28:45,492][106225] Updated weights for policy 1, policy_version 591495 (0.0008) [2023-12-27 23:28:45,726][106226] Updated weights for policy 0, policy_version 589457 (0.0007) [2023-12-27 23:28:45,779][106226] Updated weights for policy 0, policy_version 589467 (0.0008) [2023-12-27 23:28:45,828][106226] Updated weights for policy 0, policy_version 589477 (0.0007) [2023-12-27 23:28:45,888][106226] Updated weights for policy 0, policy_version 589487 (0.0008) [2023-12-27 23:28:46,090][106225] Updated weights for policy 1, policy_version 591505 (0.0008) [2023-12-27 23:28:46,144][106225] Updated weights for policy 1, policy_version 591515 (0.0005) [2023-12-27 23:28:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 302399488. Throughput: 0: 9969.7, 1: 9905.0. Samples: 302390464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:46,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-5.803')] [2023-12-27 23:28:46,195][106225] Updated weights for policy 1, policy_version 591525 (0.0007) [2023-12-27 23:28:46,244][106225] Updated weights for policy 1, policy_version 591535 (0.0008) [2023-12-27 23:28:46,589][106226] Updated weights for policy 0, policy_version 589497 (0.0005) [2023-12-27 23:28:46,647][106226] Updated weights for policy 0, policy_version 589507 (0.0005) [2023-12-27 23:28:46,698][106226] Updated weights for policy 0, policy_version 589517 (0.0006) [2023-12-27 23:28:47,011][106225] Updated weights for policy 1, policy_version 591545 (0.0010) [2023-12-27 23:28:47,072][106225] Updated weights for policy 1, policy_version 591555 (0.0010) [2023-12-27 23:28:47,133][106225] Updated weights for policy 1, policy_version 591565 (0.0011) [2023-12-27 23:28:47,226][106226] Updated weights for policy 0, policy_version 589527 (0.0005) [2023-12-27 23:28:47,288][106226] Updated weights for policy 0, policy_version 589537 (0.0005) [2023-12-27 23:28:47,346][106226] Updated weights for policy 0, policy_version 589547 (0.0006) [2023-12-27 23:28:47,839][106225] Updated weights for policy 1, policy_version 591575 (0.0008) [2023-12-27 23:28:47,852][106226] Updated weights for policy 0, policy_version 589557 (0.0008) [2023-12-27 23:28:47,899][106225] Updated weights for policy 1, policy_version 591585 (0.0005) [2023-12-27 23:28:47,909][106226] Updated weights for policy 0, policy_version 589567 (0.0010) [2023-12-27 23:28:47,955][106225] Updated weights for policy 1, policy_version 591595 (0.0005) [2023-12-27 23:28:47,964][106226] Updated weights for policy 0, policy_version 589577 (0.0009) [2023-12-27 23:28:48,496][106225] Updated weights for policy 1, policy_version 591605 (0.0005) [2023-12-27 23:28:48,545][106225] Updated weights for policy 1, policy_version 591615 (0.0006) [2023-12-27 23:28:48,580][106226] Updated weights for policy 0, policy_version 589587 (0.0007) [2023-12-27 23:28:48,594][106225] Updated weights for policy 1, policy_version 591625 (0.0007) [2023-12-27 23:28:48,641][106226] Updated weights for policy 0, policy_version 589597 (0.0010) [2023-12-27 23:28:48,698][106226] Updated weights for policy 0, policy_version 589607 (0.0011) [2023-12-27 23:28:49,327][106225] Updated weights for policy 1, policy_version 591635 (0.0008) [2023-12-27 23:28:49,398][106225] Updated weights for policy 1, policy_version 591645 (0.0007) [2023-12-27 23:28:49,400][106226] Updated weights for policy 0, policy_version 589617 (0.0010) [2023-12-27 23:28:49,457][106225] Updated weights for policy 1, policy_version 591655 (0.0006) [2023-12-27 23:28:49,462][106226] Updated weights for policy 0, policy_version 589627 (0.0007) [2023-12-27 23:28:49,521][106226] Updated weights for policy 0, policy_version 589637 (0.0009) [2023-12-27 23:28:49,584][106226] Updated weights for policy 0, policy_version 589647 (0.0009) [2023-12-27 23:28:50,165][106225] Updated weights for policy 1, policy_version 591665 (0.0006) [2023-12-27 23:28:50,226][106225] Updated weights for policy 1, policy_version 591675 (0.0008) [2023-12-27 23:28:50,290][106225] Updated weights for policy 1, policy_version 591685 (0.0009) [2023-12-27 23:28:50,350][106225] Updated weights for policy 1, policy_version 591695 (0.0008) [2023-12-27 23:28:50,366][106226] Updated weights for policy 0, policy_version 589657 (0.0008) [2023-12-27 23:28:50,426][106226] Updated weights for policy 0, policy_version 589667 (0.0009) [2023-12-27 23:28:50,489][106226] Updated weights for policy 0, policy_version 589677 (0.0009) [2023-12-27 23:28:51,084][106225] Updated weights for policy 1, policy_version 591705 (0.0007) [2023-12-27 23:28:51,154][106225] Updated weights for policy 1, policy_version 591715 (0.0009) [2023-12-27 23:28:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 302497792. Throughput: 0: 9969.9, 1: 9983.4. Samples: 302513996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:51,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.314')] [2023-12-27 23:28:51,222][106225] Updated weights for policy 1, policy_version 591725 (0.0009) [2023-12-27 23:28:51,229][106226] Updated weights for policy 0, policy_version 589687 (0.0008) [2023-12-27 23:28:51,299][106226] Updated weights for policy 0, policy_version 589697 (0.0010) [2023-12-27 23:28:51,368][106226] Updated weights for policy 0, policy_version 589707 (0.0008) [2023-12-27 23:28:51,996][106225] Updated weights for policy 1, policy_version 591735 (0.0009) [2023-12-27 23:28:52,031][106226] Updated weights for policy 0, policy_version 589717 (0.0008) [2023-12-27 23:28:52,053][106225] Updated weights for policy 1, policy_version 591745 (0.0007) [2023-12-27 23:28:52,094][106226] Updated weights for policy 0, policy_version 589727 (0.0006) [2023-12-27 23:28:52,114][106225] Updated weights for policy 1, policy_version 591755 (0.0008) [2023-12-27 23:28:52,161][106226] Updated weights for policy 0, policy_version 589737 (0.0007) [2023-12-27 23:28:52,763][106225] Updated weights for policy 1, policy_version 591765 (0.0008) [2023-12-27 23:28:52,827][106225] Updated weights for policy 1, policy_version 591775 (0.0010) [2023-12-27 23:28:52,892][106225] Updated weights for policy 1, policy_version 591785 (0.0008) [2023-12-27 23:28:52,906][106226] Updated weights for policy 0, policy_version 589747 (0.0008) [2023-12-27 23:28:52,960][106226] Updated weights for policy 0, policy_version 589757 (0.0007) [2023-12-27 23:28:53,022][106226] Updated weights for policy 0, policy_version 589767 (0.0008) [2023-12-27 23:28:53,496][106225] Updated weights for policy 1, policy_version 591795 (0.0008) [2023-12-27 23:28:53,552][106225] Updated weights for policy 1, policy_version 591805 (0.0010) [2023-12-27 23:28:53,609][106225] Updated weights for policy 1, policy_version 591815 (0.0010) [2023-12-27 23:28:53,725][106226] Updated weights for policy 0, policy_version 589777 (0.0008) [2023-12-27 23:28:53,785][106226] Updated weights for policy 0, policy_version 589787 (0.0005) [2023-12-27 23:28:53,851][106226] Updated weights for policy 0, policy_version 589797 (0.0006) [2023-12-27 23:28:53,910][106226] Updated weights for policy 0, policy_version 589807 (0.0008) [2023-12-27 23:28:54,253][106225] Updated weights for policy 1, policy_version 591825 (0.0010) [2023-12-27 23:28:54,302][106225] Updated weights for policy 1, policy_version 591835 (0.0006) [2023-12-27 23:28:54,358][106225] Updated weights for policy 1, policy_version 591845 (0.0005) [2023-12-27 23:28:54,421][106225] Updated weights for policy 1, policy_version 591855 (0.0006) [2023-12-27 23:28:54,643][106226] Updated weights for policy 0, policy_version 589817 (0.0009) [2023-12-27 23:28:54,705][106226] Updated weights for policy 0, policy_version 589827 (0.0007) [2023-12-27 23:28:54,769][106226] Updated weights for policy 0, policy_version 589837 (0.0005) [2023-12-27 23:28:55,099][106225] Updated weights for policy 1, policy_version 591865 (0.0010) [2023-12-27 23:28:55,153][106225] Updated weights for policy 1, policy_version 591875 (0.0009) [2023-12-27 23:28:55,213][106225] Updated weights for policy 1, policy_version 591885 (0.0009) [2023-12-27 23:28:55,333][106226] Updated weights for policy 0, policy_version 589847 (0.0006) [2023-12-27 23:28:55,384][106226] Updated weights for policy 0, policy_version 589857 (0.0005) [2023-12-27 23:28:55,433][106226] Updated weights for policy 0, policy_version 589867 (0.0005) [2023-12-27 23:28:55,987][106226] Updated weights for policy 0, policy_version 589877 (0.0008) [2023-12-27 23:28:56,039][106226] Updated weights for policy 0, policy_version 589887 (0.0011) [2023-12-27 23:28:56,044][106225] Updated weights for policy 1, policy_version 591895 (0.0006) [2023-12-27 23:28:56,089][106226] Updated weights for policy 0, policy_version 589897 (0.0011) [2023-12-27 23:28:56,110][106225] Updated weights for policy 1, policy_version 591905 (0.0006) [2023-12-27 23:28:56,163][106225] Updated weights for policy 1, policy_version 591915 (0.0007) [2023-12-27 23:28:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 302604288. Throughput: 0: 9936.0, 1: 9959.0. Samples: 302572264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:28:56,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.411')] [2023-12-27 23:28:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000589904_151052288.pth... [2023-12-27 23:28:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000588720_150749184.pth [2023-12-27 23:28:56,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000591920_151560192.pth... [2023-12-27 23:28:56,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000590704_151248896.pth [2023-12-27 23:28:56,683][106226] Updated weights for policy 0, policy_version 589907 (0.0009) [2023-12-27 23:28:56,732][106226] Updated weights for policy 0, policy_version 589917 (0.0007) [2023-12-27 23:28:56,790][106226] Updated weights for policy 0, policy_version 589927 (0.0010) [2023-12-27 23:28:56,804][106225] Updated weights for policy 1, policy_version 591925 (0.0008) [2023-12-27 23:28:56,856][106225] Updated weights for policy 1, policy_version 591935 (0.0007) [2023-12-27 23:28:56,919][106225] Updated weights for policy 1, policy_version 591945 (0.0008) [2023-12-27 23:28:57,495][106225] Updated weights for policy 1, policy_version 591955 (0.0007) [2023-12-27 23:28:57,544][106226] Updated weights for policy 0, policy_version 589937 (0.0010) [2023-12-27 23:28:57,547][106225] Updated weights for policy 1, policy_version 591965 (0.0010) [2023-12-27 23:28:57,597][106225] Updated weights for policy 1, policy_version 591975 (0.0010) [2023-12-27 23:28:57,600][106226] Updated weights for policy 0, policy_version 589947 (0.0006) [2023-12-27 23:28:57,654][106226] Updated weights for policy 0, policy_version 589957 (0.0011) [2023-12-27 23:28:57,714][106226] Updated weights for policy 0, policy_version 589967 (0.0010) [2023-12-27 23:28:58,257][106225] Updated weights for policy 1, policy_version 591985 (0.0006) [2023-12-27 23:28:58,266][106226] Updated weights for policy 0, policy_version 589977 (0.0008) [2023-12-27 23:28:58,321][106225] Updated weights for policy 1, policy_version 591995 (0.0010) [2023-12-27 23:28:58,328][106226] Updated weights for policy 0, policy_version 589987 (0.0009) [2023-12-27 23:28:58,391][106225] Updated weights for policy 1, policy_version 592005 (0.0009) [2023-12-27 23:28:58,397][106226] Updated weights for policy 0, policy_version 589997 (0.0009) [2023-12-27 23:28:58,457][106225] Updated weights for policy 1, policy_version 592015 (0.0010) [2023-12-27 23:28:59,223][106226] Updated weights for policy 0, policy_version 590007 (0.0008) [2023-12-27 23:28:59,287][106226] Updated weights for policy 0, policy_version 590017 (0.0008) [2023-12-27 23:28:59,338][106225] Updated weights for policy 1, policy_version 592025 (0.0008) [2023-12-27 23:28:59,348][106226] Updated weights for policy 0, policy_version 590027 (0.0007) [2023-12-27 23:28:59,409][106225] Updated weights for policy 1, policy_version 592035 (0.0007) [2023-12-27 23:28:59,471][106225] Updated weights for policy 1, policy_version 592045 (0.0008) [2023-12-27 23:28:59,965][106226] Updated weights for policy 0, policy_version 590037 (0.0007) [2023-12-27 23:29:00,015][106226] Updated weights for policy 0, policy_version 590047 (0.0005) [2023-12-27 23:29:00,065][106226] Updated weights for policy 0, policy_version 590057 (0.0006) [2023-12-27 23:29:00,274][106225] Updated weights for policy 1, policy_version 592055 (0.0008) [2023-12-27 23:29:00,336][106225] Updated weights for policy 1, policy_version 592065 (0.0008) [2023-12-27 23:29:00,399][106225] Updated weights for policy 1, policy_version 592075 (0.0009) [2023-12-27 23:29:00,773][106226] Updated weights for policy 0, policy_version 590067 (0.0009) [2023-12-27 23:29:00,828][106226] Updated weights for policy 0, policy_version 590077 (0.0008) [2023-12-27 23:29:00,885][106226] Updated weights for policy 0, policy_version 590087 (0.0008) [2023-12-27 23:29:01,108][106225] Updated weights for policy 1, policy_version 592085 (0.0008) [2023-12-27 23:29:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 302702592. Throughput: 0: 10092.7, 1: 9977.5. Samples: 302694980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:01,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.687')] [2023-12-27 23:29:01,176][106225] Updated weights for policy 1, policy_version 592095 (0.0009) [2023-12-27 23:29:01,242][106225] Updated weights for policy 1, policy_version 592105 (0.0008) [2023-12-27 23:29:01,657][106226] Updated weights for policy 0, policy_version 590097 (0.0008) [2023-12-27 23:29:01,717][106226] Updated weights for policy 0, policy_version 590107 (0.0008) [2023-12-27 23:29:01,789][106226] Updated weights for policy 0, policy_version 590117 (0.0007) [2023-12-27 23:29:01,854][106226] Updated weights for policy 0, policy_version 590127 (0.0008) [2023-12-27 23:29:01,965][106225] Updated weights for policy 1, policy_version 592115 (0.0008) [2023-12-27 23:29:02,016][106225] Updated weights for policy 1, policy_version 592125 (0.0007) [2023-12-27 23:29:02,073][106225] Updated weights for policy 1, policy_version 592135 (0.0008) [2023-12-27 23:29:02,567][106226] Updated weights for policy 0, policy_version 590137 (0.0006) [2023-12-27 23:29:02,626][106226] Updated weights for policy 0, policy_version 590147 (0.0010) [2023-12-27 23:29:02,683][106226] Updated weights for policy 0, policy_version 590157 (0.0009) [2023-12-27 23:29:02,742][106225] Updated weights for policy 1, policy_version 592145 (0.0008) [2023-12-27 23:29:02,797][106225] Updated weights for policy 1, policy_version 592155 (0.0008) [2023-12-27 23:29:02,860][106225] Updated weights for policy 1, policy_version 592165 (0.0008) [2023-12-27 23:29:02,926][106225] Updated weights for policy 1, policy_version 592175 (0.0008) [2023-12-27 23:29:03,388][106226] Updated weights for policy 0, policy_version 590167 (0.0008) [2023-12-27 23:29:03,438][106226] Updated weights for policy 0, policy_version 590177 (0.0005) [2023-12-27 23:29:03,490][106226] Updated weights for policy 0, policy_version 590187 (0.0010) [2023-12-27 23:29:03,601][106225] Updated weights for policy 1, policy_version 592185 (0.0008) [2023-12-27 23:29:03,664][106225] Updated weights for policy 1, policy_version 592195 (0.0008) [2023-12-27 23:29:03,720][106225] Updated weights for policy 1, policy_version 592205 (0.0008) [2023-12-27 23:29:04,207][106226] Updated weights for policy 0, policy_version 590197 (0.0009) [2023-12-27 23:29:04,275][106226] Updated weights for policy 0, policy_version 590207 (0.0008) [2023-12-27 23:29:04,336][106226] Updated weights for policy 0, policy_version 590217 (0.0011) [2023-12-27 23:29:04,458][106225] Updated weights for policy 1, policy_version 592215 (0.0008) [2023-12-27 23:29:04,517][106225] Updated weights for policy 1, policy_version 592225 (0.0008) [2023-12-27 23:29:04,571][106225] Updated weights for policy 1, policy_version 592235 (0.0007) [2023-12-27 23:29:05,045][106226] Updated weights for policy 0, policy_version 590227 (0.0009) [2023-12-27 23:29:05,091][106226] Updated weights for policy 0, policy_version 590237 (0.0005) [2023-12-27 23:29:05,163][106226] Updated weights for policy 0, policy_version 590247 (0.0006) [2023-12-27 23:29:05,201][106225] Updated weights for policy 1, policy_version 592245 (0.0008) [2023-12-27 23:29:05,260][106225] Updated weights for policy 1, policy_version 592255 (0.0008) [2023-12-27 23:29:05,323][106225] Updated weights for policy 1, policy_version 592265 (0.0008) [2023-12-27 23:29:05,669][106226] Updated weights for policy 0, policy_version 590257 (0.0006) [2023-12-27 23:29:05,741][106226] Updated weights for policy 0, policy_version 590267 (0.0011) [2023-12-27 23:29:05,804][106226] Updated weights for policy 0, policy_version 590277 (0.0011) [2023-12-27 23:29:05,867][106226] Updated weights for policy 0, policy_version 590287 (0.0011) [2023-12-27 23:29:05,921][106225] Updated weights for policy 1, policy_version 592275 (0.0007) [2023-12-27 23:29:05,972][106225] Updated weights for policy 1, policy_version 592285 (0.0008) [2023-12-27 23:29:06,021][106225] Updated weights for policy 1, policy_version 592295 (0.0005) [2023-12-27 23:29:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 302809088. Throughput: 0: 10120.6, 1: 10051.6. Samples: 302814804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:06,175][105115] Avg episode reward: [(0, '-4.998'), (1, '-5.364')] [2023-12-27 23:29:06,548][106226] Updated weights for policy 0, policy_version 590297 (0.0006) [2023-12-27 23:29:06,615][106226] Updated weights for policy 0, policy_version 590307 (0.0008) [2023-12-27 23:29:06,670][106225] Updated weights for policy 1, policy_version 592305 (0.0006) [2023-12-27 23:29:06,682][106226] Updated weights for policy 0, policy_version 590317 (0.0006) [2023-12-27 23:29:06,719][106225] Updated weights for policy 1, policy_version 592315 (0.0008) [2023-12-27 23:29:06,782][106225] Updated weights for policy 1, policy_version 592325 (0.0005) [2023-12-27 23:29:06,851][106225] Updated weights for policy 1, policy_version 592335 (0.0006) [2023-12-27 23:29:07,380][106225] Updated weights for policy 1, policy_version 592345 (0.0005) [2023-12-27 23:29:07,399][106226] Updated weights for policy 0, policy_version 590327 (0.0006) [2023-12-27 23:29:07,440][106225] Updated weights for policy 1, policy_version 592355 (0.0007) [2023-12-27 23:29:07,459][106226] Updated weights for policy 0, policy_version 590337 (0.0005) [2023-12-27 23:29:07,491][106225] Updated weights for policy 1, policy_version 592365 (0.0008) [2023-12-27 23:29:07,511][106226] Updated weights for policy 0, policy_version 590347 (0.0005) [2023-12-27 23:29:08,073][106225] Updated weights for policy 1, policy_version 592375 (0.0006) [2023-12-27 23:29:08,127][106225] Updated weights for policy 1, policy_version 592385 (0.0005) [2023-12-27 23:29:08,188][106225] Updated weights for policy 1, policy_version 592395 (0.0006) [2023-12-27 23:29:08,233][106226] Updated weights for policy 0, policy_version 590357 (0.0007) [2023-12-27 23:29:08,303][106226] Updated weights for policy 0, policy_version 590367 (0.0008) [2023-12-27 23:29:08,370][106226] Updated weights for policy 0, policy_version 590377 (0.0009) [2023-12-27 23:29:08,791][106225] Updated weights for policy 1, policy_version 592405 (0.0008) [2023-12-27 23:29:08,854][106225] Updated weights for policy 1, policy_version 592415 (0.0008) [2023-12-27 23:29:08,920][106225] Updated weights for policy 1, policy_version 592425 (0.0008) [2023-12-27 23:29:09,076][106226] Updated weights for policy 0, policy_version 590387 (0.0009) [2023-12-27 23:29:09,136][106226] Updated weights for policy 0, policy_version 590397 (0.0009) [2023-12-27 23:29:09,207][106226] Updated weights for policy 0, policy_version 590407 (0.0005) [2023-12-27 23:29:09,671][106225] Updated weights for policy 1, policy_version 592435 (0.0007) [2023-12-27 23:29:09,730][106225] Updated weights for policy 1, policy_version 592445 (0.0008) [2023-12-27 23:29:09,794][106225] Updated weights for policy 1, policy_version 592455 (0.0009) [2023-12-27 23:29:10,003][106226] Updated weights for policy 0, policy_version 590417 (0.0008) [2023-12-27 23:29:10,063][106226] Updated weights for policy 0, policy_version 590427 (0.0008) [2023-12-27 23:29:10,122][106226] Updated weights for policy 0, policy_version 590437 (0.0009) [2023-12-27 23:29:10,182][106226] Updated weights for policy 0, policy_version 590447 (0.0008) [2023-12-27 23:29:10,494][106225] Updated weights for policy 1, policy_version 592465 (0.0008) [2023-12-27 23:29:10,550][106225] Updated weights for policy 1, policy_version 592475 (0.0008) [2023-12-27 23:29:10,605][106225] Updated weights for policy 1, policy_version 592485 (0.0008) [2023-12-27 23:29:10,660][106225] Updated weights for policy 1, policy_version 592495 (0.0008) [2023-12-27 23:29:10,900][106226] Updated weights for policy 0, policy_version 590457 (0.0008) [2023-12-27 23:29:10,956][106226] Updated weights for policy 0, policy_version 590467 (0.0010) [2023-12-27 23:29:11,013][106226] Updated weights for policy 0, policy_version 590477 (0.0008) [2023-12-27 23:29:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 302907392. Throughput: 0: 10075.7, 1: 10209.8. Samples: 302878164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:11,175][105115] Avg episode reward: [(0, '-4.843'), (1, '-5.734')] [2023-12-27 23:29:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000592496_151707648.pth... [2023-12-27 23:29:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000590480_151199744.pth... [2023-12-27 23:29:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000591312_151404544.pth [2023-12-27 23:29:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000589296_150896640.pth [2023-12-27 23:29:11,414][106225] Updated weights for policy 1, policy_version 592505 (0.0008) [2023-12-27 23:29:11,473][106225] Updated weights for policy 1, policy_version 592515 (0.0006) [2023-12-27 23:29:11,527][106225] Updated weights for policy 1, policy_version 592525 (0.0007) [2023-12-27 23:29:11,831][106226] Updated weights for policy 0, policy_version 590487 (0.0009) [2023-12-27 23:29:11,896][106226] Updated weights for policy 0, policy_version 590497 (0.0009) [2023-12-27 23:29:11,958][106226] Updated weights for policy 0, policy_version 590507 (0.0008) [2023-12-27 23:29:12,236][106225] Updated weights for policy 1, policy_version 592535 (0.0010) [2023-12-27 23:29:12,298][106225] Updated weights for policy 1, policy_version 592545 (0.0009) [2023-12-27 23:29:12,370][106225] Updated weights for policy 1, policy_version 592555 (0.0010) [2023-12-27 23:29:12,695][106226] Updated weights for policy 0, policy_version 590517 (0.0008) [2023-12-27 23:29:12,762][106226] Updated weights for policy 0, policy_version 590527 (0.0008) [2023-12-27 23:29:12,826][106226] Updated weights for policy 0, policy_version 590537 (0.0008) [2023-12-27 23:29:13,030][106225] Updated weights for policy 1, policy_version 592565 (0.0012) [2023-12-27 23:29:13,095][106225] Updated weights for policy 1, policy_version 592575 (0.0010) [2023-12-27 23:29:13,158][106225] Updated weights for policy 1, policy_version 592585 (0.0006) [2023-12-27 23:29:13,490][106226] Updated weights for policy 0, policy_version 590547 (0.0007) [2023-12-27 23:29:13,551][106226] Updated weights for policy 0, policy_version 590557 (0.0005) [2023-12-27 23:29:13,617][106226] Updated weights for policy 0, policy_version 590567 (0.0005) [2023-12-27 23:29:13,860][106225] Updated weights for policy 1, policy_version 592595 (0.0010) [2023-12-27 23:29:13,924][106225] Updated weights for policy 1, policy_version 592605 (0.0010) [2023-12-27 23:29:13,991][106225] Updated weights for policy 1, policy_version 592615 (0.0010) [2023-12-27 23:29:14,169][106226] Updated weights for policy 0, policy_version 590577 (0.0007) [2023-12-27 23:29:14,232][106226] Updated weights for policy 0, policy_version 590587 (0.0009) [2023-12-27 23:29:14,296][106226] Updated weights for policy 0, policy_version 590597 (0.0010) [2023-12-27 23:29:14,363][106226] Updated weights for policy 0, policy_version 590607 (0.0008) [2023-12-27 23:29:14,689][106225] Updated weights for policy 1, policy_version 592625 (0.0010) [2023-12-27 23:29:14,748][106225] Updated weights for policy 1, policy_version 592635 (0.0009) [2023-12-27 23:29:14,816][106225] Updated weights for policy 1, policy_version 592645 (0.0007) [2023-12-27 23:29:14,888][106225] Updated weights for policy 1, policy_version 592655 (0.0006) [2023-12-27 23:29:14,981][106226] Updated weights for policy 0, policy_version 590617 (0.0006) [2023-12-27 23:29:15,049][106226] Updated weights for policy 0, policy_version 590627 (0.0008) [2023-12-27 23:29:15,114][106226] Updated weights for policy 0, policy_version 590637 (0.0008) [2023-12-27 23:29:15,636][106225] Updated weights for policy 1, policy_version 592665 (0.0010) [2023-12-27 23:29:15,686][106225] Updated weights for policy 1, policy_version 592675 (0.0010) [2023-12-27 23:29:15,746][106225] Updated weights for policy 1, policy_version 592685 (0.0010) [2023-12-27 23:29:15,823][106226] Updated weights for policy 0, policy_version 590647 (0.0009) [2023-12-27 23:29:15,875][106226] Updated weights for policy 0, policy_version 590657 (0.0007) [2023-12-27 23:29:15,926][106226] Updated weights for policy 0, policy_version 590667 (0.0006) [2023-12-27 23:29:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 303005696. Throughput: 0: 9942.5, 1: 10124.4. Samples: 302994952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:16,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-5.357')] [2023-12-27 23:29:16,427][106225] Updated weights for policy 1, policy_version 592695 (0.0010) [2023-12-27 23:29:16,490][106225] Updated weights for policy 1, policy_version 592705 (0.0009) [2023-12-27 23:29:16,549][106225] Updated weights for policy 1, policy_version 592715 (0.0009) [2023-12-27 23:29:16,586][106226] Updated weights for policy 0, policy_version 590677 (0.0007) [2023-12-27 23:29:16,636][106226] Updated weights for policy 0, policy_version 590687 (0.0009) [2023-12-27 23:29:16,695][106226] Updated weights for policy 0, policy_version 590697 (0.0008) [2023-12-27 23:29:17,198][106225] Updated weights for policy 1, policy_version 592725 (0.0008) [2023-12-27 23:29:17,250][106225] Updated weights for policy 1, policy_version 592735 (0.0010) [2023-12-27 23:29:17,306][106225] Updated weights for policy 1, policy_version 592745 (0.0010) [2023-12-27 23:29:17,459][106226] Updated weights for policy 0, policy_version 590707 (0.0010) [2023-12-27 23:29:17,521][106226] Updated weights for policy 0, policy_version 590717 (0.0010) [2023-12-27 23:29:17,571][106226] Updated weights for policy 0, policy_version 590727 (0.0008) [2023-12-27 23:29:17,855][106225] Updated weights for policy 1, policy_version 592755 (0.0006) [2023-12-27 23:29:17,910][106225] Updated weights for policy 1, policy_version 592765 (0.0005) [2023-12-27 23:29:17,962][106225] Updated weights for policy 1, policy_version 592775 (0.0005) [2023-12-27 23:29:18,329][106226] Updated weights for policy 0, policy_version 590737 (0.0009) [2023-12-27 23:29:18,392][106226] Updated weights for policy 0, policy_version 590747 (0.0007) [2023-12-27 23:29:18,455][106226] Updated weights for policy 0, policy_version 590757 (0.0008) [2023-12-27 23:29:18,520][106226] Updated weights for policy 0, policy_version 590767 (0.0008) [2023-12-27 23:29:18,654][106225] Updated weights for policy 1, policy_version 592785 (0.0007) [2023-12-27 23:29:18,723][106225] Updated weights for policy 1, policy_version 592795 (0.0010) [2023-12-27 23:29:18,792][106225] Updated weights for policy 1, policy_version 592805 (0.0011) [2023-12-27 23:29:18,855][106225] Updated weights for policy 1, policy_version 592815 (0.0008) [2023-12-27 23:29:19,207][106226] Updated weights for policy 0, policy_version 590777 (0.0008) [2023-12-27 23:29:19,277][106226] Updated weights for policy 0, policy_version 590787 (0.0008) [2023-12-27 23:29:19,344][106226] Updated weights for policy 0, policy_version 590797 (0.0008) [2023-12-27 23:29:19,617][106225] Updated weights for policy 1, policy_version 592825 (0.0011) [2023-12-27 23:29:19,678][106225] Updated weights for policy 1, policy_version 592835 (0.0010) [2023-12-27 23:29:19,743][106225] Updated weights for policy 1, policy_version 592845 (0.0011) [2023-12-27 23:29:20,050][106226] Updated weights for policy 0, policy_version 590807 (0.0008) [2023-12-27 23:29:20,114][106226] Updated weights for policy 0, policy_version 590817 (0.0008) [2023-12-27 23:29:20,179][106226] Updated weights for policy 0, policy_version 590827 (0.0009) [2023-12-27 23:29:20,457][106225] Updated weights for policy 1, policy_version 592855 (0.0007) [2023-12-27 23:29:20,527][106225] Updated weights for policy 1, policy_version 592865 (0.0006) [2023-12-27 23:29:20,595][106225] Updated weights for policy 1, policy_version 592875 (0.0011) [2023-12-27 23:29:20,915][106226] Updated weights for policy 0, policy_version 590837 (0.0008) [2023-12-27 23:29:20,980][106226] Updated weights for policy 0, policy_version 590847 (0.0009) [2023-12-27 23:29:21,051][106226] Updated weights for policy 0, policy_version 590857 (0.0009) [2023-12-27 23:29:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 303104000. Throughput: 0: 9914.0, 1: 10012.5. Samples: 303112108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:21,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-5.510')] [2023-12-27 23:29:21,327][106225] Updated weights for policy 1, policy_version 592885 (0.0009) [2023-12-27 23:29:21,399][106225] Updated weights for policy 1, policy_version 592895 (0.0009) [2023-12-27 23:29:21,452][106225] Updated weights for policy 1, policy_version 592905 (0.0009) [2023-12-27 23:29:21,796][106226] Updated weights for policy 0, policy_version 590867 (0.0008) [2023-12-27 23:29:21,864][106226] Updated weights for policy 0, policy_version 590877 (0.0008) [2023-12-27 23:29:21,931][106226] Updated weights for policy 0, policy_version 590887 (0.0009) [2023-12-27 23:29:22,230][106225] Updated weights for policy 1, policy_version 592915 (0.0008) [2023-12-27 23:29:22,302][106225] Updated weights for policy 1, policy_version 592925 (0.0007) [2023-12-27 23:29:22,372][106225] Updated weights for policy 1, policy_version 592935 (0.0008) [2023-12-27 23:29:22,596][106226] Updated weights for policy 0, policy_version 590897 (0.0009) [2023-12-27 23:29:22,650][106226] Updated weights for policy 0, policy_version 590907 (0.0006) [2023-12-27 23:29:22,709][106226] Updated weights for policy 0, policy_version 590917 (0.0009) [2023-12-27 23:29:22,770][106226] Updated weights for policy 0, policy_version 590927 (0.0007) [2023-12-27 23:29:23,033][106225] Updated weights for policy 1, policy_version 592945 (0.0006) [2023-12-27 23:29:23,089][106225] Updated weights for policy 1, policy_version 592955 (0.0009) [2023-12-27 23:29:23,141][106225] Updated weights for policy 1, policy_version 592965 (0.0006) [2023-12-27 23:29:23,192][106225] Updated weights for policy 1, policy_version 592975 (0.0005) [2023-12-27 23:29:23,498][106226] Updated weights for policy 0, policy_version 590937 (0.0009) [2023-12-27 23:29:23,557][106226] Updated weights for policy 0, policy_version 590947 (0.0009) [2023-12-27 23:29:23,619][106226] Updated weights for policy 0, policy_version 590957 (0.0008) [2023-12-27 23:29:23,866][106225] Updated weights for policy 1, policy_version 592985 (0.0008) [2023-12-27 23:29:23,919][106225] Updated weights for policy 1, policy_version 592995 (0.0008) [2023-12-27 23:29:23,975][106225] Updated weights for policy 1, policy_version 593005 (0.0009) [2023-12-27 23:29:24,275][106226] Updated weights for policy 0, policy_version 590967 (0.0007) [2023-12-27 23:29:24,333][106226] Updated weights for policy 0, policy_version 590977 (0.0006) [2023-12-27 23:29:24,388][106226] Updated weights for policy 0, policy_version 590987 (0.0009) [2023-12-27 23:29:24,703][106225] Updated weights for policy 1, policy_version 593015 (0.0010) [2023-12-27 23:29:24,760][106225] Updated weights for policy 1, policy_version 593025 (0.0010) [2023-12-27 23:29:24,819][106225] Updated weights for policy 1, policy_version 593035 (0.0010) [2023-12-27 23:29:25,078][106226] Updated weights for policy 0, policy_version 590997 (0.0009) [2023-12-27 23:29:25,128][106226] Updated weights for policy 0, policy_version 591007 (0.0007) [2023-12-27 23:29:25,192][106226] Updated weights for policy 0, policy_version 591017 (0.0008) [2023-12-27 23:29:25,537][106225] Updated weights for policy 1, policy_version 593045 (0.0010) [2023-12-27 23:29:25,603][106225] Updated weights for policy 1, policy_version 593055 (0.0006) [2023-12-27 23:29:25,664][106225] Updated weights for policy 1, policy_version 593065 (0.0006) [2023-12-27 23:29:25,965][106226] Updated weights for policy 0, policy_version 591027 (0.0009) [2023-12-27 23:29:26,023][106226] Updated weights for policy 0, policy_version 591037 (0.0009) [2023-12-27 23:29:26,075][106226] Updated weights for policy 0, policy_version 591047 (0.0007) [2023-12-27 23:29:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 303202304. Throughput: 0: 9882.8, 1: 9986.3. Samples: 303169948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:29:26,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.499')] [2023-12-27 23:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000591056_151347200.pth... [2023-12-27 23:29:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000589904_151052288.pth [2023-12-27 23:29:26,188][106225] Updated weights for policy 1, policy_version 593075 (0.0006) [2023-12-27 23:29:26,237][106225] Updated weights for policy 1, policy_version 593085 (0.0005) [2023-12-27 23:29:26,283][106225] Updated weights for policy 1, policy_version 593095 (0.0005) [2023-12-27 23:29:26,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000593104_151863296.pth... [2023-12-27 23:29:26,339][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000591920_151560192.pth [2023-12-27 23:29:26,828][106225] Updated weights for policy 1, policy_version 593105 (0.0006) [2023-12-27 23:29:26,889][106225] Updated weights for policy 1, policy_version 593115 (0.0010) [2023-12-27 23:29:26,936][106226] Updated weights for policy 0, policy_version 591057 (0.0009) [2023-12-27 23:29:26,942][106225] Updated weights for policy 1, policy_version 593125 (0.0010) [2023-12-27 23:29:26,990][106226] Updated weights for policy 0, policy_version 591067 (0.0005) [2023-12-27 23:29:26,992][106225] Updated weights for policy 1, policy_version 593135 (0.0010) [2023-12-27 23:29:27,043][106226] Updated weights for policy 0, policy_version 591077 (0.0007) [2023-12-27 23:29:27,097][106226] Updated weights for policy 0, policy_version 591087 (0.0007) [2023-12-27 23:29:27,700][106225] Updated weights for policy 1, policy_version 593145 (0.0010) [2023-12-27 23:29:27,749][106225] Updated weights for policy 1, policy_version 593155 (0.0010) [2023-12-27 23:29:27,804][106225] Updated weights for policy 1, policy_version 593165 (0.0010) [2023-12-27 23:29:27,833][106226] Updated weights for policy 0, policy_version 591097 (0.0006) [2023-12-27 23:29:27,884][106226] Updated weights for policy 0, policy_version 591107 (0.0008) [2023-12-27 23:29:27,930][106226] Updated weights for policy 0, policy_version 591117 (0.0007) [2023-12-27 23:29:28,518][106225] Updated weights for policy 1, policy_version 593175 (0.0007) [2023-12-27 23:29:28,566][106225] Updated weights for policy 1, policy_version 593185 (0.0005) [2023-12-27 23:29:28,619][106225] Updated weights for policy 1, policy_version 593195 (0.0010) [2023-12-27 23:29:28,684][106226] Updated weights for policy 0, policy_version 591127 (0.0008) [2023-12-27 23:29:28,751][106226] Updated weights for policy 0, policy_version 591137 (0.0010) [2023-12-27 23:29:28,812][106226] Updated weights for policy 0, policy_version 591147 (0.0009) [2023-12-27 23:29:29,192][106225] Updated weights for policy 1, policy_version 593205 (0.0008) [2023-12-27 23:29:29,258][106225] Updated weights for policy 1, policy_version 593215 (0.0008) [2023-12-27 23:29:29,325][106225] Updated weights for policy 1, policy_version 593225 (0.0010) [2023-12-27 23:29:29,630][106226] Updated weights for policy 0, policy_version 591157 (0.0009) [2023-12-27 23:29:29,696][106226] Updated weights for policy 0, policy_version 591167 (0.0008) [2023-12-27 23:29:29,757][106226] Updated weights for policy 0, policy_version 591177 (0.0007) [2023-12-27 23:29:30,064][106225] Updated weights for policy 1, policy_version 593235 (0.0010) [2023-12-27 23:29:30,126][106225] Updated weights for policy 1, policy_version 593245 (0.0010) [2023-12-27 23:29:30,185][106225] Updated weights for policy 1, policy_version 593255 (0.0010) [2023-12-27 23:29:30,495][106226] Updated weights for policy 0, policy_version 591187 (0.0008) [2023-12-27 23:29:30,541][106226] Updated weights for policy 0, policy_version 591197 (0.0008) [2023-12-27 23:29:30,590][106226] Updated weights for policy 0, policy_version 591207 (0.0008) [2023-12-27 23:29:30,912][106225] Updated weights for policy 1, policy_version 593265 (0.0010) [2023-12-27 23:29:30,975][106225] Updated weights for policy 1, policy_version 593275 (0.0010) [2023-12-27 23:29:31,031][106225] Updated weights for policy 1, policy_version 593285 (0.0010) [2023-12-27 23:29:31,094][106225] Updated weights for policy 1, policy_version 593295 (0.0010) [2023-12-27 23:29:31,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 303300608. Throughput: 0: 9868.4, 1: 10107.0. Samples: 303289360. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:31,175][105115] Avg episode reward: [(0, '-4.923'), (1, '-5.473')] [2023-12-27 23:29:31,297][106226] Updated weights for policy 0, policy_version 591217 (0.0008) [2023-12-27 23:29:31,363][106226] Updated weights for policy 0, policy_version 591227 (0.0008) [2023-12-27 23:29:31,423][106226] Updated weights for policy 0, policy_version 591237 (0.0008) [2023-12-27 23:29:31,473][106226] Updated weights for policy 0, policy_version 591247 (0.0009) [2023-12-27 23:29:31,789][106225] Updated weights for policy 1, policy_version 593305 (0.0013) [2023-12-27 23:29:31,851][106225] Updated weights for policy 1, policy_version 593315 (0.0007) [2023-12-27 23:29:31,901][106225] Updated weights for policy 1, policy_version 593325 (0.0008) [2023-12-27 23:29:32,248][106226] Updated weights for policy 0, policy_version 591257 (0.0007) [2023-12-27 23:29:32,313][106226] Updated weights for policy 0, policy_version 591267 (0.0009) [2023-12-27 23:29:32,380][106226] Updated weights for policy 0, policy_version 591277 (0.0008) [2023-12-27 23:29:32,545][106225] Updated weights for policy 1, policy_version 593335 (0.0007) [2023-12-27 23:29:32,597][106225] Updated weights for policy 1, policy_version 593345 (0.0010) [2023-12-27 23:29:32,652][106225] Updated weights for policy 1, policy_version 593355 (0.0008) [2023-12-27 23:29:33,030][106226] Updated weights for policy 0, policy_version 591287 (0.0008) [2023-12-27 23:29:33,081][106226] Updated weights for policy 0, policy_version 591297 (0.0010) [2023-12-27 23:29:33,126][106226] Updated weights for policy 0, policy_version 591307 (0.0010) [2023-12-27 23:29:33,293][106225] Updated weights for policy 1, policy_version 593365 (0.0006) [2023-12-27 23:29:33,340][106225] Updated weights for policy 1, policy_version 593375 (0.0007) [2023-12-27 23:29:33,396][106225] Updated weights for policy 1, policy_version 593385 (0.0007) [2023-12-27 23:29:33,859][106226] Updated weights for policy 0, policy_version 591317 (0.0010) [2023-12-27 23:29:33,914][106226] Updated weights for policy 0, policy_version 591327 (0.0010) [2023-12-27 23:29:33,970][106226] Updated weights for policy 0, policy_version 591337 (0.0010) [2023-12-27 23:29:34,121][106225] Updated weights for policy 1, policy_version 593395 (0.0009) [2023-12-27 23:29:34,193][106225] Updated weights for policy 1, policy_version 593405 (0.0009) [2023-12-27 23:29:34,247][106225] Updated weights for policy 1, policy_version 593415 (0.0010) [2023-12-27 23:29:34,694][106226] Updated weights for policy 0, policy_version 591347 (0.0010) [2023-12-27 23:29:34,757][106226] Updated weights for policy 0, policy_version 591357 (0.0008) [2023-12-27 23:29:34,835][106226] Updated weights for policy 0, policy_version 591367 (0.0011) [2023-12-27 23:29:34,893][106225] Updated weights for policy 1, policy_version 593425 (0.0010) [2023-12-27 23:29:34,959][106225] Updated weights for policy 1, policy_version 593435 (0.0007) [2023-12-27 23:29:35,011][106225] Updated weights for policy 1, policy_version 593445 (0.0006) [2023-12-27 23:29:35,070][106225] Updated weights for policy 1, policy_version 593455 (0.0008) [2023-12-27 23:29:35,466][106226] Updated weights for policy 0, policy_version 591377 (0.0010) [2023-12-27 23:29:35,522][106226] Updated weights for policy 0, policy_version 591387 (0.0007) [2023-12-27 23:29:35,572][106226] Updated weights for policy 0, policy_version 591397 (0.0009) [2023-12-27 23:29:35,623][106226] Updated weights for policy 0, policy_version 591407 (0.0008) [2023-12-27 23:29:35,660][106225] Updated weights for policy 1, policy_version 593465 (0.0008) [2023-12-27 23:29:35,716][106225] Updated weights for policy 1, policy_version 593475 (0.0009) [2023-12-27 23:29:35,773][106225] Updated weights for policy 1, policy_version 593485 (0.0008) [2023-12-27 23:29:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 303398912. Throughput: 0: 9795.2, 1: 10101.2. Samples: 303409336. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:36,175][105115] Avg episode reward: [(0, '-5.018'), (1, '-5.689')] [2023-12-27 23:29:36,316][106226] Updated weights for policy 0, policy_version 591417 (0.0006) [2023-12-27 23:29:36,379][106226] Updated weights for policy 0, policy_version 591427 (0.0008) [2023-12-27 23:29:36,448][106226] Updated weights for policy 0, policy_version 591437 (0.0008) [2023-12-27 23:29:36,542][106225] Updated weights for policy 1, policy_version 593495 (0.0010) [2023-12-27 23:29:36,607][106225] Updated weights for policy 1, policy_version 593505 (0.0011) [2023-12-27 23:29:36,672][106225] Updated weights for policy 1, policy_version 593515 (0.0011) [2023-12-27 23:29:37,095][106226] Updated weights for policy 0, policy_version 591447 (0.0006) [2023-12-27 23:29:37,146][106226] Updated weights for policy 0, policy_version 591457 (0.0008) [2023-12-27 23:29:37,200][106226] Updated weights for policy 0, policy_version 591467 (0.0008) [2023-12-27 23:29:37,374][106225] Updated weights for policy 1, policy_version 593525 (0.0011) [2023-12-27 23:29:37,428][106225] Updated weights for policy 1, policy_version 593535 (0.0010) [2023-12-27 23:29:37,479][106225] Updated weights for policy 1, policy_version 593545 (0.0010) [2023-12-27 23:29:37,987][106226] Updated weights for policy 0, policy_version 591477 (0.0008) [2023-12-27 23:29:38,046][106226] Updated weights for policy 0, policy_version 591487 (0.0008) [2023-12-27 23:29:38,105][106226] Updated weights for policy 0, policy_version 591497 (0.0008) [2023-12-27 23:29:38,146][106225] Updated weights for policy 1, policy_version 593555 (0.0007) [2023-12-27 23:29:38,193][106225] Updated weights for policy 1, policy_version 593565 (0.0010) [2023-12-27 23:29:38,240][106225] Updated weights for policy 1, policy_version 593575 (0.0010) [2023-12-27 23:29:38,834][106226] Updated weights for policy 0, policy_version 591507 (0.0009) [2023-12-27 23:29:38,904][106226] Updated weights for policy 0, policy_version 591517 (0.0011) [2023-12-27 23:29:38,925][106225] Updated weights for policy 1, policy_version 593585 (0.0010) [2023-12-27 23:29:38,967][106226] Updated weights for policy 0, policy_version 591527 (0.0010) [2023-12-27 23:29:38,987][106225] Updated weights for policy 1, policy_version 593595 (0.0006) [2023-12-27 23:29:39,046][106225] Updated weights for policy 1, policy_version 593605 (0.0005) [2023-12-27 23:29:39,099][106225] Updated weights for policy 1, policy_version 593615 (0.0007) [2023-12-27 23:29:39,733][106226] Updated weights for policy 0, policy_version 591537 (0.0010) [2023-12-27 23:29:39,772][106225] Updated weights for policy 1, policy_version 593625 (0.0008) [2023-12-27 23:29:39,805][106226] Updated weights for policy 0, policy_version 591547 (0.0007) [2023-12-27 23:29:39,840][106225] Updated weights for policy 1, policy_version 593635 (0.0008) [2023-12-27 23:29:39,873][106226] Updated weights for policy 0, policy_version 591557 (0.0007) [2023-12-27 23:29:39,900][106225] Updated weights for policy 1, policy_version 593645 (0.0008) [2023-12-27 23:29:39,941][106226] Updated weights for policy 0, policy_version 591567 (0.0009) [2023-12-27 23:29:40,622][106225] Updated weights for policy 1, policy_version 593655 (0.0006) [2023-12-27 23:29:40,633][106226] Updated weights for policy 0, policy_version 591577 (0.0006) [2023-12-27 23:29:40,681][106225] Updated weights for policy 1, policy_version 593665 (0.0005) [2023-12-27 23:29:40,696][106226] Updated weights for policy 0, policy_version 591587 (0.0009) [2023-12-27 23:29:40,739][106225] Updated weights for policy 1, policy_version 593675 (0.0006) [2023-12-27 23:29:40,762][106226] Updated weights for policy 0, policy_version 591597 (0.0007) [2023-12-27 23:29:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 303497216. Throughput: 0: 9796.7, 1: 10110.1. Samples: 303468072. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:41,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-5.462')] [2023-12-27 23:29:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000593680_152010752.pth... [2023-12-27 23:29:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000591600_151486464.pth... [2023-12-27 23:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000592496_151707648.pth [2023-12-27 23:29:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000590480_151199744.pth [2023-12-27 23:29:41,435][106225] Updated weights for policy 1, policy_version 593685 (0.0008) [2023-12-27 23:29:41,486][106225] Updated weights for policy 1, policy_version 593695 (0.0009) [2023-12-27 23:29:41,541][106225] Updated weights for policy 1, policy_version 593705 (0.0008) [2023-12-27 23:29:41,554][106226] Updated weights for policy 0, policy_version 591607 (0.0008) [2023-12-27 23:29:41,622][106226] Updated weights for policy 0, policy_version 591617 (0.0008) [2023-12-27 23:29:41,691][106226] Updated weights for policy 0, policy_version 591627 (0.0009) [2023-12-27 23:29:42,325][106225] Updated weights for policy 1, policy_version 593715 (0.0007) [2023-12-27 23:29:42,393][106225] Updated weights for policy 1, policy_version 593725 (0.0009) [2023-12-27 23:29:42,451][106225] Updated weights for policy 1, policy_version 593735 (0.0009) [2023-12-27 23:29:42,513][106226] Updated weights for policy 0, policy_version 591637 (0.0009) [2023-12-27 23:29:42,573][106226] Updated weights for policy 0, policy_version 591647 (0.0007) [2023-12-27 23:29:42,639][106226] Updated weights for policy 0, policy_version 591657 (0.0006) [2023-12-27 23:29:43,216][106226] Updated weights for policy 0, policy_version 591667 (0.0006) [2023-12-27 23:29:43,226][106225] Updated weights for policy 1, policy_version 593745 (0.0009) [2023-12-27 23:29:43,274][106225] Updated weights for policy 1, policy_version 593755 (0.0007) [2023-12-27 23:29:43,276][106226] Updated weights for policy 0, policy_version 591677 (0.0006) [2023-12-27 23:29:43,321][106225] Updated weights for policy 1, policy_version 593765 (0.0006) [2023-12-27 23:29:43,330][106226] Updated weights for policy 0, policy_version 591687 (0.0009) [2023-12-27 23:29:43,369][106225] Updated weights for policy 1, policy_version 593775 (0.0008) [2023-12-27 23:29:43,931][106226] Updated weights for policy 0, policy_version 591697 (0.0009) [2023-12-27 23:29:43,984][106226] Updated weights for policy 0, policy_version 591707 (0.0010) [2023-12-27 23:29:44,036][106226] Updated weights for policy 0, policy_version 591717 (0.0010) [2023-12-27 23:29:44,094][106226] Updated weights for policy 0, policy_version 591727 (0.0010) [2023-12-27 23:29:44,160][106225] Updated weights for policy 1, policy_version 593785 (0.0008) [2023-12-27 23:29:44,217][106225] Updated weights for policy 1, policy_version 593795 (0.0007) [2023-12-27 23:29:44,269][106225] Updated weights for policy 1, policy_version 593805 (0.0007) [2023-12-27 23:29:44,764][106226] Updated weights for policy 0, policy_version 591737 (0.0011) [2023-12-27 23:29:44,827][106226] Updated weights for policy 0, policy_version 591747 (0.0011) [2023-12-27 23:29:44,882][106226] Updated weights for policy 0, policy_version 591757 (0.0011) [2023-12-27 23:29:45,050][106225] Updated weights for policy 1, policy_version 593815 (0.0008) [2023-12-27 23:29:45,115][106225] Updated weights for policy 1, policy_version 593825 (0.0007) [2023-12-27 23:29:45,187][106225] Updated weights for policy 1, policy_version 593835 (0.0008) [2023-12-27 23:29:45,620][106226] Updated weights for policy 0, policy_version 591767 (0.0007) [2023-12-27 23:29:45,685][106226] Updated weights for policy 0, policy_version 591777 (0.0006) [2023-12-27 23:29:45,746][106226] Updated weights for policy 0, policy_version 591787 (0.0006) [2023-12-27 23:29:45,844][106225] Updated weights for policy 1, policy_version 593845 (0.0009) [2023-12-27 23:29:45,899][106225] Updated weights for policy 1, policy_version 593855 (0.0008) [2023-12-27 23:29:45,957][106225] Updated weights for policy 1, policy_version 593865 (0.0009) [2023-12-27 23:29:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 303595520. Throughput: 0: 9671.4, 1: 10069.9. Samples: 303583336. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:46,175][105115] Avg episode reward: [(0, '-4.873'), (1, '-5.393')] [2023-12-27 23:29:46,380][106226] Updated weights for policy 0, policy_version 591797 (0.0009) [2023-12-27 23:29:46,426][106226] Updated weights for policy 0, policy_version 591807 (0.0010) [2023-12-27 23:29:46,477][106226] Updated weights for policy 0, policy_version 591817 (0.0010) [2023-12-27 23:29:46,629][106225] Updated weights for policy 1, policy_version 593875 (0.0008) [2023-12-27 23:29:46,682][106225] Updated weights for policy 1, policy_version 593885 (0.0007) [2023-12-27 23:29:46,742][106225] Updated weights for policy 1, policy_version 593895 (0.0007) [2023-12-27 23:29:47,099][106226] Updated weights for policy 0, policy_version 591827 (0.0009) [2023-12-27 23:29:47,156][106226] Updated weights for policy 0, policy_version 591837 (0.0006) [2023-12-27 23:29:47,219][106226] Updated weights for policy 0, policy_version 591847 (0.0007) [2023-12-27 23:29:47,467][106225] Updated weights for policy 1, policy_version 593905 (0.0008) [2023-12-27 23:29:47,532][106225] Updated weights for policy 1, policy_version 593915 (0.0010) [2023-12-27 23:29:47,597][106225] Updated weights for policy 1, policy_version 593925 (0.0009) [2023-12-27 23:29:47,648][106225] Updated weights for policy 1, policy_version 593935 (0.0009) [2023-12-27 23:29:47,801][106226] Updated weights for policy 0, policy_version 591857 (0.0005) [2023-12-27 23:29:47,858][106226] Updated weights for policy 0, policy_version 591867 (0.0008) [2023-12-27 23:29:47,914][106226] Updated weights for policy 0, policy_version 591877 (0.0008) [2023-12-27 23:29:47,974][106226] Updated weights for policy 0, policy_version 591887 (0.0008) [2023-12-27 23:29:48,410][106225] Updated weights for policy 1, policy_version 593945 (0.0010) [2023-12-27 23:29:48,475][106225] Updated weights for policy 1, policy_version 593955 (0.0011) [2023-12-27 23:29:48,537][106225] Updated weights for policy 1, policy_version 593965 (0.0010) [2023-12-27 23:29:48,627][106226] Updated weights for policy 0, policy_version 591897 (0.0009) [2023-12-27 23:29:48,675][106226] Updated weights for policy 0, policy_version 591907 (0.0010) [2023-12-27 23:29:48,719][106226] Updated weights for policy 0, policy_version 591917 (0.0010) [2023-12-27 23:29:49,263][106225] Updated weights for policy 1, policy_version 593975 (0.0010) [2023-12-27 23:29:49,331][106225] Updated weights for policy 1, policy_version 593985 (0.0010) [2023-12-27 23:29:49,396][106225] Updated weights for policy 1, policy_version 593995 (0.0010) [2023-12-27 23:29:49,492][106226] Updated weights for policy 0, policy_version 591927 (0.0011) [2023-12-27 23:29:49,554][106226] Updated weights for policy 0, policy_version 591937 (0.0011) [2023-12-27 23:29:49,611][106226] Updated weights for policy 0, policy_version 591947 (0.0010) [2023-12-27 23:29:50,132][106225] Updated weights for policy 1, policy_version 594005 (0.0008) [2023-12-27 23:29:50,193][106225] Updated weights for policy 1, policy_version 594015 (0.0005) [2023-12-27 23:29:50,258][106225] Updated weights for policy 1, policy_version 594025 (0.0007) [2023-12-27 23:29:50,341][106226] Updated weights for policy 0, policy_version 591957 (0.0011) [2023-12-27 23:29:50,399][106226] Updated weights for policy 0, policy_version 591967 (0.0011) [2023-12-27 23:29:50,463][106226] Updated weights for policy 0, policy_version 591977 (0.0010) [2023-12-27 23:29:50,952][106225] Updated weights for policy 1, policy_version 594035 (0.0008) [2023-12-27 23:29:51,013][106225] Updated weights for policy 1, policy_version 594045 (0.0009) [2023-12-27 23:29:51,080][106225] Updated weights for policy 1, policy_version 594055 (0.0007) [2023-12-27 23:29:51,130][106226] Updated weights for policy 0, policy_version 591987 (0.0007) [2023-12-27 23:29:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 303693824. Throughput: 0: 9726.8, 1: 10022.7. Samples: 303703532. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:51,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.400')] [2023-12-27 23:29:51,190][106226] Updated weights for policy 0, policy_version 591997 (0.0008) [2023-12-27 23:29:51,245][106226] Updated weights for policy 0, policy_version 592007 (0.0008) [2023-12-27 23:29:51,876][106225] Updated weights for policy 1, policy_version 594065 (0.0008) [2023-12-27 23:29:51,934][106225] Updated weights for policy 1, policy_version 594075 (0.0008) [2023-12-27 23:29:51,997][106225] Updated weights for policy 1, policy_version 594085 (0.0008) [2023-12-27 23:29:52,029][106226] Updated weights for policy 0, policy_version 592017 (0.0008) [2023-12-27 23:29:52,053][106225] Updated weights for policy 1, policy_version 594095 (0.0007) [2023-12-27 23:29:52,089][106226] Updated weights for policy 0, policy_version 592027 (0.0011) [2023-12-27 23:29:52,149][106226] Updated weights for policy 0, policy_version 592037 (0.0011) [2023-12-27 23:29:52,199][106226] Updated weights for policy 0, policy_version 592047 (0.0010) [2023-12-27 23:29:52,790][106225] Updated weights for policy 1, policy_version 594105 (0.0007) [2023-12-27 23:29:52,851][106225] Updated weights for policy 1, policy_version 594115 (0.0008) [2023-12-27 23:29:52,909][106225] Updated weights for policy 1, policy_version 594125 (0.0008) [2023-12-27 23:29:52,933][106226] Updated weights for policy 0, policy_version 592057 (0.0011) [2023-12-27 23:29:52,987][106226] Updated weights for policy 0, policy_version 592067 (0.0010) [2023-12-27 23:29:53,044][106226] Updated weights for policy 0, policy_version 592077 (0.0010) [2023-12-27 23:29:53,614][106225] Updated weights for policy 1, policy_version 594135 (0.0008) [2023-12-27 23:29:53,633][106226] Updated weights for policy 0, policy_version 592087 (0.0010) [2023-12-27 23:29:53,672][106225] Updated weights for policy 1, policy_version 594145 (0.0007) [2023-12-27 23:29:53,683][106226] Updated weights for policy 0, policy_version 592097 (0.0010) [2023-12-27 23:29:53,728][106225] Updated weights for policy 1, policy_version 594155 (0.0008) [2023-12-27 23:29:53,737][106226] Updated weights for policy 0, policy_version 592107 (0.0010) [2023-12-27 23:29:54,349][106225] Updated weights for policy 1, policy_version 594165 (0.0007) [2023-12-27 23:29:54,376][106226] Updated weights for policy 0, policy_version 592117 (0.0008) [2023-12-27 23:29:54,409][106225] Updated weights for policy 1, policy_version 594175 (0.0006) [2023-12-27 23:29:54,429][106226] Updated weights for policy 0, policy_version 592127 (0.0006) [2023-12-27 23:29:54,479][106225] Updated weights for policy 1, policy_version 594185 (0.0008) [2023-12-27 23:29:54,490][106226] Updated weights for policy 0, policy_version 592137 (0.0005) [2023-12-27 23:29:55,105][106226] Updated weights for policy 0, policy_version 592147 (0.0006) [2023-12-27 23:29:55,120][106225] Updated weights for policy 1, policy_version 594195 (0.0008) [2023-12-27 23:29:55,163][106226] Updated weights for policy 0, policy_version 592157 (0.0007) [2023-12-27 23:29:55,177][106225] Updated weights for policy 1, policy_version 594205 (0.0010) [2023-12-27 23:29:55,213][106226] Updated weights for policy 0, policy_version 592167 (0.0010) [2023-12-27 23:29:55,236][106225] Updated weights for policy 1, policy_version 594215 (0.0010) [2023-12-27 23:29:55,893][106225] Updated weights for policy 1, policy_version 594225 (0.0010) [2023-12-27 23:29:55,910][106226] Updated weights for policy 0, policy_version 592177 (0.0011) [2023-12-27 23:29:55,954][106225] Updated weights for policy 1, policy_version 594235 (0.0008) [2023-12-27 23:29:55,964][106226] Updated weights for policy 0, policy_version 592187 (0.0010) [2023-12-27 23:29:56,015][106225] Updated weights for policy 1, policy_version 594245 (0.0005) [2023-12-27 23:29:56,024][106226] Updated weights for policy 0, policy_version 592197 (0.0010) [2023-12-27 23:29:56,081][106225] Updated weights for policy 1, policy_version 594255 (0.0005) [2023-12-27 23:29:56,081][106226] Updated weights for policy 0, policy_version 592207 (0.0011) [2023-12-27 23:29:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 303800320. Throughput: 0: 9742.9, 1: 9870.0. Samples: 303760744. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:29:56,175][105115] Avg episode reward: [(0, '-5.057'), (1, '-5.791')] [2023-12-27 23:29:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000594256_152158208.pth... [2023-12-27 23:29:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000592208_151642112.pth... [2023-12-27 23:29:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000593104_151863296.pth [2023-12-27 23:29:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000591056_151347200.pth [2023-12-27 23:29:56,697][106226] Updated weights for policy 0, policy_version 592217 (0.0006) [2023-12-27 23:29:56,752][106226] Updated weights for policy 0, policy_version 592227 (0.0005) [2023-12-27 23:29:56,791][106225] Updated weights for policy 1, policy_version 594265 (0.0007) [2023-12-27 23:29:56,796][106226] Updated weights for policy 0, policy_version 592237 (0.0005) [2023-12-27 23:29:56,838][106225] Updated weights for policy 1, policy_version 594275 (0.0008) [2023-12-27 23:29:56,883][106225] Updated weights for policy 1, policy_version 594285 (0.0007) [2023-12-27 23:29:57,350][106226] Updated weights for policy 0, policy_version 592247 (0.0006) [2023-12-27 23:29:57,421][106226] Updated weights for policy 0, policy_version 592257 (0.0010) [2023-12-27 23:29:57,485][106226] Updated weights for policy 0, policy_version 592267 (0.0006) [2023-12-27 23:29:57,591][106225] Updated weights for policy 1, policy_version 594295 (0.0008) [2023-12-27 23:29:57,656][106225] Updated weights for policy 1, policy_version 594305 (0.0006) [2023-12-27 23:29:57,707][106225] Updated weights for policy 1, policy_version 594315 (0.0007) [2023-12-27 23:29:58,144][106226] Updated weights for policy 0, policy_version 592277 (0.0008) [2023-12-27 23:29:58,195][106226] Updated weights for policy 0, policy_version 592287 (0.0010) [2023-12-27 23:29:58,259][106226] Updated weights for policy 0, policy_version 592297 (0.0011) [2023-12-27 23:29:58,326][106225] Updated weights for policy 1, policy_version 594325 (0.0007) [2023-12-27 23:29:58,395][106225] Updated weights for policy 1, policy_version 594335 (0.0009) [2023-12-27 23:29:58,467][106225] Updated weights for policy 1, policy_version 594345 (0.0008) [2023-12-27 23:29:59,072][106226] Updated weights for policy 0, policy_version 592307 (0.0011) [2023-12-27 23:29:59,141][106226] Updated weights for policy 0, policy_version 592317 (0.0008) [2023-12-27 23:29:59,200][106226] Updated weights for policy 0, policy_version 592327 (0.0008) [2023-12-27 23:29:59,317][106225] Updated weights for policy 1, policy_version 594355 (0.0009) [2023-12-27 23:29:59,376][106225] Updated weights for policy 1, policy_version 594365 (0.0009) [2023-12-27 23:29:59,425][106225] Updated weights for policy 1, policy_version 594375 (0.0009) [2023-12-27 23:29:59,991][106226] Updated weights for policy 0, policy_version 592337 (0.0008) [2023-12-27 23:30:00,054][106226] Updated weights for policy 0, policy_version 592347 (0.0008) [2023-12-27 23:30:00,120][106226] Updated weights for policy 0, policy_version 592357 (0.0008) [2023-12-27 23:30:00,185][106226] Updated weights for policy 0, policy_version 592367 (0.0008) [2023-12-27 23:30:00,203][106225] Updated weights for policy 1, policy_version 594385 (0.0010) [2023-12-27 23:30:00,259][106225] Updated weights for policy 1, policy_version 594395 (0.0006) [2023-12-27 23:30:00,308][106225] Updated weights for policy 1, policy_version 594405 (0.0005) [2023-12-27 23:30:00,359][106225] Updated weights for policy 1, policy_version 594415 (0.0010) [2023-12-27 23:30:00,811][106226] Updated weights for policy 0, policy_version 592377 (0.0006) [2023-12-27 23:30:00,869][106226] Updated weights for policy 0, policy_version 592387 (0.0006) [2023-12-27 23:30:00,931][106226] Updated weights for policy 0, policy_version 592397 (0.0009) [2023-12-27 23:30:01,060][106225] Updated weights for policy 1, policy_version 594425 (0.0008) [2023-12-27 23:30:01,116][106225] Updated weights for policy 1, policy_version 594435 (0.0008) [2023-12-27 23:30:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 303890432. Throughput: 0: 9800.3, 1: 9913.1. Samples: 303882052. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:01,175][105115] Avg episode reward: [(0, '-5.197'), (1, '-5.760')] [2023-12-27 23:30:01,179][106225] Updated weights for policy 1, policy_version 594445 (0.0008) [2023-12-27 23:30:01,679][106226] Updated weights for policy 0, policy_version 592407 (0.0009) [2023-12-27 23:30:01,742][106226] Updated weights for policy 0, policy_version 592417 (0.0008) [2023-12-27 23:30:01,796][106226] Updated weights for policy 0, policy_version 592427 (0.0009) [2023-12-27 23:30:01,864][106225] Updated weights for policy 1, policy_version 594455 (0.0009) [2023-12-27 23:30:01,919][106225] Updated weights for policy 1, policy_version 594465 (0.0008) [2023-12-27 23:30:01,977][106225] Updated weights for policy 1, policy_version 594475 (0.0008) [2023-12-27 23:30:02,577][106226] Updated weights for policy 0, policy_version 592437 (0.0008) [2023-12-27 23:30:02,632][106226] Updated weights for policy 0, policy_version 592447 (0.0008) [2023-12-27 23:30:02,649][106225] Updated weights for policy 1, policy_version 594485 (0.0007) [2023-12-27 23:30:02,677][106226] Updated weights for policy 0, policy_version 592457 (0.0008) [2023-12-27 23:30:02,707][106225] Updated weights for policy 1, policy_version 594495 (0.0006) [2023-12-27 23:30:02,768][106225] Updated weights for policy 1, policy_version 594505 (0.0008) [2023-12-27 23:30:03,359][106225] Updated weights for policy 1, policy_version 594515 (0.0007) [2023-12-27 23:30:03,369][106226] Updated weights for policy 0, policy_version 592467 (0.0007) [2023-12-27 23:30:03,405][106225] Updated weights for policy 1, policy_version 594525 (0.0005) [2023-12-27 23:30:03,427][106226] Updated weights for policy 0, policy_version 592477 (0.0006) [2023-12-27 23:30:03,458][106225] Updated weights for policy 1, policy_version 594535 (0.0005) [2023-12-27 23:30:03,483][106226] Updated weights for policy 0, policy_version 592487 (0.0010) [2023-12-27 23:30:04,021][106225] Updated weights for policy 1, policy_version 594545 (0.0006) [2023-12-27 23:30:04,080][106225] Updated weights for policy 1, policy_version 594555 (0.0008) [2023-12-27 23:30:04,138][106225] Updated weights for policy 1, policy_version 594565 (0.0008) [2023-12-27 23:30:04,149][106226] Updated weights for policy 0, policy_version 592497 (0.0009) [2023-12-27 23:30:04,200][106225] Updated weights for policy 1, policy_version 594575 (0.0007) [2023-12-27 23:30:04,207][106226] Updated weights for policy 0, policy_version 592507 (0.0007) [2023-12-27 23:30:04,264][106226] Updated weights for policy 0, policy_version 592517 (0.0009) [2023-12-27 23:30:04,327][106226] Updated weights for policy 0, policy_version 592527 (0.0009) [2023-12-27 23:30:04,966][106225] Updated weights for policy 1, policy_version 594585 (0.0010) [2023-12-27 23:30:05,005][106226] Updated weights for policy 0, policy_version 592537 (0.0009) [2023-12-27 23:30:05,023][106225] Updated weights for policy 1, policy_version 594595 (0.0006) [2023-12-27 23:30:05,057][106226] Updated weights for policy 0, policy_version 592547 (0.0010) [2023-12-27 23:30:05,075][106225] Updated weights for policy 1, policy_version 594605 (0.0005) [2023-12-27 23:30:05,103][106226] Updated weights for policy 0, policy_version 592557 (0.0006) [2023-12-27 23:30:05,597][106225] Updated weights for policy 1, policy_version 594615 (0.0005) [2023-12-27 23:30:05,653][106225] Updated weights for policy 1, policy_version 594625 (0.0009) [2023-12-27 23:30:05,708][106226] Updated weights for policy 0, policy_version 592567 (0.0005) [2023-12-27 23:30:05,711][106225] Updated weights for policy 1, policy_version 594635 (0.0010) [2023-12-27 23:30:05,753][106226] Updated weights for policy 0, policy_version 592577 (0.0005) [2023-12-27 23:30:05,802][106226] Updated weights for policy 0, policy_version 592587 (0.0005) [2023-12-27 23:30:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 303996928. Throughput: 0: 9885.3, 1: 9990.3. Samples: 304006512. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:06,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-5.588')] [2023-12-27 23:30:06,456][106225] Updated weights for policy 1, policy_version 594645 (0.0010) [2023-12-27 23:30:06,479][106226] Updated weights for policy 0, policy_version 592597 (0.0006) [2023-12-27 23:30:06,519][106225] Updated weights for policy 1, policy_version 594655 (0.0010) [2023-12-27 23:30:06,547][106226] Updated weights for policy 0, policy_version 592607 (0.0007) [2023-12-27 23:30:06,584][106225] Updated weights for policy 1, policy_version 594665 (0.0010) [2023-12-27 23:30:06,610][106226] Updated weights for policy 0, policy_version 592617 (0.0007) [2023-12-27 23:30:07,290][106225] Updated weights for policy 1, policy_version 594675 (0.0010) [2023-12-27 23:30:07,348][106225] Updated weights for policy 1, policy_version 594685 (0.0010) [2023-12-27 23:30:07,370][106226] Updated weights for policy 0, policy_version 592627 (0.0007) [2023-12-27 23:30:07,399][106225] Updated weights for policy 1, policy_version 594695 (0.0010) [2023-12-27 23:30:07,423][106226] Updated weights for policy 0, policy_version 592637 (0.0005) [2023-12-27 23:30:07,481][106226] Updated weights for policy 0, policy_version 592647 (0.0008) [2023-12-27 23:30:08,044][106225] Updated weights for policy 1, policy_version 594705 (0.0010) [2023-12-27 23:30:08,113][106225] Updated weights for policy 1, policy_version 594715 (0.0006) [2023-12-27 23:30:08,169][106225] Updated weights for policy 1, policy_version 594725 (0.0010) [2023-12-27 23:30:08,208][106226] Updated weights for policy 0, policy_version 592657 (0.0008) [2023-12-27 23:30:08,227][106225] Updated weights for policy 1, policy_version 594735 (0.0010) [2023-12-27 23:30:08,260][106226] Updated weights for policy 0, policy_version 592667 (0.0005) [2023-12-27 23:30:08,313][106226] Updated weights for policy 0, policy_version 592677 (0.0005) [2023-12-27 23:30:08,380][106226] Updated weights for policy 0, policy_version 592687 (0.0008) [2023-12-27 23:30:08,909][106225] Updated weights for policy 1, policy_version 594745 (0.0009) [2023-12-27 23:30:08,974][106225] Updated weights for policy 1, policy_version 594755 (0.0008) [2023-12-27 23:30:09,023][106225] Updated weights for policy 1, policy_version 594765 (0.0006) [2023-12-27 23:30:09,066][106226] Updated weights for policy 0, policy_version 592697 (0.0008) [2023-12-27 23:30:09,116][106226] Updated weights for policy 0, policy_version 592707 (0.0009) [2023-12-27 23:30:09,166][106226] Updated weights for policy 0, policy_version 592717 (0.0007) [2023-12-27 23:30:09,724][106225] Updated weights for policy 1, policy_version 594775 (0.0010) [2023-12-27 23:30:09,777][106225] Updated weights for policy 1, policy_version 594785 (0.0009) [2023-12-27 23:30:09,840][106225] Updated weights for policy 1, policy_version 594795 (0.0007) [2023-12-27 23:30:09,953][106226] Updated weights for policy 0, policy_version 592727 (0.0008) [2023-12-27 23:30:10,023][106226] Updated weights for policy 0, policy_version 592737 (0.0008) [2023-12-27 23:30:10,088][106226] Updated weights for policy 0, policy_version 592747 (0.0008) [2023-12-27 23:30:10,582][106225] Updated weights for policy 1, policy_version 594805 (0.0009) [2023-12-27 23:30:10,642][106225] Updated weights for policy 1, policy_version 594815 (0.0010) [2023-12-27 23:30:10,696][106225] Updated weights for policy 1, policy_version 594825 (0.0010) [2023-12-27 23:30:10,825][106226] Updated weights for policy 0, policy_version 592757 (0.0010) [2023-12-27 23:30:10,876][106226] Updated weights for policy 0, policy_version 592767 (0.0011) [2023-12-27 23:30:10,933][106226] Updated weights for policy 0, policy_version 592777 (0.0010) [2023-12-27 23:30:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 304095232. Throughput: 0: 9883.8, 1: 10018.6. Samples: 304065556. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:11,175][105115] Avg episode reward: [(0, '-5.061'), (1, '-5.567')] [2023-12-27 23:30:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000594832_152305664.pth... [2023-12-27 23:30:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000592784_151789568.pth... [2023-12-27 23:30:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000591600_151486464.pth [2023-12-27 23:30:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000593680_152010752.pth [2023-12-27 23:30:11,484][106225] Updated weights for policy 1, policy_version 594835 (0.0011) [2023-12-27 23:30:11,548][106225] Updated weights for policy 1, policy_version 594845 (0.0011) [2023-12-27 23:30:11,616][106225] Updated weights for policy 1, policy_version 594855 (0.0011) [2023-12-27 23:30:11,656][106226] Updated weights for policy 0, policy_version 592787 (0.0010) [2023-12-27 23:30:11,720][106226] Updated weights for policy 0, policy_version 592797 (0.0008) [2023-12-27 23:30:11,790][106226] Updated weights for policy 0, policy_version 592807 (0.0009) [2023-12-27 23:30:12,369][106225] Updated weights for policy 1, policy_version 594865 (0.0008) [2023-12-27 23:30:12,435][106225] Updated weights for policy 1, policy_version 594875 (0.0008) [2023-12-27 23:30:12,493][106225] Updated weights for policy 1, policy_version 594885 (0.0008) [2023-12-27 23:30:12,548][106226] Updated weights for policy 0, policy_version 592817 (0.0009) [2023-12-27 23:30:12,551][106225] Updated weights for policy 1, policy_version 594895 (0.0008) [2023-12-27 23:30:12,609][106226] Updated weights for policy 0, policy_version 592827 (0.0008) [2023-12-27 23:30:12,667][106226] Updated weights for policy 0, policy_version 592837 (0.0009) [2023-12-27 23:30:12,730][106226] Updated weights for policy 0, policy_version 592847 (0.0008) [2023-12-27 23:30:13,289][106225] Updated weights for policy 1, policy_version 594905 (0.0008) [2023-12-27 23:30:13,343][106225] Updated weights for policy 1, policy_version 594915 (0.0009) [2023-12-27 23:30:13,371][106226] Updated weights for policy 0, policy_version 592857 (0.0006) [2023-12-27 23:30:13,397][106225] Updated weights for policy 1, policy_version 594925 (0.0009) [2023-12-27 23:30:13,419][106226] Updated weights for policy 0, policy_version 592867 (0.0006) [2023-12-27 23:30:13,481][106226] Updated weights for policy 0, policy_version 592877 (0.0006) [2023-12-27 23:30:14,019][106226] Updated weights for policy 0, policy_version 592887 (0.0008) [2023-12-27 23:30:14,083][106226] Updated weights for policy 0, policy_version 592897 (0.0009) [2023-12-27 23:30:14,123][106225] Updated weights for policy 1, policy_version 594935 (0.0006) [2023-12-27 23:30:14,149][106226] Updated weights for policy 0, policy_version 592907 (0.0006) [2023-12-27 23:30:14,176][106225] Updated weights for policy 1, policy_version 594945 (0.0006) [2023-12-27 23:30:14,232][106225] Updated weights for policy 1, policy_version 594955 (0.0006) [2023-12-27 23:30:14,821][106226] Updated weights for policy 0, policy_version 592917 (0.0007) [2023-12-27 23:30:14,884][106226] Updated weights for policy 0, policy_version 592927 (0.0008) [2023-12-27 23:30:14,931][106225] Updated weights for policy 1, policy_version 594965 (0.0008) [2023-12-27 23:30:14,949][106226] Updated weights for policy 0, policy_version 592937 (0.0007) [2023-12-27 23:30:14,994][106225] Updated weights for policy 1, policy_version 594975 (0.0006) [2023-12-27 23:30:15,064][106225] Updated weights for policy 1, policy_version 594985 (0.0007) [2023-12-27 23:30:15,649][106225] Updated weights for policy 1, policy_version 594995 (0.0007) [2023-12-27 23:30:15,715][106225] Updated weights for policy 1, policy_version 595005 (0.0007) [2023-12-27 23:30:15,734][106226] Updated weights for policy 0, policy_version 592947 (0.0007) [2023-12-27 23:30:15,773][106225] Updated weights for policy 1, policy_version 595015 (0.0009) [2023-12-27 23:30:15,798][106226] Updated weights for policy 0, policy_version 592957 (0.0007) [2023-12-27 23:30:15,858][106226] Updated weights for policy 0, policy_version 592967 (0.0009) [2023-12-27 23:30:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 304193536. Throughput: 0: 9961.0, 1: 9867.8. Samples: 304181660. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:16,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-5.606')] [2023-12-27 23:30:16,361][106225] Updated weights for policy 1, policy_version 595025 (0.0007) [2023-12-27 23:30:16,419][106225] Updated weights for policy 1, policy_version 595035 (0.0005) [2023-12-27 23:30:16,482][106225] Updated weights for policy 1, policy_version 595045 (0.0006) [2023-12-27 23:30:16,547][106225] Updated weights for policy 1, policy_version 595055 (0.0008) [2023-12-27 23:30:16,549][106226] Updated weights for policy 0, policy_version 592977 (0.0008) [2023-12-27 23:30:16,603][106226] Updated weights for policy 0, policy_version 592987 (0.0008) [2023-12-27 23:30:16,661][106226] Updated weights for policy 0, policy_version 592997 (0.0009) [2023-12-27 23:30:16,729][106226] Updated weights for policy 0, policy_version 593007 (0.0011) [2023-12-27 23:30:17,102][106225] Updated weights for policy 1, policy_version 595065 (0.0008) [2023-12-27 23:30:17,167][106225] Updated weights for policy 1, policy_version 595075 (0.0009) [2023-12-27 23:30:17,226][106225] Updated weights for policy 1, policy_version 595085 (0.0008) [2023-12-27 23:30:17,469][106226] Updated weights for policy 0, policy_version 593017 (0.0006) [2023-12-27 23:30:17,514][106226] Updated weights for policy 0, policy_version 593027 (0.0006) [2023-12-27 23:30:17,574][106226] Updated weights for policy 0, policy_version 593037 (0.0008) [2023-12-27 23:30:17,783][106225] Updated weights for policy 1, policy_version 595095 (0.0006) [2023-12-27 23:30:17,832][106225] Updated weights for policy 1, policy_version 595105 (0.0005) [2023-12-27 23:30:17,884][106225] Updated weights for policy 1, policy_version 595115 (0.0005) [2023-12-27 23:30:18,310][106226] Updated weights for policy 0, policy_version 593047 (0.0008) [2023-12-27 23:30:18,379][106226] Updated weights for policy 0, policy_version 593057 (0.0008) [2023-12-27 23:30:18,439][106226] Updated weights for policy 0, policy_version 593067 (0.0008) [2023-12-27 23:30:18,535][106225] Updated weights for policy 1, policy_version 595125 (0.0007) [2023-12-27 23:30:18,593][106225] Updated weights for policy 1, policy_version 595135 (0.0008) [2023-12-27 23:30:18,655][106225] Updated weights for policy 1, policy_version 595145 (0.0009) [2023-12-27 23:30:19,146][106226] Updated weights for policy 0, policy_version 593077 (0.0010) [2023-12-27 23:30:19,198][106226] Updated weights for policy 0, policy_version 593087 (0.0011) [2023-12-27 23:30:19,262][106226] Updated weights for policy 0, policy_version 593097 (0.0010) [2023-12-27 23:30:19,443][106225] Updated weights for policy 1, policy_version 595155 (0.0008) [2023-12-27 23:30:19,501][106225] Updated weights for policy 1, policy_version 595165 (0.0008) [2023-12-27 23:30:19,558][106225] Updated weights for policy 1, policy_version 595175 (0.0008) [2023-12-27 23:30:20,079][106226] Updated weights for policy 0, policy_version 593107 (0.0010) [2023-12-27 23:30:20,144][106226] Updated weights for policy 0, policy_version 593117 (0.0011) [2023-12-27 23:30:20,205][106226] Updated weights for policy 0, policy_version 593127 (0.0011) [2023-12-27 23:30:20,315][106225] Updated weights for policy 1, policy_version 595185 (0.0008) [2023-12-27 23:30:20,376][106225] Updated weights for policy 1, policy_version 595195 (0.0009) [2023-12-27 23:30:20,439][106225] Updated weights for policy 1, policy_version 595205 (0.0008) [2023-12-27 23:30:20,489][106225] Updated weights for policy 1, policy_version 595215 (0.0007) [2023-12-27 23:30:20,944][106226] Updated weights for policy 0, policy_version 593137 (0.0010) [2023-12-27 23:30:21,012][106226] Updated weights for policy 0, policy_version 593147 (0.0011) [2023-12-27 23:30:21,084][106226] Updated weights for policy 0, policy_version 593157 (0.0011) [2023-12-27 23:30:21,149][106226] Updated weights for policy 0, policy_version 593167 (0.0011) [2023-12-27 23:30:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 304291840. Throughput: 0: 9906.8, 1: 9896.6. Samples: 304300484. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:21,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.417')] [2023-12-27 23:30:21,291][106225] Updated weights for policy 1, policy_version 595225 (0.0009) [2023-12-27 23:30:21,358][106225] Updated weights for policy 1, policy_version 595235 (0.0008) [2023-12-27 23:30:21,429][106225] Updated weights for policy 1, policy_version 595245 (0.0008) [2023-12-27 23:30:21,971][106226] Updated weights for policy 0, policy_version 593177 (0.0007) [2023-12-27 23:30:22,035][106226] Updated weights for policy 0, policy_version 593187 (0.0007) [2023-12-27 23:30:22,092][106226] Updated weights for policy 0, policy_version 593197 (0.0009) [2023-12-27 23:30:22,201][106225] Updated weights for policy 1, policy_version 595255 (0.0006) [2023-12-27 23:30:22,263][106225] Updated weights for policy 1, policy_version 595265 (0.0008) [2023-12-27 23:30:22,328][106225] Updated weights for policy 1, policy_version 595275 (0.0006) [2023-12-27 23:30:22,859][106226] Updated weights for policy 0, policy_version 593207 (0.0010) [2023-12-27 23:30:22,919][106226] Updated weights for policy 0, policy_version 593217 (0.0010) [2023-12-27 23:30:22,981][106226] Updated weights for policy 0, policy_version 593227 (0.0011) [2023-12-27 23:30:23,048][106225] Updated weights for policy 1, policy_version 595285 (0.0008) [2023-12-27 23:30:23,109][106225] Updated weights for policy 1, policy_version 595295 (0.0008) [2023-12-27 23:30:23,168][106225] Updated weights for policy 1, policy_version 595305 (0.0008) [2023-12-27 23:30:23,592][106226] Updated weights for policy 0, policy_version 593237 (0.0008) [2023-12-27 23:30:23,659][106226] Updated weights for policy 0, policy_version 593247 (0.0006) [2023-12-27 23:30:23,715][106226] Updated weights for policy 0, policy_version 593257 (0.0005) [2023-12-27 23:30:23,901][106225] Updated weights for policy 1, policy_version 595315 (0.0009) [2023-12-27 23:30:23,962][106225] Updated weights for policy 1, policy_version 595325 (0.0008) [2023-12-27 23:30:24,012][106225] Updated weights for policy 1, policy_version 595335 (0.0009) [2023-12-27 23:30:24,267][106226] Updated weights for policy 0, policy_version 593267 (0.0007) [2023-12-27 23:30:24,331][106226] Updated weights for policy 0, policy_version 593277 (0.0009) [2023-12-27 23:30:24,393][106226] Updated weights for policy 0, policy_version 593287 (0.0009) [2023-12-27 23:30:24,615][106225] Updated weights for policy 1, policy_version 595345 (0.0008) [2023-12-27 23:30:24,673][106225] Updated weights for policy 1, policy_version 595355 (0.0005) [2023-12-27 23:30:24,738][106225] Updated weights for policy 1, policy_version 595365 (0.0005) [2023-12-27 23:30:24,804][106225] Updated weights for policy 1, policy_version 595375 (0.0006) [2023-12-27 23:30:25,212][106226] Updated weights for policy 0, policy_version 593297 (0.0009) [2023-12-27 23:30:25,268][106226] Updated weights for policy 0, policy_version 593307 (0.0008) [2023-12-27 23:30:25,323][106226] Updated weights for policy 0, policy_version 593317 (0.0007) [2023-12-27 23:30:25,351][106225] Updated weights for policy 1, policy_version 595385 (0.0010) [2023-12-27 23:30:25,377][106226] Updated weights for policy 0, policy_version 593327 (0.0006) [2023-12-27 23:30:25,398][106225] Updated weights for policy 1, policy_version 595395 (0.0007) [2023-12-27 23:30:25,449][106225] Updated weights for policy 1, policy_version 595405 (0.0005) [2023-12-27 23:30:26,052][106225] Updated weights for policy 1, policy_version 595415 (0.0005) [2023-12-27 23:30:26,115][106225] Updated weights for policy 1, policy_version 595425 (0.0006) [2023-12-27 23:30:26,151][106226] Updated weights for policy 0, policy_version 593337 (0.0006) [2023-12-27 23:30:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 304381952. Throughput: 0: 9929.9, 1: 9843.6. Samples: 304357884. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:26,176][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.252')] [2023-12-27 23:30:26,178][106225] Updated weights for policy 1, policy_version 595435 (0.0006) [2023-12-27 23:30:26,203][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000595440_152461312.pth... [2023-12-27 23:30:26,205][106226] Updated weights for policy 0, policy_version 593347 (0.0005) [2023-12-27 23:30:26,206][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000594256_152158208.pth [2023-12-27 23:30:26,259][106226] Updated weights for policy 0, policy_version 593357 (0.0006) [2023-12-27 23:30:26,276][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000593360_151937024.pth... [2023-12-27 23:30:26,279][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000592208_151642112.pth [2023-12-27 23:30:26,753][106225] Updated weights for policy 1, policy_version 595445 (0.0008) [2023-12-27 23:30:26,802][106225] Updated weights for policy 1, policy_version 595455 (0.0010) [2023-12-27 23:30:26,820][106226] Updated weights for policy 0, policy_version 593367 (0.0006) [2023-12-27 23:30:26,858][106225] Updated weights for policy 1, policy_version 595465 (0.0010) [2023-12-27 23:30:26,874][106226] Updated weights for policy 0, policy_version 593377 (0.0006) [2023-12-27 23:30:26,930][106226] Updated weights for policy 0, policy_version 593387 (0.0005) [2023-12-27 23:30:27,498][106226] Updated weights for policy 0, policy_version 593397 (0.0007) [2023-12-27 23:30:27,555][106226] Updated weights for policy 0, policy_version 593407 (0.0009) [2023-12-27 23:30:27,557][106225] Updated weights for policy 1, policy_version 595475 (0.0009) [2023-12-27 23:30:27,614][106225] Updated weights for policy 1, policy_version 595485 (0.0006) [2023-12-27 23:30:27,618][106226] Updated weights for policy 0, policy_version 593417 (0.0008) [2023-12-27 23:30:27,675][106225] Updated weights for policy 1, policy_version 595495 (0.0008) [2023-12-27 23:30:28,213][106226] Updated weights for policy 0, policy_version 593427 (0.0006) [2023-12-27 23:30:28,270][106226] Updated weights for policy 0, policy_version 593437 (0.0006) [2023-12-27 23:30:28,327][106226] Updated weights for policy 0, policy_version 593447 (0.0006) [2023-12-27 23:30:28,360][106225] Updated weights for policy 1, policy_version 595505 (0.0007) [2023-12-27 23:30:28,414][106225] Updated weights for policy 1, policy_version 595515 (0.0008) [2023-12-27 23:30:28,475][106225] Updated weights for policy 1, policy_version 595525 (0.0008) [2023-12-27 23:30:28,537][106225] Updated weights for policy 1, policy_version 595535 (0.0007) [2023-12-27 23:30:29,000][106226] Updated weights for policy 0, policy_version 593457 (0.0008) [2023-12-27 23:30:29,064][106226] Updated weights for policy 0, policy_version 593467 (0.0008) [2023-12-27 23:30:29,121][106226] Updated weights for policy 0, policy_version 593477 (0.0008) [2023-12-27 23:30:29,172][106226] Updated weights for policy 0, policy_version 593487 (0.0008) [2023-12-27 23:30:29,258][106225] Updated weights for policy 1, policy_version 595545 (0.0007) [2023-12-27 23:30:29,318][106225] Updated weights for policy 1, policy_version 595555 (0.0006) [2023-12-27 23:30:29,393][106225] Updated weights for policy 1, policy_version 595565 (0.0008) [2023-12-27 23:30:29,859][106226] Updated weights for policy 0, policy_version 593497 (0.0008) [2023-12-27 23:30:29,917][106226] Updated weights for policy 0, policy_version 593507 (0.0008) [2023-12-27 23:30:29,978][106226] Updated weights for policy 0, policy_version 593517 (0.0007) [2023-12-27 23:30:30,103][106225] Updated weights for policy 1, policy_version 595575 (0.0008) [2023-12-27 23:30:30,160][106225] Updated weights for policy 1, policy_version 595585 (0.0007) [2023-12-27 23:30:30,209][106225] Updated weights for policy 1, policy_version 595595 (0.0007) [2023-12-27 23:30:30,692][106226] Updated weights for policy 0, policy_version 593527 (0.0009) [2023-12-27 23:30:30,748][106226] Updated weights for policy 0, policy_version 593537 (0.0006) [2023-12-27 23:30:30,810][106226] Updated weights for policy 0, policy_version 593547 (0.0005) [2023-12-27 23:30:30,836][106225] Updated weights for policy 1, policy_version 595605 (0.0009) [2023-12-27 23:30:30,895][106225] Updated weights for policy 1, policy_version 595615 (0.0009) [2023-12-27 23:30:30,944][106225] Updated weights for policy 1, policy_version 595625 (0.0008) [2023-12-27 23:30:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 304496640. Throughput: 0: 10009.1, 1: 9998.4. Samples: 304483676. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:31,175][105115] Avg episode reward: [(0, '-5.034'), (1, '-5.669')] [2023-12-27 23:30:31,478][106226] Updated weights for policy 0, policy_version 593557 (0.0007) [2023-12-27 23:30:31,530][106226] Updated weights for policy 0, policy_version 593567 (0.0008) [2023-12-27 23:30:31,585][106226] Updated weights for policy 0, policy_version 593577 (0.0008) [2023-12-27 23:30:31,694][106225] Updated weights for policy 1, policy_version 595635 (0.0008) [2023-12-27 23:30:31,759][106225] Updated weights for policy 1, policy_version 595645 (0.0008) [2023-12-27 23:30:31,806][106225] Updated weights for policy 1, policy_version 595655 (0.0008) [2023-12-27 23:30:32,266][106226] Updated weights for policy 0, policy_version 593587 (0.0008) [2023-12-27 23:30:32,334][106226] Updated weights for policy 0, policy_version 593597 (0.0008) [2023-12-27 23:30:32,413][106226] Updated weights for policy 0, policy_version 593607 (0.0009) [2023-12-27 23:30:32,575][106225] Updated weights for policy 1, policy_version 595665 (0.0008) [2023-12-27 23:30:32,635][106225] Updated weights for policy 1, policy_version 595675 (0.0008) [2023-12-27 23:30:32,703][106225] Updated weights for policy 1, policy_version 595685 (0.0006) [2023-12-27 23:30:32,767][106225] Updated weights for policy 1, policy_version 595695 (0.0007) [2023-12-27 23:30:33,162][106226] Updated weights for policy 0, policy_version 593617 (0.0008) [2023-12-27 23:30:33,217][106226] Updated weights for policy 0, policy_version 593627 (0.0008) [2023-12-27 23:30:33,278][106226] Updated weights for policy 0, policy_version 593637 (0.0008) [2023-12-27 23:30:33,335][106226] Updated weights for policy 0, policy_version 593647 (0.0007) [2023-12-27 23:30:33,455][106225] Updated weights for policy 1, policy_version 595705 (0.0006) [2023-12-27 23:30:33,515][106225] Updated weights for policy 1, policy_version 595715 (0.0005) [2023-12-27 23:30:33,575][106225] Updated weights for policy 1, policy_version 595725 (0.0005) [2023-12-27 23:30:34,072][106226] Updated weights for policy 0, policy_version 593657 (0.0008) [2023-12-27 23:30:34,123][106226] Updated weights for policy 0, policy_version 593667 (0.0008) [2023-12-27 23:30:34,132][106225] Updated weights for policy 1, policy_version 595735 (0.0005) [2023-12-27 23:30:34,203][106226] Updated weights for policy 0, policy_version 593677 (0.0008) [2023-12-27 23:30:34,214][106225] Updated weights for policy 1, policy_version 595745 (0.0007) [2023-12-27 23:30:34,280][106225] Updated weights for policy 1, policy_version 595755 (0.0008) [2023-12-27 23:30:34,939][106225] Updated weights for policy 1, policy_version 595765 (0.0009) [2023-12-27 23:30:34,946][106226] Updated weights for policy 0, policy_version 593687 (0.0007) [2023-12-27 23:30:34,992][106225] Updated weights for policy 1, policy_version 595775 (0.0010) [2023-12-27 23:30:35,007][106226] Updated weights for policy 0, policy_version 593697 (0.0006) [2023-12-27 23:30:35,050][106225] Updated weights for policy 1, policy_version 595785 (0.0007) [2023-12-27 23:30:35,063][106226] Updated weights for policy 0, policy_version 593707 (0.0009) [2023-12-27 23:30:35,625][106225] Updated weights for policy 1, policy_version 595795 (0.0009) [2023-12-27 23:30:35,677][106225] Updated weights for policy 1, policy_version 595805 (0.0005) [2023-12-27 23:30:35,721][106225] Updated weights for policy 1, policy_version 595815 (0.0005) [2023-12-27 23:30:35,803][106226] Updated weights for policy 0, policy_version 593717 (0.0009) [2023-12-27 23:30:35,850][106226] Updated weights for policy 0, policy_version 593727 (0.0010) [2023-12-27 23:30:35,903][106226] Updated weights for policy 0, policy_version 593737 (0.0010) [2023-12-27 23:30:36,174][105115] Fps is (10 sec: 21299.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 304594944. Throughput: 0: 9903.6, 1: 10072.2. Samples: 304602440. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:36,175][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.272')] [2023-12-27 23:30:36,431][106225] Updated weights for policy 1, policy_version 595825 (0.0009) [2023-12-27 23:30:36,493][106225] Updated weights for policy 1, policy_version 595835 (0.0006) [2023-12-27 23:30:36,586][106225] Updated weights for policy 1, policy_version 595845 (0.0006) [2023-12-27 23:30:36,643][106225] Updated weights for policy 1, policy_version 595855 (0.0006) [2023-12-27 23:30:36,657][106226] Updated weights for policy 0, policy_version 593747 (0.0011) [2023-12-27 23:30:36,721][106226] Updated weights for policy 0, policy_version 593757 (0.0011) [2023-12-27 23:30:36,785][106226] Updated weights for policy 0, policy_version 593767 (0.0011) [2023-12-27 23:30:37,306][106225] Updated weights for policy 1, policy_version 595865 (0.0009) [2023-12-27 23:30:37,369][106225] Updated weights for policy 1, policy_version 595875 (0.0008) [2023-12-27 23:30:37,433][106225] Updated weights for policy 1, policy_version 595885 (0.0009) [2023-12-27 23:30:37,508][106226] Updated weights for policy 0, policy_version 593777 (0.0011) [2023-12-27 23:30:37,561][106226] Updated weights for policy 0, policy_version 593787 (0.0010) [2023-12-27 23:30:37,611][106226] Updated weights for policy 0, policy_version 593797 (0.0008) [2023-12-27 23:30:37,675][106226] Updated weights for policy 0, policy_version 593807 (0.0008) [2023-12-27 23:30:38,154][106225] Updated weights for policy 1, policy_version 595895 (0.0010) [2023-12-27 23:30:38,208][106225] Updated weights for policy 1, policy_version 595905 (0.0008) [2023-12-27 23:30:38,268][106225] Updated weights for policy 1, policy_version 595915 (0.0007) [2023-12-27 23:30:38,358][106226] Updated weights for policy 0, policy_version 593817 (0.0008) [2023-12-27 23:30:38,419][106226] Updated weights for policy 0, policy_version 593827 (0.0008) [2023-12-27 23:30:38,485][106226] Updated weights for policy 0, policy_version 593837 (0.0007) [2023-12-27 23:30:38,978][106225] Updated weights for policy 1, policy_version 595925 (0.0007) [2023-12-27 23:30:39,046][106225] Updated weights for policy 1, policy_version 595935 (0.0008) [2023-12-27 23:30:39,109][106225] Updated weights for policy 1, policy_version 595945 (0.0008) [2023-12-27 23:30:39,141][106226] Updated weights for policy 0, policy_version 593847 (0.0009) [2023-12-27 23:30:39,198][106226] Updated weights for policy 0, policy_version 593857 (0.0007) [2023-12-27 23:30:39,267][106226] Updated weights for policy 0, policy_version 593867 (0.0007) [2023-12-27 23:30:39,800][106225] Updated weights for policy 1, policy_version 595955 (0.0007) [2023-12-27 23:30:39,893][106225] Updated weights for policy 1, policy_version 595965 (0.0009) [2023-12-27 23:30:39,958][106225] Updated weights for policy 1, policy_version 595975 (0.0008) [2023-12-27 23:30:40,062][106226] Updated weights for policy 0, policy_version 593877 (0.0008) [2023-12-27 23:30:40,125][106226] Updated weights for policy 0, policy_version 593887 (0.0008) [2023-12-27 23:30:40,192][106226] Updated weights for policy 0, policy_version 593897 (0.0009) [2023-12-27 23:30:40,693][106225] Updated weights for policy 1, policy_version 595985 (0.0009) [2023-12-27 23:30:40,747][106225] Updated weights for policy 1, policy_version 595995 (0.0008) [2023-12-27 23:30:40,801][106225] Updated weights for policy 1, policy_version 596005 (0.0009) [2023-12-27 23:30:40,850][106226] Updated weights for policy 0, policy_version 593907 (0.0009) [2023-12-27 23:30:40,856][106225] Updated weights for policy 1, policy_version 596015 (0.0007) [2023-12-27 23:30:40,897][106226] Updated weights for policy 0, policy_version 593917 (0.0009) [2023-12-27 23:30:40,955][106226] Updated weights for policy 0, policy_version 593927 (0.0008) [2023-12-27 23:30:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 304693248. Throughput: 0: 9901.0, 1: 10110.7. Samples: 304661272. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:41,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.860')] [2023-12-27 23:30:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000593936_152084480.pth... [2023-12-27 23:30:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000596016_152608768.pth... [2023-12-27 23:30:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000592784_151789568.pth [2023-12-27 23:30:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000594832_152305664.pth [2023-12-27 23:30:41,678][106226] Updated weights for policy 0, policy_version 593937 (0.0009) [2023-12-27 23:30:41,706][106225] Updated weights for policy 1, policy_version 596025 (0.0007) [2023-12-27 23:30:41,756][106226] Updated weights for policy 0, policy_version 593947 (0.0009) [2023-12-27 23:30:41,779][106225] Updated weights for policy 1, policy_version 596035 (0.0007) [2023-12-27 23:30:41,821][106226] Updated weights for policy 0, policy_version 593957 (0.0008) [2023-12-27 23:30:41,839][106225] Updated weights for policy 1, policy_version 596045 (0.0007) [2023-12-27 23:30:41,874][106226] Updated weights for policy 0, policy_version 593967 (0.0006) [2023-12-27 23:30:42,599][106225] Updated weights for policy 1, policy_version 596055 (0.0007) [2023-12-27 23:30:42,624][106226] Updated weights for policy 0, policy_version 593977 (0.0009) [2023-12-27 23:30:42,658][106225] Updated weights for policy 1, policy_version 596065 (0.0007) [2023-12-27 23:30:42,686][106226] Updated weights for policy 0, policy_version 593987 (0.0008) [2023-12-27 23:30:42,711][106225] Updated weights for policy 1, policy_version 596075 (0.0009) [2023-12-27 23:30:42,741][106226] Updated weights for policy 0, policy_version 593997 (0.0007) [2023-12-27 23:30:43,447][106225] Updated weights for policy 1, policy_version 596085 (0.0006) [2023-12-27 23:30:43,473][106226] Updated weights for policy 0, policy_version 594007 (0.0008) [2023-12-27 23:30:43,506][106225] Updated weights for policy 1, policy_version 596095 (0.0008) [2023-12-27 23:30:43,527][106226] Updated weights for policy 0, policy_version 594017 (0.0006) [2023-12-27 23:30:43,561][106225] Updated weights for policy 1, policy_version 596105 (0.0006) [2023-12-27 23:30:43,576][106226] Updated weights for policy 0, policy_version 594027 (0.0006) [2023-12-27 23:30:44,211][106225] Updated weights for policy 1, policy_version 596115 (0.0008) [2023-12-27 23:30:44,267][106225] Updated weights for policy 1, policy_version 596125 (0.0007) [2023-12-27 23:30:44,268][106226] Updated weights for policy 0, policy_version 594037 (0.0007) [2023-12-27 23:30:44,322][106225] Updated weights for policy 1, policy_version 596135 (0.0010) [2023-12-27 23:30:44,350][106226] Updated weights for policy 0, policy_version 594047 (0.0006) [2023-12-27 23:30:44,419][106226] Updated weights for policy 0, policy_version 594057 (0.0005) [2023-12-27 23:30:44,944][106226] Updated weights for policy 0, policy_version 594067 (0.0007) [2023-12-27 23:30:45,002][106226] Updated weights for policy 0, policy_version 594077 (0.0006) [2023-12-27 23:30:45,003][106225] Updated weights for policy 1, policy_version 596145 (0.0011) [2023-12-27 23:30:45,066][106225] Updated weights for policy 1, policy_version 596155 (0.0011) [2023-12-27 23:30:45,070][106226] Updated weights for policy 0, policy_version 594087 (0.0011) [2023-12-27 23:30:45,128][106225] Updated weights for policy 1, policy_version 596165 (0.0010) [2023-12-27 23:30:45,190][106225] Updated weights for policy 1, policy_version 596175 (0.0006) [2023-12-27 23:30:45,744][106226] Updated weights for policy 0, policy_version 594097 (0.0011) [2023-12-27 23:30:45,797][106226] Updated weights for policy 0, policy_version 594107 (0.0010) [2023-12-27 23:30:45,844][106226] Updated weights for policy 0, policy_version 594117 (0.0010) [2023-12-27 23:30:45,877][106225] Updated weights for policy 1, policy_version 596185 (0.0010) [2023-12-27 23:30:45,901][106226] Updated weights for policy 0, policy_version 594127 (0.0010) [2023-12-27 23:30:45,940][106225] Updated weights for policy 1, policy_version 596195 (0.0010) [2023-12-27 23:30:45,999][106225] Updated weights for policy 1, policy_version 596205 (0.0010) [2023-12-27 23:30:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 304791552. Throughput: 0: 9840.8, 1: 10043.8. Samples: 304776856. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:46,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.669')] [2023-12-27 23:30:46,625][106225] Updated weights for policy 1, policy_version 596215 (0.0008) [2023-12-27 23:30:46,648][106226] Updated weights for policy 0, policy_version 594137 (0.0010) [2023-12-27 23:30:46,673][106225] Updated weights for policy 1, policy_version 596225 (0.0008) [2023-12-27 23:30:46,705][106226] Updated weights for policy 0, policy_version 594147 (0.0010) [2023-12-27 23:30:46,729][106225] Updated weights for policy 1, policy_version 596235 (0.0010) [2023-12-27 23:30:46,771][106226] Updated weights for policy 0, policy_version 594157 (0.0011) [2023-12-27 23:30:47,352][106225] Updated weights for policy 1, policy_version 596245 (0.0008) [2023-12-27 23:30:47,405][106225] Updated weights for policy 1, policy_version 596255 (0.0010) [2023-12-27 23:30:47,449][106226] Updated weights for policy 0, policy_version 594167 (0.0007) [2023-12-27 23:30:47,456][106225] Updated weights for policy 1, policy_version 596265 (0.0010) [2023-12-27 23:30:47,507][106226] Updated weights for policy 0, policy_version 594177 (0.0005) [2023-12-27 23:30:47,569][106226] Updated weights for policy 0, policy_version 594187 (0.0005) [2023-12-27 23:30:48,074][106225] Updated weights for policy 1, policy_version 596275 (0.0010) [2023-12-27 23:30:48,080][106226] Updated weights for policy 0, policy_version 594197 (0.0006) [2023-12-27 23:30:48,131][106226] Updated weights for policy 0, policy_version 594207 (0.0008) [2023-12-27 23:30:48,132][106225] Updated weights for policy 1, policy_version 596285 (0.0010) [2023-12-27 23:30:48,188][106226] Updated weights for policy 0, policy_version 594217 (0.0007) [2023-12-27 23:30:48,194][106225] Updated weights for policy 1, policy_version 596295 (0.0010) [2023-12-27 23:30:48,912][106225] Updated weights for policy 1, policy_version 596305 (0.0010) [2023-12-27 23:30:48,959][106226] Updated weights for policy 0, policy_version 594227 (0.0008) [2023-12-27 23:30:48,972][106225] Updated weights for policy 1, policy_version 596315 (0.0005) [2023-12-27 23:30:49,022][106226] Updated weights for policy 0, policy_version 594237 (0.0007) [2023-12-27 23:30:49,028][106225] Updated weights for policy 1, policy_version 596325 (0.0006) [2023-12-27 23:30:49,078][106226] Updated weights for policy 0, policy_version 594247 (0.0008) [2023-12-27 23:30:49,083][106225] Updated weights for policy 1, policy_version 596335 (0.0005) [2023-12-27 23:30:49,724][106225] Updated weights for policy 1, policy_version 596345 (0.0010) [2023-12-27 23:30:49,789][106225] Updated weights for policy 1, policy_version 596355 (0.0011) [2023-12-27 23:30:49,859][106225] Updated weights for policy 1, policy_version 596365 (0.0009) [2023-12-27 23:30:49,904][106226] Updated weights for policy 0, policy_version 594257 (0.0008) [2023-12-27 23:30:49,995][106226] Updated weights for policy 0, policy_version 594267 (0.0008) [2023-12-27 23:30:50,061][106226] Updated weights for policy 0, policy_version 594277 (0.0009) [2023-12-27 23:30:50,126][106226] Updated weights for policy 0, policy_version 594287 (0.0008) [2023-12-27 23:30:50,649][106225] Updated weights for policy 1, policy_version 596375 (0.0010) [2023-12-27 23:30:50,708][106225] Updated weights for policy 1, policy_version 596385 (0.0009) [2023-12-27 23:30:50,764][106225] Updated weights for policy 1, policy_version 596395 (0.0008) [2023-12-27 23:30:50,826][106226] Updated weights for policy 0, policy_version 594297 (0.0006) [2023-12-27 23:30:50,895][106226] Updated weights for policy 0, policy_version 594307 (0.0005) [2023-12-27 23:30:50,961][106226] Updated weights for policy 0, policy_version 594317 (0.0005) [2023-12-27 23:30:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 304889856. Throughput: 0: 9802.2, 1: 9991.2. Samples: 304897216. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:51,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.606')] [2023-12-27 23:30:51,564][106225] Updated weights for policy 1, policy_version 596405 (0.0007) [2023-12-27 23:30:51,628][106225] Updated weights for policy 1, policy_version 596415 (0.0009) [2023-12-27 23:30:51,690][106226] Updated weights for policy 0, policy_version 594327 (0.0009) [2023-12-27 23:30:51,696][106225] Updated weights for policy 1, policy_version 596425 (0.0007) [2023-12-27 23:30:51,757][106226] Updated weights for policy 0, policy_version 594337 (0.0008) [2023-12-27 23:30:51,822][106226] Updated weights for policy 0, policy_version 594347 (0.0007) [2023-12-27 23:30:52,458][106225] Updated weights for policy 1, policy_version 596435 (0.0007) [2023-12-27 23:30:52,520][106225] Updated weights for policy 1, policy_version 596445 (0.0011) [2023-12-27 23:30:52,583][106226] Updated weights for policy 0, policy_version 594357 (0.0007) [2023-12-27 23:30:52,584][106225] Updated weights for policy 1, policy_version 596455 (0.0010) [2023-12-27 23:30:52,634][106226] Updated weights for policy 0, policy_version 594367 (0.0007) [2023-12-27 23:30:52,694][106226] Updated weights for policy 0, policy_version 594377 (0.0008) [2023-12-27 23:30:53,305][106225] Updated weights for policy 1, policy_version 596465 (0.0008) [2023-12-27 23:30:53,338][106226] Updated weights for policy 0, policy_version 594387 (0.0007) [2023-12-27 23:30:53,359][106225] Updated weights for policy 1, policy_version 596475 (0.0010) [2023-12-27 23:30:53,403][106226] Updated weights for policy 0, policy_version 594397 (0.0005) [2023-12-27 23:30:53,414][106225] Updated weights for policy 1, policy_version 596485 (0.0010) [2023-12-27 23:30:53,461][106226] Updated weights for policy 0, policy_version 594407 (0.0007) [2023-12-27 23:30:53,470][106225] Updated weights for policy 1, policy_version 596495 (0.0010) [2023-12-27 23:30:54,060][106226] Updated weights for policy 0, policy_version 594417 (0.0006) [2023-12-27 23:30:54,120][106226] Updated weights for policy 0, policy_version 594427 (0.0009) [2023-12-27 23:30:54,179][106226] Updated weights for policy 0, policy_version 594437 (0.0007) [2023-12-27 23:30:54,224][106225] Updated weights for policy 1, policy_version 596505 (0.0010) [2023-12-27 23:30:54,245][106226] Updated weights for policy 0, policy_version 594447 (0.0008) [2023-12-27 23:30:54,290][106225] Updated weights for policy 1, policy_version 596515 (0.0011) [2023-12-27 23:30:54,360][106225] Updated weights for policy 1, policy_version 596525 (0.0011) [2023-12-27 23:30:54,941][106226] Updated weights for policy 0, policy_version 594457 (0.0008) [2023-12-27 23:30:54,996][106226] Updated weights for policy 0, policy_version 594467 (0.0009) [2023-12-27 23:30:55,052][106226] Updated weights for policy 0, policy_version 594477 (0.0008) [2023-12-27 23:30:55,070][106225] Updated weights for policy 1, policy_version 596535 (0.0007) [2023-12-27 23:30:55,132][106225] Updated weights for policy 1, policy_version 596545 (0.0006) [2023-12-27 23:30:55,195][106225] Updated weights for policy 1, policy_version 596555 (0.0010) [2023-12-27 23:30:55,824][106226] Updated weights for policy 0, policy_version 594487 (0.0008) [2023-12-27 23:30:55,858][106225] Updated weights for policy 1, policy_version 596565 (0.0011) [2023-12-27 23:30:55,877][106226] Updated weights for policy 0, policy_version 594497 (0.0009) [2023-12-27 23:30:55,919][106225] Updated weights for policy 1, policy_version 596575 (0.0011) [2023-12-27 23:30:55,930][106226] Updated weights for policy 0, policy_version 594507 (0.0010) [2023-12-27 23:30:55,977][106225] Updated weights for policy 1, policy_version 596585 (0.0010) [2023-12-27 23:30:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 304988160. Throughput: 0: 9816.8, 1: 9935.0. Samples: 304954388. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:30:56,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-5.694')] [2023-12-27 23:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000594512_152231936.pth... [2023-12-27 23:30:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000596592_152756224.pth... [2023-12-27 23:30:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000593360_151937024.pth [2023-12-27 23:30:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000595440_152461312.pth [2023-12-27 23:30:56,660][106226] Updated weights for policy 0, policy_version 594517 (0.0009) [2023-12-27 23:30:56,684][106225] Updated weights for policy 1, policy_version 596595 (0.0010) [2023-12-27 23:30:56,730][106226] Updated weights for policy 0, policy_version 594527 (0.0011) [2023-12-27 23:30:56,741][106225] Updated weights for policy 1, policy_version 596605 (0.0010) [2023-12-27 23:30:56,790][106226] Updated weights for policy 0, policy_version 594537 (0.0010) [2023-12-27 23:30:56,798][106225] Updated weights for policy 1, policy_version 596615 (0.0010) [2023-12-27 23:30:57,392][106226] Updated weights for policy 0, policy_version 594547 (0.0011) [2023-12-27 23:30:57,458][106226] Updated weights for policy 0, policy_version 594557 (0.0011) [2023-12-27 23:30:57,504][106226] Updated weights for policy 0, policy_version 594567 (0.0010) [2023-12-27 23:30:57,521][106225] Updated weights for policy 1, policy_version 596625 (0.0010) [2023-12-27 23:30:57,584][106225] Updated weights for policy 1, policy_version 596635 (0.0010) [2023-12-27 23:30:57,649][106225] Updated weights for policy 1, policy_version 596645 (0.0010) [2023-12-27 23:30:57,717][106225] Updated weights for policy 1, policy_version 596655 (0.0010) [2023-12-27 23:30:58,120][106226] Updated weights for policy 0, policy_version 594577 (0.0008) [2023-12-27 23:30:58,178][106226] Updated weights for policy 0, policy_version 594587 (0.0011) [2023-12-27 23:30:58,247][106226] Updated weights for policy 0, policy_version 594597 (0.0010) [2023-12-27 23:30:58,312][106226] Updated weights for policy 0, policy_version 594607 (0.0010) [2023-12-27 23:30:58,481][106225] Updated weights for policy 1, policy_version 596665 (0.0008) [2023-12-27 23:30:58,548][106225] Updated weights for policy 1, policy_version 596675 (0.0010) [2023-12-27 23:30:58,615][106225] Updated weights for policy 1, policy_version 596685 (0.0008) [2023-12-27 23:30:59,277][106226] Updated weights for policy 0, policy_version 594617 (0.0009) [2023-12-27 23:30:59,354][106226] Updated weights for policy 0, policy_version 594627 (0.0009) [2023-12-27 23:30:59,424][106226] Updated weights for policy 0, policy_version 594637 (0.0009) [2023-12-27 23:30:59,487][106225] Updated weights for policy 1, policy_version 596695 (0.0009) [2023-12-27 23:30:59,545][106225] Updated weights for policy 1, policy_version 596705 (0.0009) [2023-12-27 23:30:59,604][106225] Updated weights for policy 1, policy_version 596715 (0.0009) [2023-12-27 23:31:00,182][106226] Updated weights for policy 0, policy_version 594647 (0.0010) [2023-12-27 23:31:00,239][106226] Updated weights for policy 0, policy_version 594657 (0.0010) [2023-12-27 23:31:00,300][106226] Updated weights for policy 0, policy_version 594667 (0.0005) [2023-12-27 23:31:00,415][106225] Updated weights for policy 1, policy_version 596725 (0.0008) [2023-12-27 23:31:00,481][106225] Updated weights for policy 1, policy_version 596735 (0.0010) [2023-12-27 23:31:00,544][106225] Updated weights for policy 1, policy_version 596745 (0.0010) [2023-12-27 23:31:00,910][106226] Updated weights for policy 0, policy_version 594677 (0.0008) [2023-12-27 23:31:00,964][106226] Updated weights for policy 0, policy_version 594687 (0.0010) [2023-12-27 23:31:01,031][106226] Updated weights for policy 0, policy_version 594697 (0.0010) [2023-12-27 23:31:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 305078272. Throughput: 0: 9770.9, 1: 9900.3. Samples: 305066860. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-27 23:31:01,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.663')] [2023-12-27 23:31:01,263][106225] Updated weights for policy 1, policy_version 596755 (0.0010) [2023-12-27 23:31:01,318][106225] Updated weights for policy 1, policy_version 596765 (0.0010) [2023-12-27 23:31:01,390][106225] Updated weights for policy 1, policy_version 596775 (0.0010) [2023-12-27 23:31:01,859][106226] Updated weights for policy 0, policy_version 594707 (0.0011) [2023-12-27 23:31:01,918][106226] Updated weights for policy 0, policy_version 594717 (0.0010) [2023-12-27 23:31:01,982][106226] Updated weights for policy 0, policy_version 594727 (0.0011) [2023-12-27 23:31:02,082][106225] Updated weights for policy 1, policy_version 596785 (0.0007) [2023-12-27 23:31:02,146][106225] Updated weights for policy 1, policy_version 596795 (0.0006) [2023-12-27 23:31:02,208][106225] Updated weights for policy 1, policy_version 596805 (0.0008) [2023-12-27 23:31:02,265][106225] Updated weights for policy 1, policy_version 596815 (0.0008) [2023-12-27 23:31:02,650][106226] Updated weights for policy 0, policy_version 594737 (0.0011) [2023-12-27 23:31:02,710][106226] Updated weights for policy 0, policy_version 594747 (0.0010) [2023-12-27 23:31:02,774][106226] Updated weights for policy 0, policy_version 594757 (0.0008) [2023-12-27 23:31:02,821][106226] Updated weights for policy 0, policy_version 594767 (0.0010) [2023-12-27 23:31:02,980][106225] Updated weights for policy 1, policy_version 596825 (0.0009) [2023-12-27 23:31:03,028][106225] Updated weights for policy 1, policy_version 596835 (0.0008) [2023-12-27 23:31:03,080][106225] Updated weights for policy 1, policy_version 596845 (0.0008) [2023-12-27 23:31:03,448][106226] Updated weights for policy 0, policy_version 594777 (0.0006) [2023-12-27 23:31:03,505][106226] Updated weights for policy 0, policy_version 594787 (0.0006) [2023-12-27 23:31:03,565][106226] Updated weights for policy 0, policy_version 594797 (0.0005) [2023-12-27 23:31:03,795][106225] Updated weights for policy 1, policy_version 596855 (0.0006) [2023-12-27 23:31:03,856][106225] Updated weights for policy 1, policy_version 596865 (0.0006) [2023-12-27 23:31:03,922][106225] Updated weights for policy 1, policy_version 596875 (0.0007) [2023-12-27 23:31:04,222][106226] Updated weights for policy 0, policy_version 594807 (0.0009) [2023-12-27 23:31:04,292][106226] Updated weights for policy 0, policy_version 594817 (0.0011) [2023-12-27 23:31:04,356][106226] Updated weights for policy 0, policy_version 594827 (0.0011) [2023-12-27 23:31:04,587][106225] Updated weights for policy 1, policy_version 596885 (0.0007) [2023-12-27 23:31:04,649][106225] Updated weights for policy 1, policy_version 596895 (0.0009) [2023-12-27 23:31:04,702][106225] Updated weights for policy 1, policy_version 596905 (0.0007) [2023-12-27 23:31:05,052][106226] Updated weights for policy 0, policy_version 594837 (0.0008) [2023-12-27 23:31:05,111][106226] Updated weights for policy 0, policy_version 594847 (0.0006) [2023-12-27 23:31:05,164][106226] Updated weights for policy 0, policy_version 594857 (0.0005) [2023-12-27 23:31:05,303][106225] Updated weights for policy 1, policy_version 596915 (0.0006) [2023-12-27 23:31:05,355][106225] Updated weights for policy 1, policy_version 596925 (0.0007) [2023-12-27 23:31:05,406][106225] Updated weights for policy 1, policy_version 596935 (0.0009) [2023-12-27 23:31:05,671][106226] Updated weights for policy 0, policy_version 594867 (0.0005) [2023-12-27 23:31:05,725][106226] Updated weights for policy 0, policy_version 594877 (0.0005) [2023-12-27 23:31:05,771][106226] Updated weights for policy 0, policy_version 594887 (0.0005) [2023-12-27 23:31:06,171][106225] Updated weights for policy 1, policy_version 596945 (0.0009) [2023-12-27 23:31:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 305176576. Throughput: 0: 9929.0, 1: 9817.8. Samples: 305189092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:06,175][105115] Avg episode reward: [(0, '-4.863'), (1, '-5.568')] [2023-12-27 23:31:06,237][106225] Updated weights for policy 1, policy_version 596955 (0.0006) [2023-12-27 23:31:06,306][106225] Updated weights for policy 1, policy_version 596965 (0.0005) [2023-12-27 23:31:06,360][106225] Updated weights for policy 1, policy_version 596975 (0.0005) [2023-12-27 23:31:06,460][106226] Updated weights for policy 0, policy_version 594897 (0.0006) [2023-12-27 23:31:06,520][106226] Updated weights for policy 0, policy_version 594907 (0.0008) [2023-12-27 23:31:06,574][106226] Updated weights for policy 0, policy_version 594917 (0.0009) [2023-12-27 23:31:06,634][106226] Updated weights for policy 0, policy_version 594927 (0.0009) [2023-12-27 23:31:07,020][106225] Updated weights for policy 1, policy_version 596985 (0.0009) [2023-12-27 23:31:07,075][106225] Updated weights for policy 1, policy_version 596995 (0.0008) [2023-12-27 23:31:07,137][106225] Updated weights for policy 1, policy_version 597005 (0.0011) [2023-12-27 23:31:07,308][106226] Updated weights for policy 0, policy_version 594937 (0.0009) [2023-12-27 23:31:07,374][106226] Updated weights for policy 0, policy_version 594947 (0.0007) [2023-12-27 23:31:07,433][106226] Updated weights for policy 0, policy_version 594957 (0.0006) [2023-12-27 23:31:07,924][106225] Updated weights for policy 1, policy_version 597015 (0.0010) [2023-12-27 23:31:07,983][106225] Updated weights for policy 1, policy_version 597025 (0.0010) [2023-12-27 23:31:08,038][106225] Updated weights for policy 1, policy_version 597035 (0.0011) [2023-12-27 23:31:08,143][106226] Updated weights for policy 0, policy_version 594967 (0.0006) [2023-12-27 23:31:08,202][106226] Updated weights for policy 0, policy_version 594977 (0.0007) [2023-12-27 23:31:08,262][106226] Updated weights for policy 0, policy_version 594987 (0.0008) [2023-12-27 23:31:08,784][106225] Updated weights for policy 1, policy_version 597045 (0.0010) [2023-12-27 23:31:08,832][106225] Updated weights for policy 1, policy_version 597055 (0.0010) [2023-12-27 23:31:08,885][106226] Updated weights for policy 0, policy_version 594997 (0.0007) [2023-12-27 23:31:08,886][106225] Updated weights for policy 1, policy_version 597065 (0.0010) [2023-12-27 23:31:08,943][106226] Updated weights for policy 0, policy_version 595007 (0.0006) [2023-12-27 23:31:08,995][106226] Updated weights for policy 0, policy_version 595017 (0.0006) [2023-12-27 23:31:09,658][106225] Updated weights for policy 1, policy_version 597075 (0.0010) [2023-12-27 23:31:09,724][106225] Updated weights for policy 1, policy_version 597085 (0.0008) [2023-12-27 23:31:09,741][106226] Updated weights for policy 0, policy_version 595027 (0.0008) [2023-12-27 23:31:09,780][106225] Updated weights for policy 1, policy_version 597095 (0.0008) [2023-12-27 23:31:09,801][106226] Updated weights for policy 0, policy_version 595037 (0.0008) [2023-12-27 23:31:09,870][106226] Updated weights for policy 0, policy_version 595047 (0.0008) [2023-12-27 23:31:10,493][106225] Updated weights for policy 1, policy_version 597105 (0.0008) [2023-12-27 23:31:10,552][106225] Updated weights for policy 1, policy_version 597115 (0.0008) [2023-12-27 23:31:10,611][106225] Updated weights for policy 1, policy_version 597125 (0.0007) [2023-12-27 23:31:10,651][106226] Updated weights for policy 0, policy_version 595057 (0.0007) [2023-12-27 23:31:10,672][106225] Updated weights for policy 1, policy_version 597135 (0.0007) [2023-12-27 23:31:10,708][106226] Updated weights for policy 0, policy_version 595067 (0.0009) [2023-12-27 23:31:10,767][106226] Updated weights for policy 0, policy_version 595077 (0.0008) [2023-12-27 23:31:10,824][106226] Updated weights for policy 0, policy_version 595087 (0.0008) [2023-12-27 23:31:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 305274880. Throughput: 0: 9933.0, 1: 9853.0. Samples: 305248252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:11,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.644')] [2023-12-27 23:31:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000597136_152895488.pth... [2023-12-27 23:31:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000595088_152379392.pth... [2023-12-27 23:31:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000596016_152608768.pth [2023-12-27 23:31:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000593936_152084480.pth [2023-12-27 23:31:11,442][106225] Updated weights for policy 1, policy_version 597145 (0.0009) [2023-12-27 23:31:11,495][106225] Updated weights for policy 1, policy_version 597155 (0.0009) [2023-12-27 23:31:11,555][106226] Updated weights for policy 0, policy_version 595097 (0.0008) [2023-12-27 23:31:11,557][106225] Updated weights for policy 1, policy_version 597165 (0.0007) [2023-12-27 23:31:11,612][106226] Updated weights for policy 0, policy_version 595107 (0.0008) [2023-12-27 23:31:11,680][106226] Updated weights for policy 0, policy_version 595117 (0.0009) [2023-12-27 23:31:12,298][106226] Updated weights for policy 0, policy_version 595127 (0.0007) [2023-12-27 23:31:12,358][106226] Updated weights for policy 0, policy_version 595137 (0.0008) [2023-12-27 23:31:12,398][106225] Updated weights for policy 1, policy_version 597175 (0.0008) [2023-12-27 23:31:12,429][106226] Updated weights for policy 0, policy_version 595147 (0.0009) [2023-12-27 23:31:12,464][106225] Updated weights for policy 1, policy_version 597185 (0.0007) [2023-12-27 23:31:12,534][106225] Updated weights for policy 1, policy_version 597195 (0.0008) [2023-12-27 23:31:13,111][106226] Updated weights for policy 0, policy_version 595157 (0.0008) [2023-12-27 23:31:13,175][106226] Updated weights for policy 0, policy_version 595167 (0.0006) [2023-12-27 23:31:13,199][106225] Updated weights for policy 1, policy_version 597205 (0.0009) [2023-12-27 23:31:13,236][106226] Updated weights for policy 0, policy_version 595177 (0.0006) [2023-12-27 23:31:13,259][106225] Updated weights for policy 1, policy_version 597215 (0.0010) [2023-12-27 23:31:13,320][106225] Updated weights for policy 1, policy_version 597225 (0.0007) [2023-12-27 23:31:13,926][106226] Updated weights for policy 0, policy_version 595187 (0.0008) [2023-12-27 23:31:13,931][106225] Updated weights for policy 1, policy_version 597235 (0.0007) [2023-12-27 23:31:13,984][106225] Updated weights for policy 1, policy_version 597245 (0.0010) [2023-12-27 23:31:13,986][106226] Updated weights for policy 0, policy_version 595197 (0.0005) [2023-12-27 23:31:14,040][106225] Updated weights for policy 1, policy_version 597255 (0.0010) [2023-12-27 23:31:14,046][106226] Updated weights for policy 0, policy_version 595207 (0.0007) [2023-12-27 23:31:14,699][106225] Updated weights for policy 1, policy_version 597265 (0.0010) [2023-12-27 23:31:14,746][106225] Updated weights for policy 1, policy_version 597275 (0.0006) [2023-12-27 23:31:14,806][106226] Updated weights for policy 0, policy_version 595217 (0.0009) [2023-12-27 23:31:14,813][106225] Updated weights for policy 1, policy_version 597285 (0.0010) [2023-12-27 23:31:14,870][106226] Updated weights for policy 0, policy_version 595227 (0.0008) [2023-12-27 23:31:14,874][106225] Updated weights for policy 1, policy_version 597295 (0.0010) [2023-12-27 23:31:14,941][106226] Updated weights for policy 0, policy_version 595237 (0.0009) [2023-12-27 23:31:15,004][106226] Updated weights for policy 0, policy_version 595247 (0.0009) [2023-12-27 23:31:15,515][106225] Updated weights for policy 1, policy_version 597305 (0.0008) [2023-12-27 23:31:15,565][106225] Updated weights for policy 1, policy_version 597315 (0.0008) [2023-12-27 23:31:15,619][106225] Updated weights for policy 1, policy_version 597325 (0.0008) [2023-12-27 23:31:15,716][106226] Updated weights for policy 0, policy_version 595257 (0.0006) [2023-12-27 23:31:15,771][106226] Updated weights for policy 0, policy_version 595267 (0.0007) [2023-12-27 23:31:15,824][106226] Updated weights for policy 0, policy_version 595277 (0.0008) [2023-12-27 23:31:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 305373184. Throughput: 0: 9838.6, 1: 9718.7. Samples: 305363752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:16,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-5.950')] [2023-12-27 23:31:16,379][106225] Updated weights for policy 1, policy_version 597335 (0.0008) [2023-12-27 23:31:16,436][106225] Updated weights for policy 1, policy_version 597345 (0.0009) [2023-12-27 23:31:16,481][106226] Updated weights for policy 0, policy_version 595287 (0.0007) [2023-12-27 23:31:16,490][106225] Updated weights for policy 1, policy_version 597355 (0.0010) [2023-12-27 23:31:16,538][106226] Updated weights for policy 0, policy_version 595297 (0.0006) [2023-12-27 23:31:16,602][106226] Updated weights for policy 0, policy_version 595307 (0.0008) [2023-12-27 23:31:17,240][106225] Updated weights for policy 1, policy_version 597365 (0.0011) [2023-12-27 23:31:17,291][106225] Updated weights for policy 1, policy_version 597375 (0.0010) [2023-12-27 23:31:17,335][106226] Updated weights for policy 0, policy_version 595317 (0.0007) [2023-12-27 23:31:17,337][106225] Updated weights for policy 1, policy_version 597385 (0.0010) [2023-12-27 23:31:17,391][106226] Updated weights for policy 0, policy_version 595327 (0.0006) [2023-12-27 23:31:17,443][106226] Updated weights for policy 0, policy_version 595337 (0.0007) [2023-12-27 23:31:18,067][106225] Updated weights for policy 1, policy_version 597395 (0.0010) [2023-12-27 23:31:18,117][106225] Updated weights for policy 1, policy_version 597405 (0.0010) [2023-12-27 23:31:18,171][106225] Updated weights for policy 1, policy_version 597415 (0.0010) [2023-12-27 23:31:18,197][106226] Updated weights for policy 0, policy_version 595347 (0.0009) [2023-12-27 23:31:18,250][106226] Updated weights for policy 0, policy_version 595357 (0.0008) [2023-12-27 23:31:18,310][106226] Updated weights for policy 0, policy_version 595367 (0.0007) [2023-12-27 23:31:18,931][106225] Updated weights for policy 1, policy_version 597425 (0.0010) [2023-12-27 23:31:18,989][106225] Updated weights for policy 1, policy_version 597435 (0.0011) [2023-12-27 23:31:19,048][106225] Updated weights for policy 1, policy_version 597445 (0.0011) [2023-12-27 23:31:19,049][106226] Updated weights for policy 0, policy_version 595377 (0.0008) [2023-12-27 23:31:19,093][106225] Updated weights for policy 1, policy_version 597455 (0.0010) [2023-12-27 23:31:19,111][106226] Updated weights for policy 0, policy_version 595387 (0.0007) [2023-12-27 23:31:19,158][106226] Updated weights for policy 0, policy_version 595397 (0.0008) [2023-12-27 23:31:19,224][106226] Updated weights for policy 0, policy_version 595407 (0.0008) [2023-12-27 23:31:19,917][106225] Updated weights for policy 1, policy_version 597465 (0.0011) [2023-12-27 23:31:19,978][106225] Updated weights for policy 1, policy_version 597475 (0.0011) [2023-12-27 23:31:20,000][106226] Updated weights for policy 0, policy_version 595417 (0.0006) [2023-12-27 23:31:20,041][106225] Updated weights for policy 1, policy_version 597485 (0.0011) [2023-12-27 23:31:20,052][106226] Updated weights for policy 0, policy_version 595427 (0.0008) [2023-12-27 23:31:20,110][106226] Updated weights for policy 0, policy_version 595437 (0.0008) [2023-12-27 23:31:20,849][106225] Updated weights for policy 1, policy_version 597495 (0.0008) [2023-12-27 23:31:20,878][106226] Updated weights for policy 0, policy_version 595447 (0.0007) [2023-12-27 23:31:20,906][106225] Updated weights for policy 1, policy_version 597505 (0.0006) [2023-12-27 23:31:20,933][106226] Updated weights for policy 0, policy_version 595457 (0.0009) [2023-12-27 23:31:20,959][106225] Updated weights for policy 1, policy_version 597515 (0.0008) [2023-12-27 23:31:20,995][106226] Updated weights for policy 0, policy_version 595467 (0.0008) [2023-12-27 23:31:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 305471488. Throughput: 0: 9829.9, 1: 9610.8. Samples: 305477276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:21,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.770')] [2023-12-27 23:31:21,690][106225] Updated weights for policy 1, policy_version 597525 (0.0008) [2023-12-27 23:31:21,763][106225] Updated weights for policy 1, policy_version 597535 (0.0009) [2023-12-27 23:31:21,815][106226] Updated weights for policy 0, policy_version 595477 (0.0007) [2023-12-27 23:31:21,820][106225] Updated weights for policy 1, policy_version 597545 (0.0007) [2023-12-27 23:31:21,875][106226] Updated weights for policy 0, policy_version 595487 (0.0009) [2023-12-27 23:31:21,941][106226] Updated weights for policy 0, policy_version 595497 (0.0009) [2023-12-27 23:31:22,545][106225] Updated weights for policy 1, policy_version 597555 (0.0009) [2023-12-27 23:31:22,608][106225] Updated weights for policy 1, policy_version 597565 (0.0009) [2023-12-27 23:31:22,669][106225] Updated weights for policy 1, policy_version 597575 (0.0009) [2023-12-27 23:31:22,729][106226] Updated weights for policy 0, policy_version 595507 (0.0008) [2023-12-27 23:31:22,792][106226] Updated weights for policy 0, policy_version 595517 (0.0008) [2023-12-27 23:31:22,854][106226] Updated weights for policy 0, policy_version 595527 (0.0008) [2023-12-27 23:31:23,376][106225] Updated weights for policy 1, policy_version 597585 (0.0008) [2023-12-27 23:31:23,431][106225] Updated weights for policy 1, policy_version 597595 (0.0007) [2023-12-27 23:31:23,488][106225] Updated weights for policy 1, policy_version 597605 (0.0005) [2023-12-27 23:31:23,552][106225] Updated weights for policy 1, policy_version 597615 (0.0006) [2023-12-27 23:31:23,577][106226] Updated weights for policy 0, policy_version 595537 (0.0008) [2023-12-27 23:31:23,636][106226] Updated weights for policy 0, policy_version 595547 (0.0008) [2023-12-27 23:31:23,696][106226] Updated weights for policy 0, policy_version 595557 (0.0008) [2023-12-27 23:31:23,761][106226] Updated weights for policy 0, policy_version 595567 (0.0008) [2023-12-27 23:31:24,151][106225] Updated weights for policy 1, policy_version 597625 (0.0006) [2023-12-27 23:31:24,212][106225] Updated weights for policy 1, policy_version 597635 (0.0007) [2023-12-27 23:31:24,264][106225] Updated weights for policy 1, policy_version 597645 (0.0008) [2023-12-27 23:31:24,524][106226] Updated weights for policy 0, policy_version 595577 (0.0006) [2023-12-27 23:31:24,585][106226] Updated weights for policy 0, policy_version 595587 (0.0005) [2023-12-27 23:31:24,633][106226] Updated weights for policy 0, policy_version 595597 (0.0005) [2023-12-27 23:31:24,899][106225] Updated weights for policy 1, policy_version 597655 (0.0008) [2023-12-27 23:31:24,963][106225] Updated weights for policy 1, policy_version 597665 (0.0008) [2023-12-27 23:31:25,031][106225] Updated weights for policy 1, policy_version 597675 (0.0007) [2023-12-27 23:31:25,241][106226] Updated weights for policy 0, policy_version 595607 (0.0005) [2023-12-27 23:31:25,300][106226] Updated weights for policy 0, policy_version 595618 (0.0006) [2023-12-27 23:31:25,345][106226] Updated weights for policy 0, policy_version 595628 (0.0005) [2023-12-27 23:31:25,689][106225] Updated weights for policy 1, policy_version 597685 (0.0009) [2023-12-27 23:31:25,744][106225] Updated weights for policy 1, policy_version 597695 (0.0010) [2023-12-27 23:31:25,804][106225] Updated weights for policy 1, policy_version 597705 (0.0010) [2023-12-27 23:31:25,900][106226] Updated weights for policy 0, policy_version 595638 (0.0008) [2023-12-27 23:31:25,949][106226] Updated weights for policy 0, policy_version 595648 (0.0009) [2023-12-27 23:31:25,998][106226] Updated weights for policy 0, policy_version 595658 (0.0007) [2023-12-27 23:31:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 305569792. Throughput: 0: 9771.8, 1: 9601.6. Samples: 305533076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:26,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-5.641')] [2023-12-27 23:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000595664_152526848.pth... [2023-12-27 23:31:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000597712_153042944.pth... [2023-12-27 23:31:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000594512_152231936.pth [2023-12-27 23:31:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000596592_152756224.pth [2023-12-27 23:31:26,437][106225] Updated weights for policy 1, policy_version 597715 (0.0010) [2023-12-27 23:31:26,489][106225] Updated weights for policy 1, policy_version 597725 (0.0010) [2023-12-27 23:31:26,544][106225] Updated weights for policy 1, policy_version 597735 (0.0010) [2023-12-27 23:31:26,631][106226] Updated weights for policy 0, policy_version 595668 (0.0007) [2023-12-27 23:31:26,684][106226] Updated weights for policy 0, policy_version 595678 (0.0005) [2023-12-27 23:31:26,749][106226] Updated weights for policy 0, policy_version 595688 (0.0005) [2023-12-27 23:31:27,273][106225] Updated weights for policy 1, policy_version 597745 (0.0010) [2023-12-27 23:31:27,320][106225] Updated weights for policy 1, policy_version 597755 (0.0007) [2023-12-27 23:31:27,343][106226] Updated weights for policy 0, policy_version 595698 (0.0005) [2023-12-27 23:31:27,375][106225] Updated weights for policy 1, policy_version 597765 (0.0006) [2023-12-27 23:31:27,390][106226] Updated weights for policy 0, policy_version 595708 (0.0008) [2023-12-27 23:31:27,430][106225] Updated weights for policy 1, policy_version 597775 (0.0005) [2023-12-27 23:31:27,446][106226] Updated weights for policy 0, policy_version 595718 (0.0009) [2023-12-27 23:31:27,492][106226] Updated weights for policy 0, policy_version 595728 (0.0007) [2023-12-27 23:31:28,078][106226] Updated weights for policy 0, policy_version 595738 (0.0005) [2023-12-27 23:31:28,104][106225] Updated weights for policy 1, policy_version 597785 (0.0010) [2023-12-27 23:31:28,138][106226] Updated weights for policy 0, policy_version 595748 (0.0005) [2023-12-27 23:31:28,163][106225] Updated weights for policy 1, policy_version 597795 (0.0010) [2023-12-27 23:31:28,216][106226] Updated weights for policy 0, policy_version 595758 (0.0005) [2023-12-27 23:31:28,226][106225] Updated weights for policy 1, policy_version 597805 (0.0010) [2023-12-27 23:31:28,798][106226] Updated weights for policy 0, policy_version 595768 (0.0007) [2023-12-27 23:31:28,845][106226] Updated weights for policy 0, policy_version 595778 (0.0008) [2023-12-27 23:31:28,893][106226] Updated weights for policy 0, policy_version 595788 (0.0008) [2023-12-27 23:31:28,957][106225] Updated weights for policy 1, policy_version 597815 (0.0007) [2023-12-27 23:31:29,005][106225] Updated weights for policy 1, policy_version 597825 (0.0010) [2023-12-27 23:31:29,060][106225] Updated weights for policy 1, policy_version 597835 (0.0010) [2023-12-27 23:31:29,632][106226] Updated weights for policy 0, policy_version 595798 (0.0006) [2023-12-27 23:31:29,684][106226] Updated weights for policy 0, policy_version 595808 (0.0005) [2023-12-27 23:31:29,743][106226] Updated weights for policy 0, policy_version 595818 (0.0005) [2023-12-27 23:31:29,791][106225] Updated weights for policy 1, policy_version 597845 (0.0010) [2023-12-27 23:31:29,856][106225] Updated weights for policy 1, policy_version 597855 (0.0009) [2023-12-27 23:31:29,916][106225] Updated weights for policy 1, policy_version 597865 (0.0010) [2023-12-27 23:31:30,394][106226] Updated weights for policy 0, policy_version 595828 (0.0007) [2023-12-27 23:31:30,446][106226] Updated weights for policy 0, policy_version 595838 (0.0007) [2023-12-27 23:31:30,504][106226] Updated weights for policy 0, policy_version 595848 (0.0007) [2023-12-27 23:31:30,659][106225] Updated weights for policy 1, policy_version 597875 (0.0010) [2023-12-27 23:31:30,718][106225] Updated weights for policy 1, policy_version 597885 (0.0009) [2023-12-27 23:31:30,771][106225] Updated weights for policy 1, policy_version 597895 (0.0005) [2023-12-27 23:31:31,149][106226] Updated weights for policy 0, policy_version 595858 (0.0007) [2023-12-27 23:31:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 305668096. Throughput: 0: 9943.8, 1: 9708.3. Samples: 305661204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:31,175][105115] Avg episode reward: [(0, '-4.767'), (1, '-5.522')] [2023-12-27 23:31:31,219][106226] Updated weights for policy 0, policy_version 595868 (0.0008) [2023-12-27 23:31:31,288][106226] Updated weights for policy 0, policy_version 595878 (0.0009) [2023-12-27 23:31:31,359][106226] Updated weights for policy 0, policy_version 595888 (0.0009) [2023-12-27 23:31:31,480][106225] Updated weights for policy 1, policy_version 597905 (0.0006) [2023-12-27 23:31:31,525][106225] Updated weights for policy 1, policy_version 597915 (0.0008) [2023-12-27 23:31:31,582][106225] Updated weights for policy 1, policy_version 597925 (0.0009) [2023-12-27 23:31:31,655][106225] Updated weights for policy 1, policy_version 597935 (0.0008) [2023-12-27 23:31:32,134][106226] Updated weights for policy 0, policy_version 595898 (0.0008) [2023-12-27 23:31:32,196][106226] Updated weights for policy 0, policy_version 595908 (0.0008) [2023-12-27 23:31:32,259][106226] Updated weights for policy 0, policy_version 595918 (0.0008) [2023-12-27 23:31:32,268][106225] Updated weights for policy 1, policy_version 597945 (0.0006) [2023-12-27 23:31:32,326][106225] Updated weights for policy 1, policy_version 597955 (0.0007) [2023-12-27 23:31:32,391][106225] Updated weights for policy 1, policy_version 597965 (0.0007) [2023-12-27 23:31:32,953][106226] Updated weights for policy 0, policy_version 595928 (0.0006) [2023-12-27 23:31:33,000][106226] Updated weights for policy 0, policy_version 595938 (0.0005) [2023-12-27 23:31:33,060][106226] Updated weights for policy 0, policy_version 595948 (0.0005) [2023-12-27 23:31:33,107][106225] Updated weights for policy 1, policy_version 597975 (0.0008) [2023-12-27 23:31:33,164][106225] Updated weights for policy 1, policy_version 597985 (0.0008) [2023-12-27 23:31:33,214][106225] Updated weights for policy 1, policy_version 597995 (0.0009) [2023-12-27 23:31:33,573][106226] Updated weights for policy 0, policy_version 595958 (0.0007) [2023-12-27 23:31:33,633][106226] Updated weights for policy 0, policy_version 595968 (0.0008) [2023-12-27 23:31:33,692][106226] Updated weights for policy 0, policy_version 595978 (0.0008) [2023-12-27 23:31:33,950][106225] Updated weights for policy 1, policy_version 598005 (0.0007) [2023-12-27 23:31:34,008][106225] Updated weights for policy 1, policy_version 598015 (0.0008) [2023-12-27 23:31:34,061][106225] Updated weights for policy 1, policy_version 598025 (0.0009) [2023-12-27 23:31:34,357][106226] Updated weights for policy 0, policy_version 595988 (0.0007) [2023-12-27 23:31:34,425][106226] Updated weights for policy 0, policy_version 595998 (0.0008) [2023-12-27 23:31:34,492][106226] Updated weights for policy 0, policy_version 596008 (0.0008) [2023-12-27 23:31:34,885][106225] Updated weights for policy 1, policy_version 598035 (0.0009) [2023-12-27 23:31:34,946][106225] Updated weights for policy 1, policy_version 598045 (0.0008) [2023-12-27 23:31:35,005][106225] Updated weights for policy 1, policy_version 598055 (0.0009) [2023-12-27 23:31:35,054][106226] Updated weights for policy 0, policy_version 596018 (0.0008) [2023-12-27 23:31:35,109][106226] Updated weights for policy 0, policy_version 596028 (0.0009) [2023-12-27 23:31:35,168][106226] Updated weights for policy 0, policy_version 596038 (0.0010) [2023-12-27 23:31:35,228][106226] Updated weights for policy 0, policy_version 596048 (0.0010) [2023-12-27 23:31:35,626][106225] Updated weights for policy 1, policy_version 598065 (0.0009) [2023-12-27 23:31:35,679][106225] Updated weights for policy 1, policy_version 598075 (0.0008) [2023-12-27 23:31:35,735][106225] Updated weights for policy 1, policy_version 598085 (0.0006) [2023-12-27 23:31:35,793][106225] Updated weights for policy 1, policy_version 598095 (0.0008) [2023-12-27 23:31:35,938][106226] Updated weights for policy 0, policy_version 596058 (0.0010) [2023-12-27 23:31:36,004][106226] Updated weights for policy 0, policy_version 596068 (0.0009) [2023-12-27 23:31:36,056][106226] Updated weights for policy 0, policy_version 596078 (0.0010) [2023-12-27 23:31:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 305774592. Throughput: 0: 10012.2, 1: 9654.8. Samples: 305782228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:36,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-5.647')] [2023-12-27 23:31:36,551][106225] Updated weights for policy 1, policy_version 598105 (0.0009) [2023-12-27 23:31:36,605][106225] Updated weights for policy 1, policy_version 598115 (0.0009) [2023-12-27 23:31:36,664][106225] Updated weights for policy 1, policy_version 598125 (0.0009) [2023-12-27 23:31:36,762][106226] Updated weights for policy 0, policy_version 596088 (0.0008) [2023-12-27 23:31:36,826][106226] Updated weights for policy 0, policy_version 596098 (0.0009) [2023-12-27 23:31:36,891][106226] Updated weights for policy 0, policy_version 596108 (0.0008) [2023-12-27 23:31:37,473][106225] Updated weights for policy 1, policy_version 598135 (0.0009) [2023-12-27 23:31:37,528][106226] Updated weights for policy 0, policy_version 596118 (0.0008) [2023-12-27 23:31:37,532][106225] Updated weights for policy 1, policy_version 598145 (0.0007) [2023-12-27 23:31:37,580][106226] Updated weights for policy 0, policy_version 596128 (0.0008) [2023-12-27 23:31:37,594][106225] Updated weights for policy 1, policy_version 598155 (0.0008) [2023-12-27 23:31:37,640][106226] Updated weights for policy 0, policy_version 596138 (0.0006) [2023-12-27 23:31:38,267][106226] Updated weights for policy 0, policy_version 596148 (0.0005) [2023-12-27 23:31:38,342][106226] Updated weights for policy 0, policy_version 596158 (0.0007) [2023-12-27 23:31:38,399][106226] Updated weights for policy 0, policy_version 596168 (0.0009) [2023-12-27 23:31:38,425][106225] Updated weights for policy 1, policy_version 598165 (0.0008) [2023-12-27 23:31:38,480][106225] Updated weights for policy 1, policy_version 598175 (0.0007) [2023-12-27 23:31:38,540][106225] Updated weights for policy 1, policy_version 598185 (0.0008) [2023-12-27 23:31:39,056][106226] Updated weights for policy 0, policy_version 596178 (0.0006) [2023-12-27 23:31:39,126][106226] Updated weights for policy 0, policy_version 596188 (0.0007) [2023-12-27 23:31:39,176][106226] Updated weights for policy 0, policy_version 596198 (0.0010) [2023-12-27 23:31:39,239][106226] Updated weights for policy 0, policy_version 596208 (0.0009) [2023-12-27 23:31:39,251][106225] Updated weights for policy 1, policy_version 598195 (0.0008) [2023-12-27 23:31:39,303][106225] Updated weights for policy 1, policy_version 598205 (0.0008) [2023-12-27 23:31:39,365][106225] Updated weights for policy 1, policy_version 598215 (0.0008) [2023-12-27 23:31:40,031][106226] Updated weights for policy 0, policy_version 596218 (0.0006) [2023-12-27 23:31:40,090][106226] Updated weights for policy 0, policy_version 596228 (0.0006) [2023-12-27 23:31:40,098][106225] Updated weights for policy 1, policy_version 598225 (0.0008) [2023-12-27 23:31:40,151][106226] Updated weights for policy 0, policy_version 596238 (0.0007) [2023-12-27 23:31:40,164][106225] Updated weights for policy 1, policy_version 598235 (0.0007) [2023-12-27 23:31:40,228][106225] Updated weights for policy 1, policy_version 598245 (0.0009) [2023-12-27 23:31:40,292][106225] Updated weights for policy 1, policy_version 598255 (0.0008) [2023-12-27 23:31:40,851][106226] Updated weights for policy 0, policy_version 596248 (0.0008) [2023-12-27 23:31:40,921][106226] Updated weights for policy 0, policy_version 596258 (0.0010) [2023-12-27 23:31:40,987][106225] Updated weights for policy 1, policy_version 598265 (0.0006) [2023-12-27 23:31:40,996][106226] Updated weights for policy 0, policy_version 596268 (0.0009) [2023-12-27 23:31:41,048][106225] Updated weights for policy 1, policy_version 598275 (0.0007) [2023-12-27 23:31:41,108][106225] Updated weights for policy 1, policy_version 598285 (0.0008) [2023-12-27 23:31:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 305872896. Throughput: 0: 10045.4, 1: 9636.5. Samples: 305840072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:41,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-5.408')] [2023-12-27 23:31:41,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000598288_153190400.pth... [2023-12-27 23:31:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000596272_152682496.pth... [2023-12-27 23:31:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000597136_152895488.pth [2023-12-27 23:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000595088_152379392.pth [2023-12-27 23:31:41,736][106226] Updated weights for policy 0, policy_version 596278 (0.0009) [2023-12-27 23:31:41,797][106226] Updated weights for policy 0, policy_version 596288 (0.0010) [2023-12-27 23:31:41,855][106226] Updated weights for policy 0, policy_version 596298 (0.0011) [2023-12-27 23:31:41,888][106225] Updated weights for policy 1, policy_version 598295 (0.0007) [2023-12-27 23:31:41,950][106225] Updated weights for policy 1, policy_version 598305 (0.0007) [2023-12-27 23:31:42,015][106225] Updated weights for policy 1, policy_version 598315 (0.0008) [2023-12-27 23:31:42,590][106226] Updated weights for policy 0, policy_version 596308 (0.0010) [2023-12-27 23:31:42,655][106226] Updated weights for policy 0, policy_version 596318 (0.0009) [2023-12-27 23:31:42,672][106225] Updated weights for policy 1, policy_version 598325 (0.0006) [2023-12-27 23:31:42,716][106226] Updated weights for policy 0, policy_version 596328 (0.0011) [2023-12-27 23:31:42,728][106225] Updated weights for policy 1, policy_version 598335 (0.0009) [2023-12-27 23:31:42,781][106225] Updated weights for policy 1, policy_version 598345 (0.0006) [2023-12-27 23:31:43,293][106226] Updated weights for policy 0, policy_version 596338 (0.0008) [2023-12-27 23:31:43,341][106226] Updated weights for policy 0, policy_version 596348 (0.0005) [2023-12-27 23:31:43,396][106226] Updated weights for policy 0, policy_version 596358 (0.0008) [2023-12-27 23:31:43,449][106226] Updated weights for policy 0, policy_version 596368 (0.0008) [2023-12-27 23:31:43,457][106225] Updated weights for policy 1, policy_version 598355 (0.0008) [2023-12-27 23:31:43,511][106225] Updated weights for policy 1, policy_version 598365 (0.0005) [2023-12-27 23:31:43,558][106225] Updated weights for policy 1, policy_version 598375 (0.0007) [2023-12-27 23:31:44,174][106226] Updated weights for policy 0, policy_version 596378 (0.0008) [2023-12-27 23:31:44,239][106226] Updated weights for policy 0, policy_version 596388 (0.0011) [2023-12-27 23:31:44,248][106225] Updated weights for policy 1, policy_version 598385 (0.0008) [2023-12-27 23:31:44,303][106226] Updated weights for policy 0, policy_version 596398 (0.0008) [2023-12-27 23:31:44,305][106225] Updated weights for policy 1, policy_version 598395 (0.0006) [2023-12-27 23:31:44,358][106225] Updated weights for policy 1, policy_version 598405 (0.0008) [2023-12-27 23:31:44,406][106225] Updated weights for policy 1, policy_version 598415 (0.0008) [2023-12-27 23:31:44,871][106226] Updated weights for policy 0, policy_version 596408 (0.0010) [2023-12-27 23:31:44,930][106226] Updated weights for policy 0, policy_version 596418 (0.0006) [2023-12-27 23:31:44,994][106226] Updated weights for policy 0, policy_version 596428 (0.0009) [2023-12-27 23:31:45,238][106225] Updated weights for policy 1, policy_version 598425 (0.0008) [2023-12-27 23:31:45,287][106225] Updated weights for policy 1, policy_version 598435 (0.0007) [2023-12-27 23:31:45,351][106225] Updated weights for policy 1, policy_version 598445 (0.0008) [2023-12-27 23:31:45,578][106226] Updated weights for policy 0, policy_version 596438 (0.0010) [2023-12-27 23:31:45,641][106226] Updated weights for policy 0, policy_version 596448 (0.0008) [2023-12-27 23:31:45,702][106226] Updated weights for policy 0, policy_version 596458 (0.0006) [2023-12-27 23:31:46,132][106225] Updated weights for policy 1, policy_version 598455 (0.0009) [2023-12-27 23:31:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 305963008. Throughput: 0: 10085.8, 1: 9686.4. Samples: 305956608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:46,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-6.041')] [2023-12-27 23:31:46,190][106225] Updated weights for policy 1, policy_version 598465 (0.0008) [2023-12-27 23:31:46,252][106225] Updated weights for policy 1, policy_version 598475 (0.0008) [2023-12-27 23:31:46,378][106226] Updated weights for policy 0, policy_version 596468 (0.0006) [2023-12-27 23:31:46,429][106226] Updated weights for policy 0, policy_version 596478 (0.0006) [2023-12-27 23:31:46,479][106226] Updated weights for policy 0, policy_version 596488 (0.0010) [2023-12-27 23:31:47,009][106225] Updated weights for policy 1, policy_version 598485 (0.0009) [2023-12-27 23:31:47,057][106225] Updated weights for policy 1, policy_version 598495 (0.0009) [2023-12-27 23:31:47,098][106226] Updated weights for policy 0, policy_version 596498 (0.0009) [2023-12-27 23:31:47,112][106225] Updated weights for policy 1, policy_version 598505 (0.0009) [2023-12-27 23:31:47,149][106226] Updated weights for policy 0, policy_version 596508 (0.0005) [2023-12-27 23:31:47,199][106226] Updated weights for policy 0, policy_version 596518 (0.0005) [2023-12-27 23:31:47,244][106226] Updated weights for policy 0, policy_version 596528 (0.0005) [2023-12-27 23:31:47,815][106225] Updated weights for policy 1, policy_version 598515 (0.0008) [2023-12-27 23:31:47,819][106226] Updated weights for policy 0, policy_version 596538 (0.0005) [2023-12-27 23:31:47,878][106225] Updated weights for policy 1, policy_version 598525 (0.0006) [2023-12-27 23:31:47,880][106226] Updated weights for policy 0, policy_version 596548 (0.0007) [2023-12-27 23:31:47,938][106225] Updated weights for policy 1, policy_version 598535 (0.0007) [2023-12-27 23:31:47,942][106226] Updated weights for policy 0, policy_version 596558 (0.0006) [2023-12-27 23:31:48,554][106226] Updated weights for policy 0, policy_version 596568 (0.0006) [2023-12-27 23:31:48,611][106226] Updated weights for policy 0, policy_version 596578 (0.0010) [2023-12-27 23:31:48,663][106225] Updated weights for policy 1, policy_version 598545 (0.0009) [2023-12-27 23:31:48,672][106226] Updated weights for policy 0, policy_version 596588 (0.0011) [2023-12-27 23:31:48,711][106225] Updated weights for policy 1, policy_version 598555 (0.0007) [2023-12-27 23:31:48,757][106225] Updated weights for policy 1, policy_version 598565 (0.0008) [2023-12-27 23:31:48,807][106225] Updated weights for policy 1, policy_version 598575 (0.0009) [2023-12-27 23:31:49,312][106226] Updated weights for policy 0, policy_version 596598 (0.0008) [2023-12-27 23:31:49,381][106226] Updated weights for policy 0, policy_version 596608 (0.0008) [2023-12-27 23:31:49,448][106226] Updated weights for policy 0, policy_version 596618 (0.0005) [2023-12-27 23:31:49,674][106225] Updated weights for policy 1, policy_version 598585 (0.0008) [2023-12-27 23:31:49,727][106225] Updated weights for policy 1, policy_version 598595 (0.0009) [2023-12-27 23:31:49,789][106225] Updated weights for policy 1, policy_version 598605 (0.0009) [2023-12-27 23:31:50,107][106226] Updated weights for policy 0, policy_version 596628 (0.0006) [2023-12-27 23:31:50,174][106226] Updated weights for policy 0, policy_version 596638 (0.0008) [2023-12-27 23:31:50,245][106226] Updated weights for policy 0, policy_version 596648 (0.0008) [2023-12-27 23:31:50,597][106225] Updated weights for policy 1, policy_version 598615 (0.0008) [2023-12-27 23:31:50,660][106225] Updated weights for policy 1, policy_version 598625 (0.0009) [2023-12-27 23:31:50,721][106225] Updated weights for policy 1, policy_version 598635 (0.0009) [2023-12-27 23:31:50,934][106226] Updated weights for policy 0, policy_version 596658 (0.0008) [2023-12-27 23:31:50,991][106226] Updated weights for policy 0, policy_version 596668 (0.0006) [2023-12-27 23:31:51,062][106226] Updated weights for policy 0, policy_version 596678 (0.0007) [2023-12-27 23:31:51,130][106226] Updated weights for policy 0, policy_version 596688 (0.0008) [2023-12-27 23:31:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 306069504. Throughput: 0: 10106.6, 1: 9595.5. Samples: 306075684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:51,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.553')] [2023-12-27 23:31:51,495][106225] Updated weights for policy 1, policy_version 598645 (0.0009) [2023-12-27 23:31:51,551][106225] Updated weights for policy 1, policy_version 598655 (0.0008) [2023-12-27 23:31:51,611][106225] Updated weights for policy 1, policy_version 598665 (0.0009) [2023-12-27 23:31:51,865][106226] Updated weights for policy 0, policy_version 596698 (0.0008) [2023-12-27 23:31:51,931][106226] Updated weights for policy 0, policy_version 596708 (0.0008) [2023-12-27 23:31:51,993][106226] Updated weights for policy 0, policy_version 596718 (0.0008) [2023-12-27 23:31:52,382][106225] Updated weights for policy 1, policy_version 598675 (0.0009) [2023-12-27 23:31:52,446][106225] Updated weights for policy 1, policy_version 598685 (0.0009) [2023-12-27 23:31:52,511][106225] Updated weights for policy 1, policy_version 598695 (0.0008) [2023-12-27 23:31:52,756][106226] Updated weights for policy 0, policy_version 596728 (0.0008) [2023-12-27 23:31:52,815][106226] Updated weights for policy 0, policy_version 596738 (0.0008) [2023-12-27 23:31:52,877][106226] Updated weights for policy 0, policy_version 596748 (0.0008) [2023-12-27 23:31:53,294][106225] Updated weights for policy 1, policy_version 598705 (0.0007) [2023-12-27 23:31:53,344][106225] Updated weights for policy 1, policy_version 598715 (0.0006) [2023-12-27 23:31:53,402][106225] Updated weights for policy 1, policy_version 598725 (0.0007) [2023-12-27 23:31:53,457][106225] Updated weights for policy 1, policy_version 598735 (0.0008) [2023-12-27 23:31:53,476][106226] Updated weights for policy 0, policy_version 596758 (0.0007) [2023-12-27 23:31:53,534][106226] Updated weights for policy 0, policy_version 596768 (0.0009) [2023-12-27 23:31:53,582][106226] Updated weights for policy 0, policy_version 596778 (0.0008) [2023-12-27 23:31:54,141][106225] Updated weights for policy 1, policy_version 598745 (0.0008) [2023-12-27 23:31:54,192][106225] Updated weights for policy 1, policy_version 598755 (0.0007) [2023-12-27 23:31:54,253][106225] Updated weights for policy 1, policy_version 598765 (0.0010) [2023-12-27 23:31:54,269][106226] Updated weights for policy 0, policy_version 596788 (0.0008) [2023-12-27 23:31:54,322][106226] Updated weights for policy 0, policy_version 596798 (0.0006) [2023-12-27 23:31:54,373][106226] Updated weights for policy 0, policy_version 596808 (0.0005) [2023-12-27 23:31:54,925][106225] Updated weights for policy 1, policy_version 598775 (0.0007) [2023-12-27 23:31:54,991][106225] Updated weights for policy 1, policy_version 598785 (0.0008) [2023-12-27 23:31:55,011][106226] Updated weights for policy 0, policy_version 596818 (0.0006) [2023-12-27 23:31:55,052][106225] Updated weights for policy 1, policy_version 598795 (0.0010) [2023-12-27 23:31:55,061][106226] Updated weights for policy 0, policy_version 596828 (0.0010) [2023-12-27 23:31:55,118][106226] Updated weights for policy 0, policy_version 596838 (0.0007) [2023-12-27 23:31:55,180][106226] Updated weights for policy 0, policy_version 596848 (0.0006) [2023-12-27 23:31:55,715][106225] Updated weights for policy 1, policy_version 598805 (0.0010) [2023-12-27 23:31:55,766][106226] Updated weights for policy 0, policy_version 596858 (0.0007) [2023-12-27 23:31:55,775][106225] Updated weights for policy 1, policy_version 598815 (0.0008) [2023-12-27 23:31:55,815][106226] Updated weights for policy 0, policy_version 596868 (0.0006) [2023-12-27 23:31:55,827][106225] Updated weights for policy 1, policy_version 598825 (0.0010) [2023-12-27 23:31:55,880][106226] Updated weights for policy 0, policy_version 596878 (0.0006) [2023-12-27 23:31:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 306167808. Throughput: 0: 10094.1, 1: 9566.9. Samples: 306132992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:31:56,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-5.468')] [2023-12-27 23:31:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000598832_153329664.pth... [2023-12-27 23:31:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000596880_152838144.pth... [2023-12-27 23:31:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000595664_152526848.pth [2023-12-27 23:31:56,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000597712_153042944.pth [2023-12-27 23:31:56,553][106225] Updated weights for policy 1, policy_version 598835 (0.0010) [2023-12-27 23:31:56,598][106225] Updated weights for policy 1, policy_version 598845 (0.0010) [2023-12-27 23:31:56,612][106226] Updated weights for policy 0, policy_version 596888 (0.0006) [2023-12-27 23:31:56,650][106225] Updated weights for policy 1, policy_version 598855 (0.0008) [2023-12-27 23:31:56,665][106226] Updated weights for policy 0, policy_version 596898 (0.0007) [2023-12-27 23:31:56,715][106226] Updated weights for policy 0, policy_version 596908 (0.0008) [2023-12-27 23:31:57,354][106225] Updated weights for policy 1, policy_version 598865 (0.0009) [2023-12-27 23:31:57,374][106226] Updated weights for policy 0, policy_version 596918 (0.0008) [2023-12-27 23:31:57,411][106225] Updated weights for policy 1, policy_version 598875 (0.0010) [2023-12-27 23:31:57,433][106226] Updated weights for policy 0, policy_version 596928 (0.0006) [2023-12-27 23:31:57,470][106225] Updated weights for policy 1, policy_version 598885 (0.0010) [2023-12-27 23:31:57,494][106226] Updated weights for policy 0, policy_version 596938 (0.0008) [2023-12-27 23:31:57,537][106225] Updated weights for policy 1, policy_version 598895 (0.0010) [2023-12-27 23:31:58,117][106226] Updated weights for policy 0, policy_version 596948 (0.0008) [2023-12-27 23:31:58,172][106226] Updated weights for policy 0, policy_version 596958 (0.0005) [2023-12-27 23:31:58,233][106226] Updated weights for policy 0, policy_version 596968 (0.0007) [2023-12-27 23:31:58,237][106225] Updated weights for policy 1, policy_version 598905 (0.0010) [2023-12-27 23:31:58,290][106225] Updated weights for policy 1, policy_version 598915 (0.0008) [2023-12-27 23:31:58,358][106225] Updated weights for policy 1, policy_version 598925 (0.0011) [2023-12-27 23:31:59,074][106226] Updated weights for policy 0, policy_version 596978 (0.0008) [2023-12-27 23:31:59,131][106226] Updated weights for policy 0, policy_version 596988 (0.0011) [2023-12-27 23:31:59,138][106225] Updated weights for policy 1, policy_version 598935 (0.0010) [2023-12-27 23:31:59,190][106226] Updated weights for policy 0, policy_version 596998 (0.0011) [2023-12-27 23:31:59,195][106225] Updated weights for policy 1, policy_version 598945 (0.0008) [2023-12-27 23:31:59,251][106226] Updated weights for policy 0, policy_version 597008 (0.0010) [2023-12-27 23:31:59,271][106225] Updated weights for policy 1, policy_version 598955 (0.0009) [2023-12-27 23:31:59,936][106226] Updated weights for policy 0, policy_version 597018 (0.0007) [2023-12-27 23:32:00,000][106226] Updated weights for policy 0, policy_version 597028 (0.0007) [2023-12-27 23:32:00,025][106225] Updated weights for policy 1, policy_version 598965 (0.0008) [2023-12-27 23:32:00,059][106226] Updated weights for policy 0, policy_version 597038 (0.0006) [2023-12-27 23:32:00,076][106225] Updated weights for policy 1, policy_version 598975 (0.0007) [2023-12-27 23:32:00,126][106225] Updated weights for policy 1, policy_version 598985 (0.0007) [2023-12-27 23:32:00,784][106226] Updated weights for policy 0, policy_version 597048 (0.0005) [2023-12-27 23:32:00,837][106226] Updated weights for policy 0, policy_version 597058 (0.0006) [2023-12-27 23:32:00,868][106225] Updated weights for policy 1, policy_version 598995 (0.0008) [2023-12-27 23:32:00,902][106226] Updated weights for policy 0, policy_version 597068 (0.0007) [2023-12-27 23:32:00,922][106225] Updated weights for policy 1, policy_version 599005 (0.0010) [2023-12-27 23:32:00,971][106225] Updated weights for policy 1, policy_version 599015 (0.0010) [2023-12-27 23:32:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 306266112. Throughput: 0: 10171.7, 1: 9573.1. Samples: 306252268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:01,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-5.402')] [2023-12-27 23:32:01,659][106226] Updated weights for policy 0, policy_version 597078 (0.0007) [2023-12-27 23:32:01,683][106225] Updated weights for policy 1, policy_version 599025 (0.0009) [2023-12-27 23:32:01,721][106226] Updated weights for policy 0, policy_version 597088 (0.0007) [2023-12-27 23:32:01,751][106225] Updated weights for policy 1, policy_version 599035 (0.0010) [2023-12-27 23:32:01,783][106226] Updated weights for policy 0, policy_version 597098 (0.0006) [2023-12-27 23:32:01,799][106225] Updated weights for policy 1, policy_version 599045 (0.0008) [2023-12-27 23:32:01,859][106225] Updated weights for policy 1, policy_version 599055 (0.0008) [2023-12-27 23:32:02,510][106226] Updated weights for policy 0, policy_version 597108 (0.0008) [2023-12-27 23:32:02,575][106226] Updated weights for policy 0, policy_version 597118 (0.0008) [2023-12-27 23:32:02,617][106225] Updated weights for policy 1, policy_version 599065 (0.0010) [2023-12-27 23:32:02,634][106226] Updated weights for policy 0, policy_version 597128 (0.0008) [2023-12-27 23:32:02,673][106225] Updated weights for policy 1, policy_version 599075 (0.0011) [2023-12-27 23:32:02,725][106225] Updated weights for policy 1, policy_version 599085 (0.0010) [2023-12-27 23:32:03,292][106226] Updated weights for policy 0, policy_version 597138 (0.0007) [2023-12-27 23:32:03,341][106226] Updated weights for policy 0, policy_version 597148 (0.0006) [2023-12-27 23:32:03,394][106226] Updated weights for policy 0, policy_version 597158 (0.0005) [2023-12-27 23:32:03,421][106225] Updated weights for policy 1, policy_version 599095 (0.0010) [2023-12-27 23:32:03,451][106226] Updated weights for policy 0, policy_version 597168 (0.0006) [2023-12-27 23:32:03,471][106225] Updated weights for policy 1, policy_version 599105 (0.0010) [2023-12-27 23:32:03,525][106225] Updated weights for policy 1, policy_version 599115 (0.0010) [2023-12-27 23:32:04,044][106226] Updated weights for policy 0, policy_version 597178 (0.0010) [2023-12-27 23:32:04,099][106226] Updated weights for policy 0, policy_version 597188 (0.0011) [2023-12-27 23:32:04,160][106226] Updated weights for policy 0, policy_version 597198 (0.0011) [2023-12-27 23:32:04,242][106225] Updated weights for policy 1, policy_version 599125 (0.0008) [2023-12-27 23:32:04,307][106225] Updated weights for policy 1, policy_version 599135 (0.0007) [2023-12-27 23:32:04,374][106225] Updated weights for policy 1, policy_version 599145 (0.0006) [2023-12-27 23:32:04,822][106226] Updated weights for policy 0, policy_version 597208 (0.0010) [2023-12-27 23:32:04,869][106226] Updated weights for policy 0, policy_version 597218 (0.0010) [2023-12-27 23:32:04,921][106226] Updated weights for policy 0, policy_version 597228 (0.0010) [2023-12-27 23:32:04,962][106225] Updated weights for policy 1, policy_version 599155 (0.0008) [2023-12-27 23:32:05,023][106225] Updated weights for policy 1, policy_version 599165 (0.0005) [2023-12-27 23:32:05,084][106225] Updated weights for policy 1, policy_version 599175 (0.0005) [2023-12-27 23:32:05,640][106225] Updated weights for policy 1, policy_version 599185 (0.0005) [2023-12-27 23:32:05,696][106225] Updated weights for policy 1, policy_version 599195 (0.0006) [2023-12-27 23:32:05,699][106226] Updated weights for policy 0, policy_version 597238 (0.0009) [2023-12-27 23:32:05,752][106225] Updated weights for policy 1, policy_version 599205 (0.0007) [2023-12-27 23:32:05,761][106226] Updated weights for policy 0, policy_version 597248 (0.0007) [2023-12-27 23:32:05,805][106225] Updated weights for policy 1, policy_version 599215 (0.0008) [2023-12-27 23:32:05,818][106226] Updated weights for policy 0, policy_version 597258 (0.0005) [2023-12-27 23:32:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 306364416. Throughput: 0: 10240.6, 1: 9667.8. Samples: 306373156. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:06,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.435')] [2023-12-27 23:32:06,551][106225] Updated weights for policy 1, policy_version 599225 (0.0006) [2023-12-27 23:32:06,578][106226] Updated weights for policy 0, policy_version 597268 (0.0006) [2023-12-27 23:32:06,613][106225] Updated weights for policy 1, policy_version 599235 (0.0007) [2023-12-27 23:32:06,635][106226] Updated weights for policy 0, policy_version 597278 (0.0008) [2023-12-27 23:32:06,673][106225] Updated weights for policy 1, policy_version 599245 (0.0006) [2023-12-27 23:32:06,696][106226] Updated weights for policy 0, policy_version 597288 (0.0007) [2023-12-27 23:32:07,249][106225] Updated weights for policy 1, policy_version 599255 (0.0006) [2023-12-27 23:32:07,308][106225] Updated weights for policy 1, policy_version 599265 (0.0009) [2023-12-27 23:32:07,372][106225] Updated weights for policy 1, policy_version 599275 (0.0008) [2023-12-27 23:32:07,482][106226] Updated weights for policy 0, policy_version 597298 (0.0009) [2023-12-27 23:32:07,535][106226] Updated weights for policy 0, policy_version 597308 (0.0008) [2023-12-27 23:32:07,597][106226] Updated weights for policy 0, policy_version 597318 (0.0009) [2023-12-27 23:32:07,661][106226] Updated weights for policy 0, policy_version 597328 (0.0009) [2023-12-27 23:32:08,065][106225] Updated weights for policy 1, policy_version 599285 (0.0008) [2023-12-27 23:32:08,129][106225] Updated weights for policy 1, policy_version 599295 (0.0008) [2023-12-27 23:32:08,193][106225] Updated weights for policy 1, policy_version 599305 (0.0009) [2023-12-27 23:32:08,429][106226] Updated weights for policy 0, policy_version 597338 (0.0008) [2023-12-27 23:32:08,488][106226] Updated weights for policy 0, policy_version 597348 (0.0010) [2023-12-27 23:32:08,545][106226] Updated weights for policy 0, policy_version 597358 (0.0008) [2023-12-27 23:32:08,826][106225] Updated weights for policy 1, policy_version 599315 (0.0008) [2023-12-27 23:32:08,883][106225] Updated weights for policy 1, policy_version 599325 (0.0005) [2023-12-27 23:32:08,950][106225] Updated weights for policy 1, policy_version 599335 (0.0008) [2023-12-27 23:32:09,340][106226] Updated weights for policy 0, policy_version 597368 (0.0006) [2023-12-27 23:32:09,414][106226] Updated weights for policy 0, policy_version 597378 (0.0010) [2023-12-27 23:32:09,478][106226] Updated weights for policy 0, policy_version 597388 (0.0008) [2023-12-27 23:32:09,578][106225] Updated weights for policy 1, policy_version 599345 (0.0008) [2023-12-27 23:32:09,644][106225] Updated weights for policy 1, policy_version 599355 (0.0006) [2023-12-27 23:32:09,713][106225] Updated weights for policy 1, policy_version 599365 (0.0008) [2023-12-27 23:32:09,774][106225] Updated weights for policy 1, policy_version 599375 (0.0009) [2023-12-27 23:32:10,180][106226] Updated weights for policy 0, policy_version 597398 (0.0009) [2023-12-27 23:32:10,247][106226] Updated weights for policy 0, policy_version 597408 (0.0008) [2023-12-27 23:32:10,307][106226] Updated weights for policy 0, policy_version 597418 (0.0007) [2023-12-27 23:32:10,450][106225] Updated weights for policy 1, policy_version 599385 (0.0008) [2023-12-27 23:32:10,507][106225] Updated weights for policy 1, policy_version 599395 (0.0009) [2023-12-27 23:32:10,563][106225] Updated weights for policy 1, policy_version 599405 (0.0008) [2023-12-27 23:32:11,003][106226] Updated weights for policy 0, policy_version 597428 (0.0008) [2023-12-27 23:32:11,074][106226] Updated weights for policy 0, policy_version 597438 (0.0011) [2023-12-27 23:32:11,136][106226] Updated weights for policy 0, policy_version 597448 (0.0011) [2023-12-27 23:32:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 306454528. Throughput: 0: 10233.6, 1: 9714.5. Samples: 306430740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:11,176][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.761')] [2023-12-27 23:32:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000599408_153477120.pth... [2023-12-27 23:32:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000598288_153190400.pth [2023-12-27 23:32:11,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000597456_152985600.pth... [2023-12-27 23:32:11,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000596272_152682496.pth [2023-12-27 23:32:11,365][106225] Updated weights for policy 1, policy_version 599415 (0.0009) [2023-12-27 23:32:11,431][106225] Updated weights for policy 1, policy_version 599425 (0.0008) [2023-12-27 23:32:11,490][106225] Updated weights for policy 1, policy_version 599435 (0.0008) [2023-12-27 23:32:11,875][106226] Updated weights for policy 0, policy_version 597458 (0.0010) [2023-12-27 23:32:11,945][106226] Updated weights for policy 0, policy_version 597468 (0.0007) [2023-12-27 23:32:12,016][106226] Updated weights for policy 0, policy_version 597478 (0.0009) [2023-12-27 23:32:12,084][106226] Updated weights for policy 0, policy_version 597488 (0.0009) [2023-12-27 23:32:12,252][106225] Updated weights for policy 1, policy_version 599445 (0.0009) [2023-12-27 23:32:12,319][106225] Updated weights for policy 1, policy_version 599455 (0.0009) [2023-12-27 23:32:12,381][106225] Updated weights for policy 1, policy_version 599465 (0.0008) [2023-12-27 23:32:12,748][106226] Updated weights for policy 0, policy_version 597498 (0.0009) [2023-12-27 23:32:12,813][106226] Updated weights for policy 0, policy_version 597508 (0.0009) [2023-12-27 23:32:12,876][106226] Updated weights for policy 0, policy_version 597518 (0.0009) [2023-12-27 23:32:13,158][106225] Updated weights for policy 1, policy_version 599475 (0.0008) [2023-12-27 23:32:13,210][106225] Updated weights for policy 1, policy_version 599485 (0.0009) [2023-12-27 23:32:13,269][106225] Updated weights for policy 1, policy_version 599495 (0.0009) [2023-12-27 23:32:13,597][106226] Updated weights for policy 0, policy_version 597528 (0.0008) [2023-12-27 23:32:13,661][106226] Updated weights for policy 0, policy_version 597538 (0.0010) [2023-12-27 23:32:13,723][106226] Updated weights for policy 0, policy_version 597548 (0.0009) [2023-12-27 23:32:13,912][106225] Updated weights for policy 1, policy_version 599505 (0.0008) [2023-12-27 23:32:13,988][106225] Updated weights for policy 1, policy_version 599515 (0.0007) [2023-12-27 23:32:14,041][106225] Updated weights for policy 1, policy_version 599525 (0.0010) [2023-12-27 23:32:14,095][106225] Updated weights for policy 1, policy_version 599535 (0.0010) [2023-12-27 23:32:14,356][106226] Updated weights for policy 0, policy_version 597558 (0.0007) [2023-12-27 23:32:14,413][106226] Updated weights for policy 0, policy_version 597568 (0.0008) [2023-12-27 23:32:14,473][106226] Updated weights for policy 0, policy_version 597578 (0.0008) [2023-12-27 23:32:14,772][106225] Updated weights for policy 1, policy_version 599545 (0.0007) [2023-12-27 23:32:14,829][106225] Updated weights for policy 1, policy_version 599555 (0.0008) [2023-12-27 23:32:14,885][106225] Updated weights for policy 1, policy_version 599565 (0.0010) [2023-12-27 23:32:15,249][106226] Updated weights for policy 0, policy_version 597588 (0.0008) [2023-12-27 23:32:15,311][106226] Updated weights for policy 0, policy_version 597598 (0.0008) [2023-12-27 23:32:15,362][106226] Updated weights for policy 0, policy_version 597608 (0.0010) [2023-12-27 23:32:15,542][106225] Updated weights for policy 1, policy_version 599575 (0.0008) [2023-12-27 23:32:15,600][106225] Updated weights for policy 1, policy_version 599585 (0.0010) [2023-12-27 23:32:15,651][106225] Updated weights for policy 1, policy_version 599595 (0.0010) [2023-12-27 23:32:16,172][106226] Updated weights for policy 0, policy_version 597618 (0.0008) [2023-12-27 23:32:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 306552832. Throughput: 0: 10032.8, 1: 9657.7. Samples: 306547276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:16,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.629')] [2023-12-27 23:32:16,227][106225] Updated weights for policy 1, policy_version 599605 (0.0006) [2023-12-27 23:32:16,236][106226] Updated weights for policy 0, policy_version 597628 (0.0008) [2023-12-27 23:32:16,277][106225] Updated weights for policy 1, policy_version 599615 (0.0007) [2023-12-27 23:32:16,296][106226] Updated weights for policy 0, policy_version 597638 (0.0009) [2023-12-27 23:32:16,334][106225] Updated weights for policy 1, policy_version 599625 (0.0007) [2023-12-27 23:32:16,361][106226] Updated weights for policy 0, policy_version 597648 (0.0007) [2023-12-27 23:32:16,936][106225] Updated weights for policy 1, policy_version 599635 (0.0007) [2023-12-27 23:32:16,989][106225] Updated weights for policy 1, policy_version 599645 (0.0005) [2023-12-27 23:32:17,047][106225] Updated weights for policy 1, policy_version 599655 (0.0006) [2023-12-27 23:32:17,080][106226] Updated weights for policy 0, policy_version 597658 (0.0007) [2023-12-27 23:32:17,128][106226] Updated weights for policy 0, policy_version 597668 (0.0008) [2023-12-27 23:32:17,174][106226] Updated weights for policy 0, policy_version 597678 (0.0007) [2023-12-27 23:32:17,649][106225] Updated weights for policy 1, policy_version 599665 (0.0009) [2023-12-27 23:32:17,698][106225] Updated weights for policy 1, policy_version 599675 (0.0005) [2023-12-27 23:32:17,746][106225] Updated weights for policy 1, policy_version 599685 (0.0005) [2023-12-27 23:32:17,792][106225] Updated weights for policy 1, policy_version 599695 (0.0005) [2023-12-27 23:32:17,854][106226] Updated weights for policy 0, policy_version 597688 (0.0008) [2023-12-27 23:32:17,916][106226] Updated weights for policy 0, policy_version 597698 (0.0011) [2023-12-27 23:32:17,962][106226] Updated weights for policy 0, policy_version 597708 (0.0006) [2023-12-27 23:32:18,444][106225] Updated weights for policy 1, policy_version 599705 (0.0008) [2023-12-27 23:32:18,502][106225] Updated weights for policy 1, policy_version 599715 (0.0009) [2023-12-27 23:32:18,555][106225] Updated weights for policy 1, policy_version 599725 (0.0009) [2023-12-27 23:32:18,711][106226] Updated weights for policy 0, policy_version 597718 (0.0007) [2023-12-27 23:32:18,764][106226] Updated weights for policy 0, policy_version 597728 (0.0009) [2023-12-27 23:32:18,815][106226] Updated weights for policy 0, policy_version 597738 (0.0011) [2023-12-27 23:32:19,388][106225] Updated weights for policy 1, policy_version 599735 (0.0008) [2023-12-27 23:32:19,445][106225] Updated weights for policy 1, policy_version 599745 (0.0007) [2023-12-27 23:32:19,487][106226] Updated weights for policy 0, policy_version 597748 (0.0007) [2023-12-27 23:32:19,513][106225] Updated weights for policy 1, policy_version 599755 (0.0008) [2023-12-27 23:32:19,549][106226] Updated weights for policy 0, policy_version 597758 (0.0008) [2023-12-27 23:32:19,604][106226] Updated weights for policy 0, policy_version 597768 (0.0008) [2023-12-27 23:32:20,288][106225] Updated weights for policy 1, policy_version 599765 (0.0008) [2023-12-27 23:32:20,344][106226] Updated weights for policy 0, policy_version 597778 (0.0008) [2023-12-27 23:32:20,344][106225] Updated weights for policy 1, policy_version 599775 (0.0008) [2023-12-27 23:32:20,403][106225] Updated weights for policy 1, policy_version 599785 (0.0008) [2023-12-27 23:32:20,411][106226] Updated weights for policy 0, policy_version 597788 (0.0010) [2023-12-27 23:32:20,472][106226] Updated weights for policy 0, policy_version 597798 (0.0010) [2023-12-27 23:32:20,535][106226] Updated weights for policy 0, policy_version 597808 (0.0011) [2023-12-27 23:32:21,116][106225] Updated weights for policy 1, policy_version 599795 (0.0008) [2023-12-27 23:32:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 306651136. Throughput: 0: 9935.3, 1: 9711.2. Samples: 306666320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:21,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-5.518')] [2023-12-27 23:32:21,184][106225] Updated weights for policy 1, policy_version 599805 (0.0008) [2023-12-27 23:32:21,244][106225] Updated weights for policy 1, policy_version 599815 (0.0008) [2023-12-27 23:32:21,244][106226] Updated weights for policy 0, policy_version 597818 (0.0008) [2023-12-27 23:32:21,307][106226] Updated weights for policy 0, policy_version 597828 (0.0007) [2023-12-27 23:32:21,382][106226] Updated weights for policy 0, policy_version 597838 (0.0008) [2023-12-27 23:32:22,002][106225] Updated weights for policy 1, policy_version 599825 (0.0008) [2023-12-27 23:32:22,065][106225] Updated weights for policy 1, policy_version 599835 (0.0008) [2023-12-27 23:32:22,126][106225] Updated weights for policy 1, policy_version 599845 (0.0009) [2023-12-27 23:32:22,179][106226] Updated weights for policy 0, policy_version 597848 (0.0008) [2023-12-27 23:32:22,188][106225] Updated weights for policy 1, policy_version 599855 (0.0006) [2023-12-27 23:32:22,242][106226] Updated weights for policy 0, policy_version 597858 (0.0009) [2023-12-27 23:32:22,311][106226] Updated weights for policy 0, policy_version 597868 (0.0009) [2023-12-27 23:32:22,944][106225] Updated weights for policy 1, policy_version 599865 (0.0008) [2023-12-27 23:32:23,004][106225] Updated weights for policy 1, policy_version 599875 (0.0008) [2023-12-27 23:32:23,060][106225] Updated weights for policy 1, policy_version 599885 (0.0009) [2023-12-27 23:32:23,078][106226] Updated weights for policy 0, policy_version 597878 (0.0008) [2023-12-27 23:32:23,135][106226] Updated weights for policy 0, policy_version 597888 (0.0006) [2023-12-27 23:32:23,194][106226] Updated weights for policy 0, policy_version 597898 (0.0007) [2023-12-27 23:32:23,823][106226] Updated weights for policy 0, policy_version 597908 (0.0006) [2023-12-27 23:32:23,849][106225] Updated weights for policy 1, policy_version 599895 (0.0006) [2023-12-27 23:32:23,878][106226] Updated weights for policy 0, policy_version 597918 (0.0007) [2023-12-27 23:32:23,903][106225] Updated weights for policy 1, policy_version 599905 (0.0007) [2023-12-27 23:32:23,926][106226] Updated weights for policy 0, policy_version 597928 (0.0007) [2023-12-27 23:32:23,956][106225] Updated weights for policy 1, policy_version 599915 (0.0007) [2023-12-27 23:32:24,592][106225] Updated weights for policy 1, policy_version 599925 (0.0008) [2023-12-27 23:32:24,653][106226] Updated weights for policy 0, policy_version 597938 (0.0007) [2023-12-27 23:32:24,656][106225] Updated weights for policy 1, policy_version 599935 (0.0008) [2023-12-27 23:32:24,707][106226] Updated weights for policy 0, policy_version 597948 (0.0008) [2023-12-27 23:32:24,710][106225] Updated weights for policy 1, policy_version 599945 (0.0008) [2023-12-27 23:32:24,764][106226] Updated weights for policy 0, policy_version 597958 (0.0006) [2023-12-27 23:32:24,816][106226] Updated weights for policy 0, policy_version 597968 (0.0009) [2023-12-27 23:32:25,317][106225] Updated weights for policy 1, policy_version 599955 (0.0010) [2023-12-27 23:32:25,375][106225] Updated weights for policy 1, policy_version 599965 (0.0010) [2023-12-27 23:32:25,431][106225] Updated weights for policy 1, policy_version 599975 (0.0010) [2023-12-27 23:32:25,605][106226] Updated weights for policy 0, policy_version 597978 (0.0008) [2023-12-27 23:32:25,659][106226] Updated weights for policy 0, policy_version 597988 (0.0008) [2023-12-27 23:32:25,706][106226] Updated weights for policy 0, policy_version 597998 (0.0009) [2023-12-27 23:32:26,105][106225] Updated weights for policy 1, policy_version 599985 (0.0010) [2023-12-27 23:32:26,160][106225] Updated weights for policy 1, policy_version 599995 (0.0009) [2023-12-27 23:32:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 306749440. Throughput: 0: 9861.1, 1: 9736.3. Samples: 306721960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:26,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-5.861')] [2023-12-27 23:32:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000598000_153124864.pth... [2023-12-27 23:32:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000596880_152838144.pth [2023-12-27 23:32:26,211][106225] Updated weights for policy 1, policy_version 600005 (0.0006) [2023-12-27 23:32:26,267][106225] Updated weights for policy 1, policy_version 600015 (0.0005) [2023-12-27 23:32:26,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000600016_153632768.pth... [2023-12-27 23:32:26,278][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000598832_153329664.pth [2023-12-27 23:32:26,506][106226] Updated weights for policy 0, policy_version 598008 (0.0007) [2023-12-27 23:32:26,567][106226] Updated weights for policy 0, policy_version 598018 (0.0008) [2023-12-27 23:32:26,629][106226] Updated weights for policy 0, policy_version 598028 (0.0008) [2023-12-27 23:32:26,830][106225] Updated weights for policy 1, policy_version 600025 (0.0010) [2023-12-27 23:32:26,879][106225] Updated weights for policy 1, policy_version 600035 (0.0010) [2023-12-27 23:32:26,935][106225] Updated weights for policy 1, policy_version 600045 (0.0010) [2023-12-27 23:32:27,395][106226] Updated weights for policy 0, policy_version 598038 (0.0009) [2023-12-27 23:32:27,446][106226] Updated weights for policy 0, policy_version 598048 (0.0008) [2023-12-27 23:32:27,492][106226] Updated weights for policy 0, policy_version 598058 (0.0007) [2023-12-27 23:32:27,607][106225] Updated weights for policy 1, policy_version 600055 (0.0010) [2023-12-27 23:32:27,660][106225] Updated weights for policy 1, policy_version 600065 (0.0010) [2023-12-27 23:32:27,712][106225] Updated weights for policy 1, policy_version 600075 (0.0010) [2023-12-27 23:32:28,136][106226] Updated weights for policy 0, policy_version 598068 (0.0007) [2023-12-27 23:32:28,187][106226] Updated weights for policy 0, policy_version 598078 (0.0006) [2023-12-27 23:32:28,234][106226] Updated weights for policy 0, policy_version 598088 (0.0008) [2023-12-27 23:32:28,435][106225] Updated weights for policy 1, policy_version 600085 (0.0010) [2023-12-27 23:32:28,489][106225] Updated weights for policy 1, policy_version 600095 (0.0010) [2023-12-27 23:32:28,535][106225] Updated weights for policy 1, policy_version 600105 (0.0010) [2023-12-27 23:32:28,900][106226] Updated weights for policy 0, policy_version 598098 (0.0007) [2023-12-27 23:32:28,969][106226] Updated weights for policy 0, policy_version 598108 (0.0007) [2023-12-27 23:32:29,037][106226] Updated weights for policy 0, policy_version 598118 (0.0006) [2023-12-27 23:32:29,099][106226] Updated weights for policy 0, policy_version 598128 (0.0007) [2023-12-27 23:32:29,271][106225] Updated weights for policy 1, policy_version 600115 (0.0009) [2023-12-27 23:32:29,337][106225] Updated weights for policy 1, policy_version 600125 (0.0007) [2023-12-27 23:32:29,399][106225] Updated weights for policy 1, policy_version 600135 (0.0009) [2023-12-27 23:32:29,735][106226] Updated weights for policy 0, policy_version 598138 (0.0006) [2023-12-27 23:32:29,802][106226] Updated weights for policy 0, policy_version 598148 (0.0005) [2023-12-27 23:32:29,869][106226] Updated weights for policy 0, policy_version 598158 (0.0007) [2023-12-27 23:32:30,087][106225] Updated weights for policy 1, policy_version 600145 (0.0008) [2023-12-27 23:32:30,144][106225] Updated weights for policy 1, policy_version 600155 (0.0010) [2023-12-27 23:32:30,201][106225] Updated weights for policy 1, policy_version 600165 (0.0010) [2023-12-27 23:32:30,264][106225] Updated weights for policy 1, policy_version 600175 (0.0010) [2023-12-27 23:32:30,596][106226] Updated weights for policy 0, policy_version 598168 (0.0006) [2023-12-27 23:32:30,645][106226] Updated weights for policy 0, policy_version 598178 (0.0005) [2023-12-27 23:32:30,705][106226] Updated weights for policy 0, policy_version 598188 (0.0005) [2023-12-27 23:32:30,917][106225] Updated weights for policy 1, policy_version 600185 (0.0006) [2023-12-27 23:32:30,971][106225] Updated weights for policy 1, policy_version 600195 (0.0010) [2023-12-27 23:32:31,030][106225] Updated weights for policy 1, policy_version 600205 (0.0010) [2023-12-27 23:32:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 306855936. Throughput: 0: 9858.1, 1: 9833.6. Samples: 306842736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:32:31,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-5.302')] [2023-12-27 23:32:31,392][106226] Updated weights for policy 0, policy_version 598198 (0.0007) [2023-12-27 23:32:31,451][106226] Updated weights for policy 0, policy_version 598208 (0.0008) [2023-12-27 23:32:31,509][106226] Updated weights for policy 0, policy_version 598218 (0.0008) [2023-12-27 23:32:31,747][106225] Updated weights for policy 1, policy_version 600215 (0.0008) [2023-12-27 23:32:31,793][106225] Updated weights for policy 1, policy_version 600225 (0.0009) [2023-12-27 23:32:31,838][106225] Updated weights for policy 1, policy_version 600235 (0.0009) [2023-12-27 23:32:32,290][106226] Updated weights for policy 0, policy_version 598228 (0.0008) [2023-12-27 23:32:32,353][106226] Updated weights for policy 0, policy_version 598238 (0.0008) [2023-12-27 23:32:32,417][106226] Updated weights for policy 0, policy_version 598248 (0.0008) [2023-12-27 23:32:32,626][106225] Updated weights for policy 1, policy_version 600245 (0.0008) [2023-12-27 23:32:32,691][106225] Updated weights for policy 1, policy_version 600255 (0.0009) [2023-12-27 23:32:32,738][106225] Updated weights for policy 1, policy_version 600265 (0.0009) [2023-12-27 23:32:33,091][106226] Updated weights for policy 0, policy_version 598258 (0.0008) [2023-12-27 23:32:33,145][106226] Updated weights for policy 0, policy_version 598268 (0.0010) [2023-12-27 23:32:33,194][106226] Updated weights for policy 0, policy_version 598278 (0.0010) [2023-12-27 23:32:33,240][106226] Updated weights for policy 0, policy_version 598288 (0.0010) [2023-12-27 23:32:33,475][106225] Updated weights for policy 1, policy_version 600275 (0.0009) [2023-12-27 23:32:33,528][106225] Updated weights for policy 1, policy_version 600285 (0.0007) [2023-12-27 23:32:33,575][106225] Updated weights for policy 1, policy_version 600295 (0.0007) [2023-12-27 23:32:33,973][106226] Updated weights for policy 0, policy_version 598298 (0.0008) [2023-12-27 23:32:34,032][106226] Updated weights for policy 0, policy_version 598308 (0.0005) [2023-12-27 23:32:34,089][106226] Updated weights for policy 0, policy_version 598318 (0.0005) [2023-12-27 23:32:34,321][106225] Updated weights for policy 1, policy_version 600305 (0.0008) [2023-12-27 23:32:34,389][106225] Updated weights for policy 1, policy_version 600315 (0.0009) [2023-12-27 23:32:34,445][106225] Updated weights for policy 1, policy_version 600325 (0.0009) [2023-12-27 23:32:34,503][106225] Updated weights for policy 1, policy_version 600335 (0.0008) [2023-12-27 23:32:34,765][106226] Updated weights for policy 0, policy_version 598328 (0.0008) [2023-12-27 23:32:34,821][106226] Updated weights for policy 0, policy_version 598338 (0.0008) [2023-12-27 23:32:34,879][106226] Updated weights for policy 0, policy_version 598348 (0.0008) [2023-12-27 23:32:35,211][106225] Updated weights for policy 1, policy_version 600345 (0.0008) [2023-12-27 23:32:35,264][106225] Updated weights for policy 1, policy_version 600355 (0.0008) [2023-12-27 23:32:35,319][106225] Updated weights for policy 1, policy_version 600365 (0.0009) [2023-12-27 23:32:35,553][106226] Updated weights for policy 0, policy_version 598358 (0.0008) [2023-12-27 23:32:35,619][106226] Updated weights for policy 0, policy_version 598368 (0.0009) [2023-12-27 23:32:35,681][106226] Updated weights for policy 0, policy_version 598378 (0.0007) [2023-12-27 23:32:36,138][106225] Updated weights for policy 1, policy_version 600375 (0.0008) [2023-12-27 23:32:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 306946048. Throughput: 0: 9768.9, 1: 9913.4. Samples: 306961384. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:32:36,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-5.771')] [2023-12-27 23:32:36,194][106225] Updated weights for policy 1, policy_version 600385 (0.0008) [2023-12-27 23:32:36,242][106226] Updated weights for policy 0, policy_version 598388 (0.0005) [2023-12-27 23:32:36,244][106225] Updated weights for policy 1, policy_version 600395 (0.0007) [2023-12-27 23:32:36,300][106226] Updated weights for policy 0, policy_version 598398 (0.0008) [2023-12-27 23:32:36,363][106226] Updated weights for policy 0, policy_version 598408 (0.0007) [2023-12-27 23:32:37,011][106225] Updated weights for policy 1, policy_version 600405 (0.0008) [2023-12-27 23:32:37,066][106226] Updated weights for policy 0, policy_version 598418 (0.0006) [2023-12-27 23:32:37,079][106225] Updated weights for policy 1, policy_version 600415 (0.0010) [2023-12-27 23:32:37,123][106226] Updated weights for policy 0, policy_version 598428 (0.0008) [2023-12-27 23:32:37,143][106225] Updated weights for policy 1, policy_version 600425 (0.0010) [2023-12-27 23:32:37,180][106226] Updated weights for policy 0, policy_version 598438 (0.0007) [2023-12-27 23:32:37,241][106226] Updated weights for policy 0, policy_version 598448 (0.0006) [2023-12-27 23:32:37,845][106225] Updated weights for policy 1, policy_version 600435 (0.0011) [2023-12-27 23:32:37,902][106225] Updated weights for policy 1, policy_version 600445 (0.0010) [2023-12-27 23:32:37,949][106226] Updated weights for policy 0, policy_version 598458 (0.0005) [2023-12-27 23:32:37,963][106225] Updated weights for policy 1, policy_version 600455 (0.0010) [2023-12-27 23:32:38,014][106226] Updated weights for policy 0, policy_version 598468 (0.0008) [2023-12-27 23:32:38,071][106226] Updated weights for policy 0, policy_version 598478 (0.0005) [2023-12-27 23:32:38,698][106225] Updated weights for policy 1, policy_version 600465 (0.0010) [2023-12-27 23:32:38,743][106226] Updated weights for policy 0, policy_version 598488 (0.0005) [2023-12-27 23:32:38,763][106225] Updated weights for policy 1, policy_version 600475 (0.0010) [2023-12-27 23:32:38,804][106226] Updated weights for policy 0, policy_version 598498 (0.0006) [2023-12-27 23:32:38,817][106225] Updated weights for policy 1, policy_version 600485 (0.0010) [2023-12-27 23:32:38,869][106226] Updated weights for policy 0, policy_version 598508 (0.0006) [2023-12-27 23:32:38,875][106225] Updated weights for policy 1, policy_version 600495 (0.0010) [2023-12-27 23:32:39,598][106225] Updated weights for policy 1, policy_version 600505 (0.0006) [2023-12-27 23:32:39,616][106226] Updated weights for policy 0, policy_version 598518 (0.0008) [2023-12-27 23:32:39,650][106225] Updated weights for policy 1, policy_version 600515 (0.0006) [2023-12-27 23:32:39,678][106226] Updated weights for policy 0, policy_version 598528 (0.0009) [2023-12-27 23:32:39,707][106225] Updated weights for policy 1, policy_version 600525 (0.0006) [2023-12-27 23:32:39,738][106226] Updated weights for policy 0, policy_version 598538 (0.0008) [2023-12-27 23:32:40,409][106225] Updated weights for policy 1, policy_version 600535 (0.0008) [2023-12-27 23:32:40,470][106225] Updated weights for policy 1, policy_version 600545 (0.0009) [2023-12-27 23:32:40,509][106226] Updated weights for policy 0, policy_version 598548 (0.0007) [2023-12-27 23:32:40,533][106225] Updated weights for policy 1, policy_version 600555 (0.0007) [2023-12-27 23:32:40,572][106226] Updated weights for policy 0, policy_version 598558 (0.0008) [2023-12-27 23:32:40,627][106226] Updated weights for policy 0, policy_version 598568 (0.0008) [2023-12-27 23:32:41,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 307044352. Throughput: 0: 9780.3, 1: 9914.4. Samples: 307019252. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:32:41,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.975')] [2023-12-27 23:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000600560_153772032.pth... [2023-12-27 23:32:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000598576_153272320.pth... [2023-12-27 23:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000599408_153477120.pth [2023-12-27 23:32:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000597456_152985600.pth [2023-12-27 23:32:41,259][106226] Updated weights for policy 0, policy_version 598578 (0.0007) [2023-12-27 23:32:41,326][106226] Updated weights for policy 0, policy_version 598588 (0.0008) [2023-12-27 23:32:41,394][106226] Updated weights for policy 0, policy_version 598598 (0.0008) [2023-12-27 23:32:41,400][106225] Updated weights for policy 1, policy_version 600565 (0.0008) [2023-12-27 23:32:41,455][106226] Updated weights for policy 0, policy_version 598608 (0.0008) [2023-12-27 23:32:41,456][106225] Updated weights for policy 1, policy_version 600575 (0.0006) [2023-12-27 23:32:41,511][106225] Updated weights for policy 1, policy_version 600585 (0.0008) [2023-12-27 23:32:42,253][106225] Updated weights for policy 1, policy_version 600595 (0.0007) [2023-12-27 23:32:42,257][106226] Updated weights for policy 0, policy_version 598618 (0.0008) [2023-12-27 23:32:42,316][106225] Updated weights for policy 1, policy_version 600605 (0.0007) [2023-12-27 23:32:42,329][106226] Updated weights for policy 0, policy_version 598628 (0.0009) [2023-12-27 23:32:42,387][106225] Updated weights for policy 1, policy_version 600615 (0.0007) [2023-12-27 23:32:42,401][106226] Updated weights for policy 0, policy_version 598638 (0.0009) [2023-12-27 23:32:43,082][106225] Updated weights for policy 1, policy_version 600625 (0.0007) [2023-12-27 23:32:43,125][106226] Updated weights for policy 0, policy_version 598648 (0.0007) [2023-12-27 23:32:43,144][106225] Updated weights for policy 1, policy_version 600635 (0.0005) [2023-12-27 23:32:43,195][106226] Updated weights for policy 0, policy_version 598658 (0.0008) [2023-12-27 23:32:43,209][106225] Updated weights for policy 1, policy_version 600645 (0.0007) [2023-12-27 23:32:43,253][106226] Updated weights for policy 0, policy_version 598668 (0.0007) [2023-12-27 23:32:43,268][106225] Updated weights for policy 1, policy_version 600655 (0.0006) [2023-12-27 23:32:43,898][106225] Updated weights for policy 1, policy_version 600665 (0.0008) [2023-12-27 23:32:43,945][106226] Updated weights for policy 0, policy_version 598678 (0.0007) [2023-12-27 23:32:43,951][106225] Updated weights for policy 1, policy_version 600675 (0.0007) [2023-12-27 23:32:43,999][106226] Updated weights for policy 0, policy_version 598688 (0.0007) [2023-12-27 23:32:44,006][106225] Updated weights for policy 1, policy_version 600685 (0.0005) [2023-12-27 23:32:44,050][106226] Updated weights for policy 0, policy_version 598698 (0.0008) [2023-12-27 23:32:44,668][106225] Updated weights for policy 1, policy_version 600695 (0.0005) [2023-12-27 23:32:44,725][106225] Updated weights for policy 1, policy_version 600705 (0.0005) [2023-12-27 23:32:44,787][106225] Updated weights for policy 1, policy_version 600715 (0.0007) [2023-12-27 23:32:44,834][106226] Updated weights for policy 0, policy_version 598708 (0.0008) [2023-12-27 23:32:44,899][106226] Updated weights for policy 0, policy_version 598718 (0.0008) [2023-12-27 23:32:44,964][106226] Updated weights for policy 0, policy_version 598728 (0.0008) [2023-12-27 23:32:45,455][106225] Updated weights for policy 1, policy_version 600725 (0.0007) [2023-12-27 23:32:45,504][106225] Updated weights for policy 1, policy_version 600735 (0.0008) [2023-12-27 23:32:45,552][106225] Updated weights for policy 1, policy_version 600745 (0.0008) [2023-12-27 23:32:45,604][106226] Updated weights for policy 0, policy_version 598738 (0.0007) [2023-12-27 23:32:45,655][106226] Updated weights for policy 0, policy_version 598748 (0.0005) [2023-12-27 23:32:45,711][106226] Updated weights for policy 0, policy_version 598758 (0.0006) [2023-12-27 23:32:45,766][106226] Updated weights for policy 0, policy_version 598768 (0.0005) [2023-12-27 23:32:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 307142656. Throughput: 0: 9657.3, 1: 9917.1. Samples: 307133116. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:32:46,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.639')] [2023-12-27 23:32:46,344][106226] Updated weights for policy 0, policy_version 598778 (0.0008) [2023-12-27 23:32:46,346][106225] Updated weights for policy 1, policy_version 600755 (0.0008) [2023-12-27 23:32:46,392][106226] Updated weights for policy 0, policy_version 598788 (0.0005) [2023-12-27 23:32:46,394][106225] Updated weights for policy 1, policy_version 600765 (0.0007) [2023-12-27 23:32:46,441][106225] Updated weights for policy 1, policy_version 600775 (0.0006) [2023-12-27 23:32:46,447][106226] Updated weights for policy 0, policy_version 598798 (0.0006) [2023-12-27 23:32:47,119][106226] Updated weights for policy 0, policy_version 598808 (0.0008) [2023-12-27 23:32:47,185][106226] Updated weights for policy 0, policy_version 598818 (0.0009) [2023-12-27 23:32:47,198][106225] Updated weights for policy 1, policy_version 600785 (0.0007) [2023-12-27 23:32:47,247][106226] Updated weights for policy 0, policy_version 598828 (0.0006) [2023-12-27 23:32:47,260][106225] Updated weights for policy 1, policy_version 600795 (0.0008) [2023-12-27 23:32:47,327][106225] Updated weights for policy 1, policy_version 600805 (0.0008) [2023-12-27 23:32:47,391][106225] Updated weights for policy 1, policy_version 600815 (0.0008) [2023-12-27 23:32:47,891][106226] Updated weights for policy 0, policy_version 598838 (0.0008) [2023-12-27 23:32:47,937][106226] Updated weights for policy 0, policy_version 598848 (0.0008) [2023-12-27 23:32:47,946][106225] Updated weights for policy 1, policy_version 600825 (0.0005) [2023-12-27 23:32:47,984][106226] Updated weights for policy 0, policy_version 598858 (0.0008) [2023-12-27 23:32:48,008][106225] Updated weights for policy 1, policy_version 600835 (0.0005) [2023-12-27 23:32:48,057][106225] Updated weights for policy 1, policy_version 600845 (0.0005) [2023-12-27 23:32:48,575][106226] Updated weights for policy 0, policy_version 598868 (0.0005) [2023-12-27 23:32:48,623][106226] Updated weights for policy 0, policy_version 598878 (0.0005) [2023-12-27 23:32:48,685][106226] Updated weights for policy 0, policy_version 598888 (0.0006) [2023-12-27 23:32:48,727][106225] Updated weights for policy 1, policy_version 600855 (0.0006) [2023-12-27 23:32:48,786][106225] Updated weights for policy 1, policy_version 600865 (0.0008) [2023-12-27 23:32:48,845][106225] Updated weights for policy 1, policy_version 600875 (0.0008) [2023-12-27 23:32:49,430][106226] Updated weights for policy 0, policy_version 598898 (0.0007) [2023-12-27 23:32:49,494][106226] Updated weights for policy 0, policy_version 598908 (0.0007) [2023-12-27 23:32:49,499][106225] Updated weights for policy 1, policy_version 600885 (0.0010) [2023-12-27 23:32:49,548][106225] Updated weights for policy 1, policy_version 600895 (0.0010) [2023-12-27 23:32:49,557][106226] Updated weights for policy 0, policy_version 598918 (0.0007) [2023-12-27 23:32:49,609][106225] Updated weights for policy 1, policy_version 600905 (0.0009) [2023-12-27 23:32:49,616][106226] Updated weights for policy 0, policy_version 598928 (0.0008) [2023-12-27 23:32:50,280][106226] Updated weights for policy 0, policy_version 598938 (0.0007) [2023-12-27 23:32:50,348][106226] Updated weights for policy 0, policy_version 598948 (0.0006) [2023-12-27 23:32:50,357][106225] Updated weights for policy 1, policy_version 600915 (0.0009) [2023-12-27 23:32:50,408][106226] Updated weights for policy 0, policy_version 598958 (0.0009) [2023-12-27 23:32:50,418][106225] Updated weights for policy 1, policy_version 600925 (0.0008) [2023-12-27 23:32:50,476][106225] Updated weights for policy 1, policy_version 600935 (0.0007) [2023-12-27 23:32:51,120][106226] Updated weights for policy 0, policy_version 598968 (0.0008) [2023-12-27 23:32:51,167][106225] Updated weights for policy 1, policy_version 600945 (0.0008) [2023-12-27 23:32:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 307240960. Throughput: 0: 9734.4, 1: 9890.8. Samples: 307256288. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:32:51,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.818')] [2023-12-27 23:32:51,180][106226] Updated weights for policy 0, policy_version 598978 (0.0008) [2023-12-27 23:32:51,228][106225] Updated weights for policy 1, policy_version 600955 (0.0005) [2023-12-27 23:32:51,238][106226] Updated weights for policy 0, policy_version 598988 (0.0007) [2023-12-27 23:32:51,292][106225] Updated weights for policy 1, policy_version 600965 (0.0006) [2023-12-27 23:32:51,360][106225] Updated weights for policy 1, policy_version 600975 (0.0006) [2023-12-27 23:32:52,007][106226] Updated weights for policy 0, policy_version 598998 (0.0010) [2023-12-27 23:32:52,070][106226] Updated weights for policy 0, policy_version 599008 (0.0009) [2023-12-27 23:32:52,090][106225] Updated weights for policy 1, policy_version 600985 (0.0008) [2023-12-27 23:32:52,130][106226] Updated weights for policy 0, policy_version 599018 (0.0007) [2023-12-27 23:32:52,147][106225] Updated weights for policy 1, policy_version 600995 (0.0008) [2023-12-27 23:32:52,206][106225] Updated weights for policy 1, policy_version 601005 (0.0008) [2023-12-27 23:32:52,893][106226] Updated weights for policy 0, policy_version 599028 (0.0007) [2023-12-27 23:32:52,940][106225] Updated weights for policy 1, policy_version 601015 (0.0006) [2023-12-27 23:32:52,949][106226] Updated weights for policy 0, policy_version 599038 (0.0008) [2023-12-27 23:32:52,996][106225] Updated weights for policy 1, policy_version 601025 (0.0005) [2023-12-27 23:32:53,002][106226] Updated weights for policy 0, policy_version 599048 (0.0008) [2023-12-27 23:32:53,057][106225] Updated weights for policy 1, policy_version 601035 (0.0005) [2023-12-27 23:32:53,730][106226] Updated weights for policy 0, policy_version 599058 (0.0007) [2023-12-27 23:32:53,790][106225] Updated weights for policy 1, policy_version 601045 (0.0006) [2023-12-27 23:32:53,791][106226] Updated weights for policy 0, policy_version 599068 (0.0006) [2023-12-27 23:32:53,848][106225] Updated weights for policy 1, policy_version 601055 (0.0008) [2023-12-27 23:32:53,851][106226] Updated weights for policy 0, policy_version 599078 (0.0007) [2023-12-27 23:32:53,905][106225] Updated weights for policy 1, policy_version 601065 (0.0008) [2023-12-27 23:32:53,912][106226] Updated weights for policy 0, policy_version 599088 (0.0006) [2023-12-27 23:32:54,554][106226] Updated weights for policy 0, policy_version 599098 (0.0011) [2023-12-27 23:32:54,608][106226] Updated weights for policy 0, policy_version 599108 (0.0011) [2023-12-27 23:32:54,615][106225] Updated weights for policy 1, policy_version 601075 (0.0008) [2023-12-27 23:32:54,658][106226] Updated weights for policy 0, policy_version 599118 (0.0010) [2023-12-27 23:32:54,673][106225] Updated weights for policy 1, policy_version 601085 (0.0006) [2023-12-27 23:32:54,737][106225] Updated weights for policy 1, policy_version 601095 (0.0006) [2023-12-27 23:32:55,294][106226] Updated weights for policy 0, policy_version 599128 (0.0006) [2023-12-27 23:32:55,356][106226] Updated weights for policy 0, policy_version 599138 (0.0006) [2023-12-27 23:32:55,388][106225] Updated weights for policy 1, policy_version 601105 (0.0007) [2023-12-27 23:32:55,440][106226] Updated weights for policy 0, policy_version 599148 (0.0008) [2023-12-27 23:32:55,452][106225] Updated weights for policy 1, policy_version 601115 (0.0005) [2023-12-27 23:32:55,510][106225] Updated weights for policy 1, policy_version 601125 (0.0007) [2023-12-27 23:32:55,566][106225] Updated weights for policy 1, policy_version 601135 (0.0008) [2023-12-27 23:32:56,101][106226] Updated weights for policy 0, policy_version 599158 (0.0010) [2023-12-27 23:32:56,154][106226] Updated weights for policy 0, policy_version 599168 (0.0010) [2023-12-27 23:32:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 307339264. Throughput: 0: 9773.5, 1: 9840.0. Samples: 307313348. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:32:56,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.527')] [2023-12-27 23:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000601136_153919488.pth... [2023-12-27 23:32:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000600016_153632768.pth [2023-12-27 23:32:56,211][106226] Updated weights for policy 0, policy_version 599178 (0.0010) [2023-12-27 23:32:56,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000599184_153427968.pth... [2023-12-27 23:32:56,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000598000_153124864.pth [2023-12-27 23:32:56,251][106225] Updated weights for policy 1, policy_version 601145 (0.0008) [2023-12-27 23:32:56,299][106225] Updated weights for policy 1, policy_version 601155 (0.0008) [2023-12-27 23:32:56,352][106225] Updated weights for policy 1, policy_version 601165 (0.0008) [2023-12-27 23:32:56,814][106226] Updated weights for policy 0, policy_version 599188 (0.0008) [2023-12-27 23:32:56,876][106226] Updated weights for policy 0, policy_version 599198 (0.0005) [2023-12-27 23:32:56,926][106226] Updated weights for policy 0, policy_version 599208 (0.0005) [2023-12-27 23:32:57,089][106225] Updated weights for policy 1, policy_version 601175 (0.0006) [2023-12-27 23:32:57,154][106225] Updated weights for policy 1, policy_version 601185 (0.0008) [2023-12-27 23:32:57,222][106225] Updated weights for policy 1, policy_version 601195 (0.0007) [2023-12-27 23:32:57,436][106226] Updated weights for policy 0, policy_version 599218 (0.0005) [2023-12-27 23:32:57,496][106226] Updated weights for policy 0, policy_version 599228 (0.0005) [2023-12-27 23:32:57,551][106226] Updated weights for policy 0, policy_version 599238 (0.0005) [2023-12-27 23:32:57,598][106226] Updated weights for policy 0, policy_version 599248 (0.0005) [2023-12-27 23:32:57,883][106225] Updated weights for policy 1, policy_version 601205 (0.0009) [2023-12-27 23:32:57,928][106225] Updated weights for policy 1, policy_version 601215 (0.0010) [2023-12-27 23:32:57,977][106225] Updated weights for policy 1, policy_version 601225 (0.0010) [2023-12-27 23:32:58,237][106226] Updated weights for policy 0, policy_version 599258 (0.0010) [2023-12-27 23:32:58,291][106226] Updated weights for policy 0, policy_version 599268 (0.0010) [2023-12-27 23:32:58,348][106226] Updated weights for policy 0, policy_version 599278 (0.0010) [2023-12-27 23:32:58,839][106225] Updated weights for policy 1, policy_version 601235 (0.0010) [2023-12-27 23:32:58,907][106225] Updated weights for policy 1, policy_version 601245 (0.0006) [2023-12-27 23:32:58,970][106225] Updated weights for policy 1, policy_version 601255 (0.0008) [2023-12-27 23:32:59,114][106226] Updated weights for policy 0, policy_version 599288 (0.0008) [2023-12-27 23:32:59,168][106226] Updated weights for policy 0, policy_version 599298 (0.0008) [2023-12-27 23:32:59,232][106226] Updated weights for policy 0, policy_version 599308 (0.0008) [2023-12-27 23:32:59,700][106225] Updated weights for policy 1, policy_version 601265 (0.0008) [2023-12-27 23:32:59,762][106225] Updated weights for policy 1, policy_version 601275 (0.0010) [2023-12-27 23:32:59,827][106225] Updated weights for policy 1, policy_version 601285 (0.0010) [2023-12-27 23:32:59,886][106225] Updated weights for policy 1, policy_version 601295 (0.0008) [2023-12-27 23:32:59,968][106226] Updated weights for policy 0, policy_version 599318 (0.0009) [2023-12-27 23:33:00,027][106226] Updated weights for policy 0, policy_version 599328 (0.0008) [2023-12-27 23:33:00,090][106226] Updated weights for policy 0, policy_version 599338 (0.0008) [2023-12-27 23:33:00,536][106225] Updated weights for policy 1, policy_version 601305 (0.0008) [2023-12-27 23:33:00,602][106225] Updated weights for policy 1, policy_version 601315 (0.0009) [2023-12-27 23:33:00,655][106225] Updated weights for policy 1, policy_version 601325 (0.0008) [2023-12-27 23:33:00,867][106226] Updated weights for policy 0, policy_version 599348 (0.0009) [2023-12-27 23:33:00,928][106226] Updated weights for policy 0, policy_version 599358 (0.0009) [2023-12-27 23:33:00,989][106226] Updated weights for policy 0, policy_version 599368 (0.0009) [2023-12-27 23:33:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 307445760. Throughput: 0: 9883.1, 1: 9821.6. Samples: 307433988. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:01,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.456')] [2023-12-27 23:33:01,302][106225] Updated weights for policy 1, policy_version 601335 (0.0008) [2023-12-27 23:33:01,372][106225] Updated weights for policy 1, policy_version 601345 (0.0009) [2023-12-27 23:33:01,424][106225] Updated weights for policy 1, policy_version 601355 (0.0008) [2023-12-27 23:33:01,734][106226] Updated weights for policy 0, policy_version 599378 (0.0007) [2023-12-27 23:33:01,793][106226] Updated weights for policy 0, policy_version 599388 (0.0008) [2023-12-27 23:33:01,850][106226] Updated weights for policy 0, policy_version 599398 (0.0008) [2023-12-27 23:33:01,911][106226] Updated weights for policy 0, policy_version 599408 (0.0008) [2023-12-27 23:33:02,173][106225] Updated weights for policy 1, policy_version 601365 (0.0010) [2023-12-27 23:33:02,234][106225] Updated weights for policy 1, policy_version 601375 (0.0009) [2023-12-27 23:33:02,301][106225] Updated weights for policy 1, policy_version 601385 (0.0006) [2023-12-27 23:33:02,564][106226] Updated weights for policy 0, policy_version 599418 (0.0006) [2023-12-27 23:33:02,617][106226] Updated weights for policy 0, policy_version 599428 (0.0005) [2023-12-27 23:33:02,683][106226] Updated weights for policy 0, policy_version 599438 (0.0005) [2023-12-27 23:33:02,953][106225] Updated weights for policy 1, policy_version 601395 (0.0008) [2023-12-27 23:33:03,003][106225] Updated weights for policy 1, policy_version 601405 (0.0005) [2023-12-27 23:33:03,064][106225] Updated weights for policy 1, policy_version 601415 (0.0005) [2023-12-27 23:33:03,348][106226] Updated weights for policy 0, policy_version 599448 (0.0007) [2023-12-27 23:33:03,405][106226] Updated weights for policy 0, policy_version 599458 (0.0006) [2023-12-27 23:33:03,452][106226] Updated weights for policy 0, policy_version 599468 (0.0005) [2023-12-27 23:33:03,698][106225] Updated weights for policy 1, policy_version 601425 (0.0008) [2023-12-27 23:33:03,755][106225] Updated weights for policy 1, policy_version 601435 (0.0005) [2023-12-27 23:33:03,809][106225] Updated weights for policy 1, policy_version 601445 (0.0005) [2023-12-27 23:33:03,872][106225] Updated weights for policy 1, policy_version 601455 (0.0008) [2023-12-27 23:33:04,197][106226] Updated weights for policy 0, policy_version 599478 (0.0006) [2023-12-27 23:33:04,254][106226] Updated weights for policy 0, policy_version 599488 (0.0008) [2023-12-27 23:33:04,312][106226] Updated weights for policy 0, policy_version 599498 (0.0006) [2023-12-27 23:33:04,555][106225] Updated weights for policy 1, policy_version 601465 (0.0007) [2023-12-27 23:33:04,607][106225] Updated weights for policy 1, policy_version 601475 (0.0006) [2023-12-27 23:33:04,662][106225] Updated weights for policy 1, policy_version 601485 (0.0005) [2023-12-27 23:33:05,009][106226] Updated weights for policy 0, policy_version 599508 (0.0006) [2023-12-27 23:33:05,060][106226] Updated weights for policy 0, policy_version 599518 (0.0005) [2023-12-27 23:33:05,115][106226] Updated weights for policy 0, policy_version 599528 (0.0005) [2023-12-27 23:33:05,291][106225] Updated weights for policy 1, policy_version 601495 (0.0010) [2023-12-27 23:33:05,345][106225] Updated weights for policy 1, policy_version 601505 (0.0009) [2023-12-27 23:33:05,394][106225] Updated weights for policy 1, policy_version 601515 (0.0009) [2023-12-27 23:33:05,746][106226] Updated weights for policy 0, policy_version 599538 (0.0006) [2023-12-27 23:33:05,810][106226] Updated weights for policy 0, policy_version 599548 (0.0008) [2023-12-27 23:33:05,876][106226] Updated weights for policy 0, policy_version 599558 (0.0008) [2023-12-27 23:33:05,935][106226] Updated weights for policy 0, policy_version 599568 (0.0009) [2023-12-27 23:33:06,020][106225] Updated weights for policy 1, policy_version 601525 (0.0009) [2023-12-27 23:33:06,071][106225] Updated weights for policy 1, policy_version 601535 (0.0010) [2023-12-27 23:33:06,128][106225] Updated weights for policy 1, policy_version 601545 (0.0010) [2023-12-27 23:33:06,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 307552256. Throughput: 0: 9901.8, 1: 9849.7. Samples: 307555136. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:06,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-5.361')] [2023-12-27 23:33:06,617][106226] Updated weights for policy 0, policy_version 599578 (0.0009) [2023-12-27 23:33:06,679][106226] Updated weights for policy 0, policy_version 599588 (0.0005) [2023-12-27 23:33:06,741][106226] Updated weights for policy 0, policy_version 599598 (0.0006) [2023-12-27 23:33:06,874][106225] Updated weights for policy 1, policy_version 601555 (0.0010) [2023-12-27 23:33:06,934][106225] Updated weights for policy 1, policy_version 601565 (0.0006) [2023-12-27 23:33:06,993][106225] Updated weights for policy 1, policy_version 601575 (0.0005) [2023-12-27 23:33:07,474][106226] Updated weights for policy 0, policy_version 599608 (0.0008) [2023-12-27 23:33:07,534][106226] Updated weights for policy 0, policy_version 599618 (0.0009) [2023-12-27 23:33:07,574][106225] Updated weights for policy 1, policy_version 601585 (0.0006) [2023-12-27 23:33:07,592][106226] Updated weights for policy 0, policy_version 599628 (0.0008) [2023-12-27 23:33:07,623][106225] Updated weights for policy 1, policy_version 601595 (0.0007) [2023-12-27 23:33:07,676][106225] Updated weights for policy 1, policy_version 601605 (0.0009) [2023-12-27 23:33:07,741][106225] Updated weights for policy 1, policy_version 601615 (0.0007) [2023-12-27 23:33:08,221][106226] Updated weights for policy 0, policy_version 599638 (0.0006) [2023-12-27 23:33:08,293][106226] Updated weights for policy 0, policy_version 599649 (0.0009) [2023-12-27 23:33:08,335][106225] Updated weights for policy 1, policy_version 601625 (0.0007) [2023-12-27 23:33:08,363][106226] Updated weights for policy 0, policy_version 599659 (0.0008) [2023-12-27 23:33:08,411][106225] Updated weights for policy 1, policy_version 601635 (0.0008) [2023-12-27 23:33:08,472][106225] Updated weights for policy 1, policy_version 601645 (0.0009) [2023-12-27 23:33:09,053][106226] Updated weights for policy 0, policy_version 599669 (0.0006) [2023-12-27 23:33:09,106][106226] Updated weights for policy 0, policy_version 599679 (0.0005) [2023-12-27 23:33:09,153][106225] Updated weights for policy 1, policy_version 601655 (0.0008) [2023-12-27 23:33:09,155][106226] Updated weights for policy 0, policy_version 599689 (0.0005) [2023-12-27 23:33:09,204][106225] Updated weights for policy 1, policy_version 601665 (0.0007) [2023-12-27 23:33:09,277][106225] Updated weights for policy 1, policy_version 601675 (0.0007) [2023-12-27 23:33:09,873][106226] Updated weights for policy 0, policy_version 599699 (0.0007) [2023-12-27 23:33:09,947][106226] Updated weights for policy 0, policy_version 599709 (0.0009) [2023-12-27 23:33:10,011][106226] Updated weights for policy 0, policy_version 599719 (0.0007) [2023-12-27 23:33:10,044][106225] Updated weights for policy 1, policy_version 601685 (0.0006) [2023-12-27 23:33:10,114][106225] Updated weights for policy 1, policy_version 601695 (0.0009) [2023-12-27 23:33:10,180][106225] Updated weights for policy 1, policy_version 601705 (0.0009) [2023-12-27 23:33:10,749][106226] Updated weights for policy 0, policy_version 599729 (0.0008) [2023-12-27 23:33:10,812][106226] Updated weights for policy 0, policy_version 599739 (0.0011) [2023-12-27 23:33:10,874][106226] Updated weights for policy 0, policy_version 599749 (0.0011) [2023-12-27 23:33:10,902][106225] Updated weights for policy 1, policy_version 601715 (0.0009) [2023-12-27 23:33:10,934][106226] Updated weights for policy 0, policy_version 599759 (0.0010) [2023-12-27 23:33:10,958][106225] Updated weights for policy 1, policy_version 601725 (0.0009) [2023-12-27 23:33:11,016][106225] Updated weights for policy 1, policy_version 601735 (0.0009) [2023-12-27 23:33:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 307650560. Throughput: 0: 9957.4, 1: 9934.3. Samples: 307617088. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:11,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-5.640')] [2023-12-27 23:33:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000601744_154075136.pth... [2023-12-27 23:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000599760_153575424.pth... [2023-12-27 23:33:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000600560_153772032.pth [2023-12-27 23:33:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000598576_153272320.pth [2023-12-27 23:33:11,682][106226] Updated weights for policy 0, policy_version 599769 (0.0009) [2023-12-27 23:33:11,748][106226] Updated weights for policy 0, policy_version 599779 (0.0011) [2023-12-27 23:33:11,807][106226] Updated weights for policy 0, policy_version 599789 (0.0008) [2023-12-27 23:33:11,882][106225] Updated weights for policy 1, policy_version 601745 (0.0009) [2023-12-27 23:33:11,933][106225] Updated weights for policy 1, policy_version 601755 (0.0008) [2023-12-27 23:33:11,985][106225] Updated weights for policy 1, policy_version 601765 (0.0008) [2023-12-27 23:33:12,043][106225] Updated weights for policy 1, policy_version 601775 (0.0008) [2023-12-27 23:33:12,591][106226] Updated weights for policy 0, policy_version 599799 (0.0010) [2023-12-27 23:33:12,659][106226] Updated weights for policy 0, policy_version 599809 (0.0011) [2023-12-27 23:33:12,714][106226] Updated weights for policy 0, policy_version 599819 (0.0010) [2023-12-27 23:33:12,811][106225] Updated weights for policy 1, policy_version 601785 (0.0007) [2023-12-27 23:33:12,872][106225] Updated weights for policy 1, policy_version 601795 (0.0008) [2023-12-27 23:33:12,931][106225] Updated weights for policy 1, policy_version 601805 (0.0005) [2023-12-27 23:33:13,374][106226] Updated weights for policy 0, policy_version 599829 (0.0010) [2023-12-27 23:33:13,427][106226] Updated weights for policy 0, policy_version 599839 (0.0010) [2023-12-27 23:33:13,487][106226] Updated weights for policy 0, policy_version 599849 (0.0010) [2023-12-27 23:33:13,543][106225] Updated weights for policy 1, policy_version 601815 (0.0006) [2023-12-27 23:33:13,603][106225] Updated weights for policy 1, policy_version 601825 (0.0008) [2023-12-27 23:33:13,666][106225] Updated weights for policy 1, policy_version 601835 (0.0007) [2023-12-27 23:33:14,181][106226] Updated weights for policy 0, policy_version 599859 (0.0011) [2023-12-27 23:33:14,247][106226] Updated weights for policy 0, policy_version 599869 (0.0011) [2023-12-27 23:33:14,314][106226] Updated weights for policy 0, policy_version 599879 (0.0011) [2023-12-27 23:33:14,320][106225] Updated weights for policy 1, policy_version 601845 (0.0005) [2023-12-27 23:33:14,381][106225] Updated weights for policy 1, policy_version 601855 (0.0006) [2023-12-27 23:33:14,450][106225] Updated weights for policy 1, policy_version 601865 (0.0005) [2023-12-27 23:33:14,981][106226] Updated weights for policy 0, policy_version 599889 (0.0010) [2023-12-27 23:33:15,049][106226] Updated weights for policy 0, policy_version 599899 (0.0010) [2023-12-27 23:33:15,085][106225] Updated weights for policy 1, policy_version 601875 (0.0005) [2023-12-27 23:33:15,111][106226] Updated weights for policy 0, policy_version 599909 (0.0009) [2023-12-27 23:33:15,148][106225] Updated weights for policy 1, policy_version 601885 (0.0007) [2023-12-27 23:33:15,177][106226] Updated weights for policy 0, policy_version 599919 (0.0008) [2023-12-27 23:33:15,212][106225] Updated weights for policy 1, policy_version 601895 (0.0007) [2023-12-27 23:33:15,799][106226] Updated weights for policy 0, policy_version 599929 (0.0008) [2023-12-27 23:33:15,846][106226] Updated weights for policy 0, policy_version 599939 (0.0010) [2023-12-27 23:33:15,910][106226] Updated weights for policy 0, policy_version 599949 (0.0011) [2023-12-27 23:33:15,937][106225] Updated weights for policy 1, policy_version 601905 (0.0007) [2023-12-27 23:33:15,990][106225] Updated weights for policy 1, policy_version 601915 (0.0005) [2023-12-27 23:33:16,050][106225] Updated weights for policy 1, policy_version 601925 (0.0005) [2023-12-27 23:33:16,113][106225] Updated weights for policy 1, policy_version 601935 (0.0005) [2023-12-27 23:33:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 307748864. Throughput: 0: 9943.0, 1: 9842.7. Samples: 307733092. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:16,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.557')] [2023-12-27 23:33:16,596][106226] Updated weights for policy 0, policy_version 599959 (0.0009) [2023-12-27 23:33:16,663][106226] Updated weights for policy 0, policy_version 599969 (0.0007) [2023-12-27 23:33:16,679][106225] Updated weights for policy 1, policy_version 601945 (0.0007) [2023-12-27 23:33:16,724][106226] Updated weights for policy 0, policy_version 599979 (0.0009) [2023-12-27 23:33:16,736][106225] Updated weights for policy 1, policy_version 601955 (0.0006) [2023-12-27 23:33:16,799][106225] Updated weights for policy 1, policy_version 601965 (0.0007) [2023-12-27 23:33:17,394][106225] Updated weights for policy 1, policy_version 601975 (0.0006) [2023-12-27 23:33:17,442][106225] Updated weights for policy 1, policy_version 601985 (0.0005) [2023-12-27 23:33:17,504][106225] Updated weights for policy 1, policy_version 601995 (0.0005) [2023-12-27 23:33:17,530][106226] Updated weights for policy 0, policy_version 599989 (0.0007) [2023-12-27 23:33:17,596][106226] Updated weights for policy 0, policy_version 599999 (0.0009) [2023-12-27 23:33:17,655][106226] Updated weights for policy 0, policy_version 600009 (0.0008) [2023-12-27 23:33:18,109][106225] Updated weights for policy 1, policy_version 602005 (0.0006) [2023-12-27 23:33:18,166][106225] Updated weights for policy 1, policy_version 602015 (0.0005) [2023-12-27 23:33:18,228][106225] Updated weights for policy 1, policy_version 602025 (0.0008) [2023-12-27 23:33:18,385][106226] Updated weights for policy 0, policy_version 600019 (0.0008) [2023-12-27 23:33:18,459][106226] Updated weights for policy 0, policy_version 600029 (0.0010) [2023-12-27 23:33:18,526][106226] Updated weights for policy 0, policy_version 600039 (0.0009) [2023-12-27 23:33:18,865][106225] Updated weights for policy 1, policy_version 602035 (0.0007) [2023-12-27 23:33:18,925][106225] Updated weights for policy 1, policy_version 602045 (0.0010) [2023-12-27 23:33:18,989][106225] Updated weights for policy 1, policy_version 602055 (0.0010) [2023-12-27 23:33:19,318][106226] Updated weights for policy 0, policy_version 600049 (0.0008) [2023-12-27 23:33:19,390][106226] Updated weights for policy 0, policy_version 600059 (0.0008) [2023-12-27 23:33:19,459][106226] Updated weights for policy 0, policy_version 600069 (0.0006) [2023-12-27 23:33:19,546][106226] Updated weights for policy 0, policy_version 600079 (0.0007) [2023-12-27 23:33:19,729][106225] Updated weights for policy 1, policy_version 602065 (0.0010) [2023-12-27 23:33:19,794][106225] Updated weights for policy 1, policy_version 602075 (0.0009) [2023-12-27 23:33:19,863][106225] Updated weights for policy 1, policy_version 602085 (0.0008) [2023-12-27 23:33:19,927][106225] Updated weights for policy 1, policy_version 602095 (0.0007) [2023-12-27 23:33:20,225][106226] Updated weights for policy 0, policy_version 600089 (0.0008) [2023-12-27 23:33:20,284][106226] Updated weights for policy 0, policy_version 600099 (0.0008) [2023-12-27 23:33:20,349][106226] Updated weights for policy 0, policy_version 600109 (0.0008) [2023-12-27 23:33:20,687][106225] Updated weights for policy 1, policy_version 602105 (0.0008) [2023-12-27 23:33:20,746][106225] Updated weights for policy 1, policy_version 602115 (0.0008) [2023-12-27 23:33:20,807][106225] Updated weights for policy 1, policy_version 602125 (0.0008) [2023-12-27 23:33:21,146][106226] Updated weights for policy 0, policy_version 600119 (0.0011) [2023-12-27 23:33:21,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 307838976. Throughput: 0: 9856.7, 1: 9924.3. Samples: 307851528. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:21,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.918')] [2023-12-27 23:33:21,216][106226] Updated weights for policy 0, policy_version 600129 (0.0010) [2023-12-27 23:33:21,283][106226] Updated weights for policy 0, policy_version 600139 (0.0009) [2023-12-27 23:33:21,486][106225] Updated weights for policy 1, policy_version 602135 (0.0008) [2023-12-27 23:33:21,546][106225] Updated weights for policy 1, policy_version 602145 (0.0009) [2023-12-27 23:33:21,607][106225] Updated weights for policy 1, policy_version 602155 (0.0009) [2023-12-27 23:33:22,028][106226] Updated weights for policy 0, policy_version 600149 (0.0009) [2023-12-27 23:33:22,084][106226] Updated weights for policy 0, policy_version 600159 (0.0008) [2023-12-27 23:33:22,137][106226] Updated weights for policy 0, policy_version 600169 (0.0008) [2023-12-27 23:33:22,427][106225] Updated weights for policy 1, policy_version 602165 (0.0008) [2023-12-27 23:33:22,491][106225] Updated weights for policy 1, policy_version 602175 (0.0008) [2023-12-27 23:33:22,547][106225] Updated weights for policy 1, policy_version 602185 (0.0008) [2023-12-27 23:33:22,821][106226] Updated weights for policy 0, policy_version 600179 (0.0009) [2023-12-27 23:33:22,883][106226] Updated weights for policy 0, policy_version 600189 (0.0008) [2023-12-27 23:33:22,947][106226] Updated weights for policy 0, policy_version 600199 (0.0008) [2023-12-27 23:33:23,320][106225] Updated weights for policy 1, policy_version 602195 (0.0009) [2023-12-27 23:33:23,383][106225] Updated weights for policy 1, policy_version 602205 (0.0009) [2023-12-27 23:33:23,451][106225] Updated weights for policy 1, policy_version 602215 (0.0007) [2023-12-27 23:33:23,652][106226] Updated weights for policy 0, policy_version 600209 (0.0008) [2023-12-27 23:33:23,708][106226] Updated weights for policy 0, policy_version 600219 (0.0008) [2023-12-27 23:33:23,768][106226] Updated weights for policy 0, policy_version 600229 (0.0009) [2023-12-27 23:33:23,837][106226] Updated weights for policy 0, policy_version 600239 (0.0008) [2023-12-27 23:33:24,198][106225] Updated weights for policy 1, policy_version 602225 (0.0008) [2023-12-27 23:33:24,257][106225] Updated weights for policy 1, policy_version 602235 (0.0008) [2023-12-27 23:33:24,308][106225] Updated weights for policy 1, policy_version 602245 (0.0009) [2023-12-27 23:33:24,360][106225] Updated weights for policy 1, policy_version 602255 (0.0008) [2023-12-27 23:33:24,513][106226] Updated weights for policy 0, policy_version 600249 (0.0008) [2023-12-27 23:33:24,570][106226] Updated weights for policy 0, policy_version 600259 (0.0008) [2023-12-27 23:33:24,632][106226] Updated weights for policy 0, policy_version 600269 (0.0008) [2023-12-27 23:33:25,074][106225] Updated weights for policy 1, policy_version 602265 (0.0009) [2023-12-27 23:33:25,133][106225] Updated weights for policy 1, policy_version 602275 (0.0008) [2023-12-27 23:33:25,184][106225] Updated weights for policy 1, policy_version 602285 (0.0009) [2023-12-27 23:33:25,370][106226] Updated weights for policy 0, policy_version 600279 (0.0008) [2023-12-27 23:33:25,432][106226] Updated weights for policy 0, policy_version 600289 (0.0009) [2023-12-27 23:33:25,491][106226] Updated weights for policy 0, policy_version 600299 (0.0009) [2023-12-27 23:33:25,960][106225] Updated weights for policy 1, policy_version 602295 (0.0009) [2023-12-27 23:33:26,019][106225] Updated weights for policy 1, policy_version 602305 (0.0009) [2023-12-27 23:33:26,080][106225] Updated weights for policy 1, policy_version 602315 (0.0009) [2023-12-27 23:33:26,112][106226] Updated weights for policy 0, policy_version 600309 (0.0007) [2023-12-27 23:33:26,165][106226] Updated weights for policy 0, policy_version 600319 (0.0005) [2023-12-27 23:33:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 307937280. Throughput: 0: 9813.9, 1: 9912.5. Samples: 307906944. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:26,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-5.369')] [2023-12-27 23:33:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000602320_154222592.pth... [2023-12-27 23:33:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000601136_153919488.pth [2023-12-27 23:33:26,226][106226] Updated weights for policy 0, policy_version 600329 (0.0009) [2023-12-27 23:33:26,270][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000600336_153722880.pth... [2023-12-27 23:33:26,274][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000599184_153427968.pth [2023-12-27 23:33:26,760][106225] Updated weights for policy 1, policy_version 602325 (0.0007) [2023-12-27 23:33:26,805][106225] Updated weights for policy 1, policy_version 602335 (0.0005) [2023-12-27 23:33:26,853][106225] Updated weights for policy 1, policy_version 602345 (0.0007) [2023-12-27 23:33:26,881][106226] Updated weights for policy 0, policy_version 600339 (0.0009) [2023-12-27 23:33:26,933][106226] Updated weights for policy 0, policy_version 600349 (0.0010) [2023-12-27 23:33:26,990][106226] Updated weights for policy 0, policy_version 600359 (0.0010) [2023-12-27 23:33:27,486][106225] Updated weights for policy 1, policy_version 602355 (0.0010) [2023-12-27 23:33:27,541][106225] Updated weights for policy 1, policy_version 602365 (0.0010) [2023-12-27 23:33:27,600][106225] Updated weights for policy 1, policy_version 602375 (0.0010) [2023-12-27 23:33:27,706][106226] Updated weights for policy 0, policy_version 600369 (0.0010) [2023-12-27 23:33:27,768][106226] Updated weights for policy 0, policy_version 600379 (0.0010) [2023-12-27 23:33:27,817][106226] Updated weights for policy 0, policy_version 600389 (0.0010) [2023-12-27 23:33:27,862][106226] Updated weights for policy 0, policy_version 600399 (0.0010) [2023-12-27 23:33:28,303][106225] Updated weights for policy 1, policy_version 602385 (0.0010) [2023-12-27 23:33:28,370][106225] Updated weights for policy 1, policy_version 602395 (0.0009) [2023-12-27 23:33:28,431][106225] Updated weights for policy 1, policy_version 602405 (0.0008) [2023-12-27 23:33:28,485][106225] Updated weights for policy 1, policy_version 602415 (0.0008) [2023-12-27 23:33:28,608][106226] Updated weights for policy 0, policy_version 600409 (0.0011) [2023-12-27 23:33:28,667][106226] Updated weights for policy 0, policy_version 600419 (0.0010) [2023-12-27 23:33:28,731][106226] Updated weights for policy 0, policy_version 600429 (0.0010) [2023-12-27 23:33:29,236][106225] Updated weights for policy 1, policy_version 602425 (0.0010) [2023-12-27 23:33:29,298][106225] Updated weights for policy 1, policy_version 602435 (0.0008) [2023-12-27 23:33:29,362][106225] Updated weights for policy 1, policy_version 602445 (0.0007) [2023-12-27 23:33:29,426][106226] Updated weights for policy 0, policy_version 600439 (0.0011) [2023-12-27 23:33:29,486][106226] Updated weights for policy 0, policy_version 600449 (0.0010) [2023-12-27 23:33:29,554][106226] Updated weights for policy 0, policy_version 600459 (0.0010) [2023-12-27 23:33:30,079][106225] Updated weights for policy 1, policy_version 602455 (0.0006) [2023-12-27 23:33:30,138][106225] Updated weights for policy 1, policy_version 602465 (0.0007) [2023-12-27 23:33:30,210][106225] Updated weights for policy 1, policy_version 602475 (0.0008) [2023-12-27 23:33:30,226][106226] Updated weights for policy 0, policy_version 600469 (0.0009) [2023-12-27 23:33:30,286][106226] Updated weights for policy 0, policy_version 600479 (0.0008) [2023-12-27 23:33:30,343][106226] Updated weights for policy 0, policy_version 600489 (0.0009) [2023-12-27 23:33:30,909][106225] Updated weights for policy 1, policy_version 602485 (0.0008) [2023-12-27 23:33:30,968][106225] Updated weights for policy 1, policy_version 602495 (0.0006) [2023-12-27 23:33:31,033][106225] Updated weights for policy 1, policy_version 602505 (0.0007) [2023-12-27 23:33:31,043][106226] Updated weights for policy 0, policy_version 600499 (0.0008) [2023-12-27 23:33:31,097][106226] Updated weights for policy 0, policy_version 600509 (0.0008) [2023-12-27 23:33:31,152][106226] Updated weights for policy 0, policy_version 600519 (0.0009) [2023-12-27 23:33:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 308035584. Throughput: 0: 9925.4, 1: 9922.8. Samples: 308026284. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:31,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-5.974')] [2023-12-27 23:33:31,706][106225] Updated weights for policy 1, policy_version 602515 (0.0008) [2023-12-27 23:33:31,779][106225] Updated weights for policy 1, policy_version 602525 (0.0008) [2023-12-27 23:33:31,842][106225] Updated weights for policy 1, policy_version 602535 (0.0008) [2023-12-27 23:33:31,922][106226] Updated weights for policy 0, policy_version 600529 (0.0009) [2023-12-27 23:33:31,992][106226] Updated weights for policy 0, policy_version 600539 (0.0009) [2023-12-27 23:33:32,061][106226] Updated weights for policy 0, policy_version 600549 (0.0010) [2023-12-27 23:33:32,125][106226] Updated weights for policy 0, policy_version 600559 (0.0009) [2023-12-27 23:33:32,524][106225] Updated weights for policy 1, policy_version 602545 (0.0008) [2023-12-27 23:33:32,586][106225] Updated weights for policy 1, policy_version 602555 (0.0008) [2023-12-27 23:33:32,641][106225] Updated weights for policy 1, policy_version 602565 (0.0008) [2023-12-27 23:33:32,692][106225] Updated weights for policy 1, policy_version 602575 (0.0008) [2023-12-27 23:33:32,859][106226] Updated weights for policy 0, policy_version 600569 (0.0008) [2023-12-27 23:33:32,916][106226] Updated weights for policy 0, policy_version 600579 (0.0005) [2023-12-27 23:33:32,975][106226] Updated weights for policy 0, policy_version 600589 (0.0006) [2023-12-27 23:33:33,454][106225] Updated weights for policy 1, policy_version 602585 (0.0009) [2023-12-27 23:33:33,508][106225] Updated weights for policy 1, policy_version 602595 (0.0007) [2023-12-27 23:33:33,567][106225] Updated weights for policy 1, policy_version 602605 (0.0006) [2023-12-27 23:33:33,669][106226] Updated weights for policy 0, policy_version 600599 (0.0009) [2023-12-27 23:33:33,727][106226] Updated weights for policy 0, policy_version 600609 (0.0008) [2023-12-27 23:33:33,777][106226] Updated weights for policy 0, policy_version 600619 (0.0008) [2023-12-27 23:33:34,293][106225] Updated weights for policy 1, policy_version 602615 (0.0009) [2023-12-27 23:33:34,359][106225] Updated weights for policy 1, policy_version 602625 (0.0008) [2023-12-27 23:33:34,411][106225] Updated weights for policy 1, policy_version 602635 (0.0006) [2023-12-27 23:33:34,514][106226] Updated weights for policy 0, policy_version 600629 (0.0008) [2023-12-27 23:33:34,577][106226] Updated weights for policy 0, policy_version 600639 (0.0008) [2023-12-27 23:33:34,634][106226] Updated weights for policy 0, policy_version 600649 (0.0008) [2023-12-27 23:33:35,094][106225] Updated weights for policy 1, policy_version 602645 (0.0008) [2023-12-27 23:33:35,150][106225] Updated weights for policy 1, policy_version 602655 (0.0007) [2023-12-27 23:33:35,207][106225] Updated weights for policy 1, policy_version 602665 (0.0008) [2023-12-27 23:33:35,358][106226] Updated weights for policy 0, policy_version 600659 (0.0010) [2023-12-27 23:33:35,428][106226] Updated weights for policy 0, policy_version 600669 (0.0010) [2023-12-27 23:33:35,487][106226] Updated weights for policy 0, policy_version 600679 (0.0010) [2023-12-27 23:33:35,977][106225] Updated weights for policy 1, policy_version 602675 (0.0008) [2023-12-27 23:33:36,034][106225] Updated weights for policy 1, policy_version 602685 (0.0009) [2023-12-27 23:33:36,082][106226] Updated weights for policy 0, policy_version 600689 (0.0010) [2023-12-27 23:33:36,094][106225] Updated weights for policy 1, policy_version 602695 (0.0009) [2023-12-27 23:33:36,150][106226] Updated weights for policy 0, policy_version 600699 (0.0008) [2023-12-27 23:33:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 308133888. Throughput: 0: 9826.8, 1: 9883.8. Samples: 308143268. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:36,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.388')] [2023-12-27 23:33:36,206][106226] Updated weights for policy 0, policy_version 600709 (0.0008) [2023-12-27 23:33:36,263][106226] Updated weights for policy 0, policy_version 600719 (0.0009) [2023-12-27 23:33:36,866][106225] Updated weights for policy 1, policy_version 602705 (0.0008) [2023-12-27 23:33:36,916][106225] Updated weights for policy 1, policy_version 602715 (0.0005) [2023-12-27 23:33:36,944][106226] Updated weights for policy 0, policy_version 600729 (0.0006) [2023-12-27 23:33:36,972][106225] Updated weights for policy 1, policy_version 602725 (0.0005) [2023-12-27 23:33:37,007][106226] Updated weights for policy 0, policy_version 600739 (0.0006) [2023-12-27 23:33:37,037][106225] Updated weights for policy 1, policy_version 602735 (0.0007) [2023-12-27 23:33:37,072][106226] Updated weights for policy 0, policy_version 600749 (0.0006) [2023-12-27 23:33:37,680][106226] Updated weights for policy 0, policy_version 600759 (0.0008) [2023-12-27 23:33:37,739][106225] Updated weights for policy 1, policy_version 602745 (0.0011) [2023-12-27 23:33:37,742][106226] Updated weights for policy 0, policy_version 600769 (0.0007) [2023-12-27 23:33:37,791][106226] Updated weights for policy 0, policy_version 600779 (0.0006) [2023-12-27 23:33:37,800][106225] Updated weights for policy 1, policy_version 602755 (0.0011) [2023-12-27 23:33:37,855][106225] Updated weights for policy 1, policy_version 602765 (0.0011) [2023-12-27 23:33:38,472][106226] Updated weights for policy 0, policy_version 600789 (0.0007) [2023-12-27 23:33:38,561][106226] Updated weights for policy 0, policy_version 600799 (0.0006) [2023-12-27 23:33:38,609][106225] Updated weights for policy 1, policy_version 602775 (0.0011) [2023-12-27 23:33:38,623][106226] Updated weights for policy 0, policy_version 600809 (0.0009) [2023-12-27 23:33:38,668][106225] Updated weights for policy 1, policy_version 602785 (0.0009) [2023-12-27 23:33:38,725][106225] Updated weights for policy 1, policy_version 602795 (0.0006) [2023-12-27 23:33:39,278][106226] Updated weights for policy 0, policy_version 600819 (0.0008) [2023-12-27 23:33:39,337][106226] Updated weights for policy 0, policy_version 600829 (0.0010) [2023-12-27 23:33:39,373][106225] Updated weights for policy 1, policy_version 602805 (0.0008) [2023-12-27 23:33:39,418][106226] Updated weights for policy 0, policy_version 600839 (0.0011) [2023-12-27 23:33:39,446][106225] Updated weights for policy 1, policy_version 602815 (0.0009) [2023-12-27 23:33:39,512][106225] Updated weights for policy 1, policy_version 602825 (0.0009) [2023-12-27 23:33:40,124][106226] Updated weights for policy 0, policy_version 600849 (0.0007) [2023-12-27 23:33:40,192][106226] Updated weights for policy 0, policy_version 600859 (0.0009) [2023-12-27 23:33:40,250][106225] Updated weights for policy 1, policy_version 602835 (0.0010) [2023-12-27 23:33:40,253][106226] Updated weights for policy 0, policy_version 600869 (0.0008) [2023-12-27 23:33:40,309][106226] Updated weights for policy 0, policy_version 600879 (0.0006) [2023-12-27 23:33:40,311][106225] Updated weights for policy 1, policy_version 602845 (0.0008) [2023-12-27 23:33:40,373][106225] Updated weights for policy 1, policy_version 602855 (0.0009) [2023-12-27 23:33:40,994][106226] Updated weights for policy 0, policy_version 600889 (0.0010) [2023-12-27 23:33:41,065][106226] Updated weights for policy 0, policy_version 600899 (0.0009) [2023-12-27 23:33:41,139][106225] Updated weights for policy 1, policy_version 602865 (0.0009) [2023-12-27 23:33:41,139][106226] Updated weights for policy 0, policy_version 600909 (0.0010) [2023-12-27 23:33:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 308232192. Throughput: 0: 9879.5, 1: 9873.4. Samples: 308202232. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:41,176][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.731')] [2023-12-27 23:33:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000600912_153870336.pth... [2023-12-27 23:33:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000599760_153575424.pth [2023-12-27 23:33:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000600912_153870336.pth [2023-12-27 23:33:41,205][106225] Updated weights for policy 1, policy_version 602875 (0.0009) [2023-12-27 23:33:41,274][106225] Updated weights for policy 1, policy_version 602885 (0.0009) [2023-12-27 23:33:41,331][106225] Updated weights for policy 1, policy_version 602895 (0.0009) [2023-12-27 23:33:41,340][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000602896_154370048.pth... [2023-12-27 23:33:41,345][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000601744_154075136.pth [2023-12-27 23:33:41,346][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000602896_154370048.pth [2023-12-27 23:33:41,934][106226] Updated weights for policy 0, policy_version 600919 (0.0008) [2023-12-27 23:33:42,006][106226] Updated weights for policy 0, policy_version 600929 (0.0008) [2023-12-27 23:33:42,072][106226] Updated weights for policy 0, policy_version 600939 (0.0005) [2023-12-27 23:33:42,138][106225] Updated weights for policy 1, policy_version 602905 (0.0008) [2023-12-27 23:33:42,198][106225] Updated weights for policy 1, policy_version 602915 (0.0008) [2023-12-27 23:33:42,247][106225] Updated weights for policy 1, policy_version 602925 (0.0009) [2023-12-27 23:33:42,760][106226] Updated weights for policy 0, policy_version 600949 (0.0007) [2023-12-27 23:33:42,823][106226] Updated weights for policy 0, policy_version 600959 (0.0010) [2023-12-27 23:33:42,876][106226] Updated weights for policy 0, policy_version 600969 (0.0009) [2023-12-27 23:33:42,911][106225] Updated weights for policy 1, policy_version 602935 (0.0007) [2023-12-27 23:33:42,973][106225] Updated weights for policy 1, policy_version 602945 (0.0010) [2023-12-27 23:33:43,031][106225] Updated weights for policy 1, policy_version 602955 (0.0010) [2023-12-27 23:33:43,604][106226] Updated weights for policy 0, policy_version 600979 (0.0008) [2023-12-27 23:33:43,667][106226] Updated weights for policy 0, policy_version 600989 (0.0006) [2023-12-27 23:33:43,684][106225] Updated weights for policy 1, policy_version 602965 (0.0010) [2023-12-27 23:33:43,722][106226] Updated weights for policy 0, policy_version 600999 (0.0006) [2023-12-27 23:33:43,735][106225] Updated weights for policy 1, policy_version 602975 (0.0010) [2023-12-27 23:33:43,795][106225] Updated weights for policy 1, policy_version 602985 (0.0010) [2023-12-27 23:33:44,285][106226] Updated weights for policy 0, policy_version 601009 (0.0007) [2023-12-27 23:33:44,339][106226] Updated weights for policy 0, policy_version 601019 (0.0005) [2023-12-27 23:33:44,394][106226] Updated weights for policy 0, policy_version 601029 (0.0008) [2023-12-27 23:33:44,451][106226] Updated weights for policy 0, policy_version 601039 (0.0009) [2023-12-27 23:33:44,483][106225] Updated weights for policy 1, policy_version 602995 (0.0010) [2023-12-27 23:33:44,529][106225] Updated weights for policy 1, policy_version 603005 (0.0010) [2023-12-27 23:33:44,576][106225] Updated weights for policy 1, policy_version 603015 (0.0008) [2023-12-27 23:33:45,133][106226] Updated weights for policy 0, policy_version 601049 (0.0007) [2023-12-27 23:33:45,187][106226] Updated weights for policy 0, policy_version 601059 (0.0006) [2023-12-27 23:33:45,245][106226] Updated weights for policy 0, policy_version 601069 (0.0006) [2023-12-27 23:33:45,298][106225] Updated weights for policy 1, policy_version 603025 (0.0006) [2023-12-27 23:33:45,356][106225] Updated weights for policy 1, policy_version 603035 (0.0008) [2023-12-27 23:33:45,412][106225] Updated weights for policy 1, policy_version 603045 (0.0008) [2023-12-27 23:33:45,470][106225] Updated weights for policy 1, policy_version 603055 (0.0008) [2023-12-27 23:33:45,908][106226] Updated weights for policy 0, policy_version 601079 (0.0005) [2023-12-27 23:33:45,967][106226] Updated weights for policy 0, policy_version 601089 (0.0008) [2023-12-27 23:33:46,025][106226] Updated weights for policy 0, policy_version 601099 (0.0008) [2023-12-27 23:33:46,050][106225] Updated weights for policy 1, policy_version 603065 (0.0008) [2023-12-27 23:33:46,102][106225] Updated weights for policy 1, policy_version 603075 (0.0009) [2023-12-27 23:33:46,149][106225] Updated weights for policy 1, policy_version 603085 (0.0007) [2023-12-27 23:33:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 308338688. Throughput: 0: 9816.4, 1: 9884.5. Samples: 308320532. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:46,175][105115] Avg episode reward: [(0, '-5.045'), (1, '-5.679')] [2023-12-27 23:33:46,642][106226] Updated weights for policy 0, policy_version 601109 (0.0008) [2023-12-27 23:33:46,695][106226] Updated weights for policy 0, policy_version 601119 (0.0005) [2023-12-27 23:33:46,744][106226] Updated weights for policy 0, policy_version 601129 (0.0008) [2023-12-27 23:33:46,932][106225] Updated weights for policy 1, policy_version 603095 (0.0007) [2023-12-27 23:33:46,983][106225] Updated weights for policy 1, policy_version 603105 (0.0005) [2023-12-27 23:33:47,037][106225] Updated weights for policy 1, policy_version 603115 (0.0005) [2023-12-27 23:33:47,366][106226] Updated weights for policy 0, policy_version 601139 (0.0007) [2023-12-27 23:33:47,434][106226] Updated weights for policy 0, policy_version 601149 (0.0006) [2023-12-27 23:33:47,505][106226] Updated weights for policy 0, policy_version 601159 (0.0006) [2023-12-27 23:33:47,574][106225] Updated weights for policy 1, policy_version 603125 (0.0005) [2023-12-27 23:33:47,633][106225] Updated weights for policy 1, policy_version 603135 (0.0005) [2023-12-27 23:33:47,692][106225] Updated weights for policy 1, policy_version 603145 (0.0005) [2023-12-27 23:33:48,020][106226] Updated weights for policy 0, policy_version 601169 (0.0006) [2023-12-27 23:33:48,070][106226] Updated weights for policy 0, policy_version 601179 (0.0008) [2023-12-27 23:33:48,120][106226] Updated weights for policy 0, policy_version 601189 (0.0009) [2023-12-27 23:33:48,176][106226] Updated weights for policy 0, policy_version 601199 (0.0008) [2023-12-27 23:33:48,272][106225] Updated weights for policy 1, policy_version 603155 (0.0008) [2023-12-27 23:33:48,332][106225] Updated weights for policy 1, policy_version 603165 (0.0008) [2023-12-27 23:33:48,399][106225] Updated weights for policy 1, policy_version 603175 (0.0009) [2023-12-27 23:33:48,992][106226] Updated weights for policy 0, policy_version 601209 (0.0009) [2023-12-27 23:33:49,060][106225] Updated weights for policy 1, policy_version 603185 (0.0010) [2023-12-27 23:33:49,061][106226] Updated weights for policy 0, policy_version 601219 (0.0008) [2023-12-27 23:33:49,123][106226] Updated weights for policy 0, policy_version 601229 (0.0005) [2023-12-27 23:33:49,126][106225] Updated weights for policy 1, policy_version 603195 (0.0006) [2023-12-27 23:33:49,180][106225] Updated weights for policy 1, policy_version 603205 (0.0008) [2023-12-27 23:33:49,878][106226] Updated weights for policy 0, policy_version 601239 (0.0010) [2023-12-27 23:33:49,936][106226] Updated weights for policy 0, policy_version 601249 (0.0011) [2023-12-27 23:33:49,948][106225] Updated weights for policy 1, policy_version 603217 (0.0008) [2023-12-27 23:33:50,008][106226] Updated weights for policy 0, policy_version 601259 (0.0011) [2023-12-27 23:33:50,015][106225] Updated weights for policy 1, policy_version 603227 (0.0006) [2023-12-27 23:33:50,071][106225] Updated weights for policy 1, policy_version 603237 (0.0006) [2023-12-27 23:33:50,135][106225] Updated weights for policy 1, policy_version 603247 (0.0007) [2023-12-27 23:33:50,690][106226] Updated weights for policy 0, policy_version 601269 (0.0010) [2023-12-27 23:33:50,751][106226] Updated weights for policy 0, policy_version 601279 (0.0011) [2023-12-27 23:33:50,811][106226] Updated weights for policy 0, policy_version 601289 (0.0007) [2023-12-27 23:33:50,845][106225] Updated weights for policy 1, policy_version 603257 (0.0010) [2023-12-27 23:33:50,901][106225] Updated weights for policy 1, policy_version 603267 (0.0009) [2023-12-27 23:33:50,952][106225] Updated weights for policy 1, policy_version 603277 (0.0010) [2023-12-27 23:33:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 308436992. Throughput: 0: 9867.3, 1: 9889.3. Samples: 308444184. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:51,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-5.714')] [2023-12-27 23:33:51,596][106226] Updated weights for policy 0, policy_version 601299 (0.0008) [2023-12-27 23:33:51,663][106226] Updated weights for policy 0, policy_version 601309 (0.0009) [2023-12-27 23:33:51,706][106225] Updated weights for policy 1, policy_version 603287 (0.0010) [2023-12-27 23:33:51,721][106226] Updated weights for policy 0, policy_version 601319 (0.0011) [2023-12-27 23:33:51,783][106225] Updated weights for policy 1, policy_version 603297 (0.0009) [2023-12-27 23:33:51,841][106225] Updated weights for policy 1, policy_version 603307 (0.0010) [2023-12-27 23:33:52,401][106226] Updated weights for policy 0, policy_version 601329 (0.0009) [2023-12-27 23:33:52,462][106226] Updated weights for policy 0, policy_version 601339 (0.0011) [2023-12-27 23:33:52,520][106226] Updated weights for policy 0, policy_version 601349 (0.0011) [2023-12-27 23:33:52,567][106225] Updated weights for policy 1, policy_version 603317 (0.0008) [2023-12-27 23:33:52,581][106226] Updated weights for policy 0, policy_version 601359 (0.0011) [2023-12-27 23:33:52,626][106225] Updated weights for policy 1, policy_version 603327 (0.0007) [2023-12-27 23:33:52,684][106225] Updated weights for policy 1, policy_version 603337 (0.0007) [2023-12-27 23:33:53,286][106225] Updated weights for policy 1, policy_version 603347 (0.0007) [2023-12-27 23:33:53,298][106226] Updated weights for policy 0, policy_version 601369 (0.0010) [2023-12-27 23:33:53,348][106226] Updated weights for policy 0, policy_version 601379 (0.0010) [2023-12-27 23:33:53,354][106225] Updated weights for policy 1, policy_version 603357 (0.0005) [2023-12-27 23:33:53,401][106226] Updated weights for policy 0, policy_version 601389 (0.0010) [2023-12-27 23:33:53,415][106225] Updated weights for policy 1, policy_version 603367 (0.0005) [2023-12-27 23:33:54,036][106225] Updated weights for policy 1, policy_version 603377 (0.0006) [2023-12-27 23:33:54,109][106225] Updated weights for policy 1, policy_version 603387 (0.0008) [2023-12-27 23:33:54,135][106226] Updated weights for policy 0, policy_version 601399 (0.0009) [2023-12-27 23:33:54,177][106225] Updated weights for policy 1, policy_version 603397 (0.0007) [2023-12-27 23:33:54,204][106226] Updated weights for policy 0, policy_version 601409 (0.0008) [2023-12-27 23:33:54,243][106225] Updated weights for policy 1, policy_version 603407 (0.0008) [2023-12-27 23:33:54,264][106226] Updated weights for policy 0, policy_version 601419 (0.0006) [2023-12-27 23:33:54,923][106225] Updated weights for policy 1, policy_version 603417 (0.0010) [2023-12-27 23:33:54,942][106226] Updated weights for policy 0, policy_version 601429 (0.0008) [2023-12-27 23:33:54,976][106225] Updated weights for policy 1, policy_version 603427 (0.0006) [2023-12-27 23:33:55,010][106226] Updated weights for policy 0, policy_version 601439 (0.0009) [2023-12-27 23:33:55,038][106225] Updated weights for policy 1, policy_version 603437 (0.0009) [2023-12-27 23:33:55,071][106226] Updated weights for policy 0, policy_version 601449 (0.0010) [2023-12-27 23:33:55,713][106226] Updated weights for policy 0, policy_version 601459 (0.0011) [2023-12-27 23:33:55,741][106225] Updated weights for policy 1, policy_version 603447 (0.0010) [2023-12-27 23:33:55,770][106226] Updated weights for policy 0, policy_version 601469 (0.0010) [2023-12-27 23:33:55,799][106225] Updated weights for policy 1, policy_version 603457 (0.0009) [2023-12-27 23:33:55,830][106226] Updated weights for policy 0, policy_version 601479 (0.0010) [2023-12-27 23:33:55,858][106225] Updated weights for policy 1, policy_version 603467 (0.0005) [2023-12-27 23:33:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 308535296. Throughput: 0: 9827.1, 1: 9841.9. Samples: 308502188. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:33:56,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.505')] [2023-12-27 23:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000603472_154517504.pth... [2023-12-27 23:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000601488_154017792.pth... [2023-12-27 23:33:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000602320_154222592.pth [2023-12-27 23:33:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000600336_153722880.pth [2023-12-27 23:33:56,538][106226] Updated weights for policy 0, policy_version 601489 (0.0010) [2023-12-27 23:33:56,542][106225] Updated weights for policy 1, policy_version 603477 (0.0008) [2023-12-27 23:33:56,592][106225] Updated weights for policy 1, policy_version 603487 (0.0007) [2023-12-27 23:33:56,594][106226] Updated weights for policy 0, policy_version 601499 (0.0010) [2023-12-27 23:33:56,640][106226] Updated weights for policy 0, policy_version 601509 (0.0010) [2023-12-27 23:33:56,644][106225] Updated weights for policy 1, policy_version 603497 (0.0005) [2023-12-27 23:33:56,694][106226] Updated weights for policy 0, policy_version 601519 (0.0010) [2023-12-27 23:33:57,243][106225] Updated weights for policy 1, policy_version 603507 (0.0010) [2023-12-27 23:33:57,291][106225] Updated weights for policy 1, policy_version 603517 (0.0008) [2023-12-27 23:33:57,352][106225] Updated weights for policy 1, policy_version 603527 (0.0009) [2023-12-27 23:33:57,419][106226] Updated weights for policy 0, policy_version 601529 (0.0010) [2023-12-27 23:33:57,474][106226] Updated weights for policy 0, policy_version 601539 (0.0010) [2023-12-27 23:33:57,532][106226] Updated weights for policy 0, policy_version 601549 (0.0010) [2023-12-27 23:33:57,942][106225] Updated weights for policy 1, policy_version 603537 (0.0010) [2023-12-27 23:33:57,997][106225] Updated weights for policy 1, policy_version 603547 (0.0007) [2023-12-27 23:33:58,055][106225] Updated weights for policy 1, policy_version 603557 (0.0006) [2023-12-27 23:33:58,116][106225] Updated weights for policy 1, policy_version 603567 (0.0005) [2023-12-27 23:33:58,241][106226] Updated weights for policy 0, policy_version 601559 (0.0010) [2023-12-27 23:33:58,298][106226] Updated weights for policy 0, policy_version 601569 (0.0011) [2023-12-27 23:33:58,365][106226] Updated weights for policy 0, policy_version 601579 (0.0009) [2023-12-27 23:33:58,767][106225] Updated weights for policy 1, policy_version 603577 (0.0006) [2023-12-27 23:33:58,837][106225] Updated weights for policy 1, policy_version 603587 (0.0008) [2023-12-27 23:33:58,906][106225] Updated weights for policy 1, policy_version 603597 (0.0009) [2023-12-27 23:33:59,179][106226] Updated weights for policy 0, policy_version 601589 (0.0010) [2023-12-27 23:33:59,263][106226] Updated weights for policy 0, policy_version 601599 (0.0008) [2023-12-27 23:33:59,333][106226] Updated weights for policy 0, policy_version 601609 (0.0010) [2023-12-27 23:33:59,734][106225] Updated weights for policy 1, policy_version 603607 (0.0007) [2023-12-27 23:33:59,808][106225] Updated weights for policy 1, policy_version 603617 (0.0005) [2023-12-27 23:33:59,875][106225] Updated weights for policy 1, policy_version 603627 (0.0008) [2023-12-27 23:33:59,961][106226] Updated weights for policy 0, policy_version 601619 (0.0009) [2023-12-27 23:34:00,027][106226] Updated weights for policy 0, policy_version 601629 (0.0006) [2023-12-27 23:34:00,080][106226] Updated weights for policy 0, policy_version 601639 (0.0005) [2023-12-27 23:34:00,582][106225] Updated weights for policy 1, policy_version 603637 (0.0007) [2023-12-27 23:34:00,630][106226] Updated weights for policy 0, policy_version 601649 (0.0005) [2023-12-27 23:34:00,633][106225] Updated weights for policy 1, policy_version 603647 (0.0006) [2023-12-27 23:34:00,688][106226] Updated weights for policy 0, policy_version 601659 (0.0005) [2023-12-27 23:34:00,689][106225] Updated weights for policy 1, policy_version 603657 (0.0008) [2023-12-27 23:34:00,739][106226] Updated weights for policy 0, policy_version 601669 (0.0006) [2023-12-27 23:34:00,798][106226] Updated weights for policy 0, policy_version 601679 (0.0008) [2023-12-27 23:34:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 308633600. Throughput: 0: 9844.3, 1: 9913.5. Samples: 308622196. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:34:01,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-5.807')] [2023-12-27 23:34:01,372][106225] Updated weights for policy 1, policy_version 603667 (0.0007) [2023-12-27 23:34:01,441][106225] Updated weights for policy 1, policy_version 603677 (0.0011) [2023-12-27 23:34:01,492][106225] Updated weights for policy 1, policy_version 603687 (0.0010) [2023-12-27 23:34:01,524][106226] Updated weights for policy 0, policy_version 601689 (0.0005) [2023-12-27 23:34:01,584][106226] Updated weights for policy 0, policy_version 601699 (0.0008) [2023-12-27 23:34:01,640][106226] Updated weights for policy 0, policy_version 601709 (0.0008) [2023-12-27 23:34:02,193][106225] Updated weights for policy 1, policy_version 603697 (0.0010) [2023-12-27 23:34:02,250][106225] Updated weights for policy 1, policy_version 603707 (0.0006) [2023-12-27 23:34:02,316][106225] Updated weights for policy 1, policy_version 603717 (0.0007) [2023-12-27 23:34:02,380][106225] Updated weights for policy 1, policy_version 603727 (0.0008) [2023-12-27 23:34:02,421][106226] Updated weights for policy 0, policy_version 601719 (0.0008) [2023-12-27 23:34:02,477][106226] Updated weights for policy 0, policy_version 601729 (0.0007) [2023-12-27 23:34:02,560][106226] Updated weights for policy 0, policy_version 601739 (0.0005) [2023-12-27 23:34:03,079][106225] Updated weights for policy 1, policy_version 603737 (0.0005) [2023-12-27 23:34:03,131][106225] Updated weights for policy 1, policy_version 603747 (0.0005) [2023-12-27 23:34:03,168][106226] Updated weights for policy 0, policy_version 601749 (0.0006) [2023-12-27 23:34:03,181][106225] Updated weights for policy 1, policy_version 603757 (0.0005) [2023-12-27 23:34:03,221][106226] Updated weights for policy 0, policy_version 601759 (0.0009) [2023-12-27 23:34:03,277][106226] Updated weights for policy 0, policy_version 601769 (0.0009) [2023-12-27 23:34:03,723][106225] Updated weights for policy 1, policy_version 603767 (0.0007) [2023-12-27 23:34:03,778][106225] Updated weights for policy 1, policy_version 603777 (0.0006) [2023-12-27 23:34:03,831][106225] Updated weights for policy 1, policy_version 603787 (0.0005) [2023-12-27 23:34:04,040][106226] Updated weights for policy 0, policy_version 601779 (0.0009) [2023-12-27 23:34:04,107][106226] Updated weights for policy 0, policy_version 601789 (0.0009) [2023-12-27 23:34:04,161][106226] Updated weights for policy 0, policy_version 601799 (0.0009) [2023-12-27 23:34:04,593][106225] Updated weights for policy 1, policy_version 603797 (0.0008) [2023-12-27 23:34:04,647][106225] Updated weights for policy 1, policy_version 603807 (0.0008) [2023-12-27 23:34:04,693][106225] Updated weights for policy 1, policy_version 603817 (0.0009) [2023-12-27 23:34:04,833][106226] Updated weights for policy 0, policy_version 601809 (0.0007) [2023-12-27 23:34:04,896][106226] Updated weights for policy 0, policy_version 601819 (0.0010) [2023-12-27 23:34:04,949][106226] Updated weights for policy 0, policy_version 601829 (0.0010) [2023-12-27 23:34:05,005][106226] Updated weights for policy 0, policy_version 601839 (0.0007) [2023-12-27 23:34:05,320][106225] Updated weights for policy 1, policy_version 603827 (0.0008) [2023-12-27 23:34:05,390][106225] Updated weights for policy 1, policy_version 603837 (0.0010) [2023-12-27 23:34:05,454][106225] Updated weights for policy 1, policy_version 603847 (0.0010) [2023-12-27 23:34:05,596][106226] Updated weights for policy 0, policy_version 601849 (0.0006) [2023-12-27 23:34:05,655][106226] Updated weights for policy 0, policy_version 601859 (0.0009) [2023-12-27 23:34:05,716][106226] Updated weights for policy 0, policy_version 601869 (0.0009) [2023-12-27 23:34:06,050][106225] Updated weights for policy 1, policy_version 603857 (0.0009) [2023-12-27 23:34:06,105][106225] Updated weights for policy 1, policy_version 603867 (0.0006) [2023-12-27 23:34:06,168][106225] Updated weights for policy 1, policy_version 603877 (0.0007) [2023-12-27 23:34:06,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 308731904. Throughput: 0: 9931.3, 1: 9883.3. Samples: 308743184. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-27 23:34:06,175][105115] Avg episode reward: [(0, '-5.048'), (1, '-5.690')] [2023-12-27 23:34:06,227][106225] Updated weights for policy 1, policy_version 603887 (0.0005) [2023-12-27 23:34:06,497][106226] Updated weights for policy 0, policy_version 601879 (0.0009) [2023-12-27 23:34:06,552][106226] Updated weights for policy 0, policy_version 601889 (0.0009) [2023-12-27 23:34:06,619][106226] Updated weights for policy 0, policy_version 601899 (0.0007) [2023-12-27 23:34:06,844][106225] Updated weights for policy 1, policy_version 603897 (0.0008) [2023-12-27 23:34:06,903][106225] Updated weights for policy 1, policy_version 603907 (0.0006) [2023-12-27 23:34:06,964][106225] Updated weights for policy 1, policy_version 603917 (0.0005) [2023-12-27 23:34:07,398][106226] Updated weights for policy 0, policy_version 601909 (0.0008) [2023-12-27 23:34:07,467][106226] Updated weights for policy 0, policy_version 601919 (0.0009) [2023-12-27 23:34:07,520][106226] Updated weights for policy 0, policy_version 601929 (0.0008) [2023-12-27 23:34:07,555][106225] Updated weights for policy 1, policy_version 603927 (0.0006) [2023-12-27 23:34:07,622][106225] Updated weights for policy 1, policy_version 603937 (0.0008) [2023-12-27 23:34:07,680][106225] Updated weights for policy 1, policy_version 603947 (0.0008) [2023-12-27 23:34:08,204][106226] Updated weights for policy 0, policy_version 601939 (0.0008) [2023-12-27 23:34:08,276][106226] Updated weights for policy 0, policy_version 601949 (0.0009) [2023-12-27 23:34:08,354][106226] Updated weights for policy 0, policy_version 601960 (0.0009) [2023-12-27 23:34:08,366][106225] Updated weights for policy 1, policy_version 603957 (0.0008) [2023-12-27 23:34:08,427][106225] Updated weights for policy 1, policy_version 603967 (0.0007) [2023-12-27 23:34:08,494][106225] Updated weights for policy 1, policy_version 603977 (0.0009) [2023-12-27 23:34:08,990][106226] Updated weights for policy 0, policy_version 601970 (0.0006) [2023-12-27 23:34:09,055][106226] Updated weights for policy 0, policy_version 601980 (0.0006) [2023-12-27 23:34:09,114][106226] Updated weights for policy 0, policy_version 601990 (0.0011) [2023-12-27 23:34:09,172][106226] Updated weights for policy 0, policy_version 602000 (0.0011) [2023-12-27 23:34:09,230][106225] Updated weights for policy 1, policy_version 603987 (0.0008) [2023-12-27 23:34:09,288][106225] Updated weights for policy 1, policy_version 603997 (0.0008) [2023-12-27 23:34:09,355][106225] Updated weights for policy 1, policy_version 604007 (0.0009) [2023-12-27 23:34:09,961][106226] Updated weights for policy 0, policy_version 602010 (0.0007) [2023-12-27 23:34:10,033][106226] Updated weights for policy 0, policy_version 602020 (0.0009) [2023-12-27 23:34:10,068][106225] Updated weights for policy 1, policy_version 604017 (0.0008) [2023-12-27 23:34:10,095][106226] Updated weights for policy 0, policy_version 602030 (0.0011) [2023-12-27 23:34:10,125][106225] Updated weights for policy 1, policy_version 604027 (0.0008) [2023-12-27 23:34:10,183][106225] Updated weights for policy 1, policy_version 604037 (0.0007) [2023-12-27 23:34:10,242][106225] Updated weights for policy 1, policy_version 604047 (0.0006) [2023-12-27 23:34:10,799][106226] Updated weights for policy 0, policy_version 602040 (0.0009) [2023-12-27 23:34:10,858][106226] Updated weights for policy 0, policy_version 602050 (0.0010) [2023-12-27 23:34:10,916][106226] Updated weights for policy 0, policy_version 602060 (0.0011) [2023-12-27 23:34:10,917][106225] Updated weights for policy 1, policy_version 604057 (0.0006) [2023-12-27 23:34:10,974][106225] Updated weights for policy 1, policy_version 604067 (0.0007) [2023-12-27 23:34:11,037][106225] Updated weights for policy 1, policy_version 604077 (0.0008) [2023-12-27 23:34:11,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 308838400. Throughput: 0: 9953.7, 1: 9995.6. Samples: 308804660. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:11,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.865')] [2023-12-27 23:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000602064_154165248.pth... [2023-12-27 23:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000604080_154673152.pth... [2023-12-27 23:34:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000600912_153870336.pth [2023-12-27 23:34:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000602896_154370048.pth [2023-12-27 23:34:11,660][106226] Updated weights for policy 0, policy_version 602070 (0.0009) [2023-12-27 23:34:11,716][106226] Updated weights for policy 0, policy_version 602080 (0.0006) [2023-12-27 23:34:11,783][106226] Updated weights for policy 0, policy_version 602090 (0.0009) [2023-12-27 23:34:11,833][106225] Updated weights for policy 1, policy_version 604087 (0.0008) [2023-12-27 23:34:11,897][106225] Updated weights for policy 1, policy_version 604097 (0.0008) [2023-12-27 23:34:11,960][106225] Updated weights for policy 1, policy_version 604107 (0.0010) [2023-12-27 23:34:12,462][106226] Updated weights for policy 0, policy_version 602100 (0.0007) [2023-12-27 23:34:12,522][106226] Updated weights for policy 0, policy_version 602110 (0.0007) [2023-12-27 23:34:12,582][106226] Updated weights for policy 0, policy_version 602120 (0.0007) [2023-12-27 23:34:12,823][106225] Updated weights for policy 1, policy_version 604117 (0.0009) [2023-12-27 23:34:12,895][106225] Updated weights for policy 1, policy_version 604127 (0.0009) [2023-12-27 23:34:12,958][106225] Updated weights for policy 1, policy_version 604137 (0.0009) [2023-12-27 23:34:13,208][106226] Updated weights for policy 0, policy_version 602130 (0.0009) [2023-12-27 23:34:13,259][106226] Updated weights for policy 0, policy_version 602140 (0.0006) [2023-12-27 23:34:13,314][106226] Updated weights for policy 0, policy_version 602150 (0.0005) [2023-12-27 23:34:13,372][106226] Updated weights for policy 0, policy_version 602160 (0.0008) [2023-12-27 23:34:13,716][106225] Updated weights for policy 1, policy_version 604147 (0.0008) [2023-12-27 23:34:13,779][106225] Updated weights for policy 1, policy_version 604157 (0.0008) [2023-12-27 23:34:13,837][106225] Updated weights for policy 1, policy_version 604167 (0.0007) [2023-12-27 23:34:14,019][106226] Updated weights for policy 0, policy_version 602170 (0.0010) [2023-12-27 23:34:14,075][106226] Updated weights for policy 0, policy_version 602180 (0.0010) [2023-12-27 23:34:14,133][106226] Updated weights for policy 0, policy_version 602190 (0.0010) [2023-12-27 23:34:14,588][106225] Updated weights for policy 1, policy_version 604177 (0.0007) [2023-12-27 23:34:14,651][106225] Updated weights for policy 1, policy_version 604187 (0.0007) [2023-12-27 23:34:14,710][106225] Updated weights for policy 1, policy_version 604197 (0.0008) [2023-12-27 23:34:14,744][106226] Updated weights for policy 0, policy_version 602200 (0.0011) [2023-12-27 23:34:14,769][106225] Updated weights for policy 1, policy_version 604207 (0.0006) [2023-12-27 23:34:14,812][106226] Updated weights for policy 0, policy_version 602210 (0.0010) [2023-12-27 23:34:14,870][106226] Updated weights for policy 0, policy_version 602220 (0.0011) [2023-12-27 23:34:15,472][106226] Updated weights for policy 0, policy_version 602230 (0.0008) [2023-12-27 23:34:15,527][106226] Updated weights for policy 0, policy_version 602240 (0.0006) [2023-12-27 23:34:15,579][106226] Updated weights for policy 0, policy_version 602250 (0.0008) [2023-12-27 23:34:15,611][106225] Updated weights for policy 1, policy_version 604217 (0.0007) [2023-12-27 23:34:15,664][106225] Updated weights for policy 1, policy_version 604227 (0.0008) [2023-12-27 23:34:15,715][106225] Updated weights for policy 1, policy_version 604237 (0.0008) [2023-12-27 23:34:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 308928512. Throughput: 0: 9939.4, 1: 9920.8. Samples: 308919996. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:16,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-5.729')] [2023-12-27 23:34:16,269][106226] Updated weights for policy 0, policy_version 602260 (0.0010) [2023-12-27 23:34:16,328][106226] Updated weights for policy 0, policy_version 602270 (0.0010) [2023-12-27 23:34:16,381][106226] Updated weights for policy 0, policy_version 602280 (0.0010) [2023-12-27 23:34:16,431][106225] Updated weights for policy 1, policy_version 604247 (0.0006) [2023-12-27 23:34:16,491][106225] Updated weights for policy 1, policy_version 604257 (0.0007) [2023-12-27 23:34:16,555][106225] Updated weights for policy 1, policy_version 604267 (0.0008) [2023-12-27 23:34:17,080][106226] Updated weights for policy 0, policy_version 602290 (0.0011) [2023-12-27 23:34:17,142][106226] Updated weights for policy 0, policy_version 602300 (0.0010) [2023-12-27 23:34:17,208][106226] Updated weights for policy 0, policy_version 602310 (0.0011) [2023-12-27 23:34:17,258][106225] Updated weights for policy 1, policy_version 604277 (0.0006) [2023-12-27 23:34:17,267][106226] Updated weights for policy 0, policy_version 602320 (0.0010) [2023-12-27 23:34:17,306][106225] Updated weights for policy 1, policy_version 604287 (0.0007) [2023-12-27 23:34:17,351][106225] Updated weights for policy 1, policy_version 604297 (0.0007) [2023-12-27 23:34:17,944][106226] Updated weights for policy 0, policy_version 602330 (0.0005) [2023-12-27 23:34:17,992][106226] Updated weights for policy 0, policy_version 602340 (0.0005) [2023-12-27 23:34:18,049][106226] Updated weights for policy 0, policy_version 602350 (0.0011) [2023-12-27 23:34:18,113][106225] Updated weights for policy 1, policy_version 604307 (0.0008) [2023-12-27 23:34:18,161][106225] Updated weights for policy 1, policy_version 604317 (0.0008) [2023-12-27 23:34:18,209][106225] Updated weights for policy 1, policy_version 604327 (0.0007) [2023-12-27 23:34:18,725][106226] Updated weights for policy 0, policy_version 602360 (0.0010) [2023-12-27 23:34:18,785][106226] Updated weights for policy 0, policy_version 602370 (0.0008) [2023-12-27 23:34:18,849][106226] Updated weights for policy 0, policy_version 602380 (0.0006) [2023-12-27 23:34:18,922][106225] Updated weights for policy 1, policy_version 604337 (0.0007) [2023-12-27 23:34:18,983][106225] Updated weights for policy 1, policy_version 604347 (0.0007) [2023-12-27 23:34:19,034][106225] Updated weights for policy 1, policy_version 604357 (0.0005) [2023-12-27 23:34:19,095][106225] Updated weights for policy 1, policy_version 604367 (0.0007) [2023-12-27 23:34:19,565][106226] Updated weights for policy 0, policy_version 602390 (0.0010) [2023-12-27 23:34:19,623][106226] Updated weights for policy 0, policy_version 602400 (0.0010) [2023-12-27 23:34:19,691][106226] Updated weights for policy 0, policy_version 602410 (0.0008) [2023-12-27 23:34:19,762][106225] Updated weights for policy 1, policy_version 604377 (0.0008) [2023-12-27 23:34:19,818][106225] Updated weights for policy 1, policy_version 604387 (0.0008) [2023-12-27 23:34:19,890][106225] Updated weights for policy 1, policy_version 604397 (0.0009) [2023-12-27 23:34:20,368][106226] Updated weights for policy 0, policy_version 602420 (0.0008) [2023-12-27 23:34:20,422][106226] Updated weights for policy 0, policy_version 602430 (0.0006) [2023-12-27 23:34:20,488][106226] Updated weights for policy 0, policy_version 602440 (0.0007) [2023-12-27 23:34:20,724][106225] Updated weights for policy 1, policy_version 604407 (0.0008) [2023-12-27 23:34:20,786][106225] Updated weights for policy 1, policy_version 604417 (0.0008) [2023-12-27 23:34:20,845][106225] Updated weights for policy 1, policy_version 604427 (0.0008) [2023-12-27 23:34:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 309026816. Throughput: 0: 9980.6, 1: 9891.7. Samples: 309037524. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:21,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.679')] [2023-12-27 23:34:21,215][106226] Updated weights for policy 0, policy_version 602450 (0.0010) [2023-12-27 23:34:21,280][106226] Updated weights for policy 0, policy_version 602460 (0.0011) [2023-12-27 23:34:21,343][106226] Updated weights for policy 0, policy_version 602470 (0.0011) [2023-12-27 23:34:21,414][106226] Updated weights for policy 0, policy_version 602480 (0.0014) [2023-12-27 23:34:21,636][106225] Updated weights for policy 1, policy_version 604437 (0.0009) [2023-12-27 23:34:21,699][106225] Updated weights for policy 1, policy_version 604447 (0.0008) [2023-12-27 23:34:21,766][106225] Updated weights for policy 1, policy_version 604457 (0.0009) [2023-12-27 23:34:22,153][106226] Updated weights for policy 0, policy_version 602490 (0.0009) [2023-12-27 23:34:22,203][106226] Updated weights for policy 0, policy_version 602500 (0.0010) [2023-12-27 23:34:22,250][106226] Updated weights for policy 0, policy_version 602510 (0.0010) [2023-12-27 23:34:22,518][106225] Updated weights for policy 1, policy_version 604467 (0.0009) [2023-12-27 23:34:22,576][106225] Updated weights for policy 1, policy_version 604477 (0.0010) [2023-12-27 23:34:22,637][106225] Updated weights for policy 1, policy_version 604487 (0.0008) [2023-12-27 23:34:22,928][106226] Updated weights for policy 0, policy_version 602520 (0.0009) [2023-12-27 23:34:22,997][106226] Updated weights for policy 0, policy_version 602530 (0.0005) [2023-12-27 23:34:23,062][106226] Updated weights for policy 0, policy_version 602540 (0.0006) [2023-12-27 23:34:23,427][106225] Updated weights for policy 1, policy_version 604497 (0.0008) [2023-12-27 23:34:23,493][106225] Updated weights for policy 1, policy_version 604507 (0.0008) [2023-12-27 23:34:23,552][106225] Updated weights for policy 1, policy_version 604517 (0.0008) [2023-12-27 23:34:23,609][106225] Updated weights for policy 1, policy_version 604527 (0.0009) [2023-12-27 23:34:23,633][106226] Updated weights for policy 0, policy_version 602550 (0.0005) [2023-12-27 23:34:23,690][106226] Updated weights for policy 0, policy_version 602560 (0.0009) [2023-12-27 23:34:23,747][106226] Updated weights for policy 0, policy_version 602570 (0.0008) [2023-12-27 23:34:24,382][106225] Updated weights for policy 1, policy_version 604537 (0.0009) [2023-12-27 23:34:24,433][106225] Updated weights for policy 1, policy_version 604547 (0.0008) [2023-12-27 23:34:24,487][106225] Updated weights for policy 1, policy_version 604557 (0.0008) [2023-12-27 23:34:24,498][106226] Updated weights for policy 0, policy_version 602580 (0.0007) [2023-12-27 23:34:24,553][106226] Updated weights for policy 0, policy_version 602590 (0.0008) [2023-12-27 23:34:24,604][106226] Updated weights for policy 0, policy_version 602600 (0.0009) [2023-12-27 23:34:25,230][106225] Updated weights for policy 1, policy_version 604567 (0.0008) [2023-12-27 23:34:25,282][106225] Updated weights for policy 1, policy_version 604577 (0.0008) [2023-12-27 23:34:25,337][106225] Updated weights for policy 1, policy_version 604587 (0.0008) [2023-12-27 23:34:25,339][106226] Updated weights for policy 0, policy_version 602610 (0.0007) [2023-12-27 23:34:25,390][106226] Updated weights for policy 0, policy_version 602620 (0.0008) [2023-12-27 23:34:25,446][106226] Updated weights for policy 0, policy_version 602630 (0.0008) [2023-12-27 23:34:25,500][106226] Updated weights for policy 0, policy_version 602640 (0.0008) [2023-12-27 23:34:26,060][106225] Updated weights for policy 1, policy_version 604597 (0.0008) [2023-12-27 23:34:26,125][106225] Updated weights for policy 1, policy_version 604607 (0.0009) [2023-12-27 23:34:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 309116928. Throughput: 0: 9965.5, 1: 9847.6. Samples: 309093816. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:26,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.857')] [2023-12-27 23:34:26,182][106225] Updated weights for policy 1, policy_version 604617 (0.0008) [2023-12-27 23:34:26,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000604624_154812416.pth... [2023-12-27 23:34:26,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000603472_154517504.pth [2023-12-27 23:34:26,234][106226] Updated weights for policy 0, policy_version 602650 (0.0006) [2023-12-27 23:34:26,292][106226] Updated weights for policy 0, policy_version 602660 (0.0006) [2023-12-27 23:34:26,351][106226] Updated weights for policy 0, policy_version 602670 (0.0005) [2023-12-27 23:34:26,364][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000602672_154320896.pth... [2023-12-27 23:34:26,369][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000601488_154017792.pth [2023-12-27 23:34:26,921][106225] Updated weights for policy 1, policy_version 604627 (0.0008) [2023-12-27 23:34:26,976][106225] Updated weights for policy 1, policy_version 604637 (0.0008) [2023-12-27 23:34:26,983][106226] Updated weights for policy 0, policy_version 602680 (0.0006) [2023-12-27 23:34:27,034][106225] Updated weights for policy 1, policy_version 604647 (0.0007) [2023-12-27 23:34:27,048][106226] Updated weights for policy 0, policy_version 602690 (0.0005) [2023-12-27 23:34:27,104][106226] Updated weights for policy 0, policy_version 602700 (0.0009) [2023-12-27 23:34:27,758][106225] Updated weights for policy 1, policy_version 604657 (0.0007) [2023-12-27 23:34:27,823][106225] Updated weights for policy 1, policy_version 604667 (0.0008) [2023-12-27 23:34:27,832][106226] Updated weights for policy 0, policy_version 602710 (0.0008) [2023-12-27 23:34:27,884][106225] Updated weights for policy 1, policy_version 604677 (0.0005) [2023-12-27 23:34:27,889][106226] Updated weights for policy 0, policy_version 602720 (0.0008) [2023-12-27 23:34:27,941][106225] Updated weights for policy 1, policy_version 604687 (0.0006) [2023-12-27 23:34:27,946][106226] Updated weights for policy 0, policy_version 602730 (0.0006) [2023-12-27 23:34:28,650][106226] Updated weights for policy 0, policy_version 602740 (0.0006) [2023-12-27 23:34:28,678][106225] Updated weights for policy 1, policy_version 604697 (0.0007) [2023-12-27 23:34:28,707][106226] Updated weights for policy 0, policy_version 602750 (0.0007) [2023-12-27 23:34:28,735][106225] Updated weights for policy 1, policy_version 604707 (0.0007) [2023-12-27 23:34:28,765][106226] Updated weights for policy 0, policy_version 602760 (0.0006) [2023-12-27 23:34:28,796][106225] Updated weights for policy 1, policy_version 604717 (0.0007) [2023-12-27 23:34:29,515][106226] Updated weights for policy 0, policy_version 602770 (0.0007) [2023-12-27 23:34:29,517][106225] Updated weights for policy 1, policy_version 604727 (0.0008) [2023-12-27 23:34:29,566][106226] Updated weights for policy 0, policy_version 602780 (0.0006) [2023-12-27 23:34:29,579][106225] Updated weights for policy 1, policy_version 604737 (0.0009) [2023-12-27 23:34:29,620][106226] Updated weights for policy 0, policy_version 602790 (0.0006) [2023-12-27 23:34:29,634][106225] Updated weights for policy 1, policy_version 604747 (0.0006) [2023-12-27 23:34:29,680][106226] Updated weights for policy 0, policy_version 602800 (0.0007) [2023-12-27 23:34:30,377][106226] Updated weights for policy 0, policy_version 602810 (0.0005) [2023-12-27 23:34:30,405][106225] Updated weights for policy 1, policy_version 604757 (0.0007) [2023-12-27 23:34:30,436][106226] Updated weights for policy 0, policy_version 602820 (0.0005) [2023-12-27 23:34:30,461][106225] Updated weights for policy 1, policy_version 604767 (0.0008) [2023-12-27 23:34:30,494][106226] Updated weights for policy 0, policy_version 602830 (0.0006) [2023-12-27 23:34:30,516][106225] Updated weights for policy 1, policy_version 604777 (0.0008) [2023-12-27 23:34:31,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 309215232. Throughput: 0: 9944.0, 1: 9820.1. Samples: 309209916. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:31,175][105115] Avg episode reward: [(0, '-5.013'), (1, '-5.866')] [2023-12-27 23:34:31,187][106226] Updated weights for policy 0, policy_version 602840 (0.0009) [2023-12-27 23:34:31,193][106225] Updated weights for policy 1, policy_version 604787 (0.0008) [2023-12-27 23:34:31,239][106226] Updated weights for policy 0, policy_version 602850 (0.0009) [2023-12-27 23:34:31,261][106225] Updated weights for policy 1, policy_version 604797 (0.0008) [2023-12-27 23:34:31,297][106226] Updated weights for policy 0, policy_version 602860 (0.0008) [2023-12-27 23:34:31,325][106225] Updated weights for policy 1, policy_version 604807 (0.0008) [2023-12-27 23:34:31,928][106226] Updated weights for policy 0, policy_version 602870 (0.0005) [2023-12-27 23:34:31,980][106226] Updated weights for policy 0, policy_version 602880 (0.0005) [2023-12-27 23:34:32,037][106226] Updated weights for policy 0, policy_version 602890 (0.0005) [2023-12-27 23:34:32,052][106225] Updated weights for policy 1, policy_version 604817 (0.0008) [2023-12-27 23:34:32,109][106225] Updated weights for policy 1, policy_version 604827 (0.0010) [2023-12-27 23:34:32,169][106225] Updated weights for policy 1, policy_version 604837 (0.0009) [2023-12-27 23:34:32,226][106225] Updated weights for policy 1, policy_version 604847 (0.0010) [2023-12-27 23:34:32,706][106226] Updated weights for policy 0, policy_version 602900 (0.0008) [2023-12-27 23:34:32,764][106226] Updated weights for policy 0, policy_version 602910 (0.0007) [2023-12-27 23:34:32,817][106226] Updated weights for policy 0, policy_version 602920 (0.0007) [2023-12-27 23:34:32,942][106225] Updated weights for policy 1, policy_version 604857 (0.0010) [2023-12-27 23:34:32,993][106225] Updated weights for policy 1, policy_version 604867 (0.0010) [2023-12-27 23:34:33,049][106225] Updated weights for policy 1, policy_version 604877 (0.0010) [2023-12-27 23:34:33,507][106226] Updated weights for policy 0, policy_version 602930 (0.0007) [2023-12-27 23:34:33,567][106226] Updated weights for policy 0, policy_version 602940 (0.0006) [2023-12-27 23:34:33,627][106226] Updated weights for policy 0, policy_version 602950 (0.0007) [2023-12-27 23:34:33,682][106226] Updated weights for policy 0, policy_version 602960 (0.0009) [2023-12-27 23:34:33,717][106225] Updated weights for policy 1, policy_version 604887 (0.0008) [2023-12-27 23:34:33,767][106225] Updated weights for policy 1, policy_version 604897 (0.0008) [2023-12-27 23:34:33,822][106225] Updated weights for policy 1, policy_version 604907 (0.0008) [2023-12-27 23:34:34,442][106226] Updated weights for policy 0, policy_version 602970 (0.0009) [2023-12-27 23:34:34,473][106225] Updated weights for policy 1, policy_version 604917 (0.0008) [2023-12-27 23:34:34,505][106226] Updated weights for policy 0, policy_version 602980 (0.0006) [2023-12-27 23:34:34,536][106225] Updated weights for policy 1, policy_version 604927 (0.0008) [2023-12-27 23:34:34,567][106226] Updated weights for policy 0, policy_version 602990 (0.0005) [2023-12-27 23:34:34,601][106225] Updated weights for policy 1, policy_version 604937 (0.0008) [2023-12-27 23:34:35,233][106226] Updated weights for policy 0, policy_version 603000 (0.0006) [2023-12-27 23:34:35,286][106226] Updated weights for policy 0, policy_version 603010 (0.0005) [2023-12-27 23:34:35,334][106226] Updated weights for policy 0, policy_version 603020 (0.0005) [2023-12-27 23:34:35,343][106225] Updated weights for policy 1, policy_version 604947 (0.0007) [2023-12-27 23:34:35,412][106225] Updated weights for policy 1, policy_version 604957 (0.0009) [2023-12-27 23:34:35,476][106225] Updated weights for policy 1, policy_version 604967 (0.0008) [2023-12-27 23:34:35,978][106226] Updated weights for policy 0, policy_version 603030 (0.0008) [2023-12-27 23:34:36,040][106226] Updated weights for policy 0, policy_version 603040 (0.0006) [2023-12-27 23:34:36,105][106226] Updated weights for policy 0, policy_version 603050 (0.0006) [2023-12-27 23:34:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 309321728. Throughput: 0: 9953.1, 1: 9726.4. Samples: 309329760. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:36,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.680')] [2023-12-27 23:34:36,214][106225] Updated weights for policy 1, policy_version 604977 (0.0008) [2023-12-27 23:34:36,264][106225] Updated weights for policy 1, policy_version 604987 (0.0007) [2023-12-27 23:34:36,330][106225] Updated weights for policy 1, policy_version 604997 (0.0008) [2023-12-27 23:34:36,385][106225] Updated weights for policy 1, policy_version 605007 (0.0008) [2023-12-27 23:34:36,801][106226] Updated weights for policy 0, policy_version 603060 (0.0010) [2023-12-27 23:34:36,865][106226] Updated weights for policy 0, policy_version 603070 (0.0011) [2023-12-27 23:34:36,933][106226] Updated weights for policy 0, policy_version 603080 (0.0011) [2023-12-27 23:34:37,129][106225] Updated weights for policy 1, policy_version 605017 (0.0008) [2023-12-27 23:34:37,191][106225] Updated weights for policy 1, policy_version 605027 (0.0008) [2023-12-27 23:34:37,245][106225] Updated weights for policy 1, policy_version 605037 (0.0008) [2023-12-27 23:34:37,640][106226] Updated weights for policy 0, policy_version 603090 (0.0011) [2023-12-27 23:34:37,705][106226] Updated weights for policy 0, policy_version 603100 (0.0011) [2023-12-27 23:34:37,773][106226] Updated weights for policy 0, policy_version 603110 (0.0011) [2023-12-27 23:34:37,829][106226] Updated weights for policy 0, policy_version 603120 (0.0009) [2023-12-27 23:34:37,970][106225] Updated weights for policy 1, policy_version 605047 (0.0008) [2023-12-27 23:34:38,034][106225] Updated weights for policy 1, policy_version 605057 (0.0008) [2023-12-27 23:34:38,091][106225] Updated weights for policy 1, policy_version 605067 (0.0008) [2023-12-27 23:34:38,478][106226] Updated weights for policy 0, policy_version 603130 (0.0011) [2023-12-27 23:34:38,539][106226] Updated weights for policy 0, policy_version 603140 (0.0011) [2023-12-27 23:34:38,587][106226] Updated weights for policy 0, policy_version 603150 (0.0010) [2023-12-27 23:34:38,868][106225] Updated weights for policy 1, policy_version 605077 (0.0009) [2023-12-27 23:34:38,918][106225] Updated weights for policy 1, policy_version 605087 (0.0008) [2023-12-27 23:34:38,973][106225] Updated weights for policy 1, policy_version 605097 (0.0008) [2023-12-27 23:34:39,340][106226] Updated weights for policy 0, policy_version 603160 (0.0009) [2023-12-27 23:34:39,413][106226] Updated weights for policy 0, policy_version 603170 (0.0007) [2023-12-27 23:34:39,478][106226] Updated weights for policy 0, policy_version 603180 (0.0008) [2023-12-27 23:34:39,748][106225] Updated weights for policy 1, policy_version 605107 (0.0009) [2023-12-27 23:34:39,830][106225] Updated weights for policy 1, policy_version 605117 (0.0009) [2023-12-27 23:34:39,898][106225] Updated weights for policy 1, policy_version 605127 (0.0009) [2023-12-27 23:34:40,175][106226] Updated weights for policy 0, policy_version 603190 (0.0008) [2023-12-27 23:34:40,238][106226] Updated weights for policy 0, policy_version 603200 (0.0009) [2023-12-27 23:34:40,287][106226] Updated weights for policy 0, policy_version 603210 (0.0009) [2023-12-27 23:34:40,589][106225] Updated weights for policy 1, policy_version 605137 (0.0008) [2023-12-27 23:34:40,657][106225] Updated weights for policy 1, policy_version 605147 (0.0005) [2023-12-27 23:34:40,720][106225] Updated weights for policy 1, policy_version 605157 (0.0008) [2023-12-27 23:34:40,782][106225] Updated weights for policy 1, policy_version 605167 (0.0008) [2023-12-27 23:34:41,054][106226] Updated weights for policy 0, policy_version 603220 (0.0008) [2023-12-27 23:34:41,120][106226] Updated weights for policy 0, policy_version 603230 (0.0008) [2023-12-27 23:34:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 309411840. Throughput: 0: 9974.6, 1: 9700.6. Samples: 309387576. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:41,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.656')] [2023-12-27 23:34:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000605168_154951680.pth... [2023-12-27 23:34:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000604080_154673152.pth [2023-12-27 23:34:41,190][106226] Updated weights for policy 0, policy_version 603240 (0.0009) [2023-12-27 23:34:41,228][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000603248_154468352.pth... [2023-12-27 23:34:41,232][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000602064_154165248.pth [2023-12-27 23:34:41,501][106225] Updated weights for policy 1, policy_version 605177 (0.0006) [2023-12-27 23:34:41,557][106225] Updated weights for policy 1, policy_version 605187 (0.0006) [2023-12-27 23:34:41,618][106225] Updated weights for policy 1, policy_version 605197 (0.0009) [2023-12-27 23:34:42,043][106226] Updated weights for policy 0, policy_version 603250 (0.0008) [2023-12-27 23:34:42,106][106226] Updated weights for policy 0, policy_version 603260 (0.0008) [2023-12-27 23:34:42,170][106226] Updated weights for policy 0, policy_version 603270 (0.0009) [2023-12-27 23:34:42,234][106226] Updated weights for policy 0, policy_version 603280 (0.0010) [2023-12-27 23:34:42,355][106225] Updated weights for policy 1, policy_version 605207 (0.0009) [2023-12-27 23:34:42,413][106225] Updated weights for policy 1, policy_version 605217 (0.0010) [2023-12-27 23:34:42,461][106225] Updated weights for policy 1, policy_version 605227 (0.0010) [2023-12-27 23:34:42,973][106226] Updated weights for policy 0, policy_version 603290 (0.0007) [2023-12-27 23:34:43,023][106226] Updated weights for policy 0, policy_version 603300 (0.0008) [2023-12-27 23:34:43,084][106226] Updated weights for policy 0, policy_version 603310 (0.0008) [2023-12-27 23:34:43,173][106225] Updated weights for policy 1, policy_version 605237 (0.0008) [2023-12-27 23:34:43,232][106225] Updated weights for policy 1, policy_version 605247 (0.0010) [2023-12-27 23:34:43,283][106225] Updated weights for policy 1, policy_version 605257 (0.0010) [2023-12-27 23:34:43,842][106226] Updated weights for policy 0, policy_version 603320 (0.0008) [2023-12-27 23:34:43,900][106226] Updated weights for policy 0, policy_version 603330 (0.0007) [2023-12-27 23:34:43,910][106225] Updated weights for policy 1, policy_version 605267 (0.0009) [2023-12-27 23:34:43,959][106225] Updated weights for policy 1, policy_version 605277 (0.0005) [2023-12-27 23:34:43,963][106226] Updated weights for policy 0, policy_version 603340 (0.0006) [2023-12-27 23:34:44,014][106225] Updated weights for policy 1, policy_version 605287 (0.0005) [2023-12-27 23:34:44,560][106225] Updated weights for policy 1, policy_version 605297 (0.0006) [2023-12-27 23:34:44,609][106225] Updated weights for policy 1, policy_version 605307 (0.0010) [2023-12-27 23:34:44,655][106225] Updated weights for policy 1, policy_version 605317 (0.0010) [2023-12-27 23:34:44,712][106226] Updated weights for policy 0, policy_version 603350 (0.0006) [2023-12-27 23:34:44,714][106225] Updated weights for policy 1, policy_version 605327 (0.0010) [2023-12-27 23:34:44,780][106226] Updated weights for policy 0, policy_version 603360 (0.0006) [2023-12-27 23:34:44,842][106226] Updated weights for policy 0, policy_version 603370 (0.0007) [2023-12-27 23:34:45,483][106225] Updated weights for policy 1, policy_version 605337 (0.0009) [2023-12-27 23:34:45,522][106226] Updated weights for policy 0, policy_version 603380 (0.0007) [2023-12-27 23:34:45,551][106225] Updated weights for policy 1, policy_version 605347 (0.0008) [2023-12-27 23:34:45,587][106226] Updated weights for policy 0, policy_version 603390 (0.0005) [2023-12-27 23:34:45,617][106225] Updated weights for policy 1, policy_version 605357 (0.0007) [2023-12-27 23:34:45,647][106226] Updated weights for policy 0, policy_version 603400 (0.0007) [2023-12-27 23:34:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 309510144. Throughput: 0: 9897.3, 1: 9688.6. Samples: 309503564. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:46,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.942')] [2023-12-27 23:34:46,282][106225] Updated weights for policy 1, policy_version 605367 (0.0008) [2023-12-27 23:34:46,344][106225] Updated weights for policy 1, policy_version 605377 (0.0008) [2023-12-27 23:34:46,360][106226] Updated weights for policy 0, policy_version 603410 (0.0009) [2023-12-27 23:34:46,399][106225] Updated weights for policy 1, policy_version 605387 (0.0006) [2023-12-27 23:34:46,415][106226] Updated weights for policy 0, policy_version 603420 (0.0008) [2023-12-27 23:34:46,470][106226] Updated weights for policy 0, policy_version 603430 (0.0009) [2023-12-27 23:34:46,519][106226] Updated weights for policy 0, policy_version 603440 (0.0009) [2023-12-27 23:34:47,095][106225] Updated weights for policy 1, policy_version 605397 (0.0006) [2023-12-27 23:34:47,120][106226] Updated weights for policy 0, policy_version 603450 (0.0010) [2023-12-27 23:34:47,149][106225] Updated weights for policy 1, policy_version 605407 (0.0006) [2023-12-27 23:34:47,177][106226] Updated weights for policy 0, policy_version 603460 (0.0010) [2023-12-27 23:34:47,200][106225] Updated weights for policy 1, policy_version 605417 (0.0005) [2023-12-27 23:34:47,227][106226] Updated weights for policy 0, policy_version 603470 (0.0010) [2023-12-27 23:34:47,718][106225] Updated weights for policy 1, policy_version 605427 (0.0005) [2023-12-27 23:34:47,769][106225] Updated weights for policy 1, policy_version 605437 (0.0005) [2023-12-27 23:34:47,832][106225] Updated weights for policy 1, policy_version 605447 (0.0006) [2023-12-27 23:34:47,941][106226] Updated weights for policy 0, policy_version 603480 (0.0010) [2023-12-27 23:34:48,000][106226] Updated weights for policy 0, policy_version 603490 (0.0010) [2023-12-27 23:34:48,047][106226] Updated weights for policy 0, policy_version 603500 (0.0010) [2023-12-27 23:34:48,526][106225] Updated weights for policy 1, policy_version 605457 (0.0008) [2023-12-27 23:34:48,587][106225] Updated weights for policy 1, policy_version 605467 (0.0008) [2023-12-27 23:34:48,644][106225] Updated weights for policy 1, policy_version 605477 (0.0008) [2023-12-27 23:34:48,710][106225] Updated weights for policy 1, policy_version 605487 (0.0008) [2023-12-27 23:34:48,769][106226] Updated weights for policy 0, policy_version 603510 (0.0009) [2023-12-27 23:34:48,831][106226] Updated weights for policy 0, policy_version 603520 (0.0008) [2023-12-27 23:34:48,892][106226] Updated weights for policy 0, policy_version 603530 (0.0008) [2023-12-27 23:34:49,457][106225] Updated weights for policy 1, policy_version 605497 (0.0006) [2023-12-27 23:34:49,504][106225] Updated weights for policy 1, policy_version 605507 (0.0008) [2023-12-27 23:34:49,566][106225] Updated weights for policy 1, policy_version 605517 (0.0008) [2023-12-27 23:34:49,614][106226] Updated weights for policy 0, policy_version 603540 (0.0008) [2023-12-27 23:34:49,676][106226] Updated weights for policy 0, policy_version 603550 (0.0008) [2023-12-27 23:34:49,734][106226] Updated weights for policy 0, policy_version 603560 (0.0008) [2023-12-27 23:34:50,255][106225] Updated weights for policy 1, policy_version 605527 (0.0006) [2023-12-27 23:34:50,310][106225] Updated weights for policy 1, policy_version 605537 (0.0005) [2023-12-27 23:34:50,365][106225] Updated weights for policy 1, policy_version 605547 (0.0005) [2023-12-27 23:34:50,559][106226] Updated weights for policy 0, policy_version 603570 (0.0008) [2023-12-27 23:34:50,622][106226] Updated weights for policy 0, policy_version 603580 (0.0009) [2023-12-27 23:34:50,687][106226] Updated weights for policy 0, policy_version 603590 (0.0009) [2023-12-27 23:34:50,740][106226] Updated weights for policy 0, policy_version 603600 (0.0009) [2023-12-27 23:34:50,978][106225] Updated weights for policy 1, policy_version 605557 (0.0007) [2023-12-27 23:34:51,042][106225] Updated weights for policy 1, policy_version 605567 (0.0009) [2023-12-27 23:34:51,110][106225] Updated weights for policy 1, policy_version 605577 (0.0009) [2023-12-27 23:34:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 309616640. Throughput: 0: 9832.6, 1: 9702.2. Samples: 309622248. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:51,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.521')] [2023-12-27 23:34:51,505][106226] Updated weights for policy 0, policy_version 603610 (0.0007) [2023-12-27 23:34:51,564][106226] Updated weights for policy 0, policy_version 603620 (0.0008) [2023-12-27 23:34:51,633][106226] Updated weights for policy 0, policy_version 603630 (0.0007) [2023-12-27 23:34:51,870][106225] Updated weights for policy 1, policy_version 605587 (0.0008) [2023-12-27 23:34:51,936][106225] Updated weights for policy 1, policy_version 605597 (0.0008) [2023-12-27 23:34:51,996][106225] Updated weights for policy 1, policy_version 605607 (0.0006) [2023-12-27 23:34:52,423][106226] Updated weights for policy 0, policy_version 603640 (0.0007) [2023-12-27 23:34:52,486][106226] Updated weights for policy 0, policy_version 603650 (0.0009) [2023-12-27 23:34:52,548][106226] Updated weights for policy 0, policy_version 603660 (0.0009) [2023-12-27 23:34:52,716][106225] Updated weights for policy 1, policy_version 605617 (0.0008) [2023-12-27 23:34:52,767][106225] Updated weights for policy 1, policy_version 605627 (0.0008) [2023-12-27 23:34:52,821][106225] Updated weights for policy 1, policy_version 605637 (0.0009) [2023-12-27 23:34:52,878][106225] Updated weights for policy 1, policy_version 605647 (0.0008) [2023-12-27 23:34:53,108][106226] Updated weights for policy 0, policy_version 603670 (0.0006) [2023-12-27 23:34:53,169][106226] Updated weights for policy 0, policy_version 603680 (0.0007) [2023-12-27 23:34:53,244][106226] Updated weights for policy 0, policy_version 603690 (0.0005) [2023-12-27 23:34:53,625][106225] Updated weights for policy 1, policy_version 605657 (0.0010) [2023-12-27 23:34:53,679][106225] Updated weights for policy 1, policy_version 605667 (0.0008) [2023-12-27 23:34:53,728][106225] Updated weights for policy 1, policy_version 605677 (0.0008) [2023-12-27 23:34:53,730][106226] Updated weights for policy 0, policy_version 603700 (0.0006) [2023-12-27 23:34:53,789][106226] Updated weights for policy 0, policy_version 603710 (0.0008) [2023-12-27 23:34:53,853][106226] Updated weights for policy 0, policy_version 603720 (0.0005) [2023-12-27 23:34:54,476][106226] Updated weights for policy 0, policy_version 603730 (0.0007) [2023-12-27 23:34:54,544][106226] Updated weights for policy 0, policy_version 603740 (0.0011) [2023-12-27 23:34:54,557][106225] Updated weights for policy 1, policy_version 605687 (0.0006) [2023-12-27 23:34:54,604][106226] Updated weights for policy 0, policy_version 603750 (0.0011) [2023-12-27 23:34:54,611][106225] Updated weights for policy 1, policy_version 605697 (0.0006) [2023-12-27 23:34:54,660][106225] Updated weights for policy 1, policy_version 605707 (0.0007) [2023-12-27 23:34:54,668][106226] Updated weights for policy 0, policy_version 603760 (0.0011) [2023-12-27 23:34:55,366][106226] Updated weights for policy 0, policy_version 603770 (0.0010) [2023-12-27 23:34:55,372][106225] Updated weights for policy 1, policy_version 605717 (0.0007) [2023-12-27 23:34:55,422][106225] Updated weights for policy 1, policy_version 605727 (0.0007) [2023-12-27 23:34:55,431][106226] Updated weights for policy 0, policy_version 603780 (0.0010) [2023-12-27 23:34:55,475][106225] Updated weights for policy 1, policy_version 605737 (0.0006) [2023-12-27 23:34:55,489][106226] Updated weights for policy 0, policy_version 603790 (0.0010) [2023-12-27 23:34:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 309706752. Throughput: 0: 9909.9, 1: 9623.1. Samples: 309683648. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:34:56,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-5.835')] [2023-12-27 23:34:56,179][106226] Updated weights for policy 0, policy_version 603800 (0.0009) [2023-12-27 23:34:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000605744_155099136.pth... [2023-12-27 23:34:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000604624_154812416.pth [2023-12-27 23:34:56,214][106225] Updated weights for policy 1, policy_version 605747 (0.0007) [2023-12-27 23:34:56,232][106226] Updated weights for policy 0, policy_version 603810 (0.0006) [2023-12-27 23:34:56,264][106225] Updated weights for policy 1, policy_version 605757 (0.0008) [2023-12-27 23:34:56,291][106226] Updated weights for policy 0, policy_version 603820 (0.0007) [2023-12-27 23:34:56,311][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000603824_154615808.pth... [2023-12-27 23:34:56,314][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000602672_154320896.pth [2023-12-27 23:34:56,317][106225] Updated weights for policy 1, policy_version 605767 (0.0005) [2023-12-27 23:34:56,875][106225] Updated weights for policy 1, policy_version 605777 (0.0005) [2023-12-27 23:34:56,931][106225] Updated weights for policy 1, policy_version 605787 (0.0006) [2023-12-27 23:34:56,990][106225] Updated weights for policy 1, policy_version 605797 (0.0009) [2023-12-27 23:34:57,041][106225] Updated weights for policy 1, policy_version 605807 (0.0008) [2023-12-27 23:34:57,058][106226] Updated weights for policy 0, policy_version 603830 (0.0008) [2023-12-27 23:34:57,111][106226] Updated weights for policy 0, policy_version 603840 (0.0005) [2023-12-27 23:34:57,165][106226] Updated weights for policy 0, policy_version 603850 (0.0005) [2023-12-27 23:34:57,745][106226] Updated weights for policy 0, policy_version 603860 (0.0005) [2023-12-27 23:34:57,787][106225] Updated weights for policy 1, policy_version 605817 (0.0008) [2023-12-27 23:34:57,799][106226] Updated weights for policy 0, policy_version 603870 (0.0005) [2023-12-27 23:34:57,842][106225] Updated weights for policy 1, policy_version 605827 (0.0008) [2023-12-27 23:34:57,859][106226] Updated weights for policy 0, policy_version 603880 (0.0005) [2023-12-27 23:34:57,897][106225] Updated weights for policy 1, policy_version 605837 (0.0008) [2023-12-27 23:34:58,502][106226] Updated weights for policy 0, policy_version 603890 (0.0006) [2023-12-27 23:34:58,562][106226] Updated weights for policy 0, policy_version 603900 (0.0008) [2023-12-27 23:34:58,625][106226] Updated weights for policy 0, policy_version 603910 (0.0007) [2023-12-27 23:34:58,688][106225] Updated weights for policy 1, policy_version 605847 (0.0009) [2023-12-27 23:34:58,696][106226] Updated weights for policy 0, policy_version 603920 (0.0008) [2023-12-27 23:34:58,755][106225] Updated weights for policy 1, policy_version 605857 (0.0010) [2023-12-27 23:34:58,822][106225] Updated weights for policy 1, policy_version 605867 (0.0009) [2023-12-27 23:34:59,529][106226] Updated weights for policy 0, policy_version 603930 (0.0010) [2023-12-27 23:34:59,580][106226] Updated weights for policy 0, policy_version 603940 (0.0010) [2023-12-27 23:34:59,631][106226] Updated weights for policy 0, policy_version 603950 (0.0011) [2023-12-27 23:34:59,641][106225] Updated weights for policy 1, policy_version 605877 (0.0008) [2023-12-27 23:34:59,699][106225] Updated weights for policy 1, policy_version 605887 (0.0008) [2023-12-27 23:34:59,757][106225] Updated weights for policy 1, policy_version 605897 (0.0007) [2023-12-27 23:35:00,378][106226] Updated weights for policy 0, policy_version 603960 (0.0011) [2023-12-27 23:35:00,425][106226] Updated weights for policy 0, policy_version 603970 (0.0010) [2023-12-27 23:35:00,475][106226] Updated weights for policy 0, policy_version 603980 (0.0010) [2023-12-27 23:35:00,489][106225] Updated weights for policy 1, policy_version 605907 (0.0007) [2023-12-27 23:35:00,534][106225] Updated weights for policy 1, policy_version 605917 (0.0007) [2023-12-27 23:35:00,587][106225] Updated weights for policy 1, policy_version 605927 (0.0007) [2023-12-27 23:35:01,084][106226] Updated weights for policy 0, policy_version 603990 (0.0008) [2023-12-27 23:35:01,158][106226] Updated weights for policy 0, policy_version 604000 (0.0010) [2023-12-27 23:35:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 309805056. Throughput: 0: 9881.5, 1: 9653.9. Samples: 309799088. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:01,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-6.064')] [2023-12-27 23:35:01,219][106226] Updated weights for policy 0, policy_version 604010 (0.0010) [2023-12-27 23:35:01,309][106225] Updated weights for policy 1, policy_version 605937 (0.0008) [2023-12-27 23:35:01,378][106225] Updated weights for policy 1, policy_version 605947 (0.0008) [2023-12-27 23:35:01,430][106225] Updated weights for policy 1, policy_version 605957 (0.0008) [2023-12-27 23:35:01,477][106225] Updated weights for policy 1, policy_version 605967 (0.0008) [2023-12-27 23:35:01,943][106226] Updated weights for policy 0, policy_version 604020 (0.0010) [2023-12-27 23:35:02,006][106226] Updated weights for policy 0, policy_version 604030 (0.0010) [2023-12-27 23:35:02,070][106226] Updated weights for policy 0, policy_version 604040 (0.0009) [2023-12-27 23:35:02,149][106225] Updated weights for policy 1, policy_version 605977 (0.0007) [2023-12-27 23:35:02,205][106225] Updated weights for policy 1, policy_version 605987 (0.0008) [2023-12-27 23:35:02,264][106225] Updated weights for policy 1, policy_version 605997 (0.0008) [2023-12-27 23:35:02,819][106226] Updated weights for policy 0, policy_version 604050 (0.0011) [2023-12-27 23:35:02,882][106226] Updated weights for policy 0, policy_version 604060 (0.0010) [2023-12-27 23:35:02,941][106226] Updated weights for policy 0, policy_version 604070 (0.0008) [2023-12-27 23:35:02,995][106225] Updated weights for policy 1, policy_version 606007 (0.0007) [2023-12-27 23:35:02,997][106226] Updated weights for policy 0, policy_version 604080 (0.0010) [2023-12-27 23:35:03,046][106225] Updated weights for policy 1, policy_version 606017 (0.0008) [2023-12-27 23:35:03,096][106225] Updated weights for policy 1, policy_version 606027 (0.0007) [2023-12-27 23:35:03,581][106226] Updated weights for policy 0, policy_version 604090 (0.0006) [2023-12-27 23:35:03,647][106226] Updated weights for policy 0, policy_version 604100 (0.0006) [2023-12-27 23:35:03,706][106226] Updated weights for policy 0, policy_version 604110 (0.0009) [2023-12-27 23:35:03,922][106225] Updated weights for policy 1, policy_version 606037 (0.0008) [2023-12-27 23:35:03,989][106225] Updated weights for policy 1, policy_version 606047 (0.0009) [2023-12-27 23:35:04,053][106225] Updated weights for policy 1, policy_version 606057 (0.0009) [2023-12-27 23:35:04,378][106226] Updated weights for policy 0, policy_version 604120 (0.0007) [2023-12-27 23:35:04,446][106226] Updated weights for policy 0, policy_version 604130 (0.0006) [2023-12-27 23:35:04,517][106226] Updated weights for policy 0, policy_version 604140 (0.0006) [2023-12-27 23:35:04,765][106225] Updated weights for policy 1, policy_version 606067 (0.0008) [2023-12-27 23:35:04,819][106225] Updated weights for policy 1, policy_version 606077 (0.0009) [2023-12-27 23:35:04,878][106225] Updated weights for policy 1, policy_version 606087 (0.0009) [2023-12-27 23:35:05,135][106226] Updated weights for policy 0, policy_version 604150 (0.0008) [2023-12-27 23:35:05,192][106226] Updated weights for policy 0, policy_version 604160 (0.0007) [2023-12-27 23:35:05,245][106226] Updated weights for policy 0, policy_version 604170 (0.0005) [2023-12-27 23:35:05,597][106225] Updated weights for policy 1, policy_version 606097 (0.0007) [2023-12-27 23:35:05,657][106225] Updated weights for policy 1, policy_version 606107 (0.0008) [2023-12-27 23:35:05,716][106225] Updated weights for policy 1, policy_version 606117 (0.0008) [2023-12-27 23:35:05,773][106225] Updated weights for policy 1, policy_version 606127 (0.0008) [2023-12-27 23:35:05,838][106226] Updated weights for policy 0, policy_version 604180 (0.0007) [2023-12-27 23:35:05,892][106226] Updated weights for policy 0, policy_version 604190 (0.0010) [2023-12-27 23:35:05,948][106226] Updated weights for policy 0, policy_version 604200 (0.0011) [2023-12-27 23:35:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 309911552. Throughput: 0: 9916.7, 1: 9665.0. Samples: 309918700. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:06,175][105115] Avg episode reward: [(0, '-5.006'), (1, '-5.702')] [2023-12-27 23:35:06,560][106225] Updated weights for policy 1, policy_version 606137 (0.0008) [2023-12-27 23:35:06,619][106225] Updated weights for policy 1, policy_version 606147 (0.0008) [2023-12-27 23:35:06,681][106225] Updated weights for policy 1, policy_version 606157 (0.0007) [2023-12-27 23:35:06,731][106226] Updated weights for policy 0, policy_version 604210 (0.0009) [2023-12-27 23:35:06,794][106226] Updated weights for policy 0, policy_version 604220 (0.0008) [2023-12-27 23:35:06,853][106226] Updated weights for policy 0, policy_version 604230 (0.0007) [2023-12-27 23:35:06,915][106226] Updated weights for policy 0, policy_version 604240 (0.0008) [2023-12-27 23:35:07,304][106225] Updated weights for policy 1, policy_version 606167 (0.0006) [2023-12-27 23:35:07,351][106225] Updated weights for policy 1, policy_version 606177 (0.0005) [2023-12-27 23:35:07,405][106225] Updated weights for policy 1, policy_version 606187 (0.0005) [2023-12-27 23:35:07,602][106226] Updated weights for policy 0, policy_version 604250 (0.0009) [2023-12-27 23:35:07,661][106226] Updated weights for policy 0, policy_version 604260 (0.0009) [2023-12-27 23:35:07,726][106226] Updated weights for policy 0, policy_version 604270 (0.0006) [2023-12-27 23:35:08,050][106225] Updated weights for policy 1, policy_version 606197 (0.0006) [2023-12-27 23:35:08,106][106225] Updated weights for policy 1, policy_version 606207 (0.0005) [2023-12-27 23:35:08,159][106225] Updated weights for policy 1, policy_version 606217 (0.0005) [2023-12-27 23:35:08,358][106226] Updated weights for policy 0, policy_version 604280 (0.0009) [2023-12-27 23:35:08,421][106226] Updated weights for policy 0, policy_version 604290 (0.0008) [2023-12-27 23:35:08,481][106226] Updated weights for policy 0, policy_version 604300 (0.0009) [2023-12-27 23:35:08,794][106225] Updated weights for policy 1, policy_version 606227 (0.0006) [2023-12-27 23:35:08,860][106225] Updated weights for policy 1, policy_version 606237 (0.0009) [2023-12-27 23:35:08,924][106225] Updated weights for policy 1, policy_version 606247 (0.0009) [2023-12-27 23:35:09,203][106226] Updated weights for policy 0, policy_version 604310 (0.0009) [2023-12-27 23:35:09,273][106226] Updated weights for policy 0, policy_version 604320 (0.0009) [2023-12-27 23:35:09,338][106226] Updated weights for policy 0, policy_version 604330 (0.0008) [2023-12-27 23:35:09,646][106225] Updated weights for policy 1, policy_version 606257 (0.0007) [2023-12-27 23:35:09,708][106225] Updated weights for policy 1, policy_version 606267 (0.0009) [2023-12-27 23:35:09,774][106225] Updated weights for policy 1, policy_version 606277 (0.0008) [2023-12-27 23:35:09,841][106225] Updated weights for policy 1, policy_version 606287 (0.0009) [2023-12-27 23:35:10,086][106226] Updated weights for policy 0, policy_version 604340 (0.0007) [2023-12-27 23:35:10,149][106226] Updated weights for policy 0, policy_version 604350 (0.0006) [2023-12-27 23:35:10,217][106226] Updated weights for policy 0, policy_version 604360 (0.0006) [2023-12-27 23:35:10,666][106225] Updated weights for policy 1, policy_version 606297 (0.0009) [2023-12-27 23:35:10,721][106225] Updated weights for policy 1, policy_version 606307 (0.0008) [2023-12-27 23:35:10,781][106225] Updated weights for policy 1, policy_version 606317 (0.0008) [2023-12-27 23:35:10,810][106226] Updated weights for policy 0, policy_version 604370 (0.0007) [2023-12-27 23:35:10,870][106226] Updated weights for policy 0, policy_version 604380 (0.0009) [2023-12-27 23:35:10,922][106226] Updated weights for policy 0, policy_version 604390 (0.0008) [2023-12-27 23:35:10,980][106226] Updated weights for policy 0, policy_version 604400 (0.0009) [2023-12-27 23:35:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 310009856. Throughput: 0: 9909.2, 1: 9782.9. Samples: 309979964. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:11,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.884')] [2023-12-27 23:35:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000606320_155246592.pth... [2023-12-27 23:35:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000604400_154763264.pth... [2023-12-27 23:35:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000605168_154951680.pth [2023-12-27 23:35:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000603248_154468352.pth [2023-12-27 23:35:11,478][106225] Updated weights for policy 1, policy_version 606327 (0.0008) [2023-12-27 23:35:11,534][106225] Updated weights for policy 1, policy_version 606337 (0.0008) [2023-12-27 23:35:11,594][106225] Updated weights for policy 1, policy_version 606347 (0.0008) [2023-12-27 23:35:11,785][106226] Updated weights for policy 0, policy_version 604410 (0.0007) [2023-12-27 23:35:11,838][106226] Updated weights for policy 0, policy_version 604420 (0.0006) [2023-12-27 23:35:11,906][106226] Updated weights for policy 0, policy_version 604430 (0.0006) [2023-12-27 23:35:12,423][106225] Updated weights for policy 1, policy_version 606357 (0.0008) [2023-12-27 23:35:12,491][106225] Updated weights for policy 1, policy_version 606367 (0.0008) [2023-12-27 23:35:12,558][106225] Updated weights for policy 1, policy_version 606377 (0.0008) [2023-12-27 23:35:12,561][106226] Updated weights for policy 0, policy_version 604440 (0.0006) [2023-12-27 23:35:12,631][106226] Updated weights for policy 0, policy_version 604450 (0.0006) [2023-12-27 23:35:12,697][106226] Updated weights for policy 0, policy_version 604460 (0.0007) [2023-12-27 23:35:13,243][106225] Updated weights for policy 1, policy_version 606387 (0.0006) [2023-12-27 23:35:13,250][106226] Updated weights for policy 0, policy_version 604470 (0.0008) [2023-12-27 23:35:13,293][106225] Updated weights for policy 1, policy_version 606397 (0.0005) [2023-12-27 23:35:13,306][106226] Updated weights for policy 0, policy_version 604480 (0.0008) [2023-12-27 23:35:13,347][106225] Updated weights for policy 1, policy_version 606407 (0.0005) [2023-12-27 23:35:13,369][106226] Updated weights for policy 0, policy_version 604490 (0.0006) [2023-12-27 23:35:13,889][106225] Updated weights for policy 1, policy_version 606417 (0.0005) [2023-12-27 23:35:13,946][106225] Updated weights for policy 1, policy_version 606427 (0.0007) [2023-12-27 23:35:13,995][106225] Updated weights for policy 1, policy_version 606437 (0.0005) [2023-12-27 23:35:14,042][106226] Updated weights for policy 0, policy_version 604500 (0.0008) [2023-12-27 23:35:14,056][106225] Updated weights for policy 1, policy_version 606447 (0.0005) [2023-12-27 23:35:14,098][106226] Updated weights for policy 0, policy_version 604510 (0.0008) [2023-12-27 23:35:14,149][106226] Updated weights for policy 0, policy_version 604520 (0.0008) [2023-12-27 23:35:14,664][106225] Updated weights for policy 1, policy_version 606457 (0.0006) [2023-12-27 23:35:14,726][106225] Updated weights for policy 1, policy_version 606467 (0.0009) [2023-12-27 23:35:14,787][106225] Updated weights for policy 1, policy_version 606477 (0.0009) [2023-12-27 23:35:14,963][106226] Updated weights for policy 0, policy_version 604530 (0.0009) [2023-12-27 23:35:15,027][106226] Updated weights for policy 0, policy_version 604540 (0.0009) [2023-12-27 23:35:15,087][106226] Updated weights for policy 0, policy_version 604550 (0.0008) [2023-12-27 23:35:15,151][106226] Updated weights for policy 0, policy_version 604560 (0.0009) [2023-12-27 23:35:15,473][106225] Updated weights for policy 1, policy_version 606487 (0.0009) [2023-12-27 23:35:15,524][106225] Updated weights for policy 1, policy_version 606497 (0.0006) [2023-12-27 23:35:15,578][106225] Updated weights for policy 1, policy_version 606507 (0.0005) [2023-12-27 23:35:15,932][106226] Updated weights for policy 0, policy_version 604570 (0.0009) [2023-12-27 23:35:15,983][106226] Updated weights for policy 0, policy_version 604580 (0.0009) [2023-12-27 23:35:16,040][106226] Updated weights for policy 0, policy_version 604590 (0.0006) [2023-12-27 23:35:16,151][106225] Updated weights for policy 1, policy_version 606517 (0.0007) [2023-12-27 23:35:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 310108160. Throughput: 0: 9923.6, 1: 9820.1. Samples: 310098384. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:16,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-5.649')] [2023-12-27 23:35:16,211][106225] Updated weights for policy 1, policy_version 606527 (0.0008) [2023-12-27 23:35:16,270][106225] Updated weights for policy 1, policy_version 606537 (0.0009) [2023-12-27 23:35:16,820][106226] Updated weights for policy 0, policy_version 604600 (0.0009) [2023-12-27 23:35:16,844][106225] Updated weights for policy 1, policy_version 606547 (0.0007) [2023-12-27 23:35:16,869][106226] Updated weights for policy 0, policy_version 604610 (0.0008) [2023-12-27 23:35:16,893][106225] Updated weights for policy 1, policy_version 606557 (0.0005) [2023-12-27 23:35:16,922][106226] Updated weights for policy 0, policy_version 604620 (0.0009) [2023-12-27 23:35:16,953][106225] Updated weights for policy 1, policy_version 606567 (0.0005) [2023-12-27 23:35:17,548][106225] Updated weights for policy 1, policy_version 606577 (0.0006) [2023-12-27 23:35:17,603][106225] Updated weights for policy 1, policy_version 606587 (0.0009) [2023-12-27 23:35:17,651][106225] Updated weights for policy 1, policy_version 606597 (0.0008) [2023-12-27 23:35:17,694][106226] Updated weights for policy 0, policy_version 604630 (0.0007) [2023-12-27 23:35:17,696][106225] Updated weights for policy 1, policy_version 606607 (0.0007) [2023-12-27 23:35:17,742][106226] Updated weights for policy 0, policy_version 604640 (0.0008) [2023-12-27 23:35:17,787][106226] Updated weights for policy 0, policy_version 604650 (0.0008) [2023-12-27 23:35:18,460][106225] Updated weights for policy 1, policy_version 606617 (0.0008) [2023-12-27 23:35:18,519][106225] Updated weights for policy 1, policy_version 606627 (0.0008) [2023-12-27 23:35:18,551][106226] Updated weights for policy 0, policy_version 604660 (0.0007) [2023-12-27 23:35:18,569][106225] Updated weights for policy 1, policy_version 606637 (0.0007) [2023-12-27 23:35:18,603][106226] Updated weights for policy 0, policy_version 604670 (0.0006) [2023-12-27 23:35:18,652][106226] Updated weights for policy 0, policy_version 604680 (0.0009) [2023-12-27 23:35:19,315][106225] Updated weights for policy 1, policy_version 606647 (0.0009) [2023-12-27 23:35:19,387][106225] Updated weights for policy 1, policy_version 606657 (0.0010) [2023-12-27 23:35:19,404][106226] Updated weights for policy 0, policy_version 604690 (0.0009) [2023-12-27 23:35:19,446][106225] Updated weights for policy 1, policy_version 606667 (0.0008) [2023-12-27 23:35:19,462][106226] Updated weights for policy 0, policy_version 604700 (0.0008) [2023-12-27 23:35:19,535][106226] Updated weights for policy 0, policy_version 604710 (0.0008) [2023-12-27 23:35:19,600][106226] Updated weights for policy 0, policy_version 604720 (0.0008) [2023-12-27 23:35:20,137][106225] Updated weights for policy 1, policy_version 606677 (0.0007) [2023-12-27 23:35:20,194][106225] Updated weights for policy 1, policy_version 606687 (0.0008) [2023-12-27 23:35:20,248][106225] Updated weights for policy 1, policy_version 606697 (0.0006) [2023-12-27 23:35:20,371][106226] Updated weights for policy 0, policy_version 604730 (0.0009) [2023-12-27 23:35:20,430][106226] Updated weights for policy 0, policy_version 604740 (0.0009) [2023-12-27 23:35:20,496][106226] Updated weights for policy 0, policy_version 604750 (0.0008) [2023-12-27 23:35:20,935][106225] Updated weights for policy 1, policy_version 606707 (0.0008) [2023-12-27 23:35:20,997][106225] Updated weights for policy 1, policy_version 606717 (0.0010) [2023-12-27 23:35:21,063][106225] Updated weights for policy 1, policy_version 606727 (0.0009) [2023-12-27 23:35:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 310206464. Throughput: 0: 9780.3, 1: 9900.2. Samples: 310215388. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:21,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.661')] [2023-12-27 23:35:21,218][106226] Updated weights for policy 0, policy_version 604760 (0.0007) [2023-12-27 23:35:21,281][106226] Updated weights for policy 0, policy_version 604770 (0.0009) [2023-12-27 23:35:21,343][106226] Updated weights for policy 0, policy_version 604780 (0.0010) [2023-12-27 23:35:21,810][106225] Updated weights for policy 1, policy_version 606737 (0.0008) [2023-12-27 23:35:21,872][106225] Updated weights for policy 1, policy_version 606747 (0.0010) [2023-12-27 23:35:21,930][106225] Updated weights for policy 1, policy_version 606757 (0.0007) [2023-12-27 23:35:22,001][106225] Updated weights for policy 1, policy_version 606767 (0.0007) [2023-12-27 23:35:22,094][106226] Updated weights for policy 0, policy_version 604790 (0.0007) [2023-12-27 23:35:22,154][106226] Updated weights for policy 0, policy_version 604800 (0.0006) [2023-12-27 23:35:22,202][106226] Updated weights for policy 0, policy_version 604810 (0.0005) [2023-12-27 23:35:22,641][106225] Updated weights for policy 1, policy_version 606777 (0.0009) [2023-12-27 23:35:22,712][106225] Updated weights for policy 1, policy_version 606787 (0.0008) [2023-12-27 23:35:22,782][106225] Updated weights for policy 1, policy_version 606797 (0.0007) [2023-12-27 23:35:22,913][106226] Updated weights for policy 0, policy_version 604820 (0.0008) [2023-12-27 23:35:22,974][106226] Updated weights for policy 0, policy_version 604830 (0.0008) [2023-12-27 23:35:23,037][106226] Updated weights for policy 0, policy_version 604840 (0.0008) [2023-12-27 23:35:23,388][106225] Updated weights for policy 1, policy_version 606807 (0.0006) [2023-12-27 23:35:23,446][106225] Updated weights for policy 1, policy_version 606817 (0.0006) [2023-12-27 23:35:23,504][106225] Updated weights for policy 1, policy_version 606827 (0.0010) [2023-12-27 23:35:23,761][106226] Updated weights for policy 0, policy_version 604850 (0.0009) [2023-12-27 23:35:23,825][106226] Updated weights for policy 0, policy_version 604860 (0.0009) [2023-12-27 23:35:23,880][106226] Updated weights for policy 0, policy_version 604870 (0.0007) [2023-12-27 23:35:23,928][106226] Updated weights for policy 0, policy_version 604880 (0.0005) [2023-12-27 23:35:24,063][106225] Updated weights for policy 1, policy_version 606837 (0.0010) [2023-12-27 23:35:24,116][106225] Updated weights for policy 1, policy_version 606847 (0.0010) [2023-12-27 23:35:24,169][106225] Updated weights for policy 1, policy_version 606857 (0.0010) [2023-12-27 23:35:24,574][106226] Updated weights for policy 0, policy_version 604890 (0.0006) [2023-12-27 23:35:24,636][106226] Updated weights for policy 0, policy_version 604900 (0.0008) [2023-12-27 23:35:24,685][106226] Updated weights for policy 0, policy_version 604910 (0.0008) [2023-12-27 23:35:24,863][106225] Updated weights for policy 1, policy_version 606867 (0.0010) [2023-12-27 23:35:24,932][106225] Updated weights for policy 1, policy_version 606877 (0.0008) [2023-12-27 23:35:24,999][106225] Updated weights for policy 1, policy_version 606887 (0.0011) [2023-12-27 23:35:25,422][106226] Updated weights for policy 0, policy_version 604920 (0.0008) [2023-12-27 23:35:25,475][106226] Updated weights for policy 0, policy_version 604930 (0.0008) [2023-12-27 23:35:25,541][106226] Updated weights for policy 0, policy_version 604940 (0.0008) [2023-12-27 23:35:25,654][106225] Updated weights for policy 1, policy_version 606897 (0.0010) [2023-12-27 23:35:25,702][106225] Updated weights for policy 1, policy_version 606907 (0.0010) [2023-12-27 23:35:25,759][106225] Updated weights for policy 1, policy_version 606917 (0.0010) [2023-12-27 23:35:25,818][106225] Updated weights for policy 1, policy_version 606927 (0.0010) [2023-12-27 23:35:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 310304768. Throughput: 0: 9775.8, 1: 9960.2. Samples: 310275696. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:26,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.612')] [2023-12-27 23:35:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000604944_154902528.pth... [2023-12-27 23:35:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000606928_155402240.pth... [2023-12-27 23:35:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000603824_154615808.pth [2023-12-27 23:35:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000605744_155099136.pth [2023-12-27 23:35:26,296][106226] Updated weights for policy 0, policy_version 604950 (0.0007) [2023-12-27 23:35:26,361][106226] Updated weights for policy 0, policy_version 604960 (0.0008) [2023-12-27 23:35:26,422][106226] Updated weights for policy 0, policy_version 604970 (0.0009) [2023-12-27 23:35:26,493][106225] Updated weights for policy 1, policy_version 606937 (0.0006) [2023-12-27 23:35:26,554][106225] Updated weights for policy 1, policy_version 606947 (0.0005) [2023-12-27 23:35:26,616][106225] Updated weights for policy 1, policy_version 606957 (0.0005) [2023-12-27 23:35:27,014][106226] Updated weights for policy 0, policy_version 604980 (0.0007) [2023-12-27 23:35:27,076][106226] Updated weights for policy 0, policy_version 604990 (0.0008) [2023-12-27 23:35:27,139][106226] Updated weights for policy 0, policy_version 605000 (0.0010) [2023-12-27 23:35:27,269][106225] Updated weights for policy 1, policy_version 606967 (0.0010) [2023-12-27 23:35:27,324][106225] Updated weights for policy 1, policy_version 606977 (0.0010) [2023-12-27 23:35:27,381][106225] Updated weights for policy 1, policy_version 606987 (0.0010) [2023-12-27 23:35:27,806][106226] Updated weights for policy 0, policy_version 605010 (0.0010) [2023-12-27 23:35:27,859][106226] Updated weights for policy 0, policy_version 605020 (0.0009) [2023-12-27 23:35:27,913][106226] Updated weights for policy 0, policy_version 605030 (0.0007) [2023-12-27 23:35:27,974][106226] Updated weights for policy 0, policy_version 605040 (0.0005) [2023-12-27 23:35:28,107][106225] Updated weights for policy 1, policy_version 606997 (0.0010) [2023-12-27 23:35:28,166][106225] Updated weights for policy 1, policy_version 607007 (0.0010) [2023-12-27 23:35:28,222][106225] Updated weights for policy 1, policy_version 607017 (0.0010) [2023-12-27 23:35:28,649][106226] Updated weights for policy 0, policy_version 605050 (0.0008) [2023-12-27 23:35:28,706][106226] Updated weights for policy 0, policy_version 605060 (0.0008) [2023-12-27 23:35:28,768][106226] Updated weights for policy 0, policy_version 605070 (0.0008) [2023-12-27 23:35:28,927][106225] Updated weights for policy 1, policy_version 607027 (0.0010) [2023-12-27 23:35:28,997][106225] Updated weights for policy 1, policy_version 607037 (0.0010) [2023-12-27 23:35:29,065][106225] Updated weights for policy 1, policy_version 607047 (0.0011) [2023-12-27 23:35:29,467][106226] Updated weights for policy 0, policy_version 605080 (0.0008) [2023-12-27 23:35:29,524][106226] Updated weights for policy 0, policy_version 605090 (0.0005) [2023-12-27 23:35:29,581][106226] Updated weights for policy 0, policy_version 605100 (0.0005) [2023-12-27 23:35:29,789][106225] Updated weights for policy 1, policy_version 607057 (0.0010) [2023-12-27 23:35:29,861][106225] Updated weights for policy 1, policy_version 607067 (0.0010) [2023-12-27 23:35:29,929][106225] Updated weights for policy 1, policy_version 607077 (0.0009) [2023-12-27 23:35:29,995][106225] Updated weights for policy 1, policy_version 607087 (0.0010) [2023-12-27 23:35:30,215][106226] Updated weights for policy 0, policy_version 605110 (0.0007) [2023-12-27 23:35:30,273][106226] Updated weights for policy 0, policy_version 605120 (0.0008) [2023-12-27 23:35:30,338][106226] Updated weights for policy 0, policy_version 605130 (0.0008) [2023-12-27 23:35:30,662][106225] Updated weights for policy 1, policy_version 607097 (0.0006) [2023-12-27 23:35:30,715][106225] Updated weights for policy 1, policy_version 607107 (0.0005) [2023-12-27 23:35:30,767][106225] Updated weights for policy 1, policy_version 607117 (0.0005) [2023-12-27 23:35:31,148][106226] Updated weights for policy 0, policy_version 605140 (0.0007) [2023-12-27 23:35:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 310403072. Throughput: 0: 9895.2, 1: 9953.6. Samples: 310396760. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:31,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.504')] [2023-12-27 23:35:31,216][106226] Updated weights for policy 0, policy_version 605150 (0.0007) [2023-12-27 23:35:31,281][106226] Updated weights for policy 0, policy_version 605160 (0.0009) [2023-12-27 23:35:31,397][106225] Updated weights for policy 1, policy_version 607127 (0.0007) [2023-12-27 23:35:31,452][106225] Updated weights for policy 1, policy_version 607137 (0.0006) [2023-12-27 23:35:31,512][106225] Updated weights for policy 1, policy_version 607147 (0.0006) [2023-12-27 23:35:31,940][106226] Updated weights for policy 0, policy_version 605170 (0.0008) [2023-12-27 23:35:31,999][106226] Updated weights for policy 0, policy_version 605180 (0.0009) [2023-12-27 23:35:32,059][106226] Updated weights for policy 0, policy_version 605190 (0.0008) [2023-12-27 23:35:32,118][106226] Updated weights for policy 0, policy_version 605200 (0.0008) [2023-12-27 23:35:32,266][106225] Updated weights for policy 1, policy_version 607157 (0.0007) [2023-12-27 23:35:32,322][106225] Updated weights for policy 1, policy_version 607167 (0.0009) [2023-12-27 23:35:32,385][106225] Updated weights for policy 1, policy_version 607177 (0.0009) [2023-12-27 23:35:32,837][106226] Updated weights for policy 0, policy_version 605210 (0.0008) [2023-12-27 23:35:32,892][106226] Updated weights for policy 0, policy_version 605220 (0.0007) [2023-12-27 23:35:32,945][106226] Updated weights for policy 0, policy_version 605230 (0.0008) [2023-12-27 23:35:33,116][106225] Updated weights for policy 1, policy_version 607187 (0.0008) [2023-12-27 23:35:33,172][106225] Updated weights for policy 1, policy_version 607197 (0.0010) [2023-12-27 23:35:33,228][106225] Updated weights for policy 1, policy_version 607207 (0.0010) [2023-12-27 23:35:33,635][106226] Updated weights for policy 0, policy_version 605240 (0.0007) [2023-12-27 23:35:33,692][106226] Updated weights for policy 0, policy_version 605250 (0.0010) [2023-12-27 23:35:33,747][106226] Updated weights for policy 0, policy_version 605260 (0.0010) [2023-12-27 23:35:33,928][106225] Updated weights for policy 1, policy_version 607217 (0.0009) [2023-12-27 23:35:33,979][106225] Updated weights for policy 1, policy_version 607227 (0.0007) [2023-12-27 23:35:34,036][106225] Updated weights for policy 1, policy_version 607237 (0.0008) [2023-12-27 23:35:34,086][106225] Updated weights for policy 1, policy_version 607247 (0.0007) [2023-12-27 23:35:34,443][106226] Updated weights for policy 0, policy_version 605270 (0.0009) [2023-12-27 23:35:34,512][106226] Updated weights for policy 0, policy_version 605280 (0.0009) [2023-12-27 23:35:34,576][106226] Updated weights for policy 0, policy_version 605290 (0.0008) [2023-12-27 23:35:34,824][106225] Updated weights for policy 1, policy_version 607257 (0.0009) [2023-12-27 23:35:34,881][106225] Updated weights for policy 1, policy_version 607267 (0.0008) [2023-12-27 23:35:34,929][106225] Updated weights for policy 1, policy_version 607277 (0.0008) [2023-12-27 23:35:35,305][106226] Updated weights for policy 0, policy_version 605300 (0.0009) [2023-12-27 23:35:35,370][106226] Updated weights for policy 0, policy_version 605310 (0.0009) [2023-12-27 23:35:35,436][106226] Updated weights for policy 0, policy_version 605320 (0.0009) [2023-12-27 23:35:35,551][106225] Updated weights for policy 1, policy_version 607287 (0.0007) [2023-12-27 23:35:35,608][106225] Updated weights for policy 1, policy_version 607297 (0.0005) [2023-12-27 23:35:35,659][106225] Updated weights for policy 1, policy_version 607307 (0.0007) [2023-12-27 23:35:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 310501376. Throughput: 0: 9870.3, 1: 9947.9. Samples: 310514068. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:36,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-5.799')] [2023-12-27 23:35:36,244][106226] Updated weights for policy 0, policy_version 605330 (0.0008) [2023-12-27 23:35:36,250][106225] Updated weights for policy 1, policy_version 607317 (0.0007) [2023-12-27 23:35:36,310][106226] Updated weights for policy 0, policy_version 605340 (0.0008) [2023-12-27 23:35:36,310][106225] Updated weights for policy 1, policy_version 607327 (0.0008) [2023-12-27 23:35:36,370][106225] Updated weights for policy 1, policy_version 607337 (0.0008) [2023-12-27 23:35:36,372][106226] Updated weights for policy 0, policy_version 605350 (0.0006) [2023-12-27 23:35:36,432][106226] Updated weights for policy 0, policy_version 605360 (0.0007) [2023-12-27 23:35:37,088][106225] Updated weights for policy 1, policy_version 607347 (0.0008) [2023-12-27 23:35:37,145][106225] Updated weights for policy 1, policy_version 607357 (0.0008) [2023-12-27 23:35:37,179][106226] Updated weights for policy 0, policy_version 605370 (0.0005) [2023-12-27 23:35:37,204][106225] Updated weights for policy 1, policy_version 607367 (0.0007) [2023-12-27 23:35:37,234][106226] Updated weights for policy 0, policy_version 605380 (0.0006) [2023-12-27 23:35:37,287][106226] Updated weights for policy 0, policy_version 605390 (0.0007) [2023-12-27 23:35:37,863][106225] Updated weights for policy 1, policy_version 607377 (0.0008) [2023-12-27 23:35:37,932][106225] Updated weights for policy 1, policy_version 607387 (0.0007) [2023-12-27 23:35:37,961][106226] Updated weights for policy 0, policy_version 605400 (0.0009) [2023-12-27 23:35:37,988][106225] Updated weights for policy 1, policy_version 607397 (0.0006) [2023-12-27 23:35:38,023][106226] Updated weights for policy 0, policy_version 605410 (0.0008) [2023-12-27 23:35:38,042][106225] Updated weights for policy 1, policy_version 607407 (0.0006) [2023-12-27 23:35:38,081][106226] Updated weights for policy 0, policy_version 605420 (0.0007) [2023-12-27 23:35:38,662][106225] Updated weights for policy 1, policy_version 607417 (0.0008) [2023-12-27 23:35:38,724][106225] Updated weights for policy 1, policy_version 607427 (0.0007) [2023-12-27 23:35:38,790][106225] Updated weights for policy 1, policy_version 607437 (0.0009) [2023-12-27 23:35:38,866][106226] Updated weights for policy 0, policy_version 605430 (0.0008) [2023-12-27 23:35:38,929][106226] Updated weights for policy 0, policy_version 605440 (0.0008) [2023-12-27 23:35:38,979][106226] Updated weights for policy 0, policy_version 605450 (0.0009) [2023-12-27 23:35:39,515][106225] Updated weights for policy 1, policy_version 607447 (0.0007) [2023-12-27 23:35:39,585][106225] Updated weights for policy 1, policy_version 607457 (0.0008) [2023-12-27 23:35:39,651][106225] Updated weights for policy 1, policy_version 607467 (0.0008) [2023-12-27 23:35:39,810][106226] Updated weights for policy 0, policy_version 605460 (0.0009) [2023-12-27 23:35:39,877][106226] Updated weights for policy 0, policy_version 605470 (0.0009) [2023-12-27 23:35:39,947][106226] Updated weights for policy 0, policy_version 605480 (0.0009) [2023-12-27 23:35:40,440][106225] Updated weights for policy 1, policy_version 607477 (0.0009) [2023-12-27 23:35:40,510][106225] Updated weights for policy 1, policy_version 607487 (0.0009) [2023-12-27 23:35:40,574][106225] Updated weights for policy 1, policy_version 607497 (0.0008) [2023-12-27 23:35:40,694][106226] Updated weights for policy 0, policy_version 605490 (0.0009) [2023-12-27 23:35:40,750][106226] Updated weights for policy 0, policy_version 605500 (0.0006) [2023-12-27 23:35:40,804][106226] Updated weights for policy 0, policy_version 605510 (0.0008) [2023-12-27 23:35:40,853][106226] Updated weights for policy 0, policy_version 605520 (0.0009) [2023-12-27 23:35:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 310599680. Throughput: 0: 9766.1, 1: 10007.2. Samples: 310573444. Policy #0 lag: (min: 0.0, avg: 27.6, max: 32.0) [2023-12-27 23:35:41,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-5.359')] [2023-12-27 23:35:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000607504_155549696.pth... [2023-12-27 23:35:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000605520_155049984.pth... [2023-12-27 23:35:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000606320_155246592.pth [2023-12-27 23:35:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000604400_154763264.pth [2023-12-27 23:35:41,274][106225] Updated weights for policy 1, policy_version 607507 (0.0008) [2023-12-27 23:35:41,345][106225] Updated weights for policy 1, policy_version 607517 (0.0007) [2023-12-27 23:35:41,416][106225] Updated weights for policy 1, policy_version 607527 (0.0007) [2023-12-27 23:35:41,667][106226] Updated weights for policy 0, policy_version 605530 (0.0008) [2023-12-27 23:35:41,739][106226] Updated weights for policy 0, policy_version 605540 (0.0009) [2023-12-27 23:35:41,803][106226] Updated weights for policy 0, policy_version 605550 (0.0008) [2023-12-27 23:35:42,097][106225] Updated weights for policy 1, policy_version 607537 (0.0010) [2023-12-27 23:35:42,155][106225] Updated weights for policy 1, policy_version 607547 (0.0009) [2023-12-27 23:35:42,217][106225] Updated weights for policy 1, policy_version 607557 (0.0008) [2023-12-27 23:35:42,283][106225] Updated weights for policy 1, policy_version 607567 (0.0008) [2023-12-27 23:35:42,528][106226] Updated weights for policy 0, policy_version 605560 (0.0008) [2023-12-27 23:35:42,581][106226] Updated weights for policy 0, policy_version 605570 (0.0009) [2023-12-27 23:35:42,638][106226] Updated weights for policy 0, policy_version 605580 (0.0009) [2023-12-27 23:35:43,029][106225] Updated weights for policy 1, policy_version 607577 (0.0008) [2023-12-27 23:35:43,086][106225] Updated weights for policy 1, policy_version 607587 (0.0009) [2023-12-27 23:35:43,141][106225] Updated weights for policy 1, policy_version 607597 (0.0008) [2023-12-27 23:35:43,400][106226] Updated weights for policy 0, policy_version 605590 (0.0008) [2023-12-27 23:35:43,452][106226] Updated weights for policy 0, policy_version 605600 (0.0008) [2023-12-27 23:35:43,510][106226] Updated weights for policy 0, policy_version 605610 (0.0009) [2023-12-27 23:35:43,857][106225] Updated weights for policy 1, policy_version 607607 (0.0009) [2023-12-27 23:35:43,912][106225] Updated weights for policy 1, policy_version 607617 (0.0008) [2023-12-27 23:35:43,960][106225] Updated weights for policy 1, policy_version 607627 (0.0008) [2023-12-27 23:35:44,239][106226] Updated weights for policy 0, policy_version 605620 (0.0008) [2023-12-27 23:35:44,297][106226] Updated weights for policy 0, policy_version 605630 (0.0009) [2023-12-27 23:35:44,356][106226] Updated weights for policy 0, policy_version 605640 (0.0008) [2023-12-27 23:35:44,700][106225] Updated weights for policy 1, policy_version 607637 (0.0009) [2023-12-27 23:35:44,760][106225] Updated weights for policy 1, policy_version 607647 (0.0009) [2023-12-27 23:35:44,826][106225] Updated weights for policy 1, policy_version 607657 (0.0009) [2023-12-27 23:35:45,081][106226] Updated weights for policy 0, policy_version 605650 (0.0008) [2023-12-27 23:35:45,143][106226] Updated weights for policy 0, policy_version 605660 (0.0009) [2023-12-27 23:35:45,191][106226] Updated weights for policy 0, policy_version 605670 (0.0008) [2023-12-27 23:35:45,248][106226] Updated weights for policy 0, policy_version 605680 (0.0009) [2023-12-27 23:35:45,568][106225] Updated weights for policy 1, policy_version 607667 (0.0009) [2023-12-27 23:35:45,621][106225] Updated weights for policy 1, policy_version 607677 (0.0008) [2023-12-27 23:35:45,670][106225] Updated weights for policy 1, policy_version 607687 (0.0008) [2023-12-27 23:35:45,945][106226] Updated weights for policy 0, policy_version 605690 (0.0006) [2023-12-27 23:35:46,006][106226] Updated weights for policy 0, policy_version 605700 (0.0005) [2023-12-27 23:35:46,066][106226] Updated weights for policy 0, policy_version 605710 (0.0005) [2023-12-27 23:35:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 310697984. Throughput: 0: 9701.9, 1: 10014.6. Samples: 310686332. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:35:46,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.807')] [2023-12-27 23:35:46,482][106225] Updated weights for policy 1, policy_version 607697 (0.0008) [2023-12-27 23:35:46,540][106225] Updated weights for policy 1, policy_version 607707 (0.0008) [2023-12-27 23:35:46,590][106225] Updated weights for policy 1, policy_version 607717 (0.0008) [2023-12-27 23:35:46,628][106226] Updated weights for policy 0, policy_version 605720 (0.0005) [2023-12-27 23:35:46,634][106225] Updated weights for policy 1, policy_version 607727 (0.0007) [2023-12-27 23:35:46,687][106226] Updated weights for policy 0, policy_version 605730 (0.0008) [2023-12-27 23:35:46,748][106226] Updated weights for policy 0, policy_version 605740 (0.0008) [2023-12-27 23:35:47,325][106225] Updated weights for policy 1, policy_version 607737 (0.0008) [2023-12-27 23:35:47,384][106225] Updated weights for policy 1, policy_version 607747 (0.0008) [2023-12-27 23:35:47,435][106225] Updated weights for policy 1, policy_version 607757 (0.0008) [2023-12-27 23:35:47,486][106226] Updated weights for policy 0, policy_version 605750 (0.0008) [2023-12-27 23:35:47,544][106226] Updated weights for policy 0, policy_version 605760 (0.0008) [2023-12-27 23:35:47,592][106226] Updated weights for policy 0, policy_version 605770 (0.0008) [2023-12-27 23:35:48,155][106225] Updated weights for policy 1, policy_version 607767 (0.0009) [2023-12-27 23:35:48,220][106225] Updated weights for policy 1, policy_version 607777 (0.0009) [2023-12-27 23:35:48,273][106225] Updated weights for policy 1, policy_version 607787 (0.0008) [2023-12-27 23:35:48,318][106226] Updated weights for policy 0, policy_version 605780 (0.0008) [2023-12-27 23:35:48,384][106226] Updated weights for policy 0, policy_version 605790 (0.0008) [2023-12-27 23:35:48,451][106226] Updated weights for policy 0, policy_version 605800 (0.0008) [2023-12-27 23:35:49,022][106225] Updated weights for policy 1, policy_version 607797 (0.0008) [2023-12-27 23:35:49,077][106225] Updated weights for policy 1, policy_version 607807 (0.0008) [2023-12-27 23:35:49,136][106225] Updated weights for policy 1, policy_version 607817 (0.0008) [2023-12-27 23:35:49,180][106226] Updated weights for policy 0, policy_version 605810 (0.0009) [2023-12-27 23:35:49,228][106226] Updated weights for policy 0, policy_version 605820 (0.0008) [2023-12-27 23:35:49,292][106226] Updated weights for policy 0, policy_version 605830 (0.0009) [2023-12-27 23:35:49,342][106226] Updated weights for policy 0, policy_version 605840 (0.0009) [2023-12-27 23:35:49,810][106225] Updated weights for policy 1, policy_version 607827 (0.0008) [2023-12-27 23:35:49,881][106225] Updated weights for policy 1, policy_version 607837 (0.0008) [2023-12-27 23:35:49,945][106225] Updated weights for policy 1, policy_version 607847 (0.0009) [2023-12-27 23:35:50,170][106226] Updated weights for policy 0, policy_version 605850 (0.0009) [2023-12-27 23:35:50,236][106226] Updated weights for policy 0, policy_version 605860 (0.0009) [2023-12-27 23:35:50,298][106226] Updated weights for policy 0, policy_version 605870 (0.0008) [2023-12-27 23:35:50,664][106225] Updated weights for policy 1, policy_version 607857 (0.0008) [2023-12-27 23:35:50,713][106225] Updated weights for policy 1, policy_version 607867 (0.0007) [2023-12-27 23:35:50,772][106225] Updated weights for policy 1, policy_version 607877 (0.0008) [2023-12-27 23:35:50,828][106225] Updated weights for policy 1, policy_version 607887 (0.0008) [2023-12-27 23:35:51,001][106226] Updated weights for policy 0, policy_version 605880 (0.0009) [2023-12-27 23:35:51,070][106226] Updated weights for policy 0, policy_version 605890 (0.0009) [2023-12-27 23:35:51,136][106226] Updated weights for policy 0, policy_version 605900 (0.0009) [2023-12-27 23:35:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 310796288. Throughput: 0: 9610.1, 1: 10004.8. Samples: 310801368. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:35:51,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.863')] [2023-12-27 23:35:51,553][106225] Updated weights for policy 1, policy_version 607897 (0.0005) [2023-12-27 23:35:51,619][106225] Updated weights for policy 1, policy_version 607907 (0.0006) [2023-12-27 23:35:51,682][106225] Updated weights for policy 1, policy_version 607917 (0.0007) [2023-12-27 23:35:52,001][106226] Updated weights for policy 0, policy_version 605910 (0.0008) [2023-12-27 23:35:52,052][106226] Updated weights for policy 0, policy_version 605920 (0.0009) [2023-12-27 23:35:52,113][106226] Updated weights for policy 0, policy_version 605930 (0.0009) [2023-12-27 23:35:52,302][106225] Updated weights for policy 1, policy_version 607927 (0.0006) [2023-12-27 23:35:52,365][106225] Updated weights for policy 1, policy_version 607937 (0.0006) [2023-12-27 23:35:52,432][106225] Updated weights for policy 1, policy_version 607947 (0.0008) [2023-12-27 23:35:52,928][106226] Updated weights for policy 0, policy_version 605940 (0.0008) [2023-12-27 23:35:52,996][106226] Updated weights for policy 0, policy_version 605950 (0.0007) [2023-12-27 23:35:52,999][106225] Updated weights for policy 1, policy_version 607957 (0.0010) [2023-12-27 23:35:53,059][106226] Updated weights for policy 0, policy_version 605960 (0.0006) [2023-12-27 23:35:53,060][106225] Updated weights for policy 1, policy_version 607967 (0.0011) [2023-12-27 23:35:53,121][106225] Updated weights for policy 1, policy_version 607977 (0.0010) [2023-12-27 23:35:53,749][106226] Updated weights for policy 0, policy_version 605970 (0.0005) [2023-12-27 23:35:53,814][106226] Updated weights for policy 0, policy_version 605980 (0.0005) [2023-12-27 23:35:53,855][106225] Updated weights for policy 1, policy_version 607987 (0.0010) [2023-12-27 23:35:53,882][106226] Updated weights for policy 0, policy_version 605990 (0.0005) [2023-12-27 23:35:53,915][106225] Updated weights for policy 1, policy_version 607997 (0.0007) [2023-12-27 23:35:53,943][106226] Updated weights for policy 0, policy_version 606000 (0.0007) [2023-12-27 23:35:53,970][106225] Updated weights for policy 1, policy_version 608007 (0.0005) [2023-12-27 23:35:54,507][106225] Updated weights for policy 1, policy_version 608017 (0.0006) [2023-12-27 23:35:54,566][106225] Updated weights for policy 1, policy_version 608027 (0.0008) [2023-12-27 23:35:54,624][106225] Updated weights for policy 1, policy_version 608037 (0.0007) [2023-12-27 23:35:54,637][106226] Updated weights for policy 0, policy_version 606010 (0.0008) [2023-12-27 23:35:54,686][106225] Updated weights for policy 1, policy_version 608047 (0.0007) [2023-12-27 23:35:54,700][106226] Updated weights for policy 0, policy_version 606020 (0.0008) [2023-12-27 23:35:54,764][106226] Updated weights for policy 0, policy_version 606030 (0.0008) [2023-12-27 23:35:55,317][106225] Updated weights for policy 1, policy_version 608057 (0.0006) [2023-12-27 23:35:55,375][106225] Updated weights for policy 1, policy_version 608067 (0.0005) [2023-12-27 23:35:55,442][106225] Updated weights for policy 1, policy_version 608077 (0.0005) [2023-12-27 23:35:55,592][106226] Updated weights for policy 0, policy_version 606040 (0.0009) [2023-12-27 23:35:55,651][106226] Updated weights for policy 0, policy_version 606050 (0.0008) [2023-12-27 23:35:55,703][106226] Updated weights for policy 0, policy_version 606060 (0.0008) [2023-12-27 23:35:56,045][106225] Updated weights for policy 1, policy_version 608087 (0.0005) [2023-12-27 23:35:56,110][106225] Updated weights for policy 1, policy_version 608097 (0.0006) [2023-12-27 23:35:56,158][106225] Updated weights for policy 1, policy_version 608107 (0.0005) [2023-12-27 23:35:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 310886400. Throughput: 0: 9565.5, 1: 9991.1. Samples: 310860008. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:35:56,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.804')] [2023-12-27 23:35:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000606064_155189248.pth... [2023-12-27 23:35:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000608112_155705344.pth... [2023-12-27 23:35:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000604944_154902528.pth [2023-12-27 23:35:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000606928_155402240.pth [2023-12-27 23:35:56,520][106226] Updated weights for policy 0, policy_version 606070 (0.0008) [2023-12-27 23:35:56,564][106226] Updated weights for policy 0, policy_version 606080 (0.0008) [2023-12-27 23:35:56,608][106226] Updated weights for policy 0, policy_version 606090 (0.0008) [2023-12-27 23:35:56,716][106225] Updated weights for policy 1, policy_version 608117 (0.0006) [2023-12-27 23:35:56,769][106225] Updated weights for policy 1, policy_version 608127 (0.0007) [2023-12-27 23:35:56,820][106225] Updated weights for policy 1, policy_version 608137 (0.0008) [2023-12-27 23:35:57,369][106226] Updated weights for policy 0, policy_version 606100 (0.0008) [2023-12-27 23:35:57,421][106226] Updated weights for policy 0, policy_version 606110 (0.0008) [2023-12-27 23:35:57,475][106226] Updated weights for policy 0, policy_version 606120 (0.0008) [2023-12-27 23:35:57,487][106225] Updated weights for policy 1, policy_version 608147 (0.0009) [2023-12-27 23:35:57,536][106225] Updated weights for policy 1, policy_version 608157 (0.0007) [2023-12-27 23:35:57,587][106225] Updated weights for policy 1, policy_version 608167 (0.0008) [2023-12-27 23:35:58,189][106226] Updated weights for policy 0, policy_version 606130 (0.0006) [2023-12-27 23:35:58,264][106226] Updated weights for policy 0, policy_version 606140 (0.0008) [2023-12-27 23:35:58,317][106225] Updated weights for policy 1, policy_version 608177 (0.0008) [2023-12-27 23:35:58,337][106226] Updated weights for policy 0, policy_version 606150 (0.0008) [2023-12-27 23:35:58,400][106225] Updated weights for policy 1, policy_version 608187 (0.0008) [2023-12-27 23:35:58,409][106226] Updated weights for policy 0, policy_version 606160 (0.0008) [2023-12-27 23:35:58,469][106225] Updated weights for policy 1, policy_version 608197 (0.0007) [2023-12-27 23:35:58,532][106225] Updated weights for policy 1, policy_version 608207 (0.0008) [2023-12-27 23:35:59,174][106226] Updated weights for policy 0, policy_version 606170 (0.0008) [2023-12-27 23:35:59,256][106226] Updated weights for policy 0, policy_version 606180 (0.0008) [2023-12-27 23:35:59,323][106226] Updated weights for policy 0, policy_version 606190 (0.0008) [2023-12-27 23:35:59,362][106225] Updated weights for policy 1, policy_version 608217 (0.0007) [2023-12-27 23:35:59,434][106225] Updated weights for policy 1, policy_version 608227 (0.0007) [2023-12-27 23:35:59,500][106225] Updated weights for policy 1, policy_version 608237 (0.0005) [2023-12-27 23:36:00,058][106226] Updated weights for policy 0, policy_version 606200 (0.0006) [2023-12-27 23:36:00,123][106226] Updated weights for policy 0, policy_version 606210 (0.0005) [2023-12-27 23:36:00,139][106225] Updated weights for policy 1, policy_version 608247 (0.0005) [2023-12-27 23:36:00,193][106226] Updated weights for policy 0, policy_version 606220 (0.0006) [2023-12-27 23:36:00,207][106225] Updated weights for policy 1, policy_version 608257 (0.0006) [2023-12-27 23:36:00,265][106225] Updated weights for policy 1, policy_version 608267 (0.0009) [2023-12-27 23:36:00,739][106226] Updated weights for policy 0, policy_version 606230 (0.0009) [2023-12-27 23:36:00,793][106226] Updated weights for policy 0, policy_version 606240 (0.0006) [2023-12-27 23:36:00,851][106226] Updated weights for policy 0, policy_version 606250 (0.0005) [2023-12-27 23:36:00,975][106225] Updated weights for policy 1, policy_version 608277 (0.0007) [2023-12-27 23:36:01,039][106225] Updated weights for policy 1, policy_version 608287 (0.0009) [2023-12-27 23:36:01,104][106225] Updated weights for policy 1, policy_version 608297 (0.0009) [2023-12-27 23:36:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 310992896. Throughput: 0: 9460.0, 1: 10078.9. Samples: 310977636. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:01,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-6.077')] [2023-12-27 23:36:01,485][106226] Updated weights for policy 0, policy_version 606260 (0.0007) [2023-12-27 23:36:01,545][106226] Updated weights for policy 0, policy_version 606270 (0.0009) [2023-12-27 23:36:01,610][106226] Updated weights for policy 0, policy_version 606280 (0.0009) [2023-12-27 23:36:01,891][106225] Updated weights for policy 1, policy_version 608307 (0.0008) [2023-12-27 23:36:01,949][106225] Updated weights for policy 1, policy_version 608317 (0.0008) [2023-12-27 23:36:02,010][106225] Updated weights for policy 1, policy_version 608327 (0.0009) [2023-12-27 23:36:02,266][106226] Updated weights for policy 0, policy_version 606290 (0.0007) [2023-12-27 23:36:02,330][106226] Updated weights for policy 0, policy_version 606300 (0.0008) [2023-12-27 23:36:02,395][106226] Updated weights for policy 0, policy_version 606310 (0.0010) [2023-12-27 23:36:02,463][106226] Updated weights for policy 0, policy_version 606320 (0.0008) [2023-12-27 23:36:02,759][106225] Updated weights for policy 1, policy_version 608337 (0.0008) [2023-12-27 23:36:02,808][106225] Updated weights for policy 1, policy_version 608347 (0.0005) [2023-12-27 23:36:02,859][106225] Updated weights for policy 1, policy_version 608357 (0.0005) [2023-12-27 23:36:02,907][106225] Updated weights for policy 1, policy_version 608367 (0.0005) [2023-12-27 23:36:03,130][106226] Updated weights for policy 0, policy_version 606330 (0.0008) [2023-12-27 23:36:03,191][106226] Updated weights for policy 0, policy_version 606340 (0.0008) [2023-12-27 23:36:03,249][106226] Updated weights for policy 0, policy_version 606350 (0.0008) [2023-12-27 23:36:03,595][106225] Updated weights for policy 1, policy_version 608377 (0.0010) [2023-12-27 23:36:03,642][106225] Updated weights for policy 1, policy_version 608387 (0.0010) [2023-12-27 23:36:03,689][106225] Updated weights for policy 1, policy_version 608397 (0.0010) [2023-12-27 23:36:03,923][106226] Updated weights for policy 0, policy_version 606360 (0.0009) [2023-12-27 23:36:03,990][106226] Updated weights for policy 0, policy_version 606370 (0.0008) [2023-12-27 23:36:04,053][106226] Updated weights for policy 0, policy_version 606380 (0.0009) [2023-12-27 23:36:04,398][106225] Updated weights for policy 1, policy_version 608407 (0.0009) [2023-12-27 23:36:04,465][106225] Updated weights for policy 1, policy_version 608417 (0.0009) [2023-12-27 23:36:04,523][106225] Updated weights for policy 1, policy_version 608427 (0.0008) [2023-12-27 23:36:04,784][106226] Updated weights for policy 0, policy_version 606390 (0.0009) [2023-12-27 23:36:04,833][106226] Updated weights for policy 0, policy_version 606400 (0.0008) [2023-12-27 23:36:04,881][106226] Updated weights for policy 0, policy_version 606410 (0.0008) [2023-12-27 23:36:05,168][106225] Updated weights for policy 1, policy_version 608437 (0.0009) [2023-12-27 23:36:05,227][106225] Updated weights for policy 1, policy_version 608447 (0.0006) [2023-12-27 23:36:05,285][106225] Updated weights for policy 1, policy_version 608457 (0.0005) [2023-12-27 23:36:05,618][106226] Updated weights for policy 0, policy_version 606420 (0.0008) [2023-12-27 23:36:05,676][106226] Updated weights for policy 0, policy_version 606430 (0.0009) [2023-12-27 23:36:05,732][106226] Updated weights for policy 0, policy_version 606440 (0.0008) [2023-12-27 23:36:05,973][106225] Updated weights for policy 1, policy_version 608467 (0.0007) [2023-12-27 23:36:06,028][106225] Updated weights for policy 1, policy_version 608477 (0.0008) [2023-12-27 23:36:06,078][106225] Updated weights for policy 1, policy_version 608487 (0.0007) [2023-12-27 23:36:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 311091200. Throughput: 0: 9587.5, 1: 9996.6. Samples: 311096676. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:06,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-6.010')] [2023-12-27 23:36:06,440][106226] Updated weights for policy 0, policy_version 606450 (0.0008) [2023-12-27 23:36:06,502][106226] Updated weights for policy 0, policy_version 606460 (0.0009) [2023-12-27 23:36:06,560][106226] Updated weights for policy 0, policy_version 606470 (0.0009) [2023-12-27 23:36:06,617][106226] Updated weights for policy 0, policy_version 606480 (0.0009) [2023-12-27 23:36:06,875][106225] Updated weights for policy 1, policy_version 608497 (0.0008) [2023-12-27 23:36:06,938][106225] Updated weights for policy 1, policy_version 608507 (0.0008) [2023-12-27 23:36:06,996][106225] Updated weights for policy 1, policy_version 608517 (0.0008) [2023-12-27 23:36:07,051][106225] Updated weights for policy 1, policy_version 608527 (0.0008) [2023-12-27 23:36:07,291][106226] Updated weights for policy 0, policy_version 606490 (0.0008) [2023-12-27 23:36:07,349][106226] Updated weights for policy 0, policy_version 606500 (0.0008) [2023-12-27 23:36:07,404][106226] Updated weights for policy 0, policy_version 606510 (0.0005) [2023-12-27 23:36:07,872][106225] Updated weights for policy 1, policy_version 608537 (0.0008) [2023-12-27 23:36:07,929][106225] Updated weights for policy 1, policy_version 608547 (0.0008) [2023-12-27 23:36:07,984][106226] Updated weights for policy 0, policy_version 606520 (0.0007) [2023-12-27 23:36:07,990][106225] Updated weights for policy 1, policy_version 608557 (0.0007) [2023-12-27 23:36:08,047][106226] Updated weights for policy 0, policy_version 606530 (0.0007) [2023-12-27 23:36:08,107][106226] Updated weights for policy 0, policy_version 606540 (0.0008) [2023-12-27 23:36:08,720][106225] Updated weights for policy 1, policy_version 608567 (0.0009) [2023-12-27 23:36:08,782][106225] Updated weights for policy 1, policy_version 608577 (0.0008) [2023-12-27 23:36:08,840][106225] Updated weights for policy 1, policy_version 608587 (0.0008) [2023-12-27 23:36:08,850][106226] Updated weights for policy 0, policy_version 606550 (0.0007) [2023-12-27 23:36:08,910][106226] Updated weights for policy 0, policy_version 606560 (0.0008) [2023-12-27 23:36:08,973][106226] Updated weights for policy 0, policy_version 606570 (0.0008) [2023-12-27 23:36:09,528][106225] Updated weights for policy 1, policy_version 608597 (0.0008) [2023-12-27 23:36:09,583][106225] Updated weights for policy 1, policy_version 608607 (0.0010) [2023-12-27 23:36:09,634][106225] Updated weights for policy 1, policy_version 608617 (0.0010) [2023-12-27 23:36:09,728][106226] Updated weights for policy 0, policy_version 606580 (0.0009) [2023-12-27 23:36:09,790][106226] Updated weights for policy 0, policy_version 606590 (0.0008) [2023-12-27 23:36:09,863][106226] Updated weights for policy 0, policy_version 606600 (0.0009) [2023-12-27 23:36:10,419][106225] Updated weights for policy 1, policy_version 608627 (0.0010) [2023-12-27 23:36:10,473][106225] Updated weights for policy 1, policy_version 608637 (0.0010) [2023-12-27 23:36:10,521][106225] Updated weights for policy 1, policy_version 608647 (0.0010) [2023-12-27 23:36:10,653][106226] Updated weights for policy 0, policy_version 606610 (0.0008) [2023-12-27 23:36:10,716][106226] Updated weights for policy 0, policy_version 606620 (0.0008) [2023-12-27 23:36:10,788][106226] Updated weights for policy 0, policy_version 606630 (0.0008) [2023-12-27 23:36:10,854][106226] Updated weights for policy 0, policy_version 606640 (0.0008) [2023-12-27 23:36:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 311181312. Throughput: 0: 9618.0, 1: 9916.6. Samples: 311154752. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:11,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.860')] [2023-12-27 23:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000608656_155844608.pth... [2023-12-27 23:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000606640_155336704.pth... [2023-12-27 23:36:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000607504_155549696.pth [2023-12-27 23:36:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000605520_155049984.pth [2023-12-27 23:36:11,303][106225] Updated weights for policy 1, policy_version 608657 (0.0010) [2023-12-27 23:36:11,383][106225] Updated weights for policy 1, policy_version 608667 (0.0011) [2023-12-27 23:36:11,451][106225] Updated weights for policy 1, policy_version 608677 (0.0010) [2023-12-27 23:36:11,510][106225] Updated weights for policy 1, policy_version 608687 (0.0010) [2023-12-27 23:36:11,653][106226] Updated weights for policy 0, policy_version 606650 (0.0008) [2023-12-27 23:36:11,713][106226] Updated weights for policy 0, policy_version 606660 (0.0008) [2023-12-27 23:36:11,784][106226] Updated weights for policy 0, policy_version 606670 (0.0009) [2023-12-27 23:36:12,157][106225] Updated weights for policy 1, policy_version 608697 (0.0007) [2023-12-27 23:36:12,218][106225] Updated weights for policy 1, policy_version 608707 (0.0006) [2023-12-27 23:36:12,287][106225] Updated weights for policy 1, policy_version 608717 (0.0007) [2023-12-27 23:36:12,585][106226] Updated weights for policy 0, policy_version 606680 (0.0009) [2023-12-27 23:36:12,634][106226] Updated weights for policy 0, policy_version 606690 (0.0009) [2023-12-27 23:36:12,687][106226] Updated weights for policy 0, policy_version 606700 (0.0008) [2023-12-27 23:36:12,991][106225] Updated weights for policy 1, policy_version 608727 (0.0008) [2023-12-27 23:36:13,054][106225] Updated weights for policy 1, policy_version 608737 (0.0009) [2023-12-27 23:36:13,107][106225] Updated weights for policy 1, policy_version 608747 (0.0009) [2023-12-27 23:36:13,315][106226] Updated weights for policy 0, policy_version 606710 (0.0007) [2023-12-27 23:36:13,377][106226] Updated weights for policy 0, policy_version 606720 (0.0005) [2023-12-27 23:36:13,425][106226] Updated weights for policy 0, policy_version 606730 (0.0005) [2023-12-27 23:36:13,868][106225] Updated weights for policy 1, policy_version 608757 (0.0008) [2023-12-27 23:36:13,930][106225] Updated weights for policy 1, policy_version 608767 (0.0008) [2023-12-27 23:36:13,990][106226] Updated weights for policy 0, policy_version 606740 (0.0007) [2023-12-27 23:36:13,996][106225] Updated weights for policy 1, policy_version 608777 (0.0006) [2023-12-27 23:36:14,050][106226] Updated weights for policy 0, policy_version 606750 (0.0009) [2023-12-27 23:36:14,110][106226] Updated weights for policy 0, policy_version 606760 (0.0007) [2023-12-27 23:36:14,691][106225] Updated weights for policy 1, policy_version 608787 (0.0007) [2023-12-27 23:36:14,744][106225] Updated weights for policy 1, policy_version 608797 (0.0010) [2023-12-27 23:36:14,769][106226] Updated weights for policy 0, policy_version 606770 (0.0007) [2023-12-27 23:36:14,810][106225] Updated weights for policy 1, policy_version 608807 (0.0009) [2023-12-27 23:36:14,829][106226] Updated weights for policy 0, policy_version 606780 (0.0009) [2023-12-27 23:36:14,884][106226] Updated weights for policy 0, policy_version 606790 (0.0007) [2023-12-27 23:36:14,945][106226] Updated weights for policy 0, policy_version 606800 (0.0008) [2023-12-27 23:36:15,539][106225] Updated weights for policy 1, policy_version 608817 (0.0010) [2023-12-27 23:36:15,598][106225] Updated weights for policy 1, policy_version 608827 (0.0010) [2023-12-27 23:36:15,665][106225] Updated weights for policy 1, policy_version 608837 (0.0010) [2023-12-27 23:36:15,701][106226] Updated weights for policy 0, policy_version 606810 (0.0007) [2023-12-27 23:36:15,726][106225] Updated weights for policy 1, policy_version 608847 (0.0010) [2023-12-27 23:36:15,757][106226] Updated weights for policy 0, policy_version 606820 (0.0006) [2023-12-27 23:36:15,811][106226] Updated weights for policy 0, policy_version 606830 (0.0005) [2023-12-27 23:36:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 311279616. Throughput: 0: 9554.1, 1: 9852.1. Samples: 311270036. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:16,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.782')] [2023-12-27 23:36:16,355][106226] Updated weights for policy 0, policy_version 606840 (0.0006) [2023-12-27 23:36:16,364][106225] Updated weights for policy 1, policy_version 608857 (0.0009) [2023-12-27 23:36:16,412][106226] Updated weights for policy 0, policy_version 606850 (0.0006) [2023-12-27 23:36:16,421][106225] Updated weights for policy 1, policy_version 608867 (0.0010) [2023-12-27 23:36:16,473][106226] Updated weights for policy 0, policy_version 606860 (0.0006) [2023-12-27 23:36:16,478][106225] Updated weights for policy 1, policy_version 608877 (0.0010) [2023-12-27 23:36:17,146][106225] Updated weights for policy 1, policy_version 608887 (0.0010) [2023-12-27 23:36:17,191][106226] Updated weights for policy 0, policy_version 606870 (0.0006) [2023-12-27 23:36:17,203][106225] Updated weights for policy 1, policy_version 608897 (0.0010) [2023-12-27 23:36:17,252][106226] Updated weights for policy 0, policy_version 606880 (0.0006) [2023-12-27 23:36:17,254][106225] Updated weights for policy 1, policy_version 608907 (0.0010) [2023-12-27 23:36:17,307][106226] Updated weights for policy 0, policy_version 606890 (0.0007) [2023-12-27 23:36:17,854][106225] Updated weights for policy 1, policy_version 608917 (0.0009) [2023-12-27 23:36:17,901][106225] Updated weights for policy 1, policy_version 608927 (0.0006) [2023-12-27 23:36:17,952][106225] Updated weights for policy 1, policy_version 608937 (0.0005) [2023-12-27 23:36:18,056][106226] Updated weights for policy 0, policy_version 606900 (0.0008) [2023-12-27 23:36:18,124][106226] Updated weights for policy 0, policy_version 606910 (0.0008) [2023-12-27 23:36:18,180][106226] Updated weights for policy 0, policy_version 606920 (0.0008) [2023-12-27 23:36:18,603][106225] Updated weights for policy 1, policy_version 608947 (0.0008) [2023-12-27 23:36:18,663][106225] Updated weights for policy 1, policy_version 608957 (0.0006) [2023-12-27 23:36:18,730][106225] Updated weights for policy 1, policy_version 608967 (0.0010) [2023-12-27 23:36:18,952][106226] Updated weights for policy 0, policy_version 606930 (0.0007) [2023-12-27 23:36:19,017][106226] Updated weights for policy 0, policy_version 606940 (0.0005) [2023-12-27 23:36:19,078][106226] Updated weights for policy 0, policy_version 606950 (0.0005) [2023-12-27 23:36:19,134][106226] Updated weights for policy 0, policy_version 606960 (0.0006) [2023-12-27 23:36:19,322][106225] Updated weights for policy 1, policy_version 608977 (0.0007) [2023-12-27 23:36:19,392][106225] Updated weights for policy 1, policy_version 608987 (0.0011) [2023-12-27 23:36:19,452][106225] Updated weights for policy 1, policy_version 608997 (0.0010) [2023-12-27 23:36:19,511][106225] Updated weights for policy 1, policy_version 609007 (0.0008) [2023-12-27 23:36:19,893][106226] Updated weights for policy 0, policy_version 606970 (0.0007) [2023-12-27 23:36:19,965][106226] Updated weights for policy 0, policy_version 606980 (0.0007) [2023-12-27 23:36:20,026][106226] Updated weights for policy 0, policy_version 606990 (0.0008) [2023-12-27 23:36:20,260][106225] Updated weights for policy 1, policy_version 609017 (0.0010) [2023-12-27 23:36:20,322][106225] Updated weights for policy 1, policy_version 609027 (0.0011) [2023-12-27 23:36:20,385][106225] Updated weights for policy 1, policy_version 609037 (0.0009) [2023-12-27 23:36:20,692][106226] Updated weights for policy 0, policy_version 607000 (0.0009) [2023-12-27 23:36:20,755][106226] Updated weights for policy 0, policy_version 607010 (0.0008) [2023-12-27 23:36:20,815][106226] Updated weights for policy 0, policy_version 607020 (0.0008) [2023-12-27 23:36:21,150][106225] Updated weights for policy 1, policy_version 609047 (0.0009) [2023-12-27 23:36:21,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 311377920. Throughput: 0: 9606.5, 1: 9869.6. Samples: 311390496. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:21,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-5.997')] [2023-12-27 23:36:21,216][106225] Updated weights for policy 1, policy_version 609057 (0.0011) [2023-12-27 23:36:21,282][106225] Updated weights for policy 1, policy_version 609067 (0.0011) [2023-12-27 23:36:21,583][106226] Updated weights for policy 0, policy_version 607030 (0.0009) [2023-12-27 23:36:21,653][106226] Updated weights for policy 0, policy_version 607040 (0.0009) [2023-12-27 23:36:21,730][106226] Updated weights for policy 0, policy_version 607050 (0.0008) [2023-12-27 23:36:22,016][106225] Updated weights for policy 1, policy_version 609077 (0.0007) [2023-12-27 23:36:22,086][106225] Updated weights for policy 1, policy_version 609087 (0.0006) [2023-12-27 23:36:22,149][106225] Updated weights for policy 1, policy_version 609097 (0.0008) [2023-12-27 23:36:22,508][106226] Updated weights for policy 0, policy_version 607060 (0.0009) [2023-12-27 23:36:22,573][106226] Updated weights for policy 0, policy_version 607070 (0.0011) [2023-12-27 23:36:22,635][106226] Updated weights for policy 0, policy_version 607080 (0.0011) [2023-12-27 23:36:22,906][106225] Updated weights for policy 1, policy_version 609107 (0.0008) [2023-12-27 23:36:22,968][106225] Updated weights for policy 1, policy_version 609117 (0.0008) [2023-12-27 23:36:23,022][106225] Updated weights for policy 1, policy_version 609127 (0.0008) [2023-12-27 23:36:23,355][106226] Updated weights for policy 0, policy_version 607090 (0.0011) [2023-12-27 23:36:23,408][106226] Updated weights for policy 0, policy_version 607100 (0.0010) [2023-12-27 23:36:23,461][106226] Updated weights for policy 0, policy_version 607110 (0.0011) [2023-12-27 23:36:23,512][106226] Updated weights for policy 0, policy_version 607120 (0.0010) [2023-12-27 23:36:23,782][106225] Updated weights for policy 1, policy_version 609137 (0.0008) [2023-12-27 23:36:23,841][106225] Updated weights for policy 1, policy_version 609147 (0.0010) [2023-12-27 23:36:23,893][106225] Updated weights for policy 1, policy_version 609157 (0.0010) [2023-12-27 23:36:23,948][106225] Updated weights for policy 1, policy_version 609167 (0.0010) [2023-12-27 23:36:24,208][106226] Updated weights for policy 0, policy_version 607130 (0.0009) [2023-12-27 23:36:24,262][106226] Updated weights for policy 0, policy_version 607140 (0.0010) [2023-12-27 23:36:24,321][106226] Updated weights for policy 0, policy_version 607150 (0.0010) [2023-12-27 23:36:24,641][106225] Updated weights for policy 1, policy_version 609177 (0.0010) [2023-12-27 23:36:24,691][106225] Updated weights for policy 1, policy_version 609187 (0.0010) [2023-12-27 23:36:24,741][106225] Updated weights for policy 1, policy_version 609197 (0.0010) [2023-12-27 23:36:24,977][106226] Updated weights for policy 0, policy_version 607160 (0.0010) [2023-12-27 23:36:25,040][106226] Updated weights for policy 0, policy_version 607170 (0.0006) [2023-12-27 23:36:25,101][106226] Updated weights for policy 0, policy_version 607180 (0.0008) [2023-12-27 23:36:25,479][106225] Updated weights for policy 1, policy_version 609207 (0.0010) [2023-12-27 23:36:25,543][106225] Updated weights for policy 1, policy_version 609217 (0.0010) [2023-12-27 23:36:25,590][106225] Updated weights for policy 1, policy_version 609227 (0.0010) [2023-12-27 23:36:25,788][106226] Updated weights for policy 0, policy_version 607190 (0.0010) [2023-12-27 23:36:25,839][106226] Updated weights for policy 0, policy_version 607200 (0.0005) [2023-12-27 23:36:25,899][106226] Updated weights for policy 0, policy_version 607210 (0.0009) [2023-12-27 23:36:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 311476224. Throughput: 0: 9612.6, 1: 9787.1. Samples: 311446432. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:26,176][105115] Avg episode reward: [(0, '-4.924'), (1, '-5.975')] [2023-12-27 23:36:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000609232_155992064.pth... [2023-12-27 23:36:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000607216_155484160.pth... [2023-12-27 23:36:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000606064_155189248.pth [2023-12-27 23:36:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000608112_155705344.pth [2023-12-27 23:36:26,253][106225] Updated weights for policy 1, policy_version 609237 (0.0010) [2023-12-27 23:36:26,308][106225] Updated weights for policy 1, policy_version 609247 (0.0010) [2023-12-27 23:36:26,364][106225] Updated weights for policy 1, policy_version 609257 (0.0010) [2023-12-27 23:36:26,582][106226] Updated weights for policy 0, policy_version 607220 (0.0011) [2023-12-27 23:36:26,648][106226] Updated weights for policy 0, policy_version 607230 (0.0010) [2023-12-27 23:36:26,701][106226] Updated weights for policy 0, policy_version 607240 (0.0010) [2023-12-27 23:36:27,051][106225] Updated weights for policy 1, policy_version 609267 (0.0010) [2023-12-27 23:36:27,105][106225] Updated weights for policy 1, policy_version 609277 (0.0010) [2023-12-27 23:36:27,159][106225] Updated weights for policy 1, policy_version 609287 (0.0010) [2023-12-27 23:36:27,380][106226] Updated weights for policy 0, policy_version 607250 (0.0009) [2023-12-27 23:36:27,432][106226] Updated weights for policy 0, policy_version 607260 (0.0010) [2023-12-27 23:36:27,496][106226] Updated weights for policy 0, policy_version 607270 (0.0010) [2023-12-27 23:36:27,545][106226] Updated weights for policy 0, policy_version 607280 (0.0010) [2023-12-27 23:36:27,815][106225] Updated weights for policy 1, policy_version 609297 (0.0010) [2023-12-27 23:36:27,880][106225] Updated weights for policy 1, policy_version 609307 (0.0010) [2023-12-27 23:36:27,938][106225] Updated weights for policy 1, policy_version 609317 (0.0010) [2023-12-27 23:36:27,993][106225] Updated weights for policy 1, policy_version 609327 (0.0010) [2023-12-27 23:36:28,254][106226] Updated weights for policy 0, policy_version 607290 (0.0010) [2023-12-27 23:36:28,299][106226] Updated weights for policy 0, policy_version 607300 (0.0010) [2023-12-27 23:36:28,357][106226] Updated weights for policy 0, policy_version 607310 (0.0009) [2023-12-27 23:36:28,700][106225] Updated weights for policy 1, policy_version 609337 (0.0010) [2023-12-27 23:36:28,756][106225] Updated weights for policy 1, policy_version 609347 (0.0010) [2023-12-27 23:36:28,814][106225] Updated weights for policy 1, policy_version 609357 (0.0010) [2023-12-27 23:36:29,073][106226] Updated weights for policy 0, policy_version 607320 (0.0010) [2023-12-27 23:36:29,119][106226] Updated weights for policy 0, policy_version 607330 (0.0007) [2023-12-27 23:36:29,173][106226] Updated weights for policy 0, policy_version 607340 (0.0005) [2023-12-27 23:36:29,560][106225] Updated weights for policy 1, policy_version 609367 (0.0009) [2023-12-27 23:36:29,622][106225] Updated weights for policy 1, policy_version 609377 (0.0008) [2023-12-27 23:36:29,685][106225] Updated weights for policy 1, policy_version 609387 (0.0007) [2023-12-27 23:36:29,800][106226] Updated weights for policy 0, policy_version 607350 (0.0008) [2023-12-27 23:36:29,865][106226] Updated weights for policy 0, policy_version 607360 (0.0009) [2023-12-27 23:36:29,923][106226] Updated weights for policy 0, policy_version 607370 (0.0006) [2023-12-27 23:36:30,346][106225] Updated weights for policy 1, policy_version 609397 (0.0008) [2023-12-27 23:36:30,416][106225] Updated weights for policy 1, policy_version 609407 (0.0006) [2023-12-27 23:36:30,470][106225] Updated weights for policy 1, policy_version 609417 (0.0006) [2023-12-27 23:36:30,627][106226] Updated weights for policy 0, policy_version 607380 (0.0011) [2023-12-27 23:36:30,691][106226] Updated weights for policy 0, policy_version 607390 (0.0010) [2023-12-27 23:36:30,745][106226] Updated weights for policy 0, policy_version 607400 (0.0010) [2023-12-27 23:36:30,993][106225] Updated weights for policy 1, policy_version 609427 (0.0007) [2023-12-27 23:36:31,055][106225] Updated weights for policy 1, policy_version 609437 (0.0007) [2023-12-27 23:36:31,113][106225] Updated weights for policy 1, policy_version 609447 (0.0008) [2023-12-27 23:36:31,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 311582720. Throughput: 0: 9724.8, 1: 9838.2. Samples: 311566668. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:31,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-5.902')] [2023-12-27 23:36:31,431][106226] Updated weights for policy 0, policy_version 607410 (0.0010) [2023-12-27 23:36:31,486][106226] Updated weights for policy 0, policy_version 607420 (0.0011) [2023-12-27 23:36:31,543][106226] Updated weights for policy 0, policy_version 607430 (0.0010) [2023-12-27 23:36:31,599][106226] Updated weights for policy 0, policy_version 607440 (0.0010) [2023-12-27 23:36:31,862][106225] Updated weights for policy 1, policy_version 609457 (0.0008) [2023-12-27 23:36:31,921][106225] Updated weights for policy 1, policy_version 609467 (0.0009) [2023-12-27 23:36:31,982][106225] Updated weights for policy 1, policy_version 609477 (0.0008) [2023-12-27 23:36:32,041][106225] Updated weights for policy 1, policy_version 609487 (0.0007) [2023-12-27 23:36:32,312][106226] Updated weights for policy 0, policy_version 607450 (0.0008) [2023-12-27 23:36:32,386][106226] Updated weights for policy 0, policy_version 607460 (0.0008) [2023-12-27 23:36:32,458][106226] Updated weights for policy 0, policy_version 607470 (0.0007) [2023-12-27 23:36:32,796][106225] Updated weights for policy 1, policy_version 609497 (0.0006) [2023-12-27 23:36:32,867][106225] Updated weights for policy 1, policy_version 609507 (0.0005) [2023-12-27 23:36:32,926][106225] Updated weights for policy 1, policy_version 609517 (0.0005) [2023-12-27 23:36:33,077][106226] Updated weights for policy 0, policy_version 607480 (0.0008) [2023-12-27 23:36:33,139][106226] Updated weights for policy 0, policy_version 607490 (0.0008) [2023-12-27 23:36:33,198][106226] Updated weights for policy 0, policy_version 607500 (0.0008) [2023-12-27 23:36:33,542][106225] Updated weights for policy 1, policy_version 609527 (0.0006) [2023-12-27 23:36:33,600][106225] Updated weights for policy 1, policy_version 609537 (0.0005) [2023-12-27 23:36:33,659][106225] Updated weights for policy 1, policy_version 609547 (0.0007) [2023-12-27 23:36:33,999][106226] Updated weights for policy 0, policy_version 607510 (0.0009) [2023-12-27 23:36:34,048][106226] Updated weights for policy 0, policy_version 607520 (0.0010) [2023-12-27 23:36:34,104][106226] Updated weights for policy 0, policy_version 607530 (0.0010) [2023-12-27 23:36:34,190][106225] Updated weights for policy 1, policy_version 609557 (0.0007) [2023-12-27 23:36:34,249][106225] Updated weights for policy 1, policy_version 609567 (0.0008) [2023-12-27 23:36:34,300][106225] Updated weights for policy 1, policy_version 609577 (0.0008) [2023-12-27 23:36:34,830][106226] Updated weights for policy 0, policy_version 607540 (0.0008) [2023-12-27 23:36:34,891][106226] Updated weights for policy 0, policy_version 607550 (0.0005) [2023-12-27 23:36:34,949][106226] Updated weights for policy 0, policy_version 607560 (0.0009) [2023-12-27 23:36:34,969][106225] Updated weights for policy 1, policy_version 609587 (0.0008) [2023-12-27 23:36:35,027][106225] Updated weights for policy 1, policy_version 609597 (0.0007) [2023-12-27 23:36:35,084][106225] Updated weights for policy 1, policy_version 609607 (0.0008) [2023-12-27 23:36:35,618][106226] Updated weights for policy 0, policy_version 607570 (0.0010) [2023-12-27 23:36:35,673][106226] Updated weights for policy 0, policy_version 607580 (0.0008) [2023-12-27 23:36:35,727][106226] Updated weights for policy 0, policy_version 607590 (0.0007) [2023-12-27 23:36:35,788][106226] Updated weights for policy 0, policy_version 607600 (0.0007) [2023-12-27 23:36:35,808][106225] Updated weights for policy 1, policy_version 609617 (0.0008) [2023-12-27 23:36:35,859][106225] Updated weights for policy 1, policy_version 609627 (0.0010) [2023-12-27 23:36:35,906][106225] Updated weights for policy 1, policy_version 609637 (0.0010) [2023-12-27 23:36:35,952][106225] Updated weights for policy 1, policy_version 609647 (0.0010) [2023-12-27 23:36:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 311681024. Throughput: 0: 9731.7, 1: 9979.7. Samples: 311688384. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:36,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-6.095')] [2023-12-27 23:36:36,554][106226] Updated weights for policy 0, policy_version 607610 (0.0008) [2023-12-27 23:36:36,612][106226] Updated weights for policy 0, policy_version 607620 (0.0008) [2023-12-27 23:36:36,675][106226] Updated weights for policy 0, policy_version 607630 (0.0008) [2023-12-27 23:36:36,718][106225] Updated weights for policy 1, policy_version 609657 (0.0010) [2023-12-27 23:36:36,779][106225] Updated weights for policy 1, policy_version 609667 (0.0010) [2023-12-27 23:36:36,840][106225] Updated weights for policy 1, policy_version 609677 (0.0010) [2023-12-27 23:36:37,444][106226] Updated weights for policy 0, policy_version 607640 (0.0008) [2023-12-27 23:36:37,505][106226] Updated weights for policy 0, policy_version 607650 (0.0009) [2023-12-27 23:36:37,515][106225] Updated weights for policy 1, policy_version 609687 (0.0007) [2023-12-27 23:36:37,566][106226] Updated weights for policy 0, policy_version 607660 (0.0007) [2023-12-27 23:36:37,571][106225] Updated weights for policy 1, policy_version 609697 (0.0006) [2023-12-27 23:36:37,627][106225] Updated weights for policy 1, policy_version 609707 (0.0006) [2023-12-27 23:36:38,302][106225] Updated weights for policy 1, policy_version 609717 (0.0009) [2023-12-27 23:36:38,328][106226] Updated weights for policy 0, policy_version 607670 (0.0008) [2023-12-27 23:36:38,364][106225] Updated weights for policy 1, policy_version 609727 (0.0008) [2023-12-27 23:36:38,398][106226] Updated weights for policy 0, policy_version 607680 (0.0008) [2023-12-27 23:36:38,430][106225] Updated weights for policy 1, policy_version 609737 (0.0006) [2023-12-27 23:36:38,459][106226] Updated weights for policy 0, policy_version 607690 (0.0008) [2023-12-27 23:36:39,144][106225] Updated weights for policy 1, policy_version 609747 (0.0007) [2023-12-27 23:36:39,198][106226] Updated weights for policy 0, policy_version 607700 (0.0006) [2023-12-27 23:36:39,200][106225] Updated weights for policy 1, policy_version 609757 (0.0008) [2023-12-27 23:36:39,262][106225] Updated weights for policy 1, policy_version 609767 (0.0008) [2023-12-27 23:36:39,291][106226] Updated weights for policy 0, policy_version 607710 (0.0007) [2023-12-27 23:36:39,354][106226] Updated weights for policy 0, policy_version 607720 (0.0009) [2023-12-27 23:36:40,022][106225] Updated weights for policy 1, policy_version 609777 (0.0006) [2023-12-27 23:36:40,059][106226] Updated weights for policy 0, policy_version 607730 (0.0007) [2023-12-27 23:36:40,088][106225] Updated weights for policy 1, policy_version 609787 (0.0008) [2023-12-27 23:36:40,122][106226] Updated weights for policy 0, policy_version 607740 (0.0009) [2023-12-27 23:36:40,152][106225] Updated weights for policy 1, policy_version 609797 (0.0008) [2023-12-27 23:36:40,186][106226] Updated weights for policy 0, policy_version 607750 (0.0009) [2023-12-27 23:36:40,208][106225] Updated weights for policy 1, policy_version 609807 (0.0006) [2023-12-27 23:36:40,244][106226] Updated weights for policy 0, policy_version 607760 (0.0009) [2023-12-27 23:36:40,928][106226] Updated weights for policy 0, policy_version 607770 (0.0010) [2023-12-27 23:36:40,968][106225] Updated weights for policy 1, policy_version 609817 (0.0006) [2023-12-27 23:36:40,988][106226] Updated weights for policy 0, policy_version 607780 (0.0010) [2023-12-27 23:36:41,031][106225] Updated weights for policy 1, policy_version 609827 (0.0006) [2023-12-27 23:36:41,065][106226] Updated weights for policy 0, policy_version 607790 (0.0011) [2023-12-27 23:36:41,097][106225] Updated weights for policy 1, policy_version 609837 (0.0006) [2023-12-27 23:36:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 311779328. Throughput: 0: 9726.0, 1: 9947.4. Samples: 311745308. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:41,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-6.073')] [2023-12-27 23:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000609840_156147712.pth... [2023-12-27 23:36:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000607792_155631616.pth... [2023-12-27 23:36:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000608656_155844608.pth [2023-12-27 23:36:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000606640_155336704.pth [2023-12-27 23:36:41,832][106225] Updated weights for policy 1, policy_version 609847 (0.0008) [2023-12-27 23:36:41,841][106226] Updated weights for policy 0, policy_version 607800 (0.0006) [2023-12-27 23:36:41,899][106225] Updated weights for policy 1, policy_version 609857 (0.0008) [2023-12-27 23:36:41,908][106226] Updated weights for policy 0, policy_version 607810 (0.0006) [2023-12-27 23:36:41,965][106225] Updated weights for policy 1, policy_version 609867 (0.0008) [2023-12-27 23:36:41,974][106226] Updated weights for policy 0, policy_version 607820 (0.0007) [2023-12-27 23:36:42,664][106226] Updated weights for policy 0, policy_version 607830 (0.0007) [2023-12-27 23:36:42,719][106225] Updated weights for policy 1, policy_version 609877 (0.0008) [2023-12-27 23:36:42,720][106226] Updated weights for policy 0, policy_version 607840 (0.0007) [2023-12-27 23:36:42,774][106226] Updated weights for policy 0, policy_version 607850 (0.0008) [2023-12-27 23:36:42,774][106225] Updated weights for policy 1, policy_version 609887 (0.0008) [2023-12-27 23:36:42,833][106225] Updated weights for policy 1, policy_version 609897 (0.0007) [2023-12-27 23:36:43,494][106225] Updated weights for policy 1, policy_version 609907 (0.0006) [2023-12-27 23:36:43,529][106226] Updated weights for policy 0, policy_version 607860 (0.0007) [2023-12-27 23:36:43,556][106225] Updated weights for policy 1, policy_version 609917 (0.0007) [2023-12-27 23:36:43,587][106226] Updated weights for policy 0, policy_version 607870 (0.0007) [2023-12-27 23:36:43,614][106225] Updated weights for policy 1, policy_version 609927 (0.0007) [2023-12-27 23:36:43,645][106226] Updated weights for policy 0, policy_version 607880 (0.0007) [2023-12-27 23:36:44,257][106226] Updated weights for policy 0, policy_version 607890 (0.0006) [2023-12-27 23:36:44,311][106226] Updated weights for policy 0, policy_version 607900 (0.0008) [2023-12-27 23:36:44,325][106225] Updated weights for policy 1, policy_version 609937 (0.0006) [2023-12-27 23:36:44,369][106226] Updated weights for policy 0, policy_version 607910 (0.0007) [2023-12-27 23:36:44,376][106225] Updated weights for policy 1, policy_version 609947 (0.0006) [2023-12-27 23:36:44,424][106226] Updated weights for policy 0, policy_version 607920 (0.0008) [2023-12-27 23:36:44,435][106225] Updated weights for policy 1, policy_version 609957 (0.0008) [2023-12-27 23:36:44,498][106225] Updated weights for policy 1, policy_version 609967 (0.0007) [2023-12-27 23:36:45,166][106226] Updated weights for policy 0, policy_version 607930 (0.0009) [2023-12-27 23:36:45,231][106226] Updated weights for policy 0, policy_version 607940 (0.0007) [2023-12-27 23:36:45,234][106225] Updated weights for policy 1, policy_version 609977 (0.0007) [2023-12-27 23:36:45,291][106226] Updated weights for policy 0, policy_version 607950 (0.0006) [2023-12-27 23:36:45,297][106225] Updated weights for policy 1, policy_version 609987 (0.0006) [2023-12-27 23:36:45,353][106225] Updated weights for policy 1, policy_version 609997 (0.0008) [2023-12-27 23:36:46,020][106225] Updated weights for policy 1, policy_version 610007 (0.0009) [2023-12-27 23:36:46,034][106226] Updated weights for policy 0, policy_version 607960 (0.0008) [2023-12-27 23:36:46,088][106225] Updated weights for policy 1, policy_version 610017 (0.0011) [2023-12-27 23:36:46,090][106226] Updated weights for policy 0, policy_version 607970 (0.0006) [2023-12-27 23:36:46,147][106225] Updated weights for policy 1, policy_version 610027 (0.0010) [2023-12-27 23:36:46,151][106226] Updated weights for policy 0, policy_version 607980 (0.0006) [2023-12-27 23:36:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 311877632. Throughput: 0: 9807.6, 1: 9803.9. Samples: 311860152. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:46,176][105115] Avg episode reward: [(0, '-4.686'), (1, '-6.391')] [2023-12-27 23:36:46,743][106225] Updated weights for policy 1, policy_version 610037 (0.0009) [2023-12-27 23:36:46,778][106226] Updated weights for policy 0, policy_version 607990 (0.0006) [2023-12-27 23:36:46,799][106225] Updated weights for policy 1, policy_version 610047 (0.0008) [2023-12-27 23:36:46,833][106226] Updated weights for policy 0, policy_version 608000 (0.0008) [2023-12-27 23:36:46,864][106225] Updated weights for policy 1, policy_version 610057 (0.0007) [2023-12-27 23:36:46,889][106226] Updated weights for policy 0, policy_version 608010 (0.0006) [2023-12-27 23:36:47,434][106226] Updated weights for policy 0, policy_version 608020 (0.0006) [2023-12-27 23:36:47,485][106226] Updated weights for policy 0, policy_version 608030 (0.0005) [2023-12-27 23:36:47,510][106225] Updated weights for policy 1, policy_version 610067 (0.0008) [2023-12-27 23:36:47,550][106226] Updated weights for policy 0, policy_version 608040 (0.0007) [2023-12-27 23:36:47,566][106225] Updated weights for policy 1, policy_version 610077 (0.0009) [2023-12-27 23:36:47,628][106225] Updated weights for policy 1, policy_version 610087 (0.0011) [2023-12-27 23:36:48,258][106226] Updated weights for policy 0, policy_version 608050 (0.0007) [2023-12-27 23:36:48,314][106226] Updated weights for policy 0, policy_version 608060 (0.0009) [2023-12-27 23:36:48,348][106225] Updated weights for policy 1, policy_version 610097 (0.0010) [2023-12-27 23:36:48,380][106226] Updated weights for policy 0, policy_version 608070 (0.0009) [2023-12-27 23:36:48,408][106225] Updated weights for policy 1, policy_version 610107 (0.0007) [2023-12-27 23:36:48,441][106226] Updated weights for policy 0, policy_version 608080 (0.0009) [2023-12-27 23:36:48,469][106225] Updated weights for policy 1, policy_version 610117 (0.0007) [2023-12-27 23:36:48,528][106225] Updated weights for policy 1, policy_version 610127 (0.0008) [2023-12-27 23:36:49,180][106226] Updated weights for policy 0, policy_version 608090 (0.0008) [2023-12-27 23:36:49,213][106225] Updated weights for policy 1, policy_version 610137 (0.0008) [2023-12-27 23:36:49,239][106226] Updated weights for policy 0, policy_version 608100 (0.0007) [2023-12-27 23:36:49,276][106225] Updated weights for policy 1, policy_version 610147 (0.0007) [2023-12-27 23:36:49,298][106226] Updated weights for policy 0, policy_version 608110 (0.0008) [2023-12-27 23:36:49,352][106225] Updated weights for policy 1, policy_version 610157 (0.0008) [2023-12-27 23:36:50,067][106225] Updated weights for policy 1, policy_version 610167 (0.0009) [2023-12-27 23:36:50,077][106226] Updated weights for policy 0, policy_version 608120 (0.0006) [2023-12-27 23:36:50,128][106225] Updated weights for policy 1, policy_version 610177 (0.0008) [2023-12-27 23:36:50,139][106226] Updated weights for policy 0, policy_version 608130 (0.0007) [2023-12-27 23:36:50,185][106225] Updated weights for policy 1, policy_version 610187 (0.0008) [2023-12-27 23:36:50,198][106226] Updated weights for policy 0, policy_version 608140 (0.0007) [2023-12-27 23:36:50,922][106226] Updated weights for policy 0, policy_version 608150 (0.0007) [2023-12-27 23:36:50,928][106225] Updated weights for policy 1, policy_version 610197 (0.0007) [2023-12-27 23:36:50,978][106226] Updated weights for policy 0, policy_version 608160 (0.0007) [2023-12-27 23:36:50,987][106225] Updated weights for policy 1, policy_version 610207 (0.0008) [2023-12-27 23:36:51,038][106226] Updated weights for policy 0, policy_version 608170 (0.0007) [2023-12-27 23:36:51,053][106225] Updated weights for policy 1, policy_version 610217 (0.0008) [2023-12-27 23:36:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 311975936. Throughput: 0: 9768.6, 1: 9838.8. Samples: 311979004. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:51,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.809')] [2023-12-27 23:36:51,788][106226] Updated weights for policy 0, policy_version 608180 (0.0008) [2023-12-27 23:36:51,846][106226] Updated weights for policy 0, policy_version 608190 (0.0008) [2023-12-27 23:36:51,875][106225] Updated weights for policy 1, policy_version 610227 (0.0009) [2023-12-27 23:36:51,909][106226] Updated weights for policy 0, policy_version 608200 (0.0007) [2023-12-27 23:36:51,923][106225] Updated weights for policy 1, policy_version 610237 (0.0006) [2023-12-27 23:36:51,981][106225] Updated weights for policy 1, policy_version 610247 (0.0007) [2023-12-27 23:36:52,615][106225] Updated weights for policy 1, policy_version 610257 (0.0009) [2023-12-27 23:36:52,630][106226] Updated weights for policy 0, policy_version 608210 (0.0007) [2023-12-27 23:36:52,667][106225] Updated weights for policy 1, policy_version 610267 (0.0008) [2023-12-27 23:36:52,687][106226] Updated weights for policy 0, policy_version 608220 (0.0008) [2023-12-27 23:36:52,721][106225] Updated weights for policy 1, policy_version 610277 (0.0006) [2023-12-27 23:36:52,746][106226] Updated weights for policy 0, policy_version 608230 (0.0008) [2023-12-27 23:36:52,777][106225] Updated weights for policy 1, policy_version 610287 (0.0006) [2023-12-27 23:36:52,813][106226] Updated weights for policy 0, policy_version 608240 (0.0008) [2023-12-27 23:36:53,382][106225] Updated weights for policy 1, policy_version 610297 (0.0007) [2023-12-27 23:36:53,442][106225] Updated weights for policy 1, policy_version 610307 (0.0008) [2023-12-27 23:36:53,503][106225] Updated weights for policy 1, policy_version 610317 (0.0008) [2023-12-27 23:36:53,610][106226] Updated weights for policy 0, policy_version 608250 (0.0009) [2023-12-27 23:36:53,674][106226] Updated weights for policy 0, policy_version 608260 (0.0009) [2023-12-27 23:36:53,737][106226] Updated weights for policy 0, policy_version 608270 (0.0009) [2023-12-27 23:36:54,161][106225] Updated weights for policy 1, policy_version 610327 (0.0009) [2023-12-27 23:36:54,209][106225] Updated weights for policy 1, policy_version 610337 (0.0008) [2023-12-27 23:36:54,261][106225] Updated weights for policy 1, policy_version 610347 (0.0009) [2023-12-27 23:36:54,495][106226] Updated weights for policy 0, policy_version 608280 (0.0009) [2023-12-27 23:36:54,550][106226] Updated weights for policy 0, policy_version 608290 (0.0009) [2023-12-27 23:36:54,596][106226] Updated weights for policy 0, policy_version 608300 (0.0009) [2023-12-27 23:36:54,905][106225] Updated weights for policy 1, policy_version 610357 (0.0007) [2023-12-27 23:36:54,955][106225] Updated weights for policy 1, policy_version 610367 (0.0005) [2023-12-27 23:36:55,019][106225] Updated weights for policy 1, policy_version 610377 (0.0008) [2023-12-27 23:36:55,387][106226] Updated weights for policy 0, policy_version 608310 (0.0008) [2023-12-27 23:36:55,445][106226] Updated weights for policy 0, policy_version 608320 (0.0009) [2023-12-27 23:36:55,507][106226] Updated weights for policy 0, policy_version 608330 (0.0009) [2023-12-27 23:36:55,681][106225] Updated weights for policy 1, policy_version 610387 (0.0008) [2023-12-27 23:36:55,742][106225] Updated weights for policy 1, policy_version 610397 (0.0008) [2023-12-27 23:36:55,808][106225] Updated weights for policy 1, policy_version 610407 (0.0008) [2023-12-27 23:36:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 312066048. Throughput: 0: 9705.7, 1: 9912.8. Samples: 312037584. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:36:56,176][105115] Avg episode reward: [(0, '-4.424'), (1, '-6.159')] [2023-12-27 23:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000610416_156295168.pth... [2023-12-27 23:36:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000608336_155770880.pth... [2023-12-27 23:36:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000609232_155992064.pth [2023-12-27 23:36:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000607216_155484160.pth [2023-12-27 23:36:56,291][106226] Updated weights for policy 0, policy_version 608340 (0.0009) [2023-12-27 23:36:56,342][106226] Updated weights for policy 0, policy_version 608350 (0.0008) [2023-12-27 23:36:56,405][106226] Updated weights for policy 0, policy_version 608360 (0.0008) [2023-12-27 23:36:56,433][106225] Updated weights for policy 1, policy_version 610417 (0.0008) [2023-12-27 23:36:56,489][106225] Updated weights for policy 1, policy_version 610427 (0.0005) [2023-12-27 23:36:56,557][106225] Updated weights for policy 1, policy_version 610437 (0.0008) [2023-12-27 23:36:56,623][106225] Updated weights for policy 1, policy_version 610447 (0.0006) [2023-12-27 23:36:56,973][106226] Updated weights for policy 0, policy_version 608371 (0.0009) [2023-12-27 23:36:57,043][106226] Updated weights for policy 0, policy_version 608381 (0.0009) [2023-12-27 23:36:57,093][106226] Updated weights for policy 0, policy_version 608391 (0.0010) [2023-12-27 23:36:57,182][106225] Updated weights for policy 1, policy_version 610457 (0.0005) [2023-12-27 23:36:57,229][106225] Updated weights for policy 1, policy_version 610467 (0.0005) [2023-12-27 23:36:57,279][106225] Updated weights for policy 1, policy_version 610477 (0.0009) [2023-12-27 23:36:57,670][106226] Updated weights for policy 0, policy_version 608401 (0.0010) [2023-12-27 23:36:57,728][106226] Updated weights for policy 0, policy_version 608411 (0.0005) [2023-12-27 23:36:57,779][106226] Updated weights for policy 0, policy_version 608421 (0.0005) [2023-12-27 23:36:57,829][106226] Updated weights for policy 0, policy_version 608431 (0.0005) [2023-12-27 23:36:57,973][106225] Updated weights for policy 1, policy_version 610487 (0.0010) [2023-12-27 23:36:58,028][106225] Updated weights for policy 1, policy_version 610497 (0.0009) [2023-12-27 23:36:58,084][106225] Updated weights for policy 1, policy_version 610507 (0.0005) [2023-12-27 23:36:58,393][106226] Updated weights for policy 0, policy_version 608441 (0.0010) [2023-12-27 23:36:58,453][106226] Updated weights for policy 0, policy_version 608451 (0.0010) [2023-12-27 23:36:58,515][106226] Updated weights for policy 0, policy_version 608461 (0.0011) [2023-12-27 23:36:58,963][106225] Updated weights for policy 1, policy_version 610517 (0.0008) [2023-12-27 23:36:59,022][106225] Updated weights for policy 1, policy_version 610527 (0.0011) [2023-12-27 23:36:59,080][106225] Updated weights for policy 1, policy_version 610537 (0.0010) [2023-12-27 23:36:59,309][106226] Updated weights for policy 0, policy_version 608471 (0.0007) [2023-12-27 23:36:59,374][106226] Updated weights for policy 0, policy_version 608481 (0.0009) [2023-12-27 23:36:59,431][106226] Updated weights for policy 0, policy_version 608491 (0.0009) [2023-12-27 23:36:59,808][106225] Updated weights for policy 1, policy_version 610547 (0.0007) [2023-12-27 23:36:59,875][106225] Updated weights for policy 1, policy_version 610557 (0.0010) [2023-12-27 23:36:59,940][106225] Updated weights for policy 1, policy_version 610567 (0.0010) [2023-12-27 23:37:00,141][106226] Updated weights for policy 0, policy_version 608501 (0.0007) [2023-12-27 23:37:00,208][106226] Updated weights for policy 0, policy_version 608511 (0.0008) [2023-12-27 23:37:00,269][106226] Updated weights for policy 0, policy_version 608521 (0.0009) [2023-12-27 23:37:00,563][106225] Updated weights for policy 1, policy_version 610577 (0.0009) [2023-12-27 23:37:00,619][106225] Updated weights for policy 1, policy_version 610587 (0.0010) [2023-12-27 23:37:00,669][106225] Updated weights for policy 1, policy_version 610597 (0.0006) [2023-12-27 23:37:00,719][106225] Updated weights for policy 1, policy_version 610607 (0.0005) [2023-12-27 23:37:01,035][106226] Updated weights for policy 0, policy_version 608531 (0.0008) [2023-12-27 23:37:01,104][106226] Updated weights for policy 0, policy_version 608541 (0.0007) [2023-12-27 23:37:01,168][106226] Updated weights for policy 0, policy_version 608551 (0.0008) [2023-12-27 23:37:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 312164352. Throughput: 0: 9771.4, 1: 9993.3. Samples: 312159448. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:37:01,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-5.973')] [2023-12-27 23:37:01,361][106225] Updated weights for policy 1, policy_version 610617 (0.0006) [2023-12-27 23:37:01,426][106225] Updated weights for policy 1, policy_version 610627 (0.0010) [2023-12-27 23:37:01,479][106225] Updated weights for policy 1, policy_version 610637 (0.0010) [2023-12-27 23:37:01,895][106226] Updated weights for policy 0, policy_version 608561 (0.0008) [2023-12-27 23:37:01,958][106226] Updated weights for policy 0, policy_version 608571 (0.0009) [2023-12-27 23:37:02,019][106226] Updated weights for policy 0, policy_version 608581 (0.0008) [2023-12-27 23:37:02,080][106226] Updated weights for policy 0, policy_version 608591 (0.0008) [2023-12-27 23:37:02,166][106225] Updated weights for policy 1, policy_version 610647 (0.0008) [2023-12-27 23:37:02,220][106225] Updated weights for policy 1, policy_version 610657 (0.0006) [2023-12-27 23:37:02,281][106225] Updated weights for policy 1, policy_version 610667 (0.0009) [2023-12-27 23:37:02,835][106226] Updated weights for policy 0, policy_version 608601 (0.0009) [2023-12-27 23:37:02,888][106226] Updated weights for policy 0, policy_version 608611 (0.0009) [2023-12-27 23:37:02,937][106226] Updated weights for policy 0, policy_version 608621 (0.0005) [2023-12-27 23:37:02,957][106225] Updated weights for policy 1, policy_version 610677 (0.0007) [2023-12-27 23:37:03,017][106225] Updated weights for policy 1, policy_version 610687 (0.0005) [2023-12-27 23:37:03,070][106225] Updated weights for policy 1, policy_version 610697 (0.0007) [2023-12-27 23:37:03,633][106225] Updated weights for policy 1, policy_version 610707 (0.0010) [2023-12-27 23:37:03,667][106226] Updated weights for policy 0, policy_version 608631 (0.0007) [2023-12-27 23:37:03,689][106225] Updated weights for policy 1, policy_version 610717 (0.0008) [2023-12-27 23:37:03,718][106226] Updated weights for policy 0, policy_version 608641 (0.0007) [2023-12-27 23:37:03,739][106225] Updated weights for policy 1, policy_version 610727 (0.0010) [2023-12-27 23:37:03,768][106226] Updated weights for policy 0, policy_version 608651 (0.0007) [2023-12-27 23:37:04,459][106225] Updated weights for policy 1, policy_version 610737 (0.0006) [2023-12-27 23:37:04,522][106225] Updated weights for policy 1, policy_version 610747 (0.0010) [2023-12-27 23:37:04,559][106226] Updated weights for policy 0, policy_version 608661 (0.0007) [2023-12-27 23:37:04,580][106225] Updated weights for policy 1, policy_version 610757 (0.0010) [2023-12-27 23:37:04,607][106226] Updated weights for policy 0, policy_version 608671 (0.0006) [2023-12-27 23:37:04,628][106225] Updated weights for policy 1, policy_version 610767 (0.0010) [2023-12-27 23:37:04,655][106226] Updated weights for policy 0, policy_version 608681 (0.0007) [2023-12-27 23:37:05,289][106225] Updated weights for policy 1, policy_version 610777 (0.0008) [2023-12-27 23:37:05,335][106225] Updated weights for policy 1, policy_version 610787 (0.0008) [2023-12-27 23:37:05,386][106225] Updated weights for policy 1, policy_version 610798 (0.0009) [2023-12-27 23:37:05,420][106226] Updated weights for policy 0, policy_version 608691 (0.0008) [2023-12-27 23:37:05,484][106226] Updated weights for policy 0, policy_version 608701 (0.0008) [2023-12-27 23:37:05,536][106226] Updated weights for policy 0, policy_version 608711 (0.0008) [2023-12-27 23:37:06,003][106225] Updated weights for policy 1, policy_version 610808 (0.0007) [2023-12-27 23:37:06,069][106225] Updated weights for policy 1, policy_version 610818 (0.0009) [2023-12-27 23:37:06,132][106225] Updated weights for policy 1, policy_version 610828 (0.0009) [2023-12-27 23:37:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 312270848. Throughput: 0: 9692.0, 1: 10030.2. Samples: 312277988. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:37:06,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-5.888')] [2023-12-27 23:37:06,328][106226] Updated weights for policy 0, policy_version 608721 (0.0008) [2023-12-27 23:37:06,383][106226] Updated weights for policy 0, policy_version 608731 (0.0010) [2023-12-27 23:37:06,441][106226] Updated weights for policy 0, policy_version 608741 (0.0010) [2023-12-27 23:37:06,510][106226] Updated weights for policy 0, policy_version 608751 (0.0010) [2023-12-27 23:37:06,856][106225] Updated weights for policy 1, policy_version 610838 (0.0010) [2023-12-27 23:37:06,912][106225] Updated weights for policy 1, policy_version 610848 (0.0010) [2023-12-27 23:37:06,970][106225] Updated weights for policy 1, policy_version 610858 (0.0010) [2023-12-27 23:37:07,229][106226] Updated weights for policy 0, policy_version 608761 (0.0006) [2023-12-27 23:37:07,285][106226] Updated weights for policy 0, policy_version 608771 (0.0005) [2023-12-27 23:37:07,340][106226] Updated weights for policy 0, policy_version 608781 (0.0005) [2023-12-27 23:37:07,637][106225] Updated weights for policy 1, policy_version 610868 (0.0008) [2023-12-27 23:37:07,693][106225] Updated weights for policy 1, policy_version 610878 (0.0005) [2023-12-27 23:37:07,756][106225] Updated weights for policy 1, policy_version 610888 (0.0008) [2023-12-27 23:37:08,021][106226] Updated weights for policy 0, policy_version 608791 (0.0007) [2023-12-27 23:37:08,069][106226] Updated weights for policy 0, policy_version 608801 (0.0008) [2023-12-27 23:37:08,127][106226] Updated weights for policy 0, policy_version 608811 (0.0008) [2023-12-27 23:37:08,429][106225] Updated weights for policy 1, policy_version 610898 (0.0009) [2023-12-27 23:37:08,493][106225] Updated weights for policy 1, policy_version 610908 (0.0009) [2023-12-27 23:37:08,556][106225] Updated weights for policy 1, policy_version 610918 (0.0008) [2023-12-27 23:37:08,616][106225] Updated weights for policy 1, policy_version 610928 (0.0009) [2023-12-27 23:37:08,886][106226] Updated weights for policy 0, policy_version 608821 (0.0009) [2023-12-27 23:37:08,947][106226] Updated weights for policy 0, policy_version 608831 (0.0008) [2023-12-27 23:37:09,007][106226] Updated weights for policy 0, policy_version 608841 (0.0008) [2023-12-27 23:37:09,344][106225] Updated weights for policy 1, policy_version 610938 (0.0007) [2023-12-27 23:37:09,419][106225] Updated weights for policy 1, policy_version 610948 (0.0007) [2023-12-27 23:37:09,476][106225] Updated weights for policy 1, policy_version 610958 (0.0006) [2023-12-27 23:37:09,756][106226] Updated weights for policy 0, policy_version 608851 (0.0009) [2023-12-27 23:37:09,810][106226] Updated weights for policy 0, policy_version 608861 (0.0008) [2023-12-27 23:37:09,872][106226] Updated weights for policy 0, policy_version 608871 (0.0008) [2023-12-27 23:37:10,181][106225] Updated weights for policy 1, policy_version 610968 (0.0007) [2023-12-27 23:37:10,242][106225] Updated weights for policy 1, policy_version 610978 (0.0010) [2023-12-27 23:37:10,301][106225] Updated weights for policy 1, policy_version 610988 (0.0010) [2023-12-27 23:37:10,655][106226] Updated weights for policy 0, policy_version 608881 (0.0006) [2023-12-27 23:37:10,719][106226] Updated weights for policy 0, policy_version 608891 (0.0008) [2023-12-27 23:37:10,782][106226] Updated weights for policy 0, policy_version 608901 (0.0007) [2023-12-27 23:37:10,844][106226] Updated weights for policy 0, policy_version 608911 (0.0008) [2023-12-27 23:37:11,052][106225] Updated weights for policy 1, policy_version 610998 (0.0010) [2023-12-27 23:37:11,118][106225] Updated weights for policy 1, policy_version 611008 (0.0007) [2023-12-27 23:37:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 312360960. Throughput: 0: 9700.9, 1: 10075.1. Samples: 312336352. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:37:11,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.632')] [2023-12-27 23:37:11,182][106225] Updated weights for policy 1, policy_version 611018 (0.0010) [2023-12-27 23:37:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000608912_155918336.pth... [2023-12-27 23:37:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000607792_155631616.pth [2023-12-27 23:37:11,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000611024_156450816.pth... [2023-12-27 23:37:11,220][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000609840_156147712.pth [2023-12-27 23:37:11,606][106226] Updated weights for policy 0, policy_version 608921 (0.0009) [2023-12-27 23:37:11,678][106226] Updated weights for policy 0, policy_version 608931 (0.0010) [2023-12-27 23:37:11,747][106226] Updated weights for policy 0, policy_version 608941 (0.0008) [2023-12-27 23:37:12,002][106225] Updated weights for policy 1, policy_version 611028 (0.0010) [2023-12-27 23:37:12,064][106225] Updated weights for policy 1, policy_version 611038 (0.0009) [2023-12-27 23:37:12,132][106225] Updated weights for policy 1, policy_version 611048 (0.0006) [2023-12-27 23:37:12,515][106226] Updated weights for policy 0, policy_version 608951 (0.0006) [2023-12-27 23:37:12,578][106226] Updated weights for policy 0, policy_version 608961 (0.0006) [2023-12-27 23:37:12,640][106226] Updated weights for policy 0, policy_version 608971 (0.0005) [2023-12-27 23:37:12,863][106225] Updated weights for policy 1, policy_version 611058 (0.0008) [2023-12-27 23:37:12,925][106225] Updated weights for policy 1, policy_version 611068 (0.0005) [2023-12-27 23:37:12,995][106225] Updated weights for policy 1, policy_version 611078 (0.0005) [2023-12-27 23:37:13,063][106225] Updated weights for policy 1, policy_version 611088 (0.0006) [2023-12-27 23:37:13,201][106226] Updated weights for policy 0, policy_version 608981 (0.0007) [2023-12-27 23:37:13,255][106226] Updated weights for policy 0, policy_version 608991 (0.0008) [2023-12-27 23:37:13,308][106226] Updated weights for policy 0, policy_version 609001 (0.0010) [2023-12-27 23:37:13,743][106225] Updated weights for policy 1, policy_version 611098 (0.0008) [2023-12-27 23:37:13,810][106225] Updated weights for policy 1, policy_version 611108 (0.0008) [2023-12-27 23:37:13,870][106225] Updated weights for policy 1, policy_version 611118 (0.0008) [2023-12-27 23:37:13,895][106226] Updated weights for policy 0, policy_version 609011 (0.0010) [2023-12-27 23:37:13,957][106226] Updated weights for policy 0, policy_version 609021 (0.0010) [2023-12-27 23:37:14,020][106226] Updated weights for policy 0, policy_version 609031 (0.0010) [2023-12-27 23:37:14,477][106225] Updated weights for policy 1, policy_version 611128 (0.0010) [2023-12-27 23:37:14,530][106225] Updated weights for policy 1, policy_version 611138 (0.0010) [2023-12-27 23:37:14,592][106225] Updated weights for policy 1, policy_version 611148 (0.0010) [2023-12-27 23:37:14,691][106226] Updated weights for policy 0, policy_version 609041 (0.0010) [2023-12-27 23:37:14,747][106226] Updated weights for policy 0, policy_version 609051 (0.0008) [2023-12-27 23:37:14,812][106226] Updated weights for policy 0, policy_version 609061 (0.0008) [2023-12-27 23:37:14,874][106226] Updated weights for policy 0, policy_version 609071 (0.0006) [2023-12-27 23:37:15,361][106225] Updated weights for policy 1, policy_version 611158 (0.0009) [2023-12-27 23:37:15,417][106225] Updated weights for policy 1, policy_version 611168 (0.0008) [2023-12-27 23:37:15,473][106225] Updated weights for policy 1, policy_version 611178 (0.0009) [2023-12-27 23:37:15,517][106226] Updated weights for policy 0, policy_version 609081 (0.0007) [2023-12-27 23:37:15,577][106226] Updated weights for policy 0, policy_version 609091 (0.0008) [2023-12-27 23:37:15,637][106226] Updated weights for policy 0, policy_version 609101 (0.0008) [2023-12-27 23:37:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 312459264. Throughput: 0: 9673.0, 1: 10043.7. Samples: 312453920. Policy #0 lag: (min: 12.0, avg: 18.1, max: 44.0) [2023-12-27 23:37:16,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-5.957')] [2023-12-27 23:37:16,215][106225] Updated weights for policy 1, policy_version 611188 (0.0010) [2023-12-27 23:37:16,272][106225] Updated weights for policy 1, policy_version 611198 (0.0010) [2023-12-27 23:37:16,333][106225] Updated weights for policy 1, policy_version 611208 (0.0010) [2023-12-27 23:37:16,373][106226] Updated weights for policy 0, policy_version 609111 (0.0006) [2023-12-27 23:37:16,437][106226] Updated weights for policy 0, policy_version 609121 (0.0009) [2023-12-27 23:37:16,492][106226] Updated weights for policy 0, policy_version 609131 (0.0008) [2023-12-27 23:37:17,053][106225] Updated weights for policy 1, policy_version 611218 (0.0010) [2023-12-27 23:37:17,122][106225] Updated weights for policy 1, policy_version 611228 (0.0010) [2023-12-27 23:37:17,171][106226] Updated weights for policy 0, policy_version 609141 (0.0006) [2023-12-27 23:37:17,188][106225] Updated weights for policy 1, policy_version 611238 (0.0009) [2023-12-27 23:37:17,226][106226] Updated weights for policy 0, policy_version 609151 (0.0007) [2023-12-27 23:37:17,243][106225] Updated weights for policy 1, policy_version 611248 (0.0006) [2023-12-27 23:37:17,282][106226] Updated weights for policy 0, policy_version 609161 (0.0007) [2023-12-27 23:37:17,905][106225] Updated weights for policy 1, policy_version 611258 (0.0010) [2023-12-27 23:37:17,935][106226] Updated weights for policy 0, policy_version 609171 (0.0007) [2023-12-27 23:37:17,956][106225] Updated weights for policy 1, policy_version 611268 (0.0010) [2023-12-27 23:37:17,990][106226] Updated weights for policy 0, policy_version 609181 (0.0006) [2023-12-27 23:37:18,000][106225] Updated weights for policy 1, policy_version 611278 (0.0010) [2023-12-27 23:37:18,048][106226] Updated weights for policy 0, policy_version 609191 (0.0008) [2023-12-27 23:37:18,726][106225] Updated weights for policy 1, policy_version 611288 (0.0009) [2023-12-27 23:37:18,795][106225] Updated weights for policy 1, policy_version 611298 (0.0008) [2023-12-27 23:37:18,801][106226] Updated weights for policy 0, policy_version 609201 (0.0008) [2023-12-27 23:37:18,855][106225] Updated weights for policy 1, policy_version 611308 (0.0006) [2023-12-27 23:37:18,857][106226] Updated weights for policy 0, policy_version 609211 (0.0006) [2023-12-27 23:37:18,918][106226] Updated weights for policy 0, policy_version 609221 (0.0007) [2023-12-27 23:37:18,965][106226] Updated weights for policy 0, policy_version 609231 (0.0008) [2023-12-27 23:37:19,544][106225] Updated weights for policy 1, policy_version 611318 (0.0009) [2023-12-27 23:37:19,599][106225] Updated weights for policy 1, policy_version 611328 (0.0010) [2023-12-27 23:37:19,620][106226] Updated weights for policy 0, policy_version 609241 (0.0006) [2023-12-27 23:37:19,657][106225] Updated weights for policy 1, policy_version 611338 (0.0010) [2023-12-27 23:37:19,683][106226] Updated weights for policy 0, policy_version 609251 (0.0006) [2023-12-27 23:37:19,744][106226] Updated weights for policy 0, policy_version 609261 (0.0008) [2023-12-27 23:37:20,395][106225] Updated weights for policy 1, policy_version 611348 (0.0010) [2023-12-27 23:37:20,454][106225] Updated weights for policy 1, policy_version 611358 (0.0010) [2023-12-27 23:37:20,513][106225] Updated weights for policy 1, policy_version 611368 (0.0011) [2023-12-27 23:37:20,523][106226] Updated weights for policy 0, policy_version 609271 (0.0007) [2023-12-27 23:37:20,582][106226] Updated weights for policy 0, policy_version 609281 (0.0006) [2023-12-27 23:37:20,642][106226] Updated weights for policy 0, policy_version 609291 (0.0009) [2023-12-27 23:37:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 312557568. Throughput: 0: 9665.1, 1: 9913.7. Samples: 312569428. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:21,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-6.119')] [2023-12-27 23:37:21,245][106225] Updated weights for policy 1, policy_version 611378 (0.0011) [2023-12-27 23:37:21,309][106225] Updated weights for policy 1, policy_version 611388 (0.0011) [2023-12-27 23:37:21,378][106225] Updated weights for policy 1, policy_version 611398 (0.0009) [2023-12-27 23:37:21,440][106226] Updated weights for policy 0, policy_version 609301 (0.0007) [2023-12-27 23:37:21,443][106225] Updated weights for policy 1, policy_version 611408 (0.0011) [2023-12-27 23:37:21,506][106226] Updated weights for policy 0, policy_version 609311 (0.0009) [2023-12-27 23:37:21,571][106226] Updated weights for policy 0, policy_version 609321 (0.0009) [2023-12-27 23:37:22,266][106225] Updated weights for policy 1, policy_version 611418 (0.0009) [2023-12-27 23:37:22,331][106225] Updated weights for policy 1, policy_version 611428 (0.0009) [2023-12-27 23:37:22,351][106226] Updated weights for policy 0, policy_version 609331 (0.0009) [2023-12-27 23:37:22,399][106225] Updated weights for policy 1, policy_version 611438 (0.0009) [2023-12-27 23:37:22,410][106226] Updated weights for policy 0, policy_version 609341 (0.0007) [2023-12-27 23:37:22,459][106226] Updated weights for policy 0, policy_version 609351 (0.0009) [2023-12-27 23:37:23,037][106225] Updated weights for policy 1, policy_version 611448 (0.0007) [2023-12-27 23:37:23,097][106225] Updated weights for policy 1, policy_version 611458 (0.0010) [2023-12-27 23:37:23,157][106225] Updated weights for policy 1, policy_version 611468 (0.0010) [2023-12-27 23:37:23,260][106226] Updated weights for policy 0, policy_version 609361 (0.0010) [2023-12-27 23:37:23,313][106226] Updated weights for policy 0, policy_version 609371 (0.0010) [2023-12-27 23:37:23,368][106226] Updated weights for policy 0, policy_version 609381 (0.0010) [2023-12-27 23:37:23,427][106226] Updated weights for policy 0, policy_version 609391 (0.0010) [2023-12-27 23:37:23,783][106225] Updated weights for policy 1, policy_version 611478 (0.0007) [2023-12-27 23:37:23,847][106225] Updated weights for policy 1, policy_version 611488 (0.0010) [2023-12-27 23:37:23,893][106225] Updated weights for policy 1, policy_version 611498 (0.0005) [2023-12-27 23:37:24,066][106226] Updated weights for policy 0, policy_version 609401 (0.0007) [2023-12-27 23:37:24,137][106226] Updated weights for policy 0, policy_version 609411 (0.0007) [2023-12-27 23:37:24,184][106226] Updated weights for policy 0, policy_version 609421 (0.0010) [2023-12-27 23:37:24,423][106225] Updated weights for policy 1, policy_version 611508 (0.0005) [2023-12-27 23:37:24,480][106225] Updated weights for policy 1, policy_version 611518 (0.0006) [2023-12-27 23:37:24,535][106225] Updated weights for policy 1, policy_version 611528 (0.0009) [2023-12-27 23:37:24,869][106226] Updated weights for policy 0, policy_version 609431 (0.0009) [2023-12-27 23:37:24,918][106226] Updated weights for policy 0, policy_version 609441 (0.0010) [2023-12-27 23:37:24,964][106226] Updated weights for policy 0, policy_version 609451 (0.0010) [2023-12-27 23:37:25,209][106225] Updated weights for policy 1, policy_version 611538 (0.0010) [2023-12-27 23:37:25,267][106225] Updated weights for policy 1, policy_version 611548 (0.0010) [2023-12-27 23:37:25,324][106225] Updated weights for policy 1, policy_version 611558 (0.0010) [2023-12-27 23:37:25,380][106225] Updated weights for policy 1, policy_version 611568 (0.0010) [2023-12-27 23:37:25,631][106226] Updated weights for policy 0, policy_version 609461 (0.0009) [2023-12-27 23:37:25,693][106226] Updated weights for policy 0, policy_version 609471 (0.0008) [2023-12-27 23:37:25,752][106226] Updated weights for policy 0, policy_version 609481 (0.0006) [2023-12-27 23:37:26,144][106225] Updated weights for policy 1, policy_version 611578 (0.0006) [2023-12-27 23:37:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 312655872. Throughput: 0: 9686.6, 1: 9907.5. Samples: 312627040. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:26,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-5.980')] [2023-12-27 23:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000609488_156065792.pth... [2023-12-27 23:37:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000608336_155770880.pth [2023-12-27 23:37:26,207][106225] Updated weights for policy 1, policy_version 611588 (0.0008) [2023-12-27 23:37:26,259][106225] Updated weights for policy 1, policy_version 611598 (0.0008) [2023-12-27 23:37:26,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000611600_156598272.pth... [2023-12-27 23:37:26,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000610416_156295168.pth [2023-12-27 23:37:26,419][106226] Updated weights for policy 0, policy_version 609491 (0.0007) [2023-12-27 23:37:26,491][106226] Updated weights for policy 0, policy_version 609501 (0.0008) [2023-12-27 23:37:26,547][106226] Updated weights for policy 0, policy_version 609511 (0.0007) [2023-12-27 23:37:26,849][106225] Updated weights for policy 1, policy_version 611608 (0.0006) [2023-12-27 23:37:26,898][106225] Updated weights for policy 1, policy_version 611618 (0.0005) [2023-12-27 23:37:26,946][106225] Updated weights for policy 1, policy_version 611628 (0.0005) [2023-12-27 23:37:27,120][106226] Updated weights for policy 0, policy_version 609521 (0.0006) [2023-12-27 23:37:27,170][106226] Updated weights for policy 0, policy_version 609531 (0.0009) [2023-12-27 23:37:27,230][106226] Updated weights for policy 0, policy_version 609541 (0.0008) [2023-12-27 23:37:27,280][106226] Updated weights for policy 0, policy_version 609551 (0.0009) [2023-12-27 23:37:27,503][106225] Updated weights for policy 1, policy_version 611638 (0.0007) [2023-12-27 23:37:27,554][106225] Updated weights for policy 1, policy_version 611648 (0.0005) [2023-12-27 23:37:27,610][106225] Updated weights for policy 1, policy_version 611658 (0.0005) [2023-12-27 23:37:27,942][106226] Updated weights for policy 0, policy_version 609561 (0.0006) [2023-12-27 23:37:28,007][106226] Updated weights for policy 0, policy_version 609571 (0.0008) [2023-12-27 23:37:28,054][106226] Updated weights for policy 0, policy_version 609581 (0.0008) [2023-12-27 23:37:28,145][106225] Updated weights for policy 1, policy_version 611668 (0.0005) [2023-12-27 23:37:28,192][106225] Updated weights for policy 1, policy_version 611678 (0.0006) [2023-12-27 23:37:28,250][106225] Updated weights for policy 1, policy_version 611688 (0.0008) [2023-12-27 23:37:28,771][106226] Updated weights for policy 0, policy_version 609591 (0.0008) [2023-12-27 23:37:28,823][106225] Updated weights for policy 1, policy_version 611698 (0.0006) [2023-12-27 23:37:28,828][106226] Updated weights for policy 0, policy_version 609601 (0.0010) [2023-12-27 23:37:28,884][106225] Updated weights for policy 1, policy_version 611708 (0.0005) [2023-12-27 23:37:28,886][106226] Updated weights for policy 0, policy_version 609611 (0.0007) [2023-12-27 23:37:28,942][106225] Updated weights for policy 1, policy_version 611718 (0.0009) [2023-12-27 23:37:29,030][106225] Updated weights for policy 1, policy_version 611728 (0.0009) [2023-12-27 23:37:29,601][106226] Updated weights for policy 0, policy_version 609621 (0.0009) [2023-12-27 23:37:29,667][106226] Updated weights for policy 0, policy_version 609631 (0.0009) [2023-12-27 23:37:29,721][106226] Updated weights for policy 0, policy_version 609641 (0.0007) [2023-12-27 23:37:29,735][106225] Updated weights for policy 1, policy_version 611738 (0.0008) [2023-12-27 23:37:29,797][106225] Updated weights for policy 1, policy_version 611748 (0.0009) [2023-12-27 23:37:29,882][106225] Updated weights for policy 1, policy_version 611758 (0.0007) [2023-12-27 23:37:30,388][106226] Updated weights for policy 0, policy_version 609651 (0.0009) [2023-12-27 23:37:30,458][106226] Updated weights for policy 0, policy_version 609661 (0.0007) [2023-12-27 23:37:30,512][106226] Updated weights for policy 0, policy_version 609671 (0.0008) [2023-12-27 23:37:30,581][106225] Updated weights for policy 1, policy_version 611768 (0.0006) [2023-12-27 23:37:30,641][106225] Updated weights for policy 1, policy_version 611778 (0.0008) [2023-12-27 23:37:30,692][106225] Updated weights for policy 1, policy_version 611788 (0.0009) [2023-12-27 23:37:31,090][106226] Updated weights for policy 0, policy_version 609681 (0.0006) [2023-12-27 23:37:31,151][106226] Updated weights for policy 0, policy_version 609691 (0.0009) [2023-12-27 23:37:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 312762368. Throughput: 0: 9759.4, 1: 10120.6. Samples: 312754752. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:31,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-5.752')] [2023-12-27 23:37:31,209][106226] Updated weights for policy 0, policy_version 609701 (0.0009) [2023-12-27 23:37:31,267][106226] Updated weights for policy 0, policy_version 609711 (0.0008) [2023-12-27 23:37:31,434][106225] Updated weights for policy 1, policy_version 611798 (0.0008) [2023-12-27 23:37:31,498][106225] Updated weights for policy 1, policy_version 611808 (0.0006) [2023-12-27 23:37:31,561][106225] Updated weights for policy 1, policy_version 611818 (0.0007) [2023-12-27 23:37:31,947][106226] Updated weights for policy 0, policy_version 609721 (0.0009) [2023-12-27 23:37:32,006][106226] Updated weights for policy 0, policy_version 609731 (0.0008) [2023-12-27 23:37:32,064][106226] Updated weights for policy 0, policy_version 609741 (0.0008) [2023-12-27 23:37:32,280][106225] Updated weights for policy 1, policy_version 611828 (0.0010) [2023-12-27 23:37:32,337][106225] Updated weights for policy 1, policy_version 611838 (0.0010) [2023-12-27 23:37:32,397][106225] Updated weights for policy 1, policy_version 611848 (0.0010) [2023-12-27 23:37:32,741][106226] Updated weights for policy 0, policy_version 609751 (0.0006) [2023-12-27 23:37:32,813][106226] Updated weights for policy 0, policy_version 609761 (0.0008) [2023-12-27 23:37:32,873][106226] Updated weights for policy 0, policy_version 609771 (0.0009) [2023-12-27 23:37:33,065][106225] Updated weights for policy 1, policy_version 611858 (0.0008) [2023-12-27 23:37:33,124][106225] Updated weights for policy 1, policy_version 611868 (0.0008) [2023-12-27 23:37:33,192][106225] Updated weights for policy 1, policy_version 611878 (0.0009) [2023-12-27 23:37:33,238][106225] Updated weights for policy 1, policy_version 611888 (0.0007) [2023-12-27 23:37:33,444][106226] Updated weights for policy 0, policy_version 609781 (0.0007) [2023-12-27 23:37:33,499][106226] Updated weights for policy 0, policy_version 609791 (0.0005) [2023-12-27 23:37:33,544][106226] Updated weights for policy 0, policy_version 609801 (0.0005) [2023-12-27 23:37:33,904][106225] Updated weights for policy 1, policy_version 611898 (0.0005) [2023-12-27 23:37:33,961][106225] Updated weights for policy 1, policy_version 611908 (0.0005) [2023-12-27 23:37:34,021][106225] Updated weights for policy 1, policy_version 611918 (0.0005) [2023-12-27 23:37:34,100][106226] Updated weights for policy 0, policy_version 609811 (0.0006) [2023-12-27 23:37:34,178][106226] Updated weights for policy 0, policy_version 609821 (0.0006) [2023-12-27 23:37:34,243][106226] Updated weights for policy 0, policy_version 609831 (0.0008) [2023-12-27 23:37:34,673][106225] Updated weights for policy 1, policy_version 611928 (0.0009) [2023-12-27 23:37:34,747][106225] Updated weights for policy 1, policy_version 611938 (0.0010) [2023-12-27 23:37:34,816][106225] Updated weights for policy 1, policy_version 611948 (0.0010) [2023-12-27 23:37:34,921][106226] Updated weights for policy 0, policy_version 609841 (0.0009) [2023-12-27 23:37:34,971][106226] Updated weights for policy 0, policy_version 609851 (0.0008) [2023-12-27 23:37:35,022][106226] Updated weights for policy 0, policy_version 609861 (0.0008) [2023-12-27 23:37:35,071][106226] Updated weights for policy 0, policy_version 609871 (0.0007) [2023-12-27 23:37:35,494][106225] Updated weights for policy 1, policy_version 611958 (0.0010) [2023-12-27 23:37:35,552][106225] Updated weights for policy 1, policy_version 611968 (0.0005) [2023-12-27 23:37:35,606][106225] Updated weights for policy 1, policy_version 611978 (0.0005) [2023-12-27 23:37:35,832][106226] Updated weights for policy 0, policy_version 609881 (0.0009) [2023-12-27 23:37:35,888][106226] Updated weights for policy 0, policy_version 609891 (0.0008) [2023-12-27 23:37:35,948][106226] Updated weights for policy 0, policy_version 609901 (0.0005) [2023-12-27 23:37:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 312868864. Throughput: 0: 9864.6, 1: 10117.1. Samples: 312878180. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:36,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-5.821')] [2023-12-27 23:37:36,233][106225] Updated weights for policy 1, policy_version 611988 (0.0007) [2023-12-27 23:37:36,294][106225] Updated weights for policy 1, policy_version 611998 (0.0008) [2023-12-27 23:37:36,355][106225] Updated weights for policy 1, policy_version 612008 (0.0009) [2023-12-27 23:37:36,575][106226] Updated weights for policy 0, policy_version 609911 (0.0008) [2023-12-27 23:37:36,644][106226] Updated weights for policy 0, policy_version 609921 (0.0009) [2023-12-27 23:37:36,712][106226] Updated weights for policy 0, policy_version 609931 (0.0009) [2023-12-27 23:37:37,084][106225] Updated weights for policy 1, policy_version 612018 (0.0008) [2023-12-27 23:37:37,133][106225] Updated weights for policy 1, policy_version 612028 (0.0006) [2023-12-27 23:37:37,182][106225] Updated weights for policy 1, policy_version 612038 (0.0005) [2023-12-27 23:37:37,235][106225] Updated weights for policy 1, policy_version 612048 (0.0005) [2023-12-27 23:37:37,453][106226] Updated weights for policy 0, policy_version 609941 (0.0008) [2023-12-27 23:37:37,511][106226] Updated weights for policy 0, policy_version 609951 (0.0009) [2023-12-27 23:37:37,575][106226] Updated weights for policy 0, policy_version 609961 (0.0009) [2023-12-27 23:37:37,918][106225] Updated weights for policy 1, policy_version 612058 (0.0009) [2023-12-27 23:37:37,966][106225] Updated weights for policy 1, policy_version 612068 (0.0008) [2023-12-27 23:37:38,027][106225] Updated weights for policy 1, policy_version 612078 (0.0008) [2023-12-27 23:37:38,276][106226] Updated weights for policy 0, policy_version 609971 (0.0009) [2023-12-27 23:37:38,333][106226] Updated weights for policy 0, policy_version 609981 (0.0009) [2023-12-27 23:37:38,401][106226] Updated weights for policy 0, policy_version 609991 (0.0007) [2023-12-27 23:37:38,777][106225] Updated weights for policy 1, policy_version 612088 (0.0009) [2023-12-27 23:37:38,836][106225] Updated weights for policy 1, policy_version 612098 (0.0008) [2023-12-27 23:37:38,898][106225] Updated weights for policy 1, policy_version 612108 (0.0009) [2023-12-27 23:37:39,110][106226] Updated weights for policy 0, policy_version 610001 (0.0008) [2023-12-27 23:37:39,160][106226] Updated weights for policy 0, policy_version 610011 (0.0005) [2023-12-27 23:37:39,227][106226] Updated weights for policy 0, policy_version 610021 (0.0007) [2023-12-27 23:37:39,297][106226] Updated weights for policy 0, policy_version 610031 (0.0009) [2023-12-27 23:37:39,740][106225] Updated weights for policy 1, policy_version 612118 (0.0008) [2023-12-27 23:37:39,797][106225] Updated weights for policy 1, policy_version 612128 (0.0008) [2023-12-27 23:37:39,863][106225] Updated weights for policy 1, policy_version 612138 (0.0009) [2023-12-27 23:37:40,004][106226] Updated weights for policy 0, policy_version 610041 (0.0008) [2023-12-27 23:37:40,060][106226] Updated weights for policy 0, policy_version 610051 (0.0008) [2023-12-27 23:37:40,112][106226] Updated weights for policy 0, policy_version 610061 (0.0008) [2023-12-27 23:37:40,651][106225] Updated weights for policy 1, policy_version 612148 (0.0008) [2023-12-27 23:37:40,731][106225] Updated weights for policy 1, policy_version 612158 (0.0009) [2023-12-27 23:37:40,796][106225] Updated weights for policy 1, policy_version 612168 (0.0008) [2023-12-27 23:37:40,837][106226] Updated weights for policy 0, policy_version 610071 (0.0007) [2023-12-27 23:37:40,895][106226] Updated weights for policy 0, policy_version 610081 (0.0008) [2023-12-27 23:37:40,956][106226] Updated weights for policy 0, policy_version 610091 (0.0009) [2023-12-27 23:37:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 312967168. Throughput: 0: 9902.9, 1: 10100.5. Samples: 312937732. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:41,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-6.206')] [2023-12-27 23:37:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000612176_156745728.pth... [2023-12-27 23:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000610096_156221440.pth... [2023-12-27 23:37:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000611024_156450816.pth [2023-12-27 23:37:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000608912_155918336.pth [2023-12-27 23:37:41,571][106225] Updated weights for policy 1, policy_version 612178 (0.0007) [2023-12-27 23:37:41,643][106225] Updated weights for policy 1, policy_version 612188 (0.0007) [2023-12-27 23:37:41,675][106226] Updated weights for policy 0, policy_version 610101 (0.0008) [2023-12-27 23:37:41,709][106225] Updated weights for policy 1, policy_version 612198 (0.0007) [2023-12-27 23:37:41,747][106226] Updated weights for policy 0, policy_version 610111 (0.0007) [2023-12-27 23:37:41,771][106225] Updated weights for policy 1, policy_version 612208 (0.0007) [2023-12-27 23:37:41,819][106226] Updated weights for policy 0, policy_version 610121 (0.0007) [2023-12-27 23:37:42,418][106226] Updated weights for policy 0, policy_version 610131 (0.0008) [2023-12-27 23:37:42,480][106226] Updated weights for policy 0, policy_version 610141 (0.0008) [2023-12-27 23:37:42,525][106225] Updated weights for policy 1, policy_version 612218 (0.0008) [2023-12-27 23:37:42,541][106226] Updated weights for policy 0, policy_version 610151 (0.0008) [2023-12-27 23:37:42,586][106225] Updated weights for policy 1, policy_version 612228 (0.0007) [2023-12-27 23:37:42,647][106225] Updated weights for policy 1, policy_version 612238 (0.0008) [2023-12-27 23:37:43,217][106226] Updated weights for policy 0, policy_version 610161 (0.0007) [2023-12-27 23:37:43,270][106226] Updated weights for policy 0, policy_version 610171 (0.0008) [2023-12-27 23:37:43,323][106226] Updated weights for policy 0, policy_version 610181 (0.0006) [2023-12-27 23:37:43,376][106225] Updated weights for policy 1, policy_version 612248 (0.0007) [2023-12-27 23:37:43,378][106226] Updated weights for policy 0, policy_version 610191 (0.0006) [2023-12-27 23:37:43,430][106225] Updated weights for policy 1, policy_version 612258 (0.0007) [2023-12-27 23:37:43,491][106225] Updated weights for policy 1, policy_version 612268 (0.0008) [2023-12-27 23:37:44,066][106226] Updated weights for policy 0, policy_version 610201 (0.0008) [2023-12-27 23:37:44,119][106226] Updated weights for policy 0, policy_version 610211 (0.0009) [2023-12-27 23:37:44,181][106226] Updated weights for policy 0, policy_version 610221 (0.0008) [2023-12-27 23:37:44,220][106225] Updated weights for policy 1, policy_version 612278 (0.0008) [2023-12-27 23:37:44,271][106225] Updated weights for policy 1, policy_version 612288 (0.0008) [2023-12-27 23:37:44,329][106225] Updated weights for policy 1, policy_version 612298 (0.0009) [2023-12-27 23:37:44,908][106226] Updated weights for policy 0, policy_version 610231 (0.0007) [2023-12-27 23:37:44,972][106226] Updated weights for policy 0, policy_version 610241 (0.0009) [2023-12-27 23:37:45,035][106226] Updated weights for policy 0, policy_version 610251 (0.0009) [2023-12-27 23:37:45,056][106225] Updated weights for policy 1, policy_version 612308 (0.0007) [2023-12-27 23:37:45,122][106225] Updated weights for policy 1, policy_version 612318 (0.0006) [2023-12-27 23:37:45,185][106225] Updated weights for policy 1, policy_version 612328 (0.0009) [2023-12-27 23:37:45,746][106226] Updated weights for policy 0, policy_version 610261 (0.0009) [2023-12-27 23:37:45,805][106226] Updated weights for policy 0, policy_version 610271 (0.0009) [2023-12-27 23:37:45,856][106225] Updated weights for policy 1, policy_version 612338 (0.0008) [2023-12-27 23:37:45,865][106226] Updated weights for policy 0, policy_version 610281 (0.0009) [2023-12-27 23:37:45,917][106225] Updated weights for policy 1, policy_version 612348 (0.0007) [2023-12-27 23:37:45,979][106225] Updated weights for policy 1, policy_version 612358 (0.0009) [2023-12-27 23:37:46,036][106225] Updated weights for policy 1, policy_version 612368 (0.0008) [2023-12-27 23:37:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 313065472. Throughput: 0: 9868.2, 1: 9944.5. Samples: 313051020. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:46,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-5.891')] [2023-12-27 23:37:46,573][106226] Updated weights for policy 0, policy_version 610291 (0.0009) [2023-12-27 23:37:46,629][106226] Updated weights for policy 0, policy_version 610301 (0.0009) [2023-12-27 23:37:46,680][106226] Updated weights for policy 0, policy_version 610311 (0.0008) [2023-12-27 23:37:46,747][106225] Updated weights for policy 1, policy_version 612378 (0.0006) [2023-12-27 23:37:46,802][106225] Updated weights for policy 1, policy_version 612388 (0.0008) [2023-12-27 23:37:46,863][106225] Updated weights for policy 1, policy_version 612398 (0.0009) [2023-12-27 23:37:47,279][106226] Updated weights for policy 0, policy_version 610321 (0.0008) [2023-12-27 23:37:47,333][106226] Updated weights for policy 0, policy_version 610331 (0.0010) [2023-12-27 23:37:47,397][106226] Updated weights for policy 0, policy_version 610341 (0.0006) [2023-12-27 23:37:47,450][106226] Updated weights for policy 0, policy_version 610351 (0.0006) [2023-12-27 23:37:47,675][106225] Updated weights for policy 1, policy_version 612408 (0.0008) [2023-12-27 23:37:47,724][106225] Updated weights for policy 1, policy_version 612418 (0.0009) [2023-12-27 23:37:47,782][106225] Updated weights for policy 1, policy_version 612428 (0.0008) [2023-12-27 23:37:48,073][106226] Updated weights for policy 0, policy_version 610362 (0.0008) [2023-12-27 23:37:48,125][106226] Updated weights for policy 0, policy_version 610372 (0.0009) [2023-12-27 23:37:48,180][106226] Updated weights for policy 0, policy_version 610382 (0.0008) [2023-12-27 23:37:48,523][106225] Updated weights for policy 1, policy_version 612438 (0.0009) [2023-12-27 23:37:48,584][106225] Updated weights for policy 1, policy_version 612448 (0.0009) [2023-12-27 23:37:48,643][106225] Updated weights for policy 1, policy_version 612458 (0.0008) [2023-12-27 23:37:48,947][106226] Updated weights for policy 0, policy_version 610392 (0.0008) [2023-12-27 23:37:49,004][106226] Updated weights for policy 0, policy_version 610402 (0.0008) [2023-12-27 23:37:49,063][106226] Updated weights for policy 0, policy_version 610412 (0.0008) [2023-12-27 23:37:49,374][106225] Updated weights for policy 1, policy_version 612468 (0.0007) [2023-12-27 23:37:49,440][106225] Updated weights for policy 1, policy_version 612478 (0.0006) [2023-12-27 23:37:49,500][106225] Updated weights for policy 1, policy_version 612488 (0.0009) [2023-12-27 23:37:49,811][106226] Updated weights for policy 0, policy_version 610422 (0.0009) [2023-12-27 23:37:49,881][106226] Updated weights for policy 0, policy_version 610432 (0.0009) [2023-12-27 23:37:49,948][106226] Updated weights for policy 0, policy_version 610442 (0.0009) [2023-12-27 23:37:50,212][106225] Updated weights for policy 1, policy_version 612498 (0.0009) [2023-12-27 23:37:50,274][106225] Updated weights for policy 1, policy_version 612508 (0.0008) [2023-12-27 23:37:50,320][106225] Updated weights for policy 1, policy_version 612518 (0.0008) [2023-12-27 23:37:50,380][106225] Updated weights for policy 1, policy_version 612528 (0.0008) [2023-12-27 23:37:50,717][106226] Updated weights for policy 0, policy_version 610452 (0.0008) [2023-12-27 23:37:50,773][106226] Updated weights for policy 0, policy_version 610462 (0.0008) [2023-12-27 23:37:50,835][106226] Updated weights for policy 0, policy_version 610472 (0.0009) [2023-12-27 23:37:51,093][106225] Updated weights for policy 1, policy_version 612538 (0.0009) [2023-12-27 23:37:51,157][106225] Updated weights for policy 1, policy_version 612548 (0.0008) [2023-12-27 23:37:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 313155584. Throughput: 0: 9947.5, 1: 9802.7. Samples: 313166748. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:51,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-5.793')] [2023-12-27 23:37:51,212][106225] Updated weights for policy 1, policy_version 612558 (0.0008) [2023-12-27 23:37:51,670][106226] Updated weights for policy 0, policy_version 610482 (0.0009) [2023-12-27 23:37:51,733][106226] Updated weights for policy 0, policy_version 610492 (0.0009) [2023-12-27 23:37:51,797][106226] Updated weights for policy 0, policy_version 610502 (0.0009) [2023-12-27 23:37:51,856][106226] Updated weights for policy 0, policy_version 610512 (0.0009) [2023-12-27 23:37:52,002][106225] Updated weights for policy 1, policy_version 612568 (0.0009) [2023-12-27 23:37:52,056][106225] Updated weights for policy 1, policy_version 612578 (0.0008) [2023-12-27 23:37:52,113][106225] Updated weights for policy 1, policy_version 612588 (0.0009) [2023-12-27 23:37:52,613][106226] Updated weights for policy 0, policy_version 610522 (0.0009) [2023-12-27 23:37:52,669][106226] Updated weights for policy 0, policy_version 610532 (0.0009) [2023-12-27 23:37:52,733][106226] Updated weights for policy 0, policy_version 610542 (0.0009) [2023-12-27 23:37:52,854][106225] Updated weights for policy 1, policy_version 612598 (0.0009) [2023-12-27 23:37:52,909][106225] Updated weights for policy 1, policy_version 612608 (0.0009) [2023-12-27 23:37:52,962][106225] Updated weights for policy 1, policy_version 612618 (0.0008) [2023-12-27 23:37:53,466][106226] Updated weights for policy 0, policy_version 610552 (0.0008) [2023-12-27 23:37:53,516][106226] Updated weights for policy 0, policy_version 610562 (0.0008) [2023-12-27 23:37:53,561][106226] Updated weights for policy 0, policy_version 610572 (0.0008) [2023-12-27 23:37:53,703][106225] Updated weights for policy 1, policy_version 612628 (0.0009) [2023-12-27 23:37:53,753][106225] Updated weights for policy 1, policy_version 612638 (0.0010) [2023-12-27 23:37:53,806][106225] Updated weights for policy 1, policy_version 612648 (0.0010) [2023-12-27 23:37:54,299][106226] Updated weights for policy 0, policy_version 610582 (0.0009) [2023-12-27 23:37:54,353][106226] Updated weights for policy 0, policy_version 610592 (0.0011) [2023-12-27 23:37:54,411][106226] Updated weights for policy 0, policy_version 610602 (0.0007) [2023-12-27 23:37:54,506][106225] Updated weights for policy 1, policy_version 612658 (0.0009) [2023-12-27 23:37:54,570][106225] Updated weights for policy 1, policy_version 612668 (0.0006) [2023-12-27 23:37:54,618][106225] Updated weights for policy 1, policy_version 612678 (0.0005) [2023-12-27 23:37:54,675][106225] Updated weights for policy 1, policy_version 612688 (0.0005) [2023-12-27 23:37:55,119][106226] Updated weights for policy 0, policy_version 610612 (0.0007) [2023-12-27 23:37:55,174][106226] Updated weights for policy 0, policy_version 610622 (0.0005) [2023-12-27 23:37:55,233][106226] Updated weights for policy 0, policy_version 610632 (0.0005) [2023-12-27 23:37:55,307][106225] Updated weights for policy 1, policy_version 612698 (0.0007) [2023-12-27 23:37:55,364][106225] Updated weights for policy 1, policy_version 612708 (0.0008) [2023-12-27 23:37:55,416][106225] Updated weights for policy 1, policy_version 612718 (0.0007) [2023-12-27 23:37:55,906][106226] Updated weights for policy 0, policy_version 610642 (0.0009) [2023-12-27 23:37:55,966][106226] Updated weights for policy 0, policy_version 610652 (0.0009) [2023-12-27 23:37:56,027][106226] Updated weights for policy 0, policy_version 610662 (0.0010) [2023-12-27 23:37:56,091][106226] Updated weights for policy 0, policy_version 610672 (0.0011) [2023-12-27 23:37:56,160][106225] Updated weights for policy 1, policy_version 612728 (0.0008) [2023-12-27 23:37:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19688.5). Total num frames: 313253888. Throughput: 0: 9929.2, 1: 9773.7. Samples: 313222988. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:37:56,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-6.147')] [2023-12-27 23:37:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000610672_156368896.pth... [2023-12-27 23:37:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000609488_156065792.pth [2023-12-27 23:37:56,213][106225] Updated weights for policy 1, policy_version 612738 (0.0008) [2023-12-27 23:37:56,265][106225] Updated weights for policy 1, policy_version 612748 (0.0008) [2023-12-27 23:37:56,288][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000612752_156893184.pth... [2023-12-27 23:37:56,292][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000611600_156598272.pth [2023-12-27 23:37:56,734][106226] Updated weights for policy 0, policy_version 610682 (0.0005) [2023-12-27 23:37:56,788][106226] Updated weights for policy 0, policy_version 610692 (0.0005) [2023-12-27 23:37:56,842][106226] Updated weights for policy 0, policy_version 610702 (0.0006) [2023-12-27 23:37:57,007][106225] Updated weights for policy 1, policy_version 612758 (0.0008) [2023-12-27 23:37:57,061][106225] Updated weights for policy 1, policy_version 612768 (0.0008) [2023-12-27 23:37:57,112][106225] Updated weights for policy 1, policy_version 612778 (0.0005) [2023-12-27 23:37:57,491][106226] Updated weights for policy 0, policy_version 610712 (0.0009) [2023-12-27 23:37:57,557][106226] Updated weights for policy 0, policy_version 610722 (0.0011) [2023-12-27 23:37:57,609][106226] Updated weights for policy 0, policy_version 610732 (0.0010) [2023-12-27 23:37:57,663][106225] Updated weights for policy 1, policy_version 612788 (0.0005) [2023-12-27 23:37:57,708][106225] Updated weights for policy 1, policy_version 612798 (0.0005) [2023-12-27 23:37:57,756][106225] Updated weights for policy 1, policy_version 612808 (0.0008) [2023-12-27 23:37:58,210][106226] Updated weights for policy 0, policy_version 610742 (0.0008) [2023-12-27 23:37:58,269][106226] Updated weights for policy 0, policy_version 610752 (0.0008) [2023-12-27 23:37:58,334][106226] Updated weights for policy 0, policy_version 610762 (0.0007) [2023-12-27 23:37:58,448][106225] Updated weights for policy 1, policy_version 612818 (0.0008) [2023-12-27 23:37:58,521][106225] Updated weights for policy 1, policy_version 612828 (0.0008) [2023-12-27 23:37:58,588][106225] Updated weights for policy 1, policy_version 612838 (0.0008) [2023-12-27 23:37:58,655][106225] Updated weights for policy 1, policy_version 612848 (0.0008) [2023-12-27 23:37:59,113][106226] Updated weights for policy 0, policy_version 610772 (0.0011) [2023-12-27 23:37:59,184][106226] Updated weights for policy 0, policy_version 610782 (0.0008) [2023-12-27 23:37:59,255][106226] Updated weights for policy 0, policy_version 610792 (0.0009) [2023-12-27 23:37:59,425][106225] Updated weights for policy 1, policy_version 612858 (0.0006) [2023-12-27 23:37:59,479][106225] Updated weights for policy 1, policy_version 612868 (0.0007) [2023-12-27 23:37:59,544][106225] Updated weights for policy 1, policy_version 612878 (0.0008) [2023-12-27 23:37:59,983][106226] Updated weights for policy 0, policy_version 610802 (0.0008) [2023-12-27 23:38:00,036][106226] Updated weights for policy 0, policy_version 610812 (0.0010) [2023-12-27 23:38:00,090][106226] Updated weights for policy 0, policy_version 610822 (0.0008) [2023-12-27 23:38:00,153][106226] Updated weights for policy 0, policy_version 610832 (0.0009) [2023-12-27 23:38:00,254][106225] Updated weights for policy 1, policy_version 612888 (0.0008) [2023-12-27 23:38:00,305][106225] Updated weights for policy 1, policy_version 612898 (0.0008) [2023-12-27 23:38:00,363][106225] Updated weights for policy 1, policy_version 612908 (0.0008) [2023-12-27 23:38:00,823][106226] Updated weights for policy 0, policy_version 610842 (0.0008) [2023-12-27 23:38:00,877][106226] Updated weights for policy 0, policy_version 610852 (0.0005) [2023-12-27 23:38:00,922][106226] Updated weights for policy 0, policy_version 610862 (0.0005) [2023-12-27 23:38:01,111][106225] Updated weights for policy 1, policy_version 612918 (0.0008) [2023-12-27 23:38:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 313352192. Throughput: 0: 9925.1, 1: 9816.5. Samples: 313342296. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:01,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-6.020')] [2023-12-27 23:38:01,177][106225] Updated weights for policy 1, policy_version 612928 (0.0007) [2023-12-27 23:38:01,242][106225] Updated weights for policy 1, policy_version 612938 (0.0008) [2023-12-27 23:38:01,641][106226] Updated weights for policy 0, policy_version 610872 (0.0010) [2023-12-27 23:38:01,701][106226] Updated weights for policy 0, policy_version 610882 (0.0011) [2023-12-27 23:38:01,769][106226] Updated weights for policy 0, policy_version 610892 (0.0010) [2023-12-27 23:38:02,011][106225] Updated weights for policy 1, policy_version 612948 (0.0007) [2023-12-27 23:38:02,076][106225] Updated weights for policy 1, policy_version 612958 (0.0005) [2023-12-27 23:38:02,136][106225] Updated weights for policy 1, policy_version 612968 (0.0008) [2023-12-27 23:38:02,476][106226] Updated weights for policy 0, policy_version 610902 (0.0009) [2023-12-27 23:38:02,537][106226] Updated weights for policy 0, policy_version 610912 (0.0007) [2023-12-27 23:38:02,592][106226] Updated weights for policy 0, policy_version 610922 (0.0006) [2023-12-27 23:38:02,854][106225] Updated weights for policy 1, policy_version 612978 (0.0008) [2023-12-27 23:38:02,917][106225] Updated weights for policy 1, policy_version 612988 (0.0010) [2023-12-27 23:38:02,965][106225] Updated weights for policy 1, policy_version 612998 (0.0010) [2023-12-27 23:38:03,018][106225] Updated weights for policy 1, policy_version 613008 (0.0010) [2023-12-27 23:38:03,306][106226] Updated weights for policy 0, policy_version 610932 (0.0009) [2023-12-27 23:38:03,363][106226] Updated weights for policy 0, policy_version 610942 (0.0010) [2023-12-27 23:38:03,425][106226] Updated weights for policy 0, policy_version 610952 (0.0010) [2023-12-27 23:38:03,671][106225] Updated weights for policy 1, policy_version 613018 (0.0010) [2023-12-27 23:38:03,726][106225] Updated weights for policy 1, policy_version 613028 (0.0010) [2023-12-27 23:38:03,782][106225] Updated weights for policy 1, policy_version 613038 (0.0010) [2023-12-27 23:38:04,137][106226] Updated weights for policy 0, policy_version 610962 (0.0010) [2023-12-27 23:38:04,198][106226] Updated weights for policy 0, policy_version 610972 (0.0011) [2023-12-27 23:38:04,266][106226] Updated weights for policy 0, policy_version 610982 (0.0011) [2023-12-27 23:38:04,328][106226] Updated weights for policy 0, policy_version 610992 (0.0010) [2023-12-27 23:38:04,484][106225] Updated weights for policy 1, policy_version 613048 (0.0010) [2023-12-27 23:38:04,541][106225] Updated weights for policy 1, policy_version 613058 (0.0010) [2023-12-27 23:38:04,597][106225] Updated weights for policy 1, policy_version 613068 (0.0009) [2023-12-27 23:38:05,030][106226] Updated weights for policy 0, policy_version 611002 (0.0011) [2023-12-27 23:38:05,087][106226] Updated weights for policy 0, policy_version 611012 (0.0010) [2023-12-27 23:38:05,148][106226] Updated weights for policy 0, policy_version 611022 (0.0011) [2023-12-27 23:38:05,297][106225] Updated weights for policy 1, policy_version 613078 (0.0009) [2023-12-27 23:38:05,361][106225] Updated weights for policy 1, policy_version 613088 (0.0010) [2023-12-27 23:38:05,422][106225] Updated weights for policy 1, policy_version 613098 (0.0010) [2023-12-27 23:38:05,852][106226] Updated weights for policy 0, policy_version 611032 (0.0010) [2023-12-27 23:38:05,911][106226] Updated weights for policy 0, policy_version 611042 (0.0010) [2023-12-27 23:38:05,968][106226] Updated weights for policy 0, policy_version 611052 (0.0011) [2023-12-27 23:38:06,118][106225] Updated weights for policy 1, policy_version 613108 (0.0010) [2023-12-27 23:38:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 313450496. Throughput: 0: 9944.4, 1: 9854.5. Samples: 313460380. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:06,175][105115] Avg episode reward: [(0, '-5.106'), (1, '-5.880')] [2023-12-27 23:38:06,181][106225] Updated weights for policy 1, policy_version 613118 (0.0008) [2023-12-27 23:38:06,242][106225] Updated weights for policy 1, policy_version 613128 (0.0007) [2023-12-27 23:38:06,697][106226] Updated weights for policy 0, policy_version 611062 (0.0009) [2023-12-27 23:38:06,744][106226] Updated weights for policy 0, policy_version 611072 (0.0006) [2023-12-27 23:38:06,806][106226] Updated weights for policy 0, policy_version 611082 (0.0008) [2023-12-27 23:38:06,984][106225] Updated weights for policy 1, policy_version 613138 (0.0008) [2023-12-27 23:38:07,047][106225] Updated weights for policy 1, policy_version 613148 (0.0008) [2023-12-27 23:38:07,119][106225] Updated weights for policy 1, policy_version 613158 (0.0009) [2023-12-27 23:38:07,187][106225] Updated weights for policy 1, policy_version 613168 (0.0009) [2023-12-27 23:38:07,465][106226] Updated weights for policy 0, policy_version 611092 (0.0009) [2023-12-27 23:38:07,523][106226] Updated weights for policy 0, policy_version 611102 (0.0007) [2023-12-27 23:38:07,585][106226] Updated weights for policy 0, policy_version 611112 (0.0006) [2023-12-27 23:38:07,971][106225] Updated weights for policy 1, policy_version 613178 (0.0008) [2023-12-27 23:38:08,029][106225] Updated weights for policy 1, policy_version 613188 (0.0009) [2023-12-27 23:38:08,081][106225] Updated weights for policy 1, policy_version 613198 (0.0008) [2023-12-27 23:38:08,149][106226] Updated weights for policy 0, policy_version 611122 (0.0005) [2023-12-27 23:38:08,195][106226] Updated weights for policy 0, policy_version 611132 (0.0006) [2023-12-27 23:38:08,245][106226] Updated weights for policy 0, policy_version 611142 (0.0009) [2023-12-27 23:38:08,288][106226] Updated weights for policy 0, policy_version 611152 (0.0007) [2023-12-27 23:38:08,842][106225] Updated weights for policy 1, policy_version 613208 (0.0008) [2023-12-27 23:38:08,905][106225] Updated weights for policy 1, policy_version 613218 (0.0009) [2023-12-27 23:38:08,964][106225] Updated weights for policy 1, policy_version 613228 (0.0008) [2023-12-27 23:38:09,041][106226] Updated weights for policy 0, policy_version 611162 (0.0008) [2023-12-27 23:38:09,091][106226] Updated weights for policy 0, policy_version 611172 (0.0008) [2023-12-27 23:38:09,140][106226] Updated weights for policy 0, policy_version 611182 (0.0008) [2023-12-27 23:38:09,735][106225] Updated weights for policy 1, policy_version 613238 (0.0009) [2023-12-27 23:38:09,806][106225] Updated weights for policy 1, policy_version 613248 (0.0008) [2023-12-27 23:38:09,881][106225] Updated weights for policy 1, policy_version 613258 (0.0008) [2023-12-27 23:38:09,912][106226] Updated weights for policy 0, policy_version 611192 (0.0008) [2023-12-27 23:38:09,998][106226] Updated weights for policy 0, policy_version 611202 (0.0008) [2023-12-27 23:38:10,063][106226] Updated weights for policy 0, policy_version 611212 (0.0008) [2023-12-27 23:38:10,629][106225] Updated weights for policy 1, policy_version 613268 (0.0006) [2023-12-27 23:38:10,694][106225] Updated weights for policy 1, policy_version 613278 (0.0005) [2023-12-27 23:38:10,759][106225] Updated weights for policy 1, policy_version 613288 (0.0006) [2023-12-27 23:38:10,778][106226] Updated weights for policy 0, policy_version 611222 (0.0008) [2023-12-27 23:38:10,842][106226] Updated weights for policy 0, policy_version 611232 (0.0009) [2023-12-27 23:38:10,906][106226] Updated weights for policy 0, policy_version 611242 (0.0009) [2023-12-27 23:38:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 313548800. Throughput: 0: 10009.4, 1: 9825.8. Samples: 313519624. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:11,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-5.854')] [2023-12-27 23:38:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000613296_157032448.pth... [2023-12-27 23:38:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000611248_156516352.pth... [2023-12-27 23:38:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000612176_156745728.pth [2023-12-27 23:38:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000610096_156221440.pth [2023-12-27 23:38:11,475][106225] Updated weights for policy 1, policy_version 613298 (0.0006) [2023-12-27 23:38:11,524][106225] Updated weights for policy 1, policy_version 613308 (0.0008) [2023-12-27 23:38:11,578][106225] Updated weights for policy 1, policy_version 613318 (0.0008) [2023-12-27 23:38:11,649][106225] Updated weights for policy 1, policy_version 613328 (0.0008) [2023-12-27 23:38:11,661][106226] Updated weights for policy 0, policy_version 611252 (0.0008) [2023-12-27 23:38:11,722][106226] Updated weights for policy 0, policy_version 611262 (0.0008) [2023-12-27 23:38:11,792][106226] Updated weights for policy 0, policy_version 611272 (0.0008) [2023-12-27 23:38:12,401][106226] Updated weights for policy 0, policy_version 611282 (0.0007) [2023-12-27 23:38:12,469][106226] Updated weights for policy 0, policy_version 611292 (0.0008) [2023-12-27 23:38:12,500][106225] Updated weights for policy 1, policy_version 613338 (0.0006) [2023-12-27 23:38:12,522][106226] Updated weights for policy 0, policy_version 611302 (0.0007) [2023-12-27 23:38:12,564][106225] Updated weights for policy 1, policy_version 613348 (0.0007) [2023-12-27 23:38:12,569][106226] Updated weights for policy 0, policy_version 611312 (0.0008) [2023-12-27 23:38:12,628][106225] Updated weights for policy 1, policy_version 613358 (0.0008) [2023-12-27 23:38:13,302][106226] Updated weights for policy 0, policy_version 611322 (0.0009) [2023-12-27 23:38:13,348][106225] Updated weights for policy 1, policy_version 613368 (0.0007) [2023-12-27 23:38:13,358][106226] Updated weights for policy 0, policy_version 611332 (0.0007) [2023-12-27 23:38:13,402][106225] Updated weights for policy 1, policy_version 613378 (0.0007) [2023-12-27 23:38:13,419][106226] Updated weights for policy 0, policy_version 611342 (0.0007) [2023-12-27 23:38:13,454][106225] Updated weights for policy 1, policy_version 613388 (0.0007) [2023-12-27 23:38:14,117][106225] Updated weights for policy 1, policy_version 613398 (0.0006) [2023-12-27 23:38:14,168][106225] Updated weights for policy 1, policy_version 613408 (0.0006) [2023-12-27 23:38:14,192][106226] Updated weights for policy 0, policy_version 611352 (0.0008) [2023-12-27 23:38:14,226][106225] Updated weights for policy 1, policy_version 613418 (0.0007) [2023-12-27 23:38:14,255][106226] Updated weights for policy 0, policy_version 611362 (0.0006) [2023-12-27 23:38:14,318][106226] Updated weights for policy 0, policy_version 611372 (0.0006) [2023-12-27 23:38:14,902][106225] Updated weights for policy 1, policy_version 613428 (0.0008) [2023-12-27 23:38:14,932][106226] Updated weights for policy 0, policy_version 611382 (0.0006) [2023-12-27 23:38:14,964][106225] Updated weights for policy 1, policy_version 613438 (0.0009) [2023-12-27 23:38:14,991][106226] Updated weights for policy 0, policy_version 611392 (0.0006) [2023-12-27 23:38:15,024][106225] Updated weights for policy 1, policy_version 613448 (0.0006) [2023-12-27 23:38:15,055][106226] Updated weights for policy 0, policy_version 611402 (0.0006) [2023-12-27 23:38:15,691][106225] Updated weights for policy 1, policy_version 613458 (0.0007) [2023-12-27 23:38:15,749][106225] Updated weights for policy 1, policy_version 613468 (0.0008) [2023-12-27 23:38:15,807][106225] Updated weights for policy 1, policy_version 613478 (0.0008) [2023-12-27 23:38:15,819][106226] Updated weights for policy 0, policy_version 611412 (0.0007) [2023-12-27 23:38:15,861][106225] Updated weights for policy 1, policy_version 613488 (0.0008) [2023-12-27 23:38:15,875][106226] Updated weights for policy 0, policy_version 611422 (0.0005) [2023-12-27 23:38:15,932][106226] Updated weights for policy 0, policy_version 611432 (0.0005) [2023-12-27 23:38:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 313647104. Throughput: 0: 9930.5, 1: 9610.7. Samples: 313634104. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:16,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-5.935')] [2023-12-27 23:38:16,517][106225] Updated weights for policy 1, policy_version 613498 (0.0008) [2023-12-27 23:38:16,548][106226] Updated weights for policy 0, policy_version 611442 (0.0006) [2023-12-27 23:38:16,582][106225] Updated weights for policy 1, policy_version 613508 (0.0006) [2023-12-27 23:38:16,593][106226] Updated weights for policy 0, policy_version 611452 (0.0006) [2023-12-27 23:38:16,639][106225] Updated weights for policy 1, policy_version 613518 (0.0007) [2023-12-27 23:38:16,655][106226] Updated weights for policy 0, policy_version 611462 (0.0007) [2023-12-27 23:38:16,707][106226] Updated weights for policy 0, policy_version 611472 (0.0008) [2023-12-27 23:38:17,304][106225] Updated weights for policy 1, policy_version 613528 (0.0008) [2023-12-27 23:38:17,368][106225] Updated weights for policy 1, policy_version 613538 (0.0005) [2023-12-27 23:38:17,407][106226] Updated weights for policy 0, policy_version 611482 (0.0009) [2023-12-27 23:38:17,430][106225] Updated weights for policy 1, policy_version 613548 (0.0005) [2023-12-27 23:38:17,464][106226] Updated weights for policy 0, policy_version 611492 (0.0008) [2023-12-27 23:38:17,513][106226] Updated weights for policy 0, policy_version 611502 (0.0009) [2023-12-27 23:38:17,968][106225] Updated weights for policy 1, policy_version 613558 (0.0007) [2023-12-27 23:38:18,020][106225] Updated weights for policy 1, policy_version 613568 (0.0008) [2023-12-27 23:38:18,072][106225] Updated weights for policy 1, policy_version 613578 (0.0008) [2023-12-27 23:38:18,192][106226] Updated weights for policy 0, policy_version 611512 (0.0006) [2023-12-27 23:38:18,255][106226] Updated weights for policy 0, policy_version 611522 (0.0008) [2023-12-27 23:38:18,322][106226] Updated weights for policy 0, policy_version 611532 (0.0010) [2023-12-27 23:38:18,690][106225] Updated weights for policy 1, policy_version 613588 (0.0007) [2023-12-27 23:38:18,754][106225] Updated weights for policy 1, policy_version 613598 (0.0005) [2023-12-27 23:38:18,814][106225] Updated weights for policy 1, policy_version 613608 (0.0008) [2023-12-27 23:38:19,108][106226] Updated weights for policy 0, policy_version 611542 (0.0010) [2023-12-27 23:38:19,168][106226] Updated weights for policy 0, policy_version 611552 (0.0011) [2023-12-27 23:38:19,222][106226] Updated weights for policy 0, policy_version 611562 (0.0010) [2023-12-27 23:38:19,556][106225] Updated weights for policy 1, policy_version 613618 (0.0008) [2023-12-27 23:38:19,629][106225] Updated weights for policy 1, policy_version 613628 (0.0008) [2023-12-27 23:38:19,696][106225] Updated weights for policy 1, policy_version 613638 (0.0008) [2023-12-27 23:38:19,757][106225] Updated weights for policy 1, policy_version 613648 (0.0008) [2023-12-27 23:38:19,946][106226] Updated weights for policy 0, policy_version 611572 (0.0008) [2023-12-27 23:38:20,013][106226] Updated weights for policy 0, policy_version 611582 (0.0009) [2023-12-27 23:38:20,077][106226] Updated weights for policy 0, policy_version 611592 (0.0008) [2023-12-27 23:38:20,401][106225] Updated weights for policy 1, policy_version 613658 (0.0008) [2023-12-27 23:38:20,450][106225] Updated weights for policy 1, policy_version 613668 (0.0008) [2023-12-27 23:38:20,502][106225] Updated weights for policy 1, policy_version 613678 (0.0008) [2023-12-27 23:38:20,811][106226] Updated weights for policy 0, policy_version 611602 (0.0009) [2023-12-27 23:38:20,873][106226] Updated weights for policy 0, policy_version 611612 (0.0008) [2023-12-27 23:38:20,946][106226] Updated weights for policy 0, policy_version 611622 (0.0010) [2023-12-27 23:38:21,013][106226] Updated weights for policy 0, policy_version 611632 (0.0009) [2023-12-27 23:38:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 313745408. Throughput: 0: 9802.0, 1: 9653.0. Samples: 313753652. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:21,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.986')] [2023-12-27 23:38:21,321][106225] Updated weights for policy 1, policy_version 613688 (0.0008) [2023-12-27 23:38:21,392][106225] Updated weights for policy 1, policy_version 613698 (0.0007) [2023-12-27 23:38:21,462][106225] Updated weights for policy 1, policy_version 613708 (0.0007) [2023-12-27 23:38:21,806][106226] Updated weights for policy 0, policy_version 611642 (0.0009) [2023-12-27 23:38:21,863][106226] Updated weights for policy 0, policy_version 611652 (0.0009) [2023-12-27 23:38:21,925][106226] Updated weights for policy 0, policy_version 611662 (0.0009) [2023-12-27 23:38:22,184][106225] Updated weights for policy 1, policy_version 613718 (0.0009) [2023-12-27 23:38:22,241][106225] Updated weights for policy 1, policy_version 613728 (0.0005) [2023-12-27 23:38:22,306][106225] Updated weights for policy 1, policy_version 613738 (0.0008) [2023-12-27 23:38:22,688][106226] Updated weights for policy 0, policy_version 611672 (0.0010) [2023-12-27 23:38:22,754][106226] Updated weights for policy 0, policy_version 611682 (0.0010) [2023-12-27 23:38:22,815][106226] Updated weights for policy 0, policy_version 611692 (0.0006) [2023-12-27 23:38:23,035][106225] Updated weights for policy 1, policy_version 613748 (0.0008) [2023-12-27 23:38:23,093][106225] Updated weights for policy 1, policy_version 613758 (0.0008) [2023-12-27 23:38:23,156][106225] Updated weights for policy 1, policy_version 613768 (0.0008) [2023-12-27 23:38:23,449][106226] Updated weights for policy 0, policy_version 611702 (0.0009) [2023-12-27 23:38:23,515][106226] Updated weights for policy 0, policy_version 611712 (0.0011) [2023-12-27 23:38:23,564][106226] Updated weights for policy 0, policy_version 611722 (0.0010) [2023-12-27 23:38:23,894][106225] Updated weights for policy 1, policy_version 613778 (0.0008) [2023-12-27 23:38:23,946][106225] Updated weights for policy 1, policy_version 613788 (0.0005) [2023-12-27 23:38:23,994][106225] Updated weights for policy 1, policy_version 613798 (0.0006) [2023-12-27 23:38:24,054][106225] Updated weights for policy 1, policy_version 613808 (0.0008) [2023-12-27 23:38:24,279][106226] Updated weights for policy 0, policy_version 611732 (0.0007) [2023-12-27 23:38:24,344][106226] Updated weights for policy 0, policy_version 611742 (0.0005) [2023-12-27 23:38:24,396][106226] Updated weights for policy 0, policy_version 611752 (0.0009) [2023-12-27 23:38:24,660][106225] Updated weights for policy 1, policy_version 613818 (0.0005) [2023-12-27 23:38:24,712][106225] Updated weights for policy 1, policy_version 613828 (0.0008) [2023-12-27 23:38:24,777][106225] Updated weights for policy 1, policy_version 613838 (0.0010) [2023-12-27 23:38:25,080][106226] Updated weights for policy 0, policy_version 611762 (0.0009) [2023-12-27 23:38:25,139][106226] Updated weights for policy 0, policy_version 611772 (0.0009) [2023-12-27 23:38:25,200][106226] Updated weights for policy 0, policy_version 611782 (0.0009) [2023-12-27 23:38:25,274][106226] Updated weights for policy 0, policy_version 611792 (0.0008) [2023-12-27 23:38:25,377][106225] Updated weights for policy 1, policy_version 613848 (0.0006) [2023-12-27 23:38:25,431][106225] Updated weights for policy 1, policy_version 613858 (0.0005) [2023-12-27 23:38:25,484][106225] Updated weights for policy 1, policy_version 613868 (0.0005) [2023-12-27 23:38:25,966][106226] Updated weights for policy 0, policy_version 611802 (0.0007) [2023-12-27 23:38:26,013][106226] Updated weights for policy 0, policy_version 611812 (0.0009) [2023-12-27 23:38:26,068][106226] Updated weights for policy 0, policy_version 611822 (0.0007) [2023-12-27 23:38:26,157][106225] Updated weights for policy 1, policy_version 613878 (0.0007) [2023-12-27 23:38:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 313843712. Throughput: 0: 9789.7, 1: 9604.9. Samples: 313810488. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:26,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-5.802')] [2023-12-27 23:38:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000611824_156663808.pth... [2023-12-27 23:38:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000610672_156368896.pth [2023-12-27 23:38:26,210][106225] Updated weights for policy 1, policy_version 613888 (0.0009) [2023-12-27 23:38:26,259][106225] Updated weights for policy 1, policy_version 613898 (0.0007) [2023-12-27 23:38:26,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000613904_157188096.pth... [2023-12-27 23:38:26,287][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000612752_156893184.pth [2023-12-27 23:38:26,755][106226] Updated weights for policy 0, policy_version 611832 (0.0010) [2023-12-27 23:38:26,806][106226] Updated weights for policy 0, policy_version 611842 (0.0010) [2023-12-27 23:38:26,860][106226] Updated weights for policy 0, policy_version 611852 (0.0010) [2023-12-27 23:38:26,936][106225] Updated weights for policy 1, policy_version 613909 (0.0010) [2023-12-27 23:38:26,989][106225] Updated weights for policy 1, policy_version 613919 (0.0007) [2023-12-27 23:38:27,034][106225] Updated weights for policy 1, policy_version 613929 (0.0005) [2023-12-27 23:38:27,560][106226] Updated weights for policy 0, policy_version 611862 (0.0006) [2023-12-27 23:38:27,613][106226] Updated weights for policy 0, policy_version 611872 (0.0005) [2023-12-27 23:38:27,668][106226] Updated weights for policy 0, policy_version 611882 (0.0009) [2023-12-27 23:38:27,706][106225] Updated weights for policy 1, policy_version 613939 (0.0007) [2023-12-27 23:38:27,772][106225] Updated weights for policy 1, policy_version 613949 (0.0007) [2023-12-27 23:38:27,843][106225] Updated weights for policy 1, policy_version 613959 (0.0010) [2023-12-27 23:38:28,177][106226] Updated weights for policy 0, policy_version 611892 (0.0006) [2023-12-27 23:38:28,226][106226] Updated weights for policy 0, policy_version 611902 (0.0008) [2023-12-27 23:38:28,271][106226] Updated weights for policy 0, policy_version 611912 (0.0008) [2023-12-27 23:38:28,637][106225] Updated weights for policy 1, policy_version 613969 (0.0009) [2023-12-27 23:38:28,696][106225] Updated weights for policy 1, policy_version 613979 (0.0006) [2023-12-27 23:38:28,746][106225] Updated weights for policy 1, policy_version 613989 (0.0008) [2023-12-27 23:38:28,792][106225] Updated weights for policy 1, policy_version 613999 (0.0007) [2023-12-27 23:38:28,944][106226] Updated weights for policy 0, policy_version 611922 (0.0008) [2023-12-27 23:38:28,994][106226] Updated weights for policy 0, policy_version 611932 (0.0006) [2023-12-27 23:38:29,040][106226] Updated weights for policy 0, policy_version 611942 (0.0005) [2023-12-27 23:38:29,095][106226] Updated weights for policy 0, policy_version 611952 (0.0005) [2023-12-27 23:38:29,489][106225] Updated weights for policy 1, policy_version 614009 (0.0006) [2023-12-27 23:38:29,552][106225] Updated weights for policy 1, policy_version 614019 (0.0007) [2023-12-27 23:38:29,612][106225] Updated weights for policy 1, policy_version 614029 (0.0010) [2023-12-27 23:38:29,747][106226] Updated weights for policy 0, policy_version 611962 (0.0005) [2023-12-27 23:38:29,806][106226] Updated weights for policy 0, policy_version 611972 (0.0008) [2023-12-27 23:38:29,874][106226] Updated weights for policy 0, policy_version 611982 (0.0009) [2023-12-27 23:38:30,275][106225] Updated weights for policy 1, policy_version 614039 (0.0008) [2023-12-27 23:38:30,333][106225] Updated weights for policy 1, policy_version 614049 (0.0008) [2023-12-27 23:38:30,388][106225] Updated weights for policy 1, policy_version 614059 (0.0008) [2023-12-27 23:38:30,578][106226] Updated weights for policy 0, policy_version 611992 (0.0008) [2023-12-27 23:38:30,642][106226] Updated weights for policy 0, policy_version 612002 (0.0008) [2023-12-27 23:38:30,700][106226] Updated weights for policy 0, policy_version 612012 (0.0008) [2023-12-27 23:38:31,112][106225] Updated weights for policy 1, policy_version 614069 (0.0007) [2023-12-27 23:38:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 313942016. Throughput: 0: 9865.8, 1: 9781.0. Samples: 313935124. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:31,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-6.066')] [2023-12-27 23:38:31,186][106225] Updated weights for policy 1, policy_version 614079 (0.0007) [2023-12-27 23:38:31,243][106225] Updated weights for policy 1, policy_version 614089 (0.0005) [2023-12-27 23:38:31,495][106226] Updated weights for policy 0, policy_version 612022 (0.0007) [2023-12-27 23:38:31,556][106226] Updated weights for policy 0, policy_version 612032 (0.0005) [2023-12-27 23:38:31,615][106226] Updated weights for policy 0, policy_version 612042 (0.0006) [2023-12-27 23:38:31,926][106225] Updated weights for policy 1, policy_version 614099 (0.0007) [2023-12-27 23:38:31,986][106225] Updated weights for policy 1, policy_version 614109 (0.0005) [2023-12-27 23:38:32,050][106225] Updated weights for policy 1, policy_version 614119 (0.0005) [2023-12-27 23:38:32,361][106226] Updated weights for policy 0, policy_version 612052 (0.0007) [2023-12-27 23:38:32,428][106226] Updated weights for policy 0, policy_version 612062 (0.0008) [2023-12-27 23:38:32,487][106226] Updated weights for policy 0, policy_version 612072 (0.0008) [2023-12-27 23:38:32,702][106225] Updated weights for policy 1, policy_version 614129 (0.0007) [2023-12-27 23:38:32,759][106225] Updated weights for policy 1, policy_version 614139 (0.0008) [2023-12-27 23:38:32,815][106225] Updated weights for policy 1, policy_version 614149 (0.0009) [2023-12-27 23:38:32,873][106225] Updated weights for policy 1, policy_version 614159 (0.0008) [2023-12-27 23:38:33,171][106226] Updated weights for policy 0, policy_version 612082 (0.0009) [2023-12-27 23:38:33,226][106226] Updated weights for policy 0, policy_version 612092 (0.0010) [2023-12-27 23:38:33,276][106226] Updated weights for policy 0, policy_version 612102 (0.0008) [2023-12-27 23:38:33,324][106226] Updated weights for policy 0, policy_version 612112 (0.0008) [2023-12-27 23:38:33,479][106225] Updated weights for policy 1, policy_version 614169 (0.0009) [2023-12-27 23:38:33,542][106225] Updated weights for policy 1, policy_version 614179 (0.0009) [2023-12-27 23:38:33,603][106225] Updated weights for policy 1, policy_version 614189 (0.0008) [2023-12-27 23:38:34,087][106226] Updated weights for policy 0, policy_version 612122 (0.0008) [2023-12-27 23:38:34,142][106226] Updated weights for policy 0, policy_version 612132 (0.0006) [2023-12-27 23:38:34,207][106226] Updated weights for policy 0, policy_version 612142 (0.0008) [2023-12-27 23:38:34,370][106225] Updated weights for policy 1, policy_version 614199 (0.0009) [2023-12-27 23:38:34,423][106225] Updated weights for policy 1, policy_version 614209 (0.0009) [2023-12-27 23:38:34,475][106225] Updated weights for policy 1, policy_version 614219 (0.0008) [2023-12-27 23:38:34,827][106226] Updated weights for policy 0, policy_version 612152 (0.0007) [2023-12-27 23:38:34,873][106226] Updated weights for policy 0, policy_version 612162 (0.0007) [2023-12-27 23:38:34,915][106226] Updated weights for policy 0, policy_version 612172 (0.0005) [2023-12-27 23:38:35,247][106225] Updated weights for policy 1, policy_version 614229 (0.0009) [2023-12-27 23:38:35,306][106225] Updated weights for policy 1, policy_version 614239 (0.0010) [2023-12-27 23:38:35,369][106225] Updated weights for policy 1, policy_version 614249 (0.0010) [2023-12-27 23:38:35,537][106226] Updated weights for policy 0, policy_version 612182 (0.0007) [2023-12-27 23:38:35,584][106226] Updated weights for policy 0, policy_version 612192 (0.0005) [2023-12-27 23:38:35,633][106226] Updated weights for policy 0, policy_version 612202 (0.0006) [2023-12-27 23:38:35,981][106225] Updated weights for policy 1, policy_version 614259 (0.0010) [2023-12-27 23:38:36,040][106225] Updated weights for policy 1, policy_version 614269 (0.0008) [2023-12-27 23:38:36,102][106225] Updated weights for policy 1, policy_version 614279 (0.0008) [2023-12-27 23:38:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 314048512. Throughput: 0: 9914.4, 1: 9862.2. Samples: 314056692. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:36,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.921')] [2023-12-27 23:38:36,230][106226] Updated weights for policy 0, policy_version 612212 (0.0006) [2023-12-27 23:38:36,296][106226] Updated weights for policy 0, policy_version 612222 (0.0008) [2023-12-27 23:38:36,360][106226] Updated weights for policy 0, policy_version 612232 (0.0008) [2023-12-27 23:38:36,888][106225] Updated weights for policy 1, policy_version 614289 (0.0006) [2023-12-27 23:38:36,954][106225] Updated weights for policy 1, policy_version 614299 (0.0009) [2023-12-27 23:38:37,011][106225] Updated weights for policy 1, policy_version 614309 (0.0007) [2023-12-27 23:38:37,016][106226] Updated weights for policy 0, policy_version 612242 (0.0007) [2023-12-27 23:38:37,069][106225] Updated weights for policy 1, policy_version 614319 (0.0005) [2023-12-27 23:38:37,076][106226] Updated weights for policy 0, policy_version 612252 (0.0008) [2023-12-27 23:38:37,143][106226] Updated weights for policy 0, policy_version 612262 (0.0011) [2023-12-27 23:38:37,200][106226] Updated weights for policy 0, policy_version 612272 (0.0009) [2023-12-27 23:38:37,823][106225] Updated weights for policy 1, policy_version 614329 (0.0007) [2023-12-27 23:38:37,871][106226] Updated weights for policy 0, policy_version 612282 (0.0011) [2023-12-27 23:38:37,881][106225] Updated weights for policy 1, policy_version 614339 (0.0006) [2023-12-27 23:38:37,929][106226] Updated weights for policy 0, policy_version 612292 (0.0011) [2023-12-27 23:38:37,931][106225] Updated weights for policy 1, policy_version 614349 (0.0006) [2023-12-27 23:38:37,995][106226] Updated weights for policy 0, policy_version 612302 (0.0011) [2023-12-27 23:38:38,659][106226] Updated weights for policy 0, policy_version 612312 (0.0010) [2023-12-27 23:38:38,711][106225] Updated weights for policy 1, policy_version 614359 (0.0008) [2023-12-27 23:38:38,715][106226] Updated weights for policy 0, policy_version 612322 (0.0007) [2023-12-27 23:38:38,766][106225] Updated weights for policy 1, policy_version 614369 (0.0008) [2023-12-27 23:38:38,774][106226] Updated weights for policy 0, policy_version 612332 (0.0008) [2023-12-27 23:38:38,818][106225] Updated weights for policy 1, policy_version 614379 (0.0008) [2023-12-27 23:38:39,529][106226] Updated weights for policy 0, policy_version 612342 (0.0011) [2023-12-27 23:38:39,571][106225] Updated weights for policy 1, policy_version 614389 (0.0008) [2023-12-27 23:38:39,582][106226] Updated weights for policy 0, policy_version 612352 (0.0010) [2023-12-27 23:38:39,626][106225] Updated weights for policy 1, policy_version 614399 (0.0007) [2023-12-27 23:38:39,639][106226] Updated weights for policy 0, policy_version 612362 (0.0010) [2023-12-27 23:38:39,690][106225] Updated weights for policy 1, policy_version 614409 (0.0006) [2023-12-27 23:38:40,374][106226] Updated weights for policy 0, policy_version 612372 (0.0011) [2023-12-27 23:38:40,430][106225] Updated weights for policy 1, policy_version 614419 (0.0007) [2023-12-27 23:38:40,438][106226] Updated weights for policy 0, policy_version 612382 (0.0011) [2023-12-27 23:38:40,491][106225] Updated weights for policy 1, policy_version 614429 (0.0010) [2023-12-27 23:38:40,497][106226] Updated weights for policy 0, policy_version 612392 (0.0010) [2023-12-27 23:38:40,545][106225] Updated weights for policy 1, policy_version 614439 (0.0008) [2023-12-27 23:38:41,113][106226] Updated weights for policy 0, policy_version 612402 (0.0009) [2023-12-27 23:38:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 314138624. Throughput: 0: 9972.9, 1: 9842.2. Samples: 314114660. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:41,175][105115] Avg episode reward: [(0, '-4.965'), (1, '-5.469')] [2023-12-27 23:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000614448_157327360.pth... [2023-12-27 23:38:41,183][106226] Updated weights for policy 0, policy_version 612412 (0.0011) [2023-12-27 23:38:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000613296_157032448.pth [2023-12-27 23:38:41,251][106226] Updated weights for policy 0, policy_version 612422 (0.0008) [2023-12-27 23:38:41,293][106225] Updated weights for policy 1, policy_version 614449 (0.0010) [2023-12-27 23:38:41,310][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000612432_156819456.pth... [2023-12-27 23:38:41,312][106226] Updated weights for policy 0, policy_version 612432 (0.0008) [2023-12-27 23:38:41,314][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000611248_156516352.pth [2023-12-27 23:38:41,363][106225] Updated weights for policy 1, policy_version 614459 (0.0008) [2023-12-27 23:38:41,430][106225] Updated weights for policy 1, policy_version 614469 (0.0009) [2023-12-27 23:38:41,488][106225] Updated weights for policy 1, policy_version 614479 (0.0008) [2023-12-27 23:38:41,990][106226] Updated weights for policy 0, policy_version 612442 (0.0009) [2023-12-27 23:38:42,045][106226] Updated weights for policy 0, policy_version 612452 (0.0010) [2023-12-27 23:38:42,107][106226] Updated weights for policy 0, policy_version 612462 (0.0009) [2023-12-27 23:38:42,341][106225] Updated weights for policy 1, policy_version 614489 (0.0008) [2023-12-27 23:38:42,421][106225] Updated weights for policy 1, policy_version 614499 (0.0007) [2023-12-27 23:38:42,482][106225] Updated weights for policy 1, policy_version 614509 (0.0009) [2023-12-27 23:38:42,793][106226] Updated weights for policy 0, policy_version 612472 (0.0009) [2023-12-27 23:38:42,853][106226] Updated weights for policy 0, policy_version 612482 (0.0009) [2023-12-27 23:38:42,907][106226] Updated weights for policy 0, policy_version 612492 (0.0007) [2023-12-27 23:38:43,224][106225] Updated weights for policy 1, policy_version 614519 (0.0008) [2023-12-27 23:38:43,286][106225] Updated weights for policy 1, policy_version 614529 (0.0009) [2023-12-27 23:38:43,347][106225] Updated weights for policy 1, policy_version 614539 (0.0007) [2023-12-27 23:38:43,478][106226] Updated weights for policy 0, policy_version 612502 (0.0005) [2023-12-27 23:38:43,526][106226] Updated weights for policy 0, policy_version 612512 (0.0005) [2023-12-27 23:38:43,588][106226] Updated weights for policy 0, policy_version 612522 (0.0005) [2023-12-27 23:38:43,970][106225] Updated weights for policy 1, policy_version 614549 (0.0005) [2023-12-27 23:38:44,025][106225] Updated weights for policy 1, policy_version 614559 (0.0005) [2023-12-27 23:38:44,079][106225] Updated weights for policy 1, policy_version 614569 (0.0006) [2023-12-27 23:38:44,148][106226] Updated weights for policy 0, policy_version 612532 (0.0005) [2023-12-27 23:38:44,212][106226] Updated weights for policy 0, policy_version 612542 (0.0006) [2023-12-27 23:38:44,276][106226] Updated weights for policy 0, policy_version 612552 (0.0008) [2023-12-27 23:38:44,792][106225] Updated weights for policy 1, policy_version 614579 (0.0008) [2023-12-27 23:38:44,858][106225] Updated weights for policy 1, policy_version 614589 (0.0009) [2023-12-27 23:38:44,924][106225] Updated weights for policy 1, policy_version 614599 (0.0009) [2023-12-27 23:38:44,933][106226] Updated weights for policy 0, policy_version 612562 (0.0008) [2023-12-27 23:38:44,993][106226] Updated weights for policy 0, policy_version 612572 (0.0006) [2023-12-27 23:38:45,060][106226] Updated weights for policy 0, policy_version 612582 (0.0006) [2023-12-27 23:38:45,126][106226] Updated weights for policy 0, policy_version 612592 (0.0005) [2023-12-27 23:38:45,701][106226] Updated weights for policy 0, policy_version 612602 (0.0005) [2023-12-27 23:38:45,747][106225] Updated weights for policy 1, policy_version 614609 (0.0007) [2023-12-27 23:38:45,761][106226] Updated weights for policy 0, policy_version 612612 (0.0005) [2023-12-27 23:38:45,800][106225] Updated weights for policy 1, policy_version 614619 (0.0008) [2023-12-27 23:38:45,820][106226] Updated weights for policy 0, policy_version 612622 (0.0007) [2023-12-27 23:38:45,850][106225] Updated weights for policy 1, policy_version 614629 (0.0009) [2023-12-27 23:38:45,899][106225] Updated weights for policy 1, policy_version 614639 (0.0008) [2023-12-27 23:38:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 314245120. Throughput: 0: 10034.7, 1: 9756.9. Samples: 314232916. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:46,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.706')] [2023-12-27 23:38:46,338][106226] Updated weights for policy 0, policy_version 612632 (0.0008) [2023-12-27 23:38:46,395][106226] Updated weights for policy 0, policy_version 612642 (0.0009) [2023-12-27 23:38:46,443][106226] Updated weights for policy 0, policy_version 612652 (0.0008) [2023-12-27 23:38:46,697][106225] Updated weights for policy 1, policy_version 614649 (0.0008) [2023-12-27 23:38:46,745][106225] Updated weights for policy 1, policy_version 614659 (0.0008) [2023-12-27 23:38:46,799][106225] Updated weights for policy 1, policy_version 614669 (0.0008) [2023-12-27 23:38:47,161][106226] Updated weights for policy 0, policy_version 612662 (0.0008) [2023-12-27 23:38:47,212][106226] Updated weights for policy 0, policy_version 612672 (0.0008) [2023-12-27 23:38:47,273][106226] Updated weights for policy 0, policy_version 612682 (0.0009) [2023-12-27 23:38:47,540][106225] Updated weights for policy 1, policy_version 614679 (0.0008) [2023-12-27 23:38:47,587][106225] Updated weights for policy 1, policy_version 614689 (0.0008) [2023-12-27 23:38:47,633][106225] Updated weights for policy 1, policy_version 614699 (0.0008) [2023-12-27 23:38:48,008][106226] Updated weights for policy 0, policy_version 612692 (0.0009) [2023-12-27 23:38:48,057][106226] Updated weights for policy 0, policy_version 612702 (0.0008) [2023-12-27 23:38:48,104][106226] Updated weights for policy 0, policy_version 612712 (0.0008) [2023-12-27 23:38:48,413][106225] Updated weights for policy 1, policy_version 614709 (0.0008) [2023-12-27 23:38:48,463][106225] Updated weights for policy 1, policy_version 614719 (0.0008) [2023-12-27 23:38:48,519][106225] Updated weights for policy 1, policy_version 614729 (0.0008) [2023-12-27 23:38:48,827][106226] Updated weights for policy 0, policy_version 612722 (0.0008) [2023-12-27 23:38:48,891][106226] Updated weights for policy 0, policy_version 612732 (0.0009) [2023-12-27 23:38:48,949][106226] Updated weights for policy 0, policy_version 612742 (0.0007) [2023-12-27 23:38:49,007][106226] Updated weights for policy 0, policy_version 612752 (0.0006) [2023-12-27 23:38:49,324][106225] Updated weights for policy 1, policy_version 614739 (0.0008) [2023-12-27 23:38:49,397][106225] Updated weights for policy 1, policy_version 614749 (0.0008) [2023-12-27 23:38:49,461][106225] Updated weights for policy 1, policy_version 614759 (0.0009) [2023-12-27 23:38:49,751][106226] Updated weights for policy 0, policy_version 612762 (0.0009) [2023-12-27 23:38:49,814][106226] Updated weights for policy 0, policy_version 612772 (0.0009) [2023-12-27 23:38:49,890][106226] Updated weights for policy 0, policy_version 612782 (0.0008) [2023-12-27 23:38:50,175][106225] Updated weights for policy 1, policy_version 614769 (0.0009) [2023-12-27 23:38:50,234][106225] Updated weights for policy 1, policy_version 614779 (0.0008) [2023-12-27 23:38:50,288][106225] Updated weights for policy 1, policy_version 614789 (0.0008) [2023-12-27 23:38:50,352][106225] Updated weights for policy 1, policy_version 614799 (0.0009) [2023-12-27 23:38:50,635][106226] Updated weights for policy 0, policy_version 612794 (0.0008) [2023-12-27 23:38:50,691][106226] Updated weights for policy 0, policy_version 612804 (0.0008) [2023-12-27 23:38:50,753][106226] Updated weights for policy 0, policy_version 612814 (0.0009) [2023-12-27 23:38:51,101][106225] Updated weights for policy 1, policy_version 614809 (0.0009) [2023-12-27 23:38:51,169][106225] Updated weights for policy 1, policy_version 614819 (0.0008) [2023-12-27 23:38:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 314335232. Throughput: 0: 10060.5, 1: 9668.1. Samples: 314348164. Policy #0 lag: (min: 17.0, avg: 30.6, max: 49.0) [2023-12-27 23:38:51,175][105115] Avg episode reward: [(0, '-4.916'), (1, '-5.696')] [2023-12-27 23:38:51,228][106225] Updated weights for policy 1, policy_version 614829 (0.0008) [2023-12-27 23:38:51,520][106226] Updated weights for policy 0, policy_version 612824 (0.0008) [2023-12-27 23:38:51,586][106226] Updated weights for policy 0, policy_version 612834 (0.0008) [2023-12-27 23:38:51,652][106226] Updated weights for policy 0, policy_version 612844 (0.0008) [2023-12-27 23:38:51,986][106225] Updated weights for policy 1, policy_version 614839 (0.0009) [2023-12-27 23:38:52,042][106225] Updated weights for policy 1, policy_version 614849 (0.0009) [2023-12-27 23:38:52,107][106225] Updated weights for policy 1, policy_version 614859 (0.0009) [2023-12-27 23:38:52,362][106226] Updated weights for policy 0, policy_version 612854 (0.0010) [2023-12-27 23:38:52,431][106226] Updated weights for policy 0, policy_version 612864 (0.0010) [2023-12-27 23:38:52,489][106226] Updated weights for policy 0, policy_version 612874 (0.0009) [2023-12-27 23:38:52,968][106225] Updated weights for policy 1, policy_version 614869 (0.0007) [2023-12-27 23:38:53,027][106225] Updated weights for policy 1, policy_version 614879 (0.0010) [2023-12-27 23:38:53,091][106225] Updated weights for policy 1, policy_version 614889 (0.0010) [2023-12-27 23:38:53,134][106226] Updated weights for policy 0, policy_version 612884 (0.0008) [2023-12-27 23:38:53,181][106226] Updated weights for policy 0, policy_version 612894 (0.0010) [2023-12-27 23:38:53,226][106226] Updated weights for policy 0, policy_version 612904 (0.0010) [2023-12-27 23:38:53,710][106225] Updated weights for policy 1, policy_version 614899 (0.0009) [2023-12-27 23:38:53,765][106225] Updated weights for policy 1, policy_version 614909 (0.0007) [2023-12-27 23:38:53,807][106225] Updated weights for policy 1, policy_version 614919 (0.0008) [2023-12-27 23:38:53,960][106226] Updated weights for policy 0, policy_version 612914 (0.0010) [2023-12-27 23:38:54,017][106226] Updated weights for policy 0, policy_version 612924 (0.0010) [2023-12-27 23:38:54,064][106226] Updated weights for policy 0, policy_version 612934 (0.0010) [2023-12-27 23:38:54,113][106226] Updated weights for policy 0, policy_version 612944 (0.0010) [2023-12-27 23:38:54,490][106225] Updated weights for policy 1, policy_version 614929 (0.0007) [2023-12-27 23:38:54,547][106225] Updated weights for policy 1, policy_version 614939 (0.0006) [2023-12-27 23:38:54,604][106225] Updated weights for policy 1, policy_version 614949 (0.0005) [2023-12-27 23:38:54,658][106225] Updated weights for policy 1, policy_version 614959 (0.0005) [2023-12-27 23:38:54,736][106226] Updated weights for policy 0, policy_version 612954 (0.0007) [2023-12-27 23:38:54,795][106226] Updated weights for policy 0, policy_version 612964 (0.0009) [2023-12-27 23:38:54,849][106226] Updated weights for policy 0, policy_version 612974 (0.0008) [2023-12-27 23:38:55,240][106225] Updated weights for policy 1, policy_version 614969 (0.0009) [2023-12-27 23:38:55,304][106225] Updated weights for policy 1, policy_version 614979 (0.0007) [2023-12-27 23:38:55,353][106225] Updated weights for policy 1, policy_version 614989 (0.0008) [2023-12-27 23:38:55,491][106226] Updated weights for policy 0, policy_version 612984 (0.0006) [2023-12-27 23:38:55,556][106226] Updated weights for policy 0, policy_version 612994 (0.0008) [2023-12-27 23:38:55,614][106226] Updated weights for policy 0, policy_version 613004 (0.0005) [2023-12-27 23:38:56,039][106225] Updated weights for policy 1, policy_version 614999 (0.0007) [2023-12-27 23:38:56,104][106225] Updated weights for policy 1, policy_version 615009 (0.0005) [2023-12-27 23:38:56,170][106225] Updated weights for policy 1, policy_version 615019 (0.0007) [2023-12-27 23:38:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 314433536. Throughput: 0: 10018.0, 1: 9671.7. Samples: 314405660. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:38:56,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-5.956')] [2023-12-27 23:38:56,189][106226] Updated weights for policy 0, policy_version 613014 (0.0009) [2023-12-27 23:38:56,197][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000615024_157474816.pth... [2023-12-27 23:38:56,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000613904_157188096.pth [2023-12-27 23:38:56,240][106226] Updated weights for policy 0, policy_version 613024 (0.0011) [2023-12-27 23:38:56,290][106226] Updated weights for policy 0, policy_version 613034 (0.0010) [2023-12-27 23:38:56,324][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000613040_156975104.pth... [2023-12-27 23:38:56,327][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000611824_156663808.pth [2023-12-27 23:38:56,747][106225] Updated weights for policy 1, policy_version 615029 (0.0008) [2023-12-27 23:38:56,804][106225] Updated weights for policy 1, policy_version 615039 (0.0010) [2023-12-27 23:38:56,853][106225] Updated weights for policy 1, policy_version 615049 (0.0009) [2023-12-27 23:38:56,996][106226] Updated weights for policy 0, policy_version 613044 (0.0010) [2023-12-27 23:38:57,047][106226] Updated weights for policy 0, policy_version 613054 (0.0006) [2023-12-27 23:38:57,108][106226] Updated weights for policy 0, policy_version 613064 (0.0005) [2023-12-27 23:38:57,546][106225] Updated weights for policy 1, policy_version 615059 (0.0008) [2023-12-27 23:38:57,609][106225] Updated weights for policy 1, policy_version 615069 (0.0010) [2023-12-27 23:38:57,661][106225] Updated weights for policy 1, policy_version 615079 (0.0010) [2023-12-27 23:38:57,694][106226] Updated weights for policy 0, policy_version 613074 (0.0006) [2023-12-27 23:38:57,756][106226] Updated weights for policy 0, policy_version 613084 (0.0008) [2023-12-27 23:38:57,812][106226] Updated weights for policy 0, policy_version 613094 (0.0005) [2023-12-27 23:38:57,863][106226] Updated weights for policy 0, policy_version 613104 (0.0005) [2023-12-27 23:38:58,392][106225] Updated weights for policy 1, policy_version 615089 (0.0010) [2023-12-27 23:38:58,447][106225] Updated weights for policy 1, policy_version 615099 (0.0009) [2023-12-27 23:38:58,504][106226] Updated weights for policy 0, policy_version 613114 (0.0006) [2023-12-27 23:38:58,510][106225] Updated weights for policy 1, policy_version 615109 (0.0006) [2023-12-27 23:38:58,569][106226] Updated weights for policy 0, policy_version 613124 (0.0008) [2023-12-27 23:38:58,571][106225] Updated weights for policy 1, policy_version 615119 (0.0008) [2023-12-27 23:38:58,637][106226] Updated weights for policy 0, policy_version 613134 (0.0009) [2023-12-27 23:38:59,336][106226] Updated weights for policy 0, policy_version 613144 (0.0008) [2023-12-27 23:38:59,402][106226] Updated weights for policy 0, policy_version 613154 (0.0008) [2023-12-27 23:38:59,420][106225] Updated weights for policy 1, policy_version 615129 (0.0010) [2023-12-27 23:38:59,461][106226] Updated weights for policy 0, policy_version 613164 (0.0008) [2023-12-27 23:38:59,484][106225] Updated weights for policy 1, policy_version 615139 (0.0010) [2023-12-27 23:38:59,545][106225] Updated weights for policy 1, policy_version 615149 (0.0010) [2023-12-27 23:39:00,182][106226] Updated weights for policy 0, policy_version 613174 (0.0008) [2023-12-27 23:39:00,244][106226] Updated weights for policy 0, policy_version 613184 (0.0009) [2023-12-27 23:39:00,276][106225] Updated weights for policy 1, policy_version 615159 (0.0009) [2023-12-27 23:39:00,302][106226] Updated weights for policy 0, policy_version 613194 (0.0009) [2023-12-27 23:39:00,335][106225] Updated weights for policy 1, policy_version 615169 (0.0008) [2023-12-27 23:39:00,395][106225] Updated weights for policy 1, policy_version 615179 (0.0009) [2023-12-27 23:39:00,927][106226] Updated weights for policy 0, policy_version 613204 (0.0007) [2023-12-27 23:39:00,983][106226] Updated weights for policy 0, policy_version 613214 (0.0010) [2023-12-27 23:39:01,031][106225] Updated weights for policy 1, policy_version 615189 (0.0007) [2023-12-27 23:39:01,048][106226] Updated weights for policy 0, policy_version 613224 (0.0010) [2023-12-27 23:39:01,097][106225] Updated weights for policy 1, policy_version 615199 (0.0006) [2023-12-27 23:39:01,161][106225] Updated weights for policy 1, policy_version 615209 (0.0008) [2023-12-27 23:39:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 314540032. Throughput: 0: 10144.3, 1: 9757.0. Samples: 314529668. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:01,175][105115] Avg episode reward: [(0, '-5.108'), (1, '-5.805')] [2023-12-27 23:39:01,827][106226] Updated weights for policy 0, policy_version 613234 (0.0010) [2023-12-27 23:39:01,887][106226] Updated weights for policy 0, policy_version 613244 (0.0011) [2023-12-27 23:39:01,904][106225] Updated weights for policy 1, policy_version 615219 (0.0008) [2023-12-27 23:39:01,944][106226] Updated weights for policy 0, policy_version 613254 (0.0011) [2023-12-27 23:39:01,960][106225] Updated weights for policy 1, policy_version 615229 (0.0006) [2023-12-27 23:39:02,001][106226] Updated weights for policy 0, policy_version 613264 (0.0011) [2023-12-27 23:39:02,014][106225] Updated weights for policy 1, policy_version 615239 (0.0006) [2023-12-27 23:39:02,716][106225] Updated weights for policy 1, policy_version 615249 (0.0008) [2023-12-27 23:39:02,719][106226] Updated weights for policy 0, policy_version 613274 (0.0010) [2023-12-27 23:39:02,769][106225] Updated weights for policy 1, policy_version 615259 (0.0010) [2023-12-27 23:39:02,772][106226] Updated weights for policy 0, policy_version 613284 (0.0010) [2023-12-27 23:39:02,826][106226] Updated weights for policy 0, policy_version 613294 (0.0007) [2023-12-27 23:39:02,832][106225] Updated weights for policy 1, policy_version 615269 (0.0010) [2023-12-27 23:39:02,896][106225] Updated weights for policy 1, policy_version 615279 (0.0010) [2023-12-27 23:39:03,396][106226] Updated weights for policy 0, policy_version 613304 (0.0005) [2023-12-27 23:39:03,461][106226] Updated weights for policy 0, policy_version 613314 (0.0005) [2023-12-27 23:39:03,511][106226] Updated weights for policy 0, policy_version 613324 (0.0005) [2023-12-27 23:39:03,600][106225] Updated weights for policy 1, policy_version 615289 (0.0010) [2023-12-27 23:39:03,653][106225] Updated weights for policy 1, policy_version 615299 (0.0010) [2023-12-27 23:39:03,719][106225] Updated weights for policy 1, policy_version 615309 (0.0010) [2023-12-27 23:39:04,105][106226] Updated weights for policy 0, policy_version 613334 (0.0007) [2023-12-27 23:39:04,164][106226] Updated weights for policy 0, policy_version 613344 (0.0008) [2023-12-27 23:39:04,222][106226] Updated weights for policy 0, policy_version 613354 (0.0008) [2023-12-27 23:39:04,433][106225] Updated weights for policy 1, policy_version 615319 (0.0010) [2023-12-27 23:39:04,499][106225] Updated weights for policy 1, policy_version 615329 (0.0010) [2023-12-27 23:39:04,556][106225] Updated weights for policy 1, policy_version 615339 (0.0010) [2023-12-27 23:39:04,940][106226] Updated weights for policy 0, policy_version 613364 (0.0009) [2023-12-27 23:39:05,003][106226] Updated weights for policy 0, policy_version 613374 (0.0005) [2023-12-27 23:39:05,067][106226] Updated weights for policy 0, policy_version 613384 (0.0005) [2023-12-27 23:39:05,272][106225] Updated weights for policy 1, policy_version 615349 (0.0009) [2023-12-27 23:39:05,333][106225] Updated weights for policy 1, policy_version 615359 (0.0008) [2023-12-27 23:39:05,388][106225] Updated weights for policy 1, policy_version 615369 (0.0008) [2023-12-27 23:39:05,650][106226] Updated weights for policy 0, policy_version 613394 (0.0006) [2023-12-27 23:39:05,711][106226] Updated weights for policy 0, policy_version 613404 (0.0005) [2023-12-27 23:39:05,762][106226] Updated weights for policy 0, policy_version 613414 (0.0005) [2023-12-27 23:39:05,813][106226] Updated weights for policy 0, policy_version 613424 (0.0007) [2023-12-27 23:39:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 314638336. Throughput: 0: 10259.4, 1: 9683.4. Samples: 314651076. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:06,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.973')] [2023-12-27 23:39:06,196][106225] Updated weights for policy 1, policy_version 615379 (0.0008) [2023-12-27 23:39:06,259][106225] Updated weights for policy 1, policy_version 615389 (0.0008) [2023-12-27 23:39:06,320][106225] Updated weights for policy 1, policy_version 615399 (0.0008) [2023-12-27 23:39:06,434][106226] Updated weights for policy 0, policy_version 613434 (0.0007) [2023-12-27 23:39:06,506][106226] Updated weights for policy 0, policy_version 613444 (0.0008) [2023-12-27 23:39:06,570][106226] Updated weights for policy 0, policy_version 613454 (0.0008) [2023-12-27 23:39:07,080][106225] Updated weights for policy 1, policy_version 615409 (0.0009) [2023-12-27 23:39:07,140][106225] Updated weights for policy 1, policy_version 615419 (0.0008) [2023-12-27 23:39:07,204][106225] Updated weights for policy 1, policy_version 615429 (0.0007) [2023-12-27 23:39:07,206][106226] Updated weights for policy 0, policy_version 613464 (0.0007) [2023-12-27 23:39:07,261][106225] Updated weights for policy 1, policy_version 615439 (0.0008) [2023-12-27 23:39:07,266][106226] Updated weights for policy 0, policy_version 613474 (0.0006) [2023-12-27 23:39:07,324][106226] Updated weights for policy 0, policy_version 613484 (0.0006) [2023-12-27 23:39:07,908][106226] Updated weights for policy 0, policy_version 613494 (0.0008) [2023-12-27 23:39:07,956][106226] Updated weights for policy 0, policy_version 613504 (0.0009) [2023-12-27 23:39:08,019][106226] Updated weights for policy 0, policy_version 613514 (0.0010) [2023-12-27 23:39:08,030][106225] Updated weights for policy 1, policy_version 615449 (0.0008) [2023-12-27 23:39:08,085][106225] Updated weights for policy 1, policy_version 615459 (0.0006) [2023-12-27 23:39:08,144][106225] Updated weights for policy 1, policy_version 615469 (0.0008) [2023-12-27 23:39:08,763][106226] Updated weights for policy 0, policy_version 613524 (0.0009) [2023-12-27 23:39:08,827][106226] Updated weights for policy 0, policy_version 613534 (0.0006) [2023-12-27 23:39:08,884][106226] Updated weights for policy 0, policy_version 613544 (0.0007) [2023-12-27 23:39:08,897][106225] Updated weights for policy 1, policy_version 615479 (0.0008) [2023-12-27 23:39:08,965][106225] Updated weights for policy 1, policy_version 615489 (0.0010) [2023-12-27 23:39:09,023][106225] Updated weights for policy 1, policy_version 615499 (0.0009) [2023-12-27 23:39:09,570][106226] Updated weights for policy 0, policy_version 613554 (0.0006) [2023-12-27 23:39:09,635][106226] Updated weights for policy 0, policy_version 613564 (0.0008) [2023-12-27 23:39:09,706][106226] Updated weights for policy 0, policy_version 613574 (0.0009) [2023-12-27 23:39:09,768][106226] Updated weights for policy 0, policy_version 613584 (0.0009) [2023-12-27 23:39:09,818][106225] Updated weights for policy 1, policy_version 615509 (0.0006) [2023-12-27 23:39:09,883][106225] Updated weights for policy 1, policy_version 615519 (0.0010) [2023-12-27 23:39:09,954][106225] Updated weights for policy 1, policy_version 615529 (0.0007) [2023-12-27 23:39:10,580][106226] Updated weights for policy 0, policy_version 613594 (0.0008) [2023-12-27 23:39:10,624][106225] Updated weights for policy 1, policy_version 615539 (0.0007) [2023-12-27 23:39:10,643][106226] Updated weights for policy 0, policy_version 613604 (0.0008) [2023-12-27 23:39:10,691][106225] Updated weights for policy 1, policy_version 615549 (0.0005) [2023-12-27 23:39:10,695][106226] Updated weights for policy 0, policy_version 613614 (0.0008) [2023-12-27 23:39:10,758][106225] Updated weights for policy 1, policy_version 615559 (0.0006) [2023-12-27 23:39:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 314736640. Throughput: 0: 10309.2, 1: 9675.6. Samples: 314709804. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:11,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-5.979')] [2023-12-27 23:39:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000615568_157614080.pth... [2023-12-27 23:39:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000613616_157122560.pth... [2023-12-27 23:39:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000614448_157327360.pth [2023-12-27 23:39:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000612432_156819456.pth [2023-12-27 23:39:11,491][106225] Updated weights for policy 1, policy_version 615569 (0.0008) [2023-12-27 23:39:11,506][106226] Updated weights for policy 0, policy_version 613624 (0.0007) [2023-12-27 23:39:11,561][106225] Updated weights for policy 1, policy_version 615579 (0.0008) [2023-12-27 23:39:11,574][106226] Updated weights for policy 0, policy_version 613634 (0.0009) [2023-12-27 23:39:11,623][106225] Updated weights for policy 1, policy_version 615589 (0.0007) [2023-12-27 23:39:11,638][106226] Updated weights for policy 0, policy_version 613644 (0.0007) [2023-12-27 23:39:11,692][106225] Updated weights for policy 1, policy_version 615599 (0.0008) [2023-12-27 23:39:12,402][106226] Updated weights for policy 0, policy_version 613654 (0.0009) [2023-12-27 23:39:12,418][106225] Updated weights for policy 1, policy_version 615609 (0.0008) [2023-12-27 23:39:12,466][106226] Updated weights for policy 0, policy_version 613664 (0.0007) [2023-12-27 23:39:12,477][106225] Updated weights for policy 1, policy_version 615619 (0.0008) [2023-12-27 23:39:12,525][106226] Updated weights for policy 0, policy_version 613674 (0.0007) [2023-12-27 23:39:12,536][106225] Updated weights for policy 1, policy_version 615629 (0.0008) [2023-12-27 23:39:13,185][106226] Updated weights for policy 0, policy_version 613684 (0.0006) [2023-12-27 23:39:13,266][106225] Updated weights for policy 1, policy_version 615639 (0.0009) [2023-12-27 23:39:13,274][106226] Updated weights for policy 0, policy_version 613694 (0.0005) [2023-12-27 23:39:13,316][106225] Updated weights for policy 1, policy_version 615649 (0.0010) [2023-12-27 23:39:13,330][106226] Updated weights for policy 0, policy_version 613704 (0.0005) [2023-12-27 23:39:13,366][106225] Updated weights for policy 1, policy_version 615659 (0.0010) [2023-12-27 23:39:13,952][106226] Updated weights for policy 0, policy_version 613714 (0.0006) [2023-12-27 23:39:14,002][106226] Updated weights for policy 0, policy_version 613724 (0.0008) [2023-12-27 23:39:14,049][106226] Updated weights for policy 0, policy_version 613734 (0.0008) [2023-12-27 23:39:14,071][106225] Updated weights for policy 1, policy_version 615669 (0.0009) [2023-12-27 23:39:14,098][106226] Updated weights for policy 0, policy_version 613744 (0.0007) [2023-12-27 23:39:14,128][106225] Updated weights for policy 1, policy_version 615679 (0.0005) [2023-12-27 23:39:14,186][106225] Updated weights for policy 1, policy_version 615689 (0.0005) [2023-12-27 23:39:14,821][106225] Updated weights for policy 1, policy_version 615699 (0.0007) [2023-12-27 23:39:14,876][106225] Updated weights for policy 1, policy_version 615709 (0.0009) [2023-12-27 23:39:14,886][106226] Updated weights for policy 0, policy_version 613754 (0.0007) [2023-12-27 23:39:14,938][106225] Updated weights for policy 1, policy_version 615719 (0.0006) [2023-12-27 23:39:14,948][106226] Updated weights for policy 0, policy_version 613764 (0.0006) [2023-12-27 23:39:15,009][106226] Updated weights for policy 0, policy_version 613774 (0.0007) [2023-12-27 23:39:15,658][106225] Updated weights for policy 1, policy_version 615729 (0.0007) [2023-12-27 23:39:15,711][106225] Updated weights for policy 1, policy_version 615739 (0.0007) [2023-12-27 23:39:15,717][106226] Updated weights for policy 0, policy_version 613784 (0.0010) [2023-12-27 23:39:15,760][106225] Updated weights for policy 1, policy_version 615749 (0.0005) [2023-12-27 23:39:15,773][106226] Updated weights for policy 0, policy_version 613794 (0.0010) [2023-12-27 23:39:15,823][106225] Updated weights for policy 1, policy_version 615759 (0.0006) [2023-12-27 23:39:15,831][106226] Updated weights for policy 0, policy_version 613804 (0.0005) [2023-12-27 23:39:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 314834944. Throughput: 0: 10148.5, 1: 9587.4. Samples: 314823240. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:16,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.796')] [2023-12-27 23:39:16,394][106225] Updated weights for policy 1, policy_version 615769 (0.0010) [2023-12-27 23:39:16,395][106226] Updated weights for policy 0, policy_version 613814 (0.0005) [2023-12-27 23:39:16,445][106225] Updated weights for policy 1, policy_version 615779 (0.0010) [2023-12-27 23:39:16,456][106226] Updated weights for policy 0, policy_version 613824 (0.0009) [2023-12-27 23:39:16,491][106225] Updated weights for policy 1, policy_version 615789 (0.0010) [2023-12-27 23:39:16,516][106226] Updated weights for policy 0, policy_version 613834 (0.0011) [2023-12-27 23:39:17,103][106225] Updated weights for policy 1, policy_version 615799 (0.0007) [2023-12-27 23:39:17,171][106225] Updated weights for policy 1, policy_version 615809 (0.0005) [2023-12-27 23:39:17,206][106226] Updated weights for policy 0, policy_version 613844 (0.0009) [2023-12-27 23:39:17,228][106225] Updated weights for policy 1, policy_version 615819 (0.0010) [2023-12-27 23:39:17,268][106226] Updated weights for policy 0, policy_version 613854 (0.0006) [2023-12-27 23:39:17,328][106226] Updated weights for policy 0, policy_version 613864 (0.0007) [2023-12-27 23:39:17,833][106225] Updated weights for policy 1, policy_version 615829 (0.0008) [2023-12-27 23:39:17,890][106225] Updated weights for policy 1, policy_version 615839 (0.0005) [2023-12-27 23:39:17,961][106225] Updated weights for policy 1, policy_version 615849 (0.0007) [2023-12-27 23:39:18,055][106226] Updated weights for policy 0, policy_version 613874 (0.0007) [2023-12-27 23:39:18,125][106226] Updated weights for policy 0, policy_version 613884 (0.0005) [2023-12-27 23:39:18,193][106226] Updated weights for policy 0, policy_version 613894 (0.0006) [2023-12-27 23:39:18,248][106226] Updated weights for policy 0, policy_version 613904 (0.0006) [2023-12-27 23:39:18,626][106225] Updated weights for policy 1, policy_version 615859 (0.0008) [2023-12-27 23:39:18,695][106225] Updated weights for policy 1, policy_version 615869 (0.0008) [2023-12-27 23:39:18,763][106225] Updated weights for policy 1, policy_version 615879 (0.0008) [2023-12-27 23:39:18,800][106226] Updated weights for policy 0, policy_version 613914 (0.0007) [2023-12-27 23:39:18,856][106226] Updated weights for policy 0, policy_version 613924 (0.0009) [2023-12-27 23:39:18,917][106226] Updated weights for policy 0, policy_version 613934 (0.0007) [2023-12-27 23:39:19,486][106225] Updated weights for policy 1, policy_version 615889 (0.0008) [2023-12-27 23:39:19,549][106225] Updated weights for policy 1, policy_version 615899 (0.0008) [2023-12-27 23:39:19,603][106225] Updated weights for policy 1, policy_version 615909 (0.0008) [2023-12-27 23:39:19,636][106226] Updated weights for policy 0, policy_version 613944 (0.0008) [2023-12-27 23:39:19,663][106225] Updated weights for policy 1, policy_version 615919 (0.0008) [2023-12-27 23:39:19,696][106226] Updated weights for policy 0, policy_version 613954 (0.0008) [2023-12-27 23:39:19,754][106226] Updated weights for policy 0, policy_version 613964 (0.0008) [2023-12-27 23:39:20,445][106225] Updated weights for policy 1, policy_version 615929 (0.0006) [2023-12-27 23:39:20,503][106225] Updated weights for policy 1, policy_version 615939 (0.0006) [2023-12-27 23:39:20,559][106226] Updated weights for policy 0, policy_version 613974 (0.0009) [2023-12-27 23:39:20,568][106225] Updated weights for policy 1, policy_version 615949 (0.0007) [2023-12-27 23:39:20,631][106226] Updated weights for policy 0, policy_version 613984 (0.0008) [2023-12-27 23:39:20,695][106226] Updated weights for policy 0, policy_version 613994 (0.0008) [2023-12-27 23:39:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 314933248. Throughput: 0: 10130.3, 1: 9597.6. Samples: 314944448. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:21,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-6.145')] [2023-12-27 23:39:21,333][106225] Updated weights for policy 1, policy_version 615959 (0.0008) [2023-12-27 23:39:21,410][106225] Updated weights for policy 1, policy_version 615969 (0.0008) [2023-12-27 23:39:21,473][106225] Updated weights for policy 1, policy_version 615979 (0.0008) [2023-12-27 23:39:21,479][106226] Updated weights for policy 0, policy_version 614004 (0.0008) [2023-12-27 23:39:21,534][106226] Updated weights for policy 0, policy_version 614014 (0.0008) [2023-12-27 23:39:21,597][106226] Updated weights for policy 0, policy_version 614024 (0.0007) [2023-12-27 23:39:22,163][106225] Updated weights for policy 1, policy_version 615989 (0.0008) [2023-12-27 23:39:22,230][106225] Updated weights for policy 1, policy_version 615999 (0.0006) [2023-12-27 23:39:22,298][106225] Updated weights for policy 1, policy_version 616009 (0.0007) [2023-12-27 23:39:22,377][106226] Updated weights for policy 0, policy_version 614034 (0.0008) [2023-12-27 23:39:22,438][106226] Updated weights for policy 0, policy_version 614044 (0.0006) [2023-12-27 23:39:22,508][106226] Updated weights for policy 0, policy_version 614054 (0.0008) [2023-12-27 23:39:22,566][106226] Updated weights for policy 0, policy_version 614064 (0.0006) [2023-12-27 23:39:23,031][106225] Updated weights for policy 1, policy_version 616019 (0.0009) [2023-12-27 23:39:23,079][106225] Updated weights for policy 1, policy_version 616029 (0.0008) [2023-12-27 23:39:23,139][106225] Updated weights for policy 1, policy_version 616039 (0.0009) [2023-12-27 23:39:23,227][106226] Updated weights for policy 0, policy_version 614074 (0.0007) [2023-12-27 23:39:23,285][106226] Updated weights for policy 0, policy_version 614084 (0.0009) [2023-12-27 23:39:23,354][106226] Updated weights for policy 0, policy_version 614094 (0.0010) [2023-12-27 23:39:23,903][106226] Updated weights for policy 0, policy_version 614104 (0.0006) [2023-12-27 23:39:23,936][106225] Updated weights for policy 1, policy_version 616049 (0.0008) [2023-12-27 23:39:23,966][106226] Updated weights for policy 0, policy_version 614114 (0.0006) [2023-12-27 23:39:23,988][106225] Updated weights for policy 1, policy_version 616059 (0.0008) [2023-12-27 23:39:24,022][106226] Updated weights for policy 0, policy_version 614124 (0.0006) [2023-12-27 23:39:24,044][106225] Updated weights for policy 1, policy_version 616069 (0.0006) [2023-12-27 23:39:24,100][106225] Updated weights for policy 1, policy_version 616079 (0.0008) [2023-12-27 23:39:24,723][106226] Updated weights for policy 0, policy_version 614134 (0.0006) [2023-12-27 23:39:24,783][106226] Updated weights for policy 0, policy_version 614144 (0.0005) [2023-12-27 23:39:24,820][106225] Updated weights for policy 1, policy_version 616089 (0.0008) [2023-12-27 23:39:24,850][106226] Updated weights for policy 0, policy_version 614154 (0.0009) [2023-12-27 23:39:24,866][106225] Updated weights for policy 1, policy_version 616099 (0.0007) [2023-12-27 23:39:24,914][106225] Updated weights for policy 1, policy_version 616109 (0.0007) [2023-12-27 23:39:25,412][106226] Updated weights for policy 0, policy_version 614164 (0.0010) [2023-12-27 23:39:25,464][106226] Updated weights for policy 0, policy_version 614174 (0.0010) [2023-12-27 23:39:25,526][106226] Updated weights for policy 0, policy_version 614184 (0.0010) [2023-12-27 23:39:25,642][106225] Updated weights for policy 1, policy_version 616119 (0.0008) [2023-12-27 23:39:25,698][106225] Updated weights for policy 1, policy_version 616129 (0.0007) [2023-12-27 23:39:25,761][106225] Updated weights for policy 1, policy_version 616139 (0.0008) [2023-12-27 23:39:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 315031552. Throughput: 0: 10116.5, 1: 9605.5. Samples: 315002148. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:26,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.971')] [2023-12-27 23:39:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000616144_157761536.pth... [2023-12-27 23:39:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000614192_157270016.pth... [2023-12-27 23:39:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000613040_156975104.pth [2023-12-27 23:39:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000615024_157474816.pth [2023-12-27 23:39:26,227][106226] Updated weights for policy 0, policy_version 614194 (0.0009) [2023-12-27 23:39:26,272][106226] Updated weights for policy 0, policy_version 614204 (0.0005) [2023-12-27 23:39:26,318][106226] Updated weights for policy 0, policy_version 614214 (0.0005) [2023-12-27 23:39:26,364][106226] Updated weights for policy 0, policy_version 614224 (0.0005) [2023-12-27 23:39:26,507][106225] Updated weights for policy 1, policy_version 616149 (0.0008) [2023-12-27 23:39:26,566][106225] Updated weights for policy 1, policy_version 616159 (0.0008) [2023-12-27 23:39:26,623][106225] Updated weights for policy 1, policy_version 616169 (0.0008) [2023-12-27 23:39:27,083][106226] Updated weights for policy 0, policy_version 614234 (0.0010) [2023-12-27 23:39:27,133][106226] Updated weights for policy 0, policy_version 614244 (0.0010) [2023-12-27 23:39:27,179][106226] Updated weights for policy 0, policy_version 614254 (0.0010) [2023-12-27 23:39:27,370][106225] Updated weights for policy 1, policy_version 616179 (0.0008) [2023-12-27 23:39:27,434][106225] Updated weights for policy 1, policy_version 616189 (0.0007) [2023-12-27 23:39:27,489][106225] Updated weights for policy 1, policy_version 616199 (0.0009) [2023-12-27 23:39:27,853][106226] Updated weights for policy 0, policy_version 614264 (0.0009) [2023-12-27 23:39:27,896][106226] Updated weights for policy 0, policy_version 614274 (0.0010) [2023-12-27 23:39:27,954][106226] Updated weights for policy 0, policy_version 614284 (0.0010) [2023-12-27 23:39:28,199][106225] Updated weights for policy 1, policy_version 616209 (0.0007) [2023-12-27 23:39:28,247][106225] Updated weights for policy 1, policy_version 616219 (0.0008) [2023-12-27 23:39:28,297][106225] Updated weights for policy 1, policy_version 616229 (0.0008) [2023-12-27 23:39:28,352][106225] Updated weights for policy 1, policy_version 616239 (0.0007) [2023-12-27 23:39:28,626][106226] Updated weights for policy 0, policy_version 614294 (0.0007) [2023-12-27 23:39:28,694][106226] Updated weights for policy 0, policy_version 614304 (0.0006) [2023-12-27 23:39:28,749][106226] Updated weights for policy 0, policy_version 614314 (0.0006) [2023-12-27 23:39:29,063][106225] Updated weights for policy 1, policy_version 616249 (0.0009) [2023-12-27 23:39:29,121][106225] Updated weights for policy 1, policy_version 616259 (0.0009) [2023-12-27 23:39:29,169][106225] Updated weights for policy 1, policy_version 616269 (0.0007) [2023-12-27 23:39:29,261][106226] Updated weights for policy 0, policy_version 614324 (0.0006) [2023-12-27 23:39:29,324][106226] Updated weights for policy 0, policy_version 614334 (0.0007) [2023-12-27 23:39:29,389][106226] Updated weights for policy 0, policy_version 614344 (0.0009) [2023-12-27 23:39:29,992][106225] Updated weights for policy 1, policy_version 616279 (0.0007) [2023-12-27 23:39:30,048][106225] Updated weights for policy 1, policy_version 616289 (0.0007) [2023-12-27 23:39:30,098][106225] Updated weights for policy 1, policy_version 616299 (0.0007) [2023-12-27 23:39:30,099][106226] Updated weights for policy 0, policy_version 614354 (0.0011) [2023-12-27 23:39:30,160][106226] Updated weights for policy 0, policy_version 614364 (0.0011) [2023-12-27 23:39:30,220][106226] Updated weights for policy 0, policy_version 614374 (0.0010) [2023-12-27 23:39:30,277][106226] Updated weights for policy 0, policy_version 614384 (0.0011) [2023-12-27 23:39:30,799][106225] Updated weights for policy 1, policy_version 616309 (0.0006) [2023-12-27 23:39:30,851][106225] Updated weights for policy 1, policy_version 616319 (0.0006) [2023-12-27 23:39:30,903][106225] Updated weights for policy 1, policy_version 616329 (0.0008) [2023-12-27 23:39:30,972][106226] Updated weights for policy 0, policy_version 614394 (0.0005) [2023-12-27 23:39:31,028][106226] Updated weights for policy 0, policy_version 614404 (0.0006) [2023-12-27 23:39:31,091][106226] Updated weights for policy 0, policy_version 614414 (0.0008) [2023-12-27 23:39:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 315138048. Throughput: 0: 10143.7, 1: 9622.7. Samples: 315122404. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:31,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.872')] [2023-12-27 23:39:31,641][106225] Updated weights for policy 1, policy_version 616339 (0.0008) [2023-12-27 23:39:31,701][106225] Updated weights for policy 1, policy_version 616349 (0.0008) [2023-12-27 23:39:31,764][106225] Updated weights for policy 1, policy_version 616359 (0.0009) [2023-12-27 23:39:31,835][106226] Updated weights for policy 0, policy_version 614424 (0.0007) [2023-12-27 23:39:31,895][106226] Updated weights for policy 0, policy_version 614434 (0.0007) [2023-12-27 23:39:31,954][106226] Updated weights for policy 0, policy_version 614444 (0.0009) [2023-12-27 23:39:32,421][106225] Updated weights for policy 1, policy_version 616369 (0.0008) [2023-12-27 23:39:32,483][106225] Updated weights for policy 1, policy_version 616379 (0.0008) [2023-12-27 23:39:32,540][106225] Updated weights for policy 1, policy_version 616389 (0.0008) [2023-12-27 23:39:32,601][106225] Updated weights for policy 1, policy_version 616399 (0.0009) [2023-12-27 23:39:32,662][106226] Updated weights for policy 0, policy_version 614454 (0.0009) [2023-12-27 23:39:32,714][106226] Updated weights for policy 0, policy_version 614464 (0.0009) [2023-12-27 23:39:32,762][106226] Updated weights for policy 0, policy_version 614474 (0.0008) [2023-12-27 23:39:33,312][106225] Updated weights for policy 1, policy_version 616409 (0.0006) [2023-12-27 23:39:33,342][106226] Updated weights for policy 0, policy_version 614484 (0.0009) [2023-12-27 23:39:33,367][106225] Updated weights for policy 1, policy_version 616419 (0.0007) [2023-12-27 23:39:33,402][106226] Updated weights for policy 0, policy_version 614494 (0.0010) [2023-12-27 23:39:33,425][106225] Updated weights for policy 1, policy_version 616429 (0.0006) [2023-12-27 23:39:33,455][106226] Updated weights for policy 0, policy_version 614504 (0.0010) [2023-12-27 23:39:33,967][106225] Updated weights for policy 1, policy_version 616439 (0.0008) [2023-12-27 23:39:34,016][106225] Updated weights for policy 1, policy_version 616449 (0.0010) [2023-12-27 23:39:34,079][106225] Updated weights for policy 1, policy_version 616459 (0.0010) [2023-12-27 23:39:34,100][106226] Updated weights for policy 0, policy_version 614514 (0.0010) [2023-12-27 23:39:34,157][106226] Updated weights for policy 0, policy_version 614524 (0.0007) [2023-12-27 23:39:34,221][106226] Updated weights for policy 0, policy_version 614534 (0.0009) [2023-12-27 23:39:34,284][106226] Updated weights for policy 0, policy_version 614544 (0.0008) [2023-12-27 23:39:34,780][106225] Updated weights for policy 1, policy_version 616469 (0.0010) [2023-12-27 23:39:34,833][106225] Updated weights for policy 1, policy_version 616479 (0.0010) [2023-12-27 23:39:34,886][106225] Updated weights for policy 1, policy_version 616489 (0.0010) [2023-12-27 23:39:35,036][106226] Updated weights for policy 0, policy_version 614554 (0.0010) [2023-12-27 23:39:35,093][106226] Updated weights for policy 0, policy_version 614564 (0.0009) [2023-12-27 23:39:35,151][106226] Updated weights for policy 0, policy_version 614574 (0.0009) [2023-12-27 23:39:35,443][106225] Updated weights for policy 1, policy_version 616499 (0.0008) [2023-12-27 23:39:35,492][106225] Updated weights for policy 1, policy_version 616509 (0.0006) [2023-12-27 23:39:35,536][106225] Updated weights for policy 1, policy_version 616519 (0.0005) [2023-12-27 23:39:35,777][106226] Updated weights for policy 0, policy_version 614584 (0.0006) [2023-12-27 23:39:35,827][106226] Updated weights for policy 0, policy_version 614594 (0.0006) [2023-12-27 23:39:35,878][106226] Updated weights for policy 0, policy_version 614604 (0.0005) [2023-12-27 23:39:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 315236352. Throughput: 0: 10169.9, 1: 9798.2. Samples: 315246732. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:36,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.663')] [2023-12-27 23:39:36,233][106225] Updated weights for policy 1, policy_version 616529 (0.0007) [2023-12-27 23:39:36,301][106225] Updated weights for policy 1, policy_version 616539 (0.0008) [2023-12-27 23:39:36,366][106225] Updated weights for policy 1, policy_version 616549 (0.0008) [2023-12-27 23:39:36,431][106225] Updated weights for policy 1, policy_version 616559 (0.0009) [2023-12-27 23:39:36,523][106226] Updated weights for policy 0, policy_version 614614 (0.0007) [2023-12-27 23:39:36,587][106226] Updated weights for policy 0, policy_version 614624 (0.0007) [2023-12-27 23:39:36,658][106226] Updated weights for policy 0, policy_version 614634 (0.0007) [2023-12-27 23:39:37,190][106225] Updated weights for policy 1, policy_version 616569 (0.0010) [2023-12-27 23:39:37,252][106225] Updated weights for policy 1, policy_version 616579 (0.0011) [2023-12-27 23:39:37,271][106226] Updated weights for policy 0, policy_version 614644 (0.0009) [2023-12-27 23:39:37,299][106225] Updated weights for policy 1, policy_version 616589 (0.0010) [2023-12-27 23:39:37,328][106226] Updated weights for policy 0, policy_version 614654 (0.0006) [2023-12-27 23:39:37,397][106226] Updated weights for policy 0, policy_version 614664 (0.0009) [2023-12-27 23:39:37,863][106225] Updated weights for policy 1, policy_version 616599 (0.0010) [2023-12-27 23:39:37,910][106225] Updated weights for policy 1, policy_version 616609 (0.0010) [2023-12-27 23:39:37,957][106225] Updated weights for policy 1, policy_version 616619 (0.0010) [2023-12-27 23:39:37,982][106226] Updated weights for policy 0, policy_version 614674 (0.0008) [2023-12-27 23:39:38,044][106226] Updated weights for policy 0, policy_version 614684 (0.0006) [2023-12-27 23:39:38,107][106226] Updated weights for policy 0, policy_version 614694 (0.0006) [2023-12-27 23:39:38,165][106226] Updated weights for policy 0, policy_version 614704 (0.0008) [2023-12-27 23:39:38,722][106225] Updated weights for policy 1, policy_version 616629 (0.0010) [2023-12-27 23:39:38,778][106225] Updated weights for policy 1, policy_version 616639 (0.0011) [2023-12-27 23:39:38,840][106225] Updated weights for policy 1, policy_version 616649 (0.0011) [2023-12-27 23:39:38,870][106226] Updated weights for policy 0, policy_version 614714 (0.0006) [2023-12-27 23:39:38,920][106226] Updated weights for policy 0, policy_version 614724 (0.0007) [2023-12-27 23:39:38,981][106226] Updated weights for policy 0, policy_version 614734 (0.0008) [2023-12-27 23:39:39,614][106225] Updated weights for policy 1, policy_version 616659 (0.0010) [2023-12-27 23:39:39,680][106225] Updated weights for policy 1, policy_version 616669 (0.0011) [2023-12-27 23:39:39,740][106225] Updated weights for policy 1, policy_version 616679 (0.0010) [2023-12-27 23:39:39,814][106226] Updated weights for policy 0, policy_version 614744 (0.0007) [2023-12-27 23:39:39,883][106226] Updated weights for policy 0, policy_version 614754 (0.0009) [2023-12-27 23:39:39,949][106226] Updated weights for policy 0, policy_version 614764 (0.0008) [2023-12-27 23:39:40,487][106225] Updated weights for policy 1, policy_version 616689 (0.0008) [2023-12-27 23:39:40,554][106225] Updated weights for policy 1, policy_version 616699 (0.0010) [2023-12-27 23:39:40,612][106225] Updated weights for policy 1, policy_version 616709 (0.0010) [2023-12-27 23:39:40,666][106225] Updated weights for policy 1, policy_version 616719 (0.0010) [2023-12-27 23:39:40,714][106226] Updated weights for policy 0, policy_version 614774 (0.0008) [2023-12-27 23:39:40,772][106226] Updated weights for policy 0, policy_version 614784 (0.0007) [2023-12-27 23:39:40,833][106226] Updated weights for policy 0, policy_version 614794 (0.0008) [2023-12-27 23:39:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 315334656. Throughput: 0: 10200.0, 1: 9833.0. Samples: 315307144. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:41,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-5.854')] [2023-12-27 23:39:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000616720_157908992.pth... [2023-12-27 23:39:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000614800_157425664.pth... [2023-12-27 23:39:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000613616_157122560.pth [2023-12-27 23:39:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000615568_157614080.pth [2023-12-27 23:39:41,440][106225] Updated weights for policy 1, policy_version 616729 (0.0007) [2023-12-27 23:39:41,501][106225] Updated weights for policy 1, policy_version 616739 (0.0007) [2023-12-27 23:39:41,566][106225] Updated weights for policy 1, policy_version 616749 (0.0009) [2023-12-27 23:39:41,715][106226] Updated weights for policy 0, policy_version 614804 (0.0008) [2023-12-27 23:39:41,794][106226] Updated weights for policy 0, policy_version 614814 (0.0008) [2023-12-27 23:39:41,864][106226] Updated weights for policy 0, policy_version 614824 (0.0007) [2023-12-27 23:39:42,338][106225] Updated weights for policy 1, policy_version 616759 (0.0009) [2023-12-27 23:39:42,412][106225] Updated weights for policy 1, policy_version 616769 (0.0010) [2023-12-27 23:39:42,478][106225] Updated weights for policy 1, policy_version 616779 (0.0008) [2023-12-27 23:39:42,543][106226] Updated weights for policy 0, policy_version 614834 (0.0009) [2023-12-27 23:39:42,611][106226] Updated weights for policy 0, policy_version 614844 (0.0008) [2023-12-27 23:39:42,667][106226] Updated weights for policy 0, policy_version 614854 (0.0008) [2023-12-27 23:39:42,722][106226] Updated weights for policy 0, policy_version 614864 (0.0009) [2023-12-27 23:39:43,210][106225] Updated weights for policy 1, policy_version 616789 (0.0008) [2023-12-27 23:39:43,274][106225] Updated weights for policy 1, policy_version 616799 (0.0008) [2023-12-27 23:39:43,331][106225] Updated weights for policy 1, policy_version 616809 (0.0010) [2023-12-27 23:39:43,468][106226] Updated weights for policy 0, policy_version 614874 (0.0009) [2023-12-27 23:39:43,527][106226] Updated weights for policy 0, policy_version 614884 (0.0007) [2023-12-27 23:39:43,585][106226] Updated weights for policy 0, policy_version 614894 (0.0010) [2023-12-27 23:39:44,002][106225] Updated weights for policy 1, policy_version 616819 (0.0010) [2023-12-27 23:39:44,051][106225] Updated weights for policy 1, policy_version 616829 (0.0006) [2023-12-27 23:39:44,107][106225] Updated weights for policy 1, policy_version 616839 (0.0006) [2023-12-27 23:39:44,304][106226] Updated weights for policy 0, policy_version 614904 (0.0009) [2023-12-27 23:39:44,349][106226] Updated weights for policy 0, policy_version 614914 (0.0007) [2023-12-27 23:39:44,405][106226] Updated weights for policy 0, policy_version 614924 (0.0005) [2023-12-27 23:39:44,760][106225] Updated weights for policy 1, policy_version 616849 (0.0006) [2023-12-27 23:39:44,827][106225] Updated weights for policy 1, policy_version 616859 (0.0008) [2023-12-27 23:39:44,880][106225] Updated weights for policy 1, policy_version 616869 (0.0009) [2023-12-27 23:39:44,936][106225] Updated weights for policy 1, policy_version 616879 (0.0011) [2023-12-27 23:39:45,124][106226] Updated weights for policy 0, policy_version 614934 (0.0005) [2023-12-27 23:39:45,184][106226] Updated weights for policy 0, policy_version 614944 (0.0007) [2023-12-27 23:39:45,248][106226] Updated weights for policy 0, policy_version 614954 (0.0008) [2023-12-27 23:39:45,600][106225] Updated weights for policy 1, policy_version 616889 (0.0006) [2023-12-27 23:39:45,655][106225] Updated weights for policy 1, policy_version 616899 (0.0006) [2023-12-27 23:39:45,708][106225] Updated weights for policy 1, policy_version 616909 (0.0007) [2023-12-27 23:39:46,007][106226] Updated weights for policy 0, policy_version 614964 (0.0008) [2023-12-27 23:39:46,068][106226] Updated weights for policy 0, policy_version 614974 (0.0008) [2023-12-27 23:39:46,127][106226] Updated weights for policy 0, policy_version 614984 (0.0009) [2023-12-27 23:39:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 315432960. Throughput: 0: 10026.2, 1: 9762.5. Samples: 315420156. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:46,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-5.692')] [2023-12-27 23:39:46,320][106225] Updated weights for policy 1, policy_version 616919 (0.0008) [2023-12-27 23:39:46,379][106225] Updated weights for policy 1, policy_version 616929 (0.0008) [2023-12-27 23:39:46,439][106225] Updated weights for policy 1, policy_version 616939 (0.0009) [2023-12-27 23:39:46,794][106226] Updated weights for policy 0, policy_version 614994 (0.0008) [2023-12-27 23:39:46,840][106226] Updated weights for policy 0, policy_version 615004 (0.0008) [2023-12-27 23:39:46,900][106226] Updated weights for policy 0, policy_version 615014 (0.0008) [2023-12-27 23:39:46,956][106226] Updated weights for policy 0, policy_version 615024 (0.0008) [2023-12-27 23:39:47,152][106225] Updated weights for policy 1, policy_version 616949 (0.0009) [2023-12-27 23:39:47,209][106225] Updated weights for policy 1, policy_version 616959 (0.0010) [2023-12-27 23:39:47,265][106225] Updated weights for policy 1, policy_version 616969 (0.0010) [2023-12-27 23:39:47,675][106226] Updated weights for policy 0, policy_version 615034 (0.0008) [2023-12-27 23:39:47,732][106226] Updated weights for policy 0, policy_version 615044 (0.0007) [2023-12-27 23:39:47,786][106226] Updated weights for policy 0, policy_version 615054 (0.0008) [2023-12-27 23:39:47,993][106225] Updated weights for policy 1, policy_version 616979 (0.0010) [2023-12-27 23:39:48,045][106225] Updated weights for policy 1, policy_version 616989 (0.0010) [2023-12-27 23:39:48,098][106225] Updated weights for policy 1, policy_version 616999 (0.0010) [2023-12-27 23:39:48,527][106226] Updated weights for policy 0, policy_version 615064 (0.0010) [2023-12-27 23:39:48,583][106226] Updated weights for policy 0, policy_version 615074 (0.0010) [2023-12-27 23:39:48,641][106226] Updated weights for policy 0, policy_version 615084 (0.0011) [2023-12-27 23:39:48,809][106225] Updated weights for policy 1, policy_version 617009 (0.0010) [2023-12-27 23:39:48,876][106225] Updated weights for policy 1, policy_version 617019 (0.0010) [2023-12-27 23:39:48,939][106225] Updated weights for policy 1, policy_version 617029 (0.0010) [2023-12-27 23:39:48,999][106225] Updated weights for policy 1, policy_version 617039 (0.0010) [2023-12-27 23:39:49,337][106226] Updated weights for policy 0, policy_version 615094 (0.0008) [2023-12-27 23:39:49,397][106226] Updated weights for policy 0, policy_version 615104 (0.0011) [2023-12-27 23:39:49,461][106226] Updated weights for policy 0, policy_version 615114 (0.0010) [2023-12-27 23:39:49,728][106225] Updated weights for policy 1, policy_version 617049 (0.0010) [2023-12-27 23:39:49,787][106225] Updated weights for policy 1, policy_version 617059 (0.0010) [2023-12-27 23:39:49,849][106225] Updated weights for policy 1, policy_version 617069 (0.0010) [2023-12-27 23:39:50,149][106226] Updated weights for policy 0, policy_version 615124 (0.0011) [2023-12-27 23:39:50,212][106226] Updated weights for policy 0, policy_version 615134 (0.0008) [2023-12-27 23:39:50,270][106226] Updated weights for policy 0, policy_version 615144 (0.0008) [2023-12-27 23:39:50,494][106225] Updated weights for policy 1, policy_version 617079 (0.0007) [2023-12-27 23:39:50,539][106225] Updated weights for policy 1, policy_version 617089 (0.0007) [2023-12-27 23:39:50,594][106225] Updated weights for policy 1, policy_version 617099 (0.0007) [2023-12-27 23:39:51,027][106226] Updated weights for policy 0, policy_version 615154 (0.0011) [2023-12-27 23:39:51,096][106226] Updated weights for policy 0, policy_version 615164 (0.0009) [2023-12-27 23:39:51,158][106226] Updated weights for policy 0, policy_version 615174 (0.0009) [2023-12-27 23:39:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 315523072. Throughput: 0: 9913.0, 1: 9802.4. Samples: 315538268. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:51,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-5.920')] [2023-12-27 23:39:51,216][106226] Updated weights for policy 0, policy_version 615184 (0.0009) [2023-12-27 23:39:51,336][106225] Updated weights for policy 1, policy_version 617109 (0.0006) [2023-12-27 23:39:51,398][106225] Updated weights for policy 1, policy_version 617119 (0.0008) [2023-12-27 23:39:51,464][106225] Updated weights for policy 1, policy_version 617129 (0.0008) [2023-12-27 23:39:52,023][106226] Updated weights for policy 0, policy_version 615194 (0.0006) [2023-12-27 23:39:52,085][106226] Updated weights for policy 0, policy_version 615204 (0.0009) [2023-12-27 23:39:52,143][106226] Updated weights for policy 0, policy_version 615214 (0.0008) [2023-12-27 23:39:52,151][106225] Updated weights for policy 1, policy_version 617139 (0.0009) [2023-12-27 23:39:52,215][106225] Updated weights for policy 1, policy_version 617149 (0.0010) [2023-12-27 23:39:52,281][106225] Updated weights for policy 1, policy_version 617159 (0.0006) [2023-12-27 23:39:52,757][106226] Updated weights for policy 0, policy_version 615224 (0.0005) [2023-12-27 23:39:52,808][106226] Updated weights for policy 0, policy_version 615234 (0.0005) [2023-12-27 23:39:52,859][106226] Updated weights for policy 0, policy_version 615244 (0.0005) [2023-12-27 23:39:52,987][106225] Updated weights for policy 1, policy_version 617169 (0.0007) [2023-12-27 23:39:53,038][106225] Updated weights for policy 1, policy_version 617179 (0.0010) [2023-12-27 23:39:53,092][106225] Updated weights for policy 1, policy_version 617189 (0.0010) [2023-12-27 23:39:53,152][106225] Updated weights for policy 1, policy_version 617199 (0.0010) [2023-12-27 23:39:53,512][106226] Updated weights for policy 0, policy_version 615254 (0.0007) [2023-12-27 23:39:53,565][106226] Updated weights for policy 0, policy_version 615264 (0.0008) [2023-12-27 23:39:53,611][106226] Updated weights for policy 0, policy_version 615274 (0.0007) [2023-12-27 23:39:53,839][106225] Updated weights for policy 1, policy_version 617209 (0.0010) [2023-12-27 23:39:53,888][106225] Updated weights for policy 1, policy_version 617219 (0.0010) [2023-12-27 23:39:53,939][106225] Updated weights for policy 1, policy_version 617229 (0.0010) [2023-12-27 23:39:54,342][106226] Updated weights for policy 0, policy_version 615284 (0.0007) [2023-12-27 23:39:54,399][106226] Updated weights for policy 0, policy_version 615294 (0.0008) [2023-12-27 23:39:54,452][106226] Updated weights for policy 0, policy_version 615304 (0.0008) [2023-12-27 23:39:54,691][106225] Updated weights for policy 1, policy_version 617239 (0.0007) [2023-12-27 23:39:54,746][106225] Updated weights for policy 1, policy_version 617249 (0.0008) [2023-12-27 23:39:54,801][106225] Updated weights for policy 1, policy_version 617259 (0.0008) [2023-12-27 23:39:55,137][106226] Updated weights for policy 0, policy_version 615314 (0.0007) [2023-12-27 23:39:55,202][106226] Updated weights for policy 0, policy_version 615324 (0.0007) [2023-12-27 23:39:55,262][106226] Updated weights for policy 0, policy_version 615334 (0.0009) [2023-12-27 23:39:55,317][106226] Updated weights for policy 0, policy_version 615344 (0.0007) [2023-12-27 23:39:55,416][106225] Updated weights for policy 1, policy_version 617269 (0.0006) [2023-12-27 23:39:55,462][106225] Updated weights for policy 1, policy_version 617279 (0.0005) [2023-12-27 23:39:55,511][106225] Updated weights for policy 1, policy_version 617289 (0.0008) [2023-12-27 23:39:55,957][106226] Updated weights for policy 0, policy_version 615354 (0.0007) [2023-12-27 23:39:56,015][106226] Updated weights for policy 0, policy_version 615364 (0.0009) [2023-12-27 23:39:56,066][106226] Updated weights for policy 0, policy_version 615374 (0.0008) [2023-12-27 23:39:56,072][106225] Updated weights for policy 1, policy_version 617299 (0.0009) [2023-12-27 23:39:56,125][106225] Updated weights for policy 1, policy_version 617309 (0.0005) [2023-12-27 23:39:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 315629568. Throughput: 0: 9880.7, 1: 9843.6. Samples: 315597396. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:39:56,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-5.843')] [2023-12-27 23:39:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000615376_157573120.pth... [2023-12-27 23:39:56,183][106225] Updated weights for policy 1, policy_version 617319 (0.0005) [2023-12-27 23:39:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000614192_157270016.pth [2023-12-27 23:39:56,234][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000617328_158064640.pth... [2023-12-27 23:39:56,239][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000616144_157761536.pth [2023-12-27 23:39:56,671][106226] Updated weights for policy 0, policy_version 615384 (0.0006) [2023-12-27 23:39:56,731][106226] Updated weights for policy 0, policy_version 615394 (0.0007) [2023-12-27 23:39:56,777][106226] Updated weights for policy 0, policy_version 615404 (0.0010) [2023-12-27 23:39:56,777][106225] Updated weights for policy 1, policy_version 617329 (0.0005) [2023-12-27 23:39:56,837][106225] Updated weights for policy 1, policy_version 617339 (0.0005) [2023-12-27 23:39:56,904][106225] Updated weights for policy 1, policy_version 617349 (0.0010) [2023-12-27 23:39:56,968][106225] Updated weights for policy 1, policy_version 617359 (0.0010) [2023-12-27 23:39:57,411][106226] Updated weights for policy 0, policy_version 615414 (0.0005) [2023-12-27 23:39:57,472][106226] Updated weights for policy 0, policy_version 615424 (0.0005) [2023-12-27 23:39:57,542][106226] Updated weights for policy 0, policy_version 615434 (0.0005) [2023-12-27 23:39:57,600][106225] Updated weights for policy 1, policy_version 617369 (0.0006) [2023-12-27 23:39:57,661][106225] Updated weights for policy 1, policy_version 617379 (0.0005) [2023-12-27 23:39:57,716][106225] Updated weights for policy 1, policy_version 617389 (0.0009) [2023-12-27 23:39:58,097][106226] Updated weights for policy 0, policy_version 615444 (0.0007) [2023-12-27 23:39:58,148][106226] Updated weights for policy 0, policy_version 615454 (0.0005) [2023-12-27 23:39:58,211][106226] Updated weights for policy 0, policy_version 615464 (0.0006) [2023-12-27 23:39:58,305][106225] Updated weights for policy 1, policy_version 617399 (0.0009) [2023-12-27 23:39:58,379][106225] Updated weights for policy 1, policy_version 617409 (0.0009) [2023-12-27 23:39:58,441][106225] Updated weights for policy 1, policy_version 617419 (0.0008) [2023-12-27 23:39:58,954][106226] Updated weights for policy 0, policy_version 615474 (0.0007) [2023-12-27 23:39:59,021][106226] Updated weights for policy 0, policy_version 615484 (0.0007) [2023-12-27 23:39:59,077][106226] Updated weights for policy 0, policy_version 615494 (0.0009) [2023-12-27 23:39:59,144][106226] Updated weights for policy 0, policy_version 615504 (0.0007) [2023-12-27 23:39:59,264][106225] Updated weights for policy 1, policy_version 617429 (0.0007) [2023-12-27 23:39:59,320][106225] Updated weights for policy 1, policy_version 617439 (0.0008) [2023-12-27 23:39:59,386][106225] Updated weights for policy 1, policy_version 617449 (0.0008) [2023-12-27 23:39:59,966][106226] Updated weights for policy 0, policy_version 615514 (0.0009) [2023-12-27 23:40:00,028][106226] Updated weights for policy 0, policy_version 615524 (0.0008) [2023-12-27 23:40:00,069][106225] Updated weights for policy 1, policy_version 617459 (0.0007) [2023-12-27 23:40:00,083][106226] Updated weights for policy 0, policy_version 615534 (0.0008) [2023-12-27 23:40:00,123][106225] Updated weights for policy 1, policy_version 617469 (0.0007) [2023-12-27 23:40:00,179][106225] Updated weights for policy 1, policy_version 617479 (0.0007) [2023-12-27 23:40:00,751][106225] Updated weights for policy 1, policy_version 617489 (0.0006) [2023-12-27 23:40:00,752][106226] Updated weights for policy 0, policy_version 615544 (0.0010) [2023-12-27 23:40:00,799][106226] Updated weights for policy 0, policy_version 615554 (0.0008) [2023-12-27 23:40:00,800][106225] Updated weights for policy 1, policy_version 617499 (0.0005) [2023-12-27 23:40:00,844][106225] Updated weights for policy 1, policy_version 617509 (0.0005) [2023-12-27 23:40:00,846][106226] Updated weights for policy 0, policy_version 615564 (0.0009) [2023-12-27 23:40:00,900][106225] Updated weights for policy 1, policy_version 617519 (0.0007) [2023-12-27 23:40:01,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 315736064. Throughput: 0: 10019.6, 1: 9956.0. Samples: 315722140. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:01,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-5.817')] [2023-12-27 23:40:01,586][106226] Updated weights for policy 0, policy_version 615574 (0.0009) [2023-12-27 23:40:01,623][106225] Updated weights for policy 1, policy_version 617529 (0.0010) [2023-12-27 23:40:01,651][106226] Updated weights for policy 0, policy_version 615584 (0.0008) [2023-12-27 23:40:01,684][106225] Updated weights for policy 1, policy_version 617539 (0.0010) [2023-12-27 23:40:01,711][106226] Updated weights for policy 0, policy_version 615594 (0.0006) [2023-12-27 23:40:01,748][106225] Updated weights for policy 1, policy_version 617549 (0.0010) [2023-12-27 23:40:02,318][106226] Updated weights for policy 0, policy_version 615604 (0.0009) [2023-12-27 23:40:02,386][106226] Updated weights for policy 0, policy_version 615614 (0.0011) [2023-12-27 23:40:02,442][106226] Updated weights for policy 0, policy_version 615624 (0.0010) [2023-12-27 23:40:02,487][106225] Updated weights for policy 1, policy_version 617559 (0.0009) [2023-12-27 23:40:02,541][106225] Updated weights for policy 1, policy_version 617569 (0.0008) [2023-12-27 23:40:02,608][106225] Updated weights for policy 1, policy_version 617579 (0.0007) [2023-12-27 23:40:03,059][106226] Updated weights for policy 0, policy_version 615634 (0.0010) [2023-12-27 23:40:03,124][106226] Updated weights for policy 0, policy_version 615644 (0.0007) [2023-12-27 23:40:03,178][106225] Updated weights for policy 1, policy_version 617589 (0.0005) [2023-12-27 23:40:03,183][106226] Updated weights for policy 0, policy_version 615654 (0.0010) [2023-12-27 23:40:03,234][106225] Updated weights for policy 1, policy_version 617599 (0.0005) [2023-12-27 23:40:03,236][106226] Updated weights for policy 0, policy_version 615664 (0.0010) [2023-12-27 23:40:03,292][106225] Updated weights for policy 1, policy_version 617609 (0.0007) [2023-12-27 23:40:03,866][106226] Updated weights for policy 0, policy_version 615674 (0.0009) [2023-12-27 23:40:03,937][106226] Updated weights for policy 0, policy_version 615684 (0.0008) [2023-12-27 23:40:04,003][106226] Updated weights for policy 0, policy_version 615694 (0.0009) [2023-12-27 23:40:04,030][106225] Updated weights for policy 1, policy_version 617619 (0.0008) [2023-12-27 23:40:04,095][106225] Updated weights for policy 1, policy_version 617629 (0.0009) [2023-12-27 23:40:04,150][106225] Updated weights for policy 1, policy_version 617639 (0.0008) [2023-12-27 23:40:04,636][106226] Updated weights for policy 0, policy_version 615704 (0.0007) [2023-12-27 23:40:04,692][106226] Updated weights for policy 0, policy_version 615714 (0.0005) [2023-12-27 23:40:04,743][106226] Updated weights for policy 0, policy_version 615724 (0.0005) [2023-12-27 23:40:04,912][106225] Updated weights for policy 1, policy_version 617649 (0.0008) [2023-12-27 23:40:04,962][106225] Updated weights for policy 1, policy_version 617659 (0.0006) [2023-12-27 23:40:05,015][106225] Updated weights for policy 1, policy_version 617669 (0.0005) [2023-12-27 23:40:05,069][106225] Updated weights for policy 1, policy_version 617679 (0.0009) [2023-12-27 23:40:05,279][106226] Updated weights for policy 0, policy_version 615734 (0.0005) [2023-12-27 23:40:05,336][106226] Updated weights for policy 0, policy_version 615744 (0.0005) [2023-12-27 23:40:05,389][106226] Updated weights for policy 0, policy_version 615754 (0.0005) [2023-12-27 23:40:05,865][106225] Updated weights for policy 1, policy_version 617689 (0.0007) [2023-12-27 23:40:05,918][106226] Updated weights for policy 0, policy_version 615764 (0.0007) [2023-12-27 23:40:05,955][106225] Updated weights for policy 1, policy_version 617699 (0.0008) [2023-12-27 23:40:05,976][106226] Updated weights for policy 0, policy_version 615774 (0.0007) [2023-12-27 23:40:06,012][106225] Updated weights for policy 1, policy_version 617709 (0.0005) [2023-12-27 23:40:06,040][106226] Updated weights for policy 0, policy_version 615784 (0.0008) [2023-12-27 23:40:06,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 315842560. Throughput: 0: 10140.3, 1: 9923.0. Samples: 315847296. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:06,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.874')] [2023-12-27 23:40:06,619][106225] Updated weights for policy 1, policy_version 617719 (0.0008) [2023-12-27 23:40:06,679][106225] Updated weights for policy 1, policy_version 617729 (0.0009) [2023-12-27 23:40:06,736][106225] Updated weights for policy 1, policy_version 617739 (0.0008) [2023-12-27 23:40:06,787][106226] Updated weights for policy 0, policy_version 615794 (0.0008) [2023-12-27 23:40:06,840][106226] Updated weights for policy 0, policy_version 615804 (0.0006) [2023-12-27 23:40:06,902][106226] Updated weights for policy 0, policy_version 615814 (0.0006) [2023-12-27 23:40:06,961][106226] Updated weights for policy 0, policy_version 615824 (0.0008) [2023-12-27 23:40:07,500][106225] Updated weights for policy 1, policy_version 617749 (0.0009) [2023-12-27 23:40:07,544][106225] Updated weights for policy 1, policy_version 617759 (0.0008) [2023-12-27 23:40:07,598][106225] Updated weights for policy 1, policy_version 617769 (0.0007) [2023-12-27 23:40:07,645][106226] Updated weights for policy 0, policy_version 615834 (0.0006) [2023-12-27 23:40:07,706][106226] Updated weights for policy 0, policy_version 615844 (0.0008) [2023-12-27 23:40:07,762][106226] Updated weights for policy 0, policy_version 615854 (0.0009) [2023-12-27 23:40:08,344][106225] Updated weights for policy 1, policy_version 617779 (0.0008) [2023-12-27 23:40:08,403][106225] Updated weights for policy 1, policy_version 617789 (0.0008) [2023-12-27 23:40:08,456][106225] Updated weights for policy 1, policy_version 617799 (0.0009) [2023-12-27 23:40:08,501][106226] Updated weights for policy 0, policy_version 615864 (0.0008) [2023-12-27 23:40:08,555][106226] Updated weights for policy 0, policy_version 615874 (0.0007) [2023-12-27 23:40:08,609][106226] Updated weights for policy 0, policy_version 615884 (0.0009) [2023-12-27 23:40:09,196][106225] Updated weights for policy 1, policy_version 617809 (0.0009) [2023-12-27 23:40:09,266][106225] Updated weights for policy 1, policy_version 617819 (0.0010) [2023-12-27 23:40:09,329][106225] Updated weights for policy 1, policy_version 617829 (0.0009) [2023-12-27 23:40:09,374][106226] Updated weights for policy 0, policy_version 615894 (0.0012) [2023-12-27 23:40:09,397][106225] Updated weights for policy 1, policy_version 617839 (0.0008) [2023-12-27 23:40:09,445][106226] Updated weights for policy 0, policy_version 615904 (0.0008) [2023-12-27 23:40:09,511][106226] Updated weights for policy 0, policy_version 615914 (0.0008) [2023-12-27 23:40:10,149][106225] Updated weights for policy 1, policy_version 617849 (0.0010) [2023-12-27 23:40:10,217][106225] Updated weights for policy 1, policy_version 617859 (0.0008) [2023-12-27 23:40:10,241][106226] Updated weights for policy 0, policy_version 615924 (0.0007) [2023-12-27 23:40:10,287][106225] Updated weights for policy 1, policy_version 617869 (0.0006) [2023-12-27 23:40:10,308][106226] Updated weights for policy 0, policy_version 615934 (0.0009) [2023-12-27 23:40:10,373][106226] Updated weights for policy 0, policy_version 615944 (0.0006) [2023-12-27 23:40:10,953][106225] Updated weights for policy 1, policy_version 617879 (0.0006) [2023-12-27 23:40:11,022][106225] Updated weights for policy 1, policy_version 617889 (0.0006) [2023-12-27 23:40:11,092][106225] Updated weights for policy 1, policy_version 617899 (0.0009) [2023-12-27 23:40:11,143][106226] Updated weights for policy 0, policy_version 615954 (0.0008) [2023-12-27 23:40:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 315932672. Throughput: 0: 10113.3, 1: 9950.8. Samples: 315905036. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:11,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.702')] [2023-12-27 23:40:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000617904_158212096.pth... [2023-12-27 23:40:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000616720_157908992.pth [2023-12-27 23:40:11,211][106226] Updated weights for policy 0, policy_version 615964 (0.0008) [2023-12-27 23:40:11,287][106226] Updated weights for policy 0, policy_version 615974 (0.0008) [2023-12-27 23:40:11,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000615984_157728768.pth... [2023-12-27 23:40:11,359][106226] Updated weights for policy 0, policy_version 615984 (0.0008) [2023-12-27 23:40:11,362][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000614800_157425664.pth [2023-12-27 23:40:11,825][106225] Updated weights for policy 1, policy_version 617909 (0.0008) [2023-12-27 23:40:11,888][106225] Updated weights for policy 1, policy_version 617919 (0.0008) [2023-12-27 23:40:11,947][106225] Updated weights for policy 1, policy_version 617929 (0.0008) [2023-12-27 23:40:12,096][106226] Updated weights for policy 0, policy_version 615994 (0.0008) [2023-12-27 23:40:12,161][106226] Updated weights for policy 0, policy_version 616004 (0.0007) [2023-12-27 23:40:12,233][106226] Updated weights for policy 0, policy_version 616014 (0.0008) [2023-12-27 23:40:12,672][106225] Updated weights for policy 1, policy_version 617939 (0.0009) [2023-12-27 23:40:12,743][106225] Updated weights for policy 1, policy_version 617949 (0.0010) [2023-12-27 23:40:12,812][106225] Updated weights for policy 1, policy_version 617959 (0.0007) [2023-12-27 23:40:12,955][106226] Updated weights for policy 0, policy_version 616024 (0.0009) [2023-12-27 23:40:13,018][106226] Updated weights for policy 0, policy_version 616034 (0.0008) [2023-12-27 23:40:13,084][106226] Updated weights for policy 0, policy_version 616044 (0.0008) [2023-12-27 23:40:13,536][106225] Updated weights for policy 1, policy_version 617969 (0.0007) [2023-12-27 23:40:13,598][106225] Updated weights for policy 1, policy_version 617979 (0.0009) [2023-12-27 23:40:13,657][106225] Updated weights for policy 1, policy_version 617989 (0.0009) [2023-12-27 23:40:13,721][106225] Updated weights for policy 1, policy_version 617999 (0.0010) [2023-12-27 23:40:13,788][106226] Updated weights for policy 0, policy_version 616054 (0.0008) [2023-12-27 23:40:13,841][106226] Updated weights for policy 0, policy_version 616064 (0.0007) [2023-12-27 23:40:13,899][106226] Updated weights for policy 0, policy_version 616074 (0.0008) [2023-12-27 23:40:14,380][106225] Updated weights for policy 1, policy_version 618009 (0.0010) [2023-12-27 23:40:14,428][106225] Updated weights for policy 1, policy_version 618019 (0.0006) [2023-12-27 23:40:14,485][106225] Updated weights for policy 1, policy_version 618029 (0.0005) [2023-12-27 23:40:14,693][106226] Updated weights for policy 0, policy_version 616084 (0.0007) [2023-12-27 23:40:14,754][106226] Updated weights for policy 0, policy_version 616094 (0.0008) [2023-12-27 23:40:14,825][106226] Updated weights for policy 0, policy_version 616104 (0.0008) [2023-12-27 23:40:15,178][106225] Updated weights for policy 1, policy_version 618039 (0.0009) [2023-12-27 23:40:15,236][106225] Updated weights for policy 1, policy_version 618049 (0.0010) [2023-12-27 23:40:15,298][106225] Updated weights for policy 1, policy_version 618059 (0.0010) [2023-12-27 23:40:15,543][106226] Updated weights for policy 0, policy_version 616114 (0.0009) [2023-12-27 23:40:15,600][106226] Updated weights for policy 0, policy_version 616124 (0.0011) [2023-12-27 23:40:15,659][106226] Updated weights for policy 0, policy_version 616134 (0.0011) [2023-12-27 23:40:15,715][106226] Updated weights for policy 0, policy_version 616144 (0.0010) [2023-12-27 23:40:16,001][106225] Updated weights for policy 1, policy_version 618069 (0.0010) [2023-12-27 23:40:16,062][106225] Updated weights for policy 1, policy_version 618079 (0.0009) [2023-12-27 23:40:16,125][106225] Updated weights for policy 1, policy_version 618089 (0.0006) [2023-12-27 23:40:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 316030976. Throughput: 0: 9934.8, 1: 9964.6. Samples: 316017876. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:16,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-5.657')] [2023-12-27 23:40:16,381][106226] Updated weights for policy 0, policy_version 616154 (0.0005) [2023-12-27 23:40:16,444][106226] Updated weights for policy 0, policy_version 616164 (0.0007) [2023-12-27 23:40:16,495][106226] Updated weights for policy 0, policy_version 616174 (0.0009) [2023-12-27 23:40:16,698][106225] Updated weights for policy 1, policy_version 618099 (0.0007) [2023-12-27 23:40:16,756][106225] Updated weights for policy 1, policy_version 618109 (0.0006) [2023-12-27 23:40:16,814][106225] Updated weights for policy 1, policy_version 618119 (0.0006) [2023-12-27 23:40:17,113][106226] Updated weights for policy 0, policy_version 616184 (0.0009) [2023-12-27 23:40:17,165][106226] Updated weights for policy 0, policy_version 616194 (0.0008) [2023-12-27 23:40:17,213][106226] Updated weights for policy 0, policy_version 616204 (0.0008) [2023-12-27 23:40:17,498][106225] Updated weights for policy 1, policy_version 618129 (0.0008) [2023-12-27 23:40:17,549][106225] Updated weights for policy 1, policy_version 618139 (0.0008) [2023-12-27 23:40:17,610][106225] Updated weights for policy 1, policy_version 618149 (0.0008) [2023-12-27 23:40:17,673][106225] Updated weights for policy 1, policy_version 618159 (0.0005) [2023-12-27 23:40:17,982][106226] Updated weights for policy 0, policy_version 616214 (0.0008) [2023-12-27 23:40:18,031][106226] Updated weights for policy 0, policy_version 616224 (0.0009) [2023-12-27 23:40:18,083][106226] Updated weights for policy 0, policy_version 616234 (0.0009) [2023-12-27 23:40:18,284][106225] Updated weights for policy 1, policy_version 618169 (0.0008) [2023-12-27 23:40:18,339][106225] Updated weights for policy 1, policy_version 618179 (0.0008) [2023-12-27 23:40:18,402][106225] Updated weights for policy 1, policy_version 618189 (0.0006) [2023-12-27 23:40:18,901][106226] Updated weights for policy 0, policy_version 616244 (0.0008) [2023-12-27 23:40:18,947][106226] Updated weights for policy 0, policy_version 616254 (0.0009) [2023-12-27 23:40:18,993][106225] Updated weights for policy 1, policy_version 618199 (0.0006) [2023-12-27 23:40:19,004][106226] Updated weights for policy 0, policy_version 616264 (0.0007) [2023-12-27 23:40:19,041][106225] Updated weights for policy 1, policy_version 618209 (0.0005) [2023-12-27 23:40:19,095][106225] Updated weights for policy 1, policy_version 618219 (0.0005) [2023-12-27 23:40:19,768][106225] Updated weights for policy 1, policy_version 618229 (0.0007) [2023-12-27 23:40:19,820][106226] Updated weights for policy 0, policy_version 616274 (0.0008) [2023-12-27 23:40:19,842][106225] Updated weights for policy 1, policy_version 618239 (0.0007) [2023-12-27 23:40:19,892][106226] Updated weights for policy 0, policy_version 616284 (0.0008) [2023-12-27 23:40:19,905][106225] Updated weights for policy 1, policy_version 618249 (0.0007) [2023-12-27 23:40:19,957][106226] Updated weights for policy 0, policy_version 616294 (0.0008) [2023-12-27 23:40:20,028][106226] Updated weights for policy 0, policy_version 616304 (0.0008) [2023-12-27 23:40:20,546][106225] Updated weights for policy 1, policy_version 618259 (0.0007) [2023-12-27 23:40:20,614][106225] Updated weights for policy 1, policy_version 618269 (0.0006) [2023-12-27 23:40:20,676][106225] Updated weights for policy 1, policy_version 618279 (0.0006) [2023-12-27 23:40:20,785][106226] Updated weights for policy 0, policy_version 616314 (0.0009) [2023-12-27 23:40:20,858][106226] Updated weights for policy 0, policy_version 616324 (0.0009) [2023-12-27 23:40:20,923][106226] Updated weights for policy 0, policy_version 616334 (0.0009) [2023-12-27 23:40:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 316129280. Throughput: 0: 9823.5, 1: 9966.9. Samples: 316137300. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:21,175][105115] Avg episode reward: [(0, '-4.799'), (1, '-6.049')] [2023-12-27 23:40:21,343][106225] Updated weights for policy 1, policy_version 618289 (0.0006) [2023-12-27 23:40:21,413][106225] Updated weights for policy 1, policy_version 618299 (0.0007) [2023-12-27 23:40:21,479][106225] Updated weights for policy 1, policy_version 618309 (0.0007) [2023-12-27 23:40:21,545][106225] Updated weights for policy 1, policy_version 618319 (0.0008) [2023-12-27 23:40:21,704][106226] Updated weights for policy 0, policy_version 616344 (0.0008) [2023-12-27 23:40:21,778][106226] Updated weights for policy 0, policy_version 616354 (0.0008) [2023-12-27 23:40:21,843][106226] Updated weights for policy 0, policy_version 616364 (0.0008) [2023-12-27 23:40:22,209][106225] Updated weights for policy 1, policy_version 618329 (0.0008) [2023-12-27 23:40:22,271][106225] Updated weights for policy 1, policy_version 618339 (0.0008) [2023-12-27 23:40:22,336][106225] Updated weights for policy 1, policy_version 618349 (0.0009) [2023-12-27 23:40:22,633][106226] Updated weights for policy 0, policy_version 616374 (0.0009) [2023-12-27 23:40:22,692][106226] Updated weights for policy 0, policy_version 616384 (0.0009) [2023-12-27 23:40:22,756][106226] Updated weights for policy 0, policy_version 616394 (0.0009) [2023-12-27 23:40:23,113][106225] Updated weights for policy 1, policy_version 618359 (0.0008) [2023-12-27 23:40:23,174][106225] Updated weights for policy 1, policy_version 618369 (0.0008) [2023-12-27 23:40:23,230][106225] Updated weights for policy 1, policy_version 618379 (0.0009) [2023-12-27 23:40:23,457][106226] Updated weights for policy 0, policy_version 616404 (0.0007) [2023-12-27 23:40:23,526][106226] Updated weights for policy 0, policy_version 616414 (0.0005) [2023-12-27 23:40:23,585][106226] Updated weights for policy 0, policy_version 616424 (0.0005) [2023-12-27 23:40:23,908][106225] Updated weights for policy 1, policy_version 618389 (0.0008) [2023-12-27 23:40:23,953][106225] Updated weights for policy 1, policy_version 618399 (0.0007) [2023-12-27 23:40:24,006][106225] Updated weights for policy 1, policy_version 618409 (0.0007) [2023-12-27 23:40:24,220][106226] Updated weights for policy 0, policy_version 616434 (0.0006) [2023-12-27 23:40:24,286][106226] Updated weights for policy 0, policy_version 616444 (0.0011) [2023-12-27 23:40:24,340][106226] Updated weights for policy 0, policy_version 616454 (0.0011) [2023-12-27 23:40:24,392][106226] Updated weights for policy 0, policy_version 616464 (0.0005) [2023-12-27 23:40:24,754][106225] Updated weights for policy 1, policy_version 618419 (0.0007) [2023-12-27 23:40:24,811][106225] Updated weights for policy 1, policy_version 618429 (0.0007) [2023-12-27 23:40:24,865][106225] Updated weights for policy 1, policy_version 618439 (0.0008) [2023-12-27 23:40:25,103][106226] Updated weights for policy 0, policy_version 616474 (0.0011) [2023-12-27 23:40:25,150][106226] Updated weights for policy 0, policy_version 616484 (0.0011) [2023-12-27 23:40:25,203][106226] Updated weights for policy 0, policy_version 616494 (0.0007) [2023-12-27 23:40:25,613][106225] Updated weights for policy 1, policy_version 618449 (0.0008) [2023-12-27 23:40:25,677][106225] Updated weights for policy 1, policy_version 618459 (0.0005) [2023-12-27 23:40:25,724][106225] Updated weights for policy 1, policy_version 618469 (0.0005) [2023-12-27 23:40:25,778][106225] Updated weights for policy 1, policy_version 618479 (0.0007) [2023-12-27 23:40:25,825][106226] Updated weights for policy 0, policy_version 616504 (0.0009) [2023-12-27 23:40:25,881][106226] Updated weights for policy 0, policy_version 616514 (0.0010) [2023-12-27 23:40:25,938][106226] Updated weights for policy 0, policy_version 616524 (0.0010) [2023-12-27 23:40:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 316227584. Throughput: 0: 9779.6, 1: 9964.2. Samples: 316195620. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-27 23:40:26,176][105115] Avg episode reward: [(0, '-4.599'), (1, '-6.029')] [2023-12-27 23:40:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000618480_158359552.pth... [2023-12-27 23:40:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000616528_157868032.pth... [2023-12-27 23:40:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000615376_157573120.pth [2023-12-27 23:40:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000617328_158064640.pth [2023-12-27 23:40:26,472][106225] Updated weights for policy 1, policy_version 618489 (0.0008) [2023-12-27 23:40:26,523][106225] Updated weights for policy 1, policy_version 618499 (0.0008) [2023-12-27 23:40:26,540][106226] Updated weights for policy 0, policy_version 616534 (0.0011) [2023-12-27 23:40:26,570][106225] Updated weights for policy 1, policy_version 618509 (0.0007) [2023-12-27 23:40:26,590][106226] Updated weights for policy 0, policy_version 616544 (0.0010) [2023-12-27 23:40:26,640][106226] Updated weights for policy 0, policy_version 616554 (0.0010) [2023-12-27 23:40:27,297][106225] Updated weights for policy 1, policy_version 618519 (0.0009) [2023-12-27 23:40:27,351][106226] Updated weights for policy 0, policy_version 616564 (0.0010) [2023-12-27 23:40:27,363][106225] Updated weights for policy 1, policy_version 618529 (0.0007) [2023-12-27 23:40:27,402][106226] Updated weights for policy 0, policy_version 616574 (0.0009) [2023-12-27 23:40:27,428][106225] Updated weights for policy 1, policy_version 618539 (0.0008) [2023-12-27 23:40:27,449][106226] Updated weights for policy 0, policy_version 616584 (0.0011) [2023-12-27 23:40:28,050][106225] Updated weights for policy 1, policy_version 618549 (0.0006) [2023-12-27 23:40:28,079][106226] Updated weights for policy 0, policy_version 616594 (0.0010) [2023-12-27 23:40:28,106][106225] Updated weights for policy 1, policy_version 618559 (0.0005) [2023-12-27 23:40:28,133][106226] Updated weights for policy 0, policy_version 616604 (0.0010) [2023-12-27 23:40:28,161][106225] Updated weights for policy 1, policy_version 618569 (0.0007) [2023-12-27 23:40:28,188][106226] Updated weights for policy 0, policy_version 616614 (0.0005) [2023-12-27 23:40:28,242][106226] Updated weights for policy 0, policy_version 616624 (0.0005) [2023-12-27 23:40:28,732][106225] Updated weights for policy 1, policy_version 618579 (0.0006) [2023-12-27 23:40:28,791][106225] Updated weights for policy 1, policy_version 618589 (0.0007) [2023-12-27 23:40:28,820][106226] Updated weights for policy 0, policy_version 616634 (0.0011) [2023-12-27 23:40:28,842][106225] Updated weights for policy 1, policy_version 618599 (0.0005) [2023-12-27 23:40:28,878][106226] Updated weights for policy 0, policy_version 616644 (0.0011) [2023-12-27 23:40:28,932][106226] Updated weights for policy 0, policy_version 616654 (0.0011) [2023-12-27 23:40:29,521][106225] Updated weights for policy 1, policy_version 618609 (0.0006) [2023-12-27 23:40:29,568][106226] Updated weights for policy 0, policy_version 616664 (0.0007) [2023-12-27 23:40:29,585][106225] Updated weights for policy 1, policy_version 618619 (0.0008) [2023-12-27 23:40:29,629][106226] Updated weights for policy 0, policy_version 616674 (0.0005) [2023-12-27 23:40:29,648][106225] Updated weights for policy 1, policy_version 618629 (0.0008) [2023-12-27 23:40:29,684][106226] Updated weights for policy 0, policy_version 616684 (0.0005) [2023-12-27 23:40:29,713][106225] Updated weights for policy 1, policy_version 618639 (0.0008) [2023-12-27 23:40:30,364][106226] Updated weights for policy 0, policy_version 616694 (0.0007) [2023-12-27 23:40:30,416][106226] Updated weights for policy 0, policy_version 616704 (0.0009) [2023-12-27 23:40:30,472][106226] Updated weights for policy 0, policy_version 616714 (0.0008) [2023-12-27 23:40:30,487][106225] Updated weights for policy 1, policy_version 618649 (0.0006) [2023-12-27 23:40:30,535][106225] Updated weights for policy 1, policy_version 618659 (0.0007) [2023-12-27 23:40:30,582][106225] Updated weights for policy 1, policy_version 618669 (0.0008) [2023-12-27 23:40:31,120][106226] Updated weights for policy 0, policy_version 616724 (0.0007) [2023-12-27 23:40:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 316325888. Throughput: 0: 9957.3, 1: 10037.2. Samples: 316319908. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:31,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-6.173')] [2023-12-27 23:40:31,186][106226] Updated weights for policy 0, policy_version 616734 (0.0008) [2023-12-27 23:40:31,242][106226] Updated weights for policy 0, policy_version 616744 (0.0008) [2023-12-27 23:40:31,382][106225] Updated weights for policy 1, policy_version 618679 (0.0009) [2023-12-27 23:40:31,439][106225] Updated weights for policy 1, policy_version 618689 (0.0009) [2023-12-27 23:40:31,495][106225] Updated weights for policy 1, policy_version 618699 (0.0009) [2023-12-27 23:40:32,025][106226] Updated weights for policy 0, policy_version 616754 (0.0006) [2023-12-27 23:40:32,083][106226] Updated weights for policy 0, policy_version 616764 (0.0009) [2023-12-27 23:40:32,146][106226] Updated weights for policy 0, policy_version 616774 (0.0009) [2023-12-27 23:40:32,212][106226] Updated weights for policy 0, policy_version 616784 (0.0009) [2023-12-27 23:40:32,293][106225] Updated weights for policy 1, policy_version 618710 (0.0009) [2023-12-27 23:40:32,361][106225] Updated weights for policy 1, policy_version 618720 (0.0009) [2023-12-27 23:40:32,419][106225] Updated weights for policy 1, policy_version 618730 (0.0009) [2023-12-27 23:40:32,915][106226] Updated weights for policy 0, policy_version 616794 (0.0009) [2023-12-27 23:40:32,969][106226] Updated weights for policy 0, policy_version 616804 (0.0005) [2023-12-27 23:40:33,025][106226] Updated weights for policy 0, policy_version 616814 (0.0005) [2023-12-27 23:40:33,066][106225] Updated weights for policy 1, policy_version 618740 (0.0007) [2023-12-27 23:40:33,140][106225] Updated weights for policy 1, policy_version 618750 (0.0009) [2023-12-27 23:40:33,199][106225] Updated weights for policy 1, policy_version 618760 (0.0010) [2023-12-27 23:40:33,592][106226] Updated weights for policy 0, policy_version 616824 (0.0009) [2023-12-27 23:40:33,647][106226] Updated weights for policy 0, policy_version 616834 (0.0010) [2023-12-27 23:40:33,700][106226] Updated weights for policy 0, policy_version 616844 (0.0009) [2023-12-27 23:40:33,854][106225] Updated weights for policy 1, policy_version 618770 (0.0010) [2023-12-27 23:40:33,910][106225] Updated weights for policy 1, policy_version 618780 (0.0010) [2023-12-27 23:40:33,960][106225] Updated weights for policy 1, policy_version 618790 (0.0010) [2023-12-27 23:40:34,007][106225] Updated weights for policy 1, policy_version 618800 (0.0010) [2023-12-27 23:40:34,264][106226] Updated weights for policy 0, policy_version 616854 (0.0007) [2023-12-27 23:40:34,319][106226] Updated weights for policy 0, policy_version 616864 (0.0008) [2023-12-27 23:40:34,383][106226] Updated weights for policy 0, policy_version 616874 (0.0008) [2023-12-27 23:40:34,753][106225] Updated weights for policy 1, policy_version 618810 (0.0008) [2023-12-27 23:40:34,810][106225] Updated weights for policy 1, policy_version 618820 (0.0010) [2023-12-27 23:40:34,874][106225] Updated weights for policy 1, policy_version 618830 (0.0009) [2023-12-27 23:40:35,121][106226] Updated weights for policy 0, policy_version 616884 (0.0009) [2023-12-27 23:40:35,194][106226] Updated weights for policy 0, policy_version 616894 (0.0011) [2023-12-27 23:40:35,253][106226] Updated weights for policy 0, policy_version 616904 (0.0011) [2023-12-27 23:40:35,547][106225] Updated weights for policy 1, policy_version 618840 (0.0007) [2023-12-27 23:40:35,611][106225] Updated weights for policy 1, policy_version 618850 (0.0006) [2023-12-27 23:40:35,666][106225] Updated weights for policy 1, policy_version 618860 (0.0005) [2023-12-27 23:40:35,872][106226] Updated weights for policy 0, policy_version 616914 (0.0009) [2023-12-27 23:40:35,923][106226] Updated weights for policy 0, policy_version 616924 (0.0005) [2023-12-27 23:40:35,996][106226] Updated weights for policy 0, policy_version 616934 (0.0010) [2023-12-27 23:40:36,049][106226] Updated weights for policy 0, policy_version 616944 (0.0010) [2023-12-27 23:40:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 316432384. Throughput: 0: 10047.4, 1: 9996.8. Samples: 316440256. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:36,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-5.405')] [2023-12-27 23:40:36,310][106225] Updated weights for policy 1, policy_version 618870 (0.0008) [2023-12-27 23:40:36,376][106225] Updated weights for policy 1, policy_version 618880 (0.0011) [2023-12-27 23:40:36,440][106225] Updated weights for policy 1, policy_version 618890 (0.0010) [2023-12-27 23:40:36,750][106226] Updated weights for policy 0, policy_version 616954 (0.0011) [2023-12-27 23:40:36,816][106226] Updated weights for policy 0, policy_version 616964 (0.0010) [2023-12-27 23:40:36,884][106226] Updated weights for policy 0, policy_version 616974 (0.0008) [2023-12-27 23:40:37,159][106225] Updated weights for policy 1, policy_version 618900 (0.0009) [2023-12-27 23:40:37,217][106225] Updated weights for policy 1, policy_version 618910 (0.0008) [2023-12-27 23:40:37,276][106225] Updated weights for policy 1, policy_version 618920 (0.0009) [2023-12-27 23:40:37,503][106226] Updated weights for policy 0, policy_version 616984 (0.0009) [2023-12-27 23:40:37,555][106226] Updated weights for policy 0, policy_version 616994 (0.0006) [2023-12-27 23:40:37,603][106226] Updated weights for policy 0, policy_version 617004 (0.0010) [2023-12-27 23:40:37,973][106225] Updated weights for policy 1, policy_version 618930 (0.0007) [2023-12-27 23:40:38,041][106225] Updated weights for policy 1, policy_version 618940 (0.0006) [2023-12-27 23:40:38,110][106225] Updated weights for policy 1, policy_version 618950 (0.0009) [2023-12-27 23:40:38,168][106225] Updated weights for policy 1, policy_version 618960 (0.0006) [2023-12-27 23:40:38,179][106226] Updated weights for policy 0, policy_version 617014 (0.0007) [2023-12-27 23:40:38,230][106226] Updated weights for policy 0, policy_version 617024 (0.0010) [2023-12-27 23:40:38,280][106226] Updated weights for policy 0, policy_version 617034 (0.0010) [2023-12-27 23:40:38,868][106225] Updated weights for policy 1, policy_version 618970 (0.0009) [2023-12-27 23:40:38,920][106225] Updated weights for policy 1, policy_version 618980 (0.0009) [2023-12-27 23:40:38,965][106226] Updated weights for policy 0, policy_version 617044 (0.0008) [2023-12-27 23:40:38,987][106225] Updated weights for policy 1, policy_version 618990 (0.0009) [2023-12-27 23:40:39,027][106226] Updated weights for policy 0, policy_version 617054 (0.0006) [2023-12-27 23:40:39,093][106226] Updated weights for policy 0, policy_version 617064 (0.0009) [2023-12-27 23:40:39,757][106225] Updated weights for policy 1, policy_version 619000 (0.0006) [2023-12-27 23:40:39,768][106226] Updated weights for policy 0, policy_version 617074 (0.0006) [2023-12-27 23:40:39,823][106225] Updated weights for policy 1, policy_version 619010 (0.0006) [2023-12-27 23:40:39,835][106226] Updated weights for policy 0, policy_version 617084 (0.0007) [2023-12-27 23:40:39,900][106225] Updated weights for policy 1, policy_version 619022 (0.0009) [2023-12-27 23:40:39,901][106226] Updated weights for policy 0, policy_version 617094 (0.0007) [2023-12-27 23:40:39,966][106226] Updated weights for policy 0, policy_version 617104 (0.0008) [2023-12-27 23:40:40,637][106226] Updated weights for policy 0, policy_version 617114 (0.0008) [2023-12-27 23:40:40,642][106225] Updated weights for policy 1, policy_version 619032 (0.0010) [2023-12-27 23:40:40,703][106226] Updated weights for policy 0, policy_version 617124 (0.0006) [2023-12-27 23:40:40,705][106225] Updated weights for policy 1, policy_version 619042 (0.0011) [2023-12-27 23:40:40,764][106226] Updated weights for policy 0, policy_version 617134 (0.0008) [2023-12-27 23:40:40,764][106225] Updated weights for policy 1, policy_version 619052 (0.0010) [2023-12-27 23:40:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 316530688. Throughput: 0: 10097.3, 1: 10001.4. Samples: 316501840. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:41,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-5.637')] [2023-12-27 23:40:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000617136_158023680.pth... [2023-12-27 23:40:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000619056_158507008.pth... [2023-12-27 23:40:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000617904_158212096.pth [2023-12-27 23:40:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000615984_157728768.pth [2023-12-27 23:40:41,472][106226] Updated weights for policy 0, policy_version 617144 (0.0009) [2023-12-27 23:40:41,531][106226] Updated weights for policy 0, policy_version 617154 (0.0008) [2023-12-27 23:40:41,585][106226] Updated weights for policy 0, policy_version 617164 (0.0007) [2023-12-27 23:40:41,591][106225] Updated weights for policy 1, policy_version 619062 (0.0011) [2023-12-27 23:40:41,662][106225] Updated weights for policy 1, policy_version 619072 (0.0010) [2023-12-27 23:40:41,725][106225] Updated weights for policy 1, policy_version 619082 (0.0010) [2023-12-27 23:40:42,368][106226] Updated weights for policy 0, policy_version 617174 (0.0008) [2023-12-27 23:40:42,419][106226] Updated weights for policy 0, policy_version 617184 (0.0008) [2023-12-27 23:40:42,474][106226] Updated weights for policy 0, policy_version 617194 (0.0008) [2023-12-27 23:40:42,514][106225] Updated weights for policy 1, policy_version 619092 (0.0010) [2023-12-27 23:40:42,576][106225] Updated weights for policy 1, policy_version 619102 (0.0010) [2023-12-27 23:40:42,640][106225] Updated weights for policy 1, policy_version 619112 (0.0011) [2023-12-27 23:40:43,232][106226] Updated weights for policy 0, policy_version 617204 (0.0008) [2023-12-27 23:40:43,287][106226] Updated weights for policy 0, policy_version 617214 (0.0008) [2023-12-27 23:40:43,352][106226] Updated weights for policy 0, policy_version 617224 (0.0008) [2023-12-27 23:40:43,356][106225] Updated weights for policy 1, policy_version 619122 (0.0010) [2023-12-27 23:40:43,409][106225] Updated weights for policy 1, policy_version 619132 (0.0010) [2023-12-27 23:40:43,468][106225] Updated weights for policy 1, policy_version 619142 (0.0010) [2023-12-27 23:40:43,531][106225] Updated weights for policy 1, policy_version 619152 (0.0010) [2023-12-27 23:40:44,051][106226] Updated weights for policy 0, policy_version 617234 (0.0009) [2023-12-27 23:40:44,109][106226] Updated weights for policy 0, policy_version 617244 (0.0006) [2023-12-27 23:40:44,175][106226] Updated weights for policy 0, policy_version 617254 (0.0006) [2023-12-27 23:40:44,232][106226] Updated weights for policy 0, policy_version 617264 (0.0007) [2023-12-27 23:40:44,244][106225] Updated weights for policy 1, policy_version 619162 (0.0007) [2023-12-27 23:40:44,310][106225] Updated weights for policy 1, policy_version 619172 (0.0009) [2023-12-27 23:40:44,374][106225] Updated weights for policy 1, policy_version 619182 (0.0010) [2023-12-27 23:40:44,810][106226] Updated weights for policy 0, policy_version 617274 (0.0008) [2023-12-27 23:40:44,872][106226] Updated weights for policy 0, policy_version 617284 (0.0006) [2023-12-27 23:40:44,934][106226] Updated weights for policy 0, policy_version 617294 (0.0006) [2023-12-27 23:40:45,076][106225] Updated weights for policy 1, policy_version 619192 (0.0006) [2023-12-27 23:40:45,140][106225] Updated weights for policy 1, policy_version 619202 (0.0006) [2023-12-27 23:40:45,206][106225] Updated weights for policy 1, policy_version 619212 (0.0007) [2023-12-27 23:40:45,665][106226] Updated weights for policy 0, policy_version 617304 (0.0009) [2023-12-27 23:40:45,723][106226] Updated weights for policy 0, policy_version 617314 (0.0008) [2023-12-27 23:40:45,783][106226] Updated weights for policy 0, policy_version 617324 (0.0009) [2023-12-27 23:40:45,840][106225] Updated weights for policy 1, policy_version 619222 (0.0006) [2023-12-27 23:40:45,894][106225] Updated weights for policy 1, policy_version 619232 (0.0006) [2023-12-27 23:40:45,954][106225] Updated weights for policy 1, policy_version 619242 (0.0005) [2023-12-27 23:40:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 316628992. Throughput: 0: 10034.3, 1: 9842.0. Samples: 316616576. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:46,176][105115] Avg episode reward: [(0, '-4.758'), (1, '-6.165')] [2023-12-27 23:40:46,424][106226] Updated weights for policy 0, policy_version 617334 (0.0007) [2023-12-27 23:40:46,486][106226] Updated weights for policy 0, policy_version 617344 (0.0006) [2023-12-27 23:40:46,539][106226] Updated weights for policy 0, policy_version 617354 (0.0006) [2023-12-27 23:40:46,707][106225] Updated weights for policy 1, policy_version 619252 (0.0009) [2023-12-27 23:40:46,772][106225] Updated weights for policy 1, policy_version 619262 (0.0009) [2023-12-27 23:40:46,830][106225] Updated weights for policy 1, policy_version 619272 (0.0009) [2023-12-27 23:40:47,138][106226] Updated weights for policy 0, policy_version 617364 (0.0007) [2023-12-27 23:40:47,184][106226] Updated weights for policy 0, policy_version 617374 (0.0008) [2023-12-27 23:40:47,236][106226] Updated weights for policy 0, policy_version 617384 (0.0009) [2023-12-27 23:40:47,579][106225] Updated weights for policy 1, policy_version 619282 (0.0009) [2023-12-27 23:40:47,628][106225] Updated weights for policy 1, policy_version 619292 (0.0009) [2023-12-27 23:40:47,693][106225] Updated weights for policy 1, policy_version 619302 (0.0007) [2023-12-27 23:40:47,751][106225] Updated weights for policy 1, policy_version 619312 (0.0009) [2023-12-27 23:40:47,805][106226] Updated weights for policy 0, policy_version 617394 (0.0006) [2023-12-27 23:40:47,861][106226] Updated weights for policy 0, policy_version 617404 (0.0010) [2023-12-27 23:40:47,931][106226] Updated weights for policy 0, policy_version 617414 (0.0011) [2023-12-27 23:40:47,991][106226] Updated weights for policy 0, policy_version 617424 (0.0006) [2023-12-27 23:40:48,445][106225] Updated weights for policy 1, policy_version 619322 (0.0008) [2023-12-27 23:40:48,506][106225] Updated weights for policy 1, policy_version 619332 (0.0007) [2023-12-27 23:40:48,564][106225] Updated weights for policy 1, policy_version 619342 (0.0010) [2023-12-27 23:40:48,678][106226] Updated weights for policy 0, policy_version 617434 (0.0011) [2023-12-27 23:40:48,731][106226] Updated weights for policy 0, policy_version 617444 (0.0010) [2023-12-27 23:40:48,785][106226] Updated weights for policy 0, policy_version 617454 (0.0010) [2023-12-27 23:40:49,291][106225] Updated weights for policy 1, policy_version 619352 (0.0009) [2023-12-27 23:40:49,356][106225] Updated weights for policy 1, policy_version 619362 (0.0009) [2023-12-27 23:40:49,419][106225] Updated weights for policy 1, policy_version 619372 (0.0006) [2023-12-27 23:40:49,532][106226] Updated weights for policy 0, policy_version 617464 (0.0009) [2023-12-27 23:40:49,599][106226] Updated weights for policy 0, policy_version 617474 (0.0010) [2023-12-27 23:40:49,671][106226] Updated weights for policy 0, policy_version 617484 (0.0010) [2023-12-27 23:40:50,110][106225] Updated weights for policy 1, policy_version 619382 (0.0008) [2023-12-27 23:40:50,157][106225] Updated weights for policy 1, policy_version 619392 (0.0010) [2023-12-27 23:40:50,214][106225] Updated weights for policy 1, policy_version 619402 (0.0010) [2023-12-27 23:40:50,373][106226] Updated weights for policy 0, policy_version 617494 (0.0011) [2023-12-27 23:40:50,426][106226] Updated weights for policy 0, policy_version 617504 (0.0010) [2023-12-27 23:40:50,481][106226] Updated weights for policy 0, policy_version 617514 (0.0010) [2023-12-27 23:40:50,898][106225] Updated weights for policy 1, policy_version 619412 (0.0009) [2023-12-27 23:40:50,956][106225] Updated weights for policy 1, policy_version 619422 (0.0008) [2023-12-27 23:40:51,016][106225] Updated weights for policy 1, policy_version 619432 (0.0008) [2023-12-27 23:40:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 316727296. Throughput: 0: 9942.7, 1: 9828.4. Samples: 316736996. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:51,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-5.486')] [2023-12-27 23:40:51,267][106226] Updated weights for policy 0, policy_version 617524 (0.0009) [2023-12-27 23:40:51,330][106226] Updated weights for policy 0, policy_version 617534 (0.0008) [2023-12-27 23:40:51,399][106226] Updated weights for policy 0, policy_version 617544 (0.0009) [2023-12-27 23:40:51,807][106225] Updated weights for policy 1, policy_version 619442 (0.0008) [2023-12-27 23:40:51,868][106225] Updated weights for policy 1, policy_version 619452 (0.0010) [2023-12-27 23:40:51,919][106225] Updated weights for policy 1, policy_version 619462 (0.0010) [2023-12-27 23:40:51,966][106225] Updated weights for policy 1, policy_version 619472 (0.0010) [2023-12-27 23:40:52,164][106226] Updated weights for policy 0, policy_version 617554 (0.0008) [2023-12-27 23:40:52,217][106226] Updated weights for policy 0, policy_version 617564 (0.0008) [2023-12-27 23:40:52,279][106226] Updated weights for policy 0, policy_version 617574 (0.0009) [2023-12-27 23:40:52,338][106226] Updated weights for policy 0, policy_version 617584 (0.0009) [2023-12-27 23:40:52,647][106225] Updated weights for policy 1, policy_version 619482 (0.0008) [2023-12-27 23:40:52,701][106225] Updated weights for policy 1, policy_version 619492 (0.0009) [2023-12-27 23:40:52,761][106225] Updated weights for policy 1, policy_version 619502 (0.0009) [2023-12-27 23:40:53,098][106226] Updated weights for policy 0, policy_version 617594 (0.0005) [2023-12-27 23:40:53,148][106226] Updated weights for policy 0, policy_version 617604 (0.0005) [2023-12-27 23:40:53,195][106226] Updated weights for policy 0, policy_version 617614 (0.0007) [2023-12-27 23:40:53,506][106225] Updated weights for policy 1, policy_version 619512 (0.0009) [2023-12-27 23:40:53,575][106225] Updated weights for policy 1, policy_version 619522 (0.0009) [2023-12-27 23:40:53,636][106225] Updated weights for policy 1, policy_version 619532 (0.0010) [2023-12-27 23:40:53,844][106226] Updated weights for policy 0, policy_version 617624 (0.0008) [2023-12-27 23:40:53,895][106226] Updated weights for policy 0, policy_version 617634 (0.0008) [2023-12-27 23:40:53,938][106226] Updated weights for policy 0, policy_version 617644 (0.0007) [2023-12-27 23:40:54,330][106225] Updated weights for policy 1, policy_version 619542 (0.0010) [2023-12-27 23:40:54,380][106225] Updated weights for policy 1, policy_version 619552 (0.0010) [2023-12-27 23:40:54,441][106225] Updated weights for policy 1, policy_version 619562 (0.0010) [2023-12-27 23:40:54,708][106226] Updated weights for policy 0, policy_version 617654 (0.0008) [2023-12-27 23:40:54,770][106226] Updated weights for policy 0, policy_version 617664 (0.0008) [2023-12-27 23:40:54,834][106226] Updated weights for policy 0, policy_version 617674 (0.0008) [2023-12-27 23:40:55,171][106225] Updated weights for policy 1, policy_version 619572 (0.0010) [2023-12-27 23:40:55,217][106225] Updated weights for policy 1, policy_version 619582 (0.0010) [2023-12-27 23:40:55,267][106225] Updated weights for policy 1, policy_version 619592 (0.0010) [2023-12-27 23:40:55,578][106226] Updated weights for policy 0, policy_version 617684 (0.0008) [2023-12-27 23:40:55,640][106226] Updated weights for policy 0, policy_version 617694 (0.0009) [2023-12-27 23:40:55,701][106226] Updated weights for policy 0, policy_version 617704 (0.0009) [2023-12-27 23:40:55,936][106225] Updated weights for policy 1, policy_version 619602 (0.0010) [2023-12-27 23:40:55,987][106225] Updated weights for policy 1, policy_version 619612 (0.0007) [2023-12-27 23:40:56,040][106225] Updated weights for policy 1, policy_version 619622 (0.0005) [2023-12-27 23:40:56,094][106225] Updated weights for policy 1, policy_version 619632 (0.0006) [2023-12-27 23:40:56,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 316825600. Throughput: 0: 9936.0, 1: 9817.3. Samples: 316793932. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:40:56,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.767')] [2023-12-27 23:40:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000619632_158654464.pth... [2023-12-27 23:40:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000617712_158171136.pth... [2023-12-27 23:40:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000618480_158359552.pth [2023-12-27 23:40:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000616528_157868032.pth [2023-12-27 23:40:56,401][106226] Updated weights for policy 0, policy_version 617714 (0.0007) [2023-12-27 23:40:56,462][106226] Updated weights for policy 0, policy_version 617724 (0.0005) [2023-12-27 23:40:56,528][106226] Updated weights for policy 0, policy_version 617734 (0.0005) [2023-12-27 23:40:56,585][106226] Updated weights for policy 0, policy_version 617744 (0.0008) [2023-12-27 23:40:56,663][106225] Updated weights for policy 1, policy_version 619642 (0.0005) [2023-12-27 23:40:56,724][106225] Updated weights for policy 1, policy_version 619652 (0.0005) [2023-12-27 23:40:56,791][106225] Updated weights for policy 1, policy_version 619662 (0.0009) [2023-12-27 23:40:57,153][106226] Updated weights for policy 0, policy_version 617754 (0.0009) [2023-12-27 23:40:57,210][106226] Updated weights for policy 0, policy_version 617764 (0.0008) [2023-12-27 23:40:57,272][106226] Updated weights for policy 0, policy_version 617774 (0.0009) [2023-12-27 23:40:57,412][106225] Updated weights for policy 1, policy_version 619672 (0.0008) [2023-12-27 23:40:57,468][106225] Updated weights for policy 1, policy_version 619682 (0.0009) [2023-12-27 23:40:57,520][106225] Updated weights for policy 1, policy_version 619692 (0.0008) [2023-12-27 23:40:57,966][106226] Updated weights for policy 0, policy_version 617784 (0.0010) [2023-12-27 23:40:58,026][106226] Updated weights for policy 0, policy_version 617794 (0.0010) [2023-12-27 23:40:58,087][106226] Updated weights for policy 0, policy_version 617804 (0.0011) [2023-12-27 23:40:58,199][106225] Updated weights for policy 1, policy_version 619702 (0.0008) [2023-12-27 23:40:58,258][106225] Updated weights for policy 1, policy_version 619712 (0.0007) [2023-12-27 23:40:58,323][106225] Updated weights for policy 1, policy_version 619722 (0.0006) [2023-12-27 23:40:58,917][106226] Updated weights for policy 0, policy_version 617814 (0.0009) [2023-12-27 23:40:58,972][106226] Updated weights for policy 0, policy_version 617824 (0.0008) [2023-12-27 23:40:59,031][106226] Updated weights for policy 0, policy_version 617834 (0.0008) [2023-12-27 23:40:59,116][106225] Updated weights for policy 1, policy_version 619732 (0.0008) [2023-12-27 23:40:59,177][106225] Updated weights for policy 1, policy_version 619742 (0.0010) [2023-12-27 23:40:59,243][106225] Updated weights for policy 1, policy_version 619752 (0.0009) [2023-12-27 23:40:59,781][106226] Updated weights for policy 0, policy_version 617844 (0.0007) [2023-12-27 23:40:59,848][106226] Updated weights for policy 0, policy_version 617854 (0.0007) [2023-12-27 23:40:59,907][106226] Updated weights for policy 0, policy_version 617864 (0.0007) [2023-12-27 23:40:59,937][106225] Updated weights for policy 1, policy_version 619762 (0.0010) [2023-12-27 23:40:59,994][106225] Updated weights for policy 1, policy_version 619772 (0.0007) [2023-12-27 23:41:00,051][106225] Updated weights for policy 1, policy_version 619782 (0.0008) [2023-12-27 23:41:00,111][106225] Updated weights for policy 1, policy_version 619792 (0.0008) [2023-12-27 23:41:00,490][106226] Updated weights for policy 0, policy_version 617874 (0.0011) [2023-12-27 23:41:00,542][106226] Updated weights for policy 0, policy_version 617884 (0.0010) [2023-12-27 23:41:00,591][106226] Updated weights for policy 0, policy_version 617894 (0.0010) [2023-12-27 23:41:00,644][106226] Updated weights for policy 0, policy_version 617904 (0.0010) [2023-12-27 23:41:00,814][106225] Updated weights for policy 1, policy_version 619802 (0.0008) [2023-12-27 23:41:00,863][106225] Updated weights for policy 1, policy_version 619812 (0.0008) [2023-12-27 23:41:00,909][106225] Updated weights for policy 1, policy_version 619822 (0.0008) [2023-12-27 23:41:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 316923904. Throughput: 0: 10001.7, 1: 9891.2. Samples: 316913056. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:01,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-5.970')] [2023-12-27 23:41:01,324][106226] Updated weights for policy 0, policy_version 617914 (0.0008) [2023-12-27 23:41:01,392][106226] Updated weights for policy 0, policy_version 617924 (0.0009) [2023-12-27 23:41:01,454][106226] Updated weights for policy 0, policy_version 617934 (0.0009) [2023-12-27 23:41:01,758][106225] Updated weights for policy 1, policy_version 619832 (0.0008) [2023-12-27 23:41:01,819][106225] Updated weights for policy 1, policy_version 619842 (0.0009) [2023-12-27 23:41:01,881][106225] Updated weights for policy 1, policy_version 619852 (0.0006) [2023-12-27 23:41:02,182][106226] Updated weights for policy 0, policy_version 617944 (0.0010) [2023-12-27 23:41:02,238][106226] Updated weights for policy 0, policy_version 617954 (0.0008) [2023-12-27 23:41:02,307][106226] Updated weights for policy 0, policy_version 617964 (0.0007) [2023-12-27 23:41:02,590][106225] Updated weights for policy 1, policy_version 619862 (0.0009) [2023-12-27 23:41:02,653][106225] Updated weights for policy 1, policy_version 619872 (0.0010) [2023-12-27 23:41:02,707][106225] Updated weights for policy 1, policy_version 619882 (0.0010) [2023-12-27 23:41:03,003][106226] Updated weights for policy 0, policy_version 617974 (0.0009) [2023-12-27 23:41:03,063][106226] Updated weights for policy 0, policy_version 617984 (0.0010) [2023-12-27 23:41:03,125][106226] Updated weights for policy 0, policy_version 617994 (0.0010) [2023-12-27 23:41:03,392][106225] Updated weights for policy 1, policy_version 619892 (0.0010) [2023-12-27 23:41:03,442][106225] Updated weights for policy 1, policy_version 619902 (0.0010) [2023-12-27 23:41:03,489][106225] Updated weights for policy 1, policy_version 619912 (0.0010) [2023-12-27 23:41:03,832][106226] Updated weights for policy 0, policy_version 618004 (0.0010) [2023-12-27 23:41:03,896][106226] Updated weights for policy 0, policy_version 618014 (0.0008) [2023-12-27 23:41:03,962][106226] Updated weights for policy 0, policy_version 618024 (0.0008) [2023-12-27 23:41:04,178][106225] Updated weights for policy 1, policy_version 619922 (0.0009) [2023-12-27 23:41:04,247][106225] Updated weights for policy 1, policy_version 619932 (0.0008) [2023-12-27 23:41:04,308][106225] Updated weights for policy 1, policy_version 619942 (0.0008) [2023-12-27 23:41:04,369][106225] Updated weights for policy 1, policy_version 619952 (0.0008) [2023-12-27 23:41:04,646][106226] Updated weights for policy 0, policy_version 618034 (0.0011) [2023-12-27 23:41:04,707][106226] Updated weights for policy 0, policy_version 618044 (0.0010) [2023-12-27 23:41:04,757][106226] Updated weights for policy 0, policy_version 618054 (0.0007) [2023-12-27 23:41:04,816][106226] Updated weights for policy 0, policy_version 618064 (0.0009) [2023-12-27 23:41:05,016][106225] Updated weights for policy 1, policy_version 619962 (0.0008) [2023-12-27 23:41:05,065][106225] Updated weights for policy 1, policy_version 619972 (0.0007) [2023-12-27 23:41:05,129][106225] Updated weights for policy 1, policy_version 619982 (0.0008) [2023-12-27 23:41:05,482][106226] Updated weights for policy 0, policy_version 618074 (0.0010) [2023-12-27 23:41:05,545][106226] Updated weights for policy 0, policy_version 618084 (0.0010) [2023-12-27 23:41:05,607][106226] Updated weights for policy 0, policy_version 618094 (0.0010) [2023-12-27 23:41:05,831][106225] Updated weights for policy 1, policy_version 619992 (0.0008) [2023-12-27 23:41:05,888][106225] Updated weights for policy 1, policy_version 620002 (0.0008) [2023-12-27 23:41:05,938][106225] Updated weights for policy 1, policy_version 620012 (0.0007) [2023-12-27 23:41:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 317022208. Throughput: 0: 10102.1, 1: 9789.4. Samples: 317032420. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:06,176][105115] Avg episode reward: [(0, '-4.576'), (1, '-5.916')] [2023-12-27 23:41:06,255][106226] Updated weights for policy 0, policy_version 618104 (0.0011) [2023-12-27 23:41:06,302][106226] Updated weights for policy 0, policy_version 618114 (0.0010) [2023-12-27 23:41:06,350][106226] Updated weights for policy 0, policy_version 618124 (0.0011) [2023-12-27 23:41:06,741][106225] Updated weights for policy 1, policy_version 620022 (0.0008) [2023-12-27 23:41:06,803][106225] Updated weights for policy 1, policy_version 620032 (0.0008) [2023-12-27 23:41:06,858][106225] Updated weights for policy 1, policy_version 620042 (0.0008) [2023-12-27 23:41:07,100][106226] Updated weights for policy 0, policy_version 618134 (0.0011) [2023-12-27 23:41:07,164][106226] Updated weights for policy 0, policy_version 618144 (0.0011) [2023-12-27 23:41:07,230][106226] Updated weights for policy 0, policy_version 618154 (0.0011) [2023-12-27 23:41:07,612][106225] Updated weights for policy 1, policy_version 620052 (0.0008) [2023-12-27 23:41:07,659][106225] Updated weights for policy 1, policy_version 620062 (0.0008) [2023-12-27 23:41:07,709][106225] Updated weights for policy 1, policy_version 620072 (0.0008) [2023-12-27 23:41:07,908][106226] Updated weights for policy 0, policy_version 618164 (0.0010) [2023-12-27 23:41:07,955][106226] Updated weights for policy 0, policy_version 618174 (0.0010) [2023-12-27 23:41:08,008][106226] Updated weights for policy 0, policy_version 618184 (0.0010) [2023-12-27 23:41:08,502][106225] Updated weights for policy 1, policy_version 620082 (0.0009) [2023-12-27 23:41:08,557][106225] Updated weights for policy 1, policy_version 620092 (0.0007) [2023-12-27 23:41:08,611][106225] Updated weights for policy 1, policy_version 620102 (0.0008) [2023-12-27 23:41:08,672][106225] Updated weights for policy 1, policy_version 620112 (0.0008) [2023-12-27 23:41:08,698][106226] Updated weights for policy 0, policy_version 618194 (0.0010) [2023-12-27 23:41:08,753][106226] Updated weights for policy 0, policy_version 618204 (0.0007) [2023-12-27 23:41:08,815][106226] Updated weights for policy 0, policy_version 618214 (0.0008) [2023-12-27 23:41:08,875][106226] Updated weights for policy 0, policy_version 618224 (0.0009) [2023-12-27 23:41:09,431][106225] Updated weights for policy 1, policy_version 620122 (0.0008) [2023-12-27 23:41:09,495][106225] Updated weights for policy 1, policy_version 620132 (0.0009) [2023-12-27 23:41:09,562][106225] Updated weights for policy 1, policy_version 620142 (0.0008) [2023-12-27 23:41:09,657][106226] Updated weights for policy 0, policy_version 618234 (0.0008) [2023-12-27 23:41:09,718][106226] Updated weights for policy 0, policy_version 618244 (0.0011) [2023-12-27 23:41:09,780][106226] Updated weights for policy 0, policy_version 618254 (0.0010) [2023-12-27 23:41:10,289][106225] Updated weights for policy 1, policy_version 620152 (0.0008) [2023-12-27 23:41:10,352][106225] Updated weights for policy 1, policy_version 620162 (0.0008) [2023-12-27 23:41:10,412][106225] Updated weights for policy 1, policy_version 620172 (0.0010) [2023-12-27 23:41:10,478][106226] Updated weights for policy 0, policy_version 618264 (0.0006) [2023-12-27 23:41:10,539][106226] Updated weights for policy 0, policy_version 618274 (0.0006) [2023-12-27 23:41:10,603][106226] Updated weights for policy 0, policy_version 618284 (0.0006) [2023-12-27 23:41:11,145][106225] Updated weights for policy 1, policy_version 620182 (0.0008) [2023-12-27 23:41:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 317112320. Throughput: 0: 10117.1, 1: 9740.9. Samples: 317089228. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:11,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-6.347')] [2023-12-27 23:41:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000618288_158318592.pth... [2023-12-27 23:41:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000617136_158023680.pth [2023-12-27 23:41:11,204][106225] Updated weights for policy 1, policy_version 620192 (0.0008) [2023-12-27 23:41:11,279][106225] Updated weights for policy 1, policy_version 620202 (0.0008) [2023-12-27 23:41:11,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000620208_158801920.pth... [2023-12-27 23:41:11,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000619056_158507008.pth [2023-12-27 23:41:11,329][106226] Updated weights for policy 0, policy_version 618294 (0.0007) [2023-12-27 23:41:11,402][106226] Updated weights for policy 0, policy_version 618304 (0.0008) [2023-12-27 23:41:11,472][106226] Updated weights for policy 0, policy_version 618314 (0.0008) [2023-12-27 23:41:12,078][106225] Updated weights for policy 1, policy_version 620212 (0.0008) [2023-12-27 23:41:12,131][106225] Updated weights for policy 1, policy_version 620222 (0.0008) [2023-12-27 23:41:12,184][106225] Updated weights for policy 1, policy_version 620232 (0.0009) [2023-12-27 23:41:12,211][106226] Updated weights for policy 0, policy_version 618324 (0.0006) [2023-12-27 23:41:12,273][106226] Updated weights for policy 0, policy_version 618334 (0.0007) [2023-12-27 23:41:12,336][106226] Updated weights for policy 0, policy_version 618344 (0.0008) [2023-12-27 23:41:12,980][106225] Updated weights for policy 1, policy_version 620242 (0.0007) [2023-12-27 23:41:13,028][106225] Updated weights for policy 1, policy_version 620252 (0.0007) [2023-12-27 23:41:13,061][106226] Updated weights for policy 0, policy_version 618354 (0.0009) [2023-12-27 23:41:13,086][106225] Updated weights for policy 1, policy_version 620262 (0.0010) [2023-12-27 23:41:13,117][106226] Updated weights for policy 0, policy_version 618364 (0.0010) [2023-12-27 23:41:13,143][106225] Updated weights for policy 1, policy_version 620272 (0.0010) [2023-12-27 23:41:13,170][106226] Updated weights for policy 0, policy_version 618374 (0.0010) [2023-12-27 23:41:13,228][106226] Updated weights for policy 0, policy_version 618384 (0.0011) [2023-12-27 23:41:13,872][106226] Updated weights for policy 0, policy_version 618394 (0.0008) [2023-12-27 23:41:13,914][106225] Updated weights for policy 1, policy_version 620282 (0.0008) [2023-12-27 23:41:13,923][106226] Updated weights for policy 0, policy_version 618404 (0.0008) [2023-12-27 23:41:13,969][106225] Updated weights for policy 1, policy_version 620292 (0.0010) [2023-12-27 23:41:13,982][106226] Updated weights for policy 0, policy_version 618414 (0.0006) [2023-12-27 23:41:14,021][106225] Updated weights for policy 1, policy_version 620302 (0.0010) [2023-12-27 23:41:14,593][106225] Updated weights for policy 1, policy_version 620312 (0.0010) [2023-12-27 23:41:14,643][106225] Updated weights for policy 1, policy_version 620322 (0.0010) [2023-12-27 23:41:14,689][106225] Updated weights for policy 1, policy_version 620332 (0.0010) [2023-12-27 23:41:14,723][106226] Updated weights for policy 0, policy_version 618424 (0.0007) [2023-12-27 23:41:14,793][106226] Updated weights for policy 0, policy_version 618434 (0.0008) [2023-12-27 23:41:14,855][106226] Updated weights for policy 0, policy_version 618444 (0.0008) [2023-12-27 23:41:15,428][106225] Updated weights for policy 1, policy_version 620342 (0.0010) [2023-12-27 23:41:15,483][106225] Updated weights for policy 1, policy_version 620352 (0.0010) [2023-12-27 23:41:15,538][106225] Updated weights for policy 1, policy_version 620362 (0.0011) [2023-12-27 23:41:15,623][106226] Updated weights for policy 0, policy_version 618454 (0.0009) [2023-12-27 23:41:15,678][106226] Updated weights for policy 0, policy_version 618464 (0.0008) [2023-12-27 23:41:15,735][106226] Updated weights for policy 0, policy_version 618474 (0.0007) [2023-12-27 23:41:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 317210624. Throughput: 0: 9969.6, 1: 9658.7. Samples: 317203184. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:16,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.554')] [2023-12-27 23:41:16,184][106225] Updated weights for policy 1, policy_version 620372 (0.0008) [2023-12-27 23:41:16,246][106225] Updated weights for policy 1, policy_version 620382 (0.0005) [2023-12-27 23:41:16,314][106225] Updated weights for policy 1, policy_version 620392 (0.0008) [2023-12-27 23:41:16,334][106226] Updated weights for policy 0, policy_version 618484 (0.0007) [2023-12-27 23:41:16,384][106226] Updated weights for policy 0, policy_version 618494 (0.0008) [2023-12-27 23:41:16,436][106226] Updated weights for policy 0, policy_version 618504 (0.0008) [2023-12-27 23:41:16,845][106225] Updated weights for policy 1, policy_version 620402 (0.0009) [2023-12-27 23:41:16,913][106225] Updated weights for policy 1, policy_version 620412 (0.0007) [2023-12-27 23:41:16,967][106225] Updated weights for policy 1, policy_version 620422 (0.0010) [2023-12-27 23:41:16,983][106226] Updated weights for policy 0, policy_version 618514 (0.0005) [2023-12-27 23:41:17,025][106225] Updated weights for policy 1, policy_version 620432 (0.0010) [2023-12-27 23:41:17,044][106226] Updated weights for policy 0, policy_version 618524 (0.0006) [2023-12-27 23:41:17,110][106226] Updated weights for policy 0, policy_version 618534 (0.0008) [2023-12-27 23:41:17,172][106226] Updated weights for policy 0, policy_version 618544 (0.0008) [2023-12-27 23:41:17,607][106225] Updated weights for policy 1, policy_version 620442 (0.0005) [2023-12-27 23:41:17,659][106225] Updated weights for policy 1, policy_version 620452 (0.0006) [2023-12-27 23:41:17,724][106225] Updated weights for policy 1, policy_version 620462 (0.0009) [2023-12-27 23:41:17,885][106226] Updated weights for policy 0, policy_version 618554 (0.0009) [2023-12-27 23:41:17,947][106226] Updated weights for policy 0, policy_version 618564 (0.0008) [2023-12-27 23:41:18,012][106226] Updated weights for policy 0, policy_version 618574 (0.0010) [2023-12-27 23:41:18,400][106225] Updated weights for policy 1, policy_version 620472 (0.0007) [2023-12-27 23:41:18,460][106225] Updated weights for policy 1, policy_version 620482 (0.0006) [2023-12-27 23:41:18,516][106225] Updated weights for policy 1, policy_version 620492 (0.0006) [2023-12-27 23:41:18,787][106226] Updated weights for policy 0, policy_version 618584 (0.0009) [2023-12-27 23:41:18,847][106226] Updated weights for policy 0, policy_version 618594 (0.0008) [2023-12-27 23:41:18,908][106226] Updated weights for policy 0, policy_version 618604 (0.0009) [2023-12-27 23:41:19,140][106225] Updated weights for policy 1, policy_version 620502 (0.0008) [2023-12-27 23:41:19,189][106225] Updated weights for policy 1, policy_version 620512 (0.0009) [2023-12-27 23:41:19,251][106225] Updated weights for policy 1, policy_version 620522 (0.0008) [2023-12-27 23:41:19,606][106226] Updated weights for policy 0, policy_version 618614 (0.0009) [2023-12-27 23:41:19,672][106226] Updated weights for policy 0, policy_version 618624 (0.0007) [2023-12-27 23:41:19,733][106226] Updated weights for policy 0, policy_version 618634 (0.0008) [2023-12-27 23:41:19,970][106225] Updated weights for policy 1, policy_version 620532 (0.0007) [2023-12-27 23:41:20,033][106225] Updated weights for policy 1, policy_version 620542 (0.0009) [2023-12-27 23:41:20,103][106225] Updated weights for policy 1, policy_version 620552 (0.0008) [2023-12-27 23:41:20,401][106226] Updated weights for policy 0, policy_version 618644 (0.0007) [2023-12-27 23:41:20,461][106226] Updated weights for policy 0, policy_version 618654 (0.0006) [2023-12-27 23:41:20,524][106226] Updated weights for policy 0, policy_version 618664 (0.0006) [2023-12-27 23:41:20,891][106225] Updated weights for policy 1, policy_version 620562 (0.0008) [2023-12-27 23:41:20,945][106225] Updated weights for policy 1, policy_version 620572 (0.0009) [2023-12-27 23:41:20,999][106225] Updated weights for policy 1, policy_version 620582 (0.0009) [2023-12-27 23:41:21,069][106225] Updated weights for policy 1, policy_version 620592 (0.0008) [2023-12-27 23:41:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 317317120. Throughput: 0: 9945.5, 1: 9748.0. Samples: 317326464. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:21,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-6.105')] [2023-12-27 23:41:21,202][106226] Updated weights for policy 0, policy_version 618674 (0.0007) [2023-12-27 23:41:21,266][106226] Updated weights for policy 0, policy_version 618684 (0.0008) [2023-12-27 23:41:21,333][106226] Updated weights for policy 0, policy_version 618694 (0.0008) [2023-12-27 23:41:21,406][106226] Updated weights for policy 0, policy_version 618704 (0.0010) [2023-12-27 23:41:21,830][106225] Updated weights for policy 1, policy_version 620602 (0.0005) [2023-12-27 23:41:21,893][106225] Updated weights for policy 1, policy_version 620612 (0.0006) [2023-12-27 23:41:21,953][106225] Updated weights for policy 1, policy_version 620622 (0.0009) [2023-12-27 23:41:22,232][106226] Updated weights for policy 0, policy_version 618714 (0.0009) [2023-12-27 23:41:22,295][106226] Updated weights for policy 0, policy_version 618724 (0.0009) [2023-12-27 23:41:22,363][106226] Updated weights for policy 0, policy_version 618734 (0.0009) [2023-12-27 23:41:22,680][106225] Updated weights for policy 1, policy_version 620632 (0.0008) [2023-12-27 23:41:22,744][106225] Updated weights for policy 1, policy_version 620642 (0.0008) [2023-12-27 23:41:22,808][106225] Updated weights for policy 1, policy_version 620652 (0.0006) [2023-12-27 23:41:23,070][106226] Updated weights for policy 0, policy_version 618744 (0.0006) [2023-12-27 23:41:23,129][106226] Updated weights for policy 0, policy_version 618754 (0.0007) [2023-12-27 23:41:23,190][106226] Updated weights for policy 0, policy_version 618764 (0.0009) [2023-12-27 23:41:23,484][106225] Updated weights for policy 1, policy_version 620662 (0.0010) [2023-12-27 23:41:23,552][106225] Updated weights for policy 1, policy_version 620672 (0.0007) [2023-12-27 23:41:23,614][106225] Updated weights for policy 1, policy_version 620682 (0.0010) [2023-12-27 23:41:23,823][106226] Updated weights for policy 0, policy_version 618774 (0.0006) [2023-12-27 23:41:23,882][106226] Updated weights for policy 0, policy_version 618784 (0.0005) [2023-12-27 23:41:23,935][106226] Updated weights for policy 0, policy_version 618794 (0.0007) [2023-12-27 23:41:24,192][106225] Updated weights for policy 1, policy_version 620692 (0.0010) [2023-12-27 23:41:24,243][106225] Updated weights for policy 1, policy_version 620702 (0.0008) [2023-12-27 23:41:24,296][106225] Updated weights for policy 1, policy_version 620712 (0.0007) [2023-12-27 23:41:24,622][106226] Updated weights for policy 0, policy_version 618804 (0.0010) [2023-12-27 23:41:24,676][106226] Updated weights for policy 0, policy_version 618814 (0.0008) [2023-12-27 23:41:24,729][106226] Updated weights for policy 0, policy_version 618824 (0.0008) [2023-12-27 23:41:24,972][106225] Updated weights for policy 1, policy_version 620722 (0.0008) [2023-12-27 23:41:25,033][106225] Updated weights for policy 1, policy_version 620732 (0.0005) [2023-12-27 23:41:25,086][106225] Updated weights for policy 1, policy_version 620742 (0.0005) [2023-12-27 23:41:25,134][106225] Updated weights for policy 1, policy_version 620752 (0.0005) [2023-12-27 23:41:25,548][106226] Updated weights for policy 0, policy_version 618834 (0.0008) [2023-12-27 23:41:25,615][106226] Updated weights for policy 0, policy_version 618844 (0.0006) [2023-12-27 23:41:25,677][106226] Updated weights for policy 0, policy_version 618854 (0.0007) [2023-12-27 23:41:25,702][106225] Updated weights for policy 1, policy_version 620762 (0.0010) [2023-12-27 23:41:25,738][106226] Updated weights for policy 0, policy_version 618864 (0.0007) [2023-12-27 23:41:25,760][106225] Updated weights for policy 1, policy_version 620772 (0.0008) [2023-12-27 23:41:25,814][106225] Updated weights for policy 1, policy_version 620782 (0.0005) [2023-12-27 23:41:26,175][105115] Fps is (10 sec: 20479.0, 60 sec: 19797.2, 300 sec: 19771.8). Total num frames: 317415424. Throughput: 0: 9868.2, 1: 9734.2. Samples: 317383956. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:26,176][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.768')] [2023-12-27 23:41:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000618864_158466048.pth... [2023-12-27 23:41:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000620784_158949376.pth... [2023-12-27 23:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000617712_158171136.pth [2023-12-27 23:41:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000619632_158654464.pth [2023-12-27 23:41:26,363][106225] Updated weights for policy 1, policy_version 620792 (0.0009) [2023-12-27 23:41:26,407][106226] Updated weights for policy 0, policy_version 618874 (0.0008) [2023-12-27 23:41:26,420][106225] Updated weights for policy 1, policy_version 620802 (0.0006) [2023-12-27 23:41:26,466][106226] Updated weights for policy 0, policy_version 618884 (0.0007) [2023-12-27 23:41:26,479][106225] Updated weights for policy 1, policy_version 620812 (0.0006) [2023-12-27 23:41:26,519][106226] Updated weights for policy 0, policy_version 618894 (0.0007) [2023-12-27 23:41:27,123][106225] Updated weights for policy 1, policy_version 620822 (0.0005) [2023-12-27 23:41:27,182][106225] Updated weights for policy 1, policy_version 620832 (0.0005) [2023-12-27 23:41:27,245][106225] Updated weights for policy 1, policy_version 620842 (0.0005) [2023-12-27 23:41:27,297][106226] Updated weights for policy 0, policy_version 618904 (0.0007) [2023-12-27 23:41:27,363][106226] Updated weights for policy 0, policy_version 618914 (0.0006) [2023-12-27 23:41:27,416][106226] Updated weights for policy 0, policy_version 618924 (0.0005) [2023-12-27 23:41:27,860][106225] Updated weights for policy 1, policy_version 620852 (0.0006) [2023-12-27 23:41:27,918][106225] Updated weights for policy 1, policy_version 620862 (0.0006) [2023-12-27 23:41:27,990][106225] Updated weights for policy 1, policy_version 620872 (0.0007) [2023-12-27 23:41:28,050][106226] Updated weights for policy 0, policy_version 618934 (0.0008) [2023-12-27 23:41:28,110][106226] Updated weights for policy 0, policy_version 618944 (0.0011) [2023-12-27 23:41:28,169][106226] Updated weights for policy 0, policy_version 618954 (0.0011) [2023-12-27 23:41:28,591][106225] Updated weights for policy 1, policy_version 620882 (0.0008) [2023-12-27 23:41:28,652][106225] Updated weights for policy 1, policy_version 620892 (0.0010) [2023-12-27 23:41:28,721][106225] Updated weights for policy 1, policy_version 620902 (0.0011) [2023-12-27 23:41:28,780][106225] Updated weights for policy 1, policy_version 620912 (0.0010) [2023-12-27 23:41:28,918][106226] Updated weights for policy 0, policy_version 618964 (0.0009) [2023-12-27 23:41:28,988][106226] Updated weights for policy 0, policy_version 618974 (0.0011) [2023-12-27 23:41:29,051][106226] Updated weights for policy 0, policy_version 618984 (0.0010) [2023-12-27 23:41:29,443][106225] Updated weights for policy 1, policy_version 620922 (0.0006) [2023-12-27 23:41:29,491][106225] Updated weights for policy 1, policy_version 620932 (0.0005) [2023-12-27 23:41:29,543][106225] Updated weights for policy 1, policy_version 620942 (0.0008) [2023-12-27 23:41:29,786][106226] Updated weights for policy 0, policy_version 618994 (0.0010) [2023-12-27 23:41:29,855][106226] Updated weights for policy 0, policy_version 619004 (0.0007) [2023-12-27 23:41:29,917][106226] Updated weights for policy 0, policy_version 619014 (0.0007) [2023-12-27 23:41:29,969][106226] Updated weights for policy 0, policy_version 619024 (0.0006) [2023-12-27 23:41:30,352][106225] Updated weights for policy 1, policy_version 620952 (0.0010) [2023-12-27 23:41:30,409][106225] Updated weights for policy 1, policy_version 620962 (0.0009) [2023-12-27 23:41:30,459][106225] Updated weights for policy 1, policy_version 620972 (0.0008) [2023-12-27 23:41:30,547][106226] Updated weights for policy 0, policy_version 619034 (0.0010) [2023-12-27 23:41:30,597][106226] Updated weights for policy 0, policy_version 619044 (0.0007) [2023-12-27 23:41:30,646][106226] Updated weights for policy 0, policy_version 619054 (0.0010) [2023-12-27 23:41:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 317513728. Throughput: 0: 9841.7, 1: 9963.3. Samples: 317507800. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:31,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-6.354')] [2023-12-27 23:41:31,179][106225] Updated weights for policy 1, policy_version 620982 (0.0008) [2023-12-27 23:41:31,235][106225] Updated weights for policy 1, policy_version 620992 (0.0009) [2023-12-27 23:41:31,299][106225] Updated weights for policy 1, policy_version 621002 (0.0007) [2023-12-27 23:41:31,382][106226] Updated weights for policy 0, policy_version 619064 (0.0009) [2023-12-27 23:41:31,436][106226] Updated weights for policy 0, policy_version 619074 (0.0008) [2023-12-27 23:41:31,486][106226] Updated weights for policy 0, policy_version 619084 (0.0008) [2023-12-27 23:41:32,019][106225] Updated weights for policy 1, policy_version 621012 (0.0006) [2023-12-27 23:41:32,076][106225] Updated weights for policy 1, policy_version 621022 (0.0006) [2023-12-27 23:41:32,137][106225] Updated weights for policy 1, policy_version 621032 (0.0005) [2023-12-27 23:41:32,217][106226] Updated weights for policy 0, policy_version 619094 (0.0009) [2023-12-27 23:41:32,267][106226] Updated weights for policy 0, policy_version 619104 (0.0008) [2023-12-27 23:41:32,329][106226] Updated weights for policy 0, policy_version 619114 (0.0010) [2023-12-27 23:41:32,838][106225] Updated weights for policy 1, policy_version 621042 (0.0007) [2023-12-27 23:41:32,892][106225] Updated weights for policy 1, policy_version 621052 (0.0010) [2023-12-27 23:41:32,951][106225] Updated weights for policy 1, policy_version 621062 (0.0007) [2023-12-27 23:41:33,003][106225] Updated weights for policy 1, policy_version 621072 (0.0007) [2023-12-27 23:41:33,027][106226] Updated weights for policy 0, policy_version 619124 (0.0007) [2023-12-27 23:41:33,088][106226] Updated weights for policy 0, policy_version 619134 (0.0007) [2023-12-27 23:41:33,153][106226] Updated weights for policy 0, policy_version 619144 (0.0007) [2023-12-27 23:41:33,630][106225] Updated weights for policy 1, policy_version 621082 (0.0010) [2023-12-27 23:41:33,683][106225] Updated weights for policy 1, policy_version 621092 (0.0010) [2023-12-27 23:41:33,711][106226] Updated weights for policy 0, policy_version 619154 (0.0006) [2023-12-27 23:41:33,738][106225] Updated weights for policy 1, policy_version 621102 (0.0007) [2023-12-27 23:41:33,758][106226] Updated weights for policy 0, policy_version 619164 (0.0008) [2023-12-27 23:41:33,807][106226] Updated weights for policy 0, policy_version 619174 (0.0008) [2023-12-27 23:41:33,860][106226] Updated weights for policy 0, policy_version 619184 (0.0005) [2023-12-27 23:41:34,301][106225] Updated weights for policy 1, policy_version 621112 (0.0009) [2023-12-27 23:41:34,362][106225] Updated weights for policy 1, policy_version 621122 (0.0010) [2023-12-27 23:41:34,423][106225] Updated weights for policy 1, policy_version 621132 (0.0010) [2023-12-27 23:41:34,568][106226] Updated weights for policy 0, policy_version 619194 (0.0008) [2023-12-27 23:41:34,638][106226] Updated weights for policy 0, policy_version 619204 (0.0008) [2023-12-27 23:41:34,699][106226] Updated weights for policy 0, policy_version 619214 (0.0008) [2023-12-27 23:41:35,096][106225] Updated weights for policy 1, policy_version 621142 (0.0010) [2023-12-27 23:41:35,145][106225] Updated weights for policy 1, policy_version 621152 (0.0010) [2023-12-27 23:41:35,195][106225] Updated weights for policy 1, policy_version 621162 (0.0010) [2023-12-27 23:41:35,383][106226] Updated weights for policy 0, policy_version 619224 (0.0007) [2023-12-27 23:41:35,436][106226] Updated weights for policy 0, policy_version 619234 (0.0008) [2023-12-27 23:41:35,485][106226] Updated weights for policy 0, policy_version 619244 (0.0008) [2023-12-27 23:41:35,923][106225] Updated weights for policy 1, policy_version 621172 (0.0009) [2023-12-27 23:41:35,980][106225] Updated weights for policy 1, policy_version 621182 (0.0009) [2023-12-27 23:41:36,040][106225] Updated weights for policy 1, policy_version 621192 (0.0009) [2023-12-27 23:41:36,169][106226] Updated weights for policy 0, policy_version 619254 (0.0008) [2023-12-27 23:41:36,174][105115] Fps is (10 sec: 20481.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 317620224. Throughput: 0: 9845.0, 1: 10004.1. Samples: 317630204. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:36,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.954')] [2023-12-27 23:41:36,231][106226] Updated weights for policy 0, policy_version 619264 (0.0008) [2023-12-27 23:41:36,301][106226] Updated weights for policy 0, policy_version 619274 (0.0010) [2023-12-27 23:41:36,816][106225] Updated weights for policy 1, policy_version 621202 (0.0008) [2023-12-27 23:41:36,878][106225] Updated weights for policy 1, policy_version 621212 (0.0009) [2023-12-27 23:41:36,937][106225] Updated weights for policy 1, policy_version 621222 (0.0010) [2023-12-27 23:41:36,965][106226] Updated weights for policy 0, policy_version 619284 (0.0009) [2023-12-27 23:41:36,997][106225] Updated weights for policy 1, policy_version 621232 (0.0008) [2023-12-27 23:41:37,015][106226] Updated weights for policy 0, policy_version 619294 (0.0005) [2023-12-27 23:41:37,067][106226] Updated weights for policy 0, policy_version 619304 (0.0006) [2023-12-27 23:41:37,681][106226] Updated weights for policy 0, policy_version 619314 (0.0008) [2023-12-27 23:41:37,730][106226] Updated weights for policy 0, policy_version 619324 (0.0007) [2023-12-27 23:41:37,783][106226] Updated weights for policy 0, policy_version 619334 (0.0006) [2023-12-27 23:41:37,785][106225] Updated weights for policy 1, policy_version 621242 (0.0007) [2023-12-27 23:41:37,831][106226] Updated weights for policy 0, policy_version 619344 (0.0008) [2023-12-27 23:41:37,833][106225] Updated weights for policy 1, policy_version 621252 (0.0008) [2023-12-27 23:41:37,888][106225] Updated weights for policy 1, policy_version 621262 (0.0008) [2023-12-27 23:41:38,486][106226] Updated weights for policy 0, policy_version 619354 (0.0008) [2023-12-27 23:41:38,555][106226] Updated weights for policy 0, policy_version 619364 (0.0009) [2023-12-27 23:41:38,609][106226] Updated weights for policy 0, policy_version 619374 (0.0009) [2023-12-27 23:41:38,640][106225] Updated weights for policy 1, policy_version 621272 (0.0008) [2023-12-27 23:41:38,698][106225] Updated weights for policy 1, policy_version 621282 (0.0008) [2023-12-27 23:41:38,762][106225] Updated weights for policy 1, policy_version 621292 (0.0007) [2023-12-27 23:41:39,368][106226] Updated weights for policy 0, policy_version 619384 (0.0008) [2023-12-27 23:41:39,441][106226] Updated weights for policy 0, policy_version 619394 (0.0008) [2023-12-27 23:41:39,483][106225] Updated weights for policy 1, policy_version 621302 (0.0008) [2023-12-27 23:41:39,500][106226] Updated weights for policy 0, policy_version 619404 (0.0008) [2023-12-27 23:41:39,535][106225] Updated weights for policy 1, policy_version 621312 (0.0008) [2023-12-27 23:41:39,587][106225] Updated weights for policy 1, policy_version 621322 (0.0008) [2023-12-27 23:41:40,269][106226] Updated weights for policy 0, policy_version 619414 (0.0008) [2023-12-27 23:41:40,329][106226] Updated weights for policy 0, policy_version 619424 (0.0009) [2023-12-27 23:41:40,340][106225] Updated weights for policy 1, policy_version 621332 (0.0009) [2023-12-27 23:41:40,395][106226] Updated weights for policy 0, policy_version 619434 (0.0006) [2023-12-27 23:41:40,397][106225] Updated weights for policy 1, policy_version 621342 (0.0008) [2023-12-27 23:41:40,456][106225] Updated weights for policy 1, policy_version 621352 (0.0009) [2023-12-27 23:41:41,076][106225] Updated weights for policy 1, policy_version 621362 (0.0008) [2023-12-27 23:41:41,128][106225] Updated weights for policy 1, policy_version 621372 (0.0008) [2023-12-27 23:41:41,163][106226] Updated weights for policy 0, policy_version 619444 (0.0007) [2023-12-27 23:41:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 317710336. Throughput: 0: 9905.4, 1: 9972.6. Samples: 317688444. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:41,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.794')] [2023-12-27 23:41:41,198][106225] Updated weights for policy 1, policy_version 621382 (0.0008) [2023-12-27 23:41:41,228][106226] Updated weights for policy 0, policy_version 619454 (0.0008) [2023-12-27 23:41:41,256][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000621392_159105024.pth... [2023-12-27 23:41:41,257][106225] Updated weights for policy 1, policy_version 621392 (0.0008) [2023-12-27 23:41:41,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000620208_158801920.pth [2023-12-27 23:41:41,290][106226] Updated weights for policy 0, policy_version 619464 (0.0008) [2023-12-27 23:41:41,342][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000619472_158621696.pth... [2023-12-27 23:41:41,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000618288_158318592.pth [2023-12-27 23:41:42,054][106225] Updated weights for policy 1, policy_version 621402 (0.0006) [2023-12-27 23:41:42,083][106226] Updated weights for policy 0, policy_version 619474 (0.0008) [2023-12-27 23:41:42,116][106225] Updated weights for policy 1, policy_version 621412 (0.0008) [2023-12-27 23:41:42,146][106226] Updated weights for policy 0, policy_version 619484 (0.0011) [2023-12-27 23:41:42,177][106225] Updated weights for policy 1, policy_version 621422 (0.0007) [2023-12-27 23:41:42,204][106226] Updated weights for policy 0, policy_version 619494 (0.0007) [2023-12-27 23:41:42,286][106226] Updated weights for policy 0, policy_version 619504 (0.0007) [2023-12-27 23:41:42,892][106226] Updated weights for policy 0, policy_version 619514 (0.0007) [2023-12-27 23:41:42,962][106225] Updated weights for policy 1, policy_version 621432 (0.0006) [2023-12-27 23:41:42,963][106226] Updated weights for policy 0, policy_version 619524 (0.0008) [2023-12-27 23:41:43,026][106225] Updated weights for policy 1, policy_version 621442 (0.0006) [2023-12-27 23:41:43,028][106226] Updated weights for policy 0, policy_version 619534 (0.0008) [2023-12-27 23:41:43,084][106225] Updated weights for policy 1, policy_version 621452 (0.0008) [2023-12-27 23:41:43,652][106226] Updated weights for policy 0, policy_version 619544 (0.0006) [2023-12-27 23:41:43,708][106226] Updated weights for policy 0, policy_version 619554 (0.0006) [2023-12-27 23:41:43,718][106225] Updated weights for policy 1, policy_version 621462 (0.0009) [2023-12-27 23:41:43,757][106226] Updated weights for policy 0, policy_version 619564 (0.0005) [2023-12-27 23:41:43,765][106225] Updated weights for policy 1, policy_version 621472 (0.0010) [2023-12-27 23:41:43,815][106225] Updated weights for policy 1, policy_version 621482 (0.0010) [2023-12-27 23:41:44,383][106226] Updated weights for policy 0, policy_version 619574 (0.0008) [2023-12-27 23:41:44,447][106226] Updated weights for policy 0, policy_version 619584 (0.0009) [2023-12-27 23:41:44,463][106225] Updated weights for policy 1, policy_version 621492 (0.0008) [2023-12-27 23:41:44,508][106226] Updated weights for policy 0, policy_version 619594 (0.0011) [2023-12-27 23:41:44,525][106225] Updated weights for policy 1, policy_version 621502 (0.0008) [2023-12-27 23:41:44,588][106225] Updated weights for policy 1, policy_version 621512 (0.0009) [2023-12-27 23:41:45,181][106226] Updated weights for policy 0, policy_version 619604 (0.0009) [2023-12-27 23:41:45,244][106226] Updated weights for policy 0, policy_version 619614 (0.0009) [2023-12-27 23:41:45,300][106225] Updated weights for policy 1, policy_version 621522 (0.0009) [2023-12-27 23:41:45,312][106226] Updated weights for policy 0, policy_version 619624 (0.0009) [2023-12-27 23:41:45,365][106225] Updated weights for policy 1, policy_version 621532 (0.0009) [2023-12-27 23:41:45,417][106225] Updated weights for policy 1, policy_version 621542 (0.0008) [2023-12-27 23:41:45,470][106225] Updated weights for policy 1, policy_version 621552 (0.0008) [2023-12-27 23:41:45,932][106226] Updated weights for policy 0, policy_version 619634 (0.0007) [2023-12-27 23:41:45,989][106226] Updated weights for policy 0, policy_version 619644 (0.0008) [2023-12-27 23:41:46,035][106226] Updated weights for policy 0, policy_version 619654 (0.0005) [2023-12-27 23:41:46,099][106226] Updated weights for policy 0, policy_version 619664 (0.0009) [2023-12-27 23:41:46,105][106225] Updated weights for policy 1, policy_version 621562 (0.0006) [2023-12-27 23:41:46,151][106225] Updated weights for policy 1, policy_version 621572 (0.0005) [2023-12-27 23:41:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 317816832. Throughput: 0: 9901.8, 1: 9923.6. Samples: 317805196. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:46,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-5.944')] [2023-12-27 23:41:46,197][106225] Updated weights for policy 1, policy_version 621582 (0.0005) [2023-12-27 23:41:46,822][106225] Updated weights for policy 1, policy_version 621592 (0.0007) [2023-12-27 23:41:46,844][106226] Updated weights for policy 0, policy_version 619674 (0.0006) [2023-12-27 23:41:46,883][106225] Updated weights for policy 1, policy_version 621602 (0.0008) [2023-12-27 23:41:46,894][106226] Updated weights for policy 0, policy_version 619684 (0.0007) [2023-12-27 23:41:46,941][106225] Updated weights for policy 1, policy_version 621612 (0.0008) [2023-12-27 23:41:46,948][106226] Updated weights for policy 0, policy_version 619694 (0.0006) [2023-12-27 23:41:47,637][106225] Updated weights for policy 1, policy_version 621622 (0.0008) [2023-12-27 23:41:47,688][106225] Updated weights for policy 1, policy_version 621632 (0.0007) [2023-12-27 23:41:47,690][106226] Updated weights for policy 0, policy_version 619704 (0.0005) [2023-12-27 23:41:47,747][106225] Updated weights for policy 1, policy_version 621642 (0.0006) [2023-12-27 23:41:47,749][106226] Updated weights for policy 0, policy_version 619714 (0.0007) [2023-12-27 23:41:47,813][106226] Updated weights for policy 0, policy_version 619724 (0.0008) [2023-12-27 23:41:48,307][106225] Updated weights for policy 1, policy_version 621652 (0.0007) [2023-12-27 23:41:48,370][106225] Updated weights for policy 1, policy_version 621662 (0.0008) [2023-12-27 23:41:48,426][106225] Updated weights for policy 1, policy_version 621672 (0.0010) [2023-12-27 23:41:48,635][106226] Updated weights for policy 0, policy_version 619734 (0.0008) [2023-12-27 23:41:48,698][106226] Updated weights for policy 0, policy_version 619744 (0.0008) [2023-12-27 23:41:48,762][106226] Updated weights for policy 0, policy_version 619754 (0.0008) [2023-12-27 23:41:49,133][106225] Updated weights for policy 1, policy_version 621682 (0.0010) [2023-12-27 23:41:49,197][106225] Updated weights for policy 1, policy_version 621692 (0.0010) [2023-12-27 23:41:49,265][106225] Updated weights for policy 1, policy_version 621702 (0.0010) [2023-12-27 23:41:49,332][106225] Updated weights for policy 1, policy_version 621712 (0.0010) [2023-12-27 23:41:49,424][106226] Updated weights for policy 0, policy_version 619764 (0.0009) [2023-12-27 23:41:49,483][106226] Updated weights for policy 0, policy_version 619774 (0.0008) [2023-12-27 23:41:49,551][106226] Updated weights for policy 0, policy_version 619784 (0.0008) [2023-12-27 23:41:50,057][106225] Updated weights for policy 1, policy_version 621722 (0.0009) [2023-12-27 23:41:50,116][106225] Updated weights for policy 1, policy_version 621732 (0.0010) [2023-12-27 23:41:50,174][106225] Updated weights for policy 1, policy_version 621742 (0.0010) [2023-12-27 23:41:50,246][106226] Updated weights for policy 0, policy_version 619794 (0.0007) [2023-12-27 23:41:50,310][106226] Updated weights for policy 0, policy_version 619804 (0.0009) [2023-12-27 23:41:50,371][106226] Updated weights for policy 0, policy_version 619814 (0.0008) [2023-12-27 23:41:50,428][106226] Updated weights for policy 0, policy_version 619824 (0.0009) [2023-12-27 23:41:50,814][106225] Updated weights for policy 1, policy_version 621752 (0.0009) [2023-12-27 23:41:50,871][106225] Updated weights for policy 1, policy_version 621762 (0.0008) [2023-12-27 23:41:50,937][106225] Updated weights for policy 1, policy_version 621772 (0.0008) [2023-12-27 23:41:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 317915136. Throughput: 0: 9831.3, 1: 10017.2. Samples: 317925604. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:51,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-6.081')] [2023-12-27 23:41:51,238][106226] Updated weights for policy 0, policy_version 619834 (0.0006) [2023-12-27 23:41:51,304][106226] Updated weights for policy 0, policy_version 619844 (0.0007) [2023-12-27 23:41:51,373][106226] Updated weights for policy 0, policy_version 619854 (0.0008) [2023-12-27 23:41:51,726][106225] Updated weights for policy 1, policy_version 621782 (0.0008) [2023-12-27 23:41:51,794][106225] Updated weights for policy 1, policy_version 621792 (0.0007) [2023-12-27 23:41:51,853][106225] Updated weights for policy 1, policy_version 621802 (0.0009) [2023-12-27 23:41:52,089][106226] Updated weights for policy 0, policy_version 619864 (0.0009) [2023-12-27 23:41:52,139][106226] Updated weights for policy 0, policy_version 619874 (0.0010) [2023-12-27 23:41:52,189][106226] Updated weights for policy 0, policy_version 619884 (0.0007) [2023-12-27 23:41:52,549][106225] Updated weights for policy 1, policy_version 621812 (0.0008) [2023-12-27 23:41:52,605][106225] Updated weights for policy 1, policy_version 621822 (0.0006) [2023-12-27 23:41:52,661][106225] Updated weights for policy 1, policy_version 621832 (0.0008) [2023-12-27 23:41:52,904][106226] Updated weights for policy 0, policy_version 619894 (0.0007) [2023-12-27 23:41:52,964][106226] Updated weights for policy 0, policy_version 619904 (0.0008) [2023-12-27 23:41:53,024][106226] Updated weights for policy 0, policy_version 619914 (0.0008) [2023-12-27 23:41:53,376][106225] Updated weights for policy 1, policy_version 621842 (0.0008) [2023-12-27 23:41:53,428][106225] Updated weights for policy 1, policy_version 621852 (0.0009) [2023-12-27 23:41:53,473][106225] Updated weights for policy 1, policy_version 621862 (0.0008) [2023-12-27 23:41:53,523][106225] Updated weights for policy 1, policy_version 621872 (0.0008) [2023-12-27 23:41:53,725][106226] Updated weights for policy 0, policy_version 619924 (0.0007) [2023-12-27 23:41:53,784][106226] Updated weights for policy 0, policy_version 619934 (0.0009) [2023-12-27 23:41:53,844][106226] Updated weights for policy 0, policy_version 619944 (0.0008) [2023-12-27 23:41:54,268][106225] Updated weights for policy 1, policy_version 621882 (0.0008) [2023-12-27 23:41:54,313][106225] Updated weights for policy 1, policy_version 621892 (0.0008) [2023-12-27 23:41:54,377][106225] Updated weights for policy 1, policy_version 621902 (0.0008) [2023-12-27 23:41:54,572][106226] Updated weights for policy 0, policy_version 619954 (0.0009) [2023-12-27 23:41:54,634][106226] Updated weights for policy 0, policy_version 619964 (0.0009) [2023-12-27 23:41:54,687][106226] Updated weights for policy 0, policy_version 619974 (0.0009) [2023-12-27 23:41:54,744][106226] Updated weights for policy 0, policy_version 619984 (0.0008) [2023-12-27 23:41:55,040][106225] Updated weights for policy 1, policy_version 621912 (0.0008) [2023-12-27 23:41:55,101][106225] Updated weights for policy 1, policy_version 621922 (0.0008) [2023-12-27 23:41:55,156][106225] Updated weights for policy 1, policy_version 621932 (0.0008) [2023-12-27 23:41:55,496][106226] Updated weights for policy 0, policy_version 619994 (0.0008) [2023-12-27 23:41:55,551][106226] Updated weights for policy 0, policy_version 620004 (0.0009) [2023-12-27 23:41:55,602][106226] Updated weights for policy 0, policy_version 620014 (0.0008) [2023-12-27 23:41:55,854][106225] Updated weights for policy 1, policy_version 621942 (0.0008) [2023-12-27 23:41:55,914][106225] Updated weights for policy 1, policy_version 621952 (0.0008) [2023-12-27 23:41:55,964][106225] Updated weights for policy 1, policy_version 621962 (0.0008) [2023-12-27 23:41:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 318013440. Throughput: 0: 9823.7, 1: 10036.3. Samples: 317982924. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:41:56,175][105115] Avg episode reward: [(0, '-4.767'), (1, '-5.560')] [2023-12-27 23:41:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000621968_159252480.pth... [2023-12-27 23:41:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000620784_158949376.pth [2023-12-27 23:41:56,217][106226] Updated weights for policy 0, policy_version 620024 (0.0008) [2023-12-27 23:41:56,263][106226] Updated weights for policy 0, policy_version 620034 (0.0008) [2023-12-27 23:41:56,316][106226] Updated weights for policy 0, policy_version 620044 (0.0008) [2023-12-27 23:41:56,334][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000620048_158769152.pth... [2023-12-27 23:41:56,338][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000618864_158466048.pth [2023-12-27 23:41:56,735][106225] Updated weights for policy 1, policy_version 621972 (0.0009) [2023-12-27 23:41:56,802][106225] Updated weights for policy 1, policy_version 621982 (0.0009) [2023-12-27 23:41:56,859][106225] Updated weights for policy 1, policy_version 621992 (0.0009) [2023-12-27 23:41:56,979][106226] Updated weights for policy 0, policy_version 620054 (0.0008) [2023-12-27 23:41:57,025][106226] Updated weights for policy 0, policy_version 620064 (0.0008) [2023-12-27 23:41:57,079][106226] Updated weights for policy 0, policy_version 620074 (0.0007) [2023-12-27 23:41:57,540][106225] Updated weights for policy 1, policy_version 622002 (0.0008) [2023-12-27 23:41:57,600][106225] Updated weights for policy 1, policy_version 622012 (0.0009) [2023-12-27 23:41:57,659][106225] Updated weights for policy 1, policy_version 622022 (0.0008) [2023-12-27 23:41:57,722][106225] Updated weights for policy 1, policy_version 622032 (0.0009) [2023-12-27 23:41:57,787][106226] Updated weights for policy 0, policy_version 620084 (0.0008) [2023-12-27 23:41:57,844][106226] Updated weights for policy 0, policy_version 620094 (0.0006) [2023-12-27 23:41:57,905][106226] Updated weights for policy 0, policy_version 620104 (0.0005) [2023-12-27 23:41:58,486][106225] Updated weights for policy 1, policy_version 622042 (0.0007) [2023-12-27 23:41:58,553][106225] Updated weights for policy 1, policy_version 622052 (0.0008) [2023-12-27 23:41:58,560][106226] Updated weights for policy 0, policy_version 620114 (0.0007) [2023-12-27 23:41:58,619][106225] Updated weights for policy 1, policy_version 622062 (0.0008) [2023-12-27 23:41:58,619][106226] Updated weights for policy 0, policy_version 620124 (0.0008) [2023-12-27 23:41:58,675][106226] Updated weights for policy 0, policy_version 620134 (0.0007) [2023-12-27 23:41:58,746][106226] Updated weights for policy 0, policy_version 620144 (0.0008) [2023-12-27 23:41:59,471][106225] Updated weights for policy 1, policy_version 622072 (0.0007) [2023-12-27 23:41:59,543][106225] Updated weights for policy 1, policy_version 622082 (0.0008) [2023-12-27 23:41:59,543][106226] Updated weights for policy 0, policy_version 620154 (0.0008) [2023-12-27 23:41:59,608][106225] Updated weights for policy 1, policy_version 622092 (0.0008) [2023-12-27 23:41:59,610][106226] Updated weights for policy 0, policy_version 620164 (0.0005) [2023-12-27 23:41:59,666][106226] Updated weights for policy 0, policy_version 620174 (0.0009) [2023-12-27 23:42:00,275][106225] Updated weights for policy 1, policy_version 622102 (0.0009) [2023-12-27 23:42:00,319][106226] Updated weights for policy 0, policy_version 620184 (0.0007) [2023-12-27 23:42:00,335][106225] Updated weights for policy 1, policy_version 622112 (0.0010) [2023-12-27 23:42:00,376][106226] Updated weights for policy 0, policy_version 620194 (0.0006) [2023-12-27 23:42:00,386][106225] Updated weights for policy 1, policy_version 622122 (0.0010) [2023-12-27 23:42:00,432][106226] Updated weights for policy 0, policy_version 620204 (0.0006) [2023-12-27 23:42:01,060][106226] Updated weights for policy 0, policy_version 620214 (0.0008) [2023-12-27 23:42:01,108][106225] Updated weights for policy 1, policy_version 622132 (0.0010) [2023-12-27 23:42:01,119][106226] Updated weights for policy 0, policy_version 620224 (0.0008) [2023-12-27 23:42:01,172][106225] Updated weights for policy 1, policy_version 622142 (0.0008) [2023-12-27 23:42:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 318103552. Throughput: 0: 9877.0, 1: 10038.7. Samples: 318099388. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-27 23:42:01,175][105115] Avg episode reward: [(0, '-4.191'), (1, '-6.077')] [2023-12-27 23:42:01,181][106226] Updated weights for policy 0, policy_version 620234 (0.0008) [2023-12-27 23:42:01,233][106225] Updated weights for policy 1, policy_version 622152 (0.0010) [2023-12-27 23:42:01,907][106226] Updated weights for policy 0, policy_version 620244 (0.0008) [2023-12-27 23:42:01,967][106226] Updated weights for policy 0, policy_version 620254 (0.0005) [2023-12-27 23:42:01,998][106225] Updated weights for policy 1, policy_version 622162 (0.0008) [2023-12-27 23:42:02,024][106226] Updated weights for policy 0, policy_version 620264 (0.0005) [2023-12-27 23:42:02,056][106225] Updated weights for policy 1, policy_version 622172 (0.0009) [2023-12-27 23:42:02,102][106225] Updated weights for policy 1, policy_version 622182 (0.0008) [2023-12-27 23:42:02,154][106225] Updated weights for policy 1, policy_version 622192 (0.0008) [2023-12-27 23:42:02,690][106226] Updated weights for policy 0, policy_version 620274 (0.0008) [2023-12-27 23:42:02,751][106226] Updated weights for policy 0, policy_version 620284 (0.0009) [2023-12-27 23:42:02,814][106226] Updated weights for policy 0, policy_version 620294 (0.0008) [2023-12-27 23:42:02,840][106225] Updated weights for policy 1, policy_version 622202 (0.0006) [2023-12-27 23:42:02,877][106226] Updated weights for policy 0, policy_version 620304 (0.0008) [2023-12-27 23:42:02,891][106225] Updated weights for policy 1, policy_version 622212 (0.0005) [2023-12-27 23:42:02,942][106225] Updated weights for policy 1, policy_version 622222 (0.0005) [2023-12-27 23:42:03,470][106225] Updated weights for policy 1, policy_version 622232 (0.0005) [2023-12-27 23:42:03,520][106225] Updated weights for policy 1, policy_version 622242 (0.0005) [2023-12-27 23:42:03,570][106225] Updated weights for policy 1, policy_version 622252 (0.0005) [2023-12-27 23:42:03,670][106226] Updated weights for policy 0, policy_version 620314 (0.0009) [2023-12-27 23:42:03,720][106226] Updated weights for policy 0, policy_version 620324 (0.0008) [2023-12-27 23:42:03,767][106226] Updated weights for policy 0, policy_version 620334 (0.0008) [2023-12-27 23:42:04,159][106225] Updated weights for policy 1, policy_version 622262 (0.0006) [2023-12-27 23:42:04,227][106225] Updated weights for policy 1, policy_version 622272 (0.0006) [2023-12-27 23:42:04,285][106225] Updated weights for policy 1, policy_version 622282 (0.0005) [2023-12-27 23:42:04,592][106226] Updated weights for policy 0, policy_version 620344 (0.0005) [2023-12-27 23:42:04,659][106226] Updated weights for policy 0, policy_version 620354 (0.0007) [2023-12-27 23:42:04,716][106226] Updated weights for policy 0, policy_version 620364 (0.0008) [2023-12-27 23:42:04,840][106225] Updated weights for policy 1, policy_version 622292 (0.0005) [2023-12-27 23:42:04,893][106225] Updated weights for policy 1, policy_version 622302 (0.0005) [2023-12-27 23:42:04,946][106225] Updated weights for policy 1, policy_version 622312 (0.0005) [2023-12-27 23:42:05,432][106226] Updated weights for policy 0, policy_version 620374 (0.0009) [2023-12-27 23:42:05,485][106226] Updated weights for policy 0, policy_version 620384 (0.0009) [2023-12-27 23:42:05,533][106226] Updated weights for policy 0, policy_version 620394 (0.0008) [2023-12-27 23:42:05,563][106225] Updated weights for policy 1, policy_version 622322 (0.0007) [2023-12-27 23:42:05,623][106225] Updated weights for policy 1, policy_version 622332 (0.0008) [2023-12-27 23:42:05,685][106225] Updated weights for policy 1, policy_version 622342 (0.0006) [2023-12-27 23:42:05,756][106225] Updated weights for policy 1, policy_version 622352 (0.0005) [2023-12-27 23:42:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 318210048. Throughput: 0: 9787.6, 1: 10080.6. Samples: 318220536. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:06,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-6.354')] [2023-12-27 23:42:06,325][106226] Updated weights for policy 0, policy_version 620404 (0.0006) [2023-12-27 23:42:06,366][106225] Updated weights for policy 1, policy_version 622362 (0.0008) [2023-12-27 23:42:06,372][106226] Updated weights for policy 0, policy_version 620414 (0.0008) [2023-12-27 23:42:06,430][106225] Updated weights for policy 1, policy_version 622372 (0.0007) [2023-12-27 23:42:06,435][106226] Updated weights for policy 0, policy_version 620424 (0.0006) [2023-12-27 23:42:06,493][106225] Updated weights for policy 1, policy_version 622382 (0.0007) [2023-12-27 23:42:07,140][106225] Updated weights for policy 1, policy_version 622392 (0.0009) [2023-12-27 23:42:07,174][106226] Updated weights for policy 0, policy_version 620434 (0.0009) [2023-12-27 23:42:07,201][106225] Updated weights for policy 1, policy_version 622402 (0.0008) [2023-12-27 23:42:07,234][106226] Updated weights for policy 0, policy_version 620444 (0.0007) [2023-12-27 23:42:07,263][106225] Updated weights for policy 1, policy_version 622412 (0.0009) [2023-12-27 23:42:07,290][106226] Updated weights for policy 0, policy_version 620454 (0.0007) [2023-12-27 23:42:07,341][106226] Updated weights for policy 0, policy_version 620464 (0.0008) [2023-12-27 23:42:07,910][106225] Updated weights for policy 1, policy_version 622422 (0.0005) [2023-12-27 23:42:07,973][106225] Updated weights for policy 1, policy_version 622432 (0.0005) [2023-12-27 23:42:08,030][106225] Updated weights for policy 1, policy_version 622442 (0.0006) [2023-12-27 23:42:08,140][106226] Updated weights for policy 0, policy_version 620474 (0.0010) [2023-12-27 23:42:08,191][106226] Updated weights for policy 0, policy_version 620484 (0.0009) [2023-12-27 23:42:08,241][106226] Updated weights for policy 0, policy_version 620494 (0.0009) [2023-12-27 23:42:08,633][106225] Updated weights for policy 1, policy_version 622452 (0.0006) [2023-12-27 23:42:08,686][106225] Updated weights for policy 1, policy_version 622462 (0.0008) [2023-12-27 23:42:08,738][106225] Updated weights for policy 1, policy_version 622472 (0.0010) [2023-12-27 23:42:09,013][106226] Updated weights for policy 0, policy_version 620504 (0.0009) [2023-12-27 23:42:09,071][106226] Updated weights for policy 0, policy_version 620514 (0.0008) [2023-12-27 23:42:09,121][106226] Updated weights for policy 0, policy_version 620524 (0.0008) [2023-12-27 23:42:09,405][106225] Updated weights for policy 1, policy_version 622482 (0.0009) [2023-12-27 23:42:09,473][106225] Updated weights for policy 1, policy_version 622492 (0.0007) [2023-12-27 23:42:09,540][106225] Updated weights for policy 1, policy_version 622502 (0.0006) [2023-12-27 23:42:09,601][106225] Updated weights for policy 1, policy_version 622512 (0.0006) [2023-12-27 23:42:09,950][106226] Updated weights for policy 0, policy_version 620534 (0.0009) [2023-12-27 23:42:10,017][106226] Updated weights for policy 0, policy_version 620544 (0.0008) [2023-12-27 23:42:10,074][106226] Updated weights for policy 0, policy_version 620554 (0.0008) [2023-12-27 23:42:10,274][106225] Updated weights for policy 1, policy_version 622522 (0.0007) [2023-12-27 23:42:10,345][106225] Updated weights for policy 1, policy_version 622532 (0.0006) [2023-12-27 23:42:10,409][106225] Updated weights for policy 1, policy_version 622542 (0.0008) [2023-12-27 23:42:10,855][106226] Updated weights for policy 0, policy_version 620564 (0.0010) [2023-12-27 23:42:10,914][106226] Updated weights for policy 0, policy_version 620574 (0.0010) [2023-12-27 23:42:10,978][106226] Updated weights for policy 0, policy_version 620584 (0.0010) [2023-12-27 23:42:11,041][106225] Updated weights for policy 1, policy_version 622552 (0.0007) [2023-12-27 23:42:11,103][106225] Updated weights for policy 1, policy_version 622562 (0.0008) [2023-12-27 23:42:11,172][106225] Updated weights for policy 1, policy_version 622572 (0.0009) [2023-12-27 23:42:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 318308352. Throughput: 0: 9769.6, 1: 10152.7. Samples: 318280448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:11,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.895')] [2023-12-27 23:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000620592_158908416.pth... [2023-12-27 23:42:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000619472_158621696.pth [2023-12-27 23:42:11,195][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000622576_159408128.pth... [2023-12-27 23:42:11,198][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000621392_159105024.pth [2023-12-27 23:42:11,773][106226] Updated weights for policy 0, policy_version 620594 (0.0029) [2023-12-27 23:42:11,829][106226] Updated weights for policy 0, policy_version 620604 (0.0008) [2023-12-27 23:42:11,895][106226] Updated weights for policy 0, policy_version 620614 (0.0008) [2023-12-27 23:42:11,928][106225] Updated weights for policy 1, policy_version 622582 (0.0009) [2023-12-27 23:42:11,951][106226] Updated weights for policy 0, policy_version 620624 (0.0008) [2023-12-27 23:42:11,983][106225] Updated weights for policy 1, policy_version 622592 (0.0007) [2023-12-27 23:42:12,038][106225] Updated weights for policy 1, policy_version 622602 (0.0008) [2023-12-27 23:42:12,713][106226] Updated weights for policy 0, policy_version 620634 (0.0008) [2023-12-27 23:42:12,775][106226] Updated weights for policy 0, policy_version 620644 (0.0010) [2023-12-27 23:42:12,826][106225] Updated weights for policy 1, policy_version 622612 (0.0007) [2023-12-27 23:42:12,850][106226] Updated weights for policy 0, policy_version 620654 (0.0007) [2023-12-27 23:42:12,877][106225] Updated weights for policy 1, policy_version 622622 (0.0008) [2023-12-27 23:42:12,931][106225] Updated weights for policy 1, policy_version 622632 (0.0009) [2023-12-27 23:42:13,513][106226] Updated weights for policy 0, policy_version 620664 (0.0010) [2023-12-27 23:42:13,581][106226] Updated weights for policy 0, policy_version 620674 (0.0011) [2023-12-27 23:42:13,640][106225] Updated weights for policy 1, policy_version 622642 (0.0008) [2023-12-27 23:42:13,646][106226] Updated weights for policy 0, policy_version 620684 (0.0011) [2023-12-27 23:42:13,690][106225] Updated weights for policy 1, policy_version 622652 (0.0009) [2023-12-27 23:42:13,744][106225] Updated weights for policy 1, policy_version 622662 (0.0008) [2023-12-27 23:42:13,799][106225] Updated weights for policy 1, policy_version 622672 (0.0008) [2023-12-27 23:42:14,363][106226] Updated weights for policy 0, policy_version 620694 (0.0011) [2023-12-27 23:42:14,424][106226] Updated weights for policy 0, policy_version 620704 (0.0010) [2023-12-27 23:42:14,485][106226] Updated weights for policy 0, policy_version 620714 (0.0011) [2023-12-27 23:42:14,522][106225] Updated weights for policy 1, policy_version 622682 (0.0007) [2023-12-27 23:42:14,578][106225] Updated weights for policy 1, policy_version 622692 (0.0007) [2023-12-27 23:42:14,625][106225] Updated weights for policy 1, policy_version 622702 (0.0007) [2023-12-27 23:42:15,173][106226] Updated weights for policy 0, policy_version 620724 (0.0010) [2023-12-27 23:42:15,239][106226] Updated weights for policy 0, policy_version 620734 (0.0010) [2023-12-27 23:42:15,293][106226] Updated weights for policy 0, policy_version 620744 (0.0008) [2023-12-27 23:42:15,303][106225] Updated weights for policy 1, policy_version 622712 (0.0006) [2023-12-27 23:42:15,364][106225] Updated weights for policy 1, policy_version 622722 (0.0007) [2023-12-27 23:42:15,425][106225] Updated weights for policy 1, policy_version 622732 (0.0010) [2023-12-27 23:42:16,013][106226] Updated weights for policy 0, policy_version 620754 (0.0008) [2023-12-27 23:42:16,077][106226] Updated weights for policy 0, policy_version 620764 (0.0008) [2023-12-27 23:42:16,111][106225] Updated weights for policy 1, policy_version 622742 (0.0010) [2023-12-27 23:42:16,125][106226] Updated weights for policy 0, policy_version 620774 (0.0006) [2023-12-27 23:42:16,158][106225] Updated weights for policy 1, policy_version 622752 (0.0010) [2023-12-27 23:42:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 318398464. Throughput: 0: 9729.1, 1: 9983.2. Samples: 318394856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:16,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-6.163')] [2023-12-27 23:42:16,179][106226] Updated weights for policy 0, policy_version 620784 (0.0006) [2023-12-27 23:42:16,208][106225] Updated weights for policy 1, policy_version 622762 (0.0006) [2023-12-27 23:42:16,796][106225] Updated weights for policy 1, policy_version 622772 (0.0005) [2023-12-27 23:42:16,842][106225] Updated weights for policy 1, policy_version 622782 (0.0005) [2023-12-27 23:42:16,888][106225] Updated weights for policy 1, policy_version 622792 (0.0005) [2023-12-27 23:42:16,983][106226] Updated weights for policy 0, policy_version 620794 (0.0008) [2023-12-27 23:42:17,033][106226] Updated weights for policy 0, policy_version 620804 (0.0008) [2023-12-27 23:42:17,091][106226] Updated weights for policy 0, policy_version 620814 (0.0009) [2023-12-27 23:42:17,453][106225] Updated weights for policy 1, policy_version 622802 (0.0006) [2023-12-27 23:42:17,505][106225] Updated weights for policy 1, policy_version 622812 (0.0008) [2023-12-27 23:42:17,556][106225] Updated weights for policy 1, policy_version 622822 (0.0008) [2023-12-27 23:42:17,608][106225] Updated weights for policy 1, policy_version 622832 (0.0008) [2023-12-27 23:42:17,876][106226] Updated weights for policy 0, policy_version 620824 (0.0008) [2023-12-27 23:42:17,940][106226] Updated weights for policy 0, policy_version 620834 (0.0006) [2023-12-27 23:42:17,999][106226] Updated weights for policy 0, policy_version 620844 (0.0006) [2023-12-27 23:42:18,297][106225] Updated weights for policy 1, policy_version 622842 (0.0007) [2023-12-27 23:42:18,376][106225] Updated weights for policy 1, policy_version 622852 (0.0009) [2023-12-27 23:42:18,444][106225] Updated weights for policy 1, policy_version 622862 (0.0009) [2023-12-27 23:42:18,695][106226] Updated weights for policy 0, policy_version 620854 (0.0008) [2023-12-27 23:42:18,759][106226] Updated weights for policy 0, policy_version 620864 (0.0007) [2023-12-27 23:42:18,824][106226] Updated weights for policy 0, policy_version 620874 (0.0008) [2023-12-27 23:42:19,152][106225] Updated weights for policy 1, policy_version 622872 (0.0006) [2023-12-27 23:42:19,213][106225] Updated weights for policy 1, policy_version 622882 (0.0009) [2023-12-27 23:42:19,285][106225] Updated weights for policy 1, policy_version 622892 (0.0010) [2023-12-27 23:42:19,625][106226] Updated weights for policy 0, policy_version 620884 (0.0008) [2023-12-27 23:42:19,684][106226] Updated weights for policy 0, policy_version 620894 (0.0008) [2023-12-27 23:42:19,741][106226] Updated weights for policy 0, policy_version 620904 (0.0008) [2023-12-27 23:42:20,026][106225] Updated weights for policy 1, policy_version 622902 (0.0009) [2023-12-27 23:42:20,079][106225] Updated weights for policy 1, policy_version 622912 (0.0008) [2023-12-27 23:42:20,143][106225] Updated weights for policy 1, policy_version 622922 (0.0008) [2023-12-27 23:42:20,428][106226] Updated weights for policy 0, policy_version 620914 (0.0007) [2023-12-27 23:42:20,490][106226] Updated weights for policy 0, policy_version 620924 (0.0008) [2023-12-27 23:42:20,547][106226] Updated weights for policy 0, policy_version 620934 (0.0008) [2023-12-27 23:42:20,613][106226] Updated weights for policy 0, policy_version 620944 (0.0008) [2023-12-27 23:42:20,917][106225] Updated weights for policy 1, policy_version 622932 (0.0011) [2023-12-27 23:42:20,979][106225] Updated weights for policy 1, policy_version 622942 (0.0010) [2023-12-27 23:42:21,052][106225] Updated weights for policy 1, policy_version 622952 (0.0010) [2023-12-27 23:42:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 318504960. Throughput: 0: 9619.2, 1: 9996.6. Samples: 318512916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:21,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-5.530')] [2023-12-27 23:42:21,312][106226] Updated weights for policy 0, policy_version 620954 (0.0008) [2023-12-27 23:42:21,382][106226] Updated weights for policy 0, policy_version 620964 (0.0009) [2023-12-27 23:42:21,431][106226] Updated weights for policy 0, policy_version 620974 (0.0008) [2023-12-27 23:42:21,874][106225] Updated weights for policy 1, policy_version 622962 (0.0009) [2023-12-27 23:42:21,932][106225] Updated weights for policy 1, policy_version 622972 (0.0010) [2023-12-27 23:42:22,000][106225] Updated weights for policy 1, policy_version 622982 (0.0011) [2023-12-27 23:42:22,062][106225] Updated weights for policy 1, policy_version 622992 (0.0011) [2023-12-27 23:42:22,225][106226] Updated weights for policy 0, policy_version 620984 (0.0008) [2023-12-27 23:42:22,289][106226] Updated weights for policy 0, policy_version 620994 (0.0008) [2023-12-27 23:42:22,360][106226] Updated weights for policy 0, policy_version 621004 (0.0009) [2023-12-27 23:42:22,776][106225] Updated weights for policy 1, policy_version 623002 (0.0011) [2023-12-27 23:42:22,831][106225] Updated weights for policy 1, policy_version 623012 (0.0010) [2023-12-27 23:42:22,895][106225] Updated weights for policy 1, policy_version 623022 (0.0010) [2023-12-27 23:42:23,045][106226] Updated weights for policy 0, policy_version 621014 (0.0008) [2023-12-27 23:42:23,102][106226] Updated weights for policy 0, policy_version 621024 (0.0008) [2023-12-27 23:42:23,153][106226] Updated weights for policy 0, policy_version 621034 (0.0008) [2023-12-27 23:42:23,621][106225] Updated weights for policy 1, policy_version 623032 (0.0010) [2023-12-27 23:42:23,668][106225] Updated weights for policy 1, policy_version 623042 (0.0009) [2023-12-27 23:42:23,727][106225] Updated weights for policy 1, policy_version 623052 (0.0005) [2023-12-27 23:42:23,891][106226] Updated weights for policy 0, policy_version 621044 (0.0007) [2023-12-27 23:42:23,937][106226] Updated weights for policy 0, policy_version 621054 (0.0005) [2023-12-27 23:42:23,990][106226] Updated weights for policy 0, policy_version 621064 (0.0006) [2023-12-27 23:42:24,352][106225] Updated weights for policy 1, policy_version 623062 (0.0008) [2023-12-27 23:42:24,422][106225] Updated weights for policy 1, policy_version 623072 (0.0010) [2023-12-27 23:42:24,477][106225] Updated weights for policy 1, policy_version 623082 (0.0010) [2023-12-27 23:42:24,702][106226] Updated weights for policy 0, policy_version 621074 (0.0008) [2023-12-27 23:42:24,752][106226] Updated weights for policy 0, policy_version 621084 (0.0007) [2023-12-27 23:42:24,802][106226] Updated weights for policy 0, policy_version 621094 (0.0008) [2023-12-27 23:42:24,852][106226] Updated weights for policy 0, policy_version 621104 (0.0007) [2023-12-27 23:42:25,193][106225] Updated weights for policy 1, policy_version 623092 (0.0011) [2023-12-27 23:42:25,257][106225] Updated weights for policy 1, policy_version 623102 (0.0010) [2023-12-27 23:42:25,304][106225] Updated weights for policy 1, policy_version 623112 (0.0010) [2023-12-27 23:42:25,532][106226] Updated weights for policy 0, policy_version 621114 (0.0008) [2023-12-27 23:42:25,595][106226] Updated weights for policy 0, policy_version 621125 (0.0010) [2023-12-27 23:42:25,654][106226] Updated weights for policy 0, policy_version 621135 (0.0009) [2023-12-27 23:42:25,945][106225] Updated weights for policy 1, policy_version 623122 (0.0010) [2023-12-27 23:42:26,003][106225] Updated weights for policy 1, policy_version 623132 (0.0010) [2023-12-27 23:42:26,053][106225] Updated weights for policy 1, policy_version 623142 (0.0010) [2023-12-27 23:42:26,103][106225] Updated weights for policy 1, policy_version 623152 (0.0010) [2023-12-27 23:42:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.5, 300 sec: 19799.6). Total num frames: 318603264. Throughput: 0: 9557.3, 1: 10004.6. Samples: 318568732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:26,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-6.336')] [2023-12-27 23:42:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000623152_159555584.pth... [2023-12-27 23:42:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000621136_159047680.pth... [2023-12-27 23:42:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000621968_159252480.pth [2023-12-27 23:42:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000620048_158769152.pth [2023-12-27 23:42:26,266][106226] Updated weights for policy 0, policy_version 621145 (0.0005) [2023-12-27 23:42:26,317][106226] Updated weights for policy 0, policy_version 621155 (0.0007) [2023-12-27 23:42:26,377][106226] Updated weights for policy 0, policy_version 621165 (0.0008) [2023-12-27 23:42:26,842][106225] Updated weights for policy 1, policy_version 623162 (0.0010) [2023-12-27 23:42:26,893][106225] Updated weights for policy 1, policy_version 623172 (0.0005) [2023-12-27 23:42:26,945][106225] Updated weights for policy 1, policy_version 623182 (0.0005) [2023-12-27 23:42:27,064][106226] Updated weights for policy 0, policy_version 621175 (0.0008) [2023-12-27 23:42:27,120][106226] Updated weights for policy 0, policy_version 621185 (0.0008) [2023-12-27 23:42:27,177][106226] Updated weights for policy 0, policy_version 621195 (0.0008) [2023-12-27 23:42:27,600][106225] Updated weights for policy 1, policy_version 623192 (0.0007) [2023-12-27 23:42:27,655][106225] Updated weights for policy 1, policy_version 623202 (0.0009) [2023-12-27 23:42:27,712][106225] Updated weights for policy 1, policy_version 623212 (0.0006) [2023-12-27 23:42:27,932][106226] Updated weights for policy 0, policy_version 621205 (0.0008) [2023-12-27 23:42:27,980][106226] Updated weights for policy 0, policy_version 621215 (0.0007) [2023-12-27 23:42:28,034][106226] Updated weights for policy 0, policy_version 621225 (0.0010) [2023-12-27 23:42:28,338][106225] Updated weights for policy 1, policy_version 623222 (0.0007) [2023-12-27 23:42:28,407][106225] Updated weights for policy 1, policy_version 623232 (0.0007) [2023-12-27 23:42:28,467][106225] Updated weights for policy 1, policy_version 623242 (0.0008) [2023-12-27 23:42:28,755][106226] Updated weights for policy 0, policy_version 621235 (0.0007) [2023-12-27 23:42:28,811][106226] Updated weights for policy 0, policy_version 621245 (0.0008) [2023-12-27 23:42:28,869][106226] Updated weights for policy 0, policy_version 621255 (0.0009) [2023-12-27 23:42:29,193][106225] Updated weights for policy 1, policy_version 623252 (0.0008) [2023-12-27 23:42:29,257][106225] Updated weights for policy 1, policy_version 623262 (0.0009) [2023-12-27 23:42:29,322][106225] Updated weights for policy 1, policy_version 623272 (0.0008) [2023-12-27 23:42:29,590][106226] Updated weights for policy 0, policy_version 621265 (0.0008) [2023-12-27 23:42:29,638][106226] Updated weights for policy 0, policy_version 621275 (0.0006) [2023-12-27 23:42:29,688][106226] Updated weights for policy 0, policy_version 621285 (0.0009) [2023-12-27 23:42:29,749][106226] Updated weights for policy 0, policy_version 621295 (0.0008) [2023-12-27 23:42:30,069][106225] Updated weights for policy 1, policy_version 623282 (0.0008) [2023-12-27 23:42:30,125][106225] Updated weights for policy 1, policy_version 623292 (0.0008) [2023-12-27 23:42:30,184][106225] Updated weights for policy 1, policy_version 623302 (0.0008) [2023-12-27 23:42:30,231][106225] Updated weights for policy 1, policy_version 623312 (0.0007) [2023-12-27 23:42:30,461][106226] Updated weights for policy 0, policy_version 621305 (0.0006) [2023-12-27 23:42:30,513][106226] Updated weights for policy 0, policy_version 621315 (0.0005) [2023-12-27 23:42:30,561][106226] Updated weights for policy 0, policy_version 621325 (0.0006) [2023-12-27 23:42:30,866][106225] Updated weights for policy 1, policy_version 623322 (0.0008) [2023-12-27 23:42:30,921][106225] Updated weights for policy 1, policy_version 623332 (0.0005) [2023-12-27 23:42:30,980][106225] Updated weights for policy 1, policy_version 623342 (0.0010) [2023-12-27 23:42:31,143][106226] Updated weights for policy 0, policy_version 621335 (0.0008) [2023-12-27 23:42:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 318701568. Throughput: 0: 9590.3, 1: 10050.4. Samples: 318689028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:31,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.974')] [2023-12-27 23:42:31,199][106226] Updated weights for policy 0, policy_version 621345 (0.0008) [2023-12-27 23:42:31,254][106226] Updated weights for policy 0, policy_version 621355 (0.0008) [2023-12-27 23:42:31,663][106225] Updated weights for policy 1, policy_version 623352 (0.0009) [2023-12-27 23:42:31,725][106225] Updated weights for policy 1, policy_version 623362 (0.0008) [2023-12-27 23:42:31,787][106225] Updated weights for policy 1, policy_version 623372 (0.0008) [2023-12-27 23:42:31,996][106226] Updated weights for policy 0, policy_version 621365 (0.0008) [2023-12-27 23:42:32,057][106226] Updated weights for policy 0, policy_version 621375 (0.0008) [2023-12-27 23:42:32,120][106226] Updated weights for policy 0, policy_version 621385 (0.0008) [2023-12-27 23:42:32,461][106225] Updated weights for policy 1, policy_version 623382 (0.0008) [2023-12-27 23:42:32,518][106225] Updated weights for policy 1, policy_version 623392 (0.0008) [2023-12-27 23:42:32,577][106225] Updated weights for policy 1, policy_version 623402 (0.0009) [2023-12-27 23:42:32,903][106226] Updated weights for policy 0, policy_version 621395 (0.0009) [2023-12-27 23:42:32,947][106226] Updated weights for policy 0, policy_version 621405 (0.0008) [2023-12-27 23:42:32,995][106226] Updated weights for policy 0, policy_version 621415 (0.0008) [2023-12-27 23:42:33,297][106225] Updated weights for policy 1, policy_version 623412 (0.0009) [2023-12-27 23:42:33,354][106225] Updated weights for policy 1, policy_version 623422 (0.0008) [2023-12-27 23:42:33,412][106225] Updated weights for policy 1, policy_version 623432 (0.0009) [2023-12-27 23:42:33,736][106226] Updated weights for policy 0, policy_version 621425 (0.0008) [2023-12-27 23:42:33,788][106226] Updated weights for policy 0, policy_version 621435 (0.0008) [2023-12-27 23:42:33,833][106226] Updated weights for policy 0, policy_version 621445 (0.0008) [2023-12-27 23:42:33,878][106226] Updated weights for policy 0, policy_version 621455 (0.0008) [2023-12-27 23:42:34,116][106225] Updated weights for policy 1, policy_version 623442 (0.0008) [2023-12-27 23:42:34,174][106225] Updated weights for policy 1, policy_version 623452 (0.0008) [2023-12-27 23:42:34,239][106225] Updated weights for policy 1, policy_version 623462 (0.0006) [2023-12-27 23:42:34,298][106225] Updated weights for policy 1, policy_version 623472 (0.0006) [2023-12-27 23:42:34,701][106226] Updated weights for policy 0, policy_version 621465 (0.0009) [2023-12-27 23:42:34,761][106226] Updated weights for policy 0, policy_version 621475 (0.0008) [2023-12-27 23:42:34,820][106226] Updated weights for policy 0, policy_version 621485 (0.0007) [2023-12-27 23:42:34,916][106225] Updated weights for policy 1, policy_version 623482 (0.0007) [2023-12-27 23:42:34,973][106225] Updated weights for policy 1, policy_version 623492 (0.0009) [2023-12-27 23:42:35,035][106225] Updated weights for policy 1, policy_version 623502 (0.0008) [2023-12-27 23:42:35,534][106226] Updated weights for policy 0, policy_version 621495 (0.0008) [2023-12-27 23:42:35,600][106226] Updated weights for policy 0, policy_version 621505 (0.0009) [2023-12-27 23:42:35,669][106226] Updated weights for policy 0, policy_version 621515 (0.0009) [2023-12-27 23:42:35,708][106225] Updated weights for policy 1, policy_version 623512 (0.0007) [2023-12-27 23:42:35,765][106225] Updated weights for policy 1, policy_version 623522 (0.0008) [2023-12-27 23:42:35,828][106225] Updated weights for policy 1, policy_version 623532 (0.0008) [2023-12-27 23:42:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 318799872. Throughput: 0: 9612.8, 1: 10022.2. Samples: 318809176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:36,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-5.976')] [2023-12-27 23:42:36,335][106226] Updated weights for policy 0, policy_version 621525 (0.0009) [2023-12-27 23:42:36,396][106226] Updated weights for policy 0, policy_version 621535 (0.0009) [2023-12-27 23:42:36,454][106226] Updated weights for policy 0, policy_version 621545 (0.0009) [2023-12-27 23:42:36,575][106225] Updated weights for policy 1, policy_version 623542 (0.0008) [2023-12-27 23:42:36,637][106225] Updated weights for policy 1, policy_version 623552 (0.0008) [2023-12-27 23:42:36,696][106225] Updated weights for policy 1, policy_version 623562 (0.0008) [2023-12-27 23:42:37,201][106226] Updated weights for policy 0, policy_version 621555 (0.0009) [2023-12-27 23:42:37,258][106226] Updated weights for policy 0, policy_version 621565 (0.0009) [2023-12-27 23:42:37,311][106226] Updated weights for policy 0, policy_version 621575 (0.0008) [2023-12-27 23:42:37,417][106225] Updated weights for policy 1, policy_version 623572 (0.0008) [2023-12-27 23:42:37,471][106225] Updated weights for policy 1, policy_version 623582 (0.0008) [2023-12-27 23:42:37,523][106225] Updated weights for policy 1, policy_version 623592 (0.0008) [2023-12-27 23:42:38,053][106226] Updated weights for policy 0, policy_version 621585 (0.0008) [2023-12-27 23:42:38,111][106226] Updated weights for policy 0, policy_version 621595 (0.0009) [2023-12-27 23:42:38,169][106226] Updated weights for policy 0, policy_version 621605 (0.0008) [2023-12-27 23:42:38,229][106226] Updated weights for policy 0, policy_version 621615 (0.0008) [2023-12-27 23:42:38,252][106225] Updated weights for policy 1, policy_version 623602 (0.0008) [2023-12-27 23:42:38,309][106225] Updated weights for policy 1, policy_version 623612 (0.0008) [2023-12-27 23:42:38,384][106225] Updated weights for policy 1, policy_version 623622 (0.0009) [2023-12-27 23:42:38,441][106225] Updated weights for policy 1, policy_version 623632 (0.0008) [2023-12-27 23:42:39,004][106226] Updated weights for policy 0, policy_version 621625 (0.0008) [2023-12-27 23:42:39,061][106226] Updated weights for policy 0, policy_version 621635 (0.0008) [2023-12-27 23:42:39,123][106226] Updated weights for policy 0, policy_version 621645 (0.0008) [2023-12-27 23:42:39,150][106225] Updated weights for policy 1, policy_version 623642 (0.0006) [2023-12-27 23:42:39,201][106225] Updated weights for policy 1, policy_version 623652 (0.0008) [2023-12-27 23:42:39,262][106225] Updated weights for policy 1, policy_version 623662 (0.0008) [2023-12-27 23:42:39,941][106226] Updated weights for policy 0, policy_version 621655 (0.0008) [2023-12-27 23:42:40,003][106226] Updated weights for policy 0, policy_version 621665 (0.0009) [2023-12-27 23:42:40,006][106225] Updated weights for policy 1, policy_version 623672 (0.0008) [2023-12-27 23:42:40,062][106225] Updated weights for policy 1, policy_version 623682 (0.0008) [2023-12-27 23:42:40,063][106226] Updated weights for policy 0, policy_version 621675 (0.0009) [2023-12-27 23:42:40,124][106225] Updated weights for policy 1, policy_version 623692 (0.0008) [2023-12-27 23:42:40,825][106226] Updated weights for policy 0, policy_version 621685 (0.0009) [2023-12-27 23:42:40,876][106225] Updated weights for policy 1, policy_version 623702 (0.0008) [2023-12-27 23:42:40,878][106226] Updated weights for policy 0, policy_version 621695 (0.0007) [2023-12-27 23:42:40,938][106226] Updated weights for policy 0, policy_version 621705 (0.0006) [2023-12-27 23:42:40,940][106225] Updated weights for policy 1, policy_version 623712 (0.0009) [2023-12-27 23:42:41,000][106225] Updated weights for policy 1, policy_version 623722 (0.0008) [2023-12-27 23:42:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 318898176. Throughput: 0: 9585.4, 1: 10024.6. Samples: 318865376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:41,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-6.266')] [2023-12-27 23:42:41,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000623728_159703040.pth... [2023-12-27 23:42:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000621712_159195136.pth... [2023-12-27 23:42:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000622576_159408128.pth [2023-12-27 23:42:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000620592_158908416.pth [2023-12-27 23:42:41,724][106225] Updated weights for policy 1, policy_version 623732 (0.0009) [2023-12-27 23:42:41,740][106226] Updated weights for policy 0, policy_version 621715 (0.0006) [2023-12-27 23:42:41,792][106225] Updated weights for policy 1, policy_version 623742 (0.0006) [2023-12-27 23:42:41,803][106226] Updated weights for policy 0, policy_version 621725 (0.0011) [2023-12-27 23:42:41,852][106225] Updated weights for policy 1, policy_version 623752 (0.0006) [2023-12-27 23:42:41,861][106226] Updated weights for policy 0, policy_version 621735 (0.0011) [2023-12-27 23:42:42,619][106225] Updated weights for policy 1, policy_version 623762 (0.0008) [2023-12-27 23:42:42,626][106226] Updated weights for policy 0, policy_version 621745 (0.0011) [2023-12-27 23:42:42,676][106225] Updated weights for policy 1, policy_version 623772 (0.0006) [2023-12-27 23:42:42,689][106226] Updated weights for policy 0, policy_version 621755 (0.0011) [2023-12-27 23:42:42,742][106226] Updated weights for policy 0, policy_version 621765 (0.0009) [2023-12-27 23:42:42,744][106225] Updated weights for policy 1, policy_version 623782 (0.0008) [2023-12-27 23:42:42,799][106226] Updated weights for policy 0, policy_version 621775 (0.0011) [2023-12-27 23:42:42,805][106225] Updated weights for policy 1, policy_version 623792 (0.0006) [2023-12-27 23:42:43,463][106225] Updated weights for policy 1, policy_version 623802 (0.0007) [2023-12-27 23:42:43,497][106226] Updated weights for policy 0, policy_version 621785 (0.0011) [2023-12-27 23:42:43,524][106225] Updated weights for policy 1, policy_version 623812 (0.0007) [2023-12-27 23:42:43,560][106226] Updated weights for policy 0, policy_version 621795 (0.0011) [2023-12-27 23:42:43,576][106225] Updated weights for policy 1, policy_version 623822 (0.0006) [2023-12-27 23:42:43,621][106226] Updated weights for policy 0, policy_version 621805 (0.0008) [2023-12-27 23:42:44,204][106226] Updated weights for policy 0, policy_version 621815 (0.0009) [2023-12-27 23:42:44,227][106225] Updated weights for policy 1, policy_version 623832 (0.0005) [2023-12-27 23:42:44,256][106226] Updated weights for policy 0, policy_version 621825 (0.0005) [2023-12-27 23:42:44,283][106225] Updated weights for policy 1, policy_version 623842 (0.0006) [2023-12-27 23:42:44,312][106226] Updated weights for policy 0, policy_version 621835 (0.0006) [2023-12-27 23:42:44,334][106225] Updated weights for policy 1, policy_version 623852 (0.0008) [2023-12-27 23:42:44,976][106226] Updated weights for policy 0, policy_version 621845 (0.0008) [2023-12-27 23:42:45,038][106226] Updated weights for policy 0, policy_version 621855 (0.0009) [2023-12-27 23:42:45,078][106225] Updated weights for policy 1, policy_version 623862 (0.0008) [2023-12-27 23:42:45,104][106226] Updated weights for policy 0, policy_version 621865 (0.0007) [2023-12-27 23:42:45,141][106225] Updated weights for policy 1, policy_version 623872 (0.0008) [2023-12-27 23:42:45,199][106225] Updated weights for policy 1, policy_version 623882 (0.0008) [2023-12-27 23:42:45,789][106226] Updated weights for policy 0, policy_version 621875 (0.0007) [2023-12-27 23:42:45,863][106226] Updated weights for policy 0, policy_version 621885 (0.0007) [2023-12-27 23:42:45,926][106226] Updated weights for policy 0, policy_version 621895 (0.0008) [2023-12-27 23:42:45,978][106225] Updated weights for policy 1, policy_version 623892 (0.0008) [2023-12-27 23:42:46,031][106225] Updated weights for policy 1, policy_version 623902 (0.0005) [2023-12-27 23:42:46,090][106225] Updated weights for policy 1, policy_version 623912 (0.0007) [2023-12-27 23:42:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 318996480. Throughput: 0: 9540.0, 1: 10064.3. Samples: 318981580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:46,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-6.218')] [2023-12-27 23:42:46,674][106226] Updated weights for policy 0, policy_version 621905 (0.0010) [2023-12-27 23:42:46,718][106226] Updated weights for policy 0, policy_version 621915 (0.0008) [2023-12-27 23:42:46,733][106225] Updated weights for policy 1, policy_version 623922 (0.0005) [2023-12-27 23:42:46,767][106226] Updated weights for policy 0, policy_version 621925 (0.0007) [2023-12-27 23:42:46,784][106225] Updated weights for policy 1, policy_version 623932 (0.0006) [2023-12-27 23:42:46,817][106226] Updated weights for policy 0, policy_version 621935 (0.0007) [2023-12-27 23:42:46,836][106225] Updated weights for policy 1, policy_version 623942 (0.0006) [2023-12-27 23:42:46,883][106225] Updated weights for policy 1, policy_version 623952 (0.0008) [2023-12-27 23:42:47,521][106225] Updated weights for policy 1, policy_version 623962 (0.0009) [2023-12-27 23:42:47,577][106225] Updated weights for policy 1, policy_version 623972 (0.0009) [2023-12-27 23:42:47,602][106226] Updated weights for policy 0, policy_version 621945 (0.0005) [2023-12-27 23:42:47,633][106225] Updated weights for policy 1, policy_version 623982 (0.0008) [2023-12-27 23:42:47,655][106226] Updated weights for policy 0, policy_version 621955 (0.0005) [2023-12-27 23:42:47,709][106226] Updated weights for policy 0, policy_version 621965 (0.0006) [2023-12-27 23:42:48,302][106226] Updated weights for policy 0, policy_version 621975 (0.0006) [2023-12-27 23:42:48,361][106225] Updated weights for policy 1, policy_version 623992 (0.0009) [2023-12-27 23:42:48,369][106226] Updated weights for policy 0, policy_version 621985 (0.0008) [2023-12-27 23:42:48,421][106225] Updated weights for policy 1, policy_version 624002 (0.0010) [2023-12-27 23:42:48,424][106226] Updated weights for policy 0, policy_version 621995 (0.0007) [2023-12-27 23:42:48,473][106225] Updated weights for policy 1, policy_version 624012 (0.0010) [2023-12-27 23:42:49,170][106225] Updated weights for policy 1, policy_version 624022 (0.0010) [2023-12-27 23:42:49,172][106226] Updated weights for policy 0, policy_version 622005 (0.0006) [2023-12-27 23:42:49,238][106226] Updated weights for policy 0, policy_version 622015 (0.0007) [2023-12-27 23:42:49,242][106225] Updated weights for policy 1, policy_version 624032 (0.0011) [2023-12-27 23:42:49,299][106225] Updated weights for policy 1, policy_version 624042 (0.0008) [2023-12-27 23:42:49,301][106226] Updated weights for policy 0, policy_version 622025 (0.0006) [2023-12-27 23:42:50,035][106226] Updated weights for policy 0, policy_version 622035 (0.0007) [2023-12-27 23:42:50,077][106225] Updated weights for policy 1, policy_version 624052 (0.0010) [2023-12-27 23:42:50,102][106226] Updated weights for policy 0, policy_version 622045 (0.0007) [2023-12-27 23:42:50,141][106225] Updated weights for policy 1, policy_version 624062 (0.0011) [2023-12-27 23:42:50,162][106226] Updated weights for policy 0, policy_version 622055 (0.0009) [2023-12-27 23:42:50,202][106225] Updated weights for policy 1, policy_version 624072 (0.0010) [2023-12-27 23:42:50,837][106226] Updated weights for policy 0, policy_version 622065 (0.0008) [2023-12-27 23:42:50,906][106226] Updated weights for policy 0, policy_version 622075 (0.0009) [2023-12-27 23:42:50,926][106225] Updated weights for policy 1, policy_version 624082 (0.0011) [2023-12-27 23:42:50,974][106226] Updated weights for policy 0, policy_version 622085 (0.0008) [2023-12-27 23:42:50,985][106225] Updated weights for policy 1, policy_version 624092 (0.0011) [2023-12-27 23:42:51,037][106226] Updated weights for policy 0, policy_version 622095 (0.0011) [2023-12-27 23:42:51,052][106225] Updated weights for policy 1, policy_version 624102 (0.0010) [2023-12-27 23:42:51,109][106225] Updated weights for policy 1, policy_version 624112 (0.0010) [2023-12-27 23:42:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 319094784. Throughput: 0: 9572.0, 1: 9947.9. Samples: 319098932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:51,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-6.090')] [2023-12-27 23:42:51,761][106226] Updated weights for policy 0, policy_version 622105 (0.0010) [2023-12-27 23:42:51,825][106226] Updated weights for policy 0, policy_version 622115 (0.0010) [2023-12-27 23:42:51,880][106225] Updated weights for policy 1, policy_version 624122 (0.0010) [2023-12-27 23:42:51,892][106226] Updated weights for policy 0, policy_version 622125 (0.0011) [2023-12-27 23:42:51,934][106225] Updated weights for policy 1, policy_version 624132 (0.0010) [2023-12-27 23:42:52,004][106225] Updated weights for policy 1, policy_version 624142 (0.0010) [2023-12-27 23:42:52,533][106226] Updated weights for policy 0, policy_version 622135 (0.0007) [2023-12-27 23:42:52,597][106226] Updated weights for policy 0, policy_version 622145 (0.0005) [2023-12-27 23:42:52,663][106226] Updated weights for policy 0, policy_version 622155 (0.0006) [2023-12-27 23:42:52,754][106225] Updated weights for policy 1, policy_version 624152 (0.0008) [2023-12-27 23:42:52,816][106225] Updated weights for policy 1, policy_version 624162 (0.0007) [2023-12-27 23:42:52,877][106225] Updated weights for policy 1, policy_version 624172 (0.0007) [2023-12-27 23:42:53,330][106226] Updated weights for policy 0, policy_version 622165 (0.0009) [2023-12-27 23:42:53,380][106226] Updated weights for policy 0, policy_version 622175 (0.0008) [2023-12-27 23:42:53,433][106226] Updated weights for policy 0, policy_version 622185 (0.0006) [2023-12-27 23:42:53,596][106225] Updated weights for policy 1, policy_version 624182 (0.0009) [2023-12-27 23:42:53,644][106225] Updated weights for policy 1, policy_version 624192 (0.0008) [2023-12-27 23:42:53,692][106225] Updated weights for policy 1, policy_version 624202 (0.0007) [2023-12-27 23:42:54,012][106226] Updated weights for policy 0, policy_version 622195 (0.0007) [2023-12-27 23:42:54,067][106226] Updated weights for policy 0, policy_version 622205 (0.0006) [2023-12-27 23:42:54,129][106226] Updated weights for policy 0, policy_version 622215 (0.0006) [2023-12-27 23:42:54,484][106225] Updated weights for policy 1, policy_version 624212 (0.0009) [2023-12-27 23:42:54,544][106225] Updated weights for policy 1, policy_version 624222 (0.0010) [2023-12-27 23:42:54,601][106225] Updated weights for policy 1, policy_version 624232 (0.0007) [2023-12-27 23:42:54,838][106226] Updated weights for policy 0, policy_version 622225 (0.0007) [2023-12-27 23:42:54,890][106226] Updated weights for policy 0, policy_version 622235 (0.0010) [2023-12-27 23:42:54,943][106226] Updated weights for policy 0, policy_version 622245 (0.0010) [2023-12-27 23:42:55,003][106226] Updated weights for policy 0, policy_version 622255 (0.0009) [2023-12-27 23:42:55,223][106225] Updated weights for policy 1, policy_version 624242 (0.0006) [2023-12-27 23:42:55,287][106225] Updated weights for policy 1, policy_version 624252 (0.0010) [2023-12-27 23:42:55,351][106225] Updated weights for policy 1, policy_version 624262 (0.0008) [2023-12-27 23:42:55,414][106225] Updated weights for policy 1, policy_version 624272 (0.0006) [2023-12-27 23:42:55,590][106226] Updated weights for policy 0, policy_version 622265 (0.0010) [2023-12-27 23:42:55,640][106226] Updated weights for policy 0, policy_version 622275 (0.0010) [2023-12-27 23:42:55,695][106226] Updated weights for policy 0, policy_version 622285 (0.0010) [2023-12-27 23:42:56,080][106225] Updated weights for policy 1, policy_version 624282 (0.0010) [2023-12-27 23:42:56,137][106225] Updated weights for policy 1, policy_version 624292 (0.0010) [2023-12-27 23:42:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 319184896. Throughput: 0: 9651.0, 1: 9846.2. Samples: 319157824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:42:56,176][105115] Avg episode reward: [(0, '-4.648'), (1, '-6.413')] [2023-12-27 23:42:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000622288_159342592.pth... [2023-12-27 23:42:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000621136_159047680.pth [2023-12-27 23:42:56,198][106225] Updated weights for policy 1, policy_version 624302 (0.0010) [2023-12-27 23:42:56,206][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000624304_159850496.pth... [2023-12-27 23:42:56,209][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000623152_159555584.pth [2023-12-27 23:42:56,390][106226] Updated weights for policy 0, policy_version 622295 (0.0007) [2023-12-27 23:42:56,454][106226] Updated weights for policy 0, policy_version 622305 (0.0005) [2023-12-27 23:42:56,519][106226] Updated weights for policy 0, policy_version 622315 (0.0006) [2023-12-27 23:42:56,890][106225] Updated weights for policy 1, policy_version 624312 (0.0010) [2023-12-27 23:42:56,954][106225] Updated weights for policy 1, policy_version 624322 (0.0009) [2023-12-27 23:42:57,009][106225] Updated weights for policy 1, policy_version 624332 (0.0010) [2023-12-27 23:42:57,080][106226] Updated weights for policy 0, policy_version 622325 (0.0008) [2023-12-27 23:42:57,129][106226] Updated weights for policy 0, policy_version 622335 (0.0010) [2023-12-27 23:42:57,175][106226] Updated weights for policy 0, policy_version 622345 (0.0010) [2023-12-27 23:42:57,657][106225] Updated weights for policy 1, policy_version 624342 (0.0010) [2023-12-27 23:42:57,703][106225] Updated weights for policy 1, policy_version 624352 (0.0010) [2023-12-27 23:42:57,751][106225] Updated weights for policy 1, policy_version 624362 (0.0010) [2023-12-27 23:42:57,897][106226] Updated weights for policy 0, policy_version 622355 (0.0010) [2023-12-27 23:42:57,946][106226] Updated weights for policy 0, policy_version 622365 (0.0010) [2023-12-27 23:42:57,992][106226] Updated weights for policy 0, policy_version 622375 (0.0010) [2023-12-27 23:42:58,492][106225] Updated weights for policy 1, policy_version 624372 (0.0009) [2023-12-27 23:42:58,561][106225] Updated weights for policy 1, policy_version 624382 (0.0008) [2023-12-27 23:42:58,631][106225] Updated weights for policy 1, policy_version 624392 (0.0008) [2023-12-27 23:42:58,812][106226] Updated weights for policy 0, policy_version 622385 (0.0010) [2023-12-27 23:42:58,887][106226] Updated weights for policy 0, policy_version 622395 (0.0009) [2023-12-27 23:42:58,958][106226] Updated weights for policy 0, policy_version 622405 (0.0006) [2023-12-27 23:42:59,029][106226] Updated weights for policy 0, policy_version 622415 (0.0007) [2023-12-27 23:42:59,422][106225] Updated weights for policy 1, policy_version 624402 (0.0008) [2023-12-27 23:42:59,473][106225] Updated weights for policy 1, policy_version 624412 (0.0006) [2023-12-27 23:42:59,533][106225] Updated weights for policy 1, policy_version 624422 (0.0005) [2023-12-27 23:42:59,594][106225] Updated weights for policy 1, policy_version 624432 (0.0007) [2023-12-27 23:42:59,788][106226] Updated weights for policy 0, policy_version 622425 (0.0006) [2023-12-27 23:42:59,856][106226] Updated weights for policy 0, policy_version 622435 (0.0006) [2023-12-27 23:42:59,921][106226] Updated weights for policy 0, policy_version 622445 (0.0008) [2023-12-27 23:43:00,291][106225] Updated weights for policy 1, policy_version 624442 (0.0010) [2023-12-27 23:43:00,344][106225] Updated weights for policy 1, policy_version 624452 (0.0008) [2023-12-27 23:43:00,406][106225] Updated weights for policy 1, policy_version 624462 (0.0010) [2023-12-27 23:43:00,545][106226] Updated weights for policy 0, policy_version 622455 (0.0007) [2023-12-27 23:43:00,603][106226] Updated weights for policy 0, policy_version 622465 (0.0007) [2023-12-27 23:43:00,668][106226] Updated weights for policy 0, policy_version 622475 (0.0008) [2023-12-27 23:43:01,071][106225] Updated weights for policy 1, policy_version 624472 (0.0008) [2023-12-27 23:43:01,128][106225] Updated weights for policy 1, policy_version 624482 (0.0005) [2023-12-27 23:43:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 319283200. Throughput: 0: 9733.3, 1: 9854.2. Samples: 319276296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:01,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-6.342')] [2023-12-27 23:43:01,195][106225] Updated weights for policy 1, policy_version 624492 (0.0008) [2023-12-27 23:43:01,297][106226] Updated weights for policy 0, policy_version 622485 (0.0008) [2023-12-27 23:43:01,353][106226] Updated weights for policy 0, policy_version 622495 (0.0008) [2023-12-27 23:43:01,431][106226] Updated weights for policy 0, policy_version 622505 (0.0008) [2023-12-27 23:43:01,936][106225] Updated weights for policy 1, policy_version 624502 (0.0010) [2023-12-27 23:43:01,998][106225] Updated weights for policy 1, policy_version 624512 (0.0010) [2023-12-27 23:43:02,054][106225] Updated weights for policy 1, policy_version 624522 (0.0010) [2023-12-27 23:43:02,102][106226] Updated weights for policy 0, policy_version 622515 (0.0006) [2023-12-27 23:43:02,151][106226] Updated weights for policy 0, policy_version 622525 (0.0007) [2023-12-27 23:43:02,199][106226] Updated weights for policy 0, policy_version 622535 (0.0008) [2023-12-27 23:43:02,774][106225] Updated weights for policy 1, policy_version 624532 (0.0010) [2023-12-27 23:43:02,830][106225] Updated weights for policy 1, policy_version 624542 (0.0008) [2023-12-27 23:43:02,888][106225] Updated weights for policy 1, policy_version 624552 (0.0007) [2023-12-27 23:43:02,971][106226] Updated weights for policy 0, policy_version 622545 (0.0008) [2023-12-27 23:43:03,028][106226] Updated weights for policy 0, policy_version 622555 (0.0009) [2023-12-27 23:43:03,096][106226] Updated weights for policy 0, policy_version 622565 (0.0006) [2023-12-27 23:43:03,149][106226] Updated weights for policy 0, policy_version 622575 (0.0009) [2023-12-27 23:43:03,556][106225] Updated weights for policy 1, policy_version 624562 (0.0006) [2023-12-27 23:43:03,608][106225] Updated weights for policy 1, policy_version 624572 (0.0008) [2023-12-27 23:43:03,663][106225] Updated weights for policy 1, policy_version 624582 (0.0006) [2023-12-27 23:43:03,725][106225] Updated weights for policy 1, policy_version 624592 (0.0007) [2023-12-27 23:43:03,757][106226] Updated weights for policy 0, policy_version 622585 (0.0006) [2023-12-27 23:43:03,815][106226] Updated weights for policy 0, policy_version 622595 (0.0008) [2023-12-27 23:43:03,879][106226] Updated weights for policy 0, policy_version 622605 (0.0008) [2023-12-27 23:43:04,449][106225] Updated weights for policy 1, policy_version 624602 (0.0009) [2023-12-27 23:43:04,498][106225] Updated weights for policy 1, policy_version 624612 (0.0009) [2023-12-27 23:43:04,551][106225] Updated weights for policy 1, policy_version 624622 (0.0009) [2023-12-27 23:43:04,592][106226] Updated weights for policy 0, policy_version 622615 (0.0008) [2023-12-27 23:43:04,660][106226] Updated weights for policy 0, policy_version 622625 (0.0009) [2023-12-27 23:43:04,728][106226] Updated weights for policy 0, policy_version 622635 (0.0010) [2023-12-27 23:43:05,219][106225] Updated weights for policy 1, policy_version 624632 (0.0008) [2023-12-27 23:43:05,273][106225] Updated weights for policy 1, policy_version 624642 (0.0008) [2023-12-27 23:43:05,332][106225] Updated weights for policy 1, policy_version 624652 (0.0008) [2023-12-27 23:43:05,404][106226] Updated weights for policy 0, policy_version 622645 (0.0010) [2023-12-27 23:43:05,447][106226] Updated weights for policy 0, policy_version 622655 (0.0010) [2023-12-27 23:43:05,511][106226] Updated weights for policy 0, policy_version 622665 (0.0008) [2023-12-27 23:43:06,089][106226] Updated weights for policy 0, policy_version 622675 (0.0005) [2023-12-27 23:43:06,114][106225] Updated weights for policy 1, policy_version 624662 (0.0008) [2023-12-27 23:43:06,153][106226] Updated weights for policy 0, policy_version 622685 (0.0008) [2023-12-27 23:43:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 319381504. Throughput: 0: 9865.6, 1: 9799.0. Samples: 319397824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:06,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-5.666')] [2023-12-27 23:43:06,176][106225] Updated weights for policy 1, policy_version 624672 (0.0007) [2023-12-27 23:43:06,220][106226] Updated weights for policy 0, policy_version 622695 (0.0008) [2023-12-27 23:43:06,237][106225] Updated weights for policy 1, policy_version 624682 (0.0008) [2023-12-27 23:43:06,869][106226] Updated weights for policy 0, policy_version 622705 (0.0008) [2023-12-27 23:43:06,936][106226] Updated weights for policy 0, policy_version 622715 (0.0011) [2023-12-27 23:43:06,998][106226] Updated weights for policy 0, policy_version 622725 (0.0011) [2023-12-27 23:43:06,999][106225] Updated weights for policy 1, policy_version 624692 (0.0006) [2023-12-27 23:43:07,046][106225] Updated weights for policy 1, policy_version 624702 (0.0006) [2023-12-27 23:43:07,062][106226] Updated weights for policy 0, policy_version 622735 (0.0011) [2023-12-27 23:43:07,095][106225] Updated weights for policy 1, policy_version 624712 (0.0009) [2023-12-27 23:43:07,718][106226] Updated weights for policy 0, policy_version 622745 (0.0009) [2023-12-27 23:43:07,745][106225] Updated weights for policy 1, policy_version 624722 (0.0007) [2023-12-27 23:43:07,766][106226] Updated weights for policy 0, policy_version 622755 (0.0010) [2023-12-27 23:43:07,813][106226] Updated weights for policy 0, policy_version 622765 (0.0010) [2023-12-27 23:43:07,814][106225] Updated weights for policy 1, policy_version 624732 (0.0005) [2023-12-27 23:43:07,873][106225] Updated weights for policy 1, policy_version 624742 (0.0010) [2023-12-27 23:43:07,919][106225] Updated weights for policy 1, policy_version 624752 (0.0005) [2023-12-27 23:43:08,370][106226] Updated weights for policy 0, policy_version 622775 (0.0007) [2023-12-27 23:43:08,432][106226] Updated weights for policy 0, policy_version 622785 (0.0005) [2023-12-27 23:43:08,489][106226] Updated weights for policy 0, policy_version 622795 (0.0006) [2023-12-27 23:43:08,557][106225] Updated weights for policy 1, policy_version 624762 (0.0010) [2023-12-27 23:43:08,619][106225] Updated weights for policy 1, policy_version 624772 (0.0011) [2023-12-27 23:43:08,674][106225] Updated weights for policy 1, policy_version 624782 (0.0010) [2023-12-27 23:43:09,104][106226] Updated weights for policy 0, policy_version 622805 (0.0005) [2023-12-27 23:43:09,160][106226] Updated weights for policy 0, policy_version 622815 (0.0005) [2023-12-27 23:43:09,220][106226] Updated weights for policy 0, policy_version 622825 (0.0007) [2023-12-27 23:43:09,386][106225] Updated weights for policy 1, policy_version 624792 (0.0010) [2023-12-27 23:43:09,448][106225] Updated weights for policy 1, policy_version 624802 (0.0009) [2023-12-27 23:43:09,510][106225] Updated weights for policy 1, policy_version 624812 (0.0009) [2023-12-27 23:43:10,018][106226] Updated weights for policy 0, policy_version 622835 (0.0009) [2023-12-27 23:43:10,076][106226] Updated weights for policy 0, policy_version 622845 (0.0006) [2023-12-27 23:43:10,131][106226] Updated weights for policy 0, policy_version 622855 (0.0007) [2023-12-27 23:43:10,347][106225] Updated weights for policy 1, policy_version 624822 (0.0009) [2023-12-27 23:43:10,406][106225] Updated weights for policy 1, policy_version 624832 (0.0007) [2023-12-27 23:43:10,460][106225] Updated weights for policy 1, policy_version 624842 (0.0007) [2023-12-27 23:43:10,840][106226] Updated weights for policy 0, policy_version 622865 (0.0008) [2023-12-27 23:43:10,898][106226] Updated weights for policy 0, policy_version 622875 (0.0011) [2023-12-27 23:43:10,959][106226] Updated weights for policy 0, policy_version 622885 (0.0011) [2023-12-27 23:43:11,016][106226] Updated weights for policy 0, policy_version 622895 (0.0010) [2023-12-27 23:43:11,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 319488000. Throughput: 0: 9960.9, 1: 9842.3. Samples: 319459876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:11,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-6.268')] [2023-12-27 23:43:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000624848_159989760.pth... [2023-12-27 23:43:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000622896_159498240.pth... [2023-12-27 23:43:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000621712_159195136.pth [2023-12-27 23:43:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000623728_159703040.pth [2023-12-27 23:43:11,230][106225] Updated weights for policy 1, policy_version 624852 (0.0008) [2023-12-27 23:43:11,296][106225] Updated weights for policy 1, policy_version 624862 (0.0008) [2023-12-27 23:43:11,378][106225] Updated weights for policy 1, policy_version 624872 (0.0008) [2023-12-27 23:43:11,851][106226] Updated weights for policy 0, policy_version 622905 (0.0009) [2023-12-27 23:43:11,915][106226] Updated weights for policy 0, policy_version 622915 (0.0009) [2023-12-27 23:43:11,972][106226] Updated weights for policy 0, policy_version 622925 (0.0008) [2023-12-27 23:43:12,121][106225] Updated weights for policy 1, policy_version 624882 (0.0007) [2023-12-27 23:43:12,180][106225] Updated weights for policy 1, policy_version 624892 (0.0008) [2023-12-27 23:43:12,241][106225] Updated weights for policy 1, policy_version 624902 (0.0008) [2023-12-27 23:43:12,308][106225] Updated weights for policy 1, policy_version 624912 (0.0009) [2023-12-27 23:43:12,671][106226] Updated weights for policy 0, policy_version 622935 (0.0008) [2023-12-27 23:43:12,725][106226] Updated weights for policy 0, policy_version 622945 (0.0008) [2023-12-27 23:43:12,790][106226] Updated weights for policy 0, policy_version 622955 (0.0009) [2023-12-27 23:43:13,032][106225] Updated weights for policy 1, policy_version 624922 (0.0009) [2023-12-27 23:43:13,086][106225] Updated weights for policy 1, policy_version 624932 (0.0009) [2023-12-27 23:43:13,153][106225] Updated weights for policy 1, policy_version 624942 (0.0009) [2023-12-27 23:43:13,481][106226] Updated weights for policy 0, policy_version 622965 (0.0009) [2023-12-27 23:43:13,540][106226] Updated weights for policy 0, policy_version 622975 (0.0006) [2023-12-27 23:43:13,603][106226] Updated weights for policy 0, policy_version 622985 (0.0005) [2023-12-27 23:43:13,877][106225] Updated weights for policy 1, policy_version 624952 (0.0008) [2023-12-27 23:43:13,939][106225] Updated weights for policy 1, policy_version 624962 (0.0010) [2023-12-27 23:43:13,998][106225] Updated weights for policy 1, policy_version 624972 (0.0010) [2023-12-27 23:43:14,260][106226] Updated weights for policy 0, policy_version 622995 (0.0006) [2023-12-27 23:43:14,318][106226] Updated weights for policy 0, policy_version 623005 (0.0008) [2023-12-27 23:43:14,370][106226] Updated weights for policy 0, policy_version 623015 (0.0008) [2023-12-27 23:43:14,725][106225] Updated weights for policy 1, policy_version 624982 (0.0010) [2023-12-27 23:43:14,792][106225] Updated weights for policy 1, policy_version 624992 (0.0009) [2023-12-27 23:43:14,851][106225] Updated weights for policy 1, policy_version 625002 (0.0009) [2023-12-27 23:43:15,091][106226] Updated weights for policy 0, policy_version 623025 (0.0008) [2023-12-27 23:43:15,153][106226] Updated weights for policy 0, policy_version 623035 (0.0006) [2023-12-27 23:43:15,224][106226] Updated weights for policy 0, policy_version 623045 (0.0006) [2023-12-27 23:43:15,295][106226] Updated weights for policy 0, policy_version 623055 (0.0006) [2023-12-27 23:43:15,648][106225] Updated weights for policy 1, policy_version 625012 (0.0008) [2023-12-27 23:43:15,709][106225] Updated weights for policy 1, policy_version 625022 (0.0008) [2023-12-27 23:43:15,778][106225] Updated weights for policy 1, policy_version 625032 (0.0008) [2023-12-27 23:43:15,935][106226] Updated weights for policy 0, policy_version 623065 (0.0006) [2023-12-27 23:43:16,003][106226] Updated weights for policy 0, policy_version 623075 (0.0010) [2023-12-27 23:43:16,070][106226] Updated weights for policy 0, policy_version 623085 (0.0011) [2023-12-27 23:43:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 319586304. Throughput: 0: 9916.7, 1: 9725.4. Samples: 319572924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:16,175][105115] Avg episode reward: [(0, '-4.960'), (1, '-6.043')] [2023-12-27 23:43:16,513][106225] Updated weights for policy 1, policy_version 625042 (0.0007) [2023-12-27 23:43:16,569][106225] Updated weights for policy 1, policy_version 625052 (0.0009) [2023-12-27 23:43:16,602][106226] Updated weights for policy 0, policy_version 623095 (0.0007) [2023-12-27 23:43:16,615][106225] Updated weights for policy 1, policy_version 625062 (0.0008) [2023-12-27 23:43:16,653][106226] Updated weights for policy 0, policy_version 623105 (0.0006) [2023-12-27 23:43:16,660][106225] Updated weights for policy 1, policy_version 625072 (0.0007) [2023-12-27 23:43:16,701][106226] Updated weights for policy 0, policy_version 623115 (0.0009) [2023-12-27 23:43:17,300][106226] Updated weights for policy 0, policy_version 623125 (0.0006) [2023-12-27 23:43:17,354][106226] Updated weights for policy 0, policy_version 623135 (0.0006) [2023-12-27 23:43:17,411][106226] Updated weights for policy 0, policy_version 623145 (0.0008) [2023-12-27 23:43:17,465][106225] Updated weights for policy 1, policy_version 625082 (0.0006) [2023-12-27 23:43:17,521][106225] Updated weights for policy 1, policy_version 625092 (0.0008) [2023-12-27 23:43:17,580][106225] Updated weights for policy 1, policy_version 625102 (0.0008) [2023-12-27 23:43:18,066][106226] Updated weights for policy 0, policy_version 623155 (0.0007) [2023-12-27 23:43:18,116][106226] Updated weights for policy 0, policy_version 623165 (0.0006) [2023-12-27 23:43:18,180][106226] Updated weights for policy 0, policy_version 623175 (0.0008) [2023-12-27 23:43:18,303][106225] Updated weights for policy 1, policy_version 625112 (0.0006) [2023-12-27 23:43:18,373][106225] Updated weights for policy 1, policy_version 625122 (0.0008) [2023-12-27 23:43:18,443][106225] Updated weights for policy 1, policy_version 625132 (0.0006) [2023-12-27 23:43:18,829][106226] Updated weights for policy 0, policy_version 623185 (0.0009) [2023-12-27 23:43:18,889][106226] Updated weights for policy 0, policy_version 623195 (0.0010) [2023-12-27 23:43:18,954][106226] Updated weights for policy 0, policy_version 623205 (0.0008) [2023-12-27 23:43:19,004][106226] Updated weights for policy 0, policy_version 623215 (0.0010) [2023-12-27 23:43:19,142][106225] Updated weights for policy 1, policy_version 625142 (0.0007) [2023-12-27 23:43:19,202][106225] Updated weights for policy 1, policy_version 625152 (0.0008) [2023-12-27 23:43:19,273][106225] Updated weights for policy 1, policy_version 625162 (0.0009) [2023-12-27 23:43:19,756][106226] Updated weights for policy 0, policy_version 623225 (0.0006) [2023-12-27 23:43:19,832][106226] Updated weights for policy 0, policy_version 623235 (0.0007) [2023-12-27 23:43:19,889][106226] Updated weights for policy 0, policy_version 623245 (0.0008) [2023-12-27 23:43:20,032][106225] Updated weights for policy 1, policy_version 625172 (0.0008) [2023-12-27 23:43:20,091][106225] Updated weights for policy 1, policy_version 625182 (0.0008) [2023-12-27 23:43:20,151][106225] Updated weights for policy 1, policy_version 625192 (0.0008) [2023-12-27 23:43:20,499][106226] Updated weights for policy 0, policy_version 623255 (0.0010) [2023-12-27 23:43:20,552][106226] Updated weights for policy 0, policy_version 623265 (0.0009) [2023-12-27 23:43:20,622][106226] Updated weights for policy 0, policy_version 623275 (0.0008) [2023-12-27 23:43:20,964][106225] Updated weights for policy 1, policy_version 625202 (0.0008) [2023-12-27 23:43:21,027][106225] Updated weights for policy 1, policy_version 625212 (0.0009) [2023-12-27 23:43:21,095][106225] Updated weights for policy 1, policy_version 625222 (0.0008) [2023-12-27 23:43:21,162][106225] Updated weights for policy 1, policy_version 625232 (0.0010) [2023-12-27 23:43:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 319684608. Throughput: 0: 10009.4, 1: 9603.3. Samples: 319691748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:21,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-6.050')] [2023-12-27 23:43:21,407][106226] Updated weights for policy 0, policy_version 623285 (0.0010) [2023-12-27 23:43:21,466][106226] Updated weights for policy 0, policy_version 623295 (0.0008) [2023-12-27 23:43:21,539][106226] Updated weights for policy 0, policy_version 623305 (0.0008) [2023-12-27 23:43:21,929][106225] Updated weights for policy 1, policy_version 625242 (0.0008) [2023-12-27 23:43:21,983][106225] Updated weights for policy 1, policy_version 625252 (0.0009) [2023-12-27 23:43:22,042][106225] Updated weights for policy 1, policy_version 625262 (0.0009) [2023-12-27 23:43:22,280][106226] Updated weights for policy 0, policy_version 623315 (0.0007) [2023-12-27 23:43:22,332][106226] Updated weights for policy 0, policy_version 623325 (0.0008) [2023-12-27 23:43:22,400][106226] Updated weights for policy 0, policy_version 623335 (0.0009) [2023-12-27 23:43:22,798][106225] Updated weights for policy 1, policy_version 625272 (0.0009) [2023-12-27 23:43:22,858][106225] Updated weights for policy 1, policy_version 625282 (0.0009) [2023-12-27 23:43:22,915][106225] Updated weights for policy 1, policy_version 625292 (0.0009) [2023-12-27 23:43:23,177][106226] Updated weights for policy 0, policy_version 623345 (0.0009) [2023-12-27 23:43:23,236][106226] Updated weights for policy 0, policy_version 623355 (0.0010) [2023-12-27 23:43:23,300][106226] Updated weights for policy 0, policy_version 623365 (0.0009) [2023-12-27 23:43:23,363][106226] Updated weights for policy 0, policy_version 623375 (0.0008) [2023-12-27 23:43:23,557][106225] Updated weights for policy 1, policy_version 625302 (0.0009) [2023-12-27 23:43:23,606][106225] Updated weights for policy 1, policy_version 625312 (0.0008) [2023-12-27 23:43:23,668][106225] Updated weights for policy 1, policy_version 625322 (0.0010) [2023-12-27 23:43:24,019][106226] Updated weights for policy 0, policy_version 623385 (0.0008) [2023-12-27 23:43:24,066][106226] Updated weights for policy 0, policy_version 623395 (0.0007) [2023-12-27 23:43:24,127][106226] Updated weights for policy 0, policy_version 623405 (0.0005) [2023-12-27 23:43:24,389][106225] Updated weights for policy 1, policy_version 625332 (0.0009) [2023-12-27 23:43:24,449][106225] Updated weights for policy 1, policy_version 625342 (0.0008) [2023-12-27 23:43:24,500][106225] Updated weights for policy 1, policy_version 625352 (0.0008) [2023-12-27 23:43:24,718][106226] Updated weights for policy 0, policy_version 623415 (0.0005) [2023-12-27 23:43:24,764][106226] Updated weights for policy 0, policy_version 623425 (0.0005) [2023-12-27 23:43:24,826][106226] Updated weights for policy 0, policy_version 623435 (0.0005) [2023-12-27 23:43:25,295][106225] Updated weights for policy 1, policy_version 625362 (0.0008) [2023-12-27 23:43:25,346][106225] Updated weights for policy 1, policy_version 625372 (0.0005) [2023-12-27 23:43:25,363][106226] Updated weights for policy 0, policy_version 623445 (0.0005) [2023-12-27 23:43:25,401][106225] Updated weights for policy 1, policy_version 625382 (0.0006) [2023-12-27 23:43:25,415][106226] Updated weights for policy 0, policy_version 623455 (0.0005) [2023-12-27 23:43:25,459][106225] Updated weights for policy 1, policy_version 625392 (0.0008) [2023-12-27 23:43:25,462][106226] Updated weights for policy 0, policy_version 623465 (0.0005) [2023-12-27 23:43:26,100][106226] Updated weights for policy 0, policy_version 623475 (0.0006) [2023-12-27 23:43:26,151][106225] Updated weights for policy 1, policy_version 625402 (0.0007) [2023-12-27 23:43:26,159][106226] Updated weights for policy 0, policy_version 623485 (0.0006) [2023-12-27 23:43:26,175][105115] Fps is (10 sec: 18840.8, 60 sec: 19524.1, 300 sec: 19771.8). Total num frames: 319774720. Throughput: 0: 10016.5, 1: 9592.6. Samples: 319747796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:26,176][105115] Avg episode reward: [(0, '-4.792'), (1, '-5.988')] [2023-12-27 23:43:26,206][106225] Updated weights for policy 1, policy_version 625412 (0.0006) [2023-12-27 23:43:26,216][106226] Updated weights for policy 0, policy_version 623495 (0.0007) [2023-12-27 23:43:26,258][106225] Updated weights for policy 1, policy_version 625422 (0.0007) [2023-12-27 23:43:26,260][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000623504_159653888.pth... [2023-12-27 23:43:26,263][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000622288_159342592.pth [2023-12-27 23:43:26,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000625424_160137216.pth... [2023-12-27 23:43:26,271][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000624304_159850496.pth [2023-12-27 23:43:26,824][106225] Updated weights for policy 1, policy_version 625432 (0.0008) [2023-12-27 23:43:26,847][106226] Updated weights for policy 0, policy_version 623505 (0.0009) [2023-12-27 23:43:26,871][106225] Updated weights for policy 1, policy_version 625442 (0.0010) [2023-12-27 23:43:26,900][106226] Updated weights for policy 0, policy_version 623515 (0.0006) [2023-12-27 23:43:26,917][106225] Updated weights for policy 1, policy_version 625452 (0.0008) [2023-12-27 23:43:26,948][106226] Updated weights for policy 0, policy_version 623525 (0.0009) [2023-12-27 23:43:26,997][106226] Updated weights for policy 0, policy_version 623536 (0.0008) [2023-12-27 23:43:27,494][106225] Updated weights for policy 1, policy_version 625462 (0.0006) [2023-12-27 23:43:27,553][106225] Updated weights for policy 1, policy_version 625472 (0.0010) [2023-12-27 23:43:27,606][106225] Updated weights for policy 1, policy_version 625482 (0.0010) [2023-12-27 23:43:27,765][106226] Updated weights for policy 0, policy_version 623546 (0.0008) [2023-12-27 23:43:27,821][106226] Updated weights for policy 0, policy_version 623556 (0.0008) [2023-12-27 23:43:27,880][106226] Updated weights for policy 0, policy_version 623566 (0.0008) [2023-12-27 23:43:28,267][106225] Updated weights for policy 1, policy_version 625492 (0.0008) [2023-12-27 23:43:28,319][106225] Updated weights for policy 1, policy_version 625502 (0.0006) [2023-12-27 23:43:28,385][106225] Updated weights for policy 1, policy_version 625512 (0.0011) [2023-12-27 23:43:28,618][106226] Updated weights for policy 0, policy_version 623576 (0.0007) [2023-12-27 23:43:28,681][106226] Updated weights for policy 0, policy_version 623586 (0.0006) [2023-12-27 23:43:28,745][106226] Updated weights for policy 0, policy_version 623596 (0.0005) [2023-12-27 23:43:29,156][106225] Updated weights for policy 1, policy_version 625522 (0.0007) [2023-12-27 23:43:29,211][106225] Updated weights for policy 1, policy_version 625532 (0.0009) [2023-12-27 23:43:29,283][106225] Updated weights for policy 1, policy_version 625542 (0.0009) [2023-12-27 23:43:29,343][106225] Updated weights for policy 1, policy_version 625552 (0.0009) [2023-12-27 23:43:29,368][106226] Updated weights for policy 0, policy_version 623606 (0.0007) [2023-12-27 23:43:29,439][106226] Updated weights for policy 0, policy_version 623616 (0.0006) [2023-12-27 23:43:29,504][106226] Updated weights for policy 0, policy_version 623626 (0.0008) [2023-12-27 23:43:30,118][106225] Updated weights for policy 1, policy_version 625562 (0.0006) [2023-12-27 23:43:30,177][106225] Updated weights for policy 1, policy_version 625572 (0.0006) [2023-12-27 23:43:30,198][106226] Updated weights for policy 0, policy_version 623636 (0.0007) [2023-12-27 23:43:30,236][106225] Updated weights for policy 1, policy_version 625582 (0.0010) [2023-12-27 23:43:30,258][106226] Updated weights for policy 0, policy_version 623646 (0.0005) [2023-12-27 23:43:30,317][106226] Updated weights for policy 0, policy_version 623656 (0.0005) [2023-12-27 23:43:30,924][106226] Updated weights for policy 0, policy_version 623666 (0.0007) [2023-12-27 23:43:30,930][106225] Updated weights for policy 1, policy_version 625592 (0.0010) [2023-12-27 23:43:30,977][106226] Updated weights for policy 0, policy_version 623676 (0.0005) [2023-12-27 23:43:30,981][106225] Updated weights for policy 1, policy_version 625602 (0.0010) [2023-12-27 23:43:31,031][106226] Updated weights for policy 0, policy_version 623686 (0.0006) [2023-12-27 23:43:31,039][106225] Updated weights for policy 1, policy_version 625612 (0.0012) [2023-12-27 23:43:31,095][106226] Updated weights for policy 0, policy_version 623696 (0.0008) [2023-12-27 23:43:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 319889408. Throughput: 0: 10157.3, 1: 9645.6. Samples: 319872712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:31,175][105115] Avg episode reward: [(0, '-4.923'), (1, '-6.348')] [2023-12-27 23:43:31,785][106225] Updated weights for policy 1, policy_version 625622 (0.0009) [2023-12-27 23:43:31,829][106226] Updated weights for policy 0, policy_version 623706 (0.0010) [2023-12-27 23:43:31,847][106225] Updated weights for policy 1, policy_version 625632 (0.0006) [2023-12-27 23:43:31,886][106226] Updated weights for policy 0, policy_version 623716 (0.0010) [2023-12-27 23:43:31,904][106225] Updated weights for policy 1, policy_version 625642 (0.0007) [2023-12-27 23:43:31,947][106226] Updated weights for policy 0, policy_version 623726 (0.0010) [2023-12-27 23:43:32,610][106225] Updated weights for policy 1, policy_version 625652 (0.0008) [2023-12-27 23:43:32,660][106226] Updated weights for policy 0, policy_version 623736 (0.0011) [2023-12-27 23:43:32,668][106225] Updated weights for policy 1, policy_version 625662 (0.0010) [2023-12-27 23:43:32,722][106226] Updated weights for policy 0, policy_version 623746 (0.0011) [2023-12-27 23:43:32,730][106225] Updated weights for policy 1, policy_version 625672 (0.0010) [2023-12-27 23:43:32,778][106226] Updated weights for policy 0, policy_version 623756 (0.0008) [2023-12-27 23:43:33,350][106226] Updated weights for policy 0, policy_version 623766 (0.0006) [2023-12-27 23:43:33,396][106225] Updated weights for policy 1, policy_version 625682 (0.0009) [2023-12-27 23:43:33,413][106226] Updated weights for policy 0, policy_version 623776 (0.0007) [2023-12-27 23:43:33,443][106225] Updated weights for policy 1, policy_version 625692 (0.0007) [2023-12-27 23:43:33,481][106226] Updated weights for policy 0, policy_version 623786 (0.0006) [2023-12-27 23:43:33,491][106225] Updated weights for policy 1, policy_version 625702 (0.0006) [2023-12-27 23:43:33,541][106225] Updated weights for policy 1, policy_version 625712 (0.0006) [2023-12-27 23:43:34,104][106226] Updated weights for policy 0, policy_version 623796 (0.0005) [2023-12-27 23:43:34,122][106225] Updated weights for policy 1, policy_version 625722 (0.0006) [2023-12-27 23:43:34,177][106226] Updated weights for policy 0, policy_version 623806 (0.0007) [2023-12-27 23:43:34,185][106225] Updated weights for policy 1, policy_version 625732 (0.0008) [2023-12-27 23:43:34,233][106226] Updated weights for policy 0, policy_version 623816 (0.0007) [2023-12-27 23:43:34,247][106225] Updated weights for policy 1, policy_version 625742 (0.0008) [2023-12-27 23:43:34,853][106225] Updated weights for policy 1, policy_version 625752 (0.0007) [2023-12-27 23:43:34,862][106226] Updated weights for policy 0, policy_version 623826 (0.0009) [2023-12-27 23:43:34,915][106225] Updated weights for policy 1, policy_version 625762 (0.0007) [2023-12-27 23:43:34,926][106226] Updated weights for policy 0, policy_version 623836 (0.0011) [2023-12-27 23:43:34,976][106225] Updated weights for policy 1, policy_version 625772 (0.0007) [2023-12-27 23:43:34,978][106226] Updated weights for policy 0, policy_version 623846 (0.0011) [2023-12-27 23:43:35,041][106226] Updated weights for policy 0, policy_version 623856 (0.0011) [2023-12-27 23:43:35,581][106225] Updated weights for policy 1, policy_version 625782 (0.0006) [2023-12-27 23:43:35,651][106225] Updated weights for policy 1, policy_version 625792 (0.0006) [2023-12-27 23:43:35,715][106225] Updated weights for policy 1, policy_version 625802 (0.0005) [2023-12-27 23:43:35,731][106226] Updated weights for policy 0, policy_version 623866 (0.0007) [2023-12-27 23:43:35,808][106226] Updated weights for policy 0, policy_version 623876 (0.0006) [2023-12-27 23:43:35,875][106226] Updated weights for policy 0, policy_version 623886 (0.0008) [2023-12-27 23:43:36,175][105115] Fps is (10 sec: 21299.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 319987712. Throughput: 0: 10253.5, 1: 9727.9. Samples: 319998096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-27 23:43:36,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-6.027')] [2023-12-27 23:43:36,276][106225] Updated weights for policy 1, policy_version 625812 (0.0007) [2023-12-27 23:43:36,341][106225] Updated weights for policy 1, policy_version 625822 (0.0010) [2023-12-27 23:43:36,395][106225] Updated weights for policy 1, policy_version 625832 (0.0010) [2023-12-27 23:43:36,497][106226] Updated weights for policy 0, policy_version 623896 (0.0006) [2023-12-27 23:43:36,551][106226] Updated weights for policy 0, policy_version 623906 (0.0010) [2023-12-27 23:43:36,606][106226] Updated weights for policy 0, policy_version 623916 (0.0010) [2023-12-27 23:43:37,142][106225] Updated weights for policy 1, policy_version 625842 (0.0010) [2023-12-27 23:43:37,205][106225] Updated weights for policy 1, policy_version 625852 (0.0008) [2023-12-27 23:43:37,272][106225] Updated weights for policy 1, policy_version 625862 (0.0008) [2023-12-27 23:43:37,329][106226] Updated weights for policy 0, policy_version 623926 (0.0011) [2023-12-27 23:43:37,338][106225] Updated weights for policy 1, policy_version 625872 (0.0007) [2023-12-27 23:43:37,386][106226] Updated weights for policy 0, policy_version 623936 (0.0011) [2023-12-27 23:43:37,446][106226] Updated weights for policy 0, policy_version 623946 (0.0010) [2023-12-27 23:43:38,023][106225] Updated weights for policy 1, policy_version 625882 (0.0007) [2023-12-27 23:43:38,075][106225] Updated weights for policy 1, policy_version 625892 (0.0005) [2023-12-27 23:43:38,128][106226] Updated weights for policy 0, policy_version 623956 (0.0011) [2023-12-27 23:43:38,137][106225] Updated weights for policy 1, policy_version 625902 (0.0006) [2023-12-27 23:43:38,181][106226] Updated weights for policy 0, policy_version 623966 (0.0010) [2023-12-27 23:43:38,241][106226] Updated weights for policy 0, policy_version 623976 (0.0010) [2023-12-27 23:43:38,752][106225] Updated weights for policy 1, policy_version 625912 (0.0009) [2023-12-27 23:43:38,809][106225] Updated weights for policy 1, policy_version 625922 (0.0010) [2023-12-27 23:43:38,823][106226] Updated weights for policy 0, policy_version 623986 (0.0007) [2023-12-27 23:43:38,868][106225] Updated weights for policy 1, policy_version 625932 (0.0010) [2023-12-27 23:43:38,888][106226] Updated weights for policy 0, policy_version 623996 (0.0008) [2023-12-27 23:43:38,950][106226] Updated weights for policy 0, policy_version 624006 (0.0006) [2023-12-27 23:43:39,017][106226] Updated weights for policy 0, policy_version 624016 (0.0008) [2023-12-27 23:43:39,604][106225] Updated weights for policy 1, policy_version 625942 (0.0010) [2023-12-27 23:43:39,665][106225] Updated weights for policy 1, policy_version 625952 (0.0010) [2023-12-27 23:43:39,729][106226] Updated weights for policy 0, policy_version 624026 (0.0007) [2023-12-27 23:43:39,731][106225] Updated weights for policy 1, policy_version 625962 (0.0008) [2023-12-27 23:43:39,787][106226] Updated weights for policy 0, policy_version 624036 (0.0006) [2023-12-27 23:43:39,856][106226] Updated weights for policy 0, policy_version 624046 (0.0008) [2023-12-27 23:43:40,470][106225] Updated weights for policy 1, policy_version 625972 (0.0008) [2023-12-27 23:43:40,528][106225] Updated weights for policy 1, policy_version 625982 (0.0008) [2023-12-27 23:43:40,570][106226] Updated weights for policy 0, policy_version 624056 (0.0008) [2023-12-27 23:43:40,589][106225] Updated weights for policy 1, policy_version 625992 (0.0005) [2023-12-27 23:43:40,623][106226] Updated weights for policy 0, policy_version 624066 (0.0005) [2023-12-27 23:43:40,667][106226] Updated weights for policy 0, policy_version 624076 (0.0005) [2023-12-27 23:43:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 320086016. Throughput: 0: 10250.7, 1: 9802.6. Samples: 320060220. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:43:41,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-6.135')] [2023-12-27 23:43:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000626000_160284672.pth... [2023-12-27 23:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000624080_159801344.pth... [2023-12-27 23:43:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000624848_159989760.pth [2023-12-27 23:43:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000622896_159498240.pth [2023-12-27 23:43:41,229][106225] Updated weights for policy 1, policy_version 626002 (0.0006) [2023-12-27 23:43:41,299][106225] Updated weights for policy 1, policy_version 626012 (0.0014) [2023-12-27 23:43:41,368][106225] Updated weights for policy 1, policy_version 626022 (0.0008) [2023-12-27 23:43:41,431][106225] Updated weights for policy 1, policy_version 626032 (0.0009) [2023-12-27 23:43:41,456][106226] Updated weights for policy 0, policy_version 624086 (0.0005) [2023-12-27 23:43:41,523][106226] Updated weights for policy 0, policy_version 624096 (0.0006) [2023-12-27 23:43:41,580][106226] Updated weights for policy 0, policy_version 624106 (0.0006) [2023-12-27 23:43:42,180][106225] Updated weights for policy 1, policy_version 626042 (0.0006) [2023-12-27 23:43:42,242][106225] Updated weights for policy 1, policy_version 626052 (0.0005) [2023-12-27 23:43:42,261][106226] Updated weights for policy 0, policy_version 624116 (0.0008) [2023-12-27 23:43:42,300][106225] Updated weights for policy 1, policy_version 626062 (0.0009) [2023-12-27 23:43:42,323][106226] Updated weights for policy 0, policy_version 624126 (0.0009) [2023-12-27 23:43:42,392][106226] Updated weights for policy 0, policy_version 624136 (0.0008) [2023-12-27 23:43:42,993][106225] Updated weights for policy 1, policy_version 626072 (0.0008) [2023-12-27 23:43:43,042][106226] Updated weights for policy 0, policy_version 624146 (0.0006) [2023-12-27 23:43:43,049][106225] Updated weights for policy 1, policy_version 626082 (0.0006) [2023-12-27 23:43:43,090][106226] Updated weights for policy 0, policy_version 624156 (0.0007) [2023-12-27 23:43:43,099][106225] Updated weights for policy 1, policy_version 626092 (0.0007) [2023-12-27 23:43:43,145][106226] Updated weights for policy 0, policy_version 624166 (0.0007) [2023-12-27 23:43:43,192][106226] Updated weights for policy 0, policy_version 624176 (0.0008) [2023-12-27 23:43:43,807][106226] Updated weights for policy 0, policy_version 624186 (0.0007) [2023-12-27 23:43:43,827][106225] Updated weights for policy 1, policy_version 626102 (0.0010) [2023-12-27 23:43:43,860][106226] Updated weights for policy 0, policy_version 624196 (0.0006) [2023-12-27 23:43:43,890][106225] Updated weights for policy 1, policy_version 626112 (0.0010) [2023-12-27 23:43:43,918][106226] Updated weights for policy 0, policy_version 624206 (0.0006) [2023-12-27 23:43:43,944][106225] Updated weights for policy 1, policy_version 626122 (0.0010) [2023-12-27 23:43:44,649][106226] Updated weights for policy 0, policy_version 624216 (0.0008) [2023-12-27 23:43:44,701][106225] Updated weights for policy 1, policy_version 626132 (0.0008) [2023-12-27 23:43:44,710][106226] Updated weights for policy 0, policy_version 624226 (0.0009) [2023-12-27 23:43:44,758][106226] Updated weights for policy 0, policy_version 624236 (0.0009) [2023-12-27 23:43:44,763][106225] Updated weights for policy 1, policy_version 626142 (0.0006) [2023-12-27 23:43:44,826][106225] Updated weights for policy 1, policy_version 626152 (0.0008) [2023-12-27 23:43:45,529][106225] Updated weights for policy 1, policy_version 626162 (0.0007) [2023-12-27 23:43:45,543][106226] Updated weights for policy 0, policy_version 624246 (0.0009) [2023-12-27 23:43:45,596][106225] Updated weights for policy 1, policy_version 626172 (0.0005) [2023-12-27 23:43:45,604][106226] Updated weights for policy 0, policy_version 624256 (0.0008) [2023-12-27 23:43:45,649][106225] Updated weights for policy 1, policy_version 626182 (0.0006) [2023-12-27 23:43:45,665][106226] Updated weights for policy 0, policy_version 624266 (0.0008) [2023-12-27 23:43:45,701][106225] Updated weights for policy 1, policy_version 626192 (0.0008) [2023-12-27 23:43:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 320184320. Throughput: 0: 10218.7, 1: 9772.9. Samples: 320175920. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:43:46,176][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.830')] [2023-12-27 23:43:46,318][106226] Updated weights for policy 0, policy_version 624276 (0.0006) [2023-12-27 23:43:46,356][106225] Updated weights for policy 1, policy_version 626202 (0.0008) [2023-12-27 23:43:46,372][106226] Updated weights for policy 0, policy_version 624286 (0.0005) [2023-12-27 23:43:46,412][106225] Updated weights for policy 1, policy_version 626212 (0.0007) [2023-12-27 23:43:46,428][106226] Updated weights for policy 0, policy_version 624296 (0.0005) [2023-12-27 23:43:46,475][106225] Updated weights for policy 1, policy_version 626222 (0.0006) [2023-12-27 23:43:47,023][106226] Updated weights for policy 0, policy_version 624306 (0.0006) [2023-12-27 23:43:47,070][106225] Updated weights for policy 1, policy_version 626232 (0.0007) [2023-12-27 23:43:47,081][106226] Updated weights for policy 0, policy_version 624316 (0.0008) [2023-12-27 23:43:47,135][106226] Updated weights for policy 0, policy_version 624326 (0.0006) [2023-12-27 23:43:47,143][106225] Updated weights for policy 1, policy_version 626242 (0.0008) [2023-12-27 23:43:47,187][106226] Updated weights for policy 0, policy_version 624336 (0.0010) [2023-12-27 23:43:47,210][106225] Updated weights for policy 1, policy_version 626252 (0.0009) [2023-12-27 23:43:47,746][106225] Updated weights for policy 1, policy_version 626262 (0.0005) [2023-12-27 23:43:47,802][106225] Updated weights for policy 1, policy_version 626272 (0.0005) [2023-12-27 23:43:47,849][106225] Updated weights for policy 1, policy_version 626282 (0.0005) [2023-12-27 23:43:48,008][106226] Updated weights for policy 0, policy_version 624346 (0.0007) [2023-12-27 23:43:48,060][106226] Updated weights for policy 0, policy_version 624356 (0.0008) [2023-12-27 23:43:48,107][106226] Updated weights for policy 0, policy_version 624367 (0.0008) [2023-12-27 23:43:48,505][106225] Updated weights for policy 1, policy_version 626292 (0.0005) [2023-12-27 23:43:48,569][106225] Updated weights for policy 1, policy_version 626302 (0.0007) [2023-12-27 23:43:48,629][106225] Updated weights for policy 1, policy_version 626312 (0.0008) [2023-12-27 23:43:48,764][106226] Updated weights for policy 0, policy_version 624377 (0.0006) [2023-12-27 23:43:48,824][106226] Updated weights for policy 0, policy_version 624387 (0.0005) [2023-12-27 23:43:48,888][106226] Updated weights for policy 0, policy_version 624397 (0.0008) [2023-12-27 23:43:49,252][106225] Updated weights for policy 1, policy_version 626322 (0.0008) [2023-12-27 23:43:49,313][106225] Updated weights for policy 1, policy_version 626332 (0.0008) [2023-12-27 23:43:49,383][106225] Updated weights for policy 1, policy_version 626342 (0.0009) [2023-12-27 23:43:49,441][106225] Updated weights for policy 1, policy_version 626352 (0.0008) [2023-12-27 23:43:49,570][106226] Updated weights for policy 0, policy_version 624407 (0.0008) [2023-12-27 23:43:49,630][106226] Updated weights for policy 0, policy_version 624417 (0.0009) [2023-12-27 23:43:49,682][106226] Updated weights for policy 0, policy_version 624427 (0.0009) [2023-12-27 23:43:50,263][106225] Updated weights for policy 1, policy_version 626362 (0.0006) [2023-12-27 23:43:50,309][106226] Updated weights for policy 0, policy_version 624437 (0.0007) [2023-12-27 23:43:50,326][106225] Updated weights for policy 1, policy_version 626372 (0.0008) [2023-12-27 23:43:50,370][106226] Updated weights for policy 0, policy_version 624447 (0.0006) [2023-12-27 23:43:50,383][106225] Updated weights for policy 1, policy_version 626382 (0.0006) [2023-12-27 23:43:50,434][106226] Updated weights for policy 0, policy_version 624457 (0.0006) [2023-12-27 23:43:50,995][106225] Updated weights for policy 1, policy_version 626392 (0.0007) [2023-12-27 23:43:51,061][106225] Updated weights for policy 1, policy_version 626402 (0.0007) [2023-12-27 23:43:51,126][106225] Updated weights for policy 1, policy_version 626412 (0.0007) [2023-12-27 23:43:51,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 320290816. Throughput: 0: 10170.6, 1: 9862.5. Samples: 320299312. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:43:51,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.777')] [2023-12-27 23:43:51,201][106226] Updated weights for policy 0, policy_version 624467 (0.0009) [2023-12-27 23:43:51,249][106226] Updated weights for policy 0, policy_version 624477 (0.0008) [2023-12-27 23:43:51,306][106226] Updated weights for policy 0, policy_version 624487 (0.0008) [2023-12-27 23:43:51,774][106225] Updated weights for policy 1, policy_version 626422 (0.0007) [2023-12-27 23:43:51,848][106225] Updated weights for policy 1, policy_version 626432 (0.0008) [2023-12-27 23:43:51,897][106225] Updated weights for policy 1, policy_version 626442 (0.0008) [2023-12-27 23:43:52,128][106226] Updated weights for policy 0, policy_version 624497 (0.0008) [2023-12-27 23:43:52,185][106226] Updated weights for policy 0, policy_version 624507 (0.0009) [2023-12-27 23:43:52,234][106226] Updated weights for policy 0, policy_version 624517 (0.0008) [2023-12-27 23:43:52,299][106226] Updated weights for policy 0, policy_version 624527 (0.0006) [2023-12-27 23:43:52,619][106225] Updated weights for policy 1, policy_version 626452 (0.0009) [2023-12-27 23:43:52,690][106225] Updated weights for policy 1, policy_version 626462 (0.0010) [2023-12-27 23:43:52,752][106225] Updated weights for policy 1, policy_version 626472 (0.0009) [2023-12-27 23:43:53,024][106226] Updated weights for policy 0, policy_version 624537 (0.0008) [2023-12-27 23:43:53,076][106226] Updated weights for policy 0, policy_version 624547 (0.0008) [2023-12-27 23:43:53,121][106226] Updated weights for policy 0, policy_version 624557 (0.0008) [2023-12-27 23:43:53,363][106225] Updated weights for policy 1, policy_version 626482 (0.0007) [2023-12-27 23:43:53,411][106225] Updated weights for policy 1, policy_version 626492 (0.0005) [2023-12-27 23:43:53,461][106225] Updated weights for policy 1, policy_version 626502 (0.0006) [2023-12-27 23:43:53,517][106225] Updated weights for policy 1, policy_version 626512 (0.0007) [2023-12-27 23:43:53,934][106226] Updated weights for policy 0, policy_version 624567 (0.0009) [2023-12-27 23:43:53,987][106226] Updated weights for policy 0, policy_version 624577 (0.0010) [2023-12-27 23:43:54,047][106226] Updated weights for policy 0, policy_version 624587 (0.0010) [2023-12-27 23:43:54,143][106225] Updated weights for policy 1, policy_version 626522 (0.0010) [2023-12-27 23:43:54,199][106225] Updated weights for policy 1, policy_version 626532 (0.0009) [2023-12-27 23:43:54,253][106225] Updated weights for policy 1, policy_version 626542 (0.0008) [2023-12-27 23:43:54,683][106226] Updated weights for policy 0, policy_version 624597 (0.0006) [2023-12-27 23:43:54,742][106226] Updated weights for policy 0, policy_version 624607 (0.0008) [2023-12-27 23:43:54,796][106226] Updated weights for policy 0, policy_version 624617 (0.0008) [2023-12-27 23:43:55,016][106225] Updated weights for policy 1, policy_version 626552 (0.0010) [2023-12-27 23:43:55,066][106225] Updated weights for policy 1, policy_version 626562 (0.0008) [2023-12-27 23:43:55,125][106225] Updated weights for policy 1, policy_version 626572 (0.0009) [2023-12-27 23:43:55,397][106226] Updated weights for policy 0, policy_version 624627 (0.0008) [2023-12-27 23:43:55,460][106226] Updated weights for policy 0, policy_version 624637 (0.0005) [2023-12-27 23:43:55,508][106226] Updated weights for policy 0, policy_version 624647 (0.0005) [2023-12-27 23:43:55,999][106225] Updated weights for policy 1, policy_version 626582 (0.0009) [2023-12-27 23:43:56,013][106226] Updated weights for policy 0, policy_version 624657 (0.0005) [2023-12-27 23:43:56,059][106225] Updated weights for policy 1, policy_version 626592 (0.0009) [2023-12-27 23:43:56,079][106226] Updated weights for policy 0, policy_version 624667 (0.0008) [2023-12-27 23:43:56,119][106225] Updated weights for policy 1, policy_version 626602 (0.0007) [2023-12-27 23:43:56,143][106226] Updated weights for policy 0, policy_version 624677 (0.0009) [2023-12-27 23:43:56,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 320389120. Throughput: 0: 10052.2, 1: 9880.9. Samples: 320356864. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:43:56,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.969')] [2023-12-27 23:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000626608_160440320.pth... [2023-12-27 23:43:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000625424_160137216.pth [2023-12-27 23:43:56,205][106226] Updated weights for policy 0, policy_version 624687 (0.0007) [2023-12-27 23:43:56,211][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000624688_159956992.pth... [2023-12-27 23:43:56,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000623504_159653888.pth [2023-12-27 23:43:56,824][106226] Updated weights for policy 0, policy_version 624697 (0.0005) [2023-12-27 23:43:56,830][106225] Updated weights for policy 1, policy_version 626612 (0.0008) [2023-12-27 23:43:56,881][106226] Updated weights for policy 0, policy_version 624707 (0.0005) [2023-12-27 23:43:56,886][106225] Updated weights for policy 1, policy_version 626622 (0.0008) [2023-12-27 23:43:56,933][106225] Updated weights for policy 1, policy_version 626632 (0.0005) [2023-12-27 23:43:56,937][106226] Updated weights for policy 0, policy_version 624717 (0.0005) [2023-12-27 23:43:57,474][106226] Updated weights for policy 0, policy_version 624727 (0.0005) [2023-12-27 23:43:57,484][106225] Updated weights for policy 1, policy_version 626642 (0.0005) [2023-12-27 23:43:57,529][106226] Updated weights for policy 0, policy_version 624737 (0.0008) [2023-12-27 23:43:57,539][106225] Updated weights for policy 1, policy_version 626652 (0.0005) [2023-12-27 23:43:57,578][106226] Updated weights for policy 0, policy_version 624747 (0.0008) [2023-12-27 23:43:57,591][106225] Updated weights for policy 1, policy_version 626662 (0.0005) [2023-12-27 23:43:57,640][106225] Updated weights for policy 1, policy_version 626672 (0.0007) [2023-12-27 23:43:58,184][106226] Updated weights for policy 0, policy_version 624757 (0.0005) [2023-12-27 23:43:58,242][106225] Updated weights for policy 1, policy_version 626682 (0.0007) [2023-12-27 23:43:58,255][106226] Updated weights for policy 0, policy_version 624767 (0.0008) [2023-12-27 23:43:58,300][106225] Updated weights for policy 1, policy_version 626692 (0.0007) [2023-12-27 23:43:58,313][106226] Updated weights for policy 0, policy_version 624777 (0.0009) [2023-12-27 23:43:58,377][106225] Updated weights for policy 1, policy_version 626702 (0.0008) [2023-12-27 23:43:59,122][106225] Updated weights for policy 1, policy_version 626712 (0.0008) [2023-12-27 23:43:59,151][106226] Updated weights for policy 0, policy_version 624787 (0.0009) [2023-12-27 23:43:59,193][106225] Updated weights for policy 1, policy_version 626722 (0.0009) [2023-12-27 23:43:59,221][106226] Updated weights for policy 0, policy_version 624797 (0.0007) [2023-12-27 23:43:59,264][106225] Updated weights for policy 1, policy_version 626732 (0.0008) [2023-12-27 23:43:59,297][106226] Updated weights for policy 0, policy_version 624807 (0.0009) [2023-12-27 23:43:59,983][106226] Updated weights for policy 0, policy_version 624817 (0.0008) [2023-12-27 23:44:00,044][106226] Updated weights for policy 0, policy_version 624827 (0.0007) [2023-12-27 23:44:00,071][106225] Updated weights for policy 1, policy_version 626742 (0.0008) [2023-12-27 23:44:00,104][106226] Updated weights for policy 0, policy_version 624837 (0.0006) [2023-12-27 23:44:00,130][106225] Updated weights for policy 1, policy_version 626752 (0.0008) [2023-12-27 23:44:00,158][106226] Updated weights for policy 0, policy_version 624847 (0.0007) [2023-12-27 23:44:00,194][106225] Updated weights for policy 1, policy_version 626762 (0.0008) [2023-12-27 23:44:00,795][106226] Updated weights for policy 0, policy_version 624857 (0.0005) [2023-12-27 23:44:00,849][106226] Updated weights for policy 0, policy_version 624867 (0.0007) [2023-12-27 23:44:00,879][106225] Updated weights for policy 1, policy_version 626772 (0.0007) [2023-12-27 23:44:00,912][106226] Updated weights for policy 0, policy_version 624877 (0.0008) [2023-12-27 23:44:00,942][106225] Updated weights for policy 1, policy_version 626782 (0.0007) [2023-12-27 23:44:00,997][106225] Updated weights for policy 1, policy_version 626792 (0.0008) [2023-12-27 23:44:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 320495616. Throughput: 0: 10218.5, 1: 9954.8. Samples: 320480724. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:01,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-5.959')] [2023-12-27 23:44:01,655][106226] Updated weights for policy 0, policy_version 624887 (0.0007) [2023-12-27 23:44:01,713][106226] Updated weights for policy 0, policy_version 624897 (0.0005) [2023-12-27 23:44:01,722][106225] Updated weights for policy 1, policy_version 626802 (0.0008) [2023-12-27 23:44:01,781][106226] Updated weights for policy 0, policy_version 624907 (0.0006) [2023-12-27 23:44:01,786][106225] Updated weights for policy 1, policy_version 626812 (0.0008) [2023-12-27 23:44:01,834][106225] Updated weights for policy 1, policy_version 626822 (0.0009) [2023-12-27 23:44:01,880][106225] Updated weights for policy 1, policy_version 626832 (0.0006) [2023-12-27 23:44:02,330][106226] Updated weights for policy 0, policy_version 624917 (0.0007) [2023-12-27 23:44:02,401][106226] Updated weights for policy 0, policy_version 624927 (0.0009) [2023-12-27 23:44:02,463][106226] Updated weights for policy 0, policy_version 624937 (0.0008) [2023-12-27 23:44:02,622][106225] Updated weights for policy 1, policy_version 626842 (0.0009) [2023-12-27 23:44:02,685][106225] Updated weights for policy 1, policy_version 626852 (0.0009) [2023-12-27 23:44:02,742][106225] Updated weights for policy 1, policy_version 626862 (0.0008) [2023-12-27 23:44:03,103][106226] Updated weights for policy 0, policy_version 624947 (0.0005) [2023-12-27 23:44:03,154][106226] Updated weights for policy 0, policy_version 624957 (0.0005) [2023-12-27 23:44:03,206][106226] Updated weights for policy 0, policy_version 624967 (0.0005) [2023-12-27 23:44:03,527][106225] Updated weights for policy 1, policy_version 626872 (0.0009) [2023-12-27 23:44:03,584][106225] Updated weights for policy 1, policy_version 626882 (0.0009) [2023-12-27 23:44:03,637][106225] Updated weights for policy 1, policy_version 626892 (0.0008) [2023-12-27 23:44:03,718][106226] Updated weights for policy 0, policy_version 624977 (0.0005) [2023-12-27 23:44:03,775][106226] Updated weights for policy 0, policy_version 624987 (0.0006) [2023-12-27 23:44:03,833][106226] Updated weights for policy 0, policy_version 624997 (0.0005) [2023-12-27 23:44:03,916][106226] Updated weights for policy 0, policy_version 625007 (0.0010) [2023-12-27 23:44:04,380][106225] Updated weights for policy 1, policy_version 626903 (0.0009) [2023-12-27 23:44:04,444][106225] Updated weights for policy 1, policy_version 626913 (0.0009) [2023-12-27 23:44:04,505][106225] Updated weights for policy 1, policy_version 626923 (0.0008) [2023-12-27 23:44:04,546][106226] Updated weights for policy 0, policy_version 625017 (0.0007) [2023-12-27 23:44:04,599][106226] Updated weights for policy 0, policy_version 625027 (0.0008) [2023-12-27 23:44:04,657][106226] Updated weights for policy 0, policy_version 625037 (0.0008) [2023-12-27 23:44:05,107][106225] Updated weights for policy 1, policy_version 626933 (0.0008) [2023-12-27 23:44:05,159][106225] Updated weights for policy 1, policy_version 626943 (0.0007) [2023-12-27 23:44:05,216][106225] Updated weights for policy 1, policy_version 626953 (0.0009) [2023-12-27 23:44:05,339][106226] Updated weights for policy 0, policy_version 625047 (0.0010) [2023-12-27 23:44:05,402][106226] Updated weights for policy 0, policy_version 625057 (0.0011) [2023-12-27 23:44:05,458][106226] Updated weights for policy 0, policy_version 625067 (0.0010) [2023-12-27 23:44:05,842][106225] Updated weights for policy 1, policy_version 626963 (0.0007) [2023-12-27 23:44:05,906][106225] Updated weights for policy 1, policy_version 626973 (0.0006) [2023-12-27 23:44:05,968][106225] Updated weights for policy 1, policy_version 626983 (0.0007) [2023-12-27 23:44:06,070][106226] Updated weights for policy 0, policy_version 625077 (0.0008) [2023-12-27 23:44:06,138][106226] Updated weights for policy 0, policy_version 625087 (0.0008) [2023-12-27 23:44:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 320593920. Throughput: 0: 10262.9, 1: 10023.9. Samples: 320604656. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:06,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-6.207')] [2023-12-27 23:44:06,206][106226] Updated weights for policy 0, policy_version 625097 (0.0008) [2023-12-27 23:44:06,600][106225] Updated weights for policy 1, policy_version 626993 (0.0008) [2023-12-27 23:44:06,669][106225] Updated weights for policy 1, policy_version 627003 (0.0011) [2023-12-27 23:44:06,728][106225] Updated weights for policy 1, policy_version 627013 (0.0010) [2023-12-27 23:44:06,786][106225] Updated weights for policy 1, policy_version 627023 (0.0011) [2023-12-27 23:44:06,871][106226] Updated weights for policy 0, policy_version 625107 (0.0006) [2023-12-27 23:44:06,927][106226] Updated weights for policy 0, policy_version 625117 (0.0005) [2023-12-27 23:44:06,980][106226] Updated weights for policy 0, policy_version 625127 (0.0005) [2023-12-27 23:44:07,510][106225] Updated weights for policy 1, policy_version 627033 (0.0009) [2023-12-27 23:44:07,533][106226] Updated weights for policy 0, policy_version 625137 (0.0006) [2023-12-27 23:44:07,559][106225] Updated weights for policy 1, policy_version 627043 (0.0008) [2023-12-27 23:44:07,584][106226] Updated weights for policy 0, policy_version 625147 (0.0009) [2023-12-27 23:44:07,617][106225] Updated weights for policy 1, policy_version 627053 (0.0007) [2023-12-27 23:44:07,632][106226] Updated weights for policy 0, policy_version 625157 (0.0006) [2023-12-27 23:44:07,699][106226] Updated weights for policy 0, policy_version 625167 (0.0005) [2023-12-27 23:44:08,302][106225] Updated weights for policy 1, policy_version 627063 (0.0006) [2023-12-27 23:44:08,315][106226] Updated weights for policy 0, policy_version 625177 (0.0009) [2023-12-27 23:44:08,365][106225] Updated weights for policy 1, policy_version 627073 (0.0007) [2023-12-27 23:44:08,383][106226] Updated weights for policy 0, policy_version 625187 (0.0008) [2023-12-27 23:44:08,427][106225] Updated weights for policy 1, policy_version 627083 (0.0007) [2023-12-27 23:44:08,439][106226] Updated weights for policy 0, policy_version 625197 (0.0008) [2023-12-27 23:44:09,047][106225] Updated weights for policy 1, policy_version 627093 (0.0006) [2023-12-27 23:44:09,109][106225] Updated weights for policy 1, policy_version 627103 (0.0007) [2023-12-27 23:44:09,171][106226] Updated weights for policy 0, policy_version 625207 (0.0008) [2023-12-27 23:44:09,175][106225] Updated weights for policy 1, policy_version 627113 (0.0005) [2023-12-27 23:44:09,239][106226] Updated weights for policy 0, policy_version 625217 (0.0009) [2023-12-27 23:44:09,303][106226] Updated weights for policy 0, policy_version 625227 (0.0007) [2023-12-27 23:44:09,854][106225] Updated weights for policy 1, policy_version 627123 (0.0008) [2023-12-27 23:44:09,918][106225] Updated weights for policy 1, policy_version 627133 (0.0009) [2023-12-27 23:44:09,981][106225] Updated weights for policy 1, policy_version 627143 (0.0009) [2023-12-27 23:44:10,062][106226] Updated weights for policy 0, policy_version 625237 (0.0008) [2023-12-27 23:44:10,121][106226] Updated weights for policy 0, policy_version 625247 (0.0009) [2023-12-27 23:44:10,180][106226] Updated weights for policy 0, policy_version 625257 (0.0008) [2023-12-27 23:44:10,702][106225] Updated weights for policy 1, policy_version 627153 (0.0009) [2023-12-27 23:44:10,757][106225] Updated weights for policy 1, policy_version 627163 (0.0009) [2023-12-27 23:44:10,812][106225] Updated weights for policy 1, policy_version 627173 (0.0008) [2023-12-27 23:44:10,880][106225] Updated weights for policy 1, policy_version 627183 (0.0006) [2023-12-27 23:44:10,883][106226] Updated weights for policy 0, policy_version 625267 (0.0009) [2023-12-27 23:44:10,936][106226] Updated weights for policy 0, policy_version 625277 (0.0010) [2023-12-27 23:44:10,996][106226] Updated weights for policy 0, policy_version 625287 (0.0010) [2023-12-27 23:44:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 320700416. Throughput: 0: 10340.1, 1: 10089.8. Samples: 320667132. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:11,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.605')] [2023-12-27 23:44:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000627184_160587776.pth... [2023-12-27 23:44:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000625296_160112640.pth... [2023-12-27 23:44:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000626000_160284672.pth [2023-12-27 23:44:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000624080_159801344.pth [2023-12-27 23:44:11,582][106225] Updated weights for policy 1, policy_version 627193 (0.0006) [2023-12-27 23:44:11,646][106225] Updated weights for policy 1, policy_version 627203 (0.0008) [2023-12-27 23:44:11,707][106225] Updated weights for policy 1, policy_version 627213 (0.0007) [2023-12-27 23:44:11,792][106226] Updated weights for policy 0, policy_version 625297 (0.0009) [2023-12-27 23:44:11,851][106226] Updated weights for policy 0, policy_version 625307 (0.0009) [2023-12-27 23:44:11,914][106226] Updated weights for policy 0, policy_version 625317 (0.0011) [2023-12-27 23:44:11,975][106226] Updated weights for policy 0, policy_version 625327 (0.0011) [2023-12-27 23:44:12,437][106225] Updated weights for policy 1, policy_version 627223 (0.0008) [2023-12-27 23:44:12,495][106225] Updated weights for policy 1, policy_version 627233 (0.0010) [2023-12-27 23:44:12,546][106225] Updated weights for policy 1, policy_version 627243 (0.0009) [2023-12-27 23:44:12,652][106226] Updated weights for policy 0, policy_version 625337 (0.0010) [2023-12-27 23:44:12,718][106226] Updated weights for policy 0, policy_version 625347 (0.0011) [2023-12-27 23:44:12,772][106226] Updated weights for policy 0, policy_version 625357 (0.0010) [2023-12-27 23:44:13,317][106225] Updated weights for policy 1, policy_version 627253 (0.0008) [2023-12-27 23:44:13,367][106225] Updated weights for policy 1, policy_version 627263 (0.0009) [2023-12-27 23:44:13,375][106226] Updated weights for policy 0, policy_version 625367 (0.0007) [2023-12-27 23:44:13,419][106225] Updated weights for policy 1, policy_version 627273 (0.0007) [2023-12-27 23:44:13,427][106226] Updated weights for policy 0, policy_version 625377 (0.0006) [2023-12-27 23:44:13,482][106226] Updated weights for policy 0, policy_version 625387 (0.0007) [2023-12-27 23:44:14,072][106226] Updated weights for policy 0, policy_version 625397 (0.0007) [2023-12-27 23:44:14,129][106226] Updated weights for policy 0, policy_version 625407 (0.0005) [2023-12-27 23:44:14,185][106225] Updated weights for policy 1, policy_version 627283 (0.0007) [2023-12-27 23:44:14,189][106226] Updated weights for policy 0, policy_version 625417 (0.0009) [2023-12-27 23:44:14,253][106225] Updated weights for policy 1, policy_version 627293 (0.0006) [2023-12-27 23:44:14,318][106225] Updated weights for policy 1, policy_version 627303 (0.0007) [2023-12-27 23:44:14,848][106226] Updated weights for policy 0, policy_version 625427 (0.0006) [2023-12-27 23:44:14,912][106226] Updated weights for policy 0, policy_version 625437 (0.0005) [2023-12-27 23:44:14,978][106226] Updated weights for policy 0, policy_version 625447 (0.0010) [2023-12-27 23:44:15,029][106225] Updated weights for policy 1, policy_version 627313 (0.0010) [2023-12-27 23:44:15,091][106225] Updated weights for policy 1, policy_version 627323 (0.0010) [2023-12-27 23:44:15,150][106225] Updated weights for policy 1, policy_version 627333 (0.0011) [2023-12-27 23:44:15,209][106225] Updated weights for policy 1, policy_version 627343 (0.0011) [2023-12-27 23:44:15,673][106226] Updated weights for policy 0, policy_version 625457 (0.0010) [2023-12-27 23:44:15,741][106226] Updated weights for policy 0, policy_version 625467 (0.0007) [2023-12-27 23:44:15,801][106226] Updated weights for policy 0, policy_version 625477 (0.0008) [2023-12-27 23:44:15,862][106226] Updated weights for policy 0, policy_version 625487 (0.0009) [2023-12-27 23:44:15,918][106225] Updated weights for policy 1, policy_version 627353 (0.0009) [2023-12-27 23:44:15,971][106225] Updated weights for policy 1, policy_version 627363 (0.0006) [2023-12-27 23:44:16,026][106225] Updated weights for policy 1, policy_version 627373 (0.0009) [2023-12-27 23:44:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 320798720. Throughput: 0: 10267.0, 1: 10011.8. Samples: 320785260. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:16,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-6.192')] [2023-12-27 23:44:16,571][106226] Updated weights for policy 0, policy_version 625497 (0.0008) [2023-12-27 23:44:16,621][106226] Updated weights for policy 0, policy_version 625507 (0.0009) [2023-12-27 23:44:16,664][106226] Updated weights for policy 0, policy_version 625517 (0.0008) [2023-12-27 23:44:16,700][106225] Updated weights for policy 1, policy_version 627383 (0.0007) [2023-12-27 23:44:16,760][106225] Updated weights for policy 1, policy_version 627393 (0.0008) [2023-12-27 23:44:16,816][106225] Updated weights for policy 1, policy_version 627403 (0.0007) [2023-12-27 23:44:17,328][106226] Updated weights for policy 0, policy_version 625527 (0.0008) [2023-12-27 23:44:17,391][106226] Updated weights for policy 0, policy_version 625537 (0.0008) [2023-12-27 23:44:17,451][106226] Updated weights for policy 0, policy_version 625547 (0.0008) [2023-12-27 23:44:17,587][106225] Updated weights for policy 1, policy_version 627413 (0.0008) [2023-12-27 23:44:17,643][106225] Updated weights for policy 1, policy_version 627423 (0.0009) [2023-12-27 23:44:17,706][106225] Updated weights for policy 1, policy_version 627433 (0.0008) [2023-12-27 23:44:18,131][106226] Updated weights for policy 0, policy_version 625557 (0.0008) [2023-12-27 23:44:18,178][106226] Updated weights for policy 0, policy_version 625567 (0.0008) [2023-12-27 23:44:18,224][106226] Updated weights for policy 0, policy_version 625577 (0.0007) [2023-12-27 23:44:18,462][106225] Updated weights for policy 1, policy_version 627443 (0.0010) [2023-12-27 23:44:18,524][106225] Updated weights for policy 1, policy_version 627453 (0.0010) [2023-12-27 23:44:18,577][106225] Updated weights for policy 1, policy_version 627463 (0.0010) [2023-12-27 23:44:19,004][106226] Updated weights for policy 0, policy_version 625587 (0.0008) [2023-12-27 23:44:19,054][106226] Updated weights for policy 0, policy_version 625597 (0.0008) [2023-12-27 23:44:19,105][106226] Updated weights for policy 0, policy_version 625607 (0.0008) [2023-12-27 23:44:19,336][106225] Updated weights for policy 1, policy_version 627473 (0.0010) [2023-12-27 23:44:19,399][106225] Updated weights for policy 1, policy_version 627483 (0.0006) [2023-12-27 23:44:19,455][106225] Updated weights for policy 1, policy_version 627493 (0.0006) [2023-12-27 23:44:19,531][106225] Updated weights for policy 1, policy_version 627503 (0.0007) [2023-12-27 23:44:19,866][106226] Updated weights for policy 0, policy_version 625617 (0.0008) [2023-12-27 23:44:19,934][106226] Updated weights for policy 0, policy_version 625627 (0.0014) [2023-12-27 23:44:19,992][106226] Updated weights for policy 0, policy_version 625637 (0.0011) [2023-12-27 23:44:20,042][106226] Updated weights for policy 0, policy_version 625647 (0.0009) [2023-12-27 23:44:20,252][106225] Updated weights for policy 1, policy_version 627513 (0.0006) [2023-12-27 23:44:20,316][106225] Updated weights for policy 1, policy_version 627523 (0.0006) [2023-12-27 23:44:20,387][106225] Updated weights for policy 1, policy_version 627533 (0.0008) [2023-12-27 23:44:20,844][106226] Updated weights for policy 0, policy_version 625657 (0.0009) [2023-12-27 23:44:20,904][106226] Updated weights for policy 0, policy_version 625667 (0.0005) [2023-12-27 23:44:20,964][106226] Updated weights for policy 0, policy_version 625677 (0.0006) [2023-12-27 23:44:21,077][106225] Updated weights for policy 1, policy_version 627543 (0.0009) [2023-12-27 23:44:21,144][106225] Updated weights for policy 1, policy_version 627553 (0.0009) [2023-12-27 23:44:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 320888832. Throughput: 0: 10166.3, 1: 9899.2. Samples: 320901044. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:21,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.779')] [2023-12-27 23:44:21,199][106225] Updated weights for policy 1, policy_version 627563 (0.0010) [2023-12-27 23:44:21,750][106226] Updated weights for policy 0, policy_version 625687 (0.0010) [2023-12-27 23:44:21,816][106226] Updated weights for policy 0, policy_version 625697 (0.0010) [2023-12-27 23:44:21,881][106226] Updated weights for policy 0, policy_version 625707 (0.0011) [2023-12-27 23:44:21,940][106225] Updated weights for policy 1, policy_version 627573 (0.0011) [2023-12-27 23:44:22,002][106225] Updated weights for policy 1, policy_version 627583 (0.0011) [2023-12-27 23:44:22,067][106225] Updated weights for policy 1, policy_version 627593 (0.0011) [2023-12-27 23:44:22,623][106226] Updated weights for policy 0, policy_version 625717 (0.0011) [2023-12-27 23:44:22,674][106226] Updated weights for policy 0, policy_version 625727 (0.0010) [2023-12-27 23:44:22,730][106226] Updated weights for policy 0, policy_version 625737 (0.0011) [2023-12-27 23:44:22,775][106225] Updated weights for policy 1, policy_version 627603 (0.0010) [2023-12-27 23:44:22,834][106225] Updated weights for policy 1, policy_version 627613 (0.0008) [2023-12-27 23:44:22,888][106225] Updated weights for policy 1, policy_version 627623 (0.0007) [2023-12-27 23:44:23,486][106226] Updated weights for policy 0, policy_version 625747 (0.0011) [2023-12-27 23:44:23,581][106226] Updated weights for policy 0, policy_version 625757 (0.0009) [2023-12-27 23:44:23,582][106225] Updated weights for policy 1, policy_version 627633 (0.0007) [2023-12-27 23:44:23,642][106226] Updated weights for policy 0, policy_version 625767 (0.0011) [2023-12-27 23:44:23,642][106225] Updated weights for policy 1, policy_version 627643 (0.0011) [2023-12-27 23:44:23,696][106225] Updated weights for policy 1, policy_version 627653 (0.0009) [2023-12-27 23:44:23,757][106225] Updated weights for policy 1, policy_version 627663 (0.0008) [2023-12-27 23:44:24,326][106226] Updated weights for policy 0, policy_version 625777 (0.0011) [2023-12-27 23:44:24,387][106226] Updated weights for policy 0, policy_version 625787 (0.0011) [2023-12-27 23:44:24,450][106226] Updated weights for policy 0, policy_version 625797 (0.0008) [2023-12-27 23:44:24,480][106225] Updated weights for policy 1, policy_version 627673 (0.0006) [2023-12-27 23:44:24,511][106226] Updated weights for policy 0, policy_version 625807 (0.0010) [2023-12-27 23:44:24,530][106225] Updated weights for policy 1, policy_version 627683 (0.0006) [2023-12-27 23:44:24,583][106225] Updated weights for policy 1, policy_version 627693 (0.0008) [2023-12-27 23:44:25,164][106225] Updated weights for policy 1, policy_version 627703 (0.0006) [2023-12-27 23:44:25,216][106226] Updated weights for policy 0, policy_version 625817 (0.0007) [2023-12-27 23:44:25,222][106225] Updated weights for policy 1, policy_version 627713 (0.0005) [2023-12-27 23:44:25,265][106226] Updated weights for policy 0, policy_version 625827 (0.0006) [2023-12-27 23:44:25,290][106225] Updated weights for policy 1, policy_version 627723 (0.0005) [2023-12-27 23:44:25,335][106226] Updated weights for policy 0, policy_version 625837 (0.0008) [2023-12-27 23:44:25,857][106225] Updated weights for policy 1, policy_version 627733 (0.0006) [2023-12-27 23:44:25,903][106225] Updated weights for policy 1, policy_version 627743 (0.0009) [2023-12-27 23:44:25,956][106225] Updated weights for policy 1, policy_version 627753 (0.0007) [2023-12-27 23:44:25,965][106226] Updated weights for policy 0, policy_version 625847 (0.0008) [2023-12-27 23:44:26,027][106226] Updated weights for policy 0, policy_version 625857 (0.0008) [2023-12-27 23:44:26,088][106226] Updated weights for policy 0, policy_version 625867 (0.0008) [2023-12-27 23:44:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20343.6, 300 sec: 19855.2). Total num frames: 320995328. Throughput: 0: 10087.3, 1: 9838.3. Samples: 320956872. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:26,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-5.964')] [2023-12-27 23:44:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000627760_160735232.pth... [2023-12-27 23:44:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000625872_160260096.pth... [2023-12-27 23:44:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000626608_160440320.pth [2023-12-27 23:44:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000624688_159956992.pth [2023-12-27 23:44:26,640][106225] Updated weights for policy 1, policy_version 627763 (0.0006) [2023-12-27 23:44:26,688][106225] Updated weights for policy 1, policy_version 627773 (0.0005) [2023-12-27 23:44:26,734][106225] Updated weights for policy 1, policy_version 627783 (0.0005) [2023-12-27 23:44:26,783][106226] Updated weights for policy 0, policy_version 625877 (0.0008) [2023-12-27 23:44:26,832][106226] Updated weights for policy 0, policy_version 625887 (0.0009) [2023-12-27 23:44:26,888][106226] Updated weights for policy 0, policy_version 625897 (0.0008) [2023-12-27 23:44:27,386][106225] Updated weights for policy 1, policy_version 627793 (0.0005) [2023-12-27 23:44:27,450][106225] Updated weights for policy 1, policy_version 627803 (0.0005) [2023-12-27 23:44:27,514][106225] Updated weights for policy 1, policy_version 627813 (0.0009) [2023-12-27 23:44:27,575][106225] Updated weights for policy 1, policy_version 627823 (0.0009) [2023-12-27 23:44:27,585][106226] Updated weights for policy 0, policy_version 625907 (0.0007) [2023-12-27 23:44:27,642][106226] Updated weights for policy 0, policy_version 625917 (0.0005) [2023-12-27 23:44:27,698][106226] Updated weights for policy 0, policy_version 625927 (0.0005) [2023-12-27 23:44:28,276][106225] Updated weights for policy 1, policy_version 627833 (0.0007) [2023-12-27 23:44:28,301][106226] Updated weights for policy 0, policy_version 625937 (0.0010) [2023-12-27 23:44:28,325][106225] Updated weights for policy 1, policy_version 627843 (0.0008) [2023-12-27 23:44:28,363][106226] Updated weights for policy 0, policy_version 625947 (0.0009) [2023-12-27 23:44:28,388][106225] Updated weights for policy 1, policy_version 627853 (0.0007) [2023-12-27 23:44:28,423][106226] Updated weights for policy 0, policy_version 625957 (0.0008) [2023-12-27 23:44:28,480][106226] Updated weights for policy 0, policy_version 625967 (0.0009) [2023-12-27 23:44:29,101][106225] Updated weights for policy 1, policy_version 627863 (0.0007) [2023-12-27 23:44:29,160][106225] Updated weights for policy 1, policy_version 627873 (0.0009) [2023-12-27 23:44:29,197][106226] Updated weights for policy 0, policy_version 625977 (0.0005) [2023-12-27 23:44:29,222][106225] Updated weights for policy 1, policy_version 627883 (0.0007) [2023-12-27 23:44:29,258][106226] Updated weights for policy 0, policy_version 625987 (0.0008) [2023-12-27 23:44:29,309][106226] Updated weights for policy 0, policy_version 625997 (0.0009) [2023-12-27 23:44:30,004][106225] Updated weights for policy 1, policy_version 627893 (0.0008) [2023-12-27 23:44:30,052][106225] Updated weights for policy 1, policy_version 627903 (0.0006) [2023-12-27 23:44:30,059][106226] Updated weights for policy 0, policy_version 626007 (0.0008) [2023-12-27 23:44:30,103][106225] Updated weights for policy 1, policy_version 627913 (0.0006) [2023-12-27 23:44:30,118][106226] Updated weights for policy 0, policy_version 626017 (0.0008) [2023-12-27 23:44:30,166][106226] Updated weights for policy 0, policy_version 626027 (0.0008) [2023-12-27 23:44:30,837][106225] Updated weights for policy 1, policy_version 627923 (0.0008) [2023-12-27 23:44:30,878][106226] Updated weights for policy 0, policy_version 626037 (0.0009) [2023-12-27 23:44:30,892][106225] Updated weights for policy 1, policy_version 627933 (0.0006) [2023-12-27 23:44:30,938][106226] Updated weights for policy 0, policy_version 626047 (0.0010) [2023-12-27 23:44:30,946][106225] Updated weights for policy 1, policy_version 627943 (0.0005) [2023-12-27 23:44:30,997][106226] Updated weights for policy 0, policy_version 626057 (0.0010) [2023-12-27 23:44:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 321093632. Throughput: 0: 10134.2, 1: 9937.6. Samples: 321079148. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:31,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-6.042')] [2023-12-27 23:44:31,613][106225] Updated weights for policy 1, policy_version 627953 (0.0006) [2023-12-27 23:44:31,681][106225] Updated weights for policy 1, policy_version 627963 (0.0008) [2023-12-27 23:44:31,741][106226] Updated weights for policy 0, policy_version 626067 (0.0010) [2023-12-27 23:44:31,749][106225] Updated weights for policy 1, policy_version 627973 (0.0009) [2023-12-27 23:44:31,806][106226] Updated weights for policy 0, policy_version 626077 (0.0011) [2023-12-27 23:44:31,810][106225] Updated weights for policy 1, policy_version 627983 (0.0010) [2023-12-27 23:44:31,853][106226] Updated weights for policy 0, policy_version 626087 (0.0010) [2023-12-27 23:44:32,401][106225] Updated weights for policy 1, policy_version 627993 (0.0010) [2023-12-27 23:44:32,449][106225] Updated weights for policy 1, policy_version 628003 (0.0010) [2023-12-27 23:44:32,493][106225] Updated weights for policy 1, policy_version 628013 (0.0010) [2023-12-27 23:44:32,602][106226] Updated weights for policy 0, policy_version 626097 (0.0010) [2023-12-27 23:44:32,665][106226] Updated weights for policy 0, policy_version 626107 (0.0010) [2023-12-27 23:44:32,738][106226] Updated weights for policy 0, policy_version 626117 (0.0011) [2023-12-27 23:44:32,798][106226] Updated weights for policy 0, policy_version 626127 (0.0008) [2023-12-27 23:44:33,227][106225] Updated weights for policy 1, policy_version 628023 (0.0010) [2023-12-27 23:44:33,283][106225] Updated weights for policy 1, policy_version 628033 (0.0010) [2023-12-27 23:44:33,337][106225] Updated weights for policy 1, policy_version 628043 (0.0010) [2023-12-27 23:44:33,358][106226] Updated weights for policy 0, policy_version 626137 (0.0005) [2023-12-27 23:44:33,419][106226] Updated weights for policy 0, policy_version 626147 (0.0008) [2023-12-27 23:44:33,475][106226] Updated weights for policy 0, policy_version 626157 (0.0007) [2023-12-27 23:44:34,055][106225] Updated weights for policy 1, policy_version 628053 (0.0010) [2023-12-27 23:44:34,110][106225] Updated weights for policy 1, policy_version 628063 (0.0010) [2023-12-27 23:44:34,163][106226] Updated weights for policy 0, policy_version 626167 (0.0009) [2023-12-27 23:44:34,177][106225] Updated weights for policy 1, policy_version 628073 (0.0009) [2023-12-27 23:44:34,225][106226] Updated weights for policy 0, policy_version 626177 (0.0009) [2023-12-27 23:44:34,286][106226] Updated weights for policy 0, policy_version 626187 (0.0008) [2023-12-27 23:44:34,890][106225] Updated weights for policy 1, policy_version 628083 (0.0010) [2023-12-27 23:44:34,954][106225] Updated weights for policy 1, policy_version 628093 (0.0010) [2023-12-27 23:44:34,982][106226] Updated weights for policy 0, policy_version 626197 (0.0007) [2023-12-27 23:44:35,016][106225] Updated weights for policy 1, policy_version 628103 (0.0011) [2023-12-27 23:44:35,041][106226] Updated weights for policy 0, policy_version 626207 (0.0005) [2023-12-27 23:44:35,092][106226] Updated weights for policy 0, policy_version 626217 (0.0006) [2023-12-27 23:44:35,607][106225] Updated weights for policy 1, policy_version 628113 (0.0010) [2023-12-27 23:44:35,651][106226] Updated weights for policy 0, policy_version 626227 (0.0007) [2023-12-27 23:44:35,661][106225] Updated weights for policy 1, policy_version 628123 (0.0010) [2023-12-27 23:44:35,703][106226] Updated weights for policy 0, policy_version 626237 (0.0006) [2023-12-27 23:44:35,717][106225] Updated weights for policy 1, policy_version 628133 (0.0008) [2023-12-27 23:44:35,768][106226] Updated weights for policy 0, policy_version 626247 (0.0008) [2023-12-27 23:44:35,771][106225] Updated weights for policy 1, policy_version 628143 (0.0006) [2023-12-27 23:44:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 321191936. Throughput: 0: 10151.2, 1: 9891.0. Samples: 321201212. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:36,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.850')] [2023-12-27 23:44:36,453][106226] Updated weights for policy 0, policy_version 626257 (0.0008) [2023-12-27 23:44:36,512][106226] Updated weights for policy 0, policy_version 626267 (0.0008) [2023-12-27 23:44:36,522][106225] Updated weights for policy 1, policy_version 628153 (0.0007) [2023-12-27 23:44:36,577][106226] Updated weights for policy 0, policy_version 626277 (0.0007) [2023-12-27 23:44:36,590][106225] Updated weights for policy 1, policy_version 628163 (0.0008) [2023-12-27 23:44:36,649][106226] Updated weights for policy 0, policy_version 626287 (0.0006) [2023-12-27 23:44:36,653][106225] Updated weights for policy 1, policy_version 628173 (0.0006) [2023-12-27 23:44:37,238][106225] Updated weights for policy 1, policy_version 628183 (0.0009) [2023-12-27 23:44:37,290][106225] Updated weights for policy 1, policy_version 628193 (0.0010) [2023-12-27 23:44:37,341][106225] Updated weights for policy 1, policy_version 628203 (0.0010) [2023-12-27 23:44:37,350][106226] Updated weights for policy 0, policy_version 626297 (0.0006) [2023-12-27 23:44:37,411][106226] Updated weights for policy 0, policy_version 626307 (0.0008) [2023-12-27 23:44:37,475][106226] Updated weights for policy 0, policy_version 626317 (0.0007) [2023-12-27 23:44:38,027][106225] Updated weights for policy 1, policy_version 628213 (0.0009) [2023-12-27 23:44:38,073][106226] Updated weights for policy 0, policy_version 626327 (0.0008) [2023-12-27 23:44:38,084][106225] Updated weights for policy 1, policy_version 628223 (0.0006) [2023-12-27 23:44:38,136][106226] Updated weights for policy 0, policy_version 626337 (0.0008) [2023-12-27 23:44:38,136][106225] Updated weights for policy 1, policy_version 628233 (0.0007) [2023-12-27 23:44:38,191][106226] Updated weights for policy 0, policy_version 626347 (0.0007) [2023-12-27 23:44:38,808][106225] Updated weights for policy 1, policy_version 628243 (0.0007) [2023-12-27 23:44:38,869][106225] Updated weights for policy 1, policy_version 628253 (0.0008) [2023-12-27 23:44:38,925][106225] Updated weights for policy 1, policy_version 628263 (0.0009) [2023-12-27 23:44:38,955][106226] Updated weights for policy 0, policy_version 626357 (0.0007) [2023-12-27 23:44:39,002][106226] Updated weights for policy 0, policy_version 626367 (0.0007) [2023-12-27 23:44:39,065][106226] Updated weights for policy 0, policy_version 626377 (0.0008) [2023-12-27 23:44:39,704][106225] Updated weights for policy 1, policy_version 628273 (0.0007) [2023-12-27 23:44:39,744][106226] Updated weights for policy 0, policy_version 626387 (0.0008) [2023-12-27 23:44:39,766][106225] Updated weights for policy 1, policy_version 628283 (0.0008) [2023-12-27 23:44:39,802][106226] Updated weights for policy 0, policy_version 626397 (0.0007) [2023-12-27 23:44:39,826][106225] Updated weights for policy 1, policy_version 628293 (0.0008) [2023-12-27 23:44:39,865][106226] Updated weights for policy 0, policy_version 626407 (0.0008) [2023-12-27 23:44:39,889][106225] Updated weights for policy 1, policy_version 628303 (0.0007) [2023-12-27 23:44:40,574][106225] Updated weights for policy 1, policy_version 628313 (0.0007) [2023-12-27 23:44:40,585][106226] Updated weights for policy 0, policy_version 626417 (0.0008) [2023-12-27 23:44:40,635][106225] Updated weights for policy 1, policy_version 628323 (0.0007) [2023-12-27 23:44:40,645][106226] Updated weights for policy 0, policy_version 626427 (0.0006) [2023-12-27 23:44:40,687][106225] Updated weights for policy 1, policy_version 628333 (0.0006) [2023-12-27 23:44:40,705][106226] Updated weights for policy 0, policy_version 626437 (0.0006) [2023-12-27 23:44:40,771][106226] Updated weights for policy 0, policy_version 626447 (0.0006) [2023-12-27 23:44:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 321290240. Throughput: 0: 10202.7, 1: 9904.7. Samples: 321261696. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:41,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-6.024')] [2023-12-27 23:44:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000628336_160882688.pth... [2023-12-27 23:44:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000626448_160407552.pth... [2023-12-27 23:44:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000627184_160587776.pth [2023-12-27 23:44:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000625296_160112640.pth [2023-12-27 23:44:41,425][106226] Updated weights for policy 0, policy_version 626457 (0.0008) [2023-12-27 23:44:41,489][106226] Updated weights for policy 0, policy_version 626467 (0.0008) [2023-12-27 23:44:41,496][106225] Updated weights for policy 1, policy_version 628343 (0.0006) [2023-12-27 23:44:41,552][106226] Updated weights for policy 0, policy_version 626477 (0.0009) [2023-12-27 23:44:41,560][106225] Updated weights for policy 1, policy_version 628353 (0.0008) [2023-12-27 23:44:41,625][106225] Updated weights for policy 1, policy_version 628363 (0.0008) [2023-12-27 23:44:42,208][106226] Updated weights for policy 0, policy_version 626487 (0.0008) [2023-12-27 23:44:42,270][106226] Updated weights for policy 0, policy_version 626497 (0.0008) [2023-12-27 23:44:42,297][106225] Updated weights for policy 1, policy_version 628373 (0.0008) [2023-12-27 23:44:42,336][106226] Updated weights for policy 0, policy_version 626507 (0.0009) [2023-12-27 23:44:42,368][106225] Updated weights for policy 1, policy_version 628383 (0.0007) [2023-12-27 23:44:42,429][106225] Updated weights for policy 1, policy_version 628393 (0.0009) [2023-12-27 23:44:43,077][106225] Updated weights for policy 1, policy_version 628403 (0.0007) [2023-12-27 23:44:43,136][106225] Updated weights for policy 1, policy_version 628413 (0.0008) [2023-12-27 23:44:43,162][106226] Updated weights for policy 0, policy_version 626517 (0.0008) [2023-12-27 23:44:43,192][106225] Updated weights for policy 1, policy_version 628423 (0.0006) [2023-12-27 23:44:43,221][106226] Updated weights for policy 0, policy_version 626527 (0.0006) [2023-12-27 23:44:43,280][106226] Updated weights for policy 0, policy_version 626537 (0.0006) [2023-12-27 23:44:43,852][106225] Updated weights for policy 1, policy_version 628433 (0.0006) [2023-12-27 23:44:43,900][106225] Updated weights for policy 1, policy_version 628443 (0.0008) [2023-12-27 23:44:43,947][106225] Updated weights for policy 1, policy_version 628453 (0.0008) [2023-12-27 23:44:43,995][106225] Updated weights for policy 1, policy_version 628463 (0.0008) [2023-12-27 23:44:44,021][106226] Updated weights for policy 0, policy_version 626547 (0.0008) [2023-12-27 23:44:44,065][106226] Updated weights for policy 0, policy_version 626557 (0.0008) [2023-12-27 23:44:44,130][106226] Updated weights for policy 0, policy_version 626567 (0.0008) [2023-12-27 23:44:44,771][106225] Updated weights for policy 1, policy_version 628473 (0.0007) [2023-12-27 23:44:44,834][106225] Updated weights for policy 1, policy_version 628483 (0.0008) [2023-12-27 23:44:44,883][106226] Updated weights for policy 0, policy_version 626577 (0.0008) [2023-12-27 23:44:44,896][106225] Updated weights for policy 1, policy_version 628493 (0.0009) [2023-12-27 23:44:44,947][106226] Updated weights for policy 0, policy_version 626587 (0.0008) [2023-12-27 23:44:45,010][106226] Updated weights for policy 0, policy_version 626597 (0.0008) [2023-12-27 23:44:45,073][106226] Updated weights for policy 0, policy_version 626607 (0.0005) [2023-12-27 23:44:45,663][106225] Updated weights for policy 1, policy_version 628503 (0.0008) [2023-12-27 23:44:45,730][106225] Updated weights for policy 1, policy_version 628513 (0.0007) [2023-12-27 23:44:45,733][106226] Updated weights for policy 0, policy_version 626617 (0.0007) [2023-12-27 23:44:45,786][106226] Updated weights for policy 0, policy_version 626627 (0.0008) [2023-12-27 23:44:45,792][106225] Updated weights for policy 1, policy_version 628523 (0.0005) [2023-12-27 23:44:45,836][106226] Updated weights for policy 0, policy_version 626637 (0.0008) [2023-12-27 23:44:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.5, 300 sec: 19883.0). Total num frames: 321388544. Throughput: 0: 10050.4, 1: 9903.9. Samples: 321378668. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:46,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-5.867')] [2023-12-27 23:44:46,468][106225] Updated weights for policy 1, policy_version 628533 (0.0008) [2023-12-27 23:44:46,515][106225] Updated weights for policy 1, policy_version 628543 (0.0010) [2023-12-27 23:44:46,577][106226] Updated weights for policy 0, policy_version 626647 (0.0007) [2023-12-27 23:44:46,579][106225] Updated weights for policy 1, policy_version 628553 (0.0010) [2023-12-27 23:44:46,636][106226] Updated weights for policy 0, policy_version 626657 (0.0007) [2023-12-27 23:44:46,688][106226] Updated weights for policy 0, policy_version 626667 (0.0008) [2023-12-27 23:44:47,232][106225] Updated weights for policy 1, policy_version 628563 (0.0009) [2023-12-27 23:44:47,287][106225] Updated weights for policy 1, policy_version 628573 (0.0005) [2023-12-27 23:44:47,323][106226] Updated weights for policy 0, policy_version 626677 (0.0006) [2023-12-27 23:44:47,332][106225] Updated weights for policy 1, policy_version 628583 (0.0005) [2023-12-27 23:44:47,379][106226] Updated weights for policy 0, policy_version 626687 (0.0006) [2023-12-27 23:44:47,431][106226] Updated weights for policy 0, policy_version 626697 (0.0009) [2023-12-27 23:44:48,006][106225] Updated weights for policy 1, policy_version 628593 (0.0006) [2023-12-27 23:44:48,069][106225] Updated weights for policy 1, policy_version 628603 (0.0010) [2023-12-27 23:44:48,121][106226] Updated weights for policy 0, policy_version 626707 (0.0007) [2023-12-27 23:44:48,127][106225] Updated weights for policy 1, policy_version 628613 (0.0010) [2023-12-27 23:44:48,176][106226] Updated weights for policy 0, policy_version 626717 (0.0006) [2023-12-27 23:44:48,185][106225] Updated weights for policy 1, policy_version 628623 (0.0011) [2023-12-27 23:44:48,236][106226] Updated weights for policy 0, policy_version 626727 (0.0007) [2023-12-27 23:44:48,912][106225] Updated weights for policy 1, policy_version 628633 (0.0008) [2023-12-27 23:44:48,977][106225] Updated weights for policy 1, policy_version 628643 (0.0010) [2023-12-27 23:44:48,998][106226] Updated weights for policy 0, policy_version 626737 (0.0007) [2023-12-27 23:44:49,032][106225] Updated weights for policy 1, policy_version 628653 (0.0010) [2023-12-27 23:44:49,048][106226] Updated weights for policy 0, policy_version 626747 (0.0005) [2023-12-27 23:44:49,098][106226] Updated weights for policy 0, policy_version 626757 (0.0005) [2023-12-27 23:44:49,149][106226] Updated weights for policy 0, policy_version 626767 (0.0008) [2023-12-27 23:44:49,801][106225] Updated weights for policy 1, policy_version 628663 (0.0007) [2023-12-27 23:44:49,867][106225] Updated weights for policy 1, policy_version 628673 (0.0010) [2023-12-27 23:44:49,931][106225] Updated weights for policy 1, policy_version 628683 (0.0010) [2023-12-27 23:44:49,938][106226] Updated weights for policy 0, policy_version 626777 (0.0010) [2023-12-27 23:44:50,001][106226] Updated weights for policy 0, policy_version 626787 (0.0010) [2023-12-27 23:44:50,065][106226] Updated weights for policy 0, policy_version 626797 (0.0010) [2023-12-27 23:44:50,627][106225] Updated weights for policy 1, policy_version 628693 (0.0009) [2023-12-27 23:44:50,685][106225] Updated weights for policy 1, policy_version 628703 (0.0009) [2023-12-27 23:44:50,744][106225] Updated weights for policy 1, policy_version 628713 (0.0008) [2023-12-27 23:44:50,776][106226] Updated weights for policy 0, policy_version 626807 (0.0007) [2023-12-27 23:44:50,842][106226] Updated weights for policy 0, policy_version 626817 (0.0007) [2023-12-27 23:44:50,903][106226] Updated weights for policy 0, policy_version 626827 (0.0006) [2023-12-27 23:44:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 321486848. Throughput: 0: 9922.1, 1: 9880.5. Samples: 321495776. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:51,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-5.813')] [2023-12-27 23:44:51,529][106226] Updated weights for policy 0, policy_version 626837 (0.0007) [2023-12-27 23:44:51,539][106225] Updated weights for policy 1, policy_version 628723 (0.0008) [2023-12-27 23:44:51,578][106226] Updated weights for policy 0, policy_version 626847 (0.0008) [2023-12-27 23:44:51,604][106225] Updated weights for policy 1, policy_version 628733 (0.0006) [2023-12-27 23:44:51,646][106226] Updated weights for policy 0, policy_version 626857 (0.0008) [2023-12-27 23:44:51,674][106225] Updated weights for policy 1, policy_version 628743 (0.0009) [2023-12-27 23:44:52,371][106225] Updated weights for policy 1, policy_version 628753 (0.0008) [2023-12-27 23:44:52,392][106226] Updated weights for policy 0, policy_version 626867 (0.0010) [2023-12-27 23:44:52,433][106225] Updated weights for policy 1, policy_version 628763 (0.0007) [2023-12-27 23:44:52,454][106226] Updated weights for policy 0, policy_version 626877 (0.0008) [2023-12-27 23:44:52,492][106225] Updated weights for policy 1, policy_version 628773 (0.0006) [2023-12-27 23:44:52,511][106226] Updated weights for policy 0, policy_version 626887 (0.0006) [2023-12-27 23:44:52,553][106225] Updated weights for policy 1, policy_version 628783 (0.0008) [2023-12-27 23:44:53,156][106226] Updated weights for policy 0, policy_version 626897 (0.0006) [2023-12-27 23:44:53,163][106225] Updated weights for policy 1, policy_version 628793 (0.0006) [2023-12-27 23:44:53,217][106226] Updated weights for policy 0, policy_version 626907 (0.0005) [2023-12-27 23:44:53,218][106225] Updated weights for policy 1, policy_version 628803 (0.0008) [2023-12-27 23:44:53,267][106226] Updated weights for policy 0, policy_version 626917 (0.0005) [2023-12-27 23:44:53,270][106225] Updated weights for policy 1, policy_version 628813 (0.0008) [2023-12-27 23:44:53,317][106226] Updated weights for policy 0, policy_version 626927 (0.0005) [2023-12-27 23:44:53,920][106225] Updated weights for policy 1, policy_version 628823 (0.0008) [2023-12-27 23:44:53,981][106225] Updated weights for policy 1, policy_version 628833 (0.0008) [2023-12-27 23:44:54,035][106226] Updated weights for policy 0, policy_version 626937 (0.0005) [2023-12-27 23:44:54,041][106225] Updated weights for policy 1, policy_version 628843 (0.0008) [2023-12-27 23:44:54,085][106226] Updated weights for policy 0, policy_version 626947 (0.0007) [2023-12-27 23:44:54,135][106226] Updated weights for policy 0, policy_version 626957 (0.0009) [2023-12-27 23:44:54,712][106225] Updated weights for policy 1, policy_version 628853 (0.0007) [2023-12-27 23:44:54,759][106225] Updated weights for policy 1, policy_version 628863 (0.0008) [2023-12-27 23:44:54,812][106225] Updated weights for policy 1, policy_version 628873 (0.0007) [2023-12-27 23:44:54,907][106226] Updated weights for policy 0, policy_version 626967 (0.0007) [2023-12-27 23:44:54,969][106226] Updated weights for policy 0, policy_version 626977 (0.0010) [2023-12-27 23:44:55,040][106226] Updated weights for policy 0, policy_version 626987 (0.0008) [2023-12-27 23:44:55,608][106226] Updated weights for policy 0, policy_version 626997 (0.0008) [2023-12-27 23:44:55,611][106225] Updated weights for policy 1, policy_version 628883 (0.0007) [2023-12-27 23:44:55,676][106225] Updated weights for policy 1, policy_version 628893 (0.0007) [2023-12-27 23:44:55,677][106226] Updated weights for policy 0, policy_version 627007 (0.0008) [2023-12-27 23:44:55,732][106225] Updated weights for policy 1, policy_version 628903 (0.0008) [2023-12-27 23:44:55,735][106226] Updated weights for policy 0, policy_version 627017 (0.0009) [2023-12-27 23:44:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 321585152. Throughput: 0: 9880.8, 1: 9850.8. Samples: 321555056. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:44:56,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-5.982')] [2023-12-27 23:44:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000627024_160555008.pth... [2023-12-27 23:44:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000628912_161030144.pth... [2023-12-27 23:44:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000625872_160260096.pth [2023-12-27 23:44:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000627760_160735232.pth [2023-12-27 23:44:56,392][106226] Updated weights for policy 0, policy_version 627027 (0.0005) [2023-12-27 23:44:56,443][106226] Updated weights for policy 0, policy_version 627037 (0.0005) [2023-12-27 23:44:56,460][106225] Updated weights for policy 1, policy_version 628913 (0.0008) [2023-12-27 23:44:56,497][106226] Updated weights for policy 0, policy_version 627047 (0.0006) [2023-12-27 23:44:56,518][106225] Updated weights for policy 1, policy_version 628923 (0.0007) [2023-12-27 23:44:56,569][106225] Updated weights for policy 1, policy_version 628933 (0.0006) [2023-12-27 23:44:56,628][106225] Updated weights for policy 1, policy_version 628943 (0.0008) [2023-12-27 23:44:57,165][106226] Updated weights for policy 0, policy_version 627057 (0.0010) [2023-12-27 23:44:57,237][106226] Updated weights for policy 0, policy_version 627067 (0.0006) [2023-12-27 23:44:57,295][106226] Updated weights for policy 0, policy_version 627077 (0.0010) [2023-12-27 23:44:57,302][106225] Updated weights for policy 1, policy_version 628953 (0.0007) [2023-12-27 23:44:57,354][106226] Updated weights for policy 0, policy_version 627087 (0.0010) [2023-12-27 23:44:57,364][106225] Updated weights for policy 1, policy_version 628963 (0.0006) [2023-12-27 23:44:57,410][106225] Updated weights for policy 1, policy_version 628973 (0.0005) [2023-12-27 23:44:57,930][106226] Updated weights for policy 0, policy_version 627097 (0.0010) [2023-12-27 23:44:57,986][106226] Updated weights for policy 0, policy_version 627107 (0.0010) [2023-12-27 23:44:58,041][106226] Updated weights for policy 0, policy_version 627117 (0.0010) [2023-12-27 23:44:58,127][106225] Updated weights for policy 1, policy_version 628983 (0.0007) [2023-12-27 23:44:58,186][106225] Updated weights for policy 1, policy_version 628993 (0.0007) [2023-12-27 23:44:58,252][106225] Updated weights for policy 1, policy_version 629003 (0.0009) [2023-12-27 23:44:58,862][106226] Updated weights for policy 0, policy_version 627127 (0.0009) [2023-12-27 23:44:58,931][106226] Updated weights for policy 0, policy_version 627137 (0.0008) [2023-12-27 23:44:58,995][106226] Updated weights for policy 0, policy_version 627147 (0.0008) [2023-12-27 23:44:59,052][106225] Updated weights for policy 1, policy_version 629013 (0.0009) [2023-12-27 23:44:59,121][106225] Updated weights for policy 1, policy_version 629023 (0.0008) [2023-12-27 23:44:59,188][106225] Updated weights for policy 1, policy_version 629033 (0.0008) [2023-12-27 23:44:59,694][106226] Updated weights for policy 0, policy_version 627157 (0.0008) [2023-12-27 23:44:59,748][106226] Updated weights for policy 0, policy_version 627167 (0.0008) [2023-12-27 23:44:59,796][106226] Updated weights for policy 0, policy_version 627177 (0.0008) [2023-12-27 23:44:59,971][106225] Updated weights for policy 1, policy_version 629043 (0.0009) [2023-12-27 23:45:00,033][106225] Updated weights for policy 1, policy_version 629053 (0.0008) [2023-12-27 23:45:00,086][106225] Updated weights for policy 1, policy_version 629063 (0.0007) [2023-12-27 23:45:00,464][106226] Updated weights for policy 0, policy_version 627187 (0.0007) [2023-12-27 23:45:00,516][106226] Updated weights for policy 0, policy_version 627197 (0.0005) [2023-12-27 23:45:00,570][106226] Updated weights for policy 0, policy_version 627207 (0.0007) [2023-12-27 23:45:00,858][106225] Updated weights for policy 1, policy_version 629073 (0.0009) [2023-12-27 23:45:00,912][106225] Updated weights for policy 1, policy_version 629083 (0.0006) [2023-12-27 23:45:00,966][106225] Updated weights for policy 1, policy_version 629093 (0.0010) [2023-12-27 23:45:01,030][106225] Updated weights for policy 1, policy_version 629103 (0.0010) [2023-12-27 23:45:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 321683456. Throughput: 0: 9860.8, 1: 9852.6. Samples: 321672364. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:45:01,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-6.071')] [2023-12-27 23:45:01,316][106226] Updated weights for policy 0, policy_version 627217 (0.0008) [2023-12-27 23:45:01,388][106226] Updated weights for policy 0, policy_version 627227 (0.0008) [2023-12-27 23:45:01,442][106226] Updated weights for policy 0, policy_version 627237 (0.0008) [2023-12-27 23:45:01,505][106226] Updated weights for policy 0, policy_version 627247 (0.0010) [2023-12-27 23:45:01,770][106225] Updated weights for policy 1, policy_version 629113 (0.0008) [2023-12-27 23:45:01,821][106225] Updated weights for policy 1, policy_version 629123 (0.0008) [2023-12-27 23:45:01,875][106225] Updated weights for policy 1, policy_version 629133 (0.0007) [2023-12-27 23:45:02,215][106226] Updated weights for policy 0, policy_version 627257 (0.0011) [2023-12-27 23:45:02,270][106226] Updated weights for policy 0, policy_version 627267 (0.0012) [2023-12-27 23:45:02,335][106226] Updated weights for policy 0, policy_version 627277 (0.0010) [2023-12-27 23:45:02,650][106225] Updated weights for policy 1, policy_version 629143 (0.0008) [2023-12-27 23:45:02,717][106225] Updated weights for policy 1, policy_version 629153 (0.0007) [2023-12-27 23:45:02,778][106225] Updated weights for policy 1, policy_version 629163 (0.0008) [2023-12-27 23:45:03,028][106226] Updated weights for policy 0, policy_version 627287 (0.0008) [2023-12-27 23:45:03,085][106226] Updated weights for policy 0, policy_version 627297 (0.0009) [2023-12-27 23:45:03,140][106226] Updated weights for policy 0, policy_version 627307 (0.0006) [2023-12-27 23:45:03,510][106225] Updated weights for policy 1, policy_version 629173 (0.0009) [2023-12-27 23:45:03,575][106225] Updated weights for policy 1, policy_version 629183 (0.0008) [2023-12-27 23:45:03,631][106225] Updated weights for policy 1, policy_version 629193 (0.0007) [2023-12-27 23:45:03,824][106226] Updated weights for policy 0, policy_version 627317 (0.0008) [2023-12-27 23:45:03,886][106226] Updated weights for policy 0, policy_version 627327 (0.0009) [2023-12-27 23:45:03,953][106226] Updated weights for policy 0, policy_version 627337 (0.0009) [2023-12-27 23:45:04,370][106225] Updated weights for policy 1, policy_version 629203 (0.0008) [2023-12-27 23:45:04,432][106225] Updated weights for policy 1, policy_version 629213 (0.0008) [2023-12-27 23:45:04,491][106225] Updated weights for policy 1, policy_version 629223 (0.0007) [2023-12-27 23:45:04,706][106226] Updated weights for policy 0, policy_version 627347 (0.0010) [2023-12-27 23:45:04,768][106226] Updated weights for policy 0, policy_version 627357 (0.0011) [2023-12-27 23:45:04,831][106226] Updated weights for policy 0, policy_version 627367 (0.0011) [2023-12-27 23:45:05,249][106225] Updated weights for policy 1, policy_version 629233 (0.0007) [2023-12-27 23:45:05,310][106225] Updated weights for policy 1, policy_version 629243 (0.0009) [2023-12-27 23:45:05,370][106225] Updated weights for policy 1, policy_version 629253 (0.0009) [2023-12-27 23:45:05,385][106226] Updated weights for policy 0, policy_version 627377 (0.0010) [2023-12-27 23:45:05,423][106225] Updated weights for policy 1, policy_version 629263 (0.0008) [2023-12-27 23:45:05,439][106226] Updated weights for policy 0, policy_version 627387 (0.0005) [2023-12-27 23:45:05,495][106226] Updated weights for policy 0, policy_version 627397 (0.0008) [2023-12-27 23:45:05,544][106226] Updated weights for policy 0, policy_version 627407 (0.0008) [2023-12-27 23:45:06,142][106226] Updated weights for policy 0, policy_version 627417 (0.0008) [2023-12-27 23:45:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 321773568. Throughput: 0: 9950.5, 1: 9811.2. Samples: 321790320. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:45:06,175][105115] Avg episode reward: [(0, '-4.786'), (1, '-6.303')] [2023-12-27 23:45:06,211][106226] Updated weights for policy 0, policy_version 627427 (0.0010) [2023-12-27 23:45:06,212][106225] Updated weights for policy 1, policy_version 629273 (0.0006) [2023-12-27 23:45:06,272][106225] Updated weights for policy 1, policy_version 629283 (0.0006) [2023-12-27 23:45:06,276][106226] Updated weights for policy 0, policy_version 627437 (0.0007) [2023-12-27 23:45:06,339][106225] Updated weights for policy 1, policy_version 629293 (0.0006) [2023-12-27 23:45:06,871][106226] Updated weights for policy 0, policy_version 627447 (0.0009) [2023-12-27 23:45:06,924][106225] Updated weights for policy 1, policy_version 629303 (0.0008) [2023-12-27 23:45:06,927][106226] Updated weights for policy 0, policy_version 627457 (0.0011) [2023-12-27 23:45:06,976][106225] Updated weights for policy 1, policy_version 629313 (0.0006) [2023-12-27 23:45:06,981][106226] Updated weights for policy 0, policy_version 627467 (0.0011) [2023-12-27 23:45:07,037][106225] Updated weights for policy 1, policy_version 629323 (0.0005) [2023-12-27 23:45:07,593][106225] Updated weights for policy 1, policy_version 629333 (0.0006) [2023-12-27 23:45:07,653][106225] Updated weights for policy 1, policy_version 629343 (0.0007) [2023-12-27 23:45:07,704][106226] Updated weights for policy 0, policy_version 627477 (0.0011) [2023-12-27 23:45:07,716][106225] Updated weights for policy 1, policy_version 629353 (0.0007) [2023-12-27 23:45:07,773][106226] Updated weights for policy 0, policy_version 627487 (0.0010) [2023-12-27 23:45:07,842][106226] Updated weights for policy 0, policy_version 627497 (0.0011) [2023-12-27 23:45:08,261][106225] Updated weights for policy 1, policy_version 629363 (0.0006) [2023-12-27 23:45:08,315][106225] Updated weights for policy 1, policy_version 629373 (0.0005) [2023-12-27 23:45:08,380][106225] Updated weights for policy 1, policy_version 629383 (0.0007) [2023-12-27 23:45:08,500][106226] Updated weights for policy 0, policy_version 627507 (0.0009) [2023-12-27 23:45:08,563][106226] Updated weights for policy 0, policy_version 627517 (0.0005) [2023-12-27 23:45:08,623][106226] Updated weights for policy 0, policy_version 627527 (0.0006) [2023-12-27 23:45:09,074][106225] Updated weights for policy 1, policy_version 629393 (0.0006) [2023-12-27 23:45:09,131][106225] Updated weights for policy 1, policy_version 629403 (0.0008) [2023-12-27 23:45:09,190][106225] Updated weights for policy 1, policy_version 629413 (0.0008) [2023-12-27 23:45:09,246][106225] Updated weights for policy 1, policy_version 629423 (0.0007) [2023-12-27 23:45:09,275][106226] Updated weights for policy 0, policy_version 627537 (0.0006) [2023-12-27 23:45:09,340][106226] Updated weights for policy 0, policy_version 627547 (0.0011) [2023-12-27 23:45:09,409][106226] Updated weights for policy 0, policy_version 627557 (0.0011) [2023-12-27 23:45:09,471][106226] Updated weights for policy 0, policy_version 627567 (0.0011) [2023-12-27 23:45:10,044][106225] Updated weights for policy 1, policy_version 629433 (0.0007) [2023-12-27 23:45:10,110][106225] Updated weights for policy 1, policy_version 629443 (0.0008) [2023-12-27 23:45:10,161][106225] Updated weights for policy 1, policy_version 629453 (0.0008) [2023-12-27 23:45:10,243][106226] Updated weights for policy 0, policy_version 627577 (0.0011) [2023-12-27 23:45:10,309][106226] Updated weights for policy 0, policy_version 627587 (0.0011) [2023-12-27 23:45:10,374][106226] Updated weights for policy 0, policy_version 627597 (0.0011) [2023-12-27 23:45:10,863][106225] Updated weights for policy 1, policy_version 629463 (0.0009) [2023-12-27 23:45:10,919][106225] Updated weights for policy 1, policy_version 629473 (0.0008) [2023-12-27 23:45:10,980][106225] Updated weights for policy 1, policy_version 629483 (0.0008) [2023-12-27 23:45:11,043][106226] Updated weights for policy 0, policy_version 627607 (0.0010) [2023-12-27 23:45:11,108][106226] Updated weights for policy 0, policy_version 627617 (0.0008) [2023-12-27 23:45:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 321880064. Throughput: 0: 10024.1, 1: 9917.4. Samples: 321854240. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-27 23:45:11,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.837')] [2023-12-27 23:45:11,178][106226] Updated weights for policy 0, policy_version 627627 (0.0009) [2023-12-27 23:45:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000629488_161177600.pth... [2023-12-27 23:45:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000628336_160882688.pth [2023-12-27 23:45:11,210][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000627632_160710656.pth... [2023-12-27 23:45:11,215][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000626448_160407552.pth [2023-12-27 23:45:11,792][106225] Updated weights for policy 1, policy_version 629493 (0.0008) [2023-12-27 23:45:11,851][106225] Updated weights for policy 1, policy_version 629503 (0.0008) [2023-12-27 23:45:11,908][106225] Updated weights for policy 1, policy_version 629513 (0.0008) [2023-12-27 23:45:11,947][106226] Updated weights for policy 0, policy_version 627637 (0.0009) [2023-12-27 23:45:12,007][106226] Updated weights for policy 0, policy_version 627647 (0.0008) [2023-12-27 23:45:12,067][106226] Updated weights for policy 0, policy_version 627657 (0.0008) [2023-12-27 23:45:12,652][106225] Updated weights for policy 1, policy_version 629523 (0.0007) [2023-12-27 23:45:12,718][106225] Updated weights for policy 1, policy_version 629533 (0.0008) [2023-12-27 23:45:12,768][106225] Updated weights for policy 1, policy_version 629543 (0.0008) [2023-12-27 23:45:12,820][106226] Updated weights for policy 0, policy_version 627667 (0.0007) [2023-12-27 23:45:12,879][106226] Updated weights for policy 0, policy_version 627677 (0.0005) [2023-12-27 23:45:12,934][106226] Updated weights for policy 0, policy_version 627687 (0.0005) [2023-12-27 23:45:13,394][106225] Updated weights for policy 1, policy_version 629553 (0.0008) [2023-12-27 23:45:13,451][106225] Updated weights for policy 1, policy_version 629563 (0.0009) [2023-12-27 23:45:13,507][106225] Updated weights for policy 1, policy_version 629573 (0.0010) [2023-12-27 23:45:13,557][106226] Updated weights for policy 0, policy_version 627697 (0.0006) [2023-12-27 23:45:13,560][106225] Updated weights for policy 1, policy_version 629583 (0.0010) [2023-12-27 23:45:13,615][106226] Updated weights for policy 0, policy_version 627707 (0.0009) [2023-12-27 23:45:13,669][106226] Updated weights for policy 0, policy_version 627717 (0.0010) [2023-12-27 23:45:13,729][106226] Updated weights for policy 0, policy_version 627727 (0.0010) [2023-12-27 23:45:14,206][106225] Updated weights for policy 1, policy_version 629593 (0.0010) [2023-12-27 23:45:14,269][106225] Updated weights for policy 1, policy_version 629603 (0.0010) [2023-12-27 23:45:14,330][106225] Updated weights for policy 1, policy_version 629613 (0.0010) [2023-12-27 23:45:14,453][106226] Updated weights for policy 0, policy_version 627737 (0.0011) [2023-12-27 23:45:14,511][106226] Updated weights for policy 0, policy_version 627747 (0.0007) [2023-12-27 23:45:14,572][106226] Updated weights for policy 0, policy_version 627757 (0.0005) [2023-12-27 23:45:15,072][106225] Updated weights for policy 1, policy_version 629623 (0.0008) [2023-12-27 23:45:15,122][106225] Updated weights for policy 1, policy_version 629633 (0.0005) [2023-12-27 23:45:15,185][106225] Updated weights for policy 1, policy_version 629643 (0.0007) [2023-12-27 23:45:15,205][106226] Updated weights for policy 0, policy_version 627767 (0.0009) [2023-12-27 23:45:15,265][106226] Updated weights for policy 0, policy_version 627777 (0.0008) [2023-12-27 23:45:15,331][106226] Updated weights for policy 0, policy_version 627787 (0.0008) [2023-12-27 23:45:15,825][106225] Updated weights for policy 1, policy_version 629653 (0.0007) [2023-12-27 23:45:15,884][106225] Updated weights for policy 1, policy_version 629663 (0.0009) [2023-12-27 23:45:15,930][106225] Updated weights for policy 1, policy_version 629673 (0.0010) [2023-12-27 23:45:15,995][106226] Updated weights for policy 0, policy_version 627797 (0.0010) [2023-12-27 23:45:16,054][106226] Updated weights for policy 0, policy_version 627807 (0.0007) [2023-12-27 23:45:16,118][106226] Updated weights for policy 0, policy_version 627817 (0.0005) [2023-12-27 23:45:16,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 321986560. Throughput: 0: 9973.7, 1: 9820.6. Samples: 321969888. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:16,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-5.928')] [2023-12-27 23:45:16,573][106225] Updated weights for policy 1, policy_version 629683 (0.0009) [2023-12-27 23:45:16,627][106225] Updated weights for policy 1, policy_version 629693 (0.0008) [2023-12-27 23:45:16,681][106225] Updated weights for policy 1, policy_version 629703 (0.0009) [2023-12-27 23:45:16,739][106226] Updated weights for policy 0, policy_version 627827 (0.0006) [2023-12-27 23:45:16,786][106226] Updated weights for policy 0, policy_version 627837 (0.0010) [2023-12-27 23:45:16,852][106226] Updated weights for policy 0, policy_version 627847 (0.0010) [2023-12-27 23:45:17,338][106225] Updated weights for policy 1, policy_version 629713 (0.0010) [2023-12-27 23:45:17,388][106225] Updated weights for policy 1, policy_version 629723 (0.0008) [2023-12-27 23:45:17,434][106225] Updated weights for policy 1, policy_version 629733 (0.0007) [2023-12-27 23:45:17,493][106225] Updated weights for policy 1, policy_version 629743 (0.0008) [2023-12-27 23:45:17,545][106226] Updated weights for policy 0, policy_version 627857 (0.0010) [2023-12-27 23:45:17,606][106226] Updated weights for policy 0, policy_version 627867 (0.0010) [2023-12-27 23:45:17,662][106226] Updated weights for policy 0, policy_version 627877 (0.0010) [2023-12-27 23:45:17,723][106226] Updated weights for policy 0, policy_version 627887 (0.0011) [2023-12-27 23:45:18,155][106225] Updated weights for policy 1, policy_version 629753 (0.0007) [2023-12-27 23:45:18,203][106225] Updated weights for policy 1, policy_version 629763 (0.0008) [2023-12-27 23:45:18,257][106225] Updated weights for policy 1, policy_version 629773 (0.0008) [2023-12-27 23:45:18,349][106226] Updated weights for policy 0, policy_version 627897 (0.0011) [2023-12-27 23:45:18,414][106226] Updated weights for policy 0, policy_version 627907 (0.0008) [2023-12-27 23:45:18,483][106226] Updated weights for policy 0, policy_version 627917 (0.0007) [2023-12-27 23:45:18,899][106225] Updated weights for policy 1, policy_version 629783 (0.0009) [2023-12-27 23:45:18,964][106225] Updated weights for policy 1, policy_version 629793 (0.0009) [2023-12-27 23:45:19,018][106225] Updated weights for policy 1, policy_version 629803 (0.0008) [2023-12-27 23:45:19,089][106226] Updated weights for policy 0, policy_version 627927 (0.0006) [2023-12-27 23:45:19,151][106226] Updated weights for policy 0, policy_version 627937 (0.0007) [2023-12-27 23:45:19,206][106226] Updated weights for policy 0, policy_version 627947 (0.0008) [2023-12-27 23:45:19,823][106225] Updated weights for policy 1, policy_version 629813 (0.0009) [2023-12-27 23:45:19,892][106225] Updated weights for policy 1, policy_version 629823 (0.0009) [2023-12-27 23:45:19,961][106225] Updated weights for policy 1, policy_version 629833 (0.0008) [2023-12-27 23:45:19,991][106226] Updated weights for policy 0, policy_version 627957 (0.0007) [2023-12-27 23:45:20,056][106226] Updated weights for policy 0, policy_version 627967 (0.0008) [2023-12-27 23:45:20,116][106226] Updated weights for policy 0, policy_version 627977 (0.0008) [2023-12-27 23:45:20,728][106225] Updated weights for policy 1, policy_version 629843 (0.0009) [2023-12-27 23:45:20,788][106225] Updated weights for policy 1, policy_version 629853 (0.0008) [2023-12-27 23:45:20,847][106225] Updated weights for policy 1, policy_version 629863 (0.0008) [2023-12-27 23:45:20,866][106226] Updated weights for policy 0, policy_version 627987 (0.0008) [2023-12-27 23:45:20,929][106226] Updated weights for policy 0, policy_version 627997 (0.0007) [2023-12-27 23:45:20,988][106226] Updated weights for policy 0, policy_version 628007 (0.0009) [2023-12-27 23:45:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 322084864. Throughput: 0: 9948.5, 1: 9809.0. Samples: 322090296. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:21,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.680')] [2023-12-27 23:45:21,621][106225] Updated weights for policy 1, policy_version 629873 (0.0008) [2023-12-27 23:45:21,686][106225] Updated weights for policy 1, policy_version 629883 (0.0008) [2023-12-27 23:45:21,761][106225] Updated weights for policy 1, policy_version 629893 (0.0008) [2023-12-27 23:45:21,793][106226] Updated weights for policy 0, policy_version 628017 (0.0009) [2023-12-27 23:45:21,824][106225] Updated weights for policy 1, policy_version 629903 (0.0006) [2023-12-27 23:45:21,850][106226] Updated weights for policy 0, policy_version 628027 (0.0007) [2023-12-27 23:45:21,913][106226] Updated weights for policy 0, policy_version 628037 (0.0008) [2023-12-27 23:45:21,976][106226] Updated weights for policy 0, policy_version 628047 (0.0008) [2023-12-27 23:45:22,520][106225] Updated weights for policy 1, policy_version 629913 (0.0008) [2023-12-27 23:45:22,583][106225] Updated weights for policy 1, policy_version 629923 (0.0009) [2023-12-27 23:45:22,652][106225] Updated weights for policy 1, policy_version 629933 (0.0008) [2023-12-27 23:45:22,722][106226] Updated weights for policy 0, policy_version 628057 (0.0010) [2023-12-27 23:45:22,792][106226] Updated weights for policy 0, policy_version 628067 (0.0009) [2023-12-27 23:45:22,855][106226] Updated weights for policy 0, policy_version 628077 (0.0010) [2023-12-27 23:45:23,238][106225] Updated weights for policy 1, policy_version 629943 (0.0008) [2023-12-27 23:45:23,292][106225] Updated weights for policy 1, policy_version 629953 (0.0008) [2023-12-27 23:45:23,347][106225] Updated weights for policy 1, policy_version 629963 (0.0009) [2023-12-27 23:45:23,642][106226] Updated weights for policy 0, policy_version 628087 (0.0008) [2023-12-27 23:45:23,695][106226] Updated weights for policy 0, policy_version 628097 (0.0006) [2023-12-27 23:45:23,755][106226] Updated weights for policy 0, policy_version 628107 (0.0010) [2023-12-27 23:45:23,984][106225] Updated weights for policy 1, policy_version 629973 (0.0008) [2023-12-27 23:45:24,046][106225] Updated weights for policy 1, policy_version 629983 (0.0008) [2023-12-27 23:45:24,105][106225] Updated weights for policy 1, policy_version 629993 (0.0010) [2023-12-27 23:45:24,415][106226] Updated weights for policy 0, policy_version 628117 (0.0007) [2023-12-27 23:45:24,468][106226] Updated weights for policy 0, policy_version 628127 (0.0009) [2023-12-27 23:45:24,519][106226] Updated weights for policy 0, policy_version 628137 (0.0010) [2023-12-27 23:45:24,773][106225] Updated weights for policy 1, policy_version 630003 (0.0010) [2023-12-27 23:45:24,824][106225] Updated weights for policy 1, policy_version 630013 (0.0010) [2023-12-27 23:45:24,880][106225] Updated weights for policy 1, policy_version 630023 (0.0010) [2023-12-27 23:45:25,233][106226] Updated weights for policy 0, policy_version 628147 (0.0010) [2023-12-27 23:45:25,282][106226] Updated weights for policy 0, policy_version 628157 (0.0010) [2023-12-27 23:45:25,332][106226] Updated weights for policy 0, policy_version 628167 (0.0010) [2023-12-27 23:45:25,471][106225] Updated weights for policy 1, policy_version 630033 (0.0010) [2023-12-27 23:45:25,524][106225] Updated weights for policy 1, policy_version 630043 (0.0005) [2023-12-27 23:45:25,583][106225] Updated weights for policy 1, policy_version 630053 (0.0005) [2023-12-27 23:45:25,647][106225] Updated weights for policy 1, policy_version 630063 (0.0008) [2023-12-27 23:45:26,068][106226] Updated weights for policy 0, policy_version 628177 (0.0010) [2023-12-27 23:45:26,131][106226] Updated weights for policy 0, policy_version 628187 (0.0010) [2023-12-27 23:45:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 322174976. Throughput: 0: 9912.3, 1: 9778.6. Samples: 322147788. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:26,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-6.152')] [2023-12-27 23:45:26,184][106226] Updated weights for policy 0, policy_version 628197 (0.0008) [2023-12-27 23:45:26,238][106225] Updated weights for policy 1, policy_version 630073 (0.0007) [2023-12-27 23:45:26,246][106226] Updated weights for policy 0, policy_version 628207 (0.0008) [2023-12-27 23:45:26,250][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000628208_160858112.pth... [2023-12-27 23:45:26,254][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000627024_160555008.pth [2023-12-27 23:45:26,293][106225] Updated weights for policy 1, policy_version 630083 (0.0005) [2023-12-27 23:45:26,348][106225] Updated weights for policy 1, policy_version 630093 (0.0006) [2023-12-27 23:45:26,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000630096_161333248.pth... [2023-12-27 23:45:26,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000628912_161030144.pth [2023-12-27 23:45:26,933][106225] Updated weights for policy 1, policy_version 630103 (0.0007) [2023-12-27 23:45:26,993][106225] Updated weights for policy 1, policy_version 630113 (0.0010) [2023-12-27 23:45:27,005][106226] Updated weights for policy 0, policy_version 628217 (0.0005) [2023-12-27 23:45:27,048][106225] Updated weights for policy 1, policy_version 630123 (0.0008) [2023-12-27 23:45:27,062][106226] Updated weights for policy 0, policy_version 628227 (0.0006) [2023-12-27 23:45:27,128][106226] Updated weights for policy 0, policy_version 628237 (0.0006) [2023-12-27 23:45:27,624][106225] Updated weights for policy 1, policy_version 630133 (0.0005) [2023-12-27 23:45:27,674][106225] Updated weights for policy 1, policy_version 630143 (0.0006) [2023-12-27 23:45:27,734][106225] Updated weights for policy 1, policy_version 630153 (0.0006) [2023-12-27 23:45:27,737][106226] Updated weights for policy 0, policy_version 628247 (0.0005) [2023-12-27 23:45:27,804][106226] Updated weights for policy 0, policy_version 628257 (0.0005) [2023-12-27 23:45:27,862][106226] Updated weights for policy 0, policy_version 628267 (0.0006) [2023-12-27 23:45:28,309][106225] Updated weights for policy 1, policy_version 630163 (0.0006) [2023-12-27 23:45:28,374][106225] Updated weights for policy 1, policy_version 630173 (0.0008) [2023-12-27 23:45:28,433][106225] Updated weights for policy 1, policy_version 630183 (0.0008) [2023-12-27 23:45:28,467][106226] Updated weights for policy 0, policy_version 628277 (0.0008) [2023-12-27 23:45:28,520][106226] Updated weights for policy 0, policy_version 628287 (0.0010) [2023-12-27 23:45:28,582][106226] Updated weights for policy 0, policy_version 628297 (0.0008) [2023-12-27 23:45:29,026][106225] Updated weights for policy 1, policy_version 630193 (0.0006) [2023-12-27 23:45:29,080][106225] Updated weights for policy 1, policy_version 630203 (0.0008) [2023-12-27 23:45:29,137][106225] Updated weights for policy 1, policy_version 630213 (0.0007) [2023-12-27 23:45:29,188][106225] Updated weights for policy 1, policy_version 630223 (0.0007) [2023-12-27 23:45:29,292][106226] Updated weights for policy 0, policy_version 628307 (0.0010) [2023-12-27 23:45:29,362][106226] Updated weights for policy 0, policy_version 628317 (0.0010) [2023-12-27 23:45:29,427][106226] Updated weights for policy 0, policy_version 628327 (0.0009) [2023-12-27 23:45:29,883][106225] Updated weights for policy 1, policy_version 630233 (0.0008) [2023-12-27 23:45:29,935][106225] Updated weights for policy 1, policy_version 630243 (0.0007) [2023-12-27 23:45:29,996][106225] Updated weights for policy 1, policy_version 630253 (0.0007) [2023-12-27 23:45:30,199][106226] Updated weights for policy 0, policy_version 628337 (0.0009) [2023-12-27 23:45:30,255][106226] Updated weights for policy 0, policy_version 628347 (0.0009) [2023-12-27 23:45:30,309][106226] Updated weights for policy 0, policy_version 628357 (0.0009) [2023-12-27 23:45:30,364][106226] Updated weights for policy 0, policy_version 628367 (0.0008) [2023-12-27 23:45:30,690][106225] Updated weights for policy 1, policy_version 630263 (0.0008) [2023-12-27 23:45:30,737][106225] Updated weights for policy 1, policy_version 630273 (0.0008) [2023-12-27 23:45:30,787][106225] Updated weights for policy 1, policy_version 630283 (0.0005) [2023-12-27 23:45:31,104][106226] Updated weights for policy 0, policy_version 628377 (0.0008) [2023-12-27 23:45:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 322281472. Throughput: 0: 9936.9, 1: 9962.7. Samples: 322274148. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:31,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-6.219')] [2023-12-27 23:45:31,180][106226] Updated weights for policy 0, policy_version 628387 (0.0007) [2023-12-27 23:45:31,240][106226] Updated weights for policy 0, policy_version 628397 (0.0009) [2023-12-27 23:45:31,489][106225] Updated weights for policy 1, policy_version 630293 (0.0007) [2023-12-27 23:45:31,550][106225] Updated weights for policy 1, policy_version 630303 (0.0009) [2023-12-27 23:45:31,620][106225] Updated weights for policy 1, policy_version 630313 (0.0009) [2023-12-27 23:45:31,942][106226] Updated weights for policy 0, policy_version 628407 (0.0009) [2023-12-27 23:45:32,003][106226] Updated weights for policy 0, policy_version 628417 (0.0008) [2023-12-27 23:45:32,062][106226] Updated weights for policy 0, policy_version 628427 (0.0008) [2023-12-27 23:45:32,406][106225] Updated weights for policy 1, policy_version 630323 (0.0009) [2023-12-27 23:45:32,460][106225] Updated weights for policy 1, policy_version 630333 (0.0008) [2023-12-27 23:45:32,513][106225] Updated weights for policy 1, policy_version 630343 (0.0008) [2023-12-27 23:45:32,789][106226] Updated weights for policy 0, policy_version 628437 (0.0008) [2023-12-27 23:45:32,838][106226] Updated weights for policy 0, policy_version 628447 (0.0008) [2023-12-27 23:45:32,891][106226] Updated weights for policy 0, policy_version 628457 (0.0009) [2023-12-27 23:45:33,194][106225] Updated weights for policy 1, policy_version 630353 (0.0006) [2023-12-27 23:45:33,259][106225] Updated weights for policy 1, policy_version 630363 (0.0009) [2023-12-27 23:45:33,320][106225] Updated weights for policy 1, policy_version 630373 (0.0010) [2023-12-27 23:45:33,378][106225] Updated weights for policy 1, policy_version 630383 (0.0008) [2023-12-27 23:45:33,571][106226] Updated weights for policy 0, policy_version 628467 (0.0007) [2023-12-27 23:45:33,628][106226] Updated weights for policy 0, policy_version 628477 (0.0005) [2023-12-27 23:45:33,674][106226] Updated weights for policy 0, policy_version 628487 (0.0005) [2023-12-27 23:45:34,105][106225] Updated weights for policy 1, policy_version 630393 (0.0006) [2023-12-27 23:45:34,169][106225] Updated weights for policy 1, policy_version 630403 (0.0007) [2023-12-27 23:45:34,187][106226] Updated weights for policy 0, policy_version 628497 (0.0005) [2023-12-27 23:45:34,224][106225] Updated weights for policy 1, policy_version 630413 (0.0008) [2023-12-27 23:45:34,245][106226] Updated weights for policy 0, policy_version 628507 (0.0007) [2023-12-27 23:45:34,306][106226] Updated weights for policy 0, policy_version 628517 (0.0008) [2023-12-27 23:45:34,361][106226] Updated weights for policy 0, policy_version 628527 (0.0010) [2023-12-27 23:45:34,866][106225] Updated weights for policy 1, policy_version 630423 (0.0006) [2023-12-27 23:45:34,923][106225] Updated weights for policy 1, policy_version 630433 (0.0006) [2023-12-27 23:45:34,982][106225] Updated weights for policy 1, policy_version 630443 (0.0005) [2023-12-27 23:45:35,082][106226] Updated weights for policy 0, policy_version 628537 (0.0011) [2023-12-27 23:45:35,145][106226] Updated weights for policy 0, policy_version 628547 (0.0008) [2023-12-27 23:45:35,201][106226] Updated weights for policy 0, policy_version 628557 (0.0005) [2023-12-27 23:45:35,674][106225] Updated weights for policy 1, policy_version 630453 (0.0007) [2023-12-27 23:45:35,728][106225] Updated weights for policy 1, policy_version 630463 (0.0008) [2023-12-27 23:45:35,756][106226] Updated weights for policy 0, policy_version 628567 (0.0006) [2023-12-27 23:45:35,786][106225] Updated weights for policy 1, policy_version 630473 (0.0007) [2023-12-27 23:45:35,811][106226] Updated weights for policy 0, policy_version 628577 (0.0010) [2023-12-27 23:45:35,867][106226] Updated weights for policy 0, policy_version 628587 (0.0010) [2023-12-27 23:45:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 322387968. Throughput: 0: 10007.6, 1: 9994.5. Samples: 322395872. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:36,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.988')] [2023-12-27 23:45:36,525][106226] Updated weights for policy 0, policy_version 628597 (0.0010) [2023-12-27 23:45:36,581][106225] Updated weights for policy 1, policy_version 630483 (0.0007) [2023-12-27 23:45:36,587][106226] Updated weights for policy 0, policy_version 628607 (0.0008) [2023-12-27 23:45:36,641][106226] Updated weights for policy 0, policy_version 628617 (0.0007) [2023-12-27 23:45:36,641][106225] Updated weights for policy 1, policy_version 630493 (0.0008) [2023-12-27 23:45:36,707][106225] Updated weights for policy 1, policy_version 630503 (0.0007) [2023-12-27 23:45:37,310][106226] Updated weights for policy 0, policy_version 628627 (0.0007) [2023-12-27 23:45:37,369][106226] Updated weights for policy 0, policy_version 628637 (0.0010) [2023-12-27 23:45:37,425][106225] Updated weights for policy 1, policy_version 630513 (0.0007) [2023-12-27 23:45:37,426][106226] Updated weights for policy 0, policy_version 628647 (0.0010) [2023-12-27 23:45:37,477][106225] Updated weights for policy 1, policy_version 630523 (0.0005) [2023-12-27 23:45:37,529][106225] Updated weights for policy 1, policy_version 630533 (0.0008) [2023-12-27 23:45:37,579][106225] Updated weights for policy 1, policy_version 630543 (0.0008) [2023-12-27 23:45:38,134][106226] Updated weights for policy 0, policy_version 628657 (0.0010) [2023-12-27 23:45:38,191][106226] Updated weights for policy 0, policy_version 628667 (0.0010) [2023-12-27 23:45:38,247][106226] Updated weights for policy 0, policy_version 628677 (0.0010) [2023-12-27 23:45:38,271][106225] Updated weights for policy 1, policy_version 630553 (0.0006) [2023-12-27 23:45:38,299][106226] Updated weights for policy 0, policy_version 628687 (0.0010) [2023-12-27 23:45:38,326][106225] Updated weights for policy 1, policy_version 630563 (0.0006) [2023-12-27 23:45:38,385][106225] Updated weights for policy 1, policy_version 630573 (0.0008) [2023-12-27 23:45:38,981][106226] Updated weights for policy 0, policy_version 628697 (0.0010) [2023-12-27 23:45:39,039][106226] Updated weights for policy 0, policy_version 628707 (0.0010) [2023-12-27 23:45:39,090][106226] Updated weights for policy 0, policy_version 628717 (0.0010) [2023-12-27 23:45:39,153][106225] Updated weights for policy 1, policy_version 630583 (0.0008) [2023-12-27 23:45:39,206][106225] Updated weights for policy 1, policy_version 630593 (0.0008) [2023-12-27 23:45:39,271][106225] Updated weights for policy 1, policy_version 630603 (0.0007) [2023-12-27 23:45:39,865][106226] Updated weights for policy 0, policy_version 628727 (0.0011) [2023-12-27 23:45:39,933][106226] Updated weights for policy 0, policy_version 628737 (0.0010) [2023-12-27 23:45:39,999][106226] Updated weights for policy 0, policy_version 628747 (0.0008) [2023-12-27 23:45:40,052][106225] Updated weights for policy 1, policy_version 630613 (0.0009) [2023-12-27 23:45:40,120][106225] Updated weights for policy 1, policy_version 630623 (0.0009) [2023-12-27 23:45:40,183][106225] Updated weights for policy 1, policy_version 630633 (0.0010) [2023-12-27 23:45:40,573][106226] Updated weights for policy 0, policy_version 628757 (0.0008) [2023-12-27 23:45:40,635][106226] Updated weights for policy 0, policy_version 628767 (0.0008) [2023-12-27 23:45:40,691][106226] Updated weights for policy 0, policy_version 628777 (0.0009) [2023-12-27 23:45:40,981][106225] Updated weights for policy 1, policy_version 630643 (0.0009) [2023-12-27 23:45:41,037][106225] Updated weights for policy 1, policy_version 630653 (0.0009) [2023-12-27 23:45:41,101][106225] Updated weights for policy 1, policy_version 630663 (0.0009) [2023-12-27 23:45:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 322486272. Throughput: 0: 10022.1, 1: 9968.4. Samples: 322454624. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:41,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-6.136')] [2023-12-27 23:45:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000630672_161480704.pth... [2023-12-27 23:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000628784_161005568.pth... [2023-12-27 23:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000629488_161177600.pth [2023-12-27 23:45:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000627632_160710656.pth [2023-12-27 23:45:41,348][106226] Updated weights for policy 0, policy_version 628787 (0.0008) [2023-12-27 23:45:41,420][106226] Updated weights for policy 0, policy_version 628797 (0.0008) [2023-12-27 23:45:41,477][106226] Updated weights for policy 0, policy_version 628807 (0.0011) [2023-12-27 23:45:41,920][106225] Updated weights for policy 1, policy_version 630673 (0.0008) [2023-12-27 23:45:41,981][106225] Updated weights for policy 1, policy_version 630683 (0.0010) [2023-12-27 23:45:42,036][106225] Updated weights for policy 1, policy_version 630693 (0.0010) [2023-12-27 23:45:42,097][106225] Updated weights for policy 1, policy_version 630703 (0.0010) [2023-12-27 23:45:42,181][106226] Updated weights for policy 0, policy_version 628817 (0.0011) [2023-12-27 23:45:42,245][106226] Updated weights for policy 0, policy_version 628827 (0.0011) [2023-12-27 23:45:42,306][106226] Updated weights for policy 0, policy_version 628837 (0.0011) [2023-12-27 23:45:42,368][106226] Updated weights for policy 0, policy_version 628847 (0.0012) [2023-12-27 23:45:42,820][106225] Updated weights for policy 1, policy_version 630713 (0.0008) [2023-12-27 23:45:42,868][106225] Updated weights for policy 1, policy_version 630723 (0.0008) [2023-12-27 23:45:42,921][106225] Updated weights for policy 1, policy_version 630733 (0.0008) [2023-12-27 23:45:43,084][106226] Updated weights for policy 0, policy_version 628857 (0.0009) [2023-12-27 23:45:43,151][106226] Updated weights for policy 0, policy_version 628867 (0.0008) [2023-12-27 23:45:43,212][106226] Updated weights for policy 0, policy_version 628877 (0.0008) [2023-12-27 23:45:43,671][106225] Updated weights for policy 1, policy_version 630743 (0.0010) [2023-12-27 23:45:43,727][106225] Updated weights for policy 1, policy_version 630753 (0.0010) [2023-12-27 23:45:43,775][106225] Updated weights for policy 1, policy_version 630763 (0.0010) [2023-12-27 23:45:43,844][106226] Updated weights for policy 0, policy_version 628887 (0.0006) [2023-12-27 23:45:43,905][106226] Updated weights for policy 0, policy_version 628897 (0.0007) [2023-12-27 23:45:43,969][106226] Updated weights for policy 0, policy_version 628907 (0.0009) [2023-12-27 23:45:44,405][106225] Updated weights for policy 1, policy_version 630773 (0.0008) [2023-12-27 23:45:44,457][106225] Updated weights for policy 1, policy_version 630783 (0.0005) [2023-12-27 23:45:44,505][106225] Updated weights for policy 1, policy_version 630793 (0.0007) [2023-12-27 23:45:44,555][106226] Updated weights for policy 0, policy_version 628917 (0.0006) [2023-12-27 23:45:44,612][106226] Updated weights for policy 0, policy_version 628927 (0.0005) [2023-12-27 23:45:44,676][106226] Updated weights for policy 0, policy_version 628937 (0.0007) [2023-12-27 23:45:45,230][106225] Updated weights for policy 1, policy_version 630803 (0.0005) [2023-12-27 23:45:45,286][106226] Updated weights for policy 0, policy_version 628947 (0.0006) [2023-12-27 23:45:45,300][106225] Updated weights for policy 1, policy_version 630813 (0.0006) [2023-12-27 23:45:45,353][106226] Updated weights for policy 0, policy_version 628957 (0.0006) [2023-12-27 23:45:45,364][106225] Updated weights for policy 1, policy_version 630823 (0.0007) [2023-12-27 23:45:45,408][106226] Updated weights for policy 0, policy_version 628967 (0.0006) [2023-12-27 23:45:46,024][106225] Updated weights for policy 1, policy_version 630833 (0.0008) [2023-12-27 23:45:46,036][106226] Updated weights for policy 0, policy_version 628977 (0.0008) [2023-12-27 23:45:46,081][106225] Updated weights for policy 1, policy_version 630843 (0.0006) [2023-12-27 23:45:46,089][106226] Updated weights for policy 0, policy_version 628987 (0.0008) [2023-12-27 23:45:46,133][106225] Updated weights for policy 1, policy_version 630853 (0.0007) [2023-12-27 23:45:46,135][106226] Updated weights for policy 0, policy_version 628997 (0.0007) [2023-12-27 23:45:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 322576384. Throughput: 0: 10067.4, 1: 9955.3. Samples: 322573384. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:46,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-6.556')] [2023-12-27 23:45:46,183][106226] Updated weights for policy 0, policy_version 629007 (0.0005) [2023-12-27 23:45:46,190][106225] Updated weights for policy 1, policy_version 630863 (0.0007) [2023-12-27 23:45:46,822][106225] Updated weights for policy 1, policy_version 630873 (0.0009) [2023-12-27 23:45:46,883][106225] Updated weights for policy 1, policy_version 630883 (0.0010) [2023-12-27 23:45:46,940][106225] Updated weights for policy 1, policy_version 630893 (0.0010) [2023-12-27 23:45:46,962][106226] Updated weights for policy 0, policy_version 629017 (0.0006) [2023-12-27 23:45:47,012][106226] Updated weights for policy 0, policy_version 629027 (0.0008) [2023-12-27 23:45:47,069][106226] Updated weights for policy 0, policy_version 629037 (0.0007) [2023-12-27 23:45:47,651][106225] Updated weights for policy 1, policy_version 630903 (0.0011) [2023-12-27 23:45:47,717][106225] Updated weights for policy 1, policy_version 630913 (0.0010) [2023-12-27 23:45:47,784][106225] Updated weights for policy 1, policy_version 630923 (0.0011) [2023-12-27 23:45:47,812][106226] Updated weights for policy 0, policy_version 629047 (0.0009) [2023-12-27 23:45:47,872][106226] Updated weights for policy 0, policy_version 629057 (0.0010) [2023-12-27 23:45:47,928][106226] Updated weights for policy 0, policy_version 629067 (0.0010) [2023-12-27 23:45:48,501][106225] Updated weights for policy 1, policy_version 630933 (0.0010) [2023-12-27 23:45:48,514][106226] Updated weights for policy 0, policy_version 629077 (0.0008) [2023-12-27 23:45:48,562][106225] Updated weights for policy 1, policy_version 630943 (0.0006) [2023-12-27 23:45:48,572][106226] Updated weights for policy 0, policy_version 629087 (0.0007) [2023-12-27 23:45:48,623][106225] Updated weights for policy 1, policy_version 630953 (0.0008) [2023-12-27 23:45:48,625][106226] Updated weights for policy 0, policy_version 629097 (0.0006) [2023-12-27 23:45:49,244][106226] Updated weights for policy 0, policy_version 629107 (0.0007) [2023-12-27 23:45:49,313][106226] Updated weights for policy 0, policy_version 629117 (0.0007) [2023-12-27 23:45:49,365][106225] Updated weights for policy 1, policy_version 630963 (0.0007) [2023-12-27 23:45:49,383][106226] Updated weights for policy 0, policy_version 629127 (0.0009) [2023-12-27 23:45:49,431][106225] Updated weights for policy 1, policy_version 630973 (0.0007) [2023-12-27 23:45:49,495][106225] Updated weights for policy 1, policy_version 630983 (0.0005) [2023-12-27 23:45:50,128][106226] Updated weights for policy 0, policy_version 629137 (0.0006) [2023-12-27 23:45:50,169][106225] Updated weights for policy 1, policy_version 630993 (0.0006) [2023-12-27 23:45:50,189][106226] Updated weights for policy 0, policy_version 629147 (0.0008) [2023-12-27 23:45:50,225][106225] Updated weights for policy 1, policy_version 631003 (0.0007) [2023-12-27 23:45:50,249][106226] Updated weights for policy 0, policy_version 629157 (0.0008) [2023-12-27 23:45:50,284][106225] Updated weights for policy 1, policy_version 631013 (0.0008) [2023-12-27 23:45:50,308][106226] Updated weights for policy 0, policy_version 629167 (0.0008) [2023-12-27 23:45:50,344][106225] Updated weights for policy 1, policy_version 631023 (0.0008) [2023-12-27 23:45:51,020][106225] Updated weights for policy 1, policy_version 631033 (0.0006) [2023-12-27 23:45:51,053][106226] Updated weights for policy 0, policy_version 629177 (0.0008) [2023-12-27 23:45:51,087][106225] Updated weights for policy 1, policy_version 631043 (0.0008) [2023-12-27 23:45:51,111][106226] Updated weights for policy 0, policy_version 629187 (0.0008) [2023-12-27 23:45:51,163][106225] Updated weights for policy 1, policy_version 631053 (0.0008) [2023-12-27 23:45:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 322674688. Throughput: 0: 10014.7, 1: 10017.6. Samples: 322691772. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:51,175][105115] Avg episode reward: [(0, '-4.831'), (1, '-6.474')] [2023-12-27 23:45:51,181][106226] Updated weights for policy 0, policy_version 629197 (0.0008) [2023-12-27 23:45:51,919][106226] Updated weights for policy 0, policy_version 629207 (0.0009) [2023-12-27 23:45:51,954][106225] Updated weights for policy 1, policy_version 631063 (0.0008) [2023-12-27 23:45:51,984][106226] Updated weights for policy 0, policy_version 629217 (0.0006) [2023-12-27 23:45:52,017][106225] Updated weights for policy 1, policy_version 631073 (0.0007) [2023-12-27 23:45:52,050][106226] Updated weights for policy 0, policy_version 629227 (0.0006) [2023-12-27 23:45:52,082][106225] Updated weights for policy 1, policy_version 631083 (0.0009) [2023-12-27 23:45:52,672][106226] Updated weights for policy 0, policy_version 629237 (0.0006) [2023-12-27 23:45:52,735][106226] Updated weights for policy 0, policy_version 629247 (0.0008) [2023-12-27 23:45:52,805][106226] Updated weights for policy 0, policy_version 629257 (0.0008) [2023-12-27 23:45:52,811][106225] Updated weights for policy 1, policy_version 631093 (0.0007) [2023-12-27 23:45:52,872][106225] Updated weights for policy 1, policy_version 631103 (0.0006) [2023-12-27 23:45:52,927][106225] Updated weights for policy 1, policy_version 631113 (0.0005) [2023-12-27 23:45:53,533][106225] Updated weights for policy 1, policy_version 631123 (0.0006) [2023-12-27 23:45:53,539][106226] Updated weights for policy 0, policy_version 629267 (0.0009) [2023-12-27 23:45:53,588][106226] Updated weights for policy 0, policy_version 629277 (0.0008) [2023-12-27 23:45:53,597][106225] Updated weights for policy 1, policy_version 631133 (0.0005) [2023-12-27 23:45:53,644][106226] Updated weights for policy 0, policy_version 629287 (0.0007) [2023-12-27 23:45:53,660][106225] Updated weights for policy 1, policy_version 631143 (0.0005) [2023-12-27 23:45:54,279][106225] Updated weights for policy 1, policy_version 631153 (0.0006) [2023-12-27 23:45:54,343][106225] Updated weights for policy 1, policy_version 631163 (0.0010) [2023-12-27 23:45:54,378][106226] Updated weights for policy 0, policy_version 629297 (0.0007) [2023-12-27 23:45:54,404][106225] Updated weights for policy 1, policy_version 631173 (0.0010) [2023-12-27 23:45:54,438][106226] Updated weights for policy 0, policy_version 629307 (0.0006) [2023-12-27 23:45:54,462][106225] Updated weights for policy 1, policy_version 631183 (0.0010) [2023-12-27 23:45:54,488][106226] Updated weights for policy 0, policy_version 629317 (0.0006) [2023-12-27 23:45:54,541][106226] Updated weights for policy 0, policy_version 629327 (0.0005) [2023-12-27 23:45:55,179][106225] Updated weights for policy 1, policy_version 631193 (0.0006) [2023-12-27 23:45:55,218][106226] Updated weights for policy 0, policy_version 629337 (0.0007) [2023-12-27 23:45:55,237][106225] Updated weights for policy 1, policy_version 631203 (0.0006) [2023-12-27 23:45:55,268][106226] Updated weights for policy 0, policy_version 629347 (0.0007) [2023-12-27 23:45:55,287][106225] Updated weights for policy 1, policy_version 631213 (0.0005) [2023-12-27 23:45:55,315][106226] Updated weights for policy 0, policy_version 629357 (0.0006) [2023-12-27 23:45:55,885][106225] Updated weights for policy 1, policy_version 631223 (0.0006) [2023-12-27 23:45:55,951][106225] Updated weights for policy 1, policy_version 631233 (0.0008) [2023-12-27 23:45:55,970][106226] Updated weights for policy 0, policy_version 629367 (0.0007) [2023-12-27 23:45:56,006][106225] Updated weights for policy 1, policy_version 631243 (0.0010) [2023-12-27 23:45:56,021][106226] Updated weights for policy 0, policy_version 629377 (0.0007) [2023-12-27 23:45:56,073][106226] Updated weights for policy 0, policy_version 629387 (0.0008) [2023-12-27 23:45:56,175][105115] Fps is (10 sec: 21298.7, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 322789376. Throughput: 0: 9978.0, 1: 9948.3. Samples: 322750924. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:45:56,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-5.797')] [2023-12-27 23:45:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000631248_161628160.pth... [2023-12-27 23:45:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000629392_161161216.pth... [2023-12-27 23:45:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000628208_160858112.pth [2023-12-27 23:45:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000630096_161333248.pth [2023-12-27 23:45:56,650][106225] Updated weights for policy 1, policy_version 631253 (0.0008) [2023-12-27 23:45:56,704][106225] Updated weights for policy 1, policy_version 631263 (0.0005) [2023-12-27 23:45:56,767][106225] Updated weights for policy 1, policy_version 631273 (0.0006) [2023-12-27 23:45:56,810][106226] Updated weights for policy 0, policy_version 629397 (0.0007) [2023-12-27 23:45:56,854][106226] Updated weights for policy 0, policy_version 629407 (0.0008) [2023-12-27 23:45:56,899][106226] Updated weights for policy 0, policy_version 629417 (0.0007) [2023-12-27 23:45:57,466][106225] Updated weights for policy 1, policy_version 631283 (0.0010) [2023-12-27 23:45:57,531][106225] Updated weights for policy 1, policy_version 631293 (0.0011) [2023-12-27 23:45:57,586][106225] Updated weights for policy 1, policy_version 631303 (0.0010) [2023-12-27 23:45:57,652][106226] Updated weights for policy 0, policy_version 629427 (0.0008) [2023-12-27 23:45:57,697][106226] Updated weights for policy 0, policy_version 629437 (0.0007) [2023-12-27 23:45:57,758][106226] Updated weights for policy 0, policy_version 629447 (0.0009) [2023-12-27 23:45:58,284][106225] Updated weights for policy 1, policy_version 631313 (0.0010) [2023-12-27 23:45:58,372][106225] Updated weights for policy 1, policy_version 631323 (0.0011) [2023-12-27 23:45:58,448][106225] Updated weights for policy 1, policy_version 631333 (0.0017) [2023-12-27 23:45:58,514][106225] Updated weights for policy 1, policy_version 631343 (0.0007) [2023-12-27 23:45:58,586][106226] Updated weights for policy 0, policy_version 629457 (0.0007) [2023-12-27 23:45:58,649][106226] Updated weights for policy 0, policy_version 629467 (0.0008) [2023-12-27 23:45:58,725][106226] Updated weights for policy 0, policy_version 629477 (0.0009) [2023-12-27 23:45:58,797][106226] Updated weights for policy 0, policy_version 629487 (0.0010) [2023-12-27 23:45:59,377][106225] Updated weights for policy 1, policy_version 631353 (0.0009) [2023-12-27 23:45:59,445][106225] Updated weights for policy 1, policy_version 631363 (0.0009) [2023-12-27 23:45:59,505][106225] Updated weights for policy 1, policy_version 631373 (0.0008) [2023-12-27 23:45:59,622][106226] Updated weights for policy 0, policy_version 629497 (0.0009) [2023-12-27 23:45:59,684][106226] Updated weights for policy 0, policy_version 629507 (0.0008) [2023-12-27 23:45:59,748][106226] Updated weights for policy 0, policy_version 629517 (0.0009) [2023-12-27 23:46:00,245][106225] Updated weights for policy 1, policy_version 631383 (0.0009) [2023-12-27 23:46:00,302][106225] Updated weights for policy 1, policy_version 631393 (0.0008) [2023-12-27 23:46:00,357][106225] Updated weights for policy 1, policy_version 631403 (0.0008) [2023-12-27 23:46:00,503][106226] Updated weights for policy 0, policy_version 629527 (0.0008) [2023-12-27 23:46:00,557][106226] Updated weights for policy 0, policy_version 629537 (0.0009) [2023-12-27 23:46:00,615][106226] Updated weights for policy 0, policy_version 629547 (0.0009) [2023-12-27 23:46:01,122][106225] Updated weights for policy 1, policy_version 631413 (0.0009) [2023-12-27 23:46:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 322871296. Throughput: 0: 9932.5, 1: 9967.2. Samples: 322865376. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:01,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.623')] [2023-12-27 23:46:01,189][106225] Updated weights for policy 1, policy_version 631423 (0.0009) [2023-12-27 23:46:01,258][106225] Updated weights for policy 1, policy_version 631433 (0.0010) [2023-12-27 23:46:01,336][106226] Updated weights for policy 0, policy_version 629557 (0.0009) [2023-12-27 23:46:01,406][106226] Updated weights for policy 0, policy_version 629567 (0.0008) [2023-12-27 23:46:01,468][106226] Updated weights for policy 0, policy_version 629577 (0.0008) [2023-12-27 23:46:02,038][106225] Updated weights for policy 1, policy_version 631443 (0.0008) [2023-12-27 23:46:02,100][106225] Updated weights for policy 1, policy_version 631453 (0.0008) [2023-12-27 23:46:02,158][106225] Updated weights for policy 1, policy_version 631463 (0.0009) [2023-12-27 23:46:02,220][106226] Updated weights for policy 0, policy_version 629587 (0.0008) [2023-12-27 23:46:02,282][106226] Updated weights for policy 0, policy_version 629597 (0.0010) [2023-12-27 23:46:02,343][106226] Updated weights for policy 0, policy_version 629607 (0.0010) [2023-12-27 23:46:02,912][106225] Updated weights for policy 1, policy_version 631473 (0.0008) [2023-12-27 23:46:02,968][106225] Updated weights for policy 1, policy_version 631483 (0.0008) [2023-12-27 23:46:02,974][106226] Updated weights for policy 0, policy_version 629617 (0.0008) [2023-12-27 23:46:03,019][106225] Updated weights for policy 1, policy_version 631493 (0.0007) [2023-12-27 23:46:03,027][106226] Updated weights for policy 0, policy_version 629627 (0.0006) [2023-12-27 23:46:03,079][106225] Updated weights for policy 1, policy_version 631503 (0.0007) [2023-12-27 23:46:03,082][106226] Updated weights for policy 0, policy_version 629637 (0.0010) [2023-12-27 23:46:03,139][106226] Updated weights for policy 0, policy_version 629647 (0.0010) [2023-12-27 23:46:03,709][106225] Updated weights for policy 1, policy_version 631513 (0.0008) [2023-12-27 23:46:03,760][106225] Updated weights for policy 1, policy_version 631523 (0.0008) [2023-12-27 23:46:03,815][106225] Updated weights for policy 1, policy_version 631533 (0.0006) [2023-12-27 23:46:03,825][106226] Updated weights for policy 0, policy_version 629657 (0.0011) [2023-12-27 23:46:03,895][106226] Updated weights for policy 0, policy_version 629667 (0.0009) [2023-12-27 23:46:03,950][106226] Updated weights for policy 0, policy_version 629677 (0.0009) [2023-12-27 23:46:04,496][106225] Updated weights for policy 1, policy_version 631543 (0.0007) [2023-12-27 23:46:04,563][106225] Updated weights for policy 1, policy_version 631553 (0.0009) [2023-12-27 23:46:04,622][106226] Updated weights for policy 0, policy_version 629687 (0.0007) [2023-12-27 23:46:04,626][106225] Updated weights for policy 1, policy_version 631563 (0.0008) [2023-12-27 23:46:04,678][106226] Updated weights for policy 0, policy_version 629697 (0.0005) [2023-12-27 23:46:04,740][106226] Updated weights for policy 0, policy_version 629707 (0.0005) [2023-12-27 23:46:05,336][106226] Updated weights for policy 0, policy_version 629717 (0.0008) [2023-12-27 23:46:05,377][106225] Updated weights for policy 1, policy_version 631573 (0.0006) [2023-12-27 23:46:05,386][106226] Updated weights for policy 0, policy_version 629727 (0.0010) [2023-12-27 23:46:05,440][106225] Updated weights for policy 1, policy_version 631583 (0.0005) [2023-12-27 23:46:05,445][106226] Updated weights for policy 0, policy_version 629737 (0.0010) [2023-12-27 23:46:05,497][106225] Updated weights for policy 1, policy_version 631593 (0.0006) [2023-12-27 23:46:06,149][106226] Updated weights for policy 0, policy_version 629747 (0.0011) [2023-12-27 23:46:06,162][106225] Updated weights for policy 1, policy_version 631603 (0.0007) [2023-12-27 23:46:06,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 322969600. Throughput: 0: 9952.3, 1: 9912.6. Samples: 322984220. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:06,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.938')] [2023-12-27 23:46:06,204][106226] Updated weights for policy 0, policy_version 629757 (0.0009) [2023-12-27 23:46:06,217][106225] Updated weights for policy 1, policy_version 631613 (0.0006) [2023-12-27 23:46:06,270][106226] Updated weights for policy 0, policy_version 629767 (0.0009) [2023-12-27 23:46:06,281][106225] Updated weights for policy 1, policy_version 631623 (0.0008) [2023-12-27 23:46:06,980][106226] Updated weights for policy 0, policy_version 629777 (0.0009) [2023-12-27 23:46:07,006][106225] Updated weights for policy 1, policy_version 631633 (0.0008) [2023-12-27 23:46:07,050][106226] Updated weights for policy 0, policy_version 629787 (0.0011) [2023-12-27 23:46:07,060][106225] Updated weights for policy 1, policy_version 631643 (0.0007) [2023-12-27 23:46:07,107][106226] Updated weights for policy 0, policy_version 629797 (0.0011) [2023-12-27 23:46:07,120][106225] Updated weights for policy 1, policy_version 631653 (0.0006) [2023-12-27 23:46:07,167][106226] Updated weights for policy 0, policy_version 629807 (0.0010) [2023-12-27 23:46:07,180][106225] Updated weights for policy 1, policy_version 631663 (0.0008) [2023-12-27 23:46:07,831][106226] Updated weights for policy 0, policy_version 629817 (0.0011) [2023-12-27 23:46:07,888][106226] Updated weights for policy 0, policy_version 629827 (0.0010) [2023-12-27 23:46:07,930][106225] Updated weights for policy 1, policy_version 631673 (0.0006) [2023-12-27 23:46:07,951][106226] Updated weights for policy 0, policy_version 629837 (0.0011) [2023-12-27 23:46:07,994][106225] Updated weights for policy 1, policy_version 631683 (0.0007) [2023-12-27 23:46:08,057][106225] Updated weights for policy 1, policy_version 631693 (0.0008) [2023-12-27 23:46:08,642][106226] Updated weights for policy 0, policy_version 629847 (0.0007) [2023-12-27 23:46:08,709][106226] Updated weights for policy 0, policy_version 629857 (0.0006) [2023-12-27 23:46:08,771][106226] Updated weights for policy 0, policy_version 629867 (0.0008) [2023-12-27 23:46:08,774][106225] Updated weights for policy 1, policy_version 631703 (0.0006) [2023-12-27 23:46:08,844][106225] Updated weights for policy 1, policy_version 631713 (0.0009) [2023-12-27 23:46:08,901][106225] Updated weights for policy 1, policy_version 631723 (0.0008) [2023-12-27 23:46:09,374][106226] Updated weights for policy 0, policy_version 629877 (0.0008) [2023-12-27 23:46:09,442][106226] Updated weights for policy 0, policy_version 629887 (0.0008) [2023-12-27 23:46:09,501][106226] Updated weights for policy 0, policy_version 629897 (0.0008) [2023-12-27 23:46:09,581][106225] Updated weights for policy 1, policy_version 631733 (0.0008) [2023-12-27 23:46:09,649][106225] Updated weights for policy 1, policy_version 631743 (0.0006) [2023-12-27 23:46:09,703][106225] Updated weights for policy 1, policy_version 631753 (0.0009) [2023-12-27 23:46:10,294][106226] Updated weights for policy 0, policy_version 629907 (0.0010) [2023-12-27 23:46:10,361][106226] Updated weights for policy 0, policy_version 629917 (0.0009) [2023-12-27 23:46:10,407][106225] Updated weights for policy 1, policy_version 631763 (0.0009) [2023-12-27 23:46:10,422][106226] Updated weights for policy 0, policy_version 629927 (0.0009) [2023-12-27 23:46:10,460][106225] Updated weights for policy 1, policy_version 631773 (0.0008) [2023-12-27 23:46:10,513][106225] Updated weights for policy 1, policy_version 631783 (0.0007) [2023-12-27 23:46:11,173][106226] Updated weights for policy 0, policy_version 629937 (0.0007) [2023-12-27 23:46:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 323067904. Throughput: 0: 10013.4, 1: 9896.4. Samples: 323043732. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:11,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-6.171')] [2023-12-27 23:46:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000631792_161767424.pth... [2023-12-27 23:46:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000630672_161480704.pth [2023-12-27 23:46:11,235][106225] Updated weights for policy 1, policy_version 631793 (0.0008) [2023-12-27 23:46:11,237][106226] Updated weights for policy 0, policy_version 629947 (0.0009) [2023-12-27 23:46:11,293][106225] Updated weights for policy 1, policy_version 631803 (0.0007) [2023-12-27 23:46:11,305][106226] Updated weights for policy 0, policy_version 629957 (0.0006) [2023-12-27 23:46:11,362][106225] Updated weights for policy 1, policy_version 631813 (0.0010) [2023-12-27 23:46:11,373][106226] Updated weights for policy 0, policy_version 629967 (0.0008) [2023-12-27 23:46:11,380][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000629968_161308672.pth... [2023-12-27 23:46:11,384][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000628784_161005568.pth [2023-12-27 23:46:11,425][106225] Updated weights for policy 1, policy_version 631823 (0.0008) [2023-12-27 23:46:12,113][106226] Updated weights for policy 0, policy_version 629977 (0.0008) [2023-12-27 23:46:12,159][106225] Updated weights for policy 1, policy_version 631833 (0.0008) [2023-12-27 23:46:12,171][106226] Updated weights for policy 0, policy_version 629987 (0.0006) [2023-12-27 23:46:12,212][106225] Updated weights for policy 1, policy_version 631843 (0.0007) [2023-12-27 23:46:12,230][106226] Updated weights for policy 0, policy_version 629997 (0.0009) [2023-12-27 23:46:12,276][106225] Updated weights for policy 1, policy_version 631853 (0.0009) [2023-12-27 23:46:12,921][106225] Updated weights for policy 1, policy_version 631863 (0.0007) [2023-12-27 23:46:12,975][106225] Updated weights for policy 1, policy_version 631873 (0.0005) [2023-12-27 23:46:13,021][106225] Updated weights for policy 1, policy_version 631883 (0.0007) [2023-12-27 23:46:13,024][106226] Updated weights for policy 0, policy_version 630007 (0.0006) [2023-12-27 23:46:13,090][106226] Updated weights for policy 0, policy_version 630017 (0.0009) [2023-12-27 23:46:13,160][106226] Updated weights for policy 0, policy_version 630027 (0.0009) [2023-12-27 23:46:13,608][106225] Updated weights for policy 1, policy_version 631893 (0.0007) [2023-12-27 23:46:13,662][106225] Updated weights for policy 1, policy_version 631903 (0.0008) [2023-12-27 23:46:13,721][106225] Updated weights for policy 1, policy_version 631913 (0.0008) [2023-12-27 23:46:13,919][106226] Updated weights for policy 0, policy_version 630037 (0.0009) [2023-12-27 23:46:13,982][106226] Updated weights for policy 0, policy_version 630047 (0.0010) [2023-12-27 23:46:14,041][106226] Updated weights for policy 0, policy_version 630057 (0.0006) [2023-12-27 23:46:14,333][106225] Updated weights for policy 1, policy_version 631923 (0.0007) [2023-12-27 23:46:14,401][106225] Updated weights for policy 1, policy_version 631933 (0.0006) [2023-12-27 23:46:14,459][106225] Updated weights for policy 1, policy_version 631943 (0.0009) [2023-12-27 23:46:14,788][106226] Updated weights for policy 0, policy_version 630067 (0.0007) [2023-12-27 23:46:14,852][106226] Updated weights for policy 0, policy_version 630077 (0.0009) [2023-12-27 23:46:14,919][106226] Updated weights for policy 0, policy_version 630087 (0.0009) [2023-12-27 23:46:15,126][106225] Updated weights for policy 1, policy_version 631953 (0.0008) [2023-12-27 23:46:15,182][106225] Updated weights for policy 1, policy_version 631963 (0.0008) [2023-12-27 23:46:15,240][106225] Updated weights for policy 1, policy_version 631973 (0.0009) [2023-12-27 23:46:15,295][106225] Updated weights for policy 1, policy_version 631983 (0.0008) [2023-12-27 23:46:15,660][106226] Updated weights for policy 0, policy_version 630097 (0.0009) [2023-12-27 23:46:15,730][106226] Updated weights for policy 0, policy_version 630107 (0.0006) [2023-12-27 23:46:15,799][106226] Updated weights for policy 0, policy_version 630117 (0.0006) [2023-12-27 23:46:15,871][106226] Updated weights for policy 0, policy_version 630127 (0.0006) [2023-12-27 23:46:16,016][106225] Updated weights for policy 1, policy_version 631993 (0.0008) [2023-12-27 23:46:16,062][106225] Updated weights for policy 1, policy_version 632003 (0.0005) [2023-12-27 23:46:16,113][106225] Updated weights for policy 1, policy_version 632013 (0.0005) [2023-12-27 23:46:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 323174400. Throughput: 0: 9892.0, 1: 9763.7. Samples: 323158656. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:16,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-5.786')] [2023-12-27 23:46:16,454][106226] Updated weights for policy 0, policy_version 630137 (0.0005) [2023-12-27 23:46:16,516][106226] Updated weights for policy 0, policy_version 630147 (0.0011) [2023-12-27 23:46:16,583][106226] Updated weights for policy 0, policy_version 630157 (0.0006) [2023-12-27 23:46:16,759][106225] Updated weights for policy 1, policy_version 632023 (0.0009) [2023-12-27 23:46:16,814][106225] Updated weights for policy 1, policy_version 632033 (0.0007) [2023-12-27 23:46:16,859][106225] Updated weights for policy 1, policy_version 632043 (0.0005) [2023-12-27 23:46:17,176][106226] Updated weights for policy 0, policy_version 630167 (0.0007) [2023-12-27 23:46:17,242][106226] Updated weights for policy 0, policy_version 630177 (0.0011) [2023-12-27 23:46:17,302][106226] Updated weights for policy 0, policy_version 630187 (0.0011) [2023-12-27 23:46:17,576][106225] Updated weights for policy 1, policy_version 632053 (0.0009) [2023-12-27 23:46:17,641][106225] Updated weights for policy 1, policy_version 632063 (0.0010) [2023-12-27 23:46:17,707][106225] Updated weights for policy 1, policy_version 632073 (0.0010) [2023-12-27 23:46:17,914][106226] Updated weights for policy 0, policy_version 630197 (0.0007) [2023-12-27 23:46:17,972][106226] Updated weights for policy 0, policy_version 630207 (0.0005) [2023-12-27 23:46:18,032][106226] Updated weights for policy 0, policy_version 630217 (0.0005) [2023-12-27 23:46:18,425][106225] Updated weights for policy 1, policy_version 632083 (0.0009) [2023-12-27 23:46:18,492][106225] Updated weights for policy 1, policy_version 632093 (0.0007) [2023-12-27 23:46:18,556][106225] Updated weights for policy 1, policy_version 632103 (0.0008) [2023-12-27 23:46:18,559][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000007 [2023-12-27 23:46:18,694][106226] Updated weights for policy 0, policy_version 630227 (0.0007) [2023-12-27 23:46:18,754][106226] Updated weights for policy 0, policy_version 630237 (0.0011) [2023-12-27 23:46:18,812][106226] Updated weights for policy 0, policy_version 630247 (0.0011) [2023-12-27 23:46:19,311][106225] Updated weights for policy 1, policy_version 632113 (0.0008) [2023-12-27 23:46:19,366][106225] Updated weights for policy 1, policy_version 632123 (0.0008) [2023-12-27 23:46:19,433][106225] Updated weights for policy 1, policy_version 632133 (0.0008) [2023-12-27 23:46:19,544][106226] Updated weights for policy 0, policy_version 630257 (0.0011) [2023-12-27 23:46:19,616][106226] Updated weights for policy 0, policy_version 630267 (0.0011) [2023-12-27 23:46:19,684][106226] Updated weights for policy 0, policy_version 630277 (0.0011) [2023-12-27 23:46:19,754][106226] Updated weights for policy 0, policy_version 630287 (0.0011) [2023-12-27 23:46:20,207][106225] Updated weights for policy 1, policy_version 632143 (0.0006) [2023-12-27 23:46:20,267][106225] Updated weights for policy 1, policy_version 632153 (0.0006) [2023-12-27 23:46:20,338][106225] Updated weights for policy 1, policy_version 632163 (0.0006) [2023-12-27 23:46:20,473][106226] Updated weights for policy 0, policy_version 630297 (0.0011) [2023-12-27 23:46:20,534][106226] Updated weights for policy 0, policy_version 630307 (0.0011) [2023-12-27 23:46:20,595][106226] Updated weights for policy 0, policy_version 630317 (0.0010) [2023-12-27 23:46:21,086][106225] Updated weights for policy 1, policy_version 632173 (0.0008) [2023-12-27 23:46:21,157][106225] Updated weights for policy 1, policy_version 632183 (0.0007) [2023-12-27 23:46:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.5). Total num frames: 323264512. Throughput: 0: 9853.2, 1: 9746.4. Samples: 323277852. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:21,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-6.217')] [2023-12-27 23:46:21,225][106225] Updated weights for policy 1, policy_version 632193 (0.0008) [2023-12-27 23:46:21,392][106226] Updated weights for policy 0, policy_version 630327 (0.0010) [2023-12-27 23:46:21,456][106226] Updated weights for policy 0, policy_version 630337 (0.0007) [2023-12-27 23:46:21,511][106226] Updated weights for policy 0, policy_version 630347 (0.0005) [2023-12-27 23:46:21,946][106225] Updated weights for policy 1, policy_version 632203 (0.0007) [2023-12-27 23:46:22,003][106225] Updated weights for policy 1, policy_version 632213 (0.0009) [2023-12-27 23:46:22,063][106225] Updated weights for policy 1, policy_version 632223 (0.0008) [2023-12-27 23:46:22,206][106226] Updated weights for policy 0, policy_version 630357 (0.0006) [2023-12-27 23:46:22,267][106226] Updated weights for policy 0, policy_version 630367 (0.0007) [2023-12-27 23:46:22,325][106226] Updated weights for policy 0, policy_version 630377 (0.0009) [2023-12-27 23:46:22,854][106225] Updated weights for policy 1, policy_version 632233 (0.0009) [2023-12-27 23:46:22,916][106225] Updated weights for policy 1, policy_version 632243 (0.0008) [2023-12-27 23:46:22,976][106225] Updated weights for policy 1, policy_version 632253 (0.0006) [2023-12-27 23:46:23,020][106226] Updated weights for policy 0, policy_version 630387 (0.0007) [2023-12-27 23:46:23,037][106225] Updated weights for policy 1, policy_version 632263 (0.0005) [2023-12-27 23:46:23,081][106226] Updated weights for policy 0, policy_version 630397 (0.0006) [2023-12-27 23:46:23,152][106226] Updated weights for policy 0, policy_version 630407 (0.0009) [2023-12-27 23:46:23,657][106225] Updated weights for policy 1, policy_version 632273 (0.0005) [2023-12-27 23:46:23,723][106225] Updated weights for policy 1, policy_version 632283 (0.0006) [2023-12-27 23:46:23,784][106225] Updated weights for policy 1, policy_version 632293 (0.0009) [2023-12-27 23:46:23,869][106226] Updated weights for policy 0, policy_version 630417 (0.0008) [2023-12-27 23:46:23,937][106226] Updated weights for policy 0, policy_version 630427 (0.0009) [2023-12-27 23:46:23,997][106226] Updated weights for policy 0, policy_version 630437 (0.0009) [2023-12-27 23:46:24,048][106226] Updated weights for policy 0, policy_version 630447 (0.0008) [2023-12-27 23:46:24,419][106225] Updated weights for policy 1, policy_version 632303 (0.0009) [2023-12-27 23:46:24,475][106225] Updated weights for policy 1, policy_version 632313 (0.0006) [2023-12-27 23:46:24,534][106225] Updated weights for policy 1, policy_version 632323 (0.0005) [2023-12-27 23:46:24,734][106226] Updated weights for policy 0, policy_version 630457 (0.0006) [2023-12-27 23:46:24,784][106226] Updated weights for policy 0, policy_version 630467 (0.0008) [2023-12-27 23:46:24,840][106226] Updated weights for policy 0, policy_version 630477 (0.0009) [2023-12-27 23:46:25,204][106225] Updated weights for policy 1, policy_version 632333 (0.0006) [2023-12-27 23:46:25,257][106225] Updated weights for policy 1, policy_version 632343 (0.0006) [2023-12-27 23:46:25,316][106225] Updated weights for policy 1, policy_version 632353 (0.0005) [2023-12-27 23:46:25,490][106226] Updated weights for policy 0, policy_version 630487 (0.0008) [2023-12-27 23:46:25,547][106226] Updated weights for policy 0, policy_version 630497 (0.0010) [2023-12-27 23:46:25,607][106226] Updated weights for policy 0, policy_version 630507 (0.0006) [2023-12-27 23:46:25,901][106225] Updated weights for policy 1, policy_version 632363 (0.0007) [2023-12-27 23:46:25,961][106225] Updated weights for policy 1, policy_version 632373 (0.0010) [2023-12-27 23:46:26,025][106225] Updated weights for policy 1, policy_version 632383 (0.0010) [2023-12-27 23:46:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 323371008. Throughput: 0: 9811.1, 1: 9758.5. Samples: 323335260. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:26,176][105115] Avg episode reward: [(0, '-4.913'), (1, '-6.119')] [2023-12-27 23:46:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000632392_161923072.pth... [2023-12-27 23:46:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000630512_161447936.pth... [2023-12-27 23:46:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000631248_161628160.pth [2023-12-27 23:46:26,197][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000629392_161161216.pth [2023-12-27 23:46:26,252][106226] Updated weights for policy 0, policy_version 630517 (0.0009) [2023-12-27 23:46:26,304][106226] Updated weights for policy 0, policy_version 630527 (0.0008) [2023-12-27 23:46:26,359][106226] Updated weights for policy 0, policy_version 630537 (0.0005) [2023-12-27 23:46:26,753][106225] Updated weights for policy 1, policy_version 632393 (0.0010) [2023-12-27 23:46:26,799][106225] Updated weights for policy 1, policy_version 632403 (0.0008) [2023-12-27 23:46:26,850][106225] Updated weights for policy 1, policy_version 632413 (0.0007) [2023-12-27 23:46:26,899][106225] Updated weights for policy 1, policy_version 632423 (0.0008) [2023-12-27 23:46:27,037][106226] Updated weights for policy 0, policy_version 630547 (0.0007) [2023-12-27 23:46:27,096][106226] Updated weights for policy 0, policy_version 630557 (0.0010) [2023-12-27 23:46:27,145][106226] Updated weights for policy 0, policy_version 630567 (0.0010) [2023-12-27 23:46:27,655][106225] Updated weights for policy 1, policy_version 632433 (0.0008) [2023-12-27 23:46:27,702][106225] Updated weights for policy 1, policy_version 632443 (0.0008) [2023-12-27 23:46:27,749][106225] Updated weights for policy 1, policy_version 632453 (0.0008) [2023-12-27 23:46:27,854][106226] Updated weights for policy 0, policy_version 630577 (0.0010) [2023-12-27 23:46:27,900][106226] Updated weights for policy 0, policy_version 630587 (0.0010) [2023-12-27 23:46:27,952][106226] Updated weights for policy 0, policy_version 630597 (0.0010) [2023-12-27 23:46:28,001][106226] Updated weights for policy 0, policy_version 630607 (0.0010) [2023-12-27 23:46:28,531][106225] Updated weights for policy 1, policy_version 632463 (0.0010) [2023-12-27 23:46:28,584][106225] Updated weights for policy 1, policy_version 632473 (0.0008) [2023-12-27 23:46:28,652][106225] Updated weights for policy 1, policy_version 632483 (0.0009) [2023-12-27 23:46:28,709][106226] Updated weights for policy 0, policy_version 630617 (0.0009) [2023-12-27 23:46:28,757][106226] Updated weights for policy 0, policy_version 630627 (0.0008) [2023-12-27 23:46:28,805][106226] Updated weights for policy 0, policy_version 630637 (0.0008) [2023-12-27 23:46:29,380][106225] Updated weights for policy 1, policy_version 632493 (0.0008) [2023-12-27 23:46:29,449][106225] Updated weights for policy 1, policy_version 632503 (0.0008) [2023-12-27 23:46:29,508][106225] Updated weights for policy 1, policy_version 632513 (0.0008) [2023-12-27 23:46:29,596][106226] Updated weights for policy 0, policy_version 630647 (0.0008) [2023-12-27 23:46:29,645][106226] Updated weights for policy 0, policy_version 630657 (0.0008) [2023-12-27 23:46:29,704][106226] Updated weights for policy 0, policy_version 630667 (0.0008) [2023-12-27 23:46:30,246][106225] Updated weights for policy 1, policy_version 632523 (0.0009) [2023-12-27 23:46:30,302][106225] Updated weights for policy 1, policy_version 632533 (0.0010) [2023-12-27 23:46:30,353][106225] Updated weights for policy 1, policy_version 632543 (0.0010) [2023-12-27 23:46:30,487][106226] Updated weights for policy 0, policy_version 630677 (0.0008) [2023-12-27 23:46:30,547][106226] Updated weights for policy 0, policy_version 630688 (0.0007) [2023-12-27 23:46:30,607][106226] Updated weights for policy 0, policy_version 630698 (0.0008) [2023-12-27 23:46:31,040][106225] Updated weights for policy 1, policy_version 632553 (0.0010) [2023-12-27 23:46:31,105][106225] Updated weights for policy 1, policy_version 632563 (0.0008) [2023-12-27 23:46:31,163][106225] Updated weights for policy 1, policy_version 632573 (0.0008) [2023-12-27 23:46:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 323461120. Throughput: 0: 9788.0, 1: 9802.8. Samples: 323454968. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:31,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-5.956')] [2023-12-27 23:46:31,220][106225] Updated weights for policy 1, policy_version 632583 (0.0009) [2023-12-27 23:46:31,363][106226] Updated weights for policy 0, policy_version 630708 (0.0007) [2023-12-27 23:46:31,430][106226] Updated weights for policy 0, policy_version 630718 (0.0009) [2023-12-27 23:46:31,497][106226] Updated weights for policy 0, policy_version 630728 (0.0009) [2023-12-27 23:46:32,002][106225] Updated weights for policy 1, policy_version 632593 (0.0009) [2023-12-27 23:46:32,054][106225] Updated weights for policy 1, policy_version 632603 (0.0008) [2023-12-27 23:46:32,106][106225] Updated weights for policy 1, policy_version 632613 (0.0008) [2023-12-27 23:46:32,192][106226] Updated weights for policy 0, policy_version 630738 (0.0009) [2023-12-27 23:46:32,238][106226] Updated weights for policy 0, policy_version 630748 (0.0008) [2023-12-27 23:46:32,300][106226] Updated weights for policy 0, policy_version 630758 (0.0008) [2023-12-27 23:46:32,367][106226] Updated weights for policy 0, policy_version 630768 (0.0009) [2023-12-27 23:46:32,842][106225] Updated weights for policy 1, policy_version 632623 (0.0006) [2023-12-27 23:46:32,904][106225] Updated weights for policy 1, policy_version 632633 (0.0006) [2023-12-27 23:46:32,954][106225] Updated weights for policy 1, policy_version 632643 (0.0006) [2023-12-27 23:46:33,071][106226] Updated weights for policy 0, policy_version 630778 (0.0008) [2023-12-27 23:46:33,125][106226] Updated weights for policy 0, policy_version 630788 (0.0008) [2023-12-27 23:46:33,169][106226] Updated weights for policy 0, policy_version 630798 (0.0008) [2023-12-27 23:46:33,539][106225] Updated weights for policy 1, policy_version 632653 (0.0007) [2023-12-27 23:46:33,587][106225] Updated weights for policy 1, policy_version 632663 (0.0008) [2023-12-27 23:46:33,631][106225] Updated weights for policy 1, policy_version 632673 (0.0008) [2023-12-27 23:46:33,931][106226] Updated weights for policy 0, policy_version 630808 (0.0009) [2023-12-27 23:46:33,981][106226] Updated weights for policy 0, policy_version 630818 (0.0009) [2023-12-27 23:46:34,040][106226] Updated weights for policy 0, policy_version 630828 (0.0008) [2023-12-27 23:46:34,324][106225] Updated weights for policy 1, policy_version 632683 (0.0008) [2023-12-27 23:46:34,381][106225] Updated weights for policy 1, policy_version 632693 (0.0009) [2023-12-27 23:46:34,443][106225] Updated weights for policy 1, policy_version 632703 (0.0007) [2023-12-27 23:46:34,790][106226] Updated weights for policy 0, policy_version 630838 (0.0008) [2023-12-27 23:46:34,850][106226] Updated weights for policy 0, policy_version 630848 (0.0009) [2023-12-27 23:46:34,904][106226] Updated weights for policy 0, policy_version 630858 (0.0009) [2023-12-27 23:46:35,196][106225] Updated weights for policy 1, policy_version 632713 (0.0008) [2023-12-27 23:46:35,256][106225] Updated weights for policy 1, policy_version 632723 (0.0008) [2023-12-27 23:46:35,307][106225] Updated weights for policy 1, policy_version 632733 (0.0008) [2023-12-27 23:46:35,361][106225] Updated weights for policy 1, policy_version 632743 (0.0008) [2023-12-27 23:46:35,578][106226] Updated weights for policy 0, policy_version 630868 (0.0009) [2023-12-27 23:46:35,629][106226] Updated weights for policy 0, policy_version 630878 (0.0008) [2023-12-27 23:46:35,680][106226] Updated weights for policy 0, policy_version 630888 (0.0008) [2023-12-27 23:46:36,124][106225] Updated weights for policy 1, policy_version 632753 (0.0009) [2023-12-27 23:46:36,174][105115] Fps is (10 sec: 18842.3, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 323559424. Throughput: 0: 9760.6, 1: 9831.4. Samples: 323573412. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:36,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-5.904')] [2023-12-27 23:46:36,192][106225] Updated weights for policy 1, policy_version 632763 (0.0008) [2023-12-27 23:46:36,247][106225] Updated weights for policy 1, policy_version 632773 (0.0007) [2023-12-27 23:46:36,295][106226] Updated weights for policy 0, policy_version 630898 (0.0008) [2023-12-27 23:46:36,359][106226] Updated weights for policy 0, policy_version 630908 (0.0006) [2023-12-27 23:46:36,425][106226] Updated weights for policy 0, policy_version 630918 (0.0008) [2023-12-27 23:46:36,488][106226] Updated weights for policy 0, policy_version 630928 (0.0009) [2023-12-27 23:46:36,967][106225] Updated weights for policy 1, policy_version 632783 (0.0009) [2023-12-27 23:46:37,026][106225] Updated weights for policy 1, policy_version 632793 (0.0010) [2023-12-27 23:46:37,087][106225] Updated weights for policy 1, policy_version 632803 (0.0010) [2023-12-27 23:46:37,192][106226] Updated weights for policy 0, policy_version 630938 (0.0008) [2023-12-27 23:46:37,249][106226] Updated weights for policy 0, policy_version 630948 (0.0007) [2023-12-27 23:46:37,299][106226] Updated weights for policy 0, policy_version 630958 (0.0007) [2023-12-27 23:46:37,816][106225] Updated weights for policy 1, policy_version 632813 (0.0008) [2023-12-27 23:46:37,876][106225] Updated weights for policy 1, policy_version 632823 (0.0005) [2023-12-27 23:46:37,945][106225] Updated weights for policy 1, policy_version 632833 (0.0005) [2023-12-27 23:46:37,998][106226] Updated weights for policy 0, policy_version 630968 (0.0010) [2023-12-27 23:46:38,048][106226] Updated weights for policy 0, policy_version 630978 (0.0010) [2023-12-27 23:46:38,095][106226] Updated weights for policy 0, policy_version 630988 (0.0010) [2023-12-27 23:46:38,497][106225] Updated weights for policy 1, policy_version 632843 (0.0006) [2023-12-27 23:46:38,555][106225] Updated weights for policy 1, policy_version 632853 (0.0009) [2023-12-27 23:46:38,613][106225] Updated weights for policy 1, policy_version 632863 (0.0008) [2023-12-27 23:46:38,788][106226] Updated weights for policy 0, policy_version 630998 (0.0007) [2023-12-27 23:46:38,849][106226] Updated weights for policy 0, policy_version 631008 (0.0009) [2023-12-27 23:46:38,902][106226] Updated weights for policy 0, policy_version 631018 (0.0010) [2023-12-27 23:46:39,416][106225] Updated weights for policy 1, policy_version 632873 (0.0009) [2023-12-27 23:46:39,477][106225] Updated weights for policy 1, policy_version 632883 (0.0008) [2023-12-27 23:46:39,538][106225] Updated weights for policy 1, policy_version 632893 (0.0008) [2023-12-27 23:46:39,560][106226] Updated weights for policy 0, policy_version 631028 (0.0008) [2023-12-27 23:46:39,603][106225] Updated weights for policy 1, policy_version 632903 (0.0006) [2023-12-27 23:46:39,620][106226] Updated weights for policy 0, policy_version 631038 (0.0008) [2023-12-27 23:46:39,684][106226] Updated weights for policy 0, policy_version 631048 (0.0009) [2023-12-27 23:46:40,358][106225] Updated weights for policy 1, policy_version 632913 (0.0008) [2023-12-27 23:46:40,406][106225] Updated weights for policy 1, policy_version 632923 (0.0008) [2023-12-27 23:46:40,456][106226] Updated weights for policy 0, policy_version 631058 (0.0008) [2023-12-27 23:46:40,473][106225] Updated weights for policy 1, policy_version 632933 (0.0006) [2023-12-27 23:46:40,509][106226] Updated weights for policy 0, policy_version 631068 (0.0008) [2023-12-27 23:46:40,578][106226] Updated weights for policy 0, policy_version 631078 (0.0008) [2023-12-27 23:46:40,651][106226] Updated weights for policy 0, policy_version 631088 (0.0008) [2023-12-27 23:46:41,057][106225] Updated weights for policy 1, policy_version 632943 (0.0007) [2023-12-27 23:46:41,116][106225] Updated weights for policy 1, policy_version 632953 (0.0006) [2023-12-27 23:46:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 323657728. Throughput: 0: 9786.1, 1: 9821.6. Samples: 323633268. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:41,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-5.671')] [2023-12-27 23:46:41,182][106225] Updated weights for policy 1, policy_version 632963 (0.0008) [2023-12-27 23:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000631088_161595392.pth... [2023-12-27 23:46:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000629968_161308672.pth [2023-12-27 23:46:41,211][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000632968_162070528.pth... [2023-12-27 23:46:41,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000631792_161767424.pth [2023-12-27 23:46:41,391][106226] Updated weights for policy 0, policy_version 631098 (0.0009) [2023-12-27 23:46:41,448][106226] Updated weights for policy 0, policy_version 631108 (0.0008) [2023-12-27 23:46:41,503][106226] Updated weights for policy 0, policy_version 631118 (0.0010) [2023-12-27 23:46:41,942][106225] Updated weights for policy 1, policy_version 632973 (0.0009) [2023-12-27 23:46:41,998][106225] Updated weights for policy 1, policy_version 632983 (0.0009) [2023-12-27 23:46:42,048][106225] Updated weights for policy 1, policy_version 632993 (0.0008) [2023-12-27 23:46:42,226][106226] Updated weights for policy 0, policy_version 631128 (0.0009) [2023-12-27 23:46:42,294][106226] Updated weights for policy 0, policy_version 631138 (0.0008) [2023-12-27 23:46:42,361][106226] Updated weights for policy 0, policy_version 631148 (0.0008) [2023-12-27 23:46:42,801][106225] Updated weights for policy 1, policy_version 633003 (0.0007) [2023-12-27 23:46:42,863][106225] Updated weights for policy 1, policy_version 633013 (0.0005) [2023-12-27 23:46:42,921][106225] Updated weights for policy 1, policy_version 633023 (0.0007) [2023-12-27 23:46:43,079][106226] Updated weights for policy 0, policy_version 631158 (0.0007) [2023-12-27 23:46:43,136][106226] Updated weights for policy 0, policy_version 631168 (0.0008) [2023-12-27 23:46:43,200][106226] Updated weights for policy 0, policy_version 631178 (0.0006) [2023-12-27 23:46:43,563][106225] Updated weights for policy 1, policy_version 633033 (0.0009) [2023-12-27 23:46:43,625][106225] Updated weights for policy 1, policy_version 633043 (0.0009) [2023-12-27 23:46:43,675][106225] Updated weights for policy 1, policy_version 633053 (0.0009) [2023-12-27 23:46:43,728][106225] Updated weights for policy 1, policy_version 633063 (0.0008) [2023-12-27 23:46:43,785][106226] Updated weights for policy 0, policy_version 631188 (0.0007) [2023-12-27 23:46:43,833][106226] Updated weights for policy 0, policy_version 631198 (0.0008) [2023-12-27 23:46:43,886][106226] Updated weights for policy 0, policy_version 631208 (0.0011) [2023-12-27 23:46:44,417][106225] Updated weights for policy 1, policy_version 633073 (0.0006) [2023-12-27 23:46:44,482][106225] Updated weights for policy 1, policy_version 633083 (0.0008) [2023-12-27 23:46:44,539][106225] Updated weights for policy 1, policy_version 633093 (0.0010) [2023-12-27 23:46:44,614][106226] Updated weights for policy 0, policy_version 631218 (0.0010) [2023-12-27 23:46:44,667][106226] Updated weights for policy 0, policy_version 631228 (0.0008) [2023-12-27 23:46:44,729][106226] Updated weights for policy 0, policy_version 631238 (0.0007) [2023-12-27 23:46:44,789][106226] Updated weights for policy 0, policy_version 631248 (0.0008) [2023-12-27 23:46:45,244][106225] Updated weights for policy 1, policy_version 633103 (0.0009) [2023-12-27 23:46:45,304][106225] Updated weights for policy 1, policy_version 633113 (0.0008) [2023-12-27 23:46:45,361][106225] Updated weights for policy 1, policy_version 633123 (0.0007) [2023-12-27 23:46:45,560][106226] Updated weights for policy 0, policy_version 631258 (0.0009) [2023-12-27 23:46:45,615][106226] Updated weights for policy 0, policy_version 631268 (0.0009) [2023-12-27 23:46:45,676][106226] Updated weights for policy 0, policy_version 631278 (0.0008) [2023-12-27 23:46:46,048][106225] Updated weights for policy 1, policy_version 633133 (0.0007) [2023-12-27 23:46:46,105][106225] Updated weights for policy 1, policy_version 633143 (0.0010) [2023-12-27 23:46:46,158][106225] Updated weights for policy 1, policy_version 633153 (0.0008) [2023-12-27 23:46:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 323756032. Throughput: 0: 9832.2, 1: 9835.5. Samples: 323750420. Policy #0 lag: (min: 3.0, avg: 12.3, max: 35.0) [2023-12-27 23:46:46,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-5.675')] [2023-12-27 23:46:46,480][106226] Updated weights for policy 0, policy_version 631288 (0.0008) [2023-12-27 23:46:46,545][106226] Updated weights for policy 0, policy_version 631298 (0.0009) [2023-12-27 23:46:46,607][106226] Updated weights for policy 0, policy_version 631308 (0.0009) [2023-12-27 23:46:46,750][106225] Updated weights for policy 1, policy_version 633163 (0.0006) [2023-12-27 23:46:46,807][106225] Updated weights for policy 1, policy_version 633173 (0.0005) [2023-12-27 23:46:46,861][106225] Updated weights for policy 1, policy_version 633183 (0.0005) [2023-12-27 23:46:47,392][106226] Updated weights for policy 0, policy_version 631318 (0.0010) [2023-12-27 23:46:47,413][106225] Updated weights for policy 1, policy_version 633193 (0.0005) [2023-12-27 23:46:47,440][106226] Updated weights for policy 0, policy_version 631328 (0.0007) [2023-12-27 23:46:47,479][106225] Updated weights for policy 1, policy_version 633203 (0.0005) [2023-12-27 23:46:47,500][106226] Updated weights for policy 0, policy_version 631338 (0.0007) [2023-12-27 23:46:47,546][106225] Updated weights for policy 1, policy_version 633213 (0.0005) [2023-12-27 23:46:47,609][106225] Updated weights for policy 1, policy_version 633223 (0.0005) [2023-12-27 23:46:48,163][106225] Updated weights for policy 1, policy_version 633233 (0.0007) [2023-12-27 23:46:48,217][106226] Updated weights for policy 0, policy_version 631348 (0.0008) [2023-12-27 23:46:48,225][106225] Updated weights for policy 1, policy_version 633243 (0.0010) [2023-12-27 23:46:48,271][106226] Updated weights for policy 0, policy_version 631358 (0.0010) [2023-12-27 23:46:48,275][106225] Updated weights for policy 1, policy_version 633253 (0.0010) [2023-12-27 23:46:48,335][106226] Updated weights for policy 0, policy_version 631368 (0.0011) [2023-12-27 23:46:49,006][106226] Updated weights for policy 0, policy_version 631378 (0.0008) [2023-12-27 23:46:49,017][106225] Updated weights for policy 1, policy_version 633263 (0.0010) [2023-12-27 23:46:49,073][106226] Updated weights for policy 0, policy_version 631388 (0.0010) [2023-12-27 23:46:49,084][106225] Updated weights for policy 1, policy_version 633273 (0.0011) [2023-12-27 23:46:49,134][106226] Updated weights for policy 0, policy_version 631398 (0.0011) [2023-12-27 23:46:49,139][106225] Updated weights for policy 1, policy_version 633283 (0.0010) [2023-12-27 23:46:49,197][106226] Updated weights for policy 0, policy_version 631408 (0.0011) [2023-12-27 23:46:49,873][106225] Updated weights for policy 1, policy_version 633293 (0.0009) [2023-12-27 23:46:49,937][106225] Updated weights for policy 1, policy_version 633303 (0.0008) [2023-12-27 23:46:50,005][106225] Updated weights for policy 1, policy_version 633313 (0.0006) [2023-12-27 23:46:50,010][106226] Updated weights for policy 0, policy_version 631418 (0.0007) [2023-12-27 23:46:50,062][106226] Updated weights for policy 0, policy_version 631428 (0.0010) [2023-12-27 23:46:50,147][106226] Updated weights for policy 0, policy_version 631438 (0.0011) [2023-12-27 23:46:50,713][106225] Updated weights for policy 1, policy_version 633323 (0.0008) [2023-12-27 23:46:50,777][106225] Updated weights for policy 1, policy_version 633333 (0.0008) [2023-12-27 23:46:50,843][106225] Updated weights for policy 1, policy_version 633343 (0.0008) [2023-12-27 23:46:50,894][106226] Updated weights for policy 0, policy_version 631448 (0.0010) [2023-12-27 23:46:50,954][106226] Updated weights for policy 0, policy_version 631458 (0.0011) [2023-12-27 23:46:51,015][106226] Updated weights for policy 0, policy_version 631468 (0.0009) [2023-12-27 23:46:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 323862528. Throughput: 0: 9718.1, 1: 9929.5. Samples: 323868364. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:46:51,175][105115] Avg episode reward: [(0, '-4.917'), (1, '-5.539')] [2023-12-27 23:46:51,592][106225] Updated weights for policy 1, policy_version 633353 (0.0007) [2023-12-27 23:46:51,662][106225] Updated weights for policy 1, policy_version 633363 (0.0010) [2023-12-27 23:46:51,722][106225] Updated weights for policy 1, policy_version 633373 (0.0011) [2023-12-27 23:46:51,789][106225] Updated weights for policy 1, policy_version 633383 (0.0012) [2023-12-27 23:46:51,842][106226] Updated weights for policy 0, policy_version 631478 (0.0008) [2023-12-27 23:46:51,904][106226] Updated weights for policy 0, policy_version 631488 (0.0008) [2023-12-27 23:46:51,965][106226] Updated weights for policy 0, policy_version 631498 (0.0008) [2023-12-27 23:46:52,495][106225] Updated weights for policy 1, policy_version 633393 (0.0007) [2023-12-27 23:46:52,548][106225] Updated weights for policy 1, policy_version 633403 (0.0006) [2023-12-27 23:46:52,608][106225] Updated weights for policy 1, policy_version 633413 (0.0007) [2023-12-27 23:46:52,683][106226] Updated weights for policy 0, policy_version 631508 (0.0007) [2023-12-27 23:46:52,743][106226] Updated weights for policy 0, policy_version 631518 (0.0009) [2023-12-27 23:46:52,801][106226] Updated weights for policy 0, policy_version 631528 (0.0008) [2023-12-27 23:46:53,244][106225] Updated weights for policy 1, policy_version 633423 (0.0009) [2023-12-27 23:46:53,292][106225] Updated weights for policy 1, policy_version 633433 (0.0008) [2023-12-27 23:46:53,341][106225] Updated weights for policy 1, policy_version 633443 (0.0009) [2023-12-27 23:46:53,559][106226] Updated weights for policy 0, policy_version 631538 (0.0009) [2023-12-27 23:46:53,609][106226] Updated weights for policy 0, policy_version 631548 (0.0009) [2023-12-27 23:46:53,658][106226] Updated weights for policy 0, policy_version 631558 (0.0008) [2023-12-27 23:46:53,708][106226] Updated weights for policy 0, policy_version 631568 (0.0009) [2023-12-27 23:46:54,035][106225] Updated weights for policy 1, policy_version 633453 (0.0009) [2023-12-27 23:46:54,092][106225] Updated weights for policy 1, policy_version 633463 (0.0010) [2023-12-27 23:46:54,155][106225] Updated weights for policy 1, policy_version 633473 (0.0010) [2023-12-27 23:46:54,534][106226] Updated weights for policy 0, policy_version 631578 (0.0009) [2023-12-27 23:46:54,581][106226] Updated weights for policy 0, policy_version 631588 (0.0007) [2023-12-27 23:46:54,638][106226] Updated weights for policy 0, policy_version 631598 (0.0008) [2023-12-27 23:46:54,741][106225] Updated weights for policy 1, policy_version 633483 (0.0009) [2023-12-27 23:46:54,800][106225] Updated weights for policy 1, policy_version 633493 (0.0010) [2023-12-27 23:46:54,858][106225] Updated weights for policy 1, policy_version 633503 (0.0010) [2023-12-27 23:46:55,402][106226] Updated weights for policy 0, policy_version 631608 (0.0008) [2023-12-27 23:46:55,467][106226] Updated weights for policy 0, policy_version 631618 (0.0008) [2023-12-27 23:46:55,522][106226] Updated weights for policy 0, policy_version 631628 (0.0008) [2023-12-27 23:46:55,565][106225] Updated weights for policy 1, policy_version 633513 (0.0010) [2023-12-27 23:46:55,624][106225] Updated weights for policy 1, policy_version 633523 (0.0008) [2023-12-27 23:46:55,684][106225] Updated weights for policy 1, policy_version 633533 (0.0008) [2023-12-27 23:46:55,739][106225] Updated weights for policy 1, policy_version 633543 (0.0008) [2023-12-27 23:46:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 323952640. Throughput: 0: 9643.2, 1: 9932.3. Samples: 323924632. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:46:56,176][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.946')] [2023-12-27 23:46:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000633544_162217984.pth... [2023-12-27 23:46:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000631632_161734656.pth... [2023-12-27 23:46:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000632392_161923072.pth [2023-12-27 23:46:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000630512_161447936.pth [2023-12-27 23:46:56,297][106226] Updated weights for policy 0, policy_version 631638 (0.0007) [2023-12-27 23:46:56,339][106225] Updated weights for policy 1, policy_version 633553 (0.0006) [2023-12-27 23:46:56,348][106226] Updated weights for policy 0, policy_version 631648 (0.0007) [2023-12-27 23:46:56,396][106225] Updated weights for policy 1, policy_version 633563 (0.0007) [2023-12-27 23:46:56,408][106226] Updated weights for policy 0, policy_version 631658 (0.0006) [2023-12-27 23:46:56,451][106225] Updated weights for policy 1, policy_version 633573 (0.0006) [2023-12-27 23:46:57,054][106225] Updated weights for policy 1, policy_version 633583 (0.0006) [2023-12-27 23:46:57,099][106225] Updated weights for policy 1, policy_version 633593 (0.0005) [2023-12-27 23:46:57,145][106225] Updated weights for policy 1, policy_version 633603 (0.0005) [2023-12-27 23:46:57,211][106226] Updated weights for policy 0, policy_version 631668 (0.0009) [2023-12-27 23:46:57,280][106226] Updated weights for policy 0, policy_version 631678 (0.0008) [2023-12-27 23:46:57,331][106226] Updated weights for policy 0, policy_version 631688 (0.0006) [2023-12-27 23:46:57,735][106225] Updated weights for policy 1, policy_version 633613 (0.0006) [2023-12-27 23:46:57,790][106225] Updated weights for policy 1, policy_version 633623 (0.0008) [2023-12-27 23:46:57,855][106225] Updated weights for policy 1, policy_version 633633 (0.0005) [2023-12-27 23:46:57,971][106226] Updated weights for policy 0, policy_version 631698 (0.0006) [2023-12-27 23:46:58,028][106226] Updated weights for policy 0, policy_version 631708 (0.0010) [2023-12-27 23:46:58,083][106226] Updated weights for policy 0, policy_version 631718 (0.0010) [2023-12-27 23:46:58,129][106226] Updated weights for policy 0, policy_version 631728 (0.0010) [2023-12-27 23:46:58,493][106225] Updated weights for policy 1, policy_version 633643 (0.0006) [2023-12-27 23:46:58,560][106225] Updated weights for policy 1, policy_version 633653 (0.0008) [2023-12-27 23:46:58,621][106225] Updated weights for policy 1, policy_version 633663 (0.0008) [2023-12-27 23:46:58,904][106226] Updated weights for policy 0, policy_version 631738 (0.0009) [2023-12-27 23:46:58,973][106226] Updated weights for policy 0, policy_version 631748 (0.0008) [2023-12-27 23:46:59,034][106226] Updated weights for policy 0, policy_version 631758 (0.0009) [2023-12-27 23:46:59,469][106225] Updated weights for policy 1, policy_version 633673 (0.0008) [2023-12-27 23:46:59,531][106225] Updated weights for policy 1, policy_version 633683 (0.0007) [2023-12-27 23:46:59,600][106225] Updated weights for policy 1, policy_version 633693 (0.0010) [2023-12-27 23:46:59,655][106225] Updated weights for policy 1, policy_version 633703 (0.0010) [2023-12-27 23:46:59,779][106226] Updated weights for policy 0, policy_version 631768 (0.0008) [2023-12-27 23:46:59,840][106226] Updated weights for policy 0, policy_version 631778 (0.0008) [2023-12-27 23:46:59,903][106226] Updated weights for policy 0, policy_version 631788 (0.0006) [2023-12-27 23:47:00,357][106225] Updated weights for policy 1, policy_version 633713 (0.0006) [2023-12-27 23:47:00,421][106225] Updated weights for policy 1, policy_version 633723 (0.0007) [2023-12-27 23:47:00,487][106225] Updated weights for policy 1, policy_version 633733 (0.0006) [2023-12-27 23:47:00,589][106226] Updated weights for policy 0, policy_version 631798 (0.0007) [2023-12-27 23:47:00,659][106226] Updated weights for policy 0, policy_version 631808 (0.0006) [2023-12-27 23:47:00,727][106226] Updated weights for policy 0, policy_version 631818 (0.0006) [2023-12-27 23:47:01,172][106225] Updated weights for policy 1, policy_version 633743 (0.0007) [2023-12-27 23:47:01,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 324050944. Throughput: 0: 9679.0, 1: 9982.2. Samples: 324043404. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:01,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-5.934')] [2023-12-27 23:47:01,241][106225] Updated weights for policy 1, policy_version 633753 (0.0007) [2023-12-27 23:47:01,296][106225] Updated weights for policy 1, policy_version 633763 (0.0010) [2023-12-27 23:47:01,388][106226] Updated weights for policy 0, policy_version 631828 (0.0008) [2023-12-27 23:47:01,445][106226] Updated weights for policy 0, policy_version 631838 (0.0008) [2023-12-27 23:47:01,500][106226] Updated weights for policy 0, policy_version 631848 (0.0008) [2023-12-27 23:47:02,028][106225] Updated weights for policy 1, policy_version 633773 (0.0010) [2023-12-27 23:47:02,084][106225] Updated weights for policy 1, policy_version 633783 (0.0010) [2023-12-27 23:47:02,137][106225] Updated weights for policy 1, policy_version 633793 (0.0010) [2023-12-27 23:47:02,214][106226] Updated weights for policy 0, policy_version 631858 (0.0007) [2023-12-27 23:47:02,275][106226] Updated weights for policy 0, policy_version 631868 (0.0006) [2023-12-27 23:47:02,341][106226] Updated weights for policy 0, policy_version 631878 (0.0006) [2023-12-27 23:47:02,399][106226] Updated weights for policy 0, policy_version 631888 (0.0007) [2023-12-27 23:47:02,863][106225] Updated weights for policy 1, policy_version 633803 (0.0010) [2023-12-27 23:47:02,925][106225] Updated weights for policy 1, policy_version 633813 (0.0010) [2023-12-27 23:47:02,968][106225] Updated weights for policy 1, policy_version 633823 (0.0010) [2023-12-27 23:47:03,035][106226] Updated weights for policy 0, policy_version 631898 (0.0005) [2023-12-27 23:47:03,096][106226] Updated weights for policy 0, policy_version 631908 (0.0005) [2023-12-27 23:47:03,152][106226] Updated weights for policy 0, policy_version 631918 (0.0008) [2023-12-27 23:47:03,588][106225] Updated weights for policy 1, policy_version 633833 (0.0009) [2023-12-27 23:47:03,639][106225] Updated weights for policy 1, policy_version 633843 (0.0005) [2023-12-27 23:47:03,688][106225] Updated weights for policy 1, policy_version 633853 (0.0005) [2023-12-27 23:47:03,733][106225] Updated weights for policy 1, policy_version 633863 (0.0007) [2023-12-27 23:47:03,765][106226] Updated weights for policy 0, policy_version 631928 (0.0006) [2023-12-27 23:47:03,821][106226] Updated weights for policy 0, policy_version 631938 (0.0005) [2023-12-27 23:47:03,887][106226] Updated weights for policy 0, policy_version 631948 (0.0010) [2023-12-27 23:47:04,452][106225] Updated weights for policy 1, policy_version 633873 (0.0009) [2023-12-27 23:47:04,510][106225] Updated weights for policy 1, policy_version 633883 (0.0009) [2023-12-27 23:47:04,521][106226] Updated weights for policy 0, policy_version 631958 (0.0008) [2023-12-27 23:47:04,561][106225] Updated weights for policy 1, policy_version 633893 (0.0009) [2023-12-27 23:47:04,568][106226] Updated weights for policy 0, policy_version 631968 (0.0005) [2023-12-27 23:47:04,623][106226] Updated weights for policy 0, policy_version 631978 (0.0005) [2023-12-27 23:47:05,219][106226] Updated weights for policy 0, policy_version 631988 (0.0007) [2023-12-27 23:47:05,281][106226] Updated weights for policy 0, policy_version 631998 (0.0007) [2023-12-27 23:47:05,302][106225] Updated weights for policy 1, policy_version 633904 (0.0006) [2023-12-27 23:47:05,332][106226] Updated weights for policy 0, policy_version 632008 (0.0010) [2023-12-27 23:47:05,353][106225] Updated weights for policy 1, policy_version 633914 (0.0005) [2023-12-27 23:47:05,407][106225] Updated weights for policy 1, policy_version 633924 (0.0007) [2023-12-27 23:47:06,041][106226] Updated weights for policy 0, policy_version 632018 (0.0010) [2023-12-27 23:47:06,102][106226] Updated weights for policy 0, policy_version 632028 (0.0008) [2023-12-27 23:47:06,131][106225] Updated weights for policy 1, policy_version 633934 (0.0008) [2023-12-27 23:47:06,171][106226] Updated weights for policy 0, policy_version 632038 (0.0009) [2023-12-27 23:47:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 324149248. Throughput: 0: 9723.7, 1: 10006.9. Samples: 324165724. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:06,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-5.823')] [2023-12-27 23:47:06,194][106225] Updated weights for policy 1, policy_version 633944 (0.0006) [2023-12-27 23:47:06,232][106226] Updated weights for policy 0, policy_version 632048 (0.0008) [2023-12-27 23:47:06,252][106225] Updated weights for policy 1, policy_version 633954 (0.0006) [2023-12-27 23:47:06,932][106225] Updated weights for policy 1, policy_version 633964 (0.0007) [2023-12-27 23:47:06,990][106225] Updated weights for policy 1, policy_version 633974 (0.0008) [2023-12-27 23:47:07,019][106226] Updated weights for policy 0, policy_version 632058 (0.0009) [2023-12-27 23:47:07,048][106225] Updated weights for policy 1, policy_version 633984 (0.0006) [2023-12-27 23:47:07,081][106226] Updated weights for policy 0, policy_version 632068 (0.0007) [2023-12-27 23:47:07,134][106226] Updated weights for policy 0, policy_version 632078 (0.0007) [2023-12-27 23:47:07,686][106225] Updated weights for policy 1, policy_version 633994 (0.0007) [2023-12-27 23:47:07,737][106225] Updated weights for policy 1, policy_version 634004 (0.0006) [2023-12-27 23:47:07,782][106226] Updated weights for policy 0, policy_version 632088 (0.0006) [2023-12-27 23:47:07,791][106225] Updated weights for policy 1, policy_version 634014 (0.0010) [2023-12-27 23:47:07,837][106226] Updated weights for policy 0, policy_version 632098 (0.0005) [2023-12-27 23:47:07,854][106225] Updated weights for policy 1, policy_version 634024 (0.0008) [2023-12-27 23:47:07,890][106226] Updated weights for policy 0, policy_version 632108 (0.0006) [2023-12-27 23:47:08,539][106226] Updated weights for policy 0, policy_version 632118 (0.0009) [2023-12-27 23:47:08,545][106225] Updated weights for policy 1, policy_version 634034 (0.0006) [2023-12-27 23:47:08,597][106226] Updated weights for policy 0, policy_version 632128 (0.0011) [2023-12-27 23:47:08,607][106225] Updated weights for policy 1, policy_version 634044 (0.0006) [2023-12-27 23:47:08,651][106226] Updated weights for policy 0, policy_version 632138 (0.0011) [2023-12-27 23:47:08,668][106225] Updated weights for policy 1, policy_version 634054 (0.0010) [2023-12-27 23:47:09,246][106226] Updated weights for policy 0, policy_version 632148 (0.0009) [2023-12-27 23:47:09,311][106226] Updated weights for policy 0, policy_version 632158 (0.0008) [2023-12-27 23:47:09,335][106225] Updated weights for policy 1, policy_version 634064 (0.0007) [2023-12-27 23:47:09,378][106226] Updated weights for policy 0, policy_version 632168 (0.0009) [2023-12-27 23:47:09,404][106225] Updated weights for policy 1, policy_version 634074 (0.0008) [2023-12-27 23:47:09,467][106225] Updated weights for policy 1, policy_version 634084 (0.0008) [2023-12-27 23:47:10,116][106226] Updated weights for policy 0, policy_version 632178 (0.0011) [2023-12-27 23:47:10,127][106225] Updated weights for policy 1, policy_version 634094 (0.0007) [2023-12-27 23:47:10,167][106226] Updated weights for policy 0, policy_version 632188 (0.0007) [2023-12-27 23:47:10,177][106225] Updated weights for policy 1, policy_version 634104 (0.0007) [2023-12-27 23:47:10,231][106226] Updated weights for policy 0, policy_version 632198 (0.0008) [2023-12-27 23:47:10,242][106225] Updated weights for policy 1, policy_version 634114 (0.0006) [2023-12-27 23:47:10,290][106226] Updated weights for policy 0, policy_version 632208 (0.0009) [2023-12-27 23:47:10,967][106225] Updated weights for policy 1, policy_version 634124 (0.0007) [2023-12-27 23:47:10,980][106226] Updated weights for policy 0, policy_version 632218 (0.0008) [2023-12-27 23:47:11,020][106225] Updated weights for policy 1, policy_version 634134 (0.0007) [2023-12-27 23:47:11,047][106226] Updated weights for policy 0, policy_version 632228 (0.0007) [2023-12-27 23:47:11,084][106225] Updated weights for policy 1, policy_version 634144 (0.0009) [2023-12-27 23:47:11,113][106226] Updated weights for policy 0, policy_version 632238 (0.0007) [2023-12-27 23:47:11,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 324263936. Throughput: 0: 9780.0, 1: 10041.5. Samples: 324227224. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:11,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-5.997')] [2023-12-27 23:47:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000634152_162373632.pth... [2023-12-27 23:47:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000632240_161890304.pth... [2023-12-27 23:47:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000631088_161595392.pth [2023-12-27 23:47:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000632968_162070528.pth [2023-12-27 23:47:11,860][106226] Updated weights for policy 0, policy_version 632248 (0.0006) [2023-12-27 23:47:11,926][106226] Updated weights for policy 0, policy_version 632258 (0.0007) [2023-12-27 23:47:11,958][106225] Updated weights for policy 1, policy_version 634154 (0.0009) [2023-12-27 23:47:11,990][106226] Updated weights for policy 0, policy_version 632268 (0.0008) [2023-12-27 23:47:12,022][106225] Updated weights for policy 1, policy_version 634164 (0.0009) [2023-12-27 23:47:12,090][106225] Updated weights for policy 1, policy_version 634174 (0.0011) [2023-12-27 23:47:12,148][106225] Updated weights for policy 1, policy_version 634184 (0.0011) [2023-12-27 23:47:12,701][106226] Updated weights for policy 0, policy_version 632278 (0.0010) [2023-12-27 23:47:12,766][106226] Updated weights for policy 0, policy_version 632288 (0.0011) [2023-12-27 23:47:12,824][106226] Updated weights for policy 0, policy_version 632298 (0.0011) [2023-12-27 23:47:12,858][106225] Updated weights for policy 1, policy_version 634194 (0.0007) [2023-12-27 23:47:12,918][106225] Updated weights for policy 1, policy_version 634204 (0.0010) [2023-12-27 23:47:12,978][106225] Updated weights for policy 1, policy_version 634214 (0.0010) [2023-12-27 23:47:13,496][106226] Updated weights for policy 0, policy_version 632308 (0.0008) [2023-12-27 23:47:13,549][106226] Updated weights for policy 0, policy_version 632318 (0.0007) [2023-12-27 23:47:13,601][106226] Updated weights for policy 0, policy_version 632328 (0.0005) [2023-12-27 23:47:13,606][106225] Updated weights for policy 1, policy_version 634224 (0.0010) [2023-12-27 23:47:13,656][106225] Updated weights for policy 1, policy_version 634234 (0.0010) [2023-12-27 23:47:13,717][106225] Updated weights for policy 1, policy_version 634244 (0.0010) [2023-12-27 23:47:14,124][106226] Updated weights for policy 0, policy_version 632338 (0.0006) [2023-12-27 23:47:14,181][106226] Updated weights for policy 0, policy_version 632348 (0.0007) [2023-12-27 23:47:14,237][106226] Updated weights for policy 0, policy_version 632358 (0.0006) [2023-12-27 23:47:14,293][106226] Updated weights for policy 0, policy_version 632368 (0.0005) [2023-12-27 23:47:14,368][106225] Updated weights for policy 1, policy_version 634254 (0.0007) [2023-12-27 23:47:14,432][106225] Updated weights for policy 1, policy_version 634264 (0.0009) [2023-12-27 23:47:14,491][106225] Updated weights for policy 1, policy_version 634274 (0.0010) [2023-12-27 23:47:15,012][106226] Updated weights for policy 0, policy_version 632378 (0.0009) [2023-12-27 23:47:15,071][106226] Updated weights for policy 0, policy_version 632388 (0.0008) [2023-12-27 23:47:15,135][106226] Updated weights for policy 0, policy_version 632398 (0.0008) [2023-12-27 23:47:15,150][106225] Updated weights for policy 1, policy_version 634284 (0.0010) [2023-12-27 23:47:15,213][106225] Updated weights for policy 1, policy_version 634294 (0.0011) [2023-12-27 23:47:15,275][106225] Updated weights for policy 1, policy_version 634304 (0.0010) [2023-12-27 23:47:15,819][106226] Updated weights for policy 0, policy_version 632408 (0.0008) [2023-12-27 23:47:15,883][106226] Updated weights for policy 0, policy_version 632418 (0.0008) [2023-12-27 23:47:15,947][106226] Updated weights for policy 0, policy_version 632428 (0.0007) [2023-12-27 23:47:16,014][106225] Updated weights for policy 1, policy_version 634314 (0.0011) [2023-12-27 23:47:16,076][106225] Updated weights for policy 1, policy_version 634324 (0.0008) [2023-12-27 23:47:16,138][106225] Updated weights for policy 1, policy_version 634334 (0.0005) [2023-12-27 23:47:16,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 324354048. Throughput: 0: 9753.1, 1: 10042.5. Samples: 324345768. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:16,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-5.997')] [2023-12-27 23:47:16,202][106225] Updated weights for policy 1, policy_version 634344 (0.0007) [2023-12-27 23:47:16,631][106226] Updated weights for policy 0, policy_version 632438 (0.0008) [2023-12-27 23:47:16,685][106226] Updated weights for policy 0, policy_version 632448 (0.0008) [2023-12-27 23:47:16,744][106226] Updated weights for policy 0, policy_version 632458 (0.0008) [2023-12-27 23:47:16,874][106225] Updated weights for policy 1, policy_version 634354 (0.0006) [2023-12-27 23:47:16,927][106225] Updated weights for policy 1, policy_version 634364 (0.0005) [2023-12-27 23:47:16,983][106225] Updated weights for policy 1, policy_version 634374 (0.0006) [2023-12-27 23:47:17,502][106226] Updated weights for policy 0, policy_version 632468 (0.0009) [2023-12-27 23:47:17,563][106226] Updated weights for policy 0, policy_version 632478 (0.0008) [2023-12-27 23:47:17,583][106225] Updated weights for policy 1, policy_version 634384 (0.0006) [2023-12-27 23:47:17,623][106226] Updated weights for policy 0, policy_version 632488 (0.0009) [2023-12-27 23:47:17,631][106225] Updated weights for policy 1, policy_version 634394 (0.0005) [2023-12-27 23:47:17,685][106225] Updated weights for policy 1, policy_version 634404 (0.0005) [2023-12-27 23:47:18,304][106226] Updated weights for policy 0, policy_version 632498 (0.0006) [2023-12-27 23:47:18,368][106226] Updated weights for policy 0, policy_version 632508 (0.0007) [2023-12-27 23:47:18,373][106225] Updated weights for policy 1, policy_version 634414 (0.0008) [2023-12-27 23:47:18,424][106226] Updated weights for policy 0, policy_version 632518 (0.0008) [2023-12-27 23:47:18,434][106225] Updated weights for policy 1, policy_version 634424 (0.0008) [2023-12-27 23:47:18,479][106226] Updated weights for policy 0, policy_version 632528 (0.0005) [2023-12-27 23:47:18,493][106225] Updated weights for policy 1, policy_version 634434 (0.0007) [2023-12-27 23:47:19,175][106225] Updated weights for policy 1, policy_version 634444 (0.0007) [2023-12-27 23:47:19,252][106225] Updated weights for policy 1, policy_version 634454 (0.0007) [2023-12-27 23:47:19,263][106226] Updated weights for policy 0, policy_version 632538 (0.0008) [2023-12-27 23:47:19,310][106225] Updated weights for policy 1, policy_version 634464 (0.0008) [2023-12-27 23:47:19,324][106226] Updated weights for policy 0, policy_version 632548 (0.0009) [2023-12-27 23:47:19,406][106226] Updated weights for policy 0, policy_version 632558 (0.0009) [2023-12-27 23:47:20,038][106225] Updated weights for policy 1, policy_version 634474 (0.0007) [2023-12-27 23:47:20,091][106225] Updated weights for policy 1, policy_version 634484 (0.0005) [2023-12-27 23:47:20,145][106225] Updated weights for policy 1, policy_version 634494 (0.0006) [2023-12-27 23:47:20,209][106225] Updated weights for policy 1, policy_version 634504 (0.0009) [2023-12-27 23:47:20,285][106226] Updated weights for policy 0, policy_version 632568 (0.0008) [2023-12-27 23:47:20,340][106226] Updated weights for policy 0, policy_version 632578 (0.0007) [2023-12-27 23:47:20,407][106226] Updated weights for policy 0, policy_version 632588 (0.0008) [2023-12-27 23:47:20,915][106225] Updated weights for policy 1, policy_version 634514 (0.0009) [2023-12-27 23:47:20,968][106225] Updated weights for policy 1, policy_version 634524 (0.0009) [2023-12-27 23:47:21,024][106225] Updated weights for policy 1, policy_version 634534 (0.0008) [2023-12-27 23:47:21,135][106226] Updated weights for policy 0, policy_version 632598 (0.0007) [2023-12-27 23:47:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 324452352. Throughput: 0: 9712.3, 1: 10054.6. Samples: 324462924. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:21,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-6.040')] [2023-12-27 23:47:21,205][106226] Updated weights for policy 0, policy_version 632608 (0.0007) [2023-12-27 23:47:21,275][106226] Updated weights for policy 0, policy_version 632618 (0.0008) [2023-12-27 23:47:21,844][106225] Updated weights for policy 1, policy_version 634544 (0.0010) [2023-12-27 23:47:21,911][106225] Updated weights for policy 1, policy_version 634554 (0.0008) [2023-12-27 23:47:21,986][106225] Updated weights for policy 1, policy_version 634564 (0.0010) [2023-12-27 23:47:22,051][106226] Updated weights for policy 0, policy_version 632628 (0.0008) [2023-12-27 23:47:22,117][106226] Updated weights for policy 0, policy_version 632638 (0.0008) [2023-12-27 23:47:22,181][106226] Updated weights for policy 0, policy_version 632648 (0.0008) [2023-12-27 23:47:22,689][106225] Updated weights for policy 1, policy_version 634574 (0.0009) [2023-12-27 23:47:22,747][106225] Updated weights for policy 1, policy_version 634584 (0.0008) [2023-12-27 23:47:22,805][106225] Updated weights for policy 1, policy_version 634594 (0.0005) [2023-12-27 23:47:22,971][106226] Updated weights for policy 0, policy_version 632658 (0.0009) [2023-12-27 23:47:23,031][106226] Updated weights for policy 0, policy_version 632668 (0.0009) [2023-12-27 23:47:23,085][106226] Updated weights for policy 0, policy_version 632678 (0.0007) [2023-12-27 23:47:23,143][106226] Updated weights for policy 0, policy_version 632688 (0.0008) [2023-12-27 23:47:23,412][106225] Updated weights for policy 1, policy_version 634604 (0.0006) [2023-12-27 23:47:23,461][106225] Updated weights for policy 1, policy_version 634614 (0.0005) [2023-12-27 23:47:23,510][106225] Updated weights for policy 1, policy_version 634624 (0.0005) [2023-12-27 23:47:23,732][106226] Updated weights for policy 0, policy_version 632698 (0.0010) [2023-12-27 23:47:23,794][106226] Updated weights for policy 0, policy_version 632708 (0.0008) [2023-12-27 23:47:23,860][106226] Updated weights for policy 0, policy_version 632718 (0.0009) [2023-12-27 23:47:24,130][106225] Updated weights for policy 1, policy_version 634634 (0.0008) [2023-12-27 23:47:24,198][106225] Updated weights for policy 1, policy_version 634644 (0.0008) [2023-12-27 23:47:24,255][106225] Updated weights for policy 1, policy_version 634654 (0.0008) [2023-12-27 23:47:24,308][106225] Updated weights for policy 1, policy_version 634664 (0.0008) [2023-12-27 23:47:24,515][106226] Updated weights for policy 0, policy_version 632728 (0.0007) [2023-12-27 23:47:24,570][106226] Updated weights for policy 0, policy_version 632738 (0.0007) [2023-12-27 23:47:24,631][106226] Updated weights for policy 0, policy_version 632748 (0.0008) [2023-12-27 23:47:24,954][106225] Updated weights for policy 1, policy_version 634674 (0.0005) [2023-12-27 23:47:25,000][106225] Updated weights for policy 1, policy_version 634684 (0.0005) [2023-12-27 23:47:25,049][106225] Updated weights for policy 1, policy_version 634694 (0.0005) [2023-12-27 23:47:25,363][106226] Updated weights for policy 0, policy_version 632758 (0.0008) [2023-12-27 23:47:25,415][106226] Updated weights for policy 0, policy_version 632768 (0.0009) [2023-12-27 23:47:25,460][106226] Updated weights for policy 0, policy_version 632778 (0.0008) [2023-12-27 23:47:25,647][106225] Updated weights for policy 1, policy_version 634704 (0.0009) [2023-12-27 23:47:25,703][106225] Updated weights for policy 1, policy_version 634714 (0.0010) [2023-12-27 23:47:25,749][106225] Updated weights for policy 1, policy_version 634724 (0.0010) [2023-12-27 23:47:26,148][106226] Updated weights for policy 0, policy_version 632788 (0.0007) [2023-12-27 23:47:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 324550656. Throughput: 0: 9667.6, 1: 10062.0. Samples: 324521104. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:26,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-5.673')] [2023-12-27 23:47:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000634728_162521088.pth... [2023-12-27 23:47:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000633544_162217984.pth [2023-12-27 23:47:26,205][106226] Updated weights for policy 0, policy_version 632798 (0.0006) [2023-12-27 23:47:26,267][106226] Updated weights for policy 0, policy_version 632808 (0.0006) [2023-12-27 23:47:26,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000632816_162037760.pth... [2023-12-27 23:47:26,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000631632_161734656.pth [2023-12-27 23:47:26,407][106225] Updated weights for policy 1, policy_version 634734 (0.0007) [2023-12-27 23:47:26,466][106225] Updated weights for policy 1, policy_version 634744 (0.0005) [2023-12-27 23:47:26,535][106225] Updated weights for policy 1, policy_version 634754 (0.0008) [2023-12-27 23:47:26,924][106226] Updated weights for policy 0, policy_version 632818 (0.0008) [2023-12-27 23:47:26,973][106226] Updated weights for policy 0, policy_version 632828 (0.0008) [2023-12-27 23:47:27,033][106226] Updated weights for policy 0, policy_version 632838 (0.0008) [2023-12-27 23:47:27,047][106225] Updated weights for policy 1, policy_version 634764 (0.0008) [2023-12-27 23:47:27,090][106226] Updated weights for policy 0, policy_version 632848 (0.0007) [2023-12-27 23:47:27,112][106225] Updated weights for policy 1, policy_version 634774 (0.0008) [2023-12-27 23:47:27,171][106225] Updated weights for policy 1, policy_version 634784 (0.0010) [2023-12-27 23:47:27,785][106226] Updated weights for policy 0, policy_version 632858 (0.0010) [2023-12-27 23:47:27,831][106226] Updated weights for policy 0, policy_version 632868 (0.0010) [2023-12-27 23:47:27,860][106225] Updated weights for policy 1, policy_version 634794 (0.0010) [2023-12-27 23:47:27,878][106226] Updated weights for policy 0, policy_version 632878 (0.0010) [2023-12-27 23:47:27,912][106225] Updated weights for policy 1, policy_version 634804 (0.0010) [2023-12-27 23:47:27,972][106225] Updated weights for policy 1, policy_version 634814 (0.0010) [2023-12-27 23:47:28,025][106225] Updated weights for policy 1, policy_version 634824 (0.0010) [2023-12-27 23:47:28,453][106226] Updated weights for policy 0, policy_version 632888 (0.0008) [2023-12-27 23:47:28,503][106226] Updated weights for policy 0, policy_version 632898 (0.0010) [2023-12-27 23:47:28,560][106226] Updated weights for policy 0, policy_version 632908 (0.0007) [2023-12-27 23:47:28,745][106225] Updated weights for policy 1, policy_version 634834 (0.0007) [2023-12-27 23:47:28,797][106225] Updated weights for policy 1, policy_version 634844 (0.0008) [2023-12-27 23:47:28,858][106225] Updated weights for policy 1, policy_version 634854 (0.0009) [2023-12-27 23:47:29,212][106226] Updated weights for policy 0, policy_version 632918 (0.0007) [2023-12-27 23:47:29,273][106226] Updated weights for policy 0, policy_version 632928 (0.0007) [2023-12-27 23:47:29,334][106226] Updated weights for policy 0, policy_version 632938 (0.0011) [2023-12-27 23:47:29,528][106225] Updated weights for policy 1, policy_version 634864 (0.0010) [2023-12-27 23:47:29,589][106225] Updated weights for policy 1, policy_version 634874 (0.0006) [2023-12-27 23:47:29,645][106225] Updated weights for policy 1, policy_version 634884 (0.0006) [2023-12-27 23:47:29,971][106226] Updated weights for policy 0, policy_version 632948 (0.0010) [2023-12-27 23:47:30,032][106226] Updated weights for policy 0, policy_version 632958 (0.0007) [2023-12-27 23:47:30,089][106226] Updated weights for policy 0, policy_version 632968 (0.0009) [2023-12-27 23:47:30,294][106225] Updated weights for policy 1, policy_version 634894 (0.0009) [2023-12-27 23:47:30,352][106225] Updated weights for policy 1, policy_version 634904 (0.0007) [2023-12-27 23:47:30,406][106225] Updated weights for policy 1, policy_version 634914 (0.0008) [2023-12-27 23:47:30,744][106226] Updated weights for policy 0, policy_version 632978 (0.0009) [2023-12-27 23:47:30,807][106226] Updated weights for policy 0, policy_version 632988 (0.0006) [2023-12-27 23:47:30,865][106226] Updated weights for policy 0, policy_version 632998 (0.0006) [2023-12-27 23:47:30,924][106226] Updated weights for policy 0, policy_version 633008 (0.0006) [2023-12-27 23:47:31,076][106225] Updated weights for policy 1, policy_version 634924 (0.0007) [2023-12-27 23:47:31,146][106225] Updated weights for policy 1, policy_version 634934 (0.0008) [2023-12-27 23:47:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 324657152. Throughput: 0: 9773.8, 1: 10176.7. Samples: 324648192. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:31,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-5.564')] [2023-12-27 23:47:31,211][106225] Updated weights for policy 1, policy_version 634944 (0.0006) [2023-12-27 23:47:31,567][106226] Updated weights for policy 0, policy_version 633018 (0.0009) [2023-12-27 23:47:31,637][106226] Updated weights for policy 0, policy_version 633028 (0.0009) [2023-12-27 23:47:31,700][106226] Updated weights for policy 0, policy_version 633038 (0.0007) [2023-12-27 23:47:31,897][106225] Updated weights for policy 1, policy_version 634954 (0.0008) [2023-12-27 23:47:31,960][106225] Updated weights for policy 1, policy_version 634964 (0.0009) [2023-12-27 23:47:32,026][106225] Updated weights for policy 1, policy_version 634974 (0.0008) [2023-12-27 23:47:32,076][106225] Updated weights for policy 1, policy_version 634984 (0.0008) [2023-12-27 23:47:32,390][106226] Updated weights for policy 0, policy_version 633048 (0.0007) [2023-12-27 23:47:32,459][106226] Updated weights for policy 0, policy_version 633058 (0.0009) [2023-12-27 23:47:32,523][106226] Updated weights for policy 0, policy_version 633068 (0.0008) [2023-12-27 23:47:32,857][106225] Updated weights for policy 1, policy_version 634994 (0.0008) [2023-12-27 23:47:32,917][106225] Updated weights for policy 1, policy_version 635004 (0.0009) [2023-12-27 23:47:32,976][106225] Updated weights for policy 1, policy_version 635014 (0.0010) [2023-12-27 23:47:33,260][106226] Updated weights for policy 0, policy_version 633078 (0.0008) [2023-12-27 23:47:33,326][106226] Updated weights for policy 0, policy_version 633088 (0.0009) [2023-12-27 23:47:33,392][106226] Updated weights for policy 0, policy_version 633098 (0.0009) [2023-12-27 23:47:33,549][106225] Updated weights for policy 1, policy_version 635024 (0.0010) [2023-12-27 23:47:33,609][106225] Updated weights for policy 1, policy_version 635034 (0.0009) [2023-12-27 23:47:33,669][106225] Updated weights for policy 1, policy_version 635044 (0.0005) [2023-12-27 23:47:34,041][106226] Updated weights for policy 0, policy_version 633108 (0.0008) [2023-12-27 23:47:34,088][106226] Updated weights for policy 0, policy_version 633118 (0.0005) [2023-12-27 23:47:34,147][106226] Updated weights for policy 0, policy_version 633128 (0.0006) [2023-12-27 23:47:34,303][106225] Updated weights for policy 1, policy_version 635054 (0.0006) [2023-12-27 23:47:34,363][106225] Updated weights for policy 1, policy_version 635064 (0.0006) [2023-12-27 23:47:34,421][106225] Updated weights for policy 1, policy_version 635074 (0.0008) [2023-12-27 23:47:34,822][106226] Updated weights for policy 0, policy_version 633138 (0.0011) [2023-12-27 23:47:34,879][106226] Updated weights for policy 0, policy_version 633148 (0.0008) [2023-12-27 23:47:34,933][106226] Updated weights for policy 0, policy_version 633158 (0.0008) [2023-12-27 23:47:34,999][106226] Updated weights for policy 0, policy_version 633168 (0.0006) [2023-12-27 23:47:35,113][106225] Updated weights for policy 1, policy_version 635084 (0.0007) [2023-12-27 23:47:35,167][106225] Updated weights for policy 1, policy_version 635094 (0.0007) [2023-12-27 23:47:35,214][106225] Updated weights for policy 1, policy_version 635104 (0.0008) [2023-12-27 23:47:35,612][106226] Updated weights for policy 0, policy_version 633178 (0.0008) [2023-12-27 23:47:35,669][106226] Updated weights for policy 0, policy_version 633188 (0.0008) [2023-12-27 23:47:35,733][106226] Updated weights for policy 0, policy_version 633198 (0.0008) [2023-12-27 23:47:35,783][106225] Updated weights for policy 1, policy_version 635114 (0.0005) [2023-12-27 23:47:35,849][106225] Updated weights for policy 1, policy_version 635124 (0.0006) [2023-12-27 23:47:35,902][106225] Updated weights for policy 1, policy_version 635134 (0.0006) [2023-12-27 23:47:35,972][106225] Updated weights for policy 1, policy_version 635144 (0.0007) [2023-12-27 23:47:36,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 324763648. Throughput: 0: 9892.3, 1: 10172.7. Samples: 324771288. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:36,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-5.701')] [2023-12-27 23:47:36,436][106226] Updated weights for policy 0, policy_version 633208 (0.0009) [2023-12-27 23:47:36,494][106226] Updated weights for policy 0, policy_version 633218 (0.0008) [2023-12-27 23:47:36,559][106226] Updated weights for policy 0, policy_version 633228 (0.0010) [2023-12-27 23:47:36,646][106225] Updated weights for policy 1, policy_version 635154 (0.0007) [2023-12-27 23:47:36,714][106225] Updated weights for policy 1, policy_version 635164 (0.0009) [2023-12-27 23:47:36,777][106225] Updated weights for policy 1, policy_version 635174 (0.0008) [2023-12-27 23:47:37,278][106226] Updated weights for policy 0, policy_version 633238 (0.0006) [2023-12-27 23:47:37,325][106226] Updated weights for policy 0, policy_version 633248 (0.0007) [2023-12-27 23:47:37,366][106225] Updated weights for policy 1, policy_version 635184 (0.0006) [2023-12-27 23:47:37,372][106226] Updated weights for policy 0, policy_version 633258 (0.0008) [2023-12-27 23:47:37,422][106225] Updated weights for policy 1, policy_version 635194 (0.0009) [2023-12-27 23:47:37,482][106225] Updated weights for policy 1, policy_version 635204 (0.0010) [2023-12-27 23:47:38,121][106226] Updated weights for policy 0, policy_version 633268 (0.0009) [2023-12-27 23:47:38,160][106225] Updated weights for policy 1, policy_version 635214 (0.0007) [2023-12-27 23:47:38,176][106226] Updated weights for policy 0, policy_version 633278 (0.0007) [2023-12-27 23:47:38,209][106225] Updated weights for policy 1, policy_version 635224 (0.0006) [2023-12-27 23:47:38,229][106226] Updated weights for policy 0, policy_version 633288 (0.0008) [2023-12-27 23:47:38,271][106225] Updated weights for policy 1, policy_version 635234 (0.0005) [2023-12-27 23:47:38,915][106226] Updated weights for policy 0, policy_version 633298 (0.0007) [2023-12-27 23:47:38,968][106226] Updated weights for policy 0, policy_version 633308 (0.0008) [2023-12-27 23:47:38,998][106225] Updated weights for policy 1, policy_version 635244 (0.0008) [2023-12-27 23:47:39,024][106226] Updated weights for policy 0, policy_version 633318 (0.0007) [2023-12-27 23:47:39,054][106225] Updated weights for policy 1, policy_version 635254 (0.0006) [2023-12-27 23:47:39,076][106226] Updated weights for policy 0, policy_version 633328 (0.0007) [2023-12-27 23:47:39,110][106225] Updated weights for policy 1, policy_version 635264 (0.0008) [2023-12-27 23:47:39,868][106226] Updated weights for policy 0, policy_version 633338 (0.0008) [2023-12-27 23:47:39,940][106226] Updated weights for policy 0, policy_version 633348 (0.0008) [2023-12-27 23:47:39,963][106225] Updated weights for policy 1, policy_version 635274 (0.0008) [2023-12-27 23:47:40,006][106226] Updated weights for policy 0, policy_version 633358 (0.0008) [2023-12-27 23:47:40,026][106225] Updated weights for policy 1, policy_version 635284 (0.0007) [2023-12-27 23:47:40,094][106225] Updated weights for policy 1, policy_version 635294 (0.0008) [2023-12-27 23:47:40,159][106225] Updated weights for policy 1, policy_version 635304 (0.0008) [2023-12-27 23:47:40,690][106226] Updated weights for policy 0, policy_version 633368 (0.0008) [2023-12-27 23:47:40,742][106226] Updated weights for policy 0, policy_version 633378 (0.0010) [2023-12-27 23:47:40,792][106226] Updated weights for policy 0, policy_version 633388 (0.0010) [2023-12-27 23:47:40,881][106225] Updated weights for policy 1, policy_version 635314 (0.0008) [2023-12-27 23:47:40,950][106225] Updated weights for policy 1, policy_version 635324 (0.0008) [2023-12-27 23:47:41,013][106225] Updated weights for policy 1, policy_version 635334 (0.0006) [2023-12-27 23:47:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 324861952. Throughput: 0: 9927.4, 1: 10207.9. Samples: 324830720. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:41,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.761')] [2023-12-27 23:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000635336_162676736.pth... [2023-12-27 23:47:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000633392_162185216.pth... [2023-12-27 23:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000634152_162373632.pth [2023-12-27 23:47:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000632240_161890304.pth [2023-12-27 23:47:41,542][106226] Updated weights for policy 0, policy_version 633398 (0.0010) [2023-12-27 23:47:41,606][106226] Updated weights for policy 0, policy_version 633408 (0.0009) [2023-12-27 23:47:41,674][106226] Updated weights for policy 0, policy_version 633418 (0.0009) [2023-12-27 23:47:41,795][106225] Updated weights for policy 1, policy_version 635344 (0.0009) [2023-12-27 23:47:41,859][106225] Updated weights for policy 1, policy_version 635354 (0.0006) [2023-12-27 23:47:41,920][106225] Updated weights for policy 1, policy_version 635364 (0.0008) [2023-12-27 23:47:42,413][106226] Updated weights for policy 0, policy_version 633428 (0.0010) [2023-12-27 23:47:42,475][106226] Updated weights for policy 0, policy_version 633438 (0.0008) [2023-12-27 23:47:42,527][106226] Updated weights for policy 0, policy_version 633448 (0.0008) [2023-12-27 23:47:42,619][106225] Updated weights for policy 1, policy_version 635374 (0.0007) [2023-12-27 23:47:42,680][106225] Updated weights for policy 1, policy_version 635384 (0.0006) [2023-12-27 23:47:42,744][106225] Updated weights for policy 1, policy_version 635394 (0.0006) [2023-12-27 23:47:43,320][106226] Updated weights for policy 0, policy_version 633458 (0.0009) [2023-12-27 23:47:43,355][106225] Updated weights for policy 1, policy_version 635404 (0.0007) [2023-12-27 23:47:43,369][106226] Updated weights for policy 0, policy_version 633468 (0.0007) [2023-12-27 23:47:43,400][106225] Updated weights for policy 1, policy_version 635414 (0.0005) [2023-12-27 23:47:43,421][106226] Updated weights for policy 0, policy_version 633478 (0.0007) [2023-12-27 23:47:43,447][106225] Updated weights for policy 1, policy_version 635424 (0.0005) [2023-12-27 23:47:43,466][106226] Updated weights for policy 0, policy_version 633488 (0.0006) [2023-12-27 23:47:44,155][106226] Updated weights for policy 0, policy_version 633498 (0.0007) [2023-12-27 23:47:44,174][106225] Updated weights for policy 1, policy_version 635434 (0.0007) [2023-12-27 23:47:44,215][106226] Updated weights for policy 0, policy_version 633508 (0.0008) [2023-12-27 23:47:44,230][106225] Updated weights for policy 1, policy_version 635444 (0.0006) [2023-12-27 23:47:44,269][106226] Updated weights for policy 0, policy_version 633518 (0.0009) [2023-12-27 23:47:44,288][106225] Updated weights for policy 1, policy_version 635454 (0.0006) [2023-12-27 23:47:44,349][106225] Updated weights for policy 1, policy_version 635464 (0.0009) [2023-12-27 23:47:44,889][106226] Updated weights for policy 0, policy_version 633528 (0.0009) [2023-12-27 23:47:44,952][106226] Updated weights for policy 0, policy_version 633538 (0.0007) [2023-12-27 23:47:45,018][106226] Updated weights for policy 0, policy_version 633548 (0.0010) [2023-12-27 23:47:45,084][106225] Updated weights for policy 1, policy_version 635474 (0.0007) [2023-12-27 23:47:45,146][106225] Updated weights for policy 1, policy_version 635484 (0.0007) [2023-12-27 23:47:45,212][106225] Updated weights for policy 1, policy_version 635494 (0.0006) [2023-12-27 23:47:45,752][106226] Updated weights for policy 0, policy_version 633558 (0.0008) [2023-12-27 23:47:45,809][106226] Updated weights for policy 0, policy_version 633568 (0.0008) [2023-12-27 23:47:45,842][106225] Updated weights for policy 1, policy_version 635504 (0.0006) [2023-12-27 23:47:45,856][106226] Updated weights for policy 0, policy_version 633578 (0.0008) [2023-12-27 23:47:45,889][106225] Updated weights for policy 1, policy_version 635514 (0.0006) [2023-12-27 23:47:45,937][106225] Updated weights for policy 1, policy_version 635524 (0.0009) [2023-12-27 23:47:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 324960256. Throughput: 0: 9985.5, 1: 10080.4. Samples: 324946372. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:46,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-5.905')] [2023-12-27 23:47:46,593][106226] Updated weights for policy 0, policy_version 633588 (0.0007) [2023-12-27 23:47:46,655][106226] Updated weights for policy 0, policy_version 633598 (0.0008) [2023-12-27 23:47:46,681][106225] Updated weights for policy 1, policy_version 635534 (0.0008) [2023-12-27 23:47:46,725][106226] Updated weights for policy 0, policy_version 633608 (0.0007) [2023-12-27 23:47:46,747][106225] Updated weights for policy 1, policy_version 635544 (0.0008) [2023-12-27 23:47:46,807][106225] Updated weights for policy 1, policy_version 635554 (0.0006) [2023-12-27 23:47:47,265][106226] Updated weights for policy 0, policy_version 633618 (0.0006) [2023-12-27 23:47:47,324][106226] Updated weights for policy 0, policy_version 633628 (0.0006) [2023-12-27 23:47:47,386][106225] Updated weights for policy 1, policy_version 635564 (0.0005) [2023-12-27 23:47:47,389][106226] Updated weights for policy 0, policy_version 633638 (0.0008) [2023-12-27 23:47:47,435][106225] Updated weights for policy 1, policy_version 635574 (0.0005) [2023-12-27 23:47:47,450][106226] Updated weights for policy 0, policy_version 633648 (0.0007) [2023-12-27 23:47:47,499][106225] Updated weights for policy 1, policy_version 635584 (0.0007) [2023-12-27 23:47:47,985][106226] Updated weights for policy 0, policy_version 633658 (0.0005) [2023-12-27 23:47:48,047][106226] Updated weights for policy 0, policy_version 633668 (0.0006) [2023-12-27 23:47:48,108][106226] Updated weights for policy 0, policy_version 633678 (0.0009) [2023-12-27 23:47:48,146][106225] Updated weights for policy 1, policy_version 635594 (0.0009) [2023-12-27 23:47:48,195][106225] Updated weights for policy 1, policy_version 635604 (0.0009) [2023-12-27 23:47:48,252][106225] Updated weights for policy 1, policy_version 635614 (0.0008) [2023-12-27 23:47:48,311][106225] Updated weights for policy 1, policy_version 635624 (0.0008) [2023-12-27 23:47:48,748][106226] Updated weights for policy 0, policy_version 633688 (0.0006) [2023-12-27 23:47:48,811][106226] Updated weights for policy 0, policy_version 633698 (0.0009) [2023-12-27 23:47:48,872][106226] Updated weights for policy 0, policy_version 633708 (0.0008) [2023-12-27 23:47:49,099][106225] Updated weights for policy 1, policy_version 635634 (0.0007) [2023-12-27 23:47:49,150][106225] Updated weights for policy 1, policy_version 635644 (0.0008) [2023-12-27 23:47:49,204][106225] Updated weights for policy 1, policy_version 635654 (0.0008) [2023-12-27 23:47:49,630][106226] Updated weights for policy 0, policy_version 633718 (0.0008) [2023-12-27 23:47:49,690][106226] Updated weights for policy 0, policy_version 633728 (0.0009) [2023-12-27 23:47:49,751][106226] Updated weights for policy 0, policy_version 633738 (0.0009) [2023-12-27 23:47:49,860][106225] Updated weights for policy 1, policy_version 635664 (0.0008) [2023-12-27 23:47:49,935][106225] Updated weights for policy 1, policy_version 635674 (0.0009) [2023-12-27 23:47:50,001][106225] Updated weights for policy 1, policy_version 635684 (0.0009) [2023-12-27 23:47:50,544][106226] Updated weights for policy 0, policy_version 633748 (0.0009) [2023-12-27 23:47:50,606][106226] Updated weights for policy 0, policy_version 633758 (0.0010) [2023-12-27 23:47:50,661][106225] Updated weights for policy 1, policy_version 635694 (0.0008) [2023-12-27 23:47:50,663][106226] Updated weights for policy 0, policy_version 633768 (0.0007) [2023-12-27 23:47:50,722][106225] Updated weights for policy 1, policy_version 635704 (0.0008) [2023-12-27 23:47:50,782][106225] Updated weights for policy 1, policy_version 635714 (0.0007) [2023-12-27 23:47:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 325058560. Throughput: 0: 9940.7, 1: 10112.3. Samples: 325068112. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:51,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-5.422')] [2023-12-27 23:47:51,373][106226] Updated weights for policy 0, policy_version 633778 (0.0007) [2023-12-27 23:47:51,434][106226] Updated weights for policy 0, policy_version 633788 (0.0009) [2023-12-27 23:47:51,491][106226] Updated weights for policy 0, policy_version 633798 (0.0007) [2023-12-27 23:47:51,549][106226] Updated weights for policy 0, policy_version 633808 (0.0008) [2023-12-27 23:47:51,587][106225] Updated weights for policy 1, policy_version 635724 (0.0008) [2023-12-27 23:47:51,660][106225] Updated weights for policy 1, policy_version 635734 (0.0008) [2023-12-27 23:47:51,729][106225] Updated weights for policy 1, policy_version 635744 (0.0009) [2023-12-27 23:47:52,291][106226] Updated weights for policy 0, policy_version 633818 (0.0007) [2023-12-27 23:47:52,357][106226] Updated weights for policy 0, policy_version 633828 (0.0008) [2023-12-27 23:47:52,427][106226] Updated weights for policy 0, policy_version 633838 (0.0007) [2023-12-27 23:47:52,498][106225] Updated weights for policy 1, policy_version 635754 (0.0008) [2023-12-27 23:47:52,552][106225] Updated weights for policy 1, policy_version 635764 (0.0009) [2023-12-27 23:47:52,623][106225] Updated weights for policy 1, policy_version 635774 (0.0009) [2023-12-27 23:47:52,690][106225] Updated weights for policy 1, policy_version 635784 (0.0009) [2023-12-27 23:47:53,102][106226] Updated weights for policy 0, policy_version 633848 (0.0008) [2023-12-27 23:47:53,156][106226] Updated weights for policy 0, policy_version 633858 (0.0008) [2023-12-27 23:47:53,207][106226] Updated weights for policy 0, policy_version 633868 (0.0008) [2023-12-27 23:47:53,437][106225] Updated weights for policy 1, policy_version 635794 (0.0006) [2023-12-27 23:47:53,495][106225] Updated weights for policy 1, policy_version 635804 (0.0005) [2023-12-27 23:47:53,552][106225] Updated weights for policy 1, policy_version 635814 (0.0005) [2023-12-27 23:47:53,941][106226] Updated weights for policy 0, policy_version 633878 (0.0009) [2023-12-27 23:47:54,003][106226] Updated weights for policy 0, policy_version 633888 (0.0006) [2023-12-27 23:47:54,060][106226] Updated weights for policy 0, policy_version 633898 (0.0005) [2023-12-27 23:47:54,158][106225] Updated weights for policy 1, policy_version 635824 (0.0005) [2023-12-27 23:47:54,228][106225] Updated weights for policy 1, policy_version 635834 (0.0006) [2023-12-27 23:47:54,288][106225] Updated weights for policy 1, policy_version 635844 (0.0006) [2023-12-27 23:47:54,607][106226] Updated weights for policy 0, policy_version 633908 (0.0007) [2023-12-27 23:47:54,651][106226] Updated weights for policy 0, policy_version 633918 (0.0008) [2023-12-27 23:47:54,697][106226] Updated weights for policy 0, policy_version 633928 (0.0006) [2023-12-27 23:47:54,910][106225] Updated weights for policy 1, policy_version 635854 (0.0006) [2023-12-27 23:47:54,978][106225] Updated weights for policy 1, policy_version 635864 (0.0006) [2023-12-27 23:47:55,035][106225] Updated weights for policy 1, policy_version 635874 (0.0005) [2023-12-27 23:47:55,281][106226] Updated weights for policy 0, policy_version 633938 (0.0006) [2023-12-27 23:47:55,338][106226] Updated weights for policy 0, policy_version 633948 (0.0008) [2023-12-27 23:47:55,399][106226] Updated weights for policy 0, policy_version 633958 (0.0008) [2023-12-27 23:47:55,457][106226] Updated weights for policy 0, policy_version 633968 (0.0007) [2023-12-27 23:47:55,698][106225] Updated weights for policy 1, policy_version 635884 (0.0010) [2023-12-27 23:47:55,761][106225] Updated weights for policy 1, policy_version 635894 (0.0010) [2023-12-27 23:47:55,820][106225] Updated weights for policy 1, policy_version 635904 (0.0010) [2023-12-27 23:47:56,095][106226] Updated weights for policy 0, policy_version 633978 (0.0005) [2023-12-27 23:47:56,151][106226] Updated weights for policy 0, policy_version 633988 (0.0006) [2023-12-27 23:47:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 325156864. Throughput: 0: 9900.1, 1: 10056.9. Samples: 325125288. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:47:56,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-5.740')] [2023-12-27 23:47:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000635912_162824192.pth... [2023-12-27 23:47:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000634728_162521088.pth [2023-12-27 23:47:56,214][106226] Updated weights for policy 0, policy_version 633998 (0.0010) [2023-12-27 23:47:56,223][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000634000_162340864.pth... [2023-12-27 23:47:56,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000632816_162037760.pth [2023-12-27 23:47:56,519][106225] Updated weights for policy 1, policy_version 635914 (0.0008) [2023-12-27 23:47:56,563][106225] Updated weights for policy 1, policy_version 635924 (0.0005) [2023-12-27 23:47:56,618][106225] Updated weights for policy 1, policy_version 635934 (0.0007) [2023-12-27 23:47:56,661][106225] Updated weights for policy 1, policy_version 635944 (0.0008) [2023-12-27 23:47:56,785][106226] Updated weights for policy 0, policy_version 634008 (0.0010) [2023-12-27 23:47:56,832][106226] Updated weights for policy 0, policy_version 634018 (0.0010) [2023-12-27 23:47:56,884][106226] Updated weights for policy 0, policy_version 634028 (0.0010) [2023-12-27 23:47:57,318][106225] Updated weights for policy 1, policy_version 635954 (0.0007) [2023-12-27 23:47:57,378][106225] Updated weights for policy 1, policy_version 635964 (0.0009) [2023-12-27 23:47:57,443][106225] Updated weights for policy 1, policy_version 635974 (0.0006) [2023-12-27 23:47:57,577][106226] Updated weights for policy 0, policy_version 634038 (0.0010) [2023-12-27 23:47:57,623][106226] Updated weights for policy 0, policy_version 634048 (0.0010) [2023-12-27 23:47:57,672][106226] Updated weights for policy 0, policy_version 634058 (0.0010) [2023-12-27 23:47:58,046][106225] Updated weights for policy 1, policy_version 635984 (0.0005) [2023-12-27 23:47:58,111][106225] Updated weights for policy 1, policy_version 635994 (0.0006) [2023-12-27 23:47:58,161][106225] Updated weights for policy 1, policy_version 636004 (0.0006) [2023-12-27 23:47:58,351][106226] Updated weights for policy 0, policy_version 634068 (0.0006) [2023-12-27 23:47:58,422][106226] Updated weights for policy 0, policy_version 634078 (0.0010) [2023-12-27 23:47:58,490][106226] Updated weights for policy 0, policy_version 634088 (0.0008) [2023-12-27 23:47:58,925][106225] Updated weights for policy 1, policy_version 636014 (0.0007) [2023-12-27 23:47:58,987][106225] Updated weights for policy 1, policy_version 636024 (0.0008) [2023-12-27 23:47:59,046][106225] Updated weights for policy 1, policy_version 636034 (0.0008) [2023-12-27 23:47:59,307][106226] Updated weights for policy 0, policy_version 634098 (0.0008) [2023-12-27 23:47:59,374][106226] Updated weights for policy 0, policy_version 634108 (0.0008) [2023-12-27 23:47:59,431][106226] Updated weights for policy 0, policy_version 634118 (0.0009) [2023-12-27 23:47:59,488][106226] Updated weights for policy 0, policy_version 634128 (0.0009) [2023-12-27 23:47:59,779][106225] Updated weights for policy 1, policy_version 636044 (0.0008) [2023-12-27 23:47:59,842][106225] Updated weights for policy 1, policy_version 636054 (0.0007) [2023-12-27 23:47:59,897][106225] Updated weights for policy 1, policy_version 636064 (0.0008) [2023-12-27 23:48:00,255][106226] Updated weights for policy 0, policy_version 634138 (0.0008) [2023-12-27 23:48:00,313][106226] Updated weights for policy 0, policy_version 634148 (0.0008) [2023-12-27 23:48:00,374][106226] Updated weights for policy 0, policy_version 634158 (0.0008) [2023-12-27 23:48:00,599][106225] Updated weights for policy 1, policy_version 636074 (0.0009) [2023-12-27 23:48:00,652][106225] Updated weights for policy 1, policy_version 636084 (0.0010) [2023-12-27 23:48:00,708][106225] Updated weights for policy 1, policy_version 636094 (0.0010) [2023-12-27 23:48:00,767][106225] Updated weights for policy 1, policy_version 636104 (0.0010) [2023-12-27 23:48:01,093][106226] Updated weights for policy 0, policy_version 634168 (0.0006) [2023-12-27 23:48:01,152][106226] Updated weights for policy 0, policy_version 634178 (0.0007) [2023-12-27 23:48:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 325255168. Throughput: 0: 9968.7, 1: 10106.4. Samples: 325249148. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:01,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.974')] [2023-12-27 23:48:01,212][106226] Updated weights for policy 0, policy_version 634188 (0.0008) [2023-12-27 23:48:01,551][106225] Updated weights for policy 1, policy_version 636114 (0.0009) [2023-12-27 23:48:01,605][106225] Updated weights for policy 1, policy_version 636124 (0.0008) [2023-12-27 23:48:01,672][106225] Updated weights for policy 1, policy_version 636134 (0.0008) [2023-12-27 23:48:01,896][106226] Updated weights for policy 0, policy_version 634198 (0.0008) [2023-12-27 23:48:01,951][106226] Updated weights for policy 0, policy_version 634208 (0.0007) [2023-12-27 23:48:02,012][106226] Updated weights for policy 0, policy_version 634218 (0.0007) [2023-12-27 23:48:02,422][106225] Updated weights for policy 1, policy_version 636144 (0.0007) [2023-12-27 23:48:02,481][106225] Updated weights for policy 1, policy_version 636154 (0.0009) [2023-12-27 23:48:02,532][106225] Updated weights for policy 1, policy_version 636165 (0.0010) [2023-12-27 23:48:02,663][106226] Updated weights for policy 0, policy_version 634228 (0.0008) [2023-12-27 23:48:02,713][106226] Updated weights for policy 0, policy_version 634238 (0.0005) [2023-12-27 23:48:02,775][106226] Updated weights for policy 0, policy_version 634248 (0.0008) [2023-12-27 23:48:03,249][106225] Updated weights for policy 1, policy_version 636175 (0.0010) [2023-12-27 23:48:03,306][106225] Updated weights for policy 1, policy_version 636185 (0.0010) [2023-12-27 23:48:03,362][106225] Updated weights for policy 1, policy_version 636195 (0.0010) [2023-12-27 23:48:03,498][106226] Updated weights for policy 0, policy_version 634258 (0.0008) [2023-12-27 23:48:03,559][106226] Updated weights for policy 0, policy_version 634268 (0.0008) [2023-12-27 23:48:03,612][106226] Updated weights for policy 0, policy_version 634278 (0.0008) [2023-12-27 23:48:03,666][106226] Updated weights for policy 0, policy_version 634288 (0.0008) [2023-12-27 23:48:03,997][106225] Updated weights for policy 1, policy_version 636205 (0.0008) [2023-12-27 23:48:04,052][106225] Updated weights for policy 1, policy_version 636215 (0.0005) [2023-12-27 23:48:04,111][106225] Updated weights for policy 1, policy_version 636225 (0.0007) [2023-12-27 23:48:04,483][106226] Updated weights for policy 0, policy_version 634298 (0.0008) [2023-12-27 23:48:04,540][106226] Updated weights for policy 0, policy_version 634308 (0.0007) [2023-12-27 23:48:04,594][106226] Updated weights for policy 0, policy_version 634318 (0.0008) [2023-12-27 23:48:04,823][106225] Updated weights for policy 1, policy_version 636235 (0.0009) [2023-12-27 23:48:04,870][106225] Updated weights for policy 1, policy_version 636245 (0.0010) [2023-12-27 23:48:04,913][106225] Updated weights for policy 1, policy_version 636255 (0.0010) [2023-12-27 23:48:05,302][106226] Updated weights for policy 0, policy_version 634328 (0.0005) [2023-12-27 23:48:05,352][106226] Updated weights for policy 0, policy_version 634338 (0.0005) [2023-12-27 23:48:05,403][106226] Updated weights for policy 0, policy_version 634348 (0.0006) [2023-12-27 23:48:05,566][106225] Updated weights for policy 1, policy_version 636265 (0.0010) [2023-12-27 23:48:05,618][106225] Updated weights for policy 1, policy_version 636275 (0.0006) [2023-12-27 23:48:05,674][106225] Updated weights for policy 1, policy_version 636285 (0.0007) [2023-12-27 23:48:05,732][106225] Updated weights for policy 1, policy_version 636295 (0.0006) [2023-12-27 23:48:05,930][106226] Updated weights for policy 0, policy_version 634358 (0.0008) [2023-12-27 23:48:05,983][106226] Updated weights for policy 0, policy_version 634368 (0.0011) [2023-12-27 23:48:06,036][106226] Updated weights for policy 0, policy_version 634378 (0.0010) [2023-12-27 23:48:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 325361664. Throughput: 0: 10032.8, 1: 10088.6. Samples: 325368388. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:06,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.617')] [2023-12-27 23:48:06,402][106225] Updated weights for policy 1, policy_version 636305 (0.0008) [2023-12-27 23:48:06,468][106225] Updated weights for policy 1, policy_version 636315 (0.0008) [2023-12-27 23:48:06,530][106225] Updated weights for policy 1, policy_version 636325 (0.0008) [2023-12-27 23:48:06,726][106226] Updated weights for policy 0, policy_version 634388 (0.0009) [2023-12-27 23:48:06,797][106226] Updated weights for policy 0, policy_version 634398 (0.0011) [2023-12-27 23:48:06,857][106226] Updated weights for policy 0, policy_version 634408 (0.0011) [2023-12-27 23:48:07,154][106225] Updated weights for policy 1, policy_version 636335 (0.0007) [2023-12-27 23:48:07,211][106225] Updated weights for policy 1, policy_version 636345 (0.0008) [2023-12-27 23:48:07,279][106225] Updated weights for policy 1, policy_version 636355 (0.0008) [2023-12-27 23:48:07,556][106226] Updated weights for policy 0, policy_version 634418 (0.0011) [2023-12-27 23:48:07,612][106226] Updated weights for policy 0, policy_version 634428 (0.0010) [2023-12-27 23:48:07,672][106226] Updated weights for policy 0, policy_version 634438 (0.0011) [2023-12-27 23:48:07,737][106226] Updated weights for policy 0, policy_version 634448 (0.0011) [2023-12-27 23:48:07,916][106225] Updated weights for policy 1, policy_version 636365 (0.0007) [2023-12-27 23:48:07,975][106225] Updated weights for policy 1, policy_version 636375 (0.0006) [2023-12-27 23:48:08,037][106225] Updated weights for policy 1, policy_version 636385 (0.0007) [2023-12-27 23:48:08,428][106226] Updated weights for policy 0, policy_version 634458 (0.0009) [2023-12-27 23:48:08,485][106226] Updated weights for policy 0, policy_version 634468 (0.0007) [2023-12-27 23:48:08,538][106226] Updated weights for policy 0, policy_version 634478 (0.0005) [2023-12-27 23:48:08,782][106225] Updated weights for policy 1, policy_version 636395 (0.0008) [2023-12-27 23:48:08,845][106225] Updated weights for policy 1, policy_version 636405 (0.0008) [2023-12-27 23:48:08,908][106225] Updated weights for policy 1, policy_version 636415 (0.0009) [2023-12-27 23:48:09,160][106226] Updated weights for policy 0, policy_version 634488 (0.0006) [2023-12-27 23:48:09,217][106226] Updated weights for policy 0, policy_version 634498 (0.0006) [2023-12-27 23:48:09,287][106226] Updated weights for policy 0, policy_version 634508 (0.0009) [2023-12-27 23:48:09,685][106225] Updated weights for policy 1, policy_version 636425 (0.0009) [2023-12-27 23:48:09,744][106225] Updated weights for policy 1, policy_version 636435 (0.0008) [2023-12-27 23:48:09,812][106225] Updated weights for policy 1, policy_version 636445 (0.0008) [2023-12-27 23:48:09,866][106225] Updated weights for policy 1, policy_version 636455 (0.0008) [2023-12-27 23:48:10,033][106226] Updated weights for policy 0, policy_version 634518 (0.0010) [2023-12-27 23:48:10,102][106226] Updated weights for policy 0, policy_version 634528 (0.0009) [2023-12-27 23:48:10,158][106226] Updated weights for policy 0, policy_version 634538 (0.0008) [2023-12-27 23:48:10,551][106225] Updated weights for policy 1, policy_version 636465 (0.0008) [2023-12-27 23:48:10,616][106225] Updated weights for policy 1, policy_version 636475 (0.0008) [2023-12-27 23:48:10,688][106225] Updated weights for policy 1, policy_version 636485 (0.0008) [2023-12-27 23:48:10,857][106226] Updated weights for policy 0, policy_version 634548 (0.0008) [2023-12-27 23:48:10,913][106226] Updated weights for policy 0, policy_version 634558 (0.0007) [2023-12-27 23:48:10,976][106226] Updated weights for policy 0, policy_version 634568 (0.0006) [2023-12-27 23:48:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 325459968. Throughput: 0: 10089.2, 1: 10101.0. Samples: 325429664. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:11,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.592')] [2023-12-27 23:48:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000636488_162971648.pth... [2023-12-27 23:48:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000634576_162488320.pth... [2023-12-27 23:48:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000635336_162676736.pth [2023-12-27 23:48:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000633392_162185216.pth [2023-12-27 23:48:11,326][106225] Updated weights for policy 1, policy_version 636495 (0.0006) [2023-12-27 23:48:11,399][106225] Updated weights for policy 1, policy_version 636505 (0.0007) [2023-12-27 23:48:11,468][106225] Updated weights for policy 1, policy_version 636515 (0.0006) [2023-12-27 23:48:11,803][106226] Updated weights for policy 0, policy_version 634578 (0.0007) [2023-12-27 23:48:11,866][106226] Updated weights for policy 0, policy_version 634588 (0.0010) [2023-12-27 23:48:11,932][106226] Updated weights for policy 0, policy_version 634598 (0.0011) [2023-12-27 23:48:11,995][106226] Updated weights for policy 0, policy_version 634608 (0.0010) [2023-12-27 23:48:12,194][106225] Updated weights for policy 1, policy_version 636525 (0.0007) [2023-12-27 23:48:12,263][106225] Updated weights for policy 1, policy_version 636535 (0.0008) [2023-12-27 23:48:12,328][106225] Updated weights for policy 1, policy_version 636545 (0.0008) [2023-12-27 23:48:12,626][106226] Updated weights for policy 0, policy_version 634618 (0.0006) [2023-12-27 23:48:12,687][106226] Updated weights for policy 0, policy_version 634628 (0.0011) [2023-12-27 23:48:12,748][106226] Updated weights for policy 0, policy_version 634638 (0.0011) [2023-12-27 23:48:13,097][106225] Updated weights for policy 1, policy_version 636555 (0.0009) [2023-12-27 23:48:13,152][106225] Updated weights for policy 1, policy_version 636565 (0.0009) [2023-12-27 23:48:13,213][106225] Updated weights for policy 1, policy_version 636575 (0.0008) [2023-12-27 23:48:13,376][106226] Updated weights for policy 0, policy_version 634648 (0.0007) [2023-12-27 23:48:13,421][106226] Updated weights for policy 0, policy_version 634658 (0.0005) [2023-12-27 23:48:13,468][106226] Updated weights for policy 0, policy_version 634668 (0.0005) [2023-12-27 23:48:13,907][106225] Updated weights for policy 1, policy_version 636585 (0.0009) [2023-12-27 23:48:13,967][106225] Updated weights for policy 1, policy_version 636595 (0.0010) [2023-12-27 23:48:14,023][106225] Updated weights for policy 1, policy_version 636605 (0.0010) [2023-12-27 23:48:14,082][106225] Updated weights for policy 1, policy_version 636615 (0.0010) [2023-12-27 23:48:14,177][106226] Updated weights for policy 0, policy_version 634678 (0.0008) [2023-12-27 23:48:14,232][106226] Updated weights for policy 0, policy_version 634688 (0.0009) [2023-12-27 23:48:14,288][106226] Updated weights for policy 0, policy_version 634698 (0.0010) [2023-12-27 23:48:14,793][106225] Updated weights for policy 1, policy_version 636625 (0.0010) [2023-12-27 23:48:14,849][106225] Updated weights for policy 1, policy_version 636635 (0.0010) [2023-12-27 23:48:14,911][106225] Updated weights for policy 1, policy_version 636645 (0.0010) [2023-12-27 23:48:14,975][106226] Updated weights for policy 0, policy_version 634708 (0.0009) [2023-12-27 23:48:15,043][106226] Updated weights for policy 0, policy_version 634718 (0.0009) [2023-12-27 23:48:15,111][106226] Updated weights for policy 0, policy_version 634728 (0.0010) [2023-12-27 23:48:15,645][106225] Updated weights for policy 1, policy_version 636655 (0.0010) [2023-12-27 23:48:15,705][106225] Updated weights for policy 1, policy_version 636665 (0.0010) [2023-12-27 23:48:15,755][106225] Updated weights for policy 1, policy_version 636675 (0.0010) [2023-12-27 23:48:15,771][106226] Updated weights for policy 0, policy_version 634738 (0.0011) [2023-12-27 23:48:15,824][106226] Updated weights for policy 0, policy_version 634748 (0.0010) [2023-12-27 23:48:15,877][106226] Updated weights for policy 0, policy_version 634758 (0.0010) [2023-12-27 23:48:15,943][106226] Updated weights for policy 0, policy_version 634768 (0.0011) [2023-12-27 23:48:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 325558272. Throughput: 0: 10008.4, 1: 9962.1. Samples: 325546864. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:16,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-5.852')] [2023-12-27 23:48:16,467][106225] Updated weights for policy 1, policy_version 636685 (0.0010) [2023-12-27 23:48:16,531][106225] Updated weights for policy 1, policy_version 636695 (0.0010) [2023-12-27 23:48:16,596][106225] Updated weights for policy 1, policy_version 636705 (0.0010) [2023-12-27 23:48:16,611][106226] Updated weights for policy 0, policy_version 634778 (0.0010) [2023-12-27 23:48:16,668][106226] Updated weights for policy 0, policy_version 634788 (0.0010) [2023-12-27 23:48:16,724][106226] Updated weights for policy 0, policy_version 634798 (0.0007) [2023-12-27 23:48:17,305][106225] Updated weights for policy 1, policy_version 636715 (0.0010) [2023-12-27 23:48:17,368][106225] Updated weights for policy 1, policy_version 636725 (0.0008) [2023-12-27 23:48:17,434][106225] Updated weights for policy 1, policy_version 636735 (0.0006) [2023-12-27 23:48:17,447][106226] Updated weights for policy 0, policy_version 634808 (0.0010) [2023-12-27 23:48:17,508][106226] Updated weights for policy 0, policy_version 634818 (0.0011) [2023-12-27 23:48:17,574][106226] Updated weights for policy 0, policy_version 634828 (0.0011) [2023-12-27 23:48:18,127][106225] Updated weights for policy 1, policy_version 636745 (0.0010) [2023-12-27 23:48:18,186][106225] Updated weights for policy 1, policy_version 636755 (0.0009) [2023-12-27 23:48:18,241][106225] Updated weights for policy 1, policy_version 636765 (0.0009) [2023-12-27 23:48:18,252][106226] Updated weights for policy 0, policy_version 634838 (0.0007) [2023-12-27 23:48:18,292][106225] Updated weights for policy 1, policy_version 636775 (0.0007) [2023-12-27 23:48:18,305][106226] Updated weights for policy 0, policy_version 634848 (0.0010) [2023-12-27 23:48:18,370][106226] Updated weights for policy 0, policy_version 634858 (0.0010) [2023-12-27 23:48:18,974][106225] Updated weights for policy 1, policy_version 636785 (0.0008) [2023-12-27 23:48:19,031][106225] Updated weights for policy 1, policy_version 636795 (0.0008) [2023-12-27 23:48:19,042][106226] Updated weights for policy 0, policy_version 634868 (0.0011) [2023-12-27 23:48:19,086][106225] Updated weights for policy 1, policy_version 636805 (0.0005) [2023-12-27 23:48:19,092][106226] Updated weights for policy 0, policy_version 634878 (0.0010) [2023-12-27 23:48:19,142][106226] Updated weights for policy 0, policy_version 634888 (0.0010) [2023-12-27 23:48:19,845][106226] Updated weights for policy 0, policy_version 634898 (0.0010) [2023-12-27 23:48:19,911][106226] Updated weights for policy 0, policy_version 634908 (0.0010) [2023-12-27 23:48:19,916][106225] Updated weights for policy 1, policy_version 636815 (0.0006) [2023-12-27 23:48:19,985][106225] Updated weights for policy 1, policy_version 636825 (0.0008) [2023-12-27 23:48:19,985][106226] Updated weights for policy 0, policy_version 634918 (0.0010) [2023-12-27 23:48:20,049][106226] Updated weights for policy 0, policy_version 634928 (0.0009) [2023-12-27 23:48:20,051][106225] Updated weights for policy 1, policy_version 636835 (0.0006) [2023-12-27 23:48:20,771][106226] Updated weights for policy 0, policy_version 634938 (0.0010) [2023-12-27 23:48:20,819][106225] Updated weights for policy 1, policy_version 636845 (0.0009) [2023-12-27 23:48:20,841][106226] Updated weights for policy 0, policy_version 634948 (0.0006) [2023-12-27 23:48:20,881][106225] Updated weights for policy 1, policy_version 636855 (0.0011) [2023-12-27 23:48:20,903][106226] Updated weights for policy 0, policy_version 634958 (0.0006) [2023-12-27 23:48:20,943][106225] Updated weights for policy 1, policy_version 636865 (0.0011) [2023-12-27 23:48:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 325656576. Throughput: 0: 9961.8, 1: 9848.5. Samples: 325662748. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:21,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.786')] [2023-12-27 23:48:21,645][106226] Updated weights for policy 0, policy_version 634968 (0.0008) [2023-12-27 23:48:21,710][106226] Updated weights for policy 0, policy_version 634978 (0.0009) [2023-12-27 23:48:21,717][106225] Updated weights for policy 1, policy_version 636875 (0.0010) [2023-12-27 23:48:21,778][106226] Updated weights for policy 0, policy_version 634988 (0.0009) [2023-12-27 23:48:21,782][106225] Updated weights for policy 1, policy_version 636885 (0.0008) [2023-12-27 23:48:21,841][106225] Updated weights for policy 1, policy_version 636895 (0.0009) [2023-12-27 23:48:22,513][106226] Updated weights for policy 0, policy_version 634998 (0.0009) [2023-12-27 23:48:22,577][106226] Updated weights for policy 0, policy_version 635008 (0.0009) [2023-12-27 23:48:22,609][106225] Updated weights for policy 1, policy_version 636905 (0.0008) [2023-12-27 23:48:22,636][106226] Updated weights for policy 0, policy_version 635018 (0.0008) [2023-12-27 23:48:22,670][106225] Updated weights for policy 1, policy_version 636915 (0.0006) [2023-12-27 23:48:22,730][106225] Updated weights for policy 1, policy_version 636925 (0.0009) [2023-12-27 23:48:22,790][106225] Updated weights for policy 1, policy_version 636935 (0.0008) [2023-12-27 23:48:23,342][106226] Updated weights for policy 0, policy_version 635028 (0.0007) [2023-12-27 23:48:23,402][106226] Updated weights for policy 0, policy_version 635038 (0.0008) [2023-12-27 23:48:23,467][106226] Updated weights for policy 0, policy_version 635048 (0.0007) [2023-12-27 23:48:23,556][106225] Updated weights for policy 1, policy_version 636945 (0.0009) [2023-12-27 23:48:23,613][106225] Updated weights for policy 1, policy_version 636955 (0.0008) [2023-12-27 23:48:23,673][106225] Updated weights for policy 1, policy_version 636965 (0.0009) [2023-12-27 23:48:24,059][106226] Updated weights for policy 0, policy_version 635058 (0.0008) [2023-12-27 23:48:24,117][106226] Updated weights for policy 0, policy_version 635068 (0.0008) [2023-12-27 23:48:24,176][106226] Updated weights for policy 0, policy_version 635078 (0.0008) [2023-12-27 23:48:24,235][106226] Updated weights for policy 0, policy_version 635088 (0.0008) [2023-12-27 23:48:24,415][106225] Updated weights for policy 1, policy_version 636975 (0.0009) [2023-12-27 23:48:24,460][106225] Updated weights for policy 1, policy_version 636985 (0.0008) [2023-12-27 23:48:24,505][106225] Updated weights for policy 1, policy_version 636995 (0.0008) [2023-12-27 23:48:24,897][106226] Updated weights for policy 0, policy_version 635098 (0.0006) [2023-12-27 23:48:24,963][106226] Updated weights for policy 0, policy_version 635108 (0.0007) [2023-12-27 23:48:25,022][106226] Updated weights for policy 0, policy_version 635118 (0.0005) [2023-12-27 23:48:25,339][106225] Updated weights for policy 1, policy_version 637005 (0.0007) [2023-12-27 23:48:25,401][106225] Updated weights for policy 1, policy_version 637015 (0.0008) [2023-12-27 23:48:25,461][106225] Updated weights for policy 1, policy_version 637025 (0.0008) [2023-12-27 23:48:25,614][106226] Updated weights for policy 0, policy_version 635128 (0.0007) [2023-12-27 23:48:25,670][106226] Updated weights for policy 0, policy_version 635138 (0.0007) [2023-12-27 23:48:25,725][106226] Updated weights for policy 0, policy_version 635148 (0.0008) [2023-12-27 23:48:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 325746688. Throughput: 0: 9985.5, 1: 9762.9. Samples: 325719392. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-27 23:48:26,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.368')] [2023-12-27 23:48:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000635152_162635776.pth... [2023-12-27 23:48:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000634000_162340864.pth [2023-12-27 23:48:26,190][106225] Updated weights for policy 1, policy_version 637035 (0.0009) [2023-12-27 23:48:26,247][106225] Updated weights for policy 1, policy_version 637045 (0.0010) [2023-12-27 23:48:26,299][106225] Updated weights for policy 1, policy_version 637055 (0.0010) [2023-12-27 23:48:26,344][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000637064_163119104.pth... [2023-12-27 23:48:26,347][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000635912_162824192.pth [2023-12-27 23:48:26,473][106226] Updated weights for policy 0, policy_version 635158 (0.0009) [2023-12-27 23:48:26,541][106226] Updated weights for policy 0, policy_version 635168 (0.0006) [2023-12-27 23:48:26,603][106226] Updated weights for policy 0, policy_version 635178 (0.0005) [2023-12-27 23:48:27,036][106225] Updated weights for policy 1, policy_version 637065 (0.0010) [2023-12-27 23:48:27,102][106225] Updated weights for policy 1, policy_version 637075 (0.0010) [2023-12-27 23:48:27,158][106225] Updated weights for policy 1, policy_version 637085 (0.0010) [2023-12-27 23:48:27,196][106226] Updated weights for policy 0, policy_version 635188 (0.0007) [2023-12-27 23:48:27,214][106225] Updated weights for policy 1, policy_version 637095 (0.0010) [2023-12-27 23:48:27,257][106226] Updated weights for policy 0, policy_version 635198 (0.0010) [2023-12-27 23:48:27,321][106226] Updated weights for policy 0, policy_version 635208 (0.0007) [2023-12-27 23:48:27,853][106225] Updated weights for policy 1, policy_version 637105 (0.0006) [2023-12-27 23:48:27,917][106225] Updated weights for policy 1, policy_version 637115 (0.0005) [2023-12-27 23:48:27,942][106226] Updated weights for policy 0, policy_version 635218 (0.0009) [2023-12-27 23:48:27,981][106225] Updated weights for policy 1, policy_version 637125 (0.0005) [2023-12-27 23:48:27,990][106226] Updated weights for policy 0, policy_version 635228 (0.0005) [2023-12-27 23:48:28,043][106226] Updated weights for policy 0, policy_version 635238 (0.0005) [2023-12-27 23:48:28,094][106226] Updated weights for policy 0, policy_version 635248 (0.0005) [2023-12-27 23:48:28,603][106225] Updated weights for policy 1, policy_version 637135 (0.0009) [2023-12-27 23:48:28,655][106225] Updated weights for policy 1, policy_version 637145 (0.0006) [2023-12-27 23:48:28,708][106225] Updated weights for policy 1, policy_version 637155 (0.0005) [2023-12-27 23:48:28,814][106226] Updated weights for policy 0, policy_version 635258 (0.0008) [2023-12-27 23:48:28,885][106226] Updated weights for policy 0, policy_version 635268 (0.0008) [2023-12-27 23:48:28,950][106226] Updated weights for policy 0, policy_version 635278 (0.0010) [2023-12-27 23:48:29,315][106225] Updated weights for policy 1, policy_version 637165 (0.0009) [2023-12-27 23:48:29,384][106225] Updated weights for policy 1, policy_version 637175 (0.0009) [2023-12-27 23:48:29,449][106225] Updated weights for policy 1, policy_version 637185 (0.0008) [2023-12-27 23:48:29,654][106226] Updated weights for policy 0, policy_version 635288 (0.0006) [2023-12-27 23:48:29,710][106226] Updated weights for policy 0, policy_version 635298 (0.0006) [2023-12-27 23:48:29,781][106226] Updated weights for policy 0, policy_version 635308 (0.0007) [2023-12-27 23:48:30,125][106225] Updated weights for policy 1, policy_version 637195 (0.0009) [2023-12-27 23:48:30,184][106225] Updated weights for policy 1, policy_version 637205 (0.0005) [2023-12-27 23:48:30,252][106225] Updated weights for policy 1, policy_version 637215 (0.0005) [2023-12-27 23:48:30,515][106226] Updated weights for policy 0, policy_version 635318 (0.0008) [2023-12-27 23:48:30,576][106226] Updated weights for policy 0, policy_version 635328 (0.0008) [2023-12-27 23:48:30,629][106226] Updated weights for policy 0, policy_version 635338 (0.0008) [2023-12-27 23:48:30,866][106225] Updated weights for policy 1, policy_version 637225 (0.0005) [2023-12-27 23:48:30,918][106225] Updated weights for policy 1, policy_version 637235 (0.0005) [2023-12-27 23:48:30,963][106225] Updated weights for policy 1, policy_version 637245 (0.0006) [2023-12-27 23:48:31,017][106225] Updated weights for policy 1, policy_version 637255 (0.0005) [2023-12-27 23:48:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 325853184. Throughput: 0: 10059.1, 1: 9807.4. Samples: 325840364. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:31,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-5.794')] [2023-12-27 23:48:31,424][106226] Updated weights for policy 0, policy_version 635348 (0.0008) [2023-12-27 23:48:31,481][106226] Updated weights for policy 0, policy_version 635358 (0.0009) [2023-12-27 23:48:31,544][106226] Updated weights for policy 0, policy_version 635368 (0.0008) [2023-12-27 23:48:31,783][106225] Updated weights for policy 1, policy_version 637265 (0.0009) [2023-12-27 23:48:31,845][106225] Updated weights for policy 1, policy_version 637275 (0.0009) [2023-12-27 23:48:31,901][106225] Updated weights for policy 1, policy_version 637285 (0.0009) [2023-12-27 23:48:32,294][106226] Updated weights for policy 0, policy_version 635378 (0.0009) [2023-12-27 23:48:32,362][106226] Updated weights for policy 0, policy_version 635388 (0.0009) [2023-12-27 23:48:32,430][106226] Updated weights for policy 0, policy_version 635398 (0.0007) [2023-12-27 23:48:32,492][106226] Updated weights for policy 0, policy_version 635408 (0.0005) [2023-12-27 23:48:32,628][106225] Updated weights for policy 1, policy_version 637295 (0.0008) [2023-12-27 23:48:32,691][106225] Updated weights for policy 1, policy_version 637305 (0.0008) [2023-12-27 23:48:32,756][106225] Updated weights for policy 1, policy_version 637315 (0.0009) [2023-12-27 23:48:33,083][106226] Updated weights for policy 0, policy_version 635418 (0.0008) [2023-12-27 23:48:33,142][106226] Updated weights for policy 0, policy_version 635428 (0.0008) [2023-12-27 23:48:33,204][106226] Updated weights for policy 0, policy_version 635438 (0.0010) [2023-12-27 23:48:33,528][106225] Updated weights for policy 1, policy_version 637325 (0.0008) [2023-12-27 23:48:33,577][106225] Updated weights for policy 1, policy_version 637335 (0.0009) [2023-12-27 23:48:33,625][106225] Updated weights for policy 1, policy_version 637345 (0.0008) [2023-12-27 23:48:33,788][106226] Updated weights for policy 0, policy_version 635448 (0.0006) [2023-12-27 23:48:33,841][106226] Updated weights for policy 0, policy_version 635458 (0.0006) [2023-12-27 23:48:33,887][106226] Updated weights for policy 0, policy_version 635468 (0.0006) [2023-12-27 23:48:34,318][106225] Updated weights for policy 1, policy_version 637355 (0.0007) [2023-12-27 23:48:34,387][106225] Updated weights for policy 1, policy_version 637365 (0.0006) [2023-12-27 23:48:34,457][106225] Updated weights for policy 1, policy_version 637375 (0.0007) [2023-12-27 23:48:34,485][106226] Updated weights for policy 0, policy_version 635478 (0.0006) [2023-12-27 23:48:34,544][106226] Updated weights for policy 0, policy_version 635488 (0.0006) [2023-12-27 23:48:34,599][106226] Updated weights for policy 0, policy_version 635498 (0.0006) [2023-12-27 23:48:35,025][106225] Updated weights for policy 1, policy_version 637385 (0.0007) [2023-12-27 23:48:35,091][106225] Updated weights for policy 1, policy_version 637395 (0.0009) [2023-12-27 23:48:35,153][106225] Updated weights for policy 1, policy_version 637405 (0.0009) [2023-12-27 23:48:35,204][106225] Updated weights for policy 1, policy_version 637415 (0.0007) [2023-12-27 23:48:35,204][106226] Updated weights for policy 0, policy_version 635508 (0.0007) [2023-12-27 23:48:35,265][106226] Updated weights for policy 0, policy_version 635518 (0.0005) [2023-12-27 23:48:35,327][106226] Updated weights for policy 0, policy_version 635528 (0.0005) [2023-12-27 23:48:35,898][106225] Updated weights for policy 1, policy_version 637425 (0.0008) [2023-12-27 23:48:35,958][106225] Updated weights for policy 1, policy_version 637435 (0.0008) [2023-12-27 23:48:36,011][106226] Updated weights for policy 0, policy_version 635538 (0.0006) [2023-12-27 23:48:36,016][106225] Updated weights for policy 1, policy_version 637445 (0.0007) [2023-12-27 23:48:36,066][106226] Updated weights for policy 0, policy_version 635548 (0.0008) [2023-12-27 23:48:36,130][106226] Updated weights for policy 0, policy_version 635558 (0.0009) [2023-12-27 23:48:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 325951488. Throughput: 0: 10084.7, 1: 9777.6. Samples: 325961916. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:36,175][105115] Avg episode reward: [(0, '-4.927'), (1, '-5.337')] [2023-12-27 23:48:36,194][106226] Updated weights for policy 0, policy_version 635568 (0.0008) [2023-12-27 23:48:36,681][106225] Updated weights for policy 1, policy_version 637455 (0.0008) [2023-12-27 23:48:36,741][106225] Updated weights for policy 1, policy_version 637465 (0.0008) [2023-12-27 23:48:36,800][106225] Updated weights for policy 1, policy_version 637475 (0.0008) [2023-12-27 23:48:36,963][106226] Updated weights for policy 0, policy_version 635578 (0.0009) [2023-12-27 23:48:37,024][106226] Updated weights for policy 0, policy_version 635588 (0.0009) [2023-12-27 23:48:37,077][106226] Updated weights for policy 0, policy_version 635598 (0.0008) [2023-12-27 23:48:37,501][106225] Updated weights for policy 1, policy_version 637485 (0.0007) [2023-12-27 23:48:37,568][106225] Updated weights for policy 1, policy_version 637495 (0.0005) [2023-12-27 23:48:37,628][106225] Updated weights for policy 1, policy_version 637505 (0.0007) [2023-12-27 23:48:37,842][106226] Updated weights for policy 0, policy_version 635608 (0.0006) [2023-12-27 23:48:37,900][106226] Updated weights for policy 0, policy_version 635618 (0.0005) [2023-12-27 23:48:37,957][106226] Updated weights for policy 0, policy_version 635628 (0.0005) [2023-12-27 23:48:38,179][106225] Updated weights for policy 1, policy_version 637515 (0.0008) [2023-12-27 23:48:38,239][106225] Updated weights for policy 1, policy_version 637525 (0.0009) [2023-12-27 23:48:38,298][106225] Updated weights for policy 1, policy_version 637535 (0.0010) [2023-12-27 23:48:38,645][106226] Updated weights for policy 0, policy_version 635638 (0.0008) [2023-12-27 23:48:38,700][106226] Updated weights for policy 0, policy_version 635648 (0.0008) [2023-12-27 23:48:38,748][106226] Updated weights for policy 0, policy_version 635658 (0.0007) [2023-12-27 23:48:38,992][106225] Updated weights for policy 1, policy_version 637545 (0.0009) [2023-12-27 23:48:39,059][106225] Updated weights for policy 1, policy_version 637555 (0.0006) [2023-12-27 23:48:39,121][106225] Updated weights for policy 1, policy_version 637565 (0.0008) [2023-12-27 23:48:39,180][106225] Updated weights for policy 1, policy_version 637575 (0.0008) [2023-12-27 23:48:39,488][106226] Updated weights for policy 0, policy_version 635668 (0.0009) [2023-12-27 23:48:39,545][106226] Updated weights for policy 0, policy_version 635678 (0.0009) [2023-12-27 23:48:39,605][106226] Updated weights for policy 0, policy_version 635688 (0.0008) [2023-12-27 23:48:39,991][106225] Updated weights for policy 1, policy_version 637585 (0.0008) [2023-12-27 23:48:40,049][106225] Updated weights for policy 1, policy_version 637595 (0.0006) [2023-12-27 23:48:40,101][106225] Updated weights for policy 1, policy_version 637605 (0.0005) [2023-12-27 23:48:40,371][106226] Updated weights for policy 0, policy_version 635698 (0.0008) [2023-12-27 23:48:40,439][106226] Updated weights for policy 0, policy_version 635708 (0.0009) [2023-12-27 23:48:40,499][106226] Updated weights for policy 0, policy_version 635718 (0.0008) [2023-12-27 23:48:40,551][106226] Updated weights for policy 0, policy_version 635728 (0.0008) [2023-12-27 23:48:40,725][106225] Updated weights for policy 1, policy_version 637615 (0.0006) [2023-12-27 23:48:40,779][106225] Updated weights for policy 1, policy_version 637625 (0.0006) [2023-12-27 23:48:40,843][106225] Updated weights for policy 1, policy_version 637635 (0.0010) [2023-12-27 23:48:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 326049792. Throughput: 0: 10065.8, 1: 9859.4. Samples: 326021920. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:41,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.702')] [2023-12-27 23:48:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000637640_163266560.pth... [2023-12-27 23:48:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000636488_162971648.pth [2023-12-27 23:48:41,237][106226] Updated weights for policy 0, policy_version 635738 (0.0008) [2023-12-27 23:48:41,304][106226] Updated weights for policy 0, policy_version 635748 (0.0009) [2023-12-27 23:48:41,382][106226] Updated weights for policy 0, policy_version 635758 (0.0009) [2023-12-27 23:48:41,395][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000635760_162791424.pth... [2023-12-27 23:48:41,399][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000634576_162488320.pth [2023-12-27 23:48:41,535][106225] Updated weights for policy 1, policy_version 637645 (0.0009) [2023-12-27 23:48:41,601][106225] Updated weights for policy 1, policy_version 637655 (0.0008) [2023-12-27 23:48:41,666][106225] Updated weights for policy 1, policy_version 637665 (0.0008) [2023-12-27 23:48:42,147][106226] Updated weights for policy 0, policy_version 635768 (0.0008) [2023-12-27 23:48:42,212][106226] Updated weights for policy 0, policy_version 635778 (0.0008) [2023-12-27 23:48:42,283][106226] Updated weights for policy 0, policy_version 635788 (0.0008) [2023-12-27 23:48:42,380][106225] Updated weights for policy 1, policy_version 637675 (0.0008) [2023-12-27 23:48:42,438][106225] Updated weights for policy 1, policy_version 637685 (0.0010) [2023-12-27 23:48:42,486][106225] Updated weights for policy 1, policy_version 637695 (0.0010) [2023-12-27 23:48:42,999][106226] Updated weights for policy 0, policy_version 635798 (0.0008) [2023-12-27 23:48:43,059][106226] Updated weights for policy 0, policy_version 635808 (0.0006) [2023-12-27 23:48:43,125][106226] Updated weights for policy 0, policy_version 635818 (0.0005) [2023-12-27 23:48:43,208][106225] Updated weights for policy 1, policy_version 637705 (0.0010) [2023-12-27 23:48:43,265][106225] Updated weights for policy 1, policy_version 637715 (0.0010) [2023-12-27 23:48:43,316][106225] Updated weights for policy 1, policy_version 637725 (0.0010) [2023-12-27 23:48:43,366][106225] Updated weights for policy 1, policy_version 637735 (0.0010) [2023-12-27 23:48:43,794][106226] Updated weights for policy 0, policy_version 635828 (0.0007) [2023-12-27 23:48:43,840][106226] Updated weights for policy 0, policy_version 635838 (0.0008) [2023-12-27 23:48:43,883][106226] Updated weights for policy 0, policy_version 635848 (0.0008) [2023-12-27 23:48:44,072][106225] Updated weights for policy 1, policy_version 637745 (0.0010) [2023-12-27 23:48:44,119][106225] Updated weights for policy 1, policy_version 637755 (0.0010) [2023-12-27 23:48:44,169][106225] Updated weights for policy 1, policy_version 637765 (0.0010) [2023-12-27 23:48:44,577][106226] Updated weights for policy 0, policy_version 635858 (0.0007) [2023-12-27 23:48:44,636][106226] Updated weights for policy 0, policy_version 635868 (0.0005) [2023-12-27 23:48:44,699][106226] Updated weights for policy 0, policy_version 635878 (0.0005) [2023-12-27 23:48:44,761][106226] Updated weights for policy 0, policy_version 635888 (0.0006) [2023-12-27 23:48:44,912][106225] Updated weights for policy 1, policy_version 637775 (0.0009) [2023-12-27 23:48:44,974][106225] Updated weights for policy 1, policy_version 637785 (0.0010) [2023-12-27 23:48:45,040][106225] Updated weights for policy 1, policy_version 637795 (0.0010) [2023-12-27 23:48:45,416][106226] Updated weights for policy 0, policy_version 635898 (0.0011) [2023-12-27 23:48:45,463][106226] Updated weights for policy 0, policy_version 635908 (0.0010) [2023-12-27 23:48:45,520][106226] Updated weights for policy 0, policy_version 635918 (0.0010) [2023-12-27 23:48:45,811][106225] Updated weights for policy 1, policy_version 637805 (0.0010) [2023-12-27 23:48:45,875][106225] Updated weights for policy 1, policy_version 637815 (0.0008) [2023-12-27 23:48:45,925][106225] Updated weights for policy 1, policy_version 637825 (0.0007) [2023-12-27 23:48:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 326148096. Throughput: 0: 9973.0, 1: 9795.4. Samples: 326138732. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:46,176][105115] Avg episode reward: [(0, '-4.443'), (1, '-5.661')] [2023-12-27 23:48:46,244][106226] Updated weights for policy 0, policy_version 635928 (0.0011) [2023-12-27 23:48:46,294][106226] Updated weights for policy 0, policy_version 635938 (0.0010) [2023-12-27 23:48:46,351][106226] Updated weights for policy 0, policy_version 635948 (0.0011) [2023-12-27 23:48:46,493][106225] Updated weights for policy 1, policy_version 637835 (0.0006) [2023-12-27 23:48:46,553][106225] Updated weights for policy 1, policy_version 637845 (0.0005) [2023-12-27 23:48:46,614][106225] Updated weights for policy 1, policy_version 637855 (0.0008) [2023-12-27 23:48:47,039][106226] Updated weights for policy 0, policy_version 635958 (0.0009) [2023-12-27 23:48:47,096][106226] Updated weights for policy 0, policy_version 635968 (0.0010) [2023-12-27 23:48:47,161][106226] Updated weights for policy 0, policy_version 635978 (0.0007) [2023-12-27 23:48:47,372][106225] Updated weights for policy 1, policy_version 637865 (0.0008) [2023-12-27 23:48:47,440][106225] Updated weights for policy 1, policy_version 637875 (0.0010) [2023-12-27 23:48:47,493][106225] Updated weights for policy 1, policy_version 637885 (0.0010) [2023-12-27 23:48:47,545][106225] Updated weights for policy 1, policy_version 637895 (0.0010) [2023-12-27 23:48:47,725][106226] Updated weights for policy 0, policy_version 635988 (0.0008) [2023-12-27 23:48:47,772][106226] Updated weights for policy 0, policy_version 635998 (0.0010) [2023-12-27 23:48:47,818][106226] Updated weights for policy 0, policy_version 636008 (0.0010) [2023-12-27 23:48:48,152][106225] Updated weights for policy 1, policy_version 637905 (0.0006) [2023-12-27 23:48:48,217][106225] Updated weights for policy 1, policy_version 637915 (0.0006) [2023-12-27 23:48:48,282][106225] Updated weights for policy 1, policy_version 637925 (0.0005) [2023-12-27 23:48:48,513][106226] Updated weights for policy 0, policy_version 636018 (0.0009) [2023-12-27 23:48:48,580][106226] Updated weights for policy 0, policy_version 636028 (0.0011) [2023-12-27 23:48:48,643][106226] Updated weights for policy 0, policy_version 636038 (0.0009) [2023-12-27 23:48:48,705][106226] Updated weights for policy 0, policy_version 636048 (0.0010) [2023-12-27 23:48:48,906][106225] Updated weights for policy 1, policy_version 637935 (0.0005) [2023-12-27 23:48:48,973][106225] Updated weights for policy 1, policy_version 637945 (0.0006) [2023-12-27 23:48:49,022][106225] Updated weights for policy 1, policy_version 637955 (0.0008) [2023-12-27 23:48:49,410][106226] Updated weights for policy 0, policy_version 636058 (0.0009) [2023-12-27 23:48:49,473][106226] Updated weights for policy 0, policy_version 636068 (0.0011) [2023-12-27 23:48:49,521][106226] Updated weights for policy 0, policy_version 636078 (0.0010) [2023-12-27 23:48:49,773][106225] Updated weights for policy 1, policy_version 637965 (0.0008) [2023-12-27 23:48:49,842][106225] Updated weights for policy 1, policy_version 637975 (0.0009) [2023-12-27 23:48:49,902][106225] Updated weights for policy 1, policy_version 637985 (0.0007) [2023-12-27 23:48:50,218][106226] Updated weights for policy 0, policy_version 636088 (0.0009) [2023-12-27 23:48:50,281][106226] Updated weights for policy 0, policy_version 636098 (0.0009) [2023-12-27 23:48:50,342][106226] Updated weights for policy 0, policy_version 636108 (0.0009) [2023-12-27 23:48:50,621][106225] Updated weights for policy 1, policy_version 637995 (0.0007) [2023-12-27 23:48:50,686][106225] Updated weights for policy 1, policy_version 638005 (0.0009) [2023-12-27 23:48:50,738][106225] Updated weights for policy 1, policy_version 638015 (0.0008) [2023-12-27 23:48:51,025][106226] Updated weights for policy 0, policy_version 636118 (0.0010) [2023-12-27 23:48:51,089][106226] Updated weights for policy 0, policy_version 636128 (0.0007) [2023-12-27 23:48:51,151][106226] Updated weights for policy 0, policy_version 636138 (0.0008) [2023-12-27 23:48:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 326246400. Throughput: 0: 9988.4, 1: 9809.8. Samples: 326259308. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:51,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-5.839')] [2023-12-27 23:48:51,500][106225] Updated weights for policy 1, policy_version 638025 (0.0009) [2023-12-27 23:48:51,561][106225] Updated weights for policy 1, policy_version 638035 (0.0007) [2023-12-27 23:48:51,627][106225] Updated weights for policy 1, policy_version 638045 (0.0008) [2023-12-27 23:48:51,699][106225] Updated weights for policy 1, policy_version 638055 (0.0008) [2023-12-27 23:48:51,983][106226] Updated weights for policy 0, policy_version 636148 (0.0008) [2023-12-27 23:48:52,036][106226] Updated weights for policy 0, policy_version 636158 (0.0006) [2023-12-27 23:48:52,091][106226] Updated weights for policy 0, policy_version 636168 (0.0006) [2023-12-27 23:48:52,411][106225] Updated weights for policy 1, policy_version 638065 (0.0008) [2023-12-27 23:48:52,478][106225] Updated weights for policy 1, policy_version 638075 (0.0010) [2023-12-27 23:48:52,544][106225] Updated weights for policy 1, policy_version 638085 (0.0009) [2023-12-27 23:48:52,764][106226] Updated weights for policy 0, policy_version 636178 (0.0008) [2023-12-27 23:48:52,828][106226] Updated weights for policy 0, policy_version 636188 (0.0008) [2023-12-27 23:48:52,887][106226] Updated weights for policy 0, policy_version 636198 (0.0009) [2023-12-27 23:48:52,950][106226] Updated weights for policy 0, policy_version 636208 (0.0009) [2023-12-27 23:48:53,280][106225] Updated weights for policy 1, policy_version 638095 (0.0008) [2023-12-27 23:48:53,329][106225] Updated weights for policy 1, policy_version 638105 (0.0009) [2023-12-27 23:48:53,381][106225] Updated weights for policy 1, policy_version 638115 (0.0008) [2023-12-27 23:48:53,575][106226] Updated weights for policy 0, policy_version 636218 (0.0008) [2023-12-27 23:48:53,629][106226] Updated weights for policy 0, policy_version 636228 (0.0008) [2023-12-27 23:48:53,682][106226] Updated weights for policy 0, policy_version 636238 (0.0008) [2023-12-27 23:48:54,118][106225] Updated weights for policy 1, policy_version 638125 (0.0007) [2023-12-27 23:48:54,172][106225] Updated weights for policy 1, policy_version 638135 (0.0005) [2023-12-27 23:48:54,228][106225] Updated weights for policy 1, policy_version 638145 (0.0007) [2023-12-27 23:48:54,315][106226] Updated weights for policy 0, policy_version 636248 (0.0006) [2023-12-27 23:48:54,372][106226] Updated weights for policy 0, policy_version 636258 (0.0009) [2023-12-27 23:48:54,425][106226] Updated weights for policy 0, policy_version 636268 (0.0008) [2023-12-27 23:48:54,882][106225] Updated weights for policy 1, policy_version 638155 (0.0008) [2023-12-27 23:48:54,939][106225] Updated weights for policy 1, policy_version 638165 (0.0007) [2023-12-27 23:48:55,007][106225] Updated weights for policy 1, policy_version 638175 (0.0009) [2023-12-27 23:48:55,190][106226] Updated weights for policy 0, policy_version 636278 (0.0009) [2023-12-27 23:48:55,252][106226] Updated weights for policy 0, policy_version 636288 (0.0009) [2023-12-27 23:48:55,313][106226] Updated weights for policy 0, policy_version 636298 (0.0010) [2023-12-27 23:48:55,645][106225] Updated weights for policy 1, policy_version 638185 (0.0010) [2023-12-27 23:48:55,696][106225] Updated weights for policy 1, policy_version 638195 (0.0005) [2023-12-27 23:48:55,741][106225] Updated weights for policy 1, policy_version 638205 (0.0005) [2023-12-27 23:48:55,785][106225] Updated weights for policy 1, policy_version 638215 (0.0005) [2023-12-27 23:48:56,136][106226] Updated weights for policy 0, policy_version 636308 (0.0009) [2023-12-27 23:48:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 326344704. Throughput: 0: 9972.1, 1: 9755.2. Samples: 326317392. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:48:56,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-6.000')] [2023-12-27 23:48:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000638216_163414016.pth... [2023-12-27 23:48:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000637064_163119104.pth [2023-12-27 23:48:56,190][106226] Updated weights for policy 0, policy_version 636318 (0.0008) [2023-12-27 23:48:56,247][106226] Updated weights for policy 0, policy_version 636328 (0.0008) [2023-12-27 23:48:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000636336_162938880.pth... [2023-12-27 23:48:56,298][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000635152_162635776.pth [2023-12-27 23:48:56,349][106225] Updated weights for policy 1, policy_version 638225 (0.0005) [2023-12-27 23:48:56,397][106225] Updated weights for policy 1, policy_version 638235 (0.0008) [2023-12-27 23:48:56,444][106225] Updated weights for policy 1, policy_version 638245 (0.0010) [2023-12-27 23:48:56,979][106226] Updated weights for policy 0, policy_version 636338 (0.0008) [2023-12-27 23:48:57,030][106226] Updated weights for policy 0, policy_version 636348 (0.0008) [2023-12-27 23:48:57,077][106226] Updated weights for policy 0, policy_version 636358 (0.0008) [2023-12-27 23:48:57,119][106225] Updated weights for policy 1, policy_version 638255 (0.0010) [2023-12-27 23:48:57,132][106226] Updated weights for policy 0, policy_version 636368 (0.0008) [2023-12-27 23:48:57,173][106225] Updated weights for policy 1, policy_version 638265 (0.0010) [2023-12-27 23:48:57,219][106225] Updated weights for policy 1, policy_version 638275 (0.0010) [2023-12-27 23:48:57,836][106225] Updated weights for policy 1, policy_version 638285 (0.0008) [2023-12-27 23:48:57,886][106225] Updated weights for policy 1, policy_version 638295 (0.0005) [2023-12-27 23:48:57,923][106226] Updated weights for policy 0, policy_version 636378 (0.0008) [2023-12-27 23:48:57,940][106225] Updated weights for policy 1, policy_version 638305 (0.0007) [2023-12-27 23:48:57,970][106226] Updated weights for policy 0, policy_version 636388 (0.0006) [2023-12-27 23:48:58,024][106226] Updated weights for policy 0, policy_version 636398 (0.0008) [2023-12-27 23:48:58,624][106225] Updated weights for policy 1, policy_version 638315 (0.0009) [2023-12-27 23:48:58,690][106225] Updated weights for policy 1, policy_version 638325 (0.0008) [2023-12-27 23:48:58,762][106225] Updated weights for policy 1, policy_version 638335 (0.0007) [2023-12-27 23:48:58,815][106226] Updated weights for policy 0, policy_version 636408 (0.0008) [2023-12-27 23:48:58,884][106226] Updated weights for policy 0, policy_version 636418 (0.0010) [2023-12-27 23:48:58,947][106226] Updated weights for policy 0, policy_version 636428 (0.0010) [2023-12-27 23:48:59,583][106225] Updated weights for policy 1, policy_version 638345 (0.0007) [2023-12-27 23:48:59,637][106225] Updated weights for policy 1, policy_version 638355 (0.0008) [2023-12-27 23:48:59,697][106225] Updated weights for policy 1, policy_version 638365 (0.0007) [2023-12-27 23:48:59,718][106226] Updated weights for policy 0, policy_version 636438 (0.0008) [2023-12-27 23:48:59,760][106225] Updated weights for policy 1, policy_version 638375 (0.0007) [2023-12-27 23:48:59,773][106226] Updated weights for policy 0, policy_version 636448 (0.0008) [2023-12-27 23:48:59,838][106226] Updated weights for policy 0, policy_version 636458 (0.0009) [2023-12-27 23:49:00,428][106225] Updated weights for policy 1, policy_version 638385 (0.0007) [2023-12-27 23:49:00,475][106225] Updated weights for policy 1, policy_version 638395 (0.0007) [2023-12-27 23:49:00,535][106225] Updated weights for policy 1, policy_version 638405 (0.0007) [2023-12-27 23:49:00,562][106226] Updated weights for policy 0, policy_version 636468 (0.0009) [2023-12-27 23:49:00,619][106226] Updated weights for policy 0, policy_version 636478 (0.0010) [2023-12-27 23:49:00,681][106226] Updated weights for policy 0, policy_version 636488 (0.0008) [2023-12-27 23:49:01,155][106225] Updated weights for policy 1, policy_version 638415 (0.0006) [2023-12-27 23:49:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 326443008. Throughput: 0: 9870.4, 1: 9844.6. Samples: 326434040. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:01,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.967')] [2023-12-27 23:49:01,214][106225] Updated weights for policy 1, policy_version 638425 (0.0006) [2023-12-27 23:49:01,272][106225] Updated weights for policy 1, policy_version 638435 (0.0007) [2023-12-27 23:49:01,466][106226] Updated weights for policy 0, policy_version 636498 (0.0009) [2023-12-27 23:49:01,530][106226] Updated weights for policy 0, policy_version 636508 (0.0008) [2023-12-27 23:49:01,598][106226] Updated weights for policy 0, policy_version 636518 (0.0008) [2023-12-27 23:49:01,666][106226] Updated weights for policy 0, policy_version 636528 (0.0009) [2023-12-27 23:49:01,936][106225] Updated weights for policy 1, policy_version 638445 (0.0007) [2023-12-27 23:49:01,985][106225] Updated weights for policy 1, policy_version 638455 (0.0008) [2023-12-27 23:49:02,050][106225] Updated weights for policy 1, policy_version 638465 (0.0008) [2023-12-27 23:49:02,363][106226] Updated weights for policy 0, policy_version 636538 (0.0008) [2023-12-27 23:49:02,437][106226] Updated weights for policy 0, policy_version 636548 (0.0008) [2023-12-27 23:49:02,498][106226] Updated weights for policy 0, policy_version 636558 (0.0009) [2023-12-27 23:49:02,832][106225] Updated weights for policy 1, policy_version 638475 (0.0008) [2023-12-27 23:49:02,895][106225] Updated weights for policy 1, policy_version 638485 (0.0007) [2023-12-27 23:49:02,952][106225] Updated weights for policy 1, policy_version 638495 (0.0008) [2023-12-27 23:49:03,139][106226] Updated weights for policy 0, policy_version 636568 (0.0009) [2023-12-27 23:49:03,202][106226] Updated weights for policy 0, policy_version 636578 (0.0009) [2023-12-27 23:49:03,263][106226] Updated weights for policy 0, policy_version 636588 (0.0007) [2023-12-27 23:49:03,738][106225] Updated weights for policy 1, policy_version 638505 (0.0009) [2023-12-27 23:49:03,790][106225] Updated weights for policy 1, policy_version 638515 (0.0008) [2023-12-27 23:49:03,846][106225] Updated weights for policy 1, policy_version 638525 (0.0008) [2023-12-27 23:49:03,854][106226] Updated weights for policy 0, policy_version 636598 (0.0007) [2023-12-27 23:49:03,909][106225] Updated weights for policy 1, policy_version 638535 (0.0007) [2023-12-27 23:49:03,915][106226] Updated weights for policy 0, policy_version 636608 (0.0011) [2023-12-27 23:49:03,979][106226] Updated weights for policy 0, policy_version 636618 (0.0011) [2023-12-27 23:49:04,627][106226] Updated weights for policy 0, policy_version 636628 (0.0009) [2023-12-27 23:49:04,665][106225] Updated weights for policy 1, policy_version 638545 (0.0007) [2023-12-27 23:49:04,693][106226] Updated weights for policy 0, policy_version 636638 (0.0005) [2023-12-27 23:49:04,718][106225] Updated weights for policy 1, policy_version 638555 (0.0008) [2023-12-27 23:49:04,759][106226] Updated weights for policy 0, policy_version 636648 (0.0005) [2023-12-27 23:49:04,775][106225] Updated weights for policy 1, policy_version 638565 (0.0007) [2023-12-27 23:49:05,262][106226] Updated weights for policy 0, policy_version 636658 (0.0005) [2023-12-27 23:49:05,325][106226] Updated weights for policy 0, policy_version 636668 (0.0007) [2023-12-27 23:49:05,352][106225] Updated weights for policy 1, policy_version 638575 (0.0006) [2023-12-27 23:49:05,389][106226] Updated weights for policy 0, policy_version 636678 (0.0010) [2023-12-27 23:49:05,406][106225] Updated weights for policy 1, policy_version 638585 (0.0006) [2023-12-27 23:49:05,436][106226] Updated weights for policy 0, policy_version 636688 (0.0008) [2023-12-27 23:49:05,457][106225] Updated weights for policy 1, policy_version 638595 (0.0010) [2023-12-27 23:49:05,965][106226] Updated weights for policy 0, policy_version 636698 (0.0005) [2023-12-27 23:49:06,016][106226] Updated weights for policy 0, policy_version 636708 (0.0006) [2023-12-27 23:49:06,071][106226] Updated weights for policy 0, policy_version 636718 (0.0005) [2023-12-27 23:49:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 326549504. Throughput: 0: 9983.2, 1: 9912.5. Samples: 326558056. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:06,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.704')] [2023-12-27 23:49:06,181][106225] Updated weights for policy 1, policy_version 638605 (0.0009) [2023-12-27 23:49:06,246][106225] Updated weights for policy 1, policy_version 638615 (0.0010) [2023-12-27 23:49:06,314][106225] Updated weights for policy 1, policy_version 638625 (0.0011) [2023-12-27 23:49:06,769][106226] Updated weights for policy 0, policy_version 636728 (0.0010) [2023-12-27 23:49:06,813][106226] Updated weights for policy 0, policy_version 636738 (0.0010) [2023-12-27 23:49:06,875][106226] Updated weights for policy 0, policy_version 636748 (0.0011) [2023-12-27 23:49:06,937][106225] Updated weights for policy 1, policy_version 638635 (0.0010) [2023-12-27 23:49:06,996][106225] Updated weights for policy 1, policy_version 638645 (0.0010) [2023-12-27 23:49:07,054][106225] Updated weights for policy 1, policy_version 638655 (0.0010) [2023-12-27 23:49:07,622][106226] Updated weights for policy 0, policy_version 636758 (0.0010) [2023-12-27 23:49:07,679][106226] Updated weights for policy 0, policy_version 636768 (0.0006) [2023-12-27 23:49:07,698][106225] Updated weights for policy 1, policy_version 638665 (0.0010) [2023-12-27 23:49:07,741][106226] Updated weights for policy 0, policy_version 636778 (0.0006) [2023-12-27 23:49:07,762][106225] Updated weights for policy 1, policy_version 638675 (0.0008) [2023-12-27 23:49:07,827][106225] Updated weights for policy 1, policy_version 638685 (0.0007) [2023-12-27 23:49:07,881][106225] Updated weights for policy 1, policy_version 638695 (0.0008) [2023-12-27 23:49:08,389][106226] Updated weights for policy 0, policy_version 636788 (0.0008) [2023-12-27 23:49:08,441][106226] Updated weights for policy 0, policy_version 636798 (0.0008) [2023-12-27 23:49:08,491][106226] Updated weights for policy 0, policy_version 636808 (0.0008) [2023-12-27 23:49:08,639][106225] Updated weights for policy 1, policy_version 638705 (0.0009) [2023-12-27 23:49:08,708][106225] Updated weights for policy 1, policy_version 638715 (0.0008) [2023-12-27 23:49:08,766][106225] Updated weights for policy 1, policy_version 638725 (0.0008) [2023-12-27 23:49:09,236][106226] Updated weights for policy 0, policy_version 636818 (0.0008) [2023-12-27 23:49:09,308][106226] Updated weights for policy 0, policy_version 636828 (0.0007) [2023-12-27 23:49:09,379][106226] Updated weights for policy 0, policy_version 636838 (0.0009) [2023-12-27 23:49:09,452][106226] Updated weights for policy 0, policy_version 636848 (0.0007) [2023-12-27 23:49:09,521][106225] Updated weights for policy 1, policy_version 638735 (0.0007) [2023-12-27 23:49:09,586][106225] Updated weights for policy 1, policy_version 638745 (0.0007) [2023-12-27 23:49:09,639][106225] Updated weights for policy 1, policy_version 638755 (0.0007) [2023-12-27 23:49:10,223][106226] Updated weights for policy 0, policy_version 636858 (0.0009) [2023-12-27 23:49:10,292][106226] Updated weights for policy 0, policy_version 636868 (0.0009) [2023-12-27 23:49:10,314][106225] Updated weights for policy 1, policy_version 638765 (0.0006) [2023-12-27 23:49:10,352][106226] Updated weights for policy 0, policy_version 636878 (0.0007) [2023-12-27 23:49:10,378][106225] Updated weights for policy 1, policy_version 638775 (0.0006) [2023-12-27 23:49:10,442][106225] Updated weights for policy 1, policy_version 638785 (0.0007) [2023-12-27 23:49:11,030][106226] Updated weights for policy 0, policy_version 636888 (0.0007) [2023-12-27 23:49:11,100][106226] Updated weights for policy 0, policy_version 636898 (0.0009) [2023-12-27 23:49:11,152][106225] Updated weights for policy 1, policy_version 638795 (0.0007) [2023-12-27 23:49:11,168][106226] Updated weights for policy 0, policy_version 636908 (0.0008) [2023-12-27 23:49:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 326639616. Throughput: 0: 9973.1, 1: 9978.4. Samples: 326617212. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:11,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.717')] [2023-12-27 23:49:11,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000636912_163086336.pth... [2023-12-27 23:49:11,200][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000635760_162791424.pth [2023-12-27 23:49:11,211][106225] Updated weights for policy 1, policy_version 638805 (0.0006) [2023-12-27 23:49:11,270][106225] Updated weights for policy 1, policy_version 638815 (0.0008) [2023-12-27 23:49:11,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000638824_163569664.pth... [2023-12-27 23:49:11,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000637640_163266560.pth [2023-12-27 23:49:11,897][106226] Updated weights for policy 0, policy_version 636918 (0.0009) [2023-12-27 23:49:11,963][106226] Updated weights for policy 0, policy_version 636928 (0.0007) [2023-12-27 23:49:12,027][106226] Updated weights for policy 0, policy_version 636938 (0.0008) [2023-12-27 23:49:12,053][106225] Updated weights for policy 1, policy_version 638825 (0.0008) [2023-12-27 23:49:12,119][106225] Updated weights for policy 1, policy_version 638835 (0.0008) [2023-12-27 23:49:12,185][106225] Updated weights for policy 1, policy_version 638845 (0.0007) [2023-12-27 23:49:12,247][106225] Updated weights for policy 1, policy_version 638855 (0.0010) [2023-12-27 23:49:12,757][106226] Updated weights for policy 0, policy_version 636948 (0.0008) [2023-12-27 23:49:12,821][106226] Updated weights for policy 0, policy_version 636958 (0.0009) [2023-12-27 23:49:12,894][106226] Updated weights for policy 0, policy_version 636968 (0.0009) [2023-12-27 23:49:12,969][106225] Updated weights for policy 1, policy_version 638865 (0.0007) [2023-12-27 23:49:13,029][106225] Updated weights for policy 1, policy_version 638875 (0.0009) [2023-12-27 23:49:13,083][106225] Updated weights for policy 1, policy_version 638885 (0.0006) [2023-12-27 23:49:13,569][106226] Updated weights for policy 0, policy_version 636978 (0.0008) [2023-12-27 23:49:13,627][106225] Updated weights for policy 1, policy_version 638895 (0.0005) [2023-12-27 23:49:13,634][106226] Updated weights for policy 0, policy_version 636988 (0.0008) [2023-12-27 23:49:13,675][106225] Updated weights for policy 1, policy_version 638905 (0.0005) [2023-12-27 23:49:13,696][106226] Updated weights for policy 0, policy_version 636998 (0.0008) [2023-12-27 23:49:13,721][106225] Updated weights for policy 1, policy_version 638915 (0.0005) [2023-12-27 23:49:13,762][106226] Updated weights for policy 0, policy_version 637008 (0.0008) [2023-12-27 23:49:14,315][106225] Updated weights for policy 1, policy_version 638925 (0.0006) [2023-12-27 23:49:14,377][106225] Updated weights for policy 1, policy_version 638935 (0.0008) [2023-12-27 23:49:14,433][106225] Updated weights for policy 1, policy_version 638945 (0.0008) [2023-12-27 23:49:14,507][106226] Updated weights for policy 0, policy_version 637018 (0.0008) [2023-12-27 23:49:14,571][106226] Updated weights for policy 0, policy_version 637028 (0.0006) [2023-12-27 23:49:14,638][106226] Updated weights for policy 0, policy_version 637038 (0.0006) [2023-12-27 23:49:15,132][106225] Updated weights for policy 1, policy_version 638955 (0.0008) [2023-12-27 23:49:15,197][106225] Updated weights for policy 1, policy_version 638965 (0.0009) [2023-12-27 23:49:15,258][106225] Updated weights for policy 1, policy_version 638975 (0.0007) [2023-12-27 23:49:15,269][106226] Updated weights for policy 0, policy_version 637048 (0.0006) [2023-12-27 23:49:15,333][106226] Updated weights for policy 0, policy_version 637058 (0.0008) [2023-12-27 23:49:15,396][106226] Updated weights for policy 0, policy_version 637068 (0.0007) [2023-12-27 23:49:15,946][106225] Updated weights for policy 1, policy_version 638985 (0.0006) [2023-12-27 23:49:15,998][106225] Updated weights for policy 1, policy_version 638995 (0.0008) [2023-12-27 23:49:16,053][106225] Updated weights for policy 1, policy_version 639005 (0.0007) [2023-12-27 23:49:16,114][106225] Updated weights for policy 1, policy_version 639015 (0.0006) [2023-12-27 23:49:16,115][106226] Updated weights for policy 0, policy_version 637078 (0.0008) [2023-12-27 23:49:16,165][106226] Updated weights for policy 0, policy_version 637088 (0.0006) [2023-12-27 23:49:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 326746112. Throughput: 0: 9879.6, 1: 10006.0. Samples: 326735216. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:16,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.626')] [2023-12-27 23:49:16,214][106226] Updated weights for policy 0, policy_version 637098 (0.0005) [2023-12-27 23:49:16,669][106225] Updated weights for policy 1, policy_version 639025 (0.0005) [2023-12-27 23:49:16,717][106225] Updated weights for policy 1, policy_version 639035 (0.0005) [2023-12-27 23:49:16,764][106226] Updated weights for policy 0, policy_version 637108 (0.0007) [2023-12-27 23:49:16,770][106225] Updated weights for policy 1, policy_version 639045 (0.0005) [2023-12-27 23:49:16,812][106226] Updated weights for policy 0, policy_version 637118 (0.0010) [2023-12-27 23:49:16,862][106226] Updated weights for policy 0, policy_version 637128 (0.0010) [2023-12-27 23:49:17,453][106225] Updated weights for policy 1, policy_version 639055 (0.0009) [2023-12-27 23:49:17,520][106225] Updated weights for policy 1, policy_version 639065 (0.0010) [2023-12-27 23:49:17,581][106225] Updated weights for policy 1, policy_version 639075 (0.0010) [2023-12-27 23:49:17,607][106226] Updated weights for policy 0, policy_version 637138 (0.0010) [2023-12-27 23:49:17,667][106226] Updated weights for policy 0, policy_version 637148 (0.0010) [2023-12-27 23:49:17,730][106226] Updated weights for policy 0, policy_version 637158 (0.0010) [2023-12-27 23:49:17,779][106226] Updated weights for policy 0, policy_version 637168 (0.0010) [2023-12-27 23:49:18,200][106225] Updated weights for policy 1, policy_version 639085 (0.0010) [2023-12-27 23:49:18,258][106225] Updated weights for policy 1, policy_version 639095 (0.0007) [2023-12-27 23:49:18,317][106225] Updated weights for policy 1, policy_version 639105 (0.0008) [2023-12-27 23:49:18,524][106226] Updated weights for policy 0, policy_version 637178 (0.0011) [2023-12-27 23:49:18,589][106226] Updated weights for policy 0, policy_version 637188 (0.0006) [2023-12-27 23:49:18,661][106226] Updated weights for policy 0, policy_version 637198 (0.0007) [2023-12-27 23:49:19,041][106225] Updated weights for policy 1, policy_version 639115 (0.0010) [2023-12-27 23:49:19,104][106225] Updated weights for policy 1, policy_version 639125 (0.0010) [2023-12-27 23:49:19,166][106225] Updated weights for policy 1, policy_version 639135 (0.0008) [2023-12-27 23:49:19,312][106226] Updated weights for policy 0, policy_version 637208 (0.0009) [2023-12-27 23:49:19,374][106226] Updated weights for policy 0, policy_version 637218 (0.0010) [2023-12-27 23:49:19,434][106226] Updated weights for policy 0, policy_version 637228 (0.0009) [2023-12-27 23:49:19,931][106225] Updated weights for policy 1, policy_version 639145 (0.0006) [2023-12-27 23:49:20,000][106225] Updated weights for policy 1, policy_version 639155 (0.0009) [2023-12-27 23:49:20,058][106225] Updated weights for policy 1, policy_version 639165 (0.0009) [2023-12-27 23:49:20,112][106225] Updated weights for policy 1, policy_version 639175 (0.0009) [2023-12-27 23:49:20,311][106226] Updated weights for policy 0, policy_version 637238 (0.0009) [2023-12-27 23:49:20,369][106226] Updated weights for policy 0, policy_version 637248 (0.0009) [2023-12-27 23:49:20,418][106226] Updated weights for policy 0, policy_version 637258 (0.0009) [2023-12-27 23:49:21,018][106225] Updated weights for policy 1, policy_version 639185 (0.0009) [2023-12-27 23:49:21,081][106225] Updated weights for policy 1, policy_version 639195 (0.0010) [2023-12-27 23:49:21,151][106225] Updated weights for policy 1, policy_version 639205 (0.0009) [2023-12-27 23:49:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 326844416. Throughput: 0: 9764.7, 1: 9997.2. Samples: 326851196. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:21,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.742')] [2023-12-27 23:49:21,279][106226] Updated weights for policy 0, policy_version 637268 (0.0008) [2023-12-27 23:49:21,351][106226] Updated weights for policy 0, policy_version 637278 (0.0008) [2023-12-27 23:49:21,413][106226] Updated weights for policy 0, policy_version 637288 (0.0010) [2023-12-27 23:49:21,834][106225] Updated weights for policy 1, policy_version 639215 (0.0009) [2023-12-27 23:49:21,894][106225] Updated weights for policy 1, policy_version 639225 (0.0008) [2023-12-27 23:49:21,957][106225] Updated weights for policy 1, policy_version 639235 (0.0008) [2023-12-27 23:49:22,112][106226] Updated weights for policy 0, policy_version 637298 (0.0011) [2023-12-27 23:49:22,180][106226] Updated weights for policy 0, policy_version 637308 (0.0009) [2023-12-27 23:49:22,250][106226] Updated weights for policy 0, policy_version 637318 (0.0010) [2023-12-27 23:49:22,312][106226] Updated weights for policy 0, policy_version 637328 (0.0010) [2023-12-27 23:49:22,739][106225] Updated weights for policy 1, policy_version 639245 (0.0007) [2023-12-27 23:49:22,798][106225] Updated weights for policy 1, policy_version 639255 (0.0008) [2023-12-27 23:49:22,854][106225] Updated weights for policy 1, policy_version 639265 (0.0009) [2023-12-27 23:49:23,063][106226] Updated weights for policy 0, policy_version 637338 (0.0005) [2023-12-27 23:49:23,120][106226] Updated weights for policy 0, policy_version 637348 (0.0005) [2023-12-27 23:49:23,167][106226] Updated weights for policy 0, policy_version 637358 (0.0005) [2023-12-27 23:49:23,640][106225] Updated weights for policy 1, policy_version 639275 (0.0008) [2023-12-27 23:49:23,699][106225] Updated weights for policy 1, policy_version 639285 (0.0008) [2023-12-27 23:49:23,742][106226] Updated weights for policy 0, policy_version 637368 (0.0006) [2023-12-27 23:49:23,754][106225] Updated weights for policy 1, policy_version 639295 (0.0007) [2023-12-27 23:49:23,792][106226] Updated weights for policy 0, policy_version 637378 (0.0006) [2023-12-27 23:49:23,842][106226] Updated weights for policy 0, policy_version 637388 (0.0009) [2023-12-27 23:49:24,485][106225] Updated weights for policy 1, policy_version 639305 (0.0008) [2023-12-27 23:49:24,549][106225] Updated weights for policy 1, policy_version 639315 (0.0008) [2023-12-27 23:49:24,599][106226] Updated weights for policy 0, policy_version 637398 (0.0008) [2023-12-27 23:49:24,609][106225] Updated weights for policy 1, policy_version 639325 (0.0007) [2023-12-27 23:49:24,658][106226] Updated weights for policy 0, policy_version 637408 (0.0008) [2023-12-27 23:49:24,671][106225] Updated weights for policy 1, policy_version 639335 (0.0008) [2023-12-27 23:49:24,715][106226] Updated weights for policy 0, policy_version 637418 (0.0008) [2023-12-27 23:49:25,372][106225] Updated weights for policy 1, policy_version 639345 (0.0010) [2023-12-27 23:49:25,435][106225] Updated weights for policy 1, policy_version 639355 (0.0010) [2023-12-27 23:49:25,456][106226] Updated weights for policy 0, policy_version 637428 (0.0007) [2023-12-27 23:49:25,495][106225] Updated weights for policy 1, policy_version 639365 (0.0010) [2023-12-27 23:49:25,509][106226] Updated weights for policy 0, policy_version 637438 (0.0005) [2023-12-27 23:49:25,558][106226] Updated weights for policy 0, policy_version 637448 (0.0007) [2023-12-27 23:49:26,158][106225] Updated weights for policy 1, policy_version 639375 (0.0007) [2023-12-27 23:49:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 326934528. Throughput: 0: 9805.0, 1: 9904.7. Samples: 326908860. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:26,176][105115] Avg episode reward: [(0, '-4.513'), (1, '-6.029')] [2023-12-27 23:49:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000637456_163225600.pth... [2023-12-27 23:49:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000636336_162938880.pth [2023-12-27 23:49:26,214][106225] Updated weights for policy 1, policy_version 639385 (0.0005) [2023-12-27 23:49:26,269][106225] Updated weights for policy 1, policy_version 639395 (0.0008) [2023-12-27 23:49:26,296][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000639400_163717120.pth... [2023-12-27 23:49:26,300][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000638216_163414016.pth [2023-12-27 23:49:26,333][106226] Updated weights for policy 0, policy_version 637458 (0.0008) [2023-12-27 23:49:26,396][106226] Updated weights for policy 0, policy_version 637468 (0.0009) [2023-12-27 23:49:26,461][106226] Updated weights for policy 0, policy_version 637478 (0.0008) [2023-12-27 23:49:26,517][106226] Updated weights for policy 0, policy_version 637488 (0.0009) [2023-12-27 23:49:26,951][106225] Updated weights for policy 1, policy_version 639405 (0.0010) [2023-12-27 23:49:27,010][106225] Updated weights for policy 1, policy_version 639415 (0.0010) [2023-12-27 23:49:27,070][106225] Updated weights for policy 1, policy_version 639425 (0.0010) [2023-12-27 23:49:27,240][106226] Updated weights for policy 0, policy_version 637498 (0.0008) [2023-12-27 23:49:27,288][106226] Updated weights for policy 0, policy_version 637508 (0.0007) [2023-12-27 23:49:27,342][106226] Updated weights for policy 0, policy_version 637518 (0.0009) [2023-12-27 23:49:27,755][106225] Updated weights for policy 1, policy_version 639435 (0.0010) [2023-12-27 23:49:27,800][106225] Updated weights for policy 1, policy_version 639445 (0.0005) [2023-12-27 23:49:27,844][106225] Updated weights for policy 1, policy_version 639455 (0.0005) [2023-12-27 23:49:28,111][106226] Updated weights for policy 0, policy_version 637528 (0.0008) [2023-12-27 23:49:28,163][106226] Updated weights for policy 0, policy_version 637538 (0.0008) [2023-12-27 23:49:28,223][106226] Updated weights for policy 0, policy_version 637548 (0.0008) [2023-12-27 23:49:28,517][106225] Updated weights for policy 1, policy_version 639465 (0.0005) [2023-12-27 23:49:28,583][106225] Updated weights for policy 1, policy_version 639475 (0.0008) [2023-12-27 23:49:28,644][106225] Updated weights for policy 1, policy_version 639485 (0.0008) [2023-12-27 23:49:28,705][106225] Updated weights for policy 1, policy_version 639495 (0.0008) [2023-12-27 23:49:28,947][106226] Updated weights for policy 0, policy_version 637558 (0.0009) [2023-12-27 23:49:29,005][106226] Updated weights for policy 0, policy_version 637568 (0.0008) [2023-12-27 23:49:29,058][106226] Updated weights for policy 0, policy_version 637578 (0.0009) [2023-12-27 23:49:29,320][106225] Updated weights for policy 1, policy_version 639505 (0.0009) [2023-12-27 23:49:29,390][106225] Updated weights for policy 1, policy_version 639515 (0.0008) [2023-12-27 23:49:29,436][106225] Updated weights for policy 1, policy_version 639525 (0.0005) [2023-12-27 23:49:29,836][106226] Updated weights for policy 0, policy_version 637588 (0.0010) [2023-12-27 23:49:29,904][106226] Updated weights for policy 0, policy_version 637598 (0.0008) [2023-12-27 23:49:29,972][106226] Updated weights for policy 0, policy_version 637608 (0.0010) [2023-12-27 23:49:30,057][106225] Updated weights for policy 1, policy_version 639535 (0.0009) [2023-12-27 23:49:30,111][106225] Updated weights for policy 1, policy_version 639545 (0.0010) [2023-12-27 23:49:30,163][106225] Updated weights for policy 1, policy_version 639555 (0.0009) [2023-12-27 23:49:30,711][106226] Updated weights for policy 0, policy_version 637618 (0.0009) [2023-12-27 23:49:30,770][106226] Updated weights for policy 0, policy_version 637628 (0.0008) [2023-12-27 23:49:30,823][106226] Updated weights for policy 0, policy_version 637638 (0.0008) [2023-12-27 23:49:30,875][106225] Updated weights for policy 1, policy_version 639565 (0.0010) [2023-12-27 23:49:30,878][106226] Updated weights for policy 0, policy_version 637648 (0.0009) [2023-12-27 23:49:30,930][106225] Updated weights for policy 1, policy_version 639575 (0.0010) [2023-12-27 23:49:30,976][106225] Updated weights for policy 1, policy_version 639585 (0.0010) [2023-12-27 23:49:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 327041024. Throughput: 0: 9748.3, 1: 9971.3. Samples: 327026112. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:31,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-5.521')] [2023-12-27 23:49:31,620][106226] Updated weights for policy 0, policy_version 637658 (0.0008) [2023-12-27 23:49:31,656][106225] Updated weights for policy 1, policy_version 639595 (0.0009) [2023-12-27 23:49:31,685][106226] Updated weights for policy 0, policy_version 637668 (0.0007) [2023-12-27 23:49:31,719][106225] Updated weights for policy 1, policy_version 639605 (0.0009) [2023-12-27 23:49:31,748][106226] Updated weights for policy 0, policy_version 637678 (0.0007) [2023-12-27 23:49:31,784][106225] Updated weights for policy 1, policy_version 639615 (0.0010) [2023-12-27 23:49:32,479][106225] Updated weights for policy 1, policy_version 639625 (0.0010) [2023-12-27 23:49:32,499][106226] Updated weights for policy 0, policy_version 637688 (0.0008) [2023-12-27 23:49:32,540][106225] Updated weights for policy 1, policy_version 639635 (0.0008) [2023-12-27 23:49:32,559][106226] Updated weights for policy 0, policy_version 637698 (0.0008) [2023-12-27 23:49:32,605][106225] Updated weights for policy 1, policy_version 639645 (0.0007) [2023-12-27 23:49:32,617][106226] Updated weights for policy 0, policy_version 637708 (0.0010) [2023-12-27 23:49:32,658][106225] Updated weights for policy 1, policy_version 639655 (0.0009) [2023-12-27 23:49:33,239][106226] Updated weights for policy 0, policy_version 637718 (0.0008) [2023-12-27 23:49:33,298][106226] Updated weights for policy 0, policy_version 637728 (0.0006) [2023-12-27 23:49:33,354][106225] Updated weights for policy 1, policy_version 639665 (0.0010) [2023-12-27 23:49:33,356][106226] Updated weights for policy 0, policy_version 637738 (0.0005) [2023-12-27 23:49:33,401][106225] Updated weights for policy 1, policy_version 639675 (0.0010) [2023-12-27 23:49:33,454][106225] Updated weights for policy 1, policy_version 639685 (0.0009) [2023-12-27 23:49:33,883][106226] Updated weights for policy 0, policy_version 637748 (0.0007) [2023-12-27 23:49:33,932][106226] Updated weights for policy 0, policy_version 637758 (0.0008) [2023-12-27 23:49:33,984][106226] Updated weights for policy 0, policy_version 637768 (0.0009) [2023-12-27 23:49:34,034][106225] Updated weights for policy 1, policy_version 639695 (0.0005) [2023-12-27 23:49:34,087][106225] Updated weights for policy 1, policy_version 639705 (0.0006) [2023-12-27 23:49:34,139][106225] Updated weights for policy 1, policy_version 639715 (0.0006) [2023-12-27 23:49:34,714][106226] Updated weights for policy 0, policy_version 637778 (0.0007) [2023-12-27 23:49:34,779][106226] Updated weights for policy 0, policy_version 637788 (0.0008) [2023-12-27 23:49:34,830][106225] Updated weights for policy 1, policy_version 639725 (0.0010) [2023-12-27 23:49:34,835][106226] Updated weights for policy 0, policy_version 637798 (0.0007) [2023-12-27 23:49:34,881][106225] Updated weights for policy 1, policy_version 639735 (0.0010) [2023-12-27 23:49:34,895][106226] Updated weights for policy 0, policy_version 637808 (0.0006) [2023-12-27 23:49:34,946][106225] Updated weights for policy 1, policy_version 639745 (0.0005) [2023-12-27 23:49:35,512][106226] Updated weights for policy 0, policy_version 637818 (0.0008) [2023-12-27 23:49:35,565][106226] Updated weights for policy 0, policy_version 637828 (0.0010) [2023-12-27 23:49:35,565][106225] Updated weights for policy 1, policy_version 639755 (0.0007) [2023-12-27 23:49:35,615][106225] Updated weights for policy 1, policy_version 639765 (0.0010) [2023-12-27 23:49:35,618][106226] Updated weights for policy 0, policy_version 637838 (0.0010) [2023-12-27 23:49:35,663][106225] Updated weights for policy 1, policy_version 639775 (0.0009) [2023-12-27 23:49:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 327139328. Throughput: 0: 9783.5, 1: 10013.0. Samples: 327150156. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:36,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-5.771')] [2023-12-27 23:49:36,275][106226] Updated weights for policy 0, policy_version 637848 (0.0007) [2023-12-27 23:49:36,345][106226] Updated weights for policy 0, policy_version 637858 (0.0007) [2023-12-27 23:49:36,383][106225] Updated weights for policy 1, policy_version 639785 (0.0006) [2023-12-27 23:49:36,400][106226] Updated weights for policy 0, policy_version 637868 (0.0008) [2023-12-27 23:49:36,437][106225] Updated weights for policy 1, policy_version 639795 (0.0010) [2023-12-27 23:49:36,495][106225] Updated weights for policy 1, policy_version 639805 (0.0010) [2023-12-27 23:49:36,568][106225] Updated weights for policy 1, policy_version 639815 (0.0011) [2023-12-27 23:49:37,019][106226] Updated weights for policy 0, policy_version 637878 (0.0008) [2023-12-27 23:49:37,071][106226] Updated weights for policy 0, policy_version 637888 (0.0008) [2023-12-27 23:49:37,121][106226] Updated weights for policy 0, policy_version 637898 (0.0007) [2023-12-27 23:49:37,292][106225] Updated weights for policy 1, policy_version 639825 (0.0010) [2023-12-27 23:49:37,350][106225] Updated weights for policy 1, policy_version 639835 (0.0010) [2023-12-27 23:49:37,408][106225] Updated weights for policy 1, policy_version 639845 (0.0010) [2023-12-27 23:49:37,829][106226] Updated weights for policy 0, policy_version 637908 (0.0007) [2023-12-27 23:49:37,885][106226] Updated weights for policy 0, policy_version 637918 (0.0005) [2023-12-27 23:49:37,940][106226] Updated weights for policy 0, policy_version 637928 (0.0005) [2023-12-27 23:49:38,152][106225] Updated weights for policy 1, policy_version 639855 (0.0010) [2023-12-27 23:49:38,210][106225] Updated weights for policy 1, policy_version 639865 (0.0010) [2023-12-27 23:49:38,262][106225] Updated weights for policy 1, policy_version 639875 (0.0011) [2023-12-27 23:49:38,610][106226] Updated weights for policy 0, policy_version 637938 (0.0007) [2023-12-27 23:49:38,677][106226] Updated weights for policy 0, policy_version 637948 (0.0008) [2023-12-27 23:49:38,744][106226] Updated weights for policy 0, policy_version 637958 (0.0008) [2023-12-27 23:49:38,806][106226] Updated weights for policy 0, policy_version 637968 (0.0008) [2023-12-27 23:49:39,039][106225] Updated weights for policy 1, policy_version 639885 (0.0011) [2023-12-27 23:49:39,096][106225] Updated weights for policy 1, policy_version 639895 (0.0010) [2023-12-27 23:49:39,156][106225] Updated weights for policy 1, policy_version 639905 (0.0010) [2023-12-27 23:49:39,571][106226] Updated weights for policy 0, policy_version 637978 (0.0009) [2023-12-27 23:49:39,630][106226] Updated weights for policy 0, policy_version 637988 (0.0009) [2023-12-27 23:49:39,688][106226] Updated weights for policy 0, policy_version 637998 (0.0009) [2023-12-27 23:49:39,912][106225] Updated weights for policy 1, policy_version 639915 (0.0010) [2023-12-27 23:49:39,986][106225] Updated weights for policy 1, policy_version 639925 (0.0009) [2023-12-27 23:49:40,048][106225] Updated weights for policy 1, policy_version 639935 (0.0010) [2023-12-27 23:49:40,457][106226] Updated weights for policy 0, policy_version 638008 (0.0008) [2023-12-27 23:49:40,514][106226] Updated weights for policy 0, policy_version 638018 (0.0005) [2023-12-27 23:49:40,570][106226] Updated weights for policy 0, policy_version 638028 (0.0005) [2023-12-27 23:49:40,719][106225] Updated weights for policy 1, policy_version 639945 (0.0008) [2023-12-27 23:49:40,780][106225] Updated weights for policy 1, policy_version 639955 (0.0008) [2023-12-27 23:49:40,842][106225] Updated weights for policy 1, policy_version 639965 (0.0009) [2023-12-27 23:49:40,902][106225] Updated weights for policy 1, policy_version 639975 (0.0008) [2023-12-27 23:49:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 327237632. Throughput: 0: 9793.6, 1: 10030.1. Samples: 327209460. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:41,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-5.741')] [2023-12-27 23:49:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000639976_163864576.pth... [2023-12-27 23:49:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000638032_163373056.pth... [2023-12-27 23:49:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000638824_163569664.pth [2023-12-27 23:49:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000636912_163086336.pth [2023-12-27 23:49:41,256][106226] Updated weights for policy 0, policy_version 638038 (0.0009) [2023-12-27 23:49:41,321][106226] Updated weights for policy 0, policy_version 638048 (0.0009) [2023-12-27 23:49:41,395][106226] Updated weights for policy 0, policy_version 638058 (0.0014) [2023-12-27 23:49:41,682][106225] Updated weights for policy 1, policy_version 639985 (0.0007) [2023-12-27 23:49:41,747][106225] Updated weights for policy 1, policy_version 639995 (0.0009) [2023-12-27 23:49:41,815][106225] Updated weights for policy 1, policy_version 640005 (0.0009) [2023-12-27 23:49:42,096][106226] Updated weights for policy 0, policy_version 638068 (0.0010) [2023-12-27 23:49:42,160][106226] Updated weights for policy 0, policy_version 638078 (0.0011) [2023-12-27 23:49:42,217][106226] Updated weights for policy 0, policy_version 638088 (0.0010) [2023-12-27 23:49:42,532][106225] Updated weights for policy 1, policy_version 640015 (0.0006) [2023-12-27 23:49:42,597][106225] Updated weights for policy 1, policy_version 640025 (0.0005) [2023-12-27 23:49:42,662][106225] Updated weights for policy 1, policy_version 640035 (0.0005) [2023-12-27 23:49:42,910][106226] Updated weights for policy 0, policy_version 638098 (0.0009) [2023-12-27 23:49:42,960][106226] Updated weights for policy 0, policy_version 638108 (0.0009) [2023-12-27 23:49:43,022][106226] Updated weights for policy 0, policy_version 638118 (0.0008) [2023-12-27 23:49:43,086][106226] Updated weights for policy 0, policy_version 638128 (0.0010) [2023-12-27 23:49:43,189][106225] Updated weights for policy 1, policy_version 640045 (0.0006) [2023-12-27 23:49:43,238][106225] Updated weights for policy 1, policy_version 640055 (0.0005) [2023-12-27 23:49:43,293][106225] Updated weights for policy 1, policy_version 640065 (0.0005) [2023-12-27 23:49:43,870][106225] Updated weights for policy 1, policy_version 640075 (0.0005) [2023-12-27 23:49:43,885][106226] Updated weights for policy 0, policy_version 638138 (0.0008) [2023-12-27 23:49:43,932][106225] Updated weights for policy 1, policy_version 640085 (0.0006) [2023-12-27 23:49:43,940][106226] Updated weights for policy 0, policy_version 638148 (0.0007) [2023-12-27 23:49:43,981][106225] Updated weights for policy 1, policy_version 640095 (0.0008) [2023-12-27 23:49:44,002][106226] Updated weights for policy 0, policy_version 638158 (0.0007) [2023-12-27 23:49:44,659][106226] Updated weights for policy 0, policy_version 638168 (0.0010) [2023-12-27 23:49:44,709][106225] Updated weights for policy 1, policy_version 640105 (0.0008) [2023-12-27 23:49:44,718][106226] Updated weights for policy 0, policy_version 638178 (0.0008) [2023-12-27 23:49:44,771][106225] Updated weights for policy 1, policy_version 640115 (0.0008) [2023-12-27 23:49:44,797][106226] Updated weights for policy 0, policy_version 638188 (0.0007) [2023-12-27 23:49:44,840][106225] Updated weights for policy 1, policy_version 640125 (0.0008) [2023-12-27 23:49:44,907][106225] Updated weights for policy 1, policy_version 640135 (0.0008) [2023-12-27 23:49:45,447][106226] Updated weights for policy 0, policy_version 638198 (0.0006) [2023-12-27 23:49:45,499][106226] Updated weights for policy 0, policy_version 638208 (0.0006) [2023-12-27 23:49:45,554][106226] Updated weights for policy 0, policy_version 638218 (0.0005) [2023-12-27 23:49:45,645][106225] Updated weights for policy 1, policy_version 640145 (0.0009) [2023-12-27 23:49:45,696][106225] Updated weights for policy 1, policy_version 640155 (0.0008) [2023-12-27 23:49:45,758][106225] Updated weights for policy 1, policy_version 640165 (0.0006) [2023-12-27 23:49:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 327335936. Throughput: 0: 9854.5, 1: 9991.0. Samples: 327327088. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:46,175][105115] Avg episode reward: [(0, '-4.260'), (1, '-5.764')] [2023-12-27 23:49:46,185][106226] Updated weights for policy 0, policy_version 638228 (0.0009) [2023-12-27 23:49:46,245][106226] Updated weights for policy 0, policy_version 638238 (0.0011) [2023-12-27 23:49:46,301][106226] Updated weights for policy 0, policy_version 638248 (0.0010) [2023-12-27 23:49:46,465][106225] Updated weights for policy 1, policy_version 640175 (0.0007) [2023-12-27 23:49:46,527][106225] Updated weights for policy 1, policy_version 640185 (0.0008) [2023-12-27 23:49:46,570][106225] Updated weights for policy 1, policy_version 640195 (0.0007) [2023-12-27 23:49:47,008][106226] Updated weights for policy 0, policy_version 638258 (0.0010) [2023-12-27 23:49:47,067][106226] Updated weights for policy 0, policy_version 638268 (0.0011) [2023-12-27 23:49:47,113][106226] Updated weights for policy 0, policy_version 638278 (0.0010) [2023-12-27 23:49:47,165][106226] Updated weights for policy 0, policy_version 638288 (0.0010) [2023-12-27 23:49:47,314][106225] Updated weights for policy 1, policy_version 640205 (0.0007) [2023-12-27 23:49:47,373][106225] Updated weights for policy 1, policy_version 640215 (0.0008) [2023-12-27 23:49:47,424][106225] Updated weights for policy 1, policy_version 640225 (0.0007) [2023-12-27 23:49:47,913][106226] Updated weights for policy 0, policy_version 638298 (0.0010) [2023-12-27 23:49:47,972][106226] Updated weights for policy 0, policy_version 638308 (0.0010) [2023-12-27 23:49:48,029][106226] Updated weights for policy 0, policy_version 638318 (0.0010) [2023-12-27 23:49:48,143][106225] Updated weights for policy 1, policy_version 640235 (0.0007) [2023-12-27 23:49:48,201][106225] Updated weights for policy 1, policy_version 640245 (0.0008) [2023-12-27 23:49:48,257][106225] Updated weights for policy 1, policy_version 640255 (0.0007) [2023-12-27 23:49:48,735][106226] Updated weights for policy 0, policy_version 638328 (0.0009) [2023-12-27 23:49:48,796][106226] Updated weights for policy 0, policy_version 638338 (0.0007) [2023-12-27 23:49:48,856][106226] Updated weights for policy 0, policy_version 638348 (0.0009) [2023-12-27 23:49:49,022][106225] Updated weights for policy 1, policy_version 640265 (0.0008) [2023-12-27 23:49:49,083][106225] Updated weights for policy 1, policy_version 640275 (0.0008) [2023-12-27 23:49:49,141][106225] Updated weights for policy 1, policy_version 640285 (0.0009) [2023-12-27 23:49:49,227][106225] Updated weights for policy 1, policy_version 640295 (0.0008) [2023-12-27 23:49:49,619][106226] Updated weights for policy 0, policy_version 638358 (0.0008) [2023-12-27 23:49:49,683][106226] Updated weights for policy 0, policy_version 638368 (0.0008) [2023-12-27 23:49:49,750][106226] Updated weights for policy 0, policy_version 638378 (0.0008) [2023-12-27 23:49:49,974][106225] Updated weights for policy 1, policy_version 640305 (0.0008) [2023-12-27 23:49:50,041][106225] Updated weights for policy 1, policy_version 640315 (0.0008) [2023-12-27 23:49:50,110][106225] Updated weights for policy 1, policy_version 640325 (0.0008) [2023-12-27 23:49:50,454][106226] Updated weights for policy 0, policy_version 638388 (0.0010) [2023-12-27 23:49:50,524][106226] Updated weights for policy 0, policy_version 638398 (0.0006) [2023-12-27 23:49:50,585][106226] Updated weights for policy 0, policy_version 638408 (0.0007) [2023-12-27 23:49:50,802][106225] Updated weights for policy 1, policy_version 640335 (0.0005) [2023-12-27 23:49:50,869][106225] Updated weights for policy 1, policy_version 640345 (0.0006) [2023-12-27 23:49:50,944][106225] Updated weights for policy 1, policy_version 640355 (0.0006) [2023-12-27 23:49:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 327434240. Throughput: 0: 9770.8, 1: 9927.4. Samples: 327444476. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:51,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-5.989')] [2023-12-27 23:49:51,183][106226] Updated weights for policy 0, policy_version 638418 (0.0008) [2023-12-27 23:49:51,259][106226] Updated weights for policy 0, policy_version 638428 (0.0009) [2023-12-27 23:49:51,332][106226] Updated weights for policy 0, policy_version 638438 (0.0008) [2023-12-27 23:49:51,402][106226] Updated weights for policy 0, policy_version 638448 (0.0007) [2023-12-27 23:49:51,577][106225] Updated weights for policy 1, policy_version 640365 (0.0007) [2023-12-27 23:49:51,638][106225] Updated weights for policy 1, policy_version 640375 (0.0008) [2023-12-27 23:49:51,696][106225] Updated weights for policy 1, policy_version 640385 (0.0007) [2023-12-27 23:49:52,151][106226] Updated weights for policy 0, policy_version 638458 (0.0010) [2023-12-27 23:49:52,211][106226] Updated weights for policy 0, policy_version 638468 (0.0010) [2023-12-27 23:49:52,272][106225] Updated weights for policy 1, policy_version 640395 (0.0008) [2023-12-27 23:49:52,274][106226] Updated weights for policy 0, policy_version 638478 (0.0011) [2023-12-27 23:49:52,326][106225] Updated weights for policy 1, policy_version 640405 (0.0008) [2023-12-27 23:49:52,395][106225] Updated weights for policy 1, policy_version 640415 (0.0008) [2023-12-27 23:49:53,058][106226] Updated weights for policy 0, policy_version 638488 (0.0009) [2023-12-27 23:49:53,066][106225] Updated weights for policy 1, policy_version 640425 (0.0008) [2023-12-27 23:49:53,114][106226] Updated weights for policy 0, policy_version 638498 (0.0009) [2023-12-27 23:49:53,129][106225] Updated weights for policy 1, policy_version 640435 (0.0006) [2023-12-27 23:49:53,174][106225] Updated weights for policy 1, policy_version 640445 (0.0008) [2023-12-27 23:49:53,176][106226] Updated weights for policy 0, policy_version 638508 (0.0007) [2023-12-27 23:49:53,222][106225] Updated weights for policy 1, policy_version 640455 (0.0006) [2023-12-27 23:49:53,883][106225] Updated weights for policy 1, policy_version 640465 (0.0010) [2023-12-27 23:49:53,919][106226] Updated weights for policy 0, policy_version 638518 (0.0007) [2023-12-27 23:49:53,944][106225] Updated weights for policy 1, policy_version 640475 (0.0008) [2023-12-27 23:49:53,967][106226] Updated weights for policy 0, policy_version 638528 (0.0005) [2023-12-27 23:49:54,000][106225] Updated weights for policy 1, policy_version 640485 (0.0006) [2023-12-27 23:49:54,020][106226] Updated weights for policy 0, policy_version 638538 (0.0008) [2023-12-27 23:49:54,651][106225] Updated weights for policy 1, policy_version 640495 (0.0006) [2023-12-27 23:49:54,708][106225] Updated weights for policy 1, policy_version 640505 (0.0008) [2023-12-27 23:49:54,769][106225] Updated weights for policy 1, policy_version 640515 (0.0005) [2023-12-27 23:49:54,805][106226] Updated weights for policy 0, policy_version 638548 (0.0008) [2023-12-27 23:49:54,866][106226] Updated weights for policy 0, policy_version 638558 (0.0008) [2023-12-27 23:49:54,923][106226] Updated weights for policy 0, policy_version 638568 (0.0008) [2023-12-27 23:49:55,390][106225] Updated weights for policy 1, policy_version 640525 (0.0006) [2023-12-27 23:49:55,451][106225] Updated weights for policy 1, policy_version 640535 (0.0006) [2023-12-27 23:49:55,518][106225] Updated weights for policy 1, policy_version 640545 (0.0005) [2023-12-27 23:49:55,735][106226] Updated weights for policy 0, policy_version 638578 (0.0009) [2023-12-27 23:49:55,788][106226] Updated weights for policy 0, policy_version 638588 (0.0008) [2023-12-27 23:49:55,840][106226] Updated weights for policy 0, policy_version 638598 (0.0008) [2023-12-27 23:49:55,891][106226] Updated weights for policy 0, policy_version 638608 (0.0008) [2023-12-27 23:49:56,058][106225] Updated weights for policy 1, policy_version 640555 (0.0006) [2023-12-27 23:49:56,119][106225] Updated weights for policy 1, policy_version 640565 (0.0008) [2023-12-27 23:49:56,172][106225] Updated weights for policy 1, policy_version 640575 (0.0008) [2023-12-27 23:49:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 327532544. Throughput: 0: 9715.7, 1: 9958.9. Samples: 327502564. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:49:56,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.643')] [2023-12-27 23:49:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000638608_163520512.pth... [2023-12-27 23:49:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000637456_163225600.pth [2023-12-27 23:49:56,220][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000640584_164020224.pth... [2023-12-27 23:49:56,223][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000639400_163717120.pth [2023-12-27 23:49:56,622][106226] Updated weights for policy 0, policy_version 638618 (0.0008) [2023-12-27 23:49:56,674][106226] Updated weights for policy 0, policy_version 638628 (0.0009) [2023-12-27 23:49:56,733][106226] Updated weights for policy 0, policy_version 638638 (0.0008) [2023-12-27 23:49:56,904][106225] Updated weights for policy 1, policy_version 640585 (0.0009) [2023-12-27 23:49:56,960][106225] Updated weights for policy 1, policy_version 640595 (0.0010) [2023-12-27 23:49:57,013][106225] Updated weights for policy 1, policy_version 640605 (0.0010) [2023-12-27 23:49:57,072][106225] Updated weights for policy 1, policy_version 640615 (0.0010) [2023-12-27 23:49:57,414][106226] Updated weights for policy 0, policy_version 638648 (0.0009) [2023-12-27 23:49:57,462][106226] Updated weights for policy 0, policy_version 638658 (0.0009) [2023-12-27 23:49:57,512][106226] Updated weights for policy 0, policy_version 638669 (0.0009) [2023-12-27 23:49:57,696][106225] Updated weights for policy 1, policy_version 640625 (0.0006) [2023-12-27 23:49:57,749][106225] Updated weights for policy 1, policy_version 640635 (0.0005) [2023-12-27 23:49:57,801][106225] Updated weights for policy 1, policy_version 640645 (0.0005) [2023-12-27 23:49:58,275][106226] Updated weights for policy 0, policy_version 638679 (0.0008) [2023-12-27 23:49:58,351][106226] Updated weights for policy 0, policy_version 638689 (0.0008) [2023-12-27 23:49:58,371][106225] Updated weights for policy 1, policy_version 640655 (0.0008) [2023-12-27 23:49:58,418][106226] Updated weights for policy 0, policy_version 638699 (0.0008) [2023-12-27 23:49:58,437][106225] Updated weights for policy 1, policy_version 640665 (0.0009) [2023-12-27 23:49:58,496][106225] Updated weights for policy 1, policy_version 640675 (0.0008) [2023-12-27 23:49:59,214][106226] Updated weights for policy 0, policy_version 638709 (0.0008) [2023-12-27 23:49:59,289][106226] Updated weights for policy 0, policy_version 638719 (0.0008) [2023-12-27 23:49:59,291][106225] Updated weights for policy 1, policy_version 640685 (0.0007) [2023-12-27 23:49:59,355][106226] Updated weights for policy 0, policy_version 638729 (0.0008) [2023-12-27 23:49:59,374][106225] Updated weights for policy 1, policy_version 640695 (0.0008) [2023-12-27 23:49:59,433][106225] Updated weights for policy 1, policy_version 640705 (0.0008) [2023-12-27 23:50:00,006][106226] Updated weights for policy 0, policy_version 638739 (0.0009) [2023-12-27 23:50:00,056][106226] Updated weights for policy 0, policy_version 638749 (0.0008) [2023-12-27 23:50:00,111][106226] Updated weights for policy 0, policy_version 638759 (0.0006) [2023-12-27 23:50:00,251][106225] Updated weights for policy 1, policy_version 640715 (0.0009) [2023-12-27 23:50:00,297][106225] Updated weights for policy 1, policy_version 640725 (0.0008) [2023-12-27 23:50:00,351][106225] Updated weights for policy 1, policy_version 640735 (0.0008) [2023-12-27 23:50:00,828][106226] Updated weights for policy 0, policy_version 638769 (0.0007) [2023-12-27 23:50:00,876][106226] Updated weights for policy 0, policy_version 638779 (0.0008) [2023-12-27 23:50:00,929][106226] Updated weights for policy 0, policy_version 638789 (0.0008) [2023-12-27 23:50:00,991][106226] Updated weights for policy 0, policy_version 638799 (0.0006) [2023-12-27 23:50:01,082][106225] Updated weights for policy 1, policy_version 640745 (0.0008) [2023-12-27 23:50:01,150][106225] Updated weights for policy 1, policy_version 640755 (0.0007) [2023-12-27 23:50:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 327630848. Throughput: 0: 9716.3, 1: 9986.4. Samples: 327621836. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-27 23:50:01,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-6.055')] [2023-12-27 23:50:01,210][106225] Updated weights for policy 1, policy_version 640765 (0.0008) [2023-12-27 23:50:01,271][106225] Updated weights for policy 1, policy_version 640775 (0.0008) [2023-12-27 23:50:01,657][106226] Updated weights for policy 0, policy_version 638809 (0.0008) [2023-12-27 23:50:01,728][106226] Updated weights for policy 0, policy_version 638819 (0.0008) [2023-12-27 23:50:01,783][106226] Updated weights for policy 0, policy_version 638829 (0.0009) [2023-12-27 23:50:02,002][106225] Updated weights for policy 1, policy_version 640785 (0.0009) [2023-12-27 23:50:02,065][106225] Updated weights for policy 1, policy_version 640795 (0.0008) [2023-12-27 23:50:02,124][106225] Updated weights for policy 1, policy_version 640805 (0.0008) [2023-12-27 23:50:02,528][106226] Updated weights for policy 0, policy_version 638839 (0.0007) [2023-12-27 23:50:02,585][106226] Updated weights for policy 0, policy_version 638849 (0.0007) [2023-12-27 23:50:02,651][106226] Updated weights for policy 0, policy_version 638859 (0.0009) [2023-12-27 23:50:02,804][106225] Updated weights for policy 1, policy_version 640815 (0.0006) [2023-12-27 23:50:02,858][106225] Updated weights for policy 1, policy_version 640825 (0.0005) [2023-12-27 23:50:02,911][106225] Updated weights for policy 1, policy_version 640835 (0.0005) [2023-12-27 23:50:03,317][106226] Updated weights for policy 0, policy_version 638869 (0.0010) [2023-12-27 23:50:03,368][106226] Updated weights for policy 0, policy_version 638879 (0.0008) [2023-12-27 23:50:03,420][106226] Updated weights for policy 0, policy_version 638889 (0.0010) [2023-12-27 23:50:03,530][106225] Updated weights for policy 1, policy_version 640845 (0.0005) [2023-12-27 23:50:03,579][106225] Updated weights for policy 1, policy_version 640855 (0.0008) [2023-12-27 23:50:03,628][106225] Updated weights for policy 1, policy_version 640865 (0.0006) [2023-12-27 23:50:04,104][106226] Updated weights for policy 0, policy_version 638899 (0.0009) [2023-12-27 23:50:04,169][106226] Updated weights for policy 0, policy_version 638909 (0.0009) [2023-12-27 23:50:04,230][106226] Updated weights for policy 0, policy_version 638919 (0.0009) [2023-12-27 23:50:04,325][106225] Updated weights for policy 1, policy_version 640875 (0.0005) [2023-12-27 23:50:04,392][106225] Updated weights for policy 1, policy_version 640885 (0.0006) [2023-12-27 23:50:04,460][106225] Updated weights for policy 1, policy_version 640895 (0.0006) [2023-12-27 23:50:04,876][106226] Updated weights for policy 0, policy_version 638929 (0.0008) [2023-12-27 23:50:04,943][106226] Updated weights for policy 0, policy_version 638939 (0.0005) [2023-12-27 23:50:05,012][106226] Updated weights for policy 0, policy_version 638949 (0.0007) [2023-12-27 23:50:05,074][106226] Updated weights for policy 0, policy_version 638959 (0.0008) [2023-12-27 23:50:05,105][106225] Updated weights for policy 1, policy_version 640905 (0.0010) [2023-12-27 23:50:05,160][106225] Updated weights for policy 1, policy_version 640915 (0.0006) [2023-12-27 23:50:05,215][106225] Updated weights for policy 1, policy_version 640925 (0.0006) [2023-12-27 23:50:05,271][106225] Updated weights for policy 1, policy_version 640935 (0.0008) [2023-12-27 23:50:05,756][106226] Updated weights for policy 0, policy_version 638969 (0.0009) [2023-12-27 23:50:05,822][106226] Updated weights for policy 0, policy_version 638979 (0.0008) [2023-12-27 23:50:05,873][106226] Updated weights for policy 0, policy_version 638989 (0.0010) [2023-12-27 23:50:05,970][106225] Updated weights for policy 1, policy_version 640945 (0.0007) [2023-12-27 23:50:06,020][106225] Updated weights for policy 1, policy_version 640955 (0.0007) [2023-12-27 23:50:06,078][106225] Updated weights for policy 1, policy_version 640965 (0.0008) [2023-12-27 23:50:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 327737344. Throughput: 0: 9785.1, 1: 10005.6. Samples: 327741780. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:06,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.589')] [2023-12-27 23:50:06,585][106226] Updated weights for policy 0, policy_version 638999 (0.0009) [2023-12-27 23:50:06,646][106226] Updated weights for policy 0, policy_version 639009 (0.0011) [2023-12-27 23:50:06,709][106226] Updated weights for policy 0, policy_version 639019 (0.0011) [2023-12-27 23:50:06,832][106225] Updated weights for policy 1, policy_version 640975 (0.0008) [2023-12-27 23:50:06,878][106225] Updated weights for policy 1, policy_version 640985 (0.0008) [2023-12-27 23:50:06,932][106225] Updated weights for policy 1, policy_version 640995 (0.0008) [2023-12-27 23:50:07,416][106226] Updated weights for policy 0, policy_version 639029 (0.0011) [2023-12-27 23:50:07,462][106226] Updated weights for policy 0, policy_version 639039 (0.0010) [2023-12-27 23:50:07,515][106226] Updated weights for policy 0, policy_version 639049 (0.0010) [2023-12-27 23:50:07,682][106225] Updated weights for policy 1, policy_version 641005 (0.0008) [2023-12-27 23:50:07,740][106225] Updated weights for policy 1, policy_version 641015 (0.0007) [2023-12-27 23:50:07,801][106225] Updated weights for policy 1, policy_version 641025 (0.0008) [2023-12-27 23:50:08,250][106226] Updated weights for policy 0, policy_version 639059 (0.0010) [2023-12-27 23:50:08,303][106226] Updated weights for policy 0, policy_version 639069 (0.0010) [2023-12-27 23:50:08,371][106226] Updated weights for policy 0, policy_version 639079 (0.0011) [2023-12-27 23:50:08,554][106225] Updated weights for policy 1, policy_version 641035 (0.0008) [2023-12-27 23:50:08,615][106225] Updated weights for policy 1, policy_version 641045 (0.0008) [2023-12-27 23:50:08,673][106225] Updated weights for policy 1, policy_version 641055 (0.0008) [2023-12-27 23:50:09,105][106226] Updated weights for policy 0, policy_version 639089 (0.0011) [2023-12-27 23:50:09,168][106226] Updated weights for policy 0, policy_version 639099 (0.0009) [2023-12-27 23:50:09,238][106226] Updated weights for policy 0, policy_version 639109 (0.0009) [2023-12-27 23:50:09,297][106226] Updated weights for policy 0, policy_version 639119 (0.0008) [2023-12-27 23:50:09,466][106225] Updated weights for policy 1, policy_version 641065 (0.0009) [2023-12-27 23:50:09,534][106225] Updated weights for policy 1, policy_version 641075 (0.0008) [2023-12-27 23:50:09,607][106225] Updated weights for policy 1, policy_version 641085 (0.0008) [2023-12-27 23:50:09,675][106225] Updated weights for policy 1, policy_version 641095 (0.0008) [2023-12-27 23:50:10,156][106226] Updated weights for policy 0, policy_version 639129 (0.0009) [2023-12-27 23:50:10,223][106226] Updated weights for policy 0, policy_version 639139 (0.0009) [2023-12-27 23:50:10,286][106226] Updated weights for policy 0, policy_version 639149 (0.0008) [2023-12-27 23:50:10,383][106225] Updated weights for policy 1, policy_version 641105 (0.0008) [2023-12-27 23:50:10,435][106225] Updated weights for policy 1, policy_version 641115 (0.0008) [2023-12-27 23:50:10,491][106225] Updated weights for policy 1, policy_version 641125 (0.0006) [2023-12-27 23:50:10,887][106226] Updated weights for policy 0, policy_version 639159 (0.0007) [2023-12-27 23:50:10,947][106226] Updated weights for policy 0, policy_version 639169 (0.0005) [2023-12-27 23:50:10,999][106226] Updated weights for policy 0, policy_version 639179 (0.0005) [2023-12-27 23:50:11,118][106225] Updated weights for policy 1, policy_version 641135 (0.0008) [2023-12-27 23:50:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 327827456. Throughput: 0: 9754.4, 1: 10024.1. Samples: 327798892. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:11,176][105115] Avg episode reward: [(0, '-4.623'), (1, '-5.963')] [2023-12-27 23:50:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000639184_163667968.pth... [2023-12-27 23:50:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000638032_163373056.pth [2023-12-27 23:50:11,188][106225] Updated weights for policy 1, policy_version 641145 (0.0010) [2023-12-27 23:50:11,256][106225] Updated weights for policy 1, policy_version 641155 (0.0011) [2023-12-27 23:50:11,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000641160_164167680.pth... [2023-12-27 23:50:11,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000639976_163864576.pth [2023-12-27 23:50:11,765][106226] Updated weights for policy 0, policy_version 639189 (0.0008) [2023-12-27 23:50:11,826][106226] Updated weights for policy 0, policy_version 639199 (0.0007) [2023-12-27 23:50:11,893][106226] Updated weights for policy 0, policy_version 639209 (0.0008) [2023-12-27 23:50:12,098][106225] Updated weights for policy 1, policy_version 641165 (0.0010) [2023-12-27 23:50:12,153][106225] Updated weights for policy 1, policy_version 641175 (0.0010) [2023-12-27 23:50:12,211][106225] Updated weights for policy 1, policy_version 641185 (0.0010) [2023-12-27 23:50:12,578][106226] Updated weights for policy 0, policy_version 639219 (0.0006) [2023-12-27 23:50:12,650][106226] Updated weights for policy 0, policy_version 639229 (0.0007) [2023-12-27 23:50:12,715][106226] Updated weights for policy 0, policy_version 639239 (0.0007) [2023-12-27 23:50:12,917][106225] Updated weights for policy 1, policy_version 641195 (0.0010) [2023-12-27 23:50:12,970][106225] Updated weights for policy 1, policy_version 641205 (0.0010) [2023-12-27 23:50:13,020][106225] Updated weights for policy 1, policy_version 641215 (0.0010) [2023-12-27 23:50:13,265][106226] Updated weights for policy 0, policy_version 639249 (0.0008) [2023-12-27 23:50:13,332][106226] Updated weights for policy 0, policy_version 639259 (0.0006) [2023-12-27 23:50:13,389][106226] Updated weights for policy 0, policy_version 639269 (0.0006) [2023-12-27 23:50:13,447][106226] Updated weights for policy 0, policy_version 639279 (0.0007) [2023-12-27 23:50:13,721][106225] Updated weights for policy 1, policy_version 641225 (0.0010) [2023-12-27 23:50:13,778][106225] Updated weights for policy 1, policy_version 641235 (0.0010) [2023-12-27 23:50:13,834][106225] Updated weights for policy 1, policy_version 641245 (0.0010) [2023-12-27 23:50:13,894][106225] Updated weights for policy 1, policy_version 641255 (0.0007) [2023-12-27 23:50:14,058][106226] Updated weights for policy 0, policy_version 639289 (0.0008) [2023-12-27 23:50:14,118][106226] Updated weights for policy 0, policy_version 639299 (0.0008) [2023-12-27 23:50:14,182][106226] Updated weights for policy 0, policy_version 639309 (0.0006) [2023-12-27 23:50:14,521][106225] Updated weights for policy 1, policy_version 641265 (0.0005) [2023-12-27 23:50:14,591][106225] Updated weights for policy 1, policy_version 641275 (0.0006) [2023-12-27 23:50:14,649][106225] Updated weights for policy 1, policy_version 641285 (0.0006) [2023-12-27 23:50:14,726][106226] Updated weights for policy 0, policy_version 639319 (0.0006) [2023-12-27 23:50:14,795][106226] Updated weights for policy 0, policy_version 639329 (0.0008) [2023-12-27 23:50:14,865][106226] Updated weights for policy 0, policy_version 639339 (0.0008) [2023-12-27 23:50:15,330][106225] Updated weights for policy 1, policy_version 641295 (0.0007) [2023-12-27 23:50:15,401][106225] Updated weights for policy 1, policy_version 641305 (0.0008) [2023-12-27 23:50:15,461][106225] Updated weights for policy 1, policy_version 641315 (0.0008) [2023-12-27 23:50:15,558][106226] Updated weights for policy 0, policy_version 639349 (0.0007) [2023-12-27 23:50:15,606][106226] Updated weights for policy 0, policy_version 639359 (0.0005) [2023-12-27 23:50:15,662][106226] Updated weights for policy 0, policy_version 639369 (0.0006) [2023-12-27 23:50:16,105][106225] Updated weights for policy 1, policy_version 641325 (0.0007) [2023-12-27 23:50:16,160][106225] Updated weights for policy 1, policy_version 641335 (0.0006) [2023-12-27 23:50:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 327925760. Throughput: 0: 9871.7, 1: 9984.9. Samples: 327919660. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:16,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.622')] [2023-12-27 23:50:16,227][106225] Updated weights for policy 1, policy_version 641345 (0.0005) [2023-12-27 23:50:16,284][106226] Updated weights for policy 0, policy_version 639379 (0.0008) [2023-12-27 23:50:16,332][106226] Updated weights for policy 0, policy_version 639389 (0.0007) [2023-12-27 23:50:16,385][106226] Updated weights for policy 0, policy_version 639399 (0.0007) [2023-12-27 23:50:16,947][106225] Updated weights for policy 1, policy_version 641355 (0.0006) [2023-12-27 23:50:16,980][106226] Updated weights for policy 0, policy_version 639409 (0.0007) [2023-12-27 23:50:16,992][106225] Updated weights for policy 1, policy_version 641365 (0.0007) [2023-12-27 23:50:17,034][106226] Updated weights for policy 0, policy_version 639419 (0.0008) [2023-12-27 23:50:17,038][106225] Updated weights for policy 1, policy_version 641375 (0.0006) [2023-12-27 23:50:17,094][106226] Updated weights for policy 0, policy_version 639429 (0.0006) [2023-12-27 23:50:17,150][106226] Updated weights for policy 0, policy_version 639439 (0.0009) [2023-12-27 23:50:17,730][106225] Updated weights for policy 1, policy_version 641385 (0.0008) [2023-12-27 23:50:17,800][106225] Updated weights for policy 1, policy_version 641395 (0.0009) [2023-12-27 23:50:17,860][106225] Updated weights for policy 1, policy_version 641405 (0.0008) [2023-12-27 23:50:17,902][106226] Updated weights for policy 0, policy_version 639449 (0.0006) [2023-12-27 23:50:17,918][106225] Updated weights for policy 1, policy_version 641415 (0.0009) [2023-12-27 23:50:17,961][106226] Updated weights for policy 0, policy_version 639459 (0.0006) [2023-12-27 23:50:18,030][106226] Updated weights for policy 0, policy_version 639469 (0.0006) [2023-12-27 23:50:18,654][106225] Updated weights for policy 1, policy_version 641425 (0.0008) [2023-12-27 23:50:18,711][106225] Updated weights for policy 1, policy_version 641435 (0.0007) [2023-12-27 23:50:18,727][106226] Updated weights for policy 0, policy_version 639479 (0.0009) [2023-12-27 23:50:18,769][106225] Updated weights for policy 1, policy_version 641445 (0.0006) [2023-12-27 23:50:18,785][106226] Updated weights for policy 0, policy_version 639489 (0.0007) [2023-12-27 23:50:18,838][106226] Updated weights for policy 0, policy_version 639499 (0.0008) [2023-12-27 23:50:19,522][106225] Updated weights for policy 1, policy_version 641455 (0.0007) [2023-12-27 23:50:19,545][106226] Updated weights for policy 0, policy_version 639509 (0.0009) [2023-12-27 23:50:19,582][106225] Updated weights for policy 1, policy_version 641465 (0.0007) [2023-12-27 23:50:19,605][106226] Updated weights for policy 0, policy_version 639520 (0.0008) [2023-12-27 23:50:19,644][106225] Updated weights for policy 1, policy_version 641475 (0.0006) [2023-12-27 23:50:19,664][106226] Updated weights for policy 0, policy_version 639530 (0.0008) [2023-12-27 23:50:20,317][106226] Updated weights for policy 0, policy_version 639540 (0.0008) [2023-12-27 23:50:20,377][106226] Updated weights for policy 0, policy_version 639550 (0.0006) [2023-12-27 23:50:20,439][106226] Updated weights for policy 0, policy_version 639560 (0.0007) [2023-12-27 23:50:20,459][106225] Updated weights for policy 1, policy_version 641485 (0.0008) [2023-12-27 23:50:20,525][106225] Updated weights for policy 1, policy_version 641495 (0.0007) [2023-12-27 23:50:20,596][106225] Updated weights for policy 1, policy_version 641505 (0.0008) [2023-12-27 23:50:21,142][106226] Updated weights for policy 0, policy_version 639570 (0.0007) [2023-12-27 23:50:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 328024064. Throughput: 0: 9859.1, 1: 9868.0. Samples: 328037872. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:21,176][105115] Avg episode reward: [(0, '-4.609'), (1, '-5.843')] [2023-12-27 23:50:21,206][106226] Updated weights for policy 0, policy_version 639580 (0.0008) [2023-12-27 23:50:21,277][106226] Updated weights for policy 0, policy_version 639590 (0.0009) [2023-12-27 23:50:21,347][106226] Updated weights for policy 0, policy_version 639600 (0.0008) [2023-12-27 23:50:21,375][106225] Updated weights for policy 1, policy_version 641515 (0.0009) [2023-12-27 23:50:21,434][106225] Updated weights for policy 1, policy_version 641525 (0.0009) [2023-12-27 23:50:21,494][106225] Updated weights for policy 1, policy_version 641535 (0.0009) [2023-12-27 23:50:22,105][106226] Updated weights for policy 0, policy_version 639610 (0.0009) [2023-12-27 23:50:22,168][106226] Updated weights for policy 0, policy_version 639620 (0.0008) [2023-12-27 23:50:22,229][106226] Updated weights for policy 0, policy_version 639630 (0.0008) [2023-12-27 23:50:22,256][106225] Updated weights for policy 1, policy_version 641545 (0.0009) [2023-12-27 23:50:22,321][106225] Updated weights for policy 1, policy_version 641555 (0.0009) [2023-12-27 23:50:22,389][106225] Updated weights for policy 1, policy_version 641565 (0.0008) [2023-12-27 23:50:22,447][106225] Updated weights for policy 1, policy_version 641575 (0.0009) [2023-12-27 23:50:22,862][106226] Updated weights for policy 0, policy_version 639640 (0.0008) [2023-12-27 23:50:22,930][106226] Updated weights for policy 0, policy_version 639650 (0.0007) [2023-12-27 23:50:22,984][106226] Updated weights for policy 0, policy_version 639660 (0.0005) [2023-12-27 23:50:23,243][106225] Updated weights for policy 1, policy_version 641585 (0.0010) [2023-12-27 23:50:23,301][106225] Updated weights for policy 1, policy_version 641595 (0.0008) [2023-12-27 23:50:23,361][106225] Updated weights for policy 1, policy_version 641605 (0.0006) [2023-12-27 23:50:23,620][106226] Updated weights for policy 0, policy_version 639670 (0.0008) [2023-12-27 23:50:23,669][106226] Updated weights for policy 0, policy_version 639680 (0.0009) [2023-12-27 23:50:23,718][106226] Updated weights for policy 0, policy_version 639690 (0.0010) [2023-12-27 23:50:23,955][106225] Updated weights for policy 1, policy_version 641615 (0.0008) [2023-12-27 23:50:24,012][106225] Updated weights for policy 1, policy_version 641625 (0.0009) [2023-12-27 23:50:24,064][106225] Updated weights for policy 1, policy_version 641635 (0.0008) [2023-12-27 23:50:24,459][106226] Updated weights for policy 0, policy_version 639700 (0.0009) [2023-12-27 23:50:24,512][106226] Updated weights for policy 0, policy_version 639710 (0.0008) [2023-12-27 23:50:24,562][106226] Updated weights for policy 0, policy_version 639720 (0.0009) [2023-12-27 23:50:24,691][106225] Updated weights for policy 1, policy_version 641645 (0.0009) [2023-12-27 23:50:24,743][106225] Updated weights for policy 1, policy_version 641655 (0.0008) [2023-12-27 23:50:24,808][106225] Updated weights for policy 1, policy_version 641665 (0.0007) [2023-12-27 23:50:25,353][106226] Updated weights for policy 0, policy_version 639730 (0.0008) [2023-12-27 23:50:25,410][106226] Updated weights for policy 0, policy_version 639740 (0.0008) [2023-12-27 23:50:25,434][106225] Updated weights for policy 1, policy_version 641675 (0.0007) [2023-12-27 23:50:25,460][106226] Updated weights for policy 0, policy_version 639750 (0.0006) [2023-12-27 23:50:25,480][106225] Updated weights for policy 1, policy_version 641685 (0.0010) [2023-12-27 23:50:25,513][106226] Updated weights for policy 0, policy_version 639760 (0.0007) [2023-12-27 23:50:25,534][106225] Updated weights for policy 1, policy_version 641695 (0.0010) [2023-12-27 23:50:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 328122368. Throughput: 0: 9835.0, 1: 9860.9. Samples: 328095776. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:26,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-5.695')] [2023-12-27 23:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000639760_163815424.pth... [2023-12-27 23:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000638608_163520512.pth [2023-12-27 23:50:26,192][106225] Updated weights for policy 1, policy_version 641705 (0.0010) [2023-12-27 23:50:26,255][106225] Updated weights for policy 1, policy_version 641715 (0.0008) [2023-12-27 23:50:26,285][106226] Updated weights for policy 0, policy_version 639770 (0.0005) [2023-12-27 23:50:26,317][106225] Updated weights for policy 1, policy_version 641725 (0.0007) [2023-12-27 23:50:26,343][106226] Updated weights for policy 0, policy_version 639780 (0.0006) [2023-12-27 23:50:26,385][106225] Updated weights for policy 1, policy_version 641735 (0.0008) [2023-12-27 23:50:26,389][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000641736_164315136.pth... [2023-12-27 23:50:26,394][106226] Updated weights for policy 0, policy_version 639790 (0.0006) [2023-12-27 23:50:26,394][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000640584_164020224.pth [2023-12-27 23:50:26,997][106225] Updated weights for policy 1, policy_version 641745 (0.0010) [2023-12-27 23:50:27,051][106225] Updated weights for policy 1, policy_version 641755 (0.0010) [2023-12-27 23:50:27,115][106225] Updated weights for policy 1, policy_version 641765 (0.0010) [2023-12-27 23:50:27,116][106226] Updated weights for policy 0, policy_version 639800 (0.0007) [2023-12-27 23:50:27,173][106226] Updated weights for policy 0, policy_version 639810 (0.0007) [2023-12-27 23:50:27,235][106226] Updated weights for policy 0, policy_version 639820 (0.0007) [2023-12-27 23:50:27,825][106225] Updated weights for policy 1, policy_version 641775 (0.0010) [2023-12-27 23:50:27,889][106225] Updated weights for policy 1, policy_version 641785 (0.0010) [2023-12-27 23:50:27,906][106226] Updated weights for policy 0, policy_version 639830 (0.0005) [2023-12-27 23:50:27,948][106225] Updated weights for policy 1, policy_version 641795 (0.0010) [2023-12-27 23:50:27,958][106226] Updated weights for policy 0, policy_version 639840 (0.0008) [2023-12-27 23:50:28,005][106226] Updated weights for policy 0, policy_version 639850 (0.0006) [2023-12-27 23:50:28,720][106225] Updated weights for policy 1, policy_version 641805 (0.0010) [2023-12-27 23:50:28,740][106226] Updated weights for policy 0, policy_version 639860 (0.0009) [2023-12-27 23:50:28,770][106225] Updated weights for policy 1, policy_version 641815 (0.0010) [2023-12-27 23:50:28,803][106226] Updated weights for policy 0, policy_version 639870 (0.0010) [2023-12-27 23:50:28,820][106225] Updated weights for policy 1, policy_version 641825 (0.0010) [2023-12-27 23:50:28,859][106226] Updated weights for policy 0, policy_version 639880 (0.0006) [2023-12-27 23:50:29,475][106226] Updated weights for policy 0, policy_version 639890 (0.0006) [2023-12-27 23:50:29,529][106225] Updated weights for policy 1, policy_version 641835 (0.0010) [2023-12-27 23:50:29,540][106226] Updated weights for policy 0, policy_version 639900 (0.0008) [2023-12-27 23:50:29,589][106225] Updated weights for policy 1, policy_version 641845 (0.0008) [2023-12-27 23:50:29,598][106226] Updated weights for policy 0, policy_version 639910 (0.0008) [2023-12-27 23:50:29,651][106225] Updated weights for policy 1, policy_version 641855 (0.0005) [2023-12-27 23:50:29,662][106226] Updated weights for policy 0, policy_version 639920 (0.0005) [2023-12-27 23:50:30,285][106226] Updated weights for policy 0, policy_version 639930 (0.0008) [2023-12-27 23:50:30,320][106225] Updated weights for policy 1, policy_version 641865 (0.0006) [2023-12-27 23:50:30,338][106226] Updated weights for policy 0, policy_version 639940 (0.0007) [2023-12-27 23:50:30,385][106225] Updated weights for policy 1, policy_version 641875 (0.0010) [2023-12-27 23:50:30,400][106226] Updated weights for policy 0, policy_version 639950 (0.0009) [2023-12-27 23:50:30,444][106225] Updated weights for policy 1, policy_version 641885 (0.0007) [2023-12-27 23:50:30,503][106225] Updated weights for policy 1, policy_version 641895 (0.0007) [2023-12-27 23:50:31,071][106226] Updated weights for policy 0, policy_version 639960 (0.0007) [2023-12-27 23:50:31,142][106226] Updated weights for policy 0, policy_version 639970 (0.0008) [2023-12-27 23:50:31,152][106225] Updated weights for policy 1, policy_version 641905 (0.0009) [2023-12-27 23:50:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 328220672. Throughput: 0: 9870.0, 1: 9892.9. Samples: 328216420. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:31,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-6.030')] [2023-12-27 23:50:31,202][106226] Updated weights for policy 0, policy_version 639980 (0.0009) [2023-12-27 23:50:31,211][106225] Updated weights for policy 1, policy_version 641915 (0.0006) [2023-12-27 23:50:31,278][106225] Updated weights for policy 1, policy_version 641925 (0.0007) [2023-12-27 23:50:31,902][106226] Updated weights for policy 0, policy_version 639990 (0.0006) [2023-12-27 23:50:31,964][106226] Updated weights for policy 0, policy_version 640000 (0.0007) [2023-12-27 23:50:31,985][106225] Updated weights for policy 1, policy_version 641935 (0.0007) [2023-12-27 23:50:32,028][106226] Updated weights for policy 0, policy_version 640010 (0.0008) [2023-12-27 23:50:32,041][106225] Updated weights for policy 1, policy_version 641945 (0.0006) [2023-12-27 23:50:32,103][106225] Updated weights for policy 1, policy_version 641955 (0.0007) [2023-12-27 23:50:32,747][106226] Updated weights for policy 0, policy_version 640020 (0.0007) [2023-12-27 23:50:32,778][106225] Updated weights for policy 1, policy_version 641965 (0.0005) [2023-12-27 23:50:32,798][106226] Updated weights for policy 0, policy_version 640030 (0.0008) [2023-12-27 23:50:32,843][106225] Updated weights for policy 1, policy_version 641975 (0.0007) [2023-12-27 23:50:32,853][106226] Updated weights for policy 0, policy_version 640040 (0.0006) [2023-12-27 23:50:32,907][106225] Updated weights for policy 1, policy_version 641985 (0.0007) [2023-12-27 23:50:33,492][106225] Updated weights for policy 1, policy_version 641995 (0.0006) [2023-12-27 23:50:33,517][106226] Updated weights for policy 0, policy_version 640050 (0.0007) [2023-12-27 23:50:33,547][106225] Updated weights for policy 1, policy_version 642005 (0.0005) [2023-12-27 23:50:33,570][106226] Updated weights for policy 0, policy_version 640060 (0.0006) [2023-12-27 23:50:33,595][106225] Updated weights for policy 1, policy_version 642015 (0.0007) [2023-12-27 23:50:33,620][106226] Updated weights for policy 0, policy_version 640070 (0.0008) [2023-12-27 23:50:33,670][106226] Updated weights for policy 0, policy_version 640080 (0.0007) [2023-12-27 23:50:34,315][106225] Updated weights for policy 1, policy_version 642025 (0.0006) [2023-12-27 23:50:34,378][106225] Updated weights for policy 1, policy_version 642035 (0.0007) [2023-12-27 23:50:34,384][106226] Updated weights for policy 0, policy_version 640090 (0.0011) [2023-12-27 23:50:34,439][106225] Updated weights for policy 1, policy_version 642045 (0.0006) [2023-12-27 23:50:34,439][106226] Updated weights for policy 0, policy_version 640100 (0.0010) [2023-12-27 23:50:34,495][106226] Updated weights for policy 0, policy_version 640110 (0.0011) [2023-12-27 23:50:34,501][106225] Updated weights for policy 1, policy_version 642055 (0.0008) [2023-12-27 23:50:35,101][106225] Updated weights for policy 1, policy_version 642065 (0.0006) [2023-12-27 23:50:35,163][106225] Updated weights for policy 1, policy_version 642075 (0.0005) [2023-12-27 23:50:35,223][106225] Updated weights for policy 1, policy_version 642085 (0.0005) [2023-12-27 23:50:35,240][106226] Updated weights for policy 0, policy_version 640120 (0.0011) [2023-12-27 23:50:35,301][106226] Updated weights for policy 0, policy_version 640130 (0.0009) [2023-12-27 23:50:35,358][106226] Updated weights for policy 0, policy_version 640140 (0.0010) [2023-12-27 23:50:35,911][106225] Updated weights for policy 1, policy_version 642095 (0.0007) [2023-12-27 23:50:35,960][106225] Updated weights for policy 1, policy_version 642105 (0.0006) [2023-12-27 23:50:36,009][106226] Updated weights for policy 0, policy_version 640150 (0.0011) [2023-12-27 23:50:36,019][106225] Updated weights for policy 1, policy_version 642115 (0.0006) [2023-12-27 23:50:36,073][106226] Updated weights for policy 0, policy_version 640160 (0.0011) [2023-12-27 23:50:36,139][106226] Updated weights for policy 0, policy_version 640170 (0.0011) [2023-12-27 23:50:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 328327168. Throughput: 0: 9860.2, 1: 9997.7. Samples: 328338080. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:36,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-5.658')] [2023-12-27 23:50:36,766][106226] Updated weights for policy 0, policy_version 640180 (0.0011) [2023-12-27 23:50:36,820][106226] Updated weights for policy 0, policy_version 640190 (0.0011) [2023-12-27 23:50:36,822][106225] Updated weights for policy 1, policy_version 642125 (0.0005) [2023-12-27 23:50:36,871][106226] Updated weights for policy 0, policy_version 640200 (0.0010) [2023-12-27 23:50:36,873][106225] Updated weights for policy 1, policy_version 642135 (0.0005) [2023-12-27 23:50:36,930][106225] Updated weights for policy 1, policy_version 642145 (0.0005) [2023-12-27 23:50:37,563][106225] Updated weights for policy 1, policy_version 642155 (0.0006) [2023-12-27 23:50:37,606][106226] Updated weights for policy 0, policy_version 640210 (0.0011) [2023-12-27 23:50:37,622][106225] Updated weights for policy 1, policy_version 642165 (0.0008) [2023-12-27 23:50:37,665][106226] Updated weights for policy 0, policy_version 640220 (0.0011) [2023-12-27 23:50:37,683][106225] Updated weights for policy 1, policy_version 642175 (0.0006) [2023-12-27 23:50:37,728][106226] Updated weights for policy 0, policy_version 640230 (0.0011) [2023-12-27 23:50:37,790][106226] Updated weights for policy 0, policy_version 640240 (0.0011) [2023-12-27 23:50:38,357][106225] Updated weights for policy 1, policy_version 642185 (0.0006) [2023-12-27 23:50:38,421][106225] Updated weights for policy 1, policy_version 642195 (0.0008) [2023-12-27 23:50:38,469][106226] Updated weights for policy 0, policy_version 640250 (0.0011) [2023-12-27 23:50:38,473][106225] Updated weights for policy 1, policy_version 642205 (0.0009) [2023-12-27 23:50:38,529][106225] Updated weights for policy 1, policy_version 642215 (0.0007) [2023-12-27 23:50:38,536][106226] Updated weights for policy 0, policy_version 640260 (0.0011) [2023-12-27 23:50:38,597][106226] Updated weights for policy 0, policy_version 640270 (0.0010) [2023-12-27 23:50:39,286][106225] Updated weights for policy 1, policy_version 642225 (0.0008) [2023-12-27 23:50:39,325][106226] Updated weights for policy 0, policy_version 640280 (0.0010) [2023-12-27 23:50:39,357][106225] Updated weights for policy 1, policy_version 642235 (0.0007) [2023-12-27 23:50:39,393][106226] Updated weights for policy 0, policy_version 640290 (0.0010) [2023-12-27 23:50:39,431][106225] Updated weights for policy 1, policy_version 642245 (0.0008) [2023-12-27 23:50:39,461][106226] Updated weights for policy 0, policy_version 640300 (0.0009) [2023-12-27 23:50:40,144][106226] Updated weights for policy 0, policy_version 640310 (0.0007) [2023-12-27 23:50:40,196][106225] Updated weights for policy 1, policy_version 642255 (0.0008) [2023-12-27 23:50:40,200][106226] Updated weights for policy 0, policy_version 640320 (0.0008) [2023-12-27 23:50:40,260][106225] Updated weights for policy 1, policy_version 642265 (0.0007) [2023-12-27 23:50:40,266][106226] Updated weights for policy 0, policy_version 640330 (0.0007) [2023-12-27 23:50:40,321][106225] Updated weights for policy 1, policy_version 642275 (0.0007) [2023-12-27 23:50:40,926][106226] Updated weights for policy 0, policy_version 640340 (0.0008) [2023-12-27 23:50:40,991][106226] Updated weights for policy 0, policy_version 640350 (0.0007) [2023-12-27 23:50:41,059][106225] Updated weights for policy 1, policy_version 642285 (0.0007) [2023-12-27 23:50:41,065][106226] Updated weights for policy 0, policy_version 640360 (0.0008) [2023-12-27 23:50:41,127][106225] Updated weights for policy 1, policy_version 642295 (0.0010) [2023-12-27 23:50:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 328425472. Throughput: 0: 9929.4, 1: 9961.6. Samples: 328397660. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:41,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.616')] [2023-12-27 23:50:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000640368_163971072.pth... [2023-12-27 23:50:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000639184_163667968.pth [2023-12-27 23:50:41,197][106225] Updated weights for policy 1, policy_version 642305 (0.0010) [2023-12-27 23:50:41,238][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000642312_164462592.pth... [2023-12-27 23:50:41,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000641160_164167680.pth [2023-12-27 23:50:41,792][106226] Updated weights for policy 0, policy_version 640370 (0.0008) [2023-12-27 23:50:41,855][106226] Updated weights for policy 0, policy_version 640380 (0.0009) [2023-12-27 23:50:41,897][106225] Updated weights for policy 1, policy_version 642315 (0.0010) [2023-12-27 23:50:41,911][106226] Updated weights for policy 0, policy_version 640390 (0.0008) [2023-12-27 23:50:41,959][106225] Updated weights for policy 1, policy_version 642325 (0.0007) [2023-12-27 23:50:41,969][106226] Updated weights for policy 0, policy_version 640400 (0.0008) [2023-12-27 23:50:42,015][106225] Updated weights for policy 1, policy_version 642335 (0.0008) [2023-12-27 23:50:42,708][106226] Updated weights for policy 0, policy_version 640410 (0.0008) [2023-12-27 23:50:42,723][106225] Updated weights for policy 1, policy_version 642345 (0.0008) [2023-12-27 23:50:42,763][106226] Updated weights for policy 0, policy_version 640420 (0.0006) [2023-12-27 23:50:42,785][106225] Updated weights for policy 1, policy_version 642355 (0.0006) [2023-12-27 23:50:42,820][106226] Updated weights for policy 0, policy_version 640430 (0.0006) [2023-12-27 23:50:42,849][106225] Updated weights for policy 1, policy_version 642365 (0.0006) [2023-12-27 23:50:42,909][106225] Updated weights for policy 1, policy_version 642375 (0.0009) [2023-12-27 23:50:43,494][106225] Updated weights for policy 1, policy_version 642385 (0.0007) [2023-12-27 23:50:43,541][106225] Updated weights for policy 1, policy_version 642395 (0.0007) [2023-12-27 23:50:43,588][106225] Updated weights for policy 1, policy_version 642405 (0.0009) [2023-12-27 23:50:43,617][106226] Updated weights for policy 0, policy_version 640440 (0.0006) [2023-12-27 23:50:43,663][106226] Updated weights for policy 0, policy_version 640450 (0.0005) [2023-12-27 23:50:43,709][106226] Updated weights for policy 0, policy_version 640460 (0.0005) [2023-12-27 23:50:44,234][106226] Updated weights for policy 0, policy_version 640470 (0.0006) [2023-12-27 23:50:44,290][106226] Updated weights for policy 0, policy_version 640480 (0.0008) [2023-12-27 23:50:44,290][106225] Updated weights for policy 1, policy_version 642415 (0.0010) [2023-12-27 23:50:44,347][106225] Updated weights for policy 1, policy_version 642425 (0.0006) [2023-12-27 23:50:44,348][106226] Updated weights for policy 0, policy_version 640490 (0.0008) [2023-12-27 23:50:44,402][106225] Updated weights for policy 1, policy_version 642435 (0.0005) [2023-12-27 23:50:45,052][106226] Updated weights for policy 0, policy_version 640500 (0.0010) [2023-12-27 23:50:45,110][106225] Updated weights for policy 1, policy_version 642445 (0.0009) [2023-12-27 23:50:45,118][106226] Updated weights for policy 0, policy_version 640510 (0.0011) [2023-12-27 23:50:45,162][106225] Updated weights for policy 1, policy_version 642455 (0.0011) [2023-12-27 23:50:45,183][106226] Updated weights for policy 0, policy_version 640520 (0.0011) [2023-12-27 23:50:45,222][106225] Updated weights for policy 1, policy_version 642465 (0.0011) [2023-12-27 23:50:45,887][106226] Updated weights for policy 0, policy_version 640530 (0.0011) [2023-12-27 23:50:45,947][106226] Updated weights for policy 0, policy_version 640540 (0.0011) [2023-12-27 23:50:45,968][106225] Updated weights for policy 1, policy_version 642475 (0.0009) [2023-12-27 23:50:46,008][106226] Updated weights for policy 0, policy_version 640550 (0.0011) [2023-12-27 23:50:46,026][106225] Updated weights for policy 1, policy_version 642485 (0.0005) [2023-12-27 23:50:46,072][106226] Updated weights for policy 0, policy_version 640560 (0.0011) [2023-12-27 23:50:46,081][106225] Updated weights for policy 1, policy_version 642495 (0.0007) [2023-12-27 23:50:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 328531968. Throughput: 0: 9988.0, 1: 9868.6. Samples: 328515384. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:46,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-5.645')] [2023-12-27 23:50:46,759][106225] Updated weights for policy 1, policy_version 642505 (0.0008) [2023-12-27 23:50:46,775][106226] Updated weights for policy 0, policy_version 640570 (0.0010) [2023-12-27 23:50:46,817][106225] Updated weights for policy 1, policy_version 642515 (0.0005) [2023-12-27 23:50:46,834][106226] Updated weights for policy 0, policy_version 640580 (0.0010) [2023-12-27 23:50:46,874][106225] Updated weights for policy 1, policy_version 642525 (0.0005) [2023-12-27 23:50:46,895][106226] Updated weights for policy 0, policy_version 640590 (0.0011) [2023-12-27 23:50:46,927][106225] Updated weights for policy 1, policy_version 642535 (0.0005) [2023-12-27 23:50:47,504][106225] Updated weights for policy 1, policy_version 642545 (0.0006) [2023-12-27 23:50:47,565][106225] Updated weights for policy 1, policy_version 642555 (0.0007) [2023-12-27 23:50:47,626][106226] Updated weights for policy 0, policy_version 640600 (0.0009) [2023-12-27 23:50:47,629][106225] Updated weights for policy 1, policy_version 642565 (0.0005) [2023-12-27 23:50:47,682][106226] Updated weights for policy 0, policy_version 640610 (0.0009) [2023-12-27 23:50:47,742][106226] Updated weights for policy 0, policy_version 640620 (0.0008) [2023-12-27 23:50:48,262][106225] Updated weights for policy 1, policy_version 642575 (0.0009) [2023-12-27 23:50:48,325][106225] Updated weights for policy 1, policy_version 642585 (0.0010) [2023-12-27 23:50:48,392][106225] Updated weights for policy 1, policy_version 642595 (0.0009) [2023-12-27 23:50:48,500][106226] Updated weights for policy 0, policy_version 640630 (0.0008) [2023-12-27 23:50:48,569][106226] Updated weights for policy 0, policy_version 640640 (0.0007) [2023-12-27 23:50:48,633][106226] Updated weights for policy 0, policy_version 640650 (0.0009) [2023-12-27 23:50:49,095][106225] Updated weights for policy 1, policy_version 642605 (0.0008) [2023-12-27 23:50:49,153][106225] Updated weights for policy 1, policy_version 642615 (0.0005) [2023-12-27 23:50:49,198][106225] Updated weights for policy 1, policy_version 642625 (0.0005) [2023-12-27 23:50:49,277][106226] Updated weights for policy 0, policy_version 640660 (0.0008) [2023-12-27 23:50:49,332][106226] Updated weights for policy 0, policy_version 640670 (0.0008) [2023-12-27 23:50:49,414][106226] Updated weights for policy 0, policy_version 640680 (0.0008) [2023-12-27 23:50:49,798][106225] Updated weights for policy 1, policy_version 642635 (0.0007) [2023-12-27 23:50:49,856][106225] Updated weights for policy 1, policy_version 642645 (0.0006) [2023-12-27 23:50:49,931][106225] Updated weights for policy 1, policy_version 642655 (0.0006) [2023-12-27 23:50:50,194][106226] Updated weights for policy 0, policy_version 640690 (0.0008) [2023-12-27 23:50:50,267][106226] Updated weights for policy 0, policy_version 640700 (0.0009) [2023-12-27 23:50:50,329][106226] Updated weights for policy 0, policy_version 640710 (0.0009) [2023-12-27 23:50:50,386][106226] Updated weights for policy 0, policy_version 640720 (0.0009) [2023-12-27 23:50:50,596][106225] Updated weights for policy 1, policy_version 642665 (0.0008) [2023-12-27 23:50:50,660][106225] Updated weights for policy 1, policy_version 642675 (0.0007) [2023-12-27 23:50:50,715][106225] Updated weights for policy 1, policy_version 642685 (0.0008) [2023-12-27 23:50:50,768][106225] Updated weights for policy 1, policy_version 642695 (0.0008) [2023-12-27 23:50:51,014][106226] Updated weights for policy 0, policy_version 640730 (0.0007) [2023-12-27 23:50:51,081][106226] Updated weights for policy 0, policy_version 640740 (0.0007) [2023-12-27 23:50:51,147][106226] Updated weights for policy 0, policy_version 640750 (0.0008) [2023-12-27 23:50:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 328630272. Throughput: 0: 9955.6, 1: 9900.5. Samples: 328635304. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:51,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.878')] [2023-12-27 23:50:51,611][106225] Updated weights for policy 1, policy_version 642705 (0.0008) [2023-12-27 23:50:51,677][106225] Updated weights for policy 1, policy_version 642715 (0.0008) [2023-12-27 23:50:51,745][106225] Updated weights for policy 1, policy_version 642725 (0.0008) [2023-12-27 23:50:51,865][106226] Updated weights for policy 0, policy_version 640760 (0.0006) [2023-12-27 23:50:51,933][106226] Updated weights for policy 0, policy_version 640770 (0.0010) [2023-12-27 23:50:52,000][106226] Updated weights for policy 0, policy_version 640780 (0.0011) [2023-12-27 23:50:52,479][106225] Updated weights for policy 1, policy_version 642735 (0.0008) [2023-12-27 23:50:52,545][106225] Updated weights for policy 1, policy_version 642745 (0.0007) [2023-12-27 23:50:52,610][106225] Updated weights for policy 1, policy_version 642755 (0.0005) [2023-12-27 23:50:52,704][106226] Updated weights for policy 0, policy_version 640790 (0.0011) [2023-12-27 23:50:52,764][106226] Updated weights for policy 0, policy_version 640800 (0.0007) [2023-12-27 23:50:52,819][106226] Updated weights for policy 0, policy_version 640810 (0.0005) [2023-12-27 23:50:53,192][106225] Updated weights for policy 1, policy_version 642765 (0.0007) [2023-12-27 23:50:53,252][106225] Updated weights for policy 1, policy_version 642775 (0.0008) [2023-12-27 23:50:53,309][106225] Updated weights for policy 1, policy_version 642785 (0.0008) [2023-12-27 23:50:53,448][106226] Updated weights for policy 0, policy_version 640820 (0.0007) [2023-12-27 23:50:53,499][106226] Updated weights for policy 0, policy_version 640830 (0.0010) [2023-12-27 23:50:53,550][106226] Updated weights for policy 0, policy_version 640840 (0.0010) [2023-12-27 23:50:53,983][106225] Updated weights for policy 1, policy_version 642795 (0.0007) [2023-12-27 23:50:54,047][106225] Updated weights for policy 1, policy_version 642805 (0.0007) [2023-12-27 23:50:54,109][106225] Updated weights for policy 1, policy_version 642815 (0.0008) [2023-12-27 23:50:54,273][106226] Updated weights for policy 0, policy_version 640850 (0.0010) [2023-12-27 23:50:54,335][106226] Updated weights for policy 0, policy_version 640860 (0.0007) [2023-12-27 23:50:54,382][106226] Updated weights for policy 0, policy_version 640870 (0.0009) [2023-12-27 23:50:54,442][106226] Updated weights for policy 0, policy_version 640880 (0.0009) [2023-12-27 23:50:54,782][106225] Updated weights for policy 1, policy_version 642825 (0.0009) [2023-12-27 23:50:54,835][106225] Updated weights for policy 1, policy_version 642835 (0.0007) [2023-12-27 23:50:54,890][106225] Updated weights for policy 1, policy_version 642845 (0.0008) [2023-12-27 23:50:54,935][106225] Updated weights for policy 1, policy_version 642855 (0.0007) [2023-12-27 23:50:55,142][106226] Updated weights for policy 0, policy_version 640890 (0.0008) [2023-12-27 23:50:55,192][106226] Updated weights for policy 0, policy_version 640900 (0.0007) [2023-12-27 23:50:55,246][106226] Updated weights for policy 0, policy_version 640910 (0.0005) [2023-12-27 23:50:55,671][106225] Updated weights for policy 1, policy_version 642865 (0.0008) [2023-12-27 23:50:55,727][106225] Updated weights for policy 1, policy_version 642875 (0.0008) [2023-12-27 23:50:55,774][106225] Updated weights for policy 1, policy_version 642885 (0.0008) [2023-12-27 23:50:55,923][106226] Updated weights for policy 0, policy_version 640920 (0.0008) [2023-12-27 23:50:55,983][106226] Updated weights for policy 0, policy_version 640930 (0.0009) [2023-12-27 23:50:56,042][106226] Updated weights for policy 0, policy_version 640940 (0.0008) [2023-12-27 23:50:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 328728576. Throughput: 0: 9970.2, 1: 9914.1. Samples: 328693684. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:50:56,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-5.842')] [2023-12-27 23:50:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000640944_164118528.pth... [2023-12-27 23:50:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000642888_164610048.pth... [2023-12-27 23:50:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000639760_163815424.pth [2023-12-27 23:50:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000641736_164315136.pth [2023-12-27 23:50:56,514][106225] Updated weights for policy 1, policy_version 642895 (0.0008) [2023-12-27 23:50:56,567][106225] Updated weights for policy 1, policy_version 642905 (0.0008) [2023-12-27 23:50:56,618][106225] Updated weights for policy 1, policy_version 642915 (0.0008) [2023-12-27 23:50:56,787][106226] Updated weights for policy 0, policy_version 640950 (0.0009) [2023-12-27 23:50:56,836][106226] Updated weights for policy 0, policy_version 640960 (0.0008) [2023-12-27 23:50:56,885][106226] Updated weights for policy 0, policy_version 640970 (0.0007) [2023-12-27 23:50:57,332][106225] Updated weights for policy 1, policy_version 642925 (0.0008) [2023-12-27 23:50:57,394][106225] Updated weights for policy 1, policy_version 642935 (0.0009) [2023-12-27 23:50:57,457][106225] Updated weights for policy 1, policy_version 642945 (0.0006) [2023-12-27 23:50:57,615][106226] Updated weights for policy 0, policy_version 640980 (0.0009) [2023-12-27 23:50:57,664][106226] Updated weights for policy 0, policy_version 640990 (0.0008) [2023-12-27 23:50:57,712][106226] Updated weights for policy 0, policy_version 641000 (0.0008) [2023-12-27 23:50:57,976][106225] Updated weights for policy 1, policy_version 642955 (0.0006) [2023-12-27 23:50:58,031][106225] Updated weights for policy 1, policy_version 642965 (0.0009) [2023-12-27 23:50:58,078][106225] Updated weights for policy 1, policy_version 642975 (0.0008) [2023-12-27 23:50:58,503][106226] Updated weights for policy 0, policy_version 641010 (0.0009) [2023-12-27 23:50:58,568][106226] Updated weights for policy 0, policy_version 641020 (0.0010) [2023-12-27 23:50:58,634][106226] Updated weights for policy 0, policy_version 641030 (0.0010) [2023-12-27 23:50:58,706][106226] Updated weights for policy 0, policy_version 641040 (0.0015) [2023-12-27 23:50:58,901][106225] Updated weights for policy 1, policy_version 642985 (0.0008) [2023-12-27 23:50:58,972][106225] Updated weights for policy 1, policy_version 642995 (0.0008) [2023-12-27 23:50:59,025][106225] Updated weights for policy 1, policy_version 643005 (0.0008) [2023-12-27 23:50:59,083][106225] Updated weights for policy 1, policy_version 643015 (0.0007) [2023-12-27 23:50:59,543][106226] Updated weights for policy 0, policy_version 641050 (0.0006) [2023-12-27 23:50:59,599][106226] Updated weights for policy 0, policy_version 641060 (0.0005) [2023-12-27 23:50:59,667][106226] Updated weights for policy 0, policy_version 641070 (0.0006) [2023-12-27 23:50:59,936][106225] Updated weights for policy 1, policy_version 643025 (0.0009) [2023-12-27 23:50:59,987][106225] Updated weights for policy 1, policy_version 643035 (0.0008) [2023-12-27 23:51:00,042][106225] Updated weights for policy 1, policy_version 643045 (0.0008) [2023-12-27 23:51:00,283][106226] Updated weights for policy 0, policy_version 641080 (0.0008) [2023-12-27 23:51:00,338][106226] Updated weights for policy 0, policy_version 641090 (0.0008) [2023-12-27 23:51:00,395][106226] Updated weights for policy 0, policy_version 641100 (0.0009) [2023-12-27 23:51:00,742][106225] Updated weights for policy 1, policy_version 643055 (0.0006) [2023-12-27 23:51:00,790][106225] Updated weights for policy 1, policy_version 643065 (0.0008) [2023-12-27 23:51:00,837][106225] Updated weights for policy 1, policy_version 643075 (0.0008) [2023-12-27 23:51:01,141][106226] Updated weights for policy 0, policy_version 641110 (0.0009) [2023-12-27 23:51:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 328818688. Throughput: 0: 9895.7, 1: 9903.5. Samples: 328810628. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:01,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-6.084')] [2023-12-27 23:51:01,196][106226] Updated weights for policy 0, policy_version 641120 (0.0008) [2023-12-27 23:51:01,255][106226] Updated weights for policy 0, policy_version 641130 (0.0009) [2023-12-27 23:51:01,570][106225] Updated weights for policy 1, policy_version 643085 (0.0009) [2023-12-27 23:51:01,636][106225] Updated weights for policy 1, policy_version 643095 (0.0008) [2023-12-27 23:51:01,691][106225] Updated weights for policy 1, policy_version 643105 (0.0007) [2023-12-27 23:51:01,963][106226] Updated weights for policy 0, policy_version 641140 (0.0007) [2023-12-27 23:51:02,017][106226] Updated weights for policy 0, policy_version 641150 (0.0005) [2023-12-27 23:51:02,073][106226] Updated weights for policy 0, policy_version 641160 (0.0005) [2023-12-27 23:51:02,504][106225] Updated weights for policy 1, policy_version 643115 (0.0008) [2023-12-27 23:51:02,558][106225] Updated weights for policy 1, policy_version 643125 (0.0008) [2023-12-27 23:51:02,605][106225] Updated weights for policy 1, policy_version 643135 (0.0008) [2023-12-27 23:51:02,700][106226] Updated weights for policy 0, policy_version 641170 (0.0005) [2023-12-27 23:51:02,755][106226] Updated weights for policy 0, policy_version 641180 (0.0006) [2023-12-27 23:51:02,818][106226] Updated weights for policy 0, policy_version 641190 (0.0008) [2023-12-27 23:51:02,884][106226] Updated weights for policy 0, policy_version 641200 (0.0008) [2023-12-27 23:51:03,383][106225] Updated weights for policy 1, policy_version 643145 (0.0007) [2023-12-27 23:51:03,441][106225] Updated weights for policy 1, policy_version 643155 (0.0008) [2023-12-27 23:51:03,494][106225] Updated weights for policy 1, policy_version 643165 (0.0008) [2023-12-27 23:51:03,544][106225] Updated weights for policy 1, policy_version 643175 (0.0006) [2023-12-27 23:51:03,553][106226] Updated weights for policy 0, policy_version 641210 (0.0010) [2023-12-27 23:51:03,599][106226] Updated weights for policy 0, policy_version 641220 (0.0010) [2023-12-27 23:51:03,648][106226] Updated weights for policy 0, policy_version 641230 (0.0010) [2023-12-27 23:51:04,272][106225] Updated weights for policy 1, policy_version 643185 (0.0007) [2023-12-27 23:51:04,331][106225] Updated weights for policy 1, policy_version 643195 (0.0006) [2023-12-27 23:51:04,395][106225] Updated weights for policy 1, policy_version 643205 (0.0006) [2023-12-27 23:51:04,417][106226] Updated weights for policy 0, policy_version 641240 (0.0008) [2023-12-27 23:51:04,480][106226] Updated weights for policy 0, policy_version 641250 (0.0008) [2023-12-27 23:51:04,550][106226] Updated weights for policy 0, policy_version 641260 (0.0009) [2023-12-27 23:51:05,135][106225] Updated weights for policy 1, policy_version 643215 (0.0006) [2023-12-27 23:51:05,152][106226] Updated weights for policy 0, policy_version 641270 (0.0008) [2023-12-27 23:51:05,187][106225] Updated weights for policy 1, policy_version 643225 (0.0006) [2023-12-27 23:51:05,205][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000002 [2023-12-27 23:51:05,206][106226] Updated weights for policy 0, policy_version 641280 (0.0006) [2023-12-27 23:51:05,239][106225] Updated weights for policy 1, policy_version 643235 (0.0009) [2023-12-27 23:51:05,930][106225] Updated weights for policy 1, policy_version 643245 (0.0009) [2023-12-27 23:51:05,981][106225] Updated weights for policy 1, policy_version 643255 (0.0010) [2023-12-27 23:51:05,987][106226] Updated weights for policy 0, policy_version 641290 (0.0006) [2023-12-27 23:51:06,028][106225] Updated weights for policy 1, policy_version 643265 (0.0010) [2023-12-27 23:51:06,046][106226] Updated weights for policy 0, policy_version 641300 (0.0006) [2023-12-27 23:51:06,125][106226] Updated weights for policy 0, policy_version 641310 (0.0008) [2023-12-27 23:51:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 328925184. Throughput: 0: 9865.1, 1: 9897.9. Samples: 328927208. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:06,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-6.228')] [2023-12-27 23:51:06,714][106225] Updated weights for policy 1, policy_version 643275 (0.0009) [2023-12-27 23:51:06,770][106225] Updated weights for policy 1, policy_version 643285 (0.0006) [2023-12-27 23:51:06,828][106225] Updated weights for policy 1, policy_version 643295 (0.0008) [2023-12-27 23:51:06,854][106226] Updated weights for policy 0, policy_version 641320 (0.0006) [2023-12-27 23:51:06,911][106226] Updated weights for policy 0, policy_version 641330 (0.0005) [2023-12-27 23:51:06,972][106226] Updated weights for policy 0, policy_version 641340 (0.0005) [2023-12-27 23:51:07,543][106226] Updated weights for policy 0, policy_version 641350 (0.0009) [2023-12-27 23:51:07,572][106225] Updated weights for policy 1, policy_version 643305 (0.0006) [2023-12-27 23:51:07,603][106226] Updated weights for policy 0, policy_version 641360 (0.0008) [2023-12-27 23:51:07,629][106225] Updated weights for policy 1, policy_version 643315 (0.0006) [2023-12-27 23:51:07,654][106226] Updated weights for policy 0, policy_version 641370 (0.0008) [2023-12-27 23:51:07,679][106225] Updated weights for policy 1, policy_version 643325 (0.0006) [2023-12-27 23:51:07,726][106225] Updated weights for policy 1, policy_version 643335 (0.0008) [2023-12-27 23:51:08,411][106226] Updated weights for policy 0, policy_version 641380 (0.0007) [2023-12-27 23:51:08,453][106225] Updated weights for policy 1, policy_version 643345 (0.0007) [2023-12-27 23:51:08,476][106226] Updated weights for policy 0, policy_version 641390 (0.0006) [2023-12-27 23:51:08,512][106225] Updated weights for policy 1, policy_version 643355 (0.0006) [2023-12-27 23:51:08,540][106226] Updated weights for policy 0, policy_version 641400 (0.0008) [2023-12-27 23:51:08,574][106225] Updated weights for policy 1, policy_version 643365 (0.0007) [2023-12-27 23:51:09,191][106225] Updated weights for policy 1, policy_version 643375 (0.0008) [2023-12-27 23:51:09,260][106225] Updated weights for policy 1, policy_version 643385 (0.0008) [2023-12-27 23:51:09,314][106226] Updated weights for policy 0, policy_version 641410 (0.0007) [2023-12-27 23:51:09,327][106225] Updated weights for policy 1, policy_version 643395 (0.0010) [2023-12-27 23:51:09,385][106226] Updated weights for policy 0, policy_version 641420 (0.0007) [2023-12-27 23:51:09,448][106226] Updated weights for policy 0, policy_version 641430 (0.0009) [2023-12-27 23:51:09,510][106226] Updated weights for policy 0, policy_version 641440 (0.0009) [2023-12-27 23:51:10,133][106225] Updated weights for policy 1, policy_version 643405 (0.0008) [2023-12-27 23:51:10,190][106225] Updated weights for policy 1, policy_version 643415 (0.0008) [2023-12-27 23:51:10,257][106225] Updated weights for policy 1, policy_version 643425 (0.0007) [2023-12-27 23:51:10,259][106226] Updated weights for policy 0, policy_version 641450 (0.0007) [2023-12-27 23:51:10,309][106226] Updated weights for policy 0, policy_version 641460 (0.0006) [2023-12-27 23:51:10,366][106226] Updated weights for policy 0, policy_version 641470 (0.0009) [2023-12-27 23:51:10,945][106225] Updated weights for policy 1, policy_version 643435 (0.0007) [2023-12-27 23:51:10,996][106225] Updated weights for policy 1, policy_version 643445 (0.0005) [2023-12-27 23:51:11,047][106226] Updated weights for policy 0, policy_version 641480 (0.0009) [2023-12-27 23:51:11,078][106225] Updated weights for policy 1, policy_version 643455 (0.0007) [2023-12-27 23:51:11,112][106226] Updated weights for policy 0, policy_version 641490 (0.0008) [2023-12-27 23:51:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 329015296. Throughput: 0: 9863.0, 1: 9923.3. Samples: 328986156. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:11,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-6.154')] [2023-12-27 23:51:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000643464_164757504.pth... [2023-12-27 23:51:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000642312_164462592.pth [2023-12-27 23:51:11,185][106226] Updated weights for policy 0, policy_version 641500 (0.0011) [2023-12-27 23:51:11,204][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000641504_164265984.pth... [2023-12-27 23:51:11,207][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000640368_163971072.pth [2023-12-27 23:51:11,825][106225] Updated weights for policy 1, policy_version 643465 (0.0007) [2023-12-27 23:51:11,892][106225] Updated weights for policy 1, policy_version 643475 (0.0008) [2023-12-27 23:51:11,964][106225] Updated weights for policy 1, policy_version 643485 (0.0008) [2023-12-27 23:51:12,004][106226] Updated weights for policy 0, policy_version 641510 (0.0007) [2023-12-27 23:51:12,036][106225] Updated weights for policy 1, policy_version 643495 (0.0008) [2023-12-27 23:51:12,077][106226] Updated weights for policy 0, policy_version 641520 (0.0009) [2023-12-27 23:51:12,144][106226] Updated weights for policy 0, policy_version 641530 (0.0009) [2023-12-27 23:51:12,776][106225] Updated weights for policy 1, policy_version 643505 (0.0008) [2023-12-27 23:51:12,829][106225] Updated weights for policy 1, policy_version 643515 (0.0009) [2023-12-27 23:51:12,876][106225] Updated weights for policy 1, policy_version 643525 (0.0008) [2023-12-27 23:51:12,913][106226] Updated weights for policy 0, policy_version 641540 (0.0009) [2023-12-27 23:51:12,965][106226] Updated weights for policy 0, policy_version 641550 (0.0008) [2023-12-27 23:51:13,016][106226] Updated weights for policy 0, policy_version 641560 (0.0009) [2023-12-27 23:51:13,605][106225] Updated weights for policy 1, policy_version 643535 (0.0007) [2023-12-27 23:51:13,657][106225] Updated weights for policy 1, policy_version 643545 (0.0008) [2023-12-27 23:51:13,708][106225] Updated weights for policy 1, policy_version 643555 (0.0008) [2023-12-27 23:51:13,737][106226] Updated weights for policy 0, policy_version 641570 (0.0009) [2023-12-27 23:51:13,791][106226] Updated weights for policy 0, policy_version 641580 (0.0009) [2023-12-27 23:51:13,847][106226] Updated weights for policy 0, policy_version 641590 (0.0009) [2023-12-27 23:51:13,908][106226] Updated weights for policy 0, policy_version 641600 (0.0008) [2023-12-27 23:51:14,441][106225] Updated weights for policy 1, policy_version 643565 (0.0008) [2023-12-27 23:51:14,493][106225] Updated weights for policy 1, policy_version 643575 (0.0008) [2023-12-27 23:51:14,545][106225] Updated weights for policy 1, policy_version 643585 (0.0008) [2023-12-27 23:51:14,631][106226] Updated weights for policy 0, policy_version 641610 (0.0005) [2023-12-27 23:51:14,687][106226] Updated weights for policy 0, policy_version 641620 (0.0005) [2023-12-27 23:51:14,747][106226] Updated weights for policy 0, policy_version 641630 (0.0006) [2023-12-27 23:51:15,260][106225] Updated weights for policy 1, policy_version 643595 (0.0008) [2023-12-27 23:51:15,315][106225] Updated weights for policy 1, policy_version 643605 (0.0008) [2023-12-27 23:51:15,371][106225] Updated weights for policy 1, policy_version 643615 (0.0007) [2023-12-27 23:51:15,468][106226] Updated weights for policy 0, policy_version 641640 (0.0008) [2023-12-27 23:51:15,514][106226] Updated weights for policy 0, policy_version 641650 (0.0008) [2023-12-27 23:51:15,562][106226] Updated weights for policy 0, policy_version 641660 (0.0008) [2023-12-27 23:51:16,094][106225] Updated weights for policy 1, policy_version 643625 (0.0008) [2023-12-27 23:51:16,156][106225] Updated weights for policy 1, policy_version 643635 (0.0005) [2023-12-27 23:51:16,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 329105408. Throughput: 0: 9801.5, 1: 9817.9. Samples: 329099292. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:16,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-6.241')] [2023-12-27 23:51:16,211][106225] Updated weights for policy 1, policy_version 643645 (0.0005) [2023-12-27 23:51:16,258][106225] Updated weights for policy 1, policy_version 643655 (0.0008) [2023-12-27 23:51:16,287][106226] Updated weights for policy 0, policy_version 641670 (0.0009) [2023-12-27 23:51:16,343][106226] Updated weights for policy 0, policy_version 641680 (0.0010) [2023-12-27 23:51:16,400][106226] Updated weights for policy 0, policy_version 641690 (0.0008) [2023-12-27 23:51:16,976][106226] Updated weights for policy 0, policy_version 641700 (0.0007) [2023-12-27 23:51:17,003][106225] Updated weights for policy 1, policy_version 643665 (0.0010) [2023-12-27 23:51:17,032][106226] Updated weights for policy 0, policy_version 641710 (0.0006) [2023-12-27 23:51:17,056][106225] Updated weights for policy 1, policy_version 643675 (0.0010) [2023-12-27 23:51:17,094][106226] Updated weights for policy 0, policy_version 641720 (0.0006) [2023-12-27 23:51:17,121][106225] Updated weights for policy 1, policy_version 643685 (0.0010) [2023-12-27 23:51:17,665][106226] Updated weights for policy 0, policy_version 641730 (0.0009) [2023-12-27 23:51:17,730][106225] Updated weights for policy 1, policy_version 643695 (0.0009) [2023-12-27 23:51:17,732][106226] Updated weights for policy 0, policy_version 641740 (0.0006) [2023-12-27 23:51:17,794][106225] Updated weights for policy 1, policy_version 643705 (0.0006) [2023-12-27 23:51:17,804][106226] Updated weights for policy 0, policy_version 641750 (0.0008) [2023-12-27 23:51:17,849][106225] Updated weights for policy 1, policy_version 643715 (0.0006) [2023-12-27 23:51:17,866][106226] Updated weights for policy 0, policy_version 641760 (0.0010) [2023-12-27 23:51:18,558][106225] Updated weights for policy 1, policy_version 643725 (0.0008) [2023-12-27 23:51:18,560][106226] Updated weights for policy 0, policy_version 641770 (0.0007) [2023-12-27 23:51:18,617][106225] Updated weights for policy 1, policy_version 643735 (0.0010) [2023-12-27 23:51:18,619][106226] Updated weights for policy 0, policy_version 641780 (0.0006) [2023-12-27 23:51:18,674][106225] Updated weights for policy 1, policy_version 643745 (0.0010) [2023-12-27 23:51:18,684][106226] Updated weights for policy 0, policy_version 641790 (0.0006) [2023-12-27 23:51:19,284][106226] Updated weights for policy 0, policy_version 641800 (0.0008) [2023-12-27 23:51:19,338][106226] Updated weights for policy 0, policy_version 641810 (0.0007) [2023-12-27 23:51:19,406][106226] Updated weights for policy 0, policy_version 641820 (0.0008) [2023-12-27 23:51:19,407][106225] Updated weights for policy 1, policy_version 643755 (0.0010) [2023-12-27 23:51:19,469][106225] Updated weights for policy 1, policy_version 643765 (0.0008) [2023-12-27 23:51:19,535][106225] Updated weights for policy 1, policy_version 643775 (0.0008) [2023-12-27 23:51:20,119][106226] Updated weights for policy 0, policy_version 641830 (0.0008) [2023-12-27 23:51:20,186][106226] Updated weights for policy 0, policy_version 641840 (0.0008) [2023-12-27 23:51:20,248][106226] Updated weights for policy 0, policy_version 641850 (0.0008) [2023-12-27 23:51:20,347][106225] Updated weights for policy 1, policy_version 643785 (0.0008) [2023-12-27 23:51:20,412][106225] Updated weights for policy 1, policy_version 643795 (0.0011) [2023-12-27 23:51:20,475][106225] Updated weights for policy 1, policy_version 643805 (0.0010) [2023-12-27 23:51:20,537][106225] Updated weights for policy 1, policy_version 643815 (0.0010) [2023-12-27 23:51:21,022][106226] Updated weights for policy 0, policy_version 641860 (0.0009) [2023-12-27 23:51:21,100][106226] Updated weights for policy 0, policy_version 641870 (0.0011) [2023-12-27 23:51:21,165][106226] Updated weights for policy 0, policy_version 641880 (0.0009) [2023-12-27 23:51:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 329203712. Throughput: 0: 9836.9, 1: 9743.5. Samples: 329219196. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:21,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-6.435')] [2023-12-27 23:51:21,293][106225] Updated weights for policy 1, policy_version 643825 (0.0010) [2023-12-27 23:51:21,363][106225] Updated weights for policy 1, policy_version 643835 (0.0009) [2023-12-27 23:51:21,433][106225] Updated weights for policy 1, policy_version 643845 (0.0014) [2023-12-27 23:51:21,924][106226] Updated weights for policy 0, policy_version 641890 (0.0009) [2023-12-27 23:51:21,979][106226] Updated weights for policy 0, policy_version 641900 (0.0011) [2023-12-27 23:51:22,037][106226] Updated weights for policy 0, policy_version 641910 (0.0011) [2023-12-27 23:51:22,093][106226] Updated weights for policy 0, policy_version 641920 (0.0009) [2023-12-27 23:51:22,132][106225] Updated weights for policy 1, policy_version 643855 (0.0009) [2023-12-27 23:51:22,184][106225] Updated weights for policy 1, policy_version 643865 (0.0007) [2023-12-27 23:51:22,238][106225] Updated weights for policy 1, policy_version 643875 (0.0007) [2023-12-27 23:51:22,878][106226] Updated weights for policy 0, policy_version 641930 (0.0009) [2023-12-27 23:51:22,938][106226] Updated weights for policy 0, policy_version 641940 (0.0008) [2023-12-27 23:51:22,997][106226] Updated weights for policy 0, policy_version 641950 (0.0009) [2023-12-27 23:51:23,001][106225] Updated weights for policy 1, policy_version 643885 (0.0009) [2023-12-27 23:51:23,063][106225] Updated weights for policy 1, policy_version 643895 (0.0008) [2023-12-27 23:51:23,122][106225] Updated weights for policy 1, policy_version 643905 (0.0008) [2023-12-27 23:51:23,710][106226] Updated weights for policy 0, policy_version 641960 (0.0006) [2023-12-27 23:51:23,759][106226] Updated weights for policy 0, policy_version 641970 (0.0005) [2023-12-27 23:51:23,804][106225] Updated weights for policy 1, policy_version 643915 (0.0007) [2023-12-27 23:51:23,818][106226] Updated weights for policy 0, policy_version 641980 (0.0006) [2023-12-27 23:51:23,855][106225] Updated weights for policy 1, policy_version 643925 (0.0007) [2023-12-27 23:51:23,909][106225] Updated weights for policy 1, policy_version 643935 (0.0009) [2023-12-27 23:51:24,427][106226] Updated weights for policy 0, policy_version 641990 (0.0008) [2023-12-27 23:51:24,481][106226] Updated weights for policy 0, policy_version 642000 (0.0007) [2023-12-27 23:51:24,545][106226] Updated weights for policy 0, policy_version 642010 (0.0008) [2023-12-27 23:51:24,641][106225] Updated weights for policy 1, policy_version 643945 (0.0008) [2023-12-27 23:51:24,698][106225] Updated weights for policy 1, policy_version 643955 (0.0010) [2023-12-27 23:51:24,763][106225] Updated weights for policy 1, policy_version 643965 (0.0010) [2023-12-27 23:51:24,829][106225] Updated weights for policy 1, policy_version 643975 (0.0010) [2023-12-27 23:51:25,274][106226] Updated weights for policy 0, policy_version 642020 (0.0009) [2023-12-27 23:51:25,331][106226] Updated weights for policy 0, policy_version 642030 (0.0010) [2023-12-27 23:51:25,382][106226] Updated weights for policy 0, policy_version 642040 (0.0010) [2023-12-27 23:51:25,529][106225] Updated weights for policy 1, policy_version 643985 (0.0010) [2023-12-27 23:51:25,586][106225] Updated weights for policy 1, policy_version 643995 (0.0010) [2023-12-27 23:51:25,642][106225] Updated weights for policy 1, policy_version 644005 (0.0010) [2023-12-27 23:51:26,091][106226] Updated weights for policy 0, policy_version 642050 (0.0010) [2023-12-27 23:51:26,157][106226] Updated weights for policy 0, policy_version 642060 (0.0006) [2023-12-27 23:51:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 329302016. Throughput: 0: 9812.6, 1: 9732.2. Samples: 329277172. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:26,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-5.496')] [2023-12-27 23:51:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000644008_164896768.pth... [2023-12-27 23:51:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000642888_164610048.pth [2023-12-27 23:51:26,211][106226] Updated weights for policy 0, policy_version 642070 (0.0006) [2023-12-27 23:51:26,259][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000642080_164413440.pth... [2023-12-27 23:51:26,263][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000640944_164118528.pth [2023-12-27 23:51:26,263][106226] Updated weights for policy 0, policy_version 642080 (0.0009) [2023-12-27 23:51:26,361][106225] Updated weights for policy 1, policy_version 644015 (0.0008) [2023-12-27 23:51:26,414][106225] Updated weights for policy 1, policy_version 644025 (0.0010) [2023-12-27 23:51:26,470][106225] Updated weights for policy 1, policy_version 644035 (0.0010) [2023-12-27 23:51:26,948][106226] Updated weights for policy 0, policy_version 642090 (0.0011) [2023-12-27 23:51:26,999][106226] Updated weights for policy 0, policy_version 642100 (0.0008) [2023-12-27 23:51:27,055][106226] Updated weights for policy 0, policy_version 642110 (0.0008) [2023-12-27 23:51:27,180][106225] Updated weights for policy 1, policy_version 644045 (0.0010) [2023-12-27 23:51:27,233][106225] Updated weights for policy 1, policy_version 644055 (0.0010) [2023-12-27 23:51:27,288][106225] Updated weights for policy 1, policy_version 644065 (0.0009) [2023-12-27 23:51:27,679][106226] Updated weights for policy 0, policy_version 642120 (0.0006) [2023-12-27 23:51:27,736][106226] Updated weights for policy 0, policy_version 642130 (0.0005) [2023-12-27 23:51:27,781][106226] Updated weights for policy 0, policy_version 642140 (0.0005) [2023-12-27 23:51:27,988][106225] Updated weights for policy 1, policy_version 644075 (0.0008) [2023-12-27 23:51:28,057][106225] Updated weights for policy 1, policy_version 644085 (0.0009) [2023-12-27 23:51:28,119][106225] Updated weights for policy 1, policy_version 644095 (0.0009) [2023-12-27 23:51:28,317][106226] Updated weights for policy 0, policy_version 642150 (0.0005) [2023-12-27 23:51:28,378][106226] Updated weights for policy 0, policy_version 642160 (0.0008) [2023-12-27 23:51:28,437][106226] Updated weights for policy 0, policy_version 642170 (0.0008) [2023-12-27 23:51:28,816][106225] Updated weights for policy 1, policy_version 644105 (0.0007) [2023-12-27 23:51:28,873][106225] Updated weights for policy 1, policy_version 644115 (0.0008) [2023-12-27 23:51:28,941][106225] Updated weights for policy 1, policy_version 644125 (0.0009) [2023-12-27 23:51:28,999][106225] Updated weights for policy 1, policy_version 644135 (0.0009) [2023-12-27 23:51:29,078][106226] Updated weights for policy 0, policy_version 642180 (0.0007) [2023-12-27 23:51:29,139][106226] Updated weights for policy 0, policy_version 642190 (0.0005) [2023-12-27 23:51:29,204][106226] Updated weights for policy 0, policy_version 642200 (0.0005) [2023-12-27 23:51:29,774][106226] Updated weights for policy 0, policy_version 642210 (0.0006) [2023-12-27 23:51:29,782][106225] Updated weights for policy 1, policy_version 644145 (0.0008) [2023-12-27 23:51:29,840][106226] Updated weights for policy 0, policy_version 642220 (0.0007) [2023-12-27 23:51:29,843][106225] Updated weights for policy 1, policy_version 644155 (0.0007) [2023-12-27 23:51:29,901][106225] Updated weights for policy 1, policy_version 644165 (0.0008) [2023-12-27 23:51:29,902][106226] Updated weights for policy 0, policy_version 642230 (0.0007) [2023-12-27 23:51:29,972][106226] Updated weights for policy 0, policy_version 642240 (0.0008) [2023-12-27 23:51:30,651][106225] Updated weights for policy 1, policy_version 644175 (0.0008) [2023-12-27 23:51:30,710][106226] Updated weights for policy 0, policy_version 642250 (0.0007) [2023-12-27 23:51:30,716][106225] Updated weights for policy 1, policy_version 644185 (0.0007) [2023-12-27 23:51:30,769][106226] Updated weights for policy 0, policy_version 642260 (0.0006) [2023-12-27 23:51:30,774][106225] Updated weights for policy 1, policy_version 644195 (0.0008) [2023-12-27 23:51:30,825][106226] Updated weights for policy 0, policy_version 642270 (0.0005) [2023-12-27 23:51:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 329408512. Throughput: 0: 9883.5, 1: 9738.8. Samples: 329398384. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:31,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-6.293')] [2023-12-27 23:51:31,474][106225] Updated weights for policy 1, policy_version 644205 (0.0009) [2023-12-27 23:51:31,534][106225] Updated weights for policy 1, policy_version 644215 (0.0007) [2023-12-27 23:51:31,545][106226] Updated weights for policy 0, policy_version 642280 (0.0008) [2023-12-27 23:51:31,589][106225] Updated weights for policy 1, policy_version 644225 (0.0008) [2023-12-27 23:51:31,603][106226] Updated weights for policy 0, policy_version 642290 (0.0006) [2023-12-27 23:51:31,667][106226] Updated weights for policy 0, policy_version 642300 (0.0007) [2023-12-27 23:51:32,297][106225] Updated weights for policy 1, policy_version 644235 (0.0006) [2023-12-27 23:51:32,352][106225] Updated weights for policy 1, policy_version 644245 (0.0009) [2023-12-27 23:51:32,411][106225] Updated weights for policy 1, policy_version 644255 (0.0008) [2023-12-27 23:51:32,420][106226] Updated weights for policy 0, policy_version 642310 (0.0007) [2023-12-27 23:51:32,479][106226] Updated weights for policy 0, policy_version 642320 (0.0007) [2023-12-27 23:51:32,545][106226] Updated weights for policy 0, policy_version 642330 (0.0008) [2023-12-27 23:51:33,115][106225] Updated weights for policy 1, policy_version 644265 (0.0007) [2023-12-27 23:51:33,179][106225] Updated weights for policy 1, policy_version 644275 (0.0008) [2023-12-27 23:51:33,235][106225] Updated weights for policy 1, policy_version 644285 (0.0006) [2023-12-27 23:51:33,287][106226] Updated weights for policy 0, policy_version 642340 (0.0009) [2023-12-27 23:51:33,298][106225] Updated weights for policy 1, policy_version 644295 (0.0007) [2023-12-27 23:51:33,339][106226] Updated weights for policy 0, policy_version 642350 (0.0008) [2023-12-27 23:51:33,401][106226] Updated weights for policy 0, policy_version 642360 (0.0009) [2023-12-27 23:51:33,933][106225] Updated weights for policy 1, policy_version 644305 (0.0005) [2023-12-27 23:51:33,988][106225] Updated weights for policy 1, policy_version 644315 (0.0005) [2023-12-27 23:51:34,051][106225] Updated weights for policy 1, policy_version 644325 (0.0005) [2023-12-27 23:51:34,118][106226] Updated weights for policy 0, policy_version 642370 (0.0008) [2023-12-27 23:51:34,186][106226] Updated weights for policy 0, policy_version 642380 (0.0007) [2023-12-27 23:51:34,247][106226] Updated weights for policy 0, policy_version 642390 (0.0009) [2023-12-27 23:51:34,310][106226] Updated weights for policy 0, policy_version 642400 (0.0008) [2023-12-27 23:51:34,745][106225] Updated weights for policy 1, policy_version 644335 (0.0007) [2023-12-27 23:51:34,794][106225] Updated weights for policy 1, policy_version 644345 (0.0008) [2023-12-27 23:51:34,840][106225] Updated weights for policy 1, policy_version 644355 (0.0008) [2023-12-27 23:51:35,007][106226] Updated weights for policy 0, policy_version 642410 (0.0008) [2023-12-27 23:51:35,064][106226] Updated weights for policy 0, policy_version 642420 (0.0005) [2023-12-27 23:51:35,119][106226] Updated weights for policy 0, policy_version 642430 (0.0005) [2023-12-27 23:51:35,622][106225] Updated weights for policy 1, policy_version 644365 (0.0009) [2023-12-27 23:51:35,671][106225] Updated weights for policy 1, policy_version 644375 (0.0008) [2023-12-27 23:51:35,727][106225] Updated weights for policy 1, policy_version 644385 (0.0008) [2023-12-27 23:51:35,757][106226] Updated weights for policy 0, policy_version 642440 (0.0006) [2023-12-27 23:51:35,812][106226] Updated weights for policy 0, policy_version 642450 (0.0008) [2023-12-27 23:51:35,860][106226] Updated weights for policy 0, policy_version 642460 (0.0008) [2023-12-27 23:51:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 329506816. Throughput: 0: 9868.8, 1: 9658.7. Samples: 329514040. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-27 23:51:36,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.940')] [2023-12-27 23:51:36,509][106225] Updated weights for policy 1, policy_version 644395 (0.0006) [2023-12-27 23:51:36,567][106225] Updated weights for policy 1, policy_version 644405 (0.0009) [2023-12-27 23:51:36,586][106226] Updated weights for policy 0, policy_version 642470 (0.0007) [2023-12-27 23:51:36,628][106225] Updated weights for policy 1, policy_version 644415 (0.0007) [2023-12-27 23:51:36,641][106226] Updated weights for policy 0, policy_version 642480 (0.0006) [2023-12-27 23:51:36,696][106226] Updated weights for policy 0, policy_version 642490 (0.0007) [2023-12-27 23:51:37,392][106225] Updated weights for policy 1, policy_version 644425 (0.0008) [2023-12-27 23:51:37,420][106226] Updated weights for policy 0, policy_version 642500 (0.0008) [2023-12-27 23:51:37,446][106225] Updated weights for policy 1, policy_version 644435 (0.0008) [2023-12-27 23:51:37,480][106226] Updated weights for policy 0, policy_version 642510 (0.0006) [2023-12-27 23:51:37,501][106225] Updated weights for policy 1, policy_version 644445 (0.0005) [2023-12-27 23:51:37,528][106226] Updated weights for policy 0, policy_version 642520 (0.0005) [2023-12-27 23:51:37,561][106225] Updated weights for policy 1, policy_version 644455 (0.0009) [2023-12-27 23:51:38,151][106226] Updated weights for policy 0, policy_version 642530 (0.0006) [2023-12-27 23:51:38,215][106226] Updated weights for policy 0, policy_version 642540 (0.0005) [2023-12-27 23:51:38,274][106226] Updated weights for policy 0, policy_version 642550 (0.0006) [2023-12-27 23:51:38,295][106225] Updated weights for policy 1, policy_version 644465 (0.0007) [2023-12-27 23:51:38,330][106226] Updated weights for policy 0, policy_version 642560 (0.0007) [2023-12-27 23:51:38,352][106225] Updated weights for policy 1, policy_version 644475 (0.0008) [2023-12-27 23:51:38,414][106225] Updated weights for policy 1, policy_version 644485 (0.0009) [2023-12-27 23:51:39,060][106226] Updated weights for policy 0, policy_version 642570 (0.0010) [2023-12-27 23:51:39,104][106225] Updated weights for policy 1, policy_version 644495 (0.0007) [2023-12-27 23:51:39,119][106226] Updated weights for policy 0, policy_version 642580 (0.0007) [2023-12-27 23:51:39,159][106225] Updated weights for policy 1, policy_version 644505 (0.0006) [2023-12-27 23:51:39,181][106226] Updated weights for policy 0, policy_version 642590 (0.0008) [2023-12-27 23:51:39,218][106225] Updated weights for policy 1, policy_version 644515 (0.0006) [2023-12-27 23:51:39,945][106226] Updated weights for policy 0, policy_version 642600 (0.0009) [2023-12-27 23:51:40,014][106226] Updated weights for policy 0, policy_version 642610 (0.0006) [2023-12-27 23:51:40,069][106226] Updated weights for policy 0, policy_version 642620 (0.0006) [2023-12-27 23:51:40,071][106225] Updated weights for policy 1, policy_version 644525 (0.0008) [2023-12-27 23:51:40,129][106225] Updated weights for policy 1, policy_version 644535 (0.0007) [2023-12-27 23:51:40,195][106225] Updated weights for policy 1, policy_version 644545 (0.0007) [2023-12-27 23:51:40,743][106226] Updated weights for policy 0, policy_version 642630 (0.0007) [2023-12-27 23:51:40,793][106226] Updated weights for policy 0, policy_version 642640 (0.0009) [2023-12-27 23:51:40,851][106226] Updated weights for policy 0, policy_version 642650 (0.0008) [2023-12-27 23:51:40,896][106225] Updated weights for policy 1, policy_version 644555 (0.0007) [2023-12-27 23:51:40,956][106225] Updated weights for policy 1, policy_version 644565 (0.0008) [2023-12-27 23:51:41,014][106225] Updated weights for policy 1, policy_version 644575 (0.0008) [2023-12-27 23:51:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 329605120. Throughput: 0: 9879.3, 1: 9633.4. Samples: 329571756. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:51:41,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-5.800')] [2023-12-27 23:51:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000644584_165044224.pth... [2023-12-27 23:51:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000642656_164560896.pth... [2023-12-27 23:51:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000643464_164757504.pth [2023-12-27 23:51:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000641504_164265984.pth [2023-12-27 23:51:41,686][106226] Updated weights for policy 0, policy_version 642660 (0.0008) [2023-12-27 23:51:41,771][106226] Updated weights for policy 0, policy_version 642670 (0.0009) [2023-12-27 23:51:41,802][106225] Updated weights for policy 1, policy_version 644585 (0.0007) [2023-12-27 23:51:41,834][106226] Updated weights for policy 0, policy_version 642680 (0.0009) [2023-12-27 23:51:41,863][106225] Updated weights for policy 1, policy_version 644595 (0.0006) [2023-12-27 23:51:41,931][106225] Updated weights for policy 1, policy_version 644605 (0.0008) [2023-12-27 23:51:41,990][106225] Updated weights for policy 1, policy_version 644615 (0.0008) [2023-12-27 23:51:42,573][106226] Updated weights for policy 0, policy_version 642690 (0.0008) [2023-12-27 23:51:42,625][106226] Updated weights for policy 0, policy_version 642700 (0.0008) [2023-12-27 23:51:42,678][106226] Updated weights for policy 0, policy_version 642710 (0.0008) [2023-12-27 23:51:42,714][106225] Updated weights for policy 1, policy_version 644625 (0.0008) [2023-12-27 23:51:42,734][106226] Updated weights for policy 0, policy_version 642720 (0.0006) [2023-12-27 23:51:42,783][106225] Updated weights for policy 1, policy_version 644635 (0.0007) [2023-12-27 23:51:42,848][106225] Updated weights for policy 1, policy_version 644645 (0.0008) [2023-12-27 23:51:43,429][106225] Updated weights for policy 1, policy_version 644655 (0.0006) [2023-12-27 23:51:43,484][106225] Updated weights for policy 1, policy_version 644665 (0.0005) [2023-12-27 23:51:43,551][106225] Updated weights for policy 1, policy_version 644675 (0.0008) [2023-12-27 23:51:43,557][106226] Updated weights for policy 0, policy_version 642730 (0.0008) [2023-12-27 23:51:43,622][106226] Updated weights for policy 0, policy_version 642740 (0.0008) [2023-12-27 23:51:43,686][106226] Updated weights for policy 0, policy_version 642750 (0.0008) [2023-12-27 23:51:44,202][106225] Updated weights for policy 1, policy_version 644685 (0.0006) [2023-12-27 23:51:44,251][106225] Updated weights for policy 1, policy_version 644695 (0.0005) [2023-12-27 23:51:44,315][106225] Updated weights for policy 1, policy_version 644705 (0.0005) [2023-12-27 23:51:44,415][106226] Updated weights for policy 0, policy_version 642760 (0.0006) [2023-12-27 23:51:44,474][106226] Updated weights for policy 0, policy_version 642770 (0.0005) [2023-12-27 23:51:44,540][106226] Updated weights for policy 0, policy_version 642780 (0.0005) [2023-12-27 23:51:44,846][106225] Updated weights for policy 1, policy_version 644715 (0.0005) [2023-12-27 23:51:44,905][106225] Updated weights for policy 1, policy_version 644725 (0.0008) [2023-12-27 23:51:44,968][106225] Updated weights for policy 1, policy_version 644735 (0.0008) [2023-12-27 23:51:45,140][106226] Updated weights for policy 0, policy_version 642790 (0.0007) [2023-12-27 23:51:45,199][106226] Updated weights for policy 0, policy_version 642800 (0.0008) [2023-12-27 23:51:45,260][106226] Updated weights for policy 0, policy_version 642810 (0.0008) [2023-12-27 23:51:45,667][106225] Updated weights for policy 1, policy_version 644745 (0.0007) [2023-12-27 23:51:45,722][106225] Updated weights for policy 1, policy_version 644755 (0.0008) [2023-12-27 23:51:45,774][106225] Updated weights for policy 1, policy_version 644765 (0.0009) [2023-12-27 23:51:45,830][106225] Updated weights for policy 1, policy_version 644775 (0.0009) [2023-12-27 23:51:45,951][106226] Updated weights for policy 0, policy_version 642820 (0.0009) [2023-12-27 23:51:46,000][106226] Updated weights for policy 0, policy_version 642830 (0.0009) [2023-12-27 23:51:46,048][106226] Updated weights for policy 0, policy_version 642840 (0.0007) [2023-12-27 23:51:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 329703424. Throughput: 0: 9842.3, 1: 9658.6. Samples: 329688168. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:51:46,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-6.219')] [2023-12-27 23:51:46,451][106225] Updated weights for policy 1, policy_version 644785 (0.0006) [2023-12-27 23:51:46,518][106225] Updated weights for policy 1, policy_version 644795 (0.0007) [2023-12-27 23:51:46,576][106225] Updated weights for policy 1, policy_version 644805 (0.0009) [2023-12-27 23:51:46,812][106226] Updated weights for policy 0, policy_version 642851 (0.0008) [2023-12-27 23:51:46,870][106226] Updated weights for policy 0, policy_version 642861 (0.0005) [2023-12-27 23:51:46,927][106226] Updated weights for policy 0, policy_version 642871 (0.0005) [2023-12-27 23:51:47,216][106225] Updated weights for policy 1, policy_version 644815 (0.0006) [2023-12-27 23:51:47,269][106225] Updated weights for policy 1, policy_version 644825 (0.0005) [2023-12-27 23:51:47,323][106225] Updated weights for policy 1, policy_version 644835 (0.0005) [2023-12-27 23:51:47,541][106226] Updated weights for policy 0, policy_version 642881 (0.0006) [2023-12-27 23:51:47,601][106226] Updated weights for policy 0, policy_version 642891 (0.0011) [2023-12-27 23:51:47,668][106226] Updated weights for policy 0, policy_version 642901 (0.0010) [2023-12-27 23:51:47,731][106226] Updated weights for policy 0, policy_version 642911 (0.0009) [2023-12-27 23:51:47,846][106225] Updated weights for policy 1, policy_version 644845 (0.0008) [2023-12-27 23:51:47,906][106225] Updated weights for policy 1, policy_version 644855 (0.0010) [2023-12-27 23:51:47,965][106225] Updated weights for policy 1, policy_version 644865 (0.0006) [2023-12-27 23:51:48,461][106226] Updated weights for policy 0, policy_version 642921 (0.0010) [2023-12-27 23:51:48,524][106226] Updated weights for policy 0, policy_version 642931 (0.0011) [2023-12-27 23:51:48,534][106225] Updated weights for policy 1, policy_version 644875 (0.0005) [2023-12-27 23:51:48,585][106226] Updated weights for policy 0, policy_version 642941 (0.0011) [2023-12-27 23:51:48,586][106225] Updated weights for policy 1, policy_version 644885 (0.0007) [2023-12-27 23:51:48,645][106225] Updated weights for policy 1, policy_version 644895 (0.0008) [2023-12-27 23:51:49,307][106226] Updated weights for policy 0, policy_version 642951 (0.0008) [2023-12-27 23:51:49,374][106226] Updated weights for policy 0, policy_version 642961 (0.0010) [2023-12-27 23:51:49,391][106225] Updated weights for policy 1, policy_version 644905 (0.0008) [2023-12-27 23:51:49,442][106226] Updated weights for policy 0, policy_version 642971 (0.0013) [2023-12-27 23:51:49,444][106225] Updated weights for policy 1, policy_version 644915 (0.0006) [2023-12-27 23:51:49,498][106225] Updated weights for policy 1, policy_version 644925 (0.0006) [2023-12-27 23:51:49,562][106225] Updated weights for policy 1, policy_version 644935 (0.0008) [2023-12-27 23:51:50,145][106226] Updated weights for policy 0, policy_version 642981 (0.0008) [2023-12-27 23:51:50,206][106226] Updated weights for policy 0, policy_version 642991 (0.0005) [2023-12-27 23:51:50,266][106226] Updated weights for policy 0, policy_version 643001 (0.0006) [2023-12-27 23:51:50,320][106225] Updated weights for policy 1, policy_version 644945 (0.0008) [2023-12-27 23:51:50,375][106225] Updated weights for policy 1, policy_version 644955 (0.0008) [2023-12-27 23:51:50,431][106225] Updated weights for policy 1, policy_version 644965 (0.0008) [2023-12-27 23:51:50,839][106226] Updated weights for policy 0, policy_version 643011 (0.0006) [2023-12-27 23:51:50,898][106226] Updated weights for policy 0, policy_version 643021 (0.0007) [2023-12-27 23:51:50,967][106226] Updated weights for policy 0, policy_version 643031 (0.0006) [2023-12-27 23:51:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 329801728. Throughput: 0: 9843.4, 1: 9787.0. Samples: 329810576. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:51:51,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-5.605')] [2023-12-27 23:51:51,262][106225] Updated weights for policy 1, policy_version 644975 (0.0008) [2023-12-27 23:51:51,331][106225] Updated weights for policy 1, policy_version 644985 (0.0008) [2023-12-27 23:51:51,399][106225] Updated weights for policy 1, policy_version 644995 (0.0008) [2023-12-27 23:51:51,603][106226] Updated weights for policy 0, policy_version 643041 (0.0009) [2023-12-27 23:51:51,676][106226] Updated weights for policy 0, policy_version 643051 (0.0008) [2023-12-27 23:51:51,745][106226] Updated weights for policy 0, policy_version 643061 (0.0007) [2023-12-27 23:51:51,808][106226] Updated weights for policy 0, policy_version 643071 (0.0007) [2023-12-27 23:51:52,205][106225] Updated weights for policy 1, policy_version 645005 (0.0008) [2023-12-27 23:51:52,255][106225] Updated weights for policy 1, policy_version 645015 (0.0008) [2023-12-27 23:51:52,318][106225] Updated weights for policy 1, policy_version 645025 (0.0008) [2023-12-27 23:51:52,472][106226] Updated weights for policy 0, policy_version 643081 (0.0008) [2023-12-27 23:51:52,528][106226] Updated weights for policy 0, policy_version 643091 (0.0008) [2023-12-27 23:51:52,586][106226] Updated weights for policy 0, policy_version 643101 (0.0009) [2023-12-27 23:51:53,062][106225] Updated weights for policy 1, policy_version 645035 (0.0009) [2023-12-27 23:51:53,109][106225] Updated weights for policy 1, policy_version 645045 (0.0007) [2023-12-27 23:51:53,155][106225] Updated weights for policy 1, policy_version 645055 (0.0007) [2023-12-27 23:51:53,316][106226] Updated weights for policy 0, policy_version 643111 (0.0010) [2023-12-27 23:51:53,375][106226] Updated weights for policy 0, policy_version 643121 (0.0010) [2023-12-27 23:51:53,428][106226] Updated weights for policy 0, policy_version 643131 (0.0008) [2023-12-27 23:51:53,891][106225] Updated weights for policy 1, policy_version 645065 (0.0006) [2023-12-27 23:51:53,943][106225] Updated weights for policy 1, policy_version 645075 (0.0008) [2023-12-27 23:51:53,999][106225] Updated weights for policy 1, policy_version 645085 (0.0008) [2023-12-27 23:51:54,022][106226] Updated weights for policy 0, policy_version 643141 (0.0006) [2023-12-27 23:51:54,054][106225] Updated weights for policy 1, policy_version 645095 (0.0007) [2023-12-27 23:51:54,073][106226] Updated weights for policy 0, policy_version 643151 (0.0007) [2023-12-27 23:51:54,128][106226] Updated weights for policy 0, policy_version 643161 (0.0008) [2023-12-27 23:51:54,695][106225] Updated weights for policy 1, policy_version 645105 (0.0008) [2023-12-27 23:51:54,747][106225] Updated weights for policy 1, policy_version 645115 (0.0007) [2023-12-27 23:51:54,809][106225] Updated weights for policy 1, policy_version 645125 (0.0006) [2023-12-27 23:51:54,906][106226] Updated weights for policy 0, policy_version 643171 (0.0009) [2023-12-27 23:51:54,959][106226] Updated weights for policy 0, policy_version 643181 (0.0010) [2023-12-27 23:51:55,018][106226] Updated weights for policy 0, policy_version 643191 (0.0011) [2023-12-27 23:51:55,353][106225] Updated weights for policy 1, policy_version 645135 (0.0009) [2023-12-27 23:51:55,403][106225] Updated weights for policy 1, policy_version 645145 (0.0008) [2023-12-27 23:51:55,452][106225] Updated weights for policy 1, policy_version 645155 (0.0008) [2023-12-27 23:51:55,654][106226] Updated weights for policy 0, policy_version 643201 (0.0010) [2023-12-27 23:51:55,716][106226] Updated weights for policy 0, policy_version 643211 (0.0008) [2023-12-27 23:51:55,783][106226] Updated weights for policy 0, policy_version 643221 (0.0008) [2023-12-27 23:51:55,847][106226] Updated weights for policy 0, policy_version 643231 (0.0009) [2023-12-27 23:51:56,170][106225] Updated weights for policy 1, policy_version 645165 (0.0008) [2023-12-27 23:51:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 329900032. Throughput: 0: 9878.5, 1: 9759.0. Samples: 329869844. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:51:56,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-6.102')] [2023-12-27 23:51:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000643232_164708352.pth... [2023-12-27 23:51:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000642080_164413440.pth [2023-12-27 23:51:56,231][106225] Updated weights for policy 1, policy_version 645175 (0.0007) [2023-12-27 23:51:56,279][106225] Updated weights for policy 1, policy_version 645185 (0.0008) [2023-12-27 23:51:56,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000645192_165199872.pth... [2023-12-27 23:51:56,317][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000644008_164896768.pth [2023-12-27 23:51:56,502][106226] Updated weights for policy 0, policy_version 643241 (0.0006) [2023-12-27 23:51:56,555][106226] Updated weights for policy 0, policy_version 643251 (0.0007) [2023-12-27 23:51:56,605][106226] Updated weights for policy 0, policy_version 643261 (0.0008) [2023-12-27 23:51:57,010][106225] Updated weights for policy 1, policy_version 645195 (0.0009) [2023-12-27 23:51:57,074][106225] Updated weights for policy 1, policy_version 645205 (0.0010) [2023-12-27 23:51:57,126][106225] Updated weights for policy 1, policy_version 645215 (0.0010) [2023-12-27 23:51:57,296][106226] Updated weights for policy 0, policy_version 643271 (0.0008) [2023-12-27 23:51:57,348][106226] Updated weights for policy 0, policy_version 643281 (0.0007) [2023-12-27 23:51:57,404][106226] Updated weights for policy 0, policy_version 643291 (0.0006) [2023-12-27 23:51:57,815][106225] Updated weights for policy 1, policy_version 645225 (0.0010) [2023-12-27 23:51:57,862][106225] Updated weights for policy 1, policy_version 645235 (0.0005) [2023-12-27 23:51:57,910][106225] Updated weights for policy 1, policy_version 645245 (0.0005) [2023-12-27 23:51:57,970][106225] Updated weights for policy 1, policy_version 645255 (0.0005) [2023-12-27 23:51:58,124][106226] Updated weights for policy 0, policy_version 643301 (0.0006) [2023-12-27 23:51:58,182][106226] Updated weights for policy 0, policy_version 643311 (0.0005) [2023-12-27 23:51:58,246][106226] Updated weights for policy 0, policy_version 643321 (0.0007) [2023-12-27 23:51:58,683][106225] Updated weights for policy 1, policy_version 645265 (0.0009) [2023-12-27 23:51:58,741][106225] Updated weights for policy 1, policy_version 645275 (0.0009) [2023-12-27 23:51:58,813][106225] Updated weights for policy 1, policy_version 645285 (0.0010) [2023-12-27 23:51:59,041][106226] Updated weights for policy 0, policy_version 643331 (0.0008) [2023-12-27 23:51:59,106][106226] Updated weights for policy 0, policy_version 643341 (0.0009) [2023-12-27 23:51:59,163][106226] Updated weights for policy 0, policy_version 643351 (0.0008) [2023-12-27 23:51:59,568][106225] Updated weights for policy 1, policy_version 645295 (0.0007) [2023-12-27 23:51:59,634][106225] Updated weights for policy 1, policy_version 645305 (0.0008) [2023-12-27 23:51:59,695][106225] Updated weights for policy 1, policy_version 645315 (0.0010) [2023-12-27 23:51:59,881][106226] Updated weights for policy 0, policy_version 643361 (0.0007) [2023-12-27 23:51:59,949][106226] Updated weights for policy 0, policy_version 643371 (0.0007) [2023-12-27 23:52:00,007][106226] Updated weights for policy 0, policy_version 643381 (0.0010) [2023-12-27 23:52:00,061][106226] Updated weights for policy 0, policy_version 643391 (0.0009) [2023-12-27 23:52:00,326][106225] Updated weights for policy 1, policy_version 645325 (0.0010) [2023-12-27 23:52:00,387][106225] Updated weights for policy 1, policy_version 645335 (0.0010) [2023-12-27 23:52:00,441][106225] Updated weights for policy 1, policy_version 645345 (0.0009) [2023-12-27 23:52:00,858][106226] Updated weights for policy 0, policy_version 643401 (0.0009) [2023-12-27 23:52:00,917][106226] Updated weights for policy 0, policy_version 643411 (0.0009) [2023-12-27 23:52:00,981][106226] Updated weights for policy 0, policy_version 643421 (0.0009) [2023-12-27 23:52:01,086][106225] Updated weights for policy 1, policy_version 645355 (0.0007) [2023-12-27 23:52:01,151][106225] Updated weights for policy 1, policy_version 645365 (0.0006) [2023-12-27 23:52:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 329998336. Throughput: 0: 9933.1, 1: 9838.0. Samples: 329988992. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:01,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-6.003')] [2023-12-27 23:52:01,210][106225] Updated weights for policy 1, policy_version 645375 (0.0008) [2023-12-27 23:52:01,706][106226] Updated weights for policy 0, policy_version 643431 (0.0009) [2023-12-27 23:52:01,768][106226] Updated weights for policy 0, policy_version 643441 (0.0008) [2023-12-27 23:52:01,832][106226] Updated weights for policy 0, policy_version 643451 (0.0007) [2023-12-27 23:52:01,925][106225] Updated weights for policy 1, policy_version 645385 (0.0010) [2023-12-27 23:52:01,970][106225] Updated weights for policy 1, policy_version 645395 (0.0009) [2023-12-27 23:52:02,030][106225] Updated weights for policy 1, policy_version 645405 (0.0010) [2023-12-27 23:52:02,083][106225] Updated weights for policy 1, policy_version 645415 (0.0010) [2023-12-27 23:52:02,587][106226] Updated weights for policy 0, policy_version 643461 (0.0008) [2023-12-27 23:52:02,647][106226] Updated weights for policy 0, policy_version 643471 (0.0008) [2023-12-27 23:52:02,708][106226] Updated weights for policy 0, policy_version 643481 (0.0008) [2023-12-27 23:52:02,833][106225] Updated weights for policy 1, policy_version 645425 (0.0010) [2023-12-27 23:52:02,895][106225] Updated weights for policy 1, policy_version 645435 (0.0010) [2023-12-27 23:52:02,954][106225] Updated weights for policy 1, policy_version 645445 (0.0010) [2023-12-27 23:52:03,461][106226] Updated weights for policy 0, policy_version 643491 (0.0008) [2023-12-27 23:52:03,528][106226] Updated weights for policy 0, policy_version 643501 (0.0008) [2023-12-27 23:52:03,583][106226] Updated weights for policy 0, policy_version 643511 (0.0008) [2023-12-27 23:52:03,620][106225] Updated weights for policy 1, policy_version 645455 (0.0007) [2023-12-27 23:52:03,682][106225] Updated weights for policy 1, policy_version 645465 (0.0008) [2023-12-27 23:52:03,746][106225] Updated weights for policy 1, policy_version 645475 (0.0008) [2023-12-27 23:52:04,314][106226] Updated weights for policy 0, policy_version 643521 (0.0007) [2023-12-27 23:52:04,377][106226] Updated weights for policy 0, policy_version 643531 (0.0008) [2023-12-27 23:52:04,414][106225] Updated weights for policy 1, policy_version 645485 (0.0007) [2023-12-27 23:52:04,452][106226] Updated weights for policy 0, policy_version 643541 (0.0007) [2023-12-27 23:52:04,475][106225] Updated weights for policy 1, policy_version 645495 (0.0009) [2023-12-27 23:52:04,498][106226] Updated weights for policy 0, policy_version 643551 (0.0007) [2023-12-27 23:52:04,535][106225] Updated weights for policy 1, policy_version 645505 (0.0008) [2023-12-27 23:52:05,208][106226] Updated weights for policy 0, policy_version 643561 (0.0009) [2023-12-27 23:52:05,261][106226] Updated weights for policy 0, policy_version 643571 (0.0007) [2023-12-27 23:52:05,262][106225] Updated weights for policy 1, policy_version 645515 (0.0008) [2023-12-27 23:52:05,311][106225] Updated weights for policy 1, policy_version 645525 (0.0007) [2023-12-27 23:52:05,321][106226] Updated weights for policy 0, policy_version 643581 (0.0007) [2023-12-27 23:52:05,371][106225] Updated weights for policy 1, policy_version 645535 (0.0007) [2023-12-27 23:52:05,987][106225] Updated weights for policy 1, policy_version 645545 (0.0005) [2023-12-27 23:52:06,043][106225] Updated weights for policy 1, policy_version 645555 (0.0005) [2023-12-27 23:52:06,095][106226] Updated weights for policy 0, policy_version 643591 (0.0009) [2023-12-27 23:52:06,096][106225] Updated weights for policy 1, policy_version 645565 (0.0006) [2023-12-27 23:52:06,156][106226] Updated weights for policy 0, policy_version 643601 (0.0008) [2023-12-27 23:52:06,164][106225] Updated weights for policy 1, policy_version 645575 (0.0007) [2023-12-27 23:52:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 330096640. Throughput: 0: 9810.9, 1: 9893.5. Samples: 330105892. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:06,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-6.315')] [2023-12-27 23:52:06,218][106226] Updated weights for policy 0, policy_version 643611 (0.0009) [2023-12-27 23:52:06,837][106225] Updated weights for policy 1, policy_version 645585 (0.0008) [2023-12-27 23:52:06,905][106225] Updated weights for policy 1, policy_version 645595 (0.0008) [2023-12-27 23:52:06,971][106225] Updated weights for policy 1, policy_version 645605 (0.0008) [2023-12-27 23:52:07,002][106226] Updated weights for policy 0, policy_version 643621 (0.0008) [2023-12-27 23:52:07,051][106226] Updated weights for policy 0, policy_version 643631 (0.0008) [2023-12-27 23:52:07,104][106226] Updated weights for policy 0, policy_version 643641 (0.0009) [2023-12-27 23:52:07,644][106225] Updated weights for policy 1, policy_version 645615 (0.0006) [2023-12-27 23:52:07,704][106225] Updated weights for policy 1, policy_version 645625 (0.0005) [2023-12-27 23:52:07,767][106225] Updated weights for policy 1, policy_version 645635 (0.0006) [2023-12-27 23:52:07,843][106226] Updated weights for policy 0, policy_version 643651 (0.0008) [2023-12-27 23:52:07,906][106226] Updated weights for policy 0, policy_version 643661 (0.0005) [2023-12-27 23:52:07,965][106226] Updated weights for policy 0, policy_version 643671 (0.0006) [2023-12-27 23:52:08,352][106225] Updated weights for policy 1, policy_version 645645 (0.0008) [2023-12-27 23:52:08,409][106225] Updated weights for policy 1, policy_version 645655 (0.0008) [2023-12-27 23:52:08,469][106225] Updated weights for policy 1, policy_version 645665 (0.0009) [2023-12-27 23:52:08,690][106226] Updated weights for policy 0, policy_version 643681 (0.0009) [2023-12-27 23:52:08,756][106226] Updated weights for policy 0, policy_version 643691 (0.0009) [2023-12-27 23:52:08,820][106226] Updated weights for policy 0, policy_version 643701 (0.0010) [2023-12-27 23:52:08,881][106226] Updated weights for policy 0, policy_version 643711 (0.0010) [2023-12-27 23:52:09,093][106225] Updated weights for policy 1, policy_version 645675 (0.0008) [2023-12-27 23:52:09,157][106225] Updated weights for policy 1, policy_version 645685 (0.0006) [2023-12-27 23:52:09,215][106225] Updated weights for policy 1, policy_version 645695 (0.0006) [2023-12-27 23:52:09,706][106226] Updated weights for policy 0, policy_version 643721 (0.0008) [2023-12-27 23:52:09,763][106226] Updated weights for policy 0, policy_version 643731 (0.0009) [2023-12-27 23:52:09,829][106226] Updated weights for policy 0, policy_version 643741 (0.0009) [2023-12-27 23:52:09,900][106225] Updated weights for policy 1, policy_version 645705 (0.0009) [2023-12-27 23:52:09,964][106225] Updated weights for policy 1, policy_version 645715 (0.0009) [2023-12-27 23:52:10,018][106225] Updated weights for policy 1, policy_version 645725 (0.0009) [2023-12-27 23:52:10,078][106225] Updated weights for policy 1, policy_version 645735 (0.0006) [2023-12-27 23:52:10,626][106226] Updated weights for policy 0, policy_version 643751 (0.0009) [2023-12-27 23:52:10,683][106226] Updated weights for policy 0, policy_version 643761 (0.0006) [2023-12-27 23:52:10,749][106226] Updated weights for policy 0, policy_version 643771 (0.0005) [2023-12-27 23:52:10,762][106225] Updated weights for policy 1, policy_version 645745 (0.0010) [2023-12-27 23:52:10,820][106225] Updated weights for policy 1, policy_version 645755 (0.0010) [2023-12-27 23:52:10,875][106225] Updated weights for policy 1, policy_version 645765 (0.0010) [2023-12-27 23:52:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 330194944. Throughput: 0: 9781.9, 1: 9936.7. Samples: 330164512. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:11,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-5.984')] [2023-12-27 23:52:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000645768_165347328.pth... [2023-12-27 23:52:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000643776_164847616.pth... [2023-12-27 23:52:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000644584_165044224.pth [2023-12-27 23:52:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000642656_164560896.pth [2023-12-27 23:52:11,429][106226] Updated weights for policy 0, policy_version 643781 (0.0007) [2023-12-27 23:52:11,482][106226] Updated weights for policy 0, policy_version 643791 (0.0008) [2023-12-27 23:52:11,544][106226] Updated weights for policy 0, policy_version 643801 (0.0008) [2023-12-27 23:52:11,642][106225] Updated weights for policy 1, policy_version 645775 (0.0009) [2023-12-27 23:52:11,700][106225] Updated weights for policy 1, policy_version 645785 (0.0008) [2023-12-27 23:52:11,765][106225] Updated weights for policy 1, policy_version 645795 (0.0008) [2023-12-27 23:52:12,319][106226] Updated weights for policy 0, policy_version 643811 (0.0008) [2023-12-27 23:52:12,391][106226] Updated weights for policy 0, policy_version 643821 (0.0008) [2023-12-27 23:52:12,455][106226] Updated weights for policy 0, policy_version 643831 (0.0008) [2023-12-27 23:52:12,468][106225] Updated weights for policy 1, policy_version 645805 (0.0006) [2023-12-27 23:52:12,532][106225] Updated weights for policy 1, policy_version 645815 (0.0008) [2023-12-27 23:52:12,600][106225] Updated weights for policy 1, policy_version 645825 (0.0007) [2023-12-27 23:52:13,125][106226] Updated weights for policy 0, policy_version 643841 (0.0006) [2023-12-27 23:52:13,180][106226] Updated weights for policy 0, policy_version 643851 (0.0008) [2023-12-27 23:52:13,238][106226] Updated weights for policy 0, policy_version 643861 (0.0008) [2023-12-27 23:52:13,297][106226] Updated weights for policy 0, policy_version 643871 (0.0008) [2023-12-27 23:52:13,319][106225] Updated weights for policy 1, policy_version 645835 (0.0008) [2023-12-27 23:52:13,379][106225] Updated weights for policy 1, policy_version 645845 (0.0010) [2023-12-27 23:52:13,439][106225] Updated weights for policy 1, policy_version 645855 (0.0010) [2023-12-27 23:52:14,007][106226] Updated weights for policy 0, policy_version 643881 (0.0008) [2023-12-27 23:52:14,056][106226] Updated weights for policy 0, policy_version 643891 (0.0010) [2023-12-27 23:52:14,101][106226] Updated weights for policy 0, policy_version 643901 (0.0006) [2023-12-27 23:52:14,109][106225] Updated weights for policy 1, policy_version 645865 (0.0010) [2023-12-27 23:52:14,162][106225] Updated weights for policy 1, policy_version 645875 (0.0010) [2023-12-27 23:52:14,220][106225] Updated weights for policy 1, policy_version 645885 (0.0010) [2023-12-27 23:52:14,281][106225] Updated weights for policy 1, policy_version 645895 (0.0010) [2023-12-27 23:52:14,807][106226] Updated weights for policy 0, policy_version 643911 (0.0008) [2023-12-27 23:52:14,865][106226] Updated weights for policy 0, policy_version 643921 (0.0006) [2023-12-27 23:52:14,927][106226] Updated weights for policy 0, policy_version 643931 (0.0006) [2023-12-27 23:52:15,016][106225] Updated weights for policy 1, policy_version 645905 (0.0008) [2023-12-27 23:52:15,084][106225] Updated weights for policy 1, policy_version 645915 (0.0006) [2023-12-27 23:52:15,145][106225] Updated weights for policy 1, policy_version 645925 (0.0006) [2023-12-27 23:52:15,624][106226] Updated weights for policy 0, policy_version 643941 (0.0009) [2023-12-27 23:52:15,681][106226] Updated weights for policy 0, policy_version 643951 (0.0011) [2023-12-27 23:52:15,743][106226] Updated weights for policy 0, policy_version 643961 (0.0011) [2023-12-27 23:52:15,745][106225] Updated weights for policy 1, policy_version 645935 (0.0006) [2023-12-27 23:52:15,801][106225] Updated weights for policy 1, policy_version 645945 (0.0006) [2023-12-27 23:52:15,859][106225] Updated weights for policy 1, policy_version 645955 (0.0006) [2023-12-27 23:52:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 330293248. Throughput: 0: 9646.9, 1: 9965.6. Samples: 330280948. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:16,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-6.003')] [2023-12-27 23:52:16,449][106226] Updated weights for policy 0, policy_version 643971 (0.0009) [2023-12-27 23:52:16,518][106226] Updated weights for policy 0, policy_version 643981 (0.0007) [2023-12-27 23:52:16,528][106225] Updated weights for policy 1, policy_version 645965 (0.0007) [2023-12-27 23:52:16,576][106226] Updated weights for policy 0, policy_version 643991 (0.0009) [2023-12-27 23:52:16,582][106225] Updated weights for policy 1, policy_version 645975 (0.0007) [2023-12-27 23:52:16,642][106225] Updated weights for policy 1, policy_version 645985 (0.0007) [2023-12-27 23:52:17,240][106226] Updated weights for policy 0, policy_version 644001 (0.0006) [2023-12-27 23:52:17,290][106226] Updated weights for policy 0, policy_version 644011 (0.0009) [2023-12-27 23:52:17,339][106226] Updated weights for policy 0, policy_version 644021 (0.0010) [2023-12-27 23:52:17,359][106225] Updated weights for policy 1, policy_version 645995 (0.0007) [2023-12-27 23:52:17,392][106226] Updated weights for policy 0, policy_version 644031 (0.0008) [2023-12-27 23:52:17,416][106225] Updated weights for policy 1, policy_version 646005 (0.0005) [2023-12-27 23:52:17,479][106225] Updated weights for policy 1, policy_version 646015 (0.0006) [2023-12-27 23:52:18,055][106225] Updated weights for policy 1, policy_version 646025 (0.0007) [2023-12-27 23:52:18,105][106225] Updated weights for policy 1, policy_version 646035 (0.0010) [2023-12-27 23:52:18,155][106225] Updated weights for policy 1, policy_version 646045 (0.0010) [2023-12-27 23:52:18,186][106226] Updated weights for policy 0, policy_version 644041 (0.0007) [2023-12-27 23:52:18,207][106225] Updated weights for policy 1, policy_version 646055 (0.0007) [2023-12-27 23:52:18,252][106226] Updated weights for policy 0, policy_version 644051 (0.0009) [2023-12-27 23:52:18,312][106226] Updated weights for policy 0, policy_version 644061 (0.0009) [2023-12-27 23:52:18,925][106225] Updated weights for policy 1, policy_version 646065 (0.0009) [2023-12-27 23:52:18,987][106225] Updated weights for policy 1, policy_version 646075 (0.0008) [2023-12-27 23:52:19,045][106225] Updated weights for policy 1, policy_version 646085 (0.0007) [2023-12-27 23:52:19,055][106226] Updated weights for policy 0, policy_version 644071 (0.0006) [2023-12-27 23:52:19,106][106226] Updated weights for policy 0, policy_version 644081 (0.0008) [2023-12-27 23:52:19,157][106226] Updated weights for policy 0, policy_version 644091 (0.0008) [2023-12-27 23:52:19,836][106225] Updated weights for policy 1, policy_version 646095 (0.0007) [2023-12-27 23:52:19,901][106225] Updated weights for policy 1, policy_version 646105 (0.0007) [2023-12-27 23:52:19,918][106226] Updated weights for policy 0, policy_version 644101 (0.0008) [2023-12-27 23:52:19,971][106225] Updated weights for policy 1, policy_version 646115 (0.0007) [2023-12-27 23:52:19,985][106226] Updated weights for policy 0, policy_version 644111 (0.0008) [2023-12-27 23:52:20,043][106226] Updated weights for policy 0, policy_version 644121 (0.0009) [2023-12-27 23:52:20,577][106225] Updated weights for policy 1, policy_version 646125 (0.0007) [2023-12-27 23:52:20,651][106225] Updated weights for policy 1, policy_version 646135 (0.0006) [2023-12-27 23:52:20,720][106225] Updated weights for policy 1, policy_version 646145 (0.0007) [2023-12-27 23:52:20,828][106226] Updated weights for policy 0, policy_version 644131 (0.0009) [2023-12-27 23:52:20,889][106226] Updated weights for policy 0, policy_version 644141 (0.0008) [2023-12-27 23:52:20,948][106226] Updated weights for policy 0, policy_version 644151 (0.0010) [2023-12-27 23:52:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 330391552. Throughput: 0: 9621.7, 1: 10036.2. Samples: 330398648. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:21,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.931')] [2023-12-27 23:52:21,361][106225] Updated weights for policy 1, policy_version 646155 (0.0008) [2023-12-27 23:52:21,431][106225] Updated weights for policy 1, policy_version 646165 (0.0008) [2023-12-27 23:52:21,497][106225] Updated weights for policy 1, policy_version 646175 (0.0008) [2023-12-27 23:52:21,724][106226] Updated weights for policy 0, policy_version 644161 (0.0008) [2023-12-27 23:52:21,786][106226] Updated weights for policy 0, policy_version 644171 (0.0007) [2023-12-27 23:52:21,849][106226] Updated weights for policy 0, policy_version 644181 (0.0006) [2023-12-27 23:52:21,915][106226] Updated weights for policy 0, policy_version 644191 (0.0008) [2023-12-27 23:52:22,241][106225] Updated weights for policy 1, policy_version 646185 (0.0009) [2023-12-27 23:52:22,304][106225] Updated weights for policy 1, policy_version 646195 (0.0009) [2023-12-27 23:52:22,373][106225] Updated weights for policy 1, policy_version 646205 (0.0008) [2023-12-27 23:52:22,441][106225] Updated weights for policy 1, policy_version 646215 (0.0008) [2023-12-27 23:52:22,673][106226] Updated weights for policy 0, policy_version 644201 (0.0009) [2023-12-27 23:52:22,735][106226] Updated weights for policy 0, policy_version 644211 (0.0007) [2023-12-27 23:52:22,789][106226] Updated weights for policy 0, policy_version 644221 (0.0005) [2023-12-27 23:52:23,158][106225] Updated weights for policy 1, policy_version 646225 (0.0009) [2023-12-27 23:52:23,217][106225] Updated weights for policy 1, policy_version 646235 (0.0009) [2023-12-27 23:52:23,274][106225] Updated weights for policy 1, policy_version 646245 (0.0009) [2023-12-27 23:52:23,383][106226] Updated weights for policy 0, policy_version 644231 (0.0008) [2023-12-27 23:52:23,442][106226] Updated weights for policy 0, policy_version 644241 (0.0008) [2023-12-27 23:52:23,506][106226] Updated weights for policy 0, policy_version 644251 (0.0008) [2023-12-27 23:52:23,999][106225] Updated weights for policy 1, policy_version 646255 (0.0009) [2023-12-27 23:52:24,051][106225] Updated weights for policy 1, policy_version 646265 (0.0009) [2023-12-27 23:52:24,106][106225] Updated weights for policy 1, policy_version 646275 (0.0008) [2023-12-27 23:52:24,209][106226] Updated weights for policy 0, policy_version 644261 (0.0008) [2023-12-27 23:52:24,278][106226] Updated weights for policy 0, policy_version 644271 (0.0009) [2023-12-27 23:52:24,343][106226] Updated weights for policy 0, policy_version 644281 (0.0009) [2023-12-27 23:52:24,856][106225] Updated weights for policy 1, policy_version 646285 (0.0009) [2023-12-27 23:52:24,901][106225] Updated weights for policy 1, policy_version 646295 (0.0009) [2023-12-27 23:52:24,964][106225] Updated weights for policy 1, policy_version 646305 (0.0010) [2023-12-27 23:52:24,974][106226] Updated weights for policy 0, policy_version 644291 (0.0007) [2023-12-27 23:52:25,026][106226] Updated weights for policy 0, policy_version 644301 (0.0009) [2023-12-27 23:52:25,071][106226] Updated weights for policy 0, policy_version 644311 (0.0007) [2023-12-27 23:52:25,701][106225] Updated weights for policy 1, policy_version 646315 (0.0009) [2023-12-27 23:52:25,754][106225] Updated weights for policy 1, policy_version 646325 (0.0010) [2023-12-27 23:52:25,811][106226] Updated weights for policy 0, policy_version 644321 (0.0008) [2023-12-27 23:52:25,813][106225] Updated weights for policy 1, policy_version 646335 (0.0010) [2023-12-27 23:52:25,865][106226] Updated weights for policy 0, policy_version 644331 (0.0006) [2023-12-27 23:52:25,930][106226] Updated weights for policy 0, policy_version 644341 (0.0008) [2023-12-27 23:52:25,993][106226] Updated weights for policy 0, policy_version 644351 (0.0008) [2023-12-27 23:52:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 330489856. Throughput: 0: 9619.1, 1: 10050.1. Samples: 330456872. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:26,176][105115] Avg episode reward: [(0, '-4.459'), (1, '-5.854')] [2023-12-27 23:52:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000644352_164995072.pth... [2023-12-27 23:52:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000646344_165494784.pth... [2023-12-27 23:52:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000643232_164708352.pth [2023-12-27 23:52:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000645192_165199872.pth [2023-12-27 23:52:26,540][106225] Updated weights for policy 1, policy_version 646345 (0.0010) [2023-12-27 23:52:26,588][106225] Updated weights for policy 1, policy_version 646355 (0.0010) [2023-12-27 23:52:26,644][106225] Updated weights for policy 1, policy_version 646365 (0.0010) [2023-12-27 23:52:26,696][106225] Updated weights for policy 1, policy_version 646375 (0.0010) [2023-12-27 23:52:26,717][106226] Updated weights for policy 0, policy_version 644361 (0.0006) [2023-12-27 23:52:26,762][106226] Updated weights for policy 0, policy_version 644371 (0.0007) [2023-12-27 23:52:26,807][106226] Updated weights for policy 0, policy_version 644381 (0.0007) [2023-12-27 23:52:27,413][106225] Updated weights for policy 1, policy_version 646385 (0.0010) [2023-12-27 23:52:27,462][106225] Updated weights for policy 1, policy_version 646395 (0.0010) [2023-12-27 23:52:27,510][106225] Updated weights for policy 1, policy_version 646405 (0.0010) [2023-12-27 23:52:27,557][106226] Updated weights for policy 0, policy_version 644391 (0.0007) [2023-12-27 23:52:27,615][106226] Updated weights for policy 0, policy_version 644401 (0.0008) [2023-12-27 23:52:27,665][106226] Updated weights for policy 0, policy_version 644411 (0.0008) [2023-12-27 23:52:28,241][106225] Updated weights for policy 1, policy_version 646415 (0.0010) [2023-12-27 23:52:28,291][106225] Updated weights for policy 1, policy_version 646425 (0.0010) [2023-12-27 23:52:28,343][106225] Updated weights for policy 1, policy_version 646435 (0.0010) [2023-12-27 23:52:28,393][106226] Updated weights for policy 0, policy_version 644421 (0.0008) [2023-12-27 23:52:28,457][106226] Updated weights for policy 0, policy_version 644431 (0.0008) [2023-12-27 23:52:28,519][106226] Updated weights for policy 0, policy_version 644441 (0.0008) [2023-12-27 23:52:29,084][106225] Updated weights for policy 1, policy_version 646445 (0.0010) [2023-12-27 23:52:29,134][106225] Updated weights for policy 1, policy_version 646455 (0.0010) [2023-12-27 23:52:29,164][106226] Updated weights for policy 0, policy_version 644451 (0.0007) [2023-12-27 23:52:29,192][106225] Updated weights for policy 1, policy_version 646465 (0.0010) [2023-12-27 23:52:29,213][106226] Updated weights for policy 0, policy_version 644461 (0.0005) [2023-12-27 23:52:29,277][106226] Updated weights for policy 0, policy_version 644471 (0.0007) [2023-12-27 23:52:29,910][106226] Updated weights for policy 0, policy_version 644481 (0.0006) [2023-12-27 23:52:29,946][106225] Updated weights for policy 1, policy_version 646475 (0.0008) [2023-12-27 23:52:29,978][106226] Updated weights for policy 0, policy_version 644491 (0.0009) [2023-12-27 23:52:30,005][106225] Updated weights for policy 1, policy_version 646485 (0.0008) [2023-12-27 23:52:30,034][106226] Updated weights for policy 0, policy_version 644501 (0.0006) [2023-12-27 23:52:30,066][106225] Updated weights for policy 1, policy_version 646495 (0.0007) [2023-12-27 23:52:30,090][106226] Updated weights for policy 0, policy_version 644511 (0.0006) [2023-12-27 23:52:30,696][106226] Updated weights for policy 0, policy_version 644522 (0.0008) [2023-12-27 23:52:30,762][106226] Updated weights for policy 0, policy_version 644532 (0.0005) [2023-12-27 23:52:30,765][106225] Updated weights for policy 1, policy_version 646505 (0.0006) [2023-12-27 23:52:30,820][106225] Updated weights for policy 1, policy_version 646515 (0.0007) [2023-12-27 23:52:30,827][106226] Updated weights for policy 0, policy_version 644542 (0.0007) [2023-12-27 23:52:30,876][106225] Updated weights for policy 1, policy_version 646525 (0.0010) [2023-12-27 23:52:30,919][106225] Updated weights for policy 1, policy_version 646535 (0.0005) [2023-12-27 23:52:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 330588160. Throughput: 0: 9701.8, 1: 9987.8. Samples: 330574200. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:31,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-5.620')] [2023-12-27 23:52:31,472][106226] Updated weights for policy 0, policy_version 644552 (0.0007) [2023-12-27 23:52:31,518][106226] Updated weights for policy 0, policy_version 644562 (0.0007) [2023-12-27 23:52:31,561][106226] Updated weights for policy 0, policy_version 644572 (0.0007) [2023-12-27 23:52:31,564][106225] Updated weights for policy 1, policy_version 646545 (0.0008) [2023-12-27 23:52:31,617][106225] Updated weights for policy 1, policy_version 646555 (0.0008) [2023-12-27 23:52:31,682][106225] Updated weights for policy 1, policy_version 646565 (0.0008) [2023-12-27 23:52:32,327][106226] Updated weights for policy 0, policy_version 644582 (0.0009) [2023-12-27 23:52:32,383][106225] Updated weights for policy 1, policy_version 646575 (0.0007) [2023-12-27 23:52:32,396][106226] Updated weights for policy 0, policy_version 644592 (0.0008) [2023-12-27 23:52:32,441][106225] Updated weights for policy 1, policy_version 646585 (0.0008) [2023-12-27 23:52:32,461][106226] Updated weights for policy 0, policy_version 644602 (0.0006) [2023-12-27 23:52:32,493][106225] Updated weights for policy 1, policy_version 646595 (0.0008) [2023-12-27 23:52:33,102][106226] Updated weights for policy 0, policy_version 644612 (0.0005) [2023-12-27 23:52:33,151][106226] Updated weights for policy 0, policy_version 644622 (0.0005) [2023-12-27 23:52:33,153][106225] Updated weights for policy 1, policy_version 646605 (0.0007) [2023-12-27 23:52:33,195][106226] Updated weights for policy 0, policy_version 644632 (0.0005) [2023-12-27 23:52:33,220][106225] Updated weights for policy 1, policy_version 646615 (0.0008) [2023-12-27 23:52:33,287][106225] Updated weights for policy 1, policy_version 646625 (0.0005) [2023-12-27 23:52:33,729][106226] Updated weights for policy 0, policy_version 644642 (0.0007) [2023-12-27 23:52:33,793][106226] Updated weights for policy 0, policy_version 644652 (0.0005) [2023-12-27 23:52:33,814][106225] Updated weights for policy 1, policy_version 646635 (0.0007) [2023-12-27 23:52:33,852][106226] Updated weights for policy 0, policy_version 644662 (0.0006) [2023-12-27 23:52:33,882][106225] Updated weights for policy 1, policy_version 646645 (0.0010) [2023-12-27 23:52:33,913][106226] Updated weights for policy 0, policy_version 644672 (0.0005) [2023-12-27 23:52:33,945][106225] Updated weights for policy 1, policy_version 646655 (0.0010) [2023-12-27 23:52:34,602][106226] Updated weights for policy 0, policy_version 644682 (0.0009) [2023-12-27 23:52:34,654][106226] Updated weights for policy 0, policy_version 644692 (0.0008) [2023-12-27 23:52:34,690][106225] Updated weights for policy 1, policy_version 646665 (0.0010) [2023-12-27 23:52:34,708][106226] Updated weights for policy 0, policy_version 644702 (0.0008) [2023-12-27 23:52:34,750][106225] Updated weights for policy 1, policy_version 646675 (0.0006) [2023-12-27 23:52:34,809][106225] Updated weights for policy 1, policy_version 646685 (0.0005) [2023-12-27 23:52:34,868][106225] Updated weights for policy 1, policy_version 646695 (0.0005) [2023-12-27 23:52:35,471][106226] Updated weights for policy 0, policy_version 644712 (0.0008) [2023-12-27 23:52:35,530][106226] Updated weights for policy 0, policy_version 644722 (0.0007) [2023-12-27 23:52:35,551][106225] Updated weights for policy 1, policy_version 646705 (0.0006) [2023-12-27 23:52:35,589][106226] Updated weights for policy 0, policy_version 644732 (0.0006) [2023-12-27 23:52:35,610][106225] Updated weights for policy 1, policy_version 646715 (0.0007) [2023-12-27 23:52:35,662][106225] Updated weights for policy 1, policy_version 646725 (0.0008) [2023-12-27 23:52:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 330686464. Throughput: 0: 9755.4, 1: 9964.3. Samples: 330697960. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:36,176][105115] Avg episode reward: [(0, '-4.355'), (1, '-5.789')] [2023-12-27 23:52:36,304][106226] Updated weights for policy 0, policy_version 644742 (0.0007) [2023-12-27 23:52:36,367][106226] Updated weights for policy 0, policy_version 644752 (0.0009) [2023-12-27 23:52:36,372][106225] Updated weights for policy 1, policy_version 646735 (0.0007) [2023-12-27 23:52:36,433][106225] Updated weights for policy 1, policy_version 646745 (0.0006) [2023-12-27 23:52:36,435][106226] Updated weights for policy 0, policy_version 644762 (0.0008) [2023-12-27 23:52:36,495][106225] Updated weights for policy 1, policy_version 646755 (0.0007) [2023-12-27 23:52:37,187][106225] Updated weights for policy 1, policy_version 646765 (0.0006) [2023-12-27 23:52:37,189][106226] Updated weights for policy 0, policy_version 644772 (0.0008) [2023-12-27 23:52:37,241][106226] Updated weights for policy 0, policy_version 644782 (0.0006) [2023-12-27 23:52:37,246][106225] Updated weights for policy 1, policy_version 646775 (0.0007) [2023-12-27 23:52:37,302][106226] Updated weights for policy 0, policy_version 644792 (0.0006) [2023-12-27 23:52:37,309][106225] Updated weights for policy 1, policy_version 646785 (0.0006) [2023-12-27 23:52:37,974][106226] Updated weights for policy 0, policy_version 644802 (0.0005) [2023-12-27 23:52:37,982][106225] Updated weights for policy 1, policy_version 646795 (0.0009) [2023-12-27 23:52:38,041][106225] Updated weights for policy 1, policy_version 646805 (0.0007) [2023-12-27 23:52:38,042][106226] Updated weights for policy 0, policy_version 644812 (0.0006) [2023-12-27 23:52:38,100][106226] Updated weights for policy 0, policy_version 644822 (0.0005) [2023-12-27 23:52:38,102][106225] Updated weights for policy 1, policy_version 646815 (0.0010) [2023-12-27 23:52:38,161][106226] Updated weights for policy 0, policy_version 644832 (0.0005) [2023-12-27 23:52:38,729][106226] Updated weights for policy 0, policy_version 644842 (0.0007) [2023-12-27 23:52:38,746][106225] Updated weights for policy 1, policy_version 646825 (0.0010) [2023-12-27 23:52:38,789][106226] Updated weights for policy 0, policy_version 644852 (0.0005) [2023-12-27 23:52:38,810][106225] Updated weights for policy 1, policy_version 646835 (0.0009) [2023-12-27 23:52:38,851][106226] Updated weights for policy 0, policy_version 644862 (0.0006) [2023-12-27 23:52:38,877][106225] Updated weights for policy 1, policy_version 646845 (0.0007) [2023-12-27 23:52:38,942][106225] Updated weights for policy 1, policy_version 646855 (0.0006) [2023-12-27 23:52:39,419][106226] Updated weights for policy 0, policy_version 644872 (0.0009) [2023-12-27 23:52:39,484][106226] Updated weights for policy 0, policy_version 644882 (0.0006) [2023-12-27 23:52:39,553][106226] Updated weights for policy 0, policy_version 644892 (0.0008) [2023-12-27 23:52:39,588][106225] Updated weights for policy 1, policy_version 646865 (0.0009) [2023-12-27 23:52:39,642][106225] Updated weights for policy 1, policy_version 646875 (0.0007) [2023-12-27 23:52:39,703][106225] Updated weights for policy 1, policy_version 646885 (0.0010) [2023-12-27 23:52:40,277][106226] Updated weights for policy 0, policy_version 644902 (0.0009) [2023-12-27 23:52:40,345][106226] Updated weights for policy 0, policy_version 644912 (0.0009) [2023-12-27 23:52:40,417][106226] Updated weights for policy 0, policy_version 644922 (0.0008) [2023-12-27 23:52:40,435][106225] Updated weights for policy 1, policy_version 646895 (0.0007) [2023-12-27 23:52:40,503][106225] Updated weights for policy 1, policy_version 646905 (0.0006) [2023-12-27 23:52:40,564][106225] Updated weights for policy 1, policy_version 646915 (0.0005) [2023-12-27 23:52:41,095][106225] Updated weights for policy 1, policy_version 646925 (0.0006) [2023-12-27 23:52:41,167][106225] Updated weights for policy 1, policy_version 646935 (0.0008) [2023-12-27 23:52:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 330784768. Throughput: 0: 9750.5, 1: 10016.1. Samples: 330759340. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:41,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-5.887')] [2023-12-27 23:52:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000644928_165142528.pth... [2023-12-27 23:52:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000643776_164847616.pth [2023-12-27 23:52:41,233][106225] Updated weights for policy 1, policy_version 646945 (0.0007) [2023-12-27 23:52:41,256][106226] Updated weights for policy 0, policy_version 644932 (0.0008) [2023-12-27 23:52:41,281][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000646952_165650432.pth... [2023-12-27 23:52:41,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000645768_165347328.pth [2023-12-27 23:52:41,318][106226] Updated weights for policy 0, policy_version 644942 (0.0007) [2023-12-27 23:52:41,385][106226] Updated weights for policy 0, policy_version 644952 (0.0009) [2023-12-27 23:52:42,056][106225] Updated weights for policy 1, policy_version 646955 (0.0008) [2023-12-27 23:52:42,114][106225] Updated weights for policy 1, policy_version 646965 (0.0007) [2023-12-27 23:52:42,173][106225] Updated weights for policy 1, policy_version 646975 (0.0008) [2023-12-27 23:52:42,202][106226] Updated weights for policy 0, policy_version 644962 (0.0009) [2023-12-27 23:52:42,257][106226] Updated weights for policy 0, policy_version 644972 (0.0011) [2023-12-27 23:52:42,319][106226] Updated weights for policy 0, policy_version 644982 (0.0010) [2023-12-27 23:52:42,381][106226] Updated weights for policy 0, policy_version 644992 (0.0009) [2023-12-27 23:52:42,884][106225] Updated weights for policy 1, policy_version 646985 (0.0007) [2023-12-27 23:52:42,946][106225] Updated weights for policy 1, policy_version 646995 (0.0008) [2023-12-27 23:52:42,995][106225] Updated weights for policy 1, policy_version 647005 (0.0009) [2023-12-27 23:52:43,048][106225] Updated weights for policy 1, policy_version 647015 (0.0009) [2023-12-27 23:52:43,067][106226] Updated weights for policy 0, policy_version 645002 (0.0007) [2023-12-27 23:52:43,126][106226] Updated weights for policy 0, policy_version 645012 (0.0007) [2023-12-27 23:52:43,182][106226] Updated weights for policy 0, policy_version 645022 (0.0005) [2023-12-27 23:52:43,789][106226] Updated weights for policy 0, policy_version 645032 (0.0006) [2023-12-27 23:52:43,835][106225] Updated weights for policy 1, policy_version 647025 (0.0007) [2023-12-27 23:52:43,848][106226] Updated weights for policy 0, policy_version 645042 (0.0006) [2023-12-27 23:52:43,886][106225] Updated weights for policy 1, policy_version 647035 (0.0006) [2023-12-27 23:52:43,904][106226] Updated weights for policy 0, policy_version 645052 (0.0007) [2023-12-27 23:52:43,937][106225] Updated weights for policy 1, policy_version 647045 (0.0006) [2023-12-27 23:52:44,544][106226] Updated weights for policy 0, policy_version 645062 (0.0007) [2023-12-27 23:52:44,569][106225] Updated weights for policy 1, policy_version 647055 (0.0006) [2023-12-27 23:52:44,594][106226] Updated weights for policy 0, policy_version 645072 (0.0007) [2023-12-27 23:52:44,622][106225] Updated weights for policy 1, policy_version 647065 (0.0010) [2023-12-27 23:52:44,649][106226] Updated weights for policy 0, policy_version 645082 (0.0006) [2023-12-27 23:52:44,677][106225] Updated weights for policy 1, policy_version 647075 (0.0007) [2023-12-27 23:52:45,347][106225] Updated weights for policy 1, policy_version 647085 (0.0007) [2023-12-27 23:52:45,398][106226] Updated weights for policy 0, policy_version 645092 (0.0009) [2023-12-27 23:52:45,404][106225] Updated weights for policy 1, policy_version 647095 (0.0006) [2023-12-27 23:52:45,457][106226] Updated weights for policy 0, policy_version 645102 (0.0009) [2023-12-27 23:52:45,463][106225] Updated weights for policy 1, policy_version 647105 (0.0005) [2023-12-27 23:52:45,506][106226] Updated weights for policy 0, policy_version 645112 (0.0006) [2023-12-27 23:52:46,037][106225] Updated weights for policy 1, policy_version 647115 (0.0007) [2023-12-27 23:52:46,100][106225] Updated weights for policy 1, policy_version 647125 (0.0007) [2023-12-27 23:52:46,116][106226] Updated weights for policy 0, policy_version 645122 (0.0006) [2023-12-27 23:52:46,147][106225] Updated weights for policy 1, policy_version 647135 (0.0006) [2023-12-27 23:52:46,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 330883072. Throughput: 0: 9740.2, 1: 9995.8. Samples: 330877108. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:46,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-6.651')] [2023-12-27 23:52:46,175][106226] Updated weights for policy 0, policy_version 645132 (0.0008) [2023-12-27 23:52:46,228][106226] Updated weights for policy 0, policy_version 645142 (0.0008) [2023-12-27 23:52:46,288][106226] Updated weights for policy 0, policy_version 645152 (0.0007) [2023-12-27 23:52:46,855][106225] Updated weights for policy 1, policy_version 647145 (0.0008) [2023-12-27 23:52:46,912][106225] Updated weights for policy 1, policy_version 647155 (0.0011) [2023-12-27 23:52:46,970][106225] Updated weights for policy 1, policy_version 647165 (0.0010) [2023-12-27 23:52:47,020][106225] Updated weights for policy 1, policy_version 647175 (0.0010) [2023-12-27 23:52:47,030][106226] Updated weights for policy 0, policy_version 645162 (0.0008) [2023-12-27 23:52:47,094][106226] Updated weights for policy 0, policy_version 645172 (0.0008) [2023-12-27 23:52:47,160][106226] Updated weights for policy 0, policy_version 645182 (0.0006) [2023-12-27 23:52:47,717][106225] Updated weights for policy 1, policy_version 647185 (0.0010) [2023-12-27 23:52:47,778][106225] Updated weights for policy 1, policy_version 647195 (0.0010) [2023-12-27 23:52:47,835][106225] Updated weights for policy 1, policy_version 647205 (0.0010) [2023-12-27 23:52:47,884][106226] Updated weights for policy 0, policy_version 645192 (0.0007) [2023-12-27 23:52:47,948][106226] Updated weights for policy 0, policy_version 645202 (0.0006) [2023-12-27 23:52:48,014][106226] Updated weights for policy 0, policy_version 645212 (0.0010) [2023-12-27 23:52:48,494][106225] Updated weights for policy 1, policy_version 647215 (0.0010) [2023-12-27 23:52:48,548][106225] Updated weights for policy 1, policy_version 647225 (0.0010) [2023-12-27 23:52:48,605][106225] Updated weights for policy 1, policy_version 647235 (0.0010) [2023-12-27 23:52:48,648][106226] Updated weights for policy 0, policy_version 645222 (0.0009) [2023-12-27 23:52:48,709][106226] Updated weights for policy 0, policy_version 645232 (0.0009) [2023-12-27 23:52:48,769][106226] Updated weights for policy 0, policy_version 645242 (0.0010) [2023-12-27 23:52:49,300][106225] Updated weights for policy 1, policy_version 647245 (0.0008) [2023-12-27 23:52:49,363][106225] Updated weights for policy 1, policy_version 647255 (0.0009) [2023-12-27 23:52:49,424][106225] Updated weights for policy 1, policy_version 647265 (0.0009) [2023-12-27 23:52:49,533][106226] Updated weights for policy 0, policy_version 645252 (0.0008) [2023-12-27 23:52:49,600][106226] Updated weights for policy 0, policy_version 645262 (0.0007) [2023-12-27 23:52:49,669][106226] Updated weights for policy 0, policy_version 645272 (0.0007) [2023-12-27 23:52:50,146][106225] Updated weights for policy 1, policy_version 647275 (0.0007) [2023-12-27 23:52:50,210][106225] Updated weights for policy 1, policy_version 647285 (0.0009) [2023-12-27 23:52:50,267][106225] Updated weights for policy 1, policy_version 647295 (0.0008) [2023-12-27 23:52:50,371][106226] Updated weights for policy 0, policy_version 645282 (0.0009) [2023-12-27 23:52:50,444][106226] Updated weights for policy 0, policy_version 645292 (0.0005) [2023-12-27 23:52:50,501][106226] Updated weights for policy 0, policy_version 645302 (0.0005) [2023-12-27 23:52:50,566][106226] Updated weights for policy 0, policy_version 645312 (0.0008) [2023-12-27 23:52:50,996][106225] Updated weights for policy 1, policy_version 647305 (0.0009) [2023-12-27 23:52:51,065][106225] Updated weights for policy 1, policy_version 647315 (0.0007) [2023-12-27 23:52:51,132][106225] Updated weights for policy 1, policy_version 647325 (0.0008) [2023-12-27 23:52:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 330981376. Throughput: 0: 9798.5, 1: 9990.3. Samples: 330996388. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:51,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-5.784')] [2023-12-27 23:52:51,194][106225] Updated weights for policy 1, policy_version 647335 (0.0008) [2023-12-27 23:52:51,272][106226] Updated weights for policy 0, policy_version 645322 (0.0008) [2023-12-27 23:52:51,336][106226] Updated weights for policy 0, policy_version 645332 (0.0007) [2023-12-27 23:52:51,406][106226] Updated weights for policy 0, policy_version 645342 (0.0009) [2023-12-27 23:52:51,942][106225] Updated weights for policy 1, policy_version 647345 (0.0009) [2023-12-27 23:52:51,988][106225] Updated weights for policy 1, policy_version 647355 (0.0009) [2023-12-27 23:52:52,041][106225] Updated weights for policy 1, policy_version 647365 (0.0008) [2023-12-27 23:52:52,162][106226] Updated weights for policy 0, policy_version 645352 (0.0010) [2023-12-27 23:52:52,214][106226] Updated weights for policy 0, policy_version 645362 (0.0010) [2023-12-27 23:52:52,273][106226] Updated weights for policy 0, policy_version 645372 (0.0011) [2023-12-27 23:52:52,772][106225] Updated weights for policy 1, policy_version 647375 (0.0009) [2023-12-27 23:52:52,835][106225] Updated weights for policy 1, policy_version 647385 (0.0007) [2023-12-27 23:52:52,898][106225] Updated weights for policy 1, policy_version 647395 (0.0005) [2023-12-27 23:52:52,917][106226] Updated weights for policy 0, policy_version 645382 (0.0010) [2023-12-27 23:52:52,977][106226] Updated weights for policy 0, policy_version 645392 (0.0010) [2023-12-27 23:52:53,034][106226] Updated weights for policy 0, policy_version 645402 (0.0011) [2023-12-27 23:52:53,505][106225] Updated weights for policy 1, policy_version 647405 (0.0006) [2023-12-27 23:52:53,553][106225] Updated weights for policy 1, policy_version 647415 (0.0005) [2023-12-27 23:52:53,621][106225] Updated weights for policy 1, policy_version 647425 (0.0005) [2023-12-27 23:52:53,625][106226] Updated weights for policy 0, policy_version 645412 (0.0010) [2023-12-27 23:52:53,689][106226] Updated weights for policy 0, policy_version 645422 (0.0010) [2023-12-27 23:52:53,748][106226] Updated weights for policy 0, policy_version 645432 (0.0010) [2023-12-27 23:52:54,168][106225] Updated weights for policy 1, policy_version 647435 (0.0007) [2023-12-27 23:52:54,218][106225] Updated weights for policy 1, policy_version 647445 (0.0010) [2023-12-27 23:52:54,264][106225] Updated weights for policy 1, policy_version 647455 (0.0010) [2023-12-27 23:52:54,322][106226] Updated weights for policy 0, policy_version 645442 (0.0010) [2023-12-27 23:52:54,383][106226] Updated weights for policy 0, policy_version 645452 (0.0008) [2023-12-27 23:52:54,445][106226] Updated weights for policy 0, policy_version 645462 (0.0007) [2023-12-27 23:52:54,506][106226] Updated weights for policy 0, policy_version 645472 (0.0008) [2023-12-27 23:52:54,940][106225] Updated weights for policy 1, policy_version 647465 (0.0008) [2023-12-27 23:52:54,997][106225] Updated weights for policy 1, policy_version 647475 (0.0007) [2023-12-27 23:52:55,054][106225] Updated weights for policy 1, policy_version 647485 (0.0008) [2023-12-27 23:52:55,091][106226] Updated weights for policy 0, policy_version 645482 (0.0007) [2023-12-27 23:52:55,097][106225] Updated weights for policy 1, policy_version 647495 (0.0005) [2023-12-27 23:52:55,150][106226] Updated weights for policy 0, policy_version 645492 (0.0007) [2023-12-27 23:52:55,208][106226] Updated weights for policy 0, policy_version 645502 (0.0008) [2023-12-27 23:52:55,861][106226] Updated weights for policy 0, policy_version 645512 (0.0006) [2023-12-27 23:52:55,862][106225] Updated weights for policy 1, policy_version 647505 (0.0008) [2023-12-27 23:52:55,920][106226] Updated weights for policy 0, policy_version 645522 (0.0005) [2023-12-27 23:52:55,929][106225] Updated weights for policy 1, policy_version 647515 (0.0009) [2023-12-27 23:52:55,977][106226] Updated weights for policy 0, policy_version 645532 (0.0006) [2023-12-27 23:52:55,986][106225] Updated weights for policy 1, policy_version 647525 (0.0008) [2023-12-27 23:52:56,175][105115] Fps is (10 sec: 21298.5, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 331096064. Throughput: 0: 9874.1, 1: 9987.6. Samples: 331058292. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:52:56,176][105115] Avg episode reward: [(0, '-4.554'), (1, '-6.425')] [2023-12-27 23:52:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000647528_165797888.pth... [2023-12-27 23:52:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000645536_165298176.pth... [2023-12-27 23:52:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000646344_165494784.pth [2023-12-27 23:52:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000644352_164995072.pth [2023-12-27 23:52:56,557][106226] Updated weights for policy 0, policy_version 645542 (0.0006) [2023-12-27 23:52:56,621][106226] Updated weights for policy 0, policy_version 645552 (0.0006) [2023-12-27 23:52:56,680][106226] Updated weights for policy 0, policy_version 645562 (0.0009) [2023-12-27 23:52:56,747][106225] Updated weights for policy 1, policy_version 647535 (0.0007) [2023-12-27 23:52:56,795][106225] Updated weights for policy 1, policy_version 647545 (0.0008) [2023-12-27 23:52:56,839][106225] Updated weights for policy 1, policy_version 647555 (0.0008) [2023-12-27 23:52:57,300][106226] Updated weights for policy 0, policy_version 645572 (0.0007) [2023-12-27 23:52:57,355][106226] Updated weights for policy 0, policy_version 645582 (0.0009) [2023-12-27 23:52:57,413][106226] Updated weights for policy 0, policy_version 645592 (0.0008) [2023-12-27 23:52:57,647][106225] Updated weights for policy 1, policy_version 647565 (0.0009) [2023-12-27 23:52:57,704][106225] Updated weights for policy 1, policy_version 647575 (0.0009) [2023-12-27 23:52:57,757][106225] Updated weights for policy 1, policy_version 647585 (0.0008) [2023-12-27 23:52:57,940][106226] Updated weights for policy 0, policy_version 645602 (0.0005) [2023-12-27 23:52:57,993][106226] Updated weights for policy 0, policy_version 645612 (0.0005) [2023-12-27 23:52:58,041][106226] Updated weights for policy 0, policy_version 645622 (0.0005) [2023-12-27 23:52:58,088][106226] Updated weights for policy 0, policy_version 645632 (0.0008) [2023-12-27 23:52:58,574][106225] Updated weights for policy 1, policy_version 647595 (0.0008) [2023-12-27 23:52:58,644][106225] Updated weights for policy 1, policy_version 647605 (0.0006) [2023-12-27 23:52:58,713][106225] Updated weights for policy 1, policy_version 647615 (0.0007) [2023-12-27 23:52:58,897][106226] Updated weights for policy 0, policy_version 645642 (0.0011) [2023-12-27 23:52:58,969][106226] Updated weights for policy 0, policy_version 645652 (0.0008) [2023-12-27 23:52:59,034][106226] Updated weights for policy 0, policy_version 645662 (0.0007) [2023-12-27 23:52:59,470][106225] Updated weights for policy 1, policy_version 647625 (0.0007) [2023-12-27 23:52:59,528][106225] Updated weights for policy 1, policy_version 647635 (0.0006) [2023-12-27 23:52:59,582][106225] Updated weights for policy 1, policy_version 647645 (0.0005) [2023-12-27 23:52:59,636][106225] Updated weights for policy 1, policy_version 647655 (0.0006) [2023-12-27 23:52:59,757][106226] Updated weights for policy 0, policy_version 645672 (0.0011) [2023-12-27 23:52:59,814][106226] Updated weights for policy 0, policy_version 645682 (0.0011) [2023-12-27 23:52:59,880][106226] Updated weights for policy 0, policy_version 645692 (0.0008) [2023-12-27 23:53:00,322][106225] Updated weights for policy 1, policy_version 647665 (0.0008) [2023-12-27 23:53:00,384][106225] Updated weights for policy 1, policy_version 647675 (0.0008) [2023-12-27 23:53:00,450][106225] Updated weights for policy 1, policy_version 647685 (0.0005) [2023-12-27 23:53:00,605][106226] Updated weights for policy 0, policy_version 645702 (0.0007) [2023-12-27 23:53:00,657][106226] Updated weights for policy 0, policy_version 645712 (0.0008) [2023-12-27 23:53:00,713][106226] Updated weights for policy 0, policy_version 645722 (0.0008) [2023-12-27 23:53:01,114][106225] Updated weights for policy 1, policy_version 647695 (0.0008) [2023-12-27 23:53:01,175][106225] Updated weights for policy 1, policy_version 647705 (0.0008) [2023-12-27 23:53:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 331186176. Throughput: 0: 10022.8, 1: 9923.2. Samples: 331178520. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:53:01,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-5.966')] [2023-12-27 23:53:01,234][106225] Updated weights for policy 1, policy_version 647715 (0.0007) [2023-12-27 23:53:01,384][106226] Updated weights for policy 0, policy_version 645732 (0.0009) [2023-12-27 23:53:01,449][106226] Updated weights for policy 0, policy_version 645742 (0.0006) [2023-12-27 23:53:01,506][106226] Updated weights for policy 0, policy_version 645752 (0.0006) [2023-12-27 23:53:02,007][106225] Updated weights for policy 1, policy_version 647725 (0.0007) [2023-12-27 23:53:02,056][106225] Updated weights for policy 1, policy_version 647735 (0.0008) [2023-12-27 23:53:02,108][106225] Updated weights for policy 1, policy_version 647745 (0.0007) [2023-12-27 23:53:02,110][106226] Updated weights for policy 0, policy_version 645762 (0.0007) [2023-12-27 23:53:02,160][106226] Updated weights for policy 0, policy_version 645772 (0.0008) [2023-12-27 23:53:02,211][106226] Updated weights for policy 0, policy_version 645782 (0.0007) [2023-12-27 23:53:02,273][106226] Updated weights for policy 0, policy_version 645792 (0.0007) [2023-12-27 23:53:02,859][106225] Updated weights for policy 1, policy_version 647755 (0.0007) [2023-12-27 23:53:02,883][106226] Updated weights for policy 0, policy_version 645802 (0.0006) [2023-12-27 23:53:02,914][106225] Updated weights for policy 1, policy_version 647765 (0.0009) [2023-12-27 23:53:02,942][106226] Updated weights for policy 0, policy_version 645812 (0.0007) [2023-12-27 23:53:02,975][106225] Updated weights for policy 1, policy_version 647775 (0.0008) [2023-12-27 23:53:03,002][106226] Updated weights for policy 0, policy_version 645822 (0.0006) [2023-12-27 23:53:03,652][106226] Updated weights for policy 0, policy_version 645832 (0.0008) [2023-12-27 23:53:03,701][106226] Updated weights for policy 0, policy_version 645842 (0.0006) [2023-12-27 23:53:03,716][106225] Updated weights for policy 1, policy_version 647785 (0.0007) [2023-12-27 23:53:03,747][106226] Updated weights for policy 0, policy_version 645852 (0.0007) [2023-12-27 23:53:03,776][106225] Updated weights for policy 1, policy_version 647795 (0.0006) [2023-12-27 23:53:03,830][106225] Updated weights for policy 1, policy_version 647805 (0.0008) [2023-12-27 23:53:03,896][106225] Updated weights for policy 1, policy_version 647815 (0.0007) [2023-12-27 23:53:04,470][106226] Updated weights for policy 0, policy_version 645862 (0.0008) [2023-12-27 23:53:04,534][106226] Updated weights for policy 0, policy_version 645872 (0.0009) [2023-12-27 23:53:04,602][106226] Updated weights for policy 0, policy_version 645882 (0.0008) [2023-12-27 23:53:04,645][106225] Updated weights for policy 1, policy_version 647825 (0.0010) [2023-12-27 23:53:04,707][106225] Updated weights for policy 1, policy_version 647835 (0.0009) [2023-12-27 23:53:04,763][106225] Updated weights for policy 1, policy_version 647845 (0.0009) [2023-12-27 23:53:05,311][106226] Updated weights for policy 0, policy_version 645892 (0.0007) [2023-12-27 23:53:05,362][106226] Updated weights for policy 0, policy_version 645902 (0.0010) [2023-12-27 23:53:05,415][106226] Updated weights for policy 0, policy_version 645912 (0.0010) [2023-12-27 23:53:05,477][106225] Updated weights for policy 1, policy_version 647855 (0.0008) [2023-12-27 23:53:05,522][106225] Updated weights for policy 1, policy_version 647865 (0.0007) [2023-12-27 23:53:05,575][106225] Updated weights for policy 1, policy_version 647875 (0.0008) [2023-12-27 23:53:06,173][106226] Updated weights for policy 0, policy_version 645922 (0.0010) [2023-12-27 23:53:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 331284480. Throughput: 0: 10130.5, 1: 9827.9. Samples: 331296776. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:53:06,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-5.824')] [2023-12-27 23:53:06,240][106226] Updated weights for policy 0, policy_version 645932 (0.0009) [2023-12-27 23:53:06,300][106226] Updated weights for policy 0, policy_version 645942 (0.0009) [2023-12-27 23:53:06,356][106225] Updated weights for policy 1, policy_version 647885 (0.0006) [2023-12-27 23:53:06,365][106226] Updated weights for policy 0, policy_version 645952 (0.0011) [2023-12-27 23:53:06,410][106225] Updated weights for policy 1, policy_version 647895 (0.0008) [2023-12-27 23:53:06,464][106225] Updated weights for policy 1, policy_version 647905 (0.0008) [2023-12-27 23:53:07,036][106226] Updated weights for policy 0, policy_version 645962 (0.0009) [2023-12-27 23:53:07,100][106226] Updated weights for policy 0, policy_version 645972 (0.0006) [2023-12-27 23:53:07,160][106226] Updated weights for policy 0, policy_version 645982 (0.0006) [2023-12-27 23:53:07,251][106225] Updated weights for policy 1, policy_version 647915 (0.0007) [2023-12-27 23:53:07,318][106225] Updated weights for policy 1, policy_version 647925 (0.0009) [2023-12-27 23:53:07,387][106225] Updated weights for policy 1, policy_version 647935 (0.0010) [2023-12-27 23:53:07,722][106226] Updated weights for policy 0, policy_version 645992 (0.0006) [2023-12-27 23:53:07,781][106226] Updated weights for policy 0, policy_version 646002 (0.0007) [2023-12-27 23:53:07,864][106226] Updated weights for policy 0, policy_version 646012 (0.0011) [2023-12-27 23:53:08,161][106225] Updated weights for policy 1, policy_version 647945 (0.0010) [2023-12-27 23:53:08,213][106225] Updated weights for policy 1, policy_version 647955 (0.0008) [2023-12-27 23:53:08,272][106225] Updated weights for policy 1, policy_version 647965 (0.0006) [2023-12-27 23:53:08,330][106225] Updated weights for policy 1, policy_version 647975 (0.0008) [2023-12-27 23:53:08,445][106226] Updated weights for policy 0, policy_version 646022 (0.0008) [2023-12-27 23:53:08,501][106226] Updated weights for policy 0, policy_version 646032 (0.0006) [2023-12-27 23:53:08,566][106226] Updated weights for policy 0, policy_version 646042 (0.0006) [2023-12-27 23:53:08,990][106225] Updated weights for policy 1, policy_version 647985 (0.0008) [2023-12-27 23:53:09,045][106225] Updated weights for policy 1, policy_version 647995 (0.0005) [2023-12-27 23:53:09,097][106225] Updated weights for policy 1, policy_version 648005 (0.0008) [2023-12-27 23:53:09,162][106226] Updated weights for policy 0, policy_version 646052 (0.0008) [2023-12-27 23:53:09,216][106226] Updated weights for policy 0, policy_version 646062 (0.0010) [2023-12-27 23:53:09,281][106226] Updated weights for policy 0, policy_version 646072 (0.0007) [2023-12-27 23:53:09,855][106225] Updated weights for policy 1, policy_version 648015 (0.0009) [2023-12-27 23:53:09,908][106225] Updated weights for policy 1, policy_version 648025 (0.0008) [2023-12-27 23:53:09,972][106225] Updated weights for policy 1, policy_version 648035 (0.0008) [2023-12-27 23:53:09,980][106226] Updated weights for policy 0, policy_version 646082 (0.0008) [2023-12-27 23:53:10,039][106226] Updated weights for policy 0, policy_version 646092 (0.0009) [2023-12-27 23:53:10,099][106226] Updated weights for policy 0, policy_version 646102 (0.0009) [2023-12-27 23:53:10,160][106226] Updated weights for policy 0, policy_version 646112 (0.0008) [2023-12-27 23:53:10,730][106225] Updated weights for policy 1, policy_version 648045 (0.0007) [2023-12-27 23:53:10,797][106225] Updated weights for policy 1, policy_version 648055 (0.0005) [2023-12-27 23:53:10,859][106225] Updated weights for policy 1, policy_version 648065 (0.0005) [2023-12-27 23:53:10,865][106226] Updated weights for policy 0, policy_version 646122 (0.0009) [2023-12-27 23:53:10,915][106226] Updated weights for policy 0, policy_version 646132 (0.0008) [2023-12-27 23:53:10,973][106226] Updated weights for policy 0, policy_version 646142 (0.0006) [2023-12-27 23:53:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 331390976. Throughput: 0: 10197.9, 1: 9810.8. Samples: 331357260. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:53:11,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.765')] [2023-12-27 23:53:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000646144_165453824.pth... [2023-12-27 23:53:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000648072_165937152.pth... [2023-12-27 23:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000644928_165142528.pth [2023-12-27 23:53:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000646952_165650432.pth [2023-12-27 23:53:11,523][106225] Updated weights for policy 1, policy_version 648075 (0.0007) [2023-12-27 23:53:11,578][106225] Updated weights for policy 1, policy_version 648085 (0.0008) [2023-12-27 23:53:11,636][106225] Updated weights for policy 1, policy_version 648095 (0.0008) [2023-12-27 23:53:11,802][106226] Updated weights for policy 0, policy_version 646152 (0.0008) [2023-12-27 23:53:11,865][106226] Updated weights for policy 0, policy_version 646162 (0.0009) [2023-12-27 23:53:11,919][106226] Updated weights for policy 0, policy_version 646172 (0.0008) [2023-12-27 23:53:12,390][106225] Updated weights for policy 1, policy_version 648105 (0.0009) [2023-12-27 23:53:12,445][106225] Updated weights for policy 1, policy_version 648115 (0.0008) [2023-12-27 23:53:12,494][106225] Updated weights for policy 1, policy_version 648125 (0.0008) [2023-12-27 23:53:12,550][106225] Updated weights for policy 1, policy_version 648135 (0.0008) [2023-12-27 23:53:12,687][106226] Updated weights for policy 0, policy_version 646182 (0.0006) [2023-12-27 23:53:12,744][106226] Updated weights for policy 0, policy_version 646192 (0.0005) [2023-12-27 23:53:12,806][106226] Updated weights for policy 0, policy_version 646202 (0.0006) [2023-12-27 23:53:13,355][106225] Updated weights for policy 1, policy_version 648145 (0.0008) [2023-12-27 23:53:13,400][106226] Updated weights for policy 0, policy_version 646212 (0.0009) [2023-12-27 23:53:13,410][106225] Updated weights for policy 1, policy_version 648155 (0.0006) [2023-12-27 23:53:13,462][106226] Updated weights for policy 0, policy_version 646222 (0.0007) [2023-12-27 23:53:13,463][106225] Updated weights for policy 1, policy_version 648165 (0.0007) [2023-12-27 23:53:13,524][106226] Updated weights for policy 0, policy_version 646232 (0.0006) [2023-12-27 23:53:14,172][106226] Updated weights for policy 0, policy_version 646242 (0.0009) [2023-12-27 23:53:14,222][106225] Updated weights for policy 1, policy_version 648175 (0.0009) [2023-12-27 23:53:14,231][106226] Updated weights for policy 0, policy_version 646252 (0.0007) [2023-12-27 23:53:14,269][106225] Updated weights for policy 1, policy_version 648185 (0.0007) [2023-12-27 23:53:14,283][106226] Updated weights for policy 0, policy_version 646262 (0.0006) [2023-12-27 23:53:14,326][106225] Updated weights for policy 1, policy_version 648195 (0.0007) [2023-12-27 23:53:14,335][106226] Updated weights for policy 0, policy_version 646272 (0.0008) [2023-12-27 23:53:14,986][106226] Updated weights for policy 0, policy_version 646282 (0.0009) [2023-12-27 23:53:15,048][106226] Updated weights for policy 0, policy_version 646292 (0.0007) [2023-12-27 23:53:15,105][106225] Updated weights for policy 1, policy_version 648205 (0.0008) [2023-12-27 23:53:15,116][106226] Updated weights for policy 0, policy_version 646302 (0.0006) [2023-12-27 23:53:15,157][106225] Updated weights for policy 1, policy_version 648215 (0.0007) [2023-12-27 23:53:15,215][106225] Updated weights for policy 1, policy_version 648225 (0.0009) [2023-12-27 23:53:15,809][106226] Updated weights for policy 0, policy_version 646312 (0.0005) [2023-12-27 23:53:15,868][106226] Updated weights for policy 0, policy_version 646322 (0.0006) [2023-12-27 23:53:15,926][106226] Updated weights for policy 0, policy_version 646332 (0.0008) [2023-12-27 23:53:15,965][106225] Updated weights for policy 1, policy_version 648235 (0.0008) [2023-12-27 23:53:16,024][106225] Updated weights for policy 1, policy_version 648245 (0.0008) [2023-12-27 23:53:16,083][106225] Updated weights for policy 1, policy_version 648255 (0.0008) [2023-12-27 23:53:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 331489280. Throughput: 0: 10185.3, 1: 9791.2. Samples: 331473144. Policy #0 lag: (min: 17.0, avg: 31.1, max: 49.0) [2023-12-27 23:53:16,176][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.794')] [2023-12-27 23:53:16,631][106226] Updated weights for policy 0, policy_version 646342 (0.0006) [2023-12-27 23:53:16,693][106226] Updated weights for policy 0, policy_version 646352 (0.0008) [2023-12-27 23:53:16,759][106226] Updated weights for policy 0, policy_version 646362 (0.0005) [2023-12-27 23:53:16,800][106225] Updated weights for policy 1, policy_version 648265 (0.0009) [2023-12-27 23:53:16,849][106225] Updated weights for policy 1, policy_version 648275 (0.0009) [2023-12-27 23:53:16,902][106225] Updated weights for policy 1, policy_version 648285 (0.0010) [2023-12-27 23:53:16,958][106225] Updated weights for policy 1, policy_version 648295 (0.0010) [2023-12-27 23:53:17,353][106226] Updated weights for policy 0, policy_version 646372 (0.0005) [2023-12-27 23:53:17,402][106226] Updated weights for policy 0, policy_version 646382 (0.0005) [2023-12-27 23:53:17,456][106226] Updated weights for policy 0, policy_version 646392 (0.0007) [2023-12-27 23:53:17,658][106225] Updated weights for policy 1, policy_version 648305 (0.0010) [2023-12-27 23:53:17,709][106225] Updated weights for policy 1, policy_version 648315 (0.0010) [2023-12-27 23:53:17,773][106225] Updated weights for policy 1, policy_version 648325 (0.0010) [2023-12-27 23:53:18,172][106226] Updated weights for policy 0, policy_version 646402 (0.0007) [2023-12-27 23:53:18,235][106226] Updated weights for policy 0, policy_version 646412 (0.0007) [2023-12-27 23:53:18,294][106226] Updated weights for policy 0, policy_version 646422 (0.0008) [2023-12-27 23:53:18,354][106226] Updated weights for policy 0, policy_version 646432 (0.0008) [2023-12-27 23:53:18,512][106225] Updated weights for policy 1, policy_version 648335 (0.0011) [2023-12-27 23:53:18,573][106225] Updated weights for policy 1, policy_version 648345 (0.0006) [2023-12-27 23:53:18,636][106225] Updated weights for policy 1, policy_version 648355 (0.0006) [2023-12-27 23:53:19,120][106226] Updated weights for policy 0, policy_version 646442 (0.0005) [2023-12-27 23:53:19,180][106226] Updated weights for policy 0, policy_version 646452 (0.0008) [2023-12-27 23:53:19,245][106226] Updated weights for policy 0, policy_version 646462 (0.0008) [2023-12-27 23:53:19,292][106225] Updated weights for policy 1, policy_version 648365 (0.0007) [2023-12-27 23:53:19,357][106225] Updated weights for policy 1, policy_version 648375 (0.0007) [2023-12-27 23:53:19,415][106225] Updated weights for policy 1, policy_version 648385 (0.0008) [2023-12-27 23:53:20,012][106226] Updated weights for policy 0, policy_version 646472 (0.0010) [2023-12-27 23:53:20,077][106226] Updated weights for policy 0, policy_version 646482 (0.0006) [2023-12-27 23:53:20,145][106226] Updated weights for policy 0, policy_version 646492 (0.0008) [2023-12-27 23:53:20,206][106225] Updated weights for policy 1, policy_version 648395 (0.0009) [2023-12-27 23:53:20,271][106225] Updated weights for policy 1, policy_version 648405 (0.0009) [2023-12-27 23:53:20,337][106225] Updated weights for policy 1, policy_version 648415 (0.0009) [2023-12-27 23:53:20,821][106226] Updated weights for policy 0, policy_version 646502 (0.0007) [2023-12-27 23:53:20,880][106226] Updated weights for policy 0, policy_version 646512 (0.0006) [2023-12-27 23:53:20,940][106226] Updated weights for policy 0, policy_version 646522 (0.0009) [2023-12-27 23:53:21,053][106225] Updated weights for policy 1, policy_version 648425 (0.0008) [2023-12-27 23:53:21,116][106225] Updated weights for policy 1, policy_version 648435 (0.0010) [2023-12-27 23:53:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 331579392. Throughput: 0: 10108.3, 1: 9714.5. Samples: 331589984. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:21,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-5.661')] [2023-12-27 23:53:21,187][106225] Updated weights for policy 1, policy_version 648445 (0.0008) [2023-12-27 23:53:21,254][106225] Updated weights for policy 1, policy_version 648455 (0.0008) [2023-12-27 23:53:21,650][106226] Updated weights for policy 0, policy_version 646532 (0.0008) [2023-12-27 23:53:21,719][106226] Updated weights for policy 0, policy_version 646542 (0.0009) [2023-12-27 23:53:21,787][106226] Updated weights for policy 0, policy_version 646552 (0.0007) [2023-12-27 23:53:22,052][106225] Updated weights for policy 1, policy_version 648465 (0.0009) [2023-12-27 23:53:22,109][106225] Updated weights for policy 1, policy_version 648475 (0.0009) [2023-12-27 23:53:22,160][106225] Updated weights for policy 1, policy_version 648485 (0.0010) [2023-12-27 23:53:22,397][106226] Updated weights for policy 0, policy_version 646562 (0.0006) [2023-12-27 23:53:22,453][106226] Updated weights for policy 0, policy_version 646572 (0.0006) [2023-12-27 23:53:22,517][106226] Updated weights for policy 0, policy_version 646582 (0.0009) [2023-12-27 23:53:22,577][106226] Updated weights for policy 0, policy_version 646592 (0.0009) [2023-12-27 23:53:22,906][106225] Updated weights for policy 1, policy_version 648495 (0.0006) [2023-12-27 23:53:22,966][106225] Updated weights for policy 1, policy_version 648505 (0.0010) [2023-12-27 23:53:23,024][106225] Updated weights for policy 1, policy_version 648515 (0.0010) [2023-12-27 23:53:23,328][106226] Updated weights for policy 0, policy_version 646602 (0.0008) [2023-12-27 23:53:23,376][106226] Updated weights for policy 0, policy_version 646612 (0.0008) [2023-12-27 23:53:23,430][106226] Updated weights for policy 0, policy_version 646622 (0.0007) [2023-12-27 23:53:23,710][106225] Updated weights for policy 1, policy_version 648525 (0.0008) [2023-12-27 23:53:23,774][106225] Updated weights for policy 1, policy_version 648535 (0.0010) [2023-12-27 23:53:23,831][106225] Updated weights for policy 1, policy_version 648545 (0.0006) [2023-12-27 23:53:24,183][106226] Updated weights for policy 0, policy_version 646632 (0.0007) [2023-12-27 23:53:24,247][106226] Updated weights for policy 0, policy_version 646642 (0.0008) [2023-12-27 23:53:24,307][106226] Updated weights for policy 0, policy_version 646652 (0.0008) [2023-12-27 23:53:24,471][106225] Updated weights for policy 1, policy_version 648555 (0.0010) [2023-12-27 23:53:24,526][106225] Updated weights for policy 1, policy_version 648565 (0.0008) [2023-12-27 23:53:24,579][106225] Updated weights for policy 1, policy_version 648575 (0.0009) [2023-12-27 23:53:24,981][106226] Updated weights for policy 0, policy_version 646662 (0.0008) [2023-12-27 23:53:25,034][106226] Updated weights for policy 0, policy_version 646672 (0.0008) [2023-12-27 23:53:25,091][106226] Updated weights for policy 0, policy_version 646682 (0.0008) [2023-12-27 23:53:25,227][106225] Updated weights for policy 1, policy_version 648585 (0.0007) [2023-12-27 23:53:25,286][106225] Updated weights for policy 1, policy_version 648595 (0.0010) [2023-12-27 23:53:25,347][106225] Updated weights for policy 1, policy_version 648605 (0.0008) [2023-12-27 23:53:25,405][106225] Updated weights for policy 1, policy_version 648615 (0.0008) [2023-12-27 23:53:25,728][106226] Updated weights for policy 0, policy_version 646692 (0.0009) [2023-12-27 23:53:25,782][106226] Updated weights for policy 0, policy_version 646702 (0.0010) [2023-12-27 23:53:25,838][106226] Updated weights for policy 0, policy_version 646712 (0.0010) [2023-12-27 23:53:26,010][106225] Updated weights for policy 1, policy_version 648625 (0.0010) [2023-12-27 23:53:26,073][106225] Updated weights for policy 1, policy_version 648635 (0.0010) [2023-12-27 23:53:26,125][106225] Updated weights for policy 1, policy_version 648645 (0.0010) [2023-12-27 23:53:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 331685888. Throughput: 0: 10076.0, 1: 9658.4. Samples: 331647396. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:26,176][105115] Avg episode reward: [(0, '-4.239'), (1, '-6.014')] [2023-12-27 23:53:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000648648_166084608.pth... [2023-12-27 23:53:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000646720_165601280.pth... [2023-12-27 23:53:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000645536_165298176.pth [2023-12-27 23:53:26,210][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000647528_165797888.pth [2023-12-27 23:53:26,424][106226] Updated weights for policy 0, policy_version 646722 (0.0009) [2023-12-27 23:53:26,484][106226] Updated weights for policy 0, policy_version 646732 (0.0006) [2023-12-27 23:53:26,544][106226] Updated weights for policy 0, policy_version 646742 (0.0005) [2023-12-27 23:53:26,597][106226] Updated weights for policy 0, policy_version 646752 (0.0005) [2023-12-27 23:53:26,771][106225] Updated weights for policy 1, policy_version 648655 (0.0007) [2023-12-27 23:53:26,821][106225] Updated weights for policy 1, policy_version 648665 (0.0005) [2023-12-27 23:53:26,873][106225] Updated weights for policy 1, policy_version 648675 (0.0005) [2023-12-27 23:53:27,114][106226] Updated weights for policy 0, policy_version 646762 (0.0009) [2023-12-27 23:53:27,172][106226] Updated weights for policy 0, policy_version 646772 (0.0006) [2023-12-27 23:53:27,227][106226] Updated weights for policy 0, policy_version 646782 (0.0008) [2023-12-27 23:53:27,452][106225] Updated weights for policy 1, policy_version 648685 (0.0005) [2023-12-27 23:53:27,508][106225] Updated weights for policy 1, policy_version 648695 (0.0005) [2023-12-27 23:53:27,566][106225] Updated weights for policy 1, policy_version 648705 (0.0007) [2023-12-27 23:53:27,939][106226] Updated weights for policy 0, policy_version 646792 (0.0009) [2023-12-27 23:53:27,992][106226] Updated weights for policy 0, policy_version 646802 (0.0009) [2023-12-27 23:53:28,057][106226] Updated weights for policy 0, policy_version 646812 (0.0010) [2023-12-27 23:53:28,133][106225] Updated weights for policy 1, policy_version 648715 (0.0007) [2023-12-27 23:53:28,194][106225] Updated weights for policy 1, policy_version 648725 (0.0005) [2023-12-27 23:53:28,240][106225] Updated weights for policy 1, policy_version 648735 (0.0005) [2023-12-27 23:53:28,814][106226] Updated weights for policy 0, policy_version 646822 (0.0008) [2023-12-27 23:53:28,878][106226] Updated weights for policy 0, policy_version 646832 (0.0008) [2023-12-27 23:53:28,900][106225] Updated weights for policy 1, policy_version 648745 (0.0006) [2023-12-27 23:53:28,935][106226] Updated weights for policy 0, policy_version 646842 (0.0008) [2023-12-27 23:53:28,961][106225] Updated weights for policy 1, policy_version 648755 (0.0011) [2023-12-27 23:53:29,020][106225] Updated weights for policy 1, policy_version 648765 (0.0010) [2023-12-27 23:53:29,083][106225] Updated weights for policy 1, policy_version 648775 (0.0010) [2023-12-27 23:53:29,613][106226] Updated weights for policy 0, policy_version 646852 (0.0006) [2023-12-27 23:53:29,668][106226] Updated weights for policy 0, policy_version 646862 (0.0005) [2023-12-27 23:53:29,727][106226] Updated weights for policy 0, policy_version 646872 (0.0007) [2023-12-27 23:53:29,792][106225] Updated weights for policy 1, policy_version 648785 (0.0010) [2023-12-27 23:53:29,857][106225] Updated weights for policy 1, policy_version 648795 (0.0011) [2023-12-27 23:53:29,919][106225] Updated weights for policy 1, policy_version 648805 (0.0008) [2023-12-27 23:53:30,368][106226] Updated weights for policy 0, policy_version 646882 (0.0009) [2023-12-27 23:53:30,432][106226] Updated weights for policy 0, policy_version 646892 (0.0005) [2023-12-27 23:53:30,488][106226] Updated weights for policy 0, policy_version 646902 (0.0010) [2023-12-27 23:53:30,543][106226] Updated weights for policy 0, policy_version 646912 (0.0010) [2023-12-27 23:53:30,703][106225] Updated weights for policy 1, policy_version 648815 (0.0008) [2023-12-27 23:53:30,757][106225] Updated weights for policy 1, policy_version 648825 (0.0007) [2023-12-27 23:53:30,816][106225] Updated weights for policy 1, policy_version 648835 (0.0007) [2023-12-27 23:53:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 331784192. Throughput: 0: 10176.7, 1: 9769.1. Samples: 331774672. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:31,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-6.195')] [2023-12-27 23:53:31,196][106226] Updated weights for policy 0, policy_version 646922 (0.0011) [2023-12-27 23:53:31,254][106226] Updated weights for policy 0, policy_version 646932 (0.0008) [2023-12-27 23:53:31,308][106226] Updated weights for policy 0, policy_version 646942 (0.0008) [2023-12-27 23:53:31,539][106225] Updated weights for policy 1, policy_version 648845 (0.0007) [2023-12-27 23:53:31,605][106225] Updated weights for policy 1, policy_version 648855 (0.0006) [2023-12-27 23:53:31,672][106225] Updated weights for policy 1, policy_version 648865 (0.0007) [2023-12-27 23:53:32,003][106226] Updated weights for policy 0, policy_version 646952 (0.0007) [2023-12-27 23:53:32,060][106226] Updated weights for policy 0, policy_version 646962 (0.0008) [2023-12-27 23:53:32,118][106226] Updated weights for policy 0, policy_version 646972 (0.0008) [2023-12-27 23:53:32,311][106225] Updated weights for policy 1, policy_version 648875 (0.0008) [2023-12-27 23:53:32,380][106225] Updated weights for policy 1, policy_version 648885 (0.0009) [2023-12-27 23:53:32,447][106225] Updated weights for policy 1, policy_version 648895 (0.0009) [2023-12-27 23:53:32,807][106226] Updated weights for policy 0, policy_version 646982 (0.0006) [2023-12-27 23:53:32,879][106226] Updated weights for policy 0, policy_version 646992 (0.0010) [2023-12-27 23:53:32,929][106226] Updated weights for policy 0, policy_version 647002 (0.0007) [2023-12-27 23:53:33,116][106225] Updated weights for policy 1, policy_version 648905 (0.0008) [2023-12-27 23:53:33,160][106225] Updated weights for policy 1, policy_version 648915 (0.0008) [2023-12-27 23:53:33,208][106225] Updated weights for policy 1, policy_version 648925 (0.0008) [2023-12-27 23:53:33,269][106225] Updated weights for policy 1, policy_version 648935 (0.0008) [2023-12-27 23:53:33,631][106226] Updated weights for policy 0, policy_version 647012 (0.0009) [2023-12-27 23:53:33,682][106226] Updated weights for policy 0, policy_version 647022 (0.0009) [2023-12-27 23:53:33,726][106226] Updated weights for policy 0, policy_version 647032 (0.0008) [2023-12-27 23:53:34,049][106225] Updated weights for policy 1, policy_version 648945 (0.0009) [2023-12-27 23:53:34,106][106225] Updated weights for policy 1, policy_version 648955 (0.0008) [2023-12-27 23:53:34,167][106225] Updated weights for policy 1, policy_version 648965 (0.0009) [2023-12-27 23:53:34,347][106226] Updated weights for policy 0, policy_version 647042 (0.0006) [2023-12-27 23:53:34,406][106226] Updated weights for policy 0, policy_version 647052 (0.0009) [2023-12-27 23:53:34,476][106226] Updated weights for policy 0, policy_version 647062 (0.0009) [2023-12-27 23:53:34,543][106226] Updated weights for policy 0, policy_version 647072 (0.0009) [2023-12-27 23:53:34,844][106225] Updated weights for policy 1, policy_version 648975 (0.0007) [2023-12-27 23:53:34,900][106225] Updated weights for policy 1, policy_version 648985 (0.0008) [2023-12-27 23:53:34,953][106225] Updated weights for policy 1, policy_version 648995 (0.0005) [2023-12-27 23:53:35,271][106226] Updated weights for policy 0, policy_version 647082 (0.0010) [2023-12-27 23:53:35,324][106226] Updated weights for policy 0, policy_version 647092 (0.0005) [2023-12-27 23:53:35,382][106226] Updated weights for policy 0, policy_version 647102 (0.0009) [2023-12-27 23:53:35,544][106225] Updated weights for policy 1, policy_version 649005 (0.0008) [2023-12-27 23:53:35,594][106225] Updated weights for policy 1, policy_version 649015 (0.0010) [2023-12-27 23:53:35,644][106225] Updated weights for policy 1, policy_version 649025 (0.0010) [2023-12-27 23:53:35,948][106226] Updated weights for policy 0, policy_version 647112 (0.0009) [2023-12-27 23:53:36,009][106226] Updated weights for policy 0, policy_version 647122 (0.0005) [2023-12-27 23:53:36,068][106226] Updated weights for policy 0, policy_version 647132 (0.0008) [2023-12-27 23:53:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 331890688. Throughput: 0: 10265.0, 1: 9739.2. Samples: 331896576. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:36,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-6.229')] [2023-12-27 23:53:36,364][106225] Updated weights for policy 1, policy_version 649035 (0.0010) [2023-12-27 23:53:36,423][106225] Updated weights for policy 1, policy_version 649045 (0.0011) [2023-12-27 23:53:36,484][106225] Updated weights for policy 1, policy_version 649055 (0.0010) [2023-12-27 23:53:36,745][106226] Updated weights for policy 0, policy_version 647142 (0.0010) [2023-12-27 23:53:36,801][106226] Updated weights for policy 0, policy_version 647152 (0.0009) [2023-12-27 23:53:36,866][106226] Updated weights for policy 0, policy_version 647162 (0.0008) [2023-12-27 23:53:37,209][106225] Updated weights for policy 1, policy_version 649065 (0.0010) [2023-12-27 23:53:37,280][106225] Updated weights for policy 1, policy_version 649075 (0.0010) [2023-12-27 23:53:37,343][106225] Updated weights for policy 1, policy_version 649085 (0.0010) [2023-12-27 23:53:37,412][106225] Updated weights for policy 1, policy_version 649095 (0.0010) [2023-12-27 23:53:37,515][106226] Updated weights for policy 0, policy_version 647172 (0.0007) [2023-12-27 23:53:37,565][106226] Updated weights for policy 0, policy_version 647182 (0.0005) [2023-12-27 23:53:37,614][106226] Updated weights for policy 0, policy_version 647192 (0.0008) [2023-12-27 23:53:38,012][106225] Updated weights for policy 1, policy_version 649105 (0.0010) [2023-12-27 23:53:38,071][106225] Updated weights for policy 1, policy_version 649115 (0.0010) [2023-12-27 23:53:38,123][106225] Updated weights for policy 1, policy_version 649125 (0.0010) [2023-12-27 23:53:38,283][106226] Updated weights for policy 0, policy_version 647202 (0.0010) [2023-12-27 23:53:38,350][106226] Updated weights for policy 0, policy_version 647212 (0.0009) [2023-12-27 23:53:38,411][106226] Updated weights for policy 0, policy_version 647222 (0.0011) [2023-12-27 23:53:38,473][106226] Updated weights for policy 0, policy_version 647232 (0.0011) [2023-12-27 23:53:38,912][106225] Updated weights for policy 1, policy_version 649135 (0.0009) [2023-12-27 23:53:38,965][106225] Updated weights for policy 1, policy_version 649145 (0.0007) [2023-12-27 23:53:39,014][106225] Updated weights for policy 1, policy_version 649155 (0.0007) [2023-12-27 23:53:39,150][106226] Updated weights for policy 0, policy_version 647242 (0.0005) [2023-12-27 23:53:39,201][106226] Updated weights for policy 0, policy_version 647252 (0.0008) [2023-12-27 23:53:39,266][106226] Updated weights for policy 0, policy_version 647262 (0.0008) [2023-12-27 23:53:39,757][106225] Updated weights for policy 1, policy_version 649165 (0.0010) [2023-12-27 23:53:39,815][106225] Updated weights for policy 1, policy_version 649175 (0.0009) [2023-12-27 23:53:39,879][106225] Updated weights for policy 1, policy_version 649185 (0.0010) [2023-12-27 23:53:40,032][106226] Updated weights for policy 0, policy_version 647272 (0.0008) [2023-12-27 23:53:40,092][106226] Updated weights for policy 0, policy_version 647282 (0.0010) [2023-12-27 23:53:40,151][106226] Updated weights for policy 0, policy_version 647292 (0.0011) [2023-12-27 23:53:40,536][106225] Updated weights for policy 1, policy_version 649195 (0.0007) [2023-12-27 23:53:40,602][106225] Updated weights for policy 1, policy_version 649205 (0.0011) [2023-12-27 23:53:40,660][106225] Updated weights for policy 1, policy_version 649215 (0.0011) [2023-12-27 23:53:40,813][106226] Updated weights for policy 0, policy_version 647302 (0.0009) [2023-12-27 23:53:40,870][106226] Updated weights for policy 0, policy_version 647312 (0.0008) [2023-12-27 23:53:40,923][106226] Updated weights for policy 0, policy_version 647322 (0.0008) [2023-12-27 23:53:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 331988992. Throughput: 0: 10252.3, 1: 9725.3. Samples: 331957280. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:41,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-6.113')] [2023-12-27 23:53:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000647328_165756928.pth... [2023-12-27 23:53:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000649224_166232064.pth... [2023-12-27 23:53:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000646144_165453824.pth [2023-12-27 23:53:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000647328_165756928.pth [2023-12-27 23:53:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000648072_165937152.pth [2023-12-27 23:53:41,191][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000649224_166232064.pth [2023-12-27 23:53:41,426][106225] Updated weights for policy 1, policy_version 649225 (0.0010) [2023-12-27 23:53:41,500][106225] Updated weights for policy 1, policy_version 649235 (0.0007) [2023-12-27 23:53:41,569][106225] Updated weights for policy 1, policy_version 649245 (0.0006) [2023-12-27 23:53:41,640][106225] Updated weights for policy 1, policy_version 649255 (0.0007) [2023-12-27 23:53:41,679][106226] Updated weights for policy 0, policy_version 647332 (0.0010) [2023-12-27 23:53:41,756][106226] Updated weights for policy 0, policy_version 647342 (0.0011) [2023-12-27 23:53:41,820][106226] Updated weights for policy 0, policy_version 647352 (0.0009) [2023-12-27 23:53:42,310][106225] Updated weights for policy 1, policy_version 649265 (0.0007) [2023-12-27 23:53:42,377][106225] Updated weights for policy 1, policy_version 649275 (0.0008) [2023-12-27 23:53:42,433][106225] Updated weights for policy 1, policy_version 649285 (0.0008) [2023-12-27 23:53:42,544][106226] Updated weights for policy 0, policy_version 647362 (0.0009) [2023-12-27 23:53:42,606][106226] Updated weights for policy 0, policy_version 647372 (0.0006) [2023-12-27 23:53:42,667][106226] Updated weights for policy 0, policy_version 647382 (0.0007) [2023-12-27 23:53:42,719][106226] Updated weights for policy 0, policy_version 647392 (0.0007) [2023-12-27 23:53:43,130][106225] Updated weights for policy 1, policy_version 649295 (0.0007) [2023-12-27 23:53:43,180][106225] Updated weights for policy 1, policy_version 649305 (0.0008) [2023-12-27 23:53:43,237][106225] Updated weights for policy 1, policy_version 649315 (0.0005) [2023-12-27 23:53:43,374][106226] Updated weights for policy 0, policy_version 647402 (0.0007) [2023-12-27 23:53:43,431][106226] Updated weights for policy 0, policy_version 647412 (0.0005) [2023-12-27 23:53:43,483][106226] Updated weights for policy 0, policy_version 647422 (0.0005) [2023-12-27 23:53:43,879][106225] Updated weights for policy 1, policy_version 649325 (0.0005) [2023-12-27 23:53:43,941][106225] Updated weights for policy 1, policy_version 649335 (0.0010) [2023-12-27 23:53:43,995][106225] Updated weights for policy 1, policy_version 649345 (0.0009) [2023-12-27 23:53:44,074][106226] Updated weights for policy 0, policy_version 647432 (0.0008) [2023-12-27 23:53:44,130][106226] Updated weights for policy 0, policy_version 647442 (0.0006) [2023-12-27 23:53:44,191][106226] Updated weights for policy 0, policy_version 647452 (0.0006) [2023-12-27 23:53:44,601][106225] Updated weights for policy 1, policy_version 649355 (0.0008) [2023-12-27 23:53:44,658][106225] Updated weights for policy 1, policy_version 649365 (0.0006) [2023-12-27 23:53:44,717][106225] Updated weights for policy 1, policy_version 649375 (0.0010) [2023-12-27 23:53:44,781][106226] Updated weights for policy 0, policy_version 647462 (0.0010) [2023-12-27 23:53:44,843][106226] Updated weights for policy 0, policy_version 647472 (0.0010) [2023-12-27 23:53:44,894][106226] Updated weights for policy 0, policy_version 647482 (0.0010) [2023-12-27 23:53:45,418][106225] Updated weights for policy 1, policy_version 649385 (0.0009) [2023-12-27 23:53:45,481][106225] Updated weights for policy 1, policy_version 649395 (0.0010) [2023-12-27 23:53:45,539][106225] Updated weights for policy 1, policy_version 649405 (0.0009) [2023-12-27 23:53:45,592][106225] Updated weights for policy 1, policy_version 649415 (0.0010) [2023-12-27 23:53:45,648][106226] Updated weights for policy 0, policy_version 647492 (0.0010) [2023-12-27 23:53:45,707][106226] Updated weights for policy 0, policy_version 647502 (0.0010) [2023-12-27 23:53:45,760][106226] Updated weights for policy 0, policy_version 647512 (0.0010) [2023-12-27 23:53:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 332087296. Throughput: 0: 10180.8, 1: 9806.1. Samples: 332077928. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:46,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-6.143')] [2023-12-27 23:53:46,263][106225] Updated weights for policy 1, policy_version 649425 (0.0010) [2023-12-27 23:53:46,313][106225] Updated weights for policy 1, policy_version 649435 (0.0010) [2023-12-27 23:53:46,376][106225] Updated weights for policy 1, policy_version 649445 (0.0010) [2023-12-27 23:53:46,466][106226] Updated weights for policy 0, policy_version 647522 (0.0010) [2023-12-27 23:53:46,528][106226] Updated weights for policy 0, policy_version 647532 (0.0010) [2023-12-27 23:53:46,584][106226] Updated weights for policy 0, policy_version 647542 (0.0010) [2023-12-27 23:53:46,646][106226] Updated weights for policy 0, policy_version 647552 (0.0011) [2023-12-27 23:53:46,951][106225] Updated weights for policy 1, policy_version 649455 (0.0007) [2023-12-27 23:53:47,012][106225] Updated weights for policy 1, policy_version 649465 (0.0005) [2023-12-27 23:53:47,073][106225] Updated weights for policy 1, policy_version 649475 (0.0006) [2023-12-27 23:53:47,361][106226] Updated weights for policy 0, policy_version 647562 (0.0011) [2023-12-27 23:53:47,418][106226] Updated weights for policy 0, policy_version 647572 (0.0010) [2023-12-27 23:53:47,470][106226] Updated weights for policy 0, policy_version 647582 (0.0010) [2023-12-27 23:53:47,686][106225] Updated weights for policy 1, policy_version 649485 (0.0010) [2023-12-27 23:53:47,747][106225] Updated weights for policy 1, policy_version 649495 (0.0010) [2023-12-27 23:53:47,803][106225] Updated weights for policy 1, policy_version 649505 (0.0010) [2023-12-27 23:53:48,172][106226] Updated weights for policy 0, policy_version 647592 (0.0011) [2023-12-27 23:53:48,230][106226] Updated weights for policy 0, policy_version 647602 (0.0010) [2023-12-27 23:53:48,293][106226] Updated weights for policy 0, policy_version 647612 (0.0011) [2023-12-27 23:53:48,491][106225] Updated weights for policy 1, policy_version 649515 (0.0007) [2023-12-27 23:53:48,544][106225] Updated weights for policy 1, policy_version 649525 (0.0009) [2023-12-27 23:53:48,592][106225] Updated weights for policy 1, policy_version 649535 (0.0010) [2023-12-27 23:53:49,026][106226] Updated weights for policy 0, policy_version 647622 (0.0009) [2023-12-27 23:53:49,084][106226] Updated weights for policy 0, policy_version 647632 (0.0007) [2023-12-27 23:53:49,150][106226] Updated weights for policy 0, policy_version 647642 (0.0007) [2023-12-27 23:53:49,343][106225] Updated weights for policy 1, policy_version 649545 (0.0010) [2023-12-27 23:53:49,411][106225] Updated weights for policy 1, policy_version 649555 (0.0008) [2023-12-27 23:53:49,479][106225] Updated weights for policy 1, policy_version 649565 (0.0007) [2023-12-27 23:53:49,543][106225] Updated weights for policy 1, policy_version 649575 (0.0008) [2023-12-27 23:53:49,927][106226] Updated weights for policy 0, policy_version 647652 (0.0009) [2023-12-27 23:53:49,985][106226] Updated weights for policy 0, policy_version 647662 (0.0008) [2023-12-27 23:53:50,043][106226] Updated weights for policy 0, policy_version 647672 (0.0008) [2023-12-27 23:53:50,290][106225] Updated weights for policy 1, policy_version 649585 (0.0008) [2023-12-27 23:53:50,341][106225] Updated weights for policy 1, policy_version 649595 (0.0008) [2023-12-27 23:53:50,395][106225] Updated weights for policy 1, policy_version 649605 (0.0008) [2023-12-27 23:53:50,777][106226] Updated weights for policy 0, policy_version 647682 (0.0009) [2023-12-27 23:53:50,839][106226] Updated weights for policy 0, policy_version 647692 (0.0008) [2023-12-27 23:53:50,902][106226] Updated weights for policy 0, policy_version 647702 (0.0008) [2023-12-27 23:53:50,961][106226] Updated weights for policy 0, policy_version 647712 (0.0008) [2023-12-27 23:53:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 332185600. Throughput: 0: 10094.5, 1: 9867.2. Samples: 332195052. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:51,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-5.928')] [2023-12-27 23:53:51,178][106225] Updated weights for policy 1, policy_version 649615 (0.0006) [2023-12-27 23:53:51,237][106225] Updated weights for policy 1, policy_version 649625 (0.0006) [2023-12-27 23:53:51,302][106225] Updated weights for policy 1, policy_version 649635 (0.0008) [2023-12-27 23:53:51,777][106226] Updated weights for policy 0, policy_version 647722 (0.0009) [2023-12-27 23:53:51,835][106226] Updated weights for policy 0, policy_version 647732 (0.0009) [2023-12-27 23:53:51,891][106226] Updated weights for policy 0, policy_version 647742 (0.0009) [2023-12-27 23:53:52,016][106225] Updated weights for policy 1, policy_version 649645 (0.0008) [2023-12-27 23:53:52,075][106225] Updated weights for policy 1, policy_version 649655 (0.0008) [2023-12-27 23:53:52,130][106225] Updated weights for policy 1, policy_version 649665 (0.0007) [2023-12-27 23:53:52,594][106226] Updated weights for policy 0, policy_version 647752 (0.0009) [2023-12-27 23:53:52,653][106226] Updated weights for policy 0, policy_version 647762 (0.0009) [2023-12-27 23:53:52,710][106226] Updated weights for policy 0, policy_version 647772 (0.0008) [2023-12-27 23:53:52,897][106225] Updated weights for policy 1, policy_version 649675 (0.0008) [2023-12-27 23:53:52,958][106225] Updated weights for policy 1, policy_version 649685 (0.0007) [2023-12-27 23:53:53,025][106225] Updated weights for policy 1, policy_version 649695 (0.0006) [2023-12-27 23:53:53,463][106226] Updated weights for policy 0, policy_version 647782 (0.0009) [2023-12-27 23:53:53,529][106226] Updated weights for policy 0, policy_version 647792 (0.0006) [2023-12-27 23:53:53,588][106225] Updated weights for policy 1, policy_version 649705 (0.0006) [2023-12-27 23:53:53,596][106226] Updated weights for policy 0, policy_version 647802 (0.0005) [2023-12-27 23:53:53,647][106225] Updated weights for policy 1, policy_version 649715 (0.0009) [2023-12-27 23:53:53,698][106225] Updated weights for policy 1, policy_version 649725 (0.0008) [2023-12-27 23:53:53,754][106225] Updated weights for policy 1, policy_version 649735 (0.0007) [2023-12-27 23:53:54,262][106226] Updated weights for policy 0, policy_version 647812 (0.0007) [2023-12-27 23:53:54,319][106226] Updated weights for policy 0, policy_version 647822 (0.0010) [2023-12-27 23:53:54,380][106226] Updated weights for policy 0, policy_version 647832 (0.0011) [2023-12-27 23:53:54,463][106225] Updated weights for policy 1, policy_version 649745 (0.0007) [2023-12-27 23:53:54,519][106225] Updated weights for policy 1, policy_version 649755 (0.0008) [2023-12-27 23:53:54,582][106225] Updated weights for policy 1, policy_version 649765 (0.0007) [2023-12-27 23:53:55,131][106226] Updated weights for policy 0, policy_version 647842 (0.0010) [2023-12-27 23:53:55,184][106226] Updated weights for policy 0, policy_version 647852 (0.0009) [2023-12-27 23:53:55,206][106225] Updated weights for policy 1, policy_version 649775 (0.0006) [2023-12-27 23:53:55,241][106226] Updated weights for policy 0, policy_version 647862 (0.0008) [2023-12-27 23:53:55,259][106225] Updated weights for policy 1, policy_version 649785 (0.0005) [2023-12-27 23:53:55,294][106226] Updated weights for policy 0, policy_version 647872 (0.0007) [2023-12-27 23:53:55,307][106225] Updated weights for policy 1, policy_version 649795 (0.0005) [2023-12-27 23:53:55,953][106225] Updated weights for policy 1, policy_version 649805 (0.0006) [2023-12-27 23:53:56,014][106225] Updated weights for policy 1, policy_version 649815 (0.0008) [2023-12-27 23:53:56,041][106226] Updated weights for policy 0, policy_version 647882 (0.0006) [2023-12-27 23:53:56,074][106225] Updated weights for policy 1, policy_version 649825 (0.0008) [2023-12-27 23:53:56,097][106226] Updated weights for policy 0, policy_version 647892 (0.0005) [2023-12-27 23:53:56,154][106226] Updated weights for policy 0, policy_version 647902 (0.0005) [2023-12-27 23:53:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 332292096. Throughput: 0: 10006.9, 1: 9923.2. Samples: 332254120. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:53:56,176][105115] Avg episode reward: [(0, '-4.584'), (1, '-5.984')] [2023-12-27 23:53:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000649832_166387712.pth... [2023-12-27 23:53:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000647904_165904384.pth... [2023-12-27 23:53:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000648648_166084608.pth [2023-12-27 23:53:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000646720_165601280.pth [2023-12-27 23:53:56,796][106225] Updated weights for policy 1, policy_version 649835 (0.0010) [2023-12-27 23:53:56,839][106226] Updated weights for policy 0, policy_version 647912 (0.0005) [2023-12-27 23:53:56,845][106225] Updated weights for policy 1, policy_version 649845 (0.0010) [2023-12-27 23:53:56,889][106226] Updated weights for policy 0, policy_version 647922 (0.0005) [2023-12-27 23:53:56,890][106225] Updated weights for policy 1, policy_version 649855 (0.0010) [2023-12-27 23:53:56,942][106226] Updated weights for policy 0, policy_version 647932 (0.0006) [2023-12-27 23:53:57,495][106225] Updated weights for policy 1, policy_version 649865 (0.0010) [2023-12-27 23:53:57,548][106225] Updated weights for policy 1, policy_version 649875 (0.0005) [2023-12-27 23:53:57,606][106225] Updated weights for policy 1, policy_version 649885 (0.0005) [2023-12-27 23:53:57,655][106225] Updated weights for policy 1, policy_version 649895 (0.0005) [2023-12-27 23:53:57,757][106226] Updated weights for policy 0, policy_version 647942 (0.0008) [2023-12-27 23:53:57,818][106226] Updated weights for policy 0, policy_version 647952 (0.0009) [2023-12-27 23:53:57,869][106226] Updated weights for policy 0, policy_version 647962 (0.0008) [2023-12-27 23:53:58,225][106225] Updated weights for policy 1, policy_version 649905 (0.0008) [2023-12-27 23:53:58,290][106225] Updated weights for policy 1, policy_version 649915 (0.0008) [2023-12-27 23:53:58,363][106225] Updated weights for policy 1, policy_version 649925 (0.0011) [2023-12-27 23:53:58,699][106226] Updated weights for policy 0, policy_version 647972 (0.0009) [2023-12-27 23:53:58,765][106226] Updated weights for policy 0, policy_version 647982 (0.0008) [2023-12-27 23:53:58,843][106226] Updated weights for policy 0, policy_version 647992 (0.0011) [2023-12-27 23:53:59,161][106225] Updated weights for policy 1, policy_version 649935 (0.0007) [2023-12-27 23:53:59,223][106225] Updated weights for policy 1, policy_version 649945 (0.0006) [2023-12-27 23:53:59,297][106225] Updated weights for policy 1, policy_version 649955 (0.0010) [2023-12-27 23:53:59,682][106226] Updated weights for policy 0, policy_version 648002 (0.0007) [2023-12-27 23:53:59,743][106226] Updated weights for policy 0, policy_version 648012 (0.0008) [2023-12-27 23:53:59,801][106226] Updated weights for policy 0, policy_version 648022 (0.0008) [2023-12-27 23:53:59,875][106226] Updated weights for policy 0, policy_version 648032 (0.0009) [2023-12-27 23:54:00,046][106225] Updated weights for policy 1, policy_version 649965 (0.0010) [2023-12-27 23:54:00,097][106225] Updated weights for policy 1, policy_version 649975 (0.0010) [2023-12-27 23:54:00,159][106225] Updated weights for policy 1, policy_version 649985 (0.0010) [2023-12-27 23:54:00,578][106226] Updated weights for policy 0, policy_version 648042 (0.0011) [2023-12-27 23:54:00,637][106226] Updated weights for policy 0, policy_version 648052 (0.0008) [2023-12-27 23:54:00,696][106226] Updated weights for policy 0, policy_version 648062 (0.0009) [2023-12-27 23:54:00,813][106225] Updated weights for policy 1, policy_version 649995 (0.0010) [2023-12-27 23:54:00,860][106225] Updated weights for policy 1, policy_version 650005 (0.0008) [2023-12-27 23:54:00,903][106225] Updated weights for policy 1, policy_version 650015 (0.0008) [2023-12-27 23:54:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 332382208. Throughput: 0: 9890.7, 1: 10036.1. Samples: 332369848. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:01,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-6.051')] [2023-12-27 23:54:01,421][106226] Updated weights for policy 0, policy_version 648072 (0.0010) [2023-12-27 23:54:01,482][106226] Updated weights for policy 0, policy_version 648082 (0.0009) [2023-12-27 23:54:01,542][106226] Updated weights for policy 0, policy_version 648092 (0.0009) [2023-12-27 23:54:01,620][106225] Updated weights for policy 1, policy_version 650025 (0.0008) [2023-12-27 23:54:01,675][106225] Updated weights for policy 1, policy_version 650035 (0.0008) [2023-12-27 23:54:01,740][106225] Updated weights for policy 1, policy_version 650045 (0.0009) [2023-12-27 23:54:01,800][106225] Updated weights for policy 1, policy_version 650055 (0.0006) [2023-12-27 23:54:02,242][106226] Updated weights for policy 0, policy_version 648102 (0.0007) [2023-12-27 23:54:02,304][106226] Updated weights for policy 0, policy_version 648112 (0.0006) [2023-12-27 23:54:02,368][106226] Updated weights for policy 0, policy_version 648122 (0.0008) [2023-12-27 23:54:02,513][106225] Updated weights for policy 1, policy_version 650065 (0.0008) [2023-12-27 23:54:02,579][106225] Updated weights for policy 1, policy_version 650075 (0.0006) [2023-12-27 23:54:02,654][106225] Updated weights for policy 1, policy_version 650085 (0.0006) [2023-12-27 23:54:03,013][106226] Updated weights for policy 0, policy_version 648132 (0.0008) [2023-12-27 23:54:03,064][106226] Updated weights for policy 0, policy_version 648142 (0.0009) [2023-12-27 23:54:03,123][106226] Updated weights for policy 0, policy_version 648152 (0.0009) [2023-12-27 23:54:03,247][106225] Updated weights for policy 1, policy_version 650095 (0.0007) [2023-12-27 23:54:03,310][106225] Updated weights for policy 1, policy_version 650105 (0.0007) [2023-12-27 23:54:03,377][106225] Updated weights for policy 1, policy_version 650115 (0.0005) [2023-12-27 23:54:03,823][106226] Updated weights for policy 0, policy_version 648162 (0.0008) [2023-12-27 23:54:03,892][106226] Updated weights for policy 0, policy_version 648172 (0.0008) [2023-12-27 23:54:03,955][106226] Updated weights for policy 0, policy_version 648182 (0.0009) [2023-12-27 23:54:03,980][106225] Updated weights for policy 1, policy_version 650125 (0.0007) [2023-12-27 23:54:04,014][106226] Updated weights for policy 0, policy_version 648192 (0.0006) [2023-12-27 23:54:04,041][106225] Updated weights for policy 1, policy_version 650135 (0.0007) [2023-12-27 23:54:04,098][106225] Updated weights for policy 1, policy_version 650145 (0.0009) [2023-12-27 23:54:04,747][106226] Updated weights for policy 0, policy_version 648202 (0.0010) [2023-12-27 23:54:04,809][106226] Updated weights for policy 0, policy_version 648212 (0.0009) [2023-12-27 23:54:04,835][106225] Updated weights for policy 1, policy_version 650155 (0.0007) [2023-12-27 23:54:04,873][106226] Updated weights for policy 0, policy_version 648222 (0.0009) [2023-12-27 23:54:04,887][106225] Updated weights for policy 1, policy_version 650165 (0.0005) [2023-12-27 23:54:04,945][106225] Updated weights for policy 1, policy_version 650175 (0.0005) [2023-12-27 23:54:05,502][106225] Updated weights for policy 1, policy_version 650185 (0.0006) [2023-12-27 23:54:05,567][106225] Updated weights for policy 1, policy_version 650195 (0.0010) [2023-12-27 23:54:05,598][106226] Updated weights for policy 0, policy_version 648232 (0.0006) [2023-12-27 23:54:05,625][106225] Updated weights for policy 1, policy_version 650205 (0.0006) [2023-12-27 23:54:05,654][106226] Updated weights for policy 0, policy_version 648242 (0.0005) [2023-12-27 23:54:05,683][106225] Updated weights for policy 1, policy_version 650215 (0.0010) [2023-12-27 23:54:05,710][106226] Updated weights for policy 0, policy_version 648252 (0.0005) [2023-12-27 23:54:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 332480512. Throughput: 0: 9910.4, 1: 10140.8. Samples: 332492288. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:06,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-6.353')] [2023-12-27 23:54:06,300][106225] Updated weights for policy 1, policy_version 650225 (0.0010) [2023-12-27 23:54:06,338][106226] Updated weights for policy 0, policy_version 648262 (0.0007) [2023-12-27 23:54:06,357][106225] Updated weights for policy 1, policy_version 650235 (0.0009) [2023-12-27 23:54:06,397][106226] Updated weights for policy 0, policy_version 648272 (0.0010) [2023-12-27 23:54:06,416][106225] Updated weights for policy 1, policy_version 650245 (0.0008) [2023-12-27 23:54:06,458][106226] Updated weights for policy 0, policy_version 648282 (0.0009) [2023-12-27 23:54:07,134][106226] Updated weights for policy 0, policy_version 648292 (0.0007) [2023-12-27 23:54:07,158][106225] Updated weights for policy 1, policy_version 650255 (0.0009) [2023-12-27 23:54:07,193][106226] Updated weights for policy 0, policy_version 648302 (0.0008) [2023-12-27 23:54:07,209][106225] Updated weights for policy 1, policy_version 650265 (0.0010) [2023-12-27 23:54:07,254][106226] Updated weights for policy 0, policy_version 648312 (0.0006) [2023-12-27 23:54:07,263][106225] Updated weights for policy 1, policy_version 650275 (0.0005) [2023-12-27 23:54:07,818][106226] Updated weights for policy 0, policy_version 648322 (0.0007) [2023-12-27 23:54:07,882][106226] Updated weights for policy 0, policy_version 648332 (0.0005) [2023-12-27 23:54:07,946][106226] Updated weights for policy 0, policy_version 648342 (0.0008) [2023-12-27 23:54:07,986][106225] Updated weights for policy 1, policy_version 650285 (0.0008) [2023-12-27 23:54:08,004][106226] Updated weights for policy 0, policy_version 648352 (0.0006) [2023-12-27 23:54:08,049][106225] Updated weights for policy 1, policy_version 650295 (0.0006) [2023-12-27 23:54:08,108][106225] Updated weights for policy 1, policy_version 650305 (0.0010) [2023-12-27 23:54:08,666][106226] Updated weights for policy 0, policy_version 648362 (0.0011) [2023-12-27 23:54:08,723][106226] Updated weights for policy 0, policy_version 648372 (0.0011) [2023-12-27 23:54:08,768][106225] Updated weights for policy 1, policy_version 650315 (0.0006) [2023-12-27 23:54:08,781][106226] Updated weights for policy 0, policy_version 648382 (0.0010) [2023-12-27 23:54:08,820][106225] Updated weights for policy 1, policy_version 650325 (0.0007) [2023-12-27 23:54:08,882][106225] Updated weights for policy 1, policy_version 650335 (0.0005) [2023-12-27 23:54:09,530][106225] Updated weights for policy 1, policy_version 650345 (0.0006) [2023-12-27 23:54:09,543][106226] Updated weights for policy 0, policy_version 648392 (0.0008) [2023-12-27 23:54:09,601][106225] Updated weights for policy 1, policy_version 650355 (0.0009) [2023-12-27 23:54:09,608][106226] Updated weights for policy 0, policy_version 648402 (0.0006) [2023-12-27 23:54:09,663][106225] Updated weights for policy 1, policy_version 650365 (0.0007) [2023-12-27 23:54:09,676][106226] Updated weights for policy 0, policy_version 648412 (0.0006) [2023-12-27 23:54:09,714][106225] Updated weights for policy 1, policy_version 650375 (0.0008) [2023-12-27 23:54:10,317][106226] Updated weights for policy 0, policy_version 648422 (0.0006) [2023-12-27 23:54:10,375][106226] Updated weights for policy 0, policy_version 648432 (0.0007) [2023-12-27 23:54:10,435][106226] Updated weights for policy 0, policy_version 648442 (0.0009) [2023-12-27 23:54:10,517][106225] Updated weights for policy 1, policy_version 650385 (0.0007) [2023-12-27 23:54:10,562][106225] Updated weights for policy 1, policy_version 650395 (0.0009) [2023-12-27 23:54:10,607][106225] Updated weights for policy 1, policy_version 650405 (0.0008) [2023-12-27 23:54:11,108][106226] Updated weights for policy 0, policy_version 648452 (0.0009) [2023-12-27 23:54:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 332578816. Throughput: 0: 9946.3, 1: 10195.1. Samples: 332553752. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:11,175][105115] Avg episode reward: [(0, '-4.178'), (1, '-7.025')] [2023-12-27 23:54:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000650408_166535168.pth... [2023-12-27 23:54:11,184][106226] Updated weights for policy 0, policy_version 648462 (0.0008) [2023-12-27 23:54:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000649224_166232064.pth [2023-12-27 23:54:11,244][106226] Updated weights for policy 0, policy_version 648472 (0.0008) [2023-12-27 23:54:11,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000648480_166051840.pth... [2023-12-27 23:54:11,303][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000647328_165756928.pth [2023-12-27 23:54:11,304][106140] Saving new best policy, reward=-4.178! [2023-12-27 23:54:11,450][106225] Updated weights for policy 1, policy_version 650415 (0.0008) [2023-12-27 23:54:11,509][106225] Updated weights for policy 1, policy_version 650425 (0.0008) [2023-12-27 23:54:11,568][106225] Updated weights for policy 1, policy_version 650435 (0.0008) [2023-12-27 23:54:12,085][106226] Updated weights for policy 0, policy_version 648482 (0.0008) [2023-12-27 23:54:12,142][106226] Updated weights for policy 0, policy_version 648492 (0.0009) [2023-12-27 23:54:12,196][106226] Updated weights for policy 0, policy_version 648502 (0.0009) [2023-12-27 23:54:12,249][106226] Updated weights for policy 0, policy_version 648512 (0.0009) [2023-12-27 23:54:12,322][106225] Updated weights for policy 1, policy_version 650445 (0.0009) [2023-12-27 23:54:12,398][106225] Updated weights for policy 1, policy_version 650455 (0.0010) [2023-12-27 23:54:12,462][106225] Updated weights for policy 1, policy_version 650465 (0.0008) [2023-12-27 23:54:13,012][106226] Updated weights for policy 0, policy_version 648522 (0.0008) [2023-12-27 23:54:13,062][106226] Updated weights for policy 0, policy_version 648532 (0.0009) [2023-12-27 23:54:13,110][106226] Updated weights for policy 0, policy_version 648542 (0.0009) [2023-12-27 23:54:13,198][106225] Updated weights for policy 1, policy_version 650475 (0.0008) [2023-12-27 23:54:13,260][106225] Updated weights for policy 1, policy_version 650485 (0.0009) [2023-12-27 23:54:13,319][106225] Updated weights for policy 1, policy_version 650495 (0.0008) [2023-12-27 23:54:13,887][106226] Updated weights for policy 0, policy_version 648552 (0.0008) [2023-12-27 23:54:13,936][106226] Updated weights for policy 0, policy_version 648562 (0.0007) [2023-12-27 23:54:13,983][106226] Updated weights for policy 0, policy_version 648572 (0.0008) [2023-12-27 23:54:13,998][106225] Updated weights for policy 1, policy_version 650505 (0.0008) [2023-12-27 23:54:14,050][106225] Updated weights for policy 1, policy_version 650515 (0.0008) [2023-12-27 23:54:14,104][106225] Updated weights for policy 1, policy_version 650525 (0.0008) [2023-12-27 23:54:14,155][106225] Updated weights for policy 1, policy_version 650535 (0.0009) [2023-12-27 23:54:14,738][106226] Updated weights for policy 0, policy_version 648582 (0.0008) [2023-12-27 23:54:14,808][106226] Updated weights for policy 0, policy_version 648592 (0.0008) [2023-12-27 23:54:14,865][106226] Updated weights for policy 0, policy_version 648602 (0.0009) [2023-12-27 23:54:14,909][106225] Updated weights for policy 1, policy_version 650545 (0.0010) [2023-12-27 23:54:14,968][106225] Updated weights for policy 1, policy_version 650555 (0.0006) [2023-12-27 23:54:15,030][106225] Updated weights for policy 1, policy_version 650565 (0.0010) [2023-12-27 23:54:15,577][106226] Updated weights for policy 0, policy_version 648612 (0.0007) [2023-12-27 23:54:15,626][106226] Updated weights for policy 0, policy_version 648622 (0.0008) [2023-12-27 23:54:15,678][106226] Updated weights for policy 0, policy_version 648632 (0.0010) [2023-12-27 23:54:15,696][106225] Updated weights for policy 1, policy_version 650575 (0.0007) [2023-12-27 23:54:15,758][106225] Updated weights for policy 1, policy_version 650585 (0.0007) [2023-12-27 23:54:15,819][106225] Updated weights for policy 1, policy_version 650595 (0.0008) [2023-12-27 23:54:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 332677120. Throughput: 0: 9805.9, 1: 10012.1. Samples: 332666480. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:16,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-6.073')] [2023-12-27 23:54:16,357][106226] Updated weights for policy 0, policy_version 648642 (0.0009) [2023-12-27 23:54:16,419][106226] Updated weights for policy 0, policy_version 648652 (0.0011) [2023-12-27 23:54:16,460][106225] Updated weights for policy 1, policy_version 650605 (0.0007) [2023-12-27 23:54:16,480][106226] Updated weights for policy 0, policy_version 648662 (0.0011) [2023-12-27 23:54:16,512][106225] Updated weights for policy 1, policy_version 650615 (0.0007) [2023-12-27 23:54:16,542][106226] Updated weights for policy 0, policy_version 648672 (0.0010) [2023-12-27 23:54:16,560][106225] Updated weights for policy 1, policy_version 650625 (0.0006) [2023-12-27 23:54:17,089][106226] Updated weights for policy 0, policy_version 648682 (0.0005) [2023-12-27 23:54:17,132][106225] Updated weights for policy 1, policy_version 650635 (0.0005) [2023-12-27 23:54:17,140][106226] Updated weights for policy 0, policy_version 648692 (0.0007) [2023-12-27 23:54:17,189][106225] Updated weights for policy 1, policy_version 650645 (0.0005) [2023-12-27 23:54:17,190][106226] Updated weights for policy 0, policy_version 648702 (0.0009) [2023-12-27 23:54:17,242][106225] Updated weights for policy 1, policy_version 650655 (0.0005) [2023-12-27 23:54:17,751][106226] Updated weights for policy 0, policy_version 648712 (0.0006) [2023-12-27 23:54:17,810][106226] Updated weights for policy 0, policy_version 648722 (0.0005) [2023-12-27 23:54:17,868][106226] Updated weights for policy 0, policy_version 648732 (0.0005) [2023-12-27 23:54:17,901][106225] Updated weights for policy 1, policy_version 650665 (0.0006) [2023-12-27 23:54:17,964][106225] Updated weights for policy 1, policy_version 650675 (0.0010) [2023-12-27 23:54:18,017][106225] Updated weights for policy 1, policy_version 650685 (0.0010) [2023-12-27 23:54:18,074][106225] Updated weights for policy 1, policy_version 650695 (0.0010) [2023-12-27 23:54:18,505][106226] Updated weights for policy 0, policy_version 648742 (0.0005) [2023-12-27 23:54:18,560][106226] Updated weights for policy 0, policy_version 648752 (0.0005) [2023-12-27 23:54:18,617][106226] Updated weights for policy 0, policy_version 648762 (0.0006) [2023-12-27 23:54:18,793][106225] Updated weights for policy 1, policy_version 650705 (0.0008) [2023-12-27 23:54:18,854][106225] Updated weights for policy 1, policy_version 650715 (0.0010) [2023-12-27 23:54:18,918][106225] Updated weights for policy 1, policy_version 650725 (0.0010) [2023-12-27 23:54:19,294][106226] Updated weights for policy 0, policy_version 648772 (0.0007) [2023-12-27 23:54:19,361][106226] Updated weights for policy 0, policy_version 648782 (0.0007) [2023-12-27 23:54:19,428][106226] Updated weights for policy 0, policy_version 648792 (0.0008) [2023-12-27 23:54:19,677][106225] Updated weights for policy 1, policy_version 650735 (0.0007) [2023-12-27 23:54:19,744][106225] Updated weights for policy 1, policy_version 650745 (0.0007) [2023-12-27 23:54:19,808][106225] Updated weights for policy 1, policy_version 650755 (0.0010) [2023-12-27 23:54:20,171][106226] Updated weights for policy 0, policy_version 648802 (0.0008) [2023-12-27 23:54:20,236][106226] Updated weights for policy 0, policy_version 648812 (0.0009) [2023-12-27 23:54:20,304][106226] Updated weights for policy 0, policy_version 648822 (0.0009) [2023-12-27 23:54:20,369][106226] Updated weights for policy 0, policy_version 648832 (0.0009) [2023-12-27 23:54:20,504][106225] Updated weights for policy 1, policy_version 650765 (0.0010) [2023-12-27 23:54:20,567][106225] Updated weights for policy 1, policy_version 650775 (0.0010) [2023-12-27 23:54:20,637][106225] Updated weights for policy 1, policy_version 650785 (0.0008) [2023-12-27 23:54:21,150][106226] Updated weights for policy 0, policy_version 648842 (0.0008) [2023-12-27 23:54:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 332775424. Throughput: 0: 9795.6, 1: 10031.7. Samples: 332788800. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:21,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-6.261')] [2023-12-27 23:54:21,212][106226] Updated weights for policy 0, policy_version 648852 (0.0009) [2023-12-27 23:54:21,290][106226] Updated weights for policy 0, policy_version 648862 (0.0010) [2023-12-27 23:54:21,437][106225] Updated weights for policy 1, policy_version 650795 (0.0009) [2023-12-27 23:54:21,492][106225] Updated weights for policy 1, policy_version 650805 (0.0009) [2023-12-27 23:54:21,542][106225] Updated weights for policy 1, policy_version 650815 (0.0009) [2023-12-27 23:54:22,020][106226] Updated weights for policy 0, policy_version 648872 (0.0010) [2023-12-27 23:54:22,078][106226] Updated weights for policy 0, policy_version 648882 (0.0007) [2023-12-27 23:54:22,143][106226] Updated weights for policy 0, policy_version 648892 (0.0011) [2023-12-27 23:54:22,444][106225] Updated weights for policy 1, policy_version 650825 (0.0009) [2023-12-27 23:54:22,512][106225] Updated weights for policy 1, policy_version 650835 (0.0008) [2023-12-27 23:54:22,578][106225] Updated weights for policy 1, policy_version 650845 (0.0005) [2023-12-27 23:54:22,639][106225] Updated weights for policy 1, policy_version 650855 (0.0006) [2023-12-27 23:54:22,884][106226] Updated weights for policy 0, policy_version 648902 (0.0011) [2023-12-27 23:54:22,938][106226] Updated weights for policy 0, policy_version 648912 (0.0009) [2023-12-27 23:54:23,002][106226] Updated weights for policy 0, policy_version 648922 (0.0010) [2023-12-27 23:54:23,331][106225] Updated weights for policy 1, policy_version 650865 (0.0008) [2023-12-27 23:54:23,385][106225] Updated weights for policy 1, policy_version 650875 (0.0007) [2023-12-27 23:54:23,442][106225] Updated weights for policy 1, policy_version 650885 (0.0007) [2023-12-27 23:54:23,681][106226] Updated weights for policy 0, policy_version 648932 (0.0009) [2023-12-27 23:54:23,741][106226] Updated weights for policy 0, policy_version 648942 (0.0007) [2023-12-27 23:54:23,792][106226] Updated weights for policy 0, policy_version 648952 (0.0010) [2023-12-27 23:54:24,207][106225] Updated weights for policy 1, policy_version 650895 (0.0008) [2023-12-27 23:54:24,264][106225] Updated weights for policy 1, policy_version 650905 (0.0008) [2023-12-27 23:54:24,320][106225] Updated weights for policy 1, policy_version 650915 (0.0007) [2023-12-27 23:54:24,488][106226] Updated weights for policy 0, policy_version 648962 (0.0011) [2023-12-27 23:54:24,548][106226] Updated weights for policy 0, policy_version 648972 (0.0008) [2023-12-27 23:54:24,599][106226] Updated weights for policy 0, policy_version 648982 (0.0010) [2023-12-27 23:54:24,648][106226] Updated weights for policy 0, policy_version 648992 (0.0010) [2023-12-27 23:54:25,075][106225] Updated weights for policy 1, policy_version 650925 (0.0007) [2023-12-27 23:54:25,123][106225] Updated weights for policy 1, policy_version 650935 (0.0008) [2023-12-27 23:54:25,176][106225] Updated weights for policy 1, policy_version 650945 (0.0008) [2023-12-27 23:54:25,283][106226] Updated weights for policy 0, policy_version 649002 (0.0009) [2023-12-27 23:54:25,337][106226] Updated weights for policy 0, policy_version 649012 (0.0007) [2023-12-27 23:54:25,402][106226] Updated weights for policy 0, policy_version 649022 (0.0006) [2023-12-27 23:54:25,877][106225] Updated weights for policy 1, policy_version 650955 (0.0009) [2023-12-27 23:54:25,930][106225] Updated weights for policy 1, policy_version 650965 (0.0008) [2023-12-27 23:54:25,981][106226] Updated weights for policy 0, policy_version 649032 (0.0006) [2023-12-27 23:54:25,991][106225] Updated weights for policy 1, policy_version 650975 (0.0009) [2023-12-27 23:54:26,032][106226] Updated weights for policy 0, policy_version 649042 (0.0006) [2023-12-27 23:54:26,092][106226] Updated weights for policy 0, policy_version 649052 (0.0008) [2023-12-27 23:54:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 332881920. Throughput: 0: 9757.5, 1: 9961.2. Samples: 332844620. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:26,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-6.142')] [2023-12-27 23:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000649056_166199296.pth... [2023-12-27 23:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000650984_166682624.pth... [2023-12-27 23:54:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000647904_165904384.pth [2023-12-27 23:54:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000649832_166387712.pth [2023-12-27 23:54:26,190][106140] Saving new best policy, reward=-4.175! [2023-12-27 23:54:26,708][106226] Updated weights for policy 0, policy_version 649062 (0.0007) [2023-12-27 23:54:26,767][106226] Updated weights for policy 0, policy_version 649072 (0.0007) [2023-12-27 23:54:26,772][106225] Updated weights for policy 1, policy_version 650985 (0.0008) [2023-12-27 23:54:26,818][106226] Updated weights for policy 0, policy_version 649082 (0.0007) [2023-12-27 23:54:26,830][106225] Updated weights for policy 1, policy_version 650995 (0.0008) [2023-12-27 23:54:26,886][106225] Updated weights for policy 1, policy_version 651005 (0.0008) [2023-12-27 23:54:26,938][106225] Updated weights for policy 1, policy_version 651015 (0.0008) [2023-12-27 23:54:27,459][106226] Updated weights for policy 0, policy_version 649092 (0.0008) [2023-12-27 23:54:27,514][106226] Updated weights for policy 0, policy_version 649102 (0.0005) [2023-12-27 23:54:27,565][106226] Updated weights for policy 0, policy_version 649112 (0.0005) [2023-12-27 23:54:27,711][106225] Updated weights for policy 1, policy_version 651025 (0.0009) [2023-12-27 23:54:27,767][106225] Updated weights for policy 1, policy_version 651035 (0.0009) [2023-12-27 23:54:27,833][106225] Updated weights for policy 1, policy_version 651045 (0.0010) [2023-12-27 23:54:28,122][106226] Updated weights for policy 0, policy_version 649122 (0.0005) [2023-12-27 23:54:28,182][106226] Updated weights for policy 0, policy_version 649132 (0.0008) [2023-12-27 23:54:28,238][106226] Updated weights for policy 0, policy_version 649142 (0.0009) [2023-12-27 23:54:28,294][106226] Updated weights for policy 0, policy_version 649152 (0.0010) [2023-12-27 23:54:28,584][106225] Updated weights for policy 1, policy_version 651055 (0.0008) [2023-12-27 23:54:28,639][106225] Updated weights for policy 1, policy_version 651065 (0.0008) [2023-12-27 23:54:28,692][106225] Updated weights for policy 1, policy_version 651075 (0.0008) [2023-12-27 23:54:29,015][106226] Updated weights for policy 0, policy_version 649162 (0.0011) [2023-12-27 23:54:29,069][106226] Updated weights for policy 0, policy_version 649172 (0.0011) [2023-12-27 23:54:29,131][106226] Updated weights for policy 0, policy_version 649182 (0.0011) [2023-12-27 23:54:29,466][106225] Updated weights for policy 1, policy_version 651085 (0.0008) [2023-12-27 23:54:29,527][106225] Updated weights for policy 1, policy_version 651095 (0.0008) [2023-12-27 23:54:29,589][106225] Updated weights for policy 1, policy_version 651105 (0.0008) [2023-12-27 23:54:29,769][106226] Updated weights for policy 0, policy_version 649192 (0.0009) [2023-12-27 23:54:29,824][106226] Updated weights for policy 0, policy_version 649202 (0.0010) [2023-12-27 23:54:29,891][106226] Updated weights for policy 0, policy_version 649212 (0.0006) [2023-12-27 23:54:30,225][106225] Updated weights for policy 1, policy_version 651115 (0.0008) [2023-12-27 23:54:30,271][106225] Updated weights for policy 1, policy_version 651125 (0.0007) [2023-12-27 23:54:30,318][106225] Updated weights for policy 1, policy_version 651135 (0.0008) [2023-12-27 23:54:30,540][106226] Updated weights for policy 0, policy_version 649222 (0.0009) [2023-12-27 23:54:30,598][106226] Updated weights for policy 0, policy_version 649232 (0.0010) [2023-12-27 23:54:30,650][106226] Updated weights for policy 0, policy_version 649242 (0.0006) [2023-12-27 23:54:31,092][106225] Updated weights for policy 1, policy_version 651145 (0.0008) [2023-12-27 23:54:31,155][106225] Updated weights for policy 1, policy_version 651155 (0.0007) [2023-12-27 23:54:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 332972032. Throughput: 0: 9843.4, 1: 9862.8. Samples: 332964708. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:31,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-6.113')] [2023-12-27 23:54:31,218][106225] Updated weights for policy 1, policy_version 651165 (0.0008) [2023-12-27 23:54:31,286][106225] Updated weights for policy 1, policy_version 651175 (0.0008) [2023-12-27 23:54:31,425][106226] Updated weights for policy 0, policy_version 649252 (0.0011) [2023-12-27 23:54:31,486][106226] Updated weights for policy 0, policy_version 649262 (0.0010) [2023-12-27 23:54:31,542][106226] Updated weights for policy 0, policy_version 649272 (0.0011) [2023-12-27 23:54:32,134][106225] Updated weights for policy 1, policy_version 651185 (0.0006) [2023-12-27 23:54:32,174][106226] Updated weights for policy 0, policy_version 649282 (0.0009) [2023-12-27 23:54:32,192][106225] Updated weights for policy 1, policy_version 651195 (0.0005) [2023-12-27 23:54:32,231][106226] Updated weights for policy 0, policy_version 649292 (0.0010) [2023-12-27 23:54:32,255][106225] Updated weights for policy 1, policy_version 651205 (0.0006) [2023-12-27 23:54:32,300][106226] Updated weights for policy 0, policy_version 649302 (0.0012) [2023-12-27 23:54:32,364][106226] Updated weights for policy 0, policy_version 649312 (0.0010) [2023-12-27 23:54:32,908][106225] Updated weights for policy 1, policy_version 651215 (0.0007) [2023-12-27 23:54:32,965][106225] Updated weights for policy 1, policy_version 651225 (0.0007) [2023-12-27 23:54:33,022][106225] Updated weights for policy 1, policy_version 651235 (0.0007) [2023-12-27 23:54:33,050][106226] Updated weights for policy 0, policy_version 649322 (0.0007) [2023-12-27 23:54:33,096][106226] Updated weights for policy 0, policy_version 649332 (0.0007) [2023-12-27 23:54:33,142][106226] Updated weights for policy 0, policy_version 649342 (0.0007) [2023-12-27 23:54:33,670][106225] Updated weights for policy 1, policy_version 651245 (0.0007) [2023-12-27 23:54:33,721][106225] Updated weights for policy 1, policy_version 651255 (0.0005) [2023-12-27 23:54:33,732][106226] Updated weights for policy 0, policy_version 649352 (0.0009) [2023-12-27 23:54:33,769][106225] Updated weights for policy 1, policy_version 651265 (0.0005) [2023-12-27 23:54:33,794][106226] Updated weights for policy 0, policy_version 649362 (0.0010) [2023-12-27 23:54:33,843][106226] Updated weights for policy 0, policy_version 649372 (0.0010) [2023-12-27 23:54:34,360][106225] Updated weights for policy 1, policy_version 651275 (0.0006) [2023-12-27 23:54:34,418][106225] Updated weights for policy 1, policy_version 651285 (0.0008) [2023-12-27 23:54:34,479][106225] Updated weights for policy 1, policy_version 651295 (0.0008) [2023-12-27 23:54:34,549][106226] Updated weights for policy 0, policy_version 649382 (0.0009) [2023-12-27 23:54:34,609][106226] Updated weights for policy 0, policy_version 649392 (0.0010) [2023-12-27 23:54:34,664][106226] Updated weights for policy 0, policy_version 649402 (0.0010) [2023-12-27 23:54:35,263][106225] Updated weights for policy 1, policy_version 651305 (0.0007) [2023-12-27 23:54:35,266][106226] Updated weights for policy 0, policy_version 649412 (0.0008) [2023-12-27 23:54:35,323][106225] Updated weights for policy 1, policy_version 651315 (0.0008) [2023-12-27 23:54:35,323][106226] Updated weights for policy 0, policy_version 649422 (0.0007) [2023-12-27 23:54:35,382][106225] Updated weights for policy 1, policy_version 651325 (0.0009) [2023-12-27 23:54:35,384][106226] Updated weights for policy 0, policy_version 649432 (0.0011) [2023-12-27 23:54:35,438][106225] Updated weights for policy 1, policy_version 651335 (0.0007) [2023-12-27 23:54:36,042][106226] Updated weights for policy 0, policy_version 649442 (0.0008) [2023-12-27 23:54:36,105][106226] Updated weights for policy 0, policy_version 649452 (0.0010) [2023-12-27 23:54:36,171][106226] Updated weights for policy 0, policy_version 649462 (0.0008) [2023-12-27 23:54:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 333070336. Throughput: 0: 9965.6, 1: 9858.5. Samples: 333087136. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:36,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-6.214')] [2023-12-27 23:54:36,205][106225] Updated weights for policy 1, policy_version 651345 (0.0009) [2023-12-27 23:54:36,234][106226] Updated weights for policy 0, policy_version 649472 (0.0007) [2023-12-27 23:54:36,269][106225] Updated weights for policy 1, policy_version 651355 (0.0009) [2023-12-27 23:54:36,323][106225] Updated weights for policy 1, policy_version 651365 (0.0010) [2023-12-27 23:54:36,917][106226] Updated weights for policy 0, policy_version 649482 (0.0008) [2023-12-27 23:54:36,973][106226] Updated weights for policy 0, policy_version 649492 (0.0009) [2023-12-27 23:54:37,031][106226] Updated weights for policy 0, policy_version 649502 (0.0008) [2023-12-27 23:54:37,063][106225] Updated weights for policy 1, policy_version 651375 (0.0009) [2023-12-27 23:54:37,118][106225] Updated weights for policy 1, policy_version 651385 (0.0009) [2023-12-27 23:54:37,180][106225] Updated weights for policy 1, policy_version 651395 (0.0008) [2023-12-27 23:54:37,749][106226] Updated weights for policy 0, policy_version 649512 (0.0006) [2023-12-27 23:54:37,804][106226] Updated weights for policy 0, policy_version 649522 (0.0005) [2023-12-27 23:54:37,859][106226] Updated weights for policy 0, policy_version 649532 (0.0005) [2023-12-27 23:54:37,945][106225] Updated weights for policy 1, policy_version 651405 (0.0009) [2023-12-27 23:54:37,998][106225] Updated weights for policy 1, policy_version 651415 (0.0008) [2023-12-27 23:54:38,047][106225] Updated weights for policy 1, policy_version 651425 (0.0008) [2023-12-27 23:54:38,509][106226] Updated weights for policy 0, policy_version 649542 (0.0007) [2023-12-27 23:54:38,567][106226] Updated weights for policy 0, policy_version 649552 (0.0007) [2023-12-27 23:54:38,629][106226] Updated weights for policy 0, policy_version 649562 (0.0007) [2023-12-27 23:54:38,751][106225] Updated weights for policy 1, policy_version 651435 (0.0009) [2023-12-27 23:54:38,820][106225] Updated weights for policy 1, policy_version 651445 (0.0008) [2023-12-27 23:54:38,881][106225] Updated weights for policy 1, policy_version 651455 (0.0006) [2023-12-27 23:54:39,301][106226] Updated weights for policy 0, policy_version 649572 (0.0007) [2023-12-27 23:54:39,361][106226] Updated weights for policy 0, policy_version 649582 (0.0007) [2023-12-27 23:54:39,439][106226] Updated weights for policy 0, policy_version 649592 (0.0009) [2023-12-27 23:54:39,568][106225] Updated weights for policy 1, policy_version 651465 (0.0008) [2023-12-27 23:54:39,635][106225] Updated weights for policy 1, policy_version 651475 (0.0008) [2023-12-27 23:54:39,701][106225] Updated weights for policy 1, policy_version 651485 (0.0008) [2023-12-27 23:54:39,762][106225] Updated weights for policy 1, policy_version 651495 (0.0009) [2023-12-27 23:54:40,210][106226] Updated weights for policy 0, policy_version 649602 (0.0010) [2023-12-27 23:54:40,278][106226] Updated weights for policy 0, policy_version 649612 (0.0011) [2023-12-27 23:54:40,343][106226] Updated weights for policy 0, policy_version 649622 (0.0011) [2023-12-27 23:54:40,407][106226] Updated weights for policy 0, policy_version 649632 (0.0011) [2023-12-27 23:54:40,535][106225] Updated weights for policy 1, policy_version 651505 (0.0007) [2023-12-27 23:54:40,582][106225] Updated weights for policy 1, policy_version 651515 (0.0007) [2023-12-27 23:54:40,636][106225] Updated weights for policy 1, policy_version 651525 (0.0008) [2023-12-27 23:54:41,141][106226] Updated weights for policy 0, policy_version 649642 (0.0011) [2023-12-27 23:54:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 333168640. Throughput: 0: 9979.1, 1: 9824.7. Samples: 333145292. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:41,176][105115] Avg episode reward: [(0, '-4.617'), (1, '-6.469')] [2023-12-27 23:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000651528_166821888.pth... [2023-12-27 23:54:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000650408_166535168.pth [2023-12-27 23:54:41,210][106226] Updated weights for policy 0, policy_version 649652 (0.0010) [2023-12-27 23:54:41,278][106226] Updated weights for policy 0, policy_version 649662 (0.0008) [2023-12-27 23:54:41,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000649664_166354944.pth... [2023-12-27 23:54:41,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000648480_166051840.pth [2023-12-27 23:54:41,367][106225] Updated weights for policy 1, policy_version 651535 (0.0008) [2023-12-27 23:54:41,439][106225] Updated weights for policy 1, policy_version 651545 (0.0009) [2023-12-27 23:54:41,508][106225] Updated weights for policy 1, policy_version 651555 (0.0009) [2023-12-27 23:54:42,096][106226] Updated weights for policy 0, policy_version 649672 (0.0009) [2023-12-27 23:54:42,156][106226] Updated weights for policy 0, policy_version 649682 (0.0009) [2023-12-27 23:54:42,221][106226] Updated weights for policy 0, policy_version 649692 (0.0010) [2023-12-27 23:54:42,260][106225] Updated weights for policy 1, policy_version 651565 (0.0008) [2023-12-27 23:54:42,328][106225] Updated weights for policy 1, policy_version 651575 (0.0007) [2023-12-27 23:54:42,394][106225] Updated weights for policy 1, policy_version 651585 (0.0008) [2023-12-27 23:54:42,944][106226] Updated weights for policy 0, policy_version 649702 (0.0007) [2023-12-27 23:54:43,011][106226] Updated weights for policy 0, policy_version 649712 (0.0009) [2023-12-27 23:54:43,050][106225] Updated weights for policy 1, policy_version 651595 (0.0009) [2023-12-27 23:54:43,061][106226] Updated weights for policy 0, policy_version 649722 (0.0007) [2023-12-27 23:54:43,106][106225] Updated weights for policy 1, policy_version 651605 (0.0010) [2023-12-27 23:54:43,159][106225] Updated weights for policy 1, policy_version 651615 (0.0008) [2023-12-27 23:54:43,789][106226] Updated weights for policy 0, policy_version 649732 (0.0008) [2023-12-27 23:54:43,809][106225] Updated weights for policy 1, policy_version 651625 (0.0010) [2023-12-27 23:54:43,832][106226] Updated weights for policy 0, policy_version 649742 (0.0006) [2023-12-27 23:54:43,861][106225] Updated weights for policy 1, policy_version 651635 (0.0010) [2023-12-27 23:54:43,880][106226] Updated weights for policy 0, policy_version 649752 (0.0007) [2023-12-27 23:54:43,915][106225] Updated weights for policy 1, policy_version 651645 (0.0010) [2023-12-27 23:54:43,978][106225] Updated weights for policy 1, policy_version 651655 (0.0010) [2023-12-27 23:54:44,635][106226] Updated weights for policy 0, policy_version 649762 (0.0007) [2023-12-27 23:54:44,641][106225] Updated weights for policy 1, policy_version 651665 (0.0010) [2023-12-27 23:54:44,683][106226] Updated weights for policy 0, policy_version 649772 (0.0007) [2023-12-27 23:54:44,695][106225] Updated weights for policy 1, policy_version 651675 (0.0010) [2023-12-27 23:54:44,729][106226] Updated weights for policy 0, policy_version 649782 (0.0009) [2023-12-27 23:54:44,752][106225] Updated weights for policy 1, policy_version 651685 (0.0006) [2023-12-27 23:54:44,796][106226] Updated weights for policy 0, policy_version 649792 (0.0009) [2023-12-27 23:54:45,484][106226] Updated weights for policy 0, policy_version 649802 (0.0006) [2023-12-27 23:54:45,489][106225] Updated weights for policy 1, policy_version 651695 (0.0010) [2023-12-27 23:54:45,531][106226] Updated weights for policy 0, policy_version 649812 (0.0010) [2023-12-27 23:54:45,546][106225] Updated weights for policy 1, policy_version 651705 (0.0010) [2023-12-27 23:54:45,577][106226] Updated weights for policy 0, policy_version 649822 (0.0010) [2023-12-27 23:54:45,599][106225] Updated weights for policy 1, policy_version 651715 (0.0010) [2023-12-27 23:54:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 333266944. Throughput: 0: 10022.3, 1: 9743.9. Samples: 333259328. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:46,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-5.914')] [2023-12-27 23:54:46,256][106226] Updated weights for policy 0, policy_version 649832 (0.0010) [2023-12-27 23:54:46,294][106225] Updated weights for policy 1, policy_version 651725 (0.0008) [2023-12-27 23:54:46,314][106226] Updated weights for policy 0, policy_version 649842 (0.0011) [2023-12-27 23:54:46,343][106225] Updated weights for policy 1, policy_version 651735 (0.0006) [2023-12-27 23:54:46,365][106226] Updated weights for policy 0, policy_version 649852 (0.0010) [2023-12-27 23:54:46,400][106225] Updated weights for policy 1, policy_version 651745 (0.0005) [2023-12-27 23:54:47,035][106225] Updated weights for policy 1, policy_version 651755 (0.0007) [2023-12-27 23:54:47,085][106225] Updated weights for policy 1, policy_version 651765 (0.0010) [2023-12-27 23:54:47,091][106226] Updated weights for policy 0, policy_version 649862 (0.0011) [2023-12-27 23:54:47,145][106225] Updated weights for policy 1, policy_version 651775 (0.0010) [2023-12-27 23:54:47,154][106226] Updated weights for policy 0, policy_version 649872 (0.0011) [2023-12-27 23:54:47,212][106226] Updated weights for policy 0, policy_version 649882 (0.0010) [2023-12-27 23:54:47,806][106225] Updated weights for policy 1, policy_version 651785 (0.0010) [2023-12-27 23:54:47,854][106225] Updated weights for policy 1, policy_version 651795 (0.0005) [2023-12-27 23:54:47,877][106226] Updated weights for policy 0, policy_version 649892 (0.0008) [2023-12-27 23:54:47,899][106225] Updated weights for policy 1, policy_version 651805 (0.0008) [2023-12-27 23:54:47,931][106226] Updated weights for policy 0, policy_version 649902 (0.0005) [2023-12-27 23:54:47,946][106225] Updated weights for policy 1, policy_version 651815 (0.0008) [2023-12-27 23:54:47,986][106226] Updated weights for policy 0, policy_version 649912 (0.0007) [2023-12-27 23:54:48,592][106225] Updated weights for policy 1, policy_version 651825 (0.0007) [2023-12-27 23:54:48,656][106225] Updated weights for policy 1, policy_version 651835 (0.0006) [2023-12-27 23:54:48,677][106226] Updated weights for policy 0, policy_version 649922 (0.0008) [2023-12-27 23:54:48,723][106225] Updated weights for policy 1, policy_version 651845 (0.0006) [2023-12-27 23:54:48,733][106226] Updated weights for policy 0, policy_version 649932 (0.0008) [2023-12-27 23:54:48,790][106226] Updated weights for policy 0, policy_version 649942 (0.0010) [2023-12-27 23:54:48,846][106226] Updated weights for policy 0, policy_version 649952 (0.0010) [2023-12-27 23:54:49,386][106225] Updated weights for policy 1, policy_version 651855 (0.0007) [2023-12-27 23:54:49,455][106225] Updated weights for policy 1, policy_version 651865 (0.0008) [2023-12-27 23:54:49,524][106225] Updated weights for policy 1, policy_version 651875 (0.0008) [2023-12-27 23:54:49,638][106226] Updated weights for policy 0, policy_version 649962 (0.0005) [2023-12-27 23:54:49,699][106226] Updated weights for policy 0, policy_version 649972 (0.0007) [2023-12-27 23:54:49,765][106226] Updated weights for policy 0, policy_version 649982 (0.0008) [2023-12-27 23:54:50,342][106225] Updated weights for policy 1, policy_version 651885 (0.0009) [2023-12-27 23:54:50,398][106225] Updated weights for policy 1, policy_version 651895 (0.0007) [2023-12-27 23:54:50,448][106225] Updated weights for policy 1, policy_version 651905 (0.0007) [2023-12-27 23:54:50,496][106226] Updated weights for policy 0, policy_version 649992 (0.0006) [2023-12-27 23:54:50,542][106226] Updated weights for policy 0, policy_version 650002 (0.0005) [2023-12-27 23:54:50,606][106226] Updated weights for policy 0, policy_version 650012 (0.0008) [2023-12-27 23:54:51,094][106225] Updated weights for policy 1, policy_version 651915 (0.0010) [2023-12-27 23:54:51,160][106225] Updated weights for policy 1, policy_version 651925 (0.0010) [2023-12-27 23:54:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 333365248. Throughput: 0: 10028.1, 1: 9697.4. Samples: 333379936. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-27 23:54:51,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-6.288')] [2023-12-27 23:54:51,222][106225] Updated weights for policy 1, policy_version 651935 (0.0010) [2023-12-27 23:54:51,225][106226] Updated weights for policy 0, policy_version 650022 (0.0006) [2023-12-27 23:54:51,308][106226] Updated weights for policy 0, policy_version 650032 (0.0010) [2023-12-27 23:54:51,384][106226] Updated weights for policy 0, policy_version 650042 (0.0009) [2023-12-27 23:54:51,956][106225] Updated weights for policy 1, policy_version 651945 (0.0009) [2023-12-27 23:54:52,025][106225] Updated weights for policy 1, policy_version 651955 (0.0009) [2023-12-27 23:54:52,080][106226] Updated weights for policy 0, policy_version 650052 (0.0009) [2023-12-27 23:54:52,089][106225] Updated weights for policy 1, policy_version 651965 (0.0009) [2023-12-27 23:54:52,143][106226] Updated weights for policy 0, policy_version 650062 (0.0007) [2023-12-27 23:54:52,155][106225] Updated weights for policy 1, policy_version 651975 (0.0009) [2023-12-27 23:54:52,201][106226] Updated weights for policy 0, policy_version 650072 (0.0006) [2023-12-27 23:54:52,873][106226] Updated weights for policy 0, policy_version 650082 (0.0008) [2023-12-27 23:54:52,910][106225] Updated weights for policy 1, policy_version 651985 (0.0007) [2023-12-27 23:54:52,940][106226] Updated weights for policy 0, policy_version 650092 (0.0008) [2023-12-27 23:54:52,975][106225] Updated weights for policy 1, policy_version 651995 (0.0009) [2023-12-27 23:54:53,005][106226] Updated weights for policy 0, policy_version 650102 (0.0007) [2023-12-27 23:54:53,028][106225] Updated weights for policy 1, policy_version 652005 (0.0010) [2023-12-27 23:54:53,074][106226] Updated weights for policy 0, policy_version 650112 (0.0007) [2023-12-27 23:54:53,704][106226] Updated weights for policy 0, policy_version 650122 (0.0008) [2023-12-27 23:54:53,709][106225] Updated weights for policy 1, policy_version 652015 (0.0010) [2023-12-27 23:54:53,767][106226] Updated weights for policy 0, policy_version 650132 (0.0006) [2023-12-27 23:54:53,768][106225] Updated weights for policy 1, policy_version 652025 (0.0010) [2023-12-27 23:54:53,816][106226] Updated weights for policy 0, policy_version 650142 (0.0008) [2023-12-27 23:54:53,822][106225] Updated weights for policy 1, policy_version 652035 (0.0010) [2023-12-27 23:54:54,470][106226] Updated weights for policy 0, policy_version 650152 (0.0007) [2023-12-27 23:54:54,531][106226] Updated weights for policy 0, policy_version 650162 (0.0008) [2023-12-27 23:54:54,537][106225] Updated weights for policy 1, policy_version 652045 (0.0010) [2023-12-27 23:54:54,592][106226] Updated weights for policy 0, policy_version 650172 (0.0005) [2023-12-27 23:54:54,598][106225] Updated weights for policy 1, policy_version 652055 (0.0010) [2023-12-27 23:54:54,657][106225] Updated weights for policy 1, policy_version 652065 (0.0010) [2023-12-27 23:54:55,292][106226] Updated weights for policy 0, policy_version 650182 (0.0007) [2023-12-27 23:54:55,340][106225] Updated weights for policy 1, policy_version 652075 (0.0010) [2023-12-27 23:54:55,350][106226] Updated weights for policy 0, policy_version 650192 (0.0006) [2023-12-27 23:54:55,400][106225] Updated weights for policy 1, policy_version 652085 (0.0010) [2023-12-27 23:54:55,406][106226] Updated weights for policy 0, policy_version 650202 (0.0006) [2023-12-27 23:54:55,455][106225] Updated weights for policy 1, policy_version 652095 (0.0009) [2023-12-27 23:54:55,968][106226] Updated weights for policy 0, policy_version 650212 (0.0005) [2023-12-27 23:54:56,032][106226] Updated weights for policy 0, policy_version 650222 (0.0005) [2023-12-27 23:54:56,071][106225] Updated weights for policy 1, policy_version 652105 (0.0010) [2023-12-27 23:54:56,081][106226] Updated weights for policy 0, policy_version 650232 (0.0005) [2023-12-27 23:54:56,141][106225] Updated weights for policy 1, policy_version 652115 (0.0010) [2023-12-27 23:54:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 333471744. Throughput: 0: 10009.0, 1: 9662.6. Samples: 333438980. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:54:56,176][105115] Avg episode reward: [(0, '-4.591'), (1, '-6.406')] [2023-12-27 23:54:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000650240_166502400.pth... [2023-12-27 23:54:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000649056_166199296.pth [2023-12-27 23:54:56,208][106225] Updated weights for policy 1, policy_version 652125 (0.0010) [2023-12-27 23:54:56,269][106225] Updated weights for policy 1, policy_version 652135 (0.0010) [2023-12-27 23:54:56,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000652136_166977536.pth... [2023-12-27 23:54:56,278][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000650984_166682624.pth [2023-12-27 23:54:56,617][106226] Updated weights for policy 0, policy_version 650242 (0.0005) [2023-12-27 23:54:56,672][106226] Updated weights for policy 0, policy_version 650252 (0.0005) [2023-12-27 23:54:56,731][106226] Updated weights for policy 0, policy_version 650262 (0.0007) [2023-12-27 23:54:56,788][106226] Updated weights for policy 0, policy_version 650272 (0.0007) [2023-12-27 23:54:56,935][106225] Updated weights for policy 1, policy_version 652145 (0.0010) [2023-12-27 23:54:56,991][106225] Updated weights for policy 1, policy_version 652155 (0.0010) [2023-12-27 23:54:57,047][106225] Updated weights for policy 1, policy_version 652165 (0.0010) [2023-12-27 23:54:57,477][106226] Updated weights for policy 0, policy_version 650282 (0.0008) [2023-12-27 23:54:57,535][106226] Updated weights for policy 0, policy_version 650292 (0.0009) [2023-12-27 23:54:57,594][106226] Updated weights for policy 0, policy_version 650302 (0.0008) [2023-12-27 23:54:57,711][106225] Updated weights for policy 1, policy_version 652175 (0.0007) [2023-12-27 23:54:57,762][106225] Updated weights for policy 1, policy_version 652185 (0.0007) [2023-12-27 23:54:57,815][106225] Updated weights for policy 1, policy_version 652195 (0.0005) [2023-12-27 23:54:58,253][106226] Updated weights for policy 0, policy_version 650312 (0.0008) [2023-12-27 23:54:58,315][106226] Updated weights for policy 0, policy_version 650322 (0.0008) [2023-12-27 23:54:58,390][106226] Updated weights for policy 0, policy_version 650332 (0.0009) [2023-12-27 23:54:58,417][106225] Updated weights for policy 1, policy_version 652205 (0.0007) [2023-12-27 23:54:58,482][106225] Updated weights for policy 1, policy_version 652215 (0.0009) [2023-12-27 23:54:58,549][106225] Updated weights for policy 1, policy_version 652225 (0.0007) [2023-12-27 23:54:59,166][106226] Updated weights for policy 0, policy_version 650342 (0.0008) [2023-12-27 23:54:59,235][106226] Updated weights for policy 0, policy_version 650352 (0.0008) [2023-12-27 23:54:59,299][106225] Updated weights for policy 1, policy_version 652235 (0.0006) [2023-12-27 23:54:59,306][106226] Updated weights for policy 0, policy_version 650362 (0.0008) [2023-12-27 23:54:59,371][106225] Updated weights for policy 1, policy_version 652245 (0.0008) [2023-12-27 23:54:59,439][106225] Updated weights for policy 1, policy_version 652255 (0.0005) [2023-12-27 23:55:00,082][106226] Updated weights for policy 0, policy_version 650372 (0.0008) [2023-12-27 23:55:00,093][106225] Updated weights for policy 1, policy_version 652265 (0.0006) [2023-12-27 23:55:00,132][106226] Updated weights for policy 0, policy_version 650382 (0.0010) [2023-12-27 23:55:00,151][106225] Updated weights for policy 1, policy_version 652275 (0.0010) [2023-12-27 23:55:00,183][106226] Updated weights for policy 0, policy_version 650392 (0.0010) [2023-12-27 23:55:00,202][106225] Updated weights for policy 1, policy_version 652285 (0.0010) [2023-12-27 23:55:00,253][106225] Updated weights for policy 1, policy_version 652295 (0.0010) [2023-12-27 23:55:00,809][106226] Updated weights for policy 0, policy_version 650402 (0.0009) [2023-12-27 23:55:00,864][106226] Updated weights for policy 0, policy_version 650412 (0.0006) [2023-12-27 23:55:00,919][106226] Updated weights for policy 0, policy_version 650422 (0.0009) [2023-12-27 23:55:00,975][106226] Updated weights for policy 0, policy_version 650432 (0.0007) [2023-12-27 23:55:00,976][106225] Updated weights for policy 1, policy_version 652305 (0.0006) [2023-12-27 23:55:01,038][106225] Updated weights for policy 1, policy_version 652315 (0.0007) [2023-12-27 23:55:01,098][106225] Updated weights for policy 1, policy_version 652325 (0.0007) [2023-12-27 23:55:01,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 333578240. Throughput: 0: 10121.6, 1: 9778.3. Samples: 333561976. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:01,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.909')] [2023-12-27 23:55:01,711][106226] Updated weights for policy 0, policy_version 650442 (0.0008) [2023-12-27 23:55:01,778][106226] Updated weights for policy 0, policy_version 650452 (0.0009) [2023-12-27 23:55:01,804][106225] Updated weights for policy 1, policy_version 652335 (0.0006) [2023-12-27 23:55:01,835][106226] Updated weights for policy 0, policy_version 650462 (0.0009) [2023-12-27 23:55:01,848][106225] Updated weights for policy 1, policy_version 652345 (0.0008) [2023-12-27 23:55:01,903][106225] Updated weights for policy 1, policy_version 652355 (0.0008) [2023-12-27 23:55:02,613][106226] Updated weights for policy 0, policy_version 650472 (0.0008) [2023-12-27 23:55:02,663][106226] Updated weights for policy 0, policy_version 650482 (0.0008) [2023-12-27 23:55:02,667][106225] Updated weights for policy 1, policy_version 652365 (0.0008) [2023-12-27 23:55:02,711][106226] Updated weights for policy 0, policy_version 650492 (0.0008) [2023-12-27 23:55:02,718][106225] Updated weights for policy 1, policy_version 652375 (0.0006) [2023-12-27 23:55:02,768][106225] Updated weights for policy 1, policy_version 652385 (0.0008) [2023-12-27 23:55:03,351][106226] Updated weights for policy 0, policy_version 650502 (0.0008) [2023-12-27 23:55:03,400][106226] Updated weights for policy 0, policy_version 650512 (0.0008) [2023-12-27 23:55:03,458][106226] Updated weights for policy 0, policy_version 650522 (0.0008) [2023-12-27 23:55:03,466][106225] Updated weights for policy 1, policy_version 652395 (0.0008) [2023-12-27 23:55:03,527][106225] Updated weights for policy 1, policy_version 652405 (0.0005) [2023-12-27 23:55:03,591][106225] Updated weights for policy 1, policy_version 652415 (0.0006) [2023-12-27 23:55:04,176][106226] Updated weights for policy 0, policy_version 650532 (0.0009) [2023-12-27 23:55:04,240][106226] Updated weights for policy 0, policy_version 650542 (0.0009) [2023-12-27 23:55:04,274][106225] Updated weights for policy 1, policy_version 652425 (0.0008) [2023-12-27 23:55:04,300][106226] Updated weights for policy 0, policy_version 650552 (0.0008) [2023-12-27 23:55:04,333][106225] Updated weights for policy 1, policy_version 652435 (0.0006) [2023-12-27 23:55:04,387][106225] Updated weights for policy 1, policy_version 652445 (0.0007) [2023-12-27 23:55:04,447][106225] Updated weights for policy 1, policy_version 652455 (0.0008) [2023-12-27 23:55:04,919][106226] Updated weights for policy 0, policy_version 650562 (0.0008) [2023-12-27 23:55:04,970][106226] Updated weights for policy 0, policy_version 650572 (0.0005) [2023-12-27 23:55:05,042][106226] Updated weights for policy 0, policy_version 650582 (0.0008) [2023-12-27 23:55:05,111][106226] Updated weights for policy 0, policy_version 650592 (0.0009) [2023-12-27 23:55:05,246][106225] Updated weights for policy 1, policy_version 652465 (0.0008) [2023-12-27 23:55:05,305][106225] Updated weights for policy 1, policy_version 652475 (0.0006) [2023-12-27 23:55:05,370][106225] Updated weights for policy 1, policy_version 652485 (0.0007) [2023-12-27 23:55:05,769][106226] Updated weights for policy 0, policy_version 650602 (0.0008) [2023-12-27 23:55:05,821][106226] Updated weights for policy 0, policy_version 650612 (0.0008) [2023-12-27 23:55:05,875][106226] Updated weights for policy 0, policy_version 650622 (0.0008) [2023-12-27 23:55:06,058][106225] Updated weights for policy 1, policy_version 652495 (0.0008) [2023-12-27 23:55:06,122][106225] Updated weights for policy 1, policy_version 652505 (0.0008) [2023-12-27 23:55:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 333668352. Throughput: 0: 10094.5, 1: 9727.4. Samples: 333680784. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:06,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-5.639')] [2023-12-27 23:55:06,185][106225] Updated weights for policy 1, policy_version 652515 (0.0008) [2023-12-27 23:55:06,583][106226] Updated weights for policy 0, policy_version 650632 (0.0009) [2023-12-27 23:55:06,640][106226] Updated weights for policy 0, policy_version 650642 (0.0009) [2023-12-27 23:55:06,701][106226] Updated weights for policy 0, policy_version 650652 (0.0009) [2023-12-27 23:55:06,930][106225] Updated weights for policy 1, policy_version 652525 (0.0008) [2023-12-27 23:55:06,988][106225] Updated weights for policy 1, policy_version 652535 (0.0008) [2023-12-27 23:55:07,050][106225] Updated weights for policy 1, policy_version 652545 (0.0008) [2023-12-27 23:55:07,454][106226] Updated weights for policy 0, policy_version 650662 (0.0009) [2023-12-27 23:55:07,498][106226] Updated weights for policy 0, policy_version 650672 (0.0008) [2023-12-27 23:55:07,560][106226] Updated weights for policy 0, policy_version 650682 (0.0009) [2023-12-27 23:55:07,764][106225] Updated weights for policy 1, policy_version 652555 (0.0009) [2023-12-27 23:55:07,827][106225] Updated weights for policy 1, policy_version 652565 (0.0009) [2023-12-27 23:55:07,887][106225] Updated weights for policy 1, policy_version 652575 (0.0010) [2023-12-27 23:55:08,288][106226] Updated weights for policy 0, policy_version 650692 (0.0008) [2023-12-27 23:55:08,346][106226] Updated weights for policy 0, policy_version 650702 (0.0009) [2023-12-27 23:55:08,406][106226] Updated weights for policy 0, policy_version 650712 (0.0008) [2023-12-27 23:55:08,539][106225] Updated weights for policy 1, policy_version 652585 (0.0010) [2023-12-27 23:55:08,607][106225] Updated weights for policy 1, policy_version 652595 (0.0011) [2023-12-27 23:55:08,671][106225] Updated weights for policy 1, policy_version 652605 (0.0011) [2023-12-27 23:55:08,725][106225] Updated weights for policy 1, policy_version 652615 (0.0010) [2023-12-27 23:55:09,147][106226] Updated weights for policy 0, policy_version 650722 (0.0008) [2023-12-27 23:55:09,194][106226] Updated weights for policy 0, policy_version 650732 (0.0005) [2023-12-27 23:55:09,257][106226] Updated weights for policy 0, policy_version 650742 (0.0007) [2023-12-27 23:55:09,324][106226] Updated weights for policy 0, policy_version 650752 (0.0008) [2023-12-27 23:55:09,488][106225] Updated weights for policy 1, policy_version 652625 (0.0008) [2023-12-27 23:55:09,538][106225] Updated weights for policy 1, policy_version 652635 (0.0008) [2023-12-27 23:55:09,591][106225] Updated weights for policy 1, policy_version 652645 (0.0007) [2023-12-27 23:55:10,097][106226] Updated weights for policy 0, policy_version 650762 (0.0008) [2023-12-27 23:55:10,160][106226] Updated weights for policy 0, policy_version 650772 (0.0007) [2023-12-27 23:55:10,226][106226] Updated weights for policy 0, policy_version 650782 (0.0008) [2023-12-27 23:55:10,322][106225] Updated weights for policy 1, policy_version 652655 (0.0008) [2023-12-27 23:55:10,386][106225] Updated weights for policy 1, policy_version 652665 (0.0008) [2023-12-27 23:55:10,447][106225] Updated weights for policy 1, policy_version 652675 (0.0008) [2023-12-27 23:55:10,961][106226] Updated weights for policy 0, policy_version 650792 (0.0008) [2023-12-27 23:55:11,017][106226] Updated weights for policy 0, policy_version 650802 (0.0009) [2023-12-27 23:55:11,084][106226] Updated weights for policy 0, policy_version 650812 (0.0008) [2023-12-27 23:55:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 333766656. Throughput: 0: 10093.1, 1: 9776.7. Samples: 333738760. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:11,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-6.116')] [2023-12-27 23:55:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000650816_166649856.pth... [2023-12-27 23:55:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000649664_166354944.pth [2023-12-27 23:55:11,193][106225] Updated weights for policy 1, policy_version 652685 (0.0009) [2023-12-27 23:55:11,256][106225] Updated weights for policy 1, policy_version 652695 (0.0008) [2023-12-27 23:55:11,321][106225] Updated weights for policy 1, policy_version 652705 (0.0008) [2023-12-27 23:55:11,375][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000652712_167124992.pth... [2023-12-27 23:55:11,380][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000651528_166821888.pth [2023-12-27 23:55:11,881][106226] Updated weights for policy 0, policy_version 650822 (0.0009) [2023-12-27 23:55:11,946][106226] Updated weights for policy 0, policy_version 650832 (0.0009) [2023-12-27 23:55:12,010][106226] Updated weights for policy 0, policy_version 650842 (0.0008) [2023-12-27 23:55:12,079][106225] Updated weights for policy 1, policy_version 652715 (0.0009) [2023-12-27 23:55:12,142][106225] Updated weights for policy 1, policy_version 652725 (0.0006) [2023-12-27 23:55:12,210][106225] Updated weights for policy 1, policy_version 652735 (0.0007) [2023-12-27 23:55:12,800][106226] Updated weights for policy 0, policy_version 650852 (0.0009) [2023-12-27 23:55:12,849][106226] Updated weights for policy 0, policy_version 650862 (0.0009) [2023-12-27 23:55:12,903][106226] Updated weights for policy 0, policy_version 650872 (0.0009) [2023-12-27 23:55:13,009][106225] Updated weights for policy 1, policy_version 652745 (0.0008) [2023-12-27 23:55:13,073][106225] Updated weights for policy 1, policy_version 652755 (0.0010) [2023-12-27 23:55:13,119][106225] Updated weights for policy 1, policy_version 652765 (0.0010) [2023-12-27 23:55:13,182][106225] Updated weights for policy 1, policy_version 652775 (0.0009) [2023-12-27 23:55:13,596][106226] Updated weights for policy 0, policy_version 650882 (0.0007) [2023-12-27 23:55:13,651][106226] Updated weights for policy 0, policy_version 650892 (0.0005) [2023-12-27 23:55:13,708][106226] Updated weights for policy 0, policy_version 650902 (0.0005) [2023-12-27 23:55:13,758][106226] Updated weights for policy 0, policy_version 650912 (0.0005) [2023-12-27 23:55:13,878][106225] Updated weights for policy 1, policy_version 652785 (0.0009) [2023-12-27 23:55:13,930][106225] Updated weights for policy 1, policy_version 652795 (0.0005) [2023-12-27 23:55:13,981][106225] Updated weights for policy 1, policy_version 652805 (0.0006) [2023-12-27 23:55:14,446][106226] Updated weights for policy 0, policy_version 650922 (0.0005) [2023-12-27 23:55:14,515][106226] Updated weights for policy 0, policy_version 650932 (0.0007) [2023-12-27 23:55:14,570][106226] Updated weights for policy 0, policy_version 650942 (0.0008) [2023-12-27 23:55:14,668][106225] Updated weights for policy 1, policy_version 652815 (0.0008) [2023-12-27 23:55:14,715][106225] Updated weights for policy 1, policy_version 652825 (0.0010) [2023-12-27 23:55:14,779][106225] Updated weights for policy 1, policy_version 652835 (0.0012) [2023-12-27 23:55:15,253][106226] Updated weights for policy 0, policy_version 650952 (0.0008) [2023-12-27 23:55:15,318][106226] Updated weights for policy 0, policy_version 650962 (0.0005) [2023-12-27 23:55:15,386][106226] Updated weights for policy 0, policy_version 650972 (0.0006) [2023-12-27 23:55:15,534][106225] Updated weights for policy 1, policy_version 652845 (0.0009) [2023-12-27 23:55:15,594][106225] Updated weights for policy 1, policy_version 652855 (0.0010) [2023-12-27 23:55:15,658][106225] Updated weights for policy 1, policy_version 652865 (0.0010) [2023-12-27 23:55:15,947][106226] Updated weights for policy 0, policy_version 650982 (0.0006) [2023-12-27 23:55:15,998][106226] Updated weights for policy 0, policy_version 650992 (0.0005) [2023-12-27 23:55:16,052][106226] Updated weights for policy 0, policy_version 651002 (0.0005) [2023-12-27 23:55:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 333864960. Throughput: 0: 9909.5, 1: 9791.7. Samples: 333851264. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:16,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-5.751')] [2023-12-27 23:55:16,347][106225] Updated weights for policy 1, policy_version 652875 (0.0010) [2023-12-27 23:55:16,393][106225] Updated weights for policy 1, policy_version 652885 (0.0010) [2023-12-27 23:55:16,440][106225] Updated weights for policy 1, policy_version 652895 (0.0010) [2023-12-27 23:55:16,677][106226] Updated weights for policy 0, policy_version 651012 (0.0005) [2023-12-27 23:55:16,745][106226] Updated weights for policy 0, policy_version 651022 (0.0007) [2023-12-27 23:55:16,806][106226] Updated weights for policy 0, policy_version 651032 (0.0008) [2023-12-27 23:55:17,123][106225] Updated weights for policy 1, policy_version 652905 (0.0010) [2023-12-27 23:55:17,170][106225] Updated weights for policy 1, policy_version 652915 (0.0010) [2023-12-27 23:55:17,227][106225] Updated weights for policy 1, policy_version 652925 (0.0010) [2023-12-27 23:55:17,276][106225] Updated weights for policy 1, policy_version 652935 (0.0005) [2023-12-27 23:55:17,446][106226] Updated weights for policy 0, policy_version 651042 (0.0008) [2023-12-27 23:55:17,501][106226] Updated weights for policy 0, policy_version 651052 (0.0007) [2023-12-27 23:55:17,562][106226] Updated weights for policy 0, policy_version 651062 (0.0006) [2023-12-27 23:55:17,613][106226] Updated weights for policy 0, policy_version 651072 (0.0007) [2023-12-27 23:55:17,962][106225] Updated weights for policy 1, policy_version 652945 (0.0010) [2023-12-27 23:55:18,012][106225] Updated weights for policy 1, policy_version 652955 (0.0010) [2023-12-27 23:55:18,061][106225] Updated weights for policy 1, policy_version 652965 (0.0010) [2023-12-27 23:55:18,323][106226] Updated weights for policy 0, policy_version 651082 (0.0010) [2023-12-27 23:55:18,390][106226] Updated weights for policy 0, policy_version 651092 (0.0008) [2023-12-27 23:55:18,458][106226] Updated weights for policy 0, policy_version 651102 (0.0007) [2023-12-27 23:55:18,710][106225] Updated weights for policy 1, policy_version 652975 (0.0010) [2023-12-27 23:55:18,765][106225] Updated weights for policy 1, policy_version 652985 (0.0010) [2023-12-27 23:55:18,819][106225] Updated weights for policy 1, policy_version 652995 (0.0010) [2023-12-27 23:55:19,123][106226] Updated weights for policy 0, policy_version 651112 (0.0010) [2023-12-27 23:55:19,173][106226] Updated weights for policy 0, policy_version 651122 (0.0008) [2023-12-27 23:55:19,232][106226] Updated weights for policy 0, policy_version 651132 (0.0007) [2023-12-27 23:55:19,546][106225] Updated weights for policy 1, policy_version 653005 (0.0010) [2023-12-27 23:55:19,602][106225] Updated weights for policy 1, policy_version 653015 (0.0011) [2023-12-27 23:55:19,670][106225] Updated weights for policy 1, policy_version 653025 (0.0008) [2023-12-27 23:55:19,967][106226] Updated weights for policy 0, policy_version 651142 (0.0009) [2023-12-27 23:55:20,023][106226] Updated weights for policy 0, policy_version 651152 (0.0008) [2023-12-27 23:55:20,083][106226] Updated weights for policy 0, policy_version 651162 (0.0008) [2023-12-27 23:55:20,351][106225] Updated weights for policy 1, policy_version 653035 (0.0006) [2023-12-27 23:55:20,414][106225] Updated weights for policy 1, policy_version 653045 (0.0007) [2023-12-27 23:55:20,483][106225] Updated weights for policy 1, policy_version 653055 (0.0008) [2023-12-27 23:55:20,881][106226] Updated weights for policy 0, policy_version 651172 (0.0008) [2023-12-27 23:55:20,943][106226] Updated weights for policy 0, policy_version 651182 (0.0007) [2023-12-27 23:55:21,005][106226] Updated weights for policy 0, policy_version 651192 (0.0010) [2023-12-27 23:55:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 333963264. Throughput: 0: 9855.4, 1: 9803.1. Samples: 333971768. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:21,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.648')] [2023-12-27 23:55:21,233][106225] Updated weights for policy 1, policy_version 653065 (0.0008) [2023-12-27 23:55:21,299][106225] Updated weights for policy 1, policy_version 653075 (0.0008) [2023-12-27 23:55:21,353][106225] Updated weights for policy 1, policy_version 653085 (0.0008) [2023-12-27 23:55:21,423][106225] Updated weights for policy 1, policy_version 653095 (0.0008) [2023-12-27 23:55:21,728][106226] Updated weights for policy 0, policy_version 651202 (0.0012) [2023-12-27 23:55:21,796][106226] Updated weights for policy 0, policy_version 651212 (0.0010) [2023-12-27 23:55:21,860][106226] Updated weights for policy 0, policy_version 651222 (0.0008) [2023-12-27 23:55:21,919][106226] Updated weights for policy 0, policy_version 651232 (0.0009) [2023-12-27 23:55:22,172][106225] Updated weights for policy 1, policy_version 653105 (0.0006) [2023-12-27 23:55:22,230][106225] Updated weights for policy 1, policy_version 653115 (0.0006) [2023-12-27 23:55:22,310][106225] Updated weights for policy 1, policy_version 653125 (0.0008) [2023-12-27 23:55:22,689][106226] Updated weights for policy 0, policy_version 651242 (0.0009) [2023-12-27 23:55:22,750][106226] Updated weights for policy 0, policy_version 651252 (0.0009) [2023-12-27 23:55:22,817][106226] Updated weights for policy 0, policy_version 651262 (0.0009) [2023-12-27 23:55:22,969][106225] Updated weights for policy 1, policy_version 653135 (0.0009) [2023-12-27 23:55:23,023][106225] Updated weights for policy 1, policy_version 653145 (0.0008) [2023-12-27 23:55:23,083][106225] Updated weights for policy 1, policy_version 653155 (0.0009) [2023-12-27 23:55:23,575][106226] Updated weights for policy 0, policy_version 651272 (0.0008) [2023-12-27 23:55:23,623][106226] Updated weights for policy 0, policy_version 651282 (0.0008) [2023-12-27 23:55:23,678][106226] Updated weights for policy 0, policy_version 651292 (0.0010) [2023-12-27 23:55:23,711][106225] Updated weights for policy 1, policy_version 653165 (0.0007) [2023-12-27 23:55:23,775][106225] Updated weights for policy 1, policy_version 653175 (0.0008) [2023-12-27 23:55:23,840][106225] Updated weights for policy 1, policy_version 653185 (0.0008) [2023-12-27 23:55:24,336][106226] Updated weights for policy 0, policy_version 651302 (0.0007) [2023-12-27 23:55:24,382][106226] Updated weights for policy 0, policy_version 651312 (0.0009) [2023-12-27 23:55:24,445][106226] Updated weights for policy 0, policy_version 651322 (0.0008) [2023-12-27 23:55:24,496][106225] Updated weights for policy 1, policy_version 653195 (0.0007) [2023-12-27 23:55:24,550][106225] Updated weights for policy 1, policy_version 653205 (0.0008) [2023-12-27 23:55:24,604][106225] Updated weights for policy 1, policy_version 653215 (0.0008) [2023-12-27 23:55:25,212][106226] Updated weights for policy 0, policy_version 651332 (0.0008) [2023-12-27 23:55:25,221][106225] Updated weights for policy 1, policy_version 653225 (0.0005) [2023-12-27 23:55:25,267][106226] Updated weights for policy 0, policy_version 651342 (0.0007) [2023-12-27 23:55:25,272][106225] Updated weights for policy 1, policy_version 653235 (0.0008) [2023-12-27 23:55:25,322][106226] Updated weights for policy 0, policy_version 651352 (0.0007) [2023-12-27 23:55:25,327][106225] Updated weights for policy 1, policy_version 653245 (0.0006) [2023-12-27 23:55:25,386][106225] Updated weights for policy 1, policy_version 653255 (0.0008) [2023-12-27 23:55:26,045][106225] Updated weights for policy 1, policy_version 653265 (0.0006) [2023-12-27 23:55:26,096][106226] Updated weights for policy 0, policy_version 651362 (0.0008) [2023-12-27 23:55:26,104][106225] Updated weights for policy 1, policy_version 653275 (0.0010) [2023-12-27 23:55:26,158][106225] Updated weights for policy 1, policy_version 653285 (0.0010) [2023-12-27 23:55:26,159][106226] Updated weights for policy 0, policy_version 651372 (0.0007) [2023-12-27 23:55:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 334061568. Throughput: 0: 9819.1, 1: 9831.9. Samples: 334029580. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:26,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-6.489')] [2023-12-27 23:55:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000653288_167272448.pth... [2023-12-27 23:55:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000652136_166977536.pth [2023-12-27 23:55:26,219][106226] Updated weights for policy 0, policy_version 651382 (0.0007) [2023-12-27 23:55:26,268][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000651392_166797312.pth... [2023-12-27 23:55:26,269][106226] Updated weights for policy 0, policy_version 651392 (0.0008) [2023-12-27 23:55:26,271][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000650240_166502400.pth [2023-12-27 23:55:26,785][106225] Updated weights for policy 1, policy_version 653295 (0.0009) [2023-12-27 23:55:26,837][106225] Updated weights for policy 1, policy_version 653305 (0.0008) [2023-12-27 23:55:26,886][106225] Updated weights for policy 1, policy_version 653315 (0.0008) [2023-12-27 23:55:27,001][106226] Updated weights for policy 0, policy_version 651402 (0.0009) [2023-12-27 23:55:27,045][106226] Updated weights for policy 0, policy_version 651412 (0.0008) [2023-12-27 23:55:27,087][106226] Updated weights for policy 0, policy_version 651422 (0.0006) [2023-12-27 23:55:27,655][106226] Updated weights for policy 0, policy_version 651432 (0.0008) [2023-12-27 23:55:27,695][106225] Updated weights for policy 1, policy_version 653325 (0.0007) [2023-12-27 23:55:27,705][106226] Updated weights for policy 0, policy_version 651442 (0.0007) [2023-12-27 23:55:27,745][106225] Updated weights for policy 1, policy_version 653335 (0.0005) [2023-12-27 23:55:27,755][106226] Updated weights for policy 0, policy_version 651452 (0.0008) [2023-12-27 23:55:27,793][106225] Updated weights for policy 1, policy_version 653345 (0.0006) [2023-12-27 23:55:28,369][106226] Updated weights for policy 0, policy_version 651462 (0.0008) [2023-12-27 23:55:28,427][106226] Updated weights for policy 0, policy_version 651472 (0.0005) [2023-12-27 23:55:28,481][106226] Updated weights for policy 0, policy_version 651482 (0.0005) [2023-12-27 23:55:28,591][106225] Updated weights for policy 1, policy_version 653355 (0.0008) [2023-12-27 23:55:28,642][106225] Updated weights for policy 1, policy_version 653365 (0.0007) [2023-12-27 23:55:28,690][106225] Updated weights for policy 1, policy_version 653375 (0.0005) [2023-12-27 23:55:29,159][106226] Updated weights for policy 0, policy_version 651492 (0.0007) [2023-12-27 23:55:29,226][106226] Updated weights for policy 0, policy_version 651502 (0.0007) [2023-12-27 23:55:29,284][106226] Updated weights for policy 0, policy_version 651512 (0.0008) [2023-12-27 23:55:29,384][106225] Updated weights for policy 1, policy_version 653385 (0.0008) [2023-12-27 23:55:29,446][106225] Updated weights for policy 1, policy_version 653395 (0.0008) [2023-12-27 23:55:29,497][106225] Updated weights for policy 1, policy_version 653405 (0.0006) [2023-12-27 23:55:29,562][106225] Updated weights for policy 1, policy_version 653415 (0.0005) [2023-12-27 23:55:30,003][106226] Updated weights for policy 0, policy_version 651522 (0.0009) [2023-12-27 23:55:30,062][106226] Updated weights for policy 0, policy_version 651532 (0.0011) [2023-12-27 23:55:30,124][106226] Updated weights for policy 0, policy_version 651542 (0.0009) [2023-12-27 23:55:30,182][106226] Updated weights for policy 0, policy_version 651552 (0.0010) [2023-12-27 23:55:30,184][106225] Updated weights for policy 1, policy_version 653425 (0.0006) [2023-12-27 23:55:30,235][106225] Updated weights for policy 1, policy_version 653435 (0.0008) [2023-12-27 23:55:30,286][106225] Updated weights for policy 1, policy_version 653445 (0.0008) [2023-12-27 23:55:30,877][106226] Updated weights for policy 0, policy_version 651562 (0.0011) [2023-12-27 23:55:30,923][106226] Updated weights for policy 0, policy_version 651572 (0.0010) [2023-12-27 23:55:30,976][106226] Updated weights for policy 0, policy_version 651582 (0.0010) [2023-12-27 23:55:31,053][106225] Updated weights for policy 1, policy_version 653455 (0.0009) [2023-12-27 23:55:31,116][106225] Updated weights for policy 1, policy_version 653465 (0.0007) [2023-12-27 23:55:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 334159872. Throughput: 0: 9938.4, 1: 9884.3. Samples: 334151348. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:31,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.885')] [2023-12-27 23:55:31,178][106225] Updated weights for policy 1, policy_version 653475 (0.0008) [2023-12-27 23:55:31,775][106226] Updated weights for policy 0, policy_version 651592 (0.0009) [2023-12-27 23:55:31,828][106226] Updated weights for policy 0, policy_version 651602 (0.0007) [2023-12-27 23:55:31,890][106226] Updated weights for policy 0, policy_version 651612 (0.0007) [2023-12-27 23:55:31,922][106225] Updated weights for policy 1, policy_version 653485 (0.0008) [2023-12-27 23:55:31,977][106225] Updated weights for policy 1, policy_version 653495 (0.0006) [2023-12-27 23:55:32,028][106225] Updated weights for policy 1, policy_version 653505 (0.0007) [2023-12-27 23:55:32,597][106226] Updated weights for policy 0, policy_version 651622 (0.0011) [2023-12-27 23:55:32,655][106226] Updated weights for policy 0, policy_version 651632 (0.0011) [2023-12-27 23:55:32,715][106226] Updated weights for policy 0, policy_version 651642 (0.0010) [2023-12-27 23:55:32,764][106225] Updated weights for policy 1, policy_version 653515 (0.0008) [2023-12-27 23:55:32,825][106225] Updated weights for policy 1, policy_version 653525 (0.0007) [2023-12-27 23:55:32,878][106225] Updated weights for policy 1, policy_version 653535 (0.0009) [2023-12-27 23:55:33,331][106226] Updated weights for policy 0, policy_version 651652 (0.0009) [2023-12-27 23:55:33,393][106226] Updated weights for policy 0, policy_version 651662 (0.0009) [2023-12-27 23:55:33,448][106226] Updated weights for policy 0, policy_version 651672 (0.0009) [2023-12-27 23:55:33,577][106225] Updated weights for policy 1, policy_version 653545 (0.0010) [2023-12-27 23:55:33,624][106225] Updated weights for policy 1, policy_version 653555 (0.0005) [2023-12-27 23:55:33,670][106225] Updated weights for policy 1, policy_version 653565 (0.0006) [2023-12-27 23:55:33,719][106225] Updated weights for policy 1, policy_version 653575 (0.0007) [2023-12-27 23:55:34,161][106226] Updated weights for policy 0, policy_version 651682 (0.0008) [2023-12-27 23:55:34,229][106226] Updated weights for policy 0, policy_version 651692 (0.0008) [2023-12-27 23:55:34,288][106226] Updated weights for policy 0, policy_version 651702 (0.0008) [2023-12-27 23:55:34,347][106226] Updated weights for policy 0, policy_version 651712 (0.0008) [2023-12-27 23:55:34,441][106225] Updated weights for policy 1, policy_version 653585 (0.0008) [2023-12-27 23:55:34,500][106225] Updated weights for policy 1, policy_version 653595 (0.0008) [2023-12-27 23:55:34,558][106225] Updated weights for policy 1, policy_version 653605 (0.0008) [2023-12-27 23:55:35,099][106226] Updated weights for policy 0, policy_version 651722 (0.0010) [2023-12-27 23:55:35,155][106226] Updated weights for policy 0, policy_version 651732 (0.0011) [2023-12-27 23:55:35,204][106226] Updated weights for policy 0, policy_version 651742 (0.0010) [2023-12-27 23:55:35,310][106225] Updated weights for policy 1, policy_version 653615 (0.0007) [2023-12-27 23:55:35,372][106225] Updated weights for policy 1, policy_version 653625 (0.0007) [2023-12-27 23:55:35,434][106225] Updated weights for policy 1, policy_version 653635 (0.0007) [2023-12-27 23:55:35,965][106226] Updated weights for policy 0, policy_version 651752 (0.0011) [2023-12-27 23:55:36,028][106226] Updated weights for policy 0, policy_version 651762 (0.0011) [2023-12-27 23:55:36,078][106226] Updated weights for policy 0, policy_version 651772 (0.0010) [2023-12-27 23:55:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 334258176. Throughput: 0: 9893.2, 1: 9822.3. Samples: 334267136. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:36,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-6.385')] [2023-12-27 23:55:36,208][106225] Updated weights for policy 1, policy_version 653645 (0.0008) [2023-12-27 23:55:36,277][106225] Updated weights for policy 1, policy_version 653655 (0.0008) [2023-12-27 23:55:36,333][106225] Updated weights for policy 1, policy_version 653665 (0.0008) [2023-12-27 23:55:36,797][106226] Updated weights for policy 0, policy_version 651782 (0.0011) [2023-12-27 23:55:36,854][106226] Updated weights for policy 0, policy_version 651792 (0.0011) [2023-12-27 23:55:36,918][106226] Updated weights for policy 0, policy_version 651802 (0.0010) [2023-12-27 23:55:37,094][106225] Updated weights for policy 1, policy_version 653675 (0.0009) [2023-12-27 23:55:37,144][106225] Updated weights for policy 1, policy_version 653685 (0.0008) [2023-12-27 23:55:37,194][106225] Updated weights for policy 1, policy_version 653695 (0.0008) [2023-12-27 23:55:37,526][106226] Updated weights for policy 0, policy_version 651812 (0.0009) [2023-12-27 23:55:37,591][106226] Updated weights for policy 0, policy_version 651822 (0.0008) [2023-12-27 23:55:37,655][106226] Updated weights for policy 0, policy_version 651832 (0.0010) [2023-12-27 23:55:37,956][106225] Updated weights for policy 1, policy_version 653705 (0.0009) [2023-12-27 23:55:38,010][106225] Updated weights for policy 1, policy_version 653715 (0.0009) [2023-12-27 23:55:38,059][106225] Updated weights for policy 1, policy_version 653725 (0.0008) [2023-12-27 23:55:38,120][106225] Updated weights for policy 1, policy_version 653735 (0.0008) [2023-12-27 23:55:38,293][106226] Updated weights for policy 0, policy_version 651842 (0.0010) [2023-12-27 23:55:38,360][106226] Updated weights for policy 0, policy_version 651852 (0.0009) [2023-12-27 23:55:38,419][106226] Updated weights for policy 0, policy_version 651862 (0.0008) [2023-12-27 23:55:38,477][106226] Updated weights for policy 0, policy_version 651872 (0.0008) [2023-12-27 23:55:38,904][106225] Updated weights for policy 1, policy_version 653745 (0.0008) [2023-12-27 23:55:38,963][106225] Updated weights for policy 1, policy_version 653755 (0.0008) [2023-12-27 23:55:39,018][106225] Updated weights for policy 1, policy_version 653765 (0.0009) [2023-12-27 23:55:39,210][106226] Updated weights for policy 0, policy_version 651882 (0.0008) [2023-12-27 23:55:39,275][106226] Updated weights for policy 0, policy_version 651892 (0.0008) [2023-12-27 23:55:39,330][106226] Updated weights for policy 0, policy_version 651902 (0.0008) [2023-12-27 23:55:39,792][106225] Updated weights for policy 1, policy_version 653775 (0.0008) [2023-12-27 23:55:39,859][106225] Updated weights for policy 1, policy_version 653785 (0.0008) [2023-12-27 23:55:39,931][106225] Updated weights for policy 1, policy_version 653795 (0.0008) [2023-12-27 23:55:40,095][106226] Updated weights for policy 0, policy_version 651912 (0.0009) [2023-12-27 23:55:40,150][106226] Updated weights for policy 0, policy_version 651922 (0.0008) [2023-12-27 23:55:40,207][106226] Updated weights for policy 0, policy_version 651932 (0.0009) [2023-12-27 23:55:40,669][106225] Updated weights for policy 1, policy_version 653805 (0.0009) [2023-12-27 23:55:40,718][106225] Updated weights for policy 1, policy_version 653815 (0.0008) [2023-12-27 23:55:40,774][106225] Updated weights for policy 1, policy_version 653825 (0.0008) [2023-12-27 23:55:40,926][106226] Updated weights for policy 0, policy_version 651942 (0.0009) [2023-12-27 23:55:40,991][106226] Updated weights for policy 0, policy_version 651952 (0.0009) [2023-12-27 23:55:41,054][106226] Updated weights for policy 0, policy_version 651962 (0.0009) [2023-12-27 23:55:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 334356480. Throughput: 0: 9902.1, 1: 9800.0. Samples: 334325568. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:41,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-6.006')] [2023-12-27 23:55:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000651968_166944768.pth... [2023-12-27 23:55:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000653832_167411712.pth... [2023-12-27 23:55:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000652712_167124992.pth [2023-12-27 23:55:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000650816_166649856.pth [2023-12-27 23:55:41,551][106225] Updated weights for policy 1, policy_version 653835 (0.0007) [2023-12-27 23:55:41,622][106225] Updated weights for policy 1, policy_version 653845 (0.0008) [2023-12-27 23:55:41,696][106225] Updated weights for policy 1, policy_version 653855 (0.0008) [2023-12-27 23:55:41,843][106226] Updated weights for policy 0, policy_version 651972 (0.0006) [2023-12-27 23:55:41,911][106226] Updated weights for policy 0, policy_version 651982 (0.0006) [2023-12-27 23:55:41,979][106226] Updated weights for policy 0, policy_version 651992 (0.0006) [2023-12-27 23:55:42,480][106225] Updated weights for policy 1, policy_version 653865 (0.0008) [2023-12-27 23:55:42,536][106225] Updated weights for policy 1, policy_version 653875 (0.0008) [2023-12-27 23:55:42,596][106225] Updated weights for policy 1, policy_version 653885 (0.0008) [2023-12-27 23:55:42,602][106226] Updated weights for policy 0, policy_version 652002 (0.0006) [2023-12-27 23:55:42,651][106226] Updated weights for policy 0, policy_version 652012 (0.0007) [2023-12-27 23:55:42,653][106225] Updated weights for policy 1, policy_version 653895 (0.0007) [2023-12-27 23:55:42,697][106226] Updated weights for policy 0, policy_version 652022 (0.0008) [2023-12-27 23:55:42,753][106226] Updated weights for policy 0, policy_version 652032 (0.0009) [2023-12-27 23:55:43,366][106225] Updated weights for policy 1, policy_version 653905 (0.0009) [2023-12-27 23:55:43,425][106225] Updated weights for policy 1, policy_version 653915 (0.0009) [2023-12-27 23:55:43,479][106225] Updated weights for policy 1, policy_version 653925 (0.0006) [2023-12-27 23:55:43,509][106226] Updated weights for policy 0, policy_version 652042 (0.0009) [2023-12-27 23:55:43,574][106226] Updated weights for policy 0, policy_version 652052 (0.0009) [2023-12-27 23:55:43,630][106226] Updated weights for policy 0, policy_version 652062 (0.0008) [2023-12-27 23:55:44,183][106225] Updated weights for policy 1, policy_version 653935 (0.0008) [2023-12-27 23:55:44,240][106225] Updated weights for policy 1, policy_version 653945 (0.0008) [2023-12-27 23:55:44,260][106226] Updated weights for policy 0, policy_version 652072 (0.0010) [2023-12-27 23:55:44,298][106225] Updated weights for policy 1, policy_version 653955 (0.0009) [2023-12-27 23:55:44,312][106226] Updated weights for policy 0, policy_version 652082 (0.0006) [2023-12-27 23:55:44,355][106226] Updated weights for policy 0, policy_version 652092 (0.0008) [2023-12-27 23:55:45,029][106225] Updated weights for policy 1, policy_version 653965 (0.0008) [2023-12-27 23:55:45,092][106225] Updated weights for policy 1, policy_version 653975 (0.0008) [2023-12-27 23:55:45,152][106225] Updated weights for policy 1, policy_version 653985 (0.0007) [2023-12-27 23:55:45,154][106226] Updated weights for policy 0, policy_version 652102 (0.0008) [2023-12-27 23:55:45,216][106226] Updated weights for policy 0, policy_version 652112 (0.0008) [2023-12-27 23:55:45,274][106226] Updated weights for policy 0, policy_version 652122 (0.0009) [2023-12-27 23:55:45,834][106225] Updated weights for policy 1, policy_version 653995 (0.0007) [2023-12-27 23:55:45,884][106225] Updated weights for policy 1, policy_version 654005 (0.0008) [2023-12-27 23:55:45,930][106225] Updated weights for policy 1, policy_version 654015 (0.0008) [2023-12-27 23:55:45,993][106226] Updated weights for policy 0, policy_version 652132 (0.0008) [2023-12-27 23:55:46,039][106226] Updated weights for policy 0, policy_version 652142 (0.0005) [2023-12-27 23:55:46,095][106226] Updated weights for policy 0, policy_version 652152 (0.0006) [2023-12-27 23:55:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 334454784. Throughput: 0: 9821.4, 1: 9667.4. Samples: 334438976. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:46,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-5.684')] [2023-12-27 23:55:46,592][106225] Updated weights for policy 1, policy_version 654025 (0.0009) [2023-12-27 23:55:46,640][106225] Updated weights for policy 1, policy_version 654035 (0.0005) [2023-12-27 23:55:46,694][106225] Updated weights for policy 1, policy_version 654045 (0.0006) [2023-12-27 23:55:46,737][106225] Updated weights for policy 1, policy_version 654055 (0.0010) [2023-12-27 23:55:46,792][106226] Updated weights for policy 0, policy_version 652162 (0.0010) [2023-12-27 23:55:46,851][106226] Updated weights for policy 0, policy_version 652172 (0.0008) [2023-12-27 23:55:46,917][106226] Updated weights for policy 0, policy_version 652182 (0.0007) [2023-12-27 23:55:46,983][106226] Updated weights for policy 0, policy_version 652192 (0.0006) [2023-12-27 23:55:47,397][106225] Updated weights for policy 1, policy_version 654065 (0.0006) [2023-12-27 23:55:47,446][106225] Updated weights for policy 1, policy_version 654075 (0.0009) [2023-12-27 23:55:47,493][106225] Updated weights for policy 1, policy_version 654085 (0.0010) [2023-12-27 23:55:47,617][106226] Updated weights for policy 0, policy_version 652202 (0.0008) [2023-12-27 23:55:47,668][106226] Updated weights for policy 0, policy_version 652212 (0.0010) [2023-12-27 23:55:47,717][106226] Updated weights for policy 0, policy_version 652222 (0.0010) [2023-12-27 23:55:48,031][106225] Updated weights for policy 1, policy_version 654095 (0.0007) [2023-12-27 23:55:48,095][106225] Updated weights for policy 1, policy_version 654105 (0.0006) [2023-12-27 23:55:48,150][106225] Updated weights for policy 1, policy_version 654115 (0.0008) [2023-12-27 23:55:48,520][106226] Updated weights for policy 0, policy_version 652232 (0.0009) [2023-12-27 23:55:48,583][106226] Updated weights for policy 0, policy_version 652242 (0.0008) [2023-12-27 23:55:48,636][106226] Updated weights for policy 0, policy_version 652252 (0.0008) [2023-12-27 23:55:48,763][106225] Updated weights for policy 1, policy_version 654125 (0.0007) [2023-12-27 23:55:48,815][106225] Updated weights for policy 1, policy_version 654135 (0.0008) [2023-12-27 23:55:48,868][106225] Updated weights for policy 1, policy_version 654145 (0.0009) [2023-12-27 23:55:49,357][106226] Updated weights for policy 0, policy_version 652262 (0.0009) [2023-12-27 23:55:49,424][106226] Updated weights for policy 0, policy_version 652272 (0.0008) [2023-12-27 23:55:49,488][106226] Updated weights for policy 0, policy_version 652282 (0.0009) [2023-12-27 23:55:49,655][106225] Updated weights for policy 1, policy_version 654155 (0.0008) [2023-12-27 23:55:49,717][106225] Updated weights for policy 1, policy_version 654165 (0.0009) [2023-12-27 23:55:49,776][106225] Updated weights for policy 1, policy_version 654175 (0.0008) [2023-12-27 23:55:50,253][106226] Updated weights for policy 0, policy_version 652292 (0.0009) [2023-12-27 23:55:50,319][106226] Updated weights for policy 0, policy_version 652302 (0.0006) [2023-12-27 23:55:50,383][106226] Updated weights for policy 0, policy_version 652312 (0.0007) [2023-12-27 23:55:50,538][106225] Updated weights for policy 1, policy_version 654185 (0.0009) [2023-12-27 23:55:50,599][106225] Updated weights for policy 1, policy_version 654195 (0.0008) [2023-12-27 23:55:50,650][106225] Updated weights for policy 1, policy_version 654205 (0.0009) [2023-12-27 23:55:50,717][106225] Updated weights for policy 1, policy_version 654215 (0.0008) [2023-12-27 23:55:51,074][106226] Updated weights for policy 0, policy_version 652322 (0.0008) [2023-12-27 23:55:51,137][106226] Updated weights for policy 0, policy_version 652332 (0.0011) [2023-12-27 23:55:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 334544896. Throughput: 0: 9750.3, 1: 9752.9. Samples: 334558428. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:51,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.661')] [2023-12-27 23:55:51,198][106226] Updated weights for policy 0, policy_version 652342 (0.0011) [2023-12-27 23:55:51,265][106226] Updated weights for policy 0, policy_version 652352 (0.0010) [2023-12-27 23:55:51,430][106225] Updated weights for policy 1, policy_version 654225 (0.0008) [2023-12-27 23:55:51,490][106225] Updated weights for policy 1, policy_version 654235 (0.0008) [2023-12-27 23:55:51,550][106225] Updated weights for policy 1, policy_version 654245 (0.0008) [2023-12-27 23:55:51,975][106226] Updated weights for policy 0, policy_version 652362 (0.0006) [2023-12-27 23:55:52,039][106226] Updated weights for policy 0, policy_version 652372 (0.0005) [2023-12-27 23:55:52,105][106226] Updated weights for policy 0, policy_version 652382 (0.0010) [2023-12-27 23:55:52,353][106225] Updated weights for policy 1, policy_version 654255 (0.0008) [2023-12-27 23:55:52,414][106225] Updated weights for policy 1, policy_version 654265 (0.0009) [2023-12-27 23:55:52,472][106225] Updated weights for policy 1, policy_version 654275 (0.0007) [2023-12-27 23:55:52,708][106226] Updated weights for policy 0, policy_version 652392 (0.0007) [2023-12-27 23:55:52,771][106226] Updated weights for policy 0, policy_version 652402 (0.0010) [2023-12-27 23:55:52,831][106226] Updated weights for policy 0, policy_version 652412 (0.0011) [2023-12-27 23:55:53,232][106225] Updated weights for policy 1, policy_version 654285 (0.0007) [2023-12-27 23:55:53,298][106225] Updated weights for policy 1, policy_version 654295 (0.0007) [2023-12-27 23:55:53,362][106225] Updated weights for policy 1, policy_version 654305 (0.0008) [2023-12-27 23:55:53,462][106226] Updated weights for policy 0, policy_version 652422 (0.0011) [2023-12-27 23:55:53,514][106226] Updated weights for policy 0, policy_version 652432 (0.0010) [2023-12-27 23:55:53,567][106226] Updated weights for policy 0, policy_version 652442 (0.0010) [2023-12-27 23:55:54,082][106225] Updated weights for policy 1, policy_version 654315 (0.0008) [2023-12-27 23:55:54,141][106225] Updated weights for policy 1, policy_version 654325 (0.0008) [2023-12-27 23:55:54,200][106225] Updated weights for policy 1, policy_version 654335 (0.0009) [2023-12-27 23:55:54,249][106226] Updated weights for policy 0, policy_version 652452 (0.0009) [2023-12-27 23:55:54,301][106226] Updated weights for policy 0, policy_version 652462 (0.0008) [2023-12-27 23:55:54,364][106226] Updated weights for policy 0, policy_version 652472 (0.0008) [2023-12-27 23:55:54,938][106225] Updated weights for policy 1, policy_version 654345 (0.0008) [2023-12-27 23:55:55,005][106225] Updated weights for policy 1, policy_version 654355 (0.0008) [2023-12-27 23:55:55,062][106226] Updated weights for policy 0, policy_version 652482 (0.0009) [2023-12-27 23:55:55,072][106225] Updated weights for policy 1, policy_version 654365 (0.0008) [2023-12-27 23:55:55,125][106226] Updated weights for policy 0, policy_version 652492 (0.0006) [2023-12-27 23:55:55,138][106225] Updated weights for policy 1, policy_version 654375 (0.0008) [2023-12-27 23:55:55,181][106226] Updated weights for policy 0, policy_version 652502 (0.0007) [2023-12-27 23:55:55,241][106226] Updated weights for policy 0, policy_version 652512 (0.0005) [2023-12-27 23:55:55,828][106225] Updated weights for policy 1, policy_version 654385 (0.0008) [2023-12-27 23:55:55,851][106226] Updated weights for policy 0, policy_version 652522 (0.0005) [2023-12-27 23:55:55,887][106225] Updated weights for policy 1, policy_version 654395 (0.0008) [2023-12-27 23:55:55,912][106226] Updated weights for policy 0, policy_version 652532 (0.0005) [2023-12-27 23:55:55,939][106225] Updated weights for policy 1, policy_version 654405 (0.0008) [2023-12-27 23:55:55,974][106226] Updated weights for policy 0, policy_version 652542 (0.0005) [2023-12-27 23:55:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 334651392. Throughput: 0: 9800.8, 1: 9720.6. Samples: 334617224. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:55:56,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.988')] [2023-12-27 23:55:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000654408_167559168.pth... [2023-12-27 23:55:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000652544_167092224.pth... [2023-12-27 23:55:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000653288_167272448.pth [2023-12-27 23:55:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000651392_166797312.pth [2023-12-27 23:55:56,485][106226] Updated weights for policy 0, policy_version 652552 (0.0005) [2023-12-27 23:55:56,533][106226] Updated weights for policy 0, policy_version 652562 (0.0005) [2023-12-27 23:55:56,581][106226] Updated weights for policy 0, policy_version 652572 (0.0005) [2023-12-27 23:55:56,718][106225] Updated weights for policy 1, policy_version 654415 (0.0006) [2023-12-27 23:55:56,769][106225] Updated weights for policy 1, policy_version 654425 (0.0009) [2023-12-27 23:55:56,822][106225] Updated weights for policy 1, policy_version 654435 (0.0008) [2023-12-27 23:55:57,106][106226] Updated weights for policy 0, policy_version 652582 (0.0005) [2023-12-27 23:55:57,150][106226] Updated weights for policy 0, policy_version 652592 (0.0005) [2023-12-27 23:55:57,205][106226] Updated weights for policy 0, policy_version 652602 (0.0005) [2023-12-27 23:55:57,601][106225] Updated weights for policy 1, policy_version 654445 (0.0009) [2023-12-27 23:55:57,651][106225] Updated weights for policy 1, policy_version 654455 (0.0007) [2023-12-27 23:55:57,699][106225] Updated weights for policy 1, policy_version 654466 (0.0009) [2023-12-27 23:55:57,804][106226] Updated weights for policy 0, policy_version 652612 (0.0005) [2023-12-27 23:55:57,856][106226] Updated weights for policy 0, policy_version 652622 (0.0005) [2023-12-27 23:55:57,907][106226] Updated weights for policy 0, policy_version 652632 (0.0005) [2023-12-27 23:55:58,481][106225] Updated weights for policy 1, policy_version 654476 (0.0008) [2023-12-27 23:55:58,547][106225] Updated weights for policy 1, policy_version 654486 (0.0008) [2023-12-27 23:55:58,614][106225] Updated weights for policy 1, policy_version 654496 (0.0008) [2023-12-27 23:55:58,636][106226] Updated weights for policy 0, policy_version 652642 (0.0006) [2023-12-27 23:55:58,704][106226] Updated weights for policy 0, policy_version 652652 (0.0007) [2023-12-27 23:55:58,768][106226] Updated weights for policy 0, policy_version 652662 (0.0008) [2023-12-27 23:55:58,836][106226] Updated weights for policy 0, policy_version 652672 (0.0007) [2023-12-27 23:55:59,427][106225] Updated weights for policy 1, policy_version 654506 (0.0008) [2023-12-27 23:55:59,493][106225] Updated weights for policy 1, policy_version 654516 (0.0007) [2023-12-27 23:55:59,555][106225] Updated weights for policy 1, policy_version 654526 (0.0009) [2023-12-27 23:55:59,612][106226] Updated weights for policy 0, policy_version 652682 (0.0007) [2023-12-27 23:55:59,618][106225] Updated weights for policy 1, policy_version 654536 (0.0009) [2023-12-27 23:55:59,670][106226] Updated weights for policy 0, policy_version 652692 (0.0005) [2023-12-27 23:55:59,733][106226] Updated weights for policy 0, policy_version 652702 (0.0005) [2023-12-27 23:56:00,381][106225] Updated weights for policy 1, policy_version 654546 (0.0009) [2023-12-27 23:56:00,443][106225] Updated weights for policy 1, policy_version 654556 (0.0008) [2023-12-27 23:56:00,448][106226] Updated weights for policy 0, policy_version 652712 (0.0006) [2023-12-27 23:56:00,498][106225] Updated weights for policy 1, policy_version 654566 (0.0008) [2023-12-27 23:56:00,511][106226] Updated weights for policy 0, policy_version 652722 (0.0007) [2023-12-27 23:56:00,559][106226] Updated weights for policy 0, policy_version 652732 (0.0008) [2023-12-27 23:56:01,139][106225] Updated weights for policy 1, policy_version 654576 (0.0008) [2023-12-27 23:56:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 334741504. Throughput: 0: 9986.3, 1: 9686.3. Samples: 334736532. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:01,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-6.225')] [2023-12-27 23:56:01,206][106225] Updated weights for policy 1, policy_version 654586 (0.0008) [2023-12-27 23:56:01,269][106225] Updated weights for policy 1, policy_version 654596 (0.0008) [2023-12-27 23:56:01,326][106226] Updated weights for policy 0, policy_version 652742 (0.0007) [2023-12-27 23:56:01,401][106226] Updated weights for policy 0, policy_version 652752 (0.0008) [2023-12-27 23:56:01,461][106226] Updated weights for policy 0, policy_version 652762 (0.0006) [2023-12-27 23:56:02,002][106225] Updated weights for policy 1, policy_version 654606 (0.0009) [2023-12-27 23:56:02,070][106225] Updated weights for policy 1, policy_version 654616 (0.0008) [2023-12-27 23:56:02,149][106225] Updated weights for policy 1, policy_version 654626 (0.0007) [2023-12-27 23:56:02,150][106226] Updated weights for policy 0, policy_version 652772 (0.0007) [2023-12-27 23:56:02,217][106226] Updated weights for policy 0, policy_version 652782 (0.0009) [2023-12-27 23:56:02,292][106226] Updated weights for policy 0, policy_version 652792 (0.0008) [2023-12-27 23:56:02,894][106225] Updated weights for policy 1, policy_version 654636 (0.0007) [2023-12-27 23:56:02,917][106226] Updated weights for policy 0, policy_version 652802 (0.0009) [2023-12-27 23:56:02,945][106225] Updated weights for policy 1, policy_version 654646 (0.0007) [2023-12-27 23:56:02,970][106226] Updated weights for policy 0, policy_version 652812 (0.0005) [2023-12-27 23:56:02,995][106225] Updated weights for policy 1, policy_version 654656 (0.0008) [2023-12-27 23:56:03,020][106226] Updated weights for policy 0, policy_version 652822 (0.0005) [2023-12-27 23:56:03,080][106226] Updated weights for policy 0, policy_version 652832 (0.0005) [2023-12-27 23:56:03,717][106225] Updated weights for policy 1, policy_version 654666 (0.0007) [2023-12-27 23:56:03,722][106226] Updated weights for policy 0, policy_version 652842 (0.0011) [2023-12-27 23:56:03,775][106225] Updated weights for policy 1, policy_version 654676 (0.0007) [2023-12-27 23:56:03,780][106226] Updated weights for policy 0, policy_version 652852 (0.0011) [2023-12-27 23:56:03,830][106225] Updated weights for policy 1, policy_version 654686 (0.0007) [2023-12-27 23:56:03,838][106226] Updated weights for policy 0, policy_version 652862 (0.0010) [2023-12-27 23:56:03,899][106225] Updated weights for policy 1, policy_version 654696 (0.0009) [2023-12-27 23:56:04,510][106225] Updated weights for policy 1, policy_version 654706 (0.0008) [2023-12-27 23:56:04,562][106225] Updated weights for policy 1, policy_version 654716 (0.0009) [2023-12-27 23:56:04,584][106226] Updated weights for policy 0, policy_version 652872 (0.0009) [2023-12-27 23:56:04,613][106225] Updated weights for policy 1, policy_version 654726 (0.0006) [2023-12-27 23:56:04,649][106226] Updated weights for policy 0, policy_version 652882 (0.0011) [2023-12-27 23:56:04,709][106226] Updated weights for policy 0, policy_version 652892 (0.0010) [2023-12-27 23:56:05,342][106226] Updated weights for policy 0, policy_version 652902 (0.0010) [2023-12-27 23:56:05,351][106225] Updated weights for policy 1, policy_version 654736 (0.0006) [2023-12-27 23:56:05,401][106226] Updated weights for policy 0, policy_version 652912 (0.0010) [2023-12-27 23:56:05,405][106225] Updated weights for policy 1, policy_version 654746 (0.0007) [2023-12-27 23:56:05,456][106225] Updated weights for policy 1, policy_version 654756 (0.0007) [2023-12-27 23:56:05,458][106226] Updated weights for policy 0, policy_version 652922 (0.0010) [2023-12-27 23:56:06,166][106226] Updated weights for policy 0, policy_version 652932 (0.0011) [2023-12-27 23:56:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 334839808. Throughput: 0: 9978.4, 1: 9664.6. Samples: 334855704. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:06,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-5.880')] [2023-12-27 23:56:06,194][106225] Updated weights for policy 1, policy_version 654766 (0.0008) [2023-12-27 23:56:06,222][106226] Updated weights for policy 0, policy_version 652942 (0.0011) [2023-12-27 23:56:06,258][106225] Updated weights for policy 1, policy_version 654776 (0.0007) [2023-12-27 23:56:06,279][106226] Updated weights for policy 0, policy_version 652952 (0.0011) [2023-12-27 23:56:06,322][106225] Updated weights for policy 1, policy_version 654786 (0.0007) [2023-12-27 23:56:06,955][106226] Updated weights for policy 0, policy_version 652962 (0.0010) [2023-12-27 23:56:07,017][106226] Updated weights for policy 0, policy_version 652972 (0.0009) [2023-12-27 23:56:07,073][106226] Updated weights for policy 0, policy_version 652982 (0.0010) [2023-12-27 23:56:07,094][106225] Updated weights for policy 1, policy_version 654796 (0.0009) [2023-12-27 23:56:07,131][106226] Updated weights for policy 0, policy_version 652992 (0.0011) [2023-12-27 23:56:07,150][106225] Updated weights for policy 1, policy_version 654806 (0.0010) [2023-12-27 23:56:07,209][106225] Updated weights for policy 1, policy_version 654816 (0.0010) [2023-12-27 23:56:07,815][106226] Updated weights for policy 0, policy_version 653002 (0.0005) [2023-12-27 23:56:07,873][106226] Updated weights for policy 0, policy_version 653012 (0.0009) [2023-12-27 23:56:07,894][106225] Updated weights for policy 1, policy_version 654826 (0.0006) [2023-12-27 23:56:07,930][106226] Updated weights for policy 0, policy_version 653022 (0.0011) [2023-12-27 23:56:07,955][106225] Updated weights for policy 1, policy_version 654836 (0.0006) [2023-12-27 23:56:08,016][106225] Updated weights for policy 1, policy_version 654846 (0.0008) [2023-12-27 23:56:08,069][106225] Updated weights for policy 1, policy_version 654856 (0.0008) [2023-12-27 23:56:08,623][106226] Updated weights for policy 0, policy_version 653032 (0.0011) [2023-12-27 23:56:08,673][106226] Updated weights for policy 0, policy_version 653042 (0.0010) [2023-12-27 23:56:08,723][106226] Updated weights for policy 0, policy_version 653052 (0.0010) [2023-12-27 23:56:08,841][106225] Updated weights for policy 1, policy_version 654866 (0.0009) [2023-12-27 23:56:08,906][106225] Updated weights for policy 1, policy_version 654876 (0.0008) [2023-12-27 23:56:08,963][106225] Updated weights for policy 1, policy_version 654886 (0.0008) [2023-12-27 23:56:09,483][106226] Updated weights for policy 0, policy_version 653062 (0.0009) [2023-12-27 23:56:09,549][106226] Updated weights for policy 0, policy_version 653072 (0.0011) [2023-12-27 23:56:09,615][106226] Updated weights for policy 0, policy_version 653082 (0.0010) [2023-12-27 23:56:09,682][106225] Updated weights for policy 1, policy_version 654896 (0.0009) [2023-12-27 23:56:09,746][106225] Updated weights for policy 1, policy_version 654906 (0.0008) [2023-12-27 23:56:09,798][106225] Updated weights for policy 1, policy_version 654916 (0.0008) [2023-12-27 23:56:10,344][106226] Updated weights for policy 0, policy_version 653092 (0.0010) [2023-12-27 23:56:10,398][106226] Updated weights for policy 0, policy_version 653102 (0.0011) [2023-12-27 23:56:10,459][106226] Updated weights for policy 0, policy_version 653112 (0.0011) [2023-12-27 23:56:10,587][106225] Updated weights for policy 1, policy_version 654926 (0.0008) [2023-12-27 23:56:10,644][106225] Updated weights for policy 1, policy_version 654936 (0.0007) [2023-12-27 23:56:10,696][106225] Updated weights for policy 1, policy_version 654946 (0.0005) [2023-12-27 23:56:11,152][106226] Updated weights for policy 0, policy_version 653122 (0.0010) [2023-12-27 23:56:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 334938112. Throughput: 0: 10022.7, 1: 9624.9. Samples: 334913720. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:11,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-5.973')] [2023-12-27 23:56:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000654952_167698432.pth... [2023-12-27 23:56:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000653832_167411712.pth [2023-12-27 23:56:11,218][106226] Updated weights for policy 0, policy_version 653132 (0.0007) [2023-12-27 23:56:11,288][106226] Updated weights for policy 0, policy_version 653142 (0.0007) [2023-12-27 23:56:11,350][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000653152_167247872.pth... [2023-12-27 23:56:11,353][106226] Updated weights for policy 0, policy_version 653152 (0.0010) [2023-12-27 23:56:11,355][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000651968_166944768.pth [2023-12-27 23:56:11,506][106225] Updated weights for policy 1, policy_version 654956 (0.0008) [2023-12-27 23:56:11,572][106225] Updated weights for policy 1, policy_version 654966 (0.0009) [2023-12-27 23:56:11,638][106225] Updated weights for policy 1, policy_version 654976 (0.0008) [2023-12-27 23:56:12,097][106226] Updated weights for policy 0, policy_version 653162 (0.0007) [2023-12-27 23:56:12,153][106226] Updated weights for policy 0, policy_version 653172 (0.0006) [2023-12-27 23:56:12,223][106226] Updated weights for policy 0, policy_version 653182 (0.0007) [2023-12-27 23:56:12,408][106225] Updated weights for policy 1, policy_version 654986 (0.0009) [2023-12-27 23:56:12,472][106225] Updated weights for policy 1, policy_version 654996 (0.0006) [2023-12-27 23:56:12,536][106225] Updated weights for policy 1, policy_version 655006 (0.0006) [2023-12-27 23:56:12,596][106225] Updated weights for policy 1, policy_version 655016 (0.0007) [2023-12-27 23:56:12,901][106226] Updated weights for policy 0, policy_version 653192 (0.0010) [2023-12-27 23:56:12,955][106226] Updated weights for policy 0, policy_version 653202 (0.0010) [2023-12-27 23:56:13,011][106226] Updated weights for policy 0, policy_version 653212 (0.0007) [2023-12-27 23:56:13,226][106225] Updated weights for policy 1, policy_version 655026 (0.0006) [2023-12-27 23:56:13,289][106225] Updated weights for policy 1, policy_version 655036 (0.0005) [2023-12-27 23:56:13,345][106225] Updated weights for policy 1, policy_version 655046 (0.0005) [2023-12-27 23:56:13,646][106226] Updated weights for policy 0, policy_version 653222 (0.0009) [2023-12-27 23:56:13,696][106226] Updated weights for policy 0, policy_version 653232 (0.0010) [2023-12-27 23:56:13,746][106226] Updated weights for policy 0, policy_version 653242 (0.0010) [2023-12-27 23:56:13,849][106225] Updated weights for policy 1, policy_version 655056 (0.0005) [2023-12-27 23:56:13,905][106225] Updated weights for policy 1, policy_version 655066 (0.0008) [2023-12-27 23:56:13,950][106225] Updated weights for policy 1, policy_version 655076 (0.0007) [2023-12-27 23:56:14,370][106226] Updated weights for policy 0, policy_version 653252 (0.0008) [2023-12-27 23:56:14,430][106226] Updated weights for policy 0, policy_version 653262 (0.0010) [2023-12-27 23:56:14,484][106226] Updated weights for policy 0, policy_version 653272 (0.0010) [2023-12-27 23:56:14,658][106225] Updated weights for policy 1, policy_version 655086 (0.0007) [2023-12-27 23:56:14,707][106225] Updated weights for policy 1, policy_version 655096 (0.0007) [2023-12-27 23:56:14,763][106225] Updated weights for policy 1, policy_version 655106 (0.0006) [2023-12-27 23:56:15,171][106226] Updated weights for policy 0, policy_version 653282 (0.0010) [2023-12-27 23:56:15,219][106226] Updated weights for policy 0, policy_version 653292 (0.0009) [2023-12-27 23:56:15,277][106226] Updated weights for policy 0, policy_version 653302 (0.0010) [2023-12-27 23:56:15,333][106226] Updated weights for policy 0, policy_version 653312 (0.0011) [2023-12-27 23:56:15,478][106225] Updated weights for policy 1, policy_version 655116 (0.0006) [2023-12-27 23:56:15,529][106225] Updated weights for policy 1, policy_version 655126 (0.0005) [2023-12-27 23:56:15,578][106225] Updated weights for policy 1, policy_version 655136 (0.0005) [2023-12-27 23:56:16,053][106226] Updated weights for policy 0, policy_version 653322 (0.0010) [2023-12-27 23:56:16,107][106226] Updated weights for policy 0, policy_version 653332 (0.0010) [2023-12-27 23:56:16,139][106225] Updated weights for policy 1, policy_version 655146 (0.0007) [2023-12-27 23:56:16,162][106226] Updated weights for policy 0, policy_version 653342 (0.0011) [2023-12-27 23:56:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 335044608. Throughput: 0: 9985.2, 1: 9577.4. Samples: 335031664. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:16,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-5.853')] [2023-12-27 23:56:16,198][106225] Updated weights for policy 1, policy_version 655156 (0.0007) [2023-12-27 23:56:16,257][106225] Updated weights for policy 1, policy_version 655166 (0.0008) [2023-12-27 23:56:16,316][106225] Updated weights for policy 1, policy_version 655176 (0.0007) [2023-12-27 23:56:16,887][106226] Updated weights for policy 0, policy_version 653352 (0.0011) [2023-12-27 23:56:16,934][106226] Updated weights for policy 0, policy_version 653362 (0.0010) [2023-12-27 23:56:16,981][106226] Updated weights for policy 0, policy_version 653372 (0.0010) [2023-12-27 23:56:17,037][106225] Updated weights for policy 1, policy_version 655186 (0.0007) [2023-12-27 23:56:17,097][106225] Updated weights for policy 1, policy_version 655196 (0.0008) [2023-12-27 23:56:17,145][106225] Updated weights for policy 1, policy_version 655206 (0.0007) [2023-12-27 23:56:17,706][106226] Updated weights for policy 0, policy_version 653382 (0.0010) [2023-12-27 23:56:17,770][106226] Updated weights for policy 0, policy_version 653392 (0.0011) [2023-12-27 23:56:17,823][106226] Updated weights for policy 0, policy_version 653402 (0.0010) [2023-12-27 23:56:17,857][106225] Updated weights for policy 1, policy_version 655216 (0.0007) [2023-12-27 23:56:17,913][106225] Updated weights for policy 1, policy_version 655226 (0.0007) [2023-12-27 23:56:17,968][106225] Updated weights for policy 1, policy_version 655236 (0.0007) [2023-12-27 23:56:18,515][106226] Updated weights for policy 0, policy_version 653412 (0.0009) [2023-12-27 23:56:18,582][106226] Updated weights for policy 0, policy_version 653422 (0.0005) [2023-12-27 23:56:18,628][106225] Updated weights for policy 1, policy_version 655246 (0.0009) [2023-12-27 23:56:18,647][106226] Updated weights for policy 0, policy_version 653432 (0.0010) [2023-12-27 23:56:18,676][106225] Updated weights for policy 1, policy_version 655256 (0.0010) [2023-12-27 23:56:18,728][106225] Updated weights for policy 1, policy_version 655266 (0.0008) [2023-12-27 23:56:19,247][106226] Updated weights for policy 0, policy_version 653442 (0.0010) [2023-12-27 23:56:19,311][106226] Updated weights for policy 0, policy_version 653452 (0.0009) [2023-12-27 23:56:19,342][106225] Updated weights for policy 1, policy_version 655276 (0.0007) [2023-12-27 23:56:19,375][106226] Updated weights for policy 0, policy_version 653462 (0.0009) [2023-12-27 23:56:19,404][106225] Updated weights for policy 1, policy_version 655286 (0.0009) [2023-12-27 23:56:19,424][106226] Updated weights for policy 0, policy_version 653472 (0.0009) [2023-12-27 23:56:19,448][106225] Updated weights for policy 1, policy_version 655296 (0.0008) [2023-12-27 23:56:20,176][106225] Updated weights for policy 1, policy_version 655306 (0.0008) [2023-12-27 23:56:20,240][106225] Updated weights for policy 1, policy_version 655316 (0.0011) [2023-12-27 23:56:20,295][106226] Updated weights for policy 0, policy_version 653482 (0.0007) [2023-12-27 23:56:20,296][106225] Updated weights for policy 1, policy_version 655326 (0.0007) [2023-12-27 23:56:20,355][106225] Updated weights for policy 1, policy_version 655336 (0.0008) [2023-12-27 23:56:20,360][106226] Updated weights for policy 0, policy_version 653492 (0.0006) [2023-12-27 23:56:20,430][106226] Updated weights for policy 0, policy_version 653502 (0.0009) [2023-12-27 23:56:21,089][106225] Updated weights for policy 1, policy_version 655346 (0.0009) [2023-12-27 23:56:21,154][106226] Updated weights for policy 0, policy_version 653512 (0.0008) [2023-12-27 23:56:21,173][106225] Updated weights for policy 1, policy_version 655357 (0.0008) [2023-12-27 23:56:21,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 335134720. Throughput: 0: 9985.5, 1: 9672.6. Samples: 335151748. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:21,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-5.978')] [2023-12-27 23:56:21,218][106226] Updated weights for policy 0, policy_version 653522 (0.0008) [2023-12-27 23:56:21,235][106225] Updated weights for policy 1, policy_version 655367 (0.0011) [2023-12-27 23:56:21,287][106226] Updated weights for policy 0, policy_version 653532 (0.0006) [2023-12-27 23:56:21,941][106226] Updated weights for policy 0, policy_version 653542 (0.0006) [2023-12-27 23:56:21,965][106225] Updated weights for policy 1, policy_version 655377 (0.0010) [2023-12-27 23:56:22,005][106226] Updated weights for policy 0, policy_version 653552 (0.0007) [2023-12-27 23:56:22,027][106225] Updated weights for policy 1, policy_version 655387 (0.0010) [2023-12-27 23:56:22,061][106226] Updated weights for policy 0, policy_version 653562 (0.0009) [2023-12-27 23:56:22,084][106225] Updated weights for policy 1, policy_version 655397 (0.0008) [2023-12-27 23:56:22,750][106226] Updated weights for policy 0, policy_version 653572 (0.0007) [2023-12-27 23:56:22,803][106225] Updated weights for policy 1, policy_version 655407 (0.0008) [2023-12-27 23:56:22,818][106226] Updated weights for policy 0, policy_version 653582 (0.0007) [2023-12-27 23:56:22,873][106225] Updated weights for policy 1, policy_version 655417 (0.0011) [2023-12-27 23:56:22,886][106226] Updated weights for policy 0, policy_version 653592 (0.0008) [2023-12-27 23:56:22,940][106225] Updated weights for policy 1, policy_version 655427 (0.0010) [2023-12-27 23:56:23,589][106225] Updated weights for policy 1, policy_version 655437 (0.0010) [2023-12-27 23:56:23,604][106226] Updated weights for policy 0, policy_version 653602 (0.0008) [2023-12-27 23:56:23,642][106225] Updated weights for policy 1, policy_version 655447 (0.0010) [2023-12-27 23:56:23,648][106226] Updated weights for policy 0, policy_version 653612 (0.0007) [2023-12-27 23:56:23,688][106225] Updated weights for policy 1, policy_version 655457 (0.0010) [2023-12-27 23:56:23,699][106226] Updated weights for policy 0, policy_version 653622 (0.0009) [2023-12-27 23:56:23,756][106226] Updated weights for policy 0, policy_version 653632 (0.0010) [2023-12-27 23:56:24,349][106226] Updated weights for policy 0, policy_version 653642 (0.0005) [2023-12-27 23:56:24,412][106226] Updated weights for policy 0, policy_version 653652 (0.0007) [2023-12-27 23:56:24,423][106225] Updated weights for policy 1, policy_version 655467 (0.0009) [2023-12-27 23:56:24,480][106225] Updated weights for policy 1, policy_version 655477 (0.0005) [2023-12-27 23:56:24,487][106226] Updated weights for policy 0, policy_version 653662 (0.0009) [2023-12-27 23:56:24,534][106225] Updated weights for policy 1, policy_version 655487 (0.0007) [2023-12-27 23:56:25,057][106226] Updated weights for policy 0, policy_version 653672 (0.0007) [2023-12-27 23:56:25,123][106225] Updated weights for policy 1, policy_version 655497 (0.0008) [2023-12-27 23:56:25,126][106226] Updated weights for policy 0, policy_version 653682 (0.0005) [2023-12-27 23:56:25,178][106225] Updated weights for policy 1, policy_version 655507 (0.0005) [2023-12-27 23:56:25,192][106226] Updated weights for policy 0, policy_version 653692 (0.0006) [2023-12-27 23:56:25,242][106225] Updated weights for policy 1, policy_version 655517 (0.0006) [2023-12-27 23:56:25,306][106225] Updated weights for policy 1, policy_version 655527 (0.0005) [2023-12-27 23:56:25,781][106226] Updated weights for policy 0, policy_version 653702 (0.0009) [2023-12-27 23:56:25,831][106226] Updated weights for policy 0, policy_version 653712 (0.0010) [2023-12-27 23:56:25,881][106226] Updated weights for policy 0, policy_version 653722 (0.0010) [2023-12-27 23:56:25,915][106225] Updated weights for policy 1, policy_version 655537 (0.0010) [2023-12-27 23:56:25,976][106225] Updated weights for policy 1, policy_version 655547 (0.0010) [2023-12-27 23:56:26,026][106225] Updated weights for policy 1, policy_version 655557 (0.0010) [2023-12-27 23:56:26,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 335249408. Throughput: 0: 9980.5, 1: 9689.4. Samples: 335210712. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:26,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-6.134')] [2023-12-27 23:56:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000653728_167395328.pth... [2023-12-27 23:56:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000655560_167854080.pth... [2023-12-27 23:56:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000652544_167092224.pth [2023-12-27 23:56:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000654408_167559168.pth [2023-12-27 23:56:26,529][106226] Updated weights for policy 0, policy_version 653732 (0.0010) [2023-12-27 23:56:26,590][106226] Updated weights for policy 0, policy_version 653742 (0.0011) [2023-12-27 23:56:26,647][106226] Updated weights for policy 0, policy_version 653752 (0.0006) [2023-12-27 23:56:26,715][106225] Updated weights for policy 1, policy_version 655567 (0.0007) [2023-12-27 23:56:26,770][106225] Updated weights for policy 1, policy_version 655577 (0.0007) [2023-12-27 23:56:26,823][106225] Updated weights for policy 1, policy_version 655587 (0.0006) [2023-12-27 23:56:27,280][106226] Updated weights for policy 0, policy_version 653762 (0.0005) [2023-12-27 23:56:27,344][106226] Updated weights for policy 0, policy_version 653772 (0.0011) [2023-12-27 23:56:27,397][106226] Updated weights for policy 0, policy_version 653782 (0.0010) [2023-12-27 23:56:27,406][106225] Updated weights for policy 1, policy_version 655597 (0.0005) [2023-12-27 23:56:27,454][106226] Updated weights for policy 0, policy_version 653792 (0.0010) [2023-12-27 23:56:27,470][106225] Updated weights for policy 1, policy_version 655607 (0.0005) [2023-12-27 23:56:27,528][106225] Updated weights for policy 1, policy_version 655617 (0.0008) [2023-12-27 23:56:28,089][106226] Updated weights for policy 0, policy_version 653802 (0.0010) [2023-12-27 23:56:28,144][106226] Updated weights for policy 0, policy_version 653812 (0.0008) [2023-12-27 23:56:28,213][106226] Updated weights for policy 0, policy_version 653822 (0.0006) [2023-12-27 23:56:28,256][106225] Updated weights for policy 1, policy_version 655627 (0.0007) [2023-12-27 23:56:28,309][106225] Updated weights for policy 1, policy_version 655637 (0.0008) [2023-12-27 23:56:28,371][106225] Updated weights for policy 1, policy_version 655647 (0.0008) [2023-12-27 23:56:28,867][106226] Updated weights for policy 0, policy_version 653832 (0.0010) [2023-12-27 23:56:28,920][106226] Updated weights for policy 0, policy_version 653842 (0.0010) [2023-12-27 23:56:28,979][106226] Updated weights for policy 0, policy_version 653852 (0.0010) [2023-12-27 23:56:29,095][106225] Updated weights for policy 1, policy_version 655657 (0.0008) [2023-12-27 23:56:29,143][106225] Updated weights for policy 1, policy_version 655667 (0.0005) [2023-12-27 23:56:29,202][106225] Updated weights for policy 1, policy_version 655677 (0.0007) [2023-12-27 23:56:29,275][106225] Updated weights for policy 1, policy_version 655687 (0.0009) [2023-12-27 23:56:29,682][106226] Updated weights for policy 0, policy_version 653862 (0.0009) [2023-12-27 23:56:29,745][106226] Updated weights for policy 0, policy_version 653872 (0.0008) [2023-12-27 23:56:29,804][106226] Updated weights for policy 0, policy_version 653882 (0.0009) [2023-12-27 23:56:30,030][106225] Updated weights for policy 1, policy_version 655697 (0.0007) [2023-12-27 23:56:30,086][106225] Updated weights for policy 1, policy_version 655707 (0.0006) [2023-12-27 23:56:30,146][106225] Updated weights for policy 1, policy_version 655717 (0.0008) [2023-12-27 23:56:30,597][106226] Updated weights for policy 0, policy_version 653892 (0.0009) [2023-12-27 23:56:30,654][106226] Updated weights for policy 0, policy_version 653902 (0.0005) [2023-12-27 23:56:30,709][106226] Updated weights for policy 0, policy_version 653912 (0.0005) [2023-12-27 23:56:30,841][106225] Updated weights for policy 1, policy_version 655727 (0.0008) [2023-12-27 23:56:30,895][106225] Updated weights for policy 1, policy_version 655737 (0.0008) [2023-12-27 23:56:30,945][106225] Updated weights for policy 1, policy_version 655747 (0.0008) [2023-12-27 23:56:31,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 335347712. Throughput: 0: 10112.0, 1: 9834.0. Samples: 335336544. Policy #0 lag: (min: 26.0, avg: 41.7, max: 58.0) [2023-12-27 23:56:31,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.980')] [2023-12-27 23:56:31,331][106226] Updated weights for policy 0, policy_version 653922 (0.0006) [2023-12-27 23:56:31,397][106226] Updated weights for policy 0, policy_version 653932 (0.0010) [2023-12-27 23:56:31,464][106226] Updated weights for policy 0, policy_version 653942 (0.0008) [2023-12-27 23:56:31,526][106226] Updated weights for policy 0, policy_version 653952 (0.0008) [2023-12-27 23:56:31,748][106225] Updated weights for policy 1, policy_version 655757 (0.0008) [2023-12-27 23:56:31,815][106225] Updated weights for policy 1, policy_version 655767 (0.0009) [2023-12-27 23:56:31,884][106225] Updated weights for policy 1, policy_version 655777 (0.0009) [2023-12-27 23:56:32,188][106226] Updated weights for policy 0, policy_version 653962 (0.0009) [2023-12-27 23:56:32,250][106226] Updated weights for policy 0, policy_version 653972 (0.0008) [2023-12-27 23:56:32,308][106226] Updated weights for policy 0, policy_version 653982 (0.0008) [2023-12-27 23:56:32,642][106225] Updated weights for policy 1, policy_version 655787 (0.0008) [2023-12-27 23:56:32,707][106225] Updated weights for policy 1, policy_version 655797 (0.0006) [2023-12-27 23:56:32,770][106225] Updated weights for policy 1, policy_version 655807 (0.0008) [2023-12-27 23:56:33,073][106226] Updated weights for policy 0, policy_version 653993 (0.0010) [2023-12-27 23:56:33,119][106226] Updated weights for policy 0, policy_version 654003 (0.0007) [2023-12-27 23:56:33,169][106226] Updated weights for policy 0, policy_version 654013 (0.0008) [2023-12-27 23:56:33,352][106225] Updated weights for policy 1, policy_version 655817 (0.0008) [2023-12-27 23:56:33,409][106225] Updated weights for policy 1, policy_version 655827 (0.0008) [2023-12-27 23:56:33,456][106225] Updated weights for policy 1, policy_version 655837 (0.0008) [2023-12-27 23:56:33,504][106225] Updated weights for policy 1, policy_version 655847 (0.0008) [2023-12-27 23:56:33,934][106226] Updated weights for policy 0, policy_version 654023 (0.0009) [2023-12-27 23:56:33,993][106226] Updated weights for policy 0, policy_version 654033 (0.0008) [2023-12-27 23:56:34,051][106226] Updated weights for policy 0, policy_version 654043 (0.0009) [2023-12-27 23:56:34,235][106225] Updated weights for policy 1, policy_version 655857 (0.0009) [2023-12-27 23:56:34,296][106225] Updated weights for policy 1, policy_version 655867 (0.0009) [2023-12-27 23:56:34,360][106225] Updated weights for policy 1, policy_version 655877 (0.0008) [2023-12-27 23:56:34,793][106226] Updated weights for policy 0, policy_version 654053 (0.0008) [2023-12-27 23:56:34,855][106226] Updated weights for policy 0, policy_version 654063 (0.0009) [2023-12-27 23:56:34,917][106226] Updated weights for policy 0, policy_version 654073 (0.0009) [2023-12-27 23:56:35,112][106225] Updated weights for policy 1, policy_version 655887 (0.0009) [2023-12-27 23:56:35,163][106225] Updated weights for policy 1, policy_version 655897 (0.0008) [2023-12-27 23:56:35,224][106225] Updated weights for policy 1, policy_version 655907 (0.0008) [2023-12-27 23:56:35,550][106226] Updated weights for policy 0, policy_version 654083 (0.0007) [2023-12-27 23:56:35,610][106226] Updated weights for policy 0, policy_version 654093 (0.0010) [2023-12-27 23:56:35,666][106226] Updated weights for policy 0, policy_version 654103 (0.0010) [2023-12-27 23:56:35,999][106225] Updated weights for policy 1, policy_version 655917 (0.0009) [2023-12-27 23:56:36,055][106225] Updated weights for policy 1, policy_version 655927 (0.0007) [2023-12-27 23:56:36,121][106225] Updated weights for policy 1, policy_version 655937 (0.0008) [2023-12-27 23:56:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 335446016. Throughput: 0: 10148.5, 1: 9749.9. Samples: 335453856. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:56:36,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-6.138')] [2023-12-27 23:56:36,370][106226] Updated weights for policy 0, policy_version 654113 (0.0010) [2023-12-27 23:56:36,431][106226] Updated weights for policy 0, policy_version 654123 (0.0010) [2023-12-27 23:56:36,497][106226] Updated weights for policy 0, policy_version 654133 (0.0011) [2023-12-27 23:56:36,544][106226] Updated weights for policy 0, policy_version 654143 (0.0010) [2023-12-27 23:56:36,842][106225] Updated weights for policy 1, policy_version 655947 (0.0009) [2023-12-27 23:56:36,903][106225] Updated weights for policy 1, policy_version 655957 (0.0010) [2023-12-27 23:56:36,956][106225] Updated weights for policy 1, policy_version 655967 (0.0010) [2023-12-27 23:56:37,192][106226] Updated weights for policy 0, policy_version 654153 (0.0006) [2023-12-27 23:56:37,245][106226] Updated weights for policy 0, policy_version 654163 (0.0007) [2023-12-27 23:56:37,295][106226] Updated weights for policy 0, policy_version 654173 (0.0008) [2023-12-27 23:56:37,670][106225] Updated weights for policy 1, policy_version 655977 (0.0009) [2023-12-27 23:56:37,729][106225] Updated weights for policy 1, policy_version 655987 (0.0011) [2023-12-27 23:56:37,791][106225] Updated weights for policy 1, policy_version 655997 (0.0011) [2023-12-27 23:56:37,849][106225] Updated weights for policy 1, policy_version 656007 (0.0010) [2023-12-27 23:56:38,021][106226] Updated weights for policy 0, policy_version 654183 (0.0007) [2023-12-27 23:56:38,085][106226] Updated weights for policy 0, policy_version 654193 (0.0008) [2023-12-27 23:56:38,143][106226] Updated weights for policy 0, policy_version 654203 (0.0008) [2023-12-27 23:56:38,566][106225] Updated weights for policy 1, policy_version 656017 (0.0007) [2023-12-27 23:56:38,624][106225] Updated weights for policy 1, policy_version 656027 (0.0010) [2023-12-27 23:56:38,674][106225] Updated weights for policy 1, policy_version 656037 (0.0010) [2023-12-27 23:56:38,946][106226] Updated weights for policy 0, policy_version 654213 (0.0008) [2023-12-27 23:56:38,996][106226] Updated weights for policy 0, policy_version 654223 (0.0007) [2023-12-27 23:56:39,053][106226] Updated weights for policy 0, policy_version 654233 (0.0008) [2023-12-27 23:56:39,365][106225] Updated weights for policy 1, policy_version 656047 (0.0010) [2023-12-27 23:56:39,429][106225] Updated weights for policy 1, policy_version 656057 (0.0008) [2023-12-27 23:56:39,489][106225] Updated weights for policy 1, policy_version 656067 (0.0007) [2023-12-27 23:56:39,884][106226] Updated weights for policy 0, policy_version 654243 (0.0008) [2023-12-27 23:56:39,940][106226] Updated weights for policy 0, policy_version 654253 (0.0008) [2023-12-27 23:56:40,010][106226] Updated weights for policy 0, policy_version 654263 (0.0006) [2023-12-27 23:56:40,190][106225] Updated weights for policy 1, policy_version 656077 (0.0007) [2023-12-27 23:56:40,249][106225] Updated weights for policy 1, policy_version 656087 (0.0010) [2023-12-27 23:56:40,303][106225] Updated weights for policy 1, policy_version 656097 (0.0010) [2023-12-27 23:56:40,675][106226] Updated weights for policy 0, policy_version 654273 (0.0006) [2023-12-27 23:56:40,723][106226] Updated weights for policy 0, policy_version 654283 (0.0008) [2023-12-27 23:56:40,780][106226] Updated weights for policy 0, policy_version 654293 (0.0008) [2023-12-27 23:56:40,846][106226] Updated weights for policy 0, policy_version 654303 (0.0008) [2023-12-27 23:56:41,054][106225] Updated weights for policy 1, policy_version 656107 (0.0011) [2023-12-27 23:56:41,125][106225] Updated weights for policy 1, policy_version 656117 (0.0011) [2023-12-27 23:56:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 335536128. Throughput: 0: 10104.2, 1: 9768.0. Samples: 335511472. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:56:41,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.852')] [2023-12-27 23:56:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000654304_167542784.pth... [2023-12-27 23:56:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000653152_167247872.pth [2023-12-27 23:56:41,192][106225] Updated weights for policy 1, policy_version 656127 (0.0010) [2023-12-27 23:56:41,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000656136_168001536.pth... [2023-12-27 23:56:41,246][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000654952_167698432.pth [2023-12-27 23:56:41,598][106226] Updated weights for policy 0, policy_version 654313 (0.0007) [2023-12-27 23:56:41,661][106226] Updated weights for policy 0, policy_version 654323 (0.0007) [2023-12-27 23:56:41,717][106226] Updated weights for policy 0, policy_version 654333 (0.0008) [2023-12-27 23:56:41,869][106225] Updated weights for policy 1, policy_version 656137 (0.0007) [2023-12-27 23:56:41,933][106225] Updated weights for policy 1, policy_version 656147 (0.0011) [2023-12-27 23:56:41,988][106225] Updated weights for policy 1, policy_version 656157 (0.0010) [2023-12-27 23:56:42,054][106225] Updated weights for policy 1, policy_version 656167 (0.0011) [2023-12-27 23:56:42,485][106226] Updated weights for policy 0, policy_version 654343 (0.0007) [2023-12-27 23:56:42,546][106226] Updated weights for policy 0, policy_version 654353 (0.0008) [2023-12-27 23:56:42,605][106226] Updated weights for policy 0, policy_version 654363 (0.0008) [2023-12-27 23:56:42,807][106225] Updated weights for policy 1, policy_version 656177 (0.0010) [2023-12-27 23:56:42,871][106225] Updated weights for policy 1, policy_version 656187 (0.0012) [2023-12-27 23:56:42,941][106225] Updated weights for policy 1, policy_version 656197 (0.0010) [2023-12-27 23:56:43,303][106226] Updated weights for policy 0, policy_version 654373 (0.0008) [2023-12-27 23:56:43,367][106226] Updated weights for policy 0, policy_version 654383 (0.0008) [2023-12-27 23:56:43,427][106226] Updated weights for policy 0, policy_version 654393 (0.0008) [2023-12-27 23:56:43,663][106225] Updated weights for policy 1, policy_version 656207 (0.0007) [2023-12-27 23:56:43,729][106225] Updated weights for policy 1, policy_version 656217 (0.0005) [2023-12-27 23:56:43,781][106225] Updated weights for policy 1, policy_version 656227 (0.0009) [2023-12-27 23:56:44,112][106226] Updated weights for policy 0, policy_version 654403 (0.0006) [2023-12-27 23:56:44,169][106226] Updated weights for policy 0, policy_version 654413 (0.0008) [2023-12-27 23:56:44,233][106226] Updated weights for policy 0, policy_version 654423 (0.0008) [2023-12-27 23:56:44,448][106225] Updated weights for policy 1, policy_version 656237 (0.0010) [2023-12-27 23:56:44,501][106225] Updated weights for policy 1, policy_version 656247 (0.0010) [2023-12-27 23:56:44,557][106225] Updated weights for policy 1, policy_version 656257 (0.0010) [2023-12-27 23:56:44,982][106226] Updated weights for policy 0, policy_version 654433 (0.0008) [2023-12-27 23:56:45,041][106226] Updated weights for policy 0, policy_version 654443 (0.0008) [2023-12-27 23:56:45,104][106226] Updated weights for policy 0, policy_version 654453 (0.0007) [2023-12-27 23:56:45,170][106226] Updated weights for policy 0, policy_version 654463 (0.0008) [2023-12-27 23:56:45,265][106225] Updated weights for policy 1, policy_version 656267 (0.0010) [2023-12-27 23:56:45,327][106225] Updated weights for policy 1, policy_version 656277 (0.0011) [2023-12-27 23:56:45,390][106225] Updated weights for policy 1, policy_version 656287 (0.0011) [2023-12-27 23:56:45,917][106226] Updated weights for policy 0, policy_version 654473 (0.0006) [2023-12-27 23:56:45,973][106226] Updated weights for policy 0, policy_version 654483 (0.0005) [2023-12-27 23:56:46,040][106226] Updated weights for policy 0, policy_version 654493 (0.0005) [2023-12-27 23:56:46,083][106225] Updated weights for policy 1, policy_version 656297 (0.0010) [2023-12-27 23:56:46,135][106225] Updated weights for policy 1, policy_version 656307 (0.0005) [2023-12-27 23:56:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 335634432. Throughput: 0: 9932.0, 1: 9839.2. Samples: 335626236. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:56:46,176][105115] Avg episode reward: [(0, '-4.584'), (1, '-5.791')] [2023-12-27 23:56:46,188][106225] Updated weights for policy 1, policy_version 656317 (0.0005) [2023-12-27 23:56:46,237][106225] Updated weights for policy 1, policy_version 656327 (0.0005) [2023-12-27 23:56:46,573][106226] Updated weights for policy 0, policy_version 654503 (0.0007) [2023-12-27 23:56:46,628][106226] Updated weights for policy 0, policy_version 654513 (0.0009) [2023-12-27 23:56:46,678][106226] Updated weights for policy 0, policy_version 654523 (0.0010) [2023-12-27 23:56:46,778][106225] Updated weights for policy 1, policy_version 656337 (0.0008) [2023-12-27 23:56:46,833][106225] Updated weights for policy 1, policy_version 656347 (0.0008) [2023-12-27 23:56:46,883][106225] Updated weights for policy 1, policy_version 656357 (0.0009) [2023-12-27 23:56:47,327][106226] Updated weights for policy 0, policy_version 654533 (0.0007) [2023-12-27 23:56:47,386][106226] Updated weights for policy 0, policy_version 654543 (0.0005) [2023-12-27 23:56:47,454][106226] Updated weights for policy 0, policy_version 654553 (0.0005) [2023-12-27 23:56:47,499][106225] Updated weights for policy 1, policy_version 656367 (0.0007) [2023-12-27 23:56:47,558][106225] Updated weights for policy 1, policy_version 656377 (0.0006) [2023-12-27 23:56:47,619][106225] Updated weights for policy 1, policy_version 656387 (0.0009) [2023-12-27 23:56:48,116][106226] Updated weights for policy 0, policy_version 654563 (0.0007) [2023-12-27 23:56:48,170][106226] Updated weights for policy 0, policy_version 654573 (0.0009) [2023-12-27 23:56:48,223][106226] Updated weights for policy 0, policy_version 654583 (0.0007) [2023-12-27 23:56:48,247][106225] Updated weights for policy 1, policy_version 656397 (0.0009) [2023-12-27 23:56:48,305][106225] Updated weights for policy 1, policy_version 656407 (0.0010) [2023-12-27 23:56:48,371][106225] Updated weights for policy 1, policy_version 656417 (0.0009) [2023-12-27 23:56:48,986][106226] Updated weights for policy 0, policy_version 654593 (0.0005) [2023-12-27 23:56:49,006][106225] Updated weights for policy 1, policy_version 656427 (0.0009) [2023-12-27 23:56:49,042][106226] Updated weights for policy 0, policy_version 654603 (0.0006) [2023-12-27 23:56:49,054][106225] Updated weights for policy 1, policy_version 656437 (0.0008) [2023-12-27 23:56:49,098][106226] Updated weights for policy 0, policy_version 654613 (0.0008) [2023-12-27 23:56:49,112][106225] Updated weights for policy 1, policy_version 656447 (0.0005) [2023-12-27 23:56:49,151][106226] Updated weights for policy 0, policy_version 654623 (0.0008) [2023-12-27 23:56:49,792][106225] Updated weights for policy 1, policy_version 656457 (0.0006) [2023-12-27 23:56:49,857][106225] Updated weights for policy 1, policy_version 656467 (0.0011) [2023-12-27 23:56:49,887][106226] Updated weights for policy 0, policy_version 654633 (0.0008) [2023-12-27 23:56:49,914][106225] Updated weights for policy 1, policy_version 656477 (0.0010) [2023-12-27 23:56:49,952][106226] Updated weights for policy 0, policy_version 654643 (0.0007) [2023-12-27 23:56:49,981][106225] Updated weights for policy 1, policy_version 656487 (0.0009) [2023-12-27 23:56:50,018][106226] Updated weights for policy 0, policy_version 654653 (0.0008) [2023-12-27 23:56:50,652][106225] Updated weights for policy 1, policy_version 656497 (0.0009) [2023-12-27 23:56:50,713][106225] Updated weights for policy 1, policy_version 656507 (0.0010) [2023-12-27 23:56:50,773][106225] Updated weights for policy 1, policy_version 656517 (0.0010) [2023-12-27 23:56:50,824][106226] Updated weights for policy 0, policy_version 654663 (0.0010) [2023-12-27 23:56:50,882][106226] Updated weights for policy 0, policy_version 654673 (0.0011) [2023-12-27 23:56:50,934][106226] Updated weights for policy 0, policy_version 654683 (0.0011) [2023-12-27 23:56:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 335740928. Throughput: 0: 9898.0, 1: 9951.4. Samples: 335748928. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:56:51,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-5.616')] [2023-12-27 23:56:51,540][106225] Updated weights for policy 1, policy_version 656527 (0.0010) [2023-12-27 23:56:51,589][106225] Updated weights for policy 1, policy_version 656537 (0.0008) [2023-12-27 23:56:51,660][106225] Updated weights for policy 1, policy_version 656547 (0.0007) [2023-12-27 23:56:51,688][106226] Updated weights for policy 0, policy_version 654693 (0.0009) [2023-12-27 23:56:51,752][106226] Updated weights for policy 0, policy_version 654703 (0.0009) [2023-12-27 23:56:51,811][106226] Updated weights for policy 0, policy_version 654713 (0.0009) [2023-12-27 23:56:52,356][106225] Updated weights for policy 1, policy_version 656557 (0.0006) [2023-12-27 23:56:52,417][106225] Updated weights for policy 1, policy_version 656567 (0.0009) [2023-12-27 23:56:52,472][106225] Updated weights for policy 1, policy_version 656577 (0.0008) [2023-12-27 23:56:52,580][106226] Updated weights for policy 0, policy_version 654723 (0.0009) [2023-12-27 23:56:52,636][106226] Updated weights for policy 0, policy_version 654733 (0.0011) [2023-12-27 23:56:52,703][106226] Updated weights for policy 0, policy_version 654743 (0.0011) [2023-12-27 23:56:53,099][106225] Updated weights for policy 1, policy_version 656587 (0.0009) [2023-12-27 23:56:53,161][106225] Updated weights for policy 1, policy_version 656597 (0.0008) [2023-12-27 23:56:53,225][106225] Updated weights for policy 1, policy_version 656607 (0.0008) [2023-12-27 23:56:53,366][106226] Updated weights for policy 0, policy_version 654753 (0.0010) [2023-12-27 23:56:53,417][106226] Updated weights for policy 0, policy_version 654763 (0.0008) [2023-12-27 23:56:53,474][106226] Updated weights for policy 0, policy_version 654773 (0.0010) [2023-12-27 23:56:53,532][106226] Updated weights for policy 0, policy_version 654783 (0.0011) [2023-12-27 23:56:53,890][106225] Updated weights for policy 1, policy_version 656617 (0.0008) [2023-12-27 23:56:53,939][106225] Updated weights for policy 1, policy_version 656627 (0.0008) [2023-12-27 23:56:53,989][106225] Updated weights for policy 1, policy_version 656637 (0.0007) [2023-12-27 23:56:54,045][106225] Updated weights for policy 1, policy_version 656647 (0.0007) [2023-12-27 23:56:54,231][106226] Updated weights for policy 0, policy_version 654793 (0.0010) [2023-12-27 23:56:54,292][106226] Updated weights for policy 0, policy_version 654803 (0.0010) [2023-12-27 23:56:54,349][106226] Updated weights for policy 0, policy_version 654813 (0.0011) [2023-12-27 23:56:54,664][106225] Updated weights for policy 1, policy_version 656657 (0.0005) [2023-12-27 23:56:54,720][106225] Updated weights for policy 1, policy_version 656667 (0.0005) [2023-12-27 23:56:54,779][106225] Updated weights for policy 1, policy_version 656677 (0.0006) [2023-12-27 23:56:55,016][106226] Updated weights for policy 0, policy_version 654823 (0.0008) [2023-12-27 23:56:55,063][106226] Updated weights for policy 0, policy_version 654833 (0.0007) [2023-12-27 23:56:55,114][106226] Updated weights for policy 0, policy_version 654843 (0.0006) [2023-12-27 23:56:55,346][106225] Updated weights for policy 1, policy_version 656687 (0.0005) [2023-12-27 23:56:55,405][106225] Updated weights for policy 1, policy_version 656697 (0.0008) [2023-12-27 23:56:55,458][106225] Updated weights for policy 1, policy_version 656708 (0.0012) [2023-12-27 23:56:55,687][106226] Updated weights for policy 0, policy_version 654853 (0.0008) [2023-12-27 23:56:55,747][106226] Updated weights for policy 0, policy_version 654863 (0.0007) [2023-12-27 23:56:55,798][106226] Updated weights for policy 0, policy_version 654873 (0.0005) [2023-12-27 23:56:56,077][106225] Updated weights for policy 1, policy_version 656718 (0.0007) [2023-12-27 23:56:56,132][106225] Updated weights for policy 1, policy_version 656728 (0.0008) [2023-12-27 23:56:56,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 335839232. Throughput: 0: 9882.6, 1: 9994.1. Samples: 335808172. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:56:56,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.616')] [2023-12-27 23:56:56,182][106225] Updated weights for policy 1, policy_version 656738 (0.0008) [2023-12-27 23:56:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000654880_167690240.pth... [2023-12-27 23:56:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000653728_167395328.pth [2023-12-27 23:56:56,213][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000656744_168157184.pth... [2023-12-27 23:56:56,216][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000655560_167854080.pth [2023-12-27 23:56:56,373][106226] Updated weights for policy 0, policy_version 654883 (0.0007) [2023-12-27 23:56:56,427][106226] Updated weights for policy 0, policy_version 654893 (0.0011) [2023-12-27 23:56:56,478][106226] Updated weights for policy 0, policy_version 654903 (0.0010) [2023-12-27 23:56:56,907][106225] Updated weights for policy 1, policy_version 656748 (0.0006) [2023-12-27 23:56:56,953][106225] Updated weights for policy 1, policy_version 656758 (0.0008) [2023-12-27 23:56:56,998][106225] Updated weights for policy 1, policy_version 656768 (0.0007) [2023-12-27 23:56:57,146][106226] Updated weights for policy 0, policy_version 654913 (0.0010) [2023-12-27 23:56:57,229][106226] Updated weights for policy 0, policy_version 654923 (0.0011) [2023-12-27 23:56:57,280][106226] Updated weights for policy 0, policy_version 654933 (0.0010) [2023-12-27 23:56:57,333][106226] Updated weights for policy 0, policy_version 654943 (0.0010) [2023-12-27 23:56:57,767][106225] Updated weights for policy 1, policy_version 656778 (0.0008) [2023-12-27 23:56:57,816][106225] Updated weights for policy 1, policy_version 656788 (0.0007) [2023-12-27 23:56:57,864][106225] Updated weights for policy 1, policy_version 656798 (0.0007) [2023-12-27 23:56:57,923][106225] Updated weights for policy 1, policy_version 656808 (0.0008) [2023-12-27 23:56:57,974][106226] Updated weights for policy 0, policy_version 654953 (0.0009) [2023-12-27 23:56:58,022][106226] Updated weights for policy 0, policy_version 654963 (0.0008) [2023-12-27 23:56:58,065][106226] Updated weights for policy 0, policy_version 654973 (0.0008) [2023-12-27 23:56:58,725][106225] Updated weights for policy 1, policy_version 656818 (0.0008) [2023-12-27 23:56:58,789][106225] Updated weights for policy 1, policy_version 656828 (0.0008) [2023-12-27 23:56:58,851][106226] Updated weights for policy 0, policy_version 654983 (0.0008) [2023-12-27 23:56:58,860][106225] Updated weights for policy 1, policy_version 656838 (0.0009) [2023-12-27 23:56:58,926][106226] Updated weights for policy 0, policy_version 654993 (0.0008) [2023-12-27 23:56:58,988][106226] Updated weights for policy 0, policy_version 655003 (0.0009) [2023-12-27 23:56:59,625][106225] Updated weights for policy 1, policy_version 656848 (0.0008) [2023-12-27 23:56:59,677][106225] Updated weights for policy 1, policy_version 656858 (0.0008) [2023-12-27 23:56:59,725][106225] Updated weights for policy 1, policy_version 656868 (0.0006) [2023-12-27 23:56:59,799][106226] Updated weights for policy 0, policy_version 655013 (0.0008) [2023-12-27 23:56:59,872][106226] Updated weights for policy 0, policy_version 655023 (0.0009) [2023-12-27 23:56:59,937][106226] Updated weights for policy 0, policy_version 655033 (0.0007) [2023-12-27 23:57:00,426][106225] Updated weights for policy 1, policy_version 656878 (0.0009) [2023-12-27 23:57:00,480][106225] Updated weights for policy 1, policy_version 656888 (0.0009) [2023-12-27 23:57:00,532][106225] Updated weights for policy 1, policy_version 656898 (0.0009) [2023-12-27 23:57:00,641][106226] Updated weights for policy 0, policy_version 655043 (0.0008) [2023-12-27 23:57:00,691][106226] Updated weights for policy 0, policy_version 655053 (0.0006) [2023-12-27 23:57:00,744][106226] Updated weights for policy 0, policy_version 655063 (0.0009) [2023-12-27 23:57:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 335937536. Throughput: 0: 9902.6, 1: 10034.5. Samples: 335928836. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:01,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.748')] [2023-12-27 23:57:01,219][106225] Updated weights for policy 1, policy_version 656908 (0.0008) [2023-12-27 23:57:01,285][106225] Updated weights for policy 1, policy_version 656918 (0.0009) [2023-12-27 23:57:01,353][106225] Updated weights for policy 1, policy_version 656928 (0.0010) [2023-12-27 23:57:01,439][106226] Updated weights for policy 0, policy_version 655073 (0.0007) [2023-12-27 23:57:01,491][106226] Updated weights for policy 0, policy_version 655083 (0.0009) [2023-12-27 23:57:01,544][106226] Updated weights for policy 0, policy_version 655094 (0.0009) [2023-12-27 23:57:01,590][106226] Updated weights for policy 0, policy_version 655104 (0.0009) [2023-12-27 23:57:01,974][106225] Updated weights for policy 1, policy_version 656938 (0.0007) [2023-12-27 23:57:02,030][106225] Updated weights for policy 1, policy_version 656948 (0.0008) [2023-12-27 23:57:02,079][106225] Updated weights for policy 1, policy_version 656958 (0.0009) [2023-12-27 23:57:02,127][106225] Updated weights for policy 1, policy_version 656968 (0.0008) [2023-12-27 23:57:02,413][106226] Updated weights for policy 0, policy_version 655114 (0.0008) [2023-12-27 23:57:02,477][106226] Updated weights for policy 0, policy_version 655124 (0.0008) [2023-12-27 23:57:02,538][106226] Updated weights for policy 0, policy_version 655134 (0.0008) [2023-12-27 23:57:02,868][106225] Updated weights for policy 1, policy_version 656978 (0.0008) [2023-12-27 23:57:02,929][106225] Updated weights for policy 1, policy_version 656988 (0.0006) [2023-12-27 23:57:02,989][106225] Updated weights for policy 1, policy_version 656998 (0.0007) [2023-12-27 23:57:03,287][106226] Updated weights for policy 0, policy_version 655144 (0.0010) [2023-12-27 23:57:03,334][106226] Updated weights for policy 0, policy_version 655154 (0.0010) [2023-12-27 23:57:03,383][106226] Updated weights for policy 0, policy_version 655164 (0.0010) [2023-12-27 23:57:03,652][106225] Updated weights for policy 1, policy_version 657008 (0.0007) [2023-12-27 23:57:03,711][106225] Updated weights for policy 1, policy_version 657018 (0.0007) [2023-12-27 23:57:03,772][106225] Updated weights for policy 1, policy_version 657028 (0.0008) [2023-12-27 23:57:04,091][106226] Updated weights for policy 0, policy_version 655174 (0.0009) [2023-12-27 23:57:04,156][106226] Updated weights for policy 0, policy_version 655184 (0.0008) [2023-12-27 23:57:04,217][106226] Updated weights for policy 0, policy_version 655194 (0.0008) [2023-12-27 23:57:04,523][106225] Updated weights for policy 1, policy_version 657038 (0.0007) [2023-12-27 23:57:04,572][106225] Updated weights for policy 1, policy_version 657048 (0.0008) [2023-12-27 23:57:04,616][106225] Updated weights for policy 1, policy_version 657058 (0.0008) [2023-12-27 23:57:04,968][106226] Updated weights for policy 0, policy_version 655204 (0.0008) [2023-12-27 23:57:05,025][106226] Updated weights for policy 0, policy_version 655214 (0.0008) [2023-12-27 23:57:05,077][106226] Updated weights for policy 0, policy_version 655224 (0.0008) [2023-12-27 23:57:05,351][106225] Updated weights for policy 1, policy_version 657068 (0.0008) [2023-12-27 23:57:05,399][106225] Updated weights for policy 1, policy_version 657078 (0.0009) [2023-12-27 23:57:05,456][106225] Updated weights for policy 1, policy_version 657088 (0.0010) [2023-12-27 23:57:05,831][106226] Updated weights for policy 0, policy_version 655234 (0.0009) [2023-12-27 23:57:05,881][106226] Updated weights for policy 0, policy_version 655244 (0.0010) [2023-12-27 23:57:05,930][106226] Updated weights for policy 0, policy_version 655254 (0.0010) [2023-12-27 23:57:05,987][106226] Updated weights for policy 0, policy_version 655264 (0.0010) [2023-12-27 23:57:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 336035840. Throughput: 0: 9881.6, 1: 9990.5. Samples: 336045992. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:06,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-5.558')] [2023-12-27 23:57:06,202][106225] Updated weights for policy 1, policy_version 657098 (0.0010) [2023-12-27 23:57:06,263][106225] Updated weights for policy 1, policy_version 657108 (0.0007) [2023-12-27 23:57:06,320][106225] Updated weights for policy 1, policy_version 657118 (0.0008) [2023-12-27 23:57:06,377][106225] Updated weights for policy 1, policy_version 657128 (0.0008) [2023-12-27 23:57:06,713][106226] Updated weights for policy 0, policy_version 655274 (0.0011) [2023-12-27 23:57:06,777][106226] Updated weights for policy 0, policy_version 655284 (0.0011) [2023-12-27 23:57:06,838][106226] Updated weights for policy 0, policy_version 655294 (0.0011) [2023-12-27 23:57:07,151][106225] Updated weights for policy 1, policy_version 657138 (0.0007) [2023-12-27 23:57:07,212][106225] Updated weights for policy 1, policy_version 657148 (0.0009) [2023-12-27 23:57:07,263][106225] Updated weights for policy 1, policy_version 657158 (0.0007) [2023-12-27 23:57:07,481][106226] Updated weights for policy 0, policy_version 655304 (0.0011) [2023-12-27 23:57:07,534][106226] Updated weights for policy 0, policy_version 655314 (0.0010) [2023-12-27 23:57:07,592][106226] Updated weights for policy 0, policy_version 655324 (0.0011) [2023-12-27 23:57:07,984][106225] Updated weights for policy 1, policy_version 657168 (0.0010) [2023-12-27 23:57:08,045][106225] Updated weights for policy 1, policy_version 657178 (0.0010) [2023-12-27 23:57:08,102][106225] Updated weights for policy 1, policy_version 657188 (0.0010) [2023-12-27 23:57:08,310][106226] Updated weights for policy 0, policy_version 655334 (0.0011) [2023-12-27 23:57:08,359][106226] Updated weights for policy 0, policy_version 655344 (0.0007) [2023-12-27 23:57:08,413][106226] Updated weights for policy 0, policy_version 655354 (0.0009) [2023-12-27 23:57:08,839][106225] Updated weights for policy 1, policy_version 657198 (0.0010) [2023-12-27 23:57:08,898][106225] Updated weights for policy 1, policy_version 657208 (0.0010) [2023-12-27 23:57:08,956][106225] Updated weights for policy 1, policy_version 657218 (0.0011) [2023-12-27 23:57:09,223][106226] Updated weights for policy 0, policy_version 655364 (0.0009) [2023-12-27 23:57:09,292][106226] Updated weights for policy 0, policy_version 655374 (0.0008) [2023-12-27 23:57:09,358][106226] Updated weights for policy 0, policy_version 655384 (0.0008) [2023-12-27 23:57:09,670][106225] Updated weights for policy 1, policy_version 657228 (0.0010) [2023-12-27 23:57:09,734][106225] Updated weights for policy 1, policy_version 657238 (0.0009) [2023-12-27 23:57:09,790][106225] Updated weights for policy 1, policy_version 657248 (0.0008) [2023-12-27 23:57:10,113][106226] Updated weights for policy 0, policy_version 655394 (0.0008) [2023-12-27 23:57:10,180][106226] Updated weights for policy 0, policy_version 655404 (0.0008) [2023-12-27 23:57:10,246][106226] Updated weights for policy 0, policy_version 655414 (0.0008) [2023-12-27 23:57:10,306][106226] Updated weights for policy 0, policy_version 655424 (0.0008) [2023-12-27 23:57:10,561][106225] Updated weights for policy 1, policy_version 657258 (0.0008) [2023-12-27 23:57:10,618][106225] Updated weights for policy 1, policy_version 657268 (0.0008) [2023-12-27 23:57:10,671][106225] Updated weights for policy 1, policy_version 657278 (0.0009) [2023-12-27 23:57:10,740][106225] Updated weights for policy 1, policy_version 657288 (0.0010) [2023-12-27 23:57:10,937][106226] Updated weights for policy 0, policy_version 655434 (0.0006) [2023-12-27 23:57:11,005][106226] Updated weights for policy 0, policy_version 655444 (0.0005) [2023-12-27 23:57:11,075][106226] Updated weights for policy 0, policy_version 655454 (0.0008) [2023-12-27 23:57:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 336134144. Throughput: 0: 9865.2, 1: 9986.3. Samples: 336104032. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:11,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-6.278')] [2023-12-27 23:57:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000657288_168296448.pth... [2023-12-27 23:57:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000655456_167837696.pth... [2023-12-27 23:57:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000654304_167542784.pth [2023-12-27 23:57:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000656136_168001536.pth [2023-12-27 23:57:11,387][106225] Updated weights for policy 1, policy_version 657298 (0.0008) [2023-12-27 23:57:11,458][106225] Updated weights for policy 1, policy_version 657308 (0.0008) [2023-12-27 23:57:11,525][106225] Updated weights for policy 1, policy_version 657318 (0.0007) [2023-12-27 23:57:11,823][106226] Updated weights for policy 0, policy_version 655464 (0.0008) [2023-12-27 23:57:11,888][106226] Updated weights for policy 0, policy_version 655474 (0.0008) [2023-12-27 23:57:11,950][106226] Updated weights for policy 0, policy_version 655484 (0.0008) [2023-12-27 23:57:12,259][106225] Updated weights for policy 1, policy_version 657328 (0.0007) [2023-12-27 23:57:12,314][106225] Updated weights for policy 1, policy_version 657338 (0.0008) [2023-12-27 23:57:12,386][106225] Updated weights for policy 1, policy_version 657348 (0.0010) [2023-12-27 23:57:12,721][106226] Updated weights for policy 0, policy_version 655494 (0.0008) [2023-12-27 23:57:12,779][106226] Updated weights for policy 0, policy_version 655504 (0.0008) [2023-12-27 23:57:12,838][106226] Updated weights for policy 0, policy_version 655514 (0.0008) [2023-12-27 23:57:13,029][106225] Updated weights for policy 1, policy_version 657358 (0.0008) [2023-12-27 23:57:13,089][106225] Updated weights for policy 1, policy_version 657368 (0.0009) [2023-12-27 23:57:13,141][106225] Updated weights for policy 1, policy_version 657378 (0.0008) [2023-12-27 23:57:13,576][106226] Updated weights for policy 0, policy_version 655524 (0.0008) [2023-12-27 23:57:13,635][106226] Updated weights for policy 0, policy_version 655534 (0.0009) [2023-12-27 23:57:13,691][106226] Updated weights for policy 0, policy_version 655544 (0.0007) [2023-12-27 23:57:13,849][106225] Updated weights for policy 1, policy_version 657388 (0.0007) [2023-12-27 23:57:13,912][106225] Updated weights for policy 1, policy_version 657398 (0.0005) [2023-12-27 23:57:13,966][106225] Updated weights for policy 1, policy_version 657408 (0.0008) [2023-12-27 23:57:14,295][106226] Updated weights for policy 0, policy_version 655554 (0.0006) [2023-12-27 23:57:14,358][106226] Updated weights for policy 0, policy_version 655564 (0.0009) [2023-12-27 23:57:14,422][106226] Updated weights for policy 0, policy_version 655574 (0.0009) [2023-12-27 23:57:14,470][106226] Updated weights for policy 0, policy_version 655584 (0.0008) [2023-12-27 23:57:14,698][106225] Updated weights for policy 1, policy_version 657418 (0.0008) [2023-12-27 23:57:14,761][106225] Updated weights for policy 1, policy_version 657428 (0.0008) [2023-12-27 23:57:14,826][106225] Updated weights for policy 1, policy_version 657438 (0.0008) [2023-12-27 23:57:14,889][106225] Updated weights for policy 1, policy_version 657448 (0.0009) [2023-12-27 23:57:15,168][106226] Updated weights for policy 0, policy_version 655594 (0.0009) [2023-12-27 23:57:15,234][106226] Updated weights for policy 0, policy_version 655604 (0.0006) [2023-12-27 23:57:15,294][106226] Updated weights for policy 0, policy_version 655614 (0.0006) [2023-12-27 23:57:15,596][106225] Updated weights for policy 1, policy_version 657458 (0.0008) [2023-12-27 23:57:15,651][106225] Updated weights for policy 1, policy_version 657468 (0.0008) [2023-12-27 23:57:15,703][106225] Updated weights for policy 1, policy_version 657478 (0.0007) [2023-12-27 23:57:15,973][106226] Updated weights for policy 0, policy_version 655624 (0.0009) [2023-12-27 23:57:16,029][106226] Updated weights for policy 0, policy_version 655634 (0.0009) [2023-12-27 23:57:16,074][106226] Updated weights for policy 0, policy_version 655644 (0.0008) [2023-12-27 23:57:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 336232448. Throughput: 0: 9741.7, 1: 9898.1. Samples: 336220336. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:16,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-6.065')] [2023-12-27 23:57:16,408][106225] Updated weights for policy 1, policy_version 657488 (0.0008) [2023-12-27 23:57:16,472][106225] Updated weights for policy 1, policy_version 657498 (0.0008) [2023-12-27 23:57:16,539][106225] Updated weights for policy 1, policy_version 657508 (0.0008) [2023-12-27 23:57:16,757][106226] Updated weights for policy 0, policy_version 655654 (0.0008) [2023-12-27 23:57:16,821][106226] Updated weights for policy 0, policy_version 655664 (0.0010) [2023-12-27 23:57:16,882][106226] Updated weights for policy 0, policy_version 655674 (0.0011) [2023-12-27 23:57:17,111][106225] Updated weights for policy 1, policy_version 657518 (0.0006) [2023-12-27 23:57:17,171][106225] Updated weights for policy 1, policy_version 657528 (0.0005) [2023-12-27 23:57:17,239][106225] Updated weights for policy 1, policy_version 657538 (0.0007) [2023-12-27 23:57:17,585][106226] Updated weights for policy 0, policy_version 655684 (0.0010) [2023-12-27 23:57:17,642][106226] Updated weights for policy 0, policy_version 655694 (0.0008) [2023-12-27 23:57:17,688][106226] Updated weights for policy 0, policy_version 655704 (0.0009) [2023-12-27 23:57:17,869][106225] Updated weights for policy 1, policy_version 657548 (0.0008) [2023-12-27 23:57:17,927][106225] Updated weights for policy 1, policy_version 657558 (0.0009) [2023-12-27 23:57:17,979][106225] Updated weights for policy 1, policy_version 657568 (0.0009) [2023-12-27 23:57:18,445][106226] Updated weights for policy 0, policy_version 655714 (0.0008) [2023-12-27 23:57:18,500][106226] Updated weights for policy 0, policy_version 655724 (0.0008) [2023-12-27 23:57:18,554][106226] Updated weights for policy 0, policy_version 655734 (0.0008) [2023-12-27 23:57:18,605][106226] Updated weights for policy 0, policy_version 655744 (0.0007) [2023-12-27 23:57:18,673][106225] Updated weights for policy 1, policy_version 657578 (0.0008) [2023-12-27 23:57:18,730][106225] Updated weights for policy 1, policy_version 657588 (0.0008) [2023-12-27 23:57:18,785][106225] Updated weights for policy 1, policy_version 657598 (0.0008) [2023-12-27 23:57:18,845][106225] Updated weights for policy 1, policy_version 657608 (0.0008) [2023-12-27 23:57:19,344][106226] Updated weights for policy 0, policy_version 655754 (0.0011) [2023-12-27 23:57:19,413][106226] Updated weights for policy 0, policy_version 655764 (0.0010) [2023-12-27 23:57:19,466][106226] Updated weights for policy 0, policy_version 655774 (0.0010) [2023-12-27 23:57:19,626][106225] Updated weights for policy 1, policy_version 657618 (0.0010) [2023-12-27 23:57:19,685][106225] Updated weights for policy 1, policy_version 657628 (0.0010) [2023-12-27 23:57:19,746][106225] Updated weights for policy 1, policy_version 657638 (0.0010) [2023-12-27 23:57:20,264][106226] Updated weights for policy 0, policy_version 655784 (0.0011) [2023-12-27 23:57:20,318][106226] Updated weights for policy 0, policy_version 655794 (0.0011) [2023-12-27 23:57:20,383][106226] Updated weights for policy 0, policy_version 655804 (0.0010) [2023-12-27 23:57:20,478][106225] Updated weights for policy 1, policy_version 657648 (0.0010) [2023-12-27 23:57:20,529][106225] Updated weights for policy 1, policy_version 657658 (0.0005) [2023-12-27 23:57:20,597][106225] Updated weights for policy 1, policy_version 657668 (0.0008) [2023-12-27 23:57:21,146][106226] Updated weights for policy 0, policy_version 655814 (0.0009) [2023-12-27 23:57:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 336322560. Throughput: 0: 9699.2, 1: 9942.3. Samples: 336337724. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:21,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-6.373')] [2023-12-27 23:57:21,210][106226] Updated weights for policy 0, policy_version 655824 (0.0009) [2023-12-27 23:57:21,279][106226] Updated weights for policy 0, policy_version 655834 (0.0007) [2023-12-27 23:57:21,293][106225] Updated weights for policy 1, policy_version 657678 (0.0009) [2023-12-27 23:57:21,363][106225] Updated weights for policy 1, policy_version 657688 (0.0008) [2023-12-27 23:57:21,424][106225] Updated weights for policy 1, policy_version 657698 (0.0010) [2023-12-27 23:57:22,011][106226] Updated weights for policy 0, policy_version 655844 (0.0007) [2023-12-27 23:57:22,076][106226] Updated weights for policy 0, policy_version 655854 (0.0008) [2023-12-27 23:57:22,139][106226] Updated weights for policy 0, policy_version 655864 (0.0007) [2023-12-27 23:57:22,144][106225] Updated weights for policy 1, policy_version 657708 (0.0011) [2023-12-27 23:57:22,205][106225] Updated weights for policy 1, policy_version 657718 (0.0010) [2023-12-27 23:57:22,264][106225] Updated weights for policy 1, policy_version 657728 (0.0008) [2023-12-27 23:57:22,857][106226] Updated weights for policy 0, policy_version 655874 (0.0006) [2023-12-27 23:57:22,910][106226] Updated weights for policy 0, policy_version 655884 (0.0007) [2023-12-27 23:57:22,961][106226] Updated weights for policy 0, policy_version 655894 (0.0008) [2023-12-27 23:57:23,002][106225] Updated weights for policy 1, policy_version 657738 (0.0010) [2023-12-27 23:57:23,006][106226] Updated weights for policy 0, policy_version 655904 (0.0008) [2023-12-27 23:57:23,063][106225] Updated weights for policy 1, policy_version 657748 (0.0010) [2023-12-27 23:57:23,125][106225] Updated weights for policy 1, policy_version 657758 (0.0010) [2023-12-27 23:57:23,196][106225] Updated weights for policy 1, policy_version 657768 (0.0011) [2023-12-27 23:57:23,759][106226] Updated weights for policy 0, policy_version 655914 (0.0008) [2023-12-27 23:57:23,816][106226] Updated weights for policy 0, policy_version 655924 (0.0008) [2023-12-27 23:57:23,870][106226] Updated weights for policy 0, policy_version 655934 (0.0006) [2023-12-27 23:57:23,904][106225] Updated weights for policy 1, policy_version 657778 (0.0010) [2023-12-27 23:57:23,964][106225] Updated weights for policy 1, policy_version 657788 (0.0010) [2023-12-27 23:57:24,017][106225] Updated weights for policy 1, policy_version 657798 (0.0010) [2023-12-27 23:57:24,595][106226] Updated weights for policy 0, policy_version 655944 (0.0007) [2023-12-27 23:57:24,654][106226] Updated weights for policy 0, policy_version 655954 (0.0007) [2023-12-27 23:57:24,708][106226] Updated weights for policy 0, policy_version 655964 (0.0008) [2023-12-27 23:57:24,736][106225] Updated weights for policy 1, policy_version 657808 (0.0010) [2023-12-27 23:57:24,798][106225] Updated weights for policy 1, policy_version 657818 (0.0010) [2023-12-27 23:57:24,851][106225] Updated weights for policy 1, policy_version 657828 (0.0010) [2023-12-27 23:57:25,443][106226] Updated weights for policy 0, policy_version 655974 (0.0008) [2023-12-27 23:57:25,500][106226] Updated weights for policy 0, policy_version 655984 (0.0008) [2023-12-27 23:57:25,559][106226] Updated weights for policy 0, policy_version 655994 (0.0008) [2023-12-27 23:57:25,572][106225] Updated weights for policy 1, policy_version 657838 (0.0010) [2023-12-27 23:57:25,625][106225] Updated weights for policy 1, policy_version 657848 (0.0010) [2023-12-27 23:57:25,672][106225] Updated weights for policy 1, policy_version 657858 (0.0010) [2023-12-27 23:57:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 336420864. Throughput: 0: 9671.7, 1: 9941.7. Samples: 336394076. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:26,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-5.787')] [2023-12-27 23:57:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000656000_167976960.pth... [2023-12-27 23:57:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000657864_168443904.pth... [2023-12-27 23:57:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000654880_167690240.pth [2023-12-27 23:57:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000656744_168157184.pth [2023-12-27 23:57:26,297][106226] Updated weights for policy 0, policy_version 656004 (0.0006) [2023-12-27 23:57:26,341][106226] Updated weights for policy 0, policy_version 656014 (0.0008) [2023-12-27 23:57:26,394][106226] Updated weights for policy 0, policy_version 656024 (0.0008) [2023-12-27 23:57:26,409][106225] Updated weights for policy 1, policy_version 657868 (0.0009) [2023-12-27 23:57:26,458][106225] Updated weights for policy 1, policy_version 657878 (0.0008) [2023-12-27 23:57:26,506][106225] Updated weights for policy 1, policy_version 657888 (0.0009) [2023-12-27 23:57:26,975][106226] Updated weights for policy 0, policy_version 656034 (0.0006) [2023-12-27 23:57:27,028][106226] Updated weights for policy 0, policy_version 656044 (0.0010) [2023-12-27 23:57:27,079][106226] Updated weights for policy 0, policy_version 656054 (0.0010) [2023-12-27 23:57:27,128][106226] Updated weights for policy 0, policy_version 656064 (0.0010) [2023-12-27 23:57:27,157][106225] Updated weights for policy 1, policy_version 657898 (0.0005) [2023-12-27 23:57:27,218][106225] Updated weights for policy 1, policy_version 657908 (0.0005) [2023-12-27 23:57:27,264][106225] Updated weights for policy 1, policy_version 657918 (0.0008) [2023-12-27 23:57:27,319][106225] Updated weights for policy 1, policy_version 657928 (0.0008) [2023-12-27 23:57:27,772][106226] Updated weights for policy 0, policy_version 656074 (0.0007) [2023-12-27 23:57:27,831][106226] Updated weights for policy 0, policy_version 656084 (0.0009) [2023-12-27 23:57:27,897][106226] Updated weights for policy 0, policy_version 656094 (0.0010) [2023-12-27 23:57:27,959][106225] Updated weights for policy 1, policy_version 657938 (0.0008) [2023-12-27 23:57:28,016][106225] Updated weights for policy 1, policy_version 657948 (0.0009) [2023-12-27 23:57:28,064][106225] Updated weights for policy 1, policy_version 657958 (0.0008) [2023-12-27 23:57:28,486][106226] Updated weights for policy 0, policy_version 656104 (0.0008) [2023-12-27 23:57:28,538][106226] Updated weights for policy 0, policy_version 656114 (0.0008) [2023-12-27 23:57:28,597][106226] Updated weights for policy 0, policy_version 656124 (0.0010) [2023-12-27 23:57:28,838][106225] Updated weights for policy 1, policy_version 657968 (0.0008) [2023-12-27 23:57:28,890][106225] Updated weights for policy 1, policy_version 657978 (0.0008) [2023-12-27 23:57:28,947][106225] Updated weights for policy 1, policy_version 657988 (0.0008) [2023-12-27 23:57:29,372][106226] Updated weights for policy 0, policy_version 656134 (0.0009) [2023-12-27 23:57:29,433][106226] Updated weights for policy 0, policy_version 656144 (0.0006) [2023-12-27 23:57:29,481][106226] Updated weights for policy 0, policy_version 656154 (0.0005) [2023-12-27 23:57:29,692][106225] Updated weights for policy 1, policy_version 657998 (0.0008) [2023-12-27 23:57:29,743][106225] Updated weights for policy 1, policy_version 658008 (0.0008) [2023-12-27 23:57:29,792][106225] Updated weights for policy 1, policy_version 658018 (0.0008) [2023-12-27 23:57:30,161][106226] Updated weights for policy 0, policy_version 656164 (0.0007) [2023-12-27 23:57:30,223][106226] Updated weights for policy 0, policy_version 656174 (0.0008) [2023-12-27 23:57:30,284][106226] Updated weights for policy 0, policy_version 656184 (0.0010) [2023-12-27 23:57:30,566][106225] Updated weights for policy 1, policy_version 658028 (0.0009) [2023-12-27 23:57:30,610][106225] Updated weights for policy 1, policy_version 658038 (0.0010) [2023-12-27 23:57:30,661][106225] Updated weights for policy 1, policy_version 658048 (0.0010) [2023-12-27 23:57:30,892][106226] Updated weights for policy 0, policy_version 656194 (0.0009) [2023-12-27 23:57:30,955][106226] Updated weights for policy 0, policy_version 656204 (0.0005) [2023-12-27 23:57:31,009][106226] Updated weights for policy 0, policy_version 656214 (0.0005) [2023-12-27 23:57:31,071][106226] Updated weights for policy 0, policy_version 656224 (0.0008) [2023-12-27 23:57:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 336527360. Throughput: 0: 9786.3, 1: 9959.6. Samples: 336514800. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:31,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.699')] [2023-12-27 23:57:31,444][106225] Updated weights for policy 1, policy_version 658058 (0.0010) [2023-12-27 23:57:31,498][106225] Updated weights for policy 1, policy_version 658068 (0.0007) [2023-12-27 23:57:31,554][106225] Updated weights for policy 1, policy_version 658078 (0.0008) [2023-12-27 23:57:31,610][106225] Updated weights for policy 1, policy_version 658088 (0.0008) [2023-12-27 23:57:31,802][106226] Updated weights for policy 0, policy_version 656234 (0.0008) [2023-12-27 23:57:31,863][106226] Updated weights for policy 0, policy_version 656244 (0.0007) [2023-12-27 23:57:31,925][106226] Updated weights for policy 0, policy_version 656254 (0.0007) [2023-12-27 23:57:32,290][106225] Updated weights for policy 1, policy_version 658098 (0.0005) [2023-12-27 23:57:32,347][106225] Updated weights for policy 1, policy_version 658108 (0.0006) [2023-12-27 23:57:32,403][106225] Updated weights for policy 1, policy_version 658118 (0.0006) [2023-12-27 23:57:32,694][106226] Updated weights for policy 0, policy_version 656264 (0.0010) [2023-12-27 23:57:32,742][106226] Updated weights for policy 0, policy_version 656274 (0.0009) [2023-12-27 23:57:32,799][106226] Updated weights for policy 0, policy_version 656284 (0.0009) [2023-12-27 23:57:32,995][106225] Updated weights for policy 1, policy_version 658128 (0.0008) [2023-12-27 23:57:33,042][106225] Updated weights for policy 1, policy_version 658138 (0.0006) [2023-12-27 23:57:33,092][106225] Updated weights for policy 1, policy_version 658148 (0.0007) [2023-12-27 23:57:33,572][106226] Updated weights for policy 0, policy_version 656294 (0.0008) [2023-12-27 23:57:33,637][106226] Updated weights for policy 0, policy_version 656304 (0.0008) [2023-12-27 23:57:33,701][106226] Updated weights for policy 0, policy_version 656314 (0.0007) [2023-12-27 23:57:33,714][106225] Updated weights for policy 1, policy_version 658158 (0.0008) [2023-12-27 23:57:33,772][106225] Updated weights for policy 1, policy_version 658168 (0.0007) [2023-12-27 23:57:33,823][106225] Updated weights for policy 1, policy_version 658178 (0.0008) [2023-12-27 23:57:34,439][106226] Updated weights for policy 0, policy_version 656324 (0.0007) [2023-12-27 23:57:34,500][106226] Updated weights for policy 0, policy_version 656334 (0.0009) [2023-12-27 23:57:34,556][106225] Updated weights for policy 1, policy_version 658188 (0.0008) [2023-12-27 23:57:34,557][106226] Updated weights for policy 0, policy_version 656344 (0.0009) [2023-12-27 23:57:34,618][106225] Updated weights for policy 1, policy_version 658198 (0.0007) [2023-12-27 23:57:34,679][106225] Updated weights for policy 1, policy_version 658208 (0.0007) [2023-12-27 23:57:35,227][106226] Updated weights for policy 0, policy_version 656354 (0.0008) [2023-12-27 23:57:35,289][106226] Updated weights for policy 0, policy_version 656364 (0.0009) [2023-12-27 23:57:35,337][106226] Updated weights for policy 0, policy_version 656374 (0.0009) [2023-12-27 23:57:35,339][106225] Updated weights for policy 1, policy_version 658218 (0.0007) [2023-12-27 23:57:35,389][106225] Updated weights for policy 1, policy_version 658228 (0.0006) [2023-12-27 23:57:35,391][106226] Updated weights for policy 0, policy_version 656384 (0.0007) [2023-12-27 23:57:35,434][106225] Updated weights for policy 1, policy_version 658238 (0.0008) [2023-12-27 23:57:35,484][106225] Updated weights for policy 1, policy_version 658248 (0.0008) [2023-12-27 23:57:36,173][106225] Updated weights for policy 1, policy_version 658258 (0.0006) [2023-12-27 23:57:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 336617472. Throughput: 0: 9766.4, 1: 9887.5. Samples: 336633352. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:36,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.699')] [2023-12-27 23:57:36,188][106226] Updated weights for policy 0, policy_version 656394 (0.0008) [2023-12-27 23:57:36,239][106225] Updated weights for policy 1, policy_version 658268 (0.0007) [2023-12-27 23:57:36,246][106226] Updated weights for policy 0, policy_version 656404 (0.0008) [2023-12-27 23:57:36,305][106225] Updated weights for policy 1, policy_version 658278 (0.0008) [2023-12-27 23:57:36,311][106226] Updated weights for policy 0, policy_version 656414 (0.0009) [2023-12-27 23:57:37,015][106225] Updated weights for policy 1, policy_version 658288 (0.0007) [2023-12-27 23:57:37,079][106226] Updated weights for policy 0, policy_version 656424 (0.0008) [2023-12-27 23:57:37,083][106225] Updated weights for policy 1, policy_version 658298 (0.0006) [2023-12-27 23:57:37,141][106226] Updated weights for policy 0, policy_version 656434 (0.0009) [2023-12-27 23:57:37,141][106225] Updated weights for policy 1, policy_version 658308 (0.0010) [2023-12-27 23:57:37,198][106226] Updated weights for policy 0, policy_version 656444 (0.0007) [2023-12-27 23:57:37,796][106225] Updated weights for policy 1, policy_version 658318 (0.0007) [2023-12-27 23:57:37,840][106225] Updated weights for policy 1, policy_version 658328 (0.0005) [2023-12-27 23:57:37,888][106225] Updated weights for policy 1, policy_version 658338 (0.0005) [2023-12-27 23:57:37,958][106226] Updated weights for policy 0, policy_version 656454 (0.0009) [2023-12-27 23:57:38,024][106226] Updated weights for policy 0, policy_version 656464 (0.0009) [2023-12-27 23:57:38,084][106226] Updated weights for policy 0, policy_version 656474 (0.0010) [2023-12-27 23:57:38,547][106225] Updated weights for policy 1, policy_version 658348 (0.0007) [2023-12-27 23:57:38,610][106225] Updated weights for policy 1, policy_version 658358 (0.0010) [2023-12-27 23:57:38,681][106225] Updated weights for policy 1, policy_version 658368 (0.0010) [2023-12-27 23:57:38,733][106226] Updated weights for policy 0, policy_version 656484 (0.0009) [2023-12-27 23:57:38,786][106226] Updated weights for policy 0, policy_version 656494 (0.0009) [2023-12-27 23:57:38,835][106226] Updated weights for policy 0, policy_version 656504 (0.0008) [2023-12-27 23:57:39,422][106225] Updated weights for policy 1, policy_version 658378 (0.0009) [2023-12-27 23:57:39,493][106225] Updated weights for policy 1, policy_version 658388 (0.0009) [2023-12-27 23:57:39,516][106226] Updated weights for policy 0, policy_version 656514 (0.0008) [2023-12-27 23:57:39,547][106225] Updated weights for policy 1, policy_version 658398 (0.0008) [2023-12-27 23:57:39,576][106226] Updated weights for policy 0, policy_version 656524 (0.0005) [2023-12-27 23:57:39,601][106225] Updated weights for policy 1, policy_version 658408 (0.0007) [2023-12-27 23:57:39,638][106226] Updated weights for policy 0, policy_version 656534 (0.0007) [2023-12-27 23:57:39,705][106226] Updated weights for policy 0, policy_version 656544 (0.0008) [2023-12-27 23:57:40,318][106225] Updated weights for policy 1, policy_version 658418 (0.0006) [2023-12-27 23:57:40,387][106225] Updated weights for policy 1, policy_version 658428 (0.0007) [2023-12-27 23:57:40,429][106226] Updated weights for policy 0, policy_version 656554 (0.0007) [2023-12-27 23:57:40,454][106225] Updated weights for policy 1, policy_version 658438 (0.0006) [2023-12-27 23:57:40,493][106226] Updated weights for policy 0, policy_version 656564 (0.0007) [2023-12-27 23:57:40,550][106226] Updated weights for policy 0, policy_version 656574 (0.0009) [2023-12-27 23:57:41,116][106225] Updated weights for policy 1, policy_version 658448 (0.0007) [2023-12-27 23:57:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 336715776. Throughput: 0: 9740.5, 1: 9896.0. Samples: 336691820. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:41,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.945')] [2023-12-27 23:57:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000656576_168124416.pth... [2023-12-27 23:57:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000655456_167837696.pth [2023-12-27 23:57:41,189][106225] Updated weights for policy 1, policy_version 658458 (0.0008) [2023-12-27 23:57:41,254][106225] Updated weights for policy 1, policy_version 658468 (0.0008) [2023-12-27 23:57:41,282][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000658472_168599552.pth... [2023-12-27 23:57:41,286][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000657288_168296448.pth [2023-12-27 23:57:41,290][106226] Updated weights for policy 0, policy_version 656584 (0.0009) [2023-12-27 23:57:41,348][106226] Updated weights for policy 0, policy_version 656594 (0.0010) [2023-12-27 23:57:41,420][106226] Updated weights for policy 0, policy_version 656604 (0.0009) [2023-12-27 23:57:42,018][106225] Updated weights for policy 1, policy_version 658478 (0.0009) [2023-12-27 23:57:42,070][106225] Updated weights for policy 1, policy_version 658488 (0.0008) [2023-12-27 23:57:42,137][106225] Updated weights for policy 1, policy_version 658498 (0.0008) [2023-12-27 23:57:42,145][106226] Updated weights for policy 0, policy_version 656614 (0.0009) [2023-12-27 23:57:42,215][106226] Updated weights for policy 0, policy_version 656624 (0.0009) [2023-12-27 23:57:42,279][106226] Updated weights for policy 0, policy_version 656634 (0.0008) [2023-12-27 23:57:42,773][106225] Updated weights for policy 1, policy_version 658508 (0.0007) [2023-12-27 23:57:42,834][106225] Updated weights for policy 1, policy_version 658518 (0.0008) [2023-12-27 23:57:42,903][106225] Updated weights for policy 1, policy_version 658528 (0.0010) [2023-12-27 23:57:43,034][106226] Updated weights for policy 0, policy_version 656644 (0.0009) [2023-12-27 23:57:43,094][106226] Updated weights for policy 0, policy_version 656654 (0.0007) [2023-12-27 23:57:43,151][106226] Updated weights for policy 0, policy_version 656664 (0.0008) [2023-12-27 23:57:43,636][106225] Updated weights for policy 1, policy_version 658538 (0.0009) [2023-12-27 23:57:43,695][106225] Updated weights for policy 1, policy_version 658548 (0.0008) [2023-12-27 23:57:43,758][106225] Updated weights for policy 1, policy_version 658558 (0.0008) [2023-12-27 23:57:43,809][106225] Updated weights for policy 1, policy_version 658568 (0.0009) [2023-12-27 23:57:43,852][106226] Updated weights for policy 0, policy_version 656674 (0.0009) [2023-12-27 23:57:43,903][106226] Updated weights for policy 0, policy_version 656684 (0.0008) [2023-12-27 23:57:43,967][106226] Updated weights for policy 0, policy_version 656694 (0.0007) [2023-12-27 23:57:44,019][106226] Updated weights for policy 0, policy_version 656704 (0.0005) [2023-12-27 23:57:44,549][106226] Updated weights for policy 0, policy_version 656714 (0.0008) [2023-12-27 23:57:44,597][106226] Updated weights for policy 0, policy_version 656724 (0.0006) [2023-12-27 23:57:44,610][106225] Updated weights for policy 1, policy_version 658578 (0.0006) [2023-12-27 23:57:44,652][106226] Updated weights for policy 0, policy_version 656734 (0.0006) [2023-12-27 23:57:44,665][106225] Updated weights for policy 1, policy_version 658588 (0.0007) [2023-12-27 23:57:44,723][106225] Updated weights for policy 1, policy_version 658598 (0.0008) [2023-12-27 23:57:45,432][106225] Updated weights for policy 1, policy_version 658608 (0.0009) [2023-12-27 23:57:45,462][106226] Updated weights for policy 0, policy_version 656744 (0.0007) [2023-12-27 23:57:45,484][106225] Updated weights for policy 1, policy_version 658618 (0.0006) [2023-12-27 23:57:45,526][106226] Updated weights for policy 0, policy_version 656754 (0.0007) [2023-12-27 23:57:45,541][106225] Updated weights for policy 1, policy_version 658628 (0.0008) [2023-12-27 23:57:45,582][106226] Updated weights for policy 0, policy_version 656764 (0.0008) [2023-12-27 23:57:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 336814080. Throughput: 0: 9695.7, 1: 9829.4. Samples: 336807468. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:46,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-5.735')] [2023-12-27 23:57:46,206][106225] Updated weights for policy 1, policy_version 658638 (0.0009) [2023-12-27 23:57:46,259][106225] Updated weights for policy 1, policy_version 658648 (0.0009) [2023-12-27 23:57:46,278][106226] Updated weights for policy 0, policy_version 656774 (0.0007) [2023-12-27 23:57:46,307][106225] Updated weights for policy 1, policy_version 658658 (0.0007) [2023-12-27 23:57:46,334][106226] Updated weights for policy 0, policy_version 656784 (0.0005) [2023-12-27 23:57:46,387][106226] Updated weights for policy 0, policy_version 656794 (0.0006) [2023-12-27 23:57:46,996][106226] Updated weights for policy 0, policy_version 656804 (0.0009) [2023-12-27 23:57:47,042][106226] Updated weights for policy 0, policy_version 656814 (0.0010) [2023-12-27 23:57:47,089][106226] Updated weights for policy 0, policy_version 656824 (0.0010) [2023-12-27 23:57:47,115][106225] Updated weights for policy 1, policy_version 658668 (0.0007) [2023-12-27 23:57:47,167][106225] Updated weights for policy 1, policy_version 658678 (0.0007) [2023-12-27 23:57:47,220][106225] Updated weights for policy 1, policy_version 658688 (0.0008) [2023-12-27 23:57:47,756][106226] Updated weights for policy 0, policy_version 656834 (0.0009) [2023-12-27 23:57:47,805][106226] Updated weights for policy 0, policy_version 656844 (0.0005) [2023-12-27 23:57:47,851][106226] Updated weights for policy 0, policy_version 656854 (0.0005) [2023-12-27 23:57:47,906][106226] Updated weights for policy 0, policy_version 656864 (0.0005) [2023-12-27 23:57:47,964][106225] Updated weights for policy 1, policy_version 658698 (0.0007) [2023-12-27 23:57:48,021][106225] Updated weights for policy 1, policy_version 658708 (0.0008) [2023-12-27 23:57:48,081][106225] Updated weights for policy 1, policy_version 658718 (0.0008) [2023-12-27 23:57:48,138][106225] Updated weights for policy 1, policy_version 658728 (0.0008) [2023-12-27 23:57:48,592][106226] Updated weights for policy 0, policy_version 656874 (0.0011) [2023-12-27 23:57:48,656][106226] Updated weights for policy 0, policy_version 656884 (0.0011) [2023-12-27 23:57:48,707][106226] Updated weights for policy 0, policy_version 656894 (0.0011) [2023-12-27 23:57:48,878][106225] Updated weights for policy 1, policy_version 658738 (0.0007) [2023-12-27 23:57:48,931][106225] Updated weights for policy 1, policy_version 658748 (0.0007) [2023-12-27 23:57:48,977][106225] Updated weights for policy 1, policy_version 658758 (0.0008) [2023-12-27 23:57:49,387][106226] Updated weights for policy 0, policy_version 656904 (0.0010) [2023-12-27 23:57:49,444][106226] Updated weights for policy 0, policy_version 656914 (0.0010) [2023-12-27 23:57:49,509][106226] Updated weights for policy 0, policy_version 656924 (0.0008) [2023-12-27 23:57:49,754][106225] Updated weights for policy 1, policy_version 658768 (0.0008) [2023-12-27 23:57:49,808][106225] Updated weights for policy 1, policy_version 658778 (0.0008) [2023-12-27 23:57:49,873][106225] Updated weights for policy 1, policy_version 658788 (0.0009) [2023-12-27 23:57:50,223][106226] Updated weights for policy 0, policy_version 656934 (0.0009) [2023-12-27 23:57:50,287][106226] Updated weights for policy 0, policy_version 656944 (0.0011) [2023-12-27 23:57:50,344][106226] Updated weights for policy 0, policy_version 656954 (0.0010) [2023-12-27 23:57:50,571][106225] Updated weights for policy 1, policy_version 658798 (0.0008) [2023-12-27 23:57:50,638][106225] Updated weights for policy 1, policy_version 658808 (0.0008) [2023-12-27 23:57:50,703][106225] Updated weights for policy 1, policy_version 658818 (0.0008) [2023-12-27 23:57:51,067][106226] Updated weights for policy 0, policy_version 656964 (0.0010) [2023-12-27 23:57:51,129][106226] Updated weights for policy 0, policy_version 656974 (0.0009) [2023-12-27 23:57:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19716.4). Total num frames: 336912384. Throughput: 0: 9782.4, 1: 9771.7. Samples: 336925928. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:51,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.924')] [2023-12-27 23:57:51,188][106226] Updated weights for policy 0, policy_version 656984 (0.0006) [2023-12-27 23:57:51,486][106225] Updated weights for policy 1, policy_version 658828 (0.0008) [2023-12-27 23:57:51,559][106225] Updated weights for policy 1, policy_version 658838 (0.0008) [2023-12-27 23:57:51,627][106225] Updated weights for policy 1, policy_version 658848 (0.0008) [2023-12-27 23:57:51,971][106226] Updated weights for policy 0, policy_version 656994 (0.0009) [2023-12-27 23:57:52,037][106226] Updated weights for policy 0, policy_version 657004 (0.0009) [2023-12-27 23:57:52,095][106226] Updated weights for policy 0, policy_version 657014 (0.0009) [2023-12-27 23:57:52,157][106226] Updated weights for policy 0, policy_version 657024 (0.0008) [2023-12-27 23:57:52,358][106225] Updated weights for policy 1, policy_version 658858 (0.0009) [2023-12-27 23:57:52,419][106225] Updated weights for policy 1, policy_version 658868 (0.0006) [2023-12-27 23:57:52,475][106225] Updated weights for policy 1, policy_version 658878 (0.0005) [2023-12-27 23:57:52,530][106225] Updated weights for policy 1, policy_version 658888 (0.0005) [2023-12-27 23:57:52,950][106226] Updated weights for policy 0, policy_version 657034 (0.0009) [2023-12-27 23:57:53,013][106226] Updated weights for policy 0, policy_version 657044 (0.0009) [2023-12-27 23:57:53,071][106226] Updated weights for policy 0, policy_version 657054 (0.0009) [2023-12-27 23:57:53,128][106225] Updated weights for policy 1, policy_version 658898 (0.0006) [2023-12-27 23:57:53,180][106225] Updated weights for policy 1, policy_version 658908 (0.0009) [2023-12-27 23:57:53,231][106225] Updated weights for policy 1, policy_version 658918 (0.0008) [2023-12-27 23:57:53,813][106226] Updated weights for policy 0, policy_version 657064 (0.0009) [2023-12-27 23:57:53,873][106226] Updated weights for policy 0, policy_version 657074 (0.0009) [2023-12-27 23:57:53,929][106226] Updated weights for policy 0, policy_version 657084 (0.0007) [2023-12-27 23:57:53,941][106225] Updated weights for policy 1, policy_version 658928 (0.0010) [2023-12-27 23:57:53,997][106225] Updated weights for policy 1, policy_version 658938 (0.0007) [2023-12-27 23:57:54,056][106225] Updated weights for policy 1, policy_version 658948 (0.0009) [2023-12-27 23:57:54,646][106226] Updated weights for policy 0, policy_version 657094 (0.0008) [2023-12-27 23:57:54,694][106226] Updated weights for policy 0, policy_version 657104 (0.0008) [2023-12-27 23:57:54,756][106226] Updated weights for policy 0, policy_version 657114 (0.0006) [2023-12-27 23:57:54,781][106225] Updated weights for policy 1, policy_version 658958 (0.0008) [2023-12-27 23:57:54,844][106225] Updated weights for policy 1, policy_version 658968 (0.0009) [2023-12-27 23:57:54,908][106225] Updated weights for policy 1, policy_version 658978 (0.0010) [2023-12-27 23:57:55,377][106226] Updated weights for policy 0, policy_version 657124 (0.0005) [2023-12-27 23:57:55,437][106226] Updated weights for policy 0, policy_version 657134 (0.0005) [2023-12-27 23:57:55,488][106226] Updated weights for policy 0, policy_version 657144 (0.0005) [2023-12-27 23:57:55,663][106225] Updated weights for policy 1, policy_version 658988 (0.0008) [2023-12-27 23:57:55,723][106225] Updated weights for policy 1, policy_version 658998 (0.0008) [2023-12-27 23:57:55,785][106225] Updated weights for policy 1, policy_version 659008 (0.0008) [2023-12-27 23:57:56,122][106226] Updated weights for policy 0, policy_version 657154 (0.0006) [2023-12-27 23:57:56,174][106226] Updated weights for policy 0, policy_version 657164 (0.0008) [2023-12-27 23:57:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 337010688. Throughput: 0: 9729.3, 1: 9796.2. Samples: 336982676. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:57:56,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-5.531')] [2023-12-27 23:57:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000659016_168738816.pth... [2023-12-27 23:57:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000657864_168443904.pth [2023-12-27 23:57:56,231][106226] Updated weights for policy 0, policy_version 657174 (0.0008) [2023-12-27 23:57:56,288][106226] Updated weights for policy 0, policy_version 657184 (0.0006) [2023-12-27 23:57:56,289][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000657184_168280064.pth... [2023-12-27 23:57:56,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000656000_167976960.pth [2023-12-27 23:57:56,520][106225] Updated weights for policy 1, policy_version 659018 (0.0008) [2023-12-27 23:57:56,567][106225] Updated weights for policy 1, policy_version 659028 (0.0009) [2023-12-27 23:57:56,625][106225] Updated weights for policy 1, policy_version 659038 (0.0010) [2023-12-27 23:57:56,689][106225] Updated weights for policy 1, policy_version 659048 (0.0009) [2023-12-27 23:57:56,853][106226] Updated weights for policy 0, policy_version 657194 (0.0005) [2023-12-27 23:57:56,904][106226] Updated weights for policy 0, policy_version 657204 (0.0005) [2023-12-27 23:57:56,956][106226] Updated weights for policy 0, policy_version 657214 (0.0009) [2023-12-27 23:57:57,448][106225] Updated weights for policy 1, policy_version 659058 (0.0008) [2023-12-27 23:57:57,506][106225] Updated weights for policy 1, policy_version 659068 (0.0008) [2023-12-27 23:57:57,560][106225] Updated weights for policy 1, policy_version 659078 (0.0008) [2023-12-27 23:57:57,636][106226] Updated weights for policy 0, policy_version 657224 (0.0006) [2023-12-27 23:57:57,686][106226] Updated weights for policy 0, policy_version 657234 (0.0005) [2023-12-27 23:57:57,749][106226] Updated weights for policy 0, policy_version 657244 (0.0005) [2023-12-27 23:57:58,301][106226] Updated weights for policy 0, policy_version 657254 (0.0007) [2023-12-27 23:57:58,368][106225] Updated weights for policy 1, policy_version 659088 (0.0008) [2023-12-27 23:57:58,369][106226] Updated weights for policy 0, policy_version 657264 (0.0008) [2023-12-27 23:57:58,437][106226] Updated weights for policy 0, policy_version 657274 (0.0008) [2023-12-27 23:57:58,437][106225] Updated weights for policy 1, policy_version 659098 (0.0009) [2023-12-27 23:57:58,503][106225] Updated weights for policy 1, policy_version 659108 (0.0008) [2023-12-27 23:57:59,307][106226] Updated weights for policy 0, policy_version 657284 (0.0009) [2023-12-27 23:57:59,341][106225] Updated weights for policy 1, policy_version 659118 (0.0009) [2023-12-27 23:57:59,372][106226] Updated weights for policy 0, policy_version 657294 (0.0008) [2023-12-27 23:57:59,401][106225] Updated weights for policy 1, policy_version 659128 (0.0008) [2023-12-27 23:57:59,438][106226] Updated weights for policy 0, policy_version 657304 (0.0007) [2023-12-27 23:57:59,467][106225] Updated weights for policy 1, policy_version 659138 (0.0006) [2023-12-27 23:58:00,076][106226] Updated weights for policy 0, policy_version 657314 (0.0010) [2023-12-27 23:58:00,136][106226] Updated weights for policy 0, policy_version 657324 (0.0009) [2023-12-27 23:58:00,200][106226] Updated weights for policy 0, policy_version 657334 (0.0009) [2023-12-27 23:58:00,243][106225] Updated weights for policy 1, policy_version 659148 (0.0007) [2023-12-27 23:58:00,261][106226] Updated weights for policy 0, policy_version 657344 (0.0007) [2023-12-27 23:58:00,305][106225] Updated weights for policy 1, policy_version 659158 (0.0008) [2023-12-27 23:58:00,371][106225] Updated weights for policy 1, policy_version 659168 (0.0008) [2023-12-27 23:58:00,987][106226] Updated weights for policy 0, policy_version 657354 (0.0008) [2023-12-27 23:58:01,046][106226] Updated weights for policy 0, policy_version 657364 (0.0008) [2023-12-27 23:58:01,111][106226] Updated weights for policy 0, policy_version 657374 (0.0007) [2023-12-27 23:58:01,114][106225] Updated weights for policy 1, policy_version 659178 (0.0009) [2023-12-27 23:58:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 337108992. Throughput: 0: 9843.2, 1: 9709.0. Samples: 337100184. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:58:01,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-6.015')] [2023-12-27 23:58:01,178][106225] Updated weights for policy 1, policy_version 659188 (0.0008) [2023-12-27 23:58:01,238][106225] Updated weights for policy 1, policy_version 659198 (0.0009) [2023-12-27 23:58:01,294][106225] Updated weights for policy 1, policy_version 659208 (0.0007) [2023-12-27 23:58:01,805][106226] Updated weights for policy 0, policy_version 657384 (0.0008) [2023-12-27 23:58:01,858][106226] Updated weights for policy 0, policy_version 657394 (0.0007) [2023-12-27 23:58:01,914][106226] Updated weights for policy 0, policy_version 657404 (0.0005) [2023-12-27 23:58:02,026][106225] Updated weights for policy 1, policy_version 659218 (0.0008) [2023-12-27 23:58:02,088][106225] Updated weights for policy 1, policy_version 659228 (0.0006) [2023-12-27 23:58:02,142][106225] Updated weights for policy 1, policy_version 659238 (0.0008) [2023-12-27 23:58:02,698][106226] Updated weights for policy 0, policy_version 657414 (0.0007) [2023-12-27 23:58:02,740][106225] Updated weights for policy 1, policy_version 659248 (0.0010) [2023-12-27 23:58:02,771][106226] Updated weights for policy 0, policy_version 657424 (0.0006) [2023-12-27 23:58:02,799][106225] Updated weights for policy 1, policy_version 659258 (0.0011) [2023-12-27 23:58:02,832][106226] Updated weights for policy 0, policy_version 657434 (0.0007) [2023-12-27 23:58:02,859][106225] Updated weights for policy 1, policy_version 659268 (0.0010) [2023-12-27 23:58:03,433][106226] Updated weights for policy 0, policy_version 657444 (0.0006) [2023-12-27 23:58:03,485][106226] Updated weights for policy 0, policy_version 657454 (0.0005) [2023-12-27 23:58:03,543][106226] Updated weights for policy 0, policy_version 657464 (0.0005) [2023-12-27 23:58:03,552][106225] Updated weights for policy 1, policy_version 659278 (0.0008) [2023-12-27 23:58:03,604][106225] Updated weights for policy 1, policy_version 659288 (0.0010) [2023-12-27 23:58:03,661][106225] Updated weights for policy 1, policy_version 659298 (0.0010) [2023-12-27 23:58:04,112][106226] Updated weights for policy 0, policy_version 657474 (0.0006) [2023-12-27 23:58:04,180][106226] Updated weights for policy 0, policy_version 657484 (0.0011) [2023-12-27 23:58:04,245][106226] Updated weights for policy 0, policy_version 657494 (0.0011) [2023-12-27 23:58:04,307][106226] Updated weights for policy 0, policy_version 657504 (0.0011) [2023-12-27 23:58:04,419][106225] Updated weights for policy 1, policy_version 659308 (0.0010) [2023-12-27 23:58:04,482][106225] Updated weights for policy 1, policy_version 659318 (0.0009) [2023-12-27 23:58:04,542][106225] Updated weights for policy 1, policy_version 659328 (0.0007) [2023-12-27 23:58:05,024][106226] Updated weights for policy 0, policy_version 657514 (0.0008) [2023-12-27 23:58:05,070][106226] Updated weights for policy 0, policy_version 657524 (0.0008) [2023-12-27 23:58:05,123][106226] Updated weights for policy 0, policy_version 657534 (0.0007) [2023-12-27 23:58:05,202][106225] Updated weights for policy 1, policy_version 659338 (0.0010) [2023-12-27 23:58:05,254][106225] Updated weights for policy 1, policy_version 659348 (0.0009) [2023-12-27 23:58:05,305][106225] Updated weights for policy 1, policy_version 659358 (0.0005) [2023-12-27 23:58:05,356][106225] Updated weights for policy 1, policy_version 659368 (0.0005) [2023-12-27 23:58:05,912][106225] Updated weights for policy 1, policy_version 659378 (0.0010) [2023-12-27 23:58:05,946][106226] Updated weights for policy 0, policy_version 657544 (0.0008) [2023-12-27 23:58:05,969][106225] Updated weights for policy 1, policy_version 659388 (0.0008) [2023-12-27 23:58:05,996][106226] Updated weights for policy 0, policy_version 657554 (0.0008) [2023-12-27 23:58:06,032][106225] Updated weights for policy 1, policy_version 659398 (0.0010) [2023-12-27 23:58:06,046][106226] Updated weights for policy 0, policy_version 657564 (0.0008) [2023-12-27 23:58:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 337215488. Throughput: 0: 9869.3, 1: 9715.3. Samples: 337219028. Policy #0 lag: (min: 31.0, avg: 33.7, max: 61.0) [2023-12-27 23:58:06,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.952')] [2023-12-27 23:58:06,689][106225] Updated weights for policy 1, policy_version 659408 (0.0007) [2023-12-27 23:58:06,747][106225] Updated weights for policy 1, policy_version 659418 (0.0009) [2023-12-27 23:58:06,808][106225] Updated weights for policy 1, policy_version 659428 (0.0005) [2023-12-27 23:58:06,841][106226] Updated weights for policy 0, policy_version 657574 (0.0008) [2023-12-27 23:58:06,897][106226] Updated weights for policy 0, policy_version 657584 (0.0010) [2023-12-27 23:58:06,959][106226] Updated weights for policy 0, policy_version 657594 (0.0008) [2023-12-27 23:58:07,503][106225] Updated weights for policy 1, policy_version 659438 (0.0005) [2023-12-27 23:58:07,561][106225] Updated weights for policy 1, policy_version 659448 (0.0005) [2023-12-27 23:58:07,618][106225] Updated weights for policy 1, policy_version 659458 (0.0007) [2023-12-27 23:58:07,724][106226] Updated weights for policy 0, policy_version 657604 (0.0009) [2023-12-27 23:58:07,787][106226] Updated weights for policy 0, policy_version 657614 (0.0009) [2023-12-27 23:58:07,844][106226] Updated weights for policy 0, policy_version 657624 (0.0008) [2023-12-27 23:58:08,234][106225] Updated weights for policy 1, policy_version 659468 (0.0008) [2023-12-27 23:58:08,284][106225] Updated weights for policy 1, policy_version 659478 (0.0010) [2023-12-27 23:58:08,344][106225] Updated weights for policy 1, policy_version 659488 (0.0010) [2023-12-27 23:58:08,555][106226] Updated weights for policy 0, policy_version 657634 (0.0008) [2023-12-27 23:58:08,616][106226] Updated weights for policy 0, policy_version 657644 (0.0011) [2023-12-27 23:58:08,681][106226] Updated weights for policy 0, policy_version 657654 (0.0011) [2023-12-27 23:58:08,748][106226] Updated weights for policy 0, policy_version 657664 (0.0010) [2023-12-27 23:58:09,062][106225] Updated weights for policy 1, policy_version 659498 (0.0011) [2023-12-27 23:58:09,109][106225] Updated weights for policy 1, policy_version 659508 (0.0010) [2023-12-27 23:58:09,160][106225] Updated weights for policy 1, policy_version 659518 (0.0010) [2023-12-27 23:58:09,207][106225] Updated weights for policy 1, policy_version 659528 (0.0010) [2023-12-27 23:58:09,418][106226] Updated weights for policy 0, policy_version 657674 (0.0008) [2023-12-27 23:58:09,480][106226] Updated weights for policy 0, policy_version 657684 (0.0008) [2023-12-27 23:58:09,551][106226] Updated weights for policy 0, policy_version 657694 (0.0008) [2023-12-27 23:58:10,016][106225] Updated weights for policy 1, policy_version 659538 (0.0010) [2023-12-27 23:58:10,077][106225] Updated weights for policy 1, policy_version 659548 (0.0010) [2023-12-27 23:58:10,141][106225] Updated weights for policy 1, policy_version 659558 (0.0010) [2023-12-27 23:58:10,320][106226] Updated weights for policy 0, policy_version 657704 (0.0006) [2023-12-27 23:58:10,386][106226] Updated weights for policy 0, policy_version 657714 (0.0006) [2023-12-27 23:58:10,453][106226] Updated weights for policy 0, policy_version 657724 (0.0008) [2023-12-27 23:58:10,840][106225] Updated weights for policy 1, policy_version 659568 (0.0010) [2023-12-27 23:58:10,897][106225] Updated weights for policy 1, policy_version 659578 (0.0010) [2023-12-27 23:58:10,957][106225] Updated weights for policy 1, policy_version 659588 (0.0010) [2023-12-27 23:58:11,160][106226] Updated weights for policy 0, policy_version 657734 (0.0008) [2023-12-27 23:58:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 337305600. Throughput: 0: 9882.0, 1: 9777.6. Samples: 337278756. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:11,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.270')] [2023-12-27 23:58:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000659592_168886272.pth... [2023-12-27 23:58:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000658472_168599552.pth [2023-12-27 23:58:11,235][106226] Updated weights for policy 0, policy_version 657744 (0.0008) [2023-12-27 23:58:11,302][106226] Updated weights for policy 0, policy_version 657754 (0.0009) [2023-12-27 23:58:11,343][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000657760_168427520.pth... [2023-12-27 23:58:11,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000656576_168124416.pth [2023-12-27 23:58:11,752][106225] Updated weights for policy 1, policy_version 659598 (0.0009) [2023-12-27 23:58:11,816][106225] Updated weights for policy 1, policy_version 659608 (0.0008) [2023-12-27 23:58:11,873][106225] Updated weights for policy 1, policy_version 659618 (0.0008) [2023-12-27 23:58:12,031][106226] Updated weights for policy 0, policy_version 657764 (0.0010) [2023-12-27 23:58:12,096][106226] Updated weights for policy 0, policy_version 657774 (0.0008) [2023-12-27 23:58:12,165][106226] Updated weights for policy 0, policy_version 657784 (0.0009) [2023-12-27 23:58:12,653][106225] Updated weights for policy 1, policy_version 659628 (0.0008) [2023-12-27 23:58:12,705][106225] Updated weights for policy 1, policy_version 659638 (0.0008) [2023-12-27 23:58:12,751][106225] Updated weights for policy 1, policy_version 659648 (0.0008) [2023-12-27 23:58:12,895][106226] Updated weights for policy 0, policy_version 657794 (0.0009) [2023-12-27 23:58:12,951][106226] Updated weights for policy 0, policy_version 657804 (0.0008) [2023-12-27 23:58:13,010][106226] Updated weights for policy 0, policy_version 657814 (0.0009) [2023-12-27 23:58:13,062][106226] Updated weights for policy 0, policy_version 657824 (0.0009) [2023-12-27 23:58:13,495][106225] Updated weights for policy 1, policy_version 659658 (0.0009) [2023-12-27 23:58:13,542][106225] Updated weights for policy 1, policy_version 659668 (0.0008) [2023-12-27 23:58:13,597][106225] Updated weights for policy 1, policy_version 659678 (0.0008) [2023-12-27 23:58:13,657][106225] Updated weights for policy 1, policy_version 659688 (0.0009) [2023-12-27 23:58:13,807][106226] Updated weights for policy 0, policy_version 657834 (0.0008) [2023-12-27 23:58:13,856][106226] Updated weights for policy 0, policy_version 657844 (0.0008) [2023-12-27 23:58:13,908][106226] Updated weights for policy 0, policy_version 657854 (0.0009) [2023-12-27 23:58:14,395][106225] Updated weights for policy 1, policy_version 659698 (0.0008) [2023-12-27 23:58:14,453][106225] Updated weights for policy 1, policy_version 659708 (0.0008) [2023-12-27 23:58:14,513][106225] Updated weights for policy 1, policy_version 659718 (0.0008) [2023-12-27 23:58:14,642][106226] Updated weights for policy 0, policy_version 657864 (0.0009) [2023-12-27 23:58:14,696][106226] Updated weights for policy 0, policy_version 657874 (0.0008) [2023-12-27 23:58:14,755][106226] Updated weights for policy 0, policy_version 657884 (0.0008) [2023-12-27 23:58:15,259][106225] Updated weights for policy 1, policy_version 659728 (0.0009) [2023-12-27 23:58:15,324][106225] Updated weights for policy 1, policy_version 659738 (0.0008) [2023-12-27 23:58:15,384][106225] Updated weights for policy 1, policy_version 659748 (0.0008) [2023-12-27 23:58:15,521][106226] Updated weights for policy 0, policy_version 657894 (0.0009) [2023-12-27 23:58:15,576][106226] Updated weights for policy 0, policy_version 657904 (0.0009) [2023-12-27 23:58:15,629][106226] Updated weights for policy 0, policy_version 657914 (0.0008) [2023-12-27 23:58:16,005][106225] Updated weights for policy 1, policy_version 659758 (0.0008) [2023-12-27 23:58:16,059][106225] Updated weights for policy 1, policy_version 659768 (0.0007) [2023-12-27 23:58:16,116][106225] Updated weights for policy 1, policy_version 659778 (0.0005) [2023-12-27 23:58:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 337403904. Throughput: 0: 9754.9, 1: 9711.1. Samples: 337390772. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:16,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-5.582')] [2023-12-27 23:58:16,468][106226] Updated weights for policy 0, policy_version 657924 (0.0008) [2023-12-27 23:58:16,526][106226] Updated weights for policy 0, policy_version 657934 (0.0009) [2023-12-27 23:58:16,576][106226] Updated weights for policy 0, policy_version 657944 (0.0008) [2023-12-27 23:58:16,702][106225] Updated weights for policy 1, policy_version 659788 (0.0006) [2023-12-27 23:58:16,751][106225] Updated weights for policy 1, policy_version 659798 (0.0005) [2023-12-27 23:58:16,796][106225] Updated weights for policy 1, policy_version 659808 (0.0005) [2023-12-27 23:58:17,270][106226] Updated weights for policy 0, policy_version 657954 (0.0008) [2023-12-27 23:58:17,318][106226] Updated weights for policy 0, policy_version 657964 (0.0005) [2023-12-27 23:58:17,370][106226] Updated weights for policy 0, policy_version 657974 (0.0005) [2023-12-27 23:58:17,422][106226] Updated weights for policy 0, policy_version 657984 (0.0007) [2023-12-27 23:58:17,425][106225] Updated weights for policy 1, policy_version 659818 (0.0006) [2023-12-27 23:58:17,476][106225] Updated weights for policy 1, policy_version 659828 (0.0008) [2023-12-27 23:58:17,528][106225] Updated weights for policy 1, policy_version 659838 (0.0008) [2023-12-27 23:58:17,580][106225] Updated weights for policy 1, policy_version 659848 (0.0006) [2023-12-27 23:58:18,101][106226] Updated weights for policy 0, policy_version 657994 (0.0007) [2023-12-27 23:58:18,162][106226] Updated weights for policy 0, policy_version 658004 (0.0011) [2023-12-27 23:58:18,219][106226] Updated weights for policy 0, policy_version 658014 (0.0011) [2023-12-27 23:58:18,296][106225] Updated weights for policy 1, policy_version 659858 (0.0007) [2023-12-27 23:58:18,358][106225] Updated weights for policy 1, policy_version 659868 (0.0006) [2023-12-27 23:58:18,419][106225] Updated weights for policy 1, policy_version 659878 (0.0008) [2023-12-27 23:58:18,897][106226] Updated weights for policy 0, policy_version 658024 (0.0011) [2023-12-27 23:58:18,961][106226] Updated weights for policy 0, policy_version 658034 (0.0011) [2023-12-27 23:58:19,021][106226] Updated weights for policy 0, policy_version 658044 (0.0011) [2023-12-27 23:58:19,184][106225] Updated weights for policy 1, policy_version 659888 (0.0008) [2023-12-27 23:58:19,248][106225] Updated weights for policy 1, policy_version 659898 (0.0008) [2023-12-27 23:58:19,311][106225] Updated weights for policy 1, policy_version 659908 (0.0009) [2023-12-27 23:58:19,771][106226] Updated weights for policy 0, policy_version 658054 (0.0011) [2023-12-27 23:58:19,839][106226] Updated weights for policy 0, policy_version 658064 (0.0010) [2023-12-27 23:58:19,907][106226] Updated weights for policy 0, policy_version 658074 (0.0006) [2023-12-27 23:58:20,026][106225] Updated weights for policy 1, policy_version 659918 (0.0008) [2023-12-27 23:58:20,094][106225] Updated weights for policy 1, policy_version 659928 (0.0007) [2023-12-27 23:58:20,152][106225] Updated weights for policy 1, policy_version 659938 (0.0005) [2023-12-27 23:58:20,691][106226] Updated weights for policy 0, policy_version 658084 (0.0008) [2023-12-27 23:58:20,745][106226] Updated weights for policy 0, policy_version 658094 (0.0009) [2023-12-27 23:58:20,794][106226] Updated weights for policy 0, policy_version 658104 (0.0008) [2023-12-27 23:58:20,800][106225] Updated weights for policy 1, policy_version 659948 (0.0008) [2023-12-27 23:58:20,867][106225] Updated weights for policy 1, policy_version 659958 (0.0009) [2023-12-27 23:58:20,934][106225] Updated weights for policy 1, policy_version 659968 (0.0009) [2023-12-27 23:58:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 337502208. Throughput: 0: 9730.8, 1: 9731.3. Samples: 337509148. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:21,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-5.620')] [2023-12-27 23:58:21,596][106226] Updated weights for policy 0, policy_version 658114 (0.0007) [2023-12-27 23:58:21,664][106226] Updated weights for policy 0, policy_version 658124 (0.0008) [2023-12-27 23:58:21,688][106225] Updated weights for policy 1, policy_version 659978 (0.0009) [2023-12-27 23:58:21,731][106226] Updated weights for policy 0, policy_version 658134 (0.0008) [2023-12-27 23:58:21,754][106225] Updated weights for policy 1, policy_version 659988 (0.0011) [2023-12-27 23:58:21,799][106226] Updated weights for policy 0, policy_version 658144 (0.0008) [2023-12-27 23:58:21,820][106225] Updated weights for policy 1, policy_version 659998 (0.0011) [2023-12-27 23:58:21,882][106225] Updated weights for policy 1, policy_version 660008 (0.0010) [2023-12-27 23:58:22,557][106226] Updated weights for policy 0, policy_version 658154 (0.0008) [2023-12-27 23:58:22,622][106226] Updated weights for policy 0, policy_version 658164 (0.0006) [2023-12-27 23:58:22,623][106225] Updated weights for policy 1, policy_version 660018 (0.0011) [2023-12-27 23:58:22,680][106226] Updated weights for policy 0, policy_version 658174 (0.0006) [2023-12-27 23:58:22,682][106225] Updated weights for policy 1, policy_version 660028 (0.0011) [2023-12-27 23:58:22,747][106225] Updated weights for policy 1, policy_version 660038 (0.0010) [2023-12-27 23:58:23,359][106225] Updated weights for policy 1, policy_version 660048 (0.0006) [2023-12-27 23:58:23,416][106225] Updated weights for policy 1, policy_version 660058 (0.0009) [2023-12-27 23:58:23,471][106226] Updated weights for policy 0, policy_version 658184 (0.0006) [2023-12-27 23:58:23,471][106225] Updated weights for policy 1, policy_version 660068 (0.0009) [2023-12-27 23:58:23,531][106226] Updated weights for policy 0, policy_version 658194 (0.0006) [2023-12-27 23:58:23,583][106226] Updated weights for policy 0, policy_version 658204 (0.0008) [2023-12-27 23:58:24,182][106225] Updated weights for policy 1, policy_version 660078 (0.0009) [2023-12-27 23:58:24,238][106225] Updated weights for policy 1, policy_version 660088 (0.0010) [2023-12-27 23:58:24,303][106225] Updated weights for policy 1, policy_version 660098 (0.0010) [2023-12-27 23:58:24,324][106226] Updated weights for policy 0, policy_version 658214 (0.0007) [2023-12-27 23:58:24,366][106226] Updated weights for policy 0, policy_version 658224 (0.0007) [2023-12-27 23:58:24,412][106226] Updated weights for policy 0, policy_version 658234 (0.0007) [2023-12-27 23:58:25,021][106225] Updated weights for policy 1, policy_version 660108 (0.0010) [2023-12-27 23:58:25,077][106225] Updated weights for policy 1, policy_version 660118 (0.0010) [2023-12-27 23:58:25,143][106225] Updated weights for policy 1, policy_version 660128 (0.0010) [2023-12-27 23:58:25,175][106226] Updated weights for policy 0, policy_version 658244 (0.0007) [2023-12-27 23:58:25,231][106226] Updated weights for policy 0, policy_version 658254 (0.0005) [2023-12-27 23:58:25,289][106226] Updated weights for policy 0, policy_version 658264 (0.0005) [2023-12-27 23:58:25,801][106225] Updated weights for policy 1, policy_version 660138 (0.0010) [2023-12-27 23:58:25,814][106226] Updated weights for policy 0, policy_version 658274 (0.0005) [2023-12-27 23:58:25,871][106226] Updated weights for policy 0, policy_version 658284 (0.0006) [2023-12-27 23:58:25,875][106225] Updated weights for policy 1, policy_version 660148 (0.0008) [2023-12-27 23:58:25,924][106226] Updated weights for policy 0, policy_version 658294 (0.0006) [2023-12-27 23:58:25,934][106225] Updated weights for policy 1, policy_version 660158 (0.0010) [2023-12-27 23:58:25,979][106226] Updated weights for policy 0, policy_version 658304 (0.0005) [2023-12-27 23:58:25,988][106225] Updated weights for policy 1, policy_version 660168 (0.0010) [2023-12-27 23:58:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 337600512. Throughput: 0: 9702.5, 1: 9693.1. Samples: 337564620. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:26,176][105115] Avg episode reward: [(0, '-4.476'), (1, '-6.137')] [2023-12-27 23:58:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000660168_169033728.pth... [2023-12-27 23:58:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000658304_168566784.pth... [2023-12-27 23:58:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000657184_168280064.pth [2023-12-27 23:58:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000659016_168738816.pth [2023-12-27 23:58:26,629][106225] Updated weights for policy 1, policy_version 660178 (0.0006) [2023-12-27 23:58:26,680][106225] Updated weights for policy 1, policy_version 660188 (0.0005) [2023-12-27 23:58:26,734][106226] Updated weights for policy 0, policy_version 658314 (0.0008) [2023-12-27 23:58:26,735][106225] Updated weights for policy 1, policy_version 660198 (0.0005) [2023-12-27 23:58:26,798][106226] Updated weights for policy 0, policy_version 658324 (0.0008) [2023-12-27 23:58:26,858][106226] Updated weights for policy 0, policy_version 658334 (0.0007) [2023-12-27 23:58:27,278][106225] Updated weights for policy 1, policy_version 660208 (0.0005) [2023-12-27 23:58:27,333][106225] Updated weights for policy 1, policy_version 660218 (0.0008) [2023-12-27 23:58:27,387][106225] Updated weights for policy 1, policy_version 660228 (0.0008) [2023-12-27 23:58:27,598][106226] Updated weights for policy 0, policy_version 658344 (0.0008) [2023-12-27 23:58:27,654][106226] Updated weights for policy 0, policy_version 658354 (0.0007) [2023-12-27 23:58:27,699][106226] Updated weights for policy 0, policy_version 658364 (0.0007) [2023-12-27 23:58:28,086][106225] Updated weights for policy 1, policy_version 660238 (0.0008) [2023-12-27 23:58:28,135][106225] Updated weights for policy 1, policy_version 660248 (0.0008) [2023-12-27 23:58:28,186][106225] Updated weights for policy 1, policy_version 660258 (0.0008) [2023-12-27 23:58:28,403][106226] Updated weights for policy 0, policy_version 658374 (0.0008) [2023-12-27 23:58:28,459][106226] Updated weights for policy 0, policy_version 658384 (0.0008) [2023-12-27 23:58:28,514][106226] Updated weights for policy 0, policy_version 658394 (0.0008) [2023-12-27 23:58:28,859][106225] Updated weights for policy 1, policy_version 660268 (0.0007) [2023-12-27 23:58:28,919][106225] Updated weights for policy 1, policy_version 660278 (0.0005) [2023-12-27 23:58:28,982][106225] Updated weights for policy 1, policy_version 660288 (0.0008) [2023-12-27 23:58:29,357][106226] Updated weights for policy 0, policy_version 658404 (0.0009) [2023-12-27 23:58:29,416][106226] Updated weights for policy 0, policy_version 658414 (0.0008) [2023-12-27 23:58:29,471][106226] Updated weights for policy 0, policy_version 658424 (0.0008) [2023-12-27 23:58:29,656][106225] Updated weights for policy 1, policy_version 660298 (0.0008) [2023-12-27 23:58:29,716][106225] Updated weights for policy 1, policy_version 660308 (0.0008) [2023-12-27 23:58:29,764][106225] Updated weights for policy 1, policy_version 660318 (0.0009) [2023-12-27 23:58:29,813][106225] Updated weights for policy 1, policy_version 660328 (0.0008) [2023-12-27 23:58:30,162][106226] Updated weights for policy 0, policy_version 658434 (0.0007) [2023-12-27 23:58:30,220][106226] Updated weights for policy 0, policy_version 658444 (0.0005) [2023-12-27 23:58:30,277][106226] Updated weights for policy 0, policy_version 658454 (0.0006) [2023-12-27 23:58:30,338][106226] Updated weights for policy 0, policy_version 658464 (0.0005) [2023-12-27 23:58:30,637][106225] Updated weights for policy 1, policy_version 660338 (0.0009) [2023-12-27 23:58:30,697][106225] Updated weights for policy 1, policy_version 660348 (0.0006) [2023-12-27 23:58:30,757][106225] Updated weights for policy 1, policy_version 660358 (0.0007) [2023-12-27 23:58:30,869][106226] Updated weights for policy 0, policy_version 658474 (0.0005) [2023-12-27 23:58:30,926][106226] Updated weights for policy 0, policy_version 658484 (0.0005) [2023-12-27 23:58:30,982][106226] Updated weights for policy 0, policy_version 658494 (0.0005) [2023-12-27 23:58:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 337698816. Throughput: 0: 9706.8, 1: 9802.3. Samples: 337685380. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:31,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-5.618')] [2023-12-27 23:58:31,567][106225] Updated weights for policy 1, policy_version 660368 (0.0008) [2023-12-27 23:58:31,629][106225] Updated weights for policy 1, policy_version 660378 (0.0007) [2023-12-27 23:58:31,640][106226] Updated weights for policy 0, policy_version 658504 (0.0007) [2023-12-27 23:58:31,696][106225] Updated weights for policy 1, policy_version 660388 (0.0007) [2023-12-27 23:58:31,707][106226] Updated weights for policy 0, policy_version 658514 (0.0008) [2023-12-27 23:58:31,778][106226] Updated weights for policy 0, policy_version 658524 (0.0007) [2023-12-27 23:58:32,441][106225] Updated weights for policy 1, policy_version 660398 (0.0006) [2023-12-27 23:58:32,486][106225] Updated weights for policy 1, policy_version 660408 (0.0007) [2023-12-27 23:58:32,506][106226] Updated weights for policy 0, policy_version 658534 (0.0008) [2023-12-27 23:58:32,535][106225] Updated weights for policy 1, policy_version 660418 (0.0006) [2023-12-27 23:58:32,561][106226] Updated weights for policy 0, policy_version 658544 (0.0009) [2023-12-27 23:58:32,613][106226] Updated weights for policy 0, policy_version 658554 (0.0008) [2023-12-27 23:58:33,205][106225] Updated weights for policy 1, policy_version 660428 (0.0007) [2023-12-27 23:58:33,255][106225] Updated weights for policy 1, policy_version 660438 (0.0008) [2023-12-27 23:58:33,302][106225] Updated weights for policy 1, policy_version 660448 (0.0009) [2023-12-27 23:58:33,359][106226] Updated weights for policy 0, policy_version 658564 (0.0009) [2023-12-27 23:58:33,412][106226] Updated weights for policy 0, policy_version 658574 (0.0007) [2023-12-27 23:58:33,467][106226] Updated weights for policy 0, policy_version 658584 (0.0005) [2023-12-27 23:58:34,007][106226] Updated weights for policy 0, policy_version 658594 (0.0005) [2023-12-27 23:58:34,054][106226] Updated weights for policy 0, policy_version 658604 (0.0005) [2023-12-27 23:58:34,083][106225] Updated weights for policy 1, policy_version 660458 (0.0007) [2023-12-27 23:58:34,122][106226] Updated weights for policy 0, policy_version 658614 (0.0005) [2023-12-27 23:58:34,149][106225] Updated weights for policy 1, policy_version 660468 (0.0007) [2023-12-27 23:58:34,187][106226] Updated weights for policy 0, policy_version 658624 (0.0008) [2023-12-27 23:58:34,212][106225] Updated weights for policy 1, policy_version 660478 (0.0008) [2023-12-27 23:58:34,272][106225] Updated weights for policy 1, policy_version 660488 (0.0008) [2023-12-27 23:58:34,801][106226] Updated weights for policy 0, policy_version 658634 (0.0008) [2023-12-27 23:58:34,847][106226] Updated weights for policy 0, policy_version 658644 (0.0007) [2023-12-27 23:58:34,903][106226] Updated weights for policy 0, policy_version 658654 (0.0008) [2023-12-27 23:58:34,992][106225] Updated weights for policy 1, policy_version 660498 (0.0010) [2023-12-27 23:58:35,044][106225] Updated weights for policy 1, policy_version 660508 (0.0010) [2023-12-27 23:58:35,091][106225] Updated weights for policy 1, policy_version 660518 (0.0010) [2023-12-27 23:58:35,599][106226] Updated weights for policy 0, policy_version 658664 (0.0007) [2023-12-27 23:58:35,659][106226] Updated weights for policy 0, policy_version 658674 (0.0006) [2023-12-27 23:58:35,720][106226] Updated weights for policy 0, policy_version 658684 (0.0005) [2023-12-27 23:58:35,853][106225] Updated weights for policy 1, policy_version 660528 (0.0010) [2023-12-27 23:58:35,913][106225] Updated weights for policy 1, policy_version 660538 (0.0010) [2023-12-27 23:58:35,979][106225] Updated weights for policy 1, policy_version 660548 (0.0010) [2023-12-27 23:58:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 337797120. Throughput: 0: 9779.4, 1: 9786.8. Samples: 337806408. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:36,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.254')] [2023-12-27 23:58:36,360][106226] Updated weights for policy 0, policy_version 658694 (0.0009) [2023-12-27 23:58:36,434][106226] Updated weights for policy 0, policy_version 658704 (0.0011) [2023-12-27 23:58:36,499][106226] Updated weights for policy 0, policy_version 658714 (0.0010) [2023-12-27 23:58:36,635][106225] Updated weights for policy 1, policy_version 660558 (0.0010) [2023-12-27 23:58:36,697][106225] Updated weights for policy 1, policy_version 660568 (0.0008) [2023-12-27 23:58:36,747][106225] Updated weights for policy 1, policy_version 660578 (0.0008) [2023-12-27 23:58:37,149][106226] Updated weights for policy 0, policy_version 658724 (0.0008) [2023-12-27 23:58:37,204][106226] Updated weights for policy 0, policy_version 658734 (0.0011) [2023-12-27 23:58:37,267][106226] Updated weights for policy 0, policy_version 658744 (0.0008) [2023-12-27 23:58:37,528][106225] Updated weights for policy 1, policy_version 660588 (0.0008) [2023-12-27 23:58:37,607][106225] Updated weights for policy 1, policy_version 660598 (0.0008) [2023-12-27 23:58:37,671][106225] Updated weights for policy 1, policy_version 660608 (0.0006) [2023-12-27 23:58:37,989][106226] Updated weights for policy 0, policy_version 658754 (0.0010) [2023-12-27 23:58:38,056][106226] Updated weights for policy 0, policy_version 658764 (0.0011) [2023-12-27 23:58:38,111][106226] Updated weights for policy 0, policy_version 658774 (0.0010) [2023-12-27 23:58:38,168][106226] Updated weights for policy 0, policy_version 658784 (0.0010) [2023-12-27 23:58:38,386][106225] Updated weights for policy 1, policy_version 660618 (0.0009) [2023-12-27 23:58:38,448][106225] Updated weights for policy 1, policy_version 660628 (0.0010) [2023-12-27 23:58:38,508][106225] Updated weights for policy 1, policy_version 660638 (0.0010) [2023-12-27 23:58:38,569][106225] Updated weights for policy 1, policy_version 660648 (0.0010) [2023-12-27 23:58:38,912][106226] Updated weights for policy 0, policy_version 658794 (0.0008) [2023-12-27 23:58:38,969][106226] Updated weights for policy 0, policy_version 658804 (0.0008) [2023-12-27 23:58:39,023][106226] Updated weights for policy 0, policy_version 658814 (0.0007) [2023-12-27 23:58:39,262][106225] Updated weights for policy 1, policy_version 660658 (0.0007) [2023-12-27 23:58:39,335][106225] Updated weights for policy 1, policy_version 660668 (0.0008) [2023-12-27 23:58:39,413][106225] Updated weights for policy 1, policy_version 660679 (0.0010) [2023-12-27 23:58:39,723][106226] Updated weights for policy 0, policy_version 658824 (0.0006) [2023-12-27 23:58:39,788][106226] Updated weights for policy 0, policy_version 658834 (0.0007) [2023-12-27 23:58:39,853][106226] Updated weights for policy 0, policy_version 658844 (0.0008) [2023-12-27 23:58:40,235][106225] Updated weights for policy 1, policy_version 660689 (0.0009) [2023-12-27 23:58:40,287][106225] Updated weights for policy 1, policy_version 660699 (0.0009) [2023-12-27 23:58:40,342][106225] Updated weights for policy 1, policy_version 660709 (0.0009) [2023-12-27 23:58:40,441][106226] Updated weights for policy 0, policy_version 658854 (0.0009) [2023-12-27 23:58:40,500][106226] Updated weights for policy 0, policy_version 658864 (0.0009) [2023-12-27 23:58:40,562][106226] Updated weights for policy 0, policy_version 658874 (0.0008) [2023-12-27 23:58:41,098][106225] Updated weights for policy 1, policy_version 660719 (0.0009) [2023-12-27 23:58:41,164][106225] Updated weights for policy 1, policy_version 660729 (0.0008) [2023-12-27 23:58:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 337887232. Throughput: 0: 9824.6, 1: 9761.2. Samples: 337864040. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:41,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.948')] [2023-12-27 23:58:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000658880_168714240.pth... [2023-12-27 23:58:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000657760_168427520.pth [2023-12-27 23:58:41,230][106225] Updated weights for policy 1, policy_version 660739 (0.0008) [2023-12-27 23:58:41,258][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000660744_169181184.pth... [2023-12-27 23:58:41,263][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000659592_168886272.pth [2023-12-27 23:58:41,275][106226] Updated weights for policy 0, policy_version 658884 (0.0007) [2023-12-27 23:58:41,341][106226] Updated weights for policy 0, policy_version 658894 (0.0009) [2023-12-27 23:58:41,418][106226] Updated weights for policy 0, policy_version 658904 (0.0010) [2023-12-27 23:58:42,034][106225] Updated weights for policy 1, policy_version 660749 (0.0009) [2023-12-27 23:58:42,096][106225] Updated weights for policy 1, policy_version 660759 (0.0008) [2023-12-27 23:58:42,111][106226] Updated weights for policy 0, policy_version 658914 (0.0009) [2023-12-27 23:58:42,148][106225] Updated weights for policy 1, policy_version 660769 (0.0006) [2023-12-27 23:58:42,172][106226] Updated weights for policy 0, policy_version 658924 (0.0009) [2023-12-27 23:58:42,227][106226] Updated weights for policy 0, policy_version 658934 (0.0008) [2023-12-27 23:58:42,298][106226] Updated weights for policy 0, policy_version 658944 (0.0009) [2023-12-27 23:58:42,850][106225] Updated weights for policy 1, policy_version 660779 (0.0009) [2023-12-27 23:58:42,905][106225] Updated weights for policy 1, policy_version 660789 (0.0009) [2023-12-27 23:58:42,965][106225] Updated weights for policy 1, policy_version 660799 (0.0009) [2023-12-27 23:58:43,026][106226] Updated weights for policy 0, policy_version 658954 (0.0006) [2023-12-27 23:58:43,089][106226] Updated weights for policy 0, policy_version 658964 (0.0008) [2023-12-27 23:58:43,143][106226] Updated weights for policy 0, policy_version 658974 (0.0008) [2023-12-27 23:58:43,719][106225] Updated weights for policy 1, policy_version 660809 (0.0007) [2023-12-27 23:58:43,780][106225] Updated weights for policy 1, policy_version 660819 (0.0008) [2023-12-27 23:58:43,814][106226] Updated weights for policy 0, policy_version 658984 (0.0006) [2023-12-27 23:58:43,835][106225] Updated weights for policy 1, policy_version 660829 (0.0007) [2023-12-27 23:58:43,865][106226] Updated weights for policy 0, policy_version 658994 (0.0005) [2023-12-27 23:58:43,896][106225] Updated weights for policy 1, policy_version 660839 (0.0007) [2023-12-27 23:58:43,923][106226] Updated weights for policy 0, policy_version 659004 (0.0006) [2023-12-27 23:58:44,597][106226] Updated weights for policy 0, policy_version 659014 (0.0007) [2023-12-27 23:58:44,639][106225] Updated weights for policy 1, policy_version 660849 (0.0006) [2023-12-27 23:58:44,657][106226] Updated weights for policy 0, policy_version 659024 (0.0007) [2023-12-27 23:58:44,699][106225] Updated weights for policy 1, policy_version 660859 (0.0006) [2023-12-27 23:58:44,717][106226] Updated weights for policy 0, policy_version 659034 (0.0006) [2023-12-27 23:58:44,756][106225] Updated weights for policy 1, policy_version 660869 (0.0007) [2023-12-27 23:58:45,462][106226] Updated weights for policy 0, policy_version 659044 (0.0010) [2023-12-27 23:58:45,513][106226] Updated weights for policy 0, policy_version 659054 (0.0008) [2023-12-27 23:58:45,515][106225] Updated weights for policy 1, policy_version 660879 (0.0007) [2023-12-27 23:58:45,568][106226] Updated weights for policy 0, policy_version 659064 (0.0005) [2023-12-27 23:58:45,570][106225] Updated weights for policy 1, policy_version 660889 (0.0005) [2023-12-27 23:58:45,632][106225] Updated weights for policy 1, policy_version 660899 (0.0007) [2023-12-27 23:58:46,160][106226] Updated weights for policy 0, policy_version 659074 (0.0007) [2023-12-27 23:58:46,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 337985536. Throughput: 0: 9742.4, 1: 9791.6. Samples: 337979212. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:46,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-5.360')] [2023-12-27 23:58:46,221][106226] Updated weights for policy 0, policy_version 659084 (0.0007) [2023-12-27 23:58:46,280][106226] Updated weights for policy 0, policy_version 659094 (0.0006) [2023-12-27 23:58:46,341][106226] Updated weights for policy 0, policy_version 659104 (0.0011) [2023-12-27 23:58:46,356][106225] Updated weights for policy 1, policy_version 660909 (0.0007) [2023-12-27 23:58:46,406][106225] Updated weights for policy 1, policy_version 660919 (0.0008) [2023-12-27 23:58:46,461][106225] Updated weights for policy 1, policy_version 660929 (0.0009) [2023-12-27 23:58:46,964][106226] Updated weights for policy 0, policy_version 659114 (0.0010) [2023-12-27 23:58:47,021][106226] Updated weights for policy 0, policy_version 659124 (0.0010) [2023-12-27 23:58:47,078][106226] Updated weights for policy 0, policy_version 659134 (0.0011) [2023-12-27 23:58:47,226][106225] Updated weights for policy 1, policy_version 660939 (0.0008) [2023-12-27 23:58:47,275][106225] Updated weights for policy 1, policy_version 660949 (0.0008) [2023-12-27 23:58:47,324][106225] Updated weights for policy 1, policy_version 660959 (0.0008) [2023-12-27 23:58:47,766][106226] Updated weights for policy 0, policy_version 659144 (0.0009) [2023-12-27 23:58:47,822][106226] Updated weights for policy 0, policy_version 659154 (0.0009) [2023-12-27 23:58:47,874][106226] Updated weights for policy 0, policy_version 659164 (0.0009) [2023-12-27 23:58:48,070][106225] Updated weights for policy 1, policy_version 660969 (0.0007) [2023-12-27 23:58:48,128][106225] Updated weights for policy 1, policy_version 660979 (0.0009) [2023-12-27 23:58:48,186][106225] Updated weights for policy 1, policy_version 660989 (0.0008) [2023-12-27 23:58:48,239][106225] Updated weights for policy 1, policy_version 660999 (0.0009) [2023-12-27 23:58:48,533][106226] Updated weights for policy 0, policy_version 659174 (0.0007) [2023-12-27 23:58:48,584][106226] Updated weights for policy 0, policy_version 659184 (0.0008) [2023-12-27 23:58:48,640][106226] Updated weights for policy 0, policy_version 659194 (0.0009) [2023-12-27 23:58:48,947][106225] Updated weights for policy 1, policy_version 661009 (0.0009) [2023-12-27 23:58:49,007][106225] Updated weights for policy 1, policy_version 661019 (0.0008) [2023-12-27 23:58:49,068][106225] Updated weights for policy 1, policy_version 661029 (0.0009) [2023-12-27 23:58:49,439][106226] Updated weights for policy 0, policy_version 659204 (0.0008) [2023-12-27 23:58:49,498][106226] Updated weights for policy 0, policy_version 659214 (0.0006) [2023-12-27 23:58:49,556][106226] Updated weights for policy 0, policy_version 659224 (0.0006) [2023-12-27 23:58:49,867][106225] Updated weights for policy 1, policy_version 661039 (0.0009) [2023-12-27 23:58:49,937][106225] Updated weights for policy 1, policy_version 661049 (0.0008) [2023-12-27 23:58:49,995][106225] Updated weights for policy 1, policy_version 661059 (0.0006) [2023-12-27 23:58:50,283][106226] Updated weights for policy 0, policy_version 659234 (0.0006) [2023-12-27 23:58:50,345][106226] Updated weights for policy 0, policy_version 659244 (0.0008) [2023-12-27 23:58:50,411][106226] Updated weights for policy 0, policy_version 659254 (0.0006) [2023-12-27 23:58:50,473][106226] Updated weights for policy 0, policy_version 659264 (0.0007) [2023-12-27 23:58:50,616][106225] Updated weights for policy 1, policy_version 661069 (0.0007) [2023-12-27 23:58:50,680][106225] Updated weights for policy 1, policy_version 661079 (0.0008) [2023-12-27 23:58:50,745][106225] Updated weights for policy 1, policy_version 661089 (0.0007) [2023-12-27 23:58:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 338083840. Throughput: 0: 9781.2, 1: 9712.2. Samples: 338096232. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:51,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.565')] [2023-12-27 23:58:51,186][106226] Updated weights for policy 0, policy_version 659274 (0.0008) [2023-12-27 23:58:51,241][106226] Updated weights for policy 0, policy_version 659284 (0.0008) [2023-12-27 23:58:51,306][106226] Updated weights for policy 0, policy_version 659294 (0.0008) [2023-12-27 23:58:51,476][106225] Updated weights for policy 1, policy_version 661099 (0.0009) [2023-12-27 23:58:51,527][106225] Updated weights for policy 1, policy_version 661109 (0.0007) [2023-12-27 23:58:51,583][106225] Updated weights for policy 1, policy_version 661119 (0.0006) [2023-12-27 23:58:52,027][106226] Updated weights for policy 0, policy_version 659304 (0.0008) [2023-12-27 23:58:52,086][106226] Updated weights for policy 0, policy_version 659314 (0.0009) [2023-12-27 23:58:52,138][106226] Updated weights for policy 0, policy_version 659324 (0.0008) [2023-12-27 23:58:52,269][106225] Updated weights for policy 1, policy_version 661129 (0.0008) [2023-12-27 23:58:52,331][106225] Updated weights for policy 1, policy_version 661139 (0.0008) [2023-12-27 23:58:52,397][106225] Updated weights for policy 1, policy_version 661149 (0.0009) [2023-12-27 23:58:52,454][106225] Updated weights for policy 1, policy_version 661159 (0.0008) [2023-12-27 23:58:52,806][106226] Updated weights for policy 0, policy_version 659334 (0.0008) [2023-12-27 23:58:52,871][106226] Updated weights for policy 0, policy_version 659344 (0.0008) [2023-12-27 23:58:52,922][106226] Updated weights for policy 0, policy_version 659354 (0.0008) [2023-12-27 23:58:53,207][106225] Updated weights for policy 1, policy_version 661169 (0.0008) [2023-12-27 23:58:53,252][106225] Updated weights for policy 1, policy_version 661179 (0.0008) [2023-12-27 23:58:53,304][106225] Updated weights for policy 1, policy_version 661189 (0.0008) [2023-12-27 23:58:53,659][106226] Updated weights for policy 0, policy_version 659364 (0.0008) [2023-12-27 23:58:53,720][106226] Updated weights for policy 0, policy_version 659374 (0.0008) [2023-12-27 23:58:53,778][106226] Updated weights for policy 0, policy_version 659384 (0.0008) [2023-12-27 23:58:54,044][106225] Updated weights for policy 1, policy_version 661199 (0.0009) [2023-12-27 23:58:54,094][106225] Updated weights for policy 1, policy_version 661209 (0.0009) [2023-12-27 23:58:54,139][106225] Updated weights for policy 1, policy_version 661219 (0.0007) [2023-12-27 23:58:54,432][106226] Updated weights for policy 0, policy_version 659394 (0.0009) [2023-12-27 23:58:54,491][106226] Updated weights for policy 0, policy_version 659404 (0.0006) [2023-12-27 23:58:54,549][106226] Updated weights for policy 0, policy_version 659414 (0.0007) [2023-12-27 23:58:54,607][106226] Updated weights for policy 0, policy_version 659424 (0.0008) [2023-12-27 23:58:54,924][106225] Updated weights for policy 1, policy_version 661229 (0.0008) [2023-12-27 23:58:54,987][106225] Updated weights for policy 1, policy_version 661239 (0.0007) [2023-12-27 23:58:55,043][106225] Updated weights for policy 1, policy_version 661249 (0.0008) [2023-12-27 23:58:55,269][106226] Updated weights for policy 0, policy_version 659434 (0.0008) [2023-12-27 23:58:55,326][106226] Updated weights for policy 0, policy_version 659444 (0.0005) [2023-12-27 23:58:55,383][106226] Updated weights for policy 0, policy_version 659454 (0.0005) [2023-12-27 23:58:55,808][106225] Updated weights for policy 1, policy_version 661259 (0.0008) [2023-12-27 23:58:55,870][106225] Updated weights for policy 1, policy_version 661269 (0.0010) [2023-12-27 23:58:55,924][106225] Updated weights for policy 1, policy_version 661279 (0.0008) [2023-12-27 23:58:55,980][106226] Updated weights for policy 0, policy_version 659464 (0.0005) [2023-12-27 23:58:56,037][106226] Updated weights for policy 0, policy_version 659474 (0.0005) [2023-12-27 23:58:56,089][106226] Updated weights for policy 0, policy_version 659484 (0.0005) [2023-12-27 23:58:56,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 338190336. Throughput: 0: 9793.7, 1: 9650.1. Samples: 338153732. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:58:56,176][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.512')] [2023-12-27 23:58:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000661288_169320448.pth... [2023-12-27 23:58:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000659488_168869888.pth... [2023-12-27 23:58:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000658304_168566784.pth [2023-12-27 23:58:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000660168_169033728.pth [2023-12-27 23:58:56,699][106226] Updated weights for policy 0, policy_version 659494 (0.0007) [2023-12-27 23:58:56,710][106225] Updated weights for policy 1, policy_version 661289 (0.0008) [2023-12-27 23:58:56,758][106226] Updated weights for policy 0, policy_version 659504 (0.0007) [2023-12-27 23:58:56,764][106225] Updated weights for policy 1, policy_version 661299 (0.0006) [2023-12-27 23:58:56,806][106226] Updated weights for policy 0, policy_version 659514 (0.0007) [2023-12-27 23:58:56,817][106225] Updated weights for policy 1, policy_version 661309 (0.0006) [2023-12-27 23:58:56,866][106225] Updated weights for policy 1, policy_version 661319 (0.0007) [2023-12-27 23:58:57,546][106226] Updated weights for policy 0, policy_version 659524 (0.0008) [2023-12-27 23:58:57,567][106225] Updated weights for policy 1, policy_version 661329 (0.0007) [2023-12-27 23:58:57,596][106226] Updated weights for policy 0, policy_version 659534 (0.0007) [2023-12-27 23:58:57,614][106225] Updated weights for policy 1, policy_version 661339 (0.0006) [2023-12-27 23:58:57,640][106226] Updated weights for policy 0, policy_version 659544 (0.0006) [2023-12-27 23:58:57,660][106225] Updated weights for policy 1, policy_version 661349 (0.0007) [2023-12-27 23:58:58,299][106226] Updated weights for policy 0, policy_version 659554 (0.0006) [2023-12-27 23:58:58,366][106226] Updated weights for policy 0, policy_version 659564 (0.0008) [2023-12-27 23:58:58,430][106226] Updated weights for policy 0, policy_version 659574 (0.0009) [2023-12-27 23:58:58,496][106226] Updated weights for policy 0, policy_version 659584 (0.0011) [2023-12-27 23:58:58,521][106225] Updated weights for policy 1, policy_version 661359 (0.0009) [2023-12-27 23:58:58,585][106225] Updated weights for policy 1, policy_version 661369 (0.0009) [2023-12-27 23:58:58,644][106225] Updated weights for policy 1, policy_version 661379 (0.0008) [2023-12-27 23:58:59,294][106226] Updated weights for policy 0, policy_version 659594 (0.0010) [2023-12-27 23:58:59,355][106226] Updated weights for policy 0, policy_version 659604 (0.0010) [2023-12-27 23:58:59,420][106226] Updated weights for policy 0, policy_version 659614 (0.0009) [2023-12-27 23:58:59,463][106225] Updated weights for policy 1, policy_version 661389 (0.0008) [2023-12-27 23:58:59,523][106225] Updated weights for policy 1, policy_version 661399 (0.0008) [2023-12-27 23:58:59,587][106225] Updated weights for policy 1, policy_version 661409 (0.0009) [2023-12-27 23:59:00,222][106226] Updated weights for policy 0, policy_version 659624 (0.0008) [2023-12-27 23:59:00,278][106226] Updated weights for policy 0, policy_version 659634 (0.0005) [2023-12-27 23:59:00,344][106226] Updated weights for policy 0, policy_version 659644 (0.0006) [2023-12-27 23:59:00,345][106225] Updated weights for policy 1, policy_version 661419 (0.0008) [2023-12-27 23:59:00,404][106225] Updated weights for policy 1, policy_version 661429 (0.0009) [2023-12-27 23:59:00,460][106225] Updated weights for policy 1, policy_version 661439 (0.0009) [2023-12-27 23:59:00,999][106226] Updated weights for policy 0, policy_version 659654 (0.0008) [2023-12-27 23:59:01,058][106226] Updated weights for policy 0, policy_version 659664 (0.0007) [2023-12-27 23:59:01,118][106226] Updated weights for policy 0, policy_version 659674 (0.0007) [2023-12-27 23:59:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 338280448. Throughput: 0: 9888.8, 1: 9627.4. Samples: 338269000. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:01,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-5.232')] [2023-12-27 23:59:01,246][106225] Updated weights for policy 1, policy_version 661449 (0.0009) [2023-12-27 23:59:01,310][106225] Updated weights for policy 1, policy_version 661459 (0.0008) [2023-12-27 23:59:01,379][106225] Updated weights for policy 1, policy_version 661469 (0.0009) [2023-12-27 23:59:01,444][106225] Updated weights for policy 1, policy_version 661479 (0.0009) [2023-12-27 23:59:01,869][106226] Updated weights for policy 0, policy_version 659684 (0.0007) [2023-12-27 23:59:01,934][106226] Updated weights for policy 0, policy_version 659694 (0.0006) [2023-12-27 23:59:01,995][106226] Updated weights for policy 0, policy_version 659704 (0.0008) [2023-12-27 23:59:02,208][106225] Updated weights for policy 1, policy_version 661489 (0.0008) [2023-12-27 23:59:02,262][106225] Updated weights for policy 1, policy_version 661499 (0.0008) [2023-12-27 23:59:02,319][106225] Updated weights for policy 1, policy_version 661509 (0.0009) [2023-12-27 23:59:02,669][106226] Updated weights for policy 0, policy_version 659714 (0.0007) [2023-12-27 23:59:02,727][106226] Updated weights for policy 0, policy_version 659724 (0.0006) [2023-12-27 23:59:02,786][106226] Updated weights for policy 0, policy_version 659734 (0.0005) [2023-12-27 23:59:02,843][106226] Updated weights for policy 0, policy_version 659744 (0.0006) [2023-12-27 23:59:03,135][106225] Updated weights for policy 1, policy_version 661519 (0.0009) [2023-12-27 23:59:03,199][106225] Updated weights for policy 1, policy_version 661529 (0.0008) [2023-12-27 23:59:03,259][106225] Updated weights for policy 1, policy_version 661539 (0.0009) [2023-12-27 23:59:03,477][106226] Updated weights for policy 0, policy_version 659754 (0.0009) [2023-12-27 23:59:03,531][106226] Updated weights for policy 0, policy_version 659764 (0.0008) [2023-12-27 23:59:03,586][106226] Updated weights for policy 0, policy_version 659774 (0.0009) [2023-12-27 23:59:03,963][106225] Updated weights for policy 1, policy_version 661549 (0.0008) [2023-12-27 23:59:04,025][106225] Updated weights for policy 1, policy_version 661559 (0.0008) [2023-12-27 23:59:04,088][106225] Updated weights for policy 1, policy_version 661569 (0.0008) [2023-12-27 23:59:04,303][106226] Updated weights for policy 0, policy_version 659784 (0.0010) [2023-12-27 23:59:04,352][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000002 [2023-12-27 23:59:04,778][106225] Updated weights for policy 1, policy_version 661579 (0.0008) [2023-12-27 23:59:04,835][106225] Updated weights for policy 1, policy_version 661589 (0.0008) [2023-12-27 23:59:04,897][106225] Updated weights for policy 1, policy_version 661599 (0.0007) [2023-12-27 23:59:05,037][106226] Updated weights for policy 0, policy_version 659794 (0.0010) [2023-12-27 23:59:05,105][106226] Updated weights for policy 0, policy_version 659804 (0.0009) [2023-12-27 23:59:05,168][106226] Updated weights for policy 0, policy_version 659814 (0.0011) [2023-12-27 23:59:05,222][106226] Updated weights for policy 0, policy_version 659824 (0.0010) [2023-12-27 23:59:05,575][106225] Updated weights for policy 1, policy_version 661609 (0.0009) [2023-12-27 23:59:05,640][106225] Updated weights for policy 1, policy_version 661619 (0.0008) [2023-12-27 23:59:05,713][106225] Updated weights for policy 1, policy_version 661629 (0.0009) [2023-12-27 23:59:05,774][106225] Updated weights for policy 1, policy_version 661639 (0.0009) [2023-12-27 23:59:05,886][106226] Updated weights for policy 0, policy_version 659834 (0.0006) [2023-12-27 23:59:05,945][106226] Updated weights for policy 0, policy_version 659844 (0.0011) [2023-12-27 23:59:06,007][106226] Updated weights for policy 0, policy_version 659854 (0.0011) [2023-12-27 23:59:06,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 338378752. Throughput: 0: 9981.8, 1: 9498.4. Samples: 338385756. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:06,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-5.684')] [2023-12-27 23:59:06,571][106225] Updated weights for policy 1, policy_version 661649 (0.0006) [2023-12-27 23:59:06,632][106225] Updated weights for policy 1, policy_version 661659 (0.0006) [2023-12-27 23:59:06,669][106226] Updated weights for policy 0, policy_version 659864 (0.0010) [2023-12-27 23:59:06,692][106225] Updated weights for policy 1, policy_version 661669 (0.0006) [2023-12-27 23:59:06,723][106226] Updated weights for policy 0, policy_version 659874 (0.0008) [2023-12-27 23:59:06,774][106226] Updated weights for policy 0, policy_version 659884 (0.0009) [2023-12-27 23:59:07,299][106225] Updated weights for policy 1, policy_version 661679 (0.0008) [2023-12-27 23:59:07,362][106225] Updated weights for policy 1, policy_version 661689 (0.0009) [2023-12-27 23:59:07,425][106225] Updated weights for policy 1, policy_version 661699 (0.0008) [2023-12-27 23:59:07,539][106226] Updated weights for policy 0, policy_version 659894 (0.0006) [2023-12-27 23:59:07,596][106226] Updated weights for policy 0, policy_version 659904 (0.0009) [2023-12-27 23:59:07,655][106226] Updated weights for policy 0, policy_version 659914 (0.0006) [2023-12-27 23:59:08,160][106225] Updated weights for policy 1, policy_version 661709 (0.0009) [2023-12-27 23:59:08,223][106225] Updated weights for policy 1, policy_version 661719 (0.0009) [2023-12-27 23:59:08,280][106225] Updated weights for policy 1, policy_version 661729 (0.0009) [2023-12-27 23:59:08,358][106226] Updated weights for policy 0, policy_version 659926 (0.0008) [2023-12-27 23:59:08,429][106226] Updated weights for policy 0, policy_version 659936 (0.0008) [2023-12-27 23:59:08,487][106226] Updated weights for policy 0, policy_version 659946 (0.0008) [2023-12-27 23:59:08,967][106225] Updated weights for policy 1, policy_version 661739 (0.0009) [2023-12-27 23:59:09,017][106225] Updated weights for policy 1, policy_version 661749 (0.0007) [2023-12-27 23:59:09,067][106225] Updated weights for policy 1, policy_version 661759 (0.0007) [2023-12-27 23:59:09,177][106226] Updated weights for policy 0, policy_version 659956 (0.0009) [2023-12-27 23:59:09,245][106226] Updated weights for policy 0, policy_version 659966 (0.0009) [2023-12-27 23:59:09,312][106226] Updated weights for policy 0, policy_version 659976 (0.0008) [2023-12-27 23:59:09,945][106225] Updated weights for policy 1, policy_version 661769 (0.0008) [2023-12-27 23:59:10,009][106225] Updated weights for policy 1, policy_version 661779 (0.0009) [2023-12-27 23:59:10,076][106225] Updated weights for policy 1, policy_version 661789 (0.0009) [2023-12-27 23:59:10,086][106226] Updated weights for policy 0, policy_version 659986 (0.0009) [2023-12-27 23:59:10,135][106225] Updated weights for policy 1, policy_version 661799 (0.0009) [2023-12-27 23:59:10,140][106226] Updated weights for policy 0, policy_version 659996 (0.0011) [2023-12-27 23:59:10,194][106226] Updated weights for policy 0, policy_version 660006 (0.0011) [2023-12-27 23:59:10,248][106226] Updated weights for policy 0, policy_version 660016 (0.0011) [2023-12-27 23:59:10,877][106226] Updated weights for policy 0, policy_version 660026 (0.0009) [2023-12-27 23:59:10,885][106225] Updated weights for policy 1, policy_version 661809 (0.0006) [2023-12-27 23:59:10,932][106226] Updated weights for policy 0, policy_version 660036 (0.0006) [2023-12-27 23:59:10,941][106225] Updated weights for policy 1, policy_version 661819 (0.0009) [2023-12-27 23:59:10,996][106226] Updated weights for policy 0, policy_version 660046 (0.0007) [2023-12-27 23:59:10,999][106225] Updated weights for policy 1, policy_version 661829 (0.0010) [2023-12-27 23:59:11,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 338477056. Throughput: 0: 10037.7, 1: 9503.8. Samples: 338443984. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:11,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-5.443')] [2023-12-27 23:59:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000660048_169017344.pth... [2023-12-27 23:59:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000661832_169459712.pth... [2023-12-27 23:59:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000658880_168714240.pth [2023-12-27 23:59:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000660744_169181184.pth [2023-12-27 23:59:11,777][106226] Updated weights for policy 0, policy_version 660056 (0.0008) [2023-12-27 23:59:11,780][106225] Updated weights for policy 1, policy_version 661839 (0.0009) [2023-12-27 23:59:11,840][106226] Updated weights for policy 0, policy_version 660066 (0.0006) [2023-12-27 23:59:11,846][106225] Updated weights for policy 1, policy_version 661849 (0.0008) [2023-12-27 23:59:11,909][106225] Updated weights for policy 1, policy_version 661859 (0.0007) [2023-12-27 23:59:11,910][106226] Updated weights for policy 0, policy_version 660076 (0.0006) [2023-12-27 23:59:12,555][106226] Updated weights for policy 0, policy_version 660086 (0.0007) [2023-12-27 23:59:12,622][106226] Updated weights for policy 0, policy_version 660096 (0.0008) [2023-12-27 23:59:12,657][106225] Updated weights for policy 1, policy_version 661869 (0.0007) [2023-12-27 23:59:12,679][106226] Updated weights for policy 0, policy_version 660106 (0.0007) [2023-12-27 23:59:12,712][106225] Updated weights for policy 1, policy_version 661879 (0.0006) [2023-12-27 23:59:12,771][106225] Updated weights for policy 1, policy_version 661889 (0.0009) [2023-12-27 23:59:13,380][106226] Updated weights for policy 0, policy_version 660116 (0.0008) [2023-12-27 23:59:13,432][106226] Updated weights for policy 0, policy_version 660126 (0.0007) [2023-12-27 23:59:13,491][106226] Updated weights for policy 0, policy_version 660136 (0.0009) [2023-12-27 23:59:13,497][106225] Updated weights for policy 1, policy_version 661899 (0.0007) [2023-12-27 23:59:13,540][106225] Updated weights for policy 1, policy_version 661909 (0.0006) [2023-12-27 23:59:13,587][106225] Updated weights for policy 1, policy_version 661919 (0.0008) [2023-12-27 23:59:14,213][106226] Updated weights for policy 0, policy_version 660146 (0.0007) [2023-12-27 23:59:14,279][106226] Updated weights for policy 0, policy_version 660156 (0.0008) [2023-12-27 23:59:14,334][106226] Updated weights for policy 0, policy_version 660166 (0.0008) [2023-12-27 23:59:14,334][106225] Updated weights for policy 1, policy_version 661929 (0.0008) [2023-12-27 23:59:14,379][106226] Updated weights for policy 0, policy_version 660176 (0.0007) [2023-12-27 23:59:14,397][106225] Updated weights for policy 1, policy_version 661939 (0.0008) [2023-12-27 23:59:14,456][106225] Updated weights for policy 1, policy_version 661949 (0.0008) [2023-12-27 23:59:14,518][106225] Updated weights for policy 1, policy_version 661959 (0.0008) [2023-12-27 23:59:15,143][106226] Updated weights for policy 0, policy_version 660186 (0.0005) [2023-12-27 23:59:15,200][106226] Updated weights for policy 0, policy_version 660196 (0.0008) [2023-12-27 23:59:15,235][106225] Updated weights for policy 1, policy_version 661969 (0.0008) [2023-12-27 23:59:15,254][106226] Updated weights for policy 0, policy_version 660206 (0.0007) [2023-12-27 23:59:15,289][106225] Updated weights for policy 1, policy_version 661979 (0.0008) [2023-12-27 23:59:15,360][106225] Updated weights for policy 1, policy_version 661990 (0.0008) [2023-12-27 23:59:15,909][106226] Updated weights for policy 0, policy_version 660216 (0.0009) [2023-12-27 23:59:15,967][106226] Updated weights for policy 0, policy_version 660226 (0.0009) [2023-12-27 23:59:16,031][106226] Updated weights for policy 0, policy_version 660236 (0.0009) [2023-12-27 23:59:16,058][106225] Updated weights for policy 1, policy_version 662000 (0.0006) [2023-12-27 23:59:16,107][106225] Updated weights for policy 1, policy_version 662010 (0.0007) [2023-12-27 23:59:16,158][106225] Updated weights for policy 1, policy_version 662020 (0.0007) [2023-12-27 23:59:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 338567168. Throughput: 0: 10022.9, 1: 9364.4. Samples: 338557812. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:16,176][105115] Avg episode reward: [(0, '-4.313'), (1, '-5.558')] [2023-12-27 23:59:16,698][106226] Updated weights for policy 0, policy_version 660246 (0.0007) [2023-12-27 23:59:16,753][106226] Updated weights for policy 0, policy_version 660256 (0.0006) [2023-12-27 23:59:16,817][106226] Updated weights for policy 0, policy_version 660266 (0.0006) [2023-12-27 23:59:16,819][106225] Updated weights for policy 1, policy_version 662030 (0.0007) [2023-12-27 23:59:16,874][106225] Updated weights for policy 1, policy_version 662040 (0.0008) [2023-12-27 23:59:16,929][106225] Updated weights for policy 1, policy_version 662050 (0.0009) [2023-12-27 23:59:17,399][106226] Updated weights for policy 0, policy_version 660276 (0.0007) [2023-12-27 23:59:17,462][106226] Updated weights for policy 0, policy_version 660286 (0.0011) [2023-12-27 23:59:17,521][106226] Updated weights for policy 0, policy_version 660296 (0.0011) [2023-12-27 23:59:17,690][106225] Updated weights for policy 1, policy_version 662060 (0.0009) [2023-12-27 23:59:17,744][106225] Updated weights for policy 1, policy_version 662070 (0.0008) [2023-12-27 23:59:17,794][106225] Updated weights for policy 1, policy_version 662080 (0.0008) [2023-12-27 23:59:18,221][106226] Updated weights for policy 0, policy_version 660306 (0.0010) [2023-12-27 23:59:18,284][106226] Updated weights for policy 0, policy_version 660316 (0.0011) [2023-12-27 23:59:18,350][106226] Updated weights for policy 0, policy_version 660326 (0.0010) [2023-12-27 23:59:18,414][106226] Updated weights for policy 0, policy_version 660336 (0.0009) [2023-12-27 23:59:18,462][106225] Updated weights for policy 1, policy_version 662090 (0.0006) [2023-12-27 23:59:18,512][106225] Updated weights for policy 1, policy_version 662100 (0.0007) [2023-12-27 23:59:18,577][106225] Updated weights for policy 1, policy_version 662110 (0.0008) [2023-12-27 23:59:18,641][106225] Updated weights for policy 1, policy_version 662120 (0.0008) [2023-12-27 23:59:19,148][106226] Updated weights for policy 0, policy_version 660346 (0.0010) [2023-12-27 23:59:19,203][106226] Updated weights for policy 0, policy_version 660356 (0.0008) [2023-12-27 23:59:19,272][106226] Updated weights for policy 0, policy_version 660366 (0.0008) [2023-12-27 23:59:19,426][106225] Updated weights for policy 1, policy_version 662130 (0.0007) [2023-12-27 23:59:19,491][106225] Updated weights for policy 1, policy_version 662140 (0.0006) [2023-12-27 23:59:19,553][106225] Updated weights for policy 1, policy_version 662150 (0.0008) [2023-12-27 23:59:20,057][106226] Updated weights for policy 0, policy_version 660376 (0.0010) [2023-12-27 23:59:20,114][106226] Updated weights for policy 0, policy_version 660386 (0.0009) [2023-12-27 23:59:20,176][106226] Updated weights for policy 0, policy_version 660396 (0.0009) [2023-12-27 23:59:20,249][106225] Updated weights for policy 1, policy_version 662160 (0.0010) [2023-12-27 23:59:20,301][106225] Updated weights for policy 1, policy_version 662170 (0.0010) [2023-12-27 23:59:20,358][106225] Updated weights for policy 1, policy_version 662180 (0.0010) [2023-12-27 23:59:20,954][106226] Updated weights for policy 0, policy_version 660406 (0.0009) [2023-12-27 23:59:21,020][106226] Updated weights for policy 0, policy_version 660416 (0.0008) [2023-12-27 23:59:21,082][106226] Updated weights for policy 0, policy_version 660426 (0.0008) [2023-12-27 23:59:21,132][106225] Updated weights for policy 1, policy_version 662190 (0.0009) [2023-12-27 23:59:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.8, 300 sec: 19605.3). Total num frames: 338665472. Throughput: 0: 9897.7, 1: 9404.5. Samples: 338675004. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:21,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-5.713')] [2023-12-27 23:59:21,198][106225] Updated weights for policy 1, policy_version 662200 (0.0007) [2023-12-27 23:59:21,262][106225] Updated weights for policy 1, policy_version 662210 (0.0007) [2023-12-27 23:59:21,888][106226] Updated weights for policy 0, policy_version 660436 (0.0007) [2023-12-27 23:59:21,938][106226] Updated weights for policy 0, policy_version 660446 (0.0009) [2023-12-27 23:59:21,991][106226] Updated weights for policy 0, policy_version 660456 (0.0008) [2023-12-27 23:59:22,066][106225] Updated weights for policy 1, policy_version 662220 (0.0009) [2023-12-27 23:59:22,115][106225] Updated weights for policy 1, policy_version 662230 (0.0009) [2023-12-27 23:59:22,174][106225] Updated weights for policy 1, policy_version 662240 (0.0009) [2023-12-27 23:59:22,805][106226] Updated weights for policy 0, policy_version 660466 (0.0009) [2023-12-27 23:59:22,865][106226] Updated weights for policy 0, policy_version 660476 (0.0008) [2023-12-27 23:59:22,877][106225] Updated weights for policy 1, policy_version 662250 (0.0008) [2023-12-27 23:59:22,931][106226] Updated weights for policy 0, policy_version 660486 (0.0008) [2023-12-27 23:59:22,938][106225] Updated weights for policy 1, policy_version 662260 (0.0006) [2023-12-27 23:59:22,994][106226] Updated weights for policy 0, policy_version 660496 (0.0008) [2023-12-27 23:59:22,999][106225] Updated weights for policy 1, policy_version 662270 (0.0005) [2023-12-27 23:59:23,051][106225] Updated weights for policy 1, policy_version 662280 (0.0006) [2023-12-27 23:59:23,594][106226] Updated weights for policy 0, policy_version 660506 (0.0005) [2023-12-27 23:59:23,647][106226] Updated weights for policy 0, policy_version 660516 (0.0007) [2023-12-27 23:59:23,696][106226] Updated weights for policy 0, policy_version 660526 (0.0009) [2023-12-27 23:59:23,761][106225] Updated weights for policy 1, policy_version 662290 (0.0005) [2023-12-27 23:59:23,825][106225] Updated weights for policy 1, policy_version 662300 (0.0005) [2023-12-27 23:59:23,884][106225] Updated weights for policy 1, policy_version 662310 (0.0008) [2023-12-27 23:59:24,370][106226] Updated weights for policy 0, policy_version 660536 (0.0008) [2023-12-27 23:59:24,430][106226] Updated weights for policy 0, policy_version 660546 (0.0007) [2023-12-27 23:59:24,490][106226] Updated weights for policy 0, policy_version 660556 (0.0007) [2023-12-27 23:59:24,504][106225] Updated weights for policy 1, policy_version 662320 (0.0010) [2023-12-27 23:59:24,564][106225] Updated weights for policy 1, policy_version 662330 (0.0010) [2023-12-27 23:59:24,617][106225] Updated weights for policy 1, policy_version 662340 (0.0010) [2023-12-27 23:59:25,153][106226] Updated weights for policy 0, policy_version 660566 (0.0005) [2023-12-27 23:59:25,204][106226] Updated weights for policy 0, policy_version 660576 (0.0006) [2023-12-27 23:59:25,257][106226] Updated weights for policy 0, policy_version 660586 (0.0005) [2023-12-27 23:59:25,338][106225] Updated weights for policy 1, policy_version 662350 (0.0008) [2023-12-27 23:59:25,384][106225] Updated weights for policy 1, policy_version 662360 (0.0008) [2023-12-27 23:59:25,431][106225] Updated weights for policy 1, policy_version 662370 (0.0007) [2023-12-27 23:59:25,840][106226] Updated weights for policy 0, policy_version 660596 (0.0005) [2023-12-27 23:59:25,894][106226] Updated weights for policy 0, policy_version 660606 (0.0008) [2023-12-27 23:59:25,950][106226] Updated weights for policy 0, policy_version 660616 (0.0009) [2023-12-27 23:59:26,124][106225] Updated weights for policy 1, policy_version 662380 (0.0008) [2023-12-27 23:59:26,174][106225] Updated weights for policy 1, policy_version 662390 (0.0006) [2023-12-27 23:59:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 19633.0). Total num frames: 338763776. Throughput: 0: 9895.4, 1: 9413.2. Samples: 338732924. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:26,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.630')] [2023-12-27 23:59:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000660624_169164800.pth... [2023-12-27 23:59:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000659488_168869888.pth [2023-12-27 23:59:26,222][106225] Updated weights for policy 1, policy_version 662400 (0.0006) [2023-12-27 23:59:26,263][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000662408_169607168.pth... [2023-12-27 23:59:26,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000661288_169320448.pth [2023-12-27 23:59:26,618][106226] Updated weights for policy 0, policy_version 660626 (0.0005) [2023-12-27 23:59:26,678][106226] Updated weights for policy 0, policy_version 660636 (0.0005) [2023-12-27 23:59:26,733][106226] Updated weights for policy 0, policy_version 660646 (0.0007) [2023-12-27 23:59:26,828][106225] Updated weights for policy 1, policy_version 662410 (0.0005) [2023-12-27 23:59:26,890][106225] Updated weights for policy 1, policy_version 662420 (0.0006) [2023-12-27 23:59:26,954][106225] Updated weights for policy 1, policy_version 662430 (0.0006) [2023-12-27 23:59:27,012][106225] Updated weights for policy 1, policy_version 662440 (0.0005) [2023-12-27 23:59:27,472][106226] Updated weights for policy 0, policy_version 660657 (0.0008) [2023-12-27 23:59:27,530][106226] Updated weights for policy 0, policy_version 660667 (0.0009) [2023-12-27 23:59:27,598][106226] Updated weights for policy 0, policy_version 660677 (0.0008) [2023-12-27 23:59:27,608][106225] Updated weights for policy 1, policy_version 662450 (0.0007) [2023-12-27 23:59:27,648][106226] Updated weights for policy 0, policy_version 660687 (0.0005) [2023-12-27 23:59:27,651][106225] Updated weights for policy 1, policy_version 662460 (0.0008) [2023-12-27 23:59:27,703][106225] Updated weights for policy 1, policy_version 662470 (0.0008) [2023-12-27 23:59:28,368][106226] Updated weights for policy 0, policy_version 660697 (0.0008) [2023-12-27 23:59:28,403][106225] Updated weights for policy 1, policy_version 662480 (0.0008) [2023-12-27 23:59:28,431][106226] Updated weights for policy 0, policy_version 660707 (0.0009) [2023-12-27 23:59:28,457][106225] Updated weights for policy 1, policy_version 662490 (0.0006) [2023-12-27 23:59:28,496][106226] Updated weights for policy 0, policy_version 660717 (0.0008) [2023-12-27 23:59:28,518][106225] Updated weights for policy 1, policy_version 662501 (0.0007) [2023-12-27 23:59:29,175][106226] Updated weights for policy 0, policy_version 660727 (0.0008) [2023-12-27 23:59:29,197][106225] Updated weights for policy 1, policy_version 662511 (0.0009) [2023-12-27 23:59:29,240][106226] Updated weights for policy 0, policy_version 660737 (0.0008) [2023-12-27 23:59:29,282][106225] Updated weights for policy 1, policy_version 662521 (0.0011) [2023-12-27 23:59:29,304][106226] Updated weights for policy 0, policy_version 660747 (0.0009) [2023-12-27 23:59:29,343][106225] Updated weights for policy 1, policy_version 662531 (0.0010) [2023-12-27 23:59:30,028][106225] Updated weights for policy 1, policy_version 662541 (0.0010) [2023-12-27 23:59:30,076][106226] Updated weights for policy 0, policy_version 660757 (0.0006) [2023-12-27 23:59:30,087][106225] Updated weights for policy 1, policy_version 662551 (0.0009) [2023-12-27 23:59:30,137][106226] Updated weights for policy 0, policy_version 660767 (0.0009) [2023-12-27 23:59:30,146][106225] Updated weights for policy 1, policy_version 662561 (0.0005) [2023-12-27 23:59:30,189][106226] Updated weights for policy 0, policy_version 660777 (0.0007) [2023-12-27 23:59:30,799][106225] Updated weights for policy 1, policy_version 662571 (0.0006) [2023-12-27 23:59:30,842][106225] Updated weights for policy 1, policy_version 662581 (0.0008) [2023-12-27 23:59:30,894][106225] Updated weights for policy 1, policy_version 662591 (0.0005) [2023-12-27 23:59:30,923][106226] Updated weights for policy 0, policy_version 660787 (0.0009) [2023-12-27 23:59:30,984][106226] Updated weights for policy 0, policy_version 660797 (0.0006) [2023-12-27 23:59:31,049][106226] Updated weights for policy 0, policy_version 660807 (0.0008) [2023-12-27 23:59:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 338870272. Throughput: 0: 9906.0, 1: 9558.3. Samples: 338855108. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:31,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.389')] [2023-12-27 23:59:31,607][106225] Updated weights for policy 1, policy_version 662601 (0.0006) [2023-12-27 23:59:31,671][106225] Updated weights for policy 1, policy_version 662611 (0.0009) [2023-12-27 23:59:31,741][106225] Updated weights for policy 1, policy_version 662621 (0.0009) [2023-12-27 23:59:31,752][106226] Updated weights for policy 0, policy_version 660817 (0.0008) [2023-12-27 23:59:31,801][106225] Updated weights for policy 1, policy_version 662631 (0.0006) [2023-12-27 23:59:31,803][106226] Updated weights for policy 0, policy_version 660827 (0.0008) [2023-12-27 23:59:31,850][106226] Updated weights for policy 0, policy_version 660837 (0.0008) [2023-12-27 23:59:31,901][106226] Updated weights for policy 0, policy_version 660847 (0.0008) [2023-12-27 23:59:32,487][106225] Updated weights for policy 1, policy_version 662641 (0.0008) [2023-12-27 23:59:32,542][106225] Updated weights for policy 1, policy_version 662651 (0.0009) [2023-12-27 23:59:32,597][106225] Updated weights for policy 1, policy_version 662661 (0.0008) [2023-12-27 23:59:32,697][106226] Updated weights for policy 0, policy_version 660857 (0.0009) [2023-12-27 23:59:32,765][106226] Updated weights for policy 0, policy_version 660867 (0.0009) [2023-12-27 23:59:32,831][106226] Updated weights for policy 0, policy_version 660877 (0.0008) [2023-12-27 23:59:33,159][106225] Updated weights for policy 1, policy_version 662671 (0.0008) [2023-12-27 23:59:33,212][106225] Updated weights for policy 1, policy_version 662681 (0.0008) [2023-12-27 23:59:33,260][106225] Updated weights for policy 1, policy_version 662691 (0.0008) [2023-12-27 23:59:33,580][106226] Updated weights for policy 0, policy_version 660887 (0.0008) [2023-12-27 23:59:33,628][106226] Updated weights for policy 0, policy_version 660897 (0.0008) [2023-12-27 23:59:33,673][106226] Updated weights for policy 0, policy_version 660907 (0.0008) [2023-12-27 23:59:33,992][106225] Updated weights for policy 1, policy_version 662701 (0.0009) [2023-12-27 23:59:34,050][106225] Updated weights for policy 1, policy_version 662711 (0.0008) [2023-12-27 23:59:34,104][106225] Updated weights for policy 1, policy_version 662721 (0.0008) [2023-12-27 23:59:34,402][106226] Updated weights for policy 0, policy_version 660917 (0.0008) [2023-12-27 23:59:34,467][106226] Updated weights for policy 0, policy_version 660927 (0.0008) [2023-12-27 23:59:34,535][106226] Updated weights for policy 0, policy_version 660937 (0.0009) [2023-12-27 23:59:34,790][106225] Updated weights for policy 1, policy_version 662731 (0.0009) [2023-12-27 23:59:34,841][106225] Updated weights for policy 1, policy_version 662741 (0.0009) [2023-12-27 23:59:34,895][106225] Updated weights for policy 1, policy_version 662751 (0.0009) [2023-12-27 23:59:35,126][106226] Updated weights for policy 0, policy_version 660947 (0.0005) [2023-12-27 23:59:35,181][106226] Updated weights for policy 0, policy_version 660957 (0.0005) [2023-12-27 23:59:35,237][106226] Updated weights for policy 0, policy_version 660967 (0.0007) [2023-12-27 23:59:35,658][106225] Updated weights for policy 1, policy_version 662761 (0.0009) [2023-12-27 23:59:35,705][106225] Updated weights for policy 1, policy_version 662771 (0.0008) [2023-12-27 23:59:35,748][106225] Updated weights for policy 1, policy_version 662781 (0.0008) [2023-12-27 23:59:35,797][106225] Updated weights for policy 1, policy_version 662791 (0.0007) [2023-12-27 23:59:35,908][106226] Updated weights for policy 0, policy_version 660977 (0.0006) [2023-12-27 23:59:35,964][106226] Updated weights for policy 0, policy_version 660987 (0.0010) [2023-12-27 23:59:36,016][106226] Updated weights for policy 0, policy_version 660997 (0.0010) [2023-12-27 23:59:36,076][106226] Updated weights for policy 0, policy_version 661007 (0.0010) [2023-12-27 23:59:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 338968576. Throughput: 0: 9873.4, 1: 9637.5. Samples: 338974224. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:36,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-5.649')] [2023-12-27 23:59:36,550][106225] Updated weights for policy 1, policy_version 662801 (0.0008) [2023-12-27 23:59:36,617][106225] Updated weights for policy 1, policy_version 662811 (0.0008) [2023-12-27 23:59:36,681][106225] Updated weights for policy 1, policy_version 662821 (0.0009) [2023-12-27 23:59:36,801][106226] Updated weights for policy 0, policy_version 661017 (0.0006) [2023-12-27 23:59:36,855][106226] Updated weights for policy 0, policy_version 661027 (0.0007) [2023-12-27 23:59:36,904][106226] Updated weights for policy 0, policy_version 661037 (0.0005) [2023-12-27 23:59:37,470][106225] Updated weights for policy 1, policy_version 662831 (0.0009) [2023-12-27 23:59:37,533][106225] Updated weights for policy 1, policy_version 662841 (0.0008) [2023-12-27 23:59:37,548][106226] Updated weights for policy 0, policy_version 661047 (0.0006) [2023-12-27 23:59:37,595][106225] Updated weights for policy 1, policy_version 662851 (0.0006) [2023-12-27 23:59:37,613][106226] Updated weights for policy 0, policy_version 661057 (0.0007) [2023-12-27 23:59:37,673][106226] Updated weights for policy 0, policy_version 661067 (0.0008) [2023-12-27 23:59:38,358][106225] Updated weights for policy 1, policy_version 662861 (0.0008) [2023-12-27 23:59:38,401][106226] Updated weights for policy 0, policy_version 661077 (0.0009) [2023-12-27 23:59:38,420][106225] Updated weights for policy 1, policy_version 662871 (0.0008) [2023-12-27 23:59:38,456][106226] Updated weights for policy 0, policy_version 661087 (0.0009) [2023-12-27 23:59:38,474][106225] Updated weights for policy 1, policy_version 662881 (0.0008) [2023-12-27 23:59:38,516][106226] Updated weights for policy 0, policy_version 661097 (0.0007) [2023-12-27 23:59:39,192][106226] Updated weights for policy 0, policy_version 661107 (0.0009) [2023-12-27 23:59:39,226][106225] Updated weights for policy 1, policy_version 662891 (0.0008) [2023-12-27 23:59:39,261][106226] Updated weights for policy 0, policy_version 661118 (0.0009) [2023-12-27 23:59:39,287][106225] Updated weights for policy 1, policy_version 662901 (0.0007) [2023-12-27 23:59:39,323][106226] Updated weights for policy 0, policy_version 661128 (0.0011) [2023-12-27 23:59:39,349][106225] Updated weights for policy 1, policy_version 662911 (0.0006) [2023-12-27 23:59:40,024][106225] Updated weights for policy 1, policy_version 662921 (0.0008) [2023-12-27 23:59:40,079][106225] Updated weights for policy 1, policy_version 662931 (0.0006) [2023-12-27 23:59:40,147][106225] Updated weights for policy 1, policy_version 662941 (0.0006) [2023-12-27 23:59:40,149][106226] Updated weights for policy 0, policy_version 661138 (0.0010) [2023-12-27 23:59:40,210][106226] Updated weights for policy 0, policy_version 661148 (0.0007) [2023-12-27 23:59:40,217][106225] Updated weights for policy 1, policy_version 662951 (0.0006) [2023-12-27 23:59:40,274][106226] Updated weights for policy 0, policy_version 661158 (0.0008) [2023-12-27 23:59:40,334][106226] Updated weights for policy 0, policy_version 661168 (0.0006) [2023-12-27 23:59:40,884][106225] Updated weights for policy 1, policy_version 662961 (0.0009) [2023-12-27 23:59:40,942][106225] Updated weights for policy 1, policy_version 662971 (0.0008) [2023-12-27 23:59:41,002][106225] Updated weights for policy 1, policy_version 662981 (0.0007) [2023-12-27 23:59:41,021][106226] Updated weights for policy 0, policy_version 661178 (0.0006) [2023-12-27 23:59:41,110][106226] Updated weights for policy 0, policy_version 661188 (0.0008) [2023-12-27 23:59:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 339058688. Throughput: 0: 9892.9, 1: 9627.6. Samples: 339032148. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:41,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.659')] [2023-12-27 23:59:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000662984_169754624.pth... [2023-12-27 23:59:41,185][106226] Updated weights for policy 0, policy_version 661198 (0.0008) [2023-12-27 23:59:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000661832_169459712.pth [2023-12-27 23:59:41,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000661200_169312256.pth... [2023-12-27 23:59:41,200][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000660048_169017344.pth [2023-12-27 23:59:41,790][106225] Updated weights for policy 1, policy_version 662991 (0.0008) [2023-12-27 23:59:41,854][106225] Updated weights for policy 1, policy_version 663001 (0.0007) [2023-12-27 23:59:41,916][106226] Updated weights for policy 0, policy_version 661208 (0.0007) [2023-12-27 23:59:41,917][106225] Updated weights for policy 1, policy_version 663011 (0.0008) [2023-12-27 23:59:41,977][106226] Updated weights for policy 0, policy_version 661218 (0.0007) [2023-12-27 23:59:42,033][106226] Updated weights for policy 0, policy_version 661228 (0.0009) [2023-12-27 23:59:42,675][106225] Updated weights for policy 1, policy_version 663021 (0.0008) [2023-12-27 23:59:42,737][106225] Updated weights for policy 1, policy_version 663031 (0.0008) [2023-12-27 23:59:42,753][106226] Updated weights for policy 0, policy_version 661238 (0.0009) [2023-12-27 23:59:42,801][106225] Updated weights for policy 1, policy_version 663041 (0.0010) [2023-12-27 23:59:42,818][106226] Updated weights for policy 0, policy_version 661248 (0.0008) [2023-12-27 23:59:42,875][106226] Updated weights for policy 0, policy_version 661258 (0.0007) [2023-12-27 23:59:43,427][106226] Updated weights for policy 0, policy_version 661268 (0.0005) [2023-12-27 23:59:43,490][106226] Updated weights for policy 0, policy_version 661278 (0.0007) [2023-12-27 23:59:43,555][106226] Updated weights for policy 0, policy_version 661288 (0.0005) [2023-12-27 23:59:43,568][106225] Updated weights for policy 1, policy_version 663051 (0.0005) [2023-12-27 23:59:43,618][106225] Updated weights for policy 1, policy_version 663061 (0.0005) [2023-12-27 23:59:43,673][106225] Updated weights for policy 1, policy_version 663071 (0.0005) [2023-12-27 23:59:44,177][106226] Updated weights for policy 0, policy_version 661298 (0.0006) [2023-12-27 23:59:44,236][106226] Updated weights for policy 0, policy_version 661308 (0.0010) [2023-12-27 23:59:44,298][106226] Updated weights for policy 0, policy_version 661318 (0.0009) [2023-12-27 23:59:44,325][106225] Updated weights for policy 1, policy_version 663081 (0.0010) [2023-12-27 23:59:44,356][106226] Updated weights for policy 0, policy_version 661328 (0.0005) [2023-12-27 23:59:44,392][106225] Updated weights for policy 1, policy_version 663091 (0.0006) [2023-12-27 23:59:44,449][106225] Updated weights for policy 1, policy_version 663101 (0.0008) [2023-12-27 23:59:44,502][106225] Updated weights for policy 1, policy_version 663111 (0.0008) [2023-12-27 23:59:44,937][106226] Updated weights for policy 0, policy_version 661338 (0.0006) [2023-12-27 23:59:45,000][106226] Updated weights for policy 0, policy_version 661348 (0.0006) [2023-12-27 23:59:45,067][106226] Updated weights for policy 0, policy_version 661358 (0.0007) [2023-12-27 23:59:45,209][106225] Updated weights for policy 1, policy_version 663121 (0.0008) [2023-12-27 23:59:45,271][106225] Updated weights for policy 1, policy_version 663131 (0.0009) [2023-12-27 23:59:45,335][106225] Updated weights for policy 1, policy_version 663141 (0.0008) [2023-12-27 23:59:45,688][106226] Updated weights for policy 0, policy_version 661368 (0.0006) [2023-12-27 23:59:45,759][106226] Updated weights for policy 0, policy_version 661378 (0.0006) [2023-12-27 23:59:45,812][106226] Updated weights for policy 0, policy_version 661388 (0.0009) [2023-12-27 23:59:45,959][106225] Updated weights for policy 1, policy_version 663151 (0.0010) [2023-12-27 23:59:46,016][106225] Updated weights for policy 1, policy_version 663161 (0.0010) [2023-12-27 23:59:46,071][106225] Updated weights for policy 1, policy_version 663171 (0.0010) [2023-12-27 23:59:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 339165184. Throughput: 0: 9900.0, 1: 9677.3. Samples: 339149980. Policy #0 lag: (min: 24.0, avg: 51.3, max: 56.0) [2023-12-27 23:59:46,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-5.182')] [2023-12-27 23:59:46,393][106226] Updated weights for policy 0, policy_version 661398 (0.0005) [2023-12-27 23:59:46,461][106226] Updated weights for policy 0, policy_version 661408 (0.0005) [2023-12-27 23:59:46,524][106226] Updated weights for policy 0, policy_version 661418 (0.0005) [2023-12-27 23:59:46,750][106225] Updated weights for policy 1, policy_version 663181 (0.0010) [2023-12-27 23:59:46,807][106225] Updated weights for policy 1, policy_version 663191 (0.0010) [2023-12-27 23:59:46,867][106225] Updated weights for policy 1, policy_version 663201 (0.0010) [2023-12-27 23:59:47,057][106226] Updated weights for policy 0, policy_version 661428 (0.0005) [2023-12-27 23:59:47,111][106226] Updated weights for policy 0, policy_version 661438 (0.0008) [2023-12-27 23:59:47,166][106226] Updated weights for policy 0, policy_version 661448 (0.0010) [2023-12-27 23:59:47,578][106225] Updated weights for policy 1, policy_version 663211 (0.0010) [2023-12-27 23:59:47,647][106225] Updated weights for policy 1, policy_version 663221 (0.0006) [2023-12-27 23:59:47,711][106225] Updated weights for policy 1, policy_version 663231 (0.0010) [2023-12-27 23:59:47,724][106226] Updated weights for policy 0, policy_version 661458 (0.0009) [2023-12-27 23:59:47,778][106226] Updated weights for policy 0, policy_version 661468 (0.0005) [2023-12-27 23:59:47,839][106226] Updated weights for policy 0, policy_version 661478 (0.0005) [2023-12-27 23:59:47,899][106226] Updated weights for policy 0, policy_version 661488 (0.0005) [2023-12-27 23:59:48,406][106225] Updated weights for policy 1, policy_version 663241 (0.0010) [2023-12-27 23:59:48,466][106225] Updated weights for policy 1, policy_version 663251 (0.0009) [2023-12-27 23:59:48,521][106225] Updated weights for policy 1, policy_version 663261 (0.0009) [2023-12-27 23:59:48,553][106226] Updated weights for policy 0, policy_version 661498 (0.0005) [2023-12-27 23:59:48,577][106225] Updated weights for policy 1, policy_version 663271 (0.0009) [2023-12-27 23:59:48,618][106226] Updated weights for policy 0, policy_version 661508 (0.0006) [2023-12-27 23:59:48,689][106226] Updated weights for policy 0, policy_version 661518 (0.0006) [2023-12-27 23:59:49,346][106225] Updated weights for policy 1, policy_version 663281 (0.0009) [2023-12-27 23:59:49,352][106226] Updated weights for policy 0, policy_version 661528 (0.0007) [2023-12-27 23:59:49,410][106225] Updated weights for policy 1, policy_version 663291 (0.0008) [2023-12-27 23:59:49,419][106226] Updated weights for policy 0, policy_version 661538 (0.0009) [2023-12-27 23:59:49,472][106225] Updated weights for policy 1, policy_version 663301 (0.0009) [2023-12-27 23:59:49,481][106226] Updated weights for policy 0, policy_version 661548 (0.0009) [2023-12-27 23:59:50,206][106226] Updated weights for policy 0, policy_version 661558 (0.0009) [2023-12-27 23:59:50,247][106225] Updated weights for policy 1, policy_version 663311 (0.0010) [2023-12-27 23:59:50,269][106226] Updated weights for policy 0, policy_version 661568 (0.0006) [2023-12-27 23:59:50,299][106225] Updated weights for policy 1, policy_version 663321 (0.0010) [2023-12-27 23:59:50,336][106226] Updated weights for policy 0, policy_version 661578 (0.0006) [2023-12-27 23:59:50,360][106225] Updated weights for policy 1, policy_version 663331 (0.0010) [2023-12-27 23:59:50,916][106226] Updated weights for policy 0, policy_version 661588 (0.0007) [2023-12-27 23:59:50,971][106226] Updated weights for policy 0, policy_version 661598 (0.0009) [2023-12-27 23:59:51,043][106226] Updated weights for policy 0, policy_version 661608 (0.0010) [2023-12-27 23:59:51,081][106225] Updated weights for policy 1, policy_version 663341 (0.0010) [2023-12-27 23:59:51,145][106225] Updated weights for policy 1, policy_version 663351 (0.0009) [2023-12-27 23:59:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19633.1). Total num frames: 339263488. Throughput: 0: 9982.6, 1: 9731.3. Samples: 339272880. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-27 23:59:51,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-5.481')] [2023-12-27 23:59:51,209][106225] Updated weights for policy 1, policy_version 663361 (0.0010) [2023-12-27 23:59:51,788][106226] Updated weights for policy 0, policy_version 661618 (0.0009) [2023-12-27 23:59:51,853][106226] Updated weights for policy 0, policy_version 661628 (0.0010) [2023-12-27 23:59:51,912][106226] Updated weights for policy 0, policy_version 661638 (0.0008) [2023-12-27 23:59:51,933][106225] Updated weights for policy 1, policy_version 663371 (0.0010) [2023-12-27 23:59:51,977][106226] Updated weights for policy 0, policy_version 661648 (0.0006) [2023-12-27 23:59:51,995][106225] Updated weights for policy 1, policy_version 663381 (0.0007) [2023-12-27 23:59:52,056][106225] Updated weights for policy 1, policy_version 663391 (0.0006) [2023-12-27 23:59:52,748][106226] Updated weights for policy 0, policy_version 661658 (0.0006) [2023-12-27 23:59:52,751][106225] Updated weights for policy 1, policy_version 663401 (0.0005) [2023-12-27 23:59:52,812][106226] Updated weights for policy 0, policy_version 661668 (0.0006) [2023-12-27 23:59:52,812][106225] Updated weights for policy 1, policy_version 663411 (0.0009) [2023-12-27 23:59:52,872][106225] Updated weights for policy 1, policy_version 663421 (0.0007) [2023-12-27 23:59:52,874][106226] Updated weights for policy 0, policy_version 661678 (0.0006) [2023-12-27 23:59:52,937][106225] Updated weights for policy 1, policy_version 663431 (0.0008) [2023-12-27 23:59:53,513][106226] Updated weights for policy 0, policy_version 661688 (0.0007) [2023-12-27 23:59:53,574][106226] Updated weights for policy 0, policy_version 661698 (0.0008) [2023-12-27 23:59:53,638][106226] Updated weights for policy 0, policy_version 661708 (0.0008) [2023-12-27 23:59:53,697][106225] Updated weights for policy 1, policy_version 663441 (0.0007) [2023-12-27 23:59:53,753][106225] Updated weights for policy 1, policy_version 663451 (0.0008) [2023-12-27 23:59:53,818][106225] Updated weights for policy 1, policy_version 663461 (0.0008) [2023-12-27 23:59:54,285][106226] Updated weights for policy 0, policy_version 661718 (0.0009) [2023-12-27 23:59:54,349][106226] Updated weights for policy 0, policy_version 661728 (0.0009) [2023-12-27 23:59:54,399][106226] Updated weights for policy 0, policy_version 661738 (0.0009) [2023-12-27 23:59:54,530][106225] Updated weights for policy 1, policy_version 663471 (0.0009) [2023-12-27 23:59:54,582][106225] Updated weights for policy 1, policy_version 663481 (0.0006) [2023-12-27 23:59:54,648][106225] Updated weights for policy 1, policy_version 663491 (0.0005) [2023-12-27 23:59:55,176][106226] Updated weights for policy 0, policy_version 661748 (0.0007) [2023-12-27 23:59:55,228][106226] Updated weights for policy 0, policy_version 661758 (0.0006) [2023-12-27 23:59:55,237][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000004 [2023-12-27 23:59:55,270][106225] Updated weights for policy 1, policy_version 663501 (0.0007) [2023-12-27 23:59:55,325][106225] Updated weights for policy 1, policy_version 663512 (0.0009) [2023-12-27 23:59:55,376][106225] Updated weights for policy 1, policy_version 663523 (0.0009) [2023-12-27 23:59:55,951][106226] Updated weights for policy 0, policy_version 661768 (0.0009) [2023-12-27 23:59:55,998][106226] Updated weights for policy 0, policy_version 661778 (0.0010) [2023-12-27 23:59:56,052][106226] Updated weights for policy 0, policy_version 661788 (0.0010) [2023-12-27 23:59:56,135][106225] Updated weights for policy 1, policy_version 663533 (0.0009) [2023-12-27 23:59:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.3, 300 sec: 19605.2). Total num frames: 339361792. Throughput: 0: 9988.6, 1: 9717.4. Samples: 339330760. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-27 23:59:56,176][105115] Avg episode reward: [(0, '-4.349'), (1, '-5.527')] [2023-12-27 23:59:56,182][106225] Updated weights for policy 1, policy_version 663543 (0.0007) [2023-12-27 23:59:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000661792_169467904.pth... [2023-12-27 23:59:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000660624_169164800.pth [2023-12-27 23:59:56,242][106225] Updated weights for policy 1, policy_version 663553 (0.0009) [2023-12-27 23:59:56,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000663560_169902080.pth... [2023-12-27 23:59:56,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000662408_169607168.pth [2023-12-27 23:59:56,736][106226] Updated weights for policy 0, policy_version 661798 (0.0010) [2023-12-27 23:59:56,781][106226] Updated weights for policy 0, policy_version 661808 (0.0010) [2023-12-27 23:59:56,834][106226] Updated weights for policy 0, policy_version 661818 (0.0010) [2023-12-27 23:59:56,960][106225] Updated weights for policy 1, policy_version 663563 (0.0008) [2023-12-27 23:59:57,016][106225] Updated weights for policy 1, policy_version 663573 (0.0007) [2023-12-27 23:59:57,082][106225] Updated weights for policy 1, policy_version 663583 (0.0005) [2023-12-27 23:59:57,534][106226] Updated weights for policy 0, policy_version 661828 (0.0010) [2023-12-27 23:59:57,593][106226] Updated weights for policy 0, policy_version 661838 (0.0010) [2023-12-27 23:59:57,649][106226] Updated weights for policy 0, policy_version 661848 (0.0010) [2023-12-27 23:59:57,730][106225] Updated weights for policy 1, policy_version 663593 (0.0005) [2023-12-27 23:59:57,779][106225] Updated weights for policy 1, policy_version 663603 (0.0007) [2023-12-27 23:59:57,835][106225] Updated weights for policy 1, policy_version 663613 (0.0005) [2023-12-27 23:59:57,882][106225] Updated weights for policy 1, policy_version 663623 (0.0006) [2023-12-27 23:59:58,353][106226] Updated weights for policy 0, policy_version 661858 (0.0010) [2023-12-27 23:59:58,419][106226] Updated weights for policy 0, policy_version 661868 (0.0010) [2023-12-27 23:59:58,485][106226] Updated weights for policy 0, policy_version 661878 (0.0009) [2023-12-27 23:59:58,553][106226] Updated weights for policy 0, policy_version 661888 (0.0011) [2023-12-27 23:59:58,556][106225] Updated weights for policy 1, policy_version 663633 (0.0008) [2023-12-27 23:59:58,624][106225] Updated weights for policy 1, policy_version 663643 (0.0008) [2023-12-27 23:59:58,690][106225] Updated weights for policy 1, policy_version 663653 (0.0009) [2023-12-27 23:59:59,365][106226] Updated weights for policy 0, policy_version 661898 (0.0008) [2023-12-27 23:59:59,427][106226] Updated weights for policy 0, policy_version 661908 (0.0010) [2023-12-27 23:59:59,494][106226] Updated weights for policy 0, policy_version 661918 (0.0009) [2023-12-27 23:59:59,500][106225] Updated weights for policy 1, policy_version 663663 (0.0010) [2023-12-27 23:59:59,557][106225] Updated weights for policy 1, policy_version 663673 (0.0010) [2023-12-27 23:59:59,617][106225] Updated weights for policy 1, policy_version 663683 (0.0010) [2023-12-28 00:00:00,233][106226] Updated weights for policy 0, policy_version 661928 (0.0008) [2023-12-28 00:00:00,289][106226] Updated weights for policy 0, policy_version 661938 (0.0008) [2023-12-28 00:00:00,345][106225] Updated weights for policy 1, policy_version 663693 (0.0009) [2023-12-28 00:00:00,354][106226] Updated weights for policy 0, policy_version 661948 (0.0008) [2023-12-28 00:00:00,409][106225] Updated weights for policy 1, policy_version 663703 (0.0007) [2023-12-28 00:00:00,469][106225] Updated weights for policy 1, policy_version 663713 (0.0007) [2023-12-28 00:00:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19605.3). Total num frames: 339451904. Throughput: 0: 9998.6, 1: 9798.0. Samples: 339448656. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:01,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.346')] [2023-12-28 00:00:01,187][106226] Updated weights for policy 0, policy_version 661958 (0.0010) [2023-12-28 00:00:01,233][106225] Updated weights for policy 1, policy_version 663723 (0.0009) [2023-12-28 00:00:01,260][106226] Updated weights for policy 0, policy_version 661968 (0.0010) [2023-12-28 00:00:01,306][106225] Updated weights for policy 1, policy_version 663733 (0.0007) [2023-12-28 00:00:01,324][106226] Updated weights for policy 0, policy_version 661978 (0.0011) [2023-12-28 00:00:01,376][106225] Updated weights for policy 1, policy_version 663743 (0.0008) [2023-12-28 00:00:02,148][106225] Updated weights for policy 1, policy_version 663753 (0.0008) [2023-12-28 00:00:02,164][106226] Updated weights for policy 0, policy_version 661988 (0.0011) [2023-12-28 00:00:02,207][106225] Updated weights for policy 1, policy_version 663763 (0.0009) [2023-12-28 00:00:02,230][106226] Updated weights for policy 0, policy_version 661998 (0.0011) [2023-12-28 00:00:02,275][106225] Updated weights for policy 1, policy_version 663773 (0.0007) [2023-12-28 00:00:02,303][106226] Updated weights for policy 0, policy_version 662008 (0.0009) [2023-12-28 00:00:02,333][106225] Updated weights for policy 1, policy_version 663783 (0.0007) [2023-12-28 00:00:03,044][106226] Updated weights for policy 0, policy_version 662018 (0.0008) [2023-12-28 00:00:03,082][106225] Updated weights for policy 1, policy_version 663793 (0.0007) [2023-12-28 00:00:03,102][106226] Updated weights for policy 0, policy_version 662028 (0.0007) [2023-12-28 00:00:03,145][106225] Updated weights for policy 1, policy_version 663803 (0.0007) [2023-12-28 00:00:03,166][106226] Updated weights for policy 0, policy_version 662038 (0.0008) [2023-12-28 00:00:03,217][106225] Updated weights for policy 1, policy_version 663813 (0.0008) [2023-12-28 00:00:03,242][106226] Updated weights for policy 0, policy_version 662048 (0.0009) [2023-12-28 00:00:04,093][106225] Updated weights for policy 1, policy_version 663823 (0.0007) [2023-12-28 00:00:04,119][106226] Updated weights for policy 0, policy_version 662058 (0.0009) [2023-12-28 00:00:04,166][106225] Updated weights for policy 1, policy_version 663833 (0.0008) [2023-12-28 00:00:04,193][106226] Updated weights for policy 0, policy_version 662068 (0.0008) [2023-12-28 00:00:04,233][106225] Updated weights for policy 1, policy_version 663843 (0.0008) [2023-12-28 00:00:04,265][106226] Updated weights for policy 0, policy_version 662078 (0.0009) [2023-12-28 00:00:05,118][106226] Updated weights for policy 0, policy_version 662088 (0.0009) [2023-12-28 00:00:05,127][106225] Updated weights for policy 1, policy_version 663853 (0.0008) [2023-12-28 00:00:05,185][106226] Updated weights for policy 0, policy_version 662098 (0.0009) [2023-12-28 00:00:05,194][106225] Updated weights for policy 1, policy_version 663863 (0.0009) [2023-12-28 00:00:05,253][106226] Updated weights for policy 0, policy_version 662108 (0.0009) [2023-12-28 00:00:05,258][106225] Updated weights for policy 1, policy_version 663873 (0.0009) [2023-12-28 00:00:06,070][106226] Updated weights for policy 0, policy_version 662118 (0.0008) [2023-12-28 00:00:06,111][106225] Updated weights for policy 1, policy_version 663883 (0.0009) [2023-12-28 00:00:06,171][106226] Updated weights for policy 0, policy_version 662128 (0.0010) [2023-12-28 00:00:06,175][105115] Fps is (10 sec: 17203.5, 60 sec: 19251.2, 300 sec: 19549.7). Total num frames: 339533824. Throughput: 0: 9821.0, 1: 9651.0. Samples: 339551248. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:06,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-5.613')] [2023-12-28 00:00:06,177][106225] Updated weights for policy 1, policy_version 663893 (0.0008) [2023-12-28 00:00:06,242][106226] Updated weights for policy 0, policy_version 662138 (0.0011) [2023-12-28 00:00:06,249][106225] Updated weights for policy 1, policy_version 663903 (0.0008) [2023-12-28 00:00:06,995][106226] Updated weights for policy 0, policy_version 662148 (0.0009) [2023-12-28 00:00:07,047][106225] Updated weights for policy 1, policy_version 663913 (0.0007) [2023-12-28 00:00:07,067][106226] Updated weights for policy 0, policy_version 662158 (0.0011) [2023-12-28 00:00:07,112][106225] Updated weights for policy 1, policy_version 663923 (0.0008) [2023-12-28 00:00:07,134][106226] Updated weights for policy 0, policy_version 662168 (0.0010) [2023-12-28 00:00:07,182][106225] Updated weights for policy 1, policy_version 663933 (0.0006) [2023-12-28 00:00:07,246][106225] Updated weights for policy 1, policy_version 663943 (0.0008) [2023-12-28 00:00:07,918][106226] Updated weights for policy 0, policy_version 662178 (0.0011) [2023-12-28 00:00:07,989][106226] Updated weights for policy 0, policy_version 662188 (0.0010) [2023-12-28 00:00:08,023][106225] Updated weights for policy 1, policy_version 663953 (0.0009) [2023-12-28 00:00:08,058][106226] Updated weights for policy 0, policy_version 662198 (0.0011) [2023-12-28 00:00:08,096][106225] Updated weights for policy 1, policy_version 663963 (0.0012) [2023-12-28 00:00:08,121][106226] Updated weights for policy 0, policy_version 662208 (0.0008) [2023-12-28 00:00:08,161][106225] Updated weights for policy 1, policy_version 663973 (0.0009) [2023-12-28 00:00:08,925][106226] Updated weights for policy 0, policy_version 662218 (0.0008) [2023-12-28 00:00:08,969][106225] Updated weights for policy 1, policy_version 663983 (0.0008) [2023-12-28 00:00:08,984][106226] Updated weights for policy 0, policy_version 662228 (0.0007) [2023-12-28 00:00:09,031][106225] Updated weights for policy 1, policy_version 663993 (0.0009) [2023-12-28 00:00:09,042][106226] Updated weights for policy 0, policy_version 662238 (0.0008) [2023-12-28 00:00:09,095][106225] Updated weights for policy 1, policy_version 664003 (0.0009) [2023-12-28 00:00:09,924][106226] Updated weights for policy 0, policy_version 662248 (0.0008) [2023-12-28 00:00:09,999][106226] Updated weights for policy 0, policy_version 662258 (0.0007) [2023-12-28 00:00:10,069][106226] Updated weights for policy 0, policy_version 662268 (0.0008) [2023-12-28 00:00:10,071][106225] Updated weights for policy 1, policy_version 664013 (0.0009) [2023-12-28 00:00:10,138][106225] Updated weights for policy 1, policy_version 664023 (0.0009) [2023-12-28 00:00:10,207][106225] Updated weights for policy 1, policy_version 664033 (0.0007) [2023-12-28 00:00:10,867][106226] Updated weights for policy 0, policy_version 662278 (0.0008) [2023-12-28 00:00:10,936][106226] Updated weights for policy 0, policy_version 662288 (0.0009) [2023-12-28 00:00:10,974][106225] Updated weights for policy 1, policy_version 664043 (0.0007) [2023-12-28 00:00:10,999][106226] Updated weights for policy 0, policy_version 662298 (0.0009) [2023-12-28 00:00:11,063][106225] Updated weights for policy 1, policy_version 664053 (0.0008) [2023-12-28 00:00:11,133][106225] Updated weights for policy 1, policy_version 664063 (0.0009) [2023-12-28 00:00:11,175][105115] Fps is (10 sec: 17203.4, 60 sec: 19114.7, 300 sec: 19522.0). Total num frames: 339623936. Throughput: 0: 9748.1, 1: 9592.0. Samples: 339603228. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:11,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-5.340')] [2023-12-28 00:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000662304_169598976.pth... [2023-12-28 00:00:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000661200_169312256.pth [2023-12-28 00:00:11,196][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000664072_170033152.pth... [2023-12-28 00:00:11,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000662984_169754624.pth [2023-12-28 00:00:11,904][106226] Updated weights for policy 0, policy_version 662308 (0.0009) [2023-12-28 00:00:11,937][106225] Updated weights for policy 1, policy_version 664073 (0.0009) [2023-12-28 00:00:11,972][106226] Updated weights for policy 0, policy_version 662318 (0.0008) [2023-12-28 00:00:12,006][106225] Updated weights for policy 1, policy_version 664083 (0.0010) [2023-12-28 00:00:12,044][106226] Updated weights for policy 0, policy_version 662328 (0.0009) [2023-12-28 00:00:12,077][106225] Updated weights for policy 1, policy_version 664093 (0.0009) [2023-12-28 00:00:12,140][106225] Updated weights for policy 1, policy_version 664103 (0.0008) [2023-12-28 00:00:12,890][106226] Updated weights for policy 0, policy_version 662338 (0.0007) [2023-12-28 00:00:12,960][106226] Updated weights for policy 0, policy_version 662348 (0.0006) [2023-12-28 00:00:12,968][106225] Updated weights for policy 1, policy_version 664113 (0.0009) [2023-12-28 00:00:13,022][106226] Updated weights for policy 0, policy_version 662358 (0.0006) [2023-12-28 00:00:13,031][106225] Updated weights for policy 1, policy_version 664123 (0.0009) [2023-12-28 00:00:13,086][106226] Updated weights for policy 0, policy_version 662368 (0.0007) [2023-12-28 00:00:13,089][106225] Updated weights for policy 1, policy_version 664133 (0.0007) [2023-12-28 00:00:13,848][106226] Updated weights for policy 0, policy_version 662378 (0.0009) [2023-12-28 00:00:13,868][106225] Updated weights for policy 1, policy_version 664143 (0.0008) [2023-12-28 00:00:13,924][106225] Updated weights for policy 1, policy_version 664153 (0.0006) [2023-12-28 00:00:13,925][106226] Updated weights for policy 0, policy_version 662388 (0.0008) [2023-12-28 00:00:13,980][106225] Updated weights for policy 1, policy_version 664163 (0.0007) [2023-12-28 00:00:14,001][106226] Updated weights for policy 0, policy_version 662398 (0.0009) [2023-12-28 00:00:14,723][106226] Updated weights for policy 0, policy_version 662408 (0.0007) [2023-12-28 00:00:14,730][106225] Updated weights for policy 1, policy_version 664173 (0.0008) [2023-12-28 00:00:14,799][106226] Updated weights for policy 0, policy_version 662418 (0.0008) [2023-12-28 00:00:14,815][106225] Updated weights for policy 1, policy_version 664183 (0.0009) [2023-12-28 00:00:14,859][106226] Updated weights for policy 0, policy_version 662428 (0.0008) [2023-12-28 00:00:14,886][106225] Updated weights for policy 1, policy_version 664193 (0.0011) [2023-12-28 00:00:15,581][106226] Updated weights for policy 0, policy_version 662438 (0.0008) [2023-12-28 00:00:15,647][106226] Updated weights for policy 0, policy_version 662448 (0.0008) [2023-12-28 00:00:15,662][106225] Updated weights for policy 1, policy_version 664203 (0.0009) [2023-12-28 00:00:15,703][106226] Updated weights for policy 0, policy_version 662458 (0.0007) [2023-12-28 00:00:15,722][106225] Updated weights for policy 1, policy_version 664213 (0.0007) [2023-12-28 00:00:15,791][106225] Updated weights for policy 1, policy_version 664223 (0.0008) [2023-12-28 00:00:16,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19114.7, 300 sec: 19494.2). Total num frames: 339714048. Throughput: 0: 9545.2, 1: 9348.4. Samples: 339705320. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:16,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-5.459')] [2023-12-28 00:00:16,314][106226] Updated weights for policy 0, policy_version 662468 (0.0007) [2023-12-28 00:00:16,379][106226] Updated weights for policy 0, policy_version 662478 (0.0009) [2023-12-28 00:00:16,443][106226] Updated weights for policy 0, policy_version 662488 (0.0009) [2023-12-28 00:00:16,579][106225] Updated weights for policy 1, policy_version 664233 (0.0009) [2023-12-28 00:00:16,635][106225] Updated weights for policy 1, policy_version 664243 (0.0009) [2023-12-28 00:00:16,701][106225] Updated weights for policy 1, policy_version 664253 (0.0009) [2023-12-28 00:00:16,769][106225] Updated weights for policy 1, policy_version 664263 (0.0009) [2023-12-28 00:00:17,187][106226] Updated weights for policy 0, policy_version 662498 (0.0009) [2023-12-28 00:00:17,241][106226] Updated weights for policy 0, policy_version 662508 (0.0008) [2023-12-28 00:00:17,299][106226] Updated weights for policy 0, policy_version 662518 (0.0008) [2023-12-28 00:00:17,358][106226] Updated weights for policy 0, policy_version 662528 (0.0006) [2023-12-28 00:00:17,509][106225] Updated weights for policy 1, policy_version 664273 (0.0008) [2023-12-28 00:00:17,562][106225] Updated weights for policy 1, policy_version 664283 (0.0009) [2023-12-28 00:00:17,623][106225] Updated weights for policy 1, policy_version 664293 (0.0009) [2023-12-28 00:00:18,061][106226] Updated weights for policy 0, policy_version 662538 (0.0008) [2023-12-28 00:00:18,125][106226] Updated weights for policy 0, policy_version 662548 (0.0010) [2023-12-28 00:00:18,185][106226] Updated weights for policy 0, policy_version 662558 (0.0008) [2023-12-28 00:00:18,414][106225] Updated weights for policy 1, policy_version 664303 (0.0008) [2023-12-28 00:00:18,481][106225] Updated weights for policy 1, policy_version 664313 (0.0008) [2023-12-28 00:00:18,544][106225] Updated weights for policy 1, policy_version 664323 (0.0008) [2023-12-28 00:00:19,016][106226] Updated weights for policy 0, policy_version 662568 (0.0008) [2023-12-28 00:00:19,078][106226] Updated weights for policy 0, policy_version 662578 (0.0008) [2023-12-28 00:00:19,127][106226] Updated weights for policy 0, policy_version 662588 (0.0009) [2023-12-28 00:00:19,298][106225] Updated weights for policy 1, policy_version 664333 (0.0008) [2023-12-28 00:00:19,379][106225] Updated weights for policy 1, policy_version 664343 (0.0008) [2023-12-28 00:00:19,444][106225] Updated weights for policy 1, policy_version 664353 (0.0008) [2023-12-28 00:00:19,974][106226] Updated weights for policy 0, policy_version 662598 (0.0009) [2023-12-28 00:00:20,050][106226] Updated weights for policy 0, policy_version 662608 (0.0009) [2023-12-28 00:00:20,122][106226] Updated weights for policy 0, policy_version 662618 (0.0009) [2023-12-28 00:00:20,256][106225] Updated weights for policy 1, policy_version 664363 (0.0008) [2023-12-28 00:00:20,317][106225] Updated weights for policy 1, policy_version 664373 (0.0006) [2023-12-28 00:00:20,374][106225] Updated weights for policy 1, policy_version 664383 (0.0009) [2023-12-28 00:00:21,003][106226] Updated weights for policy 0, policy_version 662628 (0.0010) [2023-12-28 00:00:21,074][106226] Updated weights for policy 0, policy_version 662638 (0.0009) [2023-12-28 00:00:21,146][106226] Updated weights for policy 0, policy_version 662648 (0.0009) [2023-12-28 00:00:21,175][105115] Fps is (10 sec: 17203.1, 60 sec: 18841.6, 300 sec: 19438.6). Total num frames: 339795968. Throughput: 0: 9454.8, 1: 9178.3. Samples: 339812716. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:21,175][105115] Avg episode reward: [(0, '-4.243'), (1, '-5.432')] [2023-12-28 00:00:21,236][106225] Updated weights for policy 1, policy_version 664393 (0.0008) [2023-12-28 00:00:21,310][106225] Updated weights for policy 1, policy_version 664403 (0.0009) [2023-12-28 00:00:21,390][106225] Updated weights for policy 1, policy_version 664413 (0.0009) [2023-12-28 00:00:21,459][106225] Updated weights for policy 1, policy_version 664423 (0.0009) [2023-12-28 00:00:21,968][106226] Updated weights for policy 0, policy_version 662658 (0.0009) [2023-12-28 00:00:22,036][106226] Updated weights for policy 0, policy_version 662668 (0.0011) [2023-12-28 00:00:22,105][106226] Updated weights for policy 0, policy_version 662678 (0.0010) [2023-12-28 00:00:22,181][106226] Updated weights for policy 0, policy_version 662688 (0.0010) [2023-12-28 00:00:22,257][106225] Updated weights for policy 1, policy_version 664433 (0.0010) [2023-12-28 00:00:22,325][106225] Updated weights for policy 1, policy_version 664443 (0.0010) [2023-12-28 00:00:22,395][106225] Updated weights for policy 1, policy_version 664453 (0.0008) [2023-12-28 00:00:22,999][106226] Updated weights for policy 0, policy_version 662698 (0.0009) [2023-12-28 00:00:23,074][106226] Updated weights for policy 0, policy_version 662708 (0.0009) [2023-12-28 00:00:23,145][106226] Updated weights for policy 0, policy_version 662718 (0.0009) [2023-12-28 00:00:23,202][106225] Updated weights for policy 1, policy_version 664463 (0.0007) [2023-12-28 00:00:23,268][106225] Updated weights for policy 1, policy_version 664473 (0.0009) [2023-12-28 00:00:23,330][106225] Updated weights for policy 1, policy_version 664483 (0.0008) [2023-12-28 00:00:23,817][106226] Updated weights for policy 0, policy_version 662728 (0.0007) [2023-12-28 00:00:23,883][106226] Updated weights for policy 0, policy_version 662738 (0.0006) [2023-12-28 00:00:23,939][106226] Updated weights for policy 0, policy_version 662748 (0.0008) [2023-12-28 00:00:24,136][106225] Updated weights for policy 1, policy_version 664493 (0.0009) [2023-12-28 00:00:24,194][106225] Updated weights for policy 1, policy_version 664503 (0.0007) [2023-12-28 00:00:24,261][106225] Updated weights for policy 1, policy_version 664513 (0.0007) [2023-12-28 00:00:24,597][106226] Updated weights for policy 0, policy_version 662758 (0.0009) [2023-12-28 00:00:24,669][106226] Updated weights for policy 0, policy_version 662768 (0.0006) [2023-12-28 00:00:24,739][106226] Updated weights for policy 0, policy_version 662778 (0.0006) [2023-12-28 00:00:25,040][106225] Updated weights for policy 1, policy_version 664523 (0.0008) [2023-12-28 00:00:25,106][106225] Updated weights for policy 1, policy_version 664533 (0.0009) [2023-12-28 00:00:25,169][106225] Updated weights for policy 1, policy_version 664543 (0.0009) [2023-12-28 00:00:25,397][106226] Updated weights for policy 0, policy_version 662788 (0.0011) [2023-12-28 00:00:25,460][106226] Updated weights for policy 0, policy_version 662798 (0.0011) [2023-12-28 00:00:25,525][106226] Updated weights for policy 0, policy_version 662808 (0.0008) [2023-12-28 00:00:25,875][106225] Updated weights for policy 1, policy_version 664553 (0.0008) [2023-12-28 00:00:25,932][106225] Updated weights for policy 1, policy_version 664563 (0.0006) [2023-12-28 00:00:25,997][106225] Updated weights for policy 1, policy_version 664573 (0.0006) [2023-12-28 00:00:26,056][106225] Updated weights for policy 1, policy_version 664583 (0.0008) [2023-12-28 00:00:26,175][105115] Fps is (10 sec: 18022.2, 60 sec: 18841.6, 300 sec: 19438.6). Total num frames: 339894272. Throughput: 0: 9380.5, 1: 9116.4. Samples: 339864512. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:26,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.419')] [2023-12-28 00:00:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000664584_170164224.pth... [2023-12-28 00:00:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000662816_169730048.pth... [2023-12-28 00:00:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000663560_169902080.pth [2023-12-28 00:00:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000661792_169467904.pth [2023-12-28 00:00:26,227][106226] Updated weights for policy 0, policy_version 662818 (0.0009) [2023-12-28 00:00:26,286][106226] Updated weights for policy 0, policy_version 662828 (0.0011) [2023-12-28 00:00:26,349][106226] Updated weights for policy 0, policy_version 662838 (0.0011) [2023-12-28 00:00:26,412][106226] Updated weights for policy 0, policy_version 662848 (0.0011) [2023-12-28 00:00:26,719][106225] Updated weights for policy 1, policy_version 664593 (0.0008) [2023-12-28 00:00:26,780][106225] Updated weights for policy 1, policy_version 664603 (0.0007) [2023-12-28 00:00:26,835][106225] Updated weights for policy 1, policy_version 664613 (0.0006) [2023-12-28 00:00:27,134][106226] Updated weights for policy 0, policy_version 662858 (0.0011) [2023-12-28 00:00:27,194][106226] Updated weights for policy 0, policy_version 662868 (0.0008) [2023-12-28 00:00:27,251][106226] Updated weights for policy 0, policy_version 662878 (0.0009) [2023-12-28 00:00:27,520][106225] Updated weights for policy 1, policy_version 664623 (0.0007) [2023-12-28 00:00:27,576][106225] Updated weights for policy 1, policy_version 664633 (0.0005) [2023-12-28 00:00:27,639][106225] Updated weights for policy 1, policy_version 664643 (0.0006) [2023-12-28 00:00:28,000][106226] Updated weights for policy 0, policy_version 662888 (0.0010) [2023-12-28 00:00:28,058][106226] Updated weights for policy 0, policy_version 662898 (0.0011) [2023-12-28 00:00:28,120][106226] Updated weights for policy 0, policy_version 662908 (0.0006) [2023-12-28 00:00:28,304][106225] Updated weights for policy 1, policy_version 664653 (0.0007) [2023-12-28 00:00:28,370][106225] Updated weights for policy 1, policy_version 664663 (0.0008) [2023-12-28 00:00:28,433][106225] Updated weights for policy 1, policy_version 664673 (0.0008) [2023-12-28 00:00:28,900][106226] Updated weights for policy 0, policy_version 662918 (0.0010) [2023-12-28 00:00:28,969][106226] Updated weights for policy 0, policy_version 662928 (0.0011) [2023-12-28 00:00:29,029][106226] Updated weights for policy 0, policy_version 662938 (0.0010) [2023-12-28 00:00:29,141][106225] Updated weights for policy 1, policy_version 664683 (0.0007) [2023-12-28 00:00:29,207][106225] Updated weights for policy 1, policy_version 664693 (0.0007) [2023-12-28 00:00:29,280][106225] Updated weights for policy 1, policy_version 664703 (0.0009) [2023-12-28 00:00:29,809][106226] Updated weights for policy 0, policy_version 662948 (0.0010) [2023-12-28 00:00:29,875][106226] Updated weights for policy 0, policy_version 662958 (0.0007) [2023-12-28 00:00:29,947][106226] Updated weights for policy 0, policy_version 662968 (0.0009) [2023-12-28 00:00:30,043][106225] Updated weights for policy 1, policy_version 664713 (0.0009) [2023-12-28 00:00:30,099][106225] Updated weights for policy 1, policy_version 664723 (0.0006) [2023-12-28 00:00:30,161][106225] Updated weights for policy 1, policy_version 664733 (0.0008) [2023-12-28 00:00:30,228][106225] Updated weights for policy 1, policy_version 664743 (0.0009) [2023-12-28 00:00:30,660][106226] Updated weights for policy 0, policy_version 662978 (0.0007) [2023-12-28 00:00:30,716][106226] Updated weights for policy 0, policy_version 662988 (0.0009) [2023-12-28 00:00:30,774][106226] Updated weights for policy 0, policy_version 662998 (0.0010) [2023-12-28 00:00:30,828][106226] Updated weights for policy 0, policy_version 663008 (0.0009) [2023-12-28 00:00:30,920][106225] Updated weights for policy 1, policy_version 664753 (0.0009) [2023-12-28 00:00:30,980][106225] Updated weights for policy 1, policy_version 664763 (0.0008) [2023-12-28 00:00:31,051][106225] Updated weights for policy 1, policy_version 664773 (0.0009) [2023-12-28 00:00:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 18705.1, 300 sec: 19438.6). Total num frames: 339992576. Throughput: 0: 9303.4, 1: 9131.7. Samples: 339979560. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:31,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-5.551')] [2023-12-28 00:00:31,597][106226] Updated weights for policy 0, policy_version 663018 (0.0009) [2023-12-28 00:00:31,671][106226] Updated weights for policy 0, policy_version 663028 (0.0009) [2023-12-28 00:00:31,745][106226] Updated weights for policy 0, policy_version 663038 (0.0009) [2023-12-28 00:00:31,842][106225] Updated weights for policy 1, policy_version 664783 (0.0008) [2023-12-28 00:00:31,897][106225] Updated weights for policy 1, policy_version 664793 (0.0006) [2023-12-28 00:00:31,964][106225] Updated weights for policy 1, policy_version 664803 (0.0006) [2023-12-28 00:00:32,538][106226] Updated weights for policy 0, policy_version 663048 (0.0008) [2023-12-28 00:00:32,603][106226] Updated weights for policy 0, policy_version 663058 (0.0007) [2023-12-28 00:00:32,667][106226] Updated weights for policy 0, policy_version 663068 (0.0007) [2023-12-28 00:00:32,675][106225] Updated weights for policy 1, policy_version 664813 (0.0007) [2023-12-28 00:00:32,724][106225] Updated weights for policy 1, policy_version 664823 (0.0008) [2023-12-28 00:00:32,784][106225] Updated weights for policy 1, policy_version 664833 (0.0007) [2023-12-28 00:00:33,346][106226] Updated weights for policy 0, policy_version 663078 (0.0007) [2023-12-28 00:00:33,415][106226] Updated weights for policy 0, policy_version 663088 (0.0008) [2023-12-28 00:00:33,416][106225] Updated weights for policy 1, policy_version 664843 (0.0008) [2023-12-28 00:00:33,465][106225] Updated weights for policy 1, policy_version 664853 (0.0006) [2023-12-28 00:00:33,483][106226] Updated weights for policy 0, policy_version 663098 (0.0007) [2023-12-28 00:00:33,517][106225] Updated weights for policy 1, policy_version 664863 (0.0006) [2023-12-28 00:00:34,116][106226] Updated weights for policy 0, policy_version 663108 (0.0006) [2023-12-28 00:00:34,187][106226] Updated weights for policy 0, policy_version 663118 (0.0008) [2023-12-28 00:00:34,253][106226] Updated weights for policy 0, policy_version 663128 (0.0009) [2023-12-28 00:00:34,295][106225] Updated weights for policy 1, policy_version 664873 (0.0008) [2023-12-28 00:00:34,360][106225] Updated weights for policy 1, policy_version 664883 (0.0009) [2023-12-28 00:00:34,423][106225] Updated weights for policy 1, policy_version 664893 (0.0008) [2023-12-28 00:00:34,488][106225] Updated weights for policy 1, policy_version 664903 (0.0007) [2023-12-28 00:00:34,998][106226] Updated weights for policy 0, policy_version 663138 (0.0008) [2023-12-28 00:00:35,056][106226] Updated weights for policy 0, policy_version 663148 (0.0006) [2023-12-28 00:00:35,117][106226] Updated weights for policy 0, policy_version 663158 (0.0008) [2023-12-28 00:00:35,178][106226] Updated weights for policy 0, policy_version 663168 (0.0007) [2023-12-28 00:00:35,186][106225] Updated weights for policy 1, policy_version 664913 (0.0006) [2023-12-28 00:00:35,245][106225] Updated weights for policy 1, policy_version 664923 (0.0008) [2023-12-28 00:00:35,308][106225] Updated weights for policy 1, policy_version 664933 (0.0008) [2023-12-28 00:00:35,887][106226] Updated weights for policy 0, policy_version 663178 (0.0009) [2023-12-28 00:00:35,948][106226] Updated weights for policy 0, policy_version 663188 (0.0009) [2023-12-28 00:00:36,015][106226] Updated weights for policy 0, policy_version 663198 (0.0007) [2023-12-28 00:00:36,047][106225] Updated weights for policy 1, policy_version 664943 (0.0009) [2023-12-28 00:00:36,117][106225] Updated weights for policy 1, policy_version 664953 (0.0009) [2023-12-28 00:00:36,174][105115] Fps is (10 sec: 18841.9, 60 sec: 18568.5, 300 sec: 19410.9). Total num frames: 340082688. Throughput: 0: 9134.9, 1: 9108.3. Samples: 340093824. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:36,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.366')] [2023-12-28 00:00:36,187][106225] Updated weights for policy 1, policy_version 664963 (0.0007) [2023-12-28 00:00:36,793][106226] Updated weights for policy 0, policy_version 663208 (0.0008) [2023-12-28 00:00:36,858][106226] Updated weights for policy 0, policy_version 663218 (0.0009) [2023-12-28 00:00:36,920][106225] Updated weights for policy 1, policy_version 664973 (0.0007) [2023-12-28 00:00:36,921][106226] Updated weights for policy 0, policy_version 663228 (0.0008) [2023-12-28 00:00:36,972][106225] Updated weights for policy 1, policy_version 664983 (0.0006) [2023-12-28 00:00:37,047][106225] Updated weights for policy 1, policy_version 664993 (0.0008) [2023-12-28 00:00:37,724][106226] Updated weights for policy 0, policy_version 663238 (0.0007) [2023-12-28 00:00:37,789][106226] Updated weights for policy 0, policy_version 663248 (0.0009) [2023-12-28 00:00:37,804][106225] Updated weights for policy 1, policy_version 665003 (0.0008) [2023-12-28 00:00:37,855][106226] Updated weights for policy 0, policy_version 663258 (0.0007) [2023-12-28 00:00:37,865][106225] Updated weights for policy 1, policy_version 665013 (0.0006) [2023-12-28 00:00:37,924][106225] Updated weights for policy 1, policy_version 665023 (0.0009) [2023-12-28 00:00:38,680][106226] Updated weights for policy 0, policy_version 663268 (0.0009) [2023-12-28 00:00:38,737][106225] Updated weights for policy 1, policy_version 665033 (0.0009) [2023-12-28 00:00:38,743][106226] Updated weights for policy 0, policy_version 663278 (0.0009) [2023-12-28 00:00:38,792][106225] Updated weights for policy 1, policy_version 665043 (0.0007) [2023-12-28 00:00:38,809][106226] Updated weights for policy 0, policy_version 663288 (0.0006) [2023-12-28 00:00:38,854][106225] Updated weights for policy 1, policy_version 665053 (0.0008) [2023-12-28 00:00:38,915][106225] Updated weights for policy 1, policy_version 665063 (0.0008) [2023-12-28 00:00:39,588][106226] Updated weights for policy 0, policy_version 663298 (0.0008) [2023-12-28 00:00:39,652][106226] Updated weights for policy 0, policy_version 663308 (0.0008) [2023-12-28 00:00:39,684][106225] Updated weights for policy 1, policy_version 665073 (0.0011) [2023-12-28 00:00:39,723][106226] Updated weights for policy 0, policy_version 663318 (0.0010) [2023-12-28 00:00:39,753][106225] Updated weights for policy 1, policy_version 665083 (0.0009) [2023-12-28 00:00:39,790][106226] Updated weights for policy 0, policy_version 663328 (0.0008) [2023-12-28 00:00:39,826][106225] Updated weights for policy 1, policy_version 665093 (0.0009) [2023-12-28 00:00:40,612][106225] Updated weights for policy 1, policy_version 665103 (0.0008) [2023-12-28 00:00:40,633][106226] Updated weights for policy 0, policy_version 663338 (0.0009) [2023-12-28 00:00:40,678][106225] Updated weights for policy 1, policy_version 665113 (0.0007) [2023-12-28 00:00:40,690][106226] Updated weights for policy 0, policy_version 663348 (0.0009) [2023-12-28 00:00:40,732][106225] Updated weights for policy 1, policy_version 665123 (0.0007) [2023-12-28 00:00:40,751][106226] Updated weights for policy 0, policy_version 663358 (0.0009) [2023-12-28 00:00:41,175][105115] Fps is (10 sec: 18022.1, 60 sec: 18568.5, 300 sec: 19383.1). Total num frames: 340172800. Throughput: 0: 9068.7, 1: 9086.9. Samples: 340147760. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:41,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.613')] [2023-12-28 00:00:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000663360_169869312.pth... [2023-12-28 00:00:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000665128_170303488.pth... [2023-12-28 00:00:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000662304_169598976.pth [2023-12-28 00:00:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000664072_170033152.pth [2023-12-28 00:00:41,543][106225] Updated weights for policy 1, policy_version 665133 (0.0008) [2023-12-28 00:00:41,615][106225] Updated weights for policy 1, policy_version 665143 (0.0008) [2023-12-28 00:00:41,646][106226] Updated weights for policy 0, policy_version 663368 (0.0009) [2023-12-28 00:00:41,684][106225] Updated weights for policy 1, policy_version 665153 (0.0008) [2023-12-28 00:00:41,718][106226] Updated weights for policy 0, policy_version 663378 (0.0006) [2023-12-28 00:00:41,791][106226] Updated weights for policy 0, policy_version 663388 (0.0008) [2023-12-28 00:00:42,491][106225] Updated weights for policy 1, policy_version 665163 (0.0009) [2023-12-28 00:00:42,555][106225] Updated weights for policy 1, policy_version 665173 (0.0009) [2023-12-28 00:00:42,570][106226] Updated weights for policy 0, policy_version 663398 (0.0007) [2023-12-28 00:00:42,613][106225] Updated weights for policy 1, policy_version 665183 (0.0007) [2023-12-28 00:00:42,635][106226] Updated weights for policy 0, policy_version 663408 (0.0008) [2023-12-28 00:00:42,702][106226] Updated weights for policy 0, policy_version 663418 (0.0008) [2023-12-28 00:00:43,383][106225] Updated weights for policy 1, policy_version 665193 (0.0006) [2023-12-28 00:00:43,443][106226] Updated weights for policy 0, policy_version 663428 (0.0008) [2023-12-28 00:00:43,444][106225] Updated weights for policy 1, policy_version 665203 (0.0008) [2023-12-28 00:00:43,497][106225] Updated weights for policy 1, policy_version 665213 (0.0007) [2023-12-28 00:00:43,502][106226] Updated weights for policy 0, policy_version 663438 (0.0007) [2023-12-28 00:00:43,555][106226] Updated weights for policy 0, policy_version 663448 (0.0006) [2023-12-28 00:00:43,561][106225] Updated weights for policy 1, policy_version 665223 (0.0008) [2023-12-28 00:00:44,283][106225] Updated weights for policy 1, policy_version 665233 (0.0009) [2023-12-28 00:00:44,303][106226] Updated weights for policy 0, policy_version 663458 (0.0008) [2023-12-28 00:00:44,344][106225] Updated weights for policy 1, policy_version 665243 (0.0010) [2023-12-28 00:00:44,366][106226] Updated weights for policy 0, policy_version 663468 (0.0008) [2023-12-28 00:00:44,404][106225] Updated weights for policy 1, policy_version 665253 (0.0006) [2023-12-28 00:00:44,430][106226] Updated weights for policy 0, policy_version 663478 (0.0008) [2023-12-28 00:00:44,491][106226] Updated weights for policy 0, policy_version 663488 (0.0009) [2023-12-28 00:00:45,182][106225] Updated weights for policy 1, policy_version 665263 (0.0008) [2023-12-28 00:00:45,248][106225] Updated weights for policy 1, policy_version 665273 (0.0009) [2023-12-28 00:00:45,263][106226] Updated weights for policy 0, policy_version 663498 (0.0007) [2023-12-28 00:00:45,315][106225] Updated weights for policy 1, policy_version 665283 (0.0008) [2023-12-28 00:00:45,332][106226] Updated weights for policy 0, policy_version 663508 (0.0008) [2023-12-28 00:00:45,399][106226] Updated weights for policy 0, policy_version 663518 (0.0007) [2023-12-28 00:00:46,024][106225] Updated weights for policy 1, policy_version 665293 (0.0007) [2023-12-28 00:00:46,081][106225] Updated weights for policy 1, policy_version 665303 (0.0006) [2023-12-28 00:00:46,126][106226] Updated weights for policy 0, policy_version 663528 (0.0011) [2023-12-28 00:00:46,142][106225] Updated weights for policy 1, policy_version 665313 (0.0007) [2023-12-28 00:00:46,174][105115] Fps is (10 sec: 17203.2, 60 sec: 18158.9, 300 sec: 19355.3). Total num frames: 340254720. Throughput: 0: 8932.8, 1: 8950.3. Samples: 340253396. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:46,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.707')] [2023-12-28 00:00:46,180][106226] Updated weights for policy 0, policy_version 663538 (0.0010) [2023-12-28 00:00:46,243][106226] Updated weights for policy 0, policy_version 663548 (0.0010) [2023-12-28 00:00:46,837][106225] Updated weights for policy 1, policy_version 665323 (0.0008) [2023-12-28 00:00:46,896][106225] Updated weights for policy 1, policy_version 665333 (0.0010) [2023-12-28 00:00:46,959][106225] Updated weights for policy 1, policy_version 665343 (0.0011) [2023-12-28 00:00:46,992][106226] Updated weights for policy 0, policy_version 663558 (0.0010) [2023-12-28 00:00:47,053][106226] Updated weights for policy 0, policy_version 663568 (0.0007) [2023-12-28 00:00:47,122][106226] Updated weights for policy 0, policy_version 663578 (0.0008) [2023-12-28 00:00:47,722][106225] Updated weights for policy 1, policy_version 665353 (0.0010) [2023-12-28 00:00:47,790][106225] Updated weights for policy 1, policy_version 665363 (0.0009) [2023-12-28 00:00:47,855][106225] Updated weights for policy 1, policy_version 665373 (0.0009) [2023-12-28 00:00:47,900][106226] Updated weights for policy 0, policy_version 663588 (0.0008) [2023-12-28 00:00:47,912][106225] Updated weights for policy 1, policy_version 665383 (0.0007) [2023-12-28 00:00:47,963][106226] Updated weights for policy 0, policy_version 663598 (0.0007) [2023-12-28 00:00:48,029][106226] Updated weights for policy 0, policy_version 663608 (0.0008) [2023-12-28 00:00:48,730][106225] Updated weights for policy 1, policy_version 665393 (0.0009) [2023-12-28 00:00:48,785][106226] Updated weights for policy 0, policy_version 663618 (0.0008) [2023-12-28 00:00:48,795][106225] Updated weights for policy 1, policy_version 665403 (0.0008) [2023-12-28 00:00:48,854][106226] Updated weights for policy 0, policy_version 663628 (0.0006) [2023-12-28 00:00:48,863][106225] Updated weights for policy 1, policy_version 665413 (0.0008) [2023-12-28 00:00:48,920][106226] Updated weights for policy 0, policy_version 663638 (0.0008) [2023-12-28 00:00:49,681][106226] Updated weights for policy 0, policy_version 663649 (0.0010) [2023-12-28 00:00:49,709][106225] Updated weights for policy 1, policy_version 665423 (0.0008) [2023-12-28 00:00:49,749][106226] Updated weights for policy 0, policy_version 663659 (0.0009) [2023-12-28 00:00:49,773][106225] Updated weights for policy 1, policy_version 665433 (0.0009) [2023-12-28 00:00:49,810][106226] Updated weights for policy 0, policy_version 663669 (0.0008) [2023-12-28 00:00:49,844][106225] Updated weights for policy 1, policy_version 665443 (0.0008) [2023-12-28 00:00:49,913][106226] Updated weights for policy 0, policy_version 663679 (0.0008) [2023-12-28 00:00:50,642][106225] Updated weights for policy 1, policy_version 665453 (0.0010) [2023-12-28 00:00:50,671][106226] Updated weights for policy 0, policy_version 663689 (0.0008) [2023-12-28 00:00:50,708][106225] Updated weights for policy 1, policy_version 665463 (0.0007) [2023-12-28 00:00:50,745][106226] Updated weights for policy 0, policy_version 663699 (0.0008) [2023-12-28 00:00:50,781][106225] Updated weights for policy 1, policy_version 665473 (0.0008) [2023-12-28 00:00:50,814][106226] Updated weights for policy 0, policy_version 663709 (0.0009) [2023-12-28 00:00:51,175][105115] Fps is (10 sec: 18022.6, 60 sec: 18158.9, 300 sec: 19327.6). Total num frames: 340353024. Throughput: 0: 8998.4, 1: 8995.2. Samples: 340360960. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:51,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.616')] [2023-12-28 00:00:51,636][106226] Updated weights for policy 0, policy_version 663719 (0.0009) [2023-12-28 00:00:51,686][106225] Updated weights for policy 1, policy_version 665483 (0.0009) [2023-12-28 00:00:51,719][106226] Updated weights for policy 0, policy_version 663729 (0.0008) [2023-12-28 00:00:51,767][106225] Updated weights for policy 1, policy_version 665493 (0.0008) [2023-12-28 00:00:51,799][106226] Updated weights for policy 0, policy_version 663739 (0.0008) [2023-12-28 00:00:51,846][106225] Updated weights for policy 1, policy_version 665503 (0.0009) [2023-12-28 00:00:52,655][106226] Updated weights for policy 0, policy_version 663749 (0.0008) [2023-12-28 00:00:52,725][106226] Updated weights for policy 0, policy_version 663759 (0.0008) [2023-12-28 00:00:52,726][106225] Updated weights for policy 1, policy_version 665513 (0.0008) [2023-12-28 00:00:52,796][106226] Updated weights for policy 0, policy_version 663769 (0.0008) [2023-12-28 00:00:52,798][106225] Updated weights for policy 1, policy_version 665523 (0.0008) [2023-12-28 00:00:52,870][106225] Updated weights for policy 1, policy_version 665533 (0.0008) [2023-12-28 00:00:52,944][106225] Updated weights for policy 1, policy_version 665543 (0.0008) [2023-12-28 00:00:53,642][106226] Updated weights for policy 0, policy_version 663779 (0.0008) [2023-12-28 00:00:53,705][106226] Updated weights for policy 0, policy_version 663789 (0.0009) [2023-12-28 00:00:53,743][106225] Updated weights for policy 1, policy_version 665553 (0.0007) [2023-12-28 00:00:53,771][106226] Updated weights for policy 0, policy_version 663799 (0.0008) [2023-12-28 00:00:53,808][106225] Updated weights for policy 1, policy_version 665563 (0.0007) [2023-12-28 00:00:53,874][106225] Updated weights for policy 1, policy_version 665573 (0.0008) [2023-12-28 00:00:54,530][106226] Updated weights for policy 0, policy_version 663809 (0.0009) [2023-12-28 00:00:54,591][106225] Updated weights for policy 1, policy_version 665583 (0.0007) [2023-12-28 00:00:54,591][106226] Updated weights for policy 0, policy_version 663819 (0.0008) [2023-12-28 00:00:54,651][106225] Updated weights for policy 1, policy_version 665593 (0.0008) [2023-12-28 00:00:54,656][106226] Updated weights for policy 0, policy_version 663829 (0.0009) [2023-12-28 00:00:54,716][106225] Updated weights for policy 1, policy_version 665603 (0.0010) [2023-12-28 00:00:54,721][106226] Updated weights for policy 0, policy_version 663839 (0.0009) [2023-12-28 00:00:55,454][106226] Updated weights for policy 0, policy_version 663849 (0.0009) [2023-12-28 00:00:55,466][106225] Updated weights for policy 1, policy_version 665613 (0.0010) [2023-12-28 00:00:55,515][106226] Updated weights for policy 0, policy_version 663859 (0.0009) [2023-12-28 00:00:55,538][106225] Updated weights for policy 1, policy_version 665623 (0.0011) [2023-12-28 00:00:55,580][106226] Updated weights for policy 0, policy_version 663869 (0.0006) [2023-12-28 00:00:55,605][106225] Updated weights for policy 1, policy_version 665633 (0.0011) [2023-12-28 00:00:56,175][105115] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 19299.8). Total num frames: 340434944. Throughput: 0: 8973.8, 1: 8961.8. Samples: 340410332. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:00:56,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-5.608')] [2023-12-28 00:00:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000665640_170434560.pth... [2023-12-28 00:00:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000663872_170000384.pth... [2023-12-28 00:00:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000664584_170164224.pth [2023-12-28 00:00:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000662816_169730048.pth [2023-12-28 00:00:56,324][106226] Updated weights for policy 0, policy_version 663879 (0.0008) [2023-12-28 00:00:56,342][106225] Updated weights for policy 1, policy_version 665643 (0.0011) [2023-12-28 00:00:56,383][106226] Updated weights for policy 0, policy_version 663889 (0.0005) [2023-12-28 00:00:56,397][106225] Updated weights for policy 1, policy_version 665653 (0.0010) [2023-12-28 00:00:56,447][106226] Updated weights for policy 0, policy_version 663899 (0.0008) [2023-12-28 00:00:56,460][106225] Updated weights for policy 1, policy_version 665663 (0.0011) [2023-12-28 00:00:57,143][106225] Updated weights for policy 1, policy_version 665673 (0.0010) [2023-12-28 00:00:57,210][106225] Updated weights for policy 1, policy_version 665683 (0.0006) [2023-12-28 00:00:57,266][106226] Updated weights for policy 0, policy_version 663909 (0.0008) [2023-12-28 00:00:57,277][106225] Updated weights for policy 1, policy_version 665693 (0.0009) [2023-12-28 00:00:57,331][106226] Updated weights for policy 0, policy_version 663919 (0.0008) [2023-12-28 00:00:57,342][106225] Updated weights for policy 1, policy_version 665703 (0.0011) [2023-12-28 00:00:57,393][106226] Updated weights for policy 0, policy_version 663929 (0.0008) [2023-12-28 00:00:58,038][106225] Updated weights for policy 1, policy_version 665713 (0.0007) [2023-12-28 00:00:58,098][106225] Updated weights for policy 1, policy_version 665723 (0.0007) [2023-12-28 00:00:58,117][106226] Updated weights for policy 0, policy_version 663939 (0.0008) [2023-12-28 00:00:58,161][106225] Updated weights for policy 1, policy_version 665733 (0.0009) [2023-12-28 00:00:58,174][106226] Updated weights for policy 0, policy_version 663949 (0.0008) [2023-12-28 00:00:58,246][106226] Updated weights for policy 0, policy_version 663959 (0.0008) [2023-12-28 00:00:59,155][106225] Updated weights for policy 1, policy_version 665743 (0.0009) [2023-12-28 00:00:59,189][106226] Updated weights for policy 0, policy_version 663969 (0.0008) [2023-12-28 00:00:59,229][106225] Updated weights for policy 1, policy_version 665753 (0.0009) [2023-12-28 00:00:59,275][106226] Updated weights for policy 0, policy_version 663979 (0.0009) [2023-12-28 00:00:59,307][106225] Updated weights for policy 1, policy_version 665763 (0.0008) [2023-12-28 00:00:59,348][106226] Updated weights for policy 0, policy_version 663989 (0.0012) [2023-12-28 00:00:59,439][106226] Updated weights for policy 0, policy_version 663999 (0.0010) [2023-12-28 00:01:00,169][106225] Updated weights for policy 1, policy_version 665773 (0.0008) [2023-12-28 00:01:00,234][106225] Updated weights for policy 1, policy_version 665783 (0.0008) [2023-12-28 00:01:00,303][106225] Updated weights for policy 1, policy_version 665793 (0.0012) [2023-12-28 00:01:00,350][106226] Updated weights for policy 0, policy_version 664009 (0.0008) [2023-12-28 00:01:00,416][106226] Updated weights for policy 0, policy_version 664019 (0.0009) [2023-12-28 00:01:00,477][106226] Updated weights for policy 0, policy_version 664029 (0.0008) [2023-12-28 00:01:01,047][106225] Updated weights for policy 1, policy_version 665803 (0.0009) [2023-12-28 00:01:01,124][106225] Updated weights for policy 1, policy_version 665813 (0.0013) [2023-12-28 00:01:01,175][105115] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 19244.3). Total num frames: 340516864. Throughput: 0: 8996.9, 1: 8995.6. Samples: 340514980. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:01:01,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-5.378')] [2023-12-28 00:01:01,200][106225] Updated weights for policy 1, policy_version 665823 (0.0008) [2023-12-28 00:01:01,240][106226] Updated weights for policy 0, policy_version 664039 (0.0008) [2023-12-28 00:01:01,313][106226] Updated weights for policy 0, policy_version 664049 (0.0009) [2023-12-28 00:01:01,387][106226] Updated weights for policy 0, policy_version 664059 (0.0009) [2023-12-28 00:01:01,996][106225] Updated weights for policy 1, policy_version 665833 (0.0009) [2023-12-28 00:01:02,062][106225] Updated weights for policy 1, policy_version 665843 (0.0008) [2023-12-28 00:01:02,119][106225] Updated weights for policy 1, policy_version 665853 (0.0007) [2023-12-28 00:01:02,137][106226] Updated weights for policy 0, policy_version 664069 (0.0007) [2023-12-28 00:01:02,182][106225] Updated weights for policy 1, policy_version 665863 (0.0007) [2023-12-28 00:01:02,196][106226] Updated weights for policy 0, policy_version 664079 (0.0008) [2023-12-28 00:01:02,268][106226] Updated weights for policy 0, policy_version 664089 (0.0008) [2023-12-28 00:01:02,987][106225] Updated weights for policy 1, policy_version 665873 (0.0006) [2023-12-28 00:01:03,041][106225] Updated weights for policy 1, policy_version 665883 (0.0009) [2023-12-28 00:01:03,087][106226] Updated weights for policy 0, policy_version 664099 (0.0009) [2023-12-28 00:01:03,101][106225] Updated weights for policy 1, policy_version 665893 (0.0008) [2023-12-28 00:01:03,147][106226] Updated weights for policy 0, policy_version 664109 (0.0006) [2023-12-28 00:01:03,211][106226] Updated weights for policy 0, policy_version 664119 (0.0007) [2023-12-28 00:01:03,891][106225] Updated weights for policy 1, policy_version 665903 (0.0008) [2023-12-28 00:01:03,962][106225] Updated weights for policy 1, policy_version 665913 (0.0009) [2023-12-28 00:01:03,962][106226] Updated weights for policy 0, policy_version 664129 (0.0007) [2023-12-28 00:01:04,025][106225] Updated weights for policy 1, policy_version 665923 (0.0009) [2023-12-28 00:01:04,027][106226] Updated weights for policy 0, policy_version 664139 (0.0007) [2023-12-28 00:01:04,090][106226] Updated weights for policy 0, policy_version 664149 (0.0007) [2023-12-28 00:01:04,159][106226] Updated weights for policy 0, policy_version 664159 (0.0009) [2023-12-28 00:01:04,796][106225] Updated weights for policy 1, policy_version 665933 (0.0009) [2023-12-28 00:01:04,851][106225] Updated weights for policy 1, policy_version 665943 (0.0008) [2023-12-28 00:01:04,873][106226] Updated weights for policy 0, policy_version 664169 (0.0007) [2023-12-28 00:01:04,916][106225] Updated weights for policy 1, policy_version 665953 (0.0008) [2023-12-28 00:01:04,932][106226] Updated weights for policy 0, policy_version 664179 (0.0008) [2023-12-28 00:01:04,990][106226] Updated weights for policy 0, policy_version 664189 (0.0009) [2023-12-28 00:01:05,676][106225] Updated weights for policy 1, policy_version 665963 (0.0008) [2023-12-28 00:01:05,735][106225] Updated weights for policy 1, policy_version 665973 (0.0009) [2023-12-28 00:01:05,746][106226] Updated weights for policy 0, policy_version 664199 (0.0007) [2023-12-28 00:01:05,795][106225] Updated weights for policy 1, policy_version 665983 (0.0008) [2023-12-28 00:01:05,811][106226] Updated weights for policy 0, policy_version 664209 (0.0006) [2023-12-28 00:01:05,868][106226] Updated weights for policy 0, policy_version 664219 (0.0007) [2023-12-28 00:01:06,174][105115] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 19244.3). Total num frames: 340615168. Throughput: 0: 8992.8, 1: 9008.5. Samples: 340622772. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:01:06,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-5.492')] [2023-12-28 00:01:06,575][106226] Updated weights for policy 0, policy_version 664229 (0.0007) [2023-12-28 00:01:06,638][106226] Updated weights for policy 0, policy_version 664239 (0.0008) [2023-12-28 00:01:06,664][106225] Updated weights for policy 1, policy_version 665993 (0.0008) [2023-12-28 00:01:06,704][106226] Updated weights for policy 0, policy_version 664249 (0.0009) [2023-12-28 00:01:06,731][106225] Updated weights for policy 1, policy_version 666003 (0.0010) [2023-12-28 00:01:06,794][106225] Updated weights for policy 1, policy_version 666013 (0.0011) [2023-12-28 00:01:06,857][106225] Updated weights for policy 1, policy_version 666023 (0.0011) [2023-12-28 00:01:07,477][106226] Updated weights for policy 0, policy_version 664259 (0.0008) [2023-12-28 00:01:07,541][106226] Updated weights for policy 0, policy_version 664269 (0.0008) [2023-12-28 00:01:07,609][106226] Updated weights for policy 0, policy_version 664279 (0.0008) [2023-12-28 00:01:07,630][106225] Updated weights for policy 1, policy_version 666033 (0.0010) [2023-12-28 00:01:07,697][106225] Updated weights for policy 1, policy_version 666043 (0.0011) [2023-12-28 00:01:07,765][106225] Updated weights for policy 1, policy_version 666053 (0.0011) [2023-12-28 00:01:08,360][106226] Updated weights for policy 0, policy_version 664289 (0.0006) [2023-12-28 00:01:08,436][106226] Updated weights for policy 0, policy_version 664299 (0.0009) [2023-12-28 00:01:08,519][106226] Updated weights for policy 0, policy_version 664309 (0.0008) [2023-12-28 00:01:08,588][106225] Updated weights for policy 1, policy_version 666063 (0.0009) [2023-12-28 00:01:08,588][106226] Updated weights for policy 0, policy_version 664319 (0.0010) [2023-12-28 00:01:08,657][106225] Updated weights for policy 1, policy_version 666073 (0.0008) [2023-12-28 00:01:08,726][106225] Updated weights for policy 1, policy_version 666083 (0.0008) [2023-12-28 00:01:09,278][106226] Updated weights for policy 0, policy_version 664330 (0.0009) [2023-12-28 00:01:09,350][106226] Updated weights for policy 0, policy_version 664340 (0.0009) [2023-12-28 00:01:09,425][106226] Updated weights for policy 0, policy_version 664350 (0.0008) [2023-12-28 00:01:09,588][106225] Updated weights for policy 1, policy_version 666093 (0.0009) [2023-12-28 00:01:09,658][106225] Updated weights for policy 1, policy_version 666103 (0.0008) [2023-12-28 00:01:09,732][106225] Updated weights for policy 1, policy_version 666113 (0.0009) [2023-12-28 00:01:10,233][106226] Updated weights for policy 0, policy_version 664360 (0.0008) [2023-12-28 00:01:10,301][106226] Updated weights for policy 0, policy_version 664370 (0.0009) [2023-12-28 00:01:10,367][106226] Updated weights for policy 0, policy_version 664380 (0.0008) [2023-12-28 00:01:10,528][106225] Updated weights for policy 1, policy_version 666123 (0.0009) [2023-12-28 00:01:10,592][106225] Updated weights for policy 1, policy_version 666133 (0.0011) [2023-12-28 00:01:10,657][106225] Updated weights for policy 1, policy_version 666143 (0.0010) [2023-12-28 00:01:11,151][106226] Updated weights for policy 0, policy_version 664390 (0.0008) [2023-12-28 00:01:11,175][105115] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 19160.9). Total num frames: 340697088. Throughput: 0: 9005.7, 1: 9023.2. Samples: 340675812. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:01:11,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.886')] [2023-12-28 00:01:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000666152_170565632.pth... [2023-12-28 00:01:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000665128_170303488.pth [2023-12-28 00:01:11,223][106226] Updated weights for policy 0, policy_version 664400 (0.0009) [2023-12-28 00:01:11,297][106226] Updated weights for policy 0, policy_version 664410 (0.0009) [2023-12-28 00:01:11,345][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000664416_170139648.pth... [2023-12-28 00:01:11,350][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000663360_169869312.pth [2023-12-28 00:01:11,514][106225] Updated weights for policy 1, policy_version 666153 (0.0010) [2023-12-28 00:01:11,583][106225] Updated weights for policy 1, policy_version 666163 (0.0008) [2023-12-28 00:01:11,675][106225] Updated weights for policy 1, policy_version 666173 (0.0009) [2023-12-28 00:01:11,757][106225] Updated weights for policy 1, policy_version 666183 (0.0009) [2023-12-28 00:01:12,179][106226] Updated weights for policy 0, policy_version 664420 (0.0009) [2023-12-28 00:01:12,250][106226] Updated weights for policy 0, policy_version 664430 (0.0008) [2023-12-28 00:01:12,324][106226] Updated weights for policy 0, policy_version 664440 (0.0008) [2023-12-28 00:01:12,595][106225] Updated weights for policy 1, policy_version 666193 (0.0009) [2023-12-28 00:01:12,665][106225] Updated weights for policy 1, policy_version 666203 (0.0009) [2023-12-28 00:01:12,728][106225] Updated weights for policy 1, policy_version 666213 (0.0007) [2023-12-28 00:01:13,134][106226] Updated weights for policy 0, policy_version 664450 (0.0009) [2023-12-28 00:01:13,201][106226] Updated weights for policy 0, policy_version 664460 (0.0011) [2023-12-28 00:01:13,263][106226] Updated weights for policy 0, policy_version 664470 (0.0011) [2023-12-28 00:01:13,330][106226] Updated weights for policy 0, policy_version 664480 (0.0011) [2023-12-28 00:01:13,481][106225] Updated weights for policy 1, policy_version 666223 (0.0008) [2023-12-28 00:01:13,545][106225] Updated weights for policy 1, policy_version 666233 (0.0008) [2023-12-28 00:01:13,608][106225] Updated weights for policy 1, policy_version 666243 (0.0008) [2023-12-28 00:01:14,044][106226] Updated weights for policy 0, policy_version 664490 (0.0009) [2023-12-28 00:01:14,099][106226] Updated weights for policy 0, policy_version 664500 (0.0011) [2023-12-28 00:01:14,157][106226] Updated weights for policy 0, policy_version 664510 (0.0009) [2023-12-28 00:01:14,364][106225] Updated weights for policy 1, policy_version 666253 (0.0007) [2023-12-28 00:01:14,417][106225] Updated weights for policy 1, policy_version 666263 (0.0005) [2023-12-28 00:01:14,474][106225] Updated weights for policy 1, policy_version 666273 (0.0007) [2023-12-28 00:01:14,873][106226] Updated weights for policy 0, policy_version 664520 (0.0008) [2023-12-28 00:01:14,940][106226] Updated weights for policy 0, policy_version 664530 (0.0011) [2023-12-28 00:01:15,013][106226] Updated weights for policy 0, policy_version 664540 (0.0009) [2023-12-28 00:01:15,235][106225] Updated weights for policy 1, policy_version 666283 (0.0010) [2023-12-28 00:01:15,300][106225] Updated weights for policy 1, policy_version 666293 (0.0011) [2023-12-28 00:01:15,369][106225] Updated weights for policy 1, policy_version 666303 (0.0011) [2023-12-28 00:01:15,787][106226] Updated weights for policy 0, policy_version 664550 (0.0009) [2023-12-28 00:01:15,847][106226] Updated weights for policy 0, policy_version 664560 (0.0011) [2023-12-28 00:01:15,908][106226] Updated weights for policy 0, policy_version 664570 (0.0011) [2023-12-28 00:01:16,078][106225] Updated weights for policy 1, policy_version 666313 (0.0009) [2023-12-28 00:01:16,145][106225] Updated weights for policy 1, policy_version 666323 (0.0011) [2023-12-28 00:01:16,175][105115] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 19160.9). Total num frames: 340787200. Throughput: 0: 8909.2, 1: 8893.8. Samples: 340780700. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:01:16,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-5.552')] [2023-12-28 00:01:16,207][106225] Updated weights for policy 1, policy_version 666333 (0.0010) [2023-12-28 00:01:16,258][106225] Updated weights for policy 1, policy_version 666343 (0.0010) [2023-12-28 00:01:16,606][106226] Updated weights for policy 0, policy_version 664580 (0.0009) [2023-12-28 00:01:16,669][106226] Updated weights for policy 0, policy_version 664590 (0.0011) [2023-12-28 00:01:16,736][106226] Updated weights for policy 0, policy_version 664600 (0.0010) [2023-12-28 00:01:16,986][106225] Updated weights for policy 1, policy_version 666353 (0.0010) [2023-12-28 00:01:17,053][106225] Updated weights for policy 1, policy_version 666363 (0.0011) [2023-12-28 00:01:17,112][106225] Updated weights for policy 1, policy_version 666373 (0.0010) [2023-12-28 00:01:17,454][106226] Updated weights for policy 0, policy_version 664610 (0.0011) [2023-12-28 00:01:17,519][106226] Updated weights for policy 0, policy_version 664620 (0.0011) [2023-12-28 00:01:17,585][106226] Updated weights for policy 0, policy_version 664630 (0.0011) [2023-12-28 00:01:17,651][106226] Updated weights for policy 0, policy_version 664640 (0.0009) [2023-12-28 00:01:17,814][106225] Updated weights for policy 1, policy_version 666383 (0.0011) [2023-12-28 00:01:17,869][106225] Updated weights for policy 1, policy_version 666393 (0.0011) [2023-12-28 00:01:17,929][106225] Updated weights for policy 1, policy_version 666403 (0.0010) [2023-12-28 00:01:18,334][106226] Updated weights for policy 0, policy_version 664650 (0.0008) [2023-12-28 00:01:18,403][106226] Updated weights for policy 0, policy_version 664660 (0.0008) [2023-12-28 00:01:18,476][106226] Updated weights for policy 0, policy_version 664670 (0.0009) [2023-12-28 00:01:18,718][106225] Updated weights for policy 1, policy_version 666413 (0.0009) [2023-12-28 00:01:18,777][106225] Updated weights for policy 1, policy_version 666423 (0.0006) [2023-12-28 00:01:18,837][106225] Updated weights for policy 1, policy_version 666433 (0.0008) [2023-12-28 00:01:19,261][106226] Updated weights for policy 0, policy_version 664680 (0.0008) [2023-12-28 00:01:19,330][106226] Updated weights for policy 0, policy_version 664690 (0.0009) [2023-12-28 00:01:19,414][106226] Updated weights for policy 0, policy_version 664700 (0.0009) [2023-12-28 00:01:19,628][106225] Updated weights for policy 1, policy_version 666443 (0.0008) [2023-12-28 00:01:19,694][106225] Updated weights for policy 1, policy_version 666453 (0.0009) [2023-12-28 00:01:19,757][106225] Updated weights for policy 1, policy_version 666463 (0.0007) [2023-12-28 00:01:20,212][106226] Updated weights for policy 0, policy_version 664710 (0.0009) [2023-12-28 00:01:20,286][106226] Updated weights for policy 0, policy_version 664720 (0.0009) [2023-12-28 00:01:20,358][106226] Updated weights for policy 0, policy_version 664730 (0.0008) [2023-12-28 00:01:20,524][106225] Updated weights for policy 1, policy_version 666473 (0.0008) [2023-12-28 00:01:20,604][106225] Updated weights for policy 1, policy_version 666484 (0.0009) [2023-12-28 00:01:20,672][106225] Updated weights for policy 1, policy_version 666494 (0.0009) [2023-12-28 00:01:20,741][106225] Updated weights for policy 1, policy_version 666504 (0.0009) [2023-12-28 00:01:21,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 19077.6). Total num frames: 340877312. Throughput: 0: 8851.5, 1: 8843.8. Samples: 340890116. Policy #0 lag: (min: 40.0, avg: 40.0, max: 40.0) [2023-12-28 00:01:21,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.403')] [2023-12-28 00:01:21,184][106226] Updated weights for policy 0, policy_version 664740 (0.0008) [2023-12-28 00:01:21,257][106226] Updated weights for policy 0, policy_version 664750 (0.0007) [2023-12-28 00:01:21,336][106226] Updated weights for policy 0, policy_version 664760 (0.0009) [2023-12-28 00:01:21,619][106225] Updated weights for policy 1, policy_version 666514 (0.0009) [2023-12-28 00:01:21,697][106225] Updated weights for policy 1, policy_version 666524 (0.0010) [2023-12-28 00:01:21,773][106225] Updated weights for policy 1, policy_version 666534 (0.0008) [2023-12-28 00:01:22,151][106226] Updated weights for policy 0, policy_version 664770 (0.0011) [2023-12-28 00:01:22,219][106226] Updated weights for policy 0, policy_version 664780 (0.0009) [2023-12-28 00:01:22,291][106226] Updated weights for policy 0, policy_version 664790 (0.0011) [2023-12-28 00:01:22,360][106226] Updated weights for policy 0, policy_version 664800 (0.0009) [2023-12-28 00:01:22,572][106225] Updated weights for policy 1, policy_version 666544 (0.0008) [2023-12-28 00:01:22,641][106225] Updated weights for policy 1, policy_version 666554 (0.0008) [2023-12-28 00:01:22,711][106225] Updated weights for policy 1, policy_version 666564 (0.0008) [2023-12-28 00:01:23,086][106226] Updated weights for policy 0, policy_version 664810 (0.0011) [2023-12-28 00:01:23,150][106226] Updated weights for policy 0, policy_version 664820 (0.0010) [2023-12-28 00:01:23,217][106226] Updated weights for policy 0, policy_version 664830 (0.0011) [2023-12-28 00:01:23,491][106225] Updated weights for policy 1, policy_version 666574 (0.0009) [2023-12-28 00:01:23,559][106225] Updated weights for policy 1, policy_version 666584 (0.0008) [2023-12-28 00:01:23,628][106225] Updated weights for policy 1, policy_version 666594 (0.0008) [2023-12-28 00:01:23,999][106226] Updated weights for policy 0, policy_version 664840 (0.0010) [2023-12-28 00:01:24,066][106226] Updated weights for policy 0, policy_version 664850 (0.0011) [2023-12-28 00:01:24,130][106226] Updated weights for policy 0, policy_version 664860 (0.0011) [2023-12-28 00:01:24,373][106225] Updated weights for policy 1, policy_version 666604 (0.0008) [2023-12-28 00:01:24,437][106225] Updated weights for policy 1, policy_version 666614 (0.0008) [2023-12-28 00:01:24,508][106225] Updated weights for policy 1, policy_version 666624 (0.0010) [2023-12-28 00:01:24,805][106226] Updated weights for policy 0, policy_version 664870 (0.0011) [2023-12-28 00:01:24,871][106226] Updated weights for policy 0, policy_version 664880 (0.0011) [2023-12-28 00:01:24,933][106226] Updated weights for policy 0, policy_version 664890 (0.0008) [2023-12-28 00:01:25,285][106225] Updated weights for policy 1, policy_version 666634 (0.0008) [2023-12-28 00:01:25,345][106225] Updated weights for policy 1, policy_version 666644 (0.0007) [2023-12-28 00:01:25,396][106225] Updated weights for policy 1, policy_version 666654 (0.0008) [2023-12-28 00:01:25,444][106225] Updated weights for policy 1, policy_version 666664 (0.0008) [2023-12-28 00:01:25,626][106226] Updated weights for policy 0, policy_version 664900 (0.0007) [2023-12-28 00:01:25,687][106226] Updated weights for policy 0, policy_version 664910 (0.0010) [2023-12-28 00:01:25,752][106226] Updated weights for policy 0, policy_version 664920 (0.0009) [2023-12-28 00:01:26,175][105115] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 19049.9). Total num frames: 340967424. Throughput: 0: 8843.7, 1: 8805.8. Samples: 340941988. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:26,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-5.541')] [2023-12-28 00:01:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000664928_170270720.pth... [2023-12-28 00:01:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000663872_170000384.pth [2023-12-28 00:01:26,211][106225] Updated weights for policy 1, policy_version 666674 (0.0009) [2023-12-28 00:01:26,267][106225] Updated weights for policy 1, policy_version 666684 (0.0008) [2023-12-28 00:01:26,326][106225] Updated weights for policy 1, policy_version 666694 (0.0008) [2023-12-28 00:01:26,336][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000666696_170704896.pth... [2023-12-28 00:01:26,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000665640_170434560.pth [2023-12-28 00:01:26,485][106226] Updated weights for policy 0, policy_version 664930 (0.0008) [2023-12-28 00:01:26,549][106226] Updated weights for policy 0, policy_version 664940 (0.0010) [2023-12-28 00:01:26,613][106226] Updated weights for policy 0, policy_version 664950 (0.0008) [2023-12-28 00:01:26,679][106226] Updated weights for policy 0, policy_version 664960 (0.0011) [2023-12-28 00:01:27,104][106225] Updated weights for policy 1, policy_version 666704 (0.0009) [2023-12-28 00:01:27,165][106225] Updated weights for policy 1, policy_version 666714 (0.0008) [2023-12-28 00:01:27,224][106225] Updated weights for policy 1, policy_version 666724 (0.0008) [2023-12-28 00:01:27,410][106226] Updated weights for policy 0, policy_version 664970 (0.0011) [2023-12-28 00:01:27,472][106226] Updated weights for policy 0, policy_version 664980 (0.0011) [2023-12-28 00:01:27,535][106226] Updated weights for policy 0, policy_version 664990 (0.0011) [2023-12-28 00:01:27,978][106225] Updated weights for policy 1, policy_version 666734 (0.0008) [2023-12-28 00:01:28,043][106225] Updated weights for policy 1, policy_version 666744 (0.0008) [2023-12-28 00:01:28,105][106225] Updated weights for policy 1, policy_version 666754 (0.0008) [2023-12-28 00:01:28,231][106226] Updated weights for policy 0, policy_version 665000 (0.0011) [2023-12-28 00:01:28,289][106226] Updated weights for policy 0, policy_version 665010 (0.0011) [2023-12-28 00:01:28,356][106226] Updated weights for policy 0, policy_version 665020 (0.0011) [2023-12-28 00:01:28,869][106225] Updated weights for policy 1, policy_version 666764 (0.0008) [2023-12-28 00:01:28,936][106225] Updated weights for policy 1, policy_version 666774 (0.0008) [2023-12-28 00:01:28,996][106225] Updated weights for policy 1, policy_version 666784 (0.0008) [2023-12-28 00:01:29,125][106226] Updated weights for policy 0, policy_version 665030 (0.0009) [2023-12-28 00:01:29,192][106226] Updated weights for policy 0, policy_version 665040 (0.0009) [2023-12-28 00:01:29,270][106226] Updated weights for policy 0, policy_version 665050 (0.0009) [2023-12-28 00:01:29,752][106225] Updated weights for policy 1, policy_version 666794 (0.0008) [2023-12-28 00:01:29,814][106225] Updated weights for policy 1, policy_version 666804 (0.0007) [2023-12-28 00:01:29,893][106225] Updated weights for policy 1, policy_version 666814 (0.0008) [2023-12-28 00:01:29,961][106225] Updated weights for policy 1, policy_version 666824 (0.0010) [2023-12-28 00:01:30,141][106226] Updated weights for policy 0, policy_version 665060 (0.0010) [2023-12-28 00:01:30,207][106226] Updated weights for policy 0, policy_version 665070 (0.0009) [2023-12-28 00:01:30,273][106226] Updated weights for policy 0, policy_version 665080 (0.0010) [2023-12-28 00:01:30,683][106225] Updated weights for policy 1, policy_version 666834 (0.0011) [2023-12-28 00:01:30,744][106225] Updated weights for policy 1, policy_version 666844 (0.0011) [2023-12-28 00:01:30,802][106225] Updated weights for policy 1, policy_version 666854 (0.0010) [2023-12-28 00:01:30,989][106226] Updated weights for policy 0, policy_version 665090 (0.0010) [2023-12-28 00:01:31,063][106226] Updated weights for policy 0, policy_version 665100 (0.0009) [2023-12-28 00:01:31,133][106226] Updated weights for policy 0, policy_version 665110 (0.0008) [2023-12-28 00:01:31,175][105115] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 19022.1). Total num frames: 341057536. Throughput: 0: 8933.0, 1: 8841.1. Samples: 341053232. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:31,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.638')] [2023-12-28 00:01:31,197][106226] Updated weights for policy 0, policy_version 665120 (0.0008) [2023-12-28 00:01:31,585][106225] Updated weights for policy 1, policy_version 666864 (0.0007) [2023-12-28 00:01:31,656][106225] Updated weights for policy 1, policy_version 666874 (0.0009) [2023-12-28 00:01:31,728][106225] Updated weights for policy 1, policy_version 666884 (0.0009) [2023-12-28 00:01:32,000][106226] Updated weights for policy 0, policy_version 665130 (0.0011) [2023-12-28 00:01:32,059][106226] Updated weights for policy 0, policy_version 665140 (0.0011) [2023-12-28 00:01:32,118][106226] Updated weights for policy 0, policy_version 665150 (0.0011) [2023-12-28 00:01:32,450][106225] Updated weights for policy 1, policy_version 666894 (0.0010) [2023-12-28 00:01:32,509][106225] Updated weights for policy 1, policy_version 666904 (0.0010) [2023-12-28 00:01:32,574][106225] Updated weights for policy 1, policy_version 666914 (0.0010) [2023-12-28 00:01:32,867][106226] Updated weights for policy 0, policy_version 665160 (0.0010) [2023-12-28 00:01:32,927][106226] Updated weights for policy 0, policy_version 665170 (0.0007) [2023-12-28 00:01:32,982][106226] Updated weights for policy 0, policy_version 665180 (0.0010) [2023-12-28 00:01:33,313][106225] Updated weights for policy 1, policy_version 666924 (0.0010) [2023-12-28 00:01:33,370][106225] Updated weights for policy 1, policy_version 666934 (0.0009) [2023-12-28 00:01:33,435][106225] Updated weights for policy 1, policy_version 666944 (0.0011) [2023-12-28 00:01:33,656][106226] Updated weights for policy 0, policy_version 665190 (0.0008) [2023-12-28 00:01:33,723][106226] Updated weights for policy 0, policy_version 665200 (0.0009) [2023-12-28 00:01:33,781][106226] Updated weights for policy 0, policy_version 665210 (0.0011) [2023-12-28 00:01:34,126][106225] Updated weights for policy 1, policy_version 666954 (0.0010) [2023-12-28 00:01:34,197][106225] Updated weights for policy 1, policy_version 666964 (0.0009) [2023-12-28 00:01:34,264][106225] Updated weights for policy 1, policy_version 666974 (0.0009) [2023-12-28 00:01:34,335][106225] Updated weights for policy 1, policy_version 666984 (0.0009) [2023-12-28 00:01:34,462][106226] Updated weights for policy 0, policy_version 665220 (0.0010) [2023-12-28 00:01:34,525][106226] Updated weights for policy 0, policy_version 665230 (0.0009) [2023-12-28 00:01:34,588][106226] Updated weights for policy 0, policy_version 665240 (0.0009) [2023-12-28 00:01:35,194][106225] Updated weights for policy 1, policy_version 666994 (0.0007) [2023-12-28 00:01:35,262][106225] Updated weights for policy 1, policy_version 667004 (0.0007) [2023-12-28 00:01:35,322][106225] Updated weights for policy 1, policy_version 667014 (0.0008) [2023-12-28 00:01:35,352][106226] Updated weights for policy 0, policy_version 665250 (0.0009) [2023-12-28 00:01:35,416][106226] Updated weights for policy 0, policy_version 665260 (0.0008) [2023-12-28 00:01:35,480][106226] Updated weights for policy 0, policy_version 665270 (0.0009) [2023-12-28 00:01:35,547][106226] Updated weights for policy 0, policy_version 665280 (0.0009) [2023-12-28 00:01:36,053][106225] Updated weights for policy 1, policy_version 667024 (0.0007) [2023-12-28 00:01:36,122][106225] Updated weights for policy 1, policy_version 667034 (0.0008) [2023-12-28 00:01:36,175][105115] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 19022.1). Total num frames: 341147648. Throughput: 0: 8978.7, 1: 8853.9. Samples: 341163424. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:36,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-5.685')] [2023-12-28 00:01:36,187][106225] Updated weights for policy 1, policy_version 667044 (0.0008) [2023-12-28 00:01:36,325][106226] Updated weights for policy 0, policy_version 665290 (0.0008) [2023-12-28 00:01:36,388][106226] Updated weights for policy 0, policy_version 665300 (0.0008) [2023-12-28 00:01:36,464][106226] Updated weights for policy 0, policy_version 665310 (0.0008) [2023-12-28 00:01:36,990][106225] Updated weights for policy 1, policy_version 667054 (0.0008) [2023-12-28 00:01:37,054][106225] Updated weights for policy 1, policy_version 667064 (0.0009) [2023-12-28 00:01:37,122][106225] Updated weights for policy 1, policy_version 667074 (0.0008) [2023-12-28 00:01:37,232][106226] Updated weights for policy 0, policy_version 665320 (0.0008) [2023-12-28 00:01:37,297][106226] Updated weights for policy 0, policy_version 665330 (0.0009) [2023-12-28 00:01:37,355][106226] Updated weights for policy 0, policy_version 665340 (0.0008) [2023-12-28 00:01:37,866][106225] Updated weights for policy 1, policy_version 667084 (0.0009) [2023-12-28 00:01:37,930][106225] Updated weights for policy 1, policy_version 667094 (0.0009) [2023-12-28 00:01:37,986][106225] Updated weights for policy 1, policy_version 667104 (0.0008) [2023-12-28 00:01:38,136][106226] Updated weights for policy 0, policy_version 665350 (0.0008) [2023-12-28 00:01:38,199][106226] Updated weights for policy 0, policy_version 665360 (0.0008) [2023-12-28 00:01:38,257][106226] Updated weights for policy 0, policy_version 665370 (0.0009) [2023-12-28 00:01:38,777][106225] Updated weights for policy 1, policy_version 667114 (0.0008) [2023-12-28 00:01:38,846][106225] Updated weights for policy 1, policy_version 667124 (0.0008) [2023-12-28 00:01:38,915][106225] Updated weights for policy 1, policy_version 667134 (0.0008) [2023-12-28 00:01:38,986][106225] Updated weights for policy 1, policy_version 667144 (0.0008) [2023-12-28 00:01:39,066][106226] Updated weights for policy 0, policy_version 665380 (0.0009) [2023-12-28 00:01:39,135][106226] Updated weights for policy 0, policy_version 665390 (0.0009) [2023-12-28 00:01:39,202][106226] Updated weights for policy 0, policy_version 665400 (0.0009) [2023-12-28 00:01:39,837][106225] Updated weights for policy 1, policy_version 667154 (0.0008) [2023-12-28 00:01:39,911][106225] Updated weights for policy 1, policy_version 667164 (0.0008) [2023-12-28 00:01:39,986][106225] Updated weights for policy 1, policy_version 667174 (0.0009) [2023-12-28 00:01:40,062][106226] Updated weights for policy 0, policy_version 665410 (0.0010) [2023-12-28 00:01:40,132][106226] Updated weights for policy 0, policy_version 665420 (0.0009) [2023-12-28 00:01:40,200][106226] Updated weights for policy 0, policy_version 665430 (0.0008) [2023-12-28 00:01:40,268][106226] Updated weights for policy 0, policy_version 665440 (0.0008) [2023-12-28 00:01:40,807][106225] Updated weights for policy 1, policy_version 667184 (0.0009) [2023-12-28 00:01:40,871][106225] Updated weights for policy 1, policy_version 667194 (0.0009) [2023-12-28 00:01:40,939][106225] Updated weights for policy 1, policy_version 667204 (0.0008) [2023-12-28 00:01:41,038][106226] Updated weights for policy 0, policy_version 665450 (0.0009) [2023-12-28 00:01:41,116][106226] Updated weights for policy 0, policy_version 665460 (0.0009) [2023-12-28 00:01:41,175][105115] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 18994.3). Total num frames: 341237760. Throughput: 0: 9020.2, 1: 8900.5. Samples: 341216764. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:41,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-5.806')] [2023-12-28 00:01:41,184][106226] Updated weights for policy 0, policy_version 665470 (0.0008) [2023-12-28 00:01:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000667208_170835968.pth... [2023-12-28 00:01:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000666152_170565632.pth [2023-12-28 00:01:41,198][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000665472_170409984.pth... [2023-12-28 00:01:41,203][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000664416_170139648.pth [2023-12-28 00:01:41,861][106225] Updated weights for policy 1, policy_version 667214 (0.0009) [2023-12-28 00:01:41,928][106225] Updated weights for policy 1, policy_version 667224 (0.0009) [2023-12-28 00:01:41,989][106225] Updated weights for policy 1, policy_version 667234 (0.0008) [2023-12-28 00:01:42,065][106226] Updated weights for policy 0, policy_version 665480 (0.0008) [2023-12-28 00:01:42,135][106226] Updated weights for policy 0, policy_version 665490 (0.0008) [2023-12-28 00:01:42,204][106226] Updated weights for policy 0, policy_version 665500 (0.0008) [2023-12-28 00:01:42,797][106225] Updated weights for policy 1, policy_version 667244 (0.0007) [2023-12-28 00:01:42,864][106225] Updated weights for policy 1, policy_version 667254 (0.0007) [2023-12-28 00:01:42,920][106225] Updated weights for policy 1, policy_version 667264 (0.0008) [2023-12-28 00:01:42,992][106226] Updated weights for policy 0, policy_version 665510 (0.0007) [2023-12-28 00:01:43,061][106226] Updated weights for policy 0, policy_version 665520 (0.0009) [2023-12-28 00:01:43,131][106226] Updated weights for policy 0, policy_version 665530 (0.0007) [2023-12-28 00:01:43,690][106225] Updated weights for policy 1, policy_version 667274 (0.0009) [2023-12-28 00:01:43,743][106225] Updated weights for policy 1, policy_version 667284 (0.0008) [2023-12-28 00:01:43,807][106225] Updated weights for policy 1, policy_version 667294 (0.0008) [2023-12-28 00:01:43,817][106226] Updated weights for policy 0, policy_version 665540 (0.0007) [2023-12-28 00:01:43,869][106225] Updated weights for policy 1, policy_version 667304 (0.0009) [2023-12-28 00:01:43,872][106226] Updated weights for policy 0, policy_version 665550 (0.0007) [2023-12-28 00:01:43,930][106226] Updated weights for policy 0, policy_version 665560 (0.0009) [2023-12-28 00:01:44,578][106226] Updated weights for policy 0, policy_version 665570 (0.0009) [2023-12-28 00:01:44,643][106226] Updated weights for policy 0, policy_version 665580 (0.0007) [2023-12-28 00:01:44,676][106225] Updated weights for policy 1, policy_version 667314 (0.0009) [2023-12-28 00:01:44,704][106226] Updated weights for policy 0, policy_version 665590 (0.0009) [2023-12-28 00:01:44,726][106225] Updated weights for policy 1, policy_version 667324 (0.0007) [2023-12-28 00:01:44,767][106226] Updated weights for policy 0, policy_version 665600 (0.0009) [2023-12-28 00:01:44,792][106225] Updated weights for policy 1, policy_version 667334 (0.0008) [2023-12-28 00:01:45,556][106226] Updated weights for policy 0, policy_version 665610 (0.0010) [2023-12-28 00:01:45,575][106225] Updated weights for policy 1, policy_version 667344 (0.0008) [2023-12-28 00:01:45,626][106226] Updated weights for policy 0, policy_version 665620 (0.0010) [2023-12-28 00:01:45,645][106225] Updated weights for policy 1, policy_version 667354 (0.0007) [2023-12-28 00:01:45,694][106226] Updated weights for policy 0, policy_version 665630 (0.0008) [2023-12-28 00:01:45,708][106225] Updated weights for policy 1, policy_version 667364 (0.0008) [2023-12-28 00:01:46,175][105115] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 18938.8). Total num frames: 341327872. Throughput: 0: 9057.8, 1: 8852.1. Samples: 341320924. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:46,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-5.947')] [2023-12-28 00:01:46,414][106226] Updated weights for policy 0, policy_version 665640 (0.0008) [2023-12-28 00:01:46,440][106225] Updated weights for policy 1, policy_version 667374 (0.0010) [2023-12-28 00:01:46,469][106226] Updated weights for policy 0, policy_version 665650 (0.0008) [2023-12-28 00:01:46,499][106225] Updated weights for policy 1, policy_version 667384 (0.0008) [2023-12-28 00:01:46,529][106226] Updated weights for policy 0, policy_version 665660 (0.0006) [2023-12-28 00:01:46,562][106225] Updated weights for policy 1, policy_version 667394 (0.0007) [2023-12-28 00:01:47,291][106225] Updated weights for policy 1, policy_version 667404 (0.0009) [2023-12-28 00:01:47,303][106226] Updated weights for policy 0, policy_version 665670 (0.0009) [2023-12-28 00:01:47,350][106225] Updated weights for policy 1, policy_version 667414 (0.0011) [2023-12-28 00:01:47,368][106226] Updated weights for policy 0, policy_version 665680 (0.0007) [2023-12-28 00:01:47,402][106225] Updated weights for policy 1, policy_version 667424 (0.0010) [2023-12-28 00:01:47,428][106226] Updated weights for policy 0, policy_version 665690 (0.0007) [2023-12-28 00:01:48,133][106225] Updated weights for policy 1, policy_version 667434 (0.0008) [2023-12-28 00:01:48,191][106226] Updated weights for policy 0, policy_version 665700 (0.0008) [2023-12-28 00:01:48,197][106225] Updated weights for policy 1, policy_version 667444 (0.0009) [2023-12-28 00:01:48,250][106226] Updated weights for policy 0, policy_version 665710 (0.0008) [2023-12-28 00:01:48,260][106225] Updated weights for policy 1, policy_version 667454 (0.0007) [2023-12-28 00:01:48,311][106226] Updated weights for policy 0, policy_version 665720 (0.0006) [2023-12-28 00:01:48,321][106225] Updated weights for policy 1, policy_version 667464 (0.0007) [2023-12-28 00:01:49,063][106226] Updated weights for policy 0, policy_version 665730 (0.0008) [2023-12-28 00:01:49,091][106225] Updated weights for policy 1, policy_version 667474 (0.0009) [2023-12-28 00:01:49,127][106226] Updated weights for policy 0, policy_version 665740 (0.0006) [2023-12-28 00:01:49,156][106225] Updated weights for policy 1, policy_version 667484 (0.0008) [2023-12-28 00:01:49,194][106226] Updated weights for policy 0, policy_version 665750 (0.0008) [2023-12-28 00:01:49,215][106225] Updated weights for policy 1, policy_version 667494 (0.0006) [2023-12-28 00:01:49,264][106226] Updated weights for policy 0, policy_version 665760 (0.0008) [2023-12-28 00:01:50,015][106226] Updated weights for policy 0, policy_version 665770 (0.0009) [2023-12-28 00:01:50,076][106226] Updated weights for policy 0, policy_version 665780 (0.0006) [2023-12-28 00:01:50,123][106225] Updated weights for policy 1, policy_version 667504 (0.0008) [2023-12-28 00:01:50,146][106226] Updated weights for policy 0, policy_version 665790 (0.0006) [2023-12-28 00:01:50,192][106225] Updated weights for policy 1, policy_version 667514 (0.0008) [2023-12-28 00:01:50,263][106225] Updated weights for policy 1, policy_version 667524 (0.0008) [2023-12-28 00:01:50,869][106226] Updated weights for policy 0, policy_version 665800 (0.0009) [2023-12-28 00:01:50,939][106226] Updated weights for policy 0, policy_version 665810 (0.0011) [2023-12-28 00:01:51,009][106226] Updated weights for policy 0, policy_version 665820 (0.0011) [2023-12-28 00:01:51,089][106225] Updated weights for policy 1, policy_version 667534 (0.0010) [2023-12-28 00:01:51,160][106225] Updated weights for policy 1, policy_version 667544 (0.0011) [2023-12-28 00:01:51,175][105115] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 18911.0). Total num frames: 341417984. Throughput: 0: 9056.9, 1: 8874.0. Samples: 341429660. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:51,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-5.454')] [2023-12-28 00:01:51,225][106225] Updated weights for policy 1, policy_version 667554 (0.0008) [2023-12-28 00:01:51,818][106226] Updated weights for policy 0, policy_version 665830 (0.0009) [2023-12-28 00:01:51,887][106226] Updated weights for policy 0, policy_version 665840 (0.0007) [2023-12-28 00:01:51,954][106226] Updated weights for policy 0, policy_version 665850 (0.0008) [2023-12-28 00:01:52,075][106225] Updated weights for policy 1, policy_version 667564 (0.0009) [2023-12-28 00:01:52,137][106225] Updated weights for policy 1, policy_version 667574 (0.0009) [2023-12-28 00:01:52,186][106225] Updated weights for policy 1, policy_version 667584 (0.0008) [2023-12-28 00:01:52,679][106226] Updated weights for policy 0, policy_version 665860 (0.0009) [2023-12-28 00:01:52,753][106226] Updated weights for policy 0, policy_version 665870 (0.0008) [2023-12-28 00:01:52,823][106226] Updated weights for policy 0, policy_version 665880 (0.0009) [2023-12-28 00:01:52,983][106225] Updated weights for policy 1, policy_version 667594 (0.0009) [2023-12-28 00:01:53,044][106225] Updated weights for policy 1, policy_version 667604 (0.0009) [2023-12-28 00:01:53,106][106225] Updated weights for policy 1, policy_version 667614 (0.0009) [2023-12-28 00:01:53,166][106225] Updated weights for policy 1, policy_version 667624 (0.0009) [2023-12-28 00:01:53,544][106226] Updated weights for policy 0, policy_version 665890 (0.0009) [2023-12-28 00:01:53,615][106226] Updated weights for policy 0, policy_version 665900 (0.0011) [2023-12-28 00:01:53,683][106226] Updated weights for policy 0, policy_version 665910 (0.0011) [2023-12-28 00:01:53,754][106226] Updated weights for policy 0, policy_version 665920 (0.0010) [2023-12-28 00:01:53,916][106225] Updated weights for policy 1, policy_version 667634 (0.0008) [2023-12-28 00:01:53,984][106225] Updated weights for policy 1, policy_version 667644 (0.0008) [2023-12-28 00:01:54,048][106225] Updated weights for policy 1, policy_version 667654 (0.0008) [2023-12-28 00:01:54,528][106226] Updated weights for policy 0, policy_version 665930 (0.0011) [2023-12-28 00:01:54,591][106226] Updated weights for policy 0, policy_version 665940 (0.0011) [2023-12-28 00:01:54,653][106226] Updated weights for policy 0, policy_version 665950 (0.0011) [2023-12-28 00:01:54,830][106225] Updated weights for policy 1, policy_version 667664 (0.0009) [2023-12-28 00:01:54,897][106225] Updated weights for policy 1, policy_version 667674 (0.0009) [2023-12-28 00:01:54,961][106225] Updated weights for policy 1, policy_version 667684 (0.0009) [2023-12-28 00:01:55,402][106226] Updated weights for policy 0, policy_version 665960 (0.0009) [2023-12-28 00:01:55,464][106226] Updated weights for policy 0, policy_version 665970 (0.0010) [2023-12-28 00:01:55,531][106226] Updated weights for policy 0, policy_version 665980 (0.0008) [2023-12-28 00:01:55,669][106225] Updated weights for policy 1, policy_version 667694 (0.0007) [2023-12-28 00:01:55,734][106225] Updated weights for policy 1, policy_version 667704 (0.0007) [2023-12-28 00:01:55,794][106225] Updated weights for policy 1, policy_version 667714 (0.0005) [2023-12-28 00:01:56,175][105115] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 18883.3). Total num frames: 341508096. Throughput: 0: 9056.8, 1: 8878.3. Samples: 341482892. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:01:56,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.210')] [2023-12-28 00:01:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000667720_170967040.pth... [2023-12-28 00:01:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000665984_170541056.pth... [2023-12-28 00:01:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000664928_170270720.pth [2023-12-28 00:01:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000666696_170704896.pth [2023-12-28 00:01:56,252][106226] Updated weights for policy 0, policy_version 665990 (0.0007) [2023-12-28 00:01:56,320][106226] Updated weights for policy 0, policy_version 666000 (0.0008) [2023-12-28 00:01:56,375][106226] Updated weights for policy 0, policy_version 666010 (0.0008) [2023-12-28 00:01:56,537][106225] Updated weights for policy 1, policy_version 667724 (0.0008) [2023-12-28 00:01:56,595][106225] Updated weights for policy 1, policy_version 667734 (0.0005) [2023-12-28 00:01:56,659][106225] Updated weights for policy 1, policy_version 667744 (0.0007) [2023-12-28 00:01:57,079][106226] Updated weights for policy 0, policy_version 666020 (0.0008) [2023-12-28 00:01:57,135][106226] Updated weights for policy 0, policy_version 666030 (0.0008) [2023-12-28 00:01:57,183][106226] Updated weights for policy 0, policy_version 666040 (0.0008) [2023-12-28 00:01:57,309][106225] Updated weights for policy 1, policy_version 667754 (0.0008) [2023-12-28 00:01:57,363][106225] Updated weights for policy 1, policy_version 667764 (0.0007) [2023-12-28 00:01:57,422][106225] Updated weights for policy 1, policy_version 667774 (0.0006) [2023-12-28 00:01:57,487][106225] Updated weights for policy 1, policy_version 667784 (0.0010) [2023-12-28 00:01:57,932][106226] Updated weights for policy 0, policy_version 666050 (0.0008) [2023-12-28 00:01:57,995][106226] Updated weights for policy 0, policy_version 666060 (0.0010) [2023-12-28 00:01:58,057][106226] Updated weights for policy 0, policy_version 666070 (0.0009) [2023-12-28 00:01:58,118][106226] Updated weights for policy 0, policy_version 666080 (0.0009) [2023-12-28 00:01:58,210][106225] Updated weights for policy 1, policy_version 667794 (0.0009) [2023-12-28 00:01:58,275][106225] Updated weights for policy 1, policy_version 667804 (0.0008) [2023-12-28 00:01:58,339][106225] Updated weights for policy 1, policy_version 667814 (0.0009) [2023-12-28 00:01:58,999][106226] Updated weights for policy 0, policy_version 666090 (0.0009) [2023-12-28 00:01:59,069][106226] Updated weights for policy 0, policy_version 666100 (0.0008) [2023-12-28 00:01:59,135][106226] Updated weights for policy 0, policy_version 666110 (0.0009) [2023-12-28 00:01:59,254][106225] Updated weights for policy 1, policy_version 667824 (0.0009) [2023-12-28 00:01:59,324][106225] Updated weights for policy 1, policy_version 667834 (0.0010) [2023-12-28 00:01:59,410][106225] Updated weights for policy 1, policy_version 667844 (0.0009) [2023-12-28 00:01:59,985][106226] Updated weights for policy 0, policy_version 666120 (0.0008) [2023-12-28 00:02:00,050][106226] Updated weights for policy 0, policy_version 666130 (0.0008) [2023-12-28 00:02:00,112][106226] Updated weights for policy 0, policy_version 666140 (0.0008) [2023-12-28 00:02:00,224][106225] Updated weights for policy 1, policy_version 667854 (0.0010) [2023-12-28 00:02:00,294][106225] Updated weights for policy 1, policy_version 667864 (0.0011) [2023-12-28 00:02:00,359][106225] Updated weights for policy 1, policy_version 667874 (0.0011) [2023-12-28 00:02:00,866][106226] Updated weights for policy 0, policy_version 666150 (0.0008) [2023-12-28 00:02:00,917][106226] Updated weights for policy 0, policy_version 666160 (0.0006) [2023-12-28 00:02:00,980][106226] Updated weights for policy 0, policy_version 666170 (0.0008) [2023-12-28 00:02:01,066][106225] Updated weights for policy 1, policy_version 667884 (0.0010) [2023-12-28 00:02:01,127][106225] Updated weights for policy 1, policy_version 667894 (0.0011) [2023-12-28 00:02:01,175][105115] Fps is (10 sec: 18021.2, 60 sec: 18022.2, 300 sec: 18855.4). Total num frames: 341598208. Throughput: 0: 9067.0, 1: 8926.7. Samples: 341590424. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:01,176][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.474')] [2023-12-28 00:02:01,199][106225] Updated weights for policy 1, policy_version 667904 (0.0012) [2023-12-28 00:02:01,830][106226] Updated weights for policy 0, policy_version 666180 (0.0007) [2023-12-28 00:02:01,898][106226] Updated weights for policy 0, policy_version 666190 (0.0008) [2023-12-28 00:02:01,953][106225] Updated weights for policy 1, policy_version 667914 (0.0010) [2023-12-28 00:02:01,966][106226] Updated weights for policy 0, policy_version 666200 (0.0007) [2023-12-28 00:02:02,019][106225] Updated weights for policy 1, policy_version 667924 (0.0007) [2023-12-28 00:02:02,086][106225] Updated weights for policy 1, policy_version 667934 (0.0008) [2023-12-28 00:02:02,149][106225] Updated weights for policy 1, policy_version 667944 (0.0008) [2023-12-28 00:02:02,705][106226] Updated weights for policy 0, policy_version 666210 (0.0007) [2023-12-28 00:02:02,764][106226] Updated weights for policy 0, policy_version 666220 (0.0008) [2023-12-28 00:02:02,826][106226] Updated weights for policy 0, policy_version 666230 (0.0009) [2023-12-28 00:02:02,872][106225] Updated weights for policy 1, policy_version 667954 (0.0007) [2023-12-28 00:02:02,894][106226] Updated weights for policy 0, policy_version 666240 (0.0007) [2023-12-28 00:02:02,939][106225] Updated weights for policy 1, policy_version 667964 (0.0009) [2023-12-28 00:02:03,002][106225] Updated weights for policy 1, policy_version 667974 (0.0007) [2023-12-28 00:02:03,679][106226] Updated weights for policy 0, policy_version 666250 (0.0008) [2023-12-28 00:02:03,686][106225] Updated weights for policy 1, policy_version 667984 (0.0006) [2023-12-28 00:02:03,742][106226] Updated weights for policy 0, policy_version 666260 (0.0005) [2023-12-28 00:02:03,742][106225] Updated weights for policy 1, policy_version 667994 (0.0009) [2023-12-28 00:02:03,802][106225] Updated weights for policy 1, policy_version 668004 (0.0008) [2023-12-28 00:02:03,811][106226] Updated weights for policy 0, policy_version 666270 (0.0006) [2023-12-28 00:02:04,550][106226] Updated weights for policy 0, policy_version 666280 (0.0008) [2023-12-28 00:02:04,615][106225] Updated weights for policy 1, policy_version 668014 (0.0008) [2023-12-28 00:02:04,617][106226] Updated weights for policy 0, policy_version 666290 (0.0009) [2023-12-28 00:02:04,675][106225] Updated weights for policy 1, policy_version 668024 (0.0007) [2023-12-28 00:02:04,681][106226] Updated weights for policy 0, policy_version 666300 (0.0007) [2023-12-28 00:02:04,734][106225] Updated weights for policy 1, policy_version 668034 (0.0008) [2023-12-28 00:02:05,438][106226] Updated weights for policy 0, policy_version 666310 (0.0007) [2023-12-28 00:02:05,467][106225] Updated weights for policy 1, policy_version 668044 (0.0008) [2023-12-28 00:02:05,498][106226] Updated weights for policy 0, policy_version 666320 (0.0006) [2023-12-28 00:02:05,526][106225] Updated weights for policy 1, policy_version 668054 (0.0008) [2023-12-28 00:02:05,561][106226] Updated weights for policy 0, policy_version 666330 (0.0008) [2023-12-28 00:02:05,592][106225] Updated weights for policy 1, policy_version 668064 (0.0007) [2023-12-28 00:02:06,175][105115] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 18827.7). Total num frames: 341688320. Throughput: 0: 9077.3, 1: 8937.1. Samples: 341700764. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:06,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.429')] [2023-12-28 00:02:06,317][106226] Updated weights for policy 0, policy_version 666340 (0.0008) [2023-12-28 00:02:06,354][106225] Updated weights for policy 1, policy_version 668074 (0.0007) [2023-12-28 00:02:06,388][106226] Updated weights for policy 0, policy_version 666350 (0.0009) [2023-12-28 00:02:06,423][106225] Updated weights for policy 1, policy_version 668084 (0.0008) [2023-12-28 00:02:06,455][106226] Updated weights for policy 0, policy_version 666360 (0.0008) [2023-12-28 00:02:06,491][106225] Updated weights for policy 1, policy_version 668094 (0.0008) [2023-12-28 00:02:06,554][106225] Updated weights for policy 1, policy_version 668104 (0.0009) [2023-12-28 00:02:07,233][106226] Updated weights for policy 0, policy_version 666370 (0.0009) [2023-12-28 00:02:07,302][106226] Updated weights for policy 0, policy_version 666380 (0.0006) [2023-12-28 00:02:07,312][106225] Updated weights for policy 1, policy_version 668114 (0.0008) [2023-12-28 00:02:07,365][106226] Updated weights for policy 0, policy_version 666390 (0.0007) [2023-12-28 00:02:07,375][106225] Updated weights for policy 1, policy_version 668124 (0.0006) [2023-12-28 00:02:07,426][106226] Updated weights for policy 0, policy_version 666400 (0.0008) [2023-12-28 00:02:07,438][106225] Updated weights for policy 1, policy_version 668134 (0.0009) [2023-12-28 00:02:08,147][106225] Updated weights for policy 1, policy_version 668144 (0.0009) [2023-12-28 00:02:08,188][106226] Updated weights for policy 0, policy_version 666410 (0.0011) [2023-12-28 00:02:08,205][106225] Updated weights for policy 1, policy_version 668154 (0.0006) [2023-12-28 00:02:08,247][106226] Updated weights for policy 0, policy_version 666420 (0.0011) [2023-12-28 00:02:08,265][106225] Updated weights for policy 1, policy_version 668164 (0.0006) [2023-12-28 00:02:08,307][106226] Updated weights for policy 0, policy_version 666430 (0.0011) [2023-12-28 00:02:09,081][106225] Updated weights for policy 1, policy_version 668174 (0.0007) [2023-12-28 00:02:09,096][106226] Updated weights for policy 0, policy_version 666440 (0.0008) [2023-12-28 00:02:09,151][106225] Updated weights for policy 1, policy_version 668184 (0.0007) [2023-12-28 00:02:09,168][106226] Updated weights for policy 0, policy_version 666450 (0.0008) [2023-12-28 00:02:09,225][106225] Updated weights for policy 1, policy_version 668194 (0.0009) [2023-12-28 00:02:09,242][106226] Updated weights for policy 0, policy_version 666460 (0.0008) [2023-12-28 00:02:10,078][106226] Updated weights for policy 0, policy_version 666470 (0.0008) [2023-12-28 00:02:10,093][106225] Updated weights for policy 1, policy_version 668204 (0.0009) [2023-12-28 00:02:10,151][106226] Updated weights for policy 0, policy_version 666480 (0.0008) [2023-12-28 00:02:10,162][106225] Updated weights for policy 1, policy_version 668214 (0.0007) [2023-12-28 00:02:10,219][106226] Updated weights for policy 0, policy_version 666490 (0.0007) [2023-12-28 00:02:10,228][106225] Updated weights for policy 1, policy_version 668224 (0.0008) [2023-12-28 00:02:10,944][106226] Updated weights for policy 0, policy_version 666500 (0.0006) [2023-12-28 00:02:10,977][106225] Updated weights for policy 1, policy_version 668234 (0.0009) [2023-12-28 00:02:11,008][106226] Updated weights for policy 0, policy_version 666510 (0.0006) [2023-12-28 00:02:11,056][106225] Updated weights for policy 1, policy_version 668244 (0.0008) [2023-12-28 00:02:11,090][106226] Updated weights for policy 0, policy_version 666520 (0.0008) [2023-12-28 00:02:11,127][106225] Updated weights for policy 1, policy_version 668254 (0.0008) [2023-12-28 00:02:11,175][105115] Fps is (10 sec: 18023.3, 60 sec: 18022.4, 300 sec: 18799.9). Total num frames: 341778432. Throughput: 0: 9093.4, 1: 8984.4. Samples: 341755492. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:11,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.690')] [2023-12-28 00:02:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000666528_170680320.pth... [2023-12-28 00:02:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000665472_170409984.pth [2023-12-28 00:02:11,206][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000668264_171106304.pth... [2023-12-28 00:02:11,209][106225] Updated weights for policy 1, policy_version 668264 (0.0008) [2023-12-28 00:02:11,210][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000667208_170835968.pth [2023-12-28 00:02:12,010][106226] Updated weights for policy 0, policy_version 666530 (0.0008) [2023-12-28 00:02:12,076][106226] Updated weights for policy 0, policy_version 666540 (0.0008) [2023-12-28 00:02:12,097][106225] Updated weights for policy 1, policy_version 668274 (0.0009) [2023-12-28 00:02:12,143][106226] Updated weights for policy 0, policy_version 666550 (0.0009) [2023-12-28 00:02:12,162][106225] Updated weights for policy 1, policy_version 668284 (0.0007) [2023-12-28 00:02:12,211][106226] Updated weights for policy 0, policy_version 666560 (0.0009) [2023-12-28 00:02:12,228][106225] Updated weights for policy 1, policy_version 668294 (0.0007) [2023-12-28 00:02:13,060][106226] Updated weights for policy 0, policy_version 666570 (0.0008) [2023-12-28 00:02:13,067][106225] Updated weights for policy 1, policy_version 668304 (0.0007) [2023-12-28 00:02:13,125][106226] Updated weights for policy 0, policy_version 666580 (0.0011) [2023-12-28 00:02:13,134][106225] Updated weights for policy 1, policy_version 668314 (0.0006) [2023-12-28 00:02:13,187][106226] Updated weights for policy 0, policy_version 666590 (0.0011) [2023-12-28 00:02:13,199][106225] Updated weights for policy 1, policy_version 668324 (0.0007) [2023-12-28 00:02:13,939][106225] Updated weights for policy 1, policy_version 668334 (0.0010) [2023-12-28 00:02:13,953][106226] Updated weights for policy 0, policy_version 666600 (0.0010) [2023-12-28 00:02:14,008][106225] Updated weights for policy 1, policy_version 668344 (0.0010) [2023-12-28 00:02:14,015][106226] Updated weights for policy 0, policy_version 666610 (0.0008) [2023-12-28 00:02:14,065][106225] Updated weights for policy 1, policy_version 668354 (0.0010) [2023-12-28 00:02:14,078][106226] Updated weights for policy 0, policy_version 666620 (0.0007) [2023-12-28 00:02:14,755][106226] Updated weights for policy 0, policy_version 666630 (0.0011) [2023-12-28 00:02:14,784][106225] Updated weights for policy 1, policy_version 668364 (0.0010) [2023-12-28 00:02:14,822][106226] Updated weights for policy 0, policy_version 666640 (0.0010) [2023-12-28 00:02:14,858][106225] Updated weights for policy 1, policy_version 668374 (0.0009) [2023-12-28 00:02:14,887][106226] Updated weights for policy 0, policy_version 666650 (0.0012) [2023-12-28 00:02:14,925][106225] Updated weights for policy 1, policy_version 668384 (0.0011) [2023-12-28 00:02:15,640][106225] Updated weights for policy 1, policy_version 668394 (0.0010) [2023-12-28 00:02:15,659][106226] Updated weights for policy 0, policy_version 666660 (0.0009) [2023-12-28 00:02:15,703][106225] Updated weights for policy 1, policy_version 668404 (0.0010) [2023-12-28 00:02:15,722][106226] Updated weights for policy 0, policy_version 666670 (0.0011) [2023-12-28 00:02:15,762][106225] Updated weights for policy 1, policy_version 668414 (0.0010) [2023-12-28 00:02:15,786][106226] Updated weights for policy 0, policy_version 666680 (0.0011) [2023-12-28 00:02:15,826][106225] Updated weights for policy 1, policy_version 668424 (0.0011) [2023-12-28 00:02:16,174][105115] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 18800.0). Total num frames: 341868544. Throughput: 0: 8987.2, 1: 8904.5. Samples: 341858356. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:16,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-5.282')] [2023-12-28 00:02:16,497][106226] Updated weights for policy 0, policy_version 666690 (0.0010) [2023-12-28 00:02:16,564][106226] Updated weights for policy 0, policy_version 666700 (0.0007) [2023-12-28 00:02:16,620][106225] Updated weights for policy 1, policy_version 668434 (0.0009) [2023-12-28 00:02:16,626][106226] Updated weights for policy 0, policy_version 666710 (0.0009) [2023-12-28 00:02:16,680][106225] Updated weights for policy 1, policy_version 668444 (0.0007) [2023-12-28 00:02:16,690][106226] Updated weights for policy 0, policy_version 666720 (0.0007) [2023-12-28 00:02:16,744][106225] Updated weights for policy 1, policy_version 668454 (0.0008) [2023-12-28 00:02:17,413][106226] Updated weights for policy 0, policy_version 666730 (0.0005) [2023-12-28 00:02:17,474][106226] Updated weights for policy 0, policy_version 666740 (0.0006) [2023-12-28 00:02:17,510][106225] Updated weights for policy 1, policy_version 668464 (0.0007) [2023-12-28 00:02:17,536][106226] Updated weights for policy 0, policy_version 666750 (0.0007) [2023-12-28 00:02:17,578][106225] Updated weights for policy 1, policy_version 668474 (0.0008) [2023-12-28 00:02:17,646][106225] Updated weights for policy 1, policy_version 668484 (0.0009) [2023-12-28 00:02:18,240][106226] Updated weights for policy 0, policy_version 666760 (0.0008) [2023-12-28 00:02:18,302][106226] Updated weights for policy 0, policy_version 666770 (0.0008) [2023-12-28 00:02:18,343][106225] Updated weights for policy 1, policy_version 668494 (0.0009) [2023-12-28 00:02:18,376][106226] Updated weights for policy 0, policy_version 666780 (0.0008) [2023-12-28 00:02:18,416][106225] Updated weights for policy 1, policy_version 668504 (0.0009) [2023-12-28 00:02:18,479][106225] Updated weights for policy 1, policy_version 668514 (0.0007) [2023-12-28 00:02:19,120][106226] Updated weights for policy 0, policy_version 666790 (0.0008) [2023-12-28 00:02:19,179][106226] Updated weights for policy 0, policy_version 666800 (0.0009) [2023-12-28 00:02:19,179][106225] Updated weights for policy 1, policy_version 668524 (0.0010) [2023-12-28 00:02:19,253][106225] Updated weights for policy 1, policy_version 668534 (0.0011) [2023-12-28 00:02:19,256][106226] Updated weights for policy 0, policy_version 666810 (0.0009) [2023-12-28 00:02:19,318][106225] Updated weights for policy 1, policy_version 668544 (0.0009) [2023-12-28 00:02:20,057][106226] Updated weights for policy 0, policy_version 666820 (0.0007) [2023-12-28 00:02:20,124][106226] Updated weights for policy 0, policy_version 666830 (0.0008) [2023-12-28 00:02:20,158][106225] Updated weights for policy 1, policy_version 668555 (0.0011) [2023-12-28 00:02:20,197][106226] Updated weights for policy 0, policy_version 666840 (0.0009) [2023-12-28 00:02:20,228][106225] Updated weights for policy 1, policy_version 668565 (0.0011) [2023-12-28 00:02:20,296][106225] Updated weights for policy 1, policy_version 668575 (0.0011) [2023-12-28 00:02:21,014][106226] Updated weights for policy 0, policy_version 666850 (0.0007) [2023-12-28 00:02:21,088][106226] Updated weights for policy 0, policy_version 666860 (0.0009) [2023-12-28 00:02:21,145][106225] Updated weights for policy 1, policy_version 668585 (0.0010) [2023-12-28 00:02:21,159][106226] Updated weights for policy 0, policy_version 666870 (0.0009) [2023-12-28 00:02:21,175][105115] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 18744.4). Total num frames: 341950464. Throughput: 0: 8963.2, 1: 8896.4. Samples: 341967104. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:21,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.583')] [2023-12-28 00:02:21,215][106225] Updated weights for policy 1, policy_version 668595 (0.0010) [2023-12-28 00:02:21,231][106226] Updated weights for policy 0, policy_version 666880 (0.0009) [2023-12-28 00:02:21,291][106225] Updated weights for policy 1, policy_version 668605 (0.0009) [2023-12-28 00:02:21,361][106225] Updated weights for policy 1, policy_version 668615 (0.0007) [2023-12-28 00:02:22,117][106226] Updated weights for policy 0, policy_version 666890 (0.0008) [2023-12-28 00:02:22,190][106226] Updated weights for policy 0, policy_version 666900 (0.0008) [2023-12-28 00:02:22,234][106225] Updated weights for policy 1, policy_version 668625 (0.0011) [2023-12-28 00:02:22,264][106226] Updated weights for policy 0, policy_version 666910 (0.0009) [2023-12-28 00:02:22,306][106225] Updated weights for policy 1, policy_version 668635 (0.0009) [2023-12-28 00:02:22,380][106225] Updated weights for policy 1, policy_version 668645 (0.0010) [2023-12-28 00:02:23,021][106226] Updated weights for policy 0, policy_version 666920 (0.0008) [2023-12-28 00:02:23,085][106226] Updated weights for policy 0, policy_version 666930 (0.0008) [2023-12-28 00:02:23,152][106226] Updated weights for policy 0, policy_version 666940 (0.0009) [2023-12-28 00:02:23,168][106225] Updated weights for policy 1, policy_version 668655 (0.0009) [2023-12-28 00:02:23,226][106225] Updated weights for policy 1, policy_version 668665 (0.0009) [2023-12-28 00:02:23,285][106225] Updated weights for policy 1, policy_version 668675 (0.0009) [2023-12-28 00:02:23,885][106226] Updated weights for policy 0, policy_version 666950 (0.0008) [2023-12-28 00:02:23,954][106226] Updated weights for policy 0, policy_version 666960 (0.0007) [2023-12-28 00:02:24,025][106226] Updated weights for policy 0, policy_version 666970 (0.0009) [2023-12-28 00:02:24,091][106225] Updated weights for policy 1, policy_version 668685 (0.0009) [2023-12-28 00:02:24,163][106225] Updated weights for policy 1, policy_version 668695 (0.0008) [2023-12-28 00:02:24,229][106225] Updated weights for policy 1, policy_version 668705 (0.0009) [2023-12-28 00:02:24,821][106226] Updated weights for policy 0, policy_version 666980 (0.0009) [2023-12-28 00:02:24,886][106226] Updated weights for policy 0, policy_version 666990 (0.0009) [2023-12-28 00:02:24,951][106226] Updated weights for policy 0, policy_version 667000 (0.0008) [2023-12-28 00:02:24,969][106225] Updated weights for policy 1, policy_version 668715 (0.0009) [2023-12-28 00:02:25,031][106225] Updated weights for policy 1, policy_version 668725 (0.0007) [2023-12-28 00:02:25,092][106225] Updated weights for policy 1, policy_version 668735 (0.0009) [2023-12-28 00:02:25,713][106226] Updated weights for policy 0, policy_version 667010 (0.0006) [2023-12-28 00:02:25,783][106226] Updated weights for policy 0, policy_version 667020 (0.0009) [2023-12-28 00:02:25,845][106225] Updated weights for policy 1, policy_version 668745 (0.0009) [2023-12-28 00:02:25,847][106226] Updated weights for policy 0, policy_version 667030 (0.0009) [2023-12-28 00:02:25,906][106225] Updated weights for policy 1, policy_version 668755 (0.0008) [2023-12-28 00:02:25,908][106226] Updated weights for policy 0, policy_version 667040 (0.0006) [2023-12-28 00:02:25,972][106225] Updated weights for policy 1, policy_version 668765 (0.0008) [2023-12-28 00:02:26,033][106225] Updated weights for policy 1, policy_version 668775 (0.0009) [2023-12-28 00:02:26,175][105115] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 18716.6). Total num frames: 342048768. Throughput: 0: 8939.5, 1: 8862.3. Samples: 342017848. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:26,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.284')] [2023-12-28 00:02:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000668776_171237376.pth... [2023-12-28 00:02:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000667040_170811392.pth... [2023-12-28 00:02:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000665984_170541056.pth [2023-12-28 00:02:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000667720_170967040.pth [2023-12-28 00:02:26,665][106226] Updated weights for policy 0, policy_version 667050 (0.0009) [2023-12-28 00:02:26,723][106226] Updated weights for policy 0, policy_version 667060 (0.0008) [2023-12-28 00:02:26,763][106225] Updated weights for policy 1, policy_version 668785 (0.0008) [2023-12-28 00:02:26,781][106226] Updated weights for policy 0, policy_version 667070 (0.0009) [2023-12-28 00:02:26,826][106225] Updated weights for policy 1, policy_version 668795 (0.0008) [2023-12-28 00:02:26,886][106225] Updated weights for policy 1, policy_version 668805 (0.0009) [2023-12-28 00:02:27,506][106226] Updated weights for policy 0, policy_version 667080 (0.0008) [2023-12-28 00:02:27,560][106226] Updated weights for policy 0, policy_version 667090 (0.0009) [2023-12-28 00:02:27,612][106226] Updated weights for policy 0, policy_version 667100 (0.0009) [2023-12-28 00:02:27,655][106225] Updated weights for policy 1, policy_version 668815 (0.0009) [2023-12-28 00:02:27,716][106225] Updated weights for policy 1, policy_version 668825 (0.0009) [2023-12-28 00:02:27,771][106225] Updated weights for policy 1, policy_version 668835 (0.0008) [2023-12-28 00:02:28,382][106226] Updated weights for policy 0, policy_version 667110 (0.0008) [2023-12-28 00:02:28,446][106226] Updated weights for policy 0, policy_version 667120 (0.0011) [2023-12-28 00:02:28,502][106226] Updated weights for policy 0, policy_version 667130 (0.0011) [2023-12-28 00:02:28,548][106225] Updated weights for policy 1, policy_version 668845 (0.0008) [2023-12-28 00:02:28,610][106225] Updated weights for policy 1, policy_version 668855 (0.0008) [2023-12-28 00:02:28,672][106225] Updated weights for policy 1, policy_version 668865 (0.0008) [2023-12-28 00:02:29,285][106226] Updated weights for policy 0, policy_version 667140 (0.0011) [2023-12-28 00:02:29,353][106226] Updated weights for policy 0, policy_version 667150 (0.0010) [2023-12-28 00:02:29,426][106226] Updated weights for policy 0, policy_version 667160 (0.0009) [2023-12-28 00:02:29,447][106225] Updated weights for policy 1, policy_version 668875 (0.0008) [2023-12-28 00:02:29,511][106225] Updated weights for policy 1, policy_version 668885 (0.0008) [2023-12-28 00:02:29,566][106225] Updated weights for policy 1, policy_version 668895 (0.0008) [2023-12-28 00:02:30,173][106226] Updated weights for policy 0, policy_version 667170 (0.0007) [2023-12-28 00:02:30,240][106226] Updated weights for policy 0, policy_version 667180 (0.0008) [2023-12-28 00:02:30,303][106226] Updated weights for policy 0, policy_version 667190 (0.0007) [2023-12-28 00:02:30,353][106225] Updated weights for policy 1, policy_version 668905 (0.0008) [2023-12-28 00:02:30,371][106226] Updated weights for policy 0, policy_version 667200 (0.0008) [2023-12-28 00:02:30,415][106225] Updated weights for policy 1, policy_version 668915 (0.0009) [2023-12-28 00:02:30,482][106225] Updated weights for policy 1, policy_version 668925 (0.0008) [2023-12-28 00:02:30,545][106225] Updated weights for policy 1, policy_version 668935 (0.0009) [2023-12-28 00:02:31,074][106226] Updated weights for policy 0, policy_version 667210 (0.0010) [2023-12-28 00:02:31,147][106226] Updated weights for policy 0, policy_version 667220 (0.0011) [2023-12-28 00:02:31,174][105115] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 18688.9). Total num frames: 342130688. Throughput: 0: 8967.1, 1: 8959.1. Samples: 342127604. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:31,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.309')] [2023-12-28 00:02:31,217][106226] Updated weights for policy 0, policy_version 667230 (0.0011) [2023-12-28 00:02:31,276][106225] Updated weights for policy 1, policy_version 668945 (0.0011) [2023-12-28 00:02:31,343][106225] Updated weights for policy 1, policy_version 668955 (0.0009) [2023-12-28 00:02:31,410][106225] Updated weights for policy 1, policy_version 668965 (0.0008) [2023-12-28 00:02:31,989][106226] Updated weights for policy 0, policy_version 667240 (0.0008) [2023-12-28 00:02:32,049][106226] Updated weights for policy 0, policy_version 667250 (0.0008) [2023-12-28 00:02:32,115][106226] Updated weights for policy 0, policy_version 667260 (0.0008) [2023-12-28 00:02:32,160][106225] Updated weights for policy 1, policy_version 668975 (0.0009) [2023-12-28 00:02:32,215][106225] Updated weights for policy 1, policy_version 668985 (0.0010) [2023-12-28 00:02:32,282][106225] Updated weights for policy 1, policy_version 668995 (0.0008) [2023-12-28 00:02:32,894][106226] Updated weights for policy 0, policy_version 667270 (0.0007) [2023-12-28 00:02:32,960][106226] Updated weights for policy 0, policy_version 667280 (0.0009) [2023-12-28 00:02:33,012][106225] Updated weights for policy 1, policy_version 669005 (0.0009) [2023-12-28 00:02:33,013][106226] Updated weights for policy 0, policy_version 667290 (0.0007) [2023-12-28 00:02:33,070][106225] Updated weights for policy 1, policy_version 669015 (0.0008) [2023-12-28 00:02:33,130][106225] Updated weights for policy 1, policy_version 669025 (0.0009) [2023-12-28 00:02:33,679][106226] Updated weights for policy 0, policy_version 667300 (0.0008) [2023-12-28 00:02:33,748][106226] Updated weights for policy 0, policy_version 667310 (0.0009) [2023-12-28 00:02:33,807][106226] Updated weights for policy 0, policy_version 667320 (0.0007) [2023-12-28 00:02:33,907][106225] Updated weights for policy 1, policy_version 669035 (0.0009) [2023-12-28 00:02:33,964][106225] Updated weights for policy 1, policy_version 669045 (0.0008) [2023-12-28 00:02:34,023][106225] Updated weights for policy 1, policy_version 669055 (0.0010) [2023-12-28 00:02:34,463][106226] Updated weights for policy 0, policy_version 667330 (0.0006) [2023-12-28 00:02:34,531][106226] Updated weights for policy 0, policy_version 667340 (0.0008) [2023-12-28 00:02:34,602][106226] Updated weights for policy 0, policy_version 667350 (0.0007) [2023-12-28 00:02:34,673][106226] Updated weights for policy 0, policy_version 667360 (0.0010) [2023-12-28 00:02:34,858][106225] Updated weights for policy 1, policy_version 669065 (0.0010) [2023-12-28 00:02:34,924][106225] Updated weights for policy 1, policy_version 669075 (0.0011) [2023-12-28 00:02:34,985][106225] Updated weights for policy 1, policy_version 669085 (0.0010) [2023-12-28 00:02:35,049][106225] Updated weights for policy 1, policy_version 669095 (0.0009) [2023-12-28 00:02:35,391][106226] Updated weights for policy 0, policy_version 667370 (0.0006) [2023-12-28 00:02:35,446][106226] Updated weights for policy 0, policy_version 667380 (0.0008) [2023-12-28 00:02:35,493][106226] Updated weights for policy 0, policy_version 667390 (0.0008) [2023-12-28 00:02:35,782][106225] Updated weights for policy 1, policy_version 669105 (0.0011) [2023-12-28 00:02:35,845][106225] Updated weights for policy 1, policy_version 669115 (0.0011) [2023-12-28 00:02:35,908][106225] Updated weights for policy 1, policy_version 669125 (0.0011) [2023-12-28 00:02:36,175][105115] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 18688.9). Total num frames: 342228992. Throughput: 0: 9021.2, 1: 8975.3. Samples: 342239504. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:36,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-5.389')] [2023-12-28 00:02:36,206][106226] Updated weights for policy 0, policy_version 667400 (0.0009) [2023-12-28 00:02:36,270][106226] Updated weights for policy 0, policy_version 667410 (0.0008) [2023-12-28 00:02:36,337][106226] Updated weights for policy 0, policy_version 667420 (0.0008) [2023-12-28 00:02:36,681][106225] Updated weights for policy 1, policy_version 669135 (0.0010) [2023-12-28 00:02:36,750][106225] Updated weights for policy 1, policy_version 669145 (0.0008) [2023-12-28 00:02:36,819][106225] Updated weights for policy 1, policy_version 669155 (0.0011) [2023-12-28 00:02:37,141][106226] Updated weights for policy 0, policy_version 667430 (0.0007) [2023-12-28 00:02:37,206][106226] Updated weights for policy 0, policy_version 667440 (0.0010) [2023-12-28 00:02:37,265][106226] Updated weights for policy 0, policy_version 667450 (0.0010) [2023-12-28 00:02:37,562][106225] Updated weights for policy 1, policy_version 669165 (0.0011) [2023-12-28 00:02:37,631][106225] Updated weights for policy 1, policy_version 669175 (0.0010) [2023-12-28 00:02:37,694][106225] Updated weights for policy 1, policy_version 669185 (0.0008) [2023-12-28 00:02:38,020][106226] Updated weights for policy 0, policy_version 667460 (0.0011) [2023-12-28 00:02:38,082][106226] Updated weights for policy 0, policy_version 667470 (0.0011) [2023-12-28 00:02:38,143][106226] Updated weights for policy 0, policy_version 667480 (0.0007) [2023-12-28 00:02:38,506][106225] Updated weights for policy 1, policy_version 669195 (0.0009) [2023-12-28 00:02:38,573][106225] Updated weights for policy 1, policy_version 669205 (0.0010) [2023-12-28 00:02:38,639][106225] Updated weights for policy 1, policy_version 669215 (0.0010) [2023-12-28 00:02:38,913][106226] Updated weights for policy 0, policy_version 667490 (0.0010) [2023-12-28 00:02:38,979][106226] Updated weights for policy 0, policy_version 667500 (0.0009) [2023-12-28 00:02:39,037][106226] Updated weights for policy 0, policy_version 667510 (0.0009) [2023-12-28 00:02:39,101][106226] Updated weights for policy 0, policy_version 667520 (0.0009) [2023-12-28 00:02:39,451][106225] Updated weights for policy 1, policy_version 669225 (0.0010) [2023-12-28 00:02:39,521][106225] Updated weights for policy 1, policy_version 669235 (0.0011) [2023-12-28 00:02:39,594][106225] Updated weights for policy 1, policy_version 669245 (0.0011) [2023-12-28 00:02:39,667][106225] Updated weights for policy 1, policy_version 669255 (0.0011) [2023-12-28 00:02:40,046][106226] Updated weights for policy 0, policy_version 667530 (0.0009) [2023-12-28 00:02:40,109][106226] Updated weights for policy 0, policy_version 667540 (0.0009) [2023-12-28 00:02:40,171][106226] Updated weights for policy 0, policy_version 667550 (0.0009) [2023-12-28 00:02:40,519][106225] Updated weights for policy 1, policy_version 669265 (0.0009) [2023-12-28 00:02:40,585][106225] Updated weights for policy 1, policy_version 669275 (0.0009) [2023-12-28 00:02:40,647][106225] Updated weights for policy 1, policy_version 669285 (0.0009) [2023-12-28 00:02:41,076][106226] Updated weights for policy 0, policy_version 667560 (0.0009) [2023-12-28 00:02:41,156][106226] Updated weights for policy 0, policy_version 667570 (0.0009) [2023-12-28 00:02:41,175][105115] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 18633.3). Total num frames: 342310912. Throughput: 0: 9016.3, 1: 8991.4. Samples: 342293244. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:41,176][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.244')] [2023-12-28 00:02:41,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000669288_171368448.pth... [2023-12-28 00:02:41,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000668264_171106304.pth [2023-12-28 00:02:41,222][106226] Updated weights for policy 0, policy_version 667580 (0.0009) [2023-12-28 00:02:41,249][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000667584_170950656.pth... [2023-12-28 00:02:41,253][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000666528_170680320.pth [2023-12-28 00:02:41,497][106225] Updated weights for policy 1, policy_version 669295 (0.0009) [2023-12-28 00:02:41,564][106225] Updated weights for policy 1, policy_version 669305 (0.0009) [2023-12-28 00:02:41,636][106225] Updated weights for policy 1, policy_version 669315 (0.0009) [2023-12-28 00:02:42,070][106226] Updated weights for policy 0, policy_version 667590 (0.0008) [2023-12-28 00:02:42,145][106226] Updated weights for policy 0, policy_version 667600 (0.0008) [2023-12-28 00:02:42,215][106226] Updated weights for policy 0, policy_version 667610 (0.0008) [2023-12-28 00:02:42,457][106225] Updated weights for policy 1, policy_version 669325 (0.0009) [2023-12-28 00:02:42,526][106225] Updated weights for policy 1, policy_version 669335 (0.0009) [2023-12-28 00:02:42,602][106225] Updated weights for policy 1, policy_version 669345 (0.0009) [2023-12-28 00:02:43,067][106226] Updated weights for policy 0, policy_version 667620 (0.0009) [2023-12-28 00:02:43,135][106226] Updated weights for policy 0, policy_version 667630 (0.0011) [2023-12-28 00:02:43,205][106226] Updated weights for policy 0, policy_version 667640 (0.0011) [2023-12-28 00:02:43,348][106225] Updated weights for policy 1, policy_version 669355 (0.0009) [2023-12-28 00:02:43,415][106225] Updated weights for policy 1, policy_version 669365 (0.0009) [2023-12-28 00:02:43,471][106225] Updated weights for policy 1, policy_version 669375 (0.0008) [2023-12-28 00:02:43,908][106226] Updated weights for policy 0, policy_version 667650 (0.0009) [2023-12-28 00:02:43,976][106226] Updated weights for policy 0, policy_version 667660 (0.0010) [2023-12-28 00:02:44,047][106226] Updated weights for policy 0, policy_version 667670 (0.0008) [2023-12-28 00:02:44,119][106226] Updated weights for policy 0, policy_version 667680 (0.0008) [2023-12-28 00:02:44,222][106225] Updated weights for policy 1, policy_version 669385 (0.0010) [2023-12-28 00:02:44,287][106225] Updated weights for policy 1, policy_version 669395 (0.0006) [2023-12-28 00:02:44,356][106225] Updated weights for policy 1, policy_version 669405 (0.0007) [2023-12-28 00:02:44,411][106225] Updated weights for policy 1, policy_version 669415 (0.0008) [2023-12-28 00:02:44,824][106226] Updated weights for policy 0, policy_version 667690 (0.0009) [2023-12-28 00:02:44,893][106226] Updated weights for policy 0, policy_version 667700 (0.0008) [2023-12-28 00:02:44,958][106226] Updated weights for policy 0, policy_version 667710 (0.0008) [2023-12-28 00:02:45,189][106225] Updated weights for policy 1, policy_version 669425 (0.0008) [2023-12-28 00:02:45,256][106225] Updated weights for policy 1, policy_version 669435 (0.0009) [2023-12-28 00:02:45,324][106225] Updated weights for policy 1, policy_version 669445 (0.0008) [2023-12-28 00:02:45,730][106226] Updated weights for policy 0, policy_version 667720 (0.0009) [2023-12-28 00:02:45,800][106226] Updated weights for policy 0, policy_version 667730 (0.0006) [2023-12-28 00:02:45,863][106226] Updated weights for policy 0, policy_version 667740 (0.0011) [2023-12-28 00:02:46,062][106225] Updated weights for policy 1, policy_version 669455 (0.0008) [2023-12-28 00:02:46,127][106225] Updated weights for policy 1, policy_version 669465 (0.0008) [2023-12-28 00:02:46,174][105115] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 18605.6). Total num frames: 342401024. Throughput: 0: 8965.4, 1: 8932.2. Samples: 342395804. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:46,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-5.311')] [2023-12-28 00:02:46,179][106225] Updated weights for policy 1, policy_version 669475 (0.0008) [2023-12-28 00:02:46,560][106226] Updated weights for policy 0, policy_version 667750 (0.0009) [2023-12-28 00:02:46,617][106226] Updated weights for policy 0, policy_version 667760 (0.0007) [2023-12-28 00:02:46,681][106226] Updated weights for policy 0, policy_version 667770 (0.0008) [2023-12-28 00:02:46,937][106225] Updated weights for policy 1, policy_version 669485 (0.0009) [2023-12-28 00:02:46,993][106225] Updated weights for policy 1, policy_version 669495 (0.0008) [2023-12-28 00:02:47,056][106225] Updated weights for policy 1, policy_version 669505 (0.0007) [2023-12-28 00:02:47,413][106226] Updated weights for policy 0, policy_version 667780 (0.0009) [2023-12-28 00:02:47,475][106226] Updated weights for policy 0, policy_version 667790 (0.0006) [2023-12-28 00:02:47,528][106226] Updated weights for policy 0, policy_version 667800 (0.0006) [2023-12-28 00:02:47,834][106225] Updated weights for policy 1, policy_version 669515 (0.0008) [2023-12-28 00:02:47,898][106225] Updated weights for policy 1, policy_version 669525 (0.0008) [2023-12-28 00:02:47,961][106225] Updated weights for policy 1, policy_version 669535 (0.0009) [2023-12-28 00:02:48,203][106226] Updated weights for policy 0, policy_version 667810 (0.0006) [2023-12-28 00:02:48,266][106226] Updated weights for policy 0, policy_version 667820 (0.0006) [2023-12-28 00:02:48,340][106226] Updated weights for policy 0, policy_version 667830 (0.0007) [2023-12-28 00:02:48,413][106226] Updated weights for policy 0, policy_version 667840 (0.0009) [2023-12-28 00:02:48,690][106225] Updated weights for policy 1, policy_version 669545 (0.0008) [2023-12-28 00:02:48,758][106225] Updated weights for policy 1, policy_version 669555 (0.0010) [2023-12-28 00:02:48,827][106225] Updated weights for policy 1, policy_version 669565 (0.0011) [2023-12-28 00:02:48,894][106225] Updated weights for policy 1, policy_version 669575 (0.0008) [2023-12-28 00:02:49,144][106226] Updated weights for policy 0, policy_version 667850 (0.0008) [2023-12-28 00:02:49,199][106226] Updated weights for policy 0, policy_version 667860 (0.0008) [2023-12-28 00:02:49,267][106226] Updated weights for policy 0, policy_version 667870 (0.0008) [2023-12-28 00:02:49,588][106225] Updated weights for policy 1, policy_version 669585 (0.0008) [2023-12-28 00:02:49,655][106225] Updated weights for policy 1, policy_version 669595 (0.0009) [2023-12-28 00:02:49,717][106225] Updated weights for policy 1, policy_version 669605 (0.0007) [2023-12-28 00:02:50,045][106226] Updated weights for policy 0, policy_version 667880 (0.0008) [2023-12-28 00:02:50,105][106226] Updated weights for policy 0, policy_version 667890 (0.0008) [2023-12-28 00:02:50,166][106226] Updated weights for policy 0, policy_version 667900 (0.0008) [2023-12-28 00:02:50,492][106225] Updated weights for policy 1, policy_version 669615 (0.0009) [2023-12-28 00:02:50,556][106225] Updated weights for policy 1, policy_version 669625 (0.0008) [2023-12-28 00:02:50,630][106225] Updated weights for policy 1, policy_version 669635 (0.0009) [2023-12-28 00:02:50,940][106226] Updated weights for policy 0, policy_version 667910 (0.0008) [2023-12-28 00:02:51,002][106226] Updated weights for policy 0, policy_version 667920 (0.0008) [2023-12-28 00:02:51,081][106226] Updated weights for policy 0, policy_version 667930 (0.0009) [2023-12-28 00:02:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 18605.6). Total num frames: 342499328. Throughput: 0: 8995.7, 1: 8912.7. Samples: 342506640. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:51,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-5.221')] [2023-12-28 00:02:51,447][106225] Updated weights for policy 1, policy_version 669645 (0.0008) [2023-12-28 00:02:51,507][106225] Updated weights for policy 1, policy_version 669655 (0.0006) [2023-12-28 00:02:51,571][106225] Updated weights for policy 1, policy_version 669665 (0.0007) [2023-12-28 00:02:51,848][106226] Updated weights for policy 0, policy_version 667940 (0.0008) [2023-12-28 00:02:51,919][106226] Updated weights for policy 0, policy_version 667950 (0.0009) [2023-12-28 00:02:51,979][106226] Updated weights for policy 0, policy_version 667960 (0.0009) [2023-12-28 00:02:52,326][106225] Updated weights for policy 1, policy_version 669675 (0.0009) [2023-12-28 00:02:52,395][106225] Updated weights for policy 1, policy_version 669685 (0.0009) [2023-12-28 00:02:52,462][106225] Updated weights for policy 1, policy_version 669695 (0.0008) [2023-12-28 00:02:52,755][106226] Updated weights for policy 0, policy_version 667970 (0.0009) [2023-12-28 00:02:52,819][106226] Updated weights for policy 0, policy_version 667980 (0.0008) [2023-12-28 00:02:52,888][106226] Updated weights for policy 0, policy_version 667990 (0.0009) [2023-12-28 00:02:52,941][106226] Updated weights for policy 0, policy_version 668000 (0.0007) [2023-12-28 00:02:53,224][106225] Updated weights for policy 1, policy_version 669705 (0.0008) [2023-12-28 00:02:53,281][106225] Updated weights for policy 1, policy_version 669715 (0.0006) [2023-12-28 00:02:53,346][106225] Updated weights for policy 1, policy_version 669725 (0.0006) [2023-12-28 00:02:53,408][106225] Updated weights for policy 1, policy_version 669735 (0.0009) [2023-12-28 00:02:53,641][106226] Updated weights for policy 0, policy_version 668010 (0.0010) [2023-12-28 00:02:53,705][106226] Updated weights for policy 0, policy_version 668020 (0.0007) [2023-12-28 00:02:53,767][106226] Updated weights for policy 0, policy_version 668030 (0.0007) [2023-12-28 00:02:54,132][106225] Updated weights for policy 1, policy_version 669745 (0.0005) [2023-12-28 00:02:54,200][106225] Updated weights for policy 1, policy_version 669755 (0.0006) [2023-12-28 00:02:54,263][106225] Updated weights for policy 1, policy_version 669765 (0.0007) [2023-12-28 00:02:54,530][106226] Updated weights for policy 0, policy_version 668040 (0.0008) [2023-12-28 00:02:54,594][106226] Updated weights for policy 0, policy_version 668050 (0.0008) [2023-12-28 00:02:54,653][106226] Updated weights for policy 0, policy_version 668060 (0.0008) [2023-12-28 00:02:55,008][106225] Updated weights for policy 1, policy_version 669775 (0.0007) [2023-12-28 00:02:55,067][106225] Updated weights for policy 1, policy_version 669785 (0.0008) [2023-12-28 00:02:55,128][106225] Updated weights for policy 1, policy_version 669795 (0.0007) [2023-12-28 00:02:55,393][106226] Updated weights for policy 0, policy_version 668070 (0.0008) [2023-12-28 00:02:55,458][106226] Updated weights for policy 0, policy_version 668080 (0.0008) [2023-12-28 00:02:55,522][106226] Updated weights for policy 0, policy_version 668090 (0.0009) [2023-12-28 00:02:55,831][106225] Updated weights for policy 1, policy_version 669805 (0.0007) [2023-12-28 00:02:55,878][106225] Updated weights for policy 1, policy_version 669815 (0.0009) [2023-12-28 00:02:55,939][106225] Updated weights for policy 1, policy_version 669825 (0.0009) [2023-12-28 00:02:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 18577.8). Total num frames: 342589440. Throughput: 0: 9008.7, 1: 8915.3. Samples: 342562072. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:02:56,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.446')] [2023-12-28 00:02:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000669832_171507712.pth... [2023-12-28 00:02:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000668096_171081728.pth... [2023-12-28 00:02:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000668776_171237376.pth [2023-12-28 00:02:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000667040_170811392.pth [2023-12-28 00:02:56,239][106226] Updated weights for policy 0, policy_version 668100 (0.0009) [2023-12-28 00:02:56,302][106226] Updated weights for policy 0, policy_version 668110 (0.0009) [2023-12-28 00:02:56,369][106226] Updated weights for policy 0, policy_version 668120 (0.0009) [2023-12-28 00:02:56,651][106225] Updated weights for policy 1, policy_version 669835 (0.0009) [2023-12-28 00:02:56,710][106225] Updated weights for policy 1, policy_version 669845 (0.0008) [2023-12-28 00:02:56,765][106225] Updated weights for policy 1, policy_version 669855 (0.0005) [2023-12-28 00:02:57,087][106226] Updated weights for policy 0, policy_version 668130 (0.0009) [2023-12-28 00:02:57,146][106226] Updated weights for policy 0, policy_version 668140 (0.0009) [2023-12-28 00:02:57,204][106226] Updated weights for policy 0, policy_version 668150 (0.0009) [2023-12-28 00:02:57,264][106226] Updated weights for policy 0, policy_version 668160 (0.0009) [2023-12-28 00:02:57,366][106225] Updated weights for policy 1, policy_version 669865 (0.0005) [2023-12-28 00:02:57,428][106225] Updated weights for policy 1, policy_version 669875 (0.0009) [2023-12-28 00:02:57,479][106225] Updated weights for policy 1, policy_version 669885 (0.0008) [2023-12-28 00:02:57,539][106225] Updated weights for policy 1, policy_version 669895 (0.0009) [2023-12-28 00:02:57,982][106226] Updated weights for policy 0, policy_version 668170 (0.0008) [2023-12-28 00:02:58,044][106226] Updated weights for policy 0, policy_version 668180 (0.0009) [2023-12-28 00:02:58,100][106226] Updated weights for policy 0, policy_version 668190 (0.0008) [2023-12-28 00:02:58,294][106225] Updated weights for policy 1, policy_version 669905 (0.0008) [2023-12-28 00:02:58,357][106225] Updated weights for policy 1, policy_version 669915 (0.0008) [2023-12-28 00:02:58,433][106225] Updated weights for policy 1, policy_version 669925 (0.0009) [2023-12-28 00:02:58,913][106226] Updated weights for policy 0, policy_version 668200 (0.0008) [2023-12-28 00:02:58,989][106226] Updated weights for policy 0, policy_version 668210 (0.0009) [2023-12-28 00:02:59,057][106226] Updated weights for policy 0, policy_version 668220 (0.0007) [2023-12-28 00:02:59,294][106225] Updated weights for policy 1, policy_version 669935 (0.0009) [2023-12-28 00:02:59,370][106225] Updated weights for policy 1, policy_version 669945 (0.0008) [2023-12-28 00:02:59,444][106225] Updated weights for policy 1, policy_version 669955 (0.0008) [2023-12-28 00:02:59,863][106226] Updated weights for policy 0, policy_version 668230 (0.0009) [2023-12-28 00:02:59,924][106226] Updated weights for policy 0, policy_version 668240 (0.0009) [2023-12-28 00:02:59,996][106226] Updated weights for policy 0, policy_version 668250 (0.0009) [2023-12-28 00:03:00,175][106225] Updated weights for policy 1, policy_version 669965 (0.0008) [2023-12-28 00:03:00,233][106225] Updated weights for policy 1, policy_version 669975 (0.0008) [2023-12-28 00:03:00,300][106225] Updated weights for policy 1, policy_version 669985 (0.0006) [2023-12-28 00:03:00,708][106226] Updated weights for policy 0, policy_version 668260 (0.0008) [2023-12-28 00:03:00,756][106226] Updated weights for policy 0, policy_version 668270 (0.0008) [2023-12-28 00:03:00,803][106226] Updated weights for policy 0, policy_version 668280 (0.0008) [2023-12-28 00:03:00,947][106225] Updated weights for policy 1, policy_version 669995 (0.0007) [2023-12-28 00:03:01,005][106225] Updated weights for policy 1, policy_version 670005 (0.0010) [2023-12-28 00:03:01,075][106225] Updated weights for policy 1, policy_version 670015 (0.0011) [2023-12-28 00:03:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 18159.1, 300 sec: 18550.0). Total num frames: 342687744. Throughput: 0: 9071.1, 1: 9022.8. Samples: 342672584. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-28 00:03:01,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-5.323')] [2023-12-28 00:03:01,545][106226] Updated weights for policy 0, policy_version 668290 (0.0005) [2023-12-28 00:03:01,608][106226] Updated weights for policy 0, policy_version 668300 (0.0006) [2023-12-28 00:03:01,678][106226] Updated weights for policy 0, policy_version 668310 (0.0008) [2023-12-28 00:03:01,742][106226] Updated weights for policy 0, policy_version 668320 (0.0009) [2023-12-28 00:03:01,855][106225] Updated weights for policy 1, policy_version 670025 (0.0011) [2023-12-28 00:03:01,910][106225] Updated weights for policy 1, policy_version 670035 (0.0011) [2023-12-28 00:03:01,961][106225] Updated weights for policy 1, policy_version 670045 (0.0010) [2023-12-28 00:03:02,019][106225] Updated weights for policy 1, policy_version 670055 (0.0010) [2023-12-28 00:03:02,467][106226] Updated weights for policy 0, policy_version 668330 (0.0008) [2023-12-28 00:03:02,535][106226] Updated weights for policy 0, policy_version 668340 (0.0008) [2023-12-28 00:03:02,595][106226] Updated weights for policy 0, policy_version 668350 (0.0008) [2023-12-28 00:03:02,768][106225] Updated weights for policy 1, policy_version 670065 (0.0008) [2023-12-28 00:03:02,827][106225] Updated weights for policy 1, policy_version 670075 (0.0008) [2023-12-28 00:03:02,890][106225] Updated weights for policy 1, policy_version 670085 (0.0010) [2023-12-28 00:03:03,249][106226] Updated weights for policy 0, policy_version 668360 (0.0006) [2023-12-28 00:03:03,303][106226] Updated weights for policy 0, policy_version 668370 (0.0006) [2023-12-28 00:03:03,381][106226] Updated weights for policy 0, policy_version 668380 (0.0008) [2023-12-28 00:03:03,609][106225] Updated weights for policy 1, policy_version 670095 (0.0007) [2023-12-28 00:03:03,669][106225] Updated weights for policy 1, policy_version 670105 (0.0005) [2023-12-28 00:03:03,735][106225] Updated weights for policy 1, policy_version 670115 (0.0007) [2023-12-28 00:03:04,108][106226] Updated weights for policy 0, policy_version 668390 (0.0007) [2023-12-28 00:03:04,178][106226] Updated weights for policy 0, policy_version 668400 (0.0008) [2023-12-28 00:03:04,247][106226] Updated weights for policy 0, policy_version 668410 (0.0008) [2023-12-28 00:03:04,444][106225] Updated weights for policy 1, policy_version 670125 (0.0010) [2023-12-28 00:03:04,507][106225] Updated weights for policy 1, policy_version 670135 (0.0011) [2023-12-28 00:03:04,572][106225] Updated weights for policy 1, policy_version 670145 (0.0010) [2023-12-28 00:03:04,961][106226] Updated weights for policy 0, policy_version 668420 (0.0007) [2023-12-28 00:03:05,031][106226] Updated weights for policy 0, policy_version 668430 (0.0007) [2023-12-28 00:03:05,090][106226] Updated weights for policy 0, policy_version 668440 (0.0008) [2023-12-28 00:03:05,280][106225] Updated weights for policy 1, policy_version 670155 (0.0010) [2023-12-28 00:03:05,338][106225] Updated weights for policy 1, policy_version 670165 (0.0010) [2023-12-28 00:03:05,398][106225] Updated weights for policy 1, policy_version 670175 (0.0010) [2023-12-28 00:03:05,778][106226] Updated weights for policy 0, policy_version 668450 (0.0008) [2023-12-28 00:03:05,830][106226] Updated weights for policy 0, policy_version 668460 (0.0008) [2023-12-28 00:03:05,881][106226] Updated weights for policy 0, policy_version 668470 (0.0008) [2023-12-28 00:03:05,946][106226] Updated weights for policy 0, policy_version 668480 (0.0008) [2023-12-28 00:03:06,123][106225] Updated weights for policy 1, policy_version 670185 (0.0010) [2023-12-28 00:03:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 18159.0, 300 sec: 18550.0). Total num frames: 342777856. Throughput: 0: 9139.2, 1: 9102.0. Samples: 342787956. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:06,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.525')] [2023-12-28 00:03:06,186][106225] Updated weights for policy 1, policy_version 670195 (0.0011) [2023-12-28 00:03:06,247][106225] Updated weights for policy 1, policy_version 670205 (0.0009) [2023-12-28 00:03:06,310][106225] Updated weights for policy 1, policy_version 670215 (0.0008) [2023-12-28 00:03:06,758][106226] Updated weights for policy 0, policy_version 668490 (0.0009) [2023-12-28 00:03:06,817][106226] Updated weights for policy 0, policy_version 668500 (0.0007) [2023-12-28 00:03:06,872][106226] Updated weights for policy 0, policy_version 668510 (0.0008) [2023-12-28 00:03:07,029][106225] Updated weights for policy 1, policy_version 670225 (0.0011) [2023-12-28 00:03:07,091][106225] Updated weights for policy 1, policy_version 670235 (0.0011) [2023-12-28 00:03:07,159][106225] Updated weights for policy 1, policy_version 670245 (0.0009) [2023-12-28 00:03:07,597][106226] Updated weights for policy 0, policy_version 668520 (0.0009) [2023-12-28 00:03:07,656][106226] Updated weights for policy 0, policy_version 668530 (0.0008) [2023-12-28 00:03:07,713][106226] Updated weights for policy 0, policy_version 668540 (0.0008) [2023-12-28 00:03:07,869][106225] Updated weights for policy 1, policy_version 670255 (0.0007) [2023-12-28 00:03:07,937][106225] Updated weights for policy 1, policy_version 670265 (0.0008) [2023-12-28 00:03:08,005][106225] Updated weights for policy 1, policy_version 670275 (0.0009) [2023-12-28 00:03:08,313][106226] Updated weights for policy 0, policy_version 668550 (0.0007) [2023-12-28 00:03:08,385][106226] Updated weights for policy 0, policy_version 668560 (0.0008) [2023-12-28 00:03:08,453][106226] Updated weights for policy 0, policy_version 668570 (0.0008) [2023-12-28 00:03:08,748][106225] Updated weights for policy 1, policy_version 670285 (0.0009) [2023-12-28 00:03:08,808][106225] Updated weights for policy 1, policy_version 670295 (0.0006) [2023-12-28 00:03:08,871][106225] Updated weights for policy 1, policy_version 670305 (0.0009) [2023-12-28 00:03:09,131][106226] Updated weights for policy 0, policy_version 668580 (0.0009) [2023-12-28 00:03:09,191][106226] Updated weights for policy 0, policy_version 668590 (0.0008) [2023-12-28 00:03:09,263][106226] Updated weights for policy 0, policy_version 668600 (0.0009) [2023-12-28 00:03:09,699][106225] Updated weights for policy 1, policy_version 670315 (0.0008) [2023-12-28 00:03:09,763][106225] Updated weights for policy 1, policy_version 670325 (0.0008) [2023-12-28 00:03:09,828][106225] Updated weights for policy 1, policy_version 670335 (0.0008) [2023-12-28 00:03:10,095][106226] Updated weights for policy 0, policy_version 668610 (0.0008) [2023-12-28 00:03:10,160][106226] Updated weights for policy 0, policy_version 668620 (0.0008) [2023-12-28 00:03:10,220][106226] Updated weights for policy 0, policy_version 668630 (0.0008) [2023-12-28 00:03:10,291][106226] Updated weights for policy 0, policy_version 668640 (0.0008) [2023-12-28 00:03:10,589][106225] Updated weights for policy 1, policy_version 670345 (0.0009) [2023-12-28 00:03:10,654][106225] Updated weights for policy 1, policy_version 670355 (0.0007) [2023-12-28 00:03:10,714][106225] Updated weights for policy 1, policy_version 670365 (0.0007) [2023-12-28 00:03:10,778][106225] Updated weights for policy 1, policy_version 670375 (0.0007) [2023-12-28 00:03:11,087][106226] Updated weights for policy 0, policy_version 668650 (0.0010) [2023-12-28 00:03:11,165][106226] Updated weights for policy 0, policy_version 668660 (0.0010) [2023-12-28 00:03:11,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 18522.3). Total num frames: 342867968. Throughput: 0: 9231.3, 1: 9167.9. Samples: 342845812. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:11,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.911')] [2023-12-28 00:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000670376_171646976.pth... [2023-12-28 00:03:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000669288_171368448.pth [2023-12-28 00:03:11,233][106226] Updated weights for policy 0, policy_version 668670 (0.0009) [2023-12-28 00:03:11,246][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000668672_171229184.pth... [2023-12-28 00:03:11,252][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000667584_170950656.pth [2023-12-28 00:03:11,564][106225] Updated weights for policy 1, policy_version 670385 (0.0008) [2023-12-28 00:03:11,635][106225] Updated weights for policy 1, policy_version 670395 (0.0008) [2023-12-28 00:03:11,713][106225] Updated weights for policy 1, policy_version 670405 (0.0009) [2023-12-28 00:03:12,094][106226] Updated weights for policy 0, policy_version 668680 (0.0010) [2023-12-28 00:03:12,157][106226] Updated weights for policy 0, policy_version 668690 (0.0009) [2023-12-28 00:03:12,224][106226] Updated weights for policy 0, policy_version 668700 (0.0009) [2023-12-28 00:03:12,456][106225] Updated weights for policy 1, policy_version 670415 (0.0008) [2023-12-28 00:03:12,524][106225] Updated weights for policy 1, policy_version 670425 (0.0008) [2023-12-28 00:03:12,591][106225] Updated weights for policy 1, policy_version 670435 (0.0009) [2023-12-28 00:03:13,023][106226] Updated weights for policy 0, policy_version 668710 (0.0010) [2023-12-28 00:03:13,092][106226] Updated weights for policy 0, policy_version 668720 (0.0011) [2023-12-28 00:03:13,157][106226] Updated weights for policy 0, policy_version 668730 (0.0010) [2023-12-28 00:03:13,330][106225] Updated weights for policy 1, policy_version 670445 (0.0008) [2023-12-28 00:03:13,392][106225] Updated weights for policy 1, policy_version 670455 (0.0006) [2023-12-28 00:03:13,436][106225] Updated weights for policy 1, policy_version 670465 (0.0008) [2023-12-28 00:03:13,883][106226] Updated weights for policy 0, policy_version 668740 (0.0009) [2023-12-28 00:03:13,948][106226] Updated weights for policy 0, policy_version 668750 (0.0007) [2023-12-28 00:03:14,014][106226] Updated weights for policy 0, policy_version 668760 (0.0006) [2023-12-28 00:03:14,142][106225] Updated weights for policy 1, policy_version 670475 (0.0009) [2023-12-28 00:03:14,205][106225] Updated weights for policy 1, policy_version 670485 (0.0009) [2023-12-28 00:03:14,266][106225] Updated weights for policy 1, policy_version 670495 (0.0009) [2023-12-28 00:03:14,648][106226] Updated weights for policy 0, policy_version 668770 (0.0006) [2023-12-28 00:03:14,708][106226] Updated weights for policy 0, policy_version 668780 (0.0009) [2023-12-28 00:03:14,778][106226] Updated weights for policy 0, policy_version 668790 (0.0008) [2023-12-28 00:03:14,843][106226] Updated weights for policy 0, policy_version 668800 (0.0008) [2023-12-28 00:03:15,033][106225] Updated weights for policy 1, policy_version 670505 (0.0007) [2023-12-28 00:03:15,097][106225] Updated weights for policy 1, policy_version 670515 (0.0007) [2023-12-28 00:03:15,167][106225] Updated weights for policy 1, policy_version 670525 (0.0007) [2023-12-28 00:03:15,233][106225] Updated weights for policy 1, policy_version 670535 (0.0008) [2023-12-28 00:03:15,606][106226] Updated weights for policy 0, policy_version 668810 (0.0006) [2023-12-28 00:03:15,664][106226] Updated weights for policy 0, policy_version 668820 (0.0006) [2023-12-28 00:03:15,713][106226] Updated weights for policy 0, policy_version 668830 (0.0005) [2023-12-28 00:03:15,974][106225] Updated weights for policy 1, policy_version 670545 (0.0008) [2023-12-28 00:03:16,036][106225] Updated weights for policy 1, policy_version 670555 (0.0008) [2023-12-28 00:03:16,105][106225] Updated weights for policy 1, policy_version 670565 (0.0008) [2023-12-28 00:03:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 18295.4, 300 sec: 18522.3). Total num frames: 342966272. Throughput: 0: 9193.4, 1: 9155.4. Samples: 342953304. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:16,175][105115] Avg episode reward: [(0, '-4.219'), (1, '-5.594')] [2023-12-28 00:03:16,368][106226] Updated weights for policy 0, policy_version 668840 (0.0008) [2023-12-28 00:03:16,433][106226] Updated weights for policy 0, policy_version 668850 (0.0008) [2023-12-28 00:03:16,497][106226] Updated weights for policy 0, policy_version 668860 (0.0008) [2023-12-28 00:03:16,761][106225] Updated weights for policy 1, policy_version 670575 (0.0007) [2023-12-28 00:03:16,810][106225] Updated weights for policy 1, policy_version 670585 (0.0006) [2023-12-28 00:03:16,867][106225] Updated weights for policy 1, policy_version 670595 (0.0008) [2023-12-28 00:03:17,230][106226] Updated weights for policy 0, policy_version 668870 (0.0010) [2023-12-28 00:03:17,289][106226] Updated weights for policy 0, policy_version 668880 (0.0010) [2023-12-28 00:03:17,356][106226] Updated weights for policy 0, policy_version 668890 (0.0011) [2023-12-28 00:03:17,576][106225] Updated weights for policy 1, policy_version 670605 (0.0007) [2023-12-28 00:03:17,627][106225] Updated weights for policy 1, policy_version 670615 (0.0007) [2023-12-28 00:03:17,679][106225] Updated weights for policy 1, policy_version 670625 (0.0008) [2023-12-28 00:03:18,077][106226] Updated weights for policy 0, policy_version 668900 (0.0009) [2023-12-28 00:03:18,129][106226] Updated weights for policy 0, policy_version 668910 (0.0005) [2023-12-28 00:03:18,190][106226] Updated weights for policy 0, policy_version 668920 (0.0010) [2023-12-28 00:03:18,358][106225] Updated weights for policy 1, policy_version 670636 (0.0007) [2023-12-28 00:03:18,420][106225] Updated weights for policy 1, policy_version 670646 (0.0008) [2023-12-28 00:03:18,489][106225] Updated weights for policy 1, policy_version 670656 (0.0008) [2023-12-28 00:03:18,944][106226] Updated weights for policy 0, policy_version 668930 (0.0010) [2023-12-28 00:03:19,006][106226] Updated weights for policy 0, policy_version 668940 (0.0008) [2023-12-28 00:03:19,076][106226] Updated weights for policy 0, policy_version 668950 (0.0008) [2023-12-28 00:03:19,141][106226] Updated weights for policy 0, policy_version 668960 (0.0009) [2023-12-28 00:03:19,174][106225] Updated weights for policy 1, policy_version 670666 (0.0008) [2023-12-28 00:03:19,242][106225] Updated weights for policy 1, policy_version 670676 (0.0009) [2023-12-28 00:03:19,300][106225] Updated weights for policy 1, policy_version 670686 (0.0007) [2023-12-28 00:03:19,372][106225] Updated weights for policy 1, policy_version 670696 (0.0009) [2023-12-28 00:03:19,949][106226] Updated weights for policy 0, policy_version 668970 (0.0008) [2023-12-28 00:03:20,017][106226] Updated weights for policy 0, policy_version 668980 (0.0009) [2023-12-28 00:03:20,082][106226] Updated weights for policy 0, policy_version 668990 (0.0008) [2023-12-28 00:03:20,126][106225] Updated weights for policy 1, policy_version 670706 (0.0009) [2023-12-28 00:03:20,193][106225] Updated weights for policy 1, policy_version 670716 (0.0009) [2023-12-28 00:03:20,263][106225] Updated weights for policy 1, policy_version 670726 (0.0010) [2023-12-28 00:03:20,881][106226] Updated weights for policy 0, policy_version 669000 (0.0008) [2023-12-28 00:03:20,948][106226] Updated weights for policy 0, policy_version 669010 (0.0008) [2023-12-28 00:03:20,991][106225] Updated weights for policy 1, policy_version 670736 (0.0008) [2023-12-28 00:03:21,022][106226] Updated weights for policy 0, policy_version 669020 (0.0008) [2023-12-28 00:03:21,065][106225] Updated weights for policy 1, policy_version 670746 (0.0008) [2023-12-28 00:03:21,129][106225] Updated weights for policy 1, policy_version 670756 (0.0008) [2023-12-28 00:03:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 18568.5, 300 sec: 18522.3). Total num frames: 343064576. Throughput: 0: 9149.9, 1: 9221.4. Samples: 343066212. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:21,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-5.512')] [2023-12-28 00:03:21,823][106226] Updated weights for policy 0, policy_version 669030 (0.0008) [2023-12-28 00:03:21,891][106226] Updated weights for policy 0, policy_version 669040 (0.0006) [2023-12-28 00:03:21,957][106226] Updated weights for policy 0, policy_version 669050 (0.0009) [2023-12-28 00:03:21,965][106225] Updated weights for policy 1, policy_version 670766 (0.0008) [2023-12-28 00:03:22,020][106225] Updated weights for policy 1, policy_version 670776 (0.0008) [2023-12-28 00:03:22,081][106225] Updated weights for policy 1, policy_version 670786 (0.0008) [2023-12-28 00:03:22,693][106226] Updated weights for policy 0, policy_version 669060 (0.0008) [2023-12-28 00:03:22,758][106226] Updated weights for policy 0, policy_version 669070 (0.0008) [2023-12-28 00:03:22,828][106226] Updated weights for policy 0, policy_version 669080 (0.0006) [2023-12-28 00:03:22,910][106225] Updated weights for policy 1, policy_version 670796 (0.0008) [2023-12-28 00:03:22,975][106225] Updated weights for policy 1, policy_version 670806 (0.0007) [2023-12-28 00:03:23,045][106225] Updated weights for policy 1, policy_version 670816 (0.0008) [2023-12-28 00:03:23,498][106226] Updated weights for policy 0, policy_version 669090 (0.0009) [2023-12-28 00:03:23,567][106226] Updated weights for policy 0, policy_version 669100 (0.0010) [2023-12-28 00:03:23,635][106226] Updated weights for policy 0, policy_version 669110 (0.0009) [2023-12-28 00:03:23,695][106226] Updated weights for policy 0, policy_version 669120 (0.0011) [2023-12-28 00:03:23,778][106225] Updated weights for policy 1, policy_version 670826 (0.0010) [2023-12-28 00:03:23,837][106225] Updated weights for policy 1, policy_version 670836 (0.0010) [2023-12-28 00:03:23,901][106225] Updated weights for policy 1, policy_version 670846 (0.0010) [2023-12-28 00:03:23,970][106225] Updated weights for policy 1, policy_version 670856 (0.0010) [2023-12-28 00:03:24,321][106226] Updated weights for policy 0, policy_version 669130 (0.0008) [2023-12-28 00:03:24,380][106226] Updated weights for policy 0, policy_version 669140 (0.0009) [2023-12-28 00:03:24,438][106226] Updated weights for policy 0, policy_version 669150 (0.0007) [2023-12-28 00:03:24,694][106225] Updated weights for policy 1, policy_version 670866 (0.0008) [2023-12-28 00:03:24,759][106225] Updated weights for policy 1, policy_version 670876 (0.0008) [2023-12-28 00:03:24,819][106225] Updated weights for policy 1, policy_version 670886 (0.0008) [2023-12-28 00:03:25,204][106226] Updated weights for policy 0, policy_version 669160 (0.0006) [2023-12-28 00:03:25,260][106226] Updated weights for policy 0, policy_version 669170 (0.0007) [2023-12-28 00:03:25,326][106226] Updated weights for policy 0, policy_version 669180 (0.0007) [2023-12-28 00:03:25,622][106225] Updated weights for policy 1, policy_version 670896 (0.0008) [2023-12-28 00:03:25,686][106225] Updated weights for policy 1, policy_version 670906 (0.0007) [2023-12-28 00:03:25,749][106225] Updated weights for policy 1, policy_version 670916 (0.0009) [2023-12-28 00:03:25,960][106226] Updated weights for policy 0, policy_version 669190 (0.0008) [2023-12-28 00:03:26,022][106226] Updated weights for policy 0, policy_version 669200 (0.0006) [2023-12-28 00:03:26,074][106226] Updated weights for policy 0, policy_version 669210 (0.0005) [2023-12-28 00:03:26,175][105115] Fps is (10 sec: 18841.8, 60 sec: 18432.0, 300 sec: 18494.5). Total num frames: 343154688. Throughput: 0: 9191.3, 1: 9216.8. Samples: 343121604. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:26,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-5.662')] [2023-12-28 00:03:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000670920_171786240.pth... [2023-12-28 00:03:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000669216_171368448.pth... [2023-12-28 00:03:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000668096_171081728.pth [2023-12-28 00:03:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000669832_171507712.pth [2023-12-28 00:03:26,442][106225] Updated weights for policy 1, policy_version 670926 (0.0009) [2023-12-28 00:03:26,491][106225] Updated weights for policy 1, policy_version 670936 (0.0010) [2023-12-28 00:03:26,549][106225] Updated weights for policy 1, policy_version 670946 (0.0009) [2023-12-28 00:03:26,685][106226] Updated weights for policy 0, policy_version 669220 (0.0006) [2023-12-28 00:03:26,745][106226] Updated weights for policy 0, policy_version 669230 (0.0006) [2023-12-28 00:03:26,811][106226] Updated weights for policy 0, policy_version 669240 (0.0008) [2023-12-28 00:03:27,178][106225] Updated weights for policy 1, policy_version 670956 (0.0008) [2023-12-28 00:03:27,237][106225] Updated weights for policy 1, policy_version 670966 (0.0010) [2023-12-28 00:03:27,294][106225] Updated weights for policy 1, policy_version 670976 (0.0011) [2023-12-28 00:03:27,473][106226] Updated weights for policy 0, policy_version 669250 (0.0008) [2023-12-28 00:03:27,526][106226] Updated weights for policy 0, policy_version 669260 (0.0007) [2023-12-28 00:03:27,578][106226] Updated weights for policy 0, policy_version 669270 (0.0006) [2023-12-28 00:03:27,630][106226] Updated weights for policy 0, policy_version 669280 (0.0008) [2023-12-28 00:03:28,003][106225] Updated weights for policy 1, policy_version 670986 (0.0010) [2023-12-28 00:03:28,058][106225] Updated weights for policy 1, policy_version 670996 (0.0005) [2023-12-28 00:03:28,123][106225] Updated weights for policy 1, policy_version 671006 (0.0008) [2023-12-28 00:03:28,182][106225] Updated weights for policy 1, policy_version 671016 (0.0007) [2023-12-28 00:03:28,391][106226] Updated weights for policy 0, policy_version 669290 (0.0008) [2023-12-28 00:03:28,451][106226] Updated weights for policy 0, policy_version 669300 (0.0007) [2023-12-28 00:03:28,506][106226] Updated weights for policy 0, policy_version 669310 (0.0008) [2023-12-28 00:03:28,882][106225] Updated weights for policy 1, policy_version 671026 (0.0010) [2023-12-28 00:03:28,939][106225] Updated weights for policy 1, policy_version 671036 (0.0010) [2023-12-28 00:03:28,998][106225] Updated weights for policy 1, policy_version 671046 (0.0008) [2023-12-28 00:03:29,143][106226] Updated weights for policy 0, policy_version 669320 (0.0005) [2023-12-28 00:03:29,206][106226] Updated weights for policy 0, policy_version 669330 (0.0006) [2023-12-28 00:03:29,275][106226] Updated weights for policy 0, policy_version 669340 (0.0007) [2023-12-28 00:03:29,687][106225] Updated weights for policy 1, policy_version 671056 (0.0007) [2023-12-28 00:03:29,751][106225] Updated weights for policy 1, policy_version 671066 (0.0008) [2023-12-28 00:03:29,814][106225] Updated weights for policy 1, policy_version 671076 (0.0008) [2023-12-28 00:03:29,989][106226] Updated weights for policy 0, policy_version 669350 (0.0009) [2023-12-28 00:03:30,049][106226] Updated weights for policy 0, policy_version 669360 (0.0009) [2023-12-28 00:03:30,112][106226] Updated weights for policy 0, policy_version 669370 (0.0007) [2023-12-28 00:03:30,579][106225] Updated weights for policy 1, policy_version 671086 (0.0009) [2023-12-28 00:03:30,639][106225] Updated weights for policy 1, policy_version 671096 (0.0010) [2023-12-28 00:03:30,691][106225] Updated weights for policy 1, policy_version 671106 (0.0009) [2023-12-28 00:03:30,778][106226] Updated weights for policy 0, policy_version 669380 (0.0008) [2023-12-28 00:03:30,831][106226] Updated weights for policy 0, policy_version 669390 (0.0009) [2023-12-28 00:03:30,879][106226] Updated weights for policy 0, policy_version 669400 (0.0006) [2023-12-28 00:03:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 18705.1, 300 sec: 18494.5). Total num frames: 343252992. Throughput: 0: 9403.6, 1: 9377.5. Samples: 343240956. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:31,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-5.804')] [2023-12-28 00:03:31,481][106225] Updated weights for policy 1, policy_version 671116 (0.0008) [2023-12-28 00:03:31,533][106225] Updated weights for policy 1, policy_version 671126 (0.0008) [2023-12-28 00:03:31,579][106226] Updated weights for policy 0, policy_version 669410 (0.0006) [2023-12-28 00:03:31,579][106225] Updated weights for policy 1, policy_version 671136 (0.0008) [2023-12-28 00:03:31,651][106226] Updated weights for policy 0, policy_version 669420 (0.0007) [2023-12-28 00:03:31,710][106226] Updated weights for policy 0, policy_version 669430 (0.0007) [2023-12-28 00:03:31,773][106226] Updated weights for policy 0, policy_version 669440 (0.0008) [2023-12-28 00:03:32,379][106225] Updated weights for policy 1, policy_version 671146 (0.0008) [2023-12-28 00:03:32,428][106225] Updated weights for policy 1, policy_version 671156 (0.0008) [2023-12-28 00:03:32,448][106226] Updated weights for policy 0, policy_version 669450 (0.0007) [2023-12-28 00:03:32,488][106225] Updated weights for policy 1, policy_version 671166 (0.0005) [2023-12-28 00:03:32,513][106226] Updated weights for policy 0, policy_version 669460 (0.0008) [2023-12-28 00:03:32,549][106225] Updated weights for policy 1, policy_version 671176 (0.0007) [2023-12-28 00:03:32,578][106226] Updated weights for policy 0, policy_version 669470 (0.0007) [2023-12-28 00:03:33,184][106225] Updated weights for policy 1, policy_version 671186 (0.0005) [2023-12-28 00:03:33,240][106225] Updated weights for policy 1, policy_version 671196 (0.0005) [2023-12-28 00:03:33,296][106225] Updated weights for policy 1, policy_version 671206 (0.0005) [2023-12-28 00:03:33,379][106226] Updated weights for policy 0, policy_version 669480 (0.0007) [2023-12-28 00:03:33,434][106226] Updated weights for policy 0, policy_version 669490 (0.0009) [2023-12-28 00:03:33,489][106226] Updated weights for policy 0, policy_version 669500 (0.0007) [2023-12-28 00:03:33,861][106225] Updated weights for policy 1, policy_version 671216 (0.0005) [2023-12-28 00:03:33,924][106225] Updated weights for policy 1, policy_version 671226 (0.0008) [2023-12-28 00:03:33,975][106225] Updated weights for policy 1, policy_version 671236 (0.0010) [2023-12-28 00:03:34,255][106226] Updated weights for policy 0, policy_version 669510 (0.0007) [2023-12-28 00:03:34,327][106226] Updated weights for policy 0, policy_version 669520 (0.0008) [2023-12-28 00:03:34,392][106226] Updated weights for policy 0, policy_version 669530 (0.0009) [2023-12-28 00:03:34,667][106225] Updated weights for policy 1, policy_version 671246 (0.0006) [2023-12-28 00:03:34,731][106225] Updated weights for policy 1, policy_version 671256 (0.0008) [2023-12-28 00:03:34,794][106225] Updated weights for policy 1, policy_version 671266 (0.0005) [2023-12-28 00:03:35,137][106226] Updated weights for policy 0, policy_version 669540 (0.0010) [2023-12-28 00:03:35,202][106226] Updated weights for policy 0, policy_version 669550 (0.0008) [2023-12-28 00:03:35,260][106226] Updated weights for policy 0, policy_version 669560 (0.0009) [2023-12-28 00:03:35,470][106225] Updated weights for policy 1, policy_version 671276 (0.0009) [2023-12-28 00:03:35,523][106225] Updated weights for policy 1, policy_version 671286 (0.0006) [2023-12-28 00:03:35,572][106225] Updated weights for policy 1, policy_version 671296 (0.0008) [2023-12-28 00:03:35,983][106226] Updated weights for policy 0, policy_version 669570 (0.0008) [2023-12-28 00:03:36,040][106226] Updated weights for policy 0, policy_version 669580 (0.0008) [2023-12-28 00:03:36,101][106226] Updated weights for policy 0, policy_version 669590 (0.0009) [2023-12-28 00:03:36,166][106226] Updated weights for policy 0, policy_version 669600 (0.0008) [2023-12-28 00:03:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 18705.0, 300 sec: 18522.3). Total num frames: 343351296. Throughput: 0: 9430.4, 1: 9466.7. Samples: 343357008. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:36,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.478')] [2023-12-28 00:03:36,339][106225] Updated weights for policy 1, policy_version 671306 (0.0008) [2023-12-28 00:03:36,404][106225] Updated weights for policy 1, policy_version 671316 (0.0008) [2023-12-28 00:03:36,469][106225] Updated weights for policy 1, policy_version 671326 (0.0007) [2023-12-28 00:03:36,531][106225] Updated weights for policy 1, policy_version 671336 (0.0007) [2023-12-28 00:03:36,977][106226] Updated weights for policy 0, policy_version 669610 (0.0008) [2023-12-28 00:03:37,044][106226] Updated weights for policy 0, policy_version 669620 (0.0009) [2023-12-28 00:03:37,108][106226] Updated weights for policy 0, policy_version 669630 (0.0008) [2023-12-28 00:03:37,181][106225] Updated weights for policy 1, policy_version 671346 (0.0008) [2023-12-28 00:03:37,248][106225] Updated weights for policy 1, policy_version 671356 (0.0008) [2023-12-28 00:03:37,309][106225] Updated weights for policy 1, policy_version 671366 (0.0009) [2023-12-28 00:03:37,876][106226] Updated weights for policy 0, policy_version 669640 (0.0009) [2023-12-28 00:03:37,937][106226] Updated weights for policy 0, policy_version 669650 (0.0008) [2023-12-28 00:03:37,987][106226] Updated weights for policy 0, policy_version 669660 (0.0008) [2023-12-28 00:03:38,026][106225] Updated weights for policy 1, policy_version 671376 (0.0010) [2023-12-28 00:03:38,092][106225] Updated weights for policy 1, policy_version 671386 (0.0011) [2023-12-28 00:03:38,158][106225] Updated weights for policy 1, policy_version 671396 (0.0011) [2023-12-28 00:03:38,786][106226] Updated weights for policy 0, policy_version 669670 (0.0008) [2023-12-28 00:03:38,850][106226] Updated weights for policy 0, policy_version 669680 (0.0008) [2023-12-28 00:03:38,885][106225] Updated weights for policy 1, policy_version 671406 (0.0009) [2023-12-28 00:03:38,916][106226] Updated weights for policy 0, policy_version 669690 (0.0007) [2023-12-28 00:03:38,946][106225] Updated weights for policy 1, policy_version 671416 (0.0007) [2023-12-28 00:03:38,999][106225] Updated weights for policy 1, policy_version 671426 (0.0005) [2023-12-28 00:03:39,665][106226] Updated weights for policy 0, policy_version 669700 (0.0008) [2023-12-28 00:03:39,733][106225] Updated weights for policy 1, policy_version 671436 (0.0006) [2023-12-28 00:03:39,735][106226] Updated weights for policy 0, policy_version 669710 (0.0011) [2023-12-28 00:03:39,795][106225] Updated weights for policy 1, policy_version 671446 (0.0008) [2023-12-28 00:03:39,800][106226] Updated weights for policy 0, policy_version 669720 (0.0008) [2023-12-28 00:03:39,867][106225] Updated weights for policy 1, policy_version 671456 (0.0009) [2023-12-28 00:03:40,587][106226] Updated weights for policy 0, policy_version 669730 (0.0008) [2023-12-28 00:03:40,633][106225] Updated weights for policy 1, policy_version 671466 (0.0012) [2023-12-28 00:03:40,644][106226] Updated weights for policy 0, policy_version 669740 (0.0009) [2023-12-28 00:03:40,691][106225] Updated weights for policy 1, policy_version 671476 (0.0010) [2023-12-28 00:03:40,707][106226] Updated weights for policy 0, policy_version 669750 (0.0011) [2023-12-28 00:03:40,761][106225] Updated weights for policy 1, policy_version 671486 (0.0011) [2023-12-28 00:03:40,777][106226] Updated weights for policy 0, policy_version 669760 (0.0011) [2023-12-28 00:03:40,826][106225] Updated weights for policy 1, policy_version 671496 (0.0011) [2023-12-28 00:03:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 18841.6, 300 sec: 18494.5). Total num frames: 343441408. Throughput: 0: 9406.6, 1: 9499.3. Samples: 343412844. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:41,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.435')] [2023-12-28 00:03:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000671496_171933696.pth... [2023-12-28 00:03:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000669760_171507712.pth... [2023-12-28 00:03:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000670376_171646976.pth [2023-12-28 00:03:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000668672_171229184.pth [2023-12-28 00:03:41,585][106226] Updated weights for policy 0, policy_version 669770 (0.0007) [2023-12-28 00:03:41,657][106226] Updated weights for policy 0, policy_version 669780 (0.0011) [2023-12-28 00:03:41,728][106226] Updated weights for policy 0, policy_version 669790 (0.0010) [2023-12-28 00:03:41,739][106225] Updated weights for policy 1, policy_version 671506 (0.0007) [2023-12-28 00:03:41,814][106225] Updated weights for policy 1, policy_version 671516 (0.0009) [2023-12-28 00:03:41,880][106225] Updated weights for policy 1, policy_version 671526 (0.0008) [2023-12-28 00:03:42,517][106226] Updated weights for policy 0, policy_version 669800 (0.0011) [2023-12-28 00:03:42,587][106226] Updated weights for policy 0, policy_version 669810 (0.0011) [2023-12-28 00:03:42,614][106225] Updated weights for policy 1, policy_version 671536 (0.0008) [2023-12-28 00:03:42,654][106226] Updated weights for policy 0, policy_version 669820 (0.0011) [2023-12-28 00:03:42,675][106225] Updated weights for policy 1, policy_version 671546 (0.0008) [2023-12-28 00:03:42,740][106225] Updated weights for policy 1, policy_version 671556 (0.0007) [2023-12-28 00:03:43,323][106226] Updated weights for policy 0, policy_version 669830 (0.0011) [2023-12-28 00:03:43,371][106225] Updated weights for policy 1, policy_version 671566 (0.0006) [2023-12-28 00:03:43,385][106226] Updated weights for policy 0, policy_version 669840 (0.0011) [2023-12-28 00:03:43,433][106225] Updated weights for policy 1, policy_version 671576 (0.0010) [2023-12-28 00:03:43,453][106226] Updated weights for policy 0, policy_version 669850 (0.0011) [2023-12-28 00:03:43,488][106225] Updated weights for policy 1, policy_version 671586 (0.0008) [2023-12-28 00:03:44,170][106226] Updated weights for policy 0, policy_version 669860 (0.0011) [2023-12-28 00:03:44,232][106226] Updated weights for policy 0, policy_version 669870 (0.0011) [2023-12-28 00:03:44,256][106225] Updated weights for policy 1, policy_version 671596 (0.0007) [2023-12-28 00:03:44,297][106226] Updated weights for policy 0, policy_version 669880 (0.0011) [2023-12-28 00:03:44,318][106225] Updated weights for policy 1, policy_version 671606 (0.0005) [2023-12-28 00:03:44,382][106225] Updated weights for policy 1, policy_version 671616 (0.0007) [2023-12-28 00:03:45,123][106226] Updated weights for policy 0, policy_version 669890 (0.0010) [2023-12-28 00:03:45,136][106225] Updated weights for policy 1, policy_version 671626 (0.0009) [2023-12-28 00:03:45,196][106226] Updated weights for policy 0, policy_version 669900 (0.0010) [2023-12-28 00:03:45,210][106225] Updated weights for policy 1, policy_version 671636 (0.0007) [2023-12-28 00:03:45,258][106226] Updated weights for policy 0, policy_version 669910 (0.0009) [2023-12-28 00:03:45,269][106225] Updated weights for policy 1, policy_version 671646 (0.0007) [2023-12-28 00:03:45,329][106226] Updated weights for policy 0, policy_version 669920 (0.0011) [2023-12-28 00:03:45,335][106225] Updated weights for policy 1, policy_version 671656 (0.0009) [2023-12-28 00:03:46,063][106226] Updated weights for policy 0, policy_version 669930 (0.0011) [2023-12-28 00:03:46,080][106225] Updated weights for policy 1, policy_version 671666 (0.0007) [2023-12-28 00:03:46,129][106226] Updated weights for policy 0, policy_version 669940 (0.0011) [2023-12-28 00:03:46,143][106225] Updated weights for policy 1, policy_version 671676 (0.0006) [2023-12-28 00:03:46,174][105115] Fps is (10 sec: 17203.4, 60 sec: 18705.1, 300 sec: 18438.9). Total num frames: 343523328. Throughput: 0: 9414.9, 1: 9486.9. Samples: 343523168. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:46,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-5.693')] [2023-12-28 00:03:46,192][106226] Updated weights for policy 0, policy_version 669950 (0.0011) [2023-12-28 00:03:46,202][106225] Updated weights for policy 1, policy_version 671686 (0.0005) [2023-12-28 00:03:46,907][106226] Updated weights for policy 0, policy_version 669960 (0.0008) [2023-12-28 00:03:46,907][106225] Updated weights for policy 1, policy_version 671696 (0.0007) [2023-12-28 00:03:46,964][106225] Updated weights for policy 1, policy_version 671706 (0.0009) [2023-12-28 00:03:46,969][106226] Updated weights for policy 0, policy_version 669970 (0.0007) [2023-12-28 00:03:47,024][106226] Updated weights for policy 0, policy_version 669980 (0.0011) [2023-12-28 00:03:47,026][106225] Updated weights for policy 1, policy_version 671716 (0.0008) [2023-12-28 00:03:47,720][106226] Updated weights for policy 0, policy_version 669990 (0.0011) [2023-12-28 00:03:47,758][106225] Updated weights for policy 1, policy_version 671726 (0.0008) [2023-12-28 00:03:47,774][106226] Updated weights for policy 0, policy_version 670000 (0.0009) [2023-12-28 00:03:47,816][106225] Updated weights for policy 1, policy_version 671736 (0.0009) [2023-12-28 00:03:47,829][106226] Updated weights for policy 0, policy_version 670010 (0.0007) [2023-12-28 00:03:47,872][106225] Updated weights for policy 1, policy_version 671746 (0.0009) [2023-12-28 00:03:48,514][106226] Updated weights for policy 0, policy_version 670020 (0.0009) [2023-12-28 00:03:48,578][106226] Updated weights for policy 0, policy_version 670030 (0.0011) [2023-12-28 00:03:48,615][106225] Updated weights for policy 1, policy_version 671756 (0.0007) [2023-12-28 00:03:48,637][106226] Updated weights for policy 0, policy_version 670040 (0.0011) [2023-12-28 00:03:48,679][106225] Updated weights for policy 1, policy_version 671766 (0.0006) [2023-12-28 00:03:48,744][106225] Updated weights for policy 1, policy_version 671776 (0.0008) [2023-12-28 00:03:49,379][106226] Updated weights for policy 0, policy_version 670050 (0.0010) [2023-12-28 00:03:49,439][106226] Updated weights for policy 0, policy_version 670060 (0.0007) [2023-12-28 00:03:49,479][106225] Updated weights for policy 1, policy_version 671786 (0.0008) [2023-12-28 00:03:49,496][106226] Updated weights for policy 0, policy_version 670070 (0.0008) [2023-12-28 00:03:49,534][106225] Updated weights for policy 1, policy_version 671796 (0.0008) [2023-12-28 00:03:49,557][106226] Updated weights for policy 0, policy_version 670080 (0.0006) [2023-12-28 00:03:49,593][106225] Updated weights for policy 1, policy_version 671806 (0.0008) [2023-12-28 00:03:49,657][106225] Updated weights for policy 1, policy_version 671816 (0.0008) [2023-12-28 00:03:50,333][106226] Updated weights for policy 0, policy_version 670090 (0.0010) [2023-12-28 00:03:50,390][106226] Updated weights for policy 0, policy_version 670100 (0.0011) [2023-12-28 00:03:50,431][106225] Updated weights for policy 1, policy_version 671826 (0.0005) [2023-12-28 00:03:50,456][106226] Updated weights for policy 0, policy_version 670110 (0.0011) [2023-12-28 00:03:50,489][106225] Updated weights for policy 1, policy_version 671836 (0.0006) [2023-12-28 00:03:50,553][106225] Updated weights for policy 1, policy_version 671846 (0.0005) [2023-12-28 00:03:51,175][105115] Fps is (10 sec: 18022.7, 60 sec: 18705.1, 300 sec: 18411.2). Total num frames: 343621632. Throughput: 0: 9396.6, 1: 9440.3. Samples: 343635620. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:51,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.461')] [2023-12-28 00:03:51,244][106226] Updated weights for policy 0, policy_version 670120 (0.0010) [2023-12-28 00:03:51,307][106226] Updated weights for policy 0, policy_version 670130 (0.0008) [2023-12-28 00:03:51,320][106225] Updated weights for policy 1, policy_version 671856 (0.0007) [2023-12-28 00:03:51,382][106226] Updated weights for policy 0, policy_version 670140 (0.0008) [2023-12-28 00:03:51,392][106225] Updated weights for policy 1, policy_version 671866 (0.0008) [2023-12-28 00:03:51,465][106225] Updated weights for policy 1, policy_version 671876 (0.0008) [2023-12-28 00:03:52,177][106226] Updated weights for policy 0, policy_version 670150 (0.0008) [2023-12-28 00:03:52,242][106226] Updated weights for policy 0, policy_version 670160 (0.0008) [2023-12-28 00:03:52,261][106225] Updated weights for policy 1, policy_version 671886 (0.0008) [2023-12-28 00:03:52,311][106226] Updated weights for policy 0, policy_version 670170 (0.0008) [2023-12-28 00:03:52,342][106225] Updated weights for policy 1, policy_version 671896 (0.0008) [2023-12-28 00:03:52,430][106225] Updated weights for policy 1, policy_version 671906 (0.0008) [2023-12-28 00:03:53,057][106226] Updated weights for policy 0, policy_version 670180 (0.0009) [2023-12-28 00:03:53,123][106226] Updated weights for policy 0, policy_version 670190 (0.0007) [2023-12-28 00:03:53,189][106225] Updated weights for policy 1, policy_version 671916 (0.0009) [2023-12-28 00:03:53,190][106226] Updated weights for policy 0, policy_version 670200 (0.0008) [2023-12-28 00:03:53,251][106225] Updated weights for policy 1, policy_version 671926 (0.0008) [2023-12-28 00:03:53,313][106225] Updated weights for policy 1, policy_version 671936 (0.0009) [2023-12-28 00:03:53,893][106226] Updated weights for policy 0, policy_version 670210 (0.0007) [2023-12-28 00:03:53,943][106226] Updated weights for policy 0, policy_version 670220 (0.0008) [2023-12-28 00:03:53,988][106225] Updated weights for policy 1, policy_version 671946 (0.0009) [2023-12-28 00:03:54,006][106226] Updated weights for policy 0, policy_version 670230 (0.0009) [2023-12-28 00:03:54,047][106225] Updated weights for policy 1, policy_version 671956 (0.0007) [2023-12-28 00:03:54,065][106226] Updated weights for policy 0, policy_version 670240 (0.0007) [2023-12-28 00:03:54,110][106225] Updated weights for policy 1, policy_version 671966 (0.0007) [2023-12-28 00:03:54,176][106225] Updated weights for policy 1, policy_version 671976 (0.0008) [2023-12-28 00:03:54,832][106226] Updated weights for policy 0, policy_version 670250 (0.0008) [2023-12-28 00:03:54,894][106226] Updated weights for policy 0, policy_version 670260 (0.0007) [2023-12-28 00:03:54,904][106225] Updated weights for policy 1, policy_version 671986 (0.0007) [2023-12-28 00:03:54,960][106225] Updated weights for policy 1, policy_version 671996 (0.0007) [2023-12-28 00:03:54,962][106226] Updated weights for policy 0, policy_version 670270 (0.0008) [2023-12-28 00:03:55,019][106225] Updated weights for policy 1, policy_version 672006 (0.0008) [2023-12-28 00:03:55,655][106226] Updated weights for policy 0, policy_version 670280 (0.0009) [2023-12-28 00:03:55,688][106225] Updated weights for policy 1, policy_version 672016 (0.0007) [2023-12-28 00:03:55,718][106226] Updated weights for policy 0, policy_version 670290 (0.0008) [2023-12-28 00:03:55,751][106225] Updated weights for policy 1, policy_version 672026 (0.0006) [2023-12-28 00:03:55,784][106226] Updated weights for policy 0, policy_version 670300 (0.0008) [2023-12-28 00:03:55,807][106225] Updated weights for policy 1, policy_version 672036 (0.0006) [2023-12-28 00:03:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 18841.6, 300 sec: 18438.9). Total num frames: 343719936. Throughput: 0: 9333.5, 1: 9407.6. Samples: 343689160. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:03:56,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.485')] [2023-12-28 00:03:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000672040_172072960.pth... [2023-12-28 00:03:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000670304_171646976.pth... [2023-12-28 00:03:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000669216_171368448.pth [2023-12-28 00:03:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000670920_171786240.pth [2023-12-28 00:03:56,493][106226] Updated weights for policy 0, policy_version 670310 (0.0007) [2023-12-28 00:03:56,509][106225] Updated weights for policy 1, policy_version 672046 (0.0006) [2023-12-28 00:03:56,560][106225] Updated weights for policy 1, policy_version 672056 (0.0005) [2023-12-28 00:03:56,561][106226] Updated weights for policy 0, policy_version 670320 (0.0009) [2023-12-28 00:03:56,621][106225] Updated weights for policy 1, policy_version 672066 (0.0006) [2023-12-28 00:03:56,623][106226] Updated weights for policy 0, policy_version 670330 (0.0007) [2023-12-28 00:03:57,336][106225] Updated weights for policy 1, policy_version 672076 (0.0009) [2023-12-28 00:03:57,372][106226] Updated weights for policy 0, policy_version 670340 (0.0008) [2023-12-28 00:03:57,387][106225] Updated weights for policy 1, policy_version 672086 (0.0007) [2023-12-28 00:03:57,424][106226] Updated weights for policy 0, policy_version 670350 (0.0006) [2023-12-28 00:03:57,442][106225] Updated weights for policy 1, policy_version 672096 (0.0007) [2023-12-28 00:03:57,480][106226] Updated weights for policy 0, policy_version 670360 (0.0007) [2023-12-28 00:03:58,103][106225] Updated weights for policy 1, policy_version 672106 (0.0006) [2023-12-28 00:03:58,160][106226] Updated weights for policy 0, policy_version 670370 (0.0009) [2023-12-28 00:03:58,162][106225] Updated weights for policy 1, policy_version 672116 (0.0010) [2023-12-28 00:03:58,224][106226] Updated weights for policy 0, policy_version 670380 (0.0007) [2023-12-28 00:03:58,229][106225] Updated weights for policy 1, policy_version 672126 (0.0010) [2023-12-28 00:03:58,288][106226] Updated weights for policy 0, policy_version 670390 (0.0010) [2023-12-28 00:03:58,290][106225] Updated weights for policy 1, policy_version 672136 (0.0011) [2023-12-28 00:03:59,158][106225] Updated weights for policy 1, policy_version 672146 (0.0011) [2023-12-28 00:03:59,224][106225] Updated weights for policy 1, policy_version 672156 (0.0009) [2023-12-28 00:03:59,225][106226] Updated weights for policy 0, policy_version 670401 (0.0011) [2023-12-28 00:03:59,301][106225] Updated weights for policy 1, policy_version 672166 (0.0008) [2023-12-28 00:03:59,302][106226] Updated weights for policy 0, policy_version 670411 (0.0008) [2023-12-28 00:03:59,372][106226] Updated weights for policy 0, policy_version 670421 (0.0009) [2023-12-28 00:03:59,445][106226] Updated weights for policy 0, policy_version 670431 (0.0010) [2023-12-28 00:04:00,083][106225] Updated weights for policy 1, policy_version 672176 (0.0007) [2023-12-28 00:04:00,143][106225] Updated weights for policy 1, policy_version 672186 (0.0007) [2023-12-28 00:04:00,208][106225] Updated weights for policy 1, policy_version 672196 (0.0008) [2023-12-28 00:04:00,245][106226] Updated weights for policy 0, policy_version 670441 (0.0011) [2023-12-28 00:04:00,304][106226] Updated weights for policy 0, policy_version 670451 (0.0011) [2023-12-28 00:04:00,368][106226] Updated weights for policy 0, policy_version 670461 (0.0011) [2023-12-28 00:04:00,872][106225] Updated weights for policy 1, policy_version 672206 (0.0008) [2023-12-28 00:04:00,928][106225] Updated weights for policy 1, policy_version 672216 (0.0006) [2023-12-28 00:04:00,989][106225] Updated weights for policy 1, policy_version 672226 (0.0006) [2023-12-28 00:04:01,107][106226] Updated weights for policy 0, policy_version 670471 (0.0011) [2023-12-28 00:04:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18705.0, 300 sec: 18411.2). Total num frames: 343810048. Throughput: 0: 9377.0, 1: 9470.5. Samples: 343801440. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:01,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.707')] [2023-12-28 00:04:01,179][106226] Updated weights for policy 0, policy_version 670481 (0.0010) [2023-12-28 00:04:01,253][106226] Updated weights for policy 0, policy_version 670491 (0.0009) [2023-12-28 00:04:01,694][106225] Updated weights for policy 1, policy_version 672236 (0.0007) [2023-12-28 00:04:01,773][106225] Updated weights for policy 1, policy_version 672246 (0.0009) [2023-12-28 00:04:01,836][106225] Updated weights for policy 1, policy_version 672256 (0.0008) [2023-12-28 00:04:01,982][106226] Updated weights for policy 0, policy_version 670501 (0.0008) [2023-12-28 00:04:02,040][106226] Updated weights for policy 0, policy_version 670511 (0.0009) [2023-12-28 00:04:02,096][106226] Updated weights for policy 0, policy_version 670521 (0.0008) [2023-12-28 00:04:02,594][106225] Updated weights for policy 1, policy_version 672266 (0.0009) [2023-12-28 00:04:02,660][106225] Updated weights for policy 1, policy_version 672276 (0.0007) [2023-12-28 00:04:02,727][106225] Updated weights for policy 1, policy_version 672286 (0.0008) [2023-12-28 00:04:02,788][106225] Updated weights for policy 1, policy_version 672296 (0.0008) [2023-12-28 00:04:02,897][106226] Updated weights for policy 0, policy_version 670531 (0.0009) [2023-12-28 00:04:02,958][106226] Updated weights for policy 0, policy_version 670541 (0.0011) [2023-12-28 00:04:03,013][106226] Updated weights for policy 0, policy_version 670551 (0.0010) [2023-12-28 00:04:03,567][106225] Updated weights for policy 1, policy_version 672306 (0.0007) [2023-12-28 00:04:03,624][106226] Updated weights for policy 0, policy_version 670561 (0.0010) [2023-12-28 00:04:03,626][106225] Updated weights for policy 1, policy_version 672316 (0.0007) [2023-12-28 00:04:03,682][106226] Updated weights for policy 0, policy_version 670571 (0.0010) [2023-12-28 00:04:03,684][106225] Updated weights for policy 1, policy_version 672326 (0.0007) [2023-12-28 00:04:03,734][106226] Updated weights for policy 0, policy_version 670581 (0.0011) [2023-12-28 00:04:03,792][106226] Updated weights for policy 0, policy_version 670591 (0.0011) [2023-12-28 00:04:04,436][106225] Updated weights for policy 1, policy_version 672336 (0.0007) [2023-12-28 00:04:04,489][106225] Updated weights for policy 1, policy_version 672346 (0.0008) [2023-12-28 00:04:04,547][106225] Updated weights for policy 1, policy_version 672356 (0.0008) [2023-12-28 00:04:04,610][106226] Updated weights for policy 0, policy_version 670601 (0.0008) [2023-12-28 00:04:04,677][106226] Updated weights for policy 0, policy_version 670611 (0.0006) [2023-12-28 00:04:04,738][106226] Updated weights for policy 0, policy_version 670621 (0.0008) [2023-12-28 00:04:05,277][106225] Updated weights for policy 1, policy_version 672366 (0.0008) [2023-12-28 00:04:05,333][106225] Updated weights for policy 1, policy_version 672376 (0.0008) [2023-12-28 00:04:05,392][106225] Updated weights for policy 1, policy_version 672386 (0.0008) [2023-12-28 00:04:05,455][106226] Updated weights for policy 0, policy_version 670631 (0.0007) [2023-12-28 00:04:05,512][106226] Updated weights for policy 0, policy_version 670641 (0.0009) [2023-12-28 00:04:05,574][106226] Updated weights for policy 0, policy_version 670651 (0.0008) [2023-12-28 00:04:06,123][106225] Updated weights for policy 1, policy_version 672396 (0.0008) [2023-12-28 00:04:06,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18705.0, 300 sec: 18383.4). Total num frames: 343900160. Throughput: 0: 9409.2, 1: 9455.5. Samples: 343915120. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:06,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.510')] [2023-12-28 00:04:06,189][106225] Updated weights for policy 1, policy_version 672406 (0.0008) [2023-12-28 00:04:06,255][106225] Updated weights for policy 1, policy_version 672416 (0.0008) [2023-12-28 00:04:06,321][106226] Updated weights for policy 0, policy_version 670661 (0.0008) [2023-12-28 00:04:06,385][106226] Updated weights for policy 0, policy_version 670671 (0.0008) [2023-12-28 00:04:06,453][106226] Updated weights for policy 0, policy_version 670681 (0.0009) [2023-12-28 00:04:06,988][106225] Updated weights for policy 1, policy_version 672426 (0.0008) [2023-12-28 00:04:07,048][106225] Updated weights for policy 1, policy_version 672436 (0.0006) [2023-12-28 00:04:07,114][106225] Updated weights for policy 1, policy_version 672446 (0.0006) [2023-12-28 00:04:07,185][106225] Updated weights for policy 1, policy_version 672456 (0.0007) [2023-12-28 00:04:07,197][106226] Updated weights for policy 0, policy_version 670691 (0.0008) [2023-12-28 00:04:07,267][106226] Updated weights for policy 0, policy_version 670701 (0.0009) [2023-12-28 00:04:07,335][106226] Updated weights for policy 0, policy_version 670711 (0.0007) [2023-12-28 00:04:07,852][106225] Updated weights for policy 1, policy_version 672466 (0.0009) [2023-12-28 00:04:07,907][106225] Updated weights for policy 1, policy_version 672476 (0.0008) [2023-12-28 00:04:07,959][106225] Updated weights for policy 1, policy_version 672486 (0.0008) [2023-12-28 00:04:08,049][106226] Updated weights for policy 0, policy_version 670721 (0.0008) [2023-12-28 00:04:08,114][106226] Updated weights for policy 0, policy_version 670731 (0.0008) [2023-12-28 00:04:08,173][106226] Updated weights for policy 0, policy_version 670741 (0.0008) [2023-12-28 00:04:08,230][106226] Updated weights for policy 0, policy_version 670751 (0.0006) [2023-12-28 00:04:08,694][106225] Updated weights for policy 1, policy_version 672496 (0.0007) [2023-12-28 00:04:08,756][106225] Updated weights for policy 1, policy_version 672506 (0.0009) [2023-12-28 00:04:08,823][106225] Updated weights for policy 1, policy_version 672516 (0.0008) [2023-12-28 00:04:09,019][106226] Updated weights for policy 0, policy_version 670761 (0.0011) [2023-12-28 00:04:09,080][106226] Updated weights for policy 0, policy_version 670771 (0.0009) [2023-12-28 00:04:09,144][106226] Updated weights for policy 0, policy_version 670781 (0.0010) [2023-12-28 00:04:09,603][106225] Updated weights for policy 1, policy_version 672526 (0.0008) [2023-12-28 00:04:09,665][106225] Updated weights for policy 1, policy_version 672536 (0.0007) [2023-12-28 00:04:09,730][106225] Updated weights for policy 1, policy_version 672546 (0.0008) [2023-12-28 00:04:09,929][106226] Updated weights for policy 0, policy_version 670791 (0.0011) [2023-12-28 00:04:10,001][106226] Updated weights for policy 0, policy_version 670801 (0.0010) [2023-12-28 00:04:10,065][106226] Updated weights for policy 0, policy_version 670811 (0.0011) [2023-12-28 00:04:10,510][106225] Updated weights for policy 1, policy_version 672556 (0.0009) [2023-12-28 00:04:10,574][106225] Updated weights for policy 1, policy_version 672566 (0.0011) [2023-12-28 00:04:10,634][106225] Updated weights for policy 1, policy_version 672576 (0.0010) [2023-12-28 00:04:10,814][106226] Updated weights for policy 0, policy_version 670821 (0.0011) [2023-12-28 00:04:10,876][106226] Updated weights for policy 0, policy_version 670831 (0.0011) [2023-12-28 00:04:10,932][106226] Updated weights for policy 0, policy_version 670841 (0.0010) [2023-12-28 00:04:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 18841.6, 300 sec: 18411.2). Total num frames: 343998464. Throughput: 0: 9393.8, 1: 9501.5. Samples: 343971892. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:11,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-5.613')] [2023-12-28 00:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000672584_172212224.pth... [2023-12-28 00:04:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000670848_171786240.pth... [2023-12-28 00:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000671496_171933696.pth [2023-12-28 00:04:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000669760_171507712.pth [2023-12-28 00:04:11,443][106225] Updated weights for policy 1, policy_version 672586 (0.0008) [2023-12-28 00:04:11,515][106225] Updated weights for policy 1, policy_version 672596 (0.0009) [2023-12-28 00:04:11,580][106225] Updated weights for policy 1, policy_version 672606 (0.0009) [2023-12-28 00:04:11,649][106225] Updated weights for policy 1, policy_version 672616 (0.0009) [2023-12-28 00:04:11,771][106226] Updated weights for policy 0, policy_version 670851 (0.0008) [2023-12-28 00:04:11,841][106226] Updated weights for policy 0, policy_version 670861 (0.0009) [2023-12-28 00:04:11,912][106226] Updated weights for policy 0, policy_version 670871 (0.0009) [2023-12-28 00:04:12,394][106225] Updated weights for policy 1, policy_version 672626 (0.0008) [2023-12-28 00:04:12,462][106225] Updated weights for policy 1, policy_version 672636 (0.0007) [2023-12-28 00:04:12,527][106225] Updated weights for policy 1, policy_version 672646 (0.0006) [2023-12-28 00:04:12,739][106226] Updated weights for policy 0, policy_version 670881 (0.0009) [2023-12-28 00:04:12,804][106226] Updated weights for policy 0, policy_version 670891 (0.0008) [2023-12-28 00:04:12,869][106226] Updated weights for policy 0, policy_version 670901 (0.0008) [2023-12-28 00:04:12,942][106226] Updated weights for policy 0, policy_version 670911 (0.0008) [2023-12-28 00:04:13,266][106225] Updated weights for policy 1, policy_version 672656 (0.0009) [2023-12-28 00:04:13,334][106225] Updated weights for policy 1, policy_version 672666 (0.0008) [2023-12-28 00:04:13,397][106225] Updated weights for policy 1, policy_version 672676 (0.0009) [2023-12-28 00:04:13,648][106226] Updated weights for policy 0, policy_version 670921 (0.0008) [2023-12-28 00:04:13,708][106226] Updated weights for policy 0, policy_version 670931 (0.0005) [2023-12-28 00:04:13,768][106226] Updated weights for policy 0, policy_version 670941 (0.0009) [2023-12-28 00:04:14,074][106225] Updated weights for policy 1, policy_version 672686 (0.0009) [2023-12-28 00:04:14,143][106225] Updated weights for policy 1, policy_version 672696 (0.0009) [2023-12-28 00:04:14,191][106225] Updated weights for policy 1, policy_version 672706 (0.0009) [2023-12-28 00:04:14,432][106226] Updated weights for policy 0, policy_version 670951 (0.0009) [2023-12-28 00:04:14,494][106226] Updated weights for policy 0, policy_version 670961 (0.0009) [2023-12-28 00:04:14,552][106226] Updated weights for policy 0, policy_version 670971 (0.0009) [2023-12-28 00:04:14,971][106225] Updated weights for policy 1, policy_version 672716 (0.0010) [2023-12-28 00:04:15,038][106225] Updated weights for policy 1, policy_version 672726 (0.0010) [2023-12-28 00:04:15,101][106225] Updated weights for policy 1, policy_version 672736 (0.0011) [2023-12-28 00:04:15,333][106226] Updated weights for policy 0, policy_version 670981 (0.0009) [2023-12-28 00:04:15,404][106226] Updated weights for policy 0, policy_version 670991 (0.0008) [2023-12-28 00:04:15,469][106226] Updated weights for policy 0, policy_version 671001 (0.0009) [2023-12-28 00:04:15,786][106225] Updated weights for policy 1, policy_version 672746 (0.0010) [2023-12-28 00:04:15,849][106225] Updated weights for policy 1, policy_version 672756 (0.0006) [2023-12-28 00:04:15,912][106225] Updated weights for policy 1, policy_version 672766 (0.0009) [2023-12-28 00:04:15,969][106225] Updated weights for policy 1, policy_version 672776 (0.0008) [2023-12-28 00:04:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 18705.1, 300 sec: 18383.4). Total num frames: 344088576. Throughput: 0: 9243.4, 1: 9394.8. Samples: 344079676. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:16,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.493')] [2023-12-28 00:04:16,207][106226] Updated weights for policy 0, policy_version 671011 (0.0010) [2023-12-28 00:04:16,266][106226] Updated weights for policy 0, policy_version 671021 (0.0007) [2023-12-28 00:04:16,335][106226] Updated weights for policy 0, policy_version 671031 (0.0008) [2023-12-28 00:04:16,712][106225] Updated weights for policy 1, policy_version 672786 (0.0008) [2023-12-28 00:04:16,784][106225] Updated weights for policy 1, policy_version 672796 (0.0007) [2023-12-28 00:04:16,843][106225] Updated weights for policy 1, policy_version 672806 (0.0009) [2023-12-28 00:04:16,975][106226] Updated weights for policy 0, policy_version 671041 (0.0009) [2023-12-28 00:04:17,035][106226] Updated weights for policy 0, policy_version 671051 (0.0009) [2023-12-28 00:04:17,099][106226] Updated weights for policy 0, policy_version 671061 (0.0008) [2023-12-28 00:04:17,156][106226] Updated weights for policy 0, policy_version 671071 (0.0009) [2023-12-28 00:04:17,545][106225] Updated weights for policy 1, policy_version 672816 (0.0009) [2023-12-28 00:04:17,607][106225] Updated weights for policy 1, policy_version 672826 (0.0007) [2023-12-28 00:04:17,676][106225] Updated weights for policy 1, policy_version 672836 (0.0006) [2023-12-28 00:04:17,919][106226] Updated weights for policy 0, policy_version 671081 (0.0009) [2023-12-28 00:04:17,983][106226] Updated weights for policy 0, policy_version 671091 (0.0008) [2023-12-28 00:04:18,047][106226] Updated weights for policy 0, policy_version 671101 (0.0008) [2023-12-28 00:04:18,340][106225] Updated weights for policy 1, policy_version 672846 (0.0007) [2023-12-28 00:04:18,406][106225] Updated weights for policy 1, policy_version 672856 (0.0008) [2023-12-28 00:04:18,470][106225] Updated weights for policy 1, policy_version 672866 (0.0008) [2023-12-28 00:04:18,824][106226] Updated weights for policy 0, policy_version 671111 (0.0008) [2023-12-28 00:04:18,892][106226] Updated weights for policy 0, policy_version 671121 (0.0009) [2023-12-28 00:04:18,956][106226] Updated weights for policy 0, policy_version 671131 (0.0009) [2023-12-28 00:04:19,180][106225] Updated weights for policy 1, policy_version 672876 (0.0008) [2023-12-28 00:04:19,250][106225] Updated weights for policy 1, policy_version 672886 (0.0009) [2023-12-28 00:04:19,317][106225] Updated weights for policy 1, policy_version 672896 (0.0007) [2023-12-28 00:04:19,741][106226] Updated weights for policy 0, policy_version 671141 (0.0009) [2023-12-28 00:04:19,805][106226] Updated weights for policy 0, policy_version 671151 (0.0006) [2023-12-28 00:04:19,875][106226] Updated weights for policy 0, policy_version 671161 (0.0009) [2023-12-28 00:04:20,137][106225] Updated weights for policy 1, policy_version 672906 (0.0009) [2023-12-28 00:04:20,200][106225] Updated weights for policy 1, policy_version 672916 (0.0009) [2023-12-28 00:04:20,274][106225] Updated weights for policy 1, policy_version 672926 (0.0008) [2023-12-28 00:04:20,335][106225] Updated weights for policy 1, policy_version 672936 (0.0009) [2023-12-28 00:04:20,587][106226] Updated weights for policy 0, policy_version 671171 (0.0009) [2023-12-28 00:04:20,657][106226] Updated weights for policy 0, policy_version 671181 (0.0008) [2023-12-28 00:04:20,724][106226] Updated weights for policy 0, policy_version 671191 (0.0008) [2023-12-28 00:04:21,095][106225] Updated weights for policy 1, policy_version 672946 (0.0008) [2023-12-28 00:04:21,158][106225] Updated weights for policy 1, policy_version 672956 (0.0008) [2023-12-28 00:04:21,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.5, 300 sec: 18355.6). Total num frames: 344178688. Throughput: 0: 9203.7, 1: 9338.6. Samples: 344191412. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:21,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-5.426')] [2023-12-28 00:04:21,228][106225] Updated weights for policy 1, policy_version 672966 (0.0007) [2023-12-28 00:04:21,489][106226] Updated weights for policy 0, policy_version 671201 (0.0008) [2023-12-28 00:04:21,555][106226] Updated weights for policy 0, policy_version 671211 (0.0006) [2023-12-28 00:04:21,626][106226] Updated weights for policy 0, policy_version 671221 (0.0007) [2023-12-28 00:04:21,701][106226] Updated weights for policy 0, policy_version 671231 (0.0007) [2023-12-28 00:04:22,081][106225] Updated weights for policy 1, policy_version 672976 (0.0009) [2023-12-28 00:04:22,142][106225] Updated weights for policy 1, policy_version 672986 (0.0009) [2023-12-28 00:04:22,207][106225] Updated weights for policy 1, policy_version 672996 (0.0009) [2023-12-28 00:04:22,433][106226] Updated weights for policy 0, policy_version 671241 (0.0008) [2023-12-28 00:04:22,500][106226] Updated weights for policy 0, policy_version 671251 (0.0009) [2023-12-28 00:04:22,565][106226] Updated weights for policy 0, policy_version 671261 (0.0009) [2023-12-28 00:04:23,001][106225] Updated weights for policy 1, policy_version 673006 (0.0007) [2023-12-28 00:04:23,068][106225] Updated weights for policy 1, policy_version 673016 (0.0007) [2023-12-28 00:04:23,121][106225] Updated weights for policy 1, policy_version 673026 (0.0010) [2023-12-28 00:04:23,373][106226] Updated weights for policy 0, policy_version 671271 (0.0010) [2023-12-28 00:04:23,431][106226] Updated weights for policy 0, policy_version 671281 (0.0011) [2023-12-28 00:04:23,482][106226] Updated weights for policy 0, policy_version 671291 (0.0010) [2023-12-28 00:04:23,850][106225] Updated weights for policy 1, policy_version 673036 (0.0010) [2023-12-28 00:04:23,905][106225] Updated weights for policy 1, policy_version 673046 (0.0010) [2023-12-28 00:04:23,963][106225] Updated weights for policy 1, policy_version 673056 (0.0010) [2023-12-28 00:04:24,174][106226] Updated weights for policy 0, policy_version 671301 (0.0011) [2023-12-28 00:04:24,234][106226] Updated weights for policy 0, policy_version 671311 (0.0007) [2023-12-28 00:04:24,297][106226] Updated weights for policy 0, policy_version 671321 (0.0007) [2023-12-28 00:04:24,682][106225] Updated weights for policy 1, policy_version 673066 (0.0009) [2023-12-28 00:04:24,731][106225] Updated weights for policy 1, policy_version 673076 (0.0007) [2023-12-28 00:04:24,798][106225] Updated weights for policy 1, policy_version 673086 (0.0008) [2023-12-28 00:04:24,864][106225] Updated weights for policy 1, policy_version 673096 (0.0006) [2023-12-28 00:04:24,963][106226] Updated weights for policy 0, policy_version 671331 (0.0006) [2023-12-28 00:04:25,027][106226] Updated weights for policy 0, policy_version 671341 (0.0007) [2023-12-28 00:04:25,093][106226] Updated weights for policy 0, policy_version 671351 (0.0006) [2023-12-28 00:04:25,597][106225] Updated weights for policy 1, policy_version 673106 (0.0008) [2023-12-28 00:04:25,658][106225] Updated weights for policy 1, policy_version 673116 (0.0009) [2023-12-28 00:04:25,714][106225] Updated weights for policy 1, policy_version 673126 (0.0008) [2023-12-28 00:04:25,759][106226] Updated weights for policy 0, policy_version 671361 (0.0007) [2023-12-28 00:04:25,823][106226] Updated weights for policy 0, policy_version 671371 (0.0008) [2023-12-28 00:04:25,884][106226] Updated weights for policy 0, policy_version 671381 (0.0009) [2023-12-28 00:04:25,947][106226] Updated weights for policy 0, policy_version 671391 (0.0007) [2023-12-28 00:04:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 18705.0, 300 sec: 18327.9). Total num frames: 344276992. Throughput: 0: 9225.3, 1: 9302.1. Samples: 344246572. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:26,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.634')] [2023-12-28 00:04:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000673128_172351488.pth... [2023-12-28 00:04:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000671392_171925504.pth... [2023-12-28 00:04:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000672040_172072960.pth [2023-12-28 00:04:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000670304_171646976.pth [2023-12-28 00:04:26,472][106225] Updated weights for policy 1, policy_version 673136 (0.0008) [2023-12-28 00:04:26,532][106225] Updated weights for policy 1, policy_version 673146 (0.0009) [2023-12-28 00:04:26,594][106225] Updated weights for policy 1, policy_version 673156 (0.0009) [2023-12-28 00:04:26,641][106226] Updated weights for policy 0, policy_version 671401 (0.0008) [2023-12-28 00:04:26,706][106226] Updated weights for policy 0, policy_version 671411 (0.0009) [2023-12-28 00:04:26,770][106226] Updated weights for policy 0, policy_version 671421 (0.0009) [2023-12-28 00:04:27,327][106225] Updated weights for policy 1, policy_version 673166 (0.0008) [2023-12-28 00:04:27,390][106225] Updated weights for policy 1, policy_version 673176 (0.0006) [2023-12-28 00:04:27,445][106225] Updated weights for policy 1, policy_version 673186 (0.0006) [2023-12-28 00:04:27,534][106226] Updated weights for policy 0, policy_version 671431 (0.0009) [2023-12-28 00:04:27,589][106226] Updated weights for policy 0, policy_version 671441 (0.0008) [2023-12-28 00:04:27,652][106226] Updated weights for policy 0, policy_version 671451 (0.0009) [2023-12-28 00:04:28,117][106225] Updated weights for policy 1, policy_version 673196 (0.0008) [2023-12-28 00:04:28,166][106225] Updated weights for policy 1, policy_version 673206 (0.0008) [2023-12-28 00:04:28,227][106225] Updated weights for policy 1, policy_version 673216 (0.0008) [2023-12-28 00:04:28,405][106226] Updated weights for policy 0, policy_version 671461 (0.0008) [2023-12-28 00:04:28,462][106226] Updated weights for policy 0, policy_version 671471 (0.0009) [2023-12-28 00:04:28,521][106226] Updated weights for policy 0, policy_version 671481 (0.0009) [2023-12-28 00:04:29,078][106225] Updated weights for policy 1, policy_version 673226 (0.0008) [2023-12-28 00:04:29,122][106225] Updated weights for policy 1, policy_version 673236 (0.0008) [2023-12-28 00:04:29,175][106225] Updated weights for policy 1, policy_version 673246 (0.0008) [2023-12-28 00:04:29,240][106225] Updated weights for policy 1, policy_version 673256 (0.0009) [2023-12-28 00:04:29,260][106226] Updated weights for policy 0, policy_version 671491 (0.0008) [2023-12-28 00:04:29,327][106226] Updated weights for policy 0, policy_version 671501 (0.0008) [2023-12-28 00:04:29,398][106226] Updated weights for policy 0, policy_version 671511 (0.0008) [2023-12-28 00:04:30,072][106225] Updated weights for policy 1, policy_version 673266 (0.0008) [2023-12-28 00:04:30,143][106225] Updated weights for policy 1, policy_version 673276 (0.0008) [2023-12-28 00:04:30,171][106226] Updated weights for policy 0, policy_version 671521 (0.0008) [2023-12-28 00:04:30,208][106225] Updated weights for policy 1, policy_version 673286 (0.0008) [2023-12-28 00:04:30,243][106226] Updated weights for policy 0, policy_version 671531 (0.0008) [2023-12-28 00:04:30,313][106226] Updated weights for policy 0, policy_version 671541 (0.0007) [2023-12-28 00:04:30,379][106226] Updated weights for policy 0, policy_version 671551 (0.0008) [2023-12-28 00:04:30,964][106226] Updated weights for policy 0, policy_version 671561 (0.0008) [2023-12-28 00:04:30,986][106225] Updated weights for policy 1, policy_version 673296 (0.0010) [2023-12-28 00:04:31,020][106226] Updated weights for policy 0, policy_version 671571 (0.0006) [2023-12-28 00:04:31,044][106225] Updated weights for policy 1, policy_version 673306 (0.0011) [2023-12-28 00:04:31,089][106226] Updated weights for policy 0, policy_version 671581 (0.0008) [2023-12-28 00:04:31,113][106225] Updated weights for policy 1, policy_version 673316 (0.0011) [2023-12-28 00:04:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 18705.1, 300 sec: 18327.9). Total num frames: 344375296. Throughput: 0: 9285.1, 1: 9316.1. Samples: 344360220. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:31,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-5.799')] [2023-12-28 00:04:31,832][106226] Updated weights for policy 0, policy_version 671591 (0.0007) [2023-12-28 00:04:31,893][106226] Updated weights for policy 0, policy_version 671601 (0.0008) [2023-12-28 00:04:31,919][106225] Updated weights for policy 1, policy_version 673326 (0.0009) [2023-12-28 00:04:31,958][106226] Updated weights for policy 0, policy_version 671611 (0.0007) [2023-12-28 00:04:31,980][106225] Updated weights for policy 1, policy_version 673336 (0.0006) [2023-12-28 00:04:32,046][106225] Updated weights for policy 1, policy_version 673346 (0.0008) [2023-12-28 00:04:32,712][106226] Updated weights for policy 0, policy_version 671621 (0.0008) [2023-12-28 00:04:32,739][106225] Updated weights for policy 1, policy_version 673356 (0.0007) [2023-12-28 00:04:32,778][106226] Updated weights for policy 0, policy_version 671631 (0.0007) [2023-12-28 00:04:32,794][106225] Updated weights for policy 1, policy_version 673366 (0.0007) [2023-12-28 00:04:32,838][106226] Updated weights for policy 0, policy_version 671641 (0.0008) [2023-12-28 00:04:32,843][106225] Updated weights for policy 1, policy_version 673376 (0.0006) [2023-12-28 00:04:33,518][106225] Updated weights for policy 1, policy_version 673386 (0.0006) [2023-12-28 00:04:33,569][106225] Updated weights for policy 1, policy_version 673396 (0.0008) [2023-12-28 00:04:33,593][106226] Updated weights for policy 0, policy_version 671651 (0.0008) [2023-12-28 00:04:33,632][106225] Updated weights for policy 1, policy_version 673406 (0.0007) [2023-12-28 00:04:33,649][106226] Updated weights for policy 0, policy_version 671661 (0.0008) [2023-12-28 00:04:33,685][106225] Updated weights for policy 1, policy_version 673416 (0.0005) [2023-12-28 00:04:33,713][106226] Updated weights for policy 0, policy_version 671671 (0.0009) [2023-12-28 00:04:34,450][106225] Updated weights for policy 1, policy_version 673426 (0.0007) [2023-12-28 00:04:34,490][106226] Updated weights for policy 0, policy_version 671681 (0.0009) [2023-12-28 00:04:34,515][106225] Updated weights for policy 1, policy_version 673436 (0.0008) [2023-12-28 00:04:34,551][106226] Updated weights for policy 0, policy_version 671691 (0.0010) [2023-12-28 00:04:34,581][106225] Updated weights for policy 1, policy_version 673446 (0.0008) [2023-12-28 00:04:34,608][106226] Updated weights for policy 0, policy_version 671701 (0.0006) [2023-12-28 00:04:34,674][106226] Updated weights for policy 0, policy_version 671711 (0.0009) [2023-12-28 00:04:35,295][106225] Updated weights for policy 1, policy_version 673456 (0.0008) [2023-12-28 00:04:35,363][106225] Updated weights for policy 1, policy_version 673466 (0.0008) [2023-12-28 00:04:35,422][106225] Updated weights for policy 1, policy_version 673476 (0.0007) [2023-12-28 00:04:35,443][106226] Updated weights for policy 0, policy_version 671721 (0.0007) [2023-12-28 00:04:35,507][106226] Updated weights for policy 0, policy_version 671731 (0.0008) [2023-12-28 00:04:35,566][106226] Updated weights for policy 0, policy_version 671741 (0.0008) [2023-12-28 00:04:36,175][105115] Fps is (10 sec: 18022.6, 60 sec: 18432.0, 300 sec: 18300.1). Total num frames: 344457216. Throughput: 0: 9275.1, 1: 9325.0. Samples: 344472624. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:36,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-5.548')] [2023-12-28 00:04:36,179][106225] Updated weights for policy 1, policy_version 673486 (0.0007) [2023-12-28 00:04:36,246][106225] Updated weights for policy 1, policy_version 673496 (0.0006) [2023-12-28 00:04:36,311][106225] Updated weights for policy 1, policy_version 673506 (0.0007) [2023-12-28 00:04:36,335][106226] Updated weights for policy 0, policy_version 671751 (0.0008) [2023-12-28 00:04:36,408][106226] Updated weights for policy 0, policy_version 671761 (0.0008) [2023-12-28 00:04:36,480][106226] Updated weights for policy 0, policy_version 671771 (0.0008) [2023-12-28 00:04:36,953][106225] Updated weights for policy 1, policy_version 673516 (0.0008) [2023-12-28 00:04:37,010][106225] Updated weights for policy 1, policy_version 673526 (0.0008) [2023-12-28 00:04:37,077][106225] Updated weights for policy 1, policy_version 673536 (0.0008) [2023-12-28 00:04:37,264][106226] Updated weights for policy 0, policy_version 671781 (0.0009) [2023-12-28 00:04:37,321][106226] Updated weights for policy 0, policy_version 671791 (0.0011) [2023-12-28 00:04:37,387][106226] Updated weights for policy 0, policy_version 671801 (0.0011) [2023-12-28 00:04:37,730][106225] Updated weights for policy 1, policy_version 673546 (0.0007) [2023-12-28 00:04:37,801][106225] Updated weights for policy 1, policy_version 673556 (0.0007) [2023-12-28 00:04:37,867][106225] Updated weights for policy 1, policy_version 673566 (0.0007) [2023-12-28 00:04:37,921][106225] Updated weights for policy 1, policy_version 673576 (0.0008) [2023-12-28 00:04:38,024][106226] Updated weights for policy 0, policy_version 671811 (0.0009) [2023-12-28 00:04:38,089][106226] Updated weights for policy 0, policy_version 671821 (0.0010) [2023-12-28 00:04:38,149][106226] Updated weights for policy 0, policy_version 671831 (0.0011) [2023-12-28 00:04:38,650][106225] Updated weights for policy 1, policy_version 673586 (0.0009) [2023-12-28 00:04:38,710][106225] Updated weights for policy 1, policy_version 673596 (0.0009) [2023-12-28 00:04:38,761][106225] Updated weights for policy 1, policy_version 673607 (0.0007) [2023-12-28 00:04:38,913][106226] Updated weights for policy 0, policy_version 671841 (0.0011) [2023-12-28 00:04:38,972][106226] Updated weights for policy 0, policy_version 671851 (0.0011) [2023-12-28 00:04:39,034][106226] Updated weights for policy 0, policy_version 671861 (0.0010) [2023-12-28 00:04:39,090][106226] Updated weights for policy 0, policy_version 671871 (0.0010) [2023-12-28 00:04:39,626][106225] Updated weights for policy 1, policy_version 673617 (0.0011) [2023-12-28 00:04:39,693][106225] Updated weights for policy 1, policy_version 673627 (0.0011) [2023-12-28 00:04:39,758][106225] Updated weights for policy 1, policy_version 673637 (0.0011) [2023-12-28 00:04:39,940][106226] Updated weights for policy 0, policy_version 671881 (0.0008) [2023-12-28 00:04:40,009][106226] Updated weights for policy 0, policy_version 671891 (0.0009) [2023-12-28 00:04:40,063][106226] Updated weights for policy 0, policy_version 671901 (0.0008) [2023-12-28 00:04:40,553][106225] Updated weights for policy 1, policy_version 673647 (0.0011) [2023-12-28 00:04:40,616][106225] Updated weights for policy 1, policy_version 673657 (0.0010) [2023-12-28 00:04:40,678][106225] Updated weights for policy 1, policy_version 673667 (0.0010) [2023-12-28 00:04:40,818][106226] Updated weights for policy 0, policy_version 671911 (0.0009) [2023-12-28 00:04:40,873][106226] Updated weights for policy 0, policy_version 671921 (0.0008) [2023-12-28 00:04:40,933][106226] Updated weights for policy 0, policy_version 671931 (0.0007) [2023-12-28 00:04:41,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18568.6, 300 sec: 18272.3). Total num frames: 344555520. Throughput: 0: 9298.6, 1: 9381.2. Samples: 344529752. Policy #0 lag: (min: 23.0, avg: 36.5, max: 55.0) [2023-12-28 00:04:41,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.412')] [2023-12-28 00:04:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000671936_172064768.pth... [2023-12-28 00:04:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000673672_172490752.pth... [2023-12-28 00:04:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000670848_171786240.pth [2023-12-28 00:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000672584_172212224.pth [2023-12-28 00:04:41,491][106225] Updated weights for policy 1, policy_version 673677 (0.0009) [2023-12-28 00:04:41,552][106225] Updated weights for policy 1, policy_version 673687 (0.0009) [2023-12-28 00:04:41,616][106225] Updated weights for policy 1, policy_version 673697 (0.0008) [2023-12-28 00:04:41,729][106226] Updated weights for policy 0, policy_version 671941 (0.0009) [2023-12-28 00:04:41,801][106226] Updated weights for policy 0, policy_version 671951 (0.0010) [2023-12-28 00:04:41,856][106226] Updated weights for policy 0, policy_version 671961 (0.0009) [2023-12-28 00:04:42,413][106225] Updated weights for policy 1, policy_version 673707 (0.0009) [2023-12-28 00:04:42,487][106225] Updated weights for policy 1, policy_version 673717 (0.0008) [2023-12-28 00:04:42,555][106225] Updated weights for policy 1, policy_version 673727 (0.0008) [2023-12-28 00:04:42,651][106226] Updated weights for policy 0, policy_version 671971 (0.0009) [2023-12-28 00:04:42,719][106226] Updated weights for policy 0, policy_version 671981 (0.0008) [2023-12-28 00:04:42,791][106226] Updated weights for policy 0, policy_version 671991 (0.0008) [2023-12-28 00:04:43,280][106225] Updated weights for policy 1, policy_version 673737 (0.0007) [2023-12-28 00:04:43,339][106225] Updated weights for policy 1, policy_version 673747 (0.0009) [2023-12-28 00:04:43,395][106225] Updated weights for policy 1, policy_version 673757 (0.0007) [2023-12-28 00:04:43,458][106225] Updated weights for policy 1, policy_version 673767 (0.0009) [2023-12-28 00:04:43,490][106226] Updated weights for policy 0, policy_version 672001 (0.0007) [2023-12-28 00:04:43,550][106226] Updated weights for policy 0, policy_version 672011 (0.0009) [2023-12-28 00:04:43,608][106226] Updated weights for policy 0, policy_version 672021 (0.0009) [2023-12-28 00:04:43,660][106226] Updated weights for policy 0, policy_version 672031 (0.0008) [2023-12-28 00:04:44,200][106225] Updated weights for policy 1, policy_version 673777 (0.0007) [2023-12-28 00:04:44,260][106225] Updated weights for policy 1, policy_version 673787 (0.0008) [2023-12-28 00:04:44,320][106225] Updated weights for policy 1, policy_version 673797 (0.0008) [2023-12-28 00:04:44,381][106226] Updated weights for policy 0, policy_version 672041 (0.0009) [2023-12-28 00:04:44,451][106226] Updated weights for policy 0, policy_version 672051 (0.0008) [2023-12-28 00:04:44,521][106226] Updated weights for policy 0, policy_version 672061 (0.0009) [2023-12-28 00:04:45,016][106225] Updated weights for policy 1, policy_version 673807 (0.0008) [2023-12-28 00:04:45,082][106225] Updated weights for policy 1, policy_version 673817 (0.0007) [2023-12-28 00:04:45,148][106225] Updated weights for policy 1, policy_version 673827 (0.0008) [2023-12-28 00:04:45,341][106226] Updated weights for policy 0, policy_version 672071 (0.0009) [2023-12-28 00:04:45,410][106226] Updated weights for policy 0, policy_version 672081 (0.0011) [2023-12-28 00:04:45,484][106226] Updated weights for policy 0, policy_version 672091 (0.0010) [2023-12-28 00:04:45,963][106225] Updated weights for policy 1, policy_version 673837 (0.0009) [2023-12-28 00:04:46,018][106225] Updated weights for policy 1, policy_version 673847 (0.0009) [2023-12-28 00:04:46,079][106225] Updated weights for policy 1, policy_version 673857 (0.0008) [2023-12-28 00:04:46,099][106226] Updated weights for policy 0, policy_version 672101 (0.0009) [2023-12-28 00:04:46,159][106226] Updated weights for policy 0, policy_version 672111 (0.0011) [2023-12-28 00:04:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 18705.0, 300 sec: 18244.5). Total num frames: 344645632. Throughput: 0: 9270.4, 1: 9306.5. Samples: 344637400. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:04:46,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-5.666')] [2023-12-28 00:04:46,220][106226] Updated weights for policy 0, policy_version 672121 (0.0006) [2023-12-28 00:04:46,862][106226] Updated weights for policy 0, policy_version 672131 (0.0009) [2023-12-28 00:04:46,892][106225] Updated weights for policy 1, policy_version 673867 (0.0007) [2023-12-28 00:04:46,924][106226] Updated weights for policy 0, policy_version 672141 (0.0011) [2023-12-28 00:04:46,946][106225] Updated weights for policy 1, policy_version 673877 (0.0007) [2023-12-28 00:04:46,986][106226] Updated weights for policy 0, policy_version 672151 (0.0011) [2023-12-28 00:04:47,007][106225] Updated weights for policy 1, policy_version 673887 (0.0006) [2023-12-28 00:04:47,705][106226] Updated weights for policy 0, policy_version 672161 (0.0011) [2023-12-28 00:04:47,763][106225] Updated weights for policy 1, policy_version 673897 (0.0007) [2023-12-28 00:04:47,771][106226] Updated weights for policy 0, policy_version 672171 (0.0011) [2023-12-28 00:04:47,813][106225] Updated weights for policy 1, policy_version 673907 (0.0007) [2023-12-28 00:04:47,835][106226] Updated weights for policy 0, policy_version 672181 (0.0011) [2023-12-28 00:04:47,876][106225] Updated weights for policy 1, policy_version 673917 (0.0006) [2023-12-28 00:04:47,897][106226] Updated weights for policy 0, policy_version 672191 (0.0011) [2023-12-28 00:04:47,943][106225] Updated weights for policy 1, policy_version 673927 (0.0009) [2023-12-28 00:04:48,644][106226] Updated weights for policy 0, policy_version 672201 (0.0008) [2023-12-28 00:04:48,694][106225] Updated weights for policy 1, policy_version 673937 (0.0011) [2023-12-28 00:04:48,713][106226] Updated weights for policy 0, policy_version 672211 (0.0008) [2023-12-28 00:04:48,762][106225] Updated weights for policy 1, policy_version 673947 (0.0011) [2023-12-28 00:04:48,785][106226] Updated weights for policy 0, policy_version 672221 (0.0009) [2023-12-28 00:04:48,829][106225] Updated weights for policy 1, policy_version 673957 (0.0011) [2023-12-28 00:04:49,508][106226] Updated weights for policy 0, policy_version 672231 (0.0011) [2023-12-28 00:04:49,572][106226] Updated weights for policy 0, policy_version 672241 (0.0011) [2023-12-28 00:04:49,634][106226] Updated weights for policy 0, policy_version 672251 (0.0011) [2023-12-28 00:04:49,644][106225] Updated weights for policy 1, policy_version 673967 (0.0007) [2023-12-28 00:04:49,707][106225] Updated weights for policy 1, policy_version 673977 (0.0007) [2023-12-28 00:04:49,774][106225] Updated weights for policy 1, policy_version 673987 (0.0008) [2023-12-28 00:04:50,372][106226] Updated weights for policy 0, policy_version 672261 (0.0011) [2023-12-28 00:04:50,432][106226] Updated weights for policy 0, policy_version 672271 (0.0011) [2023-12-28 00:04:50,498][106226] Updated weights for policy 0, policy_version 672281 (0.0011) [2023-12-28 00:04:50,501][106225] Updated weights for policy 1, policy_version 673997 (0.0006) [2023-12-28 00:04:50,565][106225] Updated weights for policy 1, policy_version 674007 (0.0007) [2023-12-28 00:04:50,638][106225] Updated weights for policy 1, policy_version 674017 (0.0008) [2023-12-28 00:04:51,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.5, 300 sec: 18216.8). Total num frames: 344735744. Throughput: 0: 9296.8, 1: 9225.1. Samples: 344748604. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:04:51,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-5.508')] [2023-12-28 00:04:51,254][106226] Updated weights for policy 0, policy_version 672291 (0.0011) [2023-12-28 00:04:51,325][106226] Updated weights for policy 0, policy_version 672301 (0.0007) [2023-12-28 00:04:51,369][106225] Updated weights for policy 1, policy_version 674027 (0.0008) [2023-12-28 00:04:51,398][106226] Updated weights for policy 0, policy_version 672311 (0.0009) [2023-12-28 00:04:51,434][106225] Updated weights for policy 1, policy_version 674037 (0.0008) [2023-12-28 00:04:51,493][106225] Updated weights for policy 1, policy_version 674047 (0.0010) [2023-12-28 00:04:52,180][106226] Updated weights for policy 0, policy_version 672321 (0.0011) [2023-12-28 00:04:52,238][106225] Updated weights for policy 1, policy_version 674057 (0.0008) [2023-12-28 00:04:52,249][106226] Updated weights for policy 0, policy_version 672331 (0.0009) [2023-12-28 00:04:52,302][106225] Updated weights for policy 1, policy_version 674067 (0.0008) [2023-12-28 00:04:52,318][106226] Updated weights for policy 0, policy_version 672341 (0.0009) [2023-12-28 00:04:52,369][106225] Updated weights for policy 1, policy_version 674077 (0.0007) [2023-12-28 00:04:52,391][106226] Updated weights for policy 0, policy_version 672351 (0.0008) [2023-12-28 00:04:52,440][106225] Updated weights for policy 1, policy_version 674087 (0.0008) [2023-12-28 00:04:53,052][106226] Updated weights for policy 0, policy_version 672361 (0.0008) [2023-12-28 00:04:53,074][106225] Updated weights for policy 1, policy_version 674097 (0.0007) [2023-12-28 00:04:53,111][106226] Updated weights for policy 0, policy_version 672371 (0.0010) [2023-12-28 00:04:53,138][106225] Updated weights for policy 1, policy_version 674107 (0.0006) [2023-12-28 00:04:53,173][106226] Updated weights for policy 0, policy_version 672381 (0.0007) [2023-12-28 00:04:53,206][106225] Updated weights for policy 1, policy_version 674117 (0.0006) [2023-12-28 00:04:53,770][106225] Updated weights for policy 1, policy_version 674127 (0.0009) [2023-12-28 00:04:53,786][106226] Updated weights for policy 0, policy_version 672391 (0.0008) [2023-12-28 00:04:53,821][106225] Updated weights for policy 1, policy_version 674137 (0.0010) [2023-12-28 00:04:53,843][106226] Updated weights for policy 0, policy_version 672401 (0.0006) [2023-12-28 00:04:53,887][106225] Updated weights for policy 1, policy_version 674147 (0.0011) [2023-12-28 00:04:53,910][106226] Updated weights for policy 0, policy_version 672411 (0.0007) [2023-12-28 00:04:54,617][106225] Updated weights for policy 1, policy_version 674157 (0.0011) [2023-12-28 00:04:54,664][106226] Updated weights for policy 0, policy_version 672421 (0.0008) [2023-12-28 00:04:54,679][106225] Updated weights for policy 1, policy_version 674167 (0.0011) [2023-12-28 00:04:54,721][106226] Updated weights for policy 0, policy_version 672431 (0.0007) [2023-12-28 00:04:54,743][106225] Updated weights for policy 1, policy_version 674177 (0.0011) [2023-12-28 00:04:54,773][106226] Updated weights for policy 0, policy_version 672441 (0.0006) [2023-12-28 00:04:55,473][106225] Updated weights for policy 1, policy_version 674187 (0.0010) [2023-12-28 00:04:55,492][106226] Updated weights for policy 0, policy_version 672451 (0.0008) [2023-12-28 00:04:55,538][106225] Updated weights for policy 1, policy_version 674197 (0.0011) [2023-12-28 00:04:55,558][106226] Updated weights for policy 0, policy_version 672461 (0.0007) [2023-12-28 00:04:55,605][106225] Updated weights for policy 1, policy_version 674207 (0.0011) [2023-12-28 00:04:55,620][106226] Updated weights for policy 0, policy_version 672471 (0.0007) [2023-12-28 00:04:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 18568.5, 300 sec: 18244.6). Total num frames: 344834048. Throughput: 0: 9315.9, 1: 9256.8. Samples: 344807664. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:04:56,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.310')] [2023-12-28 00:04:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000674216_172630016.pth... [2023-12-28 00:04:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000672480_172204032.pth... [2023-12-28 00:04:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000673128_172351488.pth [2023-12-28 00:04:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000671392_171925504.pth [2023-12-28 00:04:56,231][106226] Updated weights for policy 0, policy_version 672481 (0.0007) [2023-12-28 00:04:56,290][106226] Updated weights for policy 0, policy_version 672491 (0.0008) [2023-12-28 00:04:56,314][106225] Updated weights for policy 1, policy_version 674217 (0.0010) [2023-12-28 00:04:56,355][106226] Updated weights for policy 0, policy_version 672501 (0.0009) [2023-12-28 00:04:56,366][106225] Updated weights for policy 1, policy_version 674227 (0.0010) [2023-12-28 00:04:56,412][106226] Updated weights for policy 0, policy_version 672511 (0.0007) [2023-12-28 00:04:56,427][106225] Updated weights for policy 1, policy_version 674237 (0.0010) [2023-12-28 00:04:56,481][106225] Updated weights for policy 1, policy_version 674247 (0.0010) [2023-12-28 00:04:57,142][106226] Updated weights for policy 0, policy_version 672521 (0.0007) [2023-12-28 00:04:57,158][106225] Updated weights for policy 1, policy_version 674257 (0.0011) [2023-12-28 00:04:57,198][106226] Updated weights for policy 0, policy_version 672531 (0.0009) [2023-12-28 00:04:57,219][106225] Updated weights for policy 1, policy_version 674267 (0.0011) [2023-12-28 00:04:57,258][106226] Updated weights for policy 0, policy_version 672541 (0.0006) [2023-12-28 00:04:57,275][106225] Updated weights for policy 1, policy_version 674277 (0.0010) [2023-12-28 00:04:57,906][106226] Updated weights for policy 0, policy_version 672551 (0.0007) [2023-12-28 00:04:57,969][106226] Updated weights for policy 0, policy_version 672561 (0.0007) [2023-12-28 00:04:57,978][106225] Updated weights for policy 1, policy_version 674287 (0.0010) [2023-12-28 00:04:58,035][106226] Updated weights for policy 0, policy_version 672571 (0.0008) [2023-12-28 00:04:58,045][106225] Updated weights for policy 1, policy_version 674297 (0.0011) [2023-12-28 00:04:58,103][106225] Updated weights for policy 1, policy_version 674307 (0.0010) [2023-12-28 00:04:58,822][106226] Updated weights for policy 0, policy_version 672581 (0.0007) [2023-12-28 00:04:58,892][106226] Updated weights for policy 0, policy_version 672591 (0.0007) [2023-12-28 00:04:58,969][106226] Updated weights for policy 0, policy_version 672601 (0.0011) [2023-12-28 00:04:59,003][106225] Updated weights for policy 1, policy_version 674317 (0.0009) [2023-12-28 00:04:59,071][106225] Updated weights for policy 1, policy_version 674327 (0.0008) [2023-12-28 00:04:59,139][106225] Updated weights for policy 1, policy_version 674337 (0.0008) [2023-12-28 00:04:59,808][106226] Updated weights for policy 0, policy_version 672611 (0.0010) [2023-12-28 00:04:59,878][106226] Updated weights for policy 0, policy_version 672621 (0.0007) [2023-12-28 00:04:59,931][106226] Updated weights for policy 0, policy_version 672631 (0.0007) [2023-12-28 00:04:59,942][106225] Updated weights for policy 1, policy_version 674347 (0.0009) [2023-12-28 00:05:00,006][106225] Updated weights for policy 1, policy_version 674357 (0.0009) [2023-12-28 00:05:00,068][106225] Updated weights for policy 1, policy_version 674367 (0.0008) [2023-12-28 00:05:00,705][106226] Updated weights for policy 0, policy_version 672641 (0.0008) [2023-12-28 00:05:00,764][106226] Updated weights for policy 0, policy_version 672651 (0.0008) [2023-12-28 00:05:00,790][106225] Updated weights for policy 1, policy_version 674377 (0.0008) [2023-12-28 00:05:00,828][106226] Updated weights for policy 0, policy_version 672661 (0.0007) [2023-12-28 00:05:00,854][106225] Updated weights for policy 1, policy_version 674387 (0.0008) [2023-12-28 00:05:00,886][106226] Updated weights for policy 0, policy_version 672671 (0.0007) [2023-12-28 00:05:00,916][106225] Updated weights for policy 1, policy_version 674397 (0.0007) [2023-12-28 00:05:00,977][106225] Updated weights for policy 1, policy_version 674407 (0.0009) [2023-12-28 00:05:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 18705.1, 300 sec: 18300.1). Total num frames: 344932352. Throughput: 0: 9393.6, 1: 9294.6. Samples: 344920644. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:01,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.686')] [2023-12-28 00:05:01,681][106226] Updated weights for policy 0, policy_version 672681 (0.0006) [2023-12-28 00:05:01,712][106225] Updated weights for policy 1, policy_version 674417 (0.0008) [2023-12-28 00:05:01,752][106226] Updated weights for policy 0, policy_version 672691 (0.0007) [2023-12-28 00:05:01,779][106225] Updated weights for policy 1, policy_version 674427 (0.0009) [2023-12-28 00:05:01,812][106226] Updated weights for policy 0, policy_version 672701 (0.0007) [2023-12-28 00:05:01,839][106225] Updated weights for policy 1, policy_version 674437 (0.0008) [2023-12-28 00:05:02,551][106226] Updated weights for policy 0, policy_version 672711 (0.0008) [2023-12-28 00:05:02,553][106225] Updated weights for policy 1, policy_version 674447 (0.0007) [2023-12-28 00:05:02,614][106225] Updated weights for policy 1, policy_version 674457 (0.0006) [2023-12-28 00:05:02,616][106226] Updated weights for policy 0, policy_version 672721 (0.0007) [2023-12-28 00:05:02,678][106226] Updated weights for policy 0, policy_version 672731 (0.0007) [2023-12-28 00:05:02,683][106225] Updated weights for policy 1, policy_version 674467 (0.0007) [2023-12-28 00:05:03,290][106225] Updated weights for policy 1, policy_version 674477 (0.0009) [2023-12-28 00:05:03,341][106225] Updated weights for policy 1, policy_version 674487 (0.0006) [2023-12-28 00:05:03,389][106225] Updated weights for policy 1, policy_version 674497 (0.0006) [2023-12-28 00:05:03,484][106226] Updated weights for policy 0, policy_version 672741 (0.0009) [2023-12-28 00:05:03,552][106226] Updated weights for policy 0, policy_version 672751 (0.0009) [2023-12-28 00:05:03,612][106226] Updated weights for policy 0, policy_version 672761 (0.0009) [2023-12-28 00:05:04,148][106225] Updated weights for policy 1, policy_version 674507 (0.0008) [2023-12-28 00:05:04,209][106225] Updated weights for policy 1, policy_version 674517 (0.0008) [2023-12-28 00:05:04,278][106225] Updated weights for policy 1, policy_version 674527 (0.0008) [2023-12-28 00:05:04,381][106226] Updated weights for policy 0, policy_version 672771 (0.0010) [2023-12-28 00:05:04,450][106226] Updated weights for policy 0, policy_version 672781 (0.0011) [2023-12-28 00:05:04,513][106226] Updated weights for policy 0, policy_version 672791 (0.0011) [2023-12-28 00:05:05,041][106225] Updated weights for policy 1, policy_version 674537 (0.0008) [2023-12-28 00:05:05,104][106225] Updated weights for policy 1, policy_version 674547 (0.0010) [2023-12-28 00:05:05,165][106225] Updated weights for policy 1, policy_version 674557 (0.0007) [2023-12-28 00:05:05,204][106226] Updated weights for policy 0, policy_version 672801 (0.0010) [2023-12-28 00:05:05,231][106225] Updated weights for policy 1, policy_version 674567 (0.0006) [2023-12-28 00:05:05,271][106226] Updated weights for policy 0, policy_version 672811 (0.0008) [2023-12-28 00:05:05,327][106226] Updated weights for policy 0, policy_version 672821 (0.0008) [2023-12-28 00:05:05,390][106226] Updated weights for policy 0, policy_version 672831 (0.0011) [2023-12-28 00:05:06,022][106225] Updated weights for policy 1, policy_version 674577 (0.0007) [2023-12-28 00:05:06,090][106225] Updated weights for policy 1, policy_version 674587 (0.0007) [2023-12-28 00:05:06,158][106225] Updated weights for policy 1, policy_version 674597 (0.0007) [2023-12-28 00:05:06,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.5, 300 sec: 18272.3). Total num frames: 345014272. Throughput: 0: 9363.6, 1: 9312.5. Samples: 345031840. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:06,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-5.326')] [2023-12-28 00:05:06,204][106226] Updated weights for policy 0, policy_version 672841 (0.0009) [2023-12-28 00:05:06,272][106226] Updated weights for policy 0, policy_version 672851 (0.0008) [2023-12-28 00:05:06,339][106226] Updated weights for policy 0, policy_version 672861 (0.0011) [2023-12-28 00:05:06,970][106225] Updated weights for policy 1, policy_version 674607 (0.0008) [2023-12-28 00:05:07,014][106226] Updated weights for policy 0, policy_version 672871 (0.0007) [2023-12-28 00:05:07,032][106225] Updated weights for policy 1, policy_version 674617 (0.0008) [2023-12-28 00:05:07,076][106226] Updated weights for policy 0, policy_version 672881 (0.0010) [2023-12-28 00:05:07,096][106225] Updated weights for policy 1, policy_version 674627 (0.0010) [2023-12-28 00:05:07,140][106226] Updated weights for policy 0, policy_version 672891 (0.0010) [2023-12-28 00:05:07,797][106225] Updated weights for policy 1, policy_version 674637 (0.0008) [2023-12-28 00:05:07,813][106226] Updated weights for policy 0, policy_version 672901 (0.0011) [2023-12-28 00:05:07,852][106225] Updated weights for policy 1, policy_version 674647 (0.0006) [2023-12-28 00:05:07,879][106226] Updated weights for policy 0, policy_version 672911 (0.0011) [2023-12-28 00:05:07,909][106225] Updated weights for policy 1, policy_version 674657 (0.0006) [2023-12-28 00:05:07,938][106226] Updated weights for policy 0, policy_version 672921 (0.0011) [2023-12-28 00:05:08,604][106225] Updated weights for policy 1, policy_version 674667 (0.0007) [2023-12-28 00:05:08,654][106226] Updated weights for policy 0, policy_version 672931 (0.0011) [2023-12-28 00:05:08,668][106225] Updated weights for policy 1, policy_version 674677 (0.0008) [2023-12-28 00:05:08,719][106226] Updated weights for policy 0, policy_version 672941 (0.0011) [2023-12-28 00:05:08,726][106225] Updated weights for policy 1, policy_version 674687 (0.0008) [2023-12-28 00:05:08,782][106226] Updated weights for policy 0, policy_version 672951 (0.0010) [2023-12-28 00:05:09,516][106225] Updated weights for policy 1, policy_version 674697 (0.0008) [2023-12-28 00:05:09,567][106226] Updated weights for policy 0, policy_version 672961 (0.0011) [2023-12-28 00:05:09,588][106225] Updated weights for policy 1, policy_version 674707 (0.0008) [2023-12-28 00:05:09,638][106226] Updated weights for policy 0, policy_version 672971 (0.0011) [2023-12-28 00:05:09,652][106225] Updated weights for policy 1, policy_version 674717 (0.0006) [2023-12-28 00:05:09,707][106226] Updated weights for policy 0, policy_version 672981 (0.0011) [2023-12-28 00:05:09,710][106225] Updated weights for policy 1, policy_version 674727 (0.0007) [2023-12-28 00:05:09,775][106226] Updated weights for policy 0, policy_version 672991 (0.0011) [2023-12-28 00:05:10,537][106226] Updated weights for policy 0, policy_version 673001 (0.0011) [2023-12-28 00:05:10,554][106225] Updated weights for policy 1, policy_version 674737 (0.0009) [2023-12-28 00:05:10,598][106226] Updated weights for policy 0, policy_version 673011 (0.0007) [2023-12-28 00:05:10,617][106225] Updated weights for policy 1, policy_version 674747 (0.0009) [2023-12-28 00:05:10,665][106226] Updated weights for policy 0, policy_version 673021 (0.0011) [2023-12-28 00:05:10,679][106225] Updated weights for policy 1, policy_version 674757 (0.0009) [2023-12-28 00:05:11,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18568.5, 300 sec: 18300.1). Total num frames: 345112576. Throughput: 0: 9396.6, 1: 9316.3. Samples: 345088648. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:11,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-5.155')] [2023-12-28 00:05:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000674760_172769280.pth... [2023-12-28 00:05:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000673024_172343296.pth... [2023-12-28 00:05:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000673672_172490752.pth [2023-12-28 00:05:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000671936_172064768.pth [2023-12-28 00:05:11,475][106226] Updated weights for policy 0, policy_version 673031 (0.0009) [2023-12-28 00:05:11,501][106225] Updated weights for policy 1, policy_version 674767 (0.0008) [2023-12-28 00:05:11,536][106226] Updated weights for policy 0, policy_version 673041 (0.0008) [2023-12-28 00:05:11,564][106225] Updated weights for policy 1, policy_version 674777 (0.0006) [2023-12-28 00:05:11,600][106226] Updated weights for policy 0, policy_version 673051 (0.0008) [2023-12-28 00:05:11,634][106225] Updated weights for policy 1, policy_version 674787 (0.0008) [2023-12-28 00:05:12,490][106226] Updated weights for policy 0, policy_version 673061 (0.0010) [2023-12-28 00:05:12,523][106225] Updated weights for policy 1, policy_version 674797 (0.0008) [2023-12-28 00:05:12,558][106226] Updated weights for policy 0, policy_version 673071 (0.0011) [2023-12-28 00:05:12,595][106225] Updated weights for policy 1, policy_version 674807 (0.0008) [2023-12-28 00:05:12,630][106226] Updated weights for policy 0, policy_version 673081 (0.0011) [2023-12-28 00:05:12,664][106225] Updated weights for policy 1, policy_version 674817 (0.0009) [2023-12-28 00:05:13,367][106225] Updated weights for policy 1, policy_version 674827 (0.0009) [2023-12-28 00:05:13,429][106226] Updated weights for policy 0, policy_version 673091 (0.0009) [2023-12-28 00:05:13,433][106225] Updated weights for policy 1, policy_version 674837 (0.0008) [2023-12-28 00:05:13,491][106225] Updated weights for policy 1, policy_version 674847 (0.0008) [2023-12-28 00:05:13,505][106226] Updated weights for policy 0, policy_version 673101 (0.0006) [2023-12-28 00:05:13,579][106226] Updated weights for policy 0, policy_version 673111 (0.0007) [2023-12-28 00:05:14,226][106225] Updated weights for policy 1, policy_version 674857 (0.0008) [2023-12-28 00:05:14,297][106225] Updated weights for policy 1, policy_version 674867 (0.0007) [2023-12-28 00:05:14,363][106226] Updated weights for policy 0, policy_version 673121 (0.0009) [2023-12-28 00:05:14,365][106225] Updated weights for policy 1, policy_version 674877 (0.0006) [2023-12-28 00:05:14,425][106225] Updated weights for policy 1, policy_version 674887 (0.0006) [2023-12-28 00:05:14,431][106226] Updated weights for policy 0, policy_version 673131 (0.0011) [2023-12-28 00:05:14,497][106226] Updated weights for policy 0, policy_version 673141 (0.0010) [2023-12-28 00:05:14,568][106226] Updated weights for policy 0, policy_version 673151 (0.0010) [2023-12-28 00:05:15,147][106225] Updated weights for policy 1, policy_version 674897 (0.0008) [2023-12-28 00:05:15,220][106225] Updated weights for policy 1, policy_version 674907 (0.0007) [2023-12-28 00:05:15,289][106225] Updated weights for policy 1, policy_version 674917 (0.0008) [2023-12-28 00:05:15,377][106226] Updated weights for policy 0, policy_version 673161 (0.0009) [2023-12-28 00:05:15,446][106226] Updated weights for policy 0, policy_version 673171 (0.0009) [2023-12-28 00:05:15,515][106226] Updated weights for policy 0, policy_version 673181 (0.0009) [2023-12-28 00:05:16,036][106225] Updated weights for policy 1, policy_version 674927 (0.0009) [2023-12-28 00:05:16,107][106225] Updated weights for policy 1, policy_version 674937 (0.0008) [2023-12-28 00:05:16,175][105115] Fps is (10 sec: 18022.4, 60 sec: 18432.0, 300 sec: 18300.1). Total num frames: 345194496. Throughput: 0: 9264.1, 1: 9247.4. Samples: 345193236. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:16,175][106225] Updated weights for policy 1, policy_version 674947 (0.0009) [2023-12-28 00:05:16,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.818')] [2023-12-28 00:05:16,205][106141] Saving new best policy, reward=-4.818! [2023-12-28 00:05:16,277][106226] Updated weights for policy 0, policy_version 673191 (0.0008) [2023-12-28 00:05:16,343][106226] Updated weights for policy 0, policy_version 673201 (0.0007) [2023-12-28 00:05:16,407][106226] Updated weights for policy 0, policy_version 673211 (0.0008) [2023-12-28 00:05:16,931][106225] Updated weights for policy 1, policy_version 674957 (0.0008) [2023-12-28 00:05:16,994][106225] Updated weights for policy 1, policy_version 674967 (0.0009) [2023-12-28 00:05:17,066][106225] Updated weights for policy 1, policy_version 674977 (0.0008) [2023-12-28 00:05:17,077][106226] Updated weights for policy 0, policy_version 673221 (0.0007) [2023-12-28 00:05:17,146][106226] Updated weights for policy 0, policy_version 673231 (0.0007) [2023-12-28 00:05:17,218][106226] Updated weights for policy 0, policy_version 673241 (0.0008) [2023-12-28 00:05:17,813][106225] Updated weights for policy 1, policy_version 674987 (0.0008) [2023-12-28 00:05:17,868][106225] Updated weights for policy 1, policy_version 674997 (0.0006) [2023-12-28 00:05:17,914][106226] Updated weights for policy 0, policy_version 673251 (0.0009) [2023-12-28 00:05:17,935][106225] Updated weights for policy 1, policy_version 675007 (0.0006) [2023-12-28 00:05:17,979][106226] Updated weights for policy 0, policy_version 673261 (0.0008) [2023-12-28 00:05:18,028][106226] Updated weights for policy 0, policy_version 673271 (0.0008) [2023-12-28 00:05:18,629][106225] Updated weights for policy 1, policy_version 675017 (0.0007) [2023-12-28 00:05:18,695][106225] Updated weights for policy 1, policy_version 675027 (0.0009) [2023-12-28 00:05:18,756][106225] Updated weights for policy 1, policy_version 675037 (0.0009) [2023-12-28 00:05:18,781][106226] Updated weights for policy 0, policy_version 673281 (0.0009) [2023-12-28 00:05:18,819][106225] Updated weights for policy 1, policy_version 675047 (0.0009) [2023-12-28 00:05:18,847][106226] Updated weights for policy 0, policy_version 673291 (0.0007) [2023-12-28 00:05:18,910][106226] Updated weights for policy 0, policy_version 673301 (0.0009) [2023-12-28 00:05:18,973][106226] Updated weights for policy 0, policy_version 673311 (0.0009) [2023-12-28 00:05:19,656][106225] Updated weights for policy 1, policy_version 675057 (0.0009) [2023-12-28 00:05:19,723][106225] Updated weights for policy 1, policy_version 675067 (0.0008) [2023-12-28 00:05:19,758][106226] Updated weights for policy 0, policy_version 673321 (0.0009) [2023-12-28 00:05:19,789][106225] Updated weights for policy 1, policy_version 675077 (0.0008) [2023-12-28 00:05:19,829][106226] Updated weights for policy 0, policy_version 673331 (0.0007) [2023-12-28 00:05:19,896][106226] Updated weights for policy 0, policy_version 673341 (0.0007) [2023-12-28 00:05:20,606][106225] Updated weights for policy 1, policy_version 675087 (0.0008) [2023-12-28 00:05:20,647][106226] Updated weights for policy 0, policy_version 673351 (0.0010) [2023-12-28 00:05:20,674][106225] Updated weights for policy 1, policy_version 675097 (0.0007) [2023-12-28 00:05:20,715][106226] Updated weights for policy 0, policy_version 673361 (0.0009) [2023-12-28 00:05:20,744][106225] Updated weights for policy 1, policy_version 675107 (0.0008) [2023-12-28 00:05:20,784][106226] Updated weights for policy 0, policy_version 673371 (0.0011) [2023-12-28 00:05:21,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.5, 300 sec: 18300.1). Total num frames: 345292800. Throughput: 0: 9226.8, 1: 9196.6. Samples: 345301676. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:21,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.379')] [2023-12-28 00:05:21,545][106225] Updated weights for policy 1, policy_version 675117 (0.0007) [2023-12-28 00:05:21,606][106226] Updated weights for policy 0, policy_version 673381 (0.0010) [2023-12-28 00:05:21,615][106225] Updated weights for policy 1, policy_version 675127 (0.0007) [2023-12-28 00:05:21,686][106226] Updated weights for policy 0, policy_version 673391 (0.0008) [2023-12-28 00:05:21,689][106225] Updated weights for policy 1, policy_version 675137 (0.0008) [2023-12-28 00:05:21,760][106226] Updated weights for policy 0, policy_version 673401 (0.0009) [2023-12-28 00:05:22,494][106225] Updated weights for policy 1, policy_version 675147 (0.0009) [2023-12-28 00:05:22,514][106226] Updated weights for policy 0, policy_version 673411 (0.0008) [2023-12-28 00:05:22,579][106226] Updated weights for policy 0, policy_version 673421 (0.0008) [2023-12-28 00:05:22,590][106225] Updated weights for policy 1, policy_version 675157 (0.0007) [2023-12-28 00:05:22,642][106226] Updated weights for policy 0, policy_version 673431 (0.0007) [2023-12-28 00:05:22,658][106225] Updated weights for policy 1, policy_version 675167 (0.0008) [2023-12-28 00:05:23,313][106225] Updated weights for policy 1, policy_version 675177 (0.0010) [2023-12-28 00:05:23,375][106225] Updated weights for policy 1, policy_version 675187 (0.0011) [2023-12-28 00:05:23,409][106226] Updated weights for policy 0, policy_version 673441 (0.0009) [2023-12-28 00:05:23,440][106225] Updated weights for policy 1, policy_version 675197 (0.0010) [2023-12-28 00:05:23,470][106226] Updated weights for policy 0, policy_version 673451 (0.0006) [2023-12-28 00:05:23,499][106225] Updated weights for policy 1, policy_version 675207 (0.0010) [2023-12-28 00:05:23,534][106226] Updated weights for policy 0, policy_version 673461 (0.0007) [2023-12-28 00:05:23,592][106226] Updated weights for policy 0, policy_version 673471 (0.0008) [2023-12-28 00:05:24,255][106225] Updated weights for policy 1, policy_version 675217 (0.0009) [2023-12-28 00:05:24,318][106225] Updated weights for policy 1, policy_version 675227 (0.0006) [2023-12-28 00:05:24,340][106226] Updated weights for policy 0, policy_version 673481 (0.0007) [2023-12-28 00:05:24,381][106225] Updated weights for policy 1, policy_version 675237 (0.0009) [2023-12-28 00:05:24,398][106226] Updated weights for policy 0, policy_version 673491 (0.0006) [2023-12-28 00:05:24,459][106226] Updated weights for policy 0, policy_version 673501 (0.0007) [2023-12-28 00:05:25,096][106225] Updated weights for policy 1, policy_version 675247 (0.0010) [2023-12-28 00:05:25,162][106225] Updated weights for policy 1, policy_version 675257 (0.0010) [2023-12-28 00:05:25,194][106226] Updated weights for policy 0, policy_version 673511 (0.0008) [2023-12-28 00:05:25,222][106225] Updated weights for policy 1, policy_version 675267 (0.0010) [2023-12-28 00:05:25,257][106226] Updated weights for policy 0, policy_version 673521 (0.0006) [2023-12-28 00:05:25,314][106226] Updated weights for policy 0, policy_version 673531 (0.0007) [2023-12-28 00:05:25,970][106225] Updated weights for policy 1, policy_version 675277 (0.0011) [2023-12-28 00:05:26,038][106225] Updated weights for policy 1, policy_version 675287 (0.0011) [2023-12-28 00:05:26,049][106226] Updated weights for policy 0, policy_version 673541 (0.0006) [2023-12-28 00:05:26,104][106225] Updated weights for policy 1, policy_version 675297 (0.0010) [2023-12-28 00:05:26,107][106226] Updated weights for policy 0, policy_version 673551 (0.0006) [2023-12-28 00:05:26,171][106226] Updated weights for policy 0, policy_version 673561 (0.0007) [2023-12-28 00:05:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 18432.0, 300 sec: 18272.3). Total num frames: 345382912. Throughput: 0: 9198.7, 1: 9138.4. Samples: 345354920. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:26,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.239')] [2023-12-28 00:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000675304_172908544.pth... [2023-12-28 00:05:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000674216_172630016.pth [2023-12-28 00:05:26,214][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000673568_172482560.pth... [2023-12-28 00:05:26,218][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000672480_172204032.pth [2023-12-28 00:05:26,784][106225] Updated weights for policy 1, policy_version 675307 (0.0009) [2023-12-28 00:05:26,843][106225] Updated weights for policy 1, policy_version 675317 (0.0008) [2023-12-28 00:05:26,888][106226] Updated weights for policy 0, policy_version 673571 (0.0009) [2023-12-28 00:05:26,907][106225] Updated weights for policy 1, policy_version 675327 (0.0009) [2023-12-28 00:05:26,947][106226] Updated weights for policy 0, policy_version 673581 (0.0011) [2023-12-28 00:05:27,013][106226] Updated weights for policy 0, policy_version 673591 (0.0011) [2023-12-28 00:05:27,587][106225] Updated weights for policy 1, policy_version 675337 (0.0011) [2023-12-28 00:05:27,644][106225] Updated weights for policy 1, policy_version 675347 (0.0010) [2023-12-28 00:05:27,694][106225] Updated weights for policy 1, policy_version 675357 (0.0010) [2023-12-28 00:05:27,709][106226] Updated weights for policy 0, policy_version 673601 (0.0010) [2023-12-28 00:05:27,750][106225] Updated weights for policy 1, policy_version 675367 (0.0010) [2023-12-28 00:05:27,769][106226] Updated weights for policy 0, policy_version 673611 (0.0008) [2023-12-28 00:05:27,840][106226] Updated weights for policy 0, policy_version 673621 (0.0006) [2023-12-28 00:05:27,907][106226] Updated weights for policy 0, policy_version 673631 (0.0010) [2023-12-28 00:05:28,501][106225] Updated weights for policy 1, policy_version 675377 (0.0007) [2023-12-28 00:05:28,560][106225] Updated weights for policy 1, policy_version 675387 (0.0008) [2023-12-28 00:05:28,560][106226] Updated weights for policy 0, policy_version 673641 (0.0009) [2023-12-28 00:05:28,624][106226] Updated weights for policy 0, policy_version 673651 (0.0008) [2023-12-28 00:05:28,625][106225] Updated weights for policy 1, policy_version 675397 (0.0008) [2023-12-28 00:05:28,693][106226] Updated weights for policy 0, policy_version 673661 (0.0008) [2023-12-28 00:05:29,427][106225] Updated weights for policy 1, policy_version 675407 (0.0008) [2023-12-28 00:05:29,488][106226] Updated weights for policy 0, policy_version 673671 (0.0009) [2023-12-28 00:05:29,492][106225] Updated weights for policy 1, policy_version 675417 (0.0007) [2023-12-28 00:05:29,557][106226] Updated weights for policy 0, policy_version 673681 (0.0009) [2023-12-28 00:05:29,559][106225] Updated weights for policy 1, policy_version 675427 (0.0007) [2023-12-28 00:05:29,620][106226] Updated weights for policy 0, policy_version 673691 (0.0007) [2023-12-28 00:05:30,344][106225] Updated weights for policy 1, policy_version 675437 (0.0008) [2023-12-28 00:05:30,396][106226] Updated weights for policy 0, policy_version 673701 (0.0007) [2023-12-28 00:05:30,405][106225] Updated weights for policy 1, policy_version 675447 (0.0008) [2023-12-28 00:05:30,456][106226] Updated weights for policy 0, policy_version 673711 (0.0007) [2023-12-28 00:05:30,466][106225] Updated weights for policy 1, policy_version 675457 (0.0008) [2023-12-28 00:05:30,514][106226] Updated weights for policy 0, policy_version 673721 (0.0006) [2023-12-28 00:05:31,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18295.5, 300 sec: 18272.3). Total num frames: 345473024. Throughput: 0: 9260.8, 1: 9203.5. Samples: 345468292. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:31,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.113')] [2023-12-28 00:05:31,183][106225] Updated weights for policy 1, policy_version 675467 (0.0008) [2023-12-28 00:05:31,243][106225] Updated weights for policy 1, policy_version 675477 (0.0011) [2023-12-28 00:05:31,257][106226] Updated weights for policy 0, policy_version 673731 (0.0009) [2023-12-28 00:05:31,309][106225] Updated weights for policy 1, policy_version 675487 (0.0010) [2023-12-28 00:05:31,321][106226] Updated weights for policy 0, policy_version 673741 (0.0007) [2023-12-28 00:05:31,392][106226] Updated weights for policy 0, policy_version 673751 (0.0007) [2023-12-28 00:05:32,081][106225] Updated weights for policy 1, policy_version 675497 (0.0013) [2023-12-28 00:05:32,149][106225] Updated weights for policy 1, policy_version 675507 (0.0008) [2023-12-28 00:05:32,169][106226] Updated weights for policy 0, policy_version 673761 (0.0009) [2023-12-28 00:05:32,218][106225] Updated weights for policy 1, policy_version 675517 (0.0009) [2023-12-28 00:05:32,238][106226] Updated weights for policy 0, policy_version 673771 (0.0008) [2023-12-28 00:05:32,291][106225] Updated weights for policy 1, policy_version 675527 (0.0008) [2023-12-28 00:05:32,311][106226] Updated weights for policy 0, policy_version 673781 (0.0008) [2023-12-28 00:05:32,373][106226] Updated weights for policy 0, policy_version 673791 (0.0008) [2023-12-28 00:05:33,077][106225] Updated weights for policy 1, policy_version 675537 (0.0008) [2023-12-28 00:05:33,100][106226] Updated weights for policy 0, policy_version 673801 (0.0007) [2023-12-28 00:05:33,136][106225] Updated weights for policy 1, policy_version 675547 (0.0008) [2023-12-28 00:05:33,149][106226] Updated weights for policy 0, policy_version 673811 (0.0005) [2023-12-28 00:05:33,197][106225] Updated weights for policy 1, policy_version 675557 (0.0009) [2023-12-28 00:05:33,204][106226] Updated weights for policy 0, policy_version 673821 (0.0008) [2023-12-28 00:05:33,934][106225] Updated weights for policy 1, policy_version 675567 (0.0007) [2023-12-28 00:05:33,956][106226] Updated weights for policy 0, policy_version 673831 (0.0010) [2023-12-28 00:05:33,991][106225] Updated weights for policy 1, policy_version 675577 (0.0007) [2023-12-28 00:05:34,023][106226] Updated weights for policy 0, policy_version 673841 (0.0011) [2023-12-28 00:05:34,048][106225] Updated weights for policy 1, policy_version 675587 (0.0005) [2023-12-28 00:05:34,092][106226] Updated weights for policy 0, policy_version 673851 (0.0011) [2023-12-28 00:05:34,770][106225] Updated weights for policy 1, policy_version 675597 (0.0010) [2023-12-28 00:05:34,836][106225] Updated weights for policy 1, policy_version 675607 (0.0010) [2023-12-28 00:05:34,847][106226] Updated weights for policy 0, policy_version 673861 (0.0010) [2023-12-28 00:05:34,888][106225] Updated weights for policy 1, policy_version 675617 (0.0010) [2023-12-28 00:05:34,902][106226] Updated weights for policy 0, policy_version 673871 (0.0007) [2023-12-28 00:05:34,967][106226] Updated weights for policy 0, policy_version 673881 (0.0008) [2023-12-28 00:05:35,619][106225] Updated weights for policy 1, policy_version 675627 (0.0010) [2023-12-28 00:05:35,683][106226] Updated weights for policy 0, policy_version 673891 (0.0010) [2023-12-28 00:05:35,683][106225] Updated weights for policy 1, policy_version 675637 (0.0011) [2023-12-28 00:05:35,740][106225] Updated weights for policy 1, policy_version 675647 (0.0010) [2023-12-28 00:05:35,747][106226] Updated weights for policy 0, policy_version 673901 (0.0011) [2023-12-28 00:05:35,809][106226] Updated weights for policy 0, policy_version 673911 (0.0011) [2023-12-28 00:05:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18568.5, 300 sec: 18300.1). Total num frames: 345571328. Throughput: 0: 9204.3, 1: 9249.7. Samples: 345579036. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:36,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.410')] [2023-12-28 00:05:36,465][106225] Updated weights for policy 1, policy_version 675657 (0.0010) [2023-12-28 00:05:36,532][106225] Updated weights for policy 1, policy_version 675667 (0.0008) [2023-12-28 00:05:36,588][106226] Updated weights for policy 0, policy_version 673921 (0.0011) [2023-12-28 00:05:36,604][106225] Updated weights for policy 1, policy_version 675677 (0.0007) [2023-12-28 00:05:36,659][106226] Updated weights for policy 0, policy_version 673931 (0.0012) [2023-12-28 00:05:36,667][106225] Updated weights for policy 1, policy_version 675687 (0.0008) [2023-12-28 00:05:36,721][106226] Updated weights for policy 0, policy_version 673941 (0.0008) [2023-12-28 00:05:36,794][106226] Updated weights for policy 0, policy_version 673951 (0.0009) [2023-12-28 00:05:37,392][106225] Updated weights for policy 1, policy_version 675697 (0.0011) [2023-12-28 00:05:37,462][106225] Updated weights for policy 1, policy_version 675707 (0.0011) [2023-12-28 00:05:37,528][106225] Updated weights for policy 1, policy_version 675717 (0.0010) [2023-12-28 00:05:37,555][106226] Updated weights for policy 0, policy_version 673961 (0.0008) [2023-12-28 00:05:37,620][106226] Updated weights for policy 0, policy_version 673971 (0.0008) [2023-12-28 00:05:37,683][106226] Updated weights for policy 0, policy_version 673981 (0.0007) [2023-12-28 00:05:38,205][106225] Updated weights for policy 1, policy_version 675727 (0.0008) [2023-12-28 00:05:38,256][106225] Updated weights for policy 1, policy_version 675737 (0.0010) [2023-12-28 00:05:38,312][106225] Updated weights for policy 1, policy_version 675747 (0.0010) [2023-12-28 00:05:38,473][106226] Updated weights for policy 0, policy_version 673991 (0.0008) [2023-12-28 00:05:38,536][106226] Updated weights for policy 0, policy_version 674001 (0.0008) [2023-12-28 00:05:38,602][106226] Updated weights for policy 0, policy_version 674011 (0.0008) [2023-12-28 00:05:39,066][106225] Updated weights for policy 1, policy_version 675757 (0.0008) [2023-12-28 00:05:39,130][106225] Updated weights for policy 1, policy_version 675767 (0.0008) [2023-12-28 00:05:39,196][106225] Updated weights for policy 1, policy_version 675777 (0.0007) [2023-12-28 00:05:39,370][106226] Updated weights for policy 0, policy_version 674021 (0.0008) [2023-12-28 00:05:39,451][106226] Updated weights for policy 0, policy_version 674031 (0.0009) [2023-12-28 00:05:39,518][106226] Updated weights for policy 0, policy_version 674041 (0.0008) [2023-12-28 00:05:40,018][106225] Updated weights for policy 1, policy_version 675787 (0.0009) [2023-12-28 00:05:40,084][106225] Updated weights for policy 1, policy_version 675797 (0.0010) [2023-12-28 00:05:40,152][106225] Updated weights for policy 1, policy_version 675807 (0.0011) [2023-12-28 00:05:40,309][106226] Updated weights for policy 0, policy_version 674051 (0.0009) [2023-12-28 00:05:40,376][106226] Updated weights for policy 0, policy_version 674061 (0.0009) [2023-12-28 00:05:40,444][106226] Updated weights for policy 0, policy_version 674071 (0.0008) [2023-12-28 00:05:40,915][106225] Updated weights for policy 1, policy_version 675817 (0.0008) [2023-12-28 00:05:40,983][106225] Updated weights for policy 1, policy_version 675827 (0.0009) [2023-12-28 00:05:41,053][106225] Updated weights for policy 1, policy_version 675837 (0.0009) [2023-12-28 00:05:41,125][106225] Updated weights for policy 1, policy_version 675847 (0.0009) [2023-12-28 00:05:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 18432.0, 300 sec: 18327.8). Total num frames: 345661440. Throughput: 0: 9158.1, 1: 9211.5. Samples: 345634300. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:41,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-5.380')] [2023-12-28 00:05:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000675848_173047808.pth... [2023-12-28 00:05:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000674080_172613632.pth... [2023-12-28 00:05:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000673024_172343296.pth [2023-12-28 00:05:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000674760_172769280.pth [2023-12-28 00:05:41,279][106226] Updated weights for policy 0, policy_version 674081 (0.0008) [2023-12-28 00:05:41,350][106226] Updated weights for policy 0, policy_version 674091 (0.0008) [2023-12-28 00:05:41,419][106226] Updated weights for policy 0, policy_version 674101 (0.0008) [2023-12-28 00:05:41,486][106226] Updated weights for policy 0, policy_version 674111 (0.0008) [2023-12-28 00:05:41,950][106225] Updated weights for policy 1, policy_version 675857 (0.0009) [2023-12-28 00:05:42,013][106225] Updated weights for policy 1, policy_version 675867 (0.0009) [2023-12-28 00:05:42,076][106225] Updated weights for policy 1, policy_version 675877 (0.0009) [2023-12-28 00:05:42,315][106226] Updated weights for policy 0, policy_version 674121 (0.0008) [2023-12-28 00:05:42,395][106226] Updated weights for policy 0, policy_version 674131 (0.0008) [2023-12-28 00:05:42,463][106226] Updated weights for policy 0, policy_version 674141 (0.0008) [2023-12-28 00:05:42,899][106225] Updated weights for policy 1, policy_version 675887 (0.0008) [2023-12-28 00:05:42,960][106225] Updated weights for policy 1, policy_version 675897 (0.0009) [2023-12-28 00:05:43,027][106225] Updated weights for policy 1, policy_version 675907 (0.0009) [2023-12-28 00:05:43,210][106226] Updated weights for policy 0, policy_version 674151 (0.0008) [2023-12-28 00:05:43,273][106226] Updated weights for policy 0, policy_version 674161 (0.0009) [2023-12-28 00:05:43,338][106226] Updated weights for policy 0, policy_version 674171 (0.0009) [2023-12-28 00:05:43,765][106225] Updated weights for policy 1, policy_version 675917 (0.0008) [2023-12-28 00:05:43,826][106225] Updated weights for policy 1, policy_version 675927 (0.0006) [2023-12-28 00:05:43,886][106225] Updated weights for policy 1, policy_version 675937 (0.0007) [2023-12-28 00:05:44,108][106226] Updated weights for policy 0, policy_version 674181 (0.0009) [2023-12-28 00:05:44,173][106226] Updated weights for policy 0, policy_version 674191 (0.0009) [2023-12-28 00:05:44,234][106226] Updated weights for policy 0, policy_version 674201 (0.0009) [2023-12-28 00:05:44,586][106225] Updated weights for policy 1, policy_version 675947 (0.0009) [2023-12-28 00:05:44,645][106225] Updated weights for policy 1, policy_version 675957 (0.0008) [2023-12-28 00:05:44,706][106225] Updated weights for policy 1, policy_version 675967 (0.0008) [2023-12-28 00:05:45,006][106226] Updated weights for policy 0, policy_version 674211 (0.0010) [2023-12-28 00:05:45,069][106226] Updated weights for policy 0, policy_version 674221 (0.0010) [2023-12-28 00:05:45,137][106226] Updated weights for policy 0, policy_version 674231 (0.0010) [2023-12-28 00:05:45,520][106225] Updated weights for policy 1, policy_version 675977 (0.0007) [2023-12-28 00:05:45,581][106225] Updated weights for policy 1, policy_version 675987 (0.0009) [2023-12-28 00:05:45,644][106225] Updated weights for policy 1, policy_version 675997 (0.0008) [2023-12-28 00:05:45,706][106225] Updated weights for policy 1, policy_version 676007 (0.0008) [2023-12-28 00:05:45,899][106226] Updated weights for policy 0, policy_version 674241 (0.0011) [2023-12-28 00:05:45,956][106226] Updated weights for policy 0, policy_version 674251 (0.0011) [2023-12-28 00:05:46,015][106226] Updated weights for policy 0, policy_version 674261 (0.0011) [2023-12-28 00:05:46,082][106226] Updated weights for policy 0, policy_version 674271 (0.0010) [2023-12-28 00:05:46,174][105115] Fps is (10 sec: 18022.6, 60 sec: 18432.0, 300 sec: 18300.1). Total num frames: 345751552. Throughput: 0: 9052.7, 1: 9151.9. Samples: 345739852. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:46,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-5.725')] [2023-12-28 00:05:46,429][106225] Updated weights for policy 1, policy_version 676017 (0.0006) [2023-12-28 00:05:46,490][106225] Updated weights for policy 1, policy_version 676027 (0.0007) [2023-12-28 00:05:46,554][106225] Updated weights for policy 1, policy_version 676037 (0.0007) [2023-12-28 00:05:46,802][106226] Updated weights for policy 0, policy_version 674281 (0.0007) [2023-12-28 00:05:46,868][106226] Updated weights for policy 0, policy_version 674291 (0.0006) [2023-12-28 00:05:46,939][106226] Updated weights for policy 0, policy_version 674301 (0.0006) [2023-12-28 00:05:47,297][106225] Updated weights for policy 1, policy_version 676047 (0.0009) [2023-12-28 00:05:47,351][106225] Updated weights for policy 1, policy_version 676057 (0.0008) [2023-12-28 00:05:47,413][106225] Updated weights for policy 1, policy_version 676067 (0.0009) [2023-12-28 00:05:47,616][106226] Updated weights for policy 0, policy_version 674311 (0.0008) [2023-12-28 00:05:47,675][106226] Updated weights for policy 0, policy_version 674321 (0.0009) [2023-12-28 00:05:47,748][106226] Updated weights for policy 0, policy_version 674331 (0.0009) [2023-12-28 00:05:48,171][106225] Updated weights for policy 1, policy_version 676077 (0.0009) [2023-12-28 00:05:48,221][106225] Updated weights for policy 1, policy_version 676087 (0.0009) [2023-12-28 00:05:48,278][106225] Updated weights for policy 1, policy_version 676097 (0.0007) [2023-12-28 00:05:48,507][106226] Updated weights for policy 0, policy_version 674341 (0.0008) [2023-12-28 00:05:48,574][106226] Updated weights for policy 0, policy_version 674351 (0.0009) [2023-12-28 00:05:48,669][106226] Updated weights for policy 0, policy_version 674361 (0.0009) [2023-12-28 00:05:49,026][106225] Updated weights for policy 1, policy_version 676107 (0.0008) [2023-12-28 00:05:49,091][106225] Updated weights for policy 1, policy_version 676117 (0.0008) [2023-12-28 00:05:49,152][106225] Updated weights for policy 1, policy_version 676127 (0.0009) [2023-12-28 00:05:49,452][106226] Updated weights for policy 0, policy_version 674371 (0.0008) [2023-12-28 00:05:49,521][106226] Updated weights for policy 0, policy_version 674381 (0.0009) [2023-12-28 00:05:49,589][106226] Updated weights for policy 0, policy_version 674391 (0.0008) [2023-12-28 00:05:50,024][106225] Updated weights for policy 1, policy_version 676137 (0.0009) [2023-12-28 00:05:50,082][106225] Updated weights for policy 1, policy_version 676147 (0.0010) [2023-12-28 00:05:50,147][106225] Updated weights for policy 1, policy_version 676157 (0.0009) [2023-12-28 00:05:50,208][106225] Updated weights for policy 1, policy_version 676167 (0.0008) [2023-12-28 00:05:50,337][106226] Updated weights for policy 0, policy_version 674401 (0.0009) [2023-12-28 00:05:50,404][106226] Updated weights for policy 0, policy_version 674411 (0.0008) [2023-12-28 00:05:50,471][106226] Updated weights for policy 0, policy_version 674421 (0.0009) [2023-12-28 00:05:50,533][106226] Updated weights for policy 0, policy_version 674431 (0.0008) [2023-12-28 00:05:51,051][106225] Updated weights for policy 1, policy_version 676177 (0.0008) [2023-12-28 00:05:51,121][106225] Updated weights for policy 1, policy_version 676187 (0.0008) [2023-12-28 00:05:51,175][105115] Fps is (10 sec: 17203.5, 60 sec: 18295.5, 300 sec: 18300.1). Total num frames: 345833472. Throughput: 0: 9063.7, 1: 9095.4. Samples: 345849000. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:51,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.396')] [2023-12-28 00:05:51,194][106225] Updated weights for policy 1, policy_version 676197 (0.0009) [2023-12-28 00:05:51,386][106226] Updated weights for policy 0, policy_version 674441 (0.0009) [2023-12-28 00:05:51,457][106226] Updated weights for policy 0, policy_version 674451 (0.0009) [2023-12-28 00:05:51,528][106226] Updated weights for policy 0, policy_version 674461 (0.0007) [2023-12-28 00:05:51,979][106225] Updated weights for policy 1, policy_version 676207 (0.0008) [2023-12-28 00:05:52,049][106225] Updated weights for policy 1, policy_version 676217 (0.0008) [2023-12-28 00:05:52,120][106225] Updated weights for policy 1, policy_version 676227 (0.0008) [2023-12-28 00:05:52,328][106226] Updated weights for policy 0, policy_version 674471 (0.0008) [2023-12-28 00:05:52,401][106226] Updated weights for policy 0, policy_version 674481 (0.0008) [2023-12-28 00:05:52,465][106226] Updated weights for policy 0, policy_version 674491 (0.0008) [2023-12-28 00:05:52,852][106225] Updated weights for policy 1, policy_version 676237 (0.0007) [2023-12-28 00:05:52,915][106225] Updated weights for policy 1, policy_version 676247 (0.0008) [2023-12-28 00:05:52,981][106225] Updated weights for policy 1, policy_version 676257 (0.0008) [2023-12-28 00:05:53,253][106226] Updated weights for policy 0, policy_version 674501 (0.0008) [2023-12-28 00:05:53,312][106226] Updated weights for policy 0, policy_version 674511 (0.0006) [2023-12-28 00:05:53,371][106226] Updated weights for policy 0, policy_version 674521 (0.0007) [2023-12-28 00:05:53,706][106225] Updated weights for policy 1, policy_version 676267 (0.0007) [2023-12-28 00:05:53,761][106225] Updated weights for policy 1, policy_version 676277 (0.0005) [2023-12-28 00:05:53,828][106225] Updated weights for policy 1, policy_version 676287 (0.0008) [2023-12-28 00:05:54,106][106226] Updated weights for policy 0, policy_version 674531 (0.0007) [2023-12-28 00:05:54,168][106226] Updated weights for policy 0, policy_version 674541 (0.0009) [2023-12-28 00:05:54,226][106226] Updated weights for policy 0, policy_version 674551 (0.0009) [2023-12-28 00:05:54,527][106225] Updated weights for policy 1, policy_version 676297 (0.0009) [2023-12-28 00:05:54,591][106225] Updated weights for policy 1, policy_version 676307 (0.0008) [2023-12-28 00:05:54,659][106225] Updated weights for policy 1, policy_version 676317 (0.0008) [2023-12-28 00:05:54,725][106225] Updated weights for policy 1, policy_version 676327 (0.0007) [2023-12-28 00:05:54,963][106226] Updated weights for policy 0, policy_version 674561 (0.0009) [2023-12-28 00:05:55,026][106226] Updated weights for policy 0, policy_version 674571 (0.0009) [2023-12-28 00:05:55,087][106226] Updated weights for policy 0, policy_version 674581 (0.0008) [2023-12-28 00:05:55,151][106226] Updated weights for policy 0, policy_version 674591 (0.0008) [2023-12-28 00:05:55,416][106225] Updated weights for policy 1, policy_version 676337 (0.0008) [2023-12-28 00:05:55,481][106225] Updated weights for policy 1, policy_version 676347 (0.0010) [2023-12-28 00:05:55,541][106225] Updated weights for policy 1, policy_version 676357 (0.0009) [2023-12-28 00:05:55,898][106226] Updated weights for policy 0, policy_version 674601 (0.0008) [2023-12-28 00:05:55,962][106226] Updated weights for policy 0, policy_version 674611 (0.0009) [2023-12-28 00:05:56,029][106226] Updated weights for policy 0, policy_version 674621 (0.0009) [2023-12-28 00:05:56,175][105115] Fps is (10 sec: 18022.0, 60 sec: 18295.4, 300 sec: 18355.6). Total num frames: 345931776. Throughput: 0: 9004.3, 1: 9079.2. Samples: 345902408. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:05:56,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-5.396')] [2023-12-28 00:05:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000676360_173178880.pth... [2023-12-28 00:05:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000674624_172752896.pth... [2023-12-28 00:05:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000673568_172482560.pth [2023-12-28 00:05:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000675304_172908544.pth [2023-12-28 00:05:56,280][106225] Updated weights for policy 1, policy_version 676367 (0.0009) [2023-12-28 00:05:56,349][106225] Updated weights for policy 1, policy_version 676377 (0.0007) [2023-12-28 00:05:56,409][106225] Updated weights for policy 1, policy_version 676387 (0.0007) [2023-12-28 00:05:56,855][106226] Updated weights for policy 0, policy_version 674631 (0.0009) [2023-12-28 00:05:56,928][106226] Updated weights for policy 0, policy_version 674641 (0.0010) [2023-12-28 00:05:56,998][106226] Updated weights for policy 0, policy_version 674651 (0.0009) [2023-12-28 00:05:57,042][106225] Updated weights for policy 1, policy_version 676397 (0.0007) [2023-12-28 00:05:57,103][106225] Updated weights for policy 1, policy_version 676407 (0.0006) [2023-12-28 00:05:57,157][106225] Updated weights for policy 1, policy_version 676417 (0.0005) [2023-12-28 00:05:57,764][106225] Updated weights for policy 1, policy_version 676427 (0.0010) [2023-12-28 00:05:57,780][106226] Updated weights for policy 0, policy_version 674661 (0.0007) [2023-12-28 00:05:57,823][106225] Updated weights for policy 1, policy_version 676437 (0.0011) [2023-12-28 00:05:57,844][106226] Updated weights for policy 0, policy_version 674671 (0.0006) [2023-12-28 00:05:57,875][106225] Updated weights for policy 1, policy_version 676447 (0.0006) [2023-12-28 00:05:57,902][106226] Updated weights for policy 0, policy_version 674681 (0.0008) [2023-12-28 00:05:58,594][106225] Updated weights for policy 1, policy_version 676457 (0.0006) [2023-12-28 00:05:58,669][106225] Updated weights for policy 1, policy_version 676467 (0.0009) [2023-12-28 00:05:58,738][106225] Updated weights for policy 1, policy_version 676477 (0.0008) [2023-12-28 00:05:58,738][106226] Updated weights for policy 0, policy_version 674691 (0.0009) [2023-12-28 00:05:58,806][106225] Updated weights for policy 1, policy_version 676487 (0.0007) [2023-12-28 00:05:58,807][106226] Updated weights for policy 0, policy_version 674701 (0.0009) [2023-12-28 00:05:58,876][106226] Updated weights for policy 0, policy_version 674711 (0.0008) [2023-12-28 00:05:59,723][106225] Updated weights for policy 1, policy_version 676497 (0.0007) [2023-12-28 00:05:59,757][106226] Updated weights for policy 0, policy_version 674721 (0.0008) [2023-12-28 00:05:59,787][106225] Updated weights for policy 1, policy_version 676507 (0.0007) [2023-12-28 00:05:59,822][106226] Updated weights for policy 0, policy_version 674731 (0.0007) [2023-12-28 00:05:59,862][106225] Updated weights for policy 1, policy_version 676517 (0.0008) [2023-12-28 00:05:59,894][106226] Updated weights for policy 0, policy_version 674741 (0.0008) [2023-12-28 00:05:59,962][106226] Updated weights for policy 0, policy_version 674751 (0.0008) [2023-12-28 00:06:00,582][106225] Updated weights for policy 1, policy_version 676527 (0.0010) [2023-12-28 00:06:00,648][106225] Updated weights for policy 1, policy_version 676537 (0.0011) [2023-12-28 00:06:00,680][106226] Updated weights for policy 0, policy_version 674761 (0.0009) [2023-12-28 00:06:00,707][106225] Updated weights for policy 1, policy_version 676547 (0.0010) [2023-12-28 00:06:00,737][106226] Updated weights for policy 0, policy_version 674771 (0.0011) [2023-12-28 00:06:00,795][106226] Updated weights for policy 0, policy_version 674781 (0.0008) [2023-12-28 00:06:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 18158.9, 300 sec: 18327.9). Total num frames: 346021888. Throughput: 0: 9009.4, 1: 9177.3. Samples: 346011636. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:06:01,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-5.584')] [2023-12-28 00:06:01,438][106225] Updated weights for policy 1, policy_version 676557 (0.0009) [2023-12-28 00:06:01,502][106225] Updated weights for policy 1, policy_version 676567 (0.0008) [2023-12-28 00:06:01,564][106225] Updated weights for policy 1, policy_version 676577 (0.0008) [2023-12-28 00:06:01,586][106226] Updated weights for policy 0, policy_version 674791 (0.0008) [2023-12-28 00:06:01,653][106226] Updated weights for policy 0, policy_version 674801 (0.0008) [2023-12-28 00:06:01,719][106226] Updated weights for policy 0, policy_version 674811 (0.0009) [2023-12-28 00:06:02,385][106225] Updated weights for policy 1, policy_version 676587 (0.0006) [2023-12-28 00:06:02,448][106225] Updated weights for policy 1, policy_version 676597 (0.0009) [2023-12-28 00:06:02,456][106226] Updated weights for policy 0, policy_version 674821 (0.0009) [2023-12-28 00:06:02,509][106225] Updated weights for policy 1, policy_version 676607 (0.0007) [2023-12-28 00:06:02,524][106226] Updated weights for policy 0, policy_version 674831 (0.0009) [2023-12-28 00:06:02,593][106226] Updated weights for policy 0, policy_version 674841 (0.0007) [2023-12-28 00:06:03,250][106225] Updated weights for policy 1, policy_version 676617 (0.0009) [2023-12-28 00:06:03,316][106225] Updated weights for policy 1, policy_version 676627 (0.0009) [2023-12-28 00:06:03,362][106226] Updated weights for policy 0, policy_version 674851 (0.0009) [2023-12-28 00:06:03,381][106225] Updated weights for policy 1, policy_version 676637 (0.0008) [2023-12-28 00:06:03,423][106226] Updated weights for policy 0, policy_version 674861 (0.0006) [2023-12-28 00:06:03,441][106225] Updated weights for policy 1, policy_version 676647 (0.0008) [2023-12-28 00:06:03,482][106226] Updated weights for policy 0, policy_version 674871 (0.0007) [2023-12-28 00:06:04,195][106225] Updated weights for policy 1, policy_version 676657 (0.0009) [2023-12-28 00:06:04,242][106226] Updated weights for policy 0, policy_version 674881 (0.0008) [2023-12-28 00:06:04,263][106225] Updated weights for policy 1, policy_version 676667 (0.0008) [2023-12-28 00:06:04,315][106226] Updated weights for policy 0, policy_version 674891 (0.0008) [2023-12-28 00:06:04,333][106225] Updated weights for policy 1, policy_version 676677 (0.0008) [2023-12-28 00:06:04,383][106226] Updated weights for policy 0, policy_version 674901 (0.0008) [2023-12-28 00:06:04,454][106226] Updated weights for policy 0, policy_version 674911 (0.0009) [2023-12-28 00:06:05,019][106225] Updated weights for policy 1, policy_version 676687 (0.0007) [2023-12-28 00:06:05,076][106225] Updated weights for policy 1, policy_version 676697 (0.0008) [2023-12-28 00:06:05,138][106225] Updated weights for policy 1, policy_version 676707 (0.0009) [2023-12-28 00:06:05,201][106226] Updated weights for policy 0, policy_version 674921 (0.0010) [2023-12-28 00:06:05,266][106226] Updated weights for policy 0, policy_version 674931 (0.0010) [2023-12-28 00:06:05,326][106226] Updated weights for policy 0, policy_version 674941 (0.0009) [2023-12-28 00:06:05,867][106225] Updated weights for policy 1, policy_version 676717 (0.0010) [2023-12-28 00:06:05,931][106225] Updated weights for policy 1, policy_version 676727 (0.0009) [2023-12-28 00:06:05,990][106225] Updated weights for policy 1, policy_version 676737 (0.0008) [2023-12-28 00:06:06,066][106226] Updated weights for policy 0, policy_version 674951 (0.0009) [2023-12-28 00:06:06,134][106226] Updated weights for policy 0, policy_version 674961 (0.0008) [2023-12-28 00:06:06,174][105115] Fps is (10 sec: 18022.9, 60 sec: 18295.5, 300 sec: 18355.6). Total num frames: 346112000. Throughput: 0: 9021.7, 1: 9224.0. Samples: 346122732. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:06:06,175][105115] Avg episode reward: [(0, '-4.234'), (1, '-5.441')] [2023-12-28 00:06:06,207][106226] Updated weights for policy 0, policy_version 674971 (0.0008) [2023-12-28 00:06:06,742][106225] Updated weights for policy 1, policy_version 676747 (0.0007) [2023-12-28 00:06:06,804][106225] Updated weights for policy 1, policy_version 676757 (0.0007) [2023-12-28 00:06:06,859][106225] Updated weights for policy 1, policy_version 676767 (0.0007) [2023-12-28 00:06:07,005][106226] Updated weights for policy 0, policy_version 674981 (0.0009) [2023-12-28 00:06:07,069][106226] Updated weights for policy 0, policy_version 674991 (0.0009) [2023-12-28 00:06:07,133][106226] Updated weights for policy 0, policy_version 675001 (0.0009) [2023-12-28 00:06:07,572][106225] Updated weights for policy 1, policy_version 676777 (0.0008) [2023-12-28 00:06:07,631][106225] Updated weights for policy 1, policy_version 676787 (0.0008) [2023-12-28 00:06:07,697][106225] Updated weights for policy 1, policy_version 676797 (0.0006) [2023-12-28 00:06:07,767][106225] Updated weights for policy 1, policy_version 676807 (0.0007) [2023-12-28 00:06:07,936][106226] Updated weights for policy 0, policy_version 675011 (0.0008) [2023-12-28 00:06:07,997][106226] Updated weights for policy 0, policy_version 675021 (0.0009) [2023-12-28 00:06:08,053][106226] Updated weights for policy 0, policy_version 675031 (0.0009) [2023-12-28 00:06:08,373][106225] Updated weights for policy 1, policy_version 676817 (0.0009) [2023-12-28 00:06:08,439][106225] Updated weights for policy 1, policy_version 676827 (0.0008) [2023-12-28 00:06:08,507][106225] Updated weights for policy 1, policy_version 676837 (0.0008) [2023-12-28 00:06:08,833][106226] Updated weights for policy 0, policy_version 675041 (0.0009) [2023-12-28 00:06:08,892][106226] Updated weights for policy 0, policy_version 675051 (0.0007) [2023-12-28 00:06:08,963][106226] Updated weights for policy 0, policy_version 675061 (0.0009) [2023-12-28 00:06:09,023][106226] Updated weights for policy 0, policy_version 675071 (0.0008) [2023-12-28 00:06:09,278][106225] Updated weights for policy 1, policy_version 676847 (0.0008) [2023-12-28 00:06:09,363][106225] Updated weights for policy 1, policy_version 676857 (0.0007) [2023-12-28 00:06:09,439][106225] Updated weights for policy 1, policy_version 676867 (0.0010) [2023-12-28 00:06:09,830][106226] Updated weights for policy 0, policy_version 675081 (0.0009) [2023-12-28 00:06:09,902][106226] Updated weights for policy 0, policy_version 675091 (0.0008) [2023-12-28 00:06:09,975][106226] Updated weights for policy 0, policy_version 675101 (0.0009) [2023-12-28 00:06:10,202][106225] Updated weights for policy 1, policy_version 676877 (0.0010) [2023-12-28 00:06:10,269][106225] Updated weights for policy 1, policy_version 676887 (0.0008) [2023-12-28 00:06:10,333][106225] Updated weights for policy 1, policy_version 676897 (0.0008) [2023-12-28 00:06:10,728][106226] Updated weights for policy 0, policy_version 675111 (0.0007) [2023-12-28 00:06:10,787][106226] Updated weights for policy 0, policy_version 675121 (0.0006) [2023-12-28 00:06:10,861][106226] Updated weights for policy 0, policy_version 675131 (0.0006) [2023-12-28 00:06:11,166][106225] Updated weights for policy 1, policy_version 676907 (0.0009) [2023-12-28 00:06:11,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 18355.6). Total num frames: 346202112. Throughput: 0: 9014.4, 1: 9278.3. Samples: 346178092. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:06:11,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.512')] [2023-12-28 00:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000675136_172883968.pth... [2023-12-28 00:06:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000674080_172613632.pth [2023-12-28 00:06:11,236][106225] Updated weights for policy 1, policy_version 676917 (0.0009) [2023-12-28 00:06:11,308][106225] Updated weights for policy 1, policy_version 676927 (0.0009) [2023-12-28 00:06:11,378][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000676936_173326336.pth... [2023-12-28 00:06:11,382][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000675848_173047808.pth [2023-12-28 00:06:11,610][106226] Updated weights for policy 0, policy_version 675141 (0.0007) [2023-12-28 00:06:11,687][106226] Updated weights for policy 0, policy_version 675151 (0.0009) [2023-12-28 00:06:11,760][106226] Updated weights for policy 0, policy_version 675161 (0.0008) [2023-12-28 00:06:12,157][106225] Updated weights for policy 1, policy_version 676937 (0.0008) [2023-12-28 00:06:12,223][106225] Updated weights for policy 1, policy_version 676947 (0.0010) [2023-12-28 00:06:12,296][106225] Updated weights for policy 1, policy_version 676957 (0.0009) [2023-12-28 00:06:12,368][106225] Updated weights for policy 1, policy_version 676967 (0.0009) [2023-12-28 00:06:12,532][106226] Updated weights for policy 0, policy_version 675171 (0.0007) [2023-12-28 00:06:12,606][106226] Updated weights for policy 0, policy_version 675181 (0.0008) [2023-12-28 00:06:12,683][106226] Updated weights for policy 0, policy_version 675191 (0.0008) [2023-12-28 00:06:13,189][106225] Updated weights for policy 1, policy_version 676977 (0.0009) [2023-12-28 00:06:13,249][106225] Updated weights for policy 1, policy_version 676987 (0.0008) [2023-12-28 00:06:13,310][106225] Updated weights for policy 1, policy_version 676997 (0.0008) [2023-12-28 00:06:13,403][106226] Updated weights for policy 0, policy_version 675201 (0.0007) [2023-12-28 00:06:13,463][106226] Updated weights for policy 0, policy_version 675211 (0.0009) [2023-12-28 00:06:13,528][106226] Updated weights for policy 0, policy_version 675221 (0.0009) [2023-12-28 00:06:13,586][106226] Updated weights for policy 0, policy_version 675231 (0.0007) [2023-12-28 00:06:14,113][106225] Updated weights for policy 1, policy_version 677007 (0.0009) [2023-12-28 00:06:14,169][106225] Updated weights for policy 1, policy_version 677017 (0.0008) [2023-12-28 00:06:14,199][106226] Updated weights for policy 0, policy_version 675241 (0.0006) [2023-12-28 00:06:14,231][106225] Updated weights for policy 1, policy_version 677027 (0.0007) [2023-12-28 00:06:14,266][106226] Updated weights for policy 0, policy_version 675251 (0.0007) [2023-12-28 00:06:14,329][106226] Updated weights for policy 0, policy_version 675261 (0.0009) [2023-12-28 00:06:15,024][106225] Updated weights for policy 1, policy_version 677037 (0.0008) [2023-12-28 00:06:15,093][106225] Updated weights for policy 1, policy_version 677047 (0.0009) [2023-12-28 00:06:15,102][106226] Updated weights for policy 0, policy_version 675271 (0.0009) [2023-12-28 00:06:15,158][106225] Updated weights for policy 1, policy_version 677057 (0.0009) [2023-12-28 00:06:15,166][106226] Updated weights for policy 0, policy_version 675281 (0.0007) [2023-12-28 00:06:15,238][106226] Updated weights for policy 0, policy_version 675291 (0.0009) [2023-12-28 00:06:15,931][106225] Updated weights for policy 1, policy_version 677067 (0.0007) [2023-12-28 00:06:15,989][106225] Updated weights for policy 1, policy_version 677077 (0.0008) [2023-12-28 00:06:15,990][106226] Updated weights for policy 0, policy_version 675301 (0.0010) [2023-12-28 00:06:16,045][106225] Updated weights for policy 1, policy_version 677087 (0.0006) [2023-12-28 00:06:16,051][106226] Updated weights for policy 0, policy_version 675311 (0.0009) [2023-12-28 00:06:16,108][106226] Updated weights for policy 0, policy_version 675321 (0.0007) [2023-12-28 00:06:16,174][105115] Fps is (10 sec: 18841.5, 60 sec: 18432.0, 300 sec: 18383.4). Total num frames: 346300416. Throughput: 0: 8983.4, 1: 9164.9. Samples: 346284964. Policy #0 lag: (min: 10.0, avg: 24.4, max: 42.0) [2023-12-28 00:06:16,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-5.650')] [2023-12-28 00:06:16,769][106225] Updated weights for policy 1, policy_version 677097 (0.0008) [2023-12-28 00:06:16,833][106225] Updated weights for policy 1, policy_version 677107 (0.0009) [2023-12-28 00:06:16,881][106226] Updated weights for policy 0, policy_version 675331 (0.0009) [2023-12-28 00:06:16,891][106225] Updated weights for policy 1, policy_version 677117 (0.0007) [2023-12-28 00:06:16,942][106226] Updated weights for policy 0, policy_version 675341 (0.0007) [2023-12-28 00:06:16,956][106225] Updated weights for policy 1, policy_version 677127 (0.0006) [2023-12-28 00:06:17,006][106226] Updated weights for policy 0, policy_version 675351 (0.0009) [2023-12-28 00:06:17,715][106226] Updated weights for policy 0, policy_version 675361 (0.0008) [2023-12-28 00:06:17,734][106225] Updated weights for policy 1, policy_version 677137 (0.0007) [2023-12-28 00:06:17,781][106226] Updated weights for policy 0, policy_version 675371 (0.0008) [2023-12-28 00:06:17,796][106225] Updated weights for policy 1, policy_version 677147 (0.0006) [2023-12-28 00:06:17,845][106226] Updated weights for policy 0, policy_version 675381 (0.0008) [2023-12-28 00:06:17,859][106225] Updated weights for policy 1, policy_version 677157 (0.0006) [2023-12-28 00:06:17,896][106226] Updated weights for policy 0, policy_version 675391 (0.0007) [2023-12-28 00:06:18,642][106225] Updated weights for policy 1, policy_version 677167 (0.0008) [2023-12-28 00:06:18,685][106226] Updated weights for policy 0, policy_version 675401 (0.0008) [2023-12-28 00:06:18,707][106225] Updated weights for policy 1, policy_version 677177 (0.0009) [2023-12-28 00:06:18,745][106226] Updated weights for policy 0, policy_version 675411 (0.0007) [2023-12-28 00:06:18,775][106225] Updated weights for policy 1, policy_version 677187 (0.0008) [2023-12-28 00:06:18,810][106226] Updated weights for policy 0, policy_version 675421 (0.0009) [2023-12-28 00:06:19,611][106225] Updated weights for policy 1, policy_version 677197 (0.0007) [2023-12-28 00:06:19,617][106226] Updated weights for policy 0, policy_version 675431 (0.0008) [2023-12-28 00:06:19,679][106225] Updated weights for policy 1, policy_version 677207 (0.0008) [2023-12-28 00:06:19,685][106226] Updated weights for policy 0, policy_version 675441 (0.0008) [2023-12-28 00:06:19,746][106226] Updated weights for policy 0, policy_version 675451 (0.0007) [2023-12-28 00:06:19,747][106225] Updated weights for policy 1, policy_version 677217 (0.0008) [2023-12-28 00:06:20,492][106225] Updated weights for policy 1, policy_version 677227 (0.0009) [2023-12-28 00:06:20,554][106226] Updated weights for policy 0, policy_version 675461 (0.0009) [2023-12-28 00:06:20,557][106225] Updated weights for policy 1, policy_version 677237 (0.0009) [2023-12-28 00:06:20,629][106226] Updated weights for policy 0, policy_version 675471 (0.0008) [2023-12-28 00:06:20,631][106225] Updated weights for policy 1, policy_version 677247 (0.0008) [2023-12-28 00:06:20,699][106226] Updated weights for policy 0, policy_version 675481 (0.0010) [2023-12-28 00:06:21,175][105115] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 18355.6). Total num frames: 346382336. Throughput: 0: 8953.1, 1: 9119.1. Samples: 346392284. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:21,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-5.441')] [2023-12-28 00:06:21,471][106226] Updated weights for policy 0, policy_version 675491 (0.0008) [2023-12-28 00:06:21,478][106225] Updated weights for policy 1, policy_version 677257 (0.0010) [2023-12-28 00:06:21,542][106226] Updated weights for policy 0, policy_version 675501 (0.0008) [2023-12-28 00:06:21,544][106225] Updated weights for policy 1, policy_version 677267 (0.0007) [2023-12-28 00:06:21,609][106226] Updated weights for policy 0, policy_version 675511 (0.0008) [2023-12-28 00:06:21,612][106225] Updated weights for policy 1, policy_version 677277 (0.0008) [2023-12-28 00:06:21,686][106225] Updated weights for policy 1, policy_version 677287 (0.0008) [2023-12-28 00:06:22,437][106226] Updated weights for policy 0, policy_version 675521 (0.0008) [2023-12-28 00:06:22,503][106226] Updated weights for policy 0, policy_version 675531 (0.0011) [2023-12-28 00:06:22,505][106225] Updated weights for policy 1, policy_version 677297 (0.0007) [2023-12-28 00:06:22,568][106226] Updated weights for policy 0, policy_version 675541 (0.0011) [2023-12-28 00:06:22,577][106225] Updated weights for policy 1, policy_version 677307 (0.0008) [2023-12-28 00:06:22,639][106226] Updated weights for policy 0, policy_version 675551 (0.0011) [2023-12-28 00:06:22,641][106225] Updated weights for policy 1, policy_version 677317 (0.0009) [2023-12-28 00:06:23,395][106225] Updated weights for policy 1, policy_version 677327 (0.0006) [2023-12-28 00:06:23,397][106226] Updated weights for policy 0, policy_version 675561 (0.0011) [2023-12-28 00:06:23,454][106225] Updated weights for policy 1, policy_version 677337 (0.0007) [2023-12-28 00:06:23,461][106226] Updated weights for policy 0, policy_version 675571 (0.0011) [2023-12-28 00:06:23,510][106225] Updated weights for policy 1, policy_version 677347 (0.0007) [2023-12-28 00:06:23,523][106226] Updated weights for policy 0, policy_version 675581 (0.0011) [2023-12-28 00:06:24,264][106226] Updated weights for policy 0, policy_version 675591 (0.0011) [2023-12-28 00:06:24,268][106225] Updated weights for policy 1, policy_version 677357 (0.0007) [2023-12-28 00:06:24,326][106226] Updated weights for policy 0, policy_version 675601 (0.0011) [2023-12-28 00:06:24,331][106225] Updated weights for policy 1, policy_version 677367 (0.0010) [2023-12-28 00:06:24,390][106226] Updated weights for policy 0, policy_version 675611 (0.0011) [2023-12-28 00:06:24,392][106225] Updated weights for policy 1, policy_version 677377 (0.0006) [2023-12-28 00:06:25,146][106225] Updated weights for policy 1, policy_version 677387 (0.0007) [2023-12-28 00:06:25,167][106226] Updated weights for policy 0, policy_version 675621 (0.0009) [2023-12-28 00:06:25,202][106225] Updated weights for policy 1, policy_version 677397 (0.0006) [2023-12-28 00:06:25,232][106226] Updated weights for policy 0, policy_version 675631 (0.0006) [2023-12-28 00:06:25,262][106225] Updated weights for policy 1, policy_version 677407 (0.0008) [2023-12-28 00:06:25,299][106226] Updated weights for policy 0, policy_version 675641 (0.0007) [2023-12-28 00:06:26,008][106226] Updated weights for policy 0, policy_version 675651 (0.0008) [2023-12-28 00:06:26,031][106225] Updated weights for policy 1, policy_version 677417 (0.0006) [2023-12-28 00:06:26,069][106226] Updated weights for policy 0, policy_version 675661 (0.0007) [2023-12-28 00:06:26,090][106225] Updated weights for policy 1, policy_version 677427 (0.0008) [2023-12-28 00:06:26,133][106226] Updated weights for policy 0, policy_version 675671 (0.0008) [2023-12-28 00:06:26,162][106225] Updated weights for policy 1, policy_version 677437 (0.0009) [2023-12-28 00:06:26,175][105115] Fps is (10 sec: 16383.8, 60 sec: 18022.4, 300 sec: 18327.9). Total num frames: 346464256. Throughput: 0: 8943.1, 1: 9059.9. Samples: 346444432. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:26,175][105115] Avg episode reward: [(0, '-4.767'), (1, '-5.447')] [2023-12-28 00:06:26,200][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000675680_173023232.pth... [2023-12-28 00:06:26,205][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000674624_172752896.pth [2023-12-28 00:06:26,226][106225] Updated weights for policy 1, policy_version 677447 (0.0008) [2023-12-28 00:06:26,231][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000677448_173457408.pth... [2023-12-28 00:06:26,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000676360_173178880.pth [2023-12-28 00:06:26,875][106226] Updated weights for policy 0, policy_version 675681 (0.0008) [2023-12-28 00:06:26,939][106226] Updated weights for policy 0, policy_version 675691 (0.0008) [2023-12-28 00:06:26,967][106225] Updated weights for policy 1, policy_version 677457 (0.0007) [2023-12-28 00:06:26,999][106226] Updated weights for policy 0, policy_version 675701 (0.0008) [2023-12-28 00:06:27,031][106225] Updated weights for policy 1, policy_version 677467 (0.0009) [2023-12-28 00:06:27,061][106226] Updated weights for policy 0, policy_version 675711 (0.0008) [2023-12-28 00:06:27,084][106225] Updated weights for policy 1, policy_version 677477 (0.0009) [2023-12-28 00:06:27,773][106225] Updated weights for policy 1, policy_version 677487 (0.0009) [2023-12-28 00:06:27,797][106226] Updated weights for policy 0, policy_version 675721 (0.0009) [2023-12-28 00:06:27,833][106225] Updated weights for policy 1, policy_version 677497 (0.0007) [2023-12-28 00:06:27,856][106226] Updated weights for policy 0, policy_version 675731 (0.0009) [2023-12-28 00:06:27,889][106225] Updated weights for policy 1, policy_version 677507 (0.0007) [2023-12-28 00:06:27,912][106226] Updated weights for policy 0, policy_version 675741 (0.0008) [2023-12-28 00:06:28,577][106225] Updated weights for policy 1, policy_version 677517 (0.0007) [2023-12-28 00:06:28,632][106225] Updated weights for policy 1, policy_version 677527 (0.0007) [2023-12-28 00:06:28,692][106225] Updated weights for policy 1, policy_version 677537 (0.0007) [2023-12-28 00:06:28,700][106226] Updated weights for policy 0, policy_version 675751 (0.0008) [2023-12-28 00:06:28,757][106226] Updated weights for policy 0, policy_version 675761 (0.0009) [2023-12-28 00:06:28,818][106226] Updated weights for policy 0, policy_version 675771 (0.0008) [2023-12-28 00:06:29,492][106225] Updated weights for policy 1, policy_version 677547 (0.0007) [2023-12-28 00:06:29,557][106225] Updated weights for policy 1, policy_version 677557 (0.0008) [2023-12-28 00:06:29,618][106225] Updated weights for policy 1, policy_version 677567 (0.0007) [2023-12-28 00:06:29,632][106226] Updated weights for policy 0, policy_version 675781 (0.0008) [2023-12-28 00:06:29,697][106226] Updated weights for policy 0, policy_version 675791 (0.0008) [2023-12-28 00:06:29,755][106226] Updated weights for policy 0, policy_version 675801 (0.0008) [2023-12-28 00:06:30,421][106225] Updated weights for policy 1, policy_version 677577 (0.0008) [2023-12-28 00:06:30,482][106225] Updated weights for policy 1, policy_version 677587 (0.0008) [2023-12-28 00:06:30,538][106225] Updated weights for policy 1, policy_version 677597 (0.0008) [2023-12-28 00:06:30,570][106226] Updated weights for policy 0, policy_version 675811 (0.0008) [2023-12-28 00:06:30,596][106225] Updated weights for policy 1, policy_version 677607 (0.0008) [2023-12-28 00:06:30,631][106226] Updated weights for policy 0, policy_version 675821 (0.0008) [2023-12-28 00:06:30,695][106226] Updated weights for policy 0, policy_version 675831 (0.0008) [2023-12-28 00:06:31,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 18355.6). Total num frames: 346562560. Throughput: 0: 8987.6, 1: 9136.0. Samples: 346555416. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:31,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.208')] [2023-12-28 00:06:31,358][106225] Updated weights for policy 1, policy_version 677617 (0.0011) [2023-12-28 00:06:31,427][106225] Updated weights for policy 1, policy_version 677627 (0.0008) [2023-12-28 00:06:31,482][106226] Updated weights for policy 0, policy_version 675841 (0.0006) [2023-12-28 00:06:31,501][106225] Updated weights for policy 1, policy_version 677637 (0.0010) [2023-12-28 00:06:31,547][106226] Updated weights for policy 0, policy_version 675851 (0.0007) [2023-12-28 00:06:31,615][106226] Updated weights for policy 0, policy_version 675861 (0.0008) [2023-12-28 00:06:31,690][106226] Updated weights for policy 0, policy_version 675871 (0.0009) [2023-12-28 00:06:32,238][106225] Updated weights for policy 1, policy_version 677647 (0.0009) [2023-12-28 00:06:32,307][106225] Updated weights for policy 1, policy_version 677657 (0.0008) [2023-12-28 00:06:32,375][106225] Updated weights for policy 1, policy_version 677667 (0.0007) [2023-12-28 00:06:32,480][106226] Updated weights for policy 0, policy_version 675881 (0.0010) [2023-12-28 00:06:32,549][106226] Updated weights for policy 0, policy_version 675891 (0.0011) [2023-12-28 00:06:32,618][106226] Updated weights for policy 0, policy_version 675901 (0.0009) [2023-12-28 00:06:33,128][106225] Updated weights for policy 1, policy_version 677677 (0.0008) [2023-12-28 00:06:33,174][106225] Updated weights for policy 1, policy_version 677687 (0.0008) [2023-12-28 00:06:33,230][106225] Updated weights for policy 1, policy_version 677697 (0.0007) [2023-12-28 00:06:33,338][106226] Updated weights for policy 0, policy_version 675911 (0.0011) [2023-12-28 00:06:33,399][106226] Updated weights for policy 0, policy_version 675921 (0.0011) [2023-12-28 00:06:33,462][106226] Updated weights for policy 0, policy_version 675931 (0.0009) [2023-12-28 00:06:34,012][106225] Updated weights for policy 1, policy_version 677707 (0.0006) [2023-12-28 00:06:34,033][106226] Updated weights for policy 0, policy_version 675941 (0.0008) [2023-12-28 00:06:34,072][106225] Updated weights for policy 1, policy_version 677717 (0.0006) [2023-12-28 00:06:34,091][106226] Updated weights for policy 0, policy_version 675951 (0.0011) [2023-12-28 00:06:34,137][106225] Updated weights for policy 1, policy_version 677727 (0.0008) [2023-12-28 00:06:34,153][106226] Updated weights for policy 0, policy_version 675961 (0.0010) [2023-12-28 00:06:34,899][106226] Updated weights for policy 0, policy_version 675971 (0.0010) [2023-12-28 00:06:34,925][106225] Updated weights for policy 1, policy_version 677737 (0.0008) [2023-12-28 00:06:34,961][106226] Updated weights for policy 0, policy_version 675981 (0.0011) [2023-12-28 00:06:34,986][106225] Updated weights for policy 1, policy_version 677747 (0.0006) [2023-12-28 00:06:35,027][106226] Updated weights for policy 0, policy_version 675991 (0.0011) [2023-12-28 00:06:35,050][106225] Updated weights for policy 1, policy_version 677757 (0.0010) [2023-12-28 00:06:35,113][106225] Updated weights for policy 1, policy_version 677767 (0.0008) [2023-12-28 00:06:35,723][106226] Updated weights for policy 0, policy_version 676001 (0.0011) [2023-12-28 00:06:35,776][106225] Updated weights for policy 1, policy_version 677777 (0.0007) [2023-12-28 00:06:35,785][106226] Updated weights for policy 0, policy_version 676011 (0.0011) [2023-12-28 00:06:35,837][106225] Updated weights for policy 1, policy_version 677787 (0.0006) [2023-12-28 00:06:35,844][106226] Updated weights for policy 0, policy_version 676021 (0.0011) [2023-12-28 00:06:35,901][106225] Updated weights for policy 1, policy_version 677797 (0.0008) [2023-12-28 00:06:35,910][106226] Updated weights for policy 0, policy_version 676031 (0.0010) [2023-12-28 00:06:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 18159.0, 300 sec: 18383.4). Total num frames: 346660864. Throughput: 0: 9044.1, 1: 9154.4. Samples: 346667932. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:36,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.665')] [2023-12-28 00:06:36,650][106226] Updated weights for policy 0, policy_version 676041 (0.0011) [2023-12-28 00:06:36,665][106225] Updated weights for policy 1, policy_version 677807 (0.0007) [2023-12-28 00:06:36,713][106226] Updated weights for policy 0, policy_version 676051 (0.0010) [2023-12-28 00:06:36,726][106225] Updated weights for policy 1, policy_version 677817 (0.0007) [2023-12-28 00:06:36,781][106226] Updated weights for policy 0, policy_version 676061 (0.0011) [2023-12-28 00:06:36,794][106225] Updated weights for policy 1, policy_version 677827 (0.0006) [2023-12-28 00:06:37,520][106226] Updated weights for policy 0, policy_version 676071 (0.0011) [2023-12-28 00:06:37,564][106225] Updated weights for policy 1, policy_version 677837 (0.0007) [2023-12-28 00:06:37,586][106226] Updated weights for policy 0, policy_version 676081 (0.0011) [2023-12-28 00:06:37,624][106225] Updated weights for policy 1, policy_version 677847 (0.0006) [2023-12-28 00:06:37,647][106226] Updated weights for policy 0, policy_version 676091 (0.0010) [2023-12-28 00:06:37,683][106225] Updated weights for policy 1, policy_version 677857 (0.0007) [2023-12-28 00:06:38,427][106226] Updated weights for policy 0, policy_version 676101 (0.0007) [2023-12-28 00:06:38,457][106225] Updated weights for policy 1, policy_version 677867 (0.0006) [2023-12-28 00:06:38,488][106226] Updated weights for policy 0, policy_version 676111 (0.0006) [2023-12-28 00:06:38,525][106225] Updated weights for policy 1, policy_version 677877 (0.0009) [2023-12-28 00:06:38,557][106226] Updated weights for policy 0, policy_version 676121 (0.0007) [2023-12-28 00:06:38,589][106225] Updated weights for policy 1, policy_version 677887 (0.0008) [2023-12-28 00:06:39,289][106226] Updated weights for policy 0, policy_version 676131 (0.0007) [2023-12-28 00:06:39,323][106225] Updated weights for policy 1, policy_version 677897 (0.0009) [2023-12-28 00:06:39,357][106226] Updated weights for policy 0, policy_version 676141 (0.0008) [2023-12-28 00:06:39,398][106225] Updated weights for policy 1, policy_version 677907 (0.0008) [2023-12-28 00:06:39,439][106226] Updated weights for policy 0, policy_version 676151 (0.0009) [2023-12-28 00:06:39,471][106225] Updated weights for policy 1, policy_version 677917 (0.0008) [2023-12-28 00:06:39,533][106225] Updated weights for policy 1, policy_version 677927 (0.0007) [2023-12-28 00:06:40,244][106226] Updated weights for policy 0, policy_version 676161 (0.0007) [2023-12-28 00:06:40,312][106226] Updated weights for policy 0, policy_version 676171 (0.0006) [2023-12-28 00:06:40,313][106225] Updated weights for policy 1, policy_version 677937 (0.0009) [2023-12-28 00:06:40,379][106225] Updated weights for policy 1, policy_version 677947 (0.0008) [2023-12-28 00:06:40,381][106226] Updated weights for policy 0, policy_version 676181 (0.0007) [2023-12-28 00:06:40,441][106225] Updated weights for policy 1, policy_version 677957 (0.0008) [2023-12-28 00:06:40,448][106226] Updated weights for policy 0, policy_version 676191 (0.0007) [2023-12-28 00:06:41,175][105115] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 18355.6). Total num frames: 346742784. Throughput: 0: 9081.1, 1: 9146.9. Samples: 346722664. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:41,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-5.617')] [2023-12-28 00:06:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000677960_173588480.pth... [2023-12-28 00:06:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000676936_173326336.pth [2023-12-28 00:06:41,210][106226] Updated weights for policy 0, policy_version 676201 (0.0011) [2023-12-28 00:06:41,276][106225] Updated weights for policy 1, policy_version 677967 (0.0008) [2023-12-28 00:06:41,280][106226] Updated weights for policy 0, policy_version 676211 (0.0012) [2023-12-28 00:06:41,347][106226] Updated weights for policy 0, policy_version 676221 (0.0008) [2023-12-28 00:06:41,350][106225] Updated weights for policy 1, policy_version 677977 (0.0007) [2023-12-28 00:06:41,389][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000676224_173162496.pth... [2023-12-28 00:06:41,394][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000675136_172883968.pth [2023-12-28 00:06:41,420][106225] Updated weights for policy 1, policy_version 677987 (0.0009) [2023-12-28 00:06:42,174][106226] Updated weights for policy 0, policy_version 676231 (0.0010) [2023-12-28 00:06:42,204][106225] Updated weights for policy 1, policy_version 677997 (0.0006) [2023-12-28 00:06:42,242][106226] Updated weights for policy 0, policy_version 676241 (0.0011) [2023-12-28 00:06:42,267][106225] Updated weights for policy 1, policy_version 678007 (0.0008) [2023-12-28 00:06:42,314][106226] Updated weights for policy 0, policy_version 676251 (0.0011) [2023-12-28 00:06:42,334][106225] Updated weights for policy 1, policy_version 678017 (0.0008) [2023-12-28 00:06:43,072][106226] Updated weights for policy 0, policy_version 676261 (0.0011) [2023-12-28 00:06:43,073][106225] Updated weights for policy 1, policy_version 678027 (0.0009) [2023-12-28 00:06:43,136][106226] Updated weights for policy 0, policy_version 676271 (0.0011) [2023-12-28 00:06:43,138][106225] Updated weights for policy 1, policy_version 678037 (0.0006) [2023-12-28 00:06:43,195][106226] Updated weights for policy 0, policy_version 676281 (0.0010) [2023-12-28 00:06:43,197][106225] Updated weights for policy 1, policy_version 678047 (0.0006) [2023-12-28 00:06:43,932][106225] Updated weights for policy 1, policy_version 678057 (0.0006) [2023-12-28 00:06:43,934][106226] Updated weights for policy 0, policy_version 676291 (0.0010) [2023-12-28 00:06:43,991][106226] Updated weights for policy 0, policy_version 676301 (0.0007) [2023-12-28 00:06:43,993][106225] Updated weights for policy 1, policy_version 678067 (0.0007) [2023-12-28 00:06:44,045][106226] Updated weights for policy 0, policy_version 676311 (0.0005) [2023-12-28 00:06:44,053][106225] Updated weights for policy 1, policy_version 678077 (0.0008) [2023-12-28 00:06:44,112][106225] Updated weights for policy 1, policy_version 678087 (0.0009) [2023-12-28 00:06:44,762][106226] Updated weights for policy 0, policy_version 676321 (0.0006) [2023-12-28 00:06:44,833][106226] Updated weights for policy 0, policy_version 676331 (0.0007) [2023-12-28 00:06:44,900][106226] Updated weights for policy 0, policy_version 676341 (0.0007) [2023-12-28 00:06:44,916][106225] Updated weights for policy 1, policy_version 678097 (0.0008) [2023-12-28 00:06:44,973][106226] Updated weights for policy 0, policy_version 676351 (0.0009) [2023-12-28 00:06:44,985][106225] Updated weights for policy 1, policy_version 678107 (0.0009) [2023-12-28 00:06:45,054][106225] Updated weights for policy 1, policy_version 678117 (0.0009) [2023-12-28 00:06:45,753][106226] Updated weights for policy 0, policy_version 676361 (0.0010) [2023-12-28 00:06:45,809][106225] Updated weights for policy 1, policy_version 678127 (0.0008) [2023-12-28 00:06:45,811][106226] Updated weights for policy 0, policy_version 676371 (0.0007) [2023-12-28 00:06:45,877][106225] Updated weights for policy 1, policy_version 678137 (0.0007) [2023-12-28 00:06:45,879][106226] Updated weights for policy 0, policy_version 676381 (0.0011) [2023-12-28 00:06:45,936][106225] Updated weights for policy 1, policy_version 678147 (0.0008) [2023-12-28 00:06:46,174][105115] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 18383.4). Total num frames: 346841088. Throughput: 0: 9109.3, 1: 9061.2. Samples: 346829308. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:46,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-5.229')] [2023-12-28 00:06:46,596][106226] Updated weights for policy 0, policy_version 676391 (0.0008) [2023-12-28 00:06:46,653][106225] Updated weights for policy 1, policy_version 678157 (0.0007) [2023-12-28 00:06:46,663][106226] Updated weights for policy 0, policy_version 676401 (0.0011) [2023-12-28 00:06:46,711][106225] Updated weights for policy 1, policy_version 678167 (0.0007) [2023-12-28 00:06:46,732][106226] Updated weights for policy 0, policy_version 676411 (0.0011) [2023-12-28 00:06:46,770][106225] Updated weights for policy 1, policy_version 678177 (0.0007) [2023-12-28 00:06:47,435][106226] Updated weights for policy 0, policy_version 676421 (0.0011) [2023-12-28 00:06:47,502][106226] Updated weights for policy 0, policy_version 676431 (0.0011) [2023-12-28 00:06:47,521][106225] Updated weights for policy 1, policy_version 678187 (0.0006) [2023-12-28 00:06:47,568][106226] Updated weights for policy 0, policy_version 676441 (0.0011) [2023-12-28 00:06:47,582][106225] Updated weights for policy 1, policy_version 678197 (0.0007) [2023-12-28 00:06:47,634][106225] Updated weights for policy 1, policy_version 678207 (0.0007) [2023-12-28 00:06:48,261][106226] Updated weights for policy 0, policy_version 676451 (0.0011) [2023-12-28 00:06:48,318][106226] Updated weights for policy 0, policy_version 676461 (0.0011) [2023-12-28 00:06:48,392][106226] Updated weights for policy 0, policy_version 676471 (0.0009) [2023-12-28 00:06:48,432][106225] Updated weights for policy 1, policy_version 678217 (0.0007) [2023-12-28 00:06:48,505][106225] Updated weights for policy 1, policy_version 678227 (0.0006) [2023-12-28 00:06:48,574][106225] Updated weights for policy 1, policy_version 678237 (0.0007) [2023-12-28 00:06:48,639][106225] Updated weights for policy 1, policy_version 678247 (0.0007) [2023-12-28 00:06:49,174][106226] Updated weights for policy 0, policy_version 676481 (0.0007) [2023-12-28 00:06:49,238][106226] Updated weights for policy 0, policy_version 676491 (0.0009) [2023-12-28 00:06:49,308][106226] Updated weights for policy 0, policy_version 676501 (0.0008) [2023-12-28 00:06:49,310][106225] Updated weights for policy 1, policy_version 678257 (0.0007) [2023-12-28 00:06:49,387][106225] Updated weights for policy 1, policy_version 678267 (0.0009) [2023-12-28 00:06:49,394][106226] Updated weights for policy 0, policy_version 676511 (0.0008) [2023-12-28 00:06:49,450][106225] Updated weights for policy 1, policy_version 678277 (0.0009) [2023-12-28 00:06:50,196][106226] Updated weights for policy 0, policy_version 676521 (0.0008) [2023-12-28 00:06:50,261][106226] Updated weights for policy 0, policy_version 676531 (0.0008) [2023-12-28 00:06:50,273][106225] Updated weights for policy 1, policy_version 678287 (0.0008) [2023-12-28 00:06:50,325][106226] Updated weights for policy 0, policy_version 676541 (0.0008) [2023-12-28 00:06:50,341][106225] Updated weights for policy 1, policy_version 678297 (0.0007) [2023-12-28 00:06:50,399][106225] Updated weights for policy 1, policy_version 678307 (0.0007) [2023-12-28 00:06:51,096][106226] Updated weights for policy 0, policy_version 676551 (0.0008) [2023-12-28 00:06:51,158][106225] Updated weights for policy 1, policy_version 678317 (0.0008) [2023-12-28 00:06:51,172][106226] Updated weights for policy 0, policy_version 676561 (0.0012) [2023-12-28 00:06:51,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 18355.6). Total num frames: 346923008. Throughput: 0: 9092.8, 1: 9046.8. Samples: 346939016. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:51,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.309')] [2023-12-28 00:06:51,230][106225] Updated weights for policy 1, policy_version 678327 (0.0007) [2023-12-28 00:06:51,236][106226] Updated weights for policy 0, policy_version 676571 (0.0011) [2023-12-28 00:06:51,304][106225] Updated weights for policy 1, policy_version 678337 (0.0009) [2023-12-28 00:06:52,055][106226] Updated weights for policy 0, policy_version 676581 (0.0010) [2023-12-28 00:06:52,102][106225] Updated weights for policy 1, policy_version 678347 (0.0008) [2023-12-28 00:06:52,122][106226] Updated weights for policy 0, policy_version 676591 (0.0011) [2023-12-28 00:06:52,170][106225] Updated weights for policy 1, policy_version 678357 (0.0008) [2023-12-28 00:06:52,186][106226] Updated weights for policy 0, policy_version 676601 (0.0011) [2023-12-28 00:06:52,239][106225] Updated weights for policy 1, policy_version 678367 (0.0008) [2023-12-28 00:06:52,931][106226] Updated weights for policy 0, policy_version 676611 (0.0009) [2023-12-28 00:06:52,982][106225] Updated weights for policy 1, policy_version 678377 (0.0008) [2023-12-28 00:06:52,995][106226] Updated weights for policy 0, policy_version 676621 (0.0009) [2023-12-28 00:06:53,044][106225] Updated weights for policy 1, policy_version 678387 (0.0007) [2023-12-28 00:06:53,059][106226] Updated weights for policy 0, policy_version 676631 (0.0011) [2023-12-28 00:06:53,111][106225] Updated weights for policy 1, policy_version 678397 (0.0006) [2023-12-28 00:06:53,178][106225] Updated weights for policy 1, policy_version 678407 (0.0009) [2023-12-28 00:06:53,743][106226] Updated weights for policy 0, policy_version 676641 (0.0011) [2023-12-28 00:06:53,808][106226] Updated weights for policy 0, policy_version 676651 (0.0011) [2023-12-28 00:06:53,815][106225] Updated weights for policy 1, policy_version 678417 (0.0006) [2023-12-28 00:06:53,874][106226] Updated weights for policy 0, policy_version 676661 (0.0011) [2023-12-28 00:06:53,881][106225] Updated weights for policy 1, policy_version 678427 (0.0007) [2023-12-28 00:06:53,938][106226] Updated weights for policy 0, policy_version 676671 (0.0009) [2023-12-28 00:06:53,940][106225] Updated weights for policy 1, policy_version 678437 (0.0009) [2023-12-28 00:06:54,643][106226] Updated weights for policy 0, policy_version 676681 (0.0007) [2023-12-28 00:06:54,707][106226] Updated weights for policy 0, policy_version 676691 (0.0008) [2023-12-28 00:06:54,718][106225] Updated weights for policy 1, policy_version 678447 (0.0010) [2023-12-28 00:06:54,762][106226] Updated weights for policy 0, policy_version 676701 (0.0011) [2023-12-28 00:06:54,776][106225] Updated weights for policy 1, policy_version 678457 (0.0011) [2023-12-28 00:06:54,832][106225] Updated weights for policy 1, policy_version 678467 (0.0011) [2023-12-28 00:06:55,484][106226] Updated weights for policy 0, policy_version 676711 (0.0009) [2023-12-28 00:06:55,527][106225] Updated weights for policy 1, policy_version 678477 (0.0011) [2023-12-28 00:06:55,547][106226] Updated weights for policy 0, policy_version 676721 (0.0011) [2023-12-28 00:06:55,590][106225] Updated weights for policy 1, policy_version 678487 (0.0010) [2023-12-28 00:06:55,606][106226] Updated weights for policy 0, policy_version 676731 (0.0011) [2023-12-28 00:06:55,645][106225] Updated weights for policy 1, policy_version 678497 (0.0011) [2023-12-28 00:06:56,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 18383.4). Total num frames: 347021312. Throughput: 0: 9109.8, 1: 9018.9. Samples: 346993884. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:06:56,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.611')] [2023-12-28 00:06:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000676736_173293568.pth... [2023-12-28 00:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000678504_173727744.pth... [2023-12-28 00:06:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000675680_173023232.pth [2023-12-28 00:06:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000677448_173457408.pth [2023-12-28 00:06:56,288][106226] Updated weights for policy 0, policy_version 676741 (0.0011) [2023-12-28 00:06:56,327][106225] Updated weights for policy 1, policy_version 678507 (0.0010) [2023-12-28 00:06:56,352][106226] Updated weights for policy 0, policy_version 676751 (0.0011) [2023-12-28 00:06:56,389][106225] Updated weights for policy 1, policy_version 678517 (0.0010) [2023-12-28 00:06:56,418][106226] Updated weights for policy 0, policy_version 676761 (0.0011) [2023-12-28 00:06:56,457][106225] Updated weights for policy 1, policy_version 678527 (0.0010) [2023-12-28 00:06:57,183][106226] Updated weights for policy 0, policy_version 676771 (0.0010) [2023-12-28 00:06:57,217][106225] Updated weights for policy 1, policy_version 678537 (0.0011) [2023-12-28 00:06:57,247][106226] Updated weights for policy 0, policy_version 676781 (0.0009) [2023-12-28 00:06:57,276][106225] Updated weights for policy 1, policy_version 678547 (0.0010) [2023-12-28 00:06:57,311][106226] Updated weights for policy 0, policy_version 676791 (0.0008) [2023-12-28 00:06:57,341][106225] Updated weights for policy 1, policy_version 678557 (0.0009) [2023-12-28 00:06:57,393][106225] Updated weights for policy 1, policy_version 678567 (0.0010) [2023-12-28 00:06:58,019][106226] Updated weights for policy 0, policy_version 676801 (0.0006) [2023-12-28 00:06:58,087][106226] Updated weights for policy 0, policy_version 676811 (0.0007) [2023-12-28 00:06:58,140][106225] Updated weights for policy 1, policy_version 678577 (0.0010) [2023-12-28 00:06:58,144][106226] Updated weights for policy 0, policy_version 676821 (0.0006) [2023-12-28 00:06:58,204][106225] Updated weights for policy 1, policy_version 678587 (0.0010) [2023-12-28 00:06:58,218][106226] Updated weights for policy 0, policy_version 676831 (0.0007) [2023-12-28 00:06:58,275][106225] Updated weights for policy 1, policy_version 678597 (0.0009) [2023-12-28 00:06:59,095][106226] Updated weights for policy 0, policy_version 676841 (0.0011) [2023-12-28 00:06:59,162][106226] Updated weights for policy 0, policy_version 676851 (0.0011) [2023-12-28 00:06:59,167][106225] Updated weights for policy 1, policy_version 678607 (0.0008) [2023-12-28 00:06:59,235][106226] Updated weights for policy 0, policy_version 676861 (0.0010) [2023-12-28 00:06:59,236][106225] Updated weights for policy 1, policy_version 678617 (0.0010) [2023-12-28 00:06:59,306][106225] Updated weights for policy 1, policy_version 678627 (0.0009) [2023-12-28 00:07:00,073][106226] Updated weights for policy 0, policy_version 676871 (0.0008) [2023-12-28 00:07:00,134][106226] Updated weights for policy 0, policy_version 676881 (0.0006) [2023-12-28 00:07:00,199][106225] Updated weights for policy 1, policy_version 678637 (0.0008) [2023-12-28 00:07:00,205][106226] Updated weights for policy 0, policy_version 676891 (0.0007) [2023-12-28 00:07:00,266][106225] Updated weights for policy 1, policy_version 678647 (0.0008) [2023-12-28 00:07:00,314][106225] Updated weights for policy 1, policy_version 678657 (0.0008) [2023-12-28 00:07:00,897][106226] Updated weights for policy 0, policy_version 676901 (0.0007) [2023-12-28 00:07:00,959][106226] Updated weights for policy 0, policy_version 676911 (0.0008) [2023-12-28 00:07:01,022][106226] Updated weights for policy 0, policy_version 676921 (0.0008) [2023-12-28 00:07:01,067][106225] Updated weights for policy 1, policy_version 678667 (0.0009) [2023-12-28 00:07:01,132][106225] Updated weights for policy 1, policy_version 678677 (0.0011) [2023-12-28 00:07:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 18158.9, 300 sec: 18383.4). Total num frames: 347111424. Throughput: 0: 9118.1, 1: 9070.7. Samples: 347103464. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:01,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-5.368')] [2023-12-28 00:07:01,206][106225] Updated weights for policy 1, policy_version 678687 (0.0009) [2023-12-28 00:07:01,843][106226] Updated weights for policy 0, policy_version 676931 (0.0008) [2023-12-28 00:07:01,905][106226] Updated weights for policy 0, policy_version 676941 (0.0008) [2023-12-28 00:07:01,972][106226] Updated weights for policy 0, policy_version 676951 (0.0006) [2023-12-28 00:07:01,973][106225] Updated weights for policy 1, policy_version 678697 (0.0010) [2023-12-28 00:07:02,038][106225] Updated weights for policy 1, policy_version 678707 (0.0008) [2023-12-28 00:07:02,095][106225] Updated weights for policy 1, policy_version 678717 (0.0008) [2023-12-28 00:07:02,159][106225] Updated weights for policy 1, policy_version 678727 (0.0008) [2023-12-28 00:07:02,700][106226] Updated weights for policy 0, policy_version 676961 (0.0007) [2023-12-28 00:07:02,762][106226] Updated weights for policy 0, policy_version 676971 (0.0008) [2023-12-28 00:07:02,820][106226] Updated weights for policy 0, policy_version 676981 (0.0005) [2023-12-28 00:07:02,886][106226] Updated weights for policy 0, policy_version 676991 (0.0008) [2023-12-28 00:07:02,989][106225] Updated weights for policy 1, policy_version 678737 (0.0009) [2023-12-28 00:07:03,052][106225] Updated weights for policy 1, policy_version 678747 (0.0008) [2023-12-28 00:07:03,118][106225] Updated weights for policy 1, policy_version 678757 (0.0008) [2023-12-28 00:07:03,606][106226] Updated weights for policy 0, policy_version 677001 (0.0008) [2023-12-28 00:07:03,670][106226] Updated weights for policy 0, policy_version 677011 (0.0008) [2023-12-28 00:07:03,726][106226] Updated weights for policy 0, policy_version 677021 (0.0009) [2023-12-28 00:07:03,837][106225] Updated weights for policy 1, policy_version 678767 (0.0008) [2023-12-28 00:07:03,905][106225] Updated weights for policy 1, policy_version 678777 (0.0008) [2023-12-28 00:07:03,976][106225] Updated weights for policy 1, policy_version 678787 (0.0008) [2023-12-28 00:07:04,477][106226] Updated weights for policy 0, policy_version 677031 (0.0009) [2023-12-28 00:07:04,541][106226] Updated weights for policy 0, policy_version 677041 (0.0009) [2023-12-28 00:07:04,594][106226] Updated weights for policy 0, policy_version 677051 (0.0009) [2023-12-28 00:07:04,785][106225] Updated weights for policy 1, policy_version 678797 (0.0008) [2023-12-28 00:07:04,849][106225] Updated weights for policy 1, policy_version 678807 (0.0009) [2023-12-28 00:07:04,908][106225] Updated weights for policy 1, policy_version 678817 (0.0008) [2023-12-28 00:07:05,334][106226] Updated weights for policy 0, policy_version 677061 (0.0009) [2023-12-28 00:07:05,392][106226] Updated weights for policy 0, policy_version 677071 (0.0009) [2023-12-28 00:07:05,449][106226] Updated weights for policy 0, policy_version 677081 (0.0009) [2023-12-28 00:07:05,567][106225] Updated weights for policy 1, policy_version 678827 (0.0006) [2023-12-28 00:07:05,626][106225] Updated weights for policy 1, policy_version 678837 (0.0008) [2023-12-28 00:07:05,684][106225] Updated weights for policy 1, policy_version 678847 (0.0008) [2023-12-28 00:07:06,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 18383.4). Total num frames: 347201536. Throughput: 0: 9157.1, 1: 9094.7. Samples: 347213612. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:06,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-5.453')] [2023-12-28 00:07:06,224][106226] Updated weights for policy 0, policy_version 677091 (0.0009) [2023-12-28 00:07:06,295][106226] Updated weights for policy 0, policy_version 677101 (0.0008) [2023-12-28 00:07:06,355][106226] Updated weights for policy 0, policy_version 677111 (0.0010) [2023-12-28 00:07:06,481][106225] Updated weights for policy 1, policy_version 678857 (0.0007) [2023-12-28 00:07:06,548][106225] Updated weights for policy 1, policy_version 678867 (0.0008) [2023-12-28 00:07:06,612][106225] Updated weights for policy 1, policy_version 678877 (0.0008) [2023-12-28 00:07:06,679][106225] Updated weights for policy 1, policy_version 678887 (0.0007) [2023-12-28 00:07:07,114][106226] Updated weights for policy 0, policy_version 677121 (0.0011) [2023-12-28 00:07:07,179][106226] Updated weights for policy 0, policy_version 677131 (0.0008) [2023-12-28 00:07:07,243][106226] Updated weights for policy 0, policy_version 677141 (0.0008) [2023-12-28 00:07:07,311][106226] Updated weights for policy 0, policy_version 677151 (0.0007) [2023-12-28 00:07:07,387][106225] Updated weights for policy 1, policy_version 678897 (0.0008) [2023-12-28 00:07:07,435][106225] Updated weights for policy 1, policy_version 678907 (0.0008) [2023-12-28 00:07:07,491][106225] Updated weights for policy 1, policy_version 678917 (0.0008) [2023-12-28 00:07:08,049][106226] Updated weights for policy 0, policy_version 677161 (0.0010) [2023-12-28 00:07:08,111][106226] Updated weights for policy 0, policy_version 677171 (0.0011) [2023-12-28 00:07:08,172][106226] Updated weights for policy 0, policy_version 677181 (0.0011) [2023-12-28 00:07:08,217][106225] Updated weights for policy 1, policy_version 678927 (0.0007) [2023-12-28 00:07:08,269][106225] Updated weights for policy 1, policy_version 678937 (0.0008) [2023-12-28 00:07:08,321][106225] Updated weights for policy 1, policy_version 678947 (0.0009) [2023-12-28 00:07:08,936][106226] Updated weights for policy 0, policy_version 677191 (0.0010) [2023-12-28 00:07:08,999][106226] Updated weights for policy 0, policy_version 677201 (0.0011) [2023-12-28 00:07:09,065][106226] Updated weights for policy 0, policy_version 677211 (0.0010) [2023-12-28 00:07:09,112][106225] Updated weights for policy 1, policy_version 678957 (0.0009) [2023-12-28 00:07:09,185][106225] Updated weights for policy 1, policy_version 678967 (0.0008) [2023-12-28 00:07:09,262][106225] Updated weights for policy 1, policy_version 678977 (0.0008) [2023-12-28 00:07:09,931][106226] Updated weights for policy 0, policy_version 677221 (0.0008) [2023-12-28 00:07:10,003][106226] Updated weights for policy 0, policy_version 677231 (0.0008) [2023-12-28 00:07:10,069][106226] Updated weights for policy 0, policy_version 677241 (0.0008) [2023-12-28 00:07:10,127][106225] Updated weights for policy 1, policy_version 678987 (0.0008) [2023-12-28 00:07:10,199][106225] Updated weights for policy 1, policy_version 678997 (0.0008) [2023-12-28 00:07:10,264][106225] Updated weights for policy 1, policy_version 679007 (0.0008) [2023-12-28 00:07:10,864][106226] Updated weights for policy 0, policy_version 677251 (0.0008) [2023-12-28 00:07:10,926][106226] Updated weights for policy 0, policy_version 677261 (0.0008) [2023-12-28 00:07:10,998][106226] Updated weights for policy 0, policy_version 677271 (0.0009) [2023-12-28 00:07:11,038][106225] Updated weights for policy 1, policy_version 679017 (0.0008) [2023-12-28 00:07:11,110][106225] Updated weights for policy 1, policy_version 679027 (0.0009) [2023-12-28 00:07:11,175][105115] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 18383.4). Total num frames: 347291648. Throughput: 0: 9181.0, 1: 9142.9. Samples: 347269008. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:11,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.311')] [2023-12-28 00:07:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000677280_173432832.pth... [2023-12-28 00:07:11,184][106225] Updated weights for policy 1, policy_version 679037 (0.0008) [2023-12-28 00:07:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000676224_173162496.pth [2023-12-28 00:07:11,251][106225] Updated weights for policy 1, policy_version 679047 (0.0008) [2023-12-28 00:07:11,258][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000679048_173867008.pth... [2023-12-28 00:07:11,263][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000677960_173588480.pth [2023-12-28 00:07:11,817][106226] Updated weights for policy 0, policy_version 677281 (0.0009) [2023-12-28 00:07:11,878][106226] Updated weights for policy 0, policy_version 677291 (0.0008) [2023-12-28 00:07:11,941][106226] Updated weights for policy 0, policy_version 677301 (0.0008) [2023-12-28 00:07:11,998][106226] Updated weights for policy 0, policy_version 677311 (0.0008) [2023-12-28 00:07:12,092][106225] Updated weights for policy 1, policy_version 679057 (0.0007) [2023-12-28 00:07:12,152][106225] Updated weights for policy 1, policy_version 679067 (0.0008) [2023-12-28 00:07:12,217][106225] Updated weights for policy 1, policy_version 679077 (0.0009) [2023-12-28 00:07:12,850][106226] Updated weights for policy 0, policy_version 677321 (0.0008) [2023-12-28 00:07:12,917][106226] Updated weights for policy 0, policy_version 677331 (0.0010) [2023-12-28 00:07:12,980][106226] Updated weights for policy 0, policy_version 677341 (0.0009) [2023-12-28 00:07:12,983][106225] Updated weights for policy 1, policy_version 679087 (0.0008) [2023-12-28 00:07:13,043][106225] Updated weights for policy 1, policy_version 679097 (0.0007) [2023-12-28 00:07:13,106][106225] Updated weights for policy 1, policy_version 679107 (0.0007) [2023-12-28 00:07:13,668][106226] Updated weights for policy 0, policy_version 677351 (0.0009) [2023-12-28 00:07:13,727][106226] Updated weights for policy 0, policy_version 677361 (0.0011) [2023-12-28 00:07:13,785][106226] Updated weights for policy 0, policy_version 677371 (0.0011) [2023-12-28 00:07:13,809][106225] Updated weights for policy 1, policy_version 679117 (0.0010) [2023-12-28 00:07:13,868][106225] Updated weights for policy 1, policy_version 679127 (0.0010) [2023-12-28 00:07:13,924][106225] Updated weights for policy 1, policy_version 679137 (0.0010) [2023-12-28 00:07:14,488][106226] Updated weights for policy 0, policy_version 677381 (0.0009) [2023-12-28 00:07:14,544][106226] Updated weights for policy 0, policy_version 677391 (0.0008) [2023-12-28 00:07:14,611][106226] Updated weights for policy 0, policy_version 677401 (0.0008) [2023-12-28 00:07:14,686][106225] Updated weights for policy 1, policy_version 679147 (0.0011) [2023-12-28 00:07:14,749][106225] Updated weights for policy 1, policy_version 679157 (0.0011) [2023-12-28 00:07:14,810][106225] Updated weights for policy 1, policy_version 679167 (0.0010) [2023-12-28 00:07:15,420][106226] Updated weights for policy 0, policy_version 677411 (0.0008) [2023-12-28 00:07:15,481][106226] Updated weights for policy 0, policy_version 677421 (0.0008) [2023-12-28 00:07:15,542][106226] Updated weights for policy 0, policy_version 677431 (0.0009) [2023-12-28 00:07:15,590][106225] Updated weights for policy 1, policy_version 679177 (0.0010) [2023-12-28 00:07:15,652][106225] Updated weights for policy 1, policy_version 679187 (0.0011) [2023-12-28 00:07:15,719][106225] Updated weights for policy 1, policy_version 679197 (0.0011) [2023-12-28 00:07:15,791][106225] Updated weights for policy 1, policy_version 679207 (0.0010) [2023-12-28 00:07:16,174][105115] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 18411.2). Total num frames: 347381760. Throughput: 0: 9140.7, 1: 9078.4. Samples: 347375276. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:16,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.539')] [2023-12-28 00:07:16,286][106226] Updated weights for policy 0, policy_version 677441 (0.0008) [2023-12-28 00:07:16,350][106226] Updated weights for policy 0, policy_version 677451 (0.0007) [2023-12-28 00:07:16,422][106226] Updated weights for policy 0, policy_version 677461 (0.0009) [2023-12-28 00:07:16,488][106226] Updated weights for policy 0, policy_version 677471 (0.0008) [2023-12-28 00:07:16,520][106225] Updated weights for policy 1, policy_version 679217 (0.0010) [2023-12-28 00:07:16,581][106225] Updated weights for policy 1, policy_version 679227 (0.0011) [2023-12-28 00:07:16,636][106225] Updated weights for policy 1, policy_version 679237 (0.0010) [2023-12-28 00:07:17,152][106226] Updated weights for policy 0, policy_version 677481 (0.0009) [2023-12-28 00:07:17,219][106226] Updated weights for policy 0, policy_version 677491 (0.0008) [2023-12-28 00:07:17,285][106226] Updated weights for policy 0, policy_version 677501 (0.0008) [2023-12-28 00:07:17,382][106225] Updated weights for policy 1, policy_version 679247 (0.0011) [2023-12-28 00:07:17,443][106225] Updated weights for policy 1, policy_version 679257 (0.0011) [2023-12-28 00:07:17,507][106225] Updated weights for policy 1, policy_version 679267 (0.0011) [2023-12-28 00:07:17,994][106226] Updated weights for policy 0, policy_version 677511 (0.0009) [2023-12-28 00:07:18,063][106226] Updated weights for policy 0, policy_version 677521 (0.0009) [2023-12-28 00:07:18,128][106226] Updated weights for policy 0, policy_version 677531 (0.0008) [2023-12-28 00:07:18,223][106225] Updated weights for policy 1, policy_version 679277 (0.0011) [2023-12-28 00:07:18,287][106225] Updated weights for policy 1, policy_version 679287 (0.0011) [2023-12-28 00:07:18,357][106225] Updated weights for policy 1, policy_version 679297 (0.0009) [2023-12-28 00:07:18,971][106226] Updated weights for policy 0, policy_version 677541 (0.0008) [2023-12-28 00:07:19,039][106226] Updated weights for policy 0, policy_version 677551 (0.0008) [2023-12-28 00:07:19,082][106225] Updated weights for policy 1, policy_version 679307 (0.0010) [2023-12-28 00:07:19,108][106226] Updated weights for policy 0, policy_version 677561 (0.0006) [2023-12-28 00:07:19,137][106225] Updated weights for policy 1, policy_version 679317 (0.0011) [2023-12-28 00:07:19,197][106225] Updated weights for policy 1, policy_version 679327 (0.0010) [2023-12-28 00:07:19,943][106226] Updated weights for policy 0, policy_version 677571 (0.0008) [2023-12-28 00:07:20,013][106226] Updated weights for policy 0, policy_version 677581 (0.0009) [2023-12-28 00:07:20,015][106225] Updated weights for policy 1, policy_version 679337 (0.0011) [2023-12-28 00:07:20,084][106225] Updated weights for policy 1, policy_version 679347 (0.0008) [2023-12-28 00:07:20,085][106226] Updated weights for policy 0, policy_version 677591 (0.0008) [2023-12-28 00:07:20,151][106225] Updated weights for policy 1, policy_version 679357 (0.0007) [2023-12-28 00:07:20,221][106225] Updated weights for policy 1, policy_version 679367 (0.0008) [2023-12-28 00:07:20,869][106226] Updated weights for policy 0, policy_version 677601 (0.0009) [2023-12-28 00:07:20,942][106226] Updated weights for policy 0, policy_version 677611 (0.0008) [2023-12-28 00:07:20,983][106225] Updated weights for policy 1, policy_version 679377 (0.0007) [2023-12-28 00:07:21,005][106226] Updated weights for policy 0, policy_version 677621 (0.0008) [2023-12-28 00:07:21,051][106225] Updated weights for policy 1, policy_version 679387 (0.0007) [2023-12-28 00:07:21,086][106226] Updated weights for policy 0, policy_version 677631 (0.0009) [2023-12-28 00:07:21,124][106225] Updated weights for policy 1, policy_version 679397 (0.0008) [2023-12-28 00:07:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 18295.5, 300 sec: 18411.2). Total num frames: 347480064. Throughput: 0: 9065.5, 1: 9068.5. Samples: 347483964. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:21,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-5.338')] [2023-12-28 00:07:21,944][106226] Updated weights for policy 0, policy_version 677641 (0.0009) [2023-12-28 00:07:21,981][106225] Updated weights for policy 1, policy_version 679407 (0.0009) [2023-12-28 00:07:22,009][106226] Updated weights for policy 0, policy_version 677651 (0.0008) [2023-12-28 00:07:22,052][106225] Updated weights for policy 1, policy_version 679417 (0.0009) [2023-12-28 00:07:22,078][106226] Updated weights for policy 0, policy_version 677661 (0.0007) [2023-12-28 00:07:22,116][106225] Updated weights for policy 1, policy_version 679427 (0.0008) [2023-12-28 00:07:22,845][106225] Updated weights for policy 1, policy_version 679437 (0.0008) [2023-12-28 00:07:22,870][106226] Updated weights for policy 0, policy_version 677671 (0.0007) [2023-12-28 00:07:22,913][106225] Updated weights for policy 1, policy_version 679447 (0.0008) [2023-12-28 00:07:22,935][106226] Updated weights for policy 0, policy_version 677681 (0.0007) [2023-12-28 00:07:22,979][106225] Updated weights for policy 1, policy_version 679457 (0.0007) [2023-12-28 00:07:23,005][106226] Updated weights for policy 0, policy_version 677691 (0.0007) [2023-12-28 00:07:23,716][106225] Updated weights for policy 1, policy_version 679467 (0.0007) [2023-12-28 00:07:23,766][106226] Updated weights for policy 0, policy_version 677701 (0.0008) [2023-12-28 00:07:23,771][106225] Updated weights for policy 1, policy_version 679477 (0.0005) [2023-12-28 00:07:23,823][106226] Updated weights for policy 0, policy_version 677711 (0.0010) [2023-12-28 00:07:23,836][106225] Updated weights for policy 1, policy_version 679487 (0.0006) [2023-12-28 00:07:23,883][106226] Updated weights for policy 0, policy_version 677721 (0.0007) [2023-12-28 00:07:24,572][106225] Updated weights for policy 1, policy_version 679497 (0.0007) [2023-12-28 00:07:24,639][106225] Updated weights for policy 1, policy_version 679507 (0.0011) [2023-12-28 00:07:24,649][106226] Updated weights for policy 0, policy_version 677731 (0.0009) [2023-12-28 00:07:24,701][106225] Updated weights for policy 1, policy_version 679517 (0.0010) [2023-12-28 00:07:24,713][106226] Updated weights for policy 0, policy_version 677741 (0.0006) [2023-12-28 00:07:24,761][106225] Updated weights for policy 1, policy_version 679527 (0.0011) [2023-12-28 00:07:24,775][106226] Updated weights for policy 0, policy_version 677751 (0.0006) [2023-12-28 00:07:25,426][106225] Updated weights for policy 1, policy_version 679537 (0.0007) [2023-12-28 00:07:25,476][106225] Updated weights for policy 1, policy_version 679547 (0.0006) [2023-12-28 00:07:25,534][106225] Updated weights for policy 1, policy_version 679557 (0.0007) [2023-12-28 00:07:25,542][106226] Updated weights for policy 0, policy_version 677761 (0.0008) [2023-12-28 00:07:25,602][106226] Updated weights for policy 0, policy_version 677771 (0.0008) [2023-12-28 00:07:25,662][106226] Updated weights for policy 0, policy_version 677781 (0.0008) [2023-12-28 00:07:25,728][106226] Updated weights for policy 0, policy_version 677791 (0.0007) [2023-12-28 00:07:26,153][106225] Updated weights for policy 1, policy_version 679567 (0.0006) [2023-12-28 00:07:26,175][105115] Fps is (10 sec: 18022.0, 60 sec: 18295.4, 300 sec: 18411.2). Total num frames: 347561984. Throughput: 0: 9019.1, 1: 9065.9. Samples: 347536488. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:26,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.157')] [2023-12-28 00:07:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000677792_173563904.pth... [2023-12-28 00:07:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000676736_173293568.pth [2023-12-28 00:07:26,215][106225] Updated weights for policy 1, policy_version 679577 (0.0009) [2023-12-28 00:07:26,285][106225] Updated weights for policy 1, policy_version 679587 (0.0010) [2023-12-28 00:07:26,312][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000679592_174006272.pth... [2023-12-28 00:07:26,316][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000678504_173727744.pth [2023-12-28 00:07:26,491][106226] Updated weights for policy 0, policy_version 677801 (0.0010) [2023-12-28 00:07:26,546][106226] Updated weights for policy 0, policy_version 677811 (0.0011) [2023-12-28 00:07:26,615][106226] Updated weights for policy 0, policy_version 677821 (0.0011) [2023-12-28 00:07:26,953][106225] Updated weights for policy 1, policy_version 679597 (0.0010) [2023-12-28 00:07:27,016][106225] Updated weights for policy 1, policy_version 679607 (0.0008) [2023-12-28 00:07:27,076][106225] Updated weights for policy 1, policy_version 679617 (0.0008) [2023-12-28 00:07:27,360][106226] Updated weights for policy 0, policy_version 677831 (0.0008) [2023-12-28 00:07:27,410][106226] Updated weights for policy 0, policy_version 677841 (0.0008) [2023-12-28 00:07:27,474][106226] Updated weights for policy 0, policy_version 677851 (0.0007) [2023-12-28 00:07:27,776][106225] Updated weights for policy 1, policy_version 679627 (0.0010) [2023-12-28 00:07:27,838][106225] Updated weights for policy 1, policy_version 679637 (0.0011) [2023-12-28 00:07:27,901][106225] Updated weights for policy 1, policy_version 679647 (0.0010) [2023-12-28 00:07:28,260][106226] Updated weights for policy 0, policy_version 677861 (0.0009) [2023-12-28 00:07:28,319][106226] Updated weights for policy 0, policy_version 677871 (0.0011) [2023-12-28 00:07:28,394][106226] Updated weights for policy 0, policy_version 677881 (0.0011) [2023-12-28 00:07:28,593][106225] Updated weights for policy 1, policy_version 679657 (0.0010) [2023-12-28 00:07:28,658][106225] Updated weights for policy 1, policy_version 679667 (0.0011) [2023-12-28 00:07:28,717][106225] Updated weights for policy 1, policy_version 679677 (0.0011) [2023-12-28 00:07:28,782][106225] Updated weights for policy 1, policy_version 679687 (0.0011) [2023-12-28 00:07:29,117][106226] Updated weights for policy 0, policy_version 677891 (0.0010) [2023-12-28 00:07:29,183][106226] Updated weights for policy 0, policy_version 677901 (0.0007) [2023-12-28 00:07:29,253][106226] Updated weights for policy 0, policy_version 677911 (0.0008) [2023-12-28 00:07:29,571][106225] Updated weights for policy 1, policy_version 679697 (0.0007) [2023-12-28 00:07:29,637][106225] Updated weights for policy 1, policy_version 679707 (0.0008) [2023-12-28 00:07:29,696][106225] Updated weights for policy 1, policy_version 679717 (0.0006) [2023-12-28 00:07:30,033][106226] Updated weights for policy 0, policy_version 677921 (0.0011) [2023-12-28 00:07:30,092][106226] Updated weights for policy 0, policy_version 677931 (0.0009) [2023-12-28 00:07:30,155][106226] Updated weights for policy 0, policy_version 677941 (0.0009) [2023-12-28 00:07:30,219][106226] Updated weights for policy 0, policy_version 677951 (0.0008) [2023-12-28 00:07:30,374][106225] Updated weights for policy 1, policy_version 679727 (0.0007) [2023-12-28 00:07:30,442][106225] Updated weights for policy 1, policy_version 679737 (0.0009) [2023-12-28 00:07:30,505][106225] Updated weights for policy 1, policy_version 679747 (0.0008) [2023-12-28 00:07:30,896][106226] Updated weights for policy 0, policy_version 677961 (0.0008) [2023-12-28 00:07:30,956][106226] Updated weights for policy 0, policy_version 677971 (0.0008) [2023-12-28 00:07:31,018][106226] Updated weights for policy 0, policy_version 677981 (0.0008) [2023-12-28 00:07:31,174][105115] Fps is (10 sec: 18022.5, 60 sec: 18295.5, 300 sec: 18411.2). Total num frames: 347660288. Throughput: 0: 9058.6, 1: 9188.4. Samples: 347650424. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:31,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-5.763')] [2023-12-28 00:07:31,318][106225] Updated weights for policy 1, policy_version 679757 (0.0009) [2023-12-28 00:07:31,394][106225] Updated weights for policy 1, policy_version 679767 (0.0009) [2023-12-28 00:07:31,460][106225] Updated weights for policy 1, policy_version 679777 (0.0008) [2023-12-28 00:07:31,813][106226] Updated weights for policy 0, policy_version 677991 (0.0007) [2023-12-28 00:07:31,878][106226] Updated weights for policy 0, policy_version 678001 (0.0006) [2023-12-28 00:07:31,947][106226] Updated weights for policy 0, policy_version 678011 (0.0008) [2023-12-28 00:07:32,278][106225] Updated weights for policy 1, policy_version 679787 (0.0008) [2023-12-28 00:07:32,347][106225] Updated weights for policy 1, policy_version 679797 (0.0009) [2023-12-28 00:07:32,414][106225] Updated weights for policy 1, policy_version 679807 (0.0008) [2023-12-28 00:07:32,641][106226] Updated weights for policy 0, policy_version 678021 (0.0007) [2023-12-28 00:07:32,704][106226] Updated weights for policy 0, policy_version 678031 (0.0007) [2023-12-28 00:07:32,765][106226] Updated weights for policy 0, policy_version 678041 (0.0008) [2023-12-28 00:07:33,213][106225] Updated weights for policy 1, policy_version 679817 (0.0009) [2023-12-28 00:07:33,283][106225] Updated weights for policy 1, policy_version 679827 (0.0009) [2023-12-28 00:07:33,354][106225] Updated weights for policy 1, policy_version 679837 (0.0009) [2023-12-28 00:07:33,418][106225] Updated weights for policy 1, policy_version 679847 (0.0008) [2023-12-28 00:07:33,428][106226] Updated weights for policy 0, policy_version 678051 (0.0007) [2023-12-28 00:07:33,479][106226] Updated weights for policy 0, policy_version 678061 (0.0006) [2023-12-28 00:07:33,550][106226] Updated weights for policy 0, policy_version 678071 (0.0007) [2023-12-28 00:07:34,185][106225] Updated weights for policy 1, policy_version 679857 (0.0009) [2023-12-28 00:07:34,248][106225] Updated weights for policy 1, policy_version 679867 (0.0010) [2023-12-28 00:07:34,256][106226] Updated weights for policy 0, policy_version 678081 (0.0008) [2023-12-28 00:07:34,308][106225] Updated weights for policy 1, policy_version 679877 (0.0007) [2023-12-28 00:07:34,327][106226] Updated weights for policy 0, policy_version 678091 (0.0007) [2023-12-28 00:07:34,400][106226] Updated weights for policy 0, policy_version 678101 (0.0008) [2023-12-28 00:07:34,472][106226] Updated weights for policy 0, policy_version 678111 (0.0007) [2023-12-28 00:07:35,098][106225] Updated weights for policy 1, policy_version 679887 (0.0008) [2023-12-28 00:07:35,108][106226] Updated weights for policy 0, policy_version 678121 (0.0006) [2023-12-28 00:07:35,156][106225] Updated weights for policy 1, policy_version 679897 (0.0008) [2023-12-28 00:07:35,168][106226] Updated weights for policy 0, policy_version 678131 (0.0006) [2023-12-28 00:07:35,219][106225] Updated weights for policy 1, policy_version 679907 (0.0007) [2023-12-28 00:07:35,229][106226] Updated weights for policy 0, policy_version 678141 (0.0007) [2023-12-28 00:07:35,795][106226] Updated weights for policy 0, policy_version 678151 (0.0007) [2023-12-28 00:07:35,862][106226] Updated weights for policy 0, policy_version 678161 (0.0009) [2023-12-28 00:07:35,922][106226] Updated weights for policy 0, policy_version 678171 (0.0009) [2023-12-28 00:07:36,057][106225] Updated weights for policy 1, policy_version 679917 (0.0007) [2023-12-28 00:07:36,118][106225] Updated weights for policy 1, policy_version 679927 (0.0009) [2023-12-28 00:07:36,174][105115] Fps is (10 sec: 18842.0, 60 sec: 18158.9, 300 sec: 18439.0). Total num frames: 347750400. Throughput: 0: 9183.8, 1: 9129.6. Samples: 347763116. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:36,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.468')] [2023-12-28 00:07:36,185][106225] Updated weights for policy 1, policy_version 679937 (0.0009) [2023-12-28 00:07:36,672][106226] Updated weights for policy 0, policy_version 678181 (0.0010) [2023-12-28 00:07:36,739][106226] Updated weights for policy 0, policy_version 678191 (0.0011) [2023-12-28 00:07:36,806][106226] Updated weights for policy 0, policy_version 678201 (0.0011) [2023-12-28 00:07:36,973][106225] Updated weights for policy 1, policy_version 679947 (0.0009) [2023-12-28 00:07:37,036][106225] Updated weights for policy 1, policy_version 679957 (0.0009) [2023-12-28 00:07:37,095][106225] Updated weights for policy 1, policy_version 679967 (0.0008) [2023-12-28 00:07:37,541][106226] Updated weights for policy 0, policy_version 678211 (0.0011) [2023-12-28 00:07:37,601][106226] Updated weights for policy 0, policy_version 678221 (0.0011) [2023-12-28 00:07:37,658][106226] Updated weights for policy 0, policy_version 678231 (0.0011) [2023-12-28 00:07:37,820][106225] Updated weights for policy 1, policy_version 679977 (0.0008) [2023-12-28 00:07:37,875][106225] Updated weights for policy 1, policy_version 679987 (0.0007) [2023-12-28 00:07:37,938][106225] Updated weights for policy 1, policy_version 679997 (0.0008) [2023-12-28 00:07:38,006][106225] Updated weights for policy 1, policy_version 680007 (0.0008) [2023-12-28 00:07:38,332][106226] Updated weights for policy 0, policy_version 678241 (0.0011) [2023-12-28 00:07:38,400][106226] Updated weights for policy 0, policy_version 678251 (0.0008) [2023-12-28 00:07:38,468][106226] Updated weights for policy 0, policy_version 678261 (0.0008) [2023-12-28 00:07:38,536][106226] Updated weights for policy 0, policy_version 678271 (0.0008) [2023-12-28 00:07:38,830][106225] Updated weights for policy 1, policy_version 680017 (0.0008) [2023-12-28 00:07:38,900][106225] Updated weights for policy 1, policy_version 680027 (0.0007) [2023-12-28 00:07:38,966][106225] Updated weights for policy 1, policy_version 680037 (0.0008) [2023-12-28 00:07:39,334][106226] Updated weights for policy 0, policy_version 678281 (0.0008) [2023-12-28 00:07:39,410][106226] Updated weights for policy 0, policy_version 678291 (0.0009) [2023-12-28 00:07:39,487][106226] Updated weights for policy 0, policy_version 678301 (0.0009) [2023-12-28 00:07:39,713][106225] Updated weights for policy 1, policy_version 680047 (0.0007) [2023-12-28 00:07:39,783][106225] Updated weights for policy 1, policy_version 680057 (0.0008) [2023-12-28 00:07:39,855][106225] Updated weights for policy 1, policy_version 680067 (0.0008) [2023-12-28 00:07:40,249][106226] Updated weights for policy 0, policy_version 678311 (0.0008) [2023-12-28 00:07:40,308][106226] Updated weights for policy 0, policy_version 678321 (0.0009) [2023-12-28 00:07:40,370][106226] Updated weights for policy 0, policy_version 678331 (0.0008) [2023-12-28 00:07:40,595][106225] Updated weights for policy 1, policy_version 680077 (0.0007) [2023-12-28 00:07:40,648][106225] Updated weights for policy 1, policy_version 680087 (0.0005) [2023-12-28 00:07:40,701][106225] Updated weights for policy 1, policy_version 680097 (0.0009) [2023-12-28 00:07:41,175][105115] Fps is (10 sec: 18022.1, 60 sec: 18295.5, 300 sec: 18438.9). Total num frames: 347840512. Throughput: 0: 9205.7, 1: 9113.7. Samples: 347818260. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:41,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.606')] [2023-12-28 00:07:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000680104_174137344.pth... [2023-12-28 00:07:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000679048_173867008.pth [2023-12-28 00:07:41,208][106226] Updated weights for policy 0, policy_version 678341 (0.0007) [2023-12-28 00:07:41,277][106226] Updated weights for policy 0, policy_version 678351 (0.0009) [2023-12-28 00:07:41,355][106226] Updated weights for policy 0, policy_version 678361 (0.0007) [2023-12-28 00:07:41,406][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000678368_173711360.pth... [2023-12-28 00:07:41,411][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000677280_173432832.pth [2023-12-28 00:07:41,451][106225] Updated weights for policy 1, policy_version 680107 (0.0009) [2023-12-28 00:07:41,513][106225] Updated weights for policy 1, policy_version 680117 (0.0007) [2023-12-28 00:07:41,579][106225] Updated weights for policy 1, policy_version 680127 (0.0007) [2023-12-28 00:07:42,150][106226] Updated weights for policy 0, policy_version 678371 (0.0009) [2023-12-28 00:07:42,212][106226] Updated weights for policy 0, policy_version 678381 (0.0008) [2023-12-28 00:07:42,283][106226] Updated weights for policy 0, policy_version 678391 (0.0007) [2023-12-28 00:07:42,360][106225] Updated weights for policy 1, policy_version 680137 (0.0007) [2023-12-28 00:07:42,434][106225] Updated weights for policy 1, policy_version 680147 (0.0008) [2023-12-28 00:07:42,496][106225] Updated weights for policy 1, policy_version 680157 (0.0009) [2023-12-28 00:07:42,558][106225] Updated weights for policy 1, policy_version 680167 (0.0009) [2023-12-28 00:07:43,009][106226] Updated weights for policy 0, policy_version 678401 (0.0008) [2023-12-28 00:07:43,068][106226] Updated weights for policy 0, policy_version 678411 (0.0008) [2023-12-28 00:07:43,132][106226] Updated weights for policy 0, policy_version 678421 (0.0009) [2023-12-28 00:07:43,183][106226] Updated weights for policy 0, policy_version 678431 (0.0009) [2023-12-28 00:07:43,253][106225] Updated weights for policy 1, policy_version 680177 (0.0008) [2023-12-28 00:07:43,309][106225] Updated weights for policy 1, policy_version 680187 (0.0009) [2023-12-28 00:07:43,370][106225] Updated weights for policy 1, policy_version 680197 (0.0008) [2023-12-28 00:07:43,901][106226] Updated weights for policy 0, policy_version 678441 (0.0009) [2023-12-28 00:07:43,961][106226] Updated weights for policy 0, policy_version 678451 (0.0009) [2023-12-28 00:07:44,029][106226] Updated weights for policy 0, policy_version 678461 (0.0008) [2023-12-28 00:07:44,162][106225] Updated weights for policy 1, policy_version 680207 (0.0008) [2023-12-28 00:07:44,225][106225] Updated weights for policy 1, policy_version 680217 (0.0009) [2023-12-28 00:07:44,289][106225] Updated weights for policy 1, policy_version 680227 (0.0009) [2023-12-28 00:07:44,712][106226] Updated weights for policy 0, policy_version 678471 (0.0008) [2023-12-28 00:07:44,785][106226] Updated weights for policy 0, policy_version 678481 (0.0008) [2023-12-28 00:07:44,850][106226] Updated weights for policy 0, policy_version 678491 (0.0009) [2023-12-28 00:07:45,039][106225] Updated weights for policy 1, policy_version 680237 (0.0009) [2023-12-28 00:07:45,096][106225] Updated weights for policy 1, policy_version 680247 (0.0009) [2023-12-28 00:07:45,150][106225] Updated weights for policy 1, policy_version 680257 (0.0008) [2023-12-28 00:07:45,646][106226] Updated weights for policy 0, policy_version 678501 (0.0009) [2023-12-28 00:07:45,707][106226] Updated weights for policy 0, policy_version 678511 (0.0008) [2023-12-28 00:07:45,765][106226] Updated weights for policy 0, policy_version 678521 (0.0009) [2023-12-28 00:07:45,927][106225] Updated weights for policy 1, policy_version 680267 (0.0009) [2023-12-28 00:07:45,989][106225] Updated weights for policy 1, policy_version 680277 (0.0008) [2023-12-28 00:07:46,047][106225] Updated weights for policy 1, policy_version 680287 (0.0006) [2023-12-28 00:07:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18295.5, 300 sec: 18438.9). Total num frames: 347938816. Throughput: 0: 9156.4, 1: 9125.5. Samples: 347926152. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:46,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.565')] [2023-12-28 00:07:46,519][106226] Updated weights for policy 0, policy_version 678531 (0.0010) [2023-12-28 00:07:46,590][106226] Updated weights for policy 0, policy_version 678541 (0.0010) [2023-12-28 00:07:46,638][106225] Updated weights for policy 1, policy_version 680297 (0.0006) [2023-12-28 00:07:46,654][106226] Updated weights for policy 0, policy_version 678551 (0.0008) [2023-12-28 00:07:46,702][106225] Updated weights for policy 1, policy_version 680307 (0.0006) [2023-12-28 00:07:46,758][106225] Updated weights for policy 1, policy_version 680317 (0.0009) [2023-12-28 00:07:46,815][106225] Updated weights for policy 1, policy_version 680327 (0.0008) [2023-12-28 00:07:47,381][106226] Updated weights for policy 0, policy_version 678561 (0.0007) [2023-12-28 00:07:47,437][106226] Updated weights for policy 0, policy_version 678571 (0.0009) [2023-12-28 00:07:47,493][106226] Updated weights for policy 0, policy_version 678581 (0.0007) [2023-12-28 00:07:47,514][106225] Updated weights for policy 1, policy_version 680337 (0.0007) [2023-12-28 00:07:47,549][106226] Updated weights for policy 0, policy_version 678591 (0.0006) [2023-12-28 00:07:47,574][106225] Updated weights for policy 1, policy_version 680347 (0.0008) [2023-12-28 00:07:47,638][106225] Updated weights for policy 1, policy_version 680357 (0.0008) [2023-12-28 00:07:48,277][106225] Updated weights for policy 1, policy_version 680367 (0.0008) [2023-12-28 00:07:48,331][106225] Updated weights for policy 1, policy_version 680377 (0.0006) [2023-12-28 00:07:48,351][106226] Updated weights for policy 0, policy_version 678601 (0.0009) [2023-12-28 00:07:48,389][106225] Updated weights for policy 1, policy_version 680387 (0.0007) [2023-12-28 00:07:48,419][106226] Updated weights for policy 0, policy_version 678611 (0.0008) [2023-12-28 00:07:48,484][106226] Updated weights for policy 0, policy_version 678621 (0.0008) [2023-12-28 00:07:49,160][106225] Updated weights for policy 1, policy_version 680397 (0.0008) [2023-12-28 00:07:49,224][106225] Updated weights for policy 1, policy_version 680407 (0.0007) [2023-12-28 00:07:49,243][106226] Updated weights for policy 0, policy_version 678632 (0.0008) [2023-12-28 00:07:49,292][106225] Updated weights for policy 1, policy_version 680417 (0.0008) [2023-12-28 00:07:49,316][106226] Updated weights for policy 0, policy_version 678642 (0.0007) [2023-12-28 00:07:49,394][106226] Updated weights for policy 0, policy_version 678652 (0.0009) [2023-12-28 00:07:50,097][106225] Updated weights for policy 1, policy_version 680427 (0.0007) [2023-12-28 00:07:50,107][106226] Updated weights for policy 0, policy_version 678662 (0.0008) [2023-12-28 00:07:50,160][106225] Updated weights for policy 1, policy_version 680437 (0.0008) [2023-12-28 00:07:50,167][106226] Updated weights for policy 0, policy_version 678672 (0.0006) [2023-12-28 00:07:50,228][106225] Updated weights for policy 1, policy_version 680447 (0.0008) [2023-12-28 00:07:50,234][106226] Updated weights for policy 0, policy_version 678682 (0.0006) [2023-12-28 00:07:51,002][106225] Updated weights for policy 1, policy_version 680457 (0.0008) [2023-12-28 00:07:51,023][106226] Updated weights for policy 0, policy_version 678692 (0.0008) [2023-12-28 00:07:51,073][106225] Updated weights for policy 1, policy_version 680467 (0.0007) [2023-12-28 00:07:51,095][106226] Updated weights for policy 0, policy_version 678702 (0.0011) [2023-12-28 00:07:51,133][106225] Updated weights for policy 1, policy_version 680477 (0.0008) [2023-12-28 00:07:51,160][106226] Updated weights for policy 0, policy_version 678712 (0.0011) [2023-12-28 00:07:51,175][105115] Fps is (10 sec: 18022.6, 60 sec: 18295.5, 300 sec: 18411.2). Total num frames: 348020736. Throughput: 0: 9141.2, 1: 9201.2. Samples: 348039020. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:51,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-5.795')] [2023-12-28 00:07:51,198][106225] Updated weights for policy 1, policy_version 680487 (0.0007) [2023-12-28 00:07:51,208][106140] Saving new best policy, reward=-4.149! [2023-12-28 00:07:51,951][106226] Updated weights for policy 0, policy_version 678722 (0.0010) [2023-12-28 00:07:52,012][106225] Updated weights for policy 1, policy_version 680497 (0.0008) [2023-12-28 00:07:52,013][106226] Updated weights for policy 0, policy_version 678732 (0.0009) [2023-12-28 00:07:52,074][106225] Updated weights for policy 1, policy_version 680507 (0.0011) [2023-12-28 00:07:52,075][106226] Updated weights for policy 0, policy_version 678742 (0.0009) [2023-12-28 00:07:52,133][106225] Updated weights for policy 1, policy_version 680517 (0.0011) [2023-12-28 00:07:52,135][106226] Updated weights for policy 0, policy_version 678752 (0.0009) [2023-12-28 00:07:52,864][106225] Updated weights for policy 1, policy_version 680527 (0.0008) [2023-12-28 00:07:52,881][106226] Updated weights for policy 0, policy_version 678762 (0.0008) [2023-12-28 00:07:52,926][106225] Updated weights for policy 1, policy_version 680537 (0.0007) [2023-12-28 00:07:52,946][106226] Updated weights for policy 0, policy_version 678772 (0.0008) [2023-12-28 00:07:52,988][106225] Updated weights for policy 1, policy_version 680547 (0.0008) [2023-12-28 00:07:53,002][106226] Updated weights for policy 0, policy_version 678782 (0.0007) [2023-12-28 00:07:53,661][106225] Updated weights for policy 1, policy_version 680557 (0.0007) [2023-12-28 00:07:53,720][106225] Updated weights for policy 1, policy_version 680567 (0.0009) [2023-12-28 00:07:53,758][106226] Updated weights for policy 0, policy_version 678792 (0.0008) [2023-12-28 00:07:53,772][106225] Updated weights for policy 1, policy_version 680577 (0.0006) [2023-12-28 00:07:53,814][106226] Updated weights for policy 0, policy_version 678802 (0.0007) [2023-12-28 00:07:53,876][106226] Updated weights for policy 0, policy_version 678812 (0.0008) [2023-12-28 00:07:54,500][106225] Updated weights for policy 1, policy_version 680587 (0.0006) [2023-12-28 00:07:54,556][106225] Updated weights for policy 1, policy_version 680597 (0.0006) [2023-12-28 00:07:54,610][106225] Updated weights for policy 1, policy_version 680607 (0.0007) [2023-12-28 00:07:54,628][106226] Updated weights for policy 0, policy_version 678822 (0.0010) [2023-12-28 00:07:54,685][106226] Updated weights for policy 0, policy_version 678832 (0.0008) [2023-12-28 00:07:54,747][106226] Updated weights for policy 0, policy_version 678842 (0.0008) [2023-12-28 00:07:55,359][106225] Updated weights for policy 1, policy_version 680617 (0.0006) [2023-12-28 00:07:55,392][106226] Updated weights for policy 0, policy_version 678852 (0.0006) [2023-12-28 00:07:55,425][106225] Updated weights for policy 1, policy_version 680627 (0.0006) [2023-12-28 00:07:55,448][106226] Updated weights for policy 0, policy_version 678862 (0.0006) [2023-12-28 00:07:55,484][106225] Updated weights for policy 1, policy_version 680637 (0.0007) [2023-12-28 00:07:55,509][106226] Updated weights for policy 0, policy_version 678872 (0.0005) [2023-12-28 00:07:55,548][106225] Updated weights for policy 1, policy_version 680647 (0.0006) [2023-12-28 00:07:56,078][106225] Updated weights for policy 1, policy_version 680657 (0.0007) [2023-12-28 00:07:56,138][106225] Updated weights for policy 1, policy_version 680667 (0.0007) [2023-12-28 00:07:56,174][105115] Fps is (10 sec: 18022.4, 60 sec: 18295.5, 300 sec: 18411.2). Total num frames: 348119040. Throughput: 0: 9129.4, 1: 9202.8. Samples: 348093956. Policy #0 lag: (min: 31.0, avg: 34.3, max: 63.0) [2023-12-28 00:07:56,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-5.435')] [2023-12-28 00:07:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000678880_173842432.pth... [2023-12-28 00:07:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000677792_173563904.pth [2023-12-28 00:07:56,193][106225] Updated weights for policy 1, policy_version 680677 (0.0005) [2023-12-28 00:07:56,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000680680_174284800.pth... [2023-12-28 00:07:56,210][106226] Updated weights for policy 0, policy_version 678882 (0.0008) [2023-12-28 00:07:56,212][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000679592_174006272.pth [2023-12-28 00:07:56,283][106226] Updated weights for policy 0, policy_version 678892 (0.0008) [2023-12-28 00:07:56,353][106226] Updated weights for policy 0, policy_version 678902 (0.0009) [2023-12-28 00:07:56,422][106226] Updated weights for policy 0, policy_version 678912 (0.0006) [2023-12-28 00:07:56,768][106225] Updated weights for policy 1, policy_version 680687 (0.0007) [2023-12-28 00:07:56,828][106225] Updated weights for policy 1, policy_version 680697 (0.0008) [2023-12-28 00:07:56,879][106225] Updated weights for policy 1, policy_version 680707 (0.0010) [2023-12-28 00:07:57,034][106226] Updated weights for policy 0, policy_version 678922 (0.0010) [2023-12-28 00:07:57,098][106226] Updated weights for policy 0, policy_version 678932 (0.0007) [2023-12-28 00:07:57,163][106226] Updated weights for policy 0, policy_version 678942 (0.0007) [2023-12-28 00:07:57,660][106225] Updated weights for policy 1, policy_version 680717 (0.0008) [2023-12-28 00:07:57,723][106225] Updated weights for policy 1, policy_version 680727 (0.0009) [2023-12-28 00:07:57,779][106225] Updated weights for policy 1, policy_version 680737 (0.0008) [2023-12-28 00:07:57,844][106226] Updated weights for policy 0, policy_version 678952 (0.0007) [2023-12-28 00:07:57,900][106226] Updated weights for policy 0, policy_version 678962 (0.0010) [2023-12-28 00:07:57,962][106226] Updated weights for policy 0, policy_version 678972 (0.0011) [2023-12-28 00:07:58,508][106225] Updated weights for policy 1, policy_version 680747 (0.0007) [2023-12-28 00:07:58,580][106225] Updated weights for policy 1, policy_version 680757 (0.0009) [2023-12-28 00:07:58,646][106225] Updated weights for policy 1, policy_version 680767 (0.0009) [2023-12-28 00:07:58,756][106226] Updated weights for policy 0, policy_version 678982 (0.0009) [2023-12-28 00:07:58,823][106226] Updated weights for policy 0, policy_version 678992 (0.0009) [2023-12-28 00:07:58,899][106226] Updated weights for policy 0, policy_version 679002 (0.0008) [2023-12-28 00:07:59,494][106225] Updated weights for policy 1, policy_version 680777 (0.0009) [2023-12-28 00:07:59,552][106225] Updated weights for policy 1, policy_version 680787 (0.0008) [2023-12-28 00:07:59,606][106225] Updated weights for policy 1, policy_version 680797 (0.0008) [2023-12-28 00:07:59,669][106225] Updated weights for policy 1, policy_version 680807 (0.0011) [2023-12-28 00:07:59,785][106226] Updated weights for policy 0, policy_version 679012 (0.0008) [2023-12-28 00:07:59,855][106226] Updated weights for policy 0, policy_version 679022 (0.0009) [2023-12-28 00:07:59,928][106226] Updated weights for policy 0, policy_version 679032 (0.0008) [2023-12-28 00:08:00,465][106225] Updated weights for policy 1, policy_version 680817 (0.0008) [2023-12-28 00:08:00,524][106225] Updated weights for policy 1, policy_version 680827 (0.0008) [2023-12-28 00:08:00,591][106225] Updated weights for policy 1, policy_version 680837 (0.0008) [2023-12-28 00:08:00,681][106226] Updated weights for policy 0, policy_version 679042 (0.0007) [2023-12-28 00:08:00,745][106226] Updated weights for policy 0, policy_version 679052 (0.0005) [2023-12-28 00:08:00,803][106226] Updated weights for policy 0, policy_version 679062 (0.0006) [2023-12-28 00:08:00,865][106226] Updated weights for policy 0, policy_version 679072 (0.0009) [2023-12-28 00:08:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 18432.0, 300 sec: 18438.9). Total num frames: 348217344. Throughput: 0: 9215.2, 1: 9309.3. Samples: 348208880. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:01,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.537')] [2023-12-28 00:08:01,297][106225] Updated weights for policy 1, policy_version 680847 (0.0008) [2023-12-28 00:08:01,364][106225] Updated weights for policy 1, policy_version 680857 (0.0008) [2023-12-28 00:08:01,435][106225] Updated weights for policy 1, policy_version 680867 (0.0007) [2023-12-28 00:08:01,615][106226] Updated weights for policy 0, policy_version 679082 (0.0009) [2023-12-28 00:08:01,684][106226] Updated weights for policy 0, policy_version 679092 (0.0008) [2023-12-28 00:08:01,752][106226] Updated weights for policy 0, policy_version 679102 (0.0008) [2023-12-28 00:08:02,138][106225] Updated weights for policy 1, policy_version 680877 (0.0007) [2023-12-28 00:08:02,202][106225] Updated weights for policy 1, policy_version 680887 (0.0009) [2023-12-28 00:08:02,271][106225] Updated weights for policy 1, policy_version 680897 (0.0008) [2023-12-28 00:08:02,513][106226] Updated weights for policy 0, policy_version 679112 (0.0008) [2023-12-28 00:08:02,575][106226] Updated weights for policy 0, policy_version 679122 (0.0008) [2023-12-28 00:08:02,639][106226] Updated weights for policy 0, policy_version 679132 (0.0007) [2023-12-28 00:08:03,023][106225] Updated weights for policy 1, policy_version 680907 (0.0007) [2023-12-28 00:08:03,094][106225] Updated weights for policy 1, policy_version 680917 (0.0008) [2023-12-28 00:08:03,148][106225] Updated weights for policy 1, policy_version 680927 (0.0008) [2023-12-28 00:08:03,296][106226] Updated weights for policy 0, policy_version 679142 (0.0008) [2023-12-28 00:08:03,349][106226] Updated weights for policy 0, policy_version 679152 (0.0010) [2023-12-28 00:08:03,410][106226] Updated weights for policy 0, policy_version 679162 (0.0009) [2023-12-28 00:08:03,955][106225] Updated weights for policy 1, policy_version 680937 (0.0008) [2023-12-28 00:08:04,020][106225] Updated weights for policy 1, policy_version 680947 (0.0006) [2023-12-28 00:08:04,051][106226] Updated weights for policy 0, policy_version 679172 (0.0011) [2023-12-28 00:08:04,081][106225] Updated weights for policy 1, policy_version 680957 (0.0006) [2023-12-28 00:08:04,113][106226] Updated weights for policy 0, policy_version 679182 (0.0011) [2023-12-28 00:08:04,141][106225] Updated weights for policy 1, policy_version 680967 (0.0007) [2023-12-28 00:08:04,183][106226] Updated weights for policy 0, policy_version 679192 (0.0011) [2023-12-28 00:08:04,870][106225] Updated weights for policy 1, policy_version 680977 (0.0007) [2023-12-28 00:08:04,926][106225] Updated weights for policy 1, policy_version 680987 (0.0008) [2023-12-28 00:08:04,932][106226] Updated weights for policy 0, policy_version 679202 (0.0011) [2023-12-28 00:08:04,978][106225] Updated weights for policy 1, policy_version 680997 (0.0006) [2023-12-28 00:08:04,990][106226] Updated weights for policy 0, policy_version 679212 (0.0011) [2023-12-28 00:08:05,063][106226] Updated weights for policy 0, policy_version 679222 (0.0011) [2023-12-28 00:08:05,131][106226] Updated weights for policy 0, policy_version 679232 (0.0011) [2023-12-28 00:08:05,600][106225] Updated weights for policy 1, policy_version 681007 (0.0008) [2023-12-28 00:08:05,658][106225] Updated weights for policy 1, policy_version 681017 (0.0008) [2023-12-28 00:08:05,715][106225] Updated weights for policy 1, policy_version 681027 (0.0008) [2023-12-28 00:08:05,854][106226] Updated weights for policy 0, policy_version 679242 (0.0011) [2023-12-28 00:08:05,912][106226] Updated weights for policy 0, policy_version 679252 (0.0011) [2023-12-28 00:08:05,972][106226] Updated weights for policy 0, policy_version 679262 (0.0011) [2023-12-28 00:08:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 18568.5, 300 sec: 18466.7). Total num frames: 348315648. Throughput: 0: 9290.8, 1: 9347.1. Samples: 348322668. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:06,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-5.595')] [2023-12-28 00:08:06,463][106225] Updated weights for policy 1, policy_version 681037 (0.0007) [2023-12-28 00:08:06,528][106225] Updated weights for policy 1, policy_version 681047 (0.0009) [2023-12-28 00:08:06,598][106225] Updated weights for policy 1, policy_version 681057 (0.0009) [2023-12-28 00:08:06,712][106226] Updated weights for policy 0, policy_version 679272 (0.0007) [2023-12-28 00:08:06,765][106226] Updated weights for policy 0, policy_version 679282 (0.0008) [2023-12-28 00:08:06,825][106226] Updated weights for policy 0, policy_version 679292 (0.0006) [2023-12-28 00:08:07,386][106225] Updated weights for policy 1, policy_version 681067 (0.0010) [2023-12-28 00:08:07,445][106225] Updated weights for policy 1, policy_version 681077 (0.0011) [2023-12-28 00:08:07,504][106225] Updated weights for policy 1, policy_version 681087 (0.0010) [2023-12-28 00:08:07,533][106226] Updated weights for policy 0, policy_version 679302 (0.0006) [2023-12-28 00:08:07,603][106226] Updated weights for policy 0, policy_version 679312 (0.0006) [2023-12-28 00:08:07,665][106226] Updated weights for policy 0, policy_version 679322 (0.0009) [2023-12-28 00:08:08,183][106225] Updated weights for policy 1, policy_version 681097 (0.0010) [2023-12-28 00:08:08,247][106225] Updated weights for policy 1, policy_version 681107 (0.0009) [2023-12-28 00:08:08,308][106225] Updated weights for policy 1, policy_version 681117 (0.0009) [2023-12-28 00:08:08,408][106226] Updated weights for policy 0, policy_version 679332 (0.0010) [2023-12-28 00:08:08,412][106225] Updated weights for policy 1, policy_version 681127 (0.0008) [2023-12-28 00:08:08,468][106226] Updated weights for policy 0, policy_version 679342 (0.0008) [2023-12-28 00:08:08,525][106226] Updated weights for policy 0, policy_version 679352 (0.0009) [2023-12-28 00:08:09,036][106225] Updated weights for policy 1, policy_version 681137 (0.0009) [2023-12-28 00:08:09,092][106225] Updated weights for policy 1, policy_version 681147 (0.0008) [2023-12-28 00:08:09,155][106225] Updated weights for policy 1, policy_version 681157 (0.0006) [2023-12-28 00:08:09,321][106226] Updated weights for policy 0, policy_version 679362 (0.0009) [2023-12-28 00:08:09,393][106226] Updated weights for policy 0, policy_version 679372 (0.0008) [2023-12-28 00:08:09,463][106226] Updated weights for policy 0, policy_version 679382 (0.0008) [2023-12-28 00:08:09,527][106226] Updated weights for policy 0, policy_version 679392 (0.0008) [2023-12-28 00:08:09,994][106225] Updated weights for policy 1, policy_version 681167 (0.0008) [2023-12-28 00:08:10,058][106225] Updated weights for policy 1, policy_version 681177 (0.0009) [2023-12-28 00:08:10,120][106225] Updated weights for policy 1, policy_version 681187 (0.0009) [2023-12-28 00:08:10,282][106226] Updated weights for policy 0, policy_version 679402 (0.0008) [2023-12-28 00:08:10,335][106226] Updated weights for policy 0, policy_version 679412 (0.0009) [2023-12-28 00:08:10,400][106226] Updated weights for policy 0, policy_version 679422 (0.0009) [2023-12-28 00:08:10,816][106225] Updated weights for policy 1, policy_version 681197 (0.0008) [2023-12-28 00:08:10,878][106225] Updated weights for policy 1, policy_version 681207 (0.0006) [2023-12-28 00:08:10,935][106225] Updated weights for policy 1, policy_version 681217 (0.0006) [2023-12-28 00:08:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 18568.5, 300 sec: 18438.9). Total num frames: 348405760. Throughput: 0: 9346.7, 1: 9382.4. Samples: 348379296. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:11,176][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.449')] [2023-12-28 00:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000681224_174424064.pth... [2023-12-28 00:08:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000680104_174137344.pth [2023-12-28 00:08:11,218][106226] Updated weights for policy 0, policy_version 679432 (0.0010) [2023-12-28 00:08:11,287][106226] Updated weights for policy 0, policy_version 679442 (0.0008) [2023-12-28 00:08:11,349][106226] Updated weights for policy 0, policy_version 679452 (0.0008) [2023-12-28 00:08:11,385][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000679456_173989888.pth... [2023-12-28 00:08:11,390][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000678368_173711360.pth [2023-12-28 00:08:11,702][106225] Updated weights for policy 1, policy_version 681227 (0.0008) [2023-12-28 00:08:11,773][106225] Updated weights for policy 1, policy_version 681237 (0.0008) [2023-12-28 00:08:11,840][106225] Updated weights for policy 1, policy_version 681247 (0.0008) [2023-12-28 00:08:12,180][106226] Updated weights for policy 0, policy_version 679462 (0.0008) [2023-12-28 00:08:12,249][106226] Updated weights for policy 0, policy_version 679472 (0.0009) [2023-12-28 00:08:12,322][106226] Updated weights for policy 0, policy_version 679482 (0.0008) [2023-12-28 00:08:12,579][106225] Updated weights for policy 1, policy_version 681257 (0.0008) [2023-12-28 00:08:12,645][106225] Updated weights for policy 1, policy_version 681267 (0.0007) [2023-12-28 00:08:12,707][106225] Updated weights for policy 1, policy_version 681277 (0.0009) [2023-12-28 00:08:12,767][106225] Updated weights for policy 1, policy_version 681287 (0.0009) [2023-12-28 00:08:13,040][106226] Updated weights for policy 0, policy_version 679492 (0.0008) [2023-12-28 00:08:13,102][106226] Updated weights for policy 0, policy_version 679502 (0.0007) [2023-12-28 00:08:13,158][106226] Updated weights for policy 0, policy_version 679512 (0.0008) [2023-12-28 00:08:13,486][106225] Updated weights for policy 1, policy_version 681297 (0.0010) [2023-12-28 00:08:13,537][106225] Updated weights for policy 1, policy_version 681307 (0.0010) [2023-12-28 00:08:13,605][106225] Updated weights for policy 1, policy_version 681317 (0.0011) [2023-12-28 00:08:13,861][106226] Updated weights for policy 0, policy_version 679522 (0.0008) [2023-12-28 00:08:13,923][106226] Updated weights for policy 0, policy_version 679532 (0.0008) [2023-12-28 00:08:13,990][106226] Updated weights for policy 0, policy_version 679542 (0.0010) [2023-12-28 00:08:14,041][106226] Updated weights for policy 0, policy_version 679552 (0.0009) [2023-12-28 00:08:14,305][106225] Updated weights for policy 1, policy_version 681327 (0.0007) [2023-12-28 00:08:14,359][106225] Updated weights for policy 1, policy_version 681337 (0.0007) [2023-12-28 00:08:14,414][106225] Updated weights for policy 1, policy_version 681347 (0.0008) [2023-12-28 00:08:14,790][106226] Updated weights for policy 0, policy_version 679562 (0.0007) [2023-12-28 00:08:14,852][106226] Updated weights for policy 0, policy_version 679572 (0.0008) [2023-12-28 00:08:14,910][106226] Updated weights for policy 0, policy_version 679582 (0.0010) [2023-12-28 00:08:15,122][106225] Updated weights for policy 1, policy_version 681357 (0.0008) [2023-12-28 00:08:15,183][106225] Updated weights for policy 1, policy_version 681367 (0.0008) [2023-12-28 00:08:15,243][106225] Updated weights for policy 1, policy_version 681377 (0.0008) [2023-12-28 00:08:15,644][106226] Updated weights for policy 0, policy_version 679592 (0.0011) [2023-12-28 00:08:15,699][106226] Updated weights for policy 0, policy_version 679602 (0.0011) [2023-12-28 00:08:15,758][106226] Updated weights for policy 0, policy_version 679612 (0.0011) [2023-12-28 00:08:16,004][106225] Updated weights for policy 1, policy_version 681387 (0.0008) [2023-12-28 00:08:16,054][106225] Updated weights for policy 1, policy_version 681397 (0.0006) [2023-12-28 00:08:16,109][106225] Updated weights for policy 1, policy_version 681407 (0.0005) [2023-12-28 00:08:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 18705.1, 300 sec: 18438.9). Total num frames: 348504064. Throughput: 0: 9344.0, 1: 9325.5. Samples: 348490552. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:16,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.177')] [2023-12-28 00:08:16,506][106226] Updated weights for policy 0, policy_version 679622 (0.0009) [2023-12-28 00:08:16,564][106226] Updated weights for policy 0, policy_version 679632 (0.0011) [2023-12-28 00:08:16,626][106226] Updated weights for policy 0, policy_version 679642 (0.0011) [2023-12-28 00:08:16,783][106225] Updated weights for policy 1, policy_version 681417 (0.0006) [2023-12-28 00:08:16,838][106225] Updated weights for policy 1, policy_version 681427 (0.0006) [2023-12-28 00:08:16,889][106225] Updated weights for policy 1, policy_version 681437 (0.0007) [2023-12-28 00:08:16,952][106225] Updated weights for policy 1, policy_version 681447 (0.0008) [2023-12-28 00:08:17,329][106226] Updated weights for policy 0, policy_version 679652 (0.0008) [2023-12-28 00:08:17,392][106226] Updated weights for policy 0, policy_version 679662 (0.0007) [2023-12-28 00:08:17,453][106226] Updated weights for policy 0, policy_version 679672 (0.0005) [2023-12-28 00:08:17,615][106225] Updated weights for policy 1, policy_version 681457 (0.0009) [2023-12-28 00:08:17,675][106225] Updated weights for policy 1, policy_version 681467 (0.0009) [2023-12-28 00:08:17,738][106225] Updated weights for policy 1, policy_version 681477 (0.0010) [2023-12-28 00:08:18,117][106226] Updated weights for policy 0, policy_version 679682 (0.0011) [2023-12-28 00:08:18,174][106226] Updated weights for policy 0, policy_version 679692 (0.0010) [2023-12-28 00:08:18,236][106226] Updated weights for policy 0, policy_version 679702 (0.0009) [2023-12-28 00:08:18,293][106226] Updated weights for policy 0, policy_version 679712 (0.0008) [2023-12-28 00:08:18,479][106225] Updated weights for policy 1, policy_version 681487 (0.0009) [2023-12-28 00:08:18,547][106225] Updated weights for policy 1, policy_version 681497 (0.0009) [2023-12-28 00:08:18,607][106225] Updated weights for policy 1, policy_version 681507 (0.0009) [2023-12-28 00:08:19,038][106226] Updated weights for policy 0, policy_version 679722 (0.0008) [2023-12-28 00:08:19,101][106226] Updated weights for policy 0, policy_version 679732 (0.0010) [2023-12-28 00:08:19,159][106226] Updated weights for policy 0, policy_version 679742 (0.0009) [2023-12-28 00:08:19,299][106225] Updated weights for policy 1, policy_version 681517 (0.0008) [2023-12-28 00:08:19,374][106225] Updated weights for policy 1, policy_version 681527 (0.0008) [2023-12-28 00:08:19,447][106225] Updated weights for policy 1, policy_version 681537 (0.0008) [2023-12-28 00:08:19,968][106226] Updated weights for policy 0, policy_version 679752 (0.0007) [2023-12-28 00:08:20,044][106226] Updated weights for policy 0, policy_version 679762 (0.0007) [2023-12-28 00:08:20,112][106226] Updated weights for policy 0, policy_version 679772 (0.0007) [2023-12-28 00:08:20,175][106225] Updated weights for policy 1, policy_version 681547 (0.0007) [2023-12-28 00:08:20,238][106225] Updated weights for policy 1, policy_version 681557 (0.0006) [2023-12-28 00:08:20,301][106225] Updated weights for policy 1, policy_version 681567 (0.0008) [2023-12-28 00:08:20,870][106226] Updated weights for policy 0, policy_version 679782 (0.0009) [2023-12-28 00:08:20,937][106226] Updated weights for policy 0, policy_version 679792 (0.0009) [2023-12-28 00:08:20,998][106226] Updated weights for policy 0, policy_version 679802 (0.0008) [2023-12-28 00:08:21,078][106225] Updated weights for policy 1, policy_version 681577 (0.0008) [2023-12-28 00:08:21,146][106225] Updated weights for policy 1, policy_version 681587 (0.0008) [2023-12-28 00:08:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 18568.5, 300 sec: 18438.9). Total num frames: 348594176. Throughput: 0: 9240.8, 1: 9447.0. Samples: 348604068. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:21,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.679')] [2023-12-28 00:08:21,217][106225] Updated weights for policy 1, policy_version 681597 (0.0007) [2023-12-28 00:08:21,284][106225] Updated weights for policy 1, policy_version 681607 (0.0008) [2023-12-28 00:08:21,777][106226] Updated weights for policy 0, policy_version 679812 (0.0009) [2023-12-28 00:08:21,844][106226] Updated weights for policy 0, policy_version 679822 (0.0008) [2023-12-28 00:08:21,908][106226] Updated weights for policy 0, policy_version 679832 (0.0007) [2023-12-28 00:08:22,112][106225] Updated weights for policy 1, policy_version 681617 (0.0006) [2023-12-28 00:08:22,181][106225] Updated weights for policy 1, policy_version 681627 (0.0006) [2023-12-28 00:08:22,250][106225] Updated weights for policy 1, policy_version 681637 (0.0006) [2023-12-28 00:08:22,643][106226] Updated weights for policy 0, policy_version 679842 (0.0009) [2023-12-28 00:08:22,711][106226] Updated weights for policy 0, policy_version 679852 (0.0009) [2023-12-28 00:08:22,777][106226] Updated weights for policy 0, policy_version 679862 (0.0009) [2023-12-28 00:08:22,844][106226] Updated weights for policy 0, policy_version 679872 (0.0008) [2023-12-28 00:08:23,013][106225] Updated weights for policy 1, policy_version 681647 (0.0007) [2023-12-28 00:08:23,061][106225] Updated weights for policy 1, policy_version 681657 (0.0007) [2023-12-28 00:08:23,114][106225] Updated weights for policy 1, policy_version 681667 (0.0005) [2023-12-28 00:08:23,531][106226] Updated weights for policy 0, policy_version 679882 (0.0006) [2023-12-28 00:08:23,595][106226] Updated weights for policy 0, policy_version 679892 (0.0006) [2023-12-28 00:08:23,657][106226] Updated weights for policy 0, policy_version 679902 (0.0007) [2023-12-28 00:08:23,743][106225] Updated weights for policy 1, policy_version 681677 (0.0008) [2023-12-28 00:08:23,810][106225] Updated weights for policy 1, policy_version 681687 (0.0010) [2023-12-28 00:08:23,872][106225] Updated weights for policy 1, policy_version 681697 (0.0011) [2023-12-28 00:08:24,209][106226] Updated weights for policy 0, policy_version 679912 (0.0006) [2023-12-28 00:08:24,274][106226] Updated weights for policy 0, policy_version 679922 (0.0006) [2023-12-28 00:08:24,337][106226] Updated weights for policy 0, policy_version 679932 (0.0008) [2023-12-28 00:08:24,454][106225] Updated weights for policy 1, policy_version 681707 (0.0007) [2023-12-28 00:08:24,513][106225] Updated weights for policy 1, policy_version 681717 (0.0006) [2023-12-28 00:08:24,578][106225] Updated weights for policy 1, policy_version 681727 (0.0010) [2023-12-28 00:08:25,082][106226] Updated weights for policy 0, policy_version 679942 (0.0007) [2023-12-28 00:08:25,142][106226] Updated weights for policy 0, policy_version 679952 (0.0010) [2023-12-28 00:08:25,188][106225] Updated weights for policy 1, policy_version 681737 (0.0010) [2023-12-28 00:08:25,199][106226] Updated weights for policy 0, policy_version 679962 (0.0009) [2023-12-28 00:08:25,252][106225] Updated weights for policy 1, policy_version 681747 (0.0010) [2023-12-28 00:08:25,316][106225] Updated weights for policy 1, policy_version 681757 (0.0010) [2023-12-28 00:08:25,376][106225] Updated weights for policy 1, policy_version 681767 (0.0008) [2023-12-28 00:08:25,963][106226] Updated weights for policy 0, policy_version 679972 (0.0007) [2023-12-28 00:08:26,026][106226] Updated weights for policy 0, policy_version 679982 (0.0006) [2023-12-28 00:08:26,055][106225] Updated weights for policy 1, policy_version 681777 (0.0006) [2023-12-28 00:08:26,081][106226] Updated weights for policy 0, policy_version 679992 (0.0007) [2023-12-28 00:08:26,113][106225] Updated weights for policy 1, policy_version 681787 (0.0006) [2023-12-28 00:08:26,170][106225] Updated weights for policy 1, policy_version 681797 (0.0008) [2023-12-28 00:08:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 18841.7, 300 sec: 18438.9). Total num frames: 348692480. Throughput: 0: 9284.4, 1: 9475.4. Samples: 348662448. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:26,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.443')] [2023-12-28 00:08:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000680000_174129152.pth... [2023-12-28 00:08:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000681800_174571520.pth... [2023-12-28 00:08:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000678880_173842432.pth [2023-12-28 00:08:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000680680_174284800.pth [2023-12-28 00:08:26,731][106226] Updated weights for policy 0, policy_version 680002 (0.0007) [2023-12-28 00:08:26,790][106226] Updated weights for policy 0, policy_version 680012 (0.0006) [2023-12-28 00:08:26,837][106225] Updated weights for policy 1, policy_version 681807 (0.0009) [2023-12-28 00:08:26,851][106226] Updated weights for policy 0, policy_version 680022 (0.0006) [2023-12-28 00:08:26,894][106225] Updated weights for policy 1, policy_version 681817 (0.0010) [2023-12-28 00:08:26,912][106226] Updated weights for policy 0, policy_version 680032 (0.0006) [2023-12-28 00:08:26,948][106225] Updated weights for policy 1, policy_version 681827 (0.0010) [2023-12-28 00:08:27,576][106226] Updated weights for policy 0, policy_version 680042 (0.0006) [2023-12-28 00:08:27,639][106226] Updated weights for policy 0, policy_version 680052 (0.0006) [2023-12-28 00:08:27,648][106225] Updated weights for policy 1, policy_version 681837 (0.0008) [2023-12-28 00:08:27,707][106226] Updated weights for policy 0, policy_version 680062 (0.0008) [2023-12-28 00:08:27,713][106225] Updated weights for policy 1, policy_version 681847 (0.0008) [2023-12-28 00:08:27,778][106225] Updated weights for policy 1, policy_version 681857 (0.0007) [2023-12-28 00:08:28,314][106226] Updated weights for policy 0, policy_version 680072 (0.0010) [2023-12-28 00:08:28,388][106226] Updated weights for policy 0, policy_version 680082 (0.0011) [2023-12-28 00:08:28,456][106226] Updated weights for policy 0, policy_version 680092 (0.0010) [2023-12-28 00:08:28,485][106225] Updated weights for policy 1, policy_version 681867 (0.0007) [2023-12-28 00:08:28,548][106225] Updated weights for policy 1, policy_version 681877 (0.0007) [2023-12-28 00:08:28,618][106225] Updated weights for policy 1, policy_version 681887 (0.0007) [2023-12-28 00:08:29,130][106226] Updated weights for policy 0, policy_version 680102 (0.0008) [2023-12-28 00:08:29,195][106226] Updated weights for policy 0, policy_version 680112 (0.0008) [2023-12-28 00:08:29,264][106226] Updated weights for policy 0, policy_version 680122 (0.0009) [2023-12-28 00:08:29,408][106225] Updated weights for policy 1, policy_version 681897 (0.0008) [2023-12-28 00:08:29,469][106225] Updated weights for policy 1, policy_version 681907 (0.0009) [2023-12-28 00:08:29,526][106225] Updated weights for policy 1, policy_version 681917 (0.0008) [2023-12-28 00:08:29,588][106225] Updated weights for policy 1, policy_version 681927 (0.0009) [2023-12-28 00:08:30,031][106226] Updated weights for policy 0, policy_version 680132 (0.0010) [2023-12-28 00:08:30,088][106226] Updated weights for policy 0, policy_version 680142 (0.0009) [2023-12-28 00:08:30,146][106226] Updated weights for policy 0, policy_version 680152 (0.0010) [2023-12-28 00:08:30,366][106225] Updated weights for policy 1, policy_version 681937 (0.0008) [2023-12-28 00:08:30,421][106225] Updated weights for policy 1, policy_version 681947 (0.0008) [2023-12-28 00:08:30,480][106225] Updated weights for policy 1, policy_version 681957 (0.0008) [2023-12-28 00:08:30,851][106226] Updated weights for policy 0, policy_version 680162 (0.0011) [2023-12-28 00:08:30,909][106226] Updated weights for policy 0, policy_version 680172 (0.0006) [2023-12-28 00:08:30,964][106226] Updated weights for policy 0, policy_version 680182 (0.0006) [2023-12-28 00:08:31,019][106226] Updated weights for policy 0, policy_version 680192 (0.0005) [2023-12-28 00:08:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 18841.6, 300 sec: 18438.9). Total num frames: 348790784. Throughput: 0: 9409.6, 1: 9593.7. Samples: 348781300. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:31,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-5.458')] [2023-12-28 00:08:31,286][106225] Updated weights for policy 1, policy_version 681967 (0.0008) [2023-12-28 00:08:31,346][106225] Updated weights for policy 1, policy_version 681977 (0.0009) [2023-12-28 00:08:31,415][106225] Updated weights for policy 1, policy_version 681987 (0.0009) [2023-12-28 00:08:31,742][106226] Updated weights for policy 0, policy_version 680202 (0.0010) [2023-12-28 00:08:31,808][106226] Updated weights for policy 0, policy_version 680212 (0.0011) [2023-12-28 00:08:31,868][106226] Updated weights for policy 0, policy_version 680222 (0.0011) [2023-12-28 00:08:32,195][106225] Updated weights for policy 1, policy_version 681997 (0.0008) [2023-12-28 00:08:32,260][106225] Updated weights for policy 1, policy_version 682007 (0.0007) [2023-12-28 00:08:32,327][106225] Updated weights for policy 1, policy_version 682017 (0.0007) [2023-12-28 00:08:32,599][106226] Updated weights for policy 0, policy_version 680232 (0.0008) [2023-12-28 00:08:32,663][106226] Updated weights for policy 0, policy_version 680242 (0.0009) [2023-12-28 00:08:32,722][106226] Updated weights for policy 0, policy_version 680252 (0.0009) [2023-12-28 00:08:33,054][106225] Updated weights for policy 1, policy_version 682027 (0.0009) [2023-12-28 00:08:33,106][106225] Updated weights for policy 1, policy_version 682037 (0.0008) [2023-12-28 00:08:33,167][106225] Updated weights for policy 1, policy_version 682047 (0.0009) [2023-12-28 00:08:33,448][106226] Updated weights for policy 0, policy_version 680262 (0.0008) [2023-12-28 00:08:33,504][106226] Updated weights for policy 0, policy_version 680272 (0.0009) [2023-12-28 00:08:33,555][106226] Updated weights for policy 0, policy_version 680282 (0.0008) [2023-12-28 00:08:33,916][106225] Updated weights for policy 1, policy_version 682057 (0.0009) [2023-12-28 00:08:33,963][106225] Updated weights for policy 1, policy_version 682067 (0.0008) [2023-12-28 00:08:34,010][106225] Updated weights for policy 1, policy_version 682077 (0.0008) [2023-12-28 00:08:34,065][106225] Updated weights for policy 1, policy_version 682087 (0.0008) [2023-12-28 00:08:34,310][106226] Updated weights for policy 0, policy_version 680292 (0.0008) [2023-12-28 00:08:34,381][106226] Updated weights for policy 0, policy_version 680302 (0.0008) [2023-12-28 00:08:34,448][106226] Updated weights for policy 0, policy_version 680312 (0.0008) [2023-12-28 00:08:34,823][106225] Updated weights for policy 1, policy_version 682097 (0.0006) [2023-12-28 00:08:34,889][106225] Updated weights for policy 1, policy_version 682107 (0.0006) [2023-12-28 00:08:34,939][106225] Updated weights for policy 1, policy_version 682117 (0.0007) [2023-12-28 00:08:35,142][106226] Updated weights for policy 0, policy_version 680322 (0.0009) [2023-12-28 00:08:35,201][106226] Updated weights for policy 0, policy_version 680332 (0.0011) [2023-12-28 00:08:35,260][106226] Updated weights for policy 0, policy_version 680342 (0.0011) [2023-12-28 00:08:35,321][106226] Updated weights for policy 0, policy_version 680352 (0.0011) [2023-12-28 00:08:35,526][106225] Updated weights for policy 1, policy_version 682127 (0.0008) [2023-12-28 00:08:35,584][106225] Updated weights for policy 1, policy_version 682137 (0.0005) [2023-12-28 00:08:35,644][106225] Updated weights for policy 1, policy_version 682147 (0.0005) [2023-12-28 00:08:36,053][106226] Updated weights for policy 0, policy_version 680362 (0.0006) [2023-12-28 00:08:36,129][106226] Updated weights for policy 0, policy_version 680372 (0.0008) [2023-12-28 00:08:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18841.6, 300 sec: 18439.0). Total num frames: 348880896. Throughput: 0: 9467.9, 1: 9576.3. Samples: 348896008. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:36,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.489')] [2023-12-28 00:08:36,194][106226] Updated weights for policy 0, policy_version 680382 (0.0011) [2023-12-28 00:08:36,345][106225] Updated weights for policy 1, policy_version 682157 (0.0007) [2023-12-28 00:08:36,396][106225] Updated weights for policy 1, policy_version 682167 (0.0010) [2023-12-28 00:08:36,460][106225] Updated weights for policy 1, policy_version 682177 (0.0008) [2023-12-28 00:08:36,871][106226] Updated weights for policy 0, policy_version 680392 (0.0011) [2023-12-28 00:08:36,942][106226] Updated weights for policy 0, policy_version 680402 (0.0011) [2023-12-28 00:08:37,005][106226] Updated weights for policy 0, policy_version 680412 (0.0011) [2023-12-28 00:08:37,228][106225] Updated weights for policy 1, policy_version 682187 (0.0008) [2023-12-28 00:08:37,293][106225] Updated weights for policy 1, policy_version 682197 (0.0005) [2023-12-28 00:08:37,356][106225] Updated weights for policy 1, policy_version 682207 (0.0005) [2023-12-28 00:08:37,713][106226] Updated weights for policy 0, policy_version 680422 (0.0007) [2023-12-28 00:08:37,776][106226] Updated weights for policy 0, policy_version 680432 (0.0008) [2023-12-28 00:08:37,831][106226] Updated weights for policy 0, policy_version 680442 (0.0011) [2023-12-28 00:08:38,042][106225] Updated weights for policy 1, policy_version 682217 (0.0006) [2023-12-28 00:08:38,105][106225] Updated weights for policy 1, policy_version 682227 (0.0005) [2023-12-28 00:08:38,170][106225] Updated weights for policy 1, policy_version 682237 (0.0008) [2023-12-28 00:08:38,232][106225] Updated weights for policy 1, policy_version 682247 (0.0007) [2023-12-28 00:08:38,534][106226] Updated weights for policy 0, policy_version 680452 (0.0008) [2023-12-28 00:08:38,599][106226] Updated weights for policy 0, policy_version 680462 (0.0011) [2023-12-28 00:08:38,666][106226] Updated weights for policy 0, policy_version 680472 (0.0011) [2023-12-28 00:08:38,907][106225] Updated weights for policy 1, policy_version 682257 (0.0007) [2023-12-28 00:08:38,967][106225] Updated weights for policy 1, policy_version 682267 (0.0007) [2023-12-28 00:08:39,019][106225] Updated weights for policy 1, policy_version 682277 (0.0007) [2023-12-28 00:08:39,423][106226] Updated weights for policy 0, policy_version 680482 (0.0011) [2023-12-28 00:08:39,495][106226] Updated weights for policy 0, policy_version 680492 (0.0009) [2023-12-28 00:08:39,558][106226] Updated weights for policy 0, policy_version 680502 (0.0008) [2023-12-28 00:08:39,626][106226] Updated weights for policy 0, policy_version 680512 (0.0009) [2023-12-28 00:08:39,728][106225] Updated weights for policy 1, policy_version 682287 (0.0008) [2023-12-28 00:08:39,791][106225] Updated weights for policy 1, policy_version 682297 (0.0008) [2023-12-28 00:08:39,856][106225] Updated weights for policy 1, policy_version 682307 (0.0009) [2023-12-28 00:08:40,404][106226] Updated weights for policy 0, policy_version 680522 (0.0009) [2023-12-28 00:08:40,474][106226] Updated weights for policy 0, policy_version 680532 (0.0006) [2023-12-28 00:08:40,536][106226] Updated weights for policy 0, policy_version 680542 (0.0006) [2023-12-28 00:08:40,617][106225] Updated weights for policy 1, policy_version 682317 (0.0009) [2023-12-28 00:08:40,675][106225] Updated weights for policy 1, policy_version 682327 (0.0010) [2023-12-28 00:08:40,737][106225] Updated weights for policy 1, policy_version 682337 (0.0011) [2023-12-28 00:08:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 18978.1, 300 sec: 18494.5). Total num frames: 348979200. Throughput: 0: 9515.9, 1: 9598.3. Samples: 348954096. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:41,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-5.418')] [2023-12-28 00:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000682344_174710784.pth... [2023-12-28 00:08:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000681224_174424064.pth [2023-12-28 00:08:41,229][106226] Updated weights for policy 0, policy_version 680552 (0.0009) [2023-12-28 00:08:41,299][106226] Updated weights for policy 0, policy_version 680562 (0.0008) [2023-12-28 00:08:41,376][106226] Updated weights for policy 0, policy_version 680572 (0.0008) [2023-12-28 00:08:41,400][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000680576_174276608.pth... [2023-12-28 00:08:41,404][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000679456_173989888.pth [2023-12-28 00:08:41,478][106225] Updated weights for policy 1, policy_version 682347 (0.0008) [2023-12-28 00:08:41,546][106225] Updated weights for policy 1, policy_version 682357 (0.0009) [2023-12-28 00:08:41,612][106225] Updated weights for policy 1, policy_version 682367 (0.0008) [2023-12-28 00:08:42,135][106226] Updated weights for policy 0, policy_version 680582 (0.0008) [2023-12-28 00:08:42,202][106226] Updated weights for policy 0, policy_version 680592 (0.0007) [2023-12-28 00:08:42,270][106226] Updated weights for policy 0, policy_version 680602 (0.0008) [2023-12-28 00:08:42,446][106225] Updated weights for policy 1, policy_version 682377 (0.0008) [2023-12-28 00:08:42,515][106225] Updated weights for policy 1, policy_version 682387 (0.0011) [2023-12-28 00:08:42,581][106225] Updated weights for policy 1, policy_version 682397 (0.0011) [2023-12-28 00:08:42,640][106225] Updated weights for policy 1, policy_version 682407 (0.0011) [2023-12-28 00:08:43,040][106226] Updated weights for policy 0, policy_version 680612 (0.0008) [2023-12-28 00:08:43,099][106226] Updated weights for policy 0, policy_version 680622 (0.0008) [2023-12-28 00:08:43,167][106226] Updated weights for policy 0, policy_version 680632 (0.0005) [2023-12-28 00:08:43,343][106225] Updated weights for policy 1, policy_version 682417 (0.0006) [2023-12-28 00:08:43,401][106225] Updated weights for policy 1, policy_version 682427 (0.0005) [2023-12-28 00:08:43,458][106225] Updated weights for policy 1, policy_version 682437 (0.0009) [2023-12-28 00:08:43,895][106226] Updated weights for policy 0, policy_version 680642 (0.0007) [2023-12-28 00:08:43,950][106226] Updated weights for policy 0, policy_version 680652 (0.0008) [2023-12-28 00:08:44,001][106226] Updated weights for policy 0, policy_version 680662 (0.0008) [2023-12-28 00:08:44,054][106226] Updated weights for policy 0, policy_version 680672 (0.0008) [2023-12-28 00:08:44,152][106225] Updated weights for policy 1, policy_version 682447 (0.0010) [2023-12-28 00:08:44,210][106225] Updated weights for policy 1, policy_version 682457 (0.0010) [2023-12-28 00:08:44,279][106225] Updated weights for policy 1, policy_version 682467 (0.0008) [2023-12-28 00:08:44,843][106226] Updated weights for policy 0, policy_version 680682 (0.0008) [2023-12-28 00:08:44,906][106226] Updated weights for policy 0, policy_version 680692 (0.0008) [2023-12-28 00:08:44,969][106226] Updated weights for policy 0, policy_version 680702 (0.0008) [2023-12-28 00:08:44,994][106225] Updated weights for policy 1, policy_version 682477 (0.0011) [2023-12-28 00:08:45,062][106225] Updated weights for policy 1, policy_version 682487 (0.0008) [2023-12-28 00:08:45,126][106225] Updated weights for policy 1, policy_version 682497 (0.0009) [2023-12-28 00:08:45,752][106226] Updated weights for policy 0, policy_version 680712 (0.0008) [2023-12-28 00:08:45,812][106226] Updated weights for policy 0, policy_version 680722 (0.0009) [2023-12-28 00:08:45,842][106225] Updated weights for policy 1, policy_version 682507 (0.0009) [2023-12-28 00:08:45,873][106226] Updated weights for policy 0, policy_version 680732 (0.0007) [2023-12-28 00:08:45,900][106225] Updated weights for policy 1, policy_version 682517 (0.0006) [2023-12-28 00:08:45,963][106225] Updated weights for policy 1, policy_version 682527 (0.0005) [2023-12-28 00:08:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 18978.1, 300 sec: 18494.5). Total num frames: 349077504. Throughput: 0: 9454.1, 1: 9549.7. Samples: 349064052. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:46,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.489')] [2023-12-28 00:08:46,520][106225] Updated weights for policy 1, policy_version 682537 (0.0006) [2023-12-28 00:08:46,570][106225] Updated weights for policy 1, policy_version 682547 (0.0008) [2023-12-28 00:08:46,624][106225] Updated weights for policy 1, policy_version 682557 (0.0007) [2023-12-28 00:08:46,676][106225] Updated weights for policy 1, policy_version 682567 (0.0006) [2023-12-28 00:08:46,695][106226] Updated weights for policy 0, policy_version 680742 (0.0009) [2023-12-28 00:08:46,757][106226] Updated weights for policy 0, policy_version 680752 (0.0008) [2023-12-28 00:08:46,817][106226] Updated weights for policy 0, policy_version 680762 (0.0009) [2023-12-28 00:08:47,308][106225] Updated weights for policy 1, policy_version 682577 (0.0010) [2023-12-28 00:08:47,366][106225] Updated weights for policy 1, policy_version 682587 (0.0010) [2023-12-28 00:08:47,421][106225] Updated weights for policy 1, policy_version 682597 (0.0011) [2023-12-28 00:08:47,620][106226] Updated weights for policy 0, policy_version 680772 (0.0008) [2023-12-28 00:08:47,685][106226] Updated weights for policy 0, policy_version 680782 (0.0008) [2023-12-28 00:08:47,757][106226] Updated weights for policy 0, policy_version 680792 (0.0009) [2023-12-28 00:08:48,054][106225] Updated weights for policy 1, policy_version 682607 (0.0007) [2023-12-28 00:08:48,116][106225] Updated weights for policy 1, policy_version 682617 (0.0007) [2023-12-28 00:08:48,179][106225] Updated weights for policy 1, policy_version 682627 (0.0010) [2023-12-28 00:08:48,549][106226] Updated weights for policy 0, policy_version 680802 (0.0010) [2023-12-28 00:08:48,608][106226] Updated weights for policy 0, policy_version 680812 (0.0006) [2023-12-28 00:08:48,668][106226] Updated weights for policy 0, policy_version 680822 (0.0006) [2023-12-28 00:08:48,736][106226] Updated weights for policy 0, policy_version 680832 (0.0005) [2023-12-28 00:08:48,911][106225] Updated weights for policy 1, policy_version 682637 (0.0010) [2023-12-28 00:08:48,974][106225] Updated weights for policy 1, policy_version 682647 (0.0010) [2023-12-28 00:08:49,031][106225] Updated weights for policy 1, policy_version 682657 (0.0010) [2023-12-28 00:08:49,434][106226] Updated weights for policy 0, policy_version 680845 (0.0009) [2023-12-28 00:08:49,488][106226] Updated weights for policy 0, policy_version 680855 (0.0008) [2023-12-28 00:08:49,732][106225] Updated weights for policy 1, policy_version 682667 (0.0010) [2023-12-28 00:08:49,790][106225] Updated weights for policy 1, policy_version 682677 (0.0007) [2023-12-28 00:08:49,856][106225] Updated weights for policy 1, policy_version 682687 (0.0007) [2023-12-28 00:08:50,296][106226] Updated weights for policy 0, policy_version 680865 (0.0008) [2023-12-28 00:08:50,364][106226] Updated weights for policy 0, policy_version 680875 (0.0008) [2023-12-28 00:08:50,433][106226] Updated weights for policy 0, policy_version 680885 (0.0008) [2023-12-28 00:08:50,490][106226] Updated weights for policy 0, policy_version 680895 (0.0008) [2023-12-28 00:08:50,628][106225] Updated weights for policy 1, policy_version 682697 (0.0005) [2023-12-28 00:08:50,698][106225] Updated weights for policy 1, policy_version 682707 (0.0008) [2023-12-28 00:08:50,752][106225] Updated weights for policy 1, policy_version 682717 (0.0008) [2023-12-28 00:08:50,821][106225] Updated weights for policy 1, policy_version 682727 (0.0007) [2023-12-28 00:08:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19114.7, 300 sec: 18466.7). Total num frames: 349167616. Throughput: 0: 9382.9, 1: 9635.2. Samples: 349178480. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:51,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.681')] [2023-12-28 00:08:51,247][106226] Updated weights for policy 0, policy_version 680905 (0.0008) [2023-12-28 00:08:51,322][106226] Updated weights for policy 0, policy_version 680915 (0.0009) [2023-12-28 00:08:51,408][106226] Updated weights for policy 0, policy_version 680925 (0.0009) [2023-12-28 00:08:51,453][106225] Updated weights for policy 1, policy_version 682737 (0.0008) [2023-12-28 00:08:51,518][106225] Updated weights for policy 1, policy_version 682747 (0.0008) [2023-12-28 00:08:51,580][106225] Updated weights for policy 1, policy_version 682757 (0.0008) [2023-12-28 00:08:52,111][106226] Updated weights for policy 0, policy_version 680935 (0.0007) [2023-12-28 00:08:52,178][106226] Updated weights for policy 0, policy_version 680945 (0.0006) [2023-12-28 00:08:52,232][106226] Updated weights for policy 0, policy_version 680955 (0.0007) [2023-12-28 00:08:52,300][106225] Updated weights for policy 1, policy_version 682767 (0.0010) [2023-12-28 00:08:52,361][106225] Updated weights for policy 1, policy_version 682777 (0.0010) [2023-12-28 00:08:52,426][106225] Updated weights for policy 1, policy_version 682787 (0.0008) [2023-12-28 00:08:52,999][106226] Updated weights for policy 0, policy_version 680965 (0.0007) [2023-12-28 00:08:53,050][106226] Updated weights for policy 0, policy_version 680975 (0.0008) [2023-12-28 00:08:53,052][106225] Updated weights for policy 1, policy_version 682797 (0.0007) [2023-12-28 00:08:53,097][106226] Updated weights for policy 0, policy_version 680985 (0.0006) [2023-12-28 00:08:53,110][106225] Updated weights for policy 1, policy_version 682807 (0.0005) [2023-12-28 00:08:53,168][106225] Updated weights for policy 1, policy_version 682817 (0.0005) [2023-12-28 00:08:53,679][106225] Updated weights for policy 1, policy_version 682827 (0.0005) [2023-12-28 00:08:53,730][106225] Updated weights for policy 1, policy_version 682837 (0.0006) [2023-12-28 00:08:53,736][106226] Updated weights for policy 0, policy_version 680995 (0.0005) [2023-12-28 00:08:53,779][106225] Updated weights for policy 1, policy_version 682847 (0.0005) [2023-12-28 00:08:53,795][106226] Updated weights for policy 0, policy_version 681005 (0.0005) [2023-12-28 00:08:53,853][106226] Updated weights for policy 0, policy_version 681015 (0.0005) [2023-12-28 00:08:54,324][106225] Updated weights for policy 1, policy_version 682857 (0.0005) [2023-12-28 00:08:54,383][106225] Updated weights for policy 1, policy_version 682867 (0.0005) [2023-12-28 00:08:54,448][106225] Updated weights for policy 1, policy_version 682877 (0.0007) [2023-12-28 00:08:54,458][106226] Updated weights for policy 0, policy_version 681025 (0.0006) [2023-12-28 00:08:54,502][106226] Updated weights for policy 0, policy_version 681035 (0.0007) [2023-12-28 00:08:54,503][106225] Updated weights for policy 1, policy_version 682887 (0.0007) [2023-12-28 00:08:54,549][106226] Updated weights for policy 0, policy_version 681045 (0.0009) [2023-12-28 00:08:54,595][106226] Updated weights for policy 0, policy_version 681055 (0.0008) [2023-12-28 00:08:55,071][106225] Updated weights for policy 1, policy_version 682897 (0.0006) [2023-12-28 00:08:55,138][106225] Updated weights for policy 1, policy_version 682907 (0.0006) [2023-12-28 00:08:55,201][106225] Updated weights for policy 1, policy_version 682917 (0.0005) [2023-12-28 00:08:55,307][106226] Updated weights for policy 0, policy_version 681065 (0.0006) [2023-12-28 00:08:55,376][106226] Updated weights for policy 0, policy_version 681075 (0.0006) [2023-12-28 00:08:55,440][106226] Updated weights for policy 0, policy_version 681085 (0.0011) [2023-12-28 00:08:55,725][106225] Updated weights for policy 1, policy_version 682927 (0.0007) [2023-12-28 00:08:55,775][106225] Updated weights for policy 1, policy_version 682937 (0.0009) [2023-12-28 00:08:55,827][106225] Updated weights for policy 1, policy_version 682947 (0.0008) [2023-12-28 00:08:55,999][106226] Updated weights for policy 0, policy_version 681095 (0.0008) [2023-12-28 00:08:56,063][106226] Updated weights for policy 0, policy_version 681105 (0.0007) [2023-12-28 00:08:56,125][106226] Updated weights for policy 0, policy_version 681115 (0.0007) [2023-12-28 00:08:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19387.7, 300 sec: 18550.0). Total num frames: 349282304. Throughput: 0: 9412.6, 1: 9716.9. Samples: 349240124. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:08:56,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.371')] [2023-12-28 00:08:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000682952_174866432.pth... [2023-12-28 00:08:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000681120_174415872.pth... [2023-12-28 00:08:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000681800_174571520.pth [2023-12-28 00:08:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000680000_174129152.pth [2023-12-28 00:08:56,546][106225] Updated weights for policy 1, policy_version 682957 (0.0009) [2023-12-28 00:08:56,596][106225] Updated weights for policy 1, policy_version 682967 (0.0007) [2023-12-28 00:08:56,648][106225] Updated weights for policy 1, policy_version 682977 (0.0007) [2023-12-28 00:08:56,765][106226] Updated weights for policy 0, policy_version 681125 (0.0007) [2023-12-28 00:08:56,826][106226] Updated weights for policy 0, policy_version 681135 (0.0005) [2023-12-28 00:08:56,875][106226] Updated weights for policy 0, policy_version 681145 (0.0005) [2023-12-28 00:08:57,197][106225] Updated weights for policy 1, policy_version 682987 (0.0005) [2023-12-28 00:08:57,255][106225] Updated weights for policy 1, policy_version 682997 (0.0005) [2023-12-28 00:08:57,312][106225] Updated weights for policy 1, policy_version 683007 (0.0006) [2023-12-28 00:08:57,591][106226] Updated weights for policy 0, policy_version 681155 (0.0008) [2023-12-28 00:08:57,657][106226] Updated weights for policy 0, policy_version 681165 (0.0005) [2023-12-28 00:08:57,719][106226] Updated weights for policy 0, policy_version 681175 (0.0008) [2023-12-28 00:08:58,000][106225] Updated weights for policy 1, policy_version 683017 (0.0006) [2023-12-28 00:08:58,060][106225] Updated weights for policy 1, policy_version 683027 (0.0009) [2023-12-28 00:08:58,120][106225] Updated weights for policy 1, policy_version 683037 (0.0007) [2023-12-28 00:08:58,182][106225] Updated weights for policy 1, policy_version 683047 (0.0008) [2023-12-28 00:08:58,421][106226] Updated weights for policy 0, policy_version 681185 (0.0008) [2023-12-28 00:08:58,492][106226] Updated weights for policy 0, policy_version 681195 (0.0007) [2023-12-28 00:08:58,560][106226] Updated weights for policy 0, policy_version 681205 (0.0008) [2023-12-28 00:08:58,632][106226] Updated weights for policy 0, policy_version 681215 (0.0007) [2023-12-28 00:08:59,007][106225] Updated weights for policy 1, policy_version 683057 (0.0006) [2023-12-28 00:08:59,070][106225] Updated weights for policy 1, policy_version 683067 (0.0008) [2023-12-28 00:08:59,130][106225] Updated weights for policy 1, policy_version 683077 (0.0008) [2023-12-28 00:08:59,393][106226] Updated weights for policy 0, policy_version 681225 (0.0008) [2023-12-28 00:08:59,461][106226] Updated weights for policy 0, policy_version 681235 (0.0007) [2023-12-28 00:08:59,521][106226] Updated weights for policy 0, policy_version 681245 (0.0005) [2023-12-28 00:08:59,878][106225] Updated weights for policy 1, policy_version 683087 (0.0007) [2023-12-28 00:08:59,952][106225] Updated weights for policy 1, policy_version 683098 (0.0010) [2023-12-28 00:09:00,012][106225] Updated weights for policy 1, policy_version 683108 (0.0009) [2023-12-28 00:09:00,294][106226] Updated weights for policy 0, policy_version 681255 (0.0007) [2023-12-28 00:09:00,360][106226] Updated weights for policy 0, policy_version 681265 (0.0007) [2023-12-28 00:09:00,423][106226] Updated weights for policy 0, policy_version 681275 (0.0006) [2023-12-28 00:09:00,664][106225] Updated weights for policy 1, policy_version 683118 (0.0005) [2023-12-28 00:09:00,717][106225] Updated weights for policy 1, policy_version 683128 (0.0005) [2023-12-28 00:09:00,767][106225] Updated weights for policy 1, policy_version 683138 (0.0007) [2023-12-28 00:09:01,055][106226] Updated weights for policy 0, policy_version 681285 (0.0008) [2023-12-28 00:09:01,113][106226] Updated weights for policy 0, policy_version 681295 (0.0005) [2023-12-28 00:09:01,174][105115] Fps is (10 sec: 20479.8, 60 sec: 19251.2, 300 sec: 18550.0). Total num frames: 349372416. Throughput: 0: 9531.7, 1: 9887.6. Samples: 349364424. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:01,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.390')] [2023-12-28 00:09:01,184][106226] Updated weights for policy 0, policy_version 681305 (0.0008) [2023-12-28 00:09:01,491][106225] Updated weights for policy 1, policy_version 683148 (0.0009) [2023-12-28 00:09:01,552][106225] Updated weights for policy 1, policy_version 683158 (0.0008) [2023-12-28 00:09:01,613][106225] Updated weights for policy 1, policy_version 683168 (0.0009) [2023-12-28 00:09:01,873][106226] Updated weights for policy 0, policy_version 681315 (0.0007) [2023-12-28 00:09:01,930][106226] Updated weights for policy 0, policy_version 681325 (0.0005) [2023-12-28 00:09:01,997][106226] Updated weights for policy 0, policy_version 681335 (0.0005) [2023-12-28 00:09:02,282][106225] Updated weights for policy 1, policy_version 683178 (0.0006) [2023-12-28 00:09:02,336][106225] Updated weights for policy 1, policy_version 683188 (0.0008) [2023-12-28 00:09:02,418][106225] Updated weights for policy 1, policy_version 683198 (0.0009) [2023-12-28 00:09:02,478][106225] Updated weights for policy 1, policy_version 683208 (0.0008) [2023-12-28 00:09:02,661][106226] Updated weights for policy 0, policy_version 681345 (0.0005) [2023-12-28 00:09:02,710][106226] Updated weights for policy 0, policy_version 681355 (0.0009) [2023-12-28 00:09:02,762][106226] Updated weights for policy 0, policy_version 681365 (0.0008) [2023-12-28 00:09:02,817][106226] Updated weights for policy 0, policy_version 681375 (0.0008) [2023-12-28 00:09:03,101][106225] Updated weights for policy 1, policy_version 683218 (0.0009) [2023-12-28 00:09:03,151][106225] Updated weights for policy 1, policy_version 683228 (0.0010) [2023-12-28 00:09:03,201][106225] Updated weights for policy 1, policy_version 683238 (0.0010) [2023-12-28 00:09:03,511][106226] Updated weights for policy 0, policy_version 681385 (0.0008) [2023-12-28 00:09:03,570][106226] Updated weights for policy 0, policy_version 681395 (0.0008) [2023-12-28 00:09:03,628][106226] Updated weights for policy 0, policy_version 681405 (0.0007) [2023-12-28 00:09:03,851][106225] Updated weights for policy 1, policy_version 683248 (0.0007) [2023-12-28 00:09:03,916][106225] Updated weights for policy 1, policy_version 683258 (0.0008) [2023-12-28 00:09:03,973][106225] Updated weights for policy 1, policy_version 683268 (0.0010) [2023-12-28 00:09:04,248][106226] Updated weights for policy 0, policy_version 681415 (0.0006) [2023-12-28 00:09:04,309][106226] Updated weights for policy 0, policy_version 681425 (0.0008) [2023-12-28 00:09:04,373][106226] Updated weights for policy 0, policy_version 681435 (0.0006) [2023-12-28 00:09:04,657][106225] Updated weights for policy 1, policy_version 683278 (0.0008) [2023-12-28 00:09:04,707][106225] Updated weights for policy 1, policy_version 683288 (0.0006) [2023-12-28 00:09:04,756][106225] Updated weights for policy 1, policy_version 683298 (0.0005) [2023-12-28 00:09:05,085][106226] Updated weights for policy 0, policy_version 681445 (0.0008) [2023-12-28 00:09:05,156][106226] Updated weights for policy 0, policy_version 681455 (0.0008) [2023-12-28 00:09:05,223][106226] Updated weights for policy 0, policy_version 681465 (0.0010) [2023-12-28 00:09:05,294][106225] Updated weights for policy 1, policy_version 683308 (0.0005) [2023-12-28 00:09:05,365][106225] Updated weights for policy 1, policy_version 683318 (0.0006) [2023-12-28 00:09:05,417][106225] Updated weights for policy 1, policy_version 683328 (0.0008) [2023-12-28 00:09:05,793][106226] Updated weights for policy 0, policy_version 681475 (0.0005) [2023-12-28 00:09:05,863][106226] Updated weights for policy 0, policy_version 681485 (0.0005) [2023-12-28 00:09:05,924][106226] Updated weights for policy 0, policy_version 681495 (0.0005) [2023-12-28 00:09:06,015][106225] Updated weights for policy 1, policy_version 683338 (0.0008) [2023-12-28 00:09:06,065][106225] Updated weights for policy 1, policy_version 683348 (0.0009) [2023-12-28 00:09:06,125][106225] Updated weights for policy 1, policy_version 683358 (0.0008) [2023-12-28 00:09:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 18577.8). Total num frames: 349478912. Throughput: 0: 9686.8, 1: 10028.8. Samples: 349491268. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:06,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.349')] [2023-12-28 00:09:06,179][106225] Updated weights for policy 1, policy_version 683368 (0.0008) [2023-12-28 00:09:06,507][106226] Updated weights for policy 0, policy_version 681505 (0.0006) [2023-12-28 00:09:06,577][106226] Updated weights for policy 0, policy_version 681515 (0.0006) [2023-12-28 00:09:06,643][106226] Updated weights for policy 0, policy_version 681525 (0.0007) [2023-12-28 00:09:06,706][106226] Updated weights for policy 0, policy_version 681535 (0.0007) [2023-12-28 00:09:06,951][106225] Updated weights for policy 1, policy_version 683378 (0.0009) [2023-12-28 00:09:07,006][106225] Updated weights for policy 1, policy_version 683388 (0.0009) [2023-12-28 00:09:07,061][106225] Updated weights for policy 1, policy_version 683398 (0.0005) [2023-12-28 00:09:07,363][106226] Updated weights for policy 0, policy_version 681545 (0.0009) [2023-12-28 00:09:07,425][106226] Updated weights for policy 0, policy_version 681555 (0.0009) [2023-12-28 00:09:07,477][106226] Updated weights for policy 0, policy_version 681565 (0.0008) [2023-12-28 00:09:07,744][106225] Updated weights for policy 1, policy_version 683408 (0.0007) [2023-12-28 00:09:07,799][106225] Updated weights for policy 1, policy_version 683418 (0.0005) [2023-12-28 00:09:07,851][106225] Updated weights for policy 1, policy_version 683428 (0.0005) [2023-12-28 00:09:08,230][106226] Updated weights for policy 0, policy_version 681575 (0.0009) [2023-12-28 00:09:08,287][106226] Updated weights for policy 0, policy_version 681585 (0.0005) [2023-12-28 00:09:08,353][106226] Updated weights for policy 0, policy_version 681595 (0.0007) [2023-12-28 00:09:08,471][106225] Updated weights for policy 1, policy_version 683438 (0.0007) [2023-12-28 00:09:08,529][106225] Updated weights for policy 1, policy_version 683448 (0.0008) [2023-12-28 00:09:08,590][106225] Updated weights for policy 1, policy_version 683459 (0.0009) [2023-12-28 00:09:09,073][106226] Updated weights for policy 0, policy_version 681606 (0.0008) [2023-12-28 00:09:09,126][106226] Updated weights for policy 0, policy_version 681616 (0.0007) [2023-12-28 00:09:09,191][106226] Updated weights for policy 0, policy_version 681626 (0.0007) [2023-12-28 00:09:09,301][106225] Updated weights for policy 1, policy_version 683469 (0.0008) [2023-12-28 00:09:09,367][106225] Updated weights for policy 1, policy_version 683479 (0.0009) [2023-12-28 00:09:09,443][106225] Updated weights for policy 1, policy_version 683489 (0.0011) [2023-12-28 00:09:09,975][106226] Updated weights for policy 0, policy_version 681636 (0.0007) [2023-12-28 00:09:10,030][106226] Updated weights for policy 0, policy_version 681646 (0.0008) [2023-12-28 00:09:10,085][106226] Updated weights for policy 0, policy_version 681656 (0.0008) [2023-12-28 00:09:10,190][106225] Updated weights for policy 1, policy_version 683499 (0.0010) [2023-12-28 00:09:10,252][106225] Updated weights for policy 1, policy_version 683509 (0.0008) [2023-12-28 00:09:10,311][106225] Updated weights for policy 1, policy_version 683519 (0.0010) [2023-12-28 00:09:10,862][106226] Updated weights for policy 0, policy_version 681666 (0.0008) [2023-12-28 00:09:10,918][106226] Updated weights for policy 0, policy_version 681676 (0.0005) [2023-12-28 00:09:10,971][106226] Updated weights for policy 0, policy_version 681686 (0.0007) [2023-12-28 00:09:11,035][106226] Updated weights for policy 0, policy_version 681696 (0.0008) [2023-12-28 00:09:11,091][106225] Updated weights for policy 1, policy_version 683529 (0.0011) [2023-12-28 00:09:11,162][106225] Updated weights for policy 1, policy_version 683539 (0.0010) [2023-12-28 00:09:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 18605.6). Total num frames: 349577216. Throughput: 0: 9669.3, 1: 10064.9. Samples: 349550488. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:11,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-5.325')] [2023-12-28 00:09:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000681696_174563328.pth... [2023-12-28 00:09:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000680576_174276608.pth [2023-12-28 00:09:11,224][106225] Updated weights for policy 1, policy_version 683549 (0.0011) [2023-12-28 00:09:11,284][106225] Updated weights for policy 1, policy_version 683559 (0.0010) [2023-12-28 00:09:11,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000683560_175022080.pth... [2023-12-28 00:09:11,294][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000682344_174710784.pth [2023-12-28 00:09:11,727][106226] Updated weights for policy 0, policy_version 681706 (0.0007) [2023-12-28 00:09:11,795][106226] Updated weights for policy 0, policy_version 681716 (0.0008) [2023-12-28 00:09:11,863][106226] Updated weights for policy 0, policy_version 681726 (0.0008) [2023-12-28 00:09:12,092][106225] Updated weights for policy 1, policy_version 683569 (0.0012) [2023-12-28 00:09:12,148][106225] Updated weights for policy 1, policy_version 683579 (0.0010) [2023-12-28 00:09:12,206][106225] Updated weights for policy 1, policy_version 683589 (0.0008) [2023-12-28 00:09:12,599][106226] Updated weights for policy 0, policy_version 681736 (0.0008) [2023-12-28 00:09:12,661][106226] Updated weights for policy 0, policy_version 681746 (0.0009) [2023-12-28 00:09:12,716][106226] Updated weights for policy 0, policy_version 681756 (0.0009) [2023-12-28 00:09:12,907][106225] Updated weights for policy 1, policy_version 683599 (0.0007) [2023-12-28 00:09:12,975][106225] Updated weights for policy 1, policy_version 683609 (0.0009) [2023-12-28 00:09:13,035][106225] Updated weights for policy 1, policy_version 683619 (0.0008) [2023-12-28 00:09:13,433][106226] Updated weights for policy 0, policy_version 681766 (0.0008) [2023-12-28 00:09:13,495][106226] Updated weights for policy 0, policy_version 681776 (0.0009) [2023-12-28 00:09:13,553][106226] Updated weights for policy 0, policy_version 681786 (0.0008) [2023-12-28 00:09:13,735][106225] Updated weights for policy 1, policy_version 683629 (0.0007) [2023-12-28 00:09:13,787][106225] Updated weights for policy 1, policy_version 683639 (0.0005) [2023-12-28 00:09:13,838][106225] Updated weights for policy 1, policy_version 683649 (0.0006) [2023-12-28 00:09:14,224][106226] Updated weights for policy 0, policy_version 681796 (0.0009) [2023-12-28 00:09:14,270][106226] Updated weights for policy 0, policy_version 681806 (0.0010) [2023-12-28 00:09:14,327][106226] Updated weights for policy 0, policy_version 681816 (0.0010) [2023-12-28 00:09:14,506][106225] Updated weights for policy 1, policy_version 683659 (0.0008) [2023-12-28 00:09:14,569][106225] Updated weights for policy 1, policy_version 683669 (0.0005) [2023-12-28 00:09:14,632][106225] Updated weights for policy 1, policy_version 683679 (0.0005) [2023-12-28 00:09:14,988][106226] Updated weights for policy 0, policy_version 681826 (0.0010) [2023-12-28 00:09:15,055][106226] Updated weights for policy 0, policy_version 681836 (0.0008) [2023-12-28 00:09:15,118][106226] Updated weights for policy 0, policy_version 681846 (0.0008) [2023-12-28 00:09:15,176][106226] Updated weights for policy 0, policy_version 681856 (0.0010) [2023-12-28 00:09:15,200][106225] Updated weights for policy 1, policy_version 683689 (0.0006) [2023-12-28 00:09:15,267][106225] Updated weights for policy 1, policy_version 683699 (0.0008) [2023-12-28 00:09:15,330][106225] Updated weights for policy 1, policy_version 683709 (0.0008) [2023-12-28 00:09:15,394][106225] Updated weights for policy 1, policy_version 683719 (0.0008) [2023-12-28 00:09:15,843][106226] Updated weights for policy 0, policy_version 681866 (0.0005) [2023-12-28 00:09:15,906][106226] Updated weights for policy 0, policy_version 681876 (0.0005) [2023-12-28 00:09:15,965][106226] Updated weights for policy 0, policy_version 681886 (0.0007) [2023-12-28 00:09:16,145][106225] Updated weights for policy 1, policy_version 683729 (0.0008) [2023-12-28 00:09:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 18633.3). Total num frames: 349675520. Throughput: 0: 9647.9, 1: 10015.6. Samples: 349666156. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:16,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-5.476')] [2023-12-28 00:09:16,192][106225] Updated weights for policy 1, policy_version 683739 (0.0008) [2023-12-28 00:09:16,244][106225] Updated weights for policy 1, policy_version 683749 (0.0007) [2023-12-28 00:09:16,634][106226] Updated weights for policy 0, policy_version 681896 (0.0009) [2023-12-28 00:09:16,687][106226] Updated weights for policy 0, policy_version 681906 (0.0008) [2023-12-28 00:09:16,741][106226] Updated weights for policy 0, policy_version 681916 (0.0009) [2023-12-28 00:09:16,953][106225] Updated weights for policy 1, policy_version 683759 (0.0008) [2023-12-28 00:09:17,006][106225] Updated weights for policy 1, policy_version 683769 (0.0008) [2023-12-28 00:09:17,054][106225] Updated weights for policy 1, policy_version 683779 (0.0008) [2023-12-28 00:09:17,462][106226] Updated weights for policy 0, policy_version 681926 (0.0007) [2023-12-28 00:09:17,522][106226] Updated weights for policy 0, policy_version 681936 (0.0006) [2023-12-28 00:09:17,577][106226] Updated weights for policy 0, policy_version 681946 (0.0009) [2023-12-28 00:09:17,776][106225] Updated weights for policy 1, policy_version 683789 (0.0008) [2023-12-28 00:09:17,824][106225] Updated weights for policy 1, policy_version 683799 (0.0008) [2023-12-28 00:09:17,878][106225] Updated weights for policy 1, policy_version 683809 (0.0008) [2023-12-28 00:09:18,243][106226] Updated weights for policy 0, policy_version 681956 (0.0009) [2023-12-28 00:09:18,305][106226] Updated weights for policy 0, policy_version 681966 (0.0009) [2023-12-28 00:09:18,368][106226] Updated weights for policy 0, policy_version 681976 (0.0009) [2023-12-28 00:09:18,633][106225] Updated weights for policy 1, policy_version 683819 (0.0008) [2023-12-28 00:09:18,688][106225] Updated weights for policy 1, policy_version 683829 (0.0009) [2023-12-28 00:09:18,747][106225] Updated weights for policy 1, policy_version 683839 (0.0008) [2023-12-28 00:09:19,103][106226] Updated weights for policy 0, policy_version 681986 (0.0009) [2023-12-28 00:09:19,160][106226] Updated weights for policy 0, policy_version 681996 (0.0009) [2023-12-28 00:09:19,207][106226] Updated weights for policy 0, policy_version 682006 (0.0009) [2023-12-28 00:09:19,277][106226] Updated weights for policy 0, policy_version 682016 (0.0009) [2023-12-28 00:09:19,429][106225] Updated weights for policy 1, policy_version 683849 (0.0007) [2023-12-28 00:09:19,493][106225] Updated weights for policy 1, policy_version 683859 (0.0009) [2023-12-28 00:09:19,558][106225] Updated weights for policy 1, policy_version 683869 (0.0007) [2023-12-28 00:09:19,618][106225] Updated weights for policy 1, policy_version 683879 (0.0008) [2023-12-28 00:09:20,021][106226] Updated weights for policy 0, policy_version 682026 (0.0011) [2023-12-28 00:09:20,078][106226] Updated weights for policy 0, policy_version 682036 (0.0011) [2023-12-28 00:09:20,139][106226] Updated weights for policy 0, policy_version 682046 (0.0011) [2023-12-28 00:09:20,375][106225] Updated weights for policy 1, policy_version 683889 (0.0009) [2023-12-28 00:09:20,429][106225] Updated weights for policy 1, policy_version 683899 (0.0008) [2023-12-28 00:09:20,487][106225] Updated weights for policy 1, policy_version 683909 (0.0009) [2023-12-28 00:09:20,803][106226] Updated weights for policy 0, policy_version 682056 (0.0009) [2023-12-28 00:09:20,863][106226] Updated weights for policy 0, policy_version 682066 (0.0008) [2023-12-28 00:09:20,928][106226] Updated weights for policy 0, policy_version 682076 (0.0008) [2023-12-28 00:09:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 18633.3). Total num frames: 349773824. Throughput: 0: 9675.0, 1: 10015.8. Samples: 349782096. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:21,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-5.589')] [2023-12-28 00:09:21,259][106225] Updated weights for policy 1, policy_version 683919 (0.0006) [2023-12-28 00:09:21,324][106225] Updated weights for policy 1, policy_version 683929 (0.0009) [2023-12-28 00:09:21,415][106225] Updated weights for policy 1, policy_version 683939 (0.0008) [2023-12-28 00:09:21,723][106226] Updated weights for policy 0, policy_version 682086 (0.0010) [2023-12-28 00:09:21,789][106226] Updated weights for policy 0, policy_version 682096 (0.0011) [2023-12-28 00:09:21,854][106226] Updated weights for policy 0, policy_version 682106 (0.0011) [2023-12-28 00:09:22,193][106225] Updated weights for policy 1, policy_version 683949 (0.0009) [2023-12-28 00:09:22,257][106225] Updated weights for policy 1, policy_version 683959 (0.0008) [2023-12-28 00:09:22,333][106225] Updated weights for policy 1, policy_version 683969 (0.0008) [2023-12-28 00:09:22,597][106226] Updated weights for policy 0, policy_version 682116 (0.0011) [2023-12-28 00:09:22,674][106226] Updated weights for policy 0, policy_version 682126 (0.0009) [2023-12-28 00:09:22,743][106226] Updated weights for policy 0, policy_version 682136 (0.0009) [2023-12-28 00:09:22,992][106225] Updated weights for policy 1, policy_version 683979 (0.0008) [2023-12-28 00:09:23,045][106225] Updated weights for policy 1, policy_version 683989 (0.0005) [2023-12-28 00:09:23,104][106225] Updated weights for policy 1, policy_version 683999 (0.0005) [2023-12-28 00:09:23,377][106226] Updated weights for policy 0, policy_version 682146 (0.0005) [2023-12-28 00:09:23,443][106226] Updated weights for policy 0, policy_version 682156 (0.0006) [2023-12-28 00:09:23,501][106226] Updated weights for policy 0, policy_version 682166 (0.0010) [2023-12-28 00:09:23,560][106226] Updated weights for policy 0, policy_version 682176 (0.0009) [2023-12-28 00:09:23,739][106225] Updated weights for policy 1, policy_version 684009 (0.0006) [2023-12-28 00:09:23,799][106225] Updated weights for policy 1, policy_version 684019 (0.0010) [2023-12-28 00:09:23,852][106225] Updated weights for policy 1, policy_version 684029 (0.0010) [2023-12-28 00:09:23,918][106225] Updated weights for policy 1, policy_version 684039 (0.0010) [2023-12-28 00:09:24,242][106226] Updated weights for policy 0, policy_version 682186 (0.0010) [2023-12-28 00:09:24,292][106226] Updated weights for policy 0, policy_version 682196 (0.0010) [2023-12-28 00:09:24,349][106226] Updated weights for policy 0, policy_version 682206 (0.0010) [2023-12-28 00:09:24,634][106225] Updated weights for policy 1, policy_version 684049 (0.0010) [2023-12-28 00:09:24,684][106225] Updated weights for policy 1, policy_version 684059 (0.0010) [2023-12-28 00:09:24,734][106225] Updated weights for policy 1, policy_version 684069 (0.0010) [2023-12-28 00:09:25,071][106226] Updated weights for policy 0, policy_version 682216 (0.0007) [2023-12-28 00:09:25,131][106226] Updated weights for policy 0, policy_version 682226 (0.0006) [2023-12-28 00:09:25,180][106226] Updated weights for policy 0, policy_version 682236 (0.0010) [2023-12-28 00:09:25,447][106225] Updated weights for policy 1, policy_version 684079 (0.0007) [2023-12-28 00:09:25,496][106225] Updated weights for policy 1, policy_version 684089 (0.0005) [2023-12-28 00:09:25,545][106225] Updated weights for policy 1, policy_version 684099 (0.0005) [2023-12-28 00:09:25,864][106226] Updated weights for policy 0, policy_version 682246 (0.0010) [2023-12-28 00:09:25,918][106226] Updated weights for policy 0, policy_version 682256 (0.0011) [2023-12-28 00:09:25,976][106226] Updated weights for policy 0, policy_version 682266 (0.0011) [2023-12-28 00:09:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 18633.3). Total num frames: 349872128. Throughput: 0: 9676.3, 1: 10029.0. Samples: 349840832. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:26,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.492')] [2023-12-28 00:09:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000682272_174710784.pth... [2023-12-28 00:09:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000681120_174415872.pth [2023-12-28 00:09:26,188][106225] Updated weights for policy 1, policy_version 684109 (0.0008) [2023-12-28 00:09:26,250][106225] Updated weights for policy 1, policy_version 684119 (0.0010) [2023-12-28 00:09:26,311][106225] Updated weights for policy 1, policy_version 684129 (0.0006) [2023-12-28 00:09:26,348][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000684136_175169536.pth... [2023-12-28 00:09:26,352][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000682952_174866432.pth [2023-12-28 00:09:26,706][106226] Updated weights for policy 0, policy_version 682276 (0.0011) [2023-12-28 00:09:26,758][106226] Updated weights for policy 0, policy_version 682286 (0.0010) [2023-12-28 00:09:26,811][106226] Updated weights for policy 0, policy_version 682296 (0.0010) [2023-12-28 00:09:26,993][106225] Updated weights for policy 1, policy_version 684139 (0.0008) [2023-12-28 00:09:27,052][106225] Updated weights for policy 1, policy_version 684149 (0.0010) [2023-12-28 00:09:27,111][106225] Updated weights for policy 1, policy_version 684159 (0.0010) [2023-12-28 00:09:27,523][106226] Updated weights for policy 0, policy_version 682306 (0.0009) [2023-12-28 00:09:27,581][106226] Updated weights for policy 0, policy_version 682316 (0.0005) [2023-12-28 00:09:27,636][106226] Updated weights for policy 0, policy_version 682326 (0.0007) [2023-12-28 00:09:27,692][106226] Updated weights for policy 0, policy_version 682336 (0.0006) [2023-12-28 00:09:27,768][106225] Updated weights for policy 1, policy_version 684169 (0.0010) [2023-12-28 00:09:27,829][106225] Updated weights for policy 1, policy_version 684179 (0.0010) [2023-12-28 00:09:27,893][106225] Updated weights for policy 1, policy_version 684189 (0.0010) [2023-12-28 00:09:27,951][106225] Updated weights for policy 1, policy_version 684199 (0.0010) [2023-12-28 00:09:28,306][106226] Updated weights for policy 0, policy_version 682346 (0.0008) [2023-12-28 00:09:28,377][106226] Updated weights for policy 0, policy_version 682356 (0.0008) [2023-12-28 00:09:28,438][106226] Updated weights for policy 0, policy_version 682366 (0.0007) [2023-12-28 00:09:28,655][106225] Updated weights for policy 1, policy_version 684209 (0.0010) [2023-12-28 00:09:28,703][106225] Updated weights for policy 1, policy_version 684219 (0.0010) [2023-12-28 00:09:28,749][106225] Updated weights for policy 1, policy_version 684229 (0.0010) [2023-12-28 00:09:29,158][106226] Updated weights for policy 0, policy_version 682376 (0.0008) [2023-12-28 00:09:29,225][106226] Updated weights for policy 0, policy_version 682386 (0.0007) [2023-12-28 00:09:29,286][106226] Updated weights for policy 0, policy_version 682396 (0.0010) [2023-12-28 00:09:29,502][106225] Updated weights for policy 1, policy_version 684239 (0.0008) [2023-12-28 00:09:29,557][106225] Updated weights for policy 1, policy_version 684249 (0.0008) [2023-12-28 00:09:29,611][106225] Updated weights for policy 1, policy_version 684259 (0.0007) [2023-12-28 00:09:29,910][106226] Updated weights for policy 0, policy_version 682406 (0.0010) [2023-12-28 00:09:29,973][106226] Updated weights for policy 0, policy_version 682416 (0.0010) [2023-12-28 00:09:30,027][106226] Updated weights for policy 0, policy_version 682426 (0.0010) [2023-12-28 00:09:30,399][106225] Updated weights for policy 1, policy_version 684269 (0.0008) [2023-12-28 00:09:30,453][106225] Updated weights for policy 1, policy_version 684279 (0.0008) [2023-12-28 00:09:30,514][106225] Updated weights for policy 1, policy_version 684289 (0.0008) [2023-12-28 00:09:30,730][106226] Updated weights for policy 0, policy_version 682436 (0.0008) [2023-12-28 00:09:30,796][106226] Updated weights for policy 0, policy_version 682446 (0.0010) [2023-12-28 00:09:30,859][106226] Updated weights for policy 0, policy_version 682456 (0.0010) [2023-12-28 00:09:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 18688.9). Total num frames: 349970432. Throughput: 0: 9811.9, 1: 10098.7. Samples: 349960032. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:31,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.345')] [2023-12-28 00:09:31,191][106225] Updated weights for policy 1, policy_version 684299 (0.0007) [2023-12-28 00:09:31,260][106225] Updated weights for policy 1, policy_version 684309 (0.0006) [2023-12-28 00:09:31,332][106225] Updated weights for policy 1, policy_version 684319 (0.0007) [2023-12-28 00:09:31,577][106226] Updated weights for policy 0, policy_version 682466 (0.0011) [2023-12-28 00:09:31,644][106226] Updated weights for policy 0, policy_version 682476 (0.0011) [2023-12-28 00:09:31,702][106226] Updated weights for policy 0, policy_version 682486 (0.0011) [2023-12-28 00:09:31,774][106226] Updated weights for policy 0, policy_version 682496 (0.0010) [2023-12-28 00:09:32,043][106225] Updated weights for policy 1, policy_version 684329 (0.0008) [2023-12-28 00:09:32,104][106225] Updated weights for policy 1, policy_version 684339 (0.0008) [2023-12-28 00:09:32,154][106225] Updated weights for policy 1, policy_version 684349 (0.0008) [2023-12-28 00:09:32,211][106225] Updated weights for policy 1, policy_version 684359 (0.0008) [2023-12-28 00:09:32,494][106226] Updated weights for policy 0, policy_version 682506 (0.0009) [2023-12-28 00:09:32,547][106226] Updated weights for policy 0, policy_version 682516 (0.0009) [2023-12-28 00:09:32,606][106226] Updated weights for policy 0, policy_version 682526 (0.0008) [2023-12-28 00:09:32,963][106225] Updated weights for policy 1, policy_version 684369 (0.0008) [2023-12-28 00:09:33,025][106225] Updated weights for policy 1, policy_version 684379 (0.0007) [2023-12-28 00:09:33,074][106225] Updated weights for policy 1, policy_version 684389 (0.0005) [2023-12-28 00:09:33,350][106226] Updated weights for policy 0, policy_version 682536 (0.0009) [2023-12-28 00:09:33,395][106226] Updated weights for policy 0, policy_version 682546 (0.0008) [2023-12-28 00:09:33,443][106226] Updated weights for policy 0, policy_version 682556 (0.0008) [2023-12-28 00:09:33,764][106225] Updated weights for policy 1, policy_version 684399 (0.0009) [2023-12-28 00:09:33,817][106225] Updated weights for policy 1, policy_version 684409 (0.0009) [2023-12-28 00:09:33,878][106225] Updated weights for policy 1, policy_version 684419 (0.0009) [2023-12-28 00:09:34,095][106226] Updated weights for policy 0, policy_version 682566 (0.0009) [2023-12-28 00:09:34,157][106226] Updated weights for policy 0, policy_version 682576 (0.0009) [2023-12-28 00:09:34,220][106226] Updated weights for policy 0, policy_version 682586 (0.0006) [2023-12-28 00:09:34,566][106225] Updated weights for policy 1, policy_version 684429 (0.0009) [2023-12-28 00:09:34,629][106225] Updated weights for policy 1, policy_version 684439 (0.0006) [2023-12-28 00:09:34,684][106225] Updated weights for policy 1, policy_version 684449 (0.0006) [2023-12-28 00:09:34,941][106226] Updated weights for policy 0, policy_version 682596 (0.0008) [2023-12-28 00:09:35,007][106226] Updated weights for policy 0, policy_version 682606 (0.0007) [2023-12-28 00:09:35,064][106226] Updated weights for policy 0, policy_version 682616 (0.0009) [2023-12-28 00:09:35,385][106225] Updated weights for policy 1, policy_version 684459 (0.0008) [2023-12-28 00:09:35,446][106225] Updated weights for policy 1, policy_version 684469 (0.0009) [2023-12-28 00:09:35,500][106225] Updated weights for policy 1, policy_version 684479 (0.0008) [2023-12-28 00:09:35,720][106226] Updated weights for policy 0, policy_version 682626 (0.0008) [2023-12-28 00:09:35,773][106226] Updated weights for policy 0, policy_version 682636 (0.0009) [2023-12-28 00:09:35,831][106226] Updated weights for policy 0, policy_version 682646 (0.0008) [2023-12-28 00:09:35,896][106226] Updated weights for policy 0, policy_version 682656 (0.0009) [2023-12-28 00:09:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 18688.9). Total num frames: 350068736. Throughput: 0: 9933.1, 1: 10062.8. Samples: 350078300. Policy #0 lag: (min: 25.0, avg: 44.7, max: 57.0) [2023-12-28 00:09:36,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-5.418')] [2023-12-28 00:09:36,249][106225] Updated weights for policy 1, policy_version 684489 (0.0008) [2023-12-28 00:09:36,307][106225] Updated weights for policy 1, policy_version 684499 (0.0008) [2023-12-28 00:09:36,363][106225] Updated weights for policy 1, policy_version 684509 (0.0007) [2023-12-28 00:09:36,422][106225] Updated weights for policy 1, policy_version 684519 (0.0006) [2023-12-28 00:09:36,575][106226] Updated weights for policy 0, policy_version 682666 (0.0011) [2023-12-28 00:09:36,637][106226] Updated weights for policy 0, policy_version 682676 (0.0011) [2023-12-28 00:09:36,697][106226] Updated weights for policy 0, policy_version 682686 (0.0011) [2023-12-28 00:09:37,149][106225] Updated weights for policy 1, policy_version 684529 (0.0008) [2023-12-28 00:09:37,204][106225] Updated weights for policy 1, policy_version 684539 (0.0008) [2023-12-28 00:09:37,261][106225] Updated weights for policy 1, policy_version 684549 (0.0008) [2023-12-28 00:09:37,383][106226] Updated weights for policy 0, policy_version 682696 (0.0011) [2023-12-28 00:09:37,444][106226] Updated weights for policy 0, policy_version 682706 (0.0011) [2023-12-28 00:09:37,494][106226] Updated weights for policy 0, policy_version 682716 (0.0010) [2023-12-28 00:09:37,952][106225] Updated weights for policy 1, policy_version 684559 (0.0007) [2023-12-28 00:09:38,015][106225] Updated weights for policy 1, policy_version 684569 (0.0010) [2023-12-28 00:09:38,076][106225] Updated weights for policy 1, policy_version 684579 (0.0009) [2023-12-28 00:09:38,182][106226] Updated weights for policy 0, policy_version 682726 (0.0010) [2023-12-28 00:09:38,243][106226] Updated weights for policy 0, policy_version 682736 (0.0006) [2023-12-28 00:09:38,300][106226] Updated weights for policy 0, policy_version 682746 (0.0005) [2023-12-28 00:09:38,853][106225] Updated weights for policy 1, policy_version 684589 (0.0007) [2023-12-28 00:09:38,912][106225] Updated weights for policy 1, policy_version 684599 (0.0006) [2023-12-28 00:09:38,973][106225] Updated weights for policy 1, policy_version 684609 (0.0008) [2023-12-28 00:09:38,992][106226] Updated weights for policy 0, policy_version 682756 (0.0008) [2023-12-28 00:09:39,049][106226] Updated weights for policy 0, policy_version 682766 (0.0011) [2023-12-28 00:09:39,118][106226] Updated weights for policy 0, policy_version 682776 (0.0011) [2023-12-28 00:09:39,649][106225] Updated weights for policy 1, policy_version 684619 (0.0007) [2023-12-28 00:09:39,714][106225] Updated weights for policy 1, policy_version 684629 (0.0008) [2023-12-28 00:09:39,776][106225] Updated weights for policy 1, policy_version 684639 (0.0007) [2023-12-28 00:09:39,883][106226] Updated weights for policy 0, policy_version 682786 (0.0010) [2023-12-28 00:09:39,948][106226] Updated weights for policy 0, policy_version 682796 (0.0007) [2023-12-28 00:09:40,015][106226] Updated weights for policy 0, policy_version 682806 (0.0008) [2023-12-28 00:09:40,074][106226] Updated weights for policy 0, policy_version 682816 (0.0008) [2023-12-28 00:09:40,473][106225] Updated weights for policy 1, policy_version 684649 (0.0007) [2023-12-28 00:09:40,531][106225] Updated weights for policy 1, policy_version 684659 (0.0006) [2023-12-28 00:09:40,583][106225] Updated weights for policy 1, policy_version 684669 (0.0006) [2023-12-28 00:09:40,640][106225] Updated weights for policy 1, policy_version 684679 (0.0006) [2023-12-28 00:09:40,837][106226] Updated weights for policy 0, policy_version 682826 (0.0008) [2023-12-28 00:09:40,900][106226] Updated weights for policy 0, policy_version 682836 (0.0009) [2023-12-28 00:09:40,952][106226] Updated weights for policy 0, policy_version 682846 (0.0008) [2023-12-28 00:09:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 18716.6). Total num frames: 350167040. Throughput: 0: 9937.8, 1: 9987.0. Samples: 350136740. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:09:41,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.572')] [2023-12-28 00:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000684680_175308800.pth... [2023-12-28 00:09:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000682848_174858240.pth... [2023-12-28 00:09:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000683560_175022080.pth [2023-12-28 00:09:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000681696_174563328.pth [2023-12-28 00:09:41,280][106225] Updated weights for policy 1, policy_version 684689 (0.0008) [2023-12-28 00:09:41,342][106225] Updated weights for policy 1, policy_version 684699 (0.0006) [2023-12-28 00:09:41,415][106225] Updated weights for policy 1, policy_version 684709 (0.0008) [2023-12-28 00:09:41,816][106226] Updated weights for policy 0, policy_version 682856 (0.0009) [2023-12-28 00:09:41,876][106226] Updated weights for policy 0, policy_version 682866 (0.0009) [2023-12-28 00:09:41,942][106226] Updated weights for policy 0, policy_version 682876 (0.0008) [2023-12-28 00:09:42,232][106225] Updated weights for policy 1, policy_version 684719 (0.0008) [2023-12-28 00:09:42,299][106225] Updated weights for policy 1, policy_version 684729 (0.0008) [2023-12-28 00:09:42,368][106225] Updated weights for policy 1, policy_version 684739 (0.0009) [2023-12-28 00:09:42,641][106226] Updated weights for policy 0, policy_version 682886 (0.0009) [2023-12-28 00:09:42,697][106226] Updated weights for policy 0, policy_version 682896 (0.0008) [2023-12-28 00:09:42,761][106226] Updated weights for policy 0, policy_version 682906 (0.0009) [2023-12-28 00:09:43,096][106225] Updated weights for policy 1, policy_version 684749 (0.0008) [2023-12-28 00:09:43,158][106225] Updated weights for policy 1, policy_version 684759 (0.0008) [2023-12-28 00:09:43,221][106225] Updated weights for policy 1, policy_version 684769 (0.0008) [2023-12-28 00:09:43,534][106226] Updated weights for policy 0, policy_version 682916 (0.0009) [2023-12-28 00:09:43,581][106226] Updated weights for policy 0, policy_version 682926 (0.0010) [2023-12-28 00:09:43,625][106226] Updated weights for policy 0, policy_version 682936 (0.0010) [2023-12-28 00:09:43,920][106225] Updated weights for policy 1, policy_version 684779 (0.0007) [2023-12-28 00:09:43,966][106225] Updated weights for policy 1, policy_version 684789 (0.0007) [2023-12-28 00:09:44,013][106225] Updated weights for policy 1, policy_version 684799 (0.0008) [2023-12-28 00:09:44,348][106226] Updated weights for policy 0, policy_version 682946 (0.0010) [2023-12-28 00:09:44,394][106226] Updated weights for policy 0, policy_version 682956 (0.0010) [2023-12-28 00:09:44,450][106226] Updated weights for policy 0, policy_version 682966 (0.0011) [2023-12-28 00:09:44,500][106226] Updated weights for policy 0, policy_version 682976 (0.0010) [2023-12-28 00:09:44,762][106225] Updated weights for policy 1, policy_version 684809 (0.0008) [2023-12-28 00:09:44,829][106225] Updated weights for policy 1, policy_version 684819 (0.0006) [2023-12-28 00:09:44,893][106225] Updated weights for policy 1, policy_version 684829 (0.0008) [2023-12-28 00:09:44,964][106225] Updated weights for policy 1, policy_version 684839 (0.0008) [2023-12-28 00:09:45,223][106226] Updated weights for policy 0, policy_version 682986 (0.0009) [2023-12-28 00:09:45,287][106226] Updated weights for policy 0, policy_version 682996 (0.0009) [2023-12-28 00:09:45,345][106226] Updated weights for policy 0, policy_version 683006 (0.0008) [2023-12-28 00:09:45,702][106225] Updated weights for policy 1, policy_version 684849 (0.0010) [2023-12-28 00:09:45,761][106225] Updated weights for policy 1, policy_version 684859 (0.0008) [2023-12-28 00:09:45,812][106225] Updated weights for policy 1, policy_version 684869 (0.0008) [2023-12-28 00:09:46,000][106226] Updated weights for policy 0, policy_version 683016 (0.0008) [2023-12-28 00:09:46,059][106226] Updated weights for policy 0, policy_version 683026 (0.0008) [2023-12-28 00:09:46,118][106226] Updated weights for policy 0, policy_version 683036 (0.0009) [2023-12-28 00:09:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 18744.4). Total num frames: 350265344. Throughput: 0: 9839.4, 1: 9868.3. Samples: 350251276. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:09:46,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-5.449')] [2023-12-28 00:09:46,459][106225] Updated weights for policy 1, policy_version 684879 (0.0009) [2023-12-28 00:09:46,515][106225] Updated weights for policy 1, policy_version 684889 (0.0008) [2023-12-28 00:09:46,560][106225] Updated weights for policy 1, policy_version 684899 (0.0008) [2023-12-28 00:09:46,876][106226] Updated weights for policy 0, policy_version 683046 (0.0008) [2023-12-28 00:09:46,921][106226] Updated weights for policy 0, policy_version 683056 (0.0007) [2023-12-28 00:09:46,977][106226] Updated weights for policy 0, policy_version 683066 (0.0009) [2023-12-28 00:09:47,300][106225] Updated weights for policy 1, policy_version 684909 (0.0010) [2023-12-28 00:09:47,363][106225] Updated weights for policy 1, policy_version 684919 (0.0006) [2023-12-28 00:09:47,426][106225] Updated weights for policy 1, policy_version 684929 (0.0005) [2023-12-28 00:09:47,682][106226] Updated weights for policy 0, policy_version 683076 (0.0007) [2023-12-28 00:09:47,745][106226] Updated weights for policy 0, policy_version 683086 (0.0005) [2023-12-28 00:09:47,810][106226] Updated weights for policy 0, policy_version 683096 (0.0009) [2023-12-28 00:09:48,033][106225] Updated weights for policy 1, policy_version 684939 (0.0005) [2023-12-28 00:09:48,085][106225] Updated weights for policy 1, policy_version 684949 (0.0005) [2023-12-28 00:09:48,141][106225] Updated weights for policy 1, policy_version 684959 (0.0010) [2023-12-28 00:09:48,442][106226] Updated weights for policy 0, policy_version 683106 (0.0011) [2023-12-28 00:09:48,494][106226] Updated weights for policy 0, policy_version 683116 (0.0009) [2023-12-28 00:09:48,554][106226] Updated weights for policy 0, policy_version 683126 (0.0005) [2023-12-28 00:09:48,617][106226] Updated weights for policy 0, policy_version 683136 (0.0008) [2023-12-28 00:09:48,859][106225] Updated weights for policy 1, policy_version 684969 (0.0010) [2023-12-28 00:09:48,916][106225] Updated weights for policy 1, policy_version 684979 (0.0010) [2023-12-28 00:09:48,975][106225] Updated weights for policy 1, policy_version 684989 (0.0011) [2023-12-28 00:09:49,040][106225] Updated weights for policy 1, policy_version 684999 (0.0011) [2023-12-28 00:09:49,189][106226] Updated weights for policy 0, policy_version 683146 (0.0007) [2023-12-28 00:09:49,271][106226] Updated weights for policy 0, policy_version 683156 (0.0011) [2023-12-28 00:09:49,338][106226] Updated weights for policy 0, policy_version 683166 (0.0011) [2023-12-28 00:09:49,807][106225] Updated weights for policy 1, policy_version 685009 (0.0009) [2023-12-28 00:09:49,875][106225] Updated weights for policy 1, policy_version 685019 (0.0007) [2023-12-28 00:09:49,929][106225] Updated weights for policy 1, policy_version 685029 (0.0008) [2023-12-28 00:09:50,070][106226] Updated weights for policy 0, policy_version 683176 (0.0009) [2023-12-28 00:09:50,131][106226] Updated weights for policy 0, policy_version 683186 (0.0011) [2023-12-28 00:09:50,185][106226] Updated weights for policy 0, policy_version 683196 (0.0011) [2023-12-28 00:09:50,635][106225] Updated weights for policy 1, policy_version 685039 (0.0010) [2023-12-28 00:09:50,698][106225] Updated weights for policy 1, policy_version 685049 (0.0009) [2023-12-28 00:09:50,760][106225] Updated weights for policy 1, policy_version 685059 (0.0010) [2023-12-28 00:09:50,945][106226] Updated weights for policy 0, policy_version 683206 (0.0010) [2023-12-28 00:09:50,998][106226] Updated weights for policy 0, policy_version 683216 (0.0009) [2023-12-28 00:09:51,078][106226] Updated weights for policy 0, policy_version 683226 (0.0009) [2023-12-28 00:09:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 18744.4). Total num frames: 350363648. Throughput: 0: 9769.2, 1: 9755.0. Samples: 350369856. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:09:51,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-5.496')] [2023-12-28 00:09:51,536][106225] Updated weights for policy 1, policy_version 685069 (0.0009) [2023-12-28 00:09:51,589][106225] Updated weights for policy 1, policy_version 685079 (0.0008) [2023-12-28 00:09:51,651][106225] Updated weights for policy 1, policy_version 685089 (0.0008) [2023-12-28 00:09:51,870][106226] Updated weights for policy 0, policy_version 683236 (0.0009) [2023-12-28 00:09:51,934][106226] Updated weights for policy 0, policy_version 683246 (0.0008) [2023-12-28 00:09:51,993][106226] Updated weights for policy 0, policy_version 683256 (0.0008) [2023-12-28 00:09:52,394][106225] Updated weights for policy 1, policy_version 685099 (0.0009) [2023-12-28 00:09:52,453][106225] Updated weights for policy 1, policy_version 685109 (0.0009) [2023-12-28 00:09:52,516][106225] Updated weights for policy 1, policy_version 685119 (0.0008) [2023-12-28 00:09:52,703][106226] Updated weights for policy 0, policy_version 683266 (0.0008) [2023-12-28 00:09:52,759][106226] Updated weights for policy 0, policy_version 683276 (0.0005) [2023-12-28 00:09:52,820][106226] Updated weights for policy 0, policy_version 683286 (0.0006) [2023-12-28 00:09:52,878][106226] Updated weights for policy 0, policy_version 683296 (0.0006) [2023-12-28 00:09:53,250][106225] Updated weights for policy 1, policy_version 685129 (0.0009) [2023-12-28 00:09:53,315][106225] Updated weights for policy 1, policy_version 685139 (0.0006) [2023-12-28 00:09:53,379][106225] Updated weights for policy 1, policy_version 685149 (0.0009) [2023-12-28 00:09:53,441][106225] Updated weights for policy 1, policy_version 685159 (0.0009) [2023-12-28 00:09:53,564][106226] Updated weights for policy 0, policy_version 683306 (0.0008) [2023-12-28 00:09:53,623][106226] Updated weights for policy 0, policy_version 683316 (0.0009) [2023-12-28 00:09:53,676][106226] Updated weights for policy 0, policy_version 683326 (0.0008) [2023-12-28 00:09:54,083][106225] Updated weights for policy 1, policy_version 685169 (0.0006) [2023-12-28 00:09:54,150][106225] Updated weights for policy 1, policy_version 685179 (0.0008) [2023-12-28 00:09:54,211][106225] Updated weights for policy 1, policy_version 685189 (0.0007) [2023-12-28 00:09:54,365][106226] Updated weights for policy 0, policy_version 683336 (0.0010) [2023-12-28 00:09:54,428][106226] Updated weights for policy 0, policy_version 683346 (0.0011) [2023-12-28 00:09:54,490][106226] Updated weights for policy 0, policy_version 683356 (0.0011) [2023-12-28 00:09:54,862][106225] Updated weights for policy 1, policy_version 685199 (0.0006) [2023-12-28 00:09:54,919][106225] Updated weights for policy 1, policy_version 685209 (0.0005) [2023-12-28 00:09:54,975][106225] Updated weights for policy 1, policy_version 685219 (0.0005) [2023-12-28 00:09:55,178][106226] Updated weights for policy 0, policy_version 683366 (0.0011) [2023-12-28 00:09:55,231][106226] Updated weights for policy 0, policy_version 683376 (0.0010) [2023-12-28 00:09:55,278][106226] Updated weights for policy 0, policy_version 683386 (0.0009) [2023-12-28 00:09:55,598][106225] Updated weights for policy 1, policy_version 685229 (0.0008) [2023-12-28 00:09:55,652][106225] Updated weights for policy 1, policy_version 685239 (0.0005) [2023-12-28 00:09:55,698][106225] Updated weights for policy 1, policy_version 685249 (0.0005) [2023-12-28 00:09:55,902][106226] Updated weights for policy 0, policy_version 683396 (0.0008) [2023-12-28 00:09:55,953][106226] Updated weights for policy 0, policy_version 683406 (0.0008) [2023-12-28 00:09:56,001][106226] Updated weights for policy 0, policy_version 683416 (0.0011) [2023-12-28 00:09:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 18744.4). Total num frames: 350461952. Throughput: 0: 9755.7, 1: 9713.0. Samples: 350426584. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:09:56,176][105115] Avg episode reward: [(0, '-4.439'), (1, '-5.576')] [2023-12-28 00:09:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000685256_175456256.pth... [2023-12-28 00:09:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000683424_175005696.pth... [2023-12-28 00:09:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000684136_175169536.pth [2023-12-28 00:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000682272_174710784.pth [2023-12-28 00:09:56,370][106225] Updated weights for policy 1, policy_version 685259 (0.0009) [2023-12-28 00:09:56,431][106225] Updated weights for policy 1, policy_version 685269 (0.0008) [2023-12-28 00:09:56,492][106225] Updated weights for policy 1, policy_version 685279 (0.0006) [2023-12-28 00:09:56,674][106226] Updated weights for policy 0, policy_version 683426 (0.0010) [2023-12-28 00:09:56,740][106226] Updated weights for policy 0, policy_version 683436 (0.0010) [2023-12-28 00:09:56,801][106226] Updated weights for policy 0, policy_version 683446 (0.0010) [2023-12-28 00:09:56,854][106226] Updated weights for policy 0, policy_version 683456 (0.0010) [2023-12-28 00:09:57,055][106225] Updated weights for policy 1, policy_version 685289 (0.0005) [2023-12-28 00:09:57,110][106225] Updated weights for policy 1, policy_version 685299 (0.0005) [2023-12-28 00:09:57,166][106225] Updated weights for policy 1, policy_version 685309 (0.0005) [2023-12-28 00:09:57,230][106225] Updated weights for policy 1, policy_version 685319 (0.0005) [2023-12-28 00:09:57,509][106226] Updated weights for policy 0, policy_version 683466 (0.0005) [2023-12-28 00:09:57,556][106226] Updated weights for policy 0, policy_version 683476 (0.0005) [2023-12-28 00:09:57,602][106226] Updated weights for policy 0, policy_version 683486 (0.0005) [2023-12-28 00:09:57,861][106225] Updated weights for policy 1, policy_version 685329 (0.0009) [2023-12-28 00:09:57,920][106225] Updated weights for policy 1, policy_version 685339 (0.0010) [2023-12-28 00:09:57,970][106225] Updated weights for policy 1, policy_version 685349 (0.0010) [2023-12-28 00:09:58,187][106226] Updated weights for policy 0, policy_version 683496 (0.0009) [2023-12-28 00:09:58,256][106226] Updated weights for policy 0, policy_version 683506 (0.0012) [2023-12-28 00:09:58,321][106226] Updated weights for policy 0, policy_version 683516 (0.0010) [2023-12-28 00:09:58,745][106225] Updated weights for policy 1, policy_version 685359 (0.0008) [2023-12-28 00:09:58,817][106225] Updated weights for policy 1, policy_version 685369 (0.0007) [2023-12-28 00:09:58,883][106225] Updated weights for policy 1, policy_version 685379 (0.0007) [2023-12-28 00:09:59,109][106226] Updated weights for policy 0, policy_version 683526 (0.0009) [2023-12-28 00:09:59,170][106226] Updated weights for policy 0, policy_version 683536 (0.0011) [2023-12-28 00:09:59,239][106226] Updated weights for policy 0, policy_version 683546 (0.0011) [2023-12-28 00:09:59,714][106225] Updated weights for policy 1, policy_version 685389 (0.0009) [2023-12-28 00:09:59,758][106225] Updated weights for policy 1, policy_version 685399 (0.0008) [2023-12-28 00:09:59,806][106225] Updated weights for policy 1, policy_version 685409 (0.0009) [2023-12-28 00:09:59,898][106226] Updated weights for policy 0, policy_version 683556 (0.0008) [2023-12-28 00:09:59,959][106226] Updated weights for policy 0, policy_version 683566 (0.0009) [2023-12-28 00:10:00,010][106226] Updated weights for policy 0, policy_version 683576 (0.0009) [2023-12-28 00:10:00,519][106225] Updated weights for policy 1, policy_version 685419 (0.0006) [2023-12-28 00:10:00,567][106225] Updated weights for policy 1, policy_version 685429 (0.0007) [2023-12-28 00:10:00,623][106225] Updated weights for policy 1, policy_version 685439 (0.0011) [2023-12-28 00:10:00,749][106226] Updated weights for policy 0, policy_version 683586 (0.0008) [2023-12-28 00:10:00,816][106226] Updated weights for policy 0, policy_version 683596 (0.0006) [2023-12-28 00:10:00,873][106226] Updated weights for policy 0, policy_version 683606 (0.0007) [2023-12-28 00:10:00,937][106226] Updated weights for policy 0, policy_version 683616 (0.0009) [2023-12-28 00:10:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 18800.0). Total num frames: 350560256. Throughput: 0: 9843.9, 1: 9785.2. Samples: 350549464. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:01,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.450')] [2023-12-28 00:10:01,366][106225] Updated weights for policy 1, policy_version 685449 (0.0010) [2023-12-28 00:10:01,436][106225] Updated weights for policy 1, policy_version 685459 (0.0007) [2023-12-28 00:10:01,496][106225] Updated weights for policy 1, policy_version 685469 (0.0006) [2023-12-28 00:10:01,555][106225] Updated weights for policy 1, policy_version 685479 (0.0008) [2023-12-28 00:10:01,712][106226] Updated weights for policy 0, policy_version 683626 (0.0008) [2023-12-28 00:10:01,776][106226] Updated weights for policy 0, policy_version 683636 (0.0009) [2023-12-28 00:10:01,846][106226] Updated weights for policy 0, policy_version 683646 (0.0007) [2023-12-28 00:10:02,163][106225] Updated weights for policy 1, policy_version 685489 (0.0005) [2023-12-28 00:10:02,212][106225] Updated weights for policy 1, policy_version 685499 (0.0005) [2023-12-28 00:10:02,277][106225] Updated weights for policy 1, policy_version 685509 (0.0007) [2023-12-28 00:10:02,516][106226] Updated weights for policy 0, policy_version 683656 (0.0007) [2023-12-28 00:10:02,571][106226] Updated weights for policy 0, policy_version 683666 (0.0009) [2023-12-28 00:10:02,622][106226] Updated weights for policy 0, policy_version 683676 (0.0009) [2023-12-28 00:10:03,069][106225] Updated weights for policy 1, policy_version 685519 (0.0008) [2023-12-28 00:10:03,126][106225] Updated weights for policy 1, policy_version 685529 (0.0005) [2023-12-28 00:10:03,173][106225] Updated weights for policy 1, policy_version 685539 (0.0009) [2023-12-28 00:10:03,230][106226] Updated weights for policy 0, policy_version 683686 (0.0009) [2023-12-28 00:10:03,285][106226] Updated weights for policy 0, policy_version 683696 (0.0009) [2023-12-28 00:10:03,346][106226] Updated weights for policy 0, policy_version 683706 (0.0008) [2023-12-28 00:10:03,883][106225] Updated weights for policy 1, policy_version 685549 (0.0009) [2023-12-28 00:10:03,940][106225] Updated weights for policy 1, policy_version 685559 (0.0010) [2023-12-28 00:10:03,995][106225] Updated weights for policy 1, policy_version 685569 (0.0010) [2023-12-28 00:10:04,111][106226] Updated weights for policy 0, policy_version 683716 (0.0008) [2023-12-28 00:10:04,163][106226] Updated weights for policy 0, policy_version 683726 (0.0008) [2023-12-28 00:10:04,223][106226] Updated weights for policy 0, policy_version 683736 (0.0008) [2023-12-28 00:10:04,720][106225] Updated weights for policy 1, policy_version 685579 (0.0010) [2023-12-28 00:10:04,769][106225] Updated weights for policy 1, policy_version 685589 (0.0010) [2023-12-28 00:10:04,819][106225] Updated weights for policy 1, policy_version 685599 (0.0010) [2023-12-28 00:10:04,981][106226] Updated weights for policy 0, policy_version 683746 (0.0009) [2023-12-28 00:10:05,033][106226] Updated weights for policy 0, policy_version 683756 (0.0009) [2023-12-28 00:10:05,095][106226] Updated weights for policy 0, policy_version 683766 (0.0008) [2023-12-28 00:10:05,148][106226] Updated weights for policy 0, policy_version 683776 (0.0008) [2023-12-28 00:10:05,468][106225] Updated weights for policy 1, policy_version 685609 (0.0010) [2023-12-28 00:10:05,514][106225] Updated weights for policy 1, policy_version 685619 (0.0010) [2023-12-28 00:10:05,570][106225] Updated weights for policy 1, policy_version 685629 (0.0010) [2023-12-28 00:10:05,620][106225] Updated weights for policy 1, policy_version 685639 (0.0010) [2023-12-28 00:10:05,907][106226] Updated weights for policy 0, policy_version 683786 (0.0006) [2023-12-28 00:10:05,954][106226] Updated weights for policy 0, policy_version 683796 (0.0005) [2023-12-28 00:10:06,002][106226] Updated weights for policy 0, policy_version 683806 (0.0007) [2023-12-28 00:10:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 18799.9). Total num frames: 350658560. Throughput: 0: 9839.3, 1: 9846.4. Samples: 350667952. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:06,176][105115] Avg episode reward: [(0, '-4.587'), (1, '-5.559')] [2023-12-28 00:10:06,332][106225] Updated weights for policy 1, policy_version 685649 (0.0006) [2023-12-28 00:10:06,397][106225] Updated weights for policy 1, policy_version 685659 (0.0008) [2023-12-28 00:10:06,464][106225] Updated weights for policy 1, policy_version 685669 (0.0009) [2023-12-28 00:10:06,713][106226] Updated weights for policy 0, policy_version 683816 (0.0007) [2023-12-28 00:10:06,779][106226] Updated weights for policy 0, policy_version 683826 (0.0009) [2023-12-28 00:10:06,837][106226] Updated weights for policy 0, policy_version 683836 (0.0008) [2023-12-28 00:10:07,153][106225] Updated weights for policy 1, policy_version 685679 (0.0008) [2023-12-28 00:10:07,206][106225] Updated weights for policy 1, policy_version 685689 (0.0008) [2023-12-28 00:10:07,262][106225] Updated weights for policy 1, policy_version 685699 (0.0005) [2023-12-28 00:10:07,618][106226] Updated weights for policy 0, policy_version 683846 (0.0009) [2023-12-28 00:10:07,672][106226] Updated weights for policy 0, policy_version 683856 (0.0008) [2023-12-28 00:10:07,729][106226] Updated weights for policy 0, policy_version 683866 (0.0008) [2023-12-28 00:10:07,914][106225] Updated weights for policy 1, policy_version 685709 (0.0007) [2023-12-28 00:10:07,969][106225] Updated weights for policy 1, policy_version 685719 (0.0008) [2023-12-28 00:10:08,037][106225] Updated weights for policy 1, policy_version 685729 (0.0006) [2023-12-28 00:10:08,414][106226] Updated weights for policy 0, policy_version 683876 (0.0008) [2023-12-28 00:10:08,468][106226] Updated weights for policy 0, policy_version 683886 (0.0009) [2023-12-28 00:10:08,518][106226] Updated weights for policy 0, policy_version 683896 (0.0008) [2023-12-28 00:10:08,645][106225] Updated weights for policy 1, policy_version 685739 (0.0006) [2023-12-28 00:10:08,695][106225] Updated weights for policy 1, policy_version 685749 (0.0008) [2023-12-28 00:10:08,746][106225] Updated weights for policy 1, policy_version 685759 (0.0007) [2023-12-28 00:10:09,280][106226] Updated weights for policy 0, policy_version 683906 (0.0009) [2023-12-28 00:10:09,334][106226] Updated weights for policy 0, policy_version 683916 (0.0009) [2023-12-28 00:10:09,405][106226] Updated weights for policy 0, policy_version 683926 (0.0008) [2023-12-28 00:10:09,479][106226] Updated weights for policy 0, policy_version 683936 (0.0008) [2023-12-28 00:10:09,500][106225] Updated weights for policy 1, policy_version 685769 (0.0007) [2023-12-28 00:10:09,560][106225] Updated weights for policy 1, policy_version 685779 (0.0009) [2023-12-28 00:10:09,619][106225] Updated weights for policy 1, policy_version 685789 (0.0008) [2023-12-28 00:10:09,668][106225] Updated weights for policy 1, policy_version 685799 (0.0007) [2023-12-28 00:10:10,185][106226] Updated weights for policy 0, policy_version 683946 (0.0007) [2023-12-28 00:10:10,247][106226] Updated weights for policy 0, policy_version 683956 (0.0006) [2023-12-28 00:10:10,313][106226] Updated weights for policy 0, policy_version 683966 (0.0006) [2023-12-28 00:10:10,427][106225] Updated weights for policy 1, policy_version 685809 (0.0007) [2023-12-28 00:10:10,490][106225] Updated weights for policy 1, policy_version 685819 (0.0005) [2023-12-28 00:10:10,546][106225] Updated weights for policy 1, policy_version 685829 (0.0005) [2023-12-28 00:10:10,954][106226] Updated weights for policy 0, policy_version 683976 (0.0006) [2023-12-28 00:10:11,006][106226] Updated weights for policy 0, policy_version 683986 (0.0005) [2023-12-28 00:10:11,067][106226] Updated weights for policy 0, policy_version 683996 (0.0008) [2023-12-28 00:10:11,100][106225] Updated weights for policy 1, policy_version 685839 (0.0007) [2023-12-28 00:10:11,167][106225] Updated weights for policy 1, policy_version 685849 (0.0008) [2023-12-28 00:10:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 18855.5). Total num frames: 350756864. Throughput: 0: 9833.8, 1: 9876.1. Samples: 350727776. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:11,175][105115] Avg episode reward: [(0, '-4.232'), (1, '-5.574')] [2023-12-28 00:10:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000684000_175153152.pth... [2023-12-28 00:10:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000682848_174858240.pth [2023-12-28 00:10:11,229][106225] Updated weights for policy 1, policy_version 685859 (0.0008) [2023-12-28 00:10:11,262][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000685864_175611904.pth... [2023-12-28 00:10:11,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000684680_175308800.pth [2023-12-28 00:10:11,843][106226] Updated weights for policy 0, policy_version 684006 (0.0008) [2023-12-28 00:10:11,911][106226] Updated weights for policy 0, policy_version 684016 (0.0008) [2023-12-28 00:10:11,974][106226] Updated weights for policy 0, policy_version 684026 (0.0008) [2023-12-28 00:10:12,001][106225] Updated weights for policy 1, policy_version 685869 (0.0010) [2023-12-28 00:10:12,064][106225] Updated weights for policy 1, policy_version 685879 (0.0008) [2023-12-28 00:10:12,130][106225] Updated weights for policy 1, policy_version 685889 (0.0007) [2023-12-28 00:10:12,756][106226] Updated weights for policy 0, policy_version 684036 (0.0008) [2023-12-28 00:10:12,826][106226] Updated weights for policy 0, policy_version 684046 (0.0009) [2023-12-28 00:10:12,870][106225] Updated weights for policy 1, policy_version 685899 (0.0007) [2023-12-28 00:10:12,894][106226] Updated weights for policy 0, policy_version 684056 (0.0010) [2023-12-28 00:10:12,934][106225] Updated weights for policy 1, policy_version 685909 (0.0006) [2023-12-28 00:10:12,994][106225] Updated weights for policy 1, policy_version 685919 (0.0008) [2023-12-28 00:10:13,538][106226] Updated weights for policy 0, policy_version 684066 (0.0008) [2023-12-28 00:10:13,608][106226] Updated weights for policy 0, policy_version 684076 (0.0009) [2023-12-28 00:10:13,669][106226] Updated weights for policy 0, policy_version 684086 (0.0008) [2023-12-28 00:10:13,680][106225] Updated weights for policy 1, policy_version 685929 (0.0008) [2023-12-28 00:10:13,733][106226] Updated weights for policy 0, policy_version 684096 (0.0009) [2023-12-28 00:10:13,740][106225] Updated weights for policy 1, policy_version 685939 (0.0006) [2023-12-28 00:10:13,800][106225] Updated weights for policy 1, policy_version 685949 (0.0007) [2023-12-28 00:10:13,858][106225] Updated weights for policy 1, policy_version 685959 (0.0007) [2023-12-28 00:10:14,335][106226] Updated weights for policy 0, policy_version 684106 (0.0006) [2023-12-28 00:10:14,402][106226] Updated weights for policy 0, policy_version 684116 (0.0005) [2023-12-28 00:10:14,425][106225] Updated weights for policy 1, policy_version 685969 (0.0007) [2023-12-28 00:10:14,461][106226] Updated weights for policy 0, policy_version 684126 (0.0006) [2023-12-28 00:10:14,473][106225] Updated weights for policy 1, policy_version 685979 (0.0010) [2023-12-28 00:10:14,534][106225] Updated weights for policy 1, policy_version 685989 (0.0011) [2023-12-28 00:10:15,052][106226] Updated weights for policy 0, policy_version 684136 (0.0006) [2023-12-28 00:10:15,106][106226] Updated weights for policy 0, policy_version 684146 (0.0006) [2023-12-28 00:10:15,135][106225] Updated weights for policy 1, policy_version 685999 (0.0009) [2023-12-28 00:10:15,161][106226] Updated weights for policy 0, policy_version 684156 (0.0007) [2023-12-28 00:10:15,199][106225] Updated weights for policy 1, policy_version 686009 (0.0008) [2023-12-28 00:10:15,263][106225] Updated weights for policy 1, policy_version 686019 (0.0009) [2023-12-28 00:10:15,773][106226] Updated weights for policy 0, policy_version 684166 (0.0007) [2023-12-28 00:10:15,827][106226] Updated weights for policy 0, policy_version 684176 (0.0006) [2023-12-28 00:10:15,885][106226] Updated weights for policy 0, policy_version 684186 (0.0005) [2023-12-28 00:10:16,023][106225] Updated weights for policy 1, policy_version 686029 (0.0009) [2023-12-28 00:10:16,095][106225] Updated weights for policy 1, policy_version 686039 (0.0010) [2023-12-28 00:10:16,150][106225] Updated weights for policy 1, policy_version 686049 (0.0008) [2023-12-28 00:10:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 18855.5). Total num frames: 350855168. Throughput: 0: 9839.7, 1: 9890.9. Samples: 350847912. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:16,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-5.837')] [2023-12-28 00:10:16,467][106226] Updated weights for policy 0, policy_version 684196 (0.0009) [2023-12-28 00:10:16,523][106226] Updated weights for policy 0, policy_version 684206 (0.0005) [2023-12-28 00:10:16,575][106226] Updated weights for policy 0, policy_version 684216 (0.0006) [2023-12-28 00:10:16,855][106225] Updated weights for policy 1, policy_version 686059 (0.0007) [2023-12-28 00:10:16,914][106225] Updated weights for policy 1, policy_version 686069 (0.0010) [2023-12-28 00:10:16,963][106225] Updated weights for policy 1, policy_version 686079 (0.0010) [2023-12-28 00:10:17,282][106226] Updated weights for policy 0, policy_version 684226 (0.0007) [2023-12-28 00:10:17,351][106226] Updated weights for policy 0, policy_version 684236 (0.0008) [2023-12-28 00:10:17,408][106226] Updated weights for policy 0, policy_version 684246 (0.0009) [2023-12-28 00:10:17,471][106226] Updated weights for policy 0, policy_version 684256 (0.0006) [2023-12-28 00:10:17,652][106225] Updated weights for policy 1, policy_version 686089 (0.0010) [2023-12-28 00:10:17,701][106225] Updated weights for policy 1, policy_version 686099 (0.0010) [2023-12-28 00:10:17,751][106225] Updated weights for policy 1, policy_version 686109 (0.0010) [2023-12-28 00:10:17,815][106225] Updated weights for policy 1, policy_version 686119 (0.0010) [2023-12-28 00:10:18,132][106226] Updated weights for policy 0, policy_version 684266 (0.0006) [2023-12-28 00:10:18,194][106226] Updated weights for policy 0, policy_version 684276 (0.0009) [2023-12-28 00:10:18,251][106226] Updated weights for policy 0, policy_version 684286 (0.0009) [2023-12-28 00:10:18,507][106225] Updated weights for policy 1, policy_version 686129 (0.0006) [2023-12-28 00:10:18,574][106225] Updated weights for policy 1, policy_version 686139 (0.0006) [2023-12-28 00:10:18,638][106225] Updated weights for policy 1, policy_version 686149 (0.0008) [2023-12-28 00:10:18,913][106226] Updated weights for policy 0, policy_version 684296 (0.0006) [2023-12-28 00:10:18,980][106226] Updated weights for policy 0, policy_version 684306 (0.0007) [2023-12-28 00:10:19,046][106226] Updated weights for policy 0, policy_version 684316 (0.0009) [2023-12-28 00:10:19,274][106225] Updated weights for policy 1, policy_version 686159 (0.0009) [2023-12-28 00:10:19,340][106225] Updated weights for policy 1, policy_version 686169 (0.0009) [2023-12-28 00:10:19,412][106225] Updated weights for policy 1, policy_version 686179 (0.0009) [2023-12-28 00:10:19,689][106226] Updated weights for policy 0, policy_version 684326 (0.0006) [2023-12-28 00:10:19,763][106226] Updated weights for policy 0, policy_version 684336 (0.0006) [2023-12-28 00:10:19,838][106226] Updated weights for policy 0, policy_version 684346 (0.0008) [2023-12-28 00:10:20,132][106225] Updated weights for policy 1, policy_version 686189 (0.0009) [2023-12-28 00:10:20,188][106225] Updated weights for policy 1, policy_version 686199 (0.0006) [2023-12-28 00:10:20,247][106225] Updated weights for policy 1, policy_version 686209 (0.0007) [2023-12-28 00:10:20,514][106226] Updated weights for policy 0, policy_version 684356 (0.0007) [2023-12-28 00:10:20,578][106226] Updated weights for policy 0, policy_version 684366 (0.0008) [2023-12-28 00:10:20,640][106226] Updated weights for policy 0, policy_version 684376 (0.0007) [2023-12-28 00:10:20,936][106225] Updated weights for policy 1, policy_version 686219 (0.0010) [2023-12-28 00:10:20,991][106225] Updated weights for policy 1, policy_version 686229 (0.0007) [2023-12-28 00:10:21,053][106225] Updated weights for policy 1, policy_version 686239 (0.0008) [2023-12-28 00:10:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 18911.0). Total num frames: 350961664. Throughput: 0: 9894.0, 1: 9918.8. Samples: 350969876. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:21,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.422')] [2023-12-28 00:10:21,390][106226] Updated weights for policy 0, policy_version 684386 (0.0006) [2023-12-28 00:10:21,457][106226] Updated weights for policy 0, policy_version 684396 (0.0008) [2023-12-28 00:10:21,522][106226] Updated weights for policy 0, policy_version 684406 (0.0008) [2023-12-28 00:10:21,583][106226] Updated weights for policy 0, policy_version 684416 (0.0009) [2023-12-28 00:10:21,818][106225] Updated weights for policy 1, policy_version 686249 (0.0008) [2023-12-28 00:10:21,882][106225] Updated weights for policy 1, policy_version 686259 (0.0008) [2023-12-28 00:10:21,946][106225] Updated weights for policy 1, policy_version 686269 (0.0008) [2023-12-28 00:10:21,999][106225] Updated weights for policy 1, policy_version 686279 (0.0008) [2023-12-28 00:10:22,301][106226] Updated weights for policy 0, policy_version 684426 (0.0009) [2023-12-28 00:10:22,369][106226] Updated weights for policy 0, policy_version 684436 (0.0009) [2023-12-28 00:10:22,423][106226] Updated weights for policy 0, policy_version 684446 (0.0009) [2023-12-28 00:10:22,826][106225] Updated weights for policy 1, policy_version 686289 (0.0007) [2023-12-28 00:10:22,894][106225] Updated weights for policy 1, policy_version 686299 (0.0006) [2023-12-28 00:10:22,953][106225] Updated weights for policy 1, policy_version 686309 (0.0006) [2023-12-28 00:10:23,192][106226] Updated weights for policy 0, policy_version 684456 (0.0008) [2023-12-28 00:10:23,238][106226] Updated weights for policy 0, policy_version 684466 (0.0008) [2023-12-28 00:10:23,294][106226] Updated weights for policy 0, policy_version 684476 (0.0009) [2023-12-28 00:10:23,599][106225] Updated weights for policy 1, policy_version 686319 (0.0007) [2023-12-28 00:10:23,653][106225] Updated weights for policy 1, policy_version 686329 (0.0008) [2023-12-28 00:10:23,714][106225] Updated weights for policy 1, policy_version 686339 (0.0007) [2023-12-28 00:10:23,996][106226] Updated weights for policy 0, policy_version 684486 (0.0009) [2023-12-28 00:10:24,054][106226] Updated weights for policy 0, policy_version 684496 (0.0010) [2023-12-28 00:10:24,113][106226] Updated weights for policy 0, policy_version 684506 (0.0011) [2023-12-28 00:10:24,453][106225] Updated weights for policy 1, policy_version 686349 (0.0009) [2023-12-28 00:10:24,507][106225] Updated weights for policy 1, policy_version 686359 (0.0010) [2023-12-28 00:10:24,558][106225] Updated weights for policy 1, policy_version 686369 (0.0010) [2023-12-28 00:10:24,841][106226] Updated weights for policy 0, policy_version 684516 (0.0011) [2023-12-28 00:10:24,891][106226] Updated weights for policy 0, policy_version 684526 (0.0010) [2023-12-28 00:10:24,944][106226] Updated weights for policy 0, policy_version 684536 (0.0010) [2023-12-28 00:10:25,123][106225] Updated weights for policy 1, policy_version 686379 (0.0006) [2023-12-28 00:10:25,178][106225] Updated weights for policy 1, policy_version 686389 (0.0005) [2023-12-28 00:10:25,231][106225] Updated weights for policy 1, policy_version 686399 (0.0005) [2023-12-28 00:10:25,625][106226] Updated weights for policy 0, policy_version 684546 (0.0010) [2023-12-28 00:10:25,695][106226] Updated weights for policy 0, policy_version 684556 (0.0010) [2023-12-28 00:10:25,758][106226] Updated weights for policy 0, policy_version 684566 (0.0009) [2023-12-28 00:10:25,817][106225] Updated weights for policy 1, policy_version 686409 (0.0007) [2023-12-28 00:10:25,826][106226] Updated weights for policy 0, policy_version 684576 (0.0009) [2023-12-28 00:10:25,870][106225] Updated weights for policy 1, policy_version 686419 (0.0008) [2023-12-28 00:10:25,925][106225] Updated weights for policy 1, policy_version 686429 (0.0008) [2023-12-28 00:10:25,978][106225] Updated weights for policy 1, policy_version 686439 (0.0007) [2023-12-28 00:10:26,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 18938.8). Total num frames: 351059968. Throughput: 0: 9850.5, 1: 9905.3. Samples: 351025748. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:26,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.560')] [2023-12-28 00:10:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000686440_175759360.pth... [2023-12-28 00:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000684576_175300608.pth... [2023-12-28 00:10:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000685256_175456256.pth [2023-12-28 00:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000683424_175005696.pth [2023-12-28 00:10:26,458][106226] Updated weights for policy 0, policy_version 684586 (0.0005) [2023-12-28 00:10:26,522][106226] Updated weights for policy 0, policy_version 684596 (0.0005) [2023-12-28 00:10:26,581][106226] Updated weights for policy 0, policy_version 684606 (0.0005) [2023-12-28 00:10:26,761][106225] Updated weights for policy 1, policy_version 686449 (0.0008) [2023-12-28 00:10:26,822][106225] Updated weights for policy 1, policy_version 686459 (0.0009) [2023-12-28 00:10:26,883][106225] Updated weights for policy 1, policy_version 686469 (0.0008) [2023-12-28 00:10:27,132][106226] Updated weights for policy 0, policy_version 684616 (0.0008) [2023-12-28 00:10:27,184][106226] Updated weights for policy 0, policy_version 684626 (0.0009) [2023-12-28 00:10:27,232][106226] Updated weights for policy 0, policy_version 684636 (0.0008) [2023-12-28 00:10:27,593][106225] Updated weights for policy 1, policy_version 686479 (0.0006) [2023-12-28 00:10:27,648][106225] Updated weights for policy 1, policy_version 686489 (0.0005) [2023-12-28 00:10:27,702][106225] Updated weights for policy 1, policy_version 686499 (0.0005) [2023-12-28 00:10:27,967][106226] Updated weights for policy 0, policy_version 684646 (0.0009) [2023-12-28 00:10:28,022][106226] Updated weights for policy 0, policy_version 684656 (0.0010) [2023-12-28 00:10:28,083][106226] Updated weights for policy 0, policy_version 684666 (0.0011) [2023-12-28 00:10:28,244][106225] Updated weights for policy 1, policy_version 686509 (0.0005) [2023-12-28 00:10:28,303][106225] Updated weights for policy 1, policy_version 686519 (0.0006) [2023-12-28 00:10:28,375][106225] Updated weights for policy 1, policy_version 686529 (0.0008) [2023-12-28 00:10:28,800][106226] Updated weights for policy 0, policy_version 684676 (0.0011) [2023-12-28 00:10:28,855][106226] Updated weights for policy 0, policy_version 684686 (0.0008) [2023-12-28 00:10:28,909][106226] Updated weights for policy 0, policy_version 684696 (0.0008) [2023-12-28 00:10:29,008][106225] Updated weights for policy 1, policy_version 686539 (0.0007) [2023-12-28 00:10:29,064][106225] Updated weights for policy 1, policy_version 686549 (0.0005) [2023-12-28 00:10:29,123][106225] Updated weights for policy 1, policy_version 686559 (0.0008) [2023-12-28 00:10:29,670][106226] Updated weights for policy 0, policy_version 684707 (0.0009) [2023-12-28 00:10:29,733][106226] Updated weights for policy 0, policy_version 684717 (0.0008) [2023-12-28 00:10:29,797][106226] Updated weights for policy 0, policy_version 684727 (0.0008) [2023-12-28 00:10:29,861][106225] Updated weights for policy 1, policy_version 686569 (0.0010) [2023-12-28 00:10:29,927][106225] Updated weights for policy 1, policy_version 686579 (0.0010) [2023-12-28 00:10:29,992][106225] Updated weights for policy 1, policy_version 686589 (0.0010) [2023-12-28 00:10:30,049][106225] Updated weights for policy 1, policy_version 686599 (0.0010) [2023-12-28 00:10:30,512][106226] Updated weights for policy 0, policy_version 684737 (0.0007) [2023-12-28 00:10:30,567][106226] Updated weights for policy 0, policy_version 684747 (0.0008) [2023-12-28 00:10:30,613][106226] Updated weights for policy 0, policy_version 684757 (0.0009) [2023-12-28 00:10:30,642][106225] Updated weights for policy 1, policy_version 686609 (0.0006) [2023-12-28 00:10:30,657][106226] Updated weights for policy 0, policy_version 684767 (0.0008) [2023-12-28 00:10:30,705][106225] Updated weights for policy 1, policy_version 686619 (0.0005) [2023-12-28 00:10:30,770][106225] Updated weights for policy 1, policy_version 686629 (0.0006) [2023-12-28 00:10:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 18938.8). Total num frames: 351158272. Throughput: 0: 9946.9, 1: 10000.5. Samples: 351148912. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:31,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.723')] [2023-12-28 00:10:31,353][106225] Updated weights for policy 1, policy_version 686639 (0.0007) [2023-12-28 00:10:31,426][106225] Updated weights for policy 1, policy_version 686649 (0.0008) [2023-12-28 00:10:31,446][106226] Updated weights for policy 0, policy_version 684777 (0.0008) [2023-12-28 00:10:31,487][106225] Updated weights for policy 1, policy_version 686659 (0.0008) [2023-12-28 00:10:31,508][106226] Updated weights for policy 0, policy_version 684787 (0.0006) [2023-12-28 00:10:31,563][106226] Updated weights for policy 0, policy_version 684797 (0.0008) [2023-12-28 00:10:32,110][106225] Updated weights for policy 1, policy_version 686669 (0.0007) [2023-12-28 00:10:32,161][106225] Updated weights for policy 1, policy_version 686679 (0.0008) [2023-12-28 00:10:32,215][106225] Updated weights for policy 1, policy_version 686689 (0.0008) [2023-12-28 00:10:32,263][106226] Updated weights for policy 0, policy_version 684807 (0.0007) [2023-12-28 00:10:32,319][106226] Updated weights for policy 0, policy_version 684817 (0.0009) [2023-12-28 00:10:32,382][106226] Updated weights for policy 0, policy_version 684827 (0.0008) [2023-12-28 00:10:32,927][106225] Updated weights for policy 1, policy_version 686699 (0.0008) [2023-12-28 00:10:32,984][106225] Updated weights for policy 1, policy_version 686709 (0.0008) [2023-12-28 00:10:33,046][106225] Updated weights for policy 1, policy_version 686719 (0.0008) [2023-12-28 00:10:33,100][106226] Updated weights for policy 0, policy_version 684837 (0.0007) [2023-12-28 00:10:33,159][106226] Updated weights for policy 0, policy_version 684847 (0.0009) [2023-12-28 00:10:33,218][106226] Updated weights for policy 0, policy_version 684857 (0.0009) [2023-12-28 00:10:33,767][106225] Updated weights for policy 1, policy_version 686729 (0.0009) [2023-12-28 00:10:33,823][106225] Updated weights for policy 1, policy_version 686739 (0.0006) [2023-12-28 00:10:33,879][106225] Updated weights for policy 1, policy_version 686749 (0.0009) [2023-12-28 00:10:33,938][106225] Updated weights for policy 1, policy_version 686759 (0.0007) [2023-12-28 00:10:33,944][106226] Updated weights for policy 0, policy_version 684867 (0.0008) [2023-12-28 00:10:34,006][106226] Updated weights for policy 0, policy_version 684877 (0.0009) [2023-12-28 00:10:34,071][106226] Updated weights for policy 0, policy_version 684887 (0.0008) [2023-12-28 00:10:34,613][106225] Updated weights for policy 1, policy_version 686769 (0.0010) [2023-12-28 00:10:34,666][106225] Updated weights for policy 1, policy_version 686779 (0.0010) [2023-12-28 00:10:34,719][106225] Updated weights for policy 1, policy_version 686789 (0.0010) [2023-12-28 00:10:34,749][106226] Updated weights for policy 0, policy_version 684897 (0.0009) [2023-12-28 00:10:34,811][106226] Updated weights for policy 0, policy_version 684907 (0.0007) [2023-12-28 00:10:34,878][106226] Updated weights for policy 0, policy_version 684917 (0.0006) [2023-12-28 00:10:34,939][106226] Updated weights for policy 0, policy_version 684927 (0.0006) [2023-12-28 00:10:35,435][106225] Updated weights for policy 1, policy_version 686799 (0.0007) [2023-12-28 00:10:35,495][106225] Updated weights for policy 1, policy_version 686809 (0.0010) [2023-12-28 00:10:35,513][106226] Updated weights for policy 0, policy_version 684937 (0.0006) [2023-12-28 00:10:35,552][106225] Updated weights for policy 1, policy_version 686819 (0.0010) [2023-12-28 00:10:35,560][106226] Updated weights for policy 0, policy_version 684947 (0.0009) [2023-12-28 00:10:35,612][106226] Updated weights for policy 0, policy_version 684957 (0.0008) [2023-12-28 00:10:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 18966.6). Total num frames: 351256576. Throughput: 0: 9964.3, 1: 10051.9. Samples: 351270588. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:36,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.383')] [2023-12-28 00:10:36,246][106225] Updated weights for policy 1, policy_version 686829 (0.0007) [2023-12-28 00:10:36,270][106226] Updated weights for policy 0, policy_version 684967 (0.0007) [2023-12-28 00:10:36,303][106225] Updated weights for policy 1, policy_version 686839 (0.0008) [2023-12-28 00:10:36,334][106226] Updated weights for policy 0, policy_version 684977 (0.0007) [2023-12-28 00:10:36,363][106225] Updated weights for policy 1, policy_version 686849 (0.0008) [2023-12-28 00:10:36,394][106226] Updated weights for policy 0, policy_version 684987 (0.0006) [2023-12-28 00:10:36,999][106226] Updated weights for policy 0, policy_version 684997 (0.0007) [2023-12-28 00:10:37,051][106226] Updated weights for policy 0, policy_version 685007 (0.0009) [2023-12-28 00:10:37,065][106225] Updated weights for policy 1, policy_version 686859 (0.0008) [2023-12-28 00:10:37,108][106226] Updated weights for policy 0, policy_version 685017 (0.0007) [2023-12-28 00:10:37,114][106225] Updated weights for policy 1, policy_version 686869 (0.0007) [2023-12-28 00:10:37,170][106225] Updated weights for policy 1, policy_version 686879 (0.0007) [2023-12-28 00:10:37,788][106226] Updated weights for policy 0, policy_version 685027 (0.0007) [2023-12-28 00:10:37,841][106226] Updated weights for policy 0, policy_version 685037 (0.0007) [2023-12-28 00:10:37,882][106225] Updated weights for policy 1, policy_version 686889 (0.0008) [2023-12-28 00:10:37,896][106226] Updated weights for policy 0, policy_version 685047 (0.0005) [2023-12-28 00:10:37,943][106225] Updated weights for policy 1, policy_version 686899 (0.0005) [2023-12-28 00:10:38,004][106225] Updated weights for policy 1, policy_version 686909 (0.0005) [2023-12-28 00:10:38,061][106225] Updated weights for policy 1, policy_version 686919 (0.0005) [2023-12-28 00:10:38,547][106226] Updated weights for policy 0, policy_version 685057 (0.0006) [2023-12-28 00:10:38,603][106226] Updated weights for policy 0, policy_version 685067 (0.0008) [2023-12-28 00:10:38,665][106226] Updated weights for policy 0, policy_version 685077 (0.0006) [2023-12-28 00:10:38,721][106226] Updated weights for policy 0, policy_version 685087 (0.0005) [2023-12-28 00:10:38,747][106225] Updated weights for policy 1, policy_version 686929 (0.0009) [2023-12-28 00:10:38,800][106225] Updated weights for policy 1, policy_version 686939 (0.0009) [2023-12-28 00:10:38,862][106225] Updated weights for policy 1, policy_version 686949 (0.0008) [2023-12-28 00:10:39,366][106226] Updated weights for policy 0, policy_version 685097 (0.0007) [2023-12-28 00:10:39,433][106226] Updated weights for policy 0, policy_version 685107 (0.0008) [2023-12-28 00:10:39,489][106226] Updated weights for policy 0, policy_version 685117 (0.0008) [2023-12-28 00:10:39,756][106225] Updated weights for policy 1, policy_version 686959 (0.0009) [2023-12-28 00:10:39,812][106225] Updated weights for policy 1, policy_version 686969 (0.0008) [2023-12-28 00:10:39,877][106225] Updated weights for policy 1, policy_version 686979 (0.0008) [2023-12-28 00:10:40,266][106226] Updated weights for policy 0, policy_version 685127 (0.0009) [2023-12-28 00:10:40,327][106226] Updated weights for policy 0, policy_version 685137 (0.0009) [2023-12-28 00:10:40,393][106226] Updated weights for policy 0, policy_version 685147 (0.0009) [2023-12-28 00:10:40,578][106225] Updated weights for policy 1, policy_version 686989 (0.0007) [2023-12-28 00:10:40,633][106225] Updated weights for policy 1, policy_version 686999 (0.0005) [2023-12-28 00:10:40,689][106225] Updated weights for policy 1, policy_version 687009 (0.0006) [2023-12-28 00:10:41,091][106226] Updated weights for policy 0, policy_version 685157 (0.0008) [2023-12-28 00:10:41,153][106226] Updated weights for policy 0, policy_version 685167 (0.0008) [2023-12-28 00:10:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 18994.3). Total num frames: 351354880. Throughput: 0: 10042.0, 1: 10093.1. Samples: 351332660. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:41,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-5.516')] [2023-12-28 00:10:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000687016_175906816.pth... [2023-12-28 00:10:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000685864_175611904.pth [2023-12-28 00:10:41,216][106226] Updated weights for policy 0, policy_version 685177 (0.0008) [2023-12-28 00:10:41,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000685184_175456256.pth... [2023-12-28 00:10:41,264][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000684000_175153152.pth [2023-12-28 00:10:41,325][106225] Updated weights for policy 1, policy_version 687019 (0.0006) [2023-12-28 00:10:41,395][106225] Updated weights for policy 1, policy_version 687029 (0.0007) [2023-12-28 00:10:41,450][106225] Updated weights for policy 1, policy_version 687039 (0.0008) [2023-12-28 00:10:42,004][106226] Updated weights for policy 0, policy_version 685187 (0.0008) [2023-12-28 00:10:42,059][106226] Updated weights for policy 0, policy_version 685197 (0.0009) [2023-12-28 00:10:42,119][106226] Updated weights for policy 0, policy_version 685207 (0.0009) [2023-12-28 00:10:42,146][106225] Updated weights for policy 1, policy_version 687049 (0.0008) [2023-12-28 00:10:42,199][106225] Updated weights for policy 1, policy_version 687059 (0.0007) [2023-12-28 00:10:42,262][106225] Updated weights for policy 1, policy_version 687069 (0.0008) [2023-12-28 00:10:42,326][106225] Updated weights for policy 1, policy_version 687079 (0.0008) [2023-12-28 00:10:42,837][106226] Updated weights for policy 0, policy_version 685217 (0.0007) [2023-12-28 00:10:42,889][106226] Updated weights for policy 0, policy_version 685227 (0.0008) [2023-12-28 00:10:42,941][106226] Updated weights for policy 0, policy_version 685237 (0.0008) [2023-12-28 00:10:42,998][106226] Updated weights for policy 0, policy_version 685247 (0.0009) [2023-12-28 00:10:43,107][106225] Updated weights for policy 1, policy_version 687089 (0.0008) [2023-12-28 00:10:43,162][106225] Updated weights for policy 1, policy_version 687099 (0.0009) [2023-12-28 00:10:43,221][106225] Updated weights for policy 1, policy_version 687109 (0.0008) [2023-12-28 00:10:43,737][106226] Updated weights for policy 0, policy_version 685257 (0.0008) [2023-12-28 00:10:43,807][106226] Updated weights for policy 0, policy_version 685267 (0.0008) [2023-12-28 00:10:43,876][106226] Updated weights for policy 0, policy_version 685277 (0.0008) [2023-12-28 00:10:43,904][106225] Updated weights for policy 1, policy_version 687119 (0.0006) [2023-12-28 00:10:43,963][106225] Updated weights for policy 1, policy_version 687129 (0.0009) [2023-12-28 00:10:44,025][106225] Updated weights for policy 1, policy_version 687139 (0.0008) [2023-12-28 00:10:44,595][106226] Updated weights for policy 0, policy_version 685287 (0.0009) [2023-12-28 00:10:44,660][106226] Updated weights for policy 0, policy_version 685297 (0.0008) [2023-12-28 00:10:44,683][106225] Updated weights for policy 1, policy_version 687149 (0.0007) [2023-12-28 00:10:44,720][106226] Updated weights for policy 0, policy_version 685307 (0.0009) [2023-12-28 00:10:44,747][106225] Updated weights for policy 1, policy_version 687159 (0.0006) [2023-12-28 00:10:44,810][106225] Updated weights for policy 1, policy_version 687169 (0.0007) [2023-12-28 00:10:45,468][106226] Updated weights for policy 0, policy_version 685317 (0.0008) [2023-12-28 00:10:45,528][106225] Updated weights for policy 1, policy_version 687179 (0.0008) [2023-12-28 00:10:45,530][106226] Updated weights for policy 0, policy_version 685327 (0.0009) [2023-12-28 00:10:45,583][106226] Updated weights for policy 0, policy_version 685337 (0.0005) [2023-12-28 00:10:45,585][106225] Updated weights for policy 1, policy_version 687189 (0.0007) [2023-12-28 00:10:45,646][106225] Updated weights for policy 1, policy_version 687199 (0.0008) [2023-12-28 00:10:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19049.9). Total num frames: 351453184. Throughput: 0: 9912.0, 1: 10033.4. Samples: 351447008. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:46,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.525')] [2023-12-28 00:10:46,265][106226] Updated weights for policy 0, policy_version 685347 (0.0008) [2023-12-28 00:10:46,321][106226] Updated weights for policy 0, policy_version 685357 (0.0008) [2023-12-28 00:10:46,379][106225] Updated weights for policy 1, policy_version 687209 (0.0008) [2023-12-28 00:10:46,386][106226] Updated weights for policy 0, policy_version 685367 (0.0008) [2023-12-28 00:10:46,438][106225] Updated weights for policy 1, policy_version 687219 (0.0007) [2023-12-28 00:10:46,490][106225] Updated weights for policy 1, policy_version 687229 (0.0007) [2023-12-28 00:10:46,537][106225] Updated weights for policy 1, policy_version 687239 (0.0008) [2023-12-28 00:10:47,141][106225] Updated weights for policy 1, policy_version 687249 (0.0005) [2023-12-28 00:10:47,186][106226] Updated weights for policy 0, policy_version 685377 (0.0007) [2023-12-28 00:10:47,190][106225] Updated weights for policy 1, policy_version 687259 (0.0005) [2023-12-28 00:10:47,241][106226] Updated weights for policy 0, policy_version 685387 (0.0007) [2023-12-28 00:10:47,243][106225] Updated weights for policy 1, policy_version 687269 (0.0008) [2023-12-28 00:10:47,291][106226] Updated weights for policy 0, policy_version 685397 (0.0007) [2023-12-28 00:10:47,345][106226] Updated weights for policy 0, policy_version 685407 (0.0007) [2023-12-28 00:10:47,869][106225] Updated weights for policy 1, policy_version 687279 (0.0010) [2023-12-28 00:10:47,920][106225] Updated weights for policy 1, policy_version 687289 (0.0010) [2023-12-28 00:10:47,977][106225] Updated weights for policy 1, policy_version 687299 (0.0010) [2023-12-28 00:10:48,105][106226] Updated weights for policy 0, policy_version 685417 (0.0007) [2023-12-28 00:10:48,163][106226] Updated weights for policy 0, policy_version 685427 (0.0009) [2023-12-28 00:10:48,223][106226] Updated weights for policy 0, policy_version 685437 (0.0008) [2023-12-28 00:10:48,672][106225] Updated weights for policy 1, policy_version 687309 (0.0010) [2023-12-28 00:10:48,733][106225] Updated weights for policy 1, policy_version 687319 (0.0010) [2023-12-28 00:10:48,794][106225] Updated weights for policy 1, policy_version 687329 (0.0010) [2023-12-28 00:10:49,010][106226] Updated weights for policy 0, policy_version 685447 (0.0009) [2023-12-28 00:10:49,071][106226] Updated weights for policy 0, policy_version 685457 (0.0008) [2023-12-28 00:10:49,130][106226] Updated weights for policy 0, policy_version 685467 (0.0008) [2023-12-28 00:10:49,516][106225] Updated weights for policy 1, policy_version 687339 (0.0010) [2023-12-28 00:10:49,570][106225] Updated weights for policy 1, policy_version 687349 (0.0011) [2023-12-28 00:10:49,624][106225] Updated weights for policy 1, policy_version 687359 (0.0010) [2023-12-28 00:10:49,848][106226] Updated weights for policy 0, policy_version 685477 (0.0008) [2023-12-28 00:10:49,909][106226] Updated weights for policy 0, policy_version 685487 (0.0007) [2023-12-28 00:10:49,974][106226] Updated weights for policy 0, policy_version 685497 (0.0007) [2023-12-28 00:10:50,367][106225] Updated weights for policy 1, policy_version 687369 (0.0010) [2023-12-28 00:10:50,428][106225] Updated weights for policy 1, policy_version 687379 (0.0009) [2023-12-28 00:10:50,480][106225] Updated weights for policy 1, policy_version 687389 (0.0008) [2023-12-28 00:10:50,538][106225] Updated weights for policy 1, policy_version 687399 (0.0009) [2023-12-28 00:10:50,681][106226] Updated weights for policy 0, policy_version 685507 (0.0007) [2023-12-28 00:10:50,742][106226] Updated weights for policy 0, policy_version 685517 (0.0008) [2023-12-28 00:10:50,808][106226] Updated weights for policy 0, policy_version 685527 (0.0009) [2023-12-28 00:10:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19049.9). Total num frames: 351551488. Throughput: 0: 9864.7, 1: 10021.0. Samples: 351562808. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:51,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-5.601')] [2023-12-28 00:10:51,301][106225] Updated weights for policy 1, policy_version 687409 (0.0009) [2023-12-28 00:10:51,350][106225] Updated weights for policy 1, policy_version 687419 (0.0009) [2023-12-28 00:10:51,423][106225] Updated weights for policy 1, policy_version 687429 (0.0009) [2023-12-28 00:10:51,526][106226] Updated weights for policy 0, policy_version 685537 (0.0008) [2023-12-28 00:10:51,579][106226] Updated weights for policy 0, policy_version 685547 (0.0008) [2023-12-28 00:10:51,640][106226] Updated weights for policy 0, policy_version 685557 (0.0009) [2023-12-28 00:10:51,706][106226] Updated weights for policy 0, policy_version 685567 (0.0010) [2023-12-28 00:10:52,141][106225] Updated weights for policy 1, policy_version 687439 (0.0006) [2023-12-28 00:10:52,198][106225] Updated weights for policy 1, policy_version 687449 (0.0007) [2023-12-28 00:10:52,259][106225] Updated weights for policy 1, policy_version 687459 (0.0006) [2023-12-28 00:10:52,531][106226] Updated weights for policy 0, policy_version 685577 (0.0008) [2023-12-28 00:10:52,595][106226] Updated weights for policy 0, policy_version 685587 (0.0008) [2023-12-28 00:10:52,659][106226] Updated weights for policy 0, policy_version 685597 (0.0009) [2023-12-28 00:10:52,937][106225] Updated weights for policy 1, policy_version 687469 (0.0008) [2023-12-28 00:10:52,986][106225] Updated weights for policy 1, policy_version 687479 (0.0005) [2023-12-28 00:10:53,040][106225] Updated weights for policy 1, policy_version 687489 (0.0007) [2023-12-28 00:10:53,321][106226] Updated weights for policy 0, policy_version 685607 (0.0007) [2023-12-28 00:10:53,381][106226] Updated weights for policy 0, policy_version 685617 (0.0006) [2023-12-28 00:10:53,444][106226] Updated weights for policy 0, policy_version 685627 (0.0008) [2023-12-28 00:10:53,774][106225] Updated weights for policy 1, policy_version 687499 (0.0009) [2023-12-28 00:10:53,823][106225] Updated weights for policy 1, policy_version 687509 (0.0008) [2023-12-28 00:10:53,868][106225] Updated weights for policy 1, policy_version 687519 (0.0008) [2023-12-28 00:10:54,129][106226] Updated weights for policy 0, policy_version 685637 (0.0008) [2023-12-28 00:10:54,185][106226] Updated weights for policy 0, policy_version 685647 (0.0008) [2023-12-28 00:10:54,242][106226] Updated weights for policy 0, policy_version 685657 (0.0008) [2023-12-28 00:10:54,660][106225] Updated weights for policy 1, policy_version 687529 (0.0009) [2023-12-28 00:10:54,724][106225] Updated weights for policy 1, policy_version 687539 (0.0007) [2023-12-28 00:10:54,783][106225] Updated weights for policy 1, policy_version 687549 (0.0008) [2023-12-28 00:10:54,835][106225] Updated weights for policy 1, policy_version 687559 (0.0008) [2023-12-28 00:10:54,906][106226] Updated weights for policy 0, policy_version 685667 (0.0008) [2023-12-28 00:10:54,960][106226] Updated weights for policy 0, policy_version 685677 (0.0009) [2023-12-28 00:10:55,023][106226] Updated weights for policy 0, policy_version 685687 (0.0011) [2023-12-28 00:10:55,509][106225] Updated weights for policy 1, policy_version 687569 (0.0007) [2023-12-28 00:10:55,569][106225] Updated weights for policy 1, policy_version 687579 (0.0007) [2023-12-28 00:10:55,629][106225] Updated weights for policy 1, policy_version 687589 (0.0008) [2023-12-28 00:10:55,702][106226] Updated weights for policy 0, policy_version 685697 (0.0011) [2023-12-28 00:10:55,776][106226] Updated weights for policy 0, policy_version 685707 (0.0010) [2023-12-28 00:10:55,831][106226] Updated weights for policy 0, policy_version 685717 (0.0009) [2023-12-28 00:10:55,882][106226] Updated weights for policy 0, policy_version 685727 (0.0006) [2023-12-28 00:10:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19077.6). Total num frames: 351649792. Throughput: 0: 9863.8, 1: 9982.9. Samples: 351620880. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:10:56,175][105115] Avg episode reward: [(0, '-4.219'), (1, '-5.286')] [2023-12-28 00:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000687592_176054272.pth... [2023-12-28 00:10:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000685728_175595520.pth... [2023-12-28 00:10:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000686440_175759360.pth [2023-12-28 00:10:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000684576_175300608.pth [2023-12-28 00:10:56,353][106225] Updated weights for policy 1, policy_version 687599 (0.0007) [2023-12-28 00:10:56,409][106225] Updated weights for policy 1, policy_version 687609 (0.0005) [2023-12-28 00:10:56,463][106225] Updated weights for policy 1, policy_version 687619 (0.0005) [2023-12-28 00:10:56,554][106226] Updated weights for policy 0, policy_version 685737 (0.0009) [2023-12-28 00:10:56,615][106226] Updated weights for policy 0, policy_version 685747 (0.0009) [2023-12-28 00:10:56,675][106226] Updated weights for policy 0, policy_version 685757 (0.0010) [2023-12-28 00:10:57,129][106225] Updated weights for policy 1, policy_version 687629 (0.0007) [2023-12-28 00:10:57,188][106225] Updated weights for policy 1, policy_version 687639 (0.0008) [2023-12-28 00:10:57,236][106225] Updated weights for policy 1, policy_version 687649 (0.0007) [2023-12-28 00:10:57,379][106226] Updated weights for policy 0, policy_version 685767 (0.0009) [2023-12-28 00:10:57,452][106226] Updated weights for policy 0, policy_version 685777 (0.0010) [2023-12-28 00:10:57,521][106226] Updated weights for policy 0, policy_version 685787 (0.0010) [2023-12-28 00:10:57,830][106225] Updated weights for policy 1, policy_version 687659 (0.0007) [2023-12-28 00:10:57,888][106225] Updated weights for policy 1, policy_version 687669 (0.0007) [2023-12-28 00:10:57,942][106225] Updated weights for policy 1, policy_version 687679 (0.0008) [2023-12-28 00:10:58,135][106226] Updated weights for policy 0, policy_version 685797 (0.0008) [2023-12-28 00:10:58,182][106226] Updated weights for policy 0, policy_version 685807 (0.0005) [2023-12-28 00:10:58,244][106226] Updated weights for policy 0, policy_version 685817 (0.0007) [2023-12-28 00:10:58,805][106225] Updated weights for policy 1, policy_version 687689 (0.0006) [2023-12-28 00:10:58,886][106225] Updated weights for policy 1, policy_version 687699 (0.0009) [2023-12-28 00:10:58,953][106225] Updated weights for policy 1, policy_version 687709 (0.0009) [2023-12-28 00:10:59,013][106225] Updated weights for policy 1, policy_version 687719 (0.0008) [2023-12-28 00:10:59,043][106226] Updated weights for policy 0, policy_version 685827 (0.0008) [2023-12-28 00:10:59,104][106226] Updated weights for policy 0, policy_version 685837 (0.0008) [2023-12-28 00:10:59,165][106226] Updated weights for policy 0, policy_version 685847 (0.0008) [2023-12-28 00:10:59,710][106225] Updated weights for policy 1, policy_version 687729 (0.0007) [2023-12-28 00:10:59,758][106225] Updated weights for policy 1, policy_version 687739 (0.0007) [2023-12-28 00:10:59,804][106225] Updated weights for policy 1, policy_version 687749 (0.0008) [2023-12-28 00:10:59,950][106226] Updated weights for policy 0, policy_version 685857 (0.0008) [2023-12-28 00:11:00,013][106226] Updated weights for policy 0, policy_version 685867 (0.0009) [2023-12-28 00:11:00,064][106226] Updated weights for policy 0, policy_version 685877 (0.0008) [2023-12-28 00:11:00,113][106226] Updated weights for policy 0, policy_version 685887 (0.0009) [2023-12-28 00:11:00,478][106225] Updated weights for policy 1, policy_version 687759 (0.0008) [2023-12-28 00:11:00,543][106225] Updated weights for policy 1, policy_version 687769 (0.0009) [2023-12-28 00:11:00,607][106225] Updated weights for policy 1, policy_version 687779 (0.0008) [2023-12-28 00:11:00,777][106226] Updated weights for policy 0, policy_version 685897 (0.0009) [2023-12-28 00:11:00,827][106226] Updated weights for policy 0, policy_version 685907 (0.0005) [2023-12-28 00:11:00,876][106226] Updated weights for policy 0, policy_version 685917 (0.0010) [2023-12-28 00:11:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19105.4). Total num frames: 351748096. Throughput: 0: 9812.9, 1: 9955.3. Samples: 351737480. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:11:01,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-5.422')] [2023-12-28 00:11:01,387][106225] Updated weights for policy 1, policy_version 687789 (0.0010) [2023-12-28 00:11:01,450][106225] Updated weights for policy 1, policy_version 687799 (0.0008) [2023-12-28 00:11:01,512][106225] Updated weights for policy 1, policy_version 687809 (0.0008) [2023-12-28 00:11:01,632][106226] Updated weights for policy 0, policy_version 685927 (0.0006) [2023-12-28 00:11:01,698][106226] Updated weights for policy 0, policy_version 685937 (0.0009) [2023-12-28 00:11:01,765][106226] Updated weights for policy 0, policy_version 685947 (0.0009) [2023-12-28 00:11:02,271][106225] Updated weights for policy 1, policy_version 687819 (0.0009) [2023-12-28 00:11:02,333][106225] Updated weights for policy 1, policy_version 687829 (0.0009) [2023-12-28 00:11:02,398][106225] Updated weights for policy 1, policy_version 687839 (0.0008) [2023-12-28 00:11:02,445][106226] Updated weights for policy 0, policy_version 685957 (0.0008) [2023-12-28 00:11:02,493][106226] Updated weights for policy 0, policy_version 685967 (0.0008) [2023-12-28 00:11:02,554][106226] Updated weights for policy 0, policy_version 685977 (0.0008) [2023-12-28 00:11:03,093][106225] Updated weights for policy 1, policy_version 687849 (0.0006) [2023-12-28 00:11:03,142][106225] Updated weights for policy 1, policy_version 687859 (0.0005) [2023-12-28 00:11:03,188][106225] Updated weights for policy 1, policy_version 687869 (0.0005) [2023-12-28 00:11:03,238][106225] Updated weights for policy 1, policy_version 687879 (0.0005) [2023-12-28 00:11:03,264][106226] Updated weights for policy 0, policy_version 685987 (0.0007) [2023-12-28 00:11:03,312][106226] Updated weights for policy 0, policy_version 685997 (0.0005) [2023-12-28 00:11:03,357][106226] Updated weights for policy 0, policy_version 686007 (0.0006) [2023-12-28 00:11:03,778][106225] Updated weights for policy 1, policy_version 687889 (0.0008) [2023-12-28 00:11:03,832][106225] Updated weights for policy 1, policy_version 687899 (0.0008) [2023-12-28 00:11:03,897][106225] Updated weights for policy 1, policy_version 687909 (0.0008) [2023-12-28 00:11:04,061][106226] Updated weights for policy 0, policy_version 686017 (0.0006) [2023-12-28 00:11:04,119][106226] Updated weights for policy 0, policy_version 686027 (0.0011) [2023-12-28 00:11:04,174][106226] Updated weights for policy 0, policy_version 686037 (0.0011) [2023-12-28 00:11:04,236][106226] Updated weights for policy 0, policy_version 686047 (0.0011) [2023-12-28 00:11:04,683][106225] Updated weights for policy 1, policy_version 687919 (0.0009) [2023-12-28 00:11:04,747][106225] Updated weights for policy 1, policy_version 687929 (0.0009) [2023-12-28 00:11:04,797][106225] Updated weights for policy 1, policy_version 687939 (0.0009) [2023-12-28 00:11:04,868][106226] Updated weights for policy 0, policy_version 686057 (0.0006) [2023-12-28 00:11:04,920][106226] Updated weights for policy 0, policy_version 686067 (0.0005) [2023-12-28 00:11:04,978][106226] Updated weights for policy 0, policy_version 686077 (0.0008) [2023-12-28 00:11:05,532][106225] Updated weights for policy 1, policy_version 687949 (0.0009) [2023-12-28 00:11:05,550][106226] Updated weights for policy 0, policy_version 686087 (0.0006) [2023-12-28 00:11:05,593][106225] Updated weights for policy 1, policy_version 687959 (0.0010) [2023-12-28 00:11:05,617][106226] Updated weights for policy 0, policy_version 686097 (0.0006) [2023-12-28 00:11:05,655][106225] Updated weights for policy 1, policy_version 687969 (0.0010) [2023-12-28 00:11:05,681][106226] Updated weights for policy 0, policy_version 686107 (0.0005) [2023-12-28 00:11:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19133.2). Total num frames: 351846400. Throughput: 0: 9827.5, 1: 9909.7. Samples: 351858052. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:11:06,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.296')] [2023-12-28 00:11:06,304][106226] Updated weights for policy 0, policy_version 686117 (0.0006) [2023-12-28 00:11:06,370][106226] Updated weights for policy 0, policy_version 686127 (0.0006) [2023-12-28 00:11:06,420][106225] Updated weights for policy 1, policy_version 687979 (0.0010) [2023-12-28 00:11:06,430][106226] Updated weights for policy 0, policy_version 686137 (0.0007) [2023-12-28 00:11:06,479][106225] Updated weights for policy 1, policy_version 687989 (0.0008) [2023-12-28 00:11:06,543][106225] Updated weights for policy 1, policy_version 687999 (0.0008) [2023-12-28 00:11:07,046][106226] Updated weights for policy 0, policy_version 686147 (0.0006) [2023-12-28 00:11:07,102][106226] Updated weights for policy 0, policy_version 686157 (0.0007) [2023-12-28 00:11:07,154][106226] Updated weights for policy 0, policy_version 686167 (0.0005) [2023-12-28 00:11:07,346][106225] Updated weights for policy 1, policy_version 688009 (0.0008) [2023-12-28 00:11:07,398][106225] Updated weights for policy 1, policy_version 688019 (0.0009) [2023-12-28 00:11:07,450][106225] Updated weights for policy 1, policy_version 688029 (0.0008) [2023-12-28 00:11:07,509][106225] Updated weights for policy 1, policy_version 688039 (0.0009) [2023-12-28 00:11:07,733][106226] Updated weights for policy 0, policy_version 686177 (0.0006) [2023-12-28 00:11:07,789][106226] Updated weights for policy 0, policy_version 686187 (0.0010) [2023-12-28 00:11:07,856][106226] Updated weights for policy 0, policy_version 686197 (0.0010) [2023-12-28 00:11:07,915][106226] Updated weights for policy 0, policy_version 686207 (0.0010) [2023-12-28 00:11:08,285][106225] Updated weights for policy 1, policy_version 688049 (0.0010) [2023-12-28 00:11:08,356][106225] Updated weights for policy 1, policy_version 688059 (0.0007) [2023-12-28 00:11:08,419][106225] Updated weights for policy 1, policy_version 688069 (0.0006) [2023-12-28 00:11:08,577][106226] Updated weights for policy 0, policy_version 686217 (0.0008) [2023-12-28 00:11:08,647][106226] Updated weights for policy 0, policy_version 686227 (0.0010) [2023-12-28 00:11:08,711][106226] Updated weights for policy 0, policy_version 686237 (0.0011) [2023-12-28 00:11:09,082][106225] Updated weights for policy 1, policy_version 688079 (0.0009) [2023-12-28 00:11:09,132][106225] Updated weights for policy 1, policy_version 688089 (0.0010) [2023-12-28 00:11:09,188][106225] Updated weights for policy 1, policy_version 688099 (0.0009) [2023-12-28 00:11:09,334][106226] Updated weights for policy 0, policy_version 686247 (0.0007) [2023-12-28 00:11:09,408][106226] Updated weights for policy 0, policy_version 686257 (0.0011) [2023-12-28 00:11:09,473][106226] Updated weights for policy 0, policy_version 686267 (0.0007) [2023-12-28 00:11:09,902][106225] Updated weights for policy 1, policy_version 688109 (0.0009) [2023-12-28 00:11:09,969][106225] Updated weights for policy 1, policy_version 688119 (0.0009) [2023-12-28 00:11:10,033][106225] Updated weights for policy 1, policy_version 688129 (0.0009) [2023-12-28 00:11:10,263][106226] Updated weights for policy 0, policy_version 686277 (0.0009) [2023-12-28 00:11:10,312][106226] Updated weights for policy 0, policy_version 686287 (0.0008) [2023-12-28 00:11:10,367][106226] Updated weights for policy 0, policy_version 686297 (0.0008) [2023-12-28 00:11:10,781][106225] Updated weights for policy 1, policy_version 688139 (0.0008) [2023-12-28 00:11:10,836][106225] Updated weights for policy 1, policy_version 688149 (0.0006) [2023-12-28 00:11:10,885][106225] Updated weights for policy 1, policy_version 688159 (0.0008) [2023-12-28 00:11:11,098][106226] Updated weights for policy 0, policy_version 686307 (0.0009) [2023-12-28 00:11:11,165][106226] Updated weights for policy 0, policy_version 686317 (0.0011) [2023-12-28 00:11:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19133.2). Total num frames: 351944704. Throughput: 0: 9926.1, 1: 9905.7. Samples: 351918184. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:11:11,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.627')] [2023-12-28 00:11:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000688168_176201728.pth... [2023-12-28 00:11:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000687016_175906816.pth [2023-12-28 00:11:11,226][106226] Updated weights for policy 0, policy_version 686327 (0.0007) [2023-12-28 00:11:11,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000686336_175751168.pth... [2023-12-28 00:11:11,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000685184_175456256.pth [2023-12-28 00:11:11,639][106225] Updated weights for policy 1, policy_version 688169 (0.0008) [2023-12-28 00:11:11,705][106225] Updated weights for policy 1, policy_version 688179 (0.0008) [2023-12-28 00:11:11,777][106225] Updated weights for policy 1, policy_version 688189 (0.0008) [2023-12-28 00:11:11,839][106225] Updated weights for policy 1, policy_version 688199 (0.0008) [2023-12-28 00:11:12,059][106226] Updated weights for policy 0, policy_version 686337 (0.0010) [2023-12-28 00:11:12,129][106226] Updated weights for policy 0, policy_version 686347 (0.0007) [2023-12-28 00:11:12,191][106226] Updated weights for policy 0, policy_version 686357 (0.0008) [2023-12-28 00:11:12,253][106226] Updated weights for policy 0, policy_version 686367 (0.0008) [2023-12-28 00:11:12,561][106225] Updated weights for policy 1, policy_version 688209 (0.0010) [2023-12-28 00:11:12,635][106225] Updated weights for policy 1, policy_version 688219 (0.0009) [2023-12-28 00:11:12,698][106225] Updated weights for policy 1, policy_version 688229 (0.0005) [2023-12-28 00:11:13,003][106226] Updated weights for policy 0, policy_version 686377 (0.0010) [2023-12-28 00:11:13,065][106226] Updated weights for policy 0, policy_version 686387 (0.0008) [2023-12-28 00:11:13,119][106226] Updated weights for policy 0, policy_version 686397 (0.0009) [2023-12-28 00:11:13,382][106225] Updated weights for policy 1, policy_version 688239 (0.0009) [2023-12-28 00:11:13,439][106225] Updated weights for policy 1, policy_version 688249 (0.0010) [2023-12-28 00:11:13,499][106225] Updated weights for policy 1, policy_version 688259 (0.0010) [2023-12-28 00:11:13,687][106226] Updated weights for policy 0, policy_version 686407 (0.0008) [2023-12-28 00:11:13,751][106226] Updated weights for policy 0, policy_version 686417 (0.0011) [2023-12-28 00:11:13,815][106226] Updated weights for policy 0, policy_version 686427 (0.0008) [2023-12-28 00:11:14,222][106225] Updated weights for policy 1, policy_version 688269 (0.0009) [2023-12-28 00:11:14,276][106225] Updated weights for policy 1, policy_version 688279 (0.0008) [2023-12-28 00:11:14,322][106225] Updated weights for policy 1, policy_version 688289 (0.0008) [2023-12-28 00:11:14,460][106226] Updated weights for policy 0, policy_version 686437 (0.0010) [2023-12-28 00:11:14,514][106226] Updated weights for policy 0, policy_version 686447 (0.0010) [2023-12-28 00:11:14,565][106226] Updated weights for policy 0, policy_version 686457 (0.0010) [2023-12-28 00:11:15,086][106225] Updated weights for policy 1, policy_version 688299 (0.0010) [2023-12-28 00:11:15,150][106225] Updated weights for policy 1, policy_version 688309 (0.0009) [2023-12-28 00:11:15,209][106225] Updated weights for policy 1, policy_version 688319 (0.0010) [2023-12-28 00:11:15,287][106226] Updated weights for policy 0, policy_version 686467 (0.0011) [2023-12-28 00:11:15,360][106226] Updated weights for policy 0, policy_version 686477 (0.0011) [2023-12-28 00:11:15,423][106226] Updated weights for policy 0, policy_version 686487 (0.0011) [2023-12-28 00:11:15,864][106225] Updated weights for policy 1, policy_version 688329 (0.0010) [2023-12-28 00:11:15,924][106225] Updated weights for policy 1, policy_version 688339 (0.0005) [2023-12-28 00:11:15,975][106225] Updated weights for policy 1, policy_version 688349 (0.0008) [2023-12-28 00:11:16,029][106225] Updated weights for policy 1, policy_version 688359 (0.0006) [2023-12-28 00:11:16,092][106226] Updated weights for policy 0, policy_version 686497 (0.0010) [2023-12-28 00:11:16,159][106226] Updated weights for policy 0, policy_version 686507 (0.0006) [2023-12-28 00:11:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19188.7). Total num frames: 352043008. Throughput: 0: 9890.4, 1: 9785.2. Samples: 352034312. Policy #0 lag: (min: 22.0, avg: 35.4, max: 54.0) [2023-12-28 00:11:16,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.544')] [2023-12-28 00:11:16,225][106226] Updated weights for policy 0, policy_version 686517 (0.0005) [2023-12-28 00:11:16,287][106226] Updated weights for policy 0, policy_version 686527 (0.0006) [2023-12-28 00:11:16,629][106225] Updated weights for policy 1, policy_version 688369 (0.0010) [2023-12-28 00:11:16,688][106225] Updated weights for policy 1, policy_version 688379 (0.0007) [2023-12-28 00:11:16,744][106225] Updated weights for policy 1, policy_version 688389 (0.0005) [2023-12-28 00:11:16,926][106226] Updated weights for policy 0, policy_version 686537 (0.0010) [2023-12-28 00:11:16,990][106226] Updated weights for policy 0, policy_version 686547 (0.0007) [2023-12-28 00:11:17,059][106226] Updated weights for policy 0, policy_version 686557 (0.0008) [2023-12-28 00:11:17,366][106225] Updated weights for policy 1, policy_version 688399 (0.0005) [2023-12-28 00:11:17,427][106225] Updated weights for policy 1, policy_version 688409 (0.0007) [2023-12-28 00:11:17,487][106225] Updated weights for policy 1, policy_version 688419 (0.0008) [2023-12-28 00:11:17,722][106226] Updated weights for policy 0, policy_version 686567 (0.0006) [2023-12-28 00:11:17,786][106226] Updated weights for policy 0, policy_version 686577 (0.0006) [2023-12-28 00:11:17,837][106226] Updated weights for policy 0, policy_version 686587 (0.0005) [2023-12-28 00:11:18,149][106225] Updated weights for policy 1, policy_version 688429 (0.0006) [2023-12-28 00:11:18,203][106225] Updated weights for policy 1, policy_version 688439 (0.0005) [2023-12-28 00:11:18,257][106225] Updated weights for policy 1, policy_version 688449 (0.0005) [2023-12-28 00:11:18,501][106226] Updated weights for policy 0, policy_version 686597 (0.0009) [2023-12-28 00:11:18,561][106226] Updated weights for policy 0, policy_version 686607 (0.0009) [2023-12-28 00:11:18,621][106226] Updated weights for policy 0, policy_version 686617 (0.0009) [2023-12-28 00:11:18,969][106225] Updated weights for policy 1, policy_version 688459 (0.0006) [2023-12-28 00:11:19,019][106225] Updated weights for policy 1, policy_version 688469 (0.0009) [2023-12-28 00:11:19,075][106225] Updated weights for policy 1, policy_version 688479 (0.0007) [2023-12-28 00:11:19,244][106226] Updated weights for policy 0, policy_version 686627 (0.0008) [2023-12-28 00:11:19,315][106226] Updated weights for policy 0, policy_version 686637 (0.0008) [2023-12-28 00:11:19,403][106226] Updated weights for policy 0, policy_version 686647 (0.0009) [2023-12-28 00:11:19,803][106225] Updated weights for policy 1, policy_version 688489 (0.0008) [2023-12-28 00:11:19,886][106225] Updated weights for policy 1, policy_version 688499 (0.0011) [2023-12-28 00:11:19,954][106225] Updated weights for policy 1, policy_version 688509 (0.0011) [2023-12-28 00:11:20,016][106225] Updated weights for policy 1, policy_version 688519 (0.0010) [2023-12-28 00:11:20,041][106226] Updated weights for policy 0, policy_version 686657 (0.0006) [2023-12-28 00:11:20,093][106226] Updated weights for policy 0, policy_version 686667 (0.0007) [2023-12-28 00:11:20,148][106226] Updated weights for policy 0, policy_version 686677 (0.0011) [2023-12-28 00:11:20,199][106226] Updated weights for policy 0, policy_version 686687 (0.0010) [2023-12-28 00:11:20,723][106225] Updated weights for policy 1, policy_version 688529 (0.0012) [2023-12-28 00:11:20,783][106225] Updated weights for policy 1, policy_version 688539 (0.0011) [2023-12-28 00:11:20,845][106225] Updated weights for policy 1, policy_version 688549 (0.0011) [2023-12-28 00:11:20,960][106226] Updated weights for policy 0, policy_version 686697 (0.0011) [2023-12-28 00:11:21,026][106226] Updated weights for policy 0, policy_version 686707 (0.0011) [2023-12-28 00:11:21,096][106226] Updated weights for policy 0, policy_version 686717 (0.0010) [2023-12-28 00:11:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19272.0). Total num frames: 352149504. Throughput: 0: 9893.6, 1: 9768.2. Samples: 352155368. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:21,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-5.422')] [2023-12-28 00:11:21,624][106225] Updated weights for policy 1, policy_version 688559 (0.0010) [2023-12-28 00:11:21,691][106225] Updated weights for policy 1, policy_version 688569 (0.0008) [2023-12-28 00:11:21,763][106225] Updated weights for policy 1, policy_version 688579 (0.0009) [2023-12-28 00:11:21,818][106226] Updated weights for policy 0, policy_version 686727 (0.0011) [2023-12-28 00:11:21,882][106226] Updated weights for policy 0, policy_version 686737 (0.0010) [2023-12-28 00:11:21,947][106226] Updated weights for policy 0, policy_version 686747 (0.0006) [2023-12-28 00:11:22,536][106225] Updated weights for policy 1, policy_version 688589 (0.0008) [2023-12-28 00:11:22,590][106225] Updated weights for policy 1, policy_version 688599 (0.0008) [2023-12-28 00:11:22,644][106226] Updated weights for policy 0, policy_version 686757 (0.0009) [2023-12-28 00:11:22,644][106225] Updated weights for policy 1, policy_version 688609 (0.0008) [2023-12-28 00:11:22,705][106226] Updated weights for policy 0, policy_version 686767 (0.0011) [2023-12-28 00:11:22,766][106226] Updated weights for policy 0, policy_version 686777 (0.0011) [2023-12-28 00:11:23,362][106225] Updated weights for policy 1, policy_version 688619 (0.0007) [2023-12-28 00:11:23,428][106225] Updated weights for policy 1, policy_version 688629 (0.0010) [2023-12-28 00:11:23,475][106226] Updated weights for policy 0, policy_version 686787 (0.0010) [2023-12-28 00:11:23,498][106225] Updated weights for policy 1, policy_version 688640 (0.0008) [2023-12-28 00:11:23,529][106226] Updated weights for policy 0, policy_version 686797 (0.0011) [2023-12-28 00:11:23,579][106226] Updated weights for policy 0, policy_version 686807 (0.0010) [2023-12-28 00:11:24,161][106225] Updated weights for policy 1, policy_version 688650 (0.0007) [2023-12-28 00:11:24,215][106225] Updated weights for policy 1, policy_version 688660 (0.0005) [2023-12-28 00:11:24,236][106226] Updated weights for policy 0, policy_version 686817 (0.0010) [2023-12-28 00:11:24,284][106225] Updated weights for policy 1, policy_version 688670 (0.0006) [2023-12-28 00:11:24,288][106226] Updated weights for policy 0, policy_version 686827 (0.0006) [2023-12-28 00:11:24,336][106226] Updated weights for policy 0, policy_version 686837 (0.0006) [2023-12-28 00:11:24,349][106225] Updated weights for policy 1, policy_version 688680 (0.0005) [2023-12-28 00:11:24,385][106226] Updated weights for policy 0, policy_version 686847 (0.0005) [2023-12-28 00:11:24,927][106225] Updated weights for policy 1, policy_version 688690 (0.0010) [2023-12-28 00:11:24,990][106225] Updated weights for policy 1, policy_version 688700 (0.0010) [2023-12-28 00:11:25,047][106225] Updated weights for policy 1, policy_version 688710 (0.0011) [2023-12-28 00:11:25,095][106226] Updated weights for policy 0, policy_version 686857 (0.0008) [2023-12-28 00:11:25,151][106226] Updated weights for policy 0, policy_version 686867 (0.0007) [2023-12-28 00:11:25,208][106226] Updated weights for policy 0, policy_version 686877 (0.0005) [2023-12-28 00:11:25,633][106225] Updated weights for policy 1, policy_version 688720 (0.0007) [2023-12-28 00:11:25,687][106225] Updated weights for policy 1, policy_version 688730 (0.0010) [2023-12-28 00:11:25,733][106225] Updated weights for policy 1, policy_version 688740 (0.0010) [2023-12-28 00:11:25,787][106226] Updated weights for policy 0, policy_version 686887 (0.0007) [2023-12-28 00:11:25,837][106226] Updated weights for policy 0, policy_version 686897 (0.0008) [2023-12-28 00:11:25,892][106226] Updated weights for policy 0, policy_version 686907 (0.0009) [2023-12-28 00:11:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19272.0). Total num frames: 352247808. Throughput: 0: 9831.1, 1: 9720.4. Samples: 352212480. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:26,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-5.598')] [2023-12-28 00:11:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000688744_176349184.pth... [2023-12-28 00:11:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000686912_175898624.pth... [2023-12-28 00:11:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000685728_175595520.pth [2023-12-28 00:11:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000687592_176054272.pth [2023-12-28 00:11:26,329][106225] Updated weights for policy 1, policy_version 688750 (0.0010) [2023-12-28 00:11:26,395][106225] Updated weights for policy 1, policy_version 688760 (0.0011) [2023-12-28 00:11:26,458][106225] Updated weights for policy 1, policy_version 688770 (0.0011) [2023-12-28 00:11:26,624][106226] Updated weights for policy 0, policy_version 686917 (0.0010) [2023-12-28 00:11:26,681][106226] Updated weights for policy 0, policy_version 686927 (0.0010) [2023-12-28 00:11:26,734][106226] Updated weights for policy 0, policy_version 686937 (0.0010) [2023-12-28 00:11:27,158][106225] Updated weights for policy 1, policy_version 688780 (0.0010) [2023-12-28 00:11:27,210][106225] Updated weights for policy 1, policy_version 688790 (0.0010) [2023-12-28 00:11:27,267][106225] Updated weights for policy 1, policy_version 688800 (0.0010) [2023-12-28 00:11:27,347][106226] Updated weights for policy 0, policy_version 686947 (0.0009) [2023-12-28 00:11:27,407][106226] Updated weights for policy 0, policy_version 686957 (0.0008) [2023-12-28 00:11:27,459][106226] Updated weights for policy 0, policy_version 686967 (0.0006) [2023-12-28 00:11:27,911][106225] Updated weights for policy 1, policy_version 688810 (0.0008) [2023-12-28 00:11:27,959][106225] Updated weights for policy 1, policy_version 688820 (0.0005) [2023-12-28 00:11:28,003][106225] Updated weights for policy 1, policy_version 688830 (0.0005) [2023-12-28 00:11:28,059][106225] Updated weights for policy 1, policy_version 688840 (0.0005) [2023-12-28 00:11:28,105][106226] Updated weights for policy 0, policy_version 686977 (0.0009) [2023-12-28 00:11:28,154][106226] Updated weights for policy 0, policy_version 686987 (0.0005) [2023-12-28 00:11:28,205][106226] Updated weights for policy 0, policy_version 686997 (0.0005) [2023-12-28 00:11:28,256][106226] Updated weights for policy 0, policy_version 687007 (0.0005) [2023-12-28 00:11:28,616][106225] Updated weights for policy 1, policy_version 688850 (0.0010) [2023-12-28 00:11:28,678][106225] Updated weights for policy 1, policy_version 688860 (0.0010) [2023-12-28 00:11:28,727][106225] Updated weights for policy 1, policy_version 688870 (0.0010) [2023-12-28 00:11:28,972][106226] Updated weights for policy 0, policy_version 687017 (0.0007) [2023-12-28 00:11:29,028][106226] Updated weights for policy 0, policy_version 687027 (0.0009) [2023-12-28 00:11:29,081][106226] Updated weights for policy 0, policy_version 687037 (0.0009) [2023-12-28 00:11:29,397][106225] Updated weights for policy 1, policy_version 688880 (0.0009) [2023-12-28 00:11:29,457][106225] Updated weights for policy 1, policy_version 688890 (0.0008) [2023-12-28 00:11:29,514][106225] Updated weights for policy 1, policy_version 688900 (0.0009) [2023-12-28 00:11:29,743][106226] Updated weights for policy 0, policy_version 687047 (0.0007) [2023-12-28 00:11:29,799][106226] Updated weights for policy 0, policy_version 687057 (0.0005) [2023-12-28 00:11:29,865][106226] Updated weights for policy 0, policy_version 687067 (0.0009) [2023-12-28 00:11:30,271][106225] Updated weights for policy 1, policy_version 688910 (0.0007) [2023-12-28 00:11:30,331][106225] Updated weights for policy 1, policy_version 688920 (0.0008) [2023-12-28 00:11:30,402][106225] Updated weights for policy 1, policy_version 688930 (0.0008) [2023-12-28 00:11:30,599][106226] Updated weights for policy 0, policy_version 687077 (0.0009) [2023-12-28 00:11:30,650][106226] Updated weights for policy 0, policy_version 687087 (0.0008) [2023-12-28 00:11:30,703][106226] Updated weights for policy 0, policy_version 687097 (0.0008) [2023-12-28 00:11:31,092][106225] Updated weights for policy 1, policy_version 688940 (0.0007) [2023-12-28 00:11:31,157][106225] Updated weights for policy 1, policy_version 688950 (0.0008) [2023-12-28 00:11:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19272.0). Total num frames: 352346112. Throughput: 0: 9961.9, 1: 9869.5. Samples: 352339420. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:31,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.295')] [2023-12-28 00:11:31,223][106225] Updated weights for policy 1, policy_version 688960 (0.0009) [2023-12-28 00:11:31,518][106226] Updated weights for policy 0, policy_version 687107 (0.0008) [2023-12-28 00:11:31,571][106226] Updated weights for policy 0, policy_version 687117 (0.0011) [2023-12-28 00:11:31,629][106226] Updated weights for policy 0, policy_version 687127 (0.0011) [2023-12-28 00:11:31,910][106225] Updated weights for policy 1, policy_version 688970 (0.0008) [2023-12-28 00:11:31,956][106225] Updated weights for policy 1, policy_version 688980 (0.0008) [2023-12-28 00:11:32,005][106225] Updated weights for policy 1, policy_version 688990 (0.0008) [2023-12-28 00:11:32,062][106225] Updated weights for policy 1, policy_version 689000 (0.0008) [2023-12-28 00:11:32,293][106226] Updated weights for policy 0, policy_version 687137 (0.0011) [2023-12-28 00:11:32,353][106226] Updated weights for policy 0, policy_version 687147 (0.0010) [2023-12-28 00:11:32,415][106226] Updated weights for policy 0, policy_version 687157 (0.0011) [2023-12-28 00:11:32,474][106226] Updated weights for policy 0, policy_version 687167 (0.0006) [2023-12-28 00:11:32,863][106225] Updated weights for policy 1, policy_version 689010 (0.0008) [2023-12-28 00:11:32,917][106225] Updated weights for policy 1, policy_version 689020 (0.0006) [2023-12-28 00:11:32,971][106225] Updated weights for policy 1, policy_version 689030 (0.0005) [2023-12-28 00:11:33,094][106226] Updated weights for policy 0, policy_version 687177 (0.0010) [2023-12-28 00:11:33,151][106226] Updated weights for policy 0, policy_version 687187 (0.0010) [2023-12-28 00:11:33,218][106226] Updated weights for policy 0, policy_version 687197 (0.0006) [2023-12-28 00:11:33,592][106225] Updated weights for policy 1, policy_version 689040 (0.0008) [2023-12-28 00:11:33,649][106225] Updated weights for policy 1, policy_version 689051 (0.0010) [2023-12-28 00:11:33,703][106225] Updated weights for policy 1, policy_version 689061 (0.0008) [2023-12-28 00:11:33,735][106226] Updated weights for policy 0, policy_version 687207 (0.0009) [2023-12-28 00:11:33,786][106226] Updated weights for policy 0, policy_version 687217 (0.0010) [2023-12-28 00:11:33,842][106226] Updated weights for policy 0, policy_version 687227 (0.0008) [2023-12-28 00:11:34,365][106225] Updated weights for policy 1, policy_version 689071 (0.0005) [2023-12-28 00:11:34,427][106225] Updated weights for policy 1, policy_version 689081 (0.0008) [2023-12-28 00:11:34,486][106225] Updated weights for policy 1, policy_version 689091 (0.0008) [2023-12-28 00:11:34,518][106226] Updated weights for policy 0, policy_version 687237 (0.0010) [2023-12-28 00:11:34,583][106226] Updated weights for policy 0, policy_version 687247 (0.0011) [2023-12-28 00:11:34,654][106226] Updated weights for policy 0, policy_version 687257 (0.0011) [2023-12-28 00:11:35,119][106225] Updated weights for policy 1, policy_version 689101 (0.0007) [2023-12-28 00:11:35,171][106225] Updated weights for policy 1, policy_version 689111 (0.0007) [2023-12-28 00:11:35,233][106225] Updated weights for policy 1, policy_version 689121 (0.0006) [2023-12-28 00:11:35,360][106226] Updated weights for policy 0, policy_version 687267 (0.0011) [2023-12-28 00:11:35,410][106226] Updated weights for policy 0, policy_version 687277 (0.0010) [2023-12-28 00:11:35,469][106226] Updated weights for policy 0, policy_version 687287 (0.0010) [2023-12-28 00:11:35,939][106225] Updated weights for policy 1, policy_version 689131 (0.0008) [2023-12-28 00:11:36,004][106225] Updated weights for policy 1, policy_version 689141 (0.0008) [2023-12-28 00:11:36,070][106225] Updated weights for policy 1, policy_version 689151 (0.0007) [2023-12-28 00:11:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19355.3). Total num frames: 352452608. Throughput: 0: 10075.0, 1: 9889.1. Samples: 352461196. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:36,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-5.772')] [2023-12-28 00:11:36,190][106226] Updated weights for policy 0, policy_version 687297 (0.0011) [2023-12-28 00:11:36,258][106226] Updated weights for policy 0, policy_version 687307 (0.0011) [2023-12-28 00:11:36,320][106226] Updated weights for policy 0, policy_version 687317 (0.0011) [2023-12-28 00:11:36,383][106226] Updated weights for policy 0, policy_version 687327 (0.0011) [2023-12-28 00:11:36,835][106225] Updated weights for policy 1, policy_version 689161 (0.0008) [2023-12-28 00:11:36,899][106225] Updated weights for policy 1, policy_version 689171 (0.0008) [2023-12-28 00:11:36,961][106225] Updated weights for policy 1, policy_version 689181 (0.0009) [2023-12-28 00:11:37,010][106225] Updated weights for policy 1, policy_version 689191 (0.0007) [2023-12-28 00:11:37,100][106226] Updated weights for policy 0, policy_version 687337 (0.0011) [2023-12-28 00:11:37,154][106226] Updated weights for policy 0, policy_version 687347 (0.0010) [2023-12-28 00:11:37,212][106226] Updated weights for policy 0, policy_version 687357 (0.0011) [2023-12-28 00:11:37,769][106225] Updated weights for policy 1, policy_version 689201 (0.0006) [2023-12-28 00:11:37,828][106225] Updated weights for policy 1, policy_version 689211 (0.0006) [2023-12-28 00:11:37,860][106226] Updated weights for policy 0, policy_version 687367 (0.0007) [2023-12-28 00:11:37,884][106225] Updated weights for policy 1, policy_version 689221 (0.0005) [2023-12-28 00:11:37,912][106226] Updated weights for policy 0, policy_version 687377 (0.0008) [2023-12-28 00:11:37,976][106226] Updated weights for policy 0, policy_version 687387 (0.0009) [2023-12-28 00:11:38,529][106225] Updated weights for policy 1, policy_version 689231 (0.0009) [2023-12-28 00:11:38,548][106226] Updated weights for policy 0, policy_version 687397 (0.0008) [2023-12-28 00:11:38,591][106225] Updated weights for policy 1, policy_version 689241 (0.0010) [2023-12-28 00:11:38,613][106226] Updated weights for policy 0, policy_version 687407 (0.0011) [2023-12-28 00:11:38,651][106225] Updated weights for policy 1, policy_version 689251 (0.0010) [2023-12-28 00:11:38,677][106226] Updated weights for policy 0, policy_version 687417 (0.0011) [2023-12-28 00:11:39,289][106225] Updated weights for policy 1, policy_version 689261 (0.0010) [2023-12-28 00:11:39,355][106225] Updated weights for policy 1, policy_version 689271 (0.0011) [2023-12-28 00:11:39,428][106225] Updated weights for policy 1, policy_version 689281 (0.0012) [2023-12-28 00:11:39,433][106226] Updated weights for policy 0, policy_version 687427 (0.0011) [2023-12-28 00:11:39,497][106226] Updated weights for policy 0, policy_version 687437 (0.0006) [2023-12-28 00:11:39,558][106226] Updated weights for policy 0, policy_version 687447 (0.0006) [2023-12-28 00:11:40,216][106225] Updated weights for policy 1, policy_version 689291 (0.0010) [2023-12-28 00:11:40,275][106225] Updated weights for policy 1, policy_version 689301 (0.0009) [2023-12-28 00:11:40,278][106226] Updated weights for policy 0, policy_version 687457 (0.0010) [2023-12-28 00:11:40,338][106225] Updated weights for policy 1, policy_version 689311 (0.0011) [2023-12-28 00:11:40,339][106226] Updated weights for policy 0, policy_version 687467 (0.0011) [2023-12-28 00:11:40,403][106226] Updated weights for policy 0, policy_version 687477 (0.0011) [2023-12-28 00:11:40,464][106226] Updated weights for policy 0, policy_version 687487 (0.0011) [2023-12-28 00:11:41,007][106225] Updated weights for policy 1, policy_version 689321 (0.0010) [2023-12-28 00:11:41,082][106225] Updated weights for policy 1, policy_version 689331 (0.0008) [2023-12-28 00:11:41,149][106225] Updated weights for policy 1, policy_version 689341 (0.0011) [2023-12-28 00:11:41,158][106226] Updated weights for policy 0, policy_version 687497 (0.0008) [2023-12-28 00:11:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19327.6). Total num frames: 352542720. Throughput: 0: 10121.2, 1: 9876.7. Samples: 352520784. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:41,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-5.517')] [2023-12-28 00:11:41,214][106225] Updated weights for policy 1, policy_version 689351 (0.0011) [2023-12-28 00:11:41,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000689352_176504832.pth... [2023-12-28 00:11:41,222][106226] Updated weights for policy 0, policy_version 687507 (0.0006) [2023-12-28 00:11:41,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000688168_176201728.pth [2023-12-28 00:11:41,287][106226] Updated weights for policy 0, policy_version 687517 (0.0008) [2023-12-28 00:11:41,301][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000687520_176054272.pth... [2023-12-28 00:11:41,304][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000686336_175751168.pth [2023-12-28 00:11:41,947][106225] Updated weights for policy 1, policy_version 689361 (0.0008) [2023-12-28 00:11:42,006][106225] Updated weights for policy 1, policy_version 689371 (0.0009) [2023-12-28 00:11:42,020][106226] Updated weights for policy 0, policy_version 687527 (0.0007) [2023-12-28 00:11:42,061][106225] Updated weights for policy 1, policy_version 689381 (0.0011) [2023-12-28 00:11:42,087][106226] Updated weights for policy 0, policy_version 687537 (0.0008) [2023-12-28 00:11:42,152][106226] Updated weights for policy 0, policy_version 687547 (0.0006) [2023-12-28 00:11:42,766][106226] Updated weights for policy 0, policy_version 687557 (0.0009) [2023-12-28 00:11:42,789][106225] Updated weights for policy 1, policy_version 689391 (0.0010) [2023-12-28 00:11:42,822][106226] Updated weights for policy 0, policy_version 687567 (0.0007) [2023-12-28 00:11:42,850][106225] Updated weights for policy 1, policy_version 689401 (0.0010) [2023-12-28 00:11:42,875][106226] Updated weights for policy 0, policy_version 687577 (0.0007) [2023-12-28 00:11:42,911][106225] Updated weights for policy 1, policy_version 689411 (0.0010) [2023-12-28 00:11:43,578][106226] Updated weights for policy 0, policy_version 687587 (0.0007) [2023-12-28 00:11:43,606][106225] Updated weights for policy 1, policy_version 689421 (0.0010) [2023-12-28 00:11:43,627][106226] Updated weights for policy 0, policy_version 687597 (0.0005) [2023-12-28 00:11:43,663][106225] Updated weights for policy 1, policy_version 689431 (0.0010) [2023-12-28 00:11:43,679][106226] Updated weights for policy 0, policy_version 687607 (0.0005) [2023-12-28 00:11:43,727][106225] Updated weights for policy 1, policy_version 689441 (0.0010) [2023-12-28 00:11:44,328][106226] Updated weights for policy 0, policy_version 687617 (0.0006) [2023-12-28 00:11:44,383][106226] Updated weights for policy 0, policy_version 687627 (0.0006) [2023-12-28 00:11:44,439][106226] Updated weights for policy 0, policy_version 687637 (0.0008) [2023-12-28 00:11:44,463][106225] Updated weights for policy 1, policy_version 689451 (0.0011) [2023-12-28 00:11:44,504][106226] Updated weights for policy 0, policy_version 687647 (0.0006) [2023-12-28 00:11:44,525][106225] Updated weights for policy 1, policy_version 689461 (0.0010) [2023-12-28 00:11:44,593][106225] Updated weights for policy 1, policy_version 689471 (0.0005) [2023-12-28 00:11:45,169][106226] Updated weights for policy 0, policy_version 687657 (0.0008) [2023-12-28 00:11:45,229][106226] Updated weights for policy 0, policy_version 687667 (0.0009) [2023-12-28 00:11:45,244][106225] Updated weights for policy 1, policy_version 689481 (0.0005) [2023-12-28 00:11:45,279][106226] Updated weights for policy 0, policy_version 687677 (0.0006) [2023-12-28 00:11:45,305][106225] Updated weights for policy 1, policy_version 689491 (0.0007) [2023-12-28 00:11:45,366][106225] Updated weights for policy 1, policy_version 689501 (0.0009) [2023-12-28 00:11:45,414][106225] Updated weights for policy 1, policy_version 689511 (0.0006) [2023-12-28 00:11:45,958][106226] Updated weights for policy 0, policy_version 687687 (0.0006) [2023-12-28 00:11:46,032][106226] Updated weights for policy 0, policy_version 687697 (0.0009) [2023-12-28 00:11:46,073][106225] Updated weights for policy 1, policy_version 689521 (0.0006) [2023-12-28 00:11:46,105][106226] Updated weights for policy 0, policy_version 687707 (0.0008) [2023-12-28 00:11:46,125][106225] Updated weights for policy 1, policy_version 689531 (0.0005) [2023-12-28 00:11:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19410.9). Total num frames: 352649216. Throughput: 0: 10163.3, 1: 9872.3. Samples: 352639084. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:46,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-5.484')] [2023-12-28 00:11:46,182][106225] Updated weights for policy 1, policy_version 689541 (0.0007) [2023-12-28 00:11:46,706][106225] Updated weights for policy 1, policy_version 689551 (0.0006) [2023-12-28 00:11:46,726][106226] Updated weights for policy 0, policy_version 687717 (0.0007) [2023-12-28 00:11:46,770][106225] Updated weights for policy 1, policy_version 689561 (0.0005) [2023-12-28 00:11:46,791][106226] Updated weights for policy 0, policy_version 687727 (0.0005) [2023-12-28 00:11:46,826][106225] Updated weights for policy 1, policy_version 689571 (0.0005) [2023-12-28 00:11:46,856][106226] Updated weights for policy 0, policy_version 687737 (0.0005) [2023-12-28 00:11:47,388][106225] Updated weights for policy 1, policy_version 689581 (0.0005) [2023-12-28 00:11:47,446][106225] Updated weights for policy 1, policy_version 689591 (0.0005) [2023-12-28 00:11:47,469][106226] Updated weights for policy 0, policy_version 687747 (0.0007) [2023-12-28 00:11:47,505][106225] Updated weights for policy 1, policy_version 689601 (0.0005) [2023-12-28 00:11:47,533][106226] Updated weights for policy 0, policy_version 687757 (0.0008) [2023-12-28 00:11:47,597][106226] Updated weights for policy 0, policy_version 687767 (0.0006) [2023-12-28 00:11:48,226][106225] Updated weights for policy 1, policy_version 689611 (0.0007) [2023-12-28 00:11:48,227][106226] Updated weights for policy 0, policy_version 687777 (0.0006) [2023-12-28 00:11:48,273][106225] Updated weights for policy 1, policy_version 689621 (0.0008) [2023-12-28 00:11:48,288][106226] Updated weights for policy 0, policy_version 687787 (0.0009) [2023-12-28 00:11:48,331][106225] Updated weights for policy 1, policy_version 689631 (0.0009) [2023-12-28 00:11:48,345][106226] Updated weights for policy 0, policy_version 687797 (0.0006) [2023-12-28 00:11:48,399][106226] Updated weights for policy 0, policy_version 687807 (0.0008) [2023-12-28 00:11:49,077][106226] Updated weights for policy 0, policy_version 687817 (0.0009) [2023-12-28 00:11:49,100][106225] Updated weights for policy 1, policy_version 689641 (0.0009) [2023-12-28 00:11:49,142][106226] Updated weights for policy 0, policy_version 687827 (0.0009) [2023-12-28 00:11:49,156][106225] Updated weights for policy 1, policy_version 689651 (0.0006) [2023-12-28 00:11:49,206][106226] Updated weights for policy 0, policy_version 687837 (0.0007) [2023-12-28 00:11:49,211][106225] Updated weights for policy 1, policy_version 689661 (0.0007) [2023-12-28 00:11:49,277][106225] Updated weights for policy 1, policy_version 689671 (0.0008) [2023-12-28 00:11:49,997][106225] Updated weights for policy 1, policy_version 689681 (0.0009) [2023-12-28 00:11:50,036][106226] Updated weights for policy 0, policy_version 687847 (0.0009) [2023-12-28 00:11:50,060][106225] Updated weights for policy 1, policy_version 689691 (0.0008) [2023-12-28 00:11:50,097][106226] Updated weights for policy 0, policy_version 687857 (0.0007) [2023-12-28 00:11:50,119][106225] Updated weights for policy 1, policy_version 689701 (0.0009) [2023-12-28 00:11:50,157][106226] Updated weights for policy 0, policy_version 687867 (0.0007) [2023-12-28 00:11:50,800][106226] Updated weights for policy 0, policy_version 687877 (0.0007) [2023-12-28 00:11:50,861][106226] Updated weights for policy 0, policy_version 687887 (0.0006) [2023-12-28 00:11:50,887][106225] Updated weights for policy 1, policy_version 689711 (0.0008) [2023-12-28 00:11:50,928][106226] Updated weights for policy 0, policy_version 687897 (0.0008) [2023-12-28 00:11:50,949][106225] Updated weights for policy 1, policy_version 689721 (0.0009) [2023-12-28 00:11:51,010][106225] Updated weights for policy 1, policy_version 689731 (0.0008) [2023-12-28 00:11:51,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19438.6). Total num frames: 352755712. Throughput: 0: 10129.0, 1: 9947.2. Samples: 352761480. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:51,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.025')] [2023-12-28 00:11:51,586][106226] Updated weights for policy 0, policy_version 687907 (0.0006) [2023-12-28 00:11:51,651][106226] Updated weights for policy 0, policy_version 687917 (0.0008) [2023-12-28 00:11:51,704][106226] Updated weights for policy 0, policy_version 687927 (0.0008) [2023-12-28 00:11:51,804][106225] Updated weights for policy 1, policy_version 689741 (0.0008) [2023-12-28 00:11:51,869][106225] Updated weights for policy 1, policy_version 689751 (0.0006) [2023-12-28 00:11:51,931][106225] Updated weights for policy 1, policy_version 689761 (0.0006) [2023-12-28 00:11:52,463][106226] Updated weights for policy 0, policy_version 687937 (0.0008) [2023-12-28 00:11:52,518][106226] Updated weights for policy 0, policy_version 687947 (0.0008) [2023-12-28 00:11:52,575][106226] Updated weights for policy 0, policy_version 687957 (0.0008) [2023-12-28 00:11:52,600][106225] Updated weights for policy 1, policy_version 689771 (0.0008) [2023-12-28 00:11:52,634][106226] Updated weights for policy 0, policy_version 687967 (0.0007) [2023-12-28 00:11:52,660][106225] Updated weights for policy 1, policy_version 689781 (0.0006) [2023-12-28 00:11:52,720][106225] Updated weights for policy 1, policy_version 689791 (0.0006) [2023-12-28 00:11:53,278][106225] Updated weights for policy 1, policy_version 689801 (0.0006) [2023-12-28 00:11:53,326][106225] Updated weights for policy 1, policy_version 689811 (0.0008) [2023-12-28 00:11:53,382][106225] Updated weights for policy 1, policy_version 689821 (0.0008) [2023-12-28 00:11:53,432][106225] Updated weights for policy 1, policy_version 689831 (0.0007) [2023-12-28 00:11:53,455][106226] Updated weights for policy 0, policy_version 687977 (0.0007) [2023-12-28 00:11:53,506][106226] Updated weights for policy 0, policy_version 687987 (0.0006) [2023-12-28 00:11:53,566][106226] Updated weights for policy 0, policy_version 687997 (0.0007) [2023-12-28 00:11:54,174][106225] Updated weights for policy 1, policy_version 689841 (0.0006) [2023-12-28 00:11:54,233][106225] Updated weights for policy 1, policy_version 689851 (0.0007) [2023-12-28 00:11:54,246][106226] Updated weights for policy 0, policy_version 688007 (0.0010) [2023-12-28 00:11:54,294][106226] Updated weights for policy 0, policy_version 688017 (0.0009) [2023-12-28 00:11:54,299][106225] Updated weights for policy 1, policy_version 689861 (0.0008) [2023-12-28 00:11:54,345][106226] Updated weights for policy 0, policy_version 688027 (0.0005) [2023-12-28 00:11:54,964][106225] Updated weights for policy 1, policy_version 689871 (0.0006) [2023-12-28 00:11:55,004][106226] Updated weights for policy 0, policy_version 688037 (0.0008) [2023-12-28 00:11:55,024][106225] Updated weights for policy 1, policy_version 689881 (0.0006) [2023-12-28 00:11:55,064][106226] Updated weights for policy 0, policy_version 688047 (0.0010) [2023-12-28 00:11:55,072][106225] Updated weights for policy 1, policy_version 689891 (0.0005) [2023-12-28 00:11:55,125][106226] Updated weights for policy 0, policy_version 688057 (0.0010) [2023-12-28 00:11:55,681][106225] Updated weights for policy 1, policy_version 689901 (0.0006) [2023-12-28 00:11:55,741][106225] Updated weights for policy 1, policy_version 689911 (0.0005) [2023-12-28 00:11:55,748][106226] Updated weights for policy 0, policy_version 688067 (0.0010) [2023-12-28 00:11:55,795][106225] Updated weights for policy 1, policy_version 689921 (0.0010) [2023-12-28 00:11:55,806][106226] Updated weights for policy 0, policy_version 688077 (0.0010) [2023-12-28 00:11:55,869][106226] Updated weights for policy 0, policy_version 688087 (0.0007) [2023-12-28 00:11:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19466.4). Total num frames: 352854016. Throughput: 0: 10036.8, 1: 9981.3. Samples: 352818996. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:11:56,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.324')] [2023-12-28 00:11:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000689928_176652288.pth... [2023-12-28 00:11:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000688096_176201728.pth... [2023-12-28 00:11:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000686912_175898624.pth [2023-12-28 00:11:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000688744_176349184.pth [2023-12-28 00:11:56,453][106225] Updated weights for policy 1, policy_version 689931 (0.0010) [2023-12-28 00:11:56,511][106225] Updated weights for policy 1, policy_version 689941 (0.0010) [2023-12-28 00:11:56,542][106226] Updated weights for policy 0, policy_version 688097 (0.0010) [2023-12-28 00:11:56,567][106225] Updated weights for policy 1, policy_version 689951 (0.0010) [2023-12-28 00:11:56,598][106226] Updated weights for policy 0, policy_version 688107 (0.0010) [2023-12-28 00:11:56,660][106226] Updated weights for policy 0, policy_version 688117 (0.0010) [2023-12-28 00:11:56,716][106226] Updated weights for policy 0, policy_version 688127 (0.0010) [2023-12-28 00:11:57,216][106225] Updated weights for policy 1, policy_version 689961 (0.0006) [2023-12-28 00:11:57,279][106225] Updated weights for policy 1, policy_version 689971 (0.0010) [2023-12-28 00:11:57,345][106225] Updated weights for policy 1, policy_version 689981 (0.0007) [2023-12-28 00:11:57,405][106225] Updated weights for policy 1, policy_version 689991 (0.0010) [2023-12-28 00:11:57,414][106226] Updated weights for policy 0, policy_version 688137 (0.0010) [2023-12-28 00:11:57,460][106226] Updated weights for policy 0, policy_version 688147 (0.0010) [2023-12-28 00:11:57,482][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000005 [2023-12-28 00:11:58,080][106225] Updated weights for policy 1, policy_version 690001 (0.0010) [2023-12-28 00:11:58,129][106225] Updated weights for policy 1, policy_version 690011 (0.0010) [2023-12-28 00:11:58,179][106225] Updated weights for policy 1, policy_version 690021 (0.0010) [2023-12-28 00:11:58,242][106226] Updated weights for policy 0, policy_version 688157 (0.0009) [2023-12-28 00:11:58,307][106226] Updated weights for policy 0, policy_version 688167 (0.0008) [2023-12-28 00:11:58,389][106226] Updated weights for policy 0, policy_version 688177 (0.0009) [2023-12-28 00:11:59,016][106225] Updated weights for policy 1, policy_version 690031 (0.0009) [2023-12-28 00:11:59,099][106225] Updated weights for policy 1, policy_version 690043 (0.0007) [2023-12-28 00:11:59,165][106225] Updated weights for policy 1, policy_version 690053 (0.0007) [2023-12-28 00:11:59,192][106226] Updated weights for policy 0, policy_version 688187 (0.0008) [2023-12-28 00:11:59,265][106226] Updated weights for policy 0, policy_version 688197 (0.0008) [2023-12-28 00:11:59,322][106226] Updated weights for policy 0, policy_version 688207 (0.0008) [2023-12-28 00:11:59,903][106225] Updated weights for policy 1, policy_version 690063 (0.0008) [2023-12-28 00:11:59,961][106225] Updated weights for policy 1, policy_version 690073 (0.0009) [2023-12-28 00:12:00,013][106225] Updated weights for policy 1, policy_version 690083 (0.0007) [2023-12-28 00:12:00,064][106226] Updated weights for policy 0, policy_version 688217 (0.0008) [2023-12-28 00:12:00,121][106226] Updated weights for policy 0, policy_version 688227 (0.0007) [2023-12-28 00:12:00,192][106226] Updated weights for policy 0, policy_version 688237 (0.0010) [2023-12-28 00:12:00,251][106226] Updated weights for policy 0, policy_version 688247 (0.0007) [2023-12-28 00:12:00,622][106225] Updated weights for policy 1, policy_version 690093 (0.0005) [2023-12-28 00:12:00,666][106225] Updated weights for policy 1, policy_version 690103 (0.0005) [2023-12-28 00:12:00,712][106225] Updated weights for policy 1, policy_version 690113 (0.0005) [2023-12-28 00:12:00,828][106226] Updated weights for policy 0, policy_version 688257 (0.0006) [2023-12-28 00:12:00,880][106226] Updated weights for policy 0, policy_version 688267 (0.0005) [2023-12-28 00:12:00,929][106226] Updated weights for policy 0, policy_version 688277 (0.0008) [2023-12-28 00:12:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19494.2). Total num frames: 352952320. Throughput: 0: 10040.0, 1: 10039.2. Samples: 352937876. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:01,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.168')] [2023-12-28 00:12:01,447][106225] Updated weights for policy 1, policy_version 690123 (0.0007) [2023-12-28 00:12:01,515][106225] Updated weights for policy 1, policy_version 690133 (0.0008) [2023-12-28 00:12:01,570][106225] Updated weights for policy 1, policy_version 690143 (0.0008) [2023-12-28 00:12:01,670][106226] Updated weights for policy 0, policy_version 688288 (0.0008) [2023-12-28 00:12:01,737][106226] Updated weights for policy 0, policy_version 688298 (0.0008) [2023-12-28 00:12:01,798][106226] Updated weights for policy 0, policy_version 688308 (0.0008) [2023-12-28 00:12:02,318][106225] Updated weights for policy 1, policy_version 690153 (0.0010) [2023-12-28 00:12:02,385][106225] Updated weights for policy 1, policy_version 690163 (0.0010) [2023-12-28 00:12:02,445][106225] Updated weights for policy 1, policy_version 690173 (0.0010) [2023-12-28 00:12:02,510][106225] Updated weights for policy 1, policy_version 690183 (0.0009) [2023-12-28 00:12:02,526][106226] Updated weights for policy 0, policy_version 688318 (0.0010) [2023-12-28 00:12:02,576][106226] Updated weights for policy 0, policy_version 688328 (0.0010) [2023-12-28 00:12:02,636][106226] Updated weights for policy 0, policy_version 688338 (0.0009) [2023-12-28 00:12:03,192][106225] Updated weights for policy 1, policy_version 690193 (0.0010) [2023-12-28 00:12:03,253][106225] Updated weights for policy 1, policy_version 690203 (0.0010) [2023-12-28 00:12:03,314][106225] Updated weights for policy 1, policy_version 690213 (0.0007) [2023-12-28 00:12:03,339][106226] Updated weights for policy 0, policy_version 688348 (0.0011) [2023-12-28 00:12:03,389][106226] Updated weights for policy 0, policy_version 688358 (0.0007) [2023-12-28 00:12:03,447][106226] Updated weights for policy 0, policy_version 688368 (0.0007) [2023-12-28 00:12:03,949][106225] Updated weights for policy 1, policy_version 690223 (0.0009) [2023-12-28 00:12:04,005][106226] Updated weights for policy 0, policy_version 688378 (0.0007) [2023-12-28 00:12:04,014][106225] Updated weights for policy 1, policy_version 690233 (0.0011) [2023-12-28 00:12:04,067][106226] Updated weights for policy 0, policy_version 688388 (0.0010) [2023-12-28 00:12:04,068][106225] Updated weights for policy 1, policy_version 690243 (0.0010) [2023-12-28 00:12:04,132][106226] Updated weights for policy 0, policy_version 688398 (0.0010) [2023-12-28 00:12:04,189][106226] Updated weights for policy 0, policy_version 688408 (0.0011) [2023-12-28 00:12:04,764][106225] Updated weights for policy 1, policy_version 690253 (0.0008) [2023-12-28 00:12:04,817][106225] Updated weights for policy 1, policy_version 690263 (0.0006) [2023-12-28 00:12:04,872][106225] Updated weights for policy 1, policy_version 690273 (0.0006) [2023-12-28 00:12:04,899][106226] Updated weights for policy 0, policy_version 688418 (0.0005) [2023-12-28 00:12:04,958][106226] Updated weights for policy 0, policy_version 688428 (0.0006) [2023-12-28 00:12:05,024][106226] Updated weights for policy 0, policy_version 688438 (0.0006) [2023-12-28 00:12:05,453][106225] Updated weights for policy 1, policy_version 690283 (0.0007) [2023-12-28 00:12:05,502][106225] Updated weights for policy 1, policy_version 690293 (0.0009) [2023-12-28 00:12:05,555][106225] Updated weights for policy 1, policy_version 690303 (0.0008) [2023-12-28 00:12:05,589][106226] Updated weights for policy 0, policy_version 688448 (0.0005) [2023-12-28 00:12:05,636][106226] Updated weights for policy 0, policy_version 688458 (0.0005) [2023-12-28 00:12:05,682][106226] Updated weights for policy 0, policy_version 688468 (0.0005) [2023-12-28 00:12:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19522.0). Total num frames: 353050624. Throughput: 0: 10095.0, 1: 10052.1. Samples: 353061988. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:06,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.640')] [2023-12-28 00:12:06,306][106226] Updated weights for policy 0, policy_version 688478 (0.0006) [2023-12-28 00:12:06,372][106226] Updated weights for policy 0, policy_version 688488 (0.0008) [2023-12-28 00:12:06,377][106225] Updated weights for policy 1, policy_version 690313 (0.0008) [2023-12-28 00:12:06,429][106226] Updated weights for policy 0, policy_version 688498 (0.0010) [2023-12-28 00:12:06,437][106225] Updated weights for policy 1, policy_version 690323 (0.0009) [2023-12-28 00:12:06,503][106225] Updated weights for policy 1, policy_version 690333 (0.0008) [2023-12-28 00:12:06,567][106225] Updated weights for policy 1, policy_version 690343 (0.0008) [2023-12-28 00:12:07,123][106226] Updated weights for policy 0, policy_version 688508 (0.0008) [2023-12-28 00:12:07,184][106226] Updated weights for policy 0, policy_version 688518 (0.0008) [2023-12-28 00:12:07,247][106226] Updated weights for policy 0, policy_version 688528 (0.0006) [2023-12-28 00:12:07,297][106225] Updated weights for policy 1, policy_version 690353 (0.0007) [2023-12-28 00:12:07,354][106225] Updated weights for policy 1, policy_version 690363 (0.0008) [2023-12-28 00:12:07,410][106225] Updated weights for policy 1, policy_version 690373 (0.0007) [2023-12-28 00:12:07,825][106226] Updated weights for policy 0, policy_version 688538 (0.0006) [2023-12-28 00:12:07,874][106226] Updated weights for policy 0, policy_version 688548 (0.0010) [2023-12-28 00:12:07,920][106226] Updated weights for policy 0, policy_version 688558 (0.0009) [2023-12-28 00:12:07,977][106226] Updated weights for policy 0, policy_version 688568 (0.0007) [2023-12-28 00:12:08,097][106225] Updated weights for policy 1, policy_version 690383 (0.0007) [2023-12-28 00:12:08,155][106225] Updated weights for policy 1, policy_version 690393 (0.0006) [2023-12-28 00:12:08,220][106225] Updated weights for policy 1, policy_version 690403 (0.0007) [2023-12-28 00:12:08,676][106226] Updated weights for policy 0, policy_version 688578 (0.0007) [2023-12-28 00:12:08,736][106226] Updated weights for policy 0, policy_version 688588 (0.0007) [2023-12-28 00:12:08,800][106226] Updated weights for policy 0, policy_version 688598 (0.0008) [2023-12-28 00:12:08,895][106225] Updated weights for policy 1, policy_version 690413 (0.0010) [2023-12-28 00:12:08,949][106225] Updated weights for policy 1, policy_version 690423 (0.0010) [2023-12-28 00:12:09,005][106225] Updated weights for policy 1, policy_version 690433 (0.0010) [2023-12-28 00:12:09,467][106226] Updated weights for policy 0, policy_version 688608 (0.0008) [2023-12-28 00:12:09,533][106226] Updated weights for policy 0, policy_version 688618 (0.0008) [2023-12-28 00:12:09,594][106226] Updated weights for policy 0, policy_version 688628 (0.0008) [2023-12-28 00:12:09,768][106225] Updated weights for policy 1, policy_version 690443 (0.0007) [2023-12-28 00:12:09,840][106225] Updated weights for policy 1, policy_version 690453 (0.0010) [2023-12-28 00:12:09,904][106225] Updated weights for policy 1, policy_version 690463 (0.0009) [2023-12-28 00:12:10,368][106226] Updated weights for policy 0, policy_version 688638 (0.0008) [2023-12-28 00:12:10,427][106226] Updated weights for policy 0, policy_version 688648 (0.0010) [2023-12-28 00:12:10,487][106226] Updated weights for policy 0, policy_version 688658 (0.0009) [2023-12-28 00:12:10,541][106225] Updated weights for policy 1, policy_version 690473 (0.0008) [2023-12-28 00:12:10,606][106225] Updated weights for policy 1, policy_version 690483 (0.0005) [2023-12-28 00:12:10,658][106225] Updated weights for policy 1, policy_version 690493 (0.0005) [2023-12-28 00:12:10,711][106225] Updated weights for policy 1, policy_version 690503 (0.0005) [2023-12-28 00:12:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 353148928. Throughput: 0: 10133.8, 1: 10080.2. Samples: 353122108. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:11,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.267')] [2023-12-28 00:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000690504_176799744.pth... [2023-12-28 00:12:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000688664_176349184.pth... [2023-12-28 00:12:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000689352_176504832.pth [2023-12-28 00:12:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000687520_176054272.pth [2023-12-28 00:12:11,321][106226] Updated weights for policy 0, policy_version 688668 (0.0009) [2023-12-28 00:12:11,395][106225] Updated weights for policy 1, policy_version 690513 (0.0008) [2023-12-28 00:12:11,397][106226] Updated weights for policy 0, policy_version 688678 (0.0008) [2023-12-28 00:12:11,450][106225] Updated weights for policy 1, policy_version 690523 (0.0007) [2023-12-28 00:12:11,460][106226] Updated weights for policy 0, policy_version 688688 (0.0011) [2023-12-28 00:12:11,505][106225] Updated weights for policy 1, policy_version 690533 (0.0006) [2023-12-28 00:12:12,282][106226] Updated weights for policy 0, policy_version 688698 (0.0010) [2023-12-28 00:12:12,303][106225] Updated weights for policy 1, policy_version 690543 (0.0009) [2023-12-28 00:12:12,346][106226] Updated weights for policy 0, policy_version 688708 (0.0010) [2023-12-28 00:12:12,367][106225] Updated weights for policy 1, policy_version 690553 (0.0011) [2023-12-28 00:12:12,411][106226] Updated weights for policy 0, policy_version 688718 (0.0008) [2023-12-28 00:12:12,430][106225] Updated weights for policy 1, policy_version 690563 (0.0010) [2023-12-28 00:12:12,468][106226] Updated weights for policy 0, policy_version 688728 (0.0008) [2023-12-28 00:12:13,113][106225] Updated weights for policy 1, policy_version 690573 (0.0009) [2023-12-28 00:12:13,128][106226] Updated weights for policy 0, policy_version 688738 (0.0007) [2023-12-28 00:12:13,171][106225] Updated weights for policy 1, policy_version 690583 (0.0005) [2023-12-28 00:12:13,190][106226] Updated weights for policy 0, policy_version 688748 (0.0008) [2023-12-28 00:12:13,227][106225] Updated weights for policy 1, policy_version 690593 (0.0005) [2023-12-28 00:12:13,242][106226] Updated weights for policy 0, policy_version 688758 (0.0008) [2023-12-28 00:12:13,919][106225] Updated weights for policy 1, policy_version 690603 (0.0007) [2023-12-28 00:12:13,977][106225] Updated weights for policy 1, policy_version 690613 (0.0009) [2023-12-28 00:12:14,024][106226] Updated weights for policy 0, policy_version 688768 (0.0007) [2023-12-28 00:12:14,036][106225] Updated weights for policy 1, policy_version 690623 (0.0007) [2023-12-28 00:12:14,075][106226] Updated weights for policy 0, policy_version 688778 (0.0007) [2023-12-28 00:12:14,136][106226] Updated weights for policy 0, policy_version 688788 (0.0008) [2023-12-28 00:12:14,719][106225] Updated weights for policy 1, policy_version 690633 (0.0007) [2023-12-28 00:12:14,779][106225] Updated weights for policy 1, policy_version 690643 (0.0007) [2023-12-28 00:12:14,825][106226] Updated weights for policy 0, policy_version 688798 (0.0008) [2023-12-28 00:12:14,845][106225] Updated weights for policy 1, policy_version 690653 (0.0007) [2023-12-28 00:12:14,887][106226] Updated weights for policy 0, policy_version 688808 (0.0007) [2023-12-28 00:12:14,910][106225] Updated weights for policy 1, policy_version 690663 (0.0007) [2023-12-28 00:12:14,947][106226] Updated weights for policy 0, policy_version 688818 (0.0006) [2023-12-28 00:12:15,591][106225] Updated weights for policy 1, policy_version 690673 (0.0007) [2023-12-28 00:12:15,630][106226] Updated weights for policy 0, policy_version 688828 (0.0006) [2023-12-28 00:12:15,654][106225] Updated weights for policy 1, policy_version 690683 (0.0007) [2023-12-28 00:12:15,686][106226] Updated weights for policy 0, policy_version 688838 (0.0005) [2023-12-28 00:12:15,711][106225] Updated weights for policy 1, policy_version 690693 (0.0006) [2023-12-28 00:12:15,752][106226] Updated weights for policy 0, policy_version 688848 (0.0005) [2023-12-28 00:12:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 353247232. Throughput: 0: 10019.2, 1: 9945.0. Samples: 353237812. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:16,176][105115] Avg episode reward: [(0, '-4.519'), (1, '-5.730')] [2023-12-28 00:12:16,313][106225] Updated weights for policy 1, policy_version 690703 (0.0005) [2023-12-28 00:12:16,365][106225] Updated weights for policy 1, policy_version 690713 (0.0005) [2023-12-28 00:12:16,425][106225] Updated weights for policy 1, policy_version 690723 (0.0010) [2023-12-28 00:12:16,445][106226] Updated weights for policy 0, policy_version 688858 (0.0006) [2023-12-28 00:12:16,501][106226] Updated weights for policy 0, policy_version 688868 (0.0007) [2023-12-28 00:12:16,557][106226] Updated weights for policy 0, policy_version 688878 (0.0006) [2023-12-28 00:12:16,618][106226] Updated weights for policy 0, policy_version 688888 (0.0008) [2023-12-28 00:12:17,118][106225] Updated weights for policy 1, policy_version 690733 (0.0010) [2023-12-28 00:12:17,172][106225] Updated weights for policy 1, policy_version 690743 (0.0010) [2023-12-28 00:12:17,226][106225] Updated weights for policy 1, policy_version 690753 (0.0010) [2023-12-28 00:12:17,233][106226] Updated weights for policy 0, policy_version 688898 (0.0011) [2023-12-28 00:12:17,287][106226] Updated weights for policy 0, policy_version 688908 (0.0010) [2023-12-28 00:12:17,333][106226] Updated weights for policy 0, policy_version 688918 (0.0010) [2023-12-28 00:12:17,901][106225] Updated weights for policy 1, policy_version 690763 (0.0010) [2023-12-28 00:12:17,954][106225] Updated weights for policy 1, policy_version 690773 (0.0010) [2023-12-28 00:12:18,004][106225] Updated weights for policy 1, policy_version 690783 (0.0010) [2023-12-28 00:12:18,092][106226] Updated weights for policy 0, policy_version 688928 (0.0008) [2023-12-28 00:12:18,144][106226] Updated weights for policy 0, policy_version 688938 (0.0007) [2023-12-28 00:12:18,199][106226] Updated weights for policy 0, policy_version 688948 (0.0007) [2023-12-28 00:12:18,752][106225] Updated weights for policy 1, policy_version 690793 (0.0010) [2023-12-28 00:12:18,812][106225] Updated weights for policy 1, policy_version 690803 (0.0010) [2023-12-28 00:12:18,872][106225] Updated weights for policy 1, policy_version 690813 (0.0011) [2023-12-28 00:12:18,895][106226] Updated weights for policy 0, policy_version 688958 (0.0008) [2023-12-28 00:12:18,931][106225] Updated weights for policy 1, policy_version 690823 (0.0011) [2023-12-28 00:12:18,958][106226] Updated weights for policy 0, policy_version 688968 (0.0006) [2023-12-28 00:12:19,017][106226] Updated weights for policy 0, policy_version 688978 (0.0008) [2023-12-28 00:12:19,696][106225] Updated weights for policy 1, policy_version 690833 (0.0010) [2023-12-28 00:12:19,733][106226] Updated weights for policy 0, policy_version 688988 (0.0006) [2023-12-28 00:12:19,762][106225] Updated weights for policy 1, policy_version 690843 (0.0009) [2023-12-28 00:12:19,792][106226] Updated weights for policy 0, policy_version 688998 (0.0008) [2023-12-28 00:12:19,828][106225] Updated weights for policy 1, policy_version 690853 (0.0008) [2023-12-28 00:12:19,851][106226] Updated weights for policy 0, policy_version 689008 (0.0008) [2023-12-28 00:12:20,531][106225] Updated weights for policy 1, policy_version 690863 (0.0010) [2023-12-28 00:12:20,569][106226] Updated weights for policy 0, policy_version 689018 (0.0007) [2023-12-28 00:12:20,604][106225] Updated weights for policy 1, policy_version 690873 (0.0009) [2023-12-28 00:12:20,635][106226] Updated weights for policy 0, policy_version 689028 (0.0008) [2023-12-28 00:12:20,670][106225] Updated weights for policy 1, policy_version 690883 (0.0010) [2023-12-28 00:12:20,699][106226] Updated weights for policy 0, policy_version 689038 (0.0006) [2023-12-28 00:12:20,760][106226] Updated weights for policy 0, policy_version 689048 (0.0006) [2023-12-28 00:12:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19605.3). Total num frames: 353345536. Throughput: 0: 9992.0, 1: 9915.9. Samples: 353357052. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:21,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.495')] [2023-12-28 00:12:21,334][106225] Updated weights for policy 1, policy_version 690893 (0.0010) [2023-12-28 00:12:21,408][106225] Updated weights for policy 1, policy_version 690903 (0.0009) [2023-12-28 00:12:21,454][106226] Updated weights for policy 0, policy_version 689058 (0.0007) [2023-12-28 00:12:21,472][106225] Updated weights for policy 1, policy_version 690913 (0.0007) [2023-12-28 00:12:21,514][106226] Updated weights for policy 0, policy_version 689068 (0.0006) [2023-12-28 00:12:21,579][106226] Updated weights for policy 0, policy_version 689078 (0.0009) [2023-12-28 00:12:22,195][106225] Updated weights for policy 1, policy_version 690923 (0.0008) [2023-12-28 00:12:22,249][106225] Updated weights for policy 1, policy_version 690933 (0.0009) [2023-12-28 00:12:22,311][106225] Updated weights for policy 1, policy_version 690943 (0.0007) [2023-12-28 00:12:22,312][106226] Updated weights for policy 0, policy_version 689088 (0.0008) [2023-12-28 00:12:22,379][106226] Updated weights for policy 0, policy_version 689098 (0.0008) [2023-12-28 00:12:22,447][106226] Updated weights for policy 0, policy_version 689108 (0.0008) [2023-12-28 00:12:22,933][106225] Updated weights for policy 1, policy_version 690953 (0.0006) [2023-12-28 00:12:22,997][106225] Updated weights for policy 1, policy_version 690963 (0.0007) [2023-12-28 00:12:23,062][106225] Updated weights for policy 1, policy_version 690973 (0.0006) [2023-12-28 00:12:23,132][106225] Updated weights for policy 1, policy_version 690983 (0.0005) [2023-12-28 00:12:23,260][106226] Updated weights for policy 0, policy_version 689118 (0.0008) [2023-12-28 00:12:23,334][106226] Updated weights for policy 0, policy_version 689128 (0.0005) [2023-12-28 00:12:23,392][106226] Updated weights for policy 0, policy_version 689138 (0.0005) [2023-12-28 00:12:23,719][106225] Updated weights for policy 1, policy_version 690993 (0.0006) [2023-12-28 00:12:23,769][106225] Updated weights for policy 1, policy_version 691003 (0.0006) [2023-12-28 00:12:23,838][106225] Updated weights for policy 1, policy_version 691013 (0.0009) [2023-12-28 00:12:23,936][106226] Updated weights for policy 0, policy_version 689148 (0.0008) [2023-12-28 00:12:23,999][106226] Updated weights for policy 0, policy_version 689158 (0.0005) [2023-12-28 00:12:24,058][106226] Updated weights for policy 0, policy_version 689168 (0.0006) [2023-12-28 00:12:24,433][106225] Updated weights for policy 1, policy_version 691023 (0.0009) [2023-12-28 00:12:24,498][106225] Updated weights for policy 1, policy_version 691033 (0.0008) [2023-12-28 00:12:24,554][106225] Updated weights for policy 1, policy_version 691043 (0.0006) [2023-12-28 00:12:24,598][106226] Updated weights for policy 0, policy_version 689178 (0.0006) [2023-12-28 00:12:24,650][106226] Updated weights for policy 0, policy_version 689188 (0.0008) [2023-12-28 00:12:24,697][106226] Updated weights for policy 0, policy_version 689198 (0.0010) [2023-12-28 00:12:24,745][106226] Updated weights for policy 0, policy_version 689208 (0.0010) [2023-12-28 00:12:25,163][106225] Updated weights for policy 1, policy_version 691053 (0.0007) [2023-12-28 00:12:25,209][106225] Updated weights for policy 1, policy_version 691063 (0.0005) [2023-12-28 00:12:25,258][106225] Updated weights for policy 1, policy_version 691073 (0.0005) [2023-12-28 00:12:25,389][106226] Updated weights for policy 0, policy_version 689218 (0.0005) [2023-12-28 00:12:25,438][106226] Updated weights for policy 0, policy_version 689228 (0.0006) [2023-12-28 00:12:25,501][106226] Updated weights for policy 0, policy_version 689238 (0.0008) [2023-12-28 00:12:25,822][106225] Updated weights for policy 1, policy_version 691083 (0.0006) [2023-12-28 00:12:25,887][106225] Updated weights for policy 1, policy_version 691093 (0.0008) [2023-12-28 00:12:25,949][106225] Updated weights for policy 1, policy_version 691103 (0.0006) [2023-12-28 00:12:26,095][106226] Updated weights for policy 0, policy_version 689248 (0.0010) [2023-12-28 00:12:26,160][106226] Updated weights for policy 0, policy_version 689258 (0.0009) [2023-12-28 00:12:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19633.0). Total num frames: 353452032. Throughput: 0: 9949.6, 1: 9978.0. Samples: 353417528. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:26,175][105115] Avg episode reward: [(0, '-4.099'), (1, '-5.449')] [2023-12-28 00:12:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000691112_176955392.pth... [2023-12-28 00:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000689928_176652288.pth [2023-12-28 00:12:26,218][106226] Updated weights for policy 0, policy_version 689268 (0.0008) [2023-12-28 00:12:26,245][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000689272_176504832.pth... [2023-12-28 00:12:26,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000688096_176201728.pth [2023-12-28 00:12:26,248][106140] Saving new best policy, reward=-4.099! [2023-12-28 00:12:26,604][106225] Updated weights for policy 1, policy_version 691113 (0.0006) [2023-12-28 00:12:26,651][106225] Updated weights for policy 1, policy_version 691123 (0.0005) [2023-12-28 00:12:26,694][106225] Updated weights for policy 1, policy_version 691133 (0.0005) [2023-12-28 00:12:26,742][106225] Updated weights for policy 1, policy_version 691143 (0.0005) [2023-12-28 00:12:26,822][106226] Updated weights for policy 0, policy_version 689278 (0.0008) [2023-12-28 00:12:26,882][106226] Updated weights for policy 0, policy_version 689288 (0.0005) [2023-12-28 00:12:26,935][106226] Updated weights for policy 0, policy_version 689298 (0.0005) [2023-12-28 00:12:27,312][106225] Updated weights for policy 1, policy_version 691153 (0.0010) [2023-12-28 00:12:27,367][106225] Updated weights for policy 1, policy_version 691163 (0.0008) [2023-12-28 00:12:27,414][106225] Updated weights for policy 1, policy_version 691173 (0.0009) [2023-12-28 00:12:27,493][106226] Updated weights for policy 0, policy_version 689308 (0.0007) [2023-12-28 00:12:27,559][106226] Updated weights for policy 0, policy_version 689318 (0.0010) [2023-12-28 00:12:27,623][106226] Updated weights for policy 0, policy_version 689328 (0.0009) [2023-12-28 00:12:28,106][106225] Updated weights for policy 1, policy_version 691183 (0.0007) [2023-12-28 00:12:28,161][106225] Updated weights for policy 1, policy_version 691193 (0.0005) [2023-12-28 00:12:28,210][106225] Updated weights for policy 1, policy_version 691203 (0.0005) [2023-12-28 00:12:28,288][106226] Updated weights for policy 0, policy_version 689338 (0.0009) [2023-12-28 00:12:28,352][106226] Updated weights for policy 0, policy_version 689348 (0.0007) [2023-12-28 00:12:28,415][106226] Updated weights for policy 0, policy_version 689358 (0.0006) [2023-12-28 00:12:28,479][106226] Updated weights for policy 0, policy_version 689368 (0.0005) [2023-12-28 00:12:28,855][106225] Updated weights for policy 1, policy_version 691213 (0.0008) [2023-12-28 00:12:28,920][106225] Updated weights for policy 1, policy_version 691223 (0.0010) [2023-12-28 00:12:28,975][106225] Updated weights for policy 1, policy_version 691233 (0.0010) [2023-12-28 00:12:29,097][106226] Updated weights for policy 0, policy_version 689378 (0.0008) [2023-12-28 00:12:29,152][106226] Updated weights for policy 0, policy_version 689388 (0.0005) [2023-12-28 00:12:29,219][106226] Updated weights for policy 0, policy_version 689398 (0.0009) [2023-12-28 00:12:29,721][106225] Updated weights for policy 1, policy_version 691243 (0.0007) [2023-12-28 00:12:29,787][106225] Updated weights for policy 1, policy_version 691253 (0.0006) [2023-12-28 00:12:29,843][106225] Updated weights for policy 1, policy_version 691263 (0.0006) [2023-12-28 00:12:29,974][106226] Updated weights for policy 0, policy_version 689408 (0.0008) [2023-12-28 00:12:30,036][106226] Updated weights for policy 0, policy_version 689418 (0.0010) [2023-12-28 00:12:30,087][106226] Updated weights for policy 0, policy_version 689428 (0.0008) [2023-12-28 00:12:30,527][106225] Updated weights for policy 1, policy_version 691273 (0.0007) [2023-12-28 00:12:30,579][106225] Updated weights for policy 1, policy_version 691283 (0.0008) [2023-12-28 00:12:30,625][106225] Updated weights for policy 1, policy_version 691293 (0.0008) [2023-12-28 00:12:30,675][106225] Updated weights for policy 1, policy_version 691303 (0.0007) [2023-12-28 00:12:30,821][106226] Updated weights for policy 0, policy_version 689438 (0.0009) [2023-12-28 00:12:30,882][106226] Updated weights for policy 0, policy_version 689448 (0.0008) [2023-12-28 00:12:30,936][106226] Updated weights for policy 0, policy_version 689458 (0.0009) [2023-12-28 00:12:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20207.0, 300 sec: 19688.6). Total num frames: 353558528. Throughput: 0: 10063.7, 1: 10125.6. Samples: 353547600. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:31,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-5.347')] [2023-12-28 00:12:31,372][106225] Updated weights for policy 1, policy_version 691313 (0.0007) [2023-12-28 00:12:31,434][106225] Updated weights for policy 1, policy_version 691323 (0.0008) [2023-12-28 00:12:31,479][106225] Updated weights for policy 1, policy_version 691333 (0.0009) [2023-12-28 00:12:31,687][106226] Updated weights for policy 0, policy_version 689468 (0.0008) [2023-12-28 00:12:31,752][106226] Updated weights for policy 0, policy_version 689478 (0.0009) [2023-12-28 00:12:31,807][106226] Updated weights for policy 0, policy_version 689488 (0.0007) [2023-12-28 00:12:32,172][106225] Updated weights for policy 1, policy_version 691343 (0.0008) [2023-12-28 00:12:32,231][106225] Updated weights for policy 1, policy_version 691353 (0.0007) [2023-12-28 00:12:32,298][106225] Updated weights for policy 1, policy_version 691363 (0.0009) [2023-12-28 00:12:32,574][106226] Updated weights for policy 0, policy_version 689498 (0.0006) [2023-12-28 00:12:32,629][106226] Updated weights for policy 0, policy_version 689508 (0.0007) [2023-12-28 00:12:32,687][106226] Updated weights for policy 0, policy_version 689518 (0.0008) [2023-12-28 00:12:32,742][106226] Updated weights for policy 0, policy_version 689528 (0.0009) [2023-12-28 00:12:32,939][106225] Updated weights for policy 1, policy_version 691373 (0.0008) [2023-12-28 00:12:32,983][106225] Updated weights for policy 1, policy_version 691383 (0.0008) [2023-12-28 00:12:33,047][106225] Updated weights for policy 1, policy_version 691393 (0.0009) [2023-12-28 00:12:33,423][106226] Updated weights for policy 0, policy_version 689538 (0.0008) [2023-12-28 00:12:33,487][106226] Updated weights for policy 0, policy_version 689548 (0.0009) [2023-12-28 00:12:33,535][106226] Updated weights for policy 0, policy_version 689558 (0.0009) [2023-12-28 00:12:33,710][106225] Updated weights for policy 1, policy_version 691403 (0.0008) [2023-12-28 00:12:33,773][106225] Updated weights for policy 1, policy_version 691413 (0.0005) [2023-12-28 00:12:33,826][106225] Updated weights for policy 1, policy_version 691423 (0.0008) [2023-12-28 00:12:34,355][106226] Updated weights for policy 0, policy_version 689568 (0.0008) [2023-12-28 00:12:34,415][106226] Updated weights for policy 0, policy_version 689578 (0.0008) [2023-12-28 00:12:34,469][106226] Updated weights for policy 0, policy_version 689588 (0.0007) [2023-12-28 00:12:34,484][106225] Updated weights for policy 1, policy_version 691433 (0.0010) [2023-12-28 00:12:34,531][106225] Updated weights for policy 1, policy_version 691443 (0.0010) [2023-12-28 00:12:34,586][106225] Updated weights for policy 1, policy_version 691453 (0.0011) [2023-12-28 00:12:34,649][106225] Updated weights for policy 1, policy_version 691463 (0.0011) [2023-12-28 00:12:35,206][106226] Updated weights for policy 0, policy_version 689598 (0.0008) [2023-12-28 00:12:35,252][106226] Updated weights for policy 0, policy_version 689608 (0.0007) [2023-12-28 00:12:35,305][106226] Updated weights for policy 0, policy_version 689618 (0.0007) [2023-12-28 00:12:35,384][106225] Updated weights for policy 1, policy_version 691473 (0.0010) [2023-12-28 00:12:35,442][106225] Updated weights for policy 1, policy_version 691483 (0.0009) [2023-12-28 00:12:35,508][106225] Updated weights for policy 1, policy_version 691493 (0.0010) [2023-12-28 00:12:36,059][106226] Updated weights for policy 0, policy_version 689628 (0.0007) [2023-12-28 00:12:36,139][106226] Updated weights for policy 0, policy_version 689638 (0.0008) [2023-12-28 00:12:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 353648640. Throughput: 0: 9964.6, 1: 10117.1. Samples: 353665156. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:36,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-5.337')] [2023-12-28 00:12:36,203][106226] Updated weights for policy 0, policy_version 689648 (0.0009) [2023-12-28 00:12:36,238][106225] Updated weights for policy 1, policy_version 691503 (0.0010) [2023-12-28 00:12:36,296][106225] Updated weights for policy 1, policy_version 691513 (0.0010) [2023-12-28 00:12:36,362][106225] Updated weights for policy 1, policy_version 691523 (0.0010) [2023-12-28 00:12:36,867][106226] Updated weights for policy 0, policy_version 689658 (0.0008) [2023-12-28 00:12:36,918][106226] Updated weights for policy 0, policy_version 689668 (0.0006) [2023-12-28 00:12:36,974][106226] Updated weights for policy 0, policy_version 689678 (0.0007) [2023-12-28 00:12:37,039][106226] Updated weights for policy 0, policy_version 689688 (0.0007) [2023-12-28 00:12:37,059][106225] Updated weights for policy 1, policy_version 691533 (0.0010) [2023-12-28 00:12:37,110][106225] Updated weights for policy 1, policy_version 691543 (0.0010) [2023-12-28 00:12:37,168][106225] Updated weights for policy 1, policy_version 691553 (0.0010) [2023-12-28 00:12:37,789][106226] Updated weights for policy 0, policy_version 689698 (0.0008) [2023-12-28 00:12:37,826][106225] Updated weights for policy 1, policy_version 691563 (0.0010) [2023-12-28 00:12:37,836][106226] Updated weights for policy 0, policy_version 689708 (0.0006) [2023-12-28 00:12:37,882][106225] Updated weights for policy 1, policy_version 691573 (0.0010) [2023-12-28 00:12:37,901][106226] Updated weights for policy 0, policy_version 689718 (0.0005) [2023-12-28 00:12:37,940][106225] Updated weights for policy 1, policy_version 691583 (0.0008) [2023-12-28 00:12:38,572][106226] Updated weights for policy 0, policy_version 689728 (0.0007) [2023-12-28 00:12:38,618][106226] Updated weights for policy 0, policy_version 689738 (0.0007) [2023-12-28 00:12:38,646][106225] Updated weights for policy 1, policy_version 691593 (0.0008) [2023-12-28 00:12:38,675][106226] Updated weights for policy 0, policy_version 689748 (0.0007) [2023-12-28 00:12:38,700][106225] Updated weights for policy 1, policy_version 691603 (0.0010) [2023-12-28 00:12:38,758][106225] Updated weights for policy 1, policy_version 691613 (0.0010) [2023-12-28 00:12:38,811][106225] Updated weights for policy 1, policy_version 691623 (0.0010) [2023-12-28 00:12:39,408][106226] Updated weights for policy 0, policy_version 689758 (0.0007) [2023-12-28 00:12:39,475][106226] Updated weights for policy 0, policy_version 689768 (0.0008) [2023-12-28 00:12:39,546][106226] Updated weights for policy 0, policy_version 689778 (0.0007) [2023-12-28 00:12:39,600][106225] Updated weights for policy 1, policy_version 691633 (0.0008) [2023-12-28 00:12:39,670][106225] Updated weights for policy 1, policy_version 691643 (0.0007) [2023-12-28 00:12:39,736][106225] Updated weights for policy 1, policy_version 691653 (0.0008) [2023-12-28 00:12:40,262][106226] Updated weights for policy 0, policy_version 689788 (0.0008) [2023-12-28 00:12:40,322][106226] Updated weights for policy 0, policy_version 689798 (0.0008) [2023-12-28 00:12:40,381][106226] Updated weights for policy 0, policy_version 689808 (0.0008) [2023-12-28 00:12:40,454][106225] Updated weights for policy 1, policy_version 691663 (0.0007) [2023-12-28 00:12:40,522][106225] Updated weights for policy 1, policy_version 691673 (0.0009) [2023-12-28 00:12:40,584][106225] Updated weights for policy 1, policy_version 691683 (0.0010) [2023-12-28 00:12:40,974][106226] Updated weights for policy 0, policy_version 689818 (0.0008) [2023-12-28 00:12:41,039][106226] Updated weights for policy 0, policy_version 689828 (0.0010) [2023-12-28 00:12:41,103][106226] Updated weights for policy 0, policy_version 689838 (0.0011) [2023-12-28 00:12:41,171][106226] Updated weights for policy 0, policy_version 689848 (0.0009) [2023-12-28 00:12:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20206.9, 300 sec: 19716.3). Total num frames: 353755136. Throughput: 0: 9988.1, 1: 10131.2. Samples: 353724364. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:41,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-5.587')] [2023-12-28 00:12:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000689848_176652288.pth... [2023-12-28 00:12:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000688664_176349184.pth [2023-12-28 00:12:41,210][106225] Updated weights for policy 1, policy_version 691693 (0.0005) [2023-12-28 00:12:41,278][106225] Updated weights for policy 1, policy_version 691703 (0.0008) [2023-12-28 00:12:41,329][106225] Updated weights for policy 1, policy_version 691713 (0.0007) [2023-12-28 00:12:41,374][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000691720_177111040.pth... [2023-12-28 00:12:41,378][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000690504_176799744.pth [2023-12-28 00:12:42,005][106226] Updated weights for policy 0, policy_version 689858 (0.0008) [2023-12-28 00:12:42,068][106226] Updated weights for policy 0, policy_version 689868 (0.0007) [2023-12-28 00:12:42,084][106225] Updated weights for policy 1, policy_version 691723 (0.0010) [2023-12-28 00:12:42,130][106226] Updated weights for policy 0, policy_version 689878 (0.0009) [2023-12-28 00:12:42,151][106225] Updated weights for policy 1, policy_version 691733 (0.0007) [2023-12-28 00:12:42,220][106225] Updated weights for policy 1, policy_version 691743 (0.0006) [2023-12-28 00:12:42,872][106226] Updated weights for policy 0, policy_version 689888 (0.0007) [2023-12-28 00:12:42,883][106225] Updated weights for policy 1, policy_version 691753 (0.0009) [2023-12-28 00:12:42,931][106226] Updated weights for policy 0, policy_version 689898 (0.0007) [2023-12-28 00:12:42,940][106225] Updated weights for policy 1, policy_version 691763 (0.0010) [2023-12-28 00:12:42,987][106226] Updated weights for policy 0, policy_version 689908 (0.0006) [2023-12-28 00:12:42,993][106225] Updated weights for policy 1, policy_version 691773 (0.0009) [2023-12-28 00:12:43,055][106225] Updated weights for policy 1, policy_version 691783 (0.0006) [2023-12-28 00:12:43,594][106226] Updated weights for policy 0, policy_version 689918 (0.0006) [2023-12-28 00:12:43,643][106226] Updated weights for policy 0, policy_version 689928 (0.0005) [2023-12-28 00:12:43,701][106226] Updated weights for policy 0, policy_version 689938 (0.0005) [2023-12-28 00:12:43,736][106225] Updated weights for policy 1, policy_version 691793 (0.0007) [2023-12-28 00:12:43,792][106225] Updated weights for policy 1, policy_version 691803 (0.0010) [2023-12-28 00:12:43,842][106225] Updated weights for policy 1, policy_version 691813 (0.0010) [2023-12-28 00:12:44,325][106226] Updated weights for policy 0, policy_version 689948 (0.0005) [2023-12-28 00:12:44,392][106226] Updated weights for policy 0, policy_version 689958 (0.0006) [2023-12-28 00:12:44,459][106226] Updated weights for policy 0, policy_version 689968 (0.0008) [2023-12-28 00:12:44,568][106225] Updated weights for policy 1, policy_version 691823 (0.0007) [2023-12-28 00:12:44,625][106225] Updated weights for policy 1, policy_version 691833 (0.0010) [2023-12-28 00:12:44,675][106225] Updated weights for policy 1, policy_version 691843 (0.0010) [2023-12-28 00:12:45,102][106226] Updated weights for policy 0, policy_version 689978 (0.0008) [2023-12-28 00:12:45,163][106226] Updated weights for policy 0, policy_version 689988 (0.0006) [2023-12-28 00:12:45,225][106226] Updated weights for policy 0, policy_version 689998 (0.0008) [2023-12-28 00:12:45,291][106226] Updated weights for policy 0, policy_version 690008 (0.0007) [2023-12-28 00:12:45,344][106225] Updated weights for policy 1, policy_version 691853 (0.0010) [2023-12-28 00:12:45,402][106225] Updated weights for policy 1, policy_version 691863 (0.0008) [2023-12-28 00:12:45,453][106225] Updated weights for policy 1, policy_version 691873 (0.0006) [2023-12-28 00:12:45,861][106226] Updated weights for policy 0, policy_version 690018 (0.0007) [2023-12-28 00:12:45,906][106226] Updated weights for policy 0, policy_version 690028 (0.0007) [2023-12-28 00:12:45,960][106226] Updated weights for policy 0, policy_version 690038 (0.0006) [2023-12-28 00:12:46,100][106225] Updated weights for policy 1, policy_version 691883 (0.0007) [2023-12-28 00:12:46,152][106225] Updated weights for policy 1, policy_version 691893 (0.0005) [2023-12-28 00:12:46,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19771.9). Total num frames: 353853440. Throughput: 0: 10010.0, 1: 10088.8. Samples: 353842324. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:46,176][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.454')] [2023-12-28 00:12:46,208][106225] Updated weights for policy 1, policy_version 691903 (0.0005) [2023-12-28 00:12:46,593][106226] Updated weights for policy 0, policy_version 690048 (0.0010) [2023-12-28 00:12:46,643][106226] Updated weights for policy 0, policy_version 690058 (0.0010) [2023-12-28 00:12:46,692][106226] Updated weights for policy 0, policy_version 690068 (0.0010) [2023-12-28 00:12:46,754][106225] Updated weights for policy 1, policy_version 691913 (0.0005) [2023-12-28 00:12:46,810][106225] Updated weights for policy 1, policy_version 691923 (0.0005) [2023-12-28 00:12:46,866][106225] Updated weights for policy 1, policy_version 691933 (0.0007) [2023-12-28 00:12:46,923][106225] Updated weights for policy 1, policy_version 691943 (0.0008) [2023-12-28 00:12:47,405][106226] Updated weights for policy 0, policy_version 690078 (0.0007) [2023-12-28 00:12:47,478][106226] Updated weights for policy 0, policy_version 690088 (0.0006) [2023-12-28 00:12:47,536][106226] Updated weights for policy 0, policy_version 690098 (0.0006) [2023-12-28 00:12:47,594][106225] Updated weights for policy 1, policy_version 691953 (0.0010) [2023-12-28 00:12:47,643][106225] Updated weights for policy 1, policy_version 691963 (0.0010) [2023-12-28 00:12:47,690][106225] Updated weights for policy 1, policy_version 691973 (0.0010) [2023-12-28 00:12:48,142][106226] Updated weights for policy 0, policy_version 690108 (0.0007) [2023-12-28 00:12:48,196][106226] Updated weights for policy 0, policy_version 690118 (0.0005) [2023-12-28 00:12:48,256][106226] Updated weights for policy 0, policy_version 690128 (0.0006) [2023-12-28 00:12:48,472][106225] Updated weights for policy 1, policy_version 691983 (0.0008) [2023-12-28 00:12:48,520][106225] Updated weights for policy 1, policy_version 691993 (0.0007) [2023-12-28 00:12:48,577][106225] Updated weights for policy 1, policy_version 692003 (0.0009) [2023-12-28 00:12:48,929][106226] Updated weights for policy 0, policy_version 690138 (0.0005) [2023-12-28 00:12:48,985][106226] Updated weights for policy 0, policy_version 690148 (0.0009) [2023-12-28 00:12:49,041][106226] Updated weights for policy 0, policy_version 690158 (0.0010) [2023-12-28 00:12:49,091][106226] Updated weights for policy 0, policy_version 690168 (0.0010) [2023-12-28 00:12:49,331][106225] Updated weights for policy 1, policy_version 692013 (0.0008) [2023-12-28 00:12:49,400][106225] Updated weights for policy 1, policy_version 692023 (0.0008) [2023-12-28 00:12:49,460][106225] Updated weights for policy 1, policy_version 692033 (0.0008) [2023-12-28 00:12:49,807][106226] Updated weights for policy 0, policy_version 690178 (0.0008) [2023-12-28 00:12:49,877][106226] Updated weights for policy 0, policy_version 690188 (0.0008) [2023-12-28 00:12:49,943][106226] Updated weights for policy 0, policy_version 690198 (0.0008) [2023-12-28 00:12:50,183][106225] Updated weights for policy 1, policy_version 692043 (0.0009) [2023-12-28 00:12:50,246][106225] Updated weights for policy 1, policy_version 692053 (0.0009) [2023-12-28 00:12:50,298][106225] Updated weights for policy 1, policy_version 692063 (0.0008) [2023-12-28 00:12:50,728][106226] Updated weights for policy 0, policy_version 690208 (0.0007) [2023-12-28 00:12:50,787][106226] Updated weights for policy 0, policy_version 690218 (0.0006) [2023-12-28 00:12:50,842][106226] Updated weights for policy 0, policy_version 690228 (0.0009) [2023-12-28 00:12:51,074][106225] Updated weights for policy 1, policy_version 692073 (0.0008) [2023-12-28 00:12:51,147][106225] Updated weights for policy 1, policy_version 692083 (0.0008) [2023-12-28 00:12:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 353951744. Throughput: 0: 9984.2, 1: 10074.5. Samples: 353964628. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:51,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-5.363')] [2023-12-28 00:12:51,199][106225] Updated weights for policy 1, policy_version 692093 (0.0008) [2023-12-28 00:12:51,256][106225] Updated weights for policy 1, policy_version 692103 (0.0008) [2023-12-28 00:12:51,575][106226] Updated weights for policy 0, policy_version 690238 (0.0008) [2023-12-28 00:12:51,641][106226] Updated weights for policy 0, policy_version 690248 (0.0008) [2023-12-28 00:12:51,706][106226] Updated weights for policy 0, policy_version 690258 (0.0011) [2023-12-28 00:12:51,985][106225] Updated weights for policy 1, policy_version 692113 (0.0009) [2023-12-28 00:12:52,048][106225] Updated weights for policy 1, policy_version 692123 (0.0008) [2023-12-28 00:12:52,102][106225] Updated weights for policy 1, policy_version 692133 (0.0007) [2023-12-28 00:12:52,427][106226] Updated weights for policy 0, policy_version 690268 (0.0012) [2023-12-28 00:12:52,487][106226] Updated weights for policy 0, policy_version 690278 (0.0010) [2023-12-28 00:12:52,546][106226] Updated weights for policy 0, policy_version 690288 (0.0011) [2023-12-28 00:12:52,803][106225] Updated weights for policy 1, policy_version 692143 (0.0008) [2023-12-28 00:12:52,868][106225] Updated weights for policy 1, policy_version 692153 (0.0009) [2023-12-28 00:12:52,924][106225] Updated weights for policy 1, policy_version 692163 (0.0005) [2023-12-28 00:12:53,204][106226] Updated weights for policy 0, policy_version 690298 (0.0010) [2023-12-28 00:12:53,270][106226] Updated weights for policy 0, policy_version 690308 (0.0005) [2023-12-28 00:12:53,328][106226] Updated weights for policy 0, policy_version 690318 (0.0005) [2023-12-28 00:12:53,389][106226] Updated weights for policy 0, policy_version 690328 (0.0006) [2023-12-28 00:12:53,506][106225] Updated weights for policy 1, policy_version 692173 (0.0006) [2023-12-28 00:12:53,562][106225] Updated weights for policy 1, policy_version 692183 (0.0005) [2023-12-28 00:12:53,613][106225] Updated weights for policy 1, policy_version 692193 (0.0005) [2023-12-28 00:12:53,993][106226] Updated weights for policy 0, policy_version 690338 (0.0006) [2023-12-28 00:12:54,050][106226] Updated weights for policy 0, policy_version 690348 (0.0005) [2023-12-28 00:12:54,113][106226] Updated weights for policy 0, policy_version 690358 (0.0005) [2023-12-28 00:12:54,209][106225] Updated weights for policy 1, policy_version 692203 (0.0006) [2023-12-28 00:12:54,276][106225] Updated weights for policy 1, policy_version 692213 (0.0010) [2023-12-28 00:12:54,339][106225] Updated weights for policy 1, policy_version 692223 (0.0008) [2023-12-28 00:12:54,712][106226] Updated weights for policy 0, policy_version 690368 (0.0005) [2023-12-28 00:12:54,761][106226] Updated weights for policy 0, policy_version 690378 (0.0008) [2023-12-28 00:12:54,807][106226] Updated weights for policy 0, policy_version 690388 (0.0010) [2023-12-28 00:12:55,060][106225] Updated weights for policy 1, policy_version 692233 (0.0007) [2023-12-28 00:12:55,123][106225] Updated weights for policy 1, policy_version 692243 (0.0007) [2023-12-28 00:12:55,191][106225] Updated weights for policy 1, policy_version 692253 (0.0006) [2023-12-28 00:12:55,258][106225] Updated weights for policy 1, policy_version 692263 (0.0005) [2023-12-28 00:12:55,504][106226] Updated weights for policy 0, policy_version 690398 (0.0010) [2023-12-28 00:12:55,554][106226] Updated weights for policy 0, policy_version 690408 (0.0008) [2023-12-28 00:12:55,610][106226] Updated weights for policy 0, policy_version 690418 (0.0010) [2023-12-28 00:12:55,836][106225] Updated weights for policy 1, policy_version 692273 (0.0006) [2023-12-28 00:12:55,899][106225] Updated weights for policy 1, policy_version 692283 (0.0005) [2023-12-28 00:12:55,956][106225] Updated weights for policy 1, policy_version 692293 (0.0006) [2023-12-28 00:12:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 354058240. Throughput: 0: 9970.7, 1: 10114.4. Samples: 354025940. Policy #0 lag: (min: 7.0, avg: 8.3, max: 34.0) [2023-12-28 00:12:56,176][105115] Avg episode reward: [(0, '-4.342'), (1, '-5.631')] [2023-12-28 00:12:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000692296_177258496.pth... [2023-12-28 00:12:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000690424_176799744.pth... [2023-12-28 00:12:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000691112_176955392.pth [2023-12-28 00:12:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000689272_176504832.pth [2023-12-28 00:12:56,323][106226] Updated weights for policy 0, policy_version 690428 (0.0011) [2023-12-28 00:12:56,368][106226] Updated weights for policy 0, policy_version 690438 (0.0010) [2023-12-28 00:12:56,424][106226] Updated weights for policy 0, policy_version 690448 (0.0010) [2023-12-28 00:12:56,586][106225] Updated weights for policy 1, policy_version 692303 (0.0008) [2023-12-28 00:12:56,637][106225] Updated weights for policy 1, policy_version 692313 (0.0009) [2023-12-28 00:12:56,683][106225] Updated weights for policy 1, policy_version 692323 (0.0008) [2023-12-28 00:12:57,039][106226] Updated weights for policy 0, policy_version 690458 (0.0009) [2023-12-28 00:12:57,088][106226] Updated weights for policy 0, policy_version 690468 (0.0006) [2023-12-28 00:12:57,136][106226] Updated weights for policy 0, policy_version 690478 (0.0009) [2023-12-28 00:12:57,199][106226] Updated weights for policy 0, policy_version 690488 (0.0009) [2023-12-28 00:12:57,247][106225] Updated weights for policy 1, policy_version 692333 (0.0005) [2023-12-28 00:12:57,305][106225] Updated weights for policy 1, policy_version 692343 (0.0005) [2023-12-28 00:12:57,357][106225] Updated weights for policy 1, policy_version 692353 (0.0005) [2023-12-28 00:12:57,792][106226] Updated weights for policy 0, policy_version 690498 (0.0008) [2023-12-28 00:12:57,841][106226] Updated weights for policy 0, policy_version 690508 (0.0006) [2023-12-28 00:12:57,887][106226] Updated weights for policy 0, policy_version 690518 (0.0005) [2023-12-28 00:12:58,014][106225] Updated weights for policy 1, policy_version 692363 (0.0007) [2023-12-28 00:12:58,068][106225] Updated weights for policy 1, policy_version 692373 (0.0005) [2023-12-28 00:12:58,116][106225] Updated weights for policy 1, policy_version 692383 (0.0005) [2023-12-28 00:12:58,530][106226] Updated weights for policy 0, policy_version 690528 (0.0008) [2023-12-28 00:12:58,596][106226] Updated weights for policy 0, policy_version 690538 (0.0009) [2023-12-28 00:12:58,659][106226] Updated weights for policy 0, policy_version 690548 (0.0008) [2023-12-28 00:12:58,822][106225] Updated weights for policy 1, policy_version 692393 (0.0007) [2023-12-28 00:12:58,890][106225] Updated weights for policy 1, policy_version 692403 (0.0008) [2023-12-28 00:12:58,956][106225] Updated weights for policy 1, policy_version 692413 (0.0009) [2023-12-28 00:12:59,022][106225] Updated weights for policy 1, policy_version 692423 (0.0008) [2023-12-28 00:12:59,477][106226] Updated weights for policy 0, policy_version 690558 (0.0009) [2023-12-28 00:12:59,540][106226] Updated weights for policy 0, policy_version 690568 (0.0009) [2023-12-28 00:12:59,602][106226] Updated weights for policy 0, policy_version 690578 (0.0008) [2023-12-28 00:12:59,884][106225] Updated weights for policy 1, policy_version 692433 (0.0008) [2023-12-28 00:12:59,942][106225] Updated weights for policy 1, policy_version 692443 (0.0008) [2023-12-28 00:12:59,990][106225] Updated weights for policy 1, policy_version 692453 (0.0008) [2023-12-28 00:13:00,251][106226] Updated weights for policy 0, policy_version 690588 (0.0006) [2023-12-28 00:13:00,311][106226] Updated weights for policy 0, policy_version 690598 (0.0005) [2023-12-28 00:13:00,371][106226] Updated weights for policy 0, policy_version 690608 (0.0005) [2023-12-28 00:13:00,737][106225] Updated weights for policy 1, policy_version 692463 (0.0009) [2023-12-28 00:13:00,788][106225] Updated weights for policy 1, policy_version 692473 (0.0007) [2023-12-28 00:13:00,834][106225] Updated weights for policy 1, policy_version 692483 (0.0010) [2023-12-28 00:13:00,964][106226] Updated weights for policy 0, policy_version 690618 (0.0005) [2023-12-28 00:13:01,027][106226] Updated weights for policy 0, policy_version 690628 (0.0006) [2023-12-28 00:13:01,091][106226] Updated weights for policy 0, policy_version 690638 (0.0007) [2023-12-28 00:13:01,160][106226] Updated weights for policy 0, policy_version 690648 (0.0008) [2023-12-28 00:13:01,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 354164736. Throughput: 0: 10085.2, 1: 10179.1. Samples: 354149700. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:01,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.479')] [2023-12-28 00:13:01,544][106225] Updated weights for policy 1, policy_version 692493 (0.0008) [2023-12-28 00:13:01,597][106225] Updated weights for policy 1, policy_version 692503 (0.0009) [2023-12-28 00:13:01,662][106225] Updated weights for policy 1, policy_version 692513 (0.0008) [2023-12-28 00:13:01,853][106226] Updated weights for policy 0, policy_version 690658 (0.0006) [2023-12-28 00:13:01,908][106226] Updated weights for policy 0, policy_version 690668 (0.0005) [2023-12-28 00:13:01,967][106226] Updated weights for policy 0, policy_version 690678 (0.0005) [2023-12-28 00:13:02,455][106225] Updated weights for policy 1, policy_version 692523 (0.0008) [2023-12-28 00:13:02,511][106225] Updated weights for policy 1, policy_version 692533 (0.0009) [2023-12-28 00:13:02,556][106226] Updated weights for policy 0, policy_version 690688 (0.0006) [2023-12-28 00:13:02,566][106225] Updated weights for policy 1, policy_version 692543 (0.0008) [2023-12-28 00:13:02,615][106226] Updated weights for policy 0, policy_version 690698 (0.0006) [2023-12-28 00:13:02,670][106226] Updated weights for policy 0, policy_version 690708 (0.0008) [2023-12-28 00:13:03,271][106226] Updated weights for policy 0, policy_version 690718 (0.0005) [2023-12-28 00:13:03,303][106225] Updated weights for policy 1, policy_version 692553 (0.0009) [2023-12-28 00:13:03,320][106226] Updated weights for policy 0, policy_version 690728 (0.0007) [2023-12-28 00:13:03,362][106225] Updated weights for policy 1, policy_version 692563 (0.0010) [2023-12-28 00:13:03,374][106226] Updated weights for policy 0, policy_version 690738 (0.0008) [2023-12-28 00:13:03,418][106225] Updated weights for policy 1, policy_version 692573 (0.0010) [2023-12-28 00:13:03,483][106225] Updated weights for policy 1, policy_version 692583 (0.0011) [2023-12-28 00:13:03,932][106226] Updated weights for policy 0, policy_version 690748 (0.0007) [2023-12-28 00:13:03,992][106226] Updated weights for policy 0, policy_version 690758 (0.0009) [2023-12-28 00:13:04,053][106226] Updated weights for policy 0, policy_version 690768 (0.0008) [2023-12-28 00:13:04,075][106225] Updated weights for policy 1, policy_version 692593 (0.0006) [2023-12-28 00:13:04,127][106225] Updated weights for policy 1, policy_version 692603 (0.0007) [2023-12-28 00:13:04,181][106225] Updated weights for policy 1, policy_version 692613 (0.0007) [2023-12-28 00:13:04,783][106226] Updated weights for policy 0, policy_version 690778 (0.0009) [2023-12-28 00:13:04,828][106226] Updated weights for policy 0, policy_version 690788 (0.0008) [2023-12-28 00:13:04,878][106226] Updated weights for policy 0, policy_version 690798 (0.0008) [2023-12-28 00:13:04,915][106225] Updated weights for policy 1, policy_version 692623 (0.0006) [2023-12-28 00:13:04,937][106226] Updated weights for policy 0, policy_version 690808 (0.0007) [2023-12-28 00:13:04,970][106225] Updated weights for policy 1, policy_version 692633 (0.0007) [2023-12-28 00:13:05,026][106225] Updated weights for policy 1, policy_version 692643 (0.0008) [2023-12-28 00:13:05,682][106226] Updated weights for policy 0, policy_version 690818 (0.0008) [2023-12-28 00:13:05,739][106225] Updated weights for policy 1, policy_version 692653 (0.0009) [2023-12-28 00:13:05,742][106226] Updated weights for policy 0, policy_version 690828 (0.0007) [2023-12-28 00:13:05,793][106225] Updated weights for policy 1, policy_version 692663 (0.0005) [2023-12-28 00:13:05,803][106226] Updated weights for policy 0, policy_version 690838 (0.0007) [2023-12-28 00:13:05,846][106225] Updated weights for policy 1, policy_version 692673 (0.0008) [2023-12-28 00:13:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 354263040. Throughput: 0: 10151.9, 1: 10164.7. Samples: 354271300. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:06,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-5.588')] [2023-12-28 00:13:06,479][106226] Updated weights for policy 0, policy_version 690848 (0.0008) [2023-12-28 00:13:06,541][106226] Updated weights for policy 0, policy_version 690858 (0.0009) [2023-12-28 00:13:06,597][106226] Updated weights for policy 0, policy_version 690868 (0.0009) [2023-12-28 00:13:06,630][106225] Updated weights for policy 1, policy_version 692683 (0.0009) [2023-12-28 00:13:06,692][106225] Updated weights for policy 1, policy_version 692693 (0.0009) [2023-12-28 00:13:06,738][106225] Updated weights for policy 1, policy_version 692703 (0.0008) [2023-12-28 00:13:07,311][106226] Updated weights for policy 0, policy_version 690878 (0.0007) [2023-12-28 00:13:07,368][106226] Updated weights for policy 0, policy_version 690888 (0.0005) [2023-12-28 00:13:07,423][106226] Updated weights for policy 0, policy_version 690898 (0.0005) [2023-12-28 00:13:07,516][106225] Updated weights for policy 1, policy_version 692713 (0.0008) [2023-12-28 00:13:07,577][106225] Updated weights for policy 1, policy_version 692723 (0.0007) [2023-12-28 00:13:07,630][106225] Updated weights for policy 1, policy_version 692733 (0.0005) [2023-12-28 00:13:07,683][106225] Updated weights for policy 1, policy_version 692743 (0.0007) [2023-12-28 00:13:08,098][106226] Updated weights for policy 0, policy_version 690908 (0.0007) [2023-12-28 00:13:08,146][106226] Updated weights for policy 0, policy_version 690918 (0.0008) [2023-12-28 00:13:08,194][106226] Updated weights for policy 0, policy_version 690928 (0.0008) [2023-12-28 00:13:08,375][106225] Updated weights for policy 1, policy_version 692753 (0.0008) [2023-12-28 00:13:08,437][106225] Updated weights for policy 1, policy_version 692763 (0.0008) [2023-12-28 00:13:08,495][106225] Updated weights for policy 1, policy_version 692773 (0.0008) [2023-12-28 00:13:08,991][106226] Updated weights for policy 0, policy_version 690938 (0.0009) [2023-12-28 00:13:09,054][106226] Updated weights for policy 0, policy_version 690948 (0.0008) [2023-12-28 00:13:09,115][106226] Updated weights for policy 0, policy_version 690958 (0.0009) [2023-12-28 00:13:09,170][106226] Updated weights for policy 0, policy_version 690968 (0.0008) [2023-12-28 00:13:09,232][106225] Updated weights for policy 1, policy_version 692783 (0.0009) [2023-12-28 00:13:09,296][106225] Updated weights for policy 1, policy_version 692793 (0.0009) [2023-12-28 00:13:09,359][106225] Updated weights for policy 1, policy_version 692803 (0.0008) [2023-12-28 00:13:09,877][106226] Updated weights for policy 0, policy_version 690978 (0.0009) [2023-12-28 00:13:09,941][106226] Updated weights for policy 0, policy_version 690988 (0.0008) [2023-12-28 00:13:10,004][106226] Updated weights for policy 0, policy_version 690998 (0.0009) [2023-12-28 00:13:10,160][106225] Updated weights for policy 1, policy_version 692813 (0.0008) [2023-12-28 00:13:10,215][106225] Updated weights for policy 1, policy_version 692823 (0.0008) [2023-12-28 00:13:10,272][106225] Updated weights for policy 1, policy_version 692833 (0.0008) [2023-12-28 00:13:10,753][106226] Updated weights for policy 0, policy_version 691008 (0.0007) [2023-12-28 00:13:10,816][106226] Updated weights for policy 0, policy_version 691018 (0.0006) [2023-12-28 00:13:10,879][106226] Updated weights for policy 0, policy_version 691028 (0.0008) [2023-12-28 00:13:11,029][106225] Updated weights for policy 1, policy_version 692843 (0.0009) [2023-12-28 00:13:11,097][106225] Updated weights for policy 1, policy_version 692853 (0.0009) [2023-12-28 00:13:11,161][106225] Updated weights for policy 1, policy_version 692863 (0.0008) [2023-12-28 00:13:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 354353152. Throughput: 0: 10156.3, 1: 10087.6. Samples: 354328500. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:11,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.425')] [2023-12-28 00:13:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000691032_176955392.pth... [2023-12-28 00:13:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000689848_176652288.pth [2023-12-28 00:13:11,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000692872_177405952.pth... [2023-12-28 00:13:11,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000691720_177111040.pth [2023-12-28 00:13:11,610][106226] Updated weights for policy 0, policy_version 691038 (0.0007) [2023-12-28 00:13:11,686][106226] Updated weights for policy 0, policy_version 691048 (0.0008) [2023-12-28 00:13:11,763][106226] Updated weights for policy 0, policy_version 691058 (0.0009) [2023-12-28 00:13:11,962][106225] Updated weights for policy 1, policy_version 692873 (0.0009) [2023-12-28 00:13:12,022][106225] Updated weights for policy 1, policy_version 692883 (0.0008) [2023-12-28 00:13:12,076][106225] Updated weights for policy 1, policy_version 692893 (0.0010) [2023-12-28 00:13:12,124][106225] Updated weights for policy 1, policy_version 692903 (0.0010) [2023-12-28 00:13:12,478][106226] Updated weights for policy 0, policy_version 691068 (0.0007) [2023-12-28 00:13:12,536][106226] Updated weights for policy 0, policy_version 691078 (0.0007) [2023-12-28 00:13:12,591][106226] Updated weights for policy 0, policy_version 691088 (0.0008) [2023-12-28 00:13:12,866][106225] Updated weights for policy 1, policy_version 692913 (0.0009) [2023-12-28 00:13:12,924][106225] Updated weights for policy 1, policy_version 692923 (0.0009) [2023-12-28 00:13:12,973][106225] Updated weights for policy 1, policy_version 692933 (0.0008) [2023-12-28 00:13:13,190][106226] Updated weights for policy 0, policy_version 691098 (0.0009) [2023-12-28 00:13:13,248][106226] Updated weights for policy 0, policy_version 691108 (0.0008) [2023-12-28 00:13:13,306][106226] Updated weights for policy 0, policy_version 691118 (0.0008) [2023-12-28 00:13:13,364][106226] Updated weights for policy 0, policy_version 691128 (0.0008) [2023-12-28 00:13:13,754][106225] Updated weights for policy 1, policy_version 692943 (0.0008) [2023-12-28 00:13:13,805][106225] Updated weights for policy 1, policy_version 692953 (0.0008) [2023-12-28 00:13:13,851][106225] Updated weights for policy 1, policy_version 692963 (0.0007) [2023-12-28 00:13:13,968][106226] Updated weights for policy 0, policy_version 691138 (0.0005) [2023-12-28 00:13:14,025][106226] Updated weights for policy 0, policy_version 691148 (0.0006) [2023-12-28 00:13:14,087][106226] Updated weights for policy 0, policy_version 691158 (0.0008) [2023-12-28 00:13:14,567][106225] Updated weights for policy 1, policy_version 692973 (0.0007) [2023-12-28 00:13:14,618][106225] Updated weights for policy 1, policy_version 692983 (0.0010) [2023-12-28 00:13:14,680][106225] Updated weights for policy 1, policy_version 692993 (0.0008) [2023-12-28 00:13:14,731][106226] Updated weights for policy 0, policy_version 691168 (0.0010) [2023-12-28 00:13:14,803][106226] Updated weights for policy 0, policy_version 691178 (0.0009) [2023-12-28 00:13:14,863][106226] Updated weights for policy 0, policy_version 691188 (0.0009) [2023-12-28 00:13:15,429][106225] Updated weights for policy 1, policy_version 693003 (0.0006) [2023-12-28 00:13:15,493][106225] Updated weights for policy 1, policy_version 693013 (0.0006) [2023-12-28 00:13:15,548][106225] Updated weights for policy 1, policy_version 693023 (0.0010) [2023-12-28 00:13:15,559][106226] Updated weights for policy 0, policy_version 691198 (0.0010) [2023-12-28 00:13:15,613][106226] Updated weights for policy 0, policy_version 691208 (0.0010) [2023-12-28 00:13:15,659][106226] Updated weights for policy 0, policy_version 691218 (0.0007) [2023-12-28 00:13:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 354451456. Throughput: 0: 10036.9, 1: 9866.6. Samples: 354443260. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:16,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.580')] [2023-12-28 00:13:16,228][106225] Updated weights for policy 1, policy_version 693033 (0.0010) [2023-12-28 00:13:16,289][106225] Updated weights for policy 1, policy_version 693043 (0.0009) [2023-12-28 00:13:16,338][106226] Updated weights for policy 0, policy_version 691228 (0.0009) [2023-12-28 00:13:16,352][106225] Updated weights for policy 1, policy_version 693053 (0.0010) [2023-12-28 00:13:16,395][106226] Updated weights for policy 0, policy_version 691238 (0.0010) [2023-12-28 00:13:16,406][106225] Updated weights for policy 1, policy_version 693063 (0.0010) [2023-12-28 00:13:16,444][106226] Updated weights for policy 0, policy_version 691248 (0.0010) [2023-12-28 00:13:17,061][106226] Updated weights for policy 0, policy_version 691258 (0.0009) [2023-12-28 00:13:17,095][106225] Updated weights for policy 1, policy_version 693073 (0.0010) [2023-12-28 00:13:17,121][106226] Updated weights for policy 0, policy_version 691268 (0.0011) [2023-12-28 00:13:17,146][106225] Updated weights for policy 1, policy_version 693083 (0.0010) [2023-12-28 00:13:17,172][106226] Updated weights for policy 0, policy_version 691278 (0.0010) [2023-12-28 00:13:17,198][106225] Updated weights for policy 1, policy_version 693093 (0.0008) [2023-12-28 00:13:17,224][106226] Updated weights for policy 0, policy_version 691288 (0.0010) [2023-12-28 00:13:17,839][106225] Updated weights for policy 1, policy_version 693103 (0.0006) [2023-12-28 00:13:17,893][106226] Updated weights for policy 0, policy_version 691298 (0.0009) [2023-12-28 00:13:17,904][106225] Updated weights for policy 1, policy_version 693113 (0.0008) [2023-12-28 00:13:17,950][106226] Updated weights for policy 0, policy_version 691308 (0.0007) [2023-12-28 00:13:17,954][106225] Updated weights for policy 1, policy_version 693123 (0.0010) [2023-12-28 00:13:18,016][106226] Updated weights for policy 0, policy_version 691318 (0.0009) [2023-12-28 00:13:18,576][106225] Updated weights for policy 1, policy_version 693133 (0.0008) [2023-12-28 00:13:18,631][106225] Updated weights for policy 1, policy_version 693143 (0.0008) [2023-12-28 00:13:18,682][106225] Updated weights for policy 1, policy_version 693153 (0.0008) [2023-12-28 00:13:18,691][106226] Updated weights for policy 0, policy_version 691328 (0.0006) [2023-12-28 00:13:18,750][106226] Updated weights for policy 0, policy_version 691338 (0.0008) [2023-12-28 00:13:18,810][106226] Updated weights for policy 0, policy_version 691348 (0.0009) [2023-12-28 00:13:19,356][106225] Updated weights for policy 1, policy_version 693163 (0.0007) [2023-12-28 00:13:19,418][106225] Updated weights for policy 1, policy_version 693173 (0.0009) [2023-12-28 00:13:19,476][106225] Updated weights for policy 1, policy_version 693183 (0.0006) [2023-12-28 00:13:19,577][106226] Updated weights for policy 0, policy_version 691358 (0.0008) [2023-12-28 00:13:19,640][106226] Updated weights for policy 0, policy_version 691368 (0.0008) [2023-12-28 00:13:19,707][106226] Updated weights for policy 0, policy_version 691378 (0.0007) [2023-12-28 00:13:20,201][106225] Updated weights for policy 1, policy_version 693193 (0.0025) [2023-12-28 00:13:20,267][106225] Updated weights for policy 1, policy_version 693203 (0.0006) [2023-12-28 00:13:20,331][106225] Updated weights for policy 1, policy_version 693213 (0.0011) [2023-12-28 00:13:20,396][106225] Updated weights for policy 1, policy_version 693223 (0.0006) [2023-12-28 00:13:20,423][106226] Updated weights for policy 0, policy_version 691388 (0.0008) [2023-12-28 00:13:20,486][106226] Updated weights for policy 0, policy_version 691398 (0.0011) [2023-12-28 00:13:20,544][106226] Updated weights for policy 0, policy_version 691408 (0.0011) [2023-12-28 00:13:21,137][106225] Updated weights for policy 1, policy_version 693233 (0.0008) [2023-12-28 00:13:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 354549760. Throughput: 0: 10120.4, 1: 9865.4. Samples: 354564512. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:21,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.492')] [2023-12-28 00:13:21,199][106225] Updated weights for policy 1, policy_version 693243 (0.0008) [2023-12-28 00:13:21,261][106225] Updated weights for policy 1, policy_version 693253 (0.0008) [2023-12-28 00:13:21,291][106226] Updated weights for policy 0, policy_version 691418 (0.0010) [2023-12-28 00:13:21,346][106226] Updated weights for policy 0, policy_version 691428 (0.0007) [2023-12-28 00:13:21,413][106226] Updated weights for policy 0, policy_version 691438 (0.0009) [2023-12-28 00:13:21,480][106226] Updated weights for policy 0, policy_version 691448 (0.0008) [2023-12-28 00:13:22,060][106225] Updated weights for policy 1, policy_version 693263 (0.0008) [2023-12-28 00:13:22,107][106225] Updated weights for policy 1, policy_version 693273 (0.0007) [2023-12-28 00:13:22,158][106225] Updated weights for policy 1, policy_version 693283 (0.0007) [2023-12-28 00:13:22,200][106226] Updated weights for policy 0, policy_version 691458 (0.0008) [2023-12-28 00:13:22,266][106226] Updated weights for policy 0, policy_version 691468 (0.0007) [2023-12-28 00:13:22,337][106226] Updated weights for policy 0, policy_version 691478 (0.0008) [2023-12-28 00:13:22,892][106226] Updated weights for policy 0, policy_version 691488 (0.0007) [2023-12-28 00:13:22,961][106226] Updated weights for policy 0, policy_version 691498 (0.0008) [2023-12-28 00:13:23,018][106225] Updated weights for policy 1, policy_version 693293 (0.0007) [2023-12-28 00:13:23,028][106226] Updated weights for policy 0, policy_version 691508 (0.0007) [2023-12-28 00:13:23,083][106225] Updated weights for policy 1, policy_version 693303 (0.0006) [2023-12-28 00:13:23,136][106225] Updated weights for policy 1, policy_version 693313 (0.0007) [2023-12-28 00:13:23,661][106226] Updated weights for policy 0, policy_version 691518 (0.0009) [2023-12-28 00:13:23,725][106226] Updated weights for policy 0, policy_version 691528 (0.0010) [2023-12-28 00:13:23,784][106226] Updated weights for policy 0, policy_version 691538 (0.0005) [2023-12-28 00:13:23,837][106225] Updated weights for policy 1, policy_version 693323 (0.0009) [2023-12-28 00:13:23,890][106225] Updated weights for policy 1, policy_version 693333 (0.0007) [2023-12-28 00:13:23,940][106225] Updated weights for policy 1, policy_version 693343 (0.0009) [2023-12-28 00:13:24,357][106226] Updated weights for policy 0, policy_version 691548 (0.0007) [2023-12-28 00:13:24,410][106226] Updated weights for policy 0, policy_version 691558 (0.0010) [2023-12-28 00:13:24,457][106226] Updated weights for policy 0, policy_version 691568 (0.0011) [2023-12-28 00:13:24,635][106225] Updated weights for policy 1, policy_version 693353 (0.0010) [2023-12-28 00:13:24,695][106225] Updated weights for policy 1, policy_version 693363 (0.0005) [2023-12-28 00:13:24,754][106225] Updated weights for policy 1, policy_version 693373 (0.0005) [2023-12-28 00:13:24,813][106225] Updated weights for policy 1, policy_version 693383 (0.0005) [2023-12-28 00:13:25,163][106226] Updated weights for policy 0, policy_version 691578 (0.0010) [2023-12-28 00:13:25,219][106226] Updated weights for policy 0, policy_version 691588 (0.0009) [2023-12-28 00:13:25,275][106226] Updated weights for policy 0, policy_version 691598 (0.0009) [2023-12-28 00:13:25,334][106226] Updated weights for policy 0, policy_version 691608 (0.0009) [2023-12-28 00:13:25,437][106225] Updated weights for policy 1, policy_version 693393 (0.0006) [2023-12-28 00:13:25,496][106225] Updated weights for policy 1, policy_version 693403 (0.0008) [2023-12-28 00:13:25,548][106225] Updated weights for policy 1, policy_version 693413 (0.0008) [2023-12-28 00:13:26,072][106226] Updated weights for policy 0, policy_version 691618 (0.0008) [2023-12-28 00:13:26,131][106226] Updated weights for policy 0, policy_version 691628 (0.0007) [2023-12-28 00:13:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 354648064. Throughput: 0: 10165.0, 1: 9805.4. Samples: 354623028. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:26,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.452')] [2023-12-28 00:13:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000693416_177545216.pth... [2023-12-28 00:13:26,186][106226] Updated weights for policy 0, policy_version 691638 (0.0008) [2023-12-28 00:13:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000692296_177258496.pth [2023-12-28 00:13:26,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000691640_177111040.pth... [2023-12-28 00:13:26,198][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000690424_176799744.pth [2023-12-28 00:13:26,243][106225] Updated weights for policy 1, policy_version 693423 (0.0009) [2023-12-28 00:13:26,296][106225] Updated weights for policy 1, policy_version 693433 (0.0006) [2023-12-28 00:13:26,338][106225] Updated weights for policy 1, policy_version 693443 (0.0010) [2023-12-28 00:13:26,891][106226] Updated weights for policy 0, policy_version 691648 (0.0007) [2023-12-28 00:13:26,921][106225] Updated weights for policy 1, policy_version 693453 (0.0009) [2023-12-28 00:13:26,939][106226] Updated weights for policy 0, policy_version 691658 (0.0005) [2023-12-28 00:13:26,964][106225] Updated weights for policy 1, policy_version 693463 (0.0010) [2023-12-28 00:13:26,985][106226] Updated weights for policy 0, policy_version 691668 (0.0005) [2023-12-28 00:13:27,010][106225] Updated weights for policy 1, policy_version 693473 (0.0010) [2023-12-28 00:13:27,566][106226] Updated weights for policy 0, policy_version 691678 (0.0006) [2023-12-28 00:13:27,625][106226] Updated weights for policy 0, policy_version 691688 (0.0008) [2023-12-28 00:13:27,675][106226] Updated weights for policy 0, policy_version 691698 (0.0006) [2023-12-28 00:13:27,697][106225] Updated weights for policy 1, policy_version 693483 (0.0009) [2023-12-28 00:13:27,766][106225] Updated weights for policy 1, policy_version 693493 (0.0010) [2023-12-28 00:13:27,818][106225] Updated weights for policy 1, policy_version 693503 (0.0010) [2023-12-28 00:13:28,314][106226] Updated weights for policy 0, policy_version 691708 (0.0007) [2023-12-28 00:13:28,379][106226] Updated weights for policy 0, policy_version 691718 (0.0009) [2023-12-28 00:13:28,443][106225] Updated weights for policy 1, policy_version 693513 (0.0010) [2023-12-28 00:13:28,445][106226] Updated weights for policy 0, policy_version 691728 (0.0005) [2023-12-28 00:13:28,502][106225] Updated weights for policy 1, policy_version 693523 (0.0006) [2023-12-28 00:13:28,555][106225] Updated weights for policy 1, policy_version 693533 (0.0009) [2023-12-28 00:13:28,607][106225] Updated weights for policy 1, policy_version 693543 (0.0009) [2023-12-28 00:13:29,126][106226] Updated weights for policy 0, policy_version 691738 (0.0006) [2023-12-28 00:13:29,176][106226] Updated weights for policy 0, policy_version 691748 (0.0005) [2023-12-28 00:13:29,236][106226] Updated weights for policy 0, policy_version 691758 (0.0008) [2023-12-28 00:13:29,246][106225] Updated weights for policy 1, policy_version 693553 (0.0008) [2023-12-28 00:13:29,298][106226] Updated weights for policy 0, policy_version 691768 (0.0008) [2023-12-28 00:13:29,311][106225] Updated weights for policy 1, policy_version 693563 (0.0007) [2023-12-28 00:13:29,378][106225] Updated weights for policy 1, policy_version 693573 (0.0007) [2023-12-28 00:13:29,973][106225] Updated weights for policy 1, policy_version 693583 (0.0006) [2023-12-28 00:13:30,035][106225] Updated weights for policy 1, policy_version 693593 (0.0007) [2023-12-28 00:13:30,100][106225] Updated weights for policy 1, policy_version 693603 (0.0007) [2023-12-28 00:13:30,135][106226] Updated weights for policy 0, policy_version 691778 (0.0006) [2023-12-28 00:13:30,203][106226] Updated weights for policy 0, policy_version 691788 (0.0006) [2023-12-28 00:13:30,252][106226] Updated weights for policy 0, policy_version 691798 (0.0007) [2023-12-28 00:13:30,688][106225] Updated weights for policy 1, policy_version 693613 (0.0006) [2023-12-28 00:13:30,739][106225] Updated weights for policy 1, policy_version 693623 (0.0005) [2023-12-28 00:13:30,797][106225] Updated weights for policy 1, policy_version 693633 (0.0007) [2023-12-28 00:13:30,881][106226] Updated weights for policy 0, policy_version 691808 (0.0008) [2023-12-28 00:13:30,948][106226] Updated weights for policy 0, policy_version 691818 (0.0006) [2023-12-28 00:13:31,006][106226] Updated weights for policy 0, policy_version 691828 (0.0009) [2023-12-28 00:13:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 354762752. Throughput: 0: 10194.9, 1: 9931.7. Samples: 354748016. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:31,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.398')] [2023-12-28 00:13:31,416][106225] Updated weights for policy 1, policy_version 693643 (0.0009) [2023-12-28 00:13:31,479][106225] Updated weights for policy 1, policy_version 693653 (0.0006) [2023-12-28 00:13:31,546][106225] Updated weights for policy 1, policy_version 693663 (0.0005) [2023-12-28 00:13:31,723][106226] Updated weights for policy 0, policy_version 691838 (0.0008) [2023-12-28 00:13:31,791][106226] Updated weights for policy 0, policy_version 691848 (0.0007) [2023-12-28 00:13:31,869][106226] Updated weights for policy 0, policy_version 691858 (0.0005) [2023-12-28 00:13:32,174][106225] Updated weights for policy 1, policy_version 693673 (0.0010) [2023-12-28 00:13:32,232][106225] Updated weights for policy 1, policy_version 693683 (0.0005) [2023-12-28 00:13:32,295][106225] Updated weights for policy 1, policy_version 693693 (0.0006) [2023-12-28 00:13:32,358][106225] Updated weights for policy 1, policy_version 693703 (0.0009) [2023-12-28 00:13:32,478][106226] Updated weights for policy 0, policy_version 691868 (0.0007) [2023-12-28 00:13:32,530][106226] Updated weights for policy 0, policy_version 691878 (0.0006) [2023-12-28 00:13:32,584][106226] Updated weights for policy 0, policy_version 691888 (0.0006) [2023-12-28 00:13:33,118][106225] Updated weights for policy 1, policy_version 693713 (0.0007) [2023-12-28 00:13:33,138][106226] Updated weights for policy 0, policy_version 691898 (0.0005) [2023-12-28 00:13:33,171][106225] Updated weights for policy 1, policy_version 693723 (0.0005) [2023-12-28 00:13:33,200][106226] Updated weights for policy 0, policy_version 691908 (0.0005) [2023-12-28 00:13:33,225][106225] Updated weights for policy 1, policy_version 693733 (0.0006) [2023-12-28 00:13:33,255][106226] Updated weights for policy 0, policy_version 691918 (0.0005) [2023-12-28 00:13:33,298][106226] Updated weights for policy 0, policy_version 691928 (0.0005) [2023-12-28 00:13:33,869][106226] Updated weights for policy 0, policy_version 691938 (0.0009) [2023-12-28 00:13:33,890][106225] Updated weights for policy 1, policy_version 693743 (0.0008) [2023-12-28 00:13:33,919][106226] Updated weights for policy 0, policy_version 691948 (0.0008) [2023-12-28 00:13:33,945][106225] Updated weights for policy 1, policy_version 693753 (0.0006) [2023-12-28 00:13:33,973][106226] Updated weights for policy 0, policy_version 691958 (0.0009) [2023-12-28 00:13:34,002][106225] Updated weights for policy 1, policy_version 693763 (0.0008) [2023-12-28 00:13:34,671][106225] Updated weights for policy 1, policy_version 693773 (0.0009) [2023-12-28 00:13:34,726][106225] Updated weights for policy 1, policy_version 693783 (0.0007) [2023-12-28 00:13:34,751][106226] Updated weights for policy 0, policy_version 691968 (0.0008) [2023-12-28 00:13:34,781][106225] Updated weights for policy 1, policy_version 693793 (0.0006) [2023-12-28 00:13:34,809][106226] Updated weights for policy 0, policy_version 691978 (0.0009) [2023-12-28 00:13:34,865][106226] Updated weights for policy 0, policy_version 691988 (0.0007) [2023-12-28 00:13:35,499][106226] Updated weights for policy 0, policy_version 691998 (0.0005) [2023-12-28 00:13:35,556][106226] Updated weights for policy 0, policy_version 692008 (0.0005) [2023-12-28 00:13:35,571][106225] Updated weights for policy 1, policy_version 693803 (0.0008) [2023-12-28 00:13:35,607][106226] Updated weights for policy 0, policy_version 692018 (0.0005) [2023-12-28 00:13:35,621][106225] Updated weights for policy 1, policy_version 693813 (0.0008) [2023-12-28 00:13:35,676][106225] Updated weights for policy 1, policy_version 693823 (0.0008) [2023-12-28 00:13:36,123][106226] Updated weights for policy 0, policy_version 692028 (0.0006) [2023-12-28 00:13:36,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 354861056. Throughput: 0: 10276.2, 1: 9936.8. Samples: 354874212. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:36,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-5.714')] [2023-12-28 00:13:36,182][106226] Updated weights for policy 0, policy_version 692038 (0.0007) [2023-12-28 00:13:36,243][106226] Updated weights for policy 0, policy_version 692048 (0.0011) [2023-12-28 00:13:36,526][106225] Updated weights for policy 1, policy_version 693834 (0.0009) [2023-12-28 00:13:36,577][106225] Updated weights for policy 1, policy_version 693844 (0.0008) [2023-12-28 00:13:36,638][106225] Updated weights for policy 1, policy_version 693854 (0.0007) [2023-12-28 00:13:36,701][106225] Updated weights for policy 1, policy_version 693864 (0.0008) [2023-12-28 00:13:36,914][106226] Updated weights for policy 0, policy_version 692058 (0.0008) [2023-12-28 00:13:36,972][106226] Updated weights for policy 0, policy_version 692068 (0.0011) [2023-12-28 00:13:37,020][106226] Updated weights for policy 0, policy_version 692078 (0.0010) [2023-12-28 00:13:37,071][106226] Updated weights for policy 0, policy_version 692088 (0.0010) [2023-12-28 00:13:37,464][106225] Updated weights for policy 1, policy_version 693874 (0.0010) [2023-12-28 00:13:37,528][106225] Updated weights for policy 1, policy_version 693884 (0.0010) [2023-12-28 00:13:37,589][106225] Updated weights for policy 1, policy_version 693894 (0.0010) [2023-12-28 00:13:37,760][106226] Updated weights for policy 0, policy_version 692098 (0.0007) [2023-12-28 00:13:37,809][106226] Updated weights for policy 0, policy_version 692108 (0.0010) [2023-12-28 00:13:37,869][106226] Updated weights for policy 0, policy_version 692118 (0.0010) [2023-12-28 00:13:38,230][106225] Updated weights for policy 1, policy_version 693904 (0.0010) [2023-12-28 00:13:38,283][106225] Updated weights for policy 1, policy_version 693914 (0.0010) [2023-12-28 00:13:38,349][106225] Updated weights for policy 1, policy_version 693924 (0.0009) [2023-12-28 00:13:38,603][106226] Updated weights for policy 0, policy_version 692128 (0.0011) [2023-12-28 00:13:38,672][106226] Updated weights for policy 0, policy_version 692138 (0.0011) [2023-12-28 00:13:38,756][106226] Updated weights for policy 0, policy_version 692148 (0.0011) [2023-12-28 00:13:39,035][106225] Updated weights for policy 1, policy_version 693934 (0.0009) [2023-12-28 00:13:39,080][106225] Updated weights for policy 1, policy_version 693944 (0.0010) [2023-12-28 00:13:39,143][106225] Updated weights for policy 1, policy_version 693954 (0.0010) [2023-12-28 00:13:39,505][106226] Updated weights for policy 0, policy_version 692158 (0.0011) [2023-12-28 00:13:39,563][106226] Updated weights for policy 0, policy_version 692168 (0.0010) [2023-12-28 00:13:39,627][106226] Updated weights for policy 0, policy_version 692178 (0.0011) [2023-12-28 00:13:39,865][106225] Updated weights for policy 1, policy_version 693964 (0.0009) [2023-12-28 00:13:39,929][106225] Updated weights for policy 1, policy_version 693974 (0.0007) [2023-12-28 00:13:39,995][106225] Updated weights for policy 1, policy_version 693984 (0.0007) [2023-12-28 00:13:40,400][106226] Updated weights for policy 0, policy_version 692188 (0.0010) [2023-12-28 00:13:40,464][106226] Updated weights for policy 0, policy_version 692198 (0.0009) [2023-12-28 00:13:40,519][106226] Updated weights for policy 0, policy_version 692208 (0.0010) [2023-12-28 00:13:40,707][106225] Updated weights for policy 1, policy_version 693994 (0.0008) [2023-12-28 00:13:40,766][106225] Updated weights for policy 1, policy_version 694004 (0.0005) [2023-12-28 00:13:40,823][106225] Updated weights for policy 1, policy_version 694014 (0.0005) [2023-12-28 00:13:40,883][106225] Updated weights for policy 1, policy_version 694024 (0.0008) [2023-12-28 00:13:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 354959360. Throughput: 0: 10258.7, 1: 9875.6. Samples: 354931980. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:41,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.371')] [2023-12-28 00:13:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000692216_177258496.pth... [2023-12-28 00:13:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000694024_177700864.pth... [2023-12-28 00:13:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000692872_177405952.pth [2023-12-28 00:13:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000691032_176955392.pth [2023-12-28 00:13:41,186][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000694024_177700864.pth [2023-12-28 00:13:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000692216_177258496.pth [2023-12-28 00:13:41,250][106226] Updated weights for policy 0, policy_version 692218 (0.0011) [2023-12-28 00:13:41,323][106226] Updated weights for policy 0, policy_version 692228 (0.0010) [2023-12-28 00:13:41,401][106226] Updated weights for policy 0, policy_version 692238 (0.0009) [2023-12-28 00:13:41,463][106226] Updated weights for policy 0, policy_version 692248 (0.0010) [2023-12-28 00:13:41,546][106225] Updated weights for policy 1, policy_version 694034 (0.0006) [2023-12-28 00:13:41,615][106225] Updated weights for policy 1, policy_version 694044 (0.0007) [2023-12-28 00:13:41,680][106225] Updated weights for policy 1, policy_version 694054 (0.0007) [2023-12-28 00:13:42,227][106226] Updated weights for policy 0, policy_version 692258 (0.0011) [2023-12-28 00:13:42,293][106226] Updated weights for policy 0, policy_version 692268 (0.0010) [2023-12-28 00:13:42,358][106226] Updated weights for policy 0, policy_version 692278 (0.0011) [2023-12-28 00:13:42,364][106225] Updated weights for policy 1, policy_version 694064 (0.0007) [2023-12-28 00:13:42,438][106225] Updated weights for policy 1, policy_version 694074 (0.0008) [2023-12-28 00:13:42,502][106225] Updated weights for policy 1, policy_version 694084 (0.0006) [2023-12-28 00:13:43,103][106226] Updated weights for policy 0, policy_version 692288 (0.0010) [2023-12-28 00:13:43,165][106225] Updated weights for policy 1, policy_version 694094 (0.0007) [2023-12-28 00:13:43,167][106226] Updated weights for policy 0, policy_version 692298 (0.0011) [2023-12-28 00:13:43,224][106225] Updated weights for policy 1, policy_version 694104 (0.0005) [2023-12-28 00:13:43,229][106226] Updated weights for policy 0, policy_version 692308 (0.0011) [2023-12-28 00:13:43,283][106225] Updated weights for policy 1, policy_version 694114 (0.0008) [2023-12-28 00:13:43,842][106226] Updated weights for policy 0, policy_version 692318 (0.0007) [2023-12-28 00:13:43,890][106226] Updated weights for policy 0, policy_version 692328 (0.0005) [2023-12-28 00:13:43,942][106226] Updated weights for policy 0, policy_version 692338 (0.0005) [2023-12-28 00:13:44,016][106225] Updated weights for policy 1, policy_version 694124 (0.0010) [2023-12-28 00:13:44,069][106225] Updated weights for policy 1, policy_version 694134 (0.0010) [2023-12-28 00:13:44,131][106225] Updated weights for policy 1, policy_version 694144 (0.0007) [2023-12-28 00:13:44,503][106226] Updated weights for policy 0, policy_version 692348 (0.0006) [2023-12-28 00:13:44,568][106226] Updated weights for policy 0, policy_version 692358 (0.0005) [2023-12-28 00:13:44,630][106226] Updated weights for policy 0, policy_version 692368 (0.0005) [2023-12-28 00:13:44,784][106225] Updated weights for policy 1, policy_version 694154 (0.0008) [2023-12-28 00:13:44,842][106225] Updated weights for policy 1, policy_version 694164 (0.0008) [2023-12-28 00:13:44,904][106225] Updated weights for policy 1, policy_version 694174 (0.0008) [2023-12-28 00:13:44,972][106225] Updated weights for policy 1, policy_version 694184 (0.0007) [2023-12-28 00:13:45,267][106226] Updated weights for policy 0, policy_version 692378 (0.0005) [2023-12-28 00:13:45,334][106226] Updated weights for policy 0, policy_version 692388 (0.0008) [2023-12-28 00:13:45,398][106226] Updated weights for policy 0, policy_version 692398 (0.0011) [2023-12-28 00:13:45,453][106226] Updated weights for policy 0, policy_version 692408 (0.0010) [2023-12-28 00:13:45,684][106225] Updated weights for policy 1, policy_version 694194 (0.0007) [2023-12-28 00:13:45,739][106225] Updated weights for policy 1, policy_version 694204 (0.0005) [2023-12-28 00:13:45,802][106225] Updated weights for policy 1, policy_version 694214 (0.0005) [2023-12-28 00:13:46,083][106226] Updated weights for policy 0, policy_version 692418 (0.0010) [2023-12-28 00:13:46,130][106226] Updated weights for policy 0, policy_version 692428 (0.0010) [2023-12-28 00:13:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.5, 300 sec: 19966.3). Total num frames: 355057664. Throughput: 0: 10209.2, 1: 9840.1. Samples: 355051916. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:46,175][105115] Avg episode reward: [(0, '-4.392'), (1, '-5.277')] [2023-12-28 00:13:46,177][106226] Updated weights for policy 0, policy_version 692438 (0.0010) [2023-12-28 00:13:46,412][106225] Updated weights for policy 1, policy_version 694224 (0.0005) [2023-12-28 00:13:46,465][106225] Updated weights for policy 1, policy_version 694234 (0.0006) [2023-12-28 00:13:46,521][106225] Updated weights for policy 1, policy_version 694244 (0.0005) [2023-12-28 00:13:46,923][106226] Updated weights for policy 0, policy_version 692448 (0.0010) [2023-12-28 00:13:46,983][106226] Updated weights for policy 0, policy_version 692458 (0.0010) [2023-12-28 00:13:47,019][106225] Updated weights for policy 1, policy_version 694254 (0.0008) [2023-12-28 00:13:47,034][106226] Updated weights for policy 0, policy_version 692468 (0.0010) [2023-12-28 00:13:47,073][106225] Updated weights for policy 1, policy_version 694264 (0.0010) [2023-12-28 00:13:47,116][106225] Updated weights for policy 1, policy_version 694274 (0.0010) [2023-12-28 00:13:47,674][106226] Updated weights for policy 0, policy_version 692478 (0.0009) [2023-12-28 00:13:47,724][106226] Updated weights for policy 0, policy_version 692488 (0.0010) [2023-12-28 00:13:47,769][106225] Updated weights for policy 1, policy_version 694284 (0.0009) [2023-12-28 00:13:47,777][106226] Updated weights for policy 0, policy_version 692498 (0.0005) [2023-12-28 00:13:47,822][106225] Updated weights for policy 1, policy_version 694294 (0.0009) [2023-12-28 00:13:47,872][106225] Updated weights for policy 1, policy_version 694304 (0.0009) [2023-12-28 00:13:48,326][106226] Updated weights for policy 0, policy_version 692508 (0.0006) [2023-12-28 00:13:48,390][106226] Updated weights for policy 0, policy_version 692518 (0.0008) [2023-12-28 00:13:48,453][106226] Updated weights for policy 0, policy_version 692528 (0.0008) [2023-12-28 00:13:48,561][106225] Updated weights for policy 1, policy_version 694314 (0.0009) [2023-12-28 00:13:48,628][106225] Updated weights for policy 1, policy_version 694324 (0.0009) [2023-12-28 00:13:48,683][106225] Updated weights for policy 1, policy_version 694334 (0.0010) [2023-12-28 00:13:48,744][106225] Updated weights for policy 1, policy_version 694344 (0.0010) [2023-12-28 00:13:49,210][106226] Updated weights for policy 0, policy_version 692538 (0.0008) [2023-12-28 00:13:49,276][106226] Updated weights for policy 0, policy_version 692548 (0.0008) [2023-12-28 00:13:49,341][106226] Updated weights for policy 0, policy_version 692558 (0.0006) [2023-12-28 00:13:49,407][106226] Updated weights for policy 0, policy_version 692568 (0.0009) [2023-12-28 00:13:49,457][106225] Updated weights for policy 1, policy_version 694354 (0.0008) [2023-12-28 00:13:49,512][106225] Updated weights for policy 1, policy_version 694364 (0.0008) [2023-12-28 00:13:49,574][106225] Updated weights for policy 1, policy_version 694374 (0.0008) [2023-12-28 00:13:50,117][106226] Updated weights for policy 0, policy_version 692578 (0.0006) [2023-12-28 00:13:50,186][106226] Updated weights for policy 0, policy_version 692588 (0.0008) [2023-12-28 00:13:50,250][106226] Updated weights for policy 0, policy_version 692598 (0.0010) [2023-12-28 00:13:50,362][106225] Updated weights for policy 1, policy_version 694384 (0.0007) [2023-12-28 00:13:50,421][106225] Updated weights for policy 1, policy_version 694394 (0.0008) [2023-12-28 00:13:50,473][106225] Updated weights for policy 1, policy_version 694404 (0.0005) [2023-12-28 00:13:50,871][106226] Updated weights for policy 0, policy_version 692608 (0.0010) [2023-12-28 00:13:50,936][106226] Updated weights for policy 0, policy_version 692618 (0.0007) [2023-12-28 00:13:50,994][106226] Updated weights for policy 0, policy_version 692628 (0.0006) [2023-12-28 00:13:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 355164160. Throughput: 0: 10167.3, 1: 9909.7. Samples: 355174764. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:51,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-5.579')] [2023-12-28 00:13:51,266][106225] Updated weights for policy 1, policy_version 694414 (0.0008) [2023-12-28 00:13:51,332][106225] Updated weights for policy 1, policy_version 694424 (0.0008) [2023-12-28 00:13:51,419][106225] Updated weights for policy 1, policy_version 694434 (0.0008) [2023-12-28 00:13:51,696][106226] Updated weights for policy 0, policy_version 692638 (0.0007) [2023-12-28 00:13:51,766][106226] Updated weights for policy 0, policy_version 692648 (0.0008) [2023-12-28 00:13:51,821][106226] Updated weights for policy 0, policy_version 692658 (0.0008) [2023-12-28 00:13:52,106][106225] Updated weights for policy 1, policy_version 694444 (0.0008) [2023-12-28 00:13:52,168][106225] Updated weights for policy 1, policy_version 694454 (0.0009) [2023-12-28 00:13:52,235][106225] Updated weights for policy 1, policy_version 694464 (0.0009) [2023-12-28 00:13:52,582][106226] Updated weights for policy 0, policy_version 692668 (0.0009) [2023-12-28 00:13:52,640][106226] Updated weights for policy 0, policy_version 692678 (0.0011) [2023-12-28 00:13:52,700][106226] Updated weights for policy 0, policy_version 692688 (0.0011) [2023-12-28 00:13:52,991][106225] Updated weights for policy 1, policy_version 694474 (0.0008) [2023-12-28 00:13:53,051][106225] Updated weights for policy 1, policy_version 694484 (0.0007) [2023-12-28 00:13:53,100][106225] Updated weights for policy 1, policy_version 694494 (0.0007) [2023-12-28 00:13:53,164][106225] Updated weights for policy 1, policy_version 694504 (0.0008) [2023-12-28 00:13:53,412][106226] Updated weights for policy 0, policy_version 692698 (0.0011) [2023-12-28 00:13:53,479][106226] Updated weights for policy 0, policy_version 692708 (0.0011) [2023-12-28 00:13:53,539][106226] Updated weights for policy 0, policy_version 692718 (0.0011) [2023-12-28 00:13:53,596][106226] Updated weights for policy 0, policy_version 692728 (0.0010) [2023-12-28 00:13:53,828][106225] Updated weights for policy 1, policy_version 694514 (0.0005) [2023-12-28 00:13:53,886][106225] Updated weights for policy 1, policy_version 694524 (0.0008) [2023-12-28 00:13:53,941][106225] Updated weights for policy 1, policy_version 694534 (0.0008) [2023-12-28 00:13:54,274][106226] Updated weights for policy 0, policy_version 692738 (0.0009) [2023-12-28 00:13:54,343][106226] Updated weights for policy 0, policy_version 692748 (0.0005) [2023-12-28 00:13:54,402][106226] Updated weights for policy 0, policy_version 692758 (0.0005) [2023-12-28 00:13:54,521][106225] Updated weights for policy 1, policy_version 694544 (0.0007) [2023-12-28 00:13:54,586][106225] Updated weights for policy 1, policy_version 694554 (0.0008) [2023-12-28 00:13:54,651][106225] Updated weights for policy 1, policy_version 694564 (0.0009) [2023-12-28 00:13:54,918][106226] Updated weights for policy 0, policy_version 692768 (0.0007) [2023-12-28 00:13:54,979][106226] Updated weights for policy 0, policy_version 692778 (0.0011) [2023-12-28 00:13:55,034][106226] Updated weights for policy 0, policy_version 692788 (0.0011) [2023-12-28 00:13:55,314][106225] Updated weights for policy 1, policy_version 694574 (0.0011) [2023-12-28 00:13:55,363][106225] Updated weights for policy 1, policy_version 694584 (0.0010) [2023-12-28 00:13:55,423][106225] Updated weights for policy 1, policy_version 694594 (0.0007) [2023-12-28 00:13:55,749][106226] Updated weights for policy 0, policy_version 692798 (0.0009) [2023-12-28 00:13:55,795][106226] Updated weights for policy 0, policy_version 692808 (0.0008) [2023-12-28 00:13:55,853][106226] Updated weights for policy 0, policy_version 692818 (0.0008) [2023-12-28 00:13:56,078][106225] Updated weights for policy 1, policy_version 694604 (0.0007) [2023-12-28 00:13:56,131][106225] Updated weights for policy 1, policy_version 694614 (0.0008) [2023-12-28 00:13:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 355262464. Throughput: 0: 10151.6, 1: 9919.4. Samples: 355231696. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:13:56,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-5.561')] [2023-12-28 00:13:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000692824_177414144.pth... [2023-12-28 00:13:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000691640_177111040.pth [2023-12-28 00:13:56,186][106225] Updated weights for policy 1, policy_version 694624 (0.0008) [2023-12-28 00:13:56,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000694632_177856512.pth... [2023-12-28 00:13:56,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000693416_177545216.pth [2023-12-28 00:13:56,626][106226] Updated weights for policy 0, policy_version 692828 (0.0007) [2023-12-28 00:13:56,692][106226] Updated weights for policy 0, policy_version 692838 (0.0008) [2023-12-28 00:13:56,758][106226] Updated weights for policy 0, policy_version 692848 (0.0010) [2023-12-28 00:13:56,850][106225] Updated weights for policy 1, policy_version 694634 (0.0005) [2023-12-28 00:13:56,921][106225] Updated weights for policy 1, policy_version 694644 (0.0006) [2023-12-28 00:13:56,985][106225] Updated weights for policy 1, policy_version 694654 (0.0010) [2023-12-28 00:13:57,035][106225] Updated weights for policy 1, policy_version 694664 (0.0010) [2023-12-28 00:13:57,386][106226] Updated weights for policy 0, policy_version 692858 (0.0007) [2023-12-28 00:13:57,446][106226] Updated weights for policy 0, policy_version 692868 (0.0008) [2023-12-28 00:13:57,499][106226] Updated weights for policy 0, policy_version 692878 (0.0008) [2023-12-28 00:13:57,541][106226] Updated weights for policy 0, policy_version 692888 (0.0007) [2023-12-28 00:13:57,615][106225] Updated weights for policy 1, policy_version 694674 (0.0010) [2023-12-28 00:13:57,668][106225] Updated weights for policy 1, policy_version 694684 (0.0010) [2023-12-28 00:13:57,715][106225] Updated weights for policy 1, policy_version 694694 (0.0010) [2023-12-28 00:13:58,345][106226] Updated weights for policy 0, policy_version 692898 (0.0007) [2023-12-28 00:13:58,371][106225] Updated weights for policy 1, policy_version 694706 (0.0010) [2023-12-28 00:13:58,409][106226] Updated weights for policy 0, policy_version 692908 (0.0008) [2023-12-28 00:13:58,410][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000004 [2023-12-28 00:13:58,472][106226] Updated weights for policy 0, policy_version 692918 (0.0008) [2023-12-28 00:13:59,312][106225] Updated weights for policy 1, policy_version 694716 (0.0008) [2023-12-28 00:13:59,330][106226] Updated weights for policy 0, policy_version 692928 (0.0008) [2023-12-28 00:13:59,374][106225] Updated weights for policy 1, policy_version 694726 (0.0010) [2023-12-28 00:13:59,400][106226] Updated weights for policy 0, policy_version 692938 (0.0008) [2023-12-28 00:13:59,435][106225] Updated weights for policy 1, policy_version 694736 (0.0007) [2023-12-28 00:13:59,448][106226] Updated weights for policy 0, policy_version 692948 (0.0008) [2023-12-28 00:14:00,030][106225] Updated weights for policy 1, policy_version 694746 (0.0007) [2023-12-28 00:14:00,097][106225] Updated weights for policy 1, policy_version 694756 (0.0010) [2023-12-28 00:14:00,154][106225] Updated weights for policy 1, policy_version 694766 (0.0010) [2023-12-28 00:14:00,216][106225] Updated weights for policy 1, policy_version 694776 (0.0010) [2023-12-28 00:14:00,246][106226] Updated weights for policy 0, policy_version 692958 (0.0009) [2023-12-28 00:14:00,300][106226] Updated weights for policy 0, policy_version 692968 (0.0010) [2023-12-28 00:14:00,360][106226] Updated weights for policy 0, policy_version 692978 (0.0010) [2023-12-28 00:14:00,866][106225] Updated weights for policy 1, policy_version 694786 (0.0008) [2023-12-28 00:14:00,918][106225] Updated weights for policy 1, policy_version 694796 (0.0007) [2023-12-28 00:14:00,979][106225] Updated weights for policy 1, policy_version 694806 (0.0008) [2023-12-28 00:14:01,018][106226] Updated weights for policy 0, policy_version 692988 (0.0011) [2023-12-28 00:14:01,077][106226] Updated weights for policy 0, policy_version 692998 (0.0011) [2023-12-28 00:14:01,142][106226] Updated weights for policy 0, policy_version 693008 (0.0011) [2023-12-28 00:14:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 355360768. Throughput: 0: 10105.2, 1: 10091.7. Samples: 355352120. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:01,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-5.672')] [2023-12-28 00:14:01,756][106225] Updated weights for policy 1, policy_version 694816 (0.0008) [2023-12-28 00:14:01,817][106225] Updated weights for policy 1, policy_version 694826 (0.0007) [2023-12-28 00:14:01,875][106225] Updated weights for policy 1, policy_version 694836 (0.0008) [2023-12-28 00:14:01,890][106226] Updated weights for policy 0, policy_version 693018 (0.0010) [2023-12-28 00:14:01,950][106226] Updated weights for policy 0, policy_version 693028 (0.0011) [2023-12-28 00:14:02,011][106226] Updated weights for policy 0, policy_version 693038 (0.0011) [2023-12-28 00:14:02,068][106226] Updated weights for policy 0, policy_version 693048 (0.0011) [2023-12-28 00:14:02,631][106225] Updated weights for policy 1, policy_version 694846 (0.0009) [2023-12-28 00:14:02,685][106225] Updated weights for policy 1, policy_version 694856 (0.0008) [2023-12-28 00:14:02,736][106225] Updated weights for policy 1, policy_version 694866 (0.0007) [2023-12-28 00:14:02,778][106226] Updated weights for policy 0, policy_version 693058 (0.0010) [2023-12-28 00:14:02,829][106226] Updated weights for policy 0, policy_version 693068 (0.0010) [2023-12-28 00:14:02,877][106226] Updated weights for policy 0, policy_version 693078 (0.0010) [2023-12-28 00:14:03,313][106225] Updated weights for policy 1, policy_version 694876 (0.0006) [2023-12-28 00:14:03,360][106225] Updated weights for policy 1, policy_version 694886 (0.0005) [2023-12-28 00:14:03,413][106225] Updated weights for policy 1, policy_version 694896 (0.0009) [2023-12-28 00:14:03,575][106226] Updated weights for policy 0, policy_version 693088 (0.0010) [2023-12-28 00:14:03,624][106226] Updated weights for policy 0, policy_version 693098 (0.0010) [2023-12-28 00:14:03,670][106226] Updated weights for policy 0, policy_version 693108 (0.0010) [2023-12-28 00:14:03,990][106225] Updated weights for policy 1, policy_version 694906 (0.0010) [2023-12-28 00:14:04,052][106225] Updated weights for policy 1, policy_version 694916 (0.0005) [2023-12-28 00:14:04,111][106225] Updated weights for policy 1, policy_version 694926 (0.0006) [2023-12-28 00:14:04,173][106225] Updated weights for policy 1, policy_version 694936 (0.0009) [2023-12-28 00:14:04,398][106226] Updated weights for policy 0, policy_version 693118 (0.0010) [2023-12-28 00:14:04,463][106226] Updated weights for policy 0, policy_version 693128 (0.0009) [2023-12-28 00:14:04,527][106226] Updated weights for policy 0, policy_version 693138 (0.0011) [2023-12-28 00:14:04,850][106225] Updated weights for policy 1, policy_version 694946 (0.0006) [2023-12-28 00:14:04,894][106225] Updated weights for policy 1, policy_version 694956 (0.0010) [2023-12-28 00:14:04,947][106225] Updated weights for policy 1, policy_version 694966 (0.0010) [2023-12-28 00:14:05,164][106226] Updated weights for policy 0, policy_version 693148 (0.0011) [2023-12-28 00:14:05,220][106226] Updated weights for policy 0, policy_version 693158 (0.0010) [2023-12-28 00:14:05,279][106226] Updated weights for policy 0, policy_version 693168 (0.0010) [2023-12-28 00:14:05,683][106225] Updated weights for policy 1, policy_version 694976 (0.0010) [2023-12-28 00:14:05,750][106225] Updated weights for policy 1, policy_version 694986 (0.0009) [2023-12-28 00:14:05,805][106225] Updated weights for policy 1, policy_version 694996 (0.0007) [2023-12-28 00:14:05,987][106226] Updated weights for policy 0, policy_version 693178 (0.0011) [2023-12-28 00:14:06,037][106226] Updated weights for policy 0, policy_version 693188 (0.0009) [2023-12-28 00:14:06,096][106226] Updated weights for policy 0, policy_version 693198 (0.0006) [2023-12-28 00:14:06,167][106226] Updated weights for policy 0, policy_version 693208 (0.0007) [2023-12-28 00:14:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 355467264. Throughput: 0: 10085.1, 1: 10105.6. Samples: 355473096. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:06,175][105115] Avg episode reward: [(0, '-4.155'), (1, '-5.170')] [2023-12-28 00:14:06,503][106225] Updated weights for policy 1, policy_version 695006 (0.0008) [2023-12-28 00:14:06,564][106225] Updated weights for policy 1, policy_version 695016 (0.0010) [2023-12-28 00:14:06,623][106225] Updated weights for policy 1, policy_version 695026 (0.0010) [2023-12-28 00:14:06,860][106226] Updated weights for policy 0, policy_version 693218 (0.0005) [2023-12-28 00:14:06,912][106226] Updated weights for policy 0, policy_version 693228 (0.0005) [2023-12-28 00:14:06,976][106226] Updated weights for policy 0, policy_version 693238 (0.0006) [2023-12-28 00:14:07,349][106225] Updated weights for policy 1, policy_version 695036 (0.0011) [2023-12-28 00:14:07,409][106225] Updated weights for policy 1, policy_version 695046 (0.0010) [2023-12-28 00:14:07,456][106225] Updated weights for policy 1, policy_version 695056 (0.0008) [2023-12-28 00:14:07,673][106226] Updated weights for policy 0, policy_version 693248 (0.0009) [2023-12-28 00:14:07,732][106226] Updated weights for policy 0, policy_version 693258 (0.0008) [2023-12-28 00:14:07,792][106226] Updated weights for policy 0, policy_version 693268 (0.0008) [2023-12-28 00:14:08,071][106225] Updated weights for policy 1, policy_version 695066 (0.0008) [2023-12-28 00:14:08,130][106225] Updated weights for policy 1, policy_version 695076 (0.0005) [2023-12-28 00:14:08,185][106225] Updated weights for policy 1, policy_version 695086 (0.0006) [2023-12-28 00:14:08,243][106225] Updated weights for policy 1, policy_version 695096 (0.0006) [2023-12-28 00:14:08,581][106226] Updated weights for policy 0, policy_version 693278 (0.0007) [2023-12-28 00:14:08,638][106226] Updated weights for policy 0, policy_version 693288 (0.0007) [2023-12-28 00:14:08,703][106226] Updated weights for policy 0, policy_version 693298 (0.0009) [2023-12-28 00:14:08,910][106225] Updated weights for policy 1, policy_version 695106 (0.0008) [2023-12-28 00:14:08,958][106225] Updated weights for policy 1, policy_version 695116 (0.0008) [2023-12-28 00:14:09,006][106225] Updated weights for policy 1, policy_version 695126 (0.0008) [2023-12-28 00:14:09,361][106226] Updated weights for policy 0, policy_version 693308 (0.0007) [2023-12-28 00:14:09,437][106226] Updated weights for policy 0, policy_version 693318 (0.0007) [2023-12-28 00:14:09,499][106226] Updated weights for policy 0, policy_version 693328 (0.0008) [2023-12-28 00:14:09,814][106225] Updated weights for policy 1, policy_version 695136 (0.0009) [2023-12-28 00:14:09,882][106225] Updated weights for policy 1, policy_version 695146 (0.0008) [2023-12-28 00:14:09,950][106225] Updated weights for policy 1, policy_version 695156 (0.0008) [2023-12-28 00:14:10,252][106226] Updated weights for policy 0, policy_version 693338 (0.0010) [2023-12-28 00:14:10,319][106226] Updated weights for policy 0, policy_version 693348 (0.0008) [2023-12-28 00:14:10,387][106226] Updated weights for policy 0, policy_version 693358 (0.0008) [2023-12-28 00:14:10,451][106226] Updated weights for policy 0, policy_version 693368 (0.0009) [2023-12-28 00:14:10,619][106225] Updated weights for policy 1, policy_version 695166 (0.0009) [2023-12-28 00:14:10,682][106225] Updated weights for policy 1, policy_version 695176 (0.0006) [2023-12-28 00:14:10,732][106225] Updated weights for policy 1, policy_version 695186 (0.0007) [2023-12-28 00:14:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 355557376. Throughput: 0: 10036.3, 1: 10185.8. Samples: 355533020. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:11,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.316')] [2023-12-28 00:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000695192_178003968.pth... [2023-12-28 00:14:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000694024_177700864.pth [2023-12-28 00:14:11,195][106226] Updated weights for policy 0, policy_version 693378 (0.0009) [2023-12-28 00:14:11,252][106226] Updated weights for policy 0, policy_version 693388 (0.0009) [2023-12-28 00:14:11,318][106226] Updated weights for policy 0, policy_version 693398 (0.0008) [2023-12-28 00:14:11,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000693400_177561600.pth... [2023-12-28 00:14:11,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000692216_177258496.pth [2023-12-28 00:14:11,378][106225] Updated weights for policy 1, policy_version 695196 (0.0007) [2023-12-28 00:14:11,439][106225] Updated weights for policy 1, policy_version 695206 (0.0009) [2023-12-28 00:14:11,493][106225] Updated weights for policy 1, policy_version 695216 (0.0009) [2023-12-28 00:14:12,124][106226] Updated weights for policy 0, policy_version 693408 (0.0006) [2023-12-28 00:14:12,191][106226] Updated weights for policy 0, policy_version 693418 (0.0006) [2023-12-28 00:14:12,195][106225] Updated weights for policy 1, policy_version 695226 (0.0006) [2023-12-28 00:14:12,256][106226] Updated weights for policy 0, policy_version 693428 (0.0006) [2023-12-28 00:14:12,262][106225] Updated weights for policy 1, policy_version 695236 (0.0008) [2023-12-28 00:14:12,320][106225] Updated weights for policy 1, policy_version 695246 (0.0006) [2023-12-28 00:14:12,392][106225] Updated weights for policy 1, policy_version 695256 (0.0007) [2023-12-28 00:14:12,930][106226] Updated weights for policy 0, policy_version 693438 (0.0006) [2023-12-28 00:14:12,988][106226] Updated weights for policy 0, policy_version 693448 (0.0007) [2023-12-28 00:14:13,043][106226] Updated weights for policy 0, policy_version 693458 (0.0006) [2023-12-28 00:14:13,075][106225] Updated weights for policy 1, policy_version 695266 (0.0007) [2023-12-28 00:14:13,122][106225] Updated weights for policy 1, policy_version 695276 (0.0006) [2023-12-28 00:14:13,172][106225] Updated weights for policy 1, policy_version 695286 (0.0005) [2023-12-28 00:14:13,760][106226] Updated weights for policy 0, policy_version 693468 (0.0009) [2023-12-28 00:14:13,817][106226] Updated weights for policy 0, policy_version 693478 (0.0011) [2023-12-28 00:14:13,842][106225] Updated weights for policy 1, policy_version 695296 (0.0006) [2023-12-28 00:14:13,880][106226] Updated weights for policy 0, policy_version 693488 (0.0011) [2023-12-28 00:14:13,905][106225] Updated weights for policy 1, policy_version 695306 (0.0008) [2023-12-28 00:14:13,960][106225] Updated weights for policy 1, policy_version 695316 (0.0007) [2023-12-28 00:14:14,596][106226] Updated weights for policy 0, policy_version 693498 (0.0010) [2023-12-28 00:14:14,663][106226] Updated weights for policy 0, policy_version 693508 (0.0005) [2023-12-28 00:14:14,678][106225] Updated weights for policy 1, policy_version 695326 (0.0008) [2023-12-28 00:14:14,717][106226] Updated weights for policy 0, policy_version 693518 (0.0005) [2023-12-28 00:14:14,727][106225] Updated weights for policy 1, policy_version 695336 (0.0007) [2023-12-28 00:14:14,781][106226] Updated weights for policy 0, policy_version 693528 (0.0008) [2023-12-28 00:14:14,791][106225] Updated weights for policy 1, policy_version 695346 (0.0007) [2023-12-28 00:14:15,494][106226] Updated weights for policy 0, policy_version 693538 (0.0007) [2023-12-28 00:14:15,519][106225] Updated weights for policy 1, policy_version 695356 (0.0007) [2023-12-28 00:14:15,565][106226] Updated weights for policy 0, policy_version 693548 (0.0009) [2023-12-28 00:14:15,572][106225] Updated weights for policy 1, policy_version 695366 (0.0006) [2023-12-28 00:14:15,626][106225] Updated weights for policy 1, policy_version 695376 (0.0005) [2023-12-28 00:14:15,631][106226] Updated weights for policy 0, policy_version 693558 (0.0008) [2023-12-28 00:14:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 355655680. Throughput: 0: 9942.5, 1: 10068.7. Samples: 355648520. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:16,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.429')] [2023-12-28 00:14:16,210][106226] Updated weights for policy 0, policy_version 693568 (0.0006) [2023-12-28 00:14:16,270][106226] Updated weights for policy 0, policy_version 693578 (0.0009) [2023-12-28 00:14:16,330][106226] Updated weights for policy 0, policy_version 693588 (0.0010) [2023-12-28 00:14:16,339][106225] Updated weights for policy 1, policy_version 695386 (0.0008) [2023-12-28 00:14:16,405][106225] Updated weights for policy 1, policy_version 695396 (0.0009) [2023-12-28 00:14:16,470][106225] Updated weights for policy 1, policy_version 695406 (0.0008) [2023-12-28 00:14:16,520][106225] Updated weights for policy 1, policy_version 695416 (0.0008) [2023-12-28 00:14:16,972][106226] Updated weights for policy 0, policy_version 693598 (0.0009) [2023-12-28 00:14:17,032][106226] Updated weights for policy 0, policy_version 693608 (0.0010) [2023-12-28 00:14:17,085][106226] Updated weights for policy 0, policy_version 693618 (0.0010) [2023-12-28 00:14:17,261][106225] Updated weights for policy 1, policy_version 695426 (0.0010) [2023-12-28 00:14:17,319][106225] Updated weights for policy 1, policy_version 695436 (0.0010) [2023-12-28 00:14:17,369][106225] Updated weights for policy 1, policy_version 695446 (0.0010) [2023-12-28 00:14:17,717][106226] Updated weights for policy 0, policy_version 693628 (0.0008) [2023-12-28 00:14:17,771][106226] Updated weights for policy 0, policy_version 693638 (0.0005) [2023-12-28 00:14:17,818][106226] Updated weights for policy 0, policy_version 693648 (0.0005) [2023-12-28 00:14:18,085][106225] Updated weights for policy 1, policy_version 695456 (0.0006) [2023-12-28 00:14:18,138][106225] Updated weights for policy 1, policy_version 695466 (0.0005) [2023-12-28 00:14:18,184][106225] Updated weights for policy 1, policy_version 695476 (0.0005) [2023-12-28 00:14:18,461][106226] Updated weights for policy 0, policy_version 693658 (0.0005) [2023-12-28 00:14:18,508][106226] Updated weights for policy 0, policy_version 693668 (0.0009) [2023-12-28 00:14:18,566][106226] Updated weights for policy 0, policy_version 693678 (0.0010) [2023-12-28 00:14:18,624][106226] Updated weights for policy 0, policy_version 693688 (0.0011) [2023-12-28 00:14:18,911][106225] Updated weights for policy 1, policy_version 695486 (0.0009) [2023-12-28 00:14:18,982][106225] Updated weights for policy 1, policy_version 695496 (0.0010) [2023-12-28 00:14:19,046][106225] Updated weights for policy 1, policy_version 695506 (0.0010) [2023-12-28 00:14:19,318][106226] Updated weights for policy 0, policy_version 693698 (0.0011) [2023-12-28 00:14:19,381][106226] Updated weights for policy 0, policy_version 693708 (0.0009) [2023-12-28 00:14:19,444][106226] Updated weights for policy 0, policy_version 693718 (0.0007) [2023-12-28 00:14:19,800][106225] Updated weights for policy 1, policy_version 695516 (0.0010) [2023-12-28 00:14:19,871][106225] Updated weights for policy 1, policy_version 695526 (0.0010) [2023-12-28 00:14:19,931][106225] Updated weights for policy 1, policy_version 695536 (0.0008) [2023-12-28 00:14:20,230][106226] Updated weights for policy 0, policy_version 693728 (0.0008) [2023-12-28 00:14:20,303][106226] Updated weights for policy 0, policy_version 693738 (0.0010) [2023-12-28 00:14:20,378][106226] Updated weights for policy 0, policy_version 693748 (0.0008) [2023-12-28 00:14:20,608][106225] Updated weights for policy 1, policy_version 695546 (0.0009) [2023-12-28 00:14:20,675][106225] Updated weights for policy 1, policy_version 695556 (0.0008) [2023-12-28 00:14:20,739][106225] Updated weights for policy 1, policy_version 695566 (0.0008) [2023-12-28 00:14:20,803][106225] Updated weights for policy 1, policy_version 695576 (0.0008) [2023-12-28 00:14:21,104][106226] Updated weights for policy 0, policy_version 693758 (0.0008) [2023-12-28 00:14:21,174][106226] Updated weights for policy 0, policy_version 693768 (0.0009) [2023-12-28 00:14:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 355753984. Throughput: 0: 9844.5, 1: 10005.6. Samples: 355767468. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:21,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-5.250')] [2023-12-28 00:14:21,244][106226] Updated weights for policy 0, policy_version 693778 (0.0006) [2023-12-28 00:14:21,493][106225] Updated weights for policy 1, policy_version 695586 (0.0008) [2023-12-28 00:14:21,552][106225] Updated weights for policy 1, policy_version 695596 (0.0009) [2023-12-28 00:14:21,602][106225] Updated weights for policy 1, policy_version 695606 (0.0009) [2023-12-28 00:14:21,934][106226] Updated weights for policy 0, policy_version 693788 (0.0007) [2023-12-28 00:14:22,004][106226] Updated weights for policy 0, policy_version 693798 (0.0007) [2023-12-28 00:14:22,062][106226] Updated weights for policy 0, policy_version 693808 (0.0007) [2023-12-28 00:14:22,417][106225] Updated weights for policy 1, policy_version 695616 (0.0009) [2023-12-28 00:14:22,479][106225] Updated weights for policy 1, policy_version 695626 (0.0008) [2023-12-28 00:14:22,541][106225] Updated weights for policy 1, policy_version 695636 (0.0008) [2023-12-28 00:14:22,703][106226] Updated weights for policy 0, policy_version 693818 (0.0008) [2023-12-28 00:14:22,775][106226] Updated weights for policy 0, policy_version 693828 (0.0011) [2023-12-28 00:14:22,844][106226] Updated weights for policy 0, policy_version 693838 (0.0009) [2023-12-28 00:14:22,912][106226] Updated weights for policy 0, policy_version 693848 (0.0009) [2023-12-28 00:14:23,164][106225] Updated weights for policy 1, policy_version 695646 (0.0007) [2023-12-28 00:14:23,210][106225] Updated weights for policy 1, policy_version 695656 (0.0008) [2023-12-28 00:14:23,258][106225] Updated weights for policy 1, policy_version 695666 (0.0008) [2023-12-28 00:14:23,562][106226] Updated weights for policy 0, policy_version 693858 (0.0007) [2023-12-28 00:14:23,631][106226] Updated weights for policy 0, policy_version 693868 (0.0005) [2023-12-28 00:14:23,687][106226] Updated weights for policy 0, policy_version 693878 (0.0007) [2023-12-28 00:14:23,904][106225] Updated weights for policy 1, policy_version 695676 (0.0006) [2023-12-28 00:14:23,950][106225] Updated weights for policy 1, policy_version 695686 (0.0005) [2023-12-28 00:14:23,996][106225] Updated weights for policy 1, policy_version 695696 (0.0005) [2023-12-28 00:14:24,349][106226] Updated weights for policy 0, policy_version 693888 (0.0011) [2023-12-28 00:14:24,414][106226] Updated weights for policy 0, policy_version 693898 (0.0011) [2023-12-28 00:14:24,474][106226] Updated weights for policy 0, policy_version 693908 (0.0011) [2023-12-28 00:14:24,681][106225] Updated weights for policy 1, policy_version 695706 (0.0005) [2023-12-28 00:14:24,730][106225] Updated weights for policy 1, policy_version 695716 (0.0008) [2023-12-28 00:14:24,784][106225] Updated weights for policy 1, policy_version 695726 (0.0007) [2023-12-28 00:14:24,840][106225] Updated weights for policy 1, policy_version 695736 (0.0008) [2023-12-28 00:14:25,177][106226] Updated weights for policy 0, policy_version 693918 (0.0010) [2023-12-28 00:14:25,237][106226] Updated weights for policy 0, policy_version 693928 (0.0010) [2023-12-28 00:14:25,282][106226] Updated weights for policy 0, policy_version 693938 (0.0010) [2023-12-28 00:14:25,559][106225] Updated weights for policy 1, policy_version 695746 (0.0010) [2023-12-28 00:14:25,625][106225] Updated weights for policy 1, policy_version 695756 (0.0010) [2023-12-28 00:14:25,679][106225] Updated weights for policy 1, policy_version 695766 (0.0010) [2023-12-28 00:14:25,870][106226] Updated weights for policy 0, policy_version 693948 (0.0009) [2023-12-28 00:14:25,924][106226] Updated weights for policy 0, policy_version 693958 (0.0009) [2023-12-28 00:14:25,984][106226] Updated weights for policy 0, policy_version 693968 (0.0011) [2023-12-28 00:14:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 355860480. Throughput: 0: 9858.2, 1: 10038.2. Samples: 355827312. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:26,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-5.178')] [2023-12-28 00:14:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000693976_177709056.pth... [2023-12-28 00:14:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000695768_178151424.pth... [2023-12-28 00:14:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000692824_177414144.pth [2023-12-28 00:14:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000694632_177856512.pth [2023-12-28 00:14:26,411][106225] Updated weights for policy 1, policy_version 695776 (0.0008) [2023-12-28 00:14:26,464][106225] Updated weights for policy 1, policy_version 695786 (0.0007) [2023-12-28 00:14:26,525][106225] Updated weights for policy 1, policy_version 695796 (0.0008) [2023-12-28 00:14:26,682][106226] Updated weights for policy 0, policy_version 693978 (0.0010) [2023-12-28 00:14:26,736][106226] Updated weights for policy 0, policy_version 693988 (0.0010) [2023-12-28 00:14:26,789][106226] Updated weights for policy 0, policy_version 693998 (0.0010) [2023-12-28 00:14:26,850][106226] Updated weights for policy 0, policy_version 694008 (0.0011) [2023-12-28 00:14:27,251][106225] Updated weights for policy 1, policy_version 695806 (0.0008) [2023-12-28 00:14:27,294][106225] Updated weights for policy 1, policy_version 695816 (0.0007) [2023-12-28 00:14:27,341][106225] Updated weights for policy 1, policy_version 695826 (0.0008) [2023-12-28 00:14:27,559][106226] Updated weights for policy 0, policy_version 694018 (0.0010) [2023-12-28 00:14:27,614][106226] Updated weights for policy 0, policy_version 694028 (0.0010) [2023-12-28 00:14:27,672][106226] Updated weights for policy 0, policy_version 694038 (0.0009) [2023-12-28 00:14:28,074][106225] Updated weights for policy 1, policy_version 695836 (0.0006) [2023-12-28 00:14:28,129][106225] Updated weights for policy 1, policy_version 695846 (0.0006) [2023-12-28 00:14:28,184][106225] Updated weights for policy 1, policy_version 695856 (0.0007) [2023-12-28 00:14:28,237][106226] Updated weights for policy 0, policy_version 694048 (0.0006) [2023-12-28 00:14:28,300][106226] Updated weights for policy 0, policy_version 694058 (0.0008) [2023-12-28 00:14:28,362][106226] Updated weights for policy 0, policy_version 694068 (0.0008) [2023-12-28 00:14:28,906][106225] Updated weights for policy 1, policy_version 695866 (0.0006) [2023-12-28 00:14:28,953][106226] Updated weights for policy 0, policy_version 694078 (0.0006) [2023-12-28 00:14:28,967][106225] Updated weights for policy 1, policy_version 695876 (0.0007) [2023-12-28 00:14:29,007][106226] Updated weights for policy 0, policy_version 694088 (0.0006) [2023-12-28 00:14:29,024][106225] Updated weights for policy 1, policy_version 695886 (0.0007) [2023-12-28 00:14:29,064][106226] Updated weights for policy 0, policy_version 694098 (0.0007) [2023-12-28 00:14:29,079][106225] Updated weights for policy 1, policy_version 695896 (0.0007) [2023-12-28 00:14:29,779][106225] Updated weights for policy 1, policy_version 695906 (0.0007) [2023-12-28 00:14:29,788][106226] Updated weights for policy 0, policy_version 694108 (0.0007) [2023-12-28 00:14:29,841][106225] Updated weights for policy 1, policy_version 695916 (0.0008) [2023-12-28 00:14:29,853][106226] Updated weights for policy 0, policy_version 694118 (0.0008) [2023-12-28 00:14:29,906][106225] Updated weights for policy 1, policy_version 695926 (0.0007) [2023-12-28 00:14:29,912][106226] Updated weights for policy 0, policy_version 694128 (0.0008) [2023-12-28 00:14:30,603][106226] Updated weights for policy 0, policy_version 694138 (0.0008) [2023-12-28 00:14:30,664][106226] Updated weights for policy 0, policy_version 694148 (0.0011) [2023-12-28 00:14:30,711][106225] Updated weights for policy 1, policy_version 695936 (0.0008) [2023-12-28 00:14:30,721][106226] Updated weights for policy 0, policy_version 694158 (0.0011) [2023-12-28 00:14:30,768][106225] Updated weights for policy 1, policy_version 695946 (0.0005) [2023-12-28 00:14:30,774][106226] Updated weights for policy 0, policy_version 694168 (0.0010) [2023-12-28 00:14:30,822][106225] Updated weights for policy 1, policy_version 695956 (0.0005) [2023-12-28 00:14:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 355958784. Throughput: 0: 9915.1, 1: 10013.8. Samples: 355948720. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:31,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-5.302')] [2023-12-28 00:14:31,432][106226] Updated weights for policy 0, policy_version 694178 (0.0010) [2023-12-28 00:14:31,475][106225] Updated weights for policy 1, policy_version 695966 (0.0005) [2023-12-28 00:14:31,490][106226] Updated weights for policy 0, policy_version 694188 (0.0008) [2023-12-28 00:14:31,543][106225] Updated weights for policy 1, policy_version 695976 (0.0006) [2023-12-28 00:14:31,551][106226] Updated weights for policy 0, policy_version 694198 (0.0009) [2023-12-28 00:14:31,607][106225] Updated weights for policy 1, policy_version 695986 (0.0007) [2023-12-28 00:14:32,207][106226] Updated weights for policy 0, policy_version 694208 (0.0010) [2023-12-28 00:14:32,264][106226] Updated weights for policy 0, policy_version 694218 (0.0011) [2023-12-28 00:14:32,312][106225] Updated weights for policy 1, policy_version 695996 (0.0008) [2023-12-28 00:14:32,319][106226] Updated weights for policy 0, policy_version 694228 (0.0011) [2023-12-28 00:14:32,378][106225] Updated weights for policy 1, policy_version 696006 (0.0008) [2023-12-28 00:14:32,437][106225] Updated weights for policy 1, policy_version 696016 (0.0009) [2023-12-28 00:14:33,058][106226] Updated weights for policy 0, policy_version 694238 (0.0009) [2023-12-28 00:14:33,107][106226] Updated weights for policy 0, policy_version 694248 (0.0010) [2023-12-28 00:14:33,110][106225] Updated weights for policy 1, policy_version 696026 (0.0008) [2023-12-28 00:14:33,160][106226] Updated weights for policy 0, policy_version 694258 (0.0010) [2023-12-28 00:14:33,160][106225] Updated weights for policy 1, policy_version 696036 (0.0008) [2023-12-28 00:14:33,218][106225] Updated weights for policy 1, policy_version 696046 (0.0005) [2023-12-28 00:14:33,268][106225] Updated weights for policy 1, policy_version 696056 (0.0005) [2023-12-28 00:14:33,808][106225] Updated weights for policy 1, policy_version 696066 (0.0005) [2023-12-28 00:14:33,873][106225] Updated weights for policy 1, policy_version 696076 (0.0005) [2023-12-28 00:14:33,887][106226] Updated weights for policy 0, policy_version 694268 (0.0010) [2023-12-28 00:14:33,931][106225] Updated weights for policy 1, policy_version 696086 (0.0005) [2023-12-28 00:14:33,950][106226] Updated weights for policy 0, policy_version 694278 (0.0010) [2023-12-28 00:14:34,016][106226] Updated weights for policy 0, policy_version 694288 (0.0010) [2023-12-28 00:14:34,521][106225] Updated weights for policy 1, policy_version 696096 (0.0009) [2023-12-28 00:14:34,586][106225] Updated weights for policy 1, policy_version 696106 (0.0010) [2023-12-28 00:14:34,647][106225] Updated weights for policy 1, policy_version 696116 (0.0010) [2023-12-28 00:14:34,714][106226] Updated weights for policy 0, policy_version 694298 (0.0010) [2023-12-28 00:14:34,776][106226] Updated weights for policy 0, policy_version 694308 (0.0005) [2023-12-28 00:14:34,846][106226] Updated weights for policy 0, policy_version 694318 (0.0005) [2023-12-28 00:14:34,916][106226] Updated weights for policy 0, policy_version 694328 (0.0005) [2023-12-28 00:14:35,267][106225] Updated weights for policy 1, policy_version 696126 (0.0007) [2023-12-28 00:14:35,329][106225] Updated weights for policy 1, policy_version 696136 (0.0006) [2023-12-28 00:14:35,386][106225] Updated weights for policy 1, policy_version 696146 (0.0005) [2023-12-28 00:14:35,583][106226] Updated weights for policy 0, policy_version 694338 (0.0009) [2023-12-28 00:14:35,645][106226] Updated weights for policy 0, policy_version 694348 (0.0008) [2023-12-28 00:14:35,706][106226] Updated weights for policy 0, policy_version 694358 (0.0008) [2023-12-28 00:14:35,970][106225] Updated weights for policy 1, policy_version 696156 (0.0008) [2023-12-28 00:14:36,029][106225] Updated weights for policy 1, policy_version 696166 (0.0008) [2023-12-28 00:14:36,105][106225] Updated weights for policy 1, policy_version 696177 (0.0007) [2023-12-28 00:14:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 356065280. Throughput: 0: 9886.7, 1: 10047.3. Samples: 356071792. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-28 00:14:36,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-5.370')] [2023-12-28 00:14:36,389][106226] Updated weights for policy 0, policy_version 694368 (0.0008) [2023-12-28 00:14:36,453][106226] Updated weights for policy 0, policy_version 694378 (0.0010) [2023-12-28 00:14:36,523][106226] Updated weights for policy 0, policy_version 694388 (0.0009) [2023-12-28 00:14:36,787][106225] Updated weights for policy 1, policy_version 696187 (0.0007) [2023-12-28 00:14:36,851][106225] Updated weights for policy 1, policy_version 696197 (0.0005) [2023-12-28 00:14:36,916][106225] Updated weights for policy 1, policy_version 696207 (0.0006) [2023-12-28 00:14:37,394][106226] Updated weights for policy 0, policy_version 694398 (0.0008) [2023-12-28 00:14:37,444][106225] Updated weights for policy 1, policy_version 696217 (0.0006) [2023-12-28 00:14:37,452][106226] Updated weights for policy 0, policy_version 694408 (0.0009) [2023-12-28 00:14:37,494][106225] Updated weights for policy 1, policy_version 696227 (0.0008) [2023-12-28 00:14:37,515][106226] Updated weights for policy 0, policy_version 694418 (0.0007) [2023-12-28 00:14:37,556][106225] Updated weights for policy 1, policy_version 696237 (0.0008) [2023-12-28 00:14:37,611][106225] Updated weights for policy 1, policy_version 696247 (0.0009) [2023-12-28 00:14:38,209][106225] Updated weights for policy 1, policy_version 696257 (0.0008) [2023-12-28 00:14:38,235][106226] Updated weights for policy 0, policy_version 694428 (0.0007) [2023-12-28 00:14:38,257][106225] Updated weights for policy 1, policy_version 696267 (0.0006) [2023-12-28 00:14:38,283][106226] Updated weights for policy 0, policy_version 694438 (0.0006) [2023-12-28 00:14:38,305][106225] Updated weights for policy 1, policy_version 696277 (0.0006) [2023-12-28 00:14:38,340][106226] Updated weights for policy 0, policy_version 694448 (0.0006) [2023-12-28 00:14:39,032][106226] Updated weights for policy 0, policy_version 694458 (0.0006) [2023-12-28 00:14:39,050][106225] Updated weights for policy 1, policy_version 696287 (0.0007) [2023-12-28 00:14:39,081][106226] Updated weights for policy 0, policy_version 694468 (0.0007) [2023-12-28 00:14:39,115][106225] Updated weights for policy 1, policy_version 696297 (0.0008) [2023-12-28 00:14:39,137][106226] Updated weights for policy 0, policy_version 694478 (0.0008) [2023-12-28 00:14:39,166][106225] Updated weights for policy 1, policy_version 696307 (0.0006) [2023-12-28 00:14:39,192][106226] Updated weights for policy 0, policy_version 694488 (0.0006) [2023-12-28 00:14:39,919][106225] Updated weights for policy 1, policy_version 696317 (0.0006) [2023-12-28 00:14:39,986][106225] Updated weights for policy 1, policy_version 696327 (0.0009) [2023-12-28 00:14:40,005][106226] Updated weights for policy 0, policy_version 694498 (0.0011) [2023-12-28 00:14:40,050][106225] Updated weights for policy 1, policy_version 696337 (0.0009) [2023-12-28 00:14:40,059][106226] Updated weights for policy 0, policy_version 694508 (0.0010) [2023-12-28 00:14:40,123][106226] Updated weights for policy 0, policy_version 694518 (0.0011) [2023-12-28 00:14:40,765][106225] Updated weights for policy 1, policy_version 696347 (0.0008) [2023-12-28 00:14:40,804][106226] Updated weights for policy 0, policy_version 694528 (0.0006) [2023-12-28 00:14:40,817][106225] Updated weights for policy 1, policy_version 696357 (0.0005) [2023-12-28 00:14:40,853][106226] Updated weights for policy 0, policy_version 694538 (0.0005) [2023-12-28 00:14:40,866][106225] Updated weights for policy 1, policy_version 696367 (0.0006) [2023-12-28 00:14:40,899][106226] Updated weights for policy 0, policy_version 694548 (0.0005) [2023-12-28 00:14:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19994.0). Total num frames: 356163584. Throughput: 0: 9864.1, 1: 10145.9. Samples: 356132148. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:14:41,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.764')] [2023-12-28 00:14:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000696376_178307072.pth... [2023-12-28 00:14:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000694552_177856512.pth... [2023-12-28 00:14:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000693400_177561600.pth [2023-12-28 00:14:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000695192_178003968.pth [2023-12-28 00:14:41,595][106226] Updated weights for policy 0, policy_version 694558 (0.0007) [2023-12-28 00:14:41,618][106225] Updated weights for policy 1, policy_version 696377 (0.0008) [2023-12-28 00:14:41,673][106226] Updated weights for policy 0, policy_version 694568 (0.0008) [2023-12-28 00:14:41,687][106225] Updated weights for policy 1, policy_version 696387 (0.0008) [2023-12-28 00:14:41,744][106226] Updated weights for policy 0, policy_version 694578 (0.0007) [2023-12-28 00:14:41,758][106225] Updated weights for policy 1, policy_version 696397 (0.0008) [2023-12-28 00:14:41,816][106225] Updated weights for policy 1, policy_version 696407 (0.0007) [2023-12-28 00:14:42,475][106226] Updated weights for policy 0, policy_version 694588 (0.0008) [2023-12-28 00:14:42,545][106226] Updated weights for policy 0, policy_version 694598 (0.0006) [2023-12-28 00:14:42,610][106226] Updated weights for policy 0, policy_version 694608 (0.0006) [2023-12-28 00:14:42,616][106225] Updated weights for policy 1, policy_version 696417 (0.0008) [2023-12-28 00:14:42,675][106225] Updated weights for policy 1, policy_version 696427 (0.0009) [2023-12-28 00:14:42,733][106225] Updated weights for policy 1, policy_version 696437 (0.0008) [2023-12-28 00:14:43,164][106226] Updated weights for policy 0, policy_version 694618 (0.0006) [2023-12-28 00:14:43,224][106226] Updated weights for policy 0, policy_version 694628 (0.0008) [2023-12-28 00:14:43,282][106226] Updated weights for policy 0, policy_version 694638 (0.0008) [2023-12-28 00:14:43,346][106226] Updated weights for policy 0, policy_version 694648 (0.0008) [2023-12-28 00:14:43,500][106225] Updated weights for policy 1, policy_version 696447 (0.0010) [2023-12-28 00:14:43,557][106225] Updated weights for policy 1, policy_version 696457 (0.0010) [2023-12-28 00:14:43,613][106225] Updated weights for policy 1, policy_version 696467 (0.0010) [2023-12-28 00:14:43,983][106226] Updated weights for policy 0, policy_version 694658 (0.0010) [2023-12-28 00:14:44,030][106226] Updated weights for policy 0, policy_version 694668 (0.0010) [2023-12-28 00:14:44,080][106226] Updated weights for policy 0, policy_version 694678 (0.0010) [2023-12-28 00:14:44,285][106225] Updated weights for policy 1, policy_version 696477 (0.0008) [2023-12-28 00:14:44,344][106225] Updated weights for policy 1, policy_version 696487 (0.0010) [2023-12-28 00:14:44,393][106225] Updated weights for policy 1, policy_version 696497 (0.0010) [2023-12-28 00:14:44,818][106226] Updated weights for policy 0, policy_version 694688 (0.0010) [2023-12-28 00:14:44,869][106226] Updated weights for policy 0, policy_version 694698 (0.0010) [2023-12-28 00:14:44,927][106226] Updated weights for policy 0, policy_version 694708 (0.0010) [2023-12-28 00:14:45,110][106225] Updated weights for policy 1, policy_version 696507 (0.0010) [2023-12-28 00:14:45,184][106225] Updated weights for policy 1, policy_version 696517 (0.0010) [2023-12-28 00:14:45,245][106225] Updated weights for policy 1, policy_version 696527 (0.0007) [2023-12-28 00:14:45,657][106226] Updated weights for policy 0, policy_version 694718 (0.0008) [2023-12-28 00:14:45,719][106226] Updated weights for policy 0, policy_version 694728 (0.0008) [2023-12-28 00:14:45,775][106226] Updated weights for policy 0, policy_version 694738 (0.0008) [2023-12-28 00:14:45,963][106225] Updated weights for policy 1, policy_version 696537 (0.0007) [2023-12-28 00:14:46,028][106225] Updated weights for policy 1, policy_version 696547 (0.0009) [2023-12-28 00:14:46,092][106225] Updated weights for policy 1, policy_version 696557 (0.0009) [2023-12-28 00:14:46,158][106225] Updated weights for policy 1, policy_version 696567 (0.0006) [2023-12-28 00:14:46,175][105115] Fps is (10 sec: 19660.0, 60 sec: 20070.3, 300 sec: 19994.0). Total num frames: 356261888. Throughput: 0: 9914.4, 1: 10002.5. Samples: 356248388. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:14:46,176][105115] Avg episode reward: [(0, '-4.511'), (1, '-5.637')] [2023-12-28 00:14:46,428][106226] Updated weights for policy 0, policy_version 694748 (0.0008) [2023-12-28 00:14:46,496][106226] Updated weights for policy 0, policy_version 694758 (0.0010) [2023-12-28 00:14:46,551][106226] Updated weights for policy 0, policy_version 694768 (0.0010) [2023-12-28 00:14:46,829][106225] Updated weights for policy 1, policy_version 696577 (0.0007) [2023-12-28 00:14:46,880][106225] Updated weights for policy 1, policy_version 696587 (0.0010) [2023-12-28 00:14:46,934][106225] Updated weights for policy 1, policy_version 696597 (0.0009) [2023-12-28 00:14:47,198][106226] Updated weights for policy 0, policy_version 694778 (0.0010) [2023-12-28 00:14:47,258][106226] Updated weights for policy 0, policy_version 694788 (0.0009) [2023-12-28 00:14:47,315][106226] Updated weights for policy 0, policy_version 694798 (0.0010) [2023-12-28 00:14:47,374][106226] Updated weights for policy 0, policy_version 694808 (0.0006) [2023-12-28 00:14:47,483][106225] Updated weights for policy 1, policy_version 696607 (0.0005) [2023-12-28 00:14:47,530][106225] Updated weights for policy 1, policy_version 696617 (0.0006) [2023-12-28 00:14:47,581][106225] Updated weights for policy 1, policy_version 696627 (0.0008) [2023-12-28 00:14:48,015][106226] Updated weights for policy 0, policy_version 694818 (0.0007) [2023-12-28 00:14:48,063][106226] Updated weights for policy 0, policy_version 694828 (0.0007) [2023-12-28 00:14:48,113][106226] Updated weights for policy 0, policy_version 694838 (0.0008) [2023-12-28 00:14:48,279][106225] Updated weights for policy 1, policy_version 696637 (0.0009) [2023-12-28 00:14:48,346][106225] Updated weights for policy 1, policy_version 696647 (0.0010) [2023-12-28 00:14:48,408][106225] Updated weights for policy 1, policy_version 696657 (0.0009) [2023-12-28 00:14:48,809][106226] Updated weights for policy 0, policy_version 694848 (0.0009) [2023-12-28 00:14:48,872][106226] Updated weights for policy 0, policy_version 694858 (0.0008) [2023-12-28 00:14:48,929][106226] Updated weights for policy 0, policy_version 694868 (0.0008) [2023-12-28 00:14:49,113][106225] Updated weights for policy 1, policy_version 696667 (0.0010) [2023-12-28 00:14:49,162][106225] Updated weights for policy 1, policy_version 696677 (0.0010) [2023-12-28 00:14:49,216][106225] Updated weights for policy 1, policy_version 696687 (0.0008) [2023-12-28 00:14:49,648][106226] Updated weights for policy 0, policy_version 694878 (0.0009) [2023-12-28 00:14:49,703][106226] Updated weights for policy 0, policy_version 694888 (0.0009) [2023-12-28 00:14:49,763][106226] Updated weights for policy 0, policy_version 694898 (0.0008) [2023-12-28 00:14:49,905][106225] Updated weights for policy 1, policy_version 696697 (0.0007) [2023-12-28 00:14:49,974][106225] Updated weights for policy 1, policy_version 696707 (0.0009) [2023-12-28 00:14:50,034][106225] Updated weights for policy 1, policy_version 696717 (0.0009) [2023-12-28 00:14:50,094][106225] Updated weights for policy 1, policy_version 696727 (0.0008) [2023-12-28 00:14:50,472][106226] Updated weights for policy 0, policy_version 694908 (0.0006) [2023-12-28 00:14:50,522][106226] Updated weights for policy 0, policy_version 694918 (0.0009) [2023-12-28 00:14:50,580][106226] Updated weights for policy 0, policy_version 694928 (0.0008) [2023-12-28 00:14:50,850][106225] Updated weights for policy 1, policy_version 696737 (0.0007) [2023-12-28 00:14:50,911][106225] Updated weights for policy 1, policy_version 696747 (0.0009) [2023-12-28 00:14:50,970][106225] Updated weights for policy 1, policy_version 696757 (0.0008) [2023-12-28 00:14:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 356360192. Throughput: 0: 9929.1, 1: 9965.1. Samples: 356368340. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:14:51,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.304')] [2023-12-28 00:14:51,328][106226] Updated weights for policy 0, policy_version 694938 (0.0010) [2023-12-28 00:14:51,395][106226] Updated weights for policy 0, policy_version 694948 (0.0008) [2023-12-28 00:14:51,456][106226] Updated weights for policy 0, policy_version 694958 (0.0008) [2023-12-28 00:14:51,517][106226] Updated weights for policy 0, policy_version 694968 (0.0009) [2023-12-28 00:14:51,790][106225] Updated weights for policy 1, policy_version 696767 (0.0009) [2023-12-28 00:14:51,851][106225] Updated weights for policy 1, policy_version 696777 (0.0009) [2023-12-28 00:14:51,911][106225] Updated weights for policy 1, policy_version 696787 (0.0009) [2023-12-28 00:14:52,207][106226] Updated weights for policy 0, policy_version 694978 (0.0009) [2023-12-28 00:14:52,262][106226] Updated weights for policy 0, policy_version 694988 (0.0009) [2023-12-28 00:14:52,327][106226] Updated weights for policy 0, policy_version 694998 (0.0007) [2023-12-28 00:14:52,659][106225] Updated weights for policy 1, policy_version 696797 (0.0006) [2023-12-28 00:14:52,723][106225] Updated weights for policy 1, policy_version 696807 (0.0005) [2023-12-28 00:14:52,783][106225] Updated weights for policy 1, policy_version 696817 (0.0008) [2023-12-28 00:14:53,080][106226] Updated weights for policy 0, policy_version 695008 (0.0008) [2023-12-28 00:14:53,131][106226] Updated weights for policy 0, policy_version 695018 (0.0008) [2023-12-28 00:14:53,188][106226] Updated weights for policy 0, policy_version 695028 (0.0008) [2023-12-28 00:14:53,383][106225] Updated weights for policy 1, policy_version 696827 (0.0007) [2023-12-28 00:14:53,441][106225] Updated weights for policy 1, policy_version 696837 (0.0005) [2023-12-28 00:14:53,503][106225] Updated weights for policy 1, policy_version 696847 (0.0009) [2023-12-28 00:14:53,848][106226] Updated weights for policy 0, policy_version 695038 (0.0007) [2023-12-28 00:14:53,904][106226] Updated weights for policy 0, policy_version 695048 (0.0007) [2023-12-28 00:14:53,968][106226] Updated weights for policy 0, policy_version 695058 (0.0008) [2023-12-28 00:14:54,224][106225] Updated weights for policy 1, policy_version 696858 (0.0010) [2023-12-28 00:14:54,278][106225] Updated weights for policy 1, policy_version 696868 (0.0009) [2023-12-28 00:14:54,339][106225] Updated weights for policy 1, policy_version 696878 (0.0010) [2023-12-28 00:14:54,392][106225] Updated weights for policy 1, policy_version 696888 (0.0007) [2023-12-28 00:14:54,574][106226] Updated weights for policy 0, policy_version 695068 (0.0008) [2023-12-28 00:14:54,635][106226] Updated weights for policy 0, policy_version 695078 (0.0008) [2023-12-28 00:14:54,685][106226] Updated weights for policy 0, policy_version 695088 (0.0008) [2023-12-28 00:14:55,106][106225] Updated weights for policy 1, policy_version 696898 (0.0008) [2023-12-28 00:14:55,163][106225] Updated weights for policy 1, policy_version 696908 (0.0005) [2023-12-28 00:14:55,224][106225] Updated weights for policy 1, policy_version 696918 (0.0009) [2023-12-28 00:14:55,376][106226] Updated weights for policy 0, policy_version 695098 (0.0008) [2023-12-28 00:14:55,433][106226] Updated weights for policy 0, policy_version 695108 (0.0008) [2023-12-28 00:14:55,496][106226] Updated weights for policy 0, policy_version 695118 (0.0007) [2023-12-28 00:14:55,549][106226] Updated weights for policy 0, policy_version 695128 (0.0005) [2023-12-28 00:14:55,898][106225] Updated weights for policy 1, policy_version 696928 (0.0010) [2023-12-28 00:14:55,965][106225] Updated weights for policy 1, policy_version 696938 (0.0010) [2023-12-28 00:14:56,033][106225] Updated weights for policy 1, policy_version 696948 (0.0010) [2023-12-28 00:14:56,106][106226] Updated weights for policy 0, policy_version 695138 (0.0007) [2023-12-28 00:14:56,166][106226] Updated weights for policy 0, policy_version 695148 (0.0008) [2023-12-28 00:14:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 356458496. Throughput: 0: 9935.5, 1: 9921.7. Samples: 356426600. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:14:56,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.196')] [2023-12-28 00:14:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000696952_178454528.pth... [2023-12-28 00:14:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000695768_178151424.pth [2023-12-28 00:14:56,221][106226] Updated weights for policy 0, policy_version 695158 (0.0007) [2023-12-28 00:14:56,230][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000695160_178012160.pth... [2023-12-28 00:14:56,233][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000693976_177709056.pth [2023-12-28 00:14:56,728][106225] Updated weights for policy 1, policy_version 696958 (0.0009) [2023-12-28 00:14:56,777][106225] Updated weights for policy 1, policy_version 696968 (0.0010) [2023-12-28 00:14:56,839][106225] Updated weights for policy 1, policy_version 696978 (0.0010) [2023-12-28 00:14:56,892][106226] Updated weights for policy 0, policy_version 695168 (0.0007) [2023-12-28 00:14:56,947][106226] Updated weights for policy 0, policy_version 695178 (0.0007) [2023-12-28 00:14:57,010][106226] Updated weights for policy 0, policy_version 695188 (0.0009) [2023-12-28 00:14:57,554][106225] Updated weights for policy 1, policy_version 696988 (0.0010) [2023-12-28 00:14:57,607][106225] Updated weights for policy 1, policy_version 696998 (0.0010) [2023-12-28 00:14:57,657][106225] Updated weights for policy 1, policy_version 697008 (0.0010) [2023-12-28 00:14:57,710][106226] Updated weights for policy 0, policy_version 695198 (0.0010) [2023-12-28 00:14:57,769][106226] Updated weights for policy 0, policy_version 695208 (0.0010) [2023-12-28 00:14:57,827][106226] Updated weights for policy 0, policy_version 695218 (0.0010) [2023-12-28 00:14:58,390][106225] Updated weights for policy 1, policy_version 697018 (0.0010) [2023-12-28 00:14:58,459][106225] Updated weights for policy 1, policy_version 697028 (0.0008) [2023-12-28 00:14:58,527][106225] Updated weights for policy 1, policy_version 697038 (0.0010) [2023-12-28 00:14:58,528][106226] Updated weights for policy 0, policy_version 695228 (0.0009) [2023-12-28 00:14:58,592][106225] Updated weights for policy 1, policy_version 697048 (0.0007) [2023-12-28 00:14:58,598][106226] Updated weights for policy 0, policy_version 695238 (0.0008) [2023-12-28 00:14:58,664][106226] Updated weights for policy 0, policy_version 695248 (0.0008) [2023-12-28 00:14:59,410][106225] Updated weights for policy 1, policy_version 697058 (0.0007) [2023-12-28 00:14:59,460][106226] Updated weights for policy 0, policy_version 695258 (0.0009) [2023-12-28 00:14:59,467][106225] Updated weights for policy 1, policy_version 697068 (0.0005) [2023-12-28 00:14:59,523][106226] Updated weights for policy 0, policy_version 695268 (0.0007) [2023-12-28 00:14:59,529][106225] Updated weights for policy 1, policy_version 697078 (0.0007) [2023-12-28 00:14:59,583][106226] Updated weights for policy 0, policy_version 695278 (0.0007) [2023-12-28 00:14:59,643][106226] Updated weights for policy 0, policy_version 695288 (0.0008) [2023-12-28 00:15:00,232][106225] Updated weights for policy 1, policy_version 697088 (0.0008) [2023-12-28 00:15:00,290][106225] Updated weights for policy 1, policy_version 697098 (0.0009) [2023-12-28 00:15:00,351][106225] Updated weights for policy 1, policy_version 697108 (0.0007) [2023-12-28 00:15:00,384][106226] Updated weights for policy 0, policy_version 695298 (0.0007) [2023-12-28 00:15:00,444][106226] Updated weights for policy 0, policy_version 695308 (0.0009) [2023-12-28 00:15:00,502][106226] Updated weights for policy 0, policy_version 695318 (0.0007) [2023-12-28 00:15:00,993][106225] Updated weights for policy 1, policy_version 697118 (0.0007) [2023-12-28 00:15:01,059][106225] Updated weights for policy 1, policy_version 697128 (0.0007) [2023-12-28 00:15:01,114][106225] Updated weights for policy 1, policy_version 697138 (0.0008) [2023-12-28 00:15:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 356556800. Throughput: 0: 10032.8, 1: 9889.6. Samples: 356545028. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:01,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.441')] [2023-12-28 00:15:01,284][106226] Updated weights for policy 0, policy_version 695328 (0.0008) [2023-12-28 00:15:01,347][106226] Updated weights for policy 0, policy_version 695338 (0.0009) [2023-12-28 00:15:01,412][106226] Updated weights for policy 0, policy_version 695348 (0.0010) [2023-12-28 00:15:01,851][106225] Updated weights for policy 1, policy_version 697148 (0.0008) [2023-12-28 00:15:01,915][106225] Updated weights for policy 1, policy_version 697158 (0.0008) [2023-12-28 00:15:01,976][106225] Updated weights for policy 1, policy_version 697168 (0.0008) [2023-12-28 00:15:02,209][106226] Updated weights for policy 0, policy_version 695358 (0.0009) [2023-12-28 00:15:02,271][106226] Updated weights for policy 0, policy_version 695368 (0.0009) [2023-12-28 00:15:02,325][106226] Updated weights for policy 0, policy_version 695378 (0.0009) [2023-12-28 00:15:02,657][106225] Updated weights for policy 1, policy_version 697178 (0.0007) [2023-12-28 00:15:02,718][106225] Updated weights for policy 1, policy_version 697188 (0.0008) [2023-12-28 00:15:02,781][106225] Updated weights for policy 1, policy_version 697198 (0.0008) [2023-12-28 00:15:02,841][106225] Updated weights for policy 1, policy_version 697208 (0.0008) [2023-12-28 00:15:03,041][106226] Updated weights for policy 0, policy_version 695388 (0.0007) [2023-12-28 00:15:03,091][106226] Updated weights for policy 0, policy_version 695398 (0.0006) [2023-12-28 00:15:03,145][106226] Updated weights for policy 0, policy_version 695408 (0.0008) [2023-12-28 00:15:03,566][106225] Updated weights for policy 1, policy_version 697218 (0.0008) [2023-12-28 00:15:03,615][106225] Updated weights for policy 1, policy_version 697228 (0.0008) [2023-12-28 00:15:03,664][106225] Updated weights for policy 1, policy_version 697238 (0.0008) [2023-12-28 00:15:03,767][106226] Updated weights for policy 0, policy_version 695418 (0.0007) [2023-12-28 00:15:03,817][106226] Updated weights for policy 0, policy_version 695428 (0.0005) [2023-12-28 00:15:03,871][106226] Updated weights for policy 0, policy_version 695438 (0.0008) [2023-12-28 00:15:03,925][106226] Updated weights for policy 0, policy_version 695448 (0.0009) [2023-12-28 00:15:04,462][106225] Updated weights for policy 1, policy_version 697248 (0.0006) [2023-12-28 00:15:04,515][106225] Updated weights for policy 1, policy_version 697258 (0.0008) [2023-12-28 00:15:04,560][106225] Updated weights for policy 1, policy_version 697268 (0.0008) [2023-12-28 00:15:04,647][106226] Updated weights for policy 0, policy_version 695458 (0.0009) [2023-12-28 00:15:04,711][106226] Updated weights for policy 0, policy_version 695468 (0.0010) [2023-12-28 00:15:04,762][106226] Updated weights for policy 0, policy_version 695478 (0.0009) [2023-12-28 00:15:05,184][106225] Updated weights for policy 1, policy_version 697278 (0.0007) [2023-12-28 00:15:05,239][106225] Updated weights for policy 1, policy_version 697288 (0.0008) [2023-12-28 00:15:05,297][106225] Updated weights for policy 1, policy_version 697298 (0.0008) [2023-12-28 00:15:05,540][106226] Updated weights for policy 0, policy_version 695488 (0.0009) [2023-12-28 00:15:05,599][106226] Updated weights for policy 0, policy_version 695498 (0.0008) [2023-12-28 00:15:05,653][106226] Updated weights for policy 0, policy_version 695508 (0.0009) [2023-12-28 00:15:06,000][106225] Updated weights for policy 1, policy_version 697308 (0.0007) [2023-12-28 00:15:06,054][106225] Updated weights for policy 1, policy_version 697318 (0.0005) [2023-12-28 00:15:06,118][106225] Updated weights for policy 1, policy_version 697328 (0.0006) [2023-12-28 00:15:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19994.0). Total num frames: 356655104. Throughput: 0: 9941.5, 1: 9915.5. Samples: 356661032. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:06,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.682')] [2023-12-28 00:15:06,379][106226] Updated weights for policy 0, policy_version 695518 (0.0008) [2023-12-28 00:15:06,448][106226] Updated weights for policy 0, policy_version 695528 (0.0007) [2023-12-28 00:15:06,511][106226] Updated weights for policy 0, policy_version 695538 (0.0009) [2023-12-28 00:15:06,768][106225] Updated weights for policy 1, policy_version 697338 (0.0007) [2023-12-28 00:15:06,826][106225] Updated weights for policy 1, policy_version 697348 (0.0009) [2023-12-28 00:15:06,883][106225] Updated weights for policy 1, policy_version 697358 (0.0009) [2023-12-28 00:15:06,940][106225] Updated weights for policy 1, policy_version 697368 (0.0008) [2023-12-28 00:15:07,235][106226] Updated weights for policy 0, policy_version 695548 (0.0009) [2023-12-28 00:15:07,281][106226] Updated weights for policy 0, policy_version 695558 (0.0008) [2023-12-28 00:15:07,327][106226] Updated weights for policy 0, policy_version 695568 (0.0008) [2023-12-28 00:15:07,661][106225] Updated weights for policy 1, policy_version 697378 (0.0008) [2023-12-28 00:15:07,721][106225] Updated weights for policy 1, policy_version 697388 (0.0008) [2023-12-28 00:15:07,783][106225] Updated weights for policy 1, policy_version 697398 (0.0008) [2023-12-28 00:15:08,116][106226] Updated weights for policy 0, policy_version 695578 (0.0009) [2023-12-28 00:15:08,183][106226] Updated weights for policy 0, policy_version 695588 (0.0007) [2023-12-28 00:15:08,242][106226] Updated weights for policy 0, policy_version 695598 (0.0008) [2023-12-28 00:15:08,292][106226] Updated weights for policy 0, policy_version 695608 (0.0007) [2023-12-28 00:15:08,506][106225] Updated weights for policy 1, policy_version 697408 (0.0008) [2023-12-28 00:15:08,552][106225] Updated weights for policy 1, policy_version 697418 (0.0008) [2023-12-28 00:15:08,603][106225] Updated weights for policy 1, policy_version 697428 (0.0007) [2023-12-28 00:15:09,014][106226] Updated weights for policy 0, policy_version 695618 (0.0006) [2023-12-28 00:15:09,072][106226] Updated weights for policy 0, policy_version 695628 (0.0006) [2023-12-28 00:15:09,119][106226] Updated weights for policy 0, policy_version 695638 (0.0005) [2023-12-28 00:15:09,380][106225] Updated weights for policy 1, policy_version 697438 (0.0008) [2023-12-28 00:15:09,454][106225] Updated weights for policy 1, policy_version 697448 (0.0009) [2023-12-28 00:15:09,521][106225] Updated weights for policy 1, policy_version 697458 (0.0009) [2023-12-28 00:15:09,829][106226] Updated weights for policy 0, policy_version 695648 (0.0008) [2023-12-28 00:15:09,900][106226] Updated weights for policy 0, policy_version 695658 (0.0009) [2023-12-28 00:15:09,961][106226] Updated weights for policy 0, policy_version 695668 (0.0008) [2023-12-28 00:15:10,275][106225] Updated weights for policy 1, policy_version 697468 (0.0009) [2023-12-28 00:15:10,346][106225] Updated weights for policy 1, policy_version 697478 (0.0009) [2023-12-28 00:15:10,418][106225] Updated weights for policy 1, policy_version 697488 (0.0009) [2023-12-28 00:15:10,613][106226] Updated weights for policy 0, policy_version 695678 (0.0008) [2023-12-28 00:15:10,669][106226] Updated weights for policy 0, policy_version 695688 (0.0008) [2023-12-28 00:15:10,730][106226] Updated weights for policy 0, policy_version 695698 (0.0008) [2023-12-28 00:15:11,133][106225] Updated weights for policy 1, policy_version 697498 (0.0008) [2023-12-28 00:15:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 356745216. Throughput: 0: 9902.2, 1: 9912.5. Samples: 356718976. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:11,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.456')] [2023-12-28 00:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000695704_178151424.pth... [2023-12-28 00:15:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000694552_177856512.pth [2023-12-28 00:15:11,200][106225] Updated weights for policy 1, policy_version 697508 (0.0008) [2023-12-28 00:15:11,263][106225] Updated weights for policy 1, policy_version 697518 (0.0007) [2023-12-28 00:15:11,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000697528_178601984.pth... [2023-12-28 00:15:11,330][106225] Updated weights for policy 1, policy_version 697528 (0.0009) [2023-12-28 00:15:11,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000696376_178307072.pth [2023-12-28 00:15:11,516][106226] Updated weights for policy 0, policy_version 695708 (0.0008) [2023-12-28 00:15:11,574][106226] Updated weights for policy 0, policy_version 695718 (0.0006) [2023-12-28 00:15:11,642][106226] Updated weights for policy 0, policy_version 695728 (0.0007) [2023-12-28 00:15:12,181][106225] Updated weights for policy 1, policy_version 697538 (0.0007) [2023-12-28 00:15:12,234][106225] Updated weights for policy 1, policy_version 697548 (0.0008) [2023-12-28 00:15:12,298][106225] Updated weights for policy 1, policy_version 697558 (0.0009) [2023-12-28 00:15:12,411][106226] Updated weights for policy 0, policy_version 695738 (0.0008) [2023-12-28 00:15:12,471][106226] Updated weights for policy 0, policy_version 695748 (0.0007) [2023-12-28 00:15:12,533][106226] Updated weights for policy 0, policy_version 695758 (0.0008) [2023-12-28 00:15:12,599][106226] Updated weights for policy 0, policy_version 695768 (0.0007) [2023-12-28 00:15:12,979][106225] Updated weights for policy 1, policy_version 697568 (0.0008) [2023-12-28 00:15:13,030][106225] Updated weights for policy 1, policy_version 697578 (0.0008) [2023-12-28 00:15:13,087][106225] Updated weights for policy 1, policy_version 697588 (0.0007) [2023-12-28 00:15:13,289][106226] Updated weights for policy 0, policy_version 695778 (0.0010) [2023-12-28 00:15:13,353][106226] Updated weights for policy 0, policy_version 695788 (0.0011) [2023-12-28 00:15:13,413][106226] Updated weights for policy 0, policy_version 695798 (0.0011) [2023-12-28 00:15:13,754][106225] Updated weights for policy 1, policy_version 697598 (0.0007) [2023-12-28 00:15:13,816][106225] Updated weights for policy 1, policy_version 697608 (0.0009) [2023-12-28 00:15:13,874][106225] Updated weights for policy 1, policy_version 697618 (0.0008) [2023-12-28 00:15:14,039][106226] Updated weights for policy 0, policy_version 695808 (0.0006) [2023-12-28 00:15:14,098][106226] Updated weights for policy 0, policy_version 695818 (0.0006) [2023-12-28 00:15:14,153][106226] Updated weights for policy 0, policy_version 695828 (0.0007) [2023-12-28 00:15:14,564][106225] Updated weights for policy 1, policy_version 697628 (0.0009) [2023-12-28 00:15:14,619][106225] Updated weights for policy 1, policy_version 697638 (0.0009) [2023-12-28 00:15:14,674][106225] Updated weights for policy 1, policy_version 697648 (0.0006) [2023-12-28 00:15:14,852][106226] Updated weights for policy 0, policy_version 695838 (0.0007) [2023-12-28 00:15:14,919][106226] Updated weights for policy 0, policy_version 695848 (0.0008) [2023-12-28 00:15:14,984][106226] Updated weights for policy 0, policy_version 695858 (0.0007) [2023-12-28 00:15:15,433][106225] Updated weights for policy 1, policy_version 697658 (0.0008) [2023-12-28 00:15:15,486][106225] Updated weights for policy 1, policy_version 697668 (0.0009) [2023-12-28 00:15:15,545][106225] Updated weights for policy 1, policy_version 697678 (0.0008) [2023-12-28 00:15:15,607][106225] Updated weights for policy 1, policy_version 697688 (0.0009) [2023-12-28 00:15:15,678][106226] Updated weights for policy 0, policy_version 695868 (0.0007) [2023-12-28 00:15:15,737][106226] Updated weights for policy 0, policy_version 695878 (0.0008) [2023-12-28 00:15:15,805][106226] Updated weights for policy 0, policy_version 695888 (0.0009) [2023-12-28 00:15:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 356843520. Throughput: 0: 9833.9, 1: 9867.6. Samples: 356835288. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:16,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-5.410')] [2023-12-28 00:15:16,340][106225] Updated weights for policy 1, policy_version 697698 (0.0009) [2023-12-28 00:15:16,402][106225] Updated weights for policy 1, policy_version 697708 (0.0008) [2023-12-28 00:15:16,459][106225] Updated weights for policy 1, policy_version 697718 (0.0008) [2023-12-28 00:15:16,550][106226] Updated weights for policy 0, policy_version 695898 (0.0009) [2023-12-28 00:15:16,607][106226] Updated weights for policy 0, policy_version 695908 (0.0008) [2023-12-28 00:15:16,663][106226] Updated weights for policy 0, policy_version 695918 (0.0009) [2023-12-28 00:15:16,713][106226] Updated weights for policy 0, policy_version 695928 (0.0009) [2023-12-28 00:15:17,184][106225] Updated weights for policy 1, policy_version 697728 (0.0008) [2023-12-28 00:15:17,247][106225] Updated weights for policy 1, policy_version 697738 (0.0009) [2023-12-28 00:15:17,313][106225] Updated weights for policy 1, policy_version 697748 (0.0009) [2023-12-28 00:15:17,452][106226] Updated weights for policy 0, policy_version 695938 (0.0008) [2023-12-28 00:15:17,511][106226] Updated weights for policy 0, policy_version 695948 (0.0007) [2023-12-28 00:15:17,573][106226] Updated weights for policy 0, policy_version 695958 (0.0009) [2023-12-28 00:15:18,017][106225] Updated weights for policy 1, policy_version 697758 (0.0007) [2023-12-28 00:15:18,064][106225] Updated weights for policy 1, policy_version 697768 (0.0005) [2023-12-28 00:15:18,110][106225] Updated weights for policy 1, policy_version 697778 (0.0005) [2023-12-28 00:15:18,250][106226] Updated weights for policy 0, policy_version 695968 (0.0006) [2023-12-28 00:15:18,306][106226] Updated weights for policy 0, policy_version 695978 (0.0005) [2023-12-28 00:15:18,371][106226] Updated weights for policy 0, policy_version 695988 (0.0009) [2023-12-28 00:15:18,760][106225] Updated weights for policy 1, policy_version 697788 (0.0006) [2023-12-28 00:15:18,822][106225] Updated weights for policy 1, policy_version 697798 (0.0008) [2023-12-28 00:15:18,884][106225] Updated weights for policy 1, policy_version 697808 (0.0008) [2023-12-28 00:15:19,039][106226] Updated weights for policy 0, policy_version 695998 (0.0011) [2023-12-28 00:15:19,100][106226] Updated weights for policy 0, policy_version 696008 (0.0011) [2023-12-28 00:15:19,153][106226] Updated weights for policy 0, policy_version 696018 (0.0011) [2023-12-28 00:15:19,661][106225] Updated weights for policy 1, policy_version 697818 (0.0008) [2023-12-28 00:15:19,723][106225] Updated weights for policy 1, policy_version 697828 (0.0010) [2023-12-28 00:15:19,784][106225] Updated weights for policy 1, policy_version 697838 (0.0011) [2023-12-28 00:15:19,845][106225] Updated weights for policy 1, policy_version 697848 (0.0009) [2023-12-28 00:15:19,905][106226] Updated weights for policy 0, policy_version 696028 (0.0010) [2023-12-28 00:15:19,984][106226] Updated weights for policy 0, policy_version 696038 (0.0007) [2023-12-28 00:15:20,045][106226] Updated weights for policy 0, policy_version 696048 (0.0007) [2023-12-28 00:15:20,608][106225] Updated weights for policy 1, policy_version 697858 (0.0007) [2023-12-28 00:15:20,676][106225] Updated weights for policy 1, policy_version 697868 (0.0006) [2023-12-28 00:15:20,699][106226] Updated weights for policy 0, policy_version 696058 (0.0006) [2023-12-28 00:15:20,743][106225] Updated weights for policy 1, policy_version 697878 (0.0006) [2023-12-28 00:15:20,761][106226] Updated weights for policy 0, policy_version 696068 (0.0008) [2023-12-28 00:15:20,818][106226] Updated weights for policy 0, policy_version 696078 (0.0009) [2023-12-28 00:15:20,874][106226] Updated weights for policy 0, policy_version 696088 (0.0009) [2023-12-28 00:15:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 356941824. Throughput: 0: 9800.0, 1: 9747.8. Samples: 356951444. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:21,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-5.613')] [2023-12-28 00:15:21,485][106225] Updated weights for policy 1, policy_version 697888 (0.0006) [2023-12-28 00:15:21,551][106225] Updated weights for policy 1, policy_version 697898 (0.0005) [2023-12-28 00:15:21,634][106225] Updated weights for policy 1, policy_version 697908 (0.0006) [2023-12-28 00:15:21,681][106226] Updated weights for policy 0, policy_version 696098 (0.0009) [2023-12-28 00:15:21,755][106226] Updated weights for policy 0, policy_version 696108 (0.0009) [2023-12-28 00:15:21,823][106226] Updated weights for policy 0, policy_version 696118 (0.0008) [2023-12-28 00:15:22,203][106225] Updated weights for policy 1, policy_version 697918 (0.0007) [2023-12-28 00:15:22,269][106225] Updated weights for policy 1, policy_version 697928 (0.0007) [2023-12-28 00:15:22,328][106225] Updated weights for policy 1, policy_version 697938 (0.0010) [2023-12-28 00:15:22,550][106226] Updated weights for policy 0, policy_version 696128 (0.0008) [2023-12-28 00:15:22,613][106226] Updated weights for policy 0, policy_version 696138 (0.0008) [2023-12-28 00:15:22,675][106226] Updated weights for policy 0, policy_version 696148 (0.0009) [2023-12-28 00:15:22,992][106225] Updated weights for policy 1, policy_version 697948 (0.0008) [2023-12-28 00:15:23,048][106225] Updated weights for policy 1, policy_version 697958 (0.0005) [2023-12-28 00:15:23,103][106225] Updated weights for policy 1, policy_version 697968 (0.0005) [2023-12-28 00:15:23,442][106226] Updated weights for policy 0, policy_version 696158 (0.0008) [2023-12-28 00:15:23,502][106226] Updated weights for policy 0, policy_version 696168 (0.0007) [2023-12-28 00:15:23,557][106226] Updated weights for policy 0, policy_version 696178 (0.0008) [2023-12-28 00:15:23,775][106225] Updated weights for policy 1, policy_version 697978 (0.0005) [2023-12-28 00:15:23,833][106225] Updated weights for policy 1, policy_version 697988 (0.0006) [2023-12-28 00:15:23,885][106225] Updated weights for policy 1, policy_version 697998 (0.0008) [2023-12-28 00:15:23,940][106225] Updated weights for policy 1, policy_version 698008 (0.0009) [2023-12-28 00:15:24,320][106226] Updated weights for policy 0, policy_version 696188 (0.0008) [2023-12-28 00:15:24,364][106226] Updated weights for policy 0, policy_version 696198 (0.0008) [2023-12-28 00:15:24,425][106226] Updated weights for policy 0, policy_version 696208 (0.0009) [2023-12-28 00:15:24,567][106225] Updated weights for policy 1, policy_version 698018 (0.0009) [2023-12-28 00:15:24,619][106225] Updated weights for policy 1, policy_version 698028 (0.0009) [2023-12-28 00:15:24,664][106225] Updated weights for policy 1, policy_version 698038 (0.0008) [2023-12-28 00:15:25,046][106226] Updated weights for policy 0, policy_version 696218 (0.0008) [2023-12-28 00:15:25,102][106226] Updated weights for policy 0, policy_version 696228 (0.0008) [2023-12-28 00:15:25,160][106226] Updated weights for policy 0, policy_version 696238 (0.0008) [2023-12-28 00:15:25,208][106226] Updated weights for policy 0, policy_version 696248 (0.0008) [2023-12-28 00:15:25,428][106225] Updated weights for policy 1, policy_version 698048 (0.0009) [2023-12-28 00:15:25,477][106225] Updated weights for policy 1, policy_version 698058 (0.0008) [2023-12-28 00:15:25,528][106225] Updated weights for policy 1, policy_version 698068 (0.0005) [2023-12-28 00:15:25,978][106226] Updated weights for policy 0, policy_version 696258 (0.0009) [2023-12-28 00:15:26,028][106226] Updated weights for policy 0, policy_version 696268 (0.0009) [2023-12-28 00:15:26,083][106226] Updated weights for policy 0, policy_version 696279 (0.0009) [2023-12-28 00:15:26,135][106225] Updated weights for policy 1, policy_version 698078 (0.0007) [2023-12-28 00:15:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19938.5). Total num frames: 357040128. Throughput: 0: 9802.0, 1: 9692.1. Samples: 357009380. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:26,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.656')] [2023-12-28 00:15:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000696280_178298880.pth... [2023-12-28 00:15:26,185][106225] Updated weights for policy 1, policy_version 698088 (0.0008) [2023-12-28 00:15:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000695160_178012160.pth [2023-12-28 00:15:26,234][106225] Updated weights for policy 1, policy_version 698098 (0.0005) [2023-12-28 00:15:26,263][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000698104_178749440.pth... [2023-12-28 00:15:26,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000696952_178454528.pth [2023-12-28 00:15:26,829][106226] Updated weights for policy 0, policy_version 696289 (0.0008) [2023-12-28 00:15:26,879][106226] Updated weights for policy 0, policy_version 696299 (0.0008) [2023-12-28 00:15:26,888][106225] Updated weights for policy 1, policy_version 698108 (0.0005) [2023-12-28 00:15:26,935][106226] Updated weights for policy 0, policy_version 696309 (0.0007) [2023-12-28 00:15:26,947][106225] Updated weights for policy 1, policy_version 698118 (0.0007) [2023-12-28 00:15:27,019][106225] Updated weights for policy 1, policy_version 698128 (0.0009) [2023-12-28 00:15:27,624][106226] Updated weights for policy 0, policy_version 696319 (0.0007) [2023-12-28 00:15:27,674][106226] Updated weights for policy 0, policy_version 696329 (0.0009) [2023-12-28 00:15:27,703][106225] Updated weights for policy 1, policy_version 698138 (0.0009) [2023-12-28 00:15:27,726][106226] Updated weights for policy 0, policy_version 696339 (0.0009) [2023-12-28 00:15:27,755][106225] Updated weights for policy 1, policy_version 698148 (0.0008) [2023-12-28 00:15:27,806][106225] Updated weights for policy 1, policy_version 698158 (0.0008) [2023-12-28 00:15:27,863][106225] Updated weights for policy 1, policy_version 698168 (0.0009) [2023-12-28 00:15:28,465][106226] Updated weights for policy 0, policy_version 696349 (0.0007) [2023-12-28 00:15:28,530][106226] Updated weights for policy 0, policy_version 696359 (0.0008) [2023-12-28 00:15:28,557][106225] Updated weights for policy 1, policy_version 698178 (0.0007) [2023-12-28 00:15:28,579][106226] Updated weights for policy 0, policy_version 696369 (0.0007) [2023-12-28 00:15:28,617][106225] Updated weights for policy 1, policy_version 698188 (0.0007) [2023-12-28 00:15:28,677][106225] Updated weights for policy 1, policy_version 698198 (0.0009) [2023-12-28 00:15:29,294][106226] Updated weights for policy 0, policy_version 696379 (0.0008) [2023-12-28 00:15:29,363][106226] Updated weights for policy 0, policy_version 696389 (0.0008) [2023-12-28 00:15:29,386][106225] Updated weights for policy 1, policy_version 698208 (0.0008) [2023-12-28 00:15:29,427][106226] Updated weights for policy 0, policy_version 696399 (0.0008) [2023-12-28 00:15:29,441][106225] Updated weights for policy 1, policy_version 698218 (0.0006) [2023-12-28 00:15:29,493][106225] Updated weights for policy 1, policy_version 698228 (0.0006) [2023-12-28 00:15:30,113][106226] Updated weights for policy 0, policy_version 696409 (0.0010) [2023-12-28 00:15:30,175][106226] Updated weights for policy 0, policy_version 696419 (0.0006) [2023-12-28 00:15:30,206][106225] Updated weights for policy 1, policy_version 698238 (0.0009) [2023-12-28 00:15:30,239][106226] Updated weights for policy 0, policy_version 696429 (0.0006) [2023-12-28 00:15:30,256][106225] Updated weights for policy 1, policy_version 698248 (0.0008) [2023-12-28 00:15:30,306][106226] Updated weights for policy 0, policy_version 696439 (0.0006) [2023-12-28 00:15:30,317][106225] Updated weights for policy 1, policy_version 698258 (0.0008) [2023-12-28 00:15:30,956][106226] Updated weights for policy 0, policy_version 696449 (0.0008) [2023-12-28 00:15:31,001][106225] Updated weights for policy 1, policy_version 698268 (0.0006) [2023-12-28 00:15:31,010][106226] Updated weights for policy 0, policy_version 696459 (0.0008) [2023-12-28 00:15:31,067][106225] Updated weights for policy 1, policy_version 698278 (0.0008) [2023-12-28 00:15:31,073][106226] Updated weights for policy 0, policy_version 696469 (0.0007) [2023-12-28 00:15:31,131][106225] Updated weights for policy 1, policy_version 698288 (0.0008) [2023-12-28 00:15:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 357138432. Throughput: 0: 9776.4, 1: 9801.7. Samples: 357129396. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:31,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.482')] [2023-12-28 00:15:31,854][106226] Updated weights for policy 0, policy_version 696479 (0.0006) [2023-12-28 00:15:31,887][106225] Updated weights for policy 1, policy_version 698298 (0.0008) [2023-12-28 00:15:31,906][106226] Updated weights for policy 0, policy_version 696489 (0.0007) [2023-12-28 00:15:31,945][106225] Updated weights for policy 1, policy_version 698308 (0.0008) [2023-12-28 00:15:31,963][106226] Updated weights for policy 0, policy_version 696499 (0.0007) [2023-12-28 00:15:31,996][106225] Updated weights for policy 1, policy_version 698318 (0.0008) [2023-12-28 00:15:32,050][106225] Updated weights for policy 1, policy_version 698328 (0.0008) [2023-12-28 00:15:32,686][106226] Updated weights for policy 0, policy_version 696509 (0.0009) [2023-12-28 00:15:32,751][106226] Updated weights for policy 0, policy_version 696519 (0.0007) [2023-12-28 00:15:32,757][106225] Updated weights for policy 1, policy_version 698338 (0.0006) [2023-12-28 00:15:32,813][106225] Updated weights for policy 1, policy_version 698348 (0.0005) [2023-12-28 00:15:32,819][106226] Updated weights for policy 0, policy_version 696529 (0.0006) [2023-12-28 00:15:32,868][106225] Updated weights for policy 1, policy_version 698358 (0.0006) [2023-12-28 00:15:33,495][106225] Updated weights for policy 1, policy_version 698368 (0.0008) [2023-12-28 00:15:33,502][106226] Updated weights for policy 0, policy_version 696539 (0.0008) [2023-12-28 00:15:33,541][106225] Updated weights for policy 1, policy_version 698378 (0.0008) [2023-12-28 00:15:33,558][106226] Updated weights for policy 0, policy_version 696549 (0.0005) [2023-12-28 00:15:33,594][106225] Updated weights for policy 1, policy_version 698388 (0.0009) [2023-12-28 00:15:33,618][106226] Updated weights for policy 0, policy_version 696559 (0.0005) [2023-12-28 00:15:34,168][106226] Updated weights for policy 0, policy_version 696569 (0.0006) [2023-12-28 00:15:34,224][106226] Updated weights for policy 0, policy_version 696579 (0.0009) [2023-12-28 00:15:34,292][106226] Updated weights for policy 0, policy_version 696589 (0.0009) [2023-12-28 00:15:34,310][106225] Updated weights for policy 1, policy_version 698398 (0.0009) [2023-12-28 00:15:34,358][106226] Updated weights for policy 0, policy_version 696599 (0.0008) [2023-12-28 00:15:34,373][106225] Updated weights for policy 1, policy_version 698408 (0.0006) [2023-12-28 00:15:34,436][106225] Updated weights for policy 1, policy_version 698418 (0.0009) [2023-12-28 00:15:35,118][106226] Updated weights for policy 0, policy_version 696609 (0.0008) [2023-12-28 00:15:35,128][106225] Updated weights for policy 1, policy_version 698428 (0.0007) [2023-12-28 00:15:35,174][106226] Updated weights for policy 0, policy_version 696619 (0.0007) [2023-12-28 00:15:35,181][106225] Updated weights for policy 1, policy_version 698438 (0.0005) [2023-12-28 00:15:35,234][106226] Updated weights for policy 0, policy_version 696629 (0.0009) [2023-12-28 00:15:35,240][106225] Updated weights for policy 1, policy_version 698448 (0.0005) [2023-12-28 00:15:35,862][106226] Updated weights for policy 0, policy_version 696639 (0.0008) [2023-12-28 00:15:35,871][106225] Updated weights for policy 1, policy_version 698458 (0.0006) [2023-12-28 00:15:35,916][106226] Updated weights for policy 0, policy_version 696649 (0.0007) [2023-12-28 00:15:35,926][106225] Updated weights for policy 1, policy_version 698468 (0.0006) [2023-12-28 00:15:35,971][106226] Updated weights for policy 0, policy_version 696659 (0.0007) [2023-12-28 00:15:35,988][106225] Updated weights for policy 1, policy_version 698478 (0.0009) [2023-12-28 00:15:36,045][106225] Updated weights for policy 1, policy_version 698488 (0.0008) [2023-12-28 00:15:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19966.3). Total num frames: 357244928. Throughput: 0: 9767.3, 1: 9821.8. Samples: 357249848. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:36,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-5.781')] [2023-12-28 00:15:36,717][106226] Updated weights for policy 0, policy_version 696669 (0.0007) [2023-12-28 00:15:36,768][106226] Updated weights for policy 0, policy_version 696679 (0.0008) [2023-12-28 00:15:36,786][106225] Updated weights for policy 1, policy_version 698498 (0.0008) [2023-12-28 00:15:36,819][106226] Updated weights for policy 0, policy_version 696689 (0.0005) [2023-12-28 00:15:36,840][106225] Updated weights for policy 1, policy_version 698508 (0.0008) [2023-12-28 00:15:36,897][106225] Updated weights for policy 1, policy_version 698518 (0.0007) [2023-12-28 00:15:37,581][106226] Updated weights for policy 0, policy_version 696699 (0.0007) [2023-12-28 00:15:37,625][106225] Updated weights for policy 1, policy_version 698528 (0.0010) [2023-12-28 00:15:37,642][106226] Updated weights for policy 0, policy_version 696709 (0.0009) [2023-12-28 00:15:37,683][106225] Updated weights for policy 1, policy_version 698538 (0.0010) [2023-12-28 00:15:37,700][106226] Updated weights for policy 0, policy_version 696719 (0.0005) [2023-12-28 00:15:37,744][106225] Updated weights for policy 1, policy_version 698548 (0.0010) [2023-12-28 00:15:38,445][106226] Updated weights for policy 0, policy_version 696729 (0.0008) [2023-12-28 00:15:38,459][106225] Updated weights for policy 1, policy_version 698558 (0.0010) [2023-12-28 00:15:38,512][106226] Updated weights for policy 0, policy_version 696739 (0.0006) [2023-12-28 00:15:38,520][106225] Updated weights for policy 1, policy_version 698568 (0.0010) [2023-12-28 00:15:38,580][106226] Updated weights for policy 0, policy_version 696749 (0.0006) [2023-12-28 00:15:38,581][106225] Updated weights for policy 1, policy_version 698578 (0.0010) [2023-12-28 00:15:38,641][106226] Updated weights for policy 0, policy_version 696759 (0.0006) [2023-12-28 00:15:39,306][106225] Updated weights for policy 1, policy_version 698588 (0.0010) [2023-12-28 00:15:39,372][106225] Updated weights for policy 1, policy_version 698598 (0.0010) [2023-12-28 00:15:39,372][106226] Updated weights for policy 0, policy_version 696769 (0.0010) [2023-12-28 00:15:39,438][106226] Updated weights for policy 0, policy_version 696779 (0.0013) [2023-12-28 00:15:39,440][106225] Updated weights for policy 1, policy_version 698608 (0.0011) [2023-12-28 00:15:39,497][106226] Updated weights for policy 0, policy_version 696789 (0.0011) [2023-12-28 00:15:40,203][106225] Updated weights for policy 1, policy_version 698618 (0.0010) [2023-12-28 00:15:40,266][106225] Updated weights for policy 1, policy_version 698628 (0.0008) [2023-12-28 00:15:40,308][106226] Updated weights for policy 0, policy_version 696799 (0.0007) [2023-12-28 00:15:40,322][106225] Updated weights for policy 1, policy_version 698638 (0.0009) [2023-12-28 00:15:40,371][106226] Updated weights for policy 0, policy_version 696809 (0.0007) [2023-12-28 00:15:40,387][106225] Updated weights for policy 1, policy_version 698648 (0.0007) [2023-12-28 00:15:40,429][106226] Updated weights for policy 0, policy_version 696819 (0.0006) [2023-12-28 00:15:40,976][106226] Updated weights for policy 0, policy_version 696829 (0.0006) [2023-12-28 00:15:41,041][106226] Updated weights for policy 0, policy_version 696839 (0.0009) [2023-12-28 00:15:41,104][106226] Updated weights for policy 0, policy_version 696849 (0.0008) [2023-12-28 00:15:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 357335040. Throughput: 0: 9739.1, 1: 9813.9. Samples: 357306488. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:41,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-5.504')] [2023-12-28 00:15:41,179][106225] Updated weights for policy 1, policy_version 698658 (0.0008) [2023-12-28 00:15:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000696856_178446336.pth... [2023-12-28 00:15:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000695704_178151424.pth [2023-12-28 00:15:41,243][106225] Updated weights for policy 1, policy_version 698668 (0.0008) [2023-12-28 00:15:41,309][106225] Updated weights for policy 1, policy_version 698678 (0.0007) [2023-12-28 00:15:41,324][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000698680_178896896.pth... [2023-12-28 00:15:41,329][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000697528_178601984.pth [2023-12-28 00:15:41,928][106226] Updated weights for policy 0, policy_version 696859 (0.0008) [2023-12-28 00:15:41,988][106226] Updated weights for policy 0, policy_version 696869 (0.0008) [2023-12-28 00:15:41,996][106225] Updated weights for policy 1, policy_version 698688 (0.0007) [2023-12-28 00:15:42,052][106226] Updated weights for policy 0, policy_version 696879 (0.0006) [2023-12-28 00:15:42,062][106225] Updated weights for policy 1, policy_version 698698 (0.0008) [2023-12-28 00:15:42,121][106225] Updated weights for policy 1, policy_version 698708 (0.0008) [2023-12-28 00:15:42,701][106226] Updated weights for policy 0, policy_version 696889 (0.0006) [2023-12-28 00:15:42,764][106226] Updated weights for policy 0, policy_version 696899 (0.0007) [2023-12-28 00:15:42,794][106225] Updated weights for policy 1, policy_version 698718 (0.0009) [2023-12-28 00:15:42,825][106226] Updated weights for policy 0, policy_version 696909 (0.0011) [2023-12-28 00:15:42,844][106225] Updated weights for policy 1, policy_version 698728 (0.0010) [2023-12-28 00:15:42,876][106226] Updated weights for policy 0, policy_version 696919 (0.0010) [2023-12-28 00:15:42,891][106225] Updated weights for policy 1, policy_version 698738 (0.0009) [2023-12-28 00:15:43,555][106226] Updated weights for policy 0, policy_version 696929 (0.0011) [2023-12-28 00:15:43,573][106225] Updated weights for policy 1, policy_version 698748 (0.0006) [2023-12-28 00:15:43,608][106226] Updated weights for policy 0, policy_version 696939 (0.0009) [2023-12-28 00:15:43,634][106225] Updated weights for policy 1, policy_version 698758 (0.0005) [2023-12-28 00:15:43,669][106226] Updated weights for policy 0, policy_version 696949 (0.0005) [2023-12-28 00:15:43,690][106225] Updated weights for policy 1, policy_version 698768 (0.0010) [2023-12-28 00:15:44,291][106226] Updated weights for policy 0, policy_version 696959 (0.0009) [2023-12-28 00:15:44,347][106226] Updated weights for policy 0, policy_version 696969 (0.0010) [2023-12-28 00:15:44,372][106225] Updated weights for policy 1, policy_version 698778 (0.0010) [2023-12-28 00:15:44,416][106226] Updated weights for policy 0, policy_version 696979 (0.0006) [2023-12-28 00:15:44,422][106225] Updated weights for policy 1, policy_version 698788 (0.0010) [2023-12-28 00:15:44,471][106225] Updated weights for policy 1, policy_version 698798 (0.0008) [2023-12-28 00:15:44,528][106225] Updated weights for policy 1, policy_version 698808 (0.0005) [2023-12-28 00:15:45,166][106226] Updated weights for policy 0, policy_version 696989 (0.0008) [2023-12-28 00:15:45,184][106225] Updated weights for policy 1, policy_version 698818 (0.0008) [2023-12-28 00:15:45,223][106226] Updated weights for policy 0, policy_version 696999 (0.0006) [2023-12-28 00:15:45,250][106225] Updated weights for policy 1, policy_version 698828 (0.0008) [2023-12-28 00:15:45,285][106226] Updated weights for policy 0, policy_version 697009 (0.0009) [2023-12-28 00:15:45,307][106225] Updated weights for policy 1, policy_version 698838 (0.0008) [2023-12-28 00:15:45,964][106225] Updated weights for policy 1, policy_version 698848 (0.0008) [2023-12-28 00:15:46,027][106226] Updated weights for policy 0, policy_version 697019 (0.0008) [2023-12-28 00:15:46,034][106225] Updated weights for policy 1, policy_version 698858 (0.0008) [2023-12-28 00:15:46,088][106226] Updated weights for policy 0, policy_version 697029 (0.0010) [2023-12-28 00:15:46,097][106225] Updated weights for policy 1, policy_version 698868 (0.0007) [2023-12-28 00:15:46,144][106226] Updated weights for policy 0, policy_version 697039 (0.0007) [2023-12-28 00:15:46,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.4, 300 sec: 19938.5). Total num frames: 357433344. Throughput: 0: 9707.6, 1: 9845.9. Samples: 357424932. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:46,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-5.500')] [2023-12-28 00:15:46,790][106225] Updated weights for policy 1, policy_version 698878 (0.0008) [2023-12-28 00:15:46,799][106226] Updated weights for policy 0, policy_version 697049 (0.0007) [2023-12-28 00:15:46,850][106226] Updated weights for policy 0, policy_version 697059 (0.0008) [2023-12-28 00:15:46,858][106225] Updated weights for policy 1, policy_version 698888 (0.0007) [2023-12-28 00:15:46,902][106226] Updated weights for policy 0, policy_version 697069 (0.0008) [2023-12-28 00:15:46,927][106225] Updated weights for policy 1, policy_version 698898 (0.0009) [2023-12-28 00:15:46,955][106226] Updated weights for policy 0, policy_version 697079 (0.0006) [2023-12-28 00:15:47,485][106225] Updated weights for policy 1, policy_version 698908 (0.0009) [2023-12-28 00:15:47,532][106225] Updated weights for policy 1, policy_version 698918 (0.0010) [2023-12-28 00:15:47,582][106225] Updated weights for policy 1, policy_version 698928 (0.0010) [2023-12-28 00:15:47,742][106226] Updated weights for policy 0, policy_version 697089 (0.0008) [2023-12-28 00:15:47,810][106226] Updated weights for policy 0, policy_version 697099 (0.0009) [2023-12-28 00:15:47,877][106226] Updated weights for policy 0, policy_version 697109 (0.0010) [2023-12-28 00:15:48,287][106225] Updated weights for policy 1, policy_version 698938 (0.0010) [2023-12-28 00:15:48,367][106225] Updated weights for policy 1, policy_version 698948 (0.0011) [2023-12-28 00:15:48,429][106225] Updated weights for policy 1, policy_version 698958 (0.0011) [2023-12-28 00:15:48,494][106225] Updated weights for policy 1, policy_version 698968 (0.0010) [2023-12-28 00:15:48,615][106226] Updated weights for policy 0, policy_version 697119 (0.0008) [2023-12-28 00:15:48,673][106226] Updated weights for policy 0, policy_version 697129 (0.0008) [2023-12-28 00:15:48,737][106226] Updated weights for policy 0, policy_version 697139 (0.0008) [2023-12-28 00:15:49,162][106225] Updated weights for policy 1, policy_version 698978 (0.0010) [2023-12-28 00:15:49,222][106225] Updated weights for policy 1, policy_version 698988 (0.0010) [2023-12-28 00:15:49,285][106225] Updated weights for policy 1, policy_version 698998 (0.0009) [2023-12-28 00:15:49,501][106226] Updated weights for policy 0, policy_version 697149 (0.0008) [2023-12-28 00:15:49,553][106226] Updated weights for policy 0, policy_version 697159 (0.0007) [2023-12-28 00:15:49,617][106226] Updated weights for policy 0, policy_version 697169 (0.0006) [2023-12-28 00:15:50,120][106225] Updated weights for policy 1, policy_version 699008 (0.0009) [2023-12-28 00:15:50,181][106225] Updated weights for policy 1, policy_version 699018 (0.0008) [2023-12-28 00:15:50,241][106225] Updated weights for policy 1, policy_version 699028 (0.0007) [2023-12-28 00:15:50,316][106226] Updated weights for policy 0, policy_version 697179 (0.0008) [2023-12-28 00:15:50,374][106226] Updated weights for policy 0, policy_version 697189 (0.0008) [2023-12-28 00:15:50,429][106226] Updated weights for policy 0, policy_version 697199 (0.0009) [2023-12-28 00:15:50,955][106225] Updated weights for policy 1, policy_version 699038 (0.0009) [2023-12-28 00:15:51,020][106225] Updated weights for policy 1, policy_version 699048 (0.0011) [2023-12-28 00:15:51,084][106225] Updated weights for policy 1, policy_version 699058 (0.0009) [2023-12-28 00:15:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 357531648. Throughput: 0: 9702.7, 1: 9851.3. Samples: 357540960. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:51,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-5.235')] [2023-12-28 00:15:51,184][106226] Updated weights for policy 0, policy_version 697209 (0.0008) [2023-12-28 00:15:51,246][106226] Updated weights for policy 0, policy_version 697219 (0.0008) [2023-12-28 00:15:51,312][106226] Updated weights for policy 0, policy_version 697229 (0.0008) [2023-12-28 00:15:51,377][106226] Updated weights for policy 0, policy_version 697239 (0.0008) [2023-12-28 00:15:51,873][106225] Updated weights for policy 1, policy_version 699068 (0.0007) [2023-12-28 00:15:51,938][106225] Updated weights for policy 1, policy_version 699078 (0.0006) [2023-12-28 00:15:52,002][106225] Updated weights for policy 1, policy_version 699088 (0.0006) [2023-12-28 00:15:52,032][106226] Updated weights for policy 0, policy_version 697249 (0.0008) [2023-12-28 00:15:52,098][106226] Updated weights for policy 0, policy_version 697259 (0.0007) [2023-12-28 00:15:52,153][106226] Updated weights for policy 0, policy_version 697269 (0.0008) [2023-12-28 00:15:52,655][106225] Updated weights for policy 1, policy_version 699098 (0.0007) [2023-12-28 00:15:52,714][106225] Updated weights for policy 1, policy_version 699108 (0.0008) [2023-12-28 00:15:52,773][106225] Updated weights for policy 1, policy_version 699118 (0.0008) [2023-12-28 00:15:52,837][106225] Updated weights for policy 1, policy_version 699128 (0.0008) [2023-12-28 00:15:52,872][106226] Updated weights for policy 0, policy_version 697279 (0.0006) [2023-12-28 00:15:52,938][106226] Updated weights for policy 0, policy_version 697289 (0.0005) [2023-12-28 00:15:53,000][106226] Updated weights for policy 0, policy_version 697299 (0.0008) [2023-12-28 00:15:53,514][106225] Updated weights for policy 1, policy_version 699138 (0.0005) [2023-12-28 00:15:53,567][106225] Updated weights for policy 1, policy_version 699148 (0.0005) [2023-12-28 00:15:53,615][106225] Updated weights for policy 1, policy_version 699158 (0.0007) [2023-12-28 00:15:53,676][106226] Updated weights for policy 0, policy_version 697309 (0.0009) [2023-12-28 00:15:53,720][106226] Updated weights for policy 0, policy_version 697319 (0.0008) [2023-12-28 00:15:53,764][106226] Updated weights for policy 0, policy_version 697329 (0.0008) [2023-12-28 00:15:54,276][106225] Updated weights for policy 1, policy_version 699168 (0.0009) [2023-12-28 00:15:54,334][106225] Updated weights for policy 1, policy_version 699178 (0.0008) [2023-12-28 00:15:54,399][106225] Updated weights for policy 1, policy_version 699188 (0.0008) [2023-12-28 00:15:54,559][106226] Updated weights for policy 0, policy_version 697339 (0.0008) [2023-12-28 00:15:54,624][106226] Updated weights for policy 0, policy_version 697349 (0.0008) [2023-12-28 00:15:54,681][106226] Updated weights for policy 0, policy_version 697359 (0.0007) [2023-12-28 00:15:55,112][106225] Updated weights for policy 1, policy_version 699198 (0.0007) [2023-12-28 00:15:55,163][106225] Updated weights for policy 1, policy_version 699208 (0.0007) [2023-12-28 00:15:55,217][106225] Updated weights for policy 1, policy_version 699218 (0.0010) [2023-12-28 00:15:55,321][106226] Updated weights for policy 0, policy_version 697369 (0.0009) [2023-12-28 00:15:55,382][106226] Updated weights for policy 0, policy_version 697379 (0.0006) [2023-12-28 00:15:55,432][106226] Updated weights for policy 0, policy_version 697389 (0.0005) [2023-12-28 00:15:55,498][106226] Updated weights for policy 0, policy_version 697399 (0.0006) [2023-12-28 00:15:55,873][106225] Updated weights for policy 1, policy_version 699228 (0.0009) [2023-12-28 00:15:55,923][106225] Updated weights for policy 1, policy_version 699238 (0.0006) [2023-12-28 00:15:55,974][106225] Updated weights for policy 1, policy_version 699248 (0.0010) [2023-12-28 00:15:56,146][106226] Updated weights for policy 0, policy_version 697409 (0.0007) [2023-12-28 00:15:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19938.5). Total num frames: 357629952. Throughput: 0: 9728.5, 1: 9849.1. Samples: 357599968. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:15:56,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.826')] [2023-12-28 00:15:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000699256_179044352.pth... [2023-12-28 00:15:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000698104_178749440.pth [2023-12-28 00:15:56,212][106226] Updated weights for policy 0, policy_version 697419 (0.0007) [2023-12-28 00:15:56,278][106226] Updated weights for policy 0, policy_version 697429 (0.0007) [2023-12-28 00:15:56,297][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000697432_178593792.pth... [2023-12-28 00:15:56,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000696280_178298880.pth [2023-12-28 00:15:56,670][106225] Updated weights for policy 1, policy_version 699258 (0.0007) [2023-12-28 00:15:56,720][106225] Updated weights for policy 1, policy_version 699268 (0.0007) [2023-12-28 00:15:56,767][106225] Updated weights for policy 1, policy_version 699278 (0.0010) [2023-12-28 00:15:56,817][106225] Updated weights for policy 1, policy_version 699288 (0.0010) [2023-12-28 00:15:56,905][106226] Updated weights for policy 0, policy_version 697439 (0.0008) [2023-12-28 00:15:56,969][106226] Updated weights for policy 0, policy_version 697449 (0.0007) [2023-12-28 00:15:57,028][106226] Updated weights for policy 0, policy_version 697459 (0.0005) [2023-12-28 00:15:57,483][106225] Updated weights for policy 1, policy_version 699298 (0.0010) [2023-12-28 00:15:57,534][106225] Updated weights for policy 1, policy_version 699308 (0.0010) [2023-12-28 00:15:57,592][106225] Updated weights for policy 1, policy_version 699318 (0.0010) [2023-12-28 00:15:57,715][106226] Updated weights for policy 0, policy_version 697469 (0.0006) [2023-12-28 00:15:57,774][106226] Updated weights for policy 0, policy_version 697479 (0.0005) [2023-12-28 00:15:57,822][106226] Updated weights for policy 0, policy_version 697489 (0.0005) [2023-12-28 00:15:58,296][106225] Updated weights for policy 1, policy_version 699328 (0.0011) [2023-12-28 00:15:58,378][106225] Updated weights for policy 1, policy_version 699338 (0.0009) [2023-12-28 00:15:58,448][106225] Updated weights for policy 1, policy_version 699348 (0.0010) [2023-12-28 00:15:58,603][106226] Updated weights for policy 0, policy_version 697499 (0.0008) [2023-12-28 00:15:58,666][106226] Updated weights for policy 0, policy_version 697509 (0.0009) [2023-12-28 00:15:58,730][106226] Updated weights for policy 0, policy_version 697519 (0.0010) [2023-12-28 00:15:59,299][106225] Updated weights for policy 1, policy_version 699358 (0.0010) [2023-12-28 00:15:59,371][106225] Updated weights for policy 1, policy_version 699368 (0.0008) [2023-12-28 00:15:59,435][106225] Updated weights for policy 1, policy_version 699378 (0.0008) [2023-12-28 00:15:59,700][106226] Updated weights for policy 0, policy_version 697529 (0.0011) [2023-12-28 00:15:59,761][106226] Updated weights for policy 0, policy_version 697539 (0.0009) [2023-12-28 00:15:59,823][106226] Updated weights for policy 0, policy_version 697549 (0.0009) [2023-12-28 00:15:59,889][106226] Updated weights for policy 0, policy_version 697559 (0.0009) [2023-12-28 00:16:00,224][106225] Updated weights for policy 1, policy_version 699388 (0.0009) [2023-12-28 00:16:00,282][106225] Updated weights for policy 1, policy_version 699398 (0.0008) [2023-12-28 00:16:00,345][106225] Updated weights for policy 1, policy_version 699408 (0.0008) [2023-12-28 00:16:00,678][106226] Updated weights for policy 0, policy_version 697569 (0.0007) [2023-12-28 00:16:00,742][106226] Updated weights for policy 0, policy_version 697579 (0.0006) [2023-12-28 00:16:00,797][106226] Updated weights for policy 0, policy_version 697589 (0.0006) [2023-12-28 00:16:01,005][106225] Updated weights for policy 1, policy_version 699418 (0.0007) [2023-12-28 00:16:01,072][106225] Updated weights for policy 1, policy_version 699428 (0.0008) [2023-12-28 00:16:01,131][106225] Updated weights for policy 1, policy_version 699438 (0.0008) [2023-12-28 00:16:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19910.7). Total num frames: 357720064. Throughput: 0: 9662.4, 1: 9872.5. Samples: 357714360. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:16:01,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-5.313')] [2023-12-28 00:16:01,196][106225] Updated weights for policy 1, policy_version 699448 (0.0009) [2023-12-28 00:16:01,484][106226] Updated weights for policy 0, policy_version 697599 (0.0007) [2023-12-28 00:16:01,550][106226] Updated weights for policy 0, policy_version 697609 (0.0009) [2023-12-28 00:16:01,605][106226] Updated weights for policy 0, policy_version 697619 (0.0006) [2023-12-28 00:16:01,998][106225] Updated weights for policy 1, policy_version 699458 (0.0007) [2023-12-28 00:16:02,060][106225] Updated weights for policy 1, policy_version 699468 (0.0008) [2023-12-28 00:16:02,117][106225] Updated weights for policy 1, policy_version 699478 (0.0009) [2023-12-28 00:16:02,347][106226] Updated weights for policy 0, policy_version 697629 (0.0008) [2023-12-28 00:16:02,419][106226] Updated weights for policy 0, policy_version 697639 (0.0009) [2023-12-28 00:16:02,480][106226] Updated weights for policy 0, policy_version 697649 (0.0007) [2023-12-28 00:16:02,892][106225] Updated weights for policy 1, policy_version 699488 (0.0008) [2023-12-28 00:16:02,956][106225] Updated weights for policy 1, policy_version 699498 (0.0009) [2023-12-28 00:16:03,021][106225] Updated weights for policy 1, policy_version 699508 (0.0008) [2023-12-28 00:16:03,157][106226] Updated weights for policy 0, policy_version 697659 (0.0007) [2023-12-28 00:16:03,218][106226] Updated weights for policy 0, policy_version 697669 (0.0009) [2023-12-28 00:16:03,278][106226] Updated weights for policy 0, policy_version 697679 (0.0009) [2023-12-28 00:16:03,631][106225] Updated weights for policy 1, policy_version 699518 (0.0008) [2023-12-28 00:16:03,698][106225] Updated weights for policy 1, policy_version 699528 (0.0010) [2023-12-28 00:16:03,760][106225] Updated weights for policy 1, policy_version 699538 (0.0011) [2023-12-28 00:16:03,903][106226] Updated weights for policy 0, policy_version 697689 (0.0005) [2023-12-28 00:16:03,972][106226] Updated weights for policy 0, policy_version 697699 (0.0007) [2023-12-28 00:16:04,035][106226] Updated weights for policy 0, policy_version 697709 (0.0010) [2023-12-28 00:16:04,101][106226] Updated weights for policy 0, policy_version 697719 (0.0009) [2023-12-28 00:16:04,439][106225] Updated weights for policy 1, policy_version 699548 (0.0010) [2023-12-28 00:16:04,489][106225] Updated weights for policy 1, policy_version 699558 (0.0010) [2023-12-28 00:16:04,540][106225] Updated weights for policy 1, policy_version 699568 (0.0010) [2023-12-28 00:16:04,879][106226] Updated weights for policy 0, policy_version 697729 (0.0008) [2023-12-28 00:16:04,936][106226] Updated weights for policy 0, policy_version 697739 (0.0007) [2023-12-28 00:16:04,994][106226] Updated weights for policy 0, policy_version 697749 (0.0008) [2023-12-28 00:16:05,229][106225] Updated weights for policy 1, policy_version 699578 (0.0011) [2023-12-28 00:16:05,279][106225] Updated weights for policy 1, policy_version 699588 (0.0010) [2023-12-28 00:16:05,335][106225] Updated weights for policy 1, policy_version 699598 (0.0010) [2023-12-28 00:16:05,382][106225] Updated weights for policy 1, policy_version 699608 (0.0010) [2023-12-28 00:16:05,755][106226] Updated weights for policy 0, policy_version 697759 (0.0008) [2023-12-28 00:16:05,819][106226] Updated weights for policy 0, policy_version 697769 (0.0008) [2023-12-28 00:16:05,880][106226] Updated weights for policy 0, policy_version 697779 (0.0008) [2023-12-28 00:16:06,133][106225] Updated weights for policy 1, policy_version 699618 (0.0009) [2023-12-28 00:16:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19910.7). Total num frames: 357818368. Throughput: 0: 9641.9, 1: 9885.6. Samples: 357830180. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:16:06,175][105115] Avg episode reward: [(0, '-4.297'), (1, '-5.504')] [2023-12-28 00:16:06,199][106225] Updated weights for policy 1, policy_version 699628 (0.0009) [2023-12-28 00:16:06,252][106225] Updated weights for policy 1, policy_version 699638 (0.0008) [2023-12-28 00:16:06,633][106226] Updated weights for policy 0, policy_version 697789 (0.0009) [2023-12-28 00:16:06,694][106226] Updated weights for policy 0, policy_version 697799 (0.0010) [2023-12-28 00:16:06,745][106226] Updated weights for policy 0, policy_version 697809 (0.0010) [2023-12-28 00:16:06,953][106225] Updated weights for policy 1, policy_version 699648 (0.0006) [2023-12-28 00:16:07,003][106225] Updated weights for policy 1, policy_version 699658 (0.0005) [2023-12-28 00:16:07,064][106225] Updated weights for policy 1, policy_version 699668 (0.0005) [2023-12-28 00:16:07,427][106226] Updated weights for policy 0, policy_version 697819 (0.0010) [2023-12-28 00:16:07,480][106226] Updated weights for policy 0, policy_version 697829 (0.0010) [2023-12-28 00:16:07,539][106226] Updated weights for policy 0, policy_version 697839 (0.0010) [2023-12-28 00:16:07,612][106225] Updated weights for policy 1, policy_version 699678 (0.0006) [2023-12-28 00:16:07,667][106225] Updated weights for policy 1, policy_version 699688 (0.0005) [2023-12-28 00:16:07,719][106225] Updated weights for policy 1, policy_version 699698 (0.0005) [2023-12-28 00:16:08,244][106226] Updated weights for policy 0, policy_version 697849 (0.0010) [2023-12-28 00:16:08,302][106226] Updated weights for policy 0, policy_version 697859 (0.0010) [2023-12-28 00:16:08,368][106226] Updated weights for policy 0, policy_version 697869 (0.0007) [2023-12-28 00:16:08,381][106225] Updated weights for policy 1, policy_version 699708 (0.0007) [2023-12-28 00:16:08,433][106226] Updated weights for policy 0, policy_version 697879 (0.0007) [2023-12-28 00:16:08,444][106225] Updated weights for policy 1, policy_version 699718 (0.0008) [2023-12-28 00:16:08,509][106225] Updated weights for policy 1, policy_version 699728 (0.0008) [2023-12-28 00:16:09,102][106226] Updated weights for policy 0, policy_version 697889 (0.0007) [2023-12-28 00:16:09,166][106226] Updated weights for policy 0, policy_version 697899 (0.0005) [2023-12-28 00:16:09,201][106225] Updated weights for policy 1, policy_version 699738 (0.0009) [2023-12-28 00:16:09,232][106226] Updated weights for policy 0, policy_version 697909 (0.0007) [2023-12-28 00:16:09,268][106225] Updated weights for policy 1, policy_version 699748 (0.0011) [2023-12-28 00:16:09,328][106225] Updated weights for policy 1, policy_version 699758 (0.0006) [2023-12-28 00:16:09,398][106225] Updated weights for policy 1, policy_version 699768 (0.0010) [2023-12-28 00:16:09,947][106226] Updated weights for policy 0, policy_version 697919 (0.0009) [2023-12-28 00:16:10,024][106226] Updated weights for policy 0, policy_version 697929 (0.0010) [2023-12-28 00:16:10,087][106226] Updated weights for policy 0, policy_version 697939 (0.0011) [2023-12-28 00:16:10,110][106225] Updated weights for policy 1, policy_version 699778 (0.0006) [2023-12-28 00:16:10,176][106225] Updated weights for policy 1, policy_version 699788 (0.0008) [2023-12-28 00:16:10,238][106225] Updated weights for policy 1, policy_version 699798 (0.0008) [2023-12-28 00:16:10,768][106226] Updated weights for policy 0, policy_version 697949 (0.0008) [2023-12-28 00:16:10,824][106226] Updated weights for policy 0, policy_version 697959 (0.0005) [2023-12-28 00:16:10,884][106226] Updated weights for policy 0, policy_version 697969 (0.0007) [2023-12-28 00:16:10,913][106225] Updated weights for policy 1, policy_version 699808 (0.0006) [2023-12-28 00:16:10,983][106225] Updated weights for policy 1, policy_version 699818 (0.0008) [2023-12-28 00:16:11,050][106225] Updated weights for policy 1, policy_version 699828 (0.0008) [2023-12-28 00:16:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 357924864. Throughput: 0: 9691.0, 1: 9902.5. Samples: 357891084. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:16:11,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-5.581')] [2023-12-28 00:16:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000699832_179191808.pth... [2023-12-28 00:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000697976_178733056.pth... [2023-12-28 00:16:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000698680_178896896.pth [2023-12-28 00:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000696856_178446336.pth [2023-12-28 00:16:11,625][106226] Updated weights for policy 0, policy_version 697979 (0.0008) [2023-12-28 00:16:11,696][106226] Updated weights for policy 0, policy_version 697989 (0.0011) [2023-12-28 00:16:11,763][106226] Updated weights for policy 0, policy_version 697999 (0.0009) [2023-12-28 00:16:11,892][106225] Updated weights for policy 1, policy_version 699838 (0.0007) [2023-12-28 00:16:11,956][106225] Updated weights for policy 1, policy_version 699848 (0.0008) [2023-12-28 00:16:12,015][106225] Updated weights for policy 1, policy_version 699858 (0.0008) [2023-12-28 00:16:12,484][106226] Updated weights for policy 0, policy_version 698009 (0.0008) [2023-12-28 00:16:12,545][106226] Updated weights for policy 0, policy_version 698019 (0.0011) [2023-12-28 00:16:12,609][106226] Updated weights for policy 0, policy_version 698029 (0.0011) [2023-12-28 00:16:12,673][106226] Updated weights for policy 0, policy_version 698039 (0.0011) [2023-12-28 00:16:12,745][106225] Updated weights for policy 1, policy_version 699868 (0.0007) [2023-12-28 00:16:12,801][106225] Updated weights for policy 1, policy_version 699878 (0.0008) [2023-12-28 00:16:12,857][106225] Updated weights for policy 1, policy_version 699888 (0.0005) [2023-12-28 00:16:13,381][106226] Updated weights for policy 0, policy_version 698049 (0.0010) [2023-12-28 00:16:13,407][106225] Updated weights for policy 1, policy_version 699898 (0.0005) [2023-12-28 00:16:13,431][106226] Updated weights for policy 0, policy_version 698059 (0.0010) [2023-12-28 00:16:13,460][106225] Updated weights for policy 1, policy_version 699908 (0.0005) [2023-12-28 00:16:13,481][106226] Updated weights for policy 0, policy_version 698069 (0.0010) [2023-12-28 00:16:13,511][106225] Updated weights for policy 1, policy_version 699918 (0.0006) [2023-12-28 00:16:13,565][106225] Updated weights for policy 1, policy_version 699928 (0.0007) [2023-12-28 00:16:14,202][106226] Updated weights for policy 0, policy_version 698079 (0.0010) [2023-12-28 00:16:14,230][106225] Updated weights for policy 1, policy_version 699938 (0.0006) [2023-12-28 00:16:14,260][106226] Updated weights for policy 0, policy_version 698089 (0.0010) [2023-12-28 00:16:14,289][106225] Updated weights for policy 1, policy_version 699948 (0.0006) [2023-12-28 00:16:14,310][106226] Updated weights for policy 0, policy_version 698099 (0.0010) [2023-12-28 00:16:14,340][106225] Updated weights for policy 1, policy_version 699958 (0.0006) [2023-12-28 00:16:15,045][106225] Updated weights for policy 1, policy_version 699968 (0.0006) [2023-12-28 00:16:15,081][106226] Updated weights for policy 0, policy_version 698109 (0.0009) [2023-12-28 00:16:15,111][106225] Updated weights for policy 1, policy_version 699978 (0.0006) [2023-12-28 00:16:15,137][106226] Updated weights for policy 0, policy_version 698119 (0.0008) [2023-12-28 00:16:15,177][106225] Updated weights for policy 1, policy_version 699988 (0.0007) [2023-12-28 00:16:15,194][106226] Updated weights for policy 0, policy_version 698129 (0.0008) [2023-12-28 00:16:15,833][106225] Updated weights for policy 1, policy_version 699998 (0.0009) [2023-12-28 00:16:15,896][106226] Updated weights for policy 0, policy_version 698139 (0.0007) [2023-12-28 00:16:15,896][106225] Updated weights for policy 1, policy_version 700008 (0.0010) [2023-12-28 00:16:15,945][106226] Updated weights for policy 0, policy_version 698149 (0.0005) [2023-12-28 00:16:15,958][106225] Updated weights for policy 1, policy_version 700018 (0.0009) [2023-12-28 00:16:16,003][106226] Updated weights for policy 0, policy_version 698159 (0.0008) [2023-12-28 00:16:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 358023168. Throughput: 0: 9654.0, 1: 9861.5. Samples: 358007596. Policy #0 lag: (min: 24.0, avg: 51.6, max: 56.0) [2023-12-28 00:16:16,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.428')] [2023-12-28 00:16:16,613][106225] Updated weights for policy 1, policy_version 700028 (0.0010) [2023-12-28 00:16:16,664][106225] Updated weights for policy 1, policy_version 700038 (0.0010) [2023-12-28 00:16:16,690][106226] Updated weights for policy 0, policy_version 698169 (0.0011) [2023-12-28 00:16:16,724][106225] Updated weights for policy 1, policy_version 700048 (0.0011) [2023-12-28 00:16:16,748][106226] Updated weights for policy 0, policy_version 698179 (0.0010) [2023-12-28 00:16:16,814][106226] Updated weights for policy 0, policy_version 698189 (0.0008) [2023-12-28 00:16:16,872][106226] Updated weights for policy 0, policy_version 698199 (0.0007) [2023-12-28 00:16:17,494][106225] Updated weights for policy 1, policy_version 700058 (0.0008) [2023-12-28 00:16:17,537][106226] Updated weights for policy 0, policy_version 698209 (0.0008) [2023-12-28 00:16:17,543][106225] Updated weights for policy 1, policy_version 700068 (0.0007) [2023-12-28 00:16:17,589][106226] Updated weights for policy 0, policy_version 698219 (0.0010) [2023-12-28 00:16:17,591][106225] Updated weights for policy 1, policy_version 700078 (0.0005) [2023-12-28 00:16:17,640][106226] Updated weights for policy 0, policy_version 698229 (0.0010) [2023-12-28 00:16:17,642][106225] Updated weights for policy 1, policy_version 700088 (0.0005) [2023-12-28 00:16:18,294][106226] Updated weights for policy 0, policy_version 698239 (0.0010) [2023-12-28 00:16:18,361][106226] Updated weights for policy 0, policy_version 698249 (0.0010) [2023-12-28 00:16:18,390][106225] Updated weights for policy 1, policy_version 700098 (0.0008) [2023-12-28 00:16:18,419][106226] Updated weights for policy 0, policy_version 698259 (0.0010) [2023-12-28 00:16:18,451][106225] Updated weights for policy 1, policy_version 700108 (0.0006) [2023-12-28 00:16:18,521][106225] Updated weights for policy 1, policy_version 700118 (0.0009) [2023-12-28 00:16:19,056][106226] Updated weights for policy 0, policy_version 698269 (0.0008) [2023-12-28 00:16:19,120][106226] Updated weights for policy 0, policy_version 698279 (0.0007) [2023-12-28 00:16:19,184][106226] Updated weights for policy 0, policy_version 698289 (0.0008) [2023-12-28 00:16:19,244][106225] Updated weights for policy 1, policy_version 700128 (0.0009) [2023-12-28 00:16:19,310][106225] Updated weights for policy 1, policy_version 700138 (0.0009) [2023-12-28 00:16:19,372][106225] Updated weights for policy 1, policy_version 700148 (0.0007) [2023-12-28 00:16:19,963][106226] Updated weights for policy 0, policy_version 698299 (0.0008) [2023-12-28 00:16:20,025][106226] Updated weights for policy 0, policy_version 698309 (0.0006) [2023-12-28 00:16:20,089][106226] Updated weights for policy 0, policy_version 698319 (0.0007) [2023-12-28 00:16:20,119][106225] Updated weights for policy 1, policy_version 700158 (0.0010) [2023-12-28 00:16:20,185][106225] Updated weights for policy 1, policy_version 700168 (0.0011) [2023-12-28 00:16:20,246][106225] Updated weights for policy 1, policy_version 700178 (0.0010) [2023-12-28 00:16:20,769][106226] Updated weights for policy 0, policy_version 698329 (0.0006) [2023-12-28 00:16:20,836][106226] Updated weights for policy 0, policy_version 698339 (0.0008) [2023-12-28 00:16:20,905][106226] Updated weights for policy 0, policy_version 698349 (0.0008) [2023-12-28 00:16:20,969][106226] Updated weights for policy 0, policy_version 698359 (0.0008) [2023-12-28 00:16:21,021][106225] Updated weights for policy 1, policy_version 700188 (0.0009) [2023-12-28 00:16:21,086][106225] Updated weights for policy 1, policy_version 700198 (0.0008) [2023-12-28 00:16:21,152][106225] Updated weights for policy 1, policy_version 700208 (0.0011) [2023-12-28 00:16:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19883.0). Total num frames: 358113280. Throughput: 0: 9656.9, 1: 9808.2. Samples: 358125780. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:21,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-5.504')] [2023-12-28 00:16:21,746][106226] Updated weights for policy 0, policy_version 698369 (0.0010) [2023-12-28 00:16:21,812][106226] Updated weights for policy 0, policy_version 698379 (0.0009) [2023-12-28 00:16:21,883][106226] Updated weights for policy 0, policy_version 698389 (0.0010) [2023-12-28 00:16:21,965][106225] Updated weights for policy 1, policy_version 700218 (0.0009) [2023-12-28 00:16:22,025][106225] Updated weights for policy 1, policy_version 700228 (0.0008) [2023-12-28 00:16:22,093][106225] Updated weights for policy 1, policy_version 700238 (0.0008) [2023-12-28 00:16:22,147][106225] Updated weights for policy 1, policy_version 700248 (0.0010) [2023-12-28 00:16:22,623][106226] Updated weights for policy 0, policy_version 698399 (0.0011) [2023-12-28 00:16:22,677][106226] Updated weights for policy 0, policy_version 698409 (0.0011) [2023-12-28 00:16:22,731][106226] Updated weights for policy 0, policy_version 698419 (0.0009) [2023-12-28 00:16:22,876][106225] Updated weights for policy 1, policy_version 700258 (0.0010) [2023-12-28 00:16:22,939][106225] Updated weights for policy 1, policy_version 700268 (0.0010) [2023-12-28 00:16:22,995][106225] Updated weights for policy 1, policy_version 700278 (0.0009) [2023-12-28 00:16:23,463][106226] Updated weights for policy 0, policy_version 698429 (0.0008) [2023-12-28 00:16:23,519][106226] Updated weights for policy 0, policy_version 698439 (0.0006) [2023-12-28 00:16:23,584][106226] Updated weights for policy 0, policy_version 698449 (0.0005) [2023-12-28 00:16:23,627][106225] Updated weights for policy 1, policy_version 700288 (0.0009) [2023-12-28 00:16:23,680][106225] Updated weights for policy 1, policy_version 700298 (0.0010) [2023-12-28 00:16:23,731][106225] Updated weights for policy 1, policy_version 700308 (0.0010) [2023-12-28 00:16:24,149][106226] Updated weights for policy 0, policy_version 698459 (0.0005) [2023-12-28 00:16:24,204][106226] Updated weights for policy 0, policy_version 698469 (0.0006) [2023-12-28 00:16:24,259][106226] Updated weights for policy 0, policy_version 698479 (0.0005) [2023-12-28 00:16:24,430][106225] Updated weights for policy 1, policy_version 700318 (0.0007) [2023-12-28 00:16:24,482][106225] Updated weights for policy 1, policy_version 700328 (0.0005) [2023-12-28 00:16:24,541][106225] Updated weights for policy 1, policy_version 700338 (0.0005) [2023-12-28 00:16:24,795][106226] Updated weights for policy 0, policy_version 698489 (0.0005) [2023-12-28 00:16:24,847][106226] Updated weights for policy 0, policy_version 698499 (0.0005) [2023-12-28 00:16:24,892][106226] Updated weights for policy 0, policy_version 698509 (0.0005) [2023-12-28 00:16:24,946][106226] Updated weights for policy 0, policy_version 698519 (0.0005) [2023-12-28 00:16:25,081][106225] Updated weights for policy 1, policy_version 700348 (0.0006) [2023-12-28 00:16:25,130][106225] Updated weights for policy 1, policy_version 700358 (0.0005) [2023-12-28 00:16:25,195][106225] Updated weights for policy 1, policy_version 700368 (0.0010) [2023-12-28 00:16:25,483][106226] Updated weights for policy 0, policy_version 698529 (0.0008) [2023-12-28 00:16:25,543][106226] Updated weights for policy 0, policy_version 698539 (0.0011) [2023-12-28 00:16:25,600][106226] Updated weights for policy 0, policy_version 698549 (0.0010) [2023-12-28 00:16:25,840][106225] Updated weights for policy 1, policy_version 700378 (0.0011) [2023-12-28 00:16:25,911][106225] Updated weights for policy 1, policy_version 700388 (0.0010) [2023-12-28 00:16:25,967][106225] Updated weights for policy 1, policy_version 700398 (0.0010) [2023-12-28 00:16:26,018][106225] Updated weights for policy 1, policy_version 700408 (0.0009) [2023-12-28 00:16:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 358219776. Throughput: 0: 9684.7, 1: 9814.1. Samples: 358183932. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:26,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.515')] [2023-12-28 00:16:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000700408_179339264.pth... [2023-12-28 00:16:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000698552_178880512.pth... [2023-12-28 00:16:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000699256_179044352.pth [2023-12-28 00:16:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000697432_178593792.pth [2023-12-28 00:16:26,255][106226] Updated weights for policy 0, policy_version 698559 (0.0010) [2023-12-28 00:16:26,320][106226] Updated weights for policy 0, policy_version 698569 (0.0005) [2023-12-28 00:16:26,376][106226] Updated weights for policy 0, policy_version 698579 (0.0005) [2023-12-28 00:16:26,682][106225] Updated weights for policy 1, policy_version 700418 (0.0011) [2023-12-28 00:16:26,739][106225] Updated weights for policy 1, policy_version 700428 (0.0010) [2023-12-28 00:16:26,782][106225] Updated weights for policy 1, policy_version 700438 (0.0010) [2023-12-28 00:16:26,906][106226] Updated weights for policy 0, policy_version 698589 (0.0005) [2023-12-28 00:16:26,955][106226] Updated weights for policy 0, policy_version 698599 (0.0007) [2023-12-28 00:16:27,006][106226] Updated weights for policy 0, policy_version 698609 (0.0007) [2023-12-28 00:16:27,437][106225] Updated weights for policy 1, policy_version 700448 (0.0006) [2023-12-28 00:16:27,487][106225] Updated weights for policy 1, policy_version 700458 (0.0006) [2023-12-28 00:16:27,542][106225] Updated weights for policy 1, policy_version 700468 (0.0010) [2023-12-28 00:16:27,645][106226] Updated weights for policy 0, policy_version 698619 (0.0006) [2023-12-28 00:16:27,691][106226] Updated weights for policy 0, policy_version 698629 (0.0007) [2023-12-28 00:16:27,738][106226] Updated weights for policy 0, policy_version 698639 (0.0008) [2023-12-28 00:16:28,218][106225] Updated weights for policy 1, policy_version 700478 (0.0010) [2023-12-28 00:16:28,274][106225] Updated weights for policy 1, policy_version 700488 (0.0010) [2023-12-28 00:16:28,333][106225] Updated weights for policy 1, policy_version 700498 (0.0010) [2023-12-28 00:16:28,407][106226] Updated weights for policy 0, policy_version 698649 (0.0008) [2023-12-28 00:16:28,468][106226] Updated weights for policy 0, policy_version 698659 (0.0008) [2023-12-28 00:16:28,531][106226] Updated weights for policy 0, policy_version 698669 (0.0010) [2023-12-28 00:16:28,587][106226] Updated weights for policy 0, policy_version 698679 (0.0010) [2023-12-28 00:16:29,044][106225] Updated weights for policy 1, policy_version 700508 (0.0011) [2023-12-28 00:16:29,106][106225] Updated weights for policy 1, policy_version 700518 (0.0010) [2023-12-28 00:16:29,162][106225] Updated weights for policy 1, policy_version 700528 (0.0010) [2023-12-28 00:16:29,277][106226] Updated weights for policy 0, policy_version 698689 (0.0010) [2023-12-28 00:16:29,334][106226] Updated weights for policy 0, policy_version 698699 (0.0010) [2023-12-28 00:16:29,398][106226] Updated weights for policy 0, policy_version 698709 (0.0008) [2023-12-28 00:16:29,890][106225] Updated weights for policy 1, policy_version 700538 (0.0011) [2023-12-28 00:16:29,960][106225] Updated weights for policy 1, policy_version 700548 (0.0008) [2023-12-28 00:16:30,018][106225] Updated weights for policy 1, policy_version 700558 (0.0008) [2023-12-28 00:16:30,076][106225] Updated weights for policy 1, policy_version 700568 (0.0008) [2023-12-28 00:16:30,100][106226] Updated weights for policy 0, policy_version 698719 (0.0005) [2023-12-28 00:16:30,151][106226] Updated weights for policy 0, policy_version 698729 (0.0006) [2023-12-28 00:16:30,208][106226] Updated weights for policy 0, policy_version 698739 (0.0006) [2023-12-28 00:16:30,803][106225] Updated weights for policy 1, policy_version 700578 (0.0008) [2023-12-28 00:16:30,859][106225] Updated weights for policy 1, policy_version 700588 (0.0009) [2023-12-28 00:16:30,897][106226] Updated weights for policy 0, policy_version 698749 (0.0006) [2023-12-28 00:16:30,914][106225] Updated weights for policy 1, policy_version 700598 (0.0007) [2023-12-28 00:16:30,951][106226] Updated weights for policy 0, policy_version 698759 (0.0007) [2023-12-28 00:16:31,011][106226] Updated weights for policy 0, policy_version 698769 (0.0008) [2023-12-28 00:16:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 358326272. Throughput: 0: 9830.7, 1: 9899.7. Samples: 358312804. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:31,176][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.475')] [2023-12-28 00:16:31,728][106225] Updated weights for policy 1, policy_version 700608 (0.0008) [2023-12-28 00:16:31,760][106226] Updated weights for policy 0, policy_version 698779 (0.0007) [2023-12-28 00:16:31,798][106225] Updated weights for policy 1, policy_version 700618 (0.0006) [2023-12-28 00:16:31,818][106226] Updated weights for policy 0, policy_version 698789 (0.0007) [2023-12-28 00:16:31,861][106225] Updated weights for policy 1, policy_version 700628 (0.0006) [2023-12-28 00:16:31,874][106226] Updated weights for policy 0, policy_version 698799 (0.0008) [2023-12-28 00:16:32,558][106226] Updated weights for policy 0, policy_version 698809 (0.0008) [2023-12-28 00:16:32,561][106225] Updated weights for policy 1, policy_version 700638 (0.0007) [2023-12-28 00:16:32,616][106226] Updated weights for policy 0, policy_version 698819 (0.0006) [2023-12-28 00:16:32,629][106225] Updated weights for policy 1, policy_version 700648 (0.0008) [2023-12-28 00:16:32,676][106226] Updated weights for policy 0, policy_version 698829 (0.0007) [2023-12-28 00:16:32,692][106225] Updated weights for policy 1, policy_version 700658 (0.0008) [2023-12-28 00:16:32,730][106226] Updated weights for policy 0, policy_version 698839 (0.0007) [2023-12-28 00:16:33,376][106226] Updated weights for policy 0, policy_version 698849 (0.0006) [2023-12-28 00:16:33,403][106225] Updated weights for policy 1, policy_version 700668 (0.0007) [2023-12-28 00:16:33,431][106226] Updated weights for policy 0, policy_version 698859 (0.0005) [2023-12-28 00:16:33,455][106225] Updated weights for policy 1, policy_version 700678 (0.0009) [2023-12-28 00:16:33,490][106226] Updated weights for policy 0, policy_version 698869 (0.0008) [2023-12-28 00:16:33,505][106225] Updated weights for policy 1, policy_version 700688 (0.0009) [2023-12-28 00:16:34,098][106226] Updated weights for policy 0, policy_version 698879 (0.0008) [2023-12-28 00:16:34,162][106226] Updated weights for policy 0, policy_version 698889 (0.0008) [2023-12-28 00:16:34,222][106226] Updated weights for policy 0, policy_version 698899 (0.0008) [2023-12-28 00:16:34,241][106225] Updated weights for policy 1, policy_version 700698 (0.0007) [2023-12-28 00:16:34,304][106225] Updated weights for policy 1, policy_version 700708 (0.0007) [2023-12-28 00:16:34,359][106225] Updated weights for policy 1, policy_version 700718 (0.0009) [2023-12-28 00:16:34,418][106225] Updated weights for policy 1, policy_version 700728 (0.0008) [2023-12-28 00:16:34,929][106226] Updated weights for policy 0, policy_version 698909 (0.0008) [2023-12-28 00:16:34,979][106226] Updated weights for policy 0, policy_version 698919 (0.0005) [2023-12-28 00:16:35,025][106226] Updated weights for policy 0, policy_version 698929 (0.0005) [2023-12-28 00:16:35,162][106225] Updated weights for policy 1, policy_version 700738 (0.0008) [2023-12-28 00:16:35,216][106225] Updated weights for policy 1, policy_version 700748 (0.0007) [2023-12-28 00:16:35,280][106225] Updated weights for policy 1, policy_version 700758 (0.0008) [2023-12-28 00:16:35,711][106226] Updated weights for policy 0, policy_version 698939 (0.0007) [2023-12-28 00:16:35,771][106226] Updated weights for policy 0, policy_version 698949 (0.0009) [2023-12-28 00:16:35,830][106226] Updated weights for policy 0, policy_version 698959 (0.0006) [2023-12-28 00:16:35,973][106225] Updated weights for policy 1, policy_version 700768 (0.0009) [2023-12-28 00:16:36,037][106225] Updated weights for policy 1, policy_version 700778 (0.0008) [2023-12-28 00:16:36,095][106225] Updated weights for policy 1, policy_version 700788 (0.0008) [2023-12-28 00:16:36,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.7, 300 sec: 19938.5). Total num frames: 358424576. Throughput: 0: 9931.6, 1: 9820.1. Samples: 358429792. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:36,176][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.362')] [2023-12-28 00:16:36,422][106226] Updated weights for policy 0, policy_version 698969 (0.0010) [2023-12-28 00:16:36,487][106226] Updated weights for policy 0, policy_version 698979 (0.0011) [2023-12-28 00:16:36,549][106226] Updated weights for policy 0, policy_version 698989 (0.0011) [2023-12-28 00:16:36,611][106226] Updated weights for policy 0, policy_version 698999 (0.0011) [2023-12-28 00:16:36,829][106225] Updated weights for policy 1, policy_version 700798 (0.0010) [2023-12-28 00:16:36,894][106225] Updated weights for policy 1, policy_version 700808 (0.0010) [2023-12-28 00:16:36,962][106225] Updated weights for policy 1, policy_version 700818 (0.0010) [2023-12-28 00:16:37,283][106226] Updated weights for policy 0, policy_version 699009 (0.0011) [2023-12-28 00:16:37,334][106226] Updated weights for policy 0, policy_version 699019 (0.0010) [2023-12-28 00:16:37,388][106226] Updated weights for policy 0, policy_version 699029 (0.0010) [2023-12-28 00:16:37,621][106225] Updated weights for policy 1, policy_version 700828 (0.0011) [2023-12-28 00:16:37,676][106225] Updated weights for policy 1, policy_version 700838 (0.0011) [2023-12-28 00:16:37,734][106225] Updated weights for policy 1, policy_version 700848 (0.0010) [2023-12-28 00:16:38,113][106226] Updated weights for policy 0, policy_version 699039 (0.0009) [2023-12-28 00:16:38,169][106226] Updated weights for policy 0, policy_version 699049 (0.0010) [2023-12-28 00:16:38,233][106226] Updated weights for policy 0, policy_version 699059 (0.0011) [2023-12-28 00:16:38,377][106225] Updated weights for policy 1, policy_version 700858 (0.0010) [2023-12-28 00:16:38,443][106225] Updated weights for policy 1, policy_version 700868 (0.0011) [2023-12-28 00:16:38,509][106225] Updated weights for policy 1, policy_version 700878 (0.0010) [2023-12-28 00:16:38,574][106225] Updated weights for policy 1, policy_version 700888 (0.0010) [2023-12-28 00:16:38,919][106226] Updated weights for policy 0, policy_version 699069 (0.0007) [2023-12-28 00:16:38,987][106226] Updated weights for policy 0, policy_version 699079 (0.0006) [2023-12-28 00:16:39,045][106226] Updated weights for policy 0, policy_version 699089 (0.0005) [2023-12-28 00:16:39,212][106225] Updated weights for policy 1, policy_version 700898 (0.0008) [2023-12-28 00:16:39,290][106225] Updated weights for policy 1, policy_version 700908 (0.0010) [2023-12-28 00:16:39,358][106225] Updated weights for policy 1, policy_version 700918 (0.0009) [2023-12-28 00:16:39,708][106226] Updated weights for policy 0, policy_version 699099 (0.0007) [2023-12-28 00:16:39,763][106226] Updated weights for policy 0, policy_version 699109 (0.0011) [2023-12-28 00:16:39,821][106226] Updated weights for policy 0, policy_version 699119 (0.0011) [2023-12-28 00:16:40,113][106225] Updated weights for policy 1, policy_version 700928 (0.0010) [2023-12-28 00:16:40,172][106225] Updated weights for policy 1, policy_version 700938 (0.0010) [2023-12-28 00:16:40,237][106225] Updated weights for policy 1, policy_version 700948 (0.0010) [2023-12-28 00:16:40,501][106226] Updated weights for policy 0, policy_version 699129 (0.0009) [2023-12-28 00:16:40,559][106226] Updated weights for policy 0, policy_version 699140 (0.0008) [2023-12-28 00:16:40,630][106226] Updated weights for policy 0, policy_version 699150 (0.0009) [2023-12-28 00:16:40,683][106226] Updated weights for policy 0, policy_version 699160 (0.0009) [2023-12-28 00:16:40,978][106225] Updated weights for policy 1, policy_version 700958 (0.0011) [2023-12-28 00:16:41,045][106225] Updated weights for policy 1, policy_version 700968 (0.0010) [2023-12-28 00:16:41,112][106225] Updated weights for policy 1, policy_version 700978 (0.0011) [2023-12-28 00:16:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 358522880. Throughput: 0: 9944.5, 1: 9836.1. Samples: 358490096. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:41,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.331')] [2023-12-28 00:16:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000700984_179486720.pth... [2023-12-28 00:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000699160_179036160.pth... [2023-12-28 00:16:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000697976_178733056.pth [2023-12-28 00:16:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000699832_179191808.pth [2023-12-28 00:16:41,441][106226] Updated weights for policy 0, policy_version 699170 (0.0008) [2023-12-28 00:16:41,509][106226] Updated weights for policy 0, policy_version 699180 (0.0008) [2023-12-28 00:16:41,575][106226] Updated weights for policy 0, policy_version 699190 (0.0008) [2023-12-28 00:16:41,906][106225] Updated weights for policy 1, policy_version 700988 (0.0011) [2023-12-28 00:16:41,974][106225] Updated weights for policy 1, policy_version 700998 (0.0011) [2023-12-28 00:16:42,037][106225] Updated weights for policy 1, policy_version 701008 (0.0011) [2023-12-28 00:16:42,319][106226] Updated weights for policy 0, policy_version 699200 (0.0010) [2023-12-28 00:16:42,385][106226] Updated weights for policy 0, policy_version 699210 (0.0009) [2023-12-28 00:16:42,442][106226] Updated weights for policy 0, policy_version 699220 (0.0008) [2023-12-28 00:16:42,764][106225] Updated weights for policy 1, policy_version 701018 (0.0008) [2023-12-28 00:16:42,822][106225] Updated weights for policy 1, policy_version 701028 (0.0007) [2023-12-28 00:16:42,875][106225] Updated weights for policy 1, policy_version 701038 (0.0010) [2023-12-28 00:16:42,933][106225] Updated weights for policy 1, policy_version 701048 (0.0011) [2023-12-28 00:16:43,099][106226] Updated weights for policy 0, policy_version 699230 (0.0010) [2023-12-28 00:16:43,149][106226] Updated weights for policy 0, policy_version 699240 (0.0007) [2023-12-28 00:16:43,199][106226] Updated weights for policy 0, policy_version 699250 (0.0006) [2023-12-28 00:16:43,635][106225] Updated weights for policy 1, policy_version 701058 (0.0010) [2023-12-28 00:16:43,688][106225] Updated weights for policy 1, policy_version 701068 (0.0010) [2023-12-28 00:16:43,739][106225] Updated weights for policy 1, policy_version 701078 (0.0010) [2023-12-28 00:16:43,761][106226] Updated weights for policy 0, policy_version 699260 (0.0005) [2023-12-28 00:16:43,812][106226] Updated weights for policy 0, policy_version 699270 (0.0005) [2023-12-28 00:16:43,874][106226] Updated weights for policy 0, policy_version 699280 (0.0005) [2023-12-28 00:16:44,451][106225] Updated weights for policy 1, policy_version 701088 (0.0007) [2023-12-28 00:16:44,453][106226] Updated weights for policy 0, policy_version 699290 (0.0005) [2023-12-28 00:16:44,493][106225] Updated weights for policy 1, policy_version 701098 (0.0007) [2023-12-28 00:16:44,514][106226] Updated weights for policy 0, policy_version 699300 (0.0006) [2023-12-28 00:16:44,538][106225] Updated weights for policy 1, policy_version 701108 (0.0007) [2023-12-28 00:16:44,578][106226] Updated weights for policy 0, policy_version 699310 (0.0007) [2023-12-28 00:16:44,645][106226] Updated weights for policy 0, policy_version 699320 (0.0007) [2023-12-28 00:16:45,170][106225] Updated weights for policy 1, policy_version 701118 (0.0009) [2023-12-28 00:16:45,224][106225] Updated weights for policy 1, policy_version 701128 (0.0010) [2023-12-28 00:16:45,281][106225] Updated weights for policy 1, policy_version 701138 (0.0010) [2023-12-28 00:16:45,355][106226] Updated weights for policy 0, policy_version 699330 (0.0007) [2023-12-28 00:16:45,425][106226] Updated weights for policy 0, policy_version 699340 (0.0006) [2023-12-28 00:16:45,481][106226] Updated weights for policy 0, policy_version 699350 (0.0005) [2023-12-28 00:16:45,914][106225] Updated weights for policy 1, policy_version 701148 (0.0010) [2023-12-28 00:16:45,962][106225] Updated weights for policy 1, policy_version 701158 (0.0009) [2023-12-28 00:16:46,006][106226] Updated weights for policy 0, policy_version 699360 (0.0008) [2023-12-28 00:16:46,024][106225] Updated weights for policy 1, policy_version 701168 (0.0009) [2023-12-28 00:16:46,059][106226] Updated weights for policy 0, policy_version 699370 (0.0005) [2023-12-28 00:16:46,117][106226] Updated weights for policy 0, policy_version 699380 (0.0007) [2023-12-28 00:16:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 358629376. Throughput: 0: 10059.5, 1: 9828.5. Samples: 358609320. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:46,176][105115] Avg episode reward: [(0, '-4.376'), (1, '-5.776')] [2023-12-28 00:16:46,642][106225] Updated weights for policy 1, policy_version 701178 (0.0009) [2023-12-28 00:16:46,697][106225] Updated weights for policy 1, policy_version 701188 (0.0008) [2023-12-28 00:16:46,746][106225] Updated weights for policy 1, policy_version 701198 (0.0010) [2023-12-28 00:16:46,800][106225] Updated weights for policy 1, policy_version 701208 (0.0010) [2023-12-28 00:16:46,894][106226] Updated weights for policy 0, policy_version 699390 (0.0009) [2023-12-28 00:16:46,951][106226] Updated weights for policy 0, policy_version 699400 (0.0009) [2023-12-28 00:16:47,009][106226] Updated weights for policy 0, policy_version 699410 (0.0008) [2023-12-28 00:16:47,448][106225] Updated weights for policy 1, policy_version 701218 (0.0005) [2023-12-28 00:16:47,507][106225] Updated weights for policy 1, policy_version 701228 (0.0005) [2023-12-28 00:16:47,562][106225] Updated weights for policy 1, policy_version 701238 (0.0006) [2023-12-28 00:16:47,812][106226] Updated weights for policy 0, policy_version 699420 (0.0007) [2023-12-28 00:16:47,872][106226] Updated weights for policy 0, policy_version 699430 (0.0006) [2023-12-28 00:16:47,924][106226] Updated weights for policy 0, policy_version 699440 (0.0005) [2023-12-28 00:16:48,183][106225] Updated weights for policy 1, policy_version 701248 (0.0009) [2023-12-28 00:16:48,243][106225] Updated weights for policy 1, policy_version 701258 (0.0008) [2023-12-28 00:16:48,300][106225] Updated weights for policy 1, policy_version 701268 (0.0008) [2023-12-28 00:16:48,566][106226] Updated weights for policy 0, policy_version 699450 (0.0005) [2023-12-28 00:16:48,633][106226] Updated weights for policy 0, policy_version 699460 (0.0006) [2023-12-28 00:16:48,693][106226] Updated weights for policy 0, policy_version 699470 (0.0005) [2023-12-28 00:16:48,750][106226] Updated weights for policy 0, policy_version 699480 (0.0005) [2023-12-28 00:16:49,120][106225] Updated weights for policy 1, policy_version 701278 (0.0007) [2023-12-28 00:16:49,178][106225] Updated weights for policy 1, policy_version 701288 (0.0008) [2023-12-28 00:16:49,239][106225] Updated weights for policy 1, policy_version 701298 (0.0009) [2023-12-28 00:16:49,370][106226] Updated weights for policy 0, policy_version 699490 (0.0008) [2023-12-28 00:16:49,429][106226] Updated weights for policy 0, policy_version 699500 (0.0007) [2023-12-28 00:16:49,485][106226] Updated weights for policy 0, policy_version 699510 (0.0009) [2023-12-28 00:16:49,947][106225] Updated weights for policy 1, policy_version 701309 (0.0009) [2023-12-28 00:16:50,009][106225] Updated weights for policy 1, policy_version 701319 (0.0006) [2023-12-28 00:16:50,073][106225] Updated weights for policy 1, policy_version 701329 (0.0008) [2023-12-28 00:16:50,270][106226] Updated weights for policy 0, policy_version 699520 (0.0009) [2023-12-28 00:16:50,329][106226] Updated weights for policy 0, policy_version 699530 (0.0009) [2023-12-28 00:16:50,391][106226] Updated weights for policy 0, policy_version 699540 (0.0009) [2023-12-28 00:16:50,790][106225] Updated weights for policy 1, policy_version 701339 (0.0008) [2023-12-28 00:16:50,847][106225] Updated weights for policy 1, policy_version 701349 (0.0005) [2023-12-28 00:16:50,908][106225] Updated weights for policy 1, policy_version 701359 (0.0006) [2023-12-28 00:16:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 358719488. Throughput: 0: 10089.8, 1: 9908.4. Samples: 358730100. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:51,175][105115] Avg episode reward: [(0, '-4.782'), (1, '-5.361')] [2023-12-28 00:16:51,193][106226] Updated weights for policy 0, policy_version 699550 (0.0009) [2023-12-28 00:16:51,269][106226] Updated weights for policy 0, policy_version 699560 (0.0008) [2023-12-28 00:16:51,337][106226] Updated weights for policy 0, policy_version 699570 (0.0006) [2023-12-28 00:16:51,625][106225] Updated weights for policy 1, policy_version 701369 (0.0006) [2023-12-28 00:16:51,689][106225] Updated weights for policy 1, policy_version 701379 (0.0007) [2023-12-28 00:16:51,762][106225] Updated weights for policy 1, policy_version 701389 (0.0009) [2023-12-28 00:16:51,813][106225] Updated weights for policy 1, policy_version 701399 (0.0007) [2023-12-28 00:16:52,081][106226] Updated weights for policy 0, policy_version 699580 (0.0010) [2023-12-28 00:16:52,149][106226] Updated weights for policy 0, policy_version 699590 (0.0011) [2023-12-28 00:16:52,215][106226] Updated weights for policy 0, policy_version 699600 (0.0010) [2023-12-28 00:16:52,558][106225] Updated weights for policy 1, policy_version 701409 (0.0006) [2023-12-28 00:16:52,609][106225] Updated weights for policy 1, policy_version 701419 (0.0008) [2023-12-28 00:16:52,660][106225] Updated weights for policy 1, policy_version 701429 (0.0008) [2023-12-28 00:16:52,929][106226] Updated weights for policy 0, policy_version 699610 (0.0011) [2023-12-28 00:16:52,982][106226] Updated weights for policy 0, policy_version 699620 (0.0010) [2023-12-28 00:16:53,039][106226] Updated weights for policy 0, policy_version 699630 (0.0011) [2023-12-28 00:16:53,096][106226] Updated weights for policy 0, policy_version 699640 (0.0010) [2023-12-28 00:16:53,342][106225] Updated weights for policy 1, policy_version 701439 (0.0007) [2023-12-28 00:16:53,385][106225] Updated weights for policy 1, policy_version 701449 (0.0008) [2023-12-28 00:16:53,444][106225] Updated weights for policy 1, policy_version 701459 (0.0008) [2023-12-28 00:16:53,819][106226] Updated weights for policy 0, policy_version 699650 (0.0007) [2023-12-28 00:16:53,872][106226] Updated weights for policy 0, policy_version 699660 (0.0005) [2023-12-28 00:16:53,925][106226] Updated weights for policy 0, policy_version 699670 (0.0005) [2023-12-28 00:16:54,170][106225] Updated weights for policy 1, policy_version 701469 (0.0007) [2023-12-28 00:16:54,238][106225] Updated weights for policy 1, policy_version 701479 (0.0005) [2023-12-28 00:16:54,303][106225] Updated weights for policy 1, policy_version 701489 (0.0010) [2023-12-28 00:16:54,454][106226] Updated weights for policy 0, policy_version 699680 (0.0005) [2023-12-28 00:16:54,515][106226] Updated weights for policy 0, policy_version 699690 (0.0008) [2023-12-28 00:16:54,565][106226] Updated weights for policy 0, policy_version 699700 (0.0010) [2023-12-28 00:16:54,939][106225] Updated weights for policy 1, policy_version 701499 (0.0009) [2023-12-28 00:16:55,012][106225] Updated weights for policy 1, policy_version 701509 (0.0010) [2023-12-28 00:16:55,077][106225] Updated weights for policy 1, policy_version 701519 (0.0010) [2023-12-28 00:16:55,189][106226] Updated weights for policy 0, policy_version 699710 (0.0011) [2023-12-28 00:16:55,249][106226] Updated weights for policy 0, policy_version 699720 (0.0010) [2023-12-28 00:16:55,320][106226] Updated weights for policy 0, policy_version 699730 (0.0011) [2023-12-28 00:16:55,683][106225] Updated weights for policy 1, policy_version 701529 (0.0010) [2023-12-28 00:16:55,740][106225] Updated weights for policy 1, policy_version 701539 (0.0005) [2023-12-28 00:16:55,791][106225] Updated weights for policy 1, policy_version 701549 (0.0006) [2023-12-28 00:16:55,838][106225] Updated weights for policy 1, policy_version 701559 (0.0010) [2023-12-28 00:16:55,938][106226] Updated weights for policy 0, policy_version 699740 (0.0008) [2023-12-28 00:16:56,004][106226] Updated weights for policy 0, policy_version 699750 (0.0005) [2023-12-28 00:16:56,069][106226] Updated weights for policy 0, policy_version 699760 (0.0009) [2023-12-28 00:16:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 358825984. Throughput: 0: 10074.5, 1: 9858.8. Samples: 358788084. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:16:56,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-5.767')] [2023-12-28 00:16:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000701560_179634176.pth... [2023-12-28 00:16:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000699768_179191808.pth... [2023-12-28 00:16:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000700408_179339264.pth [2023-12-28 00:16:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000698552_178880512.pth [2023-12-28 00:16:56,401][106225] Updated weights for policy 1, policy_version 701569 (0.0006) [2023-12-28 00:16:56,466][106225] Updated weights for policy 1, policy_version 701579 (0.0008) [2023-12-28 00:16:56,526][106225] Updated weights for policy 1, policy_version 701589 (0.0010) [2023-12-28 00:16:56,589][106226] Updated weights for policy 0, policy_version 699770 (0.0007) [2023-12-28 00:16:56,652][106226] Updated weights for policy 0, policy_version 699780 (0.0005) [2023-12-28 00:16:56,698][106226] Updated weights for policy 0, policy_version 699790 (0.0005) [2023-12-28 00:16:56,749][106226] Updated weights for policy 0, policy_version 699800 (0.0005) [2023-12-28 00:16:57,189][106225] Updated weights for policy 1, policy_version 701599 (0.0007) [2023-12-28 00:16:57,241][106225] Updated weights for policy 1, policy_version 701609 (0.0006) [2023-12-28 00:16:57,298][106225] Updated weights for policy 1, policy_version 701619 (0.0006) [2023-12-28 00:16:57,307][106226] Updated weights for policy 0, policy_version 699810 (0.0007) [2023-12-28 00:16:57,359][106226] Updated weights for policy 0, policy_version 699820 (0.0006) [2023-12-28 00:16:57,427][106226] Updated weights for policy 0, policy_version 699830 (0.0005) [2023-12-28 00:16:57,879][106225] Updated weights for policy 1, policy_version 701629 (0.0009) [2023-12-28 00:16:57,927][106225] Updated weights for policy 1, policy_version 701639 (0.0009) [2023-12-28 00:16:57,939][106226] Updated weights for policy 0, policy_version 699840 (0.0005) [2023-12-28 00:16:57,984][106225] Updated weights for policy 1, policy_version 701649 (0.0007) [2023-12-28 00:16:57,995][106226] Updated weights for policy 0, policy_version 699850 (0.0005) [2023-12-28 00:16:58,053][106226] Updated weights for policy 0, policy_version 699860 (0.0009) [2023-12-28 00:16:58,702][106225] Updated weights for policy 1, policy_version 701659 (0.0008) [2023-12-28 00:16:58,770][106225] Updated weights for policy 1, policy_version 701669 (0.0008) [2023-12-28 00:16:58,775][106226] Updated weights for policy 0, policy_version 699870 (0.0009) [2023-12-28 00:16:58,839][106225] Updated weights for policy 1, policy_version 701679 (0.0009) [2023-12-28 00:16:58,851][106226] Updated weights for policy 0, policy_version 699880 (0.0013) [2023-12-28 00:16:58,927][106226] Updated weights for policy 0, policy_version 699890 (0.0008) [2023-12-28 00:16:59,631][106225] Updated weights for policy 1, policy_version 701689 (0.0008) [2023-12-28 00:16:59,688][106225] Updated weights for policy 1, policy_version 701699 (0.0008) [2023-12-28 00:16:59,701][106226] Updated weights for policy 0, policy_version 699900 (0.0008) [2023-12-28 00:16:59,747][106225] Updated weights for policy 1, policy_version 701709 (0.0006) [2023-12-28 00:16:59,762][106226] Updated weights for policy 0, policy_version 699910 (0.0008) [2023-12-28 00:16:59,818][106225] Updated weights for policy 1, policy_version 701719 (0.0007) [2023-12-28 00:16:59,824][106226] Updated weights for policy 0, policy_version 699920 (0.0008) [2023-12-28 00:17:00,465][106225] Updated weights for policy 1, policy_version 701729 (0.0008) [2023-12-28 00:17:00,523][106225] Updated weights for policy 1, policy_version 701739 (0.0008) [2023-12-28 00:17:00,580][106225] Updated weights for policy 1, policy_version 701749 (0.0006) [2023-12-28 00:17:00,585][106226] Updated weights for policy 0, policy_version 699930 (0.0009) [2023-12-28 00:17:00,645][106226] Updated weights for policy 0, policy_version 699940 (0.0010) [2023-12-28 00:17:00,705][106226] Updated weights for policy 0, policy_version 699950 (0.0010) [2023-12-28 00:17:00,771][106226] Updated weights for policy 0, policy_version 699960 (0.0010) [2023-12-28 00:17:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 358924288. Throughput: 0: 10257.8, 1: 9923.0. Samples: 358915732. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:01,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-5.628')] [2023-12-28 00:17:01,321][106225] Updated weights for policy 1, policy_version 701759 (0.0009) [2023-12-28 00:17:01,390][106225] Updated weights for policy 1, policy_version 701769 (0.0007) [2023-12-28 00:17:01,453][106225] Updated weights for policy 1, policy_version 701779 (0.0010) [2023-12-28 00:17:01,471][106226] Updated weights for policy 0, policy_version 699970 (0.0006) [2023-12-28 00:17:01,532][106226] Updated weights for policy 0, policy_version 699980 (0.0006) [2023-12-28 00:17:01,602][106226] Updated weights for policy 0, policy_version 699990 (0.0006) [2023-12-28 00:17:02,153][106225] Updated weights for policy 1, policy_version 701789 (0.0009) [2023-12-28 00:17:02,211][106225] Updated weights for policy 1, policy_version 701799 (0.0007) [2023-12-28 00:17:02,269][106225] Updated weights for policy 1, policy_version 701809 (0.0007) [2023-12-28 00:17:02,281][106226] Updated weights for policy 0, policy_version 700000 (0.0008) [2023-12-28 00:17:02,353][106226] Updated weights for policy 0, policy_version 700010 (0.0010) [2023-12-28 00:17:02,411][106226] Updated weights for policy 0, policy_version 700020 (0.0011) [2023-12-28 00:17:03,033][106225] Updated weights for policy 1, policy_version 701819 (0.0010) [2023-12-28 00:17:03,079][106225] Updated weights for policy 1, policy_version 701829 (0.0010) [2023-12-28 00:17:03,091][106226] Updated weights for policy 0, policy_version 700030 (0.0007) [2023-12-28 00:17:03,128][106225] Updated weights for policy 1, policy_version 701839 (0.0010) [2023-12-28 00:17:03,141][106226] Updated weights for policy 0, policy_version 700040 (0.0005) [2023-12-28 00:17:03,196][106226] Updated weights for policy 0, policy_version 700050 (0.0005) [2023-12-28 00:17:03,721][106226] Updated weights for policy 0, policy_version 700060 (0.0007) [2023-12-28 00:17:03,739][106225] Updated weights for policy 1, policy_version 701849 (0.0010) [2023-12-28 00:17:03,777][106226] Updated weights for policy 0, policy_version 700070 (0.0010) [2023-12-28 00:17:03,786][106225] Updated weights for policy 1, policy_version 701859 (0.0010) [2023-12-28 00:17:03,824][106226] Updated weights for policy 0, policy_version 700080 (0.0010) [2023-12-28 00:17:03,843][106225] Updated weights for policy 1, policy_version 701869 (0.0010) [2023-12-28 00:17:03,904][106225] Updated weights for policy 1, policy_version 701879 (0.0009) [2023-12-28 00:17:04,460][106226] Updated weights for policy 0, policy_version 700090 (0.0010) [2023-12-28 00:17:04,517][106226] Updated weights for policy 0, policy_version 700100 (0.0006) [2023-12-28 00:17:04,577][106226] Updated weights for policy 0, policy_version 700110 (0.0008) [2023-12-28 00:17:04,635][106225] Updated weights for policy 1, policy_version 701889 (0.0007) [2023-12-28 00:17:04,638][106226] Updated weights for policy 0, policy_version 700120 (0.0006) [2023-12-28 00:17:04,698][106225] Updated weights for policy 1, policy_version 701899 (0.0008) [2023-12-28 00:17:04,763][106225] Updated weights for policy 1, policy_version 701909 (0.0008) [2023-12-28 00:17:05,334][106226] Updated weights for policy 0, policy_version 700130 (0.0005) [2023-12-28 00:17:05,391][106226] Updated weights for policy 0, policy_version 700140 (0.0005) [2023-12-28 00:17:05,444][106226] Updated weights for policy 0, policy_version 700150 (0.0005) [2023-12-28 00:17:05,464][106225] Updated weights for policy 1, policy_version 701919 (0.0008) [2023-12-28 00:17:05,516][106225] Updated weights for policy 1, policy_version 701929 (0.0008) [2023-12-28 00:17:05,579][106225] Updated weights for policy 1, policy_version 701939 (0.0008) [2023-12-28 00:17:05,977][106226] Updated weights for policy 0, policy_version 700160 (0.0005) [2023-12-28 00:17:06,037][106226] Updated weights for policy 0, policy_version 700170 (0.0005) [2023-12-28 00:17:06,084][106226] Updated weights for policy 0, policy_version 700180 (0.0006) [2023-12-28 00:17:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20206.9, 300 sec: 19938.5). Total num frames: 359030784. Throughput: 0: 10349.6, 1: 9936.4. Samples: 359038648. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:06,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.532')] [2023-12-28 00:17:06,395][106225] Updated weights for policy 1, policy_version 701949 (0.0009) [2023-12-28 00:17:06,456][106225] Updated weights for policy 1, policy_version 701959 (0.0008) [2023-12-28 00:17:06,516][106225] Updated weights for policy 1, policy_version 701969 (0.0007) [2023-12-28 00:17:06,786][106226] Updated weights for policy 0, policy_version 700190 (0.0010) [2023-12-28 00:17:06,849][106226] Updated weights for policy 0, policy_version 700200 (0.0007) [2023-12-28 00:17:06,898][106226] Updated weights for policy 0, policy_version 700210 (0.0008) [2023-12-28 00:17:07,307][106225] Updated weights for policy 1, policy_version 701979 (0.0010) [2023-12-28 00:17:07,378][106225] Updated weights for policy 1, policy_version 701989 (0.0010) [2023-12-28 00:17:07,442][106225] Updated weights for policy 1, policy_version 701999 (0.0009) [2023-12-28 00:17:07,459][106226] Updated weights for policy 0, policy_version 700220 (0.0007) [2023-12-28 00:17:07,513][106226] Updated weights for policy 0, policy_version 700230 (0.0006) [2023-12-28 00:17:07,579][106226] Updated weights for policy 0, policy_version 700240 (0.0008) [2023-12-28 00:17:08,177][106225] Updated weights for policy 1, policy_version 702009 (0.0010) [2023-12-28 00:17:08,223][106225] Updated weights for policy 1, policy_version 702019 (0.0010) [2023-12-28 00:17:08,267][106225] Updated weights for policy 1, policy_version 702029 (0.0010) [2023-12-28 00:17:08,304][106226] Updated weights for policy 0, policy_version 700250 (0.0007) [2023-12-28 00:17:08,318][106225] Updated weights for policy 1, policy_version 702039 (0.0010) [2023-12-28 00:17:08,367][106226] Updated weights for policy 0, policy_version 700260 (0.0007) [2023-12-28 00:17:08,429][106226] Updated weights for policy 0, policy_version 700270 (0.0008) [2023-12-28 00:17:08,490][106226] Updated weights for policy 0, policy_version 700280 (0.0008) [2023-12-28 00:17:09,124][106225] Updated weights for policy 1, policy_version 702049 (0.0007) [2023-12-28 00:17:09,151][106226] Updated weights for policy 0, policy_version 700290 (0.0006) [2023-12-28 00:17:09,177][106225] Updated weights for policy 1, policy_version 702059 (0.0007) [2023-12-28 00:17:09,222][106226] Updated weights for policy 0, policy_version 700300 (0.0008) [2023-12-28 00:17:09,237][106225] Updated weights for policy 1, policy_version 702069 (0.0007) [2023-12-28 00:17:09,294][106226] Updated weights for policy 0, policy_version 700310 (0.0008) [2023-12-28 00:17:09,940][106225] Updated weights for policy 1, policy_version 702079 (0.0008) [2023-12-28 00:17:10,000][106225] Updated weights for policy 1, policy_version 702089 (0.0009) [2023-12-28 00:17:10,063][106225] Updated weights for policy 1, policy_version 702099 (0.0008) [2023-12-28 00:17:10,073][106226] Updated weights for policy 0, policy_version 700320 (0.0008) [2023-12-28 00:17:10,138][106226] Updated weights for policy 0, policy_version 700330 (0.0009) [2023-12-28 00:17:10,205][106226] Updated weights for policy 0, policy_version 700340 (0.0007) [2023-12-28 00:17:10,773][106225] Updated weights for policy 1, policy_version 702109 (0.0008) [2023-12-28 00:17:10,831][106225] Updated weights for policy 1, policy_version 702119 (0.0009) [2023-12-28 00:17:10,893][106225] Updated weights for policy 1, policy_version 702129 (0.0008) [2023-12-28 00:17:10,929][106226] Updated weights for policy 0, policy_version 700350 (0.0007) [2023-12-28 00:17:10,985][106226] Updated weights for policy 0, policy_version 700360 (0.0008) [2023-12-28 00:17:11,053][106226] Updated weights for policy 0, policy_version 700370 (0.0009) [2023-12-28 00:17:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 359129088. Throughput: 0: 10389.8, 1: 9902.8. Samples: 359097100. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:11,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-5.616')] [2023-12-28 00:17:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000700376_179347456.pth... [2023-12-28 00:17:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000702136_179781632.pth... [2023-12-28 00:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000700984_179486720.pth [2023-12-28 00:17:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000699160_179036160.pth [2023-12-28 00:17:11,656][106225] Updated weights for policy 1, policy_version 702139 (0.0006) [2023-12-28 00:17:11,731][106225] Updated weights for policy 1, policy_version 702149 (0.0006) [2023-12-28 00:17:11,804][106225] Updated weights for policy 1, policy_version 702159 (0.0007) [2023-12-28 00:17:11,902][106226] Updated weights for policy 0, policy_version 700380 (0.0009) [2023-12-28 00:17:11,959][106226] Updated weights for policy 0, policy_version 700390 (0.0009) [2023-12-28 00:17:12,025][106226] Updated weights for policy 0, policy_version 700400 (0.0009) [2023-12-28 00:17:12,487][106225] Updated weights for policy 1, policy_version 702169 (0.0008) [2023-12-28 00:17:12,556][106225] Updated weights for policy 1, policy_version 702179 (0.0008) [2023-12-28 00:17:12,622][106225] Updated weights for policy 1, policy_version 702189 (0.0008) [2023-12-28 00:17:12,683][106225] Updated weights for policy 1, policy_version 702199 (0.0007) [2023-12-28 00:17:12,775][106226] Updated weights for policy 0, policy_version 700410 (0.0009) [2023-12-28 00:17:12,829][106226] Updated weights for policy 0, policy_version 700420 (0.0008) [2023-12-28 00:17:12,897][106226] Updated weights for policy 0, policy_version 700430 (0.0010) [2023-12-28 00:17:12,955][106226] Updated weights for policy 0, policy_version 700440 (0.0009) [2023-12-28 00:17:13,322][106225] Updated weights for policy 1, policy_version 702209 (0.0005) [2023-12-28 00:17:13,381][106225] Updated weights for policy 1, policy_version 702219 (0.0005) [2023-12-28 00:17:13,444][106225] Updated weights for policy 1, policy_version 702229 (0.0006) [2023-12-28 00:17:13,718][106226] Updated weights for policy 0, policy_version 700450 (0.0008) [2023-12-28 00:17:13,765][106226] Updated weights for policy 0, policy_version 700460 (0.0008) [2023-12-28 00:17:13,815][106226] Updated weights for policy 0, policy_version 700470 (0.0009) [2023-12-28 00:17:14,044][106225] Updated weights for policy 1, policy_version 702239 (0.0008) [2023-12-28 00:17:14,089][106225] Updated weights for policy 1, policy_version 702249 (0.0008) [2023-12-28 00:17:14,144][106225] Updated weights for policy 1, policy_version 702259 (0.0008) [2023-12-28 00:17:14,653][106226] Updated weights for policy 0, policy_version 700480 (0.0008) [2023-12-28 00:17:14,705][106226] Updated weights for policy 0, policy_version 700490 (0.0008) [2023-12-28 00:17:14,748][106225] Updated weights for policy 1, policy_version 702269 (0.0006) [2023-12-28 00:17:14,772][106226] Updated weights for policy 0, policy_version 700500 (0.0008) [2023-12-28 00:17:14,816][106225] Updated weights for policy 1, policy_version 702279 (0.0007) [2023-12-28 00:17:14,880][106225] Updated weights for policy 1, policy_version 702289 (0.0009) [2023-12-28 00:17:15,519][106226] Updated weights for policy 0, policy_version 700510 (0.0007) [2023-12-28 00:17:15,575][106226] Updated weights for policy 0, policy_version 700520 (0.0008) [2023-12-28 00:17:15,628][106226] Updated weights for policy 0, policy_version 700530 (0.0006) [2023-12-28 00:17:15,628][106225] Updated weights for policy 1, policy_version 702299 (0.0009) [2023-12-28 00:17:15,690][106225] Updated weights for policy 1, policy_version 702309 (0.0008) [2023-12-28 00:17:15,747][106225] Updated weights for policy 1, policy_version 702319 (0.0008) [2023-12-28 00:17:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 359219200. Throughput: 0: 10114.0, 1: 9855.0. Samples: 359211404. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:16,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-5.862')] [2023-12-28 00:17:16,257][106226] Updated weights for policy 0, policy_version 700540 (0.0007) [2023-12-28 00:17:16,302][106226] Updated weights for policy 0, policy_version 700550 (0.0006) [2023-12-28 00:17:16,379][106226] Updated weights for policy 0, policy_version 700560 (0.0007) [2023-12-28 00:17:16,438][106225] Updated weights for policy 1, policy_version 702329 (0.0008) [2023-12-28 00:17:16,497][106225] Updated weights for policy 1, policy_version 702339 (0.0008) [2023-12-28 00:17:16,552][106225] Updated weights for policy 1, policy_version 702349 (0.0007) [2023-12-28 00:17:16,609][106225] Updated weights for policy 1, policy_version 702359 (0.0008) [2023-12-28 00:17:17,068][106226] Updated weights for policy 0, policy_version 700570 (0.0011) [2023-12-28 00:17:17,119][106226] Updated weights for policy 0, policy_version 700580 (0.0011) [2023-12-28 00:17:17,179][106226] Updated weights for policy 0, policy_version 700590 (0.0011) [2023-12-28 00:17:17,237][106226] Updated weights for policy 0, policy_version 700600 (0.0011) [2023-12-28 00:17:17,319][106225] Updated weights for policy 1, policy_version 702369 (0.0008) [2023-12-28 00:17:17,375][106225] Updated weights for policy 1, policy_version 702379 (0.0007) [2023-12-28 00:17:17,435][106225] Updated weights for policy 1, policy_version 702389 (0.0008) [2023-12-28 00:17:17,915][106226] Updated weights for policy 0, policy_version 700610 (0.0011) [2023-12-28 00:17:17,970][106226] Updated weights for policy 0, policy_version 700620 (0.0009) [2023-12-28 00:17:18,027][106226] Updated weights for policy 0, policy_version 700630 (0.0006) [2023-12-28 00:17:18,192][106225] Updated weights for policy 1, policy_version 702399 (0.0008) [2023-12-28 00:17:18,244][106225] Updated weights for policy 1, policy_version 702409 (0.0009) [2023-12-28 00:17:18,296][106225] Updated weights for policy 1, policy_version 702419 (0.0008) [2023-12-28 00:17:18,712][106226] Updated weights for policy 0, policy_version 700640 (0.0010) [2023-12-28 00:17:18,767][106226] Updated weights for policy 0, policy_version 700650 (0.0011) [2023-12-28 00:17:18,825][106226] Updated weights for policy 0, policy_version 700660 (0.0011) [2023-12-28 00:17:19,018][106225] Updated weights for policy 1, policy_version 702429 (0.0008) [2023-12-28 00:17:19,072][106225] Updated weights for policy 1, policy_version 702439 (0.0008) [2023-12-28 00:17:19,126][106225] Updated weights for policy 1, policy_version 702449 (0.0008) [2023-12-28 00:17:19,553][106226] Updated weights for policy 0, policy_version 700670 (0.0008) [2023-12-28 00:17:19,612][106226] Updated weights for policy 0, policy_version 700680 (0.0006) [2023-12-28 00:17:19,679][106226] Updated weights for policy 0, policy_version 700690 (0.0007) [2023-12-28 00:17:19,977][106225] Updated weights for policy 1, policy_version 702459 (0.0008) [2023-12-28 00:17:20,049][106225] Updated weights for policy 1, policy_version 702469 (0.0008) [2023-12-28 00:17:20,101][106225] Updated weights for policy 1, policy_version 702479 (0.0007) [2023-12-28 00:17:20,392][106226] Updated weights for policy 0, policy_version 700700 (0.0009) [2023-12-28 00:17:20,461][106226] Updated weights for policy 0, policy_version 700710 (0.0011) [2023-12-28 00:17:20,529][106226] Updated weights for policy 0, policy_version 700720 (0.0009) [2023-12-28 00:17:20,780][106225] Updated weights for policy 1, policy_version 702489 (0.0007) [2023-12-28 00:17:20,844][106225] Updated weights for policy 1, policy_version 702499 (0.0008) [2023-12-28 00:17:20,903][106225] Updated weights for policy 1, policy_version 702509 (0.0008) [2023-12-28 00:17:20,956][106225] Updated weights for policy 1, policy_version 702519 (0.0007) [2023-12-28 00:17:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 359317504. Throughput: 0: 10087.4, 1: 9861.9. Samples: 359327508. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:21,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.585')] [2023-12-28 00:17:21,247][106226] Updated weights for policy 0, policy_version 700730 (0.0011) [2023-12-28 00:17:21,302][106226] Updated weights for policy 0, policy_version 700740 (0.0011) [2023-12-28 00:17:21,360][106226] Updated weights for policy 0, policy_version 700750 (0.0010) [2023-12-28 00:17:21,425][106226] Updated weights for policy 0, policy_version 700760 (0.0008) [2023-12-28 00:17:21,743][106225] Updated weights for policy 1, policy_version 702529 (0.0008) [2023-12-28 00:17:21,801][106225] Updated weights for policy 1, policy_version 702539 (0.0007) [2023-12-28 00:17:21,864][106225] Updated weights for policy 1, policy_version 702549 (0.0008) [2023-12-28 00:17:22,129][106226] Updated weights for policy 0, policy_version 700770 (0.0007) [2023-12-28 00:17:22,196][106226] Updated weights for policy 0, policy_version 700780 (0.0009) [2023-12-28 00:17:22,259][106226] Updated weights for policy 0, policy_version 700790 (0.0009) [2023-12-28 00:17:22,654][106225] Updated weights for policy 1, policy_version 702559 (0.0008) [2023-12-28 00:17:22,721][106225] Updated weights for policy 1, policy_version 702569 (0.0007) [2023-12-28 00:17:22,788][106225] Updated weights for policy 1, policy_version 702579 (0.0008) [2023-12-28 00:17:23,035][106226] Updated weights for policy 0, policy_version 700800 (0.0008) [2023-12-28 00:17:23,100][106226] Updated weights for policy 0, policy_version 700810 (0.0009) [2023-12-28 00:17:23,160][106226] Updated weights for policy 0, policy_version 700820 (0.0008) [2023-12-28 00:17:23,444][106225] Updated weights for policy 1, policy_version 702589 (0.0008) [2023-12-28 00:17:23,502][106225] Updated weights for policy 1, policy_version 702599 (0.0008) [2023-12-28 00:17:23,565][106225] Updated weights for policy 1, policy_version 702609 (0.0009) [2023-12-28 00:17:23,834][106226] Updated weights for policy 0, policy_version 700830 (0.0010) [2023-12-28 00:17:23,883][106226] Updated weights for policy 0, policy_version 700840 (0.0010) [2023-12-28 00:17:23,936][106226] Updated weights for policy 0, policy_version 700850 (0.0010) [2023-12-28 00:17:24,289][106225] Updated weights for policy 1, policy_version 702619 (0.0009) [2023-12-28 00:17:24,348][106225] Updated weights for policy 1, policy_version 702629 (0.0010) [2023-12-28 00:17:24,415][106225] Updated weights for policy 1, policy_version 702639 (0.0010) [2023-12-28 00:17:24,600][106226] Updated weights for policy 0, policy_version 700860 (0.0011) [2023-12-28 00:17:24,652][106226] Updated weights for policy 0, policy_version 700870 (0.0010) [2023-12-28 00:17:24,708][106226] Updated weights for policy 0, policy_version 700880 (0.0005) [2023-12-28 00:17:25,058][106225] Updated weights for policy 1, policy_version 702649 (0.0010) [2023-12-28 00:17:25,123][106225] Updated weights for policy 1, policy_version 702659 (0.0010) [2023-12-28 00:17:25,175][106225] Updated weights for policy 1, policy_version 702669 (0.0010) [2023-12-28 00:17:25,228][106225] Updated weights for policy 1, policy_version 702679 (0.0010) [2023-12-28 00:17:25,376][106226] Updated weights for policy 0, policy_version 700890 (0.0006) [2023-12-28 00:17:25,437][106226] Updated weights for policy 0, policy_version 700900 (0.0011) [2023-12-28 00:17:25,493][106226] Updated weights for policy 0, policy_version 700910 (0.0010) [2023-12-28 00:17:25,545][106226] Updated weights for policy 0, policy_version 700920 (0.0010) [2023-12-28 00:17:25,925][106225] Updated weights for policy 1, policy_version 702689 (0.0007) [2023-12-28 00:17:25,982][106225] Updated weights for policy 1, policy_version 702699 (0.0009) [2023-12-28 00:17:26,041][106225] Updated weights for policy 1, policy_version 702709 (0.0008) [2023-12-28 00:17:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 359415808. Throughput: 0: 10047.6, 1: 9811.2. Samples: 359383740. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:26,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.924')] [2023-12-28 00:17:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000702712_179929088.pth... [2023-12-28 00:17:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000701560_179634176.pth [2023-12-28 00:17:26,244][106226] Updated weights for policy 0, policy_version 700930 (0.0008) [2023-12-28 00:17:26,306][106226] Updated weights for policy 0, policy_version 700940 (0.0007) [2023-12-28 00:17:26,363][106226] Updated weights for policy 0, policy_version 700950 (0.0006) [2023-12-28 00:17:26,374][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000700952_179494912.pth... [2023-12-28 00:17:26,378][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000699768_179191808.pth [2023-12-28 00:17:26,691][106225] Updated weights for policy 1, policy_version 702719 (0.0010) [2023-12-28 00:17:26,754][106225] Updated weights for policy 1, policy_version 702729 (0.0010) [2023-12-28 00:17:26,815][106225] Updated weights for policy 1, policy_version 702739 (0.0007) [2023-12-28 00:17:27,046][106226] Updated weights for policy 0, policy_version 700960 (0.0009) [2023-12-28 00:17:27,106][106226] Updated weights for policy 0, policy_version 700970 (0.0010) [2023-12-28 00:17:27,149][106226] Updated weights for policy 0, policy_version 700980 (0.0010) [2023-12-28 00:17:27,451][106225] Updated weights for policy 1, policy_version 702749 (0.0008) [2023-12-28 00:17:27,498][106225] Updated weights for policy 1, policy_version 702759 (0.0010) [2023-12-28 00:17:27,557][106225] Updated weights for policy 1, policy_version 702769 (0.0010) [2023-12-28 00:17:27,876][106226] Updated weights for policy 0, policy_version 700990 (0.0009) [2023-12-28 00:17:27,933][106226] Updated weights for policy 0, policy_version 701000 (0.0008) [2023-12-28 00:17:28,019][106226] Updated weights for policy 0, policy_version 701010 (0.0008) [2023-12-28 00:17:28,271][106225] Updated weights for policy 1, policy_version 702779 (0.0010) [2023-12-28 00:17:28,330][106225] Updated weights for policy 1, policy_version 702789 (0.0012) [2023-12-28 00:17:28,394][106225] Updated weights for policy 1, policy_version 702799 (0.0008) [2023-12-28 00:17:28,650][106226] Updated weights for policy 0, policy_version 701020 (0.0007) [2023-12-28 00:17:28,707][106226] Updated weights for policy 0, policy_version 701030 (0.0010) [2023-12-28 00:17:28,754][106226] Updated weights for policy 0, policy_version 701040 (0.0010) [2023-12-28 00:17:29,105][106225] Updated weights for policy 1, policy_version 702809 (0.0008) [2023-12-28 00:17:29,164][106225] Updated weights for policy 1, policy_version 702819 (0.0007) [2023-12-28 00:17:29,223][106225] Updated weights for policy 1, policy_version 702829 (0.0008) [2023-12-28 00:17:29,286][106225] Updated weights for policy 1, policy_version 702839 (0.0007) [2023-12-28 00:17:29,462][106226] Updated weights for policy 0, policy_version 701050 (0.0009) [2023-12-28 00:17:29,515][106226] Updated weights for policy 0, policy_version 701060 (0.0010) [2023-12-28 00:17:29,575][106226] Updated weights for policy 0, policy_version 701070 (0.0010) [2023-12-28 00:17:29,631][106226] Updated weights for policy 0, policy_version 701080 (0.0010) [2023-12-28 00:17:29,986][106225] Updated weights for policy 1, policy_version 702849 (0.0008) [2023-12-28 00:17:30,046][106225] Updated weights for policy 1, policy_version 702859 (0.0008) [2023-12-28 00:17:30,111][106225] Updated weights for policy 1, policy_version 702869 (0.0008) [2023-12-28 00:17:30,372][106226] Updated weights for policy 0, policy_version 701090 (0.0007) [2023-12-28 00:17:30,426][106226] Updated weights for policy 0, policy_version 701100 (0.0005) [2023-12-28 00:17:30,481][106226] Updated weights for policy 0, policy_version 701110 (0.0006) [2023-12-28 00:17:30,731][106225] Updated weights for policy 1, policy_version 702879 (0.0010) [2023-12-28 00:17:30,775][106225] Updated weights for policy 1, policy_version 702889 (0.0007) [2023-12-28 00:17:30,824][106225] Updated weights for policy 1, policy_version 702899 (0.0010) [2023-12-28 00:17:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 359514112. Throughput: 0: 10019.0, 1: 9889.5. Samples: 359505196. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:31,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.762')] [2023-12-28 00:17:31,265][106226] Updated weights for policy 0, policy_version 701120 (0.0008) [2023-12-28 00:17:31,324][106226] Updated weights for policy 0, policy_version 701130 (0.0009) [2023-12-28 00:17:31,391][106226] Updated weights for policy 0, policy_version 701140 (0.0008) [2023-12-28 00:17:31,505][106225] Updated weights for policy 1, policy_version 702909 (0.0010) [2023-12-28 00:17:31,557][106225] Updated weights for policy 1, policy_version 702919 (0.0009) [2023-12-28 00:17:31,612][106225] Updated weights for policy 1, policy_version 702929 (0.0010) [2023-12-28 00:17:32,080][106226] Updated weights for policy 0, policy_version 701150 (0.0007) [2023-12-28 00:17:32,141][106226] Updated weights for policy 0, policy_version 701160 (0.0006) [2023-12-28 00:17:32,212][106226] Updated weights for policy 0, policy_version 701170 (0.0005) [2023-12-28 00:17:32,299][106225] Updated weights for policy 1, policy_version 702939 (0.0008) [2023-12-28 00:17:32,381][106225] Updated weights for policy 1, policy_version 702949 (0.0007) [2023-12-28 00:17:32,448][106225] Updated weights for policy 1, policy_version 702959 (0.0005) [2023-12-28 00:17:32,879][106226] Updated weights for policy 0, policy_version 701180 (0.0007) [2023-12-28 00:17:32,947][106226] Updated weights for policy 0, policy_version 701190 (0.0007) [2023-12-28 00:17:33,014][106226] Updated weights for policy 0, policy_version 701200 (0.0009) [2023-12-28 00:17:33,098][106225] Updated weights for policy 1, policy_version 702969 (0.0007) [2023-12-28 00:17:33,150][106225] Updated weights for policy 1, policy_version 702979 (0.0009) [2023-12-28 00:17:33,204][106225] Updated weights for policy 1, policy_version 702989 (0.0009) [2023-12-28 00:17:33,258][106225] Updated weights for policy 1, policy_version 702999 (0.0009) [2023-12-28 00:17:33,690][106226] Updated weights for policy 0, policy_version 701210 (0.0008) [2023-12-28 00:17:33,741][106226] Updated weights for policy 0, policy_version 701220 (0.0008) [2023-12-28 00:17:33,789][106226] Updated weights for policy 0, policy_version 701230 (0.0007) [2023-12-28 00:17:33,847][106226] Updated weights for policy 0, policy_version 701240 (0.0006) [2023-12-28 00:17:33,962][106225] Updated weights for policy 1, policy_version 703009 (0.0005) [2023-12-28 00:17:34,024][106225] Updated weights for policy 1, policy_version 703019 (0.0005) [2023-12-28 00:17:34,071][106225] Updated weights for policy 1, policy_version 703029 (0.0005) [2023-12-28 00:17:34,458][106226] Updated weights for policy 0, policy_version 701250 (0.0007) [2023-12-28 00:17:34,513][106226] Updated weights for policy 0, policy_version 701260 (0.0008) [2023-12-28 00:17:34,564][106226] Updated weights for policy 0, policy_version 701270 (0.0008) [2023-12-28 00:17:34,732][106225] Updated weights for policy 1, policy_version 703039 (0.0007) [2023-12-28 00:17:34,790][106225] Updated weights for policy 1, policy_version 703049 (0.0010) [2023-12-28 00:17:34,851][106225] Updated weights for policy 1, policy_version 703059 (0.0010) [2023-12-28 00:17:35,286][106226] Updated weights for policy 0, policy_version 701280 (0.0007) [2023-12-28 00:17:35,335][106226] Updated weights for policy 0, policy_version 701290 (0.0007) [2023-12-28 00:17:35,383][106226] Updated weights for policy 0, policy_version 701300 (0.0008) [2023-12-28 00:17:35,564][106225] Updated weights for policy 1, policy_version 703069 (0.0010) [2023-12-28 00:17:35,610][106225] Updated weights for policy 1, policy_version 703079 (0.0010) [2023-12-28 00:17:35,656][106225] Updated weights for policy 1, policy_version 703089 (0.0010) [2023-12-28 00:17:36,139][106226] Updated weights for policy 0, policy_version 701310 (0.0008) [2023-12-28 00:17:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 359612416. Throughput: 0: 10038.7, 1: 9868.0. Samples: 359625904. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:36,175][105115] Avg episode reward: [(0, '-4.225'), (1, '-5.309')] [2023-12-28 00:17:36,199][106226] Updated weights for policy 0, policy_version 701320 (0.0008) [2023-12-28 00:17:36,262][106226] Updated weights for policy 0, policy_version 701330 (0.0007) [2023-12-28 00:17:36,416][106225] Updated weights for policy 1, policy_version 703099 (0.0010) [2023-12-28 00:17:36,478][106225] Updated weights for policy 1, policy_version 703109 (0.0011) [2023-12-28 00:17:36,537][106225] Updated weights for policy 1, policy_version 703119 (0.0010) [2023-12-28 00:17:36,983][106226] Updated weights for policy 0, policy_version 701340 (0.0007) [2023-12-28 00:17:37,035][106226] Updated weights for policy 0, policy_version 701350 (0.0005) [2023-12-28 00:17:37,086][106226] Updated weights for policy 0, policy_version 701360 (0.0005) [2023-12-28 00:17:37,194][106225] Updated weights for policy 1, policy_version 703129 (0.0006) [2023-12-28 00:17:37,252][106225] Updated weights for policy 1, policy_version 703139 (0.0010) [2023-12-28 00:17:37,305][106225] Updated weights for policy 1, policy_version 703149 (0.0009) [2023-12-28 00:17:37,363][106225] Updated weights for policy 1, policy_version 703159 (0.0010) [2023-12-28 00:17:37,716][106226] Updated weights for policy 0, policy_version 701370 (0.0006) [2023-12-28 00:17:37,765][106226] Updated weights for policy 0, policy_version 701380 (0.0007) [2023-12-28 00:17:37,823][106226] Updated weights for policy 0, policy_version 701390 (0.0008) [2023-12-28 00:17:37,884][106226] Updated weights for policy 0, policy_version 701400 (0.0008) [2023-12-28 00:17:38,065][106225] Updated weights for policy 1, policy_version 703169 (0.0010) [2023-12-28 00:17:38,113][106225] Updated weights for policy 1, policy_version 703179 (0.0010) [2023-12-28 00:17:38,159][106225] Updated weights for policy 1, policy_version 703189 (0.0010) [2023-12-28 00:17:38,518][106226] Updated weights for policy 0, policy_version 701410 (0.0008) [2023-12-28 00:17:38,574][106226] Updated weights for policy 0, policy_version 701420 (0.0008) [2023-12-28 00:17:38,624][106226] Updated weights for policy 0, policy_version 701430 (0.0008) [2023-12-28 00:17:38,930][106225] Updated weights for policy 1, policy_version 703199 (0.0010) [2023-12-28 00:17:38,980][106225] Updated weights for policy 1, policy_version 703209 (0.0010) [2023-12-28 00:17:39,034][106225] Updated weights for policy 1, policy_version 703219 (0.0010) [2023-12-28 00:17:39,299][106226] Updated weights for policy 0, policy_version 701440 (0.0008) [2023-12-28 00:17:39,360][106226] Updated weights for policy 0, policy_version 701450 (0.0009) [2023-12-28 00:17:39,430][106226] Updated weights for policy 0, policy_version 701460 (0.0008) [2023-12-28 00:17:39,858][106225] Updated weights for policy 1, policy_version 703229 (0.0009) [2023-12-28 00:17:39,924][106225] Updated weights for policy 1, policy_version 703239 (0.0007) [2023-12-28 00:17:39,988][106225] Updated weights for policy 1, policy_version 703249 (0.0006) [2023-12-28 00:17:40,168][106226] Updated weights for policy 0, policy_version 701470 (0.0008) [2023-12-28 00:17:40,221][106226] Updated weights for policy 0, policy_version 701480 (0.0008) [2023-12-28 00:17:40,285][106226] Updated weights for policy 0, policy_version 701490 (0.0009) [2023-12-28 00:17:40,664][106225] Updated weights for policy 1, policy_version 703259 (0.0007) [2023-12-28 00:17:40,719][106225] Updated weights for policy 1, policy_version 703269 (0.0009) [2023-12-28 00:17:40,776][106225] Updated weights for policy 1, policy_version 703279 (0.0006) [2023-12-28 00:17:40,919][106226] Updated weights for policy 0, policy_version 701500 (0.0009) [2023-12-28 00:17:40,977][106226] Updated weights for policy 0, policy_version 701510 (0.0008) [2023-12-28 00:17:41,050][106226] Updated weights for policy 0, policy_version 701520 (0.0006) [2023-12-28 00:17:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 359718912. Throughput: 0: 10084.9, 1: 9882.7. Samples: 359686624. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:41,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-5.304')] [2023-12-28 00:17:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000703288_180076544.pth... [2023-12-28 00:17:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000701528_179642368.pth... [2023-12-28 00:17:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000700376_179347456.pth [2023-12-28 00:17:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000702136_179781632.pth [2023-12-28 00:17:41,604][106225] Updated weights for policy 1, policy_version 703289 (0.0009) [2023-12-28 00:17:41,667][106225] Updated weights for policy 1, policy_version 703299 (0.0008) [2023-12-28 00:17:41,732][106225] Updated weights for policy 1, policy_version 703309 (0.0008) [2023-12-28 00:17:41,794][106226] Updated weights for policy 0, policy_version 701530 (0.0008) [2023-12-28 00:17:41,800][106225] Updated weights for policy 1, policy_version 703319 (0.0009) [2023-12-28 00:17:41,853][106226] Updated weights for policy 0, policy_version 701540 (0.0006) [2023-12-28 00:17:41,912][106226] Updated weights for policy 0, policy_version 701550 (0.0007) [2023-12-28 00:17:41,968][106226] Updated weights for policy 0, policy_version 701560 (0.0007) [2023-12-28 00:17:42,600][106226] Updated weights for policy 0, policy_version 701570 (0.0009) [2023-12-28 00:17:42,618][106225] Updated weights for policy 1, policy_version 703329 (0.0006) [2023-12-28 00:17:42,660][106226] Updated weights for policy 0, policy_version 701580 (0.0006) [2023-12-28 00:17:42,678][106225] Updated weights for policy 1, policy_version 703339 (0.0006) [2023-12-28 00:17:42,723][106226] Updated weights for policy 0, policy_version 701590 (0.0007) [2023-12-28 00:17:42,739][106225] Updated weights for policy 1, policy_version 703349 (0.0008) [2023-12-28 00:17:43,341][106226] Updated weights for policy 0, policy_version 701600 (0.0005) [2023-12-28 00:17:43,389][106226] Updated weights for policy 0, policy_version 701610 (0.0005) [2023-12-28 00:17:43,442][106226] Updated weights for policy 0, policy_version 701620 (0.0008) [2023-12-28 00:17:43,500][106225] Updated weights for policy 1, policy_version 703359 (0.0007) [2023-12-28 00:17:43,564][106225] Updated weights for policy 1, policy_version 703369 (0.0010) [2023-12-28 00:17:43,622][106225] Updated weights for policy 1, policy_version 703379 (0.0008) [2023-12-28 00:17:44,030][106226] Updated weights for policy 0, policy_version 701630 (0.0009) [2023-12-28 00:17:44,076][106226] Updated weights for policy 0, policy_version 701640 (0.0009) [2023-12-28 00:17:44,127][106226] Updated weights for policy 0, policy_version 701650 (0.0009) [2023-12-28 00:17:44,393][106225] Updated weights for policy 1, policy_version 703389 (0.0008) [2023-12-28 00:17:44,451][106225] Updated weights for policy 1, policy_version 703399 (0.0008) [2023-12-28 00:17:44,506][106225] Updated weights for policy 1, policy_version 703409 (0.0008) [2023-12-28 00:17:44,869][106226] Updated weights for policy 0, policy_version 701660 (0.0009) [2023-12-28 00:17:44,927][106226] Updated weights for policy 0, policy_version 701670 (0.0009) [2023-12-28 00:17:44,981][106226] Updated weights for policy 0, policy_version 701680 (0.0009) [2023-12-28 00:17:45,278][106225] Updated weights for policy 1, policy_version 703419 (0.0009) [2023-12-28 00:17:45,330][106225] Updated weights for policy 1, policy_version 703429 (0.0009) [2023-12-28 00:17:45,381][106225] Updated weights for policy 1, policy_version 703439 (0.0009) [2023-12-28 00:17:45,794][106226] Updated weights for policy 0, policy_version 701690 (0.0010) [2023-12-28 00:17:45,843][106226] Updated weights for policy 0, policy_version 701700 (0.0008) [2023-12-28 00:17:45,892][106226] Updated weights for policy 0, policy_version 701710 (0.0008) [2023-12-28 00:17:45,951][106226] Updated weights for policy 0, policy_version 701720 (0.0009) [2023-12-28 00:17:45,993][106225] Updated weights for policy 1, policy_version 703449 (0.0007) [2023-12-28 00:17:46,044][106225] Updated weights for policy 1, policy_version 703459 (0.0005) [2023-12-28 00:17:46,095][106225] Updated weights for policy 1, policy_version 703469 (0.0005) [2023-12-28 00:17:46,166][106225] Updated weights for policy 1, policy_version 703479 (0.0006) [2023-12-28 00:17:46,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 359817216. Throughput: 0: 9986.5, 1: 9688.4. Samples: 359801108. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:46,176][105115] Avg episode reward: [(0, '-4.135'), (1, '-5.738')] [2023-12-28 00:17:46,677][106225] Updated weights for policy 1, policy_version 703489 (0.0008) [2023-12-28 00:17:46,733][106225] Updated weights for policy 1, policy_version 703499 (0.0009) [2023-12-28 00:17:46,782][106225] Updated weights for policy 1, policy_version 703509 (0.0006) [2023-12-28 00:17:46,811][106226] Updated weights for policy 0, policy_version 701730 (0.0008) [2023-12-28 00:17:46,866][106226] Updated weights for policy 0, policy_version 701740 (0.0009) [2023-12-28 00:17:46,922][106226] Updated weights for policy 0, policy_version 701750 (0.0009) [2023-12-28 00:17:47,538][106225] Updated weights for policy 1, policy_version 703519 (0.0008) [2023-12-28 00:17:47,593][106225] Updated weights for policy 1, policy_version 703529 (0.0008) [2023-12-28 00:17:47,630][106226] Updated weights for policy 0, policy_version 701760 (0.0008) [2023-12-28 00:17:47,654][106225] Updated weights for policy 1, policy_version 703539 (0.0006) [2023-12-28 00:17:47,687][106226] Updated weights for policy 0, policy_version 701770 (0.0007) [2023-12-28 00:17:47,734][106226] Updated weights for policy 0, policy_version 701780 (0.0009) [2023-12-28 00:17:48,340][106226] Updated weights for policy 0, policy_version 701790 (0.0009) [2023-12-28 00:17:48,405][106226] Updated weights for policy 0, policy_version 701800 (0.0008) [2023-12-28 00:17:48,422][106225] Updated weights for policy 1, policy_version 703549 (0.0007) [2023-12-28 00:17:48,468][106226] Updated weights for policy 0, policy_version 701810 (0.0008) [2023-12-28 00:17:48,481][106225] Updated weights for policy 1, policy_version 703559 (0.0007) [2023-12-28 00:17:48,538][106225] Updated weights for policy 1, policy_version 703569 (0.0008) [2023-12-28 00:17:49,154][106225] Updated weights for policy 1, policy_version 703579 (0.0007) [2023-12-28 00:17:49,206][106225] Updated weights for policy 1, policy_version 703589 (0.0006) [2023-12-28 00:17:49,233][106226] Updated weights for policy 0, policy_version 701820 (0.0007) [2023-12-28 00:17:49,274][106225] Updated weights for policy 1, policy_version 703599 (0.0007) [2023-12-28 00:17:49,292][106226] Updated weights for policy 0, policy_version 701830 (0.0006) [2023-12-28 00:17:49,357][106226] Updated weights for policy 0, policy_version 701840 (0.0008) [2023-12-28 00:17:50,005][106225] Updated weights for policy 1, policy_version 703609 (0.0007) [2023-12-28 00:17:50,058][106225] Updated weights for policy 1, policy_version 703619 (0.0009) [2023-12-28 00:17:50,098][106226] Updated weights for policy 0, policy_version 701850 (0.0008) [2023-12-28 00:17:50,114][106225] Updated weights for policy 1, policy_version 703629 (0.0007) [2023-12-28 00:17:50,156][106226] Updated weights for policy 0, policy_version 701860 (0.0006) [2023-12-28 00:17:50,167][106225] Updated weights for policy 1, policy_version 703639 (0.0007) [2023-12-28 00:17:50,222][106226] Updated weights for policy 0, policy_version 701870 (0.0009) [2023-12-28 00:17:50,286][106226] Updated weights for policy 0, policy_version 701880 (0.0008) [2023-12-28 00:17:50,855][106225] Updated weights for policy 1, policy_version 703649 (0.0010) [2023-12-28 00:17:50,918][106225] Updated weights for policy 1, policy_version 703659 (0.0010) [2023-12-28 00:17:50,924][106226] Updated weights for policy 0, policy_version 701890 (0.0010) [2023-12-28 00:17:50,980][106225] Updated weights for policy 1, policy_version 703669 (0.0011) [2023-12-28 00:17:50,986][106226] Updated weights for policy 0, policy_version 701900 (0.0011) [2023-12-28 00:17:51,054][106226] Updated weights for policy 0, policy_version 701910 (0.0010) [2023-12-28 00:17:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 359915520. Throughput: 0: 9839.1, 1: 9748.7. Samples: 359920100. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:51,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-5.389')] [2023-12-28 00:17:51,677][106226] Updated weights for policy 0, policy_version 701920 (0.0008) [2023-12-28 00:17:51,751][106226] Updated weights for policy 0, policy_version 701930 (0.0009) [2023-12-28 00:17:51,802][106225] Updated weights for policy 1, policy_version 703679 (0.0008) [2023-12-28 00:17:51,816][106226] Updated weights for policy 0, policy_version 701940 (0.0009) [2023-12-28 00:17:51,866][106225] Updated weights for policy 1, policy_version 703689 (0.0007) [2023-12-28 00:17:51,928][106225] Updated weights for policy 1, policy_version 703699 (0.0009) [2023-12-28 00:17:52,505][106226] Updated weights for policy 0, policy_version 701950 (0.0010) [2023-12-28 00:17:52,557][106226] Updated weights for policy 0, policy_version 701960 (0.0008) [2023-12-28 00:17:52,607][106226] Updated weights for policy 0, policy_version 701970 (0.0010) [2023-12-28 00:17:52,671][106225] Updated weights for policy 1, policy_version 703709 (0.0008) [2023-12-28 00:17:52,727][106225] Updated weights for policy 1, policy_version 703719 (0.0005) [2023-12-28 00:17:52,780][106225] Updated weights for policy 1, policy_version 703729 (0.0005) [2023-12-28 00:17:53,305][106226] Updated weights for policy 0, policy_version 701980 (0.0011) [2023-12-28 00:17:53,334][106225] Updated weights for policy 1, policy_version 703739 (0.0005) [2023-12-28 00:17:53,366][106226] Updated weights for policy 0, policy_version 701990 (0.0011) [2023-12-28 00:17:53,390][106225] Updated weights for policy 1, policy_version 703749 (0.0005) [2023-12-28 00:17:53,429][106226] Updated weights for policy 0, policy_version 702000 (0.0011) [2023-12-28 00:17:53,445][106225] Updated weights for policy 1, policy_version 703759 (0.0008) [2023-12-28 00:17:54,073][106225] Updated weights for policy 1, policy_version 703769 (0.0009) [2023-12-28 00:17:54,127][106225] Updated weights for policy 1, policy_version 703779 (0.0010) [2023-12-28 00:17:54,151][106226] Updated weights for policy 0, policy_version 702010 (0.0010) [2023-12-28 00:17:54,194][106225] Updated weights for policy 1, policy_version 703789 (0.0010) [2023-12-28 00:17:54,216][106226] Updated weights for policy 0, policy_version 702020 (0.0010) [2023-12-28 00:17:54,259][106225] Updated weights for policy 1, policy_version 703799 (0.0011) [2023-12-28 00:17:54,279][106226] Updated weights for policy 0, policy_version 702030 (0.0007) [2023-12-28 00:17:54,343][106226] Updated weights for policy 0, policy_version 702040 (0.0005) [2023-12-28 00:17:54,944][106226] Updated weights for policy 0, policy_version 702050 (0.0011) [2023-12-28 00:17:54,947][106225] Updated weights for policy 1, policy_version 703809 (0.0007) [2023-12-28 00:17:55,002][106226] Updated weights for policy 0, policy_version 702060 (0.0010) [2023-12-28 00:17:55,005][106225] Updated weights for policy 1, policy_version 703819 (0.0010) [2023-12-28 00:17:55,064][106226] Updated weights for policy 0, policy_version 702070 (0.0011) [2023-12-28 00:17:55,066][106225] Updated weights for policy 1, policy_version 703829 (0.0010) [2023-12-28 00:17:55,597][106225] Updated weights for policy 1, policy_version 703839 (0.0008) [2023-12-28 00:17:55,647][106225] Updated weights for policy 1, policy_version 703849 (0.0010) [2023-12-28 00:17:55,696][106225] Updated weights for policy 1, policy_version 703859 (0.0010) [2023-12-28 00:17:55,766][106226] Updated weights for policy 0, policy_version 702080 (0.0010) [2023-12-28 00:17:55,824][106226] Updated weights for policy 0, policy_version 702090 (0.0010) [2023-12-28 00:17:55,886][106226] Updated weights for policy 0, policy_version 702100 (0.0010) [2023-12-28 00:17:56,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 360013824. Throughput: 0: 9815.2, 1: 9817.9. Samples: 359980592. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:17:56,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.594')] [2023-12-28 00:17:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000702104_179789824.pth... [2023-12-28 00:17:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000703864_180224000.pth... [2023-12-28 00:17:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000700952_179494912.pth [2023-12-28 00:17:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000702712_179929088.pth [2023-12-28 00:17:56,401][106225] Updated weights for policy 1, policy_version 703869 (0.0008) [2023-12-28 00:17:56,456][106225] Updated weights for policy 1, policy_version 703879 (0.0005) [2023-12-28 00:17:56,512][106225] Updated weights for policy 1, policy_version 703889 (0.0007) [2023-12-28 00:17:56,604][106226] Updated weights for policy 0, policy_version 702110 (0.0010) [2023-12-28 00:17:56,660][106226] Updated weights for policy 0, policy_version 702120 (0.0010) [2023-12-28 00:17:56,716][106226] Updated weights for policy 0, policy_version 702130 (0.0005) [2023-12-28 00:17:57,088][106225] Updated weights for policy 1, policy_version 703899 (0.0007) [2023-12-28 00:17:57,135][106225] Updated weights for policy 1, policy_version 703909 (0.0010) [2023-12-28 00:17:57,188][106225] Updated weights for policy 1, policy_version 703919 (0.0010) [2023-12-28 00:17:57,395][106226] Updated weights for policy 0, policy_version 702140 (0.0007) [2023-12-28 00:17:57,441][106226] Updated weights for policy 0, policy_version 702150 (0.0010) [2023-12-28 00:17:57,493][106226] Updated weights for policy 0, policy_version 702160 (0.0010) [2023-12-28 00:17:57,792][106225] Updated weights for policy 1, policy_version 703929 (0.0010) [2023-12-28 00:17:57,851][106225] Updated weights for policy 1, policy_version 703939 (0.0010) [2023-12-28 00:17:57,907][106225] Updated weights for policy 1, policy_version 703949 (0.0010) [2023-12-28 00:17:57,967][106225] Updated weights for policy 1, policy_version 703959 (0.0010) [2023-12-28 00:17:58,226][106226] Updated weights for policy 0, policy_version 702170 (0.0011) [2023-12-28 00:17:58,289][106226] Updated weights for policy 0, policy_version 702180 (0.0010) [2023-12-28 00:17:58,367][106226] Updated weights for policy 0, policy_version 702190 (0.0009) [2023-12-28 00:17:58,439][106226] Updated weights for policy 0, policy_version 702200 (0.0010) [2023-12-28 00:17:58,669][106225] Updated weights for policy 1, policy_version 703969 (0.0007) [2023-12-28 00:17:58,739][106225] Updated weights for policy 1, policy_version 703979 (0.0008) [2023-12-28 00:17:58,810][106225] Updated weights for policy 1, policy_version 703989 (0.0007) [2023-12-28 00:17:59,288][106226] Updated weights for policy 0, policy_version 702210 (0.0012) [2023-12-28 00:17:59,346][106226] Updated weights for policy 0, policy_version 702220 (0.0008) [2023-12-28 00:17:59,414][106226] Updated weights for policy 0, policy_version 702230 (0.0009) [2023-12-28 00:17:59,648][106225] Updated weights for policy 1, policy_version 703999 (0.0008) [2023-12-28 00:17:59,706][106225] Updated weights for policy 1, policy_version 704009 (0.0010) [2023-12-28 00:17:59,762][106225] Updated weights for policy 1, policy_version 704019 (0.0010) [2023-12-28 00:18:00,162][106226] Updated weights for policy 0, policy_version 702240 (0.0009) [2023-12-28 00:18:00,224][106226] Updated weights for policy 0, policy_version 702250 (0.0008) [2023-12-28 00:18:00,280][106226] Updated weights for policy 0, policy_version 702260 (0.0008) [2023-12-28 00:18:00,515][106225] Updated weights for policy 1, policy_version 704029 (0.0010) [2023-12-28 00:18:00,573][106225] Updated weights for policy 1, policy_version 704039 (0.0011) [2023-12-28 00:18:00,627][106225] Updated weights for policy 1, policy_version 704049 (0.0010) [2023-12-28 00:18:01,014][106226] Updated weights for policy 0, policy_version 702270 (0.0007) [2023-12-28 00:18:01,079][106226] Updated weights for policy 0, policy_version 702280 (0.0009) [2023-12-28 00:18:01,141][106226] Updated weights for policy 0, policy_version 702290 (0.0010) [2023-12-28 00:18:01,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 360103936. Throughput: 0: 9903.6, 1: 9846.9. Samples: 360100180. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 00:18:01,176][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.613')] [2023-12-28 00:18:01,303][106225] Updated weights for policy 1, policy_version 704059 (0.0010) [2023-12-28 00:18:01,375][106225] Updated weights for policy 1, policy_version 704069 (0.0007) [2023-12-28 00:18:01,445][106225] Updated weights for policy 1, policy_version 704079 (0.0007) [2023-12-28 00:18:01,935][106226] Updated weights for policy 0, policy_version 702300 (0.0009) [2023-12-28 00:18:02,000][106226] Updated weights for policy 0, policy_version 702310 (0.0009) [2023-12-28 00:18:02,057][106226] Updated weights for policy 0, policy_version 702320 (0.0008) [2023-12-28 00:18:02,118][106225] Updated weights for policy 1, policy_version 704089 (0.0009) [2023-12-28 00:18:02,187][106225] Updated weights for policy 1, policy_version 704099 (0.0009) [2023-12-28 00:18:02,250][106225] Updated weights for policy 1, policy_version 704109 (0.0008) [2023-12-28 00:18:02,313][106225] Updated weights for policy 1, policy_version 704119 (0.0008) [2023-12-28 00:18:02,819][106226] Updated weights for policy 0, policy_version 702330 (0.0008) [2023-12-28 00:18:02,873][106226] Updated weights for policy 0, policy_version 702340 (0.0009) [2023-12-28 00:18:02,919][106225] Updated weights for policy 1, policy_version 704129 (0.0009) [2023-12-28 00:18:02,930][106226] Updated weights for policy 0, policy_version 702350 (0.0008) [2023-12-28 00:18:02,982][106225] Updated weights for policy 1, policy_version 704139 (0.0007) [2023-12-28 00:18:02,988][106226] Updated weights for policy 0, policy_version 702360 (0.0007) [2023-12-28 00:18:03,045][106225] Updated weights for policy 1, policy_version 704149 (0.0010) [2023-12-28 00:18:03,601][106226] Updated weights for policy 0, policy_version 702370 (0.0007) [2023-12-28 00:18:03,631][106225] Updated weights for policy 1, policy_version 704159 (0.0010) [2023-12-28 00:18:03,653][106226] Updated weights for policy 0, policy_version 702380 (0.0006) [2023-12-28 00:18:03,684][106225] Updated weights for policy 1, policy_version 704169 (0.0010) [2023-12-28 00:18:03,702][106226] Updated weights for policy 0, policy_version 702390 (0.0005) [2023-12-28 00:18:03,730][106225] Updated weights for policy 1, policy_version 704179 (0.0009) [2023-12-28 00:18:04,303][106226] Updated weights for policy 0, policy_version 702400 (0.0008) [2023-12-28 00:18:04,371][106226] Updated weights for policy 0, policy_version 702410 (0.0010) [2023-12-28 00:18:04,413][106225] Updated weights for policy 1, policy_version 704189 (0.0007) [2023-12-28 00:18:04,429][106226] Updated weights for policy 0, policy_version 702420 (0.0007) [2023-12-28 00:18:04,472][106225] Updated weights for policy 1, policy_version 704199 (0.0006) [2023-12-28 00:18:04,526][106225] Updated weights for policy 1, policy_version 704209 (0.0008) [2023-12-28 00:18:05,153][106225] Updated weights for policy 1, policy_version 704219 (0.0006) [2023-12-28 00:18:05,167][106226] Updated weights for policy 0, policy_version 702430 (0.0006) [2023-12-28 00:18:05,215][106225] Updated weights for policy 1, policy_version 704229 (0.0006) [2023-12-28 00:18:05,229][106226] Updated weights for policy 0, policy_version 702440 (0.0006) [2023-12-28 00:18:05,277][106226] Updated weights for policy 0, policy_version 702450 (0.0007) [2023-12-28 00:18:05,281][106225] Updated weights for policy 1, policy_version 704239 (0.0006) [2023-12-28 00:18:05,808][106225] Updated weights for policy 1, policy_version 704249 (0.0006) [2023-12-28 00:18:05,870][106225] Updated weights for policy 1, policy_version 704259 (0.0007) [2023-12-28 00:18:05,923][106225] Updated weights for policy 1, policy_version 704269 (0.0005) [2023-12-28 00:18:05,974][106225] Updated weights for policy 1, policy_version 704279 (0.0006) [2023-12-28 00:18:06,027][106226] Updated weights for policy 0, policy_version 702460 (0.0008) [2023-12-28 00:18:06,080][106226] Updated weights for policy 0, policy_version 702470 (0.0009) [2023-12-28 00:18:06,138][106226] Updated weights for policy 0, policy_version 702480 (0.0009) [2023-12-28 00:18:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 360210432. Throughput: 0: 9870.9, 1: 10001.2. Samples: 360221752. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:06,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.548')] [2023-12-28 00:18:06,680][106225] Updated weights for policy 1, policy_version 704289 (0.0008) [2023-12-28 00:18:06,737][106225] Updated weights for policy 1, policy_version 704299 (0.0007) [2023-12-28 00:18:06,790][106225] Updated weights for policy 1, policy_version 704309 (0.0009) [2023-12-28 00:18:06,808][106226] Updated weights for policy 0, policy_version 702490 (0.0008) [2023-12-28 00:18:06,857][106226] Updated weights for policy 0, policy_version 702500 (0.0005) [2023-12-28 00:18:06,902][106226] Updated weights for policy 0, policy_version 702510 (0.0005) [2023-12-28 00:18:06,957][106226] Updated weights for policy 0, policy_version 702520 (0.0006) [2023-12-28 00:18:07,500][106226] Updated weights for policy 0, policy_version 702530 (0.0008) [2023-12-28 00:18:07,555][106226] Updated weights for policy 0, policy_version 702540 (0.0010) [2023-12-28 00:18:07,619][106226] Updated weights for policy 0, policy_version 702550 (0.0006) [2023-12-28 00:18:07,639][106225] Updated weights for policy 1, policy_version 704319 (0.0009) [2023-12-28 00:18:07,700][106225] Updated weights for policy 1, policy_version 704329 (0.0005) [2023-12-28 00:18:07,759][106225] Updated weights for policy 1, policy_version 704339 (0.0008) [2023-12-28 00:18:08,332][106226] Updated weights for policy 0, policy_version 702560 (0.0007) [2023-12-28 00:18:08,396][106226] Updated weights for policy 0, policy_version 702570 (0.0007) [2023-12-28 00:18:08,417][106225] Updated weights for policy 1, policy_version 704349 (0.0006) [2023-12-28 00:18:08,459][106226] Updated weights for policy 0, policy_version 702580 (0.0007) [2023-12-28 00:18:08,476][106225] Updated weights for policy 1, policy_version 704359 (0.0008) [2023-12-28 00:18:08,546][106225] Updated weights for policy 1, policy_version 704369 (0.0010) [2023-12-28 00:18:09,063][106226] Updated weights for policy 0, policy_version 702590 (0.0008) [2023-12-28 00:18:09,115][106226] Updated weights for policy 0, policy_version 702600 (0.0010) [2023-12-28 00:18:09,171][106226] Updated weights for policy 0, policy_version 702610 (0.0010) [2023-12-28 00:18:09,248][106225] Updated weights for policy 1, policy_version 704379 (0.0009) [2023-12-28 00:18:09,315][106225] Updated weights for policy 1, policy_version 704389 (0.0009) [2023-12-28 00:18:09,385][106225] Updated weights for policy 1, policy_version 704399 (0.0006) [2023-12-28 00:18:09,940][106226] Updated weights for policy 0, policy_version 702620 (0.0010) [2023-12-28 00:18:10,007][106226] Updated weights for policy 0, policy_version 702630 (0.0009) [2023-12-28 00:18:10,056][106225] Updated weights for policy 1, policy_version 704409 (0.0006) [2023-12-28 00:18:10,074][106226] Updated weights for policy 0, policy_version 702640 (0.0009) [2023-12-28 00:18:10,121][106225] Updated weights for policy 1, policy_version 704419 (0.0008) [2023-12-28 00:18:10,190][106225] Updated weights for policy 1, policy_version 704429 (0.0009) [2023-12-28 00:18:10,252][106225] Updated weights for policy 1, policy_version 704439 (0.0009) [2023-12-28 00:18:10,755][106226] Updated weights for policy 0, policy_version 702650 (0.0006) [2023-12-28 00:18:10,805][106226] Updated weights for policy 0, policy_version 702660 (0.0006) [2023-12-28 00:18:10,853][106226] Updated weights for policy 0, policy_version 702670 (0.0005) [2023-12-28 00:18:10,902][106226] Updated weights for policy 0, policy_version 702680 (0.0005) [2023-12-28 00:18:11,066][106225] Updated weights for policy 1, policy_version 704449 (0.0007) [2023-12-28 00:18:11,127][106225] Updated weights for policy 1, policy_version 704459 (0.0007) [2023-12-28 00:18:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 360308736. Throughput: 0: 9960.8, 1: 10016.9. Samples: 360282740. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:11,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-5.447')] [2023-12-28 00:18:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000702680_179937280.pth... [2023-12-28 00:18:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000701528_179642368.pth [2023-12-28 00:18:11,197][106225] Updated weights for policy 1, policy_version 704469 (0.0009) [2023-12-28 00:18:11,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000704472_180379648.pth... [2023-12-28 00:18:11,213][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000703288_180076544.pth [2023-12-28 00:18:11,658][106226] Updated weights for policy 0, policy_version 702690 (0.0008) [2023-12-28 00:18:11,719][106226] Updated weights for policy 0, policy_version 702700 (0.0006) [2023-12-28 00:18:11,786][106226] Updated weights for policy 0, policy_version 702710 (0.0010) [2023-12-28 00:18:11,990][106225] Updated weights for policy 1, policy_version 704479 (0.0007) [2023-12-28 00:18:12,049][106225] Updated weights for policy 1, policy_version 704489 (0.0006) [2023-12-28 00:18:12,115][106225] Updated weights for policy 1, policy_version 704499 (0.0009) [2023-12-28 00:18:12,455][106226] Updated weights for policy 0, policy_version 702720 (0.0008) [2023-12-28 00:18:12,521][106226] Updated weights for policy 0, policy_version 702730 (0.0009) [2023-12-28 00:18:12,589][106226] Updated weights for policy 0, policy_version 702740 (0.0009) [2023-12-28 00:18:12,846][106225] Updated weights for policy 1, policy_version 704509 (0.0010) [2023-12-28 00:18:12,909][106225] Updated weights for policy 1, policy_version 704519 (0.0007) [2023-12-28 00:18:12,970][106225] Updated weights for policy 1, policy_version 704529 (0.0010) [2023-12-28 00:18:13,287][106226] Updated weights for policy 0, policy_version 702750 (0.0009) [2023-12-28 00:18:13,356][106226] Updated weights for policy 0, policy_version 702760 (0.0011) [2023-12-28 00:18:13,421][106226] Updated weights for policy 0, policy_version 702770 (0.0010) [2023-12-28 00:18:13,635][106225] Updated weights for policy 1, policy_version 704539 (0.0007) [2023-12-28 00:18:13,701][106225] Updated weights for policy 1, policy_version 704549 (0.0008) [2023-12-28 00:18:13,758][106225] Updated weights for policy 1, policy_version 704559 (0.0007) [2023-12-28 00:18:14,003][106226] Updated weights for policy 0, policy_version 702780 (0.0007) [2023-12-28 00:18:14,060][106226] Updated weights for policy 0, policy_version 702790 (0.0007) [2023-12-28 00:18:14,123][106226] Updated weights for policy 0, policy_version 702800 (0.0011) [2023-12-28 00:18:14,526][106225] Updated weights for policy 1, policy_version 704569 (0.0008) [2023-12-28 00:18:14,580][106225] Updated weights for policy 1, policy_version 704579 (0.0007) [2023-12-28 00:18:14,645][106225] Updated weights for policy 1, policy_version 704589 (0.0005) [2023-12-28 00:18:14,701][106225] Updated weights for policy 1, policy_version 704599 (0.0007) [2023-12-28 00:18:14,809][106226] Updated weights for policy 0, policy_version 702810 (0.0009) [2023-12-28 00:18:14,873][106226] Updated weights for policy 0, policy_version 702820 (0.0006) [2023-12-28 00:18:14,936][106226] Updated weights for policy 0, policy_version 702830 (0.0006) [2023-12-28 00:18:14,997][106226] Updated weights for policy 0, policy_version 702840 (0.0006) [2023-12-28 00:18:15,476][106225] Updated weights for policy 1, policy_version 704609 (0.0008) [2023-12-28 00:18:15,514][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000007 [2023-12-28 00:18:15,584][106226] Updated weights for policy 0, policy_version 702850 (0.0006) [2023-12-28 00:18:15,635][106226] Updated weights for policy 0, policy_version 702860 (0.0006) [2023-12-28 00:18:15,696][106226] Updated weights for policy 0, policy_version 702870 (0.0006) [2023-12-28 00:18:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 360407040. Throughput: 0: 9945.0, 1: 9918.6. Samples: 360399064. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:16,176][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.584')] [2023-12-28 00:18:16,242][106226] Updated weights for policy 0, policy_version 702880 (0.0006) [2023-12-28 00:18:16,294][106225] Updated weights for policy 1, policy_version 704619 (0.0008) [2023-12-28 00:18:16,298][106226] Updated weights for policy 0, policy_version 702890 (0.0006) [2023-12-28 00:18:16,342][106225] Updated weights for policy 1, policy_version 704629 (0.0008) [2023-12-28 00:18:16,362][106226] Updated weights for policy 0, policy_version 702900 (0.0006) [2023-12-28 00:18:16,392][106225] Updated weights for policy 1, policy_version 704639 (0.0010) [2023-12-28 00:18:17,031][106226] Updated weights for policy 0, policy_version 702910 (0.0007) [2023-12-28 00:18:17,068][106225] Updated weights for policy 1, policy_version 704649 (0.0006) [2023-12-28 00:18:17,096][106226] Updated weights for policy 0, policy_version 702920 (0.0008) [2023-12-28 00:18:17,132][106225] Updated weights for policy 1, policy_version 704659 (0.0007) [2023-12-28 00:18:17,149][106226] Updated weights for policy 0, policy_version 702930 (0.0005) [2023-12-28 00:18:17,189][106225] Updated weights for policy 1, policy_version 704669 (0.0007) [2023-12-28 00:18:17,259][106225] Updated weights for policy 1, policy_version 704679 (0.0009) [2023-12-28 00:18:17,700][106226] Updated weights for policy 0, policy_version 702940 (0.0007) [2023-12-28 00:18:17,766][106226] Updated weights for policy 0, policy_version 702950 (0.0009) [2023-12-28 00:18:17,834][106226] Updated weights for policy 0, policy_version 702960 (0.0009) [2023-12-28 00:18:18,034][106225] Updated weights for policy 1, policy_version 704689 (0.0010) [2023-12-28 00:18:18,098][106225] Updated weights for policy 1, policy_version 704699 (0.0010) [2023-12-28 00:18:18,156][106225] Updated weights for policy 1, policy_version 704709 (0.0010) [2023-12-28 00:18:18,544][106226] Updated weights for policy 0, policy_version 702970 (0.0009) [2023-12-28 00:18:18,598][106226] Updated weights for policy 0, policy_version 702980 (0.0010) [2023-12-28 00:18:18,655][106226] Updated weights for policy 0, policy_version 702990 (0.0010) [2023-12-28 00:18:18,702][106226] Updated weights for policy 0, policy_version 703000 (0.0010) [2023-12-28 00:18:18,879][106225] Updated weights for policy 1, policy_version 704719 (0.0010) [2023-12-28 00:18:18,936][106225] Updated weights for policy 1, policy_version 704729 (0.0005) [2023-12-28 00:18:18,994][106225] Updated weights for policy 1, policy_version 704739 (0.0008) [2023-12-28 00:18:19,390][106226] Updated weights for policy 0, policy_version 703010 (0.0008) [2023-12-28 00:18:19,450][106226] Updated weights for policy 0, policy_version 703020 (0.0008) [2023-12-28 00:18:19,518][106226] Updated weights for policy 0, policy_version 703030 (0.0008) [2023-12-28 00:18:19,667][106225] Updated weights for policy 1, policy_version 704749 (0.0010) [2023-12-28 00:18:19,714][106225] Updated weights for policy 1, policy_version 704759 (0.0010) [2023-12-28 00:18:19,762][106225] Updated weights for policy 1, policy_version 704769 (0.0010) [2023-12-28 00:18:20,265][106226] Updated weights for policy 0, policy_version 703040 (0.0007) [2023-12-28 00:18:20,329][106226] Updated weights for policy 0, policy_version 703050 (0.0008) [2023-12-28 00:18:20,400][106226] Updated weights for policy 0, policy_version 703060 (0.0007) [2023-12-28 00:18:20,545][106225] Updated weights for policy 1, policy_version 704779 (0.0011) [2023-12-28 00:18:20,626][106225] Updated weights for policy 1, policy_version 704789 (0.0009) [2023-12-28 00:18:20,692][106225] Updated weights for policy 1, policy_version 704799 (0.0008) [2023-12-28 00:18:21,042][106226] Updated weights for policy 0, policy_version 703070 (0.0009) [2023-12-28 00:18:21,101][106226] Updated weights for policy 0, policy_version 703080 (0.0006) [2023-12-28 00:18:21,171][106226] Updated weights for policy 0, policy_version 703090 (0.0008) [2023-12-28 00:18:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 360505344. Throughput: 0: 10011.4, 1: 9829.6. Samples: 360518756. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:21,176][105115] Avg episode reward: [(0, '-4.732'), (1, '-5.637')] [2023-12-28 00:18:21,494][106225] Updated weights for policy 1, policy_version 704809 (0.0008) [2023-12-28 00:18:21,556][106225] Updated weights for policy 1, policy_version 704819 (0.0009) [2023-12-28 00:18:21,623][106225] Updated weights for policy 1, policy_version 704829 (0.0009) [2023-12-28 00:18:21,690][106225] Updated weights for policy 1, policy_version 704839 (0.0009) [2023-12-28 00:18:21,886][106226] Updated weights for policy 0, policy_version 703100 (0.0007) [2023-12-28 00:18:21,944][106226] Updated weights for policy 0, policy_version 703110 (0.0008) [2023-12-28 00:18:21,996][106226] Updated weights for policy 0, policy_version 703120 (0.0010) [2023-12-28 00:18:22,330][106225] Updated weights for policy 1, policy_version 704849 (0.0010) [2023-12-28 00:18:22,400][106225] Updated weights for policy 1, policy_version 704859 (0.0009) [2023-12-28 00:18:22,461][106225] Updated weights for policy 1, policy_version 704869 (0.0009) [2023-12-28 00:18:22,696][106226] Updated weights for policy 0, policy_version 703130 (0.0010) [2023-12-28 00:18:22,755][106226] Updated weights for policy 0, policy_version 703140 (0.0009) [2023-12-28 00:18:22,818][106226] Updated weights for policy 0, policy_version 703150 (0.0009) [2023-12-28 00:18:22,870][106226] Updated weights for policy 0, policy_version 703160 (0.0007) [2023-12-28 00:18:23,136][106225] Updated weights for policy 1, policy_version 704879 (0.0009) [2023-12-28 00:18:23,193][106225] Updated weights for policy 1, policy_version 704889 (0.0010) [2023-12-28 00:18:23,248][106225] Updated weights for policy 1, policy_version 704899 (0.0010) [2023-12-28 00:18:23,481][106226] Updated weights for policy 0, policy_version 703170 (0.0008) [2023-12-28 00:18:23,534][106226] Updated weights for policy 0, policy_version 703180 (0.0009) [2023-12-28 00:18:23,588][106226] Updated weights for policy 0, policy_version 703190 (0.0008) [2023-12-28 00:18:23,930][106225] Updated weights for policy 1, policy_version 704909 (0.0008) [2023-12-28 00:18:23,990][106225] Updated weights for policy 1, policy_version 704919 (0.0006) [2023-12-28 00:18:24,045][106225] Updated weights for policy 1, policy_version 704929 (0.0008) [2023-12-28 00:18:24,305][106226] Updated weights for policy 0, policy_version 703200 (0.0006) [2023-12-28 00:18:24,363][106226] Updated weights for policy 0, policy_version 703210 (0.0005) [2023-12-28 00:18:24,418][106226] Updated weights for policy 0, policy_version 703220 (0.0005) [2023-12-28 00:18:24,802][106225] Updated weights for policy 1, policy_version 704939 (0.0007) [2023-12-28 00:18:24,856][106225] Updated weights for policy 1, policy_version 704949 (0.0005) [2023-12-28 00:18:24,914][106225] Updated weights for policy 1, policy_version 704959 (0.0005) [2023-12-28 00:18:25,068][106226] Updated weights for policy 0, policy_version 703230 (0.0007) [2023-12-28 00:18:25,132][106226] Updated weights for policy 0, policy_version 703240 (0.0010) [2023-12-28 00:18:25,186][106226] Updated weights for policy 0, policy_version 703250 (0.0010) [2023-12-28 00:18:25,448][106225] Updated weights for policy 1, policy_version 704969 (0.0005) [2023-12-28 00:18:25,512][106225] Updated weights for policy 1, policy_version 704979 (0.0005) [2023-12-28 00:18:25,574][106225] Updated weights for policy 1, policy_version 704989 (0.0005) [2023-12-28 00:18:25,641][106225] Updated weights for policy 1, policy_version 704999 (0.0005) [2023-12-28 00:18:25,921][106226] Updated weights for policy 0, policy_version 703260 (0.0010) [2023-12-28 00:18:25,981][106226] Updated weights for policy 0, policy_version 703270 (0.0008) [2023-12-28 00:18:26,029][106226] Updated weights for policy 0, policy_version 703280 (0.0005) [2023-12-28 00:18:26,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 360611840. Throughput: 0: 9988.7, 1: 9826.4. Samples: 360578304. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:26,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-5.691')] [2023-12-28 00:18:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000705000_180518912.pth... [2023-12-28 00:18:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000703288_180092928.pth... [2023-12-28 00:18:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000703864_180224000.pth [2023-12-28 00:18:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000702104_179789824.pth [2023-12-28 00:18:26,287][106225] Updated weights for policy 1, policy_version 705009 (0.0010) [2023-12-28 00:18:26,347][106225] Updated weights for policy 1, policy_version 705019 (0.0010) [2023-12-28 00:18:26,394][106225] Updated weights for policy 1, policy_version 705029 (0.0010) [2023-12-28 00:18:26,611][106226] Updated weights for policy 0, policy_version 703290 (0.0006) [2023-12-28 00:18:26,661][106226] Updated weights for policy 0, policy_version 703300 (0.0008) [2023-12-28 00:18:26,714][106226] Updated weights for policy 0, policy_version 703310 (0.0007) [2023-12-28 00:18:26,771][106226] Updated weights for policy 0, policy_version 703320 (0.0006) [2023-12-28 00:18:27,106][106225] Updated weights for policy 1, policy_version 705039 (0.0009) [2023-12-28 00:18:27,155][106225] Updated weights for policy 1, policy_version 705049 (0.0008) [2023-12-28 00:18:27,203][106225] Updated weights for policy 1, policy_version 705059 (0.0008) [2023-12-28 00:18:27,332][106226] Updated weights for policy 0, policy_version 703330 (0.0006) [2023-12-28 00:18:27,382][106226] Updated weights for policy 0, policy_version 703340 (0.0010) [2023-12-28 00:18:27,436][106226] Updated weights for policy 0, policy_version 703350 (0.0009) [2023-12-28 00:18:27,836][106225] Updated weights for policy 1, policy_version 705069 (0.0010) [2023-12-28 00:18:27,882][106225] Updated weights for policy 1, policy_version 705079 (0.0010) [2023-12-28 00:18:27,929][106225] Updated weights for policy 1, policy_version 705089 (0.0010) [2023-12-28 00:18:28,085][106226] Updated weights for policy 0, policy_version 703360 (0.0010) [2023-12-28 00:18:28,140][106226] Updated weights for policy 0, policy_version 703370 (0.0010) [2023-12-28 00:18:28,191][106226] Updated weights for policy 0, policy_version 703380 (0.0010) [2023-12-28 00:18:28,620][106225] Updated weights for policy 1, policy_version 705099 (0.0009) [2023-12-28 00:18:28,670][106225] Updated weights for policy 1, policy_version 705109 (0.0008) [2023-12-28 00:18:28,718][106225] Updated weights for policy 1, policy_version 705119 (0.0009) [2023-12-28 00:18:28,896][106226] Updated weights for policy 0, policy_version 703390 (0.0010) [2023-12-28 00:18:28,954][106226] Updated weights for policy 0, policy_version 703400 (0.0010) [2023-12-28 00:18:29,012][106226] Updated weights for policy 0, policy_version 703410 (0.0010) [2023-12-28 00:18:29,452][106225] Updated weights for policy 1, policy_version 705129 (0.0007) [2023-12-28 00:18:29,506][106225] Updated weights for policy 1, policy_version 705139 (0.0007) [2023-12-28 00:18:29,558][106225] Updated weights for policy 1, policy_version 705149 (0.0011) [2023-12-28 00:18:29,609][106225] Updated weights for policy 1, policy_version 705159 (0.0005) [2023-12-28 00:18:29,820][106226] Updated weights for policy 0, policy_version 703420 (0.0010) [2023-12-28 00:18:29,887][106226] Updated weights for policy 0, policy_version 703430 (0.0008) [2023-12-28 00:18:29,953][106226] Updated weights for policy 0, policy_version 703440 (0.0008) [2023-12-28 00:18:30,309][106225] Updated weights for policy 1, policy_version 705169 (0.0010) [2023-12-28 00:18:30,376][106225] Updated weights for policy 1, policy_version 705179 (0.0010) [2023-12-28 00:18:30,440][106225] Updated weights for policy 1, policy_version 705189 (0.0011) [2023-12-28 00:18:30,560][106226] Updated weights for policy 0, policy_version 703450 (0.0008) [2023-12-28 00:18:30,615][106226] Updated weights for policy 0, policy_version 703460 (0.0005) [2023-12-28 00:18:30,668][106226] Updated weights for policy 0, policy_version 703470 (0.0009) [2023-12-28 00:18:30,717][106226] Updated weights for policy 0, policy_version 703480 (0.0009) [2023-12-28 00:18:31,022][106225] Updated weights for policy 1, policy_version 705199 (0.0008) [2023-12-28 00:18:31,087][106225] Updated weights for policy 1, policy_version 705209 (0.0010) [2023-12-28 00:18:31,153][106225] Updated weights for policy 1, policy_version 705219 (0.0010) [2023-12-28 00:18:31,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 360710144. Throughput: 0: 10003.7, 1: 10029.2. Samples: 360702584. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:31,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-5.299')] [2023-12-28 00:18:31,538][106226] Updated weights for policy 0, policy_version 703490 (0.0008) [2023-12-28 00:18:31,604][106226] Updated weights for policy 0, policy_version 703500 (0.0011) [2023-12-28 00:18:31,672][106226] Updated weights for policy 0, policy_version 703510 (0.0010) [2023-12-28 00:18:31,866][106225] Updated weights for policy 1, policy_version 705229 (0.0008) [2023-12-28 00:18:31,922][106225] Updated weights for policy 1, policy_version 705239 (0.0008) [2023-12-28 00:18:31,981][106225] Updated weights for policy 1, policy_version 705249 (0.0006) [2023-12-28 00:18:32,428][106226] Updated weights for policy 0, policy_version 703520 (0.0010) [2023-12-28 00:18:32,478][106226] Updated weights for policy 0, policy_version 703530 (0.0010) [2023-12-28 00:18:32,529][106226] Updated weights for policy 0, policy_version 703540 (0.0007) [2023-12-28 00:18:32,656][106225] Updated weights for policy 1, policy_version 705259 (0.0008) [2023-12-28 00:18:32,717][106225] Updated weights for policy 1, policy_version 705269 (0.0010) [2023-12-28 00:18:32,777][106225] Updated weights for policy 1, policy_version 705279 (0.0009) [2023-12-28 00:18:33,175][106226] Updated weights for policy 0, policy_version 703550 (0.0008) [2023-12-28 00:18:33,224][106226] Updated weights for policy 0, policy_version 703560 (0.0010) [2023-12-28 00:18:33,274][106226] Updated weights for policy 0, policy_version 703570 (0.0010) [2023-12-28 00:18:33,473][106225] Updated weights for policy 1, policy_version 705289 (0.0010) [2023-12-28 00:18:33,545][106225] Updated weights for policy 1, policy_version 705299 (0.0005) [2023-12-28 00:18:33,590][106225] Updated weights for policy 1, policy_version 705309 (0.0005) [2023-12-28 00:18:33,647][106225] Updated weights for policy 1, policy_version 705319 (0.0005) [2023-12-28 00:18:33,935][106226] Updated weights for policy 0, policy_version 703580 (0.0008) [2023-12-28 00:18:33,988][106226] Updated weights for policy 0, policy_version 703590 (0.0005) [2023-12-28 00:18:34,045][106226] Updated weights for policy 0, policy_version 703600 (0.0008) [2023-12-28 00:18:34,307][106225] Updated weights for policy 1, policy_version 705329 (0.0008) [2023-12-28 00:18:34,372][106225] Updated weights for policy 1, policy_version 705339 (0.0008) [2023-12-28 00:18:34,442][106225] Updated weights for policy 1, policy_version 705349 (0.0009) [2023-12-28 00:18:34,744][106226] Updated weights for policy 0, policy_version 703610 (0.0011) [2023-12-28 00:18:34,808][106226] Updated weights for policy 0, policy_version 703620 (0.0009) [2023-12-28 00:18:34,870][106226] Updated weights for policy 0, policy_version 703630 (0.0010) [2023-12-28 00:18:34,935][106226] Updated weights for policy 0, policy_version 703640 (0.0007) [2023-12-28 00:18:35,057][106225] Updated weights for policy 1, policy_version 705359 (0.0010) [2023-12-28 00:18:35,112][106225] Updated weights for policy 1, policy_version 705369 (0.0006) [2023-12-28 00:18:35,171][106225] Updated weights for policy 1, policy_version 705379 (0.0005) [2023-12-28 00:18:35,659][106226] Updated weights for policy 0, policy_version 703650 (0.0009) [2023-12-28 00:18:35,708][106225] Updated weights for policy 1, policy_version 705389 (0.0005) [2023-12-28 00:18:35,718][106226] Updated weights for policy 0, policy_version 703660 (0.0008) [2023-12-28 00:18:35,770][106225] Updated weights for policy 1, policy_version 705399 (0.0008) [2023-12-28 00:18:35,775][106226] Updated weights for policy 0, policy_version 703670 (0.0009) [2023-12-28 00:18:35,816][106225] Updated weights for policy 1, policy_version 705409 (0.0005) [2023-12-28 00:18:36,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 360816640. Throughput: 0: 10062.3, 1: 10060.7. Samples: 360825644. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:36,176][105115] Avg episode reward: [(0, '-4.311'), (1, '-5.259')] [2023-12-28 00:18:36,462][106225] Updated weights for policy 1, policy_version 705419 (0.0010) [2023-12-28 00:18:36,524][106225] Updated weights for policy 1, policy_version 705429 (0.0011) [2023-12-28 00:18:36,541][106226] Updated weights for policy 0, policy_version 703680 (0.0006) [2023-12-28 00:18:36,592][106225] Updated weights for policy 1, policy_version 705439 (0.0011) [2023-12-28 00:18:36,604][106226] Updated weights for policy 0, policy_version 703690 (0.0007) [2023-12-28 00:18:36,663][106226] Updated weights for policy 0, policy_version 703700 (0.0010) [2023-12-28 00:18:37,263][106225] Updated weights for policy 1, policy_version 705449 (0.0010) [2023-12-28 00:18:37,328][106225] Updated weights for policy 1, policy_version 705459 (0.0008) [2023-12-28 00:18:37,357][106226] Updated weights for policy 0, policy_version 703710 (0.0008) [2023-12-28 00:18:37,379][106225] Updated weights for policy 1, policy_version 705469 (0.0006) [2023-12-28 00:18:37,420][106226] Updated weights for policy 0, policy_version 703720 (0.0006) [2023-12-28 00:18:37,442][106225] Updated weights for policy 1, policy_version 705479 (0.0007) [2023-12-28 00:18:37,474][106226] Updated weights for policy 0, policy_version 703730 (0.0008) [2023-12-28 00:18:38,124][106225] Updated weights for policy 1, policy_version 705489 (0.0008) [2023-12-28 00:18:38,169][106226] Updated weights for policy 0, policy_version 703740 (0.0007) [2023-12-28 00:18:38,183][106225] Updated weights for policy 1, policy_version 705499 (0.0007) [2023-12-28 00:18:38,225][106226] Updated weights for policy 0, policy_version 703750 (0.0007) [2023-12-28 00:18:38,238][106225] Updated weights for policy 1, policy_version 705509 (0.0008) [2023-12-28 00:18:38,284][106226] Updated weights for policy 0, policy_version 703760 (0.0009) [2023-12-28 00:18:38,875][106225] Updated weights for policy 1, policy_version 705519 (0.0005) [2023-12-28 00:18:38,903][106226] Updated weights for policy 0, policy_version 703770 (0.0007) [2023-12-28 00:18:38,942][106225] Updated weights for policy 1, policy_version 705529 (0.0010) [2023-12-28 00:18:38,968][106226] Updated weights for policy 0, policy_version 703780 (0.0006) [2023-12-28 00:18:39,007][106225] Updated weights for policy 1, policy_version 705539 (0.0010) [2023-12-28 00:18:39,021][106226] Updated weights for policy 0, policy_version 703790 (0.0005) [2023-12-28 00:18:39,079][106226] Updated weights for policy 0, policy_version 703800 (0.0009) [2023-12-28 00:18:39,729][106225] Updated weights for policy 1, policy_version 705549 (0.0010) [2023-12-28 00:18:39,783][106225] Updated weights for policy 1, policy_version 705559 (0.0010) [2023-12-28 00:18:39,815][106226] Updated weights for policy 0, policy_version 703810 (0.0012) [2023-12-28 00:18:39,841][106225] Updated weights for policy 1, policy_version 705569 (0.0009) [2023-12-28 00:18:39,883][106226] Updated weights for policy 0, policy_version 703820 (0.0012) [2023-12-28 00:18:39,935][106226] Updated weights for policy 0, policy_version 703830 (0.0008) [2023-12-28 00:18:40,565][106225] Updated weights for policy 1, policy_version 705579 (0.0006) [2023-12-28 00:18:40,622][106225] Updated weights for policy 1, policy_version 705589 (0.0007) [2023-12-28 00:18:40,654][106226] Updated weights for policy 0, policy_version 703840 (0.0007) [2023-12-28 00:18:40,672][106225] Updated weights for policy 1, policy_version 705599 (0.0007) [2023-12-28 00:18:40,723][106226] Updated weights for policy 0, policy_version 703850 (0.0009) [2023-12-28 00:18:40,785][106226] Updated weights for policy 0, policy_version 703860 (0.0008) [2023-12-28 00:18:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 360914944. Throughput: 0: 10062.2, 1: 10068.2. Samples: 360886460. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:41,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-5.650')] [2023-12-28 00:18:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000705608_180674560.pth... [2023-12-28 00:18:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000703864_180240384.pth... [2023-12-28 00:18:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000702680_179937280.pth [2023-12-28 00:18:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000704472_180379648.pth [2023-12-28 00:18:41,423][106225] Updated weights for policy 1, policy_version 705609 (0.0006) [2023-12-28 00:18:41,478][106225] Updated weights for policy 1, policy_version 705619 (0.0011) [2023-12-28 00:18:41,533][106226] Updated weights for policy 0, policy_version 703870 (0.0007) [2023-12-28 00:18:41,541][106225] Updated weights for policy 1, policy_version 705629 (0.0011) [2023-12-28 00:18:41,592][106225] Updated weights for policy 1, policy_version 705639 (0.0010) [2023-12-28 00:18:41,603][106226] Updated weights for policy 0, policy_version 703880 (0.0006) [2023-12-28 00:18:41,673][106226] Updated weights for policy 0, policy_version 703890 (0.0008) [2023-12-28 00:18:42,265][106226] Updated weights for policy 0, policy_version 703900 (0.0008) [2023-12-28 00:18:42,335][106226] Updated weights for policy 0, policy_version 703910 (0.0008) [2023-12-28 00:18:42,378][106225] Updated weights for policy 1, policy_version 705649 (0.0008) [2023-12-28 00:18:42,408][106226] Updated weights for policy 0, policy_version 703920 (0.0008) [2023-12-28 00:18:42,433][106225] Updated weights for policy 1, policy_version 705659 (0.0006) [2023-12-28 00:18:42,486][106225] Updated weights for policy 1, policy_version 705669 (0.0006) [2023-12-28 00:18:43,084][106226] Updated weights for policy 0, policy_version 703930 (0.0009) [2023-12-28 00:18:43,110][106225] Updated weights for policy 1, policy_version 705679 (0.0007) [2023-12-28 00:18:43,144][106226] Updated weights for policy 0, policy_version 703940 (0.0008) [2023-12-28 00:18:43,167][106225] Updated weights for policy 1, policy_version 705689 (0.0005) [2023-12-28 00:18:43,211][106226] Updated weights for policy 0, policy_version 703950 (0.0008) [2023-12-28 00:18:43,221][106225] Updated weights for policy 1, policy_version 705699 (0.0005) [2023-12-28 00:18:43,264][106226] Updated weights for policy 0, policy_version 703960 (0.0007) [2023-12-28 00:18:43,798][106225] Updated weights for policy 1, policy_version 705709 (0.0009) [2023-12-28 00:18:43,848][106225] Updated weights for policy 1, policy_version 705719 (0.0010) [2023-12-28 00:18:43,891][106225] Updated weights for policy 1, policy_version 705729 (0.0010) [2023-12-28 00:18:44,029][106226] Updated weights for policy 0, policy_version 703970 (0.0008) [2023-12-28 00:18:44,079][106226] Updated weights for policy 0, policy_version 703980 (0.0007) [2023-12-28 00:18:44,142][106226] Updated weights for policy 0, policy_version 703990 (0.0008) [2023-12-28 00:18:44,568][106225] Updated weights for policy 1, policy_version 705739 (0.0010) [2023-12-28 00:18:44,621][106225] Updated weights for policy 1, policy_version 705749 (0.0008) [2023-12-28 00:18:44,673][106225] Updated weights for policy 1, policy_version 705759 (0.0008) [2023-12-28 00:18:44,903][106226] Updated weights for policy 0, policy_version 704000 (0.0008) [2023-12-28 00:18:44,964][106226] Updated weights for policy 0, policy_version 704010 (0.0006) [2023-12-28 00:18:45,033][106226] Updated weights for policy 0, policy_version 704020 (0.0007) [2023-12-28 00:18:45,467][106225] Updated weights for policy 1, policy_version 705769 (0.0010) [2023-12-28 00:18:45,522][106225] Updated weights for policy 1, policy_version 705779 (0.0010) [2023-12-28 00:18:45,579][106225] Updated weights for policy 1, policy_version 705789 (0.0009) [2023-12-28 00:18:45,634][106225] Updated weights for policy 1, policy_version 705799 (0.0007) [2023-12-28 00:18:45,662][106226] Updated weights for policy 0, policy_version 704030 (0.0009) [2023-12-28 00:18:45,724][106226] Updated weights for policy 0, policy_version 704040 (0.0011) [2023-12-28 00:18:45,789][106226] Updated weights for policy 0, policy_version 704050 (0.0008) [2023-12-28 00:18:46,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 361013248. Throughput: 0: 10057.5, 1: 10023.0. Samples: 361003804. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:46,175][105115] Avg episode reward: [(0, '-4.237'), (1, '-5.526')] [2023-12-28 00:18:46,257][106225] Updated weights for policy 1, policy_version 705809 (0.0006) [2023-12-28 00:18:46,307][106225] Updated weights for policy 1, policy_version 705819 (0.0008) [2023-12-28 00:18:46,339][106226] Updated weights for policy 0, policy_version 704060 (0.0005) [2023-12-28 00:18:46,357][106225] Updated weights for policy 1, policy_version 705829 (0.0008) [2023-12-28 00:18:46,392][106226] Updated weights for policy 0, policy_version 704070 (0.0005) [2023-12-28 00:18:46,448][106226] Updated weights for policy 0, policy_version 704080 (0.0005) [2023-12-28 00:18:47,013][106226] Updated weights for policy 0, policy_version 704090 (0.0006) [2023-12-28 00:18:47,072][106226] Updated weights for policy 0, policy_version 704100 (0.0010) [2023-12-28 00:18:47,087][106225] Updated weights for policy 1, policy_version 705839 (0.0006) [2023-12-28 00:18:47,132][106226] Updated weights for policy 0, policy_version 704110 (0.0010) [2023-12-28 00:18:47,150][106225] Updated weights for policy 1, policy_version 705849 (0.0006) [2023-12-28 00:18:47,187][106226] Updated weights for policy 0, policy_version 704120 (0.0010) [2023-12-28 00:18:47,209][106225] Updated weights for policy 1, policy_version 705859 (0.0006) [2023-12-28 00:18:47,917][106225] Updated weights for policy 1, policy_version 705869 (0.0007) [2023-12-28 00:18:47,944][106226] Updated weights for policy 0, policy_version 704130 (0.0008) [2023-12-28 00:18:47,980][106225] Updated weights for policy 1, policy_version 705879 (0.0007) [2023-12-28 00:18:48,008][106226] Updated weights for policy 0, policy_version 704140 (0.0006) [2023-12-28 00:18:48,040][106225] Updated weights for policy 1, policy_version 705889 (0.0007) [2023-12-28 00:18:48,070][106226] Updated weights for policy 0, policy_version 704150 (0.0011) [2023-12-28 00:18:48,673][106225] Updated weights for policy 1, policy_version 705899 (0.0007) [2023-12-28 00:18:48,723][106226] Updated weights for policy 0, policy_version 704160 (0.0010) [2023-12-28 00:18:48,736][106225] Updated weights for policy 1, policy_version 705909 (0.0006) [2023-12-28 00:18:48,790][106226] Updated weights for policy 0, policy_version 704170 (0.0011) [2023-12-28 00:18:48,794][106225] Updated weights for policy 1, policy_version 705919 (0.0006) [2023-12-28 00:18:48,848][106226] Updated weights for policy 0, policy_version 704180 (0.0010) [2023-12-28 00:18:49,440][106225] Updated weights for policy 1, policy_version 705929 (0.0008) [2023-12-28 00:18:49,495][106225] Updated weights for policy 1, policy_version 705939 (0.0008) [2023-12-28 00:18:49,546][106225] Updated weights for policy 1, policy_version 705949 (0.0008) [2023-12-28 00:18:49,575][106226] Updated weights for policy 0, policy_version 704190 (0.0011) [2023-12-28 00:18:49,605][106225] Updated weights for policy 1, policy_version 705959 (0.0006) [2023-12-28 00:18:49,629][106226] Updated weights for policy 0, policy_version 704200 (0.0010) [2023-12-28 00:18:49,685][106226] Updated weights for policy 0, policy_version 704210 (0.0010) [2023-12-28 00:18:50,396][106226] Updated weights for policy 0, policy_version 704220 (0.0009) [2023-12-28 00:18:50,410][106225] Updated weights for policy 1, policy_version 705969 (0.0007) [2023-12-28 00:18:50,454][106226] Updated weights for policy 0, policy_version 704230 (0.0006) [2023-12-28 00:18:50,467][106225] Updated weights for policy 1, policy_version 705979 (0.0008) [2023-12-28 00:18:50,516][106225] Updated weights for policy 1, policy_version 705989 (0.0006) [2023-12-28 00:18:50,517][106226] Updated weights for policy 0, policy_version 704240 (0.0007) [2023-12-28 00:18:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 361111552. Throughput: 0: 10131.7, 1: 9937.1. Samples: 361124852. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:51,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.551')] [2023-12-28 00:18:51,234][106225] Updated weights for policy 1, policy_version 705999 (0.0009) [2023-12-28 00:18:51,294][106226] Updated weights for policy 0, policy_version 704250 (0.0009) [2023-12-28 00:18:51,302][106225] Updated weights for policy 1, policy_version 706009 (0.0008) [2023-12-28 00:18:51,348][106226] Updated weights for policy 0, policy_version 704260 (0.0007) [2023-12-28 00:18:51,362][106225] Updated weights for policy 1, policy_version 706019 (0.0006) [2023-12-28 00:18:51,418][106226] Updated weights for policy 0, policy_version 704270 (0.0008) [2023-12-28 00:18:51,473][106226] Updated weights for policy 0, policy_version 704280 (0.0006) [2023-12-28 00:18:52,113][106225] Updated weights for policy 1, policy_version 706029 (0.0009) [2023-12-28 00:18:52,163][106225] Updated weights for policy 1, policy_version 706039 (0.0008) [2023-12-28 00:18:52,203][106226] Updated weights for policy 0, policy_version 704290 (0.0007) [2023-12-28 00:18:52,214][106225] Updated weights for policy 1, policy_version 706049 (0.0006) [2023-12-28 00:18:52,264][106226] Updated weights for policy 0, policy_version 704300 (0.0007) [2023-12-28 00:18:52,321][106226] Updated weights for policy 0, policy_version 704310 (0.0007) [2023-12-28 00:18:52,924][106225] Updated weights for policy 1, policy_version 706059 (0.0010) [2023-12-28 00:18:52,981][106225] Updated weights for policy 1, policy_version 706069 (0.0010) [2023-12-28 00:18:52,988][106226] Updated weights for policy 0, policy_version 704320 (0.0006) [2023-12-28 00:18:53,035][106225] Updated weights for policy 1, policy_version 706079 (0.0010) [2023-12-28 00:18:53,048][106226] Updated weights for policy 0, policy_version 704330 (0.0005) [2023-12-28 00:18:53,110][106226] Updated weights for policy 0, policy_version 704340 (0.0006) [2023-12-28 00:18:53,740][106226] Updated weights for policy 0, policy_version 704350 (0.0006) [2023-12-28 00:18:53,745][106225] Updated weights for policy 1, policy_version 706089 (0.0010) [2023-12-28 00:18:53,797][106226] Updated weights for policy 0, policy_version 704360 (0.0005) [2023-12-28 00:18:53,806][106225] Updated weights for policy 1, policy_version 706099 (0.0010) [2023-12-28 00:18:53,854][106226] Updated weights for policy 0, policy_version 704370 (0.0005) [2023-12-28 00:18:53,863][106225] Updated weights for policy 1, policy_version 706109 (0.0010) [2023-12-28 00:18:53,920][106225] Updated weights for policy 1, policy_version 706119 (0.0010) [2023-12-28 00:18:54,580][106226] Updated weights for policy 0, policy_version 704380 (0.0007) [2023-12-28 00:18:54,599][106225] Updated weights for policy 1, policy_version 706129 (0.0010) [2023-12-28 00:18:54,634][106226] Updated weights for policy 0, policy_version 704390 (0.0010) [2023-12-28 00:18:54,652][106225] Updated weights for policy 1, policy_version 706139 (0.0010) [2023-12-28 00:18:54,690][106226] Updated weights for policy 0, policy_version 704400 (0.0010) [2023-12-28 00:18:54,705][106225] Updated weights for policy 1, policy_version 706149 (0.0010) [2023-12-28 00:18:55,393][106226] Updated weights for policy 0, policy_version 704410 (0.0010) [2023-12-28 00:18:55,443][106225] Updated weights for policy 1, policy_version 706159 (0.0010) [2023-12-28 00:18:55,450][106226] Updated weights for policy 0, policy_version 704420 (0.0011) [2023-12-28 00:18:55,499][106225] Updated weights for policy 1, policy_version 706169 (0.0009) [2023-12-28 00:18:55,506][106226] Updated weights for policy 0, policy_version 704430 (0.0010) [2023-12-28 00:18:55,559][106225] Updated weights for policy 1, policy_version 706179 (0.0007) [2023-12-28 00:18:55,567][106226] Updated weights for policy 0, policy_version 704440 (0.0011) [2023-12-28 00:18:56,154][106225] Updated weights for policy 1, policy_version 706189 (0.0008) [2023-12-28 00:18:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 361209856. Throughput: 0: 10071.7, 1: 9957.4. Samples: 361184048. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:18:56,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-5.267')] [2023-12-28 00:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000704440_180387840.pth... [2023-12-28 00:18:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000703288_180092928.pth [2023-12-28 00:18:56,224][106225] Updated weights for policy 1, policy_version 706199 (0.0008) [2023-12-28 00:18:56,258][106226] Updated weights for policy 0, policy_version 704450 (0.0008) [2023-12-28 00:18:56,286][106225] Updated weights for policy 1, policy_version 706209 (0.0010) [2023-12-28 00:18:56,308][106226] Updated weights for policy 0, policy_version 704460 (0.0008) [2023-12-28 00:18:56,327][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000706216_180830208.pth... [2023-12-28 00:18:56,331][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000705000_180518912.pth [2023-12-28 00:18:56,357][106226] Updated weights for policy 0, policy_version 704470 (0.0007) [2023-12-28 00:18:56,935][106225] Updated weights for policy 1, policy_version 706219 (0.0010) [2023-12-28 00:18:56,992][106225] Updated weights for policy 1, policy_version 706229 (0.0005) [2023-12-28 00:18:57,029][106226] Updated weights for policy 0, policy_version 704480 (0.0006) [2023-12-28 00:18:57,047][106225] Updated weights for policy 1, policy_version 706239 (0.0008) [2023-12-28 00:18:57,084][106226] Updated weights for policy 0, policy_version 704490 (0.0007) [2023-12-28 00:18:57,132][106226] Updated weights for policy 0, policy_version 704500 (0.0008) [2023-12-28 00:18:57,673][106225] Updated weights for policy 1, policy_version 706249 (0.0007) [2023-12-28 00:18:57,737][106225] Updated weights for policy 1, policy_version 706259 (0.0010) [2023-12-28 00:18:57,757][106226] Updated weights for policy 0, policy_version 704511 (0.0007) [2023-12-28 00:18:57,793][106225] Updated weights for policy 1, policy_version 706269 (0.0010) [2023-12-28 00:18:57,808][106226] Updated weights for policy 0, policy_version 704521 (0.0005) [2023-12-28 00:18:57,849][106225] Updated weights for policy 1, policy_version 706279 (0.0010) [2023-12-28 00:18:57,866][106226] Updated weights for policy 0, policy_version 704531 (0.0006) [2023-12-28 00:18:58,472][106225] Updated weights for policy 1, policy_version 706289 (0.0008) [2023-12-28 00:18:58,531][106225] Updated weights for policy 1, policy_version 706299 (0.0008) [2023-12-28 00:18:58,600][106225] Updated weights for policy 1, policy_version 706309 (0.0008) [2023-12-28 00:18:58,618][106226] Updated weights for policy 0, policy_version 704541 (0.0007) [2023-12-28 00:18:58,681][106226] Updated weights for policy 0, policy_version 704551 (0.0008) [2023-12-28 00:18:58,747][106226] Updated weights for policy 0, policy_version 704561 (0.0008) [2023-12-28 00:18:59,430][106225] Updated weights for policy 1, policy_version 706319 (0.0008) [2023-12-28 00:18:59,482][106225] Updated weights for policy 1, policy_version 706329 (0.0009) [2023-12-28 00:18:59,512][106226] Updated weights for policy 0, policy_version 704571 (0.0009) [2023-12-28 00:18:59,535][106225] Updated weights for policy 1, policy_version 706339 (0.0008) [2023-12-28 00:18:59,560][106226] Updated weights for policy 0, policy_version 704581 (0.0008) [2023-12-28 00:18:59,623][106226] Updated weights for policy 0, policy_version 704591 (0.0008) [2023-12-28 00:19:00,305][106225] Updated weights for policy 1, policy_version 706349 (0.0010) [2023-12-28 00:19:00,331][106226] Updated weights for policy 0, policy_version 704601 (0.0008) [2023-12-28 00:19:00,363][106225] Updated weights for policy 1, policy_version 706359 (0.0010) [2023-12-28 00:19:00,389][106226] Updated weights for policy 0, policy_version 704611 (0.0011) [2023-12-28 00:19:00,421][106225] Updated weights for policy 1, policy_version 706369 (0.0010) [2023-12-28 00:19:00,445][106226] Updated weights for policy 0, policy_version 704621 (0.0009) [2023-12-28 00:19:00,492][106226] Updated weights for policy 0, policy_version 704631 (0.0006) [2023-12-28 00:19:01,132][106225] Updated weights for policy 1, policy_version 706379 (0.0010) [2023-12-28 00:19:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 361308160. Throughput: 0: 10058.7, 1: 10042.5. Samples: 361303616. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:01,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.566')] [2023-12-28 00:19:01,198][106225] Updated weights for policy 1, policy_version 706389 (0.0009) [2023-12-28 00:19:01,222][106226] Updated weights for policy 0, policy_version 704641 (0.0010) [2023-12-28 00:19:01,259][106225] Updated weights for policy 1, policy_version 706399 (0.0010) [2023-12-28 00:19:01,288][106226] Updated weights for policy 0, policy_version 704651 (0.0011) [2023-12-28 00:19:01,349][106226] Updated weights for policy 0, policy_version 704661 (0.0009) [2023-12-28 00:19:02,017][106225] Updated weights for policy 1, policy_version 706409 (0.0010) [2023-12-28 00:19:02,083][106225] Updated weights for policy 1, policy_version 706419 (0.0007) [2023-12-28 00:19:02,109][106226] Updated weights for policy 0, policy_version 704671 (0.0007) [2023-12-28 00:19:02,156][106225] Updated weights for policy 1, policy_version 706429 (0.0007) [2023-12-28 00:19:02,167][106226] Updated weights for policy 0, policy_version 704681 (0.0007) [2023-12-28 00:19:02,212][106225] Updated weights for policy 1, policy_version 706439 (0.0008) [2023-12-28 00:19:02,230][106226] Updated weights for policy 0, policy_version 704691 (0.0006) [2023-12-28 00:19:02,887][106225] Updated weights for policy 1, policy_version 706449 (0.0010) [2023-12-28 00:19:02,938][106226] Updated weights for policy 0, policy_version 704701 (0.0007) [2023-12-28 00:19:02,939][106225] Updated weights for policy 1, policy_version 706459 (0.0010) [2023-12-28 00:19:02,992][106225] Updated weights for policy 1, policy_version 706469 (0.0010) [2023-12-28 00:19:02,995][106226] Updated weights for policy 0, policy_version 704711 (0.0005) [2023-12-28 00:19:03,055][106226] Updated weights for policy 0, policy_version 704721 (0.0007) [2023-12-28 00:19:03,724][106225] Updated weights for policy 1, policy_version 706479 (0.0010) [2023-12-28 00:19:03,766][106225] Updated weights for policy 1, policy_version 706489 (0.0010) [2023-12-28 00:19:03,798][106226] Updated weights for policy 0, policy_version 704731 (0.0007) [2023-12-28 00:19:03,822][106225] Updated weights for policy 1, policy_version 706499 (0.0010) [2023-12-28 00:19:03,860][106226] Updated weights for policy 0, policy_version 704741 (0.0007) [2023-12-28 00:19:03,919][106226] Updated weights for policy 0, policy_version 704751 (0.0008) [2023-12-28 00:19:04,558][106225] Updated weights for policy 1, policy_version 706509 (0.0010) [2023-12-28 00:19:04,615][106225] Updated weights for policy 1, policy_version 706519 (0.0010) [2023-12-28 00:19:04,674][106225] Updated weights for policy 1, policy_version 706529 (0.0010) [2023-12-28 00:19:04,677][106226] Updated weights for policy 0, policy_version 704761 (0.0008) [2023-12-28 00:19:04,727][106226] Updated weights for policy 0, policy_version 704771 (0.0007) [2023-12-28 00:19:04,779][106226] Updated weights for policy 0, policy_version 704781 (0.0008) [2023-12-28 00:19:04,832][106226] Updated weights for policy 0, policy_version 704791 (0.0008) [2023-12-28 00:19:05,388][106225] Updated weights for policy 1, policy_version 706539 (0.0010) [2023-12-28 00:19:05,444][106225] Updated weights for policy 1, policy_version 706549 (0.0010) [2023-12-28 00:19:05,503][106225] Updated weights for policy 1, policy_version 706559 (0.0010) [2023-12-28 00:19:05,578][106226] Updated weights for policy 0, policy_version 704801 (0.0007) [2023-12-28 00:19:05,636][106226] Updated weights for policy 0, policy_version 704811 (0.0007) [2023-12-28 00:19:05,694][106226] Updated weights for policy 0, policy_version 704821 (0.0008) [2023-12-28 00:19:06,144][106225] Updated weights for policy 1, policy_version 706569 (0.0010) [2023-12-28 00:19:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 361406464. Throughput: 0: 9924.4, 1: 10062.6. Samples: 361418168. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:06,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.562')] [2023-12-28 00:19:06,203][106225] Updated weights for policy 1, policy_version 706579 (0.0008) [2023-12-28 00:19:06,263][106225] Updated weights for policy 1, policy_version 706589 (0.0008) [2023-12-28 00:19:06,324][106225] Updated weights for policy 1, policy_version 706599 (0.0009) [2023-12-28 00:19:06,486][106226] Updated weights for policy 0, policy_version 704831 (0.0009) [2023-12-28 00:19:06,553][106226] Updated weights for policy 0, policy_version 704841 (0.0005) [2023-12-28 00:19:06,613][106226] Updated weights for policy 0, policy_version 704851 (0.0005) [2023-12-28 00:19:06,982][106225] Updated weights for policy 1, policy_version 706609 (0.0006) [2023-12-28 00:19:07,026][106225] Updated weights for policy 1, policy_version 706619 (0.0005) [2023-12-28 00:19:07,075][106225] Updated weights for policy 1, policy_version 706629 (0.0005) [2023-12-28 00:19:07,355][106226] Updated weights for policy 0, policy_version 704861 (0.0007) [2023-12-28 00:19:07,417][106226] Updated weights for policy 0, policy_version 704871 (0.0008) [2023-12-28 00:19:07,471][106226] Updated weights for policy 0, policy_version 704881 (0.0007) [2023-12-28 00:19:07,716][106225] Updated weights for policy 1, policy_version 706639 (0.0007) [2023-12-28 00:19:07,778][106225] Updated weights for policy 1, policy_version 706649 (0.0008) [2023-12-28 00:19:07,830][106225] Updated weights for policy 1, policy_version 706659 (0.0005) [2023-12-28 00:19:08,126][106226] Updated weights for policy 0, policy_version 704891 (0.0009) [2023-12-28 00:19:08,180][106226] Updated weights for policy 0, policy_version 704901 (0.0009) [2023-12-28 00:19:08,231][106226] Updated weights for policy 0, policy_version 704911 (0.0009) [2023-12-28 00:19:08,377][106225] Updated weights for policy 1, policy_version 706669 (0.0006) [2023-12-28 00:19:08,426][106225] Updated weights for policy 1, policy_version 706679 (0.0005) [2023-12-28 00:19:08,482][106225] Updated weights for policy 1, policy_version 706689 (0.0007) [2023-12-28 00:19:09,011][106226] Updated weights for policy 0, policy_version 704921 (0.0009) [2023-12-28 00:19:09,070][106226] Updated weights for policy 0, policy_version 704931 (0.0005) [2023-12-28 00:19:09,123][106225] Updated weights for policy 1, policy_version 706699 (0.0006) [2023-12-28 00:19:09,129][106226] Updated weights for policy 0, policy_version 704941 (0.0006) [2023-12-28 00:19:09,179][106225] Updated weights for policy 1, policy_version 706709 (0.0005) [2023-12-28 00:19:09,193][106226] Updated weights for policy 0, policy_version 704951 (0.0008) [2023-12-28 00:19:09,241][106225] Updated weights for policy 1, policy_version 706719 (0.0006) [2023-12-28 00:19:09,842][106226] Updated weights for policy 0, policy_version 704961 (0.0008) [2023-12-28 00:19:09,901][106226] Updated weights for policy 0, policy_version 704971 (0.0007) [2023-12-28 00:19:09,969][106225] Updated weights for policy 1, policy_version 706729 (0.0008) [2023-12-28 00:19:09,978][106226] Updated weights for policy 0, policy_version 704981 (0.0008) [2023-12-28 00:19:10,028][106225] Updated weights for policy 1, policy_version 706739 (0.0006) [2023-12-28 00:19:10,082][106225] Updated weights for policy 1, policy_version 706749 (0.0006) [2023-12-28 00:19:10,138][106225] Updated weights for policy 1, policy_version 706759 (0.0006) [2023-12-28 00:19:10,604][106226] Updated weights for policy 0, policy_version 704991 (0.0006) [2023-12-28 00:19:10,668][106226] Updated weights for policy 0, policy_version 705001 (0.0007) [2023-12-28 00:19:10,721][106226] Updated weights for policy 0, policy_version 705012 (0.0009) [2023-12-28 00:19:10,803][106225] Updated weights for policy 1, policy_version 706769 (0.0008) [2023-12-28 00:19:10,862][106225] Updated weights for policy 1, policy_version 706779 (0.0008) [2023-12-28 00:19:10,921][106225] Updated weights for policy 1, policy_version 706789 (0.0007) [2023-12-28 00:19:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 361512960. Throughput: 0: 9896.8, 1: 10143.9. Samples: 361480136. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:11,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-5.564')] [2023-12-28 00:19:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000706792_180977664.pth... [2023-12-28 00:19:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000705016_180535296.pth... [2023-12-28 00:19:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000703864_180240384.pth [2023-12-28 00:19:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000705608_180674560.pth [2023-12-28 00:19:11,512][106226] Updated weights for policy 0, policy_version 705022 (0.0006) [2023-12-28 00:19:11,575][106226] Updated weights for policy 0, policy_version 705032 (0.0008) [2023-12-28 00:19:11,644][106226] Updated weights for policy 0, policy_version 705042 (0.0009) [2023-12-28 00:19:11,754][106225] Updated weights for policy 1, policy_version 706799 (0.0009) [2023-12-28 00:19:11,814][106225] Updated weights for policy 1, policy_version 706809 (0.0006) [2023-12-28 00:19:11,874][106225] Updated weights for policy 1, policy_version 706819 (0.0006) [2023-12-28 00:19:12,342][106226] Updated weights for policy 0, policy_version 705052 (0.0009) [2023-12-28 00:19:12,423][106226] Updated weights for policy 0, policy_version 705062 (0.0009) [2023-12-28 00:19:12,490][106226] Updated weights for policy 0, policy_version 705072 (0.0009) [2023-12-28 00:19:12,591][106225] Updated weights for policy 1, policy_version 706829 (0.0007) [2023-12-28 00:19:12,650][106225] Updated weights for policy 1, policy_version 706839 (0.0008) [2023-12-28 00:19:12,710][106225] Updated weights for policy 1, policy_version 706849 (0.0007) [2023-12-28 00:19:13,245][106226] Updated weights for policy 0, policy_version 705082 (0.0008) [2023-12-28 00:19:13,296][106226] Updated weights for policy 0, policy_version 705092 (0.0007) [2023-12-28 00:19:13,348][106226] Updated weights for policy 0, policy_version 705102 (0.0008) [2023-12-28 00:19:13,380][106225] Updated weights for policy 1, policy_version 706859 (0.0006) [2023-12-28 00:19:13,398][106226] Updated weights for policy 0, policy_version 705112 (0.0005) [2023-12-28 00:19:13,436][106225] Updated weights for policy 1, policy_version 706869 (0.0009) [2023-12-28 00:19:13,480][106225] Updated weights for policy 1, policy_version 706879 (0.0008) [2023-12-28 00:19:14,094][106226] Updated weights for policy 0, policy_version 705122 (0.0009) [2023-12-28 00:19:14,152][106226] Updated weights for policy 0, policy_version 705132 (0.0006) [2023-12-28 00:19:14,196][106225] Updated weights for policy 1, policy_version 706889 (0.0008) [2023-12-28 00:19:14,213][106226] Updated weights for policy 0, policy_version 705142 (0.0008) [2023-12-28 00:19:14,265][106225] Updated weights for policy 1, policy_version 706899 (0.0008) [2023-12-28 00:19:14,336][106225] Updated weights for policy 1, policy_version 706909 (0.0008) [2023-12-28 00:19:14,390][106225] Updated weights for policy 1, policy_version 706919 (0.0010) [2023-12-28 00:19:14,803][106226] Updated weights for policy 0, policy_version 705152 (0.0008) [2023-12-28 00:19:14,864][106226] Updated weights for policy 0, policy_version 705162 (0.0007) [2023-12-28 00:19:14,923][106226] Updated weights for policy 0, policy_version 705172 (0.0008) [2023-12-28 00:19:15,079][106225] Updated weights for policy 1, policy_version 706929 (0.0010) [2023-12-28 00:19:15,146][106225] Updated weights for policy 1, policy_version 706939 (0.0010) [2023-12-28 00:19:15,211][106225] Updated weights for policy 1, policy_version 706949 (0.0011) [2023-12-28 00:19:15,611][106226] Updated weights for policy 0, policy_version 705182 (0.0007) [2023-12-28 00:19:15,665][106226] Updated weights for policy 0, policy_version 705192 (0.0005) [2023-12-28 00:19:15,725][106226] Updated weights for policy 0, policy_version 705202 (0.0005) [2023-12-28 00:19:15,897][106225] Updated weights for policy 1, policy_version 706959 (0.0010) [2023-12-28 00:19:15,951][106225] Updated weights for policy 1, policy_version 706969 (0.0010) [2023-12-28 00:19:16,009][106225] Updated weights for policy 1, policy_version 706979 (0.0010) [2023-12-28 00:19:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 361611264. Throughput: 0: 9866.7, 1: 10046.4. Samples: 361598676. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:16,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.610')] [2023-12-28 00:19:16,358][106226] Updated weights for policy 0, policy_version 705212 (0.0008) [2023-12-28 00:19:16,420][106226] Updated weights for policy 0, policy_version 705222 (0.0010) [2023-12-28 00:19:16,487][106226] Updated weights for policy 0, policy_version 705232 (0.0008) [2023-12-28 00:19:16,731][106225] Updated weights for policy 1, policy_version 706989 (0.0010) [2023-12-28 00:19:16,778][106225] Updated weights for policy 1, policy_version 706999 (0.0010) [2023-12-28 00:19:16,832][106225] Updated weights for policy 1, policy_version 707009 (0.0010) [2023-12-28 00:19:17,069][106226] Updated weights for policy 0, policy_version 705242 (0.0009) [2023-12-28 00:19:17,122][106226] Updated weights for policy 0, policy_version 705252 (0.0005) [2023-12-28 00:19:17,171][106226] Updated weights for policy 0, policy_version 705262 (0.0005) [2023-12-28 00:19:17,235][106226] Updated weights for policy 0, policy_version 705272 (0.0006) [2023-12-28 00:19:17,504][106225] Updated weights for policy 1, policy_version 707019 (0.0010) [2023-12-28 00:19:17,557][106225] Updated weights for policy 1, policy_version 707029 (0.0009) [2023-12-28 00:19:17,613][106225] Updated weights for policy 1, policy_version 707039 (0.0008) [2023-12-28 00:19:17,776][106226] Updated weights for policy 0, policy_version 705282 (0.0010) [2023-12-28 00:19:17,836][106226] Updated weights for policy 0, policy_version 705292 (0.0008) [2023-12-28 00:19:17,902][106226] Updated weights for policy 0, policy_version 705302 (0.0009) [2023-12-28 00:19:18,403][106225] Updated weights for policy 1, policy_version 707049 (0.0009) [2023-12-28 00:19:18,465][106225] Updated weights for policy 1, policy_version 707059 (0.0007) [2023-12-28 00:19:18,525][106225] Updated weights for policy 1, policy_version 707069 (0.0005) [2023-12-28 00:19:18,591][106225] Updated weights for policy 1, policy_version 707079 (0.0006) [2023-12-28 00:19:18,635][106226] Updated weights for policy 0, policy_version 705312 (0.0009) [2023-12-28 00:19:18,702][106226] Updated weights for policy 0, policy_version 705322 (0.0009) [2023-12-28 00:19:18,759][106226] Updated weights for policy 0, policy_version 705332 (0.0008) [2023-12-28 00:19:19,261][106225] Updated weights for policy 1, policy_version 707089 (0.0010) [2023-12-28 00:19:19,318][106225] Updated weights for policy 1, policy_version 707099 (0.0009) [2023-12-28 00:19:19,371][106226] Updated weights for policy 0, policy_version 705342 (0.0008) [2023-12-28 00:19:19,384][106225] Updated weights for policy 1, policy_version 707109 (0.0008) [2023-12-28 00:19:19,428][106226] Updated weights for policy 0, policy_version 705352 (0.0008) [2023-12-28 00:19:19,489][106226] Updated weights for policy 0, policy_version 705362 (0.0008) [2023-12-28 00:19:20,146][106225] Updated weights for policy 1, policy_version 707119 (0.0008) [2023-12-28 00:19:20,203][106225] Updated weights for policy 1, policy_version 707129 (0.0006) [2023-12-28 00:19:20,262][106225] Updated weights for policy 1, policy_version 707139 (0.0007) [2023-12-28 00:19:20,269][106226] Updated weights for policy 0, policy_version 705372 (0.0007) [2023-12-28 00:19:20,333][106226] Updated weights for policy 0, policy_version 705382 (0.0008) [2023-12-28 00:19:20,390][106226] Updated weights for policy 0, policy_version 705392 (0.0009) [2023-12-28 00:19:20,962][106225] Updated weights for policy 1, policy_version 707149 (0.0007) [2023-12-28 00:19:21,022][106225] Updated weights for policy 1, policy_version 707159 (0.0008) [2023-12-28 00:19:21,087][106226] Updated weights for policy 0, policy_version 705402 (0.0008) [2023-12-28 00:19:21,100][106225] Updated weights for policy 1, policy_version 707169 (0.0010) [2023-12-28 00:19:21,154][106226] Updated weights for policy 0, policy_version 705412 (0.0007) [2023-12-28 00:19:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 361709568. Throughput: 0: 9917.2, 1: 9943.4. Samples: 361719368. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:21,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.611')] [2023-12-28 00:19:21,223][106226] Updated weights for policy 0, policy_version 705422 (0.0007) [2023-12-28 00:19:21,293][106226] Updated weights for policy 0, policy_version 705432 (0.0009) [2023-12-28 00:19:21,947][106225] Updated weights for policy 1, policy_version 707179 (0.0010) [2023-12-28 00:19:22,008][106225] Updated weights for policy 1, policy_version 707189 (0.0010) [2023-12-28 00:19:22,062][106225] Updated weights for policy 1, policy_version 707199 (0.0009) [2023-12-28 00:19:22,092][106226] Updated weights for policy 0, policy_version 705442 (0.0007) [2023-12-28 00:19:22,147][106226] Updated weights for policy 0, policy_version 705452 (0.0007) [2023-12-28 00:19:22,200][106226] Updated weights for policy 0, policy_version 705462 (0.0009) [2023-12-28 00:19:22,811][106225] Updated weights for policy 1, policy_version 707209 (0.0007) [2023-12-28 00:19:22,859][106225] Updated weights for policy 1, policy_version 707219 (0.0008) [2023-12-28 00:19:22,909][106225] Updated weights for policy 1, policy_version 707229 (0.0009) [2023-12-28 00:19:22,950][106226] Updated weights for policy 0, policy_version 705472 (0.0006) [2023-12-28 00:19:22,955][106225] Updated weights for policy 1, policy_version 707239 (0.0008) [2023-12-28 00:19:23,002][106226] Updated weights for policy 0, policy_version 705482 (0.0008) [2023-12-28 00:19:23,056][106226] Updated weights for policy 0, policy_version 705492 (0.0009) [2023-12-28 00:19:23,590][106225] Updated weights for policy 1, policy_version 707249 (0.0007) [2023-12-28 00:19:23,646][106225] Updated weights for policy 1, policy_version 707259 (0.0006) [2023-12-28 00:19:23,701][106225] Updated weights for policy 1, policy_version 707269 (0.0005) [2023-12-28 00:19:23,728][106226] Updated weights for policy 0, policy_version 705502 (0.0006) [2023-12-28 00:19:23,798][106226] Updated weights for policy 0, policy_version 705512 (0.0005) [2023-12-28 00:19:23,857][106226] Updated weights for policy 0, policy_version 705522 (0.0005) [2023-12-28 00:19:24,318][106225] Updated weights for policy 1, policy_version 707279 (0.0005) [2023-12-28 00:19:24,367][106225] Updated weights for policy 1, policy_version 707289 (0.0005) [2023-12-28 00:19:24,417][106225] Updated weights for policy 1, policy_version 707299 (0.0005) [2023-12-28 00:19:24,450][106226] Updated weights for policy 0, policy_version 705532 (0.0007) [2023-12-28 00:19:24,514][106226] Updated weights for policy 0, policy_version 705542 (0.0011) [2023-12-28 00:19:24,571][106226] Updated weights for policy 0, policy_version 705552 (0.0007) [2023-12-28 00:19:25,059][106225] Updated weights for policy 1, policy_version 707309 (0.0006) [2023-12-28 00:19:25,122][106225] Updated weights for policy 1, policy_version 707319 (0.0006) [2023-12-28 00:19:25,143][106226] Updated weights for policy 0, policy_version 705562 (0.0006) [2023-12-28 00:19:25,182][106225] Updated weights for policy 1, policy_version 707329 (0.0008) [2023-12-28 00:19:25,197][106226] Updated weights for policy 0, policy_version 705572 (0.0006) [2023-12-28 00:19:25,248][106226] Updated weights for policy 0, policy_version 705582 (0.0007) [2023-12-28 00:19:25,302][106226] Updated weights for policy 0, policy_version 705592 (0.0008) [2023-12-28 00:19:25,783][106225] Updated weights for policy 1, policy_version 707339 (0.0007) [2023-12-28 00:19:25,843][106225] Updated weights for policy 1, policy_version 707349 (0.0005) [2023-12-28 00:19:25,900][106225] Updated weights for policy 1, policy_version 707359 (0.0006) [2023-12-28 00:19:25,933][106226] Updated weights for policy 0, policy_version 705602 (0.0005) [2023-12-28 00:19:25,981][106226] Updated weights for policy 0, policy_version 705612 (0.0005) [2023-12-28 00:19:26,041][106226] Updated weights for policy 0, policy_version 705622 (0.0006) [2023-12-28 00:19:26,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 361816064. Throughput: 0: 9892.2, 1: 9898.8. Samples: 361777052. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:26,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-5.433')] [2023-12-28 00:19:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000707368_181125120.pth... [2023-12-28 00:19:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000705624_180690944.pth... [2023-12-28 00:19:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000706216_180830208.pth [2023-12-28 00:19:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000704440_180387840.pth [2023-12-28 00:19:26,550][106225] Updated weights for policy 1, policy_version 707369 (0.0006) [2023-12-28 00:19:26,604][106225] Updated weights for policy 1, policy_version 707379 (0.0005) [2023-12-28 00:19:26,668][106225] Updated weights for policy 1, policy_version 707389 (0.0008) [2023-12-28 00:19:26,722][106226] Updated weights for policy 0, policy_version 705632 (0.0008) [2023-12-28 00:19:26,732][106225] Updated weights for policy 1, policy_version 707399 (0.0007) [2023-12-28 00:19:26,781][106226] Updated weights for policy 0, policy_version 705642 (0.0007) [2023-12-28 00:19:26,838][106226] Updated weights for policy 0, policy_version 705652 (0.0009) [2023-12-28 00:19:27,331][106225] Updated weights for policy 1, policy_version 707409 (0.0008) [2023-12-28 00:19:27,394][106225] Updated weights for policy 1, policy_version 707419 (0.0005) [2023-12-28 00:19:27,452][106225] Updated weights for policy 1, policy_version 707429 (0.0005) [2023-12-28 00:19:27,540][106226] Updated weights for policy 0, policy_version 705662 (0.0009) [2023-12-28 00:19:27,593][106226] Updated weights for policy 0, policy_version 705672 (0.0009) [2023-12-28 00:19:27,656][106226] Updated weights for policy 0, policy_version 705682 (0.0009) [2023-12-28 00:19:27,997][106225] Updated weights for policy 1, policy_version 707439 (0.0006) [2023-12-28 00:19:28,058][106225] Updated weights for policy 1, policy_version 707449 (0.0009) [2023-12-28 00:19:28,109][106225] Updated weights for policy 1, policy_version 707459 (0.0008) [2023-12-28 00:19:28,356][106226] Updated weights for policy 0, policy_version 705692 (0.0008) [2023-12-28 00:19:28,421][106226] Updated weights for policy 0, policy_version 705702 (0.0009) [2023-12-28 00:19:28,473][106226] Updated weights for policy 0, policy_version 705712 (0.0008) [2023-12-28 00:19:28,799][106225] Updated weights for policy 1, policy_version 707469 (0.0007) [2023-12-28 00:19:28,858][106225] Updated weights for policy 1, policy_version 707479 (0.0006) [2023-12-28 00:19:28,918][106225] Updated weights for policy 1, policy_version 707489 (0.0006) [2023-12-28 00:19:29,241][106226] Updated weights for policy 0, policy_version 705722 (0.0009) [2023-12-28 00:19:29,301][106226] Updated weights for policy 0, policy_version 705732 (0.0008) [2023-12-28 00:19:29,368][106226] Updated weights for policy 0, policy_version 705742 (0.0008) [2023-12-28 00:19:29,432][106226] Updated weights for policy 0, policy_version 705752 (0.0007) [2023-12-28 00:19:29,608][106225] Updated weights for policy 1, policy_version 707499 (0.0007) [2023-12-28 00:19:29,665][106225] Updated weights for policy 1, policy_version 707509 (0.0008) [2023-12-28 00:19:29,718][106225] Updated weights for policy 1, policy_version 707519 (0.0008) [2023-12-28 00:19:30,179][106226] Updated weights for policy 0, policy_version 705762 (0.0009) [2023-12-28 00:19:30,240][106226] Updated weights for policy 0, policy_version 705772 (0.0009) [2023-12-28 00:19:30,302][106226] Updated weights for policy 0, policy_version 705782 (0.0009) [2023-12-28 00:19:30,474][106225] Updated weights for policy 1, policy_version 707529 (0.0009) [2023-12-28 00:19:30,537][106225] Updated weights for policy 1, policy_version 707539 (0.0008) [2023-12-28 00:19:30,590][106225] Updated weights for policy 1, policy_version 707549 (0.0008) [2023-12-28 00:19:30,642][106225] Updated weights for policy 1, policy_version 707559 (0.0008) [2023-12-28 00:19:31,011][106226] Updated weights for policy 0, policy_version 705792 (0.0010) [2023-12-28 00:19:31,088][106226] Updated weights for policy 0, policy_version 705802 (0.0010) [2023-12-28 00:19:31,156][106226] Updated weights for policy 0, policy_version 705812 (0.0009) [2023-12-28 00:19:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 361906176. Throughput: 0: 9964.5, 1: 10010.8. Samples: 361902692. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:31,175][105115] Avg episode reward: [(0, '-4.190'), (1, '-5.523')] [2023-12-28 00:19:31,276][106225] Updated weights for policy 1, policy_version 707569 (0.0008) [2023-12-28 00:19:31,336][106225] Updated weights for policy 1, policy_version 707579 (0.0009) [2023-12-28 00:19:31,402][106225] Updated weights for policy 1, policy_version 707589 (0.0008) [2023-12-28 00:19:31,889][106226] Updated weights for policy 0, policy_version 705822 (0.0007) [2023-12-28 00:19:31,948][106226] Updated weights for policy 0, policy_version 705832 (0.0008) [2023-12-28 00:19:32,009][106226] Updated weights for policy 0, policy_version 705842 (0.0008) [2023-12-28 00:19:32,159][106225] Updated weights for policy 1, policy_version 707599 (0.0010) [2023-12-28 00:19:32,223][106225] Updated weights for policy 1, policy_version 707609 (0.0010) [2023-12-28 00:19:32,293][106225] Updated weights for policy 1, policy_version 707619 (0.0011) [2023-12-28 00:19:32,738][106226] Updated weights for policy 0, policy_version 705852 (0.0009) [2023-12-28 00:19:32,792][106226] Updated weights for policy 0, policy_version 705862 (0.0007) [2023-12-28 00:19:32,850][106226] Updated weights for policy 0, policy_version 705872 (0.0008) [2023-12-28 00:19:33,012][106225] Updated weights for policy 1, policy_version 707629 (0.0010) [2023-12-28 00:19:33,077][106225] Updated weights for policy 1, policy_version 707639 (0.0010) [2023-12-28 00:19:33,140][106225] Updated weights for policy 1, policy_version 707649 (0.0008) [2023-12-28 00:19:33,565][106226] Updated weights for policy 0, policy_version 705882 (0.0007) [2023-12-28 00:19:33,629][106226] Updated weights for policy 0, policy_version 705892 (0.0005) [2023-12-28 00:19:33,677][106226] Updated weights for policy 0, policy_version 705902 (0.0005) [2023-12-28 00:19:33,726][106226] Updated weights for policy 0, policy_version 705912 (0.0005) [2023-12-28 00:19:33,757][106225] Updated weights for policy 1, policy_version 707659 (0.0007) [2023-12-28 00:19:33,805][106225] Updated weights for policy 1, policy_version 707669 (0.0008) [2023-12-28 00:19:33,854][106225] Updated weights for policy 1, policy_version 707680 (0.0007) [2023-12-28 00:19:34,244][106226] Updated weights for policy 0, policy_version 705922 (0.0009) [2023-12-28 00:19:34,305][106226] Updated weights for policy 0, policy_version 705932 (0.0008) [2023-12-28 00:19:34,377][106226] Updated weights for policy 0, policy_version 705942 (0.0009) [2023-12-28 00:19:34,603][106225] Updated weights for policy 1, policy_version 707690 (0.0008) [2023-12-28 00:19:34,664][106225] Updated weights for policy 1, policy_version 707700 (0.0006) [2023-12-28 00:19:34,738][106225] Updated weights for policy 1, policy_version 707710 (0.0005) [2023-12-28 00:19:34,797][106225] Updated weights for policy 1, policy_version 707720 (0.0005) [2023-12-28 00:19:35,166][106226] Updated weights for policy 0, policy_version 705952 (0.0008) [2023-12-28 00:19:35,214][106226] Updated weights for policy 0, policy_version 705962 (0.0008) [2023-12-28 00:19:35,274][106226] Updated weights for policy 0, policy_version 705972 (0.0006) [2023-12-28 00:19:35,373][106225] Updated weights for policy 1, policy_version 707730 (0.0009) [2023-12-28 00:19:35,420][106225] Updated weights for policy 1, policy_version 707740 (0.0007) [2023-12-28 00:19:35,468][106225] Updated weights for policy 1, policy_version 707750 (0.0008) [2023-12-28 00:19:35,959][106226] Updated weights for policy 0, policy_version 705982 (0.0005) [2023-12-28 00:19:36,016][106226] Updated weights for policy 0, policy_version 705992 (0.0008) [2023-12-28 00:19:36,073][106226] Updated weights for policy 0, policy_version 706002 (0.0008) [2023-12-28 00:19:36,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 362012672. Throughput: 0: 9903.7, 1: 10024.4. Samples: 362021616. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:36,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-5.300')] [2023-12-28 00:19:36,222][106225] Updated weights for policy 1, policy_version 707760 (0.0010) [2023-12-28 00:19:36,287][106225] Updated weights for policy 1, policy_version 707770 (0.0008) [2023-12-28 00:19:36,355][106225] Updated weights for policy 1, policy_version 707780 (0.0006) [2023-12-28 00:19:36,874][106226] Updated weights for policy 0, policy_version 706012 (0.0008) [2023-12-28 00:19:36,931][106226] Updated weights for policy 0, policy_version 706022 (0.0007) [2023-12-28 00:19:36,979][106225] Updated weights for policy 1, policy_version 707790 (0.0009) [2023-12-28 00:19:36,989][106226] Updated weights for policy 0, policy_version 706032 (0.0007) [2023-12-28 00:19:37,027][106225] Updated weights for policy 1, policy_version 707800 (0.0010) [2023-12-28 00:19:37,081][106225] Updated weights for policy 1, policy_version 707810 (0.0010) [2023-12-28 00:19:37,717][106226] Updated weights for policy 0, policy_version 706042 (0.0007) [2023-12-28 00:19:37,777][106226] Updated weights for policy 0, policy_version 706052 (0.0009) [2023-12-28 00:19:37,821][106225] Updated weights for policy 1, policy_version 707820 (0.0010) [2023-12-28 00:19:37,826][106226] Updated weights for policy 0, policy_version 706062 (0.0007) [2023-12-28 00:19:37,878][106225] Updated weights for policy 1, policy_version 707830 (0.0010) [2023-12-28 00:19:37,884][106226] Updated weights for policy 0, policy_version 706072 (0.0005) [2023-12-28 00:19:37,935][106225] Updated weights for policy 1, policy_version 707840 (0.0010) [2023-12-28 00:19:38,588][106226] Updated weights for policy 0, policy_version 706082 (0.0006) [2023-12-28 00:19:38,650][106226] Updated weights for policy 0, policy_version 706092 (0.0007) [2023-12-28 00:19:38,711][106225] Updated weights for policy 1, policy_version 707850 (0.0010) [2023-12-28 00:19:38,715][106226] Updated weights for policy 0, policy_version 706102 (0.0006) [2023-12-28 00:19:38,768][106225] Updated weights for policy 1, policy_version 707860 (0.0009) [2023-12-28 00:19:38,831][106225] Updated weights for policy 1, policy_version 707870 (0.0010) [2023-12-28 00:19:38,893][106225] Updated weights for policy 1, policy_version 707880 (0.0008) [2023-12-28 00:19:39,298][106226] Updated weights for policy 0, policy_version 706112 (0.0008) [2023-12-28 00:19:39,367][106226] Updated weights for policy 0, policy_version 706122 (0.0009) [2023-12-28 00:19:39,434][106226] Updated weights for policy 0, policy_version 706132 (0.0008) [2023-12-28 00:19:39,657][106225] Updated weights for policy 1, policy_version 707890 (0.0006) [2023-12-28 00:19:39,714][106225] Updated weights for policy 1, policy_version 707900 (0.0006) [2023-12-28 00:19:39,776][106225] Updated weights for policy 1, policy_version 707910 (0.0007) [2023-12-28 00:19:40,198][106226] Updated weights for policy 0, policy_version 706142 (0.0007) [2023-12-28 00:19:40,264][106226] Updated weights for policy 0, policy_version 706152 (0.0006) [2023-12-28 00:19:40,326][106226] Updated weights for policy 0, policy_version 706162 (0.0005) [2023-12-28 00:19:40,477][106225] Updated weights for policy 1, policy_version 707920 (0.0007) [2023-12-28 00:19:40,536][106225] Updated weights for policy 1, policy_version 707930 (0.0007) [2023-12-28 00:19:40,588][106225] Updated weights for policy 1, policy_version 707940 (0.0009) [2023-12-28 00:19:40,957][106226] Updated weights for policy 0, policy_version 706172 (0.0010) [2023-12-28 00:19:41,014][106226] Updated weights for policy 0, policy_version 706182 (0.0010) [2023-12-28 00:19:41,088][106226] Updated weights for policy 0, policy_version 706192 (0.0009) [2023-12-28 00:19:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 362110976. Throughput: 0: 9906.4, 1: 10022.5. Samples: 362080848. Policy #0 lag: (min: 31.0, avg: 40.0, max: 63.0) [2023-12-28 00:19:41,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-5.506')] [2023-12-28 00:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000706200_180838400.pth... [2023-12-28 00:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000707944_181272576.pth... [2023-12-28 00:19:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000705016_180535296.pth [2023-12-28 00:19:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000706792_180977664.pth [2023-12-28 00:19:41,324][106225] Updated weights for policy 1, policy_version 707950 (0.0007) [2023-12-28 00:19:41,393][106225] Updated weights for policy 1, policy_version 707960 (0.0011) [2023-12-28 00:19:41,453][106225] Updated weights for policy 1, policy_version 707970 (0.0010) [2023-12-28 00:19:41,770][106226] Updated weights for policy 0, policy_version 706202 (0.0009) [2023-12-28 00:19:41,834][106226] Updated weights for policy 0, policy_version 706212 (0.0006) [2023-12-28 00:19:41,895][106226] Updated weights for policy 0, policy_version 706222 (0.0009) [2023-12-28 00:19:41,966][106226] Updated weights for policy 0, policy_version 706232 (0.0009) [2023-12-28 00:19:42,219][106225] Updated weights for policy 1, policy_version 707980 (0.0009) [2023-12-28 00:19:42,284][106225] Updated weights for policy 1, policy_version 707990 (0.0008) [2023-12-28 00:19:42,345][106225] Updated weights for policy 1, policy_version 708000 (0.0008) [2023-12-28 00:19:42,735][106226] Updated weights for policy 0, policy_version 706242 (0.0011) [2023-12-28 00:19:42,790][106226] Updated weights for policy 0, policy_version 706252 (0.0011) [2023-12-28 00:19:42,841][106226] Updated weights for policy 0, policy_version 706262 (0.0010) [2023-12-28 00:19:42,985][106225] Updated weights for policy 1, policy_version 708010 (0.0008) [2023-12-28 00:19:43,045][106225] Updated weights for policy 1, policy_version 708020 (0.0006) [2023-12-28 00:19:43,105][106225] Updated weights for policy 1, policy_version 708030 (0.0006) [2023-12-28 00:19:43,171][106225] Updated weights for policy 1, policy_version 708040 (0.0005) [2023-12-28 00:19:43,568][106226] Updated weights for policy 0, policy_version 706272 (0.0008) [2023-12-28 00:19:43,630][106226] Updated weights for policy 0, policy_version 706282 (0.0010) [2023-12-28 00:19:43,676][106226] Updated weights for policy 0, policy_version 706292 (0.0010) [2023-12-28 00:19:43,830][106225] Updated weights for policy 1, policy_version 708050 (0.0008) [2023-12-28 00:19:43,881][106225] Updated weights for policy 1, policy_version 708060 (0.0008) [2023-12-28 00:19:43,945][106225] Updated weights for policy 1, policy_version 708070 (0.0008) [2023-12-28 00:19:44,337][106226] Updated weights for policy 0, policy_version 706302 (0.0010) [2023-12-28 00:19:44,385][106226] Updated weights for policy 0, policy_version 706312 (0.0010) [2023-12-28 00:19:44,434][106226] Updated weights for policy 0, policy_version 706322 (0.0010) [2023-12-28 00:19:44,658][106225] Updated weights for policy 1, policy_version 708080 (0.0009) [2023-12-28 00:19:44,721][106225] Updated weights for policy 1, policy_version 708090 (0.0008) [2023-12-28 00:19:44,786][106225] Updated weights for policy 1, policy_version 708100 (0.0009) [2023-12-28 00:19:45,193][106226] Updated weights for policy 0, policy_version 706332 (0.0010) [2023-12-28 00:19:45,256][106226] Updated weights for policy 0, policy_version 706342 (0.0010) [2023-12-28 00:19:45,321][106226] Updated weights for policy 0, policy_version 706352 (0.0008) [2023-12-28 00:19:45,508][106225] Updated weights for policy 1, policy_version 708110 (0.0008) [2023-12-28 00:19:45,555][106225] Updated weights for policy 1, policy_version 708120 (0.0007) [2023-12-28 00:19:45,606][106225] Updated weights for policy 1, policy_version 708130 (0.0005) [2023-12-28 00:19:46,053][106226] Updated weights for policy 0, policy_version 706362 (0.0006) [2023-12-28 00:19:46,124][106226] Updated weights for policy 0, policy_version 706372 (0.0005) [2023-12-28 00:19:46,138][106225] Updated weights for policy 1, policy_version 708140 (0.0005) [2023-12-28 00:19:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 362201088. Throughput: 0: 9882.8, 1: 9967.4. Samples: 362196872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:19:46,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-5.426')] [2023-12-28 00:19:46,187][106226] Updated weights for policy 0, policy_version 706382 (0.0008) [2023-12-28 00:19:46,192][106225] Updated weights for policy 1, policy_version 708150 (0.0005) [2023-12-28 00:19:46,250][106226] Updated weights for policy 0, policy_version 706392 (0.0005) [2023-12-28 00:19:46,257][106225] Updated weights for policy 1, policy_version 708160 (0.0008) [2023-12-28 00:19:46,792][106226] Updated weights for policy 0, policy_version 706402 (0.0007) [2023-12-28 00:19:46,843][106226] Updated weights for policy 0, policy_version 706412 (0.0008) [2023-12-28 00:19:46,901][106226] Updated weights for policy 0, policy_version 706422 (0.0005) [2023-12-28 00:19:46,954][106225] Updated weights for policy 1, policy_version 708170 (0.0010) [2023-12-28 00:19:47,012][106225] Updated weights for policy 1, policy_version 708180 (0.0010) [2023-12-28 00:19:47,072][106225] Updated weights for policy 1, policy_version 708190 (0.0010) [2023-12-28 00:19:47,133][106225] Updated weights for policy 1, policy_version 708200 (0.0010) [2023-12-28 00:19:47,469][106226] Updated weights for policy 0, policy_version 706432 (0.0008) [2023-12-28 00:19:47,519][106226] Updated weights for policy 0, policy_version 706442 (0.0008) [2023-12-28 00:19:47,575][106226] Updated weights for policy 0, policy_version 706452 (0.0009) [2023-12-28 00:19:47,765][106225] Updated weights for policy 1, policy_version 708210 (0.0008) [2023-12-28 00:19:47,822][106225] Updated weights for policy 1, policy_version 708220 (0.0007) [2023-12-28 00:19:47,880][106225] Updated weights for policy 1, policy_version 708230 (0.0009) [2023-12-28 00:19:48,273][106226] Updated weights for policy 0, policy_version 706462 (0.0009) [2023-12-28 00:19:48,334][106226] Updated weights for policy 0, policy_version 706472 (0.0007) [2023-12-28 00:19:48,400][106226] Updated weights for policy 0, policy_version 706482 (0.0007) [2023-12-28 00:19:48,725][106225] Updated weights for policy 1, policy_version 708240 (0.0009) [2023-12-28 00:19:48,772][106225] Updated weights for policy 1, policy_version 708250 (0.0008) [2023-12-28 00:19:48,817][106225] Updated weights for policy 1, policy_version 708260 (0.0008) [2023-12-28 00:19:49,003][106226] Updated weights for policy 0, policy_version 706492 (0.0007) [2023-12-28 00:19:49,060][106226] Updated weights for policy 0, policy_version 706502 (0.0008) [2023-12-28 00:19:49,117][106226] Updated weights for policy 0, policy_version 706512 (0.0010) [2023-12-28 00:19:49,539][106225] Updated weights for policy 1, policy_version 708270 (0.0008) [2023-12-28 00:19:49,603][106225] Updated weights for policy 1, policy_version 708280 (0.0007) [2023-12-28 00:19:49,662][106225] Updated weights for policy 1, policy_version 708290 (0.0008) [2023-12-28 00:19:49,881][106226] Updated weights for policy 0, policy_version 706522 (0.0008) [2023-12-28 00:19:49,940][106226] Updated weights for policy 0, policy_version 706532 (0.0009) [2023-12-28 00:19:50,004][106226] Updated weights for policy 0, policy_version 706542 (0.0008) [2023-12-28 00:19:50,054][106226] Updated weights for policy 0, policy_version 706552 (0.0009) [2023-12-28 00:19:50,396][106225] Updated weights for policy 1, policy_version 708300 (0.0009) [2023-12-28 00:19:50,447][106225] Updated weights for policy 1, policy_version 708310 (0.0008) [2023-12-28 00:19:50,501][106225] Updated weights for policy 1, policy_version 708320 (0.0007) [2023-12-28 00:19:50,801][106226] Updated weights for policy 0, policy_version 706562 (0.0011) [2023-12-28 00:19:50,865][106226] Updated weights for policy 0, policy_version 706572 (0.0011) [2023-12-28 00:19:50,929][106226] Updated weights for policy 0, policy_version 706582 (0.0011) [2023-12-28 00:19:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 362307584. Throughput: 0: 9978.8, 1: 10005.4. Samples: 362317456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:19:51,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-5.400')] [2023-12-28 00:19:51,311][106225] Updated weights for policy 1, policy_version 708330 (0.0008) [2023-12-28 00:19:51,377][106225] Updated weights for policy 1, policy_version 708340 (0.0007) [2023-12-28 00:19:51,436][106225] Updated weights for policy 1, policy_version 708350 (0.0008) [2023-12-28 00:19:51,494][106225] Updated weights for policy 1, policy_version 708360 (0.0009) [2023-12-28 00:19:51,668][106226] Updated weights for policy 0, policy_version 706592 (0.0011) [2023-12-28 00:19:51,731][106226] Updated weights for policy 0, policy_version 706602 (0.0011) [2023-12-28 00:19:51,796][106226] Updated weights for policy 0, policy_version 706612 (0.0010) [2023-12-28 00:19:52,245][106225] Updated weights for policy 1, policy_version 708370 (0.0008) [2023-12-28 00:19:52,308][106225] Updated weights for policy 1, policy_version 708380 (0.0007) [2023-12-28 00:19:52,373][106225] Updated weights for policy 1, policy_version 708390 (0.0008) [2023-12-28 00:19:52,514][106226] Updated weights for policy 0, policy_version 706622 (0.0009) [2023-12-28 00:19:52,578][106226] Updated weights for policy 0, policy_version 706632 (0.0008) [2023-12-28 00:19:52,640][106226] Updated weights for policy 0, policy_version 706642 (0.0006) [2023-12-28 00:19:53,049][106225] Updated weights for policy 1, policy_version 708400 (0.0008) [2023-12-28 00:19:53,101][106225] Updated weights for policy 1, policy_version 708410 (0.0008) [2023-12-28 00:19:53,161][106225] Updated weights for policy 1, policy_version 708420 (0.0006) [2023-12-28 00:19:53,378][106226] Updated weights for policy 0, policy_version 706652 (0.0008) [2023-12-28 00:19:53,434][106226] Updated weights for policy 0, policy_version 706662 (0.0007) [2023-12-28 00:19:53,491][106226] Updated weights for policy 0, policy_version 706672 (0.0010) [2023-12-28 00:19:53,820][106225] Updated weights for policy 1, policy_version 708430 (0.0006) [2023-12-28 00:19:53,873][106225] Updated weights for policy 1, policy_version 708440 (0.0010) [2023-12-28 00:19:53,931][106225] Updated weights for policy 1, policy_version 708450 (0.0009) [2023-12-28 00:19:54,191][106226] Updated weights for policy 0, policy_version 706682 (0.0010) [2023-12-28 00:19:54,258][106226] Updated weights for policy 0, policy_version 706692 (0.0008) [2023-12-28 00:19:54,339][106226] Updated weights for policy 0, policy_version 706702 (0.0008) [2023-12-28 00:19:54,397][106226] Updated weights for policy 0, policy_version 706712 (0.0008) [2023-12-28 00:19:54,603][106225] Updated weights for policy 1, policy_version 708460 (0.0007) [2023-12-28 00:19:54,651][106225] Updated weights for policy 1, policy_version 708470 (0.0006) [2023-12-28 00:19:54,705][106225] Updated weights for policy 1, policy_version 708480 (0.0005) [2023-12-28 00:19:55,098][106226] Updated weights for policy 0, policy_version 706722 (0.0010) [2023-12-28 00:19:55,154][106226] Updated weights for policy 0, policy_version 706732 (0.0008) [2023-12-28 00:19:55,211][106226] Updated weights for policy 0, policy_version 706742 (0.0009) [2023-12-28 00:19:55,309][106225] Updated weights for policy 1, policy_version 708490 (0.0008) [2023-12-28 00:19:55,368][106225] Updated weights for policy 1, policy_version 708500 (0.0008) [2023-12-28 00:19:55,423][106225] Updated weights for policy 1, policy_version 708510 (0.0008) [2023-12-28 00:19:55,481][106225] Updated weights for policy 1, policy_version 708520 (0.0008) [2023-12-28 00:19:55,943][106226] Updated weights for policy 0, policy_version 706752 (0.0008) [2023-12-28 00:19:56,004][106226] Updated weights for policy 0, policy_version 706762 (0.0008) [2023-12-28 00:19:56,058][106226] Updated weights for policy 0, policy_version 706772 (0.0008) [2023-12-28 00:19:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 362405888. Throughput: 0: 9970.2, 1: 9908.0. Samples: 362374656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:19:56,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-5.619')] [2023-12-28 00:19:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000706776_180985856.pth... [2023-12-28 00:19:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000705624_180690944.pth [2023-12-28 00:19:56,194][106225] Updated weights for policy 1, policy_version 708530 (0.0009) [2023-12-28 00:19:56,253][106225] Updated weights for policy 1, policy_version 708540 (0.0008) [2023-12-28 00:19:56,317][106225] Updated weights for policy 1, policy_version 708550 (0.0007) [2023-12-28 00:19:56,325][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000708552_181428224.pth... [2023-12-28 00:19:56,328][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000707368_181125120.pth [2023-12-28 00:19:56,712][106226] Updated weights for policy 0, policy_version 706782 (0.0008) [2023-12-28 00:19:56,767][106226] Updated weights for policy 0, policy_version 706792 (0.0007) [2023-12-28 00:19:56,832][106226] Updated weights for policy 0, policy_version 706802 (0.0005) [2023-12-28 00:19:56,994][106225] Updated weights for policy 1, policy_version 708560 (0.0005) [2023-12-28 00:19:57,053][106225] Updated weights for policy 1, policy_version 708570 (0.0005) [2023-12-28 00:19:57,105][106225] Updated weights for policy 1, policy_version 708580 (0.0005) [2023-12-28 00:19:57,455][106226] Updated weights for policy 0, policy_version 706812 (0.0005) [2023-12-28 00:19:57,511][106226] Updated weights for policy 0, policy_version 706822 (0.0008) [2023-12-28 00:19:57,561][106226] Updated weights for policy 0, policy_version 706832 (0.0009) [2023-12-28 00:19:57,670][106225] Updated weights for policy 1, policy_version 708590 (0.0007) [2023-12-28 00:19:57,718][106225] Updated weights for policy 1, policy_version 708600 (0.0009) [2023-12-28 00:19:57,769][106225] Updated weights for policy 1, policy_version 708610 (0.0008) [2023-12-28 00:19:58,236][106226] Updated weights for policy 0, policy_version 706842 (0.0009) [2023-12-28 00:19:58,298][106226] Updated weights for policy 0, policy_version 706852 (0.0011) [2023-12-28 00:19:58,371][106226] Updated weights for policy 0, policy_version 706862 (0.0011) [2023-12-28 00:19:58,448][106226] Updated weights for policy 0, policy_version 706872 (0.0010) [2023-12-28 00:19:58,581][106225] Updated weights for policy 1, policy_version 708620 (0.0008) [2023-12-28 00:19:58,644][106225] Updated weights for policy 1, policy_version 708630 (0.0007) [2023-12-28 00:19:58,709][106225] Updated weights for policy 1, policy_version 708640 (0.0009) [2023-12-28 00:19:59,240][106226] Updated weights for policy 0, policy_version 706882 (0.0008) [2023-12-28 00:19:59,305][106226] Updated weights for policy 0, policy_version 706892 (0.0007) [2023-12-28 00:19:59,375][106226] Updated weights for policy 0, policy_version 706902 (0.0009) [2023-12-28 00:19:59,622][106225] Updated weights for policy 1, policy_version 708650 (0.0010) [2023-12-28 00:19:59,690][106225] Updated weights for policy 1, policy_version 708660 (0.0010) [2023-12-28 00:19:59,758][106225] Updated weights for policy 1, policy_version 708670 (0.0008) [2023-12-28 00:19:59,829][106225] Updated weights for policy 1, policy_version 708680 (0.0006) [2023-12-28 00:20:00,077][106226] Updated weights for policy 0, policy_version 706912 (0.0007) [2023-12-28 00:20:00,143][106226] Updated weights for policy 0, policy_version 706922 (0.0005) [2023-12-28 00:20:00,207][106226] Updated weights for policy 0, policy_version 706932 (0.0007) [2023-12-28 00:20:00,501][106225] Updated weights for policy 1, policy_version 708690 (0.0010) [2023-12-28 00:20:00,558][106225] Updated weights for policy 1, policy_version 708700 (0.0010) [2023-12-28 00:20:00,617][106225] Updated weights for policy 1, policy_version 708710 (0.0010) [2023-12-28 00:20:00,780][106226] Updated weights for policy 0, policy_version 706942 (0.0007) [2023-12-28 00:20:00,836][106226] Updated weights for policy 0, policy_version 706952 (0.0005) [2023-12-28 00:20:00,889][106226] Updated weights for policy 0, policy_version 706962 (0.0005) [2023-12-28 00:20:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 362504192. Throughput: 0: 9934.7, 1: 9920.8. Samples: 362492172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:01,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-5.549')] [2023-12-28 00:20:01,347][106225] Updated weights for policy 1, policy_version 708720 (0.0008) [2023-12-28 00:20:01,413][106225] Updated weights for policy 1, policy_version 708730 (0.0008) [2023-12-28 00:20:01,477][106225] Updated weights for policy 1, policy_version 708740 (0.0006) [2023-12-28 00:20:01,532][106226] Updated weights for policy 0, policy_version 706972 (0.0006) [2023-12-28 00:20:01,592][106226] Updated weights for policy 0, policy_version 706982 (0.0006) [2023-12-28 00:20:01,658][106226] Updated weights for policy 0, policy_version 706992 (0.0007) [2023-12-28 00:20:02,078][106225] Updated weights for policy 1, policy_version 708750 (0.0008) [2023-12-28 00:20:02,147][106225] Updated weights for policy 1, policy_version 708760 (0.0007) [2023-12-28 00:20:02,215][106225] Updated weights for policy 1, policy_version 708770 (0.0006) [2023-12-28 00:20:02,281][106226] Updated weights for policy 0, policy_version 707002 (0.0007) [2023-12-28 00:20:02,336][106226] Updated weights for policy 0, policy_version 707012 (0.0008) [2023-12-28 00:20:02,399][106226] Updated weights for policy 0, policy_version 707022 (0.0008) [2023-12-28 00:20:02,449][106226] Updated weights for policy 0, policy_version 707032 (0.0006) [2023-12-28 00:20:02,816][106225] Updated weights for policy 1, policy_version 708780 (0.0009) [2023-12-28 00:20:02,879][106225] Updated weights for policy 1, policy_version 708790 (0.0007) [2023-12-28 00:20:02,937][106225] Updated weights for policy 1, policy_version 708800 (0.0008) [2023-12-28 00:20:03,189][106226] Updated weights for policy 0, policy_version 707042 (0.0008) [2023-12-28 00:20:03,258][106226] Updated weights for policy 0, policy_version 707052 (0.0011) [2023-12-28 00:20:03,321][106226] Updated weights for policy 0, policy_version 707062 (0.0011) [2023-12-28 00:20:03,573][106225] Updated weights for policy 1, policy_version 708810 (0.0007) [2023-12-28 00:20:03,632][106225] Updated weights for policy 1, policy_version 708820 (0.0005) [2023-12-28 00:20:03,687][106225] Updated weights for policy 1, policy_version 708830 (0.0005) [2023-12-28 00:20:03,739][106225] Updated weights for policy 1, policy_version 708840 (0.0008) [2023-12-28 00:20:04,007][106226] Updated weights for policy 0, policy_version 707072 (0.0009) [2023-12-28 00:20:04,064][106226] Updated weights for policy 0, policy_version 707082 (0.0009) [2023-12-28 00:20:04,120][106226] Updated weights for policy 0, policy_version 707092 (0.0008) [2023-12-28 00:20:04,410][106225] Updated weights for policy 1, policy_version 708850 (0.0008) [2023-12-28 00:20:04,473][106225] Updated weights for policy 1, policy_version 708860 (0.0008) [2023-12-28 00:20:04,533][106225] Updated weights for policy 1, policy_version 708870 (0.0008) [2023-12-28 00:20:04,893][106226] Updated weights for policy 0, policy_version 707102 (0.0007) [2023-12-28 00:20:04,943][106226] Updated weights for policy 0, policy_version 707112 (0.0006) [2023-12-28 00:20:05,008][106226] Updated weights for policy 0, policy_version 707122 (0.0007) [2023-12-28 00:20:05,100][106225] Updated weights for policy 1, policy_version 708880 (0.0008) [2023-12-28 00:20:05,149][106225] Updated weights for policy 1, policy_version 708890 (0.0007) [2023-12-28 00:20:05,210][106225] Updated weights for policy 1, policy_version 708900 (0.0008) [2023-12-28 00:20:05,686][106226] Updated weights for policy 0, policy_version 707132 (0.0007) [2023-12-28 00:20:05,739][106226] Updated weights for policy 0, policy_version 707142 (0.0008) [2023-12-28 00:20:05,790][106226] Updated weights for policy 0, policy_version 707152 (0.0008) [2023-12-28 00:20:05,949][106225] Updated weights for policy 1, policy_version 708910 (0.0009) [2023-12-28 00:20:06,006][106225] Updated weights for policy 1, policy_version 708920 (0.0007) [2023-12-28 00:20:06,065][106225] Updated weights for policy 1, policy_version 708930 (0.0007) [2023-12-28 00:20:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 362610688. Throughput: 0: 9907.9, 1: 10014.2. Samples: 362615860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:06,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-5.417')] [2023-12-28 00:20:06,584][106226] Updated weights for policy 0, policy_version 707162 (0.0007) [2023-12-28 00:20:06,650][106226] Updated weights for policy 0, policy_version 707172 (0.0006) [2023-12-28 00:20:06,707][106225] Updated weights for policy 1, policy_version 708940 (0.0008) [2023-12-28 00:20:06,712][106226] Updated weights for policy 0, policy_version 707182 (0.0007) [2023-12-28 00:20:06,766][106226] Updated weights for policy 0, policy_version 707192 (0.0008) [2023-12-28 00:20:06,768][106225] Updated weights for policy 1, policy_version 708950 (0.0008) [2023-12-28 00:20:06,832][106225] Updated weights for policy 1, policy_version 708960 (0.0010) [2023-12-28 00:20:07,403][106226] Updated weights for policy 0, policy_version 707202 (0.0008) [2023-12-28 00:20:07,414][106225] Updated weights for policy 1, policy_version 708970 (0.0006) [2023-12-28 00:20:07,465][106226] Updated weights for policy 0, policy_version 707212 (0.0009) [2023-12-28 00:20:07,471][106225] Updated weights for policy 1, policy_version 708980 (0.0006) [2023-12-28 00:20:07,526][106226] Updated weights for policy 0, policy_version 707222 (0.0009) [2023-12-28 00:20:07,532][106225] Updated weights for policy 1, policy_version 708990 (0.0005) [2023-12-28 00:20:07,591][106225] Updated weights for policy 1, policy_version 709000 (0.0005) [2023-12-28 00:20:08,199][106225] Updated weights for policy 1, policy_version 709010 (0.0010) [2023-12-28 00:20:08,209][106226] Updated weights for policy 0, policy_version 707232 (0.0006) [2023-12-28 00:20:08,256][106225] Updated weights for policy 1, policy_version 709020 (0.0010) [2023-12-28 00:20:08,269][106226] Updated weights for policy 0, policy_version 707242 (0.0006) [2023-12-28 00:20:08,323][106225] Updated weights for policy 1, policy_version 709030 (0.0010) [2023-12-28 00:20:08,325][106226] Updated weights for policy 0, policy_version 707252 (0.0008) [2023-12-28 00:20:09,032][106225] Updated weights for policy 1, policy_version 709040 (0.0007) [2023-12-28 00:20:09,055][106226] Updated weights for policy 0, policy_version 707262 (0.0007) [2023-12-28 00:20:09,093][106225] Updated weights for policy 1, policy_version 709050 (0.0008) [2023-12-28 00:20:09,124][106226] Updated weights for policy 0, policy_version 707272 (0.0007) [2023-12-28 00:20:09,162][106225] Updated weights for policy 1, policy_version 709060 (0.0009) [2023-12-28 00:20:09,185][106226] Updated weights for policy 0, policy_version 707282 (0.0006) [2023-12-28 00:20:09,924][106226] Updated weights for policy 0, policy_version 707292 (0.0009) [2023-12-28 00:20:09,934][106225] Updated weights for policy 1, policy_version 709070 (0.0007) [2023-12-28 00:20:09,988][106226] Updated weights for policy 0, policy_version 707302 (0.0011) [2023-12-28 00:20:10,001][106225] Updated weights for policy 1, policy_version 709080 (0.0006) [2023-12-28 00:20:10,050][106226] Updated weights for policy 0, policy_version 707312 (0.0011) [2023-12-28 00:20:10,064][106225] Updated weights for policy 1, policy_version 709090 (0.0006) [2023-12-28 00:20:10,724][106226] Updated weights for policy 0, policy_version 707322 (0.0011) [2023-12-28 00:20:10,785][106226] Updated weights for policy 0, policy_version 707332 (0.0011) [2023-12-28 00:20:10,797][106225] Updated weights for policy 1, policy_version 709100 (0.0008) [2023-12-28 00:20:10,845][106226] Updated weights for policy 0, policy_version 707342 (0.0010) [2023-12-28 00:20:10,847][106225] Updated weights for policy 1, policy_version 709110 (0.0005) [2023-12-28 00:20:10,897][106225] Updated weights for policy 1, policy_version 709120 (0.0006) [2023-12-28 00:20:10,902][106226] Updated weights for policy 0, policy_version 707352 (0.0011) [2023-12-28 00:20:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 362708992. Throughput: 0: 9916.2, 1: 10086.6. Samples: 362677184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:11,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-5.176')] [2023-12-28 00:20:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000707352_181133312.pth... [2023-12-28 00:20:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000709128_181575680.pth... [2023-12-28 00:20:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000706200_180838400.pth [2023-12-28 00:20:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000707944_181272576.pth [2023-12-28 00:20:11,651][106225] Updated weights for policy 1, policy_version 709130 (0.0007) [2023-12-28 00:20:11,669][106226] Updated weights for policy 0, policy_version 707362 (0.0010) [2023-12-28 00:20:11,711][106225] Updated weights for policy 1, policy_version 709140 (0.0007) [2023-12-28 00:20:11,733][106226] Updated weights for policy 0, policy_version 707372 (0.0010) [2023-12-28 00:20:11,778][106225] Updated weights for policy 1, policy_version 709150 (0.0009) [2023-12-28 00:20:11,798][106226] Updated weights for policy 0, policy_version 707382 (0.0009) [2023-12-28 00:20:11,832][106225] Updated weights for policy 1, policy_version 709160 (0.0009) [2023-12-28 00:20:12,532][106226] Updated weights for policy 0, policy_version 707392 (0.0010) [2023-12-28 00:20:12,595][106226] Updated weights for policy 0, policy_version 707402 (0.0011) [2023-12-28 00:20:12,621][106225] Updated weights for policy 1, policy_version 709170 (0.0007) [2023-12-28 00:20:12,660][106226] Updated weights for policy 0, policy_version 707412 (0.0011) [2023-12-28 00:20:12,688][106225] Updated weights for policy 1, policy_version 709180 (0.0007) [2023-12-28 00:20:12,750][106225] Updated weights for policy 1, policy_version 709190 (0.0009) [2023-12-28 00:20:13,297][106225] Updated weights for policy 1, policy_version 709200 (0.0007) [2023-12-28 00:20:13,356][106225] Updated weights for policy 1, policy_version 709210 (0.0010) [2023-12-28 00:20:13,403][106226] Updated weights for policy 0, policy_version 707422 (0.0010) [2023-12-28 00:20:13,413][106225] Updated weights for policy 1, policy_version 709220 (0.0010) [2023-12-28 00:20:13,464][106226] Updated weights for policy 0, policy_version 707432 (0.0007) [2023-12-28 00:20:13,512][106226] Updated weights for policy 0, policy_version 707442 (0.0005) [2023-12-28 00:20:14,058][106226] Updated weights for policy 0, policy_version 707452 (0.0006) [2023-12-28 00:20:14,059][106225] Updated weights for policy 1, policy_version 709230 (0.0008) [2023-12-28 00:20:14,111][106225] Updated weights for policy 1, policy_version 709240 (0.0005) [2023-12-28 00:20:14,112][106226] Updated weights for policy 0, policy_version 707462 (0.0011) [2023-12-28 00:20:14,158][106225] Updated weights for policy 1, policy_version 709250 (0.0005) [2023-12-28 00:20:14,170][106226] Updated weights for policy 0, policy_version 707472 (0.0010) [2023-12-28 00:20:14,870][106225] Updated weights for policy 1, policy_version 709260 (0.0008) [2023-12-28 00:20:14,874][106226] Updated weights for policy 0, policy_version 707482 (0.0010) [2023-12-28 00:20:14,929][106225] Updated weights for policy 1, policy_version 709270 (0.0009) [2023-12-28 00:20:14,937][106226] Updated weights for policy 0, policy_version 707492 (0.0006) [2023-12-28 00:20:14,997][106226] Updated weights for policy 0, policy_version 707502 (0.0006) [2023-12-28 00:20:14,998][106225] Updated weights for policy 1, policy_version 709280 (0.0008) [2023-12-28 00:20:15,058][106226] Updated weights for policy 0, policy_version 707512 (0.0007) [2023-12-28 00:20:15,651][106226] Updated weights for policy 0, policy_version 707522 (0.0006) [2023-12-28 00:20:15,699][106226] Updated weights for policy 0, policy_version 707532 (0.0005) [2023-12-28 00:20:15,745][106226] Updated weights for policy 0, policy_version 707542 (0.0005) [2023-12-28 00:20:15,800][106225] Updated weights for policy 1, policy_version 709290 (0.0008) [2023-12-28 00:20:15,853][106225] Updated weights for policy 1, policy_version 709300 (0.0009) [2023-12-28 00:20:15,911][106225] Updated weights for policy 1, policy_version 709311 (0.0008) [2023-12-28 00:20:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 362807296. Throughput: 0: 9873.0, 1: 9946.7. Samples: 362794576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:16,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.582')] [2023-12-28 00:20:16,376][106226] Updated weights for policy 0, policy_version 707552 (0.0008) [2023-12-28 00:20:16,435][106226] Updated weights for policy 0, policy_version 707562 (0.0006) [2023-12-28 00:20:16,490][106226] Updated weights for policy 0, policy_version 707572 (0.0006) [2023-12-28 00:20:16,628][106225] Updated weights for policy 1, policy_version 709321 (0.0008) [2023-12-28 00:20:16,680][106225] Updated weights for policy 1, policy_version 709331 (0.0008) [2023-12-28 00:20:16,724][106225] Updated weights for policy 1, policy_version 709341 (0.0008) [2023-12-28 00:20:16,772][106225] Updated weights for policy 1, policy_version 709351 (0.0008) [2023-12-28 00:20:17,130][106226] Updated weights for policy 0, policy_version 707582 (0.0008) [2023-12-28 00:20:17,187][106226] Updated weights for policy 0, policy_version 707592 (0.0010) [2023-12-28 00:20:17,237][106226] Updated weights for policy 0, policy_version 707602 (0.0010) [2023-12-28 00:20:17,549][106225] Updated weights for policy 1, policy_version 709361 (0.0009) [2023-12-28 00:20:17,598][106225] Updated weights for policy 1, policy_version 709371 (0.0008) [2023-12-28 00:20:17,648][106225] Updated weights for policy 1, policy_version 709382 (0.0008) [2023-12-28 00:20:17,825][106226] Updated weights for policy 0, policy_version 707612 (0.0010) [2023-12-28 00:20:17,888][106226] Updated weights for policy 0, policy_version 707622 (0.0005) [2023-12-28 00:20:17,950][106226] Updated weights for policy 0, policy_version 707632 (0.0007) [2023-12-28 00:20:18,407][106225] Updated weights for policy 1, policy_version 709392 (0.0009) [2023-12-28 00:20:18,465][106225] Updated weights for policy 1, policy_version 709402 (0.0007) [2023-12-28 00:20:18,530][106225] Updated weights for policy 1, policy_version 709412 (0.0008) [2023-12-28 00:20:18,635][106226] Updated weights for policy 0, policy_version 707642 (0.0010) [2023-12-28 00:20:18,699][106226] Updated weights for policy 0, policy_version 707652 (0.0008) [2023-12-28 00:20:18,758][106226] Updated weights for policy 0, policy_version 707662 (0.0008) [2023-12-28 00:20:18,816][106226] Updated weights for policy 0, policy_version 707672 (0.0008) [2023-12-28 00:20:19,231][106225] Updated weights for policy 1, policy_version 709422 (0.0008) [2023-12-28 00:20:19,289][106225] Updated weights for policy 1, policy_version 709432 (0.0008) [2023-12-28 00:20:19,347][106225] Updated weights for policy 1, policy_version 709442 (0.0009) [2023-12-28 00:20:19,577][106226] Updated weights for policy 0, policy_version 707682 (0.0008) [2023-12-28 00:20:19,641][106226] Updated weights for policy 0, policy_version 707692 (0.0009) [2023-12-28 00:20:19,702][106226] Updated weights for policy 0, policy_version 707702 (0.0009) [2023-12-28 00:20:20,114][106225] Updated weights for policy 1, policy_version 709452 (0.0007) [2023-12-28 00:20:20,174][106225] Updated weights for policy 1, policy_version 709462 (0.0005) [2023-12-28 00:20:20,229][106225] Updated weights for policy 1, policy_version 709472 (0.0009) [2023-12-28 00:20:20,493][106226] Updated weights for policy 0, policy_version 707712 (0.0008) [2023-12-28 00:20:20,541][106226] Updated weights for policy 0, policy_version 707722 (0.0008) [2023-12-28 00:20:20,609][106226] Updated weights for policy 0, policy_version 707732 (0.0009) [2023-12-28 00:20:20,973][106225] Updated weights for policy 1, policy_version 709482 (0.0006) [2023-12-28 00:20:21,048][106225] Updated weights for policy 1, policy_version 709492 (0.0007) [2023-12-28 00:20:21,110][106225] Updated weights for policy 1, policy_version 709502 (0.0008) [2023-12-28 00:20:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 362897408. Throughput: 0: 9913.0, 1: 9868.1. Samples: 362911764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:21,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-5.351')] [2023-12-28 00:20:21,178][106225] Updated weights for policy 1, policy_version 709512 (0.0009) [2023-12-28 00:20:21,320][106226] Updated weights for policy 0, policy_version 707742 (0.0008) [2023-12-28 00:20:21,394][106226] Updated weights for policy 0, policy_version 707752 (0.0008) [2023-12-28 00:20:21,453][106226] Updated weights for policy 0, policy_version 707762 (0.0008) [2023-12-28 00:20:21,932][106225] Updated weights for policy 1, policy_version 709522 (0.0008) [2023-12-28 00:20:21,997][106225] Updated weights for policy 1, policy_version 709532 (0.0008) [2023-12-28 00:20:22,061][106225] Updated weights for policy 1, policy_version 709542 (0.0007) [2023-12-28 00:20:22,245][106226] Updated weights for policy 0, policy_version 707772 (0.0008) [2023-12-28 00:20:22,303][106226] Updated weights for policy 0, policy_version 707782 (0.0008) [2023-12-28 00:20:22,365][106226] Updated weights for policy 0, policy_version 707792 (0.0008) [2023-12-28 00:20:22,779][106225] Updated weights for policy 1, policy_version 709552 (0.0007) [2023-12-28 00:20:22,835][106225] Updated weights for policy 1, policy_version 709562 (0.0006) [2023-12-28 00:20:22,891][106225] Updated weights for policy 1, policy_version 709572 (0.0005) [2023-12-28 00:20:23,053][106226] Updated weights for policy 0, policy_version 707802 (0.0007) [2023-12-28 00:20:23,109][106226] Updated weights for policy 0, policy_version 707812 (0.0005) [2023-12-28 00:20:23,176][106226] Updated weights for policy 0, policy_version 707822 (0.0009) [2023-12-28 00:20:23,233][106226] Updated weights for policy 0, policy_version 707832 (0.0008) [2023-12-28 00:20:23,432][106225] Updated weights for policy 1, policy_version 709582 (0.0005) [2023-12-28 00:20:23,489][106225] Updated weights for policy 1, policy_version 709592 (0.0005) [2023-12-28 00:20:23,554][106225] Updated weights for policy 1, policy_version 709602 (0.0007) [2023-12-28 00:20:23,902][106226] Updated weights for policy 0, policy_version 707842 (0.0005) [2023-12-28 00:20:23,960][106226] Updated weights for policy 0, policy_version 707852 (0.0008) [2023-12-28 00:20:24,036][106226] Updated weights for policy 0, policy_version 707862 (0.0010) [2023-12-28 00:20:24,221][106225] Updated weights for policy 1, policy_version 709612 (0.0008) [2023-12-28 00:20:24,270][106225] Updated weights for policy 1, policy_version 709622 (0.0006) [2023-12-28 00:20:24,324][106225] Updated weights for policy 1, policy_version 709632 (0.0008) [2023-12-28 00:20:24,687][106226] Updated weights for policy 0, policy_version 707872 (0.0006) [2023-12-28 00:20:24,756][106226] Updated weights for policy 0, policy_version 707882 (0.0007) [2023-12-28 00:20:24,811][106226] Updated weights for policy 0, policy_version 707892 (0.0006) [2023-12-28 00:20:24,901][106225] Updated weights for policy 1, policy_version 709642 (0.0005) [2023-12-28 00:20:24,960][106225] Updated weights for policy 1, policy_version 709652 (0.0006) [2023-12-28 00:20:25,015][106225] Updated weights for policy 1, policy_version 709662 (0.0007) [2023-12-28 00:20:25,063][106225] Updated weights for policy 1, policy_version 709672 (0.0007) [2023-12-28 00:20:25,477][106226] Updated weights for policy 0, policy_version 707902 (0.0007) [2023-12-28 00:20:25,544][106226] Updated weights for policy 0, policy_version 707912 (0.0005) [2023-12-28 00:20:25,609][106226] Updated weights for policy 0, policy_version 707922 (0.0005) [2023-12-28 00:20:25,763][106225] Updated weights for policy 1, policy_version 709682 (0.0009) [2023-12-28 00:20:25,822][106225] Updated weights for policy 1, policy_version 709692 (0.0008) [2023-12-28 00:20:25,869][106225] Updated weights for policy 1, policy_version 709702 (0.0008) [2023-12-28 00:20:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 363003904. Throughput: 0: 9889.5, 1: 9886.6. Samples: 362970772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:26,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-5.567')] [2023-12-28 00:20:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000707928_181280768.pth... [2023-12-28 00:20:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000709704_181723136.pth... [2023-12-28 00:20:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000706776_180985856.pth [2023-12-28 00:20:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000708552_181428224.pth [2023-12-28 00:20:26,220][106226] Updated weights for policy 0, policy_version 707932 (0.0007) [2023-12-28 00:20:26,283][106226] Updated weights for policy 0, policy_version 707942 (0.0010) [2023-12-28 00:20:26,340][106226] Updated weights for policy 0, policy_version 707952 (0.0010) [2023-12-28 00:20:26,603][106225] Updated weights for policy 1, policy_version 709712 (0.0008) [2023-12-28 00:20:26,655][106225] Updated weights for policy 1, policy_version 709722 (0.0008) [2023-12-28 00:20:26,700][106225] Updated weights for policy 1, policy_version 709732 (0.0007) [2023-12-28 00:20:27,048][106226] Updated weights for policy 0, policy_version 707962 (0.0011) [2023-12-28 00:20:27,121][106226] Updated weights for policy 0, policy_version 707972 (0.0011) [2023-12-28 00:20:27,184][106226] Updated weights for policy 0, policy_version 707982 (0.0005) [2023-12-28 00:20:27,252][106226] Updated weights for policy 0, policy_version 707992 (0.0005) [2023-12-28 00:20:27,335][106225] Updated weights for policy 1, policy_version 709742 (0.0009) [2023-12-28 00:20:27,384][106225] Updated weights for policy 1, policy_version 709752 (0.0010) [2023-12-28 00:20:27,429][106225] Updated weights for policy 1, policy_version 709762 (0.0010) [2023-12-28 00:20:27,867][106226] Updated weights for policy 0, policy_version 708002 (0.0010) [2023-12-28 00:20:27,926][106226] Updated weights for policy 0, policy_version 708012 (0.0010) [2023-12-28 00:20:27,988][106226] Updated weights for policy 0, policy_version 708022 (0.0010) [2023-12-28 00:20:28,037][106225] Updated weights for policy 1, policy_version 709772 (0.0010) [2023-12-28 00:20:28,086][106225] Updated weights for policy 1, policy_version 709782 (0.0006) [2023-12-28 00:20:28,140][106225] Updated weights for policy 1, policy_version 709792 (0.0005) [2023-12-28 00:20:28,690][106226] Updated weights for policy 0, policy_version 708032 (0.0008) [2023-12-28 00:20:28,735][106225] Updated weights for policy 1, policy_version 709802 (0.0007) [2023-12-28 00:20:28,753][106226] Updated weights for policy 0, policy_version 708042 (0.0007) [2023-12-28 00:20:28,789][106225] Updated weights for policy 1, policy_version 709812 (0.0010) [2023-12-28 00:20:28,815][106226] Updated weights for policy 0, policy_version 708052 (0.0006) [2023-12-28 00:20:28,839][106225] Updated weights for policy 1, policy_version 709822 (0.0010) [2023-12-28 00:20:28,883][106225] Updated weights for policy 1, policy_version 709832 (0.0010) [2023-12-28 00:20:29,557][106226] Updated weights for policy 0, policy_version 708062 (0.0005) [2023-12-28 00:20:29,570][106225] Updated weights for policy 1, policy_version 709842 (0.0011) [2023-12-28 00:20:29,615][106226] Updated weights for policy 0, policy_version 708072 (0.0005) [2023-12-28 00:20:29,629][106225] Updated weights for policy 1, policy_version 709852 (0.0010) [2023-12-28 00:20:29,670][106226] Updated weights for policy 0, policy_version 708082 (0.0006) [2023-12-28 00:20:29,686][106225] Updated weights for policy 1, policy_version 709862 (0.0010) [2023-12-28 00:20:30,320][106226] Updated weights for policy 0, policy_version 708092 (0.0008) [2023-12-28 00:20:30,383][106226] Updated weights for policy 0, policy_version 708102 (0.0010) [2023-12-28 00:20:30,423][106225] Updated weights for policy 1, policy_version 709872 (0.0010) [2023-12-28 00:20:30,445][106226] Updated weights for policy 0, policy_version 708112 (0.0011) [2023-12-28 00:20:30,474][106225] Updated weights for policy 1, policy_version 709882 (0.0009) [2023-12-28 00:20:30,532][106225] Updated weights for policy 1, policy_version 709892 (0.0010) [2023-12-28 00:20:31,124][106226] Updated weights for policy 0, policy_version 708122 (0.0010) [2023-12-28 00:20:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 363102208. Throughput: 0: 9944.4, 1: 10023.4. Samples: 363095424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:31,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-5.513')] [2023-12-28 00:20:31,184][106226] Updated weights for policy 0, policy_version 708132 (0.0008) [2023-12-28 00:20:31,250][106226] Updated weights for policy 0, policy_version 708142 (0.0010) [2023-12-28 00:20:31,261][106225] Updated weights for policy 1, policy_version 709902 (0.0008) [2023-12-28 00:20:31,314][106226] Updated weights for policy 0, policy_version 708152 (0.0010) [2023-12-28 00:20:31,321][106225] Updated weights for policy 1, policy_version 709912 (0.0008) [2023-12-28 00:20:31,389][106225] Updated weights for policy 1, policy_version 709922 (0.0008) [2023-12-28 00:20:32,049][106226] Updated weights for policy 0, policy_version 708162 (0.0005) [2023-12-28 00:20:32,124][106226] Updated weights for policy 0, policy_version 708172 (0.0008) [2023-12-28 00:20:32,127][106225] Updated weights for policy 1, policy_version 709932 (0.0007) [2023-12-28 00:20:32,187][106226] Updated weights for policy 0, policy_version 708182 (0.0011) [2023-12-28 00:20:32,191][106225] Updated weights for policy 1, policy_version 709942 (0.0005) [2023-12-28 00:20:32,247][106225] Updated weights for policy 1, policy_version 709952 (0.0005) [2023-12-28 00:20:32,870][106226] Updated weights for policy 0, policy_version 708192 (0.0011) [2023-12-28 00:20:32,911][106225] Updated weights for policy 1, policy_version 709962 (0.0006) [2023-12-28 00:20:32,920][106226] Updated weights for policy 0, policy_version 708202 (0.0010) [2023-12-28 00:20:32,961][106225] Updated weights for policy 1, policy_version 709972 (0.0005) [2023-12-28 00:20:32,973][106226] Updated weights for policy 0, policy_version 708212 (0.0010) [2023-12-28 00:20:33,021][106225] Updated weights for policy 1, policy_version 709982 (0.0005) [2023-12-28 00:20:33,085][106225] Updated weights for policy 1, policy_version 709992 (0.0007) [2023-12-28 00:20:33,737][106225] Updated weights for policy 1, policy_version 710002 (0.0007) [2023-12-28 00:20:33,739][106226] Updated weights for policy 0, policy_version 708222 (0.0011) [2023-12-28 00:20:33,806][106225] Updated weights for policy 1, policy_version 710012 (0.0010) [2023-12-28 00:20:33,812][106226] Updated weights for policy 0, policy_version 708232 (0.0011) [2023-12-28 00:20:33,870][106225] Updated weights for policy 1, policy_version 710022 (0.0006) [2023-12-28 00:20:33,875][106226] Updated weights for policy 0, policy_version 708242 (0.0011) [2023-12-28 00:20:34,485][106226] Updated weights for policy 0, policy_version 708252 (0.0009) [2023-12-28 00:20:34,557][106226] Updated weights for policy 0, policy_version 708262 (0.0011) [2023-12-28 00:20:34,619][106226] Updated weights for policy 0, policy_version 708272 (0.0010) [2023-12-28 00:20:34,664][106225] Updated weights for policy 1, policy_version 710032 (0.0007) [2023-12-28 00:20:34,731][106225] Updated weights for policy 1, policy_version 710042 (0.0008) [2023-12-28 00:20:34,796][106225] Updated weights for policy 1, policy_version 710052 (0.0007) [2023-12-28 00:20:35,217][106226] Updated weights for policy 0, policy_version 708282 (0.0006) [2023-12-28 00:20:35,265][106226] Updated weights for policy 0, policy_version 708292 (0.0007) [2023-12-28 00:20:35,317][106226] Updated weights for policy 0, policy_version 708302 (0.0010) [2023-12-28 00:20:35,376][106226] Updated weights for policy 0, policy_version 708312 (0.0010) [2023-12-28 00:20:35,543][106225] Updated weights for policy 1, policy_version 710062 (0.0008) [2023-12-28 00:20:35,596][106225] Updated weights for policy 1, policy_version 710072 (0.0008) [2023-12-28 00:20:35,655][106225] Updated weights for policy 1, policy_version 710082 (0.0006) [2023-12-28 00:20:36,037][106226] Updated weights for policy 0, policy_version 708322 (0.0010) [2023-12-28 00:20:36,098][106226] Updated weights for policy 0, policy_version 708332 (0.0010) [2023-12-28 00:20:36,164][106226] Updated weights for policy 0, policy_version 708342 (0.0011) [2023-12-28 00:20:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 363200512. Throughput: 0: 9961.8, 1: 9968.2. Samples: 363214304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:36,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.585')] [2023-12-28 00:20:36,455][106225] Updated weights for policy 1, policy_version 710092 (0.0008) [2023-12-28 00:20:36,521][106225] Updated weights for policy 1, policy_version 710102 (0.0008) [2023-12-28 00:20:36,586][106225] Updated weights for policy 1, policy_version 710112 (0.0008) [2023-12-28 00:20:36,838][106226] Updated weights for policy 0, policy_version 708352 (0.0011) [2023-12-28 00:20:36,906][106226] Updated weights for policy 0, policy_version 708362 (0.0011) [2023-12-28 00:20:36,971][106226] Updated weights for policy 0, policy_version 708372 (0.0008) [2023-12-28 00:20:37,338][106225] Updated weights for policy 1, policy_version 710122 (0.0010) [2023-12-28 00:20:37,398][106225] Updated weights for policy 1, policy_version 710132 (0.0008) [2023-12-28 00:20:37,462][106225] Updated weights for policy 1, policy_version 710142 (0.0008) [2023-12-28 00:20:37,515][106225] Updated weights for policy 1, policy_version 710152 (0.0007) [2023-12-28 00:20:37,642][106226] Updated weights for policy 0, policy_version 708382 (0.0010) [2023-12-28 00:20:37,702][106226] Updated weights for policy 0, policy_version 708392 (0.0010) [2023-12-28 00:20:37,767][106226] Updated weights for policy 0, policy_version 708402 (0.0011) [2023-12-28 00:20:38,123][106225] Updated weights for policy 1, policy_version 710162 (0.0007) [2023-12-28 00:20:38,176][106225] Updated weights for policy 1, policy_version 710172 (0.0007) [2023-12-28 00:20:38,227][106225] Updated weights for policy 1, policy_version 710182 (0.0008) [2023-12-28 00:20:38,476][106226] Updated weights for policy 0, policy_version 708412 (0.0011) [2023-12-28 00:20:38,538][106226] Updated weights for policy 0, policy_version 708422 (0.0011) [2023-12-28 00:20:38,602][106226] Updated weights for policy 0, policy_version 708432 (0.0011) [2023-12-28 00:20:38,953][106225] Updated weights for policy 1, policy_version 710192 (0.0008) [2023-12-28 00:20:39,005][106225] Updated weights for policy 1, policy_version 710202 (0.0008) [2023-12-28 00:20:39,053][106225] Updated weights for policy 1, policy_version 710212 (0.0008) [2023-12-28 00:20:39,311][106226] Updated weights for policy 0, policy_version 708442 (0.0011) [2023-12-28 00:20:39,380][106226] Updated weights for policy 0, policy_version 708452 (0.0009) [2023-12-28 00:20:39,450][106226] Updated weights for policy 0, policy_version 708462 (0.0008) [2023-12-28 00:20:39,509][106226] Updated weights for policy 0, policy_version 708472 (0.0009) [2023-12-28 00:20:39,847][106225] Updated weights for policy 1, policy_version 710222 (0.0009) [2023-12-28 00:20:39,917][106225] Updated weights for policy 1, policy_version 710232 (0.0008) [2023-12-28 00:20:39,984][106225] Updated weights for policy 1, policy_version 710242 (0.0008) [2023-12-28 00:20:40,257][106226] Updated weights for policy 0, policy_version 708482 (0.0007) [2023-12-28 00:20:40,324][106226] Updated weights for policy 0, policy_version 708492 (0.0006) [2023-12-28 00:20:40,388][106226] Updated weights for policy 0, policy_version 708502 (0.0008) [2023-12-28 00:20:40,716][106225] Updated weights for policy 1, policy_version 710252 (0.0011) [2023-12-28 00:20:40,781][106225] Updated weights for policy 1, policy_version 710262 (0.0011) [2023-12-28 00:20:40,842][106225] Updated weights for policy 1, policy_version 710272 (0.0011) [2023-12-28 00:20:41,105][106226] Updated weights for policy 0, policy_version 708512 (0.0008) [2023-12-28 00:20:41,174][106226] Updated weights for policy 0, policy_version 708522 (0.0010) [2023-12-28 00:20:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 363298816. Throughput: 0: 9986.2, 1: 9985.9. Samples: 363273404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:41,176][105115] Avg episode reward: [(0, '-4.399'), (1, '-5.439')] [2023-12-28 00:20:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000710280_181870592.pth... [2023-12-28 00:20:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000709128_181575680.pth [2023-12-28 00:20:41,236][106226] Updated weights for policy 0, policy_version 708532 (0.0009) [2023-12-28 00:20:41,262][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000708536_181436416.pth... [2023-12-28 00:20:41,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000707352_181133312.pth [2023-12-28 00:20:41,670][106225] Updated weights for policy 1, policy_version 710282 (0.0011) [2023-12-28 00:20:41,738][106225] Updated weights for policy 1, policy_version 710292 (0.0018) [2023-12-28 00:20:41,806][106225] Updated weights for policy 1, policy_version 710302 (0.0009) [2023-12-28 00:20:41,859][106225] Updated weights for policy 1, policy_version 710312 (0.0007) [2023-12-28 00:20:42,017][106226] Updated weights for policy 0, policy_version 708542 (0.0009) [2023-12-28 00:20:42,077][106226] Updated weights for policy 0, policy_version 708552 (0.0009) [2023-12-28 00:20:42,136][106226] Updated weights for policy 0, policy_version 708562 (0.0009) [2023-12-28 00:20:42,555][106225] Updated weights for policy 1, policy_version 710322 (0.0010) [2023-12-28 00:20:42,626][106225] Updated weights for policy 1, policy_version 710332 (0.0009) [2023-12-28 00:20:42,691][106225] Updated weights for policy 1, policy_version 710342 (0.0008) [2023-12-28 00:20:42,864][106226] Updated weights for policy 0, policy_version 708572 (0.0007) [2023-12-28 00:20:42,921][106226] Updated weights for policy 0, policy_version 708582 (0.0005) [2023-12-28 00:20:42,975][106226] Updated weights for policy 0, policy_version 708592 (0.0008) [2023-12-28 00:20:43,390][106225] Updated weights for policy 1, policy_version 710352 (0.0010) [2023-12-28 00:20:43,449][106225] Updated weights for policy 1, policy_version 710362 (0.0010) [2023-12-28 00:20:43,515][106225] Updated weights for policy 1, policy_version 710372 (0.0010) [2023-12-28 00:20:43,644][106226] Updated weights for policy 0, policy_version 708602 (0.0008) [2023-12-28 00:20:43,695][106226] Updated weights for policy 0, policy_version 708612 (0.0007) [2023-12-28 00:20:43,747][106226] Updated weights for policy 0, policy_version 708622 (0.0005) [2023-12-28 00:20:43,809][106226] Updated weights for policy 0, policy_version 708632 (0.0005) [2023-12-28 00:20:44,149][106225] Updated weights for policy 1, policy_version 710382 (0.0010) [2023-12-28 00:20:44,208][106225] Updated weights for policy 1, policy_version 710392 (0.0010) [2023-12-28 00:20:44,264][106225] Updated weights for policy 1, policy_version 710402 (0.0010) [2023-12-28 00:20:44,440][106226] Updated weights for policy 0, policy_version 708642 (0.0007) [2023-12-28 00:20:44,502][106226] Updated weights for policy 0, policy_version 708652 (0.0008) [2023-12-28 00:20:44,564][106226] Updated weights for policy 0, policy_version 708662 (0.0008) [2023-12-28 00:20:44,979][106225] Updated weights for policy 1, policy_version 710412 (0.0010) [2023-12-28 00:20:45,045][106225] Updated weights for policy 1, policy_version 710422 (0.0011) [2023-12-28 00:20:45,110][106225] Updated weights for policy 1, policy_version 710432 (0.0011) [2023-12-28 00:20:45,274][106226] Updated weights for policy 0, policy_version 708672 (0.0007) [2023-12-28 00:20:45,337][106226] Updated weights for policy 0, policy_version 708682 (0.0008) [2023-12-28 00:20:45,396][106226] Updated weights for policy 0, policy_version 708692 (0.0008) [2023-12-28 00:20:45,782][106225] Updated weights for policy 1, policy_version 710442 (0.0010) [2023-12-28 00:20:45,839][106225] Updated weights for policy 1, policy_version 710452 (0.0008) [2023-12-28 00:20:45,898][106225] Updated weights for policy 1, policy_version 710462 (0.0008) [2023-12-28 00:20:45,959][106225] Updated weights for policy 1, policy_version 710472 (0.0008) [2023-12-28 00:20:46,116][106226] Updated weights for policy 0, policy_version 708702 (0.0009) [2023-12-28 00:20:46,170][106226] Updated weights for policy 0, policy_version 708712 (0.0009) [2023-12-28 00:20:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 363397120. Throughput: 0: 9972.5, 1: 9944.4. Samples: 363388432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:46,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.718')] [2023-12-28 00:20:46,229][106226] Updated weights for policy 0, policy_version 708722 (0.0010) [2023-12-28 00:20:46,567][106225] Updated weights for policy 1, policy_version 710482 (0.0007) [2023-12-28 00:20:46,624][106225] Updated weights for policy 1, policy_version 710492 (0.0005) [2023-12-28 00:20:46,687][106225] Updated weights for policy 1, policy_version 710502 (0.0005) [2023-12-28 00:20:47,020][106226] Updated weights for policy 0, policy_version 708732 (0.0009) [2023-12-28 00:20:47,068][106226] Updated weights for policy 0, policy_version 708742 (0.0008) [2023-12-28 00:20:47,117][106226] Updated weights for policy 0, policy_version 708752 (0.0007) [2023-12-28 00:20:47,320][106225] Updated weights for policy 1, policy_version 710512 (0.0006) [2023-12-28 00:20:47,382][106225] Updated weights for policy 1, policy_version 710522 (0.0008) [2023-12-28 00:20:47,439][106225] Updated weights for policy 1, policy_version 710532 (0.0010) [2023-12-28 00:20:47,819][106226] Updated weights for policy 0, policy_version 708762 (0.0009) [2023-12-28 00:20:47,871][106226] Updated weights for policy 0, policy_version 708772 (0.0010) [2023-12-28 00:20:47,921][106226] Updated weights for policy 0, policy_version 708782 (0.0010) [2023-12-28 00:20:47,970][106226] Updated weights for policy 0, policy_version 708792 (0.0010) [2023-12-28 00:20:48,131][106225] Updated weights for policy 1, policy_version 710542 (0.0010) [2023-12-28 00:20:48,191][106225] Updated weights for policy 1, policy_version 710552 (0.0008) [2023-12-28 00:20:48,252][106225] Updated weights for policy 1, policy_version 710562 (0.0010) [2023-12-28 00:20:48,699][106226] Updated weights for policy 0, policy_version 708802 (0.0008) [2023-12-28 00:20:48,756][106226] Updated weights for policy 0, policy_version 708812 (0.0006) [2023-12-28 00:20:48,817][106226] Updated weights for policy 0, policy_version 708822 (0.0008) [2023-12-28 00:20:48,962][106225] Updated weights for policy 1, policy_version 710572 (0.0009) [2023-12-28 00:20:49,032][106225] Updated weights for policy 1, policy_version 710582 (0.0010) [2023-12-28 00:20:49,083][106225] Updated weights for policy 1, policy_version 710592 (0.0009) [2023-12-28 00:20:49,496][106226] Updated weights for policy 0, policy_version 708832 (0.0008) [2023-12-28 00:20:49,568][106226] Updated weights for policy 0, policy_version 708842 (0.0007) [2023-12-28 00:20:49,628][106226] Updated weights for policy 0, policy_version 708852 (0.0010) [2023-12-28 00:20:49,833][106225] Updated weights for policy 1, policy_version 710602 (0.0007) [2023-12-28 00:20:49,897][106225] Updated weights for policy 1, policy_version 710612 (0.0009) [2023-12-28 00:20:49,967][106225] Updated weights for policy 1, policy_version 710622 (0.0009) [2023-12-28 00:20:50,033][106225] Updated weights for policy 1, policy_version 710632 (0.0008) [2023-12-28 00:20:50,364][106226] Updated weights for policy 0, policy_version 708862 (0.0008) [2023-12-28 00:20:50,413][106226] Updated weights for policy 0, policy_version 708872 (0.0009) [2023-12-28 00:20:50,466][106226] Updated weights for policy 0, policy_version 708882 (0.0009) [2023-12-28 00:20:50,707][106225] Updated weights for policy 1, policy_version 710642 (0.0009) [2023-12-28 00:20:50,770][106225] Updated weights for policy 1, policy_version 710652 (0.0008) [2023-12-28 00:20:50,831][106225] Updated weights for policy 1, policy_version 710662 (0.0010) [2023-12-28 00:20:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 363495424. Throughput: 0: 9898.7, 1: 9883.7. Samples: 363506068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:51,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-5.530')] [2023-12-28 00:20:51,209][106226] Updated weights for policy 0, policy_version 708892 (0.0009) [2023-12-28 00:20:51,276][106226] Updated weights for policy 0, policy_version 708902 (0.0009) [2023-12-28 00:20:51,340][106226] Updated weights for policy 0, policy_version 708912 (0.0008) [2023-12-28 00:20:51,580][106225] Updated weights for policy 1, policy_version 710672 (0.0009) [2023-12-28 00:20:51,640][106225] Updated weights for policy 1, policy_version 710682 (0.0009) [2023-12-28 00:20:51,701][106225] Updated weights for policy 1, policy_version 710692 (0.0009) [2023-12-28 00:20:52,080][106226] Updated weights for policy 0, policy_version 708922 (0.0010) [2023-12-28 00:20:52,144][106226] Updated weights for policy 0, policy_version 708932 (0.0011) [2023-12-28 00:20:52,201][106226] Updated weights for policy 0, policy_version 708942 (0.0010) [2023-12-28 00:20:52,247][106226] Updated weights for policy 0, policy_version 708952 (0.0010) [2023-12-28 00:20:52,429][106225] Updated weights for policy 1, policy_version 710702 (0.0009) [2023-12-28 00:20:52,487][106225] Updated weights for policy 1, policy_version 710712 (0.0010) [2023-12-28 00:20:52,546][106225] Updated weights for policy 1, policy_version 710722 (0.0010) [2023-12-28 00:20:52,919][106226] Updated weights for policy 0, policy_version 708962 (0.0010) [2023-12-28 00:20:52,966][106226] Updated weights for policy 0, policy_version 708972 (0.0010) [2023-12-28 00:20:53,023][106226] Updated weights for policy 0, policy_version 708982 (0.0010) [2023-12-28 00:20:53,269][106225] Updated weights for policy 1, policy_version 710732 (0.0008) [2023-12-28 00:20:53,319][106225] Updated weights for policy 1, policy_version 710742 (0.0006) [2023-12-28 00:20:53,368][106225] Updated weights for policy 1, policy_version 710752 (0.0007) [2023-12-28 00:20:53,722][106226] Updated weights for policy 0, policy_version 708992 (0.0009) [2023-12-28 00:20:53,771][106226] Updated weights for policy 0, policy_version 709002 (0.0009) [2023-12-28 00:20:53,821][106226] Updated weights for policy 0, policy_version 709012 (0.0005) [2023-12-28 00:20:53,966][106225] Updated weights for policy 1, policy_version 710762 (0.0005) [2023-12-28 00:20:54,032][106225] Updated weights for policy 1, policy_version 710772 (0.0006) [2023-12-28 00:20:54,087][106225] Updated weights for policy 1, policy_version 710782 (0.0007) [2023-12-28 00:20:54,141][106225] Updated weights for policy 1, policy_version 710792 (0.0010) [2023-12-28 00:20:54,603][106226] Updated weights for policy 0, policy_version 709022 (0.0007) [2023-12-28 00:20:54,652][106226] Updated weights for policy 0, policy_version 709032 (0.0008) [2023-12-28 00:20:54,698][106226] Updated weights for policy 0, policy_version 709042 (0.0007) [2023-12-28 00:20:54,719][106225] Updated weights for policy 1, policy_version 710802 (0.0008) [2023-12-28 00:20:54,767][106225] Updated weights for policy 1, policy_version 710812 (0.0009) [2023-12-28 00:20:54,817][106225] Updated weights for policy 1, policy_version 710822 (0.0010) [2023-12-28 00:20:55,322][106226] Updated weights for policy 0, policy_version 709052 (0.0005) [2023-12-28 00:20:55,383][106226] Updated weights for policy 0, policy_version 709062 (0.0008) [2023-12-28 00:20:55,437][106226] Updated weights for policy 0, policy_version 709072 (0.0008) [2023-12-28 00:20:55,579][106225] Updated weights for policy 1, policy_version 710832 (0.0010) [2023-12-28 00:20:55,621][106225] Updated weights for policy 1, policy_version 710842 (0.0010) [2023-12-28 00:20:55,668][106225] Updated weights for policy 1, policy_version 710852 (0.0010) [2023-12-28 00:20:56,158][106226] Updated weights for policy 0, policy_version 709082 (0.0008) [2023-12-28 00:20:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 363593728. Throughput: 0: 9888.8, 1: 9828.5. Samples: 363564460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:20:56,179][105115] Avg episode reward: [(0, '-4.157'), (1, '-5.446')] [2023-12-28 00:20:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000710856_182018048.pth... [2023-12-28 00:20:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000709704_181723136.pth [2023-12-28 00:20:56,210][106226] Updated weights for policy 0, policy_version 709092 (0.0008) [2023-12-28 00:20:56,261][106226] Updated weights for policy 0, policy_version 709102 (0.0008) [2023-12-28 00:20:56,305][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000709112_181583872.pth... [2023-12-28 00:20:56,308][106226] Updated weights for policy 0, policy_version 709112 (0.0007) [2023-12-28 00:20:56,308][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000707928_181280768.pth [2023-12-28 00:20:56,412][106225] Updated weights for policy 1, policy_version 710862 (0.0009) [2023-12-28 00:20:56,470][106225] Updated weights for policy 1, policy_version 710872 (0.0008) [2023-12-28 00:20:56,519][106225] Updated weights for policy 1, policy_version 710882 (0.0006) [2023-12-28 00:20:56,978][106226] Updated weights for policy 0, policy_version 709122 (0.0008) [2023-12-28 00:20:57,033][106226] Updated weights for policy 0, policy_version 709132 (0.0007) [2023-12-28 00:20:57,087][106226] Updated weights for policy 0, policy_version 709142 (0.0007) [2023-12-28 00:20:57,203][106225] Updated weights for policy 1, policy_version 710892 (0.0007) [2023-12-28 00:20:57,252][106225] Updated weights for policy 1, policy_version 710902 (0.0010) [2023-12-28 00:20:57,304][106225] Updated weights for policy 1, policy_version 710912 (0.0010) [2023-12-28 00:20:57,841][106226] Updated weights for policy 0, policy_version 709152 (0.0007) [2023-12-28 00:20:57,890][106226] Updated weights for policy 0, policy_version 709162 (0.0008) [2023-12-28 00:20:57,923][106225] Updated weights for policy 1, policy_version 710922 (0.0009) [2023-12-28 00:20:57,952][106226] Updated weights for policy 0, policy_version 709172 (0.0006) [2023-12-28 00:20:57,976][106225] Updated weights for policy 1, policy_version 710932 (0.0010) [2023-12-28 00:20:58,024][106225] Updated weights for policy 1, policy_version 710942 (0.0010) [2023-12-28 00:20:58,074][106225] Updated weights for policy 1, policy_version 710952 (0.0010) [2023-12-28 00:20:58,829][106225] Updated weights for policy 1, policy_version 710962 (0.0008) [2023-12-28 00:20:58,836][106226] Updated weights for policy 0, policy_version 709182 (0.0007) [2023-12-28 00:20:58,895][106225] Updated weights for policy 1, policy_version 710972 (0.0009) [2023-12-28 00:20:58,902][106226] Updated weights for policy 0, policy_version 709192 (0.0009) [2023-12-28 00:20:58,947][106225] Updated weights for policy 1, policy_version 710982 (0.0009) [2023-12-28 00:20:58,960][106226] Updated weights for policy 0, policy_version 709202 (0.0010) [2023-12-28 00:20:59,757][106226] Updated weights for policy 0, policy_version 709213 (0.0007) [2023-12-28 00:20:59,765][106225] Updated weights for policy 1, policy_version 710992 (0.0009) [2023-12-28 00:20:59,812][106226] Updated weights for policy 0, policy_version 709223 (0.0006) [2023-12-28 00:20:59,826][106225] Updated weights for policy 1, policy_version 711002 (0.0008) [2023-12-28 00:20:59,879][106226] Updated weights for policy 0, policy_version 709233 (0.0008) [2023-12-28 00:20:59,889][106225] Updated weights for policy 1, policy_version 711012 (0.0007) [2023-12-28 00:21:00,523][106225] Updated weights for policy 1, policy_version 711022 (0.0005) [2023-12-28 00:21:00,579][106225] Updated weights for policy 1, policy_version 711032 (0.0005) [2023-12-28 00:21:00,622][106226] Updated weights for policy 0, policy_version 709243 (0.0008) [2023-12-28 00:21:00,640][106225] Updated weights for policy 1, policy_version 711042 (0.0005) [2023-12-28 00:21:00,676][106226] Updated weights for policy 0, policy_version 709253 (0.0005) [2023-12-28 00:21:00,733][106226] Updated weights for policy 0, policy_version 709263 (0.0006) [2023-12-28 00:21:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 363692032. Throughput: 0: 9860.4, 1: 9857.4. Samples: 363681880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:21:01,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-5.329')] [2023-12-28 00:21:01,207][106225] Updated weights for policy 1, policy_version 711052 (0.0007) [2023-12-28 00:21:01,272][106225] Updated weights for policy 1, policy_version 711062 (0.0008) [2023-12-28 00:21:01,324][106225] Updated weights for policy 1, policy_version 711072 (0.0009) [2023-12-28 00:21:01,495][106226] Updated weights for policy 0, policy_version 709273 (0.0008) [2023-12-28 00:21:01,557][106226] Updated weights for policy 0, policy_version 709283 (0.0008) [2023-12-28 00:21:01,616][106226] Updated weights for policy 0, policy_version 709293 (0.0008) [2023-12-28 00:21:01,675][106226] Updated weights for policy 0, policy_version 709303 (0.0008) [2023-12-28 00:21:02,096][106225] Updated weights for policy 1, policy_version 711082 (0.0008) [2023-12-28 00:21:02,155][106225] Updated weights for policy 1, policy_version 711092 (0.0008) [2023-12-28 00:21:02,217][106225] Updated weights for policy 1, policy_version 711102 (0.0008) [2023-12-28 00:21:02,275][106225] Updated weights for policy 1, policy_version 711112 (0.0008) [2023-12-28 00:21:02,449][106226] Updated weights for policy 0, policy_version 709313 (0.0007) [2023-12-28 00:21:02,494][106226] Updated weights for policy 0, policy_version 709323 (0.0007) [2023-12-28 00:21:02,545][106226] Updated weights for policy 0, policy_version 709333 (0.0008) [2023-12-28 00:21:03,049][106225] Updated weights for policy 1, policy_version 711122 (0.0005) [2023-12-28 00:21:03,110][106225] Updated weights for policy 1, policy_version 711132 (0.0005) [2023-12-28 00:21:03,170][106225] Updated weights for policy 1, policy_version 711142 (0.0005) [2023-12-28 00:21:03,279][106226] Updated weights for policy 0, policy_version 709343 (0.0008) [2023-12-28 00:21:03,327][106226] Updated weights for policy 0, policy_version 709353 (0.0008) [2023-12-28 00:21:03,375][106226] Updated weights for policy 0, policy_version 709363 (0.0008) [2023-12-28 00:21:03,743][106225] Updated weights for policy 1, policy_version 711152 (0.0007) [2023-12-28 00:21:03,808][106225] Updated weights for policy 1, policy_version 711162 (0.0008) [2023-12-28 00:21:03,876][106225] Updated weights for policy 1, policy_version 711172 (0.0010) [2023-12-28 00:21:04,169][106226] Updated weights for policy 0, policy_version 709373 (0.0007) [2023-12-28 00:21:04,239][106226] Updated weights for policy 0, policy_version 709383 (0.0007) [2023-12-28 00:21:04,308][106226] Updated weights for policy 0, policy_version 709393 (0.0008) [2023-12-28 00:21:04,592][106225] Updated weights for policy 1, policy_version 711182 (0.0009) [2023-12-28 00:21:04,660][106225] Updated weights for policy 1, policy_version 711192 (0.0010) [2023-12-28 00:21:04,715][106225] Updated weights for policy 1, policy_version 711202 (0.0009) [2023-12-28 00:21:04,946][106226] Updated weights for policy 0, policy_version 709403 (0.0009) [2023-12-28 00:21:05,007][106226] Updated weights for policy 0, policy_version 709413 (0.0010) [2023-12-28 00:21:05,067][106226] Updated weights for policy 0, policy_version 709423 (0.0010) [2023-12-28 00:21:05,398][106225] Updated weights for policy 1, policy_version 711212 (0.0007) [2023-12-28 00:21:05,454][106225] Updated weights for policy 1, policy_version 711222 (0.0005) [2023-12-28 00:21:05,510][106225] Updated weights for policy 1, policy_version 711232 (0.0005) [2023-12-28 00:21:05,669][106226] Updated weights for policy 0, policy_version 709433 (0.0006) [2023-12-28 00:21:05,725][106226] Updated weights for policy 0, policy_version 709443 (0.0010) [2023-12-28 00:21:05,781][106226] Updated weights for policy 0, policy_version 709453 (0.0010) [2023-12-28 00:21:05,837][106226] Updated weights for policy 0, policy_version 709463 (0.0010) [2023-12-28 00:21:06,025][106225] Updated weights for policy 1, policy_version 711242 (0.0005) [2023-12-28 00:21:06,094][106225] Updated weights for policy 1, policy_version 711252 (0.0007) [2023-12-28 00:21:06,155][106225] Updated weights for policy 1, policy_version 711262 (0.0008) [2023-12-28 00:21:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 363790336. Throughput: 0: 9793.4, 1: 9975.6. Samples: 363801368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:21:06,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.411')] [2023-12-28 00:21:06,224][106225] Updated weights for policy 1, policy_version 711272 (0.0006) [2023-12-28 00:21:06,589][106226] Updated weights for policy 0, policy_version 709473 (0.0011) [2023-12-28 00:21:06,661][106226] Updated weights for policy 0, policy_version 709483 (0.0011) [2023-12-28 00:21:06,730][106226] Updated weights for policy 0, policy_version 709493 (0.0010) [2023-12-28 00:21:06,814][106225] Updated weights for policy 1, policy_version 711282 (0.0010) [2023-12-28 00:21:06,875][106225] Updated weights for policy 1, policy_version 711292 (0.0010) [2023-12-28 00:21:06,932][106225] Updated weights for policy 1, policy_version 711302 (0.0010) [2023-12-28 00:21:07,416][106226] Updated weights for policy 0, policy_version 709503 (0.0007) [2023-12-28 00:21:07,475][106226] Updated weights for policy 0, policy_version 709513 (0.0008) [2023-12-28 00:21:07,536][106226] Updated weights for policy 0, policy_version 709523 (0.0007) [2023-12-28 00:21:07,649][106225] Updated weights for policy 1, policy_version 711312 (0.0010) [2023-12-28 00:21:07,714][106225] Updated weights for policy 1, policy_version 711322 (0.0010) [2023-12-28 00:21:07,780][106225] Updated weights for policy 1, policy_version 711332 (0.0008) [2023-12-28 00:21:08,110][106226] Updated weights for policy 0, policy_version 709533 (0.0007) [2023-12-28 00:21:08,160][106226] Updated weights for policy 0, policy_version 709543 (0.0009) [2023-12-28 00:21:08,214][106226] Updated weights for policy 0, policy_version 709553 (0.0009) [2023-12-28 00:21:08,458][106225] Updated weights for policy 1, policy_version 711342 (0.0010) [2023-12-28 00:21:08,517][106225] Updated weights for policy 1, policy_version 711352 (0.0008) [2023-12-28 00:21:08,576][106225] Updated weights for policy 1, policy_version 711362 (0.0008) [2023-12-28 00:21:08,990][106226] Updated weights for policy 0, policy_version 709563 (0.0008) [2023-12-28 00:21:09,062][106226] Updated weights for policy 0, policy_version 709573 (0.0008) [2023-12-28 00:21:09,116][106226] Updated weights for policy 0, policy_version 709583 (0.0009) [2023-12-28 00:21:09,254][106225] Updated weights for policy 1, policy_version 711372 (0.0009) [2023-12-28 00:21:09,313][106225] Updated weights for policy 1, policy_version 711382 (0.0008) [2023-12-28 00:21:09,382][106225] Updated weights for policy 1, policy_version 711392 (0.0008) [2023-12-28 00:21:09,919][106226] Updated weights for policy 0, policy_version 709593 (0.0009) [2023-12-28 00:21:09,986][106226] Updated weights for policy 0, policy_version 709603 (0.0009) [2023-12-28 00:21:10,044][106226] Updated weights for policy 0, policy_version 709613 (0.0009) [2023-12-28 00:21:10,105][106226] Updated weights for policy 0, policy_version 709623 (0.0009) [2023-12-28 00:21:10,137][106225] Updated weights for policy 1, policy_version 711402 (0.0007) [2023-12-28 00:21:10,189][106225] Updated weights for policy 1, policy_version 711412 (0.0008) [2023-12-28 00:21:10,244][106225] Updated weights for policy 1, policy_version 711422 (0.0009) [2023-12-28 00:21:10,293][106225] Updated weights for policy 1, policy_version 711432 (0.0009) [2023-12-28 00:21:10,896][106226] Updated weights for policy 0, policy_version 709633 (0.0008) [2023-12-28 00:21:10,959][106226] Updated weights for policy 0, policy_version 709643 (0.0009) [2023-12-28 00:21:11,017][106226] Updated weights for policy 0, policy_version 709653 (0.0008) [2023-12-28 00:21:11,043][106225] Updated weights for policy 1, policy_version 711442 (0.0007) [2023-12-28 00:21:11,110][106225] Updated weights for policy 1, policy_version 711452 (0.0006) [2023-12-28 00:21:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 363888640. Throughput: 0: 9814.0, 1: 9992.2. Samples: 363862052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:21:11,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.578')] [2023-12-28 00:21:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000709656_181723136.pth... [2023-12-28 00:21:11,182][106225] Updated weights for policy 1, policy_version 711462 (0.0009) [2023-12-28 00:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000708536_181436416.pth [2023-12-28 00:21:11,195][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000711464_182173696.pth... [2023-12-28 00:21:11,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000710280_181870592.pth [2023-12-28 00:21:11,816][106226] Updated weights for policy 0, policy_version 709663 (0.0008) [2023-12-28 00:21:11,881][106226] Updated weights for policy 0, policy_version 709673 (0.0007) [2023-12-28 00:21:11,947][106226] Updated weights for policy 0, policy_version 709683 (0.0007) [2023-12-28 00:21:11,952][106225] Updated weights for policy 1, policy_version 711472 (0.0008) [2023-12-28 00:21:12,014][106225] Updated weights for policy 1, policy_version 711482 (0.0008) [2023-12-28 00:21:12,063][106225] Updated weights for policy 1, policy_version 711492 (0.0008) [2023-12-28 00:21:12,656][106226] Updated weights for policy 0, policy_version 709693 (0.0007) [2023-12-28 00:21:12,727][106226] Updated weights for policy 0, policy_version 709703 (0.0008) [2023-12-28 00:21:12,789][106226] Updated weights for policy 0, policy_version 709713 (0.0008) [2023-12-28 00:21:12,810][106225] Updated weights for policy 1, policy_version 711502 (0.0010) [2023-12-28 00:21:12,868][106225] Updated weights for policy 1, policy_version 711512 (0.0010) [2023-12-28 00:21:12,929][106225] Updated weights for policy 1, policy_version 711522 (0.0010) [2023-12-28 00:21:13,532][106226] Updated weights for policy 0, policy_version 709723 (0.0008) [2023-12-28 00:21:13,578][106226] Updated weights for policy 0, policy_version 709733 (0.0008) [2023-12-28 00:21:13,639][106226] Updated weights for policy 0, policy_version 709743 (0.0006) [2023-12-28 00:21:13,645][106225] Updated weights for policy 1, policy_version 711532 (0.0010) [2023-12-28 00:21:13,704][106225] Updated weights for policy 1, policy_version 711542 (0.0010) [2023-12-28 00:21:13,754][106225] Updated weights for policy 1, policy_version 711552 (0.0010) [2023-12-28 00:21:14,326][106226] Updated weights for policy 0, policy_version 709753 (0.0006) [2023-12-28 00:21:14,384][106226] Updated weights for policy 0, policy_version 709763 (0.0010) [2023-12-28 00:21:14,415][106225] Updated weights for policy 1, policy_version 711562 (0.0010) [2023-12-28 00:21:14,442][106226] Updated weights for policy 0, policy_version 709773 (0.0009) [2023-12-28 00:21:14,475][106225] Updated weights for policy 1, policy_version 711572 (0.0010) [2023-12-28 00:21:14,503][106226] Updated weights for policy 0, policy_version 709783 (0.0006) [2023-12-28 00:21:14,535][106225] Updated weights for policy 1, policy_version 711582 (0.0010) [2023-12-28 00:21:14,601][106225] Updated weights for policy 1, policy_version 711592 (0.0010) [2023-12-28 00:21:15,236][106226] Updated weights for policy 0, policy_version 709793 (0.0008) [2023-12-28 00:21:15,282][106225] Updated weights for policy 1, policy_version 711602 (0.0011) [2023-12-28 00:21:15,293][106226] Updated weights for policy 0, policy_version 709803 (0.0006) [2023-12-28 00:21:15,343][106225] Updated weights for policy 1, policy_version 711612 (0.0010) [2023-12-28 00:21:15,354][106226] Updated weights for policy 0, policy_version 709813 (0.0006) [2023-12-28 00:21:15,391][106225] Updated weights for policy 1, policy_version 711622 (0.0010) [2023-12-28 00:21:16,085][106226] Updated weights for policy 0, policy_version 709823 (0.0007) [2023-12-28 00:21:16,110][106225] Updated weights for policy 1, policy_version 711632 (0.0010) [2023-12-28 00:21:16,139][106226] Updated weights for policy 0, policy_version 709833 (0.0006) [2023-12-28 00:21:16,167][106225] Updated weights for policy 1, policy_version 711642 (0.0010) [2023-12-28 00:21:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19883.0). Total num frames: 363978752. Throughput: 0: 9716.9, 1: 9850.2. Samples: 363975944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:21:16,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-5.184')] [2023-12-28 00:21:16,197][106226] Updated weights for policy 0, policy_version 709843 (0.0005) [2023-12-28 00:21:16,225][106225] Updated weights for policy 1, policy_version 711652 (0.0010) [2023-12-28 00:21:16,803][106226] Updated weights for policy 0, policy_version 709853 (0.0007) [2023-12-28 00:21:16,823][106225] Updated weights for policy 1, policy_version 711662 (0.0010) [2023-12-28 00:21:16,859][106226] Updated weights for policy 0, policy_version 709863 (0.0005) [2023-12-28 00:21:16,873][106225] Updated weights for policy 1, policy_version 711672 (0.0010) [2023-12-28 00:21:16,920][106225] Updated weights for policy 1, policy_version 711682 (0.0010) [2023-12-28 00:21:16,921][106226] Updated weights for policy 0, policy_version 709873 (0.0007) [2023-12-28 00:21:17,605][106226] Updated weights for policy 0, policy_version 709883 (0.0007) [2023-12-28 00:21:17,641][106225] Updated weights for policy 1, policy_version 711692 (0.0008) [2023-12-28 00:21:17,662][106226] Updated weights for policy 0, policy_version 709893 (0.0011) [2023-12-28 00:21:17,699][106225] Updated weights for policy 1, policy_version 711702 (0.0005) [2023-12-28 00:21:17,724][106226] Updated weights for policy 0, policy_version 709903 (0.0011) [2023-12-28 00:21:17,759][106225] Updated weights for policy 1, policy_version 711712 (0.0008) [2023-12-28 00:21:18,433][106226] Updated weights for policy 0, policy_version 709913 (0.0011) [2023-12-28 00:21:18,451][106225] Updated weights for policy 1, policy_version 711722 (0.0009) [2023-12-28 00:21:18,492][106226] Updated weights for policy 0, policy_version 709923 (0.0011) [2023-12-28 00:21:18,515][106225] Updated weights for policy 1, policy_version 711732 (0.0006) [2023-12-28 00:21:18,554][106226] Updated weights for policy 0, policy_version 709933 (0.0011) [2023-12-28 00:21:18,579][106225] Updated weights for policy 1, policy_version 711742 (0.0006) [2023-12-28 00:21:18,612][106226] Updated weights for policy 0, policy_version 709943 (0.0010) [2023-12-28 00:21:18,642][106225] Updated weights for policy 1, policy_version 711752 (0.0007) [2023-12-28 00:21:19,279][106225] Updated weights for policy 1, policy_version 711762 (0.0008) [2023-12-28 00:21:19,331][106225] Updated weights for policy 1, policy_version 711772 (0.0008) [2023-12-28 00:21:19,354][106226] Updated weights for policy 0, policy_version 709953 (0.0012) [2023-12-28 00:21:19,399][106225] Updated weights for policy 1, policy_version 711782 (0.0008) [2023-12-28 00:21:19,421][106226] Updated weights for policy 0, policy_version 709963 (0.0007) [2023-12-28 00:21:19,473][106226] Updated weights for policy 0, policy_version 709973 (0.0006) [2023-12-28 00:21:20,171][106225] Updated weights for policy 1, policy_version 711792 (0.0006) [2023-12-28 00:21:20,175][106226] Updated weights for policy 0, policy_version 709983 (0.0009) [2023-12-28 00:21:20,232][106226] Updated weights for policy 0, policy_version 709993 (0.0008) [2023-12-28 00:21:20,236][106225] Updated weights for policy 1, policy_version 711802 (0.0009) [2023-12-28 00:21:20,293][106226] Updated weights for policy 0, policy_version 710003 (0.0010) [2023-12-28 00:21:20,298][106225] Updated weights for policy 1, policy_version 711812 (0.0007) [2023-12-28 00:21:20,908][106225] Updated weights for policy 1, policy_version 711822 (0.0008) [2023-12-28 00:21:20,964][106225] Updated weights for policy 1, policy_version 711832 (0.0009) [2023-12-28 00:21:21,034][106225] Updated weights for policy 1, policy_version 711842 (0.0009) [2023-12-28 00:21:21,120][106226] Updated weights for policy 0, policy_version 710013 (0.0008) [2023-12-28 00:21:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 364085248. Throughput: 0: 9630.3, 1: 9946.3. Samples: 364095252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:21:21,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-5.325')] [2023-12-28 00:21:21,185][106226] Updated weights for policy 0, policy_version 710023 (0.0009) [2023-12-28 00:21:21,243][106226] Updated weights for policy 0, policy_version 710033 (0.0008) [2023-12-28 00:21:21,723][106225] Updated weights for policy 1, policy_version 711852 (0.0008) [2023-12-28 00:21:21,798][106225] Updated weights for policy 1, policy_version 711862 (0.0010) [2023-12-28 00:21:21,858][106225] Updated weights for policy 1, policy_version 711872 (0.0008) [2023-12-28 00:21:22,016][106226] Updated weights for policy 0, policy_version 710043 (0.0009) [2023-12-28 00:21:22,087][106226] Updated weights for policy 0, policy_version 710053 (0.0009) [2023-12-28 00:21:22,154][106226] Updated weights for policy 0, policy_version 710063 (0.0010) [2023-12-28 00:21:22,529][106225] Updated weights for policy 1, policy_version 711882 (0.0009) [2023-12-28 00:21:22,579][106225] Updated weights for policy 1, policy_version 711892 (0.0008) [2023-12-28 00:21:22,641][106225] Updated weights for policy 1, policy_version 711902 (0.0009) [2023-12-28 00:21:22,689][106225] Updated weights for policy 1, policy_version 711912 (0.0009) [2023-12-28 00:21:22,849][106226] Updated weights for policy 0, policy_version 710073 (0.0008) [2023-12-28 00:21:22,918][106226] Updated weights for policy 0, policy_version 710083 (0.0007) [2023-12-28 00:21:22,984][106226] Updated weights for policy 0, policy_version 710093 (0.0008) [2023-12-28 00:21:23,057][106226] Updated weights for policy 0, policy_version 710103 (0.0009) [2023-12-28 00:21:23,374][106225] Updated weights for policy 1, policy_version 711922 (0.0007) [2023-12-28 00:21:23,435][106225] Updated weights for policy 1, policy_version 711932 (0.0008) [2023-12-28 00:21:23,479][106225] Updated weights for policy 1, policy_version 711942 (0.0008) [2023-12-28 00:21:23,735][106226] Updated weights for policy 0, policy_version 710113 (0.0006) [2023-12-28 00:21:23,790][106226] Updated weights for policy 0, policy_version 710123 (0.0005) [2023-12-28 00:21:23,855][106226] Updated weights for policy 0, policy_version 710133 (0.0005) [2023-12-28 00:21:24,168][106225] Updated weights for policy 1, policy_version 711952 (0.0007) [2023-12-28 00:21:24,221][106225] Updated weights for policy 1, policy_version 711962 (0.0010) [2023-12-28 00:21:24,270][106225] Updated weights for policy 1, policy_version 711972 (0.0009) [2023-12-28 00:21:24,499][106226] Updated weights for policy 0, policy_version 710143 (0.0007) [2023-12-28 00:21:24,554][106226] Updated weights for policy 0, policy_version 710153 (0.0007) [2023-12-28 00:21:24,612][106226] Updated weights for policy 0, policy_version 710163 (0.0005) [2023-12-28 00:21:24,987][106225] Updated weights for policy 1, policy_version 711982 (0.0008) [2023-12-28 00:21:25,051][106225] Updated weights for policy 1, policy_version 711992 (0.0007) [2023-12-28 00:21:25,112][106225] Updated weights for policy 1, policy_version 712002 (0.0006) [2023-12-28 00:21:25,286][106226] Updated weights for policy 0, policy_version 710173 (0.0007) [2023-12-28 00:21:25,336][106226] Updated weights for policy 0, policy_version 710183 (0.0009) [2023-12-28 00:21:25,391][106226] Updated weights for policy 0, policy_version 710193 (0.0008) [2023-12-28 00:21:25,771][106225] Updated weights for policy 1, policy_version 712012 (0.0008) [2023-12-28 00:21:25,824][106225] Updated weights for policy 1, policy_version 712022 (0.0009) [2023-12-28 00:21:25,882][106225] Updated weights for policy 1, policy_version 712032 (0.0009) [2023-12-28 00:21:26,124][106226] Updated weights for policy 0, policy_version 710203 (0.0008) [2023-12-28 00:21:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 364183552. Throughput: 0: 9619.2, 1: 9960.6. Samples: 364154496. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:26,176][105115] Avg episode reward: [(0, '-4.778'), (1, '-5.597')] [2023-12-28 00:21:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000712040_182321152.pth... [2023-12-28 00:21:26,185][106226] Updated weights for policy 0, policy_version 710213 (0.0008) [2023-12-28 00:21:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000710856_182018048.pth [2023-12-28 00:21:26,244][106226] Updated weights for policy 0, policy_version 710223 (0.0009) [2023-12-28 00:21:26,288][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000710232_181870592.pth... [2023-12-28 00:21:26,291][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000709112_181583872.pth [2023-12-28 00:21:26,535][106225] Updated weights for policy 1, policy_version 712042 (0.0008) [2023-12-28 00:21:26,585][106225] Updated weights for policy 1, policy_version 712052 (0.0009) [2023-12-28 00:21:26,642][106225] Updated weights for policy 1, policy_version 712062 (0.0008) [2023-12-28 00:21:26,696][106225] Updated weights for policy 1, policy_version 712072 (0.0007) [2023-12-28 00:21:26,931][106226] Updated weights for policy 0, policy_version 710233 (0.0009) [2023-12-28 00:21:26,979][106226] Updated weights for policy 0, policy_version 710243 (0.0005) [2023-12-28 00:21:27,027][106226] Updated weights for policy 0, policy_version 710253 (0.0005) [2023-12-28 00:21:27,074][106226] Updated weights for policy 0, policy_version 710263 (0.0008) [2023-12-28 00:21:27,445][106225] Updated weights for policy 1, policy_version 712082 (0.0010) [2023-12-28 00:21:27,498][106225] Updated weights for policy 1, policy_version 712092 (0.0010) [2023-12-28 00:21:27,558][106225] Updated weights for policy 1, policy_version 712102 (0.0006) [2023-12-28 00:21:27,792][106226] Updated weights for policy 0, policy_version 710273 (0.0008) [2023-12-28 00:21:27,841][106226] Updated weights for policy 0, policy_version 710283 (0.0008) [2023-12-28 00:21:27,898][106226] Updated weights for policy 0, policy_version 710293 (0.0008) [2023-12-28 00:21:28,209][106225] Updated weights for policy 1, policy_version 712112 (0.0009) [2023-12-28 00:21:28,259][106225] Updated weights for policy 1, policy_version 712122 (0.0010) [2023-12-28 00:21:28,313][106225] Updated weights for policy 1, policy_version 712132 (0.0010) [2023-12-28 00:21:28,636][106226] Updated weights for policy 0, policy_version 710303 (0.0008) [2023-12-28 00:21:28,692][106226] Updated weights for policy 0, policy_version 710313 (0.0009) [2023-12-28 00:21:28,749][106226] Updated weights for policy 0, policy_version 710323 (0.0009) [2023-12-28 00:21:28,975][106225] Updated weights for policy 1, policy_version 712142 (0.0007) [2023-12-28 00:21:29,023][106225] Updated weights for policy 1, policy_version 712152 (0.0009) [2023-12-28 00:21:29,073][106225] Updated weights for policy 1, policy_version 712163 (0.0009) [2023-12-28 00:21:29,516][106226] Updated weights for policy 0, policy_version 710333 (0.0009) [2023-12-28 00:21:29,580][106226] Updated weights for policy 0, policy_version 710343 (0.0007) [2023-12-28 00:21:29,642][106226] Updated weights for policy 0, policy_version 710353 (0.0009) [2023-12-28 00:21:29,772][106225] Updated weights for policy 1, policy_version 712173 (0.0009) [2023-12-28 00:21:29,817][106225] Updated weights for policy 1, policy_version 712183 (0.0009) [2023-12-28 00:21:29,881][106225] Updated weights for policy 1, policy_version 712193 (0.0010) [2023-12-28 00:21:30,381][106226] Updated weights for policy 0, policy_version 710363 (0.0008) [2023-12-28 00:21:30,436][106226] Updated weights for policy 0, policy_version 710373 (0.0005) [2023-12-28 00:21:30,492][106226] Updated weights for policy 0, policy_version 710383 (0.0005) [2023-12-28 00:21:30,642][106225] Updated weights for policy 1, policy_version 712203 (0.0009) [2023-12-28 00:21:30,707][106225] Updated weights for policy 1, policy_version 712213 (0.0006) [2023-12-28 00:21:30,769][106225] Updated weights for policy 1, policy_version 712223 (0.0005) [2023-12-28 00:21:31,065][106226] Updated weights for policy 0, policy_version 710393 (0.0010) [2023-12-28 00:21:31,120][106226] Updated weights for policy 0, policy_version 710403 (0.0008) [2023-12-28 00:21:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 364281856. Throughput: 0: 9628.1, 1: 10046.0. Samples: 364273764. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:31,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-5.538')] [2023-12-28 00:21:31,189][106226] Updated weights for policy 0, policy_version 710413 (0.0008) [2023-12-28 00:21:31,255][106226] Updated weights for policy 0, policy_version 710423 (0.0010) [2023-12-28 00:21:31,442][106225] Updated weights for policy 1, policy_version 712233 (0.0006) [2023-12-28 00:21:31,502][106225] Updated weights for policy 1, policy_version 712243 (0.0008) [2023-12-28 00:21:31,570][106225] Updated weights for policy 1, policy_version 712253 (0.0008) [2023-12-28 00:21:31,640][106225] Updated weights for policy 1, policy_version 712263 (0.0008) [2023-12-28 00:21:32,006][106226] Updated weights for policy 0, policy_version 710433 (0.0011) [2023-12-28 00:21:32,066][106226] Updated weights for policy 0, policy_version 710443 (0.0010) [2023-12-28 00:21:32,126][106226] Updated weights for policy 0, policy_version 710453 (0.0011) [2023-12-28 00:21:32,283][106225] Updated weights for policy 1, policy_version 712273 (0.0007) [2023-12-28 00:21:32,344][106225] Updated weights for policy 1, policy_version 712283 (0.0008) [2023-12-28 00:21:32,426][106225] Updated weights for policy 1, policy_version 712293 (0.0008) [2023-12-28 00:21:32,827][106226] Updated weights for policy 0, policy_version 710463 (0.0011) [2023-12-28 00:21:32,889][106226] Updated weights for policy 0, policy_version 710473 (0.0011) [2023-12-28 00:21:32,942][106226] Updated weights for policy 0, policy_version 710483 (0.0010) [2023-12-28 00:21:33,158][106225] Updated weights for policy 1, policy_version 712303 (0.0007) [2023-12-28 00:21:33,217][106225] Updated weights for policy 1, policy_version 712313 (0.0008) [2023-12-28 00:21:33,274][106225] Updated weights for policy 1, policy_version 712323 (0.0007) [2023-12-28 00:21:33,671][106226] Updated weights for policy 0, policy_version 710493 (0.0010) [2023-12-28 00:21:33,720][106226] Updated weights for policy 0, policy_version 710503 (0.0009) [2023-12-28 00:21:33,770][106226] Updated weights for policy 0, policy_version 710513 (0.0009) [2023-12-28 00:21:33,883][106225] Updated weights for policy 1, policy_version 712333 (0.0007) [2023-12-28 00:21:33,934][106225] Updated weights for policy 1, policy_version 712343 (0.0008) [2023-12-28 00:21:34,009][106225] Updated weights for policy 1, policy_version 712353 (0.0008) [2023-12-28 00:21:34,544][106226] Updated weights for policy 0, policy_version 710523 (0.0009) [2023-12-28 00:21:34,606][106226] Updated weights for policy 0, policy_version 710533 (0.0011) [2023-12-28 00:21:34,660][106226] Updated weights for policy 0, policy_version 710543 (0.0010) [2023-12-28 00:21:34,764][106225] Updated weights for policy 1, policy_version 712363 (0.0008) [2023-12-28 00:21:34,825][106225] Updated weights for policy 1, policy_version 712373 (0.0008) [2023-12-28 00:21:34,886][106225] Updated weights for policy 1, policy_version 712383 (0.0007) [2023-12-28 00:21:35,375][106226] Updated weights for policy 0, policy_version 710553 (0.0011) [2023-12-28 00:21:35,432][106226] Updated weights for policy 0, policy_version 710563 (0.0011) [2023-12-28 00:21:35,479][106226] Updated weights for policy 0, policy_version 710573 (0.0010) [2023-12-28 00:21:35,526][106226] Updated weights for policy 0, policy_version 710583 (0.0010) [2023-12-28 00:21:35,624][106225] Updated weights for policy 1, policy_version 712393 (0.0008) [2023-12-28 00:21:35,677][106225] Updated weights for policy 1, policy_version 712403 (0.0007) [2023-12-28 00:21:35,728][106225] Updated weights for policy 1, policy_version 712413 (0.0008) [2023-12-28 00:21:35,788][106225] Updated weights for policy 1, policy_version 712423 (0.0008) [2023-12-28 00:21:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 364380160. Throughput: 0: 9645.8, 1: 10021.4. Samples: 364391092. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:36,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.530')] [2023-12-28 00:21:36,285][106226] Updated weights for policy 0, policy_version 710593 (0.0011) [2023-12-28 00:21:36,350][106226] Updated weights for policy 0, policy_version 710603 (0.0011) [2023-12-28 00:21:36,409][106226] Updated weights for policy 0, policy_version 710613 (0.0011) [2023-12-28 00:21:36,525][106225] Updated weights for policy 1, policy_version 712433 (0.0008) [2023-12-28 00:21:36,586][106225] Updated weights for policy 1, policy_version 712443 (0.0008) [2023-12-28 00:21:36,650][106225] Updated weights for policy 1, policy_version 712453 (0.0008) [2023-12-28 00:21:37,134][106226] Updated weights for policy 0, policy_version 710623 (0.0011) [2023-12-28 00:21:37,196][106226] Updated weights for policy 0, policy_version 710633 (0.0011) [2023-12-28 00:21:37,267][106226] Updated weights for policy 0, policy_version 710643 (0.0011) [2023-12-28 00:21:37,377][106225] Updated weights for policy 1, policy_version 712463 (0.0009) [2023-12-28 00:21:37,432][106225] Updated weights for policy 1, policy_version 712473 (0.0009) [2023-12-28 00:21:37,499][106225] Updated weights for policy 1, policy_version 712483 (0.0010) [2023-12-28 00:21:37,899][106226] Updated weights for policy 0, policy_version 710653 (0.0009) [2023-12-28 00:21:37,953][106226] Updated weights for policy 0, policy_version 710663 (0.0008) [2023-12-28 00:21:38,014][106226] Updated weights for policy 0, policy_version 710673 (0.0008) [2023-12-28 00:21:38,272][106225] Updated weights for policy 1, policy_version 712493 (0.0009) [2023-12-28 00:21:38,323][106225] Updated weights for policy 1, policy_version 712503 (0.0008) [2023-12-28 00:21:38,384][106225] Updated weights for policy 1, policy_version 712513 (0.0009) [2023-12-28 00:21:38,660][106226] Updated weights for policy 0, policy_version 710683 (0.0007) [2023-12-28 00:21:38,721][106226] Updated weights for policy 0, policy_version 710693 (0.0008) [2023-12-28 00:21:38,787][106226] Updated weights for policy 0, policy_version 710703 (0.0009) [2023-12-28 00:21:39,166][106225] Updated weights for policy 1, policy_version 712523 (0.0009) [2023-12-28 00:21:39,222][106225] Updated weights for policy 1, policy_version 712533 (0.0008) [2023-12-28 00:21:39,290][106225] Updated weights for policy 1, policy_version 712543 (0.0009) [2023-12-28 00:21:39,521][106226] Updated weights for policy 0, policy_version 710713 (0.0009) [2023-12-28 00:21:39,576][106226] Updated weights for policy 0, policy_version 710723 (0.0008) [2023-12-28 00:21:39,638][106226] Updated weights for policy 0, policy_version 710733 (0.0008) [2023-12-28 00:21:39,701][106226] Updated weights for policy 0, policy_version 710743 (0.0008) [2023-12-28 00:21:40,058][106225] Updated weights for policy 1, policy_version 712553 (0.0010) [2023-12-28 00:21:40,124][106225] Updated weights for policy 1, policy_version 712563 (0.0009) [2023-12-28 00:21:40,185][106225] Updated weights for policy 1, policy_version 712573 (0.0009) [2023-12-28 00:21:40,251][106225] Updated weights for policy 1, policy_version 712583 (0.0009) [2023-12-28 00:21:40,399][106226] Updated weights for policy 0, policy_version 710753 (0.0007) [2023-12-28 00:21:40,465][106226] Updated weights for policy 0, policy_version 710763 (0.0005) [2023-12-28 00:21:40,536][106226] Updated weights for policy 0, policy_version 710773 (0.0008) [2023-12-28 00:21:40,918][106225] Updated weights for policy 1, policy_version 712593 (0.0008) [2023-12-28 00:21:40,978][106225] Updated weights for policy 1, policy_version 712603 (0.0008) [2023-12-28 00:21:41,038][106225] Updated weights for policy 1, policy_version 712613 (0.0009) [2023-12-28 00:21:41,143][106226] Updated weights for policy 0, policy_version 710783 (0.0008) [2023-12-28 00:21:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 364478464. Throughput: 0: 9667.0, 1: 9977.6. Samples: 364448468. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:41,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.246')] [2023-12-28 00:21:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000712616_182468608.pth... [2023-12-28 00:21:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000711464_182173696.pth [2023-12-28 00:21:41,209][106226] Updated weights for policy 0, policy_version 710793 (0.0008) [2023-12-28 00:21:41,287][106226] Updated weights for policy 0, policy_version 710803 (0.0009) [2023-12-28 00:21:41,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000710808_182018048.pth... [2023-12-28 00:21:41,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000709656_181723136.pth [2023-12-28 00:21:41,890][106225] Updated weights for policy 1, policy_version 712623 (0.0010) [2023-12-28 00:21:41,957][106225] Updated weights for policy 1, policy_version 712633 (0.0008) [2023-12-28 00:21:42,019][106226] Updated weights for policy 0, policy_version 710813 (0.0007) [2023-12-28 00:21:42,019][106225] Updated weights for policy 1, policy_version 712643 (0.0009) [2023-12-28 00:21:42,072][106226] Updated weights for policy 0, policy_version 710823 (0.0007) [2023-12-28 00:21:42,139][106226] Updated weights for policy 0, policy_version 710833 (0.0007) [2023-12-28 00:21:42,765][106225] Updated weights for policy 1, policy_version 712653 (0.0007) [2023-12-28 00:21:42,828][106225] Updated weights for policy 1, policy_version 712663 (0.0008) [2023-12-28 00:21:42,860][106226] Updated weights for policy 0, policy_version 710843 (0.0007) [2023-12-28 00:21:42,887][106225] Updated weights for policy 1, policy_version 712673 (0.0008) [2023-12-28 00:21:42,910][106226] Updated weights for policy 0, policy_version 710853 (0.0007) [2023-12-28 00:21:42,959][106226] Updated weights for policy 0, policy_version 710863 (0.0008) [2023-12-28 00:21:43,532][106225] Updated weights for policy 1, policy_version 712683 (0.0005) [2023-12-28 00:21:43,599][106225] Updated weights for policy 1, policy_version 712693 (0.0005) [2023-12-28 00:21:43,661][106225] Updated weights for policy 1, policy_version 712703 (0.0010) [2023-12-28 00:21:43,720][106226] Updated weights for policy 0, policy_version 710873 (0.0009) [2023-12-28 00:21:43,776][106226] Updated weights for policy 0, policy_version 710883 (0.0007) [2023-12-28 00:21:43,835][106226] Updated weights for policy 0, policy_version 710893 (0.0007) [2023-12-28 00:21:43,897][106226] Updated weights for policy 0, policy_version 710903 (0.0009) [2023-12-28 00:21:44,269][106225] Updated weights for policy 1, policy_version 712713 (0.0010) [2023-12-28 00:21:44,324][106225] Updated weights for policy 1, policy_version 712723 (0.0006) [2023-12-28 00:21:44,378][106225] Updated weights for policy 1, policy_version 712733 (0.0007) [2023-12-28 00:21:44,441][106225] Updated weights for policy 1, policy_version 712743 (0.0009) [2023-12-28 00:21:44,677][106226] Updated weights for policy 0, policy_version 710913 (0.0009) [2023-12-28 00:21:44,739][106226] Updated weights for policy 0, policy_version 710923 (0.0008) [2023-12-28 00:21:44,807][106226] Updated weights for policy 0, policy_version 710933 (0.0009) [2023-12-28 00:21:45,156][106225] Updated weights for policy 1, policy_version 712753 (0.0009) [2023-12-28 00:21:45,214][106225] Updated weights for policy 1, policy_version 712763 (0.0009) [2023-12-28 00:21:45,271][106225] Updated weights for policy 1, policy_version 712773 (0.0007) [2023-12-28 00:21:45,523][106226] Updated weights for policy 0, policy_version 710943 (0.0009) [2023-12-28 00:21:45,577][106226] Updated weights for policy 0, policy_version 710953 (0.0007) [2023-12-28 00:21:45,646][106226] Updated weights for policy 0, policy_version 710963 (0.0005) [2023-12-28 00:21:45,905][106225] Updated weights for policy 1, policy_version 712783 (0.0005) [2023-12-28 00:21:45,954][106225] Updated weights for policy 1, policy_version 712793 (0.0005) [2023-12-28 00:21:46,009][106225] Updated weights for policy 1, policy_version 712803 (0.0005) [2023-12-28 00:21:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 364576768. Throughput: 0: 9666.6, 1: 9937.0. Samples: 364564044. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:46,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.531')] [2023-12-28 00:21:46,304][106226] Updated weights for policy 0, policy_version 710973 (0.0007) [2023-12-28 00:21:46,355][106226] Updated weights for policy 0, policy_version 710983 (0.0008) [2023-12-28 00:21:46,421][106226] Updated weights for policy 0, policy_version 710993 (0.0009) [2023-12-28 00:21:46,589][106225] Updated weights for policy 1, policy_version 712813 (0.0005) [2023-12-28 00:21:46,635][106225] Updated weights for policy 1, policy_version 712823 (0.0007) [2023-12-28 00:21:46,681][106225] Updated weights for policy 1, policy_version 712833 (0.0008) [2023-12-28 00:21:47,165][106226] Updated weights for policy 0, policy_version 711003 (0.0008) [2023-12-28 00:21:47,227][106226] Updated weights for policy 0, policy_version 711013 (0.0006) [2023-12-28 00:21:47,282][106226] Updated weights for policy 0, policy_version 711023 (0.0008) [2023-12-28 00:21:47,398][106225] Updated weights for policy 1, policy_version 712843 (0.0006) [2023-12-28 00:21:47,467][106225] Updated weights for policy 1, policy_version 712853 (0.0007) [2023-12-28 00:21:47,526][106225] Updated weights for policy 1, policy_version 712863 (0.0008) [2023-12-28 00:21:47,974][106226] Updated weights for policy 0, policy_version 711033 (0.0009) [2023-12-28 00:21:48,037][106226] Updated weights for policy 0, policy_version 711043 (0.0008) [2023-12-28 00:21:48,096][106226] Updated weights for policy 0, policy_version 711053 (0.0008) [2023-12-28 00:21:48,162][106226] Updated weights for policy 0, policy_version 711063 (0.0009) [2023-12-28 00:21:48,215][106225] Updated weights for policy 1, policy_version 712873 (0.0009) [2023-12-28 00:21:48,268][106225] Updated weights for policy 1, policy_version 712883 (0.0008) [2023-12-28 00:21:48,322][106225] Updated weights for policy 1, policy_version 712893 (0.0010) [2023-12-28 00:21:48,382][106225] Updated weights for policy 1, policy_version 712903 (0.0008) [2023-12-28 00:21:48,895][106226] Updated weights for policy 0, policy_version 711073 (0.0009) [2023-12-28 00:21:48,949][106226] Updated weights for policy 0, policy_version 711083 (0.0008) [2023-12-28 00:21:49,009][106226] Updated weights for policy 0, policy_version 711093 (0.0009) [2023-12-28 00:21:49,155][106225] Updated weights for policy 1, policy_version 712913 (0.0007) [2023-12-28 00:21:49,214][106225] Updated weights for policy 1, policy_version 712923 (0.0008) [2023-12-28 00:21:49,287][106225] Updated weights for policy 1, policy_version 712933 (0.0008) [2023-12-28 00:21:49,738][106226] Updated weights for policy 0, policy_version 711103 (0.0009) [2023-12-28 00:21:49,794][106226] Updated weights for policy 0, policy_version 711113 (0.0009) [2023-12-28 00:21:49,859][106226] Updated weights for policy 0, policy_version 711123 (0.0008) [2023-12-28 00:21:50,039][106225] Updated weights for policy 1, policy_version 712943 (0.0008) [2023-12-28 00:21:50,104][106225] Updated weights for policy 1, policy_version 712953 (0.0009) [2023-12-28 00:21:50,157][106225] Updated weights for policy 1, policy_version 712963 (0.0008) [2023-12-28 00:21:50,646][106226] Updated weights for policy 0, policy_version 711133 (0.0007) [2023-12-28 00:21:50,705][106226] Updated weights for policy 0, policy_version 711143 (0.0008) [2023-12-28 00:21:50,770][106226] Updated weights for policy 0, policy_version 711153 (0.0008) [2023-12-28 00:21:50,844][106225] Updated weights for policy 1, policy_version 712973 (0.0009) [2023-12-28 00:21:50,899][106225] Updated weights for policy 1, policy_version 712983 (0.0008) [2023-12-28 00:21:50,958][106225] Updated weights for policy 1, policy_version 712993 (0.0009) [2023-12-28 00:21:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 364675072. Throughput: 0: 9671.1, 1: 9906.4. Samples: 364682356. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:51,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-5.461')] [2023-12-28 00:21:51,434][106226] Updated weights for policy 0, policy_version 711163 (0.0009) [2023-12-28 00:21:51,497][106226] Updated weights for policy 0, policy_version 711173 (0.0008) [2023-12-28 00:21:51,557][106226] Updated weights for policy 0, policy_version 711183 (0.0008) [2023-12-28 00:21:51,817][106225] Updated weights for policy 1, policy_version 713003 (0.0009) [2023-12-28 00:21:51,877][106225] Updated weights for policy 1, policy_version 713013 (0.0009) [2023-12-28 00:21:51,938][106225] Updated weights for policy 1, policy_version 713023 (0.0009) [2023-12-28 00:21:52,312][106226] Updated weights for policy 0, policy_version 711193 (0.0008) [2023-12-28 00:21:52,378][106226] Updated weights for policy 0, policy_version 711203 (0.0008) [2023-12-28 00:21:52,444][106226] Updated weights for policy 0, policy_version 711213 (0.0007) [2023-12-28 00:21:52,503][106226] Updated weights for policy 0, policy_version 711223 (0.0009) [2023-12-28 00:21:52,645][106225] Updated weights for policy 1, policy_version 713033 (0.0008) [2023-12-28 00:21:52,696][106225] Updated weights for policy 1, policy_version 713043 (0.0007) [2023-12-28 00:21:52,750][106225] Updated weights for policy 1, policy_version 713053 (0.0009) [2023-12-28 00:21:52,803][106225] Updated weights for policy 1, policy_version 713063 (0.0008) [2023-12-28 00:21:53,212][106226] Updated weights for policy 0, policy_version 711233 (0.0008) [2023-12-28 00:21:53,272][106226] Updated weights for policy 0, policy_version 711243 (0.0005) [2023-12-28 00:21:53,330][106226] Updated weights for policy 0, policy_version 711253 (0.0007) [2023-12-28 00:21:53,538][106225] Updated weights for policy 1, policy_version 713073 (0.0008) [2023-12-28 00:21:53,593][106225] Updated weights for policy 1, policy_version 713083 (0.0007) [2023-12-28 00:21:53,656][106225] Updated weights for policy 1, policy_version 713093 (0.0008) [2023-12-28 00:21:53,956][106226] Updated weights for policy 0, policy_version 711263 (0.0009) [2023-12-28 00:21:54,020][106226] Updated weights for policy 0, policy_version 711273 (0.0010) [2023-12-28 00:21:54,081][106226] Updated weights for policy 0, policy_version 711283 (0.0009) [2023-12-28 00:21:54,290][106225] Updated weights for policy 1, policy_version 713103 (0.0006) [2023-12-28 00:21:54,345][106225] Updated weights for policy 1, policy_version 713113 (0.0005) [2023-12-28 00:21:54,404][106225] Updated weights for policy 1, policy_version 713123 (0.0008) [2023-12-28 00:21:54,841][106226] Updated weights for policy 0, policy_version 711293 (0.0010) [2023-12-28 00:21:54,895][106226] Updated weights for policy 0, policy_version 711303 (0.0009) [2023-12-28 00:21:54,951][106226] Updated weights for policy 0, policy_version 711313 (0.0008) [2023-12-28 00:21:55,071][106225] Updated weights for policy 1, policy_version 713133 (0.0008) [2023-12-28 00:21:55,127][106225] Updated weights for policy 1, policy_version 713143 (0.0008) [2023-12-28 00:21:55,186][106225] Updated weights for policy 1, policy_version 713153 (0.0008) [2023-12-28 00:21:55,618][106226] Updated weights for policy 0, policy_version 711323 (0.0008) [2023-12-28 00:21:55,669][106226] Updated weights for policy 0, policy_version 711333 (0.0008) [2023-12-28 00:21:55,728][106226] Updated weights for policy 0, policy_version 711343 (0.0009) [2023-12-28 00:21:55,943][106225] Updated weights for policy 1, policy_version 713163 (0.0009) [2023-12-28 00:21:55,996][106225] Updated weights for policy 1, policy_version 713173 (0.0009) [2023-12-28 00:21:56,057][106225] Updated weights for policy 1, policy_version 713183 (0.0009) [2023-12-28 00:21:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 364773376. Throughput: 0: 9663.8, 1: 9827.6. Samples: 364739164. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:21:56,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-5.434')] [2023-12-28 00:21:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000713192_182616064.pth... [2023-12-28 00:21:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000711352_182157312.pth... [2023-12-28 00:21:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000712040_182321152.pth [2023-12-28 00:21:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000710232_181870592.pth [2023-12-28 00:21:56,307][106226] Updated weights for policy 0, policy_version 711353 (0.0008) [2023-12-28 00:21:56,363][106226] Updated weights for policy 0, policy_version 711363 (0.0007) [2023-12-28 00:21:56,426][106226] Updated weights for policy 0, policy_version 711373 (0.0007) [2023-12-28 00:21:56,487][106226] Updated weights for policy 0, policy_version 711383 (0.0006) [2023-12-28 00:21:56,900][106225] Updated weights for policy 1, policy_version 713193 (0.0010) [2023-12-28 00:21:56,952][106225] Updated weights for policy 1, policy_version 713203 (0.0010) [2023-12-28 00:21:57,007][106226] Updated weights for policy 0, policy_version 711393 (0.0005) [2023-12-28 00:21:57,017][106225] Updated weights for policy 1, policy_version 713213 (0.0008) [2023-12-28 00:21:57,071][106226] Updated weights for policy 0, policy_version 711403 (0.0007) [2023-12-28 00:21:57,077][106225] Updated weights for policy 1, policy_version 713223 (0.0008) [2023-12-28 00:21:57,124][106226] Updated weights for policy 0, policy_version 711413 (0.0005) [2023-12-28 00:21:57,666][106226] Updated weights for policy 0, policy_version 711423 (0.0008) [2023-12-28 00:21:57,715][106226] Updated weights for policy 0, policy_version 711433 (0.0008) [2023-12-28 00:21:57,780][106226] Updated weights for policy 0, policy_version 711443 (0.0006) [2023-12-28 00:21:57,817][106225] Updated weights for policy 1, policy_version 713233 (0.0005) [2023-12-28 00:21:57,872][106225] Updated weights for policy 1, policy_version 713243 (0.0005) [2023-12-28 00:21:57,943][106225] Updated weights for policy 1, policy_version 713253 (0.0006) [2023-12-28 00:21:58,374][106226] Updated weights for policy 0, policy_version 711453 (0.0007) [2023-12-28 00:21:58,441][106226] Updated weights for policy 0, policy_version 711463 (0.0008) [2023-12-28 00:21:58,511][106226] Updated weights for policy 0, policy_version 711473 (0.0008) [2023-12-28 00:21:58,660][106225] Updated weights for policy 1, policy_version 713263 (0.0009) [2023-12-28 00:21:58,730][106225] Updated weights for policy 1, policy_version 713273 (0.0007) [2023-12-28 00:21:58,800][106225] Updated weights for policy 1, policy_version 713283 (0.0008) [2023-12-28 00:21:59,303][106226] Updated weights for policy 0, policy_version 711483 (0.0008) [2023-12-28 00:21:59,366][106226] Updated weights for policy 0, policy_version 711493 (0.0008) [2023-12-28 00:21:59,430][106226] Updated weights for policy 0, policy_version 711503 (0.0008) [2023-12-28 00:21:59,538][106225] Updated weights for policy 1, policy_version 713293 (0.0008) [2023-12-28 00:21:59,600][106225] Updated weights for policy 1, policy_version 713303 (0.0007) [2023-12-28 00:21:59,659][106225] Updated weights for policy 1, policy_version 713313 (0.0007) [2023-12-28 00:22:00,205][106226] Updated weights for policy 0, policy_version 711513 (0.0008) [2023-12-28 00:22:00,270][106226] Updated weights for policy 0, policy_version 711523 (0.0006) [2023-12-28 00:22:00,330][106226] Updated weights for policy 0, policy_version 711533 (0.0008) [2023-12-28 00:22:00,356][106225] Updated weights for policy 1, policy_version 713323 (0.0007) [2023-12-28 00:22:00,392][106226] Updated weights for policy 0, policy_version 711543 (0.0007) [2023-12-28 00:22:00,415][106225] Updated weights for policy 1, policy_version 713333 (0.0006) [2023-12-28 00:22:00,471][106225] Updated weights for policy 1, policy_version 713343 (0.0008) [2023-12-28 00:22:01,092][106226] Updated weights for policy 0, policy_version 711553 (0.0008) [2023-12-28 00:22:01,163][106226] Updated weights for policy 0, policy_version 711563 (0.0008) [2023-12-28 00:22:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 364863488. Throughput: 0: 9831.5, 1: 9806.0. Samples: 364859628. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:01,175][106225] Updated weights for policy 1, policy_version 713353 (0.0008) [2023-12-28 00:22:01,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.539')] [2023-12-28 00:22:01,227][106226] Updated weights for policy 0, policy_version 711573 (0.0006) [2023-12-28 00:22:01,240][106225] Updated weights for policy 1, policy_version 713363 (0.0011) [2023-12-28 00:22:01,302][106225] Updated weights for policy 1, policy_version 713373 (0.0011) [2023-12-28 00:22:01,367][106225] Updated weights for policy 1, policy_version 713383 (0.0009) [2023-12-28 00:22:01,917][106226] Updated weights for policy 0, policy_version 711583 (0.0008) [2023-12-28 00:22:01,973][106226] Updated weights for policy 0, policy_version 711593 (0.0007) [2023-12-28 00:22:02,033][106226] Updated weights for policy 0, policy_version 711603 (0.0006) [2023-12-28 00:22:02,119][106225] Updated weights for policy 1, policy_version 713393 (0.0009) [2023-12-28 00:22:02,169][106225] Updated weights for policy 1, policy_version 713403 (0.0009) [2023-12-28 00:22:02,231][106225] Updated weights for policy 1, policy_version 713413 (0.0009) [2023-12-28 00:22:02,658][106226] Updated weights for policy 0, policy_version 711613 (0.0007) [2023-12-28 00:22:02,717][106226] Updated weights for policy 0, policy_version 711623 (0.0008) [2023-12-28 00:22:02,780][106226] Updated weights for policy 0, policy_version 711633 (0.0010) [2023-12-28 00:22:03,024][106225] Updated weights for policy 1, policy_version 713423 (0.0010) [2023-12-28 00:22:03,070][106225] Updated weights for policy 1, policy_version 713433 (0.0010) [2023-12-28 00:22:03,122][106225] Updated weights for policy 1, policy_version 713443 (0.0010) [2023-12-28 00:22:03,477][106226] Updated weights for policy 0, policy_version 711643 (0.0009) [2023-12-28 00:22:03,524][106226] Updated weights for policy 0, policy_version 711653 (0.0008) [2023-12-28 00:22:03,577][106226] Updated weights for policy 0, policy_version 711663 (0.0007) [2023-12-28 00:22:03,853][106225] Updated weights for policy 1, policy_version 713453 (0.0010) [2023-12-28 00:22:03,903][106225] Updated weights for policy 1, policy_version 713463 (0.0009) [2023-12-28 00:22:03,956][106225] Updated weights for policy 1, policy_version 713473 (0.0008) [2023-12-28 00:22:04,301][106226] Updated weights for policy 0, policy_version 711673 (0.0008) [2023-12-28 00:22:04,368][106226] Updated weights for policy 0, policy_version 711683 (0.0011) [2023-12-28 00:22:04,420][106226] Updated weights for policy 0, policy_version 711693 (0.0008) [2023-12-28 00:22:04,486][106226] Updated weights for policy 0, policy_version 711703 (0.0008) [2023-12-28 00:22:04,726][106225] Updated weights for policy 1, policy_version 713483 (0.0008) [2023-12-28 00:22:04,786][106225] Updated weights for policy 1, policy_version 713493 (0.0010) [2023-12-28 00:22:04,839][106225] Updated weights for policy 1, policy_version 713503 (0.0009) [2023-12-28 00:22:05,152][106226] Updated weights for policy 0, policy_version 711713 (0.0010) [2023-12-28 00:22:05,207][106226] Updated weights for policy 0, policy_version 711723 (0.0011) [2023-12-28 00:22:05,271][106226] Updated weights for policy 0, policy_version 711733 (0.0008) [2023-12-28 00:22:05,464][106225] Updated weights for policy 1, policy_version 713513 (0.0008) [2023-12-28 00:22:05,529][106225] Updated weights for policy 1, policy_version 713523 (0.0006) [2023-12-28 00:22:05,586][106225] Updated weights for policy 1, policy_version 713533 (0.0006) [2023-12-28 00:22:05,649][106225] Updated weights for policy 1, policy_version 713543 (0.0006) [2023-12-28 00:22:05,948][106226] Updated weights for policy 0, policy_version 711743 (0.0006) [2023-12-28 00:22:06,007][106226] Updated weights for policy 0, policy_version 711753 (0.0005) [2023-12-28 00:22:06,066][106226] Updated weights for policy 0, policy_version 711763 (0.0007) [2023-12-28 00:22:06,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 364969984. Throughput: 0: 9869.3, 1: 9738.7. Samples: 364977616. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:06,176][105115] Avg episode reward: [(0, '-4.464'), (1, '-5.627')] [2023-12-28 00:22:06,349][106225] Updated weights for policy 1, policy_version 713553 (0.0010) [2023-12-28 00:22:06,397][106225] Updated weights for policy 1, policy_version 713563 (0.0010) [2023-12-28 00:22:06,449][106225] Updated weights for policy 1, policy_version 713573 (0.0010) [2023-12-28 00:22:06,757][106226] Updated weights for policy 0, policy_version 711773 (0.0009) [2023-12-28 00:22:06,803][106226] Updated weights for policy 0, policy_version 711783 (0.0010) [2023-12-28 00:22:06,850][106226] Updated weights for policy 0, policy_version 711793 (0.0010) [2023-12-28 00:22:07,195][106225] Updated weights for policy 1, policy_version 713583 (0.0007) [2023-12-28 00:22:07,258][106225] Updated weights for policy 1, policy_version 713593 (0.0007) [2023-12-28 00:22:07,315][106225] Updated weights for policy 1, policy_version 713603 (0.0008) [2023-12-28 00:22:07,545][106226] Updated weights for policy 0, policy_version 711803 (0.0009) [2023-12-28 00:22:07,599][106226] Updated weights for policy 0, policy_version 711813 (0.0005) [2023-12-28 00:22:07,654][106226] Updated weights for policy 0, policy_version 711823 (0.0005) [2023-12-28 00:22:07,967][106225] Updated weights for policy 1, policy_version 713613 (0.0007) [2023-12-28 00:22:08,024][106225] Updated weights for policy 1, policy_version 713623 (0.0007) [2023-12-28 00:22:08,077][106225] Updated weights for policy 1, policy_version 713633 (0.0006) [2023-12-28 00:22:08,273][106226] Updated weights for policy 0, policy_version 711833 (0.0005) [2023-12-28 00:22:08,342][106226] Updated weights for policy 0, policy_version 711843 (0.0007) [2023-12-28 00:22:08,404][106226] Updated weights for policy 0, policy_version 711853 (0.0008) [2023-12-28 00:22:08,459][106226] Updated weights for policy 0, policy_version 711863 (0.0008) [2023-12-28 00:22:08,849][106225] Updated weights for policy 1, policy_version 713643 (0.0007) [2023-12-28 00:22:08,912][106225] Updated weights for policy 1, policy_version 713653 (0.0006) [2023-12-28 00:22:08,977][106225] Updated weights for policy 1, policy_version 713663 (0.0007) [2023-12-28 00:22:09,044][106226] Updated weights for policy 0, policy_version 711873 (0.0008) [2023-12-28 00:22:09,111][106226] Updated weights for policy 0, policy_version 711883 (0.0009) [2023-12-28 00:22:09,168][106226] Updated weights for policy 0, policy_version 711893 (0.0010) [2023-12-28 00:22:09,605][106225] Updated weights for policy 1, policy_version 713673 (0.0009) [2023-12-28 00:22:09,672][106225] Updated weights for policy 1, policy_version 713683 (0.0009) [2023-12-28 00:22:09,742][106225] Updated weights for policy 1, policy_version 713693 (0.0006) [2023-12-28 00:22:09,813][106225] Updated weights for policy 1, policy_version 713703 (0.0007) [2023-12-28 00:22:09,990][106226] Updated weights for policy 0, policy_version 711903 (0.0010) [2023-12-28 00:22:10,056][106226] Updated weights for policy 0, policy_version 711913 (0.0011) [2023-12-28 00:22:10,117][106226] Updated weights for policy 0, policy_version 711923 (0.0011) [2023-12-28 00:22:10,413][106225] Updated weights for policy 1, policy_version 713713 (0.0009) [2023-12-28 00:22:10,472][106225] Updated weights for policy 1, policy_version 713723 (0.0007) [2023-12-28 00:22:10,535][106225] Updated weights for policy 1, policy_version 713733 (0.0008) [2023-12-28 00:22:10,823][106226] Updated weights for policy 0, policy_version 711933 (0.0008) [2023-12-28 00:22:10,881][106226] Updated weights for policy 0, policy_version 711943 (0.0006) [2023-12-28 00:22:10,934][106226] Updated weights for policy 0, policy_version 711953 (0.0006) [2023-12-28 00:22:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 365068288. Throughput: 0: 9933.3, 1: 9723.6. Samples: 365039052. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:11,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-5.351')] [2023-12-28 00:22:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000713736_182755328.pth... [2023-12-28 00:22:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000711960_182312960.pth... [2023-12-28 00:22:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000710808_182018048.pth [2023-12-28 00:22:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000712616_182468608.pth [2023-12-28 00:22:11,328][106225] Updated weights for policy 1, policy_version 713743 (0.0008) [2023-12-28 00:22:11,400][106225] Updated weights for policy 1, policy_version 713753 (0.0007) [2023-12-28 00:22:11,460][106225] Updated weights for policy 1, policy_version 713763 (0.0007) [2023-12-28 00:22:11,719][106226] Updated weights for policy 0, policy_version 711963 (0.0008) [2023-12-28 00:22:11,785][106226] Updated weights for policy 0, policy_version 711973 (0.0009) [2023-12-28 00:22:11,854][106226] Updated weights for policy 0, policy_version 711983 (0.0010) [2023-12-28 00:22:12,154][106225] Updated weights for policy 1, policy_version 713773 (0.0006) [2023-12-28 00:22:12,221][106225] Updated weights for policy 1, policy_version 713783 (0.0007) [2023-12-28 00:22:12,283][106225] Updated weights for policy 1, policy_version 713793 (0.0008) [2023-12-28 00:22:12,579][106226] Updated weights for policy 0, policy_version 711993 (0.0008) [2023-12-28 00:22:12,647][106226] Updated weights for policy 0, policy_version 712003 (0.0006) [2023-12-28 00:22:12,714][106226] Updated weights for policy 0, policy_version 712013 (0.0006) [2023-12-28 00:22:12,779][106226] Updated weights for policy 0, policy_version 712023 (0.0009) [2023-12-28 00:22:12,974][106225] Updated weights for policy 1, policy_version 713803 (0.0008) [2023-12-28 00:22:13,029][106225] Updated weights for policy 1, policy_version 713813 (0.0008) [2023-12-28 00:22:13,080][106225] Updated weights for policy 1, policy_version 713823 (0.0008) [2023-12-28 00:22:13,444][106226] Updated weights for policy 0, policy_version 712033 (0.0008) [2023-12-28 00:22:13,494][106226] Updated weights for policy 0, policy_version 712043 (0.0005) [2023-12-28 00:22:13,542][106226] Updated weights for policy 0, policy_version 712053 (0.0005) [2023-12-28 00:22:13,853][106225] Updated weights for policy 1, policy_version 713833 (0.0008) [2023-12-28 00:22:13,911][106225] Updated weights for policy 1, policy_version 713843 (0.0008) [2023-12-28 00:22:13,961][106225] Updated weights for policy 1, policy_version 713853 (0.0008) [2023-12-28 00:22:14,013][106225] Updated weights for policy 1, policy_version 713863 (0.0009) [2023-12-28 00:22:14,144][106226] Updated weights for policy 0, policy_version 712063 (0.0005) [2023-12-28 00:22:14,206][106226] Updated weights for policy 0, policy_version 712073 (0.0005) [2023-12-28 00:22:14,258][106226] Updated weights for policy 0, policy_version 712083 (0.0006) [2023-12-28 00:22:14,798][106225] Updated weights for policy 1, policy_version 713873 (0.0010) [2023-12-28 00:22:14,859][106225] Updated weights for policy 1, policy_version 713883 (0.0010) [2023-12-28 00:22:14,873][106226] Updated weights for policy 0, policy_version 712093 (0.0006) [2023-12-28 00:22:14,922][106225] Updated weights for policy 1, policy_version 713893 (0.0009) [2023-12-28 00:22:14,940][106226] Updated weights for policy 0, policy_version 712103 (0.0006) [2023-12-28 00:22:15,005][106226] Updated weights for policy 0, policy_version 712113 (0.0008) [2023-12-28 00:22:15,581][106225] Updated weights for policy 1, policy_version 713903 (0.0007) [2023-12-28 00:22:15,638][106225] Updated weights for policy 1, policy_version 713913 (0.0005) [2023-12-28 00:22:15,698][106225] Updated weights for policy 1, policy_version 713923 (0.0008) [2023-12-28 00:22:15,786][106226] Updated weights for policy 0, policy_version 712123 (0.0010) [2023-12-28 00:22:15,848][106226] Updated weights for policy 0, policy_version 712133 (0.0009) [2023-12-28 00:22:15,903][106226] Updated weights for policy 0, policy_version 712143 (0.0007) [2023-12-28 00:22:16,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 365166592. Throughput: 0: 9940.3, 1: 9660.8. Samples: 365155816. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:16,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-5.288')] [2023-12-28 00:22:16,276][106225] Updated weights for policy 1, policy_version 713933 (0.0008) [2023-12-28 00:22:16,329][106225] Updated weights for policy 1, policy_version 713943 (0.0010) [2023-12-28 00:22:16,383][106225] Updated weights for policy 1, policy_version 713953 (0.0010) [2023-12-28 00:22:16,641][106226] Updated weights for policy 0, policy_version 712153 (0.0008) [2023-12-28 00:22:16,703][106226] Updated weights for policy 0, policy_version 712163 (0.0007) [2023-12-28 00:22:16,765][106226] Updated weights for policy 0, policy_version 712173 (0.0005) [2023-12-28 00:22:16,821][106226] Updated weights for policy 0, policy_version 712183 (0.0005) [2023-12-28 00:22:17,007][106225] Updated weights for policy 1, policy_version 713963 (0.0009) [2023-12-28 00:22:17,066][106225] Updated weights for policy 1, policy_version 713973 (0.0006) [2023-12-28 00:22:17,126][106225] Updated weights for policy 1, policy_version 713983 (0.0008) [2023-12-28 00:22:17,441][106226] Updated weights for policy 0, policy_version 712193 (0.0005) [2023-12-28 00:22:17,499][106226] Updated weights for policy 0, policy_version 712203 (0.0005) [2023-12-28 00:22:17,556][106226] Updated weights for policy 0, policy_version 712213 (0.0005) [2023-12-28 00:22:17,832][106225] Updated weights for policy 1, policy_version 713993 (0.0008) [2023-12-28 00:22:17,890][106225] Updated weights for policy 1, policy_version 714003 (0.0007) [2023-12-28 00:22:17,939][106225] Updated weights for policy 1, policy_version 714013 (0.0008) [2023-12-28 00:22:17,992][106225] Updated weights for policy 1, policy_version 714023 (0.0010) [2023-12-28 00:22:18,139][106226] Updated weights for policy 0, policy_version 712223 (0.0009) [2023-12-28 00:22:18,193][106226] Updated weights for policy 0, policy_version 712233 (0.0010) [2023-12-28 00:22:18,245][106226] Updated weights for policy 0, policy_version 712243 (0.0010) [2023-12-28 00:22:18,731][106225] Updated weights for policy 1, policy_version 714033 (0.0008) [2023-12-28 00:22:18,793][106225] Updated weights for policy 1, policy_version 714043 (0.0010) [2023-12-28 00:22:18,860][106225] Updated weights for policy 1, policy_version 714053 (0.0011) [2023-12-28 00:22:19,003][106226] Updated weights for policy 0, policy_version 712253 (0.0009) [2023-12-28 00:22:19,051][106226] Updated weights for policy 0, policy_version 712263 (0.0005) [2023-12-28 00:22:19,100][106226] Updated weights for policy 0, policy_version 712273 (0.0005) [2023-12-28 00:22:19,590][106225] Updated weights for policy 1, policy_version 714063 (0.0008) [2023-12-28 00:22:19,661][106225] Updated weights for policy 1, policy_version 714073 (0.0006) [2023-12-28 00:22:19,726][106225] Updated weights for policy 1, policy_version 714083 (0.0007) [2023-12-28 00:22:19,824][106226] Updated weights for policy 0, policy_version 712283 (0.0007) [2023-12-28 00:22:19,892][106226] Updated weights for policy 0, policy_version 712293 (0.0007) [2023-12-28 00:22:19,953][106226] Updated weights for policy 0, policy_version 712303 (0.0010) [2023-12-28 00:22:20,489][106225] Updated weights for policy 1, policy_version 714093 (0.0007) [2023-12-28 00:22:20,550][106225] Updated weights for policy 1, policy_version 714103 (0.0006) [2023-12-28 00:22:20,614][106225] Updated weights for policy 1, policy_version 714113 (0.0008) [2023-12-28 00:22:20,707][106226] Updated weights for policy 0, policy_version 712313 (0.0011) [2023-12-28 00:22:20,772][106226] Updated weights for policy 0, policy_version 712323 (0.0008) [2023-12-28 00:22:20,836][106226] Updated weights for policy 0, policy_version 712333 (0.0009) [2023-12-28 00:22:20,903][106226] Updated weights for policy 0, policy_version 712343 (0.0008) [2023-12-28 00:22:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 365264896. Throughput: 0: 9942.8, 1: 9682.1. Samples: 365274208. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:21,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.370')] [2023-12-28 00:22:21,363][106225] Updated weights for policy 1, policy_version 714123 (0.0008) [2023-12-28 00:22:21,427][106225] Updated weights for policy 1, policy_version 714133 (0.0007) [2023-12-28 00:22:21,487][106225] Updated weights for policy 1, policy_version 714143 (0.0007) [2023-12-28 00:22:21,710][106226] Updated weights for policy 0, policy_version 712353 (0.0009) [2023-12-28 00:22:21,782][106226] Updated weights for policy 0, policy_version 712363 (0.0009) [2023-12-28 00:22:21,850][106226] Updated weights for policy 0, policy_version 712373 (0.0008) [2023-12-28 00:22:22,245][106225] Updated weights for policy 1, policy_version 714153 (0.0007) [2023-12-28 00:22:22,305][106225] Updated weights for policy 1, policy_version 714163 (0.0009) [2023-12-28 00:22:22,372][106225] Updated weights for policy 1, policy_version 714173 (0.0010) [2023-12-28 00:22:22,432][106225] Updated weights for policy 1, policy_version 714183 (0.0010) [2023-12-28 00:22:22,546][106226] Updated weights for policy 0, policy_version 712383 (0.0006) [2023-12-28 00:22:22,611][106226] Updated weights for policy 0, policy_version 712393 (0.0007) [2023-12-28 00:22:22,673][106226] Updated weights for policy 0, policy_version 712403 (0.0011) [2023-12-28 00:22:23,125][106225] Updated weights for policy 1, policy_version 714193 (0.0006) [2023-12-28 00:22:23,179][106225] Updated weights for policy 1, policy_version 714203 (0.0010) [2023-12-28 00:22:23,238][106225] Updated weights for policy 1, policy_version 714213 (0.0007) [2023-12-28 00:22:23,367][106226] Updated weights for policy 0, policy_version 712413 (0.0011) [2023-12-28 00:22:23,423][106226] Updated weights for policy 0, policy_version 712423 (0.0010) [2023-12-28 00:22:23,479][106226] Updated weights for policy 0, policy_version 712433 (0.0010) [2023-12-28 00:22:23,886][106225] Updated weights for policy 1, policy_version 714223 (0.0009) [2023-12-28 00:22:23,945][106225] Updated weights for policy 1, policy_version 714233 (0.0008) [2023-12-28 00:22:24,005][106225] Updated weights for policy 1, policy_version 714243 (0.0005) [2023-12-28 00:22:24,207][106226] Updated weights for policy 0, policy_version 712443 (0.0011) [2023-12-28 00:22:24,269][106226] Updated weights for policy 0, policy_version 712453 (0.0011) [2023-12-28 00:22:24,336][106226] Updated weights for policy 0, policy_version 712463 (0.0010) [2023-12-28 00:22:24,671][106225] Updated weights for policy 1, policy_version 714253 (0.0006) [2023-12-28 00:22:24,723][106225] Updated weights for policy 1, policy_version 714263 (0.0008) [2023-12-28 00:22:24,769][106225] Updated weights for policy 1, policy_version 714273 (0.0007) [2023-12-28 00:22:24,988][106226] Updated weights for policy 0, policy_version 712473 (0.0010) [2023-12-28 00:22:25,041][106226] Updated weights for policy 0, policy_version 712483 (0.0009) [2023-12-28 00:22:25,088][106226] Updated weights for policy 0, policy_version 712493 (0.0010) [2023-12-28 00:22:25,142][106226] Updated weights for policy 0, policy_version 712503 (0.0010) [2023-12-28 00:22:25,508][106225] Updated weights for policy 1, policy_version 714283 (0.0008) [2023-12-28 00:22:25,572][106225] Updated weights for policy 1, policy_version 714293 (0.0008) [2023-12-28 00:22:25,628][106225] Updated weights for policy 1, policy_version 714303 (0.0006) [2023-12-28 00:22:25,889][106226] Updated weights for policy 0, policy_version 712513 (0.0011) [2023-12-28 00:22:25,950][106226] Updated weights for policy 0, policy_version 712523 (0.0011) [2023-12-28 00:22:26,005][106226] Updated weights for policy 0, policy_version 712533 (0.0011) [2023-12-28 00:22:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 365363200. Throughput: 0: 9910.2, 1: 9728.8. Samples: 365332224. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:26,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-5.360')] [2023-12-28 00:22:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000714312_182902784.pth... [2023-12-28 00:22:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000712536_182460416.pth... [2023-12-28 00:22:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000713192_182616064.pth [2023-12-28 00:22:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000711352_182157312.pth [2023-12-28 00:22:26,252][106225] Updated weights for policy 1, policy_version 714313 (0.0005) [2023-12-28 00:22:26,314][106225] Updated weights for policy 1, policy_version 714323 (0.0008) [2023-12-28 00:22:26,367][106225] Updated weights for policy 1, policy_version 714333 (0.0006) [2023-12-28 00:22:26,417][106225] Updated weights for policy 1, policy_version 714343 (0.0005) [2023-12-28 00:22:26,690][106226] Updated weights for policy 0, policy_version 712543 (0.0010) [2023-12-28 00:22:26,734][106226] Updated weights for policy 0, policy_version 712553 (0.0010) [2023-12-28 00:22:26,780][106226] Updated weights for policy 0, policy_version 712563 (0.0010) [2023-12-28 00:22:27,062][106225] Updated weights for policy 1, policy_version 714353 (0.0005) [2023-12-28 00:22:27,118][106225] Updated weights for policy 1, policy_version 714363 (0.0007) [2023-12-28 00:22:27,171][106225] Updated weights for policy 1, policy_version 714373 (0.0007) [2023-12-28 00:22:27,517][106226] Updated weights for policy 0, policy_version 712573 (0.0010) [2023-12-28 00:22:27,576][106226] Updated weights for policy 0, policy_version 712583 (0.0010) [2023-12-28 00:22:27,638][106226] Updated weights for policy 0, policy_version 712593 (0.0010) [2023-12-28 00:22:27,811][106225] Updated weights for policy 1, policy_version 714383 (0.0008) [2023-12-28 00:22:27,869][106225] Updated weights for policy 1, policy_version 714393 (0.0007) [2023-12-28 00:22:27,921][106225] Updated weights for policy 1, policy_version 714403 (0.0008) [2023-12-28 00:22:28,327][106226] Updated weights for policy 0, policy_version 712603 (0.0010) [2023-12-28 00:22:28,381][106226] Updated weights for policy 0, policy_version 712613 (0.0011) [2023-12-28 00:22:28,431][106226] Updated weights for policy 0, policy_version 712623 (0.0010) [2023-12-28 00:22:28,648][106225] Updated weights for policy 1, policy_version 714413 (0.0007) [2023-12-28 00:22:28,708][106225] Updated weights for policy 1, policy_version 714423 (0.0008) [2023-12-28 00:22:28,769][106225] Updated weights for policy 1, policy_version 714433 (0.0008) [2023-12-28 00:22:29,115][106226] Updated weights for policy 0, policy_version 712633 (0.0010) [2023-12-28 00:22:29,178][106226] Updated weights for policy 0, policy_version 712643 (0.0008) [2023-12-28 00:22:29,246][106226] Updated weights for policy 0, policy_version 712653 (0.0009) [2023-12-28 00:22:29,307][106226] Updated weights for policy 0, policy_version 712663 (0.0008) [2023-12-28 00:22:29,517][106225] Updated weights for policy 1, policy_version 714443 (0.0007) [2023-12-28 00:22:29,574][106225] Updated weights for policy 1, policy_version 714453 (0.0005) [2023-12-28 00:22:29,640][106225] Updated weights for policy 1, policy_version 714463 (0.0006) [2023-12-28 00:22:30,086][106226] Updated weights for policy 0, policy_version 712673 (0.0009) [2023-12-28 00:22:30,167][106226] Updated weights for policy 0, policy_version 712683 (0.0008) [2023-12-28 00:22:30,225][106226] Updated weights for policy 0, policy_version 712693 (0.0009) [2023-12-28 00:22:30,244][106225] Updated weights for policy 1, policy_version 714473 (0.0005) [2023-12-28 00:22:30,304][106225] Updated weights for policy 1, policy_version 714483 (0.0009) [2023-12-28 00:22:30,367][106225] Updated weights for policy 1, policy_version 714493 (0.0007) [2023-12-28 00:22:30,425][106225] Updated weights for policy 1, policy_version 714503 (0.0007) [2023-12-28 00:22:30,979][106225] Updated weights for policy 1, policy_version 714513 (0.0006) [2023-12-28 00:22:31,009][106226] Updated weights for policy 0, policy_version 712703 (0.0008) [2023-12-28 00:22:31,055][106225] Updated weights for policy 1, policy_version 714523 (0.0008) [2023-12-28 00:22:31,066][106226] Updated weights for policy 0, policy_version 712713 (0.0008) [2023-12-28 00:22:31,118][106225] Updated weights for policy 1, policy_version 714533 (0.0010) [2023-12-28 00:22:31,124][106226] Updated weights for policy 0, policy_version 712723 (0.0008) [2023-12-28 00:22:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 365469696. Throughput: 0: 9942.2, 1: 9798.8. Samples: 365452384. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:31,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-5.735')] [2023-12-28 00:22:31,870][106225] Updated weights for policy 1, policy_version 714543 (0.0009) [2023-12-28 00:22:31,930][106225] Updated weights for policy 1, policy_version 714553 (0.0008) [2023-12-28 00:22:31,942][106226] Updated weights for policy 0, policy_version 712733 (0.0006) [2023-12-28 00:22:31,991][106225] Updated weights for policy 1, policy_version 714563 (0.0007) [2023-12-28 00:22:32,002][106226] Updated weights for policy 0, policy_version 712743 (0.0006) [2023-12-28 00:22:32,053][106226] Updated weights for policy 0, policy_version 712753 (0.0007) [2023-12-28 00:22:32,683][106225] Updated weights for policy 1, policy_version 714573 (0.0007) [2023-12-28 00:22:32,733][106225] Updated weights for policy 1, policy_version 714583 (0.0008) [2023-12-28 00:22:32,749][106226] Updated weights for policy 0, policy_version 712763 (0.0008) [2023-12-28 00:22:32,795][106225] Updated weights for policy 1, policy_version 714593 (0.0006) [2023-12-28 00:22:32,816][106226] Updated weights for policy 0, policy_version 712773 (0.0009) [2023-12-28 00:22:32,864][106226] Updated weights for policy 0, policy_version 712783 (0.0007) [2023-12-28 00:22:33,416][106225] Updated weights for policy 1, policy_version 714603 (0.0007) [2023-12-28 00:22:33,468][106225] Updated weights for policy 1, policy_version 714613 (0.0010) [2023-12-28 00:22:33,532][106225] Updated weights for policy 1, policy_version 714623 (0.0010) [2023-12-28 00:22:33,637][106226] Updated weights for policy 0, policy_version 712793 (0.0010) [2023-12-28 00:22:33,691][106226] Updated weights for policy 0, policy_version 712803 (0.0008) [2023-12-28 00:22:33,754][106226] Updated weights for policy 0, policy_version 712813 (0.0008) [2023-12-28 00:22:33,826][106226] Updated weights for policy 0, policy_version 712823 (0.0009) [2023-12-28 00:22:34,200][106225] Updated weights for policy 1, policy_version 714633 (0.0007) [2023-12-28 00:22:34,252][106225] Updated weights for policy 1, policy_version 714643 (0.0008) [2023-12-28 00:22:34,313][106225] Updated weights for policy 1, policy_version 714653 (0.0009) [2023-12-28 00:22:34,376][106225] Updated weights for policy 1, policy_version 714663 (0.0009) [2023-12-28 00:22:34,483][106226] Updated weights for policy 0, policy_version 712833 (0.0009) [2023-12-28 00:22:34,544][106226] Updated weights for policy 0, policy_version 712843 (0.0008) [2023-12-28 00:22:34,601][106226] Updated weights for policy 0, policy_version 712853 (0.0007) [2023-12-28 00:22:35,130][106225] Updated weights for policy 1, policy_version 714673 (0.0010) [2023-12-28 00:22:35,176][106225] Updated weights for policy 1, policy_version 714683 (0.0010) [2023-12-28 00:22:35,239][106225] Updated weights for policy 1, policy_version 714693 (0.0008) [2023-12-28 00:22:35,368][106226] Updated weights for policy 0, policy_version 712863 (0.0009) [2023-12-28 00:22:35,438][106226] Updated weights for policy 0, policy_version 712873 (0.0010) [2023-12-28 00:22:35,503][106226] Updated weights for policy 0, policy_version 712883 (0.0008) [2023-12-28 00:22:35,883][106225] Updated weights for policy 1, policy_version 714703 (0.0008) [2023-12-28 00:22:35,934][106225] Updated weights for policy 1, policy_version 714713 (0.0007) [2023-12-28 00:22:35,988][106225] Updated weights for policy 1, policy_version 714723 (0.0005) [2023-12-28 00:22:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 365559808. Throughput: 0: 9899.2, 1: 9841.1. Samples: 365570668. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:36,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.238')] [2023-12-28 00:22:36,260][106226] Updated weights for policy 0, policy_version 712893 (0.0008) [2023-12-28 00:22:36,329][106226] Updated weights for policy 0, policy_version 712903 (0.0008) [2023-12-28 00:22:36,400][106226] Updated weights for policy 0, policy_version 712913 (0.0008) [2023-12-28 00:22:36,745][106225] Updated weights for policy 1, policy_version 714733 (0.0007) [2023-12-28 00:22:36,806][106225] Updated weights for policy 1, policy_version 714743 (0.0008) [2023-12-28 00:22:36,860][106225] Updated weights for policy 1, policy_version 714753 (0.0009) [2023-12-28 00:22:37,092][106226] Updated weights for policy 0, policy_version 712923 (0.0008) [2023-12-28 00:22:37,155][106226] Updated weights for policy 0, policy_version 712933 (0.0008) [2023-12-28 00:22:37,216][106226] Updated weights for policy 0, policy_version 712943 (0.0008) [2023-12-28 00:22:37,566][106225] Updated weights for policy 1, policy_version 714763 (0.0008) [2023-12-28 00:22:37,623][106225] Updated weights for policy 1, policy_version 714773 (0.0008) [2023-12-28 00:22:37,682][106225] Updated weights for policy 1, policy_version 714783 (0.0008) [2023-12-28 00:22:37,961][106226] Updated weights for policy 0, policy_version 712953 (0.0009) [2023-12-28 00:22:38,014][106226] Updated weights for policy 0, policy_version 712963 (0.0009) [2023-12-28 00:22:38,071][106226] Updated weights for policy 0, policy_version 712973 (0.0008) [2023-12-28 00:22:38,126][106226] Updated weights for policy 0, policy_version 712983 (0.0008) [2023-12-28 00:22:38,399][106225] Updated weights for policy 1, policy_version 714793 (0.0008) [2023-12-28 00:22:38,461][106225] Updated weights for policy 1, policy_version 714803 (0.0009) [2023-12-28 00:22:38,515][106225] Updated weights for policy 1, policy_version 714813 (0.0006) [2023-12-28 00:22:38,578][106225] Updated weights for policy 1, policy_version 714823 (0.0007) [2023-12-28 00:22:38,892][106226] Updated weights for policy 0, policy_version 712993 (0.0008) [2023-12-28 00:22:38,957][106226] Updated weights for policy 0, policy_version 713003 (0.0009) [2023-12-28 00:22:39,022][106226] Updated weights for policy 0, policy_version 713013 (0.0008) [2023-12-28 00:22:39,229][106225] Updated weights for policy 1, policy_version 714833 (0.0007) [2023-12-28 00:22:39,293][106225] Updated weights for policy 1, policy_version 714843 (0.0010) [2023-12-28 00:22:39,357][106225] Updated weights for policy 1, policy_version 714853 (0.0007) [2023-12-28 00:22:39,848][106226] Updated weights for policy 0, policy_version 713023 (0.0010) [2023-12-28 00:22:39,919][106226] Updated weights for policy 0, policy_version 713033 (0.0009) [2023-12-28 00:22:39,987][106226] Updated weights for policy 0, policy_version 713043 (0.0009) [2023-12-28 00:22:40,048][106225] Updated weights for policy 1, policy_version 714863 (0.0010) [2023-12-28 00:22:40,115][106225] Updated weights for policy 1, policy_version 714873 (0.0010) [2023-12-28 00:22:40,177][106225] Updated weights for policy 1, policy_version 714883 (0.0010) [2023-12-28 00:22:40,663][106226] Updated weights for policy 0, policy_version 713053 (0.0008) [2023-12-28 00:22:40,727][106226] Updated weights for policy 0, policy_version 713063 (0.0008) [2023-12-28 00:22:40,787][106226] Updated weights for policy 0, policy_version 713073 (0.0008) [2023-12-28 00:22:40,899][106225] Updated weights for policy 1, policy_version 714893 (0.0009) [2023-12-28 00:22:40,957][106225] Updated weights for policy 1, policy_version 714903 (0.0006) [2023-12-28 00:22:41,017][106225] Updated weights for policy 1, policy_version 714913 (0.0006) [2023-12-28 00:22:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 365658112. Throughput: 0: 9852.6, 1: 9873.8. Samples: 365626848. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:41,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.441')] [2023-12-28 00:22:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000714920_183058432.pth... [2023-12-28 00:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000713080_182599680.pth... [2023-12-28 00:22:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000713736_182755328.pth [2023-12-28 00:22:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000711960_182312960.pth [2023-12-28 00:22:41,549][106226] Updated weights for policy 0, policy_version 713083 (0.0009) [2023-12-28 00:22:41,605][106226] Updated weights for policy 0, policy_version 713093 (0.0009) [2023-12-28 00:22:41,671][106226] Updated weights for policy 0, policy_version 713103 (0.0009) [2023-12-28 00:22:41,757][106225] Updated weights for policy 1, policy_version 714923 (0.0008) [2023-12-28 00:22:41,812][106225] Updated weights for policy 1, policy_version 714933 (0.0008) [2023-12-28 00:22:41,864][106225] Updated weights for policy 1, policy_version 714943 (0.0008) [2023-12-28 00:22:42,451][106226] Updated weights for policy 0, policy_version 713113 (0.0007) [2023-12-28 00:22:42,517][106226] Updated weights for policy 0, policy_version 713123 (0.0008) [2023-12-28 00:22:42,579][106226] Updated weights for policy 0, policy_version 713133 (0.0008) [2023-12-28 00:22:42,647][106226] Updated weights for policy 0, policy_version 713143 (0.0008) [2023-12-28 00:22:42,664][106225] Updated weights for policy 1, policy_version 714953 (0.0008) [2023-12-28 00:22:42,710][106225] Updated weights for policy 1, policy_version 714963 (0.0008) [2023-12-28 00:22:42,757][106225] Updated weights for policy 1, policy_version 714973 (0.0005) [2023-12-28 00:22:42,829][106225] Updated weights for policy 1, policy_version 714983 (0.0005) [2023-12-28 00:22:43,228][106226] Updated weights for policy 0, policy_version 713153 (0.0006) [2023-12-28 00:22:43,299][106226] Updated weights for policy 0, policy_version 713163 (0.0006) [2023-12-28 00:22:43,358][106226] Updated weights for policy 0, policy_version 713173 (0.0005) [2023-12-28 00:22:43,383][106225] Updated weights for policy 1, policy_version 714993 (0.0008) [2023-12-28 00:22:43,440][106225] Updated weights for policy 1, policy_version 715003 (0.0008) [2023-12-28 00:22:43,503][106225] Updated weights for policy 1, policy_version 715013 (0.0009) [2023-12-28 00:22:43,871][106226] Updated weights for policy 0, policy_version 713183 (0.0007) [2023-12-28 00:22:43,919][106226] Updated weights for policy 0, policy_version 713193 (0.0005) [2023-12-28 00:22:43,965][106226] Updated weights for policy 0, policy_version 713203 (0.0005) [2023-12-28 00:22:44,260][106225] Updated weights for policy 1, policy_version 715023 (0.0008) [2023-12-28 00:22:44,319][106225] Updated weights for policy 1, policy_version 715033 (0.0008) [2023-12-28 00:22:44,378][106225] Updated weights for policy 1, policy_version 715043 (0.0010) [2023-12-28 00:22:44,572][106226] Updated weights for policy 0, policy_version 713213 (0.0007) [2023-12-28 00:22:44,630][106226] Updated weights for policy 0, policy_version 713223 (0.0007) [2023-12-28 00:22:44,680][106226] Updated weights for policy 0, policy_version 713233 (0.0007) [2023-12-28 00:22:45,065][106225] Updated weights for policy 1, policy_version 715053 (0.0010) [2023-12-28 00:22:45,133][106225] Updated weights for policy 1, policy_version 715063 (0.0008) [2023-12-28 00:22:45,193][106225] Updated weights for policy 1, policy_version 715073 (0.0005) [2023-12-28 00:22:45,477][106226] Updated weights for policy 0, policy_version 713243 (0.0007) [2023-12-28 00:22:45,527][106226] Updated weights for policy 0, policy_version 713253 (0.0009) [2023-12-28 00:22:45,576][106226] Updated weights for policy 0, policy_version 713263 (0.0008) [2023-12-28 00:22:45,762][106225] Updated weights for policy 1, policy_version 715083 (0.0008) [2023-12-28 00:22:45,819][106225] Updated weights for policy 1, policy_version 715093 (0.0005) [2023-12-28 00:22:45,879][106225] Updated weights for policy 1, policy_version 715103 (0.0006) [2023-12-28 00:22:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 365756416. Throughput: 0: 9785.2, 1: 9926.3. Samples: 365746640. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:46,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.519')] [2023-12-28 00:22:46,378][106226] Updated weights for policy 0, policy_version 713273 (0.0007) [2023-12-28 00:22:46,439][106226] Updated weights for policy 0, policy_version 713283 (0.0008) [2023-12-28 00:22:46,504][106226] Updated weights for policy 0, policy_version 713293 (0.0007) [2023-12-28 00:22:46,528][106225] Updated weights for policy 1, policy_version 715113 (0.0005) [2023-12-28 00:22:46,567][106226] Updated weights for policy 0, policy_version 713303 (0.0008) [2023-12-28 00:22:46,585][106225] Updated weights for policy 1, policy_version 715123 (0.0005) [2023-12-28 00:22:46,634][106225] Updated weights for policy 1, policy_version 715133 (0.0010) [2023-12-28 00:22:46,681][106225] Updated weights for policy 1, policy_version 715143 (0.0010) [2023-12-28 00:22:47,302][106225] Updated weights for policy 1, policy_version 715153 (0.0008) [2023-12-28 00:22:47,323][106226] Updated weights for policy 0, policy_version 713313 (0.0007) [2023-12-28 00:22:47,366][106225] Updated weights for policy 1, policy_version 715163 (0.0011) [2023-12-28 00:22:47,376][106226] Updated weights for policy 0, policy_version 713323 (0.0008) [2023-12-28 00:22:47,420][106225] Updated weights for policy 1, policy_version 715173 (0.0010) [2023-12-28 00:22:47,434][106226] Updated weights for policy 0, policy_version 713333 (0.0005) [2023-12-28 00:22:48,001][106225] Updated weights for policy 1, policy_version 715183 (0.0007) [2023-12-28 00:22:48,054][106225] Updated weights for policy 1, policy_version 715193 (0.0008) [2023-12-28 00:22:48,118][106225] Updated weights for policy 1, policy_version 715203 (0.0008) [2023-12-28 00:22:48,155][106226] Updated weights for policy 0, policy_version 713343 (0.0009) [2023-12-28 00:22:48,215][106226] Updated weights for policy 0, policy_version 713353 (0.0010) [2023-12-28 00:22:48,265][106226] Updated weights for policy 0, policy_version 713363 (0.0010) [2023-12-28 00:22:48,855][106225] Updated weights for policy 1, policy_version 715213 (0.0010) [2023-12-28 00:22:48,916][106225] Updated weights for policy 1, policy_version 715223 (0.0008) [2023-12-28 00:22:48,946][106226] Updated weights for policy 0, policy_version 713373 (0.0009) [2023-12-28 00:22:48,979][106225] Updated weights for policy 1, policy_version 715233 (0.0008) [2023-12-28 00:22:49,005][106226] Updated weights for policy 0, policy_version 713383 (0.0007) [2023-12-28 00:22:49,061][106226] Updated weights for policy 0, policy_version 713393 (0.0009) [2023-12-28 00:22:49,738][106225] Updated weights for policy 1, policy_version 715243 (0.0007) [2023-12-28 00:22:49,799][106225] Updated weights for policy 1, policy_version 715253 (0.0008) [2023-12-28 00:22:49,867][106226] Updated weights for policy 0, policy_version 713403 (0.0009) [2023-12-28 00:22:49,870][106225] Updated weights for policy 1, policy_version 715263 (0.0008) [2023-12-28 00:22:49,927][106226] Updated weights for policy 0, policy_version 713413 (0.0006) [2023-12-28 00:22:49,988][106226] Updated weights for policy 0, policy_version 713423 (0.0008) [2023-12-28 00:22:50,608][106225] Updated weights for policy 1, policy_version 715273 (0.0007) [2023-12-28 00:22:50,672][106225] Updated weights for policy 1, policy_version 715283 (0.0009) [2023-12-28 00:22:50,722][106226] Updated weights for policy 0, policy_version 713433 (0.0008) [2023-12-28 00:22:50,736][106225] Updated weights for policy 1, policy_version 715293 (0.0008) [2023-12-28 00:22:50,785][106226] Updated weights for policy 0, policy_version 713443 (0.0008) [2023-12-28 00:22:50,804][106225] Updated weights for policy 1, policy_version 715303 (0.0007) [2023-12-28 00:22:50,853][106226] Updated weights for policy 0, policy_version 713453 (0.0006) [2023-12-28 00:22:50,918][106226] Updated weights for policy 0, policy_version 713463 (0.0006) [2023-12-28 00:22:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 365854720. Throughput: 0: 9706.7, 1: 9996.7. Samples: 365864264. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:51,175][105115] Avg episode reward: [(0, '-4.670'), (1, '-5.261')] [2023-12-28 00:22:51,555][106225] Updated weights for policy 1, policy_version 715313 (0.0006) [2023-12-28 00:22:51,594][106226] Updated weights for policy 0, policy_version 713473 (0.0007) [2023-12-28 00:22:51,621][106225] Updated weights for policy 1, policy_version 715323 (0.0009) [2023-12-28 00:22:51,659][106226] Updated weights for policy 0, policy_version 713483 (0.0009) [2023-12-28 00:22:51,684][106225] Updated weights for policy 1, policy_version 715333 (0.0007) [2023-12-28 00:22:51,728][106226] Updated weights for policy 0, policy_version 713493 (0.0008) [2023-12-28 00:22:52,407][106225] Updated weights for policy 1, policy_version 715343 (0.0008) [2023-12-28 00:22:52,424][106226] Updated weights for policy 0, policy_version 713503 (0.0007) [2023-12-28 00:22:52,466][106225] Updated weights for policy 1, policy_version 715353 (0.0008) [2023-12-28 00:22:52,480][106226] Updated weights for policy 0, policy_version 713513 (0.0008) [2023-12-28 00:22:52,526][106225] Updated weights for policy 1, policy_version 715363 (0.0008) [2023-12-28 00:22:52,545][106226] Updated weights for policy 0, policy_version 713523 (0.0007) [2023-12-28 00:22:53,258][106226] Updated weights for policy 0, policy_version 713533 (0.0008) [2023-12-28 00:22:53,276][106225] Updated weights for policy 1, policy_version 715373 (0.0008) [2023-12-28 00:22:53,310][106226] Updated weights for policy 0, policy_version 713543 (0.0008) [2023-12-28 00:22:53,320][106225] Updated weights for policy 1, policy_version 715383 (0.0006) [2023-12-28 00:22:53,365][106226] Updated weights for policy 0, policy_version 713553 (0.0006) [2023-12-28 00:22:53,366][106225] Updated weights for policy 1, policy_version 715393 (0.0007) [2023-12-28 00:22:53,995][106226] Updated weights for policy 0, policy_version 713563 (0.0006) [2023-12-28 00:22:54,057][106226] Updated weights for policy 0, policy_version 713573 (0.0008) [2023-12-28 00:22:54,082][106225] Updated weights for policy 1, policy_version 715403 (0.0006) [2023-12-28 00:22:54,119][106226] Updated weights for policy 0, policy_version 713583 (0.0008) [2023-12-28 00:22:54,135][106225] Updated weights for policy 1, policy_version 715413 (0.0007) [2023-12-28 00:22:54,189][106225] Updated weights for policy 1, policy_version 715423 (0.0008) [2023-12-28 00:22:54,837][106225] Updated weights for policy 1, policy_version 715433 (0.0006) [2023-12-28 00:22:54,845][106226] Updated weights for policy 0, policy_version 713593 (0.0005) [2023-12-28 00:22:54,896][106225] Updated weights for policy 1, policy_version 715443 (0.0010) [2023-12-28 00:22:54,904][106226] Updated weights for policy 0, policy_version 713603 (0.0007) [2023-12-28 00:22:54,951][106226] Updated weights for policy 0, policy_version 713613 (0.0010) [2023-12-28 00:22:54,953][106225] Updated weights for policy 1, policy_version 715453 (0.0010) [2023-12-28 00:22:55,006][106226] Updated weights for policy 0, policy_version 713623 (0.0009) [2023-12-28 00:22:55,013][106225] Updated weights for policy 1, policy_version 715463 (0.0010) [2023-12-28 00:22:55,711][106225] Updated weights for policy 1, policy_version 715473 (0.0010) [2023-12-28 00:22:55,731][106226] Updated weights for policy 0, policy_version 713633 (0.0011) [2023-12-28 00:22:55,760][106225] Updated weights for policy 1, policy_version 715483 (0.0009) [2023-12-28 00:22:55,796][106226] Updated weights for policy 0, policy_version 713643 (0.0011) [2023-12-28 00:22:55,813][106225] Updated weights for policy 1, policy_version 715493 (0.0010) [2023-12-28 00:22:55,854][106226] Updated weights for policy 0, policy_version 713653 (0.0010) [2023-12-28 00:22:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 365953024. Throughput: 0: 9656.6, 1: 9964.4. Samples: 365921996. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:22:56,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-5.521')] [2023-12-28 00:22:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000715496_183205888.pth... [2023-12-28 00:22:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000713656_182747136.pth... [2023-12-28 00:22:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000714312_182902784.pth [2023-12-28 00:22:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000712536_182460416.pth [2023-12-28 00:22:56,537][106226] Updated weights for policy 0, policy_version 713663 (0.0010) [2023-12-28 00:22:56,553][106225] Updated weights for policy 1, policy_version 715503 (0.0010) [2023-12-28 00:22:56,597][106226] Updated weights for policy 0, policy_version 713673 (0.0010) [2023-12-28 00:22:56,600][106225] Updated weights for policy 1, policy_version 715513 (0.0010) [2023-12-28 00:22:56,653][106225] Updated weights for policy 1, policy_version 715523 (0.0009) [2023-12-28 00:22:56,657][106226] Updated weights for policy 0, policy_version 713683 (0.0010) [2023-12-28 00:22:57,293][106225] Updated weights for policy 1, policy_version 715533 (0.0008) [2023-12-28 00:22:57,335][106226] Updated weights for policy 0, policy_version 713693 (0.0008) [2023-12-28 00:22:57,350][106225] Updated weights for policy 1, policy_version 715543 (0.0009) [2023-12-28 00:22:57,399][106225] Updated weights for policy 1, policy_version 715553 (0.0005) [2023-12-28 00:22:57,400][106226] Updated weights for policy 0, policy_version 713703 (0.0011) [2023-12-28 00:22:57,455][106226] Updated weights for policy 0, policy_version 713713 (0.0010) [2023-12-28 00:22:58,023][106225] Updated weights for policy 1, policy_version 715563 (0.0006) [2023-12-28 00:22:58,078][106225] Updated weights for policy 1, policy_version 715573 (0.0009) [2023-12-28 00:22:58,119][106226] Updated weights for policy 0, policy_version 713723 (0.0009) [2023-12-28 00:22:58,129][106225] Updated weights for policy 1, policy_version 715584 (0.0007) [2023-12-28 00:22:58,179][106226] Updated weights for policy 0, policy_version 713733 (0.0005) [2023-12-28 00:22:58,243][106226] Updated weights for policy 0, policy_version 713743 (0.0007) [2023-12-28 00:22:58,946][106225] Updated weights for policy 1, policy_version 715594 (0.0008) [2023-12-28 00:22:59,007][106225] Updated weights for policy 1, policy_version 715604 (0.0010) [2023-12-28 00:22:59,049][106226] Updated weights for policy 0, policy_version 713753 (0.0008) [2023-12-28 00:22:59,066][106225] Updated weights for policy 1, policy_version 715614 (0.0011) [2023-12-28 00:22:59,111][106226] Updated weights for policy 0, policy_version 713763 (0.0006) [2023-12-28 00:22:59,121][106225] Updated weights for policy 1, policy_version 715624 (0.0010) [2023-12-28 00:22:59,168][106226] Updated weights for policy 0, policy_version 713773 (0.0007) [2023-12-28 00:22:59,236][106226] Updated weights for policy 0, policy_version 713783 (0.0008) [2023-12-28 00:22:59,892][106225] Updated weights for policy 1, policy_version 715634 (0.0009) [2023-12-28 00:22:59,930][106226] Updated weights for policy 0, policy_version 713793 (0.0006) [2023-12-28 00:22:59,952][106225] Updated weights for policy 1, policy_version 715644 (0.0008) [2023-12-28 00:23:00,003][106226] Updated weights for policy 0, policy_version 713803 (0.0006) [2023-12-28 00:23:00,019][106225] Updated weights for policy 1, policy_version 715654 (0.0007) [2023-12-28 00:23:00,062][106226] Updated weights for policy 0, policy_version 713813 (0.0008) [2023-12-28 00:23:00,591][106225] Updated weights for policy 1, policy_version 715664 (0.0007) [2023-12-28 00:23:00,641][106225] Updated weights for policy 1, policy_version 715674 (0.0008) [2023-12-28 00:23:00,687][106225] Updated weights for policy 1, policy_version 715684 (0.0009) [2023-12-28 00:23:00,708][106226] Updated weights for policy 0, policy_version 713823 (0.0008) [2023-12-28 00:23:00,761][106226] Updated weights for policy 0, policy_version 713833 (0.0009) [2023-12-28 00:23:00,813][106226] Updated weights for policy 0, policy_version 713843 (0.0008) [2023-12-28 00:23:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 366051328. Throughput: 0: 9650.7, 1: 10009.5. Samples: 366040524. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 00:23:01,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.683')] [2023-12-28 00:23:01,380][106225] Updated weights for policy 1, policy_version 715694 (0.0007) [2023-12-28 00:23:01,437][106225] Updated weights for policy 1, policy_version 715704 (0.0007) [2023-12-28 00:23:01,503][106225] Updated weights for policy 1, policy_version 715714 (0.0005) [2023-12-28 00:23:01,553][106226] Updated weights for policy 0, policy_version 713853 (0.0008) [2023-12-28 00:23:01,615][106226] Updated weights for policy 0, policy_version 713863 (0.0009) [2023-12-28 00:23:01,674][106226] Updated weights for policy 0, policy_version 713873 (0.0007) [2023-12-28 00:23:02,160][106225] Updated weights for policy 1, policy_version 715724 (0.0007) [2023-12-28 00:23:02,215][106225] Updated weights for policy 1, policy_version 715734 (0.0008) [2023-12-28 00:23:02,279][106225] Updated weights for policy 1, policy_version 715744 (0.0008) [2023-12-28 00:23:02,408][106226] Updated weights for policy 0, policy_version 713883 (0.0008) [2023-12-28 00:23:02,474][106226] Updated weights for policy 0, policy_version 713893 (0.0008) [2023-12-28 00:23:02,525][106226] Updated weights for policy 0, policy_version 713903 (0.0008) [2023-12-28 00:23:02,969][106225] Updated weights for policy 1, policy_version 715754 (0.0006) [2023-12-28 00:23:03,024][106225] Updated weights for policy 1, policy_version 715764 (0.0005) [2023-12-28 00:23:03,081][106225] Updated weights for policy 1, policy_version 715774 (0.0005) [2023-12-28 00:23:03,133][106225] Updated weights for policy 1, policy_version 715784 (0.0005) [2023-12-28 00:23:03,271][106226] Updated weights for policy 0, policy_version 713913 (0.0009) [2023-12-28 00:23:03,334][106226] Updated weights for policy 0, policy_version 713923 (0.0006) [2023-12-28 00:23:03,387][106226] Updated weights for policy 0, policy_version 713933 (0.0009) [2023-12-28 00:23:03,438][106226] Updated weights for policy 0, policy_version 713943 (0.0005) [2023-12-28 00:23:03,662][106225] Updated weights for policy 1, policy_version 715794 (0.0005) [2023-12-28 00:23:03,709][106225] Updated weights for policy 1, policy_version 715804 (0.0005) [2023-12-28 00:23:03,764][106225] Updated weights for policy 1, policy_version 715814 (0.0005) [2023-12-28 00:23:04,155][106226] Updated weights for policy 0, policy_version 713953 (0.0008) [2023-12-28 00:23:04,218][106226] Updated weights for policy 0, policy_version 713963 (0.0009) [2023-12-28 00:23:04,280][106226] Updated weights for policy 0, policy_version 713973 (0.0008) [2023-12-28 00:23:04,404][106225] Updated weights for policy 1, policy_version 715824 (0.0008) [2023-12-28 00:23:04,460][106225] Updated weights for policy 1, policy_version 715834 (0.0008) [2023-12-28 00:23:04,520][106225] Updated weights for policy 1, policy_version 715844 (0.0009) [2023-12-28 00:23:05,003][106226] Updated weights for policy 0, policy_version 713983 (0.0006) [2023-12-28 00:23:05,062][106226] Updated weights for policy 0, policy_version 713993 (0.0009) [2023-12-28 00:23:05,113][106226] Updated weights for policy 0, policy_version 714003 (0.0007) [2023-12-28 00:23:05,234][106225] Updated weights for policy 1, policy_version 715854 (0.0007) [2023-12-28 00:23:05,297][106225] Updated weights for policy 1, policy_version 715864 (0.0005) [2023-12-28 00:23:05,360][106225] Updated weights for policy 1, policy_version 715874 (0.0005) [2023-12-28 00:23:05,769][106226] Updated weights for policy 0, policy_version 714013 (0.0006) [2023-12-28 00:23:05,824][106226] Updated weights for policy 0, policy_version 714023 (0.0009) [2023-12-28 00:23:05,869][106225] Updated weights for policy 1, policy_version 715884 (0.0005) [2023-12-28 00:23:05,877][106226] Updated weights for policy 0, policy_version 714033 (0.0010) [2023-12-28 00:23:05,930][106225] Updated weights for policy 1, policy_version 715894 (0.0005) [2023-12-28 00:23:05,987][106225] Updated weights for policy 1, policy_version 715904 (0.0006) [2023-12-28 00:23:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 366157824. Throughput: 0: 9645.0, 1: 10116.6. Samples: 366163480. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:06,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.176')] [2023-12-28 00:23:06,540][106225] Updated weights for policy 1, policy_version 715914 (0.0005) [2023-12-28 00:23:06,597][106225] Updated weights for policy 1, policy_version 715924 (0.0007) [2023-12-28 00:23:06,600][106226] Updated weights for policy 0, policy_version 714043 (0.0010) [2023-12-28 00:23:06,654][106225] Updated weights for policy 1, policy_version 715934 (0.0007) [2023-12-28 00:23:06,660][106226] Updated weights for policy 0, policy_version 714053 (0.0007) [2023-12-28 00:23:06,705][106225] Updated weights for policy 1, policy_version 715944 (0.0008) [2023-12-28 00:23:06,718][106226] Updated weights for policy 0, policy_version 714063 (0.0006) [2023-12-28 00:23:07,287][106226] Updated weights for policy 0, policy_version 714073 (0.0005) [2023-12-28 00:23:07,351][106226] Updated weights for policy 0, policy_version 714083 (0.0007) [2023-12-28 00:23:07,410][106226] Updated weights for policy 0, policy_version 714093 (0.0008) [2023-12-28 00:23:07,472][106226] Updated weights for policy 0, policy_version 714103 (0.0011) [2023-12-28 00:23:07,522][106225] Updated weights for policy 1, policy_version 715954 (0.0009) [2023-12-28 00:23:07,591][106225] Updated weights for policy 1, policy_version 715964 (0.0008) [2023-12-28 00:23:07,641][106225] Updated weights for policy 1, policy_version 715974 (0.0008) [2023-12-28 00:23:08,131][106226] Updated weights for policy 0, policy_version 714113 (0.0006) [2023-12-28 00:23:08,193][106226] Updated weights for policy 0, policy_version 714123 (0.0005) [2023-12-28 00:23:08,258][106226] Updated weights for policy 0, policy_version 714133 (0.0006) [2023-12-28 00:23:08,414][106225] Updated weights for policy 1, policy_version 715984 (0.0009) [2023-12-28 00:23:08,482][106225] Updated weights for policy 1, policy_version 715994 (0.0008) [2023-12-28 00:23:08,540][106225] Updated weights for policy 1, policy_version 716004 (0.0008) [2023-12-28 00:23:08,920][106226] Updated weights for policy 0, policy_version 714143 (0.0008) [2023-12-28 00:23:08,977][106226] Updated weights for policy 0, policy_version 714153 (0.0008) [2023-12-28 00:23:09,023][106226] Updated weights for policy 0, policy_version 714163 (0.0005) [2023-12-28 00:23:09,214][106225] Updated weights for policy 1, policy_version 716014 (0.0008) [2023-12-28 00:23:09,281][106225] Updated weights for policy 1, policy_version 716024 (0.0010) [2023-12-28 00:23:09,347][106225] Updated weights for policy 1, policy_version 716034 (0.0012) [2023-12-28 00:23:09,801][106226] Updated weights for policy 0, policy_version 714173 (0.0007) [2023-12-28 00:23:09,863][106226] Updated weights for policy 0, policy_version 714183 (0.0009) [2023-12-28 00:23:09,922][106226] Updated weights for policy 0, policy_version 714193 (0.0008) [2023-12-28 00:23:10,081][106225] Updated weights for policy 1, policy_version 716044 (0.0009) [2023-12-28 00:23:10,150][106225] Updated weights for policy 1, policy_version 716054 (0.0006) [2023-12-28 00:23:10,222][106225] Updated weights for policy 1, policy_version 716064 (0.0006) [2023-12-28 00:23:10,560][106226] Updated weights for policy 0, policy_version 714203 (0.0008) [2023-12-28 00:23:10,615][106226] Updated weights for policy 0, policy_version 714213 (0.0010) [2023-12-28 00:23:10,664][106226] Updated weights for policy 0, policy_version 714223 (0.0009) [2023-12-28 00:23:10,828][106225] Updated weights for policy 1, policy_version 716074 (0.0007) [2023-12-28 00:23:10,888][106225] Updated weights for policy 1, policy_version 716084 (0.0010) [2023-12-28 00:23:10,942][106225] Updated weights for policy 1, policy_version 716094 (0.0006) [2023-12-28 00:23:10,999][106225] Updated weights for policy 1, policy_version 716104 (0.0005) [2023-12-28 00:23:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 366256128. Throughput: 0: 9709.6, 1: 10103.7. Samples: 366223824. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:11,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.624')] [2023-12-28 00:23:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000714232_182894592.pth... [2023-12-28 00:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000716104_183361536.pth... [2023-12-28 00:23:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000713080_182599680.pth [2023-12-28 00:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000714920_183058432.pth [2023-12-28 00:23:11,416][106226] Updated weights for policy 0, policy_version 714233 (0.0009) [2023-12-28 00:23:11,483][106226] Updated weights for policy 0, policy_version 714243 (0.0009) [2023-12-28 00:23:11,543][106226] Updated weights for policy 0, policy_version 714253 (0.0009) [2023-12-28 00:23:11,609][106226] Updated weights for policy 0, policy_version 714263 (0.0008) [2023-12-28 00:23:11,719][106225] Updated weights for policy 1, policy_version 716114 (0.0009) [2023-12-28 00:23:11,794][106225] Updated weights for policy 1, policy_version 716124 (0.0008) [2023-12-28 00:23:11,864][106225] Updated weights for policy 1, policy_version 716134 (0.0008) [2023-12-28 00:23:12,309][106226] Updated weights for policy 0, policy_version 714273 (0.0009) [2023-12-28 00:23:12,374][106226] Updated weights for policy 0, policy_version 714283 (0.0008) [2023-12-28 00:23:12,433][106226] Updated weights for policy 0, policy_version 714293 (0.0009) [2023-12-28 00:23:12,560][106225] Updated weights for policy 1, policy_version 716144 (0.0008) [2023-12-28 00:23:12,625][106225] Updated weights for policy 1, policy_version 716154 (0.0009) [2023-12-28 00:23:12,686][106225] Updated weights for policy 1, policy_version 716164 (0.0008) [2023-12-28 00:23:13,179][106226] Updated weights for policy 0, policy_version 714303 (0.0010) [2023-12-28 00:23:13,227][106226] Updated weights for policy 0, policy_version 714313 (0.0009) [2023-12-28 00:23:13,282][106226] Updated weights for policy 0, policy_version 714323 (0.0009) [2023-12-28 00:23:13,403][106225] Updated weights for policy 1, policy_version 716174 (0.0006) [2023-12-28 00:23:13,453][106225] Updated weights for policy 1, policy_version 716184 (0.0005) [2023-12-28 00:23:13,511][106225] Updated weights for policy 1, policy_version 716194 (0.0005) [2023-12-28 00:23:13,971][106226] Updated weights for policy 0, policy_version 714333 (0.0009) [2023-12-28 00:23:14,031][106226] Updated weights for policy 0, policy_version 714343 (0.0010) [2023-12-28 00:23:14,089][106226] Updated weights for policy 0, policy_version 714353 (0.0009) [2023-12-28 00:23:14,122][106225] Updated weights for policy 1, policy_version 716204 (0.0008) [2023-12-28 00:23:14,181][106225] Updated weights for policy 1, policy_version 716214 (0.0009) [2023-12-28 00:23:14,230][106225] Updated weights for policy 1, policy_version 716224 (0.0008) [2023-12-28 00:23:14,772][106226] Updated weights for policy 0, policy_version 714363 (0.0008) [2023-12-28 00:23:14,835][106226] Updated weights for policy 0, policy_version 714373 (0.0009) [2023-12-28 00:23:14,890][106225] Updated weights for policy 1, policy_version 716234 (0.0008) [2023-12-28 00:23:14,893][106226] Updated weights for policy 0, policy_version 714383 (0.0007) [2023-12-28 00:23:14,943][106225] Updated weights for policy 1, policy_version 716244 (0.0007) [2023-12-28 00:23:15,007][106225] Updated weights for policy 1, policy_version 716254 (0.0007) [2023-12-28 00:23:15,062][106225] Updated weights for policy 1, policy_version 716264 (0.0007) [2023-12-28 00:23:15,655][106226] Updated weights for policy 0, policy_version 714393 (0.0007) [2023-12-28 00:23:15,716][106226] Updated weights for policy 0, policy_version 714403 (0.0008) [2023-12-28 00:23:15,741][106225] Updated weights for policy 1, policy_version 716274 (0.0009) [2023-12-28 00:23:15,775][106226] Updated weights for policy 0, policy_version 714413 (0.0007) [2023-12-28 00:23:15,803][106225] Updated weights for policy 1, policy_version 716284 (0.0007) [2023-12-28 00:23:15,828][106226] Updated weights for policy 0, policy_version 714423 (0.0007) [2023-12-28 00:23:15,850][106225] Updated weights for policy 1, policy_version 716294 (0.0005) [2023-12-28 00:23:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 366354432. Throughput: 0: 9685.5, 1: 10087.7. Samples: 366342180. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:16,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-5.600')] [2023-12-28 00:23:16,516][106226] Updated weights for policy 0, policy_version 714433 (0.0010) [2023-12-28 00:23:16,563][106226] Updated weights for policy 0, policy_version 714443 (0.0010) [2023-12-28 00:23:16,569][106225] Updated weights for policy 1, policy_version 716304 (0.0005) [2023-12-28 00:23:16,616][106226] Updated weights for policy 0, policy_version 714453 (0.0010) [2023-12-28 00:23:16,626][106225] Updated weights for policy 1, policy_version 716314 (0.0005) [2023-12-28 00:23:16,675][106225] Updated weights for policy 1, policy_version 716324 (0.0007) [2023-12-28 00:23:17,355][106226] Updated weights for policy 0, policy_version 714463 (0.0011) [2023-12-28 00:23:17,416][106226] Updated weights for policy 0, policy_version 714473 (0.0010) [2023-12-28 00:23:17,442][106225] Updated weights for policy 1, policy_version 716334 (0.0009) [2023-12-28 00:23:17,482][106226] Updated weights for policy 0, policy_version 714483 (0.0011) [2023-12-28 00:23:17,496][106225] Updated weights for policy 1, policy_version 716344 (0.0006) [2023-12-28 00:23:17,541][106225] Updated weights for policy 1, policy_version 716354 (0.0008) [2023-12-28 00:23:18,137][106226] Updated weights for policy 0, policy_version 714493 (0.0008) [2023-12-28 00:23:18,194][106226] Updated weights for policy 0, policy_version 714503 (0.0005) [2023-12-28 00:23:18,259][106226] Updated weights for policy 0, policy_version 714513 (0.0005) [2023-12-28 00:23:18,299][106225] Updated weights for policy 1, policy_version 716364 (0.0008) [2023-12-28 00:23:18,357][106225] Updated weights for policy 1, policy_version 716374 (0.0008) [2023-12-28 00:23:18,410][106225] Updated weights for policy 1, policy_version 716384 (0.0006) [2023-12-28 00:23:18,907][106226] Updated weights for policy 0, policy_version 714523 (0.0006) [2023-12-28 00:23:18,970][106226] Updated weights for policy 0, policy_version 714533 (0.0007) [2023-12-28 00:23:19,027][106226] Updated weights for policy 0, policy_version 714543 (0.0008) [2023-12-28 00:23:19,143][106225] Updated weights for policy 1, policy_version 716394 (0.0008) [2023-12-28 00:23:19,201][106225] Updated weights for policy 1, policy_version 716404 (0.0006) [2023-12-28 00:23:19,268][106225] Updated weights for policy 1, policy_version 716414 (0.0008) [2023-12-28 00:23:19,318][106225] Updated weights for policy 1, policy_version 716424 (0.0008) [2023-12-28 00:23:19,839][106226] Updated weights for policy 0, policy_version 714555 (0.0008) [2023-12-28 00:23:19,900][106226] Updated weights for policy 0, policy_version 714565 (0.0008) [2023-12-28 00:23:19,968][106226] Updated weights for policy 0, policy_version 714575 (0.0009) [2023-12-28 00:23:20,040][106225] Updated weights for policy 1, policy_version 716434 (0.0008) [2023-12-28 00:23:20,098][106225] Updated weights for policy 1, policy_version 716444 (0.0009) [2023-12-28 00:23:20,157][106225] Updated weights for policy 1, policy_version 716454 (0.0011) [2023-12-28 00:23:20,819][106226] Updated weights for policy 0, policy_version 714585 (0.0008) [2023-12-28 00:23:20,844][106225] Updated weights for policy 1, policy_version 716464 (0.0010) [2023-12-28 00:23:20,881][106226] Updated weights for policy 0, policy_version 714595 (0.0006) [2023-12-28 00:23:20,892][106225] Updated weights for policy 1, policy_version 716474 (0.0010) [2023-12-28 00:23:20,936][106226] Updated weights for policy 0, policy_version 714605 (0.0008) [2023-12-28 00:23:20,939][106225] Updated weights for policy 1, policy_version 716484 (0.0010) [2023-12-28 00:23:20,995][106226] Updated weights for policy 0, policy_version 714615 (0.0007) [2023-12-28 00:23:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 366452736. Throughput: 0: 9708.6, 1: 10007.7. Samples: 366457900. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:21,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-5.210')] [2023-12-28 00:23:21,754][106225] Updated weights for policy 1, policy_version 716494 (0.0008) [2023-12-28 00:23:21,802][106226] Updated weights for policy 0, policy_version 714625 (0.0009) [2023-12-28 00:23:21,819][106225] Updated weights for policy 1, policy_version 716504 (0.0009) [2023-12-28 00:23:21,869][106226] Updated weights for policy 0, policy_version 714635 (0.0007) [2023-12-28 00:23:21,884][106225] Updated weights for policy 1, policy_version 716514 (0.0006) [2023-12-28 00:23:21,940][106226] Updated weights for policy 0, policy_version 714645 (0.0008) [2023-12-28 00:23:22,540][106225] Updated weights for policy 1, policy_version 716524 (0.0006) [2023-12-28 00:23:22,599][106225] Updated weights for policy 1, policy_version 716534 (0.0007) [2023-12-28 00:23:22,654][106225] Updated weights for policy 1, policy_version 716544 (0.0006) [2023-12-28 00:23:22,692][106226] Updated weights for policy 0, policy_version 714655 (0.0009) [2023-12-28 00:23:22,748][106226] Updated weights for policy 0, policy_version 714665 (0.0008) [2023-12-28 00:23:22,802][106226] Updated weights for policy 0, policy_version 714675 (0.0008) [2023-12-28 00:23:23,262][106225] Updated weights for policy 1, policy_version 716554 (0.0008) [2023-12-28 00:23:23,315][106225] Updated weights for policy 1, policy_version 716564 (0.0010) [2023-12-28 00:23:23,365][106225] Updated weights for policy 1, policy_version 716574 (0.0010) [2023-12-28 00:23:23,419][106225] Updated weights for policy 1, policy_version 716584 (0.0010) [2023-12-28 00:23:23,552][106226] Updated weights for policy 0, policy_version 714685 (0.0008) [2023-12-28 00:23:23,614][106226] Updated weights for policy 0, policy_version 714695 (0.0007) [2023-12-28 00:23:23,680][106226] Updated weights for policy 0, policy_version 714705 (0.0010) [2023-12-28 00:23:24,116][106225] Updated weights for policy 1, policy_version 716594 (0.0010) [2023-12-28 00:23:24,168][106225] Updated weights for policy 1, policy_version 716604 (0.0006) [2023-12-28 00:23:24,226][106225] Updated weights for policy 1, policy_version 716614 (0.0008) [2023-12-28 00:23:24,248][106226] Updated weights for policy 0, policy_version 714715 (0.0009) [2023-12-28 00:23:24,308][106226] Updated weights for policy 0, policy_version 714725 (0.0008) [2023-12-28 00:23:24,371][106226] Updated weights for policy 0, policy_version 714735 (0.0008) [2023-12-28 00:23:24,875][106225] Updated weights for policy 1, policy_version 716624 (0.0009) [2023-12-28 00:23:24,926][106225] Updated weights for policy 1, policy_version 716634 (0.0009) [2023-12-28 00:23:24,974][106226] Updated weights for policy 0, policy_version 714745 (0.0007) [2023-12-28 00:23:24,975][106225] Updated weights for policy 1, policy_version 716644 (0.0008) [2023-12-28 00:23:25,039][106226] Updated weights for policy 0, policy_version 714755 (0.0008) [2023-12-28 00:23:25,102][106226] Updated weights for policy 0, policy_version 714765 (0.0009) [2023-12-28 00:23:25,169][106226] Updated weights for policy 0, policy_version 714775 (0.0009) [2023-12-28 00:23:25,717][106225] Updated weights for policy 1, policy_version 716654 (0.0008) [2023-12-28 00:23:25,769][106225] Updated weights for policy 1, policy_version 716664 (0.0008) [2023-12-28 00:23:25,826][106225] Updated weights for policy 1, policy_version 716674 (0.0009) [2023-12-28 00:23:25,877][106226] Updated weights for policy 0, policy_version 714785 (0.0008) [2023-12-28 00:23:25,932][106226] Updated weights for policy 0, policy_version 714795 (0.0008) [2023-12-28 00:23:25,981][106226] Updated weights for policy 0, policy_version 714805 (0.0009) [2023-12-28 00:23:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 366551040. Throughput: 0: 9740.8, 1: 10029.0. Samples: 366516496. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:26,176][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.278')] [2023-12-28 00:23:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000716680_183508992.pth... [2023-12-28 00:23:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000714808_183042048.pth... [2023-12-28 00:23:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000715496_183205888.pth [2023-12-28 00:23:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000713656_182747136.pth [2023-12-28 00:23:26,494][106225] Updated weights for policy 1, policy_version 716684 (0.0006) [2023-12-28 00:23:26,544][106225] Updated weights for policy 1, policy_version 716694 (0.0005) [2023-12-28 00:23:26,596][106225] Updated weights for policy 1, policy_version 716704 (0.0005) [2023-12-28 00:23:26,710][106226] Updated weights for policy 0, policy_version 714815 (0.0008) [2023-12-28 00:23:26,768][106226] Updated weights for policy 0, policy_version 714825 (0.0008) [2023-12-28 00:23:26,833][106226] Updated weights for policy 0, policy_version 714835 (0.0007) [2023-12-28 00:23:27,207][106225] Updated weights for policy 1, policy_version 716714 (0.0006) [2023-12-28 00:23:27,270][106225] Updated weights for policy 1, policy_version 716724 (0.0010) [2023-12-28 00:23:27,332][106225] Updated weights for policy 1, policy_version 716734 (0.0011) [2023-12-28 00:23:27,378][106225] Updated weights for policy 1, policy_version 716744 (0.0010) [2023-12-28 00:23:27,529][106226] Updated weights for policy 0, policy_version 714845 (0.0009) [2023-12-28 00:23:27,591][106226] Updated weights for policy 0, policy_version 714855 (0.0009) [2023-12-28 00:23:27,644][106226] Updated weights for policy 0, policy_version 714865 (0.0009) [2023-12-28 00:23:27,943][106225] Updated weights for policy 1, policy_version 716754 (0.0009) [2023-12-28 00:23:27,996][106225] Updated weights for policy 1, policy_version 716764 (0.0005) [2023-12-28 00:23:28,049][106225] Updated weights for policy 1, policy_version 716774 (0.0005) [2023-12-28 00:23:28,466][106226] Updated weights for policy 0, policy_version 714875 (0.0009) [2023-12-28 00:23:28,535][106226] Updated weights for policy 0, policy_version 714885 (0.0008) [2023-12-28 00:23:28,602][106226] Updated weights for policy 0, policy_version 714895 (0.0008) [2023-12-28 00:23:28,641][106225] Updated weights for policy 1, policy_version 716784 (0.0008) [2023-12-28 00:23:28,692][106225] Updated weights for policy 1, policy_version 716794 (0.0010) [2023-12-28 00:23:28,756][106225] Updated weights for policy 1, policy_version 716804 (0.0010) [2023-12-28 00:23:29,310][106226] Updated weights for policy 0, policy_version 714905 (0.0007) [2023-12-28 00:23:29,386][106226] Updated weights for policy 0, policy_version 714915 (0.0007) [2023-12-28 00:23:29,445][106226] Updated weights for policy 0, policy_version 714925 (0.0007) [2023-12-28 00:23:29,482][106225] Updated weights for policy 1, policy_version 716814 (0.0010) [2023-12-28 00:23:29,501][106226] Updated weights for policy 0, policy_version 714935 (0.0009) [2023-12-28 00:23:29,539][106225] Updated weights for policy 1, policy_version 716824 (0.0009) [2023-12-28 00:23:29,599][106225] Updated weights for policy 1, policy_version 716834 (0.0010) [2023-12-28 00:23:30,277][106226] Updated weights for policy 0, policy_version 714945 (0.0008) [2023-12-28 00:23:30,325][106225] Updated weights for policy 1, policy_version 716844 (0.0008) [2023-12-28 00:23:30,328][106226] Updated weights for policy 0, policy_version 714955 (0.0008) [2023-12-28 00:23:30,383][106225] Updated weights for policy 1, policy_version 716854 (0.0006) [2023-12-28 00:23:30,384][106226] Updated weights for policy 0, policy_version 714965 (0.0008) [2023-12-28 00:23:30,444][106225] Updated weights for policy 1, policy_version 716864 (0.0008) [2023-12-28 00:23:30,987][106225] Updated weights for policy 1, policy_version 716874 (0.0007) [2023-12-28 00:23:31,042][106225] Updated weights for policy 1, policy_version 716884 (0.0007) [2023-12-28 00:23:31,105][106225] Updated weights for policy 1, policy_version 716894 (0.0006) [2023-12-28 00:23:31,167][106225] Updated weights for policy 1, policy_version 716904 (0.0009) [2023-12-28 00:23:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 366649344. Throughput: 0: 9681.5, 1: 10116.8. Samples: 366637564. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:31,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.302')] [2023-12-28 00:23:31,212][106226] Updated weights for policy 0, policy_version 714975 (0.0007) [2023-12-28 00:23:31,283][106226] Updated weights for policy 0, policy_version 714985 (0.0008) [2023-12-28 00:23:31,336][106226] Updated weights for policy 0, policy_version 714995 (0.0008) [2023-12-28 00:23:31,817][106225] Updated weights for policy 1, policy_version 716914 (0.0008) [2023-12-28 00:23:31,866][106225] Updated weights for policy 1, policy_version 716924 (0.0008) [2023-12-28 00:23:31,916][106225] Updated weights for policy 1, policy_version 716934 (0.0008) [2023-12-28 00:23:32,101][106226] Updated weights for policy 0, policy_version 715005 (0.0009) [2023-12-28 00:23:32,159][106226] Updated weights for policy 0, policy_version 715015 (0.0008) [2023-12-28 00:23:32,219][106226] Updated weights for policy 0, policy_version 715025 (0.0009) [2023-12-28 00:23:32,687][106225] Updated weights for policy 1, policy_version 716944 (0.0008) [2023-12-28 00:23:32,749][106225] Updated weights for policy 1, policy_version 716954 (0.0008) [2023-12-28 00:23:32,811][106225] Updated weights for policy 1, policy_version 716964 (0.0008) [2023-12-28 00:23:32,961][106226] Updated weights for policy 0, policy_version 715035 (0.0008) [2023-12-28 00:23:33,013][106226] Updated weights for policy 0, policy_version 715045 (0.0006) [2023-12-28 00:23:33,081][106226] Updated weights for policy 0, policy_version 715055 (0.0005) [2023-12-28 00:23:33,414][106225] Updated weights for policy 1, policy_version 716974 (0.0006) [2023-12-28 00:23:33,478][106225] Updated weights for policy 1, policy_version 716984 (0.0005) [2023-12-28 00:23:33,542][106225] Updated weights for policy 1, policy_version 716994 (0.0005) [2023-12-28 00:23:33,845][106226] Updated weights for policy 0, policy_version 715065 (0.0007) [2023-12-28 00:23:33,909][106226] Updated weights for policy 0, policy_version 715075 (0.0010) [2023-12-28 00:23:33,975][106226] Updated weights for policy 0, policy_version 715085 (0.0009) [2023-12-28 00:23:34,023][106225] Updated weights for policy 1, policy_version 717004 (0.0005) [2023-12-28 00:23:34,026][106226] Updated weights for policy 0, policy_version 715095 (0.0009) [2023-12-28 00:23:34,086][106225] Updated weights for policy 1, policy_version 717014 (0.0005) [2023-12-28 00:23:34,154][106225] Updated weights for policy 1, policy_version 717024 (0.0006) [2023-12-28 00:23:34,715][106225] Updated weights for policy 1, policy_version 717034 (0.0007) [2023-12-28 00:23:34,768][106225] Updated weights for policy 1, policy_version 717044 (0.0007) [2023-12-28 00:23:34,832][106225] Updated weights for policy 1, policy_version 717054 (0.0006) [2023-12-28 00:23:34,840][106226] Updated weights for policy 0, policy_version 715105 (0.0009) [2023-12-28 00:23:34,890][106225] Updated weights for policy 1, policy_version 717064 (0.0005) [2023-12-28 00:23:34,894][106226] Updated weights for policy 0, policy_version 715115 (0.0008) [2023-12-28 00:23:34,955][106226] Updated weights for policy 0, policy_version 715125 (0.0009) [2023-12-28 00:23:35,608][106225] Updated weights for policy 1, policy_version 717074 (0.0007) [2023-12-28 00:23:35,677][106225] Updated weights for policy 1, policy_version 717084 (0.0008) [2023-12-28 00:23:35,724][106226] Updated weights for policy 0, policy_version 715135 (0.0007) [2023-12-28 00:23:35,743][106225] Updated weights for policy 1, policy_version 717094 (0.0010) [2023-12-28 00:23:35,776][106226] Updated weights for policy 0, policy_version 715145 (0.0008) [2023-12-28 00:23:35,830][106226] Updated weights for policy 0, policy_version 715155 (0.0008) [2023-12-28 00:23:36,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 366747648. Throughput: 0: 9642.8, 1: 10183.2. Samples: 366756436. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:36,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.412')] [2023-12-28 00:23:36,425][106225] Updated weights for policy 1, policy_version 717104 (0.0008) [2023-12-28 00:23:36,481][106225] Updated weights for policy 1, policy_version 717114 (0.0008) [2023-12-28 00:23:36,535][106225] Updated weights for policy 1, policy_version 717124 (0.0008) [2023-12-28 00:23:36,567][106226] Updated weights for policy 0, policy_version 715165 (0.0008) [2023-12-28 00:23:36,627][106226] Updated weights for policy 0, policy_version 715175 (0.0008) [2023-12-28 00:23:36,682][106226] Updated weights for policy 0, policy_version 715185 (0.0008) [2023-12-28 00:23:37,312][106225] Updated weights for policy 1, policy_version 717134 (0.0006) [2023-12-28 00:23:37,376][106225] Updated weights for policy 1, policy_version 717144 (0.0006) [2023-12-28 00:23:37,428][106226] Updated weights for policy 0, policy_version 715195 (0.0009) [2023-12-28 00:23:37,435][106225] Updated weights for policy 1, policy_version 717154 (0.0007) [2023-12-28 00:23:37,492][106226] Updated weights for policy 0, policy_version 715205 (0.0011) [2023-12-28 00:23:37,555][106226] Updated weights for policy 0, policy_version 715215 (0.0011) [2023-12-28 00:23:38,000][106225] Updated weights for policy 1, policy_version 717164 (0.0007) [2023-12-28 00:23:38,054][106225] Updated weights for policy 1, policy_version 717174 (0.0007) [2023-12-28 00:23:38,111][106225] Updated weights for policy 1, policy_version 717184 (0.0008) [2023-12-28 00:23:38,270][106226] Updated weights for policy 0, policy_version 715225 (0.0011) [2023-12-28 00:23:38,314][106226] Updated weights for policy 0, policy_version 715235 (0.0010) [2023-12-28 00:23:38,383][106226] Updated weights for policy 0, policy_version 715245 (0.0009) [2023-12-28 00:23:38,443][106226] Updated weights for policy 0, policy_version 715255 (0.0011) [2023-12-28 00:23:38,775][106225] Updated weights for policy 1, policy_version 717194 (0.0006) [2023-12-28 00:23:38,838][106225] Updated weights for policy 1, policy_version 717204 (0.0008) [2023-12-28 00:23:38,894][106225] Updated weights for policy 1, policy_version 717214 (0.0008) [2023-12-28 00:23:38,946][106225] Updated weights for policy 1, policy_version 717224 (0.0007) [2023-12-28 00:23:39,194][106226] Updated weights for policy 0, policy_version 715265 (0.0007) [2023-12-28 00:23:39,268][106226] Updated weights for policy 0, policy_version 715275 (0.0008) [2023-12-28 00:23:39,322][106226] Updated weights for policy 0, policy_version 715285 (0.0008) [2023-12-28 00:23:39,706][106225] Updated weights for policy 1, policy_version 717234 (0.0009) [2023-12-28 00:23:39,765][106225] Updated weights for policy 1, policy_version 717244 (0.0009) [2023-12-28 00:23:39,832][106225] Updated weights for policy 1, policy_version 717254 (0.0009) [2023-12-28 00:23:40,093][106226] Updated weights for policy 0, policy_version 715295 (0.0009) [2023-12-28 00:23:40,162][106226] Updated weights for policy 0, policy_version 715305 (0.0011) [2023-12-28 00:23:40,224][106226] Updated weights for policy 0, policy_version 715315 (0.0009) [2023-12-28 00:23:40,654][106225] Updated weights for policy 1, policy_version 717264 (0.0010) [2023-12-28 00:23:40,716][106225] Updated weights for policy 1, policy_version 717274 (0.0010) [2023-12-28 00:23:40,781][106225] Updated weights for policy 1, policy_version 717284 (0.0007) [2023-12-28 00:23:40,911][106226] Updated weights for policy 0, policy_version 715325 (0.0008) [2023-12-28 00:23:40,956][106226] Updated weights for policy 0, policy_version 715335 (0.0005) [2023-12-28 00:23:41,013][106226] Updated weights for policy 0, policy_version 715345 (0.0006) [2023-12-28 00:23:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 366845952. Throughput: 0: 9624.4, 1: 10242.8. Samples: 366816016. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:41,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.239')] [2023-12-28 00:23:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000717288_183664640.pth... [2023-12-28 00:23:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000715352_183181312.pth... [2023-12-28 00:23:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000716104_183361536.pth [2023-12-28 00:23:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000714232_182894592.pth [2023-12-28 00:23:41,579][106225] Updated weights for policy 1, policy_version 717294 (0.0006) [2023-12-28 00:23:41,645][106225] Updated weights for policy 1, policy_version 717304 (0.0007) [2023-12-28 00:23:41,718][106225] Updated weights for policy 1, policy_version 717314 (0.0009) [2023-12-28 00:23:41,789][106226] Updated weights for policy 0, policy_version 715355 (0.0009) [2023-12-28 00:23:41,838][106226] Updated weights for policy 0, policy_version 715365 (0.0010) [2023-12-28 00:23:41,897][106226] Updated weights for policy 0, policy_version 715375 (0.0008) [2023-12-28 00:23:42,379][106225] Updated weights for policy 1, policy_version 717324 (0.0009) [2023-12-28 00:23:42,441][106225] Updated weights for policy 1, policy_version 717334 (0.0009) [2023-12-28 00:23:42,505][106225] Updated weights for policy 1, policy_version 717344 (0.0008) [2023-12-28 00:23:42,643][106226] Updated weights for policy 0, policy_version 715385 (0.0008) [2023-12-28 00:23:42,716][106226] Updated weights for policy 0, policy_version 715395 (0.0005) [2023-12-28 00:23:42,790][106226] Updated weights for policy 0, policy_version 715405 (0.0007) [2023-12-28 00:23:42,849][106226] Updated weights for policy 0, policy_version 715415 (0.0010) [2023-12-28 00:23:43,123][106225] Updated weights for policy 1, policy_version 717354 (0.0006) [2023-12-28 00:23:43,189][106225] Updated weights for policy 1, policy_version 717364 (0.0010) [2023-12-28 00:23:43,251][106225] Updated weights for policy 1, policy_version 717374 (0.0007) [2023-12-28 00:23:43,314][106225] Updated weights for policy 1, policy_version 717384 (0.0008) [2023-12-28 00:23:43,443][106226] Updated weights for policy 0, policy_version 715425 (0.0006) [2023-12-28 00:23:43,500][106226] Updated weights for policy 0, policy_version 715435 (0.0007) [2023-12-28 00:23:43,558][106226] Updated weights for policy 0, policy_version 715445 (0.0005) [2023-12-28 00:23:44,024][106225] Updated weights for policy 1, policy_version 717394 (0.0005) [2023-12-28 00:23:44,080][106226] Updated weights for policy 0, policy_version 715455 (0.0007) [2023-12-28 00:23:44,089][106225] Updated weights for policy 1, policy_version 717404 (0.0006) [2023-12-28 00:23:44,131][106226] Updated weights for policy 0, policy_version 715465 (0.0010) [2023-12-28 00:23:44,149][106225] Updated weights for policy 1, policy_version 717414 (0.0007) [2023-12-28 00:23:44,182][106226] Updated weights for policy 0, policy_version 715475 (0.0010) [2023-12-28 00:23:44,830][106226] Updated weights for policy 0, policy_version 715485 (0.0011) [2023-12-28 00:23:44,862][106225] Updated weights for policy 1, policy_version 717424 (0.0008) [2023-12-28 00:23:44,885][106226] Updated weights for policy 0, policy_version 715495 (0.0011) [2023-12-28 00:23:44,928][106225] Updated weights for policy 1, policy_version 717434 (0.0006) [2023-12-28 00:23:44,958][106226] Updated weights for policy 0, policy_version 715505 (0.0011) [2023-12-28 00:23:44,993][106225] Updated weights for policy 1, policy_version 717444 (0.0006) [2023-12-28 00:23:45,658][106225] Updated weights for policy 1, policy_version 717454 (0.0009) [2023-12-28 00:23:45,695][106226] Updated weights for policy 0, policy_version 715515 (0.0011) [2023-12-28 00:23:45,718][106225] Updated weights for policy 1, policy_version 717464 (0.0010) [2023-12-28 00:23:45,755][106226] Updated weights for policy 0, policy_version 715525 (0.0010) [2023-12-28 00:23:45,779][106225] Updated weights for policy 1, policy_version 717474 (0.0010) [2023-12-28 00:23:45,816][106226] Updated weights for policy 0, policy_version 715535 (0.0010) [2023-12-28 00:23:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 366944256. Throughput: 0: 9658.5, 1: 10177.3. Samples: 366933136. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:46,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-5.463')] [2023-12-28 00:23:46,494][106225] Updated weights for policy 1, policy_version 717484 (0.0010) [2023-12-28 00:23:46,507][106226] Updated weights for policy 0, policy_version 715545 (0.0010) [2023-12-28 00:23:46,548][106225] Updated weights for policy 1, policy_version 717494 (0.0010) [2023-12-28 00:23:46,555][106226] Updated weights for policy 0, policy_version 715555 (0.0010) [2023-12-28 00:23:46,602][106225] Updated weights for policy 1, policy_version 717504 (0.0010) [2023-12-28 00:23:46,611][106226] Updated weights for policy 0, policy_version 715565 (0.0011) [2023-12-28 00:23:46,668][106226] Updated weights for policy 0, policy_version 715575 (0.0011) [2023-12-28 00:23:47,324][106225] Updated weights for policy 1, policy_version 717514 (0.0010) [2023-12-28 00:23:47,378][106225] Updated weights for policy 1, policy_version 717524 (0.0010) [2023-12-28 00:23:47,398][106226] Updated weights for policy 0, policy_version 715585 (0.0011) [2023-12-28 00:23:47,432][106225] Updated weights for policy 1, policy_version 717534 (0.0010) [2023-12-28 00:23:47,459][106226] Updated weights for policy 0, policy_version 715595 (0.0011) [2023-12-28 00:23:47,487][106225] Updated weights for policy 1, policy_version 717544 (0.0010) [2023-12-28 00:23:47,516][106226] Updated weights for policy 0, policy_version 715605 (0.0011) [2023-12-28 00:23:48,170][106226] Updated weights for policy 0, policy_version 715615 (0.0007) [2023-12-28 00:23:48,218][106225] Updated weights for policy 1, policy_version 717554 (0.0010) [2023-12-28 00:23:48,224][106226] Updated weights for policy 0, policy_version 715625 (0.0005) [2023-12-28 00:23:48,269][106225] Updated weights for policy 1, policy_version 717564 (0.0010) [2023-12-28 00:23:48,283][106226] Updated weights for policy 0, policy_version 715635 (0.0005) [2023-12-28 00:23:48,317][106225] Updated weights for policy 1, policy_version 717574 (0.0010) [2023-12-28 00:23:48,923][106226] Updated weights for policy 0, policy_version 715645 (0.0010) [2023-12-28 00:23:48,978][106226] Updated weights for policy 0, policy_version 715655 (0.0011) [2023-12-28 00:23:49,043][106226] Updated weights for policy 0, policy_version 715665 (0.0011) [2023-12-28 00:23:49,104][106225] Updated weights for policy 1, policy_version 717584 (0.0010) [2023-12-28 00:23:49,152][106225] Updated weights for policy 1, policy_version 717594 (0.0010) [2023-12-28 00:23:49,211][106225] Updated weights for policy 1, policy_version 717604 (0.0008) [2023-12-28 00:23:49,742][106226] Updated weights for policy 0, policy_version 715675 (0.0011) [2023-12-28 00:23:49,805][106226] Updated weights for policy 0, policy_version 715685 (0.0011) [2023-12-28 00:23:49,877][106226] Updated weights for policy 0, policy_version 715695 (0.0010) [2023-12-28 00:23:50,034][106225] Updated weights for policy 1, policy_version 717614 (0.0011) [2023-12-28 00:23:50,082][106225] Updated weights for policy 1, policy_version 717624 (0.0010) [2023-12-28 00:23:50,142][106225] Updated weights for policy 1, policy_version 717634 (0.0011) [2023-12-28 00:23:50,613][106226] Updated weights for policy 0, policy_version 715705 (0.0009) [2023-12-28 00:23:50,676][106226] Updated weights for policy 0, policy_version 715715 (0.0007) [2023-12-28 00:23:50,741][106226] Updated weights for policy 0, policy_version 715725 (0.0006) [2023-12-28 00:23:50,812][106226] Updated weights for policy 0, policy_version 715735 (0.0006) [2023-12-28 00:23:50,885][106225] Updated weights for policy 1, policy_version 717644 (0.0010) [2023-12-28 00:23:50,937][106225] Updated weights for policy 1, policy_version 717654 (0.0010) [2023-12-28 00:23:51,002][106225] Updated weights for policy 1, policy_version 717664 (0.0010) [2023-12-28 00:23:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 367042560. Throughput: 0: 9688.0, 1: 10013.3. Samples: 367050040. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:51,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.524')] [2023-12-28 00:23:51,497][106226] Updated weights for policy 0, policy_version 715745 (0.0008) [2023-12-28 00:23:51,563][106226] Updated weights for policy 0, policy_version 715755 (0.0008) [2023-12-28 00:23:51,635][106226] Updated weights for policy 0, policy_version 715765 (0.0007) [2023-12-28 00:23:51,775][106225] Updated weights for policy 1, policy_version 717674 (0.0008) [2023-12-28 00:23:51,831][106225] Updated weights for policy 1, policy_version 717684 (0.0008) [2023-12-28 00:23:51,883][106225] Updated weights for policy 1, policy_version 717694 (0.0008) [2023-12-28 00:23:51,933][106225] Updated weights for policy 1, policy_version 717704 (0.0007) [2023-12-28 00:23:52,332][106226] Updated weights for policy 0, policy_version 715775 (0.0009) [2023-12-28 00:23:52,400][106226] Updated weights for policy 0, policy_version 715785 (0.0010) [2023-12-28 00:23:52,459][106226] Updated weights for policy 0, policy_version 715795 (0.0008) [2023-12-28 00:23:52,667][106225] Updated weights for policy 1, policy_version 717714 (0.0006) [2023-12-28 00:23:52,733][106225] Updated weights for policy 1, policy_version 717724 (0.0008) [2023-12-28 00:23:52,798][106225] Updated weights for policy 1, policy_version 717734 (0.0009) [2023-12-28 00:23:53,273][106226] Updated weights for policy 0, policy_version 715805 (0.0009) [2023-12-28 00:23:53,326][106226] Updated weights for policy 0, policy_version 715815 (0.0009) [2023-12-28 00:23:53,366][106225] Updated weights for policy 1, policy_version 717744 (0.0006) [2023-12-28 00:23:53,385][106226] Updated weights for policy 0, policy_version 715825 (0.0009) [2023-12-28 00:23:53,420][106225] Updated weights for policy 1, policy_version 717754 (0.0005) [2023-12-28 00:23:53,476][106225] Updated weights for policy 1, policy_version 717764 (0.0008) [2023-12-28 00:23:53,991][106225] Updated weights for policy 1, policy_version 717774 (0.0008) [2023-12-28 00:23:54,046][106225] Updated weights for policy 1, policy_version 717784 (0.0008) [2023-12-28 00:23:54,109][106225] Updated weights for policy 1, policy_version 717794 (0.0010) [2023-12-28 00:23:54,204][106226] Updated weights for policy 0, policy_version 715835 (0.0007) [2023-12-28 00:23:54,267][106226] Updated weights for policy 0, policy_version 715845 (0.0007) [2023-12-28 00:23:54,328][106226] Updated weights for policy 0, policy_version 715855 (0.0008) [2023-12-28 00:23:54,822][106225] Updated weights for policy 1, policy_version 717804 (0.0010) [2023-12-28 00:23:54,875][106225] Updated weights for policy 1, policy_version 717814 (0.0010) [2023-12-28 00:23:54,925][106225] Updated weights for policy 1, policy_version 717824 (0.0010) [2023-12-28 00:23:55,070][106226] Updated weights for policy 0, policy_version 715865 (0.0008) [2023-12-28 00:23:55,134][106226] Updated weights for policy 0, policy_version 715875 (0.0007) [2023-12-28 00:23:55,187][106226] Updated weights for policy 0, policy_version 715885 (0.0007) [2023-12-28 00:23:55,233][106226] Updated weights for policy 0, policy_version 715895 (0.0008) [2023-12-28 00:23:55,641][106225] Updated weights for policy 1, policy_version 717834 (0.0009) [2023-12-28 00:23:55,689][106225] Updated weights for policy 1, policy_version 717844 (0.0005) [2023-12-28 00:23:55,743][106225] Updated weights for policy 1, policy_version 717854 (0.0005) [2023-12-28 00:23:55,799][106225] Updated weights for policy 1, policy_version 717864 (0.0005) [2023-12-28 00:23:55,998][106226] Updated weights for policy 0, policy_version 715905 (0.0008) [2023-12-28 00:23:56,063][106226] Updated weights for policy 0, policy_version 715915 (0.0007) [2023-12-28 00:23:56,133][106226] Updated weights for policy 0, policy_version 715925 (0.0007) [2023-12-28 00:23:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 367140864. Throughput: 0: 9585.6, 1: 10049.1. Samples: 367107388. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:23:56,176][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.253')] [2023-12-28 00:23:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000717864_183812096.pth... [2023-12-28 00:23:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000715928_183328768.pth... [2023-12-28 00:23:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000714808_183042048.pth [2023-12-28 00:23:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000716680_183508992.pth [2023-12-28 00:23:56,499][106225] Updated weights for policy 1, policy_version 717874 (0.0009) [2023-12-28 00:23:56,544][106225] Updated weights for policy 1, policy_version 717884 (0.0008) [2023-12-28 00:23:56,602][106225] Updated weights for policy 1, policy_version 717894 (0.0008) [2023-12-28 00:23:56,721][106226] Updated weights for policy 0, policy_version 715935 (0.0007) [2023-12-28 00:23:56,779][106226] Updated weights for policy 0, policy_version 715945 (0.0008) [2023-12-28 00:23:56,841][106226] Updated weights for policy 0, policy_version 715955 (0.0008) [2023-12-28 00:23:57,308][106225] Updated weights for policy 1, policy_version 717904 (0.0008) [2023-12-28 00:23:57,364][106225] Updated weights for policy 1, policy_version 717914 (0.0007) [2023-12-28 00:23:57,409][106225] Updated weights for policy 1, policy_version 717924 (0.0008) [2023-12-28 00:23:57,553][106226] Updated weights for policy 0, policy_version 715965 (0.0008) [2023-12-28 00:23:57,597][106226] Updated weights for policy 0, policy_version 715975 (0.0008) [2023-12-28 00:23:57,654][106226] Updated weights for policy 0, policy_version 715985 (0.0008) [2023-12-28 00:23:58,098][106225] Updated weights for policy 1, policy_version 717934 (0.0009) [2023-12-28 00:23:58,144][106225] Updated weights for policy 1, policy_version 717944 (0.0010) [2023-12-28 00:23:58,198][106225] Updated weights for policy 1, policy_version 717954 (0.0010) [2023-12-28 00:23:58,310][106226] Updated weights for policy 0, policy_version 715995 (0.0008) [2023-12-28 00:23:58,389][106226] Updated weights for policy 0, policy_version 716005 (0.0011) [2023-12-28 00:23:58,454][106226] Updated weights for policy 0, policy_version 716015 (0.0010) [2023-12-28 00:23:59,007][106225] Updated weights for policy 1, policy_version 717964 (0.0008) [2023-12-28 00:23:59,074][106225] Updated weights for policy 1, policy_version 717974 (0.0008) [2023-12-28 00:23:59,139][106225] Updated weights for policy 1, policy_version 717984 (0.0008) [2023-12-28 00:23:59,210][106226] Updated weights for policy 0, policy_version 716025 (0.0010) [2023-12-28 00:23:59,284][106226] Updated weights for policy 0, policy_version 716035 (0.0011) [2023-12-28 00:23:59,349][106226] Updated weights for policy 0, policy_version 716045 (0.0011) [2023-12-28 00:23:59,414][106226] Updated weights for policy 0, policy_version 716055 (0.0009) [2023-12-28 00:23:59,895][106225] Updated weights for policy 1, policy_version 717994 (0.0008) [2023-12-28 00:23:59,966][106225] Updated weights for policy 1, policy_version 718004 (0.0010) [2023-12-28 00:24:00,030][106225] Updated weights for policy 1, policy_version 718014 (0.0008) [2023-12-28 00:24:00,072][106226] Updated weights for policy 0, policy_version 716065 (0.0008) [2023-12-28 00:24:00,090][106225] Updated weights for policy 1, policy_version 718024 (0.0005) [2023-12-28 00:24:00,130][106226] Updated weights for policy 0, policy_version 716075 (0.0008) [2023-12-28 00:24:00,180][106226] Updated weights for policy 0, policy_version 716085 (0.0008) [2023-12-28 00:24:00,670][106225] Updated weights for policy 1, policy_version 718034 (0.0005) [2023-12-28 00:24:00,721][106225] Updated weights for policy 1, policy_version 718044 (0.0005) [2023-12-28 00:24:00,772][106225] Updated weights for policy 1, policy_version 718054 (0.0006) [2023-12-28 00:24:00,855][106226] Updated weights for policy 0, policy_version 716095 (0.0010) [2023-12-28 00:24:00,908][106226] Updated weights for policy 0, policy_version 716105 (0.0010) [2023-12-28 00:24:00,964][106226] Updated weights for policy 0, policy_version 716115 (0.0008) [2023-12-28 00:24:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 367239168. Throughput: 0: 9604.5, 1: 10024.5. Samples: 367225480. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:01,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-5.219')] [2023-12-28 00:24:01,477][106225] Updated weights for policy 1, policy_version 718064 (0.0008) [2023-12-28 00:24:01,536][106225] Updated weights for policy 1, policy_version 718074 (0.0007) [2023-12-28 00:24:01,598][106225] Updated weights for policy 1, policy_version 718084 (0.0009) [2023-12-28 00:24:01,758][106226] Updated weights for policy 0, policy_version 716125 (0.0007) [2023-12-28 00:24:01,813][106226] Updated weights for policy 0, policy_version 716135 (0.0008) [2023-12-28 00:24:01,863][106226] Updated weights for policy 0, policy_version 716145 (0.0008) [2023-12-28 00:24:02,388][106225] Updated weights for policy 1, policy_version 718094 (0.0008) [2023-12-28 00:24:02,444][106225] Updated weights for policy 1, policy_version 718104 (0.0009) [2023-12-28 00:24:02,504][106225] Updated weights for policy 1, policy_version 718114 (0.0006) [2023-12-28 00:24:02,520][106226] Updated weights for policy 0, policy_version 716155 (0.0007) [2023-12-28 00:24:02,579][106226] Updated weights for policy 0, policy_version 716165 (0.0007) [2023-12-28 00:24:02,636][106226] Updated weights for policy 0, policy_version 716175 (0.0005) [2023-12-28 00:24:03,151][106225] Updated weights for policy 1, policy_version 718124 (0.0007) [2023-12-28 00:24:03,200][106225] Updated weights for policy 1, policy_version 718134 (0.0010) [2023-12-28 00:24:03,254][106225] Updated weights for policy 1, policy_version 718144 (0.0007) [2023-12-28 00:24:03,275][106226] Updated weights for policy 0, policy_version 716185 (0.0005) [2023-12-28 00:24:03,338][106226] Updated weights for policy 0, policy_version 716195 (0.0010) [2023-12-28 00:24:03,383][106226] Updated weights for policy 0, policy_version 716205 (0.0009) [2023-12-28 00:24:03,429][106226] Updated weights for policy 0, policy_version 716215 (0.0010) [2023-12-28 00:24:03,913][106225] Updated weights for policy 1, policy_version 718154 (0.0009) [2023-12-28 00:24:03,964][106225] Updated weights for policy 1, policy_version 718164 (0.0011) [2023-12-28 00:24:04,029][106225] Updated weights for policy 1, policy_version 718174 (0.0010) [2023-12-28 00:24:04,034][106226] Updated weights for policy 0, policy_version 716225 (0.0007) [2023-12-28 00:24:04,087][106225] Updated weights for policy 1, policy_version 718184 (0.0010) [2023-12-28 00:24:04,100][106226] Updated weights for policy 0, policy_version 716235 (0.0006) [2023-12-28 00:24:04,161][106226] Updated weights for policy 0, policy_version 716245 (0.0008) [2023-12-28 00:24:04,807][106226] Updated weights for policy 0, policy_version 716255 (0.0006) [2023-12-28 00:24:04,819][106225] Updated weights for policy 1, policy_version 718194 (0.0007) [2023-12-28 00:24:04,870][106226] Updated weights for policy 0, policy_version 716265 (0.0005) [2023-12-28 00:24:04,873][106225] Updated weights for policy 1, policy_version 718204 (0.0010) [2023-12-28 00:24:04,932][106225] Updated weights for policy 1, policy_version 718214 (0.0010) [2023-12-28 00:24:04,937][106226] Updated weights for policy 0, policy_version 716275 (0.0005) [2023-12-28 00:24:05,511][106226] Updated weights for policy 0, policy_version 716285 (0.0008) [2023-12-28 00:24:05,575][106226] Updated weights for policy 0, policy_version 716295 (0.0009) [2023-12-28 00:24:05,579][106225] Updated weights for policy 1, policy_version 718224 (0.0010) [2023-12-28 00:24:05,629][106226] Updated weights for policy 0, policy_version 716305 (0.0010) [2023-12-28 00:24:05,633][106225] Updated weights for policy 1, policy_version 718234 (0.0010) [2023-12-28 00:24:05,694][106225] Updated weights for policy 1, policy_version 718244 (0.0010) [2023-12-28 00:24:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 367337472. Throughput: 0: 9739.6, 1: 10057.6. Samples: 367348780. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:06,176][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.677')] [2023-12-28 00:24:06,308][106226] Updated weights for policy 0, policy_version 716315 (0.0011) [2023-12-28 00:24:06,374][106226] Updated weights for policy 0, policy_version 716325 (0.0011) [2023-12-28 00:24:06,433][106225] Updated weights for policy 1, policy_version 718254 (0.0008) [2023-12-28 00:24:06,436][106226] Updated weights for policy 0, policy_version 716335 (0.0011) [2023-12-28 00:24:06,492][106225] Updated weights for policy 1, policy_version 718264 (0.0008) [2023-12-28 00:24:06,588][106225] Updated weights for policy 1, policy_version 718274 (0.0007) [2023-12-28 00:24:07,157][106226] Updated weights for policy 0, policy_version 716345 (0.0009) [2023-12-28 00:24:07,211][106226] Updated weights for policy 0, policy_version 716355 (0.0005) [2023-12-28 00:24:07,267][106226] Updated weights for policy 0, policy_version 716365 (0.0009) [2023-12-28 00:24:07,317][106225] Updated weights for policy 1, policy_version 718284 (0.0007) [2023-12-28 00:24:07,325][106226] Updated weights for policy 0, policy_version 716375 (0.0011) [2023-12-28 00:24:07,378][106225] Updated weights for policy 1, policy_version 718294 (0.0008) [2023-12-28 00:24:07,447][106225] Updated weights for policy 1, policy_version 718304 (0.0008) [2023-12-28 00:24:08,028][106226] Updated weights for policy 0, policy_version 716385 (0.0007) [2023-12-28 00:24:08,076][106226] Updated weights for policy 0, policy_version 716395 (0.0010) [2023-12-28 00:24:08,099][106225] Updated weights for policy 1, policy_version 718314 (0.0010) [2023-12-28 00:24:08,131][106226] Updated weights for policy 0, policy_version 716405 (0.0008) [2023-12-28 00:24:08,158][106225] Updated weights for policy 1, policy_version 718324 (0.0010) [2023-12-28 00:24:08,225][106225] Updated weights for policy 1, policy_version 718334 (0.0010) [2023-12-28 00:24:08,282][106225] Updated weights for policy 1, policy_version 718344 (0.0010) [2023-12-28 00:24:08,815][106226] Updated weights for policy 0, policy_version 716415 (0.0007) [2023-12-28 00:24:08,878][106226] Updated weights for policy 0, policy_version 716425 (0.0009) [2023-12-28 00:24:08,940][106226] Updated weights for policy 0, policy_version 716435 (0.0006) [2023-12-28 00:24:08,973][106225] Updated weights for policy 1, policy_version 718354 (0.0010) [2023-12-28 00:24:09,034][106225] Updated weights for policy 1, policy_version 718364 (0.0010) [2023-12-28 00:24:09,096][106225] Updated weights for policy 1, policy_version 718374 (0.0010) [2023-12-28 00:24:09,600][106226] Updated weights for policy 0, policy_version 716445 (0.0007) [2023-12-28 00:24:09,659][106226] Updated weights for policy 0, policy_version 716455 (0.0008) [2023-12-28 00:24:09,714][106226] Updated weights for policy 0, policy_version 716465 (0.0008) [2023-12-28 00:24:09,825][106225] Updated weights for policy 1, policy_version 718384 (0.0007) [2023-12-28 00:24:09,887][106225] Updated weights for policy 1, policy_version 718394 (0.0008) [2023-12-28 00:24:09,958][106225] Updated weights for policy 1, policy_version 718404 (0.0008) [2023-12-28 00:24:10,458][106226] Updated weights for policy 0, policy_version 716475 (0.0010) [2023-12-28 00:24:10,523][106226] Updated weights for policy 0, policy_version 716485 (0.0007) [2023-12-28 00:24:10,593][106226] Updated weights for policy 0, policy_version 716495 (0.0008) [2023-12-28 00:24:10,722][106225] Updated weights for policy 1, policy_version 718414 (0.0010) [2023-12-28 00:24:10,791][106225] Updated weights for policy 1, policy_version 718424 (0.0010) [2023-12-28 00:24:10,857][106225] Updated weights for policy 1, policy_version 718434 (0.0008) [2023-12-28 00:24:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 367435776. Throughput: 0: 9781.5, 1: 10046.4. Samples: 367408744. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:11,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.510')] [2023-12-28 00:24:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000718440_183959552.pth... [2023-12-28 00:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000716504_183476224.pth... [2023-12-28 00:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000717288_183664640.pth [2023-12-28 00:24:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000715352_183181312.pth [2023-12-28 00:24:11,388][106226] Updated weights for policy 0, policy_version 716505 (0.0009) [2023-12-28 00:24:11,455][106226] Updated weights for policy 0, policy_version 716515 (0.0008) [2023-12-28 00:24:11,514][106226] Updated weights for policy 0, policy_version 716525 (0.0008) [2023-12-28 00:24:11,581][106226] Updated weights for policy 0, policy_version 716535 (0.0008) [2023-12-28 00:24:11,690][106225] Updated weights for policy 1, policy_version 718444 (0.0008) [2023-12-28 00:24:11,764][106225] Updated weights for policy 1, policy_version 718454 (0.0008) [2023-12-28 00:24:11,827][106225] Updated weights for policy 1, policy_version 718464 (0.0009) [2023-12-28 00:24:12,391][106226] Updated weights for policy 0, policy_version 716545 (0.0009) [2023-12-28 00:24:12,457][106226] Updated weights for policy 0, policy_version 716555 (0.0008) [2023-12-28 00:24:12,519][106226] Updated weights for policy 0, policy_version 716565 (0.0009) [2023-12-28 00:24:12,531][106225] Updated weights for policy 1, policy_version 718474 (0.0009) [2023-12-28 00:24:12,598][106225] Updated weights for policy 1, policy_version 718484 (0.0010) [2023-12-28 00:24:12,658][106225] Updated weights for policy 1, policy_version 718494 (0.0008) [2023-12-28 00:24:12,724][106225] Updated weights for policy 1, policy_version 718504 (0.0005) [2023-12-28 00:24:13,274][106226] Updated weights for policy 0, policy_version 716575 (0.0008) [2023-12-28 00:24:13,301][106225] Updated weights for policy 1, policy_version 718514 (0.0007) [2023-12-28 00:24:13,327][106226] Updated weights for policy 0, policy_version 716585 (0.0009) [2023-12-28 00:24:13,362][106225] Updated weights for policy 1, policy_version 718524 (0.0008) [2023-12-28 00:24:13,379][106226] Updated weights for policy 0, policy_version 716595 (0.0007) [2023-12-28 00:24:13,420][106225] Updated weights for policy 1, policy_version 718534 (0.0008) [2023-12-28 00:24:14,074][106226] Updated weights for policy 0, policy_version 716605 (0.0006) [2023-12-28 00:24:14,104][106225] Updated weights for policy 1, policy_version 718544 (0.0007) [2023-12-28 00:24:14,145][106226] Updated weights for policy 0, policy_version 716615 (0.0006) [2023-12-28 00:24:14,150][106225] Updated weights for policy 1, policy_version 718554 (0.0007) [2023-12-28 00:24:14,203][106225] Updated weights for policy 1, policy_version 718564 (0.0007) [2023-12-28 00:24:14,217][106226] Updated weights for policy 0, policy_version 716625 (0.0006) [2023-12-28 00:24:14,865][106225] Updated weights for policy 1, policy_version 718574 (0.0006) [2023-12-28 00:24:14,925][106225] Updated weights for policy 1, policy_version 718584 (0.0008) [2023-12-28 00:24:14,946][106226] Updated weights for policy 0, policy_version 716635 (0.0010) [2023-12-28 00:24:14,987][106225] Updated weights for policy 1, policy_version 718594 (0.0008) [2023-12-28 00:24:15,008][106226] Updated weights for policy 0, policy_version 716645 (0.0007) [2023-12-28 00:24:15,069][106226] Updated weights for policy 0, policy_version 716655 (0.0009) [2023-12-28 00:24:15,660][106226] Updated weights for policy 0, policy_version 716665 (0.0008) [2023-12-28 00:24:15,702][106225] Updated weights for policy 1, policy_version 718604 (0.0006) [2023-12-28 00:24:15,712][106226] Updated weights for policy 0, policy_version 716675 (0.0008) [2023-12-28 00:24:15,753][106225] Updated weights for policy 1, policy_version 718614 (0.0007) [2023-12-28 00:24:15,769][106226] Updated weights for policy 0, policy_version 716685 (0.0008) [2023-12-28 00:24:15,808][106225] Updated weights for policy 1, policy_version 718624 (0.0006) [2023-12-28 00:24:15,826][106226] Updated weights for policy 0, policy_version 716695 (0.0006) [2023-12-28 00:24:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 367534080. Throughput: 0: 9722.4, 1: 9927.4. Samples: 367521808. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:16,176][105115] Avg episode reward: [(0, '-4.449'), (1, '-5.441')] [2023-12-28 00:24:16,448][106226] Updated weights for policy 0, policy_version 716705 (0.0008) [2023-12-28 00:24:16,480][106225] Updated weights for policy 1, policy_version 718634 (0.0006) [2023-12-28 00:24:16,507][106226] Updated weights for policy 0, policy_version 716715 (0.0005) [2023-12-28 00:24:16,543][106225] Updated weights for policy 1, policy_version 718644 (0.0006) [2023-12-28 00:24:16,558][106226] Updated weights for policy 0, policy_version 716725 (0.0005) [2023-12-28 00:24:16,602][106225] Updated weights for policy 1, policy_version 718654 (0.0008) [2023-12-28 00:24:16,663][106225] Updated weights for policy 1, policy_version 718664 (0.0009) [2023-12-28 00:24:17,149][106226] Updated weights for policy 0, policy_version 716735 (0.0009) [2023-12-28 00:24:17,209][106226] Updated weights for policy 0, policy_version 716745 (0.0008) [2023-12-28 00:24:17,269][106226] Updated weights for policy 0, policy_version 716755 (0.0005) [2023-12-28 00:24:17,350][106225] Updated weights for policy 1, policy_version 718674 (0.0009) [2023-12-28 00:24:17,416][106225] Updated weights for policy 1, policy_version 718684 (0.0009) [2023-12-28 00:24:17,472][106225] Updated weights for policy 1, policy_version 718694 (0.0008) [2023-12-28 00:24:17,883][106226] Updated weights for policy 0, policy_version 716765 (0.0007) [2023-12-28 00:24:17,949][106226] Updated weights for policy 0, policy_version 716775 (0.0008) [2023-12-28 00:24:18,018][106226] Updated weights for policy 0, policy_version 716785 (0.0008) [2023-12-28 00:24:18,208][106225] Updated weights for policy 1, policy_version 718704 (0.0010) [2023-12-28 00:24:18,276][106225] Updated weights for policy 1, policy_version 718714 (0.0006) [2023-12-28 00:24:18,348][106225] Updated weights for policy 1, policy_version 718724 (0.0006) [2023-12-28 00:24:18,642][106226] Updated weights for policy 0, policy_version 716795 (0.0008) [2023-12-28 00:24:18,703][106226] Updated weights for policy 0, policy_version 716805 (0.0009) [2023-12-28 00:24:18,763][106226] Updated weights for policy 0, policy_version 716815 (0.0008) [2023-12-28 00:24:18,946][106225] Updated weights for policy 1, policy_version 718734 (0.0007) [2023-12-28 00:24:19,000][106225] Updated weights for policy 1, policy_version 718744 (0.0006) [2023-12-28 00:24:19,051][106225] Updated weights for policy 1, policy_version 718754 (0.0006) [2023-12-28 00:24:19,531][106226] Updated weights for policy 0, policy_version 716825 (0.0008) [2023-12-28 00:24:19,596][106226] Updated weights for policy 0, policy_version 716835 (0.0006) [2023-12-28 00:24:19,660][106226] Updated weights for policy 0, policy_version 716845 (0.0009) [2023-12-28 00:24:19,703][106225] Updated weights for policy 1, policy_version 718764 (0.0006) [2023-12-28 00:24:19,722][106226] Updated weights for policy 0, policy_version 716855 (0.0008) [2023-12-28 00:24:19,762][106225] Updated weights for policy 1, policy_version 718774 (0.0008) [2023-12-28 00:24:19,816][106225] Updated weights for policy 1, policy_version 718784 (0.0009) [2023-12-28 00:24:20,445][106226] Updated weights for policy 0, policy_version 716865 (0.0009) [2023-12-28 00:24:20,480][106225] Updated weights for policy 1, policy_version 718794 (0.0007) [2023-12-28 00:24:20,509][106226] Updated weights for policy 0, policy_version 716875 (0.0008) [2023-12-28 00:24:20,549][106225] Updated weights for policy 1, policy_version 718804 (0.0008) [2023-12-28 00:24:20,579][106226] Updated weights for policy 0, policy_version 716885 (0.0007) [2023-12-28 00:24:20,615][106225] Updated weights for policy 1, policy_version 718814 (0.0008) [2023-12-28 00:24:20,670][106225] Updated weights for policy 1, policy_version 718824 (0.0006) [2023-12-28 00:24:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 367632384. Throughput: 0: 9884.9, 1: 9843.6. Samples: 367644220. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:21,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.309')] [2023-12-28 00:24:21,341][106226] Updated weights for policy 0, policy_version 716895 (0.0007) [2023-12-28 00:24:21,376][106225] Updated weights for policy 1, policy_version 718834 (0.0009) [2023-12-28 00:24:21,436][106226] Updated weights for policy 0, policy_version 716905 (0.0011) [2023-12-28 00:24:21,445][106225] Updated weights for policy 1, policy_version 718844 (0.0008) [2023-12-28 00:24:21,503][106226] Updated weights for policy 0, policy_version 716915 (0.0009) [2023-12-28 00:24:21,508][106225] Updated weights for policy 1, policy_version 718854 (0.0008) [2023-12-28 00:24:22,248][106226] Updated weights for policy 0, policy_version 716925 (0.0009) [2023-12-28 00:24:22,251][106225] Updated weights for policy 1, policy_version 718864 (0.0007) [2023-12-28 00:24:22,314][106225] Updated weights for policy 1, policy_version 718874 (0.0009) [2023-12-28 00:24:22,317][106226] Updated weights for policy 0, policy_version 716935 (0.0010) [2023-12-28 00:24:22,382][106226] Updated weights for policy 0, policy_version 716945 (0.0010) [2023-12-28 00:24:22,383][106225] Updated weights for policy 1, policy_version 718884 (0.0008) [2023-12-28 00:24:23,105][106226] Updated weights for policy 0, policy_version 716955 (0.0007) [2023-12-28 00:24:23,151][106226] Updated weights for policy 0, policy_version 716965 (0.0006) [2023-12-28 00:24:23,198][106225] Updated weights for policy 1, policy_version 718894 (0.0008) [2023-12-28 00:24:23,208][106226] Updated weights for policy 0, policy_version 716975 (0.0011) [2023-12-28 00:24:23,257][106225] Updated weights for policy 1, policy_version 718904 (0.0008) [2023-12-28 00:24:23,322][106225] Updated weights for policy 1, policy_version 718914 (0.0008) [2023-12-28 00:24:23,888][106226] Updated weights for policy 0, policy_version 716985 (0.0011) [2023-12-28 00:24:23,914][106225] Updated weights for policy 1, policy_version 718924 (0.0007) [2023-12-28 00:24:23,945][106226] Updated weights for policy 0, policy_version 716995 (0.0011) [2023-12-28 00:24:23,967][106225] Updated weights for policy 1, policy_version 718934 (0.0006) [2023-12-28 00:24:24,017][106226] Updated weights for policy 0, policy_version 717005 (0.0008) [2023-12-28 00:24:24,025][106225] Updated weights for policy 1, policy_version 718944 (0.0006) [2023-12-28 00:24:24,078][106226] Updated weights for policy 0, policy_version 717015 (0.0006) [2023-12-28 00:24:24,607][106225] Updated weights for policy 1, policy_version 718954 (0.0007) [2023-12-28 00:24:24,661][106225] Updated weights for policy 1, policy_version 718964 (0.0010) [2023-12-28 00:24:24,665][106226] Updated weights for policy 0, policy_version 717025 (0.0005) [2023-12-28 00:24:24,722][106225] Updated weights for policy 1, policy_version 718974 (0.0007) [2023-12-28 00:24:24,728][106226] Updated weights for policy 0, policy_version 717035 (0.0006) [2023-12-28 00:24:24,777][106225] Updated weights for policy 1, policy_version 718984 (0.0010) [2023-12-28 00:24:24,785][106226] Updated weights for policy 0, policy_version 717045 (0.0007) [2023-12-28 00:24:25,446][106225] Updated weights for policy 1, policy_version 718994 (0.0010) [2023-12-28 00:24:25,467][106226] Updated weights for policy 0, policy_version 717055 (0.0010) [2023-12-28 00:24:25,493][106225] Updated weights for policy 1, policy_version 719004 (0.0010) [2023-12-28 00:24:25,527][106226] Updated weights for policy 0, policy_version 717065 (0.0010) [2023-12-28 00:24:25,550][106225] Updated weights for policy 1, policy_version 719014 (0.0010) [2023-12-28 00:24:25,587][106226] Updated weights for policy 0, policy_version 717075 (0.0010) [2023-12-28 00:24:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 367730688. Throughput: 0: 9873.5, 1: 9794.1. Samples: 367701060. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:26,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.470')] [2023-12-28 00:24:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000717080_183623680.pth... [2023-12-28 00:24:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000715928_183328768.pth [2023-12-28 00:24:26,212][106225] Updated weights for policy 1, policy_version 719024 (0.0007) [2023-12-28 00:24:26,268][106225] Updated weights for policy 1, policy_version 719034 (0.0007) [2023-12-28 00:24:26,298][106226] Updated weights for policy 0, policy_version 717085 (0.0010) [2023-12-28 00:24:26,312][106225] Updated weights for policy 1, policy_version 719044 (0.0007) [2023-12-28 00:24:26,335][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000719048_184115200.pth... [2023-12-28 00:24:26,339][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000717864_183812096.pth [2023-12-28 00:24:26,357][106226] Updated weights for policy 0, policy_version 717095 (0.0010) [2023-12-28 00:24:26,410][106226] Updated weights for policy 0, policy_version 717105 (0.0010) [2023-12-28 00:24:26,909][106225] Updated weights for policy 1, policy_version 719054 (0.0009) [2023-12-28 00:24:26,973][106225] Updated weights for policy 1, policy_version 719064 (0.0010) [2023-12-28 00:24:27,036][106225] Updated weights for policy 1, policy_version 719074 (0.0010) [2023-12-28 00:24:27,041][106226] Updated weights for policy 0, policy_version 717115 (0.0009) [2023-12-28 00:24:27,095][106226] Updated weights for policy 0, policy_version 717125 (0.0005) [2023-12-28 00:24:27,160][106226] Updated weights for policy 0, policy_version 717135 (0.0005) [2023-12-28 00:24:27,701][106225] Updated weights for policy 1, policy_version 719084 (0.0010) [2023-12-28 00:24:27,769][106225] Updated weights for policy 1, policy_version 719094 (0.0011) [2023-12-28 00:24:27,786][106226] Updated weights for policy 0, policy_version 717145 (0.0005) [2023-12-28 00:24:27,823][106225] Updated weights for policy 1, policy_version 719104 (0.0010) [2023-12-28 00:24:27,845][106226] Updated weights for policy 0, policy_version 717155 (0.0007) [2023-12-28 00:24:27,902][106226] Updated weights for policy 0, policy_version 717165 (0.0007) [2023-12-28 00:24:27,963][106226] Updated weights for policy 0, policy_version 717175 (0.0008) [2023-12-28 00:24:28,491][106225] Updated weights for policy 1, policy_version 719114 (0.0009) [2023-12-28 00:24:28,553][106225] Updated weights for policy 1, policy_version 719124 (0.0006) [2023-12-28 00:24:28,606][106225] Updated weights for policy 1, policy_version 719134 (0.0010) [2023-12-28 00:24:28,638][106226] Updated weights for policy 0, policy_version 717185 (0.0008) [2023-12-28 00:24:28,653][106225] Updated weights for policy 1, policy_version 719144 (0.0010) [2023-12-28 00:24:28,692][106226] Updated weights for policy 0, policy_version 717195 (0.0010) [2023-12-28 00:24:28,755][106226] Updated weights for policy 0, policy_version 717205 (0.0008) [2023-12-28 00:24:29,342][106225] Updated weights for policy 1, policy_version 719154 (0.0009) [2023-12-28 00:24:29,369][106226] Updated weights for policy 0, policy_version 717215 (0.0008) [2023-12-28 00:24:29,413][106225] Updated weights for policy 1, policy_version 719164 (0.0009) [2023-12-28 00:24:29,436][106226] Updated weights for policy 0, policy_version 717225 (0.0008) [2023-12-28 00:24:29,476][106225] Updated weights for policy 1, policy_version 719174 (0.0006) [2023-12-28 00:24:29,486][106226] Updated weights for policy 0, policy_version 717235 (0.0008) [2023-12-28 00:24:30,104][106225] Updated weights for policy 1, policy_version 719184 (0.0008) [2023-12-28 00:24:30,127][106226] Updated weights for policy 0, policy_version 717245 (0.0006) [2023-12-28 00:24:30,154][106225] Updated weights for policy 1, policy_version 719194 (0.0008) [2023-12-28 00:24:30,190][106226] Updated weights for policy 0, policy_version 717255 (0.0005) [2023-12-28 00:24:30,208][106225] Updated weights for policy 1, policy_version 719204 (0.0008) [2023-12-28 00:24:30,253][106226] Updated weights for policy 0, policy_version 717265 (0.0006) [2023-12-28 00:24:30,773][106226] Updated weights for policy 0, policy_version 717275 (0.0010) [2023-12-28 00:24:30,822][106226] Updated weights for policy 0, policy_version 717285 (0.0010) [2023-12-28 00:24:30,879][106226] Updated weights for policy 0, policy_version 717295 (0.0010) [2023-12-28 00:24:30,964][106225] Updated weights for policy 1, policy_version 719214 (0.0007) [2023-12-28 00:24:31,016][106225] Updated weights for policy 1, policy_version 719224 (0.0006) [2023-12-28 00:24:31,083][106225] Updated weights for policy 1, policy_version 719234 (0.0007) [2023-12-28 00:24:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 367845376. Throughput: 0: 9951.2, 1: 9951.7. Samples: 367828768. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:31,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.321')] [2023-12-28 00:24:31,619][106226] Updated weights for policy 0, policy_version 717305 (0.0010) [2023-12-28 00:24:31,683][106226] Updated weights for policy 0, policy_version 717315 (0.0010) [2023-12-28 00:24:31,748][106226] Updated weights for policy 0, policy_version 717325 (0.0010) [2023-12-28 00:24:31,756][106225] Updated weights for policy 1, policy_version 719244 (0.0008) [2023-12-28 00:24:31,814][106226] Updated weights for policy 0, policy_version 717335 (0.0010) [2023-12-28 00:24:31,818][106225] Updated weights for policy 1, policy_version 719254 (0.0008) [2023-12-28 00:24:31,879][106225] Updated weights for policy 1, policy_version 719264 (0.0008) [2023-12-28 00:24:32,539][106226] Updated weights for policy 0, policy_version 717345 (0.0010) [2023-12-28 00:24:32,596][106226] Updated weights for policy 0, policy_version 717355 (0.0010) [2023-12-28 00:24:32,615][106225] Updated weights for policy 1, policy_version 719274 (0.0008) [2023-12-28 00:24:32,653][106226] Updated weights for policy 0, policy_version 717365 (0.0010) [2023-12-28 00:24:32,682][106225] Updated weights for policy 1, policy_version 719284 (0.0005) [2023-12-28 00:24:32,751][106225] Updated weights for policy 1, policy_version 719294 (0.0005) [2023-12-28 00:24:32,812][106225] Updated weights for policy 1, policy_version 719304 (0.0005) [2023-12-28 00:24:33,301][106226] Updated weights for policy 0, policy_version 717375 (0.0006) [2023-12-28 00:24:33,351][106226] Updated weights for policy 0, policy_version 717385 (0.0010) [2023-12-28 00:24:33,361][106225] Updated weights for policy 1, policy_version 719314 (0.0006) [2023-12-28 00:24:33,400][106226] Updated weights for policy 0, policy_version 717395 (0.0010) [2023-12-28 00:24:33,410][106225] Updated weights for policy 1, policy_version 719324 (0.0005) [2023-12-28 00:24:33,470][106225] Updated weights for policy 1, policy_version 719334 (0.0007) [2023-12-28 00:24:33,988][106226] Updated weights for policy 0, policy_version 717405 (0.0009) [2023-12-28 00:24:34,059][106226] Updated weights for policy 0, policy_version 717415 (0.0011) [2023-12-28 00:24:34,102][106226] Updated weights for policy 0, policy_version 717425 (0.0010) [2023-12-28 00:24:34,186][106225] Updated weights for policy 1, policy_version 719344 (0.0008) [2023-12-28 00:24:34,247][106225] Updated weights for policy 1, policy_version 719354 (0.0008) [2023-12-28 00:24:34,300][106225] Updated weights for policy 1, policy_version 719364 (0.0008) [2023-12-28 00:24:34,835][106226] Updated weights for policy 0, policy_version 717435 (0.0010) [2023-12-28 00:24:34,885][106226] Updated weights for policy 0, policy_version 717445 (0.0010) [2023-12-28 00:24:34,938][106226] Updated weights for policy 0, policy_version 717455 (0.0010) [2023-12-28 00:24:35,080][106225] Updated weights for policy 1, policy_version 719374 (0.0008) [2023-12-28 00:24:35,136][106225] Updated weights for policy 1, policy_version 719384 (0.0007) [2023-12-28 00:24:35,190][106225] Updated weights for policy 1, policy_version 719394 (0.0008) [2023-12-28 00:24:35,581][106226] Updated weights for policy 0, policy_version 717465 (0.0010) [2023-12-28 00:24:35,641][106226] Updated weights for policy 0, policy_version 717475 (0.0010) [2023-12-28 00:24:35,695][106226] Updated weights for policy 0, policy_version 717485 (0.0010) [2023-12-28 00:24:35,752][106226] Updated weights for policy 0, policy_version 717495 (0.0010) [2023-12-28 00:24:35,998][106225] Updated weights for policy 1, policy_version 719404 (0.0008) [2023-12-28 00:24:36,063][106225] Updated weights for policy 1, policy_version 719414 (0.0007) [2023-12-28 00:24:36,127][106225] Updated weights for policy 1, policy_version 719424 (0.0007) [2023-12-28 00:24:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 367935488. Throughput: 0: 10008.6, 1: 9983.3. Samples: 367949676. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:36,175][105115] Avg episode reward: [(0, '-4.774'), (1, '-5.368')] [2023-12-28 00:24:36,523][106226] Updated weights for policy 0, policy_version 717505 (0.0006) [2023-12-28 00:24:36,589][106226] Updated weights for policy 0, policy_version 717515 (0.0006) [2023-12-28 00:24:36,638][106226] Updated weights for policy 0, policy_version 717525 (0.0009) [2023-12-28 00:24:36,818][106225] Updated weights for policy 1, policy_version 719434 (0.0009) [2023-12-28 00:24:36,881][106225] Updated weights for policy 1, policy_version 719444 (0.0007) [2023-12-28 00:24:36,943][106225] Updated weights for policy 1, policy_version 719454 (0.0007) [2023-12-28 00:24:37,011][106225] Updated weights for policy 1, policy_version 719464 (0.0008) [2023-12-28 00:24:37,368][106226] Updated weights for policy 0, policy_version 717535 (0.0007) [2023-12-28 00:24:37,433][106226] Updated weights for policy 0, policy_version 717545 (0.0005) [2023-12-28 00:24:37,497][106226] Updated weights for policy 0, policy_version 717555 (0.0005) [2023-12-28 00:24:37,729][106225] Updated weights for policy 1, policy_version 719474 (0.0009) [2023-12-28 00:24:37,779][106225] Updated weights for policy 1, policy_version 719484 (0.0009) [2023-12-28 00:24:37,832][106225] Updated weights for policy 1, policy_version 719494 (0.0008) [2023-12-28 00:24:37,993][106226] Updated weights for policy 0, policy_version 717565 (0.0005) [2023-12-28 00:24:38,052][106226] Updated weights for policy 0, policy_version 717575 (0.0006) [2023-12-28 00:24:38,108][106226] Updated weights for policy 0, policy_version 717585 (0.0006) [2023-12-28 00:24:38,627][106225] Updated weights for policy 1, policy_version 719504 (0.0006) [2023-12-28 00:24:38,687][106225] Updated weights for policy 1, policy_version 719514 (0.0006) [2023-12-28 00:24:38,738][106226] Updated weights for policy 0, policy_version 717595 (0.0007) [2023-12-28 00:24:38,748][106225] Updated weights for policy 1, policy_version 719524 (0.0006) [2023-12-28 00:24:38,796][106226] Updated weights for policy 0, policy_version 717605 (0.0008) [2023-12-28 00:24:38,857][106226] Updated weights for policy 0, policy_version 717615 (0.0008) [2023-12-28 00:24:39,443][106225] Updated weights for policy 1, policy_version 719534 (0.0007) [2023-12-28 00:24:39,504][106225] Updated weights for policy 1, policy_version 719544 (0.0008) [2023-12-28 00:24:39,563][106225] Updated weights for policy 1, policy_version 719554 (0.0008) [2023-12-28 00:24:39,579][106226] Updated weights for policy 0, policy_version 717625 (0.0008) [2023-12-28 00:24:39,634][106226] Updated weights for policy 0, policy_version 717635 (0.0007) [2023-12-28 00:24:39,705][106226] Updated weights for policy 0, policy_version 717645 (0.0010) [2023-12-28 00:24:39,759][106226] Updated weights for policy 0, policy_version 717655 (0.0010) [2023-12-28 00:24:40,344][106225] Updated weights for policy 1, policy_version 719564 (0.0008) [2023-12-28 00:24:40,404][106225] Updated weights for policy 1, policy_version 719574 (0.0010) [2023-12-28 00:24:40,456][106225] Updated weights for policy 1, policy_version 719584 (0.0008) [2023-12-28 00:24:40,489][106226] Updated weights for policy 0, policy_version 717665 (0.0010) [2023-12-28 00:24:40,545][106226] Updated weights for policy 0, policy_version 717675 (0.0011) [2023-12-28 00:24:40,599][106226] Updated weights for policy 0, policy_version 717685 (0.0006) [2023-12-28 00:24:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 368033792. Throughput: 0: 10115.7, 1: 9940.6. Samples: 368009916. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 00:24:41,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.047')] [2023-12-28 00:24:41,179][106225] Updated weights for policy 1, policy_version 719594 (0.0006) [2023-12-28 00:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000717688_183779328.pth... [2023-12-28 00:24:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000716504_183476224.pth [2023-12-28 00:24:41,240][106225] Updated weights for policy 1, policy_version 719604 (0.0009) [2023-12-28 00:24:41,310][106225] Updated weights for policy 1, policy_version 719614 (0.0007) [2023-12-28 00:24:41,327][106226] Updated weights for policy 0, policy_version 717695 (0.0010) [2023-12-28 00:24:41,378][106225] Updated weights for policy 1, policy_version 719624 (0.0008) [2023-12-28 00:24:41,379][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000719624_184262656.pth... [2023-12-28 00:24:41,382][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000718440_183959552.pth [2023-12-28 00:24:41,403][106226] Updated weights for policy 0, policy_version 717705 (0.0010) [2023-12-28 00:24:41,465][106226] Updated weights for policy 0, policy_version 717715 (0.0009) [2023-12-28 00:24:42,203][106225] Updated weights for policy 1, policy_version 719634 (0.0011) [2023-12-28 00:24:42,236][106226] Updated weights for policy 0, policy_version 717725 (0.0011) [2023-12-28 00:24:42,271][106225] Updated weights for policy 1, policy_version 719644 (0.0011) [2023-12-28 00:24:42,299][106226] Updated weights for policy 0, policy_version 717735 (0.0011) [2023-12-28 00:24:42,335][106225] Updated weights for policy 1, policy_version 719654 (0.0010) [2023-12-28 00:24:42,363][106226] Updated weights for policy 0, policy_version 717745 (0.0012) [2023-12-28 00:24:43,053][106226] Updated weights for policy 0, policy_version 717755 (0.0009) [2023-12-28 00:24:43,057][106225] Updated weights for policy 1, policy_version 719664 (0.0006) [2023-12-28 00:24:43,102][106225] Updated weights for policy 1, policy_version 719674 (0.0005) [2023-12-28 00:24:43,103][106226] Updated weights for policy 0, policy_version 717765 (0.0010) [2023-12-28 00:24:43,161][106225] Updated weights for policy 1, policy_version 719684 (0.0005) [2023-12-28 00:24:43,163][106226] Updated weights for policy 0, policy_version 717775 (0.0011) [2023-12-28 00:24:43,741][106225] Updated weights for policy 1, policy_version 719694 (0.0006) [2023-12-28 00:24:43,813][106225] Updated weights for policy 1, policy_version 719704 (0.0009) [2023-12-28 00:24:43,866][106226] Updated weights for policy 0, policy_version 717785 (0.0010) [2023-12-28 00:24:43,877][106225] Updated weights for policy 1, policy_version 719714 (0.0006) [2023-12-28 00:24:43,927][106226] Updated weights for policy 0, policy_version 717795 (0.0011) [2023-12-28 00:24:43,983][106226] Updated weights for policy 0, policy_version 717805 (0.0010) [2023-12-28 00:24:44,049][106226] Updated weights for policy 0, policy_version 717815 (0.0010) [2023-12-28 00:24:44,461][106225] Updated weights for policy 1, policy_version 719724 (0.0005) [2023-12-28 00:24:44,525][106225] Updated weights for policy 1, policy_version 719734 (0.0006) [2023-12-28 00:24:44,571][106225] Updated weights for policy 1, policy_version 719744 (0.0010) [2023-12-28 00:24:44,749][106226] Updated weights for policy 0, policy_version 717825 (0.0010) [2023-12-28 00:24:44,820][106226] Updated weights for policy 0, policy_version 717835 (0.0011) [2023-12-28 00:24:44,877][106226] Updated weights for policy 0, policy_version 717845 (0.0010) [2023-12-28 00:24:45,257][106225] Updated weights for policy 1, policy_version 719754 (0.0010) [2023-12-28 00:24:45,315][106225] Updated weights for policy 1, policy_version 719764 (0.0009) [2023-12-28 00:24:45,377][106225] Updated weights for policy 1, policy_version 719774 (0.0010) [2023-12-28 00:24:45,437][106225] Updated weights for policy 1, policy_version 719784 (0.0010) [2023-12-28 00:24:45,561][106226] Updated weights for policy 0, policy_version 717855 (0.0007) [2023-12-28 00:24:45,613][106226] Updated weights for policy 0, policy_version 717865 (0.0005) [2023-12-28 00:24:45,673][106226] Updated weights for policy 0, policy_version 717875 (0.0005) [2023-12-28 00:24:46,164][106225] Updated weights for policy 1, policy_version 719794 (0.0007) [2023-12-28 00:24:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 368132096. Throughput: 0: 10087.6, 1: 9945.6. Samples: 368126976. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:24:46,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.401')] [2023-12-28 00:24:46,216][106225] Updated weights for policy 1, policy_version 719804 (0.0010) [2023-12-28 00:24:46,240][106226] Updated weights for policy 0, policy_version 717885 (0.0008) [2023-12-28 00:24:46,274][106225] Updated weights for policy 1, policy_version 719814 (0.0009) [2023-12-28 00:24:46,300][106226] Updated weights for policy 0, policy_version 717895 (0.0011) [2023-12-28 00:24:46,374][106226] Updated weights for policy 0, policy_version 717905 (0.0007) [2023-12-28 00:24:46,816][106225] Updated weights for policy 1, policy_version 719824 (0.0005) [2023-12-28 00:24:46,869][106225] Updated weights for policy 1, policy_version 719834 (0.0006) [2023-12-28 00:24:46,932][106226] Updated weights for policy 0, policy_version 717915 (0.0006) [2023-12-28 00:24:46,935][106225] Updated weights for policy 1, policy_version 719844 (0.0005) [2023-12-28 00:24:46,987][106226] Updated weights for policy 0, policy_version 717925 (0.0006) [2023-12-28 00:24:47,042][106226] Updated weights for policy 0, policy_version 717935 (0.0005) [2023-12-28 00:24:47,561][106225] Updated weights for policy 1, policy_version 719854 (0.0007) [2023-12-28 00:24:47,614][106225] Updated weights for policy 1, policy_version 719864 (0.0008) [2023-12-28 00:24:47,615][106226] Updated weights for policy 0, policy_version 717945 (0.0006) [2023-12-28 00:24:47,668][106226] Updated weights for policy 0, policy_version 717955 (0.0005) [2023-12-28 00:24:47,670][106225] Updated weights for policy 1, policy_version 719874 (0.0008) [2023-12-28 00:24:47,728][106226] Updated weights for policy 0, policy_version 717965 (0.0007) [2023-12-28 00:24:47,784][106226] Updated weights for policy 0, policy_version 717975 (0.0006) [2023-12-28 00:24:48,341][106226] Updated weights for policy 0, policy_version 717985 (0.0010) [2023-12-28 00:24:48,411][106226] Updated weights for policy 0, policy_version 717995 (0.0011) [2023-12-28 00:24:48,469][106225] Updated weights for policy 1, policy_version 719884 (0.0009) [2023-12-28 00:24:48,471][106226] Updated weights for policy 0, policy_version 718005 (0.0009) [2023-12-28 00:24:48,531][106225] Updated weights for policy 1, policy_version 719894 (0.0008) [2023-12-28 00:24:48,581][106225] Updated weights for policy 1, policy_version 719904 (0.0008) [2023-12-28 00:24:49,117][106226] Updated weights for policy 0, policy_version 718015 (0.0006) [2023-12-28 00:24:49,174][106226] Updated weights for policy 0, policy_version 718025 (0.0005) [2023-12-28 00:24:49,246][106226] Updated weights for policy 0, policy_version 718035 (0.0009) [2023-12-28 00:24:49,327][106225] Updated weights for policy 1, policy_version 719914 (0.0006) [2023-12-28 00:24:49,394][106225] Updated weights for policy 1, policy_version 719924 (0.0007) [2023-12-28 00:24:49,448][106225] Updated weights for policy 1, policy_version 719934 (0.0007) [2023-12-28 00:24:49,498][106225] Updated weights for policy 1, policy_version 719944 (0.0008) [2023-12-28 00:24:49,912][106226] Updated weights for policy 0, policy_version 718045 (0.0009) [2023-12-28 00:24:49,980][106226] Updated weights for policy 0, policy_version 718055 (0.0009) [2023-12-28 00:24:50,044][106226] Updated weights for policy 0, policy_version 718065 (0.0011) [2023-12-28 00:24:50,253][106225] Updated weights for policy 1, policy_version 719954 (0.0005) [2023-12-28 00:24:50,309][106225] Updated weights for policy 1, policy_version 719964 (0.0005) [2023-12-28 00:24:50,366][106225] Updated weights for policy 1, policy_version 719974 (0.0005) [2023-12-28 00:24:50,752][106226] Updated weights for policy 0, policy_version 718075 (0.0010) [2023-12-28 00:24:50,811][106226] Updated weights for policy 0, policy_version 718085 (0.0007) [2023-12-28 00:24:50,873][106226] Updated weights for policy 0, policy_version 718095 (0.0006) [2023-12-28 00:24:51,087][106225] Updated weights for policy 1, policy_version 719984 (0.0008) [2023-12-28 00:24:51,153][106225] Updated weights for policy 1, policy_version 719994 (0.0008) [2023-12-28 00:24:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 368238592. Throughput: 0: 10127.3, 1: 9937.2. Samples: 368251680. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:24:51,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-5.523')] [2023-12-28 00:24:51,218][106225] Updated weights for policy 1, policy_version 720004 (0.0007) [2023-12-28 00:24:51,522][106226] Updated weights for policy 0, policy_version 718105 (0.0006) [2023-12-28 00:24:51,581][106226] Updated weights for policy 0, policy_version 718115 (0.0007) [2023-12-28 00:24:51,653][106226] Updated weights for policy 0, policy_version 718125 (0.0007) [2023-12-28 00:24:51,724][106226] Updated weights for policy 0, policy_version 718135 (0.0007) [2023-12-28 00:24:51,989][106225] Updated weights for policy 1, policy_version 720014 (0.0008) [2023-12-28 00:24:52,054][106225] Updated weights for policy 1, policy_version 720024 (0.0009) [2023-12-28 00:24:52,120][106225] Updated weights for policy 1, policy_version 720034 (0.0007) [2023-12-28 00:24:52,402][106226] Updated weights for policy 0, policy_version 718145 (0.0009) [2023-12-28 00:24:52,468][106226] Updated weights for policy 0, policy_version 718155 (0.0009) [2023-12-28 00:24:52,523][106226] Updated weights for policy 0, policy_version 718165 (0.0008) [2023-12-28 00:24:52,853][106225] Updated weights for policy 1, policy_version 720044 (0.0009) [2023-12-28 00:24:52,911][106225] Updated weights for policy 1, policy_version 720054 (0.0008) [2023-12-28 00:24:52,969][106225] Updated weights for policy 1, policy_version 720064 (0.0009) [2023-12-28 00:24:53,189][106226] Updated weights for policy 0, policy_version 718175 (0.0007) [2023-12-28 00:24:53,240][106226] Updated weights for policy 0, policy_version 718185 (0.0009) [2023-12-28 00:24:53,289][106226] Updated weights for policy 0, policy_version 718195 (0.0008) [2023-12-28 00:24:53,598][106225] Updated weights for policy 1, policy_version 720074 (0.0008) [2023-12-28 00:24:53,656][106225] Updated weights for policy 1, policy_version 720084 (0.0005) [2023-12-28 00:24:53,710][106225] Updated weights for policy 1, policy_version 720094 (0.0007) [2023-12-28 00:24:53,765][106225] Updated weights for policy 1, policy_version 720104 (0.0008) [2023-12-28 00:24:54,080][106226] Updated weights for policy 0, policy_version 718205 (0.0008) [2023-12-28 00:24:54,138][106226] Updated weights for policy 0, policy_version 718215 (0.0009) [2023-12-28 00:24:54,195][106226] Updated weights for policy 0, policy_version 718225 (0.0009) [2023-12-28 00:24:54,450][106225] Updated weights for policy 1, policy_version 720114 (0.0008) [2023-12-28 00:24:54,502][106225] Updated weights for policy 1, policy_version 720124 (0.0008) [2023-12-28 00:24:54,560][106225] Updated weights for policy 1, policy_version 720134 (0.0009) [2023-12-28 00:24:54,924][106226] Updated weights for policy 0, policy_version 718235 (0.0008) [2023-12-28 00:24:54,987][106226] Updated weights for policy 0, policy_version 718245 (0.0007) [2023-12-28 00:24:55,040][106226] Updated weights for policy 0, policy_version 718255 (0.0008) [2023-12-28 00:24:55,287][106225] Updated weights for policy 1, policy_version 720144 (0.0008) [2023-12-28 00:24:55,335][106225] Updated weights for policy 1, policy_version 720154 (0.0009) [2023-12-28 00:24:55,396][106225] Updated weights for policy 1, policy_version 720164 (0.0008) [2023-12-28 00:24:55,768][106226] Updated weights for policy 0, policy_version 718265 (0.0009) [2023-12-28 00:24:55,832][106226] Updated weights for policy 0, policy_version 718275 (0.0007) [2023-12-28 00:24:55,892][106226] Updated weights for policy 0, policy_version 718285 (0.0007) [2023-12-28 00:24:55,947][106226] Updated weights for policy 0, policy_version 718295 (0.0010) [2023-12-28 00:24:56,099][106225] Updated weights for policy 1, policy_version 720174 (0.0010) [2023-12-28 00:24:56,156][106225] Updated weights for policy 1, policy_version 720184 (0.0010) [2023-12-28 00:24:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 368336896. Throughput: 0: 10102.4, 1: 9931.6. Samples: 368310276. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:24:56,176][105115] Avg episode reward: [(0, '-4.445'), (1, '-5.307')] [2023-12-28 00:24:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000718296_183934976.pth... [2023-12-28 00:24:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000717080_183623680.pth [2023-12-28 00:24:56,212][106225] Updated weights for policy 1, policy_version 720194 (0.0010) [2023-12-28 00:24:56,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000720200_184410112.pth... [2023-12-28 00:24:56,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000719048_184115200.pth [2023-12-28 00:24:56,693][106226] Updated weights for policy 0, policy_version 718305 (0.0009) [2023-12-28 00:24:56,747][106226] Updated weights for policy 0, policy_version 718316 (0.0010) [2023-12-28 00:24:56,797][106226] Updated weights for policy 0, policy_version 718326 (0.0009) [2023-12-28 00:24:56,837][106225] Updated weights for policy 1, policy_version 720204 (0.0008) [2023-12-28 00:24:56,896][106225] Updated weights for policy 1, policy_version 720214 (0.0007) [2023-12-28 00:24:56,955][106225] Updated weights for policy 1, policy_version 720224 (0.0010) [2023-12-28 00:24:57,549][106226] Updated weights for policy 0, policy_version 718336 (0.0006) [2023-12-28 00:24:57,572][106225] Updated weights for policy 1, policy_version 720234 (0.0009) [2023-12-28 00:24:57,602][106226] Updated weights for policy 0, policy_version 718346 (0.0005) [2023-12-28 00:24:57,628][106225] Updated weights for policy 1, policy_version 720244 (0.0010) [2023-12-28 00:24:57,649][106226] Updated weights for policy 0, policy_version 718356 (0.0005) [2023-12-28 00:24:57,688][106225] Updated weights for policy 1, policy_version 720254 (0.0010) [2023-12-28 00:24:57,751][106225] Updated weights for policy 1, policy_version 720264 (0.0007) [2023-12-28 00:24:58,331][106225] Updated weights for policy 1, policy_version 720274 (0.0010) [2023-12-28 00:24:58,407][106225] Updated weights for policy 1, policy_version 720284 (0.0010) [2023-12-28 00:24:58,420][106226] Updated weights for policy 0, policy_version 718366 (0.0007) [2023-12-28 00:24:58,472][106225] Updated weights for policy 1, policy_version 720294 (0.0007) [2023-12-28 00:24:58,486][106226] Updated weights for policy 0, policy_version 718376 (0.0007) [2023-12-28 00:24:58,553][106226] Updated weights for policy 0, policy_version 718386 (0.0008) [2023-12-28 00:24:59,281][106225] Updated weights for policy 1, policy_version 720304 (0.0009) [2023-12-28 00:24:59,347][106225] Updated weights for policy 1, policy_version 720314 (0.0009) [2023-12-28 00:24:59,414][106225] Updated weights for policy 1, policy_version 720324 (0.0007) [2023-12-28 00:24:59,418][106226] Updated weights for policy 0, policy_version 718396 (0.0008) [2023-12-28 00:24:59,473][106226] Updated weights for policy 0, policy_version 718406 (0.0008) [2023-12-28 00:24:59,528][106226] Updated weights for policy 0, policy_version 718416 (0.0008) [2023-12-28 00:25:00,094][106225] Updated weights for policy 1, policy_version 720334 (0.0007) [2023-12-28 00:25:00,155][106225] Updated weights for policy 1, policy_version 720344 (0.0006) [2023-12-28 00:25:00,214][106225] Updated weights for policy 1, policy_version 720354 (0.0005) [2023-12-28 00:25:00,305][106226] Updated weights for policy 0, policy_version 718426 (0.0008) [2023-12-28 00:25:00,366][106226] Updated weights for policy 0, policy_version 718436 (0.0009) [2023-12-28 00:25:00,423][106226] Updated weights for policy 0, policy_version 718446 (0.0008) [2023-12-28 00:25:00,475][106226] Updated weights for policy 0, policy_version 718456 (0.0009) [2023-12-28 00:25:00,798][106225] Updated weights for policy 1, policy_version 720364 (0.0005) [2023-12-28 00:25:00,851][106225] Updated weights for policy 1, policy_version 720374 (0.0005) [2023-12-28 00:25:00,906][106225] Updated weights for policy 1, policy_version 720384 (0.0006) [2023-12-28 00:25:01,119][106226] Updated weights for policy 0, policy_version 718466 (0.0006) [2023-12-28 00:25:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 368435200. Throughput: 0: 10103.0, 1: 9995.6. Samples: 368426244. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:01,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-5.670')] [2023-12-28 00:25:01,185][106226] Updated weights for policy 0, policy_version 718476 (0.0008) [2023-12-28 00:25:01,244][106226] Updated weights for policy 0, policy_version 718486 (0.0006) [2023-12-28 00:25:01,545][106225] Updated weights for policy 1, policy_version 720394 (0.0005) [2023-12-28 00:25:01,603][106225] Updated weights for policy 1, policy_version 720404 (0.0007) [2023-12-28 00:25:01,673][106225] Updated weights for policy 1, policy_version 720414 (0.0008) [2023-12-28 00:25:01,730][106225] Updated weights for policy 1, policy_version 720424 (0.0008) [2023-12-28 00:25:01,922][106226] Updated weights for policy 0, policy_version 718496 (0.0009) [2023-12-28 00:25:01,973][106226] Updated weights for policy 0, policy_version 718506 (0.0010) [2023-12-28 00:25:02,027][106226] Updated weights for policy 0, policy_version 718516 (0.0008) [2023-12-28 00:25:02,388][106225] Updated weights for policy 1, policy_version 720434 (0.0010) [2023-12-28 00:25:02,450][106225] Updated weights for policy 1, policy_version 720444 (0.0007) [2023-12-28 00:25:02,503][106225] Updated weights for policy 1, policy_version 720454 (0.0007) [2023-12-28 00:25:02,758][106226] Updated weights for policy 0, policy_version 718526 (0.0009) [2023-12-28 00:25:02,821][106226] Updated weights for policy 0, policy_version 718536 (0.0010) [2023-12-28 00:25:02,877][106226] Updated weights for policy 0, policy_version 718546 (0.0010) [2023-12-28 00:25:03,063][106225] Updated weights for policy 1, policy_version 720464 (0.0007) [2023-12-28 00:25:03,124][106225] Updated weights for policy 1, policy_version 720474 (0.0009) [2023-12-28 00:25:03,185][106225] Updated weights for policy 1, policy_version 720484 (0.0008) [2023-12-28 00:25:03,587][106226] Updated weights for policy 0, policy_version 718556 (0.0010) [2023-12-28 00:25:03,641][106226] Updated weights for policy 0, policy_version 718566 (0.0010) [2023-12-28 00:25:03,693][106226] Updated weights for policy 0, policy_version 718576 (0.0010) [2023-12-28 00:25:03,791][106225] Updated weights for policy 1, policy_version 720494 (0.0006) [2023-12-28 00:25:03,855][106225] Updated weights for policy 1, policy_version 720504 (0.0007) [2023-12-28 00:25:03,916][106225] Updated weights for policy 1, policy_version 720514 (0.0006) [2023-12-28 00:25:04,349][106226] Updated weights for policy 0, policy_version 718586 (0.0010) [2023-12-28 00:25:04,396][106226] Updated weights for policy 0, policy_version 718596 (0.0008) [2023-12-28 00:25:04,445][106226] Updated weights for policy 0, policy_version 718606 (0.0008) [2023-12-28 00:25:04,511][106226] Updated weights for policy 0, policy_version 718616 (0.0009) [2023-12-28 00:25:04,595][106225] Updated weights for policy 1, policy_version 720524 (0.0007) [2023-12-28 00:25:04,655][106225] Updated weights for policy 1, policy_version 720534 (0.0007) [2023-12-28 00:25:04,702][106225] Updated weights for policy 1, policy_version 720544 (0.0006) [2023-12-28 00:25:05,208][106226] Updated weights for policy 0, policy_version 718626 (0.0005) [2023-12-28 00:25:05,267][106226] Updated weights for policy 0, policy_version 718636 (0.0006) [2023-12-28 00:25:05,323][106226] Updated weights for policy 0, policy_version 718646 (0.0008) [2023-12-28 00:25:05,458][106225] Updated weights for policy 1, policy_version 720554 (0.0007) [2023-12-28 00:25:05,512][106225] Updated weights for policy 1, policy_version 720564 (0.0008) [2023-12-28 00:25:05,563][106225] Updated weights for policy 1, policy_version 720574 (0.0008) [2023-12-28 00:25:05,611][106225] Updated weights for policy 1, policy_version 720584 (0.0008) [2023-12-28 00:25:06,004][106226] Updated weights for policy 0, policy_version 718656 (0.0009) [2023-12-28 00:25:06,093][106226] Updated weights for policy 0, policy_version 718666 (0.0009) [2023-12-28 00:25:06,162][106226] Updated weights for policy 0, policy_version 718676 (0.0009) [2023-12-28 00:25:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 368533504. Throughput: 0: 10078.4, 1: 10038.7. Samples: 368549488. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:06,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.103')] [2023-12-28 00:25:06,332][106225] Updated weights for policy 1, policy_version 720594 (0.0009) [2023-12-28 00:25:06,394][106225] Updated weights for policy 1, policy_version 720604 (0.0009) [2023-12-28 00:25:06,458][106225] Updated weights for policy 1, policy_version 720614 (0.0011) [2023-12-28 00:25:06,867][106226] Updated weights for policy 0, policy_version 718686 (0.0008) [2023-12-28 00:25:06,927][106226] Updated weights for policy 0, policy_version 718696 (0.0008) [2023-12-28 00:25:06,978][106226] Updated weights for policy 0, policy_version 718706 (0.0008) [2023-12-28 00:25:07,215][106225] Updated weights for policy 1, policy_version 720624 (0.0010) [2023-12-28 00:25:07,266][106225] Updated weights for policy 1, policy_version 720634 (0.0010) [2023-12-28 00:25:07,320][106225] Updated weights for policy 1, policy_version 720644 (0.0010) [2023-12-28 00:25:07,672][106226] Updated weights for policy 0, policy_version 718716 (0.0007) [2023-12-28 00:25:07,737][106226] Updated weights for policy 0, policy_version 718726 (0.0005) [2023-12-28 00:25:07,802][106226] Updated weights for policy 0, policy_version 718736 (0.0005) [2023-12-28 00:25:07,922][106225] Updated weights for policy 1, policy_version 720654 (0.0010) [2023-12-28 00:25:07,979][106225] Updated weights for policy 1, policy_version 720664 (0.0010) [2023-12-28 00:25:08,029][106225] Updated weights for policy 1, policy_version 720674 (0.0010) [2023-12-28 00:25:08,499][106226] Updated weights for policy 0, policy_version 718746 (0.0007) [2023-12-28 00:25:08,562][106226] Updated weights for policy 0, policy_version 718756 (0.0006) [2023-12-28 00:25:08,619][106226] Updated weights for policy 0, policy_version 718766 (0.0006) [2023-12-28 00:25:08,678][106226] Updated weights for policy 0, policy_version 718776 (0.0006) [2023-12-28 00:25:08,759][106225] Updated weights for policy 1, policy_version 720684 (0.0009) [2023-12-28 00:25:08,819][106225] Updated weights for policy 1, policy_version 720694 (0.0008) [2023-12-28 00:25:08,880][106225] Updated weights for policy 1, policy_version 720704 (0.0008) [2023-12-28 00:25:09,297][106226] Updated weights for policy 0, policy_version 718786 (0.0010) [2023-12-28 00:25:09,367][106226] Updated weights for policy 0, policy_version 718796 (0.0009) [2023-12-28 00:25:09,433][106226] Updated weights for policy 0, policy_version 718806 (0.0009) [2023-12-28 00:25:09,555][106225] Updated weights for policy 1, policy_version 720714 (0.0009) [2023-12-28 00:25:09,615][106225] Updated weights for policy 1, policy_version 720724 (0.0008) [2023-12-28 00:25:09,676][106225] Updated weights for policy 1, policy_version 720734 (0.0009) [2023-12-28 00:25:09,734][106225] Updated weights for policy 1, policy_version 720744 (0.0007) [2023-12-28 00:25:10,095][106226] Updated weights for policy 0, policy_version 718816 (0.0006) [2023-12-28 00:25:10,158][106226] Updated weights for policy 0, policy_version 718826 (0.0006) [2023-12-28 00:25:10,227][106226] Updated weights for policy 0, policy_version 718836 (0.0007) [2023-12-28 00:25:10,488][106225] Updated weights for policy 1, policy_version 720754 (0.0007) [2023-12-28 00:25:10,544][106225] Updated weights for policy 1, policy_version 720764 (0.0005) [2023-12-28 00:25:10,609][106225] Updated weights for policy 1, policy_version 720774 (0.0006) [2023-12-28 00:25:10,914][106226] Updated weights for policy 0, policy_version 718846 (0.0008) [2023-12-28 00:25:10,964][106226] Updated weights for policy 0, policy_version 718856 (0.0007) [2023-12-28 00:25:11,018][106226] Updated weights for policy 0, policy_version 718866 (0.0008) [2023-12-28 00:25:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 368640000. Throughput: 0: 10124.1, 1: 10072.8. Samples: 368609920. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:11,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.456')] [2023-12-28 00:25:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000718872_184082432.pth... [2023-12-28 00:25:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000720776_184557568.pth... [2023-12-28 00:25:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000717688_183779328.pth [2023-12-28 00:25:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000719624_184262656.pth [2023-12-28 00:25:11,369][106225] Updated weights for policy 1, policy_version 720784 (0.0007) [2023-12-28 00:25:11,434][106225] Updated weights for policy 1, policy_version 720794 (0.0006) [2023-12-28 00:25:11,501][106225] Updated weights for policy 1, policy_version 720804 (0.0006) [2023-12-28 00:25:11,811][106226] Updated weights for policy 0, policy_version 718876 (0.0008) [2023-12-28 00:25:11,876][106226] Updated weights for policy 0, policy_version 718886 (0.0011) [2023-12-28 00:25:11,934][106226] Updated weights for policy 0, policy_version 718896 (0.0011) [2023-12-28 00:25:12,163][106225] Updated weights for policy 1, policy_version 720814 (0.0007) [2023-12-28 00:25:12,225][106225] Updated weights for policy 1, policy_version 720824 (0.0008) [2023-12-28 00:25:12,295][106225] Updated weights for policy 1, policy_version 720834 (0.0007) [2023-12-28 00:25:12,728][106226] Updated weights for policy 0, policy_version 718906 (0.0011) [2023-12-28 00:25:12,788][106226] Updated weights for policy 0, policy_version 718916 (0.0009) [2023-12-28 00:25:12,843][106226] Updated weights for policy 0, policy_version 718926 (0.0006) [2023-12-28 00:25:12,907][106226] Updated weights for policy 0, policy_version 718936 (0.0006) [2023-12-28 00:25:13,051][106225] Updated weights for policy 1, policy_version 720844 (0.0009) [2023-12-28 00:25:13,104][106225] Updated weights for policy 1, policy_version 720854 (0.0010) [2023-12-28 00:25:13,161][106225] Updated weights for policy 1, policy_version 720864 (0.0010) [2023-12-28 00:25:13,577][106226] Updated weights for policy 0, policy_version 718946 (0.0008) [2023-12-28 00:25:13,642][106226] Updated weights for policy 0, policy_version 718956 (0.0008) [2023-12-28 00:25:13,696][106226] Updated weights for policy 0, policy_version 718966 (0.0006) [2023-12-28 00:25:13,854][106225] Updated weights for policy 1, policy_version 720874 (0.0008) [2023-12-28 00:25:13,917][106225] Updated weights for policy 1, policy_version 720884 (0.0010) [2023-12-28 00:25:13,977][106225] Updated weights for policy 1, policy_version 720894 (0.0010) [2023-12-28 00:25:14,027][106225] Updated weights for policy 1, policy_version 720904 (0.0010) [2023-12-28 00:25:14,336][106226] Updated weights for policy 0, policy_version 718976 (0.0009) [2023-12-28 00:25:14,399][106226] Updated weights for policy 0, policy_version 718986 (0.0010) [2023-12-28 00:25:14,465][106226] Updated weights for policy 0, policy_version 718996 (0.0011) [2023-12-28 00:25:14,741][106225] Updated weights for policy 1, policy_version 720914 (0.0010) [2023-12-28 00:25:14,807][106225] Updated weights for policy 1, policy_version 720924 (0.0010) [2023-12-28 00:25:14,870][106225] Updated weights for policy 1, policy_version 720934 (0.0010) [2023-12-28 00:25:15,153][106226] Updated weights for policy 0, policy_version 719006 (0.0009) [2023-12-28 00:25:15,220][106226] Updated weights for policy 0, policy_version 719016 (0.0009) [2023-12-28 00:25:15,283][106226] Updated weights for policy 0, policy_version 719026 (0.0009) [2023-12-28 00:25:15,604][106225] Updated weights for policy 1, policy_version 720944 (0.0010) [2023-12-28 00:25:15,662][106225] Updated weights for policy 1, policy_version 720954 (0.0010) [2023-12-28 00:25:15,723][106225] Updated weights for policy 1, policy_version 720964 (0.0010) [2023-12-28 00:25:15,999][106226] Updated weights for policy 0, policy_version 719036 (0.0008) [2023-12-28 00:25:16,062][106226] Updated weights for policy 0, policy_version 719046 (0.0008) [2023-12-28 00:25:16,123][106226] Updated weights for policy 0, policy_version 719056 (0.0008) [2023-12-28 00:25:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 368738304. Throughput: 0: 10010.8, 1: 9924.4. Samples: 368725856. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:16,176][105115] Avg episode reward: [(0, '-4.618'), (1, '-5.363')] [2023-12-28 00:25:16,386][106225] Updated weights for policy 1, policy_version 720974 (0.0008) [2023-12-28 00:25:16,444][106225] Updated weights for policy 1, policy_version 720984 (0.0005) [2023-12-28 00:25:16,500][106225] Updated weights for policy 1, policy_version 720994 (0.0005) [2023-12-28 00:25:16,904][106226] Updated weights for policy 0, policy_version 719066 (0.0007) [2023-12-28 00:25:16,963][106226] Updated weights for policy 0, policy_version 719076 (0.0008) [2023-12-28 00:25:17,015][106225] Updated weights for policy 1, policy_version 721004 (0.0006) [2023-12-28 00:25:17,017][106226] Updated weights for policy 0, policy_version 719086 (0.0010) [2023-12-28 00:25:17,070][106226] Updated weights for policy 0, policy_version 719096 (0.0010) [2023-12-28 00:25:17,071][106225] Updated weights for policy 1, policy_version 721014 (0.0009) [2023-12-28 00:25:17,136][106225] Updated weights for policy 1, policy_version 721024 (0.0006) [2023-12-28 00:25:17,690][106226] Updated weights for policy 0, policy_version 719106 (0.0005) [2023-12-28 00:25:17,745][106226] Updated weights for policy 0, policy_version 719116 (0.0006) [2023-12-28 00:25:17,791][106225] Updated weights for policy 1, policy_version 721034 (0.0005) [2023-12-28 00:25:17,796][106226] Updated weights for policy 0, policy_version 719127 (0.0008) [2023-12-28 00:25:17,838][106225] Updated weights for policy 1, policy_version 721044 (0.0005) [2023-12-28 00:25:17,884][106225] Updated weights for policy 1, policy_version 721054 (0.0005) [2023-12-28 00:25:17,929][106225] Updated weights for policy 1, policy_version 721064 (0.0005) [2023-12-28 00:25:18,404][106226] Updated weights for policy 0, policy_version 719137 (0.0010) [2023-12-28 00:25:18,459][106226] Updated weights for policy 0, policy_version 719147 (0.0010) [2023-12-28 00:25:18,500][106225] Updated weights for policy 1, policy_version 721074 (0.0006) [2023-12-28 00:25:18,516][106226] Updated weights for policy 0, policy_version 719157 (0.0011) [2023-12-28 00:25:18,547][106225] Updated weights for policy 1, policy_version 721084 (0.0007) [2023-12-28 00:25:18,596][106225] Updated weights for policy 1, policy_version 721094 (0.0005) [2023-12-28 00:25:19,266][106226] Updated weights for policy 0, policy_version 719167 (0.0011) [2023-12-28 00:25:19,328][106226] Updated weights for policy 0, policy_version 719177 (0.0010) [2023-12-28 00:25:19,375][106225] Updated weights for policy 1, policy_version 721104 (0.0010) [2023-12-28 00:25:19,397][106226] Updated weights for policy 0, policy_version 719187 (0.0013) [2023-12-28 00:25:19,434][106225] Updated weights for policy 1, policy_version 721114 (0.0006) [2023-12-28 00:25:19,491][106225] Updated weights for policy 1, policy_version 721124 (0.0007) [2023-12-28 00:25:20,103][106226] Updated weights for policy 0, policy_version 719197 (0.0009) [2023-12-28 00:25:20,172][106226] Updated weights for policy 0, policy_version 719207 (0.0009) [2023-12-28 00:25:20,234][106226] Updated weights for policy 0, policy_version 719217 (0.0009) [2023-12-28 00:25:20,283][106225] Updated weights for policy 1, policy_version 721134 (0.0009) [2023-12-28 00:25:20,343][106225] Updated weights for policy 1, policy_version 721144 (0.0010) [2023-12-28 00:25:20,409][106225] Updated weights for policy 1, policy_version 721154 (0.0011) [2023-12-28 00:25:20,963][106226] Updated weights for policy 0, policy_version 719227 (0.0007) [2023-12-28 00:25:21,030][106226] Updated weights for policy 0, policy_version 719237 (0.0008) [2023-12-28 00:25:21,093][106226] Updated weights for policy 0, policy_version 719247 (0.0008) [2023-12-28 00:25:21,171][106225] Updated weights for policy 1, policy_version 721164 (0.0010) [2023-12-28 00:25:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 368836608. Throughput: 0: 9936.3, 1: 9989.0. Samples: 368846312. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:21,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-5.513')] [2023-12-28 00:25:21,225][106225] Updated weights for policy 1, policy_version 721174 (0.0006) [2023-12-28 00:25:21,292][106225] Updated weights for policy 1, policy_version 721184 (0.0008) [2023-12-28 00:25:21,876][106226] Updated weights for policy 0, policy_version 719257 (0.0008) [2023-12-28 00:25:21,944][106226] Updated weights for policy 0, policy_version 719267 (0.0008) [2023-12-28 00:25:22,001][106226] Updated weights for policy 0, policy_version 719277 (0.0009) [2023-12-28 00:25:22,035][106225] Updated weights for policy 1, policy_version 721194 (0.0008) [2023-12-28 00:25:22,064][106226] Updated weights for policy 0, policy_version 719287 (0.0009) [2023-12-28 00:25:22,095][106225] Updated weights for policy 1, policy_version 721204 (0.0007) [2023-12-28 00:25:22,145][106225] Updated weights for policy 1, policy_version 721214 (0.0008) [2023-12-28 00:25:22,201][106225] Updated weights for policy 1, policy_version 721224 (0.0007) [2023-12-28 00:25:22,800][106226] Updated weights for policy 0, policy_version 719297 (0.0008) [2023-12-28 00:25:22,857][106226] Updated weights for policy 0, policy_version 719307 (0.0005) [2023-12-28 00:25:22,921][106226] Updated weights for policy 0, policy_version 719317 (0.0008) [2023-12-28 00:25:22,985][106225] Updated weights for policy 1, policy_version 721234 (0.0008) [2023-12-28 00:25:23,035][106225] Updated weights for policy 1, policy_version 721244 (0.0008) [2023-12-28 00:25:23,104][106225] Updated weights for policy 1, policy_version 721254 (0.0008) [2023-12-28 00:25:23,525][106226] Updated weights for policy 0, policy_version 719327 (0.0006) [2023-12-28 00:25:23,583][106226] Updated weights for policy 0, policy_version 719337 (0.0006) [2023-12-28 00:25:23,636][106226] Updated weights for policy 0, policy_version 719347 (0.0008) [2023-12-28 00:25:23,827][106225] Updated weights for policy 1, policy_version 721264 (0.0008) [2023-12-28 00:25:23,876][106225] Updated weights for policy 1, policy_version 721274 (0.0008) [2023-12-28 00:25:23,925][106225] Updated weights for policy 1, policy_version 721284 (0.0008) [2023-12-28 00:25:24,313][106226] Updated weights for policy 0, policy_version 719357 (0.0009) [2023-12-28 00:25:24,374][106226] Updated weights for policy 0, policy_version 719367 (0.0008) [2023-12-28 00:25:24,432][106226] Updated weights for policy 0, policy_version 719377 (0.0008) [2023-12-28 00:25:24,696][106225] Updated weights for policy 1, policy_version 721294 (0.0008) [2023-12-28 00:25:24,755][106225] Updated weights for policy 1, policy_version 721304 (0.0009) [2023-12-28 00:25:24,805][106225] Updated weights for policy 1, policy_version 721314 (0.0009) [2023-12-28 00:25:25,119][106226] Updated weights for policy 0, policy_version 719387 (0.0008) [2023-12-28 00:25:25,183][106226] Updated weights for policy 0, policy_version 719397 (0.0008) [2023-12-28 00:25:25,230][106226] Updated weights for policy 0, policy_version 719407 (0.0008) [2023-12-28 00:25:25,552][106225] Updated weights for policy 1, policy_version 721324 (0.0009) [2023-12-28 00:25:25,608][106225] Updated weights for policy 1, policy_version 721334 (0.0008) [2023-12-28 00:25:25,667][106225] Updated weights for policy 1, policy_version 721344 (0.0008) [2023-12-28 00:25:25,938][106226] Updated weights for policy 0, policy_version 719417 (0.0008) [2023-12-28 00:25:25,989][106226] Updated weights for policy 0, policy_version 719427 (0.0005) [2023-12-28 00:25:26,050][106226] Updated weights for policy 0, policy_version 719437 (0.0005) [2023-12-28 00:25:26,102][106226] Updated weights for policy 0, policy_version 719447 (0.0007) [2023-12-28 00:25:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 368934912. Throughput: 0: 9890.0, 1: 9970.0. Samples: 368903620. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:26,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-5.511')] [2023-12-28 00:25:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000721352_184705024.pth... [2023-12-28 00:25:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000719448_184229888.pth... [2023-12-28 00:25:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000720200_184410112.pth [2023-12-28 00:25:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000718296_183934976.pth [2023-12-28 00:25:26,416][106225] Updated weights for policy 1, policy_version 721354 (0.0009) [2023-12-28 00:25:26,471][106225] Updated weights for policy 1, policy_version 721364 (0.0009) [2023-12-28 00:25:26,520][106225] Updated weights for policy 1, policy_version 721374 (0.0008) [2023-12-28 00:25:26,571][106225] Updated weights for policy 1, policy_version 721384 (0.0008) [2023-12-28 00:25:26,772][106226] Updated weights for policy 0, policy_version 719457 (0.0008) [2023-12-28 00:25:26,821][106226] Updated weights for policy 0, policy_version 719467 (0.0009) [2023-12-28 00:25:26,868][106226] Updated weights for policy 0, policy_version 719477 (0.0008) [2023-12-28 00:25:27,314][106225] Updated weights for policy 1, policy_version 721394 (0.0008) [2023-12-28 00:25:27,376][106225] Updated weights for policy 1, policy_version 721404 (0.0008) [2023-12-28 00:25:27,438][106225] Updated weights for policy 1, policy_version 721414 (0.0008) [2023-12-28 00:25:27,601][106226] Updated weights for policy 0, policy_version 719487 (0.0009) [2023-12-28 00:25:27,651][106226] Updated weights for policy 0, policy_version 719497 (0.0008) [2023-12-28 00:25:27,705][106226] Updated weights for policy 0, policy_version 719507 (0.0008) [2023-12-28 00:25:28,155][106225] Updated weights for policy 1, policy_version 721424 (0.0010) [2023-12-28 00:25:28,208][106225] Updated weights for policy 1, policy_version 721434 (0.0008) [2023-12-28 00:25:28,261][106225] Updated weights for policy 1, policy_version 721444 (0.0008) [2023-12-28 00:25:28,389][106226] Updated weights for policy 0, policy_version 719517 (0.0008) [2023-12-28 00:25:28,452][106226] Updated weights for policy 0, policy_version 719527 (0.0008) [2023-12-28 00:25:28,510][106226] Updated weights for policy 0, policy_version 719537 (0.0011) [2023-12-28 00:25:29,021][106225] Updated weights for policy 1, policy_version 721454 (0.0007) [2023-12-28 00:25:29,087][106225] Updated weights for policy 1, policy_version 721464 (0.0005) [2023-12-28 00:25:29,147][106225] Updated weights for policy 1, policy_version 721474 (0.0006) [2023-12-28 00:25:29,166][106226] Updated weights for policy 0, policy_version 719547 (0.0010) [2023-12-28 00:25:29,228][106226] Updated weights for policy 0, policy_version 719557 (0.0010) [2023-12-28 00:25:29,287][106226] Updated weights for policy 0, policy_version 719567 (0.0006) [2023-12-28 00:25:29,816][106225] Updated weights for policy 1, policy_version 721484 (0.0007) [2023-12-28 00:25:29,877][106225] Updated weights for policy 1, policy_version 721494 (0.0009) [2023-12-28 00:25:29,940][106225] Updated weights for policy 1, policy_version 721504 (0.0008) [2023-12-28 00:25:30,036][106226] Updated weights for policy 0, policy_version 719577 (0.0007) [2023-12-28 00:25:30,084][106226] Updated weights for policy 0, policy_version 719587 (0.0009) [2023-12-28 00:25:30,132][106226] Updated weights for policy 0, policy_version 719597 (0.0008) [2023-12-28 00:25:30,190][106226] Updated weights for policy 0, policy_version 719607 (0.0008) [2023-12-28 00:25:30,640][106225] Updated weights for policy 1, policy_version 721514 (0.0009) [2023-12-28 00:25:30,690][106225] Updated weights for policy 1, policy_version 721524 (0.0008) [2023-12-28 00:25:30,740][106225] Updated weights for policy 1, policy_version 721534 (0.0009) [2023-12-28 00:25:30,790][106225] Updated weights for policy 1, policy_version 721544 (0.0009) [2023-12-28 00:25:30,877][106226] Updated weights for policy 0, policy_version 719617 (0.0008) [2023-12-28 00:25:30,938][106226] Updated weights for policy 0, policy_version 719627 (0.0008) [2023-12-28 00:25:30,998][106226] Updated weights for policy 0, policy_version 719637 (0.0008) [2023-12-28 00:25:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 369033216. Throughput: 0: 9942.5, 1: 9921.2. Samples: 369020844. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:31,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.458')] [2023-12-28 00:25:31,625][106225] Updated weights for policy 1, policy_version 721554 (0.0008) [2023-12-28 00:25:31,682][106225] Updated weights for policy 1, policy_version 721564 (0.0007) [2023-12-28 00:25:31,747][106225] Updated weights for policy 1, policy_version 721574 (0.0007) [2023-12-28 00:25:31,765][106226] Updated weights for policy 0, policy_version 719647 (0.0008) [2023-12-28 00:25:31,834][106226] Updated weights for policy 0, policy_version 719657 (0.0006) [2023-12-28 00:25:31,899][106226] Updated weights for policy 0, policy_version 719667 (0.0006) [2023-12-28 00:25:32,495][106225] Updated weights for policy 1, policy_version 721584 (0.0006) [2023-12-28 00:25:32,512][106226] Updated weights for policy 0, policy_version 719677 (0.0007) [2023-12-28 00:25:32,546][106225] Updated weights for policy 1, policy_version 721594 (0.0006) [2023-12-28 00:25:32,575][106226] Updated weights for policy 0, policy_version 719687 (0.0007) [2023-12-28 00:25:32,602][106225] Updated weights for policy 1, policy_version 721604 (0.0006) [2023-12-28 00:25:32,637][106226] Updated weights for policy 0, policy_version 719697 (0.0008) [2023-12-28 00:25:33,273][106225] Updated weights for policy 1, policy_version 721614 (0.0007) [2023-12-28 00:25:33,317][106226] Updated weights for policy 0, policy_version 719707 (0.0007) [2023-12-28 00:25:33,322][106225] Updated weights for policy 1, policy_version 721624 (0.0007) [2023-12-28 00:25:33,374][106226] Updated weights for policy 0, policy_version 719717 (0.0008) [2023-12-28 00:25:33,376][106225] Updated weights for policy 1, policy_version 721634 (0.0006) [2023-12-28 00:25:33,427][106226] Updated weights for policy 0, policy_version 719727 (0.0008) [2023-12-28 00:25:33,950][106225] Updated weights for policy 1, policy_version 721644 (0.0006) [2023-12-28 00:25:34,003][106225] Updated weights for policy 1, policy_version 721654 (0.0005) [2023-12-28 00:25:34,059][106225] Updated weights for policy 1, policy_version 721664 (0.0005) [2023-12-28 00:25:34,156][106226] Updated weights for policy 0, policy_version 719737 (0.0008) [2023-12-28 00:25:34,221][106226] Updated weights for policy 0, policy_version 719747 (0.0006) [2023-12-28 00:25:34,278][106226] Updated weights for policy 0, policy_version 719757 (0.0005) [2023-12-28 00:25:34,343][106226] Updated weights for policy 0, policy_version 719767 (0.0007) [2023-12-28 00:25:34,766][106225] Updated weights for policy 1, policy_version 721674 (0.0006) [2023-12-28 00:25:34,824][106225] Updated weights for policy 1, policy_version 721684 (0.0008) [2023-12-28 00:25:34,876][106225] Updated weights for policy 1, policy_version 721694 (0.0008) [2023-12-28 00:25:34,924][106225] Updated weights for policy 1, policy_version 721704 (0.0005) [2023-12-28 00:25:35,002][106226] Updated weights for policy 0, policy_version 719777 (0.0009) [2023-12-28 00:25:35,066][106226] Updated weights for policy 0, policy_version 719787 (0.0007) [2023-12-28 00:25:35,130][106226] Updated weights for policy 0, policy_version 719797 (0.0008) [2023-12-28 00:25:35,515][106225] Updated weights for policy 1, policy_version 721714 (0.0005) [2023-12-28 00:25:35,570][106225] Updated weights for policy 1, policy_version 721724 (0.0005) [2023-12-28 00:25:35,633][106225] Updated weights for policy 1, policy_version 721734 (0.0005) [2023-12-28 00:25:35,835][106226] Updated weights for policy 0, policy_version 719807 (0.0007) [2023-12-28 00:25:35,887][106226] Updated weights for policy 0, policy_version 719817 (0.0005) [2023-12-28 00:25:35,949][106226] Updated weights for policy 0, policy_version 719827 (0.0005) [2023-12-28 00:25:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 369131520. Throughput: 0: 9839.6, 1: 9950.5. Samples: 369142232. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:36,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-5.308')] [2023-12-28 00:25:36,213][106225] Updated weights for policy 1, policy_version 721744 (0.0008) [2023-12-28 00:25:36,279][106225] Updated weights for policy 1, policy_version 721754 (0.0008) [2023-12-28 00:25:36,344][106225] Updated weights for policy 1, policy_version 721764 (0.0005) [2023-12-28 00:25:36,606][106226] Updated weights for policy 0, policy_version 719837 (0.0007) [2023-12-28 00:25:36,668][106226] Updated weights for policy 0, policy_version 719847 (0.0006) [2023-12-28 00:25:36,721][106226] Updated weights for policy 0, policy_version 719857 (0.0005) [2023-12-28 00:25:37,038][106225] Updated weights for policy 1, policy_version 721774 (0.0008) [2023-12-28 00:25:37,092][106225] Updated weights for policy 1, policy_version 721784 (0.0009) [2023-12-28 00:25:37,149][106225] Updated weights for policy 1, policy_version 721794 (0.0010) [2023-12-28 00:25:37,258][106226] Updated weights for policy 0, policy_version 719867 (0.0006) [2023-12-28 00:25:37,305][106226] Updated weights for policy 0, policy_version 719877 (0.0005) [2023-12-28 00:25:37,359][106226] Updated weights for policy 0, policy_version 719887 (0.0006) [2023-12-28 00:25:37,973][106226] Updated weights for policy 0, policy_version 719897 (0.0009) [2023-12-28 00:25:37,975][106225] Updated weights for policy 1, policy_version 721804 (0.0007) [2023-12-28 00:25:38,024][106226] Updated weights for policy 0, policy_version 719907 (0.0010) [2023-12-28 00:25:38,037][106225] Updated weights for policy 1, policy_version 721814 (0.0006) [2023-12-28 00:25:38,068][106226] Updated weights for policy 0, policy_version 719917 (0.0009) [2023-12-28 00:25:38,087][106225] Updated weights for policy 1, policy_version 721824 (0.0005) [2023-12-28 00:25:38,125][106226] Updated weights for policy 0, policy_version 719927 (0.0006) [2023-12-28 00:25:38,723][106225] Updated weights for policy 1, policy_version 721834 (0.0006) [2023-12-28 00:25:38,787][106225] Updated weights for policy 1, policy_version 721844 (0.0007) [2023-12-28 00:25:38,851][106225] Updated weights for policy 1, policy_version 721854 (0.0008) [2023-12-28 00:25:38,868][106226] Updated weights for policy 0, policy_version 719937 (0.0011) [2023-12-28 00:25:38,909][106225] Updated weights for policy 1, policy_version 721864 (0.0005) [2023-12-28 00:25:38,926][106226] Updated weights for policy 0, policy_version 719947 (0.0011) [2023-12-28 00:25:38,973][106226] Updated weights for policy 0, policy_version 719957 (0.0010) [2023-12-28 00:25:39,627][106225] Updated weights for policy 1, policy_version 721874 (0.0007) [2023-12-28 00:25:39,687][106225] Updated weights for policy 1, policy_version 721884 (0.0007) [2023-12-28 00:25:39,710][106226] Updated weights for policy 0, policy_version 719967 (0.0011) [2023-12-28 00:25:39,745][106225] Updated weights for policy 1, policy_version 721894 (0.0008) [2023-12-28 00:25:39,770][106226] Updated weights for policy 0, policy_version 719977 (0.0011) [2023-12-28 00:25:39,829][106226] Updated weights for policy 0, policy_version 719987 (0.0010) [2023-12-28 00:25:40,465][106225] Updated weights for policy 1, policy_version 721904 (0.0007) [2023-12-28 00:25:40,529][106225] Updated weights for policy 1, policy_version 721914 (0.0006) [2023-12-28 00:25:40,572][106226] Updated weights for policy 0, policy_version 719997 (0.0010) [2023-12-28 00:25:40,589][106225] Updated weights for policy 1, policy_version 721924 (0.0006) [2023-12-28 00:25:40,633][106226] Updated weights for policy 0, policy_version 720007 (0.0011) [2023-12-28 00:25:40,697][106226] Updated weights for policy 0, policy_version 720017 (0.0011) [2023-12-28 00:25:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 369229824. Throughput: 0: 9887.6, 1: 9964.4. Samples: 369203620. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:41,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-5.091')] [2023-12-28 00:25:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000721928_184852480.pth... [2023-12-28 00:25:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000720024_184377344.pth... [2023-12-28 00:25:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000720776_184557568.pth [2023-12-28 00:25:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000718872_184082432.pth [2023-12-28 00:25:41,255][106225] Updated weights for policy 1, policy_version 721934 (0.0007) [2023-12-28 00:25:41,320][106225] Updated weights for policy 1, policy_version 721944 (0.0008) [2023-12-28 00:25:41,388][106225] Updated weights for policy 1, policy_version 721954 (0.0008) [2023-12-28 00:25:41,467][106226] Updated weights for policy 0, policy_version 720027 (0.0011) [2023-12-28 00:25:41,529][106226] Updated weights for policy 0, policy_version 720037 (0.0011) [2023-12-28 00:25:41,597][106226] Updated weights for policy 0, policy_version 720047 (0.0011) [2023-12-28 00:25:42,176][106225] Updated weights for policy 1, policy_version 721964 (0.0008) [2023-12-28 00:25:42,242][106225] Updated weights for policy 1, policy_version 721974 (0.0008) [2023-12-28 00:25:42,307][106225] Updated weights for policy 1, policy_version 721984 (0.0007) [2023-12-28 00:25:42,349][106226] Updated weights for policy 0, policy_version 720057 (0.0011) [2023-12-28 00:25:42,416][106226] Updated weights for policy 0, policy_version 720067 (0.0007) [2023-12-28 00:25:42,485][106226] Updated weights for policy 0, policy_version 720077 (0.0008) [2023-12-28 00:25:42,548][106226] Updated weights for policy 0, policy_version 720087 (0.0008) [2023-12-28 00:25:43,023][106225] Updated weights for policy 1, policy_version 721994 (0.0008) [2023-12-28 00:25:43,081][106225] Updated weights for policy 1, policy_version 722004 (0.0008) [2023-12-28 00:25:43,143][106225] Updated weights for policy 1, policy_version 722014 (0.0006) [2023-12-28 00:25:43,185][106226] Updated weights for policy 0, policy_version 720097 (0.0008) [2023-12-28 00:25:43,208][106225] Updated weights for policy 1, policy_version 722024 (0.0006) [2023-12-28 00:25:43,255][106226] Updated weights for policy 0, policy_version 720107 (0.0009) [2023-12-28 00:25:43,313][106226] Updated weights for policy 0, policy_version 720117 (0.0009) [2023-12-28 00:25:43,747][106225] Updated weights for policy 1, policy_version 722034 (0.0009) [2023-12-28 00:25:43,802][106225] Updated weights for policy 1, policy_version 722044 (0.0008) [2023-12-28 00:25:43,853][106225] Updated weights for policy 1, policy_version 722054 (0.0008) [2023-12-28 00:25:44,063][106226] Updated weights for policy 0, policy_version 720127 (0.0010) [2023-12-28 00:25:44,121][106226] Updated weights for policy 0, policy_version 720137 (0.0010) [2023-12-28 00:25:44,171][106226] Updated weights for policy 0, policy_version 720147 (0.0010) [2023-12-28 00:25:44,605][106225] Updated weights for policy 1, policy_version 722064 (0.0010) [2023-12-28 00:25:44,652][106225] Updated weights for policy 1, policy_version 722074 (0.0010) [2023-12-28 00:25:44,703][106225] Updated weights for policy 1, policy_version 722084 (0.0010) [2023-12-28 00:25:44,912][106226] Updated weights for policy 0, policy_version 720157 (0.0011) [2023-12-28 00:25:44,979][106226] Updated weights for policy 0, policy_version 720167 (0.0011) [2023-12-28 00:25:45,048][106226] Updated weights for policy 0, policy_version 720177 (0.0011) [2023-12-28 00:25:45,453][106225] Updated weights for policy 1, policy_version 722094 (0.0010) [2023-12-28 00:25:45,514][106225] Updated weights for policy 1, policy_version 722104 (0.0010) [2023-12-28 00:25:45,566][106225] Updated weights for policy 1, policy_version 722114 (0.0011) [2023-12-28 00:25:45,726][106226] Updated weights for policy 0, policy_version 720187 (0.0011) [2023-12-28 00:25:45,780][106226] Updated weights for policy 0, policy_version 720197 (0.0011) [2023-12-28 00:25:45,845][106226] Updated weights for policy 0, policy_version 720207 (0.0010) [2023-12-28 00:25:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 369328128. Throughput: 0: 9912.5, 1: 9923.4. Samples: 369318856. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:46,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-5.480')] [2023-12-28 00:25:46,288][106225] Updated weights for policy 1, policy_version 722124 (0.0010) [2023-12-28 00:25:46,341][106225] Updated weights for policy 1, policy_version 722134 (0.0010) [2023-12-28 00:25:46,394][106225] Updated weights for policy 1, policy_version 722144 (0.0010) [2023-12-28 00:25:46,497][106226] Updated weights for policy 0, policy_version 720217 (0.0007) [2023-12-28 00:25:46,553][106226] Updated weights for policy 0, policy_version 720227 (0.0010) [2023-12-28 00:25:46,606][106226] Updated weights for policy 0, policy_version 720237 (0.0010) [2023-12-28 00:25:46,668][106226] Updated weights for policy 0, policy_version 720247 (0.0010) [2023-12-28 00:25:47,073][106225] Updated weights for policy 1, policy_version 722154 (0.0009) [2023-12-28 00:25:47,124][106225] Updated weights for policy 1, policy_version 722164 (0.0005) [2023-12-28 00:25:47,180][106225] Updated weights for policy 1, policy_version 722174 (0.0006) [2023-12-28 00:25:47,236][106225] Updated weights for policy 1, policy_version 722184 (0.0005) [2023-12-28 00:25:47,367][106226] Updated weights for policy 0, policy_version 720257 (0.0010) [2023-12-28 00:25:47,426][106226] Updated weights for policy 0, policy_version 720267 (0.0010) [2023-12-28 00:25:47,488][106226] Updated weights for policy 0, policy_version 720277 (0.0010) [2023-12-28 00:25:47,904][106225] Updated weights for policy 1, policy_version 722194 (0.0010) [2023-12-28 00:25:47,954][106225] Updated weights for policy 1, policy_version 722204 (0.0010) [2023-12-28 00:25:48,000][106225] Updated weights for policy 1, policy_version 722214 (0.0010) [2023-12-28 00:25:48,187][106226] Updated weights for policy 0, policy_version 720287 (0.0011) [2023-12-28 00:25:48,253][106226] Updated weights for policy 0, policy_version 720297 (0.0010) [2023-12-28 00:25:48,309][106226] Updated weights for policy 0, policy_version 720307 (0.0010) [2023-12-28 00:25:48,699][106225] Updated weights for policy 1, policy_version 722224 (0.0010) [2023-12-28 00:25:48,756][106225] Updated weights for policy 1, policy_version 722234 (0.0009) [2023-12-28 00:25:48,806][106225] Updated weights for policy 1, policy_version 722244 (0.0010) [2023-12-28 00:25:49,019][106226] Updated weights for policy 0, policy_version 720317 (0.0009) [2023-12-28 00:25:49,073][106226] Updated weights for policy 0, policy_version 720327 (0.0007) [2023-12-28 00:25:49,134][106226] Updated weights for policy 0, policy_version 720337 (0.0007) [2023-12-28 00:25:49,576][106225] Updated weights for policy 1, policy_version 722254 (0.0010) [2023-12-28 00:25:49,637][106225] Updated weights for policy 1, policy_version 722264 (0.0010) [2023-12-28 00:25:49,702][106225] Updated weights for policy 1, policy_version 722274 (0.0010) [2023-12-28 00:25:49,919][106226] Updated weights for policy 0, policy_version 720347 (0.0007) [2023-12-28 00:25:49,987][106226] Updated weights for policy 0, policy_version 720357 (0.0011) [2023-12-28 00:25:50,050][106226] Updated weights for policy 0, policy_version 720367 (0.0010) [2023-12-28 00:25:50,450][106225] Updated weights for policy 1, policy_version 722284 (0.0010) [2023-12-28 00:25:50,497][106225] Updated weights for policy 1, policy_version 722294 (0.0010) [2023-12-28 00:25:50,548][106225] Updated weights for policy 1, policy_version 722304 (0.0010) [2023-12-28 00:25:50,783][106226] Updated weights for policy 0, policy_version 720377 (0.0011) [2023-12-28 00:25:50,854][106226] Updated weights for policy 0, policy_version 720387 (0.0008) [2023-12-28 00:25:50,922][106226] Updated weights for policy 0, policy_version 720397 (0.0008) [2023-12-28 00:25:50,977][106226] Updated weights for policy 0, policy_version 720407 (0.0008) [2023-12-28 00:25:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 369426432. Throughput: 0: 9862.0, 1: 9844.0. Samples: 369436260. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:51,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.453')] [2023-12-28 00:25:51,285][106225] Updated weights for policy 1, policy_version 722314 (0.0010) [2023-12-28 00:25:51,350][106225] Updated weights for policy 1, policy_version 722324 (0.0010) [2023-12-28 00:25:51,423][106225] Updated weights for policy 1, policy_version 722334 (0.0009) [2023-12-28 00:25:51,486][106225] Updated weights for policy 1, policy_version 722344 (0.0009) [2023-12-28 00:25:51,678][106226] Updated weights for policy 0, policy_version 720417 (0.0008) [2023-12-28 00:25:51,746][106226] Updated weights for policy 0, policy_version 720427 (0.0011) [2023-12-28 00:25:51,805][106226] Updated weights for policy 0, policy_version 720437 (0.0008) [2023-12-28 00:25:52,255][106225] Updated weights for policy 1, policy_version 722354 (0.0009) [2023-12-28 00:25:52,321][106225] Updated weights for policy 1, policy_version 722364 (0.0009) [2023-12-28 00:25:52,390][106225] Updated weights for policy 1, policy_version 722374 (0.0008) [2023-12-28 00:25:52,550][106226] Updated weights for policy 0, policy_version 720447 (0.0009) [2023-12-28 00:25:52,607][106226] Updated weights for policy 0, policy_version 720457 (0.0008) [2023-12-28 00:25:52,673][106226] Updated weights for policy 0, policy_version 720467 (0.0009) [2023-12-28 00:25:53,088][106225] Updated weights for policy 1, policy_version 722384 (0.0008) [2023-12-28 00:25:53,140][106225] Updated weights for policy 1, policy_version 722394 (0.0009) [2023-12-28 00:25:53,189][106225] Updated weights for policy 1, policy_version 722404 (0.0008) [2023-12-28 00:25:53,353][106226] Updated weights for policy 0, policy_version 720477 (0.0008) [2023-12-28 00:25:53,401][106226] Updated weights for policy 0, policy_version 720487 (0.0008) [2023-12-28 00:25:53,454][106226] Updated weights for policy 0, policy_version 720497 (0.0008) [2023-12-28 00:25:53,948][106225] Updated weights for policy 1, policy_version 722414 (0.0009) [2023-12-28 00:25:54,001][106225] Updated weights for policy 1, policy_version 722424 (0.0008) [2023-12-28 00:25:54,052][106225] Updated weights for policy 1, policy_version 722434 (0.0008) [2023-12-28 00:25:54,163][106226] Updated weights for policy 0, policy_version 720507 (0.0008) [2023-12-28 00:25:54,221][106226] Updated weights for policy 0, policy_version 720517 (0.0007) [2023-12-28 00:25:54,289][106226] Updated weights for policy 0, policy_version 720527 (0.0007) [2023-12-28 00:25:54,805][106225] Updated weights for policy 1, policy_version 722444 (0.0008) [2023-12-28 00:25:54,863][106225] Updated weights for policy 1, policy_version 722454 (0.0008) [2023-12-28 00:25:54,918][106225] Updated weights for policy 1, policy_version 722464 (0.0008) [2023-12-28 00:25:54,925][106226] Updated weights for policy 0, policy_version 720537 (0.0007) [2023-12-28 00:25:54,976][106226] Updated weights for policy 0, policy_version 720547 (0.0006) [2023-12-28 00:25:55,030][106226] Updated weights for policy 0, policy_version 720557 (0.0008) [2023-12-28 00:25:55,088][106226] Updated weights for policy 0, policy_version 720567 (0.0008) [2023-12-28 00:25:55,645][106225] Updated weights for policy 1, policy_version 722474 (0.0008) [2023-12-28 00:25:55,698][106226] Updated weights for policy 0, policy_version 720577 (0.0006) [2023-12-28 00:25:55,715][106225] Updated weights for policy 1, policy_version 722484 (0.0010) [2023-12-28 00:25:55,762][106226] Updated weights for policy 0, policy_version 720587 (0.0005) [2023-12-28 00:25:55,769][106225] Updated weights for policy 1, policy_version 722494 (0.0010) [2023-12-28 00:25:55,821][106225] Updated weights for policy 1, policy_version 722504 (0.0006) [2023-12-28 00:25:55,827][106226] Updated weights for policy 0, policy_version 720597 (0.0006) [2023-12-28 00:25:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 369524736. Throughput: 0: 9834.8, 1: 9797.8. Samples: 369493388. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:25:56,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.417')] [2023-12-28 00:25:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000722504_184999936.pth... [2023-12-28 00:25:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000720600_184524800.pth... [2023-12-28 00:25:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000721352_184705024.pth [2023-12-28 00:25:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000719448_184229888.pth [2023-12-28 00:25:56,452][106226] Updated weights for policy 0, policy_version 720607 (0.0007) [2023-12-28 00:25:56,500][106225] Updated weights for policy 1, policy_version 722514 (0.0008) [2023-12-28 00:25:56,509][106226] Updated weights for policy 0, policy_version 720617 (0.0005) [2023-12-28 00:25:56,555][106225] Updated weights for policy 1, policy_version 722524 (0.0007) [2023-12-28 00:25:56,568][106226] Updated weights for policy 0, policy_version 720627 (0.0006) [2023-12-28 00:25:56,616][106225] Updated weights for policy 1, policy_version 722534 (0.0008) [2023-12-28 00:25:57,216][106226] Updated weights for policy 0, policy_version 720637 (0.0006) [2023-12-28 00:25:57,270][106226] Updated weights for policy 0, policy_version 720647 (0.0007) [2023-12-28 00:25:57,294][106225] Updated weights for policy 1, policy_version 722544 (0.0007) [2023-12-28 00:25:57,327][106226] Updated weights for policy 0, policy_version 720657 (0.0007) [2023-12-28 00:25:57,348][106225] Updated weights for policy 1, policy_version 722554 (0.0005) [2023-12-28 00:25:57,394][106225] Updated weights for policy 1, policy_version 722564 (0.0005) [2023-12-28 00:25:57,984][106226] Updated weights for policy 0, policy_version 720667 (0.0009) [2023-12-28 00:25:58,035][106226] Updated weights for policy 0, policy_version 720677 (0.0006) [2023-12-28 00:25:58,035][106225] Updated weights for policy 1, policy_version 722574 (0.0007) [2023-12-28 00:25:58,081][106225] Updated weights for policy 1, policy_version 722584 (0.0008) [2023-12-28 00:25:58,087][106226] Updated weights for policy 0, policy_version 720687 (0.0005) [2023-12-28 00:25:58,126][106225] Updated weights for policy 1, policy_version 722594 (0.0008) [2023-12-28 00:25:58,833][106226] Updated weights for policy 0, policy_version 720697 (0.0010) [2023-12-28 00:25:58,902][106226] Updated weights for policy 0, policy_version 720707 (0.0008) [2023-12-28 00:25:58,973][106226] Updated weights for policy 0, policy_version 720717 (0.0009) [2023-12-28 00:25:58,975][106225] Updated weights for policy 1, policy_version 722604 (0.0006) [2023-12-28 00:25:59,028][106225] Updated weights for policy 1, policy_version 722614 (0.0006) [2023-12-28 00:25:59,041][106226] Updated weights for policy 0, policy_version 720727 (0.0008) [2023-12-28 00:25:59,095][106225] Updated weights for policy 1, policy_version 722624 (0.0008) [2023-12-28 00:25:59,773][106226] Updated weights for policy 0, policy_version 720737 (0.0006) [2023-12-28 00:25:59,807][106225] Updated weights for policy 1, policy_version 722634 (0.0009) [2023-12-28 00:25:59,843][106226] Updated weights for policy 0, policy_version 720747 (0.0007) [2023-12-28 00:25:59,871][106225] Updated weights for policy 1, policy_version 722644 (0.0010) [2023-12-28 00:25:59,906][106226] Updated weights for policy 0, policy_version 720757 (0.0009) [2023-12-28 00:25:59,932][106225] Updated weights for policy 1, policy_version 722654 (0.0011) [2023-12-28 00:25:59,987][106225] Updated weights for policy 1, policy_version 722664 (0.0010) [2023-12-28 00:26:00,603][106226] Updated weights for policy 0, policy_version 720767 (0.0008) [2023-12-28 00:26:00,666][106226] Updated weights for policy 0, policy_version 720777 (0.0006) [2023-12-28 00:26:00,695][106225] Updated weights for policy 1, policy_version 722674 (0.0008) [2023-12-28 00:26:00,723][106226] Updated weights for policy 0, policy_version 720787 (0.0005) [2023-12-28 00:26:00,744][106225] Updated weights for policy 1, policy_version 722684 (0.0008) [2023-12-28 00:26:00,791][106225] Updated weights for policy 1, policy_version 722694 (0.0009) [2023-12-28 00:26:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 369623040. Throughput: 0: 9898.5, 1: 9808.3. Samples: 369612660. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:01,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.389')] [2023-12-28 00:26:01,330][106226] Updated weights for policy 0, policy_version 720797 (0.0007) [2023-12-28 00:26:01,406][106226] Updated weights for policy 0, policy_version 720807 (0.0008) [2023-12-28 00:26:01,468][106226] Updated weights for policy 0, policy_version 720817 (0.0009) [2023-12-28 00:26:01,522][106225] Updated weights for policy 1, policy_version 722704 (0.0008) [2023-12-28 00:26:01,584][106225] Updated weights for policy 1, policy_version 722714 (0.0009) [2023-12-28 00:26:01,655][106225] Updated weights for policy 1, policy_version 722724 (0.0008) [2023-12-28 00:26:02,184][106226] Updated weights for policy 0, policy_version 720827 (0.0008) [2023-12-28 00:26:02,251][106226] Updated weights for policy 0, policy_version 720837 (0.0010) [2023-12-28 00:26:02,313][106226] Updated weights for policy 0, policy_version 720847 (0.0008) [2023-12-28 00:26:02,395][106225] Updated weights for policy 1, policy_version 722734 (0.0008) [2023-12-28 00:26:02,459][106225] Updated weights for policy 1, policy_version 722744 (0.0009) [2023-12-28 00:26:02,520][106225] Updated weights for policy 1, policy_version 722754 (0.0009) [2023-12-28 00:26:03,010][106226] Updated weights for policy 0, policy_version 720857 (0.0010) [2023-12-28 00:26:03,063][106226] Updated weights for policy 0, policy_version 720867 (0.0009) [2023-12-28 00:26:03,115][106226] Updated weights for policy 0, policy_version 720877 (0.0008) [2023-12-28 00:26:03,165][106225] Updated weights for policy 1, policy_version 722764 (0.0007) [2023-12-28 00:26:03,171][106226] Updated weights for policy 0, policy_version 720887 (0.0008) [2023-12-28 00:26:03,215][106225] Updated weights for policy 1, policy_version 722774 (0.0005) [2023-12-28 00:26:03,264][106225] Updated weights for policy 1, policy_version 722784 (0.0005) [2023-12-28 00:26:03,789][106226] Updated weights for policy 0, policy_version 720897 (0.0006) [2023-12-28 00:26:03,847][106226] Updated weights for policy 0, policy_version 720907 (0.0007) [2023-12-28 00:26:03,865][106225] Updated weights for policy 1, policy_version 722794 (0.0006) [2023-12-28 00:26:03,914][106226] Updated weights for policy 0, policy_version 720917 (0.0008) [2023-12-28 00:26:03,932][106225] Updated weights for policy 1, policy_version 722804 (0.0006) [2023-12-28 00:26:03,997][106225] Updated weights for policy 1, policy_version 722814 (0.0008) [2023-12-28 00:26:04,067][106225] Updated weights for policy 1, policy_version 722824 (0.0006) [2023-12-28 00:26:04,580][106226] Updated weights for policy 0, policy_version 720927 (0.0008) [2023-12-28 00:26:04,636][106226] Updated weights for policy 0, policy_version 720937 (0.0008) [2023-12-28 00:26:04,689][106226] Updated weights for policy 0, policy_version 720947 (0.0006) [2023-12-28 00:26:04,691][106225] Updated weights for policy 1, policy_version 722834 (0.0007) [2023-12-28 00:26:04,742][106225] Updated weights for policy 1, policy_version 722844 (0.0008) [2023-12-28 00:26:04,799][106225] Updated weights for policy 1, policy_version 722854 (0.0009) [2023-12-28 00:26:05,343][106226] Updated weights for policy 0, policy_version 720957 (0.0006) [2023-12-28 00:26:05,403][106226] Updated weights for policy 0, policy_version 720967 (0.0005) [2023-12-28 00:26:05,462][106226] Updated weights for policy 0, policy_version 720977 (0.0005) [2023-12-28 00:26:05,586][106225] Updated weights for policy 1, policy_version 722864 (0.0009) [2023-12-28 00:26:05,634][106225] Updated weights for policy 1, policy_version 722874 (0.0009) [2023-12-28 00:26:05,692][106225] Updated weights for policy 1, policy_version 722884 (0.0010) [2023-12-28 00:26:05,970][106226] Updated weights for policy 0, policy_version 720987 (0.0006) [2023-12-28 00:26:06,017][106226] Updated weights for policy 0, policy_version 720997 (0.0005) [2023-12-28 00:26:06,071][106226] Updated weights for policy 0, policy_version 721007 (0.0005) [2023-12-28 00:26:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 369729536. Throughput: 0: 10011.0, 1: 9755.5. Samples: 369735808. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:06,176][105115] Avg episode reward: [(0, '-4.680'), (1, '-5.591')] [2023-12-28 00:26:06,462][106225] Updated weights for policy 1, policy_version 722894 (0.0006) [2023-12-28 00:26:06,518][106225] Updated weights for policy 1, policy_version 722904 (0.0005) [2023-12-28 00:26:06,585][106225] Updated weights for policy 1, policy_version 722914 (0.0006) [2023-12-28 00:26:06,776][106226] Updated weights for policy 0, policy_version 721017 (0.0007) [2023-12-28 00:26:06,845][106226] Updated weights for policy 0, policy_version 721027 (0.0008) [2023-12-28 00:26:06,905][106226] Updated weights for policy 0, policy_version 721037 (0.0005) [2023-12-28 00:26:06,970][106226] Updated weights for policy 0, policy_version 721047 (0.0008) [2023-12-28 00:26:07,175][106225] Updated weights for policy 1, policy_version 722924 (0.0007) [2023-12-28 00:26:07,234][106225] Updated weights for policy 1, policy_version 722934 (0.0009) [2023-12-28 00:26:07,298][106225] Updated weights for policy 1, policy_version 722944 (0.0006) [2023-12-28 00:26:07,679][106226] Updated weights for policy 0, policy_version 721057 (0.0007) [2023-12-28 00:26:07,742][106226] Updated weights for policy 0, policy_version 721067 (0.0009) [2023-12-28 00:26:07,797][106226] Updated weights for policy 0, policy_version 721077 (0.0007) [2023-12-28 00:26:07,894][106225] Updated weights for policy 1, policy_version 722954 (0.0006) [2023-12-28 00:26:07,956][106225] Updated weights for policy 1, policy_version 722964 (0.0008) [2023-12-28 00:26:08,015][106225] Updated weights for policy 1, policy_version 722974 (0.0008) [2023-12-28 00:26:08,072][106225] Updated weights for policy 1, policy_version 722984 (0.0008) [2023-12-28 00:26:08,576][106226] Updated weights for policy 0, policy_version 721087 (0.0007) [2023-12-28 00:26:08,634][106226] Updated weights for policy 0, policy_version 721097 (0.0008) [2023-12-28 00:26:08,694][106226] Updated weights for policy 0, policy_version 721107 (0.0008) [2023-12-28 00:26:08,744][106225] Updated weights for policy 1, policy_version 722994 (0.0006) [2023-12-28 00:26:08,812][106225] Updated weights for policy 1, policy_version 723004 (0.0006) [2023-12-28 00:26:08,877][106225] Updated weights for policy 1, policy_version 723014 (0.0007) [2023-12-28 00:26:09,488][106226] Updated weights for policy 0, policy_version 721117 (0.0008) [2023-12-28 00:26:09,509][106225] Updated weights for policy 1, policy_version 723024 (0.0009) [2023-12-28 00:26:09,548][106226] Updated weights for policy 0, policy_version 721127 (0.0007) [2023-12-28 00:26:09,562][106225] Updated weights for policy 1, policy_version 723034 (0.0006) [2023-12-28 00:26:09,608][106226] Updated weights for policy 0, policy_version 721137 (0.0007) [2023-12-28 00:26:09,614][106225] Updated weights for policy 1, policy_version 723044 (0.0006) [2023-12-28 00:26:10,274][106225] Updated weights for policy 1, policy_version 723054 (0.0007) [2023-12-28 00:26:10,336][106225] Updated weights for policy 1, policy_version 723064 (0.0008) [2023-12-28 00:26:10,373][106226] Updated weights for policy 0, policy_version 721147 (0.0008) [2023-12-28 00:26:10,402][106225] Updated weights for policy 1, policy_version 723074 (0.0008) [2023-12-28 00:26:10,445][106226] Updated weights for policy 0, policy_version 721157 (0.0011) [2023-12-28 00:26:10,510][106226] Updated weights for policy 0, policy_version 721167 (0.0011) [2023-12-28 00:26:11,137][106225] Updated weights for policy 1, policy_version 723084 (0.0008) [2023-12-28 00:26:11,146][106226] Updated weights for policy 0, policy_version 721177 (0.0006) [2023-12-28 00:26:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 369819648. Throughput: 0: 9981.7, 1: 9850.8. Samples: 369796084. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:11,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.363')] [2023-12-28 00:26:11,204][106225] Updated weights for policy 1, policy_version 723094 (0.0010) [2023-12-28 00:26:11,216][106226] Updated weights for policy 0, policy_version 721187 (0.0008) [2023-12-28 00:26:11,264][106225] Updated weights for policy 1, policy_version 723104 (0.0011) [2023-12-28 00:26:11,280][106226] Updated weights for policy 0, policy_version 721197 (0.0009) [2023-12-28 00:26:11,319][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000723112_185155584.pth... [2023-12-28 00:26:11,326][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000721928_184852480.pth [2023-12-28 00:26:11,347][106226] Updated weights for policy 0, policy_version 721207 (0.0008) [2023-12-28 00:26:11,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000721208_184680448.pth... [2023-12-28 00:26:11,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000720024_184377344.pth [2023-12-28 00:26:12,079][106225] Updated weights for policy 1, policy_version 723114 (0.0011) [2023-12-28 00:26:12,130][106226] Updated weights for policy 0, policy_version 721217 (0.0010) [2023-12-28 00:26:12,143][106225] Updated weights for policy 1, policy_version 723124 (0.0010) [2023-12-28 00:26:12,188][106226] Updated weights for policy 0, policy_version 721227 (0.0011) [2023-12-28 00:26:12,204][106225] Updated weights for policy 1, policy_version 723134 (0.0010) [2023-12-28 00:26:12,246][106226] Updated weights for policy 0, policy_version 721237 (0.0010) [2023-12-28 00:26:12,270][106225] Updated weights for policy 1, policy_version 723144 (0.0011) [2023-12-28 00:26:12,961][106226] Updated weights for policy 0, policy_version 721247 (0.0011) [2023-12-28 00:26:12,963][106225] Updated weights for policy 1, policy_version 723154 (0.0008) [2023-12-28 00:26:13,029][106226] Updated weights for policy 0, policy_version 721257 (0.0010) [2023-12-28 00:26:13,030][106225] Updated weights for policy 1, policy_version 723164 (0.0008) [2023-12-28 00:26:13,089][106225] Updated weights for policy 1, policy_version 723174 (0.0007) [2023-12-28 00:26:13,096][106226] Updated weights for policy 0, policy_version 721267 (0.0010) [2023-12-28 00:26:13,719][106225] Updated weights for policy 1, policy_version 723184 (0.0010) [2023-12-28 00:26:13,766][106225] Updated weights for policy 1, policy_version 723194 (0.0010) [2023-12-28 00:26:13,804][106226] Updated weights for policy 0, policy_version 721277 (0.0008) [2023-12-28 00:26:13,824][106225] Updated weights for policy 1, policy_version 723204 (0.0010) [2023-12-28 00:26:13,866][106226] Updated weights for policy 0, policy_version 721287 (0.0009) [2023-12-28 00:26:13,922][106226] Updated weights for policy 0, policy_version 721297 (0.0007) [2023-12-28 00:26:14,508][106225] Updated weights for policy 1, policy_version 723214 (0.0010) [2023-12-28 00:26:14,561][106225] Updated weights for policy 1, policy_version 723224 (0.0010) [2023-12-28 00:26:14,610][106225] Updated weights for policy 1, policy_version 723234 (0.0010) [2023-12-28 00:26:14,657][106226] Updated weights for policy 0, policy_version 721307 (0.0007) [2023-12-28 00:26:14,719][106226] Updated weights for policy 0, policy_version 721317 (0.0005) [2023-12-28 00:26:14,788][106226] Updated weights for policy 0, policy_version 721327 (0.0007) [2023-12-28 00:26:15,315][106225] Updated weights for policy 1, policy_version 723244 (0.0010) [2023-12-28 00:26:15,365][106225] Updated weights for policy 1, policy_version 723254 (0.0010) [2023-12-28 00:26:15,412][106225] Updated weights for policy 1, policy_version 723264 (0.0008) [2023-12-28 00:26:15,426][106226] Updated weights for policy 0, policy_version 721337 (0.0007) [2023-12-28 00:26:15,492][106226] Updated weights for policy 0, policy_version 721347 (0.0006) [2023-12-28 00:26:15,555][106226] Updated weights for policy 0, policy_version 721357 (0.0006) [2023-12-28 00:26:15,613][106226] Updated weights for policy 0, policy_version 721367 (0.0006) [2023-12-28 00:26:16,110][106226] Updated weights for policy 0, policy_version 721377 (0.0010) [2023-12-28 00:26:16,120][106225] Updated weights for policy 1, policy_version 723274 (0.0007) [2023-12-28 00:26:16,168][106226] Updated weights for policy 0, policy_version 721387 (0.0010) [2023-12-28 00:26:16,174][106225] Updated weights for policy 1, policy_version 723284 (0.0010) [2023-12-28 00:26:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 369917952. Throughput: 0: 9910.1, 1: 9883.3. Samples: 369911548. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:16,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-5.395')] [2023-12-28 00:26:16,221][106225] Updated weights for policy 1, policy_version 723294 (0.0007) [2023-12-28 00:26:16,227][106226] Updated weights for policy 0, policy_version 721397 (0.0007) [2023-12-28 00:26:16,266][106225] Updated weights for policy 1, policy_version 723304 (0.0009) [2023-12-28 00:26:16,794][106226] Updated weights for policy 0, policy_version 721407 (0.0007) [2023-12-28 00:26:16,843][106226] Updated weights for policy 0, policy_version 721417 (0.0005) [2023-12-28 00:26:16,898][106226] Updated weights for policy 0, policy_version 721427 (0.0005) [2023-12-28 00:26:17,020][106225] Updated weights for policy 1, policy_version 723314 (0.0010) [2023-12-28 00:26:17,081][106225] Updated weights for policy 1, policy_version 723324 (0.0010) [2023-12-28 00:26:17,147][106225] Updated weights for policy 1, policy_version 723334 (0.0009) [2023-12-28 00:26:17,582][106226] Updated weights for policy 0, policy_version 721437 (0.0005) [2023-12-28 00:26:17,643][106226] Updated weights for policy 0, policy_version 721447 (0.0005) [2023-12-28 00:26:17,701][106226] Updated weights for policy 0, policy_version 721457 (0.0008) [2023-12-28 00:26:17,832][106225] Updated weights for policy 1, policy_version 723344 (0.0010) [2023-12-28 00:26:17,881][106225] Updated weights for policy 1, policy_version 723354 (0.0010) [2023-12-28 00:26:17,930][106225] Updated weights for policy 1, policy_version 723364 (0.0010) [2023-12-28 00:26:18,361][106226] Updated weights for policy 0, policy_version 721467 (0.0010) [2023-12-28 00:26:18,425][106226] Updated weights for policy 0, policy_version 721477 (0.0008) [2023-12-28 00:26:18,472][106226] Updated weights for policy 0, policy_version 721487 (0.0005) [2023-12-28 00:26:18,620][106225] Updated weights for policy 1, policy_version 723374 (0.0010) [2023-12-28 00:26:18,683][106225] Updated weights for policy 1, policy_version 723384 (0.0011) [2023-12-28 00:26:18,738][106225] Updated weights for policy 1, policy_version 723394 (0.0009) [2023-12-28 00:26:19,184][106226] Updated weights for policy 0, policy_version 721497 (0.0007) [2023-12-28 00:26:19,258][106226] Updated weights for policy 0, policy_version 721507 (0.0009) [2023-12-28 00:26:19,323][106226] Updated weights for policy 0, policy_version 721517 (0.0008) [2023-12-28 00:26:19,381][106225] Updated weights for policy 1, policy_version 723404 (0.0008) [2023-12-28 00:26:19,391][106226] Updated weights for policy 0, policy_version 721527 (0.0009) [2023-12-28 00:26:19,438][106225] Updated weights for policy 1, policy_version 723414 (0.0007) [2023-12-28 00:26:19,498][106225] Updated weights for policy 1, policy_version 723424 (0.0007) [2023-12-28 00:26:20,113][106226] Updated weights for policy 0, policy_version 721537 (0.0007) [2023-12-28 00:26:20,169][106226] Updated weights for policy 0, policy_version 721547 (0.0008) [2023-12-28 00:26:20,221][106226] Updated weights for policy 0, policy_version 721557 (0.0008) [2023-12-28 00:26:20,223][106225] Updated weights for policy 1, policy_version 723434 (0.0007) [2023-12-28 00:26:20,284][106225] Updated weights for policy 1, policy_version 723444 (0.0010) [2023-12-28 00:26:20,348][106225] Updated weights for policy 1, policy_version 723454 (0.0010) [2023-12-28 00:26:20,403][106225] Updated weights for policy 1, policy_version 723464 (0.0010) [2023-12-28 00:26:21,049][106226] Updated weights for policy 0, policy_version 721567 (0.0007) [2023-12-28 00:26:21,080][106225] Updated weights for policy 1, policy_version 723474 (0.0009) [2023-12-28 00:26:21,121][106226] Updated weights for policy 0, policy_version 721577 (0.0008) [2023-12-28 00:26:21,151][106225] Updated weights for policy 1, policy_version 723484 (0.0007) [2023-12-28 00:26:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 370016256. Throughput: 0: 9940.3, 1: 9861.6. Samples: 370033320. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:21,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.083')] [2023-12-28 00:26:21,189][106226] Updated weights for policy 0, policy_version 721587 (0.0007) [2023-12-28 00:26:21,215][106225] Updated weights for policy 1, policy_version 723494 (0.0009) [2023-12-28 00:26:21,949][106226] Updated weights for policy 0, policy_version 721597 (0.0007) [2023-12-28 00:26:22,008][106226] Updated weights for policy 0, policy_version 721607 (0.0008) [2023-12-28 00:26:22,024][106225] Updated weights for policy 1, policy_version 723504 (0.0007) [2023-12-28 00:26:22,077][106226] Updated weights for policy 0, policy_version 721617 (0.0008) [2023-12-28 00:26:22,093][106225] Updated weights for policy 1, policy_version 723514 (0.0008) [2023-12-28 00:26:22,151][106225] Updated weights for policy 1, policy_version 723524 (0.0007) [2023-12-28 00:26:22,845][106225] Updated weights for policy 1, policy_version 723534 (0.0007) [2023-12-28 00:26:22,851][106226] Updated weights for policy 0, policy_version 721627 (0.0009) [2023-12-28 00:26:22,904][106225] Updated weights for policy 1, policy_version 723544 (0.0006) [2023-12-28 00:26:22,911][106226] Updated weights for policy 0, policy_version 721637 (0.0007) [2023-12-28 00:26:22,971][106226] Updated weights for policy 0, policy_version 721647 (0.0009) [2023-12-28 00:26:22,978][106225] Updated weights for policy 1, policy_version 723554 (0.0006) [2023-12-28 00:26:23,604][106225] Updated weights for policy 1, policy_version 723564 (0.0007) [2023-12-28 00:26:23,665][106225] Updated weights for policy 1, policy_version 723574 (0.0008) [2023-12-28 00:26:23,715][106226] Updated weights for policy 0, policy_version 721657 (0.0008) [2023-12-28 00:26:23,721][106225] Updated weights for policy 1, policy_version 723584 (0.0008) [2023-12-28 00:26:23,771][106226] Updated weights for policy 0, policy_version 721667 (0.0008) [2023-12-28 00:26:23,842][106226] Updated weights for policy 0, policy_version 721677 (0.0008) [2023-12-28 00:26:23,906][106226] Updated weights for policy 0, policy_version 721687 (0.0008) [2023-12-28 00:26:24,431][106225] Updated weights for policy 1, policy_version 723594 (0.0006) [2023-12-28 00:26:24,492][106225] Updated weights for policy 1, policy_version 723604 (0.0008) [2023-12-28 00:26:24,546][106225] Updated weights for policy 1, policy_version 723614 (0.0008) [2023-12-28 00:26:24,591][106226] Updated weights for policy 0, policy_version 721697 (0.0008) [2023-12-28 00:26:24,600][106225] Updated weights for policy 1, policy_version 723624 (0.0006) [2023-12-28 00:26:24,653][106226] Updated weights for policy 0, policy_version 721707 (0.0008) [2023-12-28 00:26:24,722][106226] Updated weights for policy 0, policy_version 721717 (0.0005) [2023-12-28 00:26:25,286][106226] Updated weights for policy 0, policy_version 721727 (0.0009) [2023-12-28 00:26:25,341][106225] Updated weights for policy 1, policy_version 723634 (0.0005) [2023-12-28 00:26:25,347][106226] Updated weights for policy 0, policy_version 721737 (0.0008) [2023-12-28 00:26:25,390][106225] Updated weights for policy 1, policy_version 723644 (0.0006) [2023-12-28 00:26:25,413][106226] Updated weights for policy 0, policy_version 721747 (0.0008) [2023-12-28 00:26:25,441][106225] Updated weights for policy 1, policy_version 723654 (0.0008) [2023-12-28 00:26:26,010][106226] Updated weights for policy 0, policy_version 721757 (0.0007) [2023-12-28 00:26:26,061][106226] Updated weights for policy 0, policy_version 721767 (0.0007) [2023-12-28 00:26:26,121][106226] Updated weights for policy 0, policy_version 721777 (0.0005) [2023-12-28 00:26:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 370122752. Throughput: 0: 9845.3, 1: 9852.4. Samples: 370090016. Policy #0 lag: (min: 31.0, avg: 39.6, max: 63.0) [2023-12-28 00:26:26,176][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.314')] [2023-12-28 00:26:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000721784_184827904.pth... [2023-12-28 00:26:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000720600_184524800.pth [2023-12-28 00:26:26,220][106225] Updated weights for policy 1, policy_version 723664 (0.0007) [2023-12-28 00:26:26,274][106225] Updated weights for policy 1, policy_version 723674 (0.0009) [2023-12-28 00:26:26,329][106225] Updated weights for policy 1, policy_version 723684 (0.0008) [2023-12-28 00:26:26,345][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000723688_185303040.pth... [2023-12-28 00:26:26,349][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000722504_184999936.pth [2023-12-28 00:26:26,634][106226] Updated weights for policy 0, policy_version 721787 (0.0005) [2023-12-28 00:26:26,689][106226] Updated weights for policy 0, policy_version 721797 (0.0005) [2023-12-28 00:26:26,749][106226] Updated weights for policy 0, policy_version 721807 (0.0005) [2023-12-28 00:26:27,107][106225] Updated weights for policy 1, policy_version 723694 (0.0009) [2023-12-28 00:26:27,156][106225] Updated weights for policy 1, policy_version 723704 (0.0008) [2023-12-28 00:26:27,206][106225] Updated weights for policy 1, policy_version 723714 (0.0009) [2023-12-28 00:26:27,254][106226] Updated weights for policy 0, policy_version 721817 (0.0006) [2023-12-28 00:26:27,308][106226] Updated weights for policy 0, policy_version 721827 (0.0008) [2023-12-28 00:26:27,361][106226] Updated weights for policy 0, policy_version 721837 (0.0009) [2023-12-28 00:26:27,417][106226] Updated weights for policy 0, policy_version 721847 (0.0008) [2023-12-28 00:26:27,915][106225] Updated weights for policy 1, policy_version 723724 (0.0008) [2023-12-28 00:26:27,973][106225] Updated weights for policy 1, policy_version 723734 (0.0008) [2023-12-28 00:26:28,031][106225] Updated weights for policy 1, policy_version 723744 (0.0008) [2023-12-28 00:26:28,159][106226] Updated weights for policy 0, policy_version 721857 (0.0009) [2023-12-28 00:26:28,215][106226] Updated weights for policy 0, policy_version 721867 (0.0007) [2023-12-28 00:26:28,275][106226] Updated weights for policy 0, policy_version 721877 (0.0005) [2023-12-28 00:26:28,687][106225] Updated weights for policy 1, policy_version 723754 (0.0008) [2023-12-28 00:26:28,746][106225] Updated weights for policy 1, policy_version 723764 (0.0007) [2023-12-28 00:26:28,813][106225] Updated weights for policy 1, policy_version 723774 (0.0005) [2023-12-28 00:26:28,877][106225] Updated weights for policy 1, policy_version 723784 (0.0006) [2023-12-28 00:26:28,934][106226] Updated weights for policy 0, policy_version 721887 (0.0008) [2023-12-28 00:26:28,989][106226] Updated weights for policy 0, policy_version 721897 (0.0010) [2023-12-28 00:26:29,042][106226] Updated weights for policy 0, policy_version 721907 (0.0009) [2023-12-28 00:26:29,460][106225] Updated weights for policy 1, policy_version 723794 (0.0008) [2023-12-28 00:26:29,509][106225] Updated weights for policy 1, policy_version 723804 (0.0008) [2023-12-28 00:26:29,556][106225] Updated weights for policy 1, policy_version 723814 (0.0006) [2023-12-28 00:26:29,852][106226] Updated weights for policy 0, policy_version 721917 (0.0008) [2023-12-28 00:26:29,910][106226] Updated weights for policy 0, policy_version 721927 (0.0008) [2023-12-28 00:26:29,981][106226] Updated weights for policy 0, policy_version 721937 (0.0008) [2023-12-28 00:26:30,257][106225] Updated weights for policy 1, policy_version 723824 (0.0008) [2023-12-28 00:26:30,319][106225] Updated weights for policy 1, policy_version 723834 (0.0008) [2023-12-28 00:26:30,385][106225] Updated weights for policy 1, policy_version 723844 (0.0008) [2023-12-28 00:26:30,759][106226] Updated weights for policy 0, policy_version 721947 (0.0009) [2023-12-28 00:26:30,812][106226] Updated weights for policy 0, policy_version 721957 (0.0008) [2023-12-28 00:26:30,863][106226] Updated weights for policy 0, policy_version 721967 (0.0008) [2023-12-28 00:26:30,976][106225] Updated weights for policy 1, policy_version 723854 (0.0007) [2023-12-28 00:26:31,032][106225] Updated weights for policy 1, policy_version 723864 (0.0008) [2023-12-28 00:26:31,101][106225] Updated weights for policy 1, policy_version 723874 (0.0008) [2023-12-28 00:26:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 370229248. Throughput: 0: 10020.8, 1: 9861.8. Samples: 370213572. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:31,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-5.185')] [2023-12-28 00:26:31,596][106226] Updated weights for policy 0, policy_version 721977 (0.0009) [2023-12-28 00:26:31,668][106226] Updated weights for policy 0, policy_version 721987 (0.0009) [2023-12-28 00:26:31,742][106226] Updated weights for policy 0, policy_version 721997 (0.0007) [2023-12-28 00:26:31,795][106226] Updated weights for policy 0, policy_version 722007 (0.0009) [2023-12-28 00:26:31,857][106225] Updated weights for policy 1, policy_version 723884 (0.0007) [2023-12-28 00:26:31,905][106225] Updated weights for policy 1, policy_version 723894 (0.0008) [2023-12-28 00:26:31,963][106225] Updated weights for policy 1, policy_version 723904 (0.0008) [2023-12-28 00:26:32,517][106226] Updated weights for policy 0, policy_version 722017 (0.0010) [2023-12-28 00:26:32,560][106226] Updated weights for policy 0, policy_version 722027 (0.0010) [2023-12-28 00:26:32,607][106226] Updated weights for policy 0, policy_version 722037 (0.0010) [2023-12-28 00:26:32,689][106225] Updated weights for policy 1, policy_version 723914 (0.0006) [2023-12-28 00:26:32,746][106225] Updated weights for policy 1, policy_version 723924 (0.0008) [2023-12-28 00:26:32,808][106225] Updated weights for policy 1, policy_version 723934 (0.0008) [2023-12-28 00:26:32,868][106225] Updated weights for policy 1, policy_version 723944 (0.0006) [2023-12-28 00:26:33,353][106226] Updated weights for policy 0, policy_version 722047 (0.0010) [2023-12-28 00:26:33,399][106226] Updated weights for policy 0, policy_version 722057 (0.0010) [2023-12-28 00:26:33,448][106226] Updated weights for policy 0, policy_version 722067 (0.0010) [2023-12-28 00:26:33,582][106225] Updated weights for policy 1, policy_version 723954 (0.0007) [2023-12-28 00:26:33,634][106225] Updated weights for policy 1, policy_version 723964 (0.0008) [2023-12-28 00:26:33,688][106225] Updated weights for policy 1, policy_version 723974 (0.0007) [2023-12-28 00:26:34,172][106226] Updated weights for policy 0, policy_version 722077 (0.0010) [2023-12-28 00:26:34,241][106226] Updated weights for policy 0, policy_version 722087 (0.0011) [2023-12-28 00:26:34,295][106226] Updated weights for policy 0, policy_version 722097 (0.0010) [2023-12-28 00:26:34,425][106225] Updated weights for policy 1, policy_version 723984 (0.0008) [2023-12-28 00:26:34,484][106225] Updated weights for policy 1, policy_version 723994 (0.0008) [2023-12-28 00:26:34,550][106225] Updated weights for policy 1, policy_version 724004 (0.0008) [2023-12-28 00:26:35,015][106226] Updated weights for policy 0, policy_version 722107 (0.0011) [2023-12-28 00:26:35,064][106226] Updated weights for policy 0, policy_version 722117 (0.0010) [2023-12-28 00:26:35,117][106226] Updated weights for policy 0, policy_version 722127 (0.0010) [2023-12-28 00:26:35,284][106225] Updated weights for policy 1, policy_version 724014 (0.0008) [2023-12-28 00:26:35,340][106225] Updated weights for policy 1, policy_version 724024 (0.0008) [2023-12-28 00:26:35,397][106225] Updated weights for policy 1, policy_version 724034 (0.0008) [2023-12-28 00:26:35,842][106226] Updated weights for policy 0, policy_version 722137 (0.0010) [2023-12-28 00:26:35,894][106226] Updated weights for policy 0, policy_version 722147 (0.0010) [2023-12-28 00:26:35,957][106226] Updated weights for policy 0, policy_version 722157 (0.0010) [2023-12-28 00:26:36,010][106226] Updated weights for policy 0, policy_version 722167 (0.0010) [2023-12-28 00:26:36,117][106225] Updated weights for policy 1, policy_version 724044 (0.0008) [2023-12-28 00:26:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 370319360. Throughput: 0: 9999.1, 1: 9847.6. Samples: 370329360. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:36,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-5.556')] [2023-12-28 00:26:36,180][106225] Updated weights for policy 1, policy_version 724054 (0.0008) [2023-12-28 00:26:36,244][106225] Updated weights for policy 1, policy_version 724064 (0.0008) [2023-12-28 00:26:36,742][106226] Updated weights for policy 0, policy_version 722177 (0.0011) [2023-12-28 00:26:36,796][106226] Updated weights for policy 0, policy_version 722187 (0.0011) [2023-12-28 00:26:36,856][106226] Updated weights for policy 0, policy_version 722197 (0.0010) [2023-12-28 00:26:36,989][106225] Updated weights for policy 1, policy_version 724074 (0.0008) [2023-12-28 00:26:37,050][106225] Updated weights for policy 1, policy_version 724084 (0.0008) [2023-12-28 00:26:37,111][106225] Updated weights for policy 1, policy_version 724094 (0.0005) [2023-12-28 00:26:37,168][106225] Updated weights for policy 1, policy_version 724104 (0.0008) [2023-12-28 00:26:37,541][106226] Updated weights for policy 0, policy_version 722207 (0.0010) [2023-12-28 00:26:37,592][106226] Updated weights for policy 0, policy_version 722217 (0.0009) [2023-12-28 00:26:37,647][106226] Updated weights for policy 0, policy_version 722227 (0.0010) [2023-12-28 00:26:37,779][106225] Updated weights for policy 1, policy_version 724114 (0.0008) [2023-12-28 00:26:37,825][106225] Updated weights for policy 1, policy_version 724124 (0.0010) [2023-12-28 00:26:37,873][106225] Updated weights for policy 1, policy_version 724134 (0.0008) [2023-12-28 00:26:38,435][106226] Updated weights for policy 0, policy_version 722237 (0.0010) [2023-12-28 00:26:38,500][106226] Updated weights for policy 0, policy_version 722247 (0.0011) [2023-12-28 00:26:38,555][106225] Updated weights for policy 1, policy_version 724144 (0.0007) [2023-12-28 00:26:38,559][106226] Updated weights for policy 0, policy_version 722257 (0.0009) [2023-12-28 00:26:38,609][106225] Updated weights for policy 1, policy_version 724154 (0.0008) [2023-12-28 00:26:38,672][106225] Updated weights for policy 1, policy_version 724164 (0.0008) [2023-12-28 00:26:39,227][106226] Updated weights for policy 0, policy_version 722267 (0.0007) [2023-12-28 00:26:39,291][106226] Updated weights for policy 0, policy_version 722277 (0.0009) [2023-12-28 00:26:39,352][106226] Updated weights for policy 0, policy_version 722287 (0.0011) [2023-12-28 00:26:39,451][106225] Updated weights for policy 1, policy_version 724174 (0.0007) [2023-12-28 00:26:39,513][106225] Updated weights for policy 1, policy_version 724184 (0.0008) [2023-12-28 00:26:39,576][106225] Updated weights for policy 1, policy_version 724194 (0.0010) [2023-12-28 00:26:40,108][106226] Updated weights for policy 0, policy_version 722297 (0.0011) [2023-12-28 00:26:40,163][106226] Updated weights for policy 0, policy_version 722307 (0.0011) [2023-12-28 00:26:40,226][106226] Updated weights for policy 0, policy_version 722317 (0.0009) [2023-12-28 00:26:40,293][106226] Updated weights for policy 0, policy_version 722327 (0.0011) [2023-12-28 00:26:40,324][106225] Updated weights for policy 1, policy_version 724204 (0.0008) [2023-12-28 00:26:40,381][106225] Updated weights for policy 1, policy_version 724214 (0.0007) [2023-12-28 00:26:40,431][106225] Updated weights for policy 1, policy_version 724224 (0.0008) [2023-12-28 00:26:40,966][106226] Updated weights for policy 0, policy_version 722337 (0.0006) [2023-12-28 00:26:41,032][106226] Updated weights for policy 0, policy_version 722347 (0.0006) [2023-12-28 00:26:41,088][106225] Updated weights for policy 1, policy_version 724234 (0.0009) [2023-12-28 00:26:41,098][106226] Updated weights for policy 0, policy_version 722357 (0.0009) [2023-12-28 00:26:41,151][106225] Updated weights for policy 1, policy_version 724244 (0.0009) [2023-12-28 00:26:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 370417664. Throughput: 0: 10008.0, 1: 9901.0. Samples: 370389292. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:41,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-5.454')] [2023-12-28 00:26:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000722360_184975360.pth... [2023-12-28 00:26:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000721208_184680448.pth [2023-12-28 00:26:41,218][106225] Updated weights for policy 1, policy_version 724254 (0.0008) [2023-12-28 00:26:41,277][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000724264_185450496.pth... [2023-12-28 00:26:41,279][106225] Updated weights for policy 1, policy_version 724264 (0.0009) [2023-12-28 00:26:41,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000723112_185155584.pth [2023-12-28 00:26:41,766][106226] Updated weights for policy 0, policy_version 722367 (0.0008) [2023-12-28 00:26:41,816][106226] Updated weights for policy 0, policy_version 722377 (0.0007) [2023-12-28 00:26:41,872][106226] Updated weights for policy 0, policy_version 722387 (0.0008) [2023-12-28 00:26:42,088][106225] Updated weights for policy 1, policy_version 724274 (0.0009) [2023-12-28 00:26:42,135][106225] Updated weights for policy 1, policy_version 724284 (0.0009) [2023-12-28 00:26:42,184][106225] Updated weights for policy 1, policy_version 724294 (0.0008) [2023-12-28 00:26:42,676][106226] Updated weights for policy 0, policy_version 722397 (0.0010) [2023-12-28 00:26:42,729][106226] Updated weights for policy 0, policy_version 722407 (0.0009) [2023-12-28 00:26:42,793][106226] Updated weights for policy 0, policy_version 722417 (0.0009) [2023-12-28 00:26:42,889][106225] Updated weights for policy 1, policy_version 724304 (0.0008) [2023-12-28 00:26:42,947][106225] Updated weights for policy 1, policy_version 724314 (0.0009) [2023-12-28 00:26:43,011][106225] Updated weights for policy 1, policy_version 724324 (0.0008) [2023-12-28 00:26:43,388][106226] Updated weights for policy 0, policy_version 722427 (0.0009) [2023-12-28 00:26:43,450][106226] Updated weights for policy 0, policy_version 722437 (0.0005) [2023-12-28 00:26:43,516][106226] Updated weights for policy 0, policy_version 722447 (0.0005) [2023-12-28 00:26:43,815][106225] Updated weights for policy 1, policy_version 724334 (0.0008) [2023-12-28 00:26:43,871][106225] Updated weights for policy 1, policy_version 724344 (0.0007) [2023-12-28 00:26:43,920][106225] Updated weights for policy 1, policy_version 724354 (0.0007) [2023-12-28 00:26:44,140][106226] Updated weights for policy 0, policy_version 722457 (0.0006) [2023-12-28 00:26:44,206][106226] Updated weights for policy 0, policy_version 722467 (0.0010) [2023-12-28 00:26:44,270][106226] Updated weights for policy 0, policy_version 722477 (0.0010) [2023-12-28 00:26:44,341][106226] Updated weights for policy 0, policy_version 722487 (0.0009) [2023-12-28 00:26:44,659][106225] Updated weights for policy 1, policy_version 724364 (0.0007) [2023-12-28 00:26:44,713][106225] Updated weights for policy 1, policy_version 724374 (0.0007) [2023-12-28 00:26:44,763][106225] Updated weights for policy 1, policy_version 724384 (0.0008) [2023-12-28 00:26:45,036][106226] Updated weights for policy 0, policy_version 722497 (0.0008) [2023-12-28 00:26:45,126][106226] Updated weights for policy 0, policy_version 722507 (0.0009) [2023-12-28 00:26:45,202][106226] Updated weights for policy 0, policy_version 722517 (0.0008) [2023-12-28 00:26:45,525][106225] Updated weights for policy 1, policy_version 724394 (0.0008) [2023-12-28 00:26:45,590][106225] Updated weights for policy 1, policy_version 724404 (0.0008) [2023-12-28 00:26:45,643][106225] Updated weights for policy 1, policy_version 724414 (0.0005) [2023-12-28 00:26:45,825][106226] Updated weights for policy 0, policy_version 722527 (0.0009) [2023-12-28 00:26:45,884][106226] Updated weights for policy 0, policy_version 722537 (0.0010) [2023-12-28 00:26:45,954][106226] Updated weights for policy 0, policy_version 722547 (0.0010) [2023-12-28 00:26:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 370515968. Throughput: 0: 9970.6, 1: 9858.7. Samples: 370504976. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:46,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-5.605')] [2023-12-28 00:26:46,290][106225] Updated weights for policy 1, policy_version 724425 (0.0009) [2023-12-28 00:26:46,360][106225] Updated weights for policy 1, policy_version 724435 (0.0005) [2023-12-28 00:26:46,421][106225] Updated weights for policy 1, policy_version 724445 (0.0006) [2023-12-28 00:26:46,470][106225] Updated weights for policy 1, policy_version 724455 (0.0007) [2023-12-28 00:26:46,554][106226] Updated weights for policy 0, policy_version 722557 (0.0008) [2023-12-28 00:26:46,610][106226] Updated weights for policy 0, policy_version 722567 (0.0005) [2023-12-28 00:26:46,668][106226] Updated weights for policy 0, policy_version 722577 (0.0005) [2023-12-28 00:26:47,055][106225] Updated weights for policy 1, policy_version 724465 (0.0008) [2023-12-28 00:26:47,113][106225] Updated weights for policy 1, policy_version 724475 (0.0009) [2023-12-28 00:26:47,165][106225] Updated weights for policy 1, policy_version 724485 (0.0008) [2023-12-28 00:26:47,183][106226] Updated weights for policy 0, policy_version 722587 (0.0005) [2023-12-28 00:26:47,244][106226] Updated weights for policy 0, policy_version 722597 (0.0005) [2023-12-28 00:26:47,307][106226] Updated weights for policy 0, policy_version 722607 (0.0010) [2023-12-28 00:26:47,922][106225] Updated weights for policy 1, policy_version 724495 (0.0008) [2023-12-28 00:26:47,935][106226] Updated weights for policy 0, policy_version 722617 (0.0008) [2023-12-28 00:26:47,976][106225] Updated weights for policy 1, policy_version 724505 (0.0008) [2023-12-28 00:26:47,985][106226] Updated weights for policy 0, policy_version 722627 (0.0005) [2023-12-28 00:26:48,034][106225] Updated weights for policy 1, policy_version 724515 (0.0009) [2023-12-28 00:26:48,043][106226] Updated weights for policy 0, policy_version 722637 (0.0007) [2023-12-28 00:26:48,105][106226] Updated weights for policy 0, policy_version 722647 (0.0005) [2023-12-28 00:26:48,765][106226] Updated weights for policy 0, policy_version 722657 (0.0010) [2023-12-28 00:26:48,803][106225] Updated weights for policy 1, policy_version 724525 (0.0008) [2023-12-28 00:26:48,827][106226] Updated weights for policy 0, policy_version 722667 (0.0011) [2023-12-28 00:26:48,863][106225] Updated weights for policy 1, policy_version 724535 (0.0007) [2023-12-28 00:26:48,888][106226] Updated weights for policy 0, policy_version 722677 (0.0011) [2023-12-28 00:26:48,922][106225] Updated weights for policy 1, policy_version 724545 (0.0007) [2023-12-28 00:26:49,581][106226] Updated weights for policy 0, policy_version 722687 (0.0008) [2023-12-28 00:26:49,600][106225] Updated weights for policy 1, policy_version 724555 (0.0008) [2023-12-28 00:26:49,640][106226] Updated weights for policy 0, policy_version 722697 (0.0008) [2023-12-28 00:26:49,661][106225] Updated weights for policy 1, policy_version 724565 (0.0009) [2023-12-28 00:26:49,702][106226] Updated weights for policy 0, policy_version 722707 (0.0006) [2023-12-28 00:26:49,719][106225] Updated weights for policy 1, policy_version 724575 (0.0007) [2023-12-28 00:26:50,423][106226] Updated weights for policy 0, policy_version 722717 (0.0007) [2023-12-28 00:26:50,462][106225] Updated weights for policy 1, policy_version 724585 (0.0007) [2023-12-28 00:26:50,485][106226] Updated weights for policy 0, policy_version 722727 (0.0006) [2023-12-28 00:26:50,522][106225] Updated weights for policy 1, policy_version 724595 (0.0008) [2023-12-28 00:26:50,541][106226] Updated weights for policy 0, policy_version 722737 (0.0006) [2023-12-28 00:26:50,581][106225] Updated weights for policy 1, policy_version 724605 (0.0009) [2023-12-28 00:26:50,639][106225] Updated weights for policy 1, policy_version 724615 (0.0008) [2023-12-28 00:26:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 370614272. Throughput: 0: 9964.6, 1: 9836.3. Samples: 370626844. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:51,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.112')] [2023-12-28 00:26:51,178][106226] Updated weights for policy 0, policy_version 722747 (0.0008) [2023-12-28 00:26:51,237][106226] Updated weights for policy 0, policy_version 722757 (0.0009) [2023-12-28 00:26:51,295][106226] Updated weights for policy 0, policy_version 722767 (0.0009) [2023-12-28 00:26:51,456][106225] Updated weights for policy 1, policy_version 724625 (0.0008) [2023-12-28 00:26:51,519][106225] Updated weights for policy 1, policy_version 724635 (0.0009) [2023-12-28 00:26:51,588][106225] Updated weights for policy 1, policy_version 724645 (0.0009) [2023-12-28 00:26:52,058][106226] Updated weights for policy 0, policy_version 722777 (0.0009) [2023-12-28 00:26:52,126][106226] Updated weights for policy 0, policy_version 722787 (0.0009) [2023-12-28 00:26:52,196][106226] Updated weights for policy 0, policy_version 722797 (0.0008) [2023-12-28 00:26:52,266][106226] Updated weights for policy 0, policy_version 722807 (0.0006) [2023-12-28 00:26:52,291][106225] Updated weights for policy 1, policy_version 724655 (0.0009) [2023-12-28 00:26:52,354][106225] Updated weights for policy 1, policy_version 724665 (0.0008) [2023-12-28 00:26:52,424][106225] Updated weights for policy 1, policy_version 724675 (0.0009) [2023-12-28 00:26:52,964][106226] Updated weights for policy 0, policy_version 722817 (0.0009) [2023-12-28 00:26:53,015][106226] Updated weights for policy 0, policy_version 722827 (0.0006) [2023-12-28 00:26:53,068][106226] Updated weights for policy 0, policy_version 722837 (0.0009) [2023-12-28 00:26:53,157][106225] Updated weights for policy 1, policy_version 724685 (0.0010) [2023-12-28 00:26:53,216][106225] Updated weights for policy 1, policy_version 724695 (0.0009) [2023-12-28 00:26:53,265][106225] Updated weights for policy 1, policy_version 724705 (0.0008) [2023-12-28 00:26:53,797][106226] Updated weights for policy 0, policy_version 722847 (0.0009) [2023-12-28 00:26:53,856][106226] Updated weights for policy 0, policy_version 722857 (0.0009) [2023-12-28 00:26:53,914][106226] Updated weights for policy 0, policy_version 722867 (0.0009) [2023-12-28 00:26:54,006][106225] Updated weights for policy 1, policy_version 724715 (0.0008) [2023-12-28 00:26:54,062][106225] Updated weights for policy 1, policy_version 724725 (0.0008) [2023-12-28 00:26:54,124][106225] Updated weights for policy 1, policy_version 724735 (0.0009) [2023-12-28 00:26:54,594][106226] Updated weights for policy 0, policy_version 722877 (0.0008) [2023-12-28 00:26:54,653][106226] Updated weights for policy 0, policy_version 722887 (0.0009) [2023-12-28 00:26:54,702][106226] Updated weights for policy 0, policy_version 722897 (0.0008) [2023-12-28 00:26:54,862][106225] Updated weights for policy 1, policy_version 724745 (0.0008) [2023-12-28 00:26:54,919][106225] Updated weights for policy 1, policy_version 724755 (0.0007) [2023-12-28 00:26:54,978][106225] Updated weights for policy 1, policy_version 724765 (0.0008) [2023-12-28 00:26:55,041][106225] Updated weights for policy 1, policy_version 724775 (0.0009) [2023-12-28 00:26:55,412][106226] Updated weights for policy 0, policy_version 722907 (0.0008) [2023-12-28 00:26:55,468][106226] Updated weights for policy 0, policy_version 722917 (0.0007) [2023-12-28 00:26:55,522][106226] Updated weights for policy 0, policy_version 722927 (0.0010) [2023-12-28 00:26:55,790][106225] Updated weights for policy 1, policy_version 724785 (0.0008) [2023-12-28 00:26:55,859][106225] Updated weights for policy 1, policy_version 724795 (0.0009) [2023-12-28 00:26:55,928][106225] Updated weights for policy 1, policy_version 724805 (0.0008) [2023-12-28 00:26:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 370712576. Throughput: 0: 9969.1, 1: 9744.1. Samples: 370683176. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:26:56,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.560')] [2023-12-28 00:26:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000724808_185589760.pth... [2023-12-28 00:26:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000722936_185122816.pth... [2023-12-28 00:26:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000723688_185303040.pth [2023-12-28 00:26:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000721784_184827904.pth [2023-12-28 00:26:56,219][106226] Updated weights for policy 0, policy_version 722937 (0.0007) [2023-12-28 00:26:56,279][106226] Updated weights for policy 0, policy_version 722947 (0.0005) [2023-12-28 00:26:56,329][106226] Updated weights for policy 0, policy_version 722957 (0.0009) [2023-12-28 00:26:56,387][106226] Updated weights for policy 0, policy_version 722967 (0.0008) [2023-12-28 00:26:56,618][106225] Updated weights for policy 1, policy_version 724815 (0.0008) [2023-12-28 00:26:56,674][106225] Updated weights for policy 1, policy_version 724825 (0.0008) [2023-12-28 00:26:56,731][106225] Updated weights for policy 1, policy_version 724835 (0.0008) [2023-12-28 00:26:57,080][106226] Updated weights for policy 0, policy_version 722977 (0.0009) [2023-12-28 00:26:57,134][106226] Updated weights for policy 0, policy_version 722987 (0.0008) [2023-12-28 00:26:57,178][106226] Updated weights for policy 0, policy_version 722997 (0.0008) [2023-12-28 00:26:57,448][106225] Updated weights for policy 1, policy_version 724845 (0.0008) [2023-12-28 00:26:57,495][106225] Updated weights for policy 1, policy_version 724855 (0.0008) [2023-12-28 00:26:57,543][106225] Updated weights for policy 1, policy_version 724865 (0.0008) [2023-12-28 00:26:57,866][106226] Updated weights for policy 0, policy_version 723007 (0.0006) [2023-12-28 00:26:57,917][106226] Updated weights for policy 0, policy_version 723017 (0.0006) [2023-12-28 00:26:57,970][106226] Updated weights for policy 0, policy_version 723027 (0.0009) [2023-12-28 00:26:58,347][106225] Updated weights for policy 1, policy_version 724875 (0.0008) [2023-12-28 00:26:58,413][106225] Updated weights for policy 1, policy_version 724885 (0.0009) [2023-12-28 00:26:58,475][106225] Updated weights for policy 1, policy_version 724895 (0.0010) [2023-12-28 00:26:58,663][106226] Updated weights for policy 0, policy_version 723037 (0.0007) [2023-12-28 00:26:58,733][106226] Updated weights for policy 0, policy_version 723047 (0.0010) [2023-12-28 00:26:58,808][106226] Updated weights for policy 0, policy_version 723057 (0.0009) [2023-12-28 00:26:59,341][106225] Updated weights for policy 1, policy_version 724905 (0.0010) [2023-12-28 00:26:59,409][106225] Updated weights for policy 1, policy_version 724915 (0.0008) [2023-12-28 00:26:59,469][106225] Updated weights for policy 1, policy_version 724925 (0.0008) [2023-12-28 00:26:59,530][106225] Updated weights for policy 1, policy_version 724935 (0.0008) [2023-12-28 00:26:59,557][106226] Updated weights for policy 0, policy_version 723067 (0.0009) [2023-12-28 00:26:59,622][106226] Updated weights for policy 0, policy_version 723077 (0.0009) [2023-12-28 00:26:59,681][106226] Updated weights for policy 0, policy_version 723087 (0.0008) [2023-12-28 00:27:00,217][106225] Updated weights for policy 1, policy_version 724945 (0.0008) [2023-12-28 00:27:00,278][106225] Updated weights for policy 1, policy_version 724955 (0.0007) [2023-12-28 00:27:00,345][106225] Updated weights for policy 1, policy_version 724965 (0.0006) [2023-12-28 00:27:00,481][106226] Updated weights for policy 0, policy_version 723097 (0.0008) [2023-12-28 00:27:00,547][106226] Updated weights for policy 0, policy_version 723107 (0.0010) [2023-12-28 00:27:00,601][106226] Updated weights for policy 0, policy_version 723117 (0.0009) [2023-12-28 00:27:00,658][106226] Updated weights for policy 0, policy_version 723127 (0.0009) [2023-12-28 00:27:00,904][106225] Updated weights for policy 1, policy_version 724975 (0.0006) [2023-12-28 00:27:00,959][106225] Updated weights for policy 1, policy_version 724985 (0.0008) [2023-12-28 00:27:01,010][106225] Updated weights for policy 1, policy_version 724995 (0.0008) [2023-12-28 00:27:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 370810880. Throughput: 0: 10023.1, 1: 9673.3. Samples: 370797884. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:01,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.367')] [2023-12-28 00:27:01,418][106226] Updated weights for policy 0, policy_version 723137 (0.0007) [2023-12-28 00:27:01,477][106226] Updated weights for policy 0, policy_version 723147 (0.0006) [2023-12-28 00:27:01,541][106226] Updated weights for policy 0, policy_version 723157 (0.0006) [2023-12-28 00:27:01,756][106225] Updated weights for policy 1, policy_version 725005 (0.0009) [2023-12-28 00:27:01,815][106225] Updated weights for policy 1, policy_version 725015 (0.0008) [2023-12-28 00:27:01,873][106225] Updated weights for policy 1, policy_version 725025 (0.0008) [2023-12-28 00:27:02,255][106226] Updated weights for policy 0, policy_version 723167 (0.0008) [2023-12-28 00:27:02,307][106226] Updated weights for policy 0, policy_version 723177 (0.0010) [2023-12-28 00:27:02,367][106226] Updated weights for policy 0, policy_version 723187 (0.0009) [2023-12-28 00:27:02,583][106225] Updated weights for policy 1, policy_version 725035 (0.0008) [2023-12-28 00:27:02,640][106225] Updated weights for policy 1, policy_version 725045 (0.0008) [2023-12-28 00:27:02,701][106225] Updated weights for policy 1, policy_version 725055 (0.0008) [2023-12-28 00:27:03,057][106226] Updated weights for policy 0, policy_version 723197 (0.0009) [2023-12-28 00:27:03,111][106226] Updated weights for policy 0, policy_version 723207 (0.0009) [2023-12-28 00:27:03,176][106226] Updated weights for policy 0, policy_version 723217 (0.0005) [2023-12-28 00:27:03,390][106225] Updated weights for policy 1, policy_version 725065 (0.0008) [2023-12-28 00:27:03,435][106225] Updated weights for policy 1, policy_version 725075 (0.0005) [2023-12-28 00:27:03,481][106225] Updated weights for policy 1, policy_version 725085 (0.0005) [2023-12-28 00:27:03,526][106225] Updated weights for policy 1, policy_version 725095 (0.0005) [2023-12-28 00:27:03,940][106226] Updated weights for policy 0, policy_version 723227 (0.0009) [2023-12-28 00:27:03,990][106226] Updated weights for policy 0, policy_version 723237 (0.0007) [2023-12-28 00:27:04,045][106226] Updated weights for policy 0, policy_version 723247 (0.0007) [2023-12-28 00:27:04,107][106225] Updated weights for policy 1, policy_version 725105 (0.0010) [2023-12-28 00:27:04,167][106225] Updated weights for policy 1, policy_version 725115 (0.0010) [2023-12-28 00:27:04,219][106225] Updated weights for policy 1, policy_version 725125 (0.0009) [2023-12-28 00:27:04,773][106226] Updated weights for policy 0, policy_version 723257 (0.0007) [2023-12-28 00:27:04,834][106226] Updated weights for policy 0, policy_version 723267 (0.0009) [2023-12-28 00:27:04,873][106225] Updated weights for policy 1, policy_version 725135 (0.0007) [2023-12-28 00:27:04,884][106226] Updated weights for policy 0, policy_version 723277 (0.0006) [2023-12-28 00:27:04,927][106225] Updated weights for policy 1, policy_version 725145 (0.0007) [2023-12-28 00:27:04,935][106226] Updated weights for policy 0, policy_version 723287 (0.0008) [2023-12-28 00:27:04,982][106225] Updated weights for policy 1, policy_version 725155 (0.0010) [2023-12-28 00:27:05,572][106225] Updated weights for policy 1, policy_version 725165 (0.0008) [2023-12-28 00:27:05,619][106225] Updated weights for policy 1, policy_version 725175 (0.0008) [2023-12-28 00:27:05,660][106226] Updated weights for policy 0, policy_version 723297 (0.0008) [2023-12-28 00:27:05,666][106225] Updated weights for policy 1, policy_version 725185 (0.0006) [2023-12-28 00:27:05,702][106226] Updated weights for policy 0, policy_version 723307 (0.0006) [2023-12-28 00:27:05,753][106226] Updated weights for policy 0, policy_version 723317 (0.0009) [2023-12-28 00:27:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 370909184. Throughput: 0: 9922.9, 1: 9746.2. Samples: 370918428. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:06,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.466')] [2023-12-28 00:27:06,444][106225] Updated weights for policy 1, policy_version 725195 (0.0007) [2023-12-28 00:27:06,494][106226] Updated weights for policy 0, policy_version 723327 (0.0007) [2023-12-28 00:27:06,505][106225] Updated weights for policy 1, policy_version 725205 (0.0006) [2023-12-28 00:27:06,556][106226] Updated weights for policy 0, policy_version 723337 (0.0007) [2023-12-28 00:27:06,567][106225] Updated weights for policy 1, policy_version 725215 (0.0007) [2023-12-28 00:27:06,620][106226] Updated weights for policy 0, policy_version 723347 (0.0009) [2023-12-28 00:27:07,263][106225] Updated weights for policy 1, policy_version 725225 (0.0009) [2023-12-28 00:27:07,311][106225] Updated weights for policy 1, policy_version 725235 (0.0005) [2023-12-28 00:27:07,366][106226] Updated weights for policy 0, policy_version 723357 (0.0007) [2023-12-28 00:27:07,366][106225] Updated weights for policy 1, policy_version 725245 (0.0008) [2023-12-28 00:27:07,420][106225] Updated weights for policy 1, policy_version 725255 (0.0007) [2023-12-28 00:27:07,426][106226] Updated weights for policy 0, policy_version 723367 (0.0007) [2023-12-28 00:27:07,484][106226] Updated weights for policy 0, policy_version 723377 (0.0010) [2023-12-28 00:27:08,111][106225] Updated weights for policy 1, policy_version 725265 (0.0007) [2023-12-28 00:27:08,161][106225] Updated weights for policy 1, policy_version 725275 (0.0007) [2023-12-28 00:27:08,197][106226] Updated weights for policy 0, policy_version 723387 (0.0010) [2023-12-28 00:27:08,220][106225] Updated weights for policy 1, policy_version 725285 (0.0008) [2023-12-28 00:27:08,258][106226] Updated weights for policy 0, policy_version 723397 (0.0011) [2023-12-28 00:27:08,318][106226] Updated weights for policy 0, policy_version 723407 (0.0010) [2023-12-28 00:27:09,005][106226] Updated weights for policy 0, policy_version 723417 (0.0011) [2023-12-28 00:27:09,010][106225] Updated weights for policy 1, policy_version 725295 (0.0008) [2023-12-28 00:27:09,062][106226] Updated weights for policy 0, policy_version 723427 (0.0009) [2023-12-28 00:27:09,073][106225] Updated weights for policy 1, policy_version 725305 (0.0006) [2023-12-28 00:27:09,113][106226] Updated weights for policy 0, policy_version 723437 (0.0009) [2023-12-28 00:27:09,134][106225] Updated weights for policy 1, policy_version 725315 (0.0006) [2023-12-28 00:27:09,166][106226] Updated weights for policy 0, policy_version 723447 (0.0010) [2023-12-28 00:27:09,893][106225] Updated weights for policy 1, policy_version 725325 (0.0007) [2023-12-28 00:27:09,930][106226] Updated weights for policy 0, policy_version 723457 (0.0013) [2023-12-28 00:27:09,963][106225] Updated weights for policy 1, policy_version 725335 (0.0008) [2023-12-28 00:27:09,991][106226] Updated weights for policy 0, policy_version 723467 (0.0010) [2023-12-28 00:27:10,022][106225] Updated weights for policy 1, policy_version 725345 (0.0007) [2023-12-28 00:27:10,053][106226] Updated weights for policy 0, policy_version 723477 (0.0011) [2023-12-28 00:27:10,708][106225] Updated weights for policy 1, policy_version 725355 (0.0011) [2023-12-28 00:27:10,710][106226] Updated weights for policy 0, policy_version 723487 (0.0008) [2023-12-28 00:27:10,762][106225] Updated weights for policy 1, policy_version 725365 (0.0010) [2023-12-28 00:27:10,774][106226] Updated weights for policy 0, policy_version 723497 (0.0009) [2023-12-28 00:27:10,809][106225] Updated weights for policy 1, policy_version 725375 (0.0010) [2023-12-28 00:27:10,842][106226] Updated weights for policy 0, policy_version 723507 (0.0008) [2023-12-28 00:27:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 371007488. Throughput: 0: 9957.3, 1: 9743.0. Samples: 370976528. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:11,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-5.217')] [2023-12-28 00:27:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000725384_185737216.pth... [2023-12-28 00:27:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000724264_185450496.pth [2023-12-28 00:27:11,191][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000723512_185270272.pth... [2023-12-28 00:27:11,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000722360_184975360.pth [2023-12-28 00:27:11,519][106226] Updated weights for policy 0, policy_version 723517 (0.0008) [2023-12-28 00:27:11,535][106225] Updated weights for policy 1, policy_version 725385 (0.0010) [2023-12-28 00:27:11,584][106226] Updated weights for policy 0, policy_version 723527 (0.0009) [2023-12-28 00:27:11,602][106225] Updated weights for policy 1, policy_version 725395 (0.0011) [2023-12-28 00:27:11,652][106226] Updated weights for policy 0, policy_version 723537 (0.0008) [2023-12-28 00:27:11,672][106225] Updated weights for policy 1, policy_version 725405 (0.0011) [2023-12-28 00:27:11,736][106225] Updated weights for policy 1, policy_version 725415 (0.0009) [2023-12-28 00:27:12,446][106226] Updated weights for policy 0, policy_version 723547 (0.0009) [2023-12-28 00:27:12,493][106225] Updated weights for policy 1, policy_version 725425 (0.0008) [2023-12-28 00:27:12,508][106226] Updated weights for policy 0, policy_version 723557 (0.0011) [2023-12-28 00:27:12,556][106225] Updated weights for policy 1, policy_version 725435 (0.0009) [2023-12-28 00:27:12,573][106226] Updated weights for policy 0, policy_version 723567 (0.0011) [2023-12-28 00:27:12,614][106225] Updated weights for policy 1, policy_version 725445 (0.0006) [2023-12-28 00:27:13,287][106226] Updated weights for policy 0, policy_version 723577 (0.0010) [2023-12-28 00:27:13,317][106225] Updated weights for policy 1, policy_version 725455 (0.0006) [2023-12-28 00:27:13,345][106226] Updated weights for policy 0, policy_version 723587 (0.0011) [2023-12-28 00:27:13,370][106225] Updated weights for policy 1, policy_version 725465 (0.0005) [2023-12-28 00:27:13,403][106226] Updated weights for policy 0, policy_version 723597 (0.0011) [2023-12-28 00:27:13,414][106225] Updated weights for policy 1, policy_version 725475 (0.0005) [2023-12-28 00:27:13,468][106226] Updated weights for policy 0, policy_version 723607 (0.0011) [2023-12-28 00:27:14,057][106225] Updated weights for policy 1, policy_version 725485 (0.0007) [2023-12-28 00:27:14,107][106225] Updated weights for policy 1, policy_version 725495 (0.0007) [2023-12-28 00:27:14,159][106225] Updated weights for policy 1, policy_version 725505 (0.0006) [2023-12-28 00:27:14,161][106226] Updated weights for policy 0, policy_version 723617 (0.0010) [2023-12-28 00:27:14,224][106226] Updated weights for policy 0, policy_version 723627 (0.0011) [2023-12-28 00:27:14,287][106226] Updated weights for policy 0, policy_version 723637 (0.0011) [2023-12-28 00:27:14,914][106225] Updated weights for policy 1, policy_version 725515 (0.0006) [2023-12-28 00:27:14,976][106225] Updated weights for policy 1, policy_version 725525 (0.0008) [2023-12-28 00:27:15,003][106226] Updated weights for policy 0, policy_version 723647 (0.0008) [2023-12-28 00:27:15,040][106225] Updated weights for policy 1, policy_version 725535 (0.0009) [2023-12-28 00:27:15,070][106226] Updated weights for policy 0, policy_version 723657 (0.0007) [2023-12-28 00:27:15,133][106226] Updated weights for policy 0, policy_version 723667 (0.0011) [2023-12-28 00:27:15,774][106225] Updated weights for policy 1, policy_version 725545 (0.0009) [2023-12-28 00:27:15,800][106226] Updated weights for policy 0, policy_version 723677 (0.0011) [2023-12-28 00:27:15,826][106225] Updated weights for policy 1, policy_version 725555 (0.0007) [2023-12-28 00:27:15,860][106226] Updated weights for policy 0, policy_version 723687 (0.0010) [2023-12-28 00:27:15,882][106225] Updated weights for policy 1, policy_version 725565 (0.0009) [2023-12-28 00:27:15,922][106226] Updated weights for policy 0, policy_version 723697 (0.0010) [2023-12-28 00:27:15,943][106225] Updated weights for policy 1, policy_version 725575 (0.0005) [2023-12-28 00:27:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 371105792. Throughput: 0: 9812.2, 1: 9705.2. Samples: 371091856. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:16,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-5.341')] [2023-12-28 00:27:16,560][106225] Updated weights for policy 1, policy_version 725585 (0.0005) [2023-12-28 00:27:16,627][106225] Updated weights for policy 1, policy_version 725595 (0.0007) [2023-12-28 00:27:16,676][106226] Updated weights for policy 0, policy_version 723707 (0.0009) [2023-12-28 00:27:16,689][106225] Updated weights for policy 1, policy_version 725605 (0.0007) [2023-12-28 00:27:16,730][106226] Updated weights for policy 0, policy_version 723717 (0.0010) [2023-12-28 00:27:16,779][106226] Updated weights for policy 0, policy_version 723727 (0.0010) [2023-12-28 00:27:17,264][106225] Updated weights for policy 1, policy_version 725615 (0.0008) [2023-12-28 00:27:17,323][106225] Updated weights for policy 1, policy_version 725625 (0.0009) [2023-12-28 00:27:17,383][106225] Updated weights for policy 1, policy_version 725635 (0.0009) [2023-12-28 00:27:17,448][106226] Updated weights for policy 0, policy_version 723737 (0.0008) [2023-12-28 00:27:17,510][106226] Updated weights for policy 0, policy_version 723747 (0.0010) [2023-12-28 00:27:17,559][106226] Updated weights for policy 0, policy_version 723757 (0.0010) [2023-12-28 00:27:17,616][106226] Updated weights for policy 0, policy_version 723767 (0.0010) [2023-12-28 00:27:18,112][106225] Updated weights for policy 1, policy_version 725645 (0.0009) [2023-12-28 00:27:18,171][106225] Updated weights for policy 1, policy_version 725655 (0.0010) [2023-12-28 00:27:18,232][106225] Updated weights for policy 1, policy_version 725665 (0.0008) [2023-12-28 00:27:18,252][106226] Updated weights for policy 0, policy_version 723777 (0.0006) [2023-12-28 00:27:18,306][106226] Updated weights for policy 0, policy_version 723787 (0.0005) [2023-12-28 00:27:18,367][106226] Updated weights for policy 0, policy_version 723797 (0.0007) [2023-12-28 00:27:18,827][106225] Updated weights for policy 1, policy_version 725675 (0.0007) [2023-12-28 00:27:18,888][106225] Updated weights for policy 1, policy_version 725685 (0.0008) [2023-12-28 00:27:18,963][106225] Updated weights for policy 1, policy_version 725695 (0.0010) [2023-12-28 00:27:19,041][106226] Updated weights for policy 0, policy_version 723807 (0.0007) [2023-12-28 00:27:19,103][106226] Updated weights for policy 0, policy_version 723817 (0.0007) [2023-12-28 00:27:19,159][106226] Updated weights for policy 0, policy_version 723827 (0.0007) [2023-12-28 00:27:19,738][106225] Updated weights for policy 1, policy_version 725705 (0.0010) [2023-12-28 00:27:19,798][106225] Updated weights for policy 1, policy_version 725715 (0.0006) [2023-12-28 00:27:19,862][106226] Updated weights for policy 0, policy_version 723837 (0.0006) [2023-12-28 00:27:19,870][106225] Updated weights for policy 1, policy_version 725725 (0.0007) [2023-12-28 00:27:19,935][106226] Updated weights for policy 0, policy_version 723847 (0.0006) [2023-12-28 00:27:19,935][106225] Updated weights for policy 1, policy_version 725735 (0.0009) [2023-12-28 00:27:19,999][106226] Updated weights for policy 0, policy_version 723857 (0.0008) [2023-12-28 00:27:20,548][106225] Updated weights for policy 1, policy_version 725745 (0.0005) [2023-12-28 00:27:20,615][106225] Updated weights for policy 1, policy_version 725755 (0.0007) [2023-12-28 00:27:20,684][106225] Updated weights for policy 1, policy_version 725765 (0.0008) [2023-12-28 00:27:20,799][106226] Updated weights for policy 0, policy_version 723867 (0.0009) [2023-12-28 00:27:20,859][106226] Updated weights for policy 0, policy_version 723877 (0.0008) [2023-12-28 00:27:20,917][106226] Updated weights for policy 0, policy_version 723887 (0.0009) [2023-12-28 00:27:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 371204096. Throughput: 0: 9841.2, 1: 9765.5. Samples: 371211660. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:21,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-5.215')] [2023-12-28 00:27:21,407][106225] Updated weights for policy 1, policy_version 725775 (0.0009) [2023-12-28 00:27:21,458][106225] Updated weights for policy 1, policy_version 725785 (0.0005) [2023-12-28 00:27:21,512][106225] Updated weights for policy 1, policy_version 725795 (0.0005) [2023-12-28 00:27:21,650][106226] Updated weights for policy 0, policy_version 723897 (0.0006) [2023-12-28 00:27:21,716][106226] Updated weights for policy 0, policy_version 723907 (0.0010) [2023-12-28 00:27:21,787][106226] Updated weights for policy 0, policy_version 723917 (0.0008) [2023-12-28 00:27:21,848][106226] Updated weights for policy 0, policy_version 723927 (0.0008) [2023-12-28 00:27:22,234][106225] Updated weights for policy 1, policy_version 725805 (0.0007) [2023-12-28 00:27:22,298][106225] Updated weights for policy 1, policy_version 725815 (0.0009) [2023-12-28 00:27:22,364][106225] Updated weights for policy 1, policy_version 725825 (0.0007) [2023-12-28 00:27:22,600][106226] Updated weights for policy 0, policy_version 723937 (0.0009) [2023-12-28 00:27:22,660][106226] Updated weights for policy 0, policy_version 723947 (0.0008) [2023-12-28 00:27:22,709][106226] Updated weights for policy 0, policy_version 723957 (0.0008) [2023-12-28 00:27:23,069][106225] Updated weights for policy 1, policy_version 725835 (0.0008) [2023-12-28 00:27:23,131][106225] Updated weights for policy 1, policy_version 725845 (0.0007) [2023-12-28 00:27:23,191][106225] Updated weights for policy 1, policy_version 725855 (0.0008) [2023-12-28 00:27:23,483][106226] Updated weights for policy 0, policy_version 723967 (0.0008) [2023-12-28 00:27:23,533][106226] Updated weights for policy 0, policy_version 723977 (0.0008) [2023-12-28 00:27:23,585][106226] Updated weights for policy 0, policy_version 723987 (0.0008) [2023-12-28 00:27:23,887][106225] Updated weights for policy 1, policy_version 725865 (0.0008) [2023-12-28 00:27:23,934][106225] Updated weights for policy 1, policy_version 725875 (0.0005) [2023-12-28 00:27:23,999][106225] Updated weights for policy 1, policy_version 725885 (0.0008) [2023-12-28 00:27:24,047][106225] Updated weights for policy 1, policy_version 725895 (0.0009) [2023-12-28 00:27:24,312][106226] Updated weights for policy 0, policy_version 723997 (0.0007) [2023-12-28 00:27:24,371][106226] Updated weights for policy 0, policy_version 724007 (0.0005) [2023-12-28 00:27:24,430][106226] Updated weights for policy 0, policy_version 724017 (0.0005) [2023-12-28 00:27:24,773][106225] Updated weights for policy 1, policy_version 725905 (0.0005) [2023-12-28 00:27:24,831][106225] Updated weights for policy 1, policy_version 725915 (0.0007) [2023-12-28 00:27:24,884][106225] Updated weights for policy 1, policy_version 725925 (0.0009) [2023-12-28 00:27:25,027][106226] Updated weights for policy 0, policy_version 724027 (0.0005) [2023-12-28 00:27:25,085][106226] Updated weights for policy 0, policy_version 724037 (0.0007) [2023-12-28 00:27:25,144][106226] Updated weights for policy 0, policy_version 724047 (0.0007) [2023-12-28 00:27:25,461][106225] Updated weights for policy 1, policy_version 725935 (0.0005) [2023-12-28 00:27:25,519][106225] Updated weights for policy 1, policy_version 725945 (0.0009) [2023-12-28 00:27:25,578][106225] Updated weights for policy 1, policy_version 725955 (0.0010) [2023-12-28 00:27:25,830][106226] Updated weights for policy 0, policy_version 724057 (0.0010) [2023-12-28 00:27:25,893][106226] Updated weights for policy 0, policy_version 724067 (0.0009) [2023-12-28 00:27:25,953][106226] Updated weights for policy 0, policy_version 724077 (0.0007) [2023-12-28 00:27:26,002][106226] Updated weights for policy 0, policy_version 724087 (0.0008) [2023-12-28 00:27:26,137][106225] Updated weights for policy 1, policy_version 725965 (0.0010) [2023-12-28 00:27:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 371302400. Throughput: 0: 9804.1, 1: 9736.5. Samples: 371268616. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:26,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-5.463')] [2023-12-28 00:27:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000724088_185417728.pth... [2023-12-28 00:27:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000722936_185122816.pth [2023-12-28 00:27:26,203][106225] Updated weights for policy 1, policy_version 725975 (0.0007) [2023-12-28 00:27:26,270][106225] Updated weights for policy 1, policy_version 725985 (0.0009) [2023-12-28 00:27:26,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000725992_185892864.pth... [2023-12-28 00:27:26,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000724808_185589760.pth [2023-12-28 00:27:26,688][106226] Updated weights for policy 0, policy_version 724097 (0.0010) [2023-12-28 00:27:26,746][106226] Updated weights for policy 0, policy_version 724107 (0.0010) [2023-12-28 00:27:26,804][106226] Updated weights for policy 0, policy_version 724117 (0.0010) [2023-12-28 00:27:26,973][106225] Updated weights for policy 1, policy_version 725995 (0.0009) [2023-12-28 00:27:27,027][106225] Updated weights for policy 1, policy_version 726005 (0.0009) [2023-12-28 00:27:27,080][106225] Updated weights for policy 1, policy_version 726015 (0.0008) [2023-12-28 00:27:27,413][106226] Updated weights for policy 0, policy_version 724127 (0.0011) [2023-12-28 00:27:27,472][106226] Updated weights for policy 0, policy_version 724137 (0.0010) [2023-12-28 00:27:27,532][106226] Updated weights for policy 0, policy_version 724147 (0.0011) [2023-12-28 00:27:27,847][106225] Updated weights for policy 1, policy_version 726025 (0.0008) [2023-12-28 00:27:27,900][106225] Updated weights for policy 1, policy_version 726035 (0.0008) [2023-12-28 00:27:27,947][106225] Updated weights for policy 1, policy_version 726045 (0.0007) [2023-12-28 00:27:28,024][106225] Updated weights for policy 1, policy_version 726055 (0.0007) [2023-12-28 00:27:28,235][106226] Updated weights for policy 0, policy_version 724157 (0.0011) [2023-12-28 00:27:28,288][106226] Updated weights for policy 0, policy_version 724167 (0.0010) [2023-12-28 00:27:28,343][106226] Updated weights for policy 0, policy_version 724177 (0.0010) [2023-12-28 00:27:28,768][106225] Updated weights for policy 1, policy_version 726065 (0.0010) [2023-12-28 00:27:28,829][106225] Updated weights for policy 1, policy_version 726075 (0.0010) [2023-12-28 00:27:28,886][106225] Updated weights for policy 1, policy_version 726085 (0.0009) [2023-12-28 00:27:28,994][106226] Updated weights for policy 0, policy_version 724187 (0.0010) [2023-12-28 00:27:29,043][106226] Updated weights for policy 0, policy_version 724197 (0.0010) [2023-12-28 00:27:29,089][106226] Updated weights for policy 0, policy_version 724207 (0.0010) [2023-12-28 00:27:29,623][106225] Updated weights for policy 1, policy_version 726095 (0.0006) [2023-12-28 00:27:29,675][106225] Updated weights for policy 1, policy_version 726105 (0.0008) [2023-12-28 00:27:29,730][106225] Updated weights for policy 1, policy_version 726115 (0.0007) [2023-12-28 00:27:29,845][106226] Updated weights for policy 0, policy_version 724217 (0.0010) [2023-12-28 00:27:29,904][106226] Updated weights for policy 0, policy_version 724227 (0.0011) [2023-12-28 00:27:29,971][106226] Updated weights for policy 0, policy_version 724237 (0.0008) [2023-12-28 00:27:30,035][106226] Updated weights for policy 0, policy_version 724247 (0.0011) [2023-12-28 00:27:30,415][106225] Updated weights for policy 1, policy_version 726125 (0.0007) [2023-12-28 00:27:30,466][106225] Updated weights for policy 1, policy_version 726135 (0.0008) [2023-12-28 00:27:30,523][106225] Updated weights for policy 1, policy_version 726145 (0.0008) [2023-12-28 00:27:30,719][106226] Updated weights for policy 0, policy_version 724257 (0.0010) [2023-12-28 00:27:30,765][106226] Updated weights for policy 0, policy_version 724267 (0.0010) [2023-12-28 00:27:30,817][106226] Updated weights for policy 0, policy_version 724277 (0.0010) [2023-12-28 00:27:31,135][106225] Updated weights for policy 1, policy_version 726155 (0.0008) [2023-12-28 00:27:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 371400704. Throughput: 0: 9846.5, 1: 9844.0. Samples: 371391048. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:31,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-5.459')] [2023-12-28 00:27:31,197][106225] Updated weights for policy 1, policy_version 726165 (0.0010) [2023-12-28 00:27:31,259][106225] Updated weights for policy 1, policy_version 726175 (0.0011) [2023-12-28 00:27:31,586][106226] Updated weights for policy 0, policy_version 724287 (0.0009) [2023-12-28 00:27:31,661][106226] Updated weights for policy 0, policy_version 724297 (0.0009) [2023-12-28 00:27:31,726][106226] Updated weights for policy 0, policy_version 724307 (0.0008) [2023-12-28 00:27:31,963][106225] Updated weights for policy 1, policy_version 726185 (0.0009) [2023-12-28 00:27:32,024][106225] Updated weights for policy 1, policy_version 726195 (0.0006) [2023-12-28 00:27:32,076][106225] Updated weights for policy 1, policy_version 726205 (0.0008) [2023-12-28 00:27:32,122][106225] Updated weights for policy 1, policy_version 726215 (0.0009) [2023-12-28 00:27:32,522][106226] Updated weights for policy 0, policy_version 724317 (0.0009) [2023-12-28 00:27:32,572][106226] Updated weights for policy 0, policy_version 724327 (0.0008) [2023-12-28 00:27:32,636][106226] Updated weights for policy 0, policy_version 724337 (0.0008) [2023-12-28 00:27:32,778][106225] Updated weights for policy 1, policy_version 726225 (0.0008) [2023-12-28 00:27:32,841][106225] Updated weights for policy 1, policy_version 726235 (0.0009) [2023-12-28 00:27:32,901][106225] Updated weights for policy 1, policy_version 726245 (0.0009) [2023-12-28 00:27:33,377][106226] Updated weights for policy 0, policy_version 724347 (0.0009) [2023-12-28 00:27:33,446][106226] Updated weights for policy 0, policy_version 724357 (0.0009) [2023-12-28 00:27:33,502][106226] Updated weights for policy 0, policy_version 724367 (0.0009) [2023-12-28 00:27:33,616][106225] Updated weights for policy 1, policy_version 726255 (0.0006) [2023-12-28 00:27:33,678][106225] Updated weights for policy 1, policy_version 726265 (0.0007) [2023-12-28 00:27:33,731][106225] Updated weights for policy 1, policy_version 726275 (0.0008) [2023-12-28 00:27:34,053][106226] Updated weights for policy 0, policy_version 724377 (0.0006) [2023-12-28 00:27:34,118][106226] Updated weights for policy 0, policy_version 724387 (0.0006) [2023-12-28 00:27:34,185][106226] Updated weights for policy 0, policy_version 724397 (0.0007) [2023-12-28 00:27:34,257][106226] Updated weights for policy 0, policy_version 724407 (0.0008) [2023-12-28 00:27:34,349][106225] Updated weights for policy 1, policy_version 726286 (0.0008) [2023-12-28 00:27:34,410][106225] Updated weights for policy 1, policy_version 726296 (0.0009) [2023-12-28 00:27:34,475][106225] Updated weights for policy 1, policy_version 726306 (0.0009) [2023-12-28 00:27:34,944][106226] Updated weights for policy 0, policy_version 724417 (0.0006) [2023-12-28 00:27:35,014][106226] Updated weights for policy 0, policy_version 724427 (0.0005) [2023-12-28 00:27:35,081][106226] Updated weights for policy 0, policy_version 724437 (0.0006) [2023-12-28 00:27:35,102][106225] Updated weights for policy 1, policy_version 726316 (0.0008) [2023-12-28 00:27:35,165][106225] Updated weights for policy 1, policy_version 726326 (0.0005) [2023-12-28 00:27:35,222][106225] Updated weights for policy 1, policy_version 726336 (0.0007) [2023-12-28 00:27:35,731][106225] Updated weights for policy 1, policy_version 726346 (0.0008) [2023-12-28 00:27:35,741][106226] Updated weights for policy 0, policy_version 724447 (0.0007) [2023-12-28 00:27:35,783][106225] Updated weights for policy 1, policy_version 726356 (0.0009) [2023-12-28 00:27:35,791][106226] Updated weights for policy 0, policy_version 724457 (0.0007) [2023-12-28 00:27:35,833][106225] Updated weights for policy 1, policy_version 726366 (0.0010) [2023-12-28 00:27:35,839][106226] Updated weights for policy 0, policy_version 724467 (0.0006) [2023-12-28 00:27:35,885][106225] Updated weights for policy 1, policy_version 726376 (0.0009) [2023-12-28 00:27:36,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 371507200. Throughput: 0: 9743.7, 1: 9974.5. Samples: 371514168. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:36,176][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.326')] [2023-12-28 00:27:36,558][106226] Updated weights for policy 0, policy_version 724477 (0.0005) [2023-12-28 00:27:36,625][106226] Updated weights for policy 0, policy_version 724487 (0.0009) [2023-12-28 00:27:36,639][106225] Updated weights for policy 1, policy_version 726386 (0.0006) [2023-12-28 00:27:36,688][106226] Updated weights for policy 0, policy_version 724497 (0.0007) [2023-12-28 00:27:36,699][106225] Updated weights for policy 1, policy_version 726396 (0.0007) [2023-12-28 00:27:36,756][106225] Updated weights for policy 1, policy_version 726406 (0.0008) [2023-12-28 00:27:37,400][106226] Updated weights for policy 0, policy_version 724507 (0.0008) [2023-12-28 00:27:37,463][106226] Updated weights for policy 0, policy_version 724517 (0.0009) [2023-12-28 00:27:37,513][106225] Updated weights for policy 1, policy_version 726416 (0.0007) [2023-12-28 00:27:37,523][106226] Updated weights for policy 0, policy_version 724527 (0.0007) [2023-12-28 00:27:37,561][106225] Updated weights for policy 1, policy_version 726426 (0.0006) [2023-12-28 00:27:37,609][106225] Updated weights for policy 1, policy_version 726436 (0.0008) [2023-12-28 00:27:38,156][106226] Updated weights for policy 0, policy_version 724537 (0.0008) [2023-12-28 00:27:38,212][106226] Updated weights for policy 0, policy_version 724547 (0.0009) [2023-12-28 00:27:38,271][106226] Updated weights for policy 0, policy_version 724557 (0.0009) [2023-12-28 00:27:38,346][106226] Updated weights for policy 0, policy_version 724567 (0.0009) [2023-12-28 00:27:38,390][106225] Updated weights for policy 1, policy_version 726446 (0.0008) [2023-12-28 00:27:38,453][106225] Updated weights for policy 1, policy_version 726456 (0.0009) [2023-12-28 00:27:38,515][106225] Updated weights for policy 1, policy_version 726466 (0.0008) [2023-12-28 00:27:38,963][106226] Updated weights for policy 0, policy_version 724577 (0.0006) [2023-12-28 00:27:39,018][106226] Updated weights for policy 0, policy_version 724587 (0.0008) [2023-12-28 00:27:39,068][106226] Updated weights for policy 0, policy_version 724597 (0.0009) [2023-12-28 00:27:39,317][106225] Updated weights for policy 1, policy_version 726476 (0.0009) [2023-12-28 00:27:39,384][106225] Updated weights for policy 1, policy_version 726486 (0.0008) [2023-12-28 00:27:39,449][106225] Updated weights for policy 1, policy_version 726496 (0.0008) [2023-12-28 00:27:39,843][106226] Updated weights for policy 0, policy_version 724607 (0.0009) [2023-12-28 00:27:39,910][106226] Updated weights for policy 0, policy_version 724617 (0.0009) [2023-12-28 00:27:39,975][106226] Updated weights for policy 0, policy_version 724627 (0.0009) [2023-12-28 00:27:40,161][106225] Updated weights for policy 1, policy_version 726506 (0.0007) [2023-12-28 00:27:40,220][106225] Updated weights for policy 1, policy_version 726516 (0.0006) [2023-12-28 00:27:40,291][106225] Updated weights for policy 1, policy_version 726526 (0.0008) [2023-12-28 00:27:40,354][106225] Updated weights for policy 1, policy_version 726536 (0.0008) [2023-12-28 00:27:40,749][106226] Updated weights for policy 0, policy_version 724637 (0.0010) [2023-12-28 00:27:40,833][106226] Updated weights for policy 0, policy_version 724647 (0.0008) [2023-12-28 00:27:40,902][106226] Updated weights for policy 0, policy_version 724657 (0.0010) [2023-12-28 00:27:40,953][106225] Updated weights for policy 1, policy_version 726546 (0.0007) [2023-12-28 00:27:41,004][106225] Updated weights for policy 1, policy_version 726556 (0.0008) [2023-12-28 00:27:41,070][106225] Updated weights for policy 1, policy_version 726566 (0.0008) [2023-12-28 00:27:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 371605504. Throughput: 0: 9800.6, 1: 9962.7. Samples: 371572528. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:41,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.263')] [2023-12-28 00:27:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000726568_186040320.pth... [2023-12-28 00:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000724664_185565184.pth... [2023-12-28 00:27:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000725384_185737216.pth [2023-12-28 00:27:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000723512_185270272.pth [2023-12-28 00:27:41,658][106226] Updated weights for policy 0, policy_version 724667 (0.0006) [2023-12-28 00:27:41,721][106226] Updated weights for policy 0, policy_version 724677 (0.0008) [2023-12-28 00:27:41,790][106226] Updated weights for policy 0, policy_version 724687 (0.0008) [2023-12-28 00:27:41,921][106225] Updated weights for policy 1, policy_version 726576 (0.0006) [2023-12-28 00:27:41,981][106225] Updated weights for policy 1, policy_version 726586 (0.0005) [2023-12-28 00:27:42,045][106225] Updated weights for policy 1, policy_version 726596 (0.0006) [2023-12-28 00:27:42,530][106226] Updated weights for policy 0, policy_version 724697 (0.0009) [2023-12-28 00:27:42,579][106226] Updated weights for policy 0, policy_version 724707 (0.0008) [2023-12-28 00:27:42,639][106226] Updated weights for policy 0, policy_version 724717 (0.0009) [2023-12-28 00:27:42,699][106225] Updated weights for policy 1, policy_version 726606 (0.0008) [2023-12-28 00:27:42,700][106226] Updated weights for policy 0, policy_version 724727 (0.0007) [2023-12-28 00:27:42,755][106225] Updated weights for policy 1, policy_version 726616 (0.0008) [2023-12-28 00:27:42,815][106225] Updated weights for policy 1, policy_version 726626 (0.0009) [2023-12-28 00:27:43,364][106226] Updated weights for policy 0, policy_version 724737 (0.0009) [2023-12-28 00:27:43,420][106226] Updated weights for policy 0, policy_version 724747 (0.0007) [2023-12-28 00:27:43,475][106226] Updated weights for policy 0, policy_version 724757 (0.0005) [2023-12-28 00:27:43,575][106225] Updated weights for policy 1, policy_version 726636 (0.0009) [2023-12-28 00:27:43,624][106225] Updated weights for policy 1, policy_version 726646 (0.0007) [2023-12-28 00:27:43,674][106225] Updated weights for policy 1, policy_version 726656 (0.0005) [2023-12-28 00:27:44,017][106226] Updated weights for policy 0, policy_version 724767 (0.0007) [2023-12-28 00:27:44,079][106226] Updated weights for policy 0, policy_version 724777 (0.0008) [2023-12-28 00:27:44,148][106226] Updated weights for policy 0, policy_version 724787 (0.0009) [2023-12-28 00:27:44,378][106225] Updated weights for policy 1, policy_version 726666 (0.0006) [2023-12-28 00:27:44,433][106225] Updated weights for policy 1, policy_version 726676 (0.0008) [2023-12-28 00:27:44,487][106225] Updated weights for policy 1, policy_version 726686 (0.0009) [2023-12-28 00:27:44,546][106225] Updated weights for policy 1, policy_version 726696 (0.0009) [2023-12-28 00:27:44,869][106226] Updated weights for policy 0, policy_version 724797 (0.0009) [2023-12-28 00:27:44,921][106226] Updated weights for policy 0, policy_version 724807 (0.0008) [2023-12-28 00:27:44,974][106226] Updated weights for policy 0, policy_version 724817 (0.0008) [2023-12-28 00:27:45,307][106225] Updated weights for policy 1, policy_version 726706 (0.0007) [2023-12-28 00:27:45,361][106225] Updated weights for policy 1, policy_version 726716 (0.0008) [2023-12-28 00:27:45,420][106225] Updated weights for policy 1, policy_version 726726 (0.0009) [2023-12-28 00:27:45,750][106226] Updated weights for policy 0, policy_version 724827 (0.0008) [2023-12-28 00:27:45,798][106226] Updated weights for policy 0, policy_version 724837 (0.0005) [2023-12-28 00:27:45,852][106226] Updated weights for policy 0, policy_version 724847 (0.0007) [2023-12-28 00:27:46,104][106225] Updated weights for policy 1, policy_version 726736 (0.0010) [2023-12-28 00:27:46,151][106225] Updated weights for policy 1, policy_version 726746 (0.0010) [2023-12-28 00:27:46,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 371695616. Throughput: 0: 9759.0, 1: 10018.0. Samples: 371687852. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:46,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-5.290')] [2023-12-28 00:27:46,198][106225] Updated weights for policy 1, policy_version 726756 (0.0010) [2023-12-28 00:27:46,473][106226] Updated weights for policy 0, policy_version 724857 (0.0010) [2023-12-28 00:27:46,533][106226] Updated weights for policy 0, policy_version 724867 (0.0009) [2023-12-28 00:27:46,592][106226] Updated weights for policy 0, policy_version 724877 (0.0010) [2023-12-28 00:27:46,647][106226] Updated weights for policy 0, policy_version 724887 (0.0008) [2023-12-28 00:27:46,812][106225] Updated weights for policy 1, policy_version 726766 (0.0010) [2023-12-28 00:27:46,871][106225] Updated weights for policy 1, policy_version 726776 (0.0010) [2023-12-28 00:27:46,928][106225] Updated weights for policy 1, policy_version 726786 (0.0010) [2023-12-28 00:27:47,362][106226] Updated weights for policy 0, policy_version 724897 (0.0008) [2023-12-28 00:27:47,422][106226] Updated weights for policy 0, policy_version 724907 (0.0009) [2023-12-28 00:27:47,485][106226] Updated weights for policy 0, policy_version 724917 (0.0008) [2023-12-28 00:27:47,566][106225] Updated weights for policy 1, policy_version 726796 (0.0009) [2023-12-28 00:27:47,619][106225] Updated weights for policy 1, policy_version 726806 (0.0008) [2023-12-28 00:27:47,668][106225] Updated weights for policy 1, policy_version 726816 (0.0008) [2023-12-28 00:27:48,123][106226] Updated weights for policy 0, policy_version 724927 (0.0010) [2023-12-28 00:27:48,182][106226] Updated weights for policy 0, policy_version 724937 (0.0010) [2023-12-28 00:27:48,239][106226] Updated weights for policy 0, policy_version 724947 (0.0010) [2023-12-28 00:27:48,286][106225] Updated weights for policy 1, policy_version 726826 (0.0007) [2023-12-28 00:27:48,354][106225] Updated weights for policy 1, policy_version 726836 (0.0009) [2023-12-28 00:27:48,411][106225] Updated weights for policy 1, policy_version 726846 (0.0010) [2023-12-28 00:27:48,470][106225] Updated weights for policy 1, policy_version 726856 (0.0011) [2023-12-28 00:27:48,986][106226] Updated weights for policy 0, policy_version 724957 (0.0010) [2023-12-28 00:27:49,047][106226] Updated weights for policy 0, policy_version 724967 (0.0006) [2023-12-28 00:27:49,098][106226] Updated weights for policy 0, policy_version 724977 (0.0005) [2023-12-28 00:27:49,207][106225] Updated weights for policy 1, policy_version 726866 (0.0006) [2023-12-28 00:27:49,277][106225] Updated weights for policy 1, policy_version 726876 (0.0008) [2023-12-28 00:27:49,335][106225] Updated weights for policy 1, policy_version 726886 (0.0008) [2023-12-28 00:27:49,776][106226] Updated weights for policy 0, policy_version 724987 (0.0008) [2023-12-28 00:27:49,845][106226] Updated weights for policy 0, policy_version 724997 (0.0010) [2023-12-28 00:27:49,917][106226] Updated weights for policy 0, policy_version 725007 (0.0009) [2023-12-28 00:27:49,997][106225] Updated weights for policy 1, policy_version 726896 (0.0006) [2023-12-28 00:27:50,063][106225] Updated weights for policy 1, policy_version 726906 (0.0006) [2023-12-28 00:27:50,112][106225] Updated weights for policy 1, policy_version 726916 (0.0007) [2023-12-28 00:27:50,717][106226] Updated weights for policy 0, policy_version 725017 (0.0008) [2023-12-28 00:27:50,736][106225] Updated weights for policy 1, policy_version 726926 (0.0008) [2023-12-28 00:27:50,783][106226] Updated weights for policy 0, policy_version 725027 (0.0011) [2023-12-28 00:27:50,796][106225] Updated weights for policy 1, policy_version 726936 (0.0007) [2023-12-28 00:27:50,845][106226] Updated weights for policy 0, policy_version 725037 (0.0011) [2023-12-28 00:27:50,855][106225] Updated weights for policy 1, policy_version 726946 (0.0006) [2023-12-28 00:27:50,906][106226] Updated weights for policy 0, policy_version 725047 (0.0011) [2023-12-28 00:27:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 371802112. Throughput: 0: 9796.7, 1: 9987.0. Samples: 371808696. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:51,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.273')] [2023-12-28 00:27:51,666][106226] Updated weights for policy 0, policy_version 725057 (0.0008) [2023-12-28 00:27:51,679][106225] Updated weights for policy 1, policy_version 726956 (0.0006) [2023-12-28 00:27:51,736][106226] Updated weights for policy 0, policy_version 725067 (0.0008) [2023-12-28 00:27:51,746][106225] Updated weights for policy 1, policy_version 726966 (0.0007) [2023-12-28 00:27:51,800][106226] Updated weights for policy 0, policy_version 725077 (0.0007) [2023-12-28 00:27:51,807][106225] Updated weights for policy 1, policy_version 726976 (0.0007) [2023-12-28 00:27:52,542][106226] Updated weights for policy 0, policy_version 725087 (0.0008) [2023-12-28 00:27:52,574][106225] Updated weights for policy 1, policy_version 726986 (0.0009) [2023-12-28 00:27:52,593][106226] Updated weights for policy 0, policy_version 725097 (0.0007) [2023-12-28 00:27:52,630][106225] Updated weights for policy 1, policy_version 726996 (0.0007) [2023-12-28 00:27:52,648][106226] Updated weights for policy 0, policy_version 725107 (0.0006) [2023-12-28 00:27:52,682][106225] Updated weights for policy 1, policy_version 727006 (0.0007) [2023-12-28 00:27:52,743][106225] Updated weights for policy 1, policy_version 727016 (0.0009) [2023-12-28 00:27:53,282][106226] Updated weights for policy 0, policy_version 725117 (0.0008) [2023-12-28 00:27:53,327][106226] Updated weights for policy 0, policy_version 725127 (0.0008) [2023-12-28 00:27:53,378][106226] Updated weights for policy 0, policy_version 725137 (0.0009) [2023-12-28 00:27:53,530][106225] Updated weights for policy 1, policy_version 727026 (0.0009) [2023-12-28 00:27:53,593][106225] Updated weights for policy 1, policy_version 727036 (0.0009) [2023-12-28 00:27:53,651][106225] Updated weights for policy 1, policy_version 727046 (0.0009) [2023-12-28 00:27:53,996][106226] Updated weights for policy 0, policy_version 725147 (0.0008) [2023-12-28 00:27:54,057][106226] Updated weights for policy 0, policy_version 725157 (0.0005) [2023-12-28 00:27:54,115][106226] Updated weights for policy 0, policy_version 725167 (0.0005) [2023-12-28 00:27:54,442][106225] Updated weights for policy 1, policy_version 727056 (0.0007) [2023-12-28 00:27:54,500][106225] Updated weights for policy 1, policy_version 727066 (0.0008) [2023-12-28 00:27:54,554][106225] Updated weights for policy 1, policy_version 727076 (0.0008) [2023-12-28 00:27:54,747][106226] Updated weights for policy 0, policy_version 725177 (0.0006) [2023-12-28 00:27:54,810][106226] Updated weights for policy 0, policy_version 725187 (0.0011) [2023-12-28 00:27:54,866][106226] Updated weights for policy 0, policy_version 725197 (0.0011) [2023-12-28 00:27:54,927][106226] Updated weights for policy 0, policy_version 725207 (0.0010) [2023-12-28 00:27:55,293][106225] Updated weights for policy 1, policy_version 727086 (0.0007) [2023-12-28 00:27:55,344][106225] Updated weights for policy 1, policy_version 727096 (0.0008) [2023-12-28 00:27:55,392][106225] Updated weights for policy 1, policy_version 727106 (0.0008) [2023-12-28 00:27:55,567][106226] Updated weights for policy 0, policy_version 725217 (0.0009) [2023-12-28 00:27:55,628][106226] Updated weights for policy 0, policy_version 725227 (0.0009) [2023-12-28 00:27:55,687][106226] Updated weights for policy 0, policy_version 725237 (0.0007) [2023-12-28 00:27:56,175][106225] Updated weights for policy 1, policy_version 727116 (0.0008) [2023-12-28 00:27:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 371892224. Throughput: 0: 9833.3, 1: 9934.6. Samples: 371866088. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:27:56,176][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.221')] [2023-12-28 00:27:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000725240_185712640.pth... [2023-12-28 00:27:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000724088_185417728.pth [2023-12-28 00:27:56,227][106225] Updated weights for policy 1, policy_version 727126 (0.0008) [2023-12-28 00:27:56,280][106225] Updated weights for policy 1, policy_version 727136 (0.0008) [2023-12-28 00:27:56,312][106226] Updated weights for policy 0, policy_version 725247 (0.0006) [2023-12-28 00:27:56,318][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000727144_186187776.pth... [2023-12-28 00:27:56,322][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000725992_185892864.pth [2023-12-28 00:27:56,377][106226] Updated weights for policy 0, policy_version 725257 (0.0008) [2023-12-28 00:27:56,435][106226] Updated weights for policy 0, policy_version 725267 (0.0008) [2023-12-28 00:27:57,042][106226] Updated weights for policy 0, policy_version 725277 (0.0007) [2023-12-28 00:27:57,061][106225] Updated weights for policy 1, policy_version 727146 (0.0006) [2023-12-28 00:27:57,098][106226] Updated weights for policy 0, policy_version 725287 (0.0005) [2023-12-28 00:27:57,113][106225] Updated weights for policy 1, policy_version 727156 (0.0009) [2023-12-28 00:27:57,146][106226] Updated weights for policy 0, policy_version 725297 (0.0005) [2023-12-28 00:27:57,175][106225] Updated weights for policy 1, policy_version 727166 (0.0007) [2023-12-28 00:27:57,230][106225] Updated weights for policy 1, policy_version 727176 (0.0007) [2023-12-28 00:27:57,768][106226] Updated weights for policy 0, policy_version 725307 (0.0006) [2023-12-28 00:27:57,818][106226] Updated weights for policy 0, policy_version 725317 (0.0008) [2023-12-28 00:27:57,877][106226] Updated weights for policy 0, policy_version 725327 (0.0007) [2023-12-28 00:27:57,974][106225] Updated weights for policy 1, policy_version 727186 (0.0010) [2023-12-28 00:27:58,030][106225] Updated weights for policy 1, policy_version 727196 (0.0008) [2023-12-28 00:27:58,079][106225] Updated weights for policy 1, policy_version 727206 (0.0009) [2023-12-28 00:27:58,528][106226] Updated weights for policy 0, policy_version 725337 (0.0006) [2023-12-28 00:27:58,589][106226] Updated weights for policy 0, policy_version 725347 (0.0009) [2023-12-28 00:27:58,659][106226] Updated weights for policy 0, policy_version 725357 (0.0008) [2023-12-28 00:27:58,727][106226] Updated weights for policy 0, policy_version 725367 (0.0009) [2023-12-28 00:27:58,945][106225] Updated weights for policy 1, policy_version 727216 (0.0008) [2023-12-28 00:27:59,012][106225] Updated weights for policy 1, policy_version 727226 (0.0009) [2023-12-28 00:27:59,075][106225] Updated weights for policy 1, policy_version 727236 (0.0007) [2023-12-28 00:27:59,561][106226] Updated weights for policy 0, policy_version 725377 (0.0006) [2023-12-28 00:27:59,626][106226] Updated weights for policy 0, policy_version 725387 (0.0007) [2023-12-28 00:27:59,681][106226] Updated weights for policy 0, policy_version 725397 (0.0006) [2023-12-28 00:27:59,815][106225] Updated weights for policy 1, policy_version 727246 (0.0009) [2023-12-28 00:27:59,883][106225] Updated weights for policy 1, policy_version 727256 (0.0009) [2023-12-28 00:27:59,947][106225] Updated weights for policy 1, policy_version 727266 (0.0009) [2023-12-28 00:28:00,430][106226] Updated weights for policy 0, policy_version 725407 (0.0008) [2023-12-28 00:28:00,477][106226] Updated weights for policy 0, policy_version 725417 (0.0008) [2023-12-28 00:28:00,535][106226] Updated weights for policy 0, policy_version 725427 (0.0008) [2023-12-28 00:28:00,594][106225] Updated weights for policy 1, policy_version 727276 (0.0006) [2023-12-28 00:28:00,644][106225] Updated weights for policy 1, policy_version 727286 (0.0007) [2023-12-28 00:28:00,695][106225] Updated weights for policy 1, policy_version 727296 (0.0008) [2023-12-28 00:28:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 371990528. Throughput: 0: 9932.6, 1: 9871.0. Samples: 371983012. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:28:01,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-5.367')] [2023-12-28 00:28:01,206][106226] Updated weights for policy 0, policy_version 725437 (0.0009) [2023-12-28 00:28:01,273][106226] Updated weights for policy 0, policy_version 725447 (0.0008) [2023-12-28 00:28:01,334][106226] Updated weights for policy 0, policy_version 725457 (0.0006) [2023-12-28 00:28:01,412][106225] Updated weights for policy 1, policy_version 727306 (0.0008) [2023-12-28 00:28:01,463][106225] Updated weights for policy 1, policy_version 727316 (0.0008) [2023-12-28 00:28:01,522][106225] Updated weights for policy 1, policy_version 727326 (0.0009) [2023-12-28 00:28:01,582][106225] Updated weights for policy 1, policy_version 727336 (0.0007) [2023-12-28 00:28:02,000][106226] Updated weights for policy 0, policy_version 725467 (0.0009) [2023-12-28 00:28:02,061][106226] Updated weights for policy 0, policy_version 725477 (0.0008) [2023-12-28 00:28:02,116][106226] Updated weights for policy 0, policy_version 725487 (0.0009) [2023-12-28 00:28:02,255][106225] Updated weights for policy 1, policy_version 727346 (0.0008) [2023-12-28 00:28:02,312][106225] Updated weights for policy 1, policy_version 727356 (0.0008) [2023-12-28 00:28:02,366][106225] Updated weights for policy 1, policy_version 727366 (0.0008) [2023-12-28 00:28:02,873][106226] Updated weights for policy 0, policy_version 725497 (0.0009) [2023-12-28 00:28:02,926][106226] Updated weights for policy 0, policy_version 725507 (0.0006) [2023-12-28 00:28:02,976][106226] Updated weights for policy 0, policy_version 725517 (0.0006) [2023-12-28 00:28:03,027][106226] Updated weights for policy 0, policy_version 725527 (0.0005) [2023-12-28 00:28:03,103][106225] Updated weights for policy 1, policy_version 727376 (0.0009) [2023-12-28 00:28:03,159][106225] Updated weights for policy 1, policy_version 727386 (0.0008) [2023-12-28 00:28:03,207][106225] Updated weights for policy 1, policy_version 727396 (0.0009) [2023-12-28 00:28:03,670][106226] Updated weights for policy 0, policy_version 725537 (0.0008) [2023-12-28 00:28:03,724][106226] Updated weights for policy 0, policy_version 725547 (0.0009) [2023-12-28 00:28:03,767][106226] Updated weights for policy 0, policy_version 725557 (0.0008) [2023-12-28 00:28:03,934][106225] Updated weights for policy 1, policy_version 727406 (0.0008) [2023-12-28 00:28:04,000][106225] Updated weights for policy 1, policy_version 727416 (0.0010) [2023-12-28 00:28:04,067][106225] Updated weights for policy 1, policy_version 727426 (0.0010) [2023-12-28 00:28:04,541][106226] Updated weights for policy 0, policy_version 725567 (0.0008) [2023-12-28 00:28:04,605][106226] Updated weights for policy 0, policy_version 725577 (0.0010) [2023-12-28 00:28:04,675][106226] Updated weights for policy 0, policy_version 725587 (0.0011) [2023-12-28 00:28:04,801][106225] Updated weights for policy 1, policy_version 727436 (0.0009) [2023-12-28 00:28:04,857][106225] Updated weights for policy 1, policy_version 727446 (0.0006) [2023-12-28 00:28:04,907][106225] Updated weights for policy 1, policy_version 727456 (0.0005) [2023-12-28 00:28:05,263][106226] Updated weights for policy 0, policy_version 725597 (0.0008) [2023-12-28 00:28:05,309][106226] Updated weights for policy 0, policy_version 725607 (0.0005) [2023-12-28 00:28:05,363][106226] Updated weights for policy 0, policy_version 725617 (0.0005) [2023-12-28 00:28:05,568][106225] Updated weights for policy 1, policy_version 727466 (0.0006) [2023-12-28 00:28:05,623][106225] Updated weights for policy 1, policy_version 727476 (0.0007) [2023-12-28 00:28:05,676][106225] Updated weights for policy 1, policy_version 727486 (0.0010) [2023-12-28 00:28:05,727][106225] Updated weights for policy 1, policy_version 727496 (0.0010) [2023-12-28 00:28:06,024][106226] Updated weights for policy 0, policy_version 725627 (0.0007) [2023-12-28 00:28:06,081][106226] Updated weights for policy 0, policy_version 725637 (0.0010) [2023-12-28 00:28:06,140][106226] Updated weights for policy 0, policy_version 725647 (0.0011) [2023-12-28 00:28:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 372088832. Throughput: 0: 9972.7, 1: 9826.7. Samples: 372102632. Policy #0 lag: (min: 13.0, avg: 30.4, max: 32.0) [2023-12-28 00:28:06,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.658')] [2023-12-28 00:28:06,470][106225] Updated weights for policy 1, policy_version 727506 (0.0008) [2023-12-28 00:28:06,526][106225] Updated weights for policy 1, policy_version 727516 (0.0008) [2023-12-28 00:28:06,582][106225] Updated weights for policy 1, policy_version 727526 (0.0008) [2023-12-28 00:28:06,878][106226] Updated weights for policy 0, policy_version 725657 (0.0008) [2023-12-28 00:28:06,928][106226] Updated weights for policy 0, policy_version 725667 (0.0010) [2023-12-28 00:28:06,975][106226] Updated weights for policy 0, policy_version 725677 (0.0010) [2023-12-28 00:28:07,022][106226] Updated weights for policy 0, policy_version 725687 (0.0010) [2023-12-28 00:28:07,322][106225] Updated weights for policy 1, policy_version 727536 (0.0010) [2023-12-28 00:28:07,370][106225] Updated weights for policy 1, policy_version 727546 (0.0010) [2023-12-28 00:28:07,418][106225] Updated weights for policy 1, policy_version 727556 (0.0010) [2023-12-28 00:28:07,768][106226] Updated weights for policy 0, policy_version 725697 (0.0006) [2023-12-28 00:28:07,827][106226] Updated weights for policy 0, policy_version 725707 (0.0009) [2023-12-28 00:28:07,880][106226] Updated weights for policy 0, policy_version 725717 (0.0010) [2023-12-28 00:28:08,187][106225] Updated weights for policy 1, policy_version 727566 (0.0010) [2023-12-28 00:28:08,247][106225] Updated weights for policy 1, policy_version 727576 (0.0006) [2023-12-28 00:28:08,312][106225] Updated weights for policy 1, policy_version 727586 (0.0005) [2023-12-28 00:28:08,532][106226] Updated weights for policy 0, policy_version 725727 (0.0007) [2023-12-28 00:28:08,589][106226] Updated weights for policy 0, policy_version 725737 (0.0006) [2023-12-28 00:28:08,646][106226] Updated weights for policy 0, policy_version 725747 (0.0009) [2023-12-28 00:28:08,998][106225] Updated weights for policy 1, policy_version 727596 (0.0007) [2023-12-28 00:28:09,056][106225] Updated weights for policy 1, policy_version 727606 (0.0005) [2023-12-28 00:28:09,109][106225] Updated weights for policy 1, policy_version 727616 (0.0006) [2023-12-28 00:28:09,367][106226] Updated weights for policy 0, policy_version 725757 (0.0009) [2023-12-28 00:28:09,433][106226] Updated weights for policy 0, policy_version 725767 (0.0008) [2023-12-28 00:28:09,490][106226] Updated weights for policy 0, policy_version 725777 (0.0007) [2023-12-28 00:28:09,816][106225] Updated weights for policy 1, policy_version 727626 (0.0008) [2023-12-28 00:28:09,878][106225] Updated weights for policy 1, policy_version 727636 (0.0008) [2023-12-28 00:28:09,945][106225] Updated weights for policy 1, policy_version 727646 (0.0008) [2023-12-28 00:28:09,998][106225] Updated weights for policy 1, policy_version 727656 (0.0009) [2023-12-28 00:28:10,197][106226] Updated weights for policy 0, policy_version 725787 (0.0008) [2023-12-28 00:28:10,262][106226] Updated weights for policy 0, policy_version 725797 (0.0006) [2023-12-28 00:28:10,327][106226] Updated weights for policy 0, policy_version 725807 (0.0006) [2023-12-28 00:28:10,741][106225] Updated weights for policy 1, policy_version 727666 (0.0010) [2023-12-28 00:28:10,797][106225] Updated weights for policy 1, policy_version 727676 (0.0011) [2023-12-28 00:28:10,847][106225] Updated weights for policy 1, policy_version 727686 (0.0010) [2023-12-28 00:28:10,962][106226] Updated weights for policy 0, policy_version 725817 (0.0006) [2023-12-28 00:28:11,010][106226] Updated weights for policy 0, policy_version 725827 (0.0010) [2023-12-28 00:28:11,073][106226] Updated weights for policy 0, policy_version 725837 (0.0008) [2023-12-28 00:28:11,130][106226] Updated weights for policy 0, policy_version 725847 (0.0008) [2023-12-28 00:28:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 372195328. Throughput: 0: 10008.5, 1: 9813.8. Samples: 372160624. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:11,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-5.270')] [2023-12-28 00:28:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000727688_186327040.pth... [2023-12-28 00:28:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000725848_185868288.pth... [2023-12-28 00:28:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000726568_186040320.pth [2023-12-28 00:28:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000724664_185565184.pth [2023-12-28 00:28:11,674][106225] Updated weights for policy 1, policy_version 727696 (0.0009) [2023-12-28 00:28:11,742][106225] Updated weights for policy 1, policy_version 727706 (0.0013) [2023-12-28 00:28:11,813][106225] Updated weights for policy 1, policy_version 727716 (0.0011) [2023-12-28 00:28:11,936][106226] Updated weights for policy 0, policy_version 725857 (0.0008) [2023-12-28 00:28:11,997][106226] Updated weights for policy 0, policy_version 725867 (0.0008) [2023-12-28 00:28:12,059][106226] Updated weights for policy 0, policy_version 725877 (0.0008) [2023-12-28 00:28:12,614][106225] Updated weights for policy 1, policy_version 727726 (0.0010) [2023-12-28 00:28:12,679][106225] Updated weights for policy 1, policy_version 727736 (0.0010) [2023-12-28 00:28:12,737][106225] Updated weights for policy 1, policy_version 727746 (0.0010) [2023-12-28 00:28:12,763][106226] Updated weights for policy 0, policy_version 725887 (0.0008) [2023-12-28 00:28:12,829][106226] Updated weights for policy 0, policy_version 725897 (0.0006) [2023-12-28 00:28:12,885][106226] Updated weights for policy 0, policy_version 725907 (0.0005) [2023-12-28 00:28:13,442][106225] Updated weights for policy 1, policy_version 727756 (0.0010) [2023-12-28 00:28:13,499][106226] Updated weights for policy 0, policy_version 725917 (0.0005) [2023-12-28 00:28:13,506][106225] Updated weights for policy 1, policy_version 727766 (0.0010) [2023-12-28 00:28:13,554][106225] Updated weights for policy 1, policy_version 727776 (0.0010) [2023-12-28 00:28:13,560][106226] Updated weights for policy 0, policy_version 725927 (0.0006) [2023-12-28 00:28:13,617][106226] Updated weights for policy 0, policy_version 725937 (0.0006) [2023-12-28 00:28:14,217][106226] Updated weights for policy 0, policy_version 725947 (0.0008) [2023-12-28 00:28:14,267][106225] Updated weights for policy 1, policy_version 727786 (0.0009) [2023-12-28 00:28:14,275][106226] Updated weights for policy 0, policy_version 725957 (0.0008) [2023-12-28 00:28:14,324][106225] Updated weights for policy 1, policy_version 727796 (0.0010) [2023-12-28 00:28:14,327][106226] Updated weights for policy 0, policy_version 725967 (0.0010) [2023-12-28 00:28:14,384][106225] Updated weights for policy 1, policy_version 727806 (0.0006) [2023-12-28 00:28:14,433][106225] Updated weights for policy 1, policy_version 727816 (0.0005) [2023-12-28 00:28:15,037][106226] Updated weights for policy 0, policy_version 725977 (0.0011) [2023-12-28 00:28:15,045][106225] Updated weights for policy 1, policy_version 727826 (0.0011) [2023-12-28 00:28:15,100][106226] Updated weights for policy 0, policy_version 725987 (0.0010) [2023-12-28 00:28:15,105][106225] Updated weights for policy 1, policy_version 727836 (0.0010) [2023-12-28 00:28:15,152][106226] Updated weights for policy 0, policy_version 725997 (0.0010) [2023-12-28 00:28:15,164][106225] Updated weights for policy 1, policy_version 727846 (0.0010) [2023-12-28 00:28:15,219][106226] Updated weights for policy 0, policy_version 726007 (0.0011) [2023-12-28 00:28:15,859][106225] Updated weights for policy 1, policy_version 727856 (0.0008) [2023-12-28 00:28:15,904][106226] Updated weights for policy 0, policy_version 726017 (0.0006) [2023-12-28 00:28:15,913][106225] Updated weights for policy 1, policy_version 727866 (0.0009) [2023-12-28 00:28:15,966][106226] Updated weights for policy 0, policy_version 726027 (0.0008) [2023-12-28 00:28:15,968][106225] Updated weights for policy 1, policy_version 727876 (0.0006) [2023-12-28 00:28:16,036][106226] Updated weights for policy 0, policy_version 726037 (0.0011) [2023-12-28 00:28:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 372293632. Throughput: 0: 9983.3, 1: 9745.9. Samples: 372278864. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:16,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-5.701')] [2023-12-28 00:28:16,594][106225] Updated weights for policy 1, policy_version 727886 (0.0007) [2023-12-28 00:28:16,640][106225] Updated weights for policy 1, policy_version 727896 (0.0007) [2023-12-28 00:28:16,651][106226] Updated weights for policy 0, policy_version 726047 (0.0007) [2023-12-28 00:28:16,693][106225] Updated weights for policy 1, policy_version 727906 (0.0007) [2023-12-28 00:28:16,714][106226] Updated weights for policy 0, policy_version 726057 (0.0005) [2023-12-28 00:28:16,778][106226] Updated weights for policy 0, policy_version 726067 (0.0008) [2023-12-28 00:28:17,427][106225] Updated weights for policy 1, policy_version 727916 (0.0008) [2023-12-28 00:28:17,467][106226] Updated weights for policy 0, policy_version 726077 (0.0009) [2023-12-28 00:28:17,496][106225] Updated weights for policy 1, policy_version 727926 (0.0005) [2023-12-28 00:28:17,521][106226] Updated weights for policy 0, policy_version 726087 (0.0007) [2023-12-28 00:28:17,557][106225] Updated weights for policy 1, policy_version 727936 (0.0005) [2023-12-28 00:28:17,576][106226] Updated weights for policy 0, policy_version 726097 (0.0008) [2023-12-28 00:28:18,041][106225] Updated weights for policy 1, policy_version 727946 (0.0005) [2023-12-28 00:28:18,100][106225] Updated weights for policy 1, policy_version 727956 (0.0005) [2023-12-28 00:28:18,163][106225] Updated weights for policy 1, policy_version 727966 (0.0005) [2023-12-28 00:28:18,221][106225] Updated weights for policy 1, policy_version 727976 (0.0006) [2023-12-28 00:28:18,417][106226] Updated weights for policy 0, policy_version 726107 (0.0008) [2023-12-28 00:28:18,476][106226] Updated weights for policy 0, policy_version 726117 (0.0008) [2023-12-28 00:28:18,538][106226] Updated weights for policy 0, policy_version 726127 (0.0009) [2023-12-28 00:28:18,861][106225] Updated weights for policy 1, policy_version 727986 (0.0007) [2023-12-28 00:28:18,926][106225] Updated weights for policy 1, policy_version 727996 (0.0010) [2023-12-28 00:28:18,982][106225] Updated weights for policy 1, policy_version 728006 (0.0010) [2023-12-28 00:28:19,271][106226] Updated weights for policy 0, policy_version 726137 (0.0009) [2023-12-28 00:28:19,328][106226] Updated weights for policy 0, policy_version 726147 (0.0008) [2023-12-28 00:28:19,396][106226] Updated weights for policy 0, policy_version 726157 (0.0007) [2023-12-28 00:28:19,460][106226] Updated weights for policy 0, policy_version 726167 (0.0008) [2023-12-28 00:28:19,681][106225] Updated weights for policy 1, policy_version 728016 (0.0009) [2023-12-28 00:28:19,746][106225] Updated weights for policy 1, policy_version 728026 (0.0008) [2023-12-28 00:28:19,810][106225] Updated weights for policy 1, policy_version 728036 (0.0007) [2023-12-28 00:28:20,234][106226] Updated weights for policy 0, policy_version 726177 (0.0008) [2023-12-28 00:28:20,296][106226] Updated weights for policy 0, policy_version 726187 (0.0008) [2023-12-28 00:28:20,360][106226] Updated weights for policy 0, policy_version 726197 (0.0007) [2023-12-28 00:28:20,542][106225] Updated weights for policy 1, policy_version 728046 (0.0008) [2023-12-28 00:28:20,603][106225] Updated weights for policy 1, policy_version 728056 (0.0006) [2023-12-28 00:28:20,663][106225] Updated weights for policy 1, policy_version 728066 (0.0006) [2023-12-28 00:28:21,125][106226] Updated weights for policy 0, policy_version 726207 (0.0010) [2023-12-28 00:28:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 372383744. Throughput: 0: 9932.1, 1: 9697.9. Samples: 372397516. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:21,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-5.779')] [2023-12-28 00:28:21,192][106226] Updated weights for policy 0, policy_version 726217 (0.0008) [2023-12-28 00:28:21,250][106226] Updated weights for policy 0, policy_version 726227 (0.0010) [2023-12-28 00:28:21,339][106225] Updated weights for policy 1, policy_version 728076 (0.0009) [2023-12-28 00:28:21,407][106225] Updated weights for policy 1, policy_version 728086 (0.0010) [2023-12-28 00:28:21,461][106225] Updated weights for policy 1, policy_version 728096 (0.0010) [2023-12-28 00:28:21,965][106226] Updated weights for policy 0, policy_version 726237 (0.0009) [2023-12-28 00:28:22,024][106226] Updated weights for policy 0, policy_version 726247 (0.0008) [2023-12-28 00:28:22,084][106226] Updated weights for policy 0, policy_version 726257 (0.0008) [2023-12-28 00:28:22,287][106225] Updated weights for policy 1, policy_version 728106 (0.0011) [2023-12-28 00:28:22,356][106225] Updated weights for policy 1, policy_version 728116 (0.0011) [2023-12-28 00:28:22,425][106225] Updated weights for policy 1, policy_version 728126 (0.0009) [2023-12-28 00:28:22,476][106225] Updated weights for policy 1, policy_version 728136 (0.0010) [2023-12-28 00:28:22,869][106226] Updated weights for policy 0, policy_version 726267 (0.0008) [2023-12-28 00:28:22,928][106226] Updated weights for policy 0, policy_version 726277 (0.0008) [2023-12-28 00:28:22,986][106226] Updated weights for policy 0, policy_version 726287 (0.0008) [2023-12-28 00:28:23,235][106225] Updated weights for policy 1, policy_version 728146 (0.0010) [2023-12-28 00:28:23,291][106225] Updated weights for policy 1, policy_version 728156 (0.0010) [2023-12-28 00:28:23,353][106225] Updated weights for policy 1, policy_version 728166 (0.0008) [2023-12-28 00:28:23,730][106226] Updated weights for policy 0, policy_version 726297 (0.0009) [2023-12-28 00:28:23,794][106226] Updated weights for policy 0, policy_version 726307 (0.0007) [2023-12-28 00:28:23,852][106226] Updated weights for policy 0, policy_version 726317 (0.0005) [2023-12-28 00:28:23,900][106226] Updated weights for policy 0, policy_version 726327 (0.0005) [2023-12-28 00:28:24,074][106225] Updated weights for policy 1, policy_version 728176 (0.0007) [2023-12-28 00:28:24,138][106225] Updated weights for policy 1, policy_version 728186 (0.0007) [2023-12-28 00:28:24,207][106225] Updated weights for policy 1, policy_version 728196 (0.0005) [2023-12-28 00:28:24,565][106226] Updated weights for policy 0, policy_version 726337 (0.0005) [2023-12-28 00:28:24,624][106226] Updated weights for policy 0, policy_version 726347 (0.0005) [2023-12-28 00:28:24,676][106226] Updated weights for policy 0, policy_version 726357 (0.0008) [2023-12-28 00:28:24,810][106225] Updated weights for policy 1, policy_version 728206 (0.0008) [2023-12-28 00:28:24,869][106225] Updated weights for policy 1, policy_version 728216 (0.0008) [2023-12-28 00:28:24,928][106225] Updated weights for policy 1, policy_version 728226 (0.0005) [2023-12-28 00:28:25,399][106226] Updated weights for policy 0, policy_version 726367 (0.0007) [2023-12-28 00:28:25,461][106226] Updated weights for policy 0, policy_version 726377 (0.0006) [2023-12-28 00:28:25,518][106226] Updated weights for policy 0, policy_version 726387 (0.0010) [2023-12-28 00:28:25,538][106225] Updated weights for policy 1, policy_version 728236 (0.0008) [2023-12-28 00:28:25,593][106225] Updated weights for policy 1, policy_version 728246 (0.0011) [2023-12-28 00:28:25,650][106225] Updated weights for policy 1, policy_version 728256 (0.0010) [2023-12-28 00:28:26,112][106226] Updated weights for policy 0, policy_version 726397 (0.0011) [2023-12-28 00:28:26,167][106226] Updated weights for policy 0, policy_version 726407 (0.0006) [2023-12-28 00:28:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 372482048. Throughput: 0: 9875.4, 1: 9711.1. Samples: 372453924. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:26,176][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.250')] [2023-12-28 00:28:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000728264_186474496.pth... [2023-12-28 00:28:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000727144_186187776.pth [2023-12-28 00:28:26,219][106226] Updated weights for policy 0, policy_version 726417 (0.0007) [2023-12-28 00:28:26,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000726424_186015744.pth... [2023-12-28 00:28:26,265][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000725240_185712640.pth [2023-12-28 00:28:26,395][106225] Updated weights for policy 1, policy_version 728266 (0.0009) [2023-12-28 00:28:26,443][106225] Updated weights for policy 1, policy_version 728276 (0.0005) [2023-12-28 00:28:26,499][106225] Updated weights for policy 1, policy_version 728286 (0.0005) [2023-12-28 00:28:26,557][106225] Updated weights for policy 1, policy_version 728296 (0.0008) [2023-12-28 00:28:26,879][106226] Updated weights for policy 0, policy_version 726427 (0.0007) [2023-12-28 00:28:26,928][106226] Updated weights for policy 0, policy_version 726437 (0.0010) [2023-12-28 00:28:26,977][106226] Updated weights for policy 0, policy_version 726447 (0.0010) [2023-12-28 00:28:27,117][106225] Updated weights for policy 1, policy_version 728306 (0.0005) [2023-12-28 00:28:27,164][106225] Updated weights for policy 1, policy_version 728316 (0.0010) [2023-12-28 00:28:27,210][106225] Updated weights for policy 1, policy_version 728326 (0.0010) [2023-12-28 00:28:27,638][106226] Updated weights for policy 0, policy_version 726457 (0.0010) [2023-12-28 00:28:27,695][106226] Updated weights for policy 0, policy_version 726467 (0.0005) [2023-12-28 00:28:27,756][106226] Updated weights for policy 0, policy_version 726477 (0.0005) [2023-12-28 00:28:27,792][106225] Updated weights for policy 1, policy_version 728336 (0.0010) [2023-12-28 00:28:27,809][106226] Updated weights for policy 0, policy_version 726487 (0.0005) [2023-12-28 00:28:27,855][106225] Updated weights for policy 1, policy_version 728346 (0.0010) [2023-12-28 00:28:27,924][106225] Updated weights for policy 1, policy_version 728356 (0.0010) [2023-12-28 00:28:28,291][106226] Updated weights for policy 0, policy_version 726497 (0.0010) [2023-12-28 00:28:28,345][106226] Updated weights for policy 0, policy_version 726507 (0.0009) [2023-12-28 00:28:28,413][106226] Updated weights for policy 0, policy_version 726517 (0.0010) [2023-12-28 00:28:28,621][106225] Updated weights for policy 1, policy_version 728366 (0.0010) [2023-12-28 00:28:28,678][106225] Updated weights for policy 1, policy_version 728376 (0.0010) [2023-12-28 00:28:28,731][106225] Updated weights for policy 1, policy_version 728386 (0.0010) [2023-12-28 00:28:29,056][106226] Updated weights for policy 0, policy_version 726527 (0.0007) [2023-12-28 00:28:29,111][106226] Updated weights for policy 0, policy_version 726537 (0.0006) [2023-12-28 00:28:29,165][106226] Updated weights for policy 0, policy_version 726547 (0.0005) [2023-12-28 00:28:29,458][106225] Updated weights for policy 1, policy_version 728396 (0.0010) [2023-12-28 00:28:29,514][106225] Updated weights for policy 1, policy_version 728406 (0.0010) [2023-12-28 00:28:29,564][106225] Updated weights for policy 1, policy_version 728416 (0.0010) [2023-12-28 00:28:29,839][106226] Updated weights for policy 0, policy_version 726557 (0.0007) [2023-12-28 00:28:29,899][106226] Updated weights for policy 0, policy_version 726567 (0.0008) [2023-12-28 00:28:29,960][106226] Updated weights for policy 0, policy_version 726577 (0.0008) [2023-12-28 00:28:30,236][106225] Updated weights for policy 1, policy_version 728426 (0.0010) [2023-12-28 00:28:30,304][106225] Updated weights for policy 1, policy_version 728436 (0.0008) [2023-12-28 00:28:30,366][106225] Updated weights for policy 1, policy_version 728446 (0.0008) [2023-12-28 00:28:30,425][106225] Updated weights for policy 1, policy_version 728456 (0.0005) [2023-12-28 00:28:30,782][106226] Updated weights for policy 0, policy_version 726587 (0.0008) [2023-12-28 00:28:30,836][106226] Updated weights for policy 0, policy_version 726597 (0.0009) [2023-12-28 00:28:30,889][106226] Updated weights for policy 0, policy_version 726607 (0.0009) [2023-12-28 00:28:31,026][106225] Updated weights for policy 1, policy_version 728466 (0.0008) [2023-12-28 00:28:31,094][106225] Updated weights for policy 1, policy_version 728476 (0.0007) [2023-12-28 00:28:31,170][106225] Updated weights for policy 1, policy_version 728486 (0.0007) [2023-12-28 00:28:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 372588544. Throughput: 0: 10012.1, 1: 9814.4. Samples: 372580044. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:31,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-5.921')] [2023-12-28 00:28:31,698][106226] Updated weights for policy 0, policy_version 726617 (0.0009) [2023-12-28 00:28:31,766][106226] Updated weights for policy 0, policy_version 726627 (0.0010) [2023-12-28 00:28:31,827][106226] Updated weights for policy 0, policy_version 726637 (0.0011) [2023-12-28 00:28:31,845][106225] Updated weights for policy 1, policy_version 728496 (0.0009) [2023-12-28 00:28:31,886][106226] Updated weights for policy 0, policy_version 726647 (0.0009) [2023-12-28 00:28:31,904][106225] Updated weights for policy 1, policy_version 728506 (0.0006) [2023-12-28 00:28:31,960][106225] Updated weights for policy 1, policy_version 728516 (0.0008) [2023-12-28 00:28:32,608][106226] Updated weights for policy 0, policy_version 726657 (0.0009) [2023-12-28 00:28:32,660][106226] Updated weights for policy 0, policy_version 726667 (0.0008) [2023-12-28 00:28:32,716][106226] Updated weights for policy 0, policy_version 726677 (0.0008) [2023-12-28 00:28:32,726][106225] Updated weights for policy 1, policy_version 728526 (0.0006) [2023-12-28 00:28:32,785][106225] Updated weights for policy 1, policy_version 728536 (0.0008) [2023-12-28 00:28:32,845][106225] Updated weights for policy 1, policy_version 728546 (0.0008) [2023-12-28 00:28:33,384][106226] Updated weights for policy 0, policy_version 726687 (0.0007) [2023-12-28 00:28:33,433][106226] Updated weights for policy 0, policy_version 726697 (0.0008) [2023-12-28 00:28:33,481][106226] Updated weights for policy 0, policy_version 726707 (0.0008) [2023-12-28 00:28:33,546][106225] Updated weights for policy 1, policy_version 728556 (0.0008) [2023-12-28 00:28:33,591][106225] Updated weights for policy 1, policy_version 728566 (0.0005) [2023-12-28 00:28:33,648][106225] Updated weights for policy 1, policy_version 728576 (0.0005) [2023-12-28 00:28:34,161][106225] Updated weights for policy 1, policy_version 728586 (0.0006) [2023-12-28 00:28:34,217][106225] Updated weights for policy 1, policy_version 728596 (0.0008) [2023-12-28 00:28:34,275][106226] Updated weights for policy 0, policy_version 726717 (0.0009) [2023-12-28 00:28:34,282][106225] Updated weights for policy 1, policy_version 728606 (0.0007) [2023-12-28 00:28:34,339][106226] Updated weights for policy 0, policy_version 726727 (0.0008) [2023-12-28 00:28:34,347][106225] Updated weights for policy 1, policy_version 728616 (0.0007) [2023-12-28 00:28:34,397][106226] Updated weights for policy 0, policy_version 726737 (0.0008) [2023-12-28 00:28:35,065][106225] Updated weights for policy 1, policy_version 728626 (0.0008) [2023-12-28 00:28:35,091][106226] Updated weights for policy 0, policy_version 726747 (0.0007) [2023-12-28 00:28:35,125][106225] Updated weights for policy 1, policy_version 728636 (0.0007) [2023-12-28 00:28:35,147][106226] Updated weights for policy 0, policy_version 726757 (0.0006) [2023-12-28 00:28:35,185][106225] Updated weights for policy 1, policy_version 728646 (0.0009) [2023-12-28 00:28:35,201][106226] Updated weights for policy 0, policy_version 726767 (0.0008) [2023-12-28 00:28:35,800][106225] Updated weights for policy 1, policy_version 728656 (0.0008) [2023-12-28 00:28:35,848][106225] Updated weights for policy 1, policy_version 728666 (0.0008) [2023-12-28 00:28:35,900][106225] Updated weights for policy 1, policy_version 728676 (0.0008) [2023-12-28 00:28:35,965][106226] Updated weights for policy 0, policy_version 726777 (0.0009) [2023-12-28 00:28:36,025][106226] Updated weights for policy 0, policy_version 726787 (0.0009) [2023-12-28 00:28:36,083][106226] Updated weights for policy 0, policy_version 726797 (0.0008) [2023-12-28 00:28:36,155][106226] Updated weights for policy 0, policy_version 726807 (0.0009) [2023-12-28 00:28:36,174][105115] Fps is (10 sec: 21299.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 372695040. Throughput: 0: 9944.4, 1: 9838.2. Samples: 372698908. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:36,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.282')] [2023-12-28 00:28:36,684][106225] Updated weights for policy 1, policy_version 728686 (0.0009) [2023-12-28 00:28:36,731][106225] Updated weights for policy 1, policy_version 728696 (0.0008) [2023-12-28 00:28:36,781][106225] Updated weights for policy 1, policy_version 728706 (0.0010) [2023-12-28 00:28:36,839][106226] Updated weights for policy 0, policy_version 726817 (0.0006) [2023-12-28 00:28:36,904][106226] Updated weights for policy 0, policy_version 726827 (0.0005) [2023-12-28 00:28:36,970][106226] Updated weights for policy 0, policy_version 726837 (0.0008) [2023-12-28 00:28:37,442][106225] Updated weights for policy 1, policy_version 728716 (0.0008) [2023-12-28 00:28:37,506][106225] Updated weights for policy 1, policy_version 728726 (0.0008) [2023-12-28 00:28:37,571][106225] Updated weights for policy 1, policy_version 728736 (0.0008) [2023-12-28 00:28:37,685][106226] Updated weights for policy 0, policy_version 726847 (0.0009) [2023-12-28 00:28:37,750][106226] Updated weights for policy 0, policy_version 726857 (0.0008) [2023-12-28 00:28:37,818][106226] Updated weights for policy 0, policy_version 726867 (0.0009) [2023-12-28 00:28:38,271][106225] Updated weights for policy 1, policy_version 728746 (0.0008) [2023-12-28 00:28:38,327][106225] Updated weights for policy 1, policy_version 728756 (0.0008) [2023-12-28 00:28:38,393][106225] Updated weights for policy 1, policy_version 728766 (0.0006) [2023-12-28 00:28:38,451][106225] Updated weights for policy 1, policy_version 728776 (0.0008) [2023-12-28 00:28:38,482][106226] Updated weights for policy 0, policy_version 726877 (0.0009) [2023-12-28 00:28:38,537][106226] Updated weights for policy 0, policy_version 726887 (0.0009) [2023-12-28 00:28:38,599][106226] Updated weights for policy 0, policy_version 726897 (0.0011) [2023-12-28 00:28:39,106][106225] Updated weights for policy 1, policy_version 728786 (0.0007) [2023-12-28 00:28:39,169][106225] Updated weights for policy 1, policy_version 728796 (0.0007) [2023-12-28 00:28:39,234][106225] Updated weights for policy 1, policy_version 728806 (0.0006) [2023-12-28 00:28:39,376][106226] Updated weights for policy 0, policy_version 726907 (0.0010) [2023-12-28 00:28:39,451][106226] Updated weights for policy 0, policy_version 726917 (0.0010) [2023-12-28 00:28:39,516][106226] Updated weights for policy 0, policy_version 726927 (0.0011) [2023-12-28 00:28:39,988][106225] Updated weights for policy 1, policy_version 728816 (0.0008) [2023-12-28 00:28:40,053][106225] Updated weights for policy 1, policy_version 728826 (0.0007) [2023-12-28 00:28:40,112][106225] Updated weights for policy 1, policy_version 728836 (0.0007) [2023-12-28 00:28:40,266][106226] Updated weights for policy 0, policy_version 726937 (0.0011) [2023-12-28 00:28:40,331][106226] Updated weights for policy 0, policy_version 726947 (0.0011) [2023-12-28 00:28:40,390][106226] Updated weights for policy 0, policy_version 726957 (0.0011) [2023-12-28 00:28:40,454][106226] Updated weights for policy 0, policy_version 726967 (0.0011) [2023-12-28 00:28:40,888][106225] Updated weights for policy 1, policy_version 728846 (0.0007) [2023-12-28 00:28:40,947][106225] Updated weights for policy 1, policy_version 728856 (0.0005) [2023-12-28 00:28:41,004][106225] Updated weights for policy 1, policy_version 728866 (0.0005) [2023-12-28 00:28:41,085][106226] Updated weights for policy 0, policy_version 726977 (0.0008) [2023-12-28 00:28:41,149][106226] Updated weights for policy 0, policy_version 726987 (0.0006) [2023-12-28 00:28:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 372785152. Throughput: 0: 9913.6, 1: 9900.7. Samples: 372757732. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:41,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-5.601')] [2023-12-28 00:28:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000728872_186630144.pth... [2023-12-28 00:28:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000727688_186327040.pth [2023-12-28 00:28:41,218][106226] Updated weights for policy 0, policy_version 726997 (0.0008) [2023-12-28 00:28:41,239][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000727000_186163200.pth... [2023-12-28 00:28:41,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000725848_185868288.pth [2023-12-28 00:28:41,787][106225] Updated weights for policy 1, policy_version 728876 (0.0007) [2023-12-28 00:28:41,849][106225] Updated weights for policy 1, policy_version 728886 (0.0009) [2023-12-28 00:28:41,915][106225] Updated weights for policy 1, policy_version 728896 (0.0008) [2023-12-28 00:28:41,927][106226] Updated weights for policy 0, policy_version 727007 (0.0008) [2023-12-28 00:28:41,993][106226] Updated weights for policy 0, policy_version 727017 (0.0007) [2023-12-28 00:28:42,057][106226] Updated weights for policy 0, policy_version 727027 (0.0008) [2023-12-28 00:28:42,631][106225] Updated weights for policy 1, policy_version 728906 (0.0008) [2023-12-28 00:28:42,687][106225] Updated weights for policy 1, policy_version 728916 (0.0008) [2023-12-28 00:28:42,740][106225] Updated weights for policy 1, policy_version 728926 (0.0009) [2023-12-28 00:28:42,779][106226] Updated weights for policy 0, policy_version 727037 (0.0007) [2023-12-28 00:28:42,788][106225] Updated weights for policy 1, policy_version 728936 (0.0008) [2023-12-28 00:28:42,833][106226] Updated weights for policy 0, policy_version 727047 (0.0005) [2023-12-28 00:28:42,895][106226] Updated weights for policy 0, policy_version 727057 (0.0006) [2023-12-28 00:28:43,455][106226] Updated weights for policy 0, policy_version 727067 (0.0008) [2023-12-28 00:28:43,506][106226] Updated weights for policy 0, policy_version 727077 (0.0007) [2023-12-28 00:28:43,556][106226] Updated weights for policy 0, policy_version 727087 (0.0007) [2023-12-28 00:28:43,584][106225] Updated weights for policy 1, policy_version 728946 (0.0005) [2023-12-28 00:28:43,643][106225] Updated weights for policy 1, policy_version 728956 (0.0006) [2023-12-28 00:28:43,707][106225] Updated weights for policy 1, policy_version 728966 (0.0005) [2023-12-28 00:28:44,269][106226] Updated weights for policy 0, policy_version 727097 (0.0009) [2023-12-28 00:28:44,269][106225] Updated weights for policy 1, policy_version 728976 (0.0008) [2023-12-28 00:28:44,322][106225] Updated weights for policy 1, policy_version 728986 (0.0006) [2023-12-28 00:28:44,332][106226] Updated weights for policy 0, policy_version 727107 (0.0008) [2023-12-28 00:28:44,374][106225] Updated weights for policy 1, policy_version 728996 (0.0006) [2023-12-28 00:28:44,384][106226] Updated weights for policy 0, policy_version 727117 (0.0006) [2023-12-28 00:28:44,432][106226] Updated weights for policy 0, policy_version 727127 (0.0008) [2023-12-28 00:28:45,121][106226] Updated weights for policy 0, policy_version 727137 (0.0009) [2023-12-28 00:28:45,144][106225] Updated weights for policy 1, policy_version 729006 (0.0007) [2023-12-28 00:28:45,183][106226] Updated weights for policy 0, policy_version 727147 (0.0008) [2023-12-28 00:28:45,205][106225] Updated weights for policy 1, policy_version 729016 (0.0009) [2023-12-28 00:28:45,243][106226] Updated weights for policy 0, policy_version 727157 (0.0006) [2023-12-28 00:28:45,271][106225] Updated weights for policy 1, policy_version 729026 (0.0011) [2023-12-28 00:28:45,873][106226] Updated weights for policy 0, policy_version 727167 (0.0007) [2023-12-28 00:28:45,912][106225] Updated weights for policy 1, policy_version 729036 (0.0008) [2023-12-28 00:28:45,923][106226] Updated weights for policy 0, policy_version 727177 (0.0005) [2023-12-28 00:28:45,966][106225] Updated weights for policy 1, policy_version 729046 (0.0006) [2023-12-28 00:28:45,975][106226] Updated weights for policy 0, policy_version 727187 (0.0005) [2023-12-28 00:28:46,026][106225] Updated weights for policy 1, policy_version 729056 (0.0010) [2023-12-28 00:28:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 372891648. Throughput: 0: 9863.8, 1: 9951.4. Samples: 372874696. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:46,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.353')] [2023-12-28 00:28:46,603][106225] Updated weights for policy 1, policy_version 729066 (0.0009) [2023-12-28 00:28:46,609][106226] Updated weights for policy 0, policy_version 727197 (0.0006) [2023-12-28 00:28:46,663][106225] Updated weights for policy 1, policy_version 729076 (0.0008) [2023-12-28 00:28:46,670][106226] Updated weights for policy 0, policy_version 727207 (0.0007) [2023-12-28 00:28:46,724][106225] Updated weights for policy 1, policy_version 729086 (0.0007) [2023-12-28 00:28:46,736][106226] Updated weights for policy 0, policy_version 727217 (0.0008) [2023-12-28 00:28:46,781][106225] Updated weights for policy 1, policy_version 729096 (0.0008) [2023-12-28 00:28:47,346][106226] Updated weights for policy 0, policy_version 727227 (0.0007) [2023-12-28 00:28:47,350][106225] Updated weights for policy 1, policy_version 729106 (0.0005) [2023-12-28 00:28:47,396][106226] Updated weights for policy 0, policy_version 727237 (0.0005) [2023-12-28 00:28:47,419][106225] Updated weights for policy 1, policy_version 729116 (0.0005) [2023-12-28 00:28:47,456][106226] Updated weights for policy 0, policy_version 727247 (0.0005) [2023-12-28 00:28:47,469][106225] Updated weights for policy 1, policy_version 729126 (0.0008) [2023-12-28 00:28:48,026][106225] Updated weights for policy 1, policy_version 729136 (0.0006) [2023-12-28 00:28:48,073][106226] Updated weights for policy 0, policy_version 727257 (0.0005) [2023-12-28 00:28:48,084][106225] Updated weights for policy 1, policy_version 729146 (0.0005) [2023-12-28 00:28:48,135][106226] Updated weights for policy 0, policy_version 727267 (0.0006) [2023-12-28 00:28:48,148][106225] Updated weights for policy 1, policy_version 729156 (0.0005) [2023-12-28 00:28:48,188][106226] Updated weights for policy 0, policy_version 727277 (0.0007) [2023-12-28 00:28:48,234][106226] Updated weights for policy 0, policy_version 727287 (0.0005) [2023-12-28 00:28:48,681][106225] Updated weights for policy 1, policy_version 729166 (0.0007) [2023-12-28 00:28:48,747][106225] Updated weights for policy 1, policy_version 729176 (0.0007) [2023-12-28 00:28:48,815][106225] Updated weights for policy 1, policy_version 729186 (0.0008) [2023-12-28 00:28:48,979][106226] Updated weights for policy 0, policy_version 727297 (0.0006) [2023-12-28 00:28:49,032][106226] Updated weights for policy 0, policy_version 727307 (0.0009) [2023-12-28 00:28:49,081][106226] Updated weights for policy 0, policy_version 727317 (0.0008) [2023-12-28 00:28:49,440][106225] Updated weights for policy 1, policy_version 729196 (0.0010) [2023-12-28 00:28:49,497][106225] Updated weights for policy 1, policy_version 729206 (0.0010) [2023-12-28 00:28:49,553][106225] Updated weights for policy 1, policy_version 729216 (0.0010) [2023-12-28 00:28:49,844][106226] Updated weights for policy 0, policy_version 727327 (0.0009) [2023-12-28 00:28:49,910][106226] Updated weights for policy 0, policy_version 727337 (0.0007) [2023-12-28 00:28:49,981][106226] Updated weights for policy 0, policy_version 727347 (0.0010) [2023-12-28 00:28:50,305][106225] Updated weights for policy 1, policy_version 729226 (0.0010) [2023-12-28 00:28:50,360][106225] Updated weights for policy 1, policy_version 729236 (0.0010) [2023-12-28 00:28:50,418][106225] Updated weights for policy 1, policy_version 729246 (0.0009) [2023-12-28 00:28:50,475][106225] Updated weights for policy 1, policy_version 729256 (0.0010) [2023-12-28 00:28:50,666][106226] Updated weights for policy 0, policy_version 727357 (0.0011) [2023-12-28 00:28:50,724][106226] Updated weights for policy 0, policy_version 727367 (0.0011) [2023-12-28 00:28:50,786][106226] Updated weights for policy 0, policy_version 727377 (0.0011) [2023-12-28 00:28:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 372989952. Throughput: 0: 9883.6, 1: 10077.1. Samples: 373000864. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:51,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-5.625')] [2023-12-28 00:28:51,257][106225] Updated weights for policy 1, policy_version 729266 (0.0009) [2023-12-28 00:28:51,313][106225] Updated weights for policy 1, policy_version 729276 (0.0009) [2023-12-28 00:28:51,382][106225] Updated weights for policy 1, policy_version 729286 (0.0008) [2023-12-28 00:28:51,537][106226] Updated weights for policy 0, policy_version 727387 (0.0009) [2023-12-28 00:28:51,606][106226] Updated weights for policy 0, policy_version 727397 (0.0007) [2023-12-28 00:28:51,670][106226] Updated weights for policy 0, policy_version 727407 (0.0007) [2023-12-28 00:28:52,133][106225] Updated weights for policy 1, policy_version 729296 (0.0006) [2023-12-28 00:28:52,195][106225] Updated weights for policy 1, policy_version 729306 (0.0005) [2023-12-28 00:28:52,243][106225] Updated weights for policy 1, policy_version 729316 (0.0005) [2023-12-28 00:28:52,431][106226] Updated weights for policy 0, policy_version 727417 (0.0008) [2023-12-28 00:28:52,485][106226] Updated weights for policy 0, policy_version 727427 (0.0009) [2023-12-28 00:28:52,546][106226] Updated weights for policy 0, policy_version 727437 (0.0009) [2023-12-28 00:28:52,610][106226] Updated weights for policy 0, policy_version 727447 (0.0010) [2023-12-28 00:28:52,928][106225] Updated weights for policy 1, policy_version 729326 (0.0007) [2023-12-28 00:28:52,992][106225] Updated weights for policy 1, policy_version 729336 (0.0007) [2023-12-28 00:28:53,054][106225] Updated weights for policy 1, policy_version 729346 (0.0009) [2023-12-28 00:28:53,344][106226] Updated weights for policy 0, policy_version 727457 (0.0006) [2023-12-28 00:28:53,400][106226] Updated weights for policy 0, policy_version 727467 (0.0005) [2023-12-28 00:28:53,458][106226] Updated weights for policy 0, policy_version 727477 (0.0006) [2023-12-28 00:28:53,864][106225] Updated weights for policy 1, policy_version 729356 (0.0010) [2023-12-28 00:28:53,914][106225] Updated weights for policy 1, policy_version 729366 (0.0009) [2023-12-28 00:28:53,977][106225] Updated weights for policy 1, policy_version 729376 (0.0009) [2023-12-28 00:28:53,988][106226] Updated weights for policy 0, policy_version 727487 (0.0006) [2023-12-28 00:28:54,047][106226] Updated weights for policy 0, policy_version 727497 (0.0005) [2023-12-28 00:28:54,099][106226] Updated weights for policy 0, policy_version 727507 (0.0006) [2023-12-28 00:28:54,729][106225] Updated weights for policy 1, policy_version 729386 (0.0009) [2023-12-28 00:28:54,771][106226] Updated weights for policy 0, policy_version 727517 (0.0009) [2023-12-28 00:28:54,783][106225] Updated weights for policy 1, policy_version 729396 (0.0005) [2023-12-28 00:28:54,821][106226] Updated weights for policy 0, policy_version 727527 (0.0010) [2023-12-28 00:28:54,836][106225] Updated weights for policy 1, policy_version 729406 (0.0005) [2023-12-28 00:28:54,883][106226] Updated weights for policy 0, policy_version 727537 (0.0011) [2023-12-28 00:28:54,893][106225] Updated weights for policy 1, policy_version 729416 (0.0005) [2023-12-28 00:28:55,455][106225] Updated weights for policy 1, policy_version 729426 (0.0005) [2023-12-28 00:28:55,512][106225] Updated weights for policy 1, policy_version 729436 (0.0005) [2023-12-28 00:28:55,573][106225] Updated weights for policy 1, policy_version 729446 (0.0006) [2023-12-28 00:28:55,589][106226] Updated weights for policy 0, policy_version 727547 (0.0011) [2023-12-28 00:28:55,635][106226] Updated weights for policy 0, policy_version 727557 (0.0010) [2023-12-28 00:28:55,687][106226] Updated weights for policy 0, policy_version 727567 (0.0008) [2023-12-28 00:28:56,095][106225] Updated weights for policy 1, policy_version 729456 (0.0008) [2023-12-28 00:28:56,157][106225] Updated weights for policy 1, policy_version 729466 (0.0007) [2023-12-28 00:28:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 373088256. Throughput: 0: 9908.9, 1: 10068.0. Samples: 373059584. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:28:56,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.593')] [2023-12-28 00:28:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000727576_186310656.pth... [2023-12-28 00:28:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000726424_186015744.pth [2023-12-28 00:28:56,217][106225] Updated weights for policy 1, policy_version 729476 (0.0005) [2023-12-28 00:28:56,238][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000729480_186785792.pth... [2023-12-28 00:28:56,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000728264_186474496.pth [2023-12-28 00:28:56,397][106226] Updated weights for policy 0, policy_version 727577 (0.0010) [2023-12-28 00:28:56,457][106226] Updated weights for policy 0, policy_version 727587 (0.0008) [2023-12-28 00:28:56,506][106226] Updated weights for policy 0, policy_version 727597 (0.0008) [2023-12-28 00:28:56,556][106226] Updated weights for policy 0, policy_version 727607 (0.0009) [2023-12-28 00:28:56,840][106225] Updated weights for policy 1, policy_version 729486 (0.0006) [2023-12-28 00:28:56,895][106225] Updated weights for policy 1, policy_version 729496 (0.0005) [2023-12-28 00:28:56,960][106225] Updated weights for policy 1, policy_version 729506 (0.0005) [2023-12-28 00:28:57,295][106226] Updated weights for policy 0, policy_version 727617 (0.0009) [2023-12-28 00:28:57,352][106226] Updated weights for policy 0, policy_version 727627 (0.0008) [2023-12-28 00:28:57,407][106226] Updated weights for policy 0, policy_version 727637 (0.0008) [2023-12-28 00:28:57,498][106225] Updated weights for policy 1, policy_version 729516 (0.0006) [2023-12-28 00:28:57,562][106225] Updated weights for policy 1, policy_version 729526 (0.0009) [2023-12-28 00:28:57,622][106225] Updated weights for policy 1, policy_version 729536 (0.0009) [2023-12-28 00:28:58,079][106226] Updated weights for policy 0, policy_version 727647 (0.0009) [2023-12-28 00:28:58,130][106226] Updated weights for policy 0, policy_version 727657 (0.0010) [2023-12-28 00:28:58,177][106225] Updated weights for policy 1, policy_version 729546 (0.0007) [2023-12-28 00:28:58,179][106226] Updated weights for policy 0, policy_version 727667 (0.0009) [2023-12-28 00:28:58,247][106225] Updated weights for policy 1, policy_version 729556 (0.0008) [2023-12-28 00:28:58,311][106225] Updated weights for policy 1, policy_version 729566 (0.0008) [2023-12-28 00:28:58,390][106225] Updated weights for policy 1, policy_version 729576 (0.0009) [2023-12-28 00:28:59,021][106226] Updated weights for policy 0, policy_version 727677 (0.0008) [2023-12-28 00:28:59,070][106226] Updated weights for policy 0, policy_version 727687 (0.0008) [2023-12-28 00:28:59,133][106226] Updated weights for policy 0, policy_version 727697 (0.0008) [2023-12-28 00:28:59,143][106225] Updated weights for policy 1, policy_version 729586 (0.0007) [2023-12-28 00:28:59,198][106225] Updated weights for policy 1, policy_version 729596 (0.0007) [2023-12-28 00:28:59,278][106225] Updated weights for policy 1, policy_version 729606 (0.0008) [2023-12-28 00:28:59,871][106226] Updated weights for policy 0, policy_version 727707 (0.0007) [2023-12-28 00:28:59,932][106226] Updated weights for policy 0, policy_version 727717 (0.0009) [2023-12-28 00:28:59,956][106225] Updated weights for policy 1, policy_version 729616 (0.0007) [2023-12-28 00:28:59,995][106226] Updated weights for policy 0, policy_version 727727 (0.0008) [2023-12-28 00:29:00,014][106225] Updated weights for policy 1, policy_version 729626 (0.0007) [2023-12-28 00:29:00,072][106225] Updated weights for policy 1, policy_version 729636 (0.0007) [2023-12-28 00:29:00,726][106226] Updated weights for policy 0, policy_version 727737 (0.0007) [2023-12-28 00:29:00,767][106225] Updated weights for policy 1, policy_version 729646 (0.0006) [2023-12-28 00:29:00,776][106226] Updated weights for policy 0, policy_version 727747 (0.0005) [2023-12-28 00:29:00,819][106225] Updated weights for policy 1, policy_version 729656 (0.0008) [2023-12-28 00:29:00,822][106226] Updated weights for policy 0, policy_version 727757 (0.0007) [2023-12-28 00:29:00,871][106225] Updated weights for policy 1, policy_version 729666 (0.0005) [2023-12-28 00:29:00,882][106226] Updated weights for policy 0, policy_version 727767 (0.0008) [2023-12-28 00:29:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 373194752. Throughput: 0: 9858.1, 1: 10217.3. Samples: 373182256. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:01,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-5.756')] [2023-12-28 00:29:01,515][106225] Updated weights for policy 1, policy_version 729676 (0.0007) [2023-12-28 00:29:01,576][106225] Updated weights for policy 1, policy_version 729686 (0.0010) [2023-12-28 00:29:01,639][106225] Updated weights for policy 1, policy_version 729696 (0.0008) [2023-12-28 00:29:01,659][106226] Updated weights for policy 0, policy_version 727777 (0.0008) [2023-12-28 00:29:01,716][106226] Updated weights for policy 0, policy_version 727787 (0.0010) [2023-12-28 00:29:01,788][106226] Updated weights for policy 0, policy_version 727797 (0.0011) [2023-12-28 00:29:02,362][106225] Updated weights for policy 1, policy_version 729706 (0.0008) [2023-12-28 00:29:02,425][106225] Updated weights for policy 1, policy_version 729716 (0.0008) [2023-12-28 00:29:02,484][106225] Updated weights for policy 1, policy_version 729726 (0.0008) [2023-12-28 00:29:02,494][106226] Updated weights for policy 0, policy_version 727807 (0.0007) [2023-12-28 00:29:02,549][106225] Updated weights for policy 1, policy_version 729736 (0.0007) [2023-12-28 00:29:02,554][106226] Updated weights for policy 0, policy_version 727817 (0.0008) [2023-12-28 00:29:02,615][106226] Updated weights for policy 0, policy_version 727827 (0.0009) [2023-12-28 00:29:03,174][106225] Updated weights for policy 1, policy_version 729746 (0.0006) [2023-12-28 00:29:03,221][106225] Updated weights for policy 1, policy_version 729756 (0.0009) [2023-12-28 00:29:03,280][106225] Updated weights for policy 1, policy_version 729766 (0.0010) [2023-12-28 00:29:03,288][106226] Updated weights for policy 0, policy_version 727837 (0.0007) [2023-12-28 00:29:03,342][106226] Updated weights for policy 0, policy_version 727847 (0.0007) [2023-12-28 00:29:03,394][106226] Updated weights for policy 0, policy_version 727857 (0.0010) [2023-12-28 00:29:03,908][106225] Updated weights for policy 1, policy_version 729776 (0.0009) [2023-12-28 00:29:03,976][106225] Updated weights for policy 1, policy_version 729786 (0.0010) [2023-12-28 00:29:04,030][106225] Updated weights for policy 1, policy_version 729796 (0.0010) [2023-12-28 00:29:04,094][106226] Updated weights for policy 0, policy_version 727867 (0.0010) [2023-12-28 00:29:04,163][106226] Updated weights for policy 0, policy_version 727877 (0.0009) [2023-12-28 00:29:04,238][106226] Updated weights for policy 0, policy_version 727887 (0.0007) [2023-12-28 00:29:04,752][106225] Updated weights for policy 1, policy_version 729806 (0.0010) [2023-12-28 00:29:04,808][106225] Updated weights for policy 1, policy_version 729816 (0.0010) [2023-12-28 00:29:04,864][106225] Updated weights for policy 1, policy_version 729826 (0.0010) [2023-12-28 00:29:04,895][106226] Updated weights for policy 0, policy_version 727897 (0.0007) [2023-12-28 00:29:04,946][106226] Updated weights for policy 0, policy_version 727907 (0.0011) [2023-12-28 00:29:04,999][106226] Updated weights for policy 0, policy_version 727917 (0.0011) [2023-12-28 00:29:05,055][106226] Updated weights for policy 0, policy_version 727927 (0.0011) [2023-12-28 00:29:05,510][106225] Updated weights for policy 1, policy_version 729836 (0.0010) [2023-12-28 00:29:05,557][106225] Updated weights for policy 1, policy_version 729846 (0.0010) [2023-12-28 00:29:05,608][106225] Updated weights for policy 1, policy_version 729856 (0.0010) [2023-12-28 00:29:05,746][106226] Updated weights for policy 0, policy_version 727937 (0.0008) [2023-12-28 00:29:05,809][106226] Updated weights for policy 0, policy_version 727947 (0.0005) [2023-12-28 00:29:05,869][106226] Updated weights for policy 0, policy_version 727957 (0.0006) [2023-12-28 00:29:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 373293056. Throughput: 0: 9934.4, 1: 10202.6. Samples: 373303680. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:06,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-5.664')] [2023-12-28 00:29:06,318][106225] Updated weights for policy 1, policy_version 729866 (0.0009) [2023-12-28 00:29:06,384][106225] Updated weights for policy 1, policy_version 729876 (0.0007) [2023-12-28 00:29:06,449][106225] Updated weights for policy 1, policy_version 729886 (0.0011) [2023-12-28 00:29:06,515][106226] Updated weights for policy 0, policy_version 727967 (0.0009) [2023-12-28 00:29:06,520][106225] Updated weights for policy 1, policy_version 729896 (0.0009) [2023-12-28 00:29:06,576][106226] Updated weights for policy 0, policy_version 727977 (0.0011) [2023-12-28 00:29:06,641][106226] Updated weights for policy 0, policy_version 727987 (0.0011) [2023-12-28 00:29:07,220][106225] Updated weights for policy 1, policy_version 729906 (0.0011) [2023-12-28 00:29:07,274][106225] Updated weights for policy 1, policy_version 729916 (0.0010) [2023-12-28 00:29:07,331][106225] Updated weights for policy 1, policy_version 729926 (0.0010) [2023-12-28 00:29:07,371][106226] Updated weights for policy 0, policy_version 727997 (0.0011) [2023-12-28 00:29:07,430][106226] Updated weights for policy 0, policy_version 728007 (0.0008) [2023-12-28 00:29:07,496][106226] Updated weights for policy 0, policy_version 728017 (0.0005) [2023-12-28 00:29:08,093][106226] Updated weights for policy 0, policy_version 728027 (0.0005) [2023-12-28 00:29:08,093][106225] Updated weights for policy 1, policy_version 729936 (0.0011) [2023-12-28 00:29:08,151][106225] Updated weights for policy 1, policy_version 729946 (0.0010) [2023-12-28 00:29:08,153][106226] Updated weights for policy 0, policy_version 728037 (0.0005) [2023-12-28 00:29:08,209][106225] Updated weights for policy 1, policy_version 729956 (0.0010) [2023-12-28 00:29:08,218][106226] Updated weights for policy 0, policy_version 728047 (0.0006) [2023-12-28 00:29:08,896][106225] Updated weights for policy 1, policy_version 729966 (0.0009) [2023-12-28 00:29:08,915][106226] Updated weights for policy 0, policy_version 728057 (0.0006) [2023-12-28 00:29:08,957][106225] Updated weights for policy 1, policy_version 729976 (0.0007) [2023-12-28 00:29:08,967][106226] Updated weights for policy 0, policy_version 728067 (0.0006) [2023-12-28 00:29:09,016][106225] Updated weights for policy 1, policy_version 729986 (0.0007) [2023-12-28 00:29:09,022][106226] Updated weights for policy 0, policy_version 728077 (0.0006) [2023-12-28 00:29:09,069][106226] Updated weights for policy 0, policy_version 728087 (0.0006) [2023-12-28 00:29:09,722][106225] Updated weights for policy 1, policy_version 729996 (0.0008) [2023-12-28 00:29:09,788][106225] Updated weights for policy 1, policy_version 730006 (0.0007) [2023-12-28 00:29:09,798][106226] Updated weights for policy 0, policy_version 728097 (0.0007) [2023-12-28 00:29:09,849][106225] Updated weights for policy 1, policy_version 730016 (0.0007) [2023-12-28 00:29:09,864][106226] Updated weights for policy 0, policy_version 728107 (0.0008) [2023-12-28 00:29:09,927][106226] Updated weights for policy 0, policy_version 728117 (0.0007) [2023-12-28 00:29:10,528][106225] Updated weights for policy 1, policy_version 730026 (0.0008) [2023-12-28 00:29:10,591][106225] Updated weights for policy 1, policy_version 730036 (0.0008) [2023-12-28 00:29:10,645][106225] Updated weights for policy 1, policy_version 730046 (0.0008) [2023-12-28 00:29:10,664][106226] Updated weights for policy 0, policy_version 728127 (0.0009) [2023-12-28 00:29:10,693][106225] Updated weights for policy 1, policy_version 730056 (0.0007) [2023-12-28 00:29:10,725][106226] Updated weights for policy 0, policy_version 728137 (0.0007) [2023-12-28 00:29:10,789][106226] Updated weights for policy 0, policy_version 728147 (0.0007) [2023-12-28 00:29:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 373391360. Throughput: 0: 9976.6, 1: 10229.2. Samples: 373363180. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:11,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-5.555')] [2023-12-28 00:29:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000730056_186933248.pth... [2023-12-28 00:29:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000728152_186458112.pth... [2023-12-28 00:29:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000728872_186630144.pth [2023-12-28 00:29:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000727000_186163200.pth [2023-12-28 00:29:11,489][106225] Updated weights for policy 1, policy_version 730066 (0.0008) [2023-12-28 00:29:11,491][106226] Updated weights for policy 0, policy_version 728157 (0.0007) [2023-12-28 00:29:11,542][106225] Updated weights for policy 1, policy_version 730076 (0.0008) [2023-12-28 00:29:11,547][106226] Updated weights for policy 0, policy_version 728167 (0.0007) [2023-12-28 00:29:11,597][106225] Updated weights for policy 1, policy_version 730086 (0.0008) [2023-12-28 00:29:11,613][106226] Updated weights for policy 0, policy_version 728177 (0.0007) [2023-12-28 00:29:12,380][106225] Updated weights for policy 1, policy_version 730096 (0.0008) [2023-12-28 00:29:12,419][106226] Updated weights for policy 0, policy_version 728187 (0.0009) [2023-12-28 00:29:12,441][106225] Updated weights for policy 1, policy_version 730106 (0.0007) [2023-12-28 00:29:12,484][106226] Updated weights for policy 0, policy_version 728197 (0.0008) [2023-12-28 00:29:12,498][106225] Updated weights for policy 1, policy_version 730116 (0.0006) [2023-12-28 00:29:12,549][106226] Updated weights for policy 0, policy_version 728207 (0.0008) [2023-12-28 00:29:13,208][106226] Updated weights for policy 0, policy_version 728217 (0.0008) [2023-12-28 00:29:13,265][106225] Updated weights for policy 1, policy_version 730126 (0.0007) [2023-12-28 00:29:13,269][106226] Updated weights for policy 0, policy_version 728227 (0.0008) [2023-12-28 00:29:13,315][106225] Updated weights for policy 1, policy_version 730136 (0.0008) [2023-12-28 00:29:13,334][106226] Updated weights for policy 0, policy_version 728237 (0.0006) [2023-12-28 00:29:13,369][106225] Updated weights for policy 1, policy_version 730146 (0.0007) [2023-12-28 00:29:13,396][106226] Updated weights for policy 0, policy_version 728247 (0.0005) [2023-12-28 00:29:14,013][106226] Updated weights for policy 0, policy_version 728257 (0.0005) [2023-12-28 00:29:14,076][106226] Updated weights for policy 0, policy_version 728267 (0.0005) [2023-12-28 00:29:14,106][106225] Updated weights for policy 1, policy_version 730156 (0.0008) [2023-12-28 00:29:14,137][106226] Updated weights for policy 0, policy_version 728277 (0.0005) [2023-12-28 00:29:14,164][106225] Updated weights for policy 1, policy_version 730166 (0.0008) [2023-12-28 00:29:14,226][106225] Updated weights for policy 1, policy_version 730176 (0.0008) [2023-12-28 00:29:14,739][106226] Updated weights for policy 0, policy_version 728287 (0.0009) [2023-12-28 00:29:14,801][106226] Updated weights for policy 0, policy_version 728297 (0.0011) [2023-12-28 00:29:14,869][106226] Updated weights for policy 0, policy_version 728307 (0.0011) [2023-12-28 00:29:14,985][106225] Updated weights for policy 1, policy_version 730186 (0.0008) [2023-12-28 00:29:15,047][106225] Updated weights for policy 1, policy_version 730196 (0.0007) [2023-12-28 00:29:15,114][106225] Updated weights for policy 1, policy_version 730206 (0.0006) [2023-12-28 00:29:15,177][106225] Updated weights for policy 1, policy_version 730216 (0.0005) [2023-12-28 00:29:15,593][106226] Updated weights for policy 0, policy_version 728317 (0.0011) [2023-12-28 00:29:15,654][106226] Updated weights for policy 0, policy_version 728327 (0.0011) [2023-12-28 00:29:15,706][106226] Updated weights for policy 0, policy_version 728337 (0.0011) [2023-12-28 00:29:15,826][106225] Updated weights for policy 1, policy_version 730226 (0.0006) [2023-12-28 00:29:15,879][106225] Updated weights for policy 1, policy_version 730236 (0.0009) [2023-12-28 00:29:15,933][106225] Updated weights for policy 1, policy_version 730246 (0.0008) [2023-12-28 00:29:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 373489664. Throughput: 0: 9893.8, 1: 10093.2. Samples: 373479460. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:16,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-5.399')] [2023-12-28 00:29:16,341][106226] Updated weights for policy 0, policy_version 728347 (0.0009) [2023-12-28 00:29:16,404][106226] Updated weights for policy 0, policy_version 728357 (0.0005) [2023-12-28 00:29:16,476][106226] Updated weights for policy 0, policy_version 728367 (0.0005) [2023-12-28 00:29:16,675][106225] Updated weights for policy 1, policy_version 730256 (0.0007) [2023-12-28 00:29:16,723][106225] Updated weights for policy 1, policy_version 730266 (0.0007) [2023-12-28 00:29:16,769][106225] Updated weights for policy 1, policy_version 730276 (0.0005) [2023-12-28 00:29:17,025][106226] Updated weights for policy 0, policy_version 728377 (0.0006) [2023-12-28 00:29:17,078][106226] Updated weights for policy 0, policy_version 728387 (0.0011) [2023-12-28 00:29:17,130][106226] Updated weights for policy 0, policy_version 728397 (0.0010) [2023-12-28 00:29:17,187][106226] Updated weights for policy 0, policy_version 728407 (0.0010) [2023-12-28 00:29:17,499][106225] Updated weights for policy 1, policy_version 730286 (0.0007) [2023-12-28 00:29:17,546][106225] Updated weights for policy 1, policy_version 730296 (0.0008) [2023-12-28 00:29:17,593][106225] Updated weights for policy 1, policy_version 730306 (0.0008) [2023-12-28 00:29:17,918][106226] Updated weights for policy 0, policy_version 728417 (0.0009) [2023-12-28 00:29:17,977][106226] Updated weights for policy 0, policy_version 728427 (0.0010) [2023-12-28 00:29:18,036][106226] Updated weights for policy 0, policy_version 728437 (0.0010) [2023-12-28 00:29:18,352][106225] Updated weights for policy 1, policy_version 730316 (0.0008) [2023-12-28 00:29:18,419][106225] Updated weights for policy 1, policy_version 730326 (0.0009) [2023-12-28 00:29:18,480][106225] Updated weights for policy 1, policy_version 730336 (0.0009) [2023-12-28 00:29:18,723][106226] Updated weights for policy 0, policy_version 728447 (0.0009) [2023-12-28 00:29:18,776][106226] Updated weights for policy 0, policy_version 728457 (0.0008) [2023-12-28 00:29:18,829][106226] Updated weights for policy 0, policy_version 728467 (0.0009) [2023-12-28 00:29:19,210][106225] Updated weights for policy 1, policy_version 730346 (0.0008) [2023-12-28 00:29:19,271][106225] Updated weights for policy 1, policy_version 730356 (0.0009) [2023-12-28 00:29:19,329][106225] Updated weights for policy 1, policy_version 730366 (0.0009) [2023-12-28 00:29:19,402][106225] Updated weights for policy 1, policy_version 730376 (0.0008) [2023-12-28 00:29:19,636][106226] Updated weights for policy 0, policy_version 728477 (0.0008) [2023-12-28 00:29:19,695][106226] Updated weights for policy 0, policy_version 728487 (0.0009) [2023-12-28 00:29:19,754][106226] Updated weights for policy 0, policy_version 728497 (0.0010) [2023-12-28 00:29:20,071][106225] Updated weights for policy 1, policy_version 730386 (0.0009) [2023-12-28 00:29:20,148][106225] Updated weights for policy 1, policy_version 730396 (0.0008) [2023-12-28 00:29:20,214][106225] Updated weights for policy 1, policy_version 730406 (0.0008) [2023-12-28 00:29:20,540][106226] Updated weights for policy 0, policy_version 728507 (0.0009) [2023-12-28 00:29:20,607][106226] Updated weights for policy 0, policy_version 728517 (0.0007) [2023-12-28 00:29:20,675][106226] Updated weights for policy 0, policy_version 728527 (0.0007) [2023-12-28 00:29:20,896][106225] Updated weights for policy 1, policy_version 730416 (0.0007) [2023-12-28 00:29:20,953][106225] Updated weights for policy 1, policy_version 730426 (0.0009) [2023-12-28 00:29:21,009][106225] Updated weights for policy 1, policy_version 730436 (0.0008) [2023-12-28 00:29:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 373587968. Throughput: 0: 9959.9, 1: 9986.4. Samples: 373596492. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:21,175][105115] Avg episode reward: [(0, '-4.119'), (1, '-5.360')] [2023-12-28 00:29:21,421][106226] Updated weights for policy 0, policy_version 728537 (0.0009) [2023-12-28 00:29:21,485][106226] Updated weights for policy 0, policy_version 728547 (0.0008) [2023-12-28 00:29:21,550][106226] Updated weights for policy 0, policy_version 728557 (0.0009) [2023-12-28 00:29:21,614][106226] Updated weights for policy 0, policy_version 728567 (0.0009) [2023-12-28 00:29:21,782][106225] Updated weights for policy 1, policy_version 730446 (0.0008) [2023-12-28 00:29:21,842][106225] Updated weights for policy 1, policy_version 730456 (0.0009) [2023-12-28 00:29:21,904][106225] Updated weights for policy 1, policy_version 730466 (0.0008) [2023-12-28 00:29:22,371][106226] Updated weights for policy 0, policy_version 728577 (0.0010) [2023-12-28 00:29:22,438][106226] Updated weights for policy 0, policy_version 728587 (0.0009) [2023-12-28 00:29:22,496][106226] Updated weights for policy 0, policy_version 728597 (0.0011) [2023-12-28 00:29:22,659][106225] Updated weights for policy 1, policy_version 730476 (0.0007) [2023-12-28 00:29:22,710][106225] Updated weights for policy 1, policy_version 730486 (0.0008) [2023-12-28 00:29:22,771][106225] Updated weights for policy 1, policy_version 730496 (0.0006) [2023-12-28 00:29:23,231][106226] Updated weights for policy 0, policy_version 728607 (0.0009) [2023-12-28 00:29:23,294][106226] Updated weights for policy 0, policy_version 728617 (0.0008) [2023-12-28 00:29:23,359][106226] Updated weights for policy 0, policy_version 728627 (0.0007) [2023-12-28 00:29:23,506][106225] Updated weights for policy 1, policy_version 730506 (0.0006) [2023-12-28 00:29:23,564][106225] Updated weights for policy 1, policy_version 730516 (0.0007) [2023-12-28 00:29:23,617][106225] Updated weights for policy 1, policy_version 730526 (0.0005) [2023-12-28 00:29:23,669][106225] Updated weights for policy 1, policy_version 730536 (0.0005) [2023-12-28 00:29:24,079][106226] Updated weights for policy 0, policy_version 728637 (0.0007) [2023-12-28 00:29:24,136][106226] Updated weights for policy 0, policy_version 728647 (0.0008) [2023-12-28 00:29:24,193][106226] Updated weights for policy 0, policy_version 728657 (0.0008) [2023-12-28 00:29:24,330][106225] Updated weights for policy 1, policy_version 730546 (0.0005) [2023-12-28 00:29:24,379][106225] Updated weights for policy 1, policy_version 730556 (0.0005) [2023-12-28 00:29:24,432][106225] Updated weights for policy 1, policy_version 730566 (0.0005) [2023-12-28 00:29:25,003][106226] Updated weights for policy 0, policy_version 728667 (0.0009) [2023-12-28 00:29:25,056][106225] Updated weights for policy 1, policy_version 730576 (0.0010) [2023-12-28 00:29:25,063][106226] Updated weights for policy 0, policy_version 728677 (0.0005) [2023-12-28 00:29:25,116][106225] Updated weights for policy 1, policy_version 730586 (0.0005) [2023-12-28 00:29:25,130][106226] Updated weights for policy 0, policy_version 728687 (0.0005) [2023-12-28 00:29:25,178][106225] Updated weights for policy 1, policy_version 730596 (0.0005) [2023-12-28 00:29:25,810][106225] Updated weights for policy 1, policy_version 730606 (0.0008) [2023-12-28 00:29:25,826][106226] Updated weights for policy 0, policy_version 728697 (0.0006) [2023-12-28 00:29:25,861][106225] Updated weights for policy 1, policy_version 730616 (0.0009) [2023-12-28 00:29:25,886][106226] Updated weights for policy 0, policy_version 728707 (0.0006) [2023-12-28 00:29:25,907][106225] Updated weights for policy 1, policy_version 730626 (0.0010) [2023-12-28 00:29:25,937][106226] Updated weights for policy 0, policy_version 728717 (0.0005) [2023-12-28 00:29:25,986][106226] Updated weights for policy 0, policy_version 728727 (0.0008) [2023-12-28 00:29:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 373686272. Throughput: 0: 9931.5, 1: 9955.3. Samples: 373652636. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:26,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-5.389')] [2023-12-28 00:29:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000730632_187080704.pth... [2023-12-28 00:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000728728_186605568.pth... [2023-12-28 00:29:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000727576_186310656.pth [2023-12-28 00:29:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000729480_186785792.pth [2023-12-28 00:29:26,659][106225] Updated weights for policy 1, policy_version 730636 (0.0010) [2023-12-28 00:29:26,710][106225] Updated weights for policy 1, policy_version 730646 (0.0010) [2023-12-28 00:29:26,732][106226] Updated weights for policy 0, policy_version 728737 (0.0007) [2023-12-28 00:29:26,766][106225] Updated weights for policy 1, policy_version 730656 (0.0010) [2023-12-28 00:29:26,784][106226] Updated weights for policy 0, policy_version 728747 (0.0007) [2023-12-28 00:29:26,838][106226] Updated weights for policy 0, policy_version 728757 (0.0008) [2023-12-28 00:29:27,414][106226] Updated weights for policy 0, policy_version 728767 (0.0007) [2023-12-28 00:29:27,476][106226] Updated weights for policy 0, policy_version 728777 (0.0007) [2023-12-28 00:29:27,479][106225] Updated weights for policy 1, policy_version 730666 (0.0010) [2023-12-28 00:29:27,534][106225] Updated weights for policy 1, policy_version 730676 (0.0010) [2023-12-28 00:29:27,538][106226] Updated weights for policy 0, policy_version 728787 (0.0007) [2023-12-28 00:29:27,594][106225] Updated weights for policy 1, policy_version 730686 (0.0009) [2023-12-28 00:29:27,655][106225] Updated weights for policy 1, policy_version 730696 (0.0009) [2023-12-28 00:29:28,202][106226] Updated weights for policy 0, policy_version 728797 (0.0008) [2023-12-28 00:29:28,257][106226] Updated weights for policy 0, policy_version 728807 (0.0010) [2023-12-28 00:29:28,316][106226] Updated weights for policy 0, policy_version 728817 (0.0010) [2023-12-28 00:29:28,356][106225] Updated weights for policy 1, policy_version 730706 (0.0009) [2023-12-28 00:29:28,420][106225] Updated weights for policy 1, policy_version 730716 (0.0010) [2023-12-28 00:29:28,488][106225] Updated weights for policy 1, policy_version 730726 (0.0010) [2023-12-28 00:29:29,044][106226] Updated weights for policy 0, policy_version 728827 (0.0009) [2023-12-28 00:29:29,090][106226] Updated weights for policy 0, policy_version 728837 (0.0008) [2023-12-28 00:29:29,135][106226] Updated weights for policy 0, policy_version 728847 (0.0007) [2023-12-28 00:29:29,204][106225] Updated weights for policy 1, policy_version 730736 (0.0006) [2023-12-28 00:29:29,270][106225] Updated weights for policy 1, policy_version 730746 (0.0007) [2023-12-28 00:29:29,336][106225] Updated weights for policy 1, policy_version 730756 (0.0007) [2023-12-28 00:29:29,940][106226] Updated weights for policy 0, policy_version 728857 (0.0009) [2023-12-28 00:29:30,003][106226] Updated weights for policy 0, policy_version 728867 (0.0010) [2023-12-28 00:29:30,018][106225] Updated weights for policy 1, policy_version 730766 (0.0010) [2023-12-28 00:29:30,053][106226] Updated weights for policy 0, policy_version 728877 (0.0008) [2023-12-28 00:29:30,065][106225] Updated weights for policy 1, policy_version 730776 (0.0010) [2023-12-28 00:29:30,110][106225] Updated weights for policy 1, policy_version 730786 (0.0010) [2023-12-28 00:29:30,113][106226] Updated weights for policy 0, policy_version 728887 (0.0007) [2023-12-28 00:29:30,721][106226] Updated weights for policy 0, policy_version 728897 (0.0005) [2023-12-28 00:29:30,785][106226] Updated weights for policy 0, policy_version 728907 (0.0005) [2023-12-28 00:29:30,810][106225] Updated weights for policy 1, policy_version 730796 (0.0010) [2023-12-28 00:29:30,845][106226] Updated weights for policy 0, policy_version 728917 (0.0005) [2023-12-28 00:29:30,867][106225] Updated weights for policy 1, policy_version 730806 (0.0010) [2023-12-28 00:29:30,919][106225] Updated weights for policy 1, policy_version 730816 (0.0010) [2023-12-28 00:29:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 373784576. Throughput: 0: 9898.8, 1: 10030.0. Samples: 373771488. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:31,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-5.317')] [2023-12-28 00:29:31,498][106226] Updated weights for policy 0, policy_version 728927 (0.0007) [2023-12-28 00:29:31,563][106226] Updated weights for policy 0, policy_version 728937 (0.0005) [2023-12-28 00:29:31,636][106226] Updated weights for policy 0, policy_version 728947 (0.0008) [2023-12-28 00:29:31,641][106225] Updated weights for policy 1, policy_version 730826 (0.0006) [2023-12-28 00:29:31,696][106225] Updated weights for policy 1, policy_version 730836 (0.0006) [2023-12-28 00:29:31,760][106225] Updated weights for policy 1, policy_version 730846 (0.0009) [2023-12-28 00:29:31,811][106225] Updated weights for policy 1, policy_version 730856 (0.0008) [2023-12-28 00:29:32,356][106226] Updated weights for policy 0, policy_version 728957 (0.0008) [2023-12-28 00:29:32,416][106226] Updated weights for policy 0, policy_version 728967 (0.0009) [2023-12-28 00:29:32,468][106226] Updated weights for policy 0, policy_version 728977 (0.0008) [2023-12-28 00:29:32,510][106225] Updated weights for policy 1, policy_version 730866 (0.0007) [2023-12-28 00:29:32,572][106225] Updated weights for policy 1, policy_version 730876 (0.0008) [2023-12-28 00:29:32,629][106225] Updated weights for policy 1, policy_version 730886 (0.0008) [2023-12-28 00:29:33,220][106226] Updated weights for policy 0, policy_version 728987 (0.0007) [2023-12-28 00:29:33,277][106226] Updated weights for policy 0, policy_version 728997 (0.0009) [2023-12-28 00:29:33,334][106226] Updated weights for policy 0, policy_version 729007 (0.0009) [2023-12-28 00:29:33,364][106225] Updated weights for policy 1, policy_version 730896 (0.0009) [2023-12-28 00:29:33,417][106225] Updated weights for policy 1, policy_version 730906 (0.0008) [2023-12-28 00:29:33,469][106225] Updated weights for policy 1, policy_version 730916 (0.0007) [2023-12-28 00:29:33,988][106226] Updated weights for policy 0, policy_version 729017 (0.0007) [2023-12-28 00:29:34,045][106226] Updated weights for policy 0, policy_version 729027 (0.0011) [2023-12-28 00:29:34,102][106226] Updated weights for policy 0, policy_version 729037 (0.0010) [2023-12-28 00:29:34,192][106226] Updated weights for policy 0, policy_version 729047 (0.0011) [2023-12-28 00:29:34,229][106225] Updated weights for policy 1, policy_version 730926 (0.0009) [2023-12-28 00:29:34,295][106225] Updated weights for policy 1, policy_version 730936 (0.0011) [2023-12-28 00:29:34,352][106225] Updated weights for policy 1, policy_version 730946 (0.0010) [2023-12-28 00:29:34,889][106226] Updated weights for policy 0, policy_version 729057 (0.0010) [2023-12-28 00:29:34,942][106226] Updated weights for policy 0, policy_version 729067 (0.0010) [2023-12-28 00:29:34,991][106226] Updated weights for policy 0, policy_version 729077 (0.0010) [2023-12-28 00:29:35,080][106225] Updated weights for policy 1, policy_version 730956 (0.0010) [2023-12-28 00:29:35,126][106225] Updated weights for policy 1, policy_version 730966 (0.0008) [2023-12-28 00:29:35,169][106225] Updated weights for policy 1, policy_version 730976 (0.0005) [2023-12-28 00:29:35,705][106226] Updated weights for policy 0, policy_version 729087 (0.0009) [2023-12-28 00:29:35,765][106226] Updated weights for policy 0, policy_version 729097 (0.0010) [2023-12-28 00:29:35,773][106225] Updated weights for policy 1, policy_version 730986 (0.0007) [2023-12-28 00:29:35,825][106226] Updated weights for policy 0, policy_version 729107 (0.0011) [2023-12-28 00:29:35,834][106225] Updated weights for policy 1, policy_version 730996 (0.0010) [2023-12-28 00:29:35,884][106225] Updated weights for policy 1, policy_version 731006 (0.0010) [2023-12-28 00:29:35,937][106225] Updated weights for policy 1, policy_version 731016 (0.0010) [2023-12-28 00:29:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 373882880. Throughput: 0: 9861.8, 1: 9913.8. Samples: 373890764. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:36,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-5.480')] [2023-12-28 00:29:36,535][106226] Updated weights for policy 0, policy_version 729117 (0.0010) [2023-12-28 00:29:36,600][106226] Updated weights for policy 0, policy_version 729127 (0.0011) [2023-12-28 00:29:36,664][106226] Updated weights for policy 0, policy_version 729137 (0.0011) [2023-12-28 00:29:36,680][106225] Updated weights for policy 1, policy_version 731026 (0.0011) [2023-12-28 00:29:36,743][106225] Updated weights for policy 1, policy_version 731036 (0.0010) [2023-12-28 00:29:36,810][106225] Updated weights for policy 1, policy_version 731046 (0.0010) [2023-12-28 00:29:37,370][106226] Updated weights for policy 0, policy_version 729147 (0.0009) [2023-12-28 00:29:37,422][106226] Updated weights for policy 0, policy_version 729157 (0.0005) [2023-12-28 00:29:37,482][106226] Updated weights for policy 0, policy_version 729167 (0.0006) [2023-12-28 00:29:37,512][106225] Updated weights for policy 1, policy_version 731056 (0.0009) [2023-12-28 00:29:37,567][106225] Updated weights for policy 1, policy_version 731066 (0.0006) [2023-12-28 00:29:37,619][106225] Updated weights for policy 1, policy_version 731076 (0.0005) [2023-12-28 00:29:38,094][106226] Updated weights for policy 0, policy_version 729177 (0.0006) [2023-12-28 00:29:38,156][106226] Updated weights for policy 0, policy_version 729187 (0.0005) [2023-12-28 00:29:38,222][106226] Updated weights for policy 0, policy_version 729197 (0.0006) [2023-12-28 00:29:38,287][106226] Updated weights for policy 0, policy_version 729207 (0.0008) [2023-12-28 00:29:38,348][106225] Updated weights for policy 1, policy_version 731086 (0.0007) [2023-12-28 00:29:38,416][106225] Updated weights for policy 1, policy_version 731096 (0.0009) [2023-12-28 00:29:38,481][106225] Updated weights for policy 1, policy_version 731106 (0.0010) [2023-12-28 00:29:38,972][106226] Updated weights for policy 0, policy_version 729217 (0.0008) [2023-12-28 00:29:39,025][106226] Updated weights for policy 0, policy_version 729227 (0.0008) [2023-12-28 00:29:39,084][106226] Updated weights for policy 0, policy_version 729237 (0.0008) [2023-12-28 00:29:39,214][106225] Updated weights for policy 1, policy_version 731116 (0.0010) [2023-12-28 00:29:39,276][106225] Updated weights for policy 1, policy_version 731126 (0.0007) [2023-12-28 00:29:39,332][106225] Updated weights for policy 1, policy_version 731136 (0.0005) [2023-12-28 00:29:39,934][106226] Updated weights for policy 0, policy_version 729247 (0.0008) [2023-12-28 00:29:39,993][106226] Updated weights for policy 0, policy_version 729257 (0.0008) [2023-12-28 00:29:40,059][106226] Updated weights for policy 0, policy_version 729267 (0.0008) [2023-12-28 00:29:40,196][106225] Updated weights for policy 1, policy_version 731146 (0.0009) [2023-12-28 00:29:40,263][106225] Updated weights for policy 1, policy_version 731156 (0.0008) [2023-12-28 00:29:40,328][106225] Updated weights for policy 1, policy_version 731166 (0.0008) [2023-12-28 00:29:40,390][106225] Updated weights for policy 1, policy_version 731176 (0.0008) [2023-12-28 00:29:40,803][106226] Updated weights for policy 0, policy_version 729277 (0.0008) [2023-12-28 00:29:40,851][106226] Updated weights for policy 0, policy_version 729287 (0.0008) [2023-12-28 00:29:40,905][106226] Updated weights for policy 0, policy_version 729297 (0.0005) [2023-12-28 00:29:40,971][106225] Updated weights for policy 1, policy_version 731186 (0.0006) [2023-12-28 00:29:41,040][106225] Updated weights for policy 1, policy_version 731196 (0.0008) [2023-12-28 00:29:41,102][106225] Updated weights for policy 1, policy_version 731206 (0.0009) [2023-12-28 00:29:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 373981184. Throughput: 0: 9850.0, 1: 9919.9. Samples: 373949232. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:41,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.324')] [2023-12-28 00:29:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000731208_187228160.pth... [2023-12-28 00:29:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000729304_186753024.pth... [2023-12-28 00:29:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000728152_186458112.pth [2023-12-28 00:29:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000730056_186933248.pth [2023-12-28 00:29:41,703][106226] Updated weights for policy 0, policy_version 729307 (0.0007) [2023-12-28 00:29:41,778][106226] Updated weights for policy 0, policy_version 729317 (0.0007) [2023-12-28 00:29:41,838][106225] Updated weights for policy 1, policy_version 731216 (0.0008) [2023-12-28 00:29:41,849][106226] Updated weights for policy 0, policy_version 729327 (0.0006) [2023-12-28 00:29:41,901][106225] Updated weights for policy 1, policy_version 731226 (0.0009) [2023-12-28 00:29:41,965][106225] Updated weights for policy 1, policy_version 731236 (0.0006) [2023-12-28 00:29:42,555][106226] Updated weights for policy 0, policy_version 729337 (0.0006) [2023-12-28 00:29:42,613][106226] Updated weights for policy 0, policy_version 729347 (0.0007) [2023-12-28 00:29:42,671][106226] Updated weights for policy 0, policy_version 729357 (0.0009) [2023-12-28 00:29:42,673][106225] Updated weights for policy 1, policy_version 731246 (0.0006) [2023-12-28 00:29:42,731][106226] Updated weights for policy 0, policy_version 729367 (0.0007) [2023-12-28 00:29:42,733][106225] Updated weights for policy 1, policy_version 731256 (0.0006) [2023-12-28 00:29:42,786][106225] Updated weights for policy 1, policy_version 731266 (0.0007) [2023-12-28 00:29:43,443][106226] Updated weights for policy 0, policy_version 729377 (0.0009) [2023-12-28 00:29:43,472][106225] Updated weights for policy 1, policy_version 731276 (0.0008) [2023-12-28 00:29:43,494][106226] Updated weights for policy 0, policy_version 729387 (0.0006) [2023-12-28 00:29:43,526][106225] Updated weights for policy 1, policy_version 731286 (0.0009) [2023-12-28 00:29:43,563][106226] Updated weights for policy 0, policy_version 729397 (0.0005) [2023-12-28 00:29:43,579][106225] Updated weights for policy 1, policy_version 731296 (0.0008) [2023-12-28 00:29:44,153][106226] Updated weights for policy 0, policy_version 729407 (0.0005) [2023-12-28 00:29:44,209][106226] Updated weights for policy 0, policy_version 729417 (0.0006) [2023-12-28 00:29:44,222][106225] Updated weights for policy 1, policy_version 731306 (0.0008) [2023-12-28 00:29:44,270][106226] Updated weights for policy 0, policy_version 729427 (0.0008) [2023-12-28 00:29:44,276][106225] Updated weights for policy 1, policy_version 731316 (0.0010) [2023-12-28 00:29:44,335][106225] Updated weights for policy 1, policy_version 731326 (0.0010) [2023-12-28 00:29:44,392][106225] Updated weights for policy 1, policy_version 731336 (0.0010) [2023-12-28 00:29:44,873][106226] Updated weights for policy 0, policy_version 729437 (0.0009) [2023-12-28 00:29:44,939][106226] Updated weights for policy 0, policy_version 729447 (0.0011) [2023-12-28 00:29:45,002][106226] Updated weights for policy 0, policy_version 729457 (0.0011) [2023-12-28 00:29:45,133][106225] Updated weights for policy 1, policy_version 731346 (0.0008) [2023-12-28 00:29:45,195][106225] Updated weights for policy 1, policy_version 731356 (0.0008) [2023-12-28 00:29:45,251][106225] Updated weights for policy 1, policy_version 731366 (0.0008) [2023-12-28 00:29:45,676][106226] Updated weights for policy 0, policy_version 729467 (0.0009) [2023-12-28 00:29:45,729][106226] Updated weights for policy 0, policy_version 729477 (0.0005) [2023-12-28 00:29:45,787][106226] Updated weights for policy 0, policy_version 729487 (0.0005) [2023-12-28 00:29:45,945][106225] Updated weights for policy 1, policy_version 731376 (0.0010) [2023-12-28 00:29:45,999][106225] Updated weights for policy 1, policy_version 731386 (0.0010) [2023-12-28 00:29:46,046][106225] Updated weights for policy 1, policy_version 731396 (0.0010) [2023-12-28 00:29:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 374079488. Throughput: 0: 9839.1, 1: 9782.4. Samples: 374065224. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:46,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.340')] [2023-12-28 00:29:46,412][106226] Updated weights for policy 0, policy_version 729497 (0.0008) [2023-12-28 00:29:46,463][106226] Updated weights for policy 0, policy_version 729507 (0.0008) [2023-12-28 00:29:46,523][106226] Updated weights for policy 0, policy_version 729517 (0.0008) [2023-12-28 00:29:46,570][106226] Updated weights for policy 0, policy_version 729527 (0.0010) [2023-12-28 00:29:46,772][106225] Updated weights for policy 1, policy_version 731406 (0.0008) [2023-12-28 00:29:46,829][106225] Updated weights for policy 1, policy_version 731416 (0.0008) [2023-12-28 00:29:46,892][106225] Updated weights for policy 1, policy_version 731426 (0.0007) [2023-12-28 00:29:47,285][106226] Updated weights for policy 0, policy_version 729537 (0.0010) [2023-12-28 00:29:47,346][106226] Updated weights for policy 0, policy_version 729547 (0.0010) [2023-12-28 00:29:47,407][106226] Updated weights for policy 0, policy_version 729557 (0.0005) [2023-12-28 00:29:47,578][106225] Updated weights for policy 1, policy_version 731436 (0.0008) [2023-12-28 00:29:47,634][106225] Updated weights for policy 1, policy_version 731446 (0.0010) [2023-12-28 00:29:47,693][106225] Updated weights for policy 1, policy_version 731456 (0.0010) [2023-12-28 00:29:48,052][106226] Updated weights for policy 0, policy_version 729567 (0.0005) [2023-12-28 00:29:48,110][106226] Updated weights for policy 0, policy_version 729577 (0.0008) [2023-12-28 00:29:48,159][106226] Updated weights for policy 0, policy_version 729587 (0.0010) [2023-12-28 00:29:48,316][106225] Updated weights for policy 1, policy_version 731466 (0.0011) [2023-12-28 00:29:48,379][106225] Updated weights for policy 1, policy_version 731476 (0.0010) [2023-12-28 00:29:48,437][106225] Updated weights for policy 1, policy_version 731486 (0.0008) [2023-12-28 00:29:48,496][106225] Updated weights for policy 1, policy_version 731496 (0.0010) [2023-12-28 00:29:48,895][106226] Updated weights for policy 0, policy_version 729597 (0.0010) [2023-12-28 00:29:48,959][106226] Updated weights for policy 0, policy_version 729607 (0.0010) [2023-12-28 00:29:49,020][106226] Updated weights for policy 0, policy_version 729617 (0.0007) [2023-12-28 00:29:49,143][106225] Updated weights for policy 1, policy_version 731506 (0.0010) [2023-12-28 00:29:49,194][106225] Updated weights for policy 1, policy_version 731516 (0.0010) [2023-12-28 00:29:49,261][106225] Updated weights for policy 1, policy_version 731526 (0.0013) [2023-12-28 00:29:49,740][106226] Updated weights for policy 0, policy_version 729627 (0.0005) [2023-12-28 00:29:49,797][106226] Updated weights for policy 0, policy_version 729637 (0.0006) [2023-12-28 00:29:49,868][106226] Updated weights for policy 0, policy_version 729648 (0.0010) [2023-12-28 00:29:49,932][106225] Updated weights for policy 1, policy_version 731536 (0.0006) [2023-12-28 00:29:49,996][106225] Updated weights for policy 1, policy_version 731546 (0.0008) [2023-12-28 00:29:50,054][106225] Updated weights for policy 1, policy_version 731556 (0.0008) [2023-12-28 00:29:50,498][106226] Updated weights for policy 0, policy_version 729658 (0.0008) [2023-12-28 00:29:50,551][106226] Updated weights for policy 0, policy_version 729668 (0.0009) [2023-12-28 00:29:50,616][106226] Updated weights for policy 0, policy_version 729678 (0.0008) [2023-12-28 00:29:50,669][106226] Updated weights for policy 0, policy_version 729688 (0.0008) [2023-12-28 00:29:50,822][106225] Updated weights for policy 1, policy_version 731566 (0.0009) [2023-12-28 00:29:50,880][106225] Updated weights for policy 1, policy_version 731576 (0.0010) [2023-12-28 00:29:50,944][106225] Updated weights for policy 1, policy_version 731586 (0.0010) [2023-12-28 00:29:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 374177792. Throughput: 0: 9848.8, 1: 9757.0. Samples: 374185940. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 00:29:51,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-5.522')] [2023-12-28 00:29:51,440][106226] Updated weights for policy 0, policy_version 729698 (0.0008) [2023-12-28 00:29:51,505][106226] Updated weights for policy 0, policy_version 729708 (0.0009) [2023-12-28 00:29:51,565][106226] Updated weights for policy 0, policy_version 729718 (0.0009) [2023-12-28 00:29:51,668][106225] Updated weights for policy 1, policy_version 731596 (0.0009) [2023-12-28 00:29:51,739][106225] Updated weights for policy 1, policy_version 731606 (0.0008) [2023-12-28 00:29:51,804][106225] Updated weights for policy 1, policy_version 731616 (0.0008) [2023-12-28 00:29:52,230][106226] Updated weights for policy 0, policy_version 729728 (0.0009) [2023-12-28 00:29:52,290][106226] Updated weights for policy 0, policy_version 729738 (0.0007) [2023-12-28 00:29:52,349][106226] Updated weights for policy 0, policy_version 729748 (0.0007) [2023-12-28 00:29:52,557][106225] Updated weights for policy 1, policy_version 731626 (0.0008) [2023-12-28 00:29:52,616][106225] Updated weights for policy 1, policy_version 731636 (0.0009) [2023-12-28 00:29:52,682][106225] Updated weights for policy 1, policy_version 731646 (0.0010) [2023-12-28 00:29:52,750][106225] Updated weights for policy 1, policy_version 731656 (0.0009) [2023-12-28 00:29:53,056][106226] Updated weights for policy 0, policy_version 729758 (0.0007) [2023-12-28 00:29:53,122][106226] Updated weights for policy 0, policy_version 729768 (0.0006) [2023-12-28 00:29:53,186][106226] Updated weights for policy 0, policy_version 729778 (0.0008) [2023-12-28 00:29:53,559][106225] Updated weights for policy 1, policy_version 731666 (0.0008) [2023-12-28 00:29:53,621][106225] Updated weights for policy 1, policy_version 731676 (0.0008) [2023-12-28 00:29:53,681][106225] Updated weights for policy 1, policy_version 731686 (0.0009) [2023-12-28 00:29:53,817][106226] Updated weights for policy 0, policy_version 729788 (0.0009) [2023-12-28 00:29:53,880][106226] Updated weights for policy 0, policy_version 729798 (0.0009) [2023-12-28 00:29:53,944][106226] Updated weights for policy 0, policy_version 729808 (0.0009) [2023-12-28 00:29:54,403][106225] Updated weights for policy 1, policy_version 731696 (0.0008) [2023-12-28 00:29:54,451][106225] Updated weights for policy 1, policy_version 731706 (0.0008) [2023-12-28 00:29:54,499][106225] Updated weights for policy 1, policy_version 731716 (0.0009) [2023-12-28 00:29:54,678][106226] Updated weights for policy 0, policy_version 729818 (0.0008) [2023-12-28 00:29:54,746][106226] Updated weights for policy 0, policy_version 729828 (0.0008) [2023-12-28 00:29:54,807][106226] Updated weights for policy 0, policy_version 729838 (0.0008) [2023-12-28 00:29:54,871][106226] Updated weights for policy 0, policy_version 729848 (0.0008) [2023-12-28 00:29:55,219][106225] Updated weights for policy 1, policy_version 731726 (0.0007) [2023-12-28 00:29:55,271][106225] Updated weights for policy 1, policy_version 731736 (0.0008) [2023-12-28 00:29:55,325][106225] Updated weights for policy 1, policy_version 731746 (0.0008) [2023-12-28 00:29:55,502][106226] Updated weights for policy 0, policy_version 729858 (0.0008) [2023-12-28 00:29:55,552][106226] Updated weights for policy 0, policy_version 729868 (0.0009) [2023-12-28 00:29:55,601][106226] Updated weights for policy 0, policy_version 729878 (0.0008) [2023-12-28 00:29:55,895][106225] Updated weights for policy 1, policy_version 731756 (0.0009) [2023-12-28 00:29:55,946][106225] Updated weights for policy 1, policy_version 731766 (0.0008) [2023-12-28 00:29:56,001][106225] Updated weights for policy 1, policy_version 731776 (0.0009) [2023-12-28 00:29:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 374276096. Throughput: 0: 9845.0, 1: 9706.1. Samples: 374242976. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:29:56,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.605')] [2023-12-28 00:29:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000731784_187375616.pth... [2023-12-28 00:29:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000729880_186900480.pth... [2023-12-28 00:29:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000730632_187080704.pth [2023-12-28 00:29:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000728728_186605568.pth [2023-12-28 00:29:56,412][106226] Updated weights for policy 0, policy_version 729888 (0.0009) [2023-12-28 00:29:56,471][106226] Updated weights for policy 0, policy_version 729898 (0.0008) [2023-12-28 00:29:56,531][106226] Updated weights for policy 0, policy_version 729908 (0.0009) [2023-12-28 00:29:56,741][106225] Updated weights for policy 1, policy_version 731786 (0.0009) [2023-12-28 00:29:56,793][106225] Updated weights for policy 1, policy_version 731796 (0.0008) [2023-12-28 00:29:56,841][106225] Updated weights for policy 1, policy_version 731806 (0.0009) [2023-12-28 00:29:56,890][106225] Updated weights for policy 1, policy_version 731816 (0.0009) [2023-12-28 00:29:57,259][106226] Updated weights for policy 0, policy_version 729918 (0.0009) [2023-12-28 00:29:57,321][106226] Updated weights for policy 0, policy_version 729928 (0.0009) [2023-12-28 00:29:57,379][106226] Updated weights for policy 0, policy_version 729938 (0.0009) [2023-12-28 00:29:57,631][106225] Updated weights for policy 1, policy_version 731826 (0.0008) [2023-12-28 00:29:57,674][106225] Updated weights for policy 1, policy_version 731836 (0.0008) [2023-12-28 00:29:57,724][106225] Updated weights for policy 1, policy_version 731846 (0.0008) [2023-12-28 00:29:58,081][106226] Updated weights for policy 0, policy_version 729948 (0.0009) [2023-12-28 00:29:58,129][106226] Updated weights for policy 0, policy_version 729958 (0.0009) [2023-12-28 00:29:58,180][106226] Updated weights for policy 0, policy_version 729968 (0.0008) [2023-12-28 00:29:58,555][106225] Updated weights for policy 1, policy_version 731856 (0.0009) [2023-12-28 00:29:58,621][106225] Updated weights for policy 1, policy_version 731866 (0.0008) [2023-12-28 00:29:58,686][106225] Updated weights for policy 1, policy_version 731876 (0.0008) [2023-12-28 00:29:58,933][106226] Updated weights for policy 0, policy_version 729978 (0.0009) [2023-12-28 00:29:58,992][106226] Updated weights for policy 0, policy_version 729988 (0.0009) [2023-12-28 00:29:59,051][106226] Updated weights for policy 0, policy_version 729998 (0.0008) [2023-12-28 00:29:59,113][106226] Updated weights for policy 0, policy_version 730008 (0.0008) [2023-12-28 00:29:59,552][106225] Updated weights for policy 1, policy_version 731886 (0.0008) [2023-12-28 00:29:59,610][106225] Updated weights for policy 1, policy_version 731896 (0.0009) [2023-12-28 00:29:59,671][106225] Updated weights for policy 1, policy_version 731906 (0.0005) [2023-12-28 00:29:59,880][106226] Updated weights for policy 0, policy_version 730018 (0.0007) [2023-12-28 00:29:59,945][106226] Updated weights for policy 0, policy_version 730028 (0.0007) [2023-12-28 00:30:00,009][106226] Updated weights for policy 0, policy_version 730038 (0.0008) [2023-12-28 00:30:00,358][106225] Updated weights for policy 1, policy_version 731916 (0.0007) [2023-12-28 00:30:00,421][106225] Updated weights for policy 1, policy_version 731926 (0.0008) [2023-12-28 00:30:00,482][106225] Updated weights for policy 1, policy_version 731936 (0.0008) [2023-12-28 00:30:00,655][106226] Updated weights for policy 0, policy_version 730048 (0.0008) [2023-12-28 00:30:00,710][106226] Updated weights for policy 0, policy_version 730058 (0.0006) [2023-12-28 00:30:00,772][106226] Updated weights for policy 0, policy_version 730068 (0.0005) [2023-12-28 00:30:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 374366208. Throughput: 0: 9782.4, 1: 9742.8. Samples: 374358096. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:01,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.547')] [2023-12-28 00:30:01,202][106225] Updated weights for policy 1, policy_version 731946 (0.0009) [2023-12-28 00:30:01,260][106225] Updated weights for policy 1, policy_version 731956 (0.0011) [2023-12-28 00:30:01,320][106225] Updated weights for policy 1, policy_version 731966 (0.0009) [2023-12-28 00:30:01,384][106225] Updated weights for policy 1, policy_version 731976 (0.0008) [2023-12-28 00:30:01,465][106226] Updated weights for policy 0, policy_version 730078 (0.0006) [2023-12-28 00:30:01,520][106226] Updated weights for policy 0, policy_version 730088 (0.0007) [2023-12-28 00:30:01,570][106226] Updated weights for policy 0, policy_version 730098 (0.0008) [2023-12-28 00:30:02,083][106225] Updated weights for policy 1, policy_version 731986 (0.0010) [2023-12-28 00:30:02,133][106225] Updated weights for policy 1, policy_version 731996 (0.0010) [2023-12-28 00:30:02,184][106225] Updated weights for policy 1, policy_version 732006 (0.0010) [2023-12-28 00:30:02,297][106226] Updated weights for policy 0, policy_version 730108 (0.0008) [2023-12-28 00:30:02,355][106226] Updated weights for policy 0, policy_version 730118 (0.0008) [2023-12-28 00:30:02,424][106226] Updated weights for policy 0, policy_version 730128 (0.0006) [2023-12-28 00:30:02,944][106225] Updated weights for policy 1, policy_version 732016 (0.0010) [2023-12-28 00:30:02,987][106226] Updated weights for policy 0, policy_version 730138 (0.0005) [2023-12-28 00:30:03,010][106225] Updated weights for policy 1, policy_version 732026 (0.0010) [2023-12-28 00:30:03,043][106226] Updated weights for policy 0, policy_version 730148 (0.0006) [2023-12-28 00:30:03,093][106225] Updated weights for policy 1, policy_version 732036 (0.0010) [2023-12-28 00:30:03,096][106226] Updated weights for policy 0, policy_version 730158 (0.0006) [2023-12-28 00:30:03,152][106226] Updated weights for policy 0, policy_version 730168 (0.0006) [2023-12-28 00:30:03,764][106225] Updated weights for policy 1, policy_version 732046 (0.0010) [2023-12-28 00:30:03,795][106226] Updated weights for policy 0, policy_version 730178 (0.0010) [2023-12-28 00:30:03,823][106225] Updated weights for policy 1, policy_version 732056 (0.0010) [2023-12-28 00:30:03,856][106226] Updated weights for policy 0, policy_version 730188 (0.0011) [2023-12-28 00:30:03,887][106225] Updated weights for policy 1, policy_version 732066 (0.0011) [2023-12-28 00:30:03,913][106226] Updated weights for policy 0, policy_version 730198 (0.0011) [2023-12-28 00:30:04,602][106226] Updated weights for policy 0, policy_version 730208 (0.0008) [2023-12-28 00:30:04,619][106225] Updated weights for policy 1, policy_version 732076 (0.0012) [2023-12-28 00:30:04,663][106226] Updated weights for policy 0, policy_version 730218 (0.0006) [2023-12-28 00:30:04,665][106225] Updated weights for policy 1, policy_version 732086 (0.0010) [2023-12-28 00:30:04,710][106226] Updated weights for policy 0, policy_version 730228 (0.0008) [2023-12-28 00:30:04,727][106225] Updated weights for policy 1, policy_version 732096 (0.0007) [2023-12-28 00:30:05,284][106226] Updated weights for policy 0, policy_version 730238 (0.0008) [2023-12-28 00:30:05,313][106225] Updated weights for policy 1, policy_version 732106 (0.0005) [2023-12-28 00:30:05,347][106226] Updated weights for policy 0, policy_version 730248 (0.0005) [2023-12-28 00:30:05,372][106225] Updated weights for policy 1, policy_version 732116 (0.0008) [2023-12-28 00:30:05,403][106226] Updated weights for policy 0, policy_version 730258 (0.0005) [2023-12-28 00:30:05,428][106225] Updated weights for policy 1, policy_version 732126 (0.0007) [2023-12-28 00:30:05,489][106225] Updated weights for policy 1, policy_version 732136 (0.0006) [2023-12-28 00:30:05,974][106226] Updated weights for policy 0, policy_version 730268 (0.0005) [2023-12-28 00:30:06,033][106226] Updated weights for policy 0, policy_version 730278 (0.0005) [2023-12-28 00:30:06,086][106226] Updated weights for policy 0, policy_version 730288 (0.0006) [2023-12-28 00:30:06,104][106225] Updated weights for policy 1, policy_version 732146 (0.0007) [2023-12-28 00:30:06,166][106225] Updated weights for policy 1, policy_version 732156 (0.0009) [2023-12-28 00:30:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 374472704. Throughput: 0: 9911.7, 1: 9767.2. Samples: 374482044. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:06,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.673')] [2023-12-28 00:30:06,224][106225] Updated weights for policy 1, policy_version 732166 (0.0008) [2023-12-28 00:30:06,763][106226] Updated weights for policy 0, policy_version 730298 (0.0008) [2023-12-28 00:30:06,813][106226] Updated weights for policy 0, policy_version 730308 (0.0009) [2023-12-28 00:30:06,861][106226] Updated weights for policy 0, policy_version 730318 (0.0008) [2023-12-28 00:30:06,923][106226] Updated weights for policy 0, policy_version 730328 (0.0008) [2023-12-28 00:30:06,953][106225] Updated weights for policy 1, policy_version 732176 (0.0008) [2023-12-28 00:30:07,005][106225] Updated weights for policy 1, policy_version 732186 (0.0008) [2023-12-28 00:30:07,054][106225] Updated weights for policy 1, policy_version 732196 (0.0008) [2023-12-28 00:30:07,672][106226] Updated weights for policy 0, policy_version 730338 (0.0006) [2023-12-28 00:30:07,731][106226] Updated weights for policy 0, policy_version 730348 (0.0007) [2023-12-28 00:30:07,788][106226] Updated weights for policy 0, policy_version 730358 (0.0009) [2023-12-28 00:30:07,791][106225] Updated weights for policy 1, policy_version 732206 (0.0007) [2023-12-28 00:30:07,849][106225] Updated weights for policy 1, policy_version 732216 (0.0005) [2023-12-28 00:30:07,900][106225] Updated weights for policy 1, policy_version 732226 (0.0005) [2023-12-28 00:30:08,523][106225] Updated weights for policy 1, policy_version 732236 (0.0006) [2023-12-28 00:30:08,541][106226] Updated weights for policy 0, policy_version 730368 (0.0006) [2023-12-28 00:30:08,582][106225] Updated weights for policy 1, policy_version 732246 (0.0008) [2023-12-28 00:30:08,603][106226] Updated weights for policy 0, policy_version 730378 (0.0006) [2023-12-28 00:30:08,635][106225] Updated weights for policy 1, policy_version 732256 (0.0007) [2023-12-28 00:30:08,671][106226] Updated weights for policy 0, policy_version 730388 (0.0009) [2023-12-28 00:30:09,210][106226] Updated weights for policy 0, policy_version 730398 (0.0008) [2023-12-28 00:30:09,276][106226] Updated weights for policy 0, policy_version 730408 (0.0008) [2023-12-28 00:30:09,341][106226] Updated weights for policy 0, policy_version 730418 (0.0008) [2023-12-28 00:30:09,472][106225] Updated weights for policy 1, policy_version 732266 (0.0006) [2023-12-28 00:30:09,534][106225] Updated weights for policy 1, policy_version 732276 (0.0005) [2023-12-28 00:30:09,600][106225] Updated weights for policy 1, policy_version 732286 (0.0008) [2023-12-28 00:30:09,664][106225] Updated weights for policy 1, policy_version 732296 (0.0010) [2023-12-28 00:30:10,129][106226] Updated weights for policy 0, policy_version 730428 (0.0008) [2023-12-28 00:30:10,194][106226] Updated weights for policy 0, policy_version 730438 (0.0010) [2023-12-28 00:30:10,257][106226] Updated weights for policy 0, policy_version 730448 (0.0011) [2023-12-28 00:30:10,384][106225] Updated weights for policy 1, policy_version 732306 (0.0007) [2023-12-28 00:30:10,443][106225] Updated weights for policy 1, policy_version 732316 (0.0008) [2023-12-28 00:30:10,501][106225] Updated weights for policy 1, policy_version 732326 (0.0008) [2023-12-28 00:30:10,904][106226] Updated weights for policy 0, policy_version 730458 (0.0009) [2023-12-28 00:30:10,967][106226] Updated weights for policy 0, policy_version 730468 (0.0011) [2023-12-28 00:30:11,033][106226] Updated weights for policy 0, policy_version 730478 (0.0011) [2023-12-28 00:30:11,096][106226] Updated weights for policy 0, policy_version 730488 (0.0011) [2023-12-28 00:30:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 374571008. Throughput: 0: 9960.8, 1: 9803.0. Samples: 374542004. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:11,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-5.607')] [2023-12-28 00:30:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000730488_187056128.pth... [2023-12-28 00:30:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000729304_186753024.pth [2023-12-28 00:30:11,230][106225] Updated weights for policy 1, policy_version 732336 (0.0007) [2023-12-28 00:30:11,295][106225] Updated weights for policy 1, policy_version 732346 (0.0009) [2023-12-28 00:30:11,357][106225] Updated weights for policy 1, policy_version 732356 (0.0007) [2023-12-28 00:30:11,383][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000732360_187523072.pth... [2023-12-28 00:30:11,388][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000731208_187228160.pth [2023-12-28 00:30:11,825][106226] Updated weights for policy 0, policy_version 730498 (0.0008) [2023-12-28 00:30:11,889][106226] Updated weights for policy 0, policy_version 730508 (0.0006) [2023-12-28 00:30:11,945][106226] Updated weights for policy 0, policy_version 730518 (0.0008) [2023-12-28 00:30:12,155][106225] Updated weights for policy 1, policy_version 732366 (0.0009) [2023-12-28 00:30:12,216][106225] Updated weights for policy 1, policy_version 732376 (0.0009) [2023-12-28 00:30:12,279][106225] Updated weights for policy 1, policy_version 732386 (0.0007) [2023-12-28 00:30:12,663][106226] Updated weights for policy 0, policy_version 730528 (0.0007) [2023-12-28 00:30:12,714][106226] Updated weights for policy 0, policy_version 730538 (0.0011) [2023-12-28 00:30:12,772][106226] Updated weights for policy 0, policy_version 730548 (0.0011) [2023-12-28 00:30:13,116][106225] Updated weights for policy 1, policy_version 732396 (0.0010) [2023-12-28 00:30:13,173][106225] Updated weights for policy 1, policy_version 732406 (0.0008) [2023-12-28 00:30:13,223][106225] Updated weights for policy 1, policy_version 732416 (0.0008) [2023-12-28 00:30:13,378][106226] Updated weights for policy 0, policy_version 730558 (0.0007) [2023-12-28 00:30:13,431][106226] Updated weights for policy 0, policy_version 730568 (0.0009) [2023-12-28 00:30:13,481][106226] Updated weights for policy 0, policy_version 730578 (0.0007) [2023-12-28 00:30:13,935][106225] Updated weights for policy 1, policy_version 732426 (0.0007) [2023-12-28 00:30:13,981][106225] Updated weights for policy 1, policy_version 732436 (0.0005) [2023-12-28 00:30:14,041][106225] Updated weights for policy 1, policy_version 732446 (0.0007) [2023-12-28 00:30:14,093][106225] Updated weights for policy 1, policy_version 732456 (0.0008) [2023-12-28 00:30:14,201][106226] Updated weights for policy 0, policy_version 730588 (0.0008) [2023-12-28 00:30:14,250][106226] Updated weights for policy 0, policy_version 730598 (0.0010) [2023-12-28 00:30:14,305][106226] Updated weights for policy 0, policy_version 730608 (0.0010) [2023-12-28 00:30:14,846][106225] Updated weights for policy 1, policy_version 732466 (0.0008) [2023-12-28 00:30:14,890][106225] Updated weights for policy 1, policy_version 732476 (0.0007) [2023-12-28 00:30:14,950][106225] Updated weights for policy 1, policy_version 732486 (0.0008) [2023-12-28 00:30:14,985][106226] Updated weights for policy 0, policy_version 730618 (0.0010) [2023-12-28 00:30:15,068][106226] Updated weights for policy 0, policy_version 730628 (0.0011) [2023-12-28 00:30:15,133][106226] Updated weights for policy 0, policy_version 730638 (0.0011) [2023-12-28 00:30:15,192][106226] Updated weights for policy 0, policy_version 730648 (0.0011) [2023-12-28 00:30:15,687][106225] Updated weights for policy 1, policy_version 732496 (0.0006) [2023-12-28 00:30:15,740][106225] Updated weights for policy 1, policy_version 732506 (0.0006) [2023-12-28 00:30:15,791][106225] Updated weights for policy 1, policy_version 732516 (0.0007) [2023-12-28 00:30:15,896][106226] Updated weights for policy 0, policy_version 730658 (0.0011) [2023-12-28 00:30:15,953][106226] Updated weights for policy 0, policy_version 730668 (0.0010) [2023-12-28 00:30:16,015][106226] Updated weights for policy 0, policy_version 730678 (0.0011) [2023-12-28 00:30:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 374669312. Throughput: 0: 9994.3, 1: 9699.0. Samples: 374657688. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:16,176][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.593')] [2023-12-28 00:30:16,463][106225] Updated weights for policy 1, policy_version 732526 (0.0008) [2023-12-28 00:30:16,517][106225] Updated weights for policy 1, policy_version 732536 (0.0008) [2023-12-28 00:30:16,568][106225] Updated weights for policy 1, policy_version 732546 (0.0009) [2023-12-28 00:30:16,676][106226] Updated weights for policy 0, policy_version 730688 (0.0011) [2023-12-28 00:30:16,730][106226] Updated weights for policy 0, policy_version 730698 (0.0010) [2023-12-28 00:30:16,786][106226] Updated weights for policy 0, policy_version 730708 (0.0010) [2023-12-28 00:30:17,378][106225] Updated weights for policy 1, policy_version 732556 (0.0008) [2023-12-28 00:30:17,438][106225] Updated weights for policy 1, policy_version 732566 (0.0009) [2023-12-28 00:30:17,472][106226] Updated weights for policy 0, policy_version 730718 (0.0009) [2023-12-28 00:30:17,494][106225] Updated weights for policy 1, policy_version 732576 (0.0009) [2023-12-28 00:30:17,529][106226] Updated weights for policy 0, policy_version 730728 (0.0007) [2023-12-28 00:30:17,579][106226] Updated weights for policy 0, policy_version 730738 (0.0009) [2023-12-28 00:30:18,089][106225] Updated weights for policy 1, policy_version 732586 (0.0006) [2023-12-28 00:30:18,143][106225] Updated weights for policy 1, policy_version 732596 (0.0009) [2023-12-28 00:30:18,201][106225] Updated weights for policy 1, policy_version 732606 (0.0008) [2023-12-28 00:30:18,273][106225] Updated weights for policy 1, policy_version 732616 (0.0008) [2023-12-28 00:30:18,307][106226] Updated weights for policy 0, policy_version 730748 (0.0007) [2023-12-28 00:30:18,374][106226] Updated weights for policy 0, policy_version 730758 (0.0008) [2023-12-28 00:30:18,434][106226] Updated weights for policy 0, policy_version 730768 (0.0008) [2023-12-28 00:30:19,034][106225] Updated weights for policy 1, policy_version 732626 (0.0008) [2023-12-28 00:30:19,094][106225] Updated weights for policy 1, policy_version 732636 (0.0008) [2023-12-28 00:30:19,121][106226] Updated weights for policy 0, policy_version 730778 (0.0008) [2023-12-28 00:30:19,158][106225] Updated weights for policy 1, policy_version 732646 (0.0007) [2023-12-28 00:30:19,177][106226] Updated weights for policy 0, policy_version 730788 (0.0007) [2023-12-28 00:30:19,247][106226] Updated weights for policy 0, policy_version 730798 (0.0006) [2023-12-28 00:30:19,312][106226] Updated weights for policy 0, policy_version 730808 (0.0007) [2023-12-28 00:30:19,987][106225] Updated weights for policy 1, policy_version 732656 (0.0009) [2023-12-28 00:30:20,055][106225] Updated weights for policy 1, policy_version 732666 (0.0010) [2023-12-28 00:30:20,071][106226] Updated weights for policy 0, policy_version 730818 (0.0007) [2023-12-28 00:30:20,114][106225] Updated weights for policy 1, policy_version 732676 (0.0010) [2023-12-28 00:30:20,128][106226] Updated weights for policy 0, policy_version 730828 (0.0007) [2023-12-28 00:30:20,185][106226] Updated weights for policy 0, policy_version 730838 (0.0006) [2023-12-28 00:30:20,784][106226] Updated weights for policy 0, policy_version 730848 (0.0008) [2023-12-28 00:30:20,847][106226] Updated weights for policy 0, policy_version 730858 (0.0008) [2023-12-28 00:30:20,883][106225] Updated weights for policy 1, policy_version 732686 (0.0009) [2023-12-28 00:30:20,909][106226] Updated weights for policy 0, policy_version 730868 (0.0007) [2023-12-28 00:30:20,944][106225] Updated weights for policy 1, policy_version 732696 (0.0007) [2023-12-28 00:30:21,011][106225] Updated weights for policy 1, policy_version 732706 (0.0008) [2023-12-28 00:30:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 374767616. Throughput: 0: 9981.9, 1: 9636.6. Samples: 374773592. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:21,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-5.266')] [2023-12-28 00:30:21,628][106226] Updated weights for policy 0, policy_version 730878 (0.0007) [2023-12-28 00:30:21,690][106226] Updated weights for policy 0, policy_version 730888 (0.0007) [2023-12-28 00:30:21,753][106226] Updated weights for policy 0, policy_version 730898 (0.0007) [2023-12-28 00:30:21,805][106225] Updated weights for policy 1, policy_version 732716 (0.0009) [2023-12-28 00:30:21,865][106225] Updated weights for policy 1, policy_version 732726 (0.0010) [2023-12-28 00:30:21,925][106225] Updated weights for policy 1, policy_version 732736 (0.0009) [2023-12-28 00:30:22,435][106226] Updated weights for policy 0, policy_version 730909 (0.0010) [2023-12-28 00:30:22,498][106226] Updated weights for policy 0, policy_version 730919 (0.0010) [2023-12-28 00:30:22,556][106226] Updated weights for policy 0, policy_version 730929 (0.0011) [2023-12-28 00:30:22,725][106225] Updated weights for policy 1, policy_version 732746 (0.0010) [2023-12-28 00:30:22,790][106225] Updated weights for policy 1, policy_version 732756 (0.0007) [2023-12-28 00:30:22,858][106225] Updated weights for policy 1, policy_version 732766 (0.0007) [2023-12-28 00:30:22,924][106225] Updated weights for policy 1, policy_version 732776 (0.0007) [2023-12-28 00:30:23,253][106226] Updated weights for policy 0, policy_version 730939 (0.0011) [2023-12-28 00:30:23,314][106226] Updated weights for policy 0, policy_version 730949 (0.0011) [2023-12-28 00:30:23,380][106226] Updated weights for policy 0, policy_version 730959 (0.0010) [2023-12-28 00:30:23,500][106225] Updated weights for policy 1, policy_version 732786 (0.0008) [2023-12-28 00:30:23,564][106225] Updated weights for policy 1, policy_version 732796 (0.0007) [2023-12-28 00:30:23,637][106225] Updated weights for policy 1, policy_version 732806 (0.0007) [2023-12-28 00:30:24,143][106226] Updated weights for policy 0, policy_version 730969 (0.0009) [2023-12-28 00:30:24,201][106226] Updated weights for policy 0, policy_version 730979 (0.0009) [2023-12-28 00:30:24,257][106226] Updated weights for policy 0, policy_version 730989 (0.0005) [2023-12-28 00:30:24,323][106225] Updated weights for policy 1, policy_version 732816 (0.0007) [2023-12-28 00:30:24,325][106226] Updated weights for policy 0, policy_version 730999 (0.0008) [2023-12-28 00:30:24,387][106225] Updated weights for policy 1, policy_version 732826 (0.0007) [2023-12-28 00:30:24,441][106225] Updated weights for policy 1, policy_version 732836 (0.0006) [2023-12-28 00:30:24,942][106226] Updated weights for policy 0, policy_version 731009 (0.0010) [2023-12-28 00:30:24,998][106226] Updated weights for policy 0, policy_version 731019 (0.0010) [2023-12-28 00:30:25,048][106226] Updated weights for policy 0, policy_version 731029 (0.0010) [2023-12-28 00:30:25,118][106225] Updated weights for policy 1, policy_version 732846 (0.0006) [2023-12-28 00:30:25,185][106225] Updated weights for policy 1, policy_version 732856 (0.0005) [2023-12-28 00:30:25,243][106225] Updated weights for policy 1, policy_version 732866 (0.0006) [2023-12-28 00:30:25,753][106226] Updated weights for policy 0, policy_version 731039 (0.0010) [2023-12-28 00:30:25,810][106226] Updated weights for policy 0, policy_version 731049 (0.0010) [2023-12-28 00:30:25,828][106225] Updated weights for policy 1, policy_version 732876 (0.0006) [2023-12-28 00:30:25,868][106226] Updated weights for policy 0, policy_version 731059 (0.0010) [2023-12-28 00:30:25,887][106225] Updated weights for policy 1, policy_version 732886 (0.0007) [2023-12-28 00:30:25,934][106225] Updated weights for policy 1, policy_version 732896 (0.0010) [2023-12-28 00:30:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 374865920. Throughput: 0: 9967.8, 1: 9635.1. Samples: 374831360. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:26,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-5.669')] [2023-12-28 00:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000732904_187662336.pth... [2023-12-28 00:30:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000731064_187203584.pth... [2023-12-28 00:30:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000729880_186900480.pth [2023-12-28 00:30:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000731784_187375616.pth [2023-12-28 00:30:26,518][106226] Updated weights for policy 0, policy_version 731069 (0.0010) [2023-12-28 00:30:26,559][106225] Updated weights for policy 1, policy_version 732906 (0.0007) [2023-12-28 00:30:26,573][106226] Updated weights for policy 0, policy_version 731079 (0.0010) [2023-12-28 00:30:26,622][106225] Updated weights for policy 1, policy_version 732916 (0.0006) [2023-12-28 00:30:26,623][106226] Updated weights for policy 0, policy_version 731089 (0.0010) [2023-12-28 00:30:26,676][106225] Updated weights for policy 1, policy_version 732926 (0.0006) [2023-12-28 00:30:26,735][106225] Updated weights for policy 1, policy_version 732936 (0.0005) [2023-12-28 00:30:27,333][106226] Updated weights for policy 0, policy_version 731099 (0.0009) [2023-12-28 00:30:27,352][106225] Updated weights for policy 1, policy_version 732946 (0.0007) [2023-12-28 00:30:27,384][106226] Updated weights for policy 0, policy_version 731109 (0.0005) [2023-12-28 00:30:27,406][106225] Updated weights for policy 1, policy_version 732956 (0.0008) [2023-12-28 00:30:27,432][106226] Updated weights for policy 0, policy_version 731119 (0.0006) [2023-12-28 00:30:27,459][106225] Updated weights for policy 1, policy_version 732966 (0.0006) [2023-12-28 00:30:28,093][106225] Updated weights for policy 1, policy_version 732976 (0.0010) [2023-12-28 00:30:28,146][106225] Updated weights for policy 1, policy_version 732986 (0.0010) [2023-12-28 00:30:28,182][106226] Updated weights for policy 0, policy_version 731129 (0.0007) [2023-12-28 00:30:28,200][106225] Updated weights for policy 1, policy_version 732996 (0.0010) [2023-12-28 00:30:28,236][106226] Updated weights for policy 0, policy_version 731139 (0.0008) [2023-12-28 00:30:28,285][106226] Updated weights for policy 0, policy_version 731149 (0.0007) [2023-12-28 00:30:28,349][106226] Updated weights for policy 0, policy_version 731159 (0.0009) [2023-12-28 00:30:28,977][106225] Updated weights for policy 1, policy_version 733006 (0.0010) [2023-12-28 00:30:29,036][106225] Updated weights for policy 1, policy_version 733016 (0.0010) [2023-12-28 00:30:29,098][106225] Updated weights for policy 1, policy_version 733026 (0.0010) [2023-12-28 00:30:29,113][106226] Updated weights for policy 0, policy_version 731169 (0.0009) [2023-12-28 00:30:29,159][106226] Updated weights for policy 0, policy_version 731179 (0.0007) [2023-12-28 00:30:29,211][106226] Updated weights for policy 0, policy_version 731189 (0.0007) [2023-12-28 00:30:29,818][106225] Updated weights for policy 1, policy_version 733036 (0.0010) [2023-12-28 00:30:29,886][106225] Updated weights for policy 1, policy_version 733046 (0.0009) [2023-12-28 00:30:29,947][106225] Updated weights for policy 1, policy_version 733056 (0.0009) [2023-12-28 00:30:29,999][106226] Updated weights for policy 0, policy_version 731199 (0.0008) [2023-12-28 00:30:30,057][106226] Updated weights for policy 0, policy_version 731209 (0.0008) [2023-12-28 00:30:30,116][106226] Updated weights for policy 0, policy_version 731219 (0.0009) [2023-12-28 00:30:30,589][106225] Updated weights for policy 1, policy_version 733066 (0.0008) [2023-12-28 00:30:30,640][106225] Updated weights for policy 1, policy_version 733076 (0.0007) [2023-12-28 00:30:30,698][106225] Updated weights for policy 1, policy_version 733086 (0.0006) [2023-12-28 00:30:30,752][106225] Updated weights for policy 1, policy_version 733096 (0.0009) [2023-12-28 00:30:30,755][106226] Updated weights for policy 0, policy_version 731229 (0.0008) [2023-12-28 00:30:30,815][106226] Updated weights for policy 0, policy_version 731239 (0.0005) [2023-12-28 00:30:30,875][106226] Updated weights for policy 0, policy_version 731249 (0.0009) [2023-12-28 00:30:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 374964224. Throughput: 0: 10000.3, 1: 9715.4. Samples: 374952428. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:31,175][105115] Avg episode reward: [(0, '-4.209'), (1, '-5.197')] [2023-12-28 00:30:31,479][106225] Updated weights for policy 1, policy_version 733106 (0.0008) [2023-12-28 00:30:31,508][106226] Updated weights for policy 0, policy_version 731259 (0.0007) [2023-12-28 00:30:31,539][106225] Updated weights for policy 1, policy_version 733116 (0.0006) [2023-12-28 00:30:31,562][106226] Updated weights for policy 0, policy_version 731269 (0.0010) [2023-12-28 00:30:31,592][106225] Updated weights for policy 1, policy_version 733126 (0.0010) [2023-12-28 00:30:31,614][106226] Updated weights for policy 0, policy_version 731279 (0.0009) [2023-12-28 00:30:32,283][106226] Updated weights for policy 0, policy_version 731289 (0.0009) [2023-12-28 00:30:32,348][106226] Updated weights for policy 0, policy_version 731299 (0.0011) [2023-12-28 00:30:32,361][106225] Updated weights for policy 1, policy_version 733136 (0.0007) [2023-12-28 00:30:32,410][106226] Updated weights for policy 0, policy_version 731309 (0.0009) [2023-12-28 00:30:32,420][106225] Updated weights for policy 1, policy_version 733146 (0.0007) [2023-12-28 00:30:32,474][106226] Updated weights for policy 0, policy_version 731319 (0.0011) [2023-12-28 00:30:32,479][106225] Updated weights for policy 1, policy_version 733156 (0.0006) [2023-12-28 00:30:33,068][106225] Updated weights for policy 1, policy_version 733166 (0.0007) [2023-12-28 00:30:33,121][106225] Updated weights for policy 1, policy_version 733176 (0.0009) [2023-12-28 00:30:33,157][106226] Updated weights for policy 0, policy_version 731329 (0.0006) [2023-12-28 00:30:33,165][106225] Updated weights for policy 1, policy_version 733186 (0.0008) [2023-12-28 00:30:33,206][106226] Updated weights for policy 0, policy_version 731339 (0.0005) [2023-12-28 00:30:33,259][106226] Updated weights for policy 0, policy_version 731349 (0.0005) [2023-12-28 00:30:33,805][106226] Updated weights for policy 0, policy_version 731359 (0.0009) [2023-12-28 00:30:33,861][106226] Updated weights for policy 0, policy_version 731369 (0.0010) [2023-12-28 00:30:33,869][106225] Updated weights for policy 1, policy_version 733196 (0.0007) [2023-12-28 00:30:33,917][106225] Updated weights for policy 1, policy_version 733206 (0.0005) [2023-12-28 00:30:33,928][106226] Updated weights for policy 0, policy_version 731379 (0.0010) [2023-12-28 00:30:33,977][106225] Updated weights for policy 1, policy_version 733216 (0.0005) [2023-12-28 00:30:34,628][106225] Updated weights for policy 1, policy_version 733226 (0.0006) [2023-12-28 00:30:34,629][106226] Updated weights for policy 0, policy_version 731389 (0.0009) [2023-12-28 00:30:34,688][106225] Updated weights for policy 1, policy_version 733236 (0.0008) [2023-12-28 00:30:34,691][106226] Updated weights for policy 0, policy_version 731399 (0.0007) [2023-12-28 00:30:34,750][106226] Updated weights for policy 0, policy_version 731409 (0.0006) [2023-12-28 00:30:34,752][106225] Updated weights for policy 1, policy_version 733246 (0.0008) [2023-12-28 00:30:34,810][106225] Updated weights for policy 1, policy_version 733256 (0.0008) [2023-12-28 00:30:35,442][106226] Updated weights for policy 0, policy_version 731419 (0.0007) [2023-12-28 00:30:35,501][106226] Updated weights for policy 0, policy_version 731429 (0.0005) [2023-12-28 00:30:35,533][106225] Updated weights for policy 1, policy_version 733266 (0.0007) [2023-12-28 00:30:35,552][106226] Updated weights for policy 0, policy_version 731439 (0.0006) [2023-12-28 00:30:35,588][106225] Updated weights for policy 1, policy_version 733276 (0.0008) [2023-12-28 00:30:35,643][106225] Updated weights for policy 1, policy_version 733286 (0.0005) [2023-12-28 00:30:36,150][106226] Updated weights for policy 0, policy_version 731449 (0.0007) [2023-12-28 00:30:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 375062528. Throughput: 0: 10075.4, 1: 9721.3. Samples: 375076792. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:36,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.692')] [2023-12-28 00:30:36,212][106226] Updated weights for policy 0, policy_version 731459 (0.0008) [2023-12-28 00:30:36,266][106226] Updated weights for policy 0, policy_version 731469 (0.0007) [2023-12-28 00:30:36,325][106226] Updated weights for policy 0, policy_version 731479 (0.0007) [2023-12-28 00:30:36,364][106225] Updated weights for policy 1, policy_version 733296 (0.0007) [2023-12-28 00:30:36,430][106225] Updated weights for policy 1, policy_version 733306 (0.0009) [2023-12-28 00:30:36,486][106225] Updated weights for policy 1, policy_version 733316 (0.0008) [2023-12-28 00:30:37,079][106226] Updated weights for policy 0, policy_version 731489 (0.0008) [2023-12-28 00:30:37,128][106225] Updated weights for policy 1, policy_version 733326 (0.0007) [2023-12-28 00:30:37,133][106226] Updated weights for policy 0, policy_version 731499 (0.0008) [2023-12-28 00:30:37,182][106225] Updated weights for policy 1, policy_version 733336 (0.0006) [2023-12-28 00:30:37,192][106226] Updated weights for policy 0, policy_version 731509 (0.0007) [2023-12-28 00:30:37,239][106225] Updated weights for policy 1, policy_version 733346 (0.0007) [2023-12-28 00:30:37,827][106226] Updated weights for policy 0, policy_version 731519 (0.0008) [2023-12-28 00:30:37,876][106226] Updated weights for policy 0, policy_version 731529 (0.0008) [2023-12-28 00:30:37,923][106225] Updated weights for policy 1, policy_version 733356 (0.0007) [2023-12-28 00:30:37,933][106226] Updated weights for policy 0, policy_version 731539 (0.0008) [2023-12-28 00:30:37,978][106225] Updated weights for policy 1, policy_version 733366 (0.0006) [2023-12-28 00:30:38,034][106225] Updated weights for policy 1, policy_version 733376 (0.0009) [2023-12-28 00:30:38,685][106226] Updated weights for policy 0, policy_version 731549 (0.0007) [2023-12-28 00:30:38,701][106225] Updated weights for policy 1, policy_version 733386 (0.0007) [2023-12-28 00:30:38,743][106226] Updated weights for policy 0, policy_version 731559 (0.0008) [2023-12-28 00:30:38,765][106225] Updated weights for policy 1, policy_version 733396 (0.0006) [2023-12-28 00:30:38,801][106226] Updated weights for policy 0, policy_version 731569 (0.0011) [2023-12-28 00:30:38,826][106225] Updated weights for policy 1, policy_version 733406 (0.0005) [2023-12-28 00:30:38,886][106225] Updated weights for policy 1, policy_version 733416 (0.0007) [2023-12-28 00:30:39,521][106226] Updated weights for policy 0, policy_version 731579 (0.0010) [2023-12-28 00:30:39,588][106226] Updated weights for policy 0, policy_version 731589 (0.0009) [2023-12-28 00:30:39,614][106225] Updated weights for policy 1, policy_version 733426 (0.0008) [2023-12-28 00:30:39,647][106226] Updated weights for policy 0, policy_version 731599 (0.0008) [2023-12-28 00:30:39,681][106225] Updated weights for policy 1, policy_version 733436 (0.0008) [2023-12-28 00:30:39,748][106225] Updated weights for policy 1, policy_version 733446 (0.0008) [2023-12-28 00:30:40,315][106226] Updated weights for policy 0, policy_version 731609 (0.0006) [2023-12-28 00:30:40,380][106226] Updated weights for policy 0, policy_version 731619 (0.0009) [2023-12-28 00:30:40,447][106226] Updated weights for policy 0, policy_version 731629 (0.0010) [2023-12-28 00:30:40,486][106225] Updated weights for policy 1, policy_version 733456 (0.0006) [2023-12-28 00:30:40,508][106226] Updated weights for policy 0, policy_version 731639 (0.0008) [2023-12-28 00:30:40,540][106225] Updated weights for policy 1, policy_version 733466 (0.0005) [2023-12-28 00:30:40,593][106225] Updated weights for policy 1, policy_version 733476 (0.0005) [2023-12-28 00:30:41,106][106226] Updated weights for policy 0, policy_version 731649 (0.0008) [2023-12-28 00:30:41,174][106226] Updated weights for policy 0, policy_version 731659 (0.0009) [2023-12-28 00:30:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 375160832. Throughput: 0: 10054.6, 1: 9799.4. Samples: 375136404. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:41,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-5.417')] [2023-12-28 00:30:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000733480_187809792.pth... [2023-12-28 00:30:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000732360_187523072.pth [2023-12-28 00:30:41,238][106226] Updated weights for policy 0, policy_version 731669 (0.0008) [2023-12-28 00:30:41,242][106225] Updated weights for policy 1, policy_version 733486 (0.0006) [2023-12-28 00:30:41,253][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000731672_187359232.pth... [2023-12-28 00:30:41,258][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000730488_187056128.pth [2023-12-28 00:30:41,306][106225] Updated weights for policy 1, policy_version 733496 (0.0006) [2023-12-28 00:30:41,379][106225] Updated weights for policy 1, policy_version 733506 (0.0008) [2023-12-28 00:30:41,997][106226] Updated weights for policy 0, policy_version 731679 (0.0008) [2023-12-28 00:30:42,039][106225] Updated weights for policy 1, policy_version 733516 (0.0008) [2023-12-28 00:30:42,056][106226] Updated weights for policy 0, policy_version 731689 (0.0009) [2023-12-28 00:30:42,097][106225] Updated weights for policy 1, policy_version 733526 (0.0006) [2023-12-28 00:30:42,128][106226] Updated weights for policy 0, policy_version 731699 (0.0008) [2023-12-28 00:30:42,157][106225] Updated weights for policy 1, policy_version 733536 (0.0005) [2023-12-28 00:30:42,814][106225] Updated weights for policy 1, policy_version 733546 (0.0005) [2023-12-28 00:30:42,852][106226] Updated weights for policy 0, policy_version 731709 (0.0009) [2023-12-28 00:30:42,879][106225] Updated weights for policy 1, policy_version 733556 (0.0006) [2023-12-28 00:30:42,913][106226] Updated weights for policy 0, policy_version 731719 (0.0011) [2023-12-28 00:30:42,935][106225] Updated weights for policy 1, policy_version 733566 (0.0005) [2023-12-28 00:30:42,974][106226] Updated weights for policy 0, policy_version 731729 (0.0011) [2023-12-28 00:30:42,993][106225] Updated weights for policy 1, policy_version 733576 (0.0008) [2023-12-28 00:30:43,617][106225] Updated weights for policy 1, policy_version 733586 (0.0007) [2023-12-28 00:30:43,682][106225] Updated weights for policy 1, policy_version 733596 (0.0005) [2023-12-28 00:30:43,698][106226] Updated weights for policy 0, policy_version 731739 (0.0009) [2023-12-28 00:30:43,744][106226] Updated weights for policy 0, policy_version 731749 (0.0009) [2023-12-28 00:30:43,750][106225] Updated weights for policy 1, policy_version 733606 (0.0006) [2023-12-28 00:30:43,800][106226] Updated weights for policy 0, policy_version 731759 (0.0006) [2023-12-28 00:30:44,424][106225] Updated weights for policy 1, policy_version 733616 (0.0010) [2023-12-28 00:30:44,430][106226] Updated weights for policy 0, policy_version 731769 (0.0007) [2023-12-28 00:30:44,482][106225] Updated weights for policy 1, policy_version 733626 (0.0010) [2023-12-28 00:30:44,484][106226] Updated weights for policy 0, policy_version 731779 (0.0007) [2023-12-28 00:30:44,532][106225] Updated weights for policy 1, policy_version 733636 (0.0010) [2023-12-28 00:30:44,542][106226] Updated weights for policy 0, policy_version 731789 (0.0005) [2023-12-28 00:30:44,599][106226] Updated weights for policy 0, policy_version 731799 (0.0007) [2023-12-28 00:30:45,258][106225] Updated weights for policy 1, policy_version 733646 (0.0010) [2023-12-28 00:30:45,306][106225] Updated weights for policy 1, policy_version 733656 (0.0010) [2023-12-28 00:30:45,349][106226] Updated weights for policy 0, policy_version 731809 (0.0006) [2023-12-28 00:30:45,365][106225] Updated weights for policy 1, policy_version 733666 (0.0010) [2023-12-28 00:30:45,408][106226] Updated weights for policy 0, policy_version 731819 (0.0005) [2023-12-28 00:30:45,467][106226] Updated weights for policy 0, policy_version 731829 (0.0008) [2023-12-28 00:30:46,085][106225] Updated weights for policy 1, policy_version 733676 (0.0009) [2023-12-28 00:30:46,139][106225] Updated weights for policy 1, policy_version 733686 (0.0009) [2023-12-28 00:30:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 375259136. Throughput: 0: 10095.7, 1: 9830.1. Samples: 375254756. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:46,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.321')] [2023-12-28 00:30:46,180][106226] Updated weights for policy 0, policy_version 731839 (0.0006) [2023-12-28 00:30:46,197][106225] Updated weights for policy 1, policy_version 733696 (0.0010) [2023-12-28 00:30:46,242][106226] Updated weights for policy 0, policy_version 731849 (0.0007) [2023-12-28 00:30:46,293][106226] Updated weights for policy 0, policy_version 731859 (0.0008) [2023-12-28 00:30:46,911][106225] Updated weights for policy 1, policy_version 733706 (0.0009) [2023-12-28 00:30:46,969][106226] Updated weights for policy 0, policy_version 731869 (0.0007) [2023-12-28 00:30:46,971][106225] Updated weights for policy 1, policy_version 733716 (0.0010) [2023-12-28 00:30:47,029][106226] Updated weights for policy 0, policy_version 731879 (0.0006) [2023-12-28 00:30:47,031][106225] Updated weights for policy 1, policy_version 733726 (0.0010) [2023-12-28 00:30:47,081][106226] Updated weights for policy 0, policy_version 731889 (0.0006) [2023-12-28 00:30:47,088][106225] Updated weights for policy 1, policy_version 733736 (0.0009) [2023-12-28 00:30:47,648][106225] Updated weights for policy 1, policy_version 733746 (0.0005) [2023-12-28 00:30:47,696][106225] Updated weights for policy 1, policy_version 733756 (0.0005) [2023-12-28 00:30:47,751][106225] Updated weights for policy 1, policy_version 733766 (0.0007) [2023-12-28 00:30:47,865][106226] Updated weights for policy 0, policy_version 731899 (0.0009) [2023-12-28 00:30:47,929][106226] Updated weights for policy 0, policy_version 731909 (0.0009) [2023-12-28 00:30:48,004][106226] Updated weights for policy 0, policy_version 731919 (0.0010) [2023-12-28 00:30:48,377][106225] Updated weights for policy 1, policy_version 733776 (0.0008) [2023-12-28 00:30:48,436][106225] Updated weights for policy 1, policy_version 733786 (0.0008) [2023-12-28 00:30:48,502][106225] Updated weights for policy 1, policy_version 733796 (0.0008) [2023-12-28 00:30:48,775][106226] Updated weights for policy 0, policy_version 731929 (0.0009) [2023-12-28 00:30:48,839][106226] Updated weights for policy 0, policy_version 731939 (0.0009) [2023-12-28 00:30:48,898][106226] Updated weights for policy 0, policy_version 731949 (0.0008) [2023-12-28 00:30:48,958][106226] Updated weights for policy 0, policy_version 731959 (0.0008) [2023-12-28 00:30:49,172][106225] Updated weights for policy 1, policy_version 733806 (0.0006) [2023-12-28 00:30:49,240][106225] Updated weights for policy 1, policy_version 733816 (0.0007) [2023-12-28 00:30:49,301][106225] Updated weights for policy 1, policy_version 733826 (0.0007) [2023-12-28 00:30:49,676][106226] Updated weights for policy 0, policy_version 731969 (0.0008) [2023-12-28 00:30:49,735][106226] Updated weights for policy 0, policy_version 731979 (0.0010) [2023-12-28 00:30:49,801][106226] Updated weights for policy 0, policy_version 731989 (0.0010) [2023-12-28 00:30:49,986][106225] Updated weights for policy 1, policy_version 733836 (0.0007) [2023-12-28 00:30:50,049][106225] Updated weights for policy 1, policy_version 733846 (0.0007) [2023-12-28 00:30:50,111][106225] Updated weights for policy 1, policy_version 733856 (0.0008) [2023-12-28 00:30:50,640][106226] Updated weights for policy 0, policy_version 731999 (0.0009) [2023-12-28 00:30:50,697][106226] Updated weights for policy 0, policy_version 732009 (0.0009) [2023-12-28 00:30:50,754][106226] Updated weights for policy 0, policy_version 732019 (0.0009) [2023-12-28 00:30:50,818][106225] Updated weights for policy 1, policy_version 733866 (0.0007) [2023-12-28 00:30:50,869][106225] Updated weights for policy 1, policy_version 733876 (0.0010) [2023-12-28 00:30:50,924][106225] Updated weights for policy 1, policy_version 733886 (0.0010) [2023-12-28 00:30:50,983][106225] Updated weights for policy 1, policy_version 733896 (0.0010) [2023-12-28 00:30:51,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 375365632. Throughput: 0: 9895.0, 1: 9888.6. Samples: 375372304. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:51,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-5.575')] [2023-12-28 00:30:51,531][106226] Updated weights for policy 0, policy_version 732029 (0.0010) [2023-12-28 00:30:51,590][106226] Updated weights for policy 0, policy_version 732039 (0.0011) [2023-12-28 00:30:51,656][106226] Updated weights for policy 0, policy_version 732049 (0.0010) [2023-12-28 00:30:51,713][106225] Updated weights for policy 1, policy_version 733906 (0.0006) [2023-12-28 00:30:51,783][106225] Updated weights for policy 1, policy_version 733916 (0.0008) [2023-12-28 00:30:51,844][106225] Updated weights for policy 1, policy_version 733926 (0.0008) [2023-12-28 00:30:52,375][106226] Updated weights for policy 0, policy_version 732059 (0.0009) [2023-12-28 00:30:52,443][106226] Updated weights for policy 0, policy_version 732069 (0.0010) [2023-12-28 00:30:52,502][106226] Updated weights for policy 0, policy_version 732079 (0.0011) [2023-12-28 00:30:52,621][106225] Updated weights for policy 1, policy_version 733936 (0.0007) [2023-12-28 00:30:52,688][106225] Updated weights for policy 1, policy_version 733946 (0.0008) [2023-12-28 00:30:52,751][106225] Updated weights for policy 1, policy_version 733956 (0.0008) [2023-12-28 00:30:53,188][106226] Updated weights for policy 0, policy_version 732089 (0.0010) [2023-12-28 00:30:53,239][106226] Updated weights for policy 0, policy_version 732099 (0.0006) [2023-12-28 00:30:53,295][106226] Updated weights for policy 0, policy_version 732109 (0.0008) [2023-12-28 00:30:53,355][106226] Updated weights for policy 0, policy_version 732119 (0.0010) [2023-12-28 00:30:53,463][106225] Updated weights for policy 1, policy_version 733966 (0.0008) [2023-12-28 00:30:53,520][106225] Updated weights for policy 1, policy_version 733976 (0.0007) [2023-12-28 00:30:53,580][106225] Updated weights for policy 1, policy_version 733986 (0.0007) [2023-12-28 00:30:54,070][106226] Updated weights for policy 0, policy_version 732129 (0.0009) [2023-12-28 00:30:54,127][106226] Updated weights for policy 0, policy_version 732139 (0.0009) [2023-12-28 00:30:54,187][106226] Updated weights for policy 0, policy_version 732149 (0.0008) [2023-12-28 00:30:54,357][106225] Updated weights for policy 1, policy_version 733996 (0.0009) [2023-12-28 00:30:54,421][106225] Updated weights for policy 1, policy_version 734006 (0.0010) [2023-12-28 00:30:54,484][106225] Updated weights for policy 1, policy_version 734016 (0.0010) [2023-12-28 00:30:54,843][106226] Updated weights for policy 0, policy_version 732159 (0.0006) [2023-12-28 00:30:54,915][106226] Updated weights for policy 0, policy_version 732169 (0.0008) [2023-12-28 00:30:54,980][106226] Updated weights for policy 0, policy_version 732179 (0.0007) [2023-12-28 00:30:55,124][106225] Updated weights for policy 1, policy_version 734026 (0.0010) [2023-12-28 00:30:55,186][106225] Updated weights for policy 1, policy_version 734036 (0.0011) [2023-12-28 00:30:55,249][106225] Updated weights for policy 1, policy_version 734046 (0.0010) [2023-12-28 00:30:55,310][106225] Updated weights for policy 1, policy_version 734056 (0.0011) [2023-12-28 00:30:55,553][106226] Updated weights for policy 0, policy_version 732189 (0.0006) [2023-12-28 00:30:55,613][106226] Updated weights for policy 0, policy_version 732199 (0.0006) [2023-12-28 00:30:55,674][106226] Updated weights for policy 0, policy_version 732209 (0.0005) [2023-12-28 00:30:55,976][106225] Updated weights for policy 1, policy_version 734066 (0.0010) [2023-12-28 00:30:56,035][106225] Updated weights for policy 1, policy_version 734076 (0.0010) [2023-12-28 00:30:56,095][106225] Updated weights for policy 1, policy_version 734086 (0.0010) [2023-12-28 00:30:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 375463936. Throughput: 0: 9871.5, 1: 9845.3. Samples: 375429264. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:30:56,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-5.480')] [2023-12-28 00:30:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000732216_187498496.pth... [2023-12-28 00:30:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000734088_187965440.pth... [2023-12-28 00:30:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000731064_187203584.pth [2023-12-28 00:30:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000732904_187662336.pth [2023-12-28 00:30:56,325][106226] Updated weights for policy 0, policy_version 732219 (0.0007) [2023-12-28 00:30:56,381][106226] Updated weights for policy 0, policy_version 732229 (0.0008) [2023-12-28 00:30:56,439][106226] Updated weights for policy 0, policy_version 732239 (0.0008) [2023-12-28 00:30:56,819][106225] Updated weights for policy 1, policy_version 734096 (0.0010) [2023-12-28 00:30:56,879][106225] Updated weights for policy 1, policy_version 734106 (0.0010) [2023-12-28 00:30:56,942][106225] Updated weights for policy 1, policy_version 734116 (0.0010) [2023-12-28 00:30:57,183][106226] Updated weights for policy 0, policy_version 732249 (0.0008) [2023-12-28 00:30:57,243][106226] Updated weights for policy 0, policy_version 732259 (0.0010) [2023-12-28 00:30:57,309][106226] Updated weights for policy 0, policy_version 732269 (0.0011) [2023-12-28 00:30:57,365][106226] Updated weights for policy 0, policy_version 732279 (0.0009) [2023-12-28 00:30:57,644][106225] Updated weights for policy 1, policy_version 734126 (0.0010) [2023-12-28 00:30:57,697][106225] Updated weights for policy 1, policy_version 734136 (0.0010) [2023-12-28 00:30:57,750][106225] Updated weights for policy 1, policy_version 734146 (0.0006) [2023-12-28 00:30:58,047][106226] Updated weights for policy 0, policy_version 732289 (0.0010) [2023-12-28 00:30:58,101][106226] Updated weights for policy 0, policy_version 732299 (0.0010) [2023-12-28 00:30:58,160][106226] Updated weights for policy 0, policy_version 732309 (0.0010) [2023-12-28 00:30:58,458][106225] Updated weights for policy 1, policy_version 734156 (0.0006) [2023-12-28 00:30:58,526][106225] Updated weights for policy 1, policy_version 734166 (0.0009) [2023-12-28 00:30:58,592][106225] Updated weights for policy 1, policy_version 734176 (0.0009) [2023-12-28 00:30:59,046][106226] Updated weights for policy 0, policy_version 732319 (0.0008) [2023-12-28 00:30:59,116][106226] Updated weights for policy 0, policy_version 732329 (0.0011) [2023-12-28 00:30:59,189][106226] Updated weights for policy 0, policy_version 732339 (0.0009) [2023-12-28 00:30:59,556][106225] Updated weights for policy 1, policy_version 734186 (0.0009) [2023-12-28 00:30:59,621][106225] Updated weights for policy 1, policy_version 734196 (0.0011) [2023-12-28 00:30:59,686][106225] Updated weights for policy 1, policy_version 734206 (0.0011) [2023-12-28 00:30:59,739][106225] Updated weights for policy 1, policy_version 734216 (0.0008) [2023-12-28 00:31:00,085][106226] Updated weights for policy 0, policy_version 732349 (0.0011) [2023-12-28 00:31:00,152][106226] Updated weights for policy 0, policy_version 732359 (0.0008) [2023-12-28 00:31:00,224][106226] Updated weights for policy 0, policy_version 732369 (0.0009) [2023-12-28 00:31:00,433][106225] Updated weights for policy 1, policy_version 734226 (0.0008) [2023-12-28 00:31:00,495][106225] Updated weights for policy 1, policy_version 734236 (0.0008) [2023-12-28 00:31:00,552][106225] Updated weights for policy 1, policy_version 734246 (0.0009) [2023-12-28 00:31:00,952][106226] Updated weights for policy 0, policy_version 732379 (0.0010) [2023-12-28 00:31:01,004][106226] Updated weights for policy 0, policy_version 732389 (0.0008) [2023-12-28 00:31:01,061][106226] Updated weights for policy 0, policy_version 732399 (0.0008) [2023-12-28 00:31:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 375554048. Throughput: 0: 9817.6, 1: 9868.6. Samples: 375543564. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:01,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-5.569')] [2023-12-28 00:31:01,324][106225] Updated weights for policy 1, policy_version 734256 (0.0008) [2023-12-28 00:31:01,394][106225] Updated weights for policy 1, policy_version 734266 (0.0008) [2023-12-28 00:31:01,453][106225] Updated weights for policy 1, policy_version 734276 (0.0008) [2023-12-28 00:31:01,833][106226] Updated weights for policy 0, policy_version 732409 (0.0008) [2023-12-28 00:31:01,897][106226] Updated weights for policy 0, policy_version 732419 (0.0011) [2023-12-28 00:31:01,964][106226] Updated weights for policy 0, policy_version 732429 (0.0011) [2023-12-28 00:31:02,025][106226] Updated weights for policy 0, policy_version 732439 (0.0011) [2023-12-28 00:31:02,219][106225] Updated weights for policy 1, policy_version 734286 (0.0008) [2023-12-28 00:31:02,284][106225] Updated weights for policy 1, policy_version 734296 (0.0008) [2023-12-28 00:31:02,337][106225] Updated weights for policy 1, policy_version 734306 (0.0007) [2023-12-28 00:31:02,735][106226] Updated weights for policy 0, policy_version 732449 (0.0008) [2023-12-28 00:31:02,798][106226] Updated weights for policy 0, policy_version 732459 (0.0008) [2023-12-28 00:31:02,860][106226] Updated weights for policy 0, policy_version 732469 (0.0008) [2023-12-28 00:31:03,022][106225] Updated weights for policy 1, policy_version 734316 (0.0007) [2023-12-28 00:31:03,084][106225] Updated weights for policy 1, policy_version 734326 (0.0009) [2023-12-28 00:31:03,145][106225] Updated weights for policy 1, policy_version 734336 (0.0010) [2023-12-28 00:31:03,601][106226] Updated weights for policy 0, policy_version 732479 (0.0008) [2023-12-28 00:31:03,651][106226] Updated weights for policy 0, policy_version 732489 (0.0008) [2023-12-28 00:31:03,703][106225] Updated weights for policy 1, policy_version 734346 (0.0010) [2023-12-28 00:31:03,703][106226] Updated weights for policy 0, policy_version 732499 (0.0005) [2023-12-28 00:31:03,754][106225] Updated weights for policy 1, policy_version 734356 (0.0005) [2023-12-28 00:31:03,806][106225] Updated weights for policy 1, policy_version 734366 (0.0005) [2023-12-28 00:31:03,874][106225] Updated weights for policy 1, policy_version 734376 (0.0008) [2023-12-28 00:31:04,405][106226] Updated weights for policy 0, policy_version 732509 (0.0007) [2023-12-28 00:31:04,470][106226] Updated weights for policy 0, policy_version 732519 (0.0008) [2023-12-28 00:31:04,541][106226] Updated weights for policy 0, policy_version 732529 (0.0007) [2023-12-28 00:31:04,619][106225] Updated weights for policy 1, policy_version 734386 (0.0010) [2023-12-28 00:31:04,685][106225] Updated weights for policy 1, policy_version 734396 (0.0010) [2023-12-28 00:31:04,745][106225] Updated weights for policy 1, policy_version 734406 (0.0010) [2023-12-28 00:31:05,218][106226] Updated weights for policy 0, policy_version 732539 (0.0008) [2023-12-28 00:31:05,282][106226] Updated weights for policy 0, policy_version 732549 (0.0010) [2023-12-28 00:31:05,343][106226] Updated weights for policy 0, policy_version 732559 (0.0008) [2023-12-28 00:31:05,353][106225] Updated weights for policy 1, policy_version 734416 (0.0007) [2023-12-28 00:31:05,411][106225] Updated weights for policy 1, policy_version 734426 (0.0006) [2023-12-28 00:31:05,472][106225] Updated weights for policy 1, policy_version 734436 (0.0009) [2023-12-28 00:31:06,055][106226] Updated weights for policy 0, policy_version 732569 (0.0010) [2023-12-28 00:31:06,118][106226] Updated weights for policy 0, policy_version 732579 (0.0007) [2023-12-28 00:31:06,141][106225] Updated weights for policy 1, policy_version 734446 (0.0008) [2023-12-28 00:31:06,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 375644160. Throughput: 0: 9768.6, 1: 9938.9. Samples: 375660428. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:06,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-5.533')] [2023-12-28 00:31:06,182][106226] Updated weights for policy 0, policy_version 732589 (0.0008) [2023-12-28 00:31:06,202][106225] Updated weights for policy 1, policy_version 734456 (0.0006) [2023-12-28 00:31:06,249][106226] Updated weights for policy 0, policy_version 732599 (0.0008) [2023-12-28 00:31:06,269][106225] Updated weights for policy 1, policy_version 734466 (0.0006) [2023-12-28 00:31:06,916][106225] Updated weights for policy 1, policy_version 734476 (0.0008) [2023-12-28 00:31:06,971][106225] Updated weights for policy 1, policy_version 734486 (0.0010) [2023-12-28 00:31:06,980][106226] Updated weights for policy 0, policy_version 732609 (0.0006) [2023-12-28 00:31:07,029][106225] Updated weights for policy 1, policy_version 734496 (0.0010) [2023-12-28 00:31:07,034][106226] Updated weights for policy 0, policy_version 732619 (0.0005) [2023-12-28 00:31:07,089][106226] Updated weights for policy 0, policy_version 732629 (0.0005) [2023-12-28 00:31:07,696][106226] Updated weights for policy 0, policy_version 732639 (0.0008) [2023-12-28 00:31:07,714][106225] Updated weights for policy 1, policy_version 734506 (0.0010) [2023-12-28 00:31:07,747][106226] Updated weights for policy 0, policy_version 732649 (0.0010) [2023-12-28 00:31:07,777][106225] Updated weights for policy 1, policy_version 734516 (0.0005) [2023-12-28 00:31:07,800][106226] Updated weights for policy 0, policy_version 732659 (0.0011) [2023-12-28 00:31:07,834][106225] Updated weights for policy 1, policy_version 734526 (0.0005) [2023-12-28 00:31:07,897][106225] Updated weights for policy 1, policy_version 734536 (0.0005) [2023-12-28 00:31:08,430][106225] Updated weights for policy 1, policy_version 734546 (0.0009) [2023-12-28 00:31:08,486][106225] Updated weights for policy 1, policy_version 734556 (0.0009) [2023-12-28 00:31:08,495][106226] Updated weights for policy 0, policy_version 732669 (0.0008) [2023-12-28 00:31:08,554][106225] Updated weights for policy 1, policy_version 734566 (0.0007) [2023-12-28 00:31:08,560][106226] Updated weights for policy 0, policy_version 732679 (0.0007) [2023-12-28 00:31:08,625][106226] Updated weights for policy 0, policy_version 732689 (0.0007) [2023-12-28 00:31:09,286][106225] Updated weights for policy 1, policy_version 734576 (0.0010) [2023-12-28 00:31:09,331][106226] Updated weights for policy 0, policy_version 732699 (0.0010) [2023-12-28 00:31:09,356][106225] Updated weights for policy 1, policy_version 734586 (0.0010) [2023-12-28 00:31:09,408][106226] Updated weights for policy 0, policy_version 732709 (0.0009) [2023-12-28 00:31:09,427][106225] Updated weights for policy 1, policy_version 734596 (0.0009) [2023-12-28 00:31:09,476][106226] Updated weights for policy 0, policy_version 732719 (0.0008) [2023-12-28 00:31:10,162][106225] Updated weights for policy 1, policy_version 734606 (0.0007) [2023-12-28 00:31:10,217][106226] Updated weights for policy 0, policy_version 732729 (0.0008) [2023-12-28 00:31:10,228][106225] Updated weights for policy 1, policy_version 734616 (0.0005) [2023-12-28 00:31:10,271][106226] Updated weights for policy 0, policy_version 732739 (0.0007) [2023-12-28 00:31:10,290][106225] Updated weights for policy 1, policy_version 734626 (0.0007) [2023-12-28 00:31:10,334][106226] Updated weights for policy 0, policy_version 732749 (0.0008) [2023-12-28 00:31:10,392][106226] Updated weights for policy 0, policy_version 732759 (0.0008) [2023-12-28 00:31:10,893][106225] Updated weights for policy 1, policy_version 734636 (0.0007) [2023-12-28 00:31:10,940][106225] Updated weights for policy 1, policy_version 734646 (0.0010) [2023-12-28 00:31:10,991][106225] Updated weights for policy 1, policy_version 734656 (0.0010) [2023-12-28 00:31:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 375750656. Throughput: 0: 9786.9, 1: 10010.1. Samples: 375722228. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:11,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-5.611')] [2023-12-28 00:31:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000734664_188112896.pth... [2023-12-28 00:31:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000733480_187809792.pth [2023-12-28 00:31:11,225][106226] Updated weights for policy 0, policy_version 732769 (0.0009) [2023-12-28 00:31:11,292][106226] Updated weights for policy 0, policy_version 732779 (0.0009) [2023-12-28 00:31:11,373][106226] Updated weights for policy 0, policy_version 732789 (0.0009) [2023-12-28 00:31:11,393][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000732792_187645952.pth... [2023-12-28 00:31:11,397][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000731672_187359232.pth [2023-12-28 00:31:11,843][106225] Updated weights for policy 1, policy_version 734666 (0.0010) [2023-12-28 00:31:11,917][106225] Updated weights for policy 1, policy_version 734676 (0.0007) [2023-12-28 00:31:11,986][106225] Updated weights for policy 1, policy_version 734686 (0.0011) [2023-12-28 00:31:12,054][106225] Updated weights for policy 1, policy_version 734696 (0.0011) [2023-12-28 00:31:12,062][106226] Updated weights for policy 0, policy_version 732799 (0.0006) [2023-12-28 00:31:12,119][106226] Updated weights for policy 0, policy_version 732809 (0.0006) [2023-12-28 00:31:12,179][106226] Updated weights for policy 0, policy_version 732819 (0.0007) [2023-12-28 00:31:12,784][106225] Updated weights for policy 1, policy_version 734706 (0.0011) [2023-12-28 00:31:12,848][106225] Updated weights for policy 1, policy_version 734716 (0.0011) [2023-12-28 00:31:12,899][106226] Updated weights for policy 0, policy_version 732829 (0.0007) [2023-12-28 00:31:12,903][106225] Updated weights for policy 1, policy_version 734726 (0.0010) [2023-12-28 00:31:12,963][106226] Updated weights for policy 0, policy_version 732839 (0.0008) [2023-12-28 00:31:13,028][106226] Updated weights for policy 0, policy_version 732849 (0.0009) [2023-12-28 00:31:13,597][106225] Updated weights for policy 1, policy_version 734736 (0.0006) [2023-12-28 00:31:13,660][106225] Updated weights for policy 1, policy_version 734746 (0.0006) [2023-12-28 00:31:13,722][106225] Updated weights for policy 1, policy_version 734756 (0.0005) [2023-12-28 00:31:13,782][106226] Updated weights for policy 0, policy_version 732859 (0.0009) [2023-12-28 00:31:13,832][106226] Updated weights for policy 0, policy_version 732869 (0.0008) [2023-12-28 00:31:13,888][106226] Updated weights for policy 0, policy_version 732879 (0.0007) [2023-12-28 00:31:14,360][106225] Updated weights for policy 1, policy_version 734766 (0.0007) [2023-12-28 00:31:14,428][106225] Updated weights for policy 1, policy_version 734776 (0.0008) [2023-12-28 00:31:14,494][106225] Updated weights for policy 1, policy_version 734786 (0.0009) [2023-12-28 00:31:14,527][106226] Updated weights for policy 0, policy_version 732889 (0.0006) [2023-12-28 00:31:14,592][106226] Updated weights for policy 0, policy_version 732899 (0.0008) [2023-12-28 00:31:14,641][106226] Updated weights for policy 0, policy_version 732909 (0.0009) [2023-12-28 00:31:14,689][106226] Updated weights for policy 0, policy_version 732919 (0.0008) [2023-12-28 00:31:15,160][106225] Updated weights for policy 1, policy_version 734796 (0.0008) [2023-12-28 00:31:15,213][106225] Updated weights for policy 1, policy_version 734806 (0.0009) [2023-12-28 00:31:15,266][106225] Updated weights for policy 1, policy_version 734816 (0.0009) [2023-12-28 00:31:15,480][106226] Updated weights for policy 0, policy_version 732929 (0.0006) [2023-12-28 00:31:15,549][106226] Updated weights for policy 0, policy_version 732939 (0.0006) [2023-12-28 00:31:15,616][106226] Updated weights for policy 0, policy_version 732949 (0.0008) [2023-12-28 00:31:15,988][106225] Updated weights for policy 1, policy_version 734827 (0.0009) [2023-12-28 00:31:16,048][106225] Updated weights for policy 1, policy_version 734837 (0.0005) [2023-12-28 00:31:16,095][106225] Updated weights for policy 1, policy_version 734847 (0.0005) [2023-12-28 00:31:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 375848960. Throughput: 0: 9728.5, 1: 9926.5. Samples: 375836908. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:16,176][105115] Avg episode reward: [(0, '-4.465'), (1, '-5.432')] [2023-12-28 00:31:16,200][106226] Updated weights for policy 0, policy_version 732959 (0.0008) [2023-12-28 00:31:16,261][106226] Updated weights for policy 0, policy_version 732969 (0.0010) [2023-12-28 00:31:16,311][106226] Updated weights for policy 0, policy_version 732979 (0.0010) [2023-12-28 00:31:16,631][106225] Updated weights for policy 1, policy_version 734857 (0.0005) [2023-12-28 00:31:16,694][106225] Updated weights for policy 1, policy_version 734867 (0.0007) [2023-12-28 00:31:16,757][106225] Updated weights for policy 1, policy_version 734877 (0.0007) [2023-12-28 00:31:16,816][106225] Updated weights for policy 1, policy_version 734887 (0.0008) [2023-12-28 00:31:16,968][106226] Updated weights for policy 0, policy_version 732989 (0.0009) [2023-12-28 00:31:17,026][106226] Updated weights for policy 0, policy_version 732999 (0.0009) [2023-12-28 00:31:17,082][106226] Updated weights for policy 0, policy_version 733009 (0.0008) [2023-12-28 00:31:17,483][106225] Updated weights for policy 1, policy_version 734897 (0.0009) [2023-12-28 00:31:17,534][106225] Updated weights for policy 1, policy_version 734907 (0.0008) [2023-12-28 00:31:17,584][106225] Updated weights for policy 1, policy_version 734917 (0.0009) [2023-12-28 00:31:17,881][106226] Updated weights for policy 0, policy_version 733019 (0.0007) [2023-12-28 00:31:17,937][106226] Updated weights for policy 0, policy_version 733029 (0.0008) [2023-12-28 00:31:17,986][106226] Updated weights for policy 0, policy_version 733039 (0.0010) [2023-12-28 00:31:18,176][106225] Updated weights for policy 1, policy_version 734927 (0.0008) [2023-12-28 00:31:18,232][106225] Updated weights for policy 1, policy_version 734937 (0.0011) [2023-12-28 00:31:18,286][106225] Updated weights for policy 1, policy_version 734947 (0.0010) [2023-12-28 00:31:18,754][106226] Updated weights for policy 0, policy_version 733049 (0.0009) [2023-12-28 00:31:18,815][106226] Updated weights for policy 0, policy_version 733059 (0.0008) [2023-12-28 00:31:18,881][106226] Updated weights for policy 0, policy_version 733069 (0.0007) [2023-12-28 00:31:18,942][106226] Updated weights for policy 0, policy_version 733079 (0.0008) [2023-12-28 00:31:19,031][106225] Updated weights for policy 1, policy_version 734957 (0.0010) [2023-12-28 00:31:19,075][106225] Updated weights for policy 1, policy_version 734967 (0.0010) [2023-12-28 00:31:19,121][106225] Updated weights for policy 1, policy_version 734977 (0.0006) [2023-12-28 00:31:19,769][106226] Updated weights for policy 0, policy_version 733089 (0.0010) [2023-12-28 00:31:19,778][106225] Updated weights for policy 1, policy_version 734987 (0.0005) [2023-12-28 00:31:19,832][106226] Updated weights for policy 0, policy_version 733099 (0.0009) [2023-12-28 00:31:19,850][106225] Updated weights for policy 1, policy_version 734997 (0.0007) [2023-12-28 00:31:19,899][106226] Updated weights for policy 0, policy_version 733109 (0.0008) [2023-12-28 00:31:19,915][106225] Updated weights for policy 1, policy_version 735007 (0.0007) [2023-12-28 00:31:20,632][106225] Updated weights for policy 1, policy_version 735017 (0.0007) [2023-12-28 00:31:20,693][106226] Updated weights for policy 0, policy_version 733119 (0.0008) [2023-12-28 00:31:20,702][106225] Updated weights for policy 1, policy_version 735027 (0.0008) [2023-12-28 00:31:20,761][106226] Updated weights for policy 0, policy_version 733129 (0.0009) [2023-12-28 00:31:20,762][106225] Updated weights for policy 1, policy_version 735037 (0.0006) [2023-12-28 00:31:20,821][106225] Updated weights for policy 1, policy_version 735047 (0.0008) [2023-12-28 00:31:20,828][106226] Updated weights for policy 0, policy_version 733139 (0.0008) [2023-12-28 00:31:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 375947264. Throughput: 0: 9565.9, 1: 9987.1. Samples: 375956680. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:21,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-5.576')] [2023-12-28 00:31:21,514][106226] Updated weights for policy 0, policy_version 733149 (0.0008) [2023-12-28 00:31:21,583][106226] Updated weights for policy 0, policy_version 733159 (0.0007) [2023-12-28 00:31:21,607][106225] Updated weights for policy 1, policy_version 735057 (0.0009) [2023-12-28 00:31:21,647][106226] Updated weights for policy 0, policy_version 733169 (0.0008) [2023-12-28 00:31:21,686][106225] Updated weights for policy 1, policy_version 735067 (0.0008) [2023-12-28 00:31:21,758][106225] Updated weights for policy 1, policy_version 735077 (0.0008) [2023-12-28 00:31:22,408][106225] Updated weights for policy 1, policy_version 735087 (0.0008) [2023-12-28 00:31:22,453][106226] Updated weights for policy 0, policy_version 733179 (0.0009) [2023-12-28 00:31:22,463][106225] Updated weights for policy 1, policy_version 735097 (0.0007) [2023-12-28 00:31:22,513][106226] Updated weights for policy 0, policy_version 733189 (0.0011) [2023-12-28 00:31:22,515][106225] Updated weights for policy 1, policy_version 735107 (0.0006) [2023-12-28 00:31:22,565][106226] Updated weights for policy 0, policy_version 733199 (0.0010) [2023-12-28 00:31:23,257][106225] Updated weights for policy 1, policy_version 735117 (0.0007) [2023-12-28 00:31:23,298][106226] Updated weights for policy 0, policy_version 733209 (0.0010) [2023-12-28 00:31:23,313][106225] Updated weights for policy 1, policy_version 735127 (0.0005) [2023-12-28 00:31:23,348][106226] Updated weights for policy 0, policy_version 733219 (0.0005) [2023-12-28 00:31:23,358][106225] Updated weights for policy 1, policy_version 735137 (0.0005) [2023-12-28 00:31:23,398][106226] Updated weights for policy 0, policy_version 733229 (0.0005) [2023-12-28 00:31:23,447][106226] Updated weights for policy 0, policy_version 733239 (0.0005) [2023-12-28 00:31:23,988][106225] Updated weights for policy 1, policy_version 735147 (0.0007) [2023-12-28 00:31:24,047][106226] Updated weights for policy 0, policy_version 733249 (0.0007) [2023-12-28 00:31:24,056][106225] Updated weights for policy 1, policy_version 735157 (0.0011) [2023-12-28 00:31:24,112][106226] Updated weights for policy 0, policy_version 733259 (0.0006) [2023-12-28 00:31:24,117][106225] Updated weights for policy 1, policy_version 735167 (0.0011) [2023-12-28 00:31:24,173][106226] Updated weights for policy 0, policy_version 733269 (0.0008) [2023-12-28 00:31:24,817][106225] Updated weights for policy 1, policy_version 735177 (0.0010) [2023-12-28 00:31:24,829][106226] Updated weights for policy 0, policy_version 733279 (0.0006) [2023-12-28 00:31:24,866][106225] Updated weights for policy 1, policy_version 735187 (0.0007) [2023-12-28 00:31:24,895][106226] Updated weights for policy 0, policy_version 733289 (0.0005) [2023-12-28 00:31:24,916][106225] Updated weights for policy 1, policy_version 735197 (0.0008) [2023-12-28 00:31:24,944][106226] Updated weights for policy 0, policy_version 733299 (0.0005) [2023-12-28 00:31:24,962][106225] Updated weights for policy 1, policy_version 735207 (0.0009) [2023-12-28 00:31:25,456][106226] Updated weights for policy 0, policy_version 733309 (0.0005) [2023-12-28 00:31:25,512][106226] Updated weights for policy 0, policy_version 733319 (0.0005) [2023-12-28 00:31:25,561][106226] Updated weights for policy 0, policy_version 733329 (0.0005) [2023-12-28 00:31:25,629][106225] Updated weights for policy 1, policy_version 735217 (0.0007) [2023-12-28 00:31:25,681][106225] Updated weights for policy 1, policy_version 735227 (0.0008) [2023-12-28 00:31:25,737][106225] Updated weights for policy 1, policy_version 735237 (0.0007) [2023-12-28 00:31:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 376045568. Throughput: 0: 9563.5, 1: 9962.0. Samples: 376015056. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:26,176][105115] Avg episode reward: [(0, '-4.176'), (1, '-5.238')] [2023-12-28 00:31:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000735240_188260352.pth... [2023-12-28 00:31:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000733336_187785216.pth... [2023-12-28 00:31:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000734088_187965440.pth [2023-12-28 00:31:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000732216_187498496.pth [2023-12-28 00:31:26,224][106226] Updated weights for policy 0, policy_version 733339 (0.0008) [2023-12-28 00:31:26,285][106226] Updated weights for policy 0, policy_version 733349 (0.0007) [2023-12-28 00:31:26,342][106226] Updated weights for policy 0, policy_version 733359 (0.0006) [2023-12-28 00:31:26,449][106225] Updated weights for policy 1, policy_version 735247 (0.0009) [2023-12-28 00:31:26,508][106225] Updated weights for policy 1, policy_version 735257 (0.0009) [2023-12-28 00:31:26,565][106225] Updated weights for policy 1, policy_version 735267 (0.0008) [2023-12-28 00:31:26,959][106226] Updated weights for policy 0, policy_version 733369 (0.0005) [2023-12-28 00:31:27,008][106226] Updated weights for policy 0, policy_version 733379 (0.0007) [2023-12-28 00:31:27,052][106226] Updated weights for policy 0, policy_version 733389 (0.0008) [2023-12-28 00:31:27,095][106226] Updated weights for policy 0, policy_version 733399 (0.0005) [2023-12-28 00:31:27,334][106225] Updated weights for policy 1, policy_version 735277 (0.0008) [2023-12-28 00:31:27,388][106225] Updated weights for policy 1, policy_version 735287 (0.0009) [2023-12-28 00:31:27,441][106225] Updated weights for policy 1, policy_version 735297 (0.0008) [2023-12-28 00:31:27,821][106226] Updated weights for policy 0, policy_version 733409 (0.0009) [2023-12-28 00:31:27,883][106226] Updated weights for policy 0, policy_version 733419 (0.0006) [2023-12-28 00:31:27,940][106226] Updated weights for policy 0, policy_version 733429 (0.0005) [2023-12-28 00:31:28,072][106225] Updated weights for policy 1, policy_version 735307 (0.0009) [2023-12-28 00:31:28,124][106225] Updated weights for policy 1, policy_version 735317 (0.0010) [2023-12-28 00:31:28,182][106225] Updated weights for policy 1, policy_version 735327 (0.0010) [2023-12-28 00:31:28,557][106226] Updated weights for policy 0, policy_version 733439 (0.0006) [2023-12-28 00:31:28,617][106226] Updated weights for policy 0, policy_version 733449 (0.0005) [2023-12-28 00:31:28,670][106226] Updated weights for policy 0, policy_version 733459 (0.0008) [2023-12-28 00:31:28,982][106225] Updated weights for policy 1, policy_version 735337 (0.0009) [2023-12-28 00:31:29,031][106225] Updated weights for policy 1, policy_version 735347 (0.0009) [2023-12-28 00:31:29,087][106225] Updated weights for policy 1, policy_version 735357 (0.0008) [2023-12-28 00:31:29,153][106225] Updated weights for policy 1, policy_version 735367 (0.0008) [2023-12-28 00:31:29,262][106226] Updated weights for policy 0, policy_version 733469 (0.0007) [2023-12-28 00:31:29,316][106226] Updated weights for policy 0, policy_version 733479 (0.0005) [2023-12-28 00:31:29,383][106226] Updated weights for policy 0, policy_version 733489 (0.0007) [2023-12-28 00:31:29,949][106225] Updated weights for policy 1, policy_version 735377 (0.0008) [2023-12-28 00:31:30,017][106225] Updated weights for policy 1, policy_version 735387 (0.0009) [2023-12-28 00:31:30,074][106226] Updated weights for policy 0, policy_version 733499 (0.0008) [2023-12-28 00:31:30,079][106225] Updated weights for policy 1, policy_version 735397 (0.0008) [2023-12-28 00:31:30,138][106226] Updated weights for policy 0, policy_version 733509 (0.0006) [2023-12-28 00:31:30,198][106226] Updated weights for policy 0, policy_version 733519 (0.0007) [2023-12-28 00:31:30,817][106225] Updated weights for policy 1, policy_version 735407 (0.0008) [2023-12-28 00:31:30,870][106225] Updated weights for policy 1, policy_version 735417 (0.0008) [2023-12-28 00:31:30,885][106226] Updated weights for policy 0, policy_version 733529 (0.0008) [2023-12-28 00:31:30,916][106225] Updated weights for policy 1, policy_version 735427 (0.0007) [2023-12-28 00:31:30,930][106226] Updated weights for policy 0, policy_version 733539 (0.0006) [2023-12-28 00:31:30,978][106226] Updated weights for policy 0, policy_version 733549 (0.0005) [2023-12-28 00:31:31,033][106226] Updated weights for policy 0, policy_version 733559 (0.0006) [2023-12-28 00:31:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 376152064. Throughput: 0: 9701.0, 1: 9928.3. Samples: 376138072. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 00:31:31,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.431')] [2023-12-28 00:31:31,751][106225] Updated weights for policy 1, policy_version 735437 (0.0007) [2023-12-28 00:31:31,758][106226] Updated weights for policy 0, policy_version 733569 (0.0008) [2023-12-28 00:31:31,815][106226] Updated weights for policy 0, policy_version 733579 (0.0006) [2023-12-28 00:31:31,816][106225] Updated weights for policy 1, policy_version 735447 (0.0008) [2023-12-28 00:31:31,865][106225] Updated weights for policy 1, policy_version 735457 (0.0008) [2023-12-28 00:31:31,871][106226] Updated weights for policy 0, policy_version 733589 (0.0006) [2023-12-28 00:31:32,534][106226] Updated weights for policy 0, policy_version 733599 (0.0005) [2023-12-28 00:31:32,583][106226] Updated weights for policy 0, policy_version 733609 (0.0005) [2023-12-28 00:31:32,623][106225] Updated weights for policy 1, policy_version 735467 (0.0010) [2023-12-28 00:31:32,643][106226] Updated weights for policy 0, policy_version 733619 (0.0006) [2023-12-28 00:31:32,672][106225] Updated weights for policy 1, policy_version 735477 (0.0008) [2023-12-28 00:31:32,729][106225] Updated weights for policy 1, policy_version 735487 (0.0008) [2023-12-28 00:31:33,317][106226] Updated weights for policy 0, policy_version 733629 (0.0006) [2023-12-28 00:31:33,372][106226] Updated weights for policy 0, policy_version 733639 (0.0005) [2023-12-28 00:31:33,421][106226] Updated weights for policy 0, policy_version 733649 (0.0005) [2023-12-28 00:31:33,504][106225] Updated weights for policy 1, policy_version 735497 (0.0009) [2023-12-28 00:31:33,553][106225] Updated weights for policy 1, policy_version 735507 (0.0008) [2023-12-28 00:31:33,602][106225] Updated weights for policy 1, policy_version 735517 (0.0008) [2023-12-28 00:31:33,667][106225] Updated weights for policy 1, policy_version 735527 (0.0009) [2023-12-28 00:31:33,964][106226] Updated weights for policy 0, policy_version 733659 (0.0006) [2023-12-28 00:31:34,013][106226] Updated weights for policy 0, policy_version 733669 (0.0010) [2023-12-28 00:31:34,062][106226] Updated weights for policy 0, policy_version 733679 (0.0010) [2023-12-28 00:31:34,409][106225] Updated weights for policy 1, policy_version 735537 (0.0009) [2023-12-28 00:31:34,457][106225] Updated weights for policy 1, policy_version 735547 (0.0007) [2023-12-28 00:31:34,514][106225] Updated weights for policy 1, policy_version 735557 (0.0006) [2023-12-28 00:31:34,804][106226] Updated weights for policy 0, policy_version 733689 (0.0011) [2023-12-28 00:31:34,854][106226] Updated weights for policy 0, policy_version 733699 (0.0010) [2023-12-28 00:31:34,907][106226] Updated weights for policy 0, policy_version 733709 (0.0010) [2023-12-28 00:31:34,963][106226] Updated weights for policy 0, policy_version 733719 (0.0010) [2023-12-28 00:31:35,231][106225] Updated weights for policy 1, policy_version 735567 (0.0007) [2023-12-28 00:31:35,285][106225] Updated weights for policy 1, policy_version 735577 (0.0008) [2023-12-28 00:31:35,349][106225] Updated weights for policy 1, policy_version 735587 (0.0008) [2023-12-28 00:31:35,661][106226] Updated weights for policy 0, policy_version 733729 (0.0007) [2023-12-28 00:31:35,716][106226] Updated weights for policy 0, policy_version 733739 (0.0006) [2023-12-28 00:31:35,775][106226] Updated weights for policy 0, policy_version 733749 (0.0006) [2023-12-28 00:31:36,066][106225] Updated weights for policy 1, policy_version 735597 (0.0009) [2023-12-28 00:31:36,124][106225] Updated weights for policy 1, policy_version 735607 (0.0008) [2023-12-28 00:31:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 376242176. Throughput: 0: 9844.4, 1: 9787.6. Samples: 376255748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:31:36,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-5.481')] [2023-12-28 00:31:36,186][106225] Updated weights for policy 1, policy_version 735617 (0.0009) [2023-12-28 00:31:36,462][106226] Updated weights for policy 0, policy_version 733759 (0.0008) [2023-12-28 00:31:36,519][106226] Updated weights for policy 0, policy_version 733769 (0.0009) [2023-12-28 00:31:36,577][106226] Updated weights for policy 0, policy_version 733779 (0.0009) [2023-12-28 00:31:36,917][106225] Updated weights for policy 1, policy_version 735627 (0.0009) [2023-12-28 00:31:36,983][106225] Updated weights for policy 1, policy_version 735637 (0.0008) [2023-12-28 00:31:37,049][106225] Updated weights for policy 1, policy_version 735647 (0.0008) [2023-12-28 00:31:37,333][106226] Updated weights for policy 0, policy_version 733789 (0.0009) [2023-12-28 00:31:37,395][106226] Updated weights for policy 0, policy_version 733799 (0.0008) [2023-12-28 00:31:37,459][106226] Updated weights for policy 0, policy_version 733809 (0.0008) [2023-12-28 00:31:37,755][106225] Updated weights for policy 1, policy_version 735657 (0.0009) [2023-12-28 00:31:37,813][106225] Updated weights for policy 1, policy_version 735667 (0.0009) [2023-12-28 00:31:37,867][106225] Updated weights for policy 1, policy_version 735677 (0.0008) [2023-12-28 00:31:37,926][106225] Updated weights for policy 1, policy_version 735687 (0.0009) [2023-12-28 00:31:38,160][106226] Updated weights for policy 0, policy_version 733819 (0.0009) [2023-12-28 00:31:38,216][106226] Updated weights for policy 0, policy_version 733829 (0.0009) [2023-12-28 00:31:38,280][106226] Updated weights for policy 0, policy_version 733839 (0.0008) [2023-12-28 00:31:38,571][106225] Updated weights for policy 1, policy_version 735697 (0.0009) [2023-12-28 00:31:38,627][106225] Updated weights for policy 1, policy_version 735707 (0.0008) [2023-12-28 00:31:38,679][106225] Updated weights for policy 1, policy_version 735717 (0.0008) [2023-12-28 00:31:39,064][106226] Updated weights for policy 0, policy_version 733849 (0.0008) [2023-12-28 00:31:39,117][106226] Updated weights for policy 0, policy_version 733859 (0.0008) [2023-12-28 00:31:39,180][106226] Updated weights for policy 0, policy_version 733869 (0.0009) [2023-12-28 00:31:39,248][106226] Updated weights for policy 0, policy_version 733879 (0.0008) [2023-12-28 00:31:39,449][106225] Updated weights for policy 1, policy_version 735727 (0.0008) [2023-12-28 00:31:39,508][106225] Updated weights for policy 1, policy_version 735737 (0.0009) [2023-12-28 00:31:39,573][106225] Updated weights for policy 1, policy_version 735747 (0.0009) [2023-12-28 00:31:40,024][106226] Updated weights for policy 0, policy_version 733889 (0.0009) [2023-12-28 00:31:40,109][106226] Updated weights for policy 0, policy_version 733899 (0.0009) [2023-12-28 00:31:40,176][106226] Updated weights for policy 0, policy_version 733909 (0.0010) [2023-12-28 00:31:40,315][106225] Updated weights for policy 1, policy_version 735757 (0.0007) [2023-12-28 00:31:40,378][106225] Updated weights for policy 1, policy_version 735767 (0.0005) [2023-12-28 00:31:40,435][106225] Updated weights for policy 1, policy_version 735777 (0.0006) [2023-12-28 00:31:40,843][106226] Updated weights for policy 0, policy_version 733919 (0.0010) [2023-12-28 00:31:40,910][106226] Updated weights for policy 0, policy_version 733929 (0.0011) [2023-12-28 00:31:40,964][106226] Updated weights for policy 0, policy_version 733939 (0.0008) [2023-12-28 00:31:41,111][106225] Updated weights for policy 1, policy_version 735787 (0.0007) [2023-12-28 00:31:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 376340480. Throughput: 0: 9827.0, 1: 9821.7. Samples: 376313456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:31:41,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-5.687')] [2023-12-28 00:31:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000733944_187940864.pth... [2023-12-28 00:31:41,180][106225] Updated weights for policy 1, policy_version 735797 (0.0007) [2023-12-28 00:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000732792_187645952.pth [2023-12-28 00:31:41,244][106225] Updated weights for policy 1, policy_version 735807 (0.0008) [2023-12-28 00:31:41,303][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000735816_188407808.pth... [2023-12-28 00:31:41,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000734664_188112896.pth [2023-12-28 00:31:41,791][106226] Updated weights for policy 0, policy_version 733949 (0.0010) [2023-12-28 00:31:41,848][106226] Updated weights for policy 0, policy_version 733959 (0.0009) [2023-12-28 00:31:41,912][106226] Updated weights for policy 0, policy_version 733969 (0.0009) [2023-12-28 00:31:41,982][106225] Updated weights for policy 1, policy_version 735817 (0.0007) [2023-12-28 00:31:42,048][106225] Updated weights for policy 1, policy_version 735827 (0.0007) [2023-12-28 00:31:42,119][106225] Updated weights for policy 1, policy_version 735837 (0.0007) [2023-12-28 00:31:42,185][106225] Updated weights for policy 1, policy_version 735847 (0.0008) [2023-12-28 00:31:42,612][106226] Updated weights for policy 0, policy_version 733979 (0.0009) [2023-12-28 00:31:42,661][106226] Updated weights for policy 0, policy_version 733989 (0.0009) [2023-12-28 00:31:42,720][106226] Updated weights for policy 0, policy_version 733999 (0.0006) [2023-12-28 00:31:42,936][106225] Updated weights for policy 1, policy_version 735857 (0.0009) [2023-12-28 00:31:42,985][106225] Updated weights for policy 1, policy_version 735867 (0.0009) [2023-12-28 00:31:43,039][106225] Updated weights for policy 1, policy_version 735877 (0.0008) [2023-12-28 00:31:43,271][106226] Updated weights for policy 0, policy_version 734009 (0.0007) [2023-12-28 00:31:43,335][106226] Updated weights for policy 0, policy_version 734019 (0.0005) [2023-12-28 00:31:43,395][106226] Updated weights for policy 0, policy_version 734029 (0.0005) [2023-12-28 00:31:43,452][106226] Updated weights for policy 0, policy_version 734039 (0.0005) [2023-12-28 00:31:43,848][106225] Updated weights for policy 1, policy_version 735887 (0.0009) [2023-12-28 00:31:43,897][106225] Updated weights for policy 1, policy_version 735897 (0.0007) [2023-12-28 00:31:43,958][106225] Updated weights for policy 1, policy_version 735907 (0.0008) [2023-12-28 00:31:43,960][106226] Updated weights for policy 0, policy_version 734049 (0.0005) [2023-12-28 00:31:44,011][106226] Updated weights for policy 0, policy_version 734059 (0.0008) [2023-12-28 00:31:44,073][106226] Updated weights for policy 0, policy_version 734069 (0.0007) [2023-12-28 00:31:44,669][106225] Updated weights for policy 1, policy_version 735917 (0.0007) [2023-12-28 00:31:44,690][106226] Updated weights for policy 0, policy_version 734079 (0.0007) [2023-12-28 00:31:44,726][106225] Updated weights for policy 1, policy_version 735927 (0.0007) [2023-12-28 00:31:44,744][106226] Updated weights for policy 0, policy_version 734089 (0.0007) [2023-12-28 00:31:44,804][106225] Updated weights for policy 1, policy_version 735937 (0.0007) [2023-12-28 00:31:44,809][106226] Updated weights for policy 0, policy_version 734099 (0.0007) [2023-12-28 00:31:45,459][106225] Updated weights for policy 1, policy_version 735947 (0.0007) [2023-12-28 00:31:45,514][106225] Updated weights for policy 1, policy_version 735957 (0.0005) [2023-12-28 00:31:45,568][106225] Updated weights for policy 1, policy_version 735967 (0.0006) [2023-12-28 00:31:45,600][106226] Updated weights for policy 0, policy_version 734109 (0.0008) [2023-12-28 00:31:45,670][106226] Updated weights for policy 0, policy_version 734119 (0.0011) [2023-12-28 00:31:45,741][106226] Updated weights for policy 0, policy_version 734129 (0.0011) [2023-12-28 00:31:46,155][106225] Updated weights for policy 1, policy_version 735977 (0.0007) [2023-12-28 00:31:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 376438784. Throughput: 0: 9897.9, 1: 9807.8. Samples: 376430320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:31:46,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-5.588')] [2023-12-28 00:31:46,213][106225] Updated weights for policy 1, policy_version 735987 (0.0009) [2023-12-28 00:31:46,263][106225] Updated weights for policy 1, policy_version 735997 (0.0010) [2023-12-28 00:31:46,319][106225] Updated weights for policy 1, policy_version 736007 (0.0010) [2023-12-28 00:31:46,422][106226] Updated weights for policy 0, policy_version 734139 (0.0010) [2023-12-28 00:31:46,479][106226] Updated weights for policy 0, policy_version 734149 (0.0009) [2023-12-28 00:31:46,532][106226] Updated weights for policy 0, policy_version 734159 (0.0008) [2023-12-28 00:31:46,956][106225] Updated weights for policy 1, policy_version 736017 (0.0006) [2023-12-28 00:31:47,010][106225] Updated weights for policy 1, policy_version 736027 (0.0005) [2023-12-28 00:31:47,056][106225] Updated weights for policy 1, policy_version 736037 (0.0005) [2023-12-28 00:31:47,155][106226] Updated weights for policy 0, policy_version 734169 (0.0006) [2023-12-28 00:31:47,207][106226] Updated weights for policy 0, policy_version 734179 (0.0005) [2023-12-28 00:31:47,254][106226] Updated weights for policy 0, policy_version 734189 (0.0005) [2023-12-28 00:31:47,302][106226] Updated weights for policy 0, policy_version 734199 (0.0008) [2023-12-28 00:31:47,603][106225] Updated weights for policy 1, policy_version 736047 (0.0009) [2023-12-28 00:31:47,664][106225] Updated weights for policy 1, policy_version 736057 (0.0010) [2023-12-28 00:31:47,723][106225] Updated weights for policy 1, policy_version 736067 (0.0010) [2023-12-28 00:31:47,993][106226] Updated weights for policy 0, policy_version 734209 (0.0009) [2023-12-28 00:31:48,050][106226] Updated weights for policy 0, policy_version 734219 (0.0010) [2023-12-28 00:31:48,094][106226] Updated weights for policy 0, policy_version 734229 (0.0010) [2023-12-28 00:31:48,450][106225] Updated weights for policy 1, policy_version 736077 (0.0010) [2023-12-28 00:31:48,506][106225] Updated weights for policy 1, policy_version 736087 (0.0010) [2023-12-28 00:31:48,558][106225] Updated weights for policy 1, policy_version 736097 (0.0011) [2023-12-28 00:31:48,826][106226] Updated weights for policy 0, policy_version 734240 (0.0009) [2023-12-28 00:31:48,887][106226] Updated weights for policy 0, policy_version 734250 (0.0008) [2023-12-28 00:31:48,949][106226] Updated weights for policy 0, policy_version 734260 (0.0008) [2023-12-28 00:31:49,299][106225] Updated weights for policy 1, policy_version 736107 (0.0010) [2023-12-28 00:31:49,369][106225] Updated weights for policy 1, policy_version 736117 (0.0008) [2023-12-28 00:31:49,422][106225] Updated weights for policy 1, policy_version 736127 (0.0008) [2023-12-28 00:31:49,660][106226] Updated weights for policy 0, policy_version 734270 (0.0008) [2023-12-28 00:31:49,715][106226] Updated weights for policy 0, policy_version 734280 (0.0009) [2023-12-28 00:31:49,773][106226] Updated weights for policy 0, policy_version 734290 (0.0009) [2023-12-28 00:31:50,184][106225] Updated weights for policy 1, policy_version 736137 (0.0008) [2023-12-28 00:31:50,232][106225] Updated weights for policy 1, policy_version 736147 (0.0006) [2023-12-28 00:31:50,299][106225] Updated weights for policy 1, policy_version 736157 (0.0005) [2023-12-28 00:31:50,359][106225] Updated weights for policy 1, policy_version 736167 (0.0006) [2023-12-28 00:31:50,584][106226] Updated weights for policy 0, policy_version 734300 (0.0008) [2023-12-28 00:31:50,648][106226] Updated weights for policy 0, policy_version 734310 (0.0011) [2023-12-28 00:31:50,710][106226] Updated weights for policy 0, policy_version 734320 (0.0010) [2023-12-28 00:31:50,945][106225] Updated weights for policy 1, policy_version 736177 (0.0008) [2023-12-28 00:31:51,011][106225] Updated weights for policy 1, policy_version 736187 (0.0008) [2023-12-28 00:31:51,077][106225] Updated weights for policy 1, policy_version 736197 (0.0008) [2023-12-28 00:31:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 376545280. Throughput: 0: 9926.7, 1: 9870.1. Samples: 376551288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:31:51,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.625')] [2023-12-28 00:31:51,474][106226] Updated weights for policy 0, policy_version 734330 (0.0011) [2023-12-28 00:31:51,528][106226] Updated weights for policy 0, policy_version 734340 (0.0010) [2023-12-28 00:31:51,586][106226] Updated weights for policy 0, policy_version 734350 (0.0009) [2023-12-28 00:31:51,653][106226] Updated weights for policy 0, policy_version 734360 (0.0011) [2023-12-28 00:31:51,865][106225] Updated weights for policy 1, policy_version 736207 (0.0008) [2023-12-28 00:31:51,930][106225] Updated weights for policy 1, policy_version 736217 (0.0009) [2023-12-28 00:31:51,993][106225] Updated weights for policy 1, policy_version 736227 (0.0008) [2023-12-28 00:31:52,347][106226] Updated weights for policy 0, policy_version 734370 (0.0009) [2023-12-28 00:31:52,420][106226] Updated weights for policy 0, policy_version 734380 (0.0009) [2023-12-28 00:31:52,486][106226] Updated weights for policy 0, policy_version 734390 (0.0010) [2023-12-28 00:31:52,719][106225] Updated weights for policy 1, policy_version 736237 (0.0008) [2023-12-28 00:31:52,770][106225] Updated weights for policy 1, policy_version 736247 (0.0010) [2023-12-28 00:31:52,827][106225] Updated weights for policy 1, policy_version 736257 (0.0009) [2023-12-28 00:31:53,101][106226] Updated weights for policy 0, policy_version 734400 (0.0008) [2023-12-28 00:31:53,157][106226] Updated weights for policy 0, policy_version 734410 (0.0008) [2023-12-28 00:31:53,214][106226] Updated weights for policy 0, policy_version 734420 (0.0008) [2023-12-28 00:31:53,563][106225] Updated weights for policy 1, policy_version 736267 (0.0009) [2023-12-28 00:31:53,612][106225] Updated weights for policy 1, policy_version 736277 (0.0010) [2023-12-28 00:31:53,662][106225] Updated weights for policy 1, policy_version 736287 (0.0010) [2023-12-28 00:31:53,890][106226] Updated weights for policy 0, policy_version 734430 (0.0008) [2023-12-28 00:31:53,948][106226] Updated weights for policy 0, policy_version 734440 (0.0008) [2023-12-28 00:31:54,005][106226] Updated weights for policy 0, policy_version 734450 (0.0008) [2023-12-28 00:31:54,403][106225] Updated weights for policy 1, policy_version 736297 (0.0010) [2023-12-28 00:31:54,467][106225] Updated weights for policy 1, policy_version 736307 (0.0010) [2023-12-28 00:31:54,530][106225] Updated weights for policy 1, policy_version 736317 (0.0010) [2023-12-28 00:31:54,591][106225] Updated weights for policy 1, policy_version 736327 (0.0009) [2023-12-28 00:31:54,764][106226] Updated weights for policy 0, policy_version 734460 (0.0009) [2023-12-28 00:31:54,830][106226] Updated weights for policy 0, policy_version 734470 (0.0011) [2023-12-28 00:31:54,890][106226] Updated weights for policy 0, policy_version 734480 (0.0010) [2023-12-28 00:31:55,273][106225] Updated weights for policy 1, policy_version 736337 (0.0006) [2023-12-28 00:31:55,340][106225] Updated weights for policy 1, policy_version 736347 (0.0005) [2023-12-28 00:31:55,415][106225] Updated weights for policy 1, policy_version 736357 (0.0005) [2023-12-28 00:31:55,493][106226] Updated weights for policy 0, policy_version 734490 (0.0009) [2023-12-28 00:31:55,553][106226] Updated weights for policy 0, policy_version 734500 (0.0007) [2023-12-28 00:31:55,606][106226] Updated weights for policy 0, policy_version 734510 (0.0010) [2023-12-28 00:31:55,669][106226] Updated weights for policy 0, policy_version 734520 (0.0010) [2023-12-28 00:31:56,044][106225] Updated weights for policy 1, policy_version 736367 (0.0007) [2023-12-28 00:31:56,099][106225] Updated weights for policy 1, policy_version 736377 (0.0008) [2023-12-28 00:31:56,154][106225] Updated weights for policy 1, policy_version 736387 (0.0007) [2023-12-28 00:31:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 376635392. Throughput: 0: 9917.7, 1: 9793.8. Samples: 376609244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:31:56,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-5.406')] [2023-12-28 00:31:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000736392_188555264.pth... [2023-12-28 00:31:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000734520_188088320.pth... [2023-12-28 00:31:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000733336_187785216.pth [2023-12-28 00:31:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000735240_188260352.pth [2023-12-28 00:31:56,256][106226] Updated weights for policy 0, policy_version 734530 (0.0006) [2023-12-28 00:31:56,307][106226] Updated weights for policy 0, policy_version 734540 (0.0005) [2023-12-28 00:31:56,356][106226] Updated weights for policy 0, policy_version 734550 (0.0005) [2023-12-28 00:31:56,740][106225] Updated weights for policy 1, policy_version 736397 (0.0005) [2023-12-28 00:31:56,805][106225] Updated weights for policy 1, policy_version 736407 (0.0005) [2023-12-28 00:31:56,851][106225] Updated weights for policy 1, policy_version 736417 (0.0005) [2023-12-28 00:31:57,005][106226] Updated weights for policy 0, policy_version 734560 (0.0006) [2023-12-28 00:31:57,057][106226] Updated weights for policy 0, policy_version 734570 (0.0009) [2023-12-28 00:31:57,118][106226] Updated weights for policy 0, policy_version 734580 (0.0009) [2023-12-28 00:31:57,476][106225] Updated weights for policy 1, policy_version 736427 (0.0006) [2023-12-28 00:31:57,535][106225] Updated weights for policy 1, policy_version 736437 (0.0007) [2023-12-28 00:31:57,585][106225] Updated weights for policy 1, policy_version 736448 (0.0009) [2023-12-28 00:31:57,765][106226] Updated weights for policy 0, policy_version 734590 (0.0009) [2023-12-28 00:31:57,816][106226] Updated weights for policy 0, policy_version 734600 (0.0007) [2023-12-28 00:31:57,871][106226] Updated weights for policy 0, policy_version 734610 (0.0009) [2023-12-28 00:31:58,225][106225] Updated weights for policy 1, policy_version 736458 (0.0008) [2023-12-28 00:31:58,286][106225] Updated weights for policy 1, policy_version 736468 (0.0010) [2023-12-28 00:31:58,348][106225] Updated weights for policy 1, policy_version 736478 (0.0010) [2023-12-28 00:31:58,419][106225] Updated weights for policy 1, policy_version 736488 (0.0010) [2023-12-28 00:31:58,666][106226] Updated weights for policy 0, policy_version 734620 (0.0009) [2023-12-28 00:31:58,735][106226] Updated weights for policy 0, policy_version 734630 (0.0007) [2023-12-28 00:31:58,805][106226] Updated weights for policy 0, policy_version 734640 (0.0008) [2023-12-28 00:31:59,279][106225] Updated weights for policy 1, policy_version 736498 (0.0008) [2023-12-28 00:31:59,340][106225] Updated weights for policy 1, policy_version 736508 (0.0007) [2023-12-28 00:31:59,405][106225] Updated weights for policy 1, policy_version 736518 (0.0010) [2023-12-28 00:31:59,626][106226] Updated weights for policy 0, policy_version 734650 (0.0008) [2023-12-28 00:31:59,684][106226] Updated weights for policy 0, policy_version 734660 (0.0009) [2023-12-28 00:31:59,744][106226] Updated weights for policy 0, policy_version 734670 (0.0009) [2023-12-28 00:31:59,799][106226] Updated weights for policy 0, policy_version 734680 (0.0008) [2023-12-28 00:32:00,106][106225] Updated weights for policy 1, policy_version 736528 (0.0008) [2023-12-28 00:32:00,151][106225] Updated weights for policy 1, policy_version 736538 (0.0008) [2023-12-28 00:32:00,199][106225] Updated weights for policy 1, policy_version 736548 (0.0008) [2023-12-28 00:32:00,553][106226] Updated weights for policy 0, policy_version 734690 (0.0010) [2023-12-28 00:32:00,605][106226] Updated weights for policy 0, policy_version 734700 (0.0010) [2023-12-28 00:32:00,667][106226] Updated weights for policy 0, policy_version 734710 (0.0010) [2023-12-28 00:32:00,923][106225] Updated weights for policy 1, policy_version 736558 (0.0006) [2023-12-28 00:32:00,982][106225] Updated weights for policy 1, policy_version 736568 (0.0007) [2023-12-28 00:32:01,042][106225] Updated weights for policy 1, policy_version 736578 (0.0009) [2023-12-28 00:32:01,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 376741888. Throughput: 0: 9994.5, 1: 9851.7. Samples: 376729980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:01,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-5.593')] [2023-12-28 00:32:01,410][106226] Updated weights for policy 0, policy_version 734720 (0.0010) [2023-12-28 00:32:01,466][106226] Updated weights for policy 0, policy_version 734730 (0.0009) [2023-12-28 00:32:01,514][106226] Updated weights for policy 0, policy_version 734740 (0.0009) [2023-12-28 00:32:01,840][106225] Updated weights for policy 1, policy_version 736588 (0.0009) [2023-12-28 00:32:01,917][106225] Updated weights for policy 1, policy_version 736598 (0.0008) [2023-12-28 00:32:01,970][106225] Updated weights for policy 1, policy_version 736608 (0.0008) [2023-12-28 00:32:02,265][106226] Updated weights for policy 0, policy_version 734750 (0.0008) [2023-12-28 00:32:02,331][106226] Updated weights for policy 0, policy_version 734760 (0.0007) [2023-12-28 00:32:02,397][106226] Updated weights for policy 0, policy_version 734770 (0.0009) [2023-12-28 00:32:02,722][106225] Updated weights for policy 1, policy_version 736618 (0.0008) [2023-12-28 00:32:02,779][106225] Updated weights for policy 1, policy_version 736628 (0.0006) [2023-12-28 00:32:02,833][106225] Updated weights for policy 1, policy_version 736638 (0.0005) [2023-12-28 00:32:02,880][106225] Updated weights for policy 1, policy_version 736648 (0.0007) [2023-12-28 00:32:03,110][106226] Updated weights for policy 0, policy_version 734780 (0.0010) [2023-12-28 00:32:03,167][106226] Updated weights for policy 0, policy_version 734790 (0.0010) [2023-12-28 00:32:03,217][106226] Updated weights for policy 0, policy_version 734800 (0.0010) [2023-12-28 00:32:03,577][106225] Updated weights for policy 1, policy_version 736658 (0.0007) [2023-12-28 00:32:03,626][106225] Updated weights for policy 1, policy_version 736668 (0.0008) [2023-12-28 00:32:03,678][106225] Updated weights for policy 1, policy_version 736678 (0.0009) [2023-12-28 00:32:03,852][106226] Updated weights for policy 0, policy_version 734810 (0.0010) [2023-12-28 00:32:03,912][106226] Updated weights for policy 0, policy_version 734820 (0.0007) [2023-12-28 00:32:03,978][106226] Updated weights for policy 0, policy_version 734830 (0.0010) [2023-12-28 00:32:04,046][106226] Updated weights for policy 0, policy_version 734840 (0.0011) [2023-12-28 00:32:04,340][106225] Updated weights for policy 1, policy_version 736688 (0.0006) [2023-12-28 00:32:04,405][106225] Updated weights for policy 1, policy_version 736698 (0.0010) [2023-12-28 00:32:04,472][106225] Updated weights for policy 1, policy_version 736708 (0.0010) [2023-12-28 00:32:04,744][106226] Updated weights for policy 0, policy_version 734850 (0.0010) [2023-12-28 00:32:04,803][106226] Updated weights for policy 0, policy_version 734860 (0.0010) [2023-12-28 00:32:04,853][106226] Updated weights for policy 0, policy_version 734870 (0.0010) [2023-12-28 00:32:05,083][106225] Updated weights for policy 1, policy_version 736718 (0.0009) [2023-12-28 00:32:05,129][106225] Updated weights for policy 1, policy_version 736728 (0.0005) [2023-12-28 00:32:05,175][106225] Updated weights for policy 1, policy_version 736738 (0.0005) [2023-12-28 00:32:05,562][106226] Updated weights for policy 0, policy_version 734880 (0.0010) [2023-12-28 00:32:05,611][106226] Updated weights for policy 0, policy_version 734890 (0.0010) [2023-12-28 00:32:05,665][106226] Updated weights for policy 0, policy_version 734900 (0.0009) [2023-12-28 00:32:05,759][106225] Updated weights for policy 1, policy_version 736748 (0.0007) [2023-12-28 00:32:05,820][106225] Updated weights for policy 1, policy_version 736758 (0.0010) [2023-12-28 00:32:05,883][106225] Updated weights for policy 1, policy_version 736768 (0.0008) [2023-12-28 00:32:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 376840192. Throughput: 0: 10039.0, 1: 9789.3. Samples: 376848948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:06,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-5.553')] [2023-12-28 00:32:06,408][106226] Updated weights for policy 0, policy_version 734910 (0.0011) [2023-12-28 00:32:06,470][106226] Updated weights for policy 0, policy_version 734920 (0.0007) [2023-12-28 00:32:06,527][106226] Updated weights for policy 0, policy_version 734930 (0.0010) [2023-12-28 00:32:06,630][106225] Updated weights for policy 1, policy_version 736778 (0.0010) [2023-12-28 00:32:06,694][106225] Updated weights for policy 1, policy_version 736788 (0.0008) [2023-12-28 00:32:06,751][106225] Updated weights for policy 1, policy_version 736798 (0.0006) [2023-12-28 00:32:06,805][106225] Updated weights for policy 1, policy_version 736808 (0.0006) [2023-12-28 00:32:07,233][106226] Updated weights for policy 0, policy_version 734940 (0.0011) [2023-12-28 00:32:07,284][106226] Updated weights for policy 0, policy_version 734950 (0.0010) [2023-12-28 00:32:07,330][106226] Updated weights for policy 0, policy_version 734960 (0.0010) [2023-12-28 00:32:07,487][106225] Updated weights for policy 1, policy_version 736818 (0.0008) [2023-12-28 00:32:07,538][106225] Updated weights for policy 1, policy_version 736828 (0.0008) [2023-12-28 00:32:07,589][106225] Updated weights for policy 1, policy_version 736838 (0.0009) [2023-12-28 00:32:07,967][106226] Updated weights for policy 0, policy_version 734970 (0.0009) [2023-12-28 00:32:08,027][106226] Updated weights for policy 0, policy_version 734980 (0.0005) [2023-12-28 00:32:08,081][106226] Updated weights for policy 0, policy_version 734990 (0.0005) [2023-12-28 00:32:08,145][106226] Updated weights for policy 0, policy_version 735000 (0.0005) [2023-12-28 00:32:08,423][106225] Updated weights for policy 1, policy_version 736848 (0.0010) [2023-12-28 00:32:08,485][106225] Updated weights for policy 1, policy_version 736858 (0.0011) [2023-12-28 00:32:08,537][106225] Updated weights for policy 1, policy_version 736868 (0.0008) [2023-12-28 00:32:08,750][106226] Updated weights for policy 0, policy_version 735010 (0.0007) [2023-12-28 00:32:08,814][106226] Updated weights for policy 0, policy_version 735020 (0.0008) [2023-12-28 00:32:08,873][106226] Updated weights for policy 0, policy_version 735030 (0.0009) [2023-12-28 00:32:09,224][106225] Updated weights for policy 1, policy_version 736878 (0.0008) [2023-12-28 00:32:09,295][106225] Updated weights for policy 1, policy_version 736888 (0.0008) [2023-12-28 00:32:09,359][106225] Updated weights for policy 1, policy_version 736898 (0.0008) [2023-12-28 00:32:09,652][106226] Updated weights for policy 0, policy_version 735040 (0.0009) [2023-12-28 00:32:09,723][106226] Updated weights for policy 0, policy_version 735050 (0.0009) [2023-12-28 00:32:09,781][106226] Updated weights for policy 0, policy_version 735060 (0.0009) [2023-12-28 00:32:10,040][106225] Updated weights for policy 1, policy_version 736908 (0.0008) [2023-12-28 00:32:10,089][106225] Updated weights for policy 1, policy_version 736918 (0.0008) [2023-12-28 00:32:10,145][106225] Updated weights for policy 1, policy_version 736928 (0.0008) [2023-12-28 00:32:10,543][106226] Updated weights for policy 0, policy_version 735070 (0.0008) [2023-12-28 00:32:10,604][106226] Updated weights for policy 0, policy_version 735080 (0.0006) [2023-12-28 00:32:10,659][106226] Updated weights for policy 0, policy_version 735090 (0.0006) [2023-12-28 00:32:10,942][106225] Updated weights for policy 1, policy_version 736938 (0.0009) [2023-12-28 00:32:11,009][106225] Updated weights for policy 1, policy_version 736948 (0.0009) [2023-12-28 00:32:11,080][106225] Updated weights for policy 1, policy_version 736958 (0.0009) [2023-12-28 00:32:11,127][106225] Updated weights for policy 1, policy_version 736968 (0.0009) [2023-12-28 00:32:11,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 376938496. Throughput: 0: 10074.6, 1: 9754.4. Samples: 376907360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:11,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-5.879')] [2023-12-28 00:32:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000736968_188702720.pth... [2023-12-28 00:32:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000735096_188235776.pth... [2023-12-28 00:32:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000733944_187940864.pth [2023-12-28 00:32:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000735816_188407808.pth [2023-12-28 00:32:11,270][106226] Updated weights for policy 0, policy_version 735100 (0.0007) [2023-12-28 00:32:11,324][106226] Updated weights for policy 0, policy_version 735110 (0.0010) [2023-12-28 00:32:11,398][106226] Updated weights for policy 0, policy_version 735120 (0.0009) [2023-12-28 00:32:11,992][106225] Updated weights for policy 1, policy_version 736978 (0.0008) [2023-12-28 00:32:12,056][106225] Updated weights for policy 1, policy_version 736988 (0.0008) [2023-12-28 00:32:12,120][106225] Updated weights for policy 1, policy_version 736998 (0.0009) [2023-12-28 00:32:12,153][106226] Updated weights for policy 0, policy_version 735130 (0.0008) [2023-12-28 00:32:12,203][106226] Updated weights for policy 0, policy_version 735140 (0.0009) [2023-12-28 00:32:12,254][106226] Updated weights for policy 0, policy_version 735150 (0.0008) [2023-12-28 00:32:12,319][106226] Updated weights for policy 0, policy_version 735160 (0.0009) [2023-12-28 00:32:12,850][106225] Updated weights for policy 1, policy_version 737008 (0.0008) [2023-12-28 00:32:12,914][106225] Updated weights for policy 1, policy_version 737018 (0.0008) [2023-12-28 00:32:12,978][106225] Updated weights for policy 1, policy_version 737028 (0.0008) [2023-12-28 00:32:13,099][106226] Updated weights for policy 0, policy_version 735170 (0.0008) [2023-12-28 00:32:13,172][106226] Updated weights for policy 0, policy_version 735180 (0.0009) [2023-12-28 00:32:13,233][106226] Updated weights for policy 0, policy_version 735190 (0.0009) [2023-12-28 00:32:13,638][106225] Updated weights for policy 1, policy_version 737038 (0.0006) [2023-12-28 00:32:13,699][106225] Updated weights for policy 1, policy_version 737048 (0.0010) [2023-12-28 00:32:13,756][106225] Updated weights for policy 1, policy_version 737058 (0.0010) [2023-12-28 00:32:13,987][106226] Updated weights for policy 0, policy_version 735200 (0.0008) [2023-12-28 00:32:14,043][106226] Updated weights for policy 0, policy_version 735210 (0.0007) [2023-12-28 00:32:14,103][106226] Updated weights for policy 0, policy_version 735220 (0.0008) [2023-12-28 00:32:14,428][106225] Updated weights for policy 1, policy_version 737068 (0.0010) [2023-12-28 00:32:14,484][106225] Updated weights for policy 1, policy_version 737078 (0.0010) [2023-12-28 00:32:14,550][106225] Updated weights for policy 1, policy_version 737088 (0.0011) [2023-12-28 00:32:14,843][106226] Updated weights for policy 0, policy_version 735230 (0.0009) [2023-12-28 00:32:14,897][106226] Updated weights for policy 0, policy_version 735240 (0.0008) [2023-12-28 00:32:14,961][106226] Updated weights for policy 0, policy_version 735250 (0.0007) [2023-12-28 00:32:15,233][106225] Updated weights for policy 1, policy_version 737098 (0.0010) [2023-12-28 00:32:15,298][106225] Updated weights for policy 1, policy_version 737108 (0.0009) [2023-12-28 00:32:15,363][106225] Updated weights for policy 1, policy_version 737118 (0.0009) [2023-12-28 00:32:15,419][106225] Updated weights for policy 1, policy_version 737128 (0.0006) [2023-12-28 00:32:15,736][106226] Updated weights for policy 0, policy_version 735260 (0.0008) [2023-12-28 00:32:15,785][106226] Updated weights for policy 0, policy_version 735270 (0.0008) [2023-12-28 00:32:15,840][106226] Updated weights for policy 0, policy_version 735280 (0.0009) [2023-12-28 00:32:15,957][106225] Updated weights for policy 1, policy_version 737138 (0.0005) [2023-12-28 00:32:16,006][106225] Updated weights for policy 1, policy_version 737148 (0.0005) [2023-12-28 00:32:16,055][106225] Updated weights for policy 1, policy_version 737158 (0.0005) [2023-12-28 00:32:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 377036800. Throughput: 0: 9890.8, 1: 9738.0. Samples: 377021372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:16,176][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.622')] [2023-12-28 00:32:16,602][106226] Updated weights for policy 0, policy_version 735290 (0.0008) [2023-12-28 00:32:16,658][106226] Updated weights for policy 0, policy_version 735300 (0.0010) [2023-12-28 00:32:16,708][106226] Updated weights for policy 0, policy_version 735310 (0.0011) [2023-12-28 00:32:16,737][106225] Updated weights for policy 1, policy_version 737168 (0.0007) [2023-12-28 00:32:16,773][106226] Updated weights for policy 0, policy_version 735320 (0.0006) [2023-12-28 00:32:16,796][106225] Updated weights for policy 1, policy_version 737178 (0.0009) [2023-12-28 00:32:16,845][106225] Updated weights for policy 1, policy_version 737188 (0.0009) [2023-12-28 00:32:17,346][106226] Updated weights for policy 0, policy_version 735330 (0.0010) [2023-12-28 00:32:17,403][106226] Updated weights for policy 0, policy_version 735340 (0.0011) [2023-12-28 00:32:17,459][106226] Updated weights for policy 0, policy_version 735350 (0.0010) [2023-12-28 00:32:17,621][106225] Updated weights for policy 1, policy_version 737198 (0.0009) [2023-12-28 00:32:17,682][106225] Updated weights for policy 1, policy_version 737208 (0.0005) [2023-12-28 00:32:17,745][106225] Updated weights for policy 1, policy_version 737218 (0.0009) [2023-12-28 00:32:18,145][106226] Updated weights for policy 0, policy_version 735360 (0.0011) [2023-12-28 00:32:18,213][106226] Updated weights for policy 0, policy_version 735370 (0.0011) [2023-12-28 00:32:18,280][106226] Updated weights for policy 0, policy_version 735380 (0.0011) [2023-12-28 00:32:18,289][106225] Updated weights for policy 1, policy_version 737228 (0.0006) [2023-12-28 00:32:18,362][106225] Updated weights for policy 1, policy_version 737238 (0.0009) [2023-12-28 00:32:18,420][106225] Updated weights for policy 1, policy_version 737248 (0.0007) [2023-12-28 00:32:18,962][106226] Updated weights for policy 0, policy_version 735390 (0.0005) [2023-12-28 00:32:19,030][106226] Updated weights for policy 0, policy_version 735400 (0.0006) [2023-12-28 00:32:19,062][106225] Updated weights for policy 1, policy_version 737258 (0.0009) [2023-12-28 00:32:19,089][106226] Updated weights for policy 0, policy_version 735410 (0.0008) [2023-12-28 00:32:19,124][106225] Updated weights for policy 1, policy_version 737268 (0.0008) [2023-12-28 00:32:19,174][106225] Updated weights for policy 1, policy_version 737278 (0.0008) [2023-12-28 00:32:19,231][106225] Updated weights for policy 1, policy_version 737288 (0.0007) [2023-12-28 00:32:19,831][106226] Updated weights for policy 0, policy_version 735420 (0.0006) [2023-12-28 00:32:19,893][106226] Updated weights for policy 0, policy_version 735430 (0.0009) [2023-12-28 00:32:19,956][106226] Updated weights for policy 0, policy_version 735440 (0.0008) [2023-12-28 00:32:20,048][106225] Updated weights for policy 1, policy_version 737298 (0.0009) [2023-12-28 00:32:20,119][106225] Updated weights for policy 1, policy_version 737308 (0.0009) [2023-12-28 00:32:20,180][106225] Updated weights for policy 1, policy_version 737318 (0.0011) [2023-12-28 00:32:20,672][106226] Updated weights for policy 0, policy_version 735450 (0.0008) [2023-12-28 00:32:20,729][106226] Updated weights for policy 0, policy_version 735460 (0.0008) [2023-12-28 00:32:20,777][106226] Updated weights for policy 0, policy_version 735470 (0.0008) [2023-12-28 00:32:20,824][106226] Updated weights for policy 0, policy_version 735480 (0.0008) [2023-12-28 00:32:20,974][106225] Updated weights for policy 1, policy_version 737328 (0.0010) [2023-12-28 00:32:21,039][106225] Updated weights for policy 1, policy_version 737338 (0.0011) [2023-12-28 00:32:21,106][106225] Updated weights for policy 1, policy_version 737348 (0.0011) [2023-12-28 00:32:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 377135104. Throughput: 0: 9807.4, 1: 9859.4. Samples: 377140752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:21,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.555')] [2023-12-28 00:32:21,672][106226] Updated weights for policy 0, policy_version 735490 (0.0008) [2023-12-28 00:32:21,731][106226] Updated weights for policy 0, policy_version 735500 (0.0008) [2023-12-28 00:32:21,781][106225] Updated weights for policy 1, policy_version 737358 (0.0010) [2023-12-28 00:32:21,801][106226] Updated weights for policy 0, policy_version 735510 (0.0008) [2023-12-28 00:32:21,844][106225] Updated weights for policy 1, policy_version 737368 (0.0009) [2023-12-28 00:32:21,906][106225] Updated weights for policy 1, policy_version 737378 (0.0008) [2023-12-28 00:32:22,582][106226] Updated weights for policy 0, policy_version 735520 (0.0008) [2023-12-28 00:32:22,649][106226] Updated weights for policy 0, policy_version 735530 (0.0009) [2023-12-28 00:32:22,650][106225] Updated weights for policy 1, policy_version 737388 (0.0008) [2023-12-28 00:32:22,712][106225] Updated weights for policy 1, policy_version 737398 (0.0007) [2023-12-28 00:32:22,714][106226] Updated weights for policy 0, policy_version 735540 (0.0008) [2023-12-28 00:32:22,770][106225] Updated weights for policy 1, policy_version 737408 (0.0007) [2023-12-28 00:32:23,356][106225] Updated weights for policy 1, policy_version 737418 (0.0007) [2023-12-28 00:32:23,418][106225] Updated weights for policy 1, policy_version 737428 (0.0008) [2023-12-28 00:32:23,453][106226] Updated weights for policy 0, policy_version 735550 (0.0009) [2023-12-28 00:32:23,475][106225] Updated weights for policy 1, policy_version 737438 (0.0006) [2023-12-28 00:32:23,515][106226] Updated weights for policy 0, policy_version 735560 (0.0011) [2023-12-28 00:32:23,533][106225] Updated weights for policy 1, policy_version 737448 (0.0006) [2023-12-28 00:32:23,573][106226] Updated weights for policy 0, policy_version 735570 (0.0011) [2023-12-28 00:32:24,263][106225] Updated weights for policy 1, policy_version 737458 (0.0008) [2023-12-28 00:32:24,282][106226] Updated weights for policy 0, policy_version 735580 (0.0011) [2023-12-28 00:32:24,319][106225] Updated weights for policy 1, policy_version 737468 (0.0007) [2023-12-28 00:32:24,330][106226] Updated weights for policy 0, policy_version 735590 (0.0010) [2023-12-28 00:32:24,371][106225] Updated weights for policy 1, policy_version 737478 (0.0006) [2023-12-28 00:32:24,384][106226] Updated weights for policy 0, policy_version 735600 (0.0010) [2023-12-28 00:32:25,117][106226] Updated weights for policy 0, policy_version 735610 (0.0010) [2023-12-28 00:32:25,171][106226] Updated weights for policy 0, policy_version 735620 (0.0008) [2023-12-28 00:32:25,173][106225] Updated weights for policy 1, policy_version 737488 (0.0006) [2023-12-28 00:32:25,222][106226] Updated weights for policy 0, policy_version 735630 (0.0007) [2023-12-28 00:32:25,227][106225] Updated weights for policy 1, policy_version 737498 (0.0007) [2023-12-28 00:32:25,272][106226] Updated weights for policy 0, policy_version 735640 (0.0007) [2023-12-28 00:32:25,280][106225] Updated weights for policy 1, policy_version 737508 (0.0008) [2023-12-28 00:32:25,935][106226] Updated weights for policy 0, policy_version 735650 (0.0008) [2023-12-28 00:32:25,988][106226] Updated weights for policy 0, policy_version 735660 (0.0008) [2023-12-28 00:32:26,026][106225] Updated weights for policy 1, policy_version 737518 (0.0008) [2023-12-28 00:32:26,054][106226] Updated weights for policy 0, policy_version 735670 (0.0005) [2023-12-28 00:32:26,074][106225] Updated weights for policy 1, policy_version 737528 (0.0008) [2023-12-28 00:32:26,135][106225] Updated weights for policy 1, policy_version 737539 (0.0010) [2023-12-28 00:32:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 377233408. Throughput: 0: 9789.7, 1: 9863.6. Samples: 377197852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:26,175][105115] Avg episode reward: [(0, '-4.186'), (1, '-5.535')] [2023-12-28 00:32:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000737544_188850176.pth... [2023-12-28 00:32:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000735672_188383232.pth... [2023-12-28 00:32:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000734520_188088320.pth [2023-12-28 00:32:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000736392_188555264.pth [2023-12-28 00:32:26,752][106226] Updated weights for policy 0, policy_version 735680 (0.0009) [2023-12-28 00:32:26,800][106225] Updated weights for policy 1, policy_version 737549 (0.0008) [2023-12-28 00:32:26,812][106226] Updated weights for policy 0, policy_version 735690 (0.0007) [2023-12-28 00:32:26,849][106225] Updated weights for policy 1, policy_version 737559 (0.0006) [2023-12-28 00:32:26,875][106226] Updated weights for policy 0, policy_version 735700 (0.0007) [2023-12-28 00:32:26,899][106225] Updated weights for policy 1, policy_version 737569 (0.0007) [2023-12-28 00:32:27,603][106226] Updated weights for policy 0, policy_version 735710 (0.0009) [2023-12-28 00:32:27,632][106225] Updated weights for policy 1, policy_version 737579 (0.0008) [2023-12-28 00:32:27,658][106226] Updated weights for policy 0, policy_version 735720 (0.0006) [2023-12-28 00:32:27,685][106225] Updated weights for policy 1, policy_version 737589 (0.0008) [2023-12-28 00:32:27,711][106226] Updated weights for policy 0, policy_version 735730 (0.0007) [2023-12-28 00:32:27,733][106225] Updated weights for policy 1, policy_version 737599 (0.0006) [2023-12-28 00:32:28,412][106226] Updated weights for policy 0, policy_version 735740 (0.0009) [2023-12-28 00:32:28,479][106226] Updated weights for policy 0, policy_version 735750 (0.0005) [2023-12-28 00:32:28,486][106225] Updated weights for policy 1, policy_version 737609 (0.0007) [2023-12-28 00:32:28,539][106225] Updated weights for policy 1, policy_version 737619 (0.0008) [2023-12-28 00:32:28,545][106226] Updated weights for policy 0, policy_version 735760 (0.0006) [2023-12-28 00:32:28,601][106225] Updated weights for policy 1, policy_version 737629 (0.0006) [2023-12-28 00:32:28,661][106225] Updated weights for policy 1, policy_version 737639 (0.0008) [2023-12-28 00:32:29,213][106226] Updated weights for policy 0, policy_version 735770 (0.0009) [2023-12-28 00:32:29,284][106226] Updated weights for policy 0, policy_version 735780 (0.0009) [2023-12-28 00:32:29,338][106226] Updated weights for policy 0, policy_version 735790 (0.0008) [2023-12-28 00:32:29,402][106226] Updated weights for policy 0, policy_version 735800 (0.0007) [2023-12-28 00:32:29,416][106225] Updated weights for policy 1, policy_version 737649 (0.0009) [2023-12-28 00:32:29,478][106225] Updated weights for policy 1, policy_version 737659 (0.0008) [2023-12-28 00:32:29,539][106225] Updated weights for policy 1, policy_version 737669 (0.0008) [2023-12-28 00:32:30,137][106226] Updated weights for policy 0, policy_version 735810 (0.0008) [2023-12-28 00:32:30,204][106226] Updated weights for policy 0, policy_version 735820 (0.0008) [2023-12-28 00:32:30,261][106226] Updated weights for policy 0, policy_version 735830 (0.0009) [2023-12-28 00:32:30,281][106225] Updated weights for policy 1, policy_version 737679 (0.0006) [2023-12-28 00:32:30,341][106225] Updated weights for policy 1, policy_version 737689 (0.0010) [2023-12-28 00:32:30,405][106225] Updated weights for policy 1, policy_version 737699 (0.0010) [2023-12-28 00:32:30,984][106226] Updated weights for policy 0, policy_version 735840 (0.0008) [2023-12-28 00:32:31,040][106226] Updated weights for policy 0, policy_version 735850 (0.0009) [2023-12-28 00:32:31,079][106225] Updated weights for policy 1, policy_version 737709 (0.0008) [2023-12-28 00:32:31,109][106226] Updated weights for policy 0, policy_version 735860 (0.0008) [2023-12-28 00:32:31,141][106225] Updated weights for policy 1, policy_version 737719 (0.0006) [2023-12-28 00:32:31,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19716.4). Total num frames: 377323520. Throughput: 0: 9747.6, 1: 9893.8. Samples: 377314180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:31,175][105115] Avg episode reward: [(0, '-4.299'), (1, '-5.383')] [2023-12-28 00:32:31,205][106225] Updated weights for policy 1, policy_version 737729 (0.0008) [2023-12-28 00:32:31,877][106226] Updated weights for policy 0, policy_version 735870 (0.0009) [2023-12-28 00:32:31,890][106225] Updated weights for policy 1, policy_version 737739 (0.0007) [2023-12-28 00:32:31,938][106226] Updated weights for policy 0, policy_version 735880 (0.0008) [2023-12-28 00:32:31,955][106225] Updated weights for policy 1, policy_version 737749 (0.0005) [2023-12-28 00:32:31,991][106226] Updated weights for policy 0, policy_version 735890 (0.0008) [2023-12-28 00:32:32,020][106225] Updated weights for policy 1, policy_version 737759 (0.0005) [2023-12-28 00:32:32,621][106225] Updated weights for policy 1, policy_version 737769 (0.0005) [2023-12-28 00:32:32,683][106225] Updated weights for policy 1, policy_version 737779 (0.0008) [2023-12-28 00:32:32,743][106225] Updated weights for policy 1, policy_version 737789 (0.0006) [2023-12-28 00:32:32,765][106226] Updated weights for policy 0, policy_version 735900 (0.0008) [2023-12-28 00:32:32,807][106225] Updated weights for policy 1, policy_version 737799 (0.0005) [2023-12-28 00:32:32,829][106226] Updated weights for policy 0, policy_version 735910 (0.0010) [2023-12-28 00:32:32,895][106226] Updated weights for policy 0, policy_version 735920 (0.0010) [2023-12-28 00:32:33,356][106225] Updated weights for policy 1, policy_version 737809 (0.0008) [2023-12-28 00:32:33,413][106225] Updated weights for policy 1, policy_version 737819 (0.0009) [2023-12-28 00:32:33,466][106225] Updated weights for policy 1, policy_version 737829 (0.0008) [2023-12-28 00:32:33,609][106226] Updated weights for policy 0, policy_version 735930 (0.0008) [2023-12-28 00:32:33,662][106226] Updated weights for policy 0, policy_version 735940 (0.0008) [2023-12-28 00:32:33,712][106226] Updated weights for policy 0, policy_version 735950 (0.0008) [2023-12-28 00:32:33,765][106226] Updated weights for policy 0, policy_version 735960 (0.0008) [2023-12-28 00:32:34,204][106225] Updated weights for policy 1, policy_version 737839 (0.0010) [2023-12-28 00:32:34,270][106225] Updated weights for policy 1, policy_version 737849 (0.0010) [2023-12-28 00:32:34,334][106225] Updated weights for policy 1, policy_version 737859 (0.0010) [2023-12-28 00:32:34,569][106226] Updated weights for policy 0, policy_version 735970 (0.0008) [2023-12-28 00:32:34,632][106226] Updated weights for policy 0, policy_version 735980 (0.0008) [2023-12-28 00:32:34,690][106226] Updated weights for policy 0, policy_version 735990 (0.0008) [2023-12-28 00:32:35,034][106225] Updated weights for policy 1, policy_version 737869 (0.0010) [2023-12-28 00:32:35,086][106225] Updated weights for policy 1, policy_version 737879 (0.0010) [2023-12-28 00:32:35,131][106225] Updated weights for policy 1, policy_version 737889 (0.0010) [2023-12-28 00:32:35,417][106226] Updated weights for policy 0, policy_version 736000 (0.0008) [2023-12-28 00:32:35,475][106226] Updated weights for policy 0, policy_version 736010 (0.0008) [2023-12-28 00:32:35,532][106226] Updated weights for policy 0, policy_version 736020 (0.0008) [2023-12-28 00:32:35,862][106225] Updated weights for policy 1, policy_version 737899 (0.0010) [2023-12-28 00:32:35,913][106225] Updated weights for policy 1, policy_version 737909 (0.0010) [2023-12-28 00:32:35,959][106225] Updated weights for policy 1, policy_version 737919 (0.0010) [2023-12-28 00:32:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 377421824. Throughput: 0: 9686.9, 1: 9853.6. Samples: 377430608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:36,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-5.928')] [2023-12-28 00:32:36,289][106226] Updated weights for policy 0, policy_version 736030 (0.0010) [2023-12-28 00:32:36,351][106226] Updated weights for policy 0, policy_version 736040 (0.0011) [2023-12-28 00:32:36,409][106226] Updated weights for policy 0, policy_version 736050 (0.0011) [2023-12-28 00:32:36,709][106225] Updated weights for policy 1, policy_version 737929 (0.0010) [2023-12-28 00:32:36,759][106225] Updated weights for policy 1, policy_version 737939 (0.0010) [2023-12-28 00:32:36,813][106225] Updated weights for policy 1, policy_version 737949 (0.0010) [2023-12-28 00:32:36,867][106225] Updated weights for policy 1, policy_version 737959 (0.0010) [2023-12-28 00:32:37,124][106226] Updated weights for policy 0, policy_version 736060 (0.0010) [2023-12-28 00:32:37,182][106226] Updated weights for policy 0, policy_version 736070 (0.0010) [2023-12-28 00:32:37,244][106226] Updated weights for policy 0, policy_version 736080 (0.0006) [2023-12-28 00:32:37,588][106225] Updated weights for policy 1, policy_version 737969 (0.0006) [2023-12-28 00:32:37,644][106225] Updated weights for policy 1, policy_version 737979 (0.0005) [2023-12-28 00:32:37,691][106225] Updated weights for policy 1, policy_version 737989 (0.0005) [2023-12-28 00:32:37,951][106226] Updated weights for policy 0, policy_version 736090 (0.0010) [2023-12-28 00:32:38,007][106226] Updated weights for policy 0, policy_version 736100 (0.0008) [2023-12-28 00:32:38,055][106226] Updated weights for policy 0, policy_version 736110 (0.0009) [2023-12-28 00:32:38,106][106226] Updated weights for policy 0, policy_version 736120 (0.0008) [2023-12-28 00:32:38,281][106225] Updated weights for policy 1, policy_version 737999 (0.0006) [2023-12-28 00:32:38,371][106225] Updated weights for policy 1, policy_version 738009 (0.0007) [2023-12-28 00:32:38,432][106225] Updated weights for policy 1, policy_version 738019 (0.0008) [2023-12-28 00:32:38,839][106226] Updated weights for policy 0, policy_version 736130 (0.0007) [2023-12-28 00:32:38,902][106226] Updated weights for policy 0, policy_version 736140 (0.0008) [2023-12-28 00:32:38,975][106226] Updated weights for policy 0, policy_version 736150 (0.0010) [2023-12-28 00:32:39,103][106225] Updated weights for policy 1, policy_version 738029 (0.0008) [2023-12-28 00:32:39,166][106225] Updated weights for policy 1, policy_version 738039 (0.0008) [2023-12-28 00:32:39,233][106225] Updated weights for policy 1, policy_version 738049 (0.0008) [2023-12-28 00:32:39,773][106226] Updated weights for policy 0, policy_version 736160 (0.0009) [2023-12-28 00:32:39,846][106226] Updated weights for policy 0, policy_version 736170 (0.0008) [2023-12-28 00:32:39,916][106226] Updated weights for policy 0, policy_version 736180 (0.0009) [2023-12-28 00:32:40,059][106225] Updated weights for policy 1, policy_version 738059 (0.0008) [2023-12-28 00:32:40,125][106225] Updated weights for policy 1, policy_version 738069 (0.0008) [2023-12-28 00:32:40,185][106225] Updated weights for policy 1, policy_version 738079 (0.0009) [2023-12-28 00:32:40,614][106226] Updated weights for policy 0, policy_version 736190 (0.0009) [2023-12-28 00:32:40,674][106226] Updated weights for policy 0, policy_version 736200 (0.0008) [2023-12-28 00:32:40,731][106226] Updated weights for policy 0, policy_version 736210 (0.0008) [2023-12-28 00:32:40,892][106225] Updated weights for policy 1, policy_version 738089 (0.0011) [2023-12-28 00:32:40,943][106225] Updated weights for policy 1, policy_version 738099 (0.0010) [2023-12-28 00:32:40,996][106225] Updated weights for policy 1, policy_version 738109 (0.0010) [2023-12-28 00:32:41,056][106225] Updated weights for policy 1, policy_version 738119 (0.0010) [2023-12-28 00:32:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 377520128. Throughput: 0: 9663.5, 1: 9907.7. Samples: 377489948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:41,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-5.720')] [2023-12-28 00:32:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000738120_188997632.pth... [2023-12-28 00:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000736216_188522496.pth... [2023-12-28 00:32:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000736968_188702720.pth [2023-12-28 00:32:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000735096_188235776.pth [2023-12-28 00:32:41,352][106226] Updated weights for policy 0, policy_version 736220 (0.0007) [2023-12-28 00:32:41,425][106226] Updated weights for policy 0, policy_version 736230 (0.0009) [2023-12-28 00:32:41,495][106226] Updated weights for policy 0, policy_version 736240 (0.0009) [2023-12-28 00:32:41,829][106225] Updated weights for policy 1, policy_version 738129 (0.0009) [2023-12-28 00:32:41,894][106225] Updated weights for policy 1, policy_version 738139 (0.0007) [2023-12-28 00:32:41,959][106225] Updated weights for policy 1, policy_version 738149 (0.0007) [2023-12-28 00:32:42,223][106226] Updated weights for policy 0, policy_version 736250 (0.0008) [2023-12-28 00:32:42,286][106226] Updated weights for policy 0, policy_version 736260 (0.0008) [2023-12-28 00:32:42,348][106226] Updated weights for policy 0, policy_version 736270 (0.0009) [2023-12-28 00:32:42,413][106226] Updated weights for policy 0, policy_version 736280 (0.0009) [2023-12-28 00:32:42,604][106225] Updated weights for policy 1, policy_version 738159 (0.0009) [2023-12-28 00:32:42,659][106225] Updated weights for policy 1, policy_version 738169 (0.0008) [2023-12-28 00:32:42,726][106225] Updated weights for policy 1, policy_version 738179 (0.0008) [2023-12-28 00:32:43,182][106226] Updated weights for policy 0, policy_version 736290 (0.0011) [2023-12-28 00:32:43,242][106226] Updated weights for policy 0, policy_version 736300 (0.0010) [2023-12-28 00:32:43,289][106226] Updated weights for policy 0, policy_version 736310 (0.0010) [2023-12-28 00:32:43,364][106225] Updated weights for policy 1, policy_version 738189 (0.0010) [2023-12-28 00:32:43,416][106225] Updated weights for policy 1, policy_version 738199 (0.0010) [2023-12-28 00:32:43,472][106225] Updated weights for policy 1, policy_version 738209 (0.0010) [2023-12-28 00:32:43,988][106226] Updated weights for policy 0, policy_version 736320 (0.0006) [2023-12-28 00:32:44,046][106226] Updated weights for policy 0, policy_version 736330 (0.0010) [2023-12-28 00:32:44,102][106226] Updated weights for policy 0, policy_version 736340 (0.0010) [2023-12-28 00:32:44,179][106225] Updated weights for policy 1, policy_version 738219 (0.0009) [2023-12-28 00:32:44,228][106225] Updated weights for policy 1, policy_version 738229 (0.0007) [2023-12-28 00:32:44,281][106225] Updated weights for policy 1, policy_version 738239 (0.0010) [2023-12-28 00:32:44,815][106226] Updated weights for policy 0, policy_version 736350 (0.0009) [2023-12-28 00:32:44,873][106226] Updated weights for policy 0, policy_version 736360 (0.0008) [2023-12-28 00:32:44,942][106226] Updated weights for policy 0, policy_version 736370 (0.0006) [2023-12-28 00:32:44,995][106225] Updated weights for policy 1, policy_version 738249 (0.0010) [2023-12-28 00:32:45,054][106225] Updated weights for policy 1, policy_version 738259 (0.0011) [2023-12-28 00:32:45,116][106225] Updated weights for policy 1, policy_version 738269 (0.0011) [2023-12-28 00:32:45,178][106225] Updated weights for policy 1, policy_version 738279 (0.0011) [2023-12-28 00:32:45,620][106226] Updated weights for policy 0, policy_version 736380 (0.0005) [2023-12-28 00:32:45,678][106226] Updated weights for policy 0, policy_version 736390 (0.0005) [2023-12-28 00:32:45,727][106226] Updated weights for policy 0, policy_version 736400 (0.0007) [2023-12-28 00:32:45,830][106225] Updated weights for policy 1, policy_version 738289 (0.0006) [2023-12-28 00:32:45,890][106225] Updated weights for policy 1, policy_version 738299 (0.0005) [2023-12-28 00:32:45,951][106225] Updated weights for policy 1, policy_version 738309 (0.0007) [2023-12-28 00:32:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 377618432. Throughput: 0: 9614.7, 1: 9848.8. Samples: 377605844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:46,176][105115] Avg episode reward: [(0, '-4.449'), (1, '-5.731')] [2023-12-28 00:32:46,470][106226] Updated weights for policy 0, policy_version 736410 (0.0009) [2023-12-28 00:32:46,531][106226] Updated weights for policy 0, policy_version 736420 (0.0008) [2023-12-28 00:32:46,560][106225] Updated weights for policy 1, policy_version 738319 (0.0010) [2023-12-28 00:32:46,585][106226] Updated weights for policy 0, policy_version 736430 (0.0005) [2023-12-28 00:32:46,620][106225] Updated weights for policy 1, policy_version 738329 (0.0010) [2023-12-28 00:32:46,645][106226] Updated weights for policy 0, policy_version 736440 (0.0006) [2023-12-28 00:32:46,677][106225] Updated weights for policy 1, policy_version 738339 (0.0008) [2023-12-28 00:32:47,336][106226] Updated weights for policy 0, policy_version 736450 (0.0006) [2023-12-28 00:32:47,362][106225] Updated weights for policy 1, policy_version 738349 (0.0008) [2023-12-28 00:32:47,391][106226] Updated weights for policy 0, policy_version 736460 (0.0006) [2023-12-28 00:32:47,420][106225] Updated weights for policy 1, policy_version 738359 (0.0006) [2023-12-28 00:32:47,452][106226] Updated weights for policy 0, policy_version 736470 (0.0006) [2023-12-28 00:32:47,472][106225] Updated weights for policy 1, policy_version 738369 (0.0005) [2023-12-28 00:32:48,040][106226] Updated weights for policy 0, policy_version 736480 (0.0005) [2023-12-28 00:32:48,098][106226] Updated weights for policy 0, policy_version 736490 (0.0008) [2023-12-28 00:32:48,148][106225] Updated weights for policy 1, policy_version 738379 (0.0007) [2023-12-28 00:32:48,154][106226] Updated weights for policy 0, policy_version 736500 (0.0008) [2023-12-28 00:32:48,201][106225] Updated weights for policy 1, policy_version 738389 (0.0006) [2023-12-28 00:32:48,258][106225] Updated weights for policy 1, policy_version 738399 (0.0008) [2023-12-28 00:32:48,844][106226] Updated weights for policy 0, policy_version 736510 (0.0009) [2023-12-28 00:32:48,906][106226] Updated weights for policy 0, policy_version 736520 (0.0011) [2023-12-28 00:32:48,954][106226] Updated weights for policy 0, policy_version 736530 (0.0009) [2023-12-28 00:32:48,995][106225] Updated weights for policy 1, policy_version 738409 (0.0008) [2023-12-28 00:32:49,051][106225] Updated weights for policy 1, policy_version 738419 (0.0006) [2023-12-28 00:32:49,119][106225] Updated weights for policy 1, policy_version 738429 (0.0005) [2023-12-28 00:32:49,179][106225] Updated weights for policy 1, policy_version 738439 (0.0006) [2023-12-28 00:32:49,564][106226] Updated weights for policy 0, policy_version 736540 (0.0005) [2023-12-28 00:32:49,624][106226] Updated weights for policy 0, policy_version 736550 (0.0010) [2023-12-28 00:32:49,686][106226] Updated weights for policy 0, policy_version 736560 (0.0011) [2023-12-28 00:32:49,830][106225] Updated weights for policy 1, policy_version 738449 (0.0007) [2023-12-28 00:32:49,888][106225] Updated weights for policy 1, policy_version 738459 (0.0007) [2023-12-28 00:32:49,948][106225] Updated weights for policy 1, policy_version 738469 (0.0007) [2023-12-28 00:32:50,460][106226] Updated weights for policy 0, policy_version 736570 (0.0010) [2023-12-28 00:32:50,517][106226] Updated weights for policy 0, policy_version 736580 (0.0006) [2023-12-28 00:32:50,581][106226] Updated weights for policy 0, policy_version 736590 (0.0008) [2023-12-28 00:32:50,645][106225] Updated weights for policy 1, policy_version 738479 (0.0007) [2023-12-28 00:32:50,668][106226] Updated weights for policy 0, policy_version 736600 (0.0007) [2023-12-28 00:32:50,712][106225] Updated weights for policy 1, policy_version 738489 (0.0007) [2023-12-28 00:32:50,772][106225] Updated weights for policy 1, policy_version 738499 (0.0008) [2023-12-28 00:32:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 377716736. Throughput: 0: 9639.0, 1: 9859.5. Samples: 377726380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:51,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.964')] [2023-12-28 00:32:51,426][106226] Updated weights for policy 0, policy_version 736610 (0.0010) [2023-12-28 00:32:51,490][106226] Updated weights for policy 0, policy_version 736620 (0.0007) [2023-12-28 00:32:51,492][106225] Updated weights for policy 1, policy_version 738509 (0.0007) [2023-12-28 00:32:51,545][106226] Updated weights for policy 0, policy_version 736630 (0.0006) [2023-12-28 00:32:51,551][106225] Updated weights for policy 1, policy_version 738519 (0.0006) [2023-12-28 00:32:51,610][106225] Updated weights for policy 1, policy_version 738529 (0.0008) [2023-12-28 00:32:52,186][106226] Updated weights for policy 0, policy_version 736640 (0.0006) [2023-12-28 00:32:52,257][106226] Updated weights for policy 0, policy_version 736650 (0.0006) [2023-12-28 00:32:52,317][106226] Updated weights for policy 0, policy_version 736660 (0.0010) [2023-12-28 00:32:52,318][106225] Updated weights for policy 1, policy_version 738539 (0.0008) [2023-12-28 00:32:52,389][106225] Updated weights for policy 1, policy_version 738549 (0.0009) [2023-12-28 00:32:52,459][106225] Updated weights for policy 1, policy_version 738559 (0.0010) [2023-12-28 00:32:52,943][106226] Updated weights for policy 0, policy_version 736670 (0.0010) [2023-12-28 00:32:52,996][106226] Updated weights for policy 0, policy_version 736680 (0.0010) [2023-12-28 00:32:53,060][106226] Updated weights for policy 0, policy_version 736690 (0.0010) [2023-12-28 00:32:53,165][106225] Updated weights for policy 1, policy_version 738569 (0.0009) [2023-12-28 00:32:53,221][106225] Updated weights for policy 1, policy_version 738579 (0.0010) [2023-12-28 00:32:53,287][106225] Updated weights for policy 1, policy_version 738589 (0.0010) [2023-12-28 00:32:53,343][106225] Updated weights for policy 1, policy_version 738599 (0.0010) [2023-12-28 00:32:53,780][106226] Updated weights for policy 0, policy_version 736700 (0.0011) [2023-12-28 00:32:53,826][106226] Updated weights for policy 0, policy_version 736710 (0.0010) [2023-12-28 00:32:53,877][106226] Updated weights for policy 0, policy_version 736720 (0.0010) [2023-12-28 00:32:53,917][106225] Updated weights for policy 1, policy_version 738609 (0.0006) [2023-12-28 00:32:53,970][106225] Updated weights for policy 1, policy_version 738619 (0.0008) [2023-12-28 00:32:54,039][106225] Updated weights for policy 1, policy_version 738629 (0.0005) [2023-12-28 00:32:54,609][106226] Updated weights for policy 0, policy_version 736730 (0.0010) [2023-12-28 00:32:54,669][106226] Updated weights for policy 0, policy_version 736740 (0.0011) [2023-12-28 00:32:54,676][106225] Updated weights for policy 1, policy_version 738639 (0.0009) [2023-12-28 00:32:54,725][106226] Updated weights for policy 0, policy_version 736750 (0.0010) [2023-12-28 00:32:54,729][106225] Updated weights for policy 1, policy_version 738649 (0.0010) [2023-12-28 00:32:54,786][106226] Updated weights for policy 0, policy_version 736760 (0.0010) [2023-12-28 00:32:54,788][106225] Updated weights for policy 1, policy_version 738659 (0.0010) [2023-12-28 00:32:55,484][106225] Updated weights for policy 1, policy_version 738669 (0.0010) [2023-12-28 00:32:55,530][106226] Updated weights for policy 0, policy_version 736770 (0.0005) [2023-12-28 00:32:55,530][106225] Updated weights for policy 1, policy_version 738679 (0.0010) [2023-12-28 00:32:55,576][106225] Updated weights for policy 1, policy_version 738689 (0.0010) [2023-12-28 00:32:55,592][106226] Updated weights for policy 0, policy_version 736780 (0.0005) [2023-12-28 00:32:55,644][106226] Updated weights for policy 0, policy_version 736790 (0.0005) [2023-12-28 00:32:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 377815040. Throughput: 0: 9632.0, 1: 9899.8. Samples: 377786288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:32:56,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.609')] [2023-12-28 00:32:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000736792_188669952.pth... [2023-12-28 00:32:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000738696_189145088.pth... [2023-12-28 00:32:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000735672_188383232.pth [2023-12-28 00:32:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000737544_188850176.pth [2023-12-28 00:32:56,287][106225] Updated weights for policy 1, policy_version 738699 (0.0009) [2023-12-28 00:32:56,310][106226] Updated weights for policy 0, policy_version 736800 (0.0009) [2023-12-28 00:32:56,344][106225] Updated weights for policy 1, policy_version 738709 (0.0007) [2023-12-28 00:32:56,375][106226] Updated weights for policy 0, policy_version 736810 (0.0011) [2023-12-28 00:32:56,403][106225] Updated weights for policy 1, policy_version 738719 (0.0007) [2023-12-28 00:32:56,433][106226] Updated weights for policy 0, policy_version 736820 (0.0010) [2023-12-28 00:32:57,122][106226] Updated weights for policy 0, policy_version 736830 (0.0007) [2023-12-28 00:32:57,125][106225] Updated weights for policy 1, policy_version 738729 (0.0006) [2023-12-28 00:32:57,173][106226] Updated weights for policy 0, policy_version 736840 (0.0005) [2023-12-28 00:32:57,176][106225] Updated weights for policy 1, policy_version 738739 (0.0006) [2023-12-28 00:32:57,224][106226] Updated weights for policy 0, policy_version 736850 (0.0006) [2023-12-28 00:32:57,240][106225] Updated weights for policy 1, policy_version 738749 (0.0006) [2023-12-28 00:32:57,304][106225] Updated weights for policy 1, policy_version 738759 (0.0007) [2023-12-28 00:32:57,878][106226] Updated weights for policy 0, policy_version 736860 (0.0009) [2023-12-28 00:32:57,894][106225] Updated weights for policy 1, policy_version 738769 (0.0010) [2023-12-28 00:32:57,934][106226] Updated weights for policy 0, policy_version 736870 (0.0010) [2023-12-28 00:32:57,948][106225] Updated weights for policy 1, policy_version 738779 (0.0010) [2023-12-28 00:32:57,993][106226] Updated weights for policy 0, policy_version 736880 (0.0010) [2023-12-28 00:32:58,004][106225] Updated weights for policy 1, policy_version 738789 (0.0008) [2023-12-28 00:32:58,732][106226] Updated weights for policy 0, policy_version 736890 (0.0009) [2023-12-28 00:32:58,755][106225] Updated weights for policy 1, policy_version 738799 (0.0007) [2023-12-28 00:32:58,797][106226] Updated weights for policy 0, policy_version 736900 (0.0008) [2023-12-28 00:32:58,828][106225] Updated weights for policy 1, policy_version 738809 (0.0007) [2023-12-28 00:32:58,882][106226] Updated weights for policy 0, policy_version 736910 (0.0008) [2023-12-28 00:32:58,899][106225] Updated weights for policy 1, policy_version 738819 (0.0012) [2023-12-28 00:32:58,944][106226] Updated weights for policy 0, policy_version 736920 (0.0008) [2023-12-28 00:32:59,700][106225] Updated weights for policy 1, policy_version 738829 (0.0008) [2023-12-28 00:32:59,700][106226] Updated weights for policy 0, policy_version 736930 (0.0011) [2023-12-28 00:32:59,753][106225] Updated weights for policy 1, policy_version 738839 (0.0007) [2023-12-28 00:32:59,761][106226] Updated weights for policy 0, policy_version 736940 (0.0010) [2023-12-28 00:32:59,807][106225] Updated weights for policy 1, policy_version 738849 (0.0005) [2023-12-28 00:32:59,814][106226] Updated weights for policy 0, policy_version 736950 (0.0010) [2023-12-28 00:33:00,477][106225] Updated weights for policy 1, policy_version 738859 (0.0007) [2023-12-28 00:33:00,533][106225] Updated weights for policy 1, policy_version 738869 (0.0008) [2023-12-28 00:33:00,551][106226] Updated weights for policy 0, policy_version 736960 (0.0006) [2023-12-28 00:33:00,591][106225] Updated weights for policy 1, policy_version 738879 (0.0009) [2023-12-28 00:33:00,607][106226] Updated weights for policy 0, policy_version 736970 (0.0005) [2023-12-28 00:33:00,666][106226] Updated weights for policy 0, policy_version 736980 (0.0006) [2023-12-28 00:33:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 377913344. Throughput: 0: 9666.4, 1: 9947.8. Samples: 377904012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:33:01,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.615')] [2023-12-28 00:33:01,293][106225] Updated weights for policy 1, policy_version 738889 (0.0008) [2023-12-28 00:33:01,295][106226] Updated weights for policy 0, policy_version 736990 (0.0006) [2023-12-28 00:33:01,355][106225] Updated weights for policy 1, policy_version 738899 (0.0009) [2023-12-28 00:33:01,360][106226] Updated weights for policy 0, policy_version 737000 (0.0008) [2023-12-28 00:33:01,421][106225] Updated weights for policy 1, policy_version 738909 (0.0009) [2023-12-28 00:33:01,428][106226] Updated weights for policy 0, policy_version 737010 (0.0008) [2023-12-28 00:33:01,483][106225] Updated weights for policy 1, policy_version 738919 (0.0007) [2023-12-28 00:33:02,112][106226] Updated weights for policy 0, policy_version 737020 (0.0008) [2023-12-28 00:33:02,174][106226] Updated weights for policy 0, policy_version 737030 (0.0008) [2023-12-28 00:33:02,203][106225] Updated weights for policy 1, policy_version 738929 (0.0010) [2023-12-28 00:33:02,231][106226] Updated weights for policy 0, policy_version 737040 (0.0005) [2023-12-28 00:33:02,264][106225] Updated weights for policy 1, policy_version 738939 (0.0010) [2023-12-28 00:33:02,329][106225] Updated weights for policy 1, policy_version 738949 (0.0010) [2023-12-28 00:33:02,921][106225] Updated weights for policy 1, policy_version 738959 (0.0008) [2023-12-28 00:33:02,974][106226] Updated weights for policy 0, policy_version 737050 (0.0008) [2023-12-28 00:33:02,985][106225] Updated weights for policy 1, policy_version 738969 (0.0008) [2023-12-28 00:33:03,035][106226] Updated weights for policy 0, policy_version 737060 (0.0006) [2023-12-28 00:33:03,056][106225] Updated weights for policy 1, policy_version 738979 (0.0009) [2023-12-28 00:33:03,093][106226] Updated weights for policy 0, policy_version 737070 (0.0006) [2023-12-28 00:33:03,162][106226] Updated weights for policy 0, policy_version 737080 (0.0008) [2023-12-28 00:33:03,725][106225] Updated weights for policy 1, policy_version 738989 (0.0009) [2023-12-28 00:33:03,772][106226] Updated weights for policy 0, policy_version 737090 (0.0007) [2023-12-28 00:33:03,782][106225] Updated weights for policy 1, policy_version 738999 (0.0010) [2023-12-28 00:33:03,826][106226] Updated weights for policy 0, policy_version 737100 (0.0005) [2023-12-28 00:33:03,835][106225] Updated weights for policy 1, policy_version 739009 (0.0009) [2023-12-28 00:33:03,884][106226] Updated weights for policy 0, policy_version 737110 (0.0008) [2023-12-28 00:33:04,577][106225] Updated weights for policy 1, policy_version 739019 (0.0009) [2023-12-28 00:33:04,624][106226] Updated weights for policy 0, policy_version 737120 (0.0007) [2023-12-28 00:33:04,634][106225] Updated weights for policy 1, policy_version 739029 (0.0006) [2023-12-28 00:33:04,679][106226] Updated weights for policy 0, policy_version 737130 (0.0008) [2023-12-28 00:33:04,685][106225] Updated weights for policy 1, policy_version 739039 (0.0006) [2023-12-28 00:33:04,736][106226] Updated weights for policy 0, policy_version 737140 (0.0008) [2023-12-28 00:33:05,400][106225] Updated weights for policy 1, policy_version 739049 (0.0006) [2023-12-28 00:33:05,422][106226] Updated weights for policy 0, policy_version 737150 (0.0007) [2023-12-28 00:33:05,458][106225] Updated weights for policy 1, policy_version 739059 (0.0008) [2023-12-28 00:33:05,491][106226] Updated weights for policy 0, policy_version 737160 (0.0007) [2023-12-28 00:33:05,507][106225] Updated weights for policy 1, policy_version 739069 (0.0007) [2023-12-28 00:33:05,553][106226] Updated weights for policy 0, policy_version 737170 (0.0011) [2023-12-28 00:33:05,566][106225] Updated weights for policy 1, policy_version 739079 (0.0006) [2023-12-28 00:33:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 378011648. Throughput: 0: 9712.2, 1: 9920.5. Samples: 378024220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:33:06,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-5.320')] [2023-12-28 00:33:06,230][106226] Updated weights for policy 0, policy_version 737180 (0.0011) [2023-12-28 00:33:06,246][106225] Updated weights for policy 1, policy_version 739089 (0.0007) [2023-12-28 00:33:06,292][106226] Updated weights for policy 0, policy_version 737190 (0.0011) [2023-12-28 00:33:06,306][106225] Updated weights for policy 1, policy_version 739099 (0.0009) [2023-12-28 00:33:06,358][106226] Updated weights for policy 0, policy_version 737200 (0.0011) [2023-12-28 00:33:06,363][106225] Updated weights for policy 1, policy_version 739109 (0.0010) [2023-12-28 00:33:07,039][106225] Updated weights for policy 1, policy_version 739119 (0.0010) [2023-12-28 00:33:07,074][106226] Updated weights for policy 0, policy_version 737210 (0.0011) [2023-12-28 00:33:07,096][106225] Updated weights for policy 1, policy_version 739129 (0.0010) [2023-12-28 00:33:07,133][106226] Updated weights for policy 0, policy_version 737220 (0.0008) [2023-12-28 00:33:07,143][106225] Updated weights for policy 1, policy_version 739139 (0.0010) [2023-12-28 00:33:07,189][106226] Updated weights for policy 0, policy_version 737230 (0.0006) [2023-12-28 00:33:07,244][106226] Updated weights for policy 0, policy_version 737240 (0.0008) [2023-12-28 00:33:07,806][106225] Updated weights for policy 1, policy_version 739149 (0.0009) [2023-12-28 00:33:07,861][106225] Updated weights for policy 1, policy_version 739159 (0.0008) [2023-12-28 00:33:07,912][106225] Updated weights for policy 1, policy_version 739169 (0.0008) [2023-12-28 00:33:07,978][106226] Updated weights for policy 0, policy_version 737250 (0.0008) [2023-12-28 00:33:08,033][106226] Updated weights for policy 0, policy_version 737260 (0.0008) [2023-12-28 00:33:08,084][106226] Updated weights for policy 0, policy_version 737270 (0.0007) [2023-12-28 00:33:08,604][106225] Updated weights for policy 1, policy_version 739179 (0.0007) [2023-12-28 00:33:08,670][106225] Updated weights for policy 1, policy_version 739189 (0.0010) [2023-12-28 00:33:08,734][106225] Updated weights for policy 1, policy_version 739199 (0.0006) [2023-12-28 00:33:08,737][106226] Updated weights for policy 0, policy_version 737280 (0.0007) [2023-12-28 00:33:08,799][106226] Updated weights for policy 0, policy_version 737290 (0.0008) [2023-12-28 00:33:08,852][106226] Updated weights for policy 0, policy_version 737300 (0.0009) [2023-12-28 00:33:09,492][106225] Updated weights for policy 1, policy_version 739209 (0.0010) [2023-12-28 00:33:09,550][106225] Updated weights for policy 1, policy_version 739219 (0.0007) [2023-12-28 00:33:09,614][106225] Updated weights for policy 1, policy_version 739229 (0.0007) [2023-12-28 00:33:09,627][106226] Updated weights for policy 0, policy_version 737310 (0.0009) [2023-12-28 00:33:09,679][106225] Updated weights for policy 1, policy_version 739239 (0.0007) [2023-12-28 00:33:09,689][106226] Updated weights for policy 0, policy_version 737320 (0.0007) [2023-12-28 00:33:09,757][106226] Updated weights for policy 0, policy_version 737330 (0.0009) [2023-12-28 00:33:10,405][106225] Updated weights for policy 1, policy_version 739249 (0.0006) [2023-12-28 00:33:10,467][106225] Updated weights for policy 1, policy_version 739259 (0.0008) [2023-12-28 00:33:10,525][106225] Updated weights for policy 1, policy_version 739269 (0.0006) [2023-12-28 00:33:10,542][106226] Updated weights for policy 0, policy_version 737340 (0.0008) [2023-12-28 00:33:10,593][106226] Updated weights for policy 0, policy_version 737350 (0.0005) [2023-12-28 00:33:10,650][106226] Updated weights for policy 0, policy_version 737360 (0.0006) [2023-12-28 00:33:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 378109952. Throughput: 0: 9752.2, 1: 9956.4. Samples: 378084740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:33:11,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.380')] [2023-12-28 00:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000737368_188817408.pth... [2023-12-28 00:33:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000739272_189292544.pth... [2023-12-28 00:33:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000736216_188522496.pth [2023-12-28 00:33:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000738120_188997632.pth [2023-12-28 00:33:11,287][106225] Updated weights for policy 1, policy_version 739279 (0.0009) [2023-12-28 00:33:11,329][106226] Updated weights for policy 0, policy_version 737370 (0.0006) [2023-12-28 00:33:11,352][106225] Updated weights for policy 1, policy_version 739289 (0.0007) [2023-12-28 00:33:11,395][106226] Updated weights for policy 0, policy_version 737380 (0.0007) [2023-12-28 00:33:11,424][106225] Updated weights for policy 1, policy_version 739299 (0.0008) [2023-12-28 00:33:11,449][106226] Updated weights for policy 0, policy_version 737390 (0.0006) [2023-12-28 00:33:11,499][106226] Updated weights for policy 0, policy_version 737400 (0.0006) [2023-12-28 00:33:12,185][106225] Updated weights for policy 1, policy_version 739309 (0.0007) [2023-12-28 00:33:12,244][106226] Updated weights for policy 0, policy_version 737410 (0.0010) [2023-12-28 00:33:12,251][106225] Updated weights for policy 1, policy_version 739319 (0.0006) [2023-12-28 00:33:12,310][106226] Updated weights for policy 0, policy_version 737420 (0.0009) [2023-12-28 00:33:12,317][106225] Updated weights for policy 1, policy_version 739329 (0.0009) [2023-12-28 00:33:12,377][106226] Updated weights for policy 0, policy_version 737430 (0.0009) [2023-12-28 00:33:13,016][106225] Updated weights for policy 1, policy_version 739339 (0.0007) [2023-12-28 00:33:13,045][106226] Updated weights for policy 0, policy_version 737440 (0.0010) [2023-12-28 00:33:13,075][106225] Updated weights for policy 1, policy_version 739349 (0.0006) [2023-12-28 00:33:13,102][106226] Updated weights for policy 0, policy_version 737450 (0.0010) [2023-12-28 00:33:13,141][106225] Updated weights for policy 1, policy_version 739359 (0.0005) [2023-12-28 00:33:13,148][106226] Updated weights for policy 0, policy_version 737460 (0.0010) [2023-12-28 00:33:13,780][106226] Updated weights for policy 0, policy_version 737470 (0.0010) [2023-12-28 00:33:13,828][106225] Updated weights for policy 1, policy_version 739369 (0.0006) [2023-12-28 00:33:13,837][106226] Updated weights for policy 0, policy_version 737480 (0.0010) [2023-12-28 00:33:13,882][106225] Updated weights for policy 1, policy_version 739379 (0.0006) [2023-12-28 00:33:13,897][106226] Updated weights for policy 0, policy_version 737490 (0.0010) [2023-12-28 00:33:13,939][106225] Updated weights for policy 1, policy_version 739389 (0.0005) [2023-12-28 00:33:13,983][106225] Updated weights for policy 1, policy_version 739399 (0.0009) [2023-12-28 00:33:14,591][106226] Updated weights for policy 0, policy_version 737500 (0.0010) [2023-12-28 00:33:14,647][106226] Updated weights for policy 0, policy_version 737510 (0.0010) [2023-12-28 00:33:14,684][106225] Updated weights for policy 1, policy_version 739409 (0.0010) [2023-12-28 00:33:14,704][106226] Updated weights for policy 0, policy_version 737520 (0.0010) [2023-12-28 00:33:14,742][106225] Updated weights for policy 1, policy_version 739419 (0.0010) [2023-12-28 00:33:14,812][106225] Updated weights for policy 1, policy_version 739429 (0.0008) [2023-12-28 00:33:15,330][106226] Updated weights for policy 0, policy_version 737530 (0.0006) [2023-12-28 00:33:15,397][106226] Updated weights for policy 0, policy_version 737540 (0.0008) [2023-12-28 00:33:15,469][106226] Updated weights for policy 0, policy_version 737550 (0.0005) [2023-12-28 00:33:15,533][106226] Updated weights for policy 0, policy_version 737560 (0.0008) [2023-12-28 00:33:15,555][106225] Updated weights for policy 1, policy_version 739439 (0.0007) [2023-12-28 00:33:15,613][106225] Updated weights for policy 1, policy_version 739449 (0.0006) [2023-12-28 00:33:15,670][106225] Updated weights for policy 1, policy_version 739459 (0.0006) [2023-12-28 00:33:16,093][106226] Updated weights for policy 0, policy_version 737570 (0.0009) [2023-12-28 00:33:16,162][106226] Updated weights for policy 0, policy_version 737580 (0.0009) [2023-12-28 00:33:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 378208256. Throughput: 0: 9754.7, 1: 9955.4. Samples: 378201136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:33:16,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-5.285')] [2023-12-28 00:33:16,228][106225] Updated weights for policy 1, policy_version 739469 (0.0006) [2023-12-28 00:33:16,229][106226] Updated weights for policy 0, policy_version 737590 (0.0008) [2023-12-28 00:33:16,286][106225] Updated weights for policy 1, policy_version 739479 (0.0005) [2023-12-28 00:33:16,343][106225] Updated weights for policy 1, policy_version 739489 (0.0005) [2023-12-28 00:33:16,904][106225] Updated weights for policy 1, policy_version 739499 (0.0005) [2023-12-28 00:33:16,905][106226] Updated weights for policy 0, policy_version 737600 (0.0009) [2023-12-28 00:33:16,951][106226] Updated weights for policy 0, policy_version 737610 (0.0008) [2023-12-28 00:33:16,956][106225] Updated weights for policy 1, policy_version 739509 (0.0005) [2023-12-28 00:33:16,996][106226] Updated weights for policy 0, policy_version 737620 (0.0008) [2023-12-28 00:33:17,015][106225] Updated weights for policy 1, policy_version 739519 (0.0006) [2023-12-28 00:33:17,671][106226] Updated weights for policy 0, policy_version 737630 (0.0007) [2023-12-28 00:33:17,692][106225] Updated weights for policy 1, policy_version 739529 (0.0008) [2023-12-28 00:33:17,724][106226] Updated weights for policy 0, policy_version 737640 (0.0005) [2023-12-28 00:33:17,755][106225] Updated weights for policy 1, policy_version 739539 (0.0006) [2023-12-28 00:33:17,785][106226] Updated weights for policy 0, policy_version 737650 (0.0006) [2023-12-28 00:33:17,810][106225] Updated weights for policy 1, policy_version 739549 (0.0005) [2023-12-28 00:33:17,858][106225] Updated weights for policy 1, policy_version 739559 (0.0005) [2023-12-28 00:33:18,467][106225] Updated weights for policy 1, policy_version 739569 (0.0008) [2023-12-28 00:33:18,484][106226] Updated weights for policy 0, policy_version 737660 (0.0009) [2023-12-28 00:33:18,522][106225] Updated weights for policy 1, policy_version 739579 (0.0006) [2023-12-28 00:33:18,539][106226] Updated weights for policy 0, policy_version 737670 (0.0008) [2023-12-28 00:33:18,570][106225] Updated weights for policy 1, policy_version 739589 (0.0006) [2023-12-28 00:33:18,595][106226] Updated weights for policy 0, policy_version 737680 (0.0008) [2023-12-28 00:33:19,312][106225] Updated weights for policy 1, policy_version 739599 (0.0007) [2023-12-28 00:33:19,312][106226] Updated weights for policy 0, policy_version 737690 (0.0009) [2023-12-28 00:33:19,375][106226] Updated weights for policy 0, policy_version 737700 (0.0008) [2023-12-28 00:33:19,377][106225] Updated weights for policy 1, policy_version 739609 (0.0006) [2023-12-28 00:33:19,441][106226] Updated weights for policy 0, policy_version 737710 (0.0008) [2023-12-28 00:33:19,447][106225] Updated weights for policy 1, policy_version 739619 (0.0008) [2023-12-28 00:33:19,509][106226] Updated weights for policy 0, policy_version 737720 (0.0007) [2023-12-28 00:33:20,197][106225] Updated weights for policy 1, policy_version 739629 (0.0007) [2023-12-28 00:33:20,254][106226] Updated weights for policy 0, policy_version 737730 (0.0008) [2023-12-28 00:33:20,264][106225] Updated weights for policy 1, policy_version 739639 (0.0007) [2023-12-28 00:33:20,316][106226] Updated weights for policy 0, policy_version 737740 (0.0009) [2023-12-28 00:33:20,326][106225] Updated weights for policy 1, policy_version 739649 (0.0007) [2023-12-28 00:33:20,380][106226] Updated weights for policy 0, policy_version 737750 (0.0007) [2023-12-28 00:33:21,026][106225] Updated weights for policy 1, policy_version 739659 (0.0009) [2023-12-28 00:33:21,095][106225] Updated weights for policy 1, policy_version 739669 (0.0008) [2023-12-28 00:33:21,161][106225] Updated weights for policy 1, policy_version 739679 (0.0009) [2023-12-28 00:33:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 378306560. Throughput: 0: 9836.7, 1: 9974.9. Samples: 378322132. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:21,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-5.380')] [2023-12-28 00:33:21,187][106226] Updated weights for policy 0, policy_version 737760 (0.0010) [2023-12-28 00:33:21,248][106226] Updated weights for policy 0, policy_version 737770 (0.0008) [2023-12-28 00:33:21,318][106226] Updated weights for policy 0, policy_version 737780 (0.0008) [2023-12-28 00:33:21,947][106225] Updated weights for policy 1, policy_version 739689 (0.0007) [2023-12-28 00:33:21,998][106225] Updated weights for policy 1, policy_version 739699 (0.0006) [2023-12-28 00:33:22,054][106225] Updated weights for policy 1, policy_version 739709 (0.0005) [2023-12-28 00:33:22,091][106226] Updated weights for policy 0, policy_version 737790 (0.0008) [2023-12-28 00:33:22,105][106225] Updated weights for policy 1, policy_version 739719 (0.0005) [2023-12-28 00:33:22,151][106226] Updated weights for policy 0, policy_version 737800 (0.0009) [2023-12-28 00:33:22,199][106226] Updated weights for policy 0, policy_version 737810 (0.0008) [2023-12-28 00:33:22,757][106225] Updated weights for policy 1, policy_version 739729 (0.0008) [2023-12-28 00:33:22,822][106225] Updated weights for policy 1, policy_version 739739 (0.0009) [2023-12-28 00:33:22,885][106225] Updated weights for policy 1, policy_version 739749 (0.0009) [2023-12-28 00:33:22,982][106226] Updated weights for policy 0, policy_version 737820 (0.0008) [2023-12-28 00:33:23,045][106226] Updated weights for policy 0, policy_version 737830 (0.0008) [2023-12-28 00:33:23,104][106226] Updated weights for policy 0, policy_version 737840 (0.0008) [2023-12-28 00:33:23,585][106225] Updated weights for policy 1, policy_version 739759 (0.0006) [2023-12-28 00:33:23,636][106225] Updated weights for policy 1, policy_version 739769 (0.0005) [2023-12-28 00:33:23,697][106225] Updated weights for policy 1, policy_version 739779 (0.0006) [2023-12-28 00:33:23,786][106226] Updated weights for policy 0, policy_version 737850 (0.0008) [2023-12-28 00:33:23,843][106226] Updated weights for policy 0, policy_version 737860 (0.0008) [2023-12-28 00:33:23,905][106226] Updated weights for policy 0, policy_version 737870 (0.0008) [2023-12-28 00:33:23,959][106226] Updated weights for policy 0, policy_version 737880 (0.0008) [2023-12-28 00:33:24,347][106225] Updated weights for policy 1, policy_version 739789 (0.0008) [2023-12-28 00:33:24,404][106225] Updated weights for policy 1, policy_version 739799 (0.0008) [2023-12-28 00:33:24,459][106225] Updated weights for policy 1, policy_version 739809 (0.0008) [2023-12-28 00:33:24,725][106226] Updated weights for policy 0, policy_version 737890 (0.0008) [2023-12-28 00:33:24,779][106226] Updated weights for policy 0, policy_version 737900 (0.0008) [2023-12-28 00:33:24,835][106226] Updated weights for policy 0, policy_version 737910 (0.0009) [2023-12-28 00:33:25,147][106225] Updated weights for policy 1, policy_version 739819 (0.0008) [2023-12-28 00:33:25,209][106225] Updated weights for policy 1, policy_version 739829 (0.0007) [2023-12-28 00:33:25,273][106225] Updated weights for policy 1, policy_version 739839 (0.0006) [2023-12-28 00:33:25,611][106226] Updated weights for policy 0, policy_version 737920 (0.0009) [2023-12-28 00:33:25,666][106226] Updated weights for policy 0, policy_version 737930 (0.0007) [2023-12-28 00:33:25,714][106226] Updated weights for policy 0, policy_version 737940 (0.0009) [2023-12-28 00:33:25,890][106225] Updated weights for policy 1, policy_version 739849 (0.0006) [2023-12-28 00:33:25,952][106225] Updated weights for policy 1, policy_version 739859 (0.0008) [2023-12-28 00:33:26,004][106225] Updated weights for policy 1, policy_version 739869 (0.0007) [2023-12-28 00:33:26,052][106225] Updated weights for policy 1, policy_version 739879 (0.0008) [2023-12-28 00:33:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 378413056. Throughput: 0: 9816.1, 1: 9951.6. Samples: 378379496. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:26,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-5.668')] [2023-12-28 00:33:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000739880_189448192.pth... [2023-12-28 00:33:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000737944_188964864.pth... [2023-12-28 00:33:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000736792_188669952.pth [2023-12-28 00:33:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000738696_189145088.pth [2023-12-28 00:33:26,480][106226] Updated weights for policy 0, policy_version 737950 (0.0009) [2023-12-28 00:33:26,538][106226] Updated weights for policy 0, policy_version 737960 (0.0010) [2023-12-28 00:33:26,592][106226] Updated weights for policy 0, policy_version 737970 (0.0009) [2023-12-28 00:33:26,738][106225] Updated weights for policy 1, policy_version 739889 (0.0006) [2023-12-28 00:33:26,790][106225] Updated weights for policy 1, policy_version 739899 (0.0005) [2023-12-28 00:33:26,847][106225] Updated weights for policy 1, policy_version 739909 (0.0007) [2023-12-28 00:33:27,403][106226] Updated weights for policy 0, policy_version 737980 (0.0009) [2023-12-28 00:33:27,456][106226] Updated weights for policy 0, policy_version 737990 (0.0007) [2023-12-28 00:33:27,465][106225] Updated weights for policy 1, policy_version 739919 (0.0009) [2023-12-28 00:33:27,508][106226] Updated weights for policy 0, policy_version 738000 (0.0007) [2023-12-28 00:33:27,514][106225] Updated weights for policy 1, policy_version 739929 (0.0010) [2023-12-28 00:33:27,564][106225] Updated weights for policy 1, policy_version 739939 (0.0007) [2023-12-28 00:33:28,248][106225] Updated weights for policy 1, policy_version 739949 (0.0007) [2023-12-28 00:33:28,290][106226] Updated weights for policy 0, policy_version 738010 (0.0007) [2023-12-28 00:33:28,295][106225] Updated weights for policy 1, policy_version 739959 (0.0005) [2023-12-28 00:33:28,358][106225] Updated weights for policy 1, policy_version 739969 (0.0006) [2023-12-28 00:33:28,360][106226] Updated weights for policy 0, policy_version 738020 (0.0008) [2023-12-28 00:33:28,419][106226] Updated weights for policy 0, policy_version 738030 (0.0008) [2023-12-28 00:33:28,474][106226] Updated weights for policy 0, policy_version 738040 (0.0008) [2023-12-28 00:33:29,013][106225] Updated weights for policy 1, policy_version 739979 (0.0006) [2023-12-28 00:33:29,068][106225] Updated weights for policy 1, policy_version 739989 (0.0008) [2023-12-28 00:33:29,125][106225] Updated weights for policy 1, policy_version 739999 (0.0008) [2023-12-28 00:33:29,180][106226] Updated weights for policy 0, policy_version 738050 (0.0006) [2023-12-28 00:33:29,242][106226] Updated weights for policy 0, policy_version 738060 (0.0009) [2023-12-28 00:33:29,297][106226] Updated weights for policy 0, policy_version 738070 (0.0008) [2023-12-28 00:33:29,898][106225] Updated weights for policy 1, policy_version 740009 (0.0007) [2023-12-28 00:33:29,957][106225] Updated weights for policy 1, policy_version 740019 (0.0008) [2023-12-28 00:33:30,019][106225] Updated weights for policy 1, policy_version 740029 (0.0008) [2023-12-28 00:33:30,068][106225] Updated weights for policy 1, policy_version 740039 (0.0007) [2023-12-28 00:33:30,096][106226] Updated weights for policy 0, policy_version 738080 (0.0008) [2023-12-28 00:33:30,163][106226] Updated weights for policy 0, policy_version 738090 (0.0009) [2023-12-28 00:33:30,208][106226] Updated weights for policy 0, policy_version 738100 (0.0008) [2023-12-28 00:33:30,792][106225] Updated weights for policy 1, policy_version 740049 (0.0008) [2023-12-28 00:33:30,840][106225] Updated weights for policy 1, policy_version 740059 (0.0008) [2023-12-28 00:33:30,901][106225] Updated weights for policy 1, policy_version 740069 (0.0008) [2023-12-28 00:33:30,925][106226] Updated weights for policy 0, policy_version 738110 (0.0007) [2023-12-28 00:33:30,985][106226] Updated weights for policy 0, policy_version 738120 (0.0009) [2023-12-28 00:33:31,051][106226] Updated weights for policy 0, policy_version 738130 (0.0008) [2023-12-28 00:33:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 378511360. Throughput: 0: 9765.5, 1: 10038.0. Samples: 378497000. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:31,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.531')] [2023-12-28 00:33:31,695][106225] Updated weights for policy 1, policy_version 740079 (0.0008) [2023-12-28 00:33:31,758][106225] Updated weights for policy 1, policy_version 740089 (0.0008) [2023-12-28 00:33:31,778][106226] Updated weights for policy 0, policy_version 738140 (0.0009) [2023-12-28 00:33:31,811][106225] Updated weights for policy 1, policy_version 740099 (0.0007) [2023-12-28 00:33:31,828][106226] Updated weights for policy 0, policy_version 738150 (0.0010) [2023-12-28 00:33:31,890][106226] Updated weights for policy 0, policy_version 738160 (0.0010) [2023-12-28 00:33:32,500][106225] Updated weights for policy 1, policy_version 740109 (0.0008) [2023-12-28 00:33:32,549][106225] Updated weights for policy 1, policy_version 740119 (0.0008) [2023-12-28 00:33:32,600][106225] Updated weights for policy 1, policy_version 740129 (0.0006) [2023-12-28 00:33:32,624][106226] Updated weights for policy 0, policy_version 738170 (0.0010) [2023-12-28 00:33:32,687][106226] Updated weights for policy 0, policy_version 738180 (0.0008) [2023-12-28 00:33:32,750][106226] Updated weights for policy 0, policy_version 738190 (0.0009) [2023-12-28 00:33:32,811][106226] Updated weights for policy 0, policy_version 738200 (0.0009) [2023-12-28 00:33:33,326][106225] Updated weights for policy 1, policy_version 740139 (0.0009) [2023-12-28 00:33:33,372][106225] Updated weights for policy 1, policy_version 740149 (0.0010) [2023-12-28 00:33:33,418][106225] Updated weights for policy 1, policy_version 740159 (0.0010) [2023-12-28 00:33:33,459][106226] Updated weights for policy 0, policy_version 738210 (0.0006) [2023-12-28 00:33:33,510][106226] Updated weights for policy 0, policy_version 738220 (0.0008) [2023-12-28 00:33:33,557][106226] Updated weights for policy 0, policy_version 738230 (0.0008) [2023-12-28 00:33:34,035][106225] Updated weights for policy 1, policy_version 740169 (0.0010) [2023-12-28 00:33:34,084][106225] Updated weights for policy 1, policy_version 740179 (0.0006) [2023-12-28 00:33:34,143][106225] Updated weights for policy 1, policy_version 740189 (0.0006) [2023-12-28 00:33:34,214][106225] Updated weights for policy 1, policy_version 740199 (0.0008) [2023-12-28 00:33:34,216][106226] Updated weights for policy 0, policy_version 738240 (0.0007) [2023-12-28 00:33:34,274][106226] Updated weights for policy 0, policy_version 738250 (0.0008) [2023-12-28 00:33:34,327][106226] Updated weights for policy 0, policy_version 738260 (0.0009) [2023-12-28 00:33:34,969][106225] Updated weights for policy 1, policy_version 740209 (0.0007) [2023-12-28 00:33:35,021][106225] Updated weights for policy 1, policy_version 740219 (0.0009) [2023-12-28 00:33:35,049][106226] Updated weights for policy 0, policy_version 738270 (0.0007) [2023-12-28 00:33:35,071][106225] Updated weights for policy 1, policy_version 740229 (0.0009) [2023-12-28 00:33:35,106][106226] Updated weights for policy 0, policy_version 738280 (0.0006) [2023-12-28 00:33:35,167][106226] Updated weights for policy 0, policy_version 738290 (0.0010) [2023-12-28 00:33:35,694][106225] Updated weights for policy 1, policy_version 740239 (0.0010) [2023-12-28 00:33:35,721][106226] Updated weights for policy 0, policy_version 738300 (0.0006) [2023-12-28 00:33:35,742][106225] Updated weights for policy 1, policy_version 740249 (0.0010) [2023-12-28 00:33:35,781][106226] Updated weights for policy 0, policy_version 738310 (0.0008) [2023-12-28 00:33:35,791][106225] Updated weights for policy 1, policy_version 740259 (0.0007) [2023-12-28 00:33:35,829][106226] Updated weights for policy 0, policy_version 738320 (0.0009) [2023-12-28 00:33:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 378609664. Throughput: 0: 9784.3, 1: 10007.0. Samples: 378616988. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:36,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-5.271')] [2023-12-28 00:33:36,474][106225] Updated weights for policy 1, policy_version 740269 (0.0008) [2023-12-28 00:33:36,543][106225] Updated weights for policy 1, policy_version 740279 (0.0010) [2023-12-28 00:33:36,573][106226] Updated weights for policy 0, policy_version 738330 (0.0010) [2023-12-28 00:33:36,609][106225] Updated weights for policy 1, policy_version 740289 (0.0010) [2023-12-28 00:33:36,633][106226] Updated weights for policy 0, policy_version 738340 (0.0011) [2023-12-28 00:33:36,695][106226] Updated weights for policy 0, policy_version 738350 (0.0011) [2023-12-28 00:33:36,753][106226] Updated weights for policy 0, policy_version 738360 (0.0011) [2023-12-28 00:33:37,328][106225] Updated weights for policy 1, policy_version 740299 (0.0010) [2023-12-28 00:33:37,383][106225] Updated weights for policy 1, policy_version 740309 (0.0010) [2023-12-28 00:33:37,441][106225] Updated weights for policy 1, policy_version 740319 (0.0010) [2023-12-28 00:33:37,488][106226] Updated weights for policy 0, policy_version 738370 (0.0008) [2023-12-28 00:33:37,550][106226] Updated weights for policy 0, policy_version 738380 (0.0008) [2023-12-28 00:33:37,609][106226] Updated weights for policy 0, policy_version 738390 (0.0008) [2023-12-28 00:33:38,153][106225] Updated weights for policy 1, policy_version 740329 (0.0010) [2023-12-28 00:33:38,208][106225] Updated weights for policy 1, policy_version 740339 (0.0005) [2023-12-28 00:33:38,259][106225] Updated weights for policy 1, policy_version 740349 (0.0005) [2023-12-28 00:33:38,312][106225] Updated weights for policy 1, policy_version 740359 (0.0006) [2023-12-28 00:33:38,378][106226] Updated weights for policy 0, policy_version 738400 (0.0008) [2023-12-28 00:33:38,440][106226] Updated weights for policy 0, policy_version 738410 (0.0008) [2023-12-28 00:33:38,499][106226] Updated weights for policy 0, policy_version 738420 (0.0008) [2023-12-28 00:33:39,029][106225] Updated weights for policy 1, policy_version 740369 (0.0007) [2023-12-28 00:33:39,098][106225] Updated weights for policy 1, policy_version 740379 (0.0006) [2023-12-28 00:33:39,165][106225] Updated weights for policy 1, policy_version 740389 (0.0009) [2023-12-28 00:33:39,187][106226] Updated weights for policy 0, policy_version 738430 (0.0006) [2023-12-28 00:33:39,247][106226] Updated weights for policy 0, policy_version 738440 (0.0008) [2023-12-28 00:33:39,314][106226] Updated weights for policy 0, policy_version 738450 (0.0007) [2023-12-28 00:33:39,855][106225] Updated weights for policy 1, policy_version 740399 (0.0009) [2023-12-28 00:33:39,921][106225] Updated weights for policy 1, policy_version 740409 (0.0009) [2023-12-28 00:33:39,988][106225] Updated weights for policy 1, policy_version 740419 (0.0009) [2023-12-28 00:33:40,147][106226] Updated weights for policy 0, policy_version 738460 (0.0008) [2023-12-28 00:33:40,212][106226] Updated weights for policy 0, policy_version 738470 (0.0008) [2023-12-28 00:33:40,273][106226] Updated weights for policy 0, policy_version 738480 (0.0008) [2023-12-28 00:33:40,685][106225] Updated weights for policy 1, policy_version 740429 (0.0009) [2023-12-28 00:33:40,733][106225] Updated weights for policy 1, policy_version 740439 (0.0006) [2023-12-28 00:33:40,790][106225] Updated weights for policy 1, policy_version 740449 (0.0005) [2023-12-28 00:33:41,036][106226] Updated weights for policy 0, policy_version 738490 (0.0022) [2023-12-28 00:33:41,098][106226] Updated weights for policy 0, policy_version 738500 (0.0012) [2023-12-28 00:33:41,172][106226] Updated weights for policy 0, policy_version 738510 (0.0009) [2023-12-28 00:33:41,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 378699776. Throughput: 0: 9731.7, 1: 10006.0. Samples: 378674480. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:41,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.164')] [2023-12-28 00:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000740456_189595648.pth... [2023-12-28 00:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000739272_189292544.pth [2023-12-28 00:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000740456_189595648.pth [2023-12-28 00:33:41,241][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000738520_189112320.pth... [2023-12-28 00:33:41,241][106226] Updated weights for policy 0, policy_version 738520 (0.0008) [2023-12-28 00:33:41,245][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000737368_188817408.pth [2023-12-28 00:33:41,246][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000738520_189112320.pth [2023-12-28 00:33:41,568][106225] Updated weights for policy 1, policy_version 740459 (0.0006) [2023-12-28 00:33:41,645][106225] Updated weights for policy 1, policy_version 740469 (0.0008) [2023-12-28 00:33:41,701][106225] Updated weights for policy 1, policy_version 740479 (0.0009) [2023-12-28 00:33:42,011][106226] Updated weights for policy 0, policy_version 738530 (0.0009) [2023-12-28 00:33:42,071][106226] Updated weights for policy 0, policy_version 738540 (0.0009) [2023-12-28 00:33:42,133][106226] Updated weights for policy 0, policy_version 738550 (0.0008) [2023-12-28 00:33:42,490][106225] Updated weights for policy 1, policy_version 740489 (0.0008) [2023-12-28 00:33:42,553][106225] Updated weights for policy 1, policy_version 740499 (0.0008) [2023-12-28 00:33:42,620][106225] Updated weights for policy 1, policy_version 740509 (0.0007) [2023-12-28 00:33:42,677][106225] Updated weights for policy 1, policy_version 740519 (0.0006) [2023-12-28 00:33:42,906][106226] Updated weights for policy 0, policy_version 738560 (0.0009) [2023-12-28 00:33:42,957][106226] Updated weights for policy 0, policy_version 738570 (0.0006) [2023-12-28 00:33:43,009][106226] Updated weights for policy 0, policy_version 738580 (0.0006) [2023-12-28 00:33:43,400][106225] Updated weights for policy 1, policy_version 740529 (0.0008) [2023-12-28 00:33:43,468][106225] Updated weights for policy 1, policy_version 740539 (0.0007) [2023-12-28 00:33:43,532][106225] Updated weights for policy 1, policy_version 740549 (0.0006) [2023-12-28 00:33:43,614][106226] Updated weights for policy 0, policy_version 738590 (0.0006) [2023-12-28 00:33:43,671][106226] Updated weights for policy 0, policy_version 738600 (0.0008) [2023-12-28 00:33:43,720][106226] Updated weights for policy 0, policy_version 738610 (0.0008) [2023-12-28 00:33:44,158][106225] Updated weights for policy 1, policy_version 740559 (0.0006) [2023-12-28 00:33:44,216][106225] Updated weights for policy 1, policy_version 740569 (0.0006) [2023-12-28 00:33:44,269][106225] Updated weights for policy 1, policy_version 740579 (0.0006) [2023-12-28 00:33:44,355][106226] Updated weights for policy 0, policy_version 738620 (0.0008) [2023-12-28 00:33:44,415][106226] Updated weights for policy 0, policy_version 738630 (0.0007) [2023-12-28 00:33:44,464][106226] Updated weights for policy 0, policy_version 738640 (0.0009) [2023-12-28 00:33:44,818][106225] Updated weights for policy 1, policy_version 740589 (0.0006) [2023-12-28 00:33:44,885][106225] Updated weights for policy 1, policy_version 740599 (0.0009) [2023-12-28 00:33:44,936][106225] Updated weights for policy 1, policy_version 740609 (0.0010) [2023-12-28 00:33:45,164][106226] Updated weights for policy 0, policy_version 738650 (0.0009) [2023-12-28 00:33:45,233][106226] Updated weights for policy 0, policy_version 738660 (0.0008) [2023-12-28 00:33:45,299][106226] Updated weights for policy 0, policy_version 738670 (0.0006) [2023-12-28 00:33:45,367][106226] Updated weights for policy 0, policy_version 738680 (0.0006) [2023-12-28 00:33:45,656][106225] Updated weights for policy 1, policy_version 740619 (0.0010) [2023-12-28 00:33:45,706][106225] Updated weights for policy 1, policy_version 740629 (0.0010) [2023-12-28 00:33:45,766][106225] Updated weights for policy 1, policy_version 740639 (0.0010) [2023-12-28 00:33:45,938][106226] Updated weights for policy 0, policy_version 738690 (0.0005) [2023-12-28 00:33:45,991][106226] Updated weights for policy 0, policy_version 738700 (0.0005) [2023-12-28 00:33:46,055][106226] Updated weights for policy 0, policy_version 738710 (0.0009) [2023-12-28 00:33:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 378806272. Throughput: 0: 9731.1, 1: 10004.2. Samples: 378792100. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:46,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-5.779')] [2023-12-28 00:33:46,494][106225] Updated weights for policy 1, policy_version 740649 (0.0010) [2023-12-28 00:33:46,561][106225] Updated weights for policy 1, policy_version 740659 (0.0010) [2023-12-28 00:33:46,600][106226] Updated weights for policy 0, policy_version 738720 (0.0009) [2023-12-28 00:33:46,616][106225] Updated weights for policy 1, policy_version 740669 (0.0010) [2023-12-28 00:33:46,652][106226] Updated weights for policy 0, policy_version 738730 (0.0010) [2023-12-28 00:33:46,674][106225] Updated weights for policy 1, policy_version 740679 (0.0010) [2023-12-28 00:33:46,709][106226] Updated weights for policy 0, policy_version 738740 (0.0010) [2023-12-28 00:33:47,309][106225] Updated weights for policy 1, policy_version 740689 (0.0010) [2023-12-28 00:33:47,363][106225] Updated weights for policy 1, policy_version 740699 (0.0010) [2023-12-28 00:33:47,370][106226] Updated weights for policy 0, policy_version 738750 (0.0010) [2023-12-28 00:33:47,426][106225] Updated weights for policy 1, policy_version 740709 (0.0010) [2023-12-28 00:33:47,434][106226] Updated weights for policy 0, policy_version 738760 (0.0011) [2023-12-28 00:33:47,494][106226] Updated weights for policy 0, policy_version 738770 (0.0010) [2023-12-28 00:33:48,146][106225] Updated weights for policy 1, policy_version 740719 (0.0010) [2023-12-28 00:33:48,153][106226] Updated weights for policy 0, policy_version 738780 (0.0009) [2023-12-28 00:33:48,208][106225] Updated weights for policy 1, policy_version 740729 (0.0010) [2023-12-28 00:33:48,215][106226] Updated weights for policy 0, policy_version 738790 (0.0011) [2023-12-28 00:33:48,265][106225] Updated weights for policy 1, policy_version 740739 (0.0010) [2023-12-28 00:33:48,265][106226] Updated weights for policy 0, policy_version 738800 (0.0010) [2023-12-28 00:33:48,985][106225] Updated weights for policy 1, policy_version 740749 (0.0010) [2023-12-28 00:33:49,003][106226] Updated weights for policy 0, policy_version 738810 (0.0010) [2023-12-28 00:33:49,046][106225] Updated weights for policy 1, policy_version 740759 (0.0010) [2023-12-28 00:33:49,064][106226] Updated weights for policy 0, policy_version 738820 (0.0010) [2023-12-28 00:33:49,110][106225] Updated weights for policy 1, policy_version 740769 (0.0010) [2023-12-28 00:33:49,131][106226] Updated weights for policy 0, policy_version 738830 (0.0009) [2023-12-28 00:33:49,182][106226] Updated weights for policy 0, policy_version 738840 (0.0010) [2023-12-28 00:33:49,890][106225] Updated weights for policy 1, policy_version 740779 (0.0010) [2023-12-28 00:33:49,900][106226] Updated weights for policy 0, policy_version 738850 (0.0008) [2023-12-28 00:33:49,958][106225] Updated weights for policy 1, policy_version 740789 (0.0010) [2023-12-28 00:33:49,972][106226] Updated weights for policy 0, policy_version 738860 (0.0008) [2023-12-28 00:33:50,022][106225] Updated weights for policy 1, policy_version 740799 (0.0009) [2023-12-28 00:33:50,032][106226] Updated weights for policy 0, policy_version 738870 (0.0007) [2023-12-28 00:33:50,737][106225] Updated weights for policy 1, policy_version 740809 (0.0008) [2023-12-28 00:33:50,778][106226] Updated weights for policy 0, policy_version 738880 (0.0008) [2023-12-28 00:33:50,793][106225] Updated weights for policy 1, policy_version 740819 (0.0009) [2023-12-28 00:33:50,835][106226] Updated weights for policy 0, policy_version 738890 (0.0007) [2023-12-28 00:33:50,846][106225] Updated weights for policy 1, policy_version 740829 (0.0009) [2023-12-28 00:33:50,899][106226] Updated weights for policy 0, policy_version 738900 (0.0007) [2023-12-28 00:33:50,903][106225] Updated weights for policy 1, policy_version 740839 (0.0006) [2023-12-28 00:33:51,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 378904576. Throughput: 0: 9745.9, 1: 9959.0. Samples: 378910940. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:51,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.567')] [2023-12-28 00:33:51,614][106225] Updated weights for policy 1, policy_version 740849 (0.0010) [2023-12-28 00:33:51,645][106226] Updated weights for policy 0, policy_version 738910 (0.0008) [2023-12-28 00:33:51,682][106225] Updated weights for policy 1, policy_version 740859 (0.0011) [2023-12-28 00:33:51,711][106226] Updated weights for policy 0, policy_version 738920 (0.0008) [2023-12-28 00:33:51,758][106225] Updated weights for policy 1, policy_version 740869 (0.0008) [2023-12-28 00:33:51,781][106226] Updated weights for policy 0, policy_version 738930 (0.0008) [2023-12-28 00:33:52,464][106226] Updated weights for policy 0, policy_version 738940 (0.0008) [2023-12-28 00:33:52,525][106226] Updated weights for policy 0, policy_version 738950 (0.0006) [2023-12-28 00:33:52,526][106225] Updated weights for policy 1, policy_version 740879 (0.0008) [2023-12-28 00:33:52,590][106226] Updated weights for policy 0, policy_version 738960 (0.0006) [2023-12-28 00:33:52,593][106225] Updated weights for policy 1, policy_version 740889 (0.0008) [2023-12-28 00:33:52,657][106225] Updated weights for policy 1, policy_version 740899 (0.0008) [2023-12-28 00:33:53,258][106226] Updated weights for policy 0, policy_version 738970 (0.0007) [2023-12-28 00:33:53,326][106226] Updated weights for policy 0, policy_version 738980 (0.0010) [2023-12-28 00:33:53,360][106225] Updated weights for policy 1, policy_version 740909 (0.0008) [2023-12-28 00:33:53,389][106226] Updated weights for policy 0, policy_version 738990 (0.0007) [2023-12-28 00:33:53,415][106225] Updated weights for policy 1, policy_version 740919 (0.0006) [2023-12-28 00:33:53,439][106226] Updated weights for policy 0, policy_version 739000 (0.0006) [2023-12-28 00:33:53,470][106225] Updated weights for policy 1, policy_version 740929 (0.0006) [2023-12-28 00:33:54,021][106225] Updated weights for policy 1, policy_version 740939 (0.0005) [2023-12-28 00:33:54,091][106225] Updated weights for policy 1, policy_version 740949 (0.0008) [2023-12-28 00:33:54,147][106225] Updated weights for policy 1, policy_version 740959 (0.0007) [2023-12-28 00:33:54,150][106226] Updated weights for policy 0, policy_version 739010 (0.0006) [2023-12-28 00:33:54,211][106226] Updated weights for policy 0, policy_version 739020 (0.0008) [2023-12-28 00:33:54,270][106226] Updated weights for policy 0, policy_version 739030 (0.0009) [2023-12-28 00:33:54,772][106225] Updated weights for policy 1, policy_version 740969 (0.0008) [2023-12-28 00:33:54,834][106225] Updated weights for policy 1, policy_version 740979 (0.0009) [2023-12-28 00:33:54,893][106225] Updated weights for policy 1, policy_version 740989 (0.0008) [2023-12-28 00:33:54,954][106225] Updated weights for policy 1, policy_version 740999 (0.0008) [2023-12-28 00:33:55,016][106226] Updated weights for policy 0, policy_version 739040 (0.0010) [2023-12-28 00:33:55,071][106226] Updated weights for policy 0, policy_version 739050 (0.0008) [2023-12-28 00:33:55,124][106226] Updated weights for policy 0, policy_version 739060 (0.0008) [2023-12-28 00:33:55,662][106225] Updated weights for policy 1, policy_version 741009 (0.0008) [2023-12-28 00:33:55,725][106225] Updated weights for policy 1, policy_version 741019 (0.0008) [2023-12-28 00:33:55,785][106225] Updated weights for policy 1, policy_version 741029 (0.0008) [2023-12-28 00:33:55,838][106226] Updated weights for policy 0, policy_version 739070 (0.0007) [2023-12-28 00:33:55,904][106226] Updated weights for policy 0, policy_version 739080 (0.0009) [2023-12-28 00:33:55,957][106226] Updated weights for policy 0, policy_version 739090 (0.0008) [2023-12-28 00:33:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 379002880. Throughput: 0: 9751.6, 1: 9913.6. Samples: 378969676. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:33:56,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-5.609')] [2023-12-28 00:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000741032_189743104.pth... [2023-12-28 00:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000739096_189259776.pth... [2023-12-28 00:33:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000739880_189448192.pth [2023-12-28 00:33:56,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000737944_188964864.pth [2023-12-28 00:33:56,451][106225] Updated weights for policy 1, policy_version 741039 (0.0006) [2023-12-28 00:33:56,501][106225] Updated weights for policy 1, policy_version 741049 (0.0010) [2023-12-28 00:33:56,549][106225] Updated weights for policy 1, policy_version 741059 (0.0010) [2023-12-28 00:33:56,660][106226] Updated weights for policy 0, policy_version 739100 (0.0007) [2023-12-28 00:33:56,729][106226] Updated weights for policy 0, policy_version 739110 (0.0010) [2023-12-28 00:33:56,789][106226] Updated weights for policy 0, policy_version 739120 (0.0008) [2023-12-28 00:33:57,138][106225] Updated weights for policy 1, policy_version 741069 (0.0008) [2023-12-28 00:33:57,199][106225] Updated weights for policy 1, policy_version 741079 (0.0005) [2023-12-28 00:33:57,254][106225] Updated weights for policy 1, policy_version 741089 (0.0005) [2023-12-28 00:33:57,573][106226] Updated weights for policy 0, policy_version 739130 (0.0009) [2023-12-28 00:33:57,637][106226] Updated weights for policy 0, policy_version 739140 (0.0008) [2023-12-28 00:33:57,689][106226] Updated weights for policy 0, policy_version 739150 (0.0008) [2023-12-28 00:33:57,745][106226] Updated weights for policy 0, policy_version 739160 (0.0009) [2023-12-28 00:33:57,790][106225] Updated weights for policy 1, policy_version 741099 (0.0007) [2023-12-28 00:33:57,834][106225] Updated weights for policy 1, policy_version 741109 (0.0008) [2023-12-28 00:33:57,882][106225] Updated weights for policy 1, policy_version 741119 (0.0008) [2023-12-28 00:33:58,519][106226] Updated weights for policy 0, policy_version 739170 (0.0008) [2023-12-28 00:33:58,584][106226] Updated weights for policy 0, policy_version 739180 (0.0009) [2023-12-28 00:33:58,650][106225] Updated weights for policy 1, policy_version 741129 (0.0008) [2023-12-28 00:33:58,651][106226] Updated weights for policy 0, policy_version 739190 (0.0008) [2023-12-28 00:33:58,712][106225] Updated weights for policy 1, policy_version 741139 (0.0009) [2023-12-28 00:33:58,796][106225] Updated weights for policy 1, policy_version 741149 (0.0009) [2023-12-28 00:33:58,865][106225] Updated weights for policy 1, policy_version 741159 (0.0012) [2023-12-28 00:33:59,468][106226] Updated weights for policy 0, policy_version 739200 (0.0008) [2023-12-28 00:33:59,533][106226] Updated weights for policy 0, policy_version 739210 (0.0008) [2023-12-28 00:33:59,597][106226] Updated weights for policy 0, policy_version 739220 (0.0008) [2023-12-28 00:33:59,696][106225] Updated weights for policy 1, policy_version 741169 (0.0008) [2023-12-28 00:33:59,750][106225] Updated weights for policy 1, policy_version 741179 (0.0007) [2023-12-28 00:33:59,799][106225] Updated weights for policy 1, policy_version 741189 (0.0008) [2023-12-28 00:34:00,341][106226] Updated weights for policy 0, policy_version 739230 (0.0010) [2023-12-28 00:34:00,402][106226] Updated weights for policy 0, policy_version 739240 (0.0007) [2023-12-28 00:34:00,454][106226] Updated weights for policy 0, policy_version 739250 (0.0005) [2023-12-28 00:34:00,458][106225] Updated weights for policy 1, policy_version 741199 (0.0008) [2023-12-28 00:34:00,524][106225] Updated weights for policy 1, policy_version 741209 (0.0006) [2023-12-28 00:34:00,582][106225] Updated weights for policy 1, policy_version 741219 (0.0007) [2023-12-28 00:34:01,116][106226] Updated weights for policy 0, policy_version 739260 (0.0008) [2023-12-28 00:34:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 379092992. Throughput: 0: 9665.9, 1: 10006.9. Samples: 379086412. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:01,175][105115] Avg episode reward: [(0, '-4.237'), (1, '-5.447')] [2023-12-28 00:34:01,183][106226] Updated weights for policy 0, policy_version 739270 (0.0010) [2023-12-28 00:34:01,240][106226] Updated weights for policy 0, policy_version 739280 (0.0008) [2023-12-28 00:34:01,278][106225] Updated weights for policy 1, policy_version 741229 (0.0008) [2023-12-28 00:34:01,337][106225] Updated weights for policy 1, policy_version 741239 (0.0008) [2023-12-28 00:34:01,406][106225] Updated weights for policy 1, policy_version 741249 (0.0008) [2023-12-28 00:34:01,932][106226] Updated weights for policy 0, policy_version 739290 (0.0009) [2023-12-28 00:34:01,990][106226] Updated weights for policy 0, policy_version 739300 (0.0012) [2023-12-28 00:34:02,043][106226] Updated weights for policy 0, policy_version 739310 (0.0010) [2023-12-28 00:34:02,099][106226] Updated weights for policy 0, policy_version 739320 (0.0007) [2023-12-28 00:34:02,189][106225] Updated weights for policy 1, policy_version 741259 (0.0009) [2023-12-28 00:34:02,245][106225] Updated weights for policy 1, policy_version 741269 (0.0010) [2023-12-28 00:34:02,313][106225] Updated weights for policy 1, policy_version 741279 (0.0010) [2023-12-28 00:34:02,816][106226] Updated weights for policy 0, policy_version 739330 (0.0007) [2023-12-28 00:34:02,871][106226] Updated weights for policy 0, policy_version 739340 (0.0009) [2023-12-28 00:34:02,923][106226] Updated weights for policy 0, policy_version 739350 (0.0008) [2023-12-28 00:34:02,953][106225] Updated weights for policy 1, policy_version 741289 (0.0010) [2023-12-28 00:34:03,006][106225] Updated weights for policy 1, policy_version 741299 (0.0008) [2023-12-28 00:34:03,063][106225] Updated weights for policy 1, policy_version 741309 (0.0008) [2023-12-28 00:34:03,128][106225] Updated weights for policy 1, policy_version 741319 (0.0008) [2023-12-28 00:34:03,502][106226] Updated weights for policy 0, policy_version 739360 (0.0008) [2023-12-28 00:34:03,551][106226] Updated weights for policy 0, policy_version 739370 (0.0008) [2023-12-28 00:34:03,602][106226] Updated weights for policy 0, policy_version 739380 (0.0009) [2023-12-28 00:34:03,697][106225] Updated weights for policy 1, policy_version 741329 (0.0007) [2023-12-28 00:34:03,760][106225] Updated weights for policy 1, policy_version 741339 (0.0005) [2023-12-28 00:34:03,820][106225] Updated weights for policy 1, policy_version 741349 (0.0006) [2023-12-28 00:34:04,388][106226] Updated weights for policy 0, policy_version 739390 (0.0007) [2023-12-28 00:34:04,412][106225] Updated weights for policy 1, policy_version 741359 (0.0009) [2023-12-28 00:34:04,440][106226] Updated weights for policy 0, policy_version 739400 (0.0007) [2023-12-28 00:34:04,459][106225] Updated weights for policy 1, policy_version 741369 (0.0010) [2023-12-28 00:34:04,492][106226] Updated weights for policy 0, policy_version 739410 (0.0008) [2023-12-28 00:34:04,513][106225] Updated weights for policy 1, policy_version 741379 (0.0010) [2023-12-28 00:34:05,068][106225] Updated weights for policy 1, policy_version 741389 (0.0008) [2023-12-28 00:34:05,116][106225] Updated weights for policy 1, policy_version 741399 (0.0005) [2023-12-28 00:34:05,169][106225] Updated weights for policy 1, policy_version 741409 (0.0005) [2023-12-28 00:34:05,251][106226] Updated weights for policy 0, policy_version 739420 (0.0007) [2023-12-28 00:34:05,300][106226] Updated weights for policy 0, policy_version 739430 (0.0008) [2023-12-28 00:34:05,358][106226] Updated weights for policy 0, policy_version 739440 (0.0008) [2023-12-28 00:34:05,737][106225] Updated weights for policy 1, policy_version 741419 (0.0006) [2023-12-28 00:34:05,797][106225] Updated weights for policy 1, policy_version 741429 (0.0010) [2023-12-28 00:34:05,850][106225] Updated weights for policy 1, policy_version 741439 (0.0010) [2023-12-28 00:34:06,159][106226] Updated weights for policy 0, policy_version 739450 (0.0009) [2023-12-28 00:34:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 379199488. Throughput: 0: 9671.7, 1: 10078.4. Samples: 379210884. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:06,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.467')] [2023-12-28 00:34:06,225][106226] Updated weights for policy 0, policy_version 739460 (0.0008) [2023-12-28 00:34:06,287][106226] Updated weights for policy 0, policy_version 739470 (0.0009) [2023-12-28 00:34:06,341][106226] Updated weights for policy 0, policy_version 739480 (0.0010) [2023-12-28 00:34:06,454][106225] Updated weights for policy 1, policy_version 741449 (0.0010) [2023-12-28 00:34:06,514][106225] Updated weights for policy 1, policy_version 741459 (0.0009) [2023-12-28 00:34:06,565][106225] Updated weights for policy 1, policy_version 741469 (0.0010) [2023-12-28 00:34:06,617][106225] Updated weights for policy 1, policy_version 741479 (0.0010) [2023-12-28 00:34:07,034][106226] Updated weights for policy 0, policy_version 739490 (0.0006) [2023-12-28 00:34:07,096][106226] Updated weights for policy 0, policy_version 739500 (0.0005) [2023-12-28 00:34:07,154][106226] Updated weights for policy 0, policy_version 739510 (0.0005) [2023-12-28 00:34:07,339][106225] Updated weights for policy 1, policy_version 741489 (0.0006) [2023-12-28 00:34:07,403][106225] Updated weights for policy 1, policy_version 741499 (0.0005) [2023-12-28 00:34:07,450][106225] Updated weights for policy 1, policy_version 741509 (0.0005) [2023-12-28 00:34:07,701][106226] Updated weights for policy 0, policy_version 739520 (0.0005) [2023-12-28 00:34:07,759][106226] Updated weights for policy 0, policy_version 739530 (0.0010) [2023-12-28 00:34:07,815][106226] Updated weights for policy 0, policy_version 739540 (0.0010) [2023-12-28 00:34:08,029][106225] Updated weights for policy 1, policy_version 741519 (0.0009) [2023-12-28 00:34:08,092][106225] Updated weights for policy 1, policy_version 741529 (0.0007) [2023-12-28 00:34:08,158][106225] Updated weights for policy 1, policy_version 741539 (0.0005) [2023-12-28 00:34:08,505][106226] Updated weights for policy 0, policy_version 739550 (0.0011) [2023-12-28 00:34:08,570][106226] Updated weights for policy 0, policy_version 739560 (0.0011) [2023-12-28 00:34:08,631][106226] Updated weights for policy 0, policy_version 739570 (0.0010) [2023-12-28 00:34:08,826][106225] Updated weights for policy 1, policy_version 741549 (0.0007) [2023-12-28 00:34:08,888][106225] Updated weights for policy 1, policy_version 741559 (0.0008) [2023-12-28 00:34:08,949][106225] Updated weights for policy 1, policy_version 741569 (0.0008) [2023-12-28 00:34:09,317][106226] Updated weights for policy 0, policy_version 739580 (0.0009) [2023-12-28 00:34:09,388][106226] Updated weights for policy 0, policy_version 739590 (0.0012) [2023-12-28 00:34:09,454][106226] Updated weights for policy 0, policy_version 739600 (0.0009) [2023-12-28 00:34:09,762][106225] Updated weights for policy 1, policy_version 741579 (0.0008) [2023-12-28 00:34:09,827][106225] Updated weights for policy 1, policy_version 741589 (0.0008) [2023-12-28 00:34:09,897][106225] Updated weights for policy 1, policy_version 741599 (0.0008) [2023-12-28 00:34:10,187][106226] Updated weights for policy 0, policy_version 739610 (0.0009) [2023-12-28 00:34:10,254][106226] Updated weights for policy 0, policy_version 739620 (0.0012) [2023-12-28 00:34:10,317][106226] Updated weights for policy 0, policy_version 739630 (0.0011) [2023-12-28 00:34:10,379][106226] Updated weights for policy 0, policy_version 739640 (0.0010) [2023-12-28 00:34:10,646][106225] Updated weights for policy 1, policy_version 741609 (0.0007) [2023-12-28 00:34:10,698][106225] Updated weights for policy 1, policy_version 741619 (0.0008) [2023-12-28 00:34:10,757][106225] Updated weights for policy 1, policy_version 741629 (0.0008) [2023-12-28 00:34:10,804][106225] Updated weights for policy 1, policy_version 741639 (0.0007) [2023-12-28 00:34:11,077][106226] Updated weights for policy 0, policy_version 739650 (0.0009) [2023-12-28 00:34:11,148][106226] Updated weights for policy 0, policy_version 739660 (0.0012) [2023-12-28 00:34:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 379297792. Throughput: 0: 9733.5, 1: 10139.3. Samples: 379273772. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:11,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-5.598')] [2023-12-28 00:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000741640_189898752.pth... [2023-12-28 00:34:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000740456_189595648.pth [2023-12-28 00:34:11,206][106226] Updated weights for policy 0, policy_version 739670 (0.0010) [2023-12-28 00:34:11,218][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000739672_189407232.pth... [2023-12-28 00:34:11,222][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000738520_189112320.pth [2023-12-28 00:34:11,561][106225] Updated weights for policy 1, policy_version 741649 (0.0007) [2023-12-28 00:34:11,618][106225] Updated weights for policy 1, policy_version 741659 (0.0008) [2023-12-28 00:34:11,683][106225] Updated weights for policy 1, policy_version 741669 (0.0007) [2023-12-28 00:34:11,947][106226] Updated weights for policy 0, policy_version 739680 (0.0010) [2023-12-28 00:34:12,019][106226] Updated weights for policy 0, policy_version 739690 (0.0010) [2023-12-28 00:34:12,076][106226] Updated weights for policy 0, policy_version 739700 (0.0008) [2023-12-28 00:34:12,342][106225] Updated weights for policy 1, policy_version 741679 (0.0007) [2023-12-28 00:34:12,411][106225] Updated weights for policy 1, policy_version 741689 (0.0007) [2023-12-28 00:34:12,462][106225] Updated weights for policy 1, policy_version 741699 (0.0008) [2023-12-28 00:34:12,842][106226] Updated weights for policy 0, policy_version 739710 (0.0008) [2023-12-28 00:34:12,895][106226] Updated weights for policy 0, policy_version 739720 (0.0009) [2023-12-28 00:34:12,950][106226] Updated weights for policy 0, policy_version 739730 (0.0008) [2023-12-28 00:34:13,198][106225] Updated weights for policy 1, policy_version 741709 (0.0008) [2023-12-28 00:34:13,258][106225] Updated weights for policy 1, policy_version 741719 (0.0008) [2023-12-28 00:34:13,320][106225] Updated weights for policy 1, policy_version 741729 (0.0008) [2023-12-28 00:34:13,689][106226] Updated weights for policy 0, policy_version 739740 (0.0008) [2023-12-28 00:34:13,748][106226] Updated weights for policy 0, policy_version 739750 (0.0008) [2023-12-28 00:34:13,803][106226] Updated weights for policy 0, policy_version 739760 (0.0009) [2023-12-28 00:34:14,023][106225] Updated weights for policy 1, policy_version 741739 (0.0008) [2023-12-28 00:34:14,081][106225] Updated weights for policy 1, policy_version 741749 (0.0008) [2023-12-28 00:34:14,138][106225] Updated weights for policy 1, policy_version 741759 (0.0008) [2023-12-28 00:34:14,539][106226] Updated weights for policy 0, policy_version 739770 (0.0009) [2023-12-28 00:34:14,601][106226] Updated weights for policy 0, policy_version 739780 (0.0008) [2023-12-28 00:34:14,661][106226] Updated weights for policy 0, policy_version 739790 (0.0009) [2023-12-28 00:34:14,720][106226] Updated weights for policy 0, policy_version 739800 (0.0008) [2023-12-28 00:34:14,876][106225] Updated weights for policy 1, policy_version 741769 (0.0007) [2023-12-28 00:34:14,924][106225] Updated weights for policy 1, policy_version 741779 (0.0009) [2023-12-28 00:34:14,976][106225] Updated weights for policy 1, policy_version 741789 (0.0008) [2023-12-28 00:34:15,040][106225] Updated weights for policy 1, policy_version 741799 (0.0009) [2023-12-28 00:34:15,461][106226] Updated weights for policy 0, policy_version 739810 (0.0009) [2023-12-28 00:34:15,522][106226] Updated weights for policy 0, policy_version 739820 (0.0006) [2023-12-28 00:34:15,583][106226] Updated weights for policy 0, policy_version 739830 (0.0005) [2023-12-28 00:34:15,801][106225] Updated weights for policy 1, policy_version 741809 (0.0008) [2023-12-28 00:34:15,858][106225] Updated weights for policy 1, policy_version 741819 (0.0008) [2023-12-28 00:34:15,919][106225] Updated weights for policy 1, policy_version 741829 (0.0009) [2023-12-28 00:34:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 379396096. Throughput: 0: 9765.6, 1: 10014.1. Samples: 379387088. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:16,176][105115] Avg episode reward: [(0, '-4.319'), (1, '-5.506')] [2023-12-28 00:34:16,218][106226] Updated weights for policy 0, policy_version 739840 (0.0008) [2023-12-28 00:34:16,273][106226] Updated weights for policy 0, policy_version 739850 (0.0007) [2023-12-28 00:34:16,336][106226] Updated weights for policy 0, policy_version 739860 (0.0009) [2023-12-28 00:34:16,620][106225] Updated weights for policy 1, policy_version 741839 (0.0007) [2023-12-28 00:34:16,672][106225] Updated weights for policy 1, policy_version 741849 (0.0008) [2023-12-28 00:34:16,736][106225] Updated weights for policy 1, policy_version 741859 (0.0008) [2023-12-28 00:34:16,984][106226] Updated weights for policy 0, policy_version 739870 (0.0007) [2023-12-28 00:34:17,046][106226] Updated weights for policy 0, policy_version 739880 (0.0006) [2023-12-28 00:34:17,101][106226] Updated weights for policy 0, policy_version 739890 (0.0005) [2023-12-28 00:34:17,414][106225] Updated weights for policy 1, policy_version 741869 (0.0008) [2023-12-28 00:34:17,468][106225] Updated weights for policy 1, policy_version 741879 (0.0007) [2023-12-28 00:34:17,523][106225] Updated weights for policy 1, policy_version 741889 (0.0008) [2023-12-28 00:34:17,760][106226] Updated weights for policy 0, policy_version 739900 (0.0007) [2023-12-28 00:34:17,820][106226] Updated weights for policy 0, policy_version 739910 (0.0010) [2023-12-28 00:34:17,874][106226] Updated weights for policy 0, policy_version 739920 (0.0009) [2023-12-28 00:34:18,265][106225] Updated weights for policy 1, policy_version 741899 (0.0008) [2023-12-28 00:34:18,326][106225] Updated weights for policy 1, policy_version 741909 (0.0010) [2023-12-28 00:34:18,390][106225] Updated weights for policy 1, policy_version 741919 (0.0008) [2023-12-28 00:34:18,522][106226] Updated weights for policy 0, policy_version 739930 (0.0005) [2023-12-28 00:34:18,580][106226] Updated weights for policy 0, policy_version 739940 (0.0008) [2023-12-28 00:34:18,643][106226] Updated weights for policy 0, policy_version 739950 (0.0008) [2023-12-28 00:34:18,699][106226] Updated weights for policy 0, policy_version 739960 (0.0008) [2023-12-28 00:34:19,051][106225] Updated weights for policy 1, policy_version 741929 (0.0008) [2023-12-28 00:34:19,121][106225] Updated weights for policy 1, policy_version 741939 (0.0007) [2023-12-28 00:34:19,181][106225] Updated weights for policy 1, policy_version 741949 (0.0008) [2023-12-28 00:34:19,246][106225] Updated weights for policy 1, policy_version 741959 (0.0009) [2023-12-28 00:34:19,489][106226] Updated weights for policy 0, policy_version 739970 (0.0008) [2023-12-28 00:34:19,551][106226] Updated weights for policy 0, policy_version 739980 (0.0009) [2023-12-28 00:34:19,615][106226] Updated weights for policy 0, policy_version 739990 (0.0008) [2023-12-28 00:34:20,066][106225] Updated weights for policy 1, policy_version 741969 (0.0006) [2023-12-28 00:34:20,127][106225] Updated weights for policy 1, policy_version 741979 (0.0007) [2023-12-28 00:34:20,186][106225] Updated weights for policy 1, policy_version 741989 (0.0005) [2023-12-28 00:34:20,318][106226] Updated weights for policy 0, policy_version 740000 (0.0005) [2023-12-28 00:34:20,390][106226] Updated weights for policy 0, policy_version 740010 (0.0007) [2023-12-28 00:34:20,449][106226] Updated weights for policy 0, policy_version 740020 (0.0006) [2023-12-28 00:34:20,863][106225] Updated weights for policy 1, policy_version 741999 (0.0006) [2023-12-28 00:34:20,932][106225] Updated weights for policy 1, policy_version 742009 (0.0007) [2023-12-28 00:34:20,994][106225] Updated weights for policy 1, policy_version 742019 (0.0007) [2023-12-28 00:34:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 379494400. Throughput: 0: 9738.5, 1: 9976.8. Samples: 379504176. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:21,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-5.543')] [2023-12-28 00:34:21,189][106226] Updated weights for policy 0, policy_version 740030 (0.0009) [2023-12-28 00:34:21,257][106226] Updated weights for policy 0, policy_version 740040 (0.0008) [2023-12-28 00:34:21,323][106226] Updated weights for policy 0, policy_version 740050 (0.0010) [2023-12-28 00:34:21,708][106225] Updated weights for policy 1, policy_version 742029 (0.0008) [2023-12-28 00:34:21,780][106225] Updated weights for policy 1, policy_version 742039 (0.0006) [2023-12-28 00:34:21,850][106225] Updated weights for policy 1, policy_version 742049 (0.0006) [2023-12-28 00:34:22,139][106226] Updated weights for policy 0, policy_version 740060 (0.0009) [2023-12-28 00:34:22,199][106226] Updated weights for policy 0, policy_version 740070 (0.0009) [2023-12-28 00:34:22,252][106226] Updated weights for policy 0, policy_version 740080 (0.0008) [2023-12-28 00:34:22,547][106225] Updated weights for policy 1, policy_version 742059 (0.0008) [2023-12-28 00:34:22,607][106225] Updated weights for policy 1, policy_version 742069 (0.0009) [2023-12-28 00:34:22,667][106225] Updated weights for policy 1, policy_version 742079 (0.0009) [2023-12-28 00:34:22,986][106226] Updated weights for policy 0, policy_version 740090 (0.0008) [2023-12-28 00:34:23,037][106226] Updated weights for policy 0, policy_version 740100 (0.0006) [2023-12-28 00:34:23,086][106226] Updated weights for policy 0, policy_version 740110 (0.0005) [2023-12-28 00:34:23,141][106226] Updated weights for policy 0, policy_version 740120 (0.0008) [2023-12-28 00:34:23,397][106225] Updated weights for policy 1, policy_version 742089 (0.0009) [2023-12-28 00:34:23,463][106225] Updated weights for policy 1, policy_version 742099 (0.0005) [2023-12-28 00:34:23,517][106225] Updated weights for policy 1, policy_version 742109 (0.0008) [2023-12-28 00:34:23,566][106225] Updated weights for policy 1, policy_version 742119 (0.0008) [2023-12-28 00:34:23,788][106226] Updated weights for policy 0, policy_version 740130 (0.0006) [2023-12-28 00:34:23,866][106226] Updated weights for policy 0, policy_version 740140 (0.0007) [2023-12-28 00:34:23,940][106226] Updated weights for policy 0, policy_version 740150 (0.0006) [2023-12-28 00:34:24,242][106225] Updated weights for policy 1, policy_version 742129 (0.0008) [2023-12-28 00:34:24,292][106225] Updated weights for policy 1, policy_version 742139 (0.0007) [2023-12-28 00:34:24,348][106225] Updated weights for policy 1, policy_version 742149 (0.0007) [2023-12-28 00:34:24,633][106226] Updated weights for policy 0, policy_version 740160 (0.0008) [2023-12-28 00:34:24,686][106226] Updated weights for policy 0, policy_version 740170 (0.0005) [2023-12-28 00:34:24,749][106226] Updated weights for policy 0, policy_version 740180 (0.0007) [2023-12-28 00:34:25,087][106225] Updated weights for policy 1, policy_version 742159 (0.0006) [2023-12-28 00:34:25,146][106225] Updated weights for policy 1, policy_version 742169 (0.0007) [2023-12-28 00:34:25,203][106225] Updated weights for policy 1, policy_version 742179 (0.0007) [2023-12-28 00:34:25,390][106226] Updated weights for policy 0, policy_version 740190 (0.0009) [2023-12-28 00:34:25,437][106226] Updated weights for policy 0, policy_version 740200 (0.0010) [2023-12-28 00:34:25,483][106226] Updated weights for policy 0, policy_version 740210 (0.0010) [2023-12-28 00:34:25,875][106225] Updated weights for policy 1, policy_version 742189 (0.0009) [2023-12-28 00:34:25,923][106225] Updated weights for policy 1, policy_version 742199 (0.0010) [2023-12-28 00:34:25,974][106225] Updated weights for policy 1, policy_version 742209 (0.0010) [2023-12-28 00:34:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 379592704. Throughput: 0: 9749.9, 1: 9964.0. Samples: 379561604. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:26,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.403')] [2023-12-28 00:34:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000742216_190046208.pth... [2023-12-28 00:34:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000740216_189546496.pth... [2023-12-28 00:34:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000741032_189743104.pth [2023-12-28 00:34:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000739096_189259776.pth [2023-12-28 00:34:26,230][106226] Updated weights for policy 0, policy_version 740220 (0.0010) [2023-12-28 00:34:26,277][106226] Updated weights for policy 0, policy_version 740230 (0.0010) [2023-12-28 00:34:26,336][106226] Updated weights for policy 0, policy_version 740240 (0.0010) [2023-12-28 00:34:26,683][106225] Updated weights for policy 1, policy_version 742219 (0.0010) [2023-12-28 00:34:26,740][106225] Updated weights for policy 1, policy_version 742229 (0.0010) [2023-12-28 00:34:26,795][106225] Updated weights for policy 1, policy_version 742239 (0.0010) [2023-12-28 00:34:27,045][106226] Updated weights for policy 0, policy_version 740250 (0.0010) [2023-12-28 00:34:27,097][106226] Updated weights for policy 0, policy_version 740260 (0.0010) [2023-12-28 00:34:27,156][106226] Updated weights for policy 0, policy_version 740270 (0.0010) [2023-12-28 00:34:27,208][106226] Updated weights for policy 0, policy_version 740280 (0.0010) [2023-12-28 00:34:27,466][106225] Updated weights for policy 1, policy_version 742249 (0.0010) [2023-12-28 00:34:27,511][106225] Updated weights for policy 1, policy_version 742259 (0.0010) [2023-12-28 00:34:27,560][106225] Updated weights for policy 1, policy_version 742269 (0.0010) [2023-12-28 00:34:27,609][106225] Updated weights for policy 1, policy_version 742279 (0.0010) [2023-12-28 00:34:27,819][106226] Updated weights for policy 0, policy_version 740290 (0.0007) [2023-12-28 00:34:27,878][106226] Updated weights for policy 0, policy_version 740300 (0.0010) [2023-12-28 00:34:27,936][106226] Updated weights for policy 0, policy_version 740310 (0.0005) [2023-12-28 00:34:28,360][106225] Updated weights for policy 1, policy_version 742289 (0.0008) [2023-12-28 00:34:28,427][106225] Updated weights for policy 1, policy_version 742299 (0.0006) [2023-12-28 00:34:28,454][106226] Updated weights for policy 0, policy_version 740320 (0.0009) [2023-12-28 00:34:28,488][106225] Updated weights for policy 1, policy_version 742309 (0.0008) [2023-12-28 00:34:28,511][106226] Updated weights for policy 0, policy_version 740330 (0.0010) [2023-12-28 00:34:28,576][106226] Updated weights for policy 0, policy_version 740340 (0.0008) [2023-12-28 00:34:29,083][106225] Updated weights for policy 1, policy_version 742319 (0.0008) [2023-12-28 00:34:29,136][106225] Updated weights for policy 1, policy_version 742329 (0.0007) [2023-12-28 00:34:29,192][106225] Updated weights for policy 1, policy_version 742339 (0.0006) [2023-12-28 00:34:29,216][106226] Updated weights for policy 0, policy_version 740350 (0.0008) [2023-12-28 00:34:29,281][106226] Updated weights for policy 0, policy_version 740360 (0.0009) [2023-12-28 00:34:29,339][106226] Updated weights for policy 0, policy_version 740370 (0.0009) [2023-12-28 00:34:29,854][106225] Updated weights for policy 1, policy_version 742349 (0.0007) [2023-12-28 00:34:29,920][106225] Updated weights for policy 1, policy_version 742359 (0.0007) [2023-12-28 00:34:29,991][106225] Updated weights for policy 1, policy_version 742369 (0.0009) [2023-12-28 00:34:30,049][106226] Updated weights for policy 0, policy_version 740380 (0.0008) [2023-12-28 00:34:30,107][106226] Updated weights for policy 0, policy_version 740390 (0.0008) [2023-12-28 00:34:30,167][106226] Updated weights for policy 0, policy_version 740400 (0.0009) [2023-12-28 00:34:30,681][106225] Updated weights for policy 1, policy_version 742379 (0.0009) [2023-12-28 00:34:30,730][106225] Updated weights for policy 1, policy_version 742389 (0.0010) [2023-12-28 00:34:30,752][106226] Updated weights for policy 0, policy_version 740410 (0.0008) [2023-12-28 00:34:30,783][106225] Updated weights for policy 1, policy_version 742399 (0.0010) [2023-12-28 00:34:30,813][106226] Updated weights for policy 0, policy_version 740420 (0.0005) [2023-12-28 00:34:30,866][106226] Updated weights for policy 0, policy_version 740430 (0.0005) [2023-12-28 00:34:30,922][106226] Updated weights for policy 0, policy_version 740440 (0.0005) [2023-12-28 00:34:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 379699200. Throughput: 0: 9848.3, 1: 9992.3. Samples: 379684932. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:31,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.407')] [2023-12-28 00:34:31,435][106225] Updated weights for policy 1, policy_version 742409 (0.0006) [2023-12-28 00:34:31,493][106225] Updated weights for policy 1, policy_version 742419 (0.0008) [2023-12-28 00:34:31,551][106225] Updated weights for policy 1, policy_version 742429 (0.0008) [2023-12-28 00:34:31,609][106225] Updated weights for policy 1, policy_version 742439 (0.0008) [2023-12-28 00:34:31,625][106226] Updated weights for policy 0, policy_version 740450 (0.0007) [2023-12-28 00:34:31,691][106226] Updated weights for policy 0, policy_version 740460 (0.0007) [2023-12-28 00:34:31,751][106226] Updated weights for policy 0, policy_version 740470 (0.0008) [2023-12-28 00:34:32,329][106225] Updated weights for policy 1, policy_version 742449 (0.0010) [2023-12-28 00:34:32,403][106225] Updated weights for policy 1, policy_version 742459 (0.0011) [2023-12-28 00:34:32,458][106225] Updated weights for policy 1, policy_version 742469 (0.0009) [2023-12-28 00:34:32,472][106226] Updated weights for policy 0, policy_version 740480 (0.0008) [2023-12-28 00:34:32,529][106226] Updated weights for policy 0, policy_version 740490 (0.0008) [2023-12-28 00:34:32,586][106226] Updated weights for policy 0, policy_version 740500 (0.0008) [2023-12-28 00:34:33,125][106225] Updated weights for policy 1, policy_version 742479 (0.0007) [2023-12-28 00:34:33,179][106225] Updated weights for policy 1, policy_version 742489 (0.0005) [2023-12-28 00:34:33,233][106225] Updated weights for policy 1, policy_version 742499 (0.0005) [2023-12-28 00:34:33,361][106226] Updated weights for policy 0, policy_version 740510 (0.0009) [2023-12-28 00:34:33,410][106226] Updated weights for policy 0, policy_version 740520 (0.0009) [2023-12-28 00:34:33,459][106226] Updated weights for policy 0, policy_version 740530 (0.0009) [2023-12-28 00:34:33,778][106225] Updated weights for policy 1, policy_version 742509 (0.0005) [2023-12-28 00:34:33,840][106225] Updated weights for policy 1, policy_version 742519 (0.0005) [2023-12-28 00:34:33,903][106225] Updated weights for policy 1, policy_version 742529 (0.0005) [2023-12-28 00:34:34,141][106226] Updated weights for policy 0, policy_version 740540 (0.0009) [2023-12-28 00:34:34,199][106226] Updated weights for policy 0, policy_version 740550 (0.0010) [2023-12-28 00:34:34,254][106226] Updated weights for policy 0, policy_version 740560 (0.0008) [2023-12-28 00:34:34,539][106225] Updated weights for policy 1, policy_version 742539 (0.0007) [2023-12-28 00:34:34,598][106225] Updated weights for policy 1, policy_version 742549 (0.0008) [2023-12-28 00:34:34,657][106225] Updated weights for policy 1, policy_version 742559 (0.0008) [2023-12-28 00:34:34,924][106226] Updated weights for policy 0, policy_version 740570 (0.0007) [2023-12-28 00:34:34,983][106226] Updated weights for policy 0, policy_version 740580 (0.0009) [2023-12-28 00:34:35,040][106226] Updated weights for policy 0, policy_version 740590 (0.0008) [2023-12-28 00:34:35,098][106226] Updated weights for policy 0, policy_version 740600 (0.0007) [2023-12-28 00:34:35,415][106225] Updated weights for policy 1, policy_version 742569 (0.0008) [2023-12-28 00:34:35,476][106225] Updated weights for policy 1, policy_version 742579 (0.0011) [2023-12-28 00:34:35,532][106225] Updated weights for policy 1, policy_version 742589 (0.0010) [2023-12-28 00:34:35,589][106225] Updated weights for policy 1, policy_version 742599 (0.0010) [2023-12-28 00:34:35,816][106226] Updated weights for policy 0, policy_version 740610 (0.0010) [2023-12-28 00:34:35,876][106226] Updated weights for policy 0, policy_version 740620 (0.0010) [2023-12-28 00:34:35,922][106226] Updated weights for policy 0, policy_version 740630 (0.0007) [2023-12-28 00:34:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 379797504. Throughput: 0: 9825.7, 1: 10078.4. Samples: 379806624. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:36,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-5.168')] [2023-12-28 00:34:36,340][106225] Updated weights for policy 1, policy_version 742609 (0.0009) [2023-12-28 00:34:36,400][106225] Updated weights for policy 1, policy_version 742619 (0.0008) [2023-12-28 00:34:36,465][106225] Updated weights for policy 1, policy_version 742629 (0.0008) [2023-12-28 00:34:36,655][106226] Updated weights for policy 0, policy_version 740640 (0.0009) [2023-12-28 00:34:36,722][106226] Updated weights for policy 0, policy_version 740650 (0.0007) [2023-12-28 00:34:36,782][106226] Updated weights for policy 0, policy_version 740660 (0.0010) [2023-12-28 00:34:37,076][106225] Updated weights for policy 1, policy_version 742639 (0.0010) [2023-12-28 00:34:37,128][106225] Updated weights for policy 1, policy_version 742649 (0.0010) [2023-12-28 00:34:37,189][106225] Updated weights for policy 1, policy_version 742659 (0.0010) [2023-12-28 00:34:37,551][106226] Updated weights for policy 0, policy_version 740670 (0.0010) [2023-12-28 00:34:37,618][106226] Updated weights for policy 0, policy_version 740680 (0.0010) [2023-12-28 00:34:37,673][106226] Updated weights for policy 0, policy_version 740690 (0.0009) [2023-12-28 00:34:37,781][106225] Updated weights for policy 1, policy_version 742669 (0.0008) [2023-12-28 00:34:37,843][106225] Updated weights for policy 1, policy_version 742679 (0.0006) [2023-12-28 00:34:37,913][106225] Updated weights for policy 1, policy_version 742689 (0.0010) [2023-12-28 00:34:38,351][106226] Updated weights for policy 0, policy_version 740700 (0.0009) [2023-12-28 00:34:38,411][106226] Updated weights for policy 0, policy_version 740710 (0.0008) [2023-12-28 00:34:38,472][106226] Updated weights for policy 0, policy_version 740720 (0.0006) [2023-12-28 00:34:38,592][106225] Updated weights for policy 1, policy_version 742699 (0.0009) [2023-12-28 00:34:38,651][106225] Updated weights for policy 1, policy_version 742709 (0.0008) [2023-12-28 00:34:38,713][106225] Updated weights for policy 1, policy_version 742719 (0.0009) [2023-12-28 00:34:39,128][106226] Updated weights for policy 0, policy_version 740730 (0.0005) [2023-12-28 00:34:39,180][106226] Updated weights for policy 0, policy_version 740740 (0.0006) [2023-12-28 00:34:39,245][106226] Updated weights for policy 0, policy_version 740750 (0.0008) [2023-12-28 00:34:39,300][106226] Updated weights for policy 0, policy_version 740760 (0.0009) [2023-12-28 00:34:39,349][106225] Updated weights for policy 1, policy_version 742729 (0.0009) [2023-12-28 00:34:39,428][106225] Updated weights for policy 1, policy_version 742739 (0.0009) [2023-12-28 00:34:39,489][106225] Updated weights for policy 1, policy_version 742749 (0.0009) [2023-12-28 00:34:39,555][106225] Updated weights for policy 1, policy_version 742759 (0.0009) [2023-12-28 00:34:40,067][106226] Updated weights for policy 0, policy_version 740770 (0.0007) [2023-12-28 00:34:40,125][106226] Updated weights for policy 0, policy_version 740780 (0.0007) [2023-12-28 00:34:40,184][106226] Updated weights for policy 0, policy_version 740790 (0.0008) [2023-12-28 00:34:40,329][106225] Updated weights for policy 1, policy_version 742769 (0.0009) [2023-12-28 00:34:40,390][106225] Updated weights for policy 1, policy_version 742779 (0.0009) [2023-12-28 00:34:40,443][106225] Updated weights for policy 1, policy_version 742789 (0.0009) [2023-12-28 00:34:40,911][106226] Updated weights for policy 0, policy_version 740800 (0.0010) [2023-12-28 00:34:40,975][106226] Updated weights for policy 0, policy_version 740810 (0.0011) [2023-12-28 00:34:41,042][106226] Updated weights for policy 0, policy_version 740820 (0.0010) [2023-12-28 00:34:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 379895808. Throughput: 0: 9813.5, 1: 10129.7. Samples: 379867120. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:41,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.266')] [2023-12-28 00:34:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000740824_189702144.pth... [2023-12-28 00:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000739672_189407232.pth [2023-12-28 00:34:41,215][106225] Updated weights for policy 1, policy_version 742799 (0.0008) [2023-12-28 00:34:41,285][106225] Updated weights for policy 1, policy_version 742809 (0.0008) [2023-12-28 00:34:41,352][106225] Updated weights for policy 1, policy_version 742819 (0.0008) [2023-12-28 00:34:41,384][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000742824_190201856.pth... [2023-12-28 00:34:41,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000741640_189898752.pth [2023-12-28 00:34:41,811][106226] Updated weights for policy 0, policy_version 740830 (0.0008) [2023-12-28 00:34:41,878][106226] Updated weights for policy 0, policy_version 740840 (0.0007) [2023-12-28 00:34:41,933][106226] Updated weights for policy 0, policy_version 740850 (0.0008) [2023-12-28 00:34:42,099][106225] Updated weights for policy 1, policy_version 742829 (0.0008) [2023-12-28 00:34:42,161][106225] Updated weights for policy 1, policy_version 742839 (0.0008) [2023-12-28 00:34:42,223][106225] Updated weights for policy 1, policy_version 742849 (0.0007) [2023-12-28 00:34:42,620][106226] Updated weights for policy 0, policy_version 740860 (0.0006) [2023-12-28 00:34:42,690][106226] Updated weights for policy 0, policy_version 740870 (0.0009) [2023-12-28 00:34:42,751][106226] Updated weights for policy 0, policy_version 740880 (0.0011) [2023-12-28 00:34:42,844][106225] Updated weights for policy 1, policy_version 742859 (0.0009) [2023-12-28 00:34:42,908][106225] Updated weights for policy 1, policy_version 742869 (0.0009) [2023-12-28 00:34:42,958][106225] Updated weights for policy 1, policy_version 742879 (0.0010) [2023-12-28 00:34:43,353][106226] Updated weights for policy 0, policy_version 740890 (0.0009) [2023-12-28 00:34:43,403][106226] Updated weights for policy 0, policy_version 740900 (0.0009) [2023-12-28 00:34:43,456][106226] Updated weights for policy 0, policy_version 740910 (0.0007) [2023-12-28 00:34:43,509][106226] Updated weights for policy 0, policy_version 740920 (0.0009) [2023-12-28 00:34:43,582][106225] Updated weights for policy 1, policy_version 742889 (0.0010) [2023-12-28 00:34:43,643][106225] Updated weights for policy 1, policy_version 742899 (0.0005) [2023-12-28 00:34:43,703][106225] Updated weights for policy 1, policy_version 742909 (0.0008) [2023-12-28 00:34:43,755][106225] Updated weights for policy 1, policy_version 742919 (0.0010) [2023-12-28 00:34:44,159][106226] Updated weights for policy 0, policy_version 740930 (0.0005) [2023-12-28 00:34:44,221][106226] Updated weights for policy 0, policy_version 740940 (0.0005) [2023-12-28 00:34:44,275][106226] Updated weights for policy 0, policy_version 740950 (0.0006) [2023-12-28 00:34:44,329][106225] Updated weights for policy 1, policy_version 742929 (0.0010) [2023-12-28 00:34:44,382][106225] Updated weights for policy 1, policy_version 742939 (0.0010) [2023-12-28 00:34:44,442][106225] Updated weights for policy 1, policy_version 742949 (0.0010) [2023-12-28 00:34:44,909][106226] Updated weights for policy 0, policy_version 740960 (0.0006) [2023-12-28 00:34:44,968][106226] Updated weights for policy 0, policy_version 740970 (0.0006) [2023-12-28 00:34:45,033][106226] Updated weights for policy 0, policy_version 740980 (0.0008) [2023-12-28 00:34:45,181][106225] Updated weights for policy 1, policy_version 742959 (0.0011) [2023-12-28 00:34:45,248][106225] Updated weights for policy 1, policy_version 742969 (0.0008) [2023-12-28 00:34:45,316][106225] Updated weights for policy 1, policy_version 742979 (0.0007) [2023-12-28 00:34:45,727][106226] Updated weights for policy 0, policy_version 740990 (0.0008) [2023-12-28 00:34:45,791][106226] Updated weights for policy 0, policy_version 741000 (0.0008) [2023-12-28 00:34:45,856][106226] Updated weights for policy 0, policy_version 741010 (0.0008) [2023-12-28 00:34:45,935][106225] Updated weights for policy 1, policy_version 742989 (0.0007) [2023-12-28 00:34:45,992][106225] Updated weights for policy 1, policy_version 742999 (0.0005) [2023-12-28 00:34:46,044][106225] Updated weights for policy 1, policy_version 743009 (0.0007) [2023-12-28 00:34:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 380002304. Throughput: 0: 9924.9, 1: 10082.1. Samples: 379986728. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:46,176][105115] Avg episode reward: [(0, '-4.369'), (1, '-5.336')] [2023-12-28 00:34:46,560][106226] Updated weights for policy 0, policy_version 741020 (0.0007) [2023-12-28 00:34:46,619][106226] Updated weights for policy 0, policy_version 741030 (0.0008) [2023-12-28 00:34:46,679][106226] Updated weights for policy 0, policy_version 741040 (0.0007) [2023-12-28 00:34:46,739][106225] Updated weights for policy 1, policy_version 743019 (0.0010) [2023-12-28 00:34:46,802][106225] Updated weights for policy 1, policy_version 743029 (0.0010) [2023-12-28 00:34:46,859][106225] Updated weights for policy 1, policy_version 743039 (0.0010) [2023-12-28 00:34:47,332][106226] Updated weights for policy 0, policy_version 741050 (0.0007) [2023-12-28 00:34:47,390][106226] Updated weights for policy 0, policy_version 741060 (0.0005) [2023-12-28 00:34:47,450][106226] Updated weights for policy 0, policy_version 741070 (0.0008) [2023-12-28 00:34:47,493][106225] Updated weights for policy 1, policy_version 743049 (0.0010) [2023-12-28 00:34:47,503][106226] Updated weights for policy 0, policy_version 741080 (0.0007) [2023-12-28 00:34:47,547][106225] Updated weights for policy 1, policy_version 743059 (0.0010) [2023-12-28 00:34:47,604][106225] Updated weights for policy 1, policy_version 743069 (0.0010) [2023-12-28 00:34:47,654][106225] Updated weights for policy 1, policy_version 743079 (0.0008) [2023-12-28 00:34:48,128][106226] Updated weights for policy 0, policy_version 741090 (0.0009) [2023-12-28 00:34:48,186][106226] Updated weights for policy 0, policy_version 741100 (0.0008) [2023-12-28 00:34:48,252][106226] Updated weights for policy 0, policy_version 741110 (0.0009) [2023-12-28 00:34:48,336][106225] Updated weights for policy 1, policy_version 743089 (0.0009) [2023-12-28 00:34:48,400][106225] Updated weights for policy 1, policy_version 743099 (0.0009) [2023-12-28 00:34:48,463][106225] Updated weights for policy 1, policy_version 743109 (0.0009) [2023-12-28 00:34:48,995][106226] Updated weights for policy 0, policy_version 741120 (0.0008) [2023-12-28 00:34:49,059][106226] Updated weights for policy 0, policy_version 741130 (0.0009) [2023-12-28 00:34:49,122][106226] Updated weights for policy 0, policy_version 741140 (0.0009) [2023-12-28 00:34:49,194][106225] Updated weights for policy 1, policy_version 743119 (0.0009) [2023-12-28 00:34:49,255][106225] Updated weights for policy 1, policy_version 743129 (0.0007) [2023-12-28 00:34:49,321][106225] Updated weights for policy 1, policy_version 743139 (0.0009) [2023-12-28 00:34:49,792][106226] Updated weights for policy 0, policy_version 741150 (0.0009) [2023-12-28 00:34:49,864][106226] Updated weights for policy 0, policy_version 741160 (0.0009) [2023-12-28 00:34:49,925][106226] Updated weights for policy 0, policy_version 741170 (0.0009) [2023-12-28 00:34:50,116][106225] Updated weights for policy 1, policy_version 743149 (0.0009) [2023-12-28 00:34:50,170][106225] Updated weights for policy 1, policy_version 743159 (0.0010) [2023-12-28 00:34:50,228][106225] Updated weights for policy 1, policy_version 743169 (0.0006) [2023-12-28 00:34:50,762][106226] Updated weights for policy 0, policy_version 741180 (0.0009) [2023-12-28 00:34:50,820][106226] Updated weights for policy 0, policy_version 741190 (0.0008) [2023-12-28 00:34:50,885][106226] Updated weights for policy 0, policy_version 741200 (0.0010) [2023-12-28 00:34:50,894][106225] Updated weights for policy 1, policy_version 743179 (0.0007) [2023-12-28 00:34:50,954][106225] Updated weights for policy 1, policy_version 743189 (0.0006) [2023-12-28 00:34:51,014][106225] Updated weights for policy 1, policy_version 743199 (0.0006) [2023-12-28 00:34:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 380100608. Throughput: 0: 9892.7, 1: 9966.9. Samples: 380104568. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:51,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.280')] [2023-12-28 00:34:51,711][106226] Updated weights for policy 0, policy_version 741210 (0.0008) [2023-12-28 00:34:51,774][106225] Updated weights for policy 1, policy_version 743209 (0.0008) [2023-12-28 00:34:51,786][106226] Updated weights for policy 0, policy_version 741220 (0.0009) [2023-12-28 00:34:51,830][106225] Updated weights for policy 1, policy_version 743219 (0.0010) [2023-12-28 00:34:51,841][106226] Updated weights for policy 0, policy_version 741230 (0.0007) [2023-12-28 00:34:51,887][106225] Updated weights for policy 1, policy_version 743229 (0.0010) [2023-12-28 00:34:51,897][106226] Updated weights for policy 0, policy_version 741240 (0.0007) [2023-12-28 00:34:51,951][106225] Updated weights for policy 1, policy_version 743239 (0.0010) [2023-12-28 00:34:52,623][106226] Updated weights for policy 0, policy_version 741250 (0.0009) [2023-12-28 00:34:52,676][106226] Updated weights for policy 0, policy_version 741260 (0.0007) [2023-12-28 00:34:52,708][106225] Updated weights for policy 1, policy_version 743249 (0.0010) [2023-12-28 00:34:52,726][106226] Updated weights for policy 0, policy_version 741270 (0.0007) [2023-12-28 00:34:52,772][106225] Updated weights for policy 1, policy_version 743259 (0.0010) [2023-12-28 00:34:52,836][106225] Updated weights for policy 1, policy_version 743269 (0.0010) [2023-12-28 00:34:53,495][106226] Updated weights for policy 0, policy_version 741280 (0.0009) [2023-12-28 00:34:53,524][106225] Updated weights for policy 1, policy_version 743279 (0.0010) [2023-12-28 00:34:53,550][106226] Updated weights for policy 0, policy_version 741290 (0.0006) [2023-12-28 00:34:53,571][106225] Updated weights for policy 1, policy_version 743289 (0.0010) [2023-12-28 00:34:53,604][106226] Updated weights for policy 0, policy_version 741300 (0.0006) [2023-12-28 00:34:53,628][106225] Updated weights for policy 1, policy_version 743299 (0.0010) [2023-12-28 00:34:54,292][106226] Updated weights for policy 0, policy_version 741310 (0.0007) [2023-12-28 00:34:54,343][106226] Updated weights for policy 0, policy_version 741320 (0.0010) [2023-12-28 00:34:54,380][106225] Updated weights for policy 1, policy_version 743309 (0.0008) [2023-12-28 00:34:54,393][106226] Updated weights for policy 0, policy_version 741330 (0.0009) [2023-12-28 00:34:54,438][106225] Updated weights for policy 1, policy_version 743319 (0.0006) [2023-12-28 00:34:54,490][106225] Updated weights for policy 1, policy_version 743329 (0.0008) [2023-12-28 00:34:55,104][106226] Updated weights for policy 0, policy_version 741340 (0.0009) [2023-12-28 00:34:55,151][106226] Updated weights for policy 0, policy_version 741350 (0.0005) [2023-12-28 00:34:55,198][106226] Updated weights for policy 0, policy_version 741360 (0.0007) [2023-12-28 00:34:55,232][106225] Updated weights for policy 1, policy_version 743339 (0.0009) [2023-12-28 00:34:55,288][106225] Updated weights for policy 1, policy_version 743349 (0.0008) [2023-12-28 00:34:55,340][106225] Updated weights for policy 1, policy_version 743359 (0.0009) [2023-12-28 00:34:55,763][106226] Updated weights for policy 0, policy_version 741370 (0.0006) [2023-12-28 00:34:55,818][106226] Updated weights for policy 0, policy_version 741380 (0.0007) [2023-12-28 00:34:55,872][106226] Updated weights for policy 0, policy_version 741390 (0.0008) [2023-12-28 00:34:55,948][106226] Updated weights for policy 0, policy_version 741400 (0.0009) [2023-12-28 00:34:56,127][106225] Updated weights for policy 1, policy_version 743369 (0.0007) [2023-12-28 00:34:56,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 380190720. Throughput: 0: 9835.9, 1: 9885.0. Samples: 380161208. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 00:34:56,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-5.338')] [2023-12-28 00:34:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000741400_189849600.pth... [2023-12-28 00:34:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000740216_189546496.pth [2023-12-28 00:34:56,186][106225] Updated weights for policy 1, policy_version 743379 (0.0008) [2023-12-28 00:34:56,252][106225] Updated weights for policy 1, policy_version 743389 (0.0008) [2023-12-28 00:34:56,311][106225] Updated weights for policy 1, policy_version 743399 (0.0008) [2023-12-28 00:34:56,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000743400_190349312.pth... [2023-12-28 00:34:56,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000742216_190046208.pth [2023-12-28 00:34:56,664][106226] Updated weights for policy 0, policy_version 741410 (0.0007) [2023-12-28 00:34:56,714][106226] Updated weights for policy 0, policy_version 741420 (0.0005) [2023-12-28 00:34:56,758][106226] Updated weights for policy 0, policy_version 741430 (0.0007) [2023-12-28 00:34:57,071][106225] Updated weights for policy 1, policy_version 743409 (0.0005) [2023-12-28 00:34:57,132][106225] Updated weights for policy 1, policy_version 743419 (0.0007) [2023-12-28 00:34:57,186][106225] Updated weights for policy 1, policy_version 743429 (0.0008) [2023-12-28 00:34:57,361][106226] Updated weights for policy 0, policy_version 741440 (0.0006) [2023-12-28 00:34:57,424][106226] Updated weights for policy 0, policy_version 741450 (0.0006) [2023-12-28 00:34:57,484][106226] Updated weights for policy 0, policy_version 741460 (0.0005) [2023-12-28 00:34:57,896][106225] Updated weights for policy 1, policy_version 743439 (0.0008) [2023-12-28 00:34:57,941][106225] Updated weights for policy 1, policy_version 743449 (0.0008) [2023-12-28 00:34:57,987][106225] Updated weights for policy 1, policy_version 743459 (0.0007) [2023-12-28 00:34:58,072][106226] Updated weights for policy 0, policy_version 741470 (0.0007) [2023-12-28 00:34:58,118][106226] Updated weights for policy 0, policy_version 741480 (0.0009) [2023-12-28 00:34:58,161][106226] Updated weights for policy 0, policy_version 741490 (0.0008) [2023-12-28 00:34:58,809][106225] Updated weights for policy 1, policy_version 743469 (0.0010) [2023-12-28 00:34:58,890][106225] Updated weights for policy 1, policy_version 743479 (0.0009) [2023-12-28 00:34:58,945][106225] Updated weights for policy 1, policy_version 743489 (0.0008) [2023-12-28 00:34:59,079][106226] Updated weights for policy 0, policy_version 741500 (0.0007) [2023-12-28 00:34:59,139][106226] Updated weights for policy 0, policy_version 741510 (0.0008) [2023-12-28 00:34:59,202][106226] Updated weights for policy 0, policy_version 741520 (0.0008) [2023-12-28 00:34:59,740][106225] Updated weights for policy 1, policy_version 743499 (0.0009) [2023-12-28 00:34:59,792][106225] Updated weights for policy 1, policy_version 743509 (0.0006) [2023-12-28 00:34:59,859][106225] Updated weights for policy 1, policy_version 743519 (0.0007) [2023-12-28 00:35:00,010][106226] Updated weights for policy 0, policy_version 741530 (0.0010) [2023-12-28 00:35:00,074][106226] Updated weights for policy 0, policy_version 741540 (0.0009) [2023-12-28 00:35:00,130][106226] Updated weights for policy 0, policy_version 741550 (0.0008) [2023-12-28 00:35:00,189][106226] Updated weights for policy 0, policy_version 741560 (0.0008) [2023-12-28 00:35:00,551][106225] Updated weights for policy 1, policy_version 743529 (0.0007) [2023-12-28 00:35:00,597][106225] Updated weights for policy 1, policy_version 743539 (0.0007) [2023-12-28 00:35:00,654][106225] Updated weights for policy 1, policy_version 743549 (0.0008) [2023-12-28 00:35:00,709][106225] Updated weights for policy 1, policy_version 743559 (0.0007) [2023-12-28 00:35:00,895][106226] Updated weights for policy 0, policy_version 741570 (0.0010) [2023-12-28 00:35:00,958][106226] Updated weights for policy 0, policy_version 741580 (0.0010) [2023-12-28 00:35:01,017][106226] Updated weights for policy 0, policy_version 741590 (0.0010) [2023-12-28 00:35:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 380289024. Throughput: 0: 9919.3, 1: 9860.4. Samples: 380277172. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:01,175][105115] Avg episode reward: [(0, '-4.122'), (1, '-5.412')] [2023-12-28 00:35:01,417][106225] Updated weights for policy 1, policy_version 743569 (0.0009) [2023-12-28 00:35:01,489][106225] Updated weights for policy 1, policy_version 743579 (0.0008) [2023-12-28 00:35:01,548][106225] Updated weights for policy 1, policy_version 743589 (0.0009) [2023-12-28 00:35:01,767][106226] Updated weights for policy 0, policy_version 741600 (0.0008) [2023-12-28 00:35:01,830][106226] Updated weights for policy 0, policy_version 741610 (0.0008) [2023-12-28 00:35:01,885][106226] Updated weights for policy 0, policy_version 741620 (0.0008) [2023-12-28 00:35:02,261][106225] Updated weights for policy 1, policy_version 743599 (0.0007) [2023-12-28 00:35:02,328][106225] Updated weights for policy 1, policy_version 743609 (0.0008) [2023-12-28 00:35:02,392][106225] Updated weights for policy 1, policy_version 743619 (0.0007) [2023-12-28 00:35:02,597][106226] Updated weights for policy 0, policy_version 741630 (0.0008) [2023-12-28 00:35:02,660][106226] Updated weights for policy 0, policy_version 741640 (0.0010) [2023-12-28 00:35:02,722][106226] Updated weights for policy 0, policy_version 741650 (0.0009) [2023-12-28 00:35:02,993][106225] Updated weights for policy 1, policy_version 743629 (0.0010) [2023-12-28 00:35:03,057][106225] Updated weights for policy 1, policy_version 743639 (0.0010) [2023-12-28 00:35:03,114][106225] Updated weights for policy 1, policy_version 743649 (0.0010) [2023-12-28 00:35:03,372][106226] Updated weights for policy 0, policy_version 741660 (0.0008) [2023-12-28 00:35:03,428][106226] Updated weights for policy 0, policy_version 741670 (0.0006) [2023-12-28 00:35:03,487][106226] Updated weights for policy 0, policy_version 741680 (0.0006) [2023-12-28 00:35:03,797][106225] Updated weights for policy 1, policy_version 743659 (0.0010) [2023-12-28 00:35:03,864][106225] Updated weights for policy 1, policy_version 743669 (0.0009) [2023-12-28 00:35:03,927][106225] Updated weights for policy 1, policy_version 743679 (0.0006) [2023-12-28 00:35:04,157][106226] Updated weights for policy 0, policy_version 741690 (0.0009) [2023-12-28 00:35:04,221][106226] Updated weights for policy 0, policy_version 741700 (0.0008) [2023-12-28 00:35:04,281][106226] Updated weights for policy 0, policy_version 741710 (0.0009) [2023-12-28 00:35:04,340][106226] Updated weights for policy 0, policy_version 741720 (0.0010) [2023-12-28 00:35:04,597][106225] Updated weights for policy 1, policy_version 743689 (0.0007) [2023-12-28 00:35:04,650][106225] Updated weights for policy 1, policy_version 743699 (0.0008) [2023-12-28 00:35:04,703][106225] Updated weights for policy 1, policy_version 743709 (0.0008) [2023-12-28 00:35:04,752][106225] Updated weights for policy 1, policy_version 743719 (0.0008) [2023-12-28 00:35:05,048][106226] Updated weights for policy 0, policy_version 741730 (0.0008) [2023-12-28 00:35:05,103][106226] Updated weights for policy 0, policy_version 741740 (0.0006) [2023-12-28 00:35:05,158][106226] Updated weights for policy 0, policy_version 741750 (0.0005) [2023-12-28 00:35:05,423][106225] Updated weights for policy 1, policy_version 743729 (0.0007) [2023-12-28 00:35:05,479][106225] Updated weights for policy 1, policy_version 743739 (0.0008) [2023-12-28 00:35:05,532][106225] Updated weights for policy 1, policy_version 743749 (0.0010) [2023-12-28 00:35:05,801][106226] Updated weights for policy 0, policy_version 741760 (0.0006) [2023-12-28 00:35:05,859][106226] Updated weights for policy 0, policy_version 741770 (0.0009) [2023-12-28 00:35:05,910][106226] Updated weights for policy 0, policy_version 741780 (0.0009) [2023-12-28 00:35:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 380387328. Throughput: 0: 9932.6, 1: 9917.1. Samples: 380397412. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:06,175][105115] Avg episode reward: [(0, '-4.192'), (1, '-5.448')] [2023-12-28 00:35:06,279][106225] Updated weights for policy 1, policy_version 743759 (0.0010) [2023-12-28 00:35:06,341][106225] Updated weights for policy 1, policy_version 743769 (0.0009) [2023-12-28 00:35:06,399][106225] Updated weights for policy 1, policy_version 743779 (0.0009) [2023-12-28 00:35:06,528][106226] Updated weights for policy 0, policy_version 741790 (0.0010) [2023-12-28 00:35:06,590][106226] Updated weights for policy 0, policy_version 741800 (0.0011) [2023-12-28 00:35:06,652][106226] Updated weights for policy 0, policy_version 741810 (0.0010) [2023-12-28 00:35:07,145][106225] Updated weights for policy 1, policy_version 743789 (0.0009) [2023-12-28 00:35:07,208][106225] Updated weights for policy 1, policy_version 743799 (0.0010) [2023-12-28 00:35:07,263][106225] Updated weights for policy 1, policy_version 743809 (0.0008) [2023-12-28 00:35:07,271][106226] Updated weights for policy 0, policy_version 741820 (0.0008) [2023-12-28 00:35:07,325][106226] Updated weights for policy 0, policy_version 741830 (0.0006) [2023-12-28 00:35:07,380][106226] Updated weights for policy 0, policy_version 741840 (0.0006) [2023-12-28 00:35:08,011][106226] Updated weights for policy 0, policy_version 741850 (0.0006) [2023-12-28 00:35:08,025][106225] Updated weights for policy 1, policy_version 743819 (0.0008) [2023-12-28 00:35:08,060][106226] Updated weights for policy 0, policy_version 741860 (0.0008) [2023-12-28 00:35:08,085][106225] Updated weights for policy 1, policy_version 743829 (0.0008) [2023-12-28 00:35:08,104][106226] Updated weights for policy 0, policy_version 741870 (0.0007) [2023-12-28 00:35:08,143][106225] Updated weights for policy 1, policy_version 743839 (0.0007) [2023-12-28 00:35:08,152][106226] Updated weights for policy 0, policy_version 741880 (0.0007) [2023-12-28 00:35:08,835][106225] Updated weights for policy 1, policy_version 743849 (0.0008) [2023-12-28 00:35:08,892][106225] Updated weights for policy 1, policy_version 743859 (0.0007) [2023-12-28 00:35:08,929][106226] Updated weights for policy 0, policy_version 741890 (0.0007) [2023-12-28 00:35:08,950][106225] Updated weights for policy 1, policy_version 743869 (0.0008) [2023-12-28 00:35:08,980][106226] Updated weights for policy 0, policy_version 741900 (0.0006) [2023-12-28 00:35:09,007][106225] Updated weights for policy 1, policy_version 743879 (0.0009) [2023-12-28 00:35:09,038][106226] Updated weights for policy 0, policy_version 741910 (0.0006) [2023-12-28 00:35:09,791][106226] Updated weights for policy 0, policy_version 741920 (0.0008) [2023-12-28 00:35:09,814][106225] Updated weights for policy 1, policy_version 743889 (0.0006) [2023-12-28 00:35:09,875][106226] Updated weights for policy 0, policy_version 741930 (0.0009) [2023-12-28 00:35:09,892][106225] Updated weights for policy 1, policy_version 743899 (0.0009) [2023-12-28 00:35:09,942][106226] Updated weights for policy 0, policy_version 741940 (0.0007) [2023-12-28 00:35:09,955][106225] Updated weights for policy 1, policy_version 743909 (0.0008) [2023-12-28 00:35:10,669][106225] Updated weights for policy 1, policy_version 743919 (0.0007) [2023-12-28 00:35:10,708][106226] Updated weights for policy 0, policy_version 741950 (0.0008) [2023-12-28 00:35:10,738][106225] Updated weights for policy 1, policy_version 743929 (0.0007) [2023-12-28 00:35:10,775][106226] Updated weights for policy 0, policy_version 741960 (0.0007) [2023-12-28 00:35:10,809][106225] Updated weights for policy 1, policy_version 743939 (0.0006) [2023-12-28 00:35:10,831][106226] Updated weights for policy 0, policy_version 741970 (0.0007) [2023-12-28 00:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 380485632. Throughput: 0: 9988.5, 1: 9914.8. Samples: 380457252. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:11,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-5.355')] [2023-12-28 00:35:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000743944_190488576.pth... [2023-12-28 00:35:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000741976_189997056.pth... [2023-12-28 00:35:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000740824_189702144.pth [2023-12-28 00:35:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000742824_190201856.pth [2023-12-28 00:35:11,510][106225] Updated weights for policy 1, policy_version 743949 (0.0006) [2023-12-28 00:35:11,576][106225] Updated weights for policy 1, policy_version 743959 (0.0006) [2023-12-28 00:35:11,649][106225] Updated weights for policy 1, policy_version 743969 (0.0010) [2023-12-28 00:35:11,683][106226] Updated weights for policy 0, policy_version 741980 (0.0008) [2023-12-28 00:35:11,753][106226] Updated weights for policy 0, policy_version 741990 (0.0008) [2023-12-28 00:35:11,821][106226] Updated weights for policy 0, policy_version 742000 (0.0007) [2023-12-28 00:35:12,424][106225] Updated weights for policy 1, policy_version 743979 (0.0008) [2023-12-28 00:35:12,435][106226] Updated weights for policy 0, policy_version 742010 (0.0008) [2023-12-28 00:35:12,500][106226] Updated weights for policy 0, policy_version 742020 (0.0007) [2023-12-28 00:35:12,513][106225] Updated weights for policy 1, policy_version 743989 (0.0009) [2023-12-28 00:35:12,558][106226] Updated weights for policy 0, policy_version 742030 (0.0006) [2023-12-28 00:35:12,572][106225] Updated weights for policy 1, policy_version 743999 (0.0009) [2023-12-28 00:35:12,616][106226] Updated weights for policy 0, policy_version 742040 (0.0006) [2023-12-28 00:35:13,241][106225] Updated weights for policy 1, policy_version 744009 (0.0008) [2023-12-28 00:35:13,304][106225] Updated weights for policy 1, policy_version 744019 (0.0006) [2023-12-28 00:35:13,306][106226] Updated weights for policy 0, policy_version 742050 (0.0009) [2023-12-28 00:35:13,361][106225] Updated weights for policy 1, policy_version 744029 (0.0006) [2023-12-28 00:35:13,363][106226] Updated weights for policy 0, policy_version 742060 (0.0007) [2023-12-28 00:35:13,417][106225] Updated weights for policy 1, policy_version 744039 (0.0008) [2023-12-28 00:35:13,420][106226] Updated weights for policy 0, policy_version 742070 (0.0005) [2023-12-28 00:35:14,019][106225] Updated weights for policy 1, policy_version 744049 (0.0008) [2023-12-28 00:35:14,046][106226] Updated weights for policy 0, policy_version 742080 (0.0006) [2023-12-28 00:35:14,078][106225] Updated weights for policy 1, policy_version 744059 (0.0006) [2023-12-28 00:35:14,103][106226] Updated weights for policy 0, policy_version 742090 (0.0006) [2023-12-28 00:35:14,141][106225] Updated weights for policy 1, policy_version 744069 (0.0006) [2023-12-28 00:35:14,160][106226] Updated weights for policy 0, policy_version 742100 (0.0006) [2023-12-28 00:35:14,810][106225] Updated weights for policy 1, policy_version 744079 (0.0007) [2023-12-28 00:35:14,870][106225] Updated weights for policy 1, policy_version 744089 (0.0007) [2023-12-28 00:35:14,887][106226] Updated weights for policy 0, policy_version 742110 (0.0009) [2023-12-28 00:35:14,932][106225] Updated weights for policy 1, policy_version 744099 (0.0006) [2023-12-28 00:35:14,942][106226] Updated weights for policy 0, policy_version 742120 (0.0011) [2023-12-28 00:35:15,005][106226] Updated weights for policy 0, policy_version 742130 (0.0010) [2023-12-28 00:35:15,694][106226] Updated weights for policy 0, policy_version 742140 (0.0011) [2023-12-28 00:35:15,711][106225] Updated weights for policy 1, policy_version 744109 (0.0005) [2023-12-28 00:35:15,744][106226] Updated weights for policy 0, policy_version 742150 (0.0010) [2023-12-28 00:35:15,764][106225] Updated weights for policy 1, policy_version 744119 (0.0008) [2023-12-28 00:35:15,794][106226] Updated weights for policy 0, policy_version 742160 (0.0010) [2023-12-28 00:35:15,812][106225] Updated weights for policy 1, policy_version 744129 (0.0007) [2023-12-28 00:35:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 380583936. Throughput: 0: 9888.8, 1: 9853.1. Samples: 380573316. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:16,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.127')] [2023-12-28 00:35:16,490][106226] Updated weights for policy 0, policy_version 742170 (0.0011) [2023-12-28 00:35:16,556][106226] Updated weights for policy 0, policy_version 742180 (0.0011) [2023-12-28 00:35:16,561][106225] Updated weights for policy 1, policy_version 744139 (0.0007) [2023-12-28 00:35:16,613][106226] Updated weights for policy 0, policy_version 742190 (0.0008) [2023-12-28 00:35:16,621][106225] Updated weights for policy 1, policy_version 744149 (0.0007) [2023-12-28 00:35:16,678][106225] Updated weights for policy 1, policy_version 744159 (0.0007) [2023-12-28 00:35:16,678][106226] Updated weights for policy 0, policy_version 742200 (0.0007) [2023-12-28 00:35:17,277][106226] Updated weights for policy 0, policy_version 742210 (0.0009) [2023-12-28 00:35:17,323][106226] Updated weights for policy 0, policy_version 742220 (0.0010) [2023-12-28 00:35:17,380][106226] Updated weights for policy 0, policy_version 742230 (0.0010) [2023-12-28 00:35:17,382][106225] Updated weights for policy 1, policy_version 744169 (0.0006) [2023-12-28 00:35:17,431][106225] Updated weights for policy 1, policy_version 744179 (0.0007) [2023-12-28 00:35:17,482][106225] Updated weights for policy 1, policy_version 744189 (0.0007) [2023-12-28 00:35:17,533][106225] Updated weights for policy 1, policy_version 744199 (0.0005) [2023-12-28 00:35:17,988][106226] Updated weights for policy 0, policy_version 742240 (0.0008) [2023-12-28 00:35:18,037][106226] Updated weights for policy 0, policy_version 742250 (0.0006) [2023-12-28 00:35:18,093][106226] Updated weights for policy 0, policy_version 742260 (0.0005) [2023-12-28 00:35:18,231][106225] Updated weights for policy 1, policy_version 744209 (0.0005) [2023-12-28 00:35:18,294][106225] Updated weights for policy 1, policy_version 744219 (0.0005) [2023-12-28 00:35:18,364][106225] Updated weights for policy 1, policy_version 744229 (0.0008) [2023-12-28 00:35:18,802][106226] Updated weights for policy 0, policy_version 742270 (0.0008) [2023-12-28 00:35:18,866][106226] Updated weights for policy 0, policy_version 742280 (0.0009) [2023-12-28 00:35:18,927][106226] Updated weights for policy 0, policy_version 742290 (0.0010) [2023-12-28 00:35:18,969][106225] Updated weights for policy 1, policy_version 744239 (0.0008) [2023-12-28 00:35:19,025][106225] Updated weights for policy 1, policy_version 744249 (0.0005) [2023-12-28 00:35:19,077][106225] Updated weights for policy 1, policy_version 744259 (0.0005) [2023-12-28 00:35:19,695][106226] Updated weights for policy 0, policy_version 742300 (0.0007) [2023-12-28 00:35:19,763][106226] Updated weights for policy 0, policy_version 742310 (0.0008) [2023-12-28 00:35:19,781][106225] Updated weights for policy 1, policy_version 744269 (0.0008) [2023-12-28 00:35:19,834][106226] Updated weights for policy 0, policy_version 742320 (0.0007) [2023-12-28 00:35:19,856][106225] Updated weights for policy 1, policy_version 744279 (0.0009) [2023-12-28 00:35:19,924][106225] Updated weights for policy 1, policy_version 744289 (0.0009) [2023-12-28 00:35:20,573][106225] Updated weights for policy 1, policy_version 744299 (0.0007) [2023-12-28 00:35:20,590][106226] Updated weights for policy 0, policy_version 742330 (0.0007) [2023-12-28 00:35:20,636][106225] Updated weights for policy 1, policy_version 744309 (0.0007) [2023-12-28 00:35:20,648][106226] Updated weights for policy 0, policy_version 742340 (0.0009) [2023-12-28 00:35:20,693][106225] Updated weights for policy 1, policy_version 744319 (0.0008) [2023-12-28 00:35:20,711][106226] Updated weights for policy 0, policy_version 742350 (0.0010) [2023-12-28 00:35:20,770][106226] Updated weights for policy 0, policy_version 742360 (0.0008) [2023-12-28 00:35:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 380682240. Throughput: 0: 9882.7, 1: 9803.7. Samples: 380692512. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:21,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-5.160')] [2023-12-28 00:35:21,481][106225] Updated weights for policy 1, policy_version 744329 (0.0008) [2023-12-28 00:35:21,520][106226] Updated weights for policy 0, policy_version 742370 (0.0007) [2023-12-28 00:35:21,541][106225] Updated weights for policy 1, policy_version 744339 (0.0007) [2023-12-28 00:35:21,576][106226] Updated weights for policy 0, policy_version 742380 (0.0006) [2023-12-28 00:35:21,602][106225] Updated weights for policy 1, policy_version 744349 (0.0008) [2023-12-28 00:35:21,645][106226] Updated weights for policy 0, policy_version 742390 (0.0008) [2023-12-28 00:35:21,669][106225] Updated weights for policy 1, policy_version 744359 (0.0009) [2023-12-28 00:35:22,378][106226] Updated weights for policy 0, policy_version 742400 (0.0007) [2023-12-28 00:35:22,428][106225] Updated weights for policy 1, policy_version 744369 (0.0006) [2023-12-28 00:35:22,450][106226] Updated weights for policy 0, policy_version 742410 (0.0008) [2023-12-28 00:35:22,476][106225] Updated weights for policy 1, policy_version 744379 (0.0006) [2023-12-28 00:35:22,518][106226] Updated weights for policy 0, policy_version 742420 (0.0007) [2023-12-28 00:35:22,521][106225] Updated weights for policy 1, policy_version 744389 (0.0006) [2023-12-28 00:35:23,148][106226] Updated weights for policy 0, policy_version 742430 (0.0006) [2023-12-28 00:35:23,200][106226] Updated weights for policy 0, policy_version 742440 (0.0005) [2023-12-28 00:35:23,253][106226] Updated weights for policy 0, policy_version 742450 (0.0005) [2023-12-28 00:35:23,352][106225] Updated weights for policy 1, policy_version 744399 (0.0008) [2023-12-28 00:35:23,401][106225] Updated weights for policy 1, policy_version 744409 (0.0009) [2023-12-28 00:35:23,457][106225] Updated weights for policy 1, policy_version 744420 (0.0008) [2023-12-28 00:35:23,885][106226] Updated weights for policy 0, policy_version 742460 (0.0008) [2023-12-28 00:35:23,943][106226] Updated weights for policy 0, policy_version 742470 (0.0008) [2023-12-28 00:35:24,007][106226] Updated weights for policy 0, policy_version 742480 (0.0009) [2023-12-28 00:35:24,201][106225] Updated weights for policy 1, policy_version 744430 (0.0007) [2023-12-28 00:35:24,266][106225] Updated weights for policy 1, policy_version 744440 (0.0008) [2023-12-28 00:35:24,336][106225] Updated weights for policy 1, policy_version 744450 (0.0008) [2023-12-28 00:35:24,649][106226] Updated weights for policy 0, policy_version 742490 (0.0009) [2023-12-28 00:35:24,701][106226] Updated weights for policy 0, policy_version 742500 (0.0007) [2023-12-28 00:35:24,766][106226] Updated weights for policy 0, policy_version 742510 (0.0008) [2023-12-28 00:35:24,829][106226] Updated weights for policy 0, policy_version 742520 (0.0008) [2023-12-28 00:35:24,941][106225] Updated weights for policy 1, policy_version 744460 (0.0008) [2023-12-28 00:35:24,996][106225] Updated weights for policy 1, policy_version 744470 (0.0006) [2023-12-28 00:35:25,054][106225] Updated weights for policy 1, policy_version 744480 (0.0007) [2023-12-28 00:35:25,602][106226] Updated weights for policy 0, policy_version 742530 (0.0007) [2023-12-28 00:35:25,671][106226] Updated weights for policy 0, policy_version 742540 (0.0006) [2023-12-28 00:35:25,719][106225] Updated weights for policy 1, policy_version 744490 (0.0007) [2023-12-28 00:35:25,733][106226] Updated weights for policy 0, policy_version 742550 (0.0006) [2023-12-28 00:35:25,769][106225] Updated weights for policy 1, policy_version 744500 (0.0009) [2023-12-28 00:35:25,819][106225] Updated weights for policy 1, policy_version 744510 (0.0007) [2023-12-28 00:35:25,875][106225] Updated weights for policy 1, policy_version 744520 (0.0005) [2023-12-28 00:35:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 380780544. Throughput: 0: 9901.2, 1: 9700.3. Samples: 380749188. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:26,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-5.757')] [2023-12-28 00:35:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000742552_190144512.pth... [2023-12-28 00:35:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000744520_190636032.pth... [2023-12-28 00:35:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000741400_189849600.pth [2023-12-28 00:35:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000743400_190349312.pth [2023-12-28 00:35:26,350][106226] Updated weights for policy 0, policy_version 742560 (0.0007) [2023-12-28 00:35:26,413][106226] Updated weights for policy 0, policy_version 742570 (0.0007) [2023-12-28 00:35:26,499][106226] Updated weights for policy 0, policy_version 742580 (0.0007) [2023-12-28 00:35:26,556][106225] Updated weights for policy 1, policy_version 744530 (0.0010) [2023-12-28 00:35:26,622][106225] Updated weights for policy 1, policy_version 744540 (0.0010) [2023-12-28 00:35:26,688][106225] Updated weights for policy 1, policy_version 744550 (0.0010) [2023-12-28 00:35:27,096][106226] Updated weights for policy 0, policy_version 742590 (0.0005) [2023-12-28 00:35:27,146][106226] Updated weights for policy 0, policy_version 742600 (0.0007) [2023-12-28 00:35:27,201][106226] Updated weights for policy 0, policy_version 742610 (0.0008) [2023-12-28 00:35:27,280][106225] Updated weights for policy 1, policy_version 744560 (0.0006) [2023-12-28 00:35:27,335][106225] Updated weights for policy 1, policy_version 744570 (0.0008) [2023-12-28 00:35:27,384][106225] Updated weights for policy 1, policy_version 744580 (0.0008) [2023-12-28 00:35:27,817][106226] Updated weights for policy 0, policy_version 742620 (0.0006) [2023-12-28 00:35:27,881][106226] Updated weights for policy 0, policy_version 742630 (0.0005) [2023-12-28 00:35:27,932][106226] Updated weights for policy 0, policy_version 742640 (0.0005) [2023-12-28 00:35:28,054][106225] Updated weights for policy 1, policy_version 744590 (0.0008) [2023-12-28 00:35:28,111][106225] Updated weights for policy 1, policy_version 744600 (0.0005) [2023-12-28 00:35:28,165][106225] Updated weights for policy 1, policy_version 744610 (0.0005) [2023-12-28 00:35:28,571][106226] Updated weights for policy 0, policy_version 742650 (0.0005) [2023-12-28 00:35:28,637][106226] Updated weights for policy 0, policy_version 742660 (0.0008) [2023-12-28 00:35:28,692][106226] Updated weights for policy 0, policy_version 742670 (0.0008) [2023-12-28 00:35:28,751][106226] Updated weights for policy 0, policy_version 742680 (0.0008) [2023-12-28 00:35:28,788][106225] Updated weights for policy 1, policy_version 744620 (0.0006) [2023-12-28 00:35:28,839][106225] Updated weights for policy 1, policy_version 744630 (0.0008) [2023-12-28 00:35:28,889][106225] Updated weights for policy 1, policy_version 744640 (0.0008) [2023-12-28 00:35:29,467][106226] Updated weights for policy 0, policy_version 742690 (0.0008) [2023-12-28 00:35:29,511][106226] Updated weights for policy 0, policy_version 742700 (0.0008) [2023-12-28 00:35:29,563][106226] Updated weights for policy 0, policy_version 742710 (0.0008) [2023-12-28 00:35:29,657][106225] Updated weights for policy 1, policy_version 744650 (0.0008) [2023-12-28 00:35:29,721][106225] Updated weights for policy 1, policy_version 744660 (0.0007) [2023-12-28 00:35:29,784][106225] Updated weights for policy 1, policy_version 744670 (0.0008) [2023-12-28 00:35:29,851][106225] Updated weights for policy 1, policy_version 744680 (0.0007) [2023-12-28 00:35:30,323][106226] Updated weights for policy 0, policy_version 742720 (0.0010) [2023-12-28 00:35:30,386][106226] Updated weights for policy 0, policy_version 742730 (0.0011) [2023-12-28 00:35:30,450][106226] Updated weights for policy 0, policy_version 742740 (0.0011) [2023-12-28 00:35:30,592][106225] Updated weights for policy 1, policy_version 744690 (0.0007) [2023-12-28 00:35:30,653][106225] Updated weights for policy 1, policy_version 744700 (0.0008) [2023-12-28 00:35:30,706][106225] Updated weights for policy 1, policy_version 744710 (0.0008) [2023-12-28 00:35:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 380878848. Throughput: 0: 9938.6, 1: 9766.9. Samples: 380873472. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:31,175][105115] Avg episode reward: [(0, '-3.981'), (1, '-5.657')] [2023-12-28 00:35:31,182][106226] Updated weights for policy 0, policy_version 742750 (0.0010) [2023-12-28 00:35:31,249][106226] Updated weights for policy 0, policy_version 742760 (0.0010) [2023-12-28 00:35:31,307][106226] Updated weights for policy 0, policy_version 742770 (0.0010) [2023-12-28 00:35:31,336][106140] Saving new best policy, reward=-3.981! [2023-12-28 00:35:31,462][106225] Updated weights for policy 1, policy_version 744720 (0.0008) [2023-12-28 00:35:31,523][106225] Updated weights for policy 1, policy_version 744730 (0.0007) [2023-12-28 00:35:31,575][106225] Updated weights for policy 1, policy_version 744740 (0.0009) [2023-12-28 00:35:31,975][106226] Updated weights for policy 0, policy_version 742780 (0.0010) [2023-12-28 00:35:32,029][106226] Updated weights for policy 0, policy_version 742790 (0.0008) [2023-12-28 00:35:32,091][106226] Updated weights for policy 0, policy_version 742800 (0.0009) [2023-12-28 00:35:32,343][106225] Updated weights for policy 1, policy_version 744750 (0.0008) [2023-12-28 00:35:32,410][106225] Updated weights for policy 1, policy_version 744760 (0.0008) [2023-12-28 00:35:32,474][106225] Updated weights for policy 1, policy_version 744770 (0.0009) [2023-12-28 00:35:32,759][106226] Updated weights for policy 0, policy_version 742810 (0.0008) [2023-12-28 00:35:32,821][106226] Updated weights for policy 0, policy_version 742820 (0.0009) [2023-12-28 00:35:32,888][106226] Updated weights for policy 0, policy_version 742830 (0.0009) [2023-12-28 00:35:32,944][106226] Updated weights for policy 0, policy_version 742840 (0.0008) [2023-12-28 00:35:33,208][106225] Updated weights for policy 1, policy_version 744780 (0.0008) [2023-12-28 00:35:33,259][106225] Updated weights for policy 1, policy_version 744790 (0.0008) [2023-12-28 00:35:33,317][106225] Updated weights for policy 1, policy_version 744800 (0.0008) [2023-12-28 00:35:33,653][106226] Updated weights for policy 0, policy_version 742850 (0.0009) [2023-12-28 00:35:33,702][106226] Updated weights for policy 0, policy_version 742860 (0.0008) [2023-12-28 00:35:33,746][106226] Updated weights for policy 0, policy_version 742870 (0.0007) [2023-12-28 00:35:34,043][106225] Updated weights for policy 1, policy_version 744810 (0.0009) [2023-12-28 00:35:34,123][106225] Updated weights for policy 1, policy_version 744820 (0.0010) [2023-12-28 00:35:34,188][106225] Updated weights for policy 1, policy_version 744830 (0.0007) [2023-12-28 00:35:34,250][106225] Updated weights for policy 1, policy_version 744840 (0.0008) [2023-12-28 00:35:34,491][106226] Updated weights for policy 0, policy_version 742880 (0.0009) [2023-12-28 00:35:34,554][106226] Updated weights for policy 0, policy_version 742890 (0.0007) [2023-12-28 00:35:34,616][106226] Updated weights for policy 0, policy_version 742900 (0.0007) [2023-12-28 00:35:34,964][106225] Updated weights for policy 1, policy_version 744850 (0.0008) [2023-12-28 00:35:35,020][106225] Updated weights for policy 1, policy_version 744860 (0.0009) [2023-12-28 00:35:35,075][106225] Updated weights for policy 1, policy_version 744870 (0.0007) [2023-12-28 00:35:35,297][106226] Updated weights for policy 0, policy_version 742910 (0.0006) [2023-12-28 00:35:35,348][106226] Updated weights for policy 0, policy_version 742920 (0.0005) [2023-12-28 00:35:35,408][106226] Updated weights for policy 0, policy_version 742930 (0.0008) [2023-12-28 00:35:35,696][106225] Updated weights for policy 1, policy_version 744880 (0.0006) [2023-12-28 00:35:35,754][106225] Updated weights for policy 1, policy_version 744890 (0.0005) [2023-12-28 00:35:35,802][106225] Updated weights for policy 1, policy_version 744900 (0.0007) [2023-12-28 00:35:36,166][106226] Updated weights for policy 0, policy_version 742940 (0.0008) [2023-12-28 00:35:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 380977152. Throughput: 0: 9955.8, 1: 9719.1. Samples: 380989932. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:36,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-5.452')] [2023-12-28 00:35:36,236][106226] Updated weights for policy 0, policy_version 742950 (0.0008) [2023-12-28 00:35:36,300][106226] Updated weights for policy 0, policy_version 742960 (0.0007) [2023-12-28 00:35:36,482][106225] Updated weights for policy 1, policy_version 744910 (0.0010) [2023-12-28 00:35:36,543][106225] Updated weights for policy 1, policy_version 744920 (0.0010) [2023-12-28 00:35:36,608][106225] Updated weights for policy 1, policy_version 744930 (0.0011) [2023-12-28 00:35:36,962][106226] Updated weights for policy 0, policy_version 742970 (0.0006) [2023-12-28 00:35:37,017][106226] Updated weights for policy 0, policy_version 742980 (0.0005) [2023-12-28 00:35:37,077][106226] Updated weights for policy 0, policy_version 742990 (0.0011) [2023-12-28 00:35:37,134][106226] Updated weights for policy 0, policy_version 743000 (0.0010) [2023-12-28 00:35:37,320][106225] Updated weights for policy 1, policy_version 744940 (0.0011) [2023-12-28 00:35:37,381][106225] Updated weights for policy 1, policy_version 744950 (0.0010) [2023-12-28 00:35:37,435][106225] Updated weights for policy 1, policy_version 744960 (0.0010) [2023-12-28 00:35:37,778][106226] Updated weights for policy 0, policy_version 743010 (0.0010) [2023-12-28 00:35:37,842][106226] Updated weights for policy 0, policy_version 743020 (0.0010) [2023-12-28 00:35:37,901][106226] Updated weights for policy 0, policy_version 743030 (0.0011) [2023-12-28 00:35:38,165][106225] Updated weights for policy 1, policy_version 744970 (0.0010) [2023-12-28 00:35:38,216][106225] Updated weights for policy 1, policy_version 744980 (0.0010) [2023-12-28 00:35:38,272][106225] Updated weights for policy 1, policy_version 744990 (0.0010) [2023-12-28 00:35:38,335][106225] Updated weights for policy 1, policy_version 745000 (0.0010) [2023-12-28 00:35:38,638][106226] Updated weights for policy 0, policy_version 743040 (0.0010) [2023-12-28 00:35:38,700][106226] Updated weights for policy 0, policy_version 743050 (0.0009) [2023-12-28 00:35:38,768][106226] Updated weights for policy 0, policy_version 743060 (0.0008) [2023-12-28 00:35:39,038][106225] Updated weights for policy 1, policy_version 745010 (0.0008) [2023-12-28 00:35:39,100][106225] Updated weights for policy 1, policy_version 745020 (0.0009) [2023-12-28 00:35:39,153][106225] Updated weights for policy 1, policy_version 745030 (0.0008) [2023-12-28 00:35:39,472][106226] Updated weights for policy 0, policy_version 743070 (0.0006) [2023-12-28 00:35:39,534][106226] Updated weights for policy 0, policy_version 743080 (0.0008) [2023-12-28 00:35:39,604][106226] Updated weights for policy 0, policy_version 743090 (0.0008) [2023-12-28 00:35:39,966][106225] Updated weights for policy 1, policy_version 745040 (0.0009) [2023-12-28 00:35:40,029][106225] Updated weights for policy 1, policy_version 745050 (0.0008) [2023-12-28 00:35:40,088][106225] Updated weights for policy 1, policy_version 745060 (0.0008) [2023-12-28 00:35:40,366][106226] Updated weights for policy 0, policy_version 743100 (0.0008) [2023-12-28 00:35:40,427][106226] Updated weights for policy 0, policy_version 743110 (0.0008) [2023-12-28 00:35:40,477][106226] Updated weights for policy 0, policy_version 743120 (0.0009) [2023-12-28 00:35:40,742][106225] Updated weights for policy 1, policy_version 745070 (0.0009) [2023-12-28 00:35:40,788][106225] Updated weights for policy 1, policy_version 745080 (0.0008) [2023-12-28 00:35:40,848][106225] Updated weights for policy 1, policy_version 745090 (0.0008) [2023-12-28 00:35:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 381075456. Throughput: 0: 9990.9, 1: 9736.8. Samples: 381048956. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:41,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-5.251')] [2023-12-28 00:35:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000743128_190291968.pth... [2023-12-28 00:35:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000745096_190783488.pth... [2023-12-28 00:35:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000741976_189997056.pth [2023-12-28 00:35:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000743944_190488576.pth [2023-12-28 00:35:41,243][106226] Updated weights for policy 0, policy_version 743130 (0.0009) [2023-12-28 00:35:41,299][106226] Updated weights for policy 0, policy_version 743140 (0.0008) [2023-12-28 00:35:41,366][106226] Updated weights for policy 0, policy_version 743150 (0.0008) [2023-12-28 00:35:41,440][106226] Updated weights for policy 0, policy_version 743160 (0.0008) [2023-12-28 00:35:41,630][106225] Updated weights for policy 1, policy_version 745100 (0.0009) [2023-12-28 00:35:41,698][106225] Updated weights for policy 1, policy_version 745110 (0.0008) [2023-12-28 00:35:41,770][106225] Updated weights for policy 1, policy_version 745120 (0.0008) [2023-12-28 00:35:42,187][106226] Updated weights for policy 0, policy_version 743170 (0.0010) [2023-12-28 00:35:42,236][106226] Updated weights for policy 0, policy_version 743180 (0.0007) [2023-12-28 00:35:42,294][106226] Updated weights for policy 0, policy_version 743190 (0.0008) [2023-12-28 00:35:42,473][106225] Updated weights for policy 1, policy_version 745130 (0.0007) [2023-12-28 00:35:42,539][106225] Updated weights for policy 1, policy_version 745140 (0.0008) [2023-12-28 00:35:42,600][106225] Updated weights for policy 1, policy_version 745150 (0.0005) [2023-12-28 00:35:42,658][106225] Updated weights for policy 1, policy_version 745160 (0.0005) [2023-12-28 00:35:43,038][106226] Updated weights for policy 0, policy_version 743200 (0.0008) [2023-12-28 00:35:43,086][106226] Updated weights for policy 0, policy_version 743210 (0.0008) [2023-12-28 00:35:43,136][106226] Updated weights for policy 0, policy_version 743220 (0.0007) [2023-12-28 00:35:43,299][106225] Updated weights for policy 1, policy_version 745170 (0.0010) [2023-12-28 00:35:43,353][106225] Updated weights for policy 1, policy_version 745180 (0.0010) [2023-12-28 00:35:43,411][106225] Updated weights for policy 1, policy_version 745190 (0.0006) [2023-12-28 00:35:43,889][106226] Updated weights for policy 0, policy_version 743230 (0.0006) [2023-12-28 00:35:43,946][106226] Updated weights for policy 0, policy_version 743240 (0.0005) [2023-12-28 00:35:43,982][106225] Updated weights for policy 1, policy_version 745200 (0.0007) [2023-12-28 00:35:44,009][106226] Updated weights for policy 0, policy_version 743250 (0.0007) [2023-12-28 00:35:44,047][106225] Updated weights for policy 1, policy_version 745210 (0.0006) [2023-12-28 00:35:44,115][106225] Updated weights for policy 1, policy_version 745220 (0.0005) [2023-12-28 00:35:44,604][106226] Updated weights for policy 0, policy_version 743260 (0.0007) [2023-12-28 00:35:44,644][106225] Updated weights for policy 1, policy_version 745230 (0.0008) [2023-12-28 00:35:44,653][106226] Updated weights for policy 0, policy_version 743270 (0.0005) [2023-12-28 00:35:44,694][106225] Updated weights for policy 1, policy_version 745240 (0.0010) [2023-12-28 00:35:44,702][106226] Updated weights for policy 0, policy_version 743280 (0.0005) [2023-12-28 00:35:44,755][106225] Updated weights for policy 1, policy_version 745250 (0.0010) [2023-12-28 00:35:45,390][106225] Updated weights for policy 1, policy_version 745260 (0.0010) [2023-12-28 00:35:45,453][106225] Updated weights for policy 1, policy_version 745270 (0.0008) [2023-12-28 00:35:45,463][106226] Updated weights for policy 0, policy_version 743290 (0.0006) [2023-12-28 00:35:45,512][106225] Updated weights for policy 1, policy_version 745280 (0.0008) [2023-12-28 00:35:45,518][106226] Updated weights for policy 0, policy_version 743300 (0.0005) [2023-12-28 00:35:45,576][106226] Updated weights for policy 0, policy_version 743310 (0.0006) [2023-12-28 00:35:45,630][106226] Updated weights for policy 0, policy_version 743320 (0.0009) [2023-12-28 00:35:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 381173760. Throughput: 0: 9902.5, 1: 9854.5. Samples: 381166240. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:46,176][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.323')] [2023-12-28 00:35:46,200][106225] Updated weights for policy 1, policy_version 745290 (0.0007) [2023-12-28 00:35:46,263][106225] Updated weights for policy 1, policy_version 745300 (0.0010) [2023-12-28 00:35:46,303][106226] Updated weights for policy 0, policy_version 743330 (0.0007) [2023-12-28 00:35:46,326][106225] Updated weights for policy 1, policy_version 745310 (0.0010) [2023-12-28 00:35:46,366][106226] Updated weights for policy 0, policy_version 743340 (0.0008) [2023-12-28 00:35:46,379][106225] Updated weights for policy 1, policy_version 745320 (0.0006) [2023-12-28 00:35:46,429][106226] Updated weights for policy 0, policy_version 743350 (0.0009) [2023-12-28 00:35:46,962][106225] Updated weights for policy 1, policy_version 745330 (0.0006) [2023-12-28 00:35:47,016][106225] Updated weights for policy 1, policy_version 745340 (0.0009) [2023-12-28 00:35:47,074][106225] Updated weights for policy 1, policy_version 745350 (0.0010) [2023-12-28 00:35:47,106][106226] Updated weights for policy 0, policy_version 743360 (0.0010) [2023-12-28 00:35:47,158][106226] Updated weights for policy 0, policy_version 743370 (0.0010) [2023-12-28 00:35:47,210][106226] Updated weights for policy 0, policy_version 743380 (0.0010) [2023-12-28 00:35:47,732][106225] Updated weights for policy 1, policy_version 745360 (0.0006) [2023-12-28 00:35:47,787][106225] Updated weights for policy 1, policy_version 745370 (0.0005) [2023-12-28 00:35:47,843][106225] Updated weights for policy 1, policy_version 745380 (0.0005) [2023-12-28 00:35:47,927][106226] Updated weights for policy 0, policy_version 743390 (0.0010) [2023-12-28 00:35:47,984][106226] Updated weights for policy 0, policy_version 743400 (0.0010) [2023-12-28 00:35:48,048][106226] Updated weights for policy 0, policy_version 743410 (0.0007) [2023-12-28 00:35:48,474][106225] Updated weights for policy 1, policy_version 745390 (0.0006) [2023-12-28 00:35:48,525][106225] Updated weights for policy 1, policy_version 745400 (0.0005) [2023-12-28 00:35:48,584][106225] Updated weights for policy 1, policy_version 745410 (0.0010) [2023-12-28 00:35:48,786][106226] Updated weights for policy 0, policy_version 743420 (0.0009) [2023-12-28 00:35:48,845][106226] Updated weights for policy 0, policy_version 743430 (0.0009) [2023-12-28 00:35:48,900][106226] Updated weights for policy 0, policy_version 743440 (0.0010) [2023-12-28 00:35:49,250][106225] Updated weights for policy 1, policy_version 745420 (0.0010) [2023-12-28 00:35:49,317][106225] Updated weights for policy 1, policy_version 745430 (0.0010) [2023-12-28 00:35:49,392][106225] Updated weights for policy 1, policy_version 745440 (0.0010) [2023-12-28 00:35:49,692][106226] Updated weights for policy 0, policy_version 743450 (0.0009) [2023-12-28 00:35:49,747][106226] Updated weights for policy 0, policy_version 743460 (0.0006) [2023-12-28 00:35:49,807][106226] Updated weights for policy 0, policy_version 743470 (0.0005) [2023-12-28 00:35:49,882][106226] Updated weights for policy 0, policy_version 743480 (0.0008) [2023-12-28 00:35:50,100][106225] Updated weights for policy 1, policy_version 745450 (0.0011) [2023-12-28 00:35:50,165][106225] Updated weights for policy 1, policy_version 745460 (0.0011) [2023-12-28 00:35:50,230][106225] Updated weights for policy 1, policy_version 745470 (0.0010) [2023-12-28 00:35:50,294][106225] Updated weights for policy 1, policy_version 745480 (0.0009) [2023-12-28 00:35:50,567][106226] Updated weights for policy 0, policy_version 743490 (0.0007) [2023-12-28 00:35:50,631][106226] Updated weights for policy 0, policy_version 743500 (0.0008) [2023-12-28 00:35:50,690][106226] Updated weights for policy 0, policy_version 743510 (0.0008) [2023-12-28 00:35:51,012][106225] Updated weights for policy 1, policy_version 745490 (0.0010) [2023-12-28 00:35:51,074][106225] Updated weights for policy 1, policy_version 745500 (0.0011) [2023-12-28 00:35:51,142][106225] Updated weights for policy 1, policy_version 745510 (0.0011) [2023-12-28 00:35:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.9, 300 sec: 19716.4). Total num frames: 381280256. Throughput: 0: 9843.4, 1: 9888.6. Samples: 381285352. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:51,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-5.100')] [2023-12-28 00:35:51,502][106226] Updated weights for policy 0, policy_version 743520 (0.0008) [2023-12-28 00:35:51,568][106226] Updated weights for policy 0, policy_version 743530 (0.0008) [2023-12-28 00:35:51,645][106226] Updated weights for policy 0, policy_version 743540 (0.0008) [2023-12-28 00:35:51,942][106225] Updated weights for policy 1, policy_version 745520 (0.0009) [2023-12-28 00:35:52,003][106225] Updated weights for policy 1, policy_version 745530 (0.0011) [2023-12-28 00:35:52,057][106225] Updated weights for policy 1, policy_version 745540 (0.0010) [2023-12-28 00:35:52,400][106226] Updated weights for policy 0, policy_version 743550 (0.0008) [2023-12-28 00:35:52,466][106226] Updated weights for policy 0, policy_version 743560 (0.0008) [2023-12-28 00:35:52,525][106226] Updated weights for policy 0, policy_version 743570 (0.0008) [2023-12-28 00:35:52,758][106225] Updated weights for policy 1, policy_version 745550 (0.0008) [2023-12-28 00:35:52,822][106225] Updated weights for policy 1, policy_version 745560 (0.0006) [2023-12-28 00:35:52,876][106225] Updated weights for policy 1, policy_version 745570 (0.0007) [2023-12-28 00:35:53,286][106226] Updated weights for policy 0, policy_version 743580 (0.0008) [2023-12-28 00:35:53,329][106226] Updated weights for policy 0, policy_version 743590 (0.0007) [2023-12-28 00:35:53,377][106226] Updated weights for policy 0, policy_version 743600 (0.0008) [2023-12-28 00:35:53,564][106225] Updated weights for policy 1, policy_version 745580 (0.0008) [2023-12-28 00:35:53,628][106225] Updated weights for policy 1, policy_version 745590 (0.0008) [2023-12-28 00:35:53,681][106225] Updated weights for policy 1, policy_version 745600 (0.0010) [2023-12-28 00:35:54,095][106226] Updated weights for policy 0, policy_version 743610 (0.0007) [2023-12-28 00:35:54,143][106226] Updated weights for policy 0, policy_version 743620 (0.0006) [2023-12-28 00:35:54,188][106226] Updated weights for policy 0, policy_version 743630 (0.0008) [2023-12-28 00:35:54,237][106226] Updated weights for policy 0, policy_version 743640 (0.0008) [2023-12-28 00:35:54,259][106225] Updated weights for policy 1, policy_version 745610 (0.0010) [2023-12-28 00:35:54,320][106225] Updated weights for policy 1, policy_version 745620 (0.0010) [2023-12-28 00:35:54,381][106225] Updated weights for policy 1, policy_version 745630 (0.0010) [2023-12-28 00:35:54,436][106225] Updated weights for policy 1, policy_version 745640 (0.0006) [2023-12-28 00:35:54,988][106226] Updated weights for policy 0, policy_version 743650 (0.0008) [2023-12-28 00:35:55,042][106225] Updated weights for policy 1, policy_version 745650 (0.0009) [2023-12-28 00:35:55,056][106226] Updated weights for policy 0, policy_version 743660 (0.0009) [2023-12-28 00:35:55,097][106225] Updated weights for policy 1, policy_version 745660 (0.0010) [2023-12-28 00:35:55,115][106226] Updated weights for policy 0, policy_version 743670 (0.0007) [2023-12-28 00:35:55,148][106225] Updated weights for policy 1, policy_version 745670 (0.0010) [2023-12-28 00:35:55,689][106226] Updated weights for policy 0, policy_version 743680 (0.0009) [2023-12-28 00:35:55,735][106226] Updated weights for policy 0, policy_version 743690 (0.0010) [2023-12-28 00:35:55,791][106226] Updated weights for policy 0, policy_version 743700 (0.0010) [2023-12-28 00:35:55,840][106225] Updated weights for policy 1, policy_version 745680 (0.0010) [2023-12-28 00:35:55,887][106225] Updated weights for policy 1, policy_version 745690 (0.0010) [2023-12-28 00:35:55,937][106225] Updated weights for policy 1, policy_version 745700 (0.0010) [2023-12-28 00:35:56,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 381378560. Throughput: 0: 9782.1, 1: 9895.6. Samples: 381342744. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:35:56,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-5.314')] [2023-12-28 00:35:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000743704_190439424.pth... [2023-12-28 00:35:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000745704_190939136.pth... [2023-12-28 00:35:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000742552_190144512.pth [2023-12-28 00:35:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000744520_190636032.pth [2023-12-28 00:35:56,554][106226] Updated weights for policy 0, policy_version 743710 (0.0011) [2023-12-28 00:35:56,617][106226] Updated weights for policy 0, policy_version 743720 (0.0011) [2023-12-28 00:35:56,677][106226] Updated weights for policy 0, policy_version 743730 (0.0010) [2023-12-28 00:35:56,680][106225] Updated weights for policy 1, policy_version 745710 (0.0010) [2023-12-28 00:35:56,734][106225] Updated weights for policy 1, policy_version 745720 (0.0010) [2023-12-28 00:35:56,798][106225] Updated weights for policy 1, policy_version 745730 (0.0010) [2023-12-28 00:35:57,332][106226] Updated weights for policy 0, policy_version 743740 (0.0010) [2023-12-28 00:35:57,382][106226] Updated weights for policy 0, policy_version 743750 (0.0008) [2023-12-28 00:35:57,430][106226] Updated weights for policy 0, policy_version 743760 (0.0007) [2023-12-28 00:35:57,510][106225] Updated weights for policy 1, policy_version 745740 (0.0010) [2023-12-28 00:35:57,566][106225] Updated weights for policy 1, policy_version 745750 (0.0010) [2023-12-28 00:35:57,626][106225] Updated weights for policy 1, policy_version 745760 (0.0010) [2023-12-28 00:35:58,148][106226] Updated weights for policy 0, policy_version 743770 (0.0008) [2023-12-28 00:35:58,211][106226] Updated weights for policy 0, policy_version 743780 (0.0008) [2023-12-28 00:35:58,272][106226] Updated weights for policy 0, policy_version 743790 (0.0007) [2023-12-28 00:35:58,326][106226] Updated weights for policy 0, policy_version 743800 (0.0008) [2023-12-28 00:35:58,345][106225] Updated weights for policy 1, policy_version 745770 (0.0010) [2023-12-28 00:35:58,413][106225] Updated weights for policy 1, policy_version 745780 (0.0010) [2023-12-28 00:35:58,483][106225] Updated weights for policy 1, policy_version 745790 (0.0007) [2023-12-28 00:35:58,545][106225] Updated weights for policy 1, policy_version 745800 (0.0011) [2023-12-28 00:35:59,100][106226] Updated weights for policy 0, policy_version 743810 (0.0009) [2023-12-28 00:35:59,162][106226] Updated weights for policy 0, policy_version 743820 (0.0008) [2023-12-28 00:35:59,231][106226] Updated weights for policy 0, policy_version 743830 (0.0009) [2023-12-28 00:35:59,318][106225] Updated weights for policy 1, policy_version 745810 (0.0009) [2023-12-28 00:35:59,382][106225] Updated weights for policy 1, policy_version 745820 (0.0010) [2023-12-28 00:35:59,432][106225] Updated weights for policy 1, policy_version 745830 (0.0010) [2023-12-28 00:36:00,017][106226] Updated weights for policy 0, policy_version 743840 (0.0008) [2023-12-28 00:36:00,080][106226] Updated weights for policy 0, policy_version 743850 (0.0006) [2023-12-28 00:36:00,140][106226] Updated weights for policy 0, policy_version 743860 (0.0006) [2023-12-28 00:36:00,190][106225] Updated weights for policy 1, policy_version 745840 (0.0008) [2023-12-28 00:36:00,249][106225] Updated weights for policy 1, policy_version 745850 (0.0006) [2023-12-28 00:36:00,295][106225] Updated weights for policy 1, policy_version 745860 (0.0010) [2023-12-28 00:36:00,781][106226] Updated weights for policy 0, policy_version 743870 (0.0006) [2023-12-28 00:36:00,837][106226] Updated weights for policy 0, policy_version 743880 (0.0005) [2023-12-28 00:36:00,895][106226] Updated weights for policy 0, policy_version 743890 (0.0005) [2023-12-28 00:36:01,037][106225] Updated weights for policy 1, policy_version 745870 (0.0010) [2023-12-28 00:36:01,102][106225] Updated weights for policy 1, policy_version 745880 (0.0009) [2023-12-28 00:36:01,174][106225] Updated weights for policy 1, policy_version 745890 (0.0008) [2023-12-28 00:36:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 381468672. Throughput: 0: 9780.7, 1: 9931.7. Samples: 381460376. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:01,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-5.764')] [2023-12-28 00:36:01,538][106226] Updated weights for policy 0, policy_version 743900 (0.0005) [2023-12-28 00:36:01,597][106226] Updated weights for policy 0, policy_version 743910 (0.0010) [2023-12-28 00:36:01,666][106226] Updated weights for policy 0, policy_version 743920 (0.0011) [2023-12-28 00:36:01,929][106225] Updated weights for policy 1, policy_version 745900 (0.0008) [2023-12-28 00:36:01,986][106225] Updated weights for policy 1, policy_version 745910 (0.0006) [2023-12-28 00:36:02,048][106225] Updated weights for policy 1, policy_version 745920 (0.0005) [2023-12-28 00:36:02,278][106226] Updated weights for policy 0, policy_version 743930 (0.0010) [2023-12-28 00:36:02,335][106226] Updated weights for policy 0, policy_version 743940 (0.0008) [2023-12-28 00:36:02,401][106226] Updated weights for policy 0, policy_version 743950 (0.0011) [2023-12-28 00:36:02,458][106226] Updated weights for policy 0, policy_version 743960 (0.0010) [2023-12-28 00:36:02,652][106225] Updated weights for policy 1, policy_version 745930 (0.0007) [2023-12-28 00:36:02,707][106225] Updated weights for policy 1, policy_version 745940 (0.0008) [2023-12-28 00:36:02,762][106225] Updated weights for policy 1, policy_version 745950 (0.0008) [2023-12-28 00:36:02,816][106225] Updated weights for policy 1, policy_version 745960 (0.0007) [2023-12-28 00:36:03,135][106226] Updated weights for policy 0, policy_version 743970 (0.0008) [2023-12-28 00:36:03,182][106226] Updated weights for policy 0, policy_version 743980 (0.0008) [2023-12-28 00:36:03,234][106226] Updated weights for policy 0, policy_version 743990 (0.0008) [2023-12-28 00:36:03,587][106225] Updated weights for policy 1, policy_version 745970 (0.0008) [2023-12-28 00:36:03,648][106225] Updated weights for policy 1, policy_version 745980 (0.0009) [2023-12-28 00:36:03,697][106225] Updated weights for policy 1, policy_version 745990 (0.0008) [2023-12-28 00:36:03,892][106226] Updated weights for policy 0, policy_version 744000 (0.0009) [2023-12-28 00:36:03,955][106226] Updated weights for policy 0, policy_version 744010 (0.0007) [2023-12-28 00:36:04,019][106226] Updated weights for policy 0, policy_version 744020 (0.0009) [2023-12-28 00:36:04,466][106225] Updated weights for policy 1, policy_version 746000 (0.0009) [2023-12-28 00:36:04,530][106225] Updated weights for policy 1, policy_version 746010 (0.0008) [2023-12-28 00:36:04,585][106225] Updated weights for policy 1, policy_version 746020 (0.0009) [2023-12-28 00:36:04,716][106226] Updated weights for policy 0, policy_version 744030 (0.0008) [2023-12-28 00:36:04,774][106226] Updated weights for policy 0, policy_version 744040 (0.0007) [2023-12-28 00:36:04,835][106226] Updated weights for policy 0, policy_version 744050 (0.0005) [2023-12-28 00:36:05,316][106225] Updated weights for policy 1, policy_version 746030 (0.0010) [2023-12-28 00:36:05,367][106225] Updated weights for policy 1, policy_version 746040 (0.0010) [2023-12-28 00:36:05,396][106226] Updated weights for policy 0, policy_version 744060 (0.0005) [2023-12-28 00:36:05,431][106225] Updated weights for policy 1, policy_version 746050 (0.0011) [2023-12-28 00:36:05,452][106226] Updated weights for policy 0, policy_version 744070 (0.0006) [2023-12-28 00:36:05,501][106226] Updated weights for policy 0, policy_version 744080 (0.0008) [2023-12-28 00:36:06,118][106226] Updated weights for policy 0, policy_version 744090 (0.0008) [2023-12-28 00:36:06,130][106225] Updated weights for policy 1, policy_version 746060 (0.0009) [2023-12-28 00:36:06,174][106226] Updated weights for policy 0, policy_version 744100 (0.0006) [2023-12-28 00:36:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 381566976. Throughput: 0: 9876.2, 1: 9896.4. Samples: 381582276. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:06,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.337')] [2023-12-28 00:36:06,198][106225] Updated weights for policy 1, policy_version 746070 (0.0009) [2023-12-28 00:36:06,231][106226] Updated weights for policy 0, policy_version 744110 (0.0007) [2023-12-28 00:36:06,264][106225] Updated weights for policy 1, policy_version 746080 (0.0011) [2023-12-28 00:36:06,294][106226] Updated weights for policy 0, policy_version 744120 (0.0006) [2023-12-28 00:36:06,916][106225] Updated weights for policy 1, policy_version 746090 (0.0008) [2023-12-28 00:36:06,978][106225] Updated weights for policy 1, policy_version 746100 (0.0011) [2023-12-28 00:36:07,000][106226] Updated weights for policy 0, policy_version 744130 (0.0006) [2023-12-28 00:36:07,039][106225] Updated weights for policy 1, policy_version 746110 (0.0010) [2023-12-28 00:36:07,061][106226] Updated weights for policy 0, policy_version 744140 (0.0006) [2023-12-28 00:36:07,095][106225] Updated weights for policy 1, policy_version 746120 (0.0010) [2023-12-28 00:36:07,118][106226] Updated weights for policy 0, policy_version 744150 (0.0007) [2023-12-28 00:36:07,811][106225] Updated weights for policy 1, policy_version 746130 (0.0010) [2023-12-28 00:36:07,856][106226] Updated weights for policy 0, policy_version 744160 (0.0008) [2023-12-28 00:36:07,871][106225] Updated weights for policy 1, policy_version 746140 (0.0010) [2023-12-28 00:36:07,908][106226] Updated weights for policy 0, policy_version 744170 (0.0006) [2023-12-28 00:36:07,925][106225] Updated weights for policy 1, policy_version 746150 (0.0009) [2023-12-28 00:36:07,965][106226] Updated weights for policy 0, policy_version 744180 (0.0005) [2023-12-28 00:36:08,583][106225] Updated weights for policy 1, policy_version 746160 (0.0009) [2023-12-28 00:36:08,642][106225] Updated weights for policy 1, policy_version 746170 (0.0008) [2023-12-28 00:36:08,668][106226] Updated weights for policy 0, policy_version 744190 (0.0007) [2023-12-28 00:36:08,695][106225] Updated weights for policy 1, policy_version 746180 (0.0006) [2023-12-28 00:36:08,728][106226] Updated weights for policy 0, policy_version 744200 (0.0008) [2023-12-28 00:36:08,790][106226] Updated weights for policy 0, policy_version 744210 (0.0008) [2023-12-28 00:36:09,466][106225] Updated weights for policy 1, policy_version 746190 (0.0009) [2023-12-28 00:36:09,530][106225] Updated weights for policy 1, policy_version 746200 (0.0009) [2023-12-28 00:36:09,552][106226] Updated weights for policy 0, policy_version 744220 (0.0008) [2023-12-28 00:36:09,587][106225] Updated weights for policy 1, policy_version 746210 (0.0007) [2023-12-28 00:36:09,610][106226] Updated weights for policy 0, policy_version 744230 (0.0007) [2023-12-28 00:36:09,673][106226] Updated weights for policy 0, policy_version 744240 (0.0008) [2023-12-28 00:36:10,363][106225] Updated weights for policy 1, policy_version 746220 (0.0008) [2023-12-28 00:36:10,427][106225] Updated weights for policy 1, policy_version 746230 (0.0008) [2023-12-28 00:36:10,438][106226] Updated weights for policy 0, policy_version 744250 (0.0009) [2023-12-28 00:36:10,485][106225] Updated weights for policy 1, policy_version 746240 (0.0007) [2023-12-28 00:36:10,498][106226] Updated weights for policy 0, policy_version 744260 (0.0008) [2023-12-28 00:36:10,553][106226] Updated weights for policy 0, policy_version 744270 (0.0007) [2023-12-28 00:36:10,612][106226] Updated weights for policy 0, policy_version 744280 (0.0009) [2023-12-28 00:36:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 381665280. Throughput: 0: 9853.2, 1: 9965.4. Samples: 381641020. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:11,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-5.263')] [2023-12-28 00:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000744280_190586880.pth... [2023-12-28 00:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000746248_191078400.pth... [2023-12-28 00:36:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000743128_190291968.pth [2023-12-28 00:36:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000745096_190783488.pth [2023-12-28 00:36:11,242][106225] Updated weights for policy 1, policy_version 746250 (0.0006) [2023-12-28 00:36:11,264][106226] Updated weights for policy 0, policy_version 744290 (0.0007) [2023-12-28 00:36:11,310][106225] Updated weights for policy 1, policy_version 746260 (0.0006) [2023-12-28 00:36:11,327][106226] Updated weights for policy 0, policy_version 744300 (0.0009) [2023-12-28 00:36:11,375][106225] Updated weights for policy 1, policy_version 746270 (0.0008) [2023-12-28 00:36:11,399][106226] Updated weights for policy 0, policy_version 744310 (0.0009) [2023-12-28 00:36:11,444][106225] Updated weights for policy 1, policy_version 746280 (0.0008) [2023-12-28 00:36:12,065][106226] Updated weights for policy 0, policy_version 744320 (0.0005) [2023-12-28 00:36:12,131][106226] Updated weights for policy 0, policy_version 744330 (0.0007) [2023-12-28 00:36:12,186][106226] Updated weights for policy 0, policy_version 744340 (0.0007) [2023-12-28 00:36:12,201][106225] Updated weights for policy 1, policy_version 746290 (0.0006) [2023-12-28 00:36:12,259][106225] Updated weights for policy 1, policy_version 746300 (0.0007) [2023-12-28 00:36:12,324][106225] Updated weights for policy 1, policy_version 746310 (0.0007) [2023-12-28 00:36:12,917][106226] Updated weights for policy 0, policy_version 744350 (0.0008) [2023-12-28 00:36:12,976][106226] Updated weights for policy 0, policy_version 744360 (0.0008) [2023-12-28 00:36:13,014][106225] Updated weights for policy 1, policy_version 746320 (0.0007) [2023-12-28 00:36:13,035][106226] Updated weights for policy 0, policy_version 744370 (0.0008) [2023-12-28 00:36:13,076][106225] Updated weights for policy 1, policy_version 746330 (0.0008) [2023-12-28 00:36:13,133][106225] Updated weights for policy 1, policy_version 746340 (0.0006) [2023-12-28 00:36:13,762][106226] Updated weights for policy 0, policy_version 744380 (0.0007) [2023-12-28 00:36:13,823][106226] Updated weights for policy 0, policy_version 744390 (0.0008) [2023-12-28 00:36:13,853][106225] Updated weights for policy 1, policy_version 746350 (0.0008) [2023-12-28 00:36:13,884][106226] Updated weights for policy 0, policy_version 744400 (0.0006) [2023-12-28 00:36:13,917][106225] Updated weights for policy 1, policy_version 746360 (0.0008) [2023-12-28 00:36:13,977][106225] Updated weights for policy 1, policy_version 746370 (0.0008) [2023-12-28 00:36:14,499][106226] Updated weights for policy 0, policy_version 744410 (0.0007) [2023-12-28 00:36:14,553][106226] Updated weights for policy 0, policy_version 744420 (0.0009) [2023-12-28 00:36:14,602][106226] Updated weights for policy 0, policy_version 744430 (0.0007) [2023-12-28 00:36:14,655][106226] Updated weights for policy 0, policy_version 744440 (0.0008) [2023-12-28 00:36:14,716][106225] Updated weights for policy 1, policy_version 746380 (0.0008) [2023-12-28 00:36:14,786][106225] Updated weights for policy 1, policy_version 746390 (0.0008) [2023-12-28 00:36:14,848][106225] Updated weights for policy 1, policy_version 746400 (0.0008) [2023-12-28 00:36:15,430][106226] Updated weights for policy 0, policy_version 744450 (0.0007) [2023-12-28 00:36:15,485][106226] Updated weights for policy 0, policy_version 744460 (0.0008) [2023-12-28 00:36:15,543][106226] Updated weights for policy 0, policy_version 744470 (0.0009) [2023-12-28 00:36:15,593][106225] Updated weights for policy 1, policy_version 746410 (0.0009) [2023-12-28 00:36:15,647][106225] Updated weights for policy 1, policy_version 746420 (0.0010) [2023-12-28 00:36:15,705][106225] Updated weights for policy 1, policy_version 746430 (0.0009) [2023-12-28 00:36:15,770][106225] Updated weights for policy 1, policy_version 746440 (0.0007) [2023-12-28 00:36:16,142][106226] Updated weights for policy 0, policy_version 744480 (0.0010) [2023-12-28 00:36:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 381763584. Throughput: 0: 9776.7, 1: 9830.7. Samples: 381755808. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:16,176][105115] Avg episode reward: [(0, '-4.213'), (1, '-5.271')] [2023-12-28 00:36:16,193][106226] Updated weights for policy 0, policy_version 744490 (0.0009) [2023-12-28 00:36:16,245][106226] Updated weights for policy 0, policy_version 744500 (0.0005) [2023-12-28 00:36:16,485][106225] Updated weights for policy 1, policy_version 746450 (0.0007) [2023-12-28 00:36:16,536][106225] Updated weights for policy 1, policy_version 746460 (0.0010) [2023-12-28 00:36:16,583][106225] Updated weights for policy 1, policy_version 746470 (0.0007) [2023-12-28 00:36:16,892][106226] Updated weights for policy 0, policy_version 744510 (0.0007) [2023-12-28 00:36:16,955][106226] Updated weights for policy 0, policy_version 744520 (0.0005) [2023-12-28 00:36:17,019][106226] Updated weights for policy 0, policy_version 744530 (0.0009) [2023-12-28 00:36:17,181][106225] Updated weights for policy 1, policy_version 746480 (0.0009) [2023-12-28 00:36:17,244][106225] Updated weights for policy 1, policy_version 746490 (0.0010) [2023-12-28 00:36:17,291][106225] Updated weights for policy 1, policy_version 746500 (0.0010) [2023-12-28 00:36:17,654][106226] Updated weights for policy 0, policy_version 744540 (0.0009) [2023-12-28 00:36:17,720][106226] Updated weights for policy 0, policy_version 744550 (0.0009) [2023-12-28 00:36:17,768][106226] Updated weights for policy 0, policy_version 744560 (0.0008) [2023-12-28 00:36:17,930][106225] Updated weights for policy 1, policy_version 746510 (0.0010) [2023-12-28 00:36:17,981][106225] Updated weights for policy 1, policy_version 746520 (0.0008) [2023-12-28 00:36:18,041][106225] Updated weights for policy 1, policy_version 746530 (0.0007) [2023-12-28 00:36:18,468][106226] Updated weights for policy 0, policy_version 744570 (0.0008) [2023-12-28 00:36:18,525][106226] Updated weights for policy 0, policy_version 744580 (0.0010) [2023-12-28 00:36:18,581][106226] Updated weights for policy 0, policy_version 744590 (0.0009) [2023-12-28 00:36:18,642][106226] Updated weights for policy 0, policy_version 744600 (0.0006) [2023-12-28 00:36:18,777][106225] Updated weights for policy 1, policy_version 746540 (0.0010) [2023-12-28 00:36:18,842][106225] Updated weights for policy 1, policy_version 746550 (0.0011) [2023-12-28 00:36:18,896][106225] Updated weights for policy 1, policy_version 746560 (0.0010) [2023-12-28 00:36:19,314][106226] Updated weights for policy 0, policy_version 744610 (0.0008) [2023-12-28 00:36:19,382][106226] Updated weights for policy 0, policy_version 744620 (0.0007) [2023-12-28 00:36:19,444][106226] Updated weights for policy 0, policy_version 744630 (0.0008) [2023-12-28 00:36:19,636][106225] Updated weights for policy 1, policy_version 746570 (0.0010) [2023-12-28 00:36:19,700][106225] Updated weights for policy 1, policy_version 746580 (0.0011) [2023-12-28 00:36:19,762][106225] Updated weights for policy 1, policy_version 746590 (0.0011) [2023-12-28 00:36:19,828][106225] Updated weights for policy 1, policy_version 746600 (0.0010) [2023-12-28 00:36:20,177][106226] Updated weights for policy 0, policy_version 744640 (0.0010) [2023-12-28 00:36:20,231][106226] Updated weights for policy 0, policy_version 744650 (0.0011) [2023-12-28 00:36:20,286][106226] Updated weights for policy 0, policy_version 744660 (0.0011) [2023-12-28 00:36:20,580][106225] Updated weights for policy 1, policy_version 746611 (0.0010) [2023-12-28 00:36:20,646][106225] Updated weights for policy 1, policy_version 746621 (0.0007) [2023-12-28 00:36:20,715][106225] Updated weights for policy 1, policy_version 746631 (0.0006) [2023-12-28 00:36:21,018][106226] Updated weights for policy 0, policy_version 744670 (0.0008) [2023-12-28 00:36:21,091][106226] Updated weights for policy 0, policy_version 744680 (0.0008) [2023-12-28 00:36:21,152][106226] Updated weights for policy 0, policy_version 744690 (0.0007) [2023-12-28 00:36:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 381861888. Throughput: 0: 9830.3, 1: 9853.7. Samples: 381875712. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:21,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.311')] [2023-12-28 00:36:21,504][106225] Updated weights for policy 1, policy_version 746641 (0.0007) [2023-12-28 00:36:21,572][106225] Updated weights for policy 1, policy_version 746651 (0.0007) [2023-12-28 00:36:21,643][106225] Updated weights for policy 1, policy_version 746661 (0.0009) [2023-12-28 00:36:21,905][106226] Updated weights for policy 0, policy_version 744700 (0.0007) [2023-12-28 00:36:21,973][106226] Updated weights for policy 0, policy_version 744710 (0.0008) [2023-12-28 00:36:22,033][106226] Updated weights for policy 0, policy_version 744720 (0.0009) [2023-12-28 00:36:22,397][106225] Updated weights for policy 1, policy_version 746671 (0.0008) [2023-12-28 00:36:22,453][106225] Updated weights for policy 1, policy_version 746681 (0.0009) [2023-12-28 00:36:22,508][106225] Updated weights for policy 1, policy_version 746691 (0.0008) [2023-12-28 00:36:22,801][106226] Updated weights for policy 0, policy_version 744730 (0.0008) [2023-12-28 00:36:22,854][106226] Updated weights for policy 0, policy_version 744740 (0.0009) [2023-12-28 00:36:22,911][106226] Updated weights for policy 0, policy_version 744750 (0.0008) [2023-12-28 00:36:22,976][106226] Updated weights for policy 0, policy_version 744760 (0.0009) [2023-12-28 00:36:23,208][106225] Updated weights for policy 1, policy_version 746701 (0.0006) [2023-12-28 00:36:23,270][106225] Updated weights for policy 1, policy_version 746711 (0.0005) [2023-12-28 00:36:23,335][106225] Updated weights for policy 1, policy_version 746721 (0.0008) [2023-12-28 00:36:23,745][106226] Updated weights for policy 0, policy_version 744770 (0.0008) [2023-12-28 00:36:23,788][106226] Updated weights for policy 0, policy_version 744780 (0.0008) [2023-12-28 00:36:23,834][106226] Updated weights for policy 0, policy_version 744790 (0.0009) [2023-12-28 00:36:23,999][106225] Updated weights for policy 1, policy_version 746731 (0.0008) [2023-12-28 00:36:24,047][106225] Updated weights for policy 1, policy_version 746741 (0.0008) [2023-12-28 00:36:24,098][106225] Updated weights for policy 1, policy_version 746751 (0.0008) [2023-12-28 00:36:24,597][106226] Updated weights for policy 0, policy_version 744800 (0.0008) [2023-12-28 00:36:24,646][106226] Updated weights for policy 0, policy_version 744810 (0.0009) [2023-12-28 00:36:24,697][106226] Updated weights for policy 0, policy_version 744820 (0.0008) [2023-12-28 00:36:24,804][106225] Updated weights for policy 1, policy_version 746761 (0.0006) [2023-12-28 00:36:24,869][106225] Updated weights for policy 1, policy_version 746771 (0.0009) [2023-12-28 00:36:24,927][106225] Updated weights for policy 1, policy_version 746781 (0.0008) [2023-12-28 00:36:24,986][106225] Updated weights for policy 1, policy_version 746791 (0.0009) [2023-12-28 00:36:25,445][106226] Updated weights for policy 0, policy_version 744830 (0.0009) [2023-12-28 00:36:25,496][106226] Updated weights for policy 0, policy_version 744840 (0.0009) [2023-12-28 00:36:25,547][106226] Updated weights for policy 0, policy_version 744850 (0.0009) [2023-12-28 00:36:25,647][106225] Updated weights for policy 1, policy_version 746801 (0.0008) [2023-12-28 00:36:25,708][106225] Updated weights for policy 1, policy_version 746811 (0.0008) [2023-12-28 00:36:25,769][106225] Updated weights for policy 1, policy_version 746821 (0.0008) [2023-12-28 00:36:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 381960192. Throughput: 0: 9778.9, 1: 9832.0. Samples: 381931444. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:26,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-5.344')] [2023-12-28 00:36:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000746824_191225856.pth... [2023-12-28 00:36:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000744856_190734336.pth... [2023-12-28 00:36:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000745704_190939136.pth [2023-12-28 00:36:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000743704_190439424.pth [2023-12-28 00:36:26,338][106226] Updated weights for policy 0, policy_version 744860 (0.0009) [2023-12-28 00:36:26,394][106226] Updated weights for policy 0, policy_version 744870 (0.0009) [2023-12-28 00:36:26,441][106225] Updated weights for policy 1, policy_version 746831 (0.0007) [2023-12-28 00:36:26,450][106226] Updated weights for policy 0, policy_version 744880 (0.0008) [2023-12-28 00:36:26,488][106225] Updated weights for policy 1, policy_version 746841 (0.0006) [2023-12-28 00:36:26,537][106225] Updated weights for policy 1, policy_version 746851 (0.0008) [2023-12-28 00:36:27,191][106226] Updated weights for policy 0, policy_version 744890 (0.0008) [2023-12-28 00:36:27,250][106226] Updated weights for policy 0, policy_version 744900 (0.0009) [2023-12-28 00:36:27,277][106225] Updated weights for policy 1, policy_version 746861 (0.0010) [2023-12-28 00:36:27,309][106226] Updated weights for policy 0, policy_version 744910 (0.0010) [2023-12-28 00:36:27,336][106225] Updated weights for policy 1, policy_version 746871 (0.0008) [2023-12-28 00:36:27,364][106226] Updated weights for policy 0, policy_version 744920 (0.0007) [2023-12-28 00:36:27,387][106225] Updated weights for policy 1, policy_version 746881 (0.0005) [2023-12-28 00:36:27,926][106225] Updated weights for policy 1, policy_version 746891 (0.0006) [2023-12-28 00:36:27,984][106225] Updated weights for policy 1, policy_version 746901 (0.0008) [2023-12-28 00:36:28,031][106225] Updated weights for policy 1, policy_version 746911 (0.0007) [2023-12-28 00:36:28,190][106226] Updated weights for policy 0, policy_version 744930 (0.0010) [2023-12-28 00:36:28,249][106226] Updated weights for policy 0, policy_version 744940 (0.0009) [2023-12-28 00:36:28,298][106226] Updated weights for policy 0, policy_version 744950 (0.0008) [2023-12-28 00:36:28,606][106225] Updated weights for policy 1, policy_version 746921 (0.0005) [2023-12-28 00:36:28,668][106225] Updated weights for policy 1, policy_version 746931 (0.0008) [2023-12-28 00:36:28,727][106225] Updated weights for policy 1, policy_version 746941 (0.0009) [2023-12-28 00:36:28,787][106225] Updated weights for policy 1, policy_version 746951 (0.0009) [2023-12-28 00:36:29,079][106226] Updated weights for policy 0, policy_version 744960 (0.0008) [2023-12-28 00:36:29,137][106226] Updated weights for policy 0, policy_version 744970 (0.0008) [2023-12-28 00:36:29,189][106226] Updated weights for policy 0, policy_version 744980 (0.0009) [2023-12-28 00:36:29,528][106225] Updated weights for policy 1, policy_version 746961 (0.0008) [2023-12-28 00:36:29,583][106225] Updated weights for policy 1, policy_version 746971 (0.0008) [2023-12-28 00:36:29,644][106225] Updated weights for policy 1, policy_version 746981 (0.0009) [2023-12-28 00:36:29,881][106226] Updated weights for policy 0, policy_version 744990 (0.0008) [2023-12-28 00:36:29,939][106226] Updated weights for policy 0, policy_version 745000 (0.0008) [2023-12-28 00:36:30,002][106226] Updated weights for policy 0, policy_version 745010 (0.0009) [2023-12-28 00:36:30,392][106225] Updated weights for policy 1, policy_version 746991 (0.0009) [2023-12-28 00:36:30,458][106225] Updated weights for policy 1, policy_version 747001 (0.0010) [2023-12-28 00:36:30,519][106225] Updated weights for policy 1, policy_version 747011 (0.0007) [2023-12-28 00:36:30,606][106226] Updated weights for policy 0, policy_version 745020 (0.0008) [2023-12-28 00:36:30,658][106226] Updated weights for policy 0, policy_version 745030 (0.0005) [2023-12-28 00:36:30,710][106226] Updated weights for policy 0, policy_version 745040 (0.0005) [2023-12-28 00:36:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 382058496. Throughput: 0: 9758.0, 1: 9859.3. Samples: 382049016. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:31,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-5.214')] [2023-12-28 00:36:31,270][106225] Updated weights for policy 1, policy_version 747021 (0.0010) [2023-12-28 00:36:31,332][106225] Updated weights for policy 1, policy_version 747031 (0.0009) [2023-12-28 00:36:31,408][106225] Updated weights for policy 1, policy_version 747041 (0.0009) [2023-12-28 00:36:31,458][106226] Updated weights for policy 0, policy_version 745050 (0.0008) [2023-12-28 00:36:31,522][106226] Updated weights for policy 0, policy_version 745060 (0.0008) [2023-12-28 00:36:31,588][106226] Updated weights for policy 0, policy_version 745070 (0.0008) [2023-12-28 00:36:31,654][106226] Updated weights for policy 0, policy_version 745080 (0.0008) [2023-12-28 00:36:32,106][106225] Updated weights for policy 1, policy_version 747051 (0.0008) [2023-12-28 00:36:32,166][106225] Updated weights for policy 1, policy_version 747061 (0.0010) [2023-12-28 00:36:32,228][106225] Updated weights for policy 1, policy_version 747071 (0.0011) [2023-12-28 00:36:32,411][106226] Updated weights for policy 0, policy_version 745090 (0.0008) [2023-12-28 00:36:32,474][106226] Updated weights for policy 0, policy_version 745100 (0.0008) [2023-12-28 00:36:32,533][106226] Updated weights for policy 0, policy_version 745110 (0.0008) [2023-12-28 00:36:32,860][106225] Updated weights for policy 1, policy_version 747081 (0.0010) [2023-12-28 00:36:32,913][106225] Updated weights for policy 1, policy_version 747091 (0.0009) [2023-12-28 00:36:32,966][106225] Updated weights for policy 1, policy_version 747101 (0.0010) [2023-12-28 00:36:33,032][106225] Updated weights for policy 1, policy_version 747111 (0.0010) [2023-12-28 00:36:33,244][106226] Updated weights for policy 0, policy_version 745120 (0.0008) [2023-12-28 00:36:33,292][106226] Updated weights for policy 0, policy_version 745130 (0.0008) [2023-12-28 00:36:33,342][106226] Updated weights for policy 0, policy_version 745140 (0.0009) [2023-12-28 00:36:33,583][106225] Updated weights for policy 1, policy_version 747121 (0.0006) [2023-12-28 00:36:33,642][106225] Updated weights for policy 1, policy_version 747131 (0.0005) [2023-12-28 00:36:33,690][106225] Updated weights for policy 1, policy_version 747141 (0.0005) [2023-12-28 00:36:34,211][106226] Updated weights for policy 0, policy_version 745150 (0.0008) [2023-12-28 00:36:34,257][106225] Updated weights for policy 1, policy_version 747151 (0.0005) [2023-12-28 00:36:34,272][106226] Updated weights for policy 0, policy_version 745160 (0.0008) [2023-12-28 00:36:34,320][106225] Updated weights for policy 1, policy_version 747161 (0.0008) [2023-12-28 00:36:34,333][106226] Updated weights for policy 0, policy_version 745170 (0.0006) [2023-12-28 00:36:34,381][106225] Updated weights for policy 1, policy_version 747171 (0.0009) [2023-12-28 00:36:35,024][106226] Updated weights for policy 0, policy_version 745180 (0.0007) [2023-12-28 00:36:35,033][106225] Updated weights for policy 1, policy_version 747181 (0.0011) [2023-12-28 00:36:35,078][106226] Updated weights for policy 0, policy_version 745190 (0.0006) [2023-12-28 00:36:35,080][106225] Updated weights for policy 1, policy_version 747191 (0.0010) [2023-12-28 00:36:35,136][106226] Updated weights for policy 0, policy_version 745200 (0.0007) [2023-12-28 00:36:35,138][106225] Updated weights for policy 1, policy_version 747201 (0.0009) [2023-12-28 00:36:35,794][106225] Updated weights for policy 1, policy_version 747211 (0.0009) [2023-12-28 00:36:35,819][106226] Updated weights for policy 0, policy_version 745210 (0.0006) [2023-12-28 00:36:35,851][106225] Updated weights for policy 1, policy_version 747221 (0.0010) [2023-12-28 00:36:35,880][106226] Updated weights for policy 0, policy_version 745220 (0.0007) [2023-12-28 00:36:35,911][106225] Updated weights for policy 1, policy_version 747231 (0.0010) [2023-12-28 00:36:35,931][106226] Updated weights for policy 0, policy_version 745230 (0.0009) [2023-12-28 00:36:35,986][106226] Updated weights for policy 0, policy_version 745240 (0.0008) [2023-12-28 00:36:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 382164992. Throughput: 0: 9776.6, 1: 9881.3. Samples: 382169960. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:36,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.368')] [2023-12-28 00:36:36,593][106225] Updated weights for policy 1, policy_version 747241 (0.0010) [2023-12-28 00:36:36,660][106225] Updated weights for policy 1, policy_version 747251 (0.0010) [2023-12-28 00:36:36,713][106226] Updated weights for policy 0, policy_version 745250 (0.0008) [2023-12-28 00:36:36,723][106225] Updated weights for policy 1, policy_version 747261 (0.0010) [2023-12-28 00:36:36,765][106226] Updated weights for policy 0, policy_version 745260 (0.0005) [2023-12-28 00:36:36,771][106225] Updated weights for policy 1, policy_version 747271 (0.0010) [2023-12-28 00:36:36,823][106226] Updated weights for policy 0, policy_version 745270 (0.0008) [2023-12-28 00:36:37,510][106225] Updated weights for policy 1, policy_version 747281 (0.0010) [2023-12-28 00:36:37,551][106226] Updated weights for policy 0, policy_version 745280 (0.0010) [2023-12-28 00:36:37,570][106225] Updated weights for policy 1, policy_version 747291 (0.0011) [2023-12-28 00:36:37,606][106226] Updated weights for policy 0, policy_version 745290 (0.0011) [2023-12-28 00:36:37,625][106225] Updated weights for policy 1, policy_version 747301 (0.0011) [2023-12-28 00:36:37,664][106226] Updated weights for policy 0, policy_version 745300 (0.0011) [2023-12-28 00:36:38,225][106225] Updated weights for policy 1, policy_version 747311 (0.0007) [2023-12-28 00:36:38,273][106225] Updated weights for policy 1, policy_version 747321 (0.0006) [2023-12-28 00:36:38,337][106225] Updated weights for policy 1, policy_version 747331 (0.0006) [2023-12-28 00:36:38,357][106226] Updated weights for policy 0, policy_version 745310 (0.0009) [2023-12-28 00:36:38,416][106226] Updated weights for policy 0, policy_version 745320 (0.0008) [2023-12-28 00:36:38,472][106226] Updated weights for policy 0, policy_version 745330 (0.0008) [2023-12-28 00:36:39,021][106225] Updated weights for policy 1, policy_version 747341 (0.0009) [2023-12-28 00:36:39,076][106225] Updated weights for policy 1, policy_version 747351 (0.0010) [2023-12-28 00:36:39,137][106225] Updated weights for policy 1, policy_version 747361 (0.0010) [2023-12-28 00:36:39,234][106226] Updated weights for policy 0, policy_version 745340 (0.0009) [2023-12-28 00:36:39,299][106226] Updated weights for policy 0, policy_version 745350 (0.0007) [2023-12-28 00:36:39,355][106226] Updated weights for policy 0, policy_version 745360 (0.0008) [2023-12-28 00:36:39,880][106225] Updated weights for policy 1, policy_version 747371 (0.0007) [2023-12-28 00:36:39,944][106225] Updated weights for policy 1, policy_version 747381 (0.0008) [2023-12-28 00:36:40,007][106225] Updated weights for policy 1, policy_version 747391 (0.0008) [2023-12-28 00:36:40,190][106226] Updated weights for policy 0, policy_version 745370 (0.0009) [2023-12-28 00:36:40,240][106226] Updated weights for policy 0, policy_version 745380 (0.0007) [2023-12-28 00:36:40,291][106226] Updated weights for policy 0, policy_version 745390 (0.0007) [2023-12-28 00:36:40,349][106226] Updated weights for policy 0, policy_version 745400 (0.0005) [2023-12-28 00:36:40,743][106225] Updated weights for policy 1, policy_version 747401 (0.0008) [2023-12-28 00:36:40,799][106225] Updated weights for policy 1, policy_version 747411 (0.0008) [2023-12-28 00:36:40,856][106225] Updated weights for policy 1, policy_version 747421 (0.0009) [2023-12-28 00:36:40,909][106225] Updated weights for policy 1, policy_version 747431 (0.0008) [2023-12-28 00:36:41,067][106226] Updated weights for policy 0, policy_version 745410 (0.0008) [2023-12-28 00:36:41,135][106226] Updated weights for policy 0, policy_version 745420 (0.0007) [2023-12-28 00:36:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 382255104. Throughput: 0: 9792.7, 1: 9912.7. Samples: 382229488. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-28 00:36:41,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.422')] [2023-12-28 00:36:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000747432_191381504.pth... [2023-12-28 00:36:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000746248_191078400.pth [2023-12-28 00:36:41,201][106226] Updated weights for policy 0, policy_version 745430 (0.0009) [2023-12-28 00:36:41,211][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000745432_190881792.pth... [2023-12-28 00:36:41,215][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000744280_190586880.pth [2023-12-28 00:36:41,710][106225] Updated weights for policy 1, policy_version 747441 (0.0008) [2023-12-28 00:36:41,782][106225] Updated weights for policy 1, policy_version 747451 (0.0008) [2023-12-28 00:36:41,848][106225] Updated weights for policy 1, policy_version 747461 (0.0008) [2023-12-28 00:36:41,919][106226] Updated weights for policy 0, policy_version 745440 (0.0009) [2023-12-28 00:36:41,979][106226] Updated weights for policy 0, policy_version 745450 (0.0008) [2023-12-28 00:36:42,043][106226] Updated weights for policy 0, policy_version 745460 (0.0008) [2023-12-28 00:36:42,582][106225] Updated weights for policy 1, policy_version 747471 (0.0009) [2023-12-28 00:36:42,640][106225] Updated weights for policy 1, policy_version 747481 (0.0008) [2023-12-28 00:36:42,696][106225] Updated weights for policy 1, policy_version 747491 (0.0008) [2023-12-28 00:36:42,739][106226] Updated weights for policy 0, policy_version 745470 (0.0007) [2023-12-28 00:36:42,798][106226] Updated weights for policy 0, policy_version 745480 (0.0008) [2023-12-28 00:36:42,863][106226] Updated weights for policy 0, policy_version 745490 (0.0009) [2023-12-28 00:36:43,414][106225] Updated weights for policy 1, policy_version 747501 (0.0008) [2023-12-28 00:36:43,481][106225] Updated weights for policy 1, policy_version 747511 (0.0008) [2023-12-28 00:36:43,536][106225] Updated weights for policy 1, policy_version 747521 (0.0009) [2023-12-28 00:36:43,589][106226] Updated weights for policy 0, policy_version 745500 (0.0008) [2023-12-28 00:36:43,652][106226] Updated weights for policy 0, policy_version 745510 (0.0009) [2023-12-28 00:36:43,714][106226] Updated weights for policy 0, policy_version 745520 (0.0007) [2023-12-28 00:36:44,276][106225] Updated weights for policy 1, policy_version 747531 (0.0008) [2023-12-28 00:36:44,330][106225] Updated weights for policy 1, policy_version 747541 (0.0007) [2023-12-28 00:36:44,361][106226] Updated weights for policy 0, policy_version 745530 (0.0005) [2023-12-28 00:36:44,389][106225] Updated weights for policy 1, policy_version 747551 (0.0008) [2023-12-28 00:36:44,437][106226] Updated weights for policy 0, policy_version 745540 (0.0008) [2023-12-28 00:36:44,484][106226] Updated weights for policy 0, policy_version 745550 (0.0009) [2023-12-28 00:36:44,535][106226] Updated weights for policy 0, policy_version 745560 (0.0008) [2023-12-28 00:36:45,167][106225] Updated weights for policy 1, policy_version 747561 (0.0007) [2023-12-28 00:36:45,205][106226] Updated weights for policy 0, policy_version 745570 (0.0011) [2023-12-28 00:36:45,230][106225] Updated weights for policy 1, policy_version 747571 (0.0006) [2023-12-28 00:36:45,268][106226] Updated weights for policy 0, policy_version 745580 (0.0009) [2023-12-28 00:36:45,295][106225] Updated weights for policy 1, policy_version 747581 (0.0008) [2023-12-28 00:36:45,332][106226] Updated weights for policy 0, policy_version 745590 (0.0010) [2023-12-28 00:36:45,359][106225] Updated weights for policy 1, policy_version 747591 (0.0008) [2023-12-28 00:36:45,963][106226] Updated weights for policy 0, policy_version 745600 (0.0008) [2023-12-28 00:36:46,017][106226] Updated weights for policy 0, policy_version 745610 (0.0010) [2023-12-28 00:36:46,077][106226] Updated weights for policy 0, policy_version 745620 (0.0010) [2023-12-28 00:36:46,129][106225] Updated weights for policy 1, policy_version 747601 (0.0009) [2023-12-28 00:36:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 382353408. Throughput: 0: 9797.5, 1: 9833.0. Samples: 382343752. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:36:46,176][105115] Avg episode reward: [(0, '-4.296'), (1, '-5.407')] [2023-12-28 00:36:46,194][106225] Updated weights for policy 1, policy_version 747611 (0.0005) [2023-12-28 00:36:46,260][106225] Updated weights for policy 1, policy_version 747621 (0.0006) [2023-12-28 00:36:46,729][106226] Updated weights for policy 0, policy_version 745630 (0.0008) [2023-12-28 00:36:46,779][106226] Updated weights for policy 0, policy_version 745640 (0.0005) [2023-12-28 00:36:46,838][106226] Updated weights for policy 0, policy_version 745650 (0.0005) [2023-12-28 00:36:46,908][106225] Updated weights for policy 1, policy_version 747631 (0.0006) [2023-12-28 00:36:46,971][106225] Updated weights for policy 1, policy_version 747641 (0.0006) [2023-12-28 00:36:47,047][106225] Updated weights for policy 1, policy_version 747651 (0.0008) [2023-12-28 00:36:47,379][106226] Updated weights for policy 0, policy_version 745660 (0.0007) [2023-12-28 00:36:47,436][106226] Updated weights for policy 0, policy_version 745670 (0.0010) [2023-12-28 00:36:47,496][106226] Updated weights for policy 0, policy_version 745680 (0.0011) [2023-12-28 00:36:47,702][106225] Updated weights for policy 1, policy_version 747661 (0.0010) [2023-12-28 00:36:47,766][106225] Updated weights for policy 1, policy_version 747671 (0.0010) [2023-12-28 00:36:47,820][106225] Updated weights for policy 1, policy_version 747681 (0.0010) [2023-12-28 00:36:48,225][106226] Updated weights for policy 0, policy_version 745690 (0.0011) [2023-12-28 00:36:48,298][106226] Updated weights for policy 0, policy_version 745700 (0.0011) [2023-12-28 00:36:48,351][106226] Updated weights for policy 0, policy_version 745710 (0.0009) [2023-12-28 00:36:48,417][106226] Updated weights for policy 0, policy_version 745720 (0.0009) [2023-12-28 00:36:48,491][106225] Updated weights for policy 1, policy_version 747691 (0.0010) [2023-12-28 00:36:48,553][106225] Updated weights for policy 1, policy_version 747701 (0.0010) [2023-12-28 00:36:48,607][106225] Updated weights for policy 1, policy_version 747711 (0.0010) [2023-12-28 00:36:49,143][106226] Updated weights for policy 0, policy_version 745730 (0.0005) [2023-12-28 00:36:49,205][106226] Updated weights for policy 0, policy_version 745740 (0.0005) [2023-12-28 00:36:49,226][106225] Updated weights for policy 1, policy_version 747721 (0.0009) [2023-12-28 00:36:49,274][106226] Updated weights for policy 0, policy_version 745750 (0.0008) [2023-12-28 00:36:49,290][106225] Updated weights for policy 1, policy_version 747731 (0.0011) [2023-12-28 00:36:49,352][106225] Updated weights for policy 1, policy_version 747741 (0.0010) [2023-12-28 00:36:49,427][106225] Updated weights for policy 1, policy_version 747751 (0.0010) [2023-12-28 00:36:49,926][106226] Updated weights for policy 0, policy_version 745760 (0.0009) [2023-12-28 00:36:49,996][106226] Updated weights for policy 0, policy_version 745770 (0.0008) [2023-12-28 00:36:50,051][106226] Updated weights for policy 0, policy_version 745780 (0.0008) [2023-12-28 00:36:50,155][106225] Updated weights for policy 1, policy_version 747761 (0.0008) [2023-12-28 00:36:50,220][106225] Updated weights for policy 1, policy_version 747771 (0.0008) [2023-12-28 00:36:50,281][106225] Updated weights for policy 1, policy_version 747781 (0.0008) [2023-12-28 00:36:50,799][106226] Updated weights for policy 0, policy_version 745790 (0.0008) [2023-12-28 00:36:50,854][106226] Updated weights for policy 0, policy_version 745800 (0.0008) [2023-12-28 00:36:50,911][106226] Updated weights for policy 0, policy_version 745810 (0.0009) [2023-12-28 00:36:51,001][106225] Updated weights for policy 1, policy_version 747791 (0.0009) [2023-12-28 00:36:51,069][106225] Updated weights for policy 1, policy_version 747801 (0.0008) [2023-12-28 00:36:51,132][106225] Updated weights for policy 1, policy_version 747811 (0.0009) [2023-12-28 00:36:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 382459904. Throughput: 0: 9729.9, 1: 9853.1. Samples: 382463512. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:36:51,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.469')] [2023-12-28 00:36:51,683][106226] Updated weights for policy 0, policy_version 745820 (0.0008) [2023-12-28 00:36:51,756][106226] Updated weights for policy 0, policy_version 745830 (0.0006) [2023-12-28 00:36:51,810][106226] Updated weights for policy 0, policy_version 745840 (0.0006) [2023-12-28 00:36:51,879][106225] Updated weights for policy 1, policy_version 747821 (0.0008) [2023-12-28 00:36:51,944][106225] Updated weights for policy 1, policy_version 747831 (0.0005) [2023-12-28 00:36:52,014][106225] Updated weights for policy 1, policy_version 747841 (0.0006) [2023-12-28 00:36:52,558][106226] Updated weights for policy 0, policy_version 745850 (0.0007) [2023-12-28 00:36:52,621][106226] Updated weights for policy 0, policy_version 745860 (0.0009) [2023-12-28 00:36:52,665][106225] Updated weights for policy 1, policy_version 747851 (0.0006) [2023-12-28 00:36:52,682][106226] Updated weights for policy 0, policy_version 745870 (0.0008) [2023-12-28 00:36:52,726][106225] Updated weights for policy 1, policy_version 747861 (0.0008) [2023-12-28 00:36:52,749][106226] Updated weights for policy 0, policy_version 745880 (0.0009) [2023-12-28 00:36:52,791][106225] Updated weights for policy 1, policy_version 747871 (0.0009) [2023-12-28 00:36:53,470][106226] Updated weights for policy 0, policy_version 745890 (0.0009) [2023-12-28 00:36:53,490][106225] Updated weights for policy 1, policy_version 747881 (0.0008) [2023-12-28 00:36:53,531][106226] Updated weights for policy 0, policy_version 745900 (0.0010) [2023-12-28 00:36:53,551][106225] Updated weights for policy 1, policy_version 747891 (0.0007) [2023-12-28 00:36:53,591][106226] Updated weights for policy 0, policy_version 745910 (0.0010) [2023-12-28 00:36:53,610][106225] Updated weights for policy 1, policy_version 747901 (0.0007) [2023-12-28 00:36:53,668][106225] Updated weights for policy 1, policy_version 747911 (0.0008) [2023-12-28 00:36:54,290][106226] Updated weights for policy 0, policy_version 745920 (0.0009) [2023-12-28 00:36:54,346][106226] Updated weights for policy 0, policy_version 745930 (0.0005) [2023-12-28 00:36:54,371][106225] Updated weights for policy 1, policy_version 747921 (0.0007) [2023-12-28 00:36:54,408][106226] Updated weights for policy 0, policy_version 745940 (0.0008) [2023-12-28 00:36:54,427][106225] Updated weights for policy 1, policy_version 747931 (0.0005) [2023-12-28 00:36:54,478][106225] Updated weights for policy 1, policy_version 747941 (0.0006) [2023-12-28 00:36:55,090][106226] Updated weights for policy 0, policy_version 745950 (0.0008) [2023-12-28 00:36:55,147][106225] Updated weights for policy 1, policy_version 747951 (0.0008) [2023-12-28 00:36:55,147][106226] Updated weights for policy 0, policy_version 745960 (0.0008) [2023-12-28 00:36:55,200][106226] Updated weights for policy 0, policy_version 745970 (0.0006) [2023-12-28 00:36:55,202][106225] Updated weights for policy 1, policy_version 747961 (0.0007) [2023-12-28 00:36:55,262][106225] Updated weights for policy 1, policy_version 747971 (0.0007) [2023-12-28 00:36:55,812][106226] Updated weights for policy 0, policy_version 745980 (0.0006) [2023-12-28 00:36:55,858][106226] Updated weights for policy 0, policy_version 745990 (0.0005) [2023-12-28 00:36:55,916][106226] Updated weights for policy 0, policy_version 746000 (0.0008) [2023-12-28 00:36:55,974][106225] Updated weights for policy 1, policy_version 747981 (0.0008) [2023-12-28 00:36:56,018][106225] Updated weights for policy 1, policy_version 747991 (0.0008) [2023-12-28 00:36:56,074][106225] Updated weights for policy 1, policy_version 748001 (0.0008) [2023-12-28 00:36:56,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 382558208. Throughput: 0: 9719.1, 1: 9835.7. Samples: 382520988. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:36:56,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.212')] [2023-12-28 00:36:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000746008_191029248.pth... [2023-12-28 00:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000748008_191528960.pth... [2023-12-28 00:36:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000744856_190734336.pth [2023-12-28 00:36:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000746824_191225856.pth [2023-12-28 00:36:56,602][106226] Updated weights for policy 0, policy_version 746010 (0.0008) [2023-12-28 00:36:56,657][106226] Updated weights for policy 0, policy_version 746020 (0.0010) [2023-12-28 00:36:56,706][106226] Updated weights for policy 0, policy_version 746030 (0.0010) [2023-12-28 00:36:56,718][106225] Updated weights for policy 1, policy_version 748011 (0.0009) [2023-12-28 00:36:56,764][106226] Updated weights for policy 0, policy_version 746040 (0.0010) [2023-12-28 00:36:56,776][106225] Updated weights for policy 1, policy_version 748021 (0.0005) [2023-12-28 00:36:56,827][106225] Updated weights for policy 1, policy_version 748031 (0.0005) [2023-12-28 00:36:57,378][106226] Updated weights for policy 0, policy_version 746050 (0.0011) [2023-12-28 00:36:57,439][106226] Updated weights for policy 0, policy_version 746060 (0.0008) [2023-12-28 00:36:57,498][106225] Updated weights for policy 1, policy_version 748041 (0.0007) [2023-12-28 00:36:57,507][106226] Updated weights for policy 0, policy_version 746070 (0.0007) [2023-12-28 00:36:57,552][106225] Updated weights for policy 1, policy_version 748051 (0.0010) [2023-12-28 00:36:57,610][106225] Updated weights for policy 1, policy_version 748061 (0.0006) [2023-12-28 00:36:57,662][106225] Updated weights for policy 1, policy_version 748071 (0.0005) [2023-12-28 00:36:58,127][106226] Updated weights for policy 0, policy_version 746080 (0.0006) [2023-12-28 00:36:58,181][106226] Updated weights for policy 0, policy_version 746090 (0.0005) [2023-12-28 00:36:58,247][106226] Updated weights for policy 0, policy_version 746100 (0.0008) [2023-12-28 00:36:58,327][106225] Updated weights for policy 1, policy_version 748081 (0.0008) [2023-12-28 00:36:58,394][106225] Updated weights for policy 1, policy_version 748091 (0.0008) [2023-12-28 00:36:58,466][106225] Updated weights for policy 1, policy_version 748101 (0.0008) [2023-12-28 00:36:59,043][106226] Updated weights for policy 0, policy_version 746110 (0.0007) [2023-12-28 00:36:59,102][106226] Updated weights for policy 0, policy_version 746120 (0.0008) [2023-12-28 00:36:59,163][106226] Updated weights for policy 0, policy_version 746130 (0.0008) [2023-12-28 00:36:59,287][106225] Updated weights for policy 1, policy_version 748111 (0.0008) [2023-12-28 00:36:59,345][106225] Updated weights for policy 1, policy_version 748121 (0.0008) [2023-12-28 00:36:59,413][106225] Updated weights for policy 1, policy_version 748131 (0.0009) [2023-12-28 00:36:59,930][106226] Updated weights for policy 0, policy_version 746140 (0.0009) [2023-12-28 00:36:59,995][106226] Updated weights for policy 0, policy_version 746150 (0.0011) [2023-12-28 00:37:00,049][106226] Updated weights for policy 0, policy_version 746160 (0.0010) [2023-12-28 00:37:00,167][106225] Updated weights for policy 1, policy_version 748141 (0.0007) [2023-12-28 00:37:00,234][106225] Updated weights for policy 1, policy_version 748151 (0.0008) [2023-12-28 00:37:00,298][106225] Updated weights for policy 1, policy_version 748161 (0.0008) [2023-12-28 00:37:00,741][106226] Updated weights for policy 0, policy_version 746170 (0.0010) [2023-12-28 00:37:00,789][106226] Updated weights for policy 0, policy_version 746180 (0.0009) [2023-12-28 00:37:00,839][106226] Updated weights for policy 0, policy_version 746190 (0.0005) [2023-12-28 00:37:00,888][106226] Updated weights for policy 0, policy_version 746200 (0.0008) [2023-12-28 00:37:00,937][106225] Updated weights for policy 1, policy_version 748171 (0.0007) [2023-12-28 00:37:00,992][106225] Updated weights for policy 1, policy_version 748181 (0.0005) [2023-12-28 00:37:01,058][106225] Updated weights for policy 1, policy_version 748191 (0.0008) [2023-12-28 00:37:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 382656512. Throughput: 0: 9782.3, 1: 9903.6. Samples: 382641668. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:01,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-5.169')] [2023-12-28 00:37:01,692][106226] Updated weights for policy 0, policy_version 746210 (0.0009) [2023-12-28 00:37:01,724][106225] Updated weights for policy 1, policy_version 748201 (0.0009) [2023-12-28 00:37:01,752][106226] Updated weights for policy 0, policy_version 746220 (0.0010) [2023-12-28 00:37:01,789][106225] Updated weights for policy 1, policy_version 748211 (0.0008) [2023-12-28 00:37:01,815][106226] Updated weights for policy 0, policy_version 746230 (0.0006) [2023-12-28 00:37:01,845][106225] Updated weights for policy 1, policy_version 748221 (0.0007) [2023-12-28 00:37:01,907][106225] Updated weights for policy 1, policy_version 748231 (0.0008) [2023-12-28 00:37:02,553][106226] Updated weights for policy 0, policy_version 746240 (0.0006) [2023-12-28 00:37:02,555][106225] Updated weights for policy 1, policy_version 748241 (0.0008) [2023-12-28 00:37:02,614][106226] Updated weights for policy 0, policy_version 746250 (0.0006) [2023-12-28 00:37:02,621][106225] Updated weights for policy 1, policy_version 748251 (0.0008) [2023-12-28 00:37:02,674][106225] Updated weights for policy 1, policy_version 748261 (0.0006) [2023-12-28 00:37:02,683][106226] Updated weights for policy 0, policy_version 746260 (0.0007) [2023-12-28 00:37:03,221][106226] Updated weights for policy 0, policy_version 746270 (0.0006) [2023-12-28 00:37:03,275][106226] Updated weights for policy 0, policy_version 746280 (0.0005) [2023-12-28 00:37:03,336][106226] Updated weights for policy 0, policy_version 746290 (0.0008) [2023-12-28 00:37:03,409][106225] Updated weights for policy 1, policy_version 748271 (0.0007) [2023-12-28 00:37:03,470][106225] Updated weights for policy 1, policy_version 748281 (0.0009) [2023-12-28 00:37:03,525][106225] Updated weights for policy 1, policy_version 748291 (0.0008) [2023-12-28 00:37:03,971][106226] Updated weights for policy 0, policy_version 746300 (0.0008) [2023-12-28 00:37:04,020][106226] Updated weights for policy 0, policy_version 746310 (0.0008) [2023-12-28 00:37:04,073][106226] Updated weights for policy 0, policy_version 746320 (0.0008) [2023-12-28 00:37:04,238][106225] Updated weights for policy 1, policy_version 748301 (0.0007) [2023-12-28 00:37:04,303][106225] Updated weights for policy 1, policy_version 748311 (0.0006) [2023-12-28 00:37:04,362][106225] Updated weights for policy 1, policy_version 748321 (0.0009) [2023-12-28 00:37:04,781][106226] Updated weights for policy 0, policy_version 746330 (0.0009) [2023-12-28 00:37:04,840][106226] Updated weights for policy 0, policy_version 746340 (0.0008) [2023-12-28 00:37:04,894][106226] Updated weights for policy 0, policy_version 746350 (0.0008) [2023-12-28 00:37:04,947][106226] Updated weights for policy 0, policy_version 746360 (0.0008) [2023-12-28 00:37:05,046][106225] Updated weights for policy 1, policy_version 748331 (0.0008) [2023-12-28 00:37:05,098][106225] Updated weights for policy 1, policy_version 748341 (0.0007) [2023-12-28 00:37:05,153][106225] Updated weights for policy 1, policy_version 748351 (0.0008) [2023-12-28 00:37:05,699][106226] Updated weights for policy 0, policy_version 746370 (0.0009) [2023-12-28 00:37:05,753][106226] Updated weights for policy 0, policy_version 746380 (0.0008) [2023-12-28 00:37:05,794][106225] Updated weights for policy 1, policy_version 748361 (0.0010) [2023-12-28 00:37:05,804][106226] Updated weights for policy 0, policy_version 746390 (0.0007) [2023-12-28 00:37:05,852][106225] Updated weights for policy 1, policy_version 748371 (0.0008) [2023-12-28 00:37:05,904][106225] Updated weights for policy 1, policy_version 748381 (0.0008) [2023-12-28 00:37:05,958][106225] Updated weights for policy 1, policy_version 748391 (0.0007) [2023-12-28 00:37:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 382754816. Throughput: 0: 9740.7, 1: 9946.0. Samples: 382761616. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:06,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-5.115')] [2023-12-28 00:37:06,570][106226] Updated weights for policy 0, policy_version 746400 (0.0006) [2023-12-28 00:37:06,637][106226] Updated weights for policy 0, policy_version 746410 (0.0006) [2023-12-28 00:37:06,672][106225] Updated weights for policy 1, policy_version 748401 (0.0006) [2023-12-28 00:37:06,696][106226] Updated weights for policy 0, policy_version 746420 (0.0008) [2023-12-28 00:37:06,732][106225] Updated weights for policy 1, policy_version 748411 (0.0009) [2023-12-28 00:37:06,793][106225] Updated weights for policy 1, policy_version 748421 (0.0009) [2023-12-28 00:37:07,355][106226] Updated weights for policy 0, policy_version 746430 (0.0007) [2023-12-28 00:37:07,408][106226] Updated weights for policy 0, policy_version 746440 (0.0009) [2023-12-28 00:37:07,467][106226] Updated weights for policy 0, policy_version 746450 (0.0009) [2023-12-28 00:37:07,488][106225] Updated weights for policy 1, policy_version 748431 (0.0006) [2023-12-28 00:37:07,535][106225] Updated weights for policy 1, policy_version 748441 (0.0005) [2023-12-28 00:37:07,584][106225] Updated weights for policy 1, policy_version 748451 (0.0006) [2023-12-28 00:37:08,206][106226] Updated weights for policy 0, policy_version 746460 (0.0008) [2023-12-28 00:37:08,260][106226] Updated weights for policy 0, policy_version 746470 (0.0008) [2023-12-28 00:37:08,308][106225] Updated weights for policy 1, policy_version 748461 (0.0007) [2023-12-28 00:37:08,310][106226] Updated weights for policy 0, policy_version 746480 (0.0008) [2023-12-28 00:37:08,387][106225] Updated weights for policy 1, policy_version 748471 (0.0009) [2023-12-28 00:37:08,447][106225] Updated weights for policy 1, policy_version 748481 (0.0008) [2023-12-28 00:37:09,020][106226] Updated weights for policy 0, policy_version 746490 (0.0007) [2023-12-28 00:37:09,080][106226] Updated weights for policy 0, policy_version 746500 (0.0009) [2023-12-28 00:37:09,137][106226] Updated weights for policy 0, policy_version 746510 (0.0008) [2023-12-28 00:37:09,193][106225] Updated weights for policy 1, policy_version 748491 (0.0009) [2023-12-28 00:37:09,195][106226] Updated weights for policy 0, policy_version 746520 (0.0007) [2023-12-28 00:37:09,258][106225] Updated weights for policy 1, policy_version 748501 (0.0009) [2023-12-28 00:37:09,318][106225] Updated weights for policy 1, policy_version 748511 (0.0008) [2023-12-28 00:37:09,969][106226] Updated weights for policy 0, policy_version 746530 (0.0010) [2023-12-28 00:37:10,024][106226] Updated weights for policy 0, policy_version 746540 (0.0010) [2023-12-28 00:37:10,082][106226] Updated weights for policy 0, policy_version 746550 (0.0011) [2023-12-28 00:37:10,131][106225] Updated weights for policy 1, policy_version 748521 (0.0008) [2023-12-28 00:37:10,193][106225] Updated weights for policy 1, policy_version 748531 (0.0008) [2023-12-28 00:37:10,244][106225] Updated weights for policy 1, policy_version 748541 (0.0008) [2023-12-28 00:37:10,299][106225] Updated weights for policy 1, policy_version 748551 (0.0008) [2023-12-28 00:37:10,816][106226] Updated weights for policy 0, policy_version 746560 (0.0011) [2023-12-28 00:37:10,870][106226] Updated weights for policy 0, policy_version 746570 (0.0010) [2023-12-28 00:37:10,917][106226] Updated weights for policy 0, policy_version 746580 (0.0010) [2023-12-28 00:37:11,083][106225] Updated weights for policy 1, policy_version 748561 (0.0009) [2023-12-28 00:37:11,138][106225] Updated weights for policy 1, policy_version 748571 (0.0007) [2023-12-28 00:37:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 382844928. Throughput: 0: 9784.3, 1: 9962.4. Samples: 382820044. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:11,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.311')] [2023-12-28 00:37:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000746584_191176704.pth... [2023-12-28 00:37:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000745432_190881792.pth [2023-12-28 00:37:11,209][106225] Updated weights for policy 1, policy_version 748581 (0.0008) [2023-12-28 00:37:11,224][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000748584_191676416.pth... [2023-12-28 00:37:11,227][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000747432_191381504.pth [2023-12-28 00:37:11,684][106226] Updated weights for policy 0, policy_version 746590 (0.0011) [2023-12-28 00:37:11,750][106226] Updated weights for policy 0, policy_version 746600 (0.0014) [2023-12-28 00:37:11,819][106226] Updated weights for policy 0, policy_version 746610 (0.0012) [2023-12-28 00:37:11,909][106225] Updated weights for policy 1, policy_version 748591 (0.0008) [2023-12-28 00:37:11,972][106225] Updated weights for policy 1, policy_version 748601 (0.0008) [2023-12-28 00:37:12,038][106225] Updated weights for policy 1, policy_version 748611 (0.0008) [2023-12-28 00:37:12,511][106226] Updated weights for policy 0, policy_version 746620 (0.0008) [2023-12-28 00:37:12,575][106226] Updated weights for policy 0, policy_version 746630 (0.0008) [2023-12-28 00:37:12,641][106226] Updated weights for policy 0, policy_version 746640 (0.0008) [2023-12-28 00:37:12,753][106225] Updated weights for policy 1, policy_version 748621 (0.0010) [2023-12-28 00:37:12,811][106225] Updated weights for policy 1, policy_version 748631 (0.0010) [2023-12-28 00:37:12,869][106225] Updated weights for policy 1, policy_version 748641 (0.0010) [2023-12-28 00:37:13,298][106226] Updated weights for policy 0, policy_version 746650 (0.0008) [2023-12-28 00:37:13,340][106226] Updated weights for policy 0, policy_version 746660 (0.0007) [2023-12-28 00:37:13,387][106226] Updated weights for policy 0, policy_version 746670 (0.0007) [2023-12-28 00:37:13,433][106226] Updated weights for policy 0, policy_version 746680 (0.0007) [2023-12-28 00:37:13,598][106225] Updated weights for policy 1, policy_version 748651 (0.0010) [2023-12-28 00:37:13,655][106225] Updated weights for policy 1, policy_version 748661 (0.0009) [2023-12-28 00:37:13,721][106225] Updated weights for policy 1, policy_version 748671 (0.0010) [2023-12-28 00:37:14,091][106226] Updated weights for policy 0, policy_version 746690 (0.0009) [2023-12-28 00:37:14,147][106226] Updated weights for policy 0, policy_version 746700 (0.0008) [2023-12-28 00:37:14,200][106226] Updated weights for policy 0, policy_version 746710 (0.0009) [2023-12-28 00:37:14,427][106225] Updated weights for policy 1, policy_version 748681 (0.0009) [2023-12-28 00:37:14,495][106225] Updated weights for policy 1, policy_version 748691 (0.0009) [2023-12-28 00:37:14,559][106225] Updated weights for policy 1, policy_version 748701 (0.0008) [2023-12-28 00:37:14,609][106225] Updated weights for policy 1, policy_version 748711 (0.0006) [2023-12-28 00:37:14,951][106226] Updated weights for policy 0, policy_version 746720 (0.0010) [2023-12-28 00:37:15,006][106226] Updated weights for policy 0, policy_version 746730 (0.0011) [2023-12-28 00:37:15,078][106226] Updated weights for policy 0, policy_version 746740 (0.0010) [2023-12-28 00:37:15,320][106225] Updated weights for policy 1, policy_version 748721 (0.0008) [2023-12-28 00:37:15,380][106225] Updated weights for policy 1, policy_version 748731 (0.0006) [2023-12-28 00:37:15,442][106225] Updated weights for policy 1, policy_version 748741 (0.0008) [2023-12-28 00:37:15,802][106226] Updated weights for policy 0, policy_version 746750 (0.0011) [2023-12-28 00:37:15,855][106226] Updated weights for policy 0, policy_version 746760 (0.0010) [2023-12-28 00:37:15,908][106226] Updated weights for policy 0, policy_version 746770 (0.0010) [2023-12-28 00:37:16,133][106225] Updated weights for policy 1, policy_version 748751 (0.0008) [2023-12-28 00:37:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 382943232. Throughput: 0: 9840.5, 1: 9837.2. Samples: 382934516. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:16,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-5.304')] [2023-12-28 00:37:16,187][106225] Updated weights for policy 1, policy_version 748761 (0.0008) [2023-12-28 00:37:16,230][106225] Updated weights for policy 1, policy_version 748771 (0.0008) [2023-12-28 00:37:16,625][106226] Updated weights for policy 0, policy_version 746780 (0.0009) [2023-12-28 00:37:16,690][106226] Updated weights for policy 0, policy_version 746790 (0.0008) [2023-12-28 00:37:16,753][106226] Updated weights for policy 0, policy_version 746800 (0.0007) [2023-12-28 00:37:16,879][106225] Updated weights for policy 1, policy_version 748781 (0.0008) [2023-12-28 00:37:16,931][106225] Updated weights for policy 1, policy_version 748791 (0.0007) [2023-12-28 00:37:16,982][106225] Updated weights for policy 1, policy_version 748801 (0.0005) [2023-12-28 00:37:17,448][106226] Updated weights for policy 0, policy_version 746810 (0.0008) [2023-12-28 00:37:17,512][106226] Updated weights for policy 0, policy_version 746820 (0.0008) [2023-12-28 00:37:17,582][106225] Updated weights for policy 1, policy_version 748811 (0.0008) [2023-12-28 00:37:17,582][106226] Updated weights for policy 0, policy_version 746830 (0.0008) [2023-12-28 00:37:17,634][106226] Updated weights for policy 0, policy_version 746840 (0.0008) [2023-12-28 00:37:17,640][106225] Updated weights for policy 1, policy_version 748821 (0.0007) [2023-12-28 00:37:17,701][106225] Updated weights for policy 1, policy_version 748831 (0.0009) [2023-12-28 00:37:18,283][106226] Updated weights for policy 0, policy_version 746850 (0.0005) [2023-12-28 00:37:18,350][106226] Updated weights for policy 0, policy_version 746860 (0.0007) [2023-12-28 00:37:18,407][106226] Updated weights for policy 0, policy_version 746870 (0.0008) [2023-12-28 00:37:18,443][106225] Updated weights for policy 1, policy_version 748841 (0.0005) [2023-12-28 00:37:18,515][106225] Updated weights for policy 1, policy_version 748851 (0.0009) [2023-12-28 00:37:18,567][106225] Updated weights for policy 1, policy_version 748861 (0.0009) [2023-12-28 00:37:18,635][106225] Updated weights for policy 1, policy_version 748871 (0.0008) [2023-12-28 00:37:19,121][106226] Updated weights for policy 0, policy_version 746880 (0.0006) [2023-12-28 00:37:19,177][106226] Updated weights for policy 0, policy_version 746890 (0.0006) [2023-12-28 00:37:19,242][106226] Updated weights for policy 0, policy_version 746900 (0.0007) [2023-12-28 00:37:19,390][106225] Updated weights for policy 1, policy_version 748881 (0.0009) [2023-12-28 00:37:19,446][106225] Updated weights for policy 1, policy_version 748891 (0.0009) [2023-12-28 00:37:19,507][106225] Updated weights for policy 1, policy_version 748901 (0.0008) [2023-12-28 00:37:19,881][106226] Updated weights for policy 0, policy_version 746910 (0.0009) [2023-12-28 00:37:19,945][106226] Updated weights for policy 0, policy_version 746920 (0.0010) [2023-12-28 00:37:20,015][106226] Updated weights for policy 0, policy_version 746930 (0.0009) [2023-12-28 00:37:20,295][106225] Updated weights for policy 1, policy_version 748911 (0.0008) [2023-12-28 00:37:20,359][106225] Updated weights for policy 1, policy_version 748921 (0.0009) [2023-12-28 00:37:20,416][106225] Updated weights for policy 1, policy_version 748931 (0.0008) [2023-12-28 00:37:20,769][106226] Updated weights for policy 0, policy_version 746940 (0.0007) [2023-12-28 00:37:20,828][106226] Updated weights for policy 0, policy_version 746950 (0.0006) [2023-12-28 00:37:20,894][106226] Updated weights for policy 0, policy_version 746960 (0.0007) [2023-12-28 00:37:21,137][106225] Updated weights for policy 1, policy_version 748941 (0.0007) [2023-12-28 00:37:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 383041536. Throughput: 0: 9861.4, 1: 9756.7. Samples: 383052776. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:21,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-5.248')] [2023-12-28 00:37:21,186][106225] Updated weights for policy 1, policy_version 748951 (0.0008) [2023-12-28 00:37:21,248][106225] Updated weights for policy 1, policy_version 748961 (0.0010) [2023-12-28 00:37:21,620][106226] Updated weights for policy 0, policy_version 746970 (0.0010) [2023-12-28 00:37:21,689][106226] Updated weights for policy 0, policy_version 746980 (0.0007) [2023-12-28 00:37:21,759][106226] Updated weights for policy 0, policy_version 746990 (0.0007) [2023-12-28 00:37:21,826][106226] Updated weights for policy 0, policy_version 747000 (0.0009) [2023-12-28 00:37:22,051][106225] Updated weights for policy 1, policy_version 748971 (0.0009) [2023-12-28 00:37:22,116][106225] Updated weights for policy 1, policy_version 748981 (0.0008) [2023-12-28 00:37:22,173][106225] Updated weights for policy 1, policy_version 748991 (0.0009) [2023-12-28 00:37:22,571][106226] Updated weights for policy 0, policy_version 747010 (0.0009) [2023-12-28 00:37:22,636][106226] Updated weights for policy 0, policy_version 747020 (0.0009) [2023-12-28 00:37:22,701][106226] Updated weights for policy 0, policy_version 747030 (0.0006) [2023-12-28 00:37:22,969][106225] Updated weights for policy 1, policy_version 749001 (0.0009) [2023-12-28 00:37:23,029][106225] Updated weights for policy 1, policy_version 749011 (0.0008) [2023-12-28 00:37:23,084][106225] Updated weights for policy 1, policy_version 749021 (0.0009) [2023-12-28 00:37:23,144][106225] Updated weights for policy 1, policy_version 749031 (0.0009) [2023-12-28 00:37:23,346][106226] Updated weights for policy 0, policy_version 747040 (0.0008) [2023-12-28 00:37:23,402][106226] Updated weights for policy 0, policy_version 747050 (0.0008) [2023-12-28 00:37:23,451][106226] Updated weights for policy 0, policy_version 747060 (0.0008) [2023-12-28 00:37:23,897][106225] Updated weights for policy 1, policy_version 749041 (0.0008) [2023-12-28 00:37:23,955][106225] Updated weights for policy 1, policy_version 749051 (0.0008) [2023-12-28 00:37:24,011][106225] Updated weights for policy 1, policy_version 749061 (0.0009) [2023-12-28 00:37:24,187][106226] Updated weights for policy 0, policy_version 747070 (0.0009) [2023-12-28 00:37:24,246][106226] Updated weights for policy 0, policy_version 747080 (0.0008) [2023-12-28 00:37:24,308][106226] Updated weights for policy 0, policy_version 747090 (0.0008) [2023-12-28 00:37:24,734][106225] Updated weights for policy 1, policy_version 749071 (0.0008) [2023-12-28 00:37:24,785][106225] Updated weights for policy 1, policy_version 749081 (0.0008) [2023-12-28 00:37:24,845][106225] Updated weights for policy 1, policy_version 749091 (0.0008) [2023-12-28 00:37:25,057][106226] Updated weights for policy 0, policy_version 747100 (0.0009) [2023-12-28 00:37:25,116][106226] Updated weights for policy 0, policy_version 747110 (0.0009) [2023-12-28 00:37:25,181][106226] Updated weights for policy 0, policy_version 747120 (0.0008) [2023-12-28 00:37:25,560][106225] Updated weights for policy 1, policy_version 749101 (0.0008) [2023-12-28 00:37:25,622][106225] Updated weights for policy 1, policy_version 749111 (0.0009) [2023-12-28 00:37:25,679][106225] Updated weights for policy 1, policy_version 749121 (0.0009) [2023-12-28 00:37:25,800][106226] Updated weights for policy 0, policy_version 747130 (0.0008) [2023-12-28 00:37:25,861][106226] Updated weights for policy 0, policy_version 747140 (0.0008) [2023-12-28 00:37:25,922][106226] Updated weights for policy 0, policy_version 747150 (0.0009) [2023-12-28 00:37:25,979][106226] Updated weights for policy 0, policy_version 747160 (0.0009) [2023-12-28 00:37:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 383139840. Throughput: 0: 9863.5, 1: 9679.4. Samples: 383108916. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:26,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-5.226')] [2023-12-28 00:37:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000749128_191815680.pth... [2023-12-28 00:37:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000747160_191324160.pth... [2023-12-28 00:37:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000748008_191528960.pth [2023-12-28 00:37:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000746008_191029248.pth [2023-12-28 00:37:26,388][106225] Updated weights for policy 1, policy_version 749131 (0.0008) [2023-12-28 00:37:26,439][106225] Updated weights for policy 1, policy_version 749141 (0.0009) [2023-12-28 00:37:26,483][106225] Updated weights for policy 1, policy_version 749151 (0.0010) [2023-12-28 00:37:26,650][106226] Updated weights for policy 0, policy_version 747170 (0.0008) [2023-12-28 00:37:26,711][106226] Updated weights for policy 0, policy_version 747180 (0.0005) [2023-12-28 00:37:26,774][106226] Updated weights for policy 0, policy_version 747190 (0.0005) [2023-12-28 00:37:27,272][106225] Updated weights for policy 1, policy_version 749161 (0.0010) [2023-12-28 00:37:27,303][106226] Updated weights for policy 0, policy_version 747200 (0.0008) [2023-12-28 00:37:27,339][106225] Updated weights for policy 1, policy_version 749171 (0.0008) [2023-12-28 00:37:27,368][106226] Updated weights for policy 0, policy_version 747210 (0.0008) [2023-12-28 00:37:27,396][106225] Updated weights for policy 1, policy_version 749181 (0.0007) [2023-12-28 00:37:27,428][106226] Updated weights for policy 0, policy_version 747220 (0.0007) [2023-12-28 00:37:27,450][106225] Updated weights for policy 1, policy_version 749191 (0.0006) [2023-12-28 00:37:28,058][106225] Updated weights for policy 1, policy_version 749201 (0.0008) [2023-12-28 00:37:28,110][106225] Updated weights for policy 1, policy_version 749211 (0.0008) [2023-12-28 00:37:28,158][106226] Updated weights for policy 0, policy_version 747230 (0.0008) [2023-12-28 00:37:28,172][106225] Updated weights for policy 1, policy_version 749221 (0.0007) [2023-12-28 00:37:28,206][106226] Updated weights for policy 0, policy_version 747240 (0.0007) [2023-12-28 00:37:28,255][106226] Updated weights for policy 0, policy_version 747250 (0.0009) [2023-12-28 00:37:28,927][106225] Updated weights for policy 1, policy_version 749231 (0.0008) [2023-12-28 00:37:28,978][106225] Updated weights for policy 1, policy_version 749241 (0.0008) [2023-12-28 00:37:28,984][106226] Updated weights for policy 0, policy_version 747260 (0.0008) [2023-12-28 00:37:29,033][106226] Updated weights for policy 0, policy_version 747270 (0.0010) [2023-12-28 00:37:29,036][106225] Updated weights for policy 1, policy_version 749251 (0.0006) [2023-12-28 00:37:29,080][106226] Updated weights for policy 0, policy_version 747280 (0.0006) [2023-12-28 00:37:29,754][106225] Updated weights for policy 1, policy_version 749261 (0.0008) [2023-12-28 00:37:29,805][106225] Updated weights for policy 1, policy_version 749271 (0.0009) [2023-12-28 00:37:29,815][106226] Updated weights for policy 0, policy_version 747290 (0.0010) [2023-12-28 00:37:29,867][106225] Updated weights for policy 1, policy_version 749281 (0.0009) [2023-12-28 00:37:29,877][106226] Updated weights for policy 0, policy_version 747300 (0.0008) [2023-12-28 00:37:29,928][106226] Updated weights for policy 0, policy_version 747310 (0.0009) [2023-12-28 00:37:29,994][106226] Updated weights for policy 0, policy_version 747320 (0.0009) [2023-12-28 00:37:30,667][106226] Updated weights for policy 0, policy_version 747330 (0.0008) [2023-12-28 00:37:30,669][106225] Updated weights for policy 1, policy_version 749291 (0.0006) [2023-12-28 00:37:30,718][106226] Updated weights for policy 0, policy_version 747340 (0.0006) [2023-12-28 00:37:30,720][106225] Updated weights for policy 1, policy_version 749301 (0.0007) [2023-12-28 00:37:30,776][106225] Updated weights for policy 1, policy_version 749311 (0.0007) [2023-12-28 00:37:30,778][106226] Updated weights for policy 0, policy_version 747350 (0.0005) [2023-12-28 00:37:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 383238144. Throughput: 0: 9909.6, 1: 9734.8. Samples: 383227744. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:31,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.975')] [2023-12-28 00:37:31,477][106226] Updated weights for policy 0, policy_version 747360 (0.0005) [2023-12-28 00:37:31,496][106225] Updated weights for policy 1, policy_version 749321 (0.0007) [2023-12-28 00:37:31,537][106226] Updated weights for policy 0, policy_version 747370 (0.0006) [2023-12-28 00:37:31,544][106225] Updated weights for policy 1, policy_version 749331 (0.0007) [2023-12-28 00:37:31,593][106225] Updated weights for policy 1, policy_version 749341 (0.0008) [2023-12-28 00:37:31,595][106226] Updated weights for policy 0, policy_version 747380 (0.0008) [2023-12-28 00:37:31,662][106225] Updated weights for policy 1, policy_version 749351 (0.0008) [2023-12-28 00:37:32,286][106226] Updated weights for policy 0, policy_version 747390 (0.0010) [2023-12-28 00:37:32,350][106226] Updated weights for policy 0, policy_version 747400 (0.0011) [2023-12-28 00:37:32,411][106225] Updated weights for policy 1, policy_version 749361 (0.0007) [2023-12-28 00:37:32,418][106226] Updated weights for policy 0, policy_version 747410 (0.0010) [2023-12-28 00:37:32,470][106225] Updated weights for policy 1, policy_version 749371 (0.0006) [2023-12-28 00:37:32,531][106225] Updated weights for policy 1, policy_version 749381 (0.0009) [2023-12-28 00:37:33,038][106226] Updated weights for policy 0, policy_version 747420 (0.0008) [2023-12-28 00:37:33,099][106226] Updated weights for policy 0, policy_version 747430 (0.0005) [2023-12-28 00:37:33,150][106226] Updated weights for policy 0, policy_version 747440 (0.0006) [2023-12-28 00:37:33,291][106225] Updated weights for policy 1, policy_version 749391 (0.0006) [2023-12-28 00:37:33,353][106225] Updated weights for policy 1, policy_version 749401 (0.0007) [2023-12-28 00:37:33,406][106225] Updated weights for policy 1, policy_version 749411 (0.0008) [2023-12-28 00:37:33,775][106226] Updated weights for policy 0, policy_version 747450 (0.0006) [2023-12-28 00:37:33,825][106226] Updated weights for policy 0, policy_version 747460 (0.0008) [2023-12-28 00:37:33,869][106226] Updated weights for policy 0, policy_version 747470 (0.0008) [2023-12-28 00:37:33,912][106226] Updated weights for policy 0, policy_version 747480 (0.0008) [2023-12-28 00:37:34,072][106225] Updated weights for policy 1, policy_version 749421 (0.0007) [2023-12-28 00:37:34,123][106225] Updated weights for policy 1, policy_version 749431 (0.0009) [2023-12-28 00:37:34,190][106225] Updated weights for policy 1, policy_version 749441 (0.0008) [2023-12-28 00:37:34,643][106226] Updated weights for policy 0, policy_version 747490 (0.0008) [2023-12-28 00:37:34,710][106226] Updated weights for policy 0, policy_version 747500 (0.0006) [2023-12-28 00:37:34,767][106226] Updated weights for policy 0, policy_version 747510 (0.0009) [2023-12-28 00:37:34,951][106225] Updated weights for policy 1, policy_version 749451 (0.0008) [2023-12-28 00:37:35,012][106225] Updated weights for policy 1, policy_version 749461 (0.0009) [2023-12-28 00:37:35,065][106225] Updated weights for policy 1, policy_version 749471 (0.0005) [2023-12-28 00:37:35,411][106226] Updated weights for policy 0, policy_version 747520 (0.0009) [2023-12-28 00:37:35,466][106226] Updated weights for policy 0, policy_version 747530 (0.0007) [2023-12-28 00:37:35,516][106226] Updated weights for policy 0, policy_version 747540 (0.0009) [2023-12-28 00:37:35,715][106225] Updated weights for policy 1, policy_version 749481 (0.0007) [2023-12-28 00:37:35,782][106225] Updated weights for policy 1, policy_version 749491 (0.0007) [2023-12-28 00:37:35,838][106225] Updated weights for policy 1, policy_version 749501 (0.0006) [2023-12-28 00:37:35,898][106225] Updated weights for policy 1, policy_version 749511 (0.0007) [2023-12-28 00:37:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 383336448. Throughput: 0: 9920.4, 1: 9707.0. Samples: 383346744. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:36,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.955')] [2023-12-28 00:37:36,282][106226] Updated weights for policy 0, policy_version 747550 (0.0008) [2023-12-28 00:37:36,341][106226] Updated weights for policy 0, policy_version 747560 (0.0008) [2023-12-28 00:37:36,400][106226] Updated weights for policy 0, policy_version 747570 (0.0009) [2023-12-28 00:37:36,590][106225] Updated weights for policy 1, policy_version 749521 (0.0006) [2023-12-28 00:37:36,653][106225] Updated weights for policy 1, policy_version 749531 (0.0011) [2023-12-28 00:37:36,711][106225] Updated weights for policy 1, policy_version 749541 (0.0010) [2023-12-28 00:37:37,196][106226] Updated weights for policy 0, policy_version 747580 (0.0007) [2023-12-28 00:37:37,261][106226] Updated weights for policy 0, policy_version 747590 (0.0005) [2023-12-28 00:37:37,329][106226] Updated weights for policy 0, policy_version 747600 (0.0005) [2023-12-28 00:37:37,338][106225] Updated weights for policy 1, policy_version 749551 (0.0011) [2023-12-28 00:37:37,401][106225] Updated weights for policy 1, policy_version 749561 (0.0010) [2023-12-28 00:37:37,466][106225] Updated weights for policy 1, policy_version 749571 (0.0011) [2023-12-28 00:37:37,879][106226] Updated weights for policy 0, policy_version 747610 (0.0005) [2023-12-28 00:37:37,940][106226] Updated weights for policy 0, policy_version 747620 (0.0005) [2023-12-28 00:37:38,008][106226] Updated weights for policy 0, policy_version 747630 (0.0006) [2023-12-28 00:37:38,068][106226] Updated weights for policy 0, policy_version 747640 (0.0006) [2023-12-28 00:37:38,145][106225] Updated weights for policy 1, policy_version 749581 (0.0010) [2023-12-28 00:37:38,194][106225] Updated weights for policy 1, policy_version 749591 (0.0008) [2023-12-28 00:37:38,246][106225] Updated weights for policy 1, policy_version 749601 (0.0005) [2023-12-28 00:37:38,733][106226] Updated weights for policy 0, policy_version 747650 (0.0008) [2023-12-28 00:37:38,803][106226] Updated weights for policy 0, policy_version 747660 (0.0008) [2023-12-28 00:37:38,873][106226] Updated weights for policy 0, policy_version 747670 (0.0009) [2023-12-28 00:37:38,973][106225] Updated weights for policy 1, policy_version 749611 (0.0009) [2023-12-28 00:37:39,026][106225] Updated weights for policy 1, policy_version 749621 (0.0009) [2023-12-28 00:37:39,087][106225] Updated weights for policy 1, policy_version 749631 (0.0008) [2023-12-28 00:37:39,637][106226] Updated weights for policy 0, policy_version 747680 (0.0009) [2023-12-28 00:37:39,695][106226] Updated weights for policy 0, policy_version 747690 (0.0009) [2023-12-28 00:37:39,759][106226] Updated weights for policy 0, policy_version 747700 (0.0009) [2023-12-28 00:37:39,775][106225] Updated weights for policy 1, policy_version 749641 (0.0006) [2023-12-28 00:37:39,841][106225] Updated weights for policy 1, policy_version 749651 (0.0007) [2023-12-28 00:37:39,905][106225] Updated weights for policy 1, policy_version 749661 (0.0007) [2023-12-28 00:37:39,975][106225] Updated weights for policy 1, policy_version 749671 (0.0009) [2023-12-28 00:37:40,558][106226] Updated weights for policy 0, policy_version 747710 (0.0008) [2023-12-28 00:37:40,607][106226] Updated weights for policy 0, policy_version 747720 (0.0009) [2023-12-28 00:37:40,663][106226] Updated weights for policy 0, policy_version 747730 (0.0008) [2023-12-28 00:37:40,708][106225] Updated weights for policy 1, policy_version 749681 (0.0006) [2023-12-28 00:37:40,761][106225] Updated weights for policy 1, policy_version 749691 (0.0008) [2023-12-28 00:37:40,812][106225] Updated weights for policy 1, policy_version 749701 (0.0008) [2023-12-28 00:37:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 383434752. Throughput: 0: 9956.0, 1: 9729.0. Samples: 383406812. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:41,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-5.556')] [2023-12-28 00:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000749704_191963136.pth... [2023-12-28 00:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000747736_191471616.pth... [2023-12-28 00:37:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000746584_191176704.pth [2023-12-28 00:37:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000748584_191676416.pth [2023-12-28 00:37:41,482][106226] Updated weights for policy 0, policy_version 747740 (0.0008) [2023-12-28 00:37:41,544][106226] Updated weights for policy 0, policy_version 747750 (0.0008) [2023-12-28 00:37:41,603][106226] Updated weights for policy 0, policy_version 747760 (0.0007) [2023-12-28 00:37:41,622][106225] Updated weights for policy 1, policy_version 749711 (0.0008) [2023-12-28 00:37:41,682][106225] Updated weights for policy 1, policy_version 749721 (0.0010) [2023-12-28 00:37:41,746][106225] Updated weights for policy 1, policy_version 749731 (0.0009) [2023-12-28 00:37:42,382][106226] Updated weights for policy 0, policy_version 747770 (0.0009) [2023-12-28 00:37:42,446][106226] Updated weights for policy 0, policy_version 747780 (0.0009) [2023-12-28 00:37:42,484][106225] Updated weights for policy 1, policy_version 749741 (0.0008) [2023-12-28 00:37:42,501][106226] Updated weights for policy 0, policy_version 747790 (0.0008) [2023-12-28 00:37:42,532][106225] Updated weights for policy 1, policy_version 749751 (0.0008) [2023-12-28 00:37:42,552][106226] Updated weights for policy 0, policy_version 747800 (0.0008) [2023-12-28 00:37:42,579][106225] Updated weights for policy 1, policy_version 749761 (0.0008) [2023-12-28 00:37:43,282][106226] Updated weights for policy 0, policy_version 747810 (0.0008) [2023-12-28 00:37:43,339][106226] Updated weights for policy 0, policy_version 747820 (0.0008) [2023-12-28 00:37:43,354][106225] Updated weights for policy 1, policy_version 749771 (0.0009) [2023-12-28 00:37:43,398][106226] Updated weights for policy 0, policy_version 747830 (0.0007) [2023-12-28 00:37:43,404][106225] Updated weights for policy 1, policy_version 749781 (0.0010) [2023-12-28 00:37:43,450][106225] Updated weights for policy 1, policy_version 749791 (0.0010) [2023-12-28 00:37:44,107][106225] Updated weights for policy 1, policy_version 749801 (0.0009) [2023-12-28 00:37:44,153][106226] Updated weights for policy 0, policy_version 747840 (0.0007) [2023-12-28 00:37:44,165][106225] Updated weights for policy 1, policy_version 749811 (0.0006) [2023-12-28 00:37:44,214][106226] Updated weights for policy 0, policy_version 747850 (0.0008) [2023-12-28 00:37:44,228][106225] Updated weights for policy 1, policy_version 749821 (0.0008) [2023-12-28 00:37:44,266][106226] Updated weights for policy 0, policy_version 747860 (0.0007) [2023-12-28 00:37:44,283][106225] Updated weights for policy 1, policy_version 749831 (0.0006) [2023-12-28 00:37:44,953][106225] Updated weights for policy 1, policy_version 749841 (0.0010) [2023-12-28 00:37:45,005][106225] Updated weights for policy 1, policy_version 749851 (0.0010) [2023-12-28 00:37:45,027][106226] Updated weights for policy 0, policy_version 747870 (0.0006) [2023-12-28 00:37:45,068][106225] Updated weights for policy 1, policy_version 749861 (0.0011) [2023-12-28 00:37:45,086][106226] Updated weights for policy 0, policy_version 747880 (0.0006) [2023-12-28 00:37:45,134][106226] Updated weights for policy 0, policy_version 747890 (0.0008) [2023-12-28 00:37:45,781][106225] Updated weights for policy 1, policy_version 749871 (0.0010) [2023-12-28 00:37:45,828][106225] Updated weights for policy 1, policy_version 749881 (0.0010) [2023-12-28 00:37:45,882][106225] Updated weights for policy 1, policy_version 749891 (0.0007) [2023-12-28 00:37:45,888][106226] Updated weights for policy 0, policy_version 747900 (0.0009) [2023-12-28 00:37:45,937][106226] Updated weights for policy 0, policy_version 747910 (0.0008) [2023-12-28 00:37:45,986][106226] Updated weights for policy 0, policy_version 747920 (0.0008) [2023-12-28 00:37:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 383533056. Throughput: 0: 9816.3, 1: 9697.9. Samples: 383519804. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:46,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.084')] [2023-12-28 00:37:46,539][106225] Updated weights for policy 1, policy_version 749901 (0.0006) [2023-12-28 00:37:46,608][106225] Updated weights for policy 1, policy_version 749911 (0.0007) [2023-12-28 00:37:46,662][106225] Updated weights for policy 1, policy_version 749921 (0.0008) [2023-12-28 00:37:46,758][106226] Updated weights for policy 0, policy_version 747930 (0.0007) [2023-12-28 00:37:46,813][106226] Updated weights for policy 0, policy_version 747940 (0.0008) [2023-12-28 00:37:46,875][106226] Updated weights for policy 0, policy_version 747950 (0.0009) [2023-12-28 00:37:46,927][106226] Updated weights for policy 0, policy_version 747960 (0.0008) [2023-12-28 00:37:47,285][106225] Updated weights for policy 1, policy_version 749931 (0.0008) [2023-12-28 00:37:47,336][106225] Updated weights for policy 1, policy_version 749941 (0.0008) [2023-12-28 00:37:47,382][106225] Updated weights for policy 1, policy_version 749951 (0.0009) [2023-12-28 00:37:47,688][106226] Updated weights for policy 0, policy_version 747970 (0.0011) [2023-12-28 00:37:47,756][106226] Updated weights for policy 0, policy_version 747980 (0.0011) [2023-12-28 00:37:47,819][106226] Updated weights for policy 0, policy_version 747990 (0.0010) [2023-12-28 00:37:48,085][106225] Updated weights for policy 1, policy_version 749961 (0.0010) [2023-12-28 00:37:48,136][106225] Updated weights for policy 1, policy_version 749971 (0.0005) [2023-12-28 00:37:48,191][106225] Updated weights for policy 1, policy_version 749981 (0.0008) [2023-12-28 00:37:48,252][106225] Updated weights for policy 1, policy_version 749991 (0.0008) [2023-12-28 00:37:48,507][106226] Updated weights for policy 0, policy_version 748000 (0.0009) [2023-12-28 00:37:48,567][106226] Updated weights for policy 0, policy_version 748010 (0.0009) [2023-12-28 00:37:48,627][106226] Updated weights for policy 0, policy_version 748020 (0.0009) [2023-12-28 00:37:48,954][106225] Updated weights for policy 1, policy_version 750001 (0.0008) [2023-12-28 00:37:49,011][106225] Updated weights for policy 1, policy_version 750011 (0.0008) [2023-12-28 00:37:49,070][106225] Updated weights for policy 1, policy_version 750021 (0.0008) [2023-12-28 00:37:49,341][106226] Updated weights for policy 0, policy_version 748030 (0.0009) [2023-12-28 00:37:49,406][106226] Updated weights for policy 0, policy_version 748040 (0.0007) [2023-12-28 00:37:49,460][106226] Updated weights for policy 0, policy_version 748050 (0.0005) [2023-12-28 00:37:49,792][106225] Updated weights for policy 1, policy_version 750031 (0.0008) [2023-12-28 00:37:49,857][106225] Updated weights for policy 1, policy_version 750041 (0.0009) [2023-12-28 00:37:49,909][106225] Updated weights for policy 1, policy_version 750051 (0.0008) [2023-12-28 00:37:50,099][106226] Updated weights for policy 0, policy_version 748060 (0.0007) [2023-12-28 00:37:50,164][106226] Updated weights for policy 0, policy_version 748070 (0.0008) [2023-12-28 00:37:50,225][106226] Updated weights for policy 0, policy_version 748080 (0.0008) [2023-12-28 00:37:50,589][106225] Updated weights for policy 1, policy_version 750061 (0.0009) [2023-12-28 00:37:50,651][106225] Updated weights for policy 1, policy_version 750071 (0.0008) [2023-12-28 00:37:50,712][106225] Updated weights for policy 1, policy_version 750081 (0.0008) [2023-12-28 00:37:50,979][106226] Updated weights for policy 0, policy_version 748090 (0.0008) [2023-12-28 00:37:51,055][106226] Updated weights for policy 0, policy_version 748101 (0.0008) [2023-12-28 00:37:51,118][106226] Updated weights for policy 0, policy_version 748111 (0.0008) [2023-12-28 00:37:51,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 383623168. Throughput: 0: 9756.5, 1: 9695.9. Samples: 383636976. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:51,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-5.252')] [2023-12-28 00:37:51,479][106225] Updated weights for policy 1, policy_version 750091 (0.0009) [2023-12-28 00:37:51,535][106225] Updated weights for policy 1, policy_version 750101 (0.0008) [2023-12-28 00:37:51,596][106225] Updated weights for policy 1, policy_version 750111 (0.0007) [2023-12-28 00:37:51,903][106226] Updated weights for policy 0, policy_version 748121 (0.0006) [2023-12-28 00:37:51,964][106226] Updated weights for policy 0, policy_version 748131 (0.0009) [2023-12-28 00:37:52,025][106226] Updated weights for policy 0, policy_version 748141 (0.0009) [2023-12-28 00:37:52,079][106226] Updated weights for policy 0, policy_version 748151 (0.0009) [2023-12-28 00:37:52,360][106225] Updated weights for policy 1, policy_version 750121 (0.0009) [2023-12-28 00:37:52,427][106225] Updated weights for policy 1, policy_version 750131 (0.0008) [2023-12-28 00:37:52,492][106225] Updated weights for policy 1, policy_version 750141 (0.0008) [2023-12-28 00:37:52,553][106225] Updated weights for policy 1, policy_version 750151 (0.0008) [2023-12-28 00:37:52,838][106226] Updated weights for policy 0, policy_version 748161 (0.0009) [2023-12-28 00:37:52,889][106226] Updated weights for policy 0, policy_version 748171 (0.0008) [2023-12-28 00:37:52,946][106226] Updated weights for policy 0, policy_version 748181 (0.0010) [2023-12-28 00:37:53,207][106225] Updated weights for policy 1, policy_version 750161 (0.0009) [2023-12-28 00:37:53,262][106225] Updated weights for policy 1, policy_version 750171 (0.0007) [2023-12-28 00:37:53,318][106225] Updated weights for policy 1, policy_version 750181 (0.0007) [2023-12-28 00:37:53,634][106226] Updated weights for policy 0, policy_version 748191 (0.0009) [2023-12-28 00:37:53,682][106226] Updated weights for policy 0, policy_version 748201 (0.0005) [2023-12-28 00:37:53,741][106226] Updated weights for policy 0, policy_version 748211 (0.0005) [2023-12-28 00:37:53,973][106225] Updated weights for policy 1, policy_version 750191 (0.0006) [2023-12-28 00:37:54,027][106225] Updated weights for policy 1, policy_version 750201 (0.0006) [2023-12-28 00:37:54,089][106225] Updated weights for policy 1, policy_version 750211 (0.0008) [2023-12-28 00:37:54,384][106226] Updated weights for policy 0, policy_version 748221 (0.0008) [2023-12-28 00:37:54,447][106226] Updated weights for policy 0, policy_version 748231 (0.0009) [2023-12-28 00:37:54,513][106226] Updated weights for policy 0, policy_version 748241 (0.0005) [2023-12-28 00:37:54,841][106225] Updated weights for policy 1, policy_version 750221 (0.0009) [2023-12-28 00:37:54,887][106225] Updated weights for policy 1, policy_version 750231 (0.0008) [2023-12-28 00:37:54,938][106225] Updated weights for policy 1, policy_version 750241 (0.0007) [2023-12-28 00:37:55,088][106226] Updated weights for policy 0, policy_version 748251 (0.0007) [2023-12-28 00:37:55,142][106226] Updated weights for policy 0, policy_version 748261 (0.0011) [2023-12-28 00:37:55,199][106226] Updated weights for policy 0, policy_version 748271 (0.0011) [2023-12-28 00:37:55,650][106225] Updated weights for policy 1, policy_version 750251 (0.0006) [2023-12-28 00:37:55,704][106225] Updated weights for policy 1, policy_version 750261 (0.0005) [2023-12-28 00:37:55,764][106225] Updated weights for policy 1, policy_version 750271 (0.0005) [2023-12-28 00:37:55,926][106226] Updated weights for policy 0, policy_version 748281 (0.0010) [2023-12-28 00:37:55,994][106226] Updated weights for policy 0, policy_version 748291 (0.0009) [2023-12-28 00:37:56,055][106226] Updated weights for policy 0, policy_version 748301 (0.0009) [2023-12-28 00:37:56,115][106226] Updated weights for policy 0, policy_version 748311 (0.0009) [2023-12-28 00:37:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 383729664. Throughput: 0: 9760.2, 1: 9695.8. Samples: 383695560. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:37:56,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.303')] [2023-12-28 00:37:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000750280_192110592.pth... [2023-12-28 00:37:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000748312_191619072.pth... [2023-12-28 00:37:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000747160_191324160.pth [2023-12-28 00:37:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000749128_191815680.pth [2023-12-28 00:37:56,339][106225] Updated weights for policy 1, policy_version 750281 (0.0006) [2023-12-28 00:37:56,403][106225] Updated weights for policy 1, policy_version 750291 (0.0009) [2023-12-28 00:37:56,451][106225] Updated weights for policy 1, policy_version 750301 (0.0008) [2023-12-28 00:37:56,507][106225] Updated weights for policy 1, policy_version 750311 (0.0008) [2023-12-28 00:37:56,793][106226] Updated weights for policy 0, policy_version 748321 (0.0008) [2023-12-28 00:37:56,846][106226] Updated weights for policy 0, policy_version 748331 (0.0009) [2023-12-28 00:37:56,901][106226] Updated weights for policy 0, policy_version 748341 (0.0008) [2023-12-28 00:37:57,136][106225] Updated weights for policy 1, policy_version 750321 (0.0005) [2023-12-28 00:37:57,200][106225] Updated weights for policy 1, policy_version 750331 (0.0007) [2023-12-28 00:37:57,252][106225] Updated weights for policy 1, policy_version 750341 (0.0010) [2023-12-28 00:37:57,632][106226] Updated weights for policy 0, policy_version 748351 (0.0009) [2023-12-28 00:37:57,696][106226] Updated weights for policy 0, policy_version 748361 (0.0008) [2023-12-28 00:37:57,757][106226] Updated weights for policy 0, policy_version 748371 (0.0009) [2023-12-28 00:37:57,874][106225] Updated weights for policy 1, policy_version 750351 (0.0010) [2023-12-28 00:37:57,931][106225] Updated weights for policy 1, policy_version 750361 (0.0007) [2023-12-28 00:37:57,988][106225] Updated weights for policy 1, policy_version 750371 (0.0010) [2023-12-28 00:37:58,524][106226] Updated weights for policy 0, policy_version 748381 (0.0008) [2023-12-28 00:37:58,588][106226] Updated weights for policy 0, policy_version 748391 (0.0008) [2023-12-28 00:37:58,654][106226] Updated weights for policy 0, policy_version 748401 (0.0008) [2023-12-28 00:37:58,755][106225] Updated weights for policy 1, policy_version 750381 (0.0009) [2023-12-28 00:37:58,820][106225] Updated weights for policy 1, policy_version 750391 (0.0008) [2023-12-28 00:37:58,889][106225] Updated weights for policy 1, policy_version 750401 (0.0008) [2023-12-28 00:37:59,514][106226] Updated weights for policy 0, policy_version 748412 (0.0009) [2023-12-28 00:37:59,581][106226] Updated weights for policy 0, policy_version 748422 (0.0011) [2023-12-28 00:37:59,649][106226] Updated weights for policy 0, policy_version 748432 (0.0011) [2023-12-28 00:37:59,669][106225] Updated weights for policy 1, policy_version 750411 (0.0009) [2023-12-28 00:37:59,734][106225] Updated weights for policy 1, policy_version 750421 (0.0009) [2023-12-28 00:37:59,800][106225] Updated weights for policy 1, policy_version 750431 (0.0010) [2023-12-28 00:38:00,321][106226] Updated weights for policy 0, policy_version 748442 (0.0010) [2023-12-28 00:38:00,376][106226] Updated weights for policy 0, policy_version 748452 (0.0008) [2023-12-28 00:38:00,434][106226] Updated weights for policy 0, policy_version 748462 (0.0008) [2023-12-28 00:38:00,479][106226] Updated weights for policy 0, policy_version 748472 (0.0008) [2023-12-28 00:38:00,523][106225] Updated weights for policy 1, policy_version 750441 (0.0009) [2023-12-28 00:38:00,574][106225] Updated weights for policy 1, policy_version 750451 (0.0007) [2023-12-28 00:38:00,628][106225] Updated weights for policy 1, policy_version 750462 (0.0008) [2023-12-28 00:38:00,682][106225] Updated weights for policy 1, policy_version 750472 (0.0008) [2023-12-28 00:38:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 383819776. Throughput: 0: 9753.2, 1: 9786.2. Samples: 383813792. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:01,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-5.265')] [2023-12-28 00:38:01,203][106226] Updated weights for policy 0, policy_version 748482 (0.0009) [2023-12-28 00:38:01,269][106226] Updated weights for policy 0, policy_version 748492 (0.0008) [2023-12-28 00:38:01,329][106226] Updated weights for policy 0, policy_version 748502 (0.0008) [2023-12-28 00:38:01,413][106225] Updated weights for policy 1, policy_version 750482 (0.0008) [2023-12-28 00:38:01,464][106225] Updated weights for policy 1, policy_version 750492 (0.0009) [2023-12-28 00:38:01,525][106225] Updated weights for policy 1, policy_version 750502 (0.0007) [2023-12-28 00:38:02,071][106226] Updated weights for policy 0, policy_version 748512 (0.0008) [2023-12-28 00:38:02,132][106226] Updated weights for policy 0, policy_version 748522 (0.0008) [2023-12-28 00:38:02,188][106225] Updated weights for policy 1, policy_version 750512 (0.0007) [2023-12-28 00:38:02,191][106226] Updated weights for policy 0, policy_version 748532 (0.0006) [2023-12-28 00:38:02,244][106225] Updated weights for policy 1, policy_version 750522 (0.0007) [2023-12-28 00:38:02,308][106225] Updated weights for policy 1, policy_version 750532 (0.0008) [2023-12-28 00:38:02,940][106226] Updated weights for policy 0, policy_version 748542 (0.0007) [2023-12-28 00:38:02,985][106226] Updated weights for policy 0, policy_version 748552 (0.0008) [2023-12-28 00:38:03,029][106225] Updated weights for policy 1, policy_version 750542 (0.0009) [2023-12-28 00:38:03,034][106226] Updated weights for policy 0, policy_version 748562 (0.0008) [2023-12-28 00:38:03,072][106225] Updated weights for policy 1, policy_version 750552 (0.0007) [2023-12-28 00:38:03,118][106225] Updated weights for policy 1, policy_version 750562 (0.0007) [2023-12-28 00:38:03,789][106225] Updated weights for policy 1, policy_version 750572 (0.0009) [2023-12-28 00:38:03,799][106226] Updated weights for policy 0, policy_version 748572 (0.0007) [2023-12-28 00:38:03,842][106225] Updated weights for policy 1, policy_version 750582 (0.0010) [2023-12-28 00:38:03,858][106226] Updated weights for policy 0, policy_version 748582 (0.0006) [2023-12-28 00:38:03,909][106225] Updated weights for policy 1, policy_version 750592 (0.0010) [2023-12-28 00:38:03,917][106226] Updated weights for policy 0, policy_version 748592 (0.0008) [2023-12-28 00:38:04,622][106226] Updated weights for policy 0, policy_version 748602 (0.0008) [2023-12-28 00:38:04,646][106225] Updated weights for policy 1, policy_version 750602 (0.0010) [2023-12-28 00:38:04,673][106226] Updated weights for policy 0, policy_version 748612 (0.0011) [2023-12-28 00:38:04,695][106225] Updated weights for policy 1, policy_version 750613 (0.0010) [2023-12-28 00:38:04,730][106226] Updated weights for policy 0, policy_version 748622 (0.0010) [2023-12-28 00:38:04,750][106225] Updated weights for policy 1, policy_version 750623 (0.0006) [2023-12-28 00:38:04,782][106226] Updated weights for policy 0, policy_version 748632 (0.0008) [2023-12-28 00:38:05,457][106226] Updated weights for policy 0, policy_version 748642 (0.0008) [2023-12-28 00:38:05,461][106225] Updated weights for policy 1, policy_version 750633 (0.0008) [2023-12-28 00:38:05,519][106225] Updated weights for policy 1, policy_version 750643 (0.0010) [2023-12-28 00:38:05,521][106226] Updated weights for policy 0, policy_version 748652 (0.0006) [2023-12-28 00:38:05,570][106225] Updated weights for policy 1, policy_version 750653 (0.0010) [2023-12-28 00:38:05,580][106226] Updated weights for policy 0, policy_version 748662 (0.0005) [2023-12-28 00:38:05,621][106225] Updated weights for policy 1, policy_version 750663 (0.0010) [2023-12-28 00:38:06,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19688.6). Total num frames: 383918080. Throughput: 0: 9753.3, 1: 9781.7. Samples: 383931848. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:06,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-5.267')] [2023-12-28 00:38:06,182][106226] Updated weights for policy 0, policy_version 748672 (0.0006) [2023-12-28 00:38:06,244][106226] Updated weights for policy 0, policy_version 748682 (0.0008) [2023-12-28 00:38:06,308][106226] Updated weights for policy 0, policy_version 748692 (0.0008) [2023-12-28 00:38:06,389][106225] Updated weights for policy 1, policy_version 750673 (0.0010) [2023-12-28 00:38:06,458][106225] Updated weights for policy 1, policy_version 750683 (0.0010) [2023-12-28 00:38:06,516][106225] Updated weights for policy 1, policy_version 750693 (0.0010) [2023-12-28 00:38:07,046][106226] Updated weights for policy 0, policy_version 748702 (0.0008) [2023-12-28 00:38:07,107][106226] Updated weights for policy 0, policy_version 748712 (0.0008) [2023-12-28 00:38:07,147][106225] Updated weights for policy 1, policy_version 750703 (0.0010) [2023-12-28 00:38:07,165][106226] Updated weights for policy 0, policy_version 748722 (0.0008) [2023-12-28 00:38:07,202][106225] Updated weights for policy 1, policy_version 750713 (0.0010) [2023-12-28 00:38:07,252][106225] Updated weights for policy 1, policy_version 750723 (0.0010) [2023-12-28 00:38:07,771][106226] Updated weights for policy 0, policy_version 748732 (0.0005) [2023-12-28 00:38:07,822][106226] Updated weights for policy 0, policy_version 748742 (0.0007) [2023-12-28 00:38:07,870][106226] Updated weights for policy 0, policy_version 748752 (0.0008) [2023-12-28 00:38:07,988][106225] Updated weights for policy 1, policy_version 750733 (0.0008) [2023-12-28 00:38:08,054][106225] Updated weights for policy 1, policy_version 750743 (0.0005) [2023-12-28 00:38:08,114][106225] Updated weights for policy 1, policy_version 750753 (0.0006) [2023-12-28 00:38:08,547][106226] Updated weights for policy 0, policy_version 748762 (0.0006) [2023-12-28 00:38:08,618][106226] Updated weights for policy 0, policy_version 748772 (0.0005) [2023-12-28 00:38:08,678][106226] Updated weights for policy 0, policy_version 748782 (0.0007) [2023-12-28 00:38:08,738][106226] Updated weights for policy 0, policy_version 748792 (0.0005) [2023-12-28 00:38:08,818][106225] Updated weights for policy 1, policy_version 750763 (0.0008) [2023-12-28 00:38:08,872][106225] Updated weights for policy 1, policy_version 750773 (0.0009) [2023-12-28 00:38:08,922][106225] Updated weights for policy 1, policy_version 750783 (0.0009) [2023-12-28 00:38:09,364][106226] Updated weights for policy 0, policy_version 748802 (0.0008) [2023-12-28 00:38:09,441][106226] Updated weights for policy 0, policy_version 748812 (0.0009) [2023-12-28 00:38:09,505][106226] Updated weights for policy 0, policy_version 748822 (0.0009) [2023-12-28 00:38:09,727][106225] Updated weights for policy 1, policy_version 750793 (0.0008) [2023-12-28 00:38:09,788][106225] Updated weights for policy 1, policy_version 750803 (0.0008) [2023-12-28 00:38:09,864][106225] Updated weights for policy 1, policy_version 750813 (0.0008) [2023-12-28 00:38:09,938][106225] Updated weights for policy 1, policy_version 750823 (0.0008) [2023-12-28 00:38:10,247][106226] Updated weights for policy 0, policy_version 748832 (0.0009) [2023-12-28 00:38:10,310][106226] Updated weights for policy 0, policy_version 748842 (0.0008) [2023-12-28 00:38:10,376][106226] Updated weights for policy 0, policy_version 748852 (0.0006) [2023-12-28 00:38:10,636][106225] Updated weights for policy 1, policy_version 750833 (0.0008) [2023-12-28 00:38:10,692][106225] Updated weights for policy 1, policy_version 750843 (0.0009) [2023-12-28 00:38:10,753][106225] Updated weights for policy 1, policy_version 750853 (0.0006) [2023-12-28 00:38:11,026][106226] Updated weights for policy 0, policy_version 748862 (0.0007) [2023-12-28 00:38:11,094][106226] Updated weights for policy 0, policy_version 748872 (0.0007) [2023-12-28 00:38:11,162][106226] Updated weights for policy 0, policy_version 748882 (0.0008) [2023-12-28 00:38:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 384016384. Throughput: 0: 9797.5, 1: 9845.9. Samples: 383992872. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:11,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-5.185')] [2023-12-28 00:38:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000750856_192258048.pth... [2023-12-28 00:38:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000749704_191963136.pth [2023-12-28 00:38:11,198][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000748888_191766528.pth... [2023-12-28 00:38:11,201][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000747736_191471616.pth [2023-12-28 00:38:11,466][106225] Updated weights for policy 1, policy_version 750863 (0.0007) [2023-12-28 00:38:11,526][106225] Updated weights for policy 1, policy_version 750873 (0.0009) [2023-12-28 00:38:11,583][106225] Updated weights for policy 1, policy_version 750883 (0.0007) [2023-12-28 00:38:11,893][106226] Updated weights for policy 0, policy_version 748892 (0.0009) [2023-12-28 00:38:11,956][106226] Updated weights for policy 0, policy_version 748902 (0.0008) [2023-12-28 00:38:12,016][106226] Updated weights for policy 0, policy_version 748912 (0.0008) [2023-12-28 00:38:12,377][106225] Updated weights for policy 1, policy_version 750893 (0.0009) [2023-12-28 00:38:12,431][106225] Updated weights for policy 1, policy_version 750903 (0.0008) [2023-12-28 00:38:12,492][106225] Updated weights for policy 1, policy_version 750913 (0.0007) [2023-12-28 00:38:12,755][106226] Updated weights for policy 0, policy_version 748922 (0.0009) [2023-12-28 00:38:12,824][106226] Updated weights for policy 0, policy_version 748932 (0.0009) [2023-12-28 00:38:12,889][106226] Updated weights for policy 0, policy_version 748942 (0.0009) [2023-12-28 00:38:12,958][106226] Updated weights for policy 0, policy_version 748952 (0.0009) [2023-12-28 00:38:13,160][106225] Updated weights for policy 1, policy_version 750923 (0.0007) [2023-12-28 00:38:13,213][106225] Updated weights for policy 1, policy_version 750933 (0.0010) [2023-12-28 00:38:13,269][106225] Updated weights for policy 1, policy_version 750943 (0.0010) [2023-12-28 00:38:13,584][106226] Updated weights for policy 0, policy_version 748962 (0.0005) [2023-12-28 00:38:13,640][106226] Updated weights for policy 0, policy_version 748972 (0.0005) [2023-12-28 00:38:13,693][106226] Updated weights for policy 0, policy_version 748982 (0.0008) [2023-12-28 00:38:14,061][106225] Updated weights for policy 1, policy_version 750953 (0.0008) [2023-12-28 00:38:14,111][106225] Updated weights for policy 1, policy_version 750963 (0.0008) [2023-12-28 00:38:14,165][106225] Updated weights for policy 1, policy_version 750973 (0.0008) [2023-12-28 00:38:14,217][106225] Updated weights for policy 1, policy_version 750983 (0.0008) [2023-12-28 00:38:14,346][106226] Updated weights for policy 0, policy_version 748992 (0.0009) [2023-12-28 00:38:14,400][106226] Updated weights for policy 0, policy_version 749002 (0.0007) [2023-12-28 00:38:14,450][106226] Updated weights for policy 0, policy_version 749012 (0.0007) [2023-12-28 00:38:14,980][106225] Updated weights for policy 1, policy_version 750993 (0.0007) [2023-12-28 00:38:15,040][106225] Updated weights for policy 1, policy_version 751003 (0.0009) [2023-12-28 00:38:15,101][106225] Updated weights for policy 1, policy_version 751013 (0.0008) [2023-12-28 00:38:15,161][106226] Updated weights for policy 0, policy_version 749022 (0.0008) [2023-12-28 00:38:15,216][106226] Updated weights for policy 0, policy_version 749032 (0.0010) [2023-12-28 00:38:15,281][106226] Updated weights for policy 0, policy_version 749042 (0.0009) [2023-12-28 00:38:15,780][106225] Updated weights for policy 1, policy_version 751023 (0.0006) [2023-12-28 00:38:15,838][106225] Updated weights for policy 1, policy_version 751033 (0.0006) [2023-12-28 00:38:15,900][106225] Updated weights for policy 1, policy_version 751043 (0.0007) [2023-12-28 00:38:15,957][106226] Updated weights for policy 0, policy_version 749052 (0.0007) [2023-12-28 00:38:16,016][106226] Updated weights for policy 0, policy_version 749062 (0.0005) [2023-12-28 00:38:16,064][106226] Updated weights for policy 0, policy_version 749072 (0.0005) [2023-12-28 00:38:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 384122880. Throughput: 0: 9768.1, 1: 9792.9. Samples: 384107988. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:16,176][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.510')] [2023-12-28 00:38:16,573][106225] Updated weights for policy 1, policy_version 751053 (0.0007) [2023-12-28 00:38:16,632][106226] Updated weights for policy 0, policy_version 749082 (0.0006) [2023-12-28 00:38:16,635][106225] Updated weights for policy 1, policy_version 751063 (0.0008) [2023-12-28 00:38:16,688][106225] Updated weights for policy 1, policy_version 751073 (0.0006) [2023-12-28 00:38:16,691][106226] Updated weights for policy 0, policy_version 749092 (0.0008) [2023-12-28 00:38:16,749][106226] Updated weights for policy 0, policy_version 749102 (0.0005) [2023-12-28 00:38:16,812][106226] Updated weights for policy 0, policy_version 749112 (0.0007) [2023-12-28 00:38:17,352][106225] Updated weights for policy 1, policy_version 751083 (0.0009) [2023-12-28 00:38:17,404][106225] Updated weights for policy 1, policy_version 751093 (0.0006) [2023-12-28 00:38:17,461][106225] Updated weights for policy 1, policy_version 751103 (0.0005) [2023-12-28 00:38:17,536][106226] Updated weights for policy 0, policy_version 749122 (0.0008) [2023-12-28 00:38:17,583][106226] Updated weights for policy 0, policy_version 749132 (0.0009) [2023-12-28 00:38:17,635][106226] Updated weights for policy 0, policy_version 749142 (0.0008) [2023-12-28 00:38:18,113][106225] Updated weights for policy 1, policy_version 751113 (0.0006) [2023-12-28 00:38:18,175][106225] Updated weights for policy 1, policy_version 751123 (0.0009) [2023-12-28 00:38:18,223][106225] Updated weights for policy 1, policy_version 751133 (0.0008) [2023-12-28 00:38:18,273][106225] Updated weights for policy 1, policy_version 751143 (0.0009) [2023-12-28 00:38:18,381][106226] Updated weights for policy 0, policy_version 749152 (0.0009) [2023-12-28 00:38:18,431][106226] Updated weights for policy 0, policy_version 749162 (0.0008) [2023-12-28 00:38:18,480][106226] Updated weights for policy 0, policy_version 749172 (0.0008) [2023-12-28 00:38:19,010][106225] Updated weights for policy 1, policy_version 751153 (0.0008) [2023-12-28 00:38:19,069][106225] Updated weights for policy 1, policy_version 751163 (0.0008) [2023-12-28 00:38:19,131][106225] Updated weights for policy 1, policy_version 751173 (0.0008) [2023-12-28 00:38:19,209][106226] Updated weights for policy 0, policy_version 749182 (0.0007) [2023-12-28 00:38:19,275][106226] Updated weights for policy 0, policy_version 749192 (0.0008) [2023-12-28 00:38:19,341][106226] Updated weights for policy 0, policy_version 749202 (0.0008) [2023-12-28 00:38:19,935][106225] Updated weights for policy 1, policy_version 751183 (0.0008) [2023-12-28 00:38:20,009][106225] Updated weights for policy 1, policy_version 751193 (0.0006) [2023-12-28 00:38:20,078][106225] Updated weights for policy 1, policy_version 751203 (0.0006) [2023-12-28 00:38:20,111][106226] Updated weights for policy 0, policy_version 749212 (0.0009) [2023-12-28 00:38:20,172][106226] Updated weights for policy 0, policy_version 749222 (0.0011) [2023-12-28 00:38:20,234][106226] Updated weights for policy 0, policy_version 749232 (0.0011) [2023-12-28 00:38:20,819][106225] Updated weights for policy 1, policy_version 751213 (0.0009) [2023-12-28 00:38:20,888][106225] Updated weights for policy 1, policy_version 751223 (0.0008) [2023-12-28 00:38:20,952][106225] Updated weights for policy 1, policy_version 751233 (0.0008) [2023-12-28 00:38:20,990][106226] Updated weights for policy 0, policy_version 749242 (0.0011) [2023-12-28 00:38:21,061][106226] Updated weights for policy 0, policy_version 749252 (0.0010) [2023-12-28 00:38:21,122][106226] Updated weights for policy 0, policy_version 749262 (0.0010) [2023-12-28 00:38:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 384212992. Throughput: 0: 9703.4, 1: 9819.7. Samples: 384225284. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:21,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.040')] [2023-12-28 00:38:21,184][106226] Updated weights for policy 0, policy_version 749272 (0.0007) [2023-12-28 00:38:21,767][106225] Updated weights for policy 1, policy_version 751243 (0.0006) [2023-12-28 00:38:21,826][106225] Updated weights for policy 1, policy_version 751253 (0.0005) [2023-12-28 00:38:21,895][106225] Updated weights for policy 1, policy_version 751263 (0.0008) [2023-12-28 00:38:21,912][106226] Updated weights for policy 0, policy_version 749282 (0.0006) [2023-12-28 00:38:21,972][106226] Updated weights for policy 0, policy_version 749292 (0.0008) [2023-12-28 00:38:22,031][106226] Updated weights for policy 0, policy_version 749302 (0.0009) [2023-12-28 00:38:22,568][106225] Updated weights for policy 1, policy_version 751273 (0.0007) [2023-12-28 00:38:22,623][106225] Updated weights for policy 1, policy_version 751283 (0.0008) [2023-12-28 00:38:22,685][106225] Updated weights for policy 1, policy_version 751293 (0.0008) [2023-12-28 00:38:22,743][106225] Updated weights for policy 1, policy_version 751303 (0.0007) [2023-12-28 00:38:22,745][106226] Updated weights for policy 0, policy_version 749312 (0.0007) [2023-12-28 00:38:22,810][106226] Updated weights for policy 0, policy_version 749322 (0.0008) [2023-12-28 00:38:22,882][106226] Updated weights for policy 0, policy_version 749332 (0.0006) [2023-12-28 00:38:23,413][106226] Updated weights for policy 0, policy_version 749342 (0.0008) [2023-12-28 00:38:23,472][106225] Updated weights for policy 1, policy_version 751313 (0.0005) [2023-12-28 00:38:23,476][106226] Updated weights for policy 0, policy_version 749352 (0.0005) [2023-12-28 00:38:23,519][106225] Updated weights for policy 1, policy_version 751323 (0.0005) [2023-12-28 00:38:23,526][106226] Updated weights for policy 0, policy_version 749362 (0.0008) [2023-12-28 00:38:23,565][106225] Updated weights for policy 1, policy_version 751333 (0.0005) [2023-12-28 00:38:24,214][106226] Updated weights for policy 0, policy_version 749372 (0.0008) [2023-12-28 00:38:24,251][106225] Updated weights for policy 1, policy_version 751343 (0.0006) [2023-12-28 00:38:24,273][106226] Updated weights for policy 0, policy_version 749382 (0.0008) [2023-12-28 00:38:24,304][106225] Updated weights for policy 1, policy_version 751353 (0.0006) [2023-12-28 00:38:24,325][106226] Updated weights for policy 0, policy_version 749392 (0.0008) [2023-12-28 00:38:24,368][106225] Updated weights for policy 1, policy_version 751363 (0.0007) [2023-12-28 00:38:24,907][106226] Updated weights for policy 0, policy_version 749402 (0.0007) [2023-12-28 00:38:24,965][106226] Updated weights for policy 0, policy_version 749412 (0.0005) [2023-12-28 00:38:25,016][106226] Updated weights for policy 0, policy_version 749422 (0.0005) [2023-12-28 00:38:25,062][106226] Updated weights for policy 0, policy_version 749432 (0.0005) [2023-12-28 00:38:25,153][106225] Updated weights for policy 1, policy_version 751373 (0.0007) [2023-12-28 00:38:25,214][106225] Updated weights for policy 1, policy_version 751383 (0.0005) [2023-12-28 00:38:25,269][106225] Updated weights for policy 1, policy_version 751393 (0.0008) [2023-12-28 00:38:25,681][106226] Updated weights for policy 0, policy_version 749442 (0.0009) [2023-12-28 00:38:25,737][106226] Updated weights for policy 0, policy_version 749452 (0.0010) [2023-12-28 00:38:25,805][106226] Updated weights for policy 0, policy_version 749462 (0.0009) [2023-12-28 00:38:25,840][106225] Updated weights for policy 1, policy_version 751403 (0.0008) [2023-12-28 00:38:25,900][106225] Updated weights for policy 1, policy_version 751413 (0.0005) [2023-12-28 00:38:25,954][106225] Updated weights for policy 1, policy_version 751423 (0.0005) [2023-12-28 00:38:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 384319488. Throughput: 0: 9724.0, 1: 9785.7. Samples: 384284748. Policy #0 lag: (min: 9.0, avg: 24.6, max: 41.0) [2023-12-28 00:38:26,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.332')] [2023-12-28 00:38:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000751432_192405504.pth... [2023-12-28 00:38:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000749464_191913984.pth... [2023-12-28 00:38:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000748312_191619072.pth [2023-12-28 00:38:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000750280_192110592.pth [2023-12-28 00:38:26,546][106226] Updated weights for policy 0, policy_version 749472 (0.0007) [2023-12-28 00:38:26,547][106225] Updated weights for policy 1, policy_version 751433 (0.0005) [2023-12-28 00:38:26,592][106225] Updated weights for policy 1, policy_version 751443 (0.0005) [2023-12-28 00:38:26,607][106226] Updated weights for policy 0, policy_version 749482 (0.0009) [2023-12-28 00:38:26,647][106225] Updated weights for policy 1, policy_version 751453 (0.0005) [2023-12-28 00:38:26,666][106226] Updated weights for policy 0, policy_version 749492 (0.0011) [2023-12-28 00:38:26,706][106225] Updated weights for policy 1, policy_version 751463 (0.0005) [2023-12-28 00:38:27,327][106226] Updated weights for policy 0, policy_version 749502 (0.0010) [2023-12-28 00:38:27,346][106225] Updated weights for policy 1, policy_version 751473 (0.0008) [2023-12-28 00:38:27,377][106226] Updated weights for policy 0, policy_version 749512 (0.0010) [2023-12-28 00:38:27,396][106225] Updated weights for policy 1, policy_version 751483 (0.0006) [2023-12-28 00:38:27,423][106226] Updated weights for policy 0, policy_version 749522 (0.0010) [2023-12-28 00:38:27,443][106225] Updated weights for policy 1, policy_version 751493 (0.0008) [2023-12-28 00:38:28,156][106226] Updated weights for policy 0, policy_version 749532 (0.0010) [2023-12-28 00:38:28,158][106225] Updated weights for policy 1, policy_version 751503 (0.0006) [2023-12-28 00:38:28,210][106226] Updated weights for policy 0, policy_version 749542 (0.0006) [2023-12-28 00:38:28,216][106225] Updated weights for policy 1, policy_version 751513 (0.0007) [2023-12-28 00:38:28,273][106226] Updated weights for policy 0, policy_version 749552 (0.0008) [2023-12-28 00:38:28,275][106225] Updated weights for policy 1, policy_version 751523 (0.0006) [2023-12-28 00:38:28,874][106225] Updated weights for policy 1, policy_version 751533 (0.0008) [2023-12-28 00:38:28,920][106225] Updated weights for policy 1, policy_version 751543 (0.0010) [2023-12-28 00:38:28,968][106225] Updated weights for policy 1, policy_version 751553 (0.0010) [2023-12-28 00:38:28,970][106226] Updated weights for policy 0, policy_version 749562 (0.0008) [2023-12-28 00:38:29,018][106226] Updated weights for policy 0, policy_version 749572 (0.0005) [2023-12-28 00:38:29,066][106226] Updated weights for policy 0, policy_version 749582 (0.0005) [2023-12-28 00:38:29,117][106226] Updated weights for policy 0, policy_version 749592 (0.0005) [2023-12-28 00:38:29,666][106225] Updated weights for policy 1, policy_version 751563 (0.0009) [2023-12-28 00:38:29,735][106225] Updated weights for policy 1, policy_version 751573 (0.0006) [2023-12-28 00:38:29,795][106225] Updated weights for policy 1, policy_version 751583 (0.0007) [2023-12-28 00:38:29,797][106226] Updated weights for policy 0, policy_version 749602 (0.0007) [2023-12-28 00:38:29,867][106226] Updated weights for policy 0, policy_version 749612 (0.0009) [2023-12-28 00:38:29,938][106226] Updated weights for policy 0, policy_version 749622 (0.0007) [2023-12-28 00:38:30,507][106226] Updated weights for policy 0, policy_version 749632 (0.0008) [2023-12-28 00:38:30,530][106225] Updated weights for policy 1, policy_version 751593 (0.0007) [2023-12-28 00:38:30,563][106226] Updated weights for policy 0, policy_version 749642 (0.0008) [2023-12-28 00:38:30,588][106225] Updated weights for policy 1, policy_version 751603 (0.0006) [2023-12-28 00:38:30,620][106226] Updated weights for policy 0, policy_version 749652 (0.0005) [2023-12-28 00:38:30,637][106225] Updated weights for policy 1, policy_version 751613 (0.0006) [2023-12-28 00:38:30,690][106225] Updated weights for policy 1, policy_version 751623 (0.0008) [2023-12-28 00:38:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 384417792. Throughput: 0: 9877.3, 1: 9898.0. Samples: 384409696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:31,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-5.525')] [2023-12-28 00:38:31,401][106226] Updated weights for policy 0, policy_version 749662 (0.0007) [2023-12-28 00:38:31,432][106225] Updated weights for policy 1, policy_version 751633 (0.0008) [2023-12-28 00:38:31,460][106226] Updated weights for policy 0, policy_version 749672 (0.0006) [2023-12-28 00:38:31,494][106225] Updated weights for policy 1, policy_version 751643 (0.0008) [2023-12-28 00:38:31,517][106226] Updated weights for policy 0, policy_version 749682 (0.0005) [2023-12-28 00:38:31,554][106225] Updated weights for policy 1, policy_version 751653 (0.0009) [2023-12-28 00:38:32,238][106226] Updated weights for policy 0, policy_version 749692 (0.0007) [2023-12-28 00:38:32,304][106226] Updated weights for policy 0, policy_version 749702 (0.0007) [2023-12-28 00:38:32,309][106225] Updated weights for policy 1, policy_version 751663 (0.0007) [2023-12-28 00:38:32,362][106226] Updated weights for policy 0, policy_version 749712 (0.0006) [2023-12-28 00:38:32,377][106225] Updated weights for policy 1, policy_version 751673 (0.0007) [2023-12-28 00:38:32,439][106225] Updated weights for policy 1, policy_version 751683 (0.0008) [2023-12-28 00:38:33,058][106226] Updated weights for policy 0, policy_version 749722 (0.0008) [2023-12-28 00:38:33,112][106225] Updated weights for policy 1, policy_version 751693 (0.0009) [2023-12-28 00:38:33,118][106226] Updated weights for policy 0, policy_version 749732 (0.0007) [2023-12-28 00:38:33,171][106225] Updated weights for policy 1, policy_version 751703 (0.0007) [2023-12-28 00:38:33,172][106226] Updated weights for policy 0, policy_version 749742 (0.0007) [2023-12-28 00:38:33,218][106226] Updated weights for policy 0, policy_version 749752 (0.0008) [2023-12-28 00:38:33,222][106225] Updated weights for policy 1, policy_version 751713 (0.0006) [2023-12-28 00:38:33,787][106226] Updated weights for policy 0, policy_version 749762 (0.0005) [2023-12-28 00:38:33,843][106226] Updated weights for policy 0, policy_version 749772 (0.0005) [2023-12-28 00:38:33,905][106226] Updated weights for policy 0, policy_version 749782 (0.0005) [2023-12-28 00:38:34,012][106225] Updated weights for policy 1, policy_version 751723 (0.0009) [2023-12-28 00:38:34,066][106225] Updated weights for policy 1, policy_version 751733 (0.0008) [2023-12-28 00:38:34,113][106225] Updated weights for policy 1, policy_version 751743 (0.0007) [2023-12-28 00:38:34,597][106226] Updated weights for policy 0, policy_version 749792 (0.0007) [2023-12-28 00:38:34,659][106226] Updated weights for policy 0, policy_version 749802 (0.0010) [2023-12-28 00:38:34,723][106226] Updated weights for policy 0, policy_version 749812 (0.0011) [2023-12-28 00:38:34,792][106225] Updated weights for policy 1, policy_version 751753 (0.0007) [2023-12-28 00:38:34,849][106225] Updated weights for policy 1, policy_version 751763 (0.0007) [2023-12-28 00:38:34,902][106225] Updated weights for policy 1, policy_version 751773 (0.0009) [2023-12-28 00:38:34,952][106225] Updated weights for policy 1, policy_version 751783 (0.0008) [2023-12-28 00:38:35,385][106226] Updated weights for policy 0, policy_version 749822 (0.0010) [2023-12-28 00:38:35,435][106226] Updated weights for policy 0, policy_version 749832 (0.0010) [2023-12-28 00:38:35,485][106226] Updated weights for policy 0, policy_version 749842 (0.0010) [2023-12-28 00:38:35,689][106225] Updated weights for policy 1, policy_version 751793 (0.0008) [2023-12-28 00:38:35,746][106225] Updated weights for policy 1, policy_version 751803 (0.0007) [2023-12-28 00:38:35,799][106225] Updated weights for policy 1, policy_version 751813 (0.0009) [2023-12-28 00:38:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 384516096. Throughput: 0: 9993.8, 1: 9824.4. Samples: 384528792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:36,175][106226] Updated weights for policy 0, policy_version 749852 (0.0010) [2023-12-28 00:38:36,175][105115] Avg episode reward: [(0, '-4.258'), (1, '-5.381')] [2023-12-28 00:38:36,240][106226] Updated weights for policy 0, policy_version 749862 (0.0011) [2023-12-28 00:38:36,302][106226] Updated weights for policy 0, policy_version 749872 (0.0011) [2023-12-28 00:38:36,459][106225] Updated weights for policy 1, policy_version 751823 (0.0010) [2023-12-28 00:38:36,521][106225] Updated weights for policy 1, policy_version 751833 (0.0011) [2023-12-28 00:38:36,583][106225] Updated weights for policy 1, policy_version 751843 (0.0010) [2023-12-28 00:38:37,020][106226] Updated weights for policy 0, policy_version 749882 (0.0011) [2023-12-28 00:38:37,070][106226] Updated weights for policy 0, policy_version 749892 (0.0010) [2023-12-28 00:38:37,127][106226] Updated weights for policy 0, policy_version 749902 (0.0011) [2023-12-28 00:38:37,187][106226] Updated weights for policy 0, policy_version 749912 (0.0011) [2023-12-28 00:38:37,305][106225] Updated weights for policy 1, policy_version 751853 (0.0008) [2023-12-28 00:38:37,371][106225] Updated weights for policy 1, policy_version 751863 (0.0008) [2023-12-28 00:38:37,425][106225] Updated weights for policy 1, policy_version 751873 (0.0006) [2023-12-28 00:38:37,902][106226] Updated weights for policy 0, policy_version 749922 (0.0011) [2023-12-28 00:38:37,949][106226] Updated weights for policy 0, policy_version 749932 (0.0010) [2023-12-28 00:38:37,995][106226] Updated weights for policy 0, policy_version 749942 (0.0010) [2023-12-28 00:38:38,052][106225] Updated weights for policy 1, policy_version 751883 (0.0006) [2023-12-28 00:38:38,113][106225] Updated weights for policy 1, policy_version 751893 (0.0008) [2023-12-28 00:38:38,176][106225] Updated weights for policy 1, policy_version 751903 (0.0008) [2023-12-28 00:38:38,754][106226] Updated weights for policy 0, policy_version 749952 (0.0009) [2023-12-28 00:38:38,814][106226] Updated weights for policy 0, policy_version 749962 (0.0011) [2023-12-28 00:38:38,875][106226] Updated weights for policy 0, policy_version 749972 (0.0009) [2023-12-28 00:38:38,938][106225] Updated weights for policy 1, policy_version 751913 (0.0008) [2023-12-28 00:38:38,991][106225] Updated weights for policy 1, policy_version 751923 (0.0009) [2023-12-28 00:38:39,039][106225] Updated weights for policy 1, policy_version 751933 (0.0005) [2023-12-28 00:38:39,090][106225] Updated weights for policy 1, policy_version 751943 (0.0007) [2023-12-28 00:38:39,480][106226] Updated weights for policy 0, policy_version 749982 (0.0009) [2023-12-28 00:38:39,542][106226] Updated weights for policy 0, policy_version 749992 (0.0011) [2023-12-28 00:38:39,610][106226] Updated weights for policy 0, policy_version 750002 (0.0010) [2023-12-28 00:38:39,888][106225] Updated weights for policy 1, policy_version 751953 (0.0008) [2023-12-28 00:38:39,956][106225] Updated weights for policy 1, policy_version 751963 (0.0008) [2023-12-28 00:38:40,019][106225] Updated weights for policy 1, policy_version 751973 (0.0006) [2023-12-28 00:38:40,398][106226] Updated weights for policy 0, policy_version 750012 (0.0010) [2023-12-28 00:38:40,455][106226] Updated weights for policy 0, policy_version 750022 (0.0010) [2023-12-28 00:38:40,513][106226] Updated weights for policy 0, policy_version 750032 (0.0011) [2023-12-28 00:38:40,645][106225] Updated weights for policy 1, policy_version 751983 (0.0007) [2023-12-28 00:38:40,696][106225] Updated weights for policy 1, policy_version 751993 (0.0008) [2023-12-28 00:38:40,750][106225] Updated weights for policy 1, policy_version 752003 (0.0007) [2023-12-28 00:38:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 384614400. Throughput: 0: 9982.7, 1: 9847.0. Samples: 384587900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:41,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.167')] [2023-12-28 00:38:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000750040_192061440.pth... [2023-12-28 00:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000752008_192552960.pth... [2023-12-28 00:38:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000748888_191766528.pth [2023-12-28 00:38:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000750856_192258048.pth [2023-12-28 00:38:41,271][106226] Updated weights for policy 0, policy_version 750042 (0.0010) [2023-12-28 00:38:41,333][106226] Updated weights for policy 0, policy_version 750052 (0.0008) [2023-12-28 00:38:41,405][106226] Updated weights for policy 0, policy_version 750062 (0.0008) [2023-12-28 00:38:41,470][106226] Updated weights for policy 0, policy_version 750072 (0.0007) [2023-12-28 00:38:41,485][106225] Updated weights for policy 1, policy_version 752013 (0.0009) [2023-12-28 00:38:41,549][106225] Updated weights for policy 1, policy_version 752023 (0.0009) [2023-12-28 00:38:41,618][106225] Updated weights for policy 1, policy_version 752033 (0.0008) [2023-12-28 00:38:42,168][106226] Updated weights for policy 0, policy_version 750082 (0.0011) [2023-12-28 00:38:42,225][106226] Updated weights for policy 0, policy_version 750092 (0.0010) [2023-12-28 00:38:42,285][106226] Updated weights for policy 0, policy_version 750102 (0.0011) [2023-12-28 00:38:42,373][106225] Updated weights for policy 1, policy_version 752043 (0.0007) [2023-12-28 00:38:42,431][106225] Updated weights for policy 1, policy_version 752053 (0.0007) [2023-12-28 00:38:42,484][106225] Updated weights for policy 1, policy_version 752063 (0.0007) [2023-12-28 00:38:42,939][106226] Updated weights for policy 0, policy_version 750112 (0.0007) [2023-12-28 00:38:43,005][106226] Updated weights for policy 0, policy_version 750122 (0.0008) [2023-12-28 00:38:43,067][106226] Updated weights for policy 0, policy_version 750132 (0.0008) [2023-12-28 00:38:43,147][106225] Updated weights for policy 1, policy_version 752073 (0.0008) [2023-12-28 00:38:43,211][106225] Updated weights for policy 1, policy_version 752083 (0.0010) [2023-12-28 00:38:43,278][106225] Updated weights for policy 1, policy_version 752093 (0.0010) [2023-12-28 00:38:43,336][106225] Updated weights for policy 1, policy_version 752103 (0.0010) [2023-12-28 00:38:43,741][106226] Updated weights for policy 0, policy_version 750142 (0.0008) [2023-12-28 00:38:43,798][106226] Updated weights for policy 0, policy_version 750152 (0.0008) [2023-12-28 00:38:43,849][106226] Updated weights for policy 0, policy_version 750162 (0.0008) [2023-12-28 00:38:44,001][106225] Updated weights for policy 1, policy_version 752113 (0.0006) [2023-12-28 00:38:44,054][106225] Updated weights for policy 1, policy_version 752123 (0.0005) [2023-12-28 00:38:44,118][106225] Updated weights for policy 1, policy_version 752133 (0.0006) [2023-12-28 00:38:44,580][106226] Updated weights for policy 0, policy_version 750172 (0.0009) [2023-12-28 00:38:44,636][106226] Updated weights for policy 0, policy_version 750182 (0.0010) [2023-12-28 00:38:44,673][106225] Updated weights for policy 1, policy_version 752143 (0.0006) [2023-12-28 00:38:44,693][106226] Updated weights for policy 0, policy_version 750192 (0.0010) [2023-12-28 00:38:44,732][106225] Updated weights for policy 1, policy_version 752153 (0.0005) [2023-12-28 00:38:44,825][106225] Updated weights for policy 1, policy_version 752163 (0.0007) [2023-12-28 00:38:45,436][106226] Updated weights for policy 0, policy_version 750202 (0.0009) [2023-12-28 00:38:45,490][106226] Updated weights for policy 0, policy_version 750212 (0.0010) [2023-12-28 00:38:45,514][106225] Updated weights for policy 1, policy_version 752173 (0.0007) [2023-12-28 00:38:45,546][106226] Updated weights for policy 0, policy_version 750222 (0.0010) [2023-12-28 00:38:45,571][106225] Updated weights for policy 1, policy_version 752183 (0.0005) [2023-12-28 00:38:45,606][106226] Updated weights for policy 0, policy_version 750232 (0.0010) [2023-12-28 00:38:45,629][106225] Updated weights for policy 1, policy_version 752193 (0.0007) [2023-12-28 00:38:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 384712704. Throughput: 0: 9997.5, 1: 9840.2. Samples: 384706488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:46,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.992')] [2023-12-28 00:38:46,267][106225] Updated weights for policy 1, policy_version 752203 (0.0008) [2023-12-28 00:38:46,319][106225] Updated weights for policy 1, policy_version 752213 (0.0008) [2023-12-28 00:38:46,320][106226] Updated weights for policy 0, policy_version 750242 (0.0010) [2023-12-28 00:38:46,367][106226] Updated weights for policy 0, policy_version 750252 (0.0010) [2023-12-28 00:38:46,380][106225] Updated weights for policy 1, policy_version 752223 (0.0007) [2023-12-28 00:38:46,424][106226] Updated weights for policy 0, policy_version 750262 (0.0010) [2023-12-28 00:38:47,023][106225] Updated weights for policy 1, policy_version 752233 (0.0009) [2023-12-28 00:38:47,049][106226] Updated weights for policy 0, policy_version 750272 (0.0010) [2023-12-28 00:38:47,073][106225] Updated weights for policy 1, policy_version 752243 (0.0010) [2023-12-28 00:38:47,105][106226] Updated weights for policy 0, policy_version 750282 (0.0010) [2023-12-28 00:38:47,120][106225] Updated weights for policy 1, policy_version 752253 (0.0010) [2023-12-28 00:38:47,155][106226] Updated weights for policy 0, policy_version 750292 (0.0010) [2023-12-28 00:38:47,169][106225] Updated weights for policy 1, policy_version 752263 (0.0010) [2023-12-28 00:38:47,881][106226] Updated weights for policy 0, policy_version 750302 (0.0008) [2023-12-28 00:38:47,898][106225] Updated weights for policy 1, policy_version 752273 (0.0010) [2023-12-28 00:38:47,934][106226] Updated weights for policy 0, policy_version 750312 (0.0005) [2023-12-28 00:38:47,949][106225] Updated weights for policy 1, policy_version 752283 (0.0010) [2023-12-28 00:38:47,996][106226] Updated weights for policy 0, policy_version 750322 (0.0006) [2023-12-28 00:38:48,009][106225] Updated weights for policy 1, policy_version 752293 (0.0010) [2023-12-28 00:38:48,682][106225] Updated weights for policy 1, policy_version 752303 (0.0007) [2023-12-28 00:38:48,723][106226] Updated weights for policy 0, policy_version 750332 (0.0007) [2023-12-28 00:38:48,746][106225] Updated weights for policy 1, policy_version 752313 (0.0007) [2023-12-28 00:38:48,785][106226] Updated weights for policy 0, policy_version 750342 (0.0006) [2023-12-28 00:38:48,811][106225] Updated weights for policy 1, policy_version 752323 (0.0008) [2023-12-28 00:38:48,847][106226] Updated weights for policy 0, policy_version 750352 (0.0011) [2023-12-28 00:38:49,516][106225] Updated weights for policy 1, policy_version 752333 (0.0009) [2023-12-28 00:38:49,517][106226] Updated weights for policy 0, policy_version 750362 (0.0007) [2023-12-28 00:38:49,578][106225] Updated weights for policy 1, policy_version 752343 (0.0010) [2023-12-28 00:38:49,584][106226] Updated weights for policy 0, policy_version 750372 (0.0006) [2023-12-28 00:38:49,640][106225] Updated weights for policy 1, policy_version 752353 (0.0009) [2023-12-28 00:38:49,650][106226] Updated weights for policy 0, policy_version 750382 (0.0007) [2023-12-28 00:38:49,711][106226] Updated weights for policy 0, policy_version 750392 (0.0010) [2023-12-28 00:38:50,319][106225] Updated weights for policy 1, policy_version 752363 (0.0008) [2023-12-28 00:38:50,346][106226] Updated weights for policy 0, policy_version 750402 (0.0010) [2023-12-28 00:38:50,379][106225] Updated weights for policy 1, policy_version 752373 (0.0009) [2023-12-28 00:38:50,414][106226] Updated weights for policy 0, policy_version 750412 (0.0008) [2023-12-28 00:38:50,434][106225] Updated weights for policy 1, policy_version 752383 (0.0006) [2023-12-28 00:38:50,487][106226] Updated weights for policy 0, policy_version 750422 (0.0008) [2023-12-28 00:38:51,075][106225] Updated weights for policy 1, policy_version 752393 (0.0008) [2023-12-28 00:38:51,138][106225] Updated weights for policy 1, policy_version 752403 (0.0008) [2023-12-28 00:38:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 384811008. Throughput: 0: 10018.0, 1: 9874.8. Samples: 384827028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:51,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-5.100')] [2023-12-28 00:38:51,201][106225] Updated weights for policy 1, policy_version 752413 (0.0008) [2023-12-28 00:38:51,209][106226] Updated weights for policy 0, policy_version 750432 (0.0009) [2023-12-28 00:38:51,267][106225] Updated weights for policy 1, policy_version 752423 (0.0007) [2023-12-28 00:38:51,275][106226] Updated weights for policy 0, policy_version 750442 (0.0007) [2023-12-28 00:38:51,336][106226] Updated weights for policy 0, policy_version 750452 (0.0008) [2023-12-28 00:38:51,997][106226] Updated weights for policy 0, policy_version 750462 (0.0008) [2023-12-28 00:38:52,006][106225] Updated weights for policy 1, policy_version 752433 (0.0008) [2023-12-28 00:38:52,058][106226] Updated weights for policy 0, policy_version 750472 (0.0007) [2023-12-28 00:38:52,070][106225] Updated weights for policy 1, policy_version 752443 (0.0008) [2023-12-28 00:38:52,122][106225] Updated weights for policy 1, policy_version 752453 (0.0008) [2023-12-28 00:38:52,124][106226] Updated weights for policy 0, policy_version 750482 (0.0008) [2023-12-28 00:38:52,849][106226] Updated weights for policy 0, policy_version 750492 (0.0007) [2023-12-28 00:38:52,878][106225] Updated weights for policy 1, policy_version 752463 (0.0008) [2023-12-28 00:38:52,907][106226] Updated weights for policy 0, policy_version 750502 (0.0006) [2023-12-28 00:38:52,929][106225] Updated weights for policy 1, policy_version 752473 (0.0006) [2023-12-28 00:38:52,966][106226] Updated weights for policy 0, policy_version 750512 (0.0007) [2023-12-28 00:38:52,985][106225] Updated weights for policy 1, policy_version 752483 (0.0007) [2023-12-28 00:38:53,651][106225] Updated weights for policy 1, policy_version 752493 (0.0007) [2023-12-28 00:38:53,690][106226] Updated weights for policy 0, policy_version 750522 (0.0007) [2023-12-28 00:38:53,706][106225] Updated weights for policy 1, policy_version 752503 (0.0009) [2023-12-28 00:38:53,742][106226] Updated weights for policy 0, policy_version 750532 (0.0006) [2023-12-28 00:38:53,767][106225] Updated weights for policy 1, policy_version 752513 (0.0008) [2023-12-28 00:38:53,804][106226] Updated weights for policy 0, policy_version 750542 (0.0006) [2023-12-28 00:38:53,870][106226] Updated weights for policy 0, policy_version 750552 (0.0007) [2023-12-28 00:38:54,482][106225] Updated weights for policy 1, policy_version 752523 (0.0008) [2023-12-28 00:38:54,533][106226] Updated weights for policy 0, policy_version 750562 (0.0006) [2023-12-28 00:38:54,539][106225] Updated weights for policy 1, policy_version 752533 (0.0008) [2023-12-28 00:38:54,587][106225] Updated weights for policy 1, policy_version 752543 (0.0008) [2023-12-28 00:38:54,589][106226] Updated weights for policy 0, policy_version 750572 (0.0006) [2023-12-28 00:38:54,649][106226] Updated weights for policy 0, policy_version 750582 (0.0007) [2023-12-28 00:38:55,257][106225] Updated weights for policy 1, policy_version 752553 (0.0006) [2023-12-28 00:38:55,320][106225] Updated weights for policy 1, policy_version 752563 (0.0009) [2023-12-28 00:38:55,356][106226] Updated weights for policy 0, policy_version 750592 (0.0008) [2023-12-28 00:38:55,376][106225] Updated weights for policy 1, policy_version 752573 (0.0010) [2023-12-28 00:38:55,412][106226] Updated weights for policy 0, policy_version 750602 (0.0005) [2023-12-28 00:38:55,433][106225] Updated weights for policy 1, policy_version 752583 (0.0010) [2023-12-28 00:38:55,474][106226] Updated weights for policy 0, policy_version 750612 (0.0007) [2023-12-28 00:38:56,066][106225] Updated weights for policy 1, policy_version 752593 (0.0006) [2023-12-28 00:38:56,124][106225] Updated weights for policy 1, policy_version 752603 (0.0005) [2023-12-28 00:38:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 384909312. Throughput: 0: 9972.2, 1: 9858.3. Samples: 384885244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:38:56,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.855')] [2023-12-28 00:38:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000750616_192208896.pth... [2023-12-28 00:38:56,182][106225] Updated weights for policy 1, policy_version 752613 (0.0005) [2023-12-28 00:38:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000749464_191913984.pth [2023-12-28 00:38:56,197][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000752616_192708608.pth... [2023-12-28 00:38:56,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000751432_192405504.pth [2023-12-28 00:38:56,257][106226] Updated weights for policy 0, policy_version 750622 (0.0009) [2023-12-28 00:38:56,312][106226] Updated weights for policy 0, policy_version 750632 (0.0008) [2023-12-28 00:38:56,370][106226] Updated weights for policy 0, policy_version 750642 (0.0008) [2023-12-28 00:38:56,777][106225] Updated weights for policy 1, policy_version 752623 (0.0009) [2023-12-28 00:38:56,826][106225] Updated weights for policy 1, policy_version 752633 (0.0010) [2023-12-28 00:38:56,884][106225] Updated weights for policy 1, policy_version 752643 (0.0010) [2023-12-28 00:38:57,157][106226] Updated weights for policy 0, policy_version 750652 (0.0009) [2023-12-28 00:38:57,217][106226] Updated weights for policy 0, policy_version 750662 (0.0009) [2023-12-28 00:38:57,271][106226] Updated weights for policy 0, policy_version 750672 (0.0008) [2023-12-28 00:38:57,442][106225] Updated weights for policy 1, policy_version 752653 (0.0007) [2023-12-28 00:38:57,503][106225] Updated weights for policy 1, policy_version 752663 (0.0006) [2023-12-28 00:38:57,574][106225] Updated weights for policy 1, policy_version 752673 (0.0007) [2023-12-28 00:38:57,976][106226] Updated weights for policy 0, policy_version 750682 (0.0009) [2023-12-28 00:38:58,029][106226] Updated weights for policy 0, policy_version 750692 (0.0010) [2023-12-28 00:38:58,081][106226] Updated weights for policy 0, policy_version 750702 (0.0010) [2023-12-28 00:38:58,147][106226] Updated weights for policy 0, policy_version 750712 (0.0010) [2023-12-28 00:38:58,176][106225] Updated weights for policy 1, policy_version 752683 (0.0010) [2023-12-28 00:38:58,245][106225] Updated weights for policy 1, policy_version 752693 (0.0009) [2023-12-28 00:38:58,306][106225] Updated weights for policy 1, policy_version 752703 (0.0009) [2023-12-28 00:38:59,017][106226] Updated weights for policy 0, policy_version 750722 (0.0009) [2023-12-28 00:38:59,066][106226] Updated weights for policy 0, policy_version 750732 (0.0009) [2023-12-28 00:38:59,119][106226] Updated weights for policy 0, policy_version 750742 (0.0006) [2023-12-28 00:38:59,159][106225] Updated weights for policy 1, policy_version 752713 (0.0008) [2023-12-28 00:38:59,211][106225] Updated weights for policy 1, policy_version 752723 (0.0009) [2023-12-28 00:38:59,284][106225] Updated weights for policy 1, policy_version 752733 (0.0009) [2023-12-28 00:38:59,355][106225] Updated weights for policy 1, policy_version 752743 (0.0011) [2023-12-28 00:38:59,793][106226] Updated weights for policy 0, policy_version 750752 (0.0007) [2023-12-28 00:38:59,858][106226] Updated weights for policy 0, policy_version 750762 (0.0008) [2023-12-28 00:38:59,919][106226] Updated weights for policy 0, policy_version 750772 (0.0009) [2023-12-28 00:39:00,162][106225] Updated weights for policy 1, policy_version 752753 (0.0010) [2023-12-28 00:39:00,220][106225] Updated weights for policy 1, policy_version 752763 (0.0009) [2023-12-28 00:39:00,281][106225] Updated weights for policy 1, policy_version 752773 (0.0008) [2023-12-28 00:39:00,626][106226] Updated weights for policy 0, policy_version 750782 (0.0006) [2023-12-28 00:39:00,675][106226] Updated weights for policy 0, policy_version 750792 (0.0005) [2023-12-28 00:39:00,730][106226] Updated weights for policy 0, policy_version 750802 (0.0006) [2023-12-28 00:39:00,908][106225] Updated weights for policy 1, policy_version 752783 (0.0006) [2023-12-28 00:39:00,960][106225] Updated weights for policy 1, policy_version 752793 (0.0008) [2023-12-28 00:39:01,021][106225] Updated weights for policy 1, policy_version 752803 (0.0006) [2023-12-28 00:39:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 385015808. Throughput: 0: 9910.7, 1: 9963.4. Samples: 385002320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:01,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.231')] [2023-12-28 00:39:01,361][106226] Updated weights for policy 0, policy_version 750812 (0.0009) [2023-12-28 00:39:01,435][106226] Updated weights for policy 0, policy_version 750822 (0.0010) [2023-12-28 00:39:01,502][106226] Updated weights for policy 0, policy_version 750832 (0.0011) [2023-12-28 00:39:01,607][106225] Updated weights for policy 1, policy_version 752813 (0.0008) [2023-12-28 00:39:01,670][106225] Updated weights for policy 1, policy_version 752823 (0.0007) [2023-12-28 00:39:01,736][106225] Updated weights for policy 1, policy_version 752833 (0.0008) [2023-12-28 00:39:02,243][106226] Updated weights for policy 0, policy_version 750842 (0.0010) [2023-12-28 00:39:02,312][106226] Updated weights for policy 0, policy_version 750852 (0.0011) [2023-12-28 00:39:02,387][106226] Updated weights for policy 0, policy_version 750862 (0.0011) [2023-12-28 00:39:02,456][106226] Updated weights for policy 0, policy_version 750872 (0.0010) [2023-12-28 00:39:02,551][106225] Updated weights for policy 1, policy_version 752843 (0.0008) [2023-12-28 00:39:02,601][106225] Updated weights for policy 1, policy_version 752853 (0.0008) [2023-12-28 00:39:02,659][106225] Updated weights for policy 1, policy_version 752863 (0.0008) [2023-12-28 00:39:03,143][106226] Updated weights for policy 0, policy_version 750882 (0.0010) [2023-12-28 00:39:03,202][106226] Updated weights for policy 0, policy_version 750892 (0.0010) [2023-12-28 00:39:03,254][106226] Updated weights for policy 0, policy_version 750902 (0.0010) [2023-12-28 00:39:03,403][106225] Updated weights for policy 1, policy_version 752873 (0.0008) [2023-12-28 00:39:03,456][106225] Updated weights for policy 1, policy_version 752883 (0.0007) [2023-12-28 00:39:03,505][106225] Updated weights for policy 1, policy_version 752893 (0.0008) [2023-12-28 00:39:03,552][106225] Updated weights for policy 1, policy_version 752903 (0.0008) [2023-12-28 00:39:03,965][106226] Updated weights for policy 0, policy_version 750912 (0.0010) [2023-12-28 00:39:04,026][106226] Updated weights for policy 0, policy_version 750922 (0.0011) [2023-12-28 00:39:04,096][106226] Updated weights for policy 0, policy_version 750932 (0.0010) [2023-12-28 00:39:04,272][106225] Updated weights for policy 1, policy_version 752913 (0.0010) [2023-12-28 00:39:04,324][106225] Updated weights for policy 1, policy_version 752923 (0.0010) [2023-12-28 00:39:04,382][106225] Updated weights for policy 1, policy_version 752933 (0.0010) [2023-12-28 00:39:04,802][106226] Updated weights for policy 0, policy_version 750942 (0.0011) [2023-12-28 00:39:04,855][106226] Updated weights for policy 0, policy_version 750952 (0.0010) [2023-12-28 00:39:04,905][106226] Updated weights for policy 0, policy_version 750962 (0.0010) [2023-12-28 00:39:05,063][106225] Updated weights for policy 1, policy_version 752943 (0.0007) [2023-12-28 00:39:05,124][106225] Updated weights for policy 1, policy_version 752953 (0.0008) [2023-12-28 00:39:05,187][106225] Updated weights for policy 1, policy_version 752963 (0.0007) [2023-12-28 00:39:05,642][106226] Updated weights for policy 0, policy_version 750972 (0.0009) [2023-12-28 00:39:05,702][106226] Updated weights for policy 0, policy_version 750982 (0.0008) [2023-12-28 00:39:05,715][106225] Updated weights for policy 1, policy_version 752973 (0.0007) [2023-12-28 00:39:05,768][106225] Updated weights for policy 1, policy_version 752983 (0.0010) [2023-12-28 00:39:05,768][106226] Updated weights for policy 0, policy_version 750992 (0.0005) [2023-12-28 00:39:05,817][106225] Updated weights for policy 1, policy_version 752993 (0.0010) [2023-12-28 00:39:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 385114112. Throughput: 0: 9920.1, 1: 10035.9. Samples: 385123304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:06,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-5.314')] [2023-12-28 00:39:06,459][106226] Updated weights for policy 0, policy_version 751002 (0.0005) [2023-12-28 00:39:06,527][106226] Updated weights for policy 0, policy_version 751012 (0.0008) [2023-12-28 00:39:06,547][106225] Updated weights for policy 1, policy_version 753003 (0.0010) [2023-12-28 00:39:06,590][106226] Updated weights for policy 0, policy_version 751022 (0.0010) [2023-12-28 00:39:06,608][106225] Updated weights for policy 1, policy_version 753013 (0.0010) [2023-12-28 00:39:06,654][106226] Updated weights for policy 0, policy_version 751032 (0.0006) [2023-12-28 00:39:06,673][106225] Updated weights for policy 1, policy_version 753023 (0.0011) [2023-12-28 00:39:07,322][106226] Updated weights for policy 0, policy_version 751042 (0.0009) [2023-12-28 00:39:07,379][106225] Updated weights for policy 1, policy_version 753033 (0.0010) [2023-12-28 00:39:07,380][106226] Updated weights for policy 0, policy_version 751052 (0.0008) [2023-12-28 00:39:07,439][106225] Updated weights for policy 1, policy_version 753043 (0.0010) [2023-12-28 00:39:07,444][106226] Updated weights for policy 0, policy_version 751062 (0.0006) [2023-12-28 00:39:07,497][106225] Updated weights for policy 1, policy_version 753053 (0.0010) [2023-12-28 00:39:07,561][106225] Updated weights for policy 1, policy_version 753063 (0.0010) [2023-12-28 00:39:08,178][106226] Updated weights for policy 0, policy_version 751072 (0.0008) [2023-12-28 00:39:08,242][106226] Updated weights for policy 0, policy_version 751082 (0.0007) [2023-12-28 00:39:08,276][106225] Updated weights for policy 1, policy_version 753073 (0.0010) [2023-12-28 00:39:08,297][106226] Updated weights for policy 0, policy_version 751092 (0.0008) [2023-12-28 00:39:08,348][106225] Updated weights for policy 1, policy_version 753083 (0.0009) [2023-12-28 00:39:08,413][106225] Updated weights for policy 1, policy_version 753093 (0.0007) [2023-12-28 00:39:09,028][106225] Updated weights for policy 1, policy_version 753103 (0.0007) [2023-12-28 00:39:09,028][106226] Updated weights for policy 0, policy_version 751102 (0.0006) [2023-12-28 00:39:09,089][106226] Updated weights for policy 0, policy_version 751112 (0.0007) [2023-12-28 00:39:09,091][106225] Updated weights for policy 1, policy_version 753113 (0.0008) [2023-12-28 00:39:09,152][106226] Updated weights for policy 0, policy_version 751122 (0.0007) [2023-12-28 00:39:09,155][106225] Updated weights for policy 1, policy_version 753123 (0.0006) [2023-12-28 00:39:09,840][106225] Updated weights for policy 1, policy_version 753133 (0.0007) [2023-12-28 00:39:09,904][106225] Updated weights for policy 1, policy_version 753143 (0.0008) [2023-12-28 00:39:09,948][106226] Updated weights for policy 0, policy_version 751132 (0.0008) [2023-12-28 00:39:09,972][106225] Updated weights for policy 1, policy_version 753153 (0.0009) [2023-12-28 00:39:10,019][106226] Updated weights for policy 0, policy_version 751142 (0.0009) [2023-12-28 00:39:10,084][106226] Updated weights for policy 0, policy_version 751152 (0.0009) [2023-12-28 00:39:10,669][106225] Updated weights for policy 1, policy_version 753163 (0.0007) [2023-12-28 00:39:10,715][106225] Updated weights for policy 1, policy_version 753173 (0.0006) [2023-12-28 00:39:10,768][106225] Updated weights for policy 1, policy_version 753183 (0.0006) [2023-12-28 00:39:10,822][106226] Updated weights for policy 0, policy_version 751162 (0.0009) [2023-12-28 00:39:10,877][106226] Updated weights for policy 0, policy_version 751172 (0.0011) [2023-12-28 00:39:10,925][106226] Updated weights for policy 0, policy_version 751182 (0.0010) [2023-12-28 00:39:10,978][106226] Updated weights for policy 0, policy_version 751192 (0.0006) [2023-12-28 00:39:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 385212416. Throughput: 0: 9873.6, 1: 10057.3. Samples: 385181640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:11,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-5.382')] [2023-12-28 00:39:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000753192_192856064.pth... [2023-12-28 00:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000751192_192356352.pth... [2023-12-28 00:39:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000752008_192552960.pth [2023-12-28 00:39:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000750040_192061440.pth [2023-12-28 00:39:11,470][106225] Updated weights for policy 1, policy_version 753193 (0.0007) [2023-12-28 00:39:11,533][106225] Updated weights for policy 1, policy_version 753203 (0.0005) [2023-12-28 00:39:11,596][106225] Updated weights for policy 1, policy_version 753213 (0.0009) [2023-12-28 00:39:11,666][106225] Updated weights for policy 1, policy_version 753223 (0.0008) [2023-12-28 00:39:11,785][106226] Updated weights for policy 0, policy_version 751202 (0.0007) [2023-12-28 00:39:11,851][106226] Updated weights for policy 0, policy_version 751212 (0.0008) [2023-12-28 00:39:11,911][106226] Updated weights for policy 0, policy_version 751222 (0.0008) [2023-12-28 00:39:12,442][106225] Updated weights for policy 1, policy_version 753233 (0.0011) [2023-12-28 00:39:12,506][106225] Updated weights for policy 1, policy_version 753243 (0.0011) [2023-12-28 00:39:12,571][106225] Updated weights for policy 1, policy_version 753253 (0.0010) [2023-12-28 00:39:12,627][106226] Updated weights for policy 0, policy_version 751232 (0.0010) [2023-12-28 00:39:12,691][106226] Updated weights for policy 0, policy_version 751242 (0.0010) [2023-12-28 00:39:12,741][106226] Updated weights for policy 0, policy_version 751252 (0.0010) [2023-12-28 00:39:13,260][106225] Updated weights for policy 1, policy_version 753263 (0.0009) [2023-12-28 00:39:13,323][106225] Updated weights for policy 1, policy_version 753273 (0.0010) [2023-12-28 00:39:13,389][106225] Updated weights for policy 1, policy_version 753283 (0.0008) [2023-12-28 00:39:13,432][106226] Updated weights for policy 0, policy_version 751262 (0.0007) [2023-12-28 00:39:13,498][106226] Updated weights for policy 0, policy_version 751272 (0.0008) [2023-12-28 00:39:13,564][106226] Updated weights for policy 0, policy_version 751282 (0.0010) [2023-12-28 00:39:14,017][106225] Updated weights for policy 1, policy_version 753293 (0.0008) [2023-12-28 00:39:14,070][106225] Updated weights for policy 1, policy_version 753303 (0.0008) [2023-12-28 00:39:14,120][106225] Updated weights for policy 1, policy_version 753313 (0.0007) [2023-12-28 00:39:14,261][106226] Updated weights for policy 0, policy_version 751292 (0.0011) [2023-12-28 00:39:14,317][106226] Updated weights for policy 0, policy_version 751302 (0.0010) [2023-12-28 00:39:14,371][106226] Updated weights for policy 0, policy_version 751312 (0.0008) [2023-12-28 00:39:14,732][106225] Updated weights for policy 1, policy_version 753323 (0.0007) [2023-12-28 00:39:14,813][106225] Updated weights for policy 1, policy_version 753333 (0.0009) [2023-12-28 00:39:14,872][106225] Updated weights for policy 1, policy_version 753343 (0.0009) [2023-12-28 00:39:15,127][106226] Updated weights for policy 0, policy_version 751322 (0.0006) [2023-12-28 00:39:15,193][106226] Updated weights for policy 0, policy_version 751332 (0.0008) [2023-12-28 00:39:15,256][106226] Updated weights for policy 0, policy_version 751342 (0.0008) [2023-12-28 00:39:15,320][106226] Updated weights for policy 0, policy_version 751352 (0.0009) [2023-12-28 00:39:15,569][106225] Updated weights for policy 1, policy_version 753353 (0.0010) [2023-12-28 00:39:15,623][106225] Updated weights for policy 1, policy_version 753363 (0.0010) [2023-12-28 00:39:15,679][106225] Updated weights for policy 1, policy_version 753373 (0.0010) [2023-12-28 00:39:15,734][106225] Updated weights for policy 1, policy_version 753383 (0.0010) [2023-12-28 00:39:16,049][106226] Updated weights for policy 0, policy_version 751362 (0.0008) [2023-12-28 00:39:16,099][106226] Updated weights for policy 0, policy_version 751372 (0.0008) [2023-12-28 00:39:16,158][106226] Updated weights for policy 0, policy_version 751382 (0.0008) [2023-12-28 00:39:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 385310720. Throughput: 0: 9758.1, 1: 9983.9. Samples: 385298088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:16,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.141')] [2023-12-28 00:39:16,462][106225] Updated weights for policy 1, policy_version 753393 (0.0010) [2023-12-28 00:39:16,519][106225] Updated weights for policy 1, policy_version 753403 (0.0010) [2023-12-28 00:39:16,576][106225] Updated weights for policy 1, policy_version 753413 (0.0010) [2023-12-28 00:39:16,894][106226] Updated weights for policy 0, policy_version 751392 (0.0008) [2023-12-28 00:39:16,943][106226] Updated weights for policy 0, policy_version 751402 (0.0007) [2023-12-28 00:39:16,997][106226] Updated weights for policy 0, policy_version 751412 (0.0008) [2023-12-28 00:39:17,272][106225] Updated weights for policy 1, policy_version 753423 (0.0008) [2023-12-28 00:39:17,325][106225] Updated weights for policy 1, policy_version 753433 (0.0006) [2023-12-28 00:39:17,370][106225] Updated weights for policy 1, policy_version 753443 (0.0006) [2023-12-28 00:39:17,645][106226] Updated weights for policy 0, policy_version 751422 (0.0006) [2023-12-28 00:39:17,705][106226] Updated weights for policy 0, policy_version 751432 (0.0009) [2023-12-28 00:39:17,766][106226] Updated weights for policy 0, policy_version 751442 (0.0009) [2023-12-28 00:39:18,012][106225] Updated weights for policy 1, policy_version 753453 (0.0008) [2023-12-28 00:39:18,070][106225] Updated weights for policy 1, policy_version 753463 (0.0007) [2023-12-28 00:39:18,124][106225] Updated weights for policy 1, policy_version 753473 (0.0005) [2023-12-28 00:39:18,373][106226] Updated weights for policy 0, policy_version 751452 (0.0008) [2023-12-28 00:39:18,430][106226] Updated weights for policy 0, policy_version 751462 (0.0009) [2023-12-28 00:39:18,483][106226] Updated weights for policy 0, policy_version 751472 (0.0009) [2023-12-28 00:39:18,794][106225] Updated weights for policy 1, policy_version 753483 (0.0005) [2023-12-28 00:39:18,856][106225] Updated weights for policy 1, policy_version 753493 (0.0006) [2023-12-28 00:39:18,923][106225] Updated weights for policy 1, policy_version 753503 (0.0009) [2023-12-28 00:39:19,215][106226] Updated weights for policy 0, policy_version 751482 (0.0008) [2023-12-28 00:39:19,282][106226] Updated weights for policy 0, policy_version 751492 (0.0008) [2023-12-28 00:39:19,333][106226] Updated weights for policy 0, policy_version 751502 (0.0008) [2023-12-28 00:39:19,402][106226] Updated weights for policy 0, policy_version 751512 (0.0008) [2023-12-28 00:39:19,667][106225] Updated weights for policy 1, policy_version 753513 (0.0008) [2023-12-28 00:39:19,729][106225] Updated weights for policy 1, policy_version 753523 (0.0008) [2023-12-28 00:39:19,785][106225] Updated weights for policy 1, policy_version 753533 (0.0007) [2023-12-28 00:39:19,847][106225] Updated weights for policy 1, policy_version 753543 (0.0009) [2023-12-28 00:39:20,214][106226] Updated weights for policy 0, policy_version 751522 (0.0010) [2023-12-28 00:39:20,275][106226] Updated weights for policy 0, policy_version 751532 (0.0009) [2023-12-28 00:39:20,337][106226] Updated weights for policy 0, policy_version 751542 (0.0008) [2023-12-28 00:39:20,597][106225] Updated weights for policy 1, policy_version 753553 (0.0008) [2023-12-28 00:39:20,658][106225] Updated weights for policy 1, policy_version 753563 (0.0008) [2023-12-28 00:39:20,718][106225] Updated weights for policy 1, policy_version 753573 (0.0009) [2023-12-28 00:39:21,049][106226] Updated weights for policy 0, policy_version 751552 (0.0008) [2023-12-28 00:39:21,112][106226] Updated weights for policy 0, policy_version 751562 (0.0006) [2023-12-28 00:39:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 385400832. Throughput: 0: 9670.2, 1: 10014.8. Samples: 385414616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:21,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.031')] [2023-12-28 00:39:21,184][106226] Updated weights for policy 0, policy_version 751572 (0.0009) [2023-12-28 00:39:21,538][106225] Updated weights for policy 1, policy_version 753583 (0.0008) [2023-12-28 00:39:21,597][106225] Updated weights for policy 1, policy_version 753593 (0.0008) [2023-12-28 00:39:21,677][106225] Updated weights for policy 1, policy_version 753603 (0.0009) [2023-12-28 00:39:21,928][106226] Updated weights for policy 0, policy_version 751582 (0.0006) [2023-12-28 00:39:21,989][106226] Updated weights for policy 0, policy_version 751592 (0.0006) [2023-12-28 00:39:22,050][106226] Updated weights for policy 0, policy_version 751602 (0.0006) [2023-12-28 00:39:22,470][106225] Updated weights for policy 1, policy_version 753613 (0.0009) [2023-12-28 00:39:22,530][106225] Updated weights for policy 1, policy_version 753623 (0.0009) [2023-12-28 00:39:22,592][106225] Updated weights for policy 1, policy_version 753633 (0.0008) [2023-12-28 00:39:22,729][106226] Updated weights for policy 0, policy_version 751612 (0.0008) [2023-12-28 00:39:22,798][106226] Updated weights for policy 0, policy_version 751622 (0.0009) [2023-12-28 00:39:22,862][106226] Updated weights for policy 0, policy_version 751632 (0.0007) [2023-12-28 00:39:23,364][106225] Updated weights for policy 1, policy_version 753643 (0.0009) [2023-12-28 00:39:23,426][106225] Updated weights for policy 1, policy_version 753653 (0.0005) [2023-12-28 00:39:23,485][106225] Updated weights for policy 1, policy_version 753663 (0.0006) [2023-12-28 00:39:23,591][106226] Updated weights for policy 0, policy_version 751642 (0.0006) [2023-12-28 00:39:23,643][106226] Updated weights for policy 0, policy_version 751652 (0.0009) [2023-12-28 00:39:23,706][106226] Updated weights for policy 0, policy_version 751662 (0.0009) [2023-12-28 00:39:23,756][106226] Updated weights for policy 0, policy_version 751672 (0.0009) [2023-12-28 00:39:24,216][106225] Updated weights for policy 1, policy_version 753673 (0.0008) [2023-12-28 00:39:24,269][106225] Updated weights for policy 1, policy_version 753683 (0.0008) [2023-12-28 00:39:24,323][106225] Updated weights for policy 1, policy_version 753693 (0.0008) [2023-12-28 00:39:24,383][106225] Updated weights for policy 1, policy_version 753703 (0.0009) [2023-12-28 00:39:24,426][106226] Updated weights for policy 0, policy_version 751682 (0.0005) [2023-12-28 00:39:24,480][106226] Updated weights for policy 0, policy_version 751692 (0.0005) [2023-12-28 00:39:24,530][106226] Updated weights for policy 0, policy_version 751702 (0.0005) [2023-12-28 00:39:25,117][106225] Updated weights for policy 1, policy_version 753713 (0.0005) [2023-12-28 00:39:25,171][106225] Updated weights for policy 1, policy_version 753723 (0.0006) [2023-12-28 00:39:25,179][106226] Updated weights for policy 0, policy_version 751712 (0.0009) [2023-12-28 00:39:25,223][106225] Updated weights for policy 1, policy_version 753733 (0.0006) [2023-12-28 00:39:25,229][106226] Updated weights for policy 0, policy_version 751722 (0.0007) [2023-12-28 00:39:25,294][106226] Updated weights for policy 0, policy_version 751732 (0.0008) [2023-12-28 00:39:25,840][106225] Updated weights for policy 1, policy_version 753743 (0.0007) [2023-12-28 00:39:25,899][106225] Updated weights for policy 1, policy_version 753753 (0.0009) [2023-12-28 00:39:25,958][106225] Updated weights for policy 1, policy_version 753763 (0.0008) [2023-12-28 00:39:26,052][106226] Updated weights for policy 0, policy_version 751742 (0.0008) [2023-12-28 00:39:26,116][106226] Updated weights for policy 0, policy_version 751752 (0.0009) [2023-12-28 00:39:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 385499136. Throughput: 0: 9648.0, 1: 9946.1. Samples: 385469636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:26,176][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.994')] [2023-12-28 00:39:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000753768_193003520.pth... [2023-12-28 00:39:26,190][106226] Updated weights for policy 0, policy_version 751762 (0.0010) [2023-12-28 00:39:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000752616_192708608.pth [2023-12-28 00:39:26,220][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000751768_192503808.pth... [2023-12-28 00:39:26,223][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000750616_192208896.pth [2023-12-28 00:39:26,572][106225] Updated weights for policy 1, policy_version 753773 (0.0008) [2023-12-28 00:39:26,622][106225] Updated weights for policy 1, policy_version 753783 (0.0008) [2023-12-28 00:39:26,677][106225] Updated weights for policy 1, policy_version 753793 (0.0010) [2023-12-28 00:39:26,861][106226] Updated weights for policy 0, policy_version 751772 (0.0007) [2023-12-28 00:39:26,925][106226] Updated weights for policy 0, policy_version 751782 (0.0005) [2023-12-28 00:39:26,994][106226] Updated weights for policy 0, policy_version 751792 (0.0006) [2023-12-28 00:39:27,255][106225] Updated weights for policy 1, policy_version 753803 (0.0009) [2023-12-28 00:39:27,316][106225] Updated weights for policy 1, policy_version 753813 (0.0006) [2023-12-28 00:39:27,374][106225] Updated weights for policy 1, policy_version 753823 (0.0008) [2023-12-28 00:39:27,539][106226] Updated weights for policy 0, policy_version 751802 (0.0005) [2023-12-28 00:39:27,591][106226] Updated weights for policy 0, policy_version 751812 (0.0006) [2023-12-28 00:39:27,637][106226] Updated weights for policy 0, policy_version 751822 (0.0005) [2023-12-28 00:39:27,696][106226] Updated weights for policy 0, policy_version 751832 (0.0005) [2023-12-28 00:39:28,148][106225] Updated weights for policy 1, policy_version 753833 (0.0009) [2023-12-28 00:39:28,198][106225] Updated weights for policy 1, policy_version 753843 (0.0005) [2023-12-28 00:39:28,233][106226] Updated weights for policy 0, policy_version 751842 (0.0009) [2023-12-28 00:39:28,252][106225] Updated weights for policy 1, policy_version 753853 (0.0006) [2023-12-28 00:39:28,280][106226] Updated weights for policy 0, policy_version 751852 (0.0006) [2023-12-28 00:39:28,307][106225] Updated weights for policy 1, policy_version 753863 (0.0005) [2023-12-28 00:39:28,332][106226] Updated weights for policy 0, policy_version 751862 (0.0010) [2023-12-28 00:39:28,922][106225] Updated weights for policy 1, policy_version 753873 (0.0008) [2023-12-28 00:39:28,960][106226] Updated weights for policy 0, policy_version 751872 (0.0006) [2023-12-28 00:39:28,976][106225] Updated weights for policy 1, policy_version 753883 (0.0007) [2023-12-28 00:39:29,025][106226] Updated weights for policy 0, policy_version 751882 (0.0008) [2023-12-28 00:39:29,026][106225] Updated weights for policy 1, policy_version 753893 (0.0007) [2023-12-28 00:39:29,078][106226] Updated weights for policy 0, policy_version 751892 (0.0010) [2023-12-28 00:39:29,717][106225] Updated weights for policy 1, policy_version 753903 (0.0006) [2023-12-28 00:39:29,768][106226] Updated weights for policy 0, policy_version 751902 (0.0011) [2023-12-28 00:39:29,780][106225] Updated weights for policy 1, policy_version 753913 (0.0005) [2023-12-28 00:39:29,834][106226] Updated weights for policy 0, policy_version 751912 (0.0011) [2023-12-28 00:39:29,844][106225] Updated weights for policy 1, policy_version 753923 (0.0006) [2023-12-28 00:39:29,901][106226] Updated weights for policy 0, policy_version 751922 (0.0010) [2023-12-28 00:39:30,506][106226] Updated weights for policy 0, policy_version 751932 (0.0008) [2023-12-28 00:39:30,564][106226] Updated weights for policy 0, policy_version 751942 (0.0006) [2023-12-28 00:39:30,594][106225] Updated weights for policy 1, policy_version 753933 (0.0007) [2023-12-28 00:39:30,627][106226] Updated weights for policy 0, policy_version 751952 (0.0009) [2023-12-28 00:39:30,648][106225] Updated weights for policy 1, policy_version 753943 (0.0006) [2023-12-28 00:39:30,699][106225] Updated weights for policy 1, policy_version 753953 (0.0007) [2023-12-28 00:39:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 385605632. Throughput: 0: 9772.4, 1: 10000.8. Samples: 385596280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:31,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.432')] [2023-12-28 00:39:31,306][106226] Updated weights for policy 0, policy_version 751962 (0.0009) [2023-12-28 00:39:31,375][106226] Updated weights for policy 0, policy_version 751972 (0.0008) [2023-12-28 00:39:31,436][106226] Updated weights for policy 0, policy_version 751982 (0.0007) [2023-12-28 00:39:31,481][106225] Updated weights for policy 1, policy_version 753963 (0.0007) [2023-12-28 00:39:31,493][106226] Updated weights for policy 0, policy_version 751992 (0.0005) [2023-12-28 00:39:31,541][106225] Updated weights for policy 1, policy_version 753973 (0.0007) [2023-12-28 00:39:31,604][106225] Updated weights for policy 1, policy_version 753983 (0.0007) [2023-12-28 00:39:32,229][106226] Updated weights for policy 0, policy_version 752002 (0.0011) [2023-12-28 00:39:32,295][106226] Updated weights for policy 0, policy_version 752012 (0.0011) [2023-12-28 00:39:32,323][106225] Updated weights for policy 1, policy_version 753993 (0.0009) [2023-12-28 00:39:32,355][106226] Updated weights for policy 0, policy_version 752022 (0.0009) [2023-12-28 00:39:32,388][106225] Updated weights for policy 1, policy_version 754003 (0.0008) [2023-12-28 00:39:32,451][106225] Updated weights for policy 1, policy_version 754013 (0.0008) [2023-12-28 00:39:32,516][106225] Updated weights for policy 1, policy_version 754023 (0.0008) [2023-12-28 00:39:33,072][106226] Updated weights for policy 0, policy_version 752032 (0.0008) [2023-12-28 00:39:33,132][106226] Updated weights for policy 0, policy_version 752042 (0.0011) [2023-12-28 00:39:33,184][106226] Updated weights for policy 0, policy_version 752052 (0.0010) [2023-12-28 00:39:33,274][106225] Updated weights for policy 1, policy_version 754033 (0.0006) [2023-12-28 00:39:33,337][106225] Updated weights for policy 1, policy_version 754043 (0.0005) [2023-12-28 00:39:33,403][106225] Updated weights for policy 1, policy_version 754053 (0.0005) [2023-12-28 00:39:33,890][106226] Updated weights for policy 0, policy_version 752062 (0.0010) [2023-12-28 00:39:33,892][106225] Updated weights for policy 1, policy_version 754063 (0.0005) [2023-12-28 00:39:33,949][106226] Updated weights for policy 0, policy_version 752072 (0.0007) [2023-12-28 00:39:33,951][106225] Updated weights for policy 1, policy_version 754073 (0.0006) [2023-12-28 00:39:34,008][106226] Updated weights for policy 0, policy_version 752082 (0.0010) [2023-12-28 00:39:34,016][106225] Updated weights for policy 1, policy_version 754083 (0.0005) [2023-12-28 00:39:34,706][106225] Updated weights for policy 1, policy_version 754093 (0.0007) [2023-12-28 00:39:34,718][106226] Updated weights for policy 0, policy_version 752092 (0.0010) [2023-12-28 00:39:34,767][106225] Updated weights for policy 1, policy_version 754103 (0.0007) [2023-12-28 00:39:34,769][106226] Updated weights for policy 0, policy_version 752102 (0.0011) [2023-12-28 00:39:34,825][106226] Updated weights for policy 0, policy_version 752112 (0.0010) [2023-12-28 00:39:34,827][106225] Updated weights for policy 1, policy_version 754113 (0.0007) [2023-12-28 00:39:35,467][106226] Updated weights for policy 0, policy_version 752122 (0.0008) [2023-12-28 00:39:35,533][106226] Updated weights for policy 0, policy_version 752132 (0.0010) [2023-12-28 00:39:35,563][106225] Updated weights for policy 1, policy_version 754123 (0.0009) [2023-12-28 00:39:35,593][106226] Updated weights for policy 0, policy_version 752142 (0.0009) [2023-12-28 00:39:35,617][106225] Updated weights for policy 1, policy_version 754133 (0.0006) [2023-12-28 00:39:35,654][106226] Updated weights for policy 0, policy_version 752152 (0.0008) [2023-12-28 00:39:35,674][106225] Updated weights for policy 1, policy_version 754143 (0.0007) [2023-12-28 00:39:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 385703936. Throughput: 0: 9808.9, 1: 9957.5. Samples: 385716516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:36,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.237')] [2023-12-28 00:39:36,239][106226] Updated weights for policy 0, policy_version 752162 (0.0009) [2023-12-28 00:39:36,308][106226] Updated weights for policy 0, policy_version 752172 (0.0007) [2023-12-28 00:39:36,379][106226] Updated weights for policy 0, policy_version 752182 (0.0011) [2023-12-28 00:39:36,493][106225] Updated weights for policy 1, policy_version 754153 (0.0008) [2023-12-28 00:39:36,556][106225] Updated weights for policy 1, policy_version 754163 (0.0008) [2023-12-28 00:39:36,626][106225] Updated weights for policy 1, policy_version 754173 (0.0011) [2023-12-28 00:39:36,688][106225] Updated weights for policy 1, policy_version 754183 (0.0010) [2023-12-28 00:39:37,012][106226] Updated weights for policy 0, policy_version 752192 (0.0006) [2023-12-28 00:39:37,061][106226] Updated weights for policy 0, policy_version 752202 (0.0005) [2023-12-28 00:39:37,119][106226] Updated weights for policy 0, policy_version 752212 (0.0006) [2023-12-28 00:39:37,408][106225] Updated weights for policy 1, policy_version 754193 (0.0010) [2023-12-28 00:39:37,460][106225] Updated weights for policy 1, policy_version 754203 (0.0010) [2023-12-28 00:39:37,514][106225] Updated weights for policy 1, policy_version 754213 (0.0010) [2023-12-28 00:39:37,718][106226] Updated weights for policy 0, policy_version 752222 (0.0006) [2023-12-28 00:39:37,790][106226] Updated weights for policy 0, policy_version 752232 (0.0006) [2023-12-28 00:39:37,858][106226] Updated weights for policy 0, policy_version 752242 (0.0006) [2023-12-28 00:39:38,168][106225] Updated weights for policy 1, policy_version 754223 (0.0007) [2023-12-28 00:39:38,223][106225] Updated weights for policy 1, policy_version 754233 (0.0005) [2023-12-28 00:39:38,277][106225] Updated weights for policy 1, policy_version 754243 (0.0005) [2023-12-28 00:39:38,481][106226] Updated weights for policy 0, policy_version 752252 (0.0005) [2023-12-28 00:39:38,549][106226] Updated weights for policy 0, policy_version 752262 (0.0006) [2023-12-28 00:39:38,611][106226] Updated weights for policy 0, policy_version 752272 (0.0006) [2023-12-28 00:39:38,987][106225] Updated weights for policy 1, policy_version 754253 (0.0005) [2023-12-28 00:39:39,047][106225] Updated weights for policy 1, policy_version 754263 (0.0005) [2023-12-28 00:39:39,099][106225] Updated weights for policy 1, policy_version 754273 (0.0005) [2023-12-28 00:39:39,301][106226] Updated weights for policy 0, policy_version 752282 (0.0010) [2023-12-28 00:39:39,374][106226] Updated weights for policy 0, policy_version 752292 (0.0008) [2023-12-28 00:39:39,446][106226] Updated weights for policy 0, policy_version 752302 (0.0010) [2023-12-28 00:39:39,510][106226] Updated weights for policy 0, policy_version 752312 (0.0007) [2023-12-28 00:39:39,787][106225] Updated weights for policy 1, policy_version 754283 (0.0007) [2023-12-28 00:39:39,846][106225] Updated weights for policy 1, policy_version 754293 (0.0008) [2023-12-28 00:39:39,916][106225] Updated weights for policy 1, policy_version 754303 (0.0007) [2023-12-28 00:39:40,261][106226] Updated weights for policy 0, policy_version 752322 (0.0011) [2023-12-28 00:39:40,312][106226] Updated weights for policy 0, policy_version 752332 (0.0010) [2023-12-28 00:39:40,372][106226] Updated weights for policy 0, policy_version 752342 (0.0011) [2023-12-28 00:39:40,572][106225] Updated weights for policy 1, policy_version 754313 (0.0008) [2023-12-28 00:39:40,630][106225] Updated weights for policy 1, policy_version 754323 (0.0008) [2023-12-28 00:39:40,691][106225] Updated weights for policy 1, policy_version 754333 (0.0008) [2023-12-28 00:39:40,754][106225] Updated weights for policy 1, policy_version 754343 (0.0007) [2023-12-28 00:39:41,122][106226] Updated weights for policy 0, policy_version 752352 (0.0011) [2023-12-28 00:39:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 385802240. Throughput: 0: 9868.2, 1: 9954.0. Samples: 385777244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:41,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.700')] [2023-12-28 00:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000754344_193150976.pth... [2023-12-28 00:39:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000753192_192856064.pth [2023-12-28 00:39:41,185][106141] Saving new best policy, reward=-4.700! [2023-12-28 00:39:41,202][106226] Updated weights for policy 0, policy_version 752362 (0.0010) [2023-12-28 00:39:41,265][106226] Updated weights for policy 0, policy_version 752372 (0.0010) [2023-12-28 00:39:41,288][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000752376_192659456.pth... [2023-12-28 00:39:41,292][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000751192_192356352.pth [2023-12-28 00:39:41,432][106225] Updated weights for policy 1, policy_version 754353 (0.0008) [2023-12-28 00:39:41,503][106225] Updated weights for policy 1, policy_version 754363 (0.0009) [2023-12-28 00:39:41,561][106225] Updated weights for policy 1, policy_version 754373 (0.0010) [2023-12-28 00:39:42,016][106226] Updated weights for policy 0, policy_version 752382 (0.0009) [2023-12-28 00:39:42,078][106226] Updated weights for policy 0, policy_version 752392 (0.0009) [2023-12-28 00:39:42,139][106226] Updated weights for policy 0, policy_version 752402 (0.0009) [2023-12-28 00:39:42,347][106225] Updated weights for policy 1, policy_version 754383 (0.0009) [2023-12-28 00:39:42,411][106225] Updated weights for policy 1, policy_version 754393 (0.0008) [2023-12-28 00:39:42,478][106225] Updated weights for policy 1, policy_version 754403 (0.0009) [2023-12-28 00:39:42,877][106226] Updated weights for policy 0, policy_version 752412 (0.0009) [2023-12-28 00:39:42,940][106226] Updated weights for policy 0, policy_version 752422 (0.0007) [2023-12-28 00:39:42,999][106226] Updated weights for policy 0, policy_version 752432 (0.0007) [2023-12-28 00:39:43,146][106225] Updated weights for policy 1, policy_version 754413 (0.0009) [2023-12-28 00:39:43,203][106225] Updated weights for policy 1, policy_version 754423 (0.0010) [2023-12-28 00:39:43,254][106225] Updated weights for policy 1, policy_version 754433 (0.0010) [2023-12-28 00:39:43,703][106226] Updated weights for policy 0, policy_version 752442 (0.0006) [2023-12-28 00:39:43,763][106226] Updated weights for policy 0, policy_version 752452 (0.0010) [2023-12-28 00:39:43,818][106226] Updated weights for policy 0, policy_version 752462 (0.0011) [2023-12-28 00:39:43,885][106226] Updated weights for policy 0, policy_version 752472 (0.0011) [2023-12-28 00:39:43,934][106225] Updated weights for policy 1, policy_version 754443 (0.0009) [2023-12-28 00:39:43,998][106225] Updated weights for policy 1, policy_version 754453 (0.0005) [2023-12-28 00:39:44,061][106225] Updated weights for policy 1, policy_version 754463 (0.0010) [2023-12-28 00:39:44,594][106226] Updated weights for policy 0, policy_version 752482 (0.0005) [2023-12-28 00:39:44,619][106225] Updated weights for policy 1, policy_version 754473 (0.0010) [2023-12-28 00:39:44,643][106226] Updated weights for policy 0, policy_version 752492 (0.0005) [2023-12-28 00:39:44,670][106225] Updated weights for policy 1, policy_version 754483 (0.0005) [2023-12-28 00:39:44,701][106226] Updated weights for policy 0, policy_version 752502 (0.0008) [2023-12-28 00:39:44,729][106225] Updated weights for policy 1, policy_version 754493 (0.0005) [2023-12-28 00:39:44,789][106225] Updated weights for policy 1, policy_version 754503 (0.0007) [2023-12-28 00:39:45,387][106225] Updated weights for policy 1, policy_version 754513 (0.0006) [2023-12-28 00:39:45,414][106226] Updated weights for policy 0, policy_version 752512 (0.0008) [2023-12-28 00:39:45,442][106225] Updated weights for policy 1, policy_version 754523 (0.0006) [2023-12-28 00:39:45,469][106226] Updated weights for policy 0, policy_version 752522 (0.0005) [2023-12-28 00:39:45,508][106225] Updated weights for policy 1, policy_version 754533 (0.0005) [2023-12-28 00:39:45,524][106226] Updated weights for policy 0, policy_version 752532 (0.0008) [2023-12-28 00:39:46,094][106226] Updated weights for policy 0, policy_version 752542 (0.0007) [2023-12-28 00:39:46,141][106226] Updated weights for policy 0, policy_version 752552 (0.0005) [2023-12-28 00:39:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 385900544. Throughput: 0: 9884.6, 1: 9962.1. Samples: 385895424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:46,175][105115] Avg episode reward: [(0, '-4.140'), (1, '-5.305')] [2023-12-28 00:39:46,187][106226] Updated weights for policy 0, policy_version 752562 (0.0006) [2023-12-28 00:39:46,201][106225] Updated weights for policy 1, policy_version 754543 (0.0006) [2023-12-28 00:39:46,253][106225] Updated weights for policy 1, policy_version 754553 (0.0007) [2023-12-28 00:39:46,307][106225] Updated weights for policy 1, policy_version 754563 (0.0008) [2023-12-28 00:39:46,840][106226] Updated weights for policy 0, policy_version 752572 (0.0009) [2023-12-28 00:39:46,894][106226] Updated weights for policy 0, policy_version 752582 (0.0009) [2023-12-28 00:39:46,939][106226] Updated weights for policy 0, policy_version 752592 (0.0008) [2023-12-28 00:39:47,050][106225] Updated weights for policy 1, policy_version 754573 (0.0009) [2023-12-28 00:39:47,108][106225] Updated weights for policy 1, policy_version 754583 (0.0008) [2023-12-28 00:39:47,164][106225] Updated weights for policy 1, policy_version 754593 (0.0008) [2023-12-28 00:39:47,563][106226] Updated weights for policy 0, policy_version 752602 (0.0007) [2023-12-28 00:39:47,629][106226] Updated weights for policy 0, policy_version 752612 (0.0005) [2023-12-28 00:39:47,690][106226] Updated weights for policy 0, policy_version 752622 (0.0006) [2023-12-28 00:39:47,752][106226] Updated weights for policy 0, policy_version 752632 (0.0008) [2023-12-28 00:39:47,960][106225] Updated weights for policy 1, policy_version 754603 (0.0010) [2023-12-28 00:39:48,012][106225] Updated weights for policy 1, policy_version 754613 (0.0008) [2023-12-28 00:39:48,070][106225] Updated weights for policy 1, policy_version 754623 (0.0005) [2023-12-28 00:39:48,373][106226] Updated weights for policy 0, policy_version 752642 (0.0008) [2023-12-28 00:39:48,430][106226] Updated weights for policy 0, policy_version 752652 (0.0008) [2023-12-28 00:39:48,489][106226] Updated weights for policy 0, policy_version 752662 (0.0009) [2023-12-28 00:39:48,783][106225] Updated weights for policy 1, policy_version 754633 (0.0008) [2023-12-28 00:39:48,848][106225] Updated weights for policy 1, policy_version 754643 (0.0008) [2023-12-28 00:39:48,905][106225] Updated weights for policy 1, policy_version 754653 (0.0009) [2023-12-28 00:39:48,952][106225] Updated weights for policy 1, policy_version 754663 (0.0008) [2023-12-28 00:39:49,236][106226] Updated weights for policy 0, policy_version 752672 (0.0008) [2023-12-28 00:39:49,307][106226] Updated weights for policy 0, policy_version 752682 (0.0008) [2023-12-28 00:39:49,374][106226] Updated weights for policy 0, policy_version 752692 (0.0009) [2023-12-28 00:39:49,696][106225] Updated weights for policy 1, policy_version 754673 (0.0008) [2023-12-28 00:39:49,755][106225] Updated weights for policy 1, policy_version 754683 (0.0008) [2023-12-28 00:39:49,812][106225] Updated weights for policy 1, policy_version 754693 (0.0009) [2023-12-28 00:39:50,062][106226] Updated weights for policy 0, policy_version 752702 (0.0009) [2023-12-28 00:39:50,125][106226] Updated weights for policy 0, policy_version 752712 (0.0009) [2023-12-28 00:39:50,185][106226] Updated weights for policy 0, policy_version 752722 (0.0009) [2023-12-28 00:39:50,547][106225] Updated weights for policy 1, policy_version 754703 (0.0009) [2023-12-28 00:39:50,611][106225] Updated weights for policy 1, policy_version 754713 (0.0009) [2023-12-28 00:39:50,685][106225] Updated weights for policy 1, policy_version 754723 (0.0009) [2023-12-28 00:39:50,871][106226] Updated weights for policy 0, policy_version 752732 (0.0009) [2023-12-28 00:39:50,927][106226] Updated weights for policy 0, policy_version 752742 (0.0008) [2023-12-28 00:39:50,984][106226] Updated weights for policy 0, policy_version 752752 (0.0009) [2023-12-28 00:39:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 386007040. Throughput: 0: 9948.0, 1: 9864.2. Samples: 386014852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:51,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.996')] [2023-12-28 00:39:51,440][106225] Updated weights for policy 1, policy_version 754733 (0.0008) [2023-12-28 00:39:51,506][106225] Updated weights for policy 1, policy_version 754743 (0.0008) [2023-12-28 00:39:51,570][106225] Updated weights for policy 1, policy_version 754753 (0.0006) [2023-12-28 00:39:51,799][106226] Updated weights for policy 0, policy_version 752762 (0.0009) [2023-12-28 00:39:51,861][106226] Updated weights for policy 0, policy_version 752772 (0.0007) [2023-12-28 00:39:51,915][106226] Updated weights for policy 0, policy_version 752782 (0.0007) [2023-12-28 00:39:51,964][106226] Updated weights for policy 0, policy_version 752792 (0.0009) [2023-12-28 00:39:52,277][106225] Updated weights for policy 1, policy_version 754763 (0.0006) [2023-12-28 00:39:52,337][106225] Updated weights for policy 1, policy_version 754773 (0.0008) [2023-12-28 00:39:52,415][106225] Updated weights for policy 1, policy_version 754783 (0.0008) [2023-12-28 00:39:52,702][106226] Updated weights for policy 0, policy_version 752802 (0.0008) [2023-12-28 00:39:52,760][106226] Updated weights for policy 0, policy_version 752812 (0.0006) [2023-12-28 00:39:52,826][106226] Updated weights for policy 0, policy_version 752822 (0.0009) [2023-12-28 00:39:53,155][106225] Updated weights for policy 1, policy_version 754793 (0.0008) [2023-12-28 00:39:53,208][106225] Updated weights for policy 1, policy_version 754803 (0.0005) [2023-12-28 00:39:53,275][106225] Updated weights for policy 1, policy_version 754813 (0.0005) [2023-12-28 00:39:53,340][106225] Updated weights for policy 1, policy_version 754823 (0.0008) [2023-12-28 00:39:53,525][106226] Updated weights for policy 0, policy_version 752832 (0.0008) [2023-12-28 00:39:53,587][106226] Updated weights for policy 0, policy_version 752842 (0.0009) [2023-12-28 00:39:53,653][106226] Updated weights for policy 0, policy_version 752852 (0.0009) [2023-12-28 00:39:54,037][106225] Updated weights for policy 1, policy_version 754833 (0.0010) [2023-12-28 00:39:54,099][106225] Updated weights for policy 1, policy_version 754843 (0.0008) [2023-12-28 00:39:54,153][106225] Updated weights for policy 1, policy_version 754853 (0.0009) [2023-12-28 00:39:54,250][106226] Updated weights for policy 0, policy_version 752862 (0.0009) [2023-12-28 00:39:54,314][106226] Updated weights for policy 0, policy_version 752872 (0.0009) [2023-12-28 00:39:54,376][106226] Updated weights for policy 0, policy_version 752882 (0.0008) [2023-12-28 00:39:54,857][106225] Updated weights for policy 1, policy_version 754863 (0.0007) [2023-12-28 00:39:54,923][106225] Updated weights for policy 1, policy_version 754873 (0.0010) [2023-12-28 00:39:54,990][106225] Updated weights for policy 1, policy_version 754883 (0.0011) [2023-12-28 00:39:55,119][106226] Updated weights for policy 0, policy_version 752892 (0.0008) [2023-12-28 00:39:55,181][106226] Updated weights for policy 0, policy_version 752902 (0.0006) [2023-12-28 00:39:55,231][106226] Updated weights for policy 0, policy_version 752912 (0.0008) [2023-12-28 00:39:55,668][106225] Updated weights for policy 1, policy_version 754893 (0.0006) [2023-12-28 00:39:55,729][106225] Updated weights for policy 1, policy_version 754903 (0.0006) [2023-12-28 00:39:55,780][106225] Updated weights for policy 1, policy_version 754913 (0.0009) [2023-12-28 00:39:55,909][106226] Updated weights for policy 0, policy_version 752922 (0.0006) [2023-12-28 00:39:55,971][106226] Updated weights for policy 0, policy_version 752932 (0.0010) [2023-12-28 00:39:56,034][106226] Updated weights for policy 0, policy_version 752942 (0.0009) [2023-12-28 00:39:56,092][106226] Updated weights for policy 0, policy_version 752952 (0.0009) [2023-12-28 00:39:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 386105344. Throughput: 0: 9962.6, 1: 9843.5. Samples: 386072912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:39:56,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-5.036')] [2023-12-28 00:39:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000754920_193298432.pth... [2023-12-28 00:39:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000752952_192806912.pth... [2023-12-28 00:39:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000753768_193003520.pth [2023-12-28 00:39:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000751768_192503808.pth [2023-12-28 00:39:56,361][106225] Updated weights for policy 1, policy_version 754923 (0.0010) [2023-12-28 00:39:56,410][106225] Updated weights for policy 1, policy_version 754933 (0.0010) [2023-12-28 00:39:56,470][106225] Updated weights for policy 1, policy_version 754943 (0.0010) [2023-12-28 00:39:56,837][106226] Updated weights for policy 0, policy_version 752962 (0.0006) [2023-12-28 00:39:56,901][106226] Updated weights for policy 0, policy_version 752972 (0.0006) [2023-12-28 00:39:56,961][106226] Updated weights for policy 0, policy_version 752982 (0.0005) [2023-12-28 00:39:57,051][106225] Updated weights for policy 1, policy_version 754953 (0.0010) [2023-12-28 00:39:57,108][106225] Updated weights for policy 1, policy_version 754963 (0.0005) [2023-12-28 00:39:57,164][106225] Updated weights for policy 1, policy_version 754973 (0.0005) [2023-12-28 00:39:57,218][106225] Updated weights for policy 1, policy_version 754983 (0.0008) [2023-12-28 00:39:57,601][106226] Updated weights for policy 0, policy_version 752992 (0.0008) [2023-12-28 00:39:57,662][106226] Updated weights for policy 0, policy_version 753002 (0.0008) [2023-12-28 00:39:57,716][106226] Updated weights for policy 0, policy_version 753012 (0.0008) [2023-12-28 00:39:57,863][106225] Updated weights for policy 1, policy_version 754993 (0.0006) [2023-12-28 00:39:57,914][106225] Updated weights for policy 1, policy_version 755003 (0.0005) [2023-12-28 00:39:57,970][106225] Updated weights for policy 1, policy_version 755013 (0.0005) [2023-12-28 00:39:58,501][106226] Updated weights for policy 0, policy_version 753022 (0.0011) [2023-12-28 00:39:58,560][106226] Updated weights for policy 0, policy_version 753032 (0.0012) [2023-12-28 00:39:58,625][106226] Updated weights for policy 0, policy_version 753042 (0.0010) [2023-12-28 00:39:58,752][106225] Updated weights for policy 1, policy_version 755023 (0.0010) [2023-12-28 00:39:58,821][106225] Updated weights for policy 1, policy_version 755033 (0.0013) [2023-12-28 00:39:58,889][106225] Updated weights for policy 1, policy_version 755043 (0.0010) [2023-12-28 00:39:59,461][106226] Updated weights for policy 0, policy_version 753052 (0.0008) [2023-12-28 00:39:59,518][106226] Updated weights for policy 0, policy_version 753062 (0.0008) [2023-12-28 00:39:59,571][106226] Updated weights for policy 0, policy_version 753072 (0.0008) [2023-12-28 00:39:59,648][106225] Updated weights for policy 1, policy_version 755053 (0.0010) [2023-12-28 00:39:59,711][106225] Updated weights for policy 1, policy_version 755063 (0.0006) [2023-12-28 00:39:59,773][106225] Updated weights for policy 1, policy_version 755073 (0.0005) [2023-12-28 00:40:00,352][106226] Updated weights for policy 0, policy_version 753082 (0.0008) [2023-12-28 00:40:00,401][106226] Updated weights for policy 0, policy_version 753092 (0.0010) [2023-12-28 00:40:00,432][106225] Updated weights for policy 1, policy_version 755083 (0.0009) [2023-12-28 00:40:00,450][106226] Updated weights for policy 0, policy_version 753102 (0.0008) [2023-12-28 00:40:00,498][106225] Updated weights for policy 1, policy_version 755093 (0.0007) [2023-12-28 00:40:00,504][106226] Updated weights for policy 0, policy_version 753112 (0.0006) [2023-12-28 00:40:00,565][106225] Updated weights for policy 1, policy_version 755103 (0.0008) [2023-12-28 00:40:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 386195456. Throughput: 0: 9953.2, 1: 9859.9. Samples: 386189676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:40:01,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-5.432')] [2023-12-28 00:40:01,243][106225] Updated weights for policy 1, policy_version 755113 (0.0009) [2023-12-28 00:40:01,256][106226] Updated weights for policy 0, policy_version 753122 (0.0009) [2023-12-28 00:40:01,307][106225] Updated weights for policy 1, policy_version 755123 (0.0007) [2023-12-28 00:40:01,320][106226] Updated weights for policy 0, policy_version 753132 (0.0008) [2023-12-28 00:40:01,375][106225] Updated weights for policy 1, policy_version 755133 (0.0008) [2023-12-28 00:40:01,389][106226] Updated weights for policy 0, policy_version 753142 (0.0011) [2023-12-28 00:40:01,434][106225] Updated weights for policy 1, policy_version 755143 (0.0006) [2023-12-28 00:40:02,031][106226] Updated weights for policy 0, policy_version 753152 (0.0009) [2023-12-28 00:40:02,073][106225] Updated weights for policy 1, policy_version 755153 (0.0009) [2023-12-28 00:40:02,085][106226] Updated weights for policy 0, policy_version 753162 (0.0005) [2023-12-28 00:40:02,129][106225] Updated weights for policy 1, policy_version 755163 (0.0008) [2023-12-28 00:40:02,146][106226] Updated weights for policy 0, policy_version 753172 (0.0005) [2023-12-28 00:40:02,192][106225] Updated weights for policy 1, policy_version 755173 (0.0007) [2023-12-28 00:40:02,714][106226] Updated weights for policy 0, policy_version 753182 (0.0006) [2023-12-28 00:40:02,770][106226] Updated weights for policy 0, policy_version 753192 (0.0008) [2023-12-28 00:40:02,817][106226] Updated weights for policy 0, policy_version 753202 (0.0008) [2023-12-28 00:40:03,032][106225] Updated weights for policy 1, policy_version 755183 (0.0008) [2023-12-28 00:40:03,092][106225] Updated weights for policy 1, policy_version 755193 (0.0006) [2023-12-28 00:40:03,158][106225] Updated weights for policy 1, policy_version 755203 (0.0005) [2023-12-28 00:40:03,485][106226] Updated weights for policy 0, policy_version 753212 (0.0009) [2023-12-28 00:40:03,534][106226] Updated weights for policy 0, policy_version 753222 (0.0010) [2023-12-28 00:40:03,583][106226] Updated weights for policy 0, policy_version 753232 (0.0010) [2023-12-28 00:40:03,671][106225] Updated weights for policy 1, policy_version 755213 (0.0008) [2023-12-28 00:40:03,727][106225] Updated weights for policy 1, policy_version 755223 (0.0010) [2023-12-28 00:40:03,782][106225] Updated weights for policy 1, policy_version 755233 (0.0010) [2023-12-28 00:40:04,318][106226] Updated weights for policy 0, policy_version 753242 (0.0009) [2023-12-28 00:40:04,386][106226] Updated weights for policy 0, policy_version 753252 (0.0008) [2023-12-28 00:40:04,449][106226] Updated weights for policy 0, policy_version 753262 (0.0008) [2023-12-28 00:40:04,507][106226] Updated weights for policy 0, policy_version 753272 (0.0008) [2023-12-28 00:40:04,525][106225] Updated weights for policy 1, policy_version 755243 (0.0010) [2023-12-28 00:40:04,586][106225] Updated weights for policy 1, policy_version 755253 (0.0009) [2023-12-28 00:40:04,648][106225] Updated weights for policy 1, policy_version 755263 (0.0010) [2023-12-28 00:40:05,234][106226] Updated weights for policy 0, policy_version 753282 (0.0008) [2023-12-28 00:40:05,287][106226] Updated weights for policy 0, policy_version 753292 (0.0008) [2023-12-28 00:40:05,341][106226] Updated weights for policy 0, policy_version 753302 (0.0007) [2023-12-28 00:40:05,371][106225] Updated weights for policy 1, policy_version 755273 (0.0010) [2023-12-28 00:40:05,433][106225] Updated weights for policy 1, policy_version 755283 (0.0010) [2023-12-28 00:40:05,480][106225] Updated weights for policy 1, policy_version 755293 (0.0010) [2023-12-28 00:40:05,529][106225] Updated weights for policy 1, policy_version 755303 (0.0010) [2023-12-28 00:40:06,039][106226] Updated weights for policy 0, policy_version 753312 (0.0006) [2023-12-28 00:40:06,094][106226] Updated weights for policy 0, policy_version 753322 (0.0007) [2023-12-28 00:40:06,157][106226] Updated weights for policy 0, policy_version 753332 (0.0010) [2023-12-28 00:40:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 386293760. Throughput: 0: 10019.3, 1: 9891.1. Samples: 386310584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:40:06,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.261')] [2023-12-28 00:40:06,200][106225] Updated weights for policy 1, policy_version 755313 (0.0007) [2023-12-28 00:40:06,261][106225] Updated weights for policy 1, policy_version 755323 (0.0006) [2023-12-28 00:40:06,326][106225] Updated weights for policy 1, policy_version 755333 (0.0006) [2023-12-28 00:40:06,853][106226] Updated weights for policy 0, policy_version 753342 (0.0007) [2023-12-28 00:40:06,903][106226] Updated weights for policy 0, policy_version 753352 (0.0007) [2023-12-28 00:40:06,956][106226] Updated weights for policy 0, policy_version 753362 (0.0008) [2023-12-28 00:40:07,057][106225] Updated weights for policy 1, policy_version 755343 (0.0008) [2023-12-28 00:40:07,119][106225] Updated weights for policy 1, policy_version 755353 (0.0007) [2023-12-28 00:40:07,179][106225] Updated weights for policy 1, policy_version 755363 (0.0009) [2023-12-28 00:40:07,599][106226] Updated weights for policy 0, policy_version 753372 (0.0009) [2023-12-28 00:40:07,644][106226] Updated weights for policy 0, policy_version 753382 (0.0008) [2023-12-28 00:40:07,700][106226] Updated weights for policy 0, policy_version 753392 (0.0008) [2023-12-28 00:40:07,945][106225] Updated weights for policy 1, policy_version 755373 (0.0009) [2023-12-28 00:40:07,999][106225] Updated weights for policy 1, policy_version 755383 (0.0010) [2023-12-28 00:40:08,052][106225] Updated weights for policy 1, policy_version 755393 (0.0010) [2023-12-28 00:40:08,308][106226] Updated weights for policy 0, policy_version 753402 (0.0007) [2023-12-28 00:40:08,370][106226] Updated weights for policy 0, policy_version 753412 (0.0008) [2023-12-28 00:40:08,430][106226] Updated weights for policy 0, policy_version 753422 (0.0008) [2023-12-28 00:40:08,491][106226] Updated weights for policy 0, policy_version 753432 (0.0009) [2023-12-28 00:40:08,697][106225] Updated weights for policy 1, policy_version 755403 (0.0009) [2023-12-28 00:40:08,760][106225] Updated weights for policy 1, policy_version 755413 (0.0010) [2023-12-28 00:40:08,818][106225] Updated weights for policy 1, policy_version 755423 (0.0010) [2023-12-28 00:40:09,204][106226] Updated weights for policy 0, policy_version 753442 (0.0008) [2023-12-28 00:40:09,287][106226] Updated weights for policy 0, policy_version 753452 (0.0009) [2023-12-28 00:40:09,357][106226] Updated weights for policy 0, policy_version 753462 (0.0008) [2023-12-28 00:40:09,512][106225] Updated weights for policy 1, policy_version 755433 (0.0010) [2023-12-28 00:40:09,573][106225] Updated weights for policy 1, policy_version 755443 (0.0009) [2023-12-28 00:40:09,644][106225] Updated weights for policy 1, policy_version 755453 (0.0008) [2023-12-28 00:40:09,712][106225] Updated weights for policy 1, policy_version 755463 (0.0007) [2023-12-28 00:40:10,091][106226] Updated weights for policy 0, policy_version 753472 (0.0006) [2023-12-28 00:40:10,151][106226] Updated weights for policy 0, policy_version 753482 (0.0006) [2023-12-28 00:40:10,217][106226] Updated weights for policy 0, policy_version 753492 (0.0006) [2023-12-28 00:40:10,446][106225] Updated weights for policy 1, policy_version 755473 (0.0010) [2023-12-28 00:40:10,509][106225] Updated weights for policy 1, policy_version 755483 (0.0008) [2023-12-28 00:40:10,567][106225] Updated weights for policy 1, policy_version 755493 (0.0009) [2023-12-28 00:40:10,786][106226] Updated weights for policy 0, policy_version 753502 (0.0008) [2023-12-28 00:40:10,843][106226] Updated weights for policy 0, policy_version 753512 (0.0009) [2023-12-28 00:40:10,906][106226] Updated weights for policy 0, policy_version 753522 (0.0009) [2023-12-28 00:40:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 386400256. Throughput: 0: 10080.1, 1: 9951.4. Samples: 386371044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:40:11,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-5.170')] [2023-12-28 00:40:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000753528_192954368.pth... [2023-12-28 00:40:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000755496_193445888.pth... [2023-12-28 00:40:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000754344_193150976.pth [2023-12-28 00:40:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000752376_192659456.pth [2023-12-28 00:40:11,267][106225] Updated weights for policy 1, policy_version 755503 (0.0009) [2023-12-28 00:40:11,333][106225] Updated weights for policy 1, policy_version 755513 (0.0010) [2023-12-28 00:40:11,408][106225] Updated weights for policy 1, policy_version 755523 (0.0009) [2023-12-28 00:40:11,663][106226] Updated weights for policy 0, policy_version 753532 (0.0008) [2023-12-28 00:40:11,727][106226] Updated weights for policy 0, policy_version 753542 (0.0008) [2023-12-28 00:40:11,800][106226] Updated weights for policy 0, policy_version 753552 (0.0011) [2023-12-28 00:40:12,206][106225] Updated weights for policy 1, policy_version 755533 (0.0009) [2023-12-28 00:40:12,271][106225] Updated weights for policy 1, policy_version 755543 (0.0008) [2023-12-28 00:40:12,334][106225] Updated weights for policy 1, policy_version 755553 (0.0007) [2023-12-28 00:40:12,581][106226] Updated weights for policy 0, policy_version 753562 (0.0011) [2023-12-28 00:40:12,657][106226] Updated weights for policy 0, policy_version 753572 (0.0010) [2023-12-28 00:40:12,717][106226] Updated weights for policy 0, policy_version 753582 (0.0009) [2023-12-28 00:40:12,780][106226] Updated weights for policy 0, policy_version 753592 (0.0008) [2023-12-28 00:40:13,085][106225] Updated weights for policy 1, policy_version 755563 (0.0011) [2023-12-28 00:40:13,153][106225] Updated weights for policy 1, policy_version 755573 (0.0010) [2023-12-28 00:40:13,222][106225] Updated weights for policy 1, policy_version 755583 (0.0011) [2023-12-28 00:40:13,393][106226] Updated weights for policy 0, policy_version 753602 (0.0008) [2023-12-28 00:40:13,452][106226] Updated weights for policy 0, policy_version 753612 (0.0007) [2023-12-28 00:40:13,519][106226] Updated weights for policy 0, policy_version 753622 (0.0008) [2023-12-28 00:40:14,016][106225] Updated weights for policy 1, policy_version 755593 (0.0010) [2023-12-28 00:40:14,080][106225] Updated weights for policy 1, policy_version 755603 (0.0008) [2023-12-28 00:40:14,141][106225] Updated weights for policy 1, policy_version 755613 (0.0007) [2023-12-28 00:40:14,151][106226] Updated weights for policy 0, policy_version 753632 (0.0008) [2023-12-28 00:40:14,208][106225] Updated weights for policy 1, policy_version 755623 (0.0006) [2023-12-28 00:40:14,213][106226] Updated weights for policy 0, policy_version 753642 (0.0007) [2023-12-28 00:40:14,269][106226] Updated weights for policy 0, policy_version 753652 (0.0009) [2023-12-28 00:40:14,876][106225] Updated weights for policy 1, policy_version 755633 (0.0008) [2023-12-28 00:40:14,943][106225] Updated weights for policy 1, policy_version 755643 (0.0008) [2023-12-28 00:40:14,988][106226] Updated weights for policy 0, policy_version 753662 (0.0008) [2023-12-28 00:40:15,002][106225] Updated weights for policy 1, policy_version 755653 (0.0006) [2023-12-28 00:40:15,042][106226] Updated weights for policy 0, policy_version 753672 (0.0007) [2023-12-28 00:40:15,104][106226] Updated weights for policy 0, policy_version 753682 (0.0010) [2023-12-28 00:40:15,737][106226] Updated weights for policy 0, policy_version 753692 (0.0007) [2023-12-28 00:40:15,745][106225] Updated weights for policy 1, policy_version 755663 (0.0005) [2023-12-28 00:40:15,788][106226] Updated weights for policy 0, policy_version 753702 (0.0005) [2023-12-28 00:40:15,798][106225] Updated weights for policy 1, policy_version 755673 (0.0005) [2023-12-28 00:40:15,834][106226] Updated weights for policy 0, policy_version 753712 (0.0005) [2023-12-28 00:40:15,856][106225] Updated weights for policy 1, policy_version 755683 (0.0005) [2023-12-28 00:40:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 386498560. Throughput: 0: 9979.4, 1: 9807.3. Samples: 386486684. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:16,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-5.361')] [2023-12-28 00:40:16,403][106225] Updated weights for policy 1, policy_version 755693 (0.0007) [2023-12-28 00:40:16,465][106225] Updated weights for policy 1, policy_version 755703 (0.0008) [2023-12-28 00:40:16,525][106225] Updated weights for policy 1, policy_version 755713 (0.0008) [2023-12-28 00:40:16,551][106226] Updated weights for policy 0, policy_version 753722 (0.0007) [2023-12-28 00:40:16,598][106226] Updated weights for policy 0, policy_version 753732 (0.0007) [2023-12-28 00:40:16,650][106226] Updated weights for policy 0, policy_version 753742 (0.0008) [2023-12-28 00:40:16,713][106226] Updated weights for policy 0, policy_version 753752 (0.0008) [2023-12-28 00:40:17,229][106225] Updated weights for policy 1, policy_version 755723 (0.0008) [2023-12-28 00:40:17,281][106225] Updated weights for policy 1, policy_version 755733 (0.0008) [2023-12-28 00:40:17,329][106225] Updated weights for policy 1, policy_version 755743 (0.0008) [2023-12-28 00:40:17,458][106226] Updated weights for policy 0, policy_version 753762 (0.0009) [2023-12-28 00:40:17,517][106226] Updated weights for policy 0, policy_version 753772 (0.0008) [2023-12-28 00:40:17,581][106226] Updated weights for policy 0, policy_version 753782 (0.0009) [2023-12-28 00:40:17,930][106225] Updated weights for policy 1, policy_version 755753 (0.0008) [2023-12-28 00:40:17,985][106225] Updated weights for policy 1, policy_version 755763 (0.0005) [2023-12-28 00:40:18,049][106225] Updated weights for policy 1, policy_version 755773 (0.0006) [2023-12-28 00:40:18,098][106225] Updated weights for policy 1, policy_version 755783 (0.0005) [2023-12-28 00:40:18,245][106226] Updated weights for policy 0, policy_version 753792 (0.0008) [2023-12-28 00:40:18,303][106226] Updated weights for policy 0, policy_version 753802 (0.0006) [2023-12-28 00:40:18,372][106226] Updated weights for policy 0, policy_version 753812 (0.0008) [2023-12-28 00:40:18,778][106225] Updated weights for policy 1, policy_version 755793 (0.0009) [2023-12-28 00:40:18,841][106225] Updated weights for policy 1, policy_version 755803 (0.0008) [2023-12-28 00:40:18,905][106225] Updated weights for policy 1, policy_version 755813 (0.0009) [2023-12-28 00:40:19,075][106226] Updated weights for policy 0, policy_version 753822 (0.0008) [2023-12-28 00:40:19,130][106226] Updated weights for policy 0, policy_version 753832 (0.0008) [2023-12-28 00:40:19,184][106226] Updated weights for policy 0, policy_version 753842 (0.0008) [2023-12-28 00:40:19,700][106225] Updated weights for policy 1, policy_version 755823 (0.0008) [2023-12-28 00:40:19,769][106225] Updated weights for policy 1, policy_version 755833 (0.0006) [2023-12-28 00:40:19,835][106225] Updated weights for policy 1, policy_version 755843 (0.0011) [2023-12-28 00:40:19,970][106226] Updated weights for policy 0, policy_version 753852 (0.0007) [2023-12-28 00:40:20,031][106226] Updated weights for policy 0, policy_version 753862 (0.0007) [2023-12-28 00:40:20,084][106226] Updated weights for policy 0, policy_version 753872 (0.0008) [2023-12-28 00:40:20,636][106225] Updated weights for policy 1, policy_version 755853 (0.0010) [2023-12-28 00:40:20,666][106226] Updated weights for policy 0, policy_version 753882 (0.0006) [2023-12-28 00:40:20,693][106225] Updated weights for policy 1, policy_version 755863 (0.0008) [2023-12-28 00:40:20,727][106226] Updated weights for policy 0, policy_version 753892 (0.0010) [2023-12-28 00:40:20,749][106225] Updated weights for policy 1, policy_version 755873 (0.0006) [2023-12-28 00:40:20,793][106226] Updated weights for policy 0, policy_version 753902 (0.0011) [2023-12-28 00:40:20,853][106226] Updated weights for policy 0, policy_version 753912 (0.0010) [2023-12-28 00:40:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 386596864. Throughput: 0: 9949.8, 1: 9830.1. Samples: 386606612. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:21,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.959')] [2023-12-28 00:40:21,546][106226] Updated weights for policy 0, policy_version 753922 (0.0008) [2023-12-28 00:40:21,552][106225] Updated weights for policy 1, policy_version 755883 (0.0007) [2023-12-28 00:40:21,611][106226] Updated weights for policy 0, policy_version 753932 (0.0009) [2023-12-28 00:40:21,617][106225] Updated weights for policy 1, policy_version 755893 (0.0008) [2023-12-28 00:40:21,683][106225] Updated weights for policy 1, policy_version 755903 (0.0008) [2023-12-28 00:40:21,685][106226] Updated weights for policy 0, policy_version 753942 (0.0007) [2023-12-28 00:40:22,405][106226] Updated weights for policy 0, policy_version 753952 (0.0007) [2023-12-28 00:40:22,462][106226] Updated weights for policy 0, policy_version 753962 (0.0009) [2023-12-28 00:40:22,479][106225] Updated weights for policy 1, policy_version 755913 (0.0010) [2023-12-28 00:40:22,523][106226] Updated weights for policy 0, policy_version 753972 (0.0005) [2023-12-28 00:40:22,552][106225] Updated weights for policy 1, policy_version 755923 (0.0008) [2023-12-28 00:40:22,615][106225] Updated weights for policy 1, policy_version 755933 (0.0010) [2023-12-28 00:40:22,691][106225] Updated weights for policy 1, policy_version 755943 (0.0008) [2023-12-28 00:40:23,168][106226] Updated weights for policy 0, policy_version 753982 (0.0006) [2023-12-28 00:40:23,225][106226] Updated weights for policy 0, policy_version 753992 (0.0009) [2023-12-28 00:40:23,285][106226] Updated weights for policy 0, policy_version 754002 (0.0009) [2023-12-28 00:40:23,411][106225] Updated weights for policy 1, policy_version 755953 (0.0009) [2023-12-28 00:40:23,476][106225] Updated weights for policy 1, policy_version 755963 (0.0008) [2023-12-28 00:40:23,537][106225] Updated weights for policy 1, policy_version 755973 (0.0009) [2023-12-28 00:40:23,921][106226] Updated weights for policy 0, policy_version 754012 (0.0008) [2023-12-28 00:40:23,982][106226] Updated weights for policy 0, policy_version 754022 (0.0009) [2023-12-28 00:40:24,040][106226] Updated weights for policy 0, policy_version 754032 (0.0008) [2023-12-28 00:40:24,310][106225] Updated weights for policy 1, policy_version 755983 (0.0010) [2023-12-28 00:40:24,377][106225] Updated weights for policy 1, policy_version 755993 (0.0011) [2023-12-28 00:40:24,441][106225] Updated weights for policy 1, policy_version 756003 (0.0011) [2023-12-28 00:40:24,637][106226] Updated weights for policy 0, policy_version 754042 (0.0006) [2023-12-28 00:40:24,687][106226] Updated weights for policy 0, policy_version 754052 (0.0005) [2023-12-28 00:40:24,737][106226] Updated weights for policy 0, policy_version 754062 (0.0006) [2023-12-28 00:40:24,794][106226] Updated weights for policy 0, policy_version 754072 (0.0005) [2023-12-28 00:40:25,011][106225] Updated weights for policy 1, policy_version 756013 (0.0007) [2023-12-28 00:40:25,074][106225] Updated weights for policy 1, policy_version 756023 (0.0005) [2023-12-28 00:40:25,139][106225] Updated weights for policy 1, policy_version 756033 (0.0007) [2023-12-28 00:40:25,383][106226] Updated weights for policy 0, policy_version 754082 (0.0005) [2023-12-28 00:40:25,450][106226] Updated weights for policy 0, policy_version 754092 (0.0005) [2023-12-28 00:40:25,519][106226] Updated weights for policy 0, policy_version 754102 (0.0005) [2023-12-28 00:40:25,753][106225] Updated weights for policy 1, policy_version 756043 (0.0010) [2023-12-28 00:40:25,826][106225] Updated weights for policy 1, policy_version 756053 (0.0010) [2023-12-28 00:40:25,896][106225] Updated weights for policy 1, policy_version 756063 (0.0010) [2023-12-28 00:40:26,081][106226] Updated weights for policy 0, policy_version 754112 (0.0010) [2023-12-28 00:40:26,142][106226] Updated weights for policy 0, policy_version 754122 (0.0008) [2023-12-28 00:40:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19934.0, 300 sec: 19716.3). Total num frames: 386695168. Throughput: 0: 9909.2, 1: 9776.7. Samples: 386663104. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:26,175][105115] Avg episode reward: [(0, '-4.308'), (1, '-5.123')] [2023-12-28 00:40:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000756072_193593344.pth... [2023-12-28 00:40:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000754920_193298432.pth [2023-12-28 00:40:26,214][106226] Updated weights for policy 0, policy_version 754132 (0.0010) [2023-12-28 00:40:26,238][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000754136_193110016.pth... [2023-12-28 00:40:26,242][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000752952_192806912.pth [2023-12-28 00:40:26,564][106225] Updated weights for policy 1, policy_version 756073 (0.0010) [2023-12-28 00:40:26,615][106225] Updated weights for policy 1, policy_version 756083 (0.0010) [2023-12-28 00:40:26,662][106225] Updated weights for policy 1, policy_version 756093 (0.0010) [2023-12-28 00:40:26,709][106225] Updated weights for policy 1, policy_version 756103 (0.0010) [2023-12-28 00:40:26,789][106226] Updated weights for policy 0, policy_version 754142 (0.0009) [2023-12-28 00:40:26,849][106226] Updated weights for policy 0, policy_version 754152 (0.0007) [2023-12-28 00:40:26,913][106226] Updated weights for policy 0, policy_version 754162 (0.0005) [2023-12-28 00:40:27,425][106225] Updated weights for policy 1, policy_version 756113 (0.0006) [2023-12-28 00:40:27,481][106225] Updated weights for policy 1, policy_version 756123 (0.0005) [2023-12-28 00:40:27,486][106226] Updated weights for policy 0, policy_version 754172 (0.0006) [2023-12-28 00:40:27,536][106225] Updated weights for policy 1, policy_version 756133 (0.0005) [2023-12-28 00:40:27,541][106226] Updated weights for policy 0, policy_version 754182 (0.0006) [2023-12-28 00:40:27,590][106226] Updated weights for policy 0, policy_version 754192 (0.0007) [2023-12-28 00:40:28,184][106225] Updated weights for policy 1, policy_version 756143 (0.0009) [2023-12-28 00:40:28,228][106226] Updated weights for policy 0, policy_version 754202 (0.0007) [2023-12-28 00:40:28,234][106225] Updated weights for policy 1, policy_version 756153 (0.0010) [2023-12-28 00:40:28,275][106226] Updated weights for policy 0, policy_version 754212 (0.0005) [2023-12-28 00:40:28,280][106225] Updated weights for policy 1, policy_version 756163 (0.0010) [2023-12-28 00:40:28,328][106226] Updated weights for policy 0, policy_version 754222 (0.0008) [2023-12-28 00:40:28,391][106226] Updated weights for policy 0, policy_version 754232 (0.0008) [2023-12-28 00:40:29,019][106225] Updated weights for policy 1, policy_version 756173 (0.0010) [2023-12-28 00:40:29,078][106225] Updated weights for policy 1, policy_version 756183 (0.0010) [2023-12-28 00:40:29,135][106225] Updated weights for policy 1, policy_version 756193 (0.0010) [2023-12-28 00:40:29,145][106226] Updated weights for policy 0, policy_version 754242 (0.0008) [2023-12-28 00:40:29,209][106226] Updated weights for policy 0, policy_version 754252 (0.0007) [2023-12-28 00:40:29,287][106226] Updated weights for policy 0, policy_version 754262 (0.0007) [2023-12-28 00:40:29,841][106225] Updated weights for policy 1, policy_version 756203 (0.0010) [2023-12-28 00:40:29,904][106225] Updated weights for policy 1, policy_version 756213 (0.0009) [2023-12-28 00:40:29,971][106225] Updated weights for policy 1, policy_version 756223 (0.0008) [2023-12-28 00:40:30,026][106226] Updated weights for policy 0, policy_version 754272 (0.0006) [2023-12-28 00:40:30,084][106226] Updated weights for policy 0, policy_version 754282 (0.0009) [2023-12-28 00:40:30,137][106226] Updated weights for policy 0, policy_version 754292 (0.0008) [2023-12-28 00:40:30,685][106225] Updated weights for policy 1, policy_version 756233 (0.0009) [2023-12-28 00:40:30,751][106225] Updated weights for policy 1, policy_version 756243 (0.0008) [2023-12-28 00:40:30,799][106225] Updated weights for policy 1, policy_version 756253 (0.0008) [2023-12-28 00:40:30,844][106225] Updated weights for policy 1, policy_version 756263 (0.0005) [2023-12-28 00:40:30,893][106226] Updated weights for policy 0, policy_version 754302 (0.0006) [2023-12-28 00:40:30,941][106226] Updated weights for policy 0, policy_version 754312 (0.0009) [2023-12-28 00:40:30,996][106226] Updated weights for policy 0, policy_version 754322 (0.0006) [2023-12-28 00:40:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 386801664. Throughput: 0: 10085.2, 1: 9777.9. Samples: 386789264. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:31,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.460')] [2023-12-28 00:40:31,497][106225] Updated weights for policy 1, policy_version 756273 (0.0006) [2023-12-28 00:40:31,567][106225] Updated weights for policy 1, policy_version 756283 (0.0007) [2023-12-28 00:40:31,632][106225] Updated weights for policy 1, policy_version 756293 (0.0007) [2023-12-28 00:40:31,783][106226] Updated weights for policy 0, policy_version 754332 (0.0008) [2023-12-28 00:40:31,843][106226] Updated weights for policy 0, policy_version 754342 (0.0005) [2023-12-28 00:40:31,894][106226] Updated weights for policy 0, policy_version 754352 (0.0008) [2023-12-28 00:40:32,333][106225] Updated weights for policy 1, policy_version 756303 (0.0006) [2023-12-28 00:40:32,397][106225] Updated weights for policy 1, policy_version 756313 (0.0008) [2023-12-28 00:40:32,446][106225] Updated weights for policy 1, policy_version 756323 (0.0008) [2023-12-28 00:40:32,579][106226] Updated weights for policy 0, policy_version 754362 (0.0008) [2023-12-28 00:40:32,638][106226] Updated weights for policy 0, policy_version 754372 (0.0009) [2023-12-28 00:40:32,687][106226] Updated weights for policy 0, policy_version 754382 (0.0009) [2023-12-28 00:40:32,746][106226] Updated weights for policy 0, policy_version 754392 (0.0006) [2023-12-28 00:40:33,143][106225] Updated weights for policy 1, policy_version 756333 (0.0007) [2023-12-28 00:40:33,200][106225] Updated weights for policy 1, policy_version 756343 (0.0008) [2023-12-28 00:40:33,251][106225] Updated weights for policy 1, policy_version 756353 (0.0007) [2023-12-28 00:40:33,422][106226] Updated weights for policy 0, policy_version 754402 (0.0005) [2023-12-28 00:40:33,479][106226] Updated weights for policy 0, policy_version 754412 (0.0006) [2023-12-28 00:40:33,526][106226] Updated weights for policy 0, policy_version 754422 (0.0010) [2023-12-28 00:40:33,862][106225] Updated weights for policy 1, policy_version 756363 (0.0007) [2023-12-28 00:40:33,914][106225] Updated weights for policy 1, policy_version 756373 (0.0005) [2023-12-28 00:40:33,963][106225] Updated weights for policy 1, policy_version 756383 (0.0005) [2023-12-28 00:40:34,205][106226] Updated weights for policy 0, policy_version 754432 (0.0011) [2023-12-28 00:40:34,266][106226] Updated weights for policy 0, policy_version 754442 (0.0010) [2023-12-28 00:40:34,327][106226] Updated weights for policy 0, policy_version 754452 (0.0011) [2023-12-28 00:40:34,629][106225] Updated weights for policy 1, policy_version 756393 (0.0009) [2023-12-28 00:40:34,690][106225] Updated weights for policy 1, policy_version 756403 (0.0007) [2023-12-28 00:40:34,749][106225] Updated weights for policy 1, policy_version 756413 (0.0008) [2023-12-28 00:40:34,810][106225] Updated weights for policy 1, policy_version 756423 (0.0008) [2023-12-28 00:40:35,048][106226] Updated weights for policy 0, policy_version 754462 (0.0011) [2023-12-28 00:40:35,115][106226] Updated weights for policy 0, policy_version 754472 (0.0010) [2023-12-28 00:40:35,174][106226] Updated weights for policy 0, policy_version 754482 (0.0010) [2023-12-28 00:40:35,474][106225] Updated weights for policy 1, policy_version 756433 (0.0005) [2023-12-28 00:40:35,521][106225] Updated weights for policy 1, policy_version 756443 (0.0005) [2023-12-28 00:40:35,573][106225] Updated weights for policy 1, policy_version 756453 (0.0007) [2023-12-28 00:40:35,885][106226] Updated weights for policy 0, policy_version 754492 (0.0009) [2023-12-28 00:40:35,937][106226] Updated weights for policy 0, policy_version 754502 (0.0009) [2023-12-28 00:40:35,984][106226] Updated weights for policy 0, policy_version 754512 (0.0008) [2023-12-28 00:40:36,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 386899968. Throughput: 0: 10000.8, 1: 9859.6. Samples: 386908568. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:36,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.446')] [2023-12-28 00:40:36,217][106225] Updated weights for policy 1, policy_version 756463 (0.0007) [2023-12-28 00:40:36,277][106225] Updated weights for policy 1, policy_version 756473 (0.0005) [2023-12-28 00:40:36,338][106225] Updated weights for policy 1, policy_version 756483 (0.0006) [2023-12-28 00:40:36,813][106226] Updated weights for policy 0, policy_version 754522 (0.0009) [2023-12-28 00:40:36,863][106226] Updated weights for policy 0, policy_version 754533 (0.0008) [2023-12-28 00:40:36,924][106226] Updated weights for policy 0, policy_version 754543 (0.0008) [2023-12-28 00:40:37,001][106225] Updated weights for policy 1, policy_version 756493 (0.0008) [2023-12-28 00:40:37,058][106225] Updated weights for policy 1, policy_version 756503 (0.0009) [2023-12-28 00:40:37,115][106225] Updated weights for policy 1, policy_version 756513 (0.0008) [2023-12-28 00:40:37,684][106226] Updated weights for policy 0, policy_version 754553 (0.0008) [2023-12-28 00:40:37,739][106226] Updated weights for policy 0, policy_version 754563 (0.0008) [2023-12-28 00:40:37,799][106226] Updated weights for policy 0, policy_version 754573 (0.0005) [2023-12-28 00:40:37,828][106225] Updated weights for policy 1, policy_version 756523 (0.0008) [2023-12-28 00:40:37,859][106226] Updated weights for policy 0, policy_version 754583 (0.0005) [2023-12-28 00:40:37,891][106225] Updated weights for policy 1, policy_version 756533 (0.0008) [2023-12-28 00:40:37,961][106225] Updated weights for policy 1, policy_version 756543 (0.0009) [2023-12-28 00:40:38,494][106226] Updated weights for policy 0, policy_version 754593 (0.0008) [2023-12-28 00:40:38,552][106226] Updated weights for policy 0, policy_version 754603 (0.0008) [2023-12-28 00:40:38,601][106226] Updated weights for policy 0, policy_version 754613 (0.0007) [2023-12-28 00:40:38,708][106225] Updated weights for policy 1, policy_version 756553 (0.0009) [2023-12-28 00:40:38,755][106225] Updated weights for policy 1, policy_version 756563 (0.0010) [2023-12-28 00:40:38,816][106225] Updated weights for policy 1, policy_version 756573 (0.0010) [2023-12-28 00:40:38,881][106225] Updated weights for policy 1, policy_version 756583 (0.0010) [2023-12-28 00:40:39,352][106226] Updated weights for policy 0, policy_version 754623 (0.0008) [2023-12-28 00:40:39,424][106226] Updated weights for policy 0, policy_version 754633 (0.0010) [2023-12-28 00:40:39,486][106226] Updated weights for policy 0, policy_version 754643 (0.0008) [2023-12-28 00:40:39,641][106225] Updated weights for policy 1, policy_version 756593 (0.0006) [2023-12-28 00:40:39,703][106225] Updated weights for policy 1, policy_version 756603 (0.0006) [2023-12-28 00:40:39,759][106225] Updated weights for policy 1, policy_version 756613 (0.0008) [2023-12-28 00:40:40,254][106226] Updated weights for policy 0, policy_version 754653 (0.0011) [2023-12-28 00:40:40,316][106226] Updated weights for policy 0, policy_version 754663 (0.0011) [2023-12-28 00:40:40,380][106226] Updated weights for policy 0, policy_version 754673 (0.0010) [2023-12-28 00:40:40,483][106225] Updated weights for policy 1, policy_version 756623 (0.0008) [2023-12-28 00:40:40,541][106225] Updated weights for policy 1, policy_version 756633 (0.0007) [2023-12-28 00:40:40,596][106225] Updated weights for policy 1, policy_version 756643 (0.0007) [2023-12-28 00:40:41,110][106226] Updated weights for policy 0, policy_version 754683 (0.0010) [2023-12-28 00:40:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 386990080. Throughput: 0: 9983.6, 1: 9889.1. Samples: 386967188. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:41,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.464')] [2023-12-28 00:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000756648_193740800.pth... [2023-12-28 00:40:41,183][106226] Updated weights for policy 0, policy_version 754693 (0.0008) [2023-12-28 00:40:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000755496_193445888.pth [2023-12-28 00:40:41,244][106226] Updated weights for policy 0, policy_version 754703 (0.0007) [2023-12-28 00:40:41,297][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000754712_193257472.pth... [2023-12-28 00:40:41,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000753528_192954368.pth [2023-12-28 00:40:41,365][106225] Updated weights for policy 1, policy_version 756653 (0.0007) [2023-12-28 00:40:41,438][106225] Updated weights for policy 1, policy_version 756663 (0.0009) [2023-12-28 00:40:41,498][106225] Updated weights for policy 1, policy_version 756673 (0.0008) [2023-12-28 00:40:41,986][106226] Updated weights for policy 0, policy_version 754713 (0.0008) [2023-12-28 00:40:42,050][106226] Updated weights for policy 0, policy_version 754723 (0.0009) [2023-12-28 00:40:42,119][106226] Updated weights for policy 0, policy_version 754733 (0.0010) [2023-12-28 00:40:42,180][106226] Updated weights for policy 0, policy_version 754743 (0.0008) [2023-12-28 00:40:42,239][106225] Updated weights for policy 1, policy_version 756683 (0.0008) [2023-12-28 00:40:42,311][106225] Updated weights for policy 1, policy_version 756693 (0.0008) [2023-12-28 00:40:42,371][106225] Updated weights for policy 1, policy_version 756703 (0.0009) [2023-12-28 00:40:42,985][106226] Updated weights for policy 0, policy_version 754753 (0.0008) [2023-12-28 00:40:43,048][106226] Updated weights for policy 0, policy_version 754763 (0.0008) [2023-12-28 00:40:43,049][106225] Updated weights for policy 1, policy_version 756713 (0.0008) [2023-12-28 00:40:43,100][106225] Updated weights for policy 1, policy_version 756723 (0.0010) [2023-12-28 00:40:43,109][106226] Updated weights for policy 0, policy_version 754773 (0.0006) [2023-12-28 00:40:43,153][106225] Updated weights for policy 1, policy_version 756733 (0.0010) [2023-12-28 00:40:43,211][106225] Updated weights for policy 1, policy_version 756743 (0.0010) [2023-12-28 00:40:43,833][106226] Updated weights for policy 0, policy_version 754783 (0.0007) [2023-12-28 00:40:43,893][106226] Updated weights for policy 0, policy_version 754793 (0.0009) [2023-12-28 00:40:43,916][106225] Updated weights for policy 1, policy_version 756753 (0.0010) [2023-12-28 00:40:43,952][106226] Updated weights for policy 0, policy_version 754803 (0.0008) [2023-12-28 00:40:43,973][106225] Updated weights for policy 1, policy_version 756763 (0.0010) [2023-12-28 00:40:44,033][106225] Updated weights for policy 1, policy_version 756773 (0.0010) [2023-12-28 00:40:44,623][106226] Updated weights for policy 0, policy_version 754813 (0.0005) [2023-12-28 00:40:44,682][106226] Updated weights for policy 0, policy_version 754823 (0.0007) [2023-12-28 00:40:44,720][106225] Updated weights for policy 1, policy_version 756783 (0.0007) [2023-12-28 00:40:44,737][106226] Updated weights for policy 0, policy_version 754833 (0.0007) [2023-12-28 00:40:44,789][106225] Updated weights for policy 1, policy_version 756793 (0.0007) [2023-12-28 00:40:44,855][106225] Updated weights for policy 1, policy_version 756803 (0.0009) [2023-12-28 00:40:45,467][106226] Updated weights for policy 0, policy_version 754843 (0.0009) [2023-12-28 00:40:45,519][106226] Updated weights for policy 0, policy_version 754853 (0.0008) [2023-12-28 00:40:45,576][106226] Updated weights for policy 0, policy_version 754863 (0.0010) [2023-12-28 00:40:45,586][106225] Updated weights for policy 1, policy_version 756813 (0.0007) [2023-12-28 00:40:45,641][106225] Updated weights for policy 1, policy_version 756823 (0.0008) [2023-12-28 00:40:45,691][106225] Updated weights for policy 1, policy_version 756833 (0.0010) [2023-12-28 00:40:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 387088384. Throughput: 0: 9983.4, 1: 9821.7. Samples: 387080904. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:46,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.027')] [2023-12-28 00:40:46,295][106226] Updated weights for policy 0, policy_version 754873 (0.0010) [2023-12-28 00:40:46,358][106226] Updated weights for policy 0, policy_version 754883 (0.0010) [2023-12-28 00:40:46,365][106225] Updated weights for policy 1, policy_version 756843 (0.0010) [2023-12-28 00:40:46,419][106225] Updated weights for policy 1, policy_version 756853 (0.0007) [2023-12-28 00:40:46,425][106226] Updated weights for policy 0, policy_version 754893 (0.0010) [2023-12-28 00:40:46,479][106225] Updated weights for policy 1, policy_version 756863 (0.0007) [2023-12-28 00:40:46,491][106226] Updated weights for policy 0, policy_version 754903 (0.0010) [2023-12-28 00:40:47,029][106225] Updated weights for policy 1, policy_version 756873 (0.0006) [2023-12-28 00:40:47,083][106225] Updated weights for policy 1, policy_version 756883 (0.0008) [2023-12-28 00:40:47,138][106226] Updated weights for policy 0, policy_version 754913 (0.0011) [2023-12-28 00:40:47,144][106225] Updated weights for policy 1, policy_version 756893 (0.0005) [2023-12-28 00:40:47,198][106226] Updated weights for policy 0, policy_version 754923 (0.0010) [2023-12-28 00:40:47,201][106225] Updated weights for policy 1, policy_version 756903 (0.0007) [2023-12-28 00:40:47,257][106226] Updated weights for policy 0, policy_version 754933 (0.0010) [2023-12-28 00:40:47,879][106225] Updated weights for policy 1, policy_version 756913 (0.0010) [2023-12-28 00:40:47,926][106225] Updated weights for policy 1, policy_version 756923 (0.0010) [2023-12-28 00:40:47,964][106226] Updated weights for policy 0, policy_version 754943 (0.0010) [2023-12-28 00:40:47,984][106225] Updated weights for policy 1, policy_version 756933 (0.0008) [2023-12-28 00:40:48,019][106226] Updated weights for policy 0, policy_version 754953 (0.0011) [2023-12-28 00:40:48,085][106226] Updated weights for policy 0, policy_version 754963 (0.0007) [2023-12-28 00:40:48,661][106225] Updated weights for policy 1, policy_version 756943 (0.0009) [2023-12-28 00:40:48,718][106225] Updated weights for policy 1, policy_version 756953 (0.0010) [2023-12-28 00:40:48,772][106226] Updated weights for policy 0, policy_version 754973 (0.0011) [2023-12-28 00:40:48,776][106225] Updated weights for policy 1, policy_version 756963 (0.0010) [2023-12-28 00:40:48,828][106226] Updated weights for policy 0, policy_version 754983 (0.0011) [2023-12-28 00:40:48,874][106226] Updated weights for policy 0, policy_version 754993 (0.0010) [2023-12-28 00:40:49,522][106225] Updated weights for policy 1, policy_version 756973 (0.0010) [2023-12-28 00:40:49,583][106225] Updated weights for policy 1, policy_version 756983 (0.0010) [2023-12-28 00:40:49,606][106226] Updated weights for policy 0, policy_version 755003 (0.0010) [2023-12-28 00:40:49,638][106225] Updated weights for policy 1, policy_version 756993 (0.0010) [2023-12-28 00:40:49,671][106226] Updated weights for policy 0, policy_version 755013 (0.0006) [2023-12-28 00:40:49,732][106226] Updated weights for policy 0, policy_version 755023 (0.0007) [2023-12-28 00:40:50,372][106225] Updated weights for policy 1, policy_version 757003 (0.0010) [2023-12-28 00:40:50,428][106225] Updated weights for policy 1, policy_version 757013 (0.0008) [2023-12-28 00:40:50,465][106226] Updated weights for policy 0, policy_version 755033 (0.0010) [2023-12-28 00:40:50,483][106225] Updated weights for policy 1, policy_version 757023 (0.0007) [2023-12-28 00:40:50,524][106226] Updated weights for policy 0, policy_version 755043 (0.0009) [2023-12-28 00:40:50,584][106226] Updated weights for policy 0, policy_version 755053 (0.0008) [2023-12-28 00:40:50,646][106226] Updated weights for policy 0, policy_version 755063 (0.0009) [2023-12-28 00:40:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 387186688. Throughput: 0: 9922.6, 1: 9823.7. Samples: 387199164. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:51,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.887')] [2023-12-28 00:40:51,208][106225] Updated weights for policy 1, policy_version 757033 (0.0008) [2023-12-28 00:40:51,268][106225] Updated weights for policy 1, policy_version 757043 (0.0009) [2023-12-28 00:40:51,323][106225] Updated weights for policy 1, policy_version 757053 (0.0010) [2023-12-28 00:40:51,391][106225] Updated weights for policy 1, policy_version 757063 (0.0009) [2023-12-28 00:40:51,497][106226] Updated weights for policy 0, policy_version 755073 (0.0006) [2023-12-28 00:40:51,560][106226] Updated weights for policy 0, policy_version 755083 (0.0007) [2023-12-28 00:40:51,627][106226] Updated weights for policy 0, policy_version 755093 (0.0008) [2023-12-28 00:40:52,092][106225] Updated weights for policy 1, policy_version 757073 (0.0010) [2023-12-28 00:40:52,146][106225] Updated weights for policy 1, policy_version 757083 (0.0009) [2023-12-28 00:40:52,198][106225] Updated weights for policy 1, policy_version 757093 (0.0006) [2023-12-28 00:40:52,345][106226] Updated weights for policy 0, policy_version 755103 (0.0007) [2023-12-28 00:40:52,409][106226] Updated weights for policy 0, policy_version 755113 (0.0006) [2023-12-28 00:40:52,470][106226] Updated weights for policy 0, policy_version 755123 (0.0007) [2023-12-28 00:40:52,905][106225] Updated weights for policy 1, policy_version 757103 (0.0009) [2023-12-28 00:40:52,962][106225] Updated weights for policy 1, policy_version 757113 (0.0010) [2023-12-28 00:40:53,019][106225] Updated weights for policy 1, policy_version 757123 (0.0010) [2023-12-28 00:40:53,190][106226] Updated weights for policy 0, policy_version 755133 (0.0008) [2023-12-28 00:40:53,251][106226] Updated weights for policy 0, policy_version 755143 (0.0010) [2023-12-28 00:40:53,310][106226] Updated weights for policy 0, policy_version 755153 (0.0010) [2023-12-28 00:40:53,646][106225] Updated weights for policy 1, policy_version 757133 (0.0010) [2023-12-28 00:40:53,704][106225] Updated weights for policy 1, policy_version 757143 (0.0010) [2023-12-28 00:40:53,761][106225] Updated weights for policy 1, policy_version 757153 (0.0008) [2023-12-28 00:40:53,985][106226] Updated weights for policy 0, policy_version 755163 (0.0010) [2023-12-28 00:40:54,039][106226] Updated weights for policy 0, policy_version 755173 (0.0009) [2023-12-28 00:40:54,093][106226] Updated weights for policy 0, policy_version 755183 (0.0008) [2023-12-28 00:40:54,336][106225] Updated weights for policy 1, policy_version 757163 (0.0006) [2023-12-28 00:40:54,400][106225] Updated weights for policy 1, policy_version 757173 (0.0005) [2023-12-28 00:40:54,468][106225] Updated weights for policy 1, policy_version 757183 (0.0005) [2023-12-28 00:40:54,913][106226] Updated weights for policy 0, policy_version 755193 (0.0009) [2023-12-28 00:40:54,966][106226] Updated weights for policy 0, policy_version 755203 (0.0008) [2023-12-28 00:40:54,987][106225] Updated weights for policy 1, policy_version 757193 (0.0006) [2023-12-28 00:40:55,037][106226] Updated weights for policy 0, policy_version 755213 (0.0007) [2023-12-28 00:40:55,047][106225] Updated weights for policy 1, policy_version 757203 (0.0008) [2023-12-28 00:40:55,091][106226] Updated weights for policy 0, policy_version 755223 (0.0006) [2023-12-28 00:40:55,104][106225] Updated weights for policy 1, policy_version 757213 (0.0007) [2023-12-28 00:40:55,162][106225] Updated weights for policy 1, policy_version 757223 (0.0008) [2023-12-28 00:40:55,704][106226] Updated weights for policy 0, policy_version 755233 (0.0008) [2023-12-28 00:40:55,756][106226] Updated weights for policy 0, policy_version 755243 (0.0007) [2023-12-28 00:40:55,816][106226] Updated weights for policy 0, policy_version 755253 (0.0005) [2023-12-28 00:40:55,854][106225] Updated weights for policy 1, policy_version 757233 (0.0006) [2023-12-28 00:40:55,918][106225] Updated weights for policy 1, policy_version 757243 (0.0007) [2023-12-28 00:40:55,980][106225] Updated weights for policy 1, policy_version 757253 (0.0006) [2023-12-28 00:40:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 387293184. Throughput: 0: 9874.0, 1: 9840.6. Samples: 387258204. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:40:56,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.931')] [2023-12-28 00:40:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000757256_193896448.pth... [2023-12-28 00:40:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000755256_193396736.pth... [2023-12-28 00:40:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000756072_193593344.pth [2023-12-28 00:40:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000754136_193110016.pth [2023-12-28 00:40:56,546][106225] Updated weights for policy 1, policy_version 757263 (0.0006) [2023-12-28 00:40:56,554][106226] Updated weights for policy 0, policy_version 755263 (0.0007) [2023-12-28 00:40:56,601][106225] Updated weights for policy 1, policy_version 757273 (0.0005) [2023-12-28 00:40:56,610][106226] Updated weights for policy 0, policy_version 755273 (0.0008) [2023-12-28 00:40:56,655][106225] Updated weights for policy 1, policy_version 757283 (0.0006) [2023-12-28 00:40:56,667][106226] Updated weights for policy 0, policy_version 755283 (0.0006) [2023-12-28 00:40:57,282][106225] Updated weights for policy 1, policy_version 757293 (0.0009) [2023-12-28 00:40:57,334][106225] Updated weights for policy 1, policy_version 757303 (0.0009) [2023-12-28 00:40:57,387][106225] Updated weights for policy 1, policy_version 757313 (0.0006) [2023-12-28 00:40:57,398][106226] Updated weights for policy 0, policy_version 755293 (0.0007) [2023-12-28 00:40:57,455][106226] Updated weights for policy 0, policy_version 755303 (0.0009) [2023-12-28 00:40:57,508][106226] Updated weights for policy 0, policy_version 755313 (0.0008) [2023-12-28 00:40:58,103][106225] Updated weights for policy 1, policy_version 757323 (0.0005) [2023-12-28 00:40:58,156][106225] Updated weights for policy 1, policy_version 757333 (0.0007) [2023-12-28 00:40:58,197][106226] Updated weights for policy 0, policy_version 755323 (0.0007) [2023-12-28 00:40:58,209][106225] Updated weights for policy 1, policy_version 757343 (0.0007) [2023-12-28 00:40:58,267][106226] Updated weights for policy 0, policy_version 755333 (0.0008) [2023-12-28 00:40:58,339][106226] Updated weights for policy 0, policy_version 755343 (0.0008) [2023-12-28 00:40:58,987][106225] Updated weights for policy 1, policy_version 757353 (0.0006) [2023-12-28 00:40:59,047][106225] Updated weights for policy 1, policy_version 757363 (0.0006) [2023-12-28 00:40:59,113][106225] Updated weights for policy 1, policy_version 757373 (0.0006) [2023-12-28 00:40:59,129][106226] Updated weights for policy 0, policy_version 755353 (0.0008) [2023-12-28 00:40:59,175][106225] Updated weights for policy 1, policy_version 757383 (0.0008) [2023-12-28 00:40:59,191][106226] Updated weights for policy 0, policy_version 755363 (0.0008) [2023-12-28 00:40:59,274][106226] Updated weights for policy 0, policy_version 755373 (0.0008) [2023-12-28 00:40:59,361][106226] Updated weights for policy 0, policy_version 755383 (0.0009) [2023-12-28 00:40:59,973][106225] Updated weights for policy 1, policy_version 757393 (0.0008) [2023-12-28 00:41:00,031][106226] Updated weights for policy 0, policy_version 755393 (0.0007) [2023-12-28 00:41:00,039][106225] Updated weights for policy 1, policy_version 757403 (0.0009) [2023-12-28 00:41:00,089][106226] Updated weights for policy 0, policy_version 755403 (0.0006) [2023-12-28 00:41:00,102][106225] Updated weights for policy 1, policy_version 757413 (0.0006) [2023-12-28 00:41:00,150][106226] Updated weights for policy 0, policy_version 755413 (0.0007) [2023-12-28 00:41:00,729][106225] Updated weights for policy 1, policy_version 757423 (0.0009) [2023-12-28 00:41:00,783][106225] Updated weights for policy 1, policy_version 757433 (0.0010) [2023-12-28 00:41:00,789][106226] Updated weights for policy 0, policy_version 755423 (0.0007) [2023-12-28 00:41:00,840][106225] Updated weights for policy 1, policy_version 757443 (0.0010) [2023-12-28 00:41:00,846][106226] Updated weights for policy 0, policy_version 755433 (0.0006) [2023-12-28 00:41:00,909][106226] Updated weights for policy 0, policy_version 755443 (0.0007) [2023-12-28 00:41:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 387391488. Throughput: 0: 9820.5, 1: 9986.1. Samples: 387377984. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:01,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.663')] [2023-12-28 00:41:01,176][106141] Saving new best policy, reward=-4.663! [2023-12-28 00:41:01,573][106225] Updated weights for policy 1, policy_version 757453 (0.0010) [2023-12-28 00:41:01,627][106225] Updated weights for policy 1, policy_version 757463 (0.0010) [2023-12-28 00:41:01,688][106225] Updated weights for policy 1, policy_version 757473 (0.0010) [2023-12-28 00:41:01,695][106226] Updated weights for policy 0, policy_version 755453 (0.0008) [2023-12-28 00:41:01,757][106226] Updated weights for policy 0, policy_version 755463 (0.0007) [2023-12-28 00:41:01,804][106226] Updated weights for policy 0, policy_version 755473 (0.0008) [2023-12-28 00:41:02,391][106225] Updated weights for policy 1, policy_version 757483 (0.0009) [2023-12-28 00:41:02,458][106225] Updated weights for policy 1, policy_version 757493 (0.0010) [2023-12-28 00:41:02,519][106225] Updated weights for policy 1, policy_version 757503 (0.0009) [2023-12-28 00:41:02,548][106226] Updated weights for policy 0, policy_version 755483 (0.0008) [2023-12-28 00:41:02,606][106226] Updated weights for policy 0, policy_version 755493 (0.0006) [2023-12-28 00:41:02,665][106226] Updated weights for policy 0, policy_version 755503 (0.0006) [2023-12-28 00:41:03,234][106225] Updated weights for policy 1, policy_version 757513 (0.0006) [2023-12-28 00:41:03,285][106225] Updated weights for policy 1, policy_version 757523 (0.0008) [2023-12-28 00:41:03,341][106226] Updated weights for policy 0, policy_version 755513 (0.0006) [2023-12-28 00:41:03,343][106225] Updated weights for policy 1, policy_version 757533 (0.0008) [2023-12-28 00:41:03,389][106226] Updated weights for policy 0, policy_version 755523 (0.0006) [2023-12-28 00:41:03,398][106225] Updated weights for policy 1, policy_version 757543 (0.0007) [2023-12-28 00:41:03,444][106226] Updated weights for policy 0, policy_version 755534 (0.0008) [2023-12-28 00:41:03,496][106226] Updated weights for policy 0, policy_version 755544 (0.0008) [2023-12-28 00:41:04,129][106225] Updated weights for policy 1, policy_version 757553 (0.0009) [2023-12-28 00:41:04,193][106225] Updated weights for policy 1, policy_version 757563 (0.0008) [2023-12-28 00:41:04,195][106226] Updated weights for policy 0, policy_version 755554 (0.0007) [2023-12-28 00:41:04,254][106226] Updated weights for policy 0, policy_version 755564 (0.0007) [2023-12-28 00:41:04,260][106225] Updated weights for policy 1, policy_version 757573 (0.0006) [2023-12-28 00:41:04,311][106226] Updated weights for policy 0, policy_version 755574 (0.0006) [2023-12-28 00:41:04,906][106225] Updated weights for policy 1, policy_version 757583 (0.0008) [2023-12-28 00:41:04,953][106225] Updated weights for policy 1, policy_version 757593 (0.0008) [2023-12-28 00:41:05,005][106225] Updated weights for policy 1, policy_version 757603 (0.0006) [2023-12-28 00:41:05,011][106226] Updated weights for policy 0, policy_version 755584 (0.0007) [2023-12-28 00:41:05,069][106226] Updated weights for policy 0, policy_version 755594 (0.0008) [2023-12-28 00:41:05,117][106226] Updated weights for policy 0, policy_version 755604 (0.0008) [2023-12-28 00:41:05,746][106225] Updated weights for policy 1, policy_version 757613 (0.0008) [2023-12-28 00:41:05,799][106225] Updated weights for policy 1, policy_version 757623 (0.0007) [2023-12-28 00:41:05,837][106226] Updated weights for policy 0, policy_version 755614 (0.0010) [2023-12-28 00:41:05,852][106225] Updated weights for policy 1, policy_version 757633 (0.0008) [2023-12-28 00:41:05,888][106226] Updated weights for policy 0, policy_version 755624 (0.0010) [2023-12-28 00:41:05,889][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000007 [2023-12-28 00:41:05,937][106226] Updated weights for policy 0, policy_version 755634 (0.0010) [2023-12-28 00:41:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 387489792. Throughput: 0: 9789.4, 1: 9980.7. Samples: 387496268. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:06,175][105115] Avg episode reward: [(0, '-4.774'), (1, '-4.847')] [2023-12-28 00:41:06,597][106226] Updated weights for policy 0, policy_version 755644 (0.0008) [2023-12-28 00:41:06,643][106225] Updated weights for policy 1, policy_version 757643 (0.0007) [2023-12-28 00:41:06,658][106226] Updated weights for policy 0, policy_version 755654 (0.0009) [2023-12-28 00:41:06,707][106225] Updated weights for policy 1, policy_version 757653 (0.0007) [2023-12-28 00:41:06,716][106226] Updated weights for policy 0, policy_version 755664 (0.0007) [2023-12-28 00:41:06,757][106225] Updated weights for policy 1, policy_version 757663 (0.0008) [2023-12-28 00:41:07,298][106226] Updated weights for policy 0, policy_version 755674 (0.0007) [2023-12-28 00:41:07,352][106226] Updated weights for policy 0, policy_version 755684 (0.0011) [2023-12-28 00:41:07,413][106226] Updated weights for policy 0, policy_version 755694 (0.0011) [2023-12-28 00:41:07,463][106226] Updated weights for policy 0, policy_version 755704 (0.0010) [2023-12-28 00:41:07,543][106225] Updated weights for policy 1, policy_version 757673 (0.0009) [2023-12-28 00:41:07,593][106225] Updated weights for policy 1, policy_version 757683 (0.0008) [2023-12-28 00:41:07,643][106225] Updated weights for policy 1, policy_version 757693 (0.0008) [2023-12-28 00:41:07,707][106225] Updated weights for policy 1, policy_version 757703 (0.0008) [2023-12-28 00:41:08,186][106226] Updated weights for policy 0, policy_version 755714 (0.0010) [2023-12-28 00:41:08,249][106226] Updated weights for policy 0, policy_version 755724 (0.0011) [2023-12-28 00:41:08,312][106226] Updated weights for policy 0, policy_version 755734 (0.0011) [2023-12-28 00:41:08,428][106225] Updated weights for policy 1, policy_version 757713 (0.0007) [2023-12-28 00:41:08,489][106225] Updated weights for policy 1, policy_version 757723 (0.0006) [2023-12-28 00:41:08,550][106225] Updated weights for policy 1, policy_version 757733 (0.0007) [2023-12-28 00:41:09,029][106226] Updated weights for policy 0, policy_version 755744 (0.0010) [2023-12-28 00:41:09,077][106226] Updated weights for policy 0, policy_version 755754 (0.0010) [2023-12-28 00:41:09,138][106226] Updated weights for policy 0, policy_version 755764 (0.0011) [2023-12-28 00:41:09,178][106225] Updated weights for policy 1, policy_version 757743 (0.0007) [2023-12-28 00:41:09,246][106225] Updated weights for policy 1, policy_version 757753 (0.0008) [2023-12-28 00:41:09,312][106225] Updated weights for policy 1, policy_version 757763 (0.0008) [2023-12-28 00:41:09,984][106225] Updated weights for policy 1, policy_version 757773 (0.0008) [2023-12-28 00:41:09,988][106226] Updated weights for policy 0, policy_version 755774 (0.0007) [2023-12-28 00:41:10,046][106225] Updated weights for policy 1, policy_version 757783 (0.0008) [2023-12-28 00:41:10,052][106226] Updated weights for policy 0, policy_version 755784 (0.0007) [2023-12-28 00:41:10,108][106226] Updated weights for policy 0, policy_version 755794 (0.0006) [2023-12-28 00:41:10,109][106225] Updated weights for policy 1, policy_version 757793 (0.0008) [2023-12-28 00:41:10,768][106225] Updated weights for policy 1, policy_version 757803 (0.0007) [2023-12-28 00:41:10,811][106226] Updated weights for policy 0, policy_version 755804 (0.0006) [2023-12-28 00:41:10,833][106225] Updated weights for policy 1, policy_version 757813 (0.0007) [2023-12-28 00:41:10,871][106226] Updated weights for policy 0, policy_version 755814 (0.0007) [2023-12-28 00:41:10,890][106225] Updated weights for policy 1, policy_version 757823 (0.0006) [2023-12-28 00:41:10,936][106226] Updated weights for policy 0, policy_version 755824 (0.0008) [2023-12-28 00:41:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 387588096. Throughput: 0: 9814.0, 1: 10007.3. Samples: 387555068. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:11,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.967')] [2023-12-28 00:41:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000755832_193544192.pth... [2023-12-28 00:41:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000757832_194043904.pth... [2023-12-28 00:41:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000754712_193257472.pth [2023-12-28 00:41:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000756648_193740800.pth [2023-12-28 00:41:11,592][106225] Updated weights for policy 1, policy_version 757833 (0.0006) [2023-12-28 00:41:11,662][106225] Updated weights for policy 1, policy_version 757843 (0.0007) [2023-12-28 00:41:11,704][106226] Updated weights for policy 0, policy_version 755834 (0.0006) [2023-12-28 00:41:11,724][106225] Updated weights for policy 1, policy_version 757853 (0.0008) [2023-12-28 00:41:11,775][106226] Updated weights for policy 0, policy_version 755844 (0.0007) [2023-12-28 00:41:11,799][106225] Updated weights for policy 1, policy_version 757863 (0.0007) [2023-12-28 00:41:11,837][106226] Updated weights for policy 0, policy_version 755854 (0.0008) [2023-12-28 00:41:11,899][106226] Updated weights for policy 0, policy_version 755864 (0.0008) [2023-12-28 00:41:12,554][106225] Updated weights for policy 1, policy_version 757873 (0.0008) [2023-12-28 00:41:12,616][106225] Updated weights for policy 1, policy_version 757883 (0.0008) [2023-12-28 00:41:12,686][106226] Updated weights for policy 0, policy_version 755874 (0.0008) [2023-12-28 00:41:12,693][106225] Updated weights for policy 1, policy_version 757893 (0.0006) [2023-12-28 00:41:12,740][106226] Updated weights for policy 0, policy_version 755884 (0.0010) [2023-12-28 00:41:12,791][106226] Updated weights for policy 0, policy_version 755894 (0.0011) [2023-12-28 00:41:13,394][106225] Updated weights for policy 1, policy_version 757903 (0.0005) [2023-12-28 00:41:13,444][106225] Updated weights for policy 1, policy_version 757913 (0.0005) [2023-12-28 00:41:13,494][106226] Updated weights for policy 0, policy_version 755904 (0.0006) [2023-12-28 00:41:13,501][106225] Updated weights for policy 1, policy_version 757923 (0.0005) [2023-12-28 00:41:13,542][106226] Updated weights for policy 0, policy_version 755914 (0.0005) [2023-12-28 00:41:13,593][106226] Updated weights for policy 0, policy_version 755924 (0.0005) [2023-12-28 00:41:14,063][106225] Updated weights for policy 1, policy_version 757933 (0.0005) [2023-12-28 00:41:14,133][106226] Updated weights for policy 0, policy_version 755934 (0.0005) [2023-12-28 00:41:14,137][106225] Updated weights for policy 1, policy_version 757943 (0.0005) [2023-12-28 00:41:14,193][106226] Updated weights for policy 0, policy_version 755944 (0.0006) [2023-12-28 00:41:14,203][106225] Updated weights for policy 1, policy_version 757953 (0.0005) [2023-12-28 00:41:14,245][106226] Updated weights for policy 0, policy_version 755954 (0.0005) [2023-12-28 00:41:14,788][106225] Updated weights for policy 1, policy_version 757963 (0.0006) [2023-12-28 00:41:14,849][106225] Updated weights for policy 1, policy_version 757973 (0.0008) [2023-12-28 00:41:14,884][106226] Updated weights for policy 0, policy_version 755964 (0.0008) [2023-12-28 00:41:14,914][106225] Updated weights for policy 1, policy_version 757983 (0.0009) [2023-12-28 00:41:14,950][106226] Updated weights for policy 0, policy_version 755974 (0.0011) [2023-12-28 00:41:15,011][106226] Updated weights for policy 0, policy_version 755984 (0.0010) [2023-12-28 00:41:15,605][106225] Updated weights for policy 1, policy_version 757993 (0.0009) [2023-12-28 00:41:15,647][106226] Updated weights for policy 0, policy_version 755994 (0.0008) [2023-12-28 00:41:15,676][106225] Updated weights for policy 1, policy_version 758003 (0.0009) [2023-12-28 00:41:15,695][106226] Updated weights for policy 0, policy_version 756004 (0.0005) [2023-12-28 00:41:15,727][106225] Updated weights for policy 1, policy_version 758013 (0.0006) [2023-12-28 00:41:15,748][106226] Updated weights for policy 0, policy_version 756014 (0.0005) [2023-12-28 00:41:15,779][106225] Updated weights for policy 1, policy_version 758023 (0.0005) [2023-12-28 00:41:15,807][106226] Updated weights for policy 0, policy_version 756024 (0.0005) [2023-12-28 00:41:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 387686400. Throughput: 0: 9677.7, 1: 10018.4. Samples: 387675596. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:16,176][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.932')] [2023-12-28 00:41:16,349][106226] Updated weights for policy 0, policy_version 756034 (0.0009) [2023-12-28 00:41:16,400][106225] Updated weights for policy 1, policy_version 758033 (0.0010) [2023-12-28 00:41:16,406][106226] Updated weights for policy 0, policy_version 756044 (0.0011) [2023-12-28 00:41:16,455][106225] Updated weights for policy 1, policy_version 758043 (0.0010) [2023-12-28 00:41:16,465][106226] Updated weights for policy 0, policy_version 756054 (0.0011) [2023-12-28 00:41:16,506][106225] Updated weights for policy 1, policy_version 758053 (0.0010) [2023-12-28 00:41:17,171][106226] Updated weights for policy 0, policy_version 756064 (0.0010) [2023-12-28 00:41:17,183][106225] Updated weights for policy 1, policy_version 758063 (0.0010) [2023-12-28 00:41:17,224][106226] Updated weights for policy 0, policy_version 756074 (0.0010) [2023-12-28 00:41:17,233][106225] Updated weights for policy 1, policy_version 758073 (0.0010) [2023-12-28 00:41:17,279][106225] Updated weights for policy 1, policy_version 758083 (0.0010) [2023-12-28 00:41:17,283][106226] Updated weights for policy 0, policy_version 756084 (0.0010) [2023-12-28 00:41:17,934][106225] Updated weights for policy 1, policy_version 758093 (0.0009) [2023-12-28 00:41:17,982][106226] Updated weights for policy 0, policy_version 756094 (0.0009) [2023-12-28 00:41:17,992][106225] Updated weights for policy 1, policy_version 758103 (0.0006) [2023-12-28 00:41:18,040][106226] Updated weights for policy 0, policy_version 756104 (0.0011) [2023-12-28 00:41:18,049][106225] Updated weights for policy 1, policy_version 758113 (0.0005) [2023-12-28 00:41:18,100][106226] Updated weights for policy 0, policy_version 756114 (0.0010) [2023-12-28 00:41:18,719][106225] Updated weights for policy 1, policy_version 758123 (0.0006) [2023-12-28 00:41:18,779][106225] Updated weights for policy 1, policy_version 758133 (0.0009) [2023-12-28 00:41:18,843][106226] Updated weights for policy 0, policy_version 756124 (0.0009) [2023-12-28 00:41:18,843][106225] Updated weights for policy 1, policy_version 758143 (0.0008) [2023-12-28 00:41:18,904][106226] Updated weights for policy 0, policy_version 756134 (0.0011) [2023-12-28 00:41:18,970][106226] Updated weights for policy 0, policy_version 756144 (0.0008) [2023-12-28 00:41:19,560][106225] Updated weights for policy 1, policy_version 758153 (0.0010) [2023-12-28 00:41:19,615][106225] Updated weights for policy 1, policy_version 758163 (0.0007) [2023-12-28 00:41:19,664][106225] Updated weights for policy 1, policy_version 758173 (0.0008) [2023-12-28 00:41:19,722][106225] Updated weights for policy 1, policy_version 758183 (0.0007) [2023-12-28 00:41:19,725][106226] Updated weights for policy 0, policy_version 756154 (0.0008) [2023-12-28 00:41:19,788][106226] Updated weights for policy 0, policy_version 756164 (0.0008) [2023-12-28 00:41:19,853][106226] Updated weights for policy 0, policy_version 756174 (0.0007) [2023-12-28 00:41:19,920][106226] Updated weights for policy 0, policy_version 756184 (0.0006) [2023-12-28 00:41:20,522][106225] Updated weights for policy 1, policy_version 758193 (0.0011) [2023-12-28 00:41:20,525][106226] Updated weights for policy 0, policy_version 756194 (0.0006) [2023-12-28 00:41:20,585][106226] Updated weights for policy 0, policy_version 756204 (0.0009) [2023-12-28 00:41:20,589][106225] Updated weights for policy 1, policy_version 758203 (0.0010) [2023-12-28 00:41:20,650][106226] Updated weights for policy 0, policy_version 756214 (0.0007) [2023-12-28 00:41:20,655][106225] Updated weights for policy 1, policy_version 758213 (0.0008) [2023-12-28 00:41:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 387784704. Throughput: 0: 9740.4, 1: 9987.3. Samples: 387796316. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:21,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-5.119')] [2023-12-28 00:41:21,349][106225] Updated weights for policy 1, policy_version 758223 (0.0008) [2023-12-28 00:41:21,392][106226] Updated weights for policy 0, policy_version 756224 (0.0008) [2023-12-28 00:41:21,420][106225] Updated weights for policy 1, policy_version 758233 (0.0007) [2023-12-28 00:41:21,455][106226] Updated weights for policy 0, policy_version 756234 (0.0008) [2023-12-28 00:41:21,485][106225] Updated weights for policy 1, policy_version 758243 (0.0009) [2023-12-28 00:41:21,514][106226] Updated weights for policy 0, policy_version 756244 (0.0008) [2023-12-28 00:41:22,221][106225] Updated weights for policy 1, policy_version 758253 (0.0006) [2023-12-28 00:41:22,289][106225] Updated weights for policy 1, policy_version 758263 (0.0009) [2023-12-28 00:41:22,318][106226] Updated weights for policy 0, policy_version 756254 (0.0008) [2023-12-28 00:41:22,345][106225] Updated weights for policy 1, policy_version 758273 (0.0007) [2023-12-28 00:41:22,386][106226] Updated weights for policy 0, policy_version 756264 (0.0007) [2023-12-28 00:41:22,449][106226] Updated weights for policy 0, policy_version 756274 (0.0007) [2023-12-28 00:41:22,992][106225] Updated weights for policy 1, policy_version 758283 (0.0008) [2023-12-28 00:41:23,050][106225] Updated weights for policy 1, policy_version 758293 (0.0006) [2023-12-28 00:41:23,102][106225] Updated weights for policy 1, policy_version 758303 (0.0005) [2023-12-28 00:41:23,255][106226] Updated weights for policy 0, policy_version 756284 (0.0007) [2023-12-28 00:41:23,314][106226] Updated weights for policy 0, policy_version 756294 (0.0009) [2023-12-28 00:41:23,374][106226] Updated weights for policy 0, policy_version 756304 (0.0008) [2023-12-28 00:41:23,716][106225] Updated weights for policy 1, policy_version 758313 (0.0005) [2023-12-28 00:41:23,777][106225] Updated weights for policy 1, policy_version 758323 (0.0009) [2023-12-28 00:41:23,839][106225] Updated weights for policy 1, policy_version 758333 (0.0008) [2023-12-28 00:41:23,901][106225] Updated weights for policy 1, policy_version 758343 (0.0007) [2023-12-28 00:41:24,086][106226] Updated weights for policy 0, policy_version 756314 (0.0009) [2023-12-28 00:41:24,144][106226] Updated weights for policy 0, policy_version 756324 (0.0008) [2023-12-28 00:41:24,202][106226] Updated weights for policy 0, policy_version 756334 (0.0008) [2023-12-28 00:41:24,258][106226] Updated weights for policy 0, policy_version 756344 (0.0008) [2023-12-28 00:41:24,568][106225] Updated weights for policy 1, policy_version 758353 (0.0010) [2023-12-28 00:41:24,624][106225] Updated weights for policy 1, policy_version 758363 (0.0009) [2023-12-28 00:41:24,682][106225] Updated weights for policy 1, policy_version 758373 (0.0008) [2023-12-28 00:41:24,945][106226] Updated weights for policy 0, policy_version 756354 (0.0008) [2023-12-28 00:41:25,006][106226] Updated weights for policy 0, policy_version 756364 (0.0009) [2023-12-28 00:41:25,069][106226] Updated weights for policy 0, policy_version 756374 (0.0008) [2023-12-28 00:41:25,373][106225] Updated weights for policy 1, policy_version 758383 (0.0009) [2023-12-28 00:41:25,430][106225] Updated weights for policy 1, policy_version 758393 (0.0010) [2023-12-28 00:41:25,485][106225] Updated weights for policy 1, policy_version 758403 (0.0010) [2023-12-28 00:41:25,771][106226] Updated weights for policy 0, policy_version 756384 (0.0008) [2023-12-28 00:41:25,831][106226] Updated weights for policy 0, policy_version 756394 (0.0008) [2023-12-28 00:41:25,880][106226] Updated weights for policy 0, policy_version 756404 (0.0008) [2023-12-28 00:41:26,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 387883008. Throughput: 0: 9706.3, 1: 10016.3. Samples: 387854704. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:26,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.067')] [2023-12-28 00:41:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000756408_193691648.pth... [2023-12-28 00:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000755256_193396736.pth [2023-12-28 00:41:26,198][106225] Updated weights for policy 1, policy_version 758413 (0.0010) [2023-12-28 00:41:26,254][106225] Updated weights for policy 1, policy_version 758423 (0.0010) [2023-12-28 00:41:26,314][106225] Updated weights for policy 1, policy_version 758433 (0.0010) [2023-12-28 00:41:26,353][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000758440_194199552.pth... [2023-12-28 00:41:26,357][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000757256_193896448.pth [2023-12-28 00:41:26,604][106226] Updated weights for policy 0, policy_version 756414 (0.0006) [2023-12-28 00:41:26,657][106226] Updated weights for policy 0, policy_version 756424 (0.0005) [2023-12-28 00:41:26,702][106226] Updated weights for policy 0, policy_version 756434 (0.0005) [2023-12-28 00:41:26,991][106225] Updated weights for policy 1, policy_version 758443 (0.0010) [2023-12-28 00:41:27,041][106225] Updated weights for policy 1, policy_version 758453 (0.0010) [2023-12-28 00:41:27,098][106225] Updated weights for policy 1, policy_version 758463 (0.0010) [2023-12-28 00:41:27,334][106226] Updated weights for policy 0, policy_version 756444 (0.0006) [2023-12-28 00:41:27,383][106226] Updated weights for policy 0, policy_version 756454 (0.0008) [2023-12-28 00:41:27,437][106226] Updated weights for policy 0, policy_version 756464 (0.0008) [2023-12-28 00:41:27,819][106225] Updated weights for policy 1, policy_version 758473 (0.0010) [2023-12-28 00:41:27,878][106225] Updated weights for policy 1, policy_version 758483 (0.0010) [2023-12-28 00:41:27,936][106225] Updated weights for policy 1, policy_version 758493 (0.0010) [2023-12-28 00:41:27,995][106225] Updated weights for policy 1, policy_version 758503 (0.0010) [2023-12-28 00:41:28,109][106226] Updated weights for policy 0, policy_version 756474 (0.0008) [2023-12-28 00:41:28,159][106226] Updated weights for policy 0, policy_version 756484 (0.0008) [2023-12-28 00:41:28,216][106226] Updated weights for policy 0, policy_version 756494 (0.0008) [2023-12-28 00:41:28,272][106226] Updated weights for policy 0, policy_version 756504 (0.0008) [2023-12-28 00:41:28,689][106225] Updated weights for policy 1, policy_version 758513 (0.0006) [2023-12-28 00:41:28,760][106225] Updated weights for policy 1, policy_version 758523 (0.0005) [2023-12-28 00:41:28,809][106225] Updated weights for policy 1, policy_version 758533 (0.0009) [2023-12-28 00:41:28,926][106226] Updated weights for policy 0, policy_version 756514 (0.0008) [2023-12-28 00:41:28,990][106226] Updated weights for policy 0, policy_version 756524 (0.0010) [2023-12-28 00:41:29,054][106226] Updated weights for policy 0, policy_version 756534 (0.0008) [2023-12-28 00:41:29,457][106225] Updated weights for policy 1, policy_version 758543 (0.0008) [2023-12-28 00:41:29,521][106225] Updated weights for policy 1, policy_version 758553 (0.0009) [2023-12-28 00:41:29,586][106225] Updated weights for policy 1, policy_version 758563 (0.0009) [2023-12-28 00:41:29,828][106226] Updated weights for policy 0, policy_version 756544 (0.0007) [2023-12-28 00:41:29,913][106226] Updated weights for policy 0, policy_version 756554 (0.0006) [2023-12-28 00:41:29,984][106226] Updated weights for policy 0, policy_version 756564 (0.0008) [2023-12-28 00:41:30,363][106225] Updated weights for policy 1, policy_version 758573 (0.0009) [2023-12-28 00:41:30,419][106225] Updated weights for policy 1, policy_version 758583 (0.0008) [2023-12-28 00:41:30,470][106225] Updated weights for policy 1, policy_version 758593 (0.0008) [2023-12-28 00:41:30,642][106226] Updated weights for policy 0, policy_version 756574 (0.0009) [2023-12-28 00:41:30,706][106226] Updated weights for policy 0, policy_version 756584 (0.0009) [2023-12-28 00:41:30,770][106226] Updated weights for policy 0, policy_version 756594 (0.0008) [2023-12-28 00:41:31,076][106225] Updated weights for policy 1, policy_version 758603 (0.0008) [2023-12-28 00:41:31,138][106225] Updated weights for policy 1, policy_version 758613 (0.0006) [2023-12-28 00:41:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 387981312. Throughput: 0: 9792.2, 1: 10064.2. Samples: 387974444. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:31,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-5.058')] [2023-12-28 00:41:31,201][106225] Updated weights for policy 1, policy_version 758623 (0.0007) [2023-12-28 00:41:31,578][106226] Updated weights for policy 0, policy_version 756604 (0.0010) [2023-12-28 00:41:31,641][106226] Updated weights for policy 0, policy_version 756614 (0.0008) [2023-12-28 00:41:31,701][106226] Updated weights for policy 0, policy_version 756624 (0.0007) [2023-12-28 00:41:31,863][106225] Updated weights for policy 1, policy_version 758633 (0.0007) [2023-12-28 00:41:31,929][106225] Updated weights for policy 1, policy_version 758643 (0.0006) [2023-12-28 00:41:31,990][106225] Updated weights for policy 1, policy_version 758653 (0.0007) [2023-12-28 00:41:32,055][106225] Updated weights for policy 1, policy_version 758663 (0.0007) [2023-12-28 00:41:32,477][106226] Updated weights for policy 0, policy_version 756634 (0.0008) [2023-12-28 00:41:32,536][106226] Updated weights for policy 0, policy_version 756644 (0.0006) [2023-12-28 00:41:32,595][106226] Updated weights for policy 0, policy_version 756654 (0.0008) [2023-12-28 00:41:32,660][106226] Updated weights for policy 0, policy_version 756664 (0.0008) [2023-12-28 00:41:32,712][106225] Updated weights for policy 1, policy_version 758673 (0.0008) [2023-12-28 00:41:32,766][106225] Updated weights for policy 1, policy_version 758684 (0.0007) [2023-12-28 00:41:32,812][106225] Updated weights for policy 1, policy_version 758694 (0.0005) [2023-12-28 00:41:33,304][106226] Updated weights for policy 0, policy_version 756674 (0.0008) [2023-12-28 00:41:33,362][106226] Updated weights for policy 0, policy_version 756684 (0.0008) [2023-12-28 00:41:33,416][106226] Updated weights for policy 0, policy_version 756694 (0.0008) [2023-12-28 00:41:33,556][106225] Updated weights for policy 1, policy_version 758704 (0.0005) [2023-12-28 00:41:33,605][106225] Updated weights for policy 1, policy_version 758714 (0.0005) [2023-12-28 00:41:33,653][106225] Updated weights for policy 1, policy_version 758724 (0.0007) [2023-12-28 00:41:34,127][106226] Updated weights for policy 0, policy_version 756704 (0.0009) [2023-12-28 00:41:34,194][106226] Updated weights for policy 0, policy_version 756714 (0.0008) [2023-12-28 00:41:34,257][106226] Updated weights for policy 0, policy_version 756724 (0.0008) [2023-12-28 00:41:34,358][106225] Updated weights for policy 1, policy_version 758734 (0.0009) [2023-12-28 00:41:34,408][106225] Updated weights for policy 1, policy_version 758744 (0.0009) [2023-12-28 00:41:34,462][106225] Updated weights for policy 1, policy_version 758754 (0.0008) [2023-12-28 00:41:35,002][106226] Updated weights for policy 0, policy_version 756734 (0.0008) [2023-12-28 00:41:35,065][106226] Updated weights for policy 0, policy_version 756744 (0.0006) [2023-12-28 00:41:35,122][106226] Updated weights for policy 0, policy_version 756754 (0.0009) [2023-12-28 00:41:35,125][106225] Updated weights for policy 1, policy_version 758764 (0.0011) [2023-12-28 00:41:35,175][106225] Updated weights for policy 1, policy_version 758774 (0.0010) [2023-12-28 00:41:35,242][106225] Updated weights for policy 1, policy_version 758784 (0.0010) [2023-12-28 00:41:35,783][106226] Updated weights for policy 0, policy_version 756764 (0.0009) [2023-12-28 00:41:35,836][106226] Updated weights for policy 0, policy_version 756774 (0.0010) [2023-12-28 00:41:35,902][106226] Updated weights for policy 0, policy_version 756784 (0.0009) [2023-12-28 00:41:35,970][106225] Updated weights for policy 1, policy_version 758794 (0.0010) [2023-12-28 00:41:36,016][106225] Updated weights for policy 1, policy_version 758804 (0.0010) [2023-12-28 00:41:36,068][106225] Updated weights for policy 1, policy_version 758814 (0.0010) [2023-12-28 00:41:36,138][106225] Updated weights for policy 1, policy_version 758824 (0.0009) [2023-12-28 00:41:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 388087808. Throughput: 0: 9793.1, 1: 10076.7. Samples: 388093304. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:36,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.389')] [2023-12-28 00:41:36,620][106226] Updated weights for policy 0, policy_version 756794 (0.0008) [2023-12-28 00:41:36,691][106226] Updated weights for policy 0, policy_version 756804 (0.0010) [2023-12-28 00:41:36,751][106226] Updated weights for policy 0, policy_version 756814 (0.0010) [2023-12-28 00:41:36,807][106226] Updated weights for policy 0, policy_version 756824 (0.0010) [2023-12-28 00:41:36,869][106225] Updated weights for policy 1, policy_version 758834 (0.0010) [2023-12-28 00:41:36,923][106225] Updated weights for policy 1, policy_version 758844 (0.0010) [2023-12-28 00:41:36,983][106225] Updated weights for policy 1, policy_version 758854 (0.0010) [2023-12-28 00:41:37,466][106226] Updated weights for policy 0, policy_version 756834 (0.0010) [2023-12-28 00:41:37,522][106226] Updated weights for policy 0, policy_version 756844 (0.0010) [2023-12-28 00:41:37,580][106226] Updated weights for policy 0, policy_version 756854 (0.0009) [2023-12-28 00:41:37,664][106225] Updated weights for policy 1, policy_version 758864 (0.0006) [2023-12-28 00:41:37,725][106225] Updated weights for policy 1, policy_version 758874 (0.0008) [2023-12-28 00:41:37,793][106225] Updated weights for policy 1, policy_version 758884 (0.0011) [2023-12-28 00:41:38,297][106226] Updated weights for policy 0, policy_version 756864 (0.0009) [2023-12-28 00:41:38,361][106226] Updated weights for policy 0, policy_version 756874 (0.0010) [2023-12-28 00:41:38,424][106226] Updated weights for policy 0, policy_version 756884 (0.0010) [2023-12-28 00:41:38,459][106225] Updated weights for policy 1, policy_version 758894 (0.0009) [2023-12-28 00:41:38,507][106225] Updated weights for policy 1, policy_version 758904 (0.0007) [2023-12-28 00:41:38,553][106225] Updated weights for policy 1, policy_version 758914 (0.0007) [2023-12-28 00:41:39,133][106226] Updated weights for policy 0, policy_version 756894 (0.0011) [2023-12-28 00:41:39,190][106226] Updated weights for policy 0, policy_version 756904 (0.0010) [2023-12-28 00:41:39,253][106226] Updated weights for policy 0, policy_version 756914 (0.0010) [2023-12-28 00:41:39,325][106225] Updated weights for policy 1, policy_version 758924 (0.0009) [2023-12-28 00:41:39,393][106225] Updated weights for policy 1, policy_version 758934 (0.0008) [2023-12-28 00:41:39,460][106225] Updated weights for policy 1, policy_version 758944 (0.0007) [2023-12-28 00:41:40,079][106226] Updated weights for policy 0, policy_version 756924 (0.0009) [2023-12-28 00:41:40,120][106225] Updated weights for policy 1, policy_version 758954 (0.0006) [2023-12-28 00:41:40,152][106226] Updated weights for policy 0, policy_version 756934 (0.0008) [2023-12-28 00:41:40,182][106225] Updated weights for policy 1, policy_version 758964 (0.0006) [2023-12-28 00:41:40,219][106226] Updated weights for policy 0, policy_version 756944 (0.0011) [2023-12-28 00:41:40,247][106225] Updated weights for policy 1, policy_version 758974 (0.0006) [2023-12-28 00:41:40,313][106225] Updated weights for policy 1, policy_version 758984 (0.0007) [2023-12-28 00:41:40,871][106226] Updated weights for policy 0, policy_version 756954 (0.0010) [2023-12-28 00:41:40,906][106225] Updated weights for policy 1, policy_version 758994 (0.0007) [2023-12-28 00:41:40,937][106226] Updated weights for policy 0, policy_version 756964 (0.0006) [2023-12-28 00:41:40,958][106225] Updated weights for policy 1, policy_version 759004 (0.0007) [2023-12-28 00:41:40,994][106226] Updated weights for policy 0, policy_version 756974 (0.0006) [2023-12-28 00:41:41,007][106225] Updated weights for policy 1, policy_version 759014 (0.0009) [2023-12-28 00:41:41,058][106226] Updated weights for policy 0, policy_version 756984 (0.0009) [2023-12-28 00:41:41,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 388186112. Throughput: 0: 9808.5, 1: 10053.6. Samples: 388152000. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:41,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.078')] [2023-12-28 00:41:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000756984_193839104.pth... [2023-12-28 00:41:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000759016_194347008.pth... [2023-12-28 00:41:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000757832_194043904.pth [2023-12-28 00:41:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000755832_193544192.pth [2023-12-28 00:41:41,778][106225] Updated weights for policy 1, policy_version 759024 (0.0007) [2023-12-28 00:41:41,834][106226] Updated weights for policy 0, policy_version 756994 (0.0011) [2023-12-28 00:41:41,839][106225] Updated weights for policy 1, policy_version 759034 (0.0010) [2023-12-28 00:41:41,894][106226] Updated weights for policy 0, policy_version 757004 (0.0011) [2023-12-28 00:41:41,896][106225] Updated weights for policy 1, policy_version 759044 (0.0007) [2023-12-28 00:41:41,949][106226] Updated weights for policy 0, policy_version 757014 (0.0011) [2023-12-28 00:41:42,675][106225] Updated weights for policy 1, policy_version 759054 (0.0007) [2023-12-28 00:41:42,695][106226] Updated weights for policy 0, policy_version 757024 (0.0007) [2023-12-28 00:41:42,741][106225] Updated weights for policy 1, policy_version 759064 (0.0007) [2023-12-28 00:41:42,758][106226] Updated weights for policy 0, policy_version 757034 (0.0006) [2023-12-28 00:41:42,810][106225] Updated weights for policy 1, policy_version 759074 (0.0008) [2023-12-28 00:41:42,818][106226] Updated weights for policy 0, policy_version 757044 (0.0006) [2023-12-28 00:41:43,513][106226] Updated weights for policy 0, policy_version 757054 (0.0007) [2023-12-28 00:41:43,536][106225] Updated weights for policy 1, policy_version 759084 (0.0010) [2023-12-28 00:41:43,566][106226] Updated weights for policy 0, policy_version 757064 (0.0006) [2023-12-28 00:41:43,594][106225] Updated weights for policy 1, policy_version 759094 (0.0008) [2023-12-28 00:41:43,624][106226] Updated weights for policy 0, policy_version 757074 (0.0006) [2023-12-28 00:41:43,662][106225] Updated weights for policy 1, policy_version 759104 (0.0008) [2023-12-28 00:41:44,240][106226] Updated weights for policy 0, policy_version 757084 (0.0007) [2023-12-28 00:41:44,290][106226] Updated weights for policy 0, policy_version 757094 (0.0008) [2023-12-28 00:41:44,338][106226] Updated weights for policy 0, policy_version 757104 (0.0010) [2023-12-28 00:41:44,397][106225] Updated weights for policy 1, policy_version 759114 (0.0008) [2023-12-28 00:41:44,450][106225] Updated weights for policy 1, policy_version 759124 (0.0008) [2023-12-28 00:41:44,498][106225] Updated weights for policy 1, policy_version 759134 (0.0008) [2023-12-28 00:41:44,549][106225] Updated weights for policy 1, policy_version 759144 (0.0007) [2023-12-28 00:41:45,142][106226] Updated weights for policy 0, policy_version 757114 (0.0009) [2023-12-28 00:41:45,209][106226] Updated weights for policy 0, policy_version 757124 (0.0006) [2023-12-28 00:41:45,252][106225] Updated weights for policy 1, policy_version 759154 (0.0008) [2023-12-28 00:41:45,275][106226] Updated weights for policy 0, policy_version 757134 (0.0006) [2023-12-28 00:41:45,313][106225] Updated weights for policy 1, policy_version 759164 (0.0008) [2023-12-28 00:41:45,342][106226] Updated weights for policy 0, policy_version 757144 (0.0006) [2023-12-28 00:41:45,375][106225] Updated weights for policy 1, policy_version 759174 (0.0008) [2023-12-28 00:41:45,925][106226] Updated weights for policy 0, policy_version 757154 (0.0009) [2023-12-28 00:41:45,985][106226] Updated weights for policy 0, policy_version 757164 (0.0008) [2023-12-28 00:41:46,043][106226] Updated weights for policy 0, policy_version 757174 (0.0008) [2023-12-28 00:41:46,103][106225] Updated weights for policy 1, policy_version 759184 (0.0008) [2023-12-28 00:41:46,149][106225] Updated weights for policy 1, policy_version 759194 (0.0008) [2023-12-28 00:41:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 388276224. Throughput: 0: 9815.4, 1: 9948.7. Samples: 388267368. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:46,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-5.194')] [2023-12-28 00:41:46,203][106225] Updated weights for policy 1, policy_version 759204 (0.0007) [2023-12-28 00:41:46,692][106226] Updated weights for policy 0, policy_version 757184 (0.0008) [2023-12-28 00:41:46,744][106226] Updated weights for policy 0, policy_version 757194 (0.0006) [2023-12-28 00:41:46,793][106226] Updated weights for policy 0, policy_version 757204 (0.0005) [2023-12-28 00:41:46,973][106225] Updated weights for policy 1, policy_version 759214 (0.0007) [2023-12-28 00:41:47,033][106225] Updated weights for policy 1, policy_version 759224 (0.0008) [2023-12-28 00:41:47,097][106225] Updated weights for policy 1, policy_version 759234 (0.0007) [2023-12-28 00:41:47,413][106226] Updated weights for policy 0, policy_version 757214 (0.0008) [2023-12-28 00:41:47,465][106226] Updated weights for policy 0, policy_version 757224 (0.0009) [2023-12-28 00:41:47,528][106226] Updated weights for policy 0, policy_version 757234 (0.0009) [2023-12-28 00:41:47,839][106225] Updated weights for policy 1, policy_version 759244 (0.0008) [2023-12-28 00:41:47,898][106225] Updated weights for policy 1, policy_version 759254 (0.0008) [2023-12-28 00:41:47,952][106225] Updated weights for policy 1, policy_version 759264 (0.0008) [2023-12-28 00:41:48,255][106226] Updated weights for policy 0, policy_version 757244 (0.0009) [2023-12-28 00:41:48,310][106226] Updated weights for policy 0, policy_version 757254 (0.0008) [2023-12-28 00:41:48,386][106226] Updated weights for policy 0, policy_version 757264 (0.0007) [2023-12-28 00:41:48,703][106225] Updated weights for policy 1, policy_version 759274 (0.0009) [2023-12-28 00:41:48,765][106225] Updated weights for policy 1, policy_version 759284 (0.0008) [2023-12-28 00:41:48,825][106225] Updated weights for policy 1, policy_version 759294 (0.0009) [2023-12-28 00:41:48,884][106225] Updated weights for policy 1, policy_version 759304 (0.0008) [2023-12-28 00:41:49,114][106226] Updated weights for policy 0, policy_version 757274 (0.0009) [2023-12-28 00:41:49,175][106226] Updated weights for policy 0, policy_version 757284 (0.0008) [2023-12-28 00:41:49,237][106226] Updated weights for policy 0, policy_version 757294 (0.0009) [2023-12-28 00:41:49,303][106226] Updated weights for policy 0, policy_version 757304 (0.0008) [2023-12-28 00:41:49,558][106225] Updated weights for policy 1, policy_version 759314 (0.0005) [2023-12-28 00:41:49,613][106225] Updated weights for policy 1, policy_version 759324 (0.0005) [2023-12-28 00:41:49,678][106225] Updated weights for policy 1, policy_version 759334 (0.0005) [2023-12-28 00:41:50,035][106226] Updated weights for policy 0, policy_version 757314 (0.0007) [2023-12-28 00:41:50,100][106226] Updated weights for policy 0, policy_version 757324 (0.0006) [2023-12-28 00:41:50,159][106226] Updated weights for policy 0, policy_version 757334 (0.0010) [2023-12-28 00:41:50,386][106225] Updated weights for policy 1, policy_version 759344 (0.0008) [2023-12-28 00:41:50,452][106225] Updated weights for policy 1, policy_version 759354 (0.0010) [2023-12-28 00:41:50,521][106225] Updated weights for policy 1, policy_version 759364 (0.0010) [2023-12-28 00:41:50,752][106226] Updated weights for policy 0, policy_version 757344 (0.0010) [2023-12-28 00:41:50,814][106226] Updated weights for policy 0, policy_version 757354 (0.0011) [2023-12-28 00:41:50,877][106226] Updated weights for policy 0, policy_version 757364 (0.0011) [2023-12-28 00:41:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 388374528. Throughput: 0: 9855.6, 1: 9903.7. Samples: 388385432. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:51,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-5.175')] [2023-12-28 00:41:51,225][106225] Updated weights for policy 1, policy_version 759374 (0.0008) [2023-12-28 00:41:51,292][106225] Updated weights for policy 1, policy_version 759384 (0.0008) [2023-12-28 00:41:51,358][106225] Updated weights for policy 1, policy_version 759394 (0.0008) [2023-12-28 00:41:51,611][106226] Updated weights for policy 0, policy_version 757374 (0.0010) [2023-12-28 00:41:51,675][106226] Updated weights for policy 0, policy_version 757384 (0.0009) [2023-12-28 00:41:51,737][106226] Updated weights for policy 0, policy_version 757394 (0.0009) [2023-12-28 00:41:52,161][106225] Updated weights for policy 1, policy_version 759404 (0.0008) [2023-12-28 00:41:52,223][106225] Updated weights for policy 1, policy_version 759414 (0.0009) [2023-12-28 00:41:52,289][106225] Updated weights for policy 1, policy_version 759424 (0.0011) [2023-12-28 00:41:52,498][106226] Updated weights for policy 0, policy_version 757404 (0.0007) [2023-12-28 00:41:52,556][106226] Updated weights for policy 0, policy_version 757414 (0.0009) [2023-12-28 00:41:52,614][106226] Updated weights for policy 0, policy_version 757424 (0.0010) [2023-12-28 00:41:52,964][106225] Updated weights for policy 1, policy_version 759434 (0.0010) [2023-12-28 00:41:53,021][106225] Updated weights for policy 1, policy_version 759444 (0.0008) [2023-12-28 00:41:53,083][106225] Updated weights for policy 1, policy_version 759454 (0.0008) [2023-12-28 00:41:53,147][106225] Updated weights for policy 1, policy_version 759464 (0.0008) [2023-12-28 00:41:53,328][106226] Updated weights for policy 0, policy_version 757434 (0.0008) [2023-12-28 00:41:53,387][106226] Updated weights for policy 0, policy_version 757444 (0.0006) [2023-12-28 00:41:53,441][106226] Updated weights for policy 0, policy_version 757454 (0.0010) [2023-12-28 00:41:53,494][106226] Updated weights for policy 0, policy_version 757464 (0.0011) [2023-12-28 00:41:53,889][106225] Updated weights for policy 1, policy_version 759474 (0.0007) [2023-12-28 00:41:53,943][106225] Updated weights for policy 1, policy_version 759484 (0.0008) [2023-12-28 00:41:53,998][106225] Updated weights for policy 1, policy_version 759494 (0.0006) [2023-12-28 00:41:54,126][106226] Updated weights for policy 0, policy_version 757474 (0.0010) [2023-12-28 00:41:54,172][106226] Updated weights for policy 0, policy_version 757484 (0.0010) [2023-12-28 00:41:54,226][106226] Updated weights for policy 0, policy_version 757494 (0.0010) [2023-12-28 00:41:54,714][106225] Updated weights for policy 1, policy_version 759504 (0.0007) [2023-12-28 00:41:54,763][106225] Updated weights for policy 1, policy_version 759514 (0.0007) [2023-12-28 00:41:54,809][106225] Updated weights for policy 1, policy_version 759524 (0.0007) [2023-12-28 00:41:54,959][106226] Updated weights for policy 0, policy_version 757504 (0.0010) [2023-12-28 00:41:55,022][106226] Updated weights for policy 0, policy_version 757514 (0.0011) [2023-12-28 00:41:55,085][106226] Updated weights for policy 0, policy_version 757524 (0.0010) [2023-12-28 00:41:55,488][106225] Updated weights for policy 1, policy_version 759534 (0.0008) [2023-12-28 00:41:55,543][106225] Updated weights for policy 1, policy_version 759544 (0.0007) [2023-12-28 00:41:55,601][106225] Updated weights for policy 1, policy_version 759554 (0.0007) [2023-12-28 00:41:55,794][106226] Updated weights for policy 0, policy_version 757534 (0.0010) [2023-12-28 00:41:55,843][106226] Updated weights for policy 0, policy_version 757544 (0.0010) [2023-12-28 00:41:55,896][106226] Updated weights for policy 0, policy_version 757554 (0.0010) [2023-12-28 00:41:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 388472832. Throughput: 0: 9838.1, 1: 9911.4. Samples: 388443796. Policy #0 lag: (min: 2.0, avg: 16.7, max: 34.0) [2023-12-28 00:41:56,176][105115] Avg episode reward: [(0, '-4.478'), (1, '-4.860')] [2023-12-28 00:41:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000757560_193986560.pth... [2023-12-28 00:41:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000756408_193691648.pth [2023-12-28 00:41:56,210][106225] Updated weights for policy 1, policy_version 759564 (0.0007) [2023-12-28 00:41:56,270][106225] Updated weights for policy 1, policy_version 759574 (0.0010) [2023-12-28 00:41:56,338][106225] Updated weights for policy 1, policy_version 759584 (0.0010) [2023-12-28 00:41:56,386][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000759592_194494464.pth... [2023-12-28 00:41:56,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000758440_194199552.pth [2023-12-28 00:41:56,531][106226] Updated weights for policy 0, policy_version 757564 (0.0008) [2023-12-28 00:41:56,582][106226] Updated weights for policy 0, policy_version 757574 (0.0005) [2023-12-28 00:41:56,633][106226] Updated weights for policy 0, policy_version 757584 (0.0005) [2023-12-28 00:41:57,019][106225] Updated weights for policy 1, policy_version 759594 (0.0007) [2023-12-28 00:41:57,067][106225] Updated weights for policy 1, policy_version 759604 (0.0006) [2023-12-28 00:41:57,110][106225] Updated weights for policy 1, policy_version 759614 (0.0005) [2023-12-28 00:41:57,156][106225] Updated weights for policy 1, policy_version 759624 (0.0009) [2023-12-28 00:41:57,285][106226] Updated weights for policy 0, policy_version 757594 (0.0006) [2023-12-28 00:41:57,341][106226] Updated weights for policy 0, policy_version 757604 (0.0008) [2023-12-28 00:41:57,404][106226] Updated weights for policy 0, policy_version 757614 (0.0010) [2023-12-28 00:41:57,456][106226] Updated weights for policy 0, policy_version 757624 (0.0010) [2023-12-28 00:41:57,832][106225] Updated weights for policy 1, policy_version 759634 (0.0010) [2023-12-28 00:41:57,879][106225] Updated weights for policy 1, policy_version 759644 (0.0010) [2023-12-28 00:41:57,926][106225] Updated weights for policy 1, policy_version 759654 (0.0010) [2023-12-28 00:41:58,143][106226] Updated weights for policy 0, policy_version 757634 (0.0007) [2023-12-28 00:41:58,192][106226] Updated weights for policy 0, policy_version 757644 (0.0006) [2023-12-28 00:41:58,265][106226] Updated weights for policy 0, policy_version 757654 (0.0008) [2023-12-28 00:41:58,672][106225] Updated weights for policy 1, policy_version 759664 (0.0009) [2023-12-28 00:41:58,737][106225] Updated weights for policy 1, policy_version 759674 (0.0008) [2023-12-28 00:41:58,806][106225] Updated weights for policy 1, policy_version 759684 (0.0008) [2023-12-28 00:41:59,072][106226] Updated weights for policy 0, policy_version 757664 (0.0009) [2023-12-28 00:41:59,125][106226] Updated weights for policy 0, policy_version 757674 (0.0009) [2023-12-28 00:41:59,177][106226] Updated weights for policy 0, policy_version 757684 (0.0006) [2023-12-28 00:41:59,655][106225] Updated weights for policy 1, policy_version 759694 (0.0010) [2023-12-28 00:41:59,719][106225] Updated weights for policy 1, policy_version 759704 (0.0010) [2023-12-28 00:41:59,797][106225] Updated weights for policy 1, policy_version 759714 (0.0011) [2023-12-28 00:41:59,989][106226] Updated weights for policy 0, policy_version 757694 (0.0009) [2023-12-28 00:42:00,049][106226] Updated weights for policy 0, policy_version 757704 (0.0008) [2023-12-28 00:42:00,110][106226] Updated weights for policy 0, policy_version 757714 (0.0008) [2023-12-28 00:42:00,488][106225] Updated weights for policy 1, policy_version 759724 (0.0012) [2023-12-28 00:42:00,551][106225] Updated weights for policy 1, policy_version 759734 (0.0006) [2023-12-28 00:42:00,614][106225] Updated weights for policy 1, policy_version 759744 (0.0008) [2023-12-28 00:42:00,866][106226] Updated weights for policy 0, policy_version 757724 (0.0008) [2023-12-28 00:42:00,927][106226] Updated weights for policy 0, policy_version 757734 (0.0008) [2023-12-28 00:42:00,980][106226] Updated weights for policy 0, policy_version 757744 (0.0008) [2023-12-28 00:42:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 388571136. Throughput: 0: 9830.1, 1: 9861.1. Samples: 388561696. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:01,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.955')] [2023-12-28 00:42:01,257][106225] Updated weights for policy 1, policy_version 759754 (0.0010) [2023-12-28 00:42:01,317][106225] Updated weights for policy 1, policy_version 759764 (0.0005) [2023-12-28 00:42:01,384][106225] Updated weights for policy 1, policy_version 759774 (0.0007) [2023-12-28 00:42:01,456][106225] Updated weights for policy 1, policy_version 759784 (0.0008) [2023-12-28 00:42:01,703][106226] Updated weights for policy 0, policy_version 757754 (0.0008) [2023-12-28 00:42:01,781][106226] Updated weights for policy 0, policy_version 757764 (0.0009) [2023-12-28 00:42:01,836][106226] Updated weights for policy 0, policy_version 757774 (0.0009) [2023-12-28 00:42:01,895][106226] Updated weights for policy 0, policy_version 757784 (0.0010) [2023-12-28 00:42:02,080][106225] Updated weights for policy 1, policy_version 759794 (0.0006) [2023-12-28 00:42:02,132][106225] Updated weights for policy 1, policy_version 759804 (0.0008) [2023-12-28 00:42:02,179][106225] Updated weights for policy 1, policy_version 759814 (0.0005) [2023-12-28 00:42:02,553][106226] Updated weights for policy 0, policy_version 757794 (0.0010) [2023-12-28 00:42:02,639][106226] Updated weights for policy 0, policy_version 757804 (0.0011) [2023-12-28 00:42:02,703][106226] Updated weights for policy 0, policy_version 757814 (0.0011) [2023-12-28 00:42:02,889][106225] Updated weights for policy 1, policy_version 759824 (0.0008) [2023-12-28 00:42:02,953][106225] Updated weights for policy 1, policy_version 759834 (0.0007) [2023-12-28 00:42:03,016][106225] Updated weights for policy 1, policy_version 759844 (0.0005) [2023-12-28 00:42:03,326][106226] Updated weights for policy 0, policy_version 757824 (0.0010) [2023-12-28 00:42:03,382][106226] Updated weights for policy 0, policy_version 757834 (0.0009) [2023-12-28 00:42:03,438][106226] Updated weights for policy 0, policy_version 757844 (0.0005) [2023-12-28 00:42:03,567][106225] Updated weights for policy 1, policy_version 759854 (0.0007) [2023-12-28 00:42:03,623][106225] Updated weights for policy 1, policy_version 759864 (0.0008) [2023-12-28 00:42:03,675][106225] Updated weights for policy 1, policy_version 759874 (0.0009) [2023-12-28 00:42:04,024][106226] Updated weights for policy 0, policy_version 757854 (0.0005) [2023-12-28 00:42:04,087][106226] Updated weights for policy 0, policy_version 757864 (0.0005) [2023-12-28 00:42:04,155][106226] Updated weights for policy 0, policy_version 757874 (0.0010) [2023-12-28 00:42:04,467][106225] Updated weights for policy 1, policy_version 759884 (0.0008) [2023-12-28 00:42:04,518][106225] Updated weights for policy 1, policy_version 759894 (0.0008) [2023-12-28 00:42:04,572][106225] Updated weights for policy 1, policy_version 759904 (0.0008) [2023-12-28 00:42:04,790][106226] Updated weights for policy 0, policy_version 757884 (0.0009) [2023-12-28 00:42:04,859][106226] Updated weights for policy 0, policy_version 757894 (0.0005) [2023-12-28 00:42:04,925][106226] Updated weights for policy 0, policy_version 757904 (0.0005) [2023-12-28 00:42:05,323][106225] Updated weights for policy 1, policy_version 759914 (0.0008) [2023-12-28 00:42:05,370][106225] Updated weights for policy 1, policy_version 759924 (0.0008) [2023-12-28 00:42:05,422][106225] Updated weights for policy 1, policy_version 759934 (0.0009) [2023-12-28 00:42:05,471][106225] Updated weights for policy 1, policy_version 759944 (0.0010) [2023-12-28 00:42:05,536][106226] Updated weights for policy 0, policy_version 757914 (0.0007) [2023-12-28 00:42:05,593][106226] Updated weights for policy 0, policy_version 757924 (0.0005) [2023-12-28 00:42:05,657][106226] Updated weights for policy 0, policy_version 757934 (0.0005) [2023-12-28 00:42:05,718][106226] Updated weights for policy 0, policy_version 757944 (0.0005) [2023-12-28 00:42:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 388669440. Throughput: 0: 9863.7, 1: 9867.0. Samples: 388684196. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:06,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-5.156')] [2023-12-28 00:42:06,311][106225] Updated weights for policy 1, policy_version 759954 (0.0010) [2023-12-28 00:42:06,330][106226] Updated weights for policy 0, policy_version 757954 (0.0011) [2023-12-28 00:42:06,371][106225] Updated weights for policy 1, policy_version 759964 (0.0007) [2023-12-28 00:42:06,395][106226] Updated weights for policy 0, policy_version 757964 (0.0011) [2023-12-28 00:42:06,434][106225] Updated weights for policy 1, policy_version 759974 (0.0010) [2023-12-28 00:42:06,460][106226] Updated weights for policy 0, policy_version 757974 (0.0011) [2023-12-28 00:42:07,168][106225] Updated weights for policy 1, policy_version 759984 (0.0008) [2023-12-28 00:42:07,169][106226] Updated weights for policy 0, policy_version 757984 (0.0011) [2023-12-28 00:42:07,223][106225] Updated weights for policy 1, policy_version 759994 (0.0007) [2023-12-28 00:42:07,233][106226] Updated weights for policy 0, policy_version 757994 (0.0011) [2023-12-28 00:42:07,280][106226] Updated weights for policy 0, policy_version 758004 (0.0010) [2023-12-28 00:42:07,282][106225] Updated weights for policy 1, policy_version 760004 (0.0005) [2023-12-28 00:42:07,971][106225] Updated weights for policy 1, policy_version 760014 (0.0006) [2023-12-28 00:42:07,991][106226] Updated weights for policy 0, policy_version 758014 (0.0010) [2023-12-28 00:42:08,028][106225] Updated weights for policy 1, policy_version 760024 (0.0006) [2023-12-28 00:42:08,042][106226] Updated weights for policy 0, policy_version 758024 (0.0010) [2023-12-28 00:42:08,085][106225] Updated weights for policy 1, policy_version 760034 (0.0005) [2023-12-28 00:42:08,094][106226] Updated weights for policy 0, policy_version 758034 (0.0010) [2023-12-28 00:42:08,822][106225] Updated weights for policy 1, policy_version 760044 (0.0007) [2023-12-28 00:42:08,882][106226] Updated weights for policy 0, policy_version 758044 (0.0008) [2023-12-28 00:42:08,884][106225] Updated weights for policy 1, policy_version 760054 (0.0009) [2023-12-28 00:42:08,940][106226] Updated weights for policy 0, policy_version 758054 (0.0008) [2023-12-28 00:42:08,945][106225] Updated weights for policy 1, policy_version 760064 (0.0006) [2023-12-28 00:42:09,002][106226] Updated weights for policy 0, policy_version 758064 (0.0008) [2023-12-28 00:42:09,635][106225] Updated weights for policy 1, policy_version 760074 (0.0008) [2023-12-28 00:42:09,698][106225] Updated weights for policy 1, policy_version 760084 (0.0008) [2023-12-28 00:42:09,761][106225] Updated weights for policy 1, policy_version 760094 (0.0008) [2023-12-28 00:42:09,797][106226] Updated weights for policy 0, policy_version 758074 (0.0007) [2023-12-28 00:42:09,819][106225] Updated weights for policy 1, policy_version 760104 (0.0008) [2023-12-28 00:42:09,870][106226] Updated weights for policy 0, policy_version 758084 (0.0008) [2023-12-28 00:42:09,940][106226] Updated weights for policy 0, policy_version 758094 (0.0009) [2023-12-28 00:42:09,998][106226] Updated weights for policy 0, policy_version 758104 (0.0008) [2023-12-28 00:42:10,580][106225] Updated weights for policy 1, policy_version 760114 (0.0009) [2023-12-28 00:42:10,637][106225] Updated weights for policy 1, policy_version 760124 (0.0008) [2023-12-28 00:42:10,639][106226] Updated weights for policy 0, policy_version 758114 (0.0005) [2023-12-28 00:42:10,690][106225] Updated weights for policy 1, policy_version 760134 (0.0008) [2023-12-28 00:42:10,694][106226] Updated weights for policy 0, policy_version 758124 (0.0005) [2023-12-28 00:42:10,752][106226] Updated weights for policy 0, policy_version 758134 (0.0008) [2023-12-28 00:42:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 388767744. Throughput: 0: 9890.1, 1: 9807.2. Samples: 388741084. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:11,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-5.120')] [2023-12-28 00:42:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000760136_194633728.pth... [2023-12-28 00:42:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000758136_194134016.pth... [2023-12-28 00:42:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000756984_193839104.pth [2023-12-28 00:42:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000759016_194347008.pth [2023-12-28 00:42:11,368][106226] Updated weights for policy 0, policy_version 758144 (0.0009) [2023-12-28 00:42:11,433][106226] Updated weights for policy 0, policy_version 758154 (0.0006) [2023-12-28 00:42:11,489][106226] Updated weights for policy 0, policy_version 758164 (0.0008) [2023-12-28 00:42:11,516][106225] Updated weights for policy 1, policy_version 760144 (0.0009) [2023-12-28 00:42:11,568][106225] Updated weights for policy 1, policy_version 760154 (0.0008) [2023-12-28 00:42:11,631][106225] Updated weights for policy 1, policy_version 760164 (0.0009) [2023-12-28 00:42:12,138][106226] Updated weights for policy 0, policy_version 758174 (0.0006) [2023-12-28 00:42:12,196][106226] Updated weights for policy 0, policy_version 758184 (0.0009) [2023-12-28 00:42:12,258][106226] Updated weights for policy 0, policy_version 758194 (0.0011) [2023-12-28 00:42:12,444][106225] Updated weights for policy 1, policy_version 760174 (0.0008) [2023-12-28 00:42:12,502][106225] Updated weights for policy 1, policy_version 760184 (0.0008) [2023-12-28 00:42:12,568][106225] Updated weights for policy 1, policy_version 760194 (0.0006) [2023-12-28 00:42:12,912][106226] Updated weights for policy 0, policy_version 758204 (0.0008) [2023-12-28 00:42:12,959][106226] Updated weights for policy 0, policy_version 758214 (0.0005) [2023-12-28 00:42:13,010][106226] Updated weights for policy 0, policy_version 758224 (0.0005) [2023-12-28 00:42:13,337][106225] Updated weights for policy 1, policy_version 760204 (0.0007) [2023-12-28 00:42:13,393][106225] Updated weights for policy 1, policy_version 760214 (0.0007) [2023-12-28 00:42:13,447][106225] Updated weights for policy 1, policy_version 760224 (0.0008) [2023-12-28 00:42:13,611][106226] Updated weights for policy 0, policy_version 758234 (0.0008) [2023-12-28 00:42:13,670][106226] Updated weights for policy 0, policy_version 758244 (0.0007) [2023-12-28 00:42:13,736][106226] Updated weights for policy 0, policy_version 758254 (0.0007) [2023-12-28 00:42:13,794][106226] Updated weights for policy 0, policy_version 758264 (0.0009) [2023-12-28 00:42:14,096][106225] Updated weights for policy 1, policy_version 760234 (0.0009) [2023-12-28 00:42:14,155][106225] Updated weights for policy 1, policy_version 760244 (0.0010) [2023-12-28 00:42:14,210][106225] Updated weights for policy 1, policy_version 760254 (0.0010) [2023-12-28 00:42:14,267][106225] Updated weights for policy 1, policy_version 760264 (0.0010) [2023-12-28 00:42:14,507][106226] Updated weights for policy 0, policy_version 758274 (0.0005) [2023-12-28 00:42:14,565][106226] Updated weights for policy 0, policy_version 758284 (0.0006) [2023-12-28 00:42:14,624][106226] Updated weights for policy 0, policy_version 758294 (0.0006) [2023-12-28 00:42:15,027][106225] Updated weights for policy 1, policy_version 760274 (0.0008) [2023-12-28 00:42:15,086][106225] Updated weights for policy 1, policy_version 760284 (0.0007) [2023-12-28 00:42:15,144][106225] Updated weights for policy 1, policy_version 760294 (0.0005) [2023-12-28 00:42:15,264][106226] Updated weights for policy 0, policy_version 758304 (0.0007) [2023-12-28 00:42:15,333][106226] Updated weights for policy 0, policy_version 758314 (0.0010) [2023-12-28 00:42:15,397][106226] Updated weights for policy 0, policy_version 758324 (0.0009) [2023-12-28 00:42:15,739][106225] Updated weights for policy 1, policy_version 760304 (0.0005) [2023-12-28 00:42:15,801][106225] Updated weights for policy 1, policy_version 760314 (0.0007) [2023-12-28 00:42:15,872][106225] Updated weights for policy 1, policy_version 760324 (0.0010) [2023-12-28 00:42:16,120][106226] Updated weights for policy 0, policy_version 758334 (0.0011) [2023-12-28 00:42:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 388866048. Throughput: 0: 9936.8, 1: 9722.3. Samples: 388859104. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:16,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-5.326')] [2023-12-28 00:42:16,180][106226] Updated weights for policy 0, policy_version 758344 (0.0009) [2023-12-28 00:42:16,237][106226] Updated weights for policy 0, policy_version 758354 (0.0008) [2023-12-28 00:42:16,552][106225] Updated weights for policy 1, policy_version 760334 (0.0009) [2023-12-28 00:42:16,606][106225] Updated weights for policy 1, policy_version 760344 (0.0009) [2023-12-28 00:42:16,664][106225] Updated weights for policy 1, policy_version 760354 (0.0009) [2023-12-28 00:42:16,818][106226] Updated weights for policy 0, policy_version 758364 (0.0009) [2023-12-28 00:42:16,870][106226] Updated weights for policy 0, policy_version 758374 (0.0008) [2023-12-28 00:42:16,919][106226] Updated weights for policy 0, policy_version 758384 (0.0008) [2023-12-28 00:42:17,294][106225] Updated weights for policy 1, policy_version 760364 (0.0010) [2023-12-28 00:42:17,346][106225] Updated weights for policy 1, policy_version 760374 (0.0009) [2023-12-28 00:42:17,406][106225] Updated weights for policy 1, policy_version 760384 (0.0008) [2023-12-28 00:42:17,521][106226] Updated weights for policy 0, policy_version 758394 (0.0007) [2023-12-28 00:42:17,576][106226] Updated weights for policy 0, policy_version 758404 (0.0010) [2023-12-28 00:42:17,637][106226] Updated weights for policy 0, policy_version 758414 (0.0007) [2023-12-28 00:42:17,701][106226] Updated weights for policy 0, policy_version 758424 (0.0005) [2023-12-28 00:42:18,114][106225] Updated weights for policy 1, policy_version 760394 (0.0006) [2023-12-28 00:42:18,166][106225] Updated weights for policy 1, policy_version 760404 (0.0008) [2023-12-28 00:42:18,233][106225] Updated weights for policy 1, policy_version 760414 (0.0005) [2023-12-28 00:42:18,292][106225] Updated weights for policy 1, policy_version 760424 (0.0005) [2023-12-28 00:42:18,350][106226] Updated weights for policy 0, policy_version 758434 (0.0009) [2023-12-28 00:42:18,411][106226] Updated weights for policy 0, policy_version 758444 (0.0008) [2023-12-28 00:42:18,472][106226] Updated weights for policy 0, policy_version 758454 (0.0009) [2023-12-28 00:42:19,001][106225] Updated weights for policy 1, policy_version 760434 (0.0008) [2023-12-28 00:42:19,054][106225] Updated weights for policy 1, policy_version 760444 (0.0005) [2023-12-28 00:42:19,110][106225] Updated weights for policy 1, policy_version 760454 (0.0007) [2023-12-28 00:42:19,182][106226] Updated weights for policy 0, policy_version 758464 (0.0008) [2023-12-28 00:42:19,239][106226] Updated weights for policy 0, policy_version 758474 (0.0008) [2023-12-28 00:42:19,309][106226] Updated weights for policy 0, policy_version 758484 (0.0007) [2023-12-28 00:42:19,821][106225] Updated weights for policy 1, policy_version 760464 (0.0011) [2023-12-28 00:42:19,886][106225] Updated weights for policy 1, policy_version 760474 (0.0010) [2023-12-28 00:42:19,950][106225] Updated weights for policy 1, policy_version 760484 (0.0011) [2023-12-28 00:42:20,040][106226] Updated weights for policy 0, policy_version 758494 (0.0008) [2023-12-28 00:42:20,101][106226] Updated weights for policy 0, policy_version 758504 (0.0009) [2023-12-28 00:42:20,165][106226] Updated weights for policy 0, policy_version 758514 (0.0008) [2023-12-28 00:42:20,696][106225] Updated weights for policy 1, policy_version 760494 (0.0010) [2023-12-28 00:42:20,757][106225] Updated weights for policy 1, policy_version 760504 (0.0010) [2023-12-28 00:42:20,813][106225] Updated weights for policy 1, policy_version 760514 (0.0011) [2023-12-28 00:42:20,950][106226] Updated weights for policy 0, policy_version 758524 (0.0008) [2023-12-28 00:42:21,013][106226] Updated weights for policy 0, policy_version 758534 (0.0008) [2023-12-28 00:42:21,077][106226] Updated weights for policy 0, policy_version 758544 (0.0008) [2023-12-28 00:42:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 388972544. Throughput: 0: 9980.7, 1: 9701.9. Samples: 388979020. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:21,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-5.078')] [2023-12-28 00:42:21,596][106225] Updated weights for policy 1, policy_version 760524 (0.0010) [2023-12-28 00:42:21,666][106225] Updated weights for policy 1, policy_version 760534 (0.0011) [2023-12-28 00:42:21,724][106225] Updated weights for policy 1, policy_version 760544 (0.0011) [2023-12-28 00:42:21,853][106226] Updated weights for policy 0, policy_version 758554 (0.0009) [2023-12-28 00:42:21,920][106226] Updated weights for policy 0, policy_version 758564 (0.0007) [2023-12-28 00:42:21,979][106226] Updated weights for policy 0, policy_version 758574 (0.0007) [2023-12-28 00:42:22,029][106226] Updated weights for policy 0, policy_version 758584 (0.0008) [2023-12-28 00:42:22,414][106225] Updated weights for policy 1, policy_version 760554 (0.0008) [2023-12-28 00:42:22,476][106225] Updated weights for policy 1, policy_version 760564 (0.0008) [2023-12-28 00:42:22,539][106225] Updated weights for policy 1, policy_version 760574 (0.0008) [2023-12-28 00:42:22,599][106225] Updated weights for policy 1, policy_version 760584 (0.0008) [2023-12-28 00:42:22,746][106226] Updated weights for policy 0, policy_version 758594 (0.0011) [2023-12-28 00:42:22,797][106226] Updated weights for policy 0, policy_version 758604 (0.0011) [2023-12-28 00:42:22,860][106226] Updated weights for policy 0, policy_version 758614 (0.0011) [2023-12-28 00:42:23,278][106225] Updated weights for policy 1, policy_version 760594 (0.0008) [2023-12-28 00:42:23,323][106225] Updated weights for policy 1, policy_version 760604 (0.0007) [2023-12-28 00:42:23,374][106225] Updated weights for policy 1, policy_version 760614 (0.0005) [2023-12-28 00:42:23,560][106226] Updated weights for policy 0, policy_version 758624 (0.0010) [2023-12-28 00:42:23,617][106226] Updated weights for policy 0, policy_version 758634 (0.0010) [2023-12-28 00:42:23,690][106226] Updated weights for policy 0, policy_version 758644 (0.0011) [2023-12-28 00:42:24,009][106225] Updated weights for policy 1, policy_version 760624 (0.0008) [2023-12-28 00:42:24,067][106225] Updated weights for policy 1, policy_version 760634 (0.0009) [2023-12-28 00:42:24,125][106225] Updated weights for policy 1, policy_version 760644 (0.0009) [2023-12-28 00:42:24,279][106226] Updated weights for policy 0, policy_version 758654 (0.0007) [2023-12-28 00:42:24,348][106226] Updated weights for policy 0, policy_version 758664 (0.0005) [2023-12-28 00:42:24,410][106226] Updated weights for policy 0, policy_version 758674 (0.0005) [2023-12-28 00:42:24,851][106225] Updated weights for policy 1, policy_version 760654 (0.0008) [2023-12-28 00:42:24,907][106225] Updated weights for policy 1, policy_version 760664 (0.0005) [2023-12-28 00:42:24,964][106225] Updated weights for policy 1, policy_version 760674 (0.0005) [2023-12-28 00:42:25,047][106226] Updated weights for policy 0, policy_version 758684 (0.0008) [2023-12-28 00:42:25,099][106226] Updated weights for policy 0, policy_version 758694 (0.0010) [2023-12-28 00:42:25,149][106226] Updated weights for policy 0, policy_version 758704 (0.0010) [2023-12-28 00:42:25,607][106225] Updated weights for policy 1, policy_version 760684 (0.0007) [2023-12-28 00:42:25,662][106225] Updated weights for policy 1, policy_version 760694 (0.0008) [2023-12-28 00:42:25,714][106225] Updated weights for policy 1, policy_version 760704 (0.0007) [2023-12-28 00:42:25,857][106226] Updated weights for policy 0, policy_version 758714 (0.0009) [2023-12-28 00:42:25,927][106226] Updated weights for policy 0, policy_version 758724 (0.0010) [2023-12-28 00:42:25,987][106226] Updated weights for policy 0, policy_version 758734 (0.0010) [2023-12-28 00:42:26,044][106226] Updated weights for policy 0, policy_version 758744 (0.0010) [2023-12-28 00:42:26,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 389070848. Throughput: 0: 9976.4, 1: 9690.8. Samples: 389037028. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:26,176][105115] Avg episode reward: [(0, '-4.726'), (1, '-5.026')] [2023-12-28 00:42:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000760712_194781184.pth... [2023-12-28 00:42:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000758744_194289664.pth... [2023-12-28 00:42:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000759592_194494464.pth [2023-12-28 00:42:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000757560_193986560.pth [2023-12-28 00:42:26,309][106225] Updated weights for policy 1, policy_version 760714 (0.0007) [2023-12-28 00:42:26,366][106225] Updated weights for policy 1, policy_version 760724 (0.0005) [2023-12-28 00:42:26,417][106225] Updated weights for policy 1, policy_version 760734 (0.0008) [2023-12-28 00:42:26,479][106225] Updated weights for policy 1, policy_version 760744 (0.0008) [2023-12-28 00:42:26,633][106226] Updated weights for policy 0, policy_version 758754 (0.0005) [2023-12-28 00:42:26,695][106226] Updated weights for policy 0, policy_version 758764 (0.0010) [2023-12-28 00:42:26,757][106226] Updated weights for policy 0, policy_version 758774 (0.0010) [2023-12-28 00:42:27,198][106225] Updated weights for policy 1, policy_version 760754 (0.0009) [2023-12-28 00:42:27,264][106225] Updated weights for policy 1, policy_version 760764 (0.0007) [2023-12-28 00:42:27,318][106225] Updated weights for policy 1, policy_version 760774 (0.0008) [2023-12-28 00:42:27,359][106226] Updated weights for policy 0, policy_version 758784 (0.0008) [2023-12-28 00:42:27,421][106226] Updated weights for policy 0, policy_version 758794 (0.0005) [2023-12-28 00:42:27,476][106226] Updated weights for policy 0, policy_version 758804 (0.0005) [2023-12-28 00:42:28,000][106225] Updated weights for policy 1, policy_version 760784 (0.0006) [2023-12-28 00:42:28,035][106226] Updated weights for policy 0, policy_version 758814 (0.0005) [2023-12-28 00:42:28,060][106225] Updated weights for policy 1, policy_version 760794 (0.0008) [2023-12-28 00:42:28,088][106226] Updated weights for policy 0, policy_version 758824 (0.0007) [2023-12-28 00:42:28,117][106225] Updated weights for policy 1, policy_version 760804 (0.0007) [2023-12-28 00:42:28,142][106226] Updated weights for policy 0, policy_version 758834 (0.0008) [2023-12-28 00:42:28,822][106225] Updated weights for policy 1, policy_version 760814 (0.0006) [2023-12-28 00:42:28,864][106226] Updated weights for policy 0, policy_version 758844 (0.0008) [2023-12-28 00:42:28,885][106225] Updated weights for policy 1, policy_version 760824 (0.0005) [2023-12-28 00:42:28,921][106226] Updated weights for policy 0, policy_version 758854 (0.0009) [2023-12-28 00:42:28,944][106225] Updated weights for policy 1, policy_version 760834 (0.0006) [2023-12-28 00:42:28,975][106226] Updated weights for policy 0, policy_version 758864 (0.0009) [2023-12-28 00:42:29,564][106225] Updated weights for policy 1, policy_version 760844 (0.0007) [2023-12-28 00:42:29,619][106225] Updated weights for policy 1, policy_version 760854 (0.0008) [2023-12-28 00:42:29,674][106225] Updated weights for policy 1, policy_version 760864 (0.0009) [2023-12-28 00:42:29,759][106226] Updated weights for policy 0, policy_version 758874 (0.0009) [2023-12-28 00:42:29,812][106226] Updated weights for policy 0, policy_version 758884 (0.0009) [2023-12-28 00:42:29,886][106226] Updated weights for policy 0, policy_version 758894 (0.0009) [2023-12-28 00:42:29,961][106226] Updated weights for policy 0, policy_version 758904 (0.0007) [2023-12-28 00:42:30,289][106225] Updated weights for policy 1, policy_version 760874 (0.0009) [2023-12-28 00:42:30,346][106225] Updated weights for policy 1, policy_version 760884 (0.0006) [2023-12-28 00:42:30,404][106225] Updated weights for policy 1, policy_version 760894 (0.0008) [2023-12-28 00:42:30,463][106225] Updated weights for policy 1, policy_version 760904 (0.0008) [2023-12-28 00:42:30,683][106226] Updated weights for policy 0, policy_version 758914 (0.0009) [2023-12-28 00:42:30,742][106226] Updated weights for policy 0, policy_version 758924 (0.0009) [2023-12-28 00:42:30,790][106226] Updated weights for policy 0, policy_version 758934 (0.0008) [2023-12-28 00:42:31,169][106225] Updated weights for policy 1, policy_version 760914 (0.0007) [2023-12-28 00:42:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 389169152. Throughput: 0: 10089.5, 1: 9783.9. Samples: 389161672. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:31,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-4.939')] [2023-12-28 00:42:31,224][106225] Updated weights for policy 1, policy_version 760924 (0.0005) [2023-12-28 00:42:31,282][106225] Updated weights for policy 1, policy_version 760934 (0.0008) [2023-12-28 00:42:31,590][106226] Updated weights for policy 0, policy_version 758944 (0.0008) [2023-12-28 00:42:31,653][106226] Updated weights for policy 0, policy_version 758954 (0.0008) [2023-12-28 00:42:31,722][106226] Updated weights for policy 0, policy_version 758964 (0.0009) [2023-12-28 00:42:31,960][106225] Updated weights for policy 1, policy_version 760944 (0.0008) [2023-12-28 00:42:32,015][106225] Updated weights for policy 1, policy_version 760954 (0.0008) [2023-12-28 00:42:32,069][106225] Updated weights for policy 1, policy_version 760964 (0.0009) [2023-12-28 00:42:32,347][106226] Updated weights for policy 0, policy_version 758974 (0.0008) [2023-12-28 00:42:32,413][106226] Updated weights for policy 0, policy_version 758984 (0.0008) [2023-12-28 00:42:32,479][106226] Updated weights for policy 0, policy_version 758994 (0.0009) [2023-12-28 00:42:32,779][106225] Updated weights for policy 1, policy_version 760974 (0.0008) [2023-12-28 00:42:32,831][106225] Updated weights for policy 1, policy_version 760984 (0.0008) [2023-12-28 00:42:32,888][106225] Updated weights for policy 1, policy_version 760994 (0.0007) [2023-12-28 00:42:33,248][106226] Updated weights for policy 0, policy_version 759004 (0.0009) [2023-12-28 00:42:33,299][106226] Updated weights for policy 0, policy_version 759014 (0.0010) [2023-12-28 00:42:33,348][106226] Updated weights for policy 0, policy_version 759024 (0.0008) [2023-12-28 00:42:33,481][106225] Updated weights for policy 1, policy_version 761004 (0.0006) [2023-12-28 00:42:33,535][106225] Updated weights for policy 1, policy_version 761014 (0.0008) [2023-12-28 00:42:33,593][106225] Updated weights for policy 1, policy_version 761024 (0.0006) [2023-12-28 00:42:34,152][106226] Updated weights for policy 0, policy_version 759034 (0.0008) [2023-12-28 00:42:34,202][106225] Updated weights for policy 1, policy_version 761034 (0.0006) [2023-12-28 00:42:34,213][106226] Updated weights for policy 0, policy_version 759044 (0.0008) [2023-12-28 00:42:34,264][106225] Updated weights for policy 1, policy_version 761044 (0.0008) [2023-12-28 00:42:34,272][106226] Updated weights for policy 0, policy_version 759054 (0.0008) [2023-12-28 00:42:34,330][106225] Updated weights for policy 1, policy_version 761054 (0.0007) [2023-12-28 00:42:34,336][106226] Updated weights for policy 0, policy_version 759064 (0.0009) [2023-12-28 00:42:34,383][106225] Updated weights for policy 1, policy_version 761064 (0.0005) [2023-12-28 00:42:35,019][106225] Updated weights for policy 1, policy_version 761074 (0.0005) [2023-12-28 00:42:35,077][106225] Updated weights for policy 1, policy_version 761084 (0.0005) [2023-12-28 00:42:35,093][106226] Updated weights for policy 0, policy_version 759074 (0.0008) [2023-12-28 00:42:35,136][106225] Updated weights for policy 1, policy_version 761094 (0.0007) [2023-12-28 00:42:35,143][106226] Updated weights for policy 0, policy_version 759084 (0.0005) [2023-12-28 00:42:35,200][106226] Updated weights for policy 0, policy_version 759094 (0.0009) [2023-12-28 00:42:35,663][106225] Updated weights for policy 1, policy_version 761104 (0.0007) [2023-12-28 00:42:35,721][106225] Updated weights for policy 1, policy_version 761114 (0.0009) [2023-12-28 00:42:35,774][106225] Updated weights for policy 1, policy_version 761124 (0.0010) [2023-12-28 00:42:35,818][106226] Updated weights for policy 0, policy_version 759104 (0.0007) [2023-12-28 00:42:35,878][106226] Updated weights for policy 0, policy_version 759114 (0.0008) [2023-12-28 00:42:35,941][106226] Updated weights for policy 0, policy_version 759124 (0.0008) [2023-12-28 00:42:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 389275648. Throughput: 0: 9994.7, 1: 9955.8. Samples: 389283208. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:36,176][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.819')] [2023-12-28 00:42:36,535][106225] Updated weights for policy 1, policy_version 761134 (0.0010) [2023-12-28 00:42:36,602][106225] Updated weights for policy 1, policy_version 761144 (0.0011) [2023-12-28 00:42:36,667][106225] Updated weights for policy 1, policy_version 761154 (0.0011) [2023-12-28 00:42:36,697][106226] Updated weights for policy 0, policy_version 759134 (0.0007) [2023-12-28 00:42:36,761][106226] Updated weights for policy 0, policy_version 759144 (0.0008) [2023-12-28 00:42:36,824][106226] Updated weights for policy 0, policy_version 759154 (0.0007) [2023-12-28 00:42:37,359][106225] Updated weights for policy 1, policy_version 761164 (0.0010) [2023-12-28 00:42:37,405][106225] Updated weights for policy 1, policy_version 761174 (0.0010) [2023-12-28 00:42:37,462][106225] Updated weights for policy 1, policy_version 761184 (0.0010) [2023-12-28 00:42:37,566][106226] Updated weights for policy 0, policy_version 759164 (0.0008) [2023-12-28 00:42:37,626][106226] Updated weights for policy 0, policy_version 759174 (0.0008) [2023-12-28 00:42:37,688][106226] Updated weights for policy 0, policy_version 759184 (0.0008) [2023-12-28 00:42:38,186][106225] Updated weights for policy 1, policy_version 761194 (0.0010) [2023-12-28 00:42:38,242][106225] Updated weights for policy 1, policy_version 761204 (0.0010) [2023-12-28 00:42:38,297][106225] Updated weights for policy 1, policy_version 761214 (0.0010) [2023-12-28 00:42:38,364][106225] Updated weights for policy 1, policy_version 761224 (0.0009) [2023-12-28 00:42:38,420][106226] Updated weights for policy 0, policy_version 759194 (0.0008) [2023-12-28 00:42:38,486][106226] Updated weights for policy 0, policy_version 759204 (0.0005) [2023-12-28 00:42:38,549][106226] Updated weights for policy 0, policy_version 759214 (0.0006) [2023-12-28 00:42:38,611][106226] Updated weights for policy 0, policy_version 759224 (0.0007) [2023-12-28 00:42:39,068][106225] Updated weights for policy 1, policy_version 761234 (0.0010) [2023-12-28 00:42:39,114][106225] Updated weights for policy 1, policy_version 761244 (0.0010) [2023-12-28 00:42:39,165][106225] Updated weights for policy 1, policy_version 761254 (0.0010) [2023-12-28 00:42:39,221][106226] Updated weights for policy 0, policy_version 759234 (0.0006) [2023-12-28 00:42:39,292][106226] Updated weights for policy 0, policy_version 759244 (0.0011) [2023-12-28 00:42:39,367][106226] Updated weights for policy 0, policy_version 759254 (0.0010) [2023-12-28 00:42:39,963][106225] Updated weights for policy 1, policy_version 761264 (0.0009) [2023-12-28 00:42:40,030][106225] Updated weights for policy 1, policy_version 761274 (0.0008) [2023-12-28 00:42:40,092][106225] Updated weights for policy 1, policy_version 761284 (0.0007) [2023-12-28 00:42:40,106][106226] Updated weights for policy 0, policy_version 759264 (0.0008) [2023-12-28 00:42:40,160][106226] Updated weights for policy 0, policy_version 759274 (0.0008) [2023-12-28 00:42:40,214][106226] Updated weights for policy 0, policy_version 759284 (0.0009) [2023-12-28 00:42:40,794][106225] Updated weights for policy 1, policy_version 761294 (0.0007) [2023-12-28 00:42:40,840][106225] Updated weights for policy 1, policy_version 761304 (0.0006) [2023-12-28 00:42:40,886][106225] Updated weights for policy 1, policy_version 761314 (0.0010) [2023-12-28 00:42:40,985][106226] Updated weights for policy 0, policy_version 759294 (0.0007) [2023-12-28 00:42:41,055][106226] Updated weights for policy 0, policy_version 759304 (0.0008) [2023-12-28 00:42:41,109][106226] Updated weights for policy 0, policy_version 759314 (0.0009) [2023-12-28 00:42:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 389373952. Throughput: 0: 9967.5, 1: 9969.5. Samples: 389340956. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:41,175][105115] Avg episode reward: [(0, '-4.910'), (1, '-4.922')] [2023-12-28 00:42:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000759320_194437120.pth... [2023-12-28 00:42:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000761320_194936832.pth... [2023-12-28 00:42:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000758136_194134016.pth [2023-12-28 00:42:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000760136_194633728.pth [2023-12-28 00:42:41,658][106225] Updated weights for policy 1, policy_version 761324 (0.0009) [2023-12-28 00:42:41,726][106225] Updated weights for policy 1, policy_version 761334 (0.0009) [2023-12-28 00:42:41,792][106225] Updated weights for policy 1, policy_version 761344 (0.0010) [2023-12-28 00:42:41,922][106226] Updated weights for policy 0, policy_version 759324 (0.0009) [2023-12-28 00:42:41,985][106226] Updated weights for policy 0, policy_version 759334 (0.0009) [2023-12-28 00:42:42,054][106226] Updated weights for policy 0, policy_version 759344 (0.0009) [2023-12-28 00:42:42,474][106225] Updated weights for policy 1, policy_version 761354 (0.0009) [2023-12-28 00:42:42,535][106225] Updated weights for policy 1, policy_version 761364 (0.0008) [2023-12-28 00:42:42,583][106225] Updated weights for policy 1, policy_version 761374 (0.0008) [2023-12-28 00:42:42,639][106225] Updated weights for policy 1, policy_version 761384 (0.0008) [2023-12-28 00:42:42,798][106226] Updated weights for policy 0, policy_version 759354 (0.0009) [2023-12-28 00:42:42,861][106226] Updated weights for policy 0, policy_version 759364 (0.0009) [2023-12-28 00:42:42,918][106226] Updated weights for policy 0, policy_version 759374 (0.0009) [2023-12-28 00:42:42,968][106226] Updated weights for policy 0, policy_version 759384 (0.0009) [2023-12-28 00:42:43,283][106225] Updated weights for policy 1, policy_version 761394 (0.0008) [2023-12-28 00:42:43,341][106225] Updated weights for policy 1, policy_version 761404 (0.0008) [2023-12-28 00:42:43,388][106225] Updated weights for policy 1, policy_version 761414 (0.0008) [2023-12-28 00:42:43,803][106226] Updated weights for policy 0, policy_version 759394 (0.0010) [2023-12-28 00:42:43,866][106226] Updated weights for policy 0, policy_version 759404 (0.0010) [2023-12-28 00:42:43,928][106226] Updated weights for policy 0, policy_version 759414 (0.0011) [2023-12-28 00:42:43,982][106225] Updated weights for policy 1, policy_version 761424 (0.0006) [2023-12-28 00:42:44,044][106225] Updated weights for policy 1, policy_version 761434 (0.0006) [2023-12-28 00:42:44,102][106225] Updated weights for policy 1, policy_version 761444 (0.0006) [2023-12-28 00:42:44,555][106226] Updated weights for policy 0, policy_version 759424 (0.0010) [2023-12-28 00:42:44,609][106226] Updated weights for policy 0, policy_version 759434 (0.0010) [2023-12-28 00:42:44,675][106226] Updated weights for policy 0, policy_version 759444 (0.0006) [2023-12-28 00:42:44,745][106225] Updated weights for policy 1, policy_version 761454 (0.0007) [2023-12-28 00:42:44,811][106225] Updated weights for policy 1, policy_version 761464 (0.0008) [2023-12-28 00:42:44,869][106225] Updated weights for policy 1, policy_version 761474 (0.0010) [2023-12-28 00:42:45,360][106226] Updated weights for policy 0, policy_version 759454 (0.0009) [2023-12-28 00:42:45,425][106226] Updated weights for policy 0, policy_version 759464 (0.0011) [2023-12-28 00:42:45,482][106226] Updated weights for policy 0, policy_version 759474 (0.0010) [2023-12-28 00:42:45,632][106225] Updated weights for policy 1, policy_version 761484 (0.0009) [2023-12-28 00:42:45,690][106225] Updated weights for policy 1, policy_version 761494 (0.0008) [2023-12-28 00:42:45,753][106225] Updated weights for policy 1, policy_version 761504 (0.0007) [2023-12-28 00:42:46,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 389464064. Throughput: 0: 9907.4, 1: 9984.0. Samples: 389456808. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:46,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-5.270')] [2023-12-28 00:42:46,212][106226] Updated weights for policy 0, policy_version 759484 (0.0011) [2023-12-28 00:42:46,272][106226] Updated weights for policy 0, policy_version 759494 (0.0011) [2023-12-28 00:42:46,334][106226] Updated weights for policy 0, policy_version 759504 (0.0010) [2023-12-28 00:42:46,474][106225] Updated weights for policy 1, policy_version 761514 (0.0008) [2023-12-28 00:42:46,540][106225] Updated weights for policy 1, policy_version 761524 (0.0008) [2023-12-28 00:42:46,597][106225] Updated weights for policy 1, policy_version 761534 (0.0008) [2023-12-28 00:42:46,649][106225] Updated weights for policy 1, policy_version 761544 (0.0008) [2023-12-28 00:42:47,029][106226] Updated weights for policy 0, policy_version 759514 (0.0009) [2023-12-28 00:42:47,091][106226] Updated weights for policy 0, policy_version 759524 (0.0005) [2023-12-28 00:42:47,149][106226] Updated weights for policy 0, policy_version 759534 (0.0006) [2023-12-28 00:42:47,201][106226] Updated weights for policy 0, policy_version 759544 (0.0008) [2023-12-28 00:42:47,393][106225] Updated weights for policy 1, policy_version 761554 (0.0007) [2023-12-28 00:42:47,437][106225] Updated weights for policy 1, policy_version 761564 (0.0007) [2023-12-28 00:42:47,484][106225] Updated weights for policy 1, policy_version 761574 (0.0008) [2023-12-28 00:42:47,851][106226] Updated weights for policy 0, policy_version 759554 (0.0005) [2023-12-28 00:42:47,906][106226] Updated weights for policy 0, policy_version 759564 (0.0005) [2023-12-28 00:42:47,960][106226] Updated weights for policy 0, policy_version 759574 (0.0011) [2023-12-28 00:42:48,131][106225] Updated weights for policy 1, policy_version 761584 (0.0010) [2023-12-28 00:42:48,188][106225] Updated weights for policy 1, policy_version 761594 (0.0010) [2023-12-28 00:42:48,234][106225] Updated weights for policy 1, policy_version 761604 (0.0007) [2023-12-28 00:42:48,574][106226] Updated weights for policy 0, policy_version 759584 (0.0009) [2023-12-28 00:42:48,639][106226] Updated weights for policy 0, policy_version 759594 (0.0008) [2023-12-28 00:42:48,707][106226] Updated weights for policy 0, policy_version 759604 (0.0008) [2023-12-28 00:42:48,884][106225] Updated weights for policy 1, policy_version 761614 (0.0005) [2023-12-28 00:42:48,950][106225] Updated weights for policy 1, policy_version 761624 (0.0009) [2023-12-28 00:42:49,011][106225] Updated weights for policy 1, policy_version 761634 (0.0010) [2023-12-28 00:42:49,448][106226] Updated weights for policy 0, policy_version 759614 (0.0008) [2023-12-28 00:42:49,500][106226] Updated weights for policy 0, policy_version 759624 (0.0008) [2023-12-28 00:42:49,551][106226] Updated weights for policy 0, policy_version 759634 (0.0009) [2023-12-28 00:42:49,712][106225] Updated weights for policy 1, policy_version 761644 (0.0007) [2023-12-28 00:42:49,777][106225] Updated weights for policy 1, policy_version 761654 (0.0009) [2023-12-28 00:42:49,837][106225] Updated weights for policy 1, policy_version 761664 (0.0010) [2023-12-28 00:42:50,312][106226] Updated weights for policy 0, policy_version 759644 (0.0008) [2023-12-28 00:42:50,380][106226] Updated weights for policy 0, policy_version 759654 (0.0007) [2023-12-28 00:42:50,437][106226] Updated weights for policy 0, policy_version 759664 (0.0009) [2023-12-28 00:42:50,562][106225] Updated weights for policy 1, policy_version 761674 (0.0010) [2023-12-28 00:42:50,626][106225] Updated weights for policy 1, policy_version 761684 (0.0008) [2023-12-28 00:42:50,690][106225] Updated weights for policy 1, policy_version 761694 (0.0008) [2023-12-28 00:42:50,754][106225] Updated weights for policy 1, policy_version 761704 (0.0008) [2023-12-28 00:42:51,173][106226] Updated weights for policy 0, policy_version 759674 (0.0008) [2023-12-28 00:42:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 389562368. Throughput: 0: 9818.1, 1: 9952.0. Samples: 389573852. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:51,175][105115] Avg episode reward: [(0, '-4.295'), (1, '-4.894')] [2023-12-28 00:42:51,241][106226] Updated weights for policy 0, policy_version 759684 (0.0008) [2023-12-28 00:42:51,306][106226] Updated weights for policy 0, policy_version 759694 (0.0009) [2023-12-28 00:42:51,373][106226] Updated weights for policy 0, policy_version 759704 (0.0007) [2023-12-28 00:42:51,446][106225] Updated weights for policy 1, policy_version 761714 (0.0008) [2023-12-28 00:42:51,501][106225] Updated weights for policy 1, policy_version 761724 (0.0008) [2023-12-28 00:42:51,554][106225] Updated weights for policy 1, policy_version 761734 (0.0010) [2023-12-28 00:42:52,095][106226] Updated weights for policy 0, policy_version 759714 (0.0006) [2023-12-28 00:42:52,145][106226] Updated weights for policy 0, policy_version 759724 (0.0010) [2023-12-28 00:42:52,195][106226] Updated weights for policy 0, policy_version 759734 (0.0010) [2023-12-28 00:42:52,327][106225] Updated weights for policy 1, policy_version 761744 (0.0008) [2023-12-28 00:42:52,383][106225] Updated weights for policy 1, policy_version 761754 (0.0006) [2023-12-28 00:42:52,449][106225] Updated weights for policy 1, policy_version 761764 (0.0005) [2023-12-28 00:42:52,913][106226] Updated weights for policy 0, policy_version 759744 (0.0008) [2023-12-28 00:42:52,957][106226] Updated weights for policy 0, policy_version 759754 (0.0007) [2023-12-28 00:42:53,010][106226] Updated weights for policy 0, policy_version 759764 (0.0006) [2023-12-28 00:42:53,093][106225] Updated weights for policy 1, policy_version 761774 (0.0008) [2023-12-28 00:42:53,149][106225] Updated weights for policy 1, policy_version 761784 (0.0010) [2023-12-28 00:42:53,203][106225] Updated weights for policy 1, policy_version 761794 (0.0010) [2023-12-28 00:42:53,630][106226] Updated weights for policy 0, policy_version 759774 (0.0007) [2023-12-28 00:42:53,676][106226] Updated weights for policy 0, policy_version 759784 (0.0007) [2023-12-28 00:42:53,722][106226] Updated weights for policy 0, policy_version 759794 (0.0007) [2023-12-28 00:42:53,889][106225] Updated weights for policy 1, policy_version 761804 (0.0010) [2023-12-28 00:42:53,936][106225] Updated weights for policy 1, policy_version 761814 (0.0010) [2023-12-28 00:42:53,985][106225] Updated weights for policy 1, policy_version 761824 (0.0010) [2023-12-28 00:42:54,443][106226] Updated weights for policy 0, policy_version 759804 (0.0009) [2023-12-28 00:42:54,504][106226] Updated weights for policy 0, policy_version 759814 (0.0007) [2023-12-28 00:42:54,560][106226] Updated weights for policy 0, policy_version 759824 (0.0010) [2023-12-28 00:42:54,742][106225] Updated weights for policy 1, policy_version 761834 (0.0011) [2023-12-28 00:42:54,790][106225] Updated weights for policy 1, policy_version 761844 (0.0005) [2023-12-28 00:42:54,846][106225] Updated weights for policy 1, policy_version 761854 (0.0005) [2023-12-28 00:42:54,897][106225] Updated weights for policy 1, policy_version 761864 (0.0005) [2023-12-28 00:42:55,208][106226] Updated weights for policy 0, policy_version 759834 (0.0009) [2023-12-28 00:42:55,278][106226] Updated weights for policy 0, policy_version 759844 (0.0005) [2023-12-28 00:42:55,331][106226] Updated weights for policy 0, policy_version 759854 (0.0005) [2023-12-28 00:42:55,383][106226] Updated weights for policy 0, policy_version 759864 (0.0008) [2023-12-28 00:42:55,505][106225] Updated weights for policy 1, policy_version 761874 (0.0010) [2023-12-28 00:42:55,551][106225] Updated weights for policy 1, policy_version 761884 (0.0008) [2023-12-28 00:42:55,604][106225] Updated weights for policy 1, policy_version 761894 (0.0005) [2023-12-28 00:42:55,950][106226] Updated weights for policy 0, policy_version 759874 (0.0007) [2023-12-28 00:42:56,020][106226] Updated weights for policy 0, policy_version 759884 (0.0006) [2023-12-28 00:42:56,078][106226] Updated weights for policy 0, policy_version 759894 (0.0010) [2023-12-28 00:42:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 389668864. Throughput: 0: 9854.1, 1: 9985.4. Samples: 389633860. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:42:56,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.961')] [2023-12-28 00:42:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000759896_194584576.pth... [2023-12-28 00:42:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000758744_194289664.pth [2023-12-28 00:42:56,202][106225] Updated weights for policy 1, policy_version 761904 (0.0009) [2023-12-28 00:42:56,259][106225] Updated weights for policy 1, policy_version 761914 (0.0010) [2023-12-28 00:42:56,340][106225] Updated weights for policy 1, policy_version 761924 (0.0010) [2023-12-28 00:42:56,363][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000761928_195092480.pth... [2023-12-28 00:42:56,367][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000760712_194781184.pth [2023-12-28 00:42:56,702][106226] Updated weights for policy 0, policy_version 759904 (0.0010) [2023-12-28 00:42:56,757][106226] Updated weights for policy 0, policy_version 759914 (0.0010) [2023-12-28 00:42:56,819][106226] Updated weights for policy 0, policy_version 759924 (0.0010) [2023-12-28 00:42:57,035][106225] Updated weights for policy 1, policy_version 761934 (0.0010) [2023-12-28 00:42:57,095][106225] Updated weights for policy 1, policy_version 761944 (0.0010) [2023-12-28 00:42:57,143][106225] Updated weights for policy 1, policy_version 761954 (0.0005) [2023-12-28 00:42:57,526][106226] Updated weights for policy 0, policy_version 759934 (0.0010) [2023-12-28 00:42:57,588][106226] Updated weights for policy 0, policy_version 759944 (0.0010) [2023-12-28 00:42:57,653][106226] Updated weights for policy 0, policy_version 759954 (0.0010) [2023-12-28 00:42:57,798][106225] Updated weights for policy 1, policy_version 761964 (0.0008) [2023-12-28 00:42:57,854][106225] Updated weights for policy 1, policy_version 761974 (0.0010) [2023-12-28 00:42:57,900][106225] Updated weights for policy 1, policy_version 761984 (0.0010) [2023-12-28 00:42:58,333][106226] Updated weights for policy 0, policy_version 759964 (0.0009) [2023-12-28 00:42:58,397][106226] Updated weights for policy 0, policy_version 759974 (0.0006) [2023-12-28 00:42:58,458][106226] Updated weights for policy 0, policy_version 759984 (0.0009) [2023-12-28 00:42:58,662][106225] Updated weights for policy 1, policy_version 761994 (0.0010) [2023-12-28 00:42:58,732][106225] Updated weights for policy 1, policy_version 762004 (0.0009) [2023-12-28 00:42:58,795][106225] Updated weights for policy 1, policy_version 762014 (0.0009) [2023-12-28 00:42:58,863][106225] Updated weights for policy 1, policy_version 762024 (0.0009) [2023-12-28 00:42:59,401][106226] Updated weights for policy 0, policy_version 759994 (0.0008) [2023-12-28 00:42:59,456][106226] Updated weights for policy 0, policy_version 760004 (0.0006) [2023-12-28 00:42:59,512][106226] Updated weights for policy 0, policy_version 760014 (0.0010) [2023-12-28 00:42:59,577][106226] Updated weights for policy 0, policy_version 760024 (0.0008) [2023-12-28 00:42:59,744][106225] Updated weights for policy 1, policy_version 762035 (0.0009) [2023-12-28 00:42:59,798][106225] Updated weights for policy 1, policy_version 762045 (0.0008) [2023-12-28 00:42:59,857][106225] Updated weights for policy 1, policy_version 762055 (0.0009) [2023-12-28 00:43:00,221][106226] Updated weights for policy 0, policy_version 760034 (0.0011) [2023-12-28 00:43:00,272][106226] Updated weights for policy 0, policy_version 760044 (0.0010) [2023-12-28 00:43:00,326][106226] Updated weights for policy 0, policy_version 760054 (0.0011) [2023-12-28 00:43:00,547][106225] Updated weights for policy 1, policy_version 762065 (0.0008) [2023-12-28 00:43:00,602][106225] Updated weights for policy 1, policy_version 762075 (0.0008) [2023-12-28 00:43:00,651][106225] Updated weights for policy 1, policy_version 762085 (0.0008) [2023-12-28 00:43:00,950][106226] Updated weights for policy 0, policy_version 760064 (0.0009) [2023-12-28 00:43:01,010][106226] Updated weights for policy 0, policy_version 760074 (0.0009) [2023-12-28 00:43:01,065][106226] Updated weights for policy 0, policy_version 760084 (0.0009) [2023-12-28 00:43:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 389767168. Throughput: 0: 9819.6, 1: 10051.2. Samples: 389753292. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:01,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.862')] [2023-12-28 00:43:01,390][106225] Updated weights for policy 1, policy_version 762095 (0.0008) [2023-12-28 00:43:01,450][106225] Updated weights for policy 1, policy_version 762105 (0.0006) [2023-12-28 00:43:01,505][106225] Updated weights for policy 1, policy_version 762115 (0.0005) [2023-12-28 00:43:01,817][106226] Updated weights for policy 0, policy_version 760094 (0.0008) [2023-12-28 00:43:01,879][106226] Updated weights for policy 0, policy_version 760104 (0.0008) [2023-12-28 00:43:01,940][106226] Updated weights for policy 0, policy_version 760114 (0.0007) [2023-12-28 00:43:02,233][106225] Updated weights for policy 1, policy_version 762125 (0.0006) [2023-12-28 00:43:02,302][106225] Updated weights for policy 1, policy_version 762135 (0.0007) [2023-12-28 00:43:02,365][106225] Updated weights for policy 1, policy_version 762145 (0.0008) [2023-12-28 00:43:02,583][106226] Updated weights for policy 0, policy_version 760124 (0.0007) [2023-12-28 00:43:02,635][106226] Updated weights for policy 0, policy_version 760134 (0.0008) [2023-12-28 00:43:02,683][106226] Updated weights for policy 0, policy_version 760144 (0.0008) [2023-12-28 00:43:03,116][106225] Updated weights for policy 1, policy_version 762155 (0.0008) [2023-12-28 00:43:03,176][106225] Updated weights for policy 1, policy_version 762165 (0.0005) [2023-12-28 00:43:03,235][106225] Updated weights for policy 1, policy_version 762175 (0.0009) [2023-12-28 00:43:03,390][106226] Updated weights for policy 0, policy_version 760154 (0.0008) [2023-12-28 00:43:03,446][106226] Updated weights for policy 0, policy_version 760164 (0.0007) [2023-12-28 00:43:03,505][106226] Updated weights for policy 0, policy_version 760174 (0.0007) [2023-12-28 00:43:03,551][106226] Updated weights for policy 0, policy_version 760184 (0.0006) [2023-12-28 00:43:04,001][106225] Updated weights for policy 1, policy_version 762185 (0.0008) [2023-12-28 00:43:04,061][106225] Updated weights for policy 1, policy_version 762195 (0.0009) [2023-12-28 00:43:04,119][106226] Updated weights for policy 0, policy_version 760194 (0.0006) [2023-12-28 00:43:04,120][106225] Updated weights for policy 1, policy_version 762205 (0.0008) [2023-12-28 00:43:04,177][106225] Updated weights for policy 1, policy_version 762215 (0.0007) [2023-12-28 00:43:04,178][106226] Updated weights for policy 0, policy_version 760204 (0.0008) [2023-12-28 00:43:04,241][106226] Updated weights for policy 0, policy_version 760214 (0.0009) [2023-12-28 00:43:04,915][106226] Updated weights for policy 0, policy_version 760224 (0.0008) [2023-12-28 00:43:04,958][106225] Updated weights for policy 1, policy_version 762225 (0.0008) [2023-12-28 00:43:04,977][106226] Updated weights for policy 0, policy_version 760234 (0.0010) [2023-12-28 00:43:05,020][106225] Updated weights for policy 1, policy_version 762235 (0.0008) [2023-12-28 00:43:05,029][106226] Updated weights for policy 0, policy_version 760244 (0.0011) [2023-12-28 00:43:05,082][106225] Updated weights for policy 1, policy_version 762245 (0.0007) [2023-12-28 00:43:05,685][106226] Updated weights for policy 0, policy_version 760254 (0.0007) [2023-12-28 00:43:05,738][106226] Updated weights for policy 0, policy_version 760264 (0.0009) [2023-12-28 00:43:05,788][106226] Updated weights for policy 0, policy_version 760274 (0.0010) [2023-12-28 00:43:05,794][106225] Updated weights for policy 1, policy_version 762255 (0.0006) [2023-12-28 00:43:05,853][106225] Updated weights for policy 1, policy_version 762265 (0.0007) [2023-12-28 00:43:05,919][106225] Updated weights for policy 1, policy_version 762275 (0.0008) [2023-12-28 00:43:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 389865472. Throughput: 0: 9867.5, 1: 9980.5. Samples: 389872184. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:06,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.275')] [2023-12-28 00:43:06,536][106226] Updated weights for policy 0, policy_version 760284 (0.0011) [2023-12-28 00:43:06,601][106226] Updated weights for policy 0, policy_version 760294 (0.0011) [2023-12-28 00:43:06,663][106226] Updated weights for policy 0, policy_version 760304 (0.0011) [2023-12-28 00:43:06,665][106225] Updated weights for policy 1, policy_version 762285 (0.0007) [2023-12-28 00:43:06,724][106225] Updated weights for policy 1, policy_version 762295 (0.0007) [2023-12-28 00:43:06,778][106225] Updated weights for policy 1, policy_version 762305 (0.0008) [2023-12-28 00:43:07,266][106226] Updated weights for policy 0, policy_version 760314 (0.0010) [2023-12-28 00:43:07,333][106226] Updated weights for policy 0, policy_version 760324 (0.0007) [2023-12-28 00:43:07,388][106226] Updated weights for policy 0, policy_version 760334 (0.0011) [2023-12-28 00:43:07,446][106226] Updated weights for policy 0, policy_version 760344 (0.0011) [2023-12-28 00:43:07,593][106225] Updated weights for policy 1, policy_version 762315 (0.0008) [2023-12-28 00:43:07,646][106225] Updated weights for policy 1, policy_version 762325 (0.0008) [2023-12-28 00:43:07,704][106225] Updated weights for policy 1, policy_version 762335 (0.0008) [2023-12-28 00:43:08,173][106226] Updated weights for policy 0, policy_version 760354 (0.0011) [2023-12-28 00:43:08,223][106226] Updated weights for policy 0, policy_version 760364 (0.0010) [2023-12-28 00:43:08,268][106226] Updated weights for policy 0, policy_version 760374 (0.0009) [2023-12-28 00:43:08,456][106225] Updated weights for policy 1, policy_version 762345 (0.0008) [2023-12-28 00:43:08,514][106225] Updated weights for policy 1, policy_version 762355 (0.0008) [2023-12-28 00:43:08,573][106225] Updated weights for policy 1, policy_version 762365 (0.0007) [2023-12-28 00:43:08,625][106225] Updated weights for policy 1, policy_version 762375 (0.0007) [2023-12-28 00:43:08,961][106226] Updated weights for policy 0, policy_version 760384 (0.0010) [2023-12-28 00:43:09,027][106226] Updated weights for policy 0, policy_version 760394 (0.0011) [2023-12-28 00:43:09,088][106226] Updated weights for policy 0, policy_version 760404 (0.0011) [2023-12-28 00:43:09,389][106225] Updated weights for policy 1, policy_version 762385 (0.0007) [2023-12-28 00:43:09,456][106225] Updated weights for policy 1, policy_version 762395 (0.0006) [2023-12-28 00:43:09,520][106225] Updated weights for policy 1, policy_version 762405 (0.0006) [2023-12-28 00:43:09,817][106226] Updated weights for policy 0, policy_version 760414 (0.0008) [2023-12-28 00:43:09,883][106226] Updated weights for policy 0, policy_version 760424 (0.0008) [2023-12-28 00:43:09,952][106226] Updated weights for policy 0, policy_version 760434 (0.0007) [2023-12-28 00:43:10,277][106225] Updated weights for policy 1, policy_version 762415 (0.0009) [2023-12-28 00:43:10,341][106225] Updated weights for policy 1, policy_version 762425 (0.0010) [2023-12-28 00:43:10,404][106225] Updated weights for policy 1, policy_version 762435 (0.0007) [2023-12-28 00:43:10,651][106226] Updated weights for policy 0, policy_version 760444 (0.0009) [2023-12-28 00:43:10,710][106226] Updated weights for policy 0, policy_version 760454 (0.0009) [2023-12-28 00:43:10,767][106226] Updated weights for policy 0, policy_version 760464 (0.0008) [2023-12-28 00:43:11,167][106225] Updated weights for policy 1, policy_version 762445 (0.0009) [2023-12-28 00:43:11,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 389955584. Throughput: 0: 9890.0, 1: 9943.4. Samples: 389929528. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:11,176][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.234')] [2023-12-28 00:43:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000760472_194732032.pth... [2023-12-28 00:43:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000759320_194437120.pth [2023-12-28 00:43:11,235][106225] Updated weights for policy 1, policy_version 762455 (0.0008) [2023-12-28 00:43:11,300][106225] Updated weights for policy 1, policy_version 762465 (0.0009) [2023-12-28 00:43:11,350][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000762472_195231744.pth... [2023-12-28 00:43:11,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000761320_194936832.pth [2023-12-28 00:43:11,536][106226] Updated weights for policy 0, policy_version 760474 (0.0008) [2023-12-28 00:43:11,598][106226] Updated weights for policy 0, policy_version 760484 (0.0009) [2023-12-28 00:43:11,664][106226] Updated weights for policy 0, policy_version 760494 (0.0008) [2023-12-28 00:43:11,733][106226] Updated weights for policy 0, policy_version 760504 (0.0009) [2023-12-28 00:43:12,064][106225] Updated weights for policy 1, policy_version 762475 (0.0008) [2023-12-28 00:43:12,119][106225] Updated weights for policy 1, policy_version 762485 (0.0005) [2023-12-28 00:43:12,180][106225] Updated weights for policy 1, policy_version 762495 (0.0006) [2023-12-28 00:43:12,476][106226] Updated weights for policy 0, policy_version 760514 (0.0005) [2023-12-28 00:43:12,533][106226] Updated weights for policy 0, policy_version 760524 (0.0005) [2023-12-28 00:43:12,584][106226] Updated weights for policy 0, policy_version 760534 (0.0005) [2023-12-28 00:43:12,842][106225] Updated weights for policy 1, policy_version 762505 (0.0006) [2023-12-28 00:43:12,895][106225] Updated weights for policy 1, policy_version 762515 (0.0009) [2023-12-28 00:43:12,954][106225] Updated weights for policy 1, policy_version 762525 (0.0008) [2023-12-28 00:43:13,003][106225] Updated weights for policy 1, policy_version 762535 (0.0009) [2023-12-28 00:43:13,210][106226] Updated weights for policy 0, policy_version 760544 (0.0008) [2023-12-28 00:43:13,271][106226] Updated weights for policy 0, policy_version 760554 (0.0008) [2023-12-28 00:43:13,332][106226] Updated weights for policy 0, policy_version 760564 (0.0009) [2023-12-28 00:43:13,755][106225] Updated weights for policy 1, policy_version 762545 (0.0010) [2023-12-28 00:43:13,806][106225] Updated weights for policy 1, policy_version 762555 (0.0010) [2023-12-28 00:43:13,856][106225] Updated weights for policy 1, policy_version 762565 (0.0009) [2023-12-28 00:43:13,968][106226] Updated weights for policy 0, policy_version 760574 (0.0008) [2023-12-28 00:43:14,033][106226] Updated weights for policy 0, policy_version 760584 (0.0007) [2023-12-28 00:43:14,093][106226] Updated weights for policy 0, policy_version 760594 (0.0008) [2023-12-28 00:43:14,579][106225] Updated weights for policy 1, policy_version 762575 (0.0010) [2023-12-28 00:43:14,635][106225] Updated weights for policy 1, policy_version 762585 (0.0010) [2023-12-28 00:43:14,691][106225] Updated weights for policy 1, policy_version 762595 (0.0010) [2023-12-28 00:43:14,736][106226] Updated weights for policy 0, policy_version 760604 (0.0007) [2023-12-28 00:43:14,805][106226] Updated weights for policy 0, policy_version 760614 (0.0008) [2023-12-28 00:43:14,860][106226] Updated weights for policy 0, policy_version 760624 (0.0008) [2023-12-28 00:43:15,415][106225] Updated weights for policy 1, policy_version 762605 (0.0008) [2023-12-28 00:43:15,466][106225] Updated weights for policy 1, policy_version 762615 (0.0008) [2023-12-28 00:43:15,529][106225] Updated weights for policy 1, policy_version 762625 (0.0007) [2023-12-28 00:43:15,586][106226] Updated weights for policy 0, policy_version 760634 (0.0009) [2023-12-28 00:43:15,653][106226] Updated weights for policy 0, policy_version 760644 (0.0011) [2023-12-28 00:43:15,718][106226] Updated weights for policy 0, policy_version 760654 (0.0011) [2023-12-28 00:43:15,787][106226] Updated weights for policy 0, policy_version 760664 (0.0011) [2023-12-28 00:43:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 390053888. Throughput: 0: 9825.5, 1: 9832.8. Samples: 390046296. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:16,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.150')] [2023-12-28 00:43:16,274][106225] Updated weights for policy 1, policy_version 762635 (0.0010) [2023-12-28 00:43:16,325][106225] Updated weights for policy 1, policy_version 762645 (0.0010) [2023-12-28 00:43:16,380][106225] Updated weights for policy 1, policy_version 762655 (0.0010) [2023-12-28 00:43:16,484][106226] Updated weights for policy 0, policy_version 760674 (0.0010) [2023-12-28 00:43:16,535][106226] Updated weights for policy 0, policy_version 760684 (0.0010) [2023-12-28 00:43:16,586][106226] Updated weights for policy 0, policy_version 760694 (0.0010) [2023-12-28 00:43:17,070][106225] Updated weights for policy 1, policy_version 762665 (0.0010) [2023-12-28 00:43:17,126][106225] Updated weights for policy 1, policy_version 762675 (0.0007) [2023-12-28 00:43:17,177][106225] Updated weights for policy 1, policy_version 762685 (0.0009) [2023-12-28 00:43:17,222][106225] Updated weights for policy 1, policy_version 762695 (0.0006) [2023-12-28 00:43:17,323][106226] Updated weights for policy 0, policy_version 760704 (0.0008) [2023-12-28 00:43:17,382][106226] Updated weights for policy 0, policy_version 760714 (0.0010) [2023-12-28 00:43:17,433][106226] Updated weights for policy 0, policy_version 760724 (0.0008) [2023-12-28 00:43:17,840][106225] Updated weights for policy 1, policy_version 762705 (0.0006) [2023-12-28 00:43:17,888][106225] Updated weights for policy 1, policy_version 762715 (0.0008) [2023-12-28 00:43:17,942][106225] Updated weights for policy 1, policy_version 762725 (0.0008) [2023-12-28 00:43:18,097][106226] Updated weights for policy 0, policy_version 760734 (0.0006) [2023-12-28 00:43:18,166][106226] Updated weights for policy 0, policy_version 760744 (0.0005) [2023-12-28 00:43:18,226][106226] Updated weights for policy 0, policy_version 760754 (0.0005) [2023-12-28 00:43:18,734][106225] Updated weights for policy 1, policy_version 762735 (0.0008) [2023-12-28 00:43:18,793][106225] Updated weights for policy 1, policy_version 762745 (0.0008) [2023-12-28 00:43:18,834][106226] Updated weights for policy 0, policy_version 760764 (0.0008) [2023-12-28 00:43:18,851][106225] Updated weights for policy 1, policy_version 762755 (0.0007) [2023-12-28 00:43:18,888][106226] Updated weights for policy 0, policy_version 760774 (0.0008) [2023-12-28 00:43:18,937][106226] Updated weights for policy 0, policy_version 760784 (0.0009) [2023-12-28 00:43:19,460][106225] Updated weights for policy 1, policy_version 762765 (0.0007) [2023-12-28 00:43:19,523][106225] Updated weights for policy 1, policy_version 762775 (0.0008) [2023-12-28 00:43:19,579][106225] Updated weights for policy 1, policy_version 762785 (0.0007) [2023-12-28 00:43:19,794][106226] Updated weights for policy 0, policy_version 760794 (0.0009) [2023-12-28 00:43:19,865][106226] Updated weights for policy 0, policy_version 760804 (0.0009) [2023-12-28 00:43:19,934][106226] Updated weights for policy 0, policy_version 760814 (0.0008) [2023-12-28 00:43:20,002][106226] Updated weights for policy 0, policy_version 760824 (0.0007) [2023-12-28 00:43:20,309][106225] Updated weights for policy 1, policy_version 762795 (0.0007) [2023-12-28 00:43:20,369][106225] Updated weights for policy 1, policy_version 762805 (0.0006) [2023-12-28 00:43:20,433][106225] Updated weights for policy 1, policy_version 762815 (0.0010) [2023-12-28 00:43:20,750][106226] Updated weights for policy 0, policy_version 760834 (0.0009) [2023-12-28 00:43:20,820][106226] Updated weights for policy 0, policy_version 760844 (0.0008) [2023-12-28 00:43:20,882][106226] Updated weights for policy 0, policy_version 760854 (0.0008) [2023-12-28 00:43:21,129][106225] Updated weights for policy 1, policy_version 762825 (0.0010) [2023-12-28 00:43:21,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 390152192. Throughput: 0: 9843.3, 1: 9720.8. Samples: 390163592. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:21,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.238')] [2023-12-28 00:43:21,194][106225] Updated weights for policy 1, policy_version 762835 (0.0007) [2023-12-28 00:43:21,260][106225] Updated weights for policy 1, policy_version 762845 (0.0008) [2023-12-28 00:43:21,322][106225] Updated weights for policy 1, policy_version 762855 (0.0007) [2023-12-28 00:43:21,676][106226] Updated weights for policy 0, policy_version 760864 (0.0008) [2023-12-28 00:43:21,754][106226] Updated weights for policy 0, policy_version 760874 (0.0008) [2023-12-28 00:43:21,822][106226] Updated weights for policy 0, policy_version 760884 (0.0007) [2023-12-28 00:43:22,036][106225] Updated weights for policy 1, policy_version 762865 (0.0008) [2023-12-28 00:43:22,099][106225] Updated weights for policy 1, policy_version 762875 (0.0008) [2023-12-28 00:43:22,159][106225] Updated weights for policy 1, policy_version 762885 (0.0009) [2023-12-28 00:43:22,536][106226] Updated weights for policy 0, policy_version 760894 (0.0008) [2023-12-28 00:43:22,601][106226] Updated weights for policy 0, policy_version 760904 (0.0008) [2023-12-28 00:43:22,668][106226] Updated weights for policy 0, policy_version 760914 (0.0007) [2023-12-28 00:43:22,842][106225] Updated weights for policy 1, policy_version 762895 (0.0007) [2023-12-28 00:43:22,901][106225] Updated weights for policy 1, policy_version 762905 (0.0006) [2023-12-28 00:43:22,960][106225] Updated weights for policy 1, policy_version 762915 (0.0006) [2023-12-28 00:43:23,485][106226] Updated weights for policy 0, policy_version 760924 (0.0008) [2023-12-28 00:43:23,507][106225] Updated weights for policy 1, policy_version 762925 (0.0006) [2023-12-28 00:43:23,552][106226] Updated weights for policy 0, policy_version 760934 (0.0008) [2023-12-28 00:43:23,559][106225] Updated weights for policy 1, policy_version 762935 (0.0006) [2023-12-28 00:43:23,615][106226] Updated weights for policy 0, policy_version 760944 (0.0007) [2023-12-28 00:43:23,617][106225] Updated weights for policy 1, policy_version 762945 (0.0005) [2023-12-28 00:43:24,190][106225] Updated weights for policy 1, policy_version 762955 (0.0006) [2023-12-28 00:43:24,248][106225] Updated weights for policy 1, policy_version 762965 (0.0006) [2023-12-28 00:43:24,264][106226] Updated weights for policy 0, policy_version 760954 (0.0006) [2023-12-28 00:43:24,312][106225] Updated weights for policy 1, policy_version 762975 (0.0005) [2023-12-28 00:43:24,318][106226] Updated weights for policy 0, policy_version 760964 (0.0008) [2023-12-28 00:43:24,383][106226] Updated weights for policy 0, policy_version 760974 (0.0007) [2023-12-28 00:43:24,447][106226] Updated weights for policy 0, policy_version 760984 (0.0009) [2023-12-28 00:43:24,965][106225] Updated weights for policy 1, policy_version 762985 (0.0007) [2023-12-28 00:43:25,017][106225] Updated weights for policy 1, policy_version 762995 (0.0006) [2023-12-28 00:43:25,078][106225] Updated weights for policy 1, policy_version 763005 (0.0008) [2023-12-28 00:43:25,120][106226] Updated weights for policy 0, policy_version 760994 (0.0006) [2023-12-28 00:43:25,130][106225] Updated weights for policy 1, policy_version 763015 (0.0007) [2023-12-28 00:43:25,173][106226] Updated weights for policy 0, policy_version 761004 (0.0007) [2023-12-28 00:43:25,228][106226] Updated weights for policy 0, policy_version 761014 (0.0009) [2023-12-28 00:43:25,736][106225] Updated weights for policy 1, policy_version 763025 (0.0008) [2023-12-28 00:43:25,798][106225] Updated weights for policy 1, policy_version 763036 (0.0010) [2023-12-28 00:43:25,855][106225] Updated weights for policy 1, policy_version 763046 (0.0009) [2023-12-28 00:43:25,948][106226] Updated weights for policy 0, policy_version 761024 (0.0006) [2023-12-28 00:43:26,007][106226] Updated weights for policy 0, policy_version 761034 (0.0005) [2023-12-28 00:43:26,068][106226] Updated weights for policy 0, policy_version 761044 (0.0005) [2023-12-28 00:43:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 390258688. Throughput: 0: 9806.3, 1: 9782.9. Samples: 390222472. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:26,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.783')] [2023-12-28 00:43:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000761048_194879488.pth... [2023-12-28 00:43:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000763048_195379200.pth... [2023-12-28 00:43:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000759896_194584576.pth [2023-12-28 00:43:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000761928_195092480.pth [2023-12-28 00:43:26,634][106225] Updated weights for policy 1, policy_version 763056 (0.0009) [2023-12-28 00:43:26,683][106226] Updated weights for policy 0, policy_version 761054 (0.0006) [2023-12-28 00:43:26,689][106225] Updated weights for policy 1, policy_version 763066 (0.0006) [2023-12-28 00:43:26,736][106226] Updated weights for policy 0, policy_version 761064 (0.0008) [2023-12-28 00:43:26,743][106225] Updated weights for policy 1, policy_version 763076 (0.0007) [2023-12-28 00:43:26,802][106226] Updated weights for policy 0, policy_version 761074 (0.0008) [2023-12-28 00:43:27,415][106226] Updated weights for policy 0, policy_version 761084 (0.0007) [2023-12-28 00:43:27,467][106226] Updated weights for policy 0, policy_version 761094 (0.0005) [2023-12-28 00:43:27,483][106225] Updated weights for policy 1, policy_version 763086 (0.0006) [2023-12-28 00:43:27,523][106226] Updated weights for policy 0, policy_version 761104 (0.0006) [2023-12-28 00:43:27,547][106225] Updated weights for policy 1, policy_version 763096 (0.0005) [2023-12-28 00:43:27,617][106225] Updated weights for policy 1, policy_version 763106 (0.0005) [2023-12-28 00:43:28,118][106226] Updated weights for policy 0, policy_version 761114 (0.0006) [2023-12-28 00:43:28,145][106225] Updated weights for policy 1, policy_version 763116 (0.0005) [2023-12-28 00:43:28,167][106226] Updated weights for policy 0, policy_version 761124 (0.0009) [2023-12-28 00:43:28,197][106225] Updated weights for policy 1, policy_version 763126 (0.0006) [2023-12-28 00:43:28,220][106226] Updated weights for policy 0, policy_version 761134 (0.0009) [2023-12-28 00:43:28,244][106225] Updated weights for policy 1, policy_version 763136 (0.0010) [2023-12-28 00:43:28,269][106226] Updated weights for policy 0, policy_version 761144 (0.0007) [2023-12-28 00:43:28,902][106225] Updated weights for policy 1, policy_version 763146 (0.0006) [2023-12-28 00:43:28,950][106225] Updated weights for policy 1, policy_version 763156 (0.0008) [2023-12-28 00:43:29,001][106225] Updated weights for policy 1, policy_version 763166 (0.0008) [2023-12-28 00:43:29,047][106226] Updated weights for policy 0, policy_version 761154 (0.0007) [2023-12-28 00:43:29,060][106225] Updated weights for policy 1, policy_version 763176 (0.0007) [2023-12-28 00:43:29,093][106226] Updated weights for policy 0, policy_version 761164 (0.0007) [2023-12-28 00:43:29,139][106226] Updated weights for policy 0, policy_version 761174 (0.0008) [2023-12-28 00:43:29,816][106225] Updated weights for policy 1, policy_version 763186 (0.0008) [2023-12-28 00:43:29,882][106225] Updated weights for policy 1, policy_version 763196 (0.0008) [2023-12-28 00:43:29,951][106225] Updated weights for policy 1, policy_version 763206 (0.0008) [2023-12-28 00:43:29,981][106226] Updated weights for policy 0, policy_version 761184 (0.0008) [2023-12-28 00:43:30,043][106226] Updated weights for policy 0, policy_version 761194 (0.0008) [2023-12-28 00:43:30,103][106226] Updated weights for policy 0, policy_version 761204 (0.0008) [2023-12-28 00:43:30,526][106225] Updated weights for policy 1, policy_version 763216 (0.0005) [2023-12-28 00:43:30,579][106225] Updated weights for policy 1, policy_version 763226 (0.0005) [2023-12-28 00:43:30,643][106225] Updated weights for policy 1, policy_version 763236 (0.0006) [2023-12-28 00:43:30,861][106226] Updated weights for policy 0, policy_version 761214 (0.0008) [2023-12-28 00:43:30,916][106226] Updated weights for policy 0, policy_version 761224 (0.0008) [2023-12-28 00:43:30,980][106226] Updated weights for policy 0, policy_version 761234 (0.0008) [2023-12-28 00:43:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 390356992. Throughput: 0: 9920.2, 1: 9840.0. Samples: 390346016. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:31,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.135')] [2023-12-28 00:43:31,286][106225] Updated weights for policy 1, policy_version 763246 (0.0008) [2023-12-28 00:43:31,343][106225] Updated weights for policy 1, policy_version 763256 (0.0008) [2023-12-28 00:43:31,434][106225] Updated weights for policy 1, policy_version 763266 (0.0009) [2023-12-28 00:43:31,753][106226] Updated weights for policy 0, policy_version 761244 (0.0010) [2023-12-28 00:43:31,807][106226] Updated weights for policy 0, policy_version 761254 (0.0008) [2023-12-28 00:43:31,865][106226] Updated weights for policy 0, policy_version 761264 (0.0011) [2023-12-28 00:43:32,263][106225] Updated weights for policy 1, policy_version 763276 (0.0008) [2023-12-28 00:43:32,327][106225] Updated weights for policy 1, policy_version 763286 (0.0008) [2023-12-28 00:43:32,392][106225] Updated weights for policy 1, policy_version 763296 (0.0008) [2023-12-28 00:43:32,501][106226] Updated weights for policy 0, policy_version 761274 (0.0007) [2023-12-28 00:43:32,561][106226] Updated weights for policy 0, policy_version 761284 (0.0008) [2023-12-28 00:43:32,624][106226] Updated weights for policy 0, policy_version 761294 (0.0006) [2023-12-28 00:43:32,685][106226] Updated weights for policy 0, policy_version 761304 (0.0009) [2023-12-28 00:43:33,061][106225] Updated weights for policy 1, policy_version 763306 (0.0007) [2023-12-28 00:43:33,115][106225] Updated weights for policy 1, policy_version 763316 (0.0009) [2023-12-28 00:43:33,165][106225] Updated weights for policy 1, policy_version 763326 (0.0009) [2023-12-28 00:43:33,218][106225] Updated weights for policy 1, policy_version 763336 (0.0009) [2023-12-28 00:43:33,324][106226] Updated weights for policy 0, policy_version 761314 (0.0008) [2023-12-28 00:43:33,378][106226] Updated weights for policy 0, policy_version 761324 (0.0005) [2023-12-28 00:43:33,439][106226] Updated weights for policy 0, policy_version 761334 (0.0005) [2023-12-28 00:43:33,986][106225] Updated weights for policy 1, policy_version 763346 (0.0006) [2023-12-28 00:43:34,047][106225] Updated weights for policy 1, policy_version 763356 (0.0005) [2023-12-28 00:43:34,068][106226] Updated weights for policy 0, policy_version 761344 (0.0006) [2023-12-28 00:43:34,103][106225] Updated weights for policy 1, policy_version 763366 (0.0005) [2023-12-28 00:43:34,133][106226] Updated weights for policy 0, policy_version 761354 (0.0007) [2023-12-28 00:43:34,199][106226] Updated weights for policy 0, policy_version 761364 (0.0008) [2023-12-28 00:43:34,758][106225] Updated weights for policy 1, policy_version 763376 (0.0008) [2023-12-28 00:43:34,810][106225] Updated weights for policy 1, policy_version 763386 (0.0008) [2023-12-28 00:43:34,864][106225] Updated weights for policy 1, policy_version 763396 (0.0007) [2023-12-28 00:43:34,874][106226] Updated weights for policy 0, policy_version 761374 (0.0006) [2023-12-28 00:43:34,934][106226] Updated weights for policy 0, policy_version 761384 (0.0008) [2023-12-28 00:43:34,995][106226] Updated weights for policy 0, policy_version 761394 (0.0009) [2023-12-28 00:43:35,574][106225] Updated weights for policy 1, policy_version 763406 (0.0006) [2023-12-28 00:43:35,631][106225] Updated weights for policy 1, policy_version 763416 (0.0008) [2023-12-28 00:43:35,686][106225] Updated weights for policy 1, policy_version 763426 (0.0008) [2023-12-28 00:43:35,746][106226] Updated weights for policy 0, policy_version 761404 (0.0009) [2023-12-28 00:43:35,799][106226] Updated weights for policy 0, policy_version 761414 (0.0009) [2023-12-28 00:43:35,848][106226] Updated weights for policy 0, policy_version 761424 (0.0009) [2023-12-28 00:43:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 390455296. Throughput: 0: 9941.6, 1: 9847.1. Samples: 390464344. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-28 00:43:36,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.997')] [2023-12-28 00:43:36,407][106225] Updated weights for policy 1, policy_version 763436 (0.0008) [2023-12-28 00:43:36,468][106225] Updated weights for policy 1, policy_version 763446 (0.0008) [2023-12-28 00:43:36,531][106225] Updated weights for policy 1, policy_version 763456 (0.0008) [2023-12-28 00:43:36,640][106226] Updated weights for policy 0, policy_version 761434 (0.0008) [2023-12-28 00:43:36,705][106226] Updated weights for policy 0, policy_version 761444 (0.0009) [2023-12-28 00:43:36,762][106226] Updated weights for policy 0, policy_version 761454 (0.0009) [2023-12-28 00:43:36,829][106226] Updated weights for policy 0, policy_version 761464 (0.0009) [2023-12-28 00:43:37,250][106225] Updated weights for policy 1, policy_version 763466 (0.0009) [2023-12-28 00:43:37,317][106225] Updated weights for policy 1, policy_version 763476 (0.0009) [2023-12-28 00:43:37,374][106225] Updated weights for policy 1, policy_version 763486 (0.0009) [2023-12-28 00:43:37,428][106225] Updated weights for policy 1, policy_version 763496 (0.0008) [2023-12-28 00:43:37,554][106226] Updated weights for policy 0, policy_version 761474 (0.0006) [2023-12-28 00:43:37,618][106226] Updated weights for policy 0, policy_version 761484 (0.0008) [2023-12-28 00:43:37,683][106226] Updated weights for policy 0, policy_version 761494 (0.0008) [2023-12-28 00:43:38,068][106225] Updated weights for policy 1, policy_version 763506 (0.0005) [2023-12-28 00:43:38,133][106225] Updated weights for policy 1, policy_version 763516 (0.0005) [2023-12-28 00:43:38,192][106225] Updated weights for policy 1, policy_version 763526 (0.0005) [2023-12-28 00:43:38,293][106226] Updated weights for policy 0, policy_version 761504 (0.0009) [2023-12-28 00:43:38,361][106226] Updated weights for policy 0, policy_version 761514 (0.0008) [2023-12-28 00:43:38,431][106226] Updated weights for policy 0, policy_version 761524 (0.0007) [2023-12-28 00:43:38,809][106225] Updated weights for policy 1, policy_version 763536 (0.0007) [2023-12-28 00:43:38,865][106225] Updated weights for policy 1, policy_version 763546 (0.0009) [2023-12-28 00:43:38,924][106225] Updated weights for policy 1, policy_version 763556 (0.0008) [2023-12-28 00:43:39,163][106226] Updated weights for policy 0, policy_version 761534 (0.0009) [2023-12-28 00:43:39,225][106226] Updated weights for policy 0, policy_version 761544 (0.0008) [2023-12-28 00:43:39,293][106226] Updated weights for policy 0, policy_version 761554 (0.0008) [2023-12-28 00:43:39,753][106225] Updated weights for policy 1, policy_version 763566 (0.0007) [2023-12-28 00:43:39,821][106225] Updated weights for policy 1, policy_version 763576 (0.0009) [2023-12-28 00:43:39,890][106225] Updated weights for policy 1, policy_version 763586 (0.0009) [2023-12-28 00:43:39,965][106226] Updated weights for policy 0, policy_version 761564 (0.0009) [2023-12-28 00:43:40,029][106226] Updated weights for policy 0, policy_version 761574 (0.0006) [2023-12-28 00:43:40,088][106226] Updated weights for policy 0, policy_version 761584 (0.0006) [2023-12-28 00:43:40,545][106225] Updated weights for policy 1, policy_version 763596 (0.0008) [2023-12-28 00:43:40,609][106225] Updated weights for policy 1, policy_version 763606 (0.0008) [2023-12-28 00:43:40,661][106225] Updated weights for policy 1, policy_version 763616 (0.0005) [2023-12-28 00:43:40,887][106226] Updated weights for policy 0, policy_version 761594 (0.0009) [2023-12-28 00:43:40,972][106226] Updated weights for policy 0, policy_version 761604 (0.0005) [2023-12-28 00:43:41,036][106226] Updated weights for policy 0, policy_version 761614 (0.0008) [2023-12-28 00:43:41,100][106226] Updated weights for policy 0, policy_version 761624 (0.0009) [2023-12-28 00:43:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 390553600. Throughput: 0: 9924.9, 1: 9862.8. Samples: 390524308. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:43:41,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.926')] [2023-12-28 00:43:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000763624_195526656.pth... [2023-12-28 00:43:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000761624_195026944.pth... [2023-12-28 00:43:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000762472_195231744.pth [2023-12-28 00:43:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000760472_194732032.pth [2023-12-28 00:43:41,340][106225] Updated weights for policy 1, policy_version 763626 (0.0006) [2023-12-28 00:43:41,411][106225] Updated weights for policy 1, policy_version 763636 (0.0009) [2023-12-28 00:43:41,478][106225] Updated weights for policy 1, policy_version 763646 (0.0007) [2023-12-28 00:43:41,539][106225] Updated weights for policy 1, policy_version 763656 (0.0009) [2023-12-28 00:43:41,823][106226] Updated weights for policy 0, policy_version 761634 (0.0009) [2023-12-28 00:43:41,890][106226] Updated weights for policy 0, policy_version 761644 (0.0008) [2023-12-28 00:43:41,953][106226] Updated weights for policy 0, policy_version 761654 (0.0009) [2023-12-28 00:43:42,278][106225] Updated weights for policy 1, policy_version 763666 (0.0008) [2023-12-28 00:43:42,341][106225] Updated weights for policy 1, policy_version 763676 (0.0008) [2023-12-28 00:43:42,409][106225] Updated weights for policy 1, policy_version 763686 (0.0009) [2023-12-28 00:43:42,661][106226] Updated weights for policy 0, policy_version 761664 (0.0009) [2023-12-28 00:43:42,728][106226] Updated weights for policy 0, policy_version 761674 (0.0009) [2023-12-28 00:43:42,791][106226] Updated weights for policy 0, policy_version 761684 (0.0008) [2023-12-28 00:43:43,089][106225] Updated weights for policy 1, policy_version 763696 (0.0008) [2023-12-28 00:43:43,147][106225] Updated weights for policy 1, policy_version 763706 (0.0008) [2023-12-28 00:43:43,199][106225] Updated weights for policy 1, policy_version 763716 (0.0009) [2023-12-28 00:43:43,446][106226] Updated weights for policy 0, policy_version 761694 (0.0008) [2023-12-28 00:43:43,504][106226] Updated weights for policy 0, policy_version 761704 (0.0008) [2023-12-28 00:43:43,564][106226] Updated weights for policy 0, policy_version 761714 (0.0009) [2023-12-28 00:43:43,974][106225] Updated weights for policy 1, policy_version 763726 (0.0009) [2023-12-28 00:43:44,032][106225] Updated weights for policy 1, policy_version 763736 (0.0008) [2023-12-28 00:43:44,094][106225] Updated weights for policy 1, policy_version 763746 (0.0008) [2023-12-28 00:43:44,266][106226] Updated weights for policy 0, policy_version 761724 (0.0007) [2023-12-28 00:43:44,325][106226] Updated weights for policy 0, policy_version 761734 (0.0008) [2023-12-28 00:43:44,383][106226] Updated weights for policy 0, policy_version 761744 (0.0009) [2023-12-28 00:43:44,871][106225] Updated weights for policy 1, policy_version 763756 (0.0008) [2023-12-28 00:43:44,934][106225] Updated weights for policy 1, policy_version 763766 (0.0008) [2023-12-28 00:43:44,998][106225] Updated weights for policy 1, policy_version 763776 (0.0009) [2023-12-28 00:43:45,101][106226] Updated weights for policy 0, policy_version 761754 (0.0008) [2023-12-28 00:43:45,163][106226] Updated weights for policy 0, policy_version 761764 (0.0009) [2023-12-28 00:43:45,227][106226] Updated weights for policy 0, policy_version 761774 (0.0009) [2023-12-28 00:43:45,288][106226] Updated weights for policy 0, policy_version 761784 (0.0009) [2023-12-28 00:43:45,685][106225] Updated weights for policy 1, policy_version 763786 (0.0008) [2023-12-28 00:43:45,749][106225] Updated weights for policy 1, policy_version 763796 (0.0009) [2023-12-28 00:43:45,819][106225] Updated weights for policy 1, policy_version 763806 (0.0009) [2023-12-28 00:43:45,879][106225] Updated weights for policy 1, policy_version 763816 (0.0008) [2023-12-28 00:43:46,026][106226] Updated weights for policy 0, policy_version 761794 (0.0008) [2023-12-28 00:43:46,088][106226] Updated weights for policy 0, policy_version 761804 (0.0008) [2023-12-28 00:43:46,151][106226] Updated weights for policy 0, policy_version 761814 (0.0009) [2023-12-28 00:43:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 390651904. Throughput: 0: 9857.1, 1: 9825.7. Samples: 390639016. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:43:46,177][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.901')] [2023-12-28 00:43:46,652][106225] Updated weights for policy 1, policy_version 763826 (0.0009) [2023-12-28 00:43:46,705][106225] Updated weights for policy 1, policy_version 763836 (0.0008) [2023-12-28 00:43:46,765][106225] Updated weights for policy 1, policy_version 763846 (0.0009) [2023-12-28 00:43:46,815][106226] Updated weights for policy 0, policy_version 761824 (0.0006) [2023-12-28 00:43:46,862][106226] Updated weights for policy 0, policy_version 761834 (0.0005) [2023-12-28 00:43:46,914][106226] Updated weights for policy 0, policy_version 761844 (0.0008) [2023-12-28 00:43:47,509][106226] Updated weights for policy 0, policy_version 761854 (0.0011) [2023-12-28 00:43:47,566][106226] Updated weights for policy 0, policy_version 761864 (0.0011) [2023-12-28 00:43:47,567][106225] Updated weights for policy 1, policy_version 763856 (0.0007) [2023-12-28 00:43:47,623][106226] Updated weights for policy 0, policy_version 761874 (0.0010) [2023-12-28 00:43:47,630][106225] Updated weights for policy 1, policy_version 763866 (0.0005) [2023-12-28 00:43:47,688][106225] Updated weights for policy 1, policy_version 763876 (0.0005) [2023-12-28 00:43:48,348][106226] Updated weights for policy 0, policy_version 761884 (0.0011) [2023-12-28 00:43:48,360][106225] Updated weights for policy 1, policy_version 763886 (0.0008) [2023-12-28 00:43:48,413][106226] Updated weights for policy 0, policy_version 761894 (0.0009) [2023-12-28 00:43:48,420][106225] Updated weights for policy 1, policy_version 763896 (0.0006) [2023-12-28 00:43:48,475][106226] Updated weights for policy 0, policy_version 761904 (0.0006) [2023-12-28 00:43:48,476][106225] Updated weights for policy 1, policy_version 763906 (0.0008) [2023-12-28 00:43:49,034][106225] Updated weights for policy 1, policy_version 763916 (0.0007) [2023-12-28 00:43:49,089][106225] Updated weights for policy 1, policy_version 763926 (0.0006) [2023-12-28 00:43:49,146][106225] Updated weights for policy 1, policy_version 763936 (0.0006) [2023-12-28 00:43:49,267][106226] Updated weights for policy 0, policy_version 761914 (0.0007) [2023-12-28 00:43:49,336][106226] Updated weights for policy 0, policy_version 761924 (0.0007) [2023-12-28 00:43:49,404][106226] Updated weights for policy 0, policy_version 761934 (0.0010) [2023-12-28 00:43:49,457][106226] Updated weights for policy 0, policy_version 761944 (0.0008) [2023-12-28 00:43:49,846][106225] Updated weights for policy 1, policy_version 763946 (0.0006) [2023-12-28 00:43:49,901][106225] Updated weights for policy 1, policy_version 763956 (0.0008) [2023-12-28 00:43:49,969][106225] Updated weights for policy 1, policy_version 763966 (0.0008) [2023-12-28 00:43:50,036][106225] Updated weights for policy 1, policy_version 763976 (0.0008) [2023-12-28 00:43:50,198][106226] Updated weights for policy 0, policy_version 761954 (0.0007) [2023-12-28 00:43:50,265][106226] Updated weights for policy 0, policy_version 761964 (0.0007) [2023-12-28 00:43:50,325][106226] Updated weights for policy 0, policy_version 761974 (0.0007) [2023-12-28 00:43:50,755][106225] Updated weights for policy 1, policy_version 763986 (0.0008) [2023-12-28 00:43:50,809][106225] Updated weights for policy 1, policy_version 763996 (0.0008) [2023-12-28 00:43:50,859][106225] Updated weights for policy 1, policy_version 764006 (0.0008) [2023-12-28 00:43:51,055][106226] Updated weights for policy 0, policy_version 761984 (0.0008) [2023-12-28 00:43:51,125][106226] Updated weights for policy 0, policy_version 761994 (0.0008) [2023-12-28 00:43:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 390742016. Throughput: 0: 9760.4, 1: 9858.5. Samples: 390755032. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:43:51,175][105115] Avg episode reward: [(0, '-4.236'), (1, '-4.812')] [2023-12-28 00:43:51,189][106226] Updated weights for policy 0, policy_version 762004 (0.0008) [2023-12-28 00:43:51,610][106225] Updated weights for policy 1, policy_version 764016 (0.0010) [2023-12-28 00:43:51,679][106225] Updated weights for policy 1, policy_version 764026 (0.0012) [2023-12-28 00:43:51,757][106225] Updated weights for policy 1, policy_version 764036 (0.0010) [2023-12-28 00:43:51,971][106226] Updated weights for policy 0, policy_version 762014 (0.0008) [2023-12-28 00:43:52,034][106226] Updated weights for policy 0, policy_version 762024 (0.0008) [2023-12-28 00:43:52,098][106226] Updated weights for policy 0, policy_version 762034 (0.0008) [2023-12-28 00:43:52,473][106225] Updated weights for policy 1, policy_version 764046 (0.0010) [2023-12-28 00:43:52,534][106225] Updated weights for policy 1, policy_version 764056 (0.0010) [2023-12-28 00:43:52,596][106225] Updated weights for policy 1, policy_version 764066 (0.0010) [2023-12-28 00:43:52,839][106226] Updated weights for policy 0, policy_version 762044 (0.0007) [2023-12-28 00:43:52,889][106226] Updated weights for policy 0, policy_version 762054 (0.0008) [2023-12-28 00:43:52,943][106226] Updated weights for policy 0, policy_version 762064 (0.0008) [2023-12-28 00:43:53,318][106225] Updated weights for policy 1, policy_version 764076 (0.0010) [2023-12-28 00:43:53,374][106225] Updated weights for policy 1, policy_version 764086 (0.0010) [2023-12-28 00:43:53,427][106225] Updated weights for policy 1, policy_version 764096 (0.0010) [2023-12-28 00:43:53,684][106226] Updated weights for policy 0, policy_version 762074 (0.0008) [2023-12-28 00:43:53,736][106226] Updated weights for policy 0, policy_version 762084 (0.0010) [2023-12-28 00:43:53,786][106226] Updated weights for policy 0, policy_version 762094 (0.0010) [2023-12-28 00:43:53,845][106226] Updated weights for policy 0, policy_version 762104 (0.0010) [2023-12-28 00:43:54,142][106225] Updated weights for policy 1, policy_version 764106 (0.0010) [2023-12-28 00:43:54,197][106225] Updated weights for policy 1, policy_version 764116 (0.0010) [2023-12-28 00:43:54,251][106225] Updated weights for policy 1, policy_version 764126 (0.0010) [2023-12-28 00:43:54,311][106225] Updated weights for policy 1, policy_version 764136 (0.0010) [2023-12-28 00:43:54,566][106226] Updated weights for policy 0, policy_version 762114 (0.0008) [2023-12-28 00:43:54,625][106226] Updated weights for policy 0, policy_version 762124 (0.0008) [2023-12-28 00:43:54,686][106226] Updated weights for policy 0, policy_version 762134 (0.0006) [2023-12-28 00:43:55,010][106225] Updated weights for policy 1, policy_version 764146 (0.0011) [2023-12-28 00:43:55,073][106225] Updated weights for policy 1, policy_version 764156 (0.0010) [2023-12-28 00:43:55,133][106225] Updated weights for policy 1, policy_version 764166 (0.0010) [2023-12-28 00:43:55,405][106226] Updated weights for policy 0, policy_version 762144 (0.0009) [2023-12-28 00:43:55,458][106226] Updated weights for policy 0, policy_version 762154 (0.0010) [2023-12-28 00:43:55,518][106226] Updated weights for policy 0, policy_version 762164 (0.0010) [2023-12-28 00:43:55,833][106225] Updated weights for policy 1, policy_version 764176 (0.0010) [2023-12-28 00:43:55,882][106225] Updated weights for policy 1, policy_version 764186 (0.0010) [2023-12-28 00:43:55,930][106225] Updated weights for policy 1, policy_version 764196 (0.0009) [2023-12-28 00:43:56,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 390840320. Throughput: 0: 9708.7, 1: 9881.0. Samples: 390811064. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:43:56,176][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.173')] [2023-12-28 00:43:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000764200_195674112.pth... [2023-12-28 00:43:56,187][106226] Updated weights for policy 0, policy_version 762174 (0.0010) [2023-12-28 00:43:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000763048_195379200.pth [2023-12-28 00:43:56,250][106226] Updated weights for policy 0, policy_version 762184 (0.0011) [2023-12-28 00:43:56,310][106226] Updated weights for policy 0, policy_version 762194 (0.0011) [2023-12-28 00:43:56,336][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000762200_195174400.pth... [2023-12-28 00:43:56,339][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000761048_194879488.pth [2023-12-28 00:43:56,654][106225] Updated weights for policy 1, policy_version 764206 (0.0010) [2023-12-28 00:43:56,704][106225] Updated weights for policy 1, policy_version 764216 (0.0010) [2023-12-28 00:43:56,766][106225] Updated weights for policy 1, policy_version 764226 (0.0009) [2023-12-28 00:43:56,964][106226] Updated weights for policy 0, policy_version 762204 (0.0008) [2023-12-28 00:43:57,023][106226] Updated weights for policy 0, policy_version 762214 (0.0005) [2023-12-28 00:43:57,082][106226] Updated weights for policy 0, policy_version 762224 (0.0005) [2023-12-28 00:43:57,461][106225] Updated weights for policy 1, policy_version 764236 (0.0006) [2023-12-28 00:43:57,516][106225] Updated weights for policy 1, policy_version 764246 (0.0006) [2023-12-28 00:43:57,561][106225] Updated weights for policy 1, policy_version 764256 (0.0007) [2023-12-28 00:43:57,686][106226] Updated weights for policy 0, policy_version 762234 (0.0006) [2023-12-28 00:43:57,746][106226] Updated weights for policy 0, policy_version 762244 (0.0011) [2023-12-28 00:43:57,791][106226] Updated weights for policy 0, policy_version 762254 (0.0010) [2023-12-28 00:43:57,848][106226] Updated weights for policy 0, policy_version 762264 (0.0010) [2023-12-28 00:43:58,261][106225] Updated weights for policy 1, policy_version 764266 (0.0008) [2023-12-28 00:43:58,320][106225] Updated weights for policy 1, policy_version 764276 (0.0008) [2023-12-28 00:43:58,387][106225] Updated weights for policy 1, policy_version 764286 (0.0008) [2023-12-28 00:43:58,450][106225] Updated weights for policy 1, policy_version 764296 (0.0008) [2023-12-28 00:43:58,618][106226] Updated weights for policy 0, policy_version 762274 (0.0008) [2023-12-28 00:43:58,683][106226] Updated weights for policy 0, policy_version 762284 (0.0008) [2023-12-28 00:43:58,752][106226] Updated weights for policy 0, policy_version 762294 (0.0008) [2023-12-28 00:43:59,219][106225] Updated weights for policy 1, policy_version 764306 (0.0009) [2023-12-28 00:43:59,290][106225] Updated weights for policy 1, policy_version 764316 (0.0008) [2023-12-28 00:43:59,357][106225] Updated weights for policy 1, policy_version 764326 (0.0007) [2023-12-28 00:43:59,462][106226] Updated weights for policy 0, policy_version 762304 (0.0010) [2023-12-28 00:43:59,517][106226] Updated weights for policy 0, policy_version 762314 (0.0010) [2023-12-28 00:43:59,574][106226] Updated weights for policy 0, policy_version 762324 (0.0010) [2023-12-28 00:44:00,134][106225] Updated weights for policy 1, policy_version 764336 (0.0008) [2023-12-28 00:44:00,194][106225] Updated weights for policy 1, policy_version 764346 (0.0008) [2023-12-28 00:44:00,245][106225] Updated weights for policy 1, policy_version 764356 (0.0008) [2023-12-28 00:44:00,302][106226] Updated weights for policy 0, policy_version 762334 (0.0009) [2023-12-28 00:44:00,367][106226] Updated weights for policy 0, policy_version 762344 (0.0011) [2023-12-28 00:44:00,433][106226] Updated weights for policy 0, policy_version 762354 (0.0011) [2023-12-28 00:44:00,922][106225] Updated weights for policy 1, policy_version 764366 (0.0006) [2023-12-28 00:44:00,994][106225] Updated weights for policy 1, policy_version 764376 (0.0006) [2023-12-28 00:44:01,060][106225] Updated weights for policy 1, policy_version 764386 (0.0008) [2023-12-28 00:44:01,064][106226] Updated weights for policy 0, policy_version 762364 (0.0009) [2023-12-28 00:44:01,131][106226] Updated weights for policy 0, policy_version 762374 (0.0007) [2023-12-28 00:44:01,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 390938624. Throughput: 0: 9703.9, 1: 9904.3. Samples: 390928672. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:01,176][105115] Avg episode reward: [(0, '-4.584'), (1, '-5.201')] [2023-12-28 00:44:01,195][106226] Updated weights for policy 0, policy_version 762384 (0.0007) [2023-12-28 00:44:01,821][106225] Updated weights for policy 1, policy_version 764396 (0.0009) [2023-12-28 00:44:01,876][106225] Updated weights for policy 1, policy_version 764406 (0.0008) [2023-12-28 00:44:01,892][106226] Updated weights for policy 0, policy_version 762394 (0.0008) [2023-12-28 00:44:01,938][106225] Updated weights for policy 1, policy_version 764416 (0.0008) [2023-12-28 00:44:01,955][106226] Updated weights for policy 0, policy_version 762404 (0.0007) [2023-12-28 00:44:02,018][106226] Updated weights for policy 0, policy_version 762414 (0.0006) [2023-12-28 00:44:02,077][106226] Updated weights for policy 0, policy_version 762424 (0.0008) [2023-12-28 00:44:02,709][106225] Updated weights for policy 1, policy_version 764426 (0.0008) [2023-12-28 00:44:02,762][106226] Updated weights for policy 0, policy_version 762434 (0.0008) [2023-12-28 00:44:02,766][106225] Updated weights for policy 1, policy_version 764436 (0.0008) [2023-12-28 00:44:02,809][106226] Updated weights for policy 0, policy_version 762444 (0.0008) [2023-12-28 00:44:02,823][106225] Updated weights for policy 1, policy_version 764446 (0.0007) [2023-12-28 00:44:02,863][106226] Updated weights for policy 0, policy_version 762454 (0.0008) [2023-12-28 00:44:02,882][106225] Updated weights for policy 1, policy_version 764456 (0.0006) [2023-12-28 00:44:03,574][106226] Updated weights for policy 0, policy_version 762464 (0.0006) [2023-12-28 00:44:03,581][106225] Updated weights for policy 1, policy_version 764466 (0.0007) [2023-12-28 00:44:03,625][106226] Updated weights for policy 0, policy_version 762474 (0.0005) [2023-12-28 00:44:03,630][106225] Updated weights for policy 1, policy_version 764476 (0.0008) [2023-12-28 00:44:03,675][106225] Updated weights for policy 1, policy_version 764486 (0.0006) [2023-12-28 00:44:03,680][106226] Updated weights for policy 0, policy_version 762484 (0.0007) [2023-12-28 00:44:04,315][106226] Updated weights for policy 0, policy_version 762494 (0.0009) [2023-12-28 00:44:04,375][106225] Updated weights for policy 1, policy_version 764496 (0.0010) [2023-12-28 00:44:04,380][106226] Updated weights for policy 0, policy_version 762504 (0.0009) [2023-12-28 00:44:04,430][106225] Updated weights for policy 1, policy_version 764506 (0.0010) [2023-12-28 00:44:04,440][106226] Updated weights for policy 0, policy_version 762514 (0.0010) [2023-12-28 00:44:04,478][106225] Updated weights for policy 1, policy_version 764516 (0.0010) [2023-12-28 00:44:04,984][106226] Updated weights for policy 0, policy_version 762524 (0.0009) [2023-12-28 00:44:05,036][106226] Updated weights for policy 0, policy_version 762534 (0.0008) [2023-12-28 00:44:05,092][106226] Updated weights for policy 0, policy_version 762544 (0.0005) [2023-12-28 00:44:05,112][106225] Updated weights for policy 1, policy_version 764526 (0.0008) [2023-12-28 00:44:05,172][106225] Updated weights for policy 1, policy_version 764536 (0.0005) [2023-12-28 00:44:05,229][106225] Updated weights for policy 1, policy_version 764546 (0.0005) [2023-12-28 00:44:05,769][106226] Updated weights for policy 0, policy_version 762554 (0.0006) [2023-12-28 00:44:05,782][106225] Updated weights for policy 1, policy_version 764556 (0.0009) [2023-12-28 00:44:05,832][106226] Updated weights for policy 0, policy_version 762564 (0.0006) [2023-12-28 00:44:05,837][106225] Updated weights for policy 1, policy_version 764566 (0.0010) [2023-12-28 00:44:05,891][106225] Updated weights for policy 1, policy_version 764576 (0.0010) [2023-12-28 00:44:05,892][106226] Updated weights for policy 0, policy_version 762574 (0.0010) [2023-12-28 00:44:05,946][106226] Updated weights for policy 0, policy_version 762584 (0.0009) [2023-12-28 00:44:06,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 391045120. Throughput: 0: 9812.6, 1: 9914.1. Samples: 391051292. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:06,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.871')] [2023-12-28 00:44:06,563][106225] Updated weights for policy 1, policy_version 764586 (0.0010) [2023-12-28 00:44:06,626][106225] Updated weights for policy 1, policy_version 764596 (0.0011) [2023-12-28 00:44:06,672][106226] Updated weights for policy 0, policy_version 762594 (0.0010) [2023-12-28 00:44:06,684][106225] Updated weights for policy 1, policy_version 764606 (0.0008) [2023-12-28 00:44:06,731][106226] Updated weights for policy 0, policy_version 762604 (0.0009) [2023-12-28 00:44:06,740][106225] Updated weights for policy 1, policy_version 764616 (0.0010) [2023-12-28 00:44:06,792][106226] Updated weights for policy 0, policy_version 762614 (0.0011) [2023-12-28 00:44:07,350][106225] Updated weights for policy 1, policy_version 764626 (0.0008) [2023-12-28 00:44:07,396][106225] Updated weights for policy 1, policy_version 764636 (0.0008) [2023-12-28 00:44:07,458][106225] Updated weights for policy 1, policy_version 764646 (0.0008) [2023-12-28 00:44:07,545][106226] Updated weights for policy 0, policy_version 762624 (0.0009) [2023-12-28 00:44:07,606][106226] Updated weights for policy 0, policy_version 762634 (0.0009) [2023-12-28 00:44:07,672][106226] Updated weights for policy 0, policy_version 762644 (0.0008) [2023-12-28 00:44:08,133][106225] Updated weights for policy 1, policy_version 764656 (0.0010) [2023-12-28 00:44:08,186][106225] Updated weights for policy 1, policy_version 764666 (0.0010) [2023-12-28 00:44:08,246][106225] Updated weights for policy 1, policy_version 764676 (0.0010) [2023-12-28 00:44:08,253][106226] Updated weights for policy 0, policy_version 762654 (0.0007) [2023-12-28 00:44:08,306][106226] Updated weights for policy 0, policy_version 762664 (0.0005) [2023-12-28 00:44:08,376][106226] Updated weights for policy 0, policy_version 762674 (0.0007) [2023-12-28 00:44:08,972][106225] Updated weights for policy 1, policy_version 764686 (0.0010) [2023-12-28 00:44:09,025][106226] Updated weights for policy 0, policy_version 762684 (0.0007) [2023-12-28 00:44:09,027][106225] Updated weights for policy 1, policy_version 764696 (0.0008) [2023-12-28 00:44:09,077][106226] Updated weights for policy 0, policy_version 762694 (0.0005) [2023-12-28 00:44:09,083][106225] Updated weights for policy 1, policy_version 764706 (0.0008) [2023-12-28 00:44:09,128][106226] Updated weights for policy 0, policy_version 762704 (0.0005) [2023-12-28 00:44:09,887][106226] Updated weights for policy 0, policy_version 762714 (0.0006) [2023-12-28 00:44:09,931][106225] Updated weights for policy 1, policy_version 764716 (0.0008) [2023-12-28 00:44:09,954][106226] Updated weights for policy 0, policy_version 762724 (0.0009) [2023-12-28 00:44:09,988][106225] Updated weights for policy 1, policy_version 764726 (0.0006) [2023-12-28 00:44:10,011][106226] Updated weights for policy 0, policy_version 762734 (0.0008) [2023-12-28 00:44:10,051][106225] Updated weights for policy 1, policy_version 764736 (0.0007) [2023-12-28 00:44:10,069][106226] Updated weights for policy 0, policy_version 762744 (0.0007) [2023-12-28 00:44:10,646][106225] Updated weights for policy 1, policy_version 764746 (0.0007) [2023-12-28 00:44:10,696][106225] Updated weights for policy 1, policy_version 764756 (0.0008) [2023-12-28 00:44:10,745][106225] Updated weights for policy 1, policy_version 764766 (0.0009) [2023-12-28 00:44:10,804][106225] Updated weights for policy 1, policy_version 764776 (0.0008) [2023-12-28 00:44:10,851][106226] Updated weights for policy 0, policy_version 762754 (0.0009) [2023-12-28 00:44:10,899][106226] Updated weights for policy 0, policy_version 762764 (0.0008) [2023-12-28 00:44:10,947][106226] Updated weights for policy 0, policy_version 762774 (0.0008) [2023-12-28 00:44:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 391143424. Throughput: 0: 9880.3, 1: 9894.6. Samples: 391112340. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:11,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-4.944')] [2023-12-28 00:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000764776_195821568.pth... [2023-12-28 00:44:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000762776_195321856.pth... [2023-12-28 00:44:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000763624_195526656.pth [2023-12-28 00:44:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000761624_195026944.pth [2023-12-28 00:44:11,570][106225] Updated weights for policy 1, policy_version 764786 (0.0008) [2023-12-28 00:44:11,635][106225] Updated weights for policy 1, policy_version 764796 (0.0008) [2023-12-28 00:44:11,704][106225] Updated weights for policy 1, policy_version 764806 (0.0007) [2023-12-28 00:44:11,815][106226] Updated weights for policy 0, policy_version 762784 (0.0008) [2023-12-28 00:44:11,878][106226] Updated weights for policy 0, policy_version 762794 (0.0008) [2023-12-28 00:44:11,932][106226] Updated weights for policy 0, policy_version 762804 (0.0008) [2023-12-28 00:44:12,424][106225] Updated weights for policy 1, policy_version 764816 (0.0008) [2023-12-28 00:44:12,484][106225] Updated weights for policy 1, policy_version 764826 (0.0006) [2023-12-28 00:44:12,544][106225] Updated weights for policy 1, policy_version 764836 (0.0006) [2023-12-28 00:44:12,663][106226] Updated weights for policy 0, policy_version 762814 (0.0009) [2023-12-28 00:44:12,721][106226] Updated weights for policy 0, policy_version 762824 (0.0011) [2023-12-28 00:44:12,772][106226] Updated weights for policy 0, policy_version 762834 (0.0011) [2023-12-28 00:44:13,171][106225] Updated weights for policy 1, policy_version 764846 (0.0006) [2023-12-28 00:44:13,218][106225] Updated weights for policy 1, policy_version 764856 (0.0005) [2023-12-28 00:44:13,275][106225] Updated weights for policy 1, policy_version 764866 (0.0005) [2023-12-28 00:44:13,530][106226] Updated weights for policy 0, policy_version 762844 (0.0010) [2023-12-28 00:44:13,597][106226] Updated weights for policy 0, policy_version 762854 (0.0007) [2023-12-28 00:44:13,685][106226] Updated weights for policy 0, policy_version 762864 (0.0010) [2023-12-28 00:44:13,818][106225] Updated weights for policy 1, policy_version 764876 (0.0007) [2023-12-28 00:44:13,863][106225] Updated weights for policy 1, policy_version 764886 (0.0008) [2023-12-28 00:44:13,912][106225] Updated weights for policy 1, policy_version 764896 (0.0008) [2023-12-28 00:44:14,297][106226] Updated weights for policy 0, policy_version 762874 (0.0008) [2023-12-28 00:44:14,345][106226] Updated weights for policy 0, policy_version 762884 (0.0005) [2023-12-28 00:44:14,391][106226] Updated weights for policy 0, policy_version 762894 (0.0005) [2023-12-28 00:44:14,442][106226] Updated weights for policy 0, policy_version 762904 (0.0006) [2023-12-28 00:44:14,607][106225] Updated weights for policy 1, policy_version 764906 (0.0008) [2023-12-28 00:44:14,671][106225] Updated weights for policy 1, policy_version 764916 (0.0008) [2023-12-28 00:44:14,738][106225] Updated weights for policy 1, policy_version 764926 (0.0007) [2023-12-28 00:44:14,804][106225] Updated weights for policy 1, policy_version 764936 (0.0007) [2023-12-28 00:44:15,096][106226] Updated weights for policy 0, policy_version 762914 (0.0008) [2023-12-28 00:44:15,165][106226] Updated weights for policy 0, policy_version 762924 (0.0006) [2023-12-28 00:44:15,231][106226] Updated weights for policy 0, policy_version 762934 (0.0011) [2023-12-28 00:44:15,486][106225] Updated weights for policy 1, policy_version 764946 (0.0008) [2023-12-28 00:44:15,555][106225] Updated weights for policy 1, policy_version 764956 (0.0008) [2023-12-28 00:44:15,613][106225] Updated weights for policy 1, policy_version 764966 (0.0005) [2023-12-28 00:44:15,912][106226] Updated weights for policy 0, policy_version 762944 (0.0006) [2023-12-28 00:44:15,978][106226] Updated weights for policy 0, policy_version 762954 (0.0005) [2023-12-28 00:44:16,043][106226] Updated weights for policy 0, policy_version 762964 (0.0005) [2023-12-28 00:44:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 391241728. Throughput: 0: 9800.7, 1: 9841.8. Samples: 391229928. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:16,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-5.088')] [2023-12-28 00:44:16,310][106225] Updated weights for policy 1, policy_version 764976 (0.0005) [2023-12-28 00:44:16,379][106225] Updated weights for policy 1, policy_version 764986 (0.0008) [2023-12-28 00:44:16,444][106225] Updated weights for policy 1, policy_version 764996 (0.0008) [2023-12-28 00:44:16,734][106226] Updated weights for policy 0, policy_version 762974 (0.0007) [2023-12-28 00:44:16,788][106226] Updated weights for policy 0, policy_version 762984 (0.0006) [2023-12-28 00:44:16,845][106226] Updated weights for policy 0, policy_version 762994 (0.0008) [2023-12-28 00:44:17,106][106225] Updated weights for policy 1, policy_version 765006 (0.0007) [2023-12-28 00:44:17,164][106225] Updated weights for policy 1, policy_version 765016 (0.0006) [2023-12-28 00:44:17,217][106225] Updated weights for policy 1, policy_version 765026 (0.0008) [2023-12-28 00:44:17,524][106226] Updated weights for policy 0, policy_version 763004 (0.0008) [2023-12-28 00:44:17,577][106226] Updated weights for policy 0, policy_version 763014 (0.0006) [2023-12-28 00:44:17,629][106226] Updated weights for policy 0, policy_version 763024 (0.0006) [2023-12-28 00:44:17,944][106225] Updated weights for policy 1, policy_version 765036 (0.0008) [2023-12-28 00:44:18,005][106225] Updated weights for policy 1, policy_version 765046 (0.0008) [2023-12-28 00:44:18,071][106225] Updated weights for policy 1, policy_version 765056 (0.0008) [2023-12-28 00:44:18,280][106226] Updated weights for policy 0, policy_version 763034 (0.0007) [2023-12-28 00:44:18,338][106226] Updated weights for policy 0, policy_version 763044 (0.0008) [2023-12-28 00:44:18,402][106226] Updated weights for policy 0, policy_version 763054 (0.0009) [2023-12-28 00:44:18,469][106226] Updated weights for policy 0, policy_version 763064 (0.0009) [2023-12-28 00:44:18,802][106225] Updated weights for policy 1, policy_version 765066 (0.0008) [2023-12-28 00:44:18,862][106225] Updated weights for policy 1, policy_version 765076 (0.0008) [2023-12-28 00:44:18,914][106225] Updated weights for policy 1, policy_version 765086 (0.0008) [2023-12-28 00:44:18,972][106225] Updated weights for policy 1, policy_version 765096 (0.0009) [2023-12-28 00:44:19,158][106226] Updated weights for policy 0, policy_version 763074 (0.0008) [2023-12-28 00:44:19,225][106226] Updated weights for policy 0, policy_version 763084 (0.0008) [2023-12-28 00:44:19,287][106226] Updated weights for policy 0, policy_version 763094 (0.0010) [2023-12-28 00:44:19,753][106225] Updated weights for policy 1, policy_version 765106 (0.0009) [2023-12-28 00:44:19,822][106225] Updated weights for policy 1, policy_version 765116 (0.0009) [2023-12-28 00:44:19,881][106225] Updated weights for policy 1, policy_version 765126 (0.0009) [2023-12-28 00:44:20,008][106226] Updated weights for policy 0, policy_version 763104 (0.0009) [2023-12-28 00:44:20,061][106226] Updated weights for policy 0, policy_version 763114 (0.0009) [2023-12-28 00:44:20,118][106226] Updated weights for policy 0, policy_version 763124 (0.0008) [2023-12-28 00:44:20,672][106225] Updated weights for policy 1, policy_version 765136 (0.0010) [2023-12-28 00:44:20,735][106225] Updated weights for policy 1, policy_version 765146 (0.0010) [2023-12-28 00:44:20,796][106225] Updated weights for policy 1, policy_version 765156 (0.0011) [2023-12-28 00:44:20,923][106226] Updated weights for policy 0, policy_version 763134 (0.0008) [2023-12-28 00:44:20,986][106226] Updated weights for policy 0, policy_version 763144 (0.0008) [2023-12-28 00:44:21,064][106226] Updated weights for policy 0, policy_version 763154 (0.0008) [2023-12-28 00:44:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 391340032. Throughput: 0: 9774.7, 1: 9803.5. Samples: 391345364. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:21,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.924')] [2023-12-28 00:44:21,484][106225] Updated weights for policy 1, policy_version 765166 (0.0009) [2023-12-28 00:44:21,541][106225] Updated weights for policy 1, policy_version 765176 (0.0010) [2023-12-28 00:44:21,606][106225] Updated weights for policy 1, policy_version 765186 (0.0010) [2023-12-28 00:44:21,859][106226] Updated weights for policy 0, policy_version 763164 (0.0008) [2023-12-28 00:44:21,923][106226] Updated weights for policy 0, policy_version 763174 (0.0007) [2023-12-28 00:44:21,984][106226] Updated weights for policy 0, policy_version 763184 (0.0008) [2023-12-28 00:44:22,320][106225] Updated weights for policy 1, policy_version 765196 (0.0009) [2023-12-28 00:44:22,394][106225] Updated weights for policy 1, policy_version 765206 (0.0008) [2023-12-28 00:44:22,456][106225] Updated weights for policy 1, policy_version 765216 (0.0008) [2023-12-28 00:44:22,681][106226] Updated weights for policy 0, policy_version 763194 (0.0009) [2023-12-28 00:44:22,757][106226] Updated weights for policy 0, policy_version 763204 (0.0008) [2023-12-28 00:44:22,821][106226] Updated weights for policy 0, policy_version 763214 (0.0006) [2023-12-28 00:44:22,874][106226] Updated weights for policy 0, policy_version 763224 (0.0007) [2023-12-28 00:44:23,217][106225] Updated weights for policy 1, policy_version 765226 (0.0008) [2023-12-28 00:44:23,272][106225] Updated weights for policy 1, policy_version 765236 (0.0008) [2023-12-28 00:44:23,336][106225] Updated weights for policy 1, policy_version 765246 (0.0008) [2023-12-28 00:44:23,399][106225] Updated weights for policy 1, policy_version 765256 (0.0009) [2023-12-28 00:44:23,565][106226] Updated weights for policy 0, policy_version 763234 (0.0008) [2023-12-28 00:44:23,624][106226] Updated weights for policy 0, policy_version 763244 (0.0009) [2023-12-28 00:44:23,673][106226] Updated weights for policy 0, policy_version 763254 (0.0009) [2023-12-28 00:44:24,000][106225] Updated weights for policy 1, policy_version 765266 (0.0005) [2023-12-28 00:44:24,058][106225] Updated weights for policy 1, policy_version 765276 (0.0005) [2023-12-28 00:44:24,114][106225] Updated weights for policy 1, policy_version 765286 (0.0005) [2023-12-28 00:44:24,497][106226] Updated weights for policy 0, policy_version 763264 (0.0009) [2023-12-28 00:44:24,550][106226] Updated weights for policy 0, policy_version 763274 (0.0008) [2023-12-28 00:44:24,606][106226] Updated weights for policy 0, policy_version 763284 (0.0009) [2023-12-28 00:44:24,679][106225] Updated weights for policy 1, policy_version 765296 (0.0007) [2023-12-28 00:44:24,732][106225] Updated weights for policy 1, policy_version 765306 (0.0008) [2023-12-28 00:44:24,793][106225] Updated weights for policy 1, policy_version 765316 (0.0008) [2023-12-28 00:44:25,285][106226] Updated weights for policy 0, policy_version 763294 (0.0008) [2023-12-28 00:44:25,338][106226] Updated weights for policy 0, policy_version 763304 (0.0009) [2023-12-28 00:44:25,397][106226] Updated weights for policy 0, policy_version 763314 (0.0009) [2023-12-28 00:44:25,425][106225] Updated weights for policy 1, policy_version 765326 (0.0008) [2023-12-28 00:44:25,483][106225] Updated weights for policy 1, policy_version 765336 (0.0008) [2023-12-28 00:44:25,541][106225] Updated weights for policy 1, policy_version 765346 (0.0008) [2023-12-28 00:44:26,074][106226] Updated weights for policy 0, policy_version 763324 (0.0007) [2023-12-28 00:44:26,120][106226] Updated weights for policy 0, policy_version 763334 (0.0008) [2023-12-28 00:44:26,172][106226] Updated weights for policy 0, policy_version 763344 (0.0008) [2023-12-28 00:44:26,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 391430144. Throughput: 0: 9747.9, 1: 9778.5. Samples: 391402992. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:26,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-5.187')] [2023-12-28 00:44:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000765352_195969024.pth... [2023-12-28 00:44:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000764200_195674112.pth [2023-12-28 00:44:26,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000763352_195469312.pth... [2023-12-28 00:44:26,224][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000762200_195174400.pth [2023-12-28 00:44:26,274][106225] Updated weights for policy 1, policy_version 765356 (0.0008) [2023-12-28 00:44:26,336][106225] Updated weights for policy 1, policy_version 765366 (0.0008) [2023-12-28 00:44:26,401][106225] Updated weights for policy 1, policy_version 765376 (0.0009) [2023-12-28 00:44:26,964][106225] Updated weights for policy 1, policy_version 765386 (0.0009) [2023-12-28 00:44:26,974][106226] Updated weights for policy 0, policy_version 763354 (0.0008) [2023-12-28 00:44:27,015][106225] Updated weights for policy 1, policy_version 765396 (0.0006) [2023-12-28 00:44:27,030][106226] Updated weights for policy 0, policy_version 763364 (0.0007) [2023-12-28 00:44:27,073][106225] Updated weights for policy 1, policy_version 765406 (0.0005) [2023-12-28 00:44:27,088][106226] Updated weights for policy 0, policy_version 763374 (0.0008) [2023-12-28 00:44:27,137][106225] Updated weights for policy 1, policy_version 765416 (0.0006) [2023-12-28 00:44:27,140][106226] Updated weights for policy 0, policy_version 763384 (0.0007) [2023-12-28 00:44:27,826][106225] Updated weights for policy 1, policy_version 765426 (0.0008) [2023-12-28 00:44:27,869][106226] Updated weights for policy 0, policy_version 763394 (0.0008) [2023-12-28 00:44:27,879][106225] Updated weights for policy 1, policy_version 765436 (0.0006) [2023-12-28 00:44:27,927][106226] Updated weights for policy 0, policy_version 763404 (0.0006) [2023-12-28 00:44:27,933][106225] Updated weights for policy 1, policy_version 765446 (0.0005) [2023-12-28 00:44:27,980][106226] Updated weights for policy 0, policy_version 763414 (0.0007) [2023-12-28 00:44:28,589][106225] Updated weights for policy 1, policy_version 765456 (0.0009) [2023-12-28 00:44:28,643][106225] Updated weights for policy 1, policy_version 765466 (0.0008) [2023-12-28 00:44:28,693][106225] Updated weights for policy 1, policy_version 765476 (0.0008) [2023-12-28 00:44:28,725][106226] Updated weights for policy 0, policy_version 763424 (0.0006) [2023-12-28 00:44:28,786][106226] Updated weights for policy 0, policy_version 763434 (0.0005) [2023-12-28 00:44:28,852][106226] Updated weights for policy 0, policy_version 763444 (0.0005) [2023-12-28 00:44:29,399][106226] Updated weights for policy 0, policy_version 763454 (0.0008) [2023-12-28 00:44:29,455][106226] Updated weights for policy 0, policy_version 763464 (0.0009) [2023-12-28 00:44:29,497][106225] Updated weights for policy 1, policy_version 765486 (0.0007) [2023-12-28 00:44:29,503][106226] Updated weights for policy 0, policy_version 763474 (0.0006) [2023-12-28 00:44:29,553][106225] Updated weights for policy 1, policy_version 765496 (0.0007) [2023-12-28 00:44:29,612][106225] Updated weights for policy 1, policy_version 765506 (0.0008) [2023-12-28 00:44:30,262][106226] Updated weights for policy 0, policy_version 763484 (0.0005) [2023-12-28 00:44:30,331][106226] Updated weights for policy 0, policy_version 763494 (0.0006) [2023-12-28 00:44:30,361][106225] Updated weights for policy 1, policy_version 765516 (0.0008) [2023-12-28 00:44:30,390][106226] Updated weights for policy 0, policy_version 763504 (0.0008) [2023-12-28 00:44:30,412][106225] Updated weights for policy 1, policy_version 765526 (0.0006) [2023-12-28 00:44:30,461][106225] Updated weights for policy 1, policy_version 765536 (0.0006) [2023-12-28 00:44:31,023][106226] Updated weights for policy 0, policy_version 763514 (0.0006) [2023-12-28 00:44:31,087][106226] Updated weights for policy 0, policy_version 763524 (0.0008) [2023-12-28 00:44:31,149][106226] Updated weights for policy 0, policy_version 763534 (0.0008) [2023-12-28 00:44:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 391528448. Throughput: 0: 9785.7, 1: 9874.8. Samples: 391523736. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:31,175][105115] Avg episode reward: [(0, '-4.283'), (1, '-4.977')] [2023-12-28 00:44:31,215][106226] Updated weights for policy 0, policy_version 763544 (0.0009) [2023-12-28 00:44:31,220][106225] Updated weights for policy 1, policy_version 765546 (0.0008) [2023-12-28 00:44:31,282][106225] Updated weights for policy 1, policy_version 765556 (0.0008) [2023-12-28 00:44:31,340][106225] Updated weights for policy 1, policy_version 765566 (0.0009) [2023-12-28 00:44:31,415][106225] Updated weights for policy 1, policy_version 765576 (0.0008) [2023-12-28 00:44:31,997][106226] Updated weights for policy 0, policy_version 763554 (0.0008) [2023-12-28 00:44:32,053][106226] Updated weights for policy 0, policy_version 763564 (0.0008) [2023-12-28 00:44:32,110][106226] Updated weights for policy 0, policy_version 763574 (0.0006) [2023-12-28 00:44:32,115][106225] Updated weights for policy 1, policy_version 765586 (0.0007) [2023-12-28 00:44:32,166][106225] Updated weights for policy 1, policy_version 765596 (0.0008) [2023-12-28 00:44:32,224][106225] Updated weights for policy 1, policy_version 765606 (0.0008) [2023-12-28 00:44:32,908][106226] Updated weights for policy 0, policy_version 763584 (0.0008) [2023-12-28 00:44:32,957][106225] Updated weights for policy 1, policy_version 765616 (0.0007) [2023-12-28 00:44:32,970][106226] Updated weights for policy 0, policy_version 763594 (0.0007) [2023-12-28 00:44:33,017][106225] Updated weights for policy 1, policy_version 765626 (0.0007) [2023-12-28 00:44:33,032][106226] Updated weights for policy 0, policy_version 763604 (0.0005) [2023-12-28 00:44:33,075][106225] Updated weights for policy 1, policy_version 765636 (0.0008) [2023-12-28 00:44:33,716][106226] Updated weights for policy 0, policy_version 763614 (0.0007) [2023-12-28 00:44:33,773][106226] Updated weights for policy 0, policy_version 763624 (0.0007) [2023-12-28 00:44:33,786][106225] Updated weights for policy 1, policy_version 765646 (0.0009) [2023-12-28 00:44:33,830][106226] Updated weights for policy 0, policy_version 763634 (0.0005) [2023-12-28 00:44:33,844][106225] Updated weights for policy 1, policy_version 765656 (0.0006) [2023-12-28 00:44:33,892][106225] Updated weights for policy 1, policy_version 765666 (0.0007) [2023-12-28 00:44:34,530][106226] Updated weights for policy 0, policy_version 763644 (0.0009) [2023-12-28 00:44:34,588][106226] Updated weights for policy 0, policy_version 763654 (0.0008) [2023-12-28 00:44:34,637][106225] Updated weights for policy 1, policy_version 765676 (0.0007) [2023-12-28 00:44:34,650][106226] Updated weights for policy 0, policy_version 763664 (0.0009) [2023-12-28 00:44:34,698][106225] Updated weights for policy 1, policy_version 765686 (0.0008) [2023-12-28 00:44:34,757][106225] Updated weights for policy 1, policy_version 765696 (0.0008) [2023-12-28 00:44:35,377][106226] Updated weights for policy 0, policy_version 763674 (0.0007) [2023-12-28 00:44:35,426][106226] Updated weights for policy 0, policy_version 763684 (0.0009) [2023-12-28 00:44:35,479][106225] Updated weights for policy 1, policy_version 765706 (0.0008) [2023-12-28 00:44:35,480][106226] Updated weights for policy 0, policy_version 763694 (0.0008) [2023-12-28 00:44:35,532][106225] Updated weights for policy 1, policy_version 765716 (0.0006) [2023-12-28 00:44:35,538][106226] Updated weights for policy 0, policy_version 763704 (0.0007) [2023-12-28 00:44:35,592][106225] Updated weights for policy 1, policy_version 765726 (0.0008) [2023-12-28 00:44:35,641][106225] Updated weights for policy 1, policy_version 765736 (0.0008) [2023-12-28 00:44:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 391626752. Throughput: 0: 9790.3, 1: 9859.4. Samples: 391639268. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:36,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.783')] [2023-12-28 00:44:36,256][106226] Updated weights for policy 0, policy_version 763714 (0.0009) [2023-12-28 00:44:36,320][106226] Updated weights for policy 0, policy_version 763724 (0.0009) [2023-12-28 00:44:36,386][106226] Updated weights for policy 0, policy_version 763734 (0.0007) [2023-12-28 00:44:36,392][106225] Updated weights for policy 1, policy_version 765746 (0.0007) [2023-12-28 00:44:36,457][106225] Updated weights for policy 1, policy_version 765756 (0.0006) [2023-12-28 00:44:36,523][106225] Updated weights for policy 1, policy_version 765766 (0.0007) [2023-12-28 00:44:37,141][106226] Updated weights for policy 0, policy_version 763744 (0.0008) [2023-12-28 00:44:37,191][106225] Updated weights for policy 1, policy_version 765776 (0.0006) [2023-12-28 00:44:37,202][106226] Updated weights for policy 0, policy_version 763754 (0.0008) [2023-12-28 00:44:37,249][106225] Updated weights for policy 1, policy_version 765786 (0.0006) [2023-12-28 00:44:37,268][106226] Updated weights for policy 0, policy_version 763764 (0.0009) [2023-12-28 00:44:37,313][106225] Updated weights for policy 1, policy_version 765796 (0.0009) [2023-12-28 00:44:37,994][106226] Updated weights for policy 0, policy_version 763774 (0.0009) [2023-12-28 00:44:38,042][106225] Updated weights for policy 1, policy_version 765806 (0.0008) [2023-12-28 00:44:38,060][106226] Updated weights for policy 0, policy_version 763784 (0.0008) [2023-12-28 00:44:38,100][106225] Updated weights for policy 1, policy_version 765816 (0.0007) [2023-12-28 00:44:38,126][106226] Updated weights for policy 0, policy_version 763794 (0.0006) [2023-12-28 00:44:38,160][106225] Updated weights for policy 1, policy_version 765826 (0.0006) [2023-12-28 00:44:38,800][106225] Updated weights for policy 1, policy_version 765836 (0.0009) [2023-12-28 00:44:38,834][106226] Updated weights for policy 0, policy_version 763804 (0.0007) [2023-12-28 00:44:38,855][106225] Updated weights for policy 1, policy_version 765846 (0.0006) [2023-12-28 00:44:38,885][106226] Updated weights for policy 0, policy_version 763814 (0.0011) [2023-12-28 00:44:38,904][106225] Updated weights for policy 1, policy_version 765856 (0.0006) [2023-12-28 00:44:38,943][106226] Updated weights for policy 0, policy_version 763824 (0.0006) [2023-12-28 00:44:39,638][106226] Updated weights for policy 0, policy_version 763834 (0.0008) [2023-12-28 00:44:39,695][106226] Updated weights for policy 0, policy_version 763844 (0.0009) [2023-12-28 00:44:39,722][106225] Updated weights for policy 1, policy_version 765866 (0.0008) [2023-12-28 00:44:39,747][106226] Updated weights for policy 0, policy_version 763854 (0.0010) [2023-12-28 00:44:39,789][106225] Updated weights for policy 1, policy_version 765876 (0.0006) [2023-12-28 00:44:39,795][106226] Updated weights for policy 0, policy_version 763864 (0.0010) [2023-12-28 00:44:39,854][106225] Updated weights for policy 1, policy_version 765886 (0.0008) [2023-12-28 00:44:39,921][106225] Updated weights for policy 1, policy_version 765896 (0.0006) [2023-12-28 00:44:40,531][106225] Updated weights for policy 1, policy_version 765906 (0.0007) [2023-12-28 00:44:40,585][106226] Updated weights for policy 0, policy_version 763874 (0.0011) [2023-12-28 00:44:40,586][106225] Updated weights for policy 1, policy_version 765916 (0.0006) [2023-12-28 00:44:40,642][106226] Updated weights for policy 0, policy_version 763884 (0.0010) [2023-12-28 00:44:40,642][106225] Updated weights for policy 1, policy_version 765926 (0.0007) [2023-12-28 00:44:40,688][106226] Updated weights for policy 0, policy_version 763894 (0.0008) [2023-12-28 00:44:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 391725056. Throughput: 0: 9798.9, 1: 9892.4. Samples: 391697168. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:41,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.683')] [2023-12-28 00:44:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000765928_196116480.pth... [2023-12-28 00:44:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000763896_195608576.pth... [2023-12-28 00:44:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000762776_195321856.pth [2023-12-28 00:44:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000764776_195821568.pth [2023-12-28 00:44:41,439][106225] Updated weights for policy 1, policy_version 765936 (0.0007) [2023-12-28 00:44:41,485][106226] Updated weights for policy 0, policy_version 763904 (0.0008) [2023-12-28 00:44:41,497][106225] Updated weights for policy 1, policy_version 765946 (0.0007) [2023-12-28 00:44:41,548][106226] Updated weights for policy 0, policy_version 763914 (0.0008) [2023-12-28 00:44:41,558][106225] Updated weights for policy 1, policy_version 765956 (0.0007) [2023-12-28 00:44:41,608][106226] Updated weights for policy 0, policy_version 763924 (0.0008) [2023-12-28 00:44:42,271][106225] Updated weights for policy 1, policy_version 765966 (0.0008) [2023-12-28 00:44:42,339][106225] Updated weights for policy 1, policy_version 765976 (0.0008) [2023-12-28 00:44:42,394][106226] Updated weights for policy 0, policy_version 763934 (0.0009) [2023-12-28 00:44:42,413][106225] Updated weights for policy 1, policy_version 765986 (0.0009) [2023-12-28 00:44:42,455][106226] Updated weights for policy 0, policy_version 763944 (0.0007) [2023-12-28 00:44:42,519][106226] Updated weights for policy 0, policy_version 763954 (0.0009) [2023-12-28 00:44:43,160][106225] Updated weights for policy 1, policy_version 765996 (0.0008) [2023-12-28 00:44:43,220][106225] Updated weights for policy 1, policy_version 766006 (0.0008) [2023-12-28 00:44:43,259][106226] Updated weights for policy 0, policy_version 763964 (0.0009) [2023-12-28 00:44:43,272][106225] Updated weights for policy 1, policy_version 766016 (0.0006) [2023-12-28 00:44:43,312][106226] Updated weights for policy 0, policy_version 763974 (0.0010) [2023-12-28 00:44:43,375][106226] Updated weights for policy 0, policy_version 763984 (0.0010) [2023-12-28 00:44:44,010][106225] Updated weights for policy 1, policy_version 766026 (0.0006) [2023-12-28 00:44:44,064][106225] Updated weights for policy 1, policy_version 766036 (0.0008) [2023-12-28 00:44:44,094][106226] Updated weights for policy 0, policy_version 763994 (0.0010) [2023-12-28 00:44:44,120][106225] Updated weights for policy 1, policy_version 766046 (0.0006) [2023-12-28 00:44:44,155][106226] Updated weights for policy 0, policy_version 764004 (0.0008) [2023-12-28 00:44:44,176][106225] Updated weights for policy 1, policy_version 766056 (0.0006) [2023-12-28 00:44:44,208][106226] Updated weights for policy 0, policy_version 764014 (0.0007) [2023-12-28 00:44:44,259][106226] Updated weights for policy 0, policy_version 764024 (0.0008) [2023-12-28 00:44:44,911][106225] Updated weights for policy 1, policy_version 766066 (0.0008) [2023-12-28 00:44:44,974][106226] Updated weights for policy 0, policy_version 764034 (0.0006) [2023-12-28 00:44:44,981][106225] Updated weights for policy 1, policy_version 766076 (0.0008) [2023-12-28 00:44:45,035][106226] Updated weights for policy 0, policy_version 764044 (0.0006) [2023-12-28 00:44:45,049][106225] Updated weights for policy 1, policy_version 766086 (0.0007) [2023-12-28 00:44:45,098][106226] Updated weights for policy 0, policy_version 764054 (0.0008) [2023-12-28 00:44:45,751][106226] Updated weights for policy 0, policy_version 764064 (0.0005) [2023-12-28 00:44:45,765][106225] Updated weights for policy 1, policy_version 766096 (0.0007) [2023-12-28 00:44:45,805][106226] Updated weights for policy 0, policy_version 764074 (0.0006) [2023-12-28 00:44:45,817][106225] Updated weights for policy 1, policy_version 766106 (0.0009) [2023-12-28 00:44:45,859][106226] Updated weights for policy 0, policy_version 764084 (0.0010) [2023-12-28 00:44:45,880][106225] Updated weights for policy 1, policy_version 766116 (0.0007) [2023-12-28 00:44:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 391823360. Throughput: 0: 9742.8, 1: 9879.0. Samples: 391811648. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:46,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.015')] [2023-12-28 00:44:46,565][106226] Updated weights for policy 0, policy_version 764094 (0.0011) [2023-12-28 00:44:46,631][106225] Updated weights for policy 1, policy_version 766126 (0.0007) [2023-12-28 00:44:46,635][106226] Updated weights for policy 0, policy_version 764104 (0.0011) [2023-12-28 00:44:46,693][106226] Updated weights for policy 0, policy_version 764114 (0.0011) [2023-12-28 00:44:46,694][106225] Updated weights for policy 1, policy_version 766136 (0.0009) [2023-12-28 00:44:46,751][106225] Updated weights for policy 1, policy_version 766146 (0.0007) [2023-12-28 00:44:47,321][106226] Updated weights for policy 0, policy_version 764124 (0.0008) [2023-12-28 00:44:47,368][106226] Updated weights for policy 0, policy_version 764134 (0.0005) [2023-12-28 00:44:47,425][106226] Updated weights for policy 0, policy_version 764144 (0.0006) [2023-12-28 00:44:47,502][106225] Updated weights for policy 1, policy_version 766156 (0.0007) [2023-12-28 00:44:47,566][106225] Updated weights for policy 1, policy_version 766166 (0.0006) [2023-12-28 00:44:47,635][106225] Updated weights for policy 1, policy_version 766176 (0.0005) [2023-12-28 00:44:48,069][106226] Updated weights for policy 0, policy_version 764154 (0.0006) [2023-12-28 00:44:48,119][106226] Updated weights for policy 0, policy_version 764164 (0.0008) [2023-12-28 00:44:48,169][106226] Updated weights for policy 0, policy_version 764174 (0.0008) [2023-12-28 00:44:48,218][106226] Updated weights for policy 0, policy_version 764184 (0.0008) [2023-12-28 00:44:48,307][106225] Updated weights for policy 1, policy_version 766186 (0.0008) [2023-12-28 00:44:48,380][106225] Updated weights for policy 1, policy_version 766196 (0.0009) [2023-12-28 00:44:48,449][106225] Updated weights for policy 1, policy_version 766206 (0.0011) [2023-12-28 00:44:48,503][106225] Updated weights for policy 1, policy_version 766216 (0.0010) [2023-12-28 00:44:48,911][106226] Updated weights for policy 0, policy_version 764194 (0.0006) [2023-12-28 00:44:48,980][106226] Updated weights for policy 0, policy_version 764204 (0.0006) [2023-12-28 00:44:49,042][106226] Updated weights for policy 0, policy_version 764214 (0.0006) [2023-12-28 00:44:49,188][106225] Updated weights for policy 1, policy_version 766226 (0.0010) [2023-12-28 00:44:49,258][106225] Updated weights for policy 1, policy_version 766236 (0.0009) [2023-12-28 00:44:49,326][106225] Updated weights for policy 1, policy_version 766246 (0.0005) [2023-12-28 00:44:49,802][106226] Updated weights for policy 0, policy_version 764224 (0.0008) [2023-12-28 00:44:49,872][106226] Updated weights for policy 0, policy_version 764234 (0.0009) [2023-12-28 00:44:49,883][106225] Updated weights for policy 1, policy_version 766256 (0.0007) [2023-12-28 00:44:49,936][106226] Updated weights for policy 0, policy_version 764244 (0.0008) [2023-12-28 00:44:49,949][106225] Updated weights for policy 1, policy_version 766266 (0.0007) [2023-12-28 00:44:50,010][106225] Updated weights for policy 1, policy_version 766276 (0.0008) [2023-12-28 00:44:50,567][106226] Updated weights for policy 0, policy_version 764254 (0.0007) [2023-12-28 00:44:50,634][106226] Updated weights for policy 0, policy_version 764264 (0.0006) [2023-12-28 00:44:50,698][106226] Updated weights for policy 0, policy_version 764274 (0.0006) [2023-12-28 00:44:50,842][106225] Updated weights for policy 1, policy_version 766286 (0.0007) [2023-12-28 00:44:50,909][106225] Updated weights for policy 1, policy_version 766296 (0.0006) [2023-12-28 00:44:50,975][106225] Updated weights for policy 1, policy_version 766306 (0.0005) [2023-12-28 00:44:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 391921664. Throughput: 0: 9730.6, 1: 9821.5. Samples: 391931136. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:51,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-5.069')] [2023-12-28 00:44:51,364][106226] Updated weights for policy 0, policy_version 764284 (0.0006) [2023-12-28 00:44:51,433][106226] Updated weights for policy 0, policy_version 764294 (0.0009) [2023-12-28 00:44:51,492][106226] Updated weights for policy 0, policy_version 764304 (0.0009) [2023-12-28 00:44:51,578][106225] Updated weights for policy 1, policy_version 766316 (0.0007) [2023-12-28 00:44:51,636][106225] Updated weights for policy 1, policy_version 766326 (0.0008) [2023-12-28 00:44:51,707][106225] Updated weights for policy 1, policy_version 766336 (0.0008) [2023-12-28 00:44:52,206][106226] Updated weights for policy 0, policy_version 764314 (0.0008) [2023-12-28 00:44:52,268][106226] Updated weights for policy 0, policy_version 764324 (0.0008) [2023-12-28 00:44:52,318][106226] Updated weights for policy 0, policy_version 764334 (0.0009) [2023-12-28 00:44:52,383][106226] Updated weights for policy 0, policy_version 764344 (0.0008) [2023-12-28 00:44:52,413][106225] Updated weights for policy 1, policy_version 766346 (0.0008) [2023-12-28 00:44:52,475][106225] Updated weights for policy 1, policy_version 766356 (0.0008) [2023-12-28 00:44:52,532][106225] Updated weights for policy 1, policy_version 766366 (0.0006) [2023-12-28 00:44:52,590][106225] Updated weights for policy 1, policy_version 766376 (0.0006) [2023-12-28 00:44:53,167][106225] Updated weights for policy 1, policy_version 766386 (0.0008) [2023-12-28 00:44:53,178][106226] Updated weights for policy 0, policy_version 764354 (0.0011) [2023-12-28 00:44:53,225][106225] Updated weights for policy 1, policy_version 766396 (0.0008) [2023-12-28 00:44:53,233][106226] Updated weights for policy 0, policy_version 764364 (0.0006) [2023-12-28 00:44:53,277][106225] Updated weights for policy 1, policy_version 766406 (0.0008) [2023-12-28 00:44:53,281][106226] Updated weights for policy 0, policy_version 764374 (0.0005) [2023-12-28 00:44:53,931][106225] Updated weights for policy 1, policy_version 766416 (0.0007) [2023-12-28 00:44:53,976][106226] Updated weights for policy 0, policy_version 764384 (0.0005) [2023-12-28 00:44:53,989][106225] Updated weights for policy 1, policy_version 766426 (0.0007) [2023-12-28 00:44:54,039][106225] Updated weights for policy 1, policy_version 766436 (0.0007) [2023-12-28 00:44:54,040][106226] Updated weights for policy 0, policy_version 764394 (0.0006) [2023-12-28 00:44:54,103][106226] Updated weights for policy 0, policy_version 764404 (0.0005) [2023-12-28 00:44:54,698][106226] Updated weights for policy 0, policy_version 764414 (0.0007) [2023-12-28 00:44:54,757][106226] Updated weights for policy 0, policy_version 764424 (0.0005) [2023-12-28 00:44:54,772][106225] Updated weights for policy 1, policy_version 766446 (0.0008) [2023-12-28 00:44:54,822][106226] Updated weights for policy 0, policy_version 764434 (0.0005) [2023-12-28 00:44:54,829][106225] Updated weights for policy 1, policy_version 766456 (0.0008) [2023-12-28 00:44:54,880][106225] Updated weights for policy 1, policy_version 766466 (0.0009) [2023-12-28 00:44:55,385][106226] Updated weights for policy 0, policy_version 764444 (0.0005) [2023-12-28 00:44:55,443][106226] Updated weights for policy 0, policy_version 764454 (0.0005) [2023-12-28 00:44:55,493][106226] Updated weights for policy 0, policy_version 764464 (0.0005) [2023-12-28 00:44:55,524][106225] Updated weights for policy 1, policy_version 766476 (0.0007) [2023-12-28 00:44:55,577][106225] Updated weights for policy 1, policy_version 766486 (0.0009) [2023-12-28 00:44:55,636][106225] Updated weights for policy 1, policy_version 766496 (0.0008) [2023-12-28 00:44:56,164][106226] Updated weights for policy 0, policy_version 764474 (0.0009) [2023-12-28 00:44:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 392019968. Throughput: 0: 9692.7, 1: 9837.5. Samples: 391991196. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:44:56,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.141')] [2023-12-28 00:44:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000766504_196263936.pth... [2023-12-28 00:44:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000765352_195969024.pth [2023-12-28 00:44:56,220][106226] Updated weights for policy 0, policy_version 764484 (0.0007) [2023-12-28 00:44:56,273][106226] Updated weights for policy 0, policy_version 764494 (0.0007) [2023-12-28 00:44:56,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000764504_195764224.pth... [2023-12-28 00:44:56,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000763352_195469312.pth [2023-12-28 00:44:56,326][106226] Updated weights for policy 0, policy_version 764504 (0.0009) [2023-12-28 00:44:56,349][106225] Updated weights for policy 1, policy_version 766506 (0.0007) [2023-12-28 00:44:56,403][106225] Updated weights for policy 1, policy_version 766516 (0.0005) [2023-12-28 00:44:56,447][106225] Updated weights for policy 1, policy_version 766526 (0.0005) [2023-12-28 00:44:56,490][106225] Updated weights for policy 1, policy_version 766536 (0.0005) [2023-12-28 00:44:57,048][106226] Updated weights for policy 0, policy_version 764514 (0.0005) [2023-12-28 00:44:57,104][106226] Updated weights for policy 0, policy_version 764524 (0.0005) [2023-12-28 00:44:57,162][106226] Updated weights for policy 0, policy_version 764534 (0.0007) [2023-12-28 00:44:57,181][106225] Updated weights for policy 1, policy_version 766546 (0.0006) [2023-12-28 00:44:57,231][106225] Updated weights for policy 1, policy_version 766556 (0.0009) [2023-12-28 00:44:57,292][106225] Updated weights for policy 1, policy_version 766566 (0.0008) [2023-12-28 00:44:57,773][106226] Updated weights for policy 0, policy_version 764544 (0.0006) [2023-12-28 00:44:57,822][106226] Updated weights for policy 0, policy_version 764554 (0.0010) [2023-12-28 00:44:57,870][106226] Updated weights for policy 0, policy_version 764564 (0.0009) [2023-12-28 00:44:57,893][106225] Updated weights for policy 1, policy_version 766576 (0.0006) [2023-12-28 00:44:57,944][106225] Updated weights for policy 1, policy_version 766586 (0.0008) [2023-12-28 00:44:57,989][106225] Updated weights for policy 1, policy_version 766596 (0.0010) [2023-12-28 00:44:58,561][106226] Updated weights for policy 0, policy_version 764574 (0.0009) [2023-12-28 00:44:58,628][106226] Updated weights for policy 0, policy_version 764584 (0.0010) [2023-12-28 00:44:58,692][106226] Updated weights for policy 0, policy_version 764594 (0.0008) [2023-12-28 00:44:58,768][106225] Updated weights for policy 1, policy_version 766606 (0.0009) [2023-12-28 00:44:58,849][106225] Updated weights for policy 1, policy_version 766616 (0.0011) [2023-12-28 00:44:58,919][106225] Updated weights for policy 1, policy_version 766626 (0.0010) [2023-12-28 00:44:59,481][106226] Updated weights for policy 0, policy_version 764604 (0.0010) [2023-12-28 00:44:59,535][106226] Updated weights for policy 0, policy_version 764614 (0.0008) [2023-12-28 00:44:59,600][106226] Updated weights for policy 0, policy_version 764624 (0.0008) [2023-12-28 00:44:59,700][106225] Updated weights for policy 1, policy_version 766636 (0.0009) [2023-12-28 00:44:59,759][106225] Updated weights for policy 1, policy_version 766646 (0.0006) [2023-12-28 00:44:59,822][106225] Updated weights for policy 1, policy_version 766656 (0.0008) [2023-12-28 00:45:00,378][106226] Updated weights for policy 0, policy_version 764634 (0.0008) [2023-12-28 00:45:00,438][106226] Updated weights for policy 0, policy_version 764644 (0.0009) [2023-12-28 00:45:00,494][106225] Updated weights for policy 1, policy_version 766666 (0.0008) [2023-12-28 00:45:00,495][106226] Updated weights for policy 0, policy_version 764654 (0.0007) [2023-12-28 00:45:00,559][106226] Updated weights for policy 0, policy_version 764664 (0.0007) [2023-12-28 00:45:00,560][106225] Updated weights for policy 1, policy_version 766676 (0.0007) [2023-12-28 00:45:00,616][106225] Updated weights for policy 1, policy_version 766686 (0.0005) [2023-12-28 00:45:00,674][106225] Updated weights for policy 1, policy_version 766696 (0.0005) [2023-12-28 00:45:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 392118272. Throughput: 0: 9780.5, 1: 9821.1. Samples: 392111996. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:45:01,175][105115] Avg episode reward: [(0, '-4.163'), (1, '-4.743')] [2023-12-28 00:45:01,343][106225] Updated weights for policy 1, policy_version 766706 (0.0006) [2023-12-28 00:45:01,348][106226] Updated weights for policy 0, policy_version 764674 (0.0008) [2023-12-28 00:45:01,415][106225] Updated weights for policy 1, policy_version 766716 (0.0008) [2023-12-28 00:45:01,417][106226] Updated weights for policy 0, policy_version 764684 (0.0008) [2023-12-28 00:45:01,467][106225] Updated weights for policy 1, policy_version 766726 (0.0007) [2023-12-28 00:45:01,484][106226] Updated weights for policy 0, policy_version 764694 (0.0008) [2023-12-28 00:45:02,168][106225] Updated weights for policy 1, policy_version 766736 (0.0007) [2023-12-28 00:45:02,226][106225] Updated weights for policy 1, policy_version 766746 (0.0006) [2023-12-28 00:45:02,228][106226] Updated weights for policy 0, policy_version 764704 (0.0007) [2023-12-28 00:45:02,285][106226] Updated weights for policy 0, policy_version 764714 (0.0007) [2023-12-28 00:45:02,291][106225] Updated weights for policy 1, policy_version 766756 (0.0006) [2023-12-28 00:45:02,337][106226] Updated weights for policy 0, policy_version 764724 (0.0006) [2023-12-28 00:45:02,974][106225] Updated weights for policy 1, policy_version 766766 (0.0009) [2023-12-28 00:45:03,030][106225] Updated weights for policy 1, policy_version 766776 (0.0010) [2023-12-28 00:45:03,067][106226] Updated weights for policy 0, policy_version 764734 (0.0008) [2023-12-28 00:45:03,083][106225] Updated weights for policy 1, policy_version 766786 (0.0010) [2023-12-28 00:45:03,113][106226] Updated weights for policy 0, policy_version 764744 (0.0006) [2023-12-28 00:45:03,164][106226] Updated weights for policy 0, policy_version 764754 (0.0009) [2023-12-28 00:45:03,653][106225] Updated weights for policy 1, policy_version 766796 (0.0007) [2023-12-28 00:45:03,703][106225] Updated weights for policy 1, policy_version 766806 (0.0005) [2023-12-28 00:45:03,766][106225] Updated weights for policy 1, policy_version 766816 (0.0005) [2023-12-28 00:45:03,876][106226] Updated weights for policy 0, policy_version 764764 (0.0007) [2023-12-28 00:45:03,931][106226] Updated weights for policy 0, policy_version 764774 (0.0009) [2023-12-28 00:45:03,985][106226] Updated weights for policy 0, policy_version 764784 (0.0009) [2023-12-28 00:45:04,432][106225] Updated weights for policy 1, policy_version 766826 (0.0006) [2023-12-28 00:45:04,494][106225] Updated weights for policy 1, policy_version 766836 (0.0008) [2023-12-28 00:45:04,559][106225] Updated weights for policy 1, policy_version 766846 (0.0007) [2023-12-28 00:45:04,622][106225] Updated weights for policy 1, policy_version 766856 (0.0009) [2023-12-28 00:45:04,730][106226] Updated weights for policy 0, policy_version 764794 (0.0009) [2023-12-28 00:45:04,778][106226] Updated weights for policy 0, policy_version 764804 (0.0007) [2023-12-28 00:45:04,834][106226] Updated weights for policy 0, policy_version 764814 (0.0006) [2023-12-28 00:45:04,888][106226] Updated weights for policy 0, policy_version 764824 (0.0005) [2023-12-28 00:45:05,251][106225] Updated weights for policy 1, policy_version 766866 (0.0008) [2023-12-28 00:45:05,308][106225] Updated weights for policy 1, policy_version 766876 (0.0010) [2023-12-28 00:45:05,366][106225] Updated weights for policy 1, policy_version 766886 (0.0007) [2023-12-28 00:45:05,490][106226] Updated weights for policy 0, policy_version 764834 (0.0005) [2023-12-28 00:45:05,551][106226] Updated weights for policy 0, policy_version 764844 (0.0006) [2023-12-28 00:45:05,608][106226] Updated weights for policy 0, policy_version 764854 (0.0005) [2023-12-28 00:45:05,956][106225] Updated weights for policy 1, policy_version 766896 (0.0007) [2023-12-28 00:45:06,010][106225] Updated weights for policy 1, policy_version 766906 (0.0009) [2023-12-28 00:45:06,067][106225] Updated weights for policy 1, policy_version 766916 (0.0005) [2023-12-28 00:45:06,097][106226] Updated weights for policy 0, policy_version 764864 (0.0006) [2023-12-28 00:45:06,164][106226] Updated weights for policy 0, policy_version 764874 (0.0009) [2023-12-28 00:45:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 392224768. Throughput: 0: 9829.1, 1: 9939.7. Samples: 392234960. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:45:06,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.993')] [2023-12-28 00:45:06,225][106226] Updated weights for policy 0, policy_version 764884 (0.0009) [2023-12-28 00:45:06,777][106225] Updated weights for policy 1, policy_version 766926 (0.0006) [2023-12-28 00:45:06,841][106225] Updated weights for policy 1, policy_version 766936 (0.0009) [2023-12-28 00:45:06,900][106225] Updated weights for policy 1, policy_version 766946 (0.0009) [2023-12-28 00:45:06,952][106226] Updated weights for policy 0, policy_version 764894 (0.0007) [2023-12-28 00:45:07,010][106226] Updated weights for policy 0, policy_version 764904 (0.0008) [2023-12-28 00:45:07,066][106226] Updated weights for policy 0, policy_version 764914 (0.0005) [2023-12-28 00:45:07,604][106225] Updated weights for policy 1, policy_version 766956 (0.0010) [2023-12-28 00:45:07,656][106225] Updated weights for policy 1, policy_version 766966 (0.0010) [2023-12-28 00:45:07,709][106225] Updated weights for policy 1, policy_version 766976 (0.0010) [2023-12-28 00:45:07,779][106226] Updated weights for policy 0, policy_version 764924 (0.0007) [2023-12-28 00:45:07,826][106226] Updated weights for policy 0, policy_version 764934 (0.0008) [2023-12-28 00:45:07,876][106226] Updated weights for policy 0, policy_version 764944 (0.0008) [2023-12-28 00:45:08,436][106225] Updated weights for policy 1, policy_version 766986 (0.0009) [2023-12-28 00:45:08,503][106225] Updated weights for policy 1, policy_version 766996 (0.0006) [2023-12-28 00:45:08,562][106225] Updated weights for policy 1, policy_version 767006 (0.0006) [2023-12-28 00:45:08,623][106225] Updated weights for policy 1, policy_version 767016 (0.0007) [2023-12-28 00:45:08,637][106226] Updated weights for policy 0, policy_version 764954 (0.0007) [2023-12-28 00:45:08,699][106226] Updated weights for policy 0, policy_version 764964 (0.0006) [2023-12-28 00:45:08,766][106226] Updated weights for policy 0, policy_version 764974 (0.0006) [2023-12-28 00:45:08,824][106226] Updated weights for policy 0, policy_version 764984 (0.0008) [2023-12-28 00:45:09,326][106225] Updated weights for policy 1, policy_version 767026 (0.0006) [2023-12-28 00:45:09,399][106225] Updated weights for policy 1, policy_version 767036 (0.0008) [2023-12-28 00:45:09,469][106225] Updated weights for policy 1, policy_version 767046 (0.0008) [2023-12-28 00:45:09,525][106226] Updated weights for policy 0, policy_version 764994 (0.0009) [2023-12-28 00:45:09,593][106226] Updated weights for policy 0, policy_version 765004 (0.0011) [2023-12-28 00:45:09,659][106226] Updated weights for policy 0, policy_version 765014 (0.0011) [2023-12-28 00:45:10,237][106225] Updated weights for policy 1, policy_version 767056 (0.0008) [2023-12-28 00:45:10,299][106225] Updated weights for policy 1, policy_version 767066 (0.0010) [2023-12-28 00:45:10,360][106225] Updated weights for policy 1, policy_version 767076 (0.0008) [2023-12-28 00:45:10,372][106226] Updated weights for policy 0, policy_version 765024 (0.0010) [2023-12-28 00:45:10,423][106226] Updated weights for policy 0, policy_version 765034 (0.0011) [2023-12-28 00:45:10,482][106226] Updated weights for policy 0, policy_version 765044 (0.0006) [2023-12-28 00:45:11,152][106226] Updated weights for policy 0, policy_version 765054 (0.0010) [2023-12-28 00:45:11,155][106225] Updated weights for policy 1, policy_version 767086 (0.0008) [2023-12-28 00:45:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 392314880. Throughput: 0: 9841.7, 1: 9948.6. Samples: 392293560. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:45:11,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.250')] [2023-12-28 00:45:11,217][106226] Updated weights for policy 0, policy_version 765064 (0.0007) [2023-12-28 00:45:11,218][106225] Updated weights for policy 1, policy_version 767096 (0.0008) [2023-12-28 00:45:11,283][106225] Updated weights for policy 1, policy_version 767106 (0.0008) [2023-12-28 00:45:11,284][106226] Updated weights for policy 0, policy_version 765074 (0.0007) [2023-12-28 00:45:11,312][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000767112_196419584.pth... [2023-12-28 00:45:11,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000765928_196116480.pth [2023-12-28 00:45:11,322][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000765080_195911680.pth... [2023-12-28 00:45:11,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000763896_195608576.pth [2023-12-28 00:45:12,045][106226] Updated weights for policy 0, policy_version 765084 (0.0008) [2023-12-28 00:45:12,062][106225] Updated weights for policy 1, policy_version 767116 (0.0008) [2023-12-28 00:45:12,101][106226] Updated weights for policy 0, policy_version 765094 (0.0006) [2023-12-28 00:45:12,123][106225] Updated weights for policy 1, policy_version 767126 (0.0008) [2023-12-28 00:45:12,161][106226] Updated weights for policy 0, policy_version 765104 (0.0006) [2023-12-28 00:45:12,183][106225] Updated weights for policy 1, policy_version 767136 (0.0006) [2023-12-28 00:45:12,890][106225] Updated weights for policy 1, policy_version 767146 (0.0007) [2023-12-28 00:45:12,910][106226] Updated weights for policy 0, policy_version 765114 (0.0008) [2023-12-28 00:45:12,954][106225] Updated weights for policy 1, policy_version 767156 (0.0006) [2023-12-28 00:45:12,961][106226] Updated weights for policy 0, policy_version 765124 (0.0008) [2023-12-28 00:45:13,017][106225] Updated weights for policy 1, policy_version 767166 (0.0010) [2023-12-28 00:45:13,017][106226] Updated weights for policy 0, policy_version 765134 (0.0009) [2023-12-28 00:45:13,061][106225] Updated weights for policy 1, policy_version 767176 (0.0010) [2023-12-28 00:45:13,066][106226] Updated weights for policy 0, policy_version 765144 (0.0008) [2023-12-28 00:45:13,753][106226] Updated weights for policy 0, policy_version 765154 (0.0005) [2023-12-28 00:45:13,761][106225] Updated weights for policy 1, policy_version 767186 (0.0008) [2023-12-28 00:45:13,812][106226] Updated weights for policy 0, policy_version 765164 (0.0008) [2023-12-28 00:45:13,820][106225] Updated weights for policy 1, policy_version 767196 (0.0007) [2023-12-28 00:45:13,869][106226] Updated weights for policy 0, policy_version 765174 (0.0010) [2023-12-28 00:45:13,879][106225] Updated weights for policy 1, policy_version 767206 (0.0005) [2023-12-28 00:45:14,512][106226] Updated weights for policy 0, policy_version 765184 (0.0006) [2023-12-28 00:45:14,519][106225] Updated weights for policy 1, policy_version 767216 (0.0009) [2023-12-28 00:45:14,574][106225] Updated weights for policy 1, policy_version 767226 (0.0010) [2023-12-28 00:45:14,577][106226] Updated weights for policy 0, policy_version 765194 (0.0005) [2023-12-28 00:45:14,627][106225] Updated weights for policy 1, policy_version 767236 (0.0010) [2023-12-28 00:45:14,636][106226] Updated weights for policy 0, policy_version 765204 (0.0006) [2023-12-28 00:45:15,262][106226] Updated weights for policy 0, policy_version 765214 (0.0007) [2023-12-28 00:45:15,319][106226] Updated weights for policy 0, policy_version 765224 (0.0008) [2023-12-28 00:45:15,380][106226] Updated weights for policy 0, policy_version 765234 (0.0008) [2023-12-28 00:45:15,413][106225] Updated weights for policy 1, policy_version 767246 (0.0010) [2023-12-28 00:45:15,462][106225] Updated weights for policy 1, policy_version 767256 (0.0010) [2023-12-28 00:45:15,509][106225] Updated weights for policy 1, policy_version 767266 (0.0010) [2023-12-28 00:45:15,987][106226] Updated weights for policy 0, policy_version 765244 (0.0006) [2023-12-28 00:45:16,037][106226] Updated weights for policy 0, policy_version 765254 (0.0008) [2023-12-28 00:45:16,087][106226] Updated weights for policy 0, policy_version 765264 (0.0008) [2023-12-28 00:45:16,105][106225] Updated weights for policy 1, policy_version 767276 (0.0010) [2023-12-28 00:45:16,158][106225] Updated weights for policy 1, policy_version 767286 (0.0010) [2023-12-28 00:45:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 392421376. Throughput: 0: 9837.3, 1: 9836.3. Samples: 392409048. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:45:16,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.054')] [2023-12-28 00:45:16,226][106225] Updated weights for policy 1, policy_version 767296 (0.0011) [2023-12-28 00:45:16,831][106226] Updated weights for policy 0, policy_version 765274 (0.0007) [2023-12-28 00:45:16,886][106226] Updated weights for policy 0, policy_version 765284 (0.0006) [2023-12-28 00:45:16,950][106226] Updated weights for policy 0, policy_version 765294 (0.0006) [2023-12-28 00:45:16,956][106225] Updated weights for policy 1, policy_version 767306 (0.0010) [2023-12-28 00:45:17,014][106226] Updated weights for policy 0, policy_version 765304 (0.0006) [2023-12-28 00:45:17,019][106225] Updated weights for policy 1, policy_version 767316 (0.0010) [2023-12-28 00:45:17,087][106225] Updated weights for policy 1, policy_version 767326 (0.0010) [2023-12-28 00:45:17,151][106225] Updated weights for policy 1, policy_version 767336 (0.0010) [2023-12-28 00:45:17,654][106226] Updated weights for policy 0, policy_version 765314 (0.0010) [2023-12-28 00:45:17,704][106226] Updated weights for policy 0, policy_version 765324 (0.0010) [2023-12-28 00:45:17,754][106226] Updated weights for policy 0, policy_version 765334 (0.0010) [2023-12-28 00:45:17,864][106225] Updated weights for policy 1, policy_version 767346 (0.0010) [2023-12-28 00:45:17,923][106225] Updated weights for policy 1, policy_version 767356 (0.0010) [2023-12-28 00:45:17,975][106225] Updated weights for policy 1, policy_version 767366 (0.0010) [2023-12-28 00:45:18,487][106226] Updated weights for policy 0, policy_version 765344 (0.0009) [2023-12-28 00:45:18,552][106226] Updated weights for policy 0, policy_version 765354 (0.0008) [2023-12-28 00:45:18,613][106226] Updated weights for policy 0, policy_version 765364 (0.0007) [2023-12-28 00:45:18,686][106225] Updated weights for policy 1, policy_version 767376 (0.0010) [2023-12-28 00:45:18,750][106225] Updated weights for policy 1, policy_version 767386 (0.0011) [2023-12-28 00:45:18,811][106225] Updated weights for policy 1, policy_version 767396 (0.0009) [2023-12-28 00:45:19,339][106226] Updated weights for policy 0, policy_version 765374 (0.0009) [2023-12-28 00:45:19,404][106226] Updated weights for policy 0, policy_version 765384 (0.0013) [2023-12-28 00:45:19,455][106226] Updated weights for policy 0, policy_version 765394 (0.0009) [2023-12-28 00:45:19,583][106225] Updated weights for policy 1, policy_version 767406 (0.0011) [2023-12-28 00:45:19,643][106225] Updated weights for policy 1, policy_version 767416 (0.0011) [2023-12-28 00:45:19,701][106225] Updated weights for policy 1, policy_version 767426 (0.0011) [2023-12-28 00:45:20,254][106226] Updated weights for policy 0, policy_version 765404 (0.0008) [2023-12-28 00:45:20,317][106226] Updated weights for policy 0, policy_version 765414 (0.0008) [2023-12-28 00:45:20,382][106226] Updated weights for policy 0, policy_version 765424 (0.0008) [2023-12-28 00:45:20,482][106225] Updated weights for policy 1, policy_version 767436 (0.0010) [2023-12-28 00:45:20,529][106225] Updated weights for policy 1, policy_version 767446 (0.0009) [2023-12-28 00:45:20,590][106225] Updated weights for policy 1, policy_version 767456 (0.0009) [2023-12-28 00:45:21,002][106226] Updated weights for policy 0, policy_version 765434 (0.0007) [2023-12-28 00:45:21,070][106226] Updated weights for policy 0, policy_version 765444 (0.0008) [2023-12-28 00:45:21,132][106226] Updated weights for policy 0, policy_version 765454 (0.0007) [2023-12-28 00:45:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 392511488. Throughput: 0: 9874.6, 1: 9841.9. Samples: 392526508. Policy #0 lag: (min: 31.0, avg: 42.0, max: 63.0) [2023-12-28 00:45:21,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-5.019')] [2023-12-28 00:45:21,185][106226] Updated weights for policy 0, policy_version 765464 (0.0008) [2023-12-28 00:45:21,421][106225] Updated weights for policy 1, policy_version 767466 (0.0008) [2023-12-28 00:45:21,479][106225] Updated weights for policy 1, policy_version 767476 (0.0007) [2023-12-28 00:45:21,536][106225] Updated weights for policy 1, policy_version 767486 (0.0007) [2023-12-28 00:45:21,598][106225] Updated weights for policy 1, policy_version 767496 (0.0005) [2023-12-28 00:45:22,000][106226] Updated weights for policy 0, policy_version 765474 (0.0006) [2023-12-28 00:45:22,065][106226] Updated weights for policy 0, policy_version 765484 (0.0009) [2023-12-28 00:45:22,126][106226] Updated weights for policy 0, policy_version 765494 (0.0009) [2023-12-28 00:45:22,343][106225] Updated weights for policy 1, policy_version 767506 (0.0009) [2023-12-28 00:45:22,418][106225] Updated weights for policy 1, policy_version 767516 (0.0008) [2023-12-28 00:45:22,486][106225] Updated weights for policy 1, policy_version 767526 (0.0008) [2023-12-28 00:45:22,855][106226] Updated weights for policy 0, policy_version 765504 (0.0009) [2023-12-28 00:45:22,918][106226] Updated weights for policy 0, policy_version 765514 (0.0009) [2023-12-28 00:45:22,994][106226] Updated weights for policy 0, policy_version 765524 (0.0009) [2023-12-28 00:45:23,159][106225] Updated weights for policy 1, policy_version 767536 (0.0006) [2023-12-28 00:45:23,221][106225] Updated weights for policy 1, policy_version 767546 (0.0006) [2023-12-28 00:45:23,271][106225] Updated weights for policy 1, policy_version 767556 (0.0008) [2023-12-28 00:45:23,710][106226] Updated weights for policy 0, policy_version 765534 (0.0007) [2023-12-28 00:45:23,775][106226] Updated weights for policy 0, policy_version 765544 (0.0005) [2023-12-28 00:45:23,839][106226] Updated weights for policy 0, policy_version 765554 (0.0007) [2023-12-28 00:45:23,950][106225] Updated weights for policy 1, policy_version 767566 (0.0009) [2023-12-28 00:45:24,004][106225] Updated weights for policy 1, policy_version 767576 (0.0009) [2023-12-28 00:45:24,060][106225] Updated weights for policy 1, policy_version 767586 (0.0009) [2023-12-28 00:45:24,423][106226] Updated weights for policy 0, policy_version 765564 (0.0006) [2023-12-28 00:45:24,470][106226] Updated weights for policy 0, policy_version 765574 (0.0009) [2023-12-28 00:45:24,518][106226] Updated weights for policy 0, policy_version 765584 (0.0008) [2023-12-28 00:45:24,793][106225] Updated weights for policy 1, policy_version 767596 (0.0009) [2023-12-28 00:45:24,855][106225] Updated weights for policy 1, policy_version 767606 (0.0009) [2023-12-28 00:45:24,912][106225] Updated weights for policy 1, policy_version 767616 (0.0009) [2023-12-28 00:45:25,255][106226] Updated weights for policy 0, policy_version 765594 (0.0008) [2023-12-28 00:45:25,317][106226] Updated weights for policy 0, policy_version 765604 (0.0008) [2023-12-28 00:45:25,372][106226] Updated weights for policy 0, policy_version 765614 (0.0009) [2023-12-28 00:45:25,417][106226] Updated weights for policy 0, policy_version 765624 (0.0008) [2023-12-28 00:45:25,677][106225] Updated weights for policy 1, policy_version 767626 (0.0009) [2023-12-28 00:45:25,734][106225] Updated weights for policy 1, policy_version 767636 (0.0009) [2023-12-28 00:45:25,796][106225] Updated weights for policy 1, policy_version 767646 (0.0009) [2023-12-28 00:45:25,856][106225] Updated weights for policy 1, policy_version 767656 (0.0009) [2023-12-28 00:45:25,990][106226] Updated weights for policy 0, policy_version 765634 (0.0006) [2023-12-28 00:45:26,053][106226] Updated weights for policy 0, policy_version 765644 (0.0005) [2023-12-28 00:45:26,113][106226] Updated weights for policy 0, policy_version 765654 (0.0008) [2023-12-28 00:45:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 392617984. Throughput: 0: 9888.7, 1: 9818.8. Samples: 392584008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:26,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-5.119')] [2023-12-28 00:45:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000767656_196558848.pth... [2023-12-28 00:45:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000765656_196059136.pth... [2023-12-28 00:45:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000766504_196263936.pth [2023-12-28 00:45:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000764504_195764224.pth [2023-12-28 00:45:26,599][106225] Updated weights for policy 1, policy_version 767666 (0.0008) [2023-12-28 00:45:26,656][106225] Updated weights for policy 1, policy_version 767676 (0.0008) [2023-12-28 00:45:26,719][106225] Updated weights for policy 1, policy_version 767686 (0.0008) [2023-12-28 00:45:26,774][106226] Updated weights for policy 0, policy_version 765664 (0.0008) [2023-12-28 00:45:26,835][106226] Updated weights for policy 0, policy_version 765674 (0.0009) [2023-12-28 00:45:26,887][106226] Updated weights for policy 0, policy_version 765684 (0.0008) [2023-12-28 00:45:27,424][106225] Updated weights for policy 1, policy_version 767696 (0.0008) [2023-12-28 00:45:27,475][106225] Updated weights for policy 1, policy_version 767706 (0.0008) [2023-12-28 00:45:27,533][106225] Updated weights for policy 1, policy_version 767716 (0.0008) [2023-12-28 00:45:27,619][106226] Updated weights for policy 0, policy_version 765694 (0.0008) [2023-12-28 00:45:27,671][106226] Updated weights for policy 0, policy_version 765704 (0.0008) [2023-12-28 00:45:27,727][106226] Updated weights for policy 0, policy_version 765714 (0.0008) [2023-12-28 00:45:28,136][106225] Updated weights for policy 1, policy_version 767726 (0.0008) [2023-12-28 00:45:28,192][106225] Updated weights for policy 1, policy_version 767736 (0.0008) [2023-12-28 00:45:28,241][106225] Updated weights for policy 1, policy_version 767746 (0.0008) [2023-12-28 00:45:28,520][106226] Updated weights for policy 0, policy_version 765724 (0.0009) [2023-12-28 00:45:28,590][106226] Updated weights for policy 0, policy_version 765734 (0.0008) [2023-12-28 00:45:28,649][106226] Updated weights for policy 0, policy_version 765744 (0.0009) [2023-12-28 00:45:28,966][106225] Updated weights for policy 1, policy_version 767756 (0.0008) [2023-12-28 00:45:29,014][106225] Updated weights for policy 1, policy_version 767766 (0.0008) [2023-12-28 00:45:29,058][106225] Updated weights for policy 1, policy_version 767776 (0.0008) [2023-12-28 00:45:29,410][106226] Updated weights for policy 0, policy_version 765754 (0.0008) [2023-12-28 00:45:29,477][106226] Updated weights for policy 0, policy_version 765764 (0.0005) [2023-12-28 00:45:29,546][106226] Updated weights for policy 0, policy_version 765774 (0.0005) [2023-12-28 00:45:29,609][106226] Updated weights for policy 0, policy_version 765784 (0.0007) [2023-12-28 00:45:29,849][106225] Updated weights for policy 1, policy_version 767786 (0.0008) [2023-12-28 00:45:29,914][106225] Updated weights for policy 1, policy_version 767796 (0.0007) [2023-12-28 00:45:29,979][106225] Updated weights for policy 1, policy_version 767806 (0.0008) [2023-12-28 00:45:30,038][106225] Updated weights for policy 1, policy_version 767816 (0.0009) [2023-12-28 00:45:30,265][106226] Updated weights for policy 0, policy_version 765794 (0.0007) [2023-12-28 00:45:30,329][106226] Updated weights for policy 0, policy_version 765804 (0.0005) [2023-12-28 00:45:30,391][106226] Updated weights for policy 0, policy_version 765814 (0.0005) [2023-12-28 00:45:30,836][106225] Updated weights for policy 1, policy_version 767826 (0.0008) [2023-12-28 00:45:30,901][106225] Updated weights for policy 1, policy_version 767836 (0.0006) [2023-12-28 00:45:30,927][106226] Updated weights for policy 0, policy_version 765824 (0.0005) [2023-12-28 00:45:30,954][106225] Updated weights for policy 1, policy_version 767846 (0.0007) [2023-12-28 00:45:30,984][106226] Updated weights for policy 0, policy_version 765834 (0.0007) [2023-12-28 00:45:31,041][106226] Updated weights for policy 0, policy_version 765844 (0.0008) [2023-12-28 00:45:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 392716288. Throughput: 0: 9950.8, 1: 9831.8. Samples: 392701868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:31,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.996')] [2023-12-28 00:45:31,613][106225] Updated weights for policy 1, policy_version 767856 (0.0006) [2023-12-28 00:45:31,681][106225] Updated weights for policy 1, policy_version 767866 (0.0008) [2023-12-28 00:45:31,754][106225] Updated weights for policy 1, policy_version 767876 (0.0008) [2023-12-28 00:45:31,774][106226] Updated weights for policy 0, policy_version 765854 (0.0007) [2023-12-28 00:45:31,829][106226] Updated weights for policy 0, policy_version 765864 (0.0008) [2023-12-28 00:45:31,892][106226] Updated weights for policy 0, policy_version 765874 (0.0008) [2023-12-28 00:45:32,389][106225] Updated weights for policy 1, policy_version 767886 (0.0008) [2023-12-28 00:45:32,443][106225] Updated weights for policy 1, policy_version 767896 (0.0008) [2023-12-28 00:45:32,522][106225] Updated weights for policy 1, policy_version 767906 (0.0008) [2023-12-28 00:45:32,614][106226] Updated weights for policy 0, policy_version 765884 (0.0008) [2023-12-28 00:45:32,680][106226] Updated weights for policy 0, policy_version 765894 (0.0008) [2023-12-28 00:45:32,749][106226] Updated weights for policy 0, policy_version 765904 (0.0009) [2023-12-28 00:45:33,153][106225] Updated weights for policy 1, policy_version 767916 (0.0006) [2023-12-28 00:45:33,208][106225] Updated weights for policy 1, policy_version 767926 (0.0008) [2023-12-28 00:45:33,262][106225] Updated weights for policy 1, policy_version 767936 (0.0008) [2023-12-28 00:45:33,469][106226] Updated weights for policy 0, policy_version 765914 (0.0009) [2023-12-28 00:45:33,523][106226] Updated weights for policy 0, policy_version 765924 (0.0008) [2023-12-28 00:45:33,584][106226] Updated weights for policy 0, policy_version 765934 (0.0009) [2023-12-28 00:45:33,644][106226] Updated weights for policy 0, policy_version 765944 (0.0008) [2023-12-28 00:45:34,000][106225] Updated weights for policy 1, policy_version 767946 (0.0009) [2023-12-28 00:45:34,052][106225] Updated weights for policy 1, policy_version 767956 (0.0007) [2023-12-28 00:45:34,107][106225] Updated weights for policy 1, policy_version 767966 (0.0005) [2023-12-28 00:45:34,171][106225] Updated weights for policy 1, policy_version 767976 (0.0007) [2023-12-28 00:45:34,319][106226] Updated weights for policy 0, policy_version 765954 (0.0009) [2023-12-28 00:45:34,385][106226] Updated weights for policy 0, policy_version 765964 (0.0010) [2023-12-28 00:45:34,450][106226] Updated weights for policy 0, policy_version 765974 (0.0009) [2023-12-28 00:45:34,804][106225] Updated weights for policy 1, policy_version 767986 (0.0005) [2023-12-28 00:45:34,866][106225] Updated weights for policy 1, policy_version 767996 (0.0007) [2023-12-28 00:45:34,926][106225] Updated weights for policy 1, policy_version 768006 (0.0008) [2023-12-28 00:45:35,130][106226] Updated weights for policy 0, policy_version 765984 (0.0010) [2023-12-28 00:45:35,183][106226] Updated weights for policy 0, policy_version 765994 (0.0011) [2023-12-28 00:45:35,231][106226] Updated weights for policy 0, policy_version 766004 (0.0011) [2023-12-28 00:45:35,587][106225] Updated weights for policy 1, policy_version 768016 (0.0008) [2023-12-28 00:45:35,636][106225] Updated weights for policy 1, policy_version 768026 (0.0008) [2023-12-28 00:45:35,680][106225] Updated weights for policy 1, policy_version 768036 (0.0008) [2023-12-28 00:45:35,908][106226] Updated weights for policy 0, policy_version 766014 (0.0010) [2023-12-28 00:45:35,957][106226] Updated weights for policy 0, policy_version 766024 (0.0009) [2023-12-28 00:45:36,017][106226] Updated weights for policy 0, policy_version 766034 (0.0005) [2023-12-28 00:45:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 392814592. Throughput: 0: 9916.4, 1: 9870.0. Samples: 392821528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:36,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-5.032')] [2023-12-28 00:45:36,338][106225] Updated weights for policy 1, policy_version 768046 (0.0007) [2023-12-28 00:45:36,397][106225] Updated weights for policy 1, policy_version 768056 (0.0008) [2023-12-28 00:45:36,454][106225] Updated weights for policy 1, policy_version 768066 (0.0008) [2023-12-28 00:45:36,663][106226] Updated weights for policy 0, policy_version 766044 (0.0007) [2023-12-28 00:45:36,733][106226] Updated weights for policy 0, policy_version 766054 (0.0008) [2023-12-28 00:45:36,792][106226] Updated weights for policy 0, policy_version 766064 (0.0008) [2023-12-28 00:45:37,192][106225] Updated weights for policy 1, policy_version 768076 (0.0008) [2023-12-28 00:45:37,252][106225] Updated weights for policy 1, policy_version 768086 (0.0007) [2023-12-28 00:45:37,305][106225] Updated weights for policy 1, policy_version 768096 (0.0008) [2023-12-28 00:45:37,386][106226] Updated weights for policy 0, policy_version 766074 (0.0009) [2023-12-28 00:45:37,452][106226] Updated weights for policy 0, policy_version 766084 (0.0009) [2023-12-28 00:45:37,510][106226] Updated weights for policy 0, policy_version 766094 (0.0009) [2023-12-28 00:45:37,555][106226] Updated weights for policy 0, policy_version 766104 (0.0008) [2023-12-28 00:45:38,049][106225] Updated weights for policy 1, policy_version 768106 (0.0008) [2023-12-28 00:45:38,107][106225] Updated weights for policy 1, policy_version 768116 (0.0006) [2023-12-28 00:45:38,167][106225] Updated weights for policy 1, policy_version 768126 (0.0007) [2023-12-28 00:45:38,192][106226] Updated weights for policy 0, policy_version 766114 (0.0011) [2023-12-28 00:45:38,227][106225] Updated weights for policy 1, policy_version 768136 (0.0010) [2023-12-28 00:45:38,238][106226] Updated weights for policy 0, policy_version 766124 (0.0010) [2023-12-28 00:45:38,291][106226] Updated weights for policy 0, policy_version 766134 (0.0010) [2023-12-28 00:45:38,857][106225] Updated weights for policy 1, policy_version 768146 (0.0008) [2023-12-28 00:45:38,912][106225] Updated weights for policy 1, policy_version 768156 (0.0009) [2023-12-28 00:45:38,962][106225] Updated weights for policy 1, policy_version 768166 (0.0009) [2023-12-28 00:45:39,035][106226] Updated weights for policy 0, policy_version 766144 (0.0009) [2023-12-28 00:45:39,095][106226] Updated weights for policy 0, policy_version 766154 (0.0009) [2023-12-28 00:45:39,152][106226] Updated weights for policy 0, policy_version 766164 (0.0009) [2023-12-28 00:45:39,778][106225] Updated weights for policy 1, policy_version 768176 (0.0009) [2023-12-28 00:45:39,846][106225] Updated weights for policy 1, policy_version 768186 (0.0011) [2023-12-28 00:45:39,908][106225] Updated weights for policy 1, policy_version 768196 (0.0007) [2023-12-28 00:45:39,956][106226] Updated weights for policy 0, policy_version 766174 (0.0008) [2023-12-28 00:45:40,016][106226] Updated weights for policy 0, policy_version 766184 (0.0008) [2023-12-28 00:45:40,079][106226] Updated weights for policy 0, policy_version 766194 (0.0008) [2023-12-28 00:45:40,542][106225] Updated weights for policy 1, policy_version 768206 (0.0012) [2023-12-28 00:45:40,602][106225] Updated weights for policy 1, policy_version 768216 (0.0007) [2023-12-28 00:45:40,661][106225] Updated weights for policy 1, policy_version 768226 (0.0010) [2023-12-28 00:45:40,836][106226] Updated weights for policy 0, policy_version 766204 (0.0008) [2023-12-28 00:45:40,887][106226] Updated weights for policy 0, policy_version 766214 (0.0008) [2023-12-28 00:45:40,933][106226] Updated weights for policy 0, policy_version 766224 (0.0007) [2023-12-28 00:45:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 392912896. Throughput: 0: 9982.8, 1: 9847.3. Samples: 392883552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:41,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.816')] [2023-12-28 00:45:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000768232_196706304.pth... [2023-12-28 00:45:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000766232_196206592.pth... [2023-12-28 00:45:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000767112_196419584.pth [2023-12-28 00:45:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000765080_195911680.pth [2023-12-28 00:45:41,442][106225] Updated weights for policy 1, policy_version 768236 (0.0010) [2023-12-28 00:45:41,500][106225] Updated weights for policy 1, policy_version 768246 (0.0009) [2023-12-28 00:45:41,558][106225] Updated weights for policy 1, policy_version 768256 (0.0008) [2023-12-28 00:45:41,749][106226] Updated weights for policy 0, policy_version 766234 (0.0007) [2023-12-28 00:45:41,802][106226] Updated weights for policy 0, policy_version 766244 (0.0008) [2023-12-28 00:45:41,855][106226] Updated weights for policy 0, policy_version 766254 (0.0008) [2023-12-28 00:45:41,908][106226] Updated weights for policy 0, policy_version 766264 (0.0008) [2023-12-28 00:45:42,354][106225] Updated weights for policy 1, policy_version 768266 (0.0010) [2023-12-28 00:45:42,419][106225] Updated weights for policy 1, policy_version 768276 (0.0009) [2023-12-28 00:45:42,473][106225] Updated weights for policy 1, policy_version 768286 (0.0010) [2023-12-28 00:45:42,524][106225] Updated weights for policy 1, policy_version 768296 (0.0009) [2023-12-28 00:45:42,639][106226] Updated weights for policy 0, policy_version 766274 (0.0006) [2023-12-28 00:45:42,694][106226] Updated weights for policy 0, policy_version 766284 (0.0005) [2023-12-28 00:45:42,753][106226] Updated weights for policy 0, policy_version 766294 (0.0005) [2023-12-28 00:45:43,246][106225] Updated weights for policy 1, policy_version 768306 (0.0006) [2023-12-28 00:45:43,303][106225] Updated weights for policy 1, policy_version 768316 (0.0007) [2023-12-28 00:45:43,367][106225] Updated weights for policy 1, policy_version 768326 (0.0010) [2023-12-28 00:45:43,436][106226] Updated weights for policy 0, policy_version 766304 (0.0006) [2023-12-28 00:45:43,500][106226] Updated weights for policy 0, policy_version 766314 (0.0008) [2023-12-28 00:45:43,564][106226] Updated weights for policy 0, policy_version 766324 (0.0008) [2023-12-28 00:45:44,006][106225] Updated weights for policy 1, policy_version 768336 (0.0010) [2023-12-28 00:45:44,062][106225] Updated weights for policy 1, policy_version 768346 (0.0010) [2023-12-28 00:45:44,120][106225] Updated weights for policy 1, policy_version 768356 (0.0010) [2023-12-28 00:45:44,263][106226] Updated weights for policy 0, policy_version 766334 (0.0007) [2023-12-28 00:45:44,307][106226] Updated weights for policy 0, policy_version 766344 (0.0009) [2023-12-28 00:45:44,360][106226] Updated weights for policy 0, policy_version 766354 (0.0010) [2023-12-28 00:45:44,725][106225] Updated weights for policy 1, policy_version 768366 (0.0007) [2023-12-28 00:45:44,806][106225] Updated weights for policy 1, policy_version 768376 (0.0007) [2023-12-28 00:45:44,859][106225] Updated weights for policy 1, policy_version 768386 (0.0010) [2023-12-28 00:45:45,093][106226] Updated weights for policy 0, policy_version 766364 (0.0010) [2023-12-28 00:45:45,143][106226] Updated weights for policy 0, policy_version 766374 (0.0007) [2023-12-28 00:45:45,207][106226] Updated weights for policy 0, policy_version 766384 (0.0008) [2023-12-28 00:45:45,552][106225] Updated weights for policy 1, policy_version 768396 (0.0010) [2023-12-28 00:45:45,607][106225] Updated weights for policy 1, policy_version 768406 (0.0010) [2023-12-28 00:45:45,664][106225] Updated weights for policy 1, policy_version 768416 (0.0010) [2023-12-28 00:45:45,948][106226] Updated weights for policy 0, policy_version 766394 (0.0008) [2023-12-28 00:45:46,014][106226] Updated weights for policy 0, policy_version 766404 (0.0009) [2023-12-28 00:45:46,070][106226] Updated weights for policy 0, policy_version 766414 (0.0008) [2023-12-28 00:45:46,133][106226] Updated weights for policy 0, policy_version 766424 (0.0006) [2023-12-28 00:45:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 393011200. Throughput: 0: 9881.8, 1: 9825.4. Samples: 392998824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:46,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.115')] [2023-12-28 00:45:46,379][106225] Updated weights for policy 1, policy_version 768426 (0.0010) [2023-12-28 00:45:46,439][106225] Updated weights for policy 1, policy_version 768436 (0.0009) [2023-12-28 00:45:46,495][106225] Updated weights for policy 1, policy_version 768446 (0.0010) [2023-12-28 00:45:46,560][106225] Updated weights for policy 1, policy_version 768456 (0.0011) [2023-12-28 00:45:46,684][106226] Updated weights for policy 0, policy_version 766434 (0.0008) [2023-12-28 00:45:46,738][106226] Updated weights for policy 0, policy_version 766444 (0.0008) [2023-12-28 00:45:46,790][106226] Updated weights for policy 0, policy_version 766454 (0.0008) [2023-12-28 00:45:47,250][106225] Updated weights for policy 1, policy_version 768466 (0.0011) [2023-12-28 00:45:47,309][106225] Updated weights for policy 1, policy_version 768476 (0.0010) [2023-12-28 00:45:47,369][106225] Updated weights for policy 1, policy_version 768486 (0.0009) [2023-12-28 00:45:47,506][106226] Updated weights for policy 0, policy_version 766464 (0.0006) [2023-12-28 00:45:47,565][106226] Updated weights for policy 0, policy_version 766474 (0.0006) [2023-12-28 00:45:47,627][106226] Updated weights for policy 0, policy_version 766484 (0.0010) [2023-12-28 00:45:48,160][106225] Updated weights for policy 1, policy_version 768496 (0.0007) [2023-12-28 00:45:48,219][106225] Updated weights for policy 1, policy_version 768506 (0.0005) [2023-12-28 00:45:48,242][106226] Updated weights for policy 0, policy_version 766494 (0.0008) [2023-12-28 00:45:48,278][106225] Updated weights for policy 1, policy_version 768516 (0.0007) [2023-12-28 00:45:48,303][106226] Updated weights for policy 0, policy_version 766504 (0.0008) [2023-12-28 00:45:48,370][106226] Updated weights for policy 0, policy_version 766514 (0.0009) [2023-12-28 00:45:48,999][106225] Updated weights for policy 1, policy_version 768526 (0.0007) [2023-12-28 00:45:49,049][106225] Updated weights for policy 1, policy_version 768536 (0.0007) [2023-12-28 00:45:49,113][106225] Updated weights for policy 1, policy_version 768546 (0.0007) [2023-12-28 00:45:49,121][106226] Updated weights for policy 0, policy_version 766524 (0.0011) [2023-12-28 00:45:49,185][106226] Updated weights for policy 0, policy_version 766534 (0.0011) [2023-12-28 00:45:49,258][106226] Updated weights for policy 0, policy_version 766544 (0.0014) [2023-12-28 00:45:49,907][106225] Updated weights for policy 1, policy_version 768556 (0.0007) [2023-12-28 00:45:49,927][106226] Updated weights for policy 0, policy_version 766554 (0.0009) [2023-12-28 00:45:49,973][106225] Updated weights for policy 1, policy_version 768566 (0.0008) [2023-12-28 00:45:49,994][106226] Updated weights for policy 0, policy_version 766564 (0.0008) [2023-12-28 00:45:50,030][106225] Updated weights for policy 1, policy_version 768576 (0.0008) [2023-12-28 00:45:50,060][106226] Updated weights for policy 0, policy_version 766574 (0.0006) [2023-12-28 00:45:50,119][106226] Updated weights for policy 0, policy_version 766584 (0.0006) [2023-12-28 00:45:50,757][106226] Updated weights for policy 0, policy_version 766594 (0.0008) [2023-12-28 00:45:50,790][106225] Updated weights for policy 1, policy_version 768586 (0.0008) [2023-12-28 00:45:50,821][106226] Updated weights for policy 0, policy_version 766604 (0.0009) [2023-12-28 00:45:50,849][106225] Updated weights for policy 1, policy_version 768596 (0.0007) [2023-12-28 00:45:50,882][106226] Updated weights for policy 0, policy_version 766614 (0.0009) [2023-12-28 00:45:50,908][106225] Updated weights for policy 1, policy_version 768606 (0.0006) [2023-12-28 00:45:50,967][106225] Updated weights for policy 1, policy_version 768616 (0.0008) [2023-12-28 00:45:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 393109504. Throughput: 0: 9882.8, 1: 9688.6. Samples: 393115672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:51,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-5.168')] [2023-12-28 00:45:51,656][106226] Updated weights for policy 0, policy_version 766624 (0.0008) [2023-12-28 00:45:51,720][106226] Updated weights for policy 0, policy_version 766634 (0.0009) [2023-12-28 00:45:51,737][106225] Updated weights for policy 1, policy_version 768626 (0.0007) [2023-12-28 00:45:51,789][106226] Updated weights for policy 0, policy_version 766644 (0.0008) [2023-12-28 00:45:51,804][106225] Updated weights for policy 1, policy_version 768636 (0.0008) [2023-12-28 00:45:51,863][106225] Updated weights for policy 1, policy_version 768646 (0.0008) [2023-12-28 00:45:52,507][106226] Updated weights for policy 0, policy_version 766654 (0.0008) [2023-12-28 00:45:52,568][106226] Updated weights for policy 0, policy_version 766664 (0.0009) [2023-12-28 00:45:52,620][106226] Updated weights for policy 0, policy_version 766674 (0.0008) [2023-12-28 00:45:52,653][106225] Updated weights for policy 1, policy_version 768656 (0.0008) [2023-12-28 00:45:52,719][106225] Updated weights for policy 1, policy_version 768666 (0.0009) [2023-12-28 00:45:52,786][106225] Updated weights for policy 1, policy_version 768676 (0.0008) [2023-12-28 00:45:53,326][106226] Updated weights for policy 0, policy_version 766684 (0.0007) [2023-12-28 00:45:53,381][106226] Updated weights for policy 0, policy_version 766694 (0.0005) [2023-12-28 00:45:53,437][106226] Updated weights for policy 0, policy_version 766704 (0.0005) [2023-12-28 00:45:53,516][106225] Updated weights for policy 1, policy_version 768686 (0.0007) [2023-12-28 00:45:53,566][106225] Updated weights for policy 1, policy_version 768696 (0.0008) [2023-12-28 00:45:53,628][106225] Updated weights for policy 1, policy_version 768706 (0.0009) [2023-12-28 00:45:54,083][106226] Updated weights for policy 0, policy_version 766714 (0.0006) [2023-12-28 00:45:54,139][106226] Updated weights for policy 0, policy_version 766724 (0.0009) [2023-12-28 00:45:54,193][106226] Updated weights for policy 0, policy_version 766734 (0.0008) [2023-12-28 00:45:54,212][106225] Updated weights for policy 1, policy_version 768716 (0.0007) [2023-12-28 00:45:54,248][106226] Updated weights for policy 0, policy_version 766744 (0.0010) [2023-12-28 00:45:54,263][106225] Updated weights for policy 1, policy_version 768726 (0.0007) [2023-12-28 00:45:54,314][106225] Updated weights for policy 1, policy_version 768736 (0.0007) [2023-12-28 00:45:54,989][106226] Updated weights for policy 0, policy_version 766754 (0.0007) [2023-12-28 00:45:55,015][106225] Updated weights for policy 1, policy_version 768746 (0.0008) [2023-12-28 00:45:55,051][106226] Updated weights for policy 0, policy_version 766764 (0.0009) [2023-12-28 00:45:55,069][106225] Updated weights for policy 1, policy_version 768756 (0.0006) [2023-12-28 00:45:55,112][106226] Updated weights for policy 0, policy_version 766774 (0.0009) [2023-12-28 00:45:55,119][106225] Updated weights for policy 1, policy_version 768766 (0.0005) [2023-12-28 00:45:55,176][106225] Updated weights for policy 1, policy_version 768776 (0.0007) [2023-12-28 00:45:55,872][106225] Updated weights for policy 1, policy_version 768786 (0.0009) [2023-12-28 00:45:55,898][106226] Updated weights for policy 0, policy_version 766784 (0.0007) [2023-12-28 00:45:55,934][106225] Updated weights for policy 1, policy_version 768796 (0.0007) [2023-12-28 00:45:55,959][106226] Updated weights for policy 0, policy_version 766794 (0.0006) [2023-12-28 00:45:55,998][106225] Updated weights for policy 1, policy_version 768806 (0.0007) [2023-12-28 00:45:56,019][106226] Updated weights for policy 0, policy_version 766804 (0.0006) [2023-12-28 00:45:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 393207808. Throughput: 0: 9912.3, 1: 9632.1. Samples: 393173060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:45:56,176][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.651')] [2023-12-28 00:45:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000766808_196354048.pth... [2023-12-28 00:45:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000768808_196853760.pth... [2023-12-28 00:45:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000765656_196059136.pth [2023-12-28 00:45:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000767656_196558848.pth [2023-12-28 00:45:56,193][106141] Saving new best policy, reward=-4.651! [2023-12-28 00:45:56,556][106225] Updated weights for policy 1, policy_version 768816 (0.0007) [2023-12-28 00:45:56,617][106225] Updated weights for policy 1, policy_version 768826 (0.0006) [2023-12-28 00:45:56,675][106225] Updated weights for policy 1, policy_version 768836 (0.0005) [2023-12-28 00:45:56,683][106226] Updated weights for policy 0, policy_version 766814 (0.0008) [2023-12-28 00:45:56,740][106226] Updated weights for policy 0, policy_version 766824 (0.0010) [2023-12-28 00:45:56,796][106226] Updated weights for policy 0, policy_version 766834 (0.0007) [2023-12-28 00:45:57,217][106225] Updated weights for policy 1, policy_version 768846 (0.0006) [2023-12-28 00:45:57,271][106225] Updated weights for policy 1, policy_version 768856 (0.0005) [2023-12-28 00:45:57,329][106225] Updated weights for policy 1, policy_version 768866 (0.0005) [2023-12-28 00:45:57,356][106226] Updated weights for policy 0, policy_version 766844 (0.0006) [2023-12-28 00:45:57,411][106226] Updated weights for policy 0, policy_version 766854 (0.0005) [2023-12-28 00:45:57,465][106226] Updated weights for policy 0, policy_version 766864 (0.0008) [2023-12-28 00:45:57,976][106225] Updated weights for policy 1, policy_version 768876 (0.0005) [2023-12-28 00:45:58,028][106225] Updated weights for policy 1, policy_version 768886 (0.0007) [2023-12-28 00:45:58,043][106226] Updated weights for policy 0, policy_version 766874 (0.0009) [2023-12-28 00:45:58,076][106225] Updated weights for policy 1, policy_version 768896 (0.0005) [2023-12-28 00:45:58,100][106226] Updated weights for policy 0, policy_version 766884 (0.0006) [2023-12-28 00:45:58,153][106226] Updated weights for policy 0, policy_version 766894 (0.0005) [2023-12-28 00:45:58,219][106226] Updated weights for policy 0, policy_version 766904 (0.0008) [2023-12-28 00:45:58,833][106225] Updated weights for policy 1, policy_version 768906 (0.0007) [2023-12-28 00:45:58,904][106225] Updated weights for policy 1, policy_version 768916 (0.0009) [2023-12-28 00:45:58,969][106225] Updated weights for policy 1, policy_version 768926 (0.0010) [2023-12-28 00:45:58,973][106226] Updated weights for policy 0, policy_version 766914 (0.0006) [2023-12-28 00:45:59,024][106225] Updated weights for policy 1, policy_version 768936 (0.0010) [2023-12-28 00:45:59,036][106226] Updated weights for policy 0, policy_version 766924 (0.0008) [2023-12-28 00:45:59,094][106226] Updated weights for policy 0, policy_version 766934 (0.0008) [2023-12-28 00:45:59,716][106225] Updated weights for policy 1, policy_version 768947 (0.0007) [2023-12-28 00:45:59,780][106225] Updated weights for policy 1, policy_version 768957 (0.0008) [2023-12-28 00:45:59,839][106225] Updated weights for policy 1, policy_version 768967 (0.0008) [2023-12-28 00:45:59,882][106226] Updated weights for policy 0, policy_version 766944 (0.0007) [2023-12-28 00:45:59,943][106226] Updated weights for policy 0, policy_version 766954 (0.0007) [2023-12-28 00:46:00,009][106226] Updated weights for policy 0, policy_version 766964 (0.0007) [2023-12-28 00:46:00,590][106225] Updated weights for policy 1, policy_version 768977 (0.0009) [2023-12-28 00:46:00,647][106226] Updated weights for policy 0, policy_version 766974 (0.0007) [2023-12-28 00:46:00,650][106225] Updated weights for policy 1, policy_version 768987 (0.0008) [2023-12-28 00:46:00,700][106226] Updated weights for policy 0, policy_version 766984 (0.0006) [2023-12-28 00:46:00,703][106225] Updated weights for policy 1, policy_version 768997 (0.0007) [2023-12-28 00:46:00,760][106226] Updated weights for policy 0, policy_version 766994 (0.0006) [2023-12-28 00:46:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 393306112. Throughput: 0: 9915.0, 1: 9792.6. Samples: 393295892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:01,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.929')] [2023-12-28 00:46:01,480][106226] Updated weights for policy 0, policy_version 767004 (0.0006) [2023-12-28 00:46:01,541][106226] Updated weights for policy 0, policy_version 767014 (0.0005) [2023-12-28 00:46:01,553][106225] Updated weights for policy 1, policy_version 769007 (0.0008) [2023-12-28 00:46:01,605][106226] Updated weights for policy 0, policy_version 767024 (0.0006) [2023-12-28 00:46:01,622][106225] Updated weights for policy 1, policy_version 769017 (0.0007) [2023-12-28 00:46:01,686][106225] Updated weights for policy 1, policy_version 769027 (0.0008) [2023-12-28 00:46:02,350][106226] Updated weights for policy 0, policy_version 767034 (0.0008) [2023-12-28 00:46:02,412][106226] Updated weights for policy 0, policy_version 767044 (0.0008) [2023-12-28 00:46:02,422][106225] Updated weights for policy 1, policy_version 769037 (0.0007) [2023-12-28 00:46:02,475][106226] Updated weights for policy 0, policy_version 767054 (0.0007) [2023-12-28 00:46:02,484][106225] Updated weights for policy 1, policy_version 769047 (0.0009) [2023-12-28 00:46:02,535][106226] Updated weights for policy 0, policy_version 767064 (0.0007) [2023-12-28 00:46:02,545][106225] Updated weights for policy 1, policy_version 769057 (0.0007) [2023-12-28 00:46:03,158][106226] Updated weights for policy 0, policy_version 767074 (0.0005) [2023-12-28 00:46:03,206][106226] Updated weights for policy 0, policy_version 767084 (0.0007) [2023-12-28 00:46:03,254][106225] Updated weights for policy 1, policy_version 769067 (0.0009) [2023-12-28 00:46:03,270][106226] Updated weights for policy 0, policy_version 767094 (0.0008) [2023-12-28 00:46:03,303][106225] Updated weights for policy 1, policy_version 769077 (0.0008) [2023-12-28 00:46:03,363][106225] Updated weights for policy 1, policy_version 769087 (0.0006) [2023-12-28 00:46:03,978][106226] Updated weights for policy 0, policy_version 767104 (0.0010) [2023-12-28 00:46:04,041][106226] Updated weights for policy 0, policy_version 767114 (0.0011) [2023-12-28 00:46:04,105][106226] Updated weights for policy 0, policy_version 767124 (0.0011) [2023-12-28 00:46:04,115][106225] Updated weights for policy 1, policy_version 769097 (0.0008) [2023-12-28 00:46:04,180][106225] Updated weights for policy 1, policy_version 769107 (0.0007) [2023-12-28 00:46:04,246][106225] Updated weights for policy 1, policy_version 769117 (0.0008) [2023-12-28 00:46:04,310][106225] Updated weights for policy 1, policy_version 769127 (0.0008) [2023-12-28 00:46:04,853][106226] Updated weights for policy 0, policy_version 767134 (0.0008) [2023-12-28 00:46:04,921][106226] Updated weights for policy 0, policy_version 767144 (0.0006) [2023-12-28 00:46:04,991][106226] Updated weights for policy 0, policy_version 767154 (0.0006) [2023-12-28 00:46:05,082][106225] Updated weights for policy 1, policy_version 769137 (0.0006) [2023-12-28 00:46:05,140][106225] Updated weights for policy 1, policy_version 769147 (0.0005) [2023-12-28 00:46:05,201][106225] Updated weights for policy 1, policy_version 769157 (0.0005) [2023-12-28 00:46:05,594][106226] Updated weights for policy 0, policy_version 767164 (0.0009) [2023-12-28 00:46:05,648][106226] Updated weights for policy 0, policy_version 767174 (0.0005) [2023-12-28 00:46:05,699][106226] Updated weights for policy 0, policy_version 767184 (0.0005) [2023-12-28 00:46:05,831][106225] Updated weights for policy 1, policy_version 769167 (0.0010) [2023-12-28 00:46:05,889][106225] Updated weights for policy 1, policy_version 769177 (0.0010) [2023-12-28 00:46:05,953][106225] Updated weights for policy 1, policy_version 769187 (0.0010) [2023-12-28 00:46:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 393404416. Throughput: 0: 9941.0, 1: 9765.9. Samples: 393413320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:06,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.686')] [2023-12-28 00:46:06,376][106226] Updated weights for policy 0, policy_version 767194 (0.0006) [2023-12-28 00:46:06,440][106226] Updated weights for policy 0, policy_version 767204 (0.0008) [2023-12-28 00:46:06,507][106226] Updated weights for policy 0, policy_version 767214 (0.0008) [2023-12-28 00:46:06,574][106226] Updated weights for policy 0, policy_version 767224 (0.0008) [2023-12-28 00:46:06,682][106225] Updated weights for policy 1, policy_version 769197 (0.0010) [2023-12-28 00:46:06,744][106225] Updated weights for policy 1, policy_version 769207 (0.0010) [2023-12-28 00:46:06,811][106225] Updated weights for policy 1, policy_version 769217 (0.0010) [2023-12-28 00:46:07,344][106226] Updated weights for policy 0, policy_version 767234 (0.0008) [2023-12-28 00:46:07,403][106226] Updated weights for policy 0, policy_version 767244 (0.0008) [2023-12-28 00:46:07,465][106226] Updated weights for policy 0, policy_version 767254 (0.0007) [2023-12-28 00:46:07,517][106225] Updated weights for policy 1, policy_version 769227 (0.0010) [2023-12-28 00:46:07,573][106225] Updated weights for policy 1, policy_version 769237 (0.0011) [2023-12-28 00:46:07,635][106225] Updated weights for policy 1, policy_version 769247 (0.0011) [2023-12-28 00:46:08,241][106226] Updated weights for policy 0, policy_version 767264 (0.0010) [2023-12-28 00:46:08,282][106225] Updated weights for policy 1, policy_version 769257 (0.0009) [2023-12-28 00:46:08,299][106226] Updated weights for policy 0, policy_version 767274 (0.0009) [2023-12-28 00:46:08,347][106225] Updated weights for policy 1, policy_version 769267 (0.0008) [2023-12-28 00:46:08,366][106226] Updated weights for policy 0, policy_version 767284 (0.0008) [2023-12-28 00:46:08,407][106225] Updated weights for policy 1, policy_version 769277 (0.0010) [2023-12-28 00:46:08,468][106225] Updated weights for policy 1, policy_version 769287 (0.0010) [2023-12-28 00:46:09,139][106226] Updated weights for policy 0, policy_version 767294 (0.0009) [2023-12-28 00:46:09,154][106225] Updated weights for policy 1, policy_version 769297 (0.0008) [2023-12-28 00:46:09,200][106226] Updated weights for policy 0, policy_version 767304 (0.0008) [2023-12-28 00:46:09,210][106225] Updated weights for policy 1, policy_version 769307 (0.0007) [2023-12-28 00:46:09,270][106226] Updated weights for policy 0, policy_version 767314 (0.0007) [2023-12-28 00:46:09,285][106225] Updated weights for policy 1, policy_version 769317 (0.0008) [2023-12-28 00:46:10,001][106226] Updated weights for policy 0, policy_version 767324 (0.0008) [2023-12-28 00:46:10,066][106226] Updated weights for policy 0, policy_version 767334 (0.0008) [2023-12-28 00:46:10,134][106225] Updated weights for policy 1, policy_version 769327 (0.0006) [2023-12-28 00:46:10,138][106226] Updated weights for policy 0, policy_version 767344 (0.0007) [2023-12-28 00:46:10,194][106225] Updated weights for policy 1, policy_version 769337 (0.0007) [2023-12-28 00:46:10,252][106225] Updated weights for policy 1, policy_version 769347 (0.0008) [2023-12-28 00:46:10,853][106225] Updated weights for policy 1, policy_version 769357 (0.0008) [2023-12-28 00:46:10,864][106226] Updated weights for policy 0, policy_version 767354 (0.0006) [2023-12-28 00:46:10,908][106225] Updated weights for policy 1, policy_version 769367 (0.0007) [2023-12-28 00:46:10,925][106226] Updated weights for policy 0, policy_version 767364 (0.0008) [2023-12-28 00:46:10,963][106225] Updated weights for policy 1, policy_version 769377 (0.0007) [2023-12-28 00:46:10,981][106226] Updated weights for policy 0, policy_version 767374 (0.0007) [2023-12-28 00:46:11,042][106226] Updated weights for policy 0, policy_version 767384 (0.0006) [2023-12-28 00:46:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 393502720. Throughput: 0: 9900.5, 1: 9780.5. Samples: 393469648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:11,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.289')] [2023-12-28 00:46:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000769384_197001216.pth... [2023-12-28 00:46:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000767384_196501504.pth... [2023-12-28 00:46:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000766232_196206592.pth [2023-12-28 00:46:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000768232_196706304.pth [2023-12-28 00:46:11,804][106225] Updated weights for policy 1, policy_version 769387 (0.0007) [2023-12-28 00:46:11,867][106225] Updated weights for policy 1, policy_version 769397 (0.0008) [2023-12-28 00:46:11,906][106226] Updated weights for policy 0, policy_version 767394 (0.0008) [2023-12-28 00:46:11,931][106225] Updated weights for policy 1, policy_version 769407 (0.0009) [2023-12-28 00:46:11,966][106226] Updated weights for policy 0, policy_version 767404 (0.0009) [2023-12-28 00:46:12,028][106226] Updated weights for policy 0, policy_version 767414 (0.0007) [2023-12-28 00:46:12,644][106225] Updated weights for policy 1, policy_version 769417 (0.0008) [2023-12-28 00:46:12,705][106225] Updated weights for policy 1, policy_version 769427 (0.0008) [2023-12-28 00:46:12,769][106225] Updated weights for policy 1, policy_version 769437 (0.0008) [2023-12-28 00:46:12,779][106226] Updated weights for policy 0, policy_version 767424 (0.0007) [2023-12-28 00:46:12,830][106225] Updated weights for policy 1, policy_version 769447 (0.0006) [2023-12-28 00:46:12,840][106226] Updated weights for policy 0, policy_version 767434 (0.0007) [2023-12-28 00:46:12,907][106226] Updated weights for policy 0, policy_version 767444 (0.0009) [2023-12-28 00:46:13,536][106225] Updated weights for policy 1, policy_version 769457 (0.0009) [2023-12-28 00:46:13,595][106225] Updated weights for policy 1, policy_version 769467 (0.0010) [2023-12-28 00:46:13,634][106226] Updated weights for policy 0, policy_version 767454 (0.0008) [2023-12-28 00:46:13,654][106225] Updated weights for policy 1, policy_version 769477 (0.0006) [2023-12-28 00:46:13,690][106226] Updated weights for policy 0, policy_version 767464 (0.0010) [2023-12-28 00:46:13,743][106226] Updated weights for policy 0, policy_version 767474 (0.0008) [2023-12-28 00:46:14,285][106225] Updated weights for policy 1, policy_version 769487 (0.0009) [2023-12-28 00:46:14,349][106225] Updated weights for policy 1, policy_version 769497 (0.0010) [2023-12-28 00:46:14,363][106226] Updated weights for policy 0, policy_version 767484 (0.0007) [2023-12-28 00:46:14,406][106225] Updated weights for policy 1, policy_version 769507 (0.0008) [2023-12-28 00:46:14,428][106226] Updated weights for policy 0, policy_version 767494 (0.0009) [2023-12-28 00:46:14,482][106226] Updated weights for policy 0, policy_version 767504 (0.0010) [2023-12-28 00:46:15,084][106225] Updated weights for policy 1, policy_version 769517 (0.0010) [2023-12-28 00:46:15,127][106226] Updated weights for policy 0, policy_version 767514 (0.0010) [2023-12-28 00:46:15,148][106225] Updated weights for policy 1, policy_version 769527 (0.0010) [2023-12-28 00:46:15,177][106226] Updated weights for policy 0, policy_version 767524 (0.0007) [2023-12-28 00:46:15,218][106225] Updated weights for policy 1, policy_version 769537 (0.0011) [2023-12-28 00:46:15,236][106226] Updated weights for policy 0, policy_version 767534 (0.0008) [2023-12-28 00:46:15,292][106226] Updated weights for policy 0, policy_version 767544 (0.0008) [2023-12-28 00:46:15,925][106225] Updated weights for policy 1, policy_version 769547 (0.0010) [2023-12-28 00:46:15,982][106225] Updated weights for policy 1, policy_version 769557 (0.0008) [2023-12-28 00:46:16,017][106226] Updated weights for policy 0, policy_version 767554 (0.0010) [2023-12-28 00:46:16,035][106225] Updated weights for policy 1, policy_version 769567 (0.0006) [2023-12-28 00:46:16,077][106226] Updated weights for policy 0, policy_version 767564 (0.0011) [2023-12-28 00:46:16,124][106226] Updated weights for policy 0, policy_version 767574 (0.0010) [2023-12-28 00:46:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 393601024. Throughput: 0: 9848.2, 1: 9773.7. Samples: 393584860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:16,176][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.016')] [2023-12-28 00:46:16,679][106226] Updated weights for policy 0, policy_version 767584 (0.0005) [2023-12-28 00:46:16,735][106226] Updated weights for policy 0, policy_version 767594 (0.0005) [2023-12-28 00:46:16,743][106225] Updated weights for policy 1, policy_version 769577 (0.0006) [2023-12-28 00:46:16,801][106226] Updated weights for policy 0, policy_version 767604 (0.0011) [2023-12-28 00:46:16,806][106225] Updated weights for policy 1, policy_version 769587 (0.0005) [2023-12-28 00:46:16,860][106225] Updated weights for policy 1, policy_version 769597 (0.0006) [2023-12-28 00:46:16,912][106225] Updated weights for policy 1, policy_version 769607 (0.0008) [2023-12-28 00:46:17,464][106226] Updated weights for policy 0, policy_version 767614 (0.0009) [2023-12-28 00:46:17,525][106226] Updated weights for policy 0, policy_version 767624 (0.0006) [2023-12-28 00:46:17,590][106226] Updated weights for policy 0, policy_version 767634 (0.0007) [2023-12-28 00:46:17,645][106225] Updated weights for policy 1, policy_version 769617 (0.0007) [2023-12-28 00:46:17,717][106225] Updated weights for policy 1, policy_version 769627 (0.0007) [2023-12-28 00:46:17,784][106225] Updated weights for policy 1, policy_version 769637 (0.0007) [2023-12-28 00:46:18,276][106226] Updated weights for policy 0, policy_version 767644 (0.0009) [2023-12-28 00:46:18,347][106226] Updated weights for policy 0, policy_version 767654 (0.0011) [2023-12-28 00:46:18,406][106226] Updated weights for policy 0, policy_version 767664 (0.0007) [2023-12-28 00:46:18,423][106225] Updated weights for policy 1, policy_version 769647 (0.0009) [2023-12-28 00:46:18,476][106225] Updated weights for policy 1, policy_version 769657 (0.0010) [2023-12-28 00:46:18,527][106225] Updated weights for policy 1, policy_version 769667 (0.0010) [2023-12-28 00:46:19,155][106225] Updated weights for policy 1, policy_version 769677 (0.0008) [2023-12-28 00:46:19,178][106226] Updated weights for policy 0, policy_version 767674 (0.0007) [2023-12-28 00:46:19,215][106225] Updated weights for policy 1, policy_version 769687 (0.0008) [2023-12-28 00:46:19,250][106226] Updated weights for policy 0, policy_version 767684 (0.0009) [2023-12-28 00:46:19,279][106225] Updated weights for policy 1, policy_version 769697 (0.0011) [2023-12-28 00:46:19,315][106226] Updated weights for policy 0, policy_version 767694 (0.0007) [2023-12-28 00:46:19,381][106226] Updated weights for policy 0, policy_version 767704 (0.0008) [2023-12-28 00:46:20,057][106225] Updated weights for policy 1, policy_version 769707 (0.0009) [2023-12-28 00:46:20,122][106225] Updated weights for policy 1, policy_version 769717 (0.0007) [2023-12-28 00:46:20,147][106226] Updated weights for policy 0, policy_version 767714 (0.0007) [2023-12-28 00:46:20,184][106225] Updated weights for policy 1, policy_version 769727 (0.0008) [2023-12-28 00:46:20,210][106226] Updated weights for policy 0, policy_version 767724 (0.0006) [2023-12-28 00:46:20,272][106226] Updated weights for policy 0, policy_version 767734 (0.0009) [2023-12-28 00:46:20,859][106225] Updated weights for policy 1, policy_version 769737 (0.0009) [2023-12-28 00:46:20,922][106225] Updated weights for policy 1, policy_version 769747 (0.0009) [2023-12-28 00:46:20,981][106225] Updated weights for policy 1, policy_version 769757 (0.0007) [2023-12-28 00:46:20,994][106226] Updated weights for policy 0, policy_version 767744 (0.0009) [2023-12-28 00:46:21,043][106225] Updated weights for policy 1, policy_version 769767 (0.0007) [2023-12-28 00:46:21,061][106226] Updated weights for policy 0, policy_version 767754 (0.0008) [2023-12-28 00:46:21,128][106226] Updated weights for policy 0, policy_version 767764 (0.0006) [2023-12-28 00:46:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 393699328. Throughput: 0: 9820.8, 1: 9769.7. Samples: 393703100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:21,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-5.148')] [2023-12-28 00:46:21,871][106225] Updated weights for policy 1, policy_version 769777 (0.0009) [2023-12-28 00:46:21,895][106226] Updated weights for policy 0, policy_version 767774 (0.0008) [2023-12-28 00:46:21,934][106225] Updated weights for policy 1, policy_version 769787 (0.0007) [2023-12-28 00:46:21,962][106226] Updated weights for policy 0, policy_version 767784 (0.0008) [2023-12-28 00:46:21,994][106225] Updated weights for policy 1, policy_version 769797 (0.0007) [2023-12-28 00:46:22,029][106226] Updated weights for policy 0, policy_version 767794 (0.0008) [2023-12-28 00:46:22,688][106226] Updated weights for policy 0, policy_version 767804 (0.0008) [2023-12-28 00:46:22,752][106226] Updated weights for policy 0, policy_version 767814 (0.0008) [2023-12-28 00:46:22,780][106225] Updated weights for policy 1, policy_version 769807 (0.0007) [2023-12-28 00:46:22,816][106226] Updated weights for policy 0, policy_version 767824 (0.0010) [2023-12-28 00:46:22,836][106225] Updated weights for policy 1, policy_version 769817 (0.0007) [2023-12-28 00:46:22,889][106225] Updated weights for policy 1, policy_version 769827 (0.0008) [2023-12-28 00:46:23,500][106226] Updated weights for policy 0, policy_version 767834 (0.0006) [2023-12-28 00:46:23,551][106226] Updated weights for policy 0, policy_version 767844 (0.0006) [2023-12-28 00:46:23,604][106226] Updated weights for policy 0, policy_version 767854 (0.0007) [2023-12-28 00:46:23,647][106225] Updated weights for policy 1, policy_version 769837 (0.0008) [2023-12-28 00:46:23,650][106226] Updated weights for policy 0, policy_version 767864 (0.0005) [2023-12-28 00:46:23,706][106225] Updated weights for policy 1, policy_version 769847 (0.0009) [2023-12-28 00:46:23,755][106225] Updated weights for policy 1, policy_version 769857 (0.0007) [2023-12-28 00:46:24,353][106225] Updated weights for policy 1, policy_version 769867 (0.0005) [2023-12-28 00:46:24,414][106225] Updated weights for policy 1, policy_version 769877 (0.0005) [2023-12-28 00:46:24,429][106226] Updated weights for policy 0, policy_version 767874 (0.0008) [2023-12-28 00:46:24,470][106225] Updated weights for policy 1, policy_version 769887 (0.0005) [2023-12-28 00:46:24,492][106226] Updated weights for policy 0, policy_version 767884 (0.0008) [2023-12-28 00:46:24,545][106226] Updated weights for policy 0, policy_version 767894 (0.0007) [2023-12-28 00:46:25,108][106225] Updated weights for policy 1, policy_version 769897 (0.0008) [2023-12-28 00:46:25,159][106225] Updated weights for policy 1, policy_version 769907 (0.0008) [2023-12-28 00:46:25,214][106225] Updated weights for policy 1, policy_version 769917 (0.0007) [2023-12-28 00:46:25,274][106225] Updated weights for policy 1, policy_version 769927 (0.0007) [2023-12-28 00:46:25,292][106226] Updated weights for policy 0, policy_version 767904 (0.0008) [2023-12-28 00:46:25,351][106226] Updated weights for policy 0, policy_version 767914 (0.0009) [2023-12-28 00:46:25,402][106226] Updated weights for policy 0, policy_version 767924 (0.0008) [2023-12-28 00:46:25,995][106225] Updated weights for policy 1, policy_version 769937 (0.0005) [2023-12-28 00:46:26,057][106225] Updated weights for policy 1, policy_version 769947 (0.0006) [2023-12-28 00:46:26,114][106225] Updated weights for policy 1, policy_version 769957 (0.0009) [2023-12-28 00:46:26,124][106226] Updated weights for policy 0, policy_version 767934 (0.0007) [2023-12-28 00:46:26,175][105115] Fps is (10 sec: 18842.2, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 393789440. Throughput: 0: 9762.7, 1: 9695.5. Samples: 393759168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:26,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.148')] [2023-12-28 00:46:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000769960_197148672.pth... [2023-12-28 00:46:26,185][106226] Updated weights for policy 0, policy_version 767944 (0.0005) [2023-12-28 00:46:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000768808_196853760.pth [2023-12-28 00:46:26,239][106226] Updated weights for policy 0, policy_version 767954 (0.0008) [2023-12-28 00:46:26,267][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000767960_196648960.pth... [2023-12-28 00:46:26,270][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000766808_196354048.pth [2023-12-28 00:46:26,731][106225] Updated weights for policy 1, policy_version 769967 (0.0007) [2023-12-28 00:46:26,782][106225] Updated weights for policy 1, policy_version 769978 (0.0009) [2023-12-28 00:46:26,828][106225] Updated weights for policy 1, policy_version 769988 (0.0009) [2023-12-28 00:46:26,954][106226] Updated weights for policy 0, policy_version 767964 (0.0009) [2023-12-28 00:46:27,006][106226] Updated weights for policy 0, policy_version 767974 (0.0008) [2023-12-28 00:46:27,063][106226] Updated weights for policy 0, policy_version 767984 (0.0008) [2023-12-28 00:46:27,564][106225] Updated weights for policy 1, policy_version 769998 (0.0008) [2023-12-28 00:46:27,608][106225] Updated weights for policy 1, policy_version 770008 (0.0008) [2023-12-28 00:46:27,669][106225] Updated weights for policy 1, policy_version 770018 (0.0008) [2023-12-28 00:46:27,799][106226] Updated weights for policy 0, policy_version 767994 (0.0008) [2023-12-28 00:46:27,856][106226] Updated weights for policy 0, policy_version 768004 (0.0007) [2023-12-28 00:46:27,903][106226] Updated weights for policy 0, policy_version 768014 (0.0008) [2023-12-28 00:46:27,953][106226] Updated weights for policy 0, policy_version 768024 (0.0008) [2023-12-28 00:46:28,410][106225] Updated weights for policy 1, policy_version 770028 (0.0007) [2023-12-28 00:46:28,469][106225] Updated weights for policy 1, policy_version 770038 (0.0005) [2023-12-28 00:46:28,529][106225] Updated weights for policy 1, policy_version 770048 (0.0007) [2023-12-28 00:46:28,742][106226] Updated weights for policy 0, policy_version 768034 (0.0010) [2023-12-28 00:46:28,807][106226] Updated weights for policy 0, policy_version 768044 (0.0009) [2023-12-28 00:46:28,870][106226] Updated weights for policy 0, policy_version 768054 (0.0010) [2023-12-28 00:46:29,170][106225] Updated weights for policy 1, policy_version 770058 (0.0008) [2023-12-28 00:46:29,229][106225] Updated weights for policy 1, policy_version 770068 (0.0008) [2023-12-28 00:46:29,289][106225] Updated weights for policy 1, policy_version 770078 (0.0007) [2023-12-28 00:46:29,358][106225] Updated weights for policy 1, policy_version 770088 (0.0008) [2023-12-28 00:46:29,623][106226] Updated weights for policy 0, policy_version 768064 (0.0010) [2023-12-28 00:46:29,677][106226] Updated weights for policy 0, policy_version 768074 (0.0010) [2023-12-28 00:46:29,725][106226] Updated weights for policy 0, policy_version 768084 (0.0011) [2023-12-28 00:46:30,070][106225] Updated weights for policy 1, policy_version 770098 (0.0008) [2023-12-28 00:46:30,131][106225] Updated weights for policy 1, policy_version 770108 (0.0007) [2023-12-28 00:46:30,195][106225] Updated weights for policy 1, policy_version 770118 (0.0008) [2023-12-28 00:46:30,469][106226] Updated weights for policy 0, policy_version 768094 (0.0010) [2023-12-28 00:46:30,524][106226] Updated weights for policy 0, policy_version 768104 (0.0010) [2023-12-28 00:46:30,583][106226] Updated weights for policy 0, policy_version 768114 (0.0011) [2023-12-28 00:46:30,897][106225] Updated weights for policy 1, policy_version 770128 (0.0010) [2023-12-28 00:46:30,949][106225] Updated weights for policy 1, policy_version 770138 (0.0010) [2023-12-28 00:46:30,994][106225] Updated weights for policy 1, policy_version 770148 (0.0010) [2023-12-28 00:46:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 393887744. Throughput: 0: 9757.2, 1: 9767.3. Samples: 393877424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:31,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.976')] [2023-12-28 00:46:31,292][106226] Updated weights for policy 0, policy_version 768124 (0.0011) [2023-12-28 00:46:31,364][106226] Updated weights for policy 0, policy_version 768134 (0.0009) [2023-12-28 00:46:31,418][106226] Updated weights for policy 0, policy_version 768144 (0.0008) [2023-12-28 00:46:31,721][106225] Updated weights for policy 1, policy_version 770158 (0.0009) [2023-12-28 00:46:31,782][106225] Updated weights for policy 1, policy_version 770168 (0.0008) [2023-12-28 00:46:31,840][106225] Updated weights for policy 1, policy_version 770178 (0.0008) [2023-12-28 00:46:32,093][106226] Updated weights for policy 0, policy_version 768154 (0.0008) [2023-12-28 00:46:32,159][106226] Updated weights for policy 0, policy_version 768164 (0.0007) [2023-12-28 00:46:32,216][106226] Updated weights for policy 0, policy_version 768174 (0.0010) [2023-12-28 00:46:32,281][106226] Updated weights for policy 0, policy_version 768184 (0.0007) [2023-12-28 00:46:32,523][106225] Updated weights for policy 1, policy_version 770188 (0.0008) [2023-12-28 00:46:32,574][106225] Updated weights for policy 1, policy_version 770198 (0.0008) [2023-12-28 00:46:32,631][106225] Updated weights for policy 1, policy_version 770208 (0.0010) [2023-12-28 00:46:32,944][106226] Updated weights for policy 0, policy_version 768194 (0.0008) [2023-12-28 00:46:32,991][106226] Updated weights for policy 0, policy_version 768204 (0.0008) [2023-12-28 00:46:33,038][106226] Updated weights for policy 0, policy_version 768214 (0.0008) [2023-12-28 00:46:33,291][106225] Updated weights for policy 1, policy_version 770218 (0.0010) [2023-12-28 00:46:33,342][106225] Updated weights for policy 1, policy_version 770228 (0.0008) [2023-12-28 00:46:33,386][106225] Updated weights for policy 1, policy_version 770238 (0.0008) [2023-12-28 00:46:33,437][106225] Updated weights for policy 1, policy_version 770248 (0.0008) [2023-12-28 00:46:33,790][106226] Updated weights for policy 0, policy_version 768224 (0.0008) [2023-12-28 00:46:33,855][106226] Updated weights for policy 0, policy_version 768234 (0.0009) [2023-12-28 00:46:33,912][106226] Updated weights for policy 0, policy_version 768244 (0.0010) [2023-12-28 00:46:34,144][106225] Updated weights for policy 1, policy_version 770258 (0.0008) [2023-12-28 00:46:34,209][106225] Updated weights for policy 1, policy_version 770268 (0.0009) [2023-12-28 00:46:34,278][106225] Updated weights for policy 1, policy_version 770278 (0.0011) [2023-12-28 00:46:34,624][106226] Updated weights for policy 0, policy_version 768254 (0.0011) [2023-12-28 00:46:34,679][106226] Updated weights for policy 0, policy_version 768264 (0.0011) [2023-12-28 00:46:34,726][106226] Updated weights for policy 0, policy_version 768274 (0.0010) [2023-12-28 00:46:34,913][106225] Updated weights for policy 1, policy_version 770288 (0.0010) [2023-12-28 00:46:34,957][106225] Updated weights for policy 1, policy_version 770298 (0.0009) [2023-12-28 00:46:35,008][106225] Updated weights for policy 1, policy_version 770308 (0.0010) [2023-12-28 00:46:35,368][106226] Updated weights for policy 0, policy_version 768284 (0.0011) [2023-12-28 00:46:35,418][106226] Updated weights for policy 0, policy_version 768294 (0.0010) [2023-12-28 00:46:35,475][106226] Updated weights for policy 0, policy_version 768304 (0.0010) [2023-12-28 00:46:35,709][106225] Updated weights for policy 1, policy_version 770318 (0.0010) [2023-12-28 00:46:35,759][106225] Updated weights for policy 1, policy_version 770328 (0.0010) [2023-12-28 00:46:35,808][106225] Updated weights for policy 1, policy_version 770338 (0.0010) [2023-12-28 00:46:36,169][106226] Updated weights for policy 0, policy_version 768314 (0.0010) [2023-12-28 00:46:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 393986048. Throughput: 0: 9740.5, 1: 9854.0. Samples: 393997428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:36,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.189')] [2023-12-28 00:46:36,235][106226] Updated weights for policy 0, policy_version 768324 (0.0011) [2023-12-28 00:46:36,297][106226] Updated weights for policy 0, policy_version 768334 (0.0011) [2023-12-28 00:46:36,362][106226] Updated weights for policy 0, policy_version 768344 (0.0011) [2023-12-28 00:46:36,489][106225] Updated weights for policy 1, policy_version 770348 (0.0010) [2023-12-28 00:46:36,543][106225] Updated weights for policy 1, policy_version 770358 (0.0009) [2023-12-28 00:46:36,601][106225] Updated weights for policy 1, policy_version 770368 (0.0010) [2023-12-28 00:46:37,050][106226] Updated weights for policy 0, policy_version 768354 (0.0010) [2023-12-28 00:46:37,096][106226] Updated weights for policy 0, policy_version 768364 (0.0010) [2023-12-28 00:46:37,156][106226] Updated weights for policy 0, policy_version 768374 (0.0010) [2023-12-28 00:46:37,274][106225] Updated weights for policy 1, policy_version 770378 (0.0009) [2023-12-28 00:46:37,325][106225] Updated weights for policy 1, policy_version 770388 (0.0010) [2023-12-28 00:46:37,390][106225] Updated weights for policy 1, policy_version 770398 (0.0011) [2023-12-28 00:46:37,447][106225] Updated weights for policy 1, policy_version 770408 (0.0010) [2023-12-28 00:46:37,850][106226] Updated weights for policy 0, policy_version 768384 (0.0006) [2023-12-28 00:46:37,903][106226] Updated weights for policy 0, policy_version 768394 (0.0006) [2023-12-28 00:46:37,958][106226] Updated weights for policy 0, policy_version 768404 (0.0006) [2023-12-28 00:46:38,049][106225] Updated weights for policy 1, policy_version 770418 (0.0010) [2023-12-28 00:46:38,099][106225] Updated weights for policy 1, policy_version 770428 (0.0008) [2023-12-28 00:46:38,152][106225] Updated weights for policy 1, policy_version 770438 (0.0007) [2023-12-28 00:46:38,676][106226] Updated weights for policy 0, policy_version 768414 (0.0007) [2023-12-28 00:46:38,737][106226] Updated weights for policy 0, policy_version 768424 (0.0007) [2023-12-28 00:46:38,794][106226] Updated weights for policy 0, policy_version 768434 (0.0008) [2023-12-28 00:46:38,864][106225] Updated weights for policy 1, policy_version 770448 (0.0007) [2023-12-28 00:46:38,922][106225] Updated weights for policy 1, policy_version 770458 (0.0008) [2023-12-28 00:46:38,981][106225] Updated weights for policy 1, policy_version 770468 (0.0008) [2023-12-28 00:46:39,580][106226] Updated weights for policy 0, policy_version 768444 (0.0006) [2023-12-28 00:46:39,638][106226] Updated weights for policy 0, policy_version 768454 (0.0008) [2023-12-28 00:46:39,696][106226] Updated weights for policy 0, policy_version 768464 (0.0009) [2023-12-28 00:46:39,748][106225] Updated weights for policy 1, policy_version 770478 (0.0006) [2023-12-28 00:46:39,814][106225] Updated weights for policy 1, policy_version 770488 (0.0006) [2023-12-28 00:46:39,881][106225] Updated weights for policy 1, policy_version 770498 (0.0008) [2023-12-28 00:46:40,463][106226] Updated weights for policy 0, policy_version 768474 (0.0009) [2023-12-28 00:46:40,524][106226] Updated weights for policy 0, policy_version 768484 (0.0011) [2023-12-28 00:46:40,526][106225] Updated weights for policy 1, policy_version 770508 (0.0008) [2023-12-28 00:46:40,589][106226] Updated weights for policy 0, policy_version 768494 (0.0011) [2023-12-28 00:46:40,593][106225] Updated weights for policy 1, policy_version 770518 (0.0005) [2023-12-28 00:46:40,651][106226] Updated weights for policy 0, policy_version 768504 (0.0011) [2023-12-28 00:46:40,652][106225] Updated weights for policy 1, policy_version 770528 (0.0006) [2023-12-28 00:46:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 394084352. Throughput: 0: 9733.3, 1: 9938.3. Samples: 394058276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:41,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.891')] [2023-12-28 00:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000770536_197296128.pth... [2023-12-28 00:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000768504_196788224.pth... [2023-12-28 00:46:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000767384_196501504.pth [2023-12-28 00:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000769384_197001216.pth [2023-12-28 00:46:41,369][106225] Updated weights for policy 1, policy_version 770538 (0.0008) [2023-12-28 00:46:41,412][106226] Updated weights for policy 0, policy_version 768514 (0.0010) [2023-12-28 00:46:41,434][106225] Updated weights for policy 1, policy_version 770548 (0.0008) [2023-12-28 00:46:41,471][106226] Updated weights for policy 0, policy_version 768524 (0.0009) [2023-12-28 00:46:41,490][106225] Updated weights for policy 1, policy_version 770558 (0.0008) [2023-12-28 00:46:41,530][106226] Updated weights for policy 0, policy_version 768534 (0.0009) [2023-12-28 00:46:41,549][106225] Updated weights for policy 1, policy_version 770568 (0.0008) [2023-12-28 00:46:42,325][106226] Updated weights for policy 0, policy_version 768544 (0.0010) [2023-12-28 00:46:42,352][106225] Updated weights for policy 1, policy_version 770578 (0.0011) [2023-12-28 00:46:42,405][106226] Updated weights for policy 0, policy_version 768554 (0.0008) [2023-12-28 00:46:42,419][106225] Updated weights for policy 1, policy_version 770588 (0.0008) [2023-12-28 00:46:42,457][106226] Updated weights for policy 0, policy_version 768564 (0.0007) [2023-12-28 00:46:42,482][106225] Updated weights for policy 1, policy_version 770598 (0.0008) [2023-12-28 00:46:43,191][106225] Updated weights for policy 1, policy_version 770608 (0.0008) [2023-12-28 00:46:43,210][106226] Updated weights for policy 0, policy_version 768574 (0.0006) [2023-12-28 00:46:43,254][106225] Updated weights for policy 1, policy_version 770618 (0.0007) [2023-12-28 00:46:43,275][106226] Updated weights for policy 0, policy_version 768584 (0.0009) [2023-12-28 00:46:43,316][106225] Updated weights for policy 1, policy_version 770628 (0.0008) [2023-12-28 00:46:43,333][106226] Updated weights for policy 0, policy_version 768594 (0.0009) [2023-12-28 00:46:43,976][106225] Updated weights for policy 1, policy_version 770638 (0.0007) [2023-12-28 00:46:44,038][106225] Updated weights for policy 1, policy_version 770648 (0.0009) [2023-12-28 00:46:44,073][106226] Updated weights for policy 0, policy_version 768604 (0.0007) [2023-12-28 00:46:44,095][106225] Updated weights for policy 1, policy_version 770658 (0.0007) [2023-12-28 00:46:44,133][106226] Updated weights for policy 0, policy_version 768614 (0.0008) [2023-12-28 00:46:44,195][106226] Updated weights for policy 0, policy_version 768624 (0.0008) [2023-12-28 00:46:44,798][106225] Updated weights for policy 1, policy_version 770668 (0.0008) [2023-12-28 00:46:44,868][106225] Updated weights for policy 1, policy_version 770678 (0.0007) [2023-12-28 00:46:44,933][106225] Updated weights for policy 1, policy_version 770688 (0.0007) [2023-12-28 00:46:44,943][106226] Updated weights for policy 0, policy_version 768634 (0.0009) [2023-12-28 00:46:45,011][106226] Updated weights for policy 0, policy_version 768644 (0.0008) [2023-12-28 00:46:45,083][106226] Updated weights for policy 0, policy_version 768654 (0.0009) [2023-12-28 00:46:45,146][106226] Updated weights for policy 0, policy_version 768664 (0.0008) [2023-12-28 00:46:45,638][106225] Updated weights for policy 1, policy_version 770698 (0.0008) [2023-12-28 00:46:45,685][106225] Updated weights for policy 1, policy_version 770708 (0.0008) [2023-12-28 00:46:45,737][106225] Updated weights for policy 1, policy_version 770718 (0.0008) [2023-12-28 00:46:45,784][106225] Updated weights for policy 1, policy_version 770728 (0.0007) [2023-12-28 00:46:45,818][106226] Updated weights for policy 0, policy_version 768674 (0.0007) [2023-12-28 00:46:45,870][106226] Updated weights for policy 0, policy_version 768684 (0.0009) [2023-12-28 00:46:45,922][106226] Updated weights for policy 0, policy_version 768694 (0.0008) [2023-12-28 00:46:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 394182656. Throughput: 0: 9644.2, 1: 9803.7. Samples: 394171044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:46,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.072')] [2023-12-28 00:46:46,531][106225] Updated weights for policy 1, policy_version 770738 (0.0006) [2023-12-28 00:46:46,593][106225] Updated weights for policy 1, policy_version 770748 (0.0008) [2023-12-28 00:46:46,611][106226] Updated weights for policy 0, policy_version 768704 (0.0006) [2023-12-28 00:46:46,650][106225] Updated weights for policy 1, policy_version 770758 (0.0008) [2023-12-28 00:46:46,670][106226] Updated weights for policy 0, policy_version 768714 (0.0006) [2023-12-28 00:46:46,721][106226] Updated weights for policy 0, policy_version 768724 (0.0009) [2023-12-28 00:46:47,339][106225] Updated weights for policy 1, policy_version 770768 (0.0008) [2023-12-28 00:46:47,402][106225] Updated weights for policy 1, policy_version 770778 (0.0008) [2023-12-28 00:46:47,417][106226] Updated weights for policy 0, policy_version 768734 (0.0007) [2023-12-28 00:46:47,460][106225] Updated weights for policy 1, policy_version 770788 (0.0007) [2023-12-28 00:46:47,474][106226] Updated weights for policy 0, policy_version 768744 (0.0007) [2023-12-28 00:46:47,533][106226] Updated weights for policy 0, policy_version 768754 (0.0008) [2023-12-28 00:46:48,128][106225] Updated weights for policy 1, policy_version 770798 (0.0006) [2023-12-28 00:46:48,183][106225] Updated weights for policy 1, policy_version 770808 (0.0006) [2023-12-28 00:46:48,236][106225] Updated weights for policy 1, policy_version 770818 (0.0008) [2023-12-28 00:46:48,340][106226] Updated weights for policy 0, policy_version 768764 (0.0008) [2023-12-28 00:46:48,407][106226] Updated weights for policy 0, policy_version 768774 (0.0009) [2023-12-28 00:46:48,464][106226] Updated weights for policy 0, policy_version 768784 (0.0009) [2023-12-28 00:46:48,939][106225] Updated weights for policy 1, policy_version 770828 (0.0008) [2023-12-28 00:46:48,990][106225] Updated weights for policy 1, policy_version 770838 (0.0008) [2023-12-28 00:46:49,042][106225] Updated weights for policy 1, policy_version 770848 (0.0008) [2023-12-28 00:46:49,183][106226] Updated weights for policy 0, policy_version 768794 (0.0008) [2023-12-28 00:46:49,250][106226] Updated weights for policy 0, policy_version 768804 (0.0007) [2023-12-28 00:46:49,314][106226] Updated weights for policy 0, policy_version 768814 (0.0008) [2023-12-28 00:46:49,389][106226] Updated weights for policy 0, policy_version 768824 (0.0008) [2023-12-28 00:46:49,882][106225] Updated weights for policy 1, policy_version 770858 (0.0009) [2023-12-28 00:46:49,947][106225] Updated weights for policy 1, policy_version 770868 (0.0010) [2023-12-28 00:46:50,011][106225] Updated weights for policy 1, policy_version 770878 (0.0009) [2023-12-28 00:46:50,059][106225] Updated weights for policy 1, policy_version 770888 (0.0005) [2023-12-28 00:46:50,133][106226] Updated weights for policy 0, policy_version 768834 (0.0009) [2023-12-28 00:46:50,180][106226] Updated weights for policy 0, policy_version 768844 (0.0008) [2023-12-28 00:46:50,245][106226] Updated weights for policy 0, policy_version 768854 (0.0006) [2023-12-28 00:46:50,714][106225] Updated weights for policy 1, policy_version 770898 (0.0010) [2023-12-28 00:46:50,769][106225] Updated weights for policy 1, policy_version 770908 (0.0007) [2023-12-28 00:46:50,821][106225] Updated weights for policy 1, policy_version 770918 (0.0005) [2023-12-28 00:46:51,060][106226] Updated weights for policy 0, policy_version 768864 (0.0009) [2023-12-28 00:46:51,121][106226] Updated weights for policy 0, policy_version 768874 (0.0010) [2023-12-28 00:46:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 394272768. Throughput: 0: 9551.8, 1: 9850.5. Samples: 394286424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:51,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-5.333')] [2023-12-28 00:46:51,187][106226] Updated weights for policy 0, policy_version 768884 (0.0008) [2023-12-28 00:46:51,534][106225] Updated weights for policy 1, policy_version 770928 (0.0009) [2023-12-28 00:46:51,588][106225] Updated weights for policy 1, policy_version 770938 (0.0010) [2023-12-28 00:46:51,648][106225] Updated weights for policy 1, policy_version 770948 (0.0010) [2023-12-28 00:46:51,933][106226] Updated weights for policy 0, policy_version 768894 (0.0008) [2023-12-28 00:46:51,997][106226] Updated weights for policy 0, policy_version 768904 (0.0006) [2023-12-28 00:46:52,056][106226] Updated weights for policy 0, policy_version 768914 (0.0006) [2023-12-28 00:46:52,268][106225] Updated weights for policy 1, policy_version 770958 (0.0008) [2023-12-28 00:46:52,324][106225] Updated weights for policy 1, policy_version 770968 (0.0008) [2023-12-28 00:46:52,388][106225] Updated weights for policy 1, policy_version 770978 (0.0008) [2023-12-28 00:46:52,765][106226] Updated weights for policy 0, policy_version 768924 (0.0007) [2023-12-28 00:46:52,825][106226] Updated weights for policy 0, policy_version 768934 (0.0009) [2023-12-28 00:46:52,895][106226] Updated weights for policy 0, policy_version 768944 (0.0007) [2023-12-28 00:46:53,050][106225] Updated weights for policy 1, policy_version 770988 (0.0008) [2023-12-28 00:46:53,098][106225] Updated weights for policy 1, policy_version 770998 (0.0008) [2023-12-28 00:46:53,147][106225] Updated weights for policy 1, policy_version 771008 (0.0008) [2023-12-28 00:46:53,507][106226] Updated weights for policy 0, policy_version 768954 (0.0007) [2023-12-28 00:46:53,558][106226] Updated weights for policy 0, policy_version 768964 (0.0005) [2023-12-28 00:46:53,623][106226] Updated weights for policy 0, policy_version 768974 (0.0005) [2023-12-28 00:46:53,673][106226] Updated weights for policy 0, policy_version 768984 (0.0005) [2023-12-28 00:46:53,859][106225] Updated weights for policy 1, policy_version 771018 (0.0008) [2023-12-28 00:46:53,913][106225] Updated weights for policy 1, policy_version 771028 (0.0005) [2023-12-28 00:46:53,965][106225] Updated weights for policy 1, policy_version 771038 (0.0005) [2023-12-28 00:46:54,025][106225] Updated weights for policy 1, policy_version 771048 (0.0005) [2023-12-28 00:46:54,310][106226] Updated weights for policy 0, policy_version 768994 (0.0008) [2023-12-28 00:46:54,370][106226] Updated weights for policy 0, policy_version 769004 (0.0009) [2023-12-28 00:46:54,429][106226] Updated weights for policy 0, policy_version 769014 (0.0010) [2023-12-28 00:46:54,561][106225] Updated weights for policy 1, policy_version 771058 (0.0005) [2023-12-28 00:46:54,612][106225] Updated weights for policy 1, policy_version 771068 (0.0005) [2023-12-28 00:46:54,669][106225] Updated weights for policy 1, policy_version 771078 (0.0005) [2023-12-28 00:46:55,224][106225] Updated weights for policy 1, policy_version 771088 (0.0007) [2023-12-28 00:46:55,265][106226] Updated weights for policy 0, policy_version 769024 (0.0008) [2023-12-28 00:46:55,283][106225] Updated weights for policy 1, policy_version 771098 (0.0007) [2023-12-28 00:46:55,317][106226] Updated weights for policy 0, policy_version 769034 (0.0006) [2023-12-28 00:46:55,337][106225] Updated weights for policy 1, policy_version 771108 (0.0008) [2023-12-28 00:46:55,374][106226] Updated weights for policy 0, policy_version 769044 (0.0007) [2023-12-28 00:46:56,063][106225] Updated weights for policy 1, policy_version 771118 (0.0008) [2023-12-28 00:46:56,104][106226] Updated weights for policy 0, policy_version 769054 (0.0007) [2023-12-28 00:46:56,120][106225] Updated weights for policy 1, policy_version 771128 (0.0010) [2023-12-28 00:46:56,155][106226] Updated weights for policy 0, policy_version 769064 (0.0009) [2023-12-28 00:46:56,173][106225] Updated weights for policy 1, policy_version 771138 (0.0010) [2023-12-28 00:46:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 394371072. Throughput: 0: 9624.5, 1: 9890.5. Samples: 394347824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:46:56,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.558')] [2023-12-28 00:46:56,200][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000771144_197451776.pth... [2023-12-28 00:46:56,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000769960_197148672.pth [2023-12-28 00:46:56,203][106141] Saving new best policy, reward=-4.558! [2023-12-28 00:46:56,210][106226] Updated weights for policy 0, policy_version 769074 (0.0005) [2023-12-28 00:46:56,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000769080_196935680.pth... [2023-12-28 00:46:56,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000767960_196648960.pth [2023-12-28 00:46:56,885][106225] Updated weights for policy 1, policy_version 771148 (0.0010) [2023-12-28 00:46:56,930][106225] Updated weights for policy 1, policy_version 771158 (0.0010) [2023-12-28 00:46:56,956][106226] Updated weights for policy 0, policy_version 769084 (0.0008) [2023-12-28 00:46:56,973][106225] Updated weights for policy 1, policy_version 771168 (0.0010) [2023-12-28 00:46:57,016][106226] Updated weights for policy 0, policy_version 769094 (0.0006) [2023-12-28 00:46:57,072][106226] Updated weights for policy 0, policy_version 769104 (0.0008) [2023-12-28 00:46:57,718][106225] Updated weights for policy 1, policy_version 771178 (0.0010) [2023-12-28 00:46:57,777][106225] Updated weights for policy 1, policy_version 771188 (0.0010) [2023-12-28 00:46:57,801][106226] Updated weights for policy 0, policy_version 769114 (0.0007) [2023-12-28 00:46:57,834][106225] Updated weights for policy 1, policy_version 771198 (0.0010) [2023-12-28 00:46:57,856][106226] Updated weights for policy 0, policy_version 769124 (0.0005) [2023-12-28 00:46:57,888][106225] Updated weights for policy 1, policy_version 771208 (0.0010) [2023-12-28 00:46:57,909][106226] Updated weights for policy 0, policy_version 769134 (0.0007) [2023-12-28 00:46:57,955][106226] Updated weights for policy 0, policy_version 769144 (0.0008) [2023-12-28 00:46:58,652][106225] Updated weights for policy 1, policy_version 771218 (0.0011) [2023-12-28 00:46:58,720][106225] Updated weights for policy 1, policy_version 771228 (0.0011) [2023-12-28 00:46:58,769][106226] Updated weights for policy 0, policy_version 769154 (0.0008) [2023-12-28 00:46:58,782][106225] Updated weights for policy 1, policy_version 771238 (0.0011) [2023-12-28 00:46:58,840][106226] Updated weights for policy 0, policy_version 769164 (0.0008) [2023-12-28 00:46:58,913][106226] Updated weights for policy 0, policy_version 769174 (0.0008) [2023-12-28 00:46:59,578][106225] Updated weights for policy 1, policy_version 771248 (0.0010) [2023-12-28 00:46:59,639][106225] Updated weights for policy 1, policy_version 771258 (0.0011) [2023-12-28 00:46:59,681][106226] Updated weights for policy 0, policy_version 769184 (0.0007) [2023-12-28 00:46:59,697][106225] Updated weights for policy 1, policy_version 771268 (0.0010) [2023-12-28 00:46:59,743][106226] Updated weights for policy 0, policy_version 769194 (0.0007) [2023-12-28 00:46:59,798][106226] Updated weights for policy 0, policy_version 769204 (0.0006) [2023-12-28 00:47:00,411][106225] Updated weights for policy 1, policy_version 771278 (0.0009) [2023-12-28 00:47:00,457][106225] Updated weights for policy 1, policy_version 771288 (0.0008) [2023-12-28 00:47:00,509][106225] Updated weights for policy 1, policy_version 771298 (0.0008) [2023-12-28 00:47:00,530][106226] Updated weights for policy 0, policy_version 769214 (0.0007) [2023-12-28 00:47:00,577][106226] Updated weights for policy 0, policy_version 769224 (0.0009) [2023-12-28 00:47:00,643][106226] Updated weights for policy 0, policy_version 769235 (0.0011) [2023-12-28 00:47:01,137][106225] Updated weights for policy 1, policy_version 771308 (0.0007) [2023-12-28 00:47:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 394469376. Throughput: 0: 9563.0, 1: 9938.4. Samples: 394462416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:47:01,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.900')] [2023-12-28 00:47:01,200][106225] Updated weights for policy 1, policy_version 771318 (0.0008) [2023-12-28 00:47:01,258][106225] Updated weights for policy 1, policy_version 771328 (0.0010) [2023-12-28 00:47:01,298][106226] Updated weights for policy 0, policy_version 769245 (0.0010) [2023-12-28 00:47:01,366][106226] Updated weights for policy 0, policy_version 769255 (0.0009) [2023-12-28 00:47:01,418][106226] Updated weights for policy 0, policy_version 769265 (0.0007) [2023-12-28 00:47:01,943][106225] Updated weights for policy 1, policy_version 771338 (0.0010) [2023-12-28 00:47:02,006][106225] Updated weights for policy 1, policy_version 771348 (0.0010) [2023-12-28 00:47:02,056][106225] Updated weights for policy 1, policy_version 771358 (0.0010) [2023-12-28 00:47:02,066][106226] Updated weights for policy 0, policy_version 769275 (0.0007) [2023-12-28 00:47:02,103][106225] Updated weights for policy 1, policy_version 771368 (0.0010) [2023-12-28 00:47:02,124][106226] Updated weights for policy 0, policy_version 769285 (0.0010) [2023-12-28 00:47:02,187][106226] Updated weights for policy 0, policy_version 769295 (0.0010) [2023-12-28 00:47:02,856][106225] Updated weights for policy 1, policy_version 771378 (0.0005) [2023-12-28 00:47:02,912][106226] Updated weights for policy 0, policy_version 769305 (0.0010) [2023-12-28 00:47:02,924][106225] Updated weights for policy 1, policy_version 771388 (0.0010) [2023-12-28 00:47:02,977][106226] Updated weights for policy 0, policy_version 769315 (0.0008) [2023-12-28 00:47:02,982][106225] Updated weights for policy 1, policy_version 771398 (0.0006) [2023-12-28 00:47:03,042][106226] Updated weights for policy 0, policy_version 769325 (0.0010) [2023-12-28 00:47:03,103][106226] Updated weights for policy 0, policy_version 769335 (0.0010) [2023-12-28 00:47:03,580][106225] Updated weights for policy 1, policy_version 771409 (0.0008) [2023-12-28 00:47:03,637][106225] Updated weights for policy 1, policy_version 771419 (0.0005) [2023-12-28 00:47:03,687][106225] Updated weights for policy 1, policy_version 771429 (0.0010) [2023-12-28 00:47:03,693][106226] Updated weights for policy 0, policy_version 769345 (0.0006) [2023-12-28 00:47:03,741][106226] Updated weights for policy 0, policy_version 769355 (0.0008) [2023-12-28 00:47:03,786][106226] Updated weights for policy 0, policy_version 769365 (0.0008) [2023-12-28 00:47:04,335][106225] Updated weights for policy 1, policy_version 771439 (0.0008) [2023-12-28 00:47:04,403][106225] Updated weights for policy 1, policy_version 771449 (0.0006) [2023-12-28 00:47:04,466][106225] Updated weights for policy 1, policy_version 771459 (0.0006) [2023-12-28 00:47:04,576][106226] Updated weights for policy 0, policy_version 769375 (0.0010) [2023-12-28 00:47:04,631][106226] Updated weights for policy 0, policy_version 769385 (0.0010) [2023-12-28 00:47:04,689][106226] Updated weights for policy 0, policy_version 769395 (0.0011) [2023-12-28 00:47:05,159][106225] Updated weights for policy 1, policy_version 771469 (0.0009) [2023-12-28 00:47:05,205][106225] Updated weights for policy 1, policy_version 771479 (0.0010) [2023-12-28 00:47:05,255][106225] Updated weights for policy 1, policy_version 771489 (0.0010) [2023-12-28 00:47:05,356][106226] Updated weights for policy 0, policy_version 769405 (0.0008) [2023-12-28 00:47:05,416][106226] Updated weights for policy 0, policy_version 769415 (0.0007) [2023-12-28 00:47:05,469][106226] Updated weights for policy 0, policy_version 769425 (0.0010) [2023-12-28 00:47:05,898][106225] Updated weights for policy 1, policy_version 771499 (0.0009) [2023-12-28 00:47:05,959][106225] Updated weights for policy 1, policy_version 771509 (0.0007) [2023-12-28 00:47:06,019][106225] Updated weights for policy 1, policy_version 771519 (0.0007) [2023-12-28 00:47:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 394575872. Throughput: 0: 9576.0, 1: 9980.7. Samples: 394583152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:47:06,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-5.232')] [2023-12-28 00:47:06,270][106226] Updated weights for policy 0, policy_version 769435 (0.0009) [2023-12-28 00:47:06,336][106226] Updated weights for policy 0, policy_version 769445 (0.0007) [2023-12-28 00:47:06,400][106226] Updated weights for policy 0, policy_version 769455 (0.0009) [2023-12-28 00:47:06,655][106225] Updated weights for policy 1, policy_version 771529 (0.0005) [2023-12-28 00:47:06,722][106225] Updated weights for policy 1, policy_version 771539 (0.0009) [2023-12-28 00:47:06,785][106225] Updated weights for policy 1, policy_version 771549 (0.0008) [2023-12-28 00:47:06,851][106225] Updated weights for policy 1, policy_version 771559 (0.0008) [2023-12-28 00:47:07,096][106226] Updated weights for policy 0, policy_version 769465 (0.0010) [2023-12-28 00:47:07,153][106226] Updated weights for policy 0, policy_version 769475 (0.0008) [2023-12-28 00:47:07,199][106226] Updated weights for policy 0, policy_version 769485 (0.0008) [2023-12-28 00:47:07,255][106226] Updated weights for policy 0, policy_version 769495 (0.0008) [2023-12-28 00:47:07,578][106225] Updated weights for policy 1, policy_version 771569 (0.0009) [2023-12-28 00:47:07,628][106225] Updated weights for policy 1, policy_version 771579 (0.0008) [2023-12-28 00:47:07,676][106225] Updated weights for policy 1, policy_version 771589 (0.0006) [2023-12-28 00:47:07,995][106226] Updated weights for policy 0, policy_version 769505 (0.0009) [2023-12-28 00:47:08,041][106226] Updated weights for policy 0, policy_version 769515 (0.0006) [2023-12-28 00:47:08,085][106226] Updated weights for policy 0, policy_version 769525 (0.0005) [2023-12-28 00:47:08,458][106225] Updated weights for policy 1, policy_version 771599 (0.0008) [2023-12-28 00:47:08,517][106225] Updated weights for policy 1, policy_version 771609 (0.0010) [2023-12-28 00:47:08,571][106225] Updated weights for policy 1, policy_version 771619 (0.0008) [2023-12-28 00:47:08,724][106226] Updated weights for policy 0, policy_version 769535 (0.0006) [2023-12-28 00:47:08,784][106226] Updated weights for policy 0, policy_version 769545 (0.0007) [2023-12-28 00:47:08,852][106226] Updated weights for policy 0, policy_version 769555 (0.0006) [2023-12-28 00:47:09,295][106225] Updated weights for policy 1, policy_version 771629 (0.0009) [2023-12-28 00:47:09,354][106225] Updated weights for policy 1, policy_version 771639 (0.0009) [2023-12-28 00:47:09,425][106225] Updated weights for policy 1, policy_version 771649 (0.0007) [2023-12-28 00:47:09,476][106226] Updated weights for policy 0, policy_version 769565 (0.0009) [2023-12-28 00:47:09,539][106226] Updated weights for policy 0, policy_version 769575 (0.0009) [2023-12-28 00:47:09,598][106226] Updated weights for policy 0, policy_version 769585 (0.0009) [2023-12-28 00:47:10,179][106225] Updated weights for policy 1, policy_version 771659 (0.0008) [2023-12-28 00:47:10,238][106225] Updated weights for policy 1, policy_version 771669 (0.0007) [2023-12-28 00:47:10,302][106225] Updated weights for policy 1, policy_version 771679 (0.0008) [2023-12-28 00:47:10,364][106226] Updated weights for policy 0, policy_version 769595 (0.0009) [2023-12-28 00:47:10,425][106226] Updated weights for policy 0, policy_version 769605 (0.0011) [2023-12-28 00:47:10,483][106226] Updated weights for policy 0, policy_version 769615 (0.0011) [2023-12-28 00:47:11,103][106225] Updated weights for policy 1, policy_version 771689 (0.0007) [2023-12-28 00:47:11,121][106226] Updated weights for policy 0, policy_version 769625 (0.0011) [2023-12-28 00:47:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 394665984. Throughput: 0: 9611.2, 1: 10017.8. Samples: 394642472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:47:11,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.920')] [2023-12-28 00:47:11,176][106225] Updated weights for policy 1, policy_version 771699 (0.0008) [2023-12-28 00:47:11,190][106226] Updated weights for policy 0, policy_version 769635 (0.0009) [2023-12-28 00:47:11,243][106225] Updated weights for policy 1, policy_version 771709 (0.0007) [2023-12-28 00:47:11,264][106226] Updated weights for policy 0, policy_version 769645 (0.0007) [2023-12-28 00:47:11,307][106225] Updated weights for policy 1, policy_version 771719 (0.0008) [2023-12-28 00:47:11,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000771720_197599232.pth... [2023-12-28 00:47:11,316][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000770536_197296128.pth [2023-12-28 00:47:11,321][106226] Updated weights for policy 0, policy_version 769655 (0.0007) [2023-12-28 00:47:11,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000769656_197083136.pth... [2023-12-28 00:47:11,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000768504_196788224.pth [2023-12-28 00:47:12,041][106225] Updated weights for policy 1, policy_version 771729 (0.0009) [2023-12-28 00:47:12,094][106225] Updated weights for policy 1, policy_version 771739 (0.0007) [2023-12-28 00:47:12,118][106226] Updated weights for policy 0, policy_version 769665 (0.0008) [2023-12-28 00:47:12,155][106225] Updated weights for policy 1, policy_version 771749 (0.0007) [2023-12-28 00:47:12,180][106226] Updated weights for policy 0, policy_version 769675 (0.0007) [2023-12-28 00:47:12,239][106226] Updated weights for policy 0, policy_version 769685 (0.0006) [2023-12-28 00:47:12,894][106226] Updated weights for policy 0, policy_version 769695 (0.0007) [2023-12-28 00:47:12,930][106225] Updated weights for policy 1, policy_version 771759 (0.0010) [2023-12-28 00:47:12,951][106226] Updated weights for policy 0, policy_version 769705 (0.0007) [2023-12-28 00:47:12,982][106225] Updated weights for policy 1, policy_version 771769 (0.0010) [2023-12-28 00:47:13,006][106226] Updated weights for policy 0, policy_version 769715 (0.0007) [2023-12-28 00:47:13,039][106225] Updated weights for policy 1, policy_version 771779 (0.0010) [2023-12-28 00:47:13,650][106226] Updated weights for policy 0, policy_version 769725 (0.0009) [2023-12-28 00:47:13,711][106226] Updated weights for policy 0, policy_version 769735 (0.0010) [2023-12-28 00:47:13,751][106225] Updated weights for policy 1, policy_version 771789 (0.0010) [2023-12-28 00:47:13,765][106226] Updated weights for policy 0, policy_version 769745 (0.0011) [2023-12-28 00:47:13,797][106225] Updated weights for policy 1, policy_version 771799 (0.0010) [2023-12-28 00:47:13,844][106225] Updated weights for policy 1, policy_version 771809 (0.0010) [2023-12-28 00:47:14,412][106226] Updated weights for policy 0, policy_version 769755 (0.0010) [2023-12-28 00:47:14,458][106226] Updated weights for policy 0, policy_version 769765 (0.0010) [2023-12-28 00:47:14,508][106226] Updated weights for policy 0, policy_version 769775 (0.0010) [2023-12-28 00:47:14,560][106225] Updated weights for policy 1, policy_version 771819 (0.0010) [2023-12-28 00:47:14,614][106225] Updated weights for policy 1, policy_version 771829 (0.0010) [2023-12-28 00:47:14,674][106225] Updated weights for policy 1, policy_version 771839 (0.0010) [2023-12-28 00:47:15,257][106226] Updated weights for policy 0, policy_version 769785 (0.0010) [2023-12-28 00:47:15,315][106226] Updated weights for policy 0, policy_version 769795 (0.0011) [2023-12-28 00:47:15,377][106226] Updated weights for policy 0, policy_version 769805 (0.0011) [2023-12-28 00:47:15,410][106225] Updated weights for policy 1, policy_version 771849 (0.0010) [2023-12-28 00:47:15,441][106226] Updated weights for policy 0, policy_version 769815 (0.0011) [2023-12-28 00:47:15,478][106225] Updated weights for policy 1, policy_version 771859 (0.0008) [2023-12-28 00:47:15,544][106225] Updated weights for policy 1, policy_version 771869 (0.0008) [2023-12-28 00:47:15,615][106225] Updated weights for policy 1, policy_version 771879 (0.0008) [2023-12-28 00:47:16,136][106226] Updated weights for policy 0, policy_version 769825 (0.0009) [2023-12-28 00:47:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19633.0). Total num frames: 394764288. Throughput: 0: 9682.7, 1: 9913.6. Samples: 394759256. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:16,175][105115] Avg episode reward: [(0, '-4.143'), (1, '-5.132')] [2023-12-28 00:47:16,199][106226] Updated weights for policy 0, policy_version 769835 (0.0008) [2023-12-28 00:47:16,262][106226] Updated weights for policy 0, policy_version 769845 (0.0009) [2023-12-28 00:47:16,290][106225] Updated weights for policy 1, policy_version 771889 (0.0010) [2023-12-28 00:47:16,337][106225] Updated weights for policy 1, policy_version 771899 (0.0010) [2023-12-28 00:47:16,387][106225] Updated weights for policy 1, policy_version 771909 (0.0010) [2023-12-28 00:47:16,903][106226] Updated weights for policy 0, policy_version 769855 (0.0009) [2023-12-28 00:47:16,962][106226] Updated weights for policy 0, policy_version 769865 (0.0009) [2023-12-28 00:47:17,018][106226] Updated weights for policy 0, policy_version 769875 (0.0009) [2023-12-28 00:47:17,038][106225] Updated weights for policy 1, policy_version 771919 (0.0007) [2023-12-28 00:47:17,104][106225] Updated weights for policy 1, policy_version 771929 (0.0005) [2023-12-28 00:47:17,167][106225] Updated weights for policy 1, policy_version 771939 (0.0010) [2023-12-28 00:47:17,700][106226] Updated weights for policy 0, policy_version 769885 (0.0007) [2023-12-28 00:47:17,759][106226] Updated weights for policy 0, policy_version 769895 (0.0005) [2023-12-28 00:47:17,799][106225] Updated weights for policy 1, policy_version 771949 (0.0008) [2023-12-28 00:47:17,832][106226] Updated weights for policy 0, policy_version 769905 (0.0006) [2023-12-28 00:47:17,874][106225] Updated weights for policy 1, policy_version 771959 (0.0008) [2023-12-28 00:47:17,930][106225] Updated weights for policy 1, policy_version 771969 (0.0011) [2023-12-28 00:47:18,570][106226] Updated weights for policy 0, policy_version 769915 (0.0007) [2023-12-28 00:47:18,597][106225] Updated weights for policy 1, policy_version 771979 (0.0007) [2023-12-28 00:47:18,634][106226] Updated weights for policy 0, policy_version 769925 (0.0007) [2023-12-28 00:47:18,655][106225] Updated weights for policy 1, policy_version 771989 (0.0011) [2023-12-28 00:47:18,698][106226] Updated weights for policy 0, policy_version 769935 (0.0007) [2023-12-28 00:47:18,718][106225] Updated weights for policy 1, policy_version 771999 (0.0007) [2023-12-28 00:47:19,401][106225] Updated weights for policy 1, policy_version 772009 (0.0010) [2023-12-28 00:47:19,415][106226] Updated weights for policy 0, policy_version 769945 (0.0008) [2023-12-28 00:47:19,458][106225] Updated weights for policy 1, policy_version 772019 (0.0007) [2023-12-28 00:47:19,476][106226] Updated weights for policy 0, policy_version 769955 (0.0011) [2023-12-28 00:47:19,524][106225] Updated weights for policy 1, policy_version 772029 (0.0008) [2023-12-28 00:47:19,543][106226] Updated weights for policy 0, policy_version 769965 (0.0010) [2023-12-28 00:47:19,587][106225] Updated weights for policy 1, policy_version 772039 (0.0010) [2023-12-28 00:47:19,601][106226] Updated weights for policy 0, policy_version 769975 (0.0011) [2023-12-28 00:47:20,284][106225] Updated weights for policy 1, policy_version 772049 (0.0011) [2023-12-28 00:47:20,346][106225] Updated weights for policy 1, policy_version 772059 (0.0011) [2023-12-28 00:47:20,360][106226] Updated weights for policy 0, policy_version 769985 (0.0009) [2023-12-28 00:47:20,407][106225] Updated weights for policy 1, policy_version 772069 (0.0010) [2023-12-28 00:47:20,430][106226] Updated weights for policy 0, policy_version 769995 (0.0009) [2023-12-28 00:47:20,499][106226] Updated weights for policy 0, policy_version 770005 (0.0009) [2023-12-28 00:47:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 394862592. Throughput: 0: 9648.8, 1: 9910.2. Samples: 394877584. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:21,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-5.161')] [2023-12-28 00:47:21,211][106225] Updated weights for policy 1, policy_version 772079 (0.0010) [2023-12-28 00:47:21,227][106226] Updated weights for policy 0, policy_version 770015 (0.0009) [2023-12-28 00:47:21,277][106225] Updated weights for policy 1, policy_version 772089 (0.0007) [2023-12-28 00:47:21,299][106226] Updated weights for policy 0, policy_version 770025 (0.0007) [2023-12-28 00:47:21,339][106225] Updated weights for policy 1, policy_version 772099 (0.0009) [2023-12-28 00:47:21,358][106226] Updated weights for policy 0, policy_version 770035 (0.0009) [2023-12-28 00:47:22,101][106225] Updated weights for policy 1, policy_version 772109 (0.0009) [2023-12-28 00:47:22,160][106225] Updated weights for policy 1, policy_version 772119 (0.0008) [2023-12-28 00:47:22,184][106226] Updated weights for policy 0, policy_version 770045 (0.0009) [2023-12-28 00:47:22,215][106225] Updated weights for policy 1, policy_version 772129 (0.0006) [2023-12-28 00:47:22,249][106226] Updated weights for policy 0, policy_version 770055 (0.0008) [2023-12-28 00:47:22,313][106226] Updated weights for policy 0, policy_version 770065 (0.0007) [2023-12-28 00:47:22,927][106226] Updated weights for policy 0, policy_version 770075 (0.0007) [2023-12-28 00:47:22,963][106225] Updated weights for policy 1, policy_version 772139 (0.0008) [2023-12-28 00:47:22,990][106226] Updated weights for policy 0, policy_version 770085 (0.0006) [2023-12-28 00:47:23,031][106225] Updated weights for policy 1, policy_version 772149 (0.0008) [2023-12-28 00:47:23,049][106226] Updated weights for policy 0, policy_version 770095 (0.0006) [2023-12-28 00:47:23,087][106225] Updated weights for policy 1, policy_version 772159 (0.0007) [2023-12-28 00:47:23,708][106225] Updated weights for policy 1, policy_version 772169 (0.0008) [2023-12-28 00:47:23,733][106226] Updated weights for policy 0, policy_version 770105 (0.0006) [2023-12-28 00:47:23,777][106225] Updated weights for policy 1, policy_version 772179 (0.0005) [2023-12-28 00:47:23,791][106226] Updated weights for policy 0, policy_version 770115 (0.0007) [2023-12-28 00:47:23,832][106225] Updated weights for policy 1, policy_version 772189 (0.0005) [2023-12-28 00:47:23,852][106226] Updated weights for policy 0, policy_version 770125 (0.0011) [2023-12-28 00:47:23,887][106225] Updated weights for policy 1, policy_version 772199 (0.0005) [2023-12-28 00:47:23,917][106226] Updated weights for policy 0, policy_version 770135 (0.0010) [2023-12-28 00:47:24,466][106226] Updated weights for policy 0, policy_version 770145 (0.0005) [2023-12-28 00:47:24,488][106225] Updated weights for policy 1, policy_version 772209 (0.0010) [2023-12-28 00:47:24,521][106226] Updated weights for policy 0, policy_version 770155 (0.0005) [2023-12-28 00:47:24,545][106225] Updated weights for policy 1, policy_version 772219 (0.0007) [2023-12-28 00:47:24,583][106226] Updated weights for policy 0, policy_version 770165 (0.0005) [2023-12-28 00:47:24,597][106225] Updated weights for policy 1, policy_version 772229 (0.0005) [2023-12-28 00:47:25,153][106225] Updated weights for policy 1, policy_version 772239 (0.0005) [2023-12-28 00:47:25,207][106225] Updated weights for policy 1, policy_version 772249 (0.0005) [2023-12-28 00:47:25,209][106226] Updated weights for policy 0, policy_version 770175 (0.0009) [2023-12-28 00:47:25,255][106226] Updated weights for policy 0, policy_version 770185 (0.0010) [2023-12-28 00:47:25,256][106225] Updated weights for policy 1, policy_version 772259 (0.0005) [2023-12-28 00:47:25,305][106226] Updated weights for policy 0, policy_version 770195 (0.0010) [2023-12-28 00:47:25,881][106225] Updated weights for policy 1, policy_version 772269 (0.0008) [2023-12-28 00:47:25,925][106226] Updated weights for policy 0, policy_version 770205 (0.0008) [2023-12-28 00:47:25,941][106225] Updated weights for policy 1, policy_version 772279 (0.0006) [2023-12-28 00:47:25,989][106226] Updated weights for policy 0, policy_version 770215 (0.0005) [2023-12-28 00:47:25,997][106225] Updated weights for policy 1, policy_version 772289 (0.0006) [2023-12-28 00:47:26,059][106226] Updated weights for policy 0, policy_version 770225 (0.0005) [2023-12-28 00:47:26,175][105115] Fps is (10 sec: 21298.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 394977280. Throughput: 0: 9645.9, 1: 9851.4. Samples: 394935660. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:26,176][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.905')] [2023-12-28 00:47:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000772296_197746688.pth... [2023-12-28 00:47:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000770232_197230592.pth... [2023-12-28 00:47:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000771144_197451776.pth [2023-12-28 00:47:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000769080_196935680.pth [2023-12-28 00:47:26,562][106225] Updated weights for policy 1, policy_version 772299 (0.0006) [2023-12-28 00:47:26,615][106226] Updated weights for policy 0, policy_version 770235 (0.0008) [2023-12-28 00:47:26,615][106225] Updated weights for policy 1, policy_version 772309 (0.0005) [2023-12-28 00:47:26,664][106226] Updated weights for policy 0, policy_version 770245 (0.0010) [2023-12-28 00:47:26,670][106225] Updated weights for policy 1, policy_version 772319 (0.0006) [2023-12-28 00:47:26,711][106226] Updated weights for policy 0, policy_version 770255 (0.0008) [2023-12-28 00:47:27,246][106225] Updated weights for policy 1, policy_version 772329 (0.0006) [2023-12-28 00:47:27,303][106225] Updated weights for policy 1, policy_version 772339 (0.0008) [2023-12-28 00:47:27,326][106226] Updated weights for policy 0, policy_version 770265 (0.0010) [2023-12-28 00:47:27,363][106225] Updated weights for policy 1, policy_version 772349 (0.0008) [2023-12-28 00:47:27,383][106226] Updated weights for policy 0, policy_version 770275 (0.0005) [2023-12-28 00:47:27,413][106225] Updated weights for policy 1, policy_version 772359 (0.0009) [2023-12-28 00:47:27,434][106226] Updated weights for policy 0, policy_version 770285 (0.0005) [2023-12-28 00:47:27,494][106226] Updated weights for policy 0, policy_version 770295 (0.0005) [2023-12-28 00:47:28,035][106225] Updated weights for policy 1, policy_version 772369 (0.0007) [2023-12-28 00:47:28,072][106226] Updated weights for policy 0, policy_version 770305 (0.0006) [2023-12-28 00:47:28,093][106225] Updated weights for policy 1, policy_version 772379 (0.0008) [2023-12-28 00:47:28,117][106226] Updated weights for policy 0, policy_version 770315 (0.0005) [2023-12-28 00:47:28,152][106225] Updated weights for policy 1, policy_version 772389 (0.0008) [2023-12-28 00:47:28,183][106226] Updated weights for policy 0, policy_version 770325 (0.0006) [2023-12-28 00:47:28,763][106226] Updated weights for policy 0, policy_version 770335 (0.0006) [2023-12-28 00:47:28,818][106226] Updated weights for policy 0, policy_version 770345 (0.0008) [2023-12-28 00:47:28,874][106226] Updated weights for policy 0, policy_version 770355 (0.0009) [2023-12-28 00:47:28,894][106225] Updated weights for policy 1, policy_version 772399 (0.0006) [2023-12-28 00:47:28,947][106225] Updated weights for policy 1, policy_version 772409 (0.0005) [2023-12-28 00:47:29,003][106225] Updated weights for policy 1, policy_version 772419 (0.0006) [2023-12-28 00:47:29,602][106226] Updated weights for policy 0, policy_version 770365 (0.0008) [2023-12-28 00:47:29,663][106226] Updated weights for policy 0, policy_version 770375 (0.0009) [2023-12-28 00:47:29,673][106225] Updated weights for policy 1, policy_version 772429 (0.0008) [2023-12-28 00:47:29,718][106226] Updated weights for policy 0, policy_version 770385 (0.0008) [2023-12-28 00:47:29,739][106225] Updated weights for policy 1, policy_version 772439 (0.0006) [2023-12-28 00:47:29,798][106225] Updated weights for policy 1, policy_version 772449 (0.0006) [2023-12-28 00:47:30,471][106226] Updated weights for policy 0, policy_version 770395 (0.0009) [2023-12-28 00:47:30,525][106226] Updated weights for policy 0, policy_version 770405 (0.0007) [2023-12-28 00:47:30,530][106225] Updated weights for policy 1, policy_version 772459 (0.0009) [2023-12-28 00:47:30,576][106225] Updated weights for policy 1, policy_version 772469 (0.0010) [2023-12-28 00:47:30,578][106226] Updated weights for policy 0, policy_version 770415 (0.0005) [2023-12-28 00:47:30,626][106225] Updated weights for policy 1, policy_version 772479 (0.0010) [2023-12-28 00:47:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 395075584. Throughput: 0: 9893.7, 1: 10039.0. Samples: 395068016. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:31,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.318')] [2023-12-28 00:47:31,342][106225] Updated weights for policy 1, policy_version 772489 (0.0010) [2023-12-28 00:47:31,354][106226] Updated weights for policy 0, policy_version 770425 (0.0006) [2023-12-28 00:47:31,404][106225] Updated weights for policy 1, policy_version 772499 (0.0010) [2023-12-28 00:47:31,415][106226] Updated weights for policy 0, policy_version 770435 (0.0007) [2023-12-28 00:47:31,465][106225] Updated weights for policy 1, policy_version 772509 (0.0010) [2023-12-28 00:47:31,470][106226] Updated weights for policy 0, policy_version 770445 (0.0007) [2023-12-28 00:47:31,522][106225] Updated weights for policy 1, policy_version 772519 (0.0010) [2023-12-28 00:47:31,528][106226] Updated weights for policy 0, policy_version 770455 (0.0005) [2023-12-28 00:47:32,267][106226] Updated weights for policy 0, policy_version 770465 (0.0006) [2023-12-28 00:47:32,270][106225] Updated weights for policy 1, policy_version 772529 (0.0009) [2023-12-28 00:47:32,328][106226] Updated weights for policy 0, policy_version 770475 (0.0006) [2023-12-28 00:47:32,334][106225] Updated weights for policy 1, policy_version 772539 (0.0006) [2023-12-28 00:47:32,397][106225] Updated weights for policy 1, policy_version 772549 (0.0008) [2023-12-28 00:47:32,399][106226] Updated weights for policy 0, policy_version 770485 (0.0007) [2023-12-28 00:47:33,022][106225] Updated weights for policy 1, policy_version 772559 (0.0009) [2023-12-28 00:47:33,086][106225] Updated weights for policy 1, policy_version 772569 (0.0009) [2023-12-28 00:47:33,124][106226] Updated weights for policy 0, policy_version 770495 (0.0008) [2023-12-28 00:47:33,143][106225] Updated weights for policy 1, policy_version 772579 (0.0009) [2023-12-28 00:47:33,182][106226] Updated weights for policy 0, policy_version 770505 (0.0007) [2023-12-28 00:47:33,239][106226] Updated weights for policy 0, policy_version 770515 (0.0008) [2023-12-28 00:47:33,845][106225] Updated weights for policy 1, policy_version 772589 (0.0009) [2023-12-28 00:47:33,904][106225] Updated weights for policy 1, policy_version 772599 (0.0006) [2023-12-28 00:47:33,916][106226] Updated weights for policy 0, policy_version 770525 (0.0007) [2023-12-28 00:47:33,965][106225] Updated weights for policy 1, policy_version 772609 (0.0007) [2023-12-28 00:47:33,984][106226] Updated weights for policy 0, policy_version 770535 (0.0007) [2023-12-28 00:47:34,050][106226] Updated weights for policy 0, policy_version 770545 (0.0007) [2023-12-28 00:47:34,606][106225] Updated weights for policy 1, policy_version 772619 (0.0008) [2023-12-28 00:47:34,634][106226] Updated weights for policy 0, policy_version 770555 (0.0009) [2023-12-28 00:47:34,664][106225] Updated weights for policy 1, policy_version 772629 (0.0007) [2023-12-28 00:47:34,696][106226] Updated weights for policy 0, policy_version 770565 (0.0011) [2023-12-28 00:47:34,710][106225] Updated weights for policy 1, policy_version 772639 (0.0007) [2023-12-28 00:47:34,762][106226] Updated weights for policy 0, policy_version 770575 (0.0006) [2023-12-28 00:47:35,461][106226] Updated weights for policy 0, policy_version 770585 (0.0007) [2023-12-28 00:47:35,467][106225] Updated weights for policy 1, policy_version 772649 (0.0009) [2023-12-28 00:47:35,516][106226] Updated weights for policy 0, policy_version 770595 (0.0009) [2023-12-28 00:47:35,523][106225] Updated weights for policy 1, policy_version 772659 (0.0006) [2023-12-28 00:47:35,574][106225] Updated weights for policy 1, policy_version 772669 (0.0005) [2023-12-28 00:47:35,582][106226] Updated weights for policy 0, policy_version 770605 (0.0005) [2023-12-28 00:47:35,640][106225] Updated weights for policy 1, policy_version 772679 (0.0006) [2023-12-28 00:47:35,646][106226] Updated weights for policy 0, policy_version 770615 (0.0008) [2023-12-28 00:47:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 395173888. Throughput: 0: 9930.5, 1: 10069.0. Samples: 395186404. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:36,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-5.642')] [2023-12-28 00:47:36,271][106225] Updated weights for policy 1, policy_version 772689 (0.0010) [2023-12-28 00:47:36,333][106225] Updated weights for policy 1, policy_version 772699 (0.0011) [2023-12-28 00:47:36,342][106226] Updated weights for policy 0, policy_version 770625 (0.0008) [2023-12-28 00:47:36,403][106225] Updated weights for policy 1, policy_version 772709 (0.0010) [2023-12-28 00:47:36,407][106226] Updated weights for policy 0, policy_version 770635 (0.0006) [2023-12-28 00:47:36,470][106226] Updated weights for policy 0, policy_version 770645 (0.0006) [2023-12-28 00:47:37,027][106226] Updated weights for policy 0, policy_version 770655 (0.0009) [2023-12-28 00:47:37,086][106226] Updated weights for policy 0, policy_version 770665 (0.0010) [2023-12-28 00:47:37,125][106225] Updated weights for policy 1, policy_version 772719 (0.0011) [2023-12-28 00:47:37,139][106226] Updated weights for policy 0, policy_version 770675 (0.0006) [2023-12-28 00:47:37,190][106225] Updated weights for policy 1, policy_version 772729 (0.0011) [2023-12-28 00:47:37,254][106225] Updated weights for policy 1, policy_version 772739 (0.0010) [2023-12-28 00:47:37,809][106226] Updated weights for policy 0, policy_version 770685 (0.0008) [2023-12-28 00:47:37,868][106226] Updated weights for policy 0, policy_version 770695 (0.0010) [2023-12-28 00:47:37,931][106226] Updated weights for policy 0, policy_version 770705 (0.0010) [2023-12-28 00:47:37,979][106225] Updated weights for policy 1, policy_version 772749 (0.0010) [2023-12-28 00:47:38,032][106225] Updated weights for policy 1, policy_version 772759 (0.0010) [2023-12-28 00:47:38,091][106225] Updated weights for policy 1, policy_version 772769 (0.0010) [2023-12-28 00:47:38,694][106226] Updated weights for policy 0, policy_version 770715 (0.0010) [2023-12-28 00:47:38,760][106226] Updated weights for policy 0, policy_version 770725 (0.0006) [2023-12-28 00:47:38,766][106225] Updated weights for policy 1, policy_version 772779 (0.0010) [2023-12-28 00:47:38,818][106226] Updated weights for policy 0, policy_version 770735 (0.0005) [2023-12-28 00:47:38,820][106225] Updated weights for policy 1, policy_version 772789 (0.0010) [2023-12-28 00:47:38,883][106225] Updated weights for policy 1, policy_version 772799 (0.0010) [2023-12-28 00:47:39,503][106226] Updated weights for policy 0, policy_version 770745 (0.0006) [2023-12-28 00:47:39,576][106226] Updated weights for policy 0, policy_version 770755 (0.0011) [2023-12-28 00:47:39,614][106225] Updated weights for policy 1, policy_version 772809 (0.0008) [2023-12-28 00:47:39,639][106226] Updated weights for policy 0, policy_version 770765 (0.0009) [2023-12-28 00:47:39,677][106225] Updated weights for policy 1, policy_version 772819 (0.0011) [2023-12-28 00:47:39,705][106226] Updated weights for policy 0, policy_version 770775 (0.0010) [2023-12-28 00:47:39,733][106225] Updated weights for policy 1, policy_version 772829 (0.0010) [2023-12-28 00:47:39,795][106225] Updated weights for policy 1, policy_version 772839 (0.0010) [2023-12-28 00:47:40,396][106226] Updated weights for policy 0, policy_version 770785 (0.0009) [2023-12-28 00:47:40,456][106226] Updated weights for policy 0, policy_version 770795 (0.0008) [2023-12-28 00:47:40,512][106226] Updated weights for policy 0, policy_version 770805 (0.0008) [2023-12-28 00:47:40,549][106225] Updated weights for policy 1, policy_version 772849 (0.0010) [2023-12-28 00:47:40,600][106225] Updated weights for policy 1, policy_version 772859 (0.0010) [2023-12-28 00:47:40,664][106225] Updated weights for policy 1, policy_version 772869 (0.0010) [2023-12-28 00:47:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 395272192. Throughput: 0: 9941.7, 1: 10037.0. Samples: 395246864. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:41,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-5.341')] [2023-12-28 00:47:41,178][106226] Updated weights for policy 0, policy_version 770815 (0.0007) [2023-12-28 00:47:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000772872_197894144.pth... [2023-12-28 00:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000771720_197599232.pth [2023-12-28 00:47:41,248][106226] Updated weights for policy 0, policy_version 770825 (0.0009) [2023-12-28 00:47:41,319][106226] Updated weights for policy 0, policy_version 770835 (0.0008) [2023-12-28 00:47:41,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000770840_197386240.pth... [2023-12-28 00:47:41,358][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000769656_197083136.pth [2023-12-28 00:47:41,408][106225] Updated weights for policy 1, policy_version 772879 (0.0009) [2023-12-28 00:47:41,464][106225] Updated weights for policy 1, policy_version 772889 (0.0005) [2023-12-28 00:47:41,513][106225] Updated weights for policy 1, policy_version 772899 (0.0007) [2023-12-28 00:47:42,089][106226] Updated weights for policy 0, policy_version 770845 (0.0010) [2023-12-28 00:47:42,144][106226] Updated weights for policy 0, policy_version 770855 (0.0008) [2023-12-28 00:47:42,185][106225] Updated weights for policy 1, policy_version 772909 (0.0008) [2023-12-28 00:47:42,205][106226] Updated weights for policy 0, policy_version 770865 (0.0009) [2023-12-28 00:47:42,243][106225] Updated weights for policy 1, policy_version 772919 (0.0007) [2023-12-28 00:47:42,306][106225] Updated weights for policy 1, policy_version 772929 (0.0009) [2023-12-28 00:47:42,938][106226] Updated weights for policy 0, policy_version 770875 (0.0006) [2023-12-28 00:47:42,971][106225] Updated weights for policy 1, policy_version 772939 (0.0008) [2023-12-28 00:47:42,997][106226] Updated weights for policy 0, policy_version 770885 (0.0006) [2023-12-28 00:47:43,019][106225] Updated weights for policy 1, policy_version 772949 (0.0006) [2023-12-28 00:47:43,057][106226] Updated weights for policy 0, policy_version 770895 (0.0007) [2023-12-28 00:47:43,073][106225] Updated weights for policy 1, policy_version 772959 (0.0008) [2023-12-28 00:47:43,760][106225] Updated weights for policy 1, policy_version 772969 (0.0009) [2023-12-28 00:47:43,770][106226] Updated weights for policy 0, policy_version 770905 (0.0005) [2023-12-28 00:47:43,812][106225] Updated weights for policy 1, policy_version 772979 (0.0006) [2023-12-28 00:47:43,821][106226] Updated weights for policy 0, policy_version 770915 (0.0006) [2023-12-28 00:47:43,868][106225] Updated weights for policy 1, policy_version 772989 (0.0006) [2023-12-28 00:47:43,880][106226] Updated weights for policy 0, policy_version 770925 (0.0008) [2023-12-28 00:47:43,931][106225] Updated weights for policy 1, policy_version 772999 (0.0007) [2023-12-28 00:47:43,934][106226] Updated weights for policy 0, policy_version 770935 (0.0007) [2023-12-28 00:47:44,554][106225] Updated weights for policy 1, policy_version 773009 (0.0006) [2023-12-28 00:47:44,601][106225] Updated weights for policy 1, policy_version 773019 (0.0005) [2023-12-28 00:47:44,655][106225] Updated weights for policy 1, policy_version 773029 (0.0005) [2023-12-28 00:47:44,666][106226] Updated weights for policy 0, policy_version 770945 (0.0007) [2023-12-28 00:47:44,716][106226] Updated weights for policy 0, policy_version 770955 (0.0007) [2023-12-28 00:47:44,785][106226] Updated weights for policy 0, policy_version 770965 (0.0009) [2023-12-28 00:47:45,301][106225] Updated weights for policy 1, policy_version 773039 (0.0007) [2023-12-28 00:47:45,364][106225] Updated weights for policy 1, policy_version 773049 (0.0006) [2023-12-28 00:47:45,433][106225] Updated weights for policy 1, policy_version 773059 (0.0007) [2023-12-28 00:47:45,461][106226] Updated weights for policy 0, policy_version 770975 (0.0007) [2023-12-28 00:47:45,522][106226] Updated weights for policy 0, policy_version 770985 (0.0010) [2023-12-28 00:47:45,576][106226] Updated weights for policy 0, policy_version 770995 (0.0011) [2023-12-28 00:47:46,080][106225] Updated weights for policy 1, policy_version 773069 (0.0006) [2023-12-28 00:47:46,144][106225] Updated weights for policy 1, policy_version 773079 (0.0005) [2023-12-28 00:47:46,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 395370496. Throughput: 0: 10007.8, 1: 10027.1. Samples: 395363988. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:46,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.187')] [2023-12-28 00:47:46,203][106225] Updated weights for policy 1, policy_version 773089 (0.0005) [2023-12-28 00:47:46,250][106226] Updated weights for policy 0, policy_version 771005 (0.0010) [2023-12-28 00:47:46,298][106226] Updated weights for policy 0, policy_version 771015 (0.0010) [2023-12-28 00:47:46,352][106226] Updated weights for policy 0, policy_version 771025 (0.0007) [2023-12-28 00:47:46,750][106225] Updated weights for policy 1, policy_version 773099 (0.0007) [2023-12-28 00:47:46,802][106225] Updated weights for policy 1, policy_version 773109 (0.0010) [2023-12-28 00:47:46,850][106225] Updated weights for policy 1, policy_version 773119 (0.0010) [2023-12-28 00:47:46,903][106226] Updated weights for policy 0, policy_version 771035 (0.0007) [2023-12-28 00:47:46,961][106226] Updated weights for policy 0, policy_version 771045 (0.0011) [2023-12-28 00:47:47,008][106226] Updated weights for policy 0, policy_version 771055 (0.0010) [2023-12-28 00:47:47,570][106225] Updated weights for policy 1, policy_version 773129 (0.0010) [2023-12-28 00:47:47,631][106225] Updated weights for policy 1, policy_version 773139 (0.0006) [2023-12-28 00:47:47,652][106226] Updated weights for policy 0, policy_version 771065 (0.0010) [2023-12-28 00:47:47,689][106225] Updated weights for policy 1, policy_version 773149 (0.0006) [2023-12-28 00:47:47,707][106226] Updated weights for policy 0, policy_version 771075 (0.0010) [2023-12-28 00:47:47,750][106225] Updated weights for policy 1, policy_version 773159 (0.0009) [2023-12-28 00:47:47,764][106226] Updated weights for policy 0, policy_version 771085 (0.0010) [2023-12-28 00:47:47,821][106226] Updated weights for policy 0, policy_version 771095 (0.0011) [2023-12-28 00:47:48,448][106225] Updated weights for policy 1, policy_version 773169 (0.0008) [2023-12-28 00:47:48,515][106225] Updated weights for policy 1, policy_version 773179 (0.0005) [2023-12-28 00:47:48,541][106226] Updated weights for policy 0, policy_version 771105 (0.0011) [2023-12-28 00:47:48,567][106225] Updated weights for policy 1, policy_version 773189 (0.0007) [2023-12-28 00:47:48,591][106226] Updated weights for policy 0, policy_version 771115 (0.0010) [2023-12-28 00:47:48,652][106226] Updated weights for policy 0, policy_version 771125 (0.0009) [2023-12-28 00:47:49,233][106225] Updated weights for policy 1, policy_version 773199 (0.0008) [2023-12-28 00:47:49,289][106225] Updated weights for policy 1, policy_version 773209 (0.0009) [2023-12-28 00:47:49,347][106225] Updated weights for policy 1, policy_version 773219 (0.0008) [2023-12-28 00:47:49,375][106226] Updated weights for policy 0, policy_version 771135 (0.0009) [2023-12-28 00:47:49,435][106226] Updated weights for policy 0, policy_version 771145 (0.0009) [2023-12-28 00:47:49,504][106226] Updated weights for policy 0, policy_version 771155 (0.0006) [2023-12-28 00:47:50,094][106225] Updated weights for policy 1, policy_version 773229 (0.0007) [2023-12-28 00:47:50,152][106225] Updated weights for policy 1, policy_version 773239 (0.0006) [2023-12-28 00:47:50,206][106225] Updated weights for policy 1, policy_version 773249 (0.0007) [2023-12-28 00:47:50,211][106226] Updated weights for policy 0, policy_version 771165 (0.0007) [2023-12-28 00:47:50,272][106226] Updated weights for policy 0, policy_version 771175 (0.0008) [2023-12-28 00:47:50,341][106226] Updated weights for policy 0, policy_version 771185 (0.0008) [2023-12-28 00:47:50,897][106225] Updated weights for policy 1, policy_version 773259 (0.0007) [2023-12-28 00:47:50,956][106225] Updated weights for policy 1, policy_version 773269 (0.0008) [2023-12-28 00:47:51,017][106225] Updated weights for policy 1, policy_version 773279 (0.0009) [2023-12-28 00:47:51,085][106226] Updated weights for policy 0, policy_version 771195 (0.0008) [2023-12-28 00:47:51,146][106226] Updated weights for policy 0, policy_version 771205 (0.0008) [2023-12-28 00:47:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19688.6). Total num frames: 395476992. Throughput: 0: 10053.3, 1: 10029.8. Samples: 395486888. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:51,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.103')] [2023-12-28 00:47:51,207][106226] Updated weights for policy 0, policy_version 771215 (0.0008) [2023-12-28 00:47:51,785][106225] Updated weights for policy 1, policy_version 773289 (0.0008) [2023-12-28 00:47:51,847][106225] Updated weights for policy 1, policy_version 773299 (0.0008) [2023-12-28 00:47:51,901][106225] Updated weights for policy 1, policy_version 773309 (0.0008) [2023-12-28 00:47:51,942][106226] Updated weights for policy 0, policy_version 771225 (0.0008) [2023-12-28 00:47:51,956][106225] Updated weights for policy 1, policy_version 773319 (0.0008) [2023-12-28 00:47:51,998][106226] Updated weights for policy 0, policy_version 771235 (0.0008) [2023-12-28 00:47:52,051][106226] Updated weights for policy 0, policy_version 771245 (0.0009) [2023-12-28 00:47:52,104][106226] Updated weights for policy 0, policy_version 771255 (0.0009) [2023-12-28 00:47:52,699][106225] Updated weights for policy 1, policy_version 773329 (0.0006) [2023-12-28 00:47:52,757][106225] Updated weights for policy 1, policy_version 773339 (0.0006) [2023-12-28 00:47:52,816][106225] Updated weights for policy 1, policy_version 773349 (0.0008) [2023-12-28 00:47:52,938][106226] Updated weights for policy 0, policy_version 771265 (0.0006) [2023-12-28 00:47:52,991][106226] Updated weights for policy 0, policy_version 771275 (0.0008) [2023-12-28 00:47:53,045][106226] Updated weights for policy 0, policy_version 771285 (0.0007) [2023-12-28 00:47:53,512][106225] Updated weights for policy 1, policy_version 773359 (0.0008) [2023-12-28 00:47:53,569][106225] Updated weights for policy 1, policy_version 773369 (0.0005) [2023-12-28 00:47:53,627][106225] Updated weights for policy 1, policy_version 773379 (0.0006) [2023-12-28 00:47:53,748][106226] Updated weights for policy 0, policy_version 771295 (0.0005) [2023-12-28 00:47:53,805][106226] Updated weights for policy 0, policy_version 771305 (0.0005) [2023-12-28 00:47:53,864][106226] Updated weights for policy 0, policy_version 771315 (0.0006) [2023-12-28 00:47:54,153][106225] Updated weights for policy 1, policy_version 773389 (0.0006) [2023-12-28 00:47:54,203][106225] Updated weights for policy 1, policy_version 773399 (0.0005) [2023-12-28 00:47:54,254][106225] Updated weights for policy 1, policy_version 773409 (0.0005) [2023-12-28 00:47:54,438][106226] Updated weights for policy 0, policy_version 771325 (0.0009) [2023-12-28 00:47:54,501][106226] Updated weights for policy 0, policy_version 771335 (0.0008) [2023-12-28 00:47:54,564][106226] Updated weights for policy 0, policy_version 771345 (0.0008) [2023-12-28 00:47:54,976][106225] Updated weights for policy 1, policy_version 773419 (0.0007) [2023-12-28 00:47:55,033][106225] Updated weights for policy 1, policy_version 773429 (0.0006) [2023-12-28 00:47:55,084][106225] Updated weights for policy 1, policy_version 773439 (0.0006) [2023-12-28 00:47:55,118][106226] Updated weights for policy 0, policy_version 771355 (0.0007) [2023-12-28 00:47:55,178][106226] Updated weights for policy 0, policy_version 771365 (0.0006) [2023-12-28 00:47:55,235][106226] Updated weights for policy 0, policy_version 771375 (0.0006) [2023-12-28 00:47:55,760][106225] Updated weights for policy 1, policy_version 773449 (0.0005) [2023-12-28 00:47:55,778][106226] Updated weights for policy 0, policy_version 771385 (0.0007) [2023-12-28 00:47:55,815][106225] Updated weights for policy 1, policy_version 773459 (0.0006) [2023-12-28 00:47:55,829][106226] Updated weights for policy 0, policy_version 771395 (0.0008) [2023-12-28 00:47:55,865][106225] Updated weights for policy 1, policy_version 773469 (0.0005) [2023-12-28 00:47:55,884][106226] Updated weights for policy 0, policy_version 771405 (0.0005) [2023-12-28 00:47:55,918][106225] Updated weights for policy 1, policy_version 773479 (0.0005) [2023-12-28 00:47:55,945][106226] Updated weights for policy 0, policy_version 771415 (0.0005) [2023-12-28 00:47:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20206.9, 300 sec: 19716.3). Total num frames: 395583488. Throughput: 0: 10029.3, 1: 10029.2. Samples: 395545104. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:47:56,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-5.093')] [2023-12-28 00:47:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000771416_197533696.pth... [2023-12-28 00:47:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000773480_198049792.pth... [2023-12-28 00:47:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000770232_197230592.pth [2023-12-28 00:47:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000772296_197746688.pth [2023-12-28 00:47:56,515][106226] Updated weights for policy 0, policy_version 771425 (0.0007) [2023-12-28 00:47:56,558][106226] Updated weights for policy 0, policy_version 771435 (0.0008) [2023-12-28 00:47:56,603][106226] Updated weights for policy 0, policy_version 771445 (0.0005) [2023-12-28 00:47:56,636][106225] Updated weights for policy 1, policy_version 773489 (0.0008) [2023-12-28 00:47:56,684][106225] Updated weights for policy 1, policy_version 773499 (0.0008) [2023-12-28 00:47:56,733][106225] Updated weights for policy 1, policy_version 773509 (0.0009) [2023-12-28 00:47:57,210][106226] Updated weights for policy 0, policy_version 771455 (0.0009) [2023-12-28 00:47:57,253][106226] Updated weights for policy 0, policy_version 771465 (0.0010) [2023-12-28 00:47:57,306][106226] Updated weights for policy 0, policy_version 771475 (0.0010) [2023-12-28 00:47:57,430][106225] Updated weights for policy 1, policy_version 773519 (0.0006) [2023-12-28 00:47:57,479][106225] Updated weights for policy 1, policy_version 773529 (0.0006) [2023-12-28 00:47:57,527][106225] Updated weights for policy 1, policy_version 773539 (0.0005) [2023-12-28 00:47:58,013][106226] Updated weights for policy 0, policy_version 771485 (0.0010) [2023-12-28 00:47:58,069][106226] Updated weights for policy 0, policy_version 771495 (0.0010) [2023-12-28 00:47:58,125][106226] Updated weights for policy 0, policy_version 771505 (0.0010) [2023-12-28 00:47:58,144][106225] Updated weights for policy 1, policy_version 773549 (0.0006) [2023-12-28 00:47:58,210][106225] Updated weights for policy 1, policy_version 773559 (0.0005) [2023-12-28 00:47:58,270][106225] Updated weights for policy 1, policy_version 773569 (0.0007) [2023-12-28 00:47:58,943][106226] Updated weights for policy 0, policy_version 771515 (0.0009) [2023-12-28 00:47:59,008][106226] Updated weights for policy 0, policy_version 771525 (0.0008) [2023-12-28 00:47:59,070][106226] Updated weights for policy 0, policy_version 771535 (0.0008) [2023-12-28 00:47:59,075][106225] Updated weights for policy 1, policy_version 773579 (0.0007) [2023-12-28 00:47:59,140][106225] Updated weights for policy 1, policy_version 773589 (0.0006) [2023-12-28 00:47:59,209][106225] Updated weights for policy 1, policy_version 773599 (0.0007) [2023-12-28 00:47:59,725][106226] Updated weights for policy 0, policy_version 771545 (0.0008) [2023-12-28 00:47:59,785][106226] Updated weights for policy 0, policy_version 771555 (0.0006) [2023-12-28 00:47:59,852][106226] Updated weights for policy 0, policy_version 771565 (0.0008) [2023-12-28 00:47:59,915][106226] Updated weights for policy 0, policy_version 771575 (0.0008) [2023-12-28 00:47:59,984][106225] Updated weights for policy 1, policy_version 773609 (0.0008) [2023-12-28 00:48:00,038][106225] Updated weights for policy 1, policy_version 773619 (0.0008) [2023-12-28 00:48:00,095][106225] Updated weights for policy 1, policy_version 773629 (0.0010) [2023-12-28 00:48:00,162][106225] Updated weights for policy 1, policy_version 773639 (0.0008) [2023-12-28 00:48:00,636][106226] Updated weights for policy 0, policy_version 771585 (0.0010) [2023-12-28 00:48:00,699][106226] Updated weights for policy 0, policy_version 771595 (0.0010) [2023-12-28 00:48:00,753][106225] Updated weights for policy 1, policy_version 773649 (0.0008) [2023-12-28 00:48:00,758][106226] Updated weights for policy 0, policy_version 771605 (0.0010) [2023-12-28 00:48:00,805][106225] Updated weights for policy 1, policy_version 773659 (0.0010) [2023-12-28 00:48:00,860][106225] Updated weights for policy 1, policy_version 773669 (0.0010) [2023-12-28 00:48:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 20207.0, 300 sec: 19716.3). Total num frames: 395681792. Throughput: 0: 10134.9, 1: 10103.0. Samples: 395669960. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:01,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.326')] [2023-12-28 00:48:01,422][106226] Updated weights for policy 0, policy_version 771615 (0.0011) [2023-12-28 00:48:01,485][106226] Updated weights for policy 0, policy_version 771625 (0.0008) [2023-12-28 00:48:01,539][106226] Updated weights for policy 0, policy_version 771635 (0.0010) [2023-12-28 00:48:01,605][106225] Updated weights for policy 1, policy_version 773679 (0.0010) [2023-12-28 00:48:01,664][106225] Updated weights for policy 1, policy_version 773689 (0.0013) [2023-12-28 00:48:01,729][106225] Updated weights for policy 1, policy_version 773699 (0.0010) [2023-12-28 00:48:02,160][106226] Updated weights for policy 0, policy_version 771645 (0.0011) [2023-12-28 00:48:02,225][106226] Updated weights for policy 0, policy_version 771655 (0.0011) [2023-12-28 00:48:02,289][106226] Updated weights for policy 0, policy_version 771665 (0.0008) [2023-12-28 00:48:02,453][106225] Updated weights for policy 1, policy_version 773709 (0.0010) [2023-12-28 00:48:02,519][106225] Updated weights for policy 1, policy_version 773719 (0.0010) [2023-12-28 00:48:02,582][106225] Updated weights for policy 1, policy_version 773729 (0.0010) [2023-12-28 00:48:02,992][106226] Updated weights for policy 0, policy_version 771675 (0.0007) [2023-12-28 00:48:03,055][106226] Updated weights for policy 0, policy_version 771685 (0.0006) [2023-12-28 00:48:03,130][106226] Updated weights for policy 0, policy_version 771695 (0.0006) [2023-12-28 00:48:03,321][106225] Updated weights for policy 1, policy_version 773739 (0.0010) [2023-12-28 00:48:03,379][106225] Updated weights for policy 1, policy_version 773749 (0.0009) [2023-12-28 00:48:03,441][106225] Updated weights for policy 1, policy_version 773759 (0.0007) [2023-12-28 00:48:03,717][106226] Updated weights for policy 0, policy_version 771705 (0.0006) [2023-12-28 00:48:03,784][106226] Updated weights for policy 0, policy_version 771715 (0.0008) [2023-12-28 00:48:03,846][106226] Updated weights for policy 0, policy_version 771725 (0.0008) [2023-12-28 00:48:03,916][106226] Updated weights for policy 0, policy_version 771735 (0.0008) [2023-12-28 00:48:04,192][106225] Updated weights for policy 1, policy_version 773769 (0.0009) [2023-12-28 00:48:04,248][106225] Updated weights for policy 1, policy_version 773779 (0.0007) [2023-12-28 00:48:04,315][106225] Updated weights for policy 1, policy_version 773789 (0.0006) [2023-12-28 00:48:04,378][106225] Updated weights for policy 1, policy_version 773799 (0.0009) [2023-12-28 00:48:04,617][106226] Updated weights for policy 0, policy_version 771745 (0.0007) [2023-12-28 00:48:04,673][106226] Updated weights for policy 0, policy_version 771755 (0.0005) [2023-12-28 00:48:04,736][106226] Updated weights for policy 0, policy_version 771765 (0.0006) [2023-12-28 00:48:05,057][106225] Updated weights for policy 1, policy_version 773809 (0.0009) [2023-12-28 00:48:05,107][106225] Updated weights for policy 1, policy_version 773819 (0.0009) [2023-12-28 00:48:05,164][106225] Updated weights for policy 1, policy_version 773829 (0.0008) [2023-12-28 00:48:05,326][106226] Updated weights for policy 0, policy_version 771775 (0.0006) [2023-12-28 00:48:05,376][106226] Updated weights for policy 0, policy_version 771785 (0.0005) [2023-12-28 00:48:05,430][106226] Updated weights for policy 0, policy_version 771795 (0.0005) [2023-12-28 00:48:05,952][106226] Updated weights for policy 0, policy_version 771805 (0.0005) [2023-12-28 00:48:06,007][106226] Updated weights for policy 0, policy_version 771815 (0.0005) [2023-12-28 00:48:06,030][106225] Updated weights for policy 1, policy_version 773839 (0.0008) [2023-12-28 00:48:06,063][106226] Updated weights for policy 0, policy_version 771825 (0.0006) [2023-12-28 00:48:06,081][106225] Updated weights for policy 1, policy_version 773849 (0.0008) [2023-12-28 00:48:06,146][106225] Updated weights for policy 1, policy_version 773859 (0.0008) [2023-12-28 00:48:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 395780096. Throughput: 0: 10261.4, 1: 10044.0. Samples: 395791328. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:06,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-5.222')] [2023-12-28 00:48:06,753][106226] Updated weights for policy 0, policy_version 771835 (0.0008) [2023-12-28 00:48:06,806][106226] Updated weights for policy 0, policy_version 771845 (0.0006) [2023-12-28 00:48:06,864][106226] Updated weights for policy 0, policy_version 771855 (0.0007) [2023-12-28 00:48:06,893][106225] Updated weights for policy 1, policy_version 773869 (0.0007) [2023-12-28 00:48:06,981][106225] Updated weights for policy 1, policy_version 773879 (0.0007) [2023-12-28 00:48:07,027][106225] Updated weights for policy 1, policy_version 773889 (0.0007) [2023-12-28 00:48:07,537][106226] Updated weights for policy 0, policy_version 771865 (0.0008) [2023-12-28 00:48:07,584][106226] Updated weights for policy 0, policy_version 771875 (0.0010) [2023-12-28 00:48:07,637][106226] Updated weights for policy 0, policy_version 771885 (0.0010) [2023-12-28 00:48:07,693][106226] Updated weights for policy 0, policy_version 771895 (0.0010) [2023-12-28 00:48:07,720][106225] Updated weights for policy 1, policy_version 773899 (0.0008) [2023-12-28 00:48:07,777][106225] Updated weights for policy 1, policy_version 773909 (0.0006) [2023-12-28 00:48:07,829][106225] Updated weights for policy 1, policy_version 773919 (0.0006) [2023-12-28 00:48:08,379][106226] Updated weights for policy 0, policy_version 771905 (0.0008) [2023-12-28 00:48:08,416][106225] Updated weights for policy 1, policy_version 773929 (0.0005) [2023-12-28 00:48:08,432][106226] Updated weights for policy 0, policy_version 771915 (0.0006) [2023-12-28 00:48:08,482][106225] Updated weights for policy 1, policy_version 773939 (0.0008) [2023-12-28 00:48:08,488][106226] Updated weights for policy 0, policy_version 771925 (0.0007) [2023-12-28 00:48:08,541][106225] Updated weights for policy 1, policy_version 773949 (0.0006) [2023-12-28 00:48:08,592][106225] Updated weights for policy 1, policy_version 773959 (0.0005) [2023-12-28 00:48:09,221][106225] Updated weights for policy 1, policy_version 773969 (0.0007) [2023-12-28 00:48:09,266][106226] Updated weights for policy 0, policy_version 771935 (0.0008) [2023-12-28 00:48:09,289][106225] Updated weights for policy 1, policy_version 773979 (0.0008) [2023-12-28 00:48:09,326][106226] Updated weights for policy 0, policy_version 771945 (0.0008) [2023-12-28 00:48:09,355][106225] Updated weights for policy 1, policy_version 773989 (0.0008) [2023-12-28 00:48:09,396][106226] Updated weights for policy 0, policy_version 771955 (0.0008) [2023-12-28 00:48:10,050][106225] Updated weights for policy 1, policy_version 773999 (0.0007) [2023-12-28 00:48:10,116][106225] Updated weights for policy 1, policy_version 774009 (0.0006) [2023-12-28 00:48:10,179][106225] Updated weights for policy 1, policy_version 774019 (0.0007) [2023-12-28 00:48:10,189][106226] Updated weights for policy 0, policy_version 771965 (0.0008) [2023-12-28 00:48:10,251][106226] Updated weights for policy 0, policy_version 771975 (0.0008) [2023-12-28 00:48:10,317][106226] Updated weights for policy 0, policy_version 771985 (0.0007) [2023-12-28 00:48:10,769][106225] Updated weights for policy 1, policy_version 774029 (0.0007) [2023-12-28 00:48:10,825][106225] Updated weights for policy 1, policy_version 774039 (0.0008) [2023-12-28 00:48:10,892][106225] Updated weights for policy 1, policy_version 774049 (0.0009) [2023-12-28 00:48:11,055][106226] Updated weights for policy 0, policy_version 771995 (0.0008) [2023-12-28 00:48:11,126][106226] Updated weights for policy 0, policy_version 772005 (0.0008) [2023-12-28 00:48:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19744.1). Total num frames: 395878400. Throughput: 0: 10259.1, 1: 10084.3. Samples: 395851108. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:11,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.341')] [2023-12-28 00:48:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000774056_198197248.pth... [2023-12-28 00:48:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000772872_197894144.pth [2023-12-28 00:48:11,193][106226] Updated weights for policy 0, policy_version 772015 (0.0007) [2023-12-28 00:48:11,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000772024_197689344.pth... [2023-12-28 00:48:11,253][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000770840_197386240.pth [2023-12-28 00:48:11,642][106225] Updated weights for policy 1, policy_version 774059 (0.0008) [2023-12-28 00:48:11,702][106225] Updated weights for policy 1, policy_version 774069 (0.0009) [2023-12-28 00:48:11,777][106225] Updated weights for policy 1, policy_version 774079 (0.0008) [2023-12-28 00:48:11,999][106226] Updated weights for policy 0, policy_version 772025 (0.0008) [2023-12-28 00:48:12,060][106226] Updated weights for policy 0, policy_version 772035 (0.0008) [2023-12-28 00:48:12,123][106226] Updated weights for policy 0, policy_version 772045 (0.0010) [2023-12-28 00:48:12,184][106226] Updated weights for policy 0, policy_version 772055 (0.0009) [2023-12-28 00:48:12,504][106225] Updated weights for policy 1, policy_version 774089 (0.0009) [2023-12-28 00:48:12,553][106225] Updated weights for policy 1, policy_version 774099 (0.0008) [2023-12-28 00:48:12,610][106225] Updated weights for policy 1, policy_version 774109 (0.0009) [2023-12-28 00:48:12,672][106225] Updated weights for policy 1, policy_version 774119 (0.0008) [2023-12-28 00:48:12,940][106226] Updated weights for policy 0, policy_version 772065 (0.0010) [2023-12-28 00:48:13,000][106226] Updated weights for policy 0, policy_version 772075 (0.0010) [2023-12-28 00:48:13,067][106226] Updated weights for policy 0, policy_version 772085 (0.0009) [2023-12-28 00:48:13,344][106225] Updated weights for policy 1, policy_version 774129 (0.0006) [2023-12-28 00:48:13,394][106225] Updated weights for policy 1, policy_version 774139 (0.0007) [2023-12-28 00:48:13,453][106225] Updated weights for policy 1, policy_version 774149 (0.0008) [2023-12-28 00:48:13,711][106226] Updated weights for policy 0, policy_version 772095 (0.0010) [2023-12-28 00:48:13,773][106226] Updated weights for policy 0, policy_version 772105 (0.0011) [2023-12-28 00:48:13,825][106226] Updated weights for policy 0, policy_version 772115 (0.0010) [2023-12-28 00:48:14,116][106225] Updated weights for policy 1, policy_version 774159 (0.0006) [2023-12-28 00:48:14,175][106225] Updated weights for policy 1, policy_version 774169 (0.0007) [2023-12-28 00:48:14,228][106225] Updated weights for policy 1, policy_version 774179 (0.0008) [2023-12-28 00:48:14,456][106226] Updated weights for policy 0, policy_version 772125 (0.0010) [2023-12-28 00:48:14,523][106226] Updated weights for policy 0, policy_version 772135 (0.0011) [2023-12-28 00:48:14,583][106226] Updated weights for policy 0, policy_version 772145 (0.0011) [2023-12-28 00:48:14,913][106225] Updated weights for policy 1, policy_version 774189 (0.0007) [2023-12-28 00:48:14,975][106225] Updated weights for policy 1, policy_version 774199 (0.0010) [2023-12-28 00:48:15,044][106225] Updated weights for policy 1, policy_version 774209 (0.0010) [2023-12-28 00:48:15,289][106226] Updated weights for policy 0, policy_version 772155 (0.0010) [2023-12-28 00:48:15,348][106226] Updated weights for policy 0, policy_version 772165 (0.0011) [2023-12-28 00:48:15,407][106226] Updated weights for policy 0, policy_version 772175 (0.0009) [2023-12-28 00:48:15,610][106225] Updated weights for policy 1, policy_version 774219 (0.0009) [2023-12-28 00:48:15,677][106225] Updated weights for policy 1, policy_version 774229 (0.0007) [2023-12-28 00:48:15,729][106225] Updated weights for policy 1, policy_version 774239 (0.0010) [2023-12-28 00:48:15,980][106226] Updated weights for policy 0, policy_version 772185 (0.0006) [2023-12-28 00:48:16,040][106226] Updated weights for policy 0, policy_version 772195 (0.0008) [2023-12-28 00:48:16,109][106226] Updated weights for policy 0, policy_version 772205 (0.0007) [2023-12-28 00:48:16,172][106226] Updated weights for policy 0, policy_version 772215 (0.0007) [2023-12-28 00:48:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20206.9, 300 sec: 19744.1). Total num frames: 395976704. Throughput: 0: 10047.0, 1: 9951.4. Samples: 395967944. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:16,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-5.186')] [2023-12-28 00:48:16,361][106225] Updated weights for policy 1, policy_version 774249 (0.0006) [2023-12-28 00:48:16,419][106225] Updated weights for policy 1, policy_version 774259 (0.0006) [2023-12-28 00:48:16,475][106225] Updated weights for policy 1, policy_version 774269 (0.0006) [2023-12-28 00:48:16,528][106225] Updated weights for policy 1, policy_version 774279 (0.0005) [2023-12-28 00:48:16,833][106226] Updated weights for policy 0, policy_version 772225 (0.0007) [2023-12-28 00:48:16,889][106226] Updated weights for policy 0, policy_version 772235 (0.0008) [2023-12-28 00:48:16,946][106226] Updated weights for policy 0, policy_version 772245 (0.0007) [2023-12-28 00:48:17,207][106225] Updated weights for policy 1, policy_version 774289 (0.0010) [2023-12-28 00:48:17,267][106225] Updated weights for policy 1, policy_version 774299 (0.0010) [2023-12-28 00:48:17,327][106225] Updated weights for policy 1, policy_version 774309 (0.0010) [2023-12-28 00:48:17,588][106226] Updated weights for policy 0, policy_version 772255 (0.0007) [2023-12-28 00:48:17,645][106226] Updated weights for policy 0, policy_version 772265 (0.0008) [2023-12-28 00:48:17,702][106226] Updated weights for policy 0, policy_version 772275 (0.0008) [2023-12-28 00:48:18,045][106225] Updated weights for policy 1, policy_version 774319 (0.0010) [2023-12-28 00:48:18,092][106225] Updated weights for policy 1, policy_version 774329 (0.0010) [2023-12-28 00:48:18,142][106225] Updated weights for policy 1, policy_version 774339 (0.0010) [2023-12-28 00:48:18,453][106226] Updated weights for policy 0, policy_version 772285 (0.0008) [2023-12-28 00:48:18,518][106226] Updated weights for policy 0, policy_version 772295 (0.0008) [2023-12-28 00:48:18,583][106226] Updated weights for policy 0, policy_version 772305 (0.0008) [2023-12-28 00:48:18,926][106225] Updated weights for policy 1, policy_version 774349 (0.0011) [2023-12-28 00:48:18,977][106225] Updated weights for policy 1, policy_version 774359 (0.0011) [2023-12-28 00:48:19,031][106225] Updated weights for policy 1, policy_version 774369 (0.0010) [2023-12-28 00:48:19,289][106226] Updated weights for policy 0, policy_version 772315 (0.0008) [2023-12-28 00:48:19,358][106226] Updated weights for policy 0, policy_version 772325 (0.0009) [2023-12-28 00:48:19,424][106226] Updated weights for policy 0, policy_version 772335 (0.0009) [2023-12-28 00:48:19,777][106225] Updated weights for policy 1, policy_version 774379 (0.0009) [2023-12-28 00:48:19,847][106225] Updated weights for policy 1, policy_version 774389 (0.0007) [2023-12-28 00:48:19,916][106225] Updated weights for policy 1, policy_version 774399 (0.0008) [2023-12-28 00:48:20,215][106226] Updated weights for policy 0, policy_version 772345 (0.0009) [2023-12-28 00:48:20,264][106226] Updated weights for policy 0, policy_version 772355 (0.0008) [2023-12-28 00:48:20,314][106226] Updated weights for policy 0, policy_version 772365 (0.0008) [2023-12-28 00:48:20,369][106226] Updated weights for policy 0, policy_version 772375 (0.0008) [2023-12-28 00:48:20,653][106225] Updated weights for policy 1, policy_version 774409 (0.0010) [2023-12-28 00:48:20,711][106225] Updated weights for policy 1, policy_version 774419 (0.0008) [2023-12-28 00:48:20,771][106225] Updated weights for policy 1, policy_version 774429 (0.0008) [2023-12-28 00:48:20,830][106225] Updated weights for policy 1, policy_version 774439 (0.0009) [2023-12-28 00:48:21,139][106226] Updated weights for policy 0, policy_version 772385 (0.0008) [2023-12-28 00:48:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20207.0, 300 sec: 19716.4). Total num frames: 396075008. Throughput: 0: 10047.0, 1: 9955.1. Samples: 396086496. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:21,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.969')] [2023-12-28 00:48:21,206][106226] Updated weights for policy 0, policy_version 772395 (0.0008) [2023-12-28 00:48:21,270][106226] Updated weights for policy 0, policy_version 772405 (0.0008) [2023-12-28 00:48:21,620][106225] Updated weights for policy 1, policy_version 774449 (0.0010) [2023-12-28 00:48:21,680][106225] Updated weights for policy 1, policy_version 774459 (0.0009) [2023-12-28 00:48:21,752][106225] Updated weights for policy 1, policy_version 774469 (0.0010) [2023-12-28 00:48:22,080][106226] Updated weights for policy 0, policy_version 772415 (0.0010) [2023-12-28 00:48:22,135][106226] Updated weights for policy 0, policy_version 772425 (0.0010) [2023-12-28 00:48:22,193][106226] Updated weights for policy 0, policy_version 772435 (0.0011) [2023-12-28 00:48:22,496][106225] Updated weights for policy 1, policy_version 774479 (0.0007) [2023-12-28 00:48:22,551][106225] Updated weights for policy 1, policy_version 774489 (0.0010) [2023-12-28 00:48:22,608][106225] Updated weights for policy 1, policy_version 774499 (0.0010) [2023-12-28 00:48:22,915][106226] Updated weights for policy 0, policy_version 772445 (0.0008) [2023-12-28 00:48:22,976][106226] Updated weights for policy 0, policy_version 772455 (0.0005) [2023-12-28 00:48:23,034][106226] Updated weights for policy 0, policy_version 772465 (0.0006) [2023-12-28 00:48:23,310][106225] Updated weights for policy 1, policy_version 774509 (0.0008) [2023-12-28 00:48:23,363][106225] Updated weights for policy 1, policy_version 774519 (0.0008) [2023-12-28 00:48:23,419][106225] Updated weights for policy 1, policy_version 774529 (0.0007) [2023-12-28 00:48:23,710][106226] Updated weights for policy 0, policy_version 772475 (0.0008) [2023-12-28 00:48:23,774][106226] Updated weights for policy 0, policy_version 772485 (0.0007) [2023-12-28 00:48:23,840][106226] Updated weights for policy 0, policy_version 772495 (0.0010) [2023-12-28 00:48:24,153][106225] Updated weights for policy 1, policy_version 774539 (0.0007) [2023-12-28 00:48:24,216][106225] Updated weights for policy 1, policy_version 774549 (0.0007) [2023-12-28 00:48:24,273][106225] Updated weights for policy 1, policy_version 774559 (0.0008) [2023-12-28 00:48:24,529][106226] Updated weights for policy 0, policy_version 772505 (0.0010) [2023-12-28 00:48:24,593][106226] Updated weights for policy 0, policy_version 772515 (0.0005) [2023-12-28 00:48:24,648][106226] Updated weights for policy 0, policy_version 772525 (0.0006) [2023-12-28 00:48:24,705][106226] Updated weights for policy 0, policy_version 772535 (0.0009) [2023-12-28 00:48:24,993][106225] Updated weights for policy 1, policy_version 774569 (0.0007) [2023-12-28 00:48:25,047][106225] Updated weights for policy 1, policy_version 774579 (0.0009) [2023-12-28 00:48:25,104][106225] Updated weights for policy 1, policy_version 774589 (0.0010) [2023-12-28 00:48:25,164][106225] Updated weights for policy 1, policy_version 774599 (0.0009) [2023-12-28 00:48:25,273][106226] Updated weights for policy 0, policy_version 772545 (0.0006) [2023-12-28 00:48:25,320][106226] Updated weights for policy 0, policy_version 772555 (0.0005) [2023-12-28 00:48:25,365][106226] Updated weights for policy 0, policy_version 772565 (0.0007) [2023-12-28 00:48:25,948][106225] Updated weights for policy 1, policy_version 774609 (0.0009) [2023-12-28 00:48:26,007][106225] Updated weights for policy 1, policy_version 774619 (0.0008) [2023-12-28 00:48:26,029][106226] Updated weights for policy 0, policy_version 772575 (0.0007) [2023-12-28 00:48:26,067][106225] Updated weights for policy 1, policy_version 774629 (0.0006) [2023-12-28 00:48:26,092][106226] Updated weights for policy 0, policy_version 772585 (0.0008) [2023-12-28 00:48:26,148][106226] Updated weights for policy 0, policy_version 772595 (0.0008) [2023-12-28 00:48:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 396181504. Throughput: 0: 9993.9, 1: 9921.6. Samples: 396143060. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:26,176][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.985')] [2023-12-28 00:48:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000774632_198344704.pth... [2023-12-28 00:48:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000772600_197836800.pth... [2023-12-28 00:48:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000771416_197533696.pth [2023-12-28 00:48:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000773480_198049792.pth [2023-12-28 00:48:26,731][106225] Updated weights for policy 1, policy_version 774639 (0.0008) [2023-12-28 00:48:26,781][106226] Updated weights for policy 0, policy_version 772605 (0.0008) [2023-12-28 00:48:26,787][106225] Updated weights for policy 1, policy_version 774649 (0.0007) [2023-12-28 00:48:26,838][106226] Updated weights for policy 0, policy_version 772615 (0.0008) [2023-12-28 00:48:26,841][106225] Updated weights for policy 1, policy_version 774659 (0.0006) [2023-12-28 00:48:26,888][106226] Updated weights for policy 0, policy_version 772625 (0.0007) [2023-12-28 00:48:27,393][106225] Updated weights for policy 1, policy_version 774669 (0.0007) [2023-12-28 00:48:27,439][106225] Updated weights for policy 1, policy_version 774679 (0.0005) [2023-12-28 00:48:27,487][106225] Updated weights for policy 1, policy_version 774689 (0.0005) [2023-12-28 00:48:27,697][106226] Updated weights for policy 0, policy_version 772636 (0.0009) [2023-12-28 00:48:27,765][106226] Updated weights for policy 0, policy_version 772646 (0.0006) [2023-12-28 00:48:27,826][106226] Updated weights for policy 0, policy_version 772656 (0.0008) [2023-12-28 00:48:28,199][106225] Updated weights for policy 1, policy_version 774699 (0.0008) [2023-12-28 00:48:28,243][106225] Updated weights for policy 1, policy_version 774709 (0.0008) [2023-12-28 00:48:28,288][106225] Updated weights for policy 1, policy_version 774719 (0.0009) [2023-12-28 00:48:28,474][106226] Updated weights for policy 0, policy_version 772666 (0.0006) [2023-12-28 00:48:28,532][106226] Updated weights for policy 0, policy_version 772676 (0.0006) [2023-12-28 00:48:28,589][106226] Updated weights for policy 0, policy_version 772686 (0.0005) [2023-12-28 00:48:28,647][106226] Updated weights for policy 0, policy_version 772696 (0.0005) [2023-12-28 00:48:29,095][106225] Updated weights for policy 1, policy_version 774729 (0.0007) [2023-12-28 00:48:29,155][106225] Updated weights for policy 1, policy_version 774739 (0.0008) [2023-12-28 00:48:29,203][106225] Updated weights for policy 1, policy_version 774749 (0.0006) [2023-12-28 00:48:29,226][106226] Updated weights for policy 0, policy_version 772706 (0.0009) [2023-12-28 00:48:29,269][106225] Updated weights for policy 1, policy_version 774759 (0.0007) [2023-12-28 00:48:29,287][106226] Updated weights for policy 0, policy_version 772716 (0.0007) [2023-12-28 00:48:29,340][106226] Updated weights for policy 0, policy_version 772726 (0.0010) [2023-12-28 00:48:30,006][106225] Updated weights for policy 1, policy_version 774769 (0.0008) [2023-12-28 00:48:30,067][106225] Updated weights for policy 1, policy_version 774779 (0.0006) [2023-12-28 00:48:30,103][106226] Updated weights for policy 0, policy_version 772736 (0.0008) [2023-12-28 00:48:30,131][106225] Updated weights for policy 1, policy_version 774789 (0.0007) [2023-12-28 00:48:30,159][106226] Updated weights for policy 0, policy_version 772746 (0.0008) [2023-12-28 00:48:30,225][106226] Updated weights for policy 0, policy_version 772756 (0.0008) [2023-12-28 00:48:30,712][106225] Updated weights for policy 1, policy_version 774799 (0.0007) [2023-12-28 00:48:30,761][106225] Updated weights for policy 1, policy_version 774809 (0.0009) [2023-12-28 00:48:30,819][106225] Updated weights for policy 1, policy_version 774819 (0.0007) [2023-12-28 00:48:30,878][106226] Updated weights for policy 0, policy_version 772766 (0.0010) [2023-12-28 00:48:30,939][106226] Updated weights for policy 0, policy_version 772776 (0.0011) [2023-12-28 00:48:30,996][106226] Updated weights for policy 0, policy_version 772786 (0.0010) [2023-12-28 00:48:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 396279808. Throughput: 0: 10093.2, 1: 9905.8. Samples: 396263944. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:31,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.147')] [2023-12-28 00:48:31,544][106225] Updated weights for policy 1, policy_version 774829 (0.0006) [2023-12-28 00:48:31,591][106225] Updated weights for policy 1, policy_version 774839 (0.0006) [2023-12-28 00:48:31,651][106225] Updated weights for policy 1, policy_version 774849 (0.0007) [2023-12-28 00:48:31,772][106226] Updated weights for policy 0, policy_version 772796 (0.0009) [2023-12-28 00:48:31,824][106226] Updated weights for policy 0, policy_version 772806 (0.0010) [2023-12-28 00:48:31,876][106226] Updated weights for policy 0, policy_version 772816 (0.0008) [2023-12-28 00:48:32,383][106225] Updated weights for policy 1, policy_version 774859 (0.0008) [2023-12-28 00:48:32,434][106225] Updated weights for policy 1, policy_version 774869 (0.0005) [2023-12-28 00:48:32,480][106225] Updated weights for policy 1, policy_version 774879 (0.0006) [2023-12-28 00:48:32,593][106226] Updated weights for policy 0, policy_version 772826 (0.0008) [2023-12-28 00:48:32,651][106226] Updated weights for policy 0, policy_version 772836 (0.0010) [2023-12-28 00:48:32,712][106226] Updated weights for policy 0, policy_version 772846 (0.0010) [2023-12-28 00:48:32,765][106226] Updated weights for policy 0, policy_version 772856 (0.0010) [2023-12-28 00:48:33,183][106225] Updated weights for policy 1, policy_version 774889 (0.0008) [2023-12-28 00:48:33,229][106225] Updated weights for policy 1, policy_version 774899 (0.0008) [2023-12-28 00:48:33,271][106225] Updated weights for policy 1, policy_version 774909 (0.0007) [2023-12-28 00:48:33,319][106225] Updated weights for policy 1, policy_version 774919 (0.0007) [2023-12-28 00:48:33,422][106226] Updated weights for policy 0, policy_version 772866 (0.0010) [2023-12-28 00:48:33,498][106226] Updated weights for policy 0, policy_version 772877 (0.0009) [2023-12-28 00:48:33,564][106226] Updated weights for policy 0, policy_version 772887 (0.0010) [2023-12-28 00:48:34,070][106225] Updated weights for policy 1, policy_version 774929 (0.0008) [2023-12-28 00:48:34,127][106225] Updated weights for policy 1, policy_version 774939 (0.0008) [2023-12-28 00:48:34,190][106225] Updated weights for policy 1, policy_version 774949 (0.0008) [2023-12-28 00:48:34,310][106226] Updated weights for policy 0, policy_version 772897 (0.0011) [2023-12-28 00:48:34,371][106226] Updated weights for policy 0, policy_version 772907 (0.0010) [2023-12-28 00:48:34,426][106226] Updated weights for policy 0, policy_version 772917 (0.0011) [2023-12-28 00:48:34,897][106225] Updated weights for policy 1, policy_version 774959 (0.0009) [2023-12-28 00:48:34,960][106225] Updated weights for policy 1, policy_version 774969 (0.0008) [2023-12-28 00:48:35,018][106225] Updated weights for policy 1, policy_version 774979 (0.0007) [2023-12-28 00:48:35,141][106226] Updated weights for policy 0, policy_version 772927 (0.0011) [2023-12-28 00:48:35,191][106226] Updated weights for policy 0, policy_version 772937 (0.0010) [2023-12-28 00:48:35,252][106226] Updated weights for policy 0, policy_version 772947 (0.0010) [2023-12-28 00:48:35,720][106225] Updated weights for policy 1, policy_version 774989 (0.0007) [2023-12-28 00:48:35,765][106225] Updated weights for policy 1, policy_version 774999 (0.0007) [2023-12-28 00:48:35,821][106225] Updated weights for policy 1, policy_version 775009 (0.0009) [2023-12-28 00:48:35,970][106226] Updated weights for policy 0, policy_version 772957 (0.0011) [2023-12-28 00:48:36,021][106226] Updated weights for policy 0, policy_version 772967 (0.0011) [2023-12-28 00:48:36,079][106226] Updated weights for policy 0, policy_version 772977 (0.0011) [2023-12-28 00:48:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.5, 300 sec: 19744.1). Total num frames: 396378112. Throughput: 0: 10024.7, 1: 9872.3. Samples: 396382256. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:36,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-5.225')] [2023-12-28 00:48:36,632][106225] Updated weights for policy 1, policy_version 775019 (0.0008) [2023-12-28 00:48:36,691][106225] Updated weights for policy 1, policy_version 775029 (0.0008) [2023-12-28 00:48:36,749][106225] Updated weights for policy 1, policy_version 775039 (0.0008) [2023-12-28 00:48:36,754][106226] Updated weights for policy 0, policy_version 772987 (0.0008) [2023-12-28 00:48:36,819][106226] Updated weights for policy 0, policy_version 772997 (0.0008) [2023-12-28 00:48:36,872][106226] Updated weights for policy 0, policy_version 773007 (0.0010) [2023-12-28 00:48:37,393][106225] Updated weights for policy 1, policy_version 775049 (0.0006) [2023-12-28 00:48:37,450][106225] Updated weights for policy 1, policy_version 775059 (0.0009) [2023-12-28 00:48:37,515][106225] Updated weights for policy 1, policy_version 775069 (0.0011) [2023-12-28 00:48:37,518][106226] Updated weights for policy 0, policy_version 773017 (0.0010) [2023-12-28 00:48:37,572][106225] Updated weights for policy 1, policy_version 775079 (0.0010) [2023-12-28 00:48:37,578][106226] Updated weights for policy 0, policy_version 773027 (0.0009) [2023-12-28 00:48:37,631][106226] Updated weights for policy 0, policy_version 773037 (0.0010) [2023-12-28 00:48:37,694][106226] Updated weights for policy 0, policy_version 773047 (0.0008) [2023-12-28 00:48:38,244][106225] Updated weights for policy 1, policy_version 775089 (0.0010) [2023-12-28 00:48:38,290][106225] Updated weights for policy 1, policy_version 775099 (0.0010) [2023-12-28 00:48:38,357][106225] Updated weights for policy 1, policy_version 775109 (0.0010) [2023-12-28 00:48:38,375][106226] Updated weights for policy 0, policy_version 773057 (0.0010) [2023-12-28 00:48:38,434][106226] Updated weights for policy 0, policy_version 773067 (0.0011) [2023-12-28 00:48:38,483][106226] Updated weights for policy 0, policy_version 773077 (0.0010) [2023-12-28 00:48:39,087][106226] Updated weights for policy 0, policy_version 773087 (0.0006) [2023-12-28 00:48:39,101][106225] Updated weights for policy 1, policy_version 775119 (0.0011) [2023-12-28 00:48:39,144][106226] Updated weights for policy 0, policy_version 773097 (0.0005) [2023-12-28 00:48:39,155][106225] Updated weights for policy 1, policy_version 775129 (0.0010) [2023-12-28 00:48:39,204][106226] Updated weights for policy 0, policy_version 773107 (0.0006) [2023-12-28 00:48:39,207][106225] Updated weights for policy 1, policy_version 775139 (0.0010) [2023-12-28 00:48:39,921][106226] Updated weights for policy 0, policy_version 773117 (0.0010) [2023-12-28 00:48:39,984][106225] Updated weights for policy 1, policy_version 775149 (0.0009) [2023-12-28 00:48:39,989][106226] Updated weights for policy 0, policy_version 773127 (0.0007) [2023-12-28 00:48:40,047][106225] Updated weights for policy 1, policy_version 775159 (0.0008) [2023-12-28 00:48:40,048][106226] Updated weights for policy 0, policy_version 773137 (0.0007) [2023-12-28 00:48:40,114][106225] Updated weights for policy 1, policy_version 775169 (0.0008) [2023-12-28 00:48:40,693][106226] Updated weights for policy 0, policy_version 773147 (0.0007) [2023-12-28 00:48:40,744][106226] Updated weights for policy 0, policy_version 773157 (0.0007) [2023-12-28 00:48:40,800][106226] Updated weights for policy 0, policy_version 773167 (0.0007) [2023-12-28 00:48:40,883][106225] Updated weights for policy 1, policy_version 775179 (0.0007) [2023-12-28 00:48:40,935][106225] Updated weights for policy 1, policy_version 775189 (0.0008) [2023-12-28 00:48:41,000][106225] Updated weights for policy 1, policy_version 775199 (0.0005) [2023-12-28 00:48:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 396476416. Throughput: 0: 10078.9, 1: 9884.3. Samples: 396443452. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:41,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.248')] [2023-12-28 00:48:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000773176_197984256.pth... [2023-12-28 00:48:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000775208_198492160.pth... [2023-12-28 00:48:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000772024_197689344.pth [2023-12-28 00:48:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000774056_198197248.pth [2023-12-28 00:48:41,585][106226] Updated weights for policy 0, policy_version 773177 (0.0007) [2023-12-28 00:48:41,652][106226] Updated weights for policy 0, policy_version 773187 (0.0009) [2023-12-28 00:48:41,719][106226] Updated weights for policy 0, policy_version 773197 (0.0009) [2023-12-28 00:48:41,780][106225] Updated weights for policy 1, policy_version 775209 (0.0008) [2023-12-28 00:48:41,790][106226] Updated weights for policy 0, policy_version 773207 (0.0008) [2023-12-28 00:48:41,836][106225] Updated weights for policy 1, policy_version 775219 (0.0009) [2023-12-28 00:48:41,897][106225] Updated weights for policy 1, policy_version 775229 (0.0008) [2023-12-28 00:48:41,956][106225] Updated weights for policy 1, policy_version 775239 (0.0009) [2023-12-28 00:48:42,540][106226] Updated weights for policy 0, policy_version 773217 (0.0010) [2023-12-28 00:48:42,603][106226] Updated weights for policy 0, policy_version 773227 (0.0010) [2023-12-28 00:48:42,667][106226] Updated weights for policy 0, policy_version 773237 (0.0009) [2023-12-28 00:48:42,690][106225] Updated weights for policy 1, policy_version 775249 (0.0006) [2023-12-28 00:48:42,756][106225] Updated weights for policy 1, policy_version 775259 (0.0006) [2023-12-28 00:48:42,823][106225] Updated weights for policy 1, policy_version 775269 (0.0006) [2023-12-28 00:48:43,392][106226] Updated weights for policy 0, policy_version 773247 (0.0006) [2023-12-28 00:48:43,416][106225] Updated weights for policy 1, policy_version 775279 (0.0009) [2023-12-28 00:48:43,447][106226] Updated weights for policy 0, policy_version 773257 (0.0006) [2023-12-28 00:48:43,466][106225] Updated weights for policy 1, policy_version 775289 (0.0010) [2023-12-28 00:48:43,501][106226] Updated weights for policy 0, policy_version 773267 (0.0010) [2023-12-28 00:48:43,513][106225] Updated weights for policy 1, policy_version 775299 (0.0010) [2023-12-28 00:48:44,038][106226] Updated weights for policy 0, policy_version 773277 (0.0008) [2023-12-28 00:48:44,093][106225] Updated weights for policy 1, policy_version 775309 (0.0005) [2023-12-28 00:48:44,095][106226] Updated weights for policy 0, policy_version 773287 (0.0005) [2023-12-28 00:48:44,146][106226] Updated weights for policy 0, policy_version 773297 (0.0005) [2023-12-28 00:48:44,146][106225] Updated weights for policy 1, policy_version 775319 (0.0010) [2023-12-28 00:48:44,203][106225] Updated weights for policy 1, policy_version 775329 (0.0006) [2023-12-28 00:48:44,799][106226] Updated weights for policy 0, policy_version 773307 (0.0007) [2023-12-28 00:48:44,863][106226] Updated weights for policy 0, policy_version 773317 (0.0011) [2023-12-28 00:48:44,870][106225] Updated weights for policy 1, policy_version 775339 (0.0006) [2023-12-28 00:48:44,925][106225] Updated weights for policy 1, policy_version 775349 (0.0008) [2023-12-28 00:48:44,930][106226] Updated weights for policy 0, policy_version 773327 (0.0011) [2023-12-28 00:48:44,981][106225] Updated weights for policy 1, policy_version 775359 (0.0008) [2023-12-28 00:48:45,645][106226] Updated weights for policy 0, policy_version 773337 (0.0011) [2023-12-28 00:48:45,694][106226] Updated weights for policy 0, policy_version 773347 (0.0010) [2023-12-28 00:48:45,718][106225] Updated weights for policy 1, policy_version 775369 (0.0008) [2023-12-28 00:48:45,751][106226] Updated weights for policy 0, policy_version 773357 (0.0010) [2023-12-28 00:48:45,774][106225] Updated weights for policy 1, policy_version 775379 (0.0010) [2023-12-28 00:48:45,810][106226] Updated weights for policy 0, policy_version 773367 (0.0010) [2023-12-28 00:48:45,827][106225] Updated weights for policy 1, policy_version 775389 (0.0010) [2023-12-28 00:48:45,888][106225] Updated weights for policy 1, policy_version 775399 (0.0011) [2023-12-28 00:48:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 396574720. Throughput: 0: 9969.8, 1: 9857.3. Samples: 396562180. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:46,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-5.357')] [2023-12-28 00:48:46,523][106226] Updated weights for policy 0, policy_version 773377 (0.0010) [2023-12-28 00:48:46,551][106225] Updated weights for policy 1, policy_version 775409 (0.0006) [2023-12-28 00:48:46,583][106226] Updated weights for policy 0, policy_version 773387 (0.0010) [2023-12-28 00:48:46,603][106225] Updated weights for policy 1, policy_version 775419 (0.0008) [2023-12-28 00:48:46,640][106226] Updated weights for policy 0, policy_version 773397 (0.0011) [2023-12-28 00:48:46,658][106225] Updated weights for policy 1, policy_version 775429 (0.0006) [2023-12-28 00:48:47,309][106225] Updated weights for policy 1, policy_version 775439 (0.0010) [2023-12-28 00:48:47,324][106226] Updated weights for policy 0, policy_version 773407 (0.0011) [2023-12-28 00:48:47,365][106225] Updated weights for policy 1, policy_version 775449 (0.0010) [2023-12-28 00:48:47,383][106226] Updated weights for policy 0, policy_version 773417 (0.0010) [2023-12-28 00:48:47,410][106225] Updated weights for policy 1, policy_version 775459 (0.0006) [2023-12-28 00:48:47,436][106226] Updated weights for policy 0, policy_version 773427 (0.0010) [2023-12-28 00:48:48,076][106225] Updated weights for policy 1, policy_version 775469 (0.0008) [2023-12-28 00:48:48,132][106226] Updated weights for policy 0, policy_version 773437 (0.0010) [2023-12-28 00:48:48,139][106225] Updated weights for policy 1, policy_version 775479 (0.0010) [2023-12-28 00:48:48,183][106226] Updated weights for policy 0, policy_version 773447 (0.0008) [2023-12-28 00:48:48,201][106225] Updated weights for policy 1, policy_version 775489 (0.0010) [2023-12-28 00:48:48,242][106226] Updated weights for policy 0, policy_version 773457 (0.0005) [2023-12-28 00:48:48,839][106225] Updated weights for policy 1, policy_version 775499 (0.0010) [2023-12-28 00:48:48,890][106225] Updated weights for policy 1, policy_version 775509 (0.0007) [2023-12-28 00:48:48,936][106226] Updated weights for policy 0, policy_version 773467 (0.0007) [2023-12-28 00:48:48,949][106225] Updated weights for policy 1, policy_version 775519 (0.0008) [2023-12-28 00:48:48,994][106226] Updated weights for policy 0, policy_version 773477 (0.0011) [2023-12-28 00:48:49,045][106226] Updated weights for policy 0, policy_version 773487 (0.0010) [2023-12-28 00:48:49,705][106225] Updated weights for policy 1, policy_version 775529 (0.0010) [2023-12-28 00:48:49,770][106225] Updated weights for policy 1, policy_version 775539 (0.0009) [2023-12-28 00:48:49,837][106225] Updated weights for policy 1, policy_version 775549 (0.0007) [2023-12-28 00:48:49,856][106226] Updated weights for policy 0, policy_version 773497 (0.0011) [2023-12-28 00:48:49,910][106225] Updated weights for policy 1, policy_version 775559 (0.0008) [2023-12-28 00:48:49,922][106226] Updated weights for policy 0, policy_version 773507 (0.0007) [2023-12-28 00:48:49,994][106226] Updated weights for policy 0, policy_version 773517 (0.0007) [2023-12-28 00:48:50,055][106226] Updated weights for policy 0, policy_version 773527 (0.0006) [2023-12-28 00:48:50,659][106225] Updated weights for policy 1, policy_version 775569 (0.0010) [2023-12-28 00:48:50,721][106225] Updated weights for policy 1, policy_version 775579 (0.0010) [2023-12-28 00:48:50,723][106226] Updated weights for policy 0, policy_version 773537 (0.0010) [2023-12-28 00:48:50,781][106226] Updated weights for policy 0, policy_version 773547 (0.0011) [2023-12-28 00:48:50,782][106225] Updated weights for policy 1, policy_version 775589 (0.0010) [2023-12-28 00:48:50,840][106226] Updated weights for policy 0, policy_version 773557 (0.0009) [2023-12-28 00:48:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 396673024. Throughput: 0: 9862.4, 1: 9903.2. Samples: 396680780. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:51,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.227')] [2023-12-28 00:48:51,490][106225] Updated weights for policy 1, policy_version 775599 (0.0010) [2023-12-28 00:48:51,551][106225] Updated weights for policy 1, policy_version 775609 (0.0006) [2023-12-28 00:48:51,566][106226] Updated weights for policy 0, policy_version 773567 (0.0010) [2023-12-28 00:48:51,606][106225] Updated weights for policy 1, policy_version 775619 (0.0007) [2023-12-28 00:48:51,629][106226] Updated weights for policy 0, policy_version 773577 (0.0010) [2023-12-28 00:48:51,692][106226] Updated weights for policy 0, policy_version 773587 (0.0011) [2023-12-28 00:48:52,245][106225] Updated weights for policy 1, policy_version 775629 (0.0009) [2023-12-28 00:48:52,311][106225] Updated weights for policy 1, policy_version 775639 (0.0010) [2023-12-28 00:48:52,377][106225] Updated weights for policy 1, policy_version 775649 (0.0010) [2023-12-28 00:48:52,507][106226] Updated weights for policy 0, policy_version 773597 (0.0009) [2023-12-28 00:48:52,572][106226] Updated weights for policy 0, policy_version 773607 (0.0007) [2023-12-28 00:48:52,630][106226] Updated weights for policy 0, policy_version 773617 (0.0006) [2023-12-28 00:48:53,032][106225] Updated weights for policy 1, policy_version 775659 (0.0009) [2023-12-28 00:48:53,082][106225] Updated weights for policy 1, policy_version 775669 (0.0007) [2023-12-28 00:48:53,132][106225] Updated weights for policy 1, policy_version 775679 (0.0010) [2023-12-28 00:48:53,274][106226] Updated weights for policy 0, policy_version 773627 (0.0007) [2023-12-28 00:48:53,324][106226] Updated weights for policy 0, policy_version 773637 (0.0010) [2023-12-28 00:48:53,370][106226] Updated weights for policy 0, policy_version 773647 (0.0010) [2023-12-28 00:48:53,769][106225] Updated weights for policy 1, policy_version 775689 (0.0010) [2023-12-28 00:48:53,831][106225] Updated weights for policy 1, policy_version 775699 (0.0008) [2023-12-28 00:48:53,894][106225] Updated weights for policy 1, policy_version 775709 (0.0008) [2023-12-28 00:48:53,957][106225] Updated weights for policy 1, policy_version 775719 (0.0010) [2023-12-28 00:48:54,021][106226] Updated weights for policy 0, policy_version 773657 (0.0010) [2023-12-28 00:48:54,070][106226] Updated weights for policy 0, policy_version 773667 (0.0008) [2023-12-28 00:48:54,123][106226] Updated weights for policy 0, policy_version 773677 (0.0008) [2023-12-28 00:48:54,184][106226] Updated weights for policy 0, policy_version 773687 (0.0009) [2023-12-28 00:48:54,651][106225] Updated weights for policy 1, policy_version 775729 (0.0010) [2023-12-28 00:48:54,703][106225] Updated weights for policy 1, policy_version 775739 (0.0010) [2023-12-28 00:48:54,758][106225] Updated weights for policy 1, policy_version 775749 (0.0010) [2023-12-28 00:48:54,859][106226] Updated weights for policy 0, policy_version 773697 (0.0010) [2023-12-28 00:48:54,909][106226] Updated weights for policy 0, policy_version 773707 (0.0010) [2023-12-28 00:48:54,961][106226] Updated weights for policy 0, policy_version 773717 (0.0010) [2023-12-28 00:48:55,462][106225] Updated weights for policy 1, policy_version 775759 (0.0008) [2023-12-28 00:48:55,518][106225] Updated weights for policy 1, policy_version 775769 (0.0010) [2023-12-28 00:48:55,571][106225] Updated weights for policy 1, policy_version 775779 (0.0008) [2023-12-28 00:48:55,679][106226] Updated weights for policy 0, policy_version 773727 (0.0007) [2023-12-28 00:48:55,729][106226] Updated weights for policy 0, policy_version 773737 (0.0005) [2023-12-28 00:48:55,779][106226] Updated weights for policy 0, policy_version 773747 (0.0007) [2023-12-28 00:48:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 396771328. Throughput: 0: 9877.5, 1: 9917.3. Samples: 396741876. Policy #0 lag: (min: 26.0, avg: 46.5, max: 48.0) [2023-12-28 00:48:56,176][105115] Avg episode reward: [(0, '-4.576'), (1, '-5.104')] [2023-12-28 00:48:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000773752_198131712.pth... [2023-12-28 00:48:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000775784_198639616.pth... [2023-12-28 00:48:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000772600_197836800.pth [2023-12-28 00:48:56,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000774632_198344704.pth [2023-12-28 00:48:56,292][106225] Updated weights for policy 1, policy_version 775789 (0.0010) [2023-12-28 00:48:56,341][106225] Updated weights for policy 1, policy_version 775799 (0.0010) [2023-12-28 00:48:56,387][106225] Updated weights for policy 1, policy_version 775809 (0.0010) [2023-12-28 00:48:56,453][106226] Updated weights for policy 0, policy_version 773757 (0.0008) [2023-12-28 00:48:56,507][106226] Updated weights for policy 0, policy_version 773767 (0.0008) [2023-12-28 00:48:56,555][106226] Updated weights for policy 0, policy_version 773777 (0.0008) [2023-12-28 00:48:57,041][106225] Updated weights for policy 1, policy_version 775819 (0.0009) [2023-12-28 00:48:57,094][106225] Updated weights for policy 1, policy_version 775829 (0.0010) [2023-12-28 00:48:57,151][106225] Updated weights for policy 1, policy_version 775839 (0.0009) [2023-12-28 00:48:57,193][106226] Updated weights for policy 0, policy_version 773787 (0.0007) [2023-12-28 00:48:57,242][106226] Updated weights for policy 0, policy_version 773797 (0.0010) [2023-12-28 00:48:57,293][106226] Updated weights for policy 0, policy_version 773807 (0.0010) [2023-12-28 00:48:57,761][106225] Updated weights for policy 1, policy_version 775849 (0.0009) [2023-12-28 00:48:57,815][106225] Updated weights for policy 1, policy_version 775859 (0.0006) [2023-12-28 00:48:57,870][106225] Updated weights for policy 1, policy_version 775869 (0.0006) [2023-12-28 00:48:57,891][106226] Updated weights for policy 0, policy_version 773817 (0.0011) [2023-12-28 00:48:57,918][106225] Updated weights for policy 1, policy_version 775879 (0.0005) [2023-12-28 00:48:57,960][106226] Updated weights for policy 0, policy_version 773827 (0.0009) [2023-12-28 00:48:58,020][106226] Updated weights for policy 0, policy_version 773837 (0.0010) [2023-12-28 00:48:58,073][106226] Updated weights for policy 0, policy_version 773847 (0.0009) [2023-12-28 00:48:58,540][106225] Updated weights for policy 1, policy_version 775889 (0.0008) [2023-12-28 00:48:58,602][106225] Updated weights for policy 1, policy_version 775899 (0.0008) [2023-12-28 00:48:58,659][106225] Updated weights for policy 1, policy_version 775909 (0.0008) [2023-12-28 00:48:58,855][106226] Updated weights for policy 0, policy_version 773857 (0.0007) [2023-12-28 00:48:58,939][106226] Updated weights for policy 0, policy_version 773867 (0.0008) [2023-12-28 00:48:59,001][106226] Updated weights for policy 0, policy_version 773877 (0.0008) [2023-12-28 00:48:59,572][106225] Updated weights for policy 1, policy_version 775919 (0.0009) [2023-12-28 00:48:59,631][106225] Updated weights for policy 1, policy_version 775929 (0.0009) [2023-12-28 00:48:59,692][106225] Updated weights for policy 1, policy_version 775939 (0.0007) [2023-12-28 00:48:59,708][106226] Updated weights for policy 0, policy_version 773887 (0.0007) [2023-12-28 00:48:59,759][106226] Updated weights for policy 0, policy_version 773897 (0.0008) [2023-12-28 00:48:59,814][106226] Updated weights for policy 0, policy_version 773907 (0.0008) [2023-12-28 00:49:00,401][106225] Updated weights for policy 1, policy_version 775949 (0.0006) [2023-12-28 00:49:00,464][106225] Updated weights for policy 1, policy_version 775959 (0.0006) [2023-12-28 00:49:00,506][106226] Updated weights for policy 0, policy_version 773917 (0.0008) [2023-12-28 00:49:00,525][106225] Updated weights for policy 1, policy_version 775969 (0.0005) [2023-12-28 00:49:00,560][106226] Updated weights for policy 0, policy_version 773927 (0.0007) [2023-12-28 00:49:00,625][106226] Updated weights for policy 0, policy_version 773937 (0.0008) [2023-12-28 00:49:01,071][106225] Updated weights for policy 1, policy_version 775979 (0.0006) [2023-12-28 00:49:01,133][106225] Updated weights for policy 1, policy_version 775989 (0.0008) [2023-12-28 00:49:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 396869632. Throughput: 0: 9966.2, 1: 9902.4. Samples: 396862028. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:01,175][105115] Avg episode reward: [(0, '-4.206'), (1, '-5.197')] [2023-12-28 00:49:01,195][106225] Updated weights for policy 1, policy_version 775999 (0.0008) [2023-12-28 00:49:01,341][106226] Updated weights for policy 0, policy_version 773947 (0.0008) [2023-12-28 00:49:01,414][106226] Updated weights for policy 0, policy_version 773957 (0.0008) [2023-12-28 00:49:01,472][106226] Updated weights for policy 0, policy_version 773967 (0.0008) [2023-12-28 00:49:01,896][106225] Updated weights for policy 1, policy_version 776009 (0.0006) [2023-12-28 00:49:01,959][106225] Updated weights for policy 1, policy_version 776019 (0.0007) [2023-12-28 00:49:02,022][106225] Updated weights for policy 1, policy_version 776029 (0.0006) [2023-12-28 00:49:02,086][106225] Updated weights for policy 1, policy_version 776039 (0.0008) [2023-12-28 00:49:02,170][106226] Updated weights for policy 0, policy_version 773977 (0.0007) [2023-12-28 00:49:02,228][106226] Updated weights for policy 0, policy_version 773987 (0.0008) [2023-12-28 00:49:02,293][106226] Updated weights for policy 0, policy_version 773997 (0.0008) [2023-12-28 00:49:02,359][106226] Updated weights for policy 0, policy_version 774007 (0.0008) [2023-12-28 00:49:02,762][106225] Updated weights for policy 1, policy_version 776049 (0.0006) [2023-12-28 00:49:02,827][106225] Updated weights for policy 1, policy_version 776059 (0.0008) [2023-12-28 00:49:02,877][106225] Updated weights for policy 1, policy_version 776069 (0.0010) [2023-12-28 00:49:03,043][106226] Updated weights for policy 0, policy_version 774017 (0.0008) [2023-12-28 00:49:03,111][106226] Updated weights for policy 0, policy_version 774027 (0.0005) [2023-12-28 00:49:03,157][106226] Updated weights for policy 0, policy_version 774037 (0.0005) [2023-12-28 00:49:03,493][106225] Updated weights for policy 1, policy_version 776079 (0.0010) [2023-12-28 00:49:03,536][106225] Updated weights for policy 1, policy_version 776089 (0.0010) [2023-12-28 00:49:03,582][106225] Updated weights for policy 1, policy_version 776099 (0.0010) [2023-12-28 00:49:03,672][106226] Updated weights for policy 0, policy_version 774047 (0.0005) [2023-12-28 00:49:03,720][106226] Updated weights for policy 0, policy_version 774057 (0.0005) [2023-12-28 00:49:03,787][106226] Updated weights for policy 0, policy_version 774067 (0.0008) [2023-12-28 00:49:04,365][106225] Updated weights for policy 1, policy_version 776109 (0.0009) [2023-12-28 00:49:04,423][106225] Updated weights for policy 1, policy_version 776119 (0.0007) [2023-12-28 00:49:04,483][106225] Updated weights for policy 1, policy_version 776129 (0.0005) [2023-12-28 00:49:04,497][106226] Updated weights for policy 0, policy_version 774077 (0.0008) [2023-12-28 00:49:04,557][106226] Updated weights for policy 0, policy_version 774087 (0.0009) [2023-12-28 00:49:04,608][106226] Updated weights for policy 0, policy_version 774097 (0.0009) [2023-12-28 00:49:05,021][106225] Updated weights for policy 1, policy_version 776139 (0.0005) [2023-12-28 00:49:05,077][106225] Updated weights for policy 1, policy_version 776149 (0.0010) [2023-12-28 00:49:05,129][106225] Updated weights for policy 1, policy_version 776159 (0.0010) [2023-12-28 00:49:05,365][106226] Updated weights for policy 0, policy_version 774107 (0.0010) [2023-12-28 00:49:05,433][106226] Updated weights for policy 0, policy_version 774117 (0.0009) [2023-12-28 00:49:05,496][106226] Updated weights for policy 0, policy_version 774127 (0.0011) [2023-12-28 00:49:05,731][106225] Updated weights for policy 1, policy_version 776169 (0.0006) [2023-12-28 00:49:05,796][106225] Updated weights for policy 1, policy_version 776179 (0.0010) [2023-12-28 00:49:05,848][106225] Updated weights for policy 1, policy_version 776189 (0.0010) [2023-12-28 00:49:05,894][106225] Updated weights for policy 1, policy_version 776199 (0.0010) [2023-12-28 00:49:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 396976128. Throughput: 0: 9997.1, 1: 9998.1. Samples: 396986280. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:06,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-4.975')] [2023-12-28 00:49:06,208][106226] Updated weights for policy 0, policy_version 774137 (0.0010) [2023-12-28 00:49:06,276][106226] Updated weights for policy 0, policy_version 774147 (0.0007) [2023-12-28 00:49:06,339][106226] Updated weights for policy 0, policy_version 774157 (0.0006) [2023-12-28 00:49:06,400][106226] Updated weights for policy 0, policy_version 774167 (0.0006) [2023-12-28 00:49:06,599][106225] Updated weights for policy 1, policy_version 776209 (0.0008) [2023-12-28 00:49:06,657][106225] Updated weights for policy 1, policy_version 776219 (0.0009) [2023-12-28 00:49:06,718][106225] Updated weights for policy 1, policy_version 776229 (0.0010) [2023-12-28 00:49:06,963][106226] Updated weights for policy 0, policy_version 774177 (0.0006) [2023-12-28 00:49:07,024][106226] Updated weights for policy 0, policy_version 774187 (0.0008) [2023-12-28 00:49:07,089][106226] Updated weights for policy 0, policy_version 774197 (0.0011) [2023-12-28 00:49:07,442][106225] Updated weights for policy 1, policy_version 776239 (0.0010) [2023-12-28 00:49:07,504][106225] Updated weights for policy 1, policy_version 776249 (0.0010) [2023-12-28 00:49:07,570][106225] Updated weights for policy 1, policy_version 776259 (0.0010) [2023-12-28 00:49:07,774][106226] Updated weights for policy 0, policy_version 774207 (0.0007) [2023-12-28 00:49:07,831][106226] Updated weights for policy 0, policy_version 774217 (0.0005) [2023-12-28 00:49:07,886][106226] Updated weights for policy 0, policy_version 774227 (0.0005) [2023-12-28 00:49:08,271][106225] Updated weights for policy 1, policy_version 776269 (0.0010) [2023-12-28 00:49:08,328][106225] Updated weights for policy 1, policy_version 776279 (0.0010) [2023-12-28 00:49:08,396][106225] Updated weights for policy 1, policy_version 776289 (0.0008) [2023-12-28 00:49:08,441][106226] Updated weights for policy 0, policy_version 774237 (0.0006) [2023-12-28 00:49:08,510][106226] Updated weights for policy 0, policy_version 774247 (0.0008) [2023-12-28 00:49:08,590][106226] Updated weights for policy 0, policy_version 774257 (0.0009) [2023-12-28 00:49:09,134][106225] Updated weights for policy 1, policy_version 776299 (0.0011) [2023-12-28 00:49:09,200][106225] Updated weights for policy 1, policy_version 776309 (0.0010) [2023-12-28 00:49:09,238][106226] Updated weights for policy 0, policy_version 774267 (0.0009) [2023-12-28 00:49:09,266][106225] Updated weights for policy 1, policy_version 776319 (0.0010) [2023-12-28 00:49:09,301][106226] Updated weights for policy 0, policy_version 774277 (0.0008) [2023-12-28 00:49:09,372][106226] Updated weights for policy 0, policy_version 774287 (0.0010) [2023-12-28 00:49:10,065][106225] Updated weights for policy 1, policy_version 776329 (0.0010) [2023-12-28 00:49:10,124][106225] Updated weights for policy 1, policy_version 776339 (0.0009) [2023-12-28 00:49:10,129][106226] Updated weights for policy 0, policy_version 774297 (0.0010) [2023-12-28 00:49:10,184][106225] Updated weights for policy 1, policy_version 776349 (0.0007) [2023-12-28 00:49:10,194][106226] Updated weights for policy 0, policy_version 774307 (0.0009) [2023-12-28 00:49:10,249][106225] Updated weights for policy 1, policy_version 776359 (0.0007) [2023-12-28 00:49:10,256][106226] Updated weights for policy 0, policy_version 774317 (0.0011) [2023-12-28 00:49:10,321][106226] Updated weights for policy 0, policy_version 774327 (0.0011) [2023-12-28 00:49:10,977][106225] Updated weights for policy 1, policy_version 776369 (0.0009) [2023-12-28 00:49:10,990][106226] Updated weights for policy 0, policy_version 774337 (0.0010) [2023-12-28 00:49:11,049][106225] Updated weights for policy 1, policy_version 776380 (0.0008) [2023-12-28 00:49:11,059][106226] Updated weights for policy 0, policy_version 774347 (0.0008) [2023-12-28 00:49:11,116][106225] Updated weights for policy 1, policy_version 776390 (0.0008) [2023-12-28 00:49:11,124][106226] Updated weights for policy 0, policy_version 774357 (0.0008) [2023-12-28 00:49:11,175][105115] Fps is (10 sec: 21298.8, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 397082624. Throughput: 0: 10094.9, 1: 10011.6. Samples: 397047848. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:11,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-5.266')] [2023-12-28 00:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000776392_198795264.pth... [2023-12-28 00:49:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000774360_198287360.pth... [2023-12-28 00:49:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000773176_197984256.pth [2023-12-28 00:49:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000775208_198492160.pth [2023-12-28 00:49:11,911][106226] Updated weights for policy 0, policy_version 774367 (0.0009) [2023-12-28 00:49:11,966][106225] Updated weights for policy 1, policy_version 776400 (0.0008) [2023-12-28 00:49:11,978][106226] Updated weights for policy 0, policy_version 774377 (0.0011) [2023-12-28 00:49:12,020][106225] Updated weights for policy 1, policy_version 776410 (0.0010) [2023-12-28 00:49:12,039][106226] Updated weights for policy 0, policy_version 774387 (0.0011) [2023-12-28 00:49:12,079][106225] Updated weights for policy 1, policy_version 776420 (0.0010) [2023-12-28 00:49:12,717][106226] Updated weights for policy 0, policy_version 774397 (0.0008) [2023-12-28 00:49:12,778][106226] Updated weights for policy 0, policy_version 774407 (0.0011) [2023-12-28 00:49:12,832][106225] Updated weights for policy 1, policy_version 776430 (0.0011) [2023-12-28 00:49:12,843][106226] Updated weights for policy 0, policy_version 774417 (0.0010) [2023-12-28 00:49:12,894][106225] Updated weights for policy 1, policy_version 776440 (0.0011) [2023-12-28 00:49:12,951][106225] Updated weights for policy 1, policy_version 776450 (0.0010) [2023-12-28 00:49:13,493][106226] Updated weights for policy 0, policy_version 774427 (0.0008) [2023-12-28 00:49:13,557][106226] Updated weights for policy 0, policy_version 774437 (0.0011) [2023-12-28 00:49:13,611][106226] Updated weights for policy 0, policy_version 774447 (0.0010) [2023-12-28 00:49:13,681][106225] Updated weights for policy 1, policy_version 776460 (0.0009) [2023-12-28 00:49:13,739][106225] Updated weights for policy 1, policy_version 776470 (0.0008) [2023-12-28 00:49:13,790][106225] Updated weights for policy 1, policy_version 776480 (0.0008) [2023-12-28 00:49:14,286][106226] Updated weights for policy 0, policy_version 774457 (0.0010) [2023-12-28 00:49:14,346][106226] Updated weights for policy 0, policy_version 774467 (0.0008) [2023-12-28 00:49:14,412][106226] Updated weights for policy 0, policy_version 774477 (0.0011) [2023-12-28 00:49:14,470][106226] Updated weights for policy 0, policy_version 774487 (0.0008) [2023-12-28 00:49:14,562][106225] Updated weights for policy 1, policy_version 776490 (0.0007) [2023-12-28 00:49:14,615][106225] Updated weights for policy 1, policy_version 776500 (0.0006) [2023-12-28 00:49:14,662][106225] Updated weights for policy 1, policy_version 776510 (0.0005) [2023-12-28 00:49:14,713][106225] Updated weights for policy 1, policy_version 776520 (0.0005) [2023-12-28 00:49:15,157][106226] Updated weights for policy 0, policy_version 774497 (0.0008) [2023-12-28 00:49:15,217][106226] Updated weights for policy 0, policy_version 774507 (0.0009) [2023-12-28 00:49:15,274][106226] Updated weights for policy 0, policy_version 774517 (0.0009) [2023-12-28 00:49:15,413][106225] Updated weights for policy 1, policy_version 776530 (0.0008) [2023-12-28 00:49:15,467][106225] Updated weights for policy 1, policy_version 776540 (0.0008) [2023-12-28 00:49:15,525][106225] Updated weights for policy 1, policy_version 776550 (0.0009) [2023-12-28 00:49:15,974][106226] Updated weights for policy 0, policy_version 774527 (0.0009) [2023-12-28 00:49:16,031][106226] Updated weights for policy 0, policy_version 774537 (0.0007) [2023-12-28 00:49:16,097][106226] Updated weights for policy 0, policy_version 774547 (0.0007) [2023-12-28 00:49:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 397172736. Throughput: 0: 10014.0, 1: 9931.8. Samples: 397161508. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:16,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.311')] [2023-12-28 00:49:16,289][106225] Updated weights for policy 1, policy_version 776560 (0.0009) [2023-12-28 00:49:16,343][106225] Updated weights for policy 1, policy_version 776570 (0.0008) [2023-12-28 00:49:16,397][106225] Updated weights for policy 1, policy_version 776580 (0.0008) [2023-12-28 00:49:16,750][106226] Updated weights for policy 0, policy_version 774557 (0.0009) [2023-12-28 00:49:16,811][106226] Updated weights for policy 0, policy_version 774567 (0.0009) [2023-12-28 00:49:16,873][106226] Updated weights for policy 0, policy_version 774577 (0.0009) [2023-12-28 00:49:17,147][106225] Updated weights for policy 1, policy_version 776590 (0.0006) [2023-12-28 00:49:17,195][106225] Updated weights for policy 1, policy_version 776600 (0.0005) [2023-12-28 00:49:17,255][106225] Updated weights for policy 1, policy_version 776610 (0.0005) [2023-12-28 00:49:17,550][106226] Updated weights for policy 0, policy_version 774587 (0.0009) [2023-12-28 00:49:17,613][106226] Updated weights for policy 0, policy_version 774597 (0.0007) [2023-12-28 00:49:17,675][106226] Updated weights for policy 0, policy_version 774607 (0.0008) [2023-12-28 00:49:17,842][106225] Updated weights for policy 1, policy_version 776620 (0.0006) [2023-12-28 00:49:17,896][106225] Updated weights for policy 1, policy_version 776630 (0.0008) [2023-12-28 00:49:17,953][106225] Updated weights for policy 1, policy_version 776640 (0.0008) [2023-12-28 00:49:18,409][106226] Updated weights for policy 0, policy_version 774617 (0.0008) [2023-12-28 00:49:18,466][106226] Updated weights for policy 0, policy_version 774627 (0.0010) [2023-12-28 00:49:18,533][106226] Updated weights for policy 0, policy_version 774637 (0.0010) [2023-12-28 00:49:18,597][106226] Updated weights for policy 0, policy_version 774647 (0.0011) [2023-12-28 00:49:18,630][106225] Updated weights for policy 1, policy_version 776650 (0.0007) [2023-12-28 00:49:18,694][106225] Updated weights for policy 1, policy_version 776660 (0.0005) [2023-12-28 00:49:18,754][106225] Updated weights for policy 1, policy_version 776670 (0.0005) [2023-12-28 00:49:18,821][106225] Updated weights for policy 1, policy_version 776680 (0.0007) [2023-12-28 00:49:19,346][106226] Updated weights for policy 0, policy_version 774657 (0.0011) [2023-12-28 00:49:19,393][106225] Updated weights for policy 1, policy_version 776690 (0.0011) [2023-12-28 00:49:19,408][106226] Updated weights for policy 0, policy_version 774667 (0.0011) [2023-12-28 00:49:19,444][106225] Updated weights for policy 1, policy_version 776700 (0.0010) [2023-12-28 00:49:19,475][106226] Updated weights for policy 0, policy_version 774677 (0.0011) [2023-12-28 00:49:19,509][106225] Updated weights for policy 1, policy_version 776710 (0.0009) [2023-12-28 00:49:20,229][106225] Updated weights for policy 1, policy_version 776720 (0.0007) [2023-12-28 00:49:20,230][106226] Updated weights for policy 0, policy_version 774687 (0.0008) [2023-12-28 00:49:20,292][106226] Updated weights for policy 0, policy_version 774697 (0.0008) [2023-12-28 00:49:20,293][106225] Updated weights for policy 1, policy_version 776730 (0.0006) [2023-12-28 00:49:20,355][106226] Updated weights for policy 0, policy_version 774707 (0.0007) [2023-12-28 00:49:20,360][106225] Updated weights for policy 1, policy_version 776740 (0.0006) [2023-12-28 00:49:20,980][106226] Updated weights for policy 0, policy_version 774717 (0.0008) [2023-12-28 00:49:21,041][106225] Updated weights for policy 1, policy_version 776750 (0.0007) [2023-12-28 00:49:21,047][106226] Updated weights for policy 0, policy_version 774727 (0.0007) [2023-12-28 00:49:21,111][106225] Updated weights for policy 1, policy_version 776760 (0.0008) [2023-12-28 00:49:21,120][106226] Updated weights for policy 0, policy_version 774737 (0.0007) [2023-12-28 00:49:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 397271040. Throughput: 0: 10025.4, 1: 9950.8. Samples: 397281188. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:21,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-5.323')] [2023-12-28 00:49:21,184][106225] Updated weights for policy 1, policy_version 776770 (0.0009) [2023-12-28 00:49:21,863][106225] Updated weights for policy 1, policy_version 776780 (0.0006) [2023-12-28 00:49:21,925][106225] Updated weights for policy 1, policy_version 776790 (0.0009) [2023-12-28 00:49:21,957][106226] Updated weights for policy 0, policy_version 774747 (0.0008) [2023-12-28 00:49:21,979][106225] Updated weights for policy 1, policy_version 776800 (0.0008) [2023-12-28 00:49:22,019][106226] Updated weights for policy 0, policy_version 774757 (0.0009) [2023-12-28 00:49:22,079][106226] Updated weights for policy 0, policy_version 774767 (0.0009) [2023-12-28 00:49:22,723][106225] Updated weights for policy 1, policy_version 776810 (0.0007) [2023-12-28 00:49:22,785][106225] Updated weights for policy 1, policy_version 776820 (0.0008) [2023-12-28 00:49:22,836][106226] Updated weights for policy 0, policy_version 774777 (0.0010) [2023-12-28 00:49:22,844][106225] Updated weights for policy 1, policy_version 776830 (0.0009) [2023-12-28 00:49:22,899][106226] Updated weights for policy 0, policy_version 774787 (0.0011) [2023-12-28 00:49:22,909][106225] Updated weights for policy 1, policy_version 776840 (0.0006) [2023-12-28 00:49:22,958][106226] Updated weights for policy 0, policy_version 774797 (0.0011) [2023-12-28 00:49:23,016][106226] Updated weights for policy 0, policy_version 774807 (0.0011) [2023-12-28 00:49:23,649][106225] Updated weights for policy 1, policy_version 776850 (0.0008) [2023-12-28 00:49:23,705][106225] Updated weights for policy 1, policy_version 776860 (0.0007) [2023-12-28 00:49:23,708][106226] Updated weights for policy 0, policy_version 774817 (0.0008) [2023-12-28 00:49:23,756][106225] Updated weights for policy 1, policy_version 776870 (0.0005) [2023-12-28 00:49:23,762][106226] Updated weights for policy 0, policy_version 774827 (0.0010) [2023-12-28 00:49:23,821][106226] Updated weights for policy 0, policy_version 774837 (0.0010) [2023-12-28 00:49:24,411][106226] Updated weights for policy 0, policy_version 774847 (0.0006) [2023-12-28 00:49:24,481][106226] Updated weights for policy 0, policy_version 774857 (0.0006) [2023-12-28 00:49:24,505][106225] Updated weights for policy 1, policy_version 776880 (0.0005) [2023-12-28 00:49:24,532][106226] Updated weights for policy 0, policy_version 774867 (0.0005) [2023-12-28 00:49:24,557][106225] Updated weights for policy 1, policy_version 776890 (0.0005) [2023-12-28 00:49:24,611][106225] Updated weights for policy 1, policy_version 776900 (0.0005) [2023-12-28 00:49:25,155][106225] Updated weights for policy 1, policy_version 776910 (0.0006) [2023-12-28 00:49:25,211][106225] Updated weights for policy 1, policy_version 776920 (0.0007) [2023-12-28 00:49:25,213][106226] Updated weights for policy 0, policy_version 774877 (0.0006) [2023-12-28 00:49:25,261][106226] Updated weights for policy 0, policy_version 774887 (0.0006) [2023-12-28 00:49:25,262][106225] Updated weights for policy 1, policy_version 776930 (0.0007) [2023-12-28 00:49:25,310][106226] Updated weights for policy 0, policy_version 774897 (0.0007) [2023-12-28 00:49:25,845][106225] Updated weights for policy 1, policy_version 776940 (0.0007) [2023-12-28 00:49:25,895][106225] Updated weights for policy 1, policy_version 776950 (0.0005) [2023-12-28 00:49:25,954][106225] Updated weights for policy 1, policy_version 776960 (0.0006) [2023-12-28 00:49:26,157][106226] Updated weights for policy 0, policy_version 774907 (0.0009) [2023-12-28 00:49:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 397369344. Throughput: 0: 9931.3, 1: 9930.4. Samples: 397337228. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:26,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.271')] [2023-12-28 00:49:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000776968_198942720.pth... [2023-12-28 00:49:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000775784_198639616.pth [2023-12-28 00:49:26,211][106226] Updated weights for policy 0, policy_version 774917 (0.0008) [2023-12-28 00:49:26,272][106226] Updated weights for policy 0, policy_version 774927 (0.0008) [2023-12-28 00:49:26,321][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000774936_198434816.pth... [2023-12-28 00:49:26,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000773752_198131712.pth [2023-12-28 00:49:26,485][106225] Updated weights for policy 1, policy_version 776970 (0.0006) [2023-12-28 00:49:26,529][106225] Updated weights for policy 1, policy_version 776980 (0.0008) [2023-12-28 00:49:26,581][106225] Updated weights for policy 1, policy_version 776990 (0.0008) [2023-12-28 00:49:26,628][106225] Updated weights for policy 1, policy_version 777000 (0.0006) [2023-12-28 00:49:27,079][106226] Updated weights for policy 0, policy_version 774937 (0.0009) [2023-12-28 00:49:27,131][106226] Updated weights for policy 0, policy_version 774948 (0.0009) [2023-12-28 00:49:27,181][106226] Updated weights for policy 0, policy_version 774958 (0.0005) [2023-12-28 00:49:27,215][106225] Updated weights for policy 1, policy_version 777010 (0.0005) [2023-12-28 00:49:27,229][106226] Updated weights for policy 0, policy_version 774968 (0.0008) [2023-12-28 00:49:27,259][106225] Updated weights for policy 1, policy_version 777020 (0.0005) [2023-12-28 00:49:27,307][106225] Updated weights for policy 1, policy_version 777030 (0.0007) [2023-12-28 00:49:27,802][106226] Updated weights for policy 0, policy_version 774978 (0.0006) [2023-12-28 00:49:27,859][106226] Updated weights for policy 0, policy_version 774988 (0.0006) [2023-12-28 00:49:27,905][106226] Updated weights for policy 0, policy_version 774998 (0.0005) [2023-12-28 00:49:28,048][106225] Updated weights for policy 1, policy_version 777040 (0.0008) [2023-12-28 00:49:28,111][106225] Updated weights for policy 1, policy_version 777050 (0.0010) [2023-12-28 00:49:28,174][106225] Updated weights for policy 1, policy_version 777060 (0.0008) [2023-12-28 00:49:28,445][106226] Updated weights for policy 0, policy_version 775008 (0.0008) [2023-12-28 00:49:28,492][106226] Updated weights for policy 0, policy_version 775018 (0.0010) [2023-12-28 00:49:28,536][106226] Updated weights for policy 0, policy_version 775028 (0.0010) [2023-12-28 00:49:28,954][106225] Updated weights for policy 1, policy_version 777070 (0.0009) [2023-12-28 00:49:29,003][106225] Updated weights for policy 1, policy_version 777081 (0.0010) [2023-12-28 00:49:29,053][106225] Updated weights for policy 1, policy_version 777092 (0.0009) [2023-12-28 00:49:29,167][106226] Updated weights for policy 0, policy_version 775038 (0.0007) [2023-12-28 00:49:29,212][106226] Updated weights for policy 0, policy_version 775048 (0.0006) [2023-12-28 00:49:29,278][106226] Updated weights for policy 0, policy_version 775058 (0.0009) [2023-12-28 00:49:29,734][106225] Updated weights for policy 1, policy_version 777103 (0.0006) [2023-12-28 00:49:29,795][106225] Updated weights for policy 1, policy_version 777113 (0.0005) [2023-12-28 00:49:29,856][106225] Updated weights for policy 1, policy_version 777123 (0.0007) [2023-12-28 00:49:30,030][106226] Updated weights for policy 0, policy_version 775068 (0.0010) [2023-12-28 00:49:30,089][106226] Updated weights for policy 0, policy_version 775078 (0.0008) [2023-12-28 00:49:30,143][106226] Updated weights for policy 0, policy_version 775088 (0.0008) [2023-12-28 00:49:30,560][106225] Updated weights for policy 1, policy_version 777133 (0.0007) [2023-12-28 00:49:30,618][106225] Updated weights for policy 1, policy_version 777143 (0.0009) [2023-12-28 00:49:30,679][106225] Updated weights for policy 1, policy_version 777153 (0.0008) [2023-12-28 00:49:30,803][106226] Updated weights for policy 0, policy_version 775098 (0.0009) [2023-12-28 00:49:30,860][106226] Updated weights for policy 0, policy_version 775108 (0.0008) [2023-12-28 00:49:30,921][106226] Updated weights for policy 0, policy_version 775118 (0.0009) [2023-12-28 00:49:30,978][106226] Updated weights for policy 0, policy_version 775128 (0.0009) [2023-12-28 00:49:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 397475840. Throughput: 0: 9986.8, 1: 10046.2. Samples: 397463664. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:31,175][105115] Avg episode reward: [(0, '-4.037'), (1, '-4.928')] [2023-12-28 00:49:31,342][106225] Updated weights for policy 1, policy_version 777163 (0.0008) [2023-12-28 00:49:31,409][106225] Updated weights for policy 1, policy_version 777173 (0.0008) [2023-12-28 00:49:31,457][106225] Updated weights for policy 1, policy_version 777183 (0.0008) [2023-12-28 00:49:31,751][106226] Updated weights for policy 0, policy_version 775138 (0.0008) [2023-12-28 00:49:31,808][106226] Updated weights for policy 0, policy_version 775148 (0.0008) [2023-12-28 00:49:31,865][106226] Updated weights for policy 0, policy_version 775158 (0.0007) [2023-12-28 00:49:32,162][106225] Updated weights for policy 1, policy_version 777193 (0.0008) [2023-12-28 00:49:32,223][106225] Updated weights for policy 1, policy_version 777203 (0.0007) [2023-12-28 00:49:32,280][106225] Updated weights for policy 1, policy_version 777213 (0.0010) [2023-12-28 00:49:32,337][106225] Updated weights for policy 1, policy_version 777223 (0.0010) [2023-12-28 00:49:32,640][106226] Updated weights for policy 0, policy_version 775168 (0.0009) [2023-12-28 00:49:32,694][106226] Updated weights for policy 0, policy_version 775178 (0.0010) [2023-12-28 00:49:32,743][106226] Updated weights for policy 0, policy_version 775188 (0.0008) [2023-12-28 00:49:32,927][106225] Updated weights for policy 1, policy_version 777233 (0.0009) [2023-12-28 00:49:32,996][106225] Updated weights for policy 1, policy_version 777243 (0.0005) [2023-12-28 00:49:33,053][106225] Updated weights for policy 1, policy_version 777253 (0.0006) [2023-12-28 00:49:33,520][106226] Updated weights for policy 0, policy_version 775198 (0.0008) [2023-12-28 00:49:33,550][106225] Updated weights for policy 1, policy_version 777263 (0.0008) [2023-12-28 00:49:33,572][106226] Updated weights for policy 0, policy_version 775208 (0.0007) [2023-12-28 00:49:33,601][106225] Updated weights for policy 1, policy_version 777273 (0.0008) [2023-12-28 00:49:33,622][106226] Updated weights for policy 0, policy_version 775218 (0.0006) [2023-12-28 00:49:33,653][106225] Updated weights for policy 1, policy_version 777283 (0.0007) [2023-12-28 00:49:34,283][106225] Updated weights for policy 1, policy_version 777293 (0.0009) [2023-12-28 00:49:34,286][106226] Updated weights for policy 0, policy_version 775228 (0.0008) [2023-12-28 00:49:34,334][106226] Updated weights for policy 0, policy_version 775238 (0.0008) [2023-12-28 00:49:34,340][106225] Updated weights for policy 1, policy_version 777303 (0.0008) [2023-12-28 00:49:34,389][106226] Updated weights for policy 0, policy_version 775248 (0.0008) [2023-12-28 00:49:34,396][106225] Updated weights for policy 1, policy_version 777313 (0.0008) [2023-12-28 00:49:35,076][106226] Updated weights for policy 0, policy_version 775258 (0.0008) [2023-12-28 00:49:35,114][106225] Updated weights for policy 1, policy_version 777323 (0.0007) [2023-12-28 00:49:35,125][106226] Updated weights for policy 0, policy_version 775268 (0.0007) [2023-12-28 00:49:35,166][106225] Updated weights for policy 1, policy_version 777333 (0.0008) [2023-12-28 00:49:35,173][106226] Updated weights for policy 0, policy_version 775278 (0.0006) [2023-12-28 00:49:35,229][106225] Updated weights for policy 1, policy_version 777343 (0.0008) [2023-12-28 00:49:35,233][106226] Updated weights for policy 0, policy_version 775288 (0.0005) [2023-12-28 00:49:35,920][106225] Updated weights for policy 1, policy_version 777353 (0.0008) [2023-12-28 00:49:35,934][106226] Updated weights for policy 0, policy_version 775298 (0.0010) [2023-12-28 00:49:35,971][106225] Updated weights for policy 1, policy_version 777363 (0.0005) [2023-12-28 00:49:35,984][106226] Updated weights for policy 0, policy_version 775308 (0.0010) [2023-12-28 00:49:36,021][106225] Updated weights for policy 1, policy_version 777373 (0.0005) [2023-12-28 00:49:36,030][106226] Updated weights for policy 0, policy_version 775318 (0.0010) [2023-12-28 00:49:36,073][106225] Updated weights for policy 1, policy_version 777383 (0.0007) [2023-12-28 00:49:36,175][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 397582336. Throughput: 0: 9974.7, 1: 10133.3. Samples: 397585640. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:36,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.977')] [2023-12-28 00:49:36,712][106226] Updated weights for policy 0, policy_version 775328 (0.0009) [2023-12-28 00:49:36,772][106226] Updated weights for policy 0, policy_version 775338 (0.0009) [2023-12-28 00:49:36,837][106226] Updated weights for policy 0, policy_version 775348 (0.0005) [2023-12-28 00:49:36,840][106225] Updated weights for policy 1, policy_version 777393 (0.0008) [2023-12-28 00:49:36,892][106225] Updated weights for policy 1, policy_version 777403 (0.0009) [2023-12-28 00:49:36,942][106225] Updated weights for policy 1, policy_version 777413 (0.0007) [2023-12-28 00:49:37,522][106226] Updated weights for policy 0, policy_version 775358 (0.0007) [2023-12-28 00:49:37,579][106226] Updated weights for policy 0, policy_version 775368 (0.0009) [2023-12-28 00:49:37,639][106226] Updated weights for policy 0, policy_version 775378 (0.0008) [2023-12-28 00:49:37,698][106225] Updated weights for policy 1, policy_version 777423 (0.0009) [2023-12-28 00:49:37,758][106225] Updated weights for policy 1, policy_version 777433 (0.0008) [2023-12-28 00:49:37,819][106225] Updated weights for policy 1, policy_version 777443 (0.0008) [2023-12-28 00:49:38,394][106226] Updated weights for policy 0, policy_version 775388 (0.0008) [2023-12-28 00:49:38,461][106226] Updated weights for policy 0, policy_version 775398 (0.0009) [2023-12-28 00:49:38,517][106225] Updated weights for policy 1, policy_version 777453 (0.0009) [2023-12-28 00:49:38,524][106226] Updated weights for policy 0, policy_version 775408 (0.0009) [2023-12-28 00:49:38,573][106225] Updated weights for policy 1, policy_version 777463 (0.0008) [2023-12-28 00:49:38,634][106225] Updated weights for policy 1, policy_version 777473 (0.0009) [2023-12-28 00:49:39,231][106226] Updated weights for policy 0, policy_version 775418 (0.0007) [2023-12-28 00:49:39,297][106226] Updated weights for policy 0, policy_version 775428 (0.0008) [2023-12-28 00:49:39,367][106226] Updated weights for policy 0, policy_version 775438 (0.0009) [2023-12-28 00:49:39,379][106225] Updated weights for policy 1, policy_version 777483 (0.0008) [2023-12-28 00:49:39,436][106226] Updated weights for policy 0, policy_version 775448 (0.0009) [2023-12-28 00:49:39,447][106225] Updated weights for policy 1, policy_version 777493 (0.0008) [2023-12-28 00:49:39,501][106225] Updated weights for policy 1, policy_version 777503 (0.0005) [2023-12-28 00:49:40,210][106226] Updated weights for policy 0, policy_version 775458 (0.0008) [2023-12-28 00:49:40,217][106225] Updated weights for policy 1, policy_version 777513 (0.0007) [2023-12-28 00:49:40,271][106226] Updated weights for policy 0, policy_version 775468 (0.0007) [2023-12-28 00:49:40,277][106225] Updated weights for policy 1, policy_version 777523 (0.0006) [2023-12-28 00:49:40,327][106226] Updated weights for policy 0, policy_version 775478 (0.0007) [2023-12-28 00:49:40,333][106225] Updated weights for policy 1, policy_version 777533 (0.0006) [2023-12-28 00:49:40,392][106225] Updated weights for policy 1, policy_version 777543 (0.0006) [2023-12-28 00:49:40,990][106225] Updated weights for policy 1, policy_version 777553 (0.0010) [2023-12-28 00:49:41,073][106225] Updated weights for policy 1, policy_version 777563 (0.0010) [2023-12-28 00:49:41,142][106225] Updated weights for policy 1, policy_version 777573 (0.0010) [2023-12-28 00:49:41,149][106226] Updated weights for policy 0, policy_version 775488 (0.0009) [2023-12-28 00:49:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 397672448. Throughput: 0: 9965.5, 1: 10071.4. Samples: 397643536. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:41,176][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.338')] [2023-12-28 00:49:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000777576_199098368.pth... [2023-12-28 00:49:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000776392_198795264.pth [2023-12-28 00:49:41,211][106226] Updated weights for policy 0, policy_version 775498 (0.0008) [2023-12-28 00:49:41,265][106226] Updated weights for policy 0, policy_version 775508 (0.0008) [2023-12-28 00:49:41,283][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000775512_198582272.pth... [2023-12-28 00:49:41,286][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000774360_198287360.pth [2023-12-28 00:49:41,979][106225] Updated weights for policy 1, policy_version 777583 (0.0011) [2023-12-28 00:49:42,038][106226] Updated weights for policy 0, policy_version 775518 (0.0007) [2023-12-28 00:49:42,040][106225] Updated weights for policy 1, policy_version 777593 (0.0010) [2023-12-28 00:49:42,102][106225] Updated weights for policy 1, policy_version 777603 (0.0006) [2023-12-28 00:49:42,103][106226] Updated weights for policy 0, policy_version 775528 (0.0008) [2023-12-28 00:49:42,172][106226] Updated weights for policy 0, policy_version 775538 (0.0007) [2023-12-28 00:49:42,792][106225] Updated weights for policy 1, policy_version 777613 (0.0007) [2023-12-28 00:49:42,853][106225] Updated weights for policy 1, policy_version 777623 (0.0008) [2023-12-28 00:49:42,884][106226] Updated weights for policy 0, policy_version 775548 (0.0007) [2023-12-28 00:49:42,917][106225] Updated weights for policy 1, policy_version 777633 (0.0007) [2023-12-28 00:49:42,946][106226] Updated weights for policy 0, policy_version 775558 (0.0009) [2023-12-28 00:49:43,010][106226] Updated weights for policy 0, policy_version 775568 (0.0006) [2023-12-28 00:49:43,566][106226] Updated weights for policy 0, policy_version 775578 (0.0005) [2023-12-28 00:49:43,633][106226] Updated weights for policy 0, policy_version 775588 (0.0006) [2023-12-28 00:49:43,671][106225] Updated weights for policy 1, policy_version 777643 (0.0009) [2023-12-28 00:49:43,690][106226] Updated weights for policy 0, policy_version 775598 (0.0006) [2023-12-28 00:49:43,729][106225] Updated weights for policy 1, policy_version 777653 (0.0010) [2023-12-28 00:49:43,749][106226] Updated weights for policy 0, policy_version 775608 (0.0005) [2023-12-28 00:49:43,790][106225] Updated weights for policy 1, policy_version 777663 (0.0009) [2023-12-28 00:49:44,345][106226] Updated weights for policy 0, policy_version 775618 (0.0009) [2023-12-28 00:49:44,404][106226] Updated weights for policy 0, policy_version 775628 (0.0008) [2023-12-28 00:49:44,424][106225] Updated weights for policy 1, policy_version 777673 (0.0006) [2023-12-28 00:49:44,455][106226] Updated weights for policy 0, policy_version 775638 (0.0008) [2023-12-28 00:49:44,478][106225] Updated weights for policy 1, policy_version 777683 (0.0007) [2023-12-28 00:49:44,540][106225] Updated weights for policy 1, policy_version 777693 (0.0008) [2023-12-28 00:49:44,598][106225] Updated weights for policy 1, policy_version 777703 (0.0008) [2023-12-28 00:49:45,211][106226] Updated weights for policy 0, policy_version 775648 (0.0009) [2023-12-28 00:49:45,276][106226] Updated weights for policy 0, policy_version 775658 (0.0009) [2023-12-28 00:49:45,288][106225] Updated weights for policy 1, policy_version 777713 (0.0007) [2023-12-28 00:49:45,336][106226] Updated weights for policy 0, policy_version 775668 (0.0008) [2023-12-28 00:49:45,352][106225] Updated weights for policy 1, policy_version 777723 (0.0007) [2023-12-28 00:49:45,417][106225] Updated weights for policy 1, policy_version 777733 (0.0010) [2023-12-28 00:49:45,989][106225] Updated weights for policy 1, policy_version 777743 (0.0005) [2023-12-28 00:49:46,008][106226] Updated weights for policy 0, policy_version 775678 (0.0006) [2023-12-28 00:49:46,044][106225] Updated weights for policy 1, policy_version 777753 (0.0007) [2023-12-28 00:49:46,072][106226] Updated weights for policy 0, policy_version 775688 (0.0006) [2023-12-28 00:49:46,095][106225] Updated weights for policy 1, policy_version 777763 (0.0008) [2023-12-28 00:49:46,136][106226] Updated weights for policy 0, policy_version 775698 (0.0006) [2023-12-28 00:49:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 397778944. Throughput: 0: 9889.7, 1: 10042.0. Samples: 397758956. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:46,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.290')] [2023-12-28 00:49:46,723][106226] Updated weights for policy 0, policy_version 775708 (0.0008) [2023-12-28 00:49:46,783][106226] Updated weights for policy 0, policy_version 775718 (0.0008) [2023-12-28 00:49:46,840][106226] Updated weights for policy 0, policy_version 775728 (0.0008) [2023-12-28 00:49:46,844][106225] Updated weights for policy 1, policy_version 777773 (0.0009) [2023-12-28 00:49:46,897][106225] Updated weights for policy 1, policy_version 777783 (0.0009) [2023-12-28 00:49:46,961][106225] Updated weights for policy 1, policy_version 777793 (0.0005) [2023-12-28 00:49:47,545][106225] Updated weights for policy 1, policy_version 777803 (0.0007) [2023-12-28 00:49:47,603][106225] Updated weights for policy 1, policy_version 777813 (0.0008) [2023-12-28 00:49:47,626][106226] Updated weights for policy 0, policy_version 775738 (0.0008) [2023-12-28 00:49:47,664][106225] Updated weights for policy 1, policy_version 777823 (0.0006) [2023-12-28 00:49:47,680][106226] Updated weights for policy 0, policy_version 775748 (0.0008) [2023-12-28 00:49:47,733][106226] Updated weights for policy 0, policy_version 775758 (0.0009) [2023-12-28 00:49:47,781][106226] Updated weights for policy 0, policy_version 775768 (0.0007) [2023-12-28 00:49:48,229][106225] Updated weights for policy 1, policy_version 777833 (0.0006) [2023-12-28 00:49:48,283][106225] Updated weights for policy 1, policy_version 777843 (0.0010) [2023-12-28 00:49:48,350][106225] Updated weights for policy 1, policy_version 777853 (0.0010) [2023-12-28 00:49:48,418][106225] Updated weights for policy 1, policy_version 777863 (0.0009) [2023-12-28 00:49:48,592][106226] Updated weights for policy 0, policy_version 775778 (0.0010) [2023-12-28 00:49:48,653][106226] Updated weights for policy 0, policy_version 775788 (0.0010) [2023-12-28 00:49:48,708][106226] Updated weights for policy 0, policy_version 775798 (0.0010) [2023-12-28 00:49:49,170][106225] Updated weights for policy 1, policy_version 777873 (0.0010) [2023-12-28 00:49:49,232][106225] Updated weights for policy 1, policy_version 777883 (0.0008) [2023-12-28 00:49:49,306][106225] Updated weights for policy 1, policy_version 777893 (0.0011) [2023-12-28 00:49:49,474][106226] Updated weights for policy 0, policy_version 775808 (0.0011) [2023-12-28 00:49:49,540][106226] Updated weights for policy 0, policy_version 775818 (0.0007) [2023-12-28 00:49:49,607][106226] Updated weights for policy 0, policy_version 775828 (0.0008) [2023-12-28 00:49:49,967][106225] Updated weights for policy 1, policy_version 777903 (0.0007) [2023-12-28 00:49:50,030][106225] Updated weights for policy 1, policy_version 777913 (0.0006) [2023-12-28 00:49:50,092][106225] Updated weights for policy 1, policy_version 777923 (0.0006) [2023-12-28 00:49:50,364][106226] Updated weights for policy 0, policy_version 775838 (0.0009) [2023-12-28 00:49:50,434][106226] Updated weights for policy 0, policy_version 775848 (0.0010) [2023-12-28 00:49:50,500][106226] Updated weights for policy 0, policy_version 775858 (0.0010) [2023-12-28 00:49:50,679][106225] Updated weights for policy 1, policy_version 777933 (0.0007) [2023-12-28 00:49:50,734][106225] Updated weights for policy 1, policy_version 777943 (0.0008) [2023-12-28 00:49:50,789][106225] Updated weights for policy 1, policy_version 777953 (0.0007) [2023-12-28 00:49:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 397869056. Throughput: 0: 9822.6, 1: 10024.5. Samples: 397879400. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:51,175][105115] Avg episode reward: [(0, '-4.238'), (1, '-5.065')] [2023-12-28 00:49:51,227][106226] Updated weights for policy 0, policy_version 775868 (0.0009) [2023-12-28 00:49:51,295][106226] Updated weights for policy 0, policy_version 775878 (0.0008) [2023-12-28 00:49:51,357][106226] Updated weights for policy 0, policy_version 775888 (0.0010) [2023-12-28 00:49:51,584][106225] Updated weights for policy 1, policy_version 777963 (0.0009) [2023-12-28 00:49:51,648][106225] Updated weights for policy 1, policy_version 777973 (0.0009) [2023-12-28 00:49:51,720][106225] Updated weights for policy 1, policy_version 777983 (0.0008) [2023-12-28 00:49:52,115][106226] Updated weights for policy 0, policy_version 775898 (0.0009) [2023-12-28 00:49:52,183][106226] Updated weights for policy 0, policy_version 775908 (0.0009) [2023-12-28 00:49:52,238][106226] Updated weights for policy 0, policy_version 775918 (0.0008) [2023-12-28 00:49:52,305][106226] Updated weights for policy 0, policy_version 775928 (0.0007) [2023-12-28 00:49:52,484][106225] Updated weights for policy 1, policy_version 777993 (0.0008) [2023-12-28 00:49:52,541][106225] Updated weights for policy 1, policy_version 778003 (0.0006) [2023-12-28 00:49:52,604][106225] Updated weights for policy 1, policy_version 778013 (0.0008) [2023-12-28 00:49:52,663][106225] Updated weights for policy 1, policy_version 778023 (0.0009) [2023-12-28 00:49:53,022][106226] Updated weights for policy 0, policy_version 775938 (0.0009) [2023-12-28 00:49:53,077][106226] Updated weights for policy 0, policy_version 775948 (0.0008) [2023-12-28 00:49:53,126][106226] Updated weights for policy 0, policy_version 775958 (0.0008) [2023-12-28 00:49:53,393][106225] Updated weights for policy 1, policy_version 778033 (0.0008) [2023-12-28 00:49:53,444][106225] Updated weights for policy 1, policy_version 778043 (0.0008) [2023-12-28 00:49:53,499][106225] Updated weights for policy 1, policy_version 778053 (0.0008) [2023-12-28 00:49:53,830][106226] Updated weights for policy 0, policy_version 775968 (0.0009) [2023-12-28 00:49:53,889][106226] Updated weights for policy 0, policy_version 775978 (0.0009) [2023-12-28 00:49:53,942][106226] Updated weights for policy 0, policy_version 775988 (0.0009) [2023-12-28 00:49:54,238][106225] Updated weights for policy 1, policy_version 778063 (0.0008) [2023-12-28 00:49:54,293][106225] Updated weights for policy 1, policy_version 778073 (0.0007) [2023-12-28 00:49:54,347][106225] Updated weights for policy 1, policy_version 778083 (0.0007) [2023-12-28 00:49:54,664][106226] Updated weights for policy 0, policy_version 775998 (0.0008) [2023-12-28 00:49:54,712][106226] Updated weights for policy 0, policy_version 776008 (0.0008) [2023-12-28 00:49:54,762][106226] Updated weights for policy 0, policy_version 776018 (0.0008) [2023-12-28 00:49:55,056][106225] Updated weights for policy 1, policy_version 778093 (0.0008) [2023-12-28 00:49:55,104][106225] Updated weights for policy 1, policy_version 778103 (0.0008) [2023-12-28 00:49:55,149][106225] Updated weights for policy 1, policy_version 778113 (0.0008) [2023-12-28 00:49:55,518][106226] Updated weights for policy 0, policy_version 776028 (0.0009) [2023-12-28 00:49:55,572][106226] Updated weights for policy 0, policy_version 776038 (0.0008) [2023-12-28 00:49:55,634][106226] Updated weights for policy 0, policy_version 776048 (0.0006) [2023-12-28 00:49:55,895][106225] Updated weights for policy 1, policy_version 778123 (0.0006) [2023-12-28 00:49:55,941][106225] Updated weights for policy 1, policy_version 778133 (0.0009) [2023-12-28 00:49:55,993][106225] Updated weights for policy 1, policy_version 778143 (0.0007) [2023-12-28 00:49:56,175][105115] Fps is (10 sec: 18840.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 397967360. Throughput: 0: 9716.6, 1: 10005.6. Samples: 397935348. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:49:56,176][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.190')] [2023-12-28 00:49:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000778152_199245824.pth... [2023-12-28 00:49:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000776056_198721536.pth... [2023-12-28 00:49:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000776968_198942720.pth [2023-12-28 00:49:56,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000774936_198434816.pth [2023-12-28 00:49:56,237][106226] Updated weights for policy 0, policy_version 776058 (0.0006) [2023-12-28 00:49:56,299][106226] Updated weights for policy 0, policy_version 776068 (0.0008) [2023-12-28 00:49:56,361][106226] Updated weights for policy 0, policy_version 776078 (0.0007) [2023-12-28 00:49:56,420][106226] Updated weights for policy 0, policy_version 776088 (0.0007) [2023-12-28 00:49:56,593][106225] Updated weights for policy 1, policy_version 778153 (0.0005) [2023-12-28 00:49:56,649][106225] Updated weights for policy 1, policy_version 778163 (0.0008) [2023-12-28 00:49:56,708][106225] Updated weights for policy 1, policy_version 778173 (0.0008) [2023-12-28 00:49:56,762][106225] Updated weights for policy 1, policy_version 778184 (0.0009) [2023-12-28 00:49:57,141][106226] Updated weights for policy 0, policy_version 776098 (0.0005) [2023-12-28 00:49:57,193][106226] Updated weights for policy 0, policy_version 776108 (0.0007) [2023-12-28 00:49:57,249][106226] Updated weights for policy 0, policy_version 776119 (0.0007) [2023-12-28 00:49:57,344][106225] Updated weights for policy 1, policy_version 778194 (0.0008) [2023-12-28 00:49:57,398][106225] Updated weights for policy 1, policy_version 778204 (0.0008) [2023-12-28 00:49:57,459][106225] Updated weights for policy 1, policy_version 778214 (0.0009) [2023-12-28 00:49:57,826][106226] Updated weights for policy 0, policy_version 776129 (0.0009) [2023-12-28 00:49:57,871][106226] Updated weights for policy 0, policy_version 776139 (0.0009) [2023-12-28 00:49:57,919][106226] Updated weights for policy 0, policy_version 776149 (0.0005) [2023-12-28 00:49:58,211][106225] Updated weights for policy 1, policy_version 778224 (0.0008) [2023-12-28 00:49:58,275][106225] Updated weights for policy 1, policy_version 778234 (0.0007) [2023-12-28 00:49:58,336][106225] Updated weights for policy 1, policy_version 778244 (0.0008) [2023-12-28 00:49:58,696][106226] Updated weights for policy 0, policy_version 776159 (0.0007) [2023-12-28 00:49:58,773][106226] Updated weights for policy 0, policy_version 776169 (0.0008) [2023-12-28 00:49:58,856][106226] Updated weights for policy 0, policy_version 776179 (0.0009) [2023-12-28 00:49:59,135][106225] Updated weights for policy 1, policy_version 778254 (0.0008) [2023-12-28 00:49:59,184][106225] Updated weights for policy 1, policy_version 778264 (0.0007) [2023-12-28 00:49:59,248][106225] Updated weights for policy 1, policy_version 778274 (0.0009) [2023-12-28 00:49:59,642][106226] Updated weights for policy 0, policy_version 776189 (0.0007) [2023-12-28 00:49:59,709][106226] Updated weights for policy 0, policy_version 776199 (0.0005) [2023-12-28 00:49:59,779][106226] Updated weights for policy 0, policy_version 776209 (0.0006) [2023-12-28 00:49:59,995][106225] Updated weights for policy 1, policy_version 778284 (0.0011) [2023-12-28 00:50:00,056][106225] Updated weights for policy 1, policy_version 778294 (0.0010) [2023-12-28 00:50:00,121][106225] Updated weights for policy 1, policy_version 778304 (0.0009) [2023-12-28 00:50:00,490][106226] Updated weights for policy 0, policy_version 776219 (0.0009) [2023-12-28 00:50:00,539][106226] Updated weights for policy 0, policy_version 776229 (0.0009) [2023-12-28 00:50:00,586][106226] Updated weights for policy 0, policy_version 776240 (0.0007) [2023-12-28 00:50:00,698][106225] Updated weights for policy 1, policy_version 778314 (0.0005) [2023-12-28 00:50:00,759][106225] Updated weights for policy 1, policy_version 778324 (0.0005) [2023-12-28 00:50:00,821][106225] Updated weights for policy 1, policy_version 778334 (0.0005) [2023-12-28 00:50:00,876][106225] Updated weights for policy 1, policy_version 778344 (0.0005) [2023-12-28 00:50:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 398065664. Throughput: 0: 9738.4, 1: 10100.9. Samples: 398054276. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:01,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-5.101')] [2023-12-28 00:50:01,222][106226] Updated weights for policy 0, policy_version 776250 (0.0006) [2023-12-28 00:50:01,284][106226] Updated weights for policy 0, policy_version 776260 (0.0011) [2023-12-28 00:50:01,346][106226] Updated weights for policy 0, policy_version 776270 (0.0011) [2023-12-28 00:50:01,410][106226] Updated weights for policy 0, policy_version 776280 (0.0011) [2023-12-28 00:50:01,512][106225] Updated weights for policy 1, policy_version 778354 (0.0009) [2023-12-28 00:50:01,578][106225] Updated weights for policy 1, policy_version 778364 (0.0010) [2023-12-28 00:50:01,645][106225] Updated weights for policy 1, policy_version 778374 (0.0011) [2023-12-28 00:50:02,176][106226] Updated weights for policy 0, policy_version 776290 (0.0008) [2023-12-28 00:50:02,237][106226] Updated weights for policy 0, policy_version 776300 (0.0008) [2023-12-28 00:50:02,305][106226] Updated weights for policy 0, policy_version 776310 (0.0010) [2023-12-28 00:50:02,375][106225] Updated weights for policy 1, policy_version 778384 (0.0009) [2023-12-28 00:50:02,433][106225] Updated weights for policy 1, policy_version 778394 (0.0008) [2023-12-28 00:50:02,492][106225] Updated weights for policy 1, policy_version 778404 (0.0010) [2023-12-28 00:50:02,957][106226] Updated weights for policy 0, policy_version 776320 (0.0008) [2023-12-28 00:50:03,005][106226] Updated weights for policy 0, policy_version 776330 (0.0008) [2023-12-28 00:50:03,055][106226] Updated weights for policy 0, policy_version 776340 (0.0008) [2023-12-28 00:50:03,258][106225] Updated weights for policy 1, policy_version 778414 (0.0008) [2023-12-28 00:50:03,308][106225] Updated weights for policy 1, policy_version 778424 (0.0008) [2023-12-28 00:50:03,362][106225] Updated weights for policy 1, policy_version 778434 (0.0006) [2023-12-28 00:50:03,737][106226] Updated weights for policy 0, policy_version 776350 (0.0008) [2023-12-28 00:50:03,801][106226] Updated weights for policy 0, policy_version 776360 (0.0009) [2023-12-28 00:50:03,866][106226] Updated weights for policy 0, policy_version 776370 (0.0007) [2023-12-28 00:50:03,988][106225] Updated weights for policy 1, policy_version 778444 (0.0006) [2023-12-28 00:50:04,040][106225] Updated weights for policy 1, policy_version 778454 (0.0008) [2023-12-28 00:50:04,088][106225] Updated weights for policy 1, policy_version 778464 (0.0008) [2023-12-28 00:50:04,577][106226] Updated weights for policy 0, policy_version 776380 (0.0006) [2023-12-28 00:50:04,640][106226] Updated weights for policy 0, policy_version 776390 (0.0005) [2023-12-28 00:50:04,709][106226] Updated weights for policy 0, policy_version 776400 (0.0006) [2023-12-28 00:50:04,881][106225] Updated weights for policy 1, policy_version 778474 (0.0008) [2023-12-28 00:50:04,942][106225] Updated weights for policy 1, policy_version 778484 (0.0005) [2023-12-28 00:50:04,993][106225] Updated weights for policy 1, policy_version 778494 (0.0005) [2023-12-28 00:50:05,040][106225] Updated weights for policy 1, policy_version 778504 (0.0008) [2023-12-28 00:50:05,375][106226] Updated weights for policy 0, policy_version 776410 (0.0009) [2023-12-28 00:50:05,443][106226] Updated weights for policy 0, policy_version 776420 (0.0008) [2023-12-28 00:50:05,520][106226] Updated weights for policy 0, policy_version 776430 (0.0011) [2023-12-28 00:50:05,576][106226] Updated weights for policy 0, policy_version 776440 (0.0010) [2023-12-28 00:50:05,687][106225] Updated weights for policy 1, policy_version 778514 (0.0010) [2023-12-28 00:50:05,741][106225] Updated weights for policy 1, policy_version 778524 (0.0010) [2023-12-28 00:50:05,805][106225] Updated weights for policy 1, policy_version 778534 (0.0010) [2023-12-28 00:50:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 398163968. Throughput: 0: 9770.5, 1: 10097.0. Samples: 398175224. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:06,175][105115] Avg episode reward: [(0, '-4.151'), (1, '-5.348')] [2023-12-28 00:50:06,267][106226] Updated weights for policy 0, policy_version 776450 (0.0008) [2023-12-28 00:50:06,319][106226] Updated weights for policy 0, policy_version 776460 (0.0008) [2023-12-28 00:50:06,389][106226] Updated weights for policy 0, policy_version 776470 (0.0008) [2023-12-28 00:50:06,481][106225] Updated weights for policy 1, policy_version 778544 (0.0009) [2023-12-28 00:50:06,550][106225] Updated weights for policy 1, policy_version 778554 (0.0008) [2023-12-28 00:50:06,616][106225] Updated weights for policy 1, policy_version 778564 (0.0007) [2023-12-28 00:50:07,140][106226] Updated weights for policy 0, policy_version 776480 (0.0007) [2023-12-28 00:50:07,173][106225] Updated weights for policy 1, policy_version 778574 (0.0006) [2023-12-28 00:50:07,197][106226] Updated weights for policy 0, policy_version 776490 (0.0009) [2023-12-28 00:50:07,234][106225] Updated weights for policy 1, policy_version 778584 (0.0005) [2023-12-28 00:50:07,255][106226] Updated weights for policy 0, policy_version 776500 (0.0011) [2023-12-28 00:50:07,287][106225] Updated weights for policy 1, policy_version 778594 (0.0009) [2023-12-28 00:50:07,928][106226] Updated weights for policy 0, policy_version 776510 (0.0007) [2023-12-28 00:50:07,983][106226] Updated weights for policy 0, policy_version 776520 (0.0005) [2023-12-28 00:50:07,987][106225] Updated weights for policy 1, policy_version 778604 (0.0009) [2023-12-28 00:50:08,040][106226] Updated weights for policy 0, policy_version 776530 (0.0005) [2023-12-28 00:50:08,052][106225] Updated weights for policy 1, policy_version 778614 (0.0008) [2023-12-28 00:50:08,114][106225] Updated weights for policy 1, policy_version 778624 (0.0008) [2023-12-28 00:50:08,674][106226] Updated weights for policy 0, policy_version 776540 (0.0006) [2023-12-28 00:50:08,737][106226] Updated weights for policy 0, policy_version 776550 (0.0008) [2023-12-28 00:50:08,806][106226] Updated weights for policy 0, policy_version 776560 (0.0007) [2023-12-28 00:50:08,861][106225] Updated weights for policy 1, policy_version 778634 (0.0007) [2023-12-28 00:50:08,919][106225] Updated weights for policy 1, policy_version 778644 (0.0010) [2023-12-28 00:50:08,976][106225] Updated weights for policy 1, policy_version 778654 (0.0008) [2023-12-28 00:50:09,033][106225] Updated weights for policy 1, policy_version 778664 (0.0009) [2023-12-28 00:50:09,421][106226] Updated weights for policy 0, policy_version 776570 (0.0006) [2023-12-28 00:50:09,475][106226] Updated weights for policy 0, policy_version 776580 (0.0008) [2023-12-28 00:50:09,540][106226] Updated weights for policy 0, policy_version 776590 (0.0008) [2023-12-28 00:50:09,608][106226] Updated weights for policy 0, policy_version 776600 (0.0009) [2023-12-28 00:50:09,791][106225] Updated weights for policy 1, policy_version 778674 (0.0009) [2023-12-28 00:50:09,859][106225] Updated weights for policy 1, policy_version 778684 (0.0007) [2023-12-28 00:50:09,933][106225] Updated weights for policy 1, policy_version 778694 (0.0008) [2023-12-28 00:50:10,319][106226] Updated weights for policy 0, policy_version 776610 (0.0006) [2023-12-28 00:50:10,378][106226] Updated weights for policy 0, policy_version 776620 (0.0008) [2023-12-28 00:50:10,440][106226] Updated weights for policy 0, policy_version 776630 (0.0009) [2023-12-28 00:50:10,632][106225] Updated weights for policy 1, policy_version 778704 (0.0009) [2023-12-28 00:50:10,693][106225] Updated weights for policy 1, policy_version 778714 (0.0008) [2023-12-28 00:50:10,751][106225] Updated weights for policy 1, policy_version 778724 (0.0008) [2023-12-28 00:50:11,163][106226] Updated weights for policy 0, policy_version 776640 (0.0009) [2023-12-28 00:50:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 398262272. Throughput: 0: 9844.9, 1: 10153.1. Samples: 398237140. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:11,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.269')] [2023-12-28 00:50:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000778728_199393280.pth... [2023-12-28 00:50:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000777576_199098368.pth [2023-12-28 00:50:11,221][106226] Updated weights for policy 0, policy_version 776650 (0.0009) [2023-12-28 00:50:11,283][106226] Updated weights for policy 0, policy_version 776660 (0.0007) [2023-12-28 00:50:11,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000776664_198877184.pth... [2023-12-28 00:50:11,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000775512_198582272.pth [2023-12-28 00:50:11,544][106225] Updated weights for policy 1, policy_version 778734 (0.0008) [2023-12-28 00:50:11,610][106225] Updated weights for policy 1, policy_version 778744 (0.0009) [2023-12-28 00:50:11,680][106225] Updated weights for policy 1, policy_version 778754 (0.0008) [2023-12-28 00:50:12,052][106226] Updated weights for policy 0, policy_version 776670 (0.0006) [2023-12-28 00:50:12,119][106226] Updated weights for policy 0, policy_version 776680 (0.0007) [2023-12-28 00:50:12,180][106226] Updated weights for policy 0, policy_version 776690 (0.0008) [2023-12-28 00:50:12,429][106225] Updated weights for policy 1, policy_version 778764 (0.0006) [2023-12-28 00:50:12,493][106225] Updated weights for policy 1, policy_version 778774 (0.0005) [2023-12-28 00:50:12,556][106225] Updated weights for policy 1, policy_version 778784 (0.0006) [2023-12-28 00:50:12,896][106226] Updated weights for policy 0, policy_version 776700 (0.0009) [2023-12-28 00:50:12,954][106226] Updated weights for policy 0, policy_version 776710 (0.0011) [2023-12-28 00:50:13,010][106226] Updated weights for policy 0, policy_version 776720 (0.0010) [2023-12-28 00:50:13,224][106225] Updated weights for policy 1, policy_version 778794 (0.0009) [2023-12-28 00:50:13,279][106225] Updated weights for policy 1, policy_version 778804 (0.0006) [2023-12-28 00:50:13,334][106225] Updated weights for policy 1, policy_version 778814 (0.0009) [2023-12-28 00:50:13,395][106225] Updated weights for policy 1, policy_version 778824 (0.0008) [2023-12-28 00:50:13,619][106226] Updated weights for policy 0, policy_version 776730 (0.0010) [2023-12-28 00:50:13,672][106226] Updated weights for policy 0, policy_version 776740 (0.0010) [2023-12-28 00:50:13,722][106226] Updated weights for policy 0, policy_version 776750 (0.0010) [2023-12-28 00:50:13,771][106226] Updated weights for policy 0, policy_version 776760 (0.0010) [2023-12-28 00:50:14,146][106225] Updated weights for policy 1, policy_version 778834 (0.0007) [2023-12-28 00:50:14,204][106225] Updated weights for policy 1, policy_version 778844 (0.0005) [2023-12-28 00:50:14,260][106225] Updated weights for policy 1, policy_version 778854 (0.0010) [2023-12-28 00:50:14,489][106226] Updated weights for policy 0, policy_version 776770 (0.0008) [2023-12-28 00:50:14,548][106226] Updated weights for policy 0, policy_version 776780 (0.0008) [2023-12-28 00:50:14,602][106226] Updated weights for policy 0, policy_version 776790 (0.0008) [2023-12-28 00:50:14,947][106225] Updated weights for policy 1, policy_version 778864 (0.0010) [2023-12-28 00:50:15,015][106225] Updated weights for policy 1, policy_version 778874 (0.0011) [2023-12-28 00:50:15,079][106225] Updated weights for policy 1, policy_version 778884 (0.0008) [2023-12-28 00:50:15,377][106226] Updated weights for policy 0, policy_version 776800 (0.0008) [2023-12-28 00:50:15,430][106226] Updated weights for policy 0, policy_version 776810 (0.0009) [2023-12-28 00:50:15,483][106226] Updated weights for policy 0, policy_version 776820 (0.0008) [2023-12-28 00:50:15,776][106225] Updated weights for policy 1, policy_version 778894 (0.0009) [2023-12-28 00:50:15,839][106225] Updated weights for policy 1, policy_version 778904 (0.0009) [2023-12-28 00:50:15,899][106225] Updated weights for policy 1, policy_version 778914 (0.0009) [2023-12-28 00:50:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 398360576. Throughput: 0: 9764.4, 1: 9978.6. Samples: 398352100. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:16,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.129')] [2023-12-28 00:50:16,225][106226] Updated weights for policy 0, policy_version 776830 (0.0009) [2023-12-28 00:50:16,271][106226] Updated weights for policy 0, policy_version 776840 (0.0008) [2023-12-28 00:50:16,320][106226] Updated weights for policy 0, policy_version 776850 (0.0008) [2023-12-28 00:50:16,593][106225] Updated weights for policy 1, policy_version 778924 (0.0008) [2023-12-28 00:50:16,642][106225] Updated weights for policy 1, policy_version 778934 (0.0009) [2023-12-28 00:50:16,689][106225] Updated weights for policy 1, policy_version 778944 (0.0008) [2023-12-28 00:50:17,067][106226] Updated weights for policy 0, policy_version 776860 (0.0008) [2023-12-28 00:50:17,131][106226] Updated weights for policy 0, policy_version 776870 (0.0009) [2023-12-28 00:50:17,179][106226] Updated weights for policy 0, policy_version 776880 (0.0008) [2023-12-28 00:50:17,444][106225] Updated weights for policy 1, policy_version 778954 (0.0008) [2023-12-28 00:50:17,496][106225] Updated weights for policy 1, policy_version 778964 (0.0008) [2023-12-28 00:50:17,551][106225] Updated weights for policy 1, policy_version 778974 (0.0008) [2023-12-28 00:50:17,605][106225] Updated weights for policy 1, policy_version 778984 (0.0009) [2023-12-28 00:50:17,938][106226] Updated weights for policy 0, policy_version 776890 (0.0009) [2023-12-28 00:50:17,994][106226] Updated weights for policy 0, policy_version 776900 (0.0008) [2023-12-28 00:50:18,058][106226] Updated weights for policy 0, policy_version 776910 (0.0009) [2023-12-28 00:50:18,114][106226] Updated weights for policy 0, policy_version 776920 (0.0009) [2023-12-28 00:50:18,269][106225] Updated weights for policy 1, policy_version 778994 (0.0008) [2023-12-28 00:50:18,318][106225] Updated weights for policy 1, policy_version 779004 (0.0008) [2023-12-28 00:50:18,383][106225] Updated weights for policy 1, policy_version 779014 (0.0007) [2023-12-28 00:50:18,900][106226] Updated weights for policy 0, policy_version 776930 (0.0008) [2023-12-28 00:50:18,959][106226] Updated weights for policy 0, policy_version 776940 (0.0008) [2023-12-28 00:50:19,014][106226] Updated weights for policy 0, policy_version 776950 (0.0009) [2023-12-28 00:50:19,036][106225] Updated weights for policy 1, policy_version 779024 (0.0006) [2023-12-28 00:50:19,088][106225] Updated weights for policy 1, policy_version 779034 (0.0005) [2023-12-28 00:50:19,134][106225] Updated weights for policy 1, policy_version 779044 (0.0007) [2023-12-28 00:50:19,845][106225] Updated weights for policy 1, policy_version 779054 (0.0009) [2023-12-28 00:50:19,867][106226] Updated weights for policy 0, policy_version 776960 (0.0008) [2023-12-28 00:50:19,912][106225] Updated weights for policy 1, policy_version 779064 (0.0008) [2023-12-28 00:50:19,934][106226] Updated weights for policy 0, policy_version 776970 (0.0008) [2023-12-28 00:50:19,983][106225] Updated weights for policy 1, policy_version 779074 (0.0010) [2023-12-28 00:50:20,000][106226] Updated weights for policy 0, policy_version 776980 (0.0006) [2023-12-28 00:50:20,688][106226] Updated weights for policy 0, policy_version 776990 (0.0008) [2023-12-28 00:50:20,724][106225] Updated weights for policy 1, policy_version 779084 (0.0011) [2023-12-28 00:50:20,747][106226] Updated weights for policy 0, policy_version 777000 (0.0007) [2023-12-28 00:50:20,784][106225] Updated weights for policy 1, policy_version 779094 (0.0010) [2023-12-28 00:50:20,804][106226] Updated weights for policy 0, policy_version 777010 (0.0009) [2023-12-28 00:50:20,845][106225] Updated weights for policy 1, policy_version 779104 (0.0006) [2023-12-28 00:50:21,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 398458880. Throughput: 0: 9695.9, 1: 9882.9. Samples: 398466688. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:21,175][105115] Avg episode reward: [(0, '-4.290'), (1, '-5.399')] [2023-12-28 00:50:21,544][106226] Updated weights for policy 0, policy_version 777020 (0.0008) [2023-12-28 00:50:21,606][106226] Updated weights for policy 0, policy_version 777030 (0.0008) [2023-12-28 00:50:21,665][106225] Updated weights for policy 1, policy_version 779114 (0.0008) [2023-12-28 00:50:21,673][106226] Updated weights for policy 0, policy_version 777040 (0.0008) [2023-12-28 00:50:21,739][106225] Updated weights for policy 1, policy_version 779124 (0.0008) [2023-12-28 00:50:21,805][106225] Updated weights for policy 1, policy_version 779134 (0.0006) [2023-12-28 00:50:21,867][106225] Updated weights for policy 1, policy_version 779144 (0.0007) [2023-12-28 00:50:22,329][106226] Updated weights for policy 0, policy_version 777050 (0.0007) [2023-12-28 00:50:22,400][106226] Updated weights for policy 0, policy_version 777060 (0.0009) [2023-12-28 00:50:22,465][106226] Updated weights for policy 0, policy_version 777070 (0.0008) [2023-12-28 00:50:22,527][106226] Updated weights for policy 0, policy_version 777080 (0.0008) [2023-12-28 00:50:22,632][106225] Updated weights for policy 1, policy_version 779154 (0.0011) [2023-12-28 00:50:22,690][106225] Updated weights for policy 1, policy_version 779164 (0.0010) [2023-12-28 00:50:22,751][106225] Updated weights for policy 1, policy_version 779174 (0.0010) [2023-12-28 00:50:23,273][106226] Updated weights for policy 0, policy_version 777090 (0.0008) [2023-12-28 00:50:23,330][106226] Updated weights for policy 0, policy_version 777100 (0.0008) [2023-12-28 00:50:23,396][106226] Updated weights for policy 0, policy_version 777110 (0.0007) [2023-12-28 00:50:23,410][106225] Updated weights for policy 1, policy_version 779184 (0.0008) [2023-12-28 00:50:23,468][106225] Updated weights for policy 1, policy_version 779194 (0.0009) [2023-12-28 00:50:23,530][106225] Updated weights for policy 1, policy_version 779204 (0.0008) [2023-12-28 00:50:24,124][106226] Updated weights for policy 0, policy_version 777120 (0.0007) [2023-12-28 00:50:24,174][106225] Updated weights for policy 1, policy_version 779214 (0.0008) [2023-12-28 00:50:24,181][106226] Updated weights for policy 0, policy_version 777130 (0.0008) [2023-12-28 00:50:24,230][106226] Updated weights for policy 0, policy_version 777140 (0.0007) [2023-12-28 00:50:24,232][106225] Updated weights for policy 1, policy_version 779224 (0.0006) [2023-12-28 00:50:24,286][106225] Updated weights for policy 1, policy_version 779234 (0.0007) [2023-12-28 00:50:24,900][106225] Updated weights for policy 1, policy_version 779244 (0.0006) [2023-12-28 00:50:24,956][106225] Updated weights for policy 1, policy_version 779254 (0.0008) [2023-12-28 00:50:25,011][106226] Updated weights for policy 0, policy_version 777150 (0.0008) [2023-12-28 00:50:25,012][106225] Updated weights for policy 1, policy_version 779264 (0.0007) [2023-12-28 00:50:25,070][106226] Updated weights for policy 0, policy_version 777160 (0.0005) [2023-12-28 00:50:25,135][106226] Updated weights for policy 0, policy_version 777170 (0.0005) [2023-12-28 00:50:25,676][106225] Updated weights for policy 1, policy_version 779274 (0.0008) [2023-12-28 00:50:25,742][106225] Updated weights for policy 1, policy_version 779284 (0.0008) [2023-12-28 00:50:25,785][106226] Updated weights for policy 0, policy_version 777180 (0.0006) [2023-12-28 00:50:25,806][106225] Updated weights for policy 1, policy_version 779294 (0.0008) [2023-12-28 00:50:25,850][106226] Updated weights for policy 0, policy_version 777190 (0.0007) [2023-12-28 00:50:25,866][106225] Updated weights for policy 1, policy_version 779304 (0.0007) [2023-12-28 00:50:25,904][106226] Updated weights for policy 0, policy_version 777200 (0.0010) [2023-12-28 00:50:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 398557184. Throughput: 0: 9677.9, 1: 9868.9. Samples: 398523140. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:26,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-5.252')] [2023-12-28 00:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000779304_199540736.pth... [2023-12-28 00:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000777208_199016448.pth... [2023-12-28 00:50:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000778152_199245824.pth [2023-12-28 00:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000776056_198721536.pth [2023-12-28 00:50:26,506][106225] Updated weights for policy 1, policy_version 779314 (0.0008) [2023-12-28 00:50:26,557][106225] Updated weights for policy 1, policy_version 779324 (0.0008) [2023-12-28 00:50:26,559][106226] Updated weights for policy 0, policy_version 777210 (0.0008) [2023-12-28 00:50:26,612][106226] Updated weights for policy 0, policy_version 777220 (0.0007) [2023-12-28 00:50:26,614][106225] Updated weights for policy 1, policy_version 779334 (0.0005) [2023-12-28 00:50:26,676][106226] Updated weights for policy 0, policy_version 777230 (0.0008) [2023-12-28 00:50:26,736][106226] Updated weights for policy 0, policy_version 777240 (0.0008) [2023-12-28 00:50:27,331][106225] Updated weights for policy 1, policy_version 779344 (0.0007) [2023-12-28 00:50:27,342][106226] Updated weights for policy 0, policy_version 777250 (0.0007) [2023-12-28 00:50:27,385][106225] Updated weights for policy 1, policy_version 779354 (0.0008) [2023-12-28 00:50:27,402][106226] Updated weights for policy 0, policy_version 777260 (0.0008) [2023-12-28 00:50:27,433][106225] Updated weights for policy 1, policy_version 779364 (0.0008) [2023-12-28 00:50:27,460][106226] Updated weights for policy 0, policy_version 777270 (0.0010) [2023-12-28 00:50:28,041][106225] Updated weights for policy 1, policy_version 779374 (0.0009) [2023-12-28 00:50:28,100][106225] Updated weights for policy 1, policy_version 779384 (0.0010) [2023-12-28 00:50:28,111][106226] Updated weights for policy 0, policy_version 777280 (0.0006) [2023-12-28 00:50:28,149][106225] Updated weights for policy 1, policy_version 779394 (0.0010) [2023-12-28 00:50:28,159][106226] Updated weights for policy 0, policy_version 777290 (0.0005) [2023-12-28 00:50:28,217][106226] Updated weights for policy 0, policy_version 777300 (0.0005) [2023-12-28 00:50:28,775][106226] Updated weights for policy 0, policy_version 777310 (0.0007) [2023-12-28 00:50:28,839][106226] Updated weights for policy 0, policy_version 777320 (0.0008) [2023-12-28 00:50:28,857][106225] Updated weights for policy 1, policy_version 779404 (0.0009) [2023-12-28 00:50:28,899][106226] Updated weights for policy 0, policy_version 777330 (0.0007) [2023-12-28 00:50:28,913][106225] Updated weights for policy 1, policy_version 779414 (0.0010) [2023-12-28 00:50:28,964][106225] Updated weights for policy 1, policy_version 779424 (0.0010) [2023-12-28 00:50:29,518][106226] Updated weights for policy 0, policy_version 777340 (0.0006) [2023-12-28 00:50:29,573][106226] Updated weights for policy 0, policy_version 777350 (0.0005) [2023-12-28 00:50:29,634][106226] Updated weights for policy 0, policy_version 777360 (0.0008) [2023-12-28 00:50:29,700][106225] Updated weights for policy 1, policy_version 779434 (0.0010) [2023-12-28 00:50:29,758][106225] Updated weights for policy 1, policy_version 779444 (0.0007) [2023-12-28 00:50:29,819][106225] Updated weights for policy 1, policy_version 779454 (0.0006) [2023-12-28 00:50:29,888][106225] Updated weights for policy 1, policy_version 779464 (0.0008) [2023-12-28 00:50:30,266][106226] Updated weights for policy 0, policy_version 777370 (0.0008) [2023-12-28 00:50:30,333][106226] Updated weights for policy 0, policy_version 777380 (0.0006) [2023-12-28 00:50:30,401][106226] Updated weights for policy 0, policy_version 777390 (0.0008) [2023-12-28 00:50:30,460][106226] Updated weights for policy 0, policy_version 777400 (0.0009) [2023-12-28 00:50:30,568][106225] Updated weights for policy 1, policy_version 779474 (0.0008) [2023-12-28 00:50:30,625][106225] Updated weights for policy 1, policy_version 779484 (0.0009) [2023-12-28 00:50:30,685][106225] Updated weights for policy 1, policy_version 779494 (0.0010) [2023-12-28 00:50:31,155][106226] Updated weights for policy 0, policy_version 777410 (0.0008) [2023-12-28 00:50:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 398655488. Throughput: 0: 9813.1, 1: 9975.6. Samples: 398649452. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:31,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-5.098')] [2023-12-28 00:50:31,220][106226] Updated weights for policy 0, policy_version 777420 (0.0009) [2023-12-28 00:50:31,281][106226] Updated weights for policy 0, policy_version 777430 (0.0007) [2023-12-28 00:50:31,353][106225] Updated weights for policy 1, policy_version 779504 (0.0008) [2023-12-28 00:50:31,422][106225] Updated weights for policy 1, policy_version 779514 (0.0008) [2023-12-28 00:50:31,492][106225] Updated weights for policy 1, policy_version 779524 (0.0006) [2023-12-28 00:50:32,072][106226] Updated weights for policy 0, policy_version 777440 (0.0009) [2023-12-28 00:50:32,133][106226] Updated weights for policy 0, policy_version 777450 (0.0005) [2023-12-28 00:50:32,204][106225] Updated weights for policy 1, policy_version 779534 (0.0008) [2023-12-28 00:50:32,207][106226] Updated weights for policy 0, policy_version 777460 (0.0006) [2023-12-28 00:50:32,262][106225] Updated weights for policy 1, policy_version 779544 (0.0007) [2023-12-28 00:50:32,330][106225] Updated weights for policy 1, policy_version 779554 (0.0008) [2023-12-28 00:50:32,847][106226] Updated weights for policy 0, policy_version 777470 (0.0007) [2023-12-28 00:50:32,901][106226] Updated weights for policy 0, policy_version 777480 (0.0008) [2023-12-28 00:50:32,952][106226] Updated weights for policy 0, policy_version 777490 (0.0006) [2023-12-28 00:50:32,980][106225] Updated weights for policy 1, policy_version 779564 (0.0009) [2023-12-28 00:50:33,033][106225] Updated weights for policy 1, policy_version 779574 (0.0010) [2023-12-28 00:50:33,080][106225] Updated weights for policy 1, policy_version 779584 (0.0010) [2023-12-28 00:50:33,497][106226] Updated weights for policy 0, policy_version 777500 (0.0005) [2023-12-28 00:50:33,563][106226] Updated weights for policy 0, policy_version 777510 (0.0005) [2023-12-28 00:50:33,627][106226] Updated weights for policy 0, policy_version 777520 (0.0005) [2023-12-28 00:50:33,701][106225] Updated weights for policy 1, policy_version 779594 (0.0009) [2023-12-28 00:50:33,760][106225] Updated weights for policy 1, policy_version 779604 (0.0006) [2023-12-28 00:50:33,811][106225] Updated weights for policy 1, policy_version 779614 (0.0005) [2023-12-28 00:50:33,870][106225] Updated weights for policy 1, policy_version 779624 (0.0006) [2023-12-28 00:50:34,129][106226] Updated weights for policy 0, policy_version 777530 (0.0006) [2023-12-28 00:50:34,195][106226] Updated weights for policy 0, policy_version 777540 (0.0008) [2023-12-28 00:50:34,257][106226] Updated weights for policy 0, policy_version 777550 (0.0005) [2023-12-28 00:50:34,321][106226] Updated weights for policy 0, policy_version 777560 (0.0006) [2023-12-28 00:50:34,443][106225] Updated weights for policy 1, policy_version 779634 (0.0008) [2023-12-28 00:50:34,499][106225] Updated weights for policy 1, policy_version 779644 (0.0009) [2023-12-28 00:50:34,551][106225] Updated weights for policy 1, policy_version 779654 (0.0008) [2023-12-28 00:50:34,960][106226] Updated weights for policy 0, policy_version 777570 (0.0008) [2023-12-28 00:50:35,026][106226] Updated weights for policy 0, policy_version 777580 (0.0008) [2023-12-28 00:50:35,089][106226] Updated weights for policy 0, policy_version 777590 (0.0008) [2023-12-28 00:50:35,229][106225] Updated weights for policy 1, policy_version 779664 (0.0009) [2023-12-28 00:50:35,286][106225] Updated weights for policy 1, policy_version 779674 (0.0008) [2023-12-28 00:50:35,344][106225] Updated weights for policy 1, policy_version 779684 (0.0008) [2023-12-28 00:50:35,825][106226] Updated weights for policy 0, policy_version 777600 (0.0009) [2023-12-28 00:50:35,893][106226] Updated weights for policy 0, policy_version 777610 (0.0005) [2023-12-28 00:50:35,955][106226] Updated weights for policy 0, policy_version 777620 (0.0007) [2023-12-28 00:50:36,049][106225] Updated weights for policy 1, policy_version 779694 (0.0009) [2023-12-28 00:50:36,100][106225] Updated weights for policy 1, policy_version 779705 (0.0009) [2023-12-28 00:50:36,170][106225] Updated weights for policy 1, policy_version 779715 (0.0008) [2023-12-28 00:50:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 398761984. Throughput: 0: 9932.4, 1: 9934.4. Samples: 398773404. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:36,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-5.072')] [2023-12-28 00:50:36,619][106226] Updated weights for policy 0, policy_version 777630 (0.0009) [2023-12-28 00:50:36,689][106226] Updated weights for policy 0, policy_version 777640 (0.0008) [2023-12-28 00:50:36,755][106226] Updated weights for policy 0, policy_version 777650 (0.0009) [2023-12-28 00:50:36,952][106225] Updated weights for policy 1, policy_version 779725 (0.0008) [2023-12-28 00:50:37,017][106225] Updated weights for policy 1, policy_version 779735 (0.0006) [2023-12-28 00:50:37,074][106225] Updated weights for policy 1, policy_version 779745 (0.0008) [2023-12-28 00:50:37,487][106226] Updated weights for policy 0, policy_version 777660 (0.0010) [2023-12-28 00:50:37,546][106226] Updated weights for policy 0, policy_version 777670 (0.0009) [2023-12-28 00:50:37,608][106226] Updated weights for policy 0, policy_version 777680 (0.0008) [2023-12-28 00:50:37,713][106225] Updated weights for policy 1, policy_version 779755 (0.0006) [2023-12-28 00:50:37,771][106225] Updated weights for policy 1, policy_version 779765 (0.0008) [2023-12-28 00:50:37,826][106225] Updated weights for policy 1, policy_version 779775 (0.0009) [2023-12-28 00:50:38,343][106226] Updated weights for policy 0, policy_version 777690 (0.0009) [2023-12-28 00:50:38,412][106226] Updated weights for policy 0, policy_version 777700 (0.0010) [2023-12-28 00:50:38,421][106225] Updated weights for policy 1, policy_version 779785 (0.0007) [2023-12-28 00:50:38,488][106226] Updated weights for policy 0, policy_version 777710 (0.0007) [2023-12-28 00:50:38,489][106225] Updated weights for policy 1, policy_version 779795 (0.0008) [2023-12-28 00:50:38,553][106226] Updated weights for policy 0, policy_version 777720 (0.0011) [2023-12-28 00:50:38,554][106225] Updated weights for policy 1, policy_version 779805 (0.0008) [2023-12-28 00:50:38,616][106225] Updated weights for policy 1, policy_version 779815 (0.0006) [2023-12-28 00:50:39,284][106225] Updated weights for policy 1, policy_version 779825 (0.0007) [2023-12-28 00:50:39,307][106226] Updated weights for policy 0, policy_version 777730 (0.0010) [2023-12-28 00:50:39,349][106225] Updated weights for policy 1, policy_version 779835 (0.0006) [2023-12-28 00:50:39,379][106226] Updated weights for policy 0, policy_version 777740 (0.0010) [2023-12-28 00:50:39,422][106225] Updated weights for policy 1, policy_version 779845 (0.0008) [2023-12-28 00:50:39,447][106226] Updated weights for policy 0, policy_version 777750 (0.0009) [2023-12-28 00:50:40,176][106226] Updated weights for policy 0, policy_version 777760 (0.0007) [2023-12-28 00:50:40,183][106225] Updated weights for policy 1, policy_version 779855 (0.0008) [2023-12-28 00:50:40,242][106226] Updated weights for policy 0, policy_version 777770 (0.0006) [2023-12-28 00:50:40,243][106225] Updated weights for policy 1, policy_version 779865 (0.0008) [2023-12-28 00:50:40,299][106225] Updated weights for policy 1, policy_version 779875 (0.0006) [2023-12-28 00:50:40,313][106226] Updated weights for policy 0, policy_version 777780 (0.0006) [2023-12-28 00:50:40,933][106226] Updated weights for policy 0, policy_version 777790 (0.0006) [2023-12-28 00:50:40,994][106226] Updated weights for policy 0, policy_version 777800 (0.0006) [2023-12-28 00:50:40,996][106225] Updated weights for policy 1, policy_version 779885 (0.0008) [2023-12-28 00:50:41,061][106225] Updated weights for policy 1, policy_version 779895 (0.0009) [2023-12-28 00:50:41,061][106226] Updated weights for policy 0, policy_version 777810 (0.0008) [2023-12-28 00:50:41,127][106225] Updated weights for policy 1, policy_version 779905 (0.0012) [2023-12-28 00:50:41,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 398868480. Throughput: 0: 9950.5, 1: 9993.2. Samples: 398832808. Policy #0 lag: (min: 3.0, avg: 16.1, max: 35.0) [2023-12-28 00:50:41,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-5.079')] [2023-12-28 00:50:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000779912_199696384.pth... [2023-12-28 00:50:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000777816_199172096.pth... [2023-12-28 00:50:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000778728_199393280.pth [2023-12-28 00:50:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000776664_198877184.pth [2023-12-28 00:50:41,791][106226] Updated weights for policy 0, policy_version 777820 (0.0009) [2023-12-28 00:50:41,856][106226] Updated weights for policy 0, policy_version 777830 (0.0006) [2023-12-28 00:50:41,917][106226] Updated weights for policy 0, policy_version 777840 (0.0007) [2023-12-28 00:50:41,943][106225] Updated weights for policy 1, policy_version 779915 (0.0008) [2023-12-28 00:50:42,013][106225] Updated weights for policy 1, policy_version 779925 (0.0008) [2023-12-28 00:50:42,082][106225] Updated weights for policy 1, policy_version 779935 (0.0008) [2023-12-28 00:50:42,613][106226] Updated weights for policy 0, policy_version 777850 (0.0006) [2023-12-28 00:50:42,683][106226] Updated weights for policy 0, policy_version 777860 (0.0005) [2023-12-28 00:50:42,705][106225] Updated weights for policy 1, policy_version 779945 (0.0008) [2023-12-28 00:50:42,754][106226] Updated weights for policy 0, policy_version 777870 (0.0005) [2023-12-28 00:50:42,775][106225] Updated weights for policy 1, policy_version 779955 (0.0005) [2023-12-28 00:50:42,814][106226] Updated weights for policy 0, policy_version 777880 (0.0005) [2023-12-28 00:50:42,843][106225] Updated weights for policy 1, policy_version 779965 (0.0008) [2023-12-28 00:50:42,903][106225] Updated weights for policy 1, policy_version 779975 (0.0009) [2023-12-28 00:50:43,368][106226] Updated weights for policy 0, policy_version 777890 (0.0008) [2023-12-28 00:50:43,426][106226] Updated weights for policy 0, policy_version 777900 (0.0006) [2023-12-28 00:50:43,486][106226] Updated weights for policy 0, policy_version 777910 (0.0007) [2023-12-28 00:50:43,570][106225] Updated weights for policy 1, policy_version 779985 (0.0010) [2023-12-28 00:50:43,630][106225] Updated weights for policy 1, policy_version 779995 (0.0010) [2023-12-28 00:50:43,686][106225] Updated weights for policy 1, policy_version 780005 (0.0010) [2023-12-28 00:50:44,073][106226] Updated weights for policy 0, policy_version 777920 (0.0008) [2023-12-28 00:50:44,133][106226] Updated weights for policy 0, policy_version 777930 (0.0007) [2023-12-28 00:50:44,201][106226] Updated weights for policy 0, policy_version 777940 (0.0010) [2023-12-28 00:50:44,368][106225] Updated weights for policy 1, policy_version 780015 (0.0008) [2023-12-28 00:50:44,415][106225] Updated weights for policy 1, policy_version 780025 (0.0007) [2023-12-28 00:50:44,468][106225] Updated weights for policy 1, policy_version 780035 (0.0005) [2023-12-28 00:50:44,842][106226] Updated weights for policy 0, policy_version 777950 (0.0007) [2023-12-28 00:50:44,909][106226] Updated weights for policy 0, policy_version 777960 (0.0010) [2023-12-28 00:50:44,971][106226] Updated weights for policy 0, policy_version 777970 (0.0008) [2023-12-28 00:50:45,133][106225] Updated weights for policy 1, policy_version 780045 (0.0008) [2023-12-28 00:50:45,190][106225] Updated weights for policy 1, policy_version 780055 (0.0009) [2023-12-28 00:50:45,251][106225] Updated weights for policy 1, policy_version 780065 (0.0008) [2023-12-28 00:50:45,739][106226] Updated weights for policy 0, policy_version 777980 (0.0008) [2023-12-28 00:50:45,802][106226] Updated weights for policy 0, policy_version 777990 (0.0009) [2023-12-28 00:50:45,868][106226] Updated weights for policy 0, policy_version 778000 (0.0009) [2023-12-28 00:50:45,874][106225] Updated weights for policy 1, policy_version 780075 (0.0009) [2023-12-28 00:50:45,933][106225] Updated weights for policy 1, policy_version 780085 (0.0005) [2023-12-28 00:50:45,984][106225] Updated weights for policy 1, policy_version 780095 (0.0005) [2023-12-28 00:50:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 398966784. Throughput: 0: 9993.7, 1: 9970.6. Samples: 398952668. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:50:46,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-5.143')] [2023-12-28 00:50:46,530][106225] Updated weights for policy 1, policy_version 780105 (0.0005) [2023-12-28 00:50:46,578][106225] Updated weights for policy 1, policy_version 780115 (0.0005) [2023-12-28 00:50:46,633][106225] Updated weights for policy 1, policy_version 780125 (0.0009) [2023-12-28 00:50:46,682][106226] Updated weights for policy 0, policy_version 778010 (0.0009) [2023-12-28 00:50:46,682][106225] Updated weights for policy 1, policy_version 780135 (0.0010) [2023-12-28 00:50:46,732][106226] Updated weights for policy 0, policy_version 778020 (0.0008) [2023-12-28 00:50:46,782][106226] Updated weights for policy 0, policy_version 778030 (0.0007) [2023-12-28 00:50:46,833][106226] Updated weights for policy 0, policy_version 778040 (0.0008) [2023-12-28 00:50:47,376][106225] Updated weights for policy 1, policy_version 780145 (0.0010) [2023-12-28 00:50:47,434][106225] Updated weights for policy 1, policy_version 780155 (0.0008) [2023-12-28 00:50:47,480][106225] Updated weights for policy 1, policy_version 780165 (0.0005) [2023-12-28 00:50:47,611][106226] Updated weights for policy 0, policy_version 778050 (0.0010) [2023-12-28 00:50:47,665][106226] Updated weights for policy 0, policy_version 778060 (0.0008) [2023-12-28 00:50:47,722][106226] Updated weights for policy 0, policy_version 778070 (0.0009) [2023-12-28 00:50:48,076][106225] Updated weights for policy 1, policy_version 780175 (0.0005) [2023-12-28 00:50:48,128][106225] Updated weights for policy 1, policy_version 780185 (0.0005) [2023-12-28 00:50:48,182][106225] Updated weights for policy 1, policy_version 780195 (0.0007) [2023-12-28 00:50:48,521][106226] Updated weights for policy 0, policy_version 778080 (0.0009) [2023-12-28 00:50:48,581][106226] Updated weights for policy 0, policy_version 778090 (0.0009) [2023-12-28 00:50:48,645][106226] Updated weights for policy 0, policy_version 778100 (0.0009) [2023-12-28 00:50:48,857][106225] Updated weights for policy 1, policy_version 780205 (0.0008) [2023-12-28 00:50:48,917][106225] Updated weights for policy 1, policy_version 780215 (0.0010) [2023-12-28 00:50:48,972][106225] Updated weights for policy 1, policy_version 780225 (0.0010) [2023-12-28 00:50:49,402][106226] Updated weights for policy 0, policy_version 778110 (0.0009) [2023-12-28 00:50:49,469][106226] Updated weights for policy 0, policy_version 778120 (0.0008) [2023-12-28 00:50:49,530][106226] Updated weights for policy 0, policy_version 778130 (0.0008) [2023-12-28 00:50:49,751][106225] Updated weights for policy 1, policy_version 780235 (0.0010) [2023-12-28 00:50:49,820][106225] Updated weights for policy 1, policy_version 780245 (0.0007) [2023-12-28 00:50:49,892][106225] Updated weights for policy 1, policy_version 780255 (0.0008) [2023-12-28 00:50:50,353][106226] Updated weights for policy 0, policy_version 778140 (0.0009) [2023-12-28 00:50:50,406][106226] Updated weights for policy 0, policy_version 778150 (0.0009) [2023-12-28 00:50:50,452][106226] Updated weights for policy 0, policy_version 778160 (0.0009) [2023-12-28 00:50:50,528][106225] Updated weights for policy 1, policy_version 780265 (0.0009) [2023-12-28 00:50:50,597][106225] Updated weights for policy 1, policy_version 780275 (0.0008) [2023-12-28 00:50:50,662][106225] Updated weights for policy 1, policy_version 780285 (0.0009) [2023-12-28 00:50:50,719][106225] Updated weights for policy 1, policy_version 780295 (0.0008) [2023-12-28 00:50:51,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 399056896. Throughput: 0: 9839.9, 1: 10020.3. Samples: 399068932. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:50:51,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-5.311')] [2023-12-28 00:50:51,257][106226] Updated weights for policy 0, policy_version 778170 (0.0008) [2023-12-28 00:50:51,322][106226] Updated weights for policy 0, policy_version 778180 (0.0009) [2023-12-28 00:50:51,391][106226] Updated weights for policy 0, policy_version 778190 (0.0009) [2023-12-28 00:50:51,452][106226] Updated weights for policy 0, policy_version 778200 (0.0008) [2023-12-28 00:50:51,476][106225] Updated weights for policy 1, policy_version 780305 (0.0006) [2023-12-28 00:50:51,535][106225] Updated weights for policy 1, policy_version 780315 (0.0007) [2023-12-28 00:50:51,586][106225] Updated weights for policy 1, policy_version 780325 (0.0005) [2023-12-28 00:50:52,194][106226] Updated weights for policy 0, policy_version 778210 (0.0009) [2023-12-28 00:50:52,247][106226] Updated weights for policy 0, policy_version 778220 (0.0008) [2023-12-28 00:50:52,274][106225] Updated weights for policy 1, policy_version 780335 (0.0008) [2023-12-28 00:50:52,312][106226] Updated weights for policy 0, policy_version 778230 (0.0007) [2023-12-28 00:50:52,338][106225] Updated weights for policy 1, policy_version 780345 (0.0007) [2023-12-28 00:50:52,402][106225] Updated weights for policy 1, policy_version 780355 (0.0007) [2023-12-28 00:50:53,080][106226] Updated weights for policy 0, policy_version 778240 (0.0008) [2023-12-28 00:50:53,129][106226] Updated weights for policy 0, policy_version 778250 (0.0009) [2023-12-28 00:50:53,134][106225] Updated weights for policy 1, policy_version 780365 (0.0007) [2023-12-28 00:50:53,184][106226] Updated weights for policy 0, policy_version 778260 (0.0008) [2023-12-28 00:50:53,188][106225] Updated weights for policy 1, policy_version 780375 (0.0006) [2023-12-28 00:50:53,244][106225] Updated weights for policy 1, policy_version 780385 (0.0005) [2023-12-28 00:50:53,796][106225] Updated weights for policy 1, policy_version 780395 (0.0005) [2023-12-28 00:50:53,842][106225] Updated weights for policy 1, policy_version 780405 (0.0005) [2023-12-28 00:50:53,887][106225] Updated weights for policy 1, policy_version 780415 (0.0005) [2023-12-28 00:50:54,046][106226] Updated weights for policy 0, policy_version 778270 (0.0010) [2023-12-28 00:50:54,101][106226] Updated weights for policy 0, policy_version 778280 (0.0008) [2023-12-28 00:50:54,168][106226] Updated weights for policy 0, policy_version 778290 (0.0010) [2023-12-28 00:50:54,418][106225] Updated weights for policy 1, policy_version 780425 (0.0005) [2023-12-28 00:50:54,473][106225] Updated weights for policy 1, policy_version 780435 (0.0005) [2023-12-28 00:50:54,532][106225] Updated weights for policy 1, policy_version 780445 (0.0008) [2023-12-28 00:50:54,600][106225] Updated weights for policy 1, policy_version 780455 (0.0010) [2023-12-28 00:50:54,986][106226] Updated weights for policy 0, policy_version 778300 (0.0008) [2023-12-28 00:50:55,049][106226] Updated weights for policy 0, policy_version 778310 (0.0006) [2023-12-28 00:50:55,111][106226] Updated weights for policy 0, policy_version 778320 (0.0008) [2023-12-28 00:50:55,158][106225] Updated weights for policy 1, policy_version 780465 (0.0010) [2023-12-28 00:50:55,219][106225] Updated weights for policy 1, policy_version 780475 (0.0010) [2023-12-28 00:50:55,269][106225] Updated weights for policy 1, policy_version 780485 (0.0010) [2023-12-28 00:50:55,804][106226] Updated weights for policy 0, policy_version 778330 (0.0008) [2023-12-28 00:50:55,854][106226] Updated weights for policy 0, policy_version 778340 (0.0009) [2023-12-28 00:50:55,911][106226] Updated weights for policy 0, policy_version 778350 (0.0008) [2023-12-28 00:50:55,960][106225] Updated weights for policy 1, policy_version 780495 (0.0010) [2023-12-28 00:50:55,974][106226] Updated weights for policy 0, policy_version 778360 (0.0008) [2023-12-28 00:50:56,017][106225] Updated weights for policy 1, policy_version 780505 (0.0010) [2023-12-28 00:50:56,077][106225] Updated weights for policy 1, policy_version 780515 (0.0010) [2023-12-28 00:50:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 399163392. Throughput: 0: 9739.3, 1: 10024.5. Samples: 399126512. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:50:56,176][105115] Avg episode reward: [(0, '-4.160'), (1, '-5.190')] [2023-12-28 00:50:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000778360_199311360.pth... [2023-12-28 00:50:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000780520_199852032.pth... [2023-12-28 00:50:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000777208_199016448.pth [2023-12-28 00:50:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000779304_199540736.pth [2023-12-28 00:50:56,716][106226] Updated weights for policy 0, policy_version 778370 (0.0010) [2023-12-28 00:50:56,759][106225] Updated weights for policy 1, policy_version 780525 (0.0008) [2023-12-28 00:50:56,782][106226] Updated weights for policy 0, policy_version 778380 (0.0010) [2023-12-28 00:50:56,815][106225] Updated weights for policy 1, policy_version 780535 (0.0005) [2023-12-28 00:50:56,835][106226] Updated weights for policy 0, policy_version 778390 (0.0008) [2023-12-28 00:50:56,870][106225] Updated weights for policy 1, policy_version 780545 (0.0008) [2023-12-28 00:50:57,519][106226] Updated weights for policy 0, policy_version 778400 (0.0007) [2023-12-28 00:50:57,537][106225] Updated weights for policy 1, policy_version 780555 (0.0010) [2023-12-28 00:50:57,569][106226] Updated weights for policy 0, policy_version 778410 (0.0005) [2023-12-28 00:50:57,597][106225] Updated weights for policy 1, policy_version 780565 (0.0010) [2023-12-28 00:50:57,626][106226] Updated weights for policy 0, policy_version 778420 (0.0008) [2023-12-28 00:50:57,656][106225] Updated weights for policy 1, policy_version 780575 (0.0010) [2023-12-28 00:50:58,332][106226] Updated weights for policy 0, policy_version 778430 (0.0009) [2023-12-28 00:50:58,398][106226] Updated weights for policy 0, policy_version 778440 (0.0008) [2023-12-28 00:50:58,414][106225] Updated weights for policy 1, policy_version 780585 (0.0010) [2023-12-28 00:50:58,460][106226] Updated weights for policy 0, policy_version 778450 (0.0009) [2023-12-28 00:50:58,475][106225] Updated weights for policy 1, policy_version 780595 (0.0009) [2023-12-28 00:50:58,522][106225] Updated weights for policy 1, policy_version 780605 (0.0007) [2023-12-28 00:50:58,596][106225] Updated weights for policy 1, policy_version 780615 (0.0008) [2023-12-28 00:50:59,237][106226] Updated weights for policy 0, policy_version 778460 (0.0008) [2023-12-28 00:50:59,304][106226] Updated weights for policy 0, policy_version 778470 (0.0011) [2023-12-28 00:50:59,358][106225] Updated weights for policy 1, policy_version 780625 (0.0008) [2023-12-28 00:50:59,374][106226] Updated weights for policy 0, policy_version 778480 (0.0007) [2023-12-28 00:50:59,421][106225] Updated weights for policy 1, policy_version 780635 (0.0009) [2023-12-28 00:50:59,478][106225] Updated weights for policy 1, policy_version 780645 (0.0010) [2023-12-28 00:51:00,096][106226] Updated weights for policy 0, policy_version 778490 (0.0008) [2023-12-28 00:51:00,154][106226] Updated weights for policy 0, policy_version 778500 (0.0011) [2023-12-28 00:51:00,201][106225] Updated weights for policy 1, policy_version 780655 (0.0008) [2023-12-28 00:51:00,211][106226] Updated weights for policy 0, policy_version 778510 (0.0010) [2023-12-28 00:51:00,252][106225] Updated weights for policy 1, policy_version 780665 (0.0009) [2023-12-28 00:51:00,275][106226] Updated weights for policy 0, policy_version 778520 (0.0008) [2023-12-28 00:51:00,307][106225] Updated weights for policy 1, policy_version 780675 (0.0006) [2023-12-28 00:51:00,940][106225] Updated weights for policy 1, policy_version 780685 (0.0008) [2023-12-28 00:51:00,949][106226] Updated weights for policy 0, policy_version 778530 (0.0005) [2023-12-28 00:51:00,992][106225] Updated weights for policy 1, policy_version 780695 (0.0008) [2023-12-28 00:51:01,001][106226] Updated weights for policy 0, policy_version 778540 (0.0005) [2023-12-28 00:51:01,054][106225] Updated weights for policy 1, policy_version 780705 (0.0010) [2023-12-28 00:51:01,065][106226] Updated weights for policy 0, policy_version 778550 (0.0006) [2023-12-28 00:51:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 399261696. Throughput: 0: 9691.7, 1: 10141.1. Samples: 399244576. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:01,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.134')] [2023-12-28 00:51:01,775][106226] Updated weights for policy 0, policy_version 778560 (0.0008) [2023-12-28 00:51:01,777][106225] Updated weights for policy 1, policy_version 780715 (0.0008) [2023-12-28 00:51:01,829][106225] Updated weights for policy 1, policy_version 780725 (0.0006) [2023-12-28 00:51:01,834][106226] Updated weights for policy 0, policy_version 778570 (0.0007) [2023-12-28 00:51:01,878][106225] Updated weights for policy 1, policy_version 780735 (0.0008) [2023-12-28 00:51:01,894][106226] Updated weights for policy 0, policy_version 778580 (0.0007) [2023-12-28 00:51:02,567][106225] Updated weights for policy 1, policy_version 780745 (0.0007) [2023-12-28 00:51:02,618][106225] Updated weights for policy 1, policy_version 780755 (0.0007) [2023-12-28 00:51:02,624][106226] Updated weights for policy 0, policy_version 778590 (0.0008) [2023-12-28 00:51:02,674][106225] Updated weights for policy 1, policy_version 780765 (0.0008) [2023-12-28 00:51:02,680][106226] Updated weights for policy 0, policy_version 778600 (0.0005) [2023-12-28 00:51:02,730][106225] Updated weights for policy 1, policy_version 780775 (0.0008) [2023-12-28 00:51:02,740][106226] Updated weights for policy 0, policy_version 778610 (0.0006) [2023-12-28 00:51:03,362][106226] Updated weights for policy 0, policy_version 778620 (0.0006) [2023-12-28 00:51:03,386][106225] Updated weights for policy 1, policy_version 780785 (0.0008) [2023-12-28 00:51:03,420][106226] Updated weights for policy 0, policy_version 778630 (0.0006) [2023-12-28 00:51:03,438][106225] Updated weights for policy 1, policy_version 780795 (0.0006) [2023-12-28 00:51:03,475][106226] Updated weights for policy 0, policy_version 778640 (0.0006) [2023-12-28 00:51:03,489][106225] Updated weights for policy 1, policy_version 780805 (0.0006) [2023-12-28 00:51:04,215][106225] Updated weights for policy 1, policy_version 780815 (0.0007) [2023-12-28 00:51:04,251][106226] Updated weights for policy 0, policy_version 778650 (0.0007) [2023-12-28 00:51:04,279][106225] Updated weights for policy 1, policy_version 780825 (0.0007) [2023-12-28 00:51:04,315][106226] Updated weights for policy 0, policy_version 778660 (0.0007) [2023-12-28 00:51:04,347][106225] Updated weights for policy 1, policy_version 780835 (0.0007) [2023-12-28 00:51:04,373][106226] Updated weights for policy 0, policy_version 778670 (0.0007) [2023-12-28 00:51:04,440][106226] Updated weights for policy 0, policy_version 778680 (0.0006) [2023-12-28 00:51:05,078][106225] Updated weights for policy 1, policy_version 780845 (0.0008) [2023-12-28 00:51:05,082][106226] Updated weights for policy 0, policy_version 778690 (0.0007) [2023-12-28 00:51:05,141][106225] Updated weights for policy 1, policy_version 780855 (0.0007) [2023-12-28 00:51:05,150][106226] Updated weights for policy 0, policy_version 778700 (0.0006) [2023-12-28 00:51:05,205][106225] Updated weights for policy 1, policy_version 780865 (0.0008) [2023-12-28 00:51:05,210][106226] Updated weights for policy 0, policy_version 778710 (0.0006) [2023-12-28 00:51:05,852][106226] Updated weights for policy 0, policy_version 778720 (0.0008) [2023-12-28 00:51:05,905][106226] Updated weights for policy 0, policy_version 778730 (0.0009) [2023-12-28 00:51:05,923][106225] Updated weights for policy 1, policy_version 780875 (0.0009) [2023-12-28 00:51:05,953][106226] Updated weights for policy 0, policy_version 778740 (0.0006) [2023-12-28 00:51:05,978][106225] Updated weights for policy 1, policy_version 780885 (0.0006) [2023-12-28 00:51:06,027][106225] Updated weights for policy 1, policy_version 780895 (0.0008) [2023-12-28 00:51:06,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 399360000. Throughput: 0: 9786.1, 1: 10152.7. Samples: 399363936. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:06,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-5.164')] [2023-12-28 00:51:06,707][106226] Updated weights for policy 0, policy_version 778750 (0.0007) [2023-12-28 00:51:06,769][106226] Updated weights for policy 0, policy_version 778760 (0.0008) [2023-12-28 00:51:06,808][106225] Updated weights for policy 1, policy_version 780905 (0.0008) [2023-12-28 00:51:06,825][106226] Updated weights for policy 0, policy_version 778770 (0.0008) [2023-12-28 00:51:06,861][106225] Updated weights for policy 1, policy_version 780915 (0.0007) [2023-12-28 00:51:06,920][106225] Updated weights for policy 1, policy_version 780925 (0.0009) [2023-12-28 00:51:06,978][106225] Updated weights for policy 1, policy_version 780935 (0.0009) [2023-12-28 00:51:07,471][106226] Updated weights for policy 0, policy_version 778780 (0.0007) [2023-12-28 00:51:07,536][106226] Updated weights for policy 0, policy_version 778790 (0.0009) [2023-12-28 00:51:07,599][106226] Updated weights for policy 0, policy_version 778800 (0.0008) [2023-12-28 00:51:07,743][106225] Updated weights for policy 1, policy_version 780945 (0.0008) [2023-12-28 00:51:07,794][106225] Updated weights for policy 1, policy_version 780955 (0.0008) [2023-12-28 00:51:07,856][106225] Updated weights for policy 1, policy_version 780965 (0.0008) [2023-12-28 00:51:08,236][106226] Updated weights for policy 0, policy_version 778810 (0.0008) [2023-12-28 00:51:08,298][106226] Updated weights for policy 0, policy_version 778820 (0.0008) [2023-12-28 00:51:08,368][106226] Updated weights for policy 0, policy_version 778830 (0.0007) [2023-12-28 00:51:08,433][106226] Updated weights for policy 0, policy_version 778840 (0.0007) [2023-12-28 00:51:08,621][106225] Updated weights for policy 1, policy_version 780975 (0.0009) [2023-12-28 00:51:08,678][106225] Updated weights for policy 1, policy_version 780985 (0.0009) [2023-12-28 00:51:08,732][106225] Updated weights for policy 1, policy_version 780995 (0.0008) [2023-12-28 00:51:09,087][106226] Updated weights for policy 0, policy_version 778850 (0.0008) [2023-12-28 00:51:09,142][106226] Updated weights for policy 0, policy_version 778860 (0.0007) [2023-12-28 00:51:09,200][106226] Updated weights for policy 0, policy_version 778870 (0.0008) [2023-12-28 00:51:09,582][106225] Updated weights for policy 1, policy_version 781005 (0.0008) [2023-12-28 00:51:09,633][106225] Updated weights for policy 1, policy_version 781015 (0.0010) [2023-12-28 00:51:09,687][106225] Updated weights for policy 1, policy_version 781025 (0.0009) [2023-12-28 00:51:09,903][106226] Updated weights for policy 0, policy_version 778880 (0.0007) [2023-12-28 00:51:09,972][106226] Updated weights for policy 0, policy_version 778890 (0.0008) [2023-12-28 00:51:10,034][106226] Updated weights for policy 0, policy_version 778900 (0.0008) [2023-12-28 00:51:10,453][106225] Updated weights for policy 1, policy_version 781035 (0.0008) [2023-12-28 00:51:10,503][106225] Updated weights for policy 1, policy_version 781045 (0.0010) [2023-12-28 00:51:10,563][106225] Updated weights for policy 1, policy_version 781055 (0.0008) [2023-12-28 00:51:10,623][106226] Updated weights for policy 0, policy_version 778910 (0.0008) [2023-12-28 00:51:10,680][106226] Updated weights for policy 0, policy_version 778920 (0.0009) [2023-12-28 00:51:10,737][106226] Updated weights for policy 0, policy_version 778930 (0.0009) [2023-12-28 00:51:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 399450112. Throughput: 0: 9824.7, 1: 10148.5. Samples: 399421936. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:11,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-5.002')] [2023-12-28 00:51:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000781064_199991296.pth... [2023-12-28 00:51:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000778936_199458816.pth... [2023-12-28 00:51:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000777816_199172096.pth [2023-12-28 00:51:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000779912_199696384.pth [2023-12-28 00:51:11,370][106225] Updated weights for policy 1, policy_version 781065 (0.0007) [2023-12-28 00:51:11,437][106225] Updated weights for policy 1, policy_version 781075 (0.0011) [2023-12-28 00:51:11,491][106226] Updated weights for policy 0, policy_version 778940 (0.0009) [2023-12-28 00:51:11,496][106225] Updated weights for policy 1, policy_version 781085 (0.0010) [2023-12-28 00:51:11,548][106226] Updated weights for policy 0, policy_version 778950 (0.0009) [2023-12-28 00:51:11,551][106225] Updated weights for policy 1, policy_version 781095 (0.0010) [2023-12-28 00:51:11,597][106226] Updated weights for policy 0, policy_version 778960 (0.0009) [2023-12-28 00:51:12,289][106225] Updated weights for policy 1, policy_version 781105 (0.0010) [2023-12-28 00:51:12,357][106225] Updated weights for policy 1, policy_version 781115 (0.0008) [2023-12-28 00:51:12,412][106226] Updated weights for policy 0, policy_version 778970 (0.0009) [2023-12-28 00:51:12,427][106225] Updated weights for policy 1, policy_version 781125 (0.0008) [2023-12-28 00:51:12,473][106226] Updated weights for policy 0, policy_version 778980 (0.0006) [2023-12-28 00:51:12,539][106226] Updated weights for policy 0, policy_version 778990 (0.0005) [2023-12-28 00:51:12,606][106226] Updated weights for policy 0, policy_version 779000 (0.0007) [2023-12-28 00:51:13,155][106226] Updated weights for policy 0, policy_version 779010 (0.0005) [2023-12-28 00:51:13,195][106225] Updated weights for policy 1, policy_version 781135 (0.0009) [2023-12-28 00:51:13,218][106226] Updated weights for policy 0, policy_version 779020 (0.0005) [2023-12-28 00:51:13,256][106225] Updated weights for policy 1, policy_version 781145 (0.0008) [2023-12-28 00:51:13,275][106226] Updated weights for policy 0, policy_version 779030 (0.0005) [2023-12-28 00:51:13,316][106225] Updated weights for policy 1, policy_version 781155 (0.0009) [2023-12-28 00:51:13,846][106226] Updated weights for policy 0, policy_version 779040 (0.0010) [2023-12-28 00:51:13,911][106226] Updated weights for policy 0, policy_version 779050 (0.0011) [2023-12-28 00:51:13,964][106226] Updated weights for policy 0, policy_version 779060 (0.0010) [2023-12-28 00:51:14,119][106225] Updated weights for policy 1, policy_version 781165 (0.0009) [2023-12-28 00:51:14,184][106225] Updated weights for policy 1, policy_version 781175 (0.0008) [2023-12-28 00:51:14,252][106225] Updated weights for policy 1, policy_version 781185 (0.0010) [2023-12-28 00:51:14,569][106226] Updated weights for policy 0, policy_version 779070 (0.0008) [2023-12-28 00:51:14,625][106226] Updated weights for policy 0, policy_version 779080 (0.0007) [2023-12-28 00:51:14,682][106226] Updated weights for policy 0, policy_version 779090 (0.0010) [2023-12-28 00:51:15,039][106225] Updated weights for policy 1, policy_version 781195 (0.0009) [2023-12-28 00:51:15,093][106225] Updated weights for policy 1, policy_version 781205 (0.0008) [2023-12-28 00:51:15,155][106225] Updated weights for policy 1, policy_version 781215 (0.0008) [2023-12-28 00:51:15,352][106226] Updated weights for policy 0, policy_version 779100 (0.0010) [2023-12-28 00:51:15,407][106226] Updated weights for policy 0, policy_version 779110 (0.0011) [2023-12-28 00:51:15,464][106226] Updated weights for policy 0, policy_version 779120 (0.0010) [2023-12-28 00:51:15,845][106225] Updated weights for policy 1, policy_version 781225 (0.0008) [2023-12-28 00:51:15,904][106225] Updated weights for policy 1, policy_version 781235 (0.0009) [2023-12-28 00:51:15,962][106225] Updated weights for policy 1, policy_version 781245 (0.0008) [2023-12-28 00:51:16,031][106225] Updated weights for policy 1, policy_version 781255 (0.0010) [2023-12-28 00:51:16,055][106226] Updated weights for policy 0, policy_version 779130 (0.0010) [2023-12-28 00:51:16,110][106226] Updated weights for policy 0, policy_version 779140 (0.0005) [2023-12-28 00:51:16,162][106226] Updated weights for policy 0, policy_version 779150 (0.0005) [2023-12-28 00:51:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 399548416. Throughput: 0: 9809.3, 1: 9942.2. Samples: 399538272. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:16,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.109')] [2023-12-28 00:51:16,215][106226] Updated weights for policy 0, policy_version 779160 (0.0007) [2023-12-28 00:51:16,780][106225] Updated weights for policy 1, policy_version 781265 (0.0009) [2023-12-28 00:51:16,818][106226] Updated weights for policy 0, policy_version 779170 (0.0005) [2023-12-28 00:51:16,834][106225] Updated weights for policy 1, policy_version 781275 (0.0008) [2023-12-28 00:51:16,870][106226] Updated weights for policy 0, policy_version 779180 (0.0009) [2023-12-28 00:51:16,881][106225] Updated weights for policy 1, policy_version 781285 (0.0007) [2023-12-28 00:51:16,922][106226] Updated weights for policy 0, policy_version 779190 (0.0011) [2023-12-28 00:51:17,571][106225] Updated weights for policy 1, policy_version 781295 (0.0007) [2023-12-28 00:51:17,618][106225] Updated weights for policy 1, policy_version 781305 (0.0005) [2023-12-28 00:51:17,620][106226] Updated weights for policy 0, policy_version 779200 (0.0007) [2023-12-28 00:51:17,663][106225] Updated weights for policy 1, policy_version 781315 (0.0005) [2023-12-28 00:51:17,671][106226] Updated weights for policy 0, policy_version 779210 (0.0007) [2023-12-28 00:51:17,727][106226] Updated weights for policy 0, policy_version 779220 (0.0009) [2023-12-28 00:51:18,217][106225] Updated weights for policy 1, policy_version 781325 (0.0005) [2023-12-28 00:51:18,271][106225] Updated weights for policy 1, policy_version 781335 (0.0005) [2023-12-28 00:51:18,321][106225] Updated weights for policy 1, policy_version 781345 (0.0006) [2023-12-28 00:51:18,419][106226] Updated weights for policy 0, policy_version 779230 (0.0009) [2023-12-28 00:51:18,478][106226] Updated weights for policy 0, policy_version 779240 (0.0008) [2023-12-28 00:51:18,538][106226] Updated weights for policy 0, policy_version 779250 (0.0009) [2023-12-28 00:51:18,980][106225] Updated weights for policy 1, policy_version 781355 (0.0007) [2023-12-28 00:51:19,034][106225] Updated weights for policy 1, policy_version 781365 (0.0008) [2023-12-28 00:51:19,095][106225] Updated weights for policy 1, policy_version 781375 (0.0007) [2023-12-28 00:51:19,254][106226] Updated weights for policy 0, policy_version 779260 (0.0008) [2023-12-28 00:51:19,318][106226] Updated weights for policy 0, policy_version 779270 (0.0009) [2023-12-28 00:51:19,384][106226] Updated weights for policy 0, policy_version 779280 (0.0009) [2023-12-28 00:51:19,854][106225] Updated weights for policy 1, policy_version 781385 (0.0006) [2023-12-28 00:51:19,917][106225] Updated weights for policy 1, policy_version 781395 (0.0008) [2023-12-28 00:51:19,981][106225] Updated weights for policy 1, policy_version 781405 (0.0007) [2023-12-28 00:51:20,043][106225] Updated weights for policy 1, policy_version 781415 (0.0006) [2023-12-28 00:51:20,281][106226] Updated weights for policy 0, policy_version 779290 (0.0008) [2023-12-28 00:51:20,344][106226] Updated weights for policy 0, policy_version 779300 (0.0008) [2023-12-28 00:51:20,410][106226] Updated weights for policy 0, policy_version 779310 (0.0008) [2023-12-28 00:51:20,474][106226] Updated weights for policy 0, policy_version 779320 (0.0007) [2023-12-28 00:51:20,781][106225] Updated weights for policy 1, policy_version 781425 (0.0009) [2023-12-28 00:51:20,845][106225] Updated weights for policy 1, policy_version 781435 (0.0009) [2023-12-28 00:51:20,907][106225] Updated weights for policy 1, policy_version 781445 (0.0008) [2023-12-28 00:51:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 399646720. Throughput: 0: 9758.0, 1: 9899.4. Samples: 399657984. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:21,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-4.904')] [2023-12-28 00:51:21,181][106226] Updated weights for policy 0, policy_version 779330 (0.0008) [2023-12-28 00:51:21,248][106226] Updated weights for policy 0, policy_version 779340 (0.0008) [2023-12-28 00:51:21,313][106226] Updated weights for policy 0, policy_version 779350 (0.0008) [2023-12-28 00:51:21,700][106225] Updated weights for policy 1, policy_version 781455 (0.0008) [2023-12-28 00:51:21,766][106225] Updated weights for policy 1, policy_version 781465 (0.0010) [2023-12-28 00:51:21,829][106225] Updated weights for policy 1, policy_version 781475 (0.0009) [2023-12-28 00:51:22,050][106226] Updated weights for policy 0, policy_version 779360 (0.0008) [2023-12-28 00:51:22,123][106226] Updated weights for policy 0, policy_version 779370 (0.0010) [2023-12-28 00:51:22,191][106226] Updated weights for policy 0, policy_version 779380 (0.0011) [2023-12-28 00:51:22,597][106225] Updated weights for policy 1, policy_version 781485 (0.0008) [2023-12-28 00:51:22,650][106225] Updated weights for policy 1, policy_version 781495 (0.0008) [2023-12-28 00:51:22,698][106225] Updated weights for policy 1, policy_version 781505 (0.0007) [2023-12-28 00:51:22,810][106226] Updated weights for policy 0, policy_version 779390 (0.0009) [2023-12-28 00:51:22,873][106226] Updated weights for policy 0, policy_version 779400 (0.0008) [2023-12-28 00:51:22,934][106226] Updated weights for policy 0, policy_version 779410 (0.0008) [2023-12-28 00:51:23,465][106225] Updated weights for policy 1, policy_version 781515 (0.0009) [2023-12-28 00:51:23,530][106225] Updated weights for policy 1, policy_version 781525 (0.0009) [2023-12-28 00:51:23,593][106225] Updated weights for policy 1, policy_version 781535 (0.0009) [2023-12-28 00:51:23,673][106226] Updated weights for policy 0, policy_version 779420 (0.0009) [2023-12-28 00:51:23,717][106226] Updated weights for policy 0, policy_version 779430 (0.0008) [2023-12-28 00:51:23,770][106226] Updated weights for policy 0, policy_version 779440 (0.0008) [2023-12-28 00:51:24,294][106225] Updated weights for policy 1, policy_version 781545 (0.0007) [2023-12-28 00:51:24,340][106225] Updated weights for policy 1, policy_version 781555 (0.0007) [2023-12-28 00:51:24,401][106225] Updated weights for policy 1, policy_version 781565 (0.0010) [2023-12-28 00:51:24,461][106225] Updated weights for policy 1, policy_version 781575 (0.0008) [2023-12-28 00:51:24,508][106226] Updated weights for policy 0, policy_version 779450 (0.0008) [2023-12-28 00:51:24,560][106226] Updated weights for policy 0, policy_version 779460 (0.0008) [2023-12-28 00:51:24,620][106226] Updated weights for policy 0, policy_version 779470 (0.0009) [2023-12-28 00:51:24,677][106226] Updated weights for policy 0, policy_version 779480 (0.0009) [2023-12-28 00:51:25,209][106225] Updated weights for policy 1, policy_version 781585 (0.0007) [2023-12-28 00:51:25,266][106225] Updated weights for policy 1, policy_version 781595 (0.0005) [2023-12-28 00:51:25,305][106226] Updated weights for policy 0, policy_version 779490 (0.0011) [2023-12-28 00:51:25,321][106225] Updated weights for policy 1, policy_version 781605 (0.0005) [2023-12-28 00:51:25,349][106226] Updated weights for policy 0, policy_version 779500 (0.0010) [2023-12-28 00:51:25,406][106226] Updated weights for policy 0, policy_version 779510 (0.0010) [2023-12-28 00:51:25,969][106225] Updated weights for policy 1, policy_version 781615 (0.0009) [2023-12-28 00:51:26,026][106225] Updated weights for policy 1, policy_version 781625 (0.0010) [2023-12-28 00:51:26,085][106225] Updated weights for policy 1, policy_version 781635 (0.0010) [2023-12-28 00:51:26,131][106226] Updated weights for policy 0, policy_version 779520 (0.0010) [2023-12-28 00:51:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 399745024. Throughput: 0: 9754.2, 1: 9823.7. Samples: 399713824. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:26,176][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.942')] [2023-12-28 00:51:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000781640_200138752.pth... [2023-12-28 00:51:26,189][106226] Updated weights for policy 0, policy_version 779530 (0.0010) [2023-12-28 00:51:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000780520_199852032.pth [2023-12-28 00:51:26,242][106226] Updated weights for policy 0, policy_version 779540 (0.0010) [2023-12-28 00:51:26,260][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000779544_199614464.pth... [2023-12-28 00:51:26,263][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000778360_199311360.pth [2023-12-28 00:51:26,734][106225] Updated weights for policy 1, policy_version 781645 (0.0009) [2023-12-28 00:51:26,789][106225] Updated weights for policy 1, policy_version 781655 (0.0006) [2023-12-28 00:51:26,849][106225] Updated weights for policy 1, policy_version 781665 (0.0009) [2023-12-28 00:51:26,931][106226] Updated weights for policy 0, policy_version 779550 (0.0007) [2023-12-28 00:51:26,988][106226] Updated weights for policy 0, policy_version 779560 (0.0005) [2023-12-28 00:51:27,045][106226] Updated weights for policy 0, policy_version 779570 (0.0005) [2023-12-28 00:51:27,449][106225] Updated weights for policy 1, policy_version 781675 (0.0008) [2023-12-28 00:51:27,495][106225] Updated weights for policy 1, policy_version 781685 (0.0006) [2023-12-28 00:51:27,555][106225] Updated weights for policy 1, policy_version 781695 (0.0008) [2023-12-28 00:51:27,663][106226] Updated weights for policy 0, policy_version 779580 (0.0007) [2023-12-28 00:51:27,721][106226] Updated weights for policy 0, policy_version 779590 (0.0008) [2023-12-28 00:51:27,786][106226] Updated weights for policy 0, policy_version 779600 (0.0007) [2023-12-28 00:51:28,113][106225] Updated weights for policy 1, policy_version 781705 (0.0006) [2023-12-28 00:51:28,163][106225] Updated weights for policy 1, policy_version 781715 (0.0010) [2023-12-28 00:51:28,219][106225] Updated weights for policy 1, policy_version 781725 (0.0010) [2023-12-28 00:51:28,270][106225] Updated weights for policy 1, policy_version 781735 (0.0006) [2023-12-28 00:51:28,442][106226] Updated weights for policy 0, policy_version 779610 (0.0005) [2023-12-28 00:51:28,504][106226] Updated weights for policy 0, policy_version 779620 (0.0006) [2023-12-28 00:51:28,568][106226] Updated weights for policy 0, policy_version 779630 (0.0007) [2023-12-28 00:51:28,626][106226] Updated weights for policy 0, policy_version 779640 (0.0005) [2023-12-28 00:51:28,984][106225] Updated weights for policy 1, policy_version 781745 (0.0010) [2023-12-28 00:51:29,030][106225] Updated weights for policy 1, policy_version 781755 (0.0010) [2023-12-28 00:51:29,082][106225] Updated weights for policy 1, policy_version 781765 (0.0010) [2023-12-28 00:51:29,214][106226] Updated weights for policy 0, policy_version 779650 (0.0006) [2023-12-28 00:51:29,268][106226] Updated weights for policy 0, policy_version 779660 (0.0008) [2023-12-28 00:51:29,321][106226] Updated weights for policy 0, policy_version 779670 (0.0006) [2023-12-28 00:51:29,865][106225] Updated weights for policy 1, policy_version 781775 (0.0009) [2023-12-28 00:51:29,930][106225] Updated weights for policy 1, policy_version 781785 (0.0008) [2023-12-28 00:51:29,991][106225] Updated weights for policy 1, policy_version 781795 (0.0007) [2023-12-28 00:51:30,107][106226] Updated weights for policy 0, policy_version 779680 (0.0010) [2023-12-28 00:51:30,153][106226] Updated weights for policy 0, policy_version 779690 (0.0010) [2023-12-28 00:51:30,207][106226] Updated weights for policy 0, policy_version 779700 (0.0011) [2023-12-28 00:51:30,722][106225] Updated weights for policy 1, policy_version 781805 (0.0009) [2023-12-28 00:51:30,784][106225] Updated weights for policy 1, policy_version 781815 (0.0005) [2023-12-28 00:51:30,840][106225] Updated weights for policy 1, policy_version 781825 (0.0005) [2023-12-28 00:51:30,930][106226] Updated weights for policy 0, policy_version 779710 (0.0011) [2023-12-28 00:51:30,995][106226] Updated weights for policy 0, policy_version 779720 (0.0010) [2023-12-28 00:51:31,069][106226] Updated weights for policy 0, policy_version 779730 (0.0010) [2023-12-28 00:51:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 399851520. Throughput: 0: 9772.9, 1: 9909.0. Samples: 399838352. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:31,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.203')] [2023-12-28 00:51:31,460][106225] Updated weights for policy 1, policy_version 781835 (0.0006) [2023-12-28 00:51:31,508][106225] Updated weights for policy 1, policy_version 781845 (0.0006) [2023-12-28 00:51:31,571][106225] Updated weights for policy 1, policy_version 781855 (0.0006) [2023-12-28 00:51:31,827][106226] Updated weights for policy 0, policy_version 779740 (0.0011) [2023-12-28 00:51:31,894][106226] Updated weights for policy 0, policy_version 779750 (0.0011) [2023-12-28 00:51:31,958][106226] Updated weights for policy 0, policy_version 779760 (0.0011) [2023-12-28 00:51:32,202][106225] Updated weights for policy 1, policy_version 781865 (0.0007) [2023-12-28 00:51:32,264][106225] Updated weights for policy 1, policy_version 781875 (0.0008) [2023-12-28 00:51:32,326][106225] Updated weights for policy 1, policy_version 781885 (0.0008) [2023-12-28 00:51:32,393][106225] Updated weights for policy 1, policy_version 781895 (0.0008) [2023-12-28 00:51:32,645][106226] Updated weights for policy 0, policy_version 779770 (0.0009) [2023-12-28 00:51:32,707][106226] Updated weights for policy 0, policy_version 779780 (0.0006) [2023-12-28 00:51:32,770][106226] Updated weights for policy 0, policy_version 779790 (0.0009) [2023-12-28 00:51:32,819][106226] Updated weights for policy 0, policy_version 779800 (0.0008) [2023-12-28 00:51:33,149][106225] Updated weights for policy 1, policy_version 781905 (0.0008) [2023-12-28 00:51:33,198][106225] Updated weights for policy 1, policy_version 781915 (0.0009) [2023-12-28 00:51:33,264][106225] Updated weights for policy 1, policy_version 781925 (0.0007) [2023-12-28 00:51:33,435][106226] Updated weights for policy 0, policy_version 779810 (0.0005) [2023-12-28 00:51:33,481][106226] Updated weights for policy 0, policy_version 779820 (0.0005) [2023-12-28 00:51:33,529][106226] Updated weights for policy 0, policy_version 779830 (0.0005) [2023-12-28 00:51:33,920][106225] Updated weights for policy 1, policy_version 781935 (0.0007) [2023-12-28 00:51:33,979][106225] Updated weights for policy 1, policy_version 781945 (0.0006) [2023-12-28 00:51:34,037][106225] Updated weights for policy 1, policy_version 781955 (0.0005) [2023-12-28 00:51:34,268][106226] Updated weights for policy 0, policy_version 779840 (0.0009) [2023-12-28 00:51:34,333][106226] Updated weights for policy 0, policy_version 779850 (0.0009) [2023-12-28 00:51:34,401][106226] Updated weights for policy 0, policy_version 779860 (0.0008) [2023-12-28 00:51:34,686][106225] Updated weights for policy 1, policy_version 781965 (0.0007) [2023-12-28 00:51:34,740][106225] Updated weights for policy 1, policy_version 781975 (0.0009) [2023-12-28 00:51:34,794][106225] Updated weights for policy 1, policy_version 781985 (0.0008) [2023-12-28 00:51:35,065][106226] Updated weights for policy 0, policy_version 779870 (0.0009) [2023-12-28 00:51:35,119][106226] Updated weights for policy 0, policy_version 779880 (0.0007) [2023-12-28 00:51:35,180][106226] Updated weights for policy 0, policy_version 779890 (0.0006) [2023-12-28 00:51:35,530][106225] Updated weights for policy 1, policy_version 781995 (0.0010) [2023-12-28 00:51:35,585][106225] Updated weights for policy 1, policy_version 782005 (0.0011) [2023-12-28 00:51:35,636][106225] Updated weights for policy 1, policy_version 782015 (0.0010) [2023-12-28 00:51:35,783][106226] Updated weights for policy 0, policy_version 779900 (0.0007) [2023-12-28 00:51:35,848][106226] Updated weights for policy 0, policy_version 779910 (0.0006) [2023-12-28 00:51:35,917][106226] Updated weights for policy 0, policy_version 779920 (0.0005) [2023-12-28 00:51:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 399949824. Throughput: 0: 9942.6, 1: 9845.0. Samples: 399959380. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:36,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.236')] [2023-12-28 00:51:36,395][106225] Updated weights for policy 1, policy_version 782025 (0.0010) [2023-12-28 00:51:36,467][106225] Updated weights for policy 1, policy_version 782035 (0.0009) [2023-12-28 00:51:36,470][106226] Updated weights for policy 0, policy_version 779930 (0.0006) [2023-12-28 00:51:36,531][106225] Updated weights for policy 1, policy_version 782045 (0.0007) [2023-12-28 00:51:36,536][106226] Updated weights for policy 0, policy_version 779940 (0.0008) [2023-12-28 00:51:36,600][106225] Updated weights for policy 1, policy_version 782055 (0.0005) [2023-12-28 00:51:36,604][106226] Updated weights for policy 0, policy_version 779950 (0.0008) [2023-12-28 00:51:36,672][106226] Updated weights for policy 0, policy_version 779960 (0.0008) [2023-12-28 00:51:37,237][106225] Updated weights for policy 1, policy_version 782065 (0.0010) [2023-12-28 00:51:37,298][106225] Updated weights for policy 1, policy_version 782075 (0.0009) [2023-12-28 00:51:37,359][106225] Updated weights for policy 1, policy_version 782085 (0.0010) [2023-12-28 00:51:37,384][106226] Updated weights for policy 0, policy_version 779970 (0.0005) [2023-12-28 00:51:37,451][106226] Updated weights for policy 0, policy_version 779980 (0.0010) [2023-12-28 00:51:37,521][106226] Updated weights for policy 0, policy_version 779990 (0.0010) [2023-12-28 00:51:38,028][106225] Updated weights for policy 1, policy_version 782095 (0.0010) [2023-12-28 00:51:38,088][106225] Updated weights for policy 1, policy_version 782105 (0.0010) [2023-12-28 00:51:38,148][106225] Updated weights for policy 1, policy_version 782115 (0.0005) [2023-12-28 00:51:38,151][106226] Updated weights for policy 0, policy_version 780000 (0.0006) [2023-12-28 00:51:38,205][106226] Updated weights for policy 0, policy_version 780010 (0.0007) [2023-12-28 00:51:38,257][106226] Updated weights for policy 0, policy_version 780020 (0.0008) [2023-12-28 00:51:38,732][106225] Updated weights for policy 1, policy_version 782125 (0.0008) [2023-12-28 00:51:38,790][106225] Updated weights for policy 1, policy_version 782135 (0.0010) [2023-12-28 00:51:38,849][106225] Updated weights for policy 1, policy_version 782145 (0.0010) [2023-12-28 00:51:39,016][106226] Updated weights for policy 0, policy_version 780030 (0.0009) [2023-12-28 00:51:39,066][106226] Updated weights for policy 0, policy_version 780040 (0.0007) [2023-12-28 00:51:39,116][106226] Updated weights for policy 0, policy_version 780050 (0.0007) [2023-12-28 00:51:39,557][106225] Updated weights for policy 1, policy_version 782155 (0.0008) [2023-12-28 00:51:39,621][106225] Updated weights for policy 1, policy_version 782165 (0.0009) [2023-12-28 00:51:39,682][106225] Updated weights for policy 1, policy_version 782175 (0.0008) [2023-12-28 00:51:39,908][106226] Updated weights for policy 0, policy_version 780060 (0.0008) [2023-12-28 00:51:39,982][106226] Updated weights for policy 0, policy_version 780070 (0.0009) [2023-12-28 00:51:40,048][106226] Updated weights for policy 0, policy_version 780080 (0.0009) [2023-12-28 00:51:40,448][106225] Updated weights for policy 1, policy_version 782185 (0.0009) [2023-12-28 00:51:40,510][106225] Updated weights for policy 1, policy_version 782195 (0.0008) [2023-12-28 00:51:40,575][106225] Updated weights for policy 1, policy_version 782205 (0.0008) [2023-12-28 00:51:40,635][106225] Updated weights for policy 1, policy_version 782215 (0.0010) [2023-12-28 00:51:40,750][106226] Updated weights for policy 0, policy_version 780090 (0.0008) [2023-12-28 00:51:40,808][106226] Updated weights for policy 0, policy_version 780100 (0.0006) [2023-12-28 00:51:40,857][106226] Updated weights for policy 0, policy_version 780110 (0.0007) [2023-12-28 00:51:40,919][106226] Updated weights for policy 0, policy_version 780120 (0.0005) [2023-12-28 00:51:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 400048128. Throughput: 0: 10016.9, 1: 9849.2. Samples: 400020480. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:41,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.910')] [2023-12-28 00:51:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000782216_200286208.pth... [2023-12-28 00:51:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000780120_199761920.pth... [2023-12-28 00:51:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000778936_199458816.pth [2023-12-28 00:51:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000781064_199991296.pth [2023-12-28 00:51:41,434][106225] Updated weights for policy 1, policy_version 782225 (0.0008) [2023-12-28 00:51:41,496][106225] Updated weights for policy 1, policy_version 782235 (0.0008) [2023-12-28 00:51:41,553][106226] Updated weights for policy 0, policy_version 780130 (0.0007) [2023-12-28 00:51:41,560][106225] Updated weights for policy 1, policy_version 782245 (0.0007) [2023-12-28 00:51:41,631][106226] Updated weights for policy 0, policy_version 780140 (0.0008) [2023-12-28 00:51:41,699][106226] Updated weights for policy 0, policy_version 780150 (0.0008) [2023-12-28 00:51:42,350][106225] Updated weights for policy 1, policy_version 782255 (0.0008) [2023-12-28 00:51:42,419][106225] Updated weights for policy 1, policy_version 782265 (0.0008) [2023-12-28 00:51:42,428][106226] Updated weights for policy 0, policy_version 780160 (0.0009) [2023-12-28 00:51:42,478][106225] Updated weights for policy 1, policy_version 782275 (0.0006) [2023-12-28 00:51:42,483][106226] Updated weights for policy 0, policy_version 780170 (0.0006) [2023-12-28 00:51:42,542][106226] Updated weights for policy 0, policy_version 780180 (0.0007) [2023-12-28 00:51:43,138][106225] Updated weights for policy 1, policy_version 782285 (0.0006) [2023-12-28 00:51:43,198][106225] Updated weights for policy 1, policy_version 782295 (0.0005) [2023-12-28 00:51:43,255][106225] Updated weights for policy 1, policy_version 782305 (0.0006) [2023-12-28 00:51:43,316][106226] Updated weights for policy 0, policy_version 780190 (0.0009) [2023-12-28 00:51:43,368][106226] Updated weights for policy 0, policy_version 780200 (0.0008) [2023-12-28 00:51:43,424][106226] Updated weights for policy 0, policy_version 780210 (0.0008) [2023-12-28 00:51:43,849][106225] Updated weights for policy 1, policy_version 782315 (0.0006) [2023-12-28 00:51:43,898][106225] Updated weights for policy 1, policy_version 782325 (0.0005) [2023-12-28 00:51:43,951][106225] Updated weights for policy 1, policy_version 782335 (0.0005) [2023-12-28 00:51:44,183][106226] Updated weights for policy 0, policy_version 780220 (0.0007) [2023-12-28 00:51:44,234][106226] Updated weights for policy 0, policy_version 780230 (0.0005) [2023-12-28 00:51:44,287][106226] Updated weights for policy 0, policy_version 780240 (0.0005) [2023-12-28 00:51:44,642][106225] Updated weights for policy 1, policy_version 782345 (0.0006) [2023-12-28 00:51:44,699][106225] Updated weights for policy 1, policy_version 782355 (0.0008) [2023-12-28 00:51:44,759][106225] Updated weights for policy 1, policy_version 782365 (0.0008) [2023-12-28 00:51:44,824][106225] Updated weights for policy 1, policy_version 782375 (0.0006) [2023-12-28 00:51:44,936][106226] Updated weights for policy 0, policy_version 780250 (0.0005) [2023-12-28 00:51:45,001][106226] Updated weights for policy 0, policy_version 780260 (0.0006) [2023-12-28 00:51:45,066][106226] Updated weights for policy 0, policy_version 780270 (0.0006) [2023-12-28 00:51:45,127][106226] Updated weights for policy 0, policy_version 780280 (0.0006) [2023-12-28 00:51:45,594][106225] Updated weights for policy 1, policy_version 782385 (0.0010) [2023-12-28 00:51:45,649][106225] Updated weights for policy 1, policy_version 782395 (0.0010) [2023-12-28 00:51:45,695][106225] Updated weights for policy 1, policy_version 782405 (0.0010) [2023-12-28 00:51:45,769][106226] Updated weights for policy 0, policy_version 780290 (0.0005) [2023-12-28 00:51:45,822][106226] Updated weights for policy 0, policy_version 780300 (0.0007) [2023-12-28 00:51:45,877][106226] Updated weights for policy 0, policy_version 780310 (0.0008) [2023-12-28 00:51:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 400146432. Throughput: 0: 10069.3, 1: 9761.1. Samples: 400136944. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:46,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.146')] [2023-12-28 00:51:46,360][106225] Updated weights for policy 1, policy_version 782415 (0.0009) [2023-12-28 00:51:46,417][106225] Updated weights for policy 1, policy_version 782425 (0.0007) [2023-12-28 00:51:46,464][106225] Updated weights for policy 1, policy_version 782435 (0.0005) [2023-12-28 00:51:46,536][106226] Updated weights for policy 0, policy_version 780320 (0.0010) [2023-12-28 00:51:46,606][106226] Updated weights for policy 0, policy_version 780330 (0.0010) [2023-12-28 00:51:46,676][106226] Updated weights for policy 0, policy_version 780340 (0.0010) [2023-12-28 00:51:47,041][106225] Updated weights for policy 1, policy_version 782445 (0.0008) [2023-12-28 00:51:47,099][106225] Updated weights for policy 1, policy_version 782455 (0.0010) [2023-12-28 00:51:47,161][106225] Updated weights for policy 1, policy_version 782465 (0.0010) [2023-12-28 00:51:47,314][106226] Updated weights for policy 0, policy_version 780350 (0.0007) [2023-12-28 00:51:47,369][106226] Updated weights for policy 0, policy_version 780360 (0.0009) [2023-12-28 00:51:47,424][106226] Updated weights for policy 0, policy_version 780370 (0.0010) [2023-12-28 00:51:47,869][106225] Updated weights for policy 1, policy_version 782475 (0.0009) [2023-12-28 00:51:47,937][106225] Updated weights for policy 1, policy_version 782485 (0.0006) [2023-12-28 00:51:47,992][106225] Updated weights for policy 1, policy_version 782495 (0.0006) [2023-12-28 00:51:48,085][106226] Updated weights for policy 0, policy_version 780380 (0.0007) [2023-12-28 00:51:48,139][106226] Updated weights for policy 0, policy_version 780390 (0.0008) [2023-12-28 00:51:48,194][106226] Updated weights for policy 0, policy_version 780400 (0.0009) [2023-12-28 00:51:48,684][106225] Updated weights for policy 1, policy_version 782505 (0.0010) [2023-12-28 00:51:48,747][106225] Updated weights for policy 1, policy_version 782515 (0.0008) [2023-12-28 00:51:48,807][106225] Updated weights for policy 1, policy_version 782525 (0.0008) [2023-12-28 00:51:48,843][106226] Updated weights for policy 0, policy_version 780410 (0.0007) [2023-12-28 00:51:48,865][106225] Updated weights for policy 1, policy_version 782535 (0.0010) [2023-12-28 00:51:48,900][106226] Updated weights for policy 0, policy_version 780420 (0.0011) [2023-12-28 00:51:48,963][106226] Updated weights for policy 0, policy_version 780430 (0.0011) [2023-12-28 00:51:49,027][106226] Updated weights for policy 0, policy_version 780440 (0.0010) [2023-12-28 00:51:49,583][106225] Updated weights for policy 1, policy_version 782545 (0.0010) [2023-12-28 00:51:49,636][106225] Updated weights for policy 1, policy_version 782555 (0.0009) [2023-12-28 00:51:49,690][106225] Updated weights for policy 1, policy_version 782565 (0.0010) [2023-12-28 00:51:49,747][106226] Updated weights for policy 0, policy_version 780450 (0.0011) [2023-12-28 00:51:49,802][106226] Updated weights for policy 0, policy_version 780460 (0.0010) [2023-12-28 00:51:49,865][106226] Updated weights for policy 0, policy_version 780470 (0.0010) [2023-12-28 00:51:50,442][106225] Updated weights for policy 1, policy_version 782575 (0.0010) [2023-12-28 00:51:50,500][106225] Updated weights for policy 1, policy_version 782585 (0.0010) [2023-12-28 00:51:50,549][106226] Updated weights for policy 0, policy_version 780480 (0.0009) [2023-12-28 00:51:50,562][106225] Updated weights for policy 1, policy_version 782595 (0.0010) [2023-12-28 00:51:50,619][106226] Updated weights for policy 0, policy_version 780490 (0.0010) [2023-12-28 00:51:50,683][106226] Updated weights for policy 0, policy_version 780500 (0.0010) [2023-12-28 00:51:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 400244736. Throughput: 0: 10101.4, 1: 9743.3. Samples: 400256948. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:51,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-5.348')] [2023-12-28 00:51:51,320][106225] Updated weights for policy 1, policy_version 782605 (0.0008) [2023-12-28 00:51:51,387][106225] Updated weights for policy 1, policy_version 782615 (0.0009) [2023-12-28 00:51:51,396][106226] Updated weights for policy 0, policy_version 780510 (0.0010) [2023-12-28 00:51:51,450][106225] Updated weights for policy 1, policy_version 782625 (0.0009) [2023-12-28 00:51:51,464][106226] Updated weights for policy 0, policy_version 780520 (0.0008) [2023-12-28 00:51:51,524][106226] Updated weights for policy 0, policy_version 780530 (0.0007) [2023-12-28 00:51:52,139][106225] Updated weights for policy 1, policy_version 782635 (0.0009) [2023-12-28 00:51:52,205][106225] Updated weights for policy 1, policy_version 782645 (0.0006) [2023-12-28 00:51:52,274][106225] Updated weights for policy 1, policy_version 782655 (0.0006) [2023-12-28 00:51:52,300][106226] Updated weights for policy 0, policy_version 780540 (0.0007) [2023-12-28 00:51:52,367][106226] Updated weights for policy 0, policy_version 780550 (0.0006) [2023-12-28 00:51:52,448][106226] Updated weights for policy 0, policy_version 780560 (0.0008) [2023-12-28 00:51:52,914][106225] Updated weights for policy 1, policy_version 782665 (0.0007) [2023-12-28 00:51:52,978][106225] Updated weights for policy 1, policy_version 782675 (0.0009) [2023-12-28 00:51:53,037][106225] Updated weights for policy 1, policy_version 782685 (0.0008) [2023-12-28 00:51:53,089][106225] Updated weights for policy 1, policy_version 782695 (0.0008) [2023-12-28 00:51:53,122][106226] Updated weights for policy 0, policy_version 780570 (0.0008) [2023-12-28 00:51:53,172][106226] Updated weights for policy 0, policy_version 780580 (0.0010) [2023-12-28 00:51:53,224][106226] Updated weights for policy 0, policy_version 780590 (0.0010) [2023-12-28 00:51:53,273][106226] Updated weights for policy 0, policy_version 780600 (0.0010) [2023-12-28 00:51:53,772][106225] Updated weights for policy 1, policy_version 782705 (0.0007) [2023-12-28 00:51:53,830][106225] Updated weights for policy 1, policy_version 782715 (0.0009) [2023-12-28 00:51:53,899][106225] Updated weights for policy 1, policy_version 782725 (0.0010) [2023-12-28 00:51:53,966][106226] Updated weights for policy 0, policy_version 780610 (0.0009) [2023-12-28 00:51:54,017][106226] Updated weights for policy 0, policy_version 780620 (0.0011) [2023-12-28 00:51:54,076][106226] Updated weights for policy 0, policy_version 780630 (0.0006) [2023-12-28 00:51:54,619][106225] Updated weights for policy 1, policy_version 782735 (0.0008) [2023-12-28 00:51:54,665][106225] Updated weights for policy 1, policy_version 782745 (0.0007) [2023-12-28 00:51:54,715][106225] Updated weights for policy 1, policy_version 782755 (0.0008) [2023-12-28 00:51:54,762][106226] Updated weights for policy 0, policy_version 780640 (0.0009) [2023-12-28 00:51:54,821][106226] Updated weights for policy 0, policy_version 780650 (0.0010) [2023-12-28 00:51:54,889][106226] Updated weights for policy 0, policy_version 780660 (0.0009) [2023-12-28 00:51:55,364][106225] Updated weights for policy 1, policy_version 782765 (0.0006) [2023-12-28 00:51:55,413][106225] Updated weights for policy 1, policy_version 782775 (0.0008) [2023-12-28 00:51:55,465][106225] Updated weights for policy 1, policy_version 782785 (0.0007) [2023-12-28 00:51:55,530][106226] Updated weights for policy 0, policy_version 780670 (0.0009) [2023-12-28 00:51:55,585][106226] Updated weights for policy 0, policy_version 780680 (0.0010) [2023-12-28 00:51:55,645][106226] Updated weights for policy 0, policy_version 780690 (0.0010) [2023-12-28 00:51:56,086][106225] Updated weights for policy 1, policy_version 782795 (0.0006) [2023-12-28 00:51:56,136][106225] Updated weights for policy 1, policy_version 782805 (0.0009) [2023-12-28 00:51:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19661.0, 300 sec: 19910.7). Total num frames: 400343040. Throughput: 0: 10064.6, 1: 9808.2. Samples: 400316212. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:51:56,175][105115] Avg episode reward: [(0, '-4.159'), (1, '-5.267')] [2023-12-28 00:51:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000780696_199909376.pth... [2023-12-28 00:51:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000779544_199614464.pth [2023-12-28 00:51:56,192][106225] Updated weights for policy 1, policy_version 782815 (0.0008) [2023-12-28 00:51:56,235][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000782824_200441856.pth... [2023-12-28 00:51:56,239][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000781640_200138752.pth [2023-12-28 00:51:56,367][106226] Updated weights for policy 0, policy_version 780700 (0.0010) [2023-12-28 00:51:56,429][106226] Updated weights for policy 0, policy_version 780710 (0.0008) [2023-12-28 00:51:56,492][106226] Updated weights for policy 0, policy_version 780720 (0.0008) [2023-12-28 00:51:56,903][106225] Updated weights for policy 1, policy_version 782825 (0.0008) [2023-12-28 00:51:56,953][106225] Updated weights for policy 1, policy_version 782835 (0.0005) [2023-12-28 00:51:57,004][106225] Updated weights for policy 1, policy_version 782845 (0.0005) [2023-12-28 00:51:57,054][106225] Updated weights for policy 1, policy_version 782855 (0.0005) [2023-12-28 00:51:57,174][106226] Updated weights for policy 0, policy_version 780730 (0.0008) [2023-12-28 00:51:57,223][106226] Updated weights for policy 0, policy_version 780740 (0.0005) [2023-12-28 00:51:57,271][106226] Updated weights for policy 0, policy_version 780750 (0.0005) [2023-12-28 00:51:57,319][106226] Updated weights for policy 0, policy_version 780760 (0.0005) [2023-12-28 00:51:57,592][106225] Updated weights for policy 1, policy_version 782865 (0.0008) [2023-12-28 00:51:57,645][106225] Updated weights for policy 1, policy_version 782875 (0.0008) [2023-12-28 00:51:57,698][106225] Updated weights for policy 1, policy_version 782885 (0.0009) [2023-12-28 00:51:57,935][106226] Updated weights for policy 0, policy_version 780770 (0.0008) [2023-12-28 00:51:57,984][106226] Updated weights for policy 0, policy_version 780780 (0.0009) [2023-12-28 00:51:58,033][106226] Updated weights for policy 0, policy_version 780790 (0.0008) [2023-12-28 00:51:58,424][106225] Updated weights for policy 1, policy_version 782895 (0.0009) [2023-12-28 00:51:58,488][106225] Updated weights for policy 1, policy_version 782905 (0.0008) [2023-12-28 00:51:58,552][106225] Updated weights for policy 1, policy_version 782915 (0.0007) [2023-12-28 00:51:58,877][106226] Updated weights for policy 0, policy_version 780800 (0.0008) [2023-12-28 00:51:58,947][106226] Updated weights for policy 0, policy_version 780810 (0.0009) [2023-12-28 00:51:59,003][106226] Updated weights for policy 0, policy_version 780820 (0.0009) [2023-12-28 00:51:59,366][106225] Updated weights for policy 1, policy_version 782925 (0.0008) [2023-12-28 00:51:59,431][106225] Updated weights for policy 1, policy_version 782935 (0.0007) [2023-12-28 00:51:59,490][106225] Updated weights for policy 1, policy_version 782945 (0.0006) [2023-12-28 00:51:59,754][106226] Updated weights for policy 0, policy_version 780830 (0.0009) [2023-12-28 00:51:59,825][106226] Updated weights for policy 0, policy_version 780840 (0.0008) [2023-12-28 00:51:59,896][106226] Updated weights for policy 0, policy_version 780850 (0.0008) [2023-12-28 00:52:00,123][106225] Updated weights for policy 1, policy_version 782955 (0.0007) [2023-12-28 00:52:00,175][106225] Updated weights for policy 1, policy_version 782965 (0.0008) [2023-12-28 00:52:00,232][106225] Updated weights for policy 1, policy_version 782975 (0.0008) [2023-12-28 00:52:00,651][106226] Updated weights for policy 0, policy_version 780860 (0.0007) [2023-12-28 00:52:00,696][106226] Updated weights for policy 0, policy_version 780870 (0.0005) [2023-12-28 00:52:00,745][106226] Updated weights for policy 0, policy_version 780880 (0.0005) [2023-12-28 00:52:00,847][106225] Updated weights for policy 1, policy_version 782985 (0.0005) [2023-12-28 00:52:00,908][106225] Updated weights for policy 1, policy_version 782995 (0.0008) [2023-12-28 00:52:00,970][106225] Updated weights for policy 1, policy_version 783005 (0.0006) [2023-12-28 00:52:01,022][106225] Updated weights for policy 1, policy_version 783015 (0.0005) [2023-12-28 00:52:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 400449536. Throughput: 0: 9957.3, 1: 9971.4. Samples: 400435064. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:01,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-5.205')] [2023-12-28 00:52:01,380][106226] Updated weights for policy 0, policy_version 780890 (0.0006) [2023-12-28 00:52:01,446][106226] Updated weights for policy 0, policy_version 780900 (0.0006) [2023-12-28 00:52:01,516][106226] Updated weights for policy 0, policy_version 780910 (0.0007) [2023-12-28 00:52:01,576][106226] Updated weights for policy 0, policy_version 780920 (0.0008) [2023-12-28 00:52:01,738][106225] Updated weights for policy 1, policy_version 783025 (0.0010) [2023-12-28 00:52:01,802][106225] Updated weights for policy 1, policy_version 783035 (0.0008) [2023-12-28 00:52:01,864][106225] Updated weights for policy 1, policy_version 783045 (0.0010) [2023-12-28 00:52:02,282][106226] Updated weights for policy 0, policy_version 780930 (0.0007) [2023-12-28 00:52:02,345][106226] Updated weights for policy 0, policy_version 780940 (0.0008) [2023-12-28 00:52:02,400][106226] Updated weights for policy 0, policy_version 780950 (0.0008) [2023-12-28 00:52:02,513][106225] Updated weights for policy 1, policy_version 783055 (0.0009) [2023-12-28 00:52:02,582][106225] Updated weights for policy 1, policy_version 783065 (0.0009) [2023-12-28 00:52:02,644][106225] Updated weights for policy 1, policy_version 783075 (0.0008) [2023-12-28 00:52:03,118][106226] Updated weights for policy 0, policy_version 780960 (0.0010) [2023-12-28 00:52:03,179][106226] Updated weights for policy 0, policy_version 780970 (0.0008) [2023-12-28 00:52:03,238][106226] Updated weights for policy 0, policy_version 780980 (0.0008) [2023-12-28 00:52:03,276][106225] Updated weights for policy 1, policy_version 783085 (0.0009) [2023-12-28 00:52:03,336][106225] Updated weights for policy 1, policy_version 783095 (0.0010) [2023-12-28 00:52:03,386][106225] Updated weights for policy 1, policy_version 783105 (0.0010) [2023-12-28 00:52:03,895][106226] Updated weights for policy 0, policy_version 780990 (0.0007) [2023-12-28 00:52:03,950][106226] Updated weights for policy 0, policy_version 781000 (0.0008) [2023-12-28 00:52:04,015][106226] Updated weights for policy 0, policy_version 781010 (0.0006) [2023-12-28 00:52:04,057][106225] Updated weights for policy 1, policy_version 783115 (0.0010) [2023-12-28 00:52:04,119][106225] Updated weights for policy 1, policy_version 783125 (0.0008) [2023-12-28 00:52:04,183][106225] Updated weights for policy 1, policy_version 783135 (0.0008) [2023-12-28 00:52:04,616][106226] Updated weights for policy 0, policy_version 781020 (0.0005) [2023-12-28 00:52:04,672][106226] Updated weights for policy 0, policy_version 781030 (0.0005) [2023-12-28 00:52:04,728][106226] Updated weights for policy 0, policy_version 781040 (0.0005) [2023-12-28 00:52:04,971][106225] Updated weights for policy 1, policy_version 783145 (0.0009) [2023-12-28 00:52:05,022][106225] Updated weights for policy 1, policy_version 783155 (0.0008) [2023-12-28 00:52:05,066][106225] Updated weights for policy 1, policy_version 783165 (0.0008) [2023-12-28 00:52:05,115][106225] Updated weights for policy 1, policy_version 783175 (0.0008) [2023-12-28 00:52:05,390][106226] Updated weights for policy 0, policy_version 781050 (0.0008) [2023-12-28 00:52:05,454][106226] Updated weights for policy 0, policy_version 781060 (0.0010) [2023-12-28 00:52:05,519][106226] Updated weights for policy 0, policy_version 781070 (0.0008) [2023-12-28 00:52:05,574][106226] Updated weights for policy 0, policy_version 781080 (0.0008) [2023-12-28 00:52:05,861][106225] Updated weights for policy 1, policy_version 783185 (0.0006) [2023-12-28 00:52:05,925][106225] Updated weights for policy 1, policy_version 783195 (0.0006) [2023-12-28 00:52:05,992][106225] Updated weights for policy 1, policy_version 783205 (0.0006) [2023-12-28 00:52:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 400547840. Throughput: 0: 9986.0, 1: 9988.1. Samples: 400556816. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:06,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.244')] [2023-12-28 00:52:06,249][106226] Updated weights for policy 0, policy_version 781090 (0.0008) [2023-12-28 00:52:06,314][106226] Updated weights for policy 0, policy_version 781100 (0.0009) [2023-12-28 00:52:06,374][106226] Updated weights for policy 0, policy_version 781110 (0.0010) [2023-12-28 00:52:06,673][106225] Updated weights for policy 1, policy_version 783215 (0.0006) [2023-12-28 00:52:06,734][106225] Updated weights for policy 1, policy_version 783225 (0.0010) [2023-12-28 00:52:06,792][106225] Updated weights for policy 1, policy_version 783235 (0.0010) [2023-12-28 00:52:07,085][106226] Updated weights for policy 0, policy_version 781120 (0.0005) [2023-12-28 00:52:07,153][106226] Updated weights for policy 0, policy_version 781130 (0.0009) [2023-12-28 00:52:07,216][106226] Updated weights for policy 0, policy_version 781140 (0.0010) [2023-12-28 00:52:07,502][106225] Updated weights for policy 1, policy_version 783245 (0.0010) [2023-12-28 00:52:07,558][106225] Updated weights for policy 1, policy_version 783255 (0.0010) [2023-12-28 00:52:07,608][106225] Updated weights for policy 1, policy_version 783265 (0.0010) [2023-12-28 00:52:07,866][106226] Updated weights for policy 0, policy_version 781150 (0.0010) [2023-12-28 00:52:07,922][106226] Updated weights for policy 0, policy_version 781160 (0.0010) [2023-12-28 00:52:07,978][106226] Updated weights for policy 0, policy_version 781170 (0.0010) [2023-12-28 00:52:08,353][106225] Updated weights for policy 1, policy_version 783275 (0.0010) [2023-12-28 00:52:08,415][106225] Updated weights for policy 1, policy_version 783285 (0.0011) [2023-12-28 00:52:08,480][106225] Updated weights for policy 1, policy_version 783295 (0.0006) [2023-12-28 00:52:08,711][106226] Updated weights for policy 0, policy_version 781180 (0.0010) [2023-12-28 00:52:08,775][106226] Updated weights for policy 0, policy_version 781190 (0.0010) [2023-12-28 00:52:08,837][106226] Updated weights for policy 0, policy_version 781200 (0.0010) [2023-12-28 00:52:09,142][106225] Updated weights for policy 1, policy_version 783305 (0.0006) [2023-12-28 00:52:09,192][106225] Updated weights for policy 1, policy_version 783315 (0.0007) [2023-12-28 00:52:09,252][106225] Updated weights for policy 1, policy_version 783325 (0.0008) [2023-12-28 00:52:09,322][106225] Updated weights for policy 1, policy_version 783335 (0.0009) [2023-12-28 00:52:09,554][106226] Updated weights for policy 0, policy_version 781210 (0.0010) [2023-12-28 00:52:09,619][106226] Updated weights for policy 0, policy_version 781220 (0.0011) [2023-12-28 00:52:09,680][106226] Updated weights for policy 0, policy_version 781230 (0.0007) [2023-12-28 00:52:09,746][106226] Updated weights for policy 0, policy_version 781240 (0.0006) [2023-12-28 00:52:10,086][106225] Updated weights for policy 1, policy_version 783345 (0.0009) [2023-12-28 00:52:10,145][106225] Updated weights for policy 1, policy_version 783355 (0.0006) [2023-12-28 00:52:10,214][106225] Updated weights for policy 1, policy_version 783365 (0.0006) [2023-12-28 00:52:10,454][106226] Updated weights for policy 0, policy_version 781250 (0.0010) [2023-12-28 00:52:10,517][106226] Updated weights for policy 0, policy_version 781260 (0.0009) [2023-12-28 00:52:10,590][106226] Updated weights for policy 0, policy_version 781270 (0.0010) [2023-12-28 00:52:10,805][106225] Updated weights for policy 1, policy_version 783375 (0.0008) [2023-12-28 00:52:10,855][106225] Updated weights for policy 1, policy_version 783385 (0.0008) [2023-12-28 00:52:10,914][106225] Updated weights for policy 1, policy_version 783395 (0.0008) [2023-12-28 00:52:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 400646144. Throughput: 0: 10005.5, 1: 10047.9. Samples: 400616220. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:11,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-5.071')] [2023-12-28 00:52:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000783400_200589312.pth... [2023-12-28 00:52:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000781272_200056832.pth... [2023-12-28 00:52:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000782216_200286208.pth [2023-12-28 00:52:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000780120_199761920.pth [2023-12-28 00:52:11,442][106226] Updated weights for policy 0, policy_version 781280 (0.0008) [2023-12-28 00:52:11,494][106226] Updated weights for policy 0, policy_version 781290 (0.0009) [2023-12-28 00:52:11,546][106226] Updated weights for policy 0, policy_version 781300 (0.0008) [2023-12-28 00:52:11,681][106225] Updated weights for policy 1, policy_version 783405 (0.0007) [2023-12-28 00:52:11,744][106225] Updated weights for policy 1, policy_version 783415 (0.0009) [2023-12-28 00:52:11,815][106225] Updated weights for policy 1, policy_version 783425 (0.0009) [2023-12-28 00:52:12,331][106226] Updated weights for policy 0, policy_version 781310 (0.0009) [2023-12-28 00:52:12,411][106226] Updated weights for policy 0, policy_version 781320 (0.0009) [2023-12-28 00:52:12,463][106226] Updated weights for policy 0, policy_version 781330 (0.0006) [2023-12-28 00:52:12,562][106225] Updated weights for policy 1, policy_version 783435 (0.0008) [2023-12-28 00:52:12,620][106225] Updated weights for policy 1, policy_version 783445 (0.0010) [2023-12-28 00:52:12,683][106225] Updated weights for policy 1, policy_version 783455 (0.0009) [2023-12-28 00:52:13,146][106226] Updated weights for policy 0, policy_version 781340 (0.0006) [2023-12-28 00:52:13,202][106226] Updated weights for policy 0, policy_version 781350 (0.0008) [2023-12-28 00:52:13,261][106226] Updated weights for policy 0, policy_version 781360 (0.0005) [2023-12-28 00:52:13,327][106225] Updated weights for policy 1, policy_version 783465 (0.0010) [2023-12-28 00:52:13,389][106225] Updated weights for policy 1, policy_version 783475 (0.0007) [2023-12-28 00:52:13,452][106225] Updated weights for policy 1, policy_version 783485 (0.0009) [2023-12-28 00:52:13,495][106225] Updated weights for policy 1, policy_version 783495 (0.0008) [2023-12-28 00:52:13,927][106226] Updated weights for policy 0, policy_version 781370 (0.0006) [2023-12-28 00:52:13,977][106226] Updated weights for policy 0, policy_version 781380 (0.0009) [2023-12-28 00:52:14,022][106226] Updated weights for policy 0, policy_version 781390 (0.0008) [2023-12-28 00:52:14,071][106226] Updated weights for policy 0, policy_version 781400 (0.0008) [2023-12-28 00:52:14,200][106225] Updated weights for policy 1, policy_version 783505 (0.0008) [2023-12-28 00:52:14,258][106225] Updated weights for policy 1, policy_version 783515 (0.0008) [2023-12-28 00:52:14,312][106225] Updated weights for policy 1, policy_version 783525 (0.0008) [2023-12-28 00:52:14,807][106226] Updated weights for policy 0, policy_version 781410 (0.0007) [2023-12-28 00:52:14,869][106226] Updated weights for policy 0, policy_version 781420 (0.0008) [2023-12-28 00:52:14,931][106226] Updated weights for policy 0, policy_version 781430 (0.0009) [2023-12-28 00:52:15,034][106225] Updated weights for policy 1, policy_version 783535 (0.0006) [2023-12-28 00:52:15,088][106225] Updated weights for policy 1, policy_version 783545 (0.0006) [2023-12-28 00:52:15,147][106225] Updated weights for policy 1, policy_version 783555 (0.0008) [2023-12-28 00:52:15,672][106226] Updated weights for policy 0, policy_version 781440 (0.0009) [2023-12-28 00:52:15,718][106226] Updated weights for policy 0, policy_version 781450 (0.0006) [2023-12-28 00:52:15,770][106226] Updated weights for policy 0, policy_version 781460 (0.0005) [2023-12-28 00:52:15,838][106225] Updated weights for policy 1, policy_version 783565 (0.0006) [2023-12-28 00:52:15,886][106225] Updated weights for policy 1, policy_version 783575 (0.0005) [2023-12-28 00:52:15,932][106225] Updated weights for policy 1, policy_version 783585 (0.0005) [2023-12-28 00:52:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 400744448. Throughput: 0: 9894.4, 1: 9972.9. Samples: 400732380. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:16,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.188')] [2023-12-28 00:52:16,329][106226] Updated weights for policy 0, policy_version 781470 (0.0005) [2023-12-28 00:52:16,392][106226] Updated weights for policy 0, policy_version 781480 (0.0008) [2023-12-28 00:52:16,456][106226] Updated weights for policy 0, policy_version 781490 (0.0008) [2023-12-28 00:52:16,485][106225] Updated weights for policy 1, policy_version 783595 (0.0006) [2023-12-28 00:52:16,534][106225] Updated weights for policy 1, policy_version 783605 (0.0005) [2023-12-28 00:52:16,585][106225] Updated weights for policy 1, policy_version 783615 (0.0005) [2023-12-28 00:52:17,153][106226] Updated weights for policy 0, policy_version 781500 (0.0008) [2023-12-28 00:52:17,195][106225] Updated weights for policy 1, policy_version 783625 (0.0006) [2023-12-28 00:52:17,211][106226] Updated weights for policy 0, policy_version 781510 (0.0011) [2023-12-28 00:52:17,247][106225] Updated weights for policy 1, policy_version 783635 (0.0007) [2023-12-28 00:52:17,272][106226] Updated weights for policy 0, policy_version 781520 (0.0011) [2023-12-28 00:52:17,302][106225] Updated weights for policy 1, policy_version 783645 (0.0006) [2023-12-28 00:52:17,355][106225] Updated weights for policy 1, policy_version 783655 (0.0008) [2023-12-28 00:52:17,939][106225] Updated weights for policy 1, policy_version 783665 (0.0009) [2023-12-28 00:52:17,957][106226] Updated weights for policy 0, policy_version 781530 (0.0011) [2023-12-28 00:52:18,001][106225] Updated weights for policy 1, policy_version 783675 (0.0006) [2023-12-28 00:52:18,014][106226] Updated weights for policy 0, policy_version 781540 (0.0010) [2023-12-28 00:52:18,066][106225] Updated weights for policy 1, policy_version 783685 (0.0006) [2023-12-28 00:52:18,078][106226] Updated weights for policy 0, policy_version 781550 (0.0010) [2023-12-28 00:52:18,131][106226] Updated weights for policy 0, policy_version 781560 (0.0010) [2023-12-28 00:52:18,799][106225] Updated weights for policy 1, policy_version 783695 (0.0007) [2023-12-28 00:52:18,824][106226] Updated weights for policy 0, policy_version 781570 (0.0011) [2023-12-28 00:52:18,853][106225] Updated weights for policy 1, policy_version 783705 (0.0006) [2023-12-28 00:52:18,872][106226] Updated weights for policy 0, policy_version 781580 (0.0010) [2023-12-28 00:52:18,906][106225] Updated weights for policy 1, policy_version 783715 (0.0006) [2023-12-28 00:52:18,933][106226] Updated weights for policy 0, policy_version 781590 (0.0011) [2023-12-28 00:52:19,675][106225] Updated weights for policy 1, policy_version 783725 (0.0008) [2023-12-28 00:52:19,708][106226] Updated weights for policy 0, policy_version 781600 (0.0011) [2023-12-28 00:52:19,741][106225] Updated weights for policy 1, policy_version 783735 (0.0008) [2023-12-28 00:52:19,772][106226] Updated weights for policy 0, policy_version 781610 (0.0009) [2023-12-28 00:52:19,808][106225] Updated weights for policy 1, policy_version 783745 (0.0007) [2023-12-28 00:52:19,847][106226] Updated weights for policy 0, policy_version 781620 (0.0011) [2023-12-28 00:52:20,510][106226] Updated weights for policy 0, policy_version 781630 (0.0007) [2023-12-28 00:52:20,564][106225] Updated weights for policy 1, policy_version 783755 (0.0014) [2023-12-28 00:52:20,575][106226] Updated weights for policy 0, policy_version 781640 (0.0007) [2023-12-28 00:52:20,631][106225] Updated weights for policy 1, policy_version 783765 (0.0008) [2023-12-28 00:52:20,642][106226] Updated weights for policy 0, policy_version 781650 (0.0008) [2023-12-28 00:52:20,692][106225] Updated weights for policy 1, policy_version 783775 (0.0010) [2023-12-28 00:52:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 400842752. Throughput: 0: 9871.1, 1: 10001.4. Samples: 400853644. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:21,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.974')] [2023-12-28 00:52:21,411][106226] Updated weights for policy 0, policy_version 781660 (0.0008) [2023-12-28 00:52:21,465][106225] Updated weights for policy 1, policy_version 783785 (0.0011) [2023-12-28 00:52:21,479][106226] Updated weights for policy 0, policy_version 781670 (0.0011) [2023-12-28 00:52:21,529][106225] Updated weights for policy 1, policy_version 783795 (0.0010) [2023-12-28 00:52:21,540][106226] Updated weights for policy 0, policy_version 781680 (0.0008) [2023-12-28 00:52:21,585][106225] Updated weights for policy 1, policy_version 783805 (0.0010) [2023-12-28 00:52:21,652][106225] Updated weights for policy 1, policy_version 783815 (0.0009) [2023-12-28 00:52:22,312][106226] Updated weights for policy 0, policy_version 781690 (0.0006) [2023-12-28 00:52:22,379][106225] Updated weights for policy 1, policy_version 783825 (0.0011) [2023-12-28 00:52:22,389][106226] Updated weights for policy 0, policy_version 781700 (0.0009) [2023-12-28 00:52:22,440][106225] Updated weights for policy 1, policy_version 783835 (0.0007) [2023-12-28 00:52:22,452][106226] Updated weights for policy 0, policy_version 781710 (0.0011) [2023-12-28 00:52:22,504][106225] Updated weights for policy 1, policy_version 783845 (0.0008) [2023-12-28 00:52:22,515][106226] Updated weights for policy 0, policy_version 781720 (0.0010) [2023-12-28 00:52:23,220][106225] Updated weights for policy 1, policy_version 783855 (0.0008) [2023-12-28 00:52:23,238][106226] Updated weights for policy 0, policy_version 781730 (0.0011) [2023-12-28 00:52:23,275][106225] Updated weights for policy 1, policy_version 783865 (0.0006) [2023-12-28 00:52:23,295][106226] Updated weights for policy 0, policy_version 781740 (0.0008) [2023-12-28 00:52:23,329][106225] Updated weights for policy 1, policy_version 783875 (0.0008) [2023-12-28 00:52:23,350][106226] Updated weights for policy 0, policy_version 781750 (0.0005) [2023-12-28 00:52:23,876][106226] Updated weights for policy 0, policy_version 781760 (0.0005) [2023-12-28 00:52:23,931][106226] Updated weights for policy 0, policy_version 781770 (0.0010) [2023-12-28 00:52:23,978][106226] Updated weights for policy 0, policy_version 781780 (0.0010) [2023-12-28 00:52:24,059][106225] Updated weights for policy 1, policy_version 783885 (0.0009) [2023-12-28 00:52:24,109][106225] Updated weights for policy 1, policy_version 783895 (0.0010) [2023-12-28 00:52:24,163][106225] Updated weights for policy 1, policy_version 783905 (0.0010) [2023-12-28 00:52:24,583][106226] Updated weights for policy 0, policy_version 781790 (0.0008) [2023-12-28 00:52:24,648][106226] Updated weights for policy 0, policy_version 781800 (0.0005) [2023-12-28 00:52:24,700][106226] Updated weights for policy 0, policy_version 781810 (0.0005) [2023-12-28 00:52:24,756][106225] Updated weights for policy 1, policy_version 783915 (0.0009) [2023-12-28 00:52:24,823][106225] Updated weights for policy 1, policy_version 783925 (0.0006) [2023-12-28 00:52:24,880][106225] Updated weights for policy 1, policy_version 783935 (0.0010) [2023-12-28 00:52:25,245][106226] Updated weights for policy 0, policy_version 781820 (0.0007) [2023-12-28 00:52:25,301][106226] Updated weights for policy 0, policy_version 781830 (0.0010) [2023-12-28 00:52:25,361][106226] Updated weights for policy 0, policy_version 781840 (0.0010) [2023-12-28 00:52:25,515][106225] Updated weights for policy 1, policy_version 783945 (0.0010) [2023-12-28 00:52:25,576][106225] Updated weights for policy 1, policy_version 783955 (0.0010) [2023-12-28 00:52:25,634][106225] Updated weights for policy 1, policy_version 783965 (0.0008) [2023-12-28 00:52:25,685][106225] Updated weights for policy 1, policy_version 783975 (0.0007) [2023-12-28 00:52:25,982][106226] Updated weights for policy 0, policy_version 781850 (0.0006) [2023-12-28 00:52:26,033][106226] Updated weights for policy 0, policy_version 781860 (0.0010) [2023-12-28 00:52:26,083][106226] Updated weights for policy 0, policy_version 781870 (0.0010) [2023-12-28 00:52:26,140][106226] Updated weights for policy 0, policy_version 781880 (0.0010) [2023-12-28 00:52:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 400949248. Throughput: 0: 9866.7, 1: 9936.9. Samples: 400911644. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 00:52:26,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-5.071')] [2023-12-28 00:52:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000783976_200736768.pth... [2023-12-28 00:52:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000781880_200212480.pth... [2023-12-28 00:52:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000782824_200441856.pth [2023-12-28 00:52:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000780696_199909376.pth [2023-12-28 00:52:26,414][106225] Updated weights for policy 1, policy_version 783985 (0.0008) [2023-12-28 00:52:26,463][106225] Updated weights for policy 1, policy_version 783995 (0.0007) [2023-12-28 00:52:26,516][106225] Updated weights for policy 1, policy_version 784005 (0.0007) [2023-12-28 00:52:26,854][106226] Updated weights for policy 0, policy_version 781890 (0.0010) [2023-12-28 00:52:26,910][106226] Updated weights for policy 0, policy_version 781900 (0.0010) [2023-12-28 00:52:26,959][106226] Updated weights for policy 0, policy_version 781910 (0.0010) [2023-12-28 00:52:27,237][106225] Updated weights for policy 1, policy_version 784015 (0.0008) [2023-12-28 00:52:27,287][106225] Updated weights for policy 1, policy_version 784025 (0.0009) [2023-12-28 00:52:27,345][106225] Updated weights for policy 1, policy_version 784035 (0.0007) [2023-12-28 00:52:27,616][106226] Updated weights for policy 0, policy_version 781920 (0.0006) [2023-12-28 00:52:27,675][106226] Updated weights for policy 0, policy_version 781930 (0.0005) [2023-12-28 00:52:27,734][106226] Updated weights for policy 0, policy_version 781940 (0.0005) [2023-12-28 00:52:28,045][106225] Updated weights for policy 1, policy_version 784045 (0.0007) [2023-12-28 00:52:28,095][106225] Updated weights for policy 1, policy_version 784055 (0.0009) [2023-12-28 00:52:28,152][106225] Updated weights for policy 1, policy_version 784065 (0.0006) [2023-12-28 00:52:28,358][106226] Updated weights for policy 0, policy_version 781950 (0.0009) [2023-12-28 00:52:28,425][106226] Updated weights for policy 0, policy_version 781960 (0.0010) [2023-12-28 00:52:28,488][106226] Updated weights for policy 0, policy_version 781970 (0.0008) [2023-12-28 00:52:28,821][106225] Updated weights for policy 1, policy_version 784075 (0.0006) [2023-12-28 00:52:28,877][106225] Updated weights for policy 1, policy_version 784085 (0.0007) [2023-12-28 00:52:28,935][106225] Updated weights for policy 1, policy_version 784095 (0.0008) [2023-12-28 00:52:29,170][106226] Updated weights for policy 0, policy_version 781980 (0.0010) [2023-12-28 00:52:29,234][106226] Updated weights for policy 0, policy_version 781990 (0.0010) [2023-12-28 00:52:29,298][106226] Updated weights for policy 0, policy_version 782000 (0.0008) [2023-12-28 00:52:29,621][106225] Updated weights for policy 1, policy_version 784105 (0.0008) [2023-12-28 00:52:29,682][106225] Updated weights for policy 1, policy_version 784115 (0.0010) [2023-12-28 00:52:29,733][106225] Updated weights for policy 1, policy_version 784125 (0.0010) [2023-12-28 00:52:29,788][106225] Updated weights for policy 1, policy_version 784135 (0.0010) [2023-12-28 00:52:30,026][106226] Updated weights for policy 0, policy_version 782010 (0.0008) [2023-12-28 00:52:30,076][106226] Updated weights for policy 0, policy_version 782020 (0.0010) [2023-12-28 00:52:30,137][106226] Updated weights for policy 0, policy_version 782030 (0.0008) [2023-12-28 00:52:30,197][106226] Updated weights for policy 0, policy_version 782040 (0.0007) [2023-12-28 00:52:30,570][106225] Updated weights for policy 1, policy_version 784145 (0.0008) [2023-12-28 00:52:30,631][106225] Updated weights for policy 1, policy_version 784155 (0.0008) [2023-12-28 00:52:30,680][106225] Updated weights for policy 1, policy_version 784165 (0.0009) [2023-12-28 00:52:30,821][106226] Updated weights for policy 0, policy_version 782050 (0.0006) [2023-12-28 00:52:30,880][106226] Updated weights for policy 0, policy_version 782060 (0.0009) [2023-12-28 00:52:30,928][106226] Updated weights for policy 0, policy_version 782070 (0.0006) [2023-12-28 00:52:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 401047552. Throughput: 0: 9984.8, 1: 10014.3. Samples: 401036904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:31,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.219')] [2023-12-28 00:52:31,457][106225] Updated weights for policy 1, policy_version 784175 (0.0006) [2023-12-28 00:52:31,524][106225] Updated weights for policy 1, policy_version 784185 (0.0006) [2023-12-28 00:52:31,586][106225] Updated weights for policy 1, policy_version 784195 (0.0006) [2023-12-28 00:52:31,638][106226] Updated weights for policy 0, policy_version 782080 (0.0008) [2023-12-28 00:52:31,703][106226] Updated weights for policy 0, policy_version 782090 (0.0009) [2023-12-28 00:52:31,777][106226] Updated weights for policy 0, policy_version 782100 (0.0008) [2023-12-28 00:52:32,284][106225] Updated weights for policy 1, policy_version 784205 (0.0007) [2023-12-28 00:52:32,341][106225] Updated weights for policy 1, policy_version 784215 (0.0008) [2023-12-28 00:52:32,407][106225] Updated weights for policy 1, policy_version 784225 (0.0007) [2023-12-28 00:52:32,479][106226] Updated weights for policy 0, policy_version 782110 (0.0008) [2023-12-28 00:52:32,540][106226] Updated weights for policy 0, policy_version 782120 (0.0008) [2023-12-28 00:52:32,593][106226] Updated weights for policy 0, policy_version 782130 (0.0009) [2023-12-28 00:52:33,124][106225] Updated weights for policy 1, policy_version 784235 (0.0006) [2023-12-28 00:52:33,195][106225] Updated weights for policy 1, policy_version 784245 (0.0009) [2023-12-28 00:52:33,249][106225] Updated weights for policy 1, policy_version 784255 (0.0008) [2023-12-28 00:52:33,272][106226] Updated weights for policy 0, policy_version 782140 (0.0009) [2023-12-28 00:52:33,323][106226] Updated weights for policy 0, policy_version 782150 (0.0008) [2023-12-28 00:52:33,370][106226] Updated weights for policy 0, policy_version 782160 (0.0008) [2023-12-28 00:52:33,984][106225] Updated weights for policy 1, policy_version 784265 (0.0009) [2023-12-28 00:52:34,029][106226] Updated weights for policy 0, policy_version 782170 (0.0008) [2023-12-28 00:52:34,046][106225] Updated weights for policy 1, policy_version 784275 (0.0009) [2023-12-28 00:52:34,084][106226] Updated weights for policy 0, policy_version 782180 (0.0007) [2023-12-28 00:52:34,097][106225] Updated weights for policy 1, policy_version 784285 (0.0008) [2023-12-28 00:52:34,142][106226] Updated weights for policy 0, policy_version 782190 (0.0006) [2023-12-28 00:52:34,156][106225] Updated weights for policy 1, policy_version 784295 (0.0007) [2023-12-28 00:52:34,207][106226] Updated weights for policy 0, policy_version 782200 (0.0006) [2023-12-28 00:52:34,826][106225] Updated weights for policy 1, policy_version 784305 (0.0009) [2023-12-28 00:52:34,881][106225] Updated weights for policy 1, policy_version 784315 (0.0008) [2023-12-28 00:52:34,892][106226] Updated weights for policy 0, policy_version 782210 (0.0006) [2023-12-28 00:52:34,941][106225] Updated weights for policy 1, policy_version 784325 (0.0005) [2023-12-28 00:52:34,942][106226] Updated weights for policy 0, policy_version 782220 (0.0007) [2023-12-28 00:52:34,996][106226] Updated weights for policy 0, policy_version 782230 (0.0007) [2023-12-28 00:52:35,511][106225] Updated weights for policy 1, policy_version 784335 (0.0006) [2023-12-28 00:52:35,557][106225] Updated weights for policy 1, policy_version 784345 (0.0005) [2023-12-28 00:52:35,615][106225] Updated weights for policy 1, policy_version 784355 (0.0005) [2023-12-28 00:52:35,708][106226] Updated weights for policy 0, policy_version 782240 (0.0010) [2023-12-28 00:52:35,770][106226] Updated weights for policy 0, policy_version 782250 (0.0009) [2023-12-28 00:52:35,828][106226] Updated weights for policy 0, policy_version 782260 (0.0009) [2023-12-28 00:52:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 401145856. Throughput: 0: 9958.8, 1: 10014.8. Samples: 401155756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:36,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.095')] [2023-12-28 00:52:36,222][106225] Updated weights for policy 1, policy_version 784365 (0.0005) [2023-12-28 00:52:36,294][106225] Updated weights for policy 1, policy_version 784375 (0.0007) [2023-12-28 00:52:36,359][106225] Updated weights for policy 1, policy_version 784385 (0.0009) [2023-12-28 00:52:36,564][106226] Updated weights for policy 0, policy_version 782270 (0.0009) [2023-12-28 00:52:36,626][106226] Updated weights for policy 0, policy_version 782280 (0.0009) [2023-12-28 00:52:36,683][106226] Updated weights for policy 0, policy_version 782290 (0.0009) [2023-12-28 00:52:36,979][106225] Updated weights for policy 1, policy_version 784395 (0.0009) [2023-12-28 00:52:37,054][106225] Updated weights for policy 1, policy_version 784405 (0.0009) [2023-12-28 00:52:37,123][106225] Updated weights for policy 1, policy_version 784415 (0.0009) [2023-12-28 00:52:37,372][106226] Updated weights for policy 0, policy_version 782300 (0.0009) [2023-12-28 00:52:37,439][106226] Updated weights for policy 0, policy_version 782310 (0.0009) [2023-12-28 00:52:37,502][106226] Updated weights for policy 0, policy_version 782320 (0.0009) [2023-12-28 00:52:37,804][106225] Updated weights for policy 1, policy_version 784425 (0.0008) [2023-12-28 00:52:37,859][106225] Updated weights for policy 1, policy_version 784435 (0.0009) [2023-12-28 00:52:37,904][106225] Updated weights for policy 1, policy_version 784445 (0.0008) [2023-12-28 00:52:37,949][106225] Updated weights for policy 1, policy_version 784455 (0.0009) [2023-12-28 00:52:38,233][106226] Updated weights for policy 0, policy_version 782330 (0.0009) [2023-12-28 00:52:38,297][106226] Updated weights for policy 0, policy_version 782340 (0.0009) [2023-12-28 00:52:38,370][106226] Updated weights for policy 0, policy_version 782350 (0.0009) [2023-12-28 00:52:38,436][106226] Updated weights for policy 0, policy_version 782360 (0.0008) [2023-12-28 00:52:38,676][106225] Updated weights for policy 1, policy_version 784465 (0.0008) [2023-12-28 00:52:38,734][106225] Updated weights for policy 1, policy_version 784475 (0.0010) [2023-12-28 00:52:38,792][106225] Updated weights for policy 1, policy_version 784485 (0.0010) [2023-12-28 00:52:39,224][106226] Updated weights for policy 0, policy_version 782370 (0.0008) [2023-12-28 00:52:39,291][106226] Updated weights for policy 0, policy_version 782380 (0.0009) [2023-12-28 00:52:39,354][106226] Updated weights for policy 0, policy_version 782390 (0.0009) [2023-12-28 00:52:39,535][106225] Updated weights for policy 1, policy_version 784495 (0.0009) [2023-12-28 00:52:39,603][106225] Updated weights for policy 1, policy_version 784505 (0.0009) [2023-12-28 00:52:39,668][106225] Updated weights for policy 1, policy_version 784515 (0.0008) [2023-12-28 00:52:40,167][106226] Updated weights for policy 0, policy_version 782400 (0.0010) [2023-12-28 00:52:40,234][106226] Updated weights for policy 0, policy_version 782410 (0.0010) [2023-12-28 00:52:40,307][106226] Updated weights for policy 0, policy_version 782420 (0.0008) [2023-12-28 00:52:40,410][106225] Updated weights for policy 1, policy_version 784525 (0.0009) [2023-12-28 00:52:40,475][106225] Updated weights for policy 1, policy_version 784535 (0.0011) [2023-12-28 00:52:40,537][106225] Updated weights for policy 1, policy_version 784545 (0.0011) [2023-12-28 00:52:41,156][106226] Updated weights for policy 0, policy_version 782430 (0.0009) [2023-12-28 00:52:41,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 401235968. Throughput: 0: 9950.9, 1: 10032.6. Samples: 401215472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:41,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-5.099')] [2023-12-28 00:52:41,185][106225] Updated weights for policy 1, policy_version 784555 (0.0007) [2023-12-28 00:52:41,215][106226] Updated weights for policy 0, policy_version 782440 (0.0007) [2023-12-28 00:52:41,245][106225] Updated weights for policy 1, policy_version 784565 (0.0009) [2023-12-28 00:52:41,281][106226] Updated weights for policy 0, policy_version 782450 (0.0007) [2023-12-28 00:52:41,303][106225] Updated weights for policy 1, policy_version 784575 (0.0009) [2023-12-28 00:52:41,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000782456_200359936.pth... [2023-12-28 00:52:41,319][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000781272_200056832.pth [2023-12-28 00:52:41,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000784584_200892416.pth... [2023-12-28 00:52:41,366][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000783400_200589312.pth [2023-12-28 00:52:42,049][106225] Updated weights for policy 1, policy_version 784585 (0.0010) [2023-12-28 00:52:42,088][106226] Updated weights for policy 0, policy_version 782460 (0.0006) [2023-12-28 00:52:42,111][106225] Updated weights for policy 1, policy_version 784595 (0.0007) [2023-12-28 00:52:42,141][106226] Updated weights for policy 0, policy_version 782470 (0.0009) [2023-12-28 00:52:42,164][106225] Updated weights for policy 1, policy_version 784605 (0.0006) [2023-12-28 00:52:42,201][106226] Updated weights for policy 0, policy_version 782480 (0.0009) [2023-12-28 00:52:42,220][106225] Updated weights for policy 1, policy_version 784615 (0.0008) [2023-12-28 00:52:42,839][106225] Updated weights for policy 1, policy_version 784625 (0.0009) [2023-12-28 00:52:42,895][106225] Updated weights for policy 1, policy_version 784635 (0.0009) [2023-12-28 00:52:42,946][106225] Updated weights for policy 1, policy_version 784645 (0.0009) [2023-12-28 00:52:42,978][106226] Updated weights for policy 0, policy_version 782490 (0.0008) [2023-12-28 00:52:43,038][106226] Updated weights for policy 0, policy_version 782500 (0.0008) [2023-12-28 00:52:43,097][106226] Updated weights for policy 0, policy_version 782510 (0.0010) [2023-12-28 00:52:43,163][106226] Updated weights for policy 0, policy_version 782520 (0.0011) [2023-12-28 00:52:43,611][106225] Updated weights for policy 1, policy_version 784655 (0.0009) [2023-12-28 00:52:43,666][106225] Updated weights for policy 1, policy_version 784665 (0.0008) [2023-12-28 00:52:43,724][106225] Updated weights for policy 1, policy_version 784675 (0.0008) [2023-12-28 00:52:43,839][106226] Updated weights for policy 0, policy_version 782530 (0.0009) [2023-12-28 00:52:43,889][106226] Updated weights for policy 0, policy_version 782540 (0.0009) [2023-12-28 00:52:43,937][106226] Updated weights for policy 0, policy_version 782550 (0.0008) [2023-12-28 00:52:44,372][106225] Updated weights for policy 1, policy_version 784685 (0.0008) [2023-12-28 00:52:44,417][106225] Updated weights for policy 1, policy_version 784695 (0.0005) [2023-12-28 00:52:44,469][106225] Updated weights for policy 1, policy_version 784705 (0.0006) [2023-12-28 00:52:44,622][106226] Updated weights for policy 0, policy_version 782560 (0.0009) [2023-12-28 00:52:44,682][106226] Updated weights for policy 0, policy_version 782570 (0.0009) [2023-12-28 00:52:44,729][106226] Updated weights for policy 0, policy_version 782580 (0.0008) [2023-12-28 00:52:45,091][106225] Updated weights for policy 1, policy_version 784715 (0.0005) [2023-12-28 00:52:45,154][106225] Updated weights for policy 1, policy_version 784725 (0.0008) [2023-12-28 00:52:45,203][106225] Updated weights for policy 1, policy_version 784735 (0.0009) [2023-12-28 00:52:45,436][106226] Updated weights for policy 0, policy_version 782590 (0.0006) [2023-12-28 00:52:45,505][106226] Updated weights for policy 0, policy_version 782600 (0.0006) [2023-12-28 00:52:45,570][106226] Updated weights for policy 0, policy_version 782610 (0.0007) [2023-12-28 00:52:45,967][106225] Updated weights for policy 1, policy_version 784745 (0.0009) [2023-12-28 00:52:46,030][106225] Updated weights for policy 1, policy_version 784755 (0.0008) [2023-12-28 00:52:46,084][106225] Updated weights for policy 1, policy_version 784765 (0.0008) [2023-12-28 00:52:46,138][106225] Updated weights for policy 1, policy_version 784775 (0.0008) [2023-12-28 00:52:46,153][106226] Updated weights for policy 0, policy_version 782620 (0.0006) [2023-12-28 00:52:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 401342464. Throughput: 0: 9885.4, 1: 10028.4. Samples: 401331184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:46,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.817')] [2023-12-28 00:52:46,219][106226] Updated weights for policy 0, policy_version 782630 (0.0005) [2023-12-28 00:52:46,281][106226] Updated weights for policy 0, policy_version 782640 (0.0005) [2023-12-28 00:52:46,888][106226] Updated weights for policy 0, policy_version 782650 (0.0007) [2023-12-28 00:52:46,900][106225] Updated weights for policy 1, policy_version 784785 (0.0006) [2023-12-28 00:52:46,947][106226] Updated weights for policy 0, policy_version 782660 (0.0009) [2023-12-28 00:52:46,962][106225] Updated weights for policy 1, policy_version 784795 (0.0007) [2023-12-28 00:52:47,003][106226] Updated weights for policy 0, policy_version 782670 (0.0007) [2023-12-28 00:52:47,009][106225] Updated weights for policy 1, policy_version 784805 (0.0006) [2023-12-28 00:52:47,062][106226] Updated weights for policy 0, policy_version 782680 (0.0008) [2023-12-28 00:52:47,688][106225] Updated weights for policy 1, policy_version 784815 (0.0006) [2023-12-28 00:52:47,740][106225] Updated weights for policy 1, policy_version 784825 (0.0005) [2023-12-28 00:52:47,797][106225] Updated weights for policy 1, policy_version 784835 (0.0006) [2023-12-28 00:52:47,819][106226] Updated weights for policy 0, policy_version 782690 (0.0006) [2023-12-28 00:52:47,874][106226] Updated weights for policy 0, policy_version 782700 (0.0009) [2023-12-28 00:52:47,937][106226] Updated weights for policy 0, policy_version 782710 (0.0011) [2023-12-28 00:52:48,424][106225] Updated weights for policy 1, policy_version 784845 (0.0009) [2023-12-28 00:52:48,477][106225] Updated weights for policy 1, policy_version 784855 (0.0008) [2023-12-28 00:52:48,530][106225] Updated weights for policy 1, policy_version 784865 (0.0007) [2023-12-28 00:52:48,685][106226] Updated weights for policy 0, policy_version 782720 (0.0011) [2023-12-28 00:52:48,743][106226] Updated weights for policy 0, policy_version 782730 (0.0010) [2023-12-28 00:52:48,808][106226] Updated weights for policy 0, policy_version 782740 (0.0011) [2023-12-28 00:52:49,308][106225] Updated weights for policy 1, policy_version 784875 (0.0007) [2023-12-28 00:52:49,372][106225] Updated weights for policy 1, policy_version 784885 (0.0007) [2023-12-28 00:52:49,439][106225] Updated weights for policy 1, policy_version 784895 (0.0008) [2023-12-28 00:52:49,493][106226] Updated weights for policy 0, policy_version 782750 (0.0011) [2023-12-28 00:52:49,543][106226] Updated weights for policy 0, policy_version 782760 (0.0010) [2023-12-28 00:52:49,590][106226] Updated weights for policy 0, policy_version 782770 (0.0010) [2023-12-28 00:52:50,052][106225] Updated weights for policy 1, policy_version 784905 (0.0008) [2023-12-28 00:52:50,112][106225] Updated weights for policy 1, policy_version 784915 (0.0007) [2023-12-28 00:52:50,170][106225] Updated weights for policy 1, policy_version 784925 (0.0007) [2023-12-28 00:52:50,231][106225] Updated weights for policy 1, policy_version 784935 (0.0006) [2023-12-28 00:52:50,306][106226] Updated weights for policy 0, policy_version 782780 (0.0010) [2023-12-28 00:52:50,361][106226] Updated weights for policy 0, policy_version 782790 (0.0011) [2023-12-28 00:52:50,431][106226] Updated weights for policy 0, policy_version 782800 (0.0008) [2023-12-28 00:52:50,969][106225] Updated weights for policy 1, policy_version 784945 (0.0008) [2023-12-28 00:52:51,031][106225] Updated weights for policy 1, policy_version 784955 (0.0008) [2023-12-28 00:52:51,086][106225] Updated weights for policy 1, policy_version 784965 (0.0007) [2023-12-28 00:52:51,119][106226] Updated weights for policy 0, policy_version 782810 (0.0006) [2023-12-28 00:52:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 401440768. Throughput: 0: 9869.2, 1: 10007.6. Samples: 401451276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:51,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-5.322')] [2023-12-28 00:52:51,189][106226] Updated weights for policy 0, policy_version 782820 (0.0008) [2023-12-28 00:52:51,254][106226] Updated weights for policy 0, policy_version 782830 (0.0008) [2023-12-28 00:52:51,318][106226] Updated weights for policy 0, policy_version 782840 (0.0006) [2023-12-28 00:52:51,832][106225] Updated weights for policy 1, policy_version 784975 (0.0009) [2023-12-28 00:52:51,896][106225] Updated weights for policy 1, policy_version 784985 (0.0008) [2023-12-28 00:52:51,954][106225] Updated weights for policy 1, policy_version 784995 (0.0008) [2023-12-28 00:52:51,983][106226] Updated weights for policy 0, policy_version 782850 (0.0007) [2023-12-28 00:52:52,043][106226] Updated weights for policy 0, policy_version 782860 (0.0007) [2023-12-28 00:52:52,093][106226] Updated weights for policy 0, policy_version 782870 (0.0008) [2023-12-28 00:52:52,631][106225] Updated weights for policy 1, policy_version 785005 (0.0007) [2023-12-28 00:52:52,689][106225] Updated weights for policy 1, policy_version 785015 (0.0007) [2023-12-28 00:52:52,752][106225] Updated weights for policy 1, policy_version 785025 (0.0007) [2023-12-28 00:52:52,798][106226] Updated weights for policy 0, policy_version 782880 (0.0009) [2023-12-28 00:52:52,850][106226] Updated weights for policy 0, policy_version 782890 (0.0008) [2023-12-28 00:52:52,899][106226] Updated weights for policy 0, policy_version 782900 (0.0008) [2023-12-28 00:52:53,421][106225] Updated weights for policy 1, policy_version 785035 (0.0007) [2023-12-28 00:52:53,478][106225] Updated weights for policy 1, policy_version 785045 (0.0010) [2023-12-28 00:52:53,539][106225] Updated weights for policy 1, policy_version 785055 (0.0006) [2023-12-28 00:52:53,657][106226] Updated weights for policy 0, policy_version 782910 (0.0008) [2023-12-28 00:52:53,705][106226] Updated weights for policy 0, policy_version 782920 (0.0008) [2023-12-28 00:52:53,755][106226] Updated weights for policy 0, policy_version 782930 (0.0008) [2023-12-28 00:52:54,172][106225] Updated weights for policy 1, policy_version 785065 (0.0006) [2023-12-28 00:52:54,227][106225] Updated weights for policy 1, policy_version 785075 (0.0010) [2023-12-28 00:52:54,284][106225] Updated weights for policy 1, policy_version 785085 (0.0010) [2023-12-28 00:52:54,334][106225] Updated weights for policy 1, policy_version 785095 (0.0010) [2023-12-28 00:52:54,523][106226] Updated weights for policy 0, policy_version 782940 (0.0009) [2023-12-28 00:52:54,583][106226] Updated weights for policy 0, policy_version 782950 (0.0010) [2023-12-28 00:52:54,639][106226] Updated weights for policy 0, policy_version 782960 (0.0009) [2023-12-28 00:52:55,059][106225] Updated weights for policy 1, policy_version 785105 (0.0006) [2023-12-28 00:52:55,109][106225] Updated weights for policy 1, policy_version 785115 (0.0005) [2023-12-28 00:52:55,164][106225] Updated weights for policy 1, policy_version 785125 (0.0006) [2023-12-28 00:52:55,289][106226] Updated weights for policy 0, policy_version 782970 (0.0006) [2023-12-28 00:52:55,349][106226] Updated weights for policy 0, policy_version 782980 (0.0010) [2023-12-28 00:52:55,396][106226] Updated weights for policy 0, policy_version 782990 (0.0010) [2023-12-28 00:52:55,455][106226] Updated weights for policy 0, policy_version 783000 (0.0010) [2023-12-28 00:52:55,735][106225] Updated weights for policy 1, policy_version 785135 (0.0006) [2023-12-28 00:52:55,802][106225] Updated weights for policy 1, policy_version 785145 (0.0005) [2023-12-28 00:52:55,867][106225] Updated weights for policy 1, policy_version 785155 (0.0005) [2023-12-28 00:52:56,164][106226] Updated weights for policy 0, policy_version 783010 (0.0005) [2023-12-28 00:52:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 401539072. Throughput: 0: 9849.6, 1: 10003.2. Samples: 401509596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:52:56,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-5.208')] [2023-12-28 00:52:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000785160_201039872.pth... [2023-12-28 00:52:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000783976_200736768.pth [2023-12-28 00:52:56,226][106226] Updated weights for policy 0, policy_version 783020 (0.0008) [2023-12-28 00:52:56,282][106226] Updated weights for policy 0, policy_version 783030 (0.0010) [2023-12-28 00:52:56,291][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000783032_200507392.pth... [2023-12-28 00:52:56,295][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000781880_200212480.pth [2023-12-28 00:52:56,401][106225] Updated weights for policy 1, policy_version 785165 (0.0008) [2023-12-28 00:52:56,455][106225] Updated weights for policy 1, policy_version 785175 (0.0010) [2023-12-28 00:52:56,505][106225] Updated weights for policy 1, policy_version 785185 (0.0010) [2023-12-28 00:52:56,853][106226] Updated weights for policy 0, policy_version 783040 (0.0010) [2023-12-28 00:52:56,902][106226] Updated weights for policy 0, policy_version 783050 (0.0010) [2023-12-28 00:52:56,947][106226] Updated weights for policy 0, policy_version 783060 (0.0010) [2023-12-28 00:52:57,222][106225] Updated weights for policy 1, policy_version 785195 (0.0010) [2023-12-28 00:52:57,281][106225] Updated weights for policy 1, policy_version 785205 (0.0010) [2023-12-28 00:52:57,345][106225] Updated weights for policy 1, policy_version 785215 (0.0010) [2023-12-28 00:52:57,674][106226] Updated weights for policy 0, policy_version 783070 (0.0009) [2023-12-28 00:52:57,732][106226] Updated weights for policy 0, policy_version 783080 (0.0009) [2023-12-28 00:52:57,782][106226] Updated weights for policy 0, policy_version 783090 (0.0008) [2023-12-28 00:52:57,985][106225] Updated weights for policy 1, policy_version 785225 (0.0010) [2023-12-28 00:52:58,032][106225] Updated weights for policy 1, policy_version 785235 (0.0010) [2023-12-28 00:52:58,078][106225] Updated weights for policy 1, policy_version 785245 (0.0010) [2023-12-28 00:52:58,128][106225] Updated weights for policy 1, policy_version 785255 (0.0010) [2023-12-28 00:52:58,535][106226] Updated weights for policy 0, policy_version 783100 (0.0008) [2023-12-28 00:52:58,606][106226] Updated weights for policy 0, policy_version 783110 (0.0009) [2023-12-28 00:52:58,675][106226] Updated weights for policy 0, policy_version 783120 (0.0007) [2023-12-28 00:52:58,904][106225] Updated weights for policy 1, policy_version 785265 (0.0007) [2023-12-28 00:52:58,971][106225] Updated weights for policy 1, policy_version 785275 (0.0008) [2023-12-28 00:52:59,035][106225] Updated weights for policy 1, policy_version 785285 (0.0008) [2023-12-28 00:52:59,445][106226] Updated weights for policy 0, policy_version 783130 (0.0008) [2023-12-28 00:52:59,501][106226] Updated weights for policy 0, policy_version 783140 (0.0009) [2023-12-28 00:52:59,556][106226] Updated weights for policy 0, policy_version 783150 (0.0008) [2023-12-28 00:52:59,615][106226] Updated weights for policy 0, policy_version 783160 (0.0008) [2023-12-28 00:52:59,757][106225] Updated weights for policy 1, policy_version 785295 (0.0007) [2023-12-28 00:52:59,819][106225] Updated weights for policy 1, policy_version 785305 (0.0008) [2023-12-28 00:52:59,887][106225] Updated weights for policy 1, policy_version 785315 (0.0007) [2023-12-28 00:53:00,330][106226] Updated weights for policy 0, policy_version 783170 (0.0008) [2023-12-28 00:53:00,389][106226] Updated weights for policy 0, policy_version 783180 (0.0011) [2023-12-28 00:53:00,443][106226] Updated weights for policy 0, policy_version 783190 (0.0008) [2023-12-28 00:53:00,551][106225] Updated weights for policy 1, policy_version 785325 (0.0008) [2023-12-28 00:53:00,603][106225] Updated weights for policy 1, policy_version 785335 (0.0008) [2023-12-28 00:53:00,654][106225] Updated weights for policy 1, policy_version 785345 (0.0008) [2023-12-28 00:53:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 401637376. Throughput: 0: 9904.3, 1: 10069.9. Samples: 401631220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:01,175][105115] Avg episode reward: [(0, '-4.162'), (1, '-5.381')] [2023-12-28 00:53:01,176][106226] Updated weights for policy 0, policy_version 783200 (0.0009) [2023-12-28 00:53:01,239][106226] Updated weights for policy 0, policy_version 783210 (0.0008) [2023-12-28 00:53:01,305][106226] Updated weights for policy 0, policy_version 783220 (0.0008) [2023-12-28 00:53:01,426][106225] Updated weights for policy 1, policy_version 785355 (0.0007) [2023-12-28 00:53:01,495][106225] Updated weights for policy 1, policy_version 785365 (0.0005) [2023-12-28 00:53:01,562][106225] Updated weights for policy 1, policy_version 785375 (0.0007) [2023-12-28 00:53:01,977][106226] Updated weights for policy 0, policy_version 783230 (0.0008) [2023-12-28 00:53:02,039][106226] Updated weights for policy 0, policy_version 783240 (0.0008) [2023-12-28 00:53:02,097][106226] Updated weights for policy 0, policy_version 783250 (0.0007) [2023-12-28 00:53:02,249][106225] Updated weights for policy 1, policy_version 785385 (0.0009) [2023-12-28 00:53:02,312][106225] Updated weights for policy 1, policy_version 785395 (0.0008) [2023-12-28 00:53:02,381][106225] Updated weights for policy 1, policy_version 785405 (0.0008) [2023-12-28 00:53:02,445][106225] Updated weights for policy 1, policy_version 785415 (0.0007) [2023-12-28 00:53:02,845][106226] Updated weights for policy 0, policy_version 783260 (0.0009) [2023-12-28 00:53:02,906][106226] Updated weights for policy 0, policy_version 783270 (0.0011) [2023-12-28 00:53:02,967][106226] Updated weights for policy 0, policy_version 783280 (0.0011) [2023-12-28 00:53:03,214][106225] Updated weights for policy 1, policy_version 785425 (0.0007) [2023-12-28 00:53:03,266][106225] Updated weights for policy 1, policy_version 785435 (0.0009) [2023-12-28 00:53:03,322][106225] Updated weights for policy 1, policy_version 785445 (0.0007) [2023-12-28 00:53:03,562][106226] Updated weights for policy 0, policy_version 783290 (0.0008) [2023-12-28 00:53:03,607][106226] Updated weights for policy 0, policy_version 783300 (0.0005) [2023-12-28 00:53:03,660][106226] Updated weights for policy 0, policy_version 783310 (0.0005) [2023-12-28 00:53:03,716][106226] Updated weights for policy 0, policy_version 783320 (0.0006) [2023-12-28 00:53:04,074][106225] Updated weights for policy 1, policy_version 785455 (0.0008) [2023-12-28 00:53:04,136][106225] Updated weights for policy 1, policy_version 785465 (0.0007) [2023-12-28 00:53:04,201][106225] Updated weights for policy 1, policy_version 785475 (0.0007) [2023-12-28 00:53:04,384][106226] Updated weights for policy 0, policy_version 783330 (0.0010) [2023-12-28 00:53:04,434][106226] Updated weights for policy 0, policy_version 783340 (0.0010) [2023-12-28 00:53:04,499][106226] Updated weights for policy 0, policy_version 783350 (0.0010) [2023-12-28 00:53:04,813][106225] Updated weights for policy 1, policy_version 785485 (0.0007) [2023-12-28 00:53:04,869][106225] Updated weights for policy 1, policy_version 785495 (0.0005) [2023-12-28 00:53:04,928][106225] Updated weights for policy 1, policy_version 785505 (0.0005) [2023-12-28 00:53:05,157][106226] Updated weights for policy 0, policy_version 783360 (0.0006) [2023-12-28 00:53:05,212][106226] Updated weights for policy 0, policy_version 783370 (0.0010) [2023-12-28 00:53:05,263][106226] Updated weights for policy 0, policy_version 783380 (0.0010) [2023-12-28 00:53:05,513][106225] Updated weights for policy 1, policy_version 785515 (0.0006) [2023-12-28 00:53:05,569][106225] Updated weights for policy 1, policy_version 785525 (0.0007) [2023-12-28 00:53:05,624][106225] Updated weights for policy 1, policy_version 785535 (0.0007) [2023-12-28 00:53:05,942][106226] Updated weights for policy 0, policy_version 783390 (0.0010) [2023-12-28 00:53:06,003][106226] Updated weights for policy 0, policy_version 783400 (0.0008) [2023-12-28 00:53:06,073][106226] Updated weights for policy 0, policy_version 783410 (0.0009) [2023-12-28 00:53:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 401743872. Throughput: 0: 9907.6, 1: 10021.8. Samples: 401750468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:06,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-5.281')] [2023-12-28 00:53:06,354][106225] Updated weights for policy 1, policy_version 785545 (0.0008) [2023-12-28 00:53:06,413][106225] Updated weights for policy 1, policy_version 785555 (0.0008) [2023-12-28 00:53:06,479][106225] Updated weights for policy 1, policy_version 785565 (0.0008) [2023-12-28 00:53:06,534][106225] Updated weights for policy 1, policy_version 785575 (0.0008) [2023-12-28 00:53:06,790][106226] Updated weights for policy 0, policy_version 783420 (0.0011) [2023-12-28 00:53:06,843][106226] Updated weights for policy 0, policy_version 783430 (0.0010) [2023-12-28 00:53:06,904][106226] Updated weights for policy 0, policy_version 783440 (0.0011) [2023-12-28 00:53:07,207][106225] Updated weights for policy 1, policy_version 785585 (0.0008) [2023-12-28 00:53:07,266][106225] Updated weights for policy 1, policy_version 785595 (0.0007) [2023-12-28 00:53:07,330][106225] Updated weights for policy 1, policy_version 785605 (0.0008) [2023-12-28 00:53:07,590][106226] Updated weights for policy 0, policy_version 783450 (0.0009) [2023-12-28 00:53:07,650][106226] Updated weights for policy 0, policy_version 783460 (0.0005) [2023-12-28 00:53:07,705][106226] Updated weights for policy 0, policy_version 783470 (0.0006) [2023-12-28 00:53:07,790][106226] Updated weights for policy 0, policy_version 783480 (0.0009) [2023-12-28 00:53:08,071][106225] Updated weights for policy 1, policy_version 785615 (0.0006) [2023-12-28 00:53:08,127][106225] Updated weights for policy 1, policy_version 785625 (0.0005) [2023-12-28 00:53:08,190][106225] Updated weights for policy 1, policy_version 785635 (0.0005) [2023-12-28 00:53:08,482][106226] Updated weights for policy 0, policy_version 783490 (0.0008) [2023-12-28 00:53:08,535][106226] Updated weights for policy 0, policy_version 783500 (0.0008) [2023-12-28 00:53:08,591][106226] Updated weights for policy 0, policy_version 783510 (0.0008) [2023-12-28 00:53:08,777][106225] Updated weights for policy 1, policy_version 785645 (0.0006) [2023-12-28 00:53:08,833][106225] Updated weights for policy 1, policy_version 785655 (0.0006) [2023-12-28 00:53:08,893][106225] Updated weights for policy 1, policy_version 785665 (0.0008) [2023-12-28 00:53:09,367][106226] Updated weights for policy 0, policy_version 783520 (0.0009) [2023-12-28 00:53:09,437][106226] Updated weights for policy 0, policy_version 783530 (0.0007) [2023-12-28 00:53:09,500][106226] Updated weights for policy 0, policy_version 783540 (0.0007) [2023-12-28 00:53:09,638][106225] Updated weights for policy 1, policy_version 785675 (0.0008) [2023-12-28 00:53:09,694][106225] Updated weights for policy 1, policy_version 785685 (0.0009) [2023-12-28 00:53:09,751][106225] Updated weights for policy 1, policy_version 785695 (0.0009) [2023-12-28 00:53:10,248][106226] Updated weights for policy 0, policy_version 783550 (0.0008) [2023-12-28 00:53:10,304][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000003 [2023-12-28 00:53:10,305][106226] Updated weights for policy 0, policy_version 783560 (0.0008) [2023-12-28 00:53:10,498][106225] Updated weights for policy 1, policy_version 785705 (0.0007) [2023-12-28 00:53:10,559][106225] Updated weights for policy 1, policy_version 785715 (0.0007) [2023-12-28 00:53:10,624][106225] Updated weights for policy 1, policy_version 785725 (0.0008) [2023-12-28 00:53:10,686][106225] Updated weights for policy 1, policy_version 785735 (0.0009) [2023-12-28 00:53:11,161][106226] Updated weights for policy 0, policy_version 783570 (0.0008) [2023-12-28 00:53:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 401833984. Throughput: 0: 9884.9, 1: 10067.7. Samples: 401809508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:11,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.090')] [2023-12-28 00:53:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000785736_201187328.pth... [2023-12-28 00:53:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000784584_200892416.pth [2023-12-28 00:53:11,222][106226] Updated weights for policy 0, policy_version 783580 (0.0007) [2023-12-28 00:53:11,291][106226] Updated weights for policy 0, policy_version 783590 (0.0009) [2023-12-28 00:53:11,300][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000783592_200654848.pth... [2023-12-28 00:53:11,305][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000782456_200359936.pth [2023-12-28 00:53:11,428][106225] Updated weights for policy 1, policy_version 785745 (0.0009) [2023-12-28 00:53:11,483][106225] Updated weights for policy 1, policy_version 785755 (0.0008) [2023-12-28 00:53:11,551][106225] Updated weights for policy 1, policy_version 785765 (0.0010) [2023-12-28 00:53:12,041][106226] Updated weights for policy 0, policy_version 783600 (0.0008) [2023-12-28 00:53:12,108][106226] Updated weights for policy 0, policy_version 783610 (0.0008) [2023-12-28 00:53:12,177][106226] Updated weights for policy 0, policy_version 783620 (0.0010) [2023-12-28 00:53:12,332][106225] Updated weights for policy 1, policy_version 785775 (0.0009) [2023-12-28 00:53:12,402][106225] Updated weights for policy 1, policy_version 785785 (0.0007) [2023-12-28 00:53:12,462][106225] Updated weights for policy 1, policy_version 785795 (0.0006) [2023-12-28 00:53:12,938][106226] Updated weights for policy 0, policy_version 783630 (0.0009) [2023-12-28 00:53:13,000][106226] Updated weights for policy 0, policy_version 783640 (0.0009) [2023-12-28 00:53:13,051][106226] Updated weights for policy 0, policy_version 783650 (0.0009) [2023-12-28 00:53:13,114][106225] Updated weights for policy 1, policy_version 785805 (0.0007) [2023-12-28 00:53:13,168][106225] Updated weights for policy 1, policy_version 785815 (0.0009) [2023-12-28 00:53:13,247][106225] Updated weights for policy 1, policy_version 785825 (0.0009) [2023-12-28 00:53:13,697][106226] Updated weights for policy 0, policy_version 783660 (0.0005) [2023-12-28 00:53:13,756][106226] Updated weights for policy 0, policy_version 783670 (0.0005) [2023-12-28 00:53:13,806][106226] Updated weights for policy 0, policy_version 783680 (0.0005) [2023-12-28 00:53:13,916][106225] Updated weights for policy 1, policy_version 785835 (0.0007) [2023-12-28 00:53:13,980][106225] Updated weights for policy 1, policy_version 785845 (0.0005) [2023-12-28 00:53:14,048][106225] Updated weights for policy 1, policy_version 785855 (0.0005) [2023-12-28 00:53:14,361][106226] Updated weights for policy 0, policy_version 783690 (0.0005) [2023-12-28 00:53:14,423][106226] Updated weights for policy 0, policy_version 783700 (0.0005) [2023-12-28 00:53:14,492][106226] Updated weights for policy 0, policy_version 783710 (0.0005) [2023-12-28 00:53:14,558][106226] Updated weights for policy 0, policy_version 783720 (0.0007) [2023-12-28 00:53:14,584][106225] Updated weights for policy 1, policy_version 785865 (0.0006) [2023-12-28 00:53:14,634][106225] Updated weights for policy 1, policy_version 785875 (0.0006) [2023-12-28 00:53:14,679][106225] Updated weights for policy 1, policy_version 785885 (0.0008) [2023-12-28 00:53:14,732][106225] Updated weights for policy 1, policy_version 785895 (0.0008) [2023-12-28 00:53:15,213][106226] Updated weights for policy 0, policy_version 783730 (0.0009) [2023-12-28 00:53:15,277][106226] Updated weights for policy 0, policy_version 783740 (0.0009) [2023-12-28 00:53:15,333][106226] Updated weights for policy 0, policy_version 783750 (0.0009) [2023-12-28 00:53:15,466][106225] Updated weights for policy 1, policy_version 785905 (0.0009) [2023-12-28 00:53:15,517][106225] Updated weights for policy 1, policy_version 785915 (0.0008) [2023-12-28 00:53:15,567][106225] Updated weights for policy 1, policy_version 785925 (0.0008) [2023-12-28 00:53:16,054][106226] Updated weights for policy 0, policy_version 783760 (0.0006) [2023-12-28 00:53:16,107][106226] Updated weights for policy 0, policy_version 783770 (0.0005) [2023-12-28 00:53:16,154][106226] Updated weights for policy 0, policy_version 783780 (0.0008) [2023-12-28 00:53:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 401940480. Throughput: 0: 9786.4, 1: 10013.7. Samples: 401927904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:16,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.089')] [2023-12-28 00:53:16,310][106225] Updated weights for policy 1, policy_version 785935 (0.0010) [2023-12-28 00:53:16,362][106225] Updated weights for policy 1, policy_version 785945 (0.0006) [2023-12-28 00:53:16,422][106225] Updated weights for policy 1, policy_version 785955 (0.0006) [2023-12-28 00:53:16,754][106226] Updated weights for policy 0, policy_version 783790 (0.0007) [2023-12-28 00:53:16,804][106226] Updated weights for policy 0, policy_version 783800 (0.0005) [2023-12-28 00:53:16,864][106226] Updated weights for policy 0, policy_version 783810 (0.0008) [2023-12-28 00:53:17,177][106225] Updated weights for policy 1, policy_version 785965 (0.0008) [2023-12-28 00:53:17,233][106225] Updated weights for policy 1, policy_version 785975 (0.0009) [2023-12-28 00:53:17,279][106225] Updated weights for policy 1, policy_version 785985 (0.0008) [2023-12-28 00:53:17,471][106226] Updated weights for policy 0, policy_version 783820 (0.0010) [2023-12-28 00:53:17,519][106226] Updated weights for policy 0, policy_version 783830 (0.0010) [2023-12-28 00:53:17,572][106226] Updated weights for policy 0, policy_version 783840 (0.0010) [2023-12-28 00:53:18,029][106225] Updated weights for policy 1, policy_version 785995 (0.0007) [2023-12-28 00:53:18,086][106225] Updated weights for policy 1, policy_version 786005 (0.0008) [2023-12-28 00:53:18,145][106225] Updated weights for policy 1, policy_version 786015 (0.0008) [2023-12-28 00:53:18,281][106226] Updated weights for policy 0, policy_version 783850 (0.0010) [2023-12-28 00:53:18,346][106226] Updated weights for policy 0, policy_version 783860 (0.0010) [2023-12-28 00:53:18,412][106226] Updated weights for policy 0, policy_version 783870 (0.0009) [2023-12-28 00:53:18,471][106226] Updated weights for policy 0, policy_version 783880 (0.0007) [2023-12-28 00:53:18,901][106225] Updated weights for policy 1, policy_version 786025 (0.0008) [2023-12-28 00:53:18,966][106225] Updated weights for policy 1, policy_version 786035 (0.0005) [2023-12-28 00:53:19,032][106225] Updated weights for policy 1, policy_version 786045 (0.0005) [2023-12-28 00:53:19,084][106225] Updated weights for policy 1, policy_version 786055 (0.0009) [2023-12-28 00:53:19,196][106226] Updated weights for policy 0, policy_version 783890 (0.0010) [2023-12-28 00:53:19,256][106226] Updated weights for policy 0, policy_version 783900 (0.0010) [2023-12-28 00:53:19,315][106226] Updated weights for policy 0, policy_version 783910 (0.0008) [2023-12-28 00:53:19,760][106225] Updated weights for policy 1, policy_version 786065 (0.0011) [2023-12-28 00:53:19,821][106225] Updated weights for policy 1, policy_version 786075 (0.0011) [2023-12-28 00:53:19,886][106225] Updated weights for policy 1, policy_version 786085 (0.0009) [2023-12-28 00:53:20,093][106226] Updated weights for policy 0, policy_version 783920 (0.0008) [2023-12-28 00:53:20,163][106226] Updated weights for policy 0, policy_version 783930 (0.0009) [2023-12-28 00:53:20,228][106226] Updated weights for policy 0, policy_version 783940 (0.0008) [2023-12-28 00:53:20,567][106225] Updated weights for policy 1, policy_version 786095 (0.0010) [2023-12-28 00:53:20,635][106225] Updated weights for policy 1, policy_version 786105 (0.0011) [2023-12-28 00:53:20,701][106225] Updated weights for policy 1, policy_version 786115 (0.0011) [2023-12-28 00:53:20,979][106226] Updated weights for policy 0, policy_version 783950 (0.0008) [2023-12-28 00:53:21,069][106226] Updated weights for policy 0, policy_version 783960 (0.0008) [2023-12-28 00:53:21,142][106226] Updated weights for policy 0, policy_version 783970 (0.0007) [2023-12-28 00:53:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 402030592. Throughput: 0: 9768.9, 1: 9974.5. Samples: 402044208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:21,175][105115] Avg episode reward: [(0, '-4.067'), (1, '-5.378')] [2023-12-28 00:53:21,504][106225] Updated weights for policy 1, policy_version 786125 (0.0009) [2023-12-28 00:53:21,557][106225] Updated weights for policy 1, policy_version 786135 (0.0009) [2023-12-28 00:53:21,617][106225] Updated weights for policy 1, policy_version 786145 (0.0008) [2023-12-28 00:53:21,806][106226] Updated weights for policy 0, policy_version 783980 (0.0007) [2023-12-28 00:53:21,866][106226] Updated weights for policy 0, policy_version 783990 (0.0008) [2023-12-28 00:53:21,930][106226] Updated weights for policy 0, policy_version 784000 (0.0008) [2023-12-28 00:53:22,430][106225] Updated weights for policy 1, policy_version 786155 (0.0008) [2023-12-28 00:53:22,474][106225] Updated weights for policy 1, policy_version 786165 (0.0008) [2023-12-28 00:53:22,533][106225] Updated weights for policy 1, policy_version 786175 (0.0008) [2023-12-28 00:53:22,624][106226] Updated weights for policy 0, policy_version 784010 (0.0009) [2023-12-28 00:53:22,689][106226] Updated weights for policy 0, policy_version 784020 (0.0011) [2023-12-28 00:53:22,750][106226] Updated weights for policy 0, policy_version 784030 (0.0011) [2023-12-28 00:53:22,815][106226] Updated weights for policy 0, policy_version 784040 (0.0011) [2023-12-28 00:53:23,250][106225] Updated weights for policy 1, policy_version 786185 (0.0008) [2023-12-28 00:53:23,300][106225] Updated weights for policy 1, policy_version 786195 (0.0007) [2023-12-28 00:53:23,357][106225] Updated weights for policy 1, policy_version 786205 (0.0005) [2023-12-28 00:53:23,409][106225] Updated weights for policy 1, policy_version 786215 (0.0006) [2023-12-28 00:53:23,473][106226] Updated weights for policy 0, policy_version 784050 (0.0011) [2023-12-28 00:53:23,539][106226] Updated weights for policy 0, policy_version 784060 (0.0010) [2023-12-28 00:53:23,605][106226] Updated weights for policy 0, policy_version 784070 (0.0011) [2023-12-28 00:53:23,997][106225] Updated weights for policy 1, policy_version 786225 (0.0008) [2023-12-28 00:53:24,043][106225] Updated weights for policy 1, policy_version 786235 (0.0008) [2023-12-28 00:53:24,090][106225] Updated weights for policy 1, policy_version 786245 (0.0008) [2023-12-28 00:53:24,272][106226] Updated weights for policy 0, policy_version 784080 (0.0007) [2023-12-28 00:53:24,337][106226] Updated weights for policy 0, policy_version 784090 (0.0011) [2023-12-28 00:53:24,395][106226] Updated weights for policy 0, policy_version 784100 (0.0010) [2023-12-28 00:53:24,707][106225] Updated weights for policy 1, policy_version 786255 (0.0006) [2023-12-28 00:53:24,773][106225] Updated weights for policy 1, policy_version 786265 (0.0005) [2023-12-28 00:53:24,837][106225] Updated weights for policy 1, policy_version 786275 (0.0005) [2023-12-28 00:53:24,959][106226] Updated weights for policy 0, policy_version 784110 (0.0007) [2023-12-28 00:53:25,008][106226] Updated weights for policy 0, policy_version 784120 (0.0005) [2023-12-28 00:53:25,079][106226] Updated weights for policy 0, policy_version 784130 (0.0005) [2023-12-28 00:53:25,467][106225] Updated weights for policy 1, policy_version 786285 (0.0010) [2023-12-28 00:53:25,513][106225] Updated weights for policy 1, policy_version 786295 (0.0007) [2023-12-28 00:53:25,561][106225] Updated weights for policy 1, policy_version 786305 (0.0007) [2023-12-28 00:53:25,655][106226] Updated weights for policy 0, policy_version 784140 (0.0007) [2023-12-28 00:53:25,712][106226] Updated weights for policy 0, policy_version 784150 (0.0010) [2023-12-28 00:53:25,775][106226] Updated weights for policy 0, policy_version 784160 (0.0010) [2023-12-28 00:53:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 402137088. Throughput: 0: 9800.3, 1: 9914.0. Samples: 402102612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:26,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-5.180')] [2023-12-28 00:53:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000786312_201334784.pth... [2023-12-28 00:53:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000784168_200802304.pth... [2023-12-28 00:53:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000785160_201039872.pth [2023-12-28 00:53:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000783032_200507392.pth [2023-12-28 00:53:26,271][106225] Updated weights for policy 1, policy_version 786315 (0.0009) [2023-12-28 00:53:26,326][106225] Updated weights for policy 1, policy_version 786325 (0.0008) [2023-12-28 00:53:26,382][106225] Updated weights for policy 1, policy_version 786335 (0.0008) [2023-12-28 00:53:26,495][106226] Updated weights for policy 0, policy_version 784170 (0.0011) [2023-12-28 00:53:26,550][106226] Updated weights for policy 0, policy_version 784180 (0.0010) [2023-12-28 00:53:26,600][106226] Updated weights for policy 0, policy_version 784190 (0.0010) [2023-12-28 00:53:26,645][106226] Updated weights for policy 0, policy_version 784200 (0.0010) [2023-12-28 00:53:27,108][106225] Updated weights for policy 1, policy_version 786345 (0.0008) [2023-12-28 00:53:27,156][106225] Updated weights for policy 1, policy_version 786355 (0.0009) [2023-12-28 00:53:27,204][106225] Updated weights for policy 1, policy_version 786365 (0.0009) [2023-12-28 00:53:27,254][106226] Updated weights for policy 0, policy_version 784210 (0.0005) [2023-12-28 00:53:27,265][106225] Updated weights for policy 1, policy_version 786375 (0.0008) [2023-12-28 00:53:27,307][106226] Updated weights for policy 0, policy_version 784220 (0.0006) [2023-12-28 00:53:27,362][106226] Updated weights for policy 0, policy_version 784230 (0.0006) [2023-12-28 00:53:27,881][106226] Updated weights for policy 0, policy_version 784240 (0.0005) [2023-12-28 00:53:27,934][106226] Updated weights for policy 0, policy_version 784250 (0.0005) [2023-12-28 00:53:27,955][106225] Updated weights for policy 1, policy_version 786385 (0.0006) [2023-12-28 00:53:27,990][106226] Updated weights for policy 0, policy_version 784260 (0.0005) [2023-12-28 00:53:28,010][106225] Updated weights for policy 1, policy_version 786395 (0.0006) [2023-12-28 00:53:28,065][106225] Updated weights for policy 1, policy_version 786405 (0.0008) [2023-12-28 00:53:28,566][106226] Updated weights for policy 0, policy_version 784270 (0.0007) [2023-12-28 00:53:28,635][106226] Updated weights for policy 0, policy_version 784280 (0.0007) [2023-12-28 00:53:28,701][106226] Updated weights for policy 0, policy_version 784290 (0.0006) [2023-12-28 00:53:28,779][106225] Updated weights for policy 1, policy_version 786415 (0.0010) [2023-12-28 00:53:28,832][106225] Updated weights for policy 1, policy_version 786425 (0.0010) [2023-12-28 00:53:28,885][106225] Updated weights for policy 1, policy_version 786435 (0.0010) [2023-12-28 00:53:29,328][106226] Updated weights for policy 0, policy_version 784300 (0.0008) [2023-12-28 00:53:29,398][106226] Updated weights for policy 0, policy_version 784310 (0.0011) [2023-12-28 00:53:29,444][106226] Updated weights for policy 0, policy_version 784320 (0.0008) [2023-12-28 00:53:29,609][106225] Updated weights for policy 1, policy_version 786445 (0.0010) [2023-12-28 00:53:29,669][106225] Updated weights for policy 1, policy_version 786455 (0.0010) [2023-12-28 00:53:29,730][106225] Updated weights for policy 1, policy_version 786465 (0.0010) [2023-12-28 00:53:30,148][106226] Updated weights for policy 0, policy_version 784330 (0.0008) [2023-12-28 00:53:30,212][106226] Updated weights for policy 0, policy_version 784340 (0.0007) [2023-12-28 00:53:30,277][106226] Updated weights for policy 0, policy_version 784350 (0.0008) [2023-12-28 00:53:30,344][106226] Updated weights for policy 0, policy_version 784360 (0.0009) [2023-12-28 00:53:30,422][106225] Updated weights for policy 1, policy_version 786475 (0.0009) [2023-12-28 00:53:30,484][106225] Updated weights for policy 1, policy_version 786485 (0.0005) [2023-12-28 00:53:30,545][106225] Updated weights for policy 1, policy_version 786495 (0.0009) [2023-12-28 00:53:30,968][106226] Updated weights for policy 0, policy_version 784370 (0.0005) [2023-12-28 00:53:31,021][106226] Updated weights for policy 0, policy_version 784380 (0.0006) [2023-12-28 00:53:31,085][106226] Updated weights for policy 0, policy_version 784390 (0.0008) [2023-12-28 00:53:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 402243584. Throughput: 0: 10051.8, 1: 9929.7. Samples: 402230352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:31,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.879')] [2023-12-28 00:53:31,231][106225] Updated weights for policy 1, policy_version 786505 (0.0010) [2023-12-28 00:53:31,298][106225] Updated weights for policy 1, policy_version 786515 (0.0008) [2023-12-28 00:53:31,362][106225] Updated weights for policy 1, policy_version 786525 (0.0008) [2023-12-28 00:53:31,425][106225] Updated weights for policy 1, policy_version 786535 (0.0008) [2023-12-28 00:53:31,796][106226] Updated weights for policy 0, policy_version 784400 (0.0005) [2023-12-28 00:53:31,861][106226] Updated weights for policy 0, policy_version 784410 (0.0005) [2023-12-28 00:53:31,913][106226] Updated weights for policy 0, policy_version 784420 (0.0007) [2023-12-28 00:53:32,123][106225] Updated weights for policy 1, policy_version 786545 (0.0010) [2023-12-28 00:53:32,180][106225] Updated weights for policy 1, policy_version 786555 (0.0010) [2023-12-28 00:53:32,236][106225] Updated weights for policy 1, policy_version 786565 (0.0010) [2023-12-28 00:53:32,626][106226] Updated weights for policy 0, policy_version 784430 (0.0008) [2023-12-28 00:53:32,683][106226] Updated weights for policy 0, policy_version 784440 (0.0010) [2023-12-28 00:53:32,739][106226] Updated weights for policy 0, policy_version 784450 (0.0010) [2023-12-28 00:53:32,929][106225] Updated weights for policy 1, policy_version 786575 (0.0010) [2023-12-28 00:53:32,987][106225] Updated weights for policy 1, policy_version 786585 (0.0010) [2023-12-28 00:53:33,046][106225] Updated weights for policy 1, policy_version 786595 (0.0010) [2023-12-28 00:53:33,357][106226] Updated weights for policy 0, policy_version 784460 (0.0007) [2023-12-28 00:53:33,412][106226] Updated weights for policy 0, policy_version 784470 (0.0007) [2023-12-28 00:53:33,463][106226] Updated weights for policy 0, policy_version 784480 (0.0008) [2023-12-28 00:53:33,708][106225] Updated weights for policy 1, policy_version 786605 (0.0008) [2023-12-28 00:53:33,760][106225] Updated weights for policy 1, policy_version 786615 (0.0005) [2023-12-28 00:53:33,806][106225] Updated weights for policy 1, policy_version 786625 (0.0005) [2023-12-28 00:53:34,025][106226] Updated weights for policy 0, policy_version 784490 (0.0006) [2023-12-28 00:53:34,084][106226] Updated weights for policy 0, policy_version 784500 (0.0009) [2023-12-28 00:53:34,136][106226] Updated weights for policy 0, policy_version 784510 (0.0008) [2023-12-28 00:53:34,205][106226] Updated weights for policy 0, policy_version 784520 (0.0007) [2023-12-28 00:53:34,395][106225] Updated weights for policy 1, policy_version 786635 (0.0007) [2023-12-28 00:53:34,456][106225] Updated weights for policy 1, policy_version 786645 (0.0010) [2023-12-28 00:53:34,521][106225] Updated weights for policy 1, policy_version 786655 (0.0007) [2023-12-28 00:53:34,909][106226] Updated weights for policy 0, policy_version 784530 (0.0008) [2023-12-28 00:53:34,968][106226] Updated weights for policy 0, policy_version 784540 (0.0008) [2023-12-28 00:53:35,038][106226] Updated weights for policy 0, policy_version 784550 (0.0009) [2023-12-28 00:53:35,206][106225] Updated weights for policy 1, policy_version 786665 (0.0008) [2023-12-28 00:53:35,268][106225] Updated weights for policy 1, policy_version 786675 (0.0007) [2023-12-28 00:53:35,323][106225] Updated weights for policy 1, policy_version 786685 (0.0008) [2023-12-28 00:53:35,381][106225] Updated weights for policy 1, policy_version 786695 (0.0008) [2023-12-28 00:53:35,735][106226] Updated weights for policy 0, policy_version 784560 (0.0009) [2023-12-28 00:53:35,792][106226] Updated weights for policy 0, policy_version 784570 (0.0008) [2023-12-28 00:53:35,844][106226] Updated weights for policy 0, policy_version 784580 (0.0009) [2023-12-28 00:53:36,079][106225] Updated weights for policy 1, policy_version 786705 (0.0010) [2023-12-28 00:53:36,137][106225] Updated weights for policy 1, policy_version 786715 (0.0009) [2023-12-28 00:53:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 402341888. Throughput: 0: 10071.2, 1: 9965.4. Samples: 402352920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:36,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.006')] [2023-12-28 00:53:36,200][106225] Updated weights for policy 1, policy_version 786725 (0.0008) [2023-12-28 00:53:36,657][106226] Updated weights for policy 0, policy_version 784590 (0.0009) [2023-12-28 00:53:36,720][106226] Updated weights for policy 0, policy_version 784600 (0.0008) [2023-12-28 00:53:36,780][106226] Updated weights for policy 0, policy_version 784610 (0.0009) [2023-12-28 00:53:36,924][106225] Updated weights for policy 1, policy_version 786735 (0.0009) [2023-12-28 00:53:36,987][106225] Updated weights for policy 1, policy_version 786745 (0.0008) [2023-12-28 00:53:37,050][106225] Updated weights for policy 1, policy_version 786755 (0.0008) [2023-12-28 00:53:37,574][106226] Updated weights for policy 0, policy_version 784620 (0.0008) [2023-12-28 00:53:37,625][106226] Updated weights for policy 0, policy_version 784630 (0.0007) [2023-12-28 00:53:37,630][106225] Updated weights for policy 1, policy_version 786765 (0.0008) [2023-12-28 00:53:37,672][106226] Updated weights for policy 0, policy_version 784640 (0.0007) [2023-12-28 00:53:37,678][106225] Updated weights for policy 1, policy_version 786775 (0.0006) [2023-12-28 00:53:37,729][106225] Updated weights for policy 1, policy_version 786785 (0.0007) [2023-12-28 00:53:38,365][106225] Updated weights for policy 1, policy_version 786795 (0.0009) [2023-12-28 00:53:38,426][106225] Updated weights for policy 1, policy_version 786805 (0.0009) [2023-12-28 00:53:38,436][106226] Updated weights for policy 0, policy_version 784650 (0.0006) [2023-12-28 00:53:38,485][106225] Updated weights for policy 1, policy_version 786815 (0.0006) [2023-12-28 00:53:38,495][106226] Updated weights for policy 0, policy_version 784660 (0.0008) [2023-12-28 00:53:38,563][106226] Updated weights for policy 0, policy_version 784670 (0.0007) [2023-12-28 00:53:38,629][106226] Updated weights for policy 0, policy_version 784680 (0.0007) [2023-12-28 00:53:39,256][106225] Updated weights for policy 1, policy_version 786825 (0.0007) [2023-12-28 00:53:39,307][106226] Updated weights for policy 0, policy_version 784690 (0.0007) [2023-12-28 00:53:39,319][106225] Updated weights for policy 1, policy_version 786835 (0.0008) [2023-12-28 00:53:39,362][106226] Updated weights for policy 0, policy_version 784700 (0.0006) [2023-12-28 00:53:39,387][106225] Updated weights for policy 1, policy_version 786845 (0.0008) [2023-12-28 00:53:39,437][106226] Updated weights for policy 0, policy_version 784710 (0.0008) [2023-12-28 00:53:39,453][106225] Updated weights for policy 1, policy_version 786855 (0.0007) [2023-12-28 00:53:40,155][106226] Updated weights for policy 0, policy_version 784720 (0.0008) [2023-12-28 00:53:40,220][106226] Updated weights for policy 0, policy_version 784730 (0.0006) [2023-12-28 00:53:40,243][106225] Updated weights for policy 1, policy_version 786865 (0.0009) [2023-12-28 00:53:40,284][106226] Updated weights for policy 0, policy_version 784740 (0.0007) [2023-12-28 00:53:40,304][106225] Updated weights for policy 1, policy_version 786875 (0.0009) [2023-12-28 00:53:40,371][106225] Updated weights for policy 1, policy_version 786885 (0.0009) [2023-12-28 00:53:40,891][106226] Updated weights for policy 0, policy_version 784750 (0.0008) [2023-12-28 00:53:40,948][106226] Updated weights for policy 0, policy_version 784760 (0.0009) [2023-12-28 00:53:41,001][106226] Updated weights for policy 0, policy_version 784770 (0.0008) [2023-12-28 00:53:41,103][106225] Updated weights for policy 1, policy_version 786895 (0.0008) [2023-12-28 00:53:41,166][106225] Updated weights for policy 1, policy_version 786905 (0.0008) [2023-12-28 00:53:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 402440192. Throughput: 0: 10053.9, 1: 9998.8. Samples: 402411964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:41,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.072')] [2023-12-28 00:53:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000784776_200957952.pth... [2023-12-28 00:53:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000783592_200654848.pth [2023-12-28 00:53:41,188][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000784776_200957952.pth [2023-12-28 00:53:41,232][106225] Updated weights for policy 1, policy_version 786915 (0.0008) [2023-12-28 00:53:41,264][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000786920_201490432.pth... [2023-12-28 00:53:41,268][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000785736_201187328.pth [2023-12-28 00:53:41,269][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000786920_201490432.pth [2023-12-28 00:53:41,733][106226] Updated weights for policy 0, policy_version 784780 (0.0008) [2023-12-28 00:53:41,800][106226] Updated weights for policy 0, policy_version 784790 (0.0010) [2023-12-28 00:53:41,871][106226] Updated weights for policy 0, policy_version 784800 (0.0011) [2023-12-28 00:53:42,046][106225] Updated weights for policy 1, policy_version 786925 (0.0008) [2023-12-28 00:53:42,105][106225] Updated weights for policy 1, policy_version 786935 (0.0007) [2023-12-28 00:53:42,164][106225] Updated weights for policy 1, policy_version 786945 (0.0006) [2023-12-28 00:53:42,638][106226] Updated weights for policy 0, policy_version 784810 (0.0010) [2023-12-28 00:53:42,693][106226] Updated weights for policy 0, policy_version 784820 (0.0008) [2023-12-28 00:53:42,752][106226] Updated weights for policy 0, policy_version 784830 (0.0008) [2023-12-28 00:53:42,815][106226] Updated weights for policy 0, policy_version 784840 (0.0007) [2023-12-28 00:53:42,897][106225] Updated weights for policy 1, policy_version 786955 (0.0009) [2023-12-28 00:53:42,953][106225] Updated weights for policy 1, policy_version 786965 (0.0008) [2023-12-28 00:53:43,013][106225] Updated weights for policy 1, policy_version 786975 (0.0009) [2023-12-28 00:53:43,509][106226] Updated weights for policy 0, policy_version 784850 (0.0006) [2023-12-28 00:53:43,568][106226] Updated weights for policy 0, policy_version 784860 (0.0005) [2023-12-28 00:53:43,622][106226] Updated weights for policy 0, policy_version 784870 (0.0006) [2023-12-28 00:53:43,687][106225] Updated weights for policy 1, policy_version 786985 (0.0008) [2023-12-28 00:53:43,744][106225] Updated weights for policy 1, policy_version 786995 (0.0007) [2023-12-28 00:53:43,804][106225] Updated weights for policy 1, policy_version 787005 (0.0010) [2023-12-28 00:53:43,864][106225] Updated weights for policy 1, policy_version 787015 (0.0008) [2023-12-28 00:53:44,262][106226] Updated weights for policy 0, policy_version 784880 (0.0005) [2023-12-28 00:53:44,312][106226] Updated weights for policy 0, policy_version 784890 (0.0005) [2023-12-28 00:53:44,358][106226] Updated weights for policy 0, policy_version 784900 (0.0008) [2023-12-28 00:53:44,546][106225] Updated weights for policy 1, policy_version 787025 (0.0007) [2023-12-28 00:53:44,611][106225] Updated weights for policy 1, policy_version 787035 (0.0008) [2023-12-28 00:53:44,679][106225] Updated weights for policy 1, policy_version 787045 (0.0006) [2023-12-28 00:53:45,035][106226] Updated weights for policy 0, policy_version 784910 (0.0009) [2023-12-28 00:53:45,107][106226] Updated weights for policy 0, policy_version 784920 (0.0009) [2023-12-28 00:53:45,179][106226] Updated weights for policy 0, policy_version 784930 (0.0009) [2023-12-28 00:53:45,303][106225] Updated weights for policy 1, policy_version 787055 (0.0008) [2023-12-28 00:53:45,350][106225] Updated weights for policy 1, policy_version 787065 (0.0009) [2023-12-28 00:53:45,406][106225] Updated weights for policy 1, policy_version 787075 (0.0008) [2023-12-28 00:53:45,791][106226] Updated weights for policy 0, policy_version 784940 (0.0008) [2023-12-28 00:53:45,840][106226] Updated weights for policy 0, policy_version 784950 (0.0005) [2023-12-28 00:53:45,891][106226] Updated weights for policy 0, policy_version 784960 (0.0009) [2023-12-28 00:53:46,012][106225] Updated weights for policy 1, policy_version 787085 (0.0007) [2023-12-28 00:53:46,057][106225] Updated weights for policy 1, policy_version 787095 (0.0005) [2023-12-28 00:53:46,113][106225] Updated weights for policy 1, policy_version 787105 (0.0005) [2023-12-28 00:53:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 402546688. Throughput: 0: 10064.5, 1: 9872.5. Samples: 402528384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:46,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.051')] [2023-12-28 00:53:46,605][106225] Updated weights for policy 1, policy_version 787115 (0.0005) [2023-12-28 00:53:46,651][106226] Updated weights for policy 0, policy_version 784970 (0.0006) [2023-12-28 00:53:46,657][106225] Updated weights for policy 1, policy_version 787125 (0.0006) [2023-12-28 00:53:46,720][106226] Updated weights for policy 0, policy_version 784980 (0.0006) [2023-12-28 00:53:46,727][106225] Updated weights for policy 1, policy_version 787135 (0.0007) [2023-12-28 00:53:46,771][106226] Updated weights for policy 0, policy_version 784990 (0.0006) [2023-12-28 00:53:46,826][106226] Updated weights for policy 0, policy_version 785000 (0.0009) [2023-12-28 00:53:47,387][106225] Updated weights for policy 1, policy_version 787145 (0.0008) [2023-12-28 00:53:47,443][106225] Updated weights for policy 1, policy_version 787155 (0.0007) [2023-12-28 00:53:47,499][106225] Updated weights for policy 1, policy_version 787165 (0.0005) [2023-12-28 00:53:47,501][106226] Updated weights for policy 0, policy_version 785010 (0.0007) [2023-12-28 00:53:47,552][106225] Updated weights for policy 1, policy_version 787175 (0.0007) [2023-12-28 00:53:47,553][106226] Updated weights for policy 0, policy_version 785020 (0.0009) [2023-12-28 00:53:47,601][106226] Updated weights for policy 0, policy_version 785030 (0.0008) [2023-12-28 00:53:48,203][106225] Updated weights for policy 1, policy_version 787185 (0.0008) [2023-12-28 00:53:48,227][106226] Updated weights for policy 0, policy_version 785040 (0.0006) [2023-12-28 00:53:48,266][106225] Updated weights for policy 1, policy_version 787195 (0.0009) [2023-12-28 00:53:48,287][106226] Updated weights for policy 0, policy_version 785050 (0.0006) [2023-12-28 00:53:48,319][106225] Updated weights for policy 1, policy_version 787205 (0.0006) [2023-12-28 00:53:48,355][106226] Updated weights for policy 0, policy_version 785060 (0.0008) [2023-12-28 00:53:49,034][106225] Updated weights for policy 1, policy_version 787215 (0.0010) [2023-12-28 00:53:49,081][106226] Updated weights for policy 0, policy_version 785070 (0.0007) [2023-12-28 00:53:49,087][106225] Updated weights for policy 1, policy_version 787225 (0.0010) [2023-12-28 00:53:49,130][106226] Updated weights for policy 0, policy_version 785080 (0.0007) [2023-12-28 00:53:49,141][106225] Updated weights for policy 1, policy_version 787235 (0.0008) [2023-12-28 00:53:49,187][106226] Updated weights for policy 0, policy_version 785090 (0.0006) [2023-12-28 00:53:49,889][106225] Updated weights for policy 1, policy_version 787245 (0.0008) [2023-12-28 00:53:49,935][106226] Updated weights for policy 0, policy_version 785100 (0.0007) [2023-12-28 00:53:49,949][106225] Updated weights for policy 1, policy_version 787255 (0.0010) [2023-12-28 00:53:49,996][106226] Updated weights for policy 0, policy_version 785110 (0.0008) [2023-12-28 00:53:50,017][106225] Updated weights for policy 1, policy_version 787265 (0.0008) [2023-12-28 00:53:50,059][106226] Updated weights for policy 0, policy_version 785120 (0.0006) [2023-12-28 00:53:50,650][106225] Updated weights for policy 1, policy_version 787275 (0.0007) [2023-12-28 00:53:50,714][106225] Updated weights for policy 1, policy_version 787285 (0.0006) [2023-12-28 00:53:50,771][106225] Updated weights for policy 1, policy_version 787295 (0.0006) [2023-12-28 00:53:50,776][106226] Updated weights for policy 0, policy_version 785130 (0.0007) [2023-12-28 00:53:50,831][106226] Updated weights for policy 0, policy_version 785140 (0.0007) [2023-12-28 00:53:50,890][106226] Updated weights for policy 0, policy_version 785150 (0.0006) [2023-12-28 00:53:50,941][106226] Updated weights for policy 0, policy_version 785160 (0.0006) [2023-12-28 00:53:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 402644992. Throughput: 0: 10061.5, 1: 9996.6. Samples: 402653080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:51,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-5.063')] [2023-12-28 00:53:51,450][106225] Updated weights for policy 1, policy_version 787305 (0.0007) [2023-12-28 00:53:51,506][106225] Updated weights for policy 1, policy_version 787315 (0.0005) [2023-12-28 00:53:51,560][106225] Updated weights for policy 1, policy_version 787325 (0.0006) [2023-12-28 00:53:51,623][106225] Updated weights for policy 1, policy_version 787335 (0.0007) [2023-12-28 00:53:51,684][106226] Updated weights for policy 0, policy_version 785170 (0.0009) [2023-12-28 00:53:51,751][106226] Updated weights for policy 0, policy_version 785180 (0.0008) [2023-12-28 00:53:51,807][106226] Updated weights for policy 0, policy_version 785190 (0.0009) [2023-12-28 00:53:52,343][106225] Updated weights for policy 1, policy_version 787345 (0.0008) [2023-12-28 00:53:52,410][106225] Updated weights for policy 1, policy_version 787355 (0.0009) [2023-12-28 00:53:52,468][106225] Updated weights for policy 1, policy_version 787365 (0.0011) [2023-12-28 00:53:52,600][106226] Updated weights for policy 0, policy_version 785200 (0.0010) [2023-12-28 00:53:52,657][106226] Updated weights for policy 0, policy_version 785210 (0.0009) [2023-12-28 00:53:52,715][106226] Updated weights for policy 0, policy_version 785220 (0.0008) [2023-12-28 00:53:53,148][106225] Updated weights for policy 1, policy_version 787375 (0.0007) [2023-12-28 00:53:53,193][106225] Updated weights for policy 1, policy_version 787385 (0.0005) [2023-12-28 00:53:53,243][106225] Updated weights for policy 1, policy_version 787395 (0.0007) [2023-12-28 00:53:53,455][106226] Updated weights for policy 0, policy_version 785230 (0.0009) [2023-12-28 00:53:53,512][106226] Updated weights for policy 0, policy_version 785240 (0.0010) [2023-12-28 00:53:53,562][106226] Updated weights for policy 0, policy_version 785250 (0.0010) [2023-12-28 00:53:54,002][106225] Updated weights for policy 1, policy_version 787405 (0.0008) [2023-12-28 00:53:54,063][106225] Updated weights for policy 1, policy_version 787415 (0.0008) [2023-12-28 00:53:54,120][106225] Updated weights for policy 1, policy_version 787425 (0.0007) [2023-12-28 00:53:54,192][106226] Updated weights for policy 0, policy_version 785260 (0.0011) [2023-12-28 00:53:54,244][106226] Updated weights for policy 0, policy_version 785270 (0.0009) [2023-12-28 00:53:54,301][106226] Updated weights for policy 0, policy_version 785280 (0.0006) [2023-12-28 00:53:54,843][106225] Updated weights for policy 1, policy_version 787435 (0.0009) [2023-12-28 00:53:54,902][106225] Updated weights for policy 1, policy_version 787445 (0.0010) [2023-12-28 00:53:54,952][106225] Updated weights for policy 1, policy_version 787455 (0.0010) [2023-12-28 00:53:54,978][106226] Updated weights for policy 0, policy_version 785290 (0.0006) [2023-12-28 00:53:55,036][106226] Updated weights for policy 0, policy_version 785300 (0.0007) [2023-12-28 00:53:55,090][106226] Updated weights for policy 0, policy_version 785310 (0.0008) [2023-12-28 00:53:55,153][106226] Updated weights for policy 0, policy_version 785320 (0.0008) [2023-12-28 00:53:55,655][106225] Updated weights for policy 1, policy_version 787465 (0.0010) [2023-12-28 00:53:55,705][106225] Updated weights for policy 1, policy_version 787475 (0.0010) [2023-12-28 00:53:55,754][106225] Updated weights for policy 1, policy_version 787485 (0.0010) [2023-12-28 00:53:55,811][106225] Updated weights for policy 1, policy_version 787495 (0.0011) [2023-12-28 00:53:55,878][106226] Updated weights for policy 0, policy_version 785330 (0.0008) [2023-12-28 00:53:55,942][106226] Updated weights for policy 0, policy_version 785340 (0.0008) [2023-12-28 00:53:55,995][106226] Updated weights for policy 0, policy_version 785350 (0.0008) [2023-12-28 00:53:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 402743296. Throughput: 0: 10055.9, 1: 9976.0. Samples: 402710944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:53:56,176][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.842')] [2023-12-28 00:53:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000787496_201637888.pth... [2023-12-28 00:53:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000785352_201105408.pth... [2023-12-28 00:53:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000786312_201334784.pth [2023-12-28 00:53:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000784168_200802304.pth [2023-12-28 00:53:56,435][106225] Updated weights for policy 1, policy_version 787505 (0.0010) [2023-12-28 00:53:56,487][106225] Updated weights for policy 1, policy_version 787515 (0.0007) [2023-12-28 00:53:56,541][106225] Updated weights for policy 1, policy_version 787525 (0.0010) [2023-12-28 00:53:56,730][106226] Updated weights for policy 0, policy_version 785360 (0.0006) [2023-12-28 00:53:56,786][106226] Updated weights for policy 0, policy_version 785370 (0.0011) [2023-12-28 00:53:56,838][106226] Updated weights for policy 0, policy_version 785380 (0.0006) [2023-12-28 00:53:57,179][106225] Updated weights for policy 1, policy_version 787535 (0.0008) [2023-12-28 00:53:57,231][106225] Updated weights for policy 1, policy_version 787545 (0.0009) [2023-12-28 00:53:57,279][106225] Updated weights for policy 1, policy_version 787555 (0.0010) [2023-12-28 00:53:57,443][106226] Updated weights for policy 0, policy_version 785390 (0.0006) [2023-12-28 00:53:57,501][106226] Updated weights for policy 0, policy_version 785400 (0.0007) [2023-12-28 00:53:57,563][106226] Updated weights for policy 0, policy_version 785410 (0.0005) [2023-12-28 00:53:58,111][106225] Updated weights for policy 1, policy_version 787565 (0.0008) [2023-12-28 00:53:58,121][106226] Updated weights for policy 0, policy_version 785420 (0.0005) [2023-12-28 00:53:58,166][106225] Updated weights for policy 1, policy_version 787575 (0.0006) [2023-12-28 00:53:58,179][106226] Updated weights for policy 0, policy_version 785430 (0.0007) [2023-12-28 00:53:58,232][106225] Updated weights for policy 1, policy_version 787585 (0.0008) [2023-12-28 00:53:58,242][106226] Updated weights for policy 0, policy_version 785440 (0.0007) [2023-12-28 00:53:58,961][106226] Updated weights for policy 0, policy_version 785450 (0.0007) [2023-12-28 00:53:59,024][106226] Updated weights for policy 0, policy_version 785460 (0.0007) [2023-12-28 00:53:59,049][106225] Updated weights for policy 1, policy_version 787595 (0.0009) [2023-12-28 00:53:59,089][106226] Updated weights for policy 0, policy_version 785470 (0.0007) [2023-12-28 00:53:59,114][106225] Updated weights for policy 1, policy_version 787605 (0.0011) [2023-12-28 00:53:59,146][106226] Updated weights for policy 0, policy_version 785480 (0.0006) [2023-12-28 00:53:59,174][106225] Updated weights for policy 1, policy_version 787615 (0.0010) [2023-12-28 00:53:59,844][106226] Updated weights for policy 0, policy_version 785490 (0.0007) [2023-12-28 00:53:59,904][106226] Updated weights for policy 0, policy_version 785500 (0.0007) [2023-12-28 00:53:59,909][106225] Updated weights for policy 1, policy_version 787625 (0.0009) [2023-12-28 00:53:59,971][106225] Updated weights for policy 1, policy_version 787635 (0.0009) [2023-12-28 00:53:59,975][106226] Updated weights for policy 0, policy_version 785510 (0.0009) [2023-12-28 00:54:00,029][106225] Updated weights for policy 1, policy_version 787645 (0.0009) [2023-12-28 00:54:00,082][106225] Updated weights for policy 1, policy_version 787655 (0.0009) [2023-12-28 00:54:00,658][106226] Updated weights for policy 0, policy_version 785520 (0.0009) [2023-12-28 00:54:00,723][106226] Updated weights for policy 0, policy_version 785530 (0.0006) [2023-12-28 00:54:00,782][106226] Updated weights for policy 0, policy_version 785540 (0.0010) [2023-12-28 00:54:00,810][106225] Updated weights for policy 1, policy_version 787665 (0.0009) [2023-12-28 00:54:00,866][106225] Updated weights for policy 1, policy_version 787675 (0.0010) [2023-12-28 00:54:00,926][106225] Updated weights for policy 1, policy_version 787685 (0.0010) [2023-12-28 00:54:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 402841600. Throughput: 0: 10072.7, 1: 9941.9. Samples: 402828564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:01,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.039')] [2023-12-28 00:54:01,519][106226] Updated weights for policy 0, policy_version 785550 (0.0010) [2023-12-28 00:54:01,566][106226] Updated weights for policy 0, policy_version 785560 (0.0009) [2023-12-28 00:54:01,610][106225] Updated weights for policy 1, policy_version 787695 (0.0008) [2023-12-28 00:54:01,628][106226] Updated weights for policy 0, policy_version 785570 (0.0006) [2023-12-28 00:54:01,677][106225] Updated weights for policy 1, policy_version 787705 (0.0007) [2023-12-28 00:54:01,751][106225] Updated weights for policy 1, policy_version 787715 (0.0009) [2023-12-28 00:54:02,335][106226] Updated weights for policy 0, policy_version 785580 (0.0008) [2023-12-28 00:54:02,403][106226] Updated weights for policy 0, policy_version 785590 (0.0009) [2023-12-28 00:54:02,455][106226] Updated weights for policy 0, policy_version 785600 (0.0008) [2023-12-28 00:54:02,483][106225] Updated weights for policy 1, policy_version 787725 (0.0008) [2023-12-28 00:54:02,540][106225] Updated weights for policy 1, policy_version 787735 (0.0008) [2023-12-28 00:54:02,593][106225] Updated weights for policy 1, policy_version 787745 (0.0009) [2023-12-28 00:54:03,201][106226] Updated weights for policy 0, policy_version 785610 (0.0007) [2023-12-28 00:54:03,260][106226] Updated weights for policy 0, policy_version 785620 (0.0006) [2023-12-28 00:54:03,312][106225] Updated weights for policy 1, policy_version 787755 (0.0007) [2023-12-28 00:54:03,325][106226] Updated weights for policy 0, policy_version 785630 (0.0005) [2023-12-28 00:54:03,374][106225] Updated weights for policy 1, policy_version 787765 (0.0007) [2023-12-28 00:54:03,382][106226] Updated weights for policy 0, policy_version 785640 (0.0005) [2023-12-28 00:54:03,441][106225] Updated weights for policy 1, policy_version 787775 (0.0005) [2023-12-28 00:54:04,005][106226] Updated weights for policy 0, policy_version 785650 (0.0008) [2023-12-28 00:54:04,009][106225] Updated weights for policy 1, policy_version 787785 (0.0006) [2023-12-28 00:54:04,068][106225] Updated weights for policy 1, policy_version 787795 (0.0010) [2023-12-28 00:54:04,073][106226] Updated weights for policy 0, policy_version 785660 (0.0007) [2023-12-28 00:54:04,128][106225] Updated weights for policy 1, policy_version 787805 (0.0010) [2023-12-28 00:54:04,138][106226] Updated weights for policy 0, policy_version 785670 (0.0006) [2023-12-28 00:54:04,190][106225] Updated weights for policy 1, policy_version 787815 (0.0010) [2023-12-28 00:54:04,802][106225] Updated weights for policy 1, policy_version 787825 (0.0010) [2023-12-28 00:54:04,844][106226] Updated weights for policy 0, policy_version 785680 (0.0008) [2023-12-28 00:54:04,860][106225] Updated weights for policy 1, policy_version 787835 (0.0009) [2023-12-28 00:54:04,902][106226] Updated weights for policy 0, policy_version 785690 (0.0011) [2023-12-28 00:54:04,912][106225] Updated weights for policy 1, policy_version 787845 (0.0005) [2023-12-28 00:54:04,959][106226] Updated weights for policy 0, policy_version 785700 (0.0009) [2023-12-28 00:54:05,556][106225] Updated weights for policy 1, policy_version 787855 (0.0010) [2023-12-28 00:54:05,609][106225] Updated weights for policy 1, policy_version 787865 (0.0010) [2023-12-28 00:54:05,622][106226] Updated weights for policy 0, policy_version 785710 (0.0008) [2023-12-28 00:54:05,660][106225] Updated weights for policy 1, policy_version 787875 (0.0010) [2023-12-28 00:54:05,681][106226] Updated weights for policy 0, policy_version 785720 (0.0007) [2023-12-28 00:54:05,731][106226] Updated weights for policy 0, policy_version 785730 (0.0008) [2023-12-28 00:54:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 402939904. Throughput: 0: 10068.4, 1: 10029.5. Samples: 402948612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:06,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.177')] [2023-12-28 00:54:06,354][106225] Updated weights for policy 1, policy_version 787885 (0.0010) [2023-12-28 00:54:06,415][106225] Updated weights for policy 1, policy_version 787895 (0.0010) [2023-12-28 00:54:06,480][106225] Updated weights for policy 1, policy_version 787905 (0.0010) [2023-12-28 00:54:06,561][106226] Updated weights for policy 0, policy_version 785740 (0.0008) [2023-12-28 00:54:06,627][106226] Updated weights for policy 0, policy_version 785750 (0.0008) [2023-12-28 00:54:06,693][106226] Updated weights for policy 0, policy_version 785760 (0.0008) [2023-12-28 00:54:07,225][106225] Updated weights for policy 1, policy_version 787915 (0.0009) [2023-12-28 00:54:07,286][106225] Updated weights for policy 1, policy_version 787925 (0.0008) [2023-12-28 00:54:07,347][106225] Updated weights for policy 1, policy_version 787935 (0.0008) [2023-12-28 00:54:07,379][106226] Updated weights for policy 0, policy_version 785770 (0.0008) [2023-12-28 00:54:07,440][106226] Updated weights for policy 0, policy_version 785780 (0.0008) [2023-12-28 00:54:07,502][106226] Updated weights for policy 0, policy_version 785790 (0.0009) [2023-12-28 00:54:07,556][106226] Updated weights for policy 0, policy_version 785800 (0.0007) [2023-12-28 00:54:08,034][106225] Updated weights for policy 1, policy_version 787945 (0.0010) [2023-12-28 00:54:08,080][106225] Updated weights for policy 1, policy_version 787955 (0.0010) [2023-12-28 00:54:08,136][106225] Updated weights for policy 1, policy_version 787965 (0.0010) [2023-12-28 00:54:08,182][106225] Updated weights for policy 1, policy_version 787975 (0.0009) [2023-12-28 00:54:08,195][106226] Updated weights for policy 0, policy_version 785810 (0.0011) [2023-12-28 00:54:08,254][106226] Updated weights for policy 0, policy_version 785820 (0.0011) [2023-12-28 00:54:08,315][106226] Updated weights for policy 0, policy_version 785830 (0.0010) [2023-12-28 00:54:08,921][106225] Updated weights for policy 1, policy_version 787985 (0.0010) [2023-12-28 00:54:08,978][106225] Updated weights for policy 1, policy_version 787995 (0.0010) [2023-12-28 00:54:09,038][106225] Updated weights for policy 1, policy_version 788005 (0.0010) [2023-12-28 00:54:09,080][106226] Updated weights for policy 0, policy_version 785840 (0.0010) [2023-12-28 00:54:09,137][106226] Updated weights for policy 0, policy_version 785850 (0.0010) [2023-12-28 00:54:09,186][106226] Updated weights for policy 0, policy_version 785860 (0.0010) [2023-12-28 00:54:09,799][106225] Updated weights for policy 1, policy_version 788015 (0.0010) [2023-12-28 00:54:09,865][106225] Updated weights for policy 1, policy_version 788025 (0.0011) [2023-12-28 00:54:09,898][106226] Updated weights for policy 0, policy_version 785870 (0.0009) [2023-12-28 00:54:09,930][106225] Updated weights for policy 1, policy_version 788035 (0.0011) [2023-12-28 00:54:09,961][106226] Updated weights for policy 0, policy_version 785880 (0.0011) [2023-12-28 00:54:10,030][106226] Updated weights for policy 0, policy_version 785890 (0.0011) [2023-12-28 00:54:10,668][106225] Updated weights for policy 1, policy_version 788045 (0.0009) [2023-12-28 00:54:10,715][106225] Updated weights for policy 1, policy_version 788055 (0.0010) [2023-12-28 00:54:10,775][106225] Updated weights for policy 1, policy_version 788065 (0.0010) [2023-12-28 00:54:10,790][106226] Updated weights for policy 0, policy_version 785900 (0.0009) [2023-12-28 00:54:10,852][106226] Updated weights for policy 0, policy_version 785910 (0.0008) [2023-12-28 00:54:10,913][106226] Updated weights for policy 0, policy_version 785920 (0.0009) [2023-12-28 00:54:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 403038208. Throughput: 0: 10052.0, 1: 10056.6. Samples: 403007500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:11,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-5.037')] [2023-12-28 00:54:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000785928_201252864.pth... [2023-12-28 00:54:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000788072_201785344.pth... [2023-12-28 00:54:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000784776_200957952.pth [2023-12-28 00:54:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000786920_201490432.pth [2023-12-28 00:54:11,516][106225] Updated weights for policy 1, policy_version 788075 (0.0008) [2023-12-28 00:54:11,576][106225] Updated weights for policy 1, policy_version 788085 (0.0008) [2023-12-28 00:54:11,643][106225] Updated weights for policy 1, policy_version 788095 (0.0009) [2023-12-28 00:54:11,745][106226] Updated weights for policy 0, policy_version 785930 (0.0008) [2023-12-28 00:54:11,820][106226] Updated weights for policy 0, policy_version 785940 (0.0011) [2023-12-28 00:54:11,887][106226] Updated weights for policy 0, policy_version 785950 (0.0011) [2023-12-28 00:54:11,960][106226] Updated weights for policy 0, policy_version 785960 (0.0011) [2023-12-28 00:54:12,397][106225] Updated weights for policy 1, policy_version 788105 (0.0008) [2023-12-28 00:54:12,450][106225] Updated weights for policy 1, policy_version 788115 (0.0007) [2023-12-28 00:54:12,510][106225] Updated weights for policy 1, policy_version 788125 (0.0005) [2023-12-28 00:54:12,561][106225] Updated weights for policy 1, policy_version 788135 (0.0006) [2023-12-28 00:54:12,657][106226] Updated weights for policy 0, policy_version 785970 (0.0008) [2023-12-28 00:54:12,718][106226] Updated weights for policy 0, policy_version 785980 (0.0009) [2023-12-28 00:54:12,771][106226] Updated weights for policy 0, policy_version 785990 (0.0008) [2023-12-28 00:54:13,149][106225] Updated weights for policy 1, policy_version 788145 (0.0008) [2023-12-28 00:54:13,212][106225] Updated weights for policy 1, policy_version 788155 (0.0008) [2023-12-28 00:54:13,275][106225] Updated weights for policy 1, policy_version 788165 (0.0009) [2023-12-28 00:54:13,490][106226] Updated weights for policy 0, policy_version 786000 (0.0008) [2023-12-28 00:54:13,549][106226] Updated weights for policy 0, policy_version 786010 (0.0007) [2023-12-28 00:54:13,601][106226] Updated weights for policy 0, policy_version 786020 (0.0009) [2023-12-28 00:54:14,009][106225] Updated weights for policy 1, policy_version 788175 (0.0009) [2023-12-28 00:54:14,075][106225] Updated weights for policy 1, policy_version 788185 (0.0010) [2023-12-28 00:54:14,135][106225] Updated weights for policy 1, policy_version 788195 (0.0009) [2023-12-28 00:54:14,301][106226] Updated weights for policy 0, policy_version 786030 (0.0008) [2023-12-28 00:54:14,356][106226] Updated weights for policy 0, policy_version 786040 (0.0008) [2023-12-28 00:54:14,418][106226] Updated weights for policy 0, policy_version 786050 (0.0010) [2023-12-28 00:54:14,752][106225] Updated weights for policy 1, policy_version 788205 (0.0007) [2023-12-28 00:54:14,817][106225] Updated weights for policy 1, policy_version 788215 (0.0008) [2023-12-28 00:54:14,870][106225] Updated weights for policy 1, policy_version 788225 (0.0010) [2023-12-28 00:54:15,148][106226] Updated weights for policy 0, policy_version 786060 (0.0008) [2023-12-28 00:54:15,203][106226] Updated weights for policy 0, policy_version 786070 (0.0011) [2023-12-28 00:54:15,261][106226] Updated weights for policy 0, policy_version 786080 (0.0011) [2023-12-28 00:54:15,580][106225] Updated weights for policy 1, policy_version 788235 (0.0011) [2023-12-28 00:54:15,646][106225] Updated weights for policy 1, policy_version 788245 (0.0010) [2023-12-28 00:54:15,717][106225] Updated weights for policy 1, policy_version 788255 (0.0010) [2023-12-28 00:54:15,905][106226] Updated weights for policy 0, policy_version 786090 (0.0011) [2023-12-28 00:54:15,958][106226] Updated weights for policy 0, policy_version 786100 (0.0011) [2023-12-28 00:54:16,015][106226] Updated weights for policy 0, policy_version 786110 (0.0011) [2023-12-28 00:54:16,075][106226] Updated weights for policy 0, policy_version 786120 (0.0011) [2023-12-28 00:54:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 403136512. Throughput: 0: 9843.0, 1: 9995.2. Samples: 403123076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:16,176][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.757')] [2023-12-28 00:54:16,407][106225] Updated weights for policy 1, policy_version 788265 (0.0010) [2023-12-28 00:54:16,463][106225] Updated weights for policy 1, policy_version 788275 (0.0010) [2023-12-28 00:54:16,516][106225] Updated weights for policy 1, policy_version 788285 (0.0010) [2023-12-28 00:54:16,571][106225] Updated weights for policy 1, policy_version 788295 (0.0010) [2023-12-28 00:54:16,773][106226] Updated weights for policy 0, policy_version 786130 (0.0008) [2023-12-28 00:54:16,832][106226] Updated weights for policy 0, policy_version 786140 (0.0008) [2023-12-28 00:54:16,896][106226] Updated weights for policy 0, policy_version 786150 (0.0008) [2023-12-28 00:54:17,266][106225] Updated weights for policy 1, policy_version 788305 (0.0006) [2023-12-28 00:54:17,322][106225] Updated weights for policy 1, policy_version 788315 (0.0005) [2023-12-28 00:54:17,378][106225] Updated weights for policy 1, policy_version 788325 (0.0006) [2023-12-28 00:54:17,572][106226] Updated weights for policy 0, policy_version 786160 (0.0006) [2023-12-28 00:54:17,637][106226] Updated weights for policy 0, policy_version 786170 (0.0006) [2023-12-28 00:54:17,699][106226] Updated weights for policy 0, policy_version 786180 (0.0009) [2023-12-28 00:54:17,989][106225] Updated weights for policy 1, policy_version 788335 (0.0007) [2023-12-28 00:54:18,047][106225] Updated weights for policy 1, policy_version 788345 (0.0006) [2023-12-28 00:54:18,107][106225] Updated weights for policy 1, policy_version 788355 (0.0007) [2023-12-28 00:54:18,432][106226] Updated weights for policy 0, policy_version 786190 (0.0008) [2023-12-28 00:54:18,485][106226] Updated weights for policy 0, policy_version 786200 (0.0010) [2023-12-28 00:54:18,532][106226] Updated weights for policy 0, policy_version 786210 (0.0010) [2023-12-28 00:54:18,802][106225] Updated weights for policy 1, policy_version 788365 (0.0010) [2023-12-28 00:54:18,857][106225] Updated weights for policy 1, policy_version 788375 (0.0010) [2023-12-28 00:54:18,908][106225] Updated weights for policy 1, policy_version 788385 (0.0010) [2023-12-28 00:54:19,207][106226] Updated weights for policy 0, policy_version 786220 (0.0011) [2023-12-28 00:54:19,272][106226] Updated weights for policy 0, policy_version 786230 (0.0012) [2023-12-28 00:54:19,336][106226] Updated weights for policy 0, policy_version 786240 (0.0008) [2023-12-28 00:54:19,697][106225] Updated weights for policy 1, policy_version 788395 (0.0010) [2023-12-28 00:54:19,758][106225] Updated weights for policy 1, policy_version 788405 (0.0009) [2023-12-28 00:54:19,827][106225] Updated weights for policy 1, policy_version 788415 (0.0008) [2023-12-28 00:54:20,116][106226] Updated weights for policy 0, policy_version 786250 (0.0008) [2023-12-28 00:54:20,182][106226] Updated weights for policy 0, policy_version 786260 (0.0008) [2023-12-28 00:54:20,249][106226] Updated weights for policy 0, policy_version 786270 (0.0006) [2023-12-28 00:54:20,314][106226] Updated weights for policy 0, policy_version 786280 (0.0007) [2023-12-28 00:54:20,568][106225] Updated weights for policy 1, policy_version 788425 (0.0009) [2023-12-28 00:54:20,634][106225] Updated weights for policy 1, policy_version 788435 (0.0008) [2023-12-28 00:54:20,691][106225] Updated weights for policy 1, policy_version 788445 (0.0009) [2023-12-28 00:54:20,749][106225] Updated weights for policy 1, policy_version 788455 (0.0008) [2023-12-28 00:54:20,947][106226] Updated weights for policy 0, policy_version 786290 (0.0008) [2023-12-28 00:54:21,006][106226] Updated weights for policy 0, policy_version 786300 (0.0006) [2023-12-28 00:54:21,077][106226] Updated weights for policy 0, policy_version 786310 (0.0008) [2023-12-28 00:54:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 403234816. Throughput: 0: 9812.6, 1: 9934.9. Samples: 403241556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:21,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-5.170')] [2023-12-28 00:54:21,546][106225] Updated weights for policy 1, policy_version 788465 (0.0010) [2023-12-28 00:54:21,620][106225] Updated weights for policy 1, policy_version 788475 (0.0009) [2023-12-28 00:54:21,696][106225] Updated weights for policy 1, policy_version 788485 (0.0009) [2023-12-28 00:54:21,815][106226] Updated weights for policy 0, policy_version 786320 (0.0007) [2023-12-28 00:54:21,877][106226] Updated weights for policy 0, policy_version 786330 (0.0006) [2023-12-28 00:54:21,944][106226] Updated weights for policy 0, policy_version 786340 (0.0008) [2023-12-28 00:54:22,450][106225] Updated weights for policy 1, policy_version 788495 (0.0009) [2023-12-28 00:54:22,503][106225] Updated weights for policy 1, policy_version 788505 (0.0008) [2023-12-28 00:54:22,556][106225] Updated weights for policy 1, policy_version 788515 (0.0008) [2023-12-28 00:54:22,664][106226] Updated weights for policy 0, policy_version 786350 (0.0007) [2023-12-28 00:54:22,724][106226] Updated weights for policy 0, policy_version 786360 (0.0006) [2023-12-28 00:54:22,785][106226] Updated weights for policy 0, policy_version 786370 (0.0006) [2023-12-28 00:54:23,295][106225] Updated weights for policy 1, policy_version 788525 (0.0008) [2023-12-28 00:54:23,342][106225] Updated weights for policy 1, policy_version 788535 (0.0008) [2023-12-28 00:54:23,391][106226] Updated weights for policy 0, policy_version 786380 (0.0008) [2023-12-28 00:54:23,392][106225] Updated weights for policy 1, policy_version 788545 (0.0008) [2023-12-28 00:54:23,444][106226] Updated weights for policy 0, policy_version 786390 (0.0010) [2023-12-28 00:54:23,497][106226] Updated weights for policy 0, policy_version 786400 (0.0010) [2023-12-28 00:54:24,134][106226] Updated weights for policy 0, policy_version 786410 (0.0010) [2023-12-28 00:54:24,203][106226] Updated weights for policy 0, policy_version 786420 (0.0011) [2023-12-28 00:54:24,217][106225] Updated weights for policy 1, policy_version 788555 (0.0007) [2023-12-28 00:54:24,265][106226] Updated weights for policy 0, policy_version 786430 (0.0011) [2023-12-28 00:54:24,279][106225] Updated weights for policy 1, policy_version 788565 (0.0007) [2023-12-28 00:54:24,331][106226] Updated weights for policy 0, policy_version 786440 (0.0011) [2023-12-28 00:54:24,337][106225] Updated weights for policy 1, policy_version 788575 (0.0007) [2023-12-28 00:54:24,953][106225] Updated weights for policy 1, policy_version 788585 (0.0006) [2023-12-28 00:54:25,012][106225] Updated weights for policy 1, policy_version 788595 (0.0006) [2023-12-28 00:54:25,043][106226] Updated weights for policy 0, policy_version 786450 (0.0009) [2023-12-28 00:54:25,065][106225] Updated weights for policy 1, policy_version 788605 (0.0007) [2023-12-28 00:54:25,091][106226] Updated weights for policy 0, policy_version 786460 (0.0006) [2023-12-28 00:54:25,112][106225] Updated weights for policy 1, policy_version 788615 (0.0006) [2023-12-28 00:54:25,142][106226] Updated weights for policy 0, policy_version 786470 (0.0007) [2023-12-28 00:54:25,746][106225] Updated weights for policy 1, policy_version 788625 (0.0005) [2023-12-28 00:54:25,807][106225] Updated weights for policy 1, policy_version 788635 (0.0005) [2023-12-28 00:54:25,841][106226] Updated weights for policy 0, policy_version 786480 (0.0006) [2023-12-28 00:54:25,861][106225] Updated weights for policy 1, policy_version 788645 (0.0006) [2023-12-28 00:54:25,897][106226] Updated weights for policy 0, policy_version 786490 (0.0007) [2023-12-28 00:54:25,961][106226] Updated weights for policy 0, policy_version 786500 (0.0006) [2023-12-28 00:54:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 403333120. Throughput: 0: 9875.0, 1: 9850.4. Samples: 403299612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:26,176][105115] Avg episode reward: [(0, '-4.473'), (1, '-5.194')] [2023-12-28 00:54:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000786504_201400320.pth... [2023-12-28 00:54:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000788648_201932800.pth... [2023-12-28 00:54:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000785352_201105408.pth [2023-12-28 00:54:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000787496_201637888.pth [2023-12-28 00:54:26,544][106225] Updated weights for policy 1, policy_version 788655 (0.0007) [2023-12-28 00:54:26,549][106226] Updated weights for policy 0, policy_version 786510 (0.0007) [2023-12-28 00:54:26,591][106225] Updated weights for policy 1, policy_version 788665 (0.0006) [2023-12-28 00:54:26,607][106226] Updated weights for policy 0, policy_version 786520 (0.0008) [2023-12-28 00:54:26,636][106225] Updated weights for policy 1, policy_version 788675 (0.0008) [2023-12-28 00:54:26,665][106226] Updated weights for policy 0, policy_version 786530 (0.0006) [2023-12-28 00:54:27,374][106226] Updated weights for policy 0, policy_version 786540 (0.0008) [2023-12-28 00:54:27,382][106225] Updated weights for policy 1, policy_version 788685 (0.0007) [2023-12-28 00:54:27,428][106225] Updated weights for policy 1, policy_version 788695 (0.0005) [2023-12-28 00:54:27,430][106226] Updated weights for policy 0, policy_version 786550 (0.0008) [2023-12-28 00:54:27,480][106225] Updated weights for policy 1, policy_version 788705 (0.0007) [2023-12-28 00:54:27,486][106226] Updated weights for policy 0, policy_version 786560 (0.0009) [2023-12-28 00:54:28,067][106225] Updated weights for policy 1, policy_version 788715 (0.0007) [2023-12-28 00:54:28,124][106225] Updated weights for policy 1, policy_version 788725 (0.0005) [2023-12-28 00:54:28,182][106225] Updated weights for policy 1, policy_version 788735 (0.0005) [2023-12-28 00:54:28,220][106226] Updated weights for policy 0, policy_version 786570 (0.0007) [2023-12-28 00:54:28,280][106226] Updated weights for policy 0, policy_version 786580 (0.0008) [2023-12-28 00:54:28,347][106226] Updated weights for policy 0, policy_version 786590 (0.0008) [2023-12-28 00:54:28,414][106226] Updated weights for policy 0, policy_version 786600 (0.0008) [2023-12-28 00:54:28,838][106225] Updated weights for policy 1, policy_version 788745 (0.0007) [2023-12-28 00:54:28,886][106225] Updated weights for policy 1, policy_version 788755 (0.0009) [2023-12-28 00:54:28,933][106225] Updated weights for policy 1, policy_version 788765 (0.0008) [2023-12-28 00:54:28,991][106225] Updated weights for policy 1, policy_version 788775 (0.0008) [2023-12-28 00:54:29,107][106226] Updated weights for policy 0, policy_version 786610 (0.0009) [2023-12-28 00:54:29,162][106226] Updated weights for policy 0, policy_version 786620 (0.0008) [2023-12-28 00:54:29,220][106226] Updated weights for policy 0, policy_version 786630 (0.0008) [2023-12-28 00:54:29,780][106225] Updated weights for policy 1, policy_version 788785 (0.0009) [2023-12-28 00:54:29,844][106225] Updated weights for policy 1, policy_version 788795 (0.0008) [2023-12-28 00:54:29,901][106225] Updated weights for policy 1, policy_version 788805 (0.0008) [2023-12-28 00:54:29,929][106226] Updated weights for policy 0, policy_version 786640 (0.0006) [2023-12-28 00:54:29,994][106226] Updated weights for policy 0, policy_version 786650 (0.0009) [2023-12-28 00:54:30,055][106226] Updated weights for policy 0, policy_version 786660 (0.0008) [2023-12-28 00:54:30,611][106225] Updated weights for policy 1, policy_version 788815 (0.0008) [2023-12-28 00:54:30,669][106225] Updated weights for policy 1, policy_version 788825 (0.0007) [2023-12-28 00:54:30,721][106225] Updated weights for policy 1, policy_version 788835 (0.0008) [2023-12-28 00:54:30,735][106226] Updated weights for policy 0, policy_version 786670 (0.0009) [2023-12-28 00:54:30,784][106226] Updated weights for policy 0, policy_version 786680 (0.0010) [2023-12-28 00:54:30,830][106226] Updated weights for policy 0, policy_version 786690 (0.0010) [2023-12-28 00:54:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 403431424. Throughput: 0: 9876.6, 1: 9959.1. Samples: 403420992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:31,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.965')] [2023-12-28 00:54:31,490][106225] Updated weights for policy 1, policy_version 788845 (0.0007) [2023-12-28 00:54:31,543][106225] Updated weights for policy 1, policy_version 788855 (0.0008) [2023-12-28 00:54:31,581][106226] Updated weights for policy 0, policy_version 786700 (0.0010) [2023-12-28 00:54:31,594][106225] Updated weights for policy 1, policy_version 788865 (0.0008) [2023-12-28 00:54:31,649][106226] Updated weights for policy 0, policy_version 786710 (0.0009) [2023-12-28 00:54:31,720][106226] Updated weights for policy 0, policy_version 786720 (0.0010) [2023-12-28 00:54:32,362][106225] Updated weights for policy 1, policy_version 788875 (0.0008) [2023-12-28 00:54:32,427][106225] Updated weights for policy 1, policy_version 788885 (0.0010) [2023-12-28 00:54:32,449][106226] Updated weights for policy 0, policy_version 786730 (0.0009) [2023-12-28 00:54:32,489][106225] Updated weights for policy 1, policy_version 788895 (0.0010) [2023-12-28 00:54:32,506][106226] Updated weights for policy 0, policy_version 786740 (0.0006) [2023-12-28 00:54:32,552][106226] Updated weights for policy 0, policy_version 786750 (0.0005) [2023-12-28 00:54:32,604][106226] Updated weights for policy 0, policy_version 786760 (0.0005) [2023-12-28 00:54:33,203][106225] Updated weights for policy 1, policy_version 788905 (0.0009) [2023-12-28 00:54:33,241][106226] Updated weights for policy 0, policy_version 786770 (0.0006) [2023-12-28 00:54:33,256][106225] Updated weights for policy 1, policy_version 788915 (0.0010) [2023-12-28 00:54:33,299][106225] Updated weights for policy 1, policy_version 788925 (0.0010) [2023-12-28 00:54:33,301][106226] Updated weights for policy 0, policy_version 786780 (0.0005) [2023-12-28 00:54:33,353][106225] Updated weights for policy 1, policy_version 788935 (0.0010) [2023-12-28 00:54:33,362][106226] Updated weights for policy 0, policy_version 786790 (0.0005) [2023-12-28 00:54:33,939][106226] Updated weights for policy 0, policy_version 786800 (0.0006) [2023-12-28 00:54:33,990][106226] Updated weights for policy 0, policy_version 786810 (0.0005) [2023-12-28 00:54:34,048][106225] Updated weights for policy 1, policy_version 788945 (0.0006) [2023-12-28 00:54:34,053][106226] Updated weights for policy 0, policy_version 786820 (0.0005) [2023-12-28 00:54:34,108][106225] Updated weights for policy 1, policy_version 788955 (0.0010) [2023-12-28 00:54:34,179][106225] Updated weights for policy 1, policy_version 788965 (0.0010) [2023-12-28 00:54:34,679][106226] Updated weights for policy 0, policy_version 786830 (0.0007) [2023-12-28 00:54:34,733][106226] Updated weights for policy 0, policy_version 786840 (0.0007) [2023-12-28 00:54:34,797][106226] Updated weights for policy 0, policy_version 786850 (0.0008) [2023-12-28 00:54:34,871][106225] Updated weights for policy 1, policy_version 788975 (0.0010) [2023-12-28 00:54:34,921][106225] Updated weights for policy 1, policy_version 788985 (0.0010) [2023-12-28 00:54:34,967][106225] Updated weights for policy 1, policy_version 788995 (0.0010) [2023-12-28 00:54:35,545][106226] Updated weights for policy 0, policy_version 786860 (0.0008) [2023-12-28 00:54:35,605][106226] Updated weights for policy 0, policy_version 786870 (0.0008) [2023-12-28 00:54:35,677][106226] Updated weights for policy 0, policy_version 786880 (0.0009) [2023-12-28 00:54:35,692][106225] Updated weights for policy 1, policy_version 789005 (0.0008) [2023-12-28 00:54:35,744][106225] Updated weights for policy 1, policy_version 789015 (0.0005) [2023-12-28 00:54:35,794][106225] Updated weights for policy 1, policy_version 789025 (0.0005) [2023-12-28 00:54:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 403529728. Throughput: 0: 9889.6, 1: 9817.1. Samples: 403539884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:36,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.065')] [2023-12-28 00:54:36,409][106225] Updated weights for policy 1, policy_version 789035 (0.0007) [2023-12-28 00:54:36,415][106226] Updated weights for policy 0, policy_version 786890 (0.0008) [2023-12-28 00:54:36,471][106225] Updated weights for policy 1, policy_version 789045 (0.0011) [2023-12-28 00:54:36,478][106226] Updated weights for policy 0, policy_version 786900 (0.0006) [2023-12-28 00:54:36,532][106225] Updated weights for policy 1, policy_version 789055 (0.0008) [2023-12-28 00:54:36,532][106226] Updated weights for policy 0, policy_version 786910 (0.0008) [2023-12-28 00:54:36,594][106226] Updated weights for policy 0, policy_version 786920 (0.0007) [2023-12-28 00:54:37,273][106225] Updated weights for policy 1, policy_version 789065 (0.0006) [2023-12-28 00:54:37,324][106225] Updated weights for policy 1, policy_version 789075 (0.0010) [2023-12-28 00:54:37,375][106225] Updated weights for policy 1, policy_version 789085 (0.0010) [2023-12-28 00:54:37,375][106226] Updated weights for policy 0, policy_version 786930 (0.0011) [2023-12-28 00:54:37,433][106226] Updated weights for policy 0, policy_version 786940 (0.0008) [2023-12-28 00:54:37,437][106225] Updated weights for policy 1, policy_version 789095 (0.0011) [2023-12-28 00:54:37,488][106226] Updated weights for policy 0, policy_version 786950 (0.0009) [2023-12-28 00:54:38,019][106225] Updated weights for policy 1, policy_version 789105 (0.0010) [2023-12-28 00:54:38,067][106225] Updated weights for policy 1, policy_version 789115 (0.0006) [2023-12-28 00:54:38,115][106225] Updated weights for policy 1, policy_version 789125 (0.0005) [2023-12-28 00:54:38,243][106226] Updated weights for policy 0, policy_version 786960 (0.0008) [2023-12-28 00:54:38,295][106226] Updated weights for policy 0, policy_version 786970 (0.0010) [2023-12-28 00:54:38,362][106226] Updated weights for policy 0, policy_version 786980 (0.0008) [2023-12-28 00:54:38,747][106225] Updated weights for policy 1, policy_version 789135 (0.0009) [2023-12-28 00:54:38,795][106225] Updated weights for policy 1, policy_version 789145 (0.0010) [2023-12-28 00:54:38,860][106225] Updated weights for policy 1, policy_version 789155 (0.0010) [2023-12-28 00:54:39,030][106226] Updated weights for policy 0, policy_version 786990 (0.0008) [2023-12-28 00:54:39,103][106226] Updated weights for policy 0, policy_version 787000 (0.0008) [2023-12-28 00:54:39,170][106226] Updated weights for policy 0, policy_version 787010 (0.0010) [2023-12-28 00:54:39,582][106225] Updated weights for policy 1, policy_version 789165 (0.0009) [2023-12-28 00:54:39,643][106225] Updated weights for policy 1, policy_version 789175 (0.0008) [2023-12-28 00:54:39,707][106225] Updated weights for policy 1, policy_version 789185 (0.0009) [2023-12-28 00:54:39,882][106226] Updated weights for policy 0, policy_version 787020 (0.0009) [2023-12-28 00:54:39,952][106226] Updated weights for policy 0, policy_version 787030 (0.0008) [2023-12-28 00:54:40,016][106226] Updated weights for policy 0, policy_version 787040 (0.0009) [2023-12-28 00:54:40,386][106225] Updated weights for policy 1, policy_version 789195 (0.0009) [2023-12-28 00:54:40,452][106225] Updated weights for policy 1, policy_version 789205 (0.0009) [2023-12-28 00:54:40,521][106225] Updated weights for policy 1, policy_version 789215 (0.0009) [2023-12-28 00:54:40,785][106226] Updated weights for policy 0, policy_version 787050 (0.0009) [2023-12-28 00:54:40,851][106226] Updated weights for policy 0, policy_version 787060 (0.0010) [2023-12-28 00:54:40,905][106226] Updated weights for policy 0, policy_version 787070 (0.0010) [2023-12-28 00:54:40,959][106226] Updated weights for policy 0, policy_version 787080 (0.0010) [2023-12-28 00:54:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 403628032. Throughput: 0: 9896.2, 1: 9870.2. Samples: 403600428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:41,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.914')] [2023-12-28 00:54:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000789224_202080256.pth... [2023-12-28 00:54:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000787080_201547776.pth... [2023-12-28 00:54:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000785928_201252864.pth [2023-12-28 00:54:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000788072_201785344.pth [2023-12-28 00:54:41,242][106225] Updated weights for policy 1, policy_version 789225 (0.0008) [2023-12-28 00:54:41,312][106225] Updated weights for policy 1, policy_version 789235 (0.0007) [2023-12-28 00:54:41,382][106225] Updated weights for policy 1, policy_version 789245 (0.0008) [2023-12-28 00:54:41,444][106225] Updated weights for policy 1, policy_version 789255 (0.0010) [2023-12-28 00:54:41,705][106226] Updated weights for policy 0, policy_version 787090 (0.0007) [2023-12-28 00:54:41,774][106226] Updated weights for policy 0, policy_version 787100 (0.0008) [2023-12-28 00:54:41,839][106226] Updated weights for policy 0, policy_version 787110 (0.0009) [2023-12-28 00:54:42,171][106225] Updated weights for policy 1, policy_version 789265 (0.0006) [2023-12-28 00:54:42,227][106225] Updated weights for policy 1, policy_version 789275 (0.0005) [2023-12-28 00:54:42,293][106225] Updated weights for policy 1, policy_version 789285 (0.0006) [2023-12-28 00:54:42,541][106226] Updated weights for policy 0, policy_version 787120 (0.0008) [2023-12-28 00:54:42,601][106226] Updated weights for policy 0, policy_version 787130 (0.0008) [2023-12-28 00:54:42,664][106226] Updated weights for policy 0, policy_version 787140 (0.0009) [2023-12-28 00:54:42,958][106225] Updated weights for policy 1, policy_version 789295 (0.0008) [2023-12-28 00:54:43,008][106225] Updated weights for policy 1, policy_version 789305 (0.0009) [2023-12-28 00:54:43,063][106225] Updated weights for policy 1, policy_version 789315 (0.0009) [2023-12-28 00:54:43,263][106226] Updated weights for policy 0, policy_version 787150 (0.0009) [2023-12-28 00:54:43,315][106226] Updated weights for policy 0, policy_version 787160 (0.0008) [2023-12-28 00:54:43,374][106226] Updated weights for policy 0, policy_version 787170 (0.0008) [2023-12-28 00:54:43,920][106225] Updated weights for policy 1, policy_version 789325 (0.0009) [2023-12-28 00:54:43,932][106226] Updated weights for policy 0, policy_version 787180 (0.0007) [2023-12-28 00:54:43,981][106225] Updated weights for policy 1, policy_version 789335 (0.0008) [2023-12-28 00:54:43,984][106226] Updated weights for policy 0, policy_version 787190 (0.0006) [2023-12-28 00:54:44,038][106226] Updated weights for policy 0, policy_version 787200 (0.0007) [2023-12-28 00:54:44,039][106225] Updated weights for policy 1, policy_version 789345 (0.0008) [2023-12-28 00:54:44,732][106226] Updated weights for policy 0, policy_version 787210 (0.0007) [2023-12-28 00:54:44,787][106225] Updated weights for policy 1, policy_version 789355 (0.0008) [2023-12-28 00:54:44,799][106226] Updated weights for policy 0, policy_version 787220 (0.0007) [2023-12-28 00:54:44,844][106225] Updated weights for policy 1, policy_version 789365 (0.0007) [2023-12-28 00:54:44,860][106226] Updated weights for policy 0, policy_version 787230 (0.0008) [2023-12-28 00:54:44,897][106225] Updated weights for policy 1, policy_version 789375 (0.0008) [2023-12-28 00:54:44,916][106226] Updated weights for policy 0, policy_version 787240 (0.0006) [2023-12-28 00:54:45,612][106226] Updated weights for policy 0, policy_version 787250 (0.0008) [2023-12-28 00:54:45,663][106226] Updated weights for policy 0, policy_version 787260 (0.0008) [2023-12-28 00:54:45,715][106225] Updated weights for policy 1, policy_version 789385 (0.0008) [2023-12-28 00:54:45,718][106226] Updated weights for policy 0, policy_version 787270 (0.0008) [2023-12-28 00:54:45,762][106225] Updated weights for policy 1, policy_version 789395 (0.0007) [2023-12-28 00:54:45,814][106225] Updated weights for policy 1, policy_version 789405 (0.0008) [2023-12-28 00:54:45,874][106225] Updated weights for policy 1, policy_version 789415 (0.0008) [2023-12-28 00:54:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 403726336. Throughput: 0: 9881.9, 1: 9854.0. Samples: 403716676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:46,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.179')] [2023-12-28 00:54:46,441][106226] Updated weights for policy 0, policy_version 787280 (0.0005) [2023-12-28 00:54:46,492][106226] Updated weights for policy 0, policy_version 787290 (0.0005) [2023-12-28 00:54:46,547][106226] Updated weights for policy 0, policy_version 787300 (0.0005) [2023-12-28 00:54:46,584][106225] Updated weights for policy 1, policy_version 789425 (0.0009) [2023-12-28 00:54:46,636][106225] Updated weights for policy 1, policy_version 789435 (0.0007) [2023-12-28 00:54:46,689][106225] Updated weights for policy 1, policy_version 789445 (0.0009) [2023-12-28 00:54:47,101][106226] Updated weights for policy 0, policy_version 787310 (0.0006) [2023-12-28 00:54:47,150][106226] Updated weights for policy 0, policy_version 787320 (0.0009) [2023-12-28 00:54:47,210][106226] Updated weights for policy 0, policy_version 787330 (0.0009) [2023-12-28 00:54:47,489][106225] Updated weights for policy 1, policy_version 789455 (0.0008) [2023-12-28 00:54:47,551][106225] Updated weights for policy 1, policy_version 789465 (0.0009) [2023-12-28 00:54:47,608][106225] Updated weights for policy 1, policy_version 789475 (0.0008) [2023-12-28 00:54:47,906][106226] Updated weights for policy 0, policy_version 787340 (0.0008) [2023-12-28 00:54:47,973][106226] Updated weights for policy 0, policy_version 787350 (0.0006) [2023-12-28 00:54:48,033][106226] Updated weights for policy 0, policy_version 787360 (0.0008) [2023-12-28 00:54:48,368][106225] Updated weights for policy 1, policy_version 789485 (0.0007) [2023-12-28 00:54:48,432][106225] Updated weights for policy 1, policy_version 789495 (0.0008) [2023-12-28 00:54:48,495][106225] Updated weights for policy 1, policy_version 789505 (0.0008) [2023-12-28 00:54:48,676][106226] Updated weights for policy 0, policy_version 787370 (0.0009) [2023-12-28 00:54:48,729][106226] Updated weights for policy 0, policy_version 787380 (0.0008) [2023-12-28 00:54:48,788][106226] Updated weights for policy 0, policy_version 787390 (0.0008) [2023-12-28 00:54:48,858][106226] Updated weights for policy 0, policy_version 787400 (0.0009) [2023-12-28 00:54:49,257][106225] Updated weights for policy 1, policy_version 789515 (0.0009) [2023-12-28 00:54:49,316][106225] Updated weights for policy 1, policy_version 789525 (0.0008) [2023-12-28 00:54:49,387][106225] Updated weights for policy 1, policy_version 789535 (0.0009) [2023-12-28 00:54:49,626][106226] Updated weights for policy 0, policy_version 787410 (0.0009) [2023-12-28 00:54:49,691][106226] Updated weights for policy 0, policy_version 787420 (0.0008) [2023-12-28 00:54:49,756][106226] Updated weights for policy 0, policy_version 787430 (0.0010) [2023-12-28 00:54:50,060][106225] Updated weights for policy 1, policy_version 789545 (0.0006) [2023-12-28 00:54:50,121][106225] Updated weights for policy 1, policy_version 789555 (0.0010) [2023-12-28 00:54:50,183][106225] Updated weights for policy 1, policy_version 789565 (0.0008) [2023-12-28 00:54:50,248][106225] Updated weights for policy 1, policy_version 789575 (0.0010) [2023-12-28 00:54:50,430][106226] Updated weights for policy 0, policy_version 787440 (0.0008) [2023-12-28 00:54:50,491][106226] Updated weights for policy 0, policy_version 787450 (0.0009) [2023-12-28 00:54:50,557][106226] Updated weights for policy 0, policy_version 787460 (0.0009) [2023-12-28 00:54:51,052][106225] Updated weights for policy 1, policy_version 789585 (0.0009) [2023-12-28 00:54:51,112][106225] Updated weights for policy 1, policy_version 789595 (0.0009) [2023-12-28 00:54:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 403816448. Throughput: 0: 9924.5, 1: 9736.5. Samples: 403833360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:51,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-5.233')] [2023-12-28 00:54:51,180][106225] Updated weights for policy 1, policy_version 789605 (0.0008) [2023-12-28 00:54:51,239][106226] Updated weights for policy 0, policy_version 787470 (0.0009) [2023-12-28 00:54:51,309][106226] Updated weights for policy 0, policy_version 787480 (0.0008) [2023-12-28 00:54:51,381][106226] Updated weights for policy 0, policy_version 787490 (0.0008) [2023-12-28 00:54:51,915][106225] Updated weights for policy 1, policy_version 789615 (0.0010) [2023-12-28 00:54:51,976][106225] Updated weights for policy 1, policy_version 789625 (0.0008) [2023-12-28 00:54:52,044][106225] Updated weights for policy 1, policy_version 789635 (0.0010) [2023-12-28 00:54:52,072][106226] Updated weights for policy 0, policy_version 787500 (0.0009) [2023-12-28 00:54:52,133][106226] Updated weights for policy 0, policy_version 787510 (0.0008) [2023-12-28 00:54:52,199][106226] Updated weights for policy 0, policy_version 787520 (0.0009) [2023-12-28 00:54:52,786][106225] Updated weights for policy 1, policy_version 789645 (0.0011) [2023-12-28 00:54:52,849][106225] Updated weights for policy 1, policy_version 789655 (0.0010) [2023-12-28 00:54:52,903][106225] Updated weights for policy 1, policy_version 789665 (0.0007) [2023-12-28 00:54:52,937][106226] Updated weights for policy 0, policy_version 787530 (0.0009) [2023-12-28 00:54:52,993][106226] Updated weights for policy 0, policy_version 787540 (0.0008) [2023-12-28 00:54:53,050][106226] Updated weights for policy 0, policy_version 787550 (0.0008) [2023-12-28 00:54:53,102][106226] Updated weights for policy 0, policy_version 787560 (0.0007) [2023-12-28 00:54:53,588][106225] Updated weights for policy 1, policy_version 789675 (0.0009) [2023-12-28 00:54:53,640][106225] Updated weights for policy 1, policy_version 789685 (0.0008) [2023-12-28 00:54:53,695][106225] Updated weights for policy 1, policy_version 789695 (0.0008) [2023-12-28 00:54:53,805][106226] Updated weights for policy 0, policy_version 787570 (0.0007) [2023-12-28 00:54:53,855][106226] Updated weights for policy 0, policy_version 787580 (0.0007) [2023-12-28 00:54:53,905][106226] Updated weights for policy 0, policy_version 787590 (0.0010) [2023-12-28 00:54:54,435][106225] Updated weights for policy 1, policy_version 789705 (0.0009) [2023-12-28 00:54:54,467][106226] Updated weights for policy 0, policy_version 787600 (0.0007) [2023-12-28 00:54:54,490][106225] Updated weights for policy 1, policy_version 789715 (0.0006) [2023-12-28 00:54:54,522][106226] Updated weights for policy 0, policy_version 787610 (0.0005) [2023-12-28 00:54:54,549][106225] Updated weights for policy 1, policy_version 789725 (0.0005) [2023-12-28 00:54:54,582][106226] Updated weights for policy 0, policy_version 787620 (0.0005) [2023-12-28 00:54:54,615][106225] Updated weights for policy 1, policy_version 789735 (0.0006) [2023-12-28 00:54:55,133][106226] Updated weights for policy 0, policy_version 787630 (0.0006) [2023-12-28 00:54:55,193][106226] Updated weights for policy 0, policy_version 787640 (0.0008) [2023-12-28 00:54:55,219][106225] Updated weights for policy 1, policy_version 789745 (0.0006) [2023-12-28 00:54:55,242][106226] Updated weights for policy 0, policy_version 787650 (0.0009) [2023-12-28 00:54:55,276][106225] Updated weights for policy 1, policy_version 789755 (0.0005) [2023-12-28 00:54:55,344][106225] Updated weights for policy 1, policy_version 789765 (0.0005) [2023-12-28 00:54:55,878][106226] Updated weights for policy 0, policy_version 787660 (0.0011) [2023-12-28 00:54:55,928][106226] Updated weights for policy 0, policy_version 787670 (0.0010) [2023-12-28 00:54:55,971][106225] Updated weights for policy 1, policy_version 789775 (0.0008) [2023-12-28 00:54:55,979][106226] Updated weights for policy 0, policy_version 787680 (0.0011) [2023-12-28 00:54:56,018][106225] Updated weights for policy 1, policy_version 789785 (0.0007) [2023-12-28 00:54:56,075][106225] Updated weights for policy 1, policy_version 789795 (0.0005) [2023-12-28 00:54:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 403931136. Throughput: 0: 9922.2, 1: 9701.3. Samples: 403890560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:54:56,175][105115] Avg episode reward: [(0, '-4.048'), (1, '-5.064')] [2023-12-28 00:54:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000789800_202227712.pth... [2023-12-28 00:54:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000787688_201703424.pth... [2023-12-28 00:54:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000786504_201400320.pth [2023-12-28 00:54:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000788648_201932800.pth [2023-12-28 00:54:56,668][106226] Updated weights for policy 0, policy_version 787690 (0.0009) [2023-12-28 00:54:56,717][106225] Updated weights for policy 1, policy_version 789805 (0.0006) [2023-12-28 00:54:56,718][106226] Updated weights for policy 0, policy_version 787700 (0.0005) [2023-12-28 00:54:56,770][106226] Updated weights for policy 0, policy_version 787710 (0.0005) [2023-12-28 00:54:56,776][106225] Updated weights for policy 1, policy_version 789815 (0.0008) [2023-12-28 00:54:56,821][106226] Updated weights for policy 0, policy_version 787720 (0.0005) [2023-12-28 00:54:56,833][106225] Updated weights for policy 1, policy_version 789825 (0.0007) [2023-12-28 00:54:57,434][106226] Updated weights for policy 0, policy_version 787730 (0.0010) [2023-12-28 00:54:57,480][106226] Updated weights for policy 0, policy_version 787740 (0.0010) [2023-12-28 00:54:57,519][106225] Updated weights for policy 1, policy_version 789835 (0.0008) [2023-12-28 00:54:57,529][106226] Updated weights for policy 0, policy_version 787750 (0.0010) [2023-12-28 00:54:57,573][106225] Updated weights for policy 1, policy_version 789845 (0.0005) [2023-12-28 00:54:57,633][106225] Updated weights for policy 1, policy_version 789855 (0.0005) [2023-12-28 00:54:58,135][106226] Updated weights for policy 0, policy_version 787760 (0.0010) [2023-12-28 00:54:58,198][106226] Updated weights for policy 0, policy_version 787770 (0.0010) [2023-12-28 00:54:58,265][106226] Updated weights for policy 0, policy_version 787780 (0.0010) [2023-12-28 00:54:58,350][106225] Updated weights for policy 1, policy_version 789865 (0.0006) [2023-12-28 00:54:58,412][106225] Updated weights for policy 1, policy_version 789875 (0.0008) [2023-12-28 00:54:58,479][106225] Updated weights for policy 1, policy_version 789885 (0.0008) [2023-12-28 00:54:58,537][106225] Updated weights for policy 1, policy_version 789895 (0.0008) [2023-12-28 00:54:59,099][106226] Updated weights for policy 0, policy_version 787790 (0.0009) [2023-12-28 00:54:59,153][106226] Updated weights for policy 0, policy_version 787800 (0.0008) [2023-12-28 00:54:59,231][106226] Updated weights for policy 0, policy_version 787810 (0.0008) [2023-12-28 00:54:59,259][106225] Updated weights for policy 1, policy_version 789905 (0.0009) [2023-12-28 00:54:59,325][106225] Updated weights for policy 1, policy_version 789915 (0.0010) [2023-12-28 00:54:59,386][106225] Updated weights for policy 1, policy_version 789925 (0.0010) [2023-12-28 00:55:00,007][106226] Updated weights for policy 0, policy_version 787820 (0.0008) [2023-12-28 00:55:00,068][106226] Updated weights for policy 0, policy_version 787830 (0.0008) [2023-12-28 00:55:00,134][106226] Updated weights for policy 0, policy_version 787840 (0.0009) [2023-12-28 00:55:00,162][106225] Updated weights for policy 1, policy_version 789935 (0.0008) [2023-12-28 00:55:00,218][106225] Updated weights for policy 1, policy_version 789945 (0.0010) [2023-12-28 00:55:00,274][106225] Updated weights for policy 1, policy_version 789955 (0.0009) [2023-12-28 00:55:00,765][106226] Updated weights for policy 0, policy_version 787850 (0.0006) [2023-12-28 00:55:00,817][106226] Updated weights for policy 0, policy_version 787860 (0.0008) [2023-12-28 00:55:00,863][106226] Updated weights for policy 0, policy_version 787870 (0.0010) [2023-12-28 00:55:00,909][106226] Updated weights for policy 0, policy_version 787880 (0.0010) [2023-12-28 00:55:00,914][106225] Updated weights for policy 1, policy_version 789965 (0.0007) [2023-12-28 00:55:00,963][106225] Updated weights for policy 1, policy_version 789975 (0.0007) [2023-12-28 00:55:01,021][106225] Updated weights for policy 1, policy_version 789985 (0.0008) [2023-12-28 00:55:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 404029440. Throughput: 0: 10065.8, 1: 9736.2. Samples: 404014164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:01,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-5.181')] [2023-12-28 00:55:01,705][106226] Updated weights for policy 0, policy_version 787890 (0.0009) [2023-12-28 00:55:01,739][106225] Updated weights for policy 1, policy_version 789995 (0.0008) [2023-12-28 00:55:01,769][106226] Updated weights for policy 0, policy_version 787900 (0.0009) [2023-12-28 00:55:01,800][106225] Updated weights for policy 1, policy_version 790005 (0.0009) [2023-12-28 00:55:01,827][106226] Updated weights for policy 0, policy_version 787910 (0.0005) [2023-12-28 00:55:01,857][106225] Updated weights for policy 1, policy_version 790015 (0.0008) [2023-12-28 00:55:02,506][106226] Updated weights for policy 0, policy_version 787920 (0.0006) [2023-12-28 00:55:02,547][106225] Updated weights for policy 1, policy_version 790025 (0.0006) [2023-12-28 00:55:02,566][106226] Updated weights for policy 0, policy_version 787930 (0.0006) [2023-12-28 00:55:02,609][106225] Updated weights for policy 1, policy_version 790035 (0.0008) [2023-12-28 00:55:02,626][106226] Updated weights for policy 0, policy_version 787940 (0.0007) [2023-12-28 00:55:02,665][106225] Updated weights for policy 1, policy_version 790045 (0.0006) [2023-12-28 00:55:02,722][106225] Updated weights for policy 1, policy_version 790055 (0.0010) [2023-12-28 00:55:03,268][106226] Updated weights for policy 0, policy_version 787950 (0.0007) [2023-12-28 00:55:03,316][106226] Updated weights for policy 0, policy_version 787960 (0.0008) [2023-12-28 00:55:03,363][106226] Updated weights for policy 0, policy_version 787970 (0.0007) [2023-12-28 00:55:03,401][106225] Updated weights for policy 1, policy_version 790065 (0.0010) [2023-12-28 00:55:03,455][106225] Updated weights for policy 1, policy_version 790075 (0.0008) [2023-12-28 00:55:03,506][106225] Updated weights for policy 1, policy_version 790085 (0.0008) [2023-12-28 00:55:04,165][106226] Updated weights for policy 0, policy_version 787980 (0.0009) [2023-12-28 00:55:04,169][106225] Updated weights for policy 1, policy_version 790095 (0.0006) [2023-12-28 00:55:04,227][106226] Updated weights for policy 0, policy_version 787990 (0.0008) [2023-12-28 00:55:04,232][106225] Updated weights for policy 1, policy_version 790105 (0.0006) [2023-12-28 00:55:04,289][106226] Updated weights for policy 0, policy_version 788000 (0.0008) [2023-12-28 00:55:04,294][106225] Updated weights for policy 1, policy_version 790115 (0.0005) [2023-12-28 00:55:04,813][106225] Updated weights for policy 1, policy_version 790125 (0.0005) [2023-12-28 00:55:04,864][106225] Updated weights for policy 1, policy_version 790135 (0.0005) [2023-12-28 00:55:04,922][106225] Updated weights for policy 1, policy_version 790145 (0.0007) [2023-12-28 00:55:04,932][106226] Updated weights for policy 0, policy_version 788010 (0.0008) [2023-12-28 00:55:04,985][106226] Updated weights for policy 0, policy_version 788020 (0.0006) [2023-12-28 00:55:05,033][106226] Updated weights for policy 0, policy_version 788030 (0.0005) [2023-12-28 00:55:05,081][106226] Updated weights for policy 0, policy_version 788040 (0.0005) [2023-12-28 00:55:05,500][106225] Updated weights for policy 1, policy_version 790155 (0.0007) [2023-12-28 00:55:05,550][106225] Updated weights for policy 1, policy_version 790165 (0.0005) [2023-12-28 00:55:05,600][106225] Updated weights for policy 1, policy_version 790175 (0.0005) [2023-12-28 00:55:05,738][106226] Updated weights for policy 0, policy_version 788050 (0.0009) [2023-12-28 00:55:05,787][106226] Updated weights for policy 0, policy_version 788060 (0.0008) [2023-12-28 00:55:05,853][106226] Updated weights for policy 0, policy_version 788070 (0.0010) [2023-12-28 00:55:06,116][106225] Updated weights for policy 1, policy_version 790185 (0.0005) [2023-12-28 00:55:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 404127744. Throughput: 0: 10054.7, 1: 9870.7. Samples: 404138200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:06,175][105115] Avg episode reward: [(0, '-4.278'), (1, '-5.119')] [2023-12-28 00:55:06,181][106225] Updated weights for policy 1, policy_version 790195 (0.0007) [2023-12-28 00:55:06,235][106225] Updated weights for policy 1, policy_version 790205 (0.0008) [2023-12-28 00:55:06,295][106225] Updated weights for policy 1, policy_version 790215 (0.0007) [2023-12-28 00:55:06,664][106226] Updated weights for policy 0, policy_version 788080 (0.0008) [2023-12-28 00:55:06,732][106226] Updated weights for policy 0, policy_version 788090 (0.0007) [2023-12-28 00:55:06,790][106226] Updated weights for policy 0, policy_version 788100 (0.0009) [2023-12-28 00:55:07,003][106225] Updated weights for policy 1, policy_version 790225 (0.0010) [2023-12-28 00:55:07,064][106225] Updated weights for policy 1, policy_version 790235 (0.0011) [2023-12-28 00:55:07,126][106225] Updated weights for policy 1, policy_version 790245 (0.0011) [2023-12-28 00:55:07,417][106226] Updated weights for policy 0, policy_version 788110 (0.0006) [2023-12-28 00:55:07,476][106226] Updated weights for policy 0, policy_version 788120 (0.0006) [2023-12-28 00:55:07,524][106226] Updated weights for policy 0, policy_version 788130 (0.0006) [2023-12-28 00:55:07,836][106225] Updated weights for policy 1, policy_version 790255 (0.0009) [2023-12-28 00:55:07,897][106225] Updated weights for policy 1, policy_version 790265 (0.0009) [2023-12-28 00:55:07,957][106225] Updated weights for policy 1, policy_version 790275 (0.0007) [2023-12-28 00:55:08,129][106226] Updated weights for policy 0, policy_version 788140 (0.0008) [2023-12-28 00:55:08,182][106226] Updated weights for policy 0, policy_version 788150 (0.0010) [2023-12-28 00:55:08,239][106226] Updated weights for policy 0, policy_version 788160 (0.0010) [2023-12-28 00:55:08,683][106225] Updated weights for policy 1, policy_version 790285 (0.0008) [2023-12-28 00:55:08,746][106225] Updated weights for policy 1, policy_version 790295 (0.0009) [2023-12-28 00:55:08,810][106225] Updated weights for policy 1, policy_version 790305 (0.0009) [2023-12-28 00:55:08,859][106226] Updated weights for policy 0, policy_version 788170 (0.0009) [2023-12-28 00:55:08,928][106226] Updated weights for policy 0, policy_version 788180 (0.0006) [2023-12-28 00:55:08,987][106226] Updated weights for policy 0, policy_version 788190 (0.0006) [2023-12-28 00:55:09,046][106226] Updated weights for policy 0, policy_version 788200 (0.0006) [2023-12-28 00:55:09,652][106225] Updated weights for policy 1, policy_version 790315 (0.0008) [2023-12-28 00:55:09,716][106225] Updated weights for policy 1, policy_version 790325 (0.0007) [2023-12-28 00:55:09,748][106226] Updated weights for policy 0, policy_version 788210 (0.0011) [2023-12-28 00:55:09,775][106225] Updated weights for policy 1, policy_version 790335 (0.0007) [2023-12-28 00:55:09,810][106226] Updated weights for policy 0, policy_version 788220 (0.0011) [2023-12-28 00:55:09,876][106226] Updated weights for policy 0, policy_version 788230 (0.0009) [2023-12-28 00:55:10,537][106225] Updated weights for policy 1, policy_version 790345 (0.0009) [2023-12-28 00:55:10,587][106225] Updated weights for policy 1, policy_version 790355 (0.0010) [2023-12-28 00:55:10,605][106226] Updated weights for policy 0, policy_version 788240 (0.0006) [2023-12-28 00:55:10,644][106225] Updated weights for policy 1, policy_version 790365 (0.0010) [2023-12-28 00:55:10,663][106226] Updated weights for policy 0, policy_version 788250 (0.0008) [2023-12-28 00:55:10,692][106225] Updated weights for policy 1, policy_version 790375 (0.0010) [2023-12-28 00:55:10,719][106226] Updated weights for policy 0, policy_version 788260 (0.0005) [2023-12-28 00:55:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 404226048. Throughput: 0: 10083.1, 1: 9931.7. Samples: 404200272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:11,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.906')] [2023-12-28 00:55:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000790376_202375168.pth... [2023-12-28 00:55:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000788264_201850880.pth... [2023-12-28 00:55:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000787080_201547776.pth [2023-12-28 00:55:11,204][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000789224_202080256.pth [2023-12-28 00:55:11,426][106226] Updated weights for policy 0, policy_version 788270 (0.0009) [2023-12-28 00:55:11,481][106225] Updated weights for policy 1, policy_version 790385 (0.0010) [2023-12-28 00:55:11,485][106226] Updated weights for policy 0, policy_version 788280 (0.0008) [2023-12-28 00:55:11,541][106225] Updated weights for policy 1, policy_version 790395 (0.0010) [2023-12-28 00:55:11,541][106226] Updated weights for policy 0, policy_version 788290 (0.0008) [2023-12-28 00:55:11,597][106225] Updated weights for policy 1, policy_version 790405 (0.0011) [2023-12-28 00:55:12,320][106225] Updated weights for policy 1, policy_version 790415 (0.0009) [2023-12-28 00:55:12,326][106226] Updated weights for policy 0, policy_version 788300 (0.0008) [2023-12-28 00:55:12,382][106225] Updated weights for policy 1, policy_version 790425 (0.0007) [2023-12-28 00:55:12,388][106226] Updated weights for policy 0, policy_version 788310 (0.0007) [2023-12-28 00:55:12,445][106225] Updated weights for policy 1, policy_version 790435 (0.0008) [2023-12-28 00:55:12,451][106226] Updated weights for policy 0, policy_version 788320 (0.0010) [2023-12-28 00:55:13,055][106226] Updated weights for policy 0, policy_version 788330 (0.0008) [2023-12-28 00:55:13,112][106226] Updated weights for policy 0, policy_version 788340 (0.0007) [2023-12-28 00:55:13,159][106226] Updated weights for policy 0, policy_version 788350 (0.0009) [2023-12-28 00:55:13,215][106226] Updated weights for policy 0, policy_version 788360 (0.0007) [2023-12-28 00:55:13,222][106225] Updated weights for policy 1, policy_version 790445 (0.0007) [2023-12-28 00:55:13,288][106225] Updated weights for policy 1, policy_version 790455 (0.0010) [2023-12-28 00:55:13,359][106225] Updated weights for policy 1, policy_version 790465 (0.0007) [2023-12-28 00:55:13,905][106226] Updated weights for policy 0, policy_version 788370 (0.0009) [2023-12-28 00:55:13,933][106225] Updated weights for policy 1, policy_version 790475 (0.0007) [2023-12-28 00:55:13,967][106226] Updated weights for policy 0, policy_version 788380 (0.0008) [2023-12-28 00:55:13,999][106225] Updated weights for policy 1, policy_version 790485 (0.0005) [2023-12-28 00:55:14,026][106226] Updated weights for policy 0, policy_version 788390 (0.0007) [2023-12-28 00:55:14,050][106225] Updated weights for policy 1, policy_version 790495 (0.0006) [2023-12-28 00:55:14,671][106225] Updated weights for policy 1, policy_version 790505 (0.0005) [2023-12-28 00:55:14,728][106225] Updated weights for policy 1, policy_version 790515 (0.0008) [2023-12-28 00:55:14,789][106225] Updated weights for policy 1, policy_version 790525 (0.0007) [2023-12-28 00:55:14,791][106226] Updated weights for policy 0, policy_version 788400 (0.0007) [2023-12-28 00:55:14,850][106225] Updated weights for policy 1, policy_version 790535 (0.0006) [2023-12-28 00:55:14,852][106226] Updated weights for policy 0, policy_version 788410 (0.0007) [2023-12-28 00:55:14,909][106226] Updated weights for policy 0, policy_version 788421 (0.0010) [2023-12-28 00:55:15,469][106225] Updated weights for policy 1, policy_version 790545 (0.0008) [2023-12-28 00:55:15,527][106225] Updated weights for policy 1, policy_version 790555 (0.0006) [2023-12-28 00:55:15,596][106226] Updated weights for policy 0, policy_version 788431 (0.0007) [2023-12-28 00:55:15,599][106225] Updated weights for policy 1, policy_version 790565 (0.0006) [2023-12-28 00:55:15,654][106226] Updated weights for policy 0, policy_version 788441 (0.0005) [2023-12-28 00:55:15,709][106226] Updated weights for policy 0, policy_version 788451 (0.0005) [2023-12-28 00:55:16,136][106225] Updated weights for policy 1, policy_version 790575 (0.0008) [2023-12-28 00:55:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 404324352. Throughput: 0: 10016.9, 1: 9847.8. Samples: 404314904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:16,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.981')] [2023-12-28 00:55:16,199][106225] Updated weights for policy 1, policy_version 790585 (0.0009) [2023-12-28 00:55:16,257][106225] Updated weights for policy 1, policy_version 790595 (0.0009) [2023-12-28 00:55:16,274][106226] Updated weights for policy 0, policy_version 788461 (0.0007) [2023-12-28 00:55:16,328][106226] Updated weights for policy 0, policy_version 788471 (0.0007) [2023-12-28 00:55:16,382][106226] Updated weights for policy 0, policy_version 788481 (0.0008) [2023-12-28 00:55:16,915][106225] Updated weights for policy 1, policy_version 790605 (0.0007) [2023-12-28 00:55:16,976][106225] Updated weights for policy 1, policy_version 790615 (0.0006) [2023-12-28 00:55:16,982][106226] Updated weights for policy 0, policy_version 788491 (0.0008) [2023-12-28 00:55:17,037][106225] Updated weights for policy 1, policy_version 790625 (0.0007) [2023-12-28 00:55:17,046][106226] Updated weights for policy 0, policy_version 788501 (0.0007) [2023-12-28 00:55:17,103][106226] Updated weights for policy 0, policy_version 788511 (0.0007) [2023-12-28 00:55:17,762][106225] Updated weights for policy 1, policy_version 790635 (0.0007) [2023-12-28 00:55:17,773][106226] Updated weights for policy 0, policy_version 788521 (0.0008) [2023-12-28 00:55:17,812][106225] Updated weights for policy 1, policy_version 790645 (0.0008) [2023-12-28 00:55:17,835][106226] Updated weights for policy 0, policy_version 788531 (0.0005) [2023-12-28 00:55:17,861][106225] Updated weights for policy 1, policy_version 790655 (0.0008) [2023-12-28 00:55:17,893][106226] Updated weights for policy 0, policy_version 788541 (0.0006) [2023-12-28 00:55:17,950][106226] Updated weights for policy 0, policy_version 788551 (0.0005) [2023-12-28 00:55:18,553][106226] Updated weights for policy 0, policy_version 788561 (0.0008) [2023-12-28 00:55:18,582][106225] Updated weights for policy 1, policy_version 790665 (0.0006) [2023-12-28 00:55:18,615][106226] Updated weights for policy 0, policy_version 788571 (0.0009) [2023-12-28 00:55:18,640][106225] Updated weights for policy 1, policy_version 790675 (0.0006) [2023-12-28 00:55:18,678][106226] Updated weights for policy 0, policy_version 788581 (0.0008) [2023-12-28 00:55:18,700][106225] Updated weights for policy 1, policy_version 790685 (0.0006) [2023-12-28 00:55:18,761][106225] Updated weights for policy 1, policy_version 790695 (0.0009) [2023-12-28 00:55:19,349][106225] Updated weights for policy 1, policy_version 790705 (0.0009) [2023-12-28 00:55:19,407][106226] Updated weights for policy 0, policy_version 788591 (0.0008) [2023-12-28 00:55:19,419][106225] Updated weights for policy 1, policy_version 790715 (0.0008) [2023-12-28 00:55:19,461][106226] Updated weights for policy 0, policy_version 788601 (0.0008) [2023-12-28 00:55:19,474][106225] Updated weights for policy 1, policy_version 790725 (0.0008) [2023-12-28 00:55:19,527][106226] Updated weights for policy 0, policy_version 788611 (0.0009) [2023-12-28 00:55:20,280][106226] Updated weights for policy 0, policy_version 788621 (0.0008) [2023-12-28 00:55:20,301][106225] Updated weights for policy 1, policy_version 790735 (0.0008) [2023-12-28 00:55:20,340][106226] Updated weights for policy 0, policy_version 788631 (0.0007) [2023-12-28 00:55:20,358][106225] Updated weights for policy 1, policy_version 790745 (0.0009) [2023-12-28 00:55:20,402][106226] Updated weights for policy 0, policy_version 788641 (0.0007) [2023-12-28 00:55:20,416][106225] Updated weights for policy 1, policy_version 790755 (0.0009) [2023-12-28 00:55:21,082][106226] Updated weights for policy 0, policy_version 788651 (0.0008) [2023-12-28 00:55:21,152][106226] Updated weights for policy 0, policy_version 788661 (0.0009) [2023-12-28 00:55:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 404422656. Throughput: 0: 10068.6, 1: 9906.8. Samples: 404438780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:21,176][105115] Avg episode reward: [(0, '-4.356'), (1, '-5.116')] [2023-12-28 00:55:21,213][106226] Updated weights for policy 0, policy_version 788671 (0.0008) [2023-12-28 00:55:21,227][106225] Updated weights for policy 1, policy_version 790765 (0.0009) [2023-12-28 00:55:21,294][106225] Updated weights for policy 1, policy_version 790775 (0.0011) [2023-12-28 00:55:21,358][106225] Updated weights for policy 1, policy_version 790785 (0.0010) [2023-12-28 00:55:22,000][106226] Updated weights for policy 0, policy_version 788681 (0.0007) [2023-12-28 00:55:22,054][106226] Updated weights for policy 0, policy_version 788691 (0.0009) [2023-12-28 00:55:22,105][106225] Updated weights for policy 1, policy_version 790795 (0.0010) [2023-12-28 00:55:22,124][106226] Updated weights for policy 0, policy_version 788701 (0.0007) [2023-12-28 00:55:22,174][106225] Updated weights for policy 1, policy_version 790805 (0.0008) [2023-12-28 00:55:22,193][106226] Updated weights for policy 0, policy_version 788711 (0.0006) [2023-12-28 00:55:22,240][106225] Updated weights for policy 1, policy_version 790815 (0.0008) [2023-12-28 00:55:22,914][106226] Updated weights for policy 0, policy_version 788721 (0.0008) [2023-12-28 00:55:22,975][106226] Updated weights for policy 0, policy_version 788731 (0.0009) [2023-12-28 00:55:23,007][106225] Updated weights for policy 1, policy_version 790825 (0.0008) [2023-12-28 00:55:23,040][106226] Updated weights for policy 0, policy_version 788741 (0.0009) [2023-12-28 00:55:23,064][106225] Updated weights for policy 1, policy_version 790835 (0.0006) [2023-12-28 00:55:23,116][106225] Updated weights for policy 1, policy_version 790845 (0.0006) [2023-12-28 00:55:23,179][106225] Updated weights for policy 1, policy_version 790855 (0.0006) [2023-12-28 00:55:23,709][106226] Updated weights for policy 0, policy_version 788751 (0.0006) [2023-12-28 00:55:23,766][106226] Updated weights for policy 0, policy_version 788761 (0.0005) [2023-12-28 00:55:23,824][106226] Updated weights for policy 0, policy_version 788771 (0.0006) [2023-12-28 00:55:23,846][106225] Updated weights for policy 1, policy_version 790865 (0.0005) [2023-12-28 00:55:23,898][106225] Updated weights for policy 1, policy_version 790875 (0.0006) [2023-12-28 00:55:23,957][106225] Updated weights for policy 1, policy_version 790885 (0.0005) [2023-12-28 00:55:24,343][106226] Updated weights for policy 0, policy_version 788781 (0.0006) [2023-12-28 00:55:24,399][106226] Updated weights for policy 0, policy_version 788791 (0.0006) [2023-12-28 00:55:24,461][106226] Updated weights for policy 0, policy_version 788801 (0.0005) [2023-12-28 00:55:24,500][106225] Updated weights for policy 1, policy_version 790895 (0.0005) [2023-12-28 00:55:24,557][106225] Updated weights for policy 1, policy_version 790905 (0.0005) [2023-12-28 00:55:24,609][106225] Updated weights for policy 1, policy_version 790915 (0.0005) [2023-12-28 00:55:25,073][106226] Updated weights for policy 0, policy_version 788811 (0.0010) [2023-12-28 00:55:25,130][106226] Updated weights for policy 0, policy_version 788821 (0.0010) [2023-12-28 00:55:25,163][106225] Updated weights for policy 1, policy_version 790925 (0.0008) [2023-12-28 00:55:25,181][106226] Updated weights for policy 0, policy_version 788831 (0.0006) [2023-12-28 00:55:25,217][106225] Updated weights for policy 1, policy_version 790935 (0.0010) [2023-12-28 00:55:25,272][106225] Updated weights for policy 1, policy_version 790945 (0.0009) [2023-12-28 00:55:25,803][106226] Updated weights for policy 0, policy_version 788841 (0.0007) [2023-12-28 00:55:25,855][106226] Updated weights for policy 0, policy_version 788851 (0.0010) [2023-12-28 00:55:25,902][106226] Updated weights for policy 0, policy_version 788861 (0.0010) [2023-12-28 00:55:25,918][106225] Updated weights for policy 1, policy_version 790955 (0.0006) [2023-12-28 00:55:25,949][106226] Updated weights for policy 0, policy_version 788871 (0.0010) [2023-12-28 00:55:25,977][106225] Updated weights for policy 1, policy_version 790965 (0.0009) [2023-12-28 00:55:26,030][106225] Updated weights for policy 1, policy_version 790975 (0.0007) [2023-12-28 00:55:26,175][105115] Fps is (10 sec: 21298.6, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 404537344. Throughput: 0: 10084.2, 1: 9832.0. Samples: 404496656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:26,176][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.229')] [2023-12-28 00:55:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000788872_202006528.pth... [2023-12-28 00:55:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000790984_202530816.pth... [2023-12-28 00:55:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000787688_201703424.pth [2023-12-28 00:55:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000789800_202227712.pth [2023-12-28 00:55:26,578][106226] Updated weights for policy 0, policy_version 788881 (0.0010) [2023-12-28 00:55:26,624][106226] Updated weights for policy 0, policy_version 788891 (0.0010) [2023-12-28 00:55:26,670][106226] Updated weights for policy 0, policy_version 788901 (0.0010) [2023-12-28 00:55:26,780][106225] Updated weights for policy 1, policy_version 790985 (0.0007) [2023-12-28 00:55:26,844][106225] Updated weights for policy 1, policy_version 790995 (0.0009) [2023-12-28 00:55:26,891][106225] Updated weights for policy 1, policy_version 791005 (0.0008) [2023-12-28 00:55:26,935][106225] Updated weights for policy 1, policy_version 791015 (0.0007) [2023-12-28 00:55:27,389][106226] Updated weights for policy 0, policy_version 788911 (0.0010) [2023-12-28 00:55:27,448][106226] Updated weights for policy 0, policy_version 788921 (0.0010) [2023-12-28 00:55:27,507][106226] Updated weights for policy 0, policy_version 788931 (0.0010) [2023-12-28 00:55:27,635][106225] Updated weights for policy 1, policy_version 791025 (0.0006) [2023-12-28 00:55:27,686][106225] Updated weights for policy 1, policy_version 791035 (0.0005) [2023-12-28 00:55:27,740][106225] Updated weights for policy 1, policy_version 791045 (0.0005) [2023-12-28 00:55:28,233][106226] Updated weights for policy 0, policy_version 788941 (0.0010) [2023-12-28 00:55:28,278][106225] Updated weights for policy 1, policy_version 791055 (0.0005) [2023-12-28 00:55:28,290][106226] Updated weights for policy 0, policy_version 788951 (0.0010) [2023-12-28 00:55:28,342][106225] Updated weights for policy 1, policy_version 791065 (0.0007) [2023-12-28 00:55:28,353][106226] Updated weights for policy 0, policy_version 788961 (0.0009) [2023-12-28 00:55:28,402][106225] Updated weights for policy 1, policy_version 791075 (0.0008) [2023-12-28 00:55:29,031][106225] Updated weights for policy 1, policy_version 791085 (0.0009) [2023-12-28 00:55:29,055][106226] Updated weights for policy 0, policy_version 788971 (0.0011) [2023-12-28 00:55:29,087][106225] Updated weights for policy 1, policy_version 791095 (0.0008) [2023-12-28 00:55:29,120][106226] Updated weights for policy 0, policy_version 788981 (0.0011) [2023-12-28 00:55:29,141][106225] Updated weights for policy 1, policy_version 791105 (0.0010) [2023-12-28 00:55:29,180][106226] Updated weights for policy 0, policy_version 788991 (0.0010) [2023-12-28 00:55:29,784][106225] Updated weights for policy 1, policy_version 791115 (0.0009) [2023-12-28 00:55:29,847][106225] Updated weights for policy 1, policy_version 791125 (0.0007) [2023-12-28 00:55:29,897][106226] Updated weights for policy 0, policy_version 789001 (0.0010) [2023-12-28 00:55:29,899][106225] Updated weights for policy 1, policy_version 791135 (0.0007) [2023-12-28 00:55:29,965][106226] Updated weights for policy 0, policy_version 789011 (0.0011) [2023-12-28 00:55:30,020][106226] Updated weights for policy 0, policy_version 789021 (0.0010) [2023-12-28 00:55:30,078][106226] Updated weights for policy 0, policy_version 789031 (0.0010) [2023-12-28 00:55:30,571][106225] Updated weights for policy 1, policy_version 791145 (0.0008) [2023-12-28 00:55:30,632][106225] Updated weights for policy 1, policy_version 791155 (0.0010) [2023-12-28 00:55:30,683][106225] Updated weights for policy 1, policy_version 791165 (0.0010) [2023-12-28 00:55:30,740][106225] Updated weights for policy 1, policy_version 791175 (0.0009) [2023-12-28 00:55:30,780][106226] Updated weights for policy 0, policy_version 789041 (0.0011) [2023-12-28 00:55:30,833][106226] Updated weights for policy 0, policy_version 789051 (0.0010) [2023-12-28 00:55:30,903][106226] Updated weights for policy 0, policy_version 789061 (0.0011) [2023-12-28 00:55:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 404635648. Throughput: 0: 10142.5, 1: 10022.1. Samples: 404624084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:31,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.973')] [2023-12-28 00:55:31,406][106225] Updated weights for policy 1, policy_version 791185 (0.0009) [2023-12-28 00:55:31,461][106225] Updated weights for policy 1, policy_version 791195 (0.0008) [2023-12-28 00:55:31,515][106225] Updated weights for policy 1, policy_version 791205 (0.0008) [2023-12-28 00:55:31,635][106226] Updated weights for policy 0, policy_version 789071 (0.0008) [2023-12-28 00:55:31,689][106226] Updated weights for policy 0, policy_version 789081 (0.0005) [2023-12-28 00:55:31,750][106226] Updated weights for policy 0, policy_version 789091 (0.0007) [2023-12-28 00:55:32,252][106225] Updated weights for policy 1, policy_version 791215 (0.0009) [2023-12-28 00:55:32,316][106225] Updated weights for policy 1, policy_version 791225 (0.0009) [2023-12-28 00:55:32,382][106225] Updated weights for policy 1, policy_version 791235 (0.0008) [2023-12-28 00:55:32,437][106226] Updated weights for policy 0, policy_version 789101 (0.0007) [2023-12-28 00:55:32,491][106226] Updated weights for policy 0, policy_version 789111 (0.0007) [2023-12-28 00:55:32,556][106226] Updated weights for policy 0, policy_version 789121 (0.0008) [2023-12-28 00:55:33,070][106225] Updated weights for policy 1, policy_version 791245 (0.0008) [2023-12-28 00:55:33,119][106225] Updated weights for policy 1, policy_version 791255 (0.0008) [2023-12-28 00:55:33,172][106225] Updated weights for policy 1, policy_version 791265 (0.0007) [2023-12-28 00:55:33,264][106226] Updated weights for policy 0, policy_version 789131 (0.0007) [2023-12-28 00:55:33,310][106226] Updated weights for policy 0, policy_version 789141 (0.0010) [2023-12-28 00:55:33,362][106226] Updated weights for policy 0, policy_version 789151 (0.0006) [2023-12-28 00:55:33,785][106225] Updated weights for policy 1, policy_version 791275 (0.0007) [2023-12-28 00:55:33,841][106225] Updated weights for policy 1, policy_version 791285 (0.0005) [2023-12-28 00:55:33,892][106225] Updated weights for policy 1, policy_version 791295 (0.0005) [2023-12-28 00:55:33,918][106226] Updated weights for policy 0, policy_version 789161 (0.0008) [2023-12-28 00:55:33,967][106226] Updated weights for policy 0, policy_version 789171 (0.0005) [2023-12-28 00:55:34,014][106226] Updated weights for policy 0, policy_version 789181 (0.0005) [2023-12-28 00:55:34,059][106226] Updated weights for policy 0, policy_version 789191 (0.0005) [2023-12-28 00:55:34,603][106225] Updated weights for policy 1, policy_version 791305 (0.0010) [2023-12-28 00:55:34,658][106225] Updated weights for policy 1, policy_version 791315 (0.0008) [2023-12-28 00:55:34,719][106225] Updated weights for policy 1, policy_version 791325 (0.0009) [2023-12-28 00:55:34,780][106225] Updated weights for policy 1, policy_version 791335 (0.0006) [2023-12-28 00:55:34,784][106226] Updated weights for policy 0, policy_version 789201 (0.0008) [2023-12-28 00:55:34,836][106226] Updated weights for policy 0, policy_version 789211 (0.0005) [2023-12-28 00:55:34,896][106226] Updated weights for policy 0, policy_version 789221 (0.0005) [2023-12-28 00:55:35,423][106225] Updated weights for policy 1, policy_version 791345 (0.0005) [2023-12-28 00:55:35,484][106225] Updated weights for policy 1, policy_version 791355 (0.0005) [2023-12-28 00:55:35,504][106226] Updated weights for policy 0, policy_version 789231 (0.0006) [2023-12-28 00:55:35,540][106225] Updated weights for policy 1, policy_version 791365 (0.0006) [2023-12-28 00:55:35,561][106226] Updated weights for policy 0, policy_version 789241 (0.0007) [2023-12-28 00:55:35,624][106226] Updated weights for policy 0, policy_version 789251 (0.0010) [2023-12-28 00:55:36,168][106225] Updated weights for policy 1, policy_version 791375 (0.0005) [2023-12-28 00:55:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 404733952. Throughput: 0: 10165.4, 1: 10148.8. Samples: 404747500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:36,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.914')] [2023-12-28 00:55:36,232][106225] Updated weights for policy 1, policy_version 791385 (0.0006) [2023-12-28 00:55:36,301][106225] Updated weights for policy 1, policy_version 791395 (0.0008) [2023-12-28 00:55:36,331][106226] Updated weights for policy 0, policy_version 789261 (0.0009) [2023-12-28 00:55:36,395][106226] Updated weights for policy 0, policy_version 789271 (0.0010) [2023-12-28 00:55:36,454][106226] Updated weights for policy 0, policy_version 789281 (0.0011) [2023-12-28 00:55:37,020][106225] Updated weights for policy 1, policy_version 791405 (0.0008) [2023-12-28 00:55:37,082][106225] Updated weights for policy 1, policy_version 791415 (0.0008) [2023-12-28 00:55:37,125][106226] Updated weights for policy 0, policy_version 789291 (0.0011) [2023-12-28 00:55:37,138][106225] Updated weights for policy 1, policy_version 791425 (0.0008) [2023-12-28 00:55:37,184][106226] Updated weights for policy 0, policy_version 789301 (0.0011) [2023-12-28 00:55:37,253][106226] Updated weights for policy 0, policy_version 789311 (0.0008) [2023-12-28 00:55:37,867][106225] Updated weights for policy 1, policy_version 791435 (0.0006) [2023-12-28 00:55:37,924][106225] Updated weights for policy 1, policy_version 791445 (0.0008) [2023-12-28 00:55:37,938][106226] Updated weights for policy 0, policy_version 789321 (0.0007) [2023-12-28 00:55:37,978][106225] Updated weights for policy 1, policy_version 791455 (0.0006) [2023-12-28 00:55:37,988][106226] Updated weights for policy 0, policy_version 789331 (0.0010) [2023-12-28 00:55:38,049][106226] Updated weights for policy 0, policy_version 789341 (0.0010) [2023-12-28 00:55:38,111][106226] Updated weights for policy 0, policy_version 789351 (0.0011) [2023-12-28 00:55:38,705][106225] Updated weights for policy 1, policy_version 791465 (0.0006) [2023-12-28 00:55:38,770][106225] Updated weights for policy 1, policy_version 791475 (0.0009) [2023-12-28 00:55:38,836][106225] Updated weights for policy 1, policy_version 791485 (0.0007) [2023-12-28 00:55:38,838][106226] Updated weights for policy 0, policy_version 789361 (0.0010) [2023-12-28 00:55:38,897][106225] Updated weights for policy 1, policy_version 791495 (0.0007) [2023-12-28 00:55:38,901][106226] Updated weights for policy 0, policy_version 789371 (0.0008) [2023-12-28 00:55:38,959][106226] Updated weights for policy 0, policy_version 789381 (0.0010) [2023-12-28 00:55:39,625][106225] Updated weights for policy 1, policy_version 791505 (0.0008) [2023-12-28 00:55:39,695][106225] Updated weights for policy 1, policy_version 791515 (0.0008) [2023-12-28 00:55:39,703][106226] Updated weights for policy 0, policy_version 789391 (0.0010) [2023-12-28 00:55:39,762][106225] Updated weights for policy 1, policy_version 791525 (0.0008) [2023-12-28 00:55:39,764][106226] Updated weights for policy 0, policy_version 789401 (0.0007) [2023-12-28 00:55:39,820][106226] Updated weights for policy 0, policy_version 789411 (0.0008) [2023-12-28 00:55:40,501][106225] Updated weights for policy 1, policy_version 791535 (0.0008) [2023-12-28 00:55:40,566][106225] Updated weights for policy 1, policy_version 791545 (0.0008) [2023-12-28 00:55:40,606][106226] Updated weights for policy 0, policy_version 789421 (0.0010) [2023-12-28 00:55:40,628][106225] Updated weights for policy 1, policy_version 791555 (0.0006) [2023-12-28 00:55:40,665][106226] Updated weights for policy 0, policy_version 789431 (0.0011) [2023-12-28 00:55:40,723][106226] Updated weights for policy 0, policy_version 789441 (0.0011) [2023-12-28 00:55:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 404832256. Throughput: 0: 10171.1, 1: 10171.4. Samples: 404805972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:41,175][105115] Avg episode reward: [(0, '-4.169'), (1, '-5.173')] [2023-12-28 00:55:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000789448_202153984.pth... [2023-12-28 00:55:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000791560_202678272.pth... [2023-12-28 00:55:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000788264_201850880.pth [2023-12-28 00:55:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000790376_202375168.pth [2023-12-28 00:55:41,377][106225] Updated weights for policy 1, policy_version 791565 (0.0008) [2023-12-28 00:55:41,442][106225] Updated weights for policy 1, policy_version 791575 (0.0008) [2023-12-28 00:55:41,505][106225] Updated weights for policy 1, policy_version 791585 (0.0009) [2023-12-28 00:55:41,541][106226] Updated weights for policy 0, policy_version 789451 (0.0011) [2023-12-28 00:55:41,632][106226] Updated weights for policy 0, policy_version 789461 (0.0010) [2023-12-28 00:55:41,698][106226] Updated weights for policy 0, policy_version 789471 (0.0008) [2023-12-28 00:55:42,274][106225] Updated weights for policy 1, policy_version 791595 (0.0008) [2023-12-28 00:55:42,336][106225] Updated weights for policy 1, policy_version 791605 (0.0008) [2023-12-28 00:55:42,377][106226] Updated weights for policy 0, policy_version 789481 (0.0008) [2023-12-28 00:55:42,405][106225] Updated weights for policy 1, policy_version 791615 (0.0008) [2023-12-28 00:55:42,442][106226] Updated weights for policy 0, policy_version 789491 (0.0008) [2023-12-28 00:55:42,501][106226] Updated weights for policy 0, policy_version 789501 (0.0005) [2023-12-28 00:55:42,568][106226] Updated weights for policy 0, policy_version 789511 (0.0005) [2023-12-28 00:55:43,189][106225] Updated weights for policy 1, policy_version 791625 (0.0008) [2023-12-28 00:55:43,204][106226] Updated weights for policy 0, policy_version 789521 (0.0008) [2023-12-28 00:55:43,247][106225] Updated weights for policy 1, policy_version 791635 (0.0011) [2023-12-28 00:55:43,258][106226] Updated weights for policy 0, policy_version 789531 (0.0006) [2023-12-28 00:55:43,304][106225] Updated weights for policy 1, policy_version 791645 (0.0010) [2023-12-28 00:55:43,312][106226] Updated weights for policy 0, policy_version 789541 (0.0009) [2023-12-28 00:55:43,362][106225] Updated weights for policy 1, policy_version 791655 (0.0010) [2023-12-28 00:55:43,977][106225] Updated weights for policy 1, policy_version 791665 (0.0006) [2023-12-28 00:55:44,028][106225] Updated weights for policy 1, policy_version 791675 (0.0005) [2023-12-28 00:55:44,077][106225] Updated weights for policy 1, policy_version 791685 (0.0008) [2023-12-28 00:55:44,112][106226] Updated weights for policy 0, policy_version 789551 (0.0009) [2023-12-28 00:55:44,178][106226] Updated weights for policy 0, policy_version 789561 (0.0008) [2023-12-28 00:55:44,240][106226] Updated weights for policy 0, policy_version 789571 (0.0009) [2023-12-28 00:55:44,654][106225] Updated weights for policy 1, policy_version 791695 (0.0009) [2023-12-28 00:55:44,718][106225] Updated weights for policy 1, policy_version 791705 (0.0010) [2023-12-28 00:55:44,781][106225] Updated weights for policy 1, policy_version 791715 (0.0010) [2023-12-28 00:55:44,999][106226] Updated weights for policy 0, policy_version 789581 (0.0008) [2023-12-28 00:55:45,055][106226] Updated weights for policy 0, policy_version 789591 (0.0008) [2023-12-28 00:55:45,113][106226] Updated weights for policy 0, policy_version 789601 (0.0008) [2023-12-28 00:55:45,472][106225] Updated weights for policy 1, policy_version 791725 (0.0006) [2023-12-28 00:55:45,527][106225] Updated weights for policy 1, policy_version 791735 (0.0005) [2023-12-28 00:55:45,584][106225] Updated weights for policy 1, policy_version 791745 (0.0005) [2023-12-28 00:55:45,713][106226] Updated weights for policy 0, policy_version 789611 (0.0007) [2023-12-28 00:55:45,770][106226] Updated weights for policy 0, policy_version 789621 (0.0006) [2023-12-28 00:55:45,828][106226] Updated weights for policy 0, policy_version 789631 (0.0005) [2023-12-28 00:55:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 404930560. Throughput: 0: 10005.3, 1: 10124.0. Samples: 404919984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:46,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-5.007')] [2023-12-28 00:55:46,246][106225] Updated weights for policy 1, policy_version 791755 (0.0006) [2023-12-28 00:55:46,296][106225] Updated weights for policy 1, policy_version 791765 (0.0009) [2023-12-28 00:55:46,340][106226] Updated weights for policy 0, policy_version 789641 (0.0005) [2023-12-28 00:55:46,345][106225] Updated weights for policy 1, policy_version 791776 (0.0010) [2023-12-28 00:55:46,397][106226] Updated weights for policy 0, policy_version 789651 (0.0006) [2023-12-28 00:55:46,448][106226] Updated weights for policy 0, policy_version 789661 (0.0006) [2023-12-28 00:55:46,496][106226] Updated weights for policy 0, policy_version 789671 (0.0005) [2023-12-28 00:55:47,100][106226] Updated weights for policy 0, policy_version 789681 (0.0005) [2023-12-28 00:55:47,156][106226] Updated weights for policy 0, policy_version 789691 (0.0005) [2023-12-28 00:55:47,161][106225] Updated weights for policy 1, policy_version 791786 (0.0008) [2023-12-28 00:55:47,215][106226] Updated weights for policy 0, policy_version 789701 (0.0005) [2023-12-28 00:55:47,217][106225] Updated weights for policy 1, policy_version 791796 (0.0007) [2023-12-28 00:55:47,279][106225] Updated weights for policy 1, policy_version 791806 (0.0010) [2023-12-28 00:55:47,337][106225] Updated weights for policy 1, policy_version 791816 (0.0008) [2023-12-28 00:55:47,816][106226] Updated weights for policy 0, policy_version 789711 (0.0008) [2023-12-28 00:55:47,865][106226] Updated weights for policy 0, policy_version 789721 (0.0007) [2023-12-28 00:55:47,921][106226] Updated weights for policy 0, policy_version 789731 (0.0005) [2023-12-28 00:55:48,093][106225] Updated weights for policy 1, policy_version 791826 (0.0008) [2023-12-28 00:55:48,138][106225] Updated weights for policy 1, policy_version 791836 (0.0009) [2023-12-28 00:55:48,193][106225] Updated weights for policy 1, policy_version 791846 (0.0006) [2023-12-28 00:55:48,561][106226] Updated weights for policy 0, policy_version 789741 (0.0007) [2023-12-28 00:55:48,627][106226] Updated weights for policy 0, policy_version 789751 (0.0008) [2023-12-28 00:55:48,692][106226] Updated weights for policy 0, policy_version 789761 (0.0008) [2023-12-28 00:55:48,871][106225] Updated weights for policy 1, policy_version 791856 (0.0006) [2023-12-28 00:55:48,929][106225] Updated weights for policy 1, policy_version 791866 (0.0007) [2023-12-28 00:55:48,984][106225] Updated weights for policy 1, policy_version 791876 (0.0008) [2023-12-28 00:55:49,468][106226] Updated weights for policy 0, policy_version 789771 (0.0009) [2023-12-28 00:55:49,530][106226] Updated weights for policy 0, policy_version 789781 (0.0009) [2023-12-28 00:55:49,594][106226] Updated weights for policy 0, policy_version 789791 (0.0008) [2023-12-28 00:55:49,741][106225] Updated weights for policy 1, policy_version 791886 (0.0007) [2023-12-28 00:55:49,801][106225] Updated weights for policy 1, policy_version 791896 (0.0007) [2023-12-28 00:55:49,866][106225] Updated weights for policy 1, policy_version 791906 (0.0008) [2023-12-28 00:55:50,379][106226] Updated weights for policy 0, policy_version 789801 (0.0008) [2023-12-28 00:55:50,451][106226] Updated weights for policy 0, policy_version 789811 (0.0008) [2023-12-28 00:55:50,506][106226] Updated weights for policy 0, policy_version 789821 (0.0009) [2023-12-28 00:55:50,565][106226] Updated weights for policy 0, policy_version 789831 (0.0009) [2023-12-28 00:55:50,612][106225] Updated weights for policy 1, policy_version 791916 (0.0009) [2023-12-28 00:55:50,683][106225] Updated weights for policy 1, policy_version 791926 (0.0009) [2023-12-28 00:55:50,749][106225] Updated weights for policy 1, policy_version 791936 (0.0009) [2023-12-28 00:55:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 405028864. Throughput: 0: 10084.6, 1: 9962.5. Samples: 405040316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:51,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-5.111')] [2023-12-28 00:55:51,297][106226] Updated weights for policy 0, policy_version 789841 (0.0008) [2023-12-28 00:55:51,350][106226] Updated weights for policy 0, policy_version 789851 (0.0008) [2023-12-28 00:55:51,421][106226] Updated weights for policy 0, policy_version 789861 (0.0008) [2023-12-28 00:55:51,506][106225] Updated weights for policy 1, policy_version 791946 (0.0009) [2023-12-28 00:55:51,569][106225] Updated weights for policy 1, policy_version 791956 (0.0006) [2023-12-28 00:55:51,629][106225] Updated weights for policy 1, policy_version 791966 (0.0008) [2023-12-28 00:55:51,682][106225] Updated weights for policy 1, policy_version 791976 (0.0007) [2023-12-28 00:55:52,124][106226] Updated weights for policy 0, policy_version 789871 (0.0008) [2023-12-28 00:55:52,187][106226] Updated weights for policy 0, policy_version 789881 (0.0009) [2023-12-28 00:55:52,251][106226] Updated weights for policy 0, policy_version 789891 (0.0008) [2023-12-28 00:55:52,397][106225] Updated weights for policy 1, policy_version 791986 (0.0008) [2023-12-28 00:55:52,452][106225] Updated weights for policy 1, policy_version 791996 (0.0008) [2023-12-28 00:55:52,500][106225] Updated weights for policy 1, policy_version 792006 (0.0008) [2023-12-28 00:55:53,049][106226] Updated weights for policy 0, policy_version 789901 (0.0007) [2023-12-28 00:55:53,100][106226] Updated weights for policy 0, policy_version 789911 (0.0009) [2023-12-28 00:55:53,147][106226] Updated weights for policy 0, policy_version 789921 (0.0008) [2023-12-28 00:55:53,171][106225] Updated weights for policy 1, policy_version 792016 (0.0006) [2023-12-28 00:55:53,220][106225] Updated weights for policy 1, policy_version 792026 (0.0006) [2023-12-28 00:55:53,274][106225] Updated weights for policy 1, policy_version 792036 (0.0008) [2023-12-28 00:55:53,864][106225] Updated weights for policy 1, policy_version 792046 (0.0009) [2023-12-28 00:55:53,926][106225] Updated weights for policy 1, policy_version 792056 (0.0009) [2023-12-28 00:55:53,928][106226] Updated weights for policy 0, policy_version 789931 (0.0007) [2023-12-28 00:55:53,971][106225] Updated weights for policy 1, policy_version 792066 (0.0006) [2023-12-28 00:55:53,990][106226] Updated weights for policy 0, policy_version 789941 (0.0008) [2023-12-28 00:55:54,049][106226] Updated weights for policy 0, policy_version 789951 (0.0008) [2023-12-28 00:55:54,682][106225] Updated weights for policy 1, policy_version 792076 (0.0008) [2023-12-28 00:55:54,740][106225] Updated weights for policy 1, policy_version 792086 (0.0008) [2023-12-28 00:55:54,774][106226] Updated weights for policy 0, policy_version 789961 (0.0009) [2023-12-28 00:55:54,802][106225] Updated weights for policy 1, policy_version 792096 (0.0009) [2023-12-28 00:55:54,828][106226] Updated weights for policy 0, policy_version 789971 (0.0005) [2023-12-28 00:55:54,883][106226] Updated weights for policy 0, policy_version 789981 (0.0007) [2023-12-28 00:55:54,943][106226] Updated weights for policy 0, policy_version 789991 (0.0010) [2023-12-28 00:55:55,371][106225] Updated weights for policy 1, policy_version 792106 (0.0009) [2023-12-28 00:55:55,428][106225] Updated weights for policy 1, policy_version 792116 (0.0005) [2023-12-28 00:55:55,479][106225] Updated weights for policy 1, policy_version 792126 (0.0005) [2023-12-28 00:55:55,532][106225] Updated weights for policy 1, policy_version 792136 (0.0005) [2023-12-28 00:55:55,752][106226] Updated weights for policy 0, policy_version 790001 (0.0009) [2023-12-28 00:55:55,808][106226] Updated weights for policy 0, policy_version 790011 (0.0009) [2023-12-28 00:55:55,864][106226] Updated weights for policy 0, policy_version 790021 (0.0009) [2023-12-28 00:55:56,155][106225] Updated weights for policy 1, policy_version 792146 (0.0008) [2023-12-28 00:55:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 405127168. Throughput: 0: 9988.4, 1: 9973.2. Samples: 405098548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 00:55:56,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-5.009')] [2023-12-28 00:55:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000790024_202301440.pth... [2023-12-28 00:55:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000788872_202006528.pth [2023-12-28 00:55:56,218][106225] Updated weights for policy 1, policy_version 792156 (0.0008) [2023-12-28 00:55:56,265][106225] Updated weights for policy 1, policy_version 792166 (0.0008) [2023-12-28 00:55:56,276][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000792168_202833920.pth... [2023-12-28 00:55:56,279][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000790984_202530816.pth [2023-12-28 00:55:56,594][106226] Updated weights for policy 0, policy_version 790031 (0.0009) [2023-12-28 00:55:56,645][106226] Updated weights for policy 0, policy_version 790041 (0.0006) [2023-12-28 00:55:56,696][106226] Updated weights for policy 0, policy_version 790051 (0.0007) [2023-12-28 00:55:57,019][106225] Updated weights for policy 1, policy_version 792176 (0.0010) [2023-12-28 00:55:57,071][106225] Updated weights for policy 1, policy_version 792186 (0.0010) [2023-12-28 00:55:57,129][106225] Updated weights for policy 1, policy_version 792196 (0.0010) [2023-12-28 00:55:57,394][106226] Updated weights for policy 0, policy_version 790061 (0.0008) [2023-12-28 00:55:57,451][106226] Updated weights for policy 0, policy_version 790071 (0.0010) [2023-12-28 00:55:57,506][106226] Updated weights for policy 0, policy_version 790081 (0.0008) [2023-12-28 00:55:57,811][106225] Updated weights for policy 1, policy_version 792206 (0.0010) [2023-12-28 00:55:57,864][106225] Updated weights for policy 1, policy_version 792216 (0.0005) [2023-12-28 00:55:57,919][106225] Updated weights for policy 1, policy_version 792226 (0.0005) [2023-12-28 00:55:58,203][106226] Updated weights for policy 0, policy_version 790091 (0.0009) [2023-12-28 00:55:58,270][106226] Updated weights for policy 0, policy_version 790101 (0.0008) [2023-12-28 00:55:58,343][106226] Updated weights for policy 0, policy_version 790111 (0.0009) [2023-12-28 00:55:58,549][106225] Updated weights for policy 1, policy_version 792236 (0.0006) [2023-12-28 00:55:58,612][106225] Updated weights for policy 1, policy_version 792246 (0.0008) [2023-12-28 00:55:58,671][106225] Updated weights for policy 1, policy_version 792256 (0.0007) [2023-12-28 00:55:59,116][106226] Updated weights for policy 0, policy_version 790121 (0.0008) [2023-12-28 00:55:59,184][106226] Updated weights for policy 0, policy_version 790131 (0.0009) [2023-12-28 00:55:59,250][106226] Updated weights for policy 0, policy_version 790141 (0.0009) [2023-12-28 00:55:59,321][106226] Updated weights for policy 0, policy_version 790151 (0.0009) [2023-12-28 00:55:59,516][106225] Updated weights for policy 1, policy_version 792266 (0.0008) [2023-12-28 00:55:59,579][106225] Updated weights for policy 1, policy_version 792276 (0.0010) [2023-12-28 00:55:59,643][106225] Updated weights for policy 1, policy_version 792286 (0.0010) [2023-12-28 00:55:59,705][106225] Updated weights for policy 1, policy_version 792296 (0.0010) [2023-12-28 00:56:00,051][106226] Updated weights for policy 0, policy_version 790161 (0.0007) [2023-12-28 00:56:00,113][106226] Updated weights for policy 0, policy_version 790171 (0.0008) [2023-12-28 00:56:00,171][106226] Updated weights for policy 0, policy_version 790181 (0.0008) [2023-12-28 00:56:00,376][106225] Updated weights for policy 1, policy_version 792306 (0.0011) [2023-12-28 00:56:00,437][106225] Updated weights for policy 1, policy_version 792316 (0.0010) [2023-12-28 00:56:00,497][106225] Updated weights for policy 1, policy_version 792326 (0.0010) [2023-12-28 00:56:00,871][106226] Updated weights for policy 0, policy_version 790191 (0.0008) [2023-12-28 00:56:00,921][106226] Updated weights for policy 0, policy_version 790201 (0.0009) [2023-12-28 00:56:00,978][106226] Updated weights for policy 0, policy_version 790211 (0.0007) [2023-12-28 00:56:01,083][106225] Updated weights for policy 1, policy_version 792336 (0.0010) [2023-12-28 00:56:01,146][106225] Updated weights for policy 1, policy_version 792346 (0.0010) [2023-12-28 00:56:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 405225472. Throughput: 0: 9968.7, 1: 10038.7. Samples: 405215240. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:01,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.099')] [2023-12-28 00:56:01,208][106225] Updated weights for policy 1, policy_version 792356 (0.0011) [2023-12-28 00:56:01,815][106226] Updated weights for policy 0, policy_version 790221 (0.0008) [2023-12-28 00:56:01,881][106226] Updated weights for policy 0, policy_version 790231 (0.0008) [2023-12-28 00:56:01,946][106226] Updated weights for policy 0, policy_version 790241 (0.0008) [2023-12-28 00:56:01,963][106225] Updated weights for policy 1, policy_version 792366 (0.0010) [2023-12-28 00:56:02,023][106225] Updated weights for policy 1, policy_version 792376 (0.0010) [2023-12-28 00:56:02,080][106225] Updated weights for policy 1, policy_version 792386 (0.0010) [2023-12-28 00:56:02,656][106226] Updated weights for policy 0, policy_version 790251 (0.0005) [2023-12-28 00:56:02,720][106226] Updated weights for policy 0, policy_version 790261 (0.0008) [2023-12-28 00:56:02,787][106226] Updated weights for policy 0, policy_version 790271 (0.0007) [2023-12-28 00:56:02,801][106225] Updated weights for policy 1, policy_version 792396 (0.0010) [2023-12-28 00:56:02,855][106225] Updated weights for policy 1, policy_version 792406 (0.0009) [2023-12-28 00:56:02,910][106225] Updated weights for policy 1, policy_version 792416 (0.0005) [2023-12-28 00:56:03,468][106226] Updated weights for policy 0, policy_version 790281 (0.0006) [2023-12-28 00:56:03,527][106226] Updated weights for policy 0, policy_version 790291 (0.0007) [2023-12-28 00:56:03,584][106226] Updated weights for policy 0, policy_version 790301 (0.0007) [2023-12-28 00:56:03,596][106225] Updated weights for policy 1, policy_version 792426 (0.0009) [2023-12-28 00:56:03,637][106226] Updated weights for policy 0, policy_version 790311 (0.0007) [2023-12-28 00:56:03,654][106225] Updated weights for policy 1, policy_version 792436 (0.0010) [2023-12-28 00:56:03,697][106225] Updated weights for policy 1, policy_version 792446 (0.0010) [2023-12-28 00:56:03,743][106225] Updated weights for policy 1, policy_version 792456 (0.0010) [2023-12-28 00:56:04,431][106226] Updated weights for policy 0, policy_version 790321 (0.0008) [2023-12-28 00:56:04,461][106225] Updated weights for policy 1, policy_version 792466 (0.0009) [2023-12-28 00:56:04,492][106226] Updated weights for policy 0, policy_version 790331 (0.0006) [2023-12-28 00:56:04,518][106225] Updated weights for policy 1, policy_version 792476 (0.0009) [2023-12-28 00:56:04,552][106226] Updated weights for policy 0, policy_version 790341 (0.0006) [2023-12-28 00:56:04,578][106225] Updated weights for policy 1, policy_version 792486 (0.0008) [2023-12-28 00:56:05,193][106225] Updated weights for policy 1, policy_version 792496 (0.0006) [2023-12-28 00:56:05,206][106226] Updated weights for policy 0, policy_version 790351 (0.0005) [2023-12-28 00:56:05,255][106225] Updated weights for policy 1, policy_version 792506 (0.0008) [2023-12-28 00:56:05,267][106226] Updated weights for policy 0, policy_version 790361 (0.0005) [2023-12-28 00:56:05,311][106225] Updated weights for policy 1, policy_version 792516 (0.0010) [2023-12-28 00:56:05,325][106226] Updated weights for policy 0, policy_version 790371 (0.0006) [2023-12-28 00:56:05,902][106225] Updated weights for policy 1, policy_version 792526 (0.0005) [2023-12-28 00:56:05,963][106226] Updated weights for policy 0, policy_version 790381 (0.0008) [2023-12-28 00:56:05,966][106225] Updated weights for policy 1, policy_version 792536 (0.0010) [2023-12-28 00:56:06,030][106226] Updated weights for policy 0, policy_version 790391 (0.0006) [2023-12-28 00:56:06,030][106225] Updated weights for policy 1, policy_version 792546 (0.0010) [2023-12-28 00:56:06,086][106226] Updated weights for policy 0, policy_version 790401 (0.0006) [2023-12-28 00:56:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 405331968. Throughput: 0: 9853.7, 1: 10062.1. Samples: 405334992. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:06,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-5.313')] [2023-12-28 00:56:06,730][106225] Updated weights for policy 1, policy_version 792556 (0.0010) [2023-12-28 00:56:06,793][106226] Updated weights for policy 0, policy_version 790411 (0.0009) [2023-12-28 00:56:06,793][106225] Updated weights for policy 1, policy_version 792566 (0.0010) [2023-12-28 00:56:06,848][106226] Updated weights for policy 0, policy_version 790421 (0.0008) [2023-12-28 00:56:06,860][106225] Updated weights for policy 1, policy_version 792576 (0.0008) [2023-12-28 00:56:06,907][106226] Updated weights for policy 0, policy_version 790431 (0.0010) [2023-12-28 00:56:07,425][106225] Updated weights for policy 1, policy_version 792586 (0.0008) [2023-12-28 00:56:07,489][106225] Updated weights for policy 1, policy_version 792596 (0.0007) [2023-12-28 00:56:07,546][106225] Updated weights for policy 1, policy_version 792606 (0.0008) [2023-12-28 00:56:07,607][106225] Updated weights for policy 1, policy_version 792616 (0.0010) [2023-12-28 00:56:07,612][106226] Updated weights for policy 0, policy_version 790441 (0.0011) [2023-12-28 00:56:07,678][106226] Updated weights for policy 0, policy_version 790451 (0.0010) [2023-12-28 00:56:07,743][106226] Updated weights for policy 0, policy_version 790461 (0.0011) [2023-12-28 00:56:07,804][106226] Updated weights for policy 0, policy_version 790471 (0.0011) [2023-12-28 00:56:08,299][106225] Updated weights for policy 1, policy_version 792626 (0.0005) [2023-12-28 00:56:08,364][106225] Updated weights for policy 1, policy_version 792636 (0.0007) [2023-12-28 00:56:08,429][106225] Updated weights for policy 1, policy_version 792646 (0.0007) [2023-12-28 00:56:08,488][106226] Updated weights for policy 0, policy_version 790481 (0.0008) [2023-12-28 00:56:08,548][106226] Updated weights for policy 0, policy_version 790491 (0.0009) [2023-12-28 00:56:08,610][106226] Updated weights for policy 0, policy_version 790501 (0.0009) [2023-12-28 00:56:09,070][106225] Updated weights for policy 1, policy_version 792656 (0.0010) [2023-12-28 00:56:09,123][106225] Updated weights for policy 1, policy_version 792666 (0.0010) [2023-12-28 00:56:09,183][106225] Updated weights for policy 1, policy_version 792676 (0.0010) [2023-12-28 00:56:09,262][106226] Updated weights for policy 0, policy_version 790511 (0.0010) [2023-12-28 00:56:09,323][106226] Updated weights for policy 0, policy_version 790521 (0.0007) [2023-12-28 00:56:09,389][106226] Updated weights for policy 0, policy_version 790531 (0.0010) [2023-12-28 00:56:09,930][106225] Updated weights for policy 1, policy_version 792686 (0.0009) [2023-12-28 00:56:10,002][106225] Updated weights for policy 1, policy_version 792696 (0.0009) [2023-12-28 00:56:10,068][106225] Updated weights for policy 1, policy_version 792706 (0.0008) [2023-12-28 00:56:10,143][106226] Updated weights for policy 0, policy_version 790541 (0.0008) [2023-12-28 00:56:10,205][106226] Updated weights for policy 0, policy_version 790551 (0.0009) [2023-12-28 00:56:10,267][106226] Updated weights for policy 0, policy_version 790561 (0.0009) [2023-12-28 00:56:10,733][106225] Updated weights for policy 1, policy_version 792716 (0.0007) [2023-12-28 00:56:10,793][106225] Updated weights for policy 1, policy_version 792726 (0.0007) [2023-12-28 00:56:10,855][106225] Updated weights for policy 1, policy_version 792736 (0.0008) [2023-12-28 00:56:11,070][106226] Updated weights for policy 0, policy_version 790571 (0.0009) [2023-12-28 00:56:11,131][106226] Updated weights for policy 0, policy_version 790581 (0.0009) [2023-12-28 00:56:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 405422080. Throughput: 0: 9851.5, 1: 10130.5. Samples: 405395844. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:11,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.102')] [2023-12-28 00:56:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000792744_202981376.pth... [2023-12-28 00:56:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000791560_202678272.pth [2023-12-28 00:56:11,198][106226] Updated weights for policy 0, policy_version 790591 (0.0010) [2023-12-28 00:56:11,263][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000790600_202448896.pth... [2023-12-28 00:56:11,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000789448_202153984.pth [2023-12-28 00:56:11,538][106225] Updated weights for policy 1, policy_version 792746 (0.0007) [2023-12-28 00:56:11,602][106225] Updated weights for policy 1, policy_version 792756 (0.0006) [2023-12-28 00:56:11,667][106225] Updated weights for policy 1, policy_version 792766 (0.0008) [2023-12-28 00:56:11,736][106225] Updated weights for policy 1, policy_version 792776 (0.0010) [2023-12-28 00:56:12,140][106226] Updated weights for policy 0, policy_version 790601 (0.0009) [2023-12-28 00:56:12,208][106226] Updated weights for policy 0, policy_version 790611 (0.0008) [2023-12-28 00:56:12,277][106226] Updated weights for policy 0, policy_version 790621 (0.0009) [2023-12-28 00:56:12,344][106226] Updated weights for policy 0, policy_version 790631 (0.0008) [2023-12-28 00:56:12,485][106225] Updated weights for policy 1, policy_version 792786 (0.0011) [2023-12-28 00:56:12,540][106225] Updated weights for policy 1, policy_version 792796 (0.0010) [2023-12-28 00:56:12,604][106225] Updated weights for policy 1, policy_version 792806 (0.0011) [2023-12-28 00:56:13,080][106226] Updated weights for policy 0, policy_version 790641 (0.0007) [2023-12-28 00:56:13,126][106226] Updated weights for policy 0, policy_version 790651 (0.0010) [2023-12-28 00:56:13,172][106226] Updated weights for policy 0, policy_version 790661 (0.0010) [2023-12-28 00:56:13,287][106225] Updated weights for policy 1, policy_version 792816 (0.0010) [2023-12-28 00:56:13,337][106225] Updated weights for policy 1, policy_version 792826 (0.0010) [2023-12-28 00:56:13,394][106225] Updated weights for policy 1, policy_version 792836 (0.0008) [2023-12-28 00:56:13,857][106226] Updated weights for policy 0, policy_version 790671 (0.0010) [2023-12-28 00:56:13,918][106226] Updated weights for policy 0, policy_version 790681 (0.0011) [2023-12-28 00:56:13,971][106226] Updated weights for policy 0, policy_version 790691 (0.0010) [2023-12-28 00:56:13,976][106225] Updated weights for policy 1, policy_version 792846 (0.0010) [2023-12-28 00:56:14,025][106225] Updated weights for policy 1, policy_version 792856 (0.0010) [2023-12-28 00:56:14,075][106225] Updated weights for policy 1, policy_version 792866 (0.0010) [2023-12-28 00:56:14,667][106226] Updated weights for policy 0, policy_version 790701 (0.0010) [2023-12-28 00:56:14,729][106226] Updated weights for policy 0, policy_version 790711 (0.0006) [2023-12-28 00:56:14,763][106225] Updated weights for policy 1, policy_version 792876 (0.0010) [2023-12-28 00:56:14,795][106226] Updated weights for policy 0, policy_version 790721 (0.0007) [2023-12-28 00:56:14,826][106225] Updated weights for policy 1, policy_version 792886 (0.0010) [2023-12-28 00:56:14,885][106225] Updated weights for policy 1, policy_version 792896 (0.0011) [2023-12-28 00:56:15,538][106226] Updated weights for policy 0, policy_version 790731 (0.0009) [2023-12-28 00:56:15,583][106225] Updated weights for policy 1, policy_version 792906 (0.0010) [2023-12-28 00:56:15,599][106226] Updated weights for policy 0, policy_version 790741 (0.0010) [2023-12-28 00:56:15,645][106225] Updated weights for policy 1, policy_version 792916 (0.0010) [2023-12-28 00:56:15,662][106226] Updated weights for policy 0, policy_version 790751 (0.0007) [2023-12-28 00:56:15,702][106225] Updated weights for policy 1, policy_version 792926 (0.0010) [2023-12-28 00:56:15,759][106225] Updated weights for policy 1, policy_version 792936 (0.0010) [2023-12-28 00:56:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 405520384. Throughput: 0: 9695.9, 1: 10011.4. Samples: 405510912. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:16,176][105115] Avg episode reward: [(0, '-4.505'), (1, '-5.278')] [2023-12-28 00:56:16,291][106226] Updated weights for policy 0, policy_version 790761 (0.0006) [2023-12-28 00:56:16,347][106226] Updated weights for policy 0, policy_version 790771 (0.0010) [2023-12-28 00:56:16,400][106226] Updated weights for policy 0, policy_version 790781 (0.0010) [2023-12-28 00:56:16,453][106226] Updated weights for policy 0, policy_version 790791 (0.0010) [2023-12-28 00:56:16,489][106225] Updated weights for policy 1, policy_version 792946 (0.0007) [2023-12-28 00:56:16,540][106225] Updated weights for policy 1, policy_version 792956 (0.0008) [2023-12-28 00:56:16,587][106225] Updated weights for policy 1, policy_version 792966 (0.0008) [2023-12-28 00:56:17,133][106226] Updated weights for policy 0, policy_version 790801 (0.0005) [2023-12-28 00:56:17,196][106226] Updated weights for policy 0, policy_version 790811 (0.0010) [2023-12-28 00:56:17,255][106226] Updated weights for policy 0, policy_version 790821 (0.0010) [2023-12-28 00:56:17,328][106225] Updated weights for policy 1, policy_version 792976 (0.0009) [2023-12-28 00:56:17,384][106225] Updated weights for policy 1, policy_version 792986 (0.0005) [2023-12-28 00:56:17,449][106225] Updated weights for policy 1, policy_version 792996 (0.0006) [2023-12-28 00:56:17,899][106226] Updated weights for policy 0, policy_version 790831 (0.0007) [2023-12-28 00:56:17,955][106226] Updated weights for policy 0, policy_version 790841 (0.0008) [2023-12-28 00:56:18,019][106226] Updated weights for policy 0, policy_version 790851 (0.0008) [2023-12-28 00:56:18,019][106225] Updated weights for policy 1, policy_version 793006 (0.0010) [2023-12-28 00:56:18,080][106225] Updated weights for policy 1, policy_version 793016 (0.0010) [2023-12-28 00:56:18,140][106225] Updated weights for policy 1, policy_version 793026 (0.0010) [2023-12-28 00:56:18,779][106226] Updated weights for policy 0, policy_version 790861 (0.0009) [2023-12-28 00:56:18,830][106225] Updated weights for policy 1, policy_version 793036 (0.0011) [2023-12-28 00:56:18,832][106226] Updated weights for policy 0, policy_version 790871 (0.0007) [2023-12-28 00:56:18,888][106225] Updated weights for policy 1, policy_version 793046 (0.0010) [2023-12-28 00:56:18,894][106226] Updated weights for policy 0, policy_version 790881 (0.0006) [2023-12-28 00:56:18,946][106225] Updated weights for policy 1, policy_version 793056 (0.0010) [2023-12-28 00:56:19,670][106226] Updated weights for policy 0, policy_version 790891 (0.0006) [2023-12-28 00:56:19,712][106225] Updated weights for policy 1, policy_version 793066 (0.0010) [2023-12-28 00:56:19,730][106226] Updated weights for policy 0, policy_version 790901 (0.0007) [2023-12-28 00:56:19,771][106225] Updated weights for policy 1, policy_version 793076 (0.0010) [2023-12-28 00:56:19,789][106226] Updated weights for policy 0, policy_version 790911 (0.0006) [2023-12-28 00:56:19,831][106225] Updated weights for policy 1, policy_version 793086 (0.0010) [2023-12-28 00:56:19,896][106225] Updated weights for policy 1, policy_version 793096 (0.0008) [2023-12-28 00:56:20,588][106225] Updated weights for policy 1, policy_version 793106 (0.0007) [2023-12-28 00:56:20,598][106226] Updated weights for policy 0, policy_version 790921 (0.0008) [2023-12-28 00:56:20,640][106225] Updated weights for policy 1, policy_version 793116 (0.0008) [2023-12-28 00:56:20,652][106226] Updated weights for policy 0, policy_version 790931 (0.0009) [2023-12-28 00:56:20,701][106225] Updated weights for policy 1, policy_version 793126 (0.0009) [2023-12-28 00:56:20,711][106226] Updated weights for policy 0, policy_version 790941 (0.0010) [2023-12-28 00:56:20,771][106226] Updated weights for policy 0, policy_version 790951 (0.0009) [2023-12-28 00:56:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 405618688. Throughput: 0: 9598.3, 1: 9962.2. Samples: 405627724. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:21,176][105115] Avg episode reward: [(0, '-4.006'), (1, '-5.134')] [2023-12-28 00:56:21,470][106225] Updated weights for policy 1, policy_version 793136 (0.0008) [2023-12-28 00:56:21,519][106225] Updated weights for policy 1, policy_version 793146 (0.0008) [2023-12-28 00:56:21,581][106225] Updated weights for policy 1, policy_version 793156 (0.0009) [2023-12-28 00:56:21,591][106226] Updated weights for policy 0, policy_version 790961 (0.0007) [2023-12-28 00:56:21,658][106226] Updated weights for policy 0, policy_version 790971 (0.0009) [2023-12-28 00:56:21,724][106226] Updated weights for policy 0, policy_version 790981 (0.0008) [2023-12-28 00:56:22,359][106225] Updated weights for policy 1, policy_version 793166 (0.0007) [2023-12-28 00:56:22,420][106225] Updated weights for policy 1, policy_version 793176 (0.0009) [2023-12-28 00:56:22,481][106225] Updated weights for policy 1, policy_version 793186 (0.0008) [2023-12-28 00:56:22,496][106226] Updated weights for policy 0, policy_version 790991 (0.0008) [2023-12-28 00:56:22,558][106226] Updated weights for policy 0, policy_version 791001 (0.0010) [2023-12-28 00:56:22,615][106226] Updated weights for policy 0, policy_version 791011 (0.0009) [2023-12-28 00:56:23,205][106225] Updated weights for policy 1, policy_version 793196 (0.0010) [2023-12-28 00:56:23,265][106225] Updated weights for policy 1, policy_version 793206 (0.0005) [2023-12-28 00:56:23,289][106226] Updated weights for policy 0, policy_version 791021 (0.0010) [2023-12-28 00:56:23,326][106225] Updated weights for policy 1, policy_version 793216 (0.0005) [2023-12-28 00:56:23,342][106226] Updated weights for policy 0, policy_version 791031 (0.0010) [2023-12-28 00:56:23,393][106226] Updated weights for policy 0, policy_version 791041 (0.0005) [2023-12-28 00:56:23,864][106225] Updated weights for policy 1, policy_version 793226 (0.0007) [2023-12-28 00:56:23,915][106225] Updated weights for policy 1, policy_version 793236 (0.0008) [2023-12-28 00:56:23,962][106225] Updated weights for policy 1, policy_version 793246 (0.0007) [2023-12-28 00:56:24,012][106225] Updated weights for policy 1, policy_version 793256 (0.0008) [2023-12-28 00:56:24,039][106226] Updated weights for policy 0, policy_version 791051 (0.0007) [2023-12-28 00:56:24,099][106226] Updated weights for policy 0, policy_version 791061 (0.0010) [2023-12-28 00:56:24,157][106226] Updated weights for policy 0, policy_version 791071 (0.0010) [2023-12-28 00:56:24,700][106225] Updated weights for policy 1, policy_version 793266 (0.0006) [2023-12-28 00:56:24,757][106225] Updated weights for policy 1, policy_version 793276 (0.0007) [2023-12-28 00:56:24,819][106225] Updated weights for policy 1, policy_version 793286 (0.0005) [2023-12-28 00:56:24,864][106226] Updated weights for policy 0, policy_version 791081 (0.0011) [2023-12-28 00:56:24,927][106226] Updated weights for policy 0, policy_version 791091 (0.0011) [2023-12-28 00:56:24,990][106226] Updated weights for policy 0, policy_version 791101 (0.0011) [2023-12-28 00:56:25,051][106226] Updated weights for policy 0, policy_version 791111 (0.0010) [2023-12-28 00:56:25,389][106225] Updated weights for policy 1, policy_version 793296 (0.0008) [2023-12-28 00:56:25,451][106225] Updated weights for policy 1, policy_version 793306 (0.0008) [2023-12-28 00:56:25,505][106225] Updated weights for policy 1, policy_version 793316 (0.0008) [2023-12-28 00:56:25,730][106226] Updated weights for policy 0, policy_version 791121 (0.0008) [2023-12-28 00:56:25,787][106226] Updated weights for policy 0, policy_version 791131 (0.0009) [2023-12-28 00:56:25,846][106226] Updated weights for policy 0, policy_version 791141 (0.0006) [2023-12-28 00:56:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 405716992. Throughput: 0: 9602.0, 1: 9968.6. Samples: 405686652. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:26,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.097')] [2023-12-28 00:56:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000793320_203128832.pth... [2023-12-28 00:56:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000791144_202588160.pth... [2023-12-28 00:56:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000792168_202833920.pth [2023-12-28 00:56:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000790024_202301440.pth [2023-12-28 00:56:26,231][106225] Updated weights for policy 1, policy_version 793326 (0.0008) [2023-12-28 00:56:26,280][106225] Updated weights for policy 1, policy_version 793336 (0.0008) [2023-12-28 00:56:26,335][106225] Updated weights for policy 1, policy_version 793346 (0.0008) [2023-12-28 00:56:26,469][106226] Updated weights for policy 0, policy_version 791151 (0.0009) [2023-12-28 00:56:26,530][106226] Updated weights for policy 0, policy_version 791161 (0.0011) [2023-12-28 00:56:26,583][106226] Updated weights for policy 0, policy_version 791171 (0.0010) [2023-12-28 00:56:27,090][106225] Updated weights for policy 1, policy_version 793356 (0.0008) [2023-12-28 00:56:27,152][106225] Updated weights for policy 1, policy_version 793366 (0.0008) [2023-12-28 00:56:27,203][106225] Updated weights for policy 1, policy_version 793376 (0.0007) [2023-12-28 00:56:27,206][106226] Updated weights for policy 0, policy_version 791181 (0.0008) [2023-12-28 00:56:27,272][106226] Updated weights for policy 0, policy_version 791191 (0.0005) [2023-12-28 00:56:27,338][106226] Updated weights for policy 0, policy_version 791201 (0.0007) [2023-12-28 00:56:27,817][106225] Updated weights for policy 1, policy_version 793386 (0.0007) [2023-12-28 00:56:27,870][106225] Updated weights for policy 1, policy_version 793397 (0.0009) [2023-12-28 00:56:27,896][106226] Updated weights for policy 0, policy_version 791211 (0.0006) [2023-12-28 00:56:27,927][106225] Updated weights for policy 1, policy_version 793407 (0.0008) [2023-12-28 00:56:27,951][106226] Updated weights for policy 0, policy_version 791221 (0.0005) [2023-12-28 00:56:28,003][106226] Updated weights for policy 0, policy_version 791231 (0.0005) [2023-12-28 00:56:28,587][106226] Updated weights for policy 0, policy_version 791241 (0.0005) [2023-12-28 00:56:28,641][106226] Updated weights for policy 0, policy_version 791251 (0.0005) [2023-12-28 00:56:28,690][106226] Updated weights for policy 0, policy_version 791261 (0.0005) [2023-12-28 00:56:28,732][106225] Updated weights for policy 1, policy_version 793417 (0.0008) [2023-12-28 00:56:28,745][106226] Updated weights for policy 0, policy_version 791271 (0.0005) [2023-12-28 00:56:28,792][106225] Updated weights for policy 1, policy_version 793427 (0.0009) [2023-12-28 00:56:28,852][106225] Updated weights for policy 1, policy_version 793437 (0.0008) [2023-12-28 00:56:28,908][106225] Updated weights for policy 1, policy_version 793447 (0.0009) [2023-12-28 00:56:29,386][106226] Updated weights for policy 0, policy_version 791281 (0.0008) [2023-12-28 00:56:29,447][106226] Updated weights for policy 0, policy_version 791291 (0.0009) [2023-12-28 00:56:29,503][106226] Updated weights for policy 0, policy_version 791301 (0.0005) [2023-12-28 00:56:29,669][106225] Updated weights for policy 1, policy_version 793457 (0.0008) [2023-12-28 00:56:29,728][106225] Updated weights for policy 1, policy_version 793467 (0.0008) [2023-12-28 00:56:29,796][106225] Updated weights for policy 1, policy_version 793477 (0.0006) [2023-12-28 00:56:30,237][106226] Updated weights for policy 0, policy_version 791311 (0.0009) [2023-12-28 00:56:30,297][106226] Updated weights for policy 0, policy_version 791321 (0.0010) [2023-12-28 00:56:30,358][106226] Updated weights for policy 0, policy_version 791331 (0.0010) [2023-12-28 00:56:30,507][106225] Updated weights for policy 1, policy_version 793487 (0.0007) [2023-12-28 00:56:30,560][106225] Updated weights for policy 1, policy_version 793497 (0.0008) [2023-12-28 00:56:30,602][106225] Updated weights for policy 1, policy_version 793507 (0.0007) [2023-12-28 00:56:31,069][106226] Updated weights for policy 0, policy_version 791341 (0.0009) [2023-12-28 00:56:31,123][106226] Updated weights for policy 0, policy_version 791351 (0.0007) [2023-12-28 00:56:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 405815296. Throughput: 0: 9784.6, 1: 10004.4. Samples: 405810488. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:31,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.315')] [2023-12-28 00:56:31,186][106226] Updated weights for policy 0, policy_version 791361 (0.0006) [2023-12-28 00:56:31,340][106225] Updated weights for policy 1, policy_version 793517 (0.0008) [2023-12-28 00:56:31,410][106225] Updated weights for policy 1, policy_version 793527 (0.0008) [2023-12-28 00:56:31,475][106225] Updated weights for policy 1, policy_version 793537 (0.0007) [2023-12-28 00:56:31,908][106226] Updated weights for policy 0, policy_version 791371 (0.0006) [2023-12-28 00:56:31,973][106226] Updated weights for policy 0, policy_version 791381 (0.0008) [2023-12-28 00:56:32,037][106226] Updated weights for policy 0, policy_version 791391 (0.0008) [2023-12-28 00:56:32,203][106225] Updated weights for policy 1, policy_version 793547 (0.0008) [2023-12-28 00:56:32,263][106225] Updated weights for policy 1, policy_version 793557 (0.0008) [2023-12-28 00:56:32,328][106225] Updated weights for policy 1, policy_version 793567 (0.0008) [2023-12-28 00:56:32,742][106226] Updated weights for policy 0, policy_version 791401 (0.0008) [2023-12-28 00:56:32,807][106226] Updated weights for policy 0, policy_version 791411 (0.0011) [2023-12-28 00:56:32,871][106226] Updated weights for policy 0, policy_version 791421 (0.0011) [2023-12-28 00:56:32,932][106226] Updated weights for policy 0, policy_version 791431 (0.0008) [2023-12-28 00:56:33,092][106225] Updated weights for policy 1, policy_version 793577 (0.0008) [2023-12-28 00:56:33,159][106225] Updated weights for policy 1, policy_version 793587 (0.0008) [2023-12-28 00:56:33,218][106225] Updated weights for policy 1, policy_version 793597 (0.0009) [2023-12-28 00:56:33,271][106225] Updated weights for policy 1, policy_version 793607 (0.0009) [2023-12-28 00:56:33,554][106226] Updated weights for policy 0, policy_version 791441 (0.0009) [2023-12-28 00:56:33,604][106226] Updated weights for policy 0, policy_version 791451 (0.0007) [2023-12-28 00:56:33,648][106226] Updated weights for policy 0, policy_version 791461 (0.0005) [2023-12-28 00:56:34,029][106225] Updated weights for policy 1, policy_version 793617 (0.0008) [2023-12-28 00:56:34,084][106225] Updated weights for policy 1, policy_version 793627 (0.0008) [2023-12-28 00:56:34,142][106225] Updated weights for policy 1, policy_version 793637 (0.0009) [2023-12-28 00:56:34,263][106226] Updated weights for policy 0, policy_version 791471 (0.0007) [2023-12-28 00:56:34,326][106226] Updated weights for policy 0, policy_version 791481 (0.0009) [2023-12-28 00:56:34,393][106226] Updated weights for policy 0, policy_version 791491 (0.0009) [2023-12-28 00:56:34,900][106225] Updated weights for policy 1, policy_version 793647 (0.0010) [2023-12-28 00:56:34,956][106225] Updated weights for policy 1, policy_version 793657 (0.0010) [2023-12-28 00:56:35,006][106225] Updated weights for policy 1, policy_version 793667 (0.0010) [2023-12-28 00:56:35,131][106226] Updated weights for policy 0, policy_version 791501 (0.0009) [2023-12-28 00:56:35,181][106226] Updated weights for policy 0, policy_version 791511 (0.0008) [2023-12-28 00:56:35,233][106226] Updated weights for policy 0, policy_version 791521 (0.0008) [2023-12-28 00:56:35,729][106225] Updated weights for policy 1, policy_version 793677 (0.0010) [2023-12-28 00:56:35,781][106225] Updated weights for policy 1, policy_version 793687 (0.0010) [2023-12-28 00:56:35,843][106225] Updated weights for policy 1, policy_version 793697 (0.0010) [2023-12-28 00:56:35,898][106226] Updated weights for policy 0, policy_version 791531 (0.0007) [2023-12-28 00:56:35,953][106226] Updated weights for policy 0, policy_version 791541 (0.0005) [2023-12-28 00:56:36,008][106226] Updated weights for policy 0, policy_version 791551 (0.0006) [2023-12-28 00:56:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 405921792. Throughput: 0: 9719.0, 1: 10001.7. Samples: 405927748. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:36,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.959')] [2023-12-28 00:56:36,545][106225] Updated weights for policy 1, policy_version 793707 (0.0010) [2023-12-28 00:56:36,606][106225] Updated weights for policy 1, policy_version 793717 (0.0008) [2023-12-28 00:56:36,626][106226] Updated weights for policy 0, policy_version 791561 (0.0008) [2023-12-28 00:56:36,661][106225] Updated weights for policy 1, policy_version 793727 (0.0008) [2023-12-28 00:56:36,694][106226] Updated weights for policy 0, policy_version 791571 (0.0007) [2023-12-28 00:56:36,756][106226] Updated weights for policy 0, policy_version 791581 (0.0010) [2023-12-28 00:56:36,820][106226] Updated weights for policy 0, policy_version 791591 (0.0007) [2023-12-28 00:56:37,420][106225] Updated weights for policy 1, policy_version 793737 (0.0008) [2023-12-28 00:56:37,473][106225] Updated weights for policy 1, policy_version 793747 (0.0008) [2023-12-28 00:56:37,491][106226] Updated weights for policy 0, policy_version 791601 (0.0008) [2023-12-28 00:56:37,518][106225] Updated weights for policy 1, policy_version 793757 (0.0008) [2023-12-28 00:56:37,541][106226] Updated weights for policy 0, policy_version 791611 (0.0005) [2023-12-28 00:56:37,567][106225] Updated weights for policy 1, policy_version 793767 (0.0008) [2023-12-28 00:56:37,587][106226] Updated weights for policy 0, policy_version 791621 (0.0005) [2023-12-28 00:56:38,321][106226] Updated weights for policy 0, policy_version 791631 (0.0007) [2023-12-28 00:56:38,330][106225] Updated weights for policy 1, policy_version 793777 (0.0006) [2023-12-28 00:56:38,387][106226] Updated weights for policy 0, policy_version 791641 (0.0008) [2023-12-28 00:56:38,392][106225] Updated weights for policy 1, policy_version 793787 (0.0007) [2023-12-28 00:56:38,450][106226] Updated weights for policy 0, policy_version 791651 (0.0008) [2023-12-28 00:56:38,457][106225] Updated weights for policy 1, policy_version 793797 (0.0006) [2023-12-28 00:56:39,094][106225] Updated weights for policy 1, policy_version 793807 (0.0007) [2023-12-28 00:56:39,145][106225] Updated weights for policy 1, policy_version 793817 (0.0008) [2023-12-28 00:56:39,195][106225] Updated weights for policy 1, policy_version 793827 (0.0007) [2023-12-28 00:56:39,205][106226] Updated weights for policy 0, policy_version 791661 (0.0008) [2023-12-28 00:56:39,285][106226] Updated weights for policy 0, policy_version 791671 (0.0007) [2023-12-28 00:56:39,351][106226] Updated weights for policy 0, policy_version 791681 (0.0007) [2023-12-28 00:56:39,914][106225] Updated weights for policy 1, policy_version 793837 (0.0008) [2023-12-28 00:56:39,980][106225] Updated weights for policy 1, policy_version 793847 (0.0008) [2023-12-28 00:56:40,049][106225] Updated weights for policy 1, policy_version 793857 (0.0006) [2023-12-28 00:56:40,117][106226] Updated weights for policy 0, policy_version 791691 (0.0008) [2023-12-28 00:56:40,178][106226] Updated weights for policy 0, policy_version 791701 (0.0010) [2023-12-28 00:56:40,243][106226] Updated weights for policy 0, policy_version 791711 (0.0009) [2023-12-28 00:56:40,702][106225] Updated weights for policy 1, policy_version 793867 (0.0007) [2023-12-28 00:56:40,760][106225] Updated weights for policy 1, policy_version 793877 (0.0008) [2023-12-28 00:56:40,817][106225] Updated weights for policy 1, policy_version 793887 (0.0005) [2023-12-28 00:56:40,978][106226] Updated weights for policy 0, policy_version 791721 (0.0008) [2023-12-28 00:56:41,041][106226] Updated weights for policy 0, policy_version 791731 (0.0009) [2023-12-28 00:56:41,096][106226] Updated weights for policy 0, policy_version 791741 (0.0007) [2023-12-28 00:56:41,164][106226] Updated weights for policy 0, policy_version 791751 (0.0007) [2023-12-28 00:56:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 406020096. Throughput: 0: 9773.3, 1: 9971.4. Samples: 405987064. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:41,176][105115] Avg episode reward: [(0, '-4.398'), (1, '-5.248')] [2023-12-28 00:56:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000793896_203276288.pth... [2023-12-28 00:56:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000791752_202743808.pth... [2023-12-28 00:56:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000790600_202448896.pth [2023-12-28 00:56:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000792744_202981376.pth [2023-12-28 00:56:41,547][106225] Updated weights for policy 1, policy_version 793897 (0.0006) [2023-12-28 00:56:41,612][106225] Updated weights for policy 1, policy_version 793907 (0.0009) [2023-12-28 00:56:41,682][106225] Updated weights for policy 1, policy_version 793917 (0.0008) [2023-12-28 00:56:41,748][106225] Updated weights for policy 1, policy_version 793927 (0.0008) [2023-12-28 00:56:41,991][106226] Updated weights for policy 0, policy_version 791761 (0.0009) [2023-12-28 00:56:42,063][106226] Updated weights for policy 0, policy_version 791771 (0.0009) [2023-12-28 00:56:42,132][106226] Updated weights for policy 0, policy_version 791781 (0.0007) [2023-12-28 00:56:42,560][106225] Updated weights for policy 1, policy_version 793937 (0.0008) [2023-12-28 00:56:42,615][106225] Updated weights for policy 1, policy_version 793947 (0.0008) [2023-12-28 00:56:42,674][106225] Updated weights for policy 1, policy_version 793957 (0.0008) [2023-12-28 00:56:42,830][106226] Updated weights for policy 0, policy_version 791791 (0.0009) [2023-12-28 00:56:42,895][106226] Updated weights for policy 0, policy_version 791801 (0.0009) [2023-12-28 00:56:42,963][106226] Updated weights for policy 0, policy_version 791811 (0.0009) [2023-12-28 00:56:43,408][106225] Updated weights for policy 1, policy_version 793967 (0.0009) [2023-12-28 00:56:43,453][106225] Updated weights for policy 1, policy_version 793977 (0.0008) [2023-12-28 00:56:43,506][106225] Updated weights for policy 1, policy_version 793987 (0.0008) [2023-12-28 00:56:43,706][106226] Updated weights for policy 0, policy_version 791821 (0.0009) [2023-12-28 00:56:43,769][106226] Updated weights for policy 0, policy_version 791831 (0.0009) [2023-12-28 00:56:43,832][106226] Updated weights for policy 0, policy_version 791841 (0.0005) [2023-12-28 00:56:44,180][106225] Updated weights for policy 1, policy_version 793997 (0.0008) [2023-12-28 00:56:44,236][106225] Updated weights for policy 1, policy_version 794007 (0.0008) [2023-12-28 00:56:44,292][106225] Updated weights for policy 1, policy_version 794017 (0.0008) [2023-12-28 00:56:44,512][106226] Updated weights for policy 0, policy_version 791851 (0.0009) [2023-12-28 00:56:44,570][106226] Updated weights for policy 0, policy_version 791861 (0.0008) [2023-12-28 00:56:44,623][106226] Updated weights for policy 0, policy_version 791871 (0.0009) [2023-12-28 00:56:45,018][106225] Updated weights for policy 1, policy_version 794027 (0.0007) [2023-12-28 00:56:45,081][106225] Updated weights for policy 1, policy_version 794037 (0.0005) [2023-12-28 00:56:45,144][106225] Updated weights for policy 1, policy_version 794047 (0.0005) [2023-12-28 00:56:45,427][106226] Updated weights for policy 0, policy_version 791881 (0.0008) [2023-12-28 00:56:45,480][106226] Updated weights for policy 0, policy_version 791891 (0.0005) [2023-12-28 00:56:45,546][106226] Updated weights for policy 0, policy_version 791901 (0.0005) [2023-12-28 00:56:45,617][106226] Updated weights for policy 0, policy_version 791911 (0.0006) [2023-12-28 00:56:45,837][106225] Updated weights for policy 1, policy_version 794057 (0.0006) [2023-12-28 00:56:45,899][106225] Updated weights for policy 1, policy_version 794067 (0.0009) [2023-12-28 00:56:45,966][106225] Updated weights for policy 1, policy_version 794077 (0.0009) [2023-12-28 00:56:46,022][106225] Updated weights for policy 1, policy_version 794087 (0.0009) [2023-12-28 00:56:46,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 406110208. Throughput: 0: 9754.8, 1: 9917.9. Samples: 406100512. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:46,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.916')] [2023-12-28 00:56:46,177][106226] Updated weights for policy 0, policy_version 791921 (0.0006) [2023-12-28 00:56:46,235][106226] Updated weights for policy 0, policy_version 791931 (0.0006) [2023-12-28 00:56:46,297][106226] Updated weights for policy 0, policy_version 791941 (0.0009) [2023-12-28 00:56:46,769][106225] Updated weights for policy 1, policy_version 794097 (0.0008) [2023-12-28 00:56:46,816][106225] Updated weights for policy 1, policy_version 794107 (0.0008) [2023-12-28 00:56:46,871][106225] Updated weights for policy 1, policy_version 794117 (0.0008) [2023-12-28 00:56:46,961][106226] Updated weights for policy 0, policy_version 791951 (0.0009) [2023-12-28 00:56:47,011][106226] Updated weights for policy 0, policy_version 791961 (0.0010) [2023-12-28 00:56:47,074][106226] Updated weights for policy 0, policy_version 791971 (0.0010) [2023-12-28 00:56:47,531][106225] Updated weights for policy 1, policy_version 794127 (0.0009) [2023-12-28 00:56:47,578][106225] Updated weights for policy 1, policy_version 794137 (0.0010) [2023-12-28 00:56:47,634][106225] Updated weights for policy 1, policy_version 794147 (0.0008) [2023-12-28 00:56:47,740][106226] Updated weights for policy 0, policy_version 791981 (0.0010) [2023-12-28 00:56:47,802][106226] Updated weights for policy 0, policy_version 791991 (0.0010) [2023-12-28 00:56:47,872][106226] Updated weights for policy 0, policy_version 792001 (0.0011) [2023-12-28 00:56:48,219][106225] Updated weights for policy 1, policy_version 794157 (0.0007) [2023-12-28 00:56:48,280][106225] Updated weights for policy 1, policy_version 794167 (0.0010) [2023-12-28 00:56:48,348][106225] Updated weights for policy 1, policy_version 794177 (0.0011) [2023-12-28 00:56:48,460][106226] Updated weights for policy 0, policy_version 792011 (0.0006) [2023-12-28 00:56:48,525][106226] Updated weights for policy 0, policy_version 792021 (0.0005) [2023-12-28 00:56:48,586][106226] Updated weights for policy 0, policy_version 792031 (0.0009) [2023-12-28 00:56:49,007][106225] Updated weights for policy 1, policy_version 794187 (0.0009) [2023-12-28 00:56:49,073][106225] Updated weights for policy 1, policy_version 794197 (0.0010) [2023-12-28 00:56:49,129][106225] Updated weights for policy 1, policy_version 794207 (0.0010) [2023-12-28 00:56:49,246][106226] Updated weights for policy 0, policy_version 792041 (0.0010) [2023-12-28 00:56:49,313][106226] Updated weights for policy 0, policy_version 792051 (0.0010) [2023-12-28 00:56:49,383][106226] Updated weights for policy 0, policy_version 792061 (0.0009) [2023-12-28 00:56:49,452][106226] Updated weights for policy 0, policy_version 792071 (0.0008) [2023-12-28 00:56:49,845][106225] Updated weights for policy 1, policy_version 794217 (0.0010) [2023-12-28 00:56:49,903][106225] Updated weights for policy 1, policy_version 794227 (0.0010) [2023-12-28 00:56:49,975][106225] Updated weights for policy 1, policy_version 794237 (0.0009) [2023-12-28 00:56:50,030][106225] Updated weights for policy 1, policy_version 794247 (0.0010) [2023-12-28 00:56:50,189][106226] Updated weights for policy 0, policy_version 792081 (0.0008) [2023-12-28 00:56:50,242][106226] Updated weights for policy 0, policy_version 792091 (0.0008) [2023-12-28 00:56:50,289][106226] Updated weights for policy 0, policy_version 792101 (0.0008) [2023-12-28 00:56:50,769][106225] Updated weights for policy 1, policy_version 794257 (0.0009) [2023-12-28 00:56:50,836][106225] Updated weights for policy 1, policy_version 794267 (0.0006) [2023-12-28 00:56:50,896][106225] Updated weights for policy 1, policy_version 794277 (0.0006) [2023-12-28 00:56:51,041][106226] Updated weights for policy 0, policy_version 792111 (0.0008) [2023-12-28 00:56:51,105][106226] Updated weights for policy 0, policy_version 792121 (0.0008) [2023-12-28 00:56:51,170][106226] Updated weights for policy 0, policy_version 792131 (0.0009) [2023-12-28 00:56:51,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 406208512. Throughput: 0: 9825.3, 1: 9877.4. Samples: 406221616. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:51,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-5.164')] [2023-12-28 00:56:51,561][106225] Updated weights for policy 1, policy_version 794287 (0.0008) [2023-12-28 00:56:51,624][106225] Updated weights for policy 1, policy_version 794297 (0.0006) [2023-12-28 00:56:51,687][106225] Updated weights for policy 1, policy_version 794307 (0.0008) [2023-12-28 00:56:51,965][106226] Updated weights for policy 0, policy_version 792141 (0.0008) [2023-12-28 00:56:52,024][106226] Updated weights for policy 0, policy_version 792151 (0.0009) [2023-12-28 00:56:52,081][106226] Updated weights for policy 0, policy_version 792161 (0.0008) [2023-12-28 00:56:52,400][106225] Updated weights for policy 1, policy_version 794317 (0.0008) [2023-12-28 00:56:52,456][106225] Updated weights for policy 1, policy_version 794327 (0.0007) [2023-12-28 00:56:52,518][106225] Updated weights for policy 1, policy_version 794337 (0.0006) [2023-12-28 00:56:52,863][106226] Updated weights for policy 0, policy_version 792171 (0.0009) [2023-12-28 00:56:52,925][106226] Updated weights for policy 0, policy_version 792181 (0.0008) [2023-12-28 00:56:52,986][106226] Updated weights for policy 0, policy_version 792191 (0.0009) [2023-12-28 00:56:53,176][106225] Updated weights for policy 1, policy_version 794347 (0.0008) [2023-12-28 00:56:53,236][106225] Updated weights for policy 1, policy_version 794357 (0.0007) [2023-12-28 00:56:53,296][106225] Updated weights for policy 1, policy_version 794367 (0.0010) [2023-12-28 00:56:53,677][106226] Updated weights for policy 0, policy_version 792201 (0.0010) [2023-12-28 00:56:53,732][106226] Updated weights for policy 0, policy_version 792211 (0.0005) [2023-12-28 00:56:53,786][106226] Updated weights for policy 0, policy_version 792221 (0.0005) [2023-12-28 00:56:53,838][106226] Updated weights for policy 0, policy_version 792231 (0.0009) [2023-12-28 00:56:54,010][106225] Updated weights for policy 1, policy_version 794377 (0.0010) [2023-12-28 00:56:54,070][106225] Updated weights for policy 1, policy_version 794387 (0.0005) [2023-12-28 00:56:54,132][106225] Updated weights for policy 1, policy_version 794397 (0.0005) [2023-12-28 00:56:54,194][106225] Updated weights for policy 1, policy_version 794407 (0.0007) [2023-12-28 00:56:54,493][106226] Updated weights for policy 0, policy_version 792241 (0.0011) [2023-12-28 00:56:54,544][106226] Updated weights for policy 0, policy_version 792251 (0.0010) [2023-12-28 00:56:54,598][106226] Updated weights for policy 0, policy_version 792261 (0.0011) [2023-12-28 00:56:54,834][106225] Updated weights for policy 1, policy_version 794417 (0.0005) [2023-12-28 00:56:54,885][106225] Updated weights for policy 1, policy_version 794427 (0.0005) [2023-12-28 00:56:54,946][106225] Updated weights for policy 1, policy_version 794437 (0.0005) [2023-12-28 00:56:55,309][106226] Updated weights for policy 0, policy_version 792271 (0.0009) [2023-12-28 00:56:55,357][106226] Updated weights for policy 0, policy_version 792281 (0.0008) [2023-12-28 00:56:55,414][106226] Updated weights for policy 0, policy_version 792291 (0.0006) [2023-12-28 00:56:55,554][106225] Updated weights for policy 1, policy_version 794447 (0.0005) [2023-12-28 00:56:55,616][106225] Updated weights for policy 1, policy_version 794457 (0.0005) [2023-12-28 00:56:55,678][106225] Updated weights for policy 1, policy_version 794467 (0.0008) [2023-12-28 00:56:56,001][106226] Updated weights for policy 0, policy_version 792301 (0.0008) [2023-12-28 00:56:56,060][106226] Updated weights for policy 0, policy_version 792311 (0.0010) [2023-12-28 00:56:56,120][106226] Updated weights for policy 0, policy_version 792321 (0.0011) [2023-12-28 00:56:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 406315008. Throughput: 0: 9802.9, 1: 9835.5. Samples: 406279576. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:56:56,175][105115] Avg episode reward: [(0, '-4.278'), (1, '-4.926')] [2023-12-28 00:56:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000792328_202891264.pth... [2023-12-28 00:56:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000794472_203423744.pth... [2023-12-28 00:56:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000791144_202588160.pth [2023-12-28 00:56:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000793320_203128832.pth [2023-12-28 00:56:56,402][106225] Updated weights for policy 1, policy_version 794477 (0.0009) [2023-12-28 00:56:56,458][106225] Updated weights for policy 1, policy_version 794487 (0.0006) [2023-12-28 00:56:56,516][106225] Updated weights for policy 1, policy_version 794497 (0.0007) [2023-12-28 00:56:56,748][106226] Updated weights for policy 0, policy_version 792331 (0.0009) [2023-12-28 00:56:56,793][106226] Updated weights for policy 0, policy_version 792341 (0.0005) [2023-12-28 00:56:56,850][106226] Updated weights for policy 0, policy_version 792351 (0.0009) [2023-12-28 00:56:57,265][106225] Updated weights for policy 1, policy_version 794507 (0.0008) [2023-12-28 00:56:57,320][106225] Updated weights for policy 1, policy_version 794517 (0.0007) [2023-12-28 00:56:57,387][106225] Updated weights for policy 1, policy_version 794527 (0.0008) [2023-12-28 00:56:57,502][106226] Updated weights for policy 0, policy_version 792361 (0.0010) [2023-12-28 00:56:57,558][106226] Updated weights for policy 0, policy_version 792371 (0.0005) [2023-12-28 00:56:57,614][106226] Updated weights for policy 0, policy_version 792381 (0.0005) [2023-12-28 00:56:57,675][106226] Updated weights for policy 0, policy_version 792391 (0.0005) [2023-12-28 00:56:58,078][106225] Updated weights for policy 1, policy_version 794537 (0.0008) [2023-12-28 00:56:58,128][106225] Updated weights for policy 1, policy_version 794547 (0.0009) [2023-12-28 00:56:58,190][106225] Updated weights for policy 1, policy_version 794558 (0.0010) [2023-12-28 00:56:58,244][106226] Updated weights for policy 0, policy_version 792401 (0.0006) [2023-12-28 00:56:58,257][106225] Updated weights for policy 1, policy_version 794568 (0.0008) [2023-12-28 00:56:58,306][106226] Updated weights for policy 0, policy_version 792411 (0.0008) [2023-12-28 00:56:58,371][106226] Updated weights for policy 0, policy_version 792421 (0.0009) [2023-12-28 00:56:59,136][106225] Updated weights for policy 1, policy_version 794578 (0.0010) [2023-12-28 00:56:59,168][106226] Updated weights for policy 0, policy_version 792431 (0.0010) [2023-12-28 00:56:59,199][106225] Updated weights for policy 1, policy_version 794588 (0.0009) [2023-12-28 00:56:59,234][106226] Updated weights for policy 0, policy_version 792441 (0.0010) [2023-12-28 00:56:59,269][106225] Updated weights for policy 1, policy_version 794598 (0.0010) [2023-12-28 00:56:59,298][106226] Updated weights for policy 0, policy_version 792451 (0.0007) [2023-12-28 00:56:59,949][106226] Updated weights for policy 0, policy_version 792461 (0.0008) [2023-12-28 00:57:00,001][106225] Updated weights for policy 1, policy_version 794608 (0.0007) [2023-12-28 00:57:00,017][106226] Updated weights for policy 0, policy_version 792471 (0.0007) [2023-12-28 00:57:00,059][106225] Updated weights for policy 1, policy_version 794618 (0.0010) [2023-12-28 00:57:00,079][106226] Updated weights for policy 0, policy_version 792481 (0.0005) [2023-12-28 00:57:00,113][106225] Updated weights for policy 1, policy_version 794628 (0.0008) [2023-12-28 00:57:00,649][106226] Updated weights for policy 0, policy_version 792491 (0.0005) [2023-12-28 00:57:00,705][106226] Updated weights for policy 0, policy_version 792501 (0.0005) [2023-12-28 00:57:00,757][106225] Updated weights for policy 1, policy_version 794638 (0.0008) [2023-12-28 00:57:00,770][106226] Updated weights for policy 0, policy_version 792511 (0.0005) [2023-12-28 00:57:00,807][106225] Updated weights for policy 1, policy_version 794648 (0.0010) [2023-12-28 00:57:00,853][106225] Updated weights for policy 1, policy_version 794658 (0.0010) [2023-12-28 00:57:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 406413312. Throughput: 0: 9967.8, 1: 9791.1. Samples: 406400056. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:01,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-5.193')] [2023-12-28 00:57:01,402][106226] Updated weights for policy 0, policy_version 792521 (0.0005) [2023-12-28 00:57:01,457][106226] Updated weights for policy 0, policy_version 792531 (0.0005) [2023-12-28 00:57:01,515][106226] Updated weights for policy 0, policy_version 792541 (0.0006) [2023-12-28 00:57:01,556][106225] Updated weights for policy 1, policy_version 794668 (0.0008) [2023-12-28 00:57:01,582][106226] Updated weights for policy 0, policy_version 792551 (0.0007) [2023-12-28 00:57:01,615][106225] Updated weights for policy 1, policy_version 794678 (0.0006) [2023-12-28 00:57:01,674][106225] Updated weights for policy 1, policy_version 794688 (0.0008) [2023-12-28 00:57:02,148][106226] Updated weights for policy 0, policy_version 792561 (0.0009) [2023-12-28 00:57:02,212][106226] Updated weights for policy 0, policy_version 792571 (0.0008) [2023-12-28 00:57:02,267][106226] Updated weights for policy 0, policy_version 792581 (0.0008) [2023-12-28 00:57:02,366][106225] Updated weights for policy 1, policy_version 794698 (0.0009) [2023-12-28 00:57:02,423][106225] Updated weights for policy 1, policy_version 794708 (0.0007) [2023-12-28 00:57:02,494][106225] Updated weights for policy 1, policy_version 794718 (0.0010) [2023-12-28 00:57:02,555][106225] Updated weights for policy 1, policy_version 794728 (0.0009) [2023-12-28 00:57:02,961][106226] Updated weights for policy 0, policy_version 792591 (0.0008) [2023-12-28 00:57:03,016][106226] Updated weights for policy 0, policy_version 792601 (0.0007) [2023-12-28 00:57:03,073][106226] Updated weights for policy 0, policy_version 792611 (0.0008) [2023-12-28 00:57:03,246][106225] Updated weights for policy 1, policy_version 794738 (0.0005) [2023-12-28 00:57:03,302][106225] Updated weights for policy 1, policy_version 794748 (0.0005) [2023-12-28 00:57:03,356][106225] Updated weights for policy 1, policy_version 794758 (0.0008) [2023-12-28 00:57:03,855][106226] Updated weights for policy 0, policy_version 792621 (0.0008) [2023-12-28 00:57:03,925][106226] Updated weights for policy 0, policy_version 792631 (0.0010) [2023-12-28 00:57:03,986][106226] Updated weights for policy 0, policy_version 792641 (0.0007) [2023-12-28 00:57:04,028][106225] Updated weights for policy 1, policy_version 794768 (0.0009) [2023-12-28 00:57:04,083][106225] Updated weights for policy 1, policy_version 794778 (0.0006) [2023-12-28 00:57:04,147][106225] Updated weights for policy 1, policy_version 794788 (0.0006) [2023-12-28 00:57:04,742][106226] Updated weights for policy 0, policy_version 792651 (0.0007) [2023-12-28 00:57:04,769][106225] Updated weights for policy 1, policy_version 794798 (0.0005) [2023-12-28 00:57:04,799][106226] Updated weights for policy 0, policy_version 792661 (0.0008) [2023-12-28 00:57:04,829][106225] Updated weights for policy 1, policy_version 794808 (0.0006) [2023-12-28 00:57:04,859][106226] Updated weights for policy 0, policy_version 792671 (0.0009) [2023-12-28 00:57:04,890][106225] Updated weights for policy 1, policy_version 794818 (0.0005) [2023-12-28 00:57:05,532][106225] Updated weights for policy 1, policy_version 794828 (0.0007) [2023-12-28 00:57:05,586][106225] Updated weights for policy 1, policy_version 794838 (0.0010) [2023-12-28 00:57:05,611][106226] Updated weights for policy 0, policy_version 792681 (0.0008) [2023-12-28 00:57:05,643][106225] Updated weights for policy 1, policy_version 794848 (0.0010) [2023-12-28 00:57:05,657][106226] Updated weights for policy 0, policy_version 792691 (0.0006) [2023-12-28 00:57:05,714][106226] Updated weights for policy 0, policy_version 792701 (0.0006) [2023-12-28 00:57:05,772][106226] Updated weights for policy 0, policy_version 792711 (0.0008) [2023-12-28 00:57:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 406511616. Throughput: 0: 10018.8, 1: 9841.5. Samples: 406521432. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:06,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-5.317')] [2023-12-28 00:57:06,370][106225] Updated weights for policy 1, policy_version 794858 (0.0010) [2023-12-28 00:57:06,428][106225] Updated weights for policy 1, policy_version 794868 (0.0010) [2023-12-28 00:57:06,486][106225] Updated weights for policy 1, policy_version 794878 (0.0010) [2023-12-28 00:57:06,515][106226] Updated weights for policy 0, policy_version 792721 (0.0006) [2023-12-28 00:57:06,544][106225] Updated weights for policy 1, policy_version 794888 (0.0010) [2023-12-28 00:57:06,579][106226] Updated weights for policy 0, policy_version 792731 (0.0007) [2023-12-28 00:57:06,629][106226] Updated weights for policy 0, policy_version 792741 (0.0008) [2023-12-28 00:57:07,241][106225] Updated weights for policy 1, policy_version 794898 (0.0010) [2023-12-28 00:57:07,289][106225] Updated weights for policy 1, policy_version 794908 (0.0010) [2023-12-28 00:57:07,335][106225] Updated weights for policy 1, policy_version 794918 (0.0010) [2023-12-28 00:57:07,397][106226] Updated weights for policy 0, policy_version 792751 (0.0008) [2023-12-28 00:57:07,454][106226] Updated weights for policy 0, policy_version 792761 (0.0007) [2023-12-28 00:57:07,506][106226] Updated weights for policy 0, policy_version 792771 (0.0007) [2023-12-28 00:57:08,092][106225] Updated weights for policy 1, policy_version 794928 (0.0011) [2023-12-28 00:57:08,157][106225] Updated weights for policy 1, policy_version 794938 (0.0010) [2023-12-28 00:57:08,214][106225] Updated weights for policy 1, policy_version 794948 (0.0010) [2023-12-28 00:57:08,259][106226] Updated weights for policy 0, policy_version 792781 (0.0007) [2023-12-28 00:57:08,324][106226] Updated weights for policy 0, policy_version 792791 (0.0008) [2023-12-28 00:57:08,383][106226] Updated weights for policy 0, policy_version 792801 (0.0009) [2023-12-28 00:57:08,927][106225] Updated weights for policy 1, policy_version 794958 (0.0010) [2023-12-28 00:57:08,974][106225] Updated weights for policy 1, policy_version 794968 (0.0010) [2023-12-28 00:57:09,026][106225] Updated weights for policy 1, policy_version 794978 (0.0009) [2023-12-28 00:57:09,155][106226] Updated weights for policy 0, policy_version 792811 (0.0009) [2023-12-28 00:57:09,200][106226] Updated weights for policy 0, policy_version 792821 (0.0008) [2023-12-28 00:57:09,268][106226] Updated weights for policy 0, policy_version 792831 (0.0008) [2023-12-28 00:57:09,785][106225] Updated weights for policy 1, policy_version 794988 (0.0007) [2023-12-28 00:57:09,855][106225] Updated weights for policy 1, policy_version 794998 (0.0009) [2023-12-28 00:57:09,923][106225] Updated weights for policy 1, policy_version 795008 (0.0008) [2023-12-28 00:57:10,032][106226] Updated weights for policy 0, policy_version 792841 (0.0008) [2023-12-28 00:57:10,088][106226] Updated weights for policy 0, policy_version 792851 (0.0009) [2023-12-28 00:57:10,151][106226] Updated weights for policy 0, policy_version 792861 (0.0008) [2023-12-28 00:57:10,211][106226] Updated weights for policy 0, policy_version 792871 (0.0008) [2023-12-28 00:57:10,637][106225] Updated weights for policy 1, policy_version 795018 (0.0010) [2023-12-28 00:57:10,698][106225] Updated weights for policy 1, policy_version 795028 (0.0010) [2023-12-28 00:57:10,756][106225] Updated weights for policy 1, policy_version 795038 (0.0010) [2023-12-28 00:57:10,800][106225] Updated weights for policy 1, policy_version 795048 (0.0010) [2023-12-28 00:57:10,870][106226] Updated weights for policy 0, policy_version 792881 (0.0008) [2023-12-28 00:57:10,927][106226] Updated weights for policy 0, policy_version 792891 (0.0008) [2023-12-28 00:57:10,974][106226] Updated weights for policy 0, policy_version 792901 (0.0007) [2023-12-28 00:57:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 406609920. Throughput: 0: 9987.6, 1: 9831.0. Samples: 406578484. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:11,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.821')] [2023-12-28 00:57:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000795048_203571200.pth... [2023-12-28 00:57:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000792904_203038720.pth... [2023-12-28 00:57:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000793896_203276288.pth [2023-12-28 00:57:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000791752_202743808.pth [2023-12-28 00:57:11,663][106226] Updated weights for policy 0, policy_version 792911 (0.0009) [2023-12-28 00:57:11,693][106225] Updated weights for policy 1, policy_version 795058 (0.0007) [2023-12-28 00:57:11,733][106226] Updated weights for policy 0, policy_version 792921 (0.0007) [2023-12-28 00:57:11,763][106225] Updated weights for policy 1, policy_version 795068 (0.0008) [2023-12-28 00:57:11,796][106226] Updated weights for policy 0, policy_version 792931 (0.0009) [2023-12-28 00:57:11,822][106225] Updated weights for policy 1, policy_version 795078 (0.0007) [2023-12-28 00:57:12,478][106226] Updated weights for policy 0, policy_version 792941 (0.0008) [2023-12-28 00:57:12,537][106226] Updated weights for policy 0, policy_version 792951 (0.0009) [2023-12-28 00:57:12,585][106225] Updated weights for policy 1, policy_version 795088 (0.0006) [2023-12-28 00:57:12,608][106226] Updated weights for policy 0, policy_version 792961 (0.0009) [2023-12-28 00:57:12,650][106225] Updated weights for policy 1, policy_version 795098 (0.0006) [2023-12-28 00:57:12,710][106225] Updated weights for policy 1, policy_version 795108 (0.0008) [2023-12-28 00:57:13,303][106225] Updated weights for policy 1, policy_version 795118 (0.0008) [2023-12-28 00:57:13,346][106225] Updated weights for policy 1, policy_version 795128 (0.0008) [2023-12-28 00:57:13,377][106226] Updated weights for policy 0, policy_version 792971 (0.0008) [2023-12-28 00:57:13,394][106225] Updated weights for policy 1, policy_version 795138 (0.0006) [2023-12-28 00:57:13,434][106226] Updated weights for policy 0, policy_version 792981 (0.0011) [2023-12-28 00:57:13,494][106226] Updated weights for policy 0, policy_version 792991 (0.0010) [2023-12-28 00:57:14,067][106225] Updated weights for policy 1, policy_version 795148 (0.0005) [2023-12-28 00:57:14,128][106225] Updated weights for policy 1, policy_version 795158 (0.0006) [2023-12-28 00:57:14,137][106226] Updated weights for policy 0, policy_version 793001 (0.0010) [2023-12-28 00:57:14,191][106225] Updated weights for policy 1, policy_version 795168 (0.0006) [2023-12-28 00:57:14,195][106226] Updated weights for policy 0, policy_version 793011 (0.0010) [2023-12-28 00:57:14,245][106226] Updated weights for policy 0, policy_version 793021 (0.0010) [2023-12-28 00:57:14,298][106226] Updated weights for policy 0, policy_version 793031 (0.0010) [2023-12-28 00:57:14,776][106225] Updated weights for policy 1, policy_version 795179 (0.0009) [2023-12-28 00:57:14,848][106225] Updated weights for policy 1, policy_version 795189 (0.0009) [2023-12-28 00:57:14,911][106225] Updated weights for policy 1, policy_version 795199 (0.0006) [2023-12-28 00:57:15,073][106226] Updated weights for policy 0, policy_version 793041 (0.0008) [2023-12-28 00:57:15,137][106226] Updated weights for policy 0, policy_version 793051 (0.0008) [2023-12-28 00:57:15,196][106226] Updated weights for policy 0, policy_version 793061 (0.0008) [2023-12-28 00:57:15,592][106225] Updated weights for policy 1, policy_version 795209 (0.0006) [2023-12-28 00:57:15,653][106225] Updated weights for policy 1, policy_version 795219 (0.0011) [2023-12-28 00:57:15,714][106225] Updated weights for policy 1, policy_version 795229 (0.0010) [2023-12-28 00:57:15,776][106225] Updated weights for policy 1, policy_version 795239 (0.0011) [2023-12-28 00:57:15,814][106226] Updated weights for policy 0, policy_version 793071 (0.0009) [2023-12-28 00:57:15,861][106226] Updated weights for policy 0, policy_version 793081 (0.0010) [2023-12-28 00:57:15,904][106226] Updated weights for policy 0, policy_version 793091 (0.0010) [2023-12-28 00:57:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 406708224. Throughput: 0: 9861.7, 1: 9812.8. Samples: 406695840. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:16,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.942')] [2023-12-28 00:57:16,487][106225] Updated weights for policy 1, policy_version 795249 (0.0010) [2023-12-28 00:57:16,534][106225] Updated weights for policy 1, policy_version 795259 (0.0007) [2023-12-28 00:57:16,579][106225] Updated weights for policy 1, policy_version 795269 (0.0005) [2023-12-28 00:57:16,631][106226] Updated weights for policy 0, policy_version 793101 (0.0010) [2023-12-28 00:57:16,679][106226] Updated weights for policy 0, policy_version 793111 (0.0009) [2023-12-28 00:57:16,742][106226] Updated weights for policy 0, policy_version 793121 (0.0011) [2023-12-28 00:57:17,229][106225] Updated weights for policy 1, policy_version 795279 (0.0007) [2023-12-28 00:57:17,290][106225] Updated weights for policy 1, policy_version 795289 (0.0008) [2023-12-28 00:57:17,349][106225] Updated weights for policy 1, policy_version 795299 (0.0008) [2023-12-28 00:57:17,445][106226] Updated weights for policy 0, policy_version 793131 (0.0009) [2023-12-28 00:57:17,510][106226] Updated weights for policy 0, policy_version 793141 (0.0006) [2023-12-28 00:57:17,565][106226] Updated weights for policy 0, policy_version 793151 (0.0007) [2023-12-28 00:57:18,107][106226] Updated weights for policy 0, policy_version 793161 (0.0006) [2023-12-28 00:57:18,129][106225] Updated weights for policy 1, policy_version 795309 (0.0007) [2023-12-28 00:57:18,162][106226] Updated weights for policy 0, policy_version 793171 (0.0010) [2023-12-28 00:57:18,179][106225] Updated weights for policy 1, policy_version 795319 (0.0005) [2023-12-28 00:57:18,215][106226] Updated weights for policy 0, policy_version 793181 (0.0010) [2023-12-28 00:57:18,232][106225] Updated weights for policy 1, policy_version 795329 (0.0005) [2023-12-28 00:57:18,278][106226] Updated weights for policy 0, policy_version 793191 (0.0011) [2023-12-28 00:57:18,979][106225] Updated weights for policy 1, policy_version 795339 (0.0006) [2023-12-28 00:57:19,034][106226] Updated weights for policy 0, policy_version 793201 (0.0006) [2023-12-28 00:57:19,036][106225] Updated weights for policy 1, policy_version 795349 (0.0009) [2023-12-28 00:57:19,085][106226] Updated weights for policy 0, policy_version 793211 (0.0011) [2023-12-28 00:57:19,095][106225] Updated weights for policy 1, policy_version 795359 (0.0006) [2023-12-28 00:57:19,137][106226] Updated weights for policy 0, policy_version 793221 (0.0010) [2023-12-28 00:57:19,873][106225] Updated weights for policy 1, policy_version 795369 (0.0007) [2023-12-28 00:57:19,923][106226] Updated weights for policy 0, policy_version 793231 (0.0010) [2023-12-28 00:57:19,939][106225] Updated weights for policy 1, policy_version 795379 (0.0007) [2023-12-28 00:57:19,986][106226] Updated weights for policy 0, policy_version 793241 (0.0009) [2023-12-28 00:57:20,000][106225] Updated weights for policy 1, policy_version 795389 (0.0007) [2023-12-28 00:57:20,049][106226] Updated weights for policy 0, policy_version 793251 (0.0010) [2023-12-28 00:57:20,060][106225] Updated weights for policy 1, policy_version 795399 (0.0006) [2023-12-28 00:57:20,828][106225] Updated weights for policy 1, policy_version 795409 (0.0007) [2023-12-28 00:57:20,833][106226] Updated weights for policy 0, policy_version 793261 (0.0010) [2023-12-28 00:57:20,880][106225] Updated weights for policy 1, policy_version 795419 (0.0007) [2023-12-28 00:57:20,893][106226] Updated weights for policy 0, policy_version 793271 (0.0008) [2023-12-28 00:57:20,939][106225] Updated weights for policy 1, policy_version 795429 (0.0007) [2023-12-28 00:57:20,955][106226] Updated weights for policy 0, policy_version 793281 (0.0007) [2023-12-28 00:57:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 406806528. Throughput: 0: 9843.4, 1: 9813.8. Samples: 406812320. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:21,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.960')] [2023-12-28 00:57:21,628][106225] Updated weights for policy 1, policy_version 795439 (0.0008) [2023-12-28 00:57:21,697][106225] Updated weights for policy 1, policy_version 795449 (0.0008) [2023-12-28 00:57:21,767][106225] Updated weights for policy 1, policy_version 795459 (0.0008) [2023-12-28 00:57:21,773][106226] Updated weights for policy 0, policy_version 793291 (0.0008) [2023-12-28 00:57:21,842][106226] Updated weights for policy 0, policy_version 793301 (0.0007) [2023-12-28 00:57:21,905][106226] Updated weights for policy 0, policy_version 793311 (0.0007) [2023-12-28 00:57:22,532][106225] Updated weights for policy 1, policy_version 795469 (0.0008) [2023-12-28 00:57:22,561][106226] Updated weights for policy 0, policy_version 793321 (0.0006) [2023-12-28 00:57:22,595][106225] Updated weights for policy 1, policy_version 795479 (0.0008) [2023-12-28 00:57:22,625][106226] Updated weights for policy 0, policy_version 793331 (0.0007) [2023-12-28 00:57:22,655][106225] Updated weights for policy 1, policy_version 795489 (0.0008) [2023-12-28 00:57:22,683][106226] Updated weights for policy 0, policy_version 793341 (0.0006) [2023-12-28 00:57:22,748][106226] Updated weights for policy 0, policy_version 793351 (0.0007) [2023-12-28 00:57:23,351][106225] Updated weights for policy 1, policy_version 795499 (0.0008) [2023-12-28 00:57:23,411][106225] Updated weights for policy 1, policy_version 795509 (0.0010) [2023-12-28 00:57:23,420][106226] Updated weights for policy 0, policy_version 793361 (0.0007) [2023-12-28 00:57:23,472][106225] Updated weights for policy 1, policy_version 795519 (0.0010) [2023-12-28 00:57:23,482][106226] Updated weights for policy 0, policy_version 793371 (0.0006) [2023-12-28 00:57:23,543][106226] Updated weights for policy 0, policy_version 793381 (0.0006) [2023-12-28 00:57:24,087][106225] Updated weights for policy 1, policy_version 795529 (0.0010) [2023-12-28 00:57:24,141][106225] Updated weights for policy 1, policy_version 795539 (0.0008) [2023-12-28 00:57:24,193][106225] Updated weights for policy 1, policy_version 795549 (0.0008) [2023-12-28 00:57:24,237][106225] Updated weights for policy 1, policy_version 795559 (0.0008) [2023-12-28 00:57:24,272][106226] Updated weights for policy 0, policy_version 793391 (0.0007) [2023-12-28 00:57:24,333][106226] Updated weights for policy 0, policy_version 793401 (0.0008) [2023-12-28 00:57:24,394][106226] Updated weights for policy 0, policy_version 793411 (0.0009) [2023-12-28 00:57:24,905][106225] Updated weights for policy 1, policy_version 795569 (0.0008) [2023-12-28 00:57:24,971][106225] Updated weights for policy 1, policy_version 795579 (0.0009) [2023-12-28 00:57:25,023][106225] Updated weights for policy 1, policy_version 795589 (0.0010) [2023-12-28 00:57:25,127][106226] Updated weights for policy 0, policy_version 793421 (0.0010) [2023-12-28 00:57:25,177][106226] Updated weights for policy 0, policy_version 793431 (0.0009) [2023-12-28 00:57:25,238][106226] Updated weights for policy 0, policy_version 793441 (0.0005) [2023-12-28 00:57:25,589][106225] Updated weights for policy 1, policy_version 795599 (0.0007) [2023-12-28 00:57:25,650][106225] Updated weights for policy 1, policy_version 795609 (0.0005) [2023-12-28 00:57:25,710][106225] Updated weights for policy 1, policy_version 795619 (0.0006) [2023-12-28 00:57:26,026][106226] Updated weights for policy 0, policy_version 793451 (0.0006) [2023-12-28 00:57:26,068][106226] Updated weights for policy 0, policy_version 793461 (0.0007) [2023-12-28 00:57:26,114][106226] Updated weights for policy 0, policy_version 793471 (0.0008) [2023-12-28 00:57:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 406904832. Throughput: 0: 9807.4, 1: 9812.0. Samples: 406869932. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:26,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.932')] [2023-12-28 00:57:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000795624_203718656.pth... [2023-12-28 00:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000793480_203186176.pth... [2023-12-28 00:57:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000794472_203423744.pth [2023-12-28 00:57:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000792328_202891264.pth [2023-12-28 00:57:26,272][106225] Updated weights for policy 1, policy_version 795629 (0.0006) [2023-12-28 00:57:26,336][106225] Updated weights for policy 1, policy_version 795639 (0.0005) [2023-12-28 00:57:26,382][106225] Updated weights for policy 1, policy_version 795649 (0.0005) [2023-12-28 00:57:26,888][106225] Updated weights for policy 1, policy_version 795659 (0.0005) [2023-12-28 00:57:26,946][106225] Updated weights for policy 1, policy_version 795669 (0.0005) [2023-12-28 00:57:26,963][106226] Updated weights for policy 0, policy_version 793481 (0.0008) [2023-12-28 00:57:26,995][106225] Updated weights for policy 1, policy_version 795679 (0.0005) [2023-12-28 00:57:27,015][106226] Updated weights for policy 0, policy_version 793491 (0.0008) [2023-12-28 00:57:27,064][106226] Updated weights for policy 0, policy_version 793501 (0.0008) [2023-12-28 00:57:27,116][106226] Updated weights for policy 0, policy_version 793511 (0.0008) [2023-12-28 00:57:27,616][106225] Updated weights for policy 1, policy_version 795689 (0.0006) [2023-12-28 00:57:27,673][106225] Updated weights for policy 1, policy_version 795699 (0.0010) [2023-12-28 00:57:27,732][106225] Updated weights for policy 1, policy_version 795709 (0.0010) [2023-12-28 00:57:27,785][106225] Updated weights for policy 1, policy_version 795719 (0.0010) [2023-12-28 00:57:27,853][106226] Updated weights for policy 0, policy_version 793521 (0.0008) [2023-12-28 00:57:27,917][106226] Updated weights for policy 0, policy_version 793531 (0.0008) [2023-12-28 00:57:27,981][106226] Updated weights for policy 0, policy_version 793541 (0.0008) [2023-12-28 00:57:28,497][106225] Updated weights for policy 1, policy_version 795729 (0.0006) [2023-12-28 00:57:28,559][106225] Updated weights for policy 1, policy_version 795739 (0.0006) [2023-12-28 00:57:28,613][106225] Updated weights for policy 1, policy_version 795749 (0.0008) [2023-12-28 00:57:28,706][106226] Updated weights for policy 0, policy_version 793551 (0.0009) [2023-12-28 00:57:28,760][106226] Updated weights for policy 0, policy_version 793561 (0.0009) [2023-12-28 00:57:28,828][106226] Updated weights for policy 0, policy_version 793571 (0.0008) [2023-12-28 00:57:29,222][106225] Updated weights for policy 1, policy_version 795759 (0.0009) [2023-12-28 00:57:29,285][106225] Updated weights for policy 1, policy_version 795769 (0.0010) [2023-12-28 00:57:29,345][106225] Updated weights for policy 1, policy_version 795779 (0.0010) [2023-12-28 00:57:29,549][106226] Updated weights for policy 0, policy_version 793581 (0.0006) [2023-12-28 00:57:29,618][106226] Updated weights for policy 0, policy_version 793591 (0.0006) [2023-12-28 00:57:29,683][106226] Updated weights for policy 0, policy_version 793601 (0.0007) [2023-12-28 00:57:30,092][106225] Updated weights for policy 1, policy_version 795789 (0.0007) [2023-12-28 00:57:30,147][106225] Updated weights for policy 1, policy_version 795799 (0.0007) [2023-12-28 00:57:30,193][106225] Updated weights for policy 1, policy_version 795809 (0.0005) [2023-12-28 00:57:30,387][106226] Updated weights for policy 0, policy_version 793611 (0.0008) [2023-12-28 00:57:30,445][106226] Updated weights for policy 0, policy_version 793621 (0.0006) [2023-12-28 00:57:30,496][106226] Updated weights for policy 0, policy_version 793631 (0.0008) [2023-12-28 00:57:30,842][106225] Updated weights for policy 1, policy_version 795819 (0.0005) [2023-12-28 00:57:30,905][106225] Updated weights for policy 1, policy_version 795829 (0.0008) [2023-12-28 00:57:30,955][106225] Updated weights for policy 1, policy_version 795839 (0.0010) [2023-12-28 00:57:31,027][106226] Updated weights for policy 0, policy_version 793641 (0.0006) [2023-12-28 00:57:31,093][106226] Updated weights for policy 0, policy_version 793651 (0.0007) [2023-12-28 00:57:31,159][106226] Updated weights for policy 0, policy_version 793661 (0.0008) [2023-12-28 00:57:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 407003136. Throughput: 0: 9821.9, 1: 9996.3. Samples: 406992332. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:31,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.743')] [2023-12-28 00:57:31,217][106226] Updated weights for policy 0, policy_version 793671 (0.0009) [2023-12-28 00:57:31,706][106225] Updated weights for policy 1, policy_version 795849 (0.0010) [2023-12-28 00:57:31,774][106225] Updated weights for policy 1, policy_version 795859 (0.0008) [2023-12-28 00:57:31,820][106225] Updated weights for policy 1, policy_version 795869 (0.0010) [2023-12-28 00:57:31,870][106225] Updated weights for policy 1, policy_version 795879 (0.0010) [2023-12-28 00:57:31,983][106226] Updated weights for policy 0, policy_version 793681 (0.0009) [2023-12-28 00:57:32,041][106226] Updated weights for policy 0, policy_version 793691 (0.0009) [2023-12-28 00:57:32,091][106226] Updated weights for policy 0, policy_version 793701 (0.0010) [2023-12-28 00:57:32,505][106225] Updated weights for policy 1, policy_version 795889 (0.0008) [2023-12-28 00:57:32,569][106225] Updated weights for policy 1, policy_version 795899 (0.0008) [2023-12-28 00:57:32,630][106225] Updated weights for policy 1, policy_version 795909 (0.0008) [2023-12-28 00:57:32,838][106226] Updated weights for policy 0, policy_version 793711 (0.0010) [2023-12-28 00:57:32,888][106226] Updated weights for policy 0, policy_version 793721 (0.0010) [2023-12-28 00:57:32,943][106226] Updated weights for policy 0, policy_version 793731 (0.0010) [2023-12-28 00:57:33,297][106225] Updated weights for policy 1, policy_version 795919 (0.0006) [2023-12-28 00:57:33,343][106225] Updated weights for policy 1, policy_version 795929 (0.0005) [2023-12-28 00:57:33,388][106225] Updated weights for policy 1, policy_version 795939 (0.0005) [2023-12-28 00:57:33,632][106226] Updated weights for policy 0, policy_version 793741 (0.0008) [2023-12-28 00:57:33,683][106226] Updated weights for policy 0, policy_version 793751 (0.0005) [2023-12-28 00:57:33,733][106226] Updated weights for policy 0, policy_version 793761 (0.0005) [2023-12-28 00:57:34,002][106225] Updated weights for policy 1, policy_version 795949 (0.0008) [2023-12-28 00:57:34,054][106225] Updated weights for policy 1, policy_version 795959 (0.0010) [2023-12-28 00:57:34,102][106225] Updated weights for policy 1, policy_version 795969 (0.0010) [2023-12-28 00:57:34,328][106226] Updated weights for policy 0, policy_version 793771 (0.0007) [2023-12-28 00:57:34,391][106226] Updated weights for policy 0, policy_version 793781 (0.0008) [2023-12-28 00:57:34,458][106226] Updated weights for policy 0, policy_version 793791 (0.0011) [2023-12-28 00:57:34,813][106225] Updated weights for policy 1, policy_version 795979 (0.0010) [2023-12-28 00:57:34,860][106225] Updated weights for policy 1, policy_version 795989 (0.0010) [2023-12-28 00:57:34,918][106225] Updated weights for policy 1, policy_version 795999 (0.0009) [2023-12-28 00:57:35,195][106226] Updated weights for policy 0, policy_version 793801 (0.0011) [2023-12-28 00:57:35,247][106226] Updated weights for policy 0, policy_version 793811 (0.0007) [2023-12-28 00:57:35,309][106226] Updated weights for policy 0, policy_version 793821 (0.0006) [2023-12-28 00:57:35,359][106226] Updated weights for policy 0, policy_version 793831 (0.0007) [2023-12-28 00:57:35,553][106225] Updated weights for policy 1, policy_version 796009 (0.0010) [2023-12-28 00:57:35,609][106225] Updated weights for policy 1, policy_version 796019 (0.0005) [2023-12-28 00:57:35,676][106225] Updated weights for policy 1, policy_version 796029 (0.0010) [2023-12-28 00:57:35,737][106225] Updated weights for policy 1, policy_version 796039 (0.0007) [2023-12-28 00:57:36,042][106226] Updated weights for policy 0, policy_version 793841 (0.0007) [2023-12-28 00:57:36,093][106226] Updated weights for policy 0, policy_version 793851 (0.0008) [2023-12-28 00:57:36,153][106226] Updated weights for policy 0, policy_version 793861 (0.0008) [2023-12-28 00:57:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 407109632. Throughput: 0: 9819.7, 1: 10058.3. Samples: 407116124. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:36,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.777')] [2023-12-28 00:57:36,328][106225] Updated weights for policy 1, policy_version 796049 (0.0010) [2023-12-28 00:57:36,386][106225] Updated weights for policy 1, policy_version 796059 (0.0010) [2023-12-28 00:57:36,448][106225] Updated weights for policy 1, policy_version 796069 (0.0010) [2023-12-28 00:57:36,938][106226] Updated weights for policy 0, policy_version 793871 (0.0008) [2023-12-28 00:57:36,998][106226] Updated weights for policy 0, policy_version 793881 (0.0007) [2023-12-28 00:57:37,052][106226] Updated weights for policy 0, policy_version 793891 (0.0008) [2023-12-28 00:57:37,183][106225] Updated weights for policy 1, policy_version 796079 (0.0007) [2023-12-28 00:57:37,241][106225] Updated weights for policy 1, policy_version 796089 (0.0006) [2023-12-28 00:57:37,301][106225] Updated weights for policy 1, policy_version 796099 (0.0005) [2023-12-28 00:57:37,859][106226] Updated weights for policy 0, policy_version 793901 (0.0007) [2023-12-28 00:57:37,865][106225] Updated weights for policy 1, policy_version 796109 (0.0008) [2023-12-28 00:57:37,908][106226] Updated weights for policy 0, policy_version 793911 (0.0007) [2023-12-28 00:57:37,925][106225] Updated weights for policy 1, policy_version 796119 (0.0007) [2023-12-28 00:57:37,958][106226] Updated weights for policy 0, policy_version 793921 (0.0006) [2023-12-28 00:57:37,983][106225] Updated weights for policy 1, policy_version 796129 (0.0008) [2023-12-28 00:57:38,691][106226] Updated weights for policy 0, policy_version 793931 (0.0007) [2023-12-28 00:57:38,700][106225] Updated weights for policy 1, policy_version 796139 (0.0007) [2023-12-28 00:57:38,755][106225] Updated weights for policy 1, policy_version 796149 (0.0005) [2023-12-28 00:57:38,756][106226] Updated weights for policy 0, policy_version 793941 (0.0009) [2023-12-28 00:57:38,805][106225] Updated weights for policy 1, policy_version 796159 (0.0005) [2023-12-28 00:57:38,815][106226] Updated weights for policy 0, policy_version 793951 (0.0007) [2023-12-28 00:57:39,433][106225] Updated weights for policy 1, policy_version 796169 (0.0006) [2023-12-28 00:57:39,495][106225] Updated weights for policy 1, policy_version 796179 (0.0009) [2023-12-28 00:57:39,550][106225] Updated weights for policy 1, policy_version 796189 (0.0009) [2023-12-28 00:57:39,594][106226] Updated weights for policy 0, policy_version 793961 (0.0008) [2023-12-28 00:57:39,614][106225] Updated weights for policy 1, policy_version 796199 (0.0008) [2023-12-28 00:57:39,659][106226] Updated weights for policy 0, policy_version 793971 (0.0010) [2023-12-28 00:57:39,720][106226] Updated weights for policy 0, policy_version 793981 (0.0009) [2023-12-28 00:57:39,783][106226] Updated weights for policy 0, policy_version 793991 (0.0008) [2023-12-28 00:57:40,420][106226] Updated weights for policy 0, policy_version 794001 (0.0007) [2023-12-28 00:57:40,435][106225] Updated weights for policy 1, policy_version 796209 (0.0007) [2023-12-28 00:57:40,479][106226] Updated weights for policy 0, policy_version 794011 (0.0008) [2023-12-28 00:57:40,497][106225] Updated weights for policy 1, policy_version 796219 (0.0006) [2023-12-28 00:57:40,538][106226] Updated weights for policy 0, policy_version 794021 (0.0006) [2023-12-28 00:57:40,557][106225] Updated weights for policy 1, policy_version 796229 (0.0006) [2023-12-28 00:57:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 407199744. Throughput: 0: 9792.5, 1: 10095.3. Samples: 407174524. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:41,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-4.938')] [2023-12-28 00:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000796232_203874304.pth... [2023-12-28 00:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000794024_203325440.pth... [2023-12-28 00:57:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000792904_203038720.pth [2023-12-28 00:57:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000795048_203571200.pth [2023-12-28 00:57:41,285][106226] Updated weights for policy 0, policy_version 794031 (0.0008) [2023-12-28 00:57:41,290][106225] Updated weights for policy 1, policy_version 796239 (0.0008) [2023-12-28 00:57:41,352][106226] Updated weights for policy 0, policy_version 794041 (0.0009) [2023-12-28 00:57:41,353][106225] Updated weights for policy 1, policy_version 796249 (0.0009) [2023-12-28 00:57:41,416][106225] Updated weights for policy 1, policy_version 796259 (0.0008) [2023-12-28 00:57:41,422][106226] Updated weights for policy 0, policy_version 794051 (0.0008) [2023-12-28 00:57:42,117][106225] Updated weights for policy 1, policy_version 796269 (0.0008) [2023-12-28 00:57:42,162][106226] Updated weights for policy 0, policy_version 794061 (0.0007) [2023-12-28 00:57:42,186][106225] Updated weights for policy 1, policy_version 796279 (0.0008) [2023-12-28 00:57:42,208][106226] Updated weights for policy 0, policy_version 794071 (0.0008) [2023-12-28 00:57:42,258][106225] Updated weights for policy 1, policy_version 796289 (0.0008) [2023-12-28 00:57:42,272][106226] Updated weights for policy 0, policy_version 794081 (0.0008) [2023-12-28 00:57:42,924][106226] Updated weights for policy 0, policy_version 794091 (0.0007) [2023-12-28 00:57:42,972][106226] Updated weights for policy 0, policy_version 794101 (0.0006) [2023-12-28 00:57:43,003][106225] Updated weights for policy 1, policy_version 796299 (0.0007) [2023-12-28 00:57:43,021][106226] Updated weights for policy 0, policy_version 794111 (0.0007) [2023-12-28 00:57:43,050][106225] Updated weights for policy 1, policy_version 796309 (0.0005) [2023-12-28 00:57:43,094][106225] Updated weights for policy 1, policy_version 796319 (0.0006) [2023-12-28 00:57:43,706][106226] Updated weights for policy 0, policy_version 794121 (0.0008) [2023-12-28 00:57:43,771][106226] Updated weights for policy 0, policy_version 794131 (0.0005) [2023-12-28 00:57:43,819][106225] Updated weights for policy 1, policy_version 796329 (0.0009) [2023-12-28 00:57:43,836][106226] Updated weights for policy 0, policy_version 794141 (0.0005) [2023-12-28 00:57:43,879][106225] Updated weights for policy 1, policy_version 796339 (0.0010) [2023-12-28 00:57:43,891][106226] Updated weights for policy 0, policy_version 794151 (0.0005) [2023-12-28 00:57:43,935][106225] Updated weights for policy 1, policy_version 796349 (0.0010) [2023-12-28 00:57:44,010][106225] Updated weights for policy 1, policy_version 796359 (0.0010) [2023-12-28 00:57:44,433][106226] Updated weights for policy 0, policy_version 794161 (0.0005) [2023-12-28 00:57:44,488][106226] Updated weights for policy 0, policy_version 794171 (0.0006) [2023-12-28 00:57:44,546][106226] Updated weights for policy 0, policy_version 794181 (0.0005) [2023-12-28 00:57:44,683][106225] Updated weights for policy 1, policy_version 796369 (0.0006) [2023-12-28 00:57:44,750][106225] Updated weights for policy 1, policy_version 796379 (0.0008) [2023-12-28 00:57:44,814][106225] Updated weights for policy 1, policy_version 796389 (0.0010) [2023-12-28 00:57:45,210][106226] Updated weights for policy 0, policy_version 794191 (0.0008) [2023-12-28 00:57:45,272][106226] Updated weights for policy 0, policy_version 794201 (0.0011) [2023-12-28 00:57:45,333][106226] Updated weights for policy 0, policy_version 794211 (0.0010) [2023-12-28 00:57:45,502][106225] Updated weights for policy 1, policy_version 796399 (0.0010) [2023-12-28 00:57:45,551][106225] Updated weights for policy 1, policy_version 796409 (0.0010) [2023-12-28 00:57:45,597][106225] Updated weights for policy 1, policy_version 796419 (0.0010) [2023-12-28 00:57:45,972][106226] Updated weights for policy 0, policy_version 794221 (0.0005) [2023-12-28 00:57:46,033][106226] Updated weights for policy 0, policy_version 794231 (0.0006) [2023-12-28 00:57:46,087][106226] Updated weights for policy 0, policy_version 794241 (0.0008) [2023-12-28 00:57:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 407306240. Throughput: 0: 9770.4, 1: 10088.1. Samples: 407293688. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-28 00:57:46,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.206')] [2023-12-28 00:57:46,305][106225] Updated weights for policy 1, policy_version 796429 (0.0010) [2023-12-28 00:57:46,351][106225] Updated weights for policy 1, policy_version 796439 (0.0010) [2023-12-28 00:57:46,394][106225] Updated weights for policy 1, policy_version 796449 (0.0010) [2023-12-28 00:57:46,693][106226] Updated weights for policy 0, policy_version 794251 (0.0007) [2023-12-28 00:57:46,745][106226] Updated weights for policy 0, policy_version 794261 (0.0005) [2023-12-28 00:57:46,800][106226] Updated weights for policy 0, policy_version 794271 (0.0007) [2023-12-28 00:57:47,040][106225] Updated weights for policy 1, policy_version 796459 (0.0009) [2023-12-28 00:57:47,093][106225] Updated weights for policy 1, policy_version 796469 (0.0005) [2023-12-28 00:57:47,144][106225] Updated weights for policy 1, policy_version 796479 (0.0005) [2023-12-28 00:57:47,479][106226] Updated weights for policy 0, policy_version 794281 (0.0010) [2023-12-28 00:57:47,539][106226] Updated weights for policy 0, policy_version 794291 (0.0010) [2023-12-28 00:57:47,593][106226] Updated weights for policy 0, policy_version 794301 (0.0011) [2023-12-28 00:57:47,645][106226] Updated weights for policy 0, policy_version 794311 (0.0010) [2023-12-28 00:57:47,797][106225] Updated weights for policy 1, policy_version 796489 (0.0009) [2023-12-28 00:57:47,859][106225] Updated weights for policy 1, policy_version 796499 (0.0007) [2023-12-28 00:57:47,907][106225] Updated weights for policy 1, policy_version 796509 (0.0006) [2023-12-28 00:57:47,964][106225] Updated weights for policy 1, policy_version 796519 (0.0006) [2023-12-28 00:57:48,314][106226] Updated weights for policy 0, policy_version 794321 (0.0010) [2023-12-28 00:57:48,395][106226] Updated weights for policy 0, policy_version 794331 (0.0010) [2023-12-28 00:57:48,460][106226] Updated weights for policy 0, policy_version 794341 (0.0011) [2023-12-28 00:57:48,631][106225] Updated weights for policy 1, policy_version 796529 (0.0008) [2023-12-28 00:57:48,686][106225] Updated weights for policy 1, policy_version 796539 (0.0009) [2023-12-28 00:57:48,747][106225] Updated weights for policy 1, policy_version 796549 (0.0006) [2023-12-28 00:57:49,109][106226] Updated weights for policy 0, policy_version 794351 (0.0007) [2023-12-28 00:57:49,160][106226] Updated weights for policy 0, policy_version 794361 (0.0007) [2023-12-28 00:57:49,211][106226] Updated weights for policy 0, policy_version 794371 (0.0008) [2023-12-28 00:57:49,369][106225] Updated weights for policy 1, policy_version 796559 (0.0008) [2023-12-28 00:57:49,433][106225] Updated weights for policy 1, policy_version 796569 (0.0010) [2023-12-28 00:57:49,493][106225] Updated weights for policy 1, policy_version 796579 (0.0010) [2023-12-28 00:57:49,983][106226] Updated weights for policy 0, policy_version 794381 (0.0009) [2023-12-28 00:57:50,042][106226] Updated weights for policy 0, policy_version 794391 (0.0010) [2023-12-28 00:57:50,107][106226] Updated weights for policy 0, policy_version 794401 (0.0011) [2023-12-28 00:57:50,267][106225] Updated weights for policy 1, policy_version 796589 (0.0009) [2023-12-28 00:57:50,330][106225] Updated weights for policy 1, policy_version 796599 (0.0008) [2023-12-28 00:57:50,391][106225] Updated weights for policy 1, policy_version 796609 (0.0007) [2023-12-28 00:57:50,846][106226] Updated weights for policy 0, policy_version 794411 (0.0007) [2023-12-28 00:57:50,910][106226] Updated weights for policy 0, policy_version 794421 (0.0011) [2023-12-28 00:57:50,974][106226] Updated weights for policy 0, policy_version 794431 (0.0011) [2023-12-28 00:57:51,169][106225] Updated weights for policy 1, policy_version 796619 (0.0009) [2023-12-28 00:57:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 407404544. Throughput: 0: 9778.9, 1: 10055.6. Samples: 407413988. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:57:51,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-5.068')] [2023-12-28 00:57:51,236][106225] Updated weights for policy 1, policy_version 796629 (0.0011) [2023-12-28 00:57:51,300][106225] Updated weights for policy 1, policy_version 796639 (0.0010) [2023-12-28 00:57:51,784][106226] Updated weights for policy 0, policy_version 794441 (0.0010) [2023-12-28 00:57:51,834][106226] Updated weights for policy 0, policy_version 794451 (0.0005) [2023-12-28 00:57:51,902][106226] Updated weights for policy 0, policy_version 794461 (0.0006) [2023-12-28 00:57:51,969][106226] Updated weights for policy 0, policy_version 794471 (0.0008) [2023-12-28 00:57:52,061][106225] Updated weights for policy 1, policy_version 796649 (0.0010) [2023-12-28 00:57:52,124][106225] Updated weights for policy 1, policy_version 796659 (0.0008) [2023-12-28 00:57:52,183][106225] Updated weights for policy 1, policy_version 796669 (0.0008) [2023-12-28 00:57:52,243][106225] Updated weights for policy 1, policy_version 796679 (0.0008) [2023-12-28 00:57:52,614][106226] Updated weights for policy 0, policy_version 794481 (0.0009) [2023-12-28 00:57:52,672][106226] Updated weights for policy 0, policy_version 794491 (0.0007) [2023-12-28 00:57:52,733][106226] Updated weights for policy 0, policy_version 794501 (0.0008) [2023-12-28 00:57:53,050][106225] Updated weights for policy 1, policy_version 796689 (0.0008) [2023-12-28 00:57:53,105][106225] Updated weights for policy 1, policy_version 796699 (0.0006) [2023-12-28 00:57:53,157][106225] Updated weights for policy 1, policy_version 796709 (0.0009) [2023-12-28 00:57:53,407][106226] Updated weights for policy 0, policy_version 794511 (0.0009) [2023-12-28 00:57:53,466][106226] Updated weights for policy 0, policy_version 794521 (0.0011) [2023-12-28 00:57:53,528][106226] Updated weights for policy 0, policy_version 794531 (0.0011) [2023-12-28 00:57:53,915][106225] Updated weights for policy 1, policy_version 796719 (0.0009) [2023-12-28 00:57:53,969][106225] Updated weights for policy 1, policy_version 796729 (0.0010) [2023-12-28 00:57:54,015][106225] Updated weights for policy 1, policy_version 796739 (0.0010) [2023-12-28 00:57:54,245][106226] Updated weights for policy 0, policy_version 794541 (0.0011) [2023-12-28 00:57:54,308][106226] Updated weights for policy 0, policy_version 794551 (0.0008) [2023-12-28 00:57:54,374][106226] Updated weights for policy 0, policy_version 794561 (0.0010) [2023-12-28 00:57:54,729][106225] Updated weights for policy 1, policy_version 796749 (0.0010) [2023-12-28 00:57:54,786][106225] Updated weights for policy 1, policy_version 796759 (0.0010) [2023-12-28 00:57:54,839][106225] Updated weights for policy 1, policy_version 796769 (0.0010) [2023-12-28 00:57:55,056][106226] Updated weights for policy 0, policy_version 794571 (0.0007) [2023-12-28 00:57:55,114][106226] Updated weights for policy 0, policy_version 794581 (0.0005) [2023-12-28 00:57:55,169][106226] Updated weights for policy 0, policy_version 794591 (0.0005) [2023-12-28 00:57:55,506][106225] Updated weights for policy 1, policy_version 796779 (0.0010) [2023-12-28 00:57:55,571][106225] Updated weights for policy 1, policy_version 796789 (0.0006) [2023-12-28 00:57:55,633][106225] Updated weights for policy 1, policy_version 796799 (0.0008) [2023-12-28 00:57:55,900][106226] Updated weights for policy 0, policy_version 794601 (0.0006) [2023-12-28 00:57:55,955][106226] Updated weights for policy 0, policy_version 794611 (0.0009) [2023-12-28 00:57:56,016][106226] Updated weights for policy 0, policy_version 794621 (0.0006) [2023-12-28 00:57:56,083][106226] Updated weights for policy 0, policy_version 794631 (0.0005) [2023-12-28 00:57:56,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 407502848. Throughput: 0: 9819.7, 1: 10029.7. Samples: 407471708. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:57:56,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-5.063')] [2023-12-28 00:57:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000794632_203481088.pth... [2023-12-28 00:57:56,184][106225] Updated weights for policy 1, policy_version 796809 (0.0005) [2023-12-28 00:57:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000793480_203186176.pth [2023-12-28 00:57:56,241][106225] Updated weights for policy 1, policy_version 796819 (0.0008) [2023-12-28 00:57:56,295][106225] Updated weights for policy 1, policy_version 796830 (0.0009) [2023-12-28 00:57:56,343][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000796840_204029952.pth... [2023-12-28 00:57:56,344][106225] Updated weights for policy 1, policy_version 796840 (0.0007) [2023-12-28 00:57:56,346][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000795624_203718656.pth [2023-12-28 00:57:56,741][106226] Updated weights for policy 0, policy_version 794641 (0.0009) [2023-12-28 00:57:56,786][106226] Updated weights for policy 0, policy_version 794651 (0.0006) [2023-12-28 00:57:56,831][106226] Updated weights for policy 0, policy_version 794661 (0.0008) [2023-12-28 00:57:56,966][106225] Updated weights for policy 1, policy_version 796850 (0.0009) [2023-12-28 00:57:57,019][106225] Updated weights for policy 1, policy_version 796860 (0.0008) [2023-12-28 00:57:57,070][106225] Updated weights for policy 1, policy_version 796870 (0.0007) [2023-12-28 00:57:57,486][106226] Updated weights for policy 0, policy_version 794671 (0.0006) [2023-12-28 00:57:57,543][106226] Updated weights for policy 0, policy_version 794681 (0.0005) [2023-12-28 00:57:57,612][106226] Updated weights for policy 0, policy_version 794691 (0.0005) [2023-12-28 00:57:57,818][106225] Updated weights for policy 1, policy_version 796880 (0.0009) [2023-12-28 00:57:57,879][106225] Updated weights for policy 1, policy_version 796890 (0.0008) [2023-12-28 00:57:57,934][106225] Updated weights for policy 1, policy_version 796900 (0.0006) [2023-12-28 00:57:58,165][106226] Updated weights for policy 0, policy_version 794701 (0.0008) [2023-12-28 00:57:58,227][106226] Updated weights for policy 0, policy_version 794711 (0.0010) [2023-12-28 00:57:58,290][106226] Updated weights for policy 0, policy_version 794721 (0.0008) [2023-12-28 00:57:58,642][106225] Updated weights for policy 1, policy_version 796910 (0.0007) [2023-12-28 00:57:58,703][106225] Updated weights for policy 1, policy_version 796920 (0.0008) [2023-12-28 00:57:58,772][106225] Updated weights for policy 1, policy_version 796930 (0.0009) [2023-12-28 00:57:59,094][106226] Updated weights for policy 0, policy_version 794731 (0.0008) [2023-12-28 00:57:59,144][106226] Updated weights for policy 0, policy_version 794741 (0.0009) [2023-12-28 00:57:59,201][106226] Updated weights for policy 0, policy_version 794751 (0.0008) [2023-12-28 00:57:59,547][106225] Updated weights for policy 1, policy_version 796940 (0.0008) [2023-12-28 00:57:59,613][106225] Updated weights for policy 1, policy_version 796950 (0.0009) [2023-12-28 00:57:59,681][106225] Updated weights for policy 1, policy_version 796960 (0.0010) [2023-12-28 00:57:59,996][106226] Updated weights for policy 0, policy_version 794761 (0.0008) [2023-12-28 00:58:00,053][106226] Updated weights for policy 0, policy_version 794771 (0.0008) [2023-12-28 00:58:00,099][106226] Updated weights for policy 0, policy_version 794781 (0.0008) [2023-12-28 00:58:00,150][106226] Updated weights for policy 0, policy_version 794791 (0.0008) [2023-12-28 00:58:00,355][106225] Updated weights for policy 1, policy_version 796970 (0.0009) [2023-12-28 00:58:00,420][106225] Updated weights for policy 1, policy_version 796980 (0.0010) [2023-12-28 00:58:00,477][106225] Updated weights for policy 1, policy_version 796990 (0.0010) [2023-12-28 00:58:00,534][106225] Updated weights for policy 1, policy_version 797000 (0.0010) [2023-12-28 00:58:00,889][106226] Updated weights for policy 0, policy_version 794801 (0.0010) [2023-12-28 00:58:00,948][106226] Updated weights for policy 0, policy_version 794811 (0.0009) [2023-12-28 00:58:00,998][106226] Updated weights for policy 0, policy_version 794821 (0.0007) [2023-12-28 00:58:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 407601152. Throughput: 0: 9847.1, 1: 10057.6. Samples: 407591552. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:01,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.947')] [2023-12-28 00:58:01,219][106225] Updated weights for policy 1, policy_version 797010 (0.0009) [2023-12-28 00:58:01,284][106225] Updated weights for policy 1, policy_version 797020 (0.0007) [2023-12-28 00:58:01,346][106225] Updated weights for policy 1, policy_version 797030 (0.0008) [2023-12-28 00:58:01,660][106226] Updated weights for policy 0, policy_version 794831 (0.0010) [2023-12-28 00:58:01,722][106226] Updated weights for policy 0, policy_version 794841 (0.0007) [2023-12-28 00:58:01,790][106226] Updated weights for policy 0, policy_version 794851 (0.0009) [2023-12-28 00:58:02,102][106225] Updated weights for policy 1, policy_version 797040 (0.0006) [2023-12-28 00:58:02,160][106225] Updated weights for policy 1, policy_version 797050 (0.0006) [2023-12-28 00:58:02,219][106225] Updated weights for policy 1, policy_version 797060 (0.0006) [2023-12-28 00:58:02,581][106226] Updated weights for policy 0, policy_version 794861 (0.0010) [2023-12-28 00:58:02,643][106226] Updated weights for policy 0, policy_version 794871 (0.0010) [2023-12-28 00:58:02,709][106226] Updated weights for policy 0, policy_version 794881 (0.0010) [2023-12-28 00:58:02,820][106225] Updated weights for policy 1, policy_version 797070 (0.0008) [2023-12-28 00:58:02,871][106225] Updated weights for policy 1, policy_version 797080 (0.0006) [2023-12-28 00:58:02,923][106225] Updated weights for policy 1, policy_version 797090 (0.0005) [2023-12-28 00:58:03,464][106226] Updated weights for policy 0, policy_version 794891 (0.0008) [2023-12-28 00:58:03,520][106226] Updated weights for policy 0, policy_version 794901 (0.0007) [2023-12-28 00:58:03,525][106225] Updated weights for policy 1, policy_version 797100 (0.0007) [2023-12-28 00:58:03,577][106225] Updated weights for policy 1, policy_version 797110 (0.0010) [2023-12-28 00:58:03,577][106226] Updated weights for policy 0, policy_version 794911 (0.0010) [2023-12-28 00:58:03,633][106225] Updated weights for policy 1, policy_version 797120 (0.0010) [2023-12-28 00:58:04,291][106225] Updated weights for policy 1, policy_version 797130 (0.0009) [2023-12-28 00:58:04,346][106226] Updated weights for policy 0, policy_version 794921 (0.0008) [2023-12-28 00:58:04,348][106225] Updated weights for policy 1, policy_version 797140 (0.0005) [2023-12-28 00:58:04,406][106225] Updated weights for policy 1, policy_version 797150 (0.0008) [2023-12-28 00:58:04,408][106226] Updated weights for policy 0, policy_version 794931 (0.0007) [2023-12-28 00:58:04,465][106225] Updated weights for policy 1, policy_version 797160 (0.0010) [2023-12-28 00:58:04,467][106226] Updated weights for policy 0, policy_version 794941 (0.0006) [2023-12-28 00:58:04,521][106226] Updated weights for policy 0, policy_version 794951 (0.0008) [2023-12-28 00:58:05,081][106225] Updated weights for policy 1, policy_version 797170 (0.0006) [2023-12-28 00:58:05,098][106226] Updated weights for policy 0, policy_version 794961 (0.0006) [2023-12-28 00:58:05,135][106225] Updated weights for policy 1, policy_version 797180 (0.0007) [2023-12-28 00:58:05,156][106226] Updated weights for policy 0, policy_version 794971 (0.0005) [2023-12-28 00:58:05,190][106225] Updated weights for policy 1, policy_version 797190 (0.0007) [2023-12-28 00:58:05,218][106226] Updated weights for policy 0, policy_version 794981 (0.0006) [2023-12-28 00:58:05,800][106225] Updated weights for policy 1, policy_version 797200 (0.0010) [2023-12-28 00:58:05,808][106226] Updated weights for policy 0, policy_version 794991 (0.0005) [2023-12-28 00:58:05,847][106225] Updated weights for policy 1, policy_version 797210 (0.0010) [2023-12-28 00:58:05,872][106226] Updated weights for policy 0, policy_version 795001 (0.0006) [2023-12-28 00:58:05,897][106225] Updated weights for policy 1, policy_version 797220 (0.0010) [2023-12-28 00:58:05,931][106226] Updated weights for policy 0, policy_version 795011 (0.0006) [2023-12-28 00:58:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 407707648. Throughput: 0: 9865.7, 1: 10194.1. Samples: 407715012. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:06,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-5.005')] [2023-12-28 00:58:06,601][106225] Updated weights for policy 1, policy_version 797230 (0.0007) [2023-12-28 00:58:06,629][106226] Updated weights for policy 0, policy_version 795021 (0.0007) [2023-12-28 00:58:06,666][106225] Updated weights for policy 1, policy_version 797240 (0.0008) [2023-12-28 00:58:06,684][106226] Updated weights for policy 0, policy_version 795031 (0.0008) [2023-12-28 00:58:06,724][106225] Updated weights for policy 1, policy_version 797250 (0.0010) [2023-12-28 00:58:06,740][106226] Updated weights for policy 0, policy_version 795041 (0.0008) [2023-12-28 00:58:07,373][106225] Updated weights for policy 1, policy_version 797260 (0.0010) [2023-12-28 00:58:07,426][106225] Updated weights for policy 1, policy_version 797270 (0.0010) [2023-12-28 00:58:07,480][106225] Updated weights for policy 1, policy_version 797280 (0.0010) [2023-12-28 00:58:07,500][106226] Updated weights for policy 0, policy_version 795051 (0.0008) [2023-12-28 00:58:07,556][106226] Updated weights for policy 0, policy_version 795061 (0.0007) [2023-12-28 00:58:07,608][106226] Updated weights for policy 0, policy_version 795071 (0.0008) [2023-12-28 00:58:08,205][106225] Updated weights for policy 1, policy_version 797290 (0.0011) [2023-12-28 00:58:08,258][106225] Updated weights for policy 1, policy_version 797300 (0.0010) [2023-12-28 00:58:08,311][106225] Updated weights for policy 1, policy_version 797310 (0.0010) [2023-12-28 00:58:08,322][106226] Updated weights for policy 0, policy_version 795081 (0.0008) [2023-12-28 00:58:08,384][106226] Updated weights for policy 0, policy_version 795091 (0.0007) [2023-12-28 00:58:08,395][106225] Updated weights for policy 1, policy_version 797320 (0.0011) [2023-12-28 00:58:08,441][106226] Updated weights for policy 0, policy_version 795101 (0.0006) [2023-12-28 00:58:08,501][106226] Updated weights for policy 0, policy_version 795111 (0.0007) [2023-12-28 00:58:09,132][106225] Updated weights for policy 1, policy_version 797330 (0.0010) [2023-12-28 00:58:09,161][106226] Updated weights for policy 0, policy_version 795121 (0.0006) [2023-12-28 00:58:09,192][106225] Updated weights for policy 1, policy_version 797340 (0.0010) [2023-12-28 00:58:09,221][106226] Updated weights for policy 0, policy_version 795131 (0.0010) [2023-12-28 00:58:09,258][106225] Updated weights for policy 1, policy_version 797350 (0.0011) [2023-12-28 00:58:09,288][106226] Updated weights for policy 0, policy_version 795141 (0.0008) [2023-12-28 00:58:09,913][106226] Updated weights for policy 0, policy_version 795151 (0.0008) [2023-12-28 00:58:09,983][106226] Updated weights for policy 0, policy_version 795161 (0.0010) [2023-12-28 00:58:10,028][106225] Updated weights for policy 1, policy_version 797360 (0.0007) [2023-12-28 00:58:10,037][106226] Updated weights for policy 0, policy_version 795171 (0.0011) [2023-12-28 00:58:10,080][106225] Updated weights for policy 1, policy_version 797370 (0.0008) [2023-12-28 00:58:10,136][106225] Updated weights for policy 1, policy_version 797380 (0.0009) [2023-12-28 00:58:10,735][106226] Updated weights for policy 0, policy_version 795181 (0.0011) [2023-12-28 00:58:10,797][106226] Updated weights for policy 0, policy_version 795191 (0.0011) [2023-12-28 00:58:10,864][106226] Updated weights for policy 0, policy_version 795201 (0.0005) [2023-12-28 00:58:10,886][106225] Updated weights for policy 1, policy_version 797390 (0.0010) [2023-12-28 00:58:10,943][106225] Updated weights for policy 1, policy_version 797400 (0.0010) [2023-12-28 00:58:11,005][106225] Updated weights for policy 1, policy_version 797410 (0.0009) [2023-12-28 00:58:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 407805952. Throughput: 0: 9873.6, 1: 10200.9. Samples: 407773284. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:11,175][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.794')] [2023-12-28 00:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000797416_204177408.pth... [2023-12-28 00:58:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000795208_203628544.pth... [2023-12-28 00:58:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000794024_203325440.pth [2023-12-28 00:58:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000796232_203874304.pth [2023-12-28 00:58:11,602][106226] Updated weights for policy 0, policy_version 795211 (0.0011) [2023-12-28 00:58:11,672][106226] Updated weights for policy 0, policy_version 795221 (0.0009) [2023-12-28 00:58:11,735][106226] Updated weights for policy 0, policy_version 795231 (0.0008) [2023-12-28 00:58:11,781][106225] Updated weights for policy 1, policy_version 797420 (0.0009) [2023-12-28 00:58:11,842][106225] Updated weights for policy 1, policy_version 797430 (0.0010) [2023-12-28 00:58:11,893][106225] Updated weights for policy 1, policy_version 797440 (0.0011) [2023-12-28 00:58:12,530][106226] Updated weights for policy 0, policy_version 795241 (0.0008) [2023-12-28 00:58:12,590][106226] Updated weights for policy 0, policy_version 795251 (0.0006) [2023-12-28 00:58:12,654][106226] Updated weights for policy 0, policy_version 795261 (0.0006) [2023-12-28 00:58:12,659][106225] Updated weights for policy 1, policy_version 797450 (0.0010) [2023-12-28 00:58:12,720][106225] Updated weights for policy 1, policy_version 797460 (0.0010) [2023-12-28 00:58:12,720][106226] Updated weights for policy 0, policy_version 795271 (0.0005) [2023-12-28 00:58:12,783][106225] Updated weights for policy 1, policy_version 797470 (0.0010) [2023-12-28 00:58:12,848][106225] Updated weights for policy 1, policy_version 797480 (0.0007) [2023-12-28 00:58:13,360][106226] Updated weights for policy 0, policy_version 795281 (0.0008) [2023-12-28 00:58:13,420][106226] Updated weights for policy 0, policy_version 795291 (0.0008) [2023-12-28 00:58:13,485][106226] Updated weights for policy 0, policy_version 795301 (0.0008) [2023-12-28 00:58:13,487][106225] Updated weights for policy 1, policy_version 797490 (0.0006) [2023-12-28 00:58:13,544][106225] Updated weights for policy 1, policy_version 797500 (0.0006) [2023-12-28 00:58:13,592][106225] Updated weights for policy 1, policy_version 797510 (0.0008) [2023-12-28 00:58:14,237][106225] Updated weights for policy 1, policy_version 797520 (0.0010) [2023-12-28 00:58:14,250][106226] Updated weights for policy 0, policy_version 795311 (0.0009) [2023-12-28 00:58:14,297][106225] Updated weights for policy 1, policy_version 797530 (0.0010) [2023-12-28 00:58:14,311][106226] Updated weights for policy 0, policy_version 795321 (0.0011) [2023-12-28 00:58:14,358][106225] Updated weights for policy 1, policy_version 797540 (0.0010) [2023-12-28 00:58:14,362][106226] Updated weights for policy 0, policy_version 795331 (0.0010) [2023-12-28 00:58:15,046][106225] Updated weights for policy 1, policy_version 797550 (0.0011) [2023-12-28 00:58:15,056][106226] Updated weights for policy 0, policy_version 795341 (0.0010) [2023-12-28 00:58:15,104][106225] Updated weights for policy 1, policy_version 797560 (0.0010) [2023-12-28 00:58:15,116][106226] Updated weights for policy 0, policy_version 795351 (0.0010) [2023-12-28 00:58:15,165][106225] Updated weights for policy 1, policy_version 797570 (0.0010) [2023-12-28 00:58:15,174][106226] Updated weights for policy 0, policy_version 795361 (0.0010) [2023-12-28 00:58:15,882][106225] Updated weights for policy 1, policy_version 797580 (0.0010) [2023-12-28 00:58:15,885][106226] Updated weights for policy 0, policy_version 795371 (0.0010) [2023-12-28 00:58:15,939][106225] Updated weights for policy 1, policy_version 797590 (0.0010) [2023-12-28 00:58:15,943][106226] Updated weights for policy 0, policy_version 795381 (0.0008) [2023-12-28 00:58:15,997][106225] Updated weights for policy 1, policy_version 797600 (0.0010) [2023-12-28 00:58:16,005][106226] Updated weights for policy 0, policy_version 795391 (0.0008) [2023-12-28 00:58:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 407904256. Throughput: 0: 9923.1, 1: 10011.5. Samples: 407889392. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:16,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.123')] [2023-12-28 00:58:16,625][106226] Updated weights for policy 0, policy_version 795401 (0.0010) [2023-12-28 00:58:16,679][106226] Updated weights for policy 0, policy_version 795411 (0.0011) [2023-12-28 00:58:16,721][106225] Updated weights for policy 1, policy_version 797610 (0.0010) [2023-12-28 00:58:16,737][106226] Updated weights for policy 0, policy_version 795421 (0.0011) [2023-12-28 00:58:16,778][106225] Updated weights for policy 1, policy_version 797620 (0.0010) [2023-12-28 00:58:16,785][106226] Updated weights for policy 0, policy_version 795431 (0.0010) [2023-12-28 00:58:16,845][106225] Updated weights for policy 1, policy_version 797630 (0.0009) [2023-12-28 00:58:16,910][106225] Updated weights for policy 1, policy_version 797640 (0.0010) [2023-12-28 00:58:17,406][106226] Updated weights for policy 0, policy_version 795441 (0.0008) [2023-12-28 00:58:17,456][106226] Updated weights for policy 0, policy_version 795451 (0.0009) [2023-12-28 00:58:17,512][106226] Updated weights for policy 0, policy_version 795461 (0.0009) [2023-12-28 00:58:17,553][106225] Updated weights for policy 1, policy_version 797650 (0.0009) [2023-12-28 00:58:17,601][106225] Updated weights for policy 1, policy_version 797660 (0.0009) [2023-12-28 00:58:17,658][106225] Updated weights for policy 1, policy_version 797670 (0.0006) [2023-12-28 00:58:18,142][106226] Updated weights for policy 0, policy_version 795471 (0.0008) [2023-12-28 00:58:18,206][106226] Updated weights for policy 0, policy_version 795481 (0.0008) [2023-12-28 00:58:18,266][106225] Updated weights for policy 1, policy_version 797680 (0.0008) [2023-12-28 00:58:18,268][106226] Updated weights for policy 0, policy_version 795491 (0.0008) [2023-12-28 00:58:18,319][106225] Updated weights for policy 1, policy_version 797690 (0.0006) [2023-12-28 00:58:18,389][106225] Updated weights for policy 1, policy_version 797700 (0.0007) [2023-12-28 00:58:18,931][106226] Updated weights for policy 0, policy_version 795501 (0.0006) [2023-12-28 00:58:18,990][106226] Updated weights for policy 0, policy_version 795511 (0.0006) [2023-12-28 00:58:19,061][106226] Updated weights for policy 0, policy_version 795521 (0.0007) [2023-12-28 00:58:19,123][106225] Updated weights for policy 1, policy_version 797710 (0.0005) [2023-12-28 00:58:19,190][106225] Updated weights for policy 1, policy_version 797720 (0.0005) [2023-12-28 00:58:19,267][106225] Updated weights for policy 1, policy_version 797730 (0.0009) [2023-12-28 00:58:19,741][106226] Updated weights for policy 0, policy_version 795531 (0.0007) [2023-12-28 00:58:19,801][106226] Updated weights for policy 0, policy_version 795541 (0.0009) [2023-12-28 00:58:19,876][106226] Updated weights for policy 0, policy_version 795551 (0.0008) [2023-12-28 00:58:19,935][106225] Updated weights for policy 1, policy_version 797740 (0.0009) [2023-12-28 00:58:20,003][106225] Updated weights for policy 1, policy_version 797750 (0.0010) [2023-12-28 00:58:20,074][106225] Updated weights for policy 1, policy_version 797760 (0.0011) [2023-12-28 00:58:20,581][106226] Updated weights for policy 0, policy_version 795561 (0.0008) [2023-12-28 00:58:20,643][106226] Updated weights for policy 0, policy_version 795571 (0.0010) [2023-12-28 00:58:20,702][106226] Updated weights for policy 0, policy_version 795581 (0.0011) [2023-12-28 00:58:20,750][106226] Updated weights for policy 0, policy_version 795591 (0.0010) [2023-12-28 00:58:20,769][106225] Updated weights for policy 1, policy_version 797770 (0.0011) [2023-12-28 00:58:20,828][106225] Updated weights for policy 1, policy_version 797780 (0.0010) [2023-12-28 00:58:20,890][106225] Updated weights for policy 1, policy_version 797790 (0.0010) [2023-12-28 00:58:20,949][106225] Updated weights for policy 1, policy_version 797800 (0.0009) [2023-12-28 00:58:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 408002560. Throughput: 0: 9931.8, 1: 9946.0. Samples: 408010628. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:21,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.497')] [2023-12-28 00:58:21,513][106226] Updated weights for policy 0, policy_version 795601 (0.0006) [2023-12-28 00:58:21,583][106226] Updated weights for policy 0, policy_version 795611 (0.0006) [2023-12-28 00:58:21,664][106226] Updated weights for policy 0, policy_version 795621 (0.0008) [2023-12-28 00:58:21,716][106225] Updated weights for policy 1, policy_version 797810 (0.0011) [2023-12-28 00:58:21,789][106225] Updated weights for policy 1, policy_version 797820 (0.0009) [2023-12-28 00:58:21,860][106225] Updated weights for policy 1, policy_version 797830 (0.0006) [2023-12-28 00:58:22,370][106226] Updated weights for policy 0, policy_version 795631 (0.0009) [2023-12-28 00:58:22,441][106226] Updated weights for policy 0, policy_version 795641 (0.0007) [2023-12-28 00:58:22,506][106226] Updated weights for policy 0, policy_version 795651 (0.0008) [2023-12-28 00:58:22,599][106225] Updated weights for policy 1, policy_version 797840 (0.0008) [2023-12-28 00:58:22,663][106225] Updated weights for policy 1, policy_version 797850 (0.0009) [2023-12-28 00:58:22,731][106225] Updated weights for policy 1, policy_version 797860 (0.0007) [2023-12-28 00:58:23,209][106226] Updated weights for policy 0, policy_version 795661 (0.0008) [2023-12-28 00:58:23,264][106226] Updated weights for policy 0, policy_version 795671 (0.0009) [2023-12-28 00:58:23,321][106226] Updated weights for policy 0, policy_version 795681 (0.0009) [2023-12-28 00:58:23,376][106225] Updated weights for policy 1, policy_version 797870 (0.0006) [2023-12-28 00:58:23,434][106225] Updated weights for policy 1, policy_version 797880 (0.0005) [2023-12-28 00:58:23,485][106225] Updated weights for policy 1, policy_version 797890 (0.0005) [2023-12-28 00:58:24,077][106226] Updated weights for policy 0, policy_version 795691 (0.0010) [2023-12-28 00:58:24,122][106225] Updated weights for policy 1, policy_version 797900 (0.0006) [2023-12-28 00:58:24,138][106226] Updated weights for policy 0, policy_version 795701 (0.0011) [2023-12-28 00:58:24,179][106225] Updated weights for policy 1, policy_version 797910 (0.0006) [2023-12-28 00:58:24,196][106226] Updated weights for policy 0, policy_version 795711 (0.0010) [2023-12-28 00:58:24,241][106225] Updated weights for policy 1, policy_version 797920 (0.0006) [2023-12-28 00:58:24,838][106225] Updated weights for policy 1, policy_version 797930 (0.0008) [2023-12-28 00:58:24,893][106225] Updated weights for policy 1, policy_version 797940 (0.0006) [2023-12-28 00:58:24,914][106226] Updated weights for policy 0, policy_version 795721 (0.0010) [2023-12-28 00:58:24,944][106225] Updated weights for policy 1, policy_version 797950 (0.0010) [2023-12-28 00:58:24,968][106226] Updated weights for policy 0, policy_version 795731 (0.0010) [2023-12-28 00:58:24,996][106225] Updated weights for policy 1, policy_version 797960 (0.0010) [2023-12-28 00:58:25,025][106226] Updated weights for policy 0, policy_version 795741 (0.0010) [2023-12-28 00:58:25,096][106226] Updated weights for policy 0, policy_version 795751 (0.0011) [2023-12-28 00:58:25,624][106225] Updated weights for policy 1, policy_version 797970 (0.0011) [2023-12-28 00:58:25,669][106225] Updated weights for policy 1, policy_version 797980 (0.0011) [2023-12-28 00:58:25,714][106225] Updated weights for policy 1, policy_version 797990 (0.0010) [2023-12-28 00:58:25,794][106226] Updated weights for policy 0, policy_version 795761 (0.0010) [2023-12-28 00:58:25,851][106226] Updated weights for policy 0, policy_version 795771 (0.0010) [2023-12-28 00:58:25,906][106226] Updated weights for policy 0, policy_version 795781 (0.0010) [2023-12-28 00:58:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 408100864. Throughput: 0: 9955.5, 1: 9890.3. Samples: 408067588. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:26,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-4.832')] [2023-12-28 00:58:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000795784_203776000.pth... [2023-12-28 00:58:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000797992_204324864.pth... [2023-12-28 00:58:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000794632_203481088.pth [2023-12-28 00:58:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000796840_204029952.pth [2023-12-28 00:58:26,407][106225] Updated weights for policy 1, policy_version 798000 (0.0010) [2023-12-28 00:58:26,453][106225] Updated weights for policy 1, policy_version 798010 (0.0010) [2023-12-28 00:58:26,513][106225] Updated weights for policy 1, policy_version 798020 (0.0010) [2023-12-28 00:58:26,633][106226] Updated weights for policy 0, policy_version 795791 (0.0011) [2023-12-28 00:58:26,691][106226] Updated weights for policy 0, policy_version 795801 (0.0010) [2023-12-28 00:58:26,738][106226] Updated weights for policy 0, policy_version 795811 (0.0010) [2023-12-28 00:58:27,173][106225] Updated weights for policy 1, policy_version 798030 (0.0007) [2023-12-28 00:58:27,222][106225] Updated weights for policy 1, policy_version 798040 (0.0005) [2023-12-28 00:58:27,273][106225] Updated weights for policy 1, policy_version 798050 (0.0005) [2023-12-28 00:58:27,455][106226] Updated weights for policy 0, policy_version 795821 (0.0010) [2023-12-28 00:58:27,513][106226] Updated weights for policy 0, policy_version 795831 (0.0010) [2023-12-28 00:58:27,573][106226] Updated weights for policy 0, policy_version 795841 (0.0010) [2023-12-28 00:58:27,945][106225] Updated weights for policy 1, policy_version 798060 (0.0007) [2023-12-28 00:58:27,994][106225] Updated weights for policy 1, policy_version 798070 (0.0007) [2023-12-28 00:58:28,041][106225] Updated weights for policy 1, policy_version 798080 (0.0008) [2023-12-28 00:58:28,265][106226] Updated weights for policy 0, policy_version 795851 (0.0010) [2023-12-28 00:58:28,318][106226] Updated weights for policy 0, policy_version 795861 (0.0010) [2023-12-28 00:58:28,376][106226] Updated weights for policy 0, policy_version 795871 (0.0008) [2023-12-28 00:58:28,807][106225] Updated weights for policy 1, policy_version 798090 (0.0008) [2023-12-28 00:58:28,869][106225] Updated weights for policy 1, policy_version 798100 (0.0009) [2023-12-28 00:58:28,927][106225] Updated weights for policy 1, policy_version 798110 (0.0007) [2023-12-28 00:58:28,984][106225] Updated weights for policy 1, policy_version 798120 (0.0007) [2023-12-28 00:58:28,987][106226] Updated weights for policy 0, policy_version 795881 (0.0008) [2023-12-28 00:58:29,043][106226] Updated weights for policy 0, policy_version 795891 (0.0010) [2023-12-28 00:58:29,099][106226] Updated weights for policy 0, policy_version 795901 (0.0010) [2023-12-28 00:58:29,155][106226] Updated weights for policy 0, policy_version 795911 (0.0010) [2023-12-28 00:58:29,709][106225] Updated weights for policy 1, policy_version 798130 (0.0008) [2023-12-28 00:58:29,768][106225] Updated weights for policy 1, policy_version 798140 (0.0008) [2023-12-28 00:58:29,832][106225] Updated weights for policy 1, policy_version 798150 (0.0009) [2023-12-28 00:58:29,891][106226] Updated weights for policy 0, policy_version 795921 (0.0012) [2023-12-28 00:58:29,954][106226] Updated weights for policy 0, policy_version 795931 (0.0007) [2023-12-28 00:58:30,016][106226] Updated weights for policy 0, policy_version 795941 (0.0009) [2023-12-28 00:58:30,551][106225] Updated weights for policy 1, policy_version 798160 (0.0005) [2023-12-28 00:58:30,599][106226] Updated weights for policy 0, policy_version 795951 (0.0008) [2023-12-28 00:58:30,616][106225] Updated weights for policy 1, policy_version 798170 (0.0006) [2023-12-28 00:58:30,653][106226] Updated weights for policy 0, policy_version 795961 (0.0006) [2023-12-28 00:58:30,667][106225] Updated weights for policy 1, policy_version 798180 (0.0007) [2023-12-28 00:58:30,706][106226] Updated weights for policy 0, policy_version 795971 (0.0008) [2023-12-28 00:58:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 408199168. Throughput: 0: 9899.4, 1: 9987.7. Samples: 408188612. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:31,176][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.976')] [2023-12-28 00:58:31,303][106225] Updated weights for policy 1, policy_version 798190 (0.0007) [2023-12-28 00:58:31,363][106226] Updated weights for policy 0, policy_version 795981 (0.0008) [2023-12-28 00:58:31,372][106225] Updated weights for policy 1, policy_version 798200 (0.0012) [2023-12-28 00:58:31,430][106226] Updated weights for policy 0, policy_version 795991 (0.0007) [2023-12-28 00:58:31,436][106225] Updated weights for policy 1, policy_version 798210 (0.0010) [2023-12-28 00:58:31,491][106226] Updated weights for policy 0, policy_version 796001 (0.0008) [2023-12-28 00:58:32,164][106226] Updated weights for policy 0, policy_version 796011 (0.0009) [2023-12-28 00:58:32,168][106225] Updated weights for policy 1, policy_version 798220 (0.0010) [2023-12-28 00:58:32,215][106226] Updated weights for policy 0, policy_version 796021 (0.0007) [2023-12-28 00:58:32,228][106225] Updated weights for policy 1, policy_version 798230 (0.0010) [2023-12-28 00:58:32,268][106226] Updated weights for policy 0, policy_version 796031 (0.0006) [2023-12-28 00:58:32,293][106225] Updated weights for policy 1, policy_version 798240 (0.0009) [2023-12-28 00:58:32,925][106226] Updated weights for policy 0, policy_version 796041 (0.0007) [2023-12-28 00:58:32,974][106226] Updated weights for policy 0, policy_version 796051 (0.0008) [2023-12-28 00:58:33,004][106225] Updated weights for policy 1, policy_version 798250 (0.0008) [2023-12-28 00:58:33,023][106226] Updated weights for policy 0, policy_version 796061 (0.0006) [2023-12-28 00:58:33,053][106225] Updated weights for policy 1, policy_version 798260 (0.0008) [2023-12-28 00:58:33,070][106226] Updated weights for policy 0, policy_version 796071 (0.0005) [2023-12-28 00:58:33,110][106225] Updated weights for policy 1, policy_version 798270 (0.0009) [2023-12-28 00:58:33,168][106225] Updated weights for policy 1, policy_version 798280 (0.0010) [2023-12-28 00:58:33,703][106226] Updated weights for policy 0, policy_version 796081 (0.0008) [2023-12-28 00:58:33,756][106226] Updated weights for policy 0, policy_version 796091 (0.0009) [2023-12-28 00:58:33,819][106226] Updated weights for policy 0, policy_version 796101 (0.0008) [2023-12-28 00:58:33,943][106225] Updated weights for policy 1, policy_version 798290 (0.0005) [2023-12-28 00:58:34,006][106225] Updated weights for policy 1, policy_version 798300 (0.0005) [2023-12-28 00:58:34,067][106225] Updated weights for policy 1, policy_version 798310 (0.0006) [2023-12-28 00:58:34,505][106226] Updated weights for policy 0, policy_version 796111 (0.0010) [2023-12-28 00:58:34,566][106226] Updated weights for policy 0, policy_version 796121 (0.0011) [2023-12-28 00:58:34,624][106226] Updated weights for policy 0, policy_version 796131 (0.0010) [2023-12-28 00:58:34,685][106225] Updated weights for policy 1, policy_version 798320 (0.0008) [2023-12-28 00:58:34,728][106225] Updated weights for policy 1, policy_version 798330 (0.0007) [2023-12-28 00:58:34,788][106225] Updated weights for policy 1, policy_version 798340 (0.0008) [2023-12-28 00:58:35,340][106226] Updated weights for policy 0, policy_version 796141 (0.0011) [2023-12-28 00:58:35,399][106226] Updated weights for policy 0, policy_version 796151 (0.0010) [2023-12-28 00:58:35,452][106226] Updated weights for policy 0, policy_version 796161 (0.0010) [2023-12-28 00:58:35,558][106225] Updated weights for policy 1, policy_version 798350 (0.0007) [2023-12-28 00:58:35,611][106225] Updated weights for policy 1, policy_version 798360 (0.0005) [2023-12-28 00:58:35,675][106225] Updated weights for policy 1, policy_version 798370 (0.0007) [2023-12-28 00:58:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 408297472. Throughput: 0: 9962.9, 1: 9967.7. Samples: 408310868. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:36,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-4.963')] [2023-12-28 00:58:36,184][106226] Updated weights for policy 0, policy_version 796171 (0.0010) [2023-12-28 00:58:36,240][106226] Updated weights for policy 0, policy_version 796181 (0.0011) [2023-12-28 00:58:36,295][106226] Updated weights for policy 0, policy_version 796191 (0.0010) [2023-12-28 00:58:36,401][106225] Updated weights for policy 1, policy_version 798380 (0.0007) [2023-12-28 00:58:36,470][106225] Updated weights for policy 1, policy_version 798390 (0.0007) [2023-12-28 00:58:36,529][106225] Updated weights for policy 1, policy_version 798400 (0.0008) [2023-12-28 00:58:37,037][106226] Updated weights for policy 0, policy_version 796201 (0.0010) [2023-12-28 00:58:37,093][106226] Updated weights for policy 0, policy_version 796211 (0.0009) [2023-12-28 00:58:37,153][106226] Updated weights for policy 0, policy_version 796221 (0.0007) [2023-12-28 00:58:37,199][106225] Updated weights for policy 1, policy_version 798410 (0.0005) [2023-12-28 00:58:37,209][106226] Updated weights for policy 0, policy_version 796231 (0.0007) [2023-12-28 00:58:37,253][106225] Updated weights for policy 1, policy_version 798420 (0.0007) [2023-12-28 00:58:37,302][106225] Updated weights for policy 1, policy_version 798430 (0.0008) [2023-12-28 00:58:37,350][106225] Updated weights for policy 1, policy_version 798440 (0.0009) [2023-12-28 00:58:37,904][106226] Updated weights for policy 0, policy_version 796241 (0.0007) [2023-12-28 00:58:37,958][106226] Updated weights for policy 0, policy_version 796251 (0.0008) [2023-12-28 00:58:38,012][106226] Updated weights for policy 0, policy_version 796261 (0.0007) [2023-12-28 00:58:38,089][106225] Updated weights for policy 1, policy_version 798450 (0.0010) [2023-12-28 00:58:38,142][106225] Updated weights for policy 1, policy_version 798460 (0.0010) [2023-12-28 00:58:38,198][106225] Updated weights for policy 1, policy_version 798470 (0.0010) [2023-12-28 00:58:38,796][106226] Updated weights for policy 0, policy_version 796271 (0.0009) [2023-12-28 00:58:38,862][106226] Updated weights for policy 0, policy_version 796281 (0.0007) [2023-12-28 00:58:38,862][106225] Updated weights for policy 1, policy_version 798480 (0.0007) [2023-12-28 00:58:38,925][106226] Updated weights for policy 0, policy_version 796291 (0.0006) [2023-12-28 00:58:38,926][106225] Updated weights for policy 1, policy_version 798490 (0.0008) [2023-12-28 00:58:38,988][106225] Updated weights for policy 1, policy_version 798500 (0.0008) [2023-12-28 00:58:39,684][106226] Updated weights for policy 0, policy_version 796301 (0.0009) [2023-12-28 00:58:39,744][106225] Updated weights for policy 1, policy_version 798510 (0.0007) [2023-12-28 00:58:39,746][106226] Updated weights for policy 0, policy_version 796311 (0.0007) [2023-12-28 00:58:39,805][106225] Updated weights for policy 1, policy_version 798520 (0.0008) [2023-12-28 00:58:39,807][106226] Updated weights for policy 0, policy_version 796321 (0.0006) [2023-12-28 00:58:39,868][106225] Updated weights for policy 1, policy_version 798530 (0.0009) [2023-12-28 00:58:40,584][106225] Updated weights for policy 1, policy_version 798540 (0.0009) [2023-12-28 00:58:40,589][106226] Updated weights for policy 0, policy_version 796331 (0.0007) [2023-12-28 00:58:40,629][106225] Updated weights for policy 1, policy_version 798550 (0.0008) [2023-12-28 00:58:40,650][106226] Updated weights for policy 0, policy_version 796341 (0.0008) [2023-12-28 00:58:40,678][106225] Updated weights for policy 1, policy_version 798560 (0.0007) [2023-12-28 00:58:40,707][106226] Updated weights for policy 0, policy_version 796351 (0.0007) [2023-12-28 00:58:41,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 408395776. Throughput: 0: 9926.6, 1: 10014.7. Samples: 408369064. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:41,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.033')] [2023-12-28 00:58:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000798568_204472320.pth... [2023-12-28 00:58:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000796360_203923456.pth... [2023-12-28 00:58:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000795208_203628544.pth [2023-12-28 00:58:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000797416_204177408.pth [2023-12-28 00:58:41,388][106226] Updated weights for policy 0, policy_version 796361 (0.0008) [2023-12-28 00:58:41,410][106225] Updated weights for policy 1, policy_version 798570 (0.0006) [2023-12-28 00:58:41,455][106226] Updated weights for policy 0, policy_version 796371 (0.0006) [2023-12-28 00:58:41,477][106225] Updated weights for policy 1, policy_version 798580 (0.0007) [2023-12-28 00:58:41,523][106226] Updated weights for policy 0, policy_version 796381 (0.0006) [2023-12-28 00:58:41,538][106225] Updated weights for policy 1, policy_version 798590 (0.0008) [2023-12-28 00:58:41,578][106226] Updated weights for policy 0, policy_version 796391 (0.0008) [2023-12-28 00:58:41,601][106225] Updated weights for policy 1, policy_version 798600 (0.0008) [2023-12-28 00:58:42,255][106226] Updated weights for policy 0, policy_version 796401 (0.0008) [2023-12-28 00:58:42,317][106226] Updated weights for policy 0, policy_version 796411 (0.0008) [2023-12-28 00:58:42,385][106226] Updated weights for policy 0, policy_version 796421 (0.0010) [2023-12-28 00:58:42,399][106225] Updated weights for policy 1, policy_version 798610 (0.0007) [2023-12-28 00:58:42,461][106225] Updated weights for policy 1, policy_version 798620 (0.0009) [2023-12-28 00:58:42,529][106225] Updated weights for policy 1, policy_version 798630 (0.0008) [2023-12-28 00:58:43,064][106226] Updated weights for policy 0, policy_version 796431 (0.0007) [2023-12-28 00:58:43,115][106226] Updated weights for policy 0, policy_version 796441 (0.0008) [2023-12-28 00:58:43,170][106226] Updated weights for policy 0, policy_version 796451 (0.0008) [2023-12-28 00:58:43,264][106225] Updated weights for policy 1, policy_version 798640 (0.0010) [2023-12-28 00:58:43,329][106225] Updated weights for policy 1, policy_version 798650 (0.0010) [2023-12-28 00:58:43,378][106225] Updated weights for policy 1, policy_version 798660 (0.0010) [2023-12-28 00:58:43,896][106226] Updated weights for policy 0, policy_version 796461 (0.0007) [2023-12-28 00:58:43,955][106226] Updated weights for policy 0, policy_version 796471 (0.0005) [2023-12-28 00:58:44,013][106226] Updated weights for policy 0, policy_version 796481 (0.0007) [2023-12-28 00:58:44,085][106225] Updated weights for policy 1, policy_version 798670 (0.0008) [2023-12-28 00:58:44,153][106225] Updated weights for policy 1, policy_version 798680 (0.0006) [2023-12-28 00:58:44,212][106225] Updated weights for policy 1, policy_version 798690 (0.0006) [2023-12-28 00:58:44,612][106226] Updated weights for policy 0, policy_version 796491 (0.0007) [2023-12-28 00:58:44,660][106226] Updated weights for policy 0, policy_version 796501 (0.0005) [2023-12-28 00:58:44,716][106226] Updated weights for policy 0, policy_version 796511 (0.0005) [2023-12-28 00:58:44,806][106225] Updated weights for policy 1, policy_version 798700 (0.0008) [2023-12-28 00:58:44,859][106225] Updated weights for policy 1, policy_version 798710 (0.0009) [2023-12-28 00:58:44,920][106225] Updated weights for policy 1, policy_version 798720 (0.0008) [2023-12-28 00:58:45,398][106226] Updated weights for policy 0, policy_version 796521 (0.0006) [2023-12-28 00:58:45,461][106226] Updated weights for policy 0, policy_version 796531 (0.0009) [2023-12-28 00:58:45,517][106226] Updated weights for policy 0, policy_version 796541 (0.0008) [2023-12-28 00:58:45,573][106226] Updated weights for policy 0, policy_version 796551 (0.0005) [2023-12-28 00:58:45,688][106225] Updated weights for policy 1, policy_version 798730 (0.0009) [2023-12-28 00:58:45,746][106225] Updated weights for policy 1, policy_version 798740 (0.0008) [2023-12-28 00:58:45,807][106225] Updated weights for policy 1, policy_version 798750 (0.0008) [2023-12-28 00:58:45,861][106225] Updated weights for policy 1, policy_version 798760 (0.0008) [2023-12-28 00:58:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 408494080. Throughput: 0: 9916.8, 1: 9961.4. Samples: 408486072. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:46,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-5.204')] [2023-12-28 00:58:46,183][106226] Updated weights for policy 0, policy_version 796561 (0.0006) [2023-12-28 00:58:46,239][106226] Updated weights for policy 0, policy_version 796571 (0.0009) [2023-12-28 00:58:46,304][106226] Updated weights for policy 0, policy_version 796581 (0.0008) [2023-12-28 00:58:46,624][106225] Updated weights for policy 1, policy_version 798770 (0.0008) [2023-12-28 00:58:46,688][106225] Updated weights for policy 1, policy_version 798780 (0.0009) [2023-12-28 00:58:46,749][106225] Updated weights for policy 1, policy_version 798790 (0.0008) [2023-12-28 00:58:46,997][106226] Updated weights for policy 0, policy_version 796591 (0.0008) [2023-12-28 00:58:47,062][106226] Updated weights for policy 0, policy_version 796601 (0.0008) [2023-12-28 00:58:47,121][106226] Updated weights for policy 0, policy_version 796611 (0.0008) [2023-12-28 00:58:47,448][106225] Updated weights for policy 1, policy_version 798800 (0.0007) [2023-12-28 00:58:47,492][106225] Updated weights for policy 1, policy_version 798810 (0.0008) [2023-12-28 00:58:47,548][106225] Updated weights for policy 1, policy_version 798820 (0.0009) [2023-12-28 00:58:47,843][106226] Updated weights for policy 0, policy_version 796621 (0.0009) [2023-12-28 00:58:47,905][106226] Updated weights for policy 0, policy_version 796631 (0.0009) [2023-12-28 00:58:47,967][106226] Updated weights for policy 0, policy_version 796641 (0.0010) [2023-12-28 00:58:48,197][106225] Updated weights for policy 1, policy_version 798830 (0.0009) [2023-12-28 00:58:48,252][106225] Updated weights for policy 1, policy_version 798840 (0.0008) [2023-12-28 00:58:48,315][106225] Updated weights for policy 1, policy_version 798850 (0.0007) [2023-12-28 00:58:48,671][106226] Updated weights for policy 0, policy_version 796651 (0.0010) [2023-12-28 00:58:48,732][106226] Updated weights for policy 0, policy_version 796661 (0.0009) [2023-12-28 00:58:48,794][106226] Updated weights for policy 0, policy_version 796671 (0.0009) [2023-12-28 00:58:49,026][106225] Updated weights for policy 1, policy_version 798860 (0.0009) [2023-12-28 00:58:49,093][106225] Updated weights for policy 1, policy_version 798870 (0.0009) [2023-12-28 00:58:49,147][106225] Updated weights for policy 1, policy_version 798880 (0.0008) [2023-12-28 00:58:49,457][106226] Updated weights for policy 0, policy_version 796681 (0.0008) [2023-12-28 00:58:49,523][106226] Updated weights for policy 0, policy_version 796691 (0.0009) [2023-12-28 00:58:49,587][106226] Updated weights for policy 0, policy_version 796701 (0.0008) [2023-12-28 00:58:49,656][106226] Updated weights for policy 0, policy_version 796711 (0.0008) [2023-12-28 00:58:49,997][106225] Updated weights for policy 1, policy_version 798890 (0.0009) [2023-12-28 00:58:50,064][106225] Updated weights for policy 1, policy_version 798900 (0.0008) [2023-12-28 00:58:50,126][106225] Updated weights for policy 1, policy_version 798910 (0.0010) [2023-12-28 00:58:50,191][106225] Updated weights for policy 1, policy_version 798920 (0.0008) [2023-12-28 00:58:50,366][106226] Updated weights for policy 0, policy_version 796721 (0.0009) [2023-12-28 00:58:50,432][106226] Updated weights for policy 0, policy_version 796731 (0.0009) [2023-12-28 00:58:50,490][106226] Updated weights for policy 0, policy_version 796741 (0.0011) [2023-12-28 00:58:50,887][106225] Updated weights for policy 1, policy_version 798930 (0.0008) [2023-12-28 00:58:50,947][106225] Updated weights for policy 1, policy_version 798940 (0.0010) [2023-12-28 00:58:51,008][106225] Updated weights for policy 1, policy_version 798950 (0.0009) [2023-12-28 00:58:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 408592384. Throughput: 0: 9903.1, 1: 9814.3. Samples: 408602296. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:51,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.985')] [2023-12-28 00:58:51,225][106226] Updated weights for policy 0, policy_version 796751 (0.0007) [2023-12-28 00:58:51,285][106226] Updated weights for policy 0, policy_version 796761 (0.0008) [2023-12-28 00:58:51,360][106226] Updated weights for policy 0, policy_version 796771 (0.0009) [2023-12-28 00:58:51,689][106225] Updated weights for policy 1, policy_version 798960 (0.0008) [2023-12-28 00:58:51,759][106225] Updated weights for policy 1, policy_version 798970 (0.0008) [2023-12-28 00:58:51,825][106225] Updated weights for policy 1, policy_version 798980 (0.0008) [2023-12-28 00:58:52,047][106226] Updated weights for policy 0, policy_version 796781 (0.0009) [2023-12-28 00:58:52,103][106226] Updated weights for policy 0, policy_version 796791 (0.0009) [2023-12-28 00:58:52,161][106226] Updated weights for policy 0, policy_version 796801 (0.0009) [2023-12-28 00:58:52,575][106225] Updated weights for policy 1, policy_version 798990 (0.0008) [2023-12-28 00:58:52,635][106225] Updated weights for policy 1, policy_version 799000 (0.0008) [2023-12-28 00:58:52,704][106225] Updated weights for policy 1, policy_version 799010 (0.0008) [2023-12-28 00:58:52,942][106226] Updated weights for policy 0, policy_version 796811 (0.0009) [2023-12-28 00:58:52,995][106226] Updated weights for policy 0, policy_version 796821 (0.0009) [2023-12-28 00:58:53,047][106226] Updated weights for policy 0, policy_version 796831 (0.0009) [2023-12-28 00:58:53,421][106225] Updated weights for policy 1, policy_version 799020 (0.0008) [2023-12-28 00:58:53,484][106225] Updated weights for policy 1, policy_version 799030 (0.0008) [2023-12-28 00:58:53,541][106225] Updated weights for policy 1, policy_version 799040 (0.0009) [2023-12-28 00:58:53,795][106226] Updated weights for policy 0, policy_version 796841 (0.0008) [2023-12-28 00:58:53,848][106226] Updated weights for policy 0, policy_version 796851 (0.0008) [2023-12-28 00:58:53,904][106226] Updated weights for policy 0, policy_version 796861 (0.0009) [2023-12-28 00:58:53,968][106226] Updated weights for policy 0, policy_version 796871 (0.0008) [2023-12-28 00:58:54,279][106225] Updated weights for policy 1, policy_version 799050 (0.0009) [2023-12-28 00:58:54,333][106225] Updated weights for policy 1, policy_version 799060 (0.0007) [2023-12-28 00:58:54,397][106225] Updated weights for policy 1, policy_version 799070 (0.0007) [2023-12-28 00:58:54,460][106225] Updated weights for policy 1, policy_version 799080 (0.0008) [2023-12-28 00:58:54,689][106226] Updated weights for policy 0, policy_version 796881 (0.0006) [2023-12-28 00:58:54,737][106226] Updated weights for policy 0, policy_version 796891 (0.0006) [2023-12-28 00:58:54,790][106226] Updated weights for policy 0, policy_version 796901 (0.0009) [2023-12-28 00:58:55,191][106225] Updated weights for policy 1, policy_version 799090 (0.0006) [2023-12-28 00:58:55,254][106225] Updated weights for policy 1, policy_version 799100 (0.0006) [2023-12-28 00:58:55,320][106225] Updated weights for policy 1, policy_version 799110 (0.0006) [2023-12-28 00:58:55,415][106226] Updated weights for policy 0, policy_version 796911 (0.0006) [2023-12-28 00:58:55,484][106226] Updated weights for policy 0, policy_version 796921 (0.0005) [2023-12-28 00:58:55,550][106226] Updated weights for policy 0, policy_version 796931 (0.0005) [2023-12-28 00:58:56,051][106226] Updated weights for policy 0, policy_version 796941 (0.0006) [2023-12-28 00:58:56,051][106225] Updated weights for policy 1, policy_version 799120 (0.0009) [2023-12-28 00:58:56,112][106225] Updated weights for policy 1, policy_version 799130 (0.0008) [2023-12-28 00:58:56,120][106226] Updated weights for policy 0, policy_version 796951 (0.0005) [2023-12-28 00:58:56,171][106225] Updated weights for policy 1, policy_version 799140 (0.0009) [2023-12-28 00:58:56,175][105115] Fps is (10 sec: 18840.8, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 408682496. Throughput: 0: 9878.9, 1: 9798.5. Samples: 408658772. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:58:56,176][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.920')] [2023-12-28 00:58:56,186][106226] Updated weights for policy 0, policy_version 796961 (0.0009) [2023-12-28 00:58:56,195][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000799144_204619776.pth... [2023-12-28 00:58:56,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000797992_204324864.pth [2023-12-28 00:58:56,228][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000796968_204079104.pth... [2023-12-28 00:58:56,231][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000795784_203776000.pth [2023-12-28 00:58:56,827][106226] Updated weights for policy 0, policy_version 796971 (0.0010) [2023-12-28 00:58:56,887][106226] Updated weights for policy 0, policy_version 796981 (0.0005) [2023-12-28 00:58:56,898][106225] Updated weights for policy 1, policy_version 799150 (0.0008) [2023-12-28 00:58:56,940][106226] Updated weights for policy 0, policy_version 796991 (0.0005) [2023-12-28 00:58:56,958][106225] Updated weights for policy 1, policy_version 799160 (0.0009) [2023-12-28 00:58:57,015][106225] Updated weights for policy 1, policy_version 799170 (0.0008) [2023-12-28 00:58:57,497][106226] Updated weights for policy 0, policy_version 797001 (0.0006) [2023-12-28 00:58:57,546][106226] Updated weights for policy 0, policy_version 797011 (0.0010) [2023-12-28 00:58:57,599][106226] Updated weights for policy 0, policy_version 797021 (0.0010) [2023-12-28 00:58:57,645][106226] Updated weights for policy 0, policy_version 797031 (0.0010) [2023-12-28 00:58:57,756][106225] Updated weights for policy 1, policy_version 799180 (0.0007) [2023-12-28 00:58:57,809][106225] Updated weights for policy 1, policy_version 799190 (0.0009) [2023-12-28 00:58:57,864][106225] Updated weights for policy 1, policy_version 799200 (0.0006) [2023-12-28 00:58:58,228][106226] Updated weights for policy 0, policy_version 797041 (0.0006) [2023-12-28 00:58:58,288][106226] Updated weights for policy 0, policy_version 797051 (0.0007) [2023-12-28 00:58:58,352][106226] Updated weights for policy 0, policy_version 797061 (0.0010) [2023-12-28 00:58:58,659][106225] Updated weights for policy 1, policy_version 799210 (0.0006) [2023-12-28 00:58:58,721][106225] Updated weights for policy 1, policy_version 799220 (0.0009) [2023-12-28 00:58:58,789][106225] Updated weights for policy 1, policy_version 799230 (0.0009) [2023-12-28 00:58:58,866][106225] Updated weights for policy 1, policy_version 799240 (0.0008) [2023-12-28 00:58:59,148][106226] Updated weights for policy 0, policy_version 797071 (0.0009) [2023-12-28 00:58:59,194][106226] Updated weights for policy 0, policy_version 797081 (0.0009) [2023-12-28 00:58:59,267][106226] Updated weights for policy 0, policy_version 797091 (0.0009) [2023-12-28 00:58:59,669][106225] Updated weights for policy 1, policy_version 799250 (0.0008) [2023-12-28 00:58:59,731][106225] Updated weights for policy 1, policy_version 799260 (0.0008) [2023-12-28 00:58:59,786][106225] Updated weights for policy 1, policy_version 799270 (0.0008) [2023-12-28 00:59:00,054][106226] Updated weights for policy 0, policy_version 797101 (0.0009) [2023-12-28 00:59:00,118][106226] Updated weights for policy 0, policy_version 797111 (0.0008) [2023-12-28 00:59:00,164][106226] Updated weights for policy 0, policy_version 797121 (0.0008) [2023-12-28 00:59:00,542][106225] Updated weights for policy 1, policy_version 799280 (0.0008) [2023-12-28 00:59:00,592][106225] Updated weights for policy 1, policy_version 799290 (0.0008) [2023-12-28 00:59:00,644][106225] Updated weights for policy 1, policy_version 799300 (0.0008) [2023-12-28 00:59:00,852][106226] Updated weights for policy 0, policy_version 797131 (0.0009) [2023-12-28 00:59:00,908][106226] Updated weights for policy 0, policy_version 797141 (0.0007) [2023-12-28 00:59:00,965][106226] Updated weights for policy 0, policy_version 797151 (0.0005) [2023-12-28 00:59:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 408788992. Throughput: 0: 9998.0, 1: 9744.7. Samples: 408777812. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:01,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-5.100')] [2023-12-28 00:59:01,442][106225] Updated weights for policy 1, policy_version 799310 (0.0008) [2023-12-28 00:59:01,498][106225] Updated weights for policy 1, policy_version 799320 (0.0008) [2023-12-28 00:59:01,556][106225] Updated weights for policy 1, policy_version 799330 (0.0008) [2023-12-28 00:59:01,668][106226] Updated weights for policy 0, policy_version 797161 (0.0009) [2023-12-28 00:59:01,736][106226] Updated weights for policy 0, policy_version 797171 (0.0008) [2023-12-28 00:59:01,802][106226] Updated weights for policy 0, policy_version 797181 (0.0008) [2023-12-28 00:59:01,858][106226] Updated weights for policy 0, policy_version 797191 (0.0008) [2023-12-28 00:59:02,321][106225] Updated weights for policy 1, policy_version 799340 (0.0009) [2023-12-28 00:59:02,394][106225] Updated weights for policy 1, policy_version 799350 (0.0008) [2023-12-28 00:59:02,458][106225] Updated weights for policy 1, policy_version 799360 (0.0006) [2023-12-28 00:59:02,619][106226] Updated weights for policy 0, policy_version 797201 (0.0008) [2023-12-28 00:59:02,677][106226] Updated weights for policy 0, policy_version 797211 (0.0008) [2023-12-28 00:59:02,726][106226] Updated weights for policy 0, policy_version 797221 (0.0008) [2023-12-28 00:59:03,151][106225] Updated weights for policy 1, policy_version 799370 (0.0008) [2023-12-28 00:59:03,203][106225] Updated weights for policy 1, policy_version 799380 (0.0005) [2023-12-28 00:59:03,257][106225] Updated weights for policy 1, policy_version 799390 (0.0005) [2023-12-28 00:59:03,308][106225] Updated weights for policy 1, policy_version 799400 (0.0005) [2023-12-28 00:59:03,387][106226] Updated weights for policy 0, policy_version 797231 (0.0008) [2023-12-28 00:59:03,434][106226] Updated weights for policy 0, policy_version 797241 (0.0009) [2023-12-28 00:59:03,489][106226] Updated weights for policy 0, policy_version 797251 (0.0009) [2023-12-28 00:59:03,964][106225] Updated weights for policy 1, policy_version 799410 (0.0009) [2023-12-28 00:59:04,026][106225] Updated weights for policy 1, policy_version 799420 (0.0008) [2023-12-28 00:59:04,087][106225] Updated weights for policy 1, policy_version 799430 (0.0009) [2023-12-28 00:59:04,249][106226] Updated weights for policy 0, policy_version 797261 (0.0009) [2023-12-28 00:59:04,315][106226] Updated weights for policy 0, policy_version 797271 (0.0009) [2023-12-28 00:59:04,378][106226] Updated weights for policy 0, policy_version 797281 (0.0008) [2023-12-28 00:59:04,793][106225] Updated weights for policy 1, policy_version 799440 (0.0008) [2023-12-28 00:59:04,850][106225] Updated weights for policy 1, policy_version 799450 (0.0005) [2023-12-28 00:59:04,904][106225] Updated weights for policy 1, policy_version 799460 (0.0008) [2023-12-28 00:59:05,026][106226] Updated weights for policy 0, policy_version 797291 (0.0008) [2023-12-28 00:59:05,072][106226] Updated weights for policy 0, policy_version 797301 (0.0008) [2023-12-28 00:59:05,118][106226] Updated weights for policy 0, policy_version 797311 (0.0009) [2023-12-28 00:59:05,555][106225] Updated weights for policy 1, policy_version 799470 (0.0006) [2023-12-28 00:59:05,611][106225] Updated weights for policy 1, policy_version 799480 (0.0009) [2023-12-28 00:59:05,668][106225] Updated weights for policy 1, policy_version 799490 (0.0005) [2023-12-28 00:59:05,804][106226] Updated weights for policy 0, policy_version 797321 (0.0008) [2023-12-28 00:59:05,858][106226] Updated weights for policy 0, policy_version 797331 (0.0008) [2023-12-28 00:59:05,905][106226] Updated weights for policy 0, policy_version 797341 (0.0008) [2023-12-28 00:59:05,954][106226] Updated weights for policy 0, policy_version 797351 (0.0005) [2023-12-28 00:59:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 408887296. Throughput: 0: 9973.3, 1: 9727.0. Samples: 408897144. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:06,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.968')] [2023-12-28 00:59:06,248][106225] Updated weights for policy 1, policy_version 799500 (0.0009) [2023-12-28 00:59:06,310][106225] Updated weights for policy 1, policy_version 799510 (0.0011) [2023-12-28 00:59:06,366][106225] Updated weights for policy 1, policy_version 799520 (0.0010) [2023-12-28 00:59:06,677][106226] Updated weights for policy 0, policy_version 797361 (0.0008) [2023-12-28 00:59:06,743][106226] Updated weights for policy 0, policy_version 797371 (0.0008) [2023-12-28 00:59:06,801][106226] Updated weights for policy 0, policy_version 797381 (0.0008) [2023-12-28 00:59:07,089][106225] Updated weights for policy 1, policy_version 799530 (0.0010) [2023-12-28 00:59:07,142][106225] Updated weights for policy 1, policy_version 799540 (0.0008) [2023-12-28 00:59:07,199][106225] Updated weights for policy 1, policy_version 799550 (0.0007) [2023-12-28 00:59:07,255][106225] Updated weights for policy 1, policy_version 799560 (0.0008) [2023-12-28 00:59:07,582][106226] Updated weights for policy 0, policy_version 797391 (0.0006) [2023-12-28 00:59:07,633][106226] Updated weights for policy 0, policy_version 797401 (0.0008) [2023-12-28 00:59:07,682][106226] Updated weights for policy 0, policy_version 797411 (0.0009) [2023-12-28 00:59:07,890][106225] Updated weights for policy 1, policy_version 799570 (0.0008) [2023-12-28 00:59:07,947][106225] Updated weights for policy 1, policy_version 799580 (0.0006) [2023-12-28 00:59:08,003][106225] Updated weights for policy 1, policy_version 799590 (0.0006) [2023-12-28 00:59:08,444][106226] Updated weights for policy 0, policy_version 797421 (0.0008) [2023-12-28 00:59:08,515][106226] Updated weights for policy 0, policy_version 797431 (0.0009) [2023-12-28 00:59:08,575][106226] Updated weights for policy 0, policy_version 797441 (0.0009) [2023-12-28 00:59:08,685][106225] Updated weights for policy 1, policy_version 799600 (0.0009) [2023-12-28 00:59:08,748][106225] Updated weights for policy 1, policy_version 799610 (0.0008) [2023-12-28 00:59:08,807][106225] Updated weights for policy 1, policy_version 799620 (0.0008) [2023-12-28 00:59:09,297][106226] Updated weights for policy 0, policy_version 797451 (0.0009) [2023-12-28 00:59:09,371][106226] Updated weights for policy 0, policy_version 797461 (0.0009) [2023-12-28 00:59:09,446][106226] Updated weights for policy 0, policy_version 797471 (0.0008) [2023-12-28 00:59:09,605][106225] Updated weights for policy 1, policy_version 799630 (0.0009) [2023-12-28 00:59:09,663][106225] Updated weights for policy 1, policy_version 799640 (0.0007) [2023-12-28 00:59:09,711][106225] Updated weights for policy 1, policy_version 799650 (0.0008) [2023-12-28 00:59:10,110][106226] Updated weights for policy 0, policy_version 797481 (0.0009) [2023-12-28 00:59:10,171][106226] Updated weights for policy 0, policy_version 797491 (0.0010) [2023-12-28 00:59:10,235][106226] Updated weights for policy 0, policy_version 797501 (0.0011) [2023-12-28 00:59:10,296][106226] Updated weights for policy 0, policy_version 797511 (0.0011) [2023-12-28 00:59:10,449][106225] Updated weights for policy 1, policy_version 799660 (0.0008) [2023-12-28 00:59:10,510][106225] Updated weights for policy 1, policy_version 799670 (0.0011) [2023-12-28 00:59:10,572][106225] Updated weights for policy 1, policy_version 799680 (0.0010) [2023-12-28 00:59:11,045][106226] Updated weights for policy 0, policy_version 797521 (0.0009) [2023-12-28 00:59:11,113][106226] Updated weights for policy 0, policy_version 797531 (0.0007) [2023-12-28 00:59:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 408977408. Throughput: 0: 9967.4, 1: 9781.2. Samples: 408956276. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:11,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-5.171')] [2023-12-28 00:59:11,183][106226] Updated weights for policy 0, policy_version 797541 (0.0008) [2023-12-28 00:59:11,201][106225] Updated weights for policy 1, policy_version 799690 (0.0009) [2023-12-28 00:59:11,203][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000797544_204226560.pth... [2023-12-28 00:59:11,206][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000796360_203923456.pth [2023-12-28 00:59:11,271][106225] Updated weights for policy 1, policy_version 799700 (0.0012) [2023-12-28 00:59:11,338][106225] Updated weights for policy 1, policy_version 799710 (0.0010) [2023-12-28 00:59:11,409][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000799720_204767232.pth... [2023-12-28 00:59:11,409][106225] Updated weights for policy 1, policy_version 799720 (0.0009) [2023-12-28 00:59:11,414][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000798568_204472320.pth [2023-12-28 00:59:11,946][106226] Updated weights for policy 0, policy_version 797551 (0.0008) [2023-12-28 00:59:12,002][106226] Updated weights for policy 0, policy_version 797561 (0.0007) [2023-12-28 00:59:12,063][106226] Updated weights for policy 0, policy_version 797571 (0.0009) [2023-12-28 00:59:12,144][106225] Updated weights for policy 1, policy_version 799730 (0.0008) [2023-12-28 00:59:12,203][106225] Updated weights for policy 1, policy_version 799740 (0.0008) [2023-12-28 00:59:12,268][106225] Updated weights for policy 1, policy_version 799750 (0.0008) [2023-12-28 00:59:12,846][106226] Updated weights for policy 0, policy_version 797581 (0.0009) [2023-12-28 00:59:12,898][106226] Updated weights for policy 0, policy_version 797591 (0.0008) [2023-12-28 00:59:12,960][106226] Updated weights for policy 0, policy_version 797601 (0.0006) [2023-12-28 00:59:12,961][106225] Updated weights for policy 1, policy_version 799760 (0.0009) [2023-12-28 00:59:13,018][106225] Updated weights for policy 1, policy_version 799770 (0.0007) [2023-12-28 00:59:13,079][106225] Updated weights for policy 1, policy_version 799780 (0.0008) [2023-12-28 00:59:13,632][106225] Updated weights for policy 1, policy_version 799790 (0.0007) [2023-12-28 00:59:13,694][106226] Updated weights for policy 0, policy_version 797611 (0.0006) [2023-12-28 00:59:13,695][106225] Updated weights for policy 1, policy_version 799800 (0.0007) [2023-12-28 00:59:13,745][106225] Updated weights for policy 1, policy_version 799810 (0.0010) [2023-12-28 00:59:13,750][106226] Updated weights for policy 0, policy_version 797621 (0.0005) [2023-12-28 00:59:13,806][106226] Updated weights for policy 0, policy_version 797631 (0.0007) [2023-12-28 00:59:14,382][106225] Updated weights for policy 1, policy_version 799820 (0.0008) [2023-12-28 00:59:14,430][106225] Updated weights for policy 1, policy_version 799830 (0.0005) [2023-12-28 00:59:14,481][106225] Updated weights for policy 1, policy_version 799840 (0.0005) [2023-12-28 00:59:14,572][106226] Updated weights for policy 0, policy_version 797641 (0.0008) [2023-12-28 00:59:14,637][106226] Updated weights for policy 0, policy_version 797651 (0.0010) [2023-12-28 00:59:14,701][106226] Updated weights for policy 0, policy_version 797661 (0.0007) [2023-12-28 00:59:14,759][106226] Updated weights for policy 0, policy_version 797671 (0.0006) [2023-12-28 00:59:15,154][106225] Updated weights for policy 1, policy_version 799850 (0.0005) [2023-12-28 00:59:15,228][106225] Updated weights for policy 1, policy_version 799860 (0.0008) [2023-12-28 00:59:15,289][106225] Updated weights for policy 1, policy_version 799870 (0.0008) [2023-12-28 00:59:15,350][106225] Updated weights for policy 1, policy_version 799880 (0.0007) [2023-12-28 00:59:15,380][106226] Updated weights for policy 0, policy_version 797681 (0.0006) [2023-12-28 00:59:15,445][106226] Updated weights for policy 0, policy_version 797691 (0.0007) [2023-12-28 00:59:15,511][106226] Updated weights for policy 0, policy_version 797701 (0.0008) [2023-12-28 00:59:16,118][106225] Updated weights for policy 1, policy_version 799890 (0.0007) [2023-12-28 00:59:16,129][106226] Updated weights for policy 0, policy_version 797711 (0.0009) [2023-12-28 00:59:16,169][106225] Updated weights for policy 1, policy_version 799900 (0.0007) [2023-12-28 00:59:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 409075712. Throughput: 0: 9916.7, 1: 9744.7. Samples: 409073376. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:16,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-4.909')] [2023-12-28 00:59:16,178][106226] Updated weights for policy 0, policy_version 797721 (0.0009) [2023-12-28 00:59:16,218][106225] Updated weights for policy 1, policy_version 799910 (0.0008) [2023-12-28 00:59:16,226][106226] Updated weights for policy 0, policy_version 797731 (0.0007) [2023-12-28 00:59:16,824][106226] Updated weights for policy 0, policy_version 797741 (0.0007) [2023-12-28 00:59:16,829][106225] Updated weights for policy 1, policy_version 799920 (0.0006) [2023-12-28 00:59:16,888][106226] Updated weights for policy 0, policy_version 797751 (0.0008) [2023-12-28 00:59:16,896][106225] Updated weights for policy 1, policy_version 799930 (0.0006) [2023-12-28 00:59:16,938][106226] Updated weights for policy 0, policy_version 797761 (0.0010) [2023-12-28 00:59:16,943][106225] Updated weights for policy 1, policy_version 799940 (0.0006) [2023-12-28 00:59:17,555][106226] Updated weights for policy 0, policy_version 797771 (0.0006) [2023-12-28 00:59:17,561][106225] Updated weights for policy 1, policy_version 799950 (0.0007) [2023-12-28 00:59:17,602][106226] Updated weights for policy 0, policy_version 797781 (0.0006) [2023-12-28 00:59:17,619][106225] Updated weights for policy 1, policy_version 799960 (0.0008) [2023-12-28 00:59:17,656][106226] Updated weights for policy 0, policy_version 797791 (0.0006) [2023-12-28 00:59:17,677][106225] Updated weights for policy 1, policy_version 799970 (0.0007) [2023-12-28 00:59:18,375][106226] Updated weights for policy 0, policy_version 797801 (0.0007) [2023-12-28 00:59:18,422][106225] Updated weights for policy 1, policy_version 799980 (0.0007) [2023-12-28 00:59:18,435][106226] Updated weights for policy 0, policy_version 797811 (0.0009) [2023-12-28 00:59:18,483][106225] Updated weights for policy 1, policy_version 799990 (0.0007) [2023-12-28 00:59:18,493][106226] Updated weights for policy 0, policy_version 797821 (0.0007) [2023-12-28 00:59:18,541][106225] Updated weights for policy 1, policy_version 800000 (0.0007) [2023-12-28 00:59:18,556][106226] Updated weights for policy 0, policy_version 797831 (0.0007) [2023-12-28 00:59:19,168][106226] Updated weights for policy 0, policy_version 797841 (0.0006) [2023-12-28 00:59:19,228][106226] Updated weights for policy 0, policy_version 797851 (0.0007) [2023-12-28 00:59:19,287][106226] Updated weights for policy 0, policy_version 797861 (0.0008) [2023-12-28 00:59:19,311][106225] Updated weights for policy 1, policy_version 800010 (0.0007) [2023-12-28 00:59:19,374][106225] Updated weights for policy 1, policy_version 800020 (0.0008) [2023-12-28 00:59:19,443][106225] Updated weights for policy 1, policy_version 800030 (0.0010) [2023-12-28 00:59:19,509][106225] Updated weights for policy 1, policy_version 800040 (0.0011) [2023-12-28 00:59:19,958][106226] Updated weights for policy 0, policy_version 797871 (0.0008) [2023-12-28 00:59:20,027][106226] Updated weights for policy 0, policy_version 797881 (0.0009) [2023-12-28 00:59:20,092][106226] Updated weights for policy 0, policy_version 797891 (0.0009) [2023-12-28 00:59:20,335][106225] Updated weights for policy 1, policy_version 800050 (0.0009) [2023-12-28 00:59:20,397][106225] Updated weights for policy 1, policy_version 800060 (0.0008) [2023-12-28 00:59:20,451][106225] Updated weights for policy 1, policy_version 800070 (0.0009) [2023-12-28 00:59:20,823][106226] Updated weights for policy 0, policy_version 797901 (0.0009) [2023-12-28 00:59:20,884][106226] Updated weights for policy 0, policy_version 797911 (0.0008) [2023-12-28 00:59:20,942][106226] Updated weights for policy 0, policy_version 797921 (0.0010) [2023-12-28 00:59:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 409182208. Throughput: 0: 9899.7, 1: 9693.1. Samples: 409192544. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:21,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.073')] [2023-12-28 00:59:21,245][106225] Updated weights for policy 1, policy_version 800080 (0.0007) [2023-12-28 00:59:21,315][106225] Updated weights for policy 1, policy_version 800090 (0.0008) [2023-12-28 00:59:21,389][106225] Updated weights for policy 1, policy_version 800100 (0.0008) [2023-12-28 00:59:21,712][106226] Updated weights for policy 0, policy_version 797931 (0.0009) [2023-12-28 00:59:21,790][106226] Updated weights for policy 0, policy_version 797941 (0.0008) [2023-12-28 00:59:21,855][106226] Updated weights for policy 0, policy_version 797951 (0.0008) [2023-12-28 00:59:22,159][106225] Updated weights for policy 1, policy_version 800110 (0.0009) [2023-12-28 00:59:22,212][106225] Updated weights for policy 1, policy_version 800120 (0.0008) [2023-12-28 00:59:22,263][106225] Updated weights for policy 1, policy_version 800130 (0.0009) [2023-12-28 00:59:22,545][106226] Updated weights for policy 0, policy_version 797961 (0.0009) [2023-12-28 00:59:22,611][106226] Updated weights for policy 0, policy_version 797971 (0.0008) [2023-12-28 00:59:22,667][106226] Updated weights for policy 0, policy_version 797981 (0.0009) [2023-12-28 00:59:22,727][106226] Updated weights for policy 0, policy_version 797991 (0.0008) [2023-12-28 00:59:23,049][106225] Updated weights for policy 1, policy_version 800140 (0.0009) [2023-12-28 00:59:23,102][106225] Updated weights for policy 1, policy_version 800150 (0.0010) [2023-12-28 00:59:23,166][106225] Updated weights for policy 1, policy_version 800160 (0.0010) [2023-12-28 00:59:23,470][106226] Updated weights for policy 0, policy_version 798001 (0.0008) [2023-12-28 00:59:23,530][106226] Updated weights for policy 0, policy_version 798011 (0.0008) [2023-12-28 00:59:23,599][106226] Updated weights for policy 0, policy_version 798021 (0.0008) [2023-12-28 00:59:23,898][106225] Updated weights for policy 1, policy_version 800170 (0.0011) [2023-12-28 00:59:23,948][106225] Updated weights for policy 1, policy_version 800180 (0.0009) [2023-12-28 00:59:24,005][106225] Updated weights for policy 1, policy_version 800190 (0.0011) [2023-12-28 00:59:24,059][106225] Updated weights for policy 1, policy_version 800200 (0.0010) [2023-12-28 00:59:24,413][106226] Updated weights for policy 0, policy_version 798031 (0.0008) [2023-12-28 00:59:24,481][106226] Updated weights for policy 0, policy_version 798041 (0.0008) [2023-12-28 00:59:24,541][106226] Updated weights for policy 0, policy_version 798051 (0.0009) [2023-12-28 00:59:24,827][106225] Updated weights for policy 1, policy_version 800210 (0.0008) [2023-12-28 00:59:24,883][106225] Updated weights for policy 1, policy_version 800220 (0.0005) [2023-12-28 00:59:24,940][106225] Updated weights for policy 1, policy_version 800230 (0.0007) [2023-12-28 00:59:25,262][106226] Updated weights for policy 0, policy_version 798061 (0.0008) [2023-12-28 00:59:25,315][106226] Updated weights for policy 0, policy_version 798071 (0.0008) [2023-12-28 00:59:25,377][106226] Updated weights for policy 0, policy_version 798081 (0.0007) [2023-12-28 00:59:25,665][106225] Updated weights for policy 1, policy_version 800240 (0.0009) [2023-12-28 00:59:25,715][106225] Updated weights for policy 1, policy_version 800250 (0.0009) [2023-12-28 00:59:25,763][106225] Updated weights for policy 1, policy_version 800260 (0.0009) [2023-12-28 00:59:25,944][106226] Updated weights for policy 0, policy_version 798091 (0.0006) [2023-12-28 00:59:26,010][106226] Updated weights for policy 0, policy_version 798101 (0.0008) [2023-12-28 00:59:26,074][106226] Updated weights for policy 0, policy_version 798111 (0.0008) [2023-12-28 00:59:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 409280512. Throughput: 0: 9893.0, 1: 9632.1. Samples: 409247692. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:26,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.342')] [2023-12-28 00:59:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000800264_204906496.pth... [2023-12-28 00:59:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000798120_204374016.pth... [2023-12-28 00:59:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000799144_204619776.pth [2023-12-28 00:59:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000796968_204079104.pth [2023-12-28 00:59:26,567][106225] Updated weights for policy 1, policy_version 800270 (0.0009) [2023-12-28 00:59:26,618][106225] Updated weights for policy 1, policy_version 800280 (0.0008) [2023-12-28 00:59:26,670][106225] Updated weights for policy 1, policy_version 800290 (0.0009) [2023-12-28 00:59:26,694][106226] Updated weights for policy 0, policy_version 798121 (0.0005) [2023-12-28 00:59:26,752][106226] Updated weights for policy 0, policy_version 798131 (0.0008) [2023-12-28 00:59:26,814][106226] Updated weights for policy 0, policy_version 798141 (0.0009) [2023-12-28 00:59:26,873][106226] Updated weights for policy 0, policy_version 798151 (0.0008) [2023-12-28 00:59:27,410][106225] Updated weights for policy 1, policy_version 800300 (0.0008) [2023-12-28 00:59:27,457][106225] Updated weights for policy 1, policy_version 800310 (0.0008) [2023-12-28 00:59:27,503][106226] Updated weights for policy 0, policy_version 798161 (0.0006) [2023-12-28 00:59:27,505][106225] Updated weights for policy 1, policy_version 800320 (0.0006) [2023-12-28 00:59:27,550][106226] Updated weights for policy 0, policy_version 798171 (0.0006) [2023-12-28 00:59:27,598][106226] Updated weights for policy 0, policy_version 798181 (0.0007) [2023-12-28 00:59:28,210][106225] Updated weights for policy 1, policy_version 800330 (0.0006) [2023-12-28 00:59:28,271][106225] Updated weights for policy 1, policy_version 800340 (0.0005) [2023-12-28 00:59:28,286][106226] Updated weights for policy 0, policy_version 798191 (0.0009) [2023-12-28 00:59:28,333][106225] Updated weights for policy 1, policy_version 800350 (0.0006) [2023-12-28 00:59:28,347][106226] Updated weights for policy 0, policy_version 798201 (0.0009) [2023-12-28 00:59:28,394][106225] Updated weights for policy 1, policy_version 800360 (0.0007) [2023-12-28 00:59:28,405][106226] Updated weights for policy 0, policy_version 798211 (0.0011) [2023-12-28 00:59:28,971][106225] Updated weights for policy 1, policy_version 800370 (0.0005) [2023-12-28 00:59:29,024][106225] Updated weights for policy 1, policy_version 800380 (0.0005) [2023-12-28 00:59:29,073][106225] Updated weights for policy 1, policy_version 800390 (0.0010) [2023-12-28 00:59:29,112][106226] Updated weights for policy 0, policy_version 798221 (0.0011) [2023-12-28 00:59:29,165][106226] Updated weights for policy 0, policy_version 798231 (0.0010) [2023-12-28 00:59:29,231][106226] Updated weights for policy 0, policy_version 798241 (0.0011) [2023-12-28 00:59:29,773][106225] Updated weights for policy 1, policy_version 800400 (0.0010) [2023-12-28 00:59:29,823][106225] Updated weights for policy 1, policy_version 800410 (0.0006) [2023-12-28 00:59:29,853][106226] Updated weights for policy 0, policy_version 798251 (0.0009) [2023-12-28 00:59:29,885][106225] Updated weights for policy 1, policy_version 800420 (0.0008) [2023-12-28 00:59:29,924][106226] Updated weights for policy 0, policy_version 798261 (0.0007) [2023-12-28 00:59:29,986][106226] Updated weights for policy 0, policy_version 798271 (0.0007) [2023-12-28 00:59:30,594][106226] Updated weights for policy 0, policy_version 798281 (0.0008) [2023-12-28 00:59:30,654][106226] Updated weights for policy 0, policy_version 798291 (0.0007) [2023-12-28 00:59:30,670][106225] Updated weights for policy 1, policy_version 800430 (0.0008) [2023-12-28 00:59:30,705][106226] Updated weights for policy 0, policy_version 798301 (0.0008) [2023-12-28 00:59:30,721][106225] Updated weights for policy 1, policy_version 800440 (0.0008) [2023-12-28 00:59:30,755][106226] Updated weights for policy 0, policy_version 798311 (0.0006) [2023-12-28 00:59:30,773][106225] Updated weights for policy 1, policy_version 800450 (0.0007) [2023-12-28 00:59:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 409378816. Throughput: 0: 9944.1, 1: 9656.9. Samples: 409368116. Policy #0 lag: (min: 31.0, avg: 31.7, max: 50.0) [2023-12-28 00:59:31,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-4.901')] [2023-12-28 00:59:31,487][106226] Updated weights for policy 0, policy_version 798321 (0.0006) [2023-12-28 00:59:31,500][106225] Updated weights for policy 1, policy_version 800460 (0.0008) [2023-12-28 00:59:31,547][106226] Updated weights for policy 0, policy_version 798331 (0.0005) [2023-12-28 00:59:31,556][106225] Updated weights for policy 1, policy_version 800470 (0.0008) [2023-12-28 00:59:31,611][106226] Updated weights for policy 0, policy_version 798341 (0.0006) [2023-12-28 00:59:31,618][106225] Updated weights for policy 1, policy_version 800480 (0.0009) [2023-12-28 00:59:32,180][106226] Updated weights for policy 0, policy_version 798351 (0.0006) [2023-12-28 00:59:32,245][106226] Updated weights for policy 0, policy_version 798361 (0.0007) [2023-12-28 00:59:32,301][106226] Updated weights for policy 0, policy_version 798371 (0.0005) [2023-12-28 00:59:32,326][106225] Updated weights for policy 1, policy_version 800490 (0.0009) [2023-12-28 00:59:32,390][106225] Updated weights for policy 1, policy_version 800500 (0.0008) [2023-12-28 00:59:32,451][106225] Updated weights for policy 1, policy_version 800510 (0.0007) [2023-12-28 00:59:32,519][106225] Updated weights for policy 1, policy_version 800520 (0.0006) [2023-12-28 00:59:32,966][106226] Updated weights for policy 0, policy_version 798381 (0.0006) [2023-12-28 00:59:33,019][106226] Updated weights for policy 0, policy_version 798391 (0.0008) [2023-12-28 00:59:33,074][106226] Updated weights for policy 0, policy_version 798401 (0.0009) [2023-12-28 00:59:33,155][106225] Updated weights for policy 1, policy_version 800530 (0.0006) [2023-12-28 00:59:33,206][106225] Updated weights for policy 1, policy_version 800540 (0.0005) [2023-12-28 00:59:33,260][106225] Updated weights for policy 1, policy_version 800550 (0.0005) [2023-12-28 00:59:33,785][106225] Updated weights for policy 1, policy_version 800560 (0.0005) [2023-12-28 00:59:33,842][106225] Updated weights for policy 1, policy_version 800570 (0.0005) [2023-12-28 00:59:33,893][106226] Updated weights for policy 0, policy_version 798411 (0.0007) [2023-12-28 00:59:33,895][106225] Updated weights for policy 1, policy_version 800580 (0.0006) [2023-12-28 00:59:33,942][106226] Updated weights for policy 0, policy_version 798421 (0.0007) [2023-12-28 00:59:33,987][106226] Updated weights for policy 0, policy_version 798431 (0.0008) [2023-12-28 00:59:34,559][106225] Updated weights for policy 1, policy_version 800590 (0.0007) [2023-12-28 00:59:34,629][106225] Updated weights for policy 1, policy_version 800600 (0.0006) [2023-12-28 00:59:34,693][106225] Updated weights for policy 1, policy_version 800610 (0.0006) [2023-12-28 00:59:34,810][106226] Updated weights for policy 0, policy_version 798441 (0.0008) [2023-12-28 00:59:34,877][106226] Updated weights for policy 0, policy_version 798451 (0.0009) [2023-12-28 00:59:34,940][106226] Updated weights for policy 0, policy_version 798461 (0.0009) [2023-12-28 00:59:35,005][106226] Updated weights for policy 0, policy_version 798471 (0.0009) [2023-12-28 00:59:35,277][106225] Updated weights for policy 1, policy_version 800620 (0.0005) [2023-12-28 00:59:35,339][106225] Updated weights for policy 1, policy_version 800630 (0.0005) [2023-12-28 00:59:35,404][106225] Updated weights for policy 1, policy_version 800640 (0.0005) [2023-12-28 00:59:35,675][106226] Updated weights for policy 0, policy_version 798481 (0.0005) [2023-12-28 00:59:35,730][106226] Updated weights for policy 0, policy_version 798491 (0.0008) [2023-12-28 00:59:35,790][106226] Updated weights for policy 0, policy_version 798501 (0.0009) [2023-12-28 00:59:35,930][106225] Updated weights for policy 1, policy_version 800650 (0.0005) [2023-12-28 00:59:35,987][106225] Updated weights for policy 1, policy_version 800660 (0.0005) [2023-12-28 00:59:36,047][106225] Updated weights for policy 1, policy_version 800670 (0.0005) [2023-12-28 00:59:36,108][106225] Updated weights for policy 1, policy_version 800680 (0.0006) [2023-12-28 00:59:36,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 409485312. Throughput: 0: 9941.2, 1: 9808.9. Samples: 409491056. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 00:59:36,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.184')] [2023-12-28 00:59:36,516][106226] Updated weights for policy 0, policy_version 798511 (0.0009) [2023-12-28 00:59:36,576][106226] Updated weights for policy 0, policy_version 798521 (0.0009) [2023-12-28 00:59:36,625][106226] Updated weights for policy 0, policy_version 798531 (0.0008) [2023-12-28 00:59:36,798][106225] Updated weights for policy 1, policy_version 800690 (0.0009) [2023-12-28 00:59:36,858][106225] Updated weights for policy 1, policy_version 800700 (0.0008) [2023-12-28 00:59:36,925][106225] Updated weights for policy 1, policy_version 800710 (0.0008) [2023-12-28 00:59:37,362][106226] Updated weights for policy 0, policy_version 798541 (0.0007) [2023-12-28 00:59:37,416][106226] Updated weights for policy 0, policy_version 798551 (0.0005) [2023-12-28 00:59:37,480][106226] Updated weights for policy 0, policy_version 798561 (0.0007) [2023-12-28 00:59:37,604][106225] Updated weights for policy 1, policy_version 800720 (0.0008) [2023-12-28 00:59:37,661][106225] Updated weights for policy 1, policy_version 800730 (0.0008) [2023-12-28 00:59:37,710][106225] Updated weights for policy 1, policy_version 800740 (0.0008) [2023-12-28 00:59:38,147][106226] Updated weights for policy 0, policy_version 798571 (0.0009) [2023-12-28 00:59:38,200][106226] Updated weights for policy 0, policy_version 798581 (0.0009) [2023-12-28 00:59:38,256][106226] Updated weights for policy 0, policy_version 798591 (0.0008) [2023-12-28 00:59:38,456][106225] Updated weights for policy 1, policy_version 800750 (0.0009) [2023-12-28 00:59:38,519][106225] Updated weights for policy 1, policy_version 800760 (0.0008) [2023-12-28 00:59:38,582][106225] Updated weights for policy 1, policy_version 800770 (0.0008) [2023-12-28 00:59:38,998][106226] Updated weights for policy 0, policy_version 798601 (0.0008) [2023-12-28 00:59:39,062][106226] Updated weights for policy 0, policy_version 798611 (0.0009) [2023-12-28 00:59:39,120][106226] Updated weights for policy 0, policy_version 798621 (0.0009) [2023-12-28 00:59:39,186][106226] Updated weights for policy 0, policy_version 798631 (0.0009) [2023-12-28 00:59:39,332][106225] Updated weights for policy 1, policy_version 800780 (0.0009) [2023-12-28 00:59:39,403][106225] Updated weights for policy 1, policy_version 800790 (0.0008) [2023-12-28 00:59:39,476][106225] Updated weights for policy 1, policy_version 800800 (0.0007) [2023-12-28 00:59:39,939][106226] Updated weights for policy 0, policy_version 798641 (0.0009) [2023-12-28 00:59:40,007][106226] Updated weights for policy 0, policy_version 798651 (0.0010) [2023-12-28 00:59:40,078][106226] Updated weights for policy 0, policy_version 798661 (0.0008) [2023-12-28 00:59:40,223][106225] Updated weights for policy 1, policy_version 800810 (0.0007) [2023-12-28 00:59:40,279][106225] Updated weights for policy 1, policy_version 800820 (0.0007) [2023-12-28 00:59:40,344][106225] Updated weights for policy 1, policy_version 800830 (0.0007) [2023-12-28 00:59:40,403][106225] Updated weights for policy 1, policy_version 800840 (0.0008) [2023-12-28 00:59:40,747][106226] Updated weights for policy 0, policy_version 798671 (0.0006) [2023-12-28 00:59:40,792][106226] Updated weights for policy 0, policy_version 798681 (0.0008) [2023-12-28 00:59:40,853][106226] Updated weights for policy 0, policy_version 798691 (0.0009) [2023-12-28 00:59:41,149][106225] Updated weights for policy 1, policy_version 800850 (0.0009) [2023-12-28 00:59:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 409575424. Throughput: 0: 9969.2, 1: 9823.2. Samples: 409549424. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 00:59:41,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.977')] [2023-12-28 00:59:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000798696_204521472.pth... [2023-12-28 00:59:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000797544_204226560.pth [2023-12-28 00:59:41,210][106225] Updated weights for policy 1, policy_version 800860 (0.0008) [2023-12-28 00:59:41,278][106225] Updated weights for policy 1, policy_version 800870 (0.0008) [2023-12-28 00:59:41,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000800872_205062144.pth... [2023-12-28 00:59:41,296][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000799720_204767232.pth [2023-12-28 00:59:41,664][106226] Updated weights for policy 0, policy_version 798701 (0.0008) [2023-12-28 00:59:41,729][106226] Updated weights for policy 0, policy_version 798711 (0.0009) [2023-12-28 00:59:41,791][106226] Updated weights for policy 0, policy_version 798721 (0.0010) [2023-12-28 00:59:42,044][106225] Updated weights for policy 1, policy_version 800880 (0.0008) [2023-12-28 00:59:42,112][106225] Updated weights for policy 1, policy_version 800890 (0.0008) [2023-12-28 00:59:42,176][106225] Updated weights for policy 1, policy_version 800900 (0.0008) [2023-12-28 00:59:42,459][106226] Updated weights for policy 0, policy_version 798731 (0.0007) [2023-12-28 00:59:42,523][106226] Updated weights for policy 0, policy_version 798741 (0.0006) [2023-12-28 00:59:42,591][106226] Updated weights for policy 0, policy_version 798751 (0.0007) [2023-12-28 00:59:42,844][106225] Updated weights for policy 1, policy_version 800910 (0.0009) [2023-12-28 00:59:42,908][106225] Updated weights for policy 1, policy_version 800920 (0.0008) [2023-12-28 00:59:42,969][106225] Updated weights for policy 1, policy_version 800930 (0.0009) [2023-12-28 00:59:43,229][106226] Updated weights for policy 0, policy_version 798761 (0.0008) [2023-12-28 00:59:43,294][106226] Updated weights for policy 0, policy_version 798771 (0.0007) [2023-12-28 00:59:43,363][106226] Updated weights for policy 0, policy_version 798781 (0.0007) [2023-12-28 00:59:43,430][106226] Updated weights for policy 0, policy_version 798791 (0.0009) [2023-12-28 00:59:43,620][106225] Updated weights for policy 1, policy_version 800940 (0.0007) [2023-12-28 00:59:43,676][106225] Updated weights for policy 1, policy_version 800950 (0.0005) [2023-12-28 00:59:43,733][106225] Updated weights for policy 1, policy_version 800960 (0.0008) [2023-12-28 00:59:44,120][106226] Updated weights for policy 0, policy_version 798801 (0.0009) [2023-12-28 00:59:44,181][106226] Updated weights for policy 0, policy_version 798811 (0.0008) [2023-12-28 00:59:44,234][106226] Updated weights for policy 0, policy_version 798821 (0.0009) [2023-12-28 00:59:44,410][106225] Updated weights for policy 1, policy_version 800970 (0.0009) [2023-12-28 00:59:44,464][106225] Updated weights for policy 1, policy_version 800980 (0.0008) [2023-12-28 00:59:44,519][106225] Updated weights for policy 1, policy_version 800990 (0.0009) [2023-12-28 00:59:44,578][106225] Updated weights for policy 1, policy_version 801000 (0.0008) [2023-12-28 00:59:44,956][106226] Updated weights for policy 0, policy_version 798831 (0.0008) [2023-12-28 00:59:45,018][106226] Updated weights for policy 0, policy_version 798841 (0.0009) [2023-12-28 00:59:45,087][106226] Updated weights for policy 0, policy_version 798851 (0.0008) [2023-12-28 00:59:45,240][106225] Updated weights for policy 1, policy_version 801010 (0.0009) [2023-12-28 00:59:45,306][106225] Updated weights for policy 1, policy_version 801020 (0.0008) [2023-12-28 00:59:45,368][106225] Updated weights for policy 1, policy_version 801030 (0.0009) [2023-12-28 00:59:45,798][106226] Updated weights for policy 0, policy_version 798861 (0.0008) [2023-12-28 00:59:45,846][106226] Updated weights for policy 0, policy_version 798871 (0.0008) [2023-12-28 00:59:45,898][106226] Updated weights for policy 0, policy_version 798881 (0.0006) [2023-12-28 00:59:46,076][106225] Updated weights for policy 1, policy_version 801040 (0.0006) [2023-12-28 00:59:46,127][106225] Updated weights for policy 1, policy_version 801050 (0.0006) [2023-12-28 00:59:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 409673728. Throughput: 0: 9851.9, 1: 9876.0. Samples: 409665576. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 00:59:46,176][105115] Avg episode reward: [(0, '-4.681'), (1, '-5.156')] [2023-12-28 00:59:46,182][106225] Updated weights for policy 1, policy_version 801060 (0.0005) [2023-12-28 00:59:46,551][106226] Updated weights for policy 0, policy_version 798891 (0.0005) [2023-12-28 00:59:46,612][106226] Updated weights for policy 0, policy_version 798901 (0.0005) [2023-12-28 00:59:46,663][106226] Updated weights for policy 0, policy_version 798911 (0.0005) [2023-12-28 00:59:46,878][106225] Updated weights for policy 1, policy_version 801070 (0.0008) [2023-12-28 00:59:46,933][106225] Updated weights for policy 1, policy_version 801080 (0.0009) [2023-12-28 00:59:46,980][106225] Updated weights for policy 1, policy_version 801090 (0.0009) [2023-12-28 00:59:47,200][106226] Updated weights for policy 0, policy_version 798921 (0.0006) [2023-12-28 00:59:47,260][106226] Updated weights for policy 0, policy_version 798931 (0.0008) [2023-12-28 00:59:47,308][106226] Updated weights for policy 0, policy_version 798941 (0.0008) [2023-12-28 00:59:47,360][106226] Updated weights for policy 0, policy_version 798951 (0.0005) [2023-12-28 00:59:47,788][106225] Updated weights for policy 1, policy_version 801100 (0.0009) [2023-12-28 00:59:47,838][106225] Updated weights for policy 1, policy_version 801110 (0.0009) [2023-12-28 00:59:47,886][106225] Updated weights for policy 1, policy_version 801120 (0.0008) [2023-12-28 00:59:47,979][106226] Updated weights for policy 0, policy_version 798961 (0.0008) [2023-12-28 00:59:48,029][106226] Updated weights for policy 0, policy_version 798971 (0.0008) [2023-12-28 00:59:48,082][106226] Updated weights for policy 0, policy_version 798982 (0.0009) [2023-12-28 00:59:48,621][106225] Updated weights for policy 1, policy_version 801130 (0.0008) [2023-12-28 00:59:48,680][106225] Updated weights for policy 1, policy_version 801140 (0.0008) [2023-12-28 00:59:48,743][106225] Updated weights for policy 1, policy_version 801150 (0.0007) [2023-12-28 00:59:48,802][106225] Updated weights for policy 1, policy_version 801160 (0.0009) [2023-12-28 00:59:48,831][106226] Updated weights for policy 0, policy_version 798992 (0.0008) [2023-12-28 00:59:48,887][106226] Updated weights for policy 0, policy_version 799002 (0.0008) [2023-12-28 00:59:48,949][106226] Updated weights for policy 0, policy_version 799012 (0.0008) [2023-12-28 00:59:49,577][106225] Updated weights for policy 1, policy_version 801170 (0.0008) [2023-12-28 00:59:49,631][106225] Updated weights for policy 1, policy_version 801180 (0.0008) [2023-12-28 00:59:49,683][106226] Updated weights for policy 0, policy_version 799022 (0.0010) [2023-12-28 00:59:49,689][106225] Updated weights for policy 1, policy_version 801190 (0.0007) [2023-12-28 00:59:49,739][106226] Updated weights for policy 0, policy_version 799032 (0.0011) [2023-12-28 00:59:49,795][106226] Updated weights for policy 0, policy_version 799042 (0.0010) [2023-12-28 00:59:50,376][106225] Updated weights for policy 1, policy_version 801200 (0.0007) [2023-12-28 00:59:50,441][106225] Updated weights for policy 1, policy_version 801210 (0.0006) [2023-12-28 00:59:50,498][106225] Updated weights for policy 1, policy_version 801220 (0.0008) [2023-12-28 00:59:50,528][106226] Updated weights for policy 0, policy_version 799052 (0.0010) [2023-12-28 00:59:50,587][106226] Updated weights for policy 0, policy_version 799062 (0.0010) [2023-12-28 00:59:50,651][106226] Updated weights for policy 0, policy_version 799072 (0.0011) [2023-12-28 00:59:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 409772032. Throughput: 0: 9887.2, 1: 9861.9. Samples: 409785852. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 00:59:51,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-5.060')] [2023-12-28 00:59:51,286][106225] Updated weights for policy 1, policy_version 801230 (0.0008) [2023-12-28 00:59:51,316][106226] Updated weights for policy 0, policy_version 799082 (0.0011) [2023-12-28 00:59:51,355][106225] Updated weights for policy 1, policy_version 801240 (0.0009) [2023-12-28 00:59:51,380][106226] Updated weights for policy 0, policy_version 799092 (0.0010) [2023-12-28 00:59:51,422][106225] Updated weights for policy 1, policy_version 801250 (0.0008) [2023-12-28 00:59:51,443][106226] Updated weights for policy 0, policy_version 799102 (0.0008) [2023-12-28 00:59:51,504][106226] Updated weights for policy 0, policy_version 799112 (0.0010) [2023-12-28 00:59:52,092][106225] Updated weights for policy 1, policy_version 801260 (0.0008) [2023-12-28 00:59:52,140][106225] Updated weights for policy 1, policy_version 801270 (0.0008) [2023-12-28 00:59:52,194][106226] Updated weights for policy 0, policy_version 799122 (0.0005) [2023-12-28 00:59:52,200][106225] Updated weights for policy 1, policy_version 801280 (0.0008) [2023-12-28 00:59:52,253][106226] Updated weights for policy 0, policy_version 799132 (0.0006) [2023-12-28 00:59:52,319][106226] Updated weights for policy 0, policy_version 799142 (0.0008) [2023-12-28 00:59:52,885][106225] Updated weights for policy 1, policy_version 801290 (0.0007) [2023-12-28 00:59:52,945][106225] Updated weights for policy 1, policy_version 801300 (0.0008) [2023-12-28 00:59:53,005][106225] Updated weights for policy 1, policy_version 801310 (0.0006) [2023-12-28 00:59:53,027][106226] Updated weights for policy 0, policy_version 799152 (0.0007) [2023-12-28 00:59:53,061][106225] Updated weights for policy 1, policy_version 801320 (0.0007) [2023-12-28 00:59:53,091][106226] Updated weights for policy 0, policy_version 799162 (0.0007) [2023-12-28 00:59:53,147][106226] Updated weights for policy 0, policy_version 799172 (0.0009) [2023-12-28 00:59:53,772][106225] Updated weights for policy 1, policy_version 801330 (0.0007) [2023-12-28 00:59:53,823][106225] Updated weights for policy 1, policy_version 801340 (0.0005) [2023-12-28 00:59:53,878][106225] Updated weights for policy 1, policy_version 801350 (0.0007) [2023-12-28 00:59:53,889][106226] Updated weights for policy 0, policy_version 799182 (0.0009) [2023-12-28 00:59:53,941][106226] Updated weights for policy 0, policy_version 799192 (0.0009) [2023-12-28 00:59:54,005][106226] Updated weights for policy 0, policy_version 799202 (0.0009) [2023-12-28 00:59:54,478][106225] Updated weights for policy 1, policy_version 801360 (0.0007) [2023-12-28 00:59:54,544][106225] Updated weights for policy 1, policy_version 801370 (0.0008) [2023-12-28 00:59:54,594][106225] Updated weights for policy 1, policy_version 801380 (0.0008) [2023-12-28 00:59:54,802][106226] Updated weights for policy 0, policy_version 799212 (0.0009) [2023-12-28 00:59:54,857][106226] Updated weights for policy 0, policy_version 799222 (0.0008) [2023-12-28 00:59:54,922][106226] Updated weights for policy 0, policy_version 799232 (0.0011) [2023-12-28 00:59:55,269][106225] Updated weights for policy 1, policy_version 801390 (0.0007) [2023-12-28 00:59:55,327][106225] Updated weights for policy 1, policy_version 801400 (0.0008) [2023-12-28 00:59:55,380][106225] Updated weights for policy 1, policy_version 801410 (0.0007) [2023-12-28 00:59:55,577][106226] Updated weights for policy 0, policy_version 799242 (0.0010) [2023-12-28 00:59:55,637][106226] Updated weights for policy 0, policy_version 799252 (0.0010) [2023-12-28 00:59:55,683][106226] Updated weights for policy 0, policy_version 799262 (0.0010) [2023-12-28 00:59:55,729][106226] Updated weights for policy 0, policy_version 799272 (0.0010) [2023-12-28 00:59:56,104][106225] Updated weights for policy 1, policy_version 801420 (0.0007) [2023-12-28 00:59:56,168][106225] Updated weights for policy 1, policy_version 801430 (0.0008) [2023-12-28 00:59:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 409870336. Throughput: 0: 9900.9, 1: 9814.4. Samples: 409843464. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 00:59:56,176][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.069')] [2023-12-28 00:59:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000799272_204668928.pth... [2023-12-28 00:59:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000798120_204374016.pth [2023-12-28 00:59:56,219][106225] Updated weights for policy 1, policy_version 801440 (0.0008) [2023-12-28 00:59:56,261][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000801448_205209600.pth... [2023-12-28 00:59:56,265][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000800264_204906496.pth [2023-12-28 00:59:56,465][106226] Updated weights for policy 0, policy_version 799282 (0.0010) [2023-12-28 00:59:56,526][106226] Updated weights for policy 0, policy_version 799292 (0.0011) [2023-12-28 00:59:56,586][106226] Updated weights for policy 0, policy_version 799302 (0.0010) [2023-12-28 00:59:56,937][106225] Updated weights for policy 1, policy_version 801450 (0.0008) [2023-12-28 00:59:56,991][106225] Updated weights for policy 1, policy_version 801460 (0.0008) [2023-12-28 00:59:57,049][106225] Updated weights for policy 1, policy_version 801470 (0.0008) [2023-12-28 00:59:57,104][106225] Updated weights for policy 1, policy_version 801480 (0.0008) [2023-12-28 00:59:57,255][106226] Updated weights for policy 0, policy_version 799312 (0.0009) [2023-12-28 00:59:57,311][106226] Updated weights for policy 0, policy_version 799322 (0.0010) [2023-12-28 00:59:57,380][106226] Updated weights for policy 0, policy_version 799332 (0.0010) [2023-12-28 00:59:57,801][106225] Updated weights for policy 1, policy_version 801490 (0.0008) [2023-12-28 00:59:57,846][106225] Updated weights for policy 1, policy_version 801500 (0.0007) [2023-12-28 00:59:57,895][106225] Updated weights for policy 1, policy_version 801510 (0.0008) [2023-12-28 00:59:58,058][106226] Updated weights for policy 0, policy_version 799342 (0.0010) [2023-12-28 00:59:58,107][106226] Updated weights for policy 0, policy_version 799352 (0.0009) [2023-12-28 00:59:58,163][106226] Updated weights for policy 0, policy_version 799362 (0.0010) [2023-12-28 00:59:58,671][106225] Updated weights for policy 1, policy_version 801520 (0.0008) [2023-12-28 00:59:58,730][106225] Updated weights for policy 1, policy_version 801530 (0.0009) [2023-12-28 00:59:58,796][106225] Updated weights for policy 1, policy_version 801540 (0.0007) [2023-12-28 00:59:59,012][106226] Updated weights for policy 0, policy_version 799372 (0.0010) [2023-12-28 00:59:59,075][106226] Updated weights for policy 0, policy_version 799382 (0.0009) [2023-12-28 00:59:59,137][106226] Updated weights for policy 0, policy_version 799392 (0.0008) [2023-12-28 00:59:59,534][106225] Updated weights for policy 1, policy_version 801550 (0.0008) [2023-12-28 00:59:59,586][106225] Updated weights for policy 1, policy_version 801560 (0.0008) [2023-12-28 00:59:59,639][106225] Updated weights for policy 1, policy_version 801570 (0.0007) [2023-12-28 00:59:59,917][106226] Updated weights for policy 0, policy_version 799402 (0.0008) [2023-12-28 00:59:59,983][106226] Updated weights for policy 0, policy_version 799412 (0.0006) [2023-12-28 01:00:00,044][106226] Updated weights for policy 0, policy_version 799422 (0.0007) [2023-12-28 01:00:00,095][106226] Updated weights for policy 0, policy_version 799432 (0.0009) [2023-12-28 01:00:00,376][106225] Updated weights for policy 1, policy_version 801580 (0.0007) [2023-12-28 01:00:00,425][106225] Updated weights for policy 1, policy_version 801590 (0.0008) [2023-12-28 01:00:00,470][106225] Updated weights for policy 1, policy_version 801600 (0.0009) [2023-12-28 01:00:00,767][106226] Updated weights for policy 0, policy_version 799442 (0.0006) [2023-12-28 01:00:00,842][106226] Updated weights for policy 0, policy_version 799452 (0.0006) [2023-12-28 01:00:00,901][106226] Updated weights for policy 0, policy_version 799462 (0.0007) [2023-12-28 01:00:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 409968640. Throughput: 0: 9914.4, 1: 9773.3. Samples: 409959324. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:01,175][105115] Avg episode reward: [(0, '-4.269'), (1, '-4.688')] [2023-12-28 01:00:01,273][106225] Updated weights for policy 1, policy_version 801610 (0.0008) [2023-12-28 01:00:01,335][106225] Updated weights for policy 1, policy_version 801620 (0.0008) [2023-12-28 01:00:01,403][106225] Updated weights for policy 1, policy_version 801630 (0.0009) [2023-12-28 01:00:01,453][106225] Updated weights for policy 1, policy_version 801640 (0.0008) [2023-12-28 01:00:01,549][106226] Updated weights for policy 0, policy_version 799472 (0.0011) [2023-12-28 01:00:01,610][106226] Updated weights for policy 0, policy_version 799482 (0.0011) [2023-12-28 01:00:01,671][106226] Updated weights for policy 0, policy_version 799492 (0.0010) [2023-12-28 01:00:02,239][106225] Updated weights for policy 1, policy_version 801650 (0.0010) [2023-12-28 01:00:02,303][106225] Updated weights for policy 1, policy_version 801660 (0.0009) [2023-12-28 01:00:02,363][106225] Updated weights for policy 1, policy_version 801670 (0.0011) [2023-12-28 01:00:02,399][106226] Updated weights for policy 0, policy_version 799502 (0.0009) [2023-12-28 01:00:02,456][106226] Updated weights for policy 0, policy_version 799512 (0.0010) [2023-12-28 01:00:02,509][106226] Updated weights for policy 0, policy_version 799522 (0.0010) [2023-12-28 01:00:03,070][106225] Updated weights for policy 1, policy_version 801680 (0.0005) [2023-12-28 01:00:03,117][106225] Updated weights for policy 1, policy_version 801690 (0.0005) [2023-12-28 01:00:03,175][106225] Updated weights for policy 1, policy_version 801700 (0.0005) [2023-12-28 01:00:03,194][106226] Updated weights for policy 0, policy_version 799532 (0.0010) [2023-12-28 01:00:03,254][106226] Updated weights for policy 0, policy_version 799542 (0.0008) [2023-12-28 01:00:03,303][106226] Updated weights for policy 0, policy_version 799552 (0.0010) [2023-12-28 01:00:03,721][106225] Updated weights for policy 1, policy_version 801710 (0.0006) [2023-12-28 01:00:03,775][106225] Updated weights for policy 1, policy_version 801720 (0.0006) [2023-12-28 01:00:03,827][106225] Updated weights for policy 1, policy_version 801730 (0.0009) [2023-12-28 01:00:03,978][106226] Updated weights for policy 0, policy_version 799562 (0.0005) [2023-12-28 01:00:04,045][106226] Updated weights for policy 0, policy_version 799572 (0.0010) [2023-12-28 01:00:04,113][106226] Updated weights for policy 0, policy_version 799582 (0.0009) [2023-12-28 01:00:04,184][106226] Updated weights for policy 0, policy_version 799592 (0.0006) [2023-12-28 01:00:04,468][106225] Updated weights for policy 1, policy_version 801740 (0.0007) [2023-12-28 01:00:04,528][106225] Updated weights for policy 1, policy_version 801750 (0.0009) [2023-12-28 01:00:04,585][106225] Updated weights for policy 1, policy_version 801760 (0.0007) [2023-12-28 01:00:04,732][106226] Updated weights for policy 0, policy_version 799602 (0.0011) [2023-12-28 01:00:04,794][106226] Updated weights for policy 0, policy_version 799612 (0.0011) [2023-12-28 01:00:04,848][106226] Updated weights for policy 0, policy_version 799622 (0.0011) [2023-12-28 01:00:05,309][106225] Updated weights for policy 1, policy_version 801770 (0.0008) [2023-12-28 01:00:05,355][106225] Updated weights for policy 1, policy_version 801780 (0.0005) [2023-12-28 01:00:05,413][106225] Updated weights for policy 1, policy_version 801790 (0.0007) [2023-12-28 01:00:05,463][106225] Updated weights for policy 1, policy_version 801800 (0.0009) [2023-12-28 01:00:05,513][106226] Updated weights for policy 0, policy_version 799632 (0.0006) [2023-12-28 01:00:05,575][106226] Updated weights for policy 0, policy_version 799642 (0.0005) [2023-12-28 01:00:05,634][106226] Updated weights for policy 0, policy_version 799652 (0.0007) [2023-12-28 01:00:06,130][106225] Updated weights for policy 1, policy_version 801810 (0.0009) [2023-12-28 01:00:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 410066944. Throughput: 0: 9910.9, 1: 9835.8. Samples: 410081148. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:06,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.107')] [2023-12-28 01:00:06,190][106225] Updated weights for policy 1, policy_version 801820 (0.0007) [2023-12-28 01:00:06,248][106225] Updated weights for policy 1, policy_version 801830 (0.0006) [2023-12-28 01:00:06,309][106226] Updated weights for policy 0, policy_version 799662 (0.0010) [2023-12-28 01:00:06,367][106226] Updated weights for policy 0, policy_version 799672 (0.0011) [2023-12-28 01:00:06,428][106226] Updated weights for policy 0, policy_version 799682 (0.0011) [2023-12-28 01:00:06,910][106225] Updated weights for policy 1, policy_version 801840 (0.0008) [2023-12-28 01:00:06,976][106225] Updated weights for policy 1, policy_version 801850 (0.0009) [2023-12-28 01:00:07,024][106226] Updated weights for policy 0, policy_version 799692 (0.0009) [2023-12-28 01:00:07,044][106225] Updated weights for policy 1, policy_version 801860 (0.0008) [2023-12-28 01:00:07,073][106226] Updated weights for policy 0, policy_version 799702 (0.0008) [2023-12-28 01:00:07,130][106226] Updated weights for policy 0, policy_version 799712 (0.0011) [2023-12-28 01:00:07,717][106225] Updated weights for policy 1, policy_version 801870 (0.0008) [2023-12-28 01:00:07,773][106225] Updated weights for policy 1, policy_version 801880 (0.0008) [2023-12-28 01:00:07,828][106225] Updated weights for policy 1, policy_version 801890 (0.0007) [2023-12-28 01:00:07,844][106226] Updated weights for policy 0, policy_version 799722 (0.0011) [2023-12-28 01:00:07,908][106226] Updated weights for policy 0, policy_version 799732 (0.0011) [2023-12-28 01:00:07,974][106226] Updated weights for policy 0, policy_version 799742 (0.0011) [2023-12-28 01:00:08,038][106226] Updated weights for policy 0, policy_version 799752 (0.0011) [2023-12-28 01:00:08,530][106225] Updated weights for policy 1, policy_version 801900 (0.0007) [2023-12-28 01:00:08,578][106225] Updated weights for policy 1, policy_version 801910 (0.0005) [2023-12-28 01:00:08,627][106225] Updated weights for policy 1, policy_version 801920 (0.0005) [2023-12-28 01:00:08,765][106226] Updated weights for policy 0, policy_version 799762 (0.0008) [2023-12-28 01:00:08,821][106226] Updated weights for policy 0, policy_version 799772 (0.0008) [2023-12-28 01:00:08,878][106226] Updated weights for policy 0, policy_version 799782 (0.0009) [2023-12-28 01:00:09,278][106225] Updated weights for policy 1, policy_version 801930 (0.0007) [2023-12-28 01:00:09,331][106225] Updated weights for policy 1, policy_version 801940 (0.0008) [2023-12-28 01:00:09,399][106225] Updated weights for policy 1, policy_version 801950 (0.0008) [2023-12-28 01:00:09,456][106225] Updated weights for policy 1, policy_version 801960 (0.0010) [2023-12-28 01:00:09,621][106226] Updated weights for policy 0, policy_version 799792 (0.0008) [2023-12-28 01:00:09,688][106226] Updated weights for policy 0, policy_version 799802 (0.0008) [2023-12-28 01:00:09,750][106226] Updated weights for policy 0, policy_version 799812 (0.0008) [2023-12-28 01:00:10,239][106225] Updated weights for policy 1, policy_version 801970 (0.0008) [2023-12-28 01:00:10,302][106225] Updated weights for policy 1, policy_version 801980 (0.0007) [2023-12-28 01:00:10,356][106225] Updated weights for policy 1, policy_version 801990 (0.0008) [2023-12-28 01:00:10,489][106226] Updated weights for policy 0, policy_version 799822 (0.0007) [2023-12-28 01:00:10,556][106226] Updated weights for policy 0, policy_version 799832 (0.0011) [2023-12-28 01:00:10,613][106226] Updated weights for policy 0, policy_version 799842 (0.0010) [2023-12-28 01:00:11,018][106225] Updated weights for policy 1, policy_version 802000 (0.0008) [2023-12-28 01:00:11,104][106225] Updated weights for policy 1, policy_version 802010 (0.0007) [2023-12-28 01:00:11,174][106225] Updated weights for policy 1, policy_version 802020 (0.0008) [2023-12-28 01:00:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 410165248. Throughput: 0: 9942.8, 1: 9919.0. Samples: 410141476. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:11,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-4.903')] [2023-12-28 01:00:11,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000802024_205357056.pth... [2023-12-28 01:00:11,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000800872_205062144.pth [2023-12-28 01:00:11,217][106226] Updated weights for policy 0, policy_version 799852 (0.0009) [2023-12-28 01:00:11,292][106226] Updated weights for policy 0, policy_version 799862 (0.0011) [2023-12-28 01:00:11,356][106226] Updated weights for policy 0, policy_version 799872 (0.0008) [2023-12-28 01:00:11,412][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000799880_204824576.pth... [2023-12-28 01:00:11,416][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000798696_204521472.pth [2023-12-28 01:00:11,934][106225] Updated weights for policy 1, policy_version 802030 (0.0009) [2023-12-28 01:00:11,990][106225] Updated weights for policy 1, policy_version 802040 (0.0011) [2023-12-28 01:00:12,041][106225] Updated weights for policy 1, policy_version 802050 (0.0010) [2023-12-28 01:00:12,101][106226] Updated weights for policy 0, policy_version 799882 (0.0009) [2023-12-28 01:00:12,166][106226] Updated weights for policy 0, policy_version 799892 (0.0008) [2023-12-28 01:00:12,225][106226] Updated weights for policy 0, policy_version 799902 (0.0008) [2023-12-28 01:00:12,293][106226] Updated weights for policy 0, policy_version 799912 (0.0008) [2023-12-28 01:00:12,747][106225] Updated weights for policy 1, policy_version 802060 (0.0010) [2023-12-28 01:00:12,807][106225] Updated weights for policy 1, policy_version 802070 (0.0011) [2023-12-28 01:00:12,865][106225] Updated weights for policy 1, policy_version 802080 (0.0011) [2023-12-28 01:00:13,028][106226] Updated weights for policy 0, policy_version 799922 (0.0010) [2023-12-28 01:00:13,074][106226] Updated weights for policy 0, policy_version 799932 (0.0010) [2023-12-28 01:00:13,141][106226] Updated weights for policy 0, policy_version 799942 (0.0011) [2023-12-28 01:00:13,549][106225] Updated weights for policy 1, policy_version 802090 (0.0010) [2023-12-28 01:00:13,614][106225] Updated weights for policy 1, policy_version 802100 (0.0007) [2023-12-28 01:00:13,683][106225] Updated weights for policy 1, policy_version 802110 (0.0005) [2023-12-28 01:00:13,741][106226] Updated weights for policy 0, policy_version 799952 (0.0007) [2023-12-28 01:00:13,750][106225] Updated weights for policy 1, policy_version 802120 (0.0005) [2023-12-28 01:00:13,793][106226] Updated weights for policy 0, policy_version 799962 (0.0006) [2023-12-28 01:00:13,843][106226] Updated weights for policy 0, policy_version 799972 (0.0006) [2023-12-28 01:00:14,289][106225] Updated weights for policy 1, policy_version 802130 (0.0005) [2023-12-28 01:00:14,352][106225] Updated weights for policy 1, policy_version 802140 (0.0005) [2023-12-28 01:00:14,421][106225] Updated weights for policy 1, policy_version 802150 (0.0008) [2023-12-28 01:00:14,526][106226] Updated weights for policy 0, policy_version 799982 (0.0007) [2023-12-28 01:00:14,574][106226] Updated weights for policy 0, policy_version 799992 (0.0005) [2023-12-28 01:00:14,622][106226] Updated weights for policy 0, policy_version 800002 (0.0005) [2023-12-28 01:00:15,115][106225] Updated weights for policy 1, policy_version 802160 (0.0009) [2023-12-28 01:00:15,173][106225] Updated weights for policy 1, policy_version 802170 (0.0008) [2023-12-28 01:00:15,227][106225] Updated weights for policy 1, policy_version 802180 (0.0009) [2023-12-28 01:00:15,341][106226] Updated weights for policy 0, policy_version 800012 (0.0008) [2023-12-28 01:00:15,400][106226] Updated weights for policy 0, policy_version 800022 (0.0008) [2023-12-28 01:00:15,463][106226] Updated weights for policy 0, policy_version 800032 (0.0009) [2023-12-28 01:00:15,989][106225] Updated weights for policy 1, policy_version 802190 (0.0009) [2023-12-28 01:00:16,048][106225] Updated weights for policy 1, policy_version 802200 (0.0008) [2023-12-28 01:00:16,107][106225] Updated weights for policy 1, policy_version 802210 (0.0008) [2023-12-28 01:00:16,119][106226] Updated weights for policy 0, policy_version 800042 (0.0009) [2023-12-28 01:00:16,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 410271744. Throughput: 0: 9896.8, 1: 9934.1. Samples: 410260508. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:16,175][105115] Avg episode reward: [(0, '-4.075'), (1, '-5.215')] [2023-12-28 01:00:16,175][106226] Updated weights for policy 0, policy_version 800052 (0.0008) [2023-12-28 01:00:16,233][106226] Updated weights for policy 0, policy_version 800062 (0.0007) [2023-12-28 01:00:16,290][106226] Updated weights for policy 0, policy_version 800072 (0.0005) [2023-12-28 01:00:16,840][106226] Updated weights for policy 0, policy_version 800082 (0.0005) [2023-12-28 01:00:16,887][106225] Updated weights for policy 1, policy_version 802220 (0.0006) [2023-12-28 01:00:16,891][106226] Updated weights for policy 0, policy_version 800092 (0.0005) [2023-12-28 01:00:16,942][106225] Updated weights for policy 1, policy_version 802230 (0.0005) [2023-12-28 01:00:16,952][106226] Updated weights for policy 0, policy_version 800102 (0.0006) [2023-12-28 01:00:16,990][106225] Updated weights for policy 1, policy_version 802240 (0.0005) [2023-12-28 01:00:17,623][106226] Updated weights for policy 0, policy_version 800112 (0.0008) [2023-12-28 01:00:17,634][106225] Updated weights for policy 1, policy_version 802250 (0.0005) [2023-12-28 01:00:17,683][106225] Updated weights for policy 1, policy_version 802260 (0.0008) [2023-12-28 01:00:17,685][106226] Updated weights for policy 0, policy_version 800122 (0.0006) [2023-12-28 01:00:17,735][106225] Updated weights for policy 1, policy_version 802270 (0.0008) [2023-12-28 01:00:17,743][106226] Updated weights for policy 0, policy_version 800132 (0.0006) [2023-12-28 01:00:17,789][106225] Updated weights for policy 1, policy_version 802280 (0.0005) [2023-12-28 01:00:18,440][106225] Updated weights for policy 1, policy_version 802290 (0.0009) [2023-12-28 01:00:18,462][106226] Updated weights for policy 0, policy_version 800142 (0.0008) [2023-12-28 01:00:18,487][106225] Updated weights for policy 1, policy_version 802300 (0.0007) [2023-12-28 01:00:18,515][106226] Updated weights for policy 0, policy_version 800152 (0.0006) [2023-12-28 01:00:18,539][106225] Updated weights for policy 1, policy_version 802310 (0.0008) [2023-12-28 01:00:18,576][106226] Updated weights for policy 0, policy_version 800162 (0.0007) [2023-12-28 01:00:19,289][106225] Updated weights for policy 1, policy_version 802320 (0.0009) [2023-12-28 01:00:19,313][106226] Updated weights for policy 0, policy_version 800172 (0.0007) [2023-12-28 01:00:19,351][106225] Updated weights for policy 1, policy_version 802330 (0.0010) [2023-12-28 01:00:19,381][106226] Updated weights for policy 0, policy_version 800182 (0.0007) [2023-12-28 01:00:19,441][106225] Updated weights for policy 1, policy_version 802340 (0.0008) [2023-12-28 01:00:19,448][106226] Updated weights for policy 0, policy_version 800192 (0.0006) [2023-12-28 01:00:20,105][106225] Updated weights for policy 1, policy_version 802350 (0.0009) [2023-12-28 01:00:20,165][106225] Updated weights for policy 1, policy_version 802360 (0.0008) [2023-12-28 01:00:20,221][106225] Updated weights for policy 1, policy_version 802370 (0.0008) [2023-12-28 01:00:20,239][106226] Updated weights for policy 0, policy_version 800202 (0.0008) [2023-12-28 01:00:20,302][106226] Updated weights for policy 0, policy_version 800212 (0.0008) [2023-12-28 01:00:20,362][106226] Updated weights for policy 0, policy_version 800222 (0.0007) [2023-12-28 01:00:20,416][106226] Updated weights for policy 0, policy_version 800232 (0.0008) [2023-12-28 01:00:21,009][106225] Updated weights for policy 1, policy_version 802380 (0.0008) [2023-12-28 01:00:21,072][106225] Updated weights for policy 1, policy_version 802390 (0.0009) [2023-12-28 01:00:21,128][106225] Updated weights for policy 1, policy_version 802400 (0.0009) [2023-12-28 01:00:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 410361856. Throughput: 0: 9894.7, 1: 9808.6. Samples: 410377700. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:21,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.157')] [2023-12-28 01:00:21,195][106226] Updated weights for policy 0, policy_version 800242 (0.0009) [2023-12-28 01:00:21,252][106226] Updated weights for policy 0, policy_version 800252 (0.0009) [2023-12-28 01:00:21,313][106226] Updated weights for policy 0, policy_version 800262 (0.0009) [2023-12-28 01:00:21,980][106225] Updated weights for policy 1, policy_version 802410 (0.0010) [2023-12-28 01:00:22,042][106225] Updated weights for policy 1, policy_version 802420 (0.0008) [2023-12-28 01:00:22,101][106225] Updated weights for policy 1, policy_version 802430 (0.0009) [2023-12-28 01:00:22,148][106226] Updated weights for policy 0, policy_version 800272 (0.0009) [2023-12-28 01:00:22,162][106225] Updated weights for policy 1, policy_version 802440 (0.0007) [2023-12-28 01:00:22,210][106226] Updated weights for policy 0, policy_version 800282 (0.0008) [2023-12-28 01:00:22,270][106226] Updated weights for policy 0, policy_version 800292 (0.0009) [2023-12-28 01:00:22,875][106225] Updated weights for policy 1, policy_version 802450 (0.0008) [2023-12-28 01:00:22,942][106225] Updated weights for policy 1, policy_version 802460 (0.0009) [2023-12-28 01:00:22,972][106226] Updated weights for policy 0, policy_version 800302 (0.0008) [2023-12-28 01:00:22,996][106225] Updated weights for policy 1, policy_version 802470 (0.0006) [2023-12-28 01:00:23,030][106226] Updated weights for policy 0, policy_version 800312 (0.0007) [2023-12-28 01:00:23,090][106226] Updated weights for policy 0, policy_version 800322 (0.0008) [2023-12-28 01:00:23,572][106225] Updated weights for policy 1, policy_version 802480 (0.0010) [2023-12-28 01:00:23,635][106225] Updated weights for policy 1, policy_version 802490 (0.0009) [2023-12-28 01:00:23,689][106225] Updated weights for policy 1, policy_version 802500 (0.0009) [2023-12-28 01:00:23,789][106226] Updated weights for policy 0, policy_version 800332 (0.0008) [2023-12-28 01:00:23,854][106226] Updated weights for policy 0, policy_version 800342 (0.0009) [2023-12-28 01:00:23,920][106226] Updated weights for policy 0, policy_version 800352 (0.0009) [2023-12-28 01:00:24,419][106225] Updated weights for policy 1, policy_version 802510 (0.0009) [2023-12-28 01:00:24,483][106225] Updated weights for policy 1, policy_version 802520 (0.0006) [2023-12-28 01:00:24,549][106225] Updated weights for policy 1, policy_version 802530 (0.0007) [2023-12-28 01:00:24,638][106226] Updated weights for policy 0, policy_version 800362 (0.0009) [2023-12-28 01:00:24,712][106226] Updated weights for policy 0, policy_version 800372 (0.0009) [2023-12-28 01:00:24,775][106226] Updated weights for policy 0, policy_version 800382 (0.0010) [2023-12-28 01:00:24,835][106226] Updated weights for policy 0, policy_version 800392 (0.0006) [2023-12-28 01:00:25,246][106225] Updated weights for policy 1, policy_version 802540 (0.0010) [2023-12-28 01:00:25,296][106225] Updated weights for policy 1, policy_version 802550 (0.0010) [2023-12-28 01:00:25,342][106225] Updated weights for policy 1, policy_version 802560 (0.0010) [2023-12-28 01:00:25,426][106226] Updated weights for policy 0, policy_version 800402 (0.0005) [2023-12-28 01:00:25,496][106226] Updated weights for policy 0, policy_version 800412 (0.0007) [2023-12-28 01:00:25,557][106226] Updated weights for policy 0, policy_version 800422 (0.0006) [2023-12-28 01:00:26,071][106225] Updated weights for policy 1, policy_version 802570 (0.0010) [2023-12-28 01:00:26,122][106225] Updated weights for policy 1, policy_version 802580 (0.0010) [2023-12-28 01:00:26,173][106225] Updated weights for policy 1, policy_version 802590 (0.0010) [2023-12-28 01:00:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 410460160. Throughput: 0: 9876.9, 1: 9793.2. Samples: 410434576. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:26,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.337')] [2023-12-28 01:00:26,192][106226] Updated weights for policy 0, policy_version 800432 (0.0010) [2023-12-28 01:00:26,224][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000802600_205504512.pth... [2023-12-28 01:00:26,226][106225] Updated weights for policy 1, policy_version 802600 (0.0010) [2023-12-28 01:00:26,228][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000801448_205209600.pth [2023-12-28 01:00:26,243][106226] Updated weights for policy 0, policy_version 800442 (0.0010) [2023-12-28 01:00:26,301][106226] Updated weights for policy 0, policy_version 800452 (0.0010) [2023-12-28 01:00:26,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000800456_204972032.pth... [2023-12-28 01:00:26,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000799272_204668928.pth [2023-12-28 01:00:26,931][106225] Updated weights for policy 1, policy_version 802610 (0.0005) [2023-12-28 01:00:26,983][106225] Updated weights for policy 1, policy_version 802620 (0.0007) [2023-12-28 01:00:27,020][106226] Updated weights for policy 0, policy_version 800462 (0.0010) [2023-12-28 01:00:27,033][106225] Updated weights for policy 1, policy_version 802630 (0.0005) [2023-12-28 01:00:27,074][106226] Updated weights for policy 0, policy_version 800472 (0.0010) [2023-12-28 01:00:27,130][106226] Updated weights for policy 0, policy_version 800482 (0.0011) [2023-12-28 01:00:27,726][106225] Updated weights for policy 1, policy_version 802640 (0.0006) [2023-12-28 01:00:27,742][106226] Updated weights for policy 0, policy_version 800492 (0.0009) [2023-12-28 01:00:27,784][106225] Updated weights for policy 1, policy_version 802650 (0.0005) [2023-12-28 01:00:27,803][106226] Updated weights for policy 0, policy_version 800502 (0.0005) [2023-12-28 01:00:27,837][106225] Updated weights for policy 1, policy_version 802660 (0.0005) [2023-12-28 01:00:27,871][106226] Updated weights for policy 0, policy_version 800512 (0.0005) [2023-12-28 01:00:28,382][106225] Updated weights for policy 1, policy_version 802670 (0.0006) [2023-12-28 01:00:28,397][106226] Updated weights for policy 0, policy_version 800522 (0.0006) [2023-12-28 01:00:28,443][106225] Updated weights for policy 1, policy_version 802680 (0.0008) [2023-12-28 01:00:28,444][106226] Updated weights for policy 0, policy_version 800532 (0.0010) [2023-12-28 01:00:28,490][106226] Updated weights for policy 0, policy_version 800542 (0.0007) [2023-12-28 01:00:28,490][106225] Updated weights for policy 1, policy_version 802690 (0.0010) [2023-12-28 01:00:28,547][106226] Updated weights for policy 0, policy_version 800552 (0.0010) [2023-12-28 01:00:29,239][106225] Updated weights for policy 1, policy_version 802700 (0.0009) [2023-12-28 01:00:29,270][106226] Updated weights for policy 0, policy_version 800562 (0.0008) [2023-12-28 01:00:29,300][106225] Updated weights for policy 1, policy_version 802710 (0.0007) [2023-12-28 01:00:29,336][106226] Updated weights for policy 0, policy_version 800572 (0.0006) [2023-12-28 01:00:29,366][106225] Updated weights for policy 1, policy_version 802720 (0.0008) [2023-12-28 01:00:29,411][106226] Updated weights for policy 0, policy_version 800582 (0.0009) [2023-12-28 01:00:30,030][106225] Updated weights for policy 1, policy_version 802730 (0.0007) [2023-12-28 01:00:30,085][106225] Updated weights for policy 1, policy_version 802740 (0.0008) [2023-12-28 01:00:30,106][106226] Updated weights for policy 0, policy_version 800592 (0.0006) [2023-12-28 01:00:30,142][106225] Updated weights for policy 1, policy_version 802750 (0.0008) [2023-12-28 01:00:30,163][106226] Updated weights for policy 0, policy_version 800602 (0.0008) [2023-12-28 01:00:30,201][106225] Updated weights for policy 1, policy_version 802760 (0.0008) [2023-12-28 01:00:30,232][106226] Updated weights for policy 0, policy_version 800612 (0.0008) [2023-12-28 01:00:30,895][106226] Updated weights for policy 0, policy_version 800622 (0.0008) [2023-12-28 01:00:30,914][106225] Updated weights for policy 1, policy_version 802770 (0.0009) [2023-12-28 01:00:30,939][106226] Updated weights for policy 0, policy_version 800632 (0.0005) [2023-12-28 01:00:30,959][106225] Updated weights for policy 1, policy_version 802780 (0.0009) [2023-12-28 01:00:30,994][106226] Updated weights for policy 0, policy_version 800642 (0.0006) [2023-12-28 01:00:31,014][106225] Updated weights for policy 1, policy_version 802790 (0.0010) [2023-12-28 01:00:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 410574848. Throughput: 0: 9970.7, 1: 9871.8. Samples: 410558484. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:31,175][105115] Avg episode reward: [(0, '-4.153'), (1, '-5.254')] [2023-12-28 01:00:31,693][106226] Updated weights for policy 0, policy_version 800652 (0.0008) [2023-12-28 01:00:31,761][106226] Updated weights for policy 0, policy_version 800662 (0.0008) [2023-12-28 01:00:31,819][106225] Updated weights for policy 1, policy_version 802800 (0.0010) [2023-12-28 01:00:31,822][106226] Updated weights for policy 0, policy_version 800672 (0.0007) [2023-12-28 01:00:31,879][106225] Updated weights for policy 1, policy_version 802810 (0.0010) [2023-12-28 01:00:31,946][106225] Updated weights for policy 1, policy_version 802820 (0.0010) [2023-12-28 01:00:32,483][106226] Updated weights for policy 0, policy_version 800682 (0.0007) [2023-12-28 01:00:32,541][106226] Updated weights for policy 0, policy_version 800692 (0.0006) [2023-12-28 01:00:32,606][106226] Updated weights for policy 0, policy_version 800702 (0.0007) [2023-12-28 01:00:32,642][106225] Updated weights for policy 1, policy_version 802830 (0.0008) [2023-12-28 01:00:32,660][106226] Updated weights for policy 0, policy_version 800712 (0.0007) [2023-12-28 01:00:32,700][106225] Updated weights for policy 1, policy_version 802840 (0.0005) [2023-12-28 01:00:32,747][106225] Updated weights for policy 1, policy_version 802850 (0.0005) [2023-12-28 01:00:33,269][106226] Updated weights for policy 0, policy_version 800722 (0.0008) [2023-12-28 01:00:33,329][106226] Updated weights for policy 0, policy_version 800732 (0.0008) [2023-12-28 01:00:33,344][106225] Updated weights for policy 1, policy_version 802860 (0.0007) [2023-12-28 01:00:33,384][106226] Updated weights for policy 0, policy_version 800742 (0.0008) [2023-12-28 01:00:33,393][106225] Updated weights for policy 1, policy_version 802870 (0.0010) [2023-12-28 01:00:33,452][106225] Updated weights for policy 1, policy_version 802880 (0.0008) [2023-12-28 01:00:34,031][106225] Updated weights for policy 1, policy_version 802890 (0.0009) [2023-12-28 01:00:34,070][106226] Updated weights for policy 0, policy_version 800752 (0.0007) [2023-12-28 01:00:34,091][106225] Updated weights for policy 1, policy_version 802900 (0.0008) [2023-12-28 01:00:34,127][106226] Updated weights for policy 0, policy_version 800762 (0.0005) [2023-12-28 01:00:34,152][106225] Updated weights for policy 1, policy_version 802910 (0.0010) [2023-12-28 01:00:34,198][106226] Updated weights for policy 0, policy_version 800772 (0.0009) [2023-12-28 01:00:34,210][106225] Updated weights for policy 1, policy_version 802920 (0.0010) [2023-12-28 01:00:34,885][106226] Updated weights for policy 0, policy_version 800782 (0.0007) [2023-12-28 01:00:34,923][106225] Updated weights for policy 1, policy_version 802930 (0.0006) [2023-12-28 01:00:34,939][106226] Updated weights for policy 0, policy_version 800792 (0.0006) [2023-12-28 01:00:34,974][106225] Updated weights for policy 1, policy_version 802940 (0.0007) [2023-12-28 01:00:35,007][106226] Updated weights for policy 0, policy_version 800802 (0.0009) [2023-12-28 01:00:35,024][106225] Updated weights for policy 1, policy_version 802950 (0.0009) [2023-12-28 01:00:35,694][106226] Updated weights for policy 0, policy_version 800812 (0.0009) [2023-12-28 01:00:35,709][106225] Updated weights for policy 1, policy_version 802960 (0.0010) [2023-12-28 01:00:35,757][106226] Updated weights for policy 0, policy_version 800822 (0.0009) [2023-12-28 01:00:35,763][106225] Updated weights for policy 1, policy_version 802970 (0.0006) [2023-12-28 01:00:35,819][106225] Updated weights for policy 1, policy_version 802980 (0.0008) [2023-12-28 01:00:35,821][106226] Updated weights for policy 0, policy_version 800832 (0.0007) [2023-12-28 01:00:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 410673152. Throughput: 0: 9952.6, 1: 9929.9. Samples: 410680564. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:36,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.709')] [2023-12-28 01:00:36,491][106225] Updated weights for policy 1, policy_version 802990 (0.0011) [2023-12-28 01:00:36,557][106225] Updated weights for policy 1, policy_version 803000 (0.0011) [2023-12-28 01:00:36,617][106225] Updated weights for policy 1, policy_version 803010 (0.0011) [2023-12-28 01:00:36,630][106226] Updated weights for policy 0, policy_version 800842 (0.0007) [2023-12-28 01:00:36,691][106226] Updated weights for policy 0, policy_version 800852 (0.0011) [2023-12-28 01:00:36,777][106226] Updated weights for policy 0, policy_version 800862 (0.0011) [2023-12-28 01:00:36,832][106226] Updated weights for policy 0, policy_version 800872 (0.0010) [2023-12-28 01:00:37,222][106225] Updated weights for policy 1, policy_version 803020 (0.0010) [2023-12-28 01:00:37,286][106225] Updated weights for policy 1, policy_version 803030 (0.0010) [2023-12-28 01:00:37,353][106225] Updated weights for policy 1, policy_version 803040 (0.0010) [2023-12-28 01:00:37,523][106226] Updated weights for policy 0, policy_version 800882 (0.0008) [2023-12-28 01:00:37,574][106226] Updated weights for policy 0, policy_version 800892 (0.0008) [2023-12-28 01:00:37,625][106226] Updated weights for policy 0, policy_version 800902 (0.0009) [2023-12-28 01:00:37,956][106225] Updated weights for policy 1, policy_version 803050 (0.0010) [2023-12-28 01:00:38,015][106225] Updated weights for policy 1, policy_version 803060 (0.0005) [2023-12-28 01:00:38,064][106225] Updated weights for policy 1, policy_version 803070 (0.0005) [2023-12-28 01:00:38,117][106225] Updated weights for policy 1, policy_version 803080 (0.0006) [2023-12-28 01:00:38,451][106226] Updated weights for policy 0, policy_version 800912 (0.0009) [2023-12-28 01:00:38,516][106226] Updated weights for policy 0, policy_version 800922 (0.0009) [2023-12-28 01:00:38,570][106226] Updated weights for policy 0, policy_version 800932 (0.0008) [2023-12-28 01:00:38,774][106225] Updated weights for policy 1, policy_version 803090 (0.0009) [2023-12-28 01:00:38,834][106225] Updated weights for policy 1, policy_version 803100 (0.0008) [2023-12-28 01:00:38,890][106225] Updated weights for policy 1, policy_version 803110 (0.0009) [2023-12-28 01:00:39,323][106226] Updated weights for policy 0, policy_version 800942 (0.0009) [2023-12-28 01:00:39,396][106226] Updated weights for policy 0, policy_version 800952 (0.0008) [2023-12-28 01:00:39,474][106226] Updated weights for policy 0, policy_version 800962 (0.0008) [2023-12-28 01:00:39,690][106225] Updated weights for policy 1, policy_version 803120 (0.0006) [2023-12-28 01:00:39,749][106225] Updated weights for policy 1, policy_version 803130 (0.0006) [2023-12-28 01:00:39,813][106225] Updated weights for policy 1, policy_version 803140 (0.0008) [2023-12-28 01:00:40,188][106226] Updated weights for policy 0, policy_version 800972 (0.0007) [2023-12-28 01:00:40,248][106226] Updated weights for policy 0, policy_version 800982 (0.0009) [2023-12-28 01:00:40,312][106226] Updated weights for policy 0, policy_version 800992 (0.0007) [2023-12-28 01:00:40,534][106225] Updated weights for policy 1, policy_version 803150 (0.0009) [2023-12-28 01:00:40,596][106225] Updated weights for policy 1, policy_version 803160 (0.0008) [2023-12-28 01:00:40,652][106225] Updated weights for policy 1, policy_version 803170 (0.0007) [2023-12-28 01:00:40,999][106226] Updated weights for policy 0, policy_version 801002 (0.0007) [2023-12-28 01:00:41,069][106226] Updated weights for policy 0, policy_version 801012 (0.0007) [2023-12-28 01:00:41,138][106226] Updated weights for policy 0, policy_version 801022 (0.0008) [2023-12-28 01:00:41,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 410763264. Throughput: 0: 9928.9, 1: 10003.5. Samples: 410740420. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:41,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.000')] [2023-12-28 01:00:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000803176_205651968.pth... [2023-12-28 01:00:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000802024_205357056.pth [2023-12-28 01:00:41,204][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000801032_205119488.pth... [2023-12-28 01:00:41,206][106226] Updated weights for policy 0, policy_version 801032 (0.0008) [2023-12-28 01:00:41,209][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000799880_204824576.pth [2023-12-28 01:00:41,300][106225] Updated weights for policy 1, policy_version 803180 (0.0006) [2023-12-28 01:00:41,365][106225] Updated weights for policy 1, policy_version 803190 (0.0008) [2023-12-28 01:00:41,440][106225] Updated weights for policy 1, policy_version 803200 (0.0008) [2023-12-28 01:00:41,937][106226] Updated weights for policy 0, policy_version 801042 (0.0008) [2023-12-28 01:00:41,997][106226] Updated weights for policy 0, policy_version 801052 (0.0009) [2023-12-28 01:00:42,062][106226] Updated weights for policy 0, policy_version 801062 (0.0009) [2023-12-28 01:00:42,207][106225] Updated weights for policy 1, policy_version 803210 (0.0008) [2023-12-28 01:00:42,268][106225] Updated weights for policy 1, policy_version 803220 (0.0006) [2023-12-28 01:00:42,327][106225] Updated weights for policy 1, policy_version 803230 (0.0008) [2023-12-28 01:00:42,398][106225] Updated weights for policy 1, policy_version 803240 (0.0009) [2023-12-28 01:00:42,804][106226] Updated weights for policy 0, policy_version 801072 (0.0008) [2023-12-28 01:00:42,863][106226] Updated weights for policy 0, policy_version 801082 (0.0008) [2023-12-28 01:00:42,921][106226] Updated weights for policy 0, policy_version 801092 (0.0008) [2023-12-28 01:00:43,074][106225] Updated weights for policy 1, policy_version 803250 (0.0008) [2023-12-28 01:00:43,123][106225] Updated weights for policy 1, policy_version 803260 (0.0008) [2023-12-28 01:00:43,185][106225] Updated weights for policy 1, policy_version 803270 (0.0008) [2023-12-28 01:00:43,662][106226] Updated weights for policy 0, policy_version 801102 (0.0009) [2023-12-28 01:00:43,711][106226] Updated weights for policy 0, policy_version 801112 (0.0009) [2023-12-28 01:00:43,763][106226] Updated weights for policy 0, policy_version 801122 (0.0008) [2023-12-28 01:00:43,834][106225] Updated weights for policy 1, policy_version 803280 (0.0006) [2023-12-28 01:00:43,887][106225] Updated weights for policy 1, policy_version 803290 (0.0005) [2023-12-28 01:00:43,936][106225] Updated weights for policy 1, policy_version 803300 (0.0005) [2023-12-28 01:00:44,490][106225] Updated weights for policy 1, policy_version 803310 (0.0007) [2023-12-28 01:00:44,546][106225] Updated weights for policy 1, policy_version 803320 (0.0010) [2023-12-28 01:00:44,594][106226] Updated weights for policy 0, policy_version 801132 (0.0007) [2023-12-28 01:00:44,606][106225] Updated weights for policy 1, policy_version 803330 (0.0010) [2023-12-28 01:00:44,640][106226] Updated weights for policy 0, policy_version 801142 (0.0008) [2023-12-28 01:00:44,693][106226] Updated weights for policy 0, policy_version 801152 (0.0008) [2023-12-28 01:00:45,333][106225] Updated weights for policy 1, policy_version 803340 (0.0010) [2023-12-28 01:00:45,383][106225] Updated weights for policy 1, policy_version 803350 (0.0009) [2023-12-28 01:00:45,433][106225] Updated weights for policy 1, policy_version 803360 (0.0008) [2023-12-28 01:00:45,468][106226] Updated weights for policy 0, policy_version 801162 (0.0008) [2023-12-28 01:00:45,525][106226] Updated weights for policy 0, policy_version 801172 (0.0007) [2023-12-28 01:00:45,584][106226] Updated weights for policy 0, policy_version 801182 (0.0008) [2023-12-28 01:00:45,649][106226] Updated weights for policy 0, policy_version 801192 (0.0008) [2023-12-28 01:00:46,167][106225] Updated weights for policy 1, policy_version 803370 (0.0008) [2023-12-28 01:00:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 410861568. Throughput: 0: 9887.1, 1: 10032.3. Samples: 410855696. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:46,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-4.935')] [2023-12-28 01:00:46,216][106225] Updated weights for policy 1, policy_version 803380 (0.0008) [2023-12-28 01:00:46,252][106226] Updated weights for policy 0, policy_version 801202 (0.0010) [2023-12-28 01:00:46,268][106225] Updated weights for policy 1, policy_version 803390 (0.0009) [2023-12-28 01:00:46,302][106226] Updated weights for policy 0, policy_version 801212 (0.0010) [2023-12-28 01:00:46,318][106225] Updated weights for policy 1, policy_version 803400 (0.0007) [2023-12-28 01:00:46,347][106226] Updated weights for policy 0, policy_version 801222 (0.0009) [2023-12-28 01:00:46,881][106225] Updated weights for policy 1, policy_version 803410 (0.0007) [2023-12-28 01:00:46,936][106225] Updated weights for policy 1, policy_version 803420 (0.0010) [2023-12-28 01:00:46,993][106225] Updated weights for policy 1, policy_version 803430 (0.0010) [2023-12-28 01:00:47,040][106226] Updated weights for policy 0, policy_version 801232 (0.0009) [2023-12-28 01:00:47,097][106226] Updated weights for policy 0, policy_version 801242 (0.0009) [2023-12-28 01:00:47,166][106226] Updated weights for policy 0, policy_version 801252 (0.0010) [2023-12-28 01:00:47,654][106225] Updated weights for policy 1, policy_version 803440 (0.0006) [2023-12-28 01:00:47,712][106225] Updated weights for policy 1, policy_version 803450 (0.0010) [2023-12-28 01:00:47,738][106226] Updated weights for policy 0, policy_version 801262 (0.0009) [2023-12-28 01:00:47,772][106225] Updated weights for policy 1, policy_version 803460 (0.0010) [2023-12-28 01:00:47,792][106226] Updated weights for policy 0, policy_version 801272 (0.0010) [2023-12-28 01:00:47,839][106226] Updated weights for policy 0, policy_version 801282 (0.0010) [2023-12-28 01:00:48,410][106225] Updated weights for policy 1, policy_version 803470 (0.0010) [2023-12-28 01:00:48,474][106225] Updated weights for policy 1, policy_version 803480 (0.0010) [2023-12-28 01:00:48,531][106225] Updated weights for policy 1, policy_version 803490 (0.0010) [2023-12-28 01:00:48,558][106226] Updated weights for policy 0, policy_version 801292 (0.0010) [2023-12-28 01:00:48,615][106226] Updated weights for policy 0, policy_version 801302 (0.0011) [2023-12-28 01:00:48,679][106226] Updated weights for policy 0, policy_version 801312 (0.0010) [2023-12-28 01:00:49,173][106225] Updated weights for policy 1, policy_version 803500 (0.0008) [2023-12-28 01:00:49,247][106225] Updated weights for policy 1, policy_version 803510 (0.0008) [2023-12-28 01:00:49,302][106225] Updated weights for policy 1, policy_version 803520 (0.0009) [2023-12-28 01:00:49,305][106226] Updated weights for policy 0, policy_version 801322 (0.0010) [2023-12-28 01:00:49,365][106226] Updated weights for policy 0, policy_version 801332 (0.0009) [2023-12-28 01:00:49,426][106226] Updated weights for policy 0, policy_version 801342 (0.0009) [2023-12-28 01:00:49,482][106226] Updated weights for policy 0, policy_version 801352 (0.0009) [2023-12-28 01:00:50,097][106225] Updated weights for policy 1, policy_version 803530 (0.0010) [2023-12-28 01:00:50,161][106225] Updated weights for policy 1, policy_version 803540 (0.0008) [2023-12-28 01:00:50,216][106225] Updated weights for policy 1, policy_version 803550 (0.0008) [2023-12-28 01:00:50,281][106225] Updated weights for policy 1, policy_version 803560 (0.0009) [2023-12-28 01:00:50,316][106226] Updated weights for policy 0, policy_version 801362 (0.0011) [2023-12-28 01:00:50,374][106226] Updated weights for policy 0, policy_version 801372 (0.0011) [2023-12-28 01:00:50,440][106226] Updated weights for policy 0, policy_version 801382 (0.0011) [2023-12-28 01:00:51,022][106225] Updated weights for policy 1, policy_version 803570 (0.0008) [2023-12-28 01:00:51,084][106225] Updated weights for policy 1, policy_version 803580 (0.0008) [2023-12-28 01:00:51,152][106225] Updated weights for policy 1, policy_version 803590 (0.0008) [2023-12-28 01:00:51,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 410968064. Throughput: 0: 9853.5, 1: 10058.2. Samples: 410977176. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:51,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-4.883')] [2023-12-28 01:00:51,210][106226] Updated weights for policy 0, policy_version 801392 (0.0009) [2023-12-28 01:00:51,274][106226] Updated weights for policy 0, policy_version 801402 (0.0011) [2023-12-28 01:00:51,338][106226] Updated weights for policy 0, policy_version 801412 (0.0011) [2023-12-28 01:00:51,943][106225] Updated weights for policy 1, policy_version 803600 (0.0008) [2023-12-28 01:00:51,998][106225] Updated weights for policy 1, policy_version 803610 (0.0008) [2023-12-28 01:00:52,060][106225] Updated weights for policy 1, policy_version 803620 (0.0008) [2023-12-28 01:00:52,101][106226] Updated weights for policy 0, policy_version 801422 (0.0010) [2023-12-28 01:00:52,163][106226] Updated weights for policy 0, policy_version 801432 (0.0008) [2023-12-28 01:00:52,225][106226] Updated weights for policy 0, policy_version 801442 (0.0008) [2023-12-28 01:00:52,808][106225] Updated weights for policy 1, policy_version 803630 (0.0008) [2023-12-28 01:00:52,871][106225] Updated weights for policy 1, policy_version 803640 (0.0007) [2023-12-28 01:00:52,939][106225] Updated weights for policy 1, policy_version 803650 (0.0007) [2023-12-28 01:00:53,043][106226] Updated weights for policy 0, policy_version 801452 (0.0009) [2023-12-28 01:00:53,097][106226] Updated weights for policy 0, policy_version 801462 (0.0009) [2023-12-28 01:00:53,157][106226] Updated weights for policy 0, policy_version 801472 (0.0010) [2023-12-28 01:00:53,601][106225] Updated weights for policy 1, policy_version 803660 (0.0007) [2023-12-28 01:00:53,656][106225] Updated weights for policy 1, policy_version 803670 (0.0005) [2023-12-28 01:00:53,720][106225] Updated weights for policy 1, policy_version 803680 (0.0007) [2023-12-28 01:00:53,831][106226] Updated weights for policy 0, policy_version 801482 (0.0009) [2023-12-28 01:00:53,877][106226] Updated weights for policy 0, policy_version 801492 (0.0009) [2023-12-28 01:00:53,925][106226] Updated weights for policy 0, policy_version 801502 (0.0008) [2023-12-28 01:00:53,974][106226] Updated weights for policy 0, policy_version 801512 (0.0005) [2023-12-28 01:00:54,449][106225] Updated weights for policy 1, policy_version 803690 (0.0008) [2023-12-28 01:00:54,509][106225] Updated weights for policy 1, policy_version 803700 (0.0008) [2023-12-28 01:00:54,565][106225] Updated weights for policy 1, policy_version 803710 (0.0008) [2023-12-28 01:00:54,624][106225] Updated weights for policy 1, policy_version 803720 (0.0005) [2023-12-28 01:00:54,648][106226] Updated weights for policy 0, policy_version 801522 (0.0011) [2023-12-28 01:00:54,711][106226] Updated weights for policy 0, policy_version 801532 (0.0007) [2023-12-28 01:00:54,775][106226] Updated weights for policy 0, policy_version 801542 (0.0008) [2023-12-28 01:00:55,372][106225] Updated weights for policy 1, policy_version 803730 (0.0011) [2023-12-28 01:00:55,431][106225] Updated weights for policy 1, policy_version 803740 (0.0010) [2023-12-28 01:00:55,499][106225] Updated weights for policy 1, policy_version 803750 (0.0008) [2023-12-28 01:00:55,515][106226] Updated weights for policy 0, policy_version 801552 (0.0010) [2023-12-28 01:00:55,577][106226] Updated weights for policy 0, policy_version 801562 (0.0011) [2023-12-28 01:00:55,638][106226] Updated weights for policy 0, policy_version 801572 (0.0011) [2023-12-28 01:00:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 411058176. Throughput: 0: 9813.6, 1: 9993.5. Samples: 411032796. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:00:56,175][105115] Avg episode reward: [(0, '-3.995'), (1, '-5.211')] [2023-12-28 01:00:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000801576_205258752.pth... [2023-12-28 01:00:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000800456_204972032.pth [2023-12-28 01:00:56,225][106225] Updated weights for policy 1, policy_version 803760 (0.0009) [2023-12-28 01:00:56,282][106225] Updated weights for policy 1, policy_version 803770 (0.0010) [2023-12-28 01:00:56,334][106225] Updated weights for policy 1, policy_version 803780 (0.0008) [2023-12-28 01:00:56,353][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000803784_205807616.pth... [2023-12-28 01:00:56,358][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000802600_205504512.pth [2023-12-28 01:00:56,369][106226] Updated weights for policy 0, policy_version 801582 (0.0011) [2023-12-28 01:00:56,430][106226] Updated weights for policy 0, policy_version 801592 (0.0011) [2023-12-28 01:00:56,492][106226] Updated weights for policy 0, policy_version 801602 (0.0011) [2023-12-28 01:00:57,073][106225] Updated weights for policy 1, policy_version 803790 (0.0007) [2023-12-28 01:00:57,134][106225] Updated weights for policy 1, policy_version 803800 (0.0008) [2023-12-28 01:00:57,200][106225] Updated weights for policy 1, policy_version 803810 (0.0008) [2023-12-28 01:00:57,201][106226] Updated weights for policy 0, policy_version 801612 (0.0010) [2023-12-28 01:00:57,269][106226] Updated weights for policy 0, policy_version 801622 (0.0006) [2023-12-28 01:00:57,336][106226] Updated weights for policy 0, policy_version 801632 (0.0010) [2023-12-28 01:00:57,789][106225] Updated weights for policy 1, policy_version 803820 (0.0007) [2023-12-28 01:00:57,856][106225] Updated weights for policy 1, policy_version 803830 (0.0008) [2023-12-28 01:00:57,906][106225] Updated weights for policy 1, policy_version 803840 (0.0008) [2023-12-28 01:00:58,012][106226] Updated weights for policy 0, policy_version 801642 (0.0010) [2023-12-28 01:00:58,070][106226] Updated weights for policy 0, policy_version 801652 (0.0006) [2023-12-28 01:00:58,132][106226] Updated weights for policy 0, policy_version 801662 (0.0009) [2023-12-28 01:00:58,193][106226] Updated weights for policy 0, policy_version 801672 (0.0011) [2023-12-28 01:00:58,712][106225] Updated weights for policy 1, policy_version 803850 (0.0008) [2023-12-28 01:00:58,781][106225] Updated weights for policy 1, policy_version 803860 (0.0009) [2023-12-28 01:00:58,855][106225] Updated weights for policy 1, policy_version 803870 (0.0009) [2023-12-28 01:00:58,931][106225] Updated weights for policy 1, policy_version 803880 (0.0008) [2023-12-28 01:00:59,049][106226] Updated weights for policy 0, policy_version 801682 (0.0009) [2023-12-28 01:00:59,111][106226] Updated weights for policy 0, policy_version 801692 (0.0008) [2023-12-28 01:00:59,162][106226] Updated weights for policy 0, policy_version 801702 (0.0010) [2023-12-28 01:00:59,778][106225] Updated weights for policy 1, policy_version 803890 (0.0010) [2023-12-28 01:00:59,839][106225] Updated weights for policy 1, policy_version 803900 (0.0010) [2023-12-28 01:00:59,905][106225] Updated weights for policy 1, policy_version 803910 (0.0010) [2023-12-28 01:00:59,953][106226] Updated weights for policy 0, policy_version 801712 (0.0008) [2023-12-28 01:01:00,018][106226] Updated weights for policy 0, policy_version 801722 (0.0008) [2023-12-28 01:01:00,075][106226] Updated weights for policy 0, policy_version 801732 (0.0006) [2023-12-28 01:01:00,660][106225] Updated weights for policy 1, policy_version 803920 (0.0008) [2023-12-28 01:01:00,702][106226] Updated weights for policy 0, policy_version 801742 (0.0008) [2023-12-28 01:01:00,714][106225] Updated weights for policy 1, policy_version 803930 (0.0005) [2023-12-28 01:01:00,768][106225] Updated weights for policy 1, policy_version 803940 (0.0005) [2023-12-28 01:01:00,768][106226] Updated weights for policy 0, policy_version 801752 (0.0007) [2023-12-28 01:01:00,824][106226] Updated weights for policy 0, policy_version 801762 (0.0005) [2023-12-28 01:01:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 411156480. Throughput: 0: 9745.8, 1: 9908.6. Samples: 411144956. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:01:01,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.936')] [2023-12-28 01:01:01,490][106225] Updated weights for policy 1, policy_version 803950 (0.0007) [2023-12-28 01:01:01,503][106226] Updated weights for policy 0, policy_version 801772 (0.0006) [2023-12-28 01:01:01,552][106225] Updated weights for policy 1, policy_version 803960 (0.0006) [2023-12-28 01:01:01,569][106226] Updated weights for policy 0, policy_version 801782 (0.0010) [2023-12-28 01:01:01,623][106225] Updated weights for policy 1, policy_version 803970 (0.0008) [2023-12-28 01:01:01,641][106226] Updated weights for policy 0, policy_version 801792 (0.0007) [2023-12-28 01:01:02,358][106226] Updated weights for policy 0, policy_version 801802 (0.0009) [2023-12-28 01:01:02,421][106226] Updated weights for policy 0, policy_version 801812 (0.0008) [2023-12-28 01:01:02,423][106225] Updated weights for policy 1, policy_version 803980 (0.0008) [2023-12-28 01:01:02,476][106226] Updated weights for policy 0, policy_version 801822 (0.0008) [2023-12-28 01:01:02,484][106225] Updated weights for policy 1, policy_version 803990 (0.0007) [2023-12-28 01:01:02,531][106226] Updated weights for policy 0, policy_version 801832 (0.0008) [2023-12-28 01:01:02,538][106225] Updated weights for policy 1, policy_version 804000 (0.0007) [2023-12-28 01:01:03,252][106225] Updated weights for policy 1, policy_version 804010 (0.0009) [2023-12-28 01:01:03,270][106226] Updated weights for policy 0, policy_version 801842 (0.0008) [2023-12-28 01:01:03,303][106225] Updated weights for policy 1, policy_version 804020 (0.0005) [2023-12-28 01:01:03,326][106226] Updated weights for policy 0, policy_version 801852 (0.0007) [2023-12-28 01:01:03,356][106225] Updated weights for policy 1, policy_version 804030 (0.0010) [2023-12-28 01:01:03,384][106226] Updated weights for policy 0, policy_version 801862 (0.0009) [2023-12-28 01:01:03,409][106225] Updated weights for policy 1, policy_version 804040 (0.0010) [2023-12-28 01:01:04,115][106226] Updated weights for policy 0, policy_version 801872 (0.0007) [2023-12-28 01:01:04,138][106225] Updated weights for policy 1, policy_version 804050 (0.0006) [2023-12-28 01:01:04,182][106226] Updated weights for policy 0, policy_version 801882 (0.0008) [2023-12-28 01:01:04,200][106225] Updated weights for policy 1, policy_version 804060 (0.0007) [2023-12-28 01:01:04,246][106226] Updated weights for policy 0, policy_version 801892 (0.0006) [2023-12-28 01:01:04,266][106225] Updated weights for policy 1, policy_version 804070 (0.0008) [2023-12-28 01:01:04,924][106226] Updated weights for policy 0, policy_version 801902 (0.0008) [2023-12-28 01:01:04,982][106226] Updated weights for policy 0, policy_version 801912 (0.0008) [2023-12-28 01:01:05,021][106225] Updated weights for policy 1, policy_version 804080 (0.0010) [2023-12-28 01:01:05,040][106226] Updated weights for policy 0, policy_version 801922 (0.0007) [2023-12-28 01:01:05,082][106225] Updated weights for policy 1, policy_version 804090 (0.0008) [2023-12-28 01:01:05,138][106225] Updated weights for policy 1, policy_version 804100 (0.0008) [2023-12-28 01:01:05,715][106226] Updated weights for policy 0, policy_version 801932 (0.0007) [2023-12-28 01:01:05,776][106226] Updated weights for policy 0, policy_version 801942 (0.0008) [2023-12-28 01:01:05,803][106225] Updated weights for policy 1, policy_version 804110 (0.0008) [2023-12-28 01:01:05,835][106226] Updated weights for policy 0, policy_version 801952 (0.0007) [2023-12-28 01:01:05,863][106225] Updated weights for policy 1, policy_version 804120 (0.0006) [2023-12-28 01:01:05,917][106225] Updated weights for policy 1, policy_version 804130 (0.0010) [2023-12-28 01:01:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 411254784. Throughput: 0: 9756.0, 1: 9895.5. Samples: 411262016. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:01:06,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.845')] [2023-12-28 01:01:06,472][106226] Updated weights for policy 0, policy_version 801962 (0.0006) [2023-12-28 01:01:06,534][106226] Updated weights for policy 0, policy_version 801972 (0.0007) [2023-12-28 01:01:06,603][106226] Updated weights for policy 0, policy_version 801982 (0.0007) [2023-12-28 01:01:06,648][106225] Updated weights for policy 1, policy_version 804140 (0.0010) [2023-12-28 01:01:06,666][106226] Updated weights for policy 0, policy_version 801992 (0.0007) [2023-12-28 01:01:06,714][106225] Updated weights for policy 1, policy_version 804150 (0.0011) [2023-12-28 01:01:06,779][106225] Updated weights for policy 1, policy_version 804160 (0.0010) [2023-12-28 01:01:07,302][106226] Updated weights for policy 0, policy_version 802002 (0.0011) [2023-12-28 01:01:07,362][106226] Updated weights for policy 0, policy_version 802012 (0.0011) [2023-12-28 01:01:07,389][106225] Updated weights for policy 1, policy_version 804170 (0.0008) [2023-12-28 01:01:07,413][106226] Updated weights for policy 0, policy_version 802022 (0.0011) [2023-12-28 01:01:07,453][106225] Updated weights for policy 1, policy_version 804180 (0.0005) [2023-12-28 01:01:07,512][106225] Updated weights for policy 1, policy_version 804190 (0.0007) [2023-12-28 01:01:07,564][106225] Updated weights for policy 1, policy_version 804200 (0.0010) [2023-12-28 01:01:08,045][106226] Updated weights for policy 0, policy_version 802032 (0.0009) [2023-12-28 01:01:08,112][106226] Updated weights for policy 0, policy_version 802042 (0.0010) [2023-12-28 01:01:08,172][106226] Updated weights for policy 0, policy_version 802052 (0.0010) [2023-12-28 01:01:08,292][106225] Updated weights for policy 1, policy_version 804210 (0.0010) [2023-12-28 01:01:08,359][106225] Updated weights for policy 1, policy_version 804220 (0.0010) [2023-12-28 01:01:08,424][106225] Updated weights for policy 1, policy_version 804230 (0.0010) [2023-12-28 01:01:08,904][106226] Updated weights for policy 0, policy_version 802062 (0.0010) [2023-12-28 01:01:08,952][106226] Updated weights for policy 0, policy_version 802072 (0.0008) [2023-12-28 01:01:09,009][106226] Updated weights for policy 0, policy_version 802082 (0.0009) [2023-12-28 01:01:09,023][106225] Updated weights for policy 1, policy_version 804240 (0.0006) [2023-12-28 01:01:09,072][106225] Updated weights for policy 1, policy_version 804250 (0.0006) [2023-12-28 01:01:09,116][106225] Updated weights for policy 1, policy_version 804260 (0.0005) [2023-12-28 01:01:09,786][106226] Updated weights for policy 0, policy_version 802092 (0.0009) [2023-12-28 01:01:09,851][106225] Updated weights for policy 1, policy_version 804270 (0.0006) [2023-12-28 01:01:09,861][106226] Updated weights for policy 0, policy_version 802102 (0.0008) [2023-12-28 01:01:09,916][106225] Updated weights for policy 1, policy_version 804280 (0.0007) [2023-12-28 01:01:09,924][106226] Updated weights for policy 0, policy_version 802112 (0.0007) [2023-12-28 01:01:09,987][106225] Updated weights for policy 1, policy_version 804290 (0.0006) [2023-12-28 01:01:10,561][106226] Updated weights for policy 0, policy_version 802122 (0.0008) [2023-12-28 01:01:10,627][106226] Updated weights for policy 0, policy_version 802132 (0.0008) [2023-12-28 01:01:10,696][106226] Updated weights for policy 0, policy_version 802142 (0.0009) [2023-12-28 01:01:10,735][106225] Updated weights for policy 1, policy_version 804300 (0.0008) [2023-12-28 01:01:10,760][106226] Updated weights for policy 0, policy_version 802152 (0.0007) [2023-12-28 01:01:10,791][106225] Updated weights for policy 1, policy_version 804310 (0.0007) [2023-12-28 01:01:10,850][106225] Updated weights for policy 1, policy_version 804320 (0.0008) [2023-12-28 01:01:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 411353088. Throughput: 0: 9804.5, 1: 9922.1. Samples: 411322276. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:01:11,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-5.241')] [2023-12-28 01:01:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000804328_205946880.pth... [2023-12-28 01:01:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000802152_205406208.pth... [2023-12-28 01:01:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000801032_205119488.pth [2023-12-28 01:01:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000803176_205651968.pth [2023-12-28 01:01:11,453][106226] Updated weights for policy 0, policy_version 802162 (0.0007) [2023-12-28 01:01:11,503][106226] Updated weights for policy 0, policy_version 802172 (0.0008) [2023-12-28 01:01:11,557][106226] Updated weights for policy 0, policy_version 802182 (0.0009) [2023-12-28 01:01:11,634][106225] Updated weights for policy 1, policy_version 804330 (0.0009) [2023-12-28 01:01:11,703][106225] Updated weights for policy 1, policy_version 804340 (0.0009) [2023-12-28 01:01:11,775][106225] Updated weights for policy 1, policy_version 804350 (0.0009) [2023-12-28 01:01:11,833][106225] Updated weights for policy 1, policy_version 804360 (0.0008) [2023-12-28 01:01:12,350][106226] Updated weights for policy 0, policy_version 802192 (0.0008) [2023-12-28 01:01:12,423][106226] Updated weights for policy 0, policy_version 802202 (0.0010) [2023-12-28 01:01:12,485][106226] Updated weights for policy 0, policy_version 802212 (0.0009) [2023-12-28 01:01:12,583][106225] Updated weights for policy 1, policy_version 804370 (0.0009) [2023-12-28 01:01:12,642][106225] Updated weights for policy 1, policy_version 804380 (0.0008) [2023-12-28 01:01:12,699][106225] Updated weights for policy 1, policy_version 804390 (0.0008) [2023-12-28 01:01:13,181][106226] Updated weights for policy 0, policy_version 802222 (0.0007) [2023-12-28 01:01:13,240][106226] Updated weights for policy 0, policy_version 802232 (0.0006) [2023-12-28 01:01:13,287][106226] Updated weights for policy 0, policy_version 802242 (0.0007) [2023-12-28 01:01:13,464][106225] Updated weights for policy 1, policy_version 804400 (0.0009) [2023-12-28 01:01:13,514][106225] Updated weights for policy 1, policy_version 804410 (0.0008) [2023-12-28 01:01:13,566][106225] Updated weights for policy 1, policy_version 804420 (0.0009) [2023-12-28 01:01:13,902][106226] Updated weights for policy 0, policy_version 802252 (0.0009) [2023-12-28 01:01:13,964][106226] Updated weights for policy 0, policy_version 802262 (0.0008) [2023-12-28 01:01:14,016][106226] Updated weights for policy 0, policy_version 802272 (0.0007) [2023-12-28 01:01:14,358][106225] Updated weights for policy 1, policy_version 804430 (0.0008) [2023-12-28 01:01:14,418][106225] Updated weights for policy 1, policy_version 804440 (0.0008) [2023-12-28 01:01:14,477][106225] Updated weights for policy 1, policy_version 804450 (0.0008) [2023-12-28 01:01:14,695][106226] Updated weights for policy 0, policy_version 802282 (0.0006) [2023-12-28 01:01:14,754][106226] Updated weights for policy 0, policy_version 802292 (0.0011) [2023-12-28 01:01:14,819][106226] Updated weights for policy 0, policy_version 802302 (0.0011) [2023-12-28 01:01:14,884][106226] Updated weights for policy 0, policy_version 802312 (0.0011) [2023-12-28 01:01:15,186][106225] Updated weights for policy 1, policy_version 804460 (0.0006) [2023-12-28 01:01:15,254][106225] Updated weights for policy 1, policy_version 804470 (0.0011) [2023-12-28 01:01:15,313][106225] Updated weights for policy 1, policy_version 804480 (0.0011) [2023-12-28 01:01:15,581][106226] Updated weights for policy 0, policy_version 802322 (0.0010) [2023-12-28 01:01:15,627][106226] Updated weights for policy 0, policy_version 802332 (0.0010) [2023-12-28 01:01:15,674][106226] Updated weights for policy 0, policy_version 802342 (0.0010) [2023-12-28 01:01:15,943][106225] Updated weights for policy 1, policy_version 804490 (0.0010) [2023-12-28 01:01:16,003][106225] Updated weights for policy 1, policy_version 804500 (0.0010) [2023-12-28 01:01:16,059][106225] Updated weights for policy 1, policy_version 804510 (0.0010) [2023-12-28 01:01:16,109][106225] Updated weights for policy 1, policy_version 804520 (0.0010) [2023-12-28 01:01:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 411451392. Throughput: 0: 9723.1, 1: 9789.1. Samples: 411436532. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:01:16,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.824')] [2023-12-28 01:01:16,374][106226] Updated weights for policy 0, policy_version 802352 (0.0007) [2023-12-28 01:01:16,440][106226] Updated weights for policy 0, policy_version 802362 (0.0006) [2023-12-28 01:01:16,511][106226] Updated weights for policy 0, policy_version 802372 (0.0007) [2023-12-28 01:01:16,768][106225] Updated weights for policy 1, policy_version 804530 (0.0010) [2023-12-28 01:01:16,818][106225] Updated weights for policy 1, policy_version 804540 (0.0010) [2023-12-28 01:01:16,881][106225] Updated weights for policy 1, policy_version 804550 (0.0010) [2023-12-28 01:01:17,132][106226] Updated weights for policy 0, policy_version 802382 (0.0010) [2023-12-28 01:01:17,182][106226] Updated weights for policy 0, policy_version 802392 (0.0010) [2023-12-28 01:01:17,232][106226] Updated weights for policy 0, policy_version 802402 (0.0010) [2023-12-28 01:01:17,528][106225] Updated weights for policy 1, policy_version 804560 (0.0008) [2023-12-28 01:01:17,579][106225] Updated weights for policy 1, policy_version 804570 (0.0008) [2023-12-28 01:01:17,624][106225] Updated weights for policy 1, policy_version 804580 (0.0007) [2023-12-28 01:01:17,948][106226] Updated weights for policy 0, policy_version 802412 (0.0010) [2023-12-28 01:01:18,003][106226] Updated weights for policy 0, policy_version 802422 (0.0010) [2023-12-28 01:01:18,060][106226] Updated weights for policy 0, policy_version 802432 (0.0010) [2023-12-28 01:01:18,408][106225] Updated weights for policy 1, policy_version 804590 (0.0008) [2023-12-28 01:01:18,464][106225] Updated weights for policy 1, policy_version 804600 (0.0009) [2023-12-28 01:01:18,520][106225] Updated weights for policy 1, policy_version 804610 (0.0008) [2023-12-28 01:01:18,701][106226] Updated weights for policy 0, policy_version 802442 (0.0007) [2023-12-28 01:01:18,754][106226] Updated weights for policy 0, policy_version 802452 (0.0006) [2023-12-28 01:01:18,808][106226] Updated weights for policy 0, policy_version 802462 (0.0006) [2023-12-28 01:01:18,867][106226] Updated weights for policy 0, policy_version 802472 (0.0006) [2023-12-28 01:01:19,335][106225] Updated weights for policy 1, policy_version 804620 (0.0008) [2023-12-28 01:01:19,402][106225] Updated weights for policy 1, policy_version 804630 (0.0007) [2023-12-28 01:01:19,460][106225] Updated weights for policy 1, policy_version 804640 (0.0006) [2023-12-28 01:01:19,508][106226] Updated weights for policy 0, policy_version 802482 (0.0008) [2023-12-28 01:01:19,567][106226] Updated weights for policy 0, policy_version 802492 (0.0009) [2023-12-28 01:01:19,615][106226] Updated weights for policy 0, policy_version 802502 (0.0010) [2023-12-28 01:01:20,244][106225] Updated weights for policy 1, policy_version 804650 (0.0008) [2023-12-28 01:01:20,301][106225] Updated weights for policy 1, policy_version 804660 (0.0007) [2023-12-28 01:01:20,366][106225] Updated weights for policy 1, policy_version 804670 (0.0008) [2023-12-28 01:01:20,390][106226] Updated weights for policy 0, policy_version 802512 (0.0011) [2023-12-28 01:01:20,427][106225] Updated weights for policy 1, policy_version 804680 (0.0006) [2023-12-28 01:01:20,448][106226] Updated weights for policy 0, policy_version 802522 (0.0011) [2023-12-28 01:01:20,495][106226] Updated weights for policy 0, policy_version 802532 (0.0010) [2023-12-28 01:01:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 411541504. Throughput: 0: 9709.5, 1: 9732.5. Samples: 411555456. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 01:01:21,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-5.062')] [2023-12-28 01:01:21,191][106225] Updated weights for policy 1, policy_version 804690 (0.0008) [2023-12-28 01:01:21,263][106225] Updated weights for policy 1, policy_version 804700 (0.0007) [2023-12-28 01:01:21,279][106226] Updated weights for policy 0, policy_version 802542 (0.0009) [2023-12-28 01:01:21,328][106225] Updated weights for policy 1, policy_version 804710 (0.0006) [2023-12-28 01:01:21,335][106226] Updated weights for policy 0, policy_version 802552 (0.0008) [2023-12-28 01:01:21,409][106226] Updated weights for policy 0, policy_version 802562 (0.0008) [2023-12-28 01:01:22,120][106225] Updated weights for policy 1, policy_version 804720 (0.0008) [2023-12-28 01:01:22,182][106225] Updated weights for policy 1, policy_version 804730 (0.0008) [2023-12-28 01:01:22,188][106226] Updated weights for policy 0, policy_version 802572 (0.0008) [2023-12-28 01:01:22,236][106226] Updated weights for policy 0, policy_version 802582 (0.0007) [2023-12-28 01:01:22,248][106225] Updated weights for policy 1, policy_version 804740 (0.0009) [2023-12-28 01:01:22,300][106226] Updated weights for policy 0, policy_version 802592 (0.0009) [2023-12-28 01:01:23,014][106225] Updated weights for policy 1, policy_version 804750 (0.0006) [2023-12-28 01:01:23,049][106226] Updated weights for policy 0, policy_version 802602 (0.0009) [2023-12-28 01:01:23,072][106225] Updated weights for policy 1, policy_version 804760 (0.0007) [2023-12-28 01:01:23,107][106226] Updated weights for policy 0, policy_version 802612 (0.0007) [2023-12-28 01:01:23,125][106225] Updated weights for policy 1, policy_version 804770 (0.0007) [2023-12-28 01:01:23,167][106226] Updated weights for policy 0, policy_version 802622 (0.0006) [2023-12-28 01:01:23,227][106226] Updated weights for policy 0, policy_version 802632 (0.0010) [2023-12-28 01:01:23,712][106225] Updated weights for policy 1, policy_version 804780 (0.0007) [2023-12-28 01:01:23,764][106225] Updated weights for policy 1, policy_version 804790 (0.0008) [2023-12-28 01:01:23,816][106225] Updated weights for policy 1, policy_version 804800 (0.0008) [2023-12-28 01:01:23,985][106226] Updated weights for policy 0, policy_version 802642 (0.0009) [2023-12-28 01:01:24,034][106226] Updated weights for policy 0, policy_version 802652 (0.0008) [2023-12-28 01:01:24,089][106226] Updated weights for policy 0, policy_version 802662 (0.0008) [2023-12-28 01:01:24,478][106225] Updated weights for policy 1, policy_version 804810 (0.0006) [2023-12-28 01:01:24,534][106225] Updated weights for policy 1, policy_version 804820 (0.0009) [2023-12-28 01:01:24,591][106225] Updated weights for policy 1, policy_version 804830 (0.0008) [2023-12-28 01:01:24,647][106225] Updated weights for policy 1, policy_version 804840 (0.0008) [2023-12-28 01:01:24,820][106226] Updated weights for policy 0, policy_version 802672 (0.0009) [2023-12-28 01:01:24,880][106226] Updated weights for policy 0, policy_version 802682 (0.0009) [2023-12-28 01:01:24,931][106226] Updated weights for policy 0, policy_version 802692 (0.0008) [2023-12-28 01:01:25,406][106225] Updated weights for policy 1, policy_version 804850 (0.0009) [2023-12-28 01:01:25,471][106225] Updated weights for policy 1, policy_version 804860 (0.0008) [2023-12-28 01:01:25,530][106225] Updated weights for policy 1, policy_version 804870 (0.0007) [2023-12-28 01:01:25,707][106226] Updated weights for policy 0, policy_version 802702 (0.0008) [2023-12-28 01:01:25,773][106226] Updated weights for policy 0, policy_version 802712 (0.0008) [2023-12-28 01:01:25,838][106226] Updated weights for policy 0, policy_version 802722 (0.0008) [2023-12-28 01:01:26,135][106225] Updated weights for policy 1, policy_version 804880 (0.0008) [2023-12-28 01:01:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 411639808. Throughput: 0: 9711.7, 1: 9636.9. Samples: 411611108. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:26,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-5.118')] [2023-12-28 01:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000802728_205553664.pth... [2023-12-28 01:01:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000801576_205258752.pth [2023-12-28 01:01:26,198][106225] Updated weights for policy 1, policy_version 804890 (0.0008) [2023-12-28 01:01:26,260][106225] Updated weights for policy 1, policy_version 804900 (0.0008) [2023-12-28 01:01:26,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000804904_206094336.pth... [2023-12-28 01:01:26,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000803784_205807616.pth [2023-12-28 01:01:26,591][106226] Updated weights for policy 0, policy_version 802732 (0.0006) [2023-12-28 01:01:26,637][106226] Updated weights for policy 0, policy_version 802742 (0.0005) [2023-12-28 01:01:26,694][106226] Updated weights for policy 0, policy_version 802752 (0.0005) [2023-12-28 01:01:26,873][106225] Updated weights for policy 1, policy_version 804910 (0.0008) [2023-12-28 01:01:26,928][106225] Updated weights for policy 1, policy_version 804920 (0.0009) [2023-12-28 01:01:26,996][106225] Updated weights for policy 1, policy_version 804930 (0.0009) [2023-12-28 01:01:27,242][106226] Updated weights for policy 0, policy_version 802762 (0.0005) [2023-12-28 01:01:27,305][106226] Updated weights for policy 0, policy_version 802772 (0.0006) [2023-12-28 01:01:27,358][106226] Updated weights for policy 0, policy_version 802782 (0.0008) [2023-12-28 01:01:27,406][106226] Updated weights for policy 0, policy_version 802792 (0.0008) [2023-12-28 01:01:27,671][106225] Updated weights for policy 1, policy_version 804940 (0.0006) [2023-12-28 01:01:27,732][106225] Updated weights for policy 1, policy_version 804950 (0.0008) [2023-12-28 01:01:27,804][106225] Updated weights for policy 1, policy_version 804960 (0.0009) [2023-12-28 01:01:28,061][106226] Updated weights for policy 0, policy_version 802802 (0.0006) [2023-12-28 01:01:28,131][106226] Updated weights for policy 0, policy_version 802812 (0.0006) [2023-12-28 01:01:28,187][106226] Updated weights for policy 0, policy_version 802822 (0.0005) [2023-12-28 01:01:28,496][106225] Updated weights for policy 1, policy_version 804970 (0.0008) [2023-12-28 01:01:28,552][106225] Updated weights for policy 1, policy_version 804980 (0.0008) [2023-12-28 01:01:28,605][106225] Updated weights for policy 1, policy_version 804990 (0.0007) [2023-12-28 01:01:28,660][106225] Updated weights for policy 1, policy_version 805000 (0.0008) [2023-12-28 01:01:28,819][106226] Updated weights for policy 0, policy_version 802832 (0.0010) [2023-12-28 01:01:28,873][106226] Updated weights for policy 0, policy_version 802842 (0.0010) [2023-12-28 01:01:28,929][106226] Updated weights for policy 0, policy_version 802852 (0.0010) [2023-12-28 01:01:29,407][106225] Updated weights for policy 1, policy_version 805010 (0.0008) [2023-12-28 01:01:29,460][106225] Updated weights for policy 1, policy_version 805020 (0.0008) [2023-12-28 01:01:29,515][106225] Updated weights for policy 1, policy_version 805030 (0.0008) [2023-12-28 01:01:29,583][106226] Updated weights for policy 0, policy_version 802862 (0.0007) [2023-12-28 01:01:29,628][106226] Updated weights for policy 0, policy_version 802872 (0.0008) [2023-12-28 01:01:29,688][106226] Updated weights for policy 0, policy_version 802882 (0.0006) [2023-12-28 01:01:30,285][106225] Updated weights for policy 1, policy_version 805040 (0.0009) [2023-12-28 01:01:30,316][106226] Updated weights for policy 0, policy_version 802892 (0.0005) [2023-12-28 01:01:30,336][106225] Updated weights for policy 1, policy_version 805050 (0.0007) [2023-12-28 01:01:30,371][106226] Updated weights for policy 0, policy_version 802902 (0.0006) [2023-12-28 01:01:30,395][106225] Updated weights for policy 1, policy_version 805060 (0.0009) [2023-12-28 01:01:30,419][106226] Updated weights for policy 0, policy_version 802912 (0.0006) [2023-12-28 01:01:31,000][106226] Updated weights for policy 0, policy_version 802922 (0.0005) [2023-12-28 01:01:31,069][106226] Updated weights for policy 0, policy_version 802932 (0.0007) [2023-12-28 01:01:31,118][106225] Updated weights for policy 1, policy_version 805070 (0.0007) [2023-12-28 01:01:31,120][106226] Updated weights for policy 0, policy_version 802942 (0.0008) [2023-12-28 01:01:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 411738112. Throughput: 0: 9850.7, 1: 9643.0. Samples: 411732916. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:31,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-5.264')] [2023-12-28 01:01:31,185][106226] Updated weights for policy 0, policy_version 802952 (0.0009) [2023-12-28 01:01:31,190][106225] Updated weights for policy 1, policy_version 805080 (0.0008) [2023-12-28 01:01:31,254][106225] Updated weights for policy 1, policy_version 805090 (0.0006) [2023-12-28 01:01:31,910][106226] Updated weights for policy 0, policy_version 802962 (0.0006) [2023-12-28 01:01:31,963][106226] Updated weights for policy 0, policy_version 802972 (0.0008) [2023-12-28 01:01:31,986][106225] Updated weights for policy 1, policy_version 805100 (0.0010) [2023-12-28 01:01:32,019][106226] Updated weights for policy 0, policy_version 802982 (0.0007) [2023-12-28 01:01:32,049][106225] Updated weights for policy 1, policy_version 805110 (0.0007) [2023-12-28 01:01:32,114][106225] Updated weights for policy 1, policy_version 805120 (0.0011) [2023-12-28 01:01:32,754][106226] Updated weights for policy 0, policy_version 802992 (0.0008) [2023-12-28 01:01:32,798][106225] Updated weights for policy 1, policy_version 805130 (0.0009) [2023-12-28 01:01:32,807][106226] Updated weights for policy 0, policy_version 803002 (0.0007) [2023-12-28 01:01:32,849][106225] Updated weights for policy 1, policy_version 805140 (0.0006) [2023-12-28 01:01:32,877][106226] Updated weights for policy 0, policy_version 803012 (0.0005) [2023-12-28 01:01:32,897][106225] Updated weights for policy 1, policy_version 805150 (0.0008) [2023-12-28 01:01:32,958][106225] Updated weights for policy 1, policy_version 805160 (0.0007) [2023-12-28 01:01:33,500][106226] Updated weights for policy 0, policy_version 803022 (0.0008) [2023-12-28 01:01:33,548][106226] Updated weights for policy 0, policy_version 803032 (0.0011) [2023-12-28 01:01:33,551][106225] Updated weights for policy 1, policy_version 805170 (0.0005) [2023-12-28 01:01:33,595][106226] Updated weights for policy 0, policy_version 803042 (0.0009) [2023-12-28 01:01:33,602][106225] Updated weights for policy 1, policy_version 805180 (0.0006) [2023-12-28 01:01:33,643][106225] Updated weights for policy 1, policy_version 805190 (0.0007) [2023-12-28 01:01:34,209][106225] Updated weights for policy 1, policy_version 805200 (0.0007) [2023-12-28 01:01:34,209][106226] Updated weights for policy 0, policy_version 803052 (0.0007) [2023-12-28 01:01:34,256][106226] Updated weights for policy 0, policy_version 803062 (0.0010) [2023-12-28 01:01:34,271][106225] Updated weights for policy 1, policy_version 805210 (0.0008) [2023-12-28 01:01:34,303][106226] Updated weights for policy 0, policy_version 803072 (0.0009) [2023-12-28 01:01:34,334][106225] Updated weights for policy 1, policy_version 805220 (0.0008) [2023-12-28 01:01:34,973][106226] Updated weights for policy 0, policy_version 803082 (0.0010) [2023-12-28 01:01:35,031][106226] Updated weights for policy 0, policy_version 803092 (0.0010) [2023-12-28 01:01:35,063][106225] Updated weights for policy 1, policy_version 805230 (0.0008) [2023-12-28 01:01:35,084][106226] Updated weights for policy 0, policy_version 803102 (0.0010) [2023-12-28 01:01:35,110][106225] Updated weights for policy 1, policy_version 805240 (0.0005) [2023-12-28 01:01:35,137][106226] Updated weights for policy 0, policy_version 803112 (0.0010) [2023-12-28 01:01:35,162][106225] Updated weights for policy 1, policy_version 805250 (0.0006) [2023-12-28 01:01:35,705][106225] Updated weights for policy 1, policy_version 805260 (0.0005) [2023-12-28 01:01:35,763][106225] Updated weights for policy 1, policy_version 805270 (0.0007) [2023-12-28 01:01:35,822][106225] Updated weights for policy 1, policy_version 805280 (0.0007) [2023-12-28 01:01:35,824][106226] Updated weights for policy 0, policy_version 803122 (0.0005) [2023-12-28 01:01:35,874][106226] Updated weights for policy 0, policy_version 803132 (0.0007) [2023-12-28 01:01:35,924][106226] Updated weights for policy 0, policy_version 803142 (0.0008) [2023-12-28 01:01:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 411852800. Throughput: 0: 9923.2, 1: 9692.4. Samples: 411859880. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:36,175][105115] Avg episode reward: [(0, '-4.397'), (1, '-5.153')] [2023-12-28 01:01:36,504][106226] Updated weights for policy 0, policy_version 803152 (0.0007) [2023-12-28 01:01:36,549][106225] Updated weights for policy 1, policy_version 805290 (0.0008) [2023-12-28 01:01:36,567][106226] Updated weights for policy 0, policy_version 803162 (0.0007) [2023-12-28 01:01:36,615][106225] Updated weights for policy 1, policy_version 805300 (0.0011) [2023-12-28 01:01:36,626][106226] Updated weights for policy 0, policy_version 803172 (0.0006) [2023-12-28 01:01:36,674][106225] Updated weights for policy 1, policy_version 805310 (0.0010) [2023-12-28 01:01:36,737][106225] Updated weights for policy 1, policy_version 805320 (0.0010) [2023-12-28 01:01:37,251][106226] Updated weights for policy 0, policy_version 803182 (0.0008) [2023-12-28 01:01:37,315][106226] Updated weights for policy 0, policy_version 803192 (0.0008) [2023-12-28 01:01:37,382][106226] Updated weights for policy 0, policy_version 803202 (0.0005) [2023-12-28 01:01:37,517][106225] Updated weights for policy 1, policy_version 805330 (0.0008) [2023-12-28 01:01:37,572][106225] Updated weights for policy 1, policy_version 805340 (0.0008) [2023-12-28 01:01:37,620][106225] Updated weights for policy 1, policy_version 805350 (0.0008) [2023-12-28 01:01:37,995][106226] Updated weights for policy 0, policy_version 803212 (0.0007) [2023-12-28 01:01:38,056][106226] Updated weights for policy 0, policy_version 803222 (0.0011) [2023-12-28 01:01:38,113][106226] Updated weights for policy 0, policy_version 803232 (0.0008) [2023-12-28 01:01:38,412][106225] Updated weights for policy 1, policy_version 805360 (0.0007) [2023-12-28 01:01:38,473][106225] Updated weights for policy 1, policy_version 805370 (0.0008) [2023-12-28 01:01:38,523][106225] Updated weights for policy 1, policy_version 805380 (0.0008) [2023-12-28 01:01:38,778][106226] Updated weights for policy 0, policy_version 803242 (0.0010) [2023-12-28 01:01:38,842][106226] Updated weights for policy 0, policy_version 803252 (0.0008) [2023-12-28 01:01:38,892][106226] Updated weights for policy 0, policy_version 803262 (0.0010) [2023-12-28 01:01:38,949][106226] Updated weights for policy 0, policy_version 803272 (0.0010) [2023-12-28 01:01:39,315][106225] Updated weights for policy 1, policy_version 805390 (0.0008) [2023-12-28 01:01:39,386][106225] Updated weights for policy 1, policy_version 805400 (0.0008) [2023-12-28 01:01:39,449][106225] Updated weights for policy 1, policy_version 805410 (0.0009) [2023-12-28 01:01:39,706][106226] Updated weights for policy 0, policy_version 803282 (0.0011) [2023-12-28 01:01:39,768][106226] Updated weights for policy 0, policy_version 803292 (0.0011) [2023-12-28 01:01:39,834][106226] Updated weights for policy 0, policy_version 803302 (0.0010) [2023-12-28 01:01:40,216][106225] Updated weights for policy 1, policy_version 805420 (0.0008) [2023-12-28 01:01:40,275][106225] Updated weights for policy 1, policy_version 805430 (0.0008) [2023-12-28 01:01:40,330][106225] Updated weights for policy 1, policy_version 805440 (0.0008) [2023-12-28 01:01:40,559][106226] Updated weights for policy 0, policy_version 803312 (0.0007) [2023-12-28 01:01:40,621][106226] Updated weights for policy 0, policy_version 803322 (0.0006) [2023-12-28 01:01:40,678][106226] Updated weights for policy 0, policy_version 803332 (0.0006) [2023-12-28 01:01:41,102][106225] Updated weights for policy 1, policy_version 805450 (0.0008) [2023-12-28 01:01:41,163][106225] Updated weights for policy 1, policy_version 805460 (0.0009) [2023-12-28 01:01:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 411942912. Throughput: 0: 10018.0, 1: 9680.0. Samples: 411919204. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:41,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.170')] [2023-12-28 01:01:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000803336_205709312.pth... [2023-12-28 01:01:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000802152_205406208.pth [2023-12-28 01:01:41,215][106225] Updated weights for policy 1, policy_version 805470 (0.0007) [2023-12-28 01:01:41,276][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000805480_206241792.pth... [2023-12-28 01:01:41,278][106225] Updated weights for policy 1, policy_version 805480 (0.0007) [2023-12-28 01:01:41,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000804328_205946880.pth [2023-12-28 01:01:41,458][106226] Updated weights for policy 0, policy_version 803342 (0.0009) [2023-12-28 01:01:41,521][106226] Updated weights for policy 0, policy_version 803352 (0.0009) [2023-12-28 01:01:41,591][106226] Updated weights for policy 0, policy_version 803362 (0.0009) [2023-12-28 01:01:42,028][106225] Updated weights for policy 1, policy_version 805490 (0.0009) [2023-12-28 01:01:42,089][106225] Updated weights for policy 1, policy_version 805500 (0.0008) [2023-12-28 01:01:42,147][106225] Updated weights for policy 1, policy_version 805510 (0.0009) [2023-12-28 01:01:42,364][106226] Updated weights for policy 0, policy_version 803372 (0.0009) [2023-12-28 01:01:42,417][106226] Updated weights for policy 0, policy_version 803382 (0.0007) [2023-12-28 01:01:42,466][106226] Updated weights for policy 0, policy_version 803392 (0.0005) [2023-12-28 01:01:42,928][106225] Updated weights for policy 1, policy_version 805520 (0.0009) [2023-12-28 01:01:42,983][106225] Updated weights for policy 1, policy_version 805530 (0.0006) [2023-12-28 01:01:43,044][106225] Updated weights for policy 1, policy_version 805540 (0.0005) [2023-12-28 01:01:43,109][106226] Updated weights for policy 0, policy_version 803402 (0.0006) [2023-12-28 01:01:43,164][106226] Updated weights for policy 0, policy_version 803412 (0.0009) [2023-12-28 01:01:43,214][106226] Updated weights for policy 0, policy_version 803422 (0.0008) [2023-12-28 01:01:43,268][106226] Updated weights for policy 0, policy_version 803432 (0.0009) [2023-12-28 01:01:43,619][106225] Updated weights for policy 1, policy_version 805550 (0.0007) [2023-12-28 01:01:43,672][106225] Updated weights for policy 1, policy_version 805560 (0.0008) [2023-12-28 01:01:43,721][106225] Updated weights for policy 1, policy_version 805570 (0.0008) [2023-12-28 01:01:44,012][106226] Updated weights for policy 0, policy_version 803442 (0.0008) [2023-12-28 01:01:44,065][106226] Updated weights for policy 0, policy_version 803452 (0.0005) [2023-12-28 01:01:44,128][106226] Updated weights for policy 0, policy_version 803462 (0.0005) [2023-12-28 01:01:44,504][106225] Updated weights for policy 1, policy_version 805580 (0.0008) [2023-12-28 01:01:44,560][106225] Updated weights for policy 1, policy_version 805590 (0.0007) [2023-12-28 01:01:44,618][106225] Updated weights for policy 1, policy_version 805600 (0.0007) [2023-12-28 01:01:44,790][106226] Updated weights for policy 0, policy_version 803472 (0.0009) [2023-12-28 01:01:44,850][106226] Updated weights for policy 0, policy_version 803482 (0.0010) [2023-12-28 01:01:44,916][106226] Updated weights for policy 0, policy_version 803492 (0.0010) [2023-12-28 01:01:45,418][106225] Updated weights for policy 1, policy_version 805610 (0.0008) [2023-12-28 01:01:45,480][106225] Updated weights for policy 1, policy_version 805620 (0.0007) [2023-12-28 01:01:45,538][106225] Updated weights for policy 1, policy_version 805630 (0.0009) [2023-12-28 01:01:45,597][106225] Updated weights for policy 1, policy_version 805640 (0.0007) [2023-12-28 01:01:45,598][106226] Updated weights for policy 0, policy_version 803502 (0.0007) [2023-12-28 01:01:45,646][106226] Updated weights for policy 0, policy_version 803512 (0.0006) [2023-12-28 01:01:45,710][106226] Updated weights for policy 0, policy_version 803522 (0.0006) [2023-12-28 01:01:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 412041216. Throughput: 0: 10058.4, 1: 9694.8. Samples: 412033848. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:46,175][105115] Avg episode reward: [(0, '-4.219'), (1, '-5.123')] [2023-12-28 01:01:46,237][106225] Updated weights for policy 1, policy_version 805650 (0.0005) [2023-12-28 01:01:46,261][106226] Updated weights for policy 0, policy_version 803532 (0.0006) [2023-12-28 01:01:46,300][106225] Updated weights for policy 1, policy_version 805660 (0.0007) [2023-12-28 01:01:46,326][106226] Updated weights for policy 0, policy_version 803542 (0.0005) [2023-12-28 01:01:46,363][106225] Updated weights for policy 1, policy_version 805670 (0.0005) [2023-12-28 01:01:46,386][106226] Updated weights for policy 0, policy_version 803552 (0.0009) [2023-12-28 01:01:46,928][106225] Updated weights for policy 1, policy_version 805680 (0.0007) [2023-12-28 01:01:46,987][106225] Updated weights for policy 1, policy_version 805690 (0.0009) [2023-12-28 01:01:47,047][106225] Updated weights for policy 1, policy_version 805700 (0.0010) [2023-12-28 01:01:47,048][106226] Updated weights for policy 0, policy_version 803562 (0.0007) [2023-12-28 01:01:47,101][106226] Updated weights for policy 0, policy_version 803572 (0.0010) [2023-12-28 01:01:47,162][106226] Updated weights for policy 0, policy_version 803582 (0.0008) [2023-12-28 01:01:47,221][106226] Updated weights for policy 0, policy_version 803592 (0.0009) [2023-12-28 01:01:47,620][106225] Updated weights for policy 1, policy_version 805710 (0.0010) [2023-12-28 01:01:47,669][106225] Updated weights for policy 1, policy_version 805720 (0.0010) [2023-12-28 01:01:47,720][106225] Updated weights for policy 1, policy_version 805730 (0.0010) [2023-12-28 01:01:48,000][106226] Updated weights for policy 0, policy_version 803602 (0.0007) [2023-12-28 01:01:48,062][106226] Updated weights for policy 0, policy_version 803612 (0.0009) [2023-12-28 01:01:48,125][106226] Updated weights for policy 0, policy_version 803622 (0.0008) [2023-12-28 01:01:48,443][106225] Updated weights for policy 1, policy_version 805740 (0.0009) [2023-12-28 01:01:48,505][106225] Updated weights for policy 1, policy_version 805750 (0.0008) [2023-12-28 01:01:48,570][106225] Updated weights for policy 1, policy_version 805760 (0.0009) [2023-12-28 01:01:48,844][106226] Updated weights for policy 0, policy_version 803632 (0.0006) [2023-12-28 01:01:48,904][106226] Updated weights for policy 0, policy_version 803642 (0.0005) [2023-12-28 01:01:48,968][106226] Updated weights for policy 0, policy_version 803652 (0.0006) [2023-12-28 01:01:49,329][106225] Updated weights for policy 1, policy_version 805770 (0.0008) [2023-12-28 01:01:49,397][106225] Updated weights for policy 1, policy_version 805780 (0.0007) [2023-12-28 01:01:49,459][106225] Updated weights for policy 1, policy_version 805790 (0.0008) [2023-12-28 01:01:49,511][106225] Updated weights for policy 1, policy_version 805800 (0.0008) [2023-12-28 01:01:49,584][106226] Updated weights for policy 0, policy_version 803662 (0.0008) [2023-12-28 01:01:49,643][106226] Updated weights for policy 0, policy_version 803672 (0.0007) [2023-12-28 01:01:49,694][106226] Updated weights for policy 0, policy_version 803682 (0.0007) [2023-12-28 01:01:50,208][106225] Updated weights for policy 1, policy_version 805810 (0.0008) [2023-12-28 01:01:50,261][106225] Updated weights for policy 1, policy_version 805820 (0.0007) [2023-12-28 01:01:50,325][106225] Updated weights for policy 1, policy_version 805830 (0.0008) [2023-12-28 01:01:50,508][106226] Updated weights for policy 0, policy_version 803692 (0.0008) [2023-12-28 01:01:50,573][106226] Updated weights for policy 0, policy_version 803702 (0.0008) [2023-12-28 01:01:50,637][106226] Updated weights for policy 0, policy_version 803712 (0.0008) [2023-12-28 01:01:50,973][106225] Updated weights for policy 1, policy_version 805840 (0.0006) [2023-12-28 01:01:51,035][106225] Updated weights for policy 1, policy_version 805850 (0.0006) [2023-12-28 01:01:51,098][106225] Updated weights for policy 1, policy_version 805860 (0.0007) [2023-12-28 01:01:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 412147712. Throughput: 0: 10035.1, 1: 9773.5. Samples: 412153404. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:51,175][105115] Avg episode reward: [(0, '-4.373'), (1, '-4.833')] [2023-12-28 01:01:51,447][106226] Updated weights for policy 0, policy_version 803722 (0.0008) [2023-12-28 01:01:51,505][106226] Updated weights for policy 0, policy_version 803732 (0.0011) [2023-12-28 01:01:51,560][106226] Updated weights for policy 0, policy_version 803742 (0.0011) [2023-12-28 01:01:51,619][106226] Updated weights for policy 0, policy_version 803752 (0.0010) [2023-12-28 01:01:51,743][106225] Updated weights for policy 1, policy_version 805870 (0.0009) [2023-12-28 01:01:51,805][106225] Updated weights for policy 1, policy_version 805880 (0.0008) [2023-12-28 01:01:51,864][106225] Updated weights for policy 1, policy_version 805890 (0.0009) [2023-12-28 01:01:52,321][106226] Updated weights for policy 0, policy_version 803762 (0.0010) [2023-12-28 01:01:52,384][106226] Updated weights for policy 0, policy_version 803772 (0.0011) [2023-12-28 01:01:52,443][106226] Updated weights for policy 0, policy_version 803782 (0.0010) [2023-12-28 01:01:52,608][106225] Updated weights for policy 1, policy_version 805900 (0.0008) [2023-12-28 01:01:52,664][106225] Updated weights for policy 1, policy_version 805910 (0.0008) [2023-12-28 01:01:52,711][106225] Updated weights for policy 1, policy_version 805920 (0.0008) [2023-12-28 01:01:53,184][106226] Updated weights for policy 0, policy_version 803792 (0.0011) [2023-12-28 01:01:53,240][106226] Updated weights for policy 0, policy_version 803802 (0.0010) [2023-12-28 01:01:53,294][106226] Updated weights for policy 0, policy_version 803812 (0.0006) [2023-12-28 01:01:53,479][106225] Updated weights for policy 1, policy_version 805930 (0.0008) [2023-12-28 01:01:53,546][106225] Updated weights for policy 1, policy_version 805940 (0.0007) [2023-12-28 01:01:53,613][106225] Updated weights for policy 1, policy_version 805950 (0.0009) [2023-12-28 01:01:53,677][106225] Updated weights for policy 1, policy_version 805960 (0.0007) [2023-12-28 01:01:53,937][106226] Updated weights for policy 0, policy_version 803822 (0.0006) [2023-12-28 01:01:54,004][106226] Updated weights for policy 0, policy_version 803832 (0.0011) [2023-12-28 01:01:54,057][106226] Updated weights for policy 0, policy_version 803842 (0.0010) [2023-12-28 01:01:54,340][106225] Updated weights for policy 1, policy_version 805970 (0.0010) [2023-12-28 01:01:54,403][106225] Updated weights for policy 1, policy_version 805980 (0.0010) [2023-12-28 01:01:54,466][106225] Updated weights for policy 1, policy_version 805990 (0.0010) [2023-12-28 01:01:54,659][106226] Updated weights for policy 0, policy_version 803852 (0.0008) [2023-12-28 01:01:54,712][106226] Updated weights for policy 0, policy_version 803862 (0.0010) [2023-12-28 01:01:54,758][106226] Updated weights for policy 0, policy_version 803872 (0.0010) [2023-12-28 01:01:55,147][106225] Updated weights for policy 1, policy_version 806000 (0.0009) [2023-12-28 01:01:55,194][106225] Updated weights for policy 1, policy_version 806010 (0.0010) [2023-12-28 01:01:55,244][106225] Updated weights for policy 1, policy_version 806020 (0.0010) [2023-12-28 01:01:55,455][106226] Updated weights for policy 0, policy_version 803882 (0.0010) [2023-12-28 01:01:55,513][106226] Updated weights for policy 0, policy_version 803892 (0.0010) [2023-12-28 01:01:55,577][106226] Updated weights for policy 0, policy_version 803902 (0.0008) [2023-12-28 01:01:55,636][106226] Updated weights for policy 0, policy_version 803912 (0.0008) [2023-12-28 01:01:55,931][106225] Updated weights for policy 1, policy_version 806030 (0.0009) [2023-12-28 01:01:55,985][106225] Updated weights for policy 1, policy_version 806040 (0.0009) [2023-12-28 01:01:56,036][106225] Updated weights for policy 1, policy_version 806050 (0.0009) [2023-12-28 01:01:56,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 412246016. Throughput: 0: 10019.6, 1: 9761.2. Samples: 412212408. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:01:56,175][105115] Avg episode reward: [(0, '-4.286'), (1, '-4.732')] [2023-12-28 01:01:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000806056_206389248.pth... [2023-12-28 01:01:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000803912_205856768.pth... [2023-12-28 01:01:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000802728_205553664.pth [2023-12-28 01:01:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000804904_206094336.pth [2023-12-28 01:01:56,257][106226] Updated weights for policy 0, policy_version 803922 (0.0006) [2023-12-28 01:01:56,306][106226] Updated weights for policy 0, policy_version 803932 (0.0008) [2023-12-28 01:01:56,358][106226] Updated weights for policy 0, policy_version 803942 (0.0009) [2023-12-28 01:01:56,785][106225] Updated weights for policy 1, policy_version 806060 (0.0009) [2023-12-28 01:01:56,837][106225] Updated weights for policy 1, policy_version 806070 (0.0008) [2023-12-28 01:01:56,894][106225] Updated weights for policy 1, policy_version 806080 (0.0008) [2023-12-28 01:01:57,066][106226] Updated weights for policy 0, policy_version 803952 (0.0008) [2023-12-28 01:01:57,126][106226] Updated weights for policy 0, policy_version 803962 (0.0009) [2023-12-28 01:01:57,183][106226] Updated weights for policy 0, policy_version 803972 (0.0009) [2023-12-28 01:01:57,511][106225] Updated weights for policy 1, policy_version 806090 (0.0008) [2023-12-28 01:01:57,555][106225] Updated weights for policy 1, policy_version 806100 (0.0010) [2023-12-28 01:01:57,601][106225] Updated weights for policy 1, policy_version 806110 (0.0010) [2023-12-28 01:01:57,657][106225] Updated weights for policy 1, policy_version 806120 (0.0010) [2023-12-28 01:01:57,849][106226] Updated weights for policy 0, policy_version 803982 (0.0007) [2023-12-28 01:01:57,904][106226] Updated weights for policy 0, policy_version 803992 (0.0006) [2023-12-28 01:01:57,956][106226] Updated weights for policy 0, policy_version 804002 (0.0007) [2023-12-28 01:01:58,339][106225] Updated weights for policy 1, policy_version 806130 (0.0010) [2023-12-28 01:01:58,409][106225] Updated weights for policy 1, policy_version 806140 (0.0009) [2023-12-28 01:01:58,472][106225] Updated weights for policy 1, policy_version 806150 (0.0008) [2023-12-28 01:01:58,721][106226] Updated weights for policy 0, policy_version 804012 (0.0009) [2023-12-28 01:01:58,790][106226] Updated weights for policy 0, policy_version 804022 (0.0008) [2023-12-28 01:01:58,865][106226] Updated weights for policy 0, policy_version 804032 (0.0008) [2023-12-28 01:01:59,473][106225] Updated weights for policy 1, policy_version 806160 (0.0008) [2023-12-28 01:01:59,528][106225] Updated weights for policy 1, policy_version 806170 (0.0008) [2023-12-28 01:01:59,581][106225] Updated weights for policy 1, policy_version 806180 (0.0008) [2023-12-28 01:01:59,639][106226] Updated weights for policy 0, policy_version 804042 (0.0008) [2023-12-28 01:01:59,693][106226] Updated weights for policy 0, policy_version 804052 (0.0009) [2023-12-28 01:01:59,752][106226] Updated weights for policy 0, policy_version 804062 (0.0008) [2023-12-28 01:01:59,808][106226] Updated weights for policy 0, policy_version 804072 (0.0008) [2023-12-28 01:02:00,290][106225] Updated weights for policy 1, policy_version 806190 (0.0007) [2023-12-28 01:02:00,341][106225] Updated weights for policy 1, policy_version 806200 (0.0006) [2023-12-28 01:02:00,400][106225] Updated weights for policy 1, policy_version 806210 (0.0008) [2023-12-28 01:02:00,600][106226] Updated weights for policy 0, policy_version 804082 (0.0009) [2023-12-28 01:02:00,659][106226] Updated weights for policy 0, policy_version 804092 (0.0008) [2023-12-28 01:02:00,726][106226] Updated weights for policy 0, policy_version 804102 (0.0008) [2023-12-28 01:02:01,066][106225] Updated weights for policy 1, policy_version 806220 (0.0008) [2023-12-28 01:02:01,128][106225] Updated weights for policy 1, policy_version 806230 (0.0006) [2023-12-28 01:02:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 412336128. Throughput: 0: 10024.8, 1: 9818.9. Samples: 412329500. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:01,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-5.122')] [2023-12-28 01:02:01,185][106225] Updated weights for policy 1, policy_version 806240 (0.0007) [2023-12-28 01:02:01,431][106226] Updated weights for policy 0, policy_version 804112 (0.0010) [2023-12-28 01:02:01,486][106226] Updated weights for policy 0, policy_version 804122 (0.0008) [2023-12-28 01:02:01,543][106226] Updated weights for policy 0, policy_version 804132 (0.0007) [2023-12-28 01:02:01,883][106225] Updated weights for policy 1, policy_version 806250 (0.0008) [2023-12-28 01:02:01,947][106225] Updated weights for policy 1, policy_version 806260 (0.0008) [2023-12-28 01:02:02,009][106225] Updated weights for policy 1, policy_version 806270 (0.0011) [2023-12-28 01:02:02,073][106225] Updated weights for policy 1, policy_version 806280 (0.0010) [2023-12-28 01:02:02,195][106226] Updated weights for policy 0, policy_version 804142 (0.0007) [2023-12-28 01:02:02,258][106226] Updated weights for policy 0, policy_version 804152 (0.0007) [2023-12-28 01:02:02,318][106226] Updated weights for policy 0, policy_version 804162 (0.0007) [2023-12-28 01:02:02,820][106225] Updated weights for policy 1, policy_version 806290 (0.0007) [2023-12-28 01:02:02,877][106225] Updated weights for policy 1, policy_version 806300 (0.0006) [2023-12-28 01:02:02,934][106225] Updated weights for policy 1, policy_version 806310 (0.0005) [2023-12-28 01:02:02,951][106226] Updated weights for policy 0, policy_version 804172 (0.0006) [2023-12-28 01:02:03,007][106226] Updated weights for policy 0, policy_version 804182 (0.0009) [2023-12-28 01:02:03,053][106226] Updated weights for policy 0, policy_version 804192 (0.0010) [2023-12-28 01:02:03,591][106225] Updated weights for policy 1, policy_version 806320 (0.0005) [2023-12-28 01:02:03,639][106225] Updated weights for policy 1, policy_version 806330 (0.0005) [2023-12-28 01:02:03,685][106225] Updated weights for policy 1, policy_version 806340 (0.0006) [2023-12-28 01:02:03,708][106226] Updated weights for policy 0, policy_version 804202 (0.0005) [2023-12-28 01:02:03,776][106226] Updated weights for policy 0, policy_version 804212 (0.0008) [2023-12-28 01:02:03,839][106226] Updated weights for policy 0, policy_version 804222 (0.0008) [2023-12-28 01:02:03,912][106226] Updated weights for policy 0, policy_version 804232 (0.0008) [2023-12-28 01:02:04,298][106225] Updated weights for policy 1, policy_version 806350 (0.0005) [2023-12-28 01:02:04,356][106225] Updated weights for policy 1, policy_version 806360 (0.0006) [2023-12-28 01:02:04,417][106225] Updated weights for policy 1, policy_version 806370 (0.0008) [2023-12-28 01:02:04,653][106226] Updated weights for policy 0, policy_version 804242 (0.0006) [2023-12-28 01:02:04,705][106226] Updated weights for policy 0, policy_version 804252 (0.0005) [2023-12-28 01:02:04,759][106226] Updated weights for policy 0, policy_version 804262 (0.0005) [2023-12-28 01:02:05,143][106225] Updated weights for policy 1, policy_version 806380 (0.0008) [2023-12-28 01:02:05,199][106225] Updated weights for policy 1, policy_version 806390 (0.0008) [2023-12-28 01:02:05,244][106225] Updated weights for policy 1, policy_version 806400 (0.0008) [2023-12-28 01:02:05,418][106226] Updated weights for policy 0, policy_version 804272 (0.0008) [2023-12-28 01:02:05,476][106226] Updated weights for policy 0, policy_version 804282 (0.0009) [2023-12-28 01:02:05,531][106226] Updated weights for policy 0, policy_version 804292 (0.0009) [2023-12-28 01:02:05,847][106225] Updated weights for policy 1, policy_version 806410 (0.0008) [2023-12-28 01:02:05,911][106225] Updated weights for policy 1, policy_version 806420 (0.0008) [2023-12-28 01:02:05,970][106225] Updated weights for policy 1, policy_version 806430 (0.0008) [2023-12-28 01:02:06,029][106225] Updated weights for policy 1, policy_version 806440 (0.0008) [2023-12-28 01:02:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 412442624. Throughput: 0: 10016.1, 1: 9881.7. Samples: 412450856. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:06,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-5.059')] [2023-12-28 01:02:06,338][106226] Updated weights for policy 0, policy_version 804302 (0.0009) [2023-12-28 01:02:06,401][106226] Updated weights for policy 0, policy_version 804312 (0.0008) [2023-12-28 01:02:06,468][106226] Updated weights for policy 0, policy_version 804322 (0.0009) [2023-12-28 01:02:06,730][106225] Updated weights for policy 1, policy_version 806450 (0.0008) [2023-12-28 01:02:06,790][106225] Updated weights for policy 1, policy_version 806460 (0.0009) [2023-12-28 01:02:06,841][106225] Updated weights for policy 1, policy_version 806470 (0.0010) [2023-12-28 01:02:07,187][106226] Updated weights for policy 0, policy_version 804332 (0.0010) [2023-12-28 01:02:07,245][106226] Updated weights for policy 0, policy_version 804342 (0.0011) [2023-12-28 01:02:07,300][106226] Updated weights for policy 0, policy_version 804352 (0.0010) [2023-12-28 01:02:07,615][106225] Updated weights for policy 1, policy_version 806480 (0.0008) [2023-12-28 01:02:07,658][106225] Updated weights for policy 1, policy_version 806490 (0.0007) [2023-12-28 01:02:07,712][106225] Updated weights for policy 1, policy_version 806500 (0.0008) [2023-12-28 01:02:07,968][106226] Updated weights for policy 0, policy_version 804362 (0.0010) [2023-12-28 01:02:08,028][106226] Updated weights for policy 0, policy_version 804372 (0.0010) [2023-12-28 01:02:08,078][106226] Updated weights for policy 0, policy_version 804382 (0.0008) [2023-12-28 01:02:08,124][106226] Updated weights for policy 0, policy_version 804392 (0.0009) [2023-12-28 01:02:08,534][106225] Updated weights for policy 1, policy_version 806510 (0.0008) [2023-12-28 01:02:08,588][106225] Updated weights for policy 1, policy_version 806520 (0.0008) [2023-12-28 01:02:08,650][106225] Updated weights for policy 1, policy_version 806530 (0.0008) [2023-12-28 01:02:08,789][106226] Updated weights for policy 0, policy_version 804402 (0.0010) [2023-12-28 01:02:08,855][106226] Updated weights for policy 0, policy_version 804412 (0.0006) [2023-12-28 01:02:08,914][106226] Updated weights for policy 0, policy_version 804422 (0.0006) [2023-12-28 01:02:09,454][106225] Updated weights for policy 1, policy_version 806540 (0.0008) [2023-12-28 01:02:09,510][106225] Updated weights for policy 1, policy_version 806550 (0.0008) [2023-12-28 01:02:09,574][106225] Updated weights for policy 1, policy_version 806560 (0.0008) [2023-12-28 01:02:09,581][106226] Updated weights for policy 0, policy_version 804432 (0.0006) [2023-12-28 01:02:09,635][106226] Updated weights for policy 0, policy_version 804442 (0.0006) [2023-12-28 01:02:09,682][106226] Updated weights for policy 0, policy_version 804452 (0.0009) [2023-12-28 01:02:10,341][106225] Updated weights for policy 1, policy_version 806570 (0.0009) [2023-12-28 01:02:10,405][106225] Updated weights for policy 1, policy_version 806580 (0.0009) [2023-12-28 01:02:10,453][106226] Updated weights for policy 0, policy_version 804462 (0.0009) [2023-12-28 01:02:10,462][106225] Updated weights for policy 1, policy_version 806590 (0.0009) [2023-12-28 01:02:10,512][106226] Updated weights for policy 0, policy_version 804472 (0.0007) [2023-12-28 01:02:10,534][106225] Updated weights for policy 1, policy_version 806600 (0.0008) [2023-12-28 01:02:10,574][106226] Updated weights for policy 0, policy_version 804482 (0.0007) [2023-12-28 01:02:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 412532736. Throughput: 0: 10077.5, 1: 9872.9. Samples: 412508876. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:11,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-5.159')] [2023-12-28 01:02:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000806600_206528512.pth... [2023-12-28 01:02:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000804488_206004224.pth... [2023-12-28 01:02:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000803336_205709312.pth [2023-12-28 01:02:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000805480_206241792.pth [2023-12-28 01:02:11,317][106225] Updated weights for policy 1, policy_version 806610 (0.0008) [2023-12-28 01:02:11,363][106226] Updated weights for policy 0, policy_version 804492 (0.0008) [2023-12-28 01:02:11,386][106225] Updated weights for policy 1, policy_version 806620 (0.0012) [2023-12-28 01:02:11,434][106226] Updated weights for policy 0, policy_version 804502 (0.0009) [2023-12-28 01:02:11,446][106225] Updated weights for policy 1, policy_version 806630 (0.0009) [2023-12-28 01:02:11,504][106226] Updated weights for policy 0, policy_version 804512 (0.0009) [2023-12-28 01:02:12,198][106225] Updated weights for policy 1, policy_version 806640 (0.0006) [2023-12-28 01:02:12,267][106225] Updated weights for policy 1, policy_version 806650 (0.0010) [2023-12-28 01:02:12,308][106226] Updated weights for policy 0, policy_version 804522 (0.0008) [2023-12-28 01:02:12,330][106225] Updated weights for policy 1, policy_version 806660 (0.0011) [2023-12-28 01:02:12,372][106226] Updated weights for policy 0, policy_version 804532 (0.0007) [2023-12-28 01:02:12,434][106226] Updated weights for policy 0, policy_version 804542 (0.0008) [2023-12-28 01:02:12,492][106226] Updated weights for policy 0, policy_version 804552 (0.0008) [2023-12-28 01:02:12,990][106225] Updated weights for policy 1, policy_version 806670 (0.0009) [2023-12-28 01:02:13,037][106225] Updated weights for policy 1, policy_version 806680 (0.0008) [2023-12-28 01:02:13,080][106225] Updated weights for policy 1, policy_version 806690 (0.0008) [2023-12-28 01:02:13,221][106226] Updated weights for policy 0, policy_version 804562 (0.0009) [2023-12-28 01:02:13,287][106226] Updated weights for policy 0, policy_version 804572 (0.0005) [2023-12-28 01:02:13,352][106226] Updated weights for policy 0, policy_version 804582 (0.0005) [2023-12-28 01:02:13,887][106225] Updated weights for policy 1, policy_version 806700 (0.0008) [2023-12-28 01:02:13,914][106226] Updated weights for policy 0, policy_version 804592 (0.0009) [2023-12-28 01:02:13,940][106225] Updated weights for policy 1, policy_version 806710 (0.0008) [2023-12-28 01:02:13,975][106226] Updated weights for policy 0, policy_version 804602 (0.0011) [2023-12-28 01:02:13,989][106225] Updated weights for policy 1, policy_version 806720 (0.0008) [2023-12-28 01:02:14,029][106226] Updated weights for policy 0, policy_version 804612 (0.0011) [2023-12-28 01:02:14,638][106226] Updated weights for policy 0, policy_version 804622 (0.0007) [2023-12-28 01:02:14,691][106226] Updated weights for policy 0, policy_version 804632 (0.0009) [2023-12-28 01:02:14,741][106226] Updated weights for policy 0, policy_version 804642 (0.0010) [2023-12-28 01:02:14,768][106225] Updated weights for policy 1, policy_version 806730 (0.0006) [2023-12-28 01:02:14,827][106225] Updated weights for policy 1, policy_version 806740 (0.0009) [2023-12-28 01:02:14,890][106225] Updated weights for policy 1, policy_version 806750 (0.0009) [2023-12-28 01:02:14,957][106225] Updated weights for policy 1, policy_version 806760 (0.0011) [2023-12-28 01:02:15,484][106226] Updated weights for policy 0, policy_version 804652 (0.0011) [2023-12-28 01:02:15,530][106226] Updated weights for policy 0, policy_version 804662 (0.0010) [2023-12-28 01:02:15,583][106226] Updated weights for policy 0, policy_version 804672 (0.0010) [2023-12-28 01:02:15,695][106225] Updated weights for policy 1, policy_version 806770 (0.0010) [2023-12-28 01:02:15,752][106225] Updated weights for policy 1, policy_version 806780 (0.0010) [2023-12-28 01:02:15,807][106225] Updated weights for policy 1, policy_version 806790 (0.0010) [2023-12-28 01:02:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 412631040. Throughput: 0: 10007.6, 1: 9762.0. Samples: 412622544. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:16,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.927')] [2023-12-28 01:02:16,309][106226] Updated weights for policy 0, policy_version 804682 (0.0010) [2023-12-28 01:02:16,379][106226] Updated weights for policy 0, policy_version 804692 (0.0010) [2023-12-28 01:02:16,442][106226] Updated weights for policy 0, policy_version 804702 (0.0010) [2023-12-28 01:02:16,500][106225] Updated weights for policy 1, policy_version 806800 (0.0007) [2023-12-28 01:02:16,501][106226] Updated weights for policy 0, policy_version 804712 (0.0010) [2023-12-28 01:02:16,559][106225] Updated weights for policy 1, policy_version 806810 (0.0008) [2023-12-28 01:02:16,616][106225] Updated weights for policy 1, policy_version 806820 (0.0008) [2023-12-28 01:02:17,199][106226] Updated weights for policy 0, policy_version 804722 (0.0011) [2023-12-28 01:02:17,259][106226] Updated weights for policy 0, policy_version 804732 (0.0010) [2023-12-28 01:02:17,306][106225] Updated weights for policy 1, policy_version 806830 (0.0006) [2023-12-28 01:02:17,315][106226] Updated weights for policy 0, policy_version 804742 (0.0010) [2023-12-28 01:02:17,350][106225] Updated weights for policy 1, policy_version 806840 (0.0006) [2023-12-28 01:02:17,402][106225] Updated weights for policy 1, policy_version 806850 (0.0007) [2023-12-28 01:02:17,903][106226] Updated weights for policy 0, policy_version 804752 (0.0006) [2023-12-28 01:02:17,975][106226] Updated weights for policy 0, policy_version 804762 (0.0005) [2023-12-28 01:02:18,043][106226] Updated weights for policy 0, policy_version 804772 (0.0005) [2023-12-28 01:02:18,151][106225] Updated weights for policy 1, policy_version 806860 (0.0008) [2023-12-28 01:02:18,204][106225] Updated weights for policy 1, policy_version 806870 (0.0008) [2023-12-28 01:02:18,259][106225] Updated weights for policy 1, policy_version 806880 (0.0009) [2023-12-28 01:02:18,680][106226] Updated weights for policy 0, policy_version 804782 (0.0008) [2023-12-28 01:02:18,730][106226] Updated weights for policy 0, policy_version 804792 (0.0009) [2023-12-28 01:02:18,781][106226] Updated weights for policy 0, policy_version 804802 (0.0008) [2023-12-28 01:02:18,892][106225] Updated weights for policy 1, policy_version 806890 (0.0009) [2023-12-28 01:02:18,962][106225] Updated weights for policy 1, policy_version 806900 (0.0008) [2023-12-28 01:02:19,021][106225] Updated weights for policy 1, policy_version 806910 (0.0008) [2023-12-28 01:02:19,076][106225] Updated weights for policy 1, policy_version 806920 (0.0008) [2023-12-28 01:02:19,450][106226] Updated weights for policy 0, policy_version 804812 (0.0008) [2023-12-28 01:02:19,514][106226] Updated weights for policy 0, policy_version 804822 (0.0008) [2023-12-28 01:02:19,579][106226] Updated weights for policy 0, policy_version 804832 (0.0009) [2023-12-28 01:02:19,893][106225] Updated weights for policy 1, policy_version 806930 (0.0009) [2023-12-28 01:02:19,958][106225] Updated weights for policy 1, policy_version 806940 (0.0011) [2023-12-28 01:02:20,014][106225] Updated weights for policy 1, policy_version 806950 (0.0011) [2023-12-28 01:02:20,364][106226] Updated weights for policy 0, policy_version 804842 (0.0009) [2023-12-28 01:02:20,426][106226] Updated weights for policy 0, policy_version 804852 (0.0008) [2023-12-28 01:02:20,480][106226] Updated weights for policy 0, policy_version 804862 (0.0007) [2023-12-28 01:02:20,542][106226] Updated weights for policy 0, policy_version 804872 (0.0008) [2023-12-28 01:02:20,760][106225] Updated weights for policy 1, policy_version 806960 (0.0007) [2023-12-28 01:02:20,820][106225] Updated weights for policy 1, policy_version 806970 (0.0009) [2023-12-28 01:02:20,874][106225] Updated weights for policy 1, policy_version 806980 (0.0010) [2023-12-28 01:02:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 412729344. Throughput: 0: 9910.2, 1: 9645.9. Samples: 412739904. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:21,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.839')] [2023-12-28 01:02:21,311][106226] Updated weights for policy 0, policy_version 804882 (0.0008) [2023-12-28 01:02:21,379][106226] Updated weights for policy 0, policy_version 804892 (0.0009) [2023-12-28 01:02:21,447][106226] Updated weights for policy 0, policy_version 804902 (0.0009) [2023-12-28 01:02:21,604][106225] Updated weights for policy 1, policy_version 806990 (0.0009) [2023-12-28 01:02:21,668][106225] Updated weights for policy 1, policy_version 807000 (0.0008) [2023-12-28 01:02:21,728][106225] Updated weights for policy 1, policy_version 807010 (0.0008) [2023-12-28 01:02:22,169][106226] Updated weights for policy 0, policy_version 804912 (0.0006) [2023-12-28 01:02:22,228][106226] Updated weights for policy 0, policy_version 804922 (0.0005) [2023-12-28 01:02:22,302][106226] Updated weights for policy 0, policy_version 804932 (0.0007) [2023-12-28 01:02:22,555][106225] Updated weights for policy 1, policy_version 807020 (0.0008) [2023-12-28 01:02:22,619][106225] Updated weights for policy 1, policy_version 807030 (0.0008) [2023-12-28 01:02:22,683][106225] Updated weights for policy 1, policy_version 807040 (0.0006) [2023-12-28 01:02:22,928][106226] Updated weights for policy 0, policy_version 804942 (0.0009) [2023-12-28 01:02:23,002][106226] Updated weights for policy 0, policy_version 804952 (0.0008) [2023-12-28 01:02:23,066][106226] Updated weights for policy 0, policy_version 804962 (0.0008) [2023-12-28 01:02:23,378][106225] Updated weights for policy 1, policy_version 807050 (0.0007) [2023-12-28 01:02:23,426][106225] Updated weights for policy 1, policy_version 807060 (0.0006) [2023-12-28 01:02:23,475][106225] Updated weights for policy 1, policy_version 807070 (0.0006) [2023-12-28 01:02:23,519][106225] Updated weights for policy 1, policy_version 807080 (0.0010) [2023-12-28 01:02:23,687][106226] Updated weights for policy 0, policy_version 804972 (0.0007) [2023-12-28 01:02:23,747][106226] Updated weights for policy 0, policy_version 804982 (0.0009) [2023-12-28 01:02:23,805][106226] Updated weights for policy 0, policy_version 804992 (0.0009) [2023-12-28 01:02:24,138][106225] Updated weights for policy 1, policy_version 807090 (0.0010) [2023-12-28 01:02:24,206][106225] Updated weights for policy 1, policy_version 807100 (0.0011) [2023-12-28 01:02:24,281][106225] Updated weights for policy 1, policy_version 807110 (0.0010) [2023-12-28 01:02:24,560][106226] Updated weights for policy 0, policy_version 805002 (0.0010) [2023-12-28 01:02:24,622][106226] Updated weights for policy 0, policy_version 805012 (0.0008) [2023-12-28 01:02:24,680][106226] Updated weights for policy 0, policy_version 805022 (0.0008) [2023-12-28 01:02:24,744][106226] Updated weights for policy 0, policy_version 805032 (0.0007) [2023-12-28 01:02:24,905][106225] Updated weights for policy 1, policy_version 807120 (0.0011) [2023-12-28 01:02:24,969][106225] Updated weights for policy 1, policy_version 807130 (0.0010) [2023-12-28 01:02:25,023][106225] Updated weights for policy 1, policy_version 807140 (0.0010) [2023-12-28 01:02:25,476][106226] Updated weights for policy 0, policy_version 805042 (0.0008) [2023-12-28 01:02:25,533][106226] Updated weights for policy 0, policy_version 805052 (0.0007) [2023-12-28 01:02:25,589][106226] Updated weights for policy 0, policy_version 805062 (0.0007) [2023-12-28 01:02:25,685][106225] Updated weights for policy 1, policy_version 807150 (0.0010) [2023-12-28 01:02:25,734][106225] Updated weights for policy 1, policy_version 807160 (0.0010) [2023-12-28 01:02:25,784][106225] Updated weights for policy 1, policy_version 807170 (0.0010) [2023-12-28 01:02:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 412827648. Throughput: 0: 9849.9, 1: 9665.7. Samples: 412797408. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:26,176][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.802')] [2023-12-28 01:02:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000807176_206675968.pth... [2023-12-28 01:02:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000805064_206151680.pth... [2023-12-28 01:02:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000806056_206389248.pth [2023-12-28 01:02:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000803912_205856768.pth [2023-12-28 01:02:26,344][106226] Updated weights for policy 0, policy_version 805072 (0.0008) [2023-12-28 01:02:26,395][106226] Updated weights for policy 0, policy_version 805082 (0.0008) [2023-12-28 01:02:26,440][106226] Updated weights for policy 0, policy_version 805092 (0.0008) [2023-12-28 01:02:26,476][106225] Updated weights for policy 1, policy_version 807180 (0.0009) [2023-12-28 01:02:26,520][106225] Updated weights for policy 1, policy_version 807190 (0.0008) [2023-12-28 01:02:26,563][106225] Updated weights for policy 1, policy_version 807200 (0.0008) [2023-12-28 01:02:27,128][106226] Updated weights for policy 0, policy_version 805102 (0.0006) [2023-12-28 01:02:27,181][106226] Updated weights for policy 0, policy_version 805112 (0.0005) [2023-12-28 01:02:27,196][106225] Updated weights for policy 1, policy_version 807210 (0.0008) [2023-12-28 01:02:27,249][106226] Updated weights for policy 0, policy_version 805122 (0.0006) [2023-12-28 01:02:27,258][106225] Updated weights for policy 1, policy_version 807220 (0.0008) [2023-12-28 01:02:27,321][106225] Updated weights for policy 1, policy_version 807230 (0.0008) [2023-12-28 01:02:27,375][106225] Updated weights for policy 1, policy_version 807240 (0.0006) [2023-12-28 01:02:27,756][106226] Updated weights for policy 0, policy_version 805132 (0.0006) [2023-12-28 01:02:27,815][106226] Updated weights for policy 0, policy_version 805142 (0.0006) [2023-12-28 01:02:27,877][106226] Updated weights for policy 0, policy_version 805152 (0.0005) [2023-12-28 01:02:27,913][106225] Updated weights for policy 1, policy_version 807250 (0.0005) [2023-12-28 01:02:27,963][106225] Updated weights for policy 1, policy_version 807260 (0.0006) [2023-12-28 01:02:28,015][106225] Updated weights for policy 1, policy_version 807270 (0.0007) [2023-12-28 01:02:28,441][106226] Updated weights for policy 0, policy_version 805162 (0.0006) [2023-12-28 01:02:28,495][106226] Updated weights for policy 0, policy_version 805172 (0.0008) [2023-12-28 01:02:28,550][106226] Updated weights for policy 0, policy_version 805182 (0.0009) [2023-12-28 01:02:28,602][106226] Updated weights for policy 0, policy_version 805192 (0.0008) [2023-12-28 01:02:28,636][106225] Updated weights for policy 1, policy_version 807280 (0.0006) [2023-12-28 01:02:28,695][106225] Updated weights for policy 1, policy_version 807290 (0.0005) [2023-12-28 01:02:28,754][106225] Updated weights for policy 1, policy_version 807300 (0.0009) [2023-12-28 01:02:29,300][106226] Updated weights for policy 0, policy_version 805202 (0.0009) [2023-12-28 01:02:29,367][106226] Updated weights for policy 0, policy_version 805212 (0.0008) [2023-12-28 01:02:29,399][106225] Updated weights for policy 1, policy_version 807310 (0.0009) [2023-12-28 01:02:29,421][106226] Updated weights for policy 0, policy_version 805222 (0.0010) [2023-12-28 01:02:29,452][106225] Updated weights for policy 1, policy_version 807320 (0.0006) [2023-12-28 01:02:29,505][106225] Updated weights for policy 1, policy_version 807330 (0.0006) [2023-12-28 01:02:30,154][106225] Updated weights for policy 1, policy_version 807340 (0.0007) [2023-12-28 01:02:30,210][106226] Updated weights for policy 0, policy_version 805232 (0.0008) [2023-12-28 01:02:30,218][106225] Updated weights for policy 1, policy_version 807350 (0.0010) [2023-12-28 01:02:30,271][106226] Updated weights for policy 0, policy_version 805242 (0.0009) [2023-12-28 01:02:30,281][106225] Updated weights for policy 1, policy_version 807360 (0.0007) [2023-12-28 01:02:30,329][106226] Updated weights for policy 0, policy_version 805252 (0.0007) [2023-12-28 01:02:30,982][106225] Updated weights for policy 1, policy_version 807370 (0.0009) [2023-12-28 01:02:31,056][106225] Updated weights for policy 1, policy_version 807380 (0.0008) [2023-12-28 01:02:31,062][106226] Updated weights for policy 0, policy_version 805262 (0.0008) [2023-12-28 01:02:31,110][106225] Updated weights for policy 1, policy_version 807390 (0.0008) [2023-12-28 01:02:31,122][106226] Updated weights for policy 0, policy_version 805272 (0.0006) [2023-12-28 01:02:31,173][106225] Updated weights for policy 1, policy_version 807400 (0.0008) [2023-12-28 01:02:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 412934144. Throughput: 0: 9926.0, 1: 9872.1. Samples: 412924764. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:31,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-5.187')] [2023-12-28 01:02:31,193][106226] Updated weights for policy 0, policy_version 805282 (0.0007) [2023-12-28 01:02:31,862][106226] Updated weights for policy 0, policy_version 805292 (0.0006) [2023-12-28 01:02:31,924][106226] Updated weights for policy 0, policy_version 805302 (0.0008) [2023-12-28 01:02:31,964][106225] Updated weights for policy 1, policy_version 807410 (0.0007) [2023-12-28 01:02:31,983][106226] Updated weights for policy 0, policy_version 805312 (0.0006) [2023-12-28 01:02:32,028][106225] Updated weights for policy 1, policy_version 807420 (0.0007) [2023-12-28 01:02:32,078][106225] Updated weights for policy 1, policy_version 807430 (0.0008) [2023-12-28 01:02:32,545][106226] Updated weights for policy 0, policy_version 805322 (0.0006) [2023-12-28 01:02:32,602][106226] Updated weights for policy 0, policy_version 805332 (0.0005) [2023-12-28 01:02:32,661][106226] Updated weights for policy 0, policy_version 805342 (0.0008) [2023-12-28 01:02:32,722][106226] Updated weights for policy 0, policy_version 805352 (0.0009) [2023-12-28 01:02:32,758][106225] Updated weights for policy 1, policy_version 807440 (0.0007) [2023-12-28 01:02:32,821][106225] Updated weights for policy 1, policy_version 807450 (0.0009) [2023-12-28 01:02:32,880][106225] Updated weights for policy 1, policy_version 807460 (0.0008) [2023-12-28 01:02:33,423][106226] Updated weights for policy 0, policy_version 805362 (0.0008) [2023-12-28 01:02:33,469][106226] Updated weights for policy 0, policy_version 805372 (0.0008) [2023-12-28 01:02:33,517][106226] Updated weights for policy 0, policy_version 805382 (0.0008) [2023-12-28 01:02:33,564][106225] Updated weights for policy 1, policy_version 807470 (0.0009) [2023-12-28 01:02:33,626][106225] Updated weights for policy 1, policy_version 807480 (0.0010) [2023-12-28 01:02:33,683][106225] Updated weights for policy 1, policy_version 807490 (0.0010) [2023-12-28 01:02:34,128][106226] Updated weights for policy 0, policy_version 805392 (0.0007) [2023-12-28 01:02:34,194][106226] Updated weights for policy 0, policy_version 805402 (0.0008) [2023-12-28 01:02:34,255][106226] Updated weights for policy 0, policy_version 805412 (0.0006) [2023-12-28 01:02:34,386][106225] Updated weights for policy 1, policy_version 807500 (0.0009) [2023-12-28 01:02:34,446][106225] Updated weights for policy 1, policy_version 807510 (0.0008) [2023-12-28 01:02:34,504][106225] Updated weights for policy 1, policy_version 807520 (0.0008) [2023-12-28 01:02:34,888][106226] Updated weights for policy 0, policy_version 805422 (0.0007) [2023-12-28 01:02:34,948][106226] Updated weights for policy 0, policy_version 805432 (0.0008) [2023-12-28 01:02:35,000][106226] Updated weights for policy 0, policy_version 805442 (0.0008) [2023-12-28 01:02:35,242][106225] Updated weights for policy 1, policy_version 807530 (0.0009) [2023-12-28 01:02:35,295][106225] Updated weights for policy 1, policy_version 807540 (0.0010) [2023-12-28 01:02:35,360][106225] Updated weights for policy 1, policy_version 807550 (0.0009) [2023-12-28 01:02:35,419][106225] Updated weights for policy 1, policy_version 807560 (0.0006) [2023-12-28 01:02:35,782][106226] Updated weights for policy 0, policy_version 805452 (0.0008) [2023-12-28 01:02:35,830][106226] Updated weights for policy 0, policy_version 805462 (0.0008) [2023-12-28 01:02:35,879][106226] Updated weights for policy 0, policy_version 805472 (0.0009) [2023-12-28 01:02:35,984][106225] Updated weights for policy 1, policy_version 807570 (0.0006) [2023-12-28 01:02:36,033][106225] Updated weights for policy 1, policy_version 807580 (0.0009) [2023-12-28 01:02:36,090][106225] Updated weights for policy 1, policy_version 807590 (0.0007) [2023-12-28 01:02:36,175][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 413040640. Throughput: 0: 9967.2, 1: 9821.8. Samples: 413043908. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:36,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.984')] [2023-12-28 01:02:36,711][106226] Updated weights for policy 0, policy_version 805482 (0.0008) [2023-12-28 01:02:36,741][106225] Updated weights for policy 1, policy_version 807600 (0.0006) [2023-12-28 01:02:36,763][106226] Updated weights for policy 0, policy_version 805492 (0.0007) [2023-12-28 01:02:36,799][106225] Updated weights for policy 1, policy_version 807610 (0.0008) [2023-12-28 01:02:36,814][106226] Updated weights for policy 0, policy_version 805502 (0.0006) [2023-12-28 01:02:36,850][106225] Updated weights for policy 1, policy_version 807620 (0.0008) [2023-12-28 01:02:36,872][106226] Updated weights for policy 0, policy_version 805512 (0.0007) [2023-12-28 01:02:37,501][106226] Updated weights for policy 0, policy_version 805522 (0.0009) [2023-12-28 01:02:37,551][106225] Updated weights for policy 1, policy_version 807630 (0.0007) [2023-12-28 01:02:37,562][106226] Updated weights for policy 0, policy_version 805532 (0.0008) [2023-12-28 01:02:37,600][106225] Updated weights for policy 1, policy_version 807640 (0.0007) [2023-12-28 01:02:37,617][106226] Updated weights for policy 0, policy_version 805542 (0.0007) [2023-12-28 01:02:37,659][106225] Updated weights for policy 1, policy_version 807650 (0.0006) [2023-12-28 01:02:38,200][106226] Updated weights for policy 0, policy_version 805552 (0.0011) [2023-12-28 01:02:38,253][106226] Updated weights for policy 0, policy_version 805562 (0.0010) [2023-12-28 01:02:38,302][106226] Updated weights for policy 0, policy_version 805572 (0.0010) [2023-12-28 01:02:38,401][106225] Updated weights for policy 1, policy_version 807660 (0.0008) [2023-12-28 01:02:38,461][106225] Updated weights for policy 1, policy_version 807670 (0.0008) [2023-12-28 01:02:38,523][106225] Updated weights for policy 1, policy_version 807680 (0.0008) [2023-12-28 01:02:39,038][106226] Updated weights for policy 0, policy_version 805582 (0.0010) [2023-12-28 01:02:39,094][106226] Updated weights for policy 0, policy_version 805593 (0.0007) [2023-12-28 01:02:39,148][106226] Updated weights for policy 0, policy_version 805603 (0.0006) [2023-12-28 01:02:39,292][106225] Updated weights for policy 1, policy_version 807690 (0.0008) [2023-12-28 01:02:39,361][106225] Updated weights for policy 1, policy_version 807700 (0.0009) [2023-12-28 01:02:39,433][106225] Updated weights for policy 1, policy_version 807710 (0.0009) [2023-12-28 01:02:39,502][106225] Updated weights for policy 1, policy_version 807720 (0.0008) [2023-12-28 01:02:39,889][106226] Updated weights for policy 0, policy_version 805613 (0.0007) [2023-12-28 01:02:39,961][106226] Updated weights for policy 0, policy_version 805623 (0.0008) [2023-12-28 01:02:40,030][106226] Updated weights for policy 0, policy_version 805633 (0.0008) [2023-12-28 01:02:40,176][106225] Updated weights for policy 1, policy_version 807730 (0.0008) [2023-12-28 01:02:40,238][106225] Updated weights for policy 1, policy_version 807740 (0.0008) [2023-12-28 01:02:40,289][106225] Updated weights for policy 1, policy_version 807750 (0.0007) [2023-12-28 01:02:40,695][106226] Updated weights for policy 0, policy_version 805643 (0.0008) [2023-12-28 01:02:40,761][106226] Updated weights for policy 0, policy_version 805653 (0.0009) [2023-12-28 01:02:40,819][106226] Updated weights for policy 0, policy_version 805663 (0.0011) [2023-12-28 01:02:40,988][106225] Updated weights for policy 1, policy_version 807760 (0.0008) [2023-12-28 01:02:41,055][106225] Updated weights for policy 1, policy_version 807770 (0.0008) [2023-12-28 01:02:41,116][106225] Updated weights for policy 1, policy_version 807780 (0.0007) [2023-12-28 01:02:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 413138944. Throughput: 0: 9991.7, 1: 9846.4. Samples: 413105128. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:41,176][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.245')] [2023-12-28 01:02:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000805672_206307328.pth... [2023-12-28 01:02:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000807784_206831616.pth... [2023-12-28 01:02:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000804488_206004224.pth [2023-12-28 01:02:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000806600_206528512.pth [2023-12-28 01:02:41,546][106226] Updated weights for policy 0, policy_version 805673 (0.0011) [2023-12-28 01:02:41,597][106226] Updated weights for policy 0, policy_version 805683 (0.0009) [2023-12-28 01:02:41,665][106226] Updated weights for policy 0, policy_version 805693 (0.0008) [2023-12-28 01:02:41,732][106226] Updated weights for policy 0, policy_version 805703 (0.0008) [2023-12-28 01:02:41,909][106225] Updated weights for policy 1, policy_version 807790 (0.0007) [2023-12-28 01:02:41,970][106225] Updated weights for policy 1, policy_version 807800 (0.0008) [2023-12-28 01:02:42,037][106225] Updated weights for policy 1, policy_version 807810 (0.0008) [2023-12-28 01:02:42,514][106226] Updated weights for policy 0, policy_version 805713 (0.0008) [2023-12-28 01:02:42,581][106226] Updated weights for policy 0, policy_version 805723 (0.0008) [2023-12-28 01:02:42,641][106226] Updated weights for policy 0, policy_version 805733 (0.0009) [2023-12-28 01:02:42,816][106225] Updated weights for policy 1, policy_version 807820 (0.0008) [2023-12-28 01:02:42,865][106225] Updated weights for policy 1, policy_version 807830 (0.0008) [2023-12-28 01:02:42,914][106225] Updated weights for policy 1, policy_version 807840 (0.0008) [2023-12-28 01:02:43,260][106226] Updated weights for policy 0, policy_version 805743 (0.0007) [2023-12-28 01:02:43,310][106226] Updated weights for policy 0, policy_version 805753 (0.0009) [2023-12-28 01:02:43,356][106226] Updated weights for policy 0, policy_version 805763 (0.0008) [2023-12-28 01:02:43,666][106225] Updated weights for policy 1, policy_version 807850 (0.0008) [2023-12-28 01:02:43,726][106225] Updated weights for policy 1, policy_version 807860 (0.0009) [2023-12-28 01:02:43,782][106225] Updated weights for policy 1, policy_version 807870 (0.0009) [2023-12-28 01:02:43,834][106225] Updated weights for policy 1, policy_version 807880 (0.0009) [2023-12-28 01:02:43,948][106226] Updated weights for policy 0, policy_version 805773 (0.0007) [2023-12-28 01:02:44,024][106226] Updated weights for policy 0, policy_version 805783 (0.0009) [2023-12-28 01:02:44,079][106226] Updated weights for policy 0, policy_version 805793 (0.0009) [2023-12-28 01:02:44,556][106225] Updated weights for policy 1, policy_version 807890 (0.0010) [2023-12-28 01:02:44,613][106225] Updated weights for policy 1, policy_version 807900 (0.0008) [2023-12-28 01:02:44,667][106225] Updated weights for policy 1, policy_version 807910 (0.0008) [2023-12-28 01:02:44,713][106226] Updated weights for policy 0, policy_version 805803 (0.0008) [2023-12-28 01:02:44,792][106226] Updated weights for policy 0, policy_version 805813 (0.0007) [2023-12-28 01:02:44,861][106226] Updated weights for policy 0, policy_version 805823 (0.0008) [2023-12-28 01:02:45,447][106225] Updated weights for policy 1, policy_version 807920 (0.0008) [2023-12-28 01:02:45,471][106226] Updated weights for policy 0, policy_version 805833 (0.0008) [2023-12-28 01:02:45,496][106225] Updated weights for policy 1, policy_version 807930 (0.0008) [2023-12-28 01:02:45,531][106226] Updated weights for policy 0, policy_version 805843 (0.0007) [2023-12-28 01:02:45,542][106225] Updated weights for policy 1, policy_version 807940 (0.0006) [2023-12-28 01:02:45,593][106226] Updated weights for policy 0, policy_version 805853 (0.0005) [2023-12-28 01:02:45,660][106226] Updated weights for policy 0, policy_version 805863 (0.0007) [2023-12-28 01:02:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 413229056. Throughput: 0: 10013.5, 1: 9810.5. Samples: 413221580. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:46,175][105115] Avg episode reward: [(0, '-4.290'), (1, '-5.048')] [2023-12-28 01:02:46,235][106225] Updated weights for policy 1, policy_version 807950 (0.0007) [2023-12-28 01:02:46,290][106225] Updated weights for policy 1, policy_version 807960 (0.0005) [2023-12-28 01:02:46,294][106226] Updated weights for policy 0, policy_version 805873 (0.0010) [2023-12-28 01:02:46,347][106225] Updated weights for policy 1, policy_version 807970 (0.0009) [2023-12-28 01:02:46,350][106226] Updated weights for policy 0, policy_version 805883 (0.0010) [2023-12-28 01:02:46,410][106226] Updated weights for policy 0, policy_version 805893 (0.0010) [2023-12-28 01:02:46,975][106225] Updated weights for policy 1, policy_version 807980 (0.0010) [2023-12-28 01:02:47,032][106225] Updated weights for policy 1, policy_version 807990 (0.0010) [2023-12-28 01:02:47,036][106226] Updated weights for policy 0, policy_version 805903 (0.0008) [2023-12-28 01:02:47,088][106225] Updated weights for policy 1, policy_version 808000 (0.0010) [2023-12-28 01:02:47,093][106226] Updated weights for policy 0, policy_version 805913 (0.0006) [2023-12-28 01:02:47,148][106226] Updated weights for policy 0, policy_version 805923 (0.0007) [2023-12-28 01:02:47,727][106226] Updated weights for policy 0, policy_version 805933 (0.0008) [2023-12-28 01:02:47,771][106225] Updated weights for policy 1, policy_version 808010 (0.0010) [2023-12-28 01:02:47,815][106226] Updated weights for policy 0, policy_version 805943 (0.0010) [2023-12-28 01:02:47,826][106225] Updated weights for policy 1, policy_version 808020 (0.0007) [2023-12-28 01:02:47,875][106226] Updated weights for policy 0, policy_version 805953 (0.0010) [2023-12-28 01:02:47,882][106225] Updated weights for policy 1, policy_version 808030 (0.0005) [2023-12-28 01:02:47,928][106225] Updated weights for policy 1, policy_version 808040 (0.0005) [2023-12-28 01:02:48,506][106225] Updated weights for policy 1, policy_version 808050 (0.0008) [2023-12-28 01:02:48,517][106226] Updated weights for policy 0, policy_version 805963 (0.0011) [2023-12-28 01:02:48,565][106225] Updated weights for policy 1, policy_version 808060 (0.0006) [2023-12-28 01:02:48,582][106226] Updated weights for policy 0, policy_version 805973 (0.0011) [2023-12-28 01:02:48,623][106225] Updated weights for policy 1, policy_version 808070 (0.0008) [2023-12-28 01:02:48,647][106226] Updated weights for policy 0, policy_version 805983 (0.0011) [2023-12-28 01:02:49,305][106226] Updated weights for policy 0, policy_version 805993 (0.0011) [2023-12-28 01:02:49,383][106226] Updated weights for policy 0, policy_version 806003 (0.0011) [2023-12-28 01:02:49,428][106225] Updated weights for policy 1, policy_version 808080 (0.0006) [2023-12-28 01:02:49,443][106226] Updated weights for policy 0, policy_version 806013 (0.0008) [2023-12-28 01:02:49,479][106225] Updated weights for policy 1, policy_version 808090 (0.0007) [2023-12-28 01:02:49,509][106226] Updated weights for policy 0, policy_version 806023 (0.0007) [2023-12-28 01:02:49,528][106225] Updated weights for policy 1, policy_version 808100 (0.0007) [2023-12-28 01:02:50,146][106226] Updated weights for policy 0, policy_version 806033 (0.0009) [2023-12-28 01:02:50,198][106226] Updated weights for policy 0, policy_version 806043 (0.0008) [2023-12-28 01:02:50,258][106226] Updated weights for policy 0, policy_version 806053 (0.0008) [2023-12-28 01:02:50,325][106225] Updated weights for policy 1, policy_version 808110 (0.0008) [2023-12-28 01:02:50,383][106225] Updated weights for policy 1, policy_version 808120 (0.0009) [2023-12-28 01:02:50,441][106225] Updated weights for policy 1, policy_version 808130 (0.0009) [2023-12-28 01:02:50,944][106226] Updated weights for policy 0, policy_version 806063 (0.0008) [2023-12-28 01:02:51,007][106226] Updated weights for policy 0, policy_version 806073 (0.0009) [2023-12-28 01:02:51,077][106226] Updated weights for policy 0, policy_version 806083 (0.0008) [2023-12-28 01:02:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 413335552. Throughput: 0: 10088.7, 1: 9760.6. Samples: 413344076. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:51,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.908')] [2023-12-28 01:02:51,231][106225] Updated weights for policy 1, policy_version 808140 (0.0009) [2023-12-28 01:02:51,307][106225] Updated weights for policy 1, policy_version 808150 (0.0007) [2023-12-28 01:02:51,378][106225] Updated weights for policy 1, policy_version 808160 (0.0008) [2023-12-28 01:02:51,820][106226] Updated weights for policy 0, policy_version 806093 (0.0007) [2023-12-28 01:02:51,891][106226] Updated weights for policy 0, policy_version 806103 (0.0006) [2023-12-28 01:02:51,954][106226] Updated weights for policy 0, policy_version 806113 (0.0008) [2023-12-28 01:02:52,091][106225] Updated weights for policy 1, policy_version 808170 (0.0008) [2023-12-28 01:02:52,155][106225] Updated weights for policy 1, policy_version 808180 (0.0008) [2023-12-28 01:02:52,214][106225] Updated weights for policy 1, policy_version 808190 (0.0010) [2023-12-28 01:02:52,279][106225] Updated weights for policy 1, policy_version 808200 (0.0010) [2023-12-28 01:02:52,589][106226] Updated weights for policy 0, policy_version 806123 (0.0007) [2023-12-28 01:02:52,646][106226] Updated weights for policy 0, policy_version 806133 (0.0006) [2023-12-28 01:02:52,697][106226] Updated weights for policy 0, policy_version 806143 (0.0009) [2023-12-28 01:02:52,896][106225] Updated weights for policy 1, policy_version 808210 (0.0006) [2023-12-28 01:02:52,947][106225] Updated weights for policy 1, policy_version 808220 (0.0008) [2023-12-28 01:02:52,998][106225] Updated weights for policy 1, policy_version 808230 (0.0010) [2023-12-28 01:02:53,467][106226] Updated weights for policy 0, policy_version 806153 (0.0009) [2023-12-28 01:02:53,534][106226] Updated weights for policy 0, policy_version 806163 (0.0008) [2023-12-28 01:02:53,592][106226] Updated weights for policy 0, policy_version 806173 (0.0007) [2023-12-28 01:02:53,628][106225] Updated weights for policy 1, policy_version 808240 (0.0008) [2023-12-28 01:02:53,638][106226] Updated weights for policy 0, policy_version 806183 (0.0007) [2023-12-28 01:02:53,688][106225] Updated weights for policy 1, policy_version 808250 (0.0010) [2023-12-28 01:02:53,749][106225] Updated weights for policy 1, policy_version 808260 (0.0010) [2023-12-28 01:02:54,318][106226] Updated weights for policy 0, policy_version 806193 (0.0010) [2023-12-28 01:02:54,352][106225] Updated weights for policy 1, policy_version 808270 (0.0009) [2023-12-28 01:02:54,379][106226] Updated weights for policy 0, policy_version 806203 (0.0011) [2023-12-28 01:02:54,409][106225] Updated weights for policy 1, policy_version 808280 (0.0010) [2023-12-28 01:02:54,429][106226] Updated weights for policy 0, policy_version 806213 (0.0010) [2023-12-28 01:02:54,465][106225] Updated weights for policy 1, policy_version 808290 (0.0010) [2023-12-28 01:02:55,119][106225] Updated weights for policy 1, policy_version 808300 (0.0010) [2023-12-28 01:02:55,146][106226] Updated weights for policy 0, policy_version 806223 (0.0007) [2023-12-28 01:02:55,205][106226] Updated weights for policy 0, policy_version 806233 (0.0006) [2023-12-28 01:02:55,210][106225] Updated weights for policy 1, policy_version 808310 (0.0010) [2023-12-28 01:02:55,262][106226] Updated weights for policy 0, policy_version 806243 (0.0006) [2023-12-28 01:02:55,268][106225] Updated weights for policy 1, policy_version 808320 (0.0011) [2023-12-28 01:02:55,836][106226] Updated weights for policy 0, policy_version 806253 (0.0006) [2023-12-28 01:02:55,885][106226] Updated weights for policy 0, policy_version 806263 (0.0006) [2023-12-28 01:02:55,932][106225] Updated weights for policy 1, policy_version 808330 (0.0009) [2023-12-28 01:02:55,935][106226] Updated weights for policy 0, policy_version 806273 (0.0006) [2023-12-28 01:02:55,986][106225] Updated weights for policy 1, policy_version 808340 (0.0010) [2023-12-28 01:02:56,035][106225] Updated weights for policy 1, policy_version 808350 (0.0010) [2023-12-28 01:02:56,086][106225] Updated weights for policy 1, policy_version 808360 (0.0010) [2023-12-28 01:02:56,175][105115] Fps is (10 sec: 21298.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 413442048. Throughput: 0: 10074.2, 1: 9819.0. Samples: 413404072. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:02:56,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-5.029')] [2023-12-28 01:02:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000808360_206979072.pth... [2023-12-28 01:02:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000806280_206462976.pth... [2023-12-28 01:02:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000805064_206151680.pth [2023-12-28 01:02:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000807176_206675968.pth [2023-12-28 01:02:56,620][106226] Updated weights for policy 0, policy_version 806283 (0.0007) [2023-12-28 01:02:56,679][106226] Updated weights for policy 0, policy_version 806293 (0.0011) [2023-12-28 01:02:56,737][106226] Updated weights for policy 0, policy_version 806303 (0.0011) [2023-12-28 01:02:56,772][106225] Updated weights for policy 1, policy_version 808370 (0.0006) [2023-12-28 01:02:56,828][106225] Updated weights for policy 1, policy_version 808380 (0.0005) [2023-12-28 01:02:56,887][106225] Updated weights for policy 1, policy_version 808390 (0.0005) [2023-12-28 01:02:57,384][106226] Updated weights for policy 0, policy_version 806313 (0.0010) [2023-12-28 01:02:57,411][106225] Updated weights for policy 1, policy_version 808400 (0.0005) [2023-12-28 01:02:57,434][106226] Updated weights for policy 0, policy_version 806323 (0.0005) [2023-12-28 01:02:57,466][106225] Updated weights for policy 1, policy_version 808410 (0.0005) [2023-12-28 01:02:57,489][106226] Updated weights for policy 0, policy_version 806333 (0.0009) [2023-12-28 01:02:57,519][106225] Updated weights for policy 1, policy_version 808420 (0.0005) [2023-12-28 01:02:57,546][106226] Updated weights for policy 0, policy_version 806343 (0.0010) [2023-12-28 01:02:58,170][106225] Updated weights for policy 1, policy_version 808430 (0.0007) [2023-12-28 01:02:58,176][106226] Updated weights for policy 0, policy_version 806353 (0.0006) [2023-12-28 01:02:58,228][106225] Updated weights for policy 1, policy_version 808440 (0.0007) [2023-12-28 01:02:58,236][106226] Updated weights for policy 0, policy_version 806363 (0.0007) [2023-12-28 01:02:58,291][106225] Updated weights for policy 1, policy_version 808450 (0.0006) [2023-12-28 01:02:58,299][106226] Updated weights for policy 0, policy_version 806373 (0.0007) [2023-12-28 01:02:59,076][106225] Updated weights for policy 1, policy_version 808460 (0.0007) [2023-12-28 01:02:59,088][106226] Updated weights for policy 0, policy_version 806383 (0.0008) [2023-12-28 01:02:59,135][106225] Updated weights for policy 1, policy_version 808470 (0.0008) [2023-12-28 01:02:59,148][106226] Updated weights for policy 0, policy_version 806393 (0.0008) [2023-12-28 01:02:59,195][106225] Updated weights for policy 1, policy_version 808480 (0.0007) [2023-12-28 01:02:59,204][106226] Updated weights for policy 0, policy_version 806403 (0.0008) [2023-12-28 01:02:59,899][106225] Updated weights for policy 1, policy_version 808490 (0.0009) [2023-12-28 01:02:59,901][106226] Updated weights for policy 0, policy_version 806413 (0.0007) [2023-12-28 01:02:59,958][106225] Updated weights for policy 1, policy_version 808500 (0.0009) [2023-12-28 01:02:59,960][106226] Updated weights for policy 0, policy_version 806423 (0.0007) [2023-12-28 01:03:00,018][106226] Updated weights for policy 0, policy_version 806433 (0.0006) [2023-12-28 01:03:00,018][106225] Updated weights for policy 1, policy_version 808510 (0.0007) [2023-12-28 01:03:00,078][106225] Updated weights for policy 1, policy_version 808520 (0.0008) [2023-12-28 01:03:00,604][106226] Updated weights for policy 0, policy_version 806443 (0.0006) [2023-12-28 01:03:00,658][106226] Updated weights for policy 0, policy_version 806453 (0.0008) [2023-12-28 01:03:00,712][106226] Updated weights for policy 0, policy_version 806463 (0.0006) [2023-12-28 01:03:00,721][106225] Updated weights for policy 1, policy_version 808530 (0.0010) [2023-12-28 01:03:00,786][106225] Updated weights for policy 1, policy_version 808540 (0.0010) [2023-12-28 01:03:00,840][106225] Updated weights for policy 1, policy_version 808550 (0.0010) [2023-12-28 01:03:01,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 413540352. Throughput: 0: 10128.9, 1: 9969.8. Samples: 413526984. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:03:01,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.789')] [2023-12-28 01:03:01,469][106226] Updated weights for policy 0, policy_version 806473 (0.0008) [2023-12-28 01:03:01,530][106226] Updated weights for policy 0, policy_version 806483 (0.0008) [2023-12-28 01:03:01,557][106225] Updated weights for policy 1, policy_version 808560 (0.0010) [2023-12-28 01:03:01,590][106226] Updated weights for policy 0, policy_version 806493 (0.0006) [2023-12-28 01:03:01,616][106225] Updated weights for policy 1, policy_version 808570 (0.0010) [2023-12-28 01:03:01,655][106226] Updated weights for policy 0, policy_version 806503 (0.0008) [2023-12-28 01:03:01,686][106225] Updated weights for policy 1, policy_version 808580 (0.0009) [2023-12-28 01:03:02,380][106226] Updated weights for policy 0, policy_version 806513 (0.0008) [2023-12-28 01:03:02,417][106225] Updated weights for policy 1, policy_version 808590 (0.0008) [2023-12-28 01:03:02,444][106226] Updated weights for policy 0, policy_version 806523 (0.0006) [2023-12-28 01:03:02,483][106225] Updated weights for policy 1, policy_version 808600 (0.0006) [2023-12-28 01:03:02,505][106226] Updated weights for policy 0, policy_version 806533 (0.0007) [2023-12-28 01:03:02,536][106225] Updated weights for policy 1, policy_version 808610 (0.0006) [2023-12-28 01:03:03,149][106226] Updated weights for policy 0, policy_version 806543 (0.0010) [2023-12-28 01:03:03,170][106225] Updated weights for policy 1, policy_version 808620 (0.0006) [2023-12-28 01:03:03,201][106226] Updated weights for policy 0, policy_version 806553 (0.0008) [2023-12-28 01:03:03,227][106225] Updated weights for policy 1, policy_version 808630 (0.0007) [2023-12-28 01:03:03,251][106226] Updated weights for policy 0, policy_version 806563 (0.0005) [2023-12-28 01:03:03,279][106225] Updated weights for policy 1, policy_version 808640 (0.0008) [2023-12-28 01:03:03,865][106226] Updated weights for policy 0, policy_version 806573 (0.0007) [2023-12-28 01:03:03,931][106226] Updated weights for policy 0, policy_version 806583 (0.0009) [2023-12-28 01:03:03,991][106226] Updated weights for policy 0, policy_version 806593 (0.0007) [2023-12-28 01:03:04,044][106225] Updated weights for policy 1, policy_version 808650 (0.0008) [2023-12-28 01:03:04,093][106225] Updated weights for policy 1, policy_version 808660 (0.0008) [2023-12-28 01:03:04,141][106225] Updated weights for policy 1, policy_version 808670 (0.0009) [2023-12-28 01:03:04,191][106225] Updated weights for policy 1, policy_version 808680 (0.0008) [2023-12-28 01:03:04,797][106226] Updated weights for policy 0, policy_version 806603 (0.0007) [2023-12-28 01:03:04,853][106226] Updated weights for policy 0, policy_version 806613 (0.0008) [2023-12-28 01:03:04,863][106225] Updated weights for policy 1, policy_version 808690 (0.0006) [2023-12-28 01:03:04,914][106226] Updated weights for policy 0, policy_version 806623 (0.0008) [2023-12-28 01:03:04,920][106225] Updated weights for policy 1, policy_version 808700 (0.0006) [2023-12-28 01:03:04,978][106225] Updated weights for policy 1, policy_version 808710 (0.0006) [2023-12-28 01:03:05,573][106225] Updated weights for policy 1, policy_version 808720 (0.0006) [2023-12-28 01:03:05,623][106225] Updated weights for policy 1, policy_version 808730 (0.0005) [2023-12-28 01:03:05,679][106225] Updated weights for policy 1, policy_version 808740 (0.0005) [2023-12-28 01:03:05,698][106226] Updated weights for policy 0, policy_version 806633 (0.0009) [2023-12-28 01:03:05,746][106226] Updated weights for policy 0, policy_version 806643 (0.0009) [2023-12-28 01:03:05,798][106226] Updated weights for policy 0, policy_version 806653 (0.0008) [2023-12-28 01:03:05,848][106226] Updated weights for policy 0, policy_version 806663 (0.0008) [2023-12-28 01:03:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 413638656. Throughput: 0: 10120.3, 1: 10047.4. Samples: 413647452. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 01:03:06,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-5.265')] [2023-12-28 01:03:06,280][106225] Updated weights for policy 1, policy_version 808750 (0.0007) [2023-12-28 01:03:06,336][106225] Updated weights for policy 1, policy_version 808760 (0.0008) [2023-12-28 01:03:06,393][106225] Updated weights for policy 1, policy_version 808770 (0.0008) [2023-12-28 01:03:06,625][106226] Updated weights for policy 0, policy_version 806673 (0.0008) [2023-12-28 01:03:06,678][106226] Updated weights for policy 0, policy_version 806683 (0.0006) [2023-12-28 01:03:06,727][106226] Updated weights for policy 0, policy_version 806693 (0.0006) [2023-12-28 01:03:07,186][106225] Updated weights for policy 1, policy_version 808780 (0.0008) [2023-12-28 01:03:07,249][106225] Updated weights for policy 1, policy_version 808790 (0.0008) [2023-12-28 01:03:07,309][106225] Updated weights for policy 1, policy_version 808800 (0.0008) [2023-12-28 01:03:07,362][106226] Updated weights for policy 0, policy_version 806703 (0.0007) [2023-12-28 01:03:07,417][106226] Updated weights for policy 0, policy_version 806713 (0.0009) [2023-12-28 01:03:07,465][106226] Updated weights for policy 0, policy_version 806723 (0.0008) [2023-12-28 01:03:07,919][106225] Updated weights for policy 1, policy_version 808810 (0.0008) [2023-12-28 01:03:07,976][106225] Updated weights for policy 1, policy_version 808820 (0.0009) [2023-12-28 01:03:08,032][106225] Updated weights for policy 1, policy_version 808830 (0.0008) [2023-12-28 01:03:08,080][106225] Updated weights for policy 1, policy_version 808840 (0.0008) [2023-12-28 01:03:08,240][106226] Updated weights for policy 0, policy_version 806733 (0.0008) [2023-12-28 01:03:08,291][106226] Updated weights for policy 0, policy_version 806743 (0.0008) [2023-12-28 01:03:08,348][106226] Updated weights for policy 0, policy_version 806753 (0.0009) [2023-12-28 01:03:08,855][106225] Updated weights for policy 1, policy_version 808850 (0.0009) [2023-12-28 01:03:08,913][106225] Updated weights for policy 1, policy_version 808860 (0.0008) [2023-12-28 01:03:08,962][106225] Updated weights for policy 1, policy_version 808870 (0.0008) [2023-12-28 01:03:09,075][106226] Updated weights for policy 0, policy_version 806763 (0.0008) [2023-12-28 01:03:09,131][106226] Updated weights for policy 0, policy_version 806773 (0.0008) [2023-12-28 01:03:09,183][106226] Updated weights for policy 0, policy_version 806783 (0.0009) [2023-12-28 01:03:09,767][106225] Updated weights for policy 1, policy_version 808880 (0.0008) [2023-12-28 01:03:09,826][106225] Updated weights for policy 1, policy_version 808890 (0.0008) [2023-12-28 01:03:09,890][106225] Updated weights for policy 1, policy_version 808900 (0.0009) [2023-12-28 01:03:09,917][106226] Updated weights for policy 0, policy_version 806793 (0.0009) [2023-12-28 01:03:09,977][106226] Updated weights for policy 0, policy_version 806803 (0.0008) [2023-12-28 01:03:10,031][106226] Updated weights for policy 0, policy_version 806813 (0.0011) [2023-12-28 01:03:10,089][106226] Updated weights for policy 0, policy_version 806823 (0.0011) [2023-12-28 01:03:10,661][106225] Updated weights for policy 1, policy_version 808910 (0.0009) [2023-12-28 01:03:10,715][106225] Updated weights for policy 1, policy_version 808920 (0.0008) [2023-12-28 01:03:10,773][106225] Updated weights for policy 1, policy_version 808930 (0.0009) [2023-12-28 01:03:10,814][106226] Updated weights for policy 0, policy_version 806833 (0.0011) [2023-12-28 01:03:10,871][106226] Updated weights for policy 0, policy_version 806843 (0.0011) [2023-12-28 01:03:10,921][106226] Updated weights for policy 0, policy_version 806853 (0.0011) [2023-12-28 01:03:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 413736960. Throughput: 0: 10127.8, 1: 10075.8. Samples: 413706564. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:11,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.010')] [2023-12-28 01:03:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000808936_207126528.pth... [2023-12-28 01:03:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000806856_206610432.pth... [2023-12-28 01:03:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000805672_206307328.pth [2023-12-28 01:03:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000807784_206831616.pth [2023-12-28 01:03:11,625][106225] Updated weights for policy 1, policy_version 808940 (0.0006) [2023-12-28 01:03:11,698][106225] Updated weights for policy 1, policy_version 808950 (0.0008) [2023-12-28 01:03:11,713][106226] Updated weights for policy 0, policy_version 806863 (0.0009) [2023-12-28 01:03:11,768][106225] Updated weights for policy 1, policy_version 808960 (0.0007) [2023-12-28 01:03:11,782][106226] Updated weights for policy 0, policy_version 806873 (0.0009) [2023-12-28 01:03:11,846][106226] Updated weights for policy 0, policy_version 806883 (0.0009) [2023-12-28 01:03:12,515][106225] Updated weights for policy 1, policy_version 808970 (0.0006) [2023-12-28 01:03:12,570][106226] Updated weights for policy 0, policy_version 806893 (0.0007) [2023-12-28 01:03:12,579][106225] Updated weights for policy 1, policy_version 808980 (0.0006) [2023-12-28 01:03:12,634][106226] Updated weights for policy 0, policy_version 806903 (0.0006) [2023-12-28 01:03:12,642][106225] Updated weights for policy 1, policy_version 808990 (0.0007) [2023-12-28 01:03:12,698][106226] Updated weights for policy 0, policy_version 806913 (0.0008) [2023-12-28 01:03:12,706][106225] Updated weights for policy 1, policy_version 809000 (0.0008) [2023-12-28 01:03:13,330][106226] Updated weights for policy 0, policy_version 806923 (0.0006) [2023-12-28 01:03:13,337][106225] Updated weights for policy 1, policy_version 809010 (0.0007) [2023-12-28 01:03:13,382][106225] Updated weights for policy 1, policy_version 809020 (0.0008) [2023-12-28 01:03:13,383][106226] Updated weights for policy 0, policy_version 806933 (0.0005) [2023-12-28 01:03:13,428][106226] Updated weights for policy 0, policy_version 806943 (0.0006) [2023-12-28 01:03:13,429][106225] Updated weights for policy 1, policy_version 809030 (0.0006) [2023-12-28 01:03:14,124][106226] Updated weights for policy 0, policy_version 806953 (0.0007) [2023-12-28 01:03:14,126][106225] Updated weights for policy 1, policy_version 809040 (0.0010) [2023-12-28 01:03:14,178][106226] Updated weights for policy 0, policy_version 806963 (0.0008) [2023-12-28 01:03:14,189][106225] Updated weights for policy 1, policy_version 809050 (0.0009) [2023-12-28 01:03:14,230][106226] Updated weights for policy 0, policy_version 806973 (0.0009) [2023-12-28 01:03:14,243][106225] Updated weights for policy 1, policy_version 809060 (0.0006) [2023-12-28 01:03:14,282][106226] Updated weights for policy 0, policy_version 806983 (0.0007) [2023-12-28 01:03:14,886][106225] Updated weights for policy 1, policy_version 809070 (0.0007) [2023-12-28 01:03:14,952][106225] Updated weights for policy 1, policy_version 809080 (0.0009) [2023-12-28 01:03:15,012][106225] Updated weights for policy 1, policy_version 809090 (0.0008) [2023-12-28 01:03:15,048][106226] Updated weights for policy 0, policy_version 806993 (0.0008) [2023-12-28 01:03:15,104][106226] Updated weights for policy 0, policy_version 807003 (0.0008) [2023-12-28 01:03:15,161][106226] Updated weights for policy 0, policy_version 807013 (0.0009) [2023-12-28 01:03:15,760][106225] Updated weights for policy 1, policy_version 809100 (0.0007) [2023-12-28 01:03:15,813][106225] Updated weights for policy 1, policy_version 809110 (0.0006) [2023-12-28 01:03:15,868][106225] Updated weights for policy 1, policy_version 809120 (0.0008) [2023-12-28 01:03:15,923][106226] Updated weights for policy 0, policy_version 807023 (0.0007) [2023-12-28 01:03:15,971][106226] Updated weights for policy 0, policy_version 807033 (0.0008) [2023-12-28 01:03:16,021][106226] Updated weights for policy 0, policy_version 807043 (0.0009) [2023-12-28 01:03:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.3, 300 sec: 19771.9). Total num frames: 413835264. Throughput: 0: 10036.1, 1: 9893.9. Samples: 413821620. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:16,176][105115] Avg episode reward: [(0, '-4.302'), (1, '-4.507')] [2023-12-28 01:03:16,177][106141] Saving new best policy, reward=-4.507! [2023-12-28 01:03:16,535][106225] Updated weights for policy 1, policy_version 809130 (0.0007) [2023-12-28 01:03:16,589][106225] Updated weights for policy 1, policy_version 809140 (0.0008) [2023-12-28 01:03:16,651][106225] Updated weights for policy 1, policy_version 809150 (0.0008) [2023-12-28 01:03:16,706][106225] Updated weights for policy 1, policy_version 809160 (0.0008) [2023-12-28 01:03:16,772][106226] Updated weights for policy 0, policy_version 807053 (0.0009) [2023-12-28 01:03:16,820][106226] Updated weights for policy 0, policy_version 807063 (0.0008) [2023-12-28 01:03:16,875][106226] Updated weights for policy 0, policy_version 807073 (0.0008) [2023-12-28 01:03:17,432][106225] Updated weights for policy 1, policy_version 809170 (0.0008) [2023-12-28 01:03:17,494][106225] Updated weights for policy 1, policy_version 809180 (0.0008) [2023-12-28 01:03:17,553][106225] Updated weights for policy 1, policy_version 809190 (0.0008) [2023-12-28 01:03:17,611][106226] Updated weights for policy 0, policy_version 807083 (0.0009) [2023-12-28 01:03:17,670][106226] Updated weights for policy 0, policy_version 807093 (0.0009) [2023-12-28 01:03:17,720][106226] Updated weights for policy 0, policy_version 807103 (0.0008) [2023-12-28 01:03:18,288][106225] Updated weights for policy 1, policy_version 809200 (0.0006) [2023-12-28 01:03:18,360][106225] Updated weights for policy 1, policy_version 809210 (0.0007) [2023-12-28 01:03:18,418][106226] Updated weights for policy 0, policy_version 807113 (0.0008) [2023-12-28 01:03:18,431][106225] Updated weights for policy 1, policy_version 809220 (0.0008) [2023-12-28 01:03:18,484][106226] Updated weights for policy 0, policy_version 807123 (0.0008) [2023-12-28 01:03:18,549][106226] Updated weights for policy 0, policy_version 807133 (0.0007) [2023-12-28 01:03:18,608][106226] Updated weights for policy 0, policy_version 807143 (0.0005) [2023-12-28 01:03:19,141][106225] Updated weights for policy 1, policy_version 809230 (0.0008) [2023-12-28 01:03:19,195][106226] Updated weights for policy 0, policy_version 807153 (0.0007) [2023-12-28 01:03:19,196][106225] Updated weights for policy 1, policy_version 809240 (0.0007) [2023-12-28 01:03:19,262][106225] Updated weights for policy 1, policy_version 809250 (0.0007) [2023-12-28 01:03:19,265][106226] Updated weights for policy 0, policy_version 807163 (0.0008) [2023-12-28 01:03:19,329][106226] Updated weights for policy 0, policy_version 807173 (0.0008) [2023-12-28 01:03:20,016][106225] Updated weights for policy 1, policy_version 809260 (0.0007) [2023-12-28 01:03:20,072][106225] Updated weights for policy 1, policy_version 809270 (0.0008) [2023-12-28 01:03:20,118][106226] Updated weights for policy 0, policy_version 807183 (0.0008) [2023-12-28 01:03:20,132][106225] Updated weights for policy 1, policy_version 809280 (0.0008) [2023-12-28 01:03:20,182][106226] Updated weights for policy 0, policy_version 807193 (0.0008) [2023-12-28 01:03:20,248][106226] Updated weights for policy 0, policy_version 807203 (0.0008) [2023-12-28 01:03:20,823][106225] Updated weights for policy 1, policy_version 809290 (0.0008) [2023-12-28 01:03:20,887][106225] Updated weights for policy 1, policy_version 809300 (0.0008) [2023-12-28 01:03:20,945][106226] Updated weights for policy 0, policy_version 807213 (0.0007) [2023-12-28 01:03:20,955][106225] Updated weights for policy 1, policy_version 809310 (0.0008) [2023-12-28 01:03:21,008][106226] Updated weights for policy 0, policy_version 807223 (0.0007) [2023-12-28 01:03:21,023][106225] Updated weights for policy 1, policy_version 809320 (0.0009) [2023-12-28 01:03:21,075][106226] Updated weights for policy 0, policy_version 807233 (0.0008) [2023-12-28 01:03:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 413933568. Throughput: 0: 9981.2, 1: 9866.8. Samples: 413937064. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:21,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.838')] [2023-12-28 01:03:21,780][106225] Updated weights for policy 1, policy_version 809330 (0.0008) [2023-12-28 01:03:21,803][106226] Updated weights for policy 0, policy_version 807243 (0.0010) [2023-12-28 01:03:21,842][106225] Updated weights for policy 1, policy_version 809340 (0.0010) [2023-12-28 01:03:21,862][106226] Updated weights for policy 0, policy_version 807253 (0.0011) [2023-12-28 01:03:21,903][106225] Updated weights for policy 1, policy_version 809350 (0.0009) [2023-12-28 01:03:21,924][106226] Updated weights for policy 0, policy_version 807263 (0.0011) [2023-12-28 01:03:22,570][106225] Updated weights for policy 1, policy_version 809360 (0.0007) [2023-12-28 01:03:22,620][106225] Updated weights for policy 1, policy_version 809370 (0.0008) [2023-12-28 01:03:22,656][106226] Updated weights for policy 0, policy_version 807273 (0.0010) [2023-12-28 01:03:22,678][106225] Updated weights for policy 1, policy_version 809380 (0.0008) [2023-12-28 01:03:22,715][106226] Updated weights for policy 0, policy_version 807283 (0.0007) [2023-12-28 01:03:22,777][106226] Updated weights for policy 0, policy_version 807293 (0.0009) [2023-12-28 01:03:22,840][106226] Updated weights for policy 0, policy_version 807303 (0.0009) [2023-12-28 01:03:23,384][106225] Updated weights for policy 1, policy_version 809390 (0.0006) [2023-12-28 01:03:23,450][106225] Updated weights for policy 1, policy_version 809400 (0.0006) [2023-12-28 01:03:23,507][106225] Updated weights for policy 1, policy_version 809410 (0.0005) [2023-12-28 01:03:23,556][106226] Updated weights for policy 0, policy_version 807313 (0.0008) [2023-12-28 01:03:23,629][106226] Updated weights for policy 0, policy_version 807323 (0.0008) [2023-12-28 01:03:23,677][106226] Updated weights for policy 0, policy_version 807333 (0.0008) [2023-12-28 01:03:24,150][106225] Updated weights for policy 1, policy_version 809420 (0.0006) [2023-12-28 01:03:24,212][106225] Updated weights for policy 1, policy_version 809430 (0.0007) [2023-12-28 01:03:24,264][106225] Updated weights for policy 1, policy_version 809440 (0.0009) [2023-12-28 01:03:24,317][106226] Updated weights for policy 0, policy_version 807343 (0.0005) [2023-12-28 01:03:24,388][106226] Updated weights for policy 0, policy_version 807353 (0.0008) [2023-12-28 01:03:24,455][106226] Updated weights for policy 0, policy_version 807363 (0.0009) [2023-12-28 01:03:24,885][106225] Updated weights for policy 1, policy_version 809450 (0.0008) [2023-12-28 01:03:24,954][106225] Updated weights for policy 1, policy_version 809460 (0.0009) [2023-12-28 01:03:25,009][106225] Updated weights for policy 1, policy_version 809470 (0.0008) [2023-12-28 01:03:25,069][106225] Updated weights for policy 1, policy_version 809480 (0.0009) [2023-12-28 01:03:25,128][106226] Updated weights for policy 0, policy_version 807373 (0.0006) [2023-12-28 01:03:25,187][106226] Updated weights for policy 0, policy_version 807383 (0.0006) [2023-12-28 01:03:25,252][106226] Updated weights for policy 0, policy_version 807393 (0.0009) [2023-12-28 01:03:25,825][106225] Updated weights for policy 1, policy_version 809490 (0.0008) [2023-12-28 01:03:25,881][106225] Updated weights for policy 1, policy_version 809500 (0.0008) [2023-12-28 01:03:25,901][106226] Updated weights for policy 0, policy_version 807403 (0.0009) [2023-12-28 01:03:25,936][106225] Updated weights for policy 1, policy_version 809510 (0.0008) [2023-12-28 01:03:25,962][106226] Updated weights for policy 0, policy_version 807413 (0.0009) [2023-12-28 01:03:26,025][106226] Updated weights for policy 0, policy_version 807423 (0.0010) [2023-12-28 01:03:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 414031872. Throughput: 0: 9945.5, 1: 9850.3. Samples: 413995936. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:26,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.737')] [2023-12-28 01:03:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000809512_207273984.pth... [2023-12-28 01:03:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000807432_206757888.pth... [2023-12-28 01:03:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000808360_206979072.pth [2023-12-28 01:03:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000806280_206462976.pth [2023-12-28 01:03:26,645][106225] Updated weights for policy 1, policy_version 809520 (0.0007) [2023-12-28 01:03:26,699][106225] Updated weights for policy 1, policy_version 809530 (0.0006) [2023-12-28 01:03:26,740][106226] Updated weights for policy 0, policy_version 807433 (0.0011) [2023-12-28 01:03:26,753][106225] Updated weights for policy 1, policy_version 809540 (0.0006) [2023-12-28 01:03:26,800][106226] Updated weights for policy 0, policy_version 807443 (0.0011) [2023-12-28 01:03:26,858][106226] Updated weights for policy 0, policy_version 807453 (0.0010) [2023-12-28 01:03:26,923][106226] Updated weights for policy 0, policy_version 807463 (0.0008) [2023-12-28 01:03:27,456][106225] Updated weights for policy 1, policy_version 809550 (0.0006) [2023-12-28 01:03:27,515][106225] Updated weights for policy 1, policy_version 809560 (0.0005) [2023-12-28 01:03:27,571][106225] Updated weights for policy 1, policy_version 809570 (0.0005) [2023-12-28 01:03:27,579][106226] Updated weights for policy 0, policy_version 807473 (0.0010) [2023-12-28 01:03:27,628][106226] Updated weights for policy 0, policy_version 807483 (0.0010) [2023-12-28 01:03:27,678][106226] Updated weights for policy 0, policy_version 807493 (0.0010) [2023-12-28 01:03:28,088][106225] Updated weights for policy 1, policy_version 809580 (0.0005) [2023-12-28 01:03:28,133][106225] Updated weights for policy 1, policy_version 809590 (0.0007) [2023-12-28 01:03:28,183][106225] Updated weights for policy 1, policy_version 809600 (0.0008) [2023-12-28 01:03:28,405][106226] Updated weights for policy 0, policy_version 807503 (0.0011) [2023-12-28 01:03:28,478][106226] Updated weights for policy 0, policy_version 807513 (0.0006) [2023-12-28 01:03:28,550][106226] Updated weights for policy 0, policy_version 807523 (0.0010) [2023-12-28 01:03:28,832][106225] Updated weights for policy 1, policy_version 809610 (0.0007) [2023-12-28 01:03:28,896][106225] Updated weights for policy 1, policy_version 809620 (0.0006) [2023-12-28 01:03:28,958][106225] Updated weights for policy 1, policy_version 809630 (0.0008) [2023-12-28 01:03:29,021][106225] Updated weights for policy 1, policy_version 809640 (0.0005) [2023-12-28 01:03:29,210][106226] Updated weights for policy 0, policy_version 807533 (0.0011) [2023-12-28 01:03:29,273][106226] Updated weights for policy 0, policy_version 807543 (0.0010) [2023-12-28 01:03:29,336][106226] Updated weights for policy 0, policy_version 807553 (0.0007) [2023-12-28 01:03:29,677][106225] Updated weights for policy 1, policy_version 809650 (0.0007) [2023-12-28 01:03:29,734][106225] Updated weights for policy 1, policy_version 809660 (0.0008) [2023-12-28 01:03:29,785][106225] Updated weights for policy 1, policy_version 809670 (0.0008) [2023-12-28 01:03:30,066][106226] Updated weights for policy 0, policy_version 807563 (0.0008) [2023-12-28 01:03:30,130][106226] Updated weights for policy 0, policy_version 807573 (0.0009) [2023-12-28 01:03:30,192][106226] Updated weights for policy 0, policy_version 807583 (0.0009) [2023-12-28 01:03:30,475][106225] Updated weights for policy 1, policy_version 809680 (0.0008) [2023-12-28 01:03:30,530][106225] Updated weights for policy 1, policy_version 809690 (0.0009) [2023-12-28 01:03:30,585][106225] Updated weights for policy 1, policy_version 809700 (0.0009) [2023-12-28 01:03:30,813][106226] Updated weights for policy 0, policy_version 807593 (0.0010) [2023-12-28 01:03:30,879][106226] Updated weights for policy 0, policy_version 807603 (0.0010) [2023-12-28 01:03:30,941][106226] Updated weights for policy 0, policy_version 807613 (0.0010) [2023-12-28 01:03:30,991][106226] Updated weights for policy 0, policy_version 807623 (0.0010) [2023-12-28 01:03:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 414130176. Throughput: 0: 9941.4, 1: 9982.9. Samples: 414118176. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:31,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.945')] [2023-12-28 01:03:31,380][106225] Updated weights for policy 1, policy_version 809710 (0.0007) [2023-12-28 01:03:31,440][106225] Updated weights for policy 1, policy_version 809720 (0.0008) [2023-12-28 01:03:31,492][106225] Updated weights for policy 1, policy_version 809730 (0.0006) [2023-12-28 01:03:31,760][106226] Updated weights for policy 0, policy_version 807633 (0.0009) [2023-12-28 01:03:31,818][106226] Updated weights for policy 0, policy_version 807643 (0.0008) [2023-12-28 01:03:31,866][106226] Updated weights for policy 0, policy_version 807653 (0.0008) [2023-12-28 01:03:32,165][106225] Updated weights for policy 1, policy_version 809740 (0.0006) [2023-12-28 01:03:32,234][106225] Updated weights for policy 1, policy_version 809750 (0.0006) [2023-12-28 01:03:32,304][106225] Updated weights for policy 1, policy_version 809760 (0.0006) [2023-12-28 01:03:32,557][106226] Updated weights for policy 0, policy_version 807663 (0.0009) [2023-12-28 01:03:32,607][106226] Updated weights for policy 0, policy_version 807673 (0.0010) [2023-12-28 01:03:32,672][106226] Updated weights for policy 0, policy_version 807683 (0.0007) [2023-12-28 01:03:32,924][106225] Updated weights for policy 1, policy_version 809770 (0.0006) [2023-12-28 01:03:32,981][106225] Updated weights for policy 1, policy_version 809780 (0.0005) [2023-12-28 01:03:33,034][106225] Updated weights for policy 1, policy_version 809790 (0.0008) [2023-12-28 01:03:33,084][106225] Updated weights for policy 1, policy_version 809800 (0.0008) [2023-12-28 01:03:33,346][106226] Updated weights for policy 0, policy_version 807693 (0.0010) [2023-12-28 01:03:33,392][106226] Updated weights for policy 0, policy_version 807703 (0.0010) [2023-12-28 01:03:33,445][106226] Updated weights for policy 0, policy_version 807713 (0.0008) [2023-12-28 01:03:33,812][106225] Updated weights for policy 1, policy_version 809810 (0.0009) [2023-12-28 01:03:33,867][106225] Updated weights for policy 1, policy_version 809820 (0.0010) [2023-12-28 01:03:33,926][106225] Updated weights for policy 1, policy_version 809830 (0.0010) [2023-12-28 01:03:34,011][106226] Updated weights for policy 0, policy_version 807723 (0.0007) [2023-12-28 01:03:34,071][106226] Updated weights for policy 0, policy_version 807733 (0.0005) [2023-12-28 01:03:34,128][106226] Updated weights for policy 0, policy_version 807743 (0.0005) [2023-12-28 01:03:34,690][106225] Updated weights for policy 1, policy_version 809840 (0.0009) [2023-12-28 01:03:34,741][106225] Updated weights for policy 1, policy_version 809850 (0.0008) [2023-12-28 01:03:34,792][106225] Updated weights for policy 1, policy_version 809860 (0.0007) [2023-12-28 01:03:34,809][106226] Updated weights for policy 0, policy_version 807753 (0.0008) [2023-12-28 01:03:34,865][106226] Updated weights for policy 0, policy_version 807763 (0.0010) [2023-12-28 01:03:34,932][106226] Updated weights for policy 0, policy_version 807773 (0.0011) [2023-12-28 01:03:34,996][106226] Updated weights for policy 0, policy_version 807783 (0.0010) [2023-12-28 01:03:35,418][106225] Updated weights for policy 1, policy_version 809870 (0.0006) [2023-12-28 01:03:35,475][106225] Updated weights for policy 1, policy_version 809880 (0.0006) [2023-12-28 01:03:35,539][106225] Updated weights for policy 1, policy_version 809890 (0.0008) [2023-12-28 01:03:35,703][106226] Updated weights for policy 0, policy_version 807793 (0.0011) [2023-12-28 01:03:35,764][106226] Updated weights for policy 0, policy_version 807803 (0.0011) [2023-12-28 01:03:35,824][106226] Updated weights for policy 0, policy_version 807813 (0.0010) [2023-12-28 01:03:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 414228480. Throughput: 0: 9893.1, 1: 9997.8. Samples: 414239164. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:36,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.935')] [2023-12-28 01:03:36,197][106225] Updated weights for policy 1, policy_version 809900 (0.0009) [2023-12-28 01:03:36,262][106225] Updated weights for policy 1, policy_version 809910 (0.0010) [2023-12-28 01:03:36,325][106225] Updated weights for policy 1, policy_version 809920 (0.0006) [2023-12-28 01:03:36,523][106226] Updated weights for policy 0, policy_version 807823 (0.0009) [2023-12-28 01:03:36,582][106226] Updated weights for policy 0, policy_version 807833 (0.0011) [2023-12-28 01:03:36,643][106226] Updated weights for policy 0, policy_version 807843 (0.0011) [2023-12-28 01:03:36,990][106225] Updated weights for policy 1, policy_version 809930 (0.0007) [2023-12-28 01:03:37,043][106225] Updated weights for policy 1, policy_version 809940 (0.0010) [2023-12-28 01:03:37,106][106225] Updated weights for policy 1, policy_version 809950 (0.0010) [2023-12-28 01:03:37,153][106225] Updated weights for policy 1, policy_version 809960 (0.0010) [2023-12-28 01:03:37,306][106226] Updated weights for policy 0, policy_version 807853 (0.0011) [2023-12-28 01:03:37,363][106226] Updated weights for policy 0, policy_version 807863 (0.0007) [2023-12-28 01:03:37,429][106226] Updated weights for policy 0, policy_version 807873 (0.0005) [2023-12-28 01:03:37,828][106225] Updated weights for policy 1, policy_version 809970 (0.0007) [2023-12-28 01:03:37,877][106225] Updated weights for policy 1, policy_version 809980 (0.0005) [2023-12-28 01:03:37,923][106225] Updated weights for policy 1, policy_version 809990 (0.0006) [2023-12-28 01:03:38,096][106226] Updated weights for policy 0, policy_version 807883 (0.0009) [2023-12-28 01:03:38,150][106226] Updated weights for policy 0, policy_version 807893 (0.0009) [2023-12-28 01:03:38,217][106226] Updated weights for policy 0, policy_version 807903 (0.0011) [2023-12-28 01:03:38,653][106225] Updated weights for policy 1, policy_version 810000 (0.0010) [2023-12-28 01:03:38,711][106225] Updated weights for policy 1, policy_version 810010 (0.0010) [2023-12-28 01:03:38,768][106225] Updated weights for policy 1, policy_version 810020 (0.0010) [2023-12-28 01:03:38,915][106226] Updated weights for policy 0, policy_version 807913 (0.0010) [2023-12-28 01:03:38,966][106226] Updated weights for policy 0, policy_version 807923 (0.0011) [2023-12-28 01:03:39,017][106226] Updated weights for policy 0, policy_version 807933 (0.0010) [2023-12-28 01:03:39,078][106226] Updated weights for policy 0, policy_version 807943 (0.0010) [2023-12-28 01:03:39,550][106225] Updated weights for policy 1, policy_version 810030 (0.0009) [2023-12-28 01:03:39,608][106225] Updated weights for policy 1, policy_version 810040 (0.0007) [2023-12-28 01:03:39,673][106225] Updated weights for policy 1, policy_version 810050 (0.0008) [2023-12-28 01:03:39,835][106226] Updated weights for policy 0, policy_version 807953 (0.0010) [2023-12-28 01:03:39,899][106226] Updated weights for policy 0, policy_version 807963 (0.0009) [2023-12-28 01:03:39,960][106226] Updated weights for policy 0, policy_version 807973 (0.0008) [2023-12-28 01:03:40,414][106225] Updated weights for policy 1, policy_version 810060 (0.0007) [2023-12-28 01:03:40,474][106225] Updated weights for policy 1, policy_version 810070 (0.0006) [2023-12-28 01:03:40,531][106225] Updated weights for policy 1, policy_version 810080 (0.0006) [2023-12-28 01:03:40,628][106226] Updated weights for policy 0, policy_version 807983 (0.0010) [2023-12-28 01:03:40,678][106226] Updated weights for policy 0, policy_version 807993 (0.0010) [2023-12-28 01:03:40,742][106226] Updated weights for policy 0, policy_version 808003 (0.0011) [2023-12-28 01:03:41,139][106225] Updated weights for policy 1, policy_version 810090 (0.0008) [2023-12-28 01:03:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 414326784. Throughput: 0: 9900.6, 1: 9997.7. Samples: 414299496. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:41,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.981')] [2023-12-28 01:03:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000808008_206905344.pth... [2023-12-28 01:03:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000806856_206610432.pth [2023-12-28 01:03:41,210][106225] Updated weights for policy 1, policy_version 810100 (0.0007) [2023-12-28 01:03:41,270][106225] Updated weights for policy 1, policy_version 810110 (0.0007) [2023-12-28 01:03:41,335][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000810120_207429632.pth... [2023-12-28 01:03:41,336][106225] Updated weights for policy 1, policy_version 810120 (0.0009) [2023-12-28 01:03:41,340][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000808936_207126528.pth [2023-12-28 01:03:41,469][106226] Updated weights for policy 0, policy_version 808013 (0.0009) [2023-12-28 01:03:41,545][106226] Updated weights for policy 0, policy_version 808023 (0.0006) [2023-12-28 01:03:41,613][106226] Updated weights for policy 0, policy_version 808033 (0.0007) [2023-12-28 01:03:42,089][106225] Updated weights for policy 1, policy_version 810130 (0.0007) [2023-12-28 01:03:42,152][106225] Updated weights for policy 1, policy_version 810140 (0.0010) [2023-12-28 01:03:42,214][106225] Updated weights for policy 1, policy_version 810150 (0.0007) [2023-12-28 01:03:42,243][106226] Updated weights for policy 0, policy_version 808043 (0.0008) [2023-12-28 01:03:42,316][106226] Updated weights for policy 0, policy_version 808053 (0.0008) [2023-12-28 01:03:42,382][106226] Updated weights for policy 0, policy_version 808063 (0.0008) [2023-12-28 01:03:42,924][106225] Updated weights for policy 1, policy_version 810160 (0.0009) [2023-12-28 01:03:42,986][106225] Updated weights for policy 1, policy_version 810170 (0.0010) [2023-12-28 01:03:43,049][106225] Updated weights for policy 1, policy_version 810180 (0.0009) [2023-12-28 01:03:43,107][106226] Updated weights for policy 0, policy_version 808073 (0.0008) [2023-12-28 01:03:43,174][106226] Updated weights for policy 0, policy_version 808083 (0.0010) [2023-12-28 01:03:43,235][106226] Updated weights for policy 0, policy_version 808093 (0.0010) [2023-12-28 01:03:43,292][106226] Updated weights for policy 0, policy_version 808103 (0.0007) [2023-12-28 01:03:43,735][106225] Updated weights for policy 1, policy_version 810190 (0.0010) [2023-12-28 01:03:43,793][106225] Updated weights for policy 1, policy_version 810200 (0.0010) [2023-12-28 01:03:43,843][106225] Updated weights for policy 1, policy_version 810210 (0.0010) [2023-12-28 01:03:43,861][106226] Updated weights for policy 0, policy_version 808113 (0.0006) [2023-12-28 01:03:43,911][106226] Updated weights for policy 0, policy_version 808123 (0.0010) [2023-12-28 01:03:43,956][106226] Updated weights for policy 0, policy_version 808133 (0.0007) [2023-12-28 01:03:44,471][106225] Updated weights for policy 1, policy_version 810220 (0.0008) [2023-12-28 01:03:44,538][106225] Updated weights for policy 1, policy_version 810230 (0.0008) [2023-12-28 01:03:44,562][106226] Updated weights for policy 0, policy_version 808143 (0.0005) [2023-12-28 01:03:44,603][106225] Updated weights for policy 1, policy_version 810240 (0.0008) [2023-12-28 01:03:44,613][106226] Updated weights for policy 0, policy_version 808153 (0.0005) [2023-12-28 01:03:44,675][106226] Updated weights for policy 0, policy_version 808163 (0.0009) [2023-12-28 01:03:45,230][106225] Updated weights for policy 1, policy_version 810250 (0.0007) [2023-12-28 01:03:45,289][106225] Updated weights for policy 1, policy_version 810260 (0.0007) [2023-12-28 01:03:45,340][106226] Updated weights for policy 0, policy_version 808173 (0.0009) [2023-12-28 01:03:45,354][106225] Updated weights for policy 1, policy_version 810270 (0.0007) [2023-12-28 01:03:45,403][106226] Updated weights for policy 0, policy_version 808183 (0.0008) [2023-12-28 01:03:45,423][106225] Updated weights for policy 1, policy_version 810280 (0.0006) [2023-12-28 01:03:45,467][106226] Updated weights for policy 0, policy_version 808193 (0.0006) [2023-12-28 01:03:46,090][106226] Updated weights for policy 0, policy_version 808203 (0.0010) [2023-12-28 01:03:46,103][106225] Updated weights for policy 1, policy_version 810290 (0.0008) [2023-12-28 01:03:46,150][106225] Updated weights for policy 1, policy_version 810300 (0.0005) [2023-12-28 01:03:46,150][106226] Updated weights for policy 0, policy_version 808213 (0.0010) [2023-12-28 01:03:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 414425088. Throughput: 0: 9922.2, 1: 9941.5. Samples: 414420852. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:46,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-5.113')] [2023-12-28 01:03:46,205][106225] Updated weights for policy 1, policy_version 810310 (0.0005) [2023-12-28 01:03:46,214][106226] Updated weights for policy 0, policy_version 808223 (0.0011) [2023-12-28 01:03:46,889][106225] Updated weights for policy 1, policy_version 810320 (0.0007) [2023-12-28 01:03:46,907][106226] Updated weights for policy 0, policy_version 808233 (0.0010) [2023-12-28 01:03:46,934][106225] Updated weights for policy 1, policy_version 810330 (0.0008) [2023-12-28 01:03:46,967][106226] Updated weights for policy 0, policy_version 808243 (0.0010) [2023-12-28 01:03:46,979][106225] Updated weights for policy 1, policy_version 810340 (0.0008) [2023-12-28 01:03:47,027][106226] Updated weights for policy 0, policy_version 808253 (0.0010) [2023-12-28 01:03:47,093][106226] Updated weights for policy 0, policy_version 808263 (0.0011) [2023-12-28 01:03:47,656][106226] Updated weights for policy 0, policy_version 808273 (0.0006) [2023-12-28 01:03:47,702][106226] Updated weights for policy 0, policy_version 808283 (0.0005) [2023-12-28 01:03:47,763][106226] Updated weights for policy 0, policy_version 808293 (0.0005) [2023-12-28 01:03:47,805][106225] Updated weights for policy 1, policy_version 810350 (0.0008) [2023-12-28 01:03:47,855][106225] Updated weights for policy 1, policy_version 810360 (0.0008) [2023-12-28 01:03:47,908][106225] Updated weights for policy 1, policy_version 810370 (0.0008) [2023-12-28 01:03:48,386][106226] Updated weights for policy 0, policy_version 808303 (0.0008) [2023-12-28 01:03:48,437][106226] Updated weights for policy 0, policy_version 808313 (0.0009) [2023-12-28 01:03:48,500][106226] Updated weights for policy 0, policy_version 808323 (0.0009) [2023-12-28 01:03:48,691][106225] Updated weights for policy 1, policy_version 810380 (0.0008) [2023-12-28 01:03:48,751][106225] Updated weights for policy 1, policy_version 810390 (0.0007) [2023-12-28 01:03:48,809][106225] Updated weights for policy 1, policy_version 810400 (0.0006) [2023-12-28 01:03:49,242][106226] Updated weights for policy 0, policy_version 808333 (0.0009) [2023-12-28 01:03:49,304][106226] Updated weights for policy 0, policy_version 808343 (0.0008) [2023-12-28 01:03:49,378][106226] Updated weights for policy 0, policy_version 808353 (0.0008) [2023-12-28 01:03:49,550][106225] Updated weights for policy 1, policy_version 810410 (0.0008) [2023-12-28 01:03:49,607][106225] Updated weights for policy 1, policy_version 810420 (0.0008) [2023-12-28 01:03:49,663][106225] Updated weights for policy 1, policy_version 810430 (0.0008) [2023-12-28 01:03:49,717][106225] Updated weights for policy 1, policy_version 810440 (0.0008) [2023-12-28 01:03:50,170][106226] Updated weights for policy 0, policy_version 808363 (0.0009) [2023-12-28 01:03:50,229][106226] Updated weights for policy 0, policy_version 808373 (0.0009) [2023-12-28 01:03:50,293][106226] Updated weights for policy 0, policy_version 808383 (0.0006) [2023-12-28 01:03:50,429][106225] Updated weights for policy 1, policy_version 810450 (0.0006) [2023-12-28 01:03:50,480][106225] Updated weights for policy 1, policy_version 810460 (0.0008) [2023-12-28 01:03:50,528][106225] Updated weights for policy 1, policy_version 810470 (0.0007) [2023-12-28 01:03:51,010][106226] Updated weights for policy 0, policy_version 808393 (0.0008) [2023-12-28 01:03:51,075][106226] Updated weights for policy 0, policy_version 808403 (0.0009) [2023-12-28 01:03:51,145][106226] Updated weights for policy 0, policy_version 808413 (0.0010) [2023-12-28 01:03:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 414523392. Throughput: 0: 9951.3, 1: 9870.4. Samples: 414539428. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:51,175][105115] Avg episode reward: [(0, '-4.247'), (1, '-4.968')] [2023-12-28 01:03:51,210][106226] Updated weights for policy 0, policy_version 808423 (0.0011) [2023-12-28 01:03:51,287][106225] Updated weights for policy 1, policy_version 810480 (0.0008) [2023-12-28 01:03:51,340][106225] Updated weights for policy 1, policy_version 810490 (0.0007) [2023-12-28 01:03:51,409][106225] Updated weights for policy 1, policy_version 810500 (0.0008) [2023-12-28 01:03:51,952][106226] Updated weights for policy 0, policy_version 808433 (0.0009) [2023-12-28 01:03:52,009][106226] Updated weights for policy 0, policy_version 808443 (0.0008) [2023-12-28 01:03:52,062][106226] Updated weights for policy 0, policy_version 808453 (0.0009) [2023-12-28 01:03:52,107][106225] Updated weights for policy 1, policy_version 810510 (0.0008) [2023-12-28 01:03:52,160][106225] Updated weights for policy 1, policy_version 810520 (0.0008) [2023-12-28 01:03:52,226][106225] Updated weights for policy 1, policy_version 810530 (0.0009) [2023-12-28 01:03:52,766][106226] Updated weights for policy 0, policy_version 808463 (0.0006) [2023-12-28 01:03:52,830][106226] Updated weights for policy 0, policy_version 808473 (0.0005) [2023-12-28 01:03:52,891][106226] Updated weights for policy 0, policy_version 808483 (0.0007) [2023-12-28 01:03:53,019][106225] Updated weights for policy 1, policy_version 810540 (0.0009) [2023-12-28 01:03:53,073][106225] Updated weights for policy 1, policy_version 810550 (0.0010) [2023-12-28 01:03:53,133][106225] Updated weights for policy 1, policy_version 810560 (0.0010) [2023-12-28 01:03:53,556][106226] Updated weights for policy 0, policy_version 808493 (0.0008) [2023-12-28 01:03:53,616][106226] Updated weights for policy 0, policy_version 808503 (0.0008) [2023-12-28 01:03:53,670][106226] Updated weights for policy 0, policy_version 808513 (0.0008) [2023-12-28 01:03:53,799][106225] Updated weights for policy 1, policy_version 810570 (0.0010) [2023-12-28 01:03:53,866][106225] Updated weights for policy 1, policy_version 810580 (0.0008) [2023-12-28 01:03:53,934][106225] Updated weights for policy 1, policy_version 810590 (0.0007) [2023-12-28 01:03:54,007][106225] Updated weights for policy 1, policy_version 810600 (0.0008) [2023-12-28 01:03:54,445][106226] Updated weights for policy 0, policy_version 808523 (0.0008) [2023-12-28 01:03:54,512][106226] Updated weights for policy 0, policy_version 808533 (0.0007) [2023-12-28 01:03:54,555][106225] Updated weights for policy 1, policy_version 810610 (0.0007) [2023-12-28 01:03:54,579][106226] Updated weights for policy 0, policy_version 808543 (0.0008) [2023-12-28 01:03:54,618][106225] Updated weights for policy 1, policy_version 810620 (0.0008) [2023-12-28 01:03:54,677][106225] Updated weights for policy 1, policy_version 810630 (0.0007) [2023-12-28 01:03:55,271][106226] Updated weights for policy 0, policy_version 808553 (0.0008) [2023-12-28 01:03:55,329][106226] Updated weights for policy 0, policy_version 808563 (0.0008) [2023-12-28 01:03:55,383][106226] Updated weights for policy 0, policy_version 808573 (0.0007) [2023-12-28 01:03:55,399][106225] Updated weights for policy 1, policy_version 810640 (0.0010) [2023-12-28 01:03:55,436][106226] Updated weights for policy 0, policy_version 808583 (0.0006) [2023-12-28 01:03:55,449][106225] Updated weights for policy 1, policy_version 810650 (0.0010) [2023-12-28 01:03:55,499][106225] Updated weights for policy 1, policy_version 810660 (0.0010) [2023-12-28 01:03:56,161][106226] Updated weights for policy 0, policy_version 808593 (0.0008) [2023-12-28 01:03:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 414621696. Throughput: 0: 9939.3, 1: 9852.3. Samples: 414597184. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:03:56,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.768')] [2023-12-28 01:03:56,210][106226] Updated weights for policy 0, policy_version 808603 (0.0007) [2023-12-28 01:03:56,219][106225] Updated weights for policy 1, policy_version 810670 (0.0010) [2023-12-28 01:03:56,268][106226] Updated weights for policy 0, policy_version 808613 (0.0008) [2023-12-28 01:03:56,275][106225] Updated weights for policy 1, policy_version 810680 (0.0010) [2023-12-28 01:03:56,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000808616_207060992.pth... [2023-12-28 01:03:56,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000807432_206757888.pth [2023-12-28 01:03:56,332][106225] Updated weights for policy 1, policy_version 810690 (0.0010) [2023-12-28 01:03:56,365][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000810696_207577088.pth... [2023-12-28 01:03:56,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000809512_207273984.pth [2023-12-28 01:03:57,027][106226] Updated weights for policy 0, policy_version 808623 (0.0007) [2023-12-28 01:03:57,035][106225] Updated weights for policy 1, policy_version 810700 (0.0008) [2023-12-28 01:03:57,087][106226] Updated weights for policy 0, policy_version 808633 (0.0008) [2023-12-28 01:03:57,102][106225] Updated weights for policy 1, policy_version 810710 (0.0006) [2023-12-28 01:03:57,149][106226] Updated weights for policy 0, policy_version 808643 (0.0008) [2023-12-28 01:03:57,169][106225] Updated weights for policy 1, policy_version 810720 (0.0009) [2023-12-28 01:03:57,698][106225] Updated weights for policy 1, policy_version 810730 (0.0009) [2023-12-28 01:03:57,751][106225] Updated weights for policy 1, policy_version 810740 (0.0005) [2023-12-28 01:03:57,802][106225] Updated weights for policy 1, policy_version 810750 (0.0005) [2023-12-28 01:03:57,852][106226] Updated weights for policy 0, policy_version 808653 (0.0008) [2023-12-28 01:03:57,853][106225] Updated weights for policy 1, policy_version 810760 (0.0005) [2023-12-28 01:03:57,904][106226] Updated weights for policy 0, policy_version 808663 (0.0009) [2023-12-28 01:03:57,954][106226] Updated weights for policy 0, policy_version 808673 (0.0008) [2023-12-28 01:03:58,488][106225] Updated weights for policy 1, policy_version 810770 (0.0010) [2023-12-28 01:03:58,554][106225] Updated weights for policy 1, policy_version 810780 (0.0010) [2023-12-28 01:03:58,618][106225] Updated weights for policy 1, policy_version 810790 (0.0010) [2023-12-28 01:03:58,794][106226] Updated weights for policy 0, policy_version 808683 (0.0008) [2023-12-28 01:03:58,867][106226] Updated weights for policy 0, policy_version 808693 (0.0008) [2023-12-28 01:03:58,937][106226] Updated weights for policy 0, policy_version 808703 (0.0006) [2023-12-28 01:03:59,464][106225] Updated weights for policy 1, policy_version 810800 (0.0008) [2023-12-28 01:03:59,524][106225] Updated weights for policy 1, policy_version 810810 (0.0006) [2023-12-28 01:03:59,578][106225] Updated weights for policy 1, policy_version 810820 (0.0006) [2023-12-28 01:03:59,655][106226] Updated weights for policy 0, policy_version 808713 (0.0008) [2023-12-28 01:03:59,708][106226] Updated weights for policy 0, policy_version 808723 (0.0010) [2023-12-28 01:03:59,759][106226] Updated weights for policy 0, policy_version 808733 (0.0009) [2023-12-28 01:03:59,813][106226] Updated weights for policy 0, policy_version 808743 (0.0008) [2023-12-28 01:04:00,226][106225] Updated weights for policy 1, policy_version 810830 (0.0009) [2023-12-28 01:04:00,291][106225] Updated weights for policy 1, policy_version 810840 (0.0008) [2023-12-28 01:04:00,355][106225] Updated weights for policy 1, policy_version 810850 (0.0009) [2023-12-28 01:04:00,561][106226] Updated weights for policy 0, policy_version 808753 (0.0008) [2023-12-28 01:04:00,613][106226] Updated weights for policy 0, policy_version 808763 (0.0008) [2023-12-28 01:04:00,675][106226] Updated weights for policy 0, policy_version 808773 (0.0008) [2023-12-28 01:04:01,078][106225] Updated weights for policy 1, policy_version 810860 (0.0008) [2023-12-28 01:04:01,133][106225] Updated weights for policy 1, policy_version 810870 (0.0010) [2023-12-28 01:04:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 414720000. Throughput: 0: 9906.4, 1: 9921.9. Samples: 414713892. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:01,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.736')] [2023-12-28 01:04:01,201][106225] Updated weights for policy 1, policy_version 810880 (0.0008) [2023-12-28 01:04:01,329][106226] Updated weights for policy 0, policy_version 808783 (0.0010) [2023-12-28 01:04:01,399][106226] Updated weights for policy 0, policy_version 808793 (0.0010) [2023-12-28 01:04:01,451][106226] Updated weights for policy 0, policy_version 808803 (0.0010) [2023-12-28 01:04:01,930][106225] Updated weights for policy 1, policy_version 810890 (0.0008) [2023-12-28 01:04:01,987][106225] Updated weights for policy 1, policy_version 810900 (0.0008) [2023-12-28 01:04:02,042][106225] Updated weights for policy 1, policy_version 810910 (0.0008) [2023-12-28 01:04:02,093][106225] Updated weights for policy 1, policy_version 810920 (0.0006) [2023-12-28 01:04:02,191][106226] Updated weights for policy 0, policy_version 808813 (0.0009) [2023-12-28 01:04:02,242][106226] Updated weights for policy 0, policy_version 808823 (0.0009) [2023-12-28 01:04:02,302][106226] Updated weights for policy 0, policy_version 808833 (0.0008) [2023-12-28 01:04:02,824][106225] Updated weights for policy 1, policy_version 810930 (0.0008) [2023-12-28 01:04:02,883][106225] Updated weights for policy 1, policy_version 810940 (0.0008) [2023-12-28 01:04:02,932][106225] Updated weights for policy 1, policy_version 810950 (0.0007) [2023-12-28 01:04:02,993][106226] Updated weights for policy 0, policy_version 808843 (0.0007) [2023-12-28 01:04:03,042][106226] Updated weights for policy 0, policy_version 808853 (0.0005) [2023-12-28 01:04:03,088][106226] Updated weights for policy 0, policy_version 808863 (0.0007) [2023-12-28 01:04:03,678][106225] Updated weights for policy 1, policy_version 810960 (0.0009) [2023-12-28 01:04:03,719][106225] Updated weights for policy 1, policy_version 810970 (0.0006) [2023-12-28 01:04:03,774][106225] Updated weights for policy 1, policy_version 810980 (0.0005) [2023-12-28 01:04:03,804][106226] Updated weights for policy 0, policy_version 808873 (0.0009) [2023-12-28 01:04:03,870][106226] Updated weights for policy 0, policy_version 808883 (0.0008) [2023-12-28 01:04:03,936][106226] Updated weights for policy 0, policy_version 808893 (0.0008) [2023-12-28 01:04:03,990][106226] Updated weights for policy 0, policy_version 808903 (0.0009) [2023-12-28 01:04:04,515][106225] Updated weights for policy 1, policy_version 810990 (0.0008) [2023-12-28 01:04:04,582][106225] Updated weights for policy 1, policy_version 811000 (0.0009) [2023-12-28 01:04:04,638][106225] Updated weights for policy 1, policy_version 811010 (0.0009) [2023-12-28 01:04:04,745][106226] Updated weights for policy 0, policy_version 808913 (0.0006) [2023-12-28 01:04:04,793][106226] Updated weights for policy 0, policy_version 808923 (0.0008) [2023-12-28 01:04:04,846][106226] Updated weights for policy 0, policy_version 808933 (0.0009) [2023-12-28 01:04:05,360][106225] Updated weights for policy 1, policy_version 811020 (0.0009) [2023-12-28 01:04:05,425][106225] Updated weights for policy 1, policy_version 811030 (0.0007) [2023-12-28 01:04:05,477][106225] Updated weights for policy 1, policy_version 811040 (0.0005) [2023-12-28 01:04:05,592][106226] Updated weights for policy 0, policy_version 808943 (0.0008) [2023-12-28 01:04:05,653][106226] Updated weights for policy 0, policy_version 808953 (0.0009) [2023-12-28 01:04:05,718][106226] Updated weights for policy 0, policy_version 808963 (0.0010) [2023-12-28 01:04:06,081][106225] Updated weights for policy 1, policy_version 811050 (0.0006) [2023-12-28 01:04:06,144][106225] Updated weights for policy 1, policy_version 811060 (0.0009) [2023-12-28 01:04:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 414818304. Throughput: 0: 9896.3, 1: 9958.7. Samples: 414830536. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:06,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.923')] [2023-12-28 01:04:06,211][106225] Updated weights for policy 1, policy_version 811070 (0.0011) [2023-12-28 01:04:06,274][106225] Updated weights for policy 1, policy_version 811080 (0.0008) [2023-12-28 01:04:06,496][106226] Updated weights for policy 0, policy_version 808973 (0.0009) [2023-12-28 01:04:06,562][106226] Updated weights for policy 0, policy_version 808983 (0.0008) [2023-12-28 01:04:06,626][106226] Updated weights for policy 0, policy_version 808993 (0.0006) [2023-12-28 01:04:06,932][106225] Updated weights for policy 1, policy_version 811090 (0.0010) [2023-12-28 01:04:06,986][106225] Updated weights for policy 1, policy_version 811100 (0.0010) [2023-12-28 01:04:07,042][106225] Updated weights for policy 1, policy_version 811110 (0.0010) [2023-12-28 01:04:07,300][106226] Updated weights for policy 0, policy_version 809003 (0.0007) [2023-12-28 01:04:07,353][106226] Updated weights for policy 0, policy_version 809013 (0.0008) [2023-12-28 01:04:07,407][106226] Updated weights for policy 0, policy_version 809023 (0.0008) [2023-12-28 01:04:07,740][106225] Updated weights for policy 1, policy_version 811120 (0.0008) [2023-12-28 01:04:07,793][106225] Updated weights for policy 1, policy_version 811130 (0.0008) [2023-12-28 01:04:07,843][106225] Updated weights for policy 1, policy_version 811140 (0.0008) [2023-12-28 01:04:08,082][106226] Updated weights for policy 0, policy_version 809033 (0.0010) [2023-12-28 01:04:08,128][106226] Updated weights for policy 0, policy_version 809043 (0.0010) [2023-12-28 01:04:08,181][106226] Updated weights for policy 0, policy_version 809053 (0.0010) [2023-12-28 01:04:08,234][106226] Updated weights for policy 0, policy_version 809063 (0.0010) [2023-12-28 01:04:08,555][106225] Updated weights for policy 1, policy_version 811150 (0.0008) [2023-12-28 01:04:08,620][106225] Updated weights for policy 1, policy_version 811160 (0.0009) [2023-12-28 01:04:08,688][106225] Updated weights for policy 1, policy_version 811170 (0.0007) [2023-12-28 01:04:08,960][106226] Updated weights for policy 0, policy_version 809073 (0.0009) [2023-12-28 01:04:09,023][106226] Updated weights for policy 0, policy_version 809083 (0.0010) [2023-12-28 01:04:09,083][106226] Updated weights for policy 0, policy_version 809093 (0.0010) [2023-12-28 01:04:09,352][106225] Updated weights for policy 1, policy_version 811180 (0.0008) [2023-12-28 01:04:09,421][106225] Updated weights for policy 1, policy_version 811190 (0.0009) [2023-12-28 01:04:09,477][106225] Updated weights for policy 1, policy_version 811200 (0.0006) [2023-12-28 01:04:09,784][106226] Updated weights for policy 0, policy_version 809103 (0.0009) [2023-12-28 01:04:09,852][106226] Updated weights for policy 0, policy_version 809113 (0.0008) [2023-12-28 01:04:09,915][106226] Updated weights for policy 0, policy_version 809123 (0.0008) [2023-12-28 01:04:10,133][106225] Updated weights for policy 1, policy_version 811210 (0.0008) [2023-12-28 01:04:10,185][106225] Updated weights for policy 1, policy_version 811220 (0.0008) [2023-12-28 01:04:10,246][106225] Updated weights for policy 1, policy_version 811230 (0.0009) [2023-12-28 01:04:10,306][106225] Updated weights for policy 1, policy_version 811240 (0.0009) [2023-12-28 01:04:10,719][106226] Updated weights for policy 0, policy_version 809133 (0.0009) [2023-12-28 01:04:10,774][106226] Updated weights for policy 0, policy_version 809143 (0.0009) [2023-12-28 01:04:10,823][106226] Updated weights for policy 0, policy_version 809153 (0.0009) [2023-12-28 01:04:10,977][106225] Updated weights for policy 1, policy_version 811250 (0.0009) [2023-12-28 01:04:11,044][106225] Updated weights for policy 1, policy_version 811260 (0.0008) [2023-12-28 01:04:11,111][106225] Updated weights for policy 1, policy_version 811270 (0.0008) [2023-12-28 01:04:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 414924800. Throughput: 0: 9908.4, 1: 9964.2. Samples: 414890208. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:11,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.807')] [2023-12-28 01:04:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000811272_207724544.pth... [2023-12-28 01:04:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000809160_207200256.pth... [2023-12-28 01:04:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000810120_207429632.pth [2023-12-28 01:04:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000808008_206905344.pth [2023-12-28 01:04:11,614][106226] Updated weights for policy 0, policy_version 809163 (0.0009) [2023-12-28 01:04:11,683][106226] Updated weights for policy 0, policy_version 809173 (0.0010) [2023-12-28 01:04:11,756][106226] Updated weights for policy 0, policy_version 809183 (0.0009) [2023-12-28 01:04:11,958][106225] Updated weights for policy 1, policy_version 811280 (0.0010) [2023-12-28 01:04:12,017][106225] Updated weights for policy 1, policy_version 811290 (0.0011) [2023-12-28 01:04:12,082][106225] Updated weights for policy 1, policy_version 811300 (0.0011) [2023-12-28 01:04:12,456][106226] Updated weights for policy 0, policy_version 809193 (0.0007) [2023-12-28 01:04:12,517][106226] Updated weights for policy 0, policy_version 809203 (0.0011) [2023-12-28 01:04:12,577][106226] Updated weights for policy 0, policy_version 809213 (0.0011) [2023-12-28 01:04:12,641][106226] Updated weights for policy 0, policy_version 809223 (0.0011) [2023-12-28 01:04:12,806][106225] Updated weights for policy 1, policy_version 811310 (0.0010) [2023-12-28 01:04:12,868][106225] Updated weights for policy 1, policy_version 811320 (0.0010) [2023-12-28 01:04:12,922][106225] Updated weights for policy 1, policy_version 811330 (0.0010) [2023-12-28 01:04:13,343][106226] Updated weights for policy 0, policy_version 809233 (0.0011) [2023-12-28 01:04:13,403][106226] Updated weights for policy 0, policy_version 809243 (0.0010) [2023-12-28 01:04:13,460][106226] Updated weights for policy 0, policy_version 809253 (0.0010) [2023-12-28 01:04:13,577][106225] Updated weights for policy 1, policy_version 811340 (0.0008) [2023-12-28 01:04:13,636][106225] Updated weights for policy 1, policy_version 811350 (0.0005) [2023-12-28 01:04:13,700][106225] Updated weights for policy 1, policy_version 811360 (0.0005) [2023-12-28 01:04:14,106][106226] Updated weights for policy 0, policy_version 809263 (0.0007) [2023-12-28 01:04:14,159][106226] Updated weights for policy 0, policy_version 809273 (0.0005) [2023-12-28 01:04:14,212][106226] Updated weights for policy 0, policy_version 809283 (0.0006) [2023-12-28 01:04:14,265][106225] Updated weights for policy 1, policy_version 811370 (0.0006) [2023-12-28 01:04:14,331][106225] Updated weights for policy 1, policy_version 811380 (0.0009) [2023-12-28 01:04:14,399][106225] Updated weights for policy 1, policy_version 811390 (0.0009) [2023-12-28 01:04:14,452][106225] Updated weights for policy 1, policy_version 811400 (0.0008) [2023-12-28 01:04:14,752][106226] Updated weights for policy 0, policy_version 809293 (0.0006) [2023-12-28 01:04:14,821][106226] Updated weights for policy 0, policy_version 809303 (0.0009) [2023-12-28 01:04:14,890][106226] Updated weights for policy 0, policy_version 809313 (0.0008) [2023-12-28 01:04:15,197][106225] Updated weights for policy 1, policy_version 811410 (0.0008) [2023-12-28 01:04:15,250][106225] Updated weights for policy 1, policy_version 811420 (0.0008) [2023-12-28 01:04:15,304][106225] Updated weights for policy 1, policy_version 811430 (0.0008) [2023-12-28 01:04:15,558][106226] Updated weights for policy 0, policy_version 809323 (0.0008) [2023-12-28 01:04:15,615][106226] Updated weights for policy 0, policy_version 809333 (0.0005) [2023-12-28 01:04:15,667][106226] Updated weights for policy 0, policy_version 809343 (0.0005) [2023-12-28 01:04:16,141][106225] Updated weights for policy 1, policy_version 811440 (0.0010) [2023-12-28 01:04:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 415014912. Throughput: 0: 9876.4, 1: 9902.2. Samples: 415008212. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:16,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.894')] [2023-12-28 01:04:16,204][106225] Updated weights for policy 1, policy_version 811450 (0.0010) [2023-12-28 01:04:16,224][106226] Updated weights for policy 0, policy_version 809353 (0.0006) [2023-12-28 01:04:16,265][106225] Updated weights for policy 1, policy_version 811460 (0.0010) [2023-12-28 01:04:16,273][106226] Updated weights for policy 0, policy_version 809363 (0.0005) [2023-12-28 01:04:16,324][106226] Updated weights for policy 0, policy_version 809373 (0.0006) [2023-12-28 01:04:16,382][106226] Updated weights for policy 0, policy_version 809383 (0.0006) [2023-12-28 01:04:16,947][106225] Updated weights for policy 1, policy_version 811470 (0.0009) [2023-12-28 01:04:16,998][106225] Updated weights for policy 1, policy_version 811480 (0.0008) [2023-12-28 01:04:17,041][106225] Updated weights for policy 1, policy_version 811490 (0.0006) [2023-12-28 01:04:17,070][106226] Updated weights for policy 0, policy_version 809393 (0.0007) [2023-12-28 01:04:17,136][106226] Updated weights for policy 0, policy_version 809403 (0.0010) [2023-12-28 01:04:17,198][106226] Updated weights for policy 0, policy_version 809413 (0.0007) [2023-12-28 01:04:17,625][106225] Updated weights for policy 1, policy_version 811500 (0.0005) [2023-12-28 01:04:17,688][106225] Updated weights for policy 1, policy_version 811510 (0.0005) [2023-12-28 01:04:17,744][106225] Updated weights for policy 1, policy_version 811520 (0.0009) [2023-12-28 01:04:17,786][106226] Updated weights for policy 0, policy_version 809423 (0.0009) [2023-12-28 01:04:17,830][106226] Updated weights for policy 0, policy_version 809433 (0.0011) [2023-12-28 01:04:17,886][106226] Updated weights for policy 0, policy_version 809443 (0.0009) [2023-12-28 01:04:18,399][106225] Updated weights for policy 1, policy_version 811530 (0.0010) [2023-12-28 01:04:18,463][106225] Updated weights for policy 1, policy_version 811540 (0.0010) [2023-12-28 01:04:18,524][106225] Updated weights for policy 1, policy_version 811550 (0.0010) [2023-12-28 01:04:18,549][106226] Updated weights for policy 0, policy_version 809453 (0.0008) [2023-12-28 01:04:18,586][106225] Updated weights for policy 1, policy_version 811560 (0.0009) [2023-12-28 01:04:18,608][106226] Updated weights for policy 0, policy_version 809463 (0.0011) [2023-12-28 01:04:18,668][106226] Updated weights for policy 0, policy_version 809473 (0.0010) [2023-12-28 01:04:19,330][106225] Updated weights for policy 1, policy_version 811570 (0.0008) [2023-12-28 01:04:19,384][106226] Updated weights for policy 0, policy_version 809483 (0.0006) [2023-12-28 01:04:19,400][106225] Updated weights for policy 1, policy_version 811580 (0.0008) [2023-12-28 01:04:19,444][106226] Updated weights for policy 0, policy_version 809493 (0.0010) [2023-12-28 01:04:19,461][106225] Updated weights for policy 1, policy_version 811590 (0.0007) [2023-12-28 01:04:19,506][106226] Updated weights for policy 0, policy_version 809503 (0.0009) [2023-12-28 01:04:20,178][106225] Updated weights for policy 1, policy_version 811600 (0.0007) [2023-12-28 01:04:20,237][106226] Updated weights for policy 0, policy_version 809513 (0.0007) [2023-12-28 01:04:20,245][106225] Updated weights for policy 1, policy_version 811610 (0.0006) [2023-12-28 01:04:20,302][106225] Updated weights for policy 1, policy_version 811620 (0.0005) [2023-12-28 01:04:20,303][106226] Updated weights for policy 0, policy_version 809523 (0.0009) [2023-12-28 01:04:20,369][106226] Updated weights for policy 0, policy_version 809533 (0.0008) [2023-12-28 01:04:20,423][106226] Updated weights for policy 0, policy_version 809543 (0.0009) [2023-12-28 01:04:20,976][106225] Updated weights for policy 1, policy_version 811630 (0.0008) [2023-12-28 01:04:21,032][106225] Updated weights for policy 1, policy_version 811640 (0.0008) [2023-12-28 01:04:21,092][106225] Updated weights for policy 1, policy_version 811650 (0.0009) [2023-12-28 01:04:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 415121408. Throughput: 0: 9899.7, 1: 9893.2. Samples: 415129848. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:21,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-5.136')] [2023-12-28 01:04:21,182][106226] Updated weights for policy 0, policy_version 809553 (0.0008) [2023-12-28 01:04:21,240][106226] Updated weights for policy 0, policy_version 809563 (0.0006) [2023-12-28 01:04:21,307][106226] Updated weights for policy 0, policy_version 809573 (0.0010) [2023-12-28 01:04:21,853][106225] Updated weights for policy 1, policy_version 811660 (0.0009) [2023-12-28 01:04:21,908][106225] Updated weights for policy 1, policy_version 811670 (0.0008) [2023-12-28 01:04:21,972][106225] Updated weights for policy 1, policy_version 811680 (0.0008) [2023-12-28 01:04:22,048][106226] Updated weights for policy 0, policy_version 809583 (0.0011) [2023-12-28 01:04:22,114][106226] Updated weights for policy 0, policy_version 809593 (0.0011) [2023-12-28 01:04:22,172][106226] Updated weights for policy 0, policy_version 809603 (0.0010) [2023-12-28 01:04:22,754][106225] Updated weights for policy 1, policy_version 811690 (0.0008) [2023-12-28 01:04:22,818][106225] Updated weights for policy 1, policy_version 811700 (0.0008) [2023-12-28 01:04:22,868][106225] Updated weights for policy 1, policy_version 811710 (0.0007) [2023-12-28 01:04:22,916][106226] Updated weights for policy 0, policy_version 809613 (0.0011) [2023-12-28 01:04:22,922][106225] Updated weights for policy 1, policy_version 811720 (0.0007) [2023-12-28 01:04:22,970][106226] Updated weights for policy 0, policy_version 809623 (0.0010) [2023-12-28 01:04:23,028][106226] Updated weights for policy 0, policy_version 809633 (0.0011) [2023-12-28 01:04:23,599][106225] Updated weights for policy 1, policy_version 811730 (0.0005) [2023-12-28 01:04:23,656][106225] Updated weights for policy 1, policy_version 811740 (0.0008) [2023-12-28 01:04:23,671][106226] Updated weights for policy 0, policy_version 809643 (0.0009) [2023-12-28 01:04:23,717][106225] Updated weights for policy 1, policy_version 811750 (0.0010) [2023-12-28 01:04:23,726][106226] Updated weights for policy 0, policy_version 809653 (0.0005) [2023-12-28 01:04:23,792][106226] Updated weights for policy 0, policy_version 809663 (0.0005) [2023-12-28 01:04:24,373][106226] Updated weights for policy 0, policy_version 809673 (0.0006) [2023-12-28 01:04:24,416][106225] Updated weights for policy 1, policy_version 811760 (0.0010) [2023-12-28 01:04:24,431][106226] Updated weights for policy 0, policy_version 809683 (0.0010) [2023-12-28 01:04:24,477][106225] Updated weights for policy 1, policy_version 811770 (0.0010) [2023-12-28 01:04:24,490][106226] Updated weights for policy 0, policy_version 809693 (0.0010) [2023-12-28 01:04:24,530][106225] Updated weights for policy 1, policy_version 811780 (0.0010) [2023-12-28 01:04:24,543][106226] Updated weights for policy 0, policy_version 809703 (0.0010) [2023-12-28 01:04:25,243][106225] Updated weights for policy 1, policy_version 811790 (0.0009) [2023-12-28 01:04:25,263][106226] Updated weights for policy 0, policy_version 809713 (0.0011) [2023-12-28 01:04:25,290][106225] Updated weights for policy 1, policy_version 811800 (0.0009) [2023-12-28 01:04:25,315][106226] Updated weights for policy 0, policy_version 809723 (0.0010) [2023-12-28 01:04:25,343][106225] Updated weights for policy 1, policy_version 811810 (0.0007) [2023-12-28 01:04:25,367][106226] Updated weights for policy 0, policy_version 809733 (0.0010) [2023-12-28 01:04:26,016][106225] Updated weights for policy 1, policy_version 811820 (0.0005) [2023-12-28 01:04:26,066][106226] Updated weights for policy 0, policy_version 809743 (0.0007) [2023-12-28 01:04:26,074][106225] Updated weights for policy 1, policy_version 811830 (0.0007) [2023-12-28 01:04:26,136][106225] Updated weights for policy 1, policy_version 811840 (0.0008) [2023-12-28 01:04:26,148][106226] Updated weights for policy 0, policy_version 809753 (0.0010) [2023-12-28 01:04:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 415219712. Throughput: 0: 9898.9, 1: 9854.2. Samples: 415188380. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:26,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-5.110')] [2023-12-28 01:04:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000811848_207872000.pth... [2023-12-28 01:04:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000810696_207577088.pth [2023-12-28 01:04:26,205][106226] Updated weights for policy 0, policy_version 809763 (0.0008) [2023-12-28 01:04:26,234][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000809768_207355904.pth... [2023-12-28 01:04:26,239][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000808616_207060992.pth [2023-12-28 01:04:26,845][106225] Updated weights for policy 1, policy_version 811850 (0.0007) [2023-12-28 01:04:26,891][106225] Updated weights for policy 1, policy_version 811860 (0.0009) [2023-12-28 01:04:26,894][106226] Updated weights for policy 0, policy_version 809773 (0.0008) [2023-12-28 01:04:26,939][106225] Updated weights for policy 1, policy_version 811870 (0.0008) [2023-12-28 01:04:26,952][106226] Updated weights for policy 0, policy_version 809783 (0.0007) [2023-12-28 01:04:27,004][106225] Updated weights for policy 1, policy_version 811880 (0.0007) [2023-12-28 01:04:27,009][106226] Updated weights for policy 0, policy_version 809793 (0.0009) [2023-12-28 01:04:27,697][106225] Updated weights for policy 1, policy_version 811890 (0.0007) [2023-12-28 01:04:27,712][106226] Updated weights for policy 0, policy_version 809803 (0.0008) [2023-12-28 01:04:27,753][106225] Updated weights for policy 1, policy_version 811900 (0.0009) [2023-12-28 01:04:27,759][106226] Updated weights for policy 0, policy_version 809813 (0.0008) [2023-12-28 01:04:27,810][106225] Updated weights for policy 1, policy_version 811910 (0.0005) [2023-12-28 01:04:27,819][106226] Updated weights for policy 0, policy_version 809823 (0.0010) [2023-12-28 01:04:28,447][106226] Updated weights for policy 0, policy_version 809833 (0.0009) [2023-12-28 01:04:28,509][106226] Updated weights for policy 0, policy_version 809843 (0.0007) [2023-12-28 01:04:28,554][106225] Updated weights for policy 1, policy_version 811920 (0.0007) [2023-12-28 01:04:28,577][106226] Updated weights for policy 0, policy_version 809853 (0.0008) [2023-12-28 01:04:28,606][106225] Updated weights for policy 1, policy_version 811930 (0.0006) [2023-12-28 01:04:28,646][106226] Updated weights for policy 0, policy_version 809863 (0.0008) [2023-12-28 01:04:28,665][106225] Updated weights for policy 1, policy_version 811940 (0.0006) [2023-12-28 01:04:29,361][106226] Updated weights for policy 0, policy_version 809873 (0.0007) [2023-12-28 01:04:29,372][106225] Updated weights for policy 1, policy_version 811950 (0.0009) [2023-12-28 01:04:29,419][106226] Updated weights for policy 0, policy_version 809883 (0.0006) [2023-12-28 01:04:29,422][106225] Updated weights for policy 1, policy_version 811960 (0.0006) [2023-12-28 01:04:29,471][106225] Updated weights for policy 1, policy_version 811970 (0.0007) [2023-12-28 01:04:29,476][106226] Updated weights for policy 0, policy_version 809893 (0.0005) [2023-12-28 01:04:30,093][106226] Updated weights for policy 0, policy_version 809903 (0.0007) [2023-12-28 01:04:30,162][106226] Updated weights for policy 0, policy_version 809913 (0.0009) [2023-12-28 01:04:30,229][106226] Updated weights for policy 0, policy_version 809923 (0.0006) [2023-12-28 01:04:30,230][106225] Updated weights for policy 1, policy_version 811980 (0.0008) [2023-12-28 01:04:30,289][106225] Updated weights for policy 1, policy_version 811990 (0.0009) [2023-12-28 01:04:30,341][106225] Updated weights for policy 1, policy_version 812000 (0.0009) [2023-12-28 01:04:30,908][106226] Updated weights for policy 0, policy_version 809933 (0.0007) [2023-12-28 01:04:30,961][106226] Updated weights for policy 0, policy_version 809943 (0.0008) [2023-12-28 01:04:30,981][106225] Updated weights for policy 1, policy_version 812010 (0.0006) [2023-12-28 01:04:31,014][106226] Updated weights for policy 0, policy_version 809953 (0.0007) [2023-12-28 01:04:31,042][106225] Updated weights for policy 1, policy_version 812020 (0.0013) [2023-12-28 01:04:31,099][106225] Updated weights for policy 1, policy_version 812030 (0.0008) [2023-12-28 01:04:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 415326208. Throughput: 0: 9876.2, 1: 9847.7. Samples: 415308424. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:31,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.945')] [2023-12-28 01:04:31,176][106225] Updated weights for policy 1, policy_version 812040 (0.0008) [2023-12-28 01:04:31,827][106226] Updated weights for policy 0, policy_version 809963 (0.0009) [2023-12-28 01:04:31,869][106225] Updated weights for policy 1, policy_version 812050 (0.0007) [2023-12-28 01:04:31,887][106226] Updated weights for policy 0, policy_version 809973 (0.0007) [2023-12-28 01:04:31,931][106225] Updated weights for policy 1, policy_version 812060 (0.0008) [2023-12-28 01:04:31,949][106226] Updated weights for policy 0, policy_version 809983 (0.0007) [2023-12-28 01:04:31,990][106225] Updated weights for policy 1, policy_version 812070 (0.0007) [2023-12-28 01:04:32,633][106226] Updated weights for policy 0, policy_version 809993 (0.0006) [2023-12-28 01:04:32,697][106226] Updated weights for policy 0, policy_version 810003 (0.0006) [2023-12-28 01:04:32,703][106225] Updated weights for policy 1, policy_version 812080 (0.0009) [2023-12-28 01:04:32,754][106226] Updated weights for policy 0, policy_version 810013 (0.0009) [2023-12-28 01:04:32,764][106225] Updated weights for policy 1, policy_version 812090 (0.0005) [2023-12-28 01:04:32,811][106226] Updated weights for policy 0, policy_version 810023 (0.0007) [2023-12-28 01:04:32,821][106225] Updated weights for policy 1, policy_version 812100 (0.0010) [2023-12-28 01:04:33,350][106225] Updated weights for policy 1, policy_version 812110 (0.0009) [2023-12-28 01:04:33,397][106225] Updated weights for policy 1, policy_version 812120 (0.0008) [2023-12-28 01:04:33,441][106225] Updated weights for policy 1, policy_version 812130 (0.0005) [2023-12-28 01:04:33,479][106226] Updated weights for policy 0, policy_version 810033 (0.0007) [2023-12-28 01:04:33,532][106226] Updated weights for policy 0, policy_version 810043 (0.0010) [2023-12-28 01:04:33,581][106226] Updated weights for policy 0, policy_version 810053 (0.0007) [2023-12-28 01:04:34,033][106225] Updated weights for policy 1, policy_version 812140 (0.0007) [2023-12-28 01:04:34,079][106225] Updated weights for policy 1, policy_version 812150 (0.0010) [2023-12-28 01:04:34,145][106225] Updated weights for policy 1, policy_version 812160 (0.0010) [2023-12-28 01:04:34,281][106226] Updated weights for policy 0, policy_version 810063 (0.0009) [2023-12-28 01:04:34,348][106226] Updated weights for policy 0, policy_version 810073 (0.0010) [2023-12-28 01:04:34,410][106226] Updated weights for policy 0, policy_version 810083 (0.0007) [2023-12-28 01:04:34,901][106225] Updated weights for policy 1, policy_version 812170 (0.0014) [2023-12-28 01:04:34,960][106225] Updated weights for policy 1, policy_version 812180 (0.0008) [2023-12-28 01:04:35,022][106225] Updated weights for policy 1, policy_version 812190 (0.0008) [2023-12-28 01:04:35,035][106226] Updated weights for policy 0, policy_version 810093 (0.0006) [2023-12-28 01:04:35,079][106225] Updated weights for policy 1, policy_version 812200 (0.0009) [2023-12-28 01:04:35,086][106226] Updated weights for policy 0, policy_version 810103 (0.0005) [2023-12-28 01:04:35,149][106226] Updated weights for policy 0, policy_version 810113 (0.0009) [2023-12-28 01:04:35,762][106225] Updated weights for policy 1, policy_version 812210 (0.0007) [2023-12-28 01:04:35,818][106225] Updated weights for policy 1, policy_version 812220 (0.0010) [2023-12-28 01:04:35,833][106226] Updated weights for policy 0, policy_version 810123 (0.0010) [2023-12-28 01:04:35,868][106225] Updated weights for policy 1, policy_version 812230 (0.0010) [2023-12-28 01:04:35,885][106226] Updated weights for policy 0, policy_version 810133 (0.0010) [2023-12-28 01:04:35,938][106226] Updated weights for policy 0, policy_version 810143 (0.0010) [2023-12-28 01:04:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 415424512. Throughput: 0: 9852.9, 1: 9937.5. Samples: 415429996. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:36,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.908')] [2023-12-28 01:04:36,616][106225] Updated weights for policy 1, policy_version 812240 (0.0011) [2023-12-28 01:04:36,675][106225] Updated weights for policy 1, policy_version 812250 (0.0010) [2023-12-28 01:04:36,677][106226] Updated weights for policy 0, policy_version 810153 (0.0010) [2023-12-28 01:04:36,730][106226] Updated weights for policy 0, policy_version 810163 (0.0010) [2023-12-28 01:04:36,740][106225] Updated weights for policy 1, policy_version 812260 (0.0010) [2023-12-28 01:04:36,783][106226] Updated weights for policy 0, policy_version 810173 (0.0010) [2023-12-28 01:04:36,837][106226] Updated weights for policy 0, policy_version 810183 (0.0010) [2023-12-28 01:04:37,383][106225] Updated weights for policy 1, policy_version 812270 (0.0011) [2023-12-28 01:04:37,434][106225] Updated weights for policy 1, policy_version 812280 (0.0010) [2023-12-28 01:04:37,492][106225] Updated weights for policy 1, policy_version 812290 (0.0006) [2023-12-28 01:04:37,541][106226] Updated weights for policy 0, policy_version 810193 (0.0010) [2023-12-28 01:04:37,609][106226] Updated weights for policy 0, policy_version 810203 (0.0011) [2023-12-28 01:04:37,673][106226] Updated weights for policy 0, policy_version 810213 (0.0011) [2023-12-28 01:04:38,194][106225] Updated weights for policy 1, policy_version 812300 (0.0008) [2023-12-28 01:04:38,250][106225] Updated weights for policy 1, policy_version 812310 (0.0008) [2023-12-28 01:04:38,311][106225] Updated weights for policy 1, policy_version 812320 (0.0010) [2023-12-28 01:04:38,356][106226] Updated weights for policy 0, policy_version 810223 (0.0009) [2023-12-28 01:04:38,413][106226] Updated weights for policy 0, policy_version 810233 (0.0010) [2023-12-28 01:04:38,473][106226] Updated weights for policy 0, policy_version 810243 (0.0010) [2023-12-28 01:04:39,013][106225] Updated weights for policy 1, policy_version 812330 (0.0009) [2023-12-28 01:04:39,079][106225] Updated weights for policy 1, policy_version 812340 (0.0005) [2023-12-28 01:04:39,142][106225] Updated weights for policy 1, policy_version 812350 (0.0006) [2023-12-28 01:04:39,194][106226] Updated weights for policy 0, policy_version 810253 (0.0010) [2023-12-28 01:04:39,195][106225] Updated weights for policy 1, policy_version 812360 (0.0007) [2023-12-28 01:04:39,256][106226] Updated weights for policy 0, policy_version 810263 (0.0009) [2023-12-28 01:04:39,328][106226] Updated weights for policy 0, policy_version 810273 (0.0010) [2023-12-28 01:04:40,049][106226] Updated weights for policy 0, policy_version 810283 (0.0009) [2023-12-28 01:04:40,091][106225] Updated weights for policy 1, policy_version 812370 (0.0008) [2023-12-28 01:04:40,105][106226] Updated weights for policy 0, policy_version 810293 (0.0008) [2023-12-28 01:04:40,143][106225] Updated weights for policy 1, policy_version 812380 (0.0008) [2023-12-28 01:04:40,164][106226] Updated weights for policy 0, policy_version 810303 (0.0008) [2023-12-28 01:04:40,195][106225] Updated weights for policy 1, policy_version 812390 (0.0006) [2023-12-28 01:04:40,854][106226] Updated weights for policy 0, policy_version 810313 (0.0010) [2023-12-28 01:04:40,911][106226] Updated weights for policy 0, policy_version 810323 (0.0006) [2023-12-28 01:04:40,954][106225] Updated weights for policy 1, policy_version 812400 (0.0008) [2023-12-28 01:04:40,955][106226] Updated weights for policy 0, policy_version 810333 (0.0005) [2023-12-28 01:04:41,007][106226] Updated weights for policy 0, policy_version 810343 (0.0005) [2023-12-28 01:04:41,013][106225] Updated weights for policy 1, policy_version 812410 (0.0008) [2023-12-28 01:04:41,084][106225] Updated weights for policy 1, policy_version 812420 (0.0010) [2023-12-28 01:04:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 415522816. Throughput: 0: 9862.7, 1: 9958.5. Samples: 415489140. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:41,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.034')] [2023-12-28 01:04:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000812424_208019456.pth... [2023-12-28 01:04:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000810344_207503360.pth... [2023-12-28 01:04:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000809160_207200256.pth [2023-12-28 01:04:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000811272_207724544.pth [2023-12-28 01:04:41,765][106226] Updated weights for policy 0, policy_version 810353 (0.0010) [2023-12-28 01:04:41,824][106226] Updated weights for policy 0, policy_version 810363 (0.0010) [2023-12-28 01:04:41,883][106225] Updated weights for policy 1, policy_version 812430 (0.0009) [2023-12-28 01:04:41,889][106226] Updated weights for policy 0, policy_version 810373 (0.0011) [2023-12-28 01:04:41,949][106225] Updated weights for policy 1, policy_version 812440 (0.0011) [2023-12-28 01:04:42,011][106225] Updated weights for policy 1, policy_version 812450 (0.0010) [2023-12-28 01:04:42,666][106226] Updated weights for policy 0, policy_version 810383 (0.0007) [2023-12-28 01:04:42,733][106226] Updated weights for policy 0, policy_version 810393 (0.0009) [2023-12-28 01:04:42,757][106225] Updated weights for policy 1, policy_version 812460 (0.0008) [2023-12-28 01:04:42,800][106226] Updated weights for policy 0, policy_version 810403 (0.0011) [2023-12-28 01:04:42,815][106225] Updated weights for policy 1, policy_version 812470 (0.0008) [2023-12-28 01:04:42,885][106225] Updated weights for policy 1, policy_version 812480 (0.0007) [2023-12-28 01:04:43,406][106226] Updated weights for policy 0, policy_version 810413 (0.0008) [2023-12-28 01:04:43,464][106226] Updated weights for policy 0, policy_version 810423 (0.0005) [2023-12-28 01:04:43,517][106226] Updated weights for policy 0, policy_version 810433 (0.0005) [2023-12-28 01:04:43,650][106225] Updated weights for policy 1, policy_version 812490 (0.0009) [2023-12-28 01:04:43,716][106225] Updated weights for policy 1, policy_version 812500 (0.0009) [2023-12-28 01:04:43,773][106225] Updated weights for policy 1, policy_version 812510 (0.0009) [2023-12-28 01:04:43,834][106225] Updated weights for policy 1, policy_version 812520 (0.0008) [2023-12-28 01:04:44,108][106226] Updated weights for policy 0, policy_version 810443 (0.0006) [2023-12-28 01:04:44,160][106226] Updated weights for policy 0, policy_version 810453 (0.0009) [2023-12-28 01:04:44,210][106226] Updated weights for policy 0, policy_version 810463 (0.0009) [2023-12-28 01:04:44,563][106225] Updated weights for policy 1, policy_version 812530 (0.0006) [2023-12-28 01:04:44,632][106225] Updated weights for policy 1, policy_version 812540 (0.0009) [2023-12-28 01:04:44,693][106225] Updated weights for policy 1, policy_version 812550 (0.0008) [2023-12-28 01:04:44,889][106226] Updated weights for policy 0, policy_version 810473 (0.0009) [2023-12-28 01:04:44,952][106226] Updated weights for policy 0, policy_version 810483 (0.0011) [2023-12-28 01:04:45,015][106226] Updated weights for policy 0, policy_version 810493 (0.0008) [2023-12-28 01:04:45,077][106226] Updated weights for policy 0, policy_version 810503 (0.0010) [2023-12-28 01:04:45,427][106225] Updated weights for policy 1, policy_version 812560 (0.0008) [2023-12-28 01:04:45,488][106225] Updated weights for policy 1, policy_version 812570 (0.0008) [2023-12-28 01:04:45,537][106225] Updated weights for policy 1, policy_version 812580 (0.0008) [2023-12-28 01:04:45,787][106226] Updated weights for policy 0, policy_version 810513 (0.0010) [2023-12-28 01:04:45,847][106226] Updated weights for policy 0, policy_version 810523 (0.0010) [2023-12-28 01:04:45,898][106226] Updated weights for policy 0, policy_version 810533 (0.0009) [2023-12-28 01:04:46,148][106225] Updated weights for policy 1, policy_version 812590 (0.0006) [2023-12-28 01:04:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 415612928. Throughput: 0: 9950.1, 1: 9827.1. Samples: 415603868. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:46,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-5.119')] [2023-12-28 01:04:46,204][106225] Updated weights for policy 1, policy_version 812600 (0.0006) [2023-12-28 01:04:46,257][106225] Updated weights for policy 1, policy_version 812610 (0.0009) [2023-12-28 01:04:46,446][106226] Updated weights for policy 0, policy_version 810543 (0.0005) [2023-12-28 01:04:46,498][106226] Updated weights for policy 0, policy_version 810553 (0.0005) [2023-12-28 01:04:46,568][106226] Updated weights for policy 0, policy_version 810563 (0.0005) [2023-12-28 01:04:46,999][106225] Updated weights for policy 1, policy_version 812620 (0.0007) [2023-12-28 01:04:47,051][106225] Updated weights for policy 1, policy_version 812630 (0.0008) [2023-12-28 01:04:47,104][106225] Updated weights for policy 1, policy_version 812640 (0.0007) [2023-12-28 01:04:47,104][106226] Updated weights for policy 0, policy_version 810573 (0.0007) [2023-12-28 01:04:47,157][106226] Updated weights for policy 0, policy_version 810583 (0.0009) [2023-12-28 01:04:47,223][106226] Updated weights for policy 0, policy_version 810593 (0.0009) [2023-12-28 01:04:47,714][106225] Updated weights for policy 1, policy_version 812650 (0.0006) [2023-12-28 01:04:47,778][106225] Updated weights for policy 1, policy_version 812660 (0.0008) [2023-12-28 01:04:47,839][106225] Updated weights for policy 1, policy_version 812670 (0.0008) [2023-12-28 01:04:47,885][106225] Updated weights for policy 1, policy_version 812680 (0.0009) [2023-12-28 01:04:47,959][106226] Updated weights for policy 0, policy_version 810603 (0.0008) [2023-12-28 01:04:48,022][106226] Updated weights for policy 0, policy_version 810613 (0.0005) [2023-12-28 01:04:48,087][106226] Updated weights for policy 0, policy_version 810623 (0.0006) [2023-12-28 01:04:48,644][106225] Updated weights for policy 1, policy_version 812690 (0.0009) [2023-12-28 01:04:48,695][106225] Updated weights for policy 1, policy_version 812700 (0.0009) [2023-12-28 01:04:48,722][106226] Updated weights for policy 0, policy_version 810633 (0.0006) [2023-12-28 01:04:48,746][106225] Updated weights for policy 1, policy_version 812710 (0.0008) [2023-12-28 01:04:48,784][106226] Updated weights for policy 0, policy_version 810643 (0.0008) [2023-12-28 01:04:48,851][106226] Updated weights for policy 0, policy_version 810653 (0.0009) [2023-12-28 01:04:48,917][106226] Updated weights for policy 0, policy_version 810663 (0.0010) [2023-12-28 01:04:49,391][106225] Updated weights for policy 1, policy_version 812720 (0.0009) [2023-12-28 01:04:49,451][106225] Updated weights for policy 1, policy_version 812730 (0.0009) [2023-12-28 01:04:49,515][106225] Updated weights for policy 1, policy_version 812740 (0.0008) [2023-12-28 01:04:49,725][106226] Updated weights for policy 0, policy_version 810673 (0.0009) [2023-12-28 01:04:49,784][106226] Updated weights for policy 0, policy_version 810683 (0.0009) [2023-12-28 01:04:49,855][106226] Updated weights for policy 0, policy_version 810693 (0.0008) [2023-12-28 01:04:50,313][106225] Updated weights for policy 1, policy_version 812750 (0.0009) [2023-12-28 01:04:50,372][106225] Updated weights for policy 1, policy_version 812760 (0.0008) [2023-12-28 01:04:50,436][106225] Updated weights for policy 1, policy_version 812770 (0.0009) [2023-12-28 01:04:50,496][106226] Updated weights for policy 0, policy_version 810703 (0.0009) [2023-12-28 01:04:50,547][106226] Updated weights for policy 0, policy_version 810713 (0.0008) [2023-12-28 01:04:50,617][106226] Updated weights for policy 0, policy_version 810723 (0.0007) [2023-12-28 01:04:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 415711232. Throughput: 0: 10040.1, 1: 9839.1. Samples: 415725104. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:51,175][105115] Avg episode reward: [(0, '-4.202'), (1, '-4.932')] [2023-12-28 01:04:51,212][106225] Updated weights for policy 1, policy_version 812780 (0.0007) [2023-12-28 01:04:51,276][106225] Updated weights for policy 1, policy_version 812790 (0.0007) [2023-12-28 01:04:51,341][106225] Updated weights for policy 1, policy_version 812800 (0.0008) [2023-12-28 01:04:51,385][106226] Updated weights for policy 0, policy_version 810733 (0.0008) [2023-12-28 01:04:51,447][106226] Updated weights for policy 0, policy_version 810743 (0.0011) [2023-12-28 01:04:51,518][106226] Updated weights for policy 0, policy_version 810753 (0.0011) [2023-12-28 01:04:51,981][106225] Updated weights for policy 1, policy_version 812810 (0.0007) [2023-12-28 01:04:52,041][106225] Updated weights for policy 1, policy_version 812820 (0.0008) [2023-12-28 01:04:52,101][106225] Updated weights for policy 1, policy_version 812830 (0.0009) [2023-12-28 01:04:52,157][106225] Updated weights for policy 1, policy_version 812840 (0.0008) [2023-12-28 01:04:52,268][106226] Updated weights for policy 0, policy_version 810763 (0.0010) [2023-12-28 01:04:52,333][106226] Updated weights for policy 0, policy_version 810773 (0.0006) [2023-12-28 01:04:52,410][106226] Updated weights for policy 0, policy_version 810783 (0.0009) [2023-12-28 01:04:52,923][106225] Updated weights for policy 1, policy_version 812850 (0.0006) [2023-12-28 01:04:52,983][106225] Updated weights for policy 1, policy_version 812860 (0.0007) [2023-12-28 01:04:53,044][106225] Updated weights for policy 1, policy_version 812870 (0.0009) [2023-12-28 01:04:53,104][106226] Updated weights for policy 0, policy_version 810793 (0.0009) [2023-12-28 01:04:53,162][106226] Updated weights for policy 0, policy_version 810803 (0.0010) [2023-12-28 01:04:53,213][106226] Updated weights for policy 0, policy_version 810813 (0.0009) [2023-12-28 01:04:53,270][106226] Updated weights for policy 0, policy_version 810823 (0.0008) [2023-12-28 01:04:53,687][106225] Updated weights for policy 1, policy_version 812880 (0.0008) [2023-12-28 01:04:53,738][106225] Updated weights for policy 1, policy_version 812890 (0.0005) [2023-12-28 01:04:53,787][106225] Updated weights for policy 1, policy_version 812900 (0.0010) [2023-12-28 01:04:53,951][106226] Updated weights for policy 0, policy_version 810833 (0.0010) [2023-12-28 01:04:54,012][106226] Updated weights for policy 0, policy_version 810843 (0.0010) [2023-12-28 01:04:54,064][106226] Updated weights for policy 0, policy_version 810853 (0.0007) [2023-12-28 01:04:54,417][106225] Updated weights for policy 1, policy_version 812910 (0.0008) [2023-12-28 01:04:54,474][106225] Updated weights for policy 1, policy_version 812920 (0.0009) [2023-12-28 01:04:54,535][106225] Updated weights for policy 1, policy_version 812930 (0.0008) [2023-12-28 01:04:54,772][106226] Updated weights for policy 0, policy_version 810863 (0.0007) [2023-12-28 01:04:54,833][106226] Updated weights for policy 0, policy_version 810873 (0.0006) [2023-12-28 01:04:54,895][106226] Updated weights for policy 0, policy_version 810883 (0.0006) [2023-12-28 01:04:55,320][106225] Updated weights for policy 1, policy_version 812940 (0.0008) [2023-12-28 01:04:55,382][106225] Updated weights for policy 1, policy_version 812950 (0.0007) [2023-12-28 01:04:55,424][106226] Updated weights for policy 0, policy_version 810893 (0.0008) [2023-12-28 01:04:55,430][106225] Updated weights for policy 1, policy_version 812960 (0.0006) [2023-12-28 01:04:55,478][106226] Updated weights for policy 0, policy_version 810903 (0.0010) [2023-12-28 01:04:55,537][106226] Updated weights for policy 0, policy_version 810913 (0.0009) [2023-12-28 01:04:56,040][106225] Updated weights for policy 1, policy_version 812970 (0.0006) [2023-12-28 01:04:56,102][106225] Updated weights for policy 1, policy_version 812980 (0.0007) [2023-12-28 01:04:56,161][106225] Updated weights for policy 1, policy_version 812990 (0.0006) [2023-12-28 01:04:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 415809536. Throughput: 0: 10025.5, 1: 9841.0. Samples: 415784200. Policy #0 lag: (min: 31.0, avg: 46.6, max: 63.0) [2023-12-28 01:04:56,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.708')] [2023-12-28 01:04:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000810920_207650816.pth... [2023-12-28 01:04:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000809768_207355904.pth [2023-12-28 01:04:56,226][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000813000_208166912.pth... [2023-12-28 01:04:56,227][106225] Updated weights for policy 1, policy_version 813000 (0.0006) [2023-12-28 01:04:56,232][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000811848_207872000.pth [2023-12-28 01:04:56,258][106226] Updated weights for policy 0, policy_version 810923 (0.0010) [2023-12-28 01:04:56,308][106226] Updated weights for policy 0, policy_version 810933 (0.0007) [2023-12-28 01:04:56,357][106226] Updated weights for policy 0, policy_version 810943 (0.0010) [2023-12-28 01:04:56,802][106225] Updated weights for policy 1, policy_version 813010 (0.0010) [2023-12-28 01:04:56,854][106225] Updated weights for policy 1, policy_version 813020 (0.0009) [2023-12-28 01:04:56,900][106225] Updated weights for policy 1, policy_version 813030 (0.0010) [2023-12-28 01:04:56,926][106226] Updated weights for policy 0, policy_version 810953 (0.0009) [2023-12-28 01:04:56,989][106226] Updated weights for policy 0, policy_version 810963 (0.0005) [2023-12-28 01:04:57,051][106226] Updated weights for policy 0, policy_version 810973 (0.0006) [2023-12-28 01:04:57,105][106226] Updated weights for policy 0, policy_version 810983 (0.0006) [2023-12-28 01:04:57,618][106225] Updated weights for policy 1, policy_version 813040 (0.0010) [2023-12-28 01:04:57,669][106225] Updated weights for policy 1, policy_version 813050 (0.0010) [2023-12-28 01:04:57,683][106226] Updated weights for policy 0, policy_version 810993 (0.0006) [2023-12-28 01:04:57,732][106225] Updated weights for policy 1, policy_version 813060 (0.0008) [2023-12-28 01:04:57,743][106226] Updated weights for policy 0, policy_version 811003 (0.0007) [2023-12-28 01:04:57,796][106226] Updated weights for policy 0, policy_version 811013 (0.0007) [2023-12-28 01:04:58,401][106225] Updated weights for policy 1, policy_version 813070 (0.0009) [2023-12-28 01:04:58,455][106225] Updated weights for policy 1, policy_version 813080 (0.0006) [2023-12-28 01:04:58,458][106226] Updated weights for policy 0, policy_version 811023 (0.0008) [2023-12-28 01:04:58,517][106225] Updated weights for policy 1, policy_version 813090 (0.0009) [2023-12-28 01:04:58,519][106226] Updated weights for policy 0, policy_version 811033 (0.0007) [2023-12-28 01:04:58,579][106226] Updated weights for policy 0, policy_version 811043 (0.0007) [2023-12-28 01:04:59,273][106226] Updated weights for policy 0, policy_version 811053 (0.0008) [2023-12-28 01:04:59,337][106226] Updated weights for policy 0, policy_version 811063 (0.0009) [2023-12-28 01:04:59,351][106225] Updated weights for policy 1, policy_version 813100 (0.0008) [2023-12-28 01:04:59,402][106226] Updated weights for policy 0, policy_version 811073 (0.0007) [2023-12-28 01:04:59,415][106225] Updated weights for policy 1, policy_version 813110 (0.0007) [2023-12-28 01:04:59,476][106225] Updated weights for policy 1, policy_version 813120 (0.0007) [2023-12-28 01:05:00,116][106226] Updated weights for policy 0, policy_version 811083 (0.0009) [2023-12-28 01:05:00,171][106226] Updated weights for policy 0, policy_version 811093 (0.0009) [2023-12-28 01:05:00,202][106225] Updated weights for policy 1, policy_version 813130 (0.0009) [2023-12-28 01:05:00,228][106226] Updated weights for policy 0, policy_version 811103 (0.0006) [2023-12-28 01:05:00,263][106225] Updated weights for policy 1, policy_version 813140 (0.0008) [2023-12-28 01:05:00,328][106225] Updated weights for policy 1, policy_version 813150 (0.0008) [2023-12-28 01:05:00,385][106225] Updated weights for policy 1, policy_version 813160 (0.0007) [2023-12-28 01:05:00,928][106226] Updated weights for policy 0, policy_version 811113 (0.0006) [2023-12-28 01:05:00,999][106226] Updated weights for policy 0, policy_version 811123 (0.0008) [2023-12-28 01:05:01,058][106225] Updated weights for policy 1, policy_version 813170 (0.0009) [2023-12-28 01:05:01,064][106226] Updated weights for policy 0, policy_version 811133 (0.0010) [2023-12-28 01:05:01,115][106225] Updated weights for policy 1, policy_version 813180 (0.0010) [2023-12-28 01:05:01,129][106226] Updated weights for policy 0, policy_version 811143 (0.0010) [2023-12-28 01:05:01,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 415916032. Throughput: 0: 10130.5, 1: 9841.8. Samples: 415906964. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:01,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.894')] [2023-12-28 01:05:01,181][106225] Updated weights for policy 1, policy_version 813190 (0.0008) [2023-12-28 01:05:01,835][106226] Updated weights for policy 0, policy_version 811153 (0.0006) [2023-12-28 01:05:01,890][106226] Updated weights for policy 0, policy_version 811163 (0.0007) [2023-12-28 01:05:01,954][106226] Updated weights for policy 0, policy_version 811173 (0.0007) [2023-12-28 01:05:01,958][106225] Updated weights for policy 1, policy_version 813200 (0.0006) [2023-12-28 01:05:02,016][106225] Updated weights for policy 1, policy_version 813210 (0.0005) [2023-12-28 01:05:02,069][106225] Updated weights for policy 1, policy_version 813220 (0.0008) [2023-12-28 01:05:02,666][106226] Updated weights for policy 0, policy_version 811183 (0.0007) [2023-12-28 01:05:02,726][106226] Updated weights for policy 0, policy_version 811193 (0.0007) [2023-12-28 01:05:02,754][106225] Updated weights for policy 1, policy_version 813230 (0.0010) [2023-12-28 01:05:02,782][106226] Updated weights for policy 0, policy_version 811203 (0.0006) [2023-12-28 01:05:02,813][106225] Updated weights for policy 1, policy_version 813240 (0.0010) [2023-12-28 01:05:02,869][106225] Updated weights for policy 1, policy_version 813250 (0.0010) [2023-12-28 01:05:03,509][106226] Updated weights for policy 0, policy_version 811213 (0.0008) [2023-12-28 01:05:03,543][106225] Updated weights for policy 1, policy_version 813260 (0.0010) [2023-12-28 01:05:03,564][106226] Updated weights for policy 0, policy_version 811223 (0.0006) [2023-12-28 01:05:03,597][106225] Updated weights for policy 1, policy_version 813270 (0.0010) [2023-12-28 01:05:03,627][106226] Updated weights for policy 0, policy_version 811233 (0.0006) [2023-12-28 01:05:03,646][106225] Updated weights for policy 1, policy_version 813280 (0.0010) [2023-12-28 01:05:04,188][106226] Updated weights for policy 0, policy_version 811243 (0.0006) [2023-12-28 01:05:04,248][106226] Updated weights for policy 0, policy_version 811253 (0.0009) [2023-12-28 01:05:04,314][106226] Updated weights for policy 0, policy_version 811263 (0.0010) [2023-12-28 01:05:04,355][106225] Updated weights for policy 1, policy_version 813290 (0.0010) [2023-12-28 01:05:04,423][106225] Updated weights for policy 1, policy_version 813300 (0.0006) [2023-12-28 01:05:04,486][106225] Updated weights for policy 1, policy_version 813310 (0.0005) [2023-12-28 01:05:04,547][106225] Updated weights for policy 1, policy_version 813320 (0.0006) [2023-12-28 01:05:05,066][106226] Updated weights for policy 0, policy_version 811273 (0.0008) [2023-12-28 01:05:05,118][106226] Updated weights for policy 0, policy_version 811283 (0.0006) [2023-12-28 01:05:05,172][106226] Updated weights for policy 0, policy_version 811293 (0.0005) [2023-12-28 01:05:05,190][106225] Updated weights for policy 1, policy_version 813330 (0.0006) [2023-12-28 01:05:05,231][106226] Updated weights for policy 0, policy_version 811303 (0.0006) [2023-12-28 01:05:05,243][106225] Updated weights for policy 1, policy_version 813340 (0.0006) [2023-12-28 01:05:05,297][106225] Updated weights for policy 1, policy_version 813350 (0.0005) [2023-12-28 01:05:05,908][106226] Updated weights for policy 0, policy_version 811313 (0.0006) [2023-12-28 01:05:05,962][106226] Updated weights for policy 0, policy_version 811323 (0.0007) [2023-12-28 01:05:05,992][106225] Updated weights for policy 1, policy_version 813360 (0.0007) [2023-12-28 01:05:06,019][106226] Updated weights for policy 0, policy_version 811333 (0.0008) [2023-12-28 01:05:06,047][106225] Updated weights for policy 1, policy_version 813370 (0.0008) [2023-12-28 01:05:06,109][106225] Updated weights for policy 1, policy_version 813380 (0.0008) [2023-12-28 01:05:06,175][105115] Fps is (10 sec: 21298.8, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 416022528. Throughput: 0: 10072.3, 1: 9851.7. Samples: 416026432. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:06,176][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.116')] [2023-12-28 01:05:06,745][106226] Updated weights for policy 0, policy_version 811343 (0.0008) [2023-12-28 01:05:06,805][106226] Updated weights for policy 0, policy_version 811353 (0.0007) [2023-12-28 01:05:06,822][106225] Updated weights for policy 1, policy_version 813390 (0.0008) [2023-12-28 01:05:06,865][106226] Updated weights for policy 0, policy_version 811363 (0.0006) [2023-12-28 01:05:06,875][106225] Updated weights for policy 1, policy_version 813400 (0.0006) [2023-12-28 01:05:06,936][106225] Updated weights for policy 1, policy_version 813410 (0.0008) [2023-12-28 01:05:07,590][106226] Updated weights for policy 0, policy_version 811373 (0.0007) [2023-12-28 01:05:07,642][106226] Updated weights for policy 0, policy_version 811383 (0.0008) [2023-12-28 01:05:07,666][106225] Updated weights for policy 1, policy_version 813420 (0.0009) [2023-12-28 01:05:07,694][106226] Updated weights for policy 0, policy_version 811393 (0.0010) [2023-12-28 01:05:07,734][106225] Updated weights for policy 1, policy_version 813430 (0.0008) [2023-12-28 01:05:07,806][106225] Updated weights for policy 1, policy_version 813440 (0.0007) [2023-12-28 01:05:08,414][106226] Updated weights for policy 0, policy_version 811403 (0.0008) [2023-12-28 01:05:08,464][106225] Updated weights for policy 1, policy_version 813450 (0.0009) [2023-12-28 01:05:08,467][106226] Updated weights for policy 0, policy_version 811413 (0.0008) [2023-12-28 01:05:08,524][106225] Updated weights for policy 1, policy_version 813460 (0.0011) [2023-12-28 01:05:08,526][106226] Updated weights for policy 0, policy_version 811423 (0.0006) [2023-12-28 01:05:08,583][106225] Updated weights for policy 1, policy_version 813470 (0.0010) [2023-12-28 01:05:08,647][106225] Updated weights for policy 1, policy_version 813480 (0.0008) [2023-12-28 01:05:09,307][106225] Updated weights for policy 1, policy_version 813490 (0.0008) [2023-12-28 01:05:09,350][106226] Updated weights for policy 0, policy_version 811433 (0.0006) [2023-12-28 01:05:09,377][106225] Updated weights for policy 1, policy_version 813500 (0.0008) [2023-12-28 01:05:09,425][106226] Updated weights for policy 0, policy_version 811443 (0.0009) [2023-12-28 01:05:09,445][106225] Updated weights for policy 1, policy_version 813510 (0.0008) [2023-12-28 01:05:09,490][106226] Updated weights for policy 0, policy_version 811453 (0.0008) [2023-12-28 01:05:09,553][106226] Updated weights for policy 0, policy_version 811463 (0.0009) [2023-12-28 01:05:10,184][106225] Updated weights for policy 1, policy_version 813520 (0.0008) [2023-12-28 01:05:10,251][106225] Updated weights for policy 1, policy_version 813530 (0.0008) [2023-12-28 01:05:10,265][106226] Updated weights for policy 0, policy_version 811473 (0.0006) [2023-12-28 01:05:10,314][106225] Updated weights for policy 1, policy_version 813540 (0.0008) [2023-12-28 01:05:10,333][106226] Updated weights for policy 0, policy_version 811483 (0.0009) [2023-12-28 01:05:10,399][106226] Updated weights for policy 0, policy_version 811493 (0.0007) [2023-12-28 01:05:11,016][106225] Updated weights for policy 1, policy_version 813550 (0.0010) [2023-12-28 01:05:11,092][106225] Updated weights for policy 1, policy_version 813560 (0.0007) [2023-12-28 01:05:11,093][106226] Updated weights for policy 0, policy_version 811503 (0.0007) [2023-12-28 01:05:11,160][106225] Updated weights for policy 1, policy_version 813570 (0.0010) [2023-12-28 01:05:11,162][106226] Updated weights for policy 0, policy_version 811513 (0.0008) [2023-12-28 01:05:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 416104448. Throughput: 0: 10037.5, 1: 9863.7. Samples: 416083936. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:11,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-5.053')] [2023-12-28 01:05:11,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000813576_208314368.pth... [2023-12-28 01:05:11,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000812424_208019456.pth [2023-12-28 01:05:11,224][106226] Updated weights for policy 0, policy_version 811523 (0.0007) [2023-12-28 01:05:11,256][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000811528_207806464.pth... [2023-12-28 01:05:11,260][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000810344_207503360.pth [2023-12-28 01:05:11,905][106225] Updated weights for policy 1, policy_version 813580 (0.0010) [2023-12-28 01:05:11,969][106225] Updated weights for policy 1, policy_version 813590 (0.0011) [2023-12-28 01:05:11,975][106226] Updated weights for policy 0, policy_version 811533 (0.0007) [2023-12-28 01:05:12,032][106226] Updated weights for policy 0, policy_version 811543 (0.0007) [2023-12-28 01:05:12,034][106225] Updated weights for policy 1, policy_version 813600 (0.0010) [2023-12-28 01:05:12,089][106226] Updated weights for policy 0, policy_version 811553 (0.0008) [2023-12-28 01:05:12,772][106225] Updated weights for policy 1, policy_version 813610 (0.0011) [2023-12-28 01:05:12,827][106226] Updated weights for policy 0, policy_version 811563 (0.0007) [2023-12-28 01:05:12,828][106225] Updated weights for policy 1, policy_version 813620 (0.0010) [2023-12-28 01:05:12,881][106225] Updated weights for policy 1, policy_version 813630 (0.0009) [2023-12-28 01:05:12,886][106226] Updated weights for policy 0, policy_version 811573 (0.0006) [2023-12-28 01:05:12,927][106225] Updated weights for policy 1, policy_version 813640 (0.0010) [2023-12-28 01:05:12,943][106226] Updated weights for policy 0, policy_version 811583 (0.0007) [2023-12-28 01:05:13,583][106225] Updated weights for policy 1, policy_version 813650 (0.0007) [2023-12-28 01:05:13,646][106225] Updated weights for policy 1, policy_version 813660 (0.0008) [2023-12-28 01:05:13,674][106226] Updated weights for policy 0, policy_version 811593 (0.0008) [2023-12-28 01:05:13,694][106225] Updated weights for policy 1, policy_version 813671 (0.0009) [2023-12-28 01:05:13,730][106226] Updated weights for policy 0, policy_version 811603 (0.0005) [2023-12-28 01:05:13,788][106226] Updated weights for policy 0, policy_version 811613 (0.0005) [2023-12-28 01:05:13,845][106226] Updated weights for policy 0, policy_version 811623 (0.0006) [2023-12-28 01:05:14,436][106225] Updated weights for policy 1, policy_version 813681 (0.0008) [2023-12-28 01:05:14,489][106226] Updated weights for policy 0, policy_version 811633 (0.0007) [2023-12-28 01:05:14,494][106225] Updated weights for policy 1, policy_version 813691 (0.0006) [2023-12-28 01:05:14,544][106226] Updated weights for policy 0, policy_version 811643 (0.0008) [2023-12-28 01:05:14,553][106225] Updated weights for policy 1, policy_version 813701 (0.0008) [2023-12-28 01:05:14,596][106226] Updated weights for policy 0, policy_version 811653 (0.0007) [2023-12-28 01:05:15,307][106225] Updated weights for policy 1, policy_version 813711 (0.0006) [2023-12-28 01:05:15,343][106226] Updated weights for policy 0, policy_version 811663 (0.0008) [2023-12-28 01:05:15,372][106225] Updated weights for policy 1, policy_version 813721 (0.0007) [2023-12-28 01:05:15,406][106226] Updated weights for policy 0, policy_version 811673 (0.0008) [2023-12-28 01:05:15,432][106225] Updated weights for policy 1, policy_version 813731 (0.0006) [2023-12-28 01:05:15,457][106226] Updated weights for policy 0, policy_version 811683 (0.0008) [2023-12-28 01:05:16,011][106225] Updated weights for policy 1, policy_version 813741 (0.0006) [2023-12-28 01:05:16,059][106225] Updated weights for policy 1, policy_version 813751 (0.0005) [2023-12-28 01:05:16,116][106225] Updated weights for policy 1, policy_version 813761 (0.0007) [2023-12-28 01:05:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 416210944. Throughput: 0: 9961.9, 1: 9824.7. Samples: 416198824. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:16,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-4.792')] [2023-12-28 01:05:16,191][106226] Updated weights for policy 0, policy_version 811693 (0.0008) [2023-12-28 01:05:16,240][106226] Updated weights for policy 0, policy_version 811703 (0.0007) [2023-12-28 01:05:16,289][106226] Updated weights for policy 0, policy_version 811713 (0.0005) [2023-12-28 01:05:16,829][106225] Updated weights for policy 1, policy_version 813771 (0.0009) [2023-12-28 01:05:16,882][106225] Updated weights for policy 1, policy_version 813781 (0.0009) [2023-12-28 01:05:16,936][106225] Updated weights for policy 1, policy_version 813791 (0.0008) [2023-12-28 01:05:16,947][106226] Updated weights for policy 0, policy_version 811723 (0.0008) [2023-12-28 01:05:17,001][106226] Updated weights for policy 0, policy_version 811733 (0.0007) [2023-12-28 01:05:17,068][106226] Updated weights for policy 0, policy_version 811743 (0.0006) [2023-12-28 01:05:17,627][106226] Updated weights for policy 0, policy_version 811753 (0.0005) [2023-12-28 01:05:17,687][106225] Updated weights for policy 1, policy_version 813801 (0.0008) [2023-12-28 01:05:17,697][106226] Updated weights for policy 0, policy_version 811763 (0.0006) [2023-12-28 01:05:17,742][106225] Updated weights for policy 1, policy_version 813811 (0.0008) [2023-12-28 01:05:17,753][106226] Updated weights for policy 0, policy_version 811773 (0.0008) [2023-12-28 01:05:17,801][106225] Updated weights for policy 1, policy_version 813821 (0.0008) [2023-12-28 01:05:17,811][106226] Updated weights for policy 0, policy_version 811783 (0.0006) [2023-12-28 01:05:17,850][106225] Updated weights for policy 1, policy_version 813831 (0.0008) [2023-12-28 01:05:18,494][106226] Updated weights for policy 0, policy_version 811793 (0.0008) [2023-12-28 01:05:18,556][106226] Updated weights for policy 0, policy_version 811803 (0.0008) [2023-12-28 01:05:18,589][106225] Updated weights for policy 1, policy_version 813841 (0.0006) [2023-12-28 01:05:18,607][106226] Updated weights for policy 0, policy_version 811813 (0.0008) [2023-12-28 01:05:18,647][106225] Updated weights for policy 1, policy_version 813851 (0.0008) [2023-12-28 01:05:18,708][106225] Updated weights for policy 1, policy_version 813861 (0.0009) [2023-12-28 01:05:19,378][106226] Updated weights for policy 0, policy_version 811823 (0.0009) [2023-12-28 01:05:19,411][106225] Updated weights for policy 1, policy_version 813871 (0.0008) [2023-12-28 01:05:19,434][106226] Updated weights for policy 0, policy_version 811833 (0.0007) [2023-12-28 01:05:19,471][106225] Updated weights for policy 1, policy_version 813881 (0.0008) [2023-12-28 01:05:19,498][106226] Updated weights for policy 0, policy_version 811843 (0.0007) [2023-12-28 01:05:19,538][106225] Updated weights for policy 1, policy_version 813891 (0.0007) [2023-12-28 01:05:20,247][106226] Updated weights for policy 0, policy_version 811853 (0.0008) [2023-12-28 01:05:20,271][106225] Updated weights for policy 1, policy_version 813901 (0.0007) [2023-12-28 01:05:20,305][106226] Updated weights for policy 0, policy_version 811863 (0.0008) [2023-12-28 01:05:20,323][106225] Updated weights for policy 1, policy_version 813911 (0.0008) [2023-12-28 01:05:20,364][106226] Updated weights for policy 0, policy_version 811873 (0.0007) [2023-12-28 01:05:20,381][106225] Updated weights for policy 1, policy_version 813921 (0.0009) [2023-12-28 01:05:21,083][106226] Updated weights for policy 0, policy_version 811883 (0.0007) [2023-12-28 01:05:21,136][106226] Updated weights for policy 0, policy_version 811893 (0.0007) [2023-12-28 01:05:21,170][106225] Updated weights for policy 1, policy_version 813931 (0.0011) [2023-12-28 01:05:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 416301056. Throughput: 0: 9966.2, 1: 9734.8. Samples: 416316544. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:21,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.696')] [2023-12-28 01:05:21,208][106226] Updated weights for policy 0, policy_version 811903 (0.0008) [2023-12-28 01:05:21,235][106225] Updated weights for policy 1, policy_version 813941 (0.0011) [2023-12-28 01:05:21,302][106225] Updated weights for policy 1, policy_version 813951 (0.0009) [2023-12-28 01:05:21,941][106226] Updated weights for policy 0, policy_version 811913 (0.0008) [2023-12-28 01:05:22,012][106226] Updated weights for policy 0, policy_version 811923 (0.0007) [2023-12-28 01:05:22,086][106226] Updated weights for policy 0, policy_version 811933 (0.0006) [2023-12-28 01:05:22,107][106225] Updated weights for policy 1, policy_version 813961 (0.0008) [2023-12-28 01:05:22,148][106226] Updated weights for policy 0, policy_version 811943 (0.0006) [2023-12-28 01:05:22,165][106225] Updated weights for policy 1, policy_version 813971 (0.0008) [2023-12-28 01:05:22,221][106225] Updated weights for policy 1, policy_version 813981 (0.0009) [2023-12-28 01:05:22,286][106225] Updated weights for policy 1, policy_version 813991 (0.0007) [2023-12-28 01:05:22,747][106226] Updated weights for policy 0, policy_version 811953 (0.0009) [2023-12-28 01:05:22,805][106226] Updated weights for policy 0, policy_version 811963 (0.0008) [2023-12-28 01:05:22,868][106226] Updated weights for policy 0, policy_version 811973 (0.0008) [2023-12-28 01:05:23,041][106225] Updated weights for policy 1, policy_version 814001 (0.0007) [2023-12-28 01:05:23,110][106225] Updated weights for policy 1, policy_version 814011 (0.0005) [2023-12-28 01:05:23,167][106225] Updated weights for policy 1, policy_version 814021 (0.0005) [2023-12-28 01:05:23,664][106226] Updated weights for policy 0, policy_version 811983 (0.0008) [2023-12-28 01:05:23,672][106225] Updated weights for policy 1, policy_version 814031 (0.0005) [2023-12-28 01:05:23,717][106226] Updated weights for policy 0, policy_version 811993 (0.0009) [2023-12-28 01:05:23,731][106225] Updated weights for policy 1, policy_version 814041 (0.0006) [2023-12-28 01:05:23,768][106226] Updated weights for policy 0, policy_version 812003 (0.0007) [2023-12-28 01:05:23,777][106225] Updated weights for policy 1, policy_version 814051 (0.0007) [2023-12-28 01:05:24,352][106225] Updated weights for policy 1, policy_version 814061 (0.0008) [2023-12-28 01:05:24,402][106225] Updated weights for policy 1, policy_version 814071 (0.0010) [2023-12-28 01:05:24,454][106225] Updated weights for policy 1, policy_version 814081 (0.0011) [2023-12-28 01:05:24,488][106226] Updated weights for policy 0, policy_version 812013 (0.0006) [2023-12-28 01:05:24,548][106226] Updated weights for policy 0, policy_version 812023 (0.0008) [2023-12-28 01:05:24,609][106226] Updated weights for policy 0, policy_version 812033 (0.0008) [2023-12-28 01:05:25,186][106225] Updated weights for policy 1, policy_version 814091 (0.0010) [2023-12-28 01:05:25,249][106225] Updated weights for policy 1, policy_version 814101 (0.0007) [2023-12-28 01:05:25,278][106226] Updated weights for policy 0, policy_version 812043 (0.0007) [2023-12-28 01:05:25,306][106225] Updated weights for policy 1, policy_version 814111 (0.0008) [2023-12-28 01:05:25,324][106226] Updated weights for policy 0, policy_version 812053 (0.0006) [2023-12-28 01:05:25,385][106226] Updated weights for policy 0, policy_version 812063 (0.0007) [2023-12-28 01:05:25,992][106225] Updated weights for policy 1, policy_version 814121 (0.0008) [2023-12-28 01:05:26,061][106225] Updated weights for policy 1, policy_version 814131 (0.0008) [2023-12-28 01:05:26,075][106226] Updated weights for policy 0, policy_version 812073 (0.0008) [2023-12-28 01:05:26,118][106225] Updated weights for policy 1, policy_version 814141 (0.0007) [2023-12-28 01:05:26,122][106226] Updated weights for policy 0, policy_version 812083 (0.0006) [2023-12-28 01:05:26,171][106226] Updated weights for policy 0, policy_version 812093 (0.0006) [2023-12-28 01:05:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 416399360. Throughput: 0: 9953.0, 1: 9733.7. Samples: 416375040. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:26,175][106225] Updated weights for policy 1, policy_version 814151 (0.0009) [2023-12-28 01:05:26,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.806')] [2023-12-28 01:05:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000814152_208461824.pth... [2023-12-28 01:05:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000813000_208166912.pth [2023-12-28 01:05:26,231][106226] Updated weights for policy 0, policy_version 812103 (0.0005) [2023-12-28 01:05:26,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000812104_207953920.pth... [2023-12-28 01:05:26,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000810920_207650816.pth [2023-12-28 01:05:26,792][106225] Updated weights for policy 1, policy_version 814161 (0.0007) [2023-12-28 01:05:26,812][106226] Updated weights for policy 0, policy_version 812113 (0.0006) [2023-12-28 01:05:26,852][106225] Updated weights for policy 1, policy_version 814171 (0.0010) [2023-12-28 01:05:26,858][106226] Updated weights for policy 0, policy_version 812123 (0.0007) [2023-12-28 01:05:26,901][106225] Updated weights for policy 1, policy_version 814181 (0.0009) [2023-12-28 01:05:26,904][106226] Updated weights for policy 0, policy_version 812133 (0.0005) [2023-12-28 01:05:27,589][106225] Updated weights for policy 1, policy_version 814191 (0.0010) [2023-12-28 01:05:27,591][106226] Updated weights for policy 0, policy_version 812143 (0.0005) [2023-12-28 01:05:27,640][106225] Updated weights for policy 1, policy_version 814201 (0.0010) [2023-12-28 01:05:27,649][106226] Updated weights for policy 0, policy_version 812153 (0.0006) [2023-12-28 01:05:27,687][106225] Updated weights for policy 1, policy_version 814211 (0.0010) [2023-12-28 01:05:27,701][106226] Updated weights for policy 0, policy_version 812163 (0.0005) [2023-12-28 01:05:28,412][106226] Updated weights for policy 0, policy_version 812173 (0.0006) [2023-12-28 01:05:28,430][106225] Updated weights for policy 1, policy_version 814221 (0.0008) [2023-12-28 01:05:28,469][106226] Updated weights for policy 0, policy_version 812183 (0.0010) [2023-12-28 01:05:28,490][106225] Updated weights for policy 1, policy_version 814231 (0.0005) [2023-12-28 01:05:28,518][106226] Updated weights for policy 0, policy_version 812193 (0.0009) [2023-12-28 01:05:28,555][106225] Updated weights for policy 1, policy_version 814241 (0.0007) [2023-12-28 01:05:29,134][106225] Updated weights for policy 1, policy_version 814251 (0.0008) [2023-12-28 01:05:29,152][106226] Updated weights for policy 0, policy_version 812203 (0.0008) [2023-12-28 01:05:29,186][106225] Updated weights for policy 1, policy_version 814261 (0.0005) [2023-12-28 01:05:29,213][106226] Updated weights for policy 0, policy_version 812213 (0.0010) [2023-12-28 01:05:29,246][106225] Updated weights for policy 1, policy_version 814271 (0.0008) [2023-12-28 01:05:29,283][106226] Updated weights for policy 0, policy_version 812223 (0.0009) [2023-12-28 01:05:29,996][106225] Updated weights for policy 1, policy_version 814281 (0.0010) [2023-12-28 01:05:29,999][106226] Updated weights for policy 0, policy_version 812233 (0.0010) [2023-12-28 01:05:30,062][106226] Updated weights for policy 0, policy_version 812243 (0.0009) [2023-12-28 01:05:30,072][106225] Updated weights for policy 1, policy_version 814291 (0.0006) [2023-12-28 01:05:30,121][106226] Updated weights for policy 0, policy_version 812253 (0.0006) [2023-12-28 01:05:30,122][106225] Updated weights for policy 1, policy_version 814301 (0.0008) [2023-12-28 01:05:30,177][106225] Updated weights for policy 1, policy_version 814311 (0.0008) [2023-12-28 01:05:30,179][106226] Updated weights for policy 0, policy_version 812263 (0.0006) [2023-12-28 01:05:30,786][106225] Updated weights for policy 1, policy_version 814321 (0.0007) [2023-12-28 01:05:30,790][106226] Updated weights for policy 0, policy_version 812273 (0.0006) [2023-12-28 01:05:30,840][106226] Updated weights for policy 0, policy_version 812283 (0.0007) [2023-12-28 01:05:30,840][106225] Updated weights for policy 1, policy_version 814331 (0.0008) [2023-12-28 01:05:30,896][106226] Updated weights for policy 0, policy_version 812293 (0.0006) [2023-12-28 01:05:30,897][106225] Updated weights for policy 1, policy_version 814341 (0.0010) [2023-12-28 01:05:31,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 416514048. Throughput: 0: 10002.3, 1: 9889.5. Samples: 416499000. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:31,175][105115] Avg episode reward: [(0, '-4.224'), (1, '-4.897')] [2023-12-28 01:05:31,608][106226] Updated weights for policy 0, policy_version 812303 (0.0010) [2023-12-28 01:05:31,648][106225] Updated weights for policy 1, policy_version 814351 (0.0008) [2023-12-28 01:05:31,693][106226] Updated weights for policy 0, policy_version 812313 (0.0010) [2023-12-28 01:05:31,713][106225] Updated weights for policy 1, policy_version 814361 (0.0007) [2023-12-28 01:05:31,753][106226] Updated weights for policy 0, policy_version 812323 (0.0010) [2023-12-28 01:05:31,774][106225] Updated weights for policy 1, policy_version 814371 (0.0008) [2023-12-28 01:05:32,494][106226] Updated weights for policy 0, policy_version 812333 (0.0007) [2023-12-28 01:05:32,524][106225] Updated weights for policy 1, policy_version 814381 (0.0008) [2023-12-28 01:05:32,550][106226] Updated weights for policy 0, policy_version 812343 (0.0008) [2023-12-28 01:05:32,574][106225] Updated weights for policy 1, policy_version 814391 (0.0007) [2023-12-28 01:05:32,616][106226] Updated weights for policy 0, policy_version 812353 (0.0005) [2023-12-28 01:05:32,628][106225] Updated weights for policy 1, policy_version 814401 (0.0007) [2023-12-28 01:05:33,243][106226] Updated weights for policy 0, policy_version 812363 (0.0006) [2023-12-28 01:05:33,295][106226] Updated weights for policy 0, policy_version 812373 (0.0009) [2023-12-28 01:05:33,343][106226] Updated weights for policy 0, policy_version 812383 (0.0008) [2023-12-28 01:05:33,424][106225] Updated weights for policy 1, policy_version 814411 (0.0008) [2023-12-28 01:05:33,478][106225] Updated weights for policy 1, policy_version 814421 (0.0008) [2023-12-28 01:05:33,526][106225] Updated weights for policy 1, policy_version 814431 (0.0009) [2023-12-28 01:05:34,130][106226] Updated weights for policy 0, policy_version 812393 (0.0008) [2023-12-28 01:05:34,148][106225] Updated weights for policy 1, policy_version 814441 (0.0007) [2023-12-28 01:05:34,195][106226] Updated weights for policy 0, policy_version 812403 (0.0008) [2023-12-28 01:05:34,215][106225] Updated weights for policy 1, policy_version 814451 (0.0008) [2023-12-28 01:05:34,261][106226] Updated weights for policy 0, policy_version 812413 (0.0007) [2023-12-28 01:05:34,281][106225] Updated weights for policy 1, policy_version 814461 (0.0008) [2023-12-28 01:05:34,323][106226] Updated weights for policy 0, policy_version 812423 (0.0008) [2023-12-28 01:05:34,342][106225] Updated weights for policy 1, policy_version 814471 (0.0007) [2023-12-28 01:05:34,963][106225] Updated weights for policy 1, policy_version 814481 (0.0008) [2023-12-28 01:05:35,019][106225] Updated weights for policy 1, policy_version 814491 (0.0008) [2023-12-28 01:05:35,038][106226] Updated weights for policy 0, policy_version 812433 (0.0008) [2023-12-28 01:05:35,074][106225] Updated weights for policy 1, policy_version 814501 (0.0010) [2023-12-28 01:05:35,092][106226] Updated weights for policy 0, policy_version 812443 (0.0009) [2023-12-28 01:05:35,144][106226] Updated weights for policy 0, policy_version 812453 (0.0009) [2023-12-28 01:05:35,678][106225] Updated weights for policy 1, policy_version 814511 (0.0007) [2023-12-28 01:05:35,729][106225] Updated weights for policy 1, policy_version 814521 (0.0005) [2023-12-28 01:05:35,784][106225] Updated weights for policy 1, policy_version 814531 (0.0005) [2023-12-28 01:05:35,970][106226] Updated weights for policy 0, policy_version 812463 (0.0009) [2023-12-28 01:05:36,031][106226] Updated weights for policy 0, policy_version 812473 (0.0006) [2023-12-28 01:05:36,084][106226] Updated weights for policy 0, policy_version 812483 (0.0005) [2023-12-28 01:05:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 416612352. Throughput: 0: 9919.3, 1: 9919.5. Samples: 416617848. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:36,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-5.006')] [2023-12-28 01:05:36,490][106225] Updated weights for policy 1, policy_version 814541 (0.0009) [2023-12-28 01:05:36,551][106225] Updated weights for policy 1, policy_version 814551 (0.0009) [2023-12-28 01:05:36,609][106225] Updated weights for policy 1, policy_version 814561 (0.0010) [2023-12-28 01:05:36,702][106226] Updated weights for policy 0, policy_version 812493 (0.0008) [2023-12-28 01:05:36,754][106226] Updated weights for policy 0, policy_version 812503 (0.0008) [2023-12-28 01:05:36,809][106226] Updated weights for policy 0, policy_version 812513 (0.0008) [2023-12-28 01:05:37,350][106225] Updated weights for policy 1, policy_version 814571 (0.0011) [2023-12-28 01:05:37,410][106225] Updated weights for policy 1, policy_version 814581 (0.0010) [2023-12-28 01:05:37,478][106225] Updated weights for policy 1, policy_version 814591 (0.0008) [2023-12-28 01:05:37,543][106226] Updated weights for policy 0, policy_version 812523 (0.0007) [2023-12-28 01:05:37,589][106226] Updated weights for policy 0, policy_version 812533 (0.0008) [2023-12-28 01:05:37,640][106226] Updated weights for policy 0, policy_version 812543 (0.0008) [2023-12-28 01:05:38,148][106225] Updated weights for policy 1, policy_version 814601 (0.0008) [2023-12-28 01:05:38,210][106225] Updated weights for policy 1, policy_version 814611 (0.0010) [2023-12-28 01:05:38,272][106225] Updated weights for policy 1, policy_version 814621 (0.0010) [2023-12-28 01:05:38,339][106225] Updated weights for policy 1, policy_version 814631 (0.0010) [2023-12-28 01:05:38,418][106226] Updated weights for policy 0, policy_version 812553 (0.0007) [2023-12-28 01:05:38,473][106226] Updated weights for policy 0, policy_version 812563 (0.0010) [2023-12-28 01:05:38,523][106226] Updated weights for policy 0, policy_version 812573 (0.0010) [2023-12-28 01:05:38,583][106226] Updated weights for policy 0, policy_version 812583 (0.0009) [2023-12-28 01:05:39,046][106225] Updated weights for policy 1, policy_version 814641 (0.0010) [2023-12-28 01:05:39,102][106225] Updated weights for policy 1, policy_version 814651 (0.0010) [2023-12-28 01:05:39,161][106225] Updated weights for policy 1, policy_version 814661 (0.0010) [2023-12-28 01:05:39,318][106226] Updated weights for policy 0, policy_version 812593 (0.0010) [2023-12-28 01:05:39,388][106226] Updated weights for policy 0, policy_version 812603 (0.0010) [2023-12-28 01:05:39,457][106226] Updated weights for policy 0, policy_version 812613 (0.0011) [2023-12-28 01:05:39,964][106225] Updated weights for policy 1, policy_version 814671 (0.0009) [2023-12-28 01:05:40,023][106225] Updated weights for policy 1, policy_version 814681 (0.0008) [2023-12-28 01:05:40,088][106225] Updated weights for policy 1, policy_version 814691 (0.0007) [2023-12-28 01:05:40,210][106226] Updated weights for policy 0, policy_version 812623 (0.0009) [2023-12-28 01:05:40,273][106226] Updated weights for policy 0, policy_version 812633 (0.0009) [2023-12-28 01:05:40,341][106226] Updated weights for policy 0, policy_version 812643 (0.0008) [2023-12-28 01:05:40,765][106225] Updated weights for policy 1, policy_version 814701 (0.0008) [2023-12-28 01:05:40,822][106225] Updated weights for policy 1, policy_version 814711 (0.0009) [2023-12-28 01:05:40,878][106225] Updated weights for policy 1, policy_version 814721 (0.0010) [2023-12-28 01:05:41,068][106226] Updated weights for policy 0, policy_version 812653 (0.0008) [2023-12-28 01:05:41,129][106226] Updated weights for policy 0, policy_version 812663 (0.0009) [2023-12-28 01:05:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 416702464. Throughput: 0: 9927.1, 1: 9894.6. Samples: 416676176. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:41,175][105115] Avg episode reward: [(0, '-4.095'), (1, '-4.893')] [2023-12-28 01:05:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000814728_208609280.pth... [2023-12-28 01:05:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000813576_208314368.pth [2023-12-28 01:05:41,197][106226] Updated weights for policy 0, policy_version 812673 (0.0009) [2023-12-28 01:05:41,243][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000812680_208101376.pth... [2023-12-28 01:05:41,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000811528_207806464.pth [2023-12-28 01:05:41,719][106225] Updated weights for policy 1, policy_version 814731 (0.0009) [2023-12-28 01:05:41,786][106225] Updated weights for policy 1, policy_version 814741 (0.0008) [2023-12-28 01:05:41,855][106225] Updated weights for policy 1, policy_version 814751 (0.0009) [2023-12-28 01:05:42,029][106226] Updated weights for policy 0, policy_version 812683 (0.0009) [2023-12-28 01:05:42,092][106226] Updated weights for policy 0, policy_version 812693 (0.0010) [2023-12-28 01:05:42,159][106226] Updated weights for policy 0, policy_version 812703 (0.0011) [2023-12-28 01:05:42,614][106225] Updated weights for policy 1, policy_version 814761 (0.0008) [2023-12-28 01:05:42,678][106225] Updated weights for policy 1, policy_version 814771 (0.0007) [2023-12-28 01:05:42,738][106225] Updated weights for policy 1, policy_version 814781 (0.0008) [2023-12-28 01:05:42,799][106225] Updated weights for policy 1, policy_version 814791 (0.0008) [2023-12-28 01:05:42,915][106226] Updated weights for policy 0, policy_version 812713 (0.0010) [2023-12-28 01:05:42,973][106226] Updated weights for policy 0, policy_version 812723 (0.0008) [2023-12-28 01:05:43,030][106226] Updated weights for policy 0, policy_version 812733 (0.0009) [2023-12-28 01:05:43,080][106226] Updated weights for policy 0, policy_version 812743 (0.0005) [2023-12-28 01:05:43,476][106225] Updated weights for policy 1, policy_version 814801 (0.0009) [2023-12-28 01:05:43,521][106225] Updated weights for policy 1, policy_version 814811 (0.0008) [2023-12-28 01:05:43,575][106225] Updated weights for policy 1, policy_version 814821 (0.0007) [2023-12-28 01:05:43,818][106226] Updated weights for policy 0, policy_version 812753 (0.0009) [2023-12-28 01:05:43,875][106226] Updated weights for policy 0, policy_version 812763 (0.0009) [2023-12-28 01:05:43,928][106226] Updated weights for policy 0, policy_version 812773 (0.0009) [2023-12-28 01:05:44,150][106225] Updated weights for policy 1, policy_version 814831 (0.0009) [2023-12-28 01:05:44,203][106225] Updated weights for policy 1, policy_version 814841 (0.0010) [2023-12-28 01:05:44,259][106225] Updated weights for policy 1, policy_version 814851 (0.0010) [2023-12-28 01:05:44,702][106226] Updated weights for policy 0, policy_version 812783 (0.0006) [2023-12-28 01:05:44,772][106226] Updated weights for policy 0, policy_version 812793 (0.0006) [2023-12-28 01:05:44,840][106226] Updated weights for policy 0, policy_version 812803 (0.0008) [2023-12-28 01:05:44,976][106225] Updated weights for policy 1, policy_version 814861 (0.0009) [2023-12-28 01:05:45,042][106225] Updated weights for policy 1, policy_version 814871 (0.0011) [2023-12-28 01:05:45,110][106225] Updated weights for policy 1, policy_version 814881 (0.0011) [2023-12-28 01:05:45,441][106226] Updated weights for policy 0, policy_version 812813 (0.0007) [2023-12-28 01:05:45,496][106226] Updated weights for policy 0, policy_version 812823 (0.0005) [2023-12-28 01:05:45,553][106226] Updated weights for policy 0, policy_version 812833 (0.0009) [2023-12-28 01:05:45,803][106225] Updated weights for policy 1, policy_version 814891 (0.0010) [2023-12-28 01:05:45,852][106225] Updated weights for policy 1, policy_version 814901 (0.0008) [2023-12-28 01:05:45,908][106225] Updated weights for policy 1, policy_version 814911 (0.0008) [2023-12-28 01:05:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 416800768. Throughput: 0: 9750.8, 1: 9858.9. Samples: 416789400. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:46,175][105115] Avg episode reward: [(0, '-4.003'), (1, '-4.866')] [2023-12-28 01:05:46,228][106226] Updated weights for policy 0, policy_version 812843 (0.0009) [2023-12-28 01:05:46,277][106226] Updated weights for policy 0, policy_version 812853 (0.0009) [2023-12-28 01:05:46,322][106226] Updated weights for policy 0, policy_version 812863 (0.0009) [2023-12-28 01:05:46,676][106225] Updated weights for policy 1, policy_version 814921 (0.0008) [2023-12-28 01:05:46,731][106225] Updated weights for policy 1, policy_version 814931 (0.0008) [2023-12-28 01:05:46,786][106225] Updated weights for policy 1, policy_version 814941 (0.0008) [2023-12-28 01:05:46,847][106225] Updated weights for policy 1, policy_version 814951 (0.0008) [2023-12-28 01:05:47,031][106226] Updated weights for policy 0, policy_version 812873 (0.0008) [2023-12-28 01:05:47,081][106226] Updated weights for policy 0, policy_version 812883 (0.0010) [2023-12-28 01:05:47,136][106226] Updated weights for policy 0, policy_version 812893 (0.0005) [2023-12-28 01:05:47,194][106226] Updated weights for policy 0, policy_version 812903 (0.0005) [2023-12-28 01:05:47,565][106225] Updated weights for policy 1, policy_version 814961 (0.0006) [2023-12-28 01:05:47,621][106225] Updated weights for policy 1, policy_version 814971 (0.0008) [2023-12-28 01:05:47,678][106225] Updated weights for policy 1, policy_version 814981 (0.0008) [2023-12-28 01:05:47,817][106226] Updated weights for policy 0, policy_version 812913 (0.0006) [2023-12-28 01:05:47,876][106226] Updated weights for policy 0, policy_version 812923 (0.0005) [2023-12-28 01:05:47,931][106226] Updated weights for policy 0, policy_version 812933 (0.0006) [2023-12-28 01:05:48,418][106225] Updated weights for policy 1, policy_version 814991 (0.0009) [2023-12-28 01:05:48,471][106225] Updated weights for policy 1, policy_version 815001 (0.0009) [2023-12-28 01:05:48,520][106225] Updated weights for policy 1, policy_version 815011 (0.0008) [2023-12-28 01:05:48,609][106226] Updated weights for policy 0, policy_version 812943 (0.0009) [2023-12-28 01:05:48,671][106226] Updated weights for policy 0, policy_version 812953 (0.0007) [2023-12-28 01:05:48,741][106226] Updated weights for policy 0, policy_version 812963 (0.0005) [2023-12-28 01:05:49,257][106225] Updated weights for policy 1, policy_version 815021 (0.0008) [2023-12-28 01:05:49,315][106226] Updated weights for policy 0, policy_version 812973 (0.0006) [2023-12-28 01:05:49,323][106225] Updated weights for policy 1, policy_version 815031 (0.0005) [2023-12-28 01:05:49,384][106226] Updated weights for policy 0, policy_version 812983 (0.0009) [2023-12-28 01:05:49,395][106225] Updated weights for policy 1, policy_version 815041 (0.0007) [2023-12-28 01:05:49,449][106226] Updated weights for policy 0, policy_version 812993 (0.0007) [2023-12-28 01:05:50,125][106225] Updated weights for policy 1, policy_version 815051 (0.0006) [2023-12-28 01:05:50,191][106225] Updated weights for policy 1, policy_version 815061 (0.0007) [2023-12-28 01:05:50,206][106226] Updated weights for policy 0, policy_version 813003 (0.0009) [2023-12-28 01:05:50,246][106225] Updated weights for policy 1, policy_version 815071 (0.0008) [2023-12-28 01:05:50,265][106226] Updated weights for policy 0, policy_version 813013 (0.0006) [2023-12-28 01:05:50,318][106226] Updated weights for policy 0, policy_version 813023 (0.0006) [2023-12-28 01:05:50,930][106225] Updated weights for policy 1, policy_version 815081 (0.0007) [2023-12-28 01:05:50,959][106226] Updated weights for policy 0, policy_version 813033 (0.0005) [2023-12-28 01:05:50,988][106225] Updated weights for policy 1, policy_version 815091 (0.0006) [2023-12-28 01:05:51,023][106226] Updated weights for policy 0, policy_version 813043 (0.0008) [2023-12-28 01:05:51,055][106225] Updated weights for policy 1, policy_version 815101 (0.0007) [2023-12-28 01:05:51,085][106226] Updated weights for policy 0, policy_version 813053 (0.0008) [2023-12-28 01:05:51,112][106225] Updated weights for policy 1, policy_version 815111 (0.0006) [2023-12-28 01:05:51,157][106226] Updated weights for policy 0, policy_version 813063 (0.0007) [2023-12-28 01:05:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 416907264. Throughput: 0: 9810.8, 1: 9816.4. Samples: 416909652. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:51,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.136')] [2023-12-28 01:05:51,703][106225] Updated weights for policy 1, policy_version 815121 (0.0008) [2023-12-28 01:05:51,772][106225] Updated weights for policy 1, policy_version 815131 (0.0009) [2023-12-28 01:05:51,827][106225] Updated weights for policy 1, policy_version 815141 (0.0008) [2023-12-28 01:05:51,979][106226] Updated weights for policy 0, policy_version 813073 (0.0009) [2023-12-28 01:05:52,045][106226] Updated weights for policy 0, policy_version 813083 (0.0009) [2023-12-28 01:05:52,101][106226] Updated weights for policy 0, policy_version 813093 (0.0009) [2023-12-28 01:05:52,556][106225] Updated weights for policy 1, policy_version 815151 (0.0008) [2023-12-28 01:05:52,619][106225] Updated weights for policy 1, policy_version 815161 (0.0008) [2023-12-28 01:05:52,679][106225] Updated weights for policy 1, policy_version 815171 (0.0010) [2023-12-28 01:05:52,821][106226] Updated weights for policy 0, policy_version 813103 (0.0008) [2023-12-28 01:05:52,878][106226] Updated weights for policy 0, policy_version 813113 (0.0005) [2023-12-28 01:05:52,934][106226] Updated weights for policy 0, policy_version 813123 (0.0007) [2023-12-28 01:05:53,394][106225] Updated weights for policy 1, policy_version 815181 (0.0007) [2023-12-28 01:05:53,447][106225] Updated weights for policy 1, policy_version 815191 (0.0005) [2023-12-28 01:05:53,505][106225] Updated weights for policy 1, policy_version 815201 (0.0007) [2023-12-28 01:05:53,660][106226] Updated weights for policy 0, policy_version 813133 (0.0009) [2023-12-28 01:05:53,714][106226] Updated weights for policy 0, policy_version 813143 (0.0010) [2023-12-28 01:05:53,766][106226] Updated weights for policy 0, policy_version 813153 (0.0008) [2023-12-28 01:05:54,139][106225] Updated weights for policy 1, policy_version 815211 (0.0007) [2023-12-28 01:05:54,192][106225] Updated weights for policy 1, policy_version 815221 (0.0006) [2023-12-28 01:05:54,244][106225] Updated weights for policy 1, policy_version 815231 (0.0005) [2023-12-28 01:05:54,451][106226] Updated weights for policy 0, policy_version 813163 (0.0009) [2023-12-28 01:05:54,509][106226] Updated weights for policy 0, policy_version 813173 (0.0010) [2023-12-28 01:05:54,561][106226] Updated weights for policy 0, policy_version 813183 (0.0008) [2023-12-28 01:05:54,905][106225] Updated weights for policy 1, policy_version 815241 (0.0005) [2023-12-28 01:05:54,959][106225] Updated weights for policy 1, policy_version 815251 (0.0005) [2023-12-28 01:05:55,017][106225] Updated weights for policy 1, policy_version 815261 (0.0007) [2023-12-28 01:05:55,076][106225] Updated weights for policy 1, policy_version 815271 (0.0008) [2023-12-28 01:05:55,242][106226] Updated weights for policy 0, policy_version 813193 (0.0007) [2023-12-28 01:05:55,297][106226] Updated weights for policy 0, policy_version 813203 (0.0005) [2023-12-28 01:05:55,356][106226] Updated weights for policy 0, policy_version 813213 (0.0005) [2023-12-28 01:05:55,418][106226] Updated weights for policy 0, policy_version 813223 (0.0006) [2023-12-28 01:05:55,728][106225] Updated weights for policy 1, policy_version 815281 (0.0010) [2023-12-28 01:05:55,787][106225] Updated weights for policy 1, policy_version 815291 (0.0010) [2023-12-28 01:05:55,849][106225] Updated weights for policy 1, policy_version 815301 (0.0010) [2023-12-28 01:05:55,988][106226] Updated weights for policy 0, policy_version 813233 (0.0008) [2023-12-28 01:05:56,054][106226] Updated weights for policy 0, policy_version 813243 (0.0009) [2023-12-28 01:05:56,120][106226] Updated weights for policy 0, policy_version 813253 (0.0008) [2023-12-28 01:05:56,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 417005568. Throughput: 0: 9797.9, 1: 9828.7. Samples: 416967136. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:05:56,176][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.141')] [2023-12-28 01:05:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000815304_208756736.pth... [2023-12-28 01:05:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000813256_208248832.pth... [2023-12-28 01:05:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000814152_208461824.pth [2023-12-28 01:05:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000812104_207953920.pth [2023-12-28 01:05:56,475][106225] Updated weights for policy 1, policy_version 815311 (0.0009) [2023-12-28 01:05:56,520][106225] Updated weights for policy 1, policy_version 815321 (0.0007) [2023-12-28 01:05:56,563][106225] Updated weights for policy 1, policy_version 815331 (0.0008) [2023-12-28 01:05:56,736][106226] Updated weights for policy 0, policy_version 813263 (0.0009) [2023-12-28 01:05:56,782][106226] Updated weights for policy 0, policy_version 813273 (0.0010) [2023-12-28 01:05:56,825][106226] Updated weights for policy 0, policy_version 813283 (0.0010) [2023-12-28 01:05:57,169][106225] Updated weights for policy 1, policy_version 815341 (0.0006) [2023-12-28 01:05:57,220][106225] Updated weights for policy 1, policy_version 815351 (0.0005) [2023-12-28 01:05:57,265][106225] Updated weights for policy 1, policy_version 815361 (0.0005) [2023-12-28 01:05:57,541][106226] Updated weights for policy 0, policy_version 813293 (0.0010) [2023-12-28 01:05:57,588][106226] Updated weights for policy 0, policy_version 813303 (0.0010) [2023-12-28 01:05:57,637][106226] Updated weights for policy 0, policy_version 813313 (0.0010) [2023-12-28 01:05:57,845][106225] Updated weights for policy 1, policy_version 815371 (0.0006) [2023-12-28 01:05:57,912][106225] Updated weights for policy 1, policy_version 815381 (0.0007) [2023-12-28 01:05:57,970][106225] Updated weights for policy 1, policy_version 815391 (0.0010) [2023-12-28 01:05:58,417][106226] Updated weights for policy 0, policy_version 813323 (0.0010) [2023-12-28 01:05:58,484][106226] Updated weights for policy 0, policy_version 813333 (0.0008) [2023-12-28 01:05:58,545][106226] Updated weights for policy 0, policy_version 813343 (0.0009) [2023-12-28 01:05:58,690][106225] Updated weights for policy 1, policy_version 815401 (0.0009) [2023-12-28 01:05:58,757][106225] Updated weights for policy 1, policy_version 815411 (0.0008) [2023-12-28 01:05:58,820][106225] Updated weights for policy 1, policy_version 815421 (0.0008) [2023-12-28 01:05:58,891][106225] Updated weights for policy 1, policy_version 815431 (0.0008) [2023-12-28 01:05:59,418][106226] Updated weights for policy 0, policy_version 813353 (0.0009) [2023-12-28 01:05:59,488][106226] Updated weights for policy 0, policy_version 813363 (0.0008) [2023-12-28 01:05:59,550][106226] Updated weights for policy 0, policy_version 813373 (0.0010) [2023-12-28 01:05:59,560][106225] Updated weights for policy 1, policy_version 815441 (0.0006) [2023-12-28 01:05:59,612][106225] Updated weights for policy 1, policy_version 815451 (0.0011) [2023-12-28 01:05:59,640][106226] Updated weights for policy 0, policy_version 813383 (0.0011) [2023-12-28 01:05:59,663][106225] Updated weights for policy 1, policy_version 815461 (0.0008) [2023-12-28 01:06:00,286][106225] Updated weights for policy 1, policy_version 815471 (0.0009) [2023-12-28 01:06:00,303][106226] Updated weights for policy 0, policy_version 813393 (0.0011) [2023-12-28 01:06:00,343][106225] Updated weights for policy 1, policy_version 815481 (0.0008) [2023-12-28 01:06:00,364][106226] Updated weights for policy 0, policy_version 813403 (0.0011) [2023-12-28 01:06:00,405][106225] Updated weights for policy 1, policy_version 815491 (0.0006) [2023-12-28 01:06:00,424][106226] Updated weights for policy 0, policy_version 813413 (0.0010) [2023-12-28 01:06:00,989][106225] Updated weights for policy 1, policy_version 815501 (0.0008) [2023-12-28 01:06:01,050][106225] Updated weights for policy 1, policy_version 815511 (0.0010) [2023-12-28 01:06:01,111][106225] Updated weights for policy 1, policy_version 815521 (0.0010) [2023-12-28 01:06:01,155][106226] Updated weights for policy 0, policy_version 813423 (0.0011) [2023-12-28 01:06:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 417103872. Throughput: 0: 9838.9, 1: 9972.2. Samples: 417090320. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:01,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.966')] [2023-12-28 01:06:01,220][106226] Updated weights for policy 0, policy_version 813433 (0.0010) [2023-12-28 01:06:01,289][106226] Updated weights for policy 0, policy_version 813443 (0.0008) [2023-12-28 01:06:01,849][106225] Updated weights for policy 1, policy_version 815531 (0.0010) [2023-12-28 01:06:01,898][106225] Updated weights for policy 1, policy_version 815541 (0.0007) [2023-12-28 01:06:01,955][106225] Updated weights for policy 1, policy_version 815551 (0.0006) [2023-12-28 01:06:02,029][106226] Updated weights for policy 0, policy_version 813453 (0.0009) [2023-12-28 01:06:02,083][106226] Updated weights for policy 0, policy_version 813463 (0.0008) [2023-12-28 01:06:02,142][106226] Updated weights for policy 0, policy_version 813473 (0.0008) [2023-12-28 01:06:02,605][106225] Updated weights for policy 1, policy_version 815561 (0.0007) [2023-12-28 01:06:02,665][106225] Updated weights for policy 1, policy_version 815571 (0.0009) [2023-12-28 01:06:02,724][106225] Updated weights for policy 1, policy_version 815581 (0.0007) [2023-12-28 01:06:02,786][106225] Updated weights for policy 1, policy_version 815591 (0.0007) [2023-12-28 01:06:02,925][106226] Updated weights for policy 0, policy_version 813483 (0.0009) [2023-12-28 01:06:02,975][106226] Updated weights for policy 0, policy_version 813493 (0.0008) [2023-12-28 01:06:03,021][106226] Updated weights for policy 0, policy_version 813503 (0.0007) [2023-12-28 01:06:03,474][106225] Updated weights for policy 1, policy_version 815601 (0.0009) [2023-12-28 01:06:03,520][106225] Updated weights for policy 1, policy_version 815611 (0.0009) [2023-12-28 01:06:03,572][106225] Updated weights for policy 1, policy_version 815621 (0.0008) [2023-12-28 01:06:03,596][106226] Updated weights for policy 0, policy_version 813513 (0.0005) [2023-12-28 01:06:03,646][106226] Updated weights for policy 0, policy_version 813523 (0.0006) [2023-12-28 01:06:03,693][106226] Updated weights for policy 0, policy_version 813533 (0.0006) [2023-12-28 01:06:03,744][106226] Updated weights for policy 0, policy_version 813543 (0.0005) [2023-12-28 01:06:04,341][106225] Updated weights for policy 1, policy_version 815631 (0.0008) [2023-12-28 01:06:04,398][106225] Updated weights for policy 1, policy_version 815641 (0.0008) [2023-12-28 01:06:04,450][106226] Updated weights for policy 0, policy_version 813553 (0.0010) [2023-12-28 01:06:04,457][106225] Updated weights for policy 1, policy_version 815651 (0.0008) [2023-12-28 01:06:04,504][106226] Updated weights for policy 0, policy_version 813563 (0.0011) [2023-12-28 01:06:04,562][106226] Updated weights for policy 0, policy_version 813573 (0.0011) [2023-12-28 01:06:05,193][106225] Updated weights for policy 1, policy_version 815661 (0.0007) [2023-12-28 01:06:05,249][106225] Updated weights for policy 1, policy_version 815671 (0.0005) [2023-12-28 01:06:05,258][106226] Updated weights for policy 0, policy_version 813583 (0.0011) [2023-12-28 01:06:05,296][106225] Updated weights for policy 1, policy_version 815681 (0.0005) [2023-12-28 01:06:05,309][106226] Updated weights for policy 0, policy_version 813593 (0.0010) [2023-12-28 01:06:05,359][106226] Updated weights for policy 0, policy_version 813603 (0.0010) [2023-12-28 01:06:05,940][106225] Updated weights for policy 1, policy_version 815691 (0.0006) [2023-12-28 01:06:05,996][106225] Updated weights for policy 1, policy_version 815701 (0.0006) [2023-12-28 01:06:06,054][106225] Updated weights for policy 1, policy_version 815711 (0.0005) [2023-12-28 01:06:06,123][106226] Updated weights for policy 0, policy_version 813613 (0.0010) [2023-12-28 01:06:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 417202176. Throughput: 0: 9829.0, 1: 10043.3. Samples: 417210796. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:06,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.962')] [2023-12-28 01:06:06,181][106226] Updated weights for policy 0, policy_version 813623 (0.0006) [2023-12-28 01:06:06,250][106226] Updated weights for policy 0, policy_version 813633 (0.0006) [2023-12-28 01:06:06,663][106225] Updated weights for policy 1, policy_version 815721 (0.0007) [2023-12-28 01:06:06,719][106225] Updated weights for policy 1, policy_version 815731 (0.0008) [2023-12-28 01:06:06,771][106225] Updated weights for policy 1, policy_version 815741 (0.0008) [2023-12-28 01:06:06,829][106225] Updated weights for policy 1, policy_version 815751 (0.0008) [2023-12-28 01:06:06,978][106226] Updated weights for policy 0, policy_version 813643 (0.0009) [2023-12-28 01:06:07,037][106226] Updated weights for policy 0, policy_version 813653 (0.0006) [2023-12-28 01:06:07,094][106226] Updated weights for policy 0, policy_version 813663 (0.0006) [2023-12-28 01:06:07,542][106225] Updated weights for policy 1, policy_version 815761 (0.0010) [2023-12-28 01:06:07,602][106225] Updated weights for policy 1, policy_version 815771 (0.0006) [2023-12-28 01:06:07,661][106225] Updated weights for policy 1, policy_version 815781 (0.0008) [2023-12-28 01:06:07,703][106226] Updated weights for policy 0, policy_version 813673 (0.0007) [2023-12-28 01:06:07,761][106226] Updated weights for policy 0, policy_version 813683 (0.0008) [2023-12-28 01:06:07,825][106226] Updated weights for policy 0, policy_version 813693 (0.0005) [2023-12-28 01:06:07,891][106226] Updated weights for policy 0, policy_version 813703 (0.0005) [2023-12-28 01:06:08,335][106225] Updated weights for policy 1, policy_version 815791 (0.0007) [2023-12-28 01:06:08,398][106225] Updated weights for policy 1, policy_version 815801 (0.0008) [2023-12-28 01:06:08,454][106225] Updated weights for policy 1, policy_version 815811 (0.0007) [2023-12-28 01:06:08,485][106226] Updated weights for policy 0, policy_version 813713 (0.0005) [2023-12-28 01:06:08,535][106226] Updated weights for policy 0, policy_version 813723 (0.0007) [2023-12-28 01:06:08,596][106226] Updated weights for policy 0, policy_version 813733 (0.0009) [2023-12-28 01:06:09,192][106225] Updated weights for policy 1, policy_version 815821 (0.0007) [2023-12-28 01:06:09,265][106225] Updated weights for policy 1, policy_version 815831 (0.0007) [2023-12-28 01:06:09,290][106226] Updated weights for policy 0, policy_version 813743 (0.0007) [2023-12-28 01:06:09,324][106225] Updated weights for policy 1, policy_version 815841 (0.0008) [2023-12-28 01:06:09,362][106226] Updated weights for policy 0, policy_version 813753 (0.0007) [2023-12-28 01:06:09,429][106226] Updated weights for policy 0, policy_version 813763 (0.0008) [2023-12-28 01:06:10,027][106225] Updated weights for policy 1, policy_version 815851 (0.0008) [2023-12-28 01:06:10,095][106225] Updated weights for policy 1, policy_version 815861 (0.0006) [2023-12-28 01:06:10,159][106225] Updated weights for policy 1, policy_version 815871 (0.0009) [2023-12-28 01:06:10,234][106226] Updated weights for policy 0, policy_version 813773 (0.0007) [2023-12-28 01:06:10,301][106226] Updated weights for policy 0, policy_version 813783 (0.0007) [2023-12-28 01:06:10,362][106226] Updated weights for policy 0, policy_version 813793 (0.0008) [2023-12-28 01:06:10,874][106225] Updated weights for policy 1, policy_version 815881 (0.0009) [2023-12-28 01:06:10,930][106225] Updated weights for policy 1, policy_version 815891 (0.0008) [2023-12-28 01:06:10,995][106225] Updated weights for policy 1, policy_version 815901 (0.0007) [2023-12-28 01:06:11,065][106225] Updated weights for policy 1, policy_version 815911 (0.0008) [2023-12-28 01:06:11,078][106226] Updated weights for policy 0, policy_version 813803 (0.0009) [2023-12-28 01:06:11,134][106226] Updated weights for policy 0, policy_version 813813 (0.0008) [2023-12-28 01:06:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 417300480. Throughput: 0: 9883.0, 1: 10068.9. Samples: 417272876. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:11,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-4.864')] [2023-12-28 01:06:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000815912_208912384.pth... [2023-12-28 01:06:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000814728_208609280.pth [2023-12-28 01:06:11,210][106226] Updated weights for policy 0, policy_version 813823 (0.0007) [2023-12-28 01:06:11,264][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000813832_208396288.pth... [2023-12-28 01:06:11,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000812680_208101376.pth [2023-12-28 01:06:11,856][106225] Updated weights for policy 1, policy_version 815921 (0.0007) [2023-12-28 01:06:11,918][106225] Updated weights for policy 1, policy_version 815931 (0.0007) [2023-12-28 01:06:11,981][106225] Updated weights for policy 1, policy_version 815941 (0.0009) [2023-12-28 01:06:11,998][106226] Updated weights for policy 0, policy_version 813833 (0.0008) [2023-12-28 01:06:12,055][106226] Updated weights for policy 0, policy_version 813843 (0.0008) [2023-12-28 01:06:12,118][106226] Updated weights for policy 0, policy_version 813853 (0.0008) [2023-12-28 01:06:12,181][106226] Updated weights for policy 0, policy_version 813863 (0.0008) [2023-12-28 01:06:12,696][106225] Updated weights for policy 1, policy_version 815951 (0.0009) [2023-12-28 01:06:12,757][106225] Updated weights for policy 1, policy_version 815961 (0.0009) [2023-12-28 01:06:12,815][106225] Updated weights for policy 1, policy_version 815971 (0.0008) [2023-12-28 01:06:12,929][106226] Updated weights for policy 0, policy_version 813873 (0.0008) [2023-12-28 01:06:12,991][106226] Updated weights for policy 0, policy_version 813883 (0.0007) [2023-12-28 01:06:13,059][106226] Updated weights for policy 0, policy_version 813893 (0.0009) [2023-12-28 01:06:13,514][106225] Updated weights for policy 1, policy_version 815981 (0.0005) [2023-12-28 01:06:13,569][106225] Updated weights for policy 1, policy_version 815991 (0.0005) [2023-12-28 01:06:13,630][106225] Updated weights for policy 1, policy_version 816001 (0.0005) [2023-12-28 01:06:13,801][106226] Updated weights for policy 0, policy_version 813903 (0.0007) [2023-12-28 01:06:13,859][106226] Updated weights for policy 0, policy_version 813913 (0.0009) [2023-12-28 01:06:13,917][106226] Updated weights for policy 0, policy_version 813923 (0.0010) [2023-12-28 01:06:14,229][106225] Updated weights for policy 1, policy_version 816011 (0.0008) [2023-12-28 01:06:14,285][106225] Updated weights for policy 1, policy_version 816021 (0.0007) [2023-12-28 01:06:14,345][106225] Updated weights for policy 1, policy_version 816031 (0.0005) [2023-12-28 01:06:14,596][106226] Updated weights for policy 0, policy_version 813933 (0.0006) [2023-12-28 01:06:14,650][106226] Updated weights for policy 0, policy_version 813943 (0.0005) [2023-12-28 01:06:14,712][106226] Updated weights for policy 0, policy_version 813953 (0.0010) [2023-12-28 01:06:15,036][106225] Updated weights for policy 1, policy_version 816041 (0.0009) [2023-12-28 01:06:15,107][106225] Updated weights for policy 1, policy_version 816051 (0.0011) [2023-12-28 01:06:15,180][106225] Updated weights for policy 1, policy_version 816061 (0.0009) [2023-12-28 01:06:15,254][106225] Updated weights for policy 1, policy_version 816071 (0.0007) [2023-12-28 01:06:15,342][106226] Updated weights for policy 0, policy_version 813963 (0.0009) [2023-12-28 01:06:15,413][106226] Updated weights for policy 0, policy_version 813973 (0.0006) [2023-12-28 01:06:15,486][106226] Updated weights for policy 0, policy_version 813983 (0.0006) [2023-12-28 01:06:15,902][106225] Updated weights for policy 1, policy_version 816081 (0.0006) [2023-12-28 01:06:15,959][106225] Updated weights for policy 1, policy_version 816091 (0.0007) [2023-12-28 01:06:16,019][106225] Updated weights for policy 1, policy_version 816101 (0.0010) [2023-12-28 01:06:16,041][106226] Updated weights for policy 0, policy_version 813993 (0.0006) [2023-12-28 01:06:16,088][106226] Updated weights for policy 0, policy_version 814003 (0.0008) [2023-12-28 01:06:16,135][106226] Updated weights for policy 0, policy_version 814013 (0.0008) [2023-12-28 01:06:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 417398784. Throughput: 0: 9752.4, 1: 10002.1. Samples: 417387956. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:16,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.976')] [2023-12-28 01:06:16,199][106226] Updated weights for policy 0, policy_version 814023 (0.0008) [2023-12-28 01:06:16,707][106225] Updated weights for policy 1, policy_version 816111 (0.0010) [2023-12-28 01:06:16,765][106225] Updated weights for policy 1, policy_version 816121 (0.0010) [2023-12-28 01:06:16,822][106225] Updated weights for policy 1, policy_version 816131 (0.0010) [2023-12-28 01:06:16,932][106226] Updated weights for policy 0, policy_version 814033 (0.0008) [2023-12-28 01:06:16,988][106226] Updated weights for policy 0, policy_version 814043 (0.0007) [2023-12-28 01:06:17,051][106226] Updated weights for policy 0, policy_version 814053 (0.0005) [2023-12-28 01:06:17,495][106225] Updated weights for policy 1, policy_version 816141 (0.0008) [2023-12-28 01:06:17,552][106225] Updated weights for policy 1, policy_version 816151 (0.0005) [2023-12-28 01:06:17,607][106225] Updated weights for policy 1, policy_version 816161 (0.0007) [2023-12-28 01:06:17,725][106226] Updated weights for policy 0, policy_version 814063 (0.0007) [2023-12-28 01:06:17,789][106226] Updated weights for policy 0, policy_version 814073 (0.0005) [2023-12-28 01:06:17,844][106226] Updated weights for policy 0, policy_version 814083 (0.0005) [2023-12-28 01:06:18,217][106225] Updated weights for policy 1, policy_version 816171 (0.0010) [2023-12-28 01:06:18,281][106225] Updated weights for policy 1, policy_version 816181 (0.0010) [2023-12-28 01:06:18,342][106225] Updated weights for policy 1, policy_version 816191 (0.0010) [2023-12-28 01:06:18,485][106226] Updated weights for policy 0, policy_version 814093 (0.0007) [2023-12-28 01:06:18,542][106226] Updated weights for policy 0, policy_version 814103 (0.0008) [2023-12-28 01:06:18,589][106226] Updated weights for policy 0, policy_version 814113 (0.0008) [2023-12-28 01:06:19,024][106225] Updated weights for policy 1, policy_version 816201 (0.0010) [2023-12-28 01:06:19,085][106225] Updated weights for policy 1, policy_version 816211 (0.0008) [2023-12-28 01:06:19,146][106225] Updated weights for policy 1, policy_version 816221 (0.0008) [2023-12-28 01:06:19,207][106225] Updated weights for policy 1, policy_version 816231 (0.0007) [2023-12-28 01:06:19,366][106226] Updated weights for policy 0, policy_version 814123 (0.0013) [2023-12-28 01:06:19,424][106226] Updated weights for policy 0, policy_version 814133 (0.0010) [2023-12-28 01:06:19,482][106226] Updated weights for policy 0, policy_version 814143 (0.0010) [2023-12-28 01:06:19,855][106225] Updated weights for policy 1, policy_version 816241 (0.0008) [2023-12-28 01:06:19,913][106225] Updated weights for policy 1, policy_version 816251 (0.0008) [2023-12-28 01:06:19,978][106225] Updated weights for policy 1, policy_version 816261 (0.0008) [2023-12-28 01:06:20,188][106226] Updated weights for policy 0, policy_version 814153 (0.0009) [2023-12-28 01:06:20,253][106226] Updated weights for policy 0, policy_version 814163 (0.0009) [2023-12-28 01:06:20,322][106226] Updated weights for policy 0, policy_version 814173 (0.0008) [2023-12-28 01:06:20,389][106226] Updated weights for policy 0, policy_version 814183 (0.0008) [2023-12-28 01:06:20,763][106225] Updated weights for policy 1, policy_version 816271 (0.0007) [2023-12-28 01:06:20,820][106225] Updated weights for policy 1, policy_version 816281 (0.0007) [2023-12-28 01:06:20,875][106225] Updated weights for policy 1, policy_version 816291 (0.0005) [2023-12-28 01:06:21,064][106226] Updated weights for policy 0, policy_version 814193 (0.0009) [2023-12-28 01:06:21,126][106226] Updated weights for policy 0, policy_version 814203 (0.0006) [2023-12-28 01:06:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 417497088. Throughput: 0: 9806.8, 1: 9979.4. Samples: 417508228. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:21,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.887')] [2023-12-28 01:06:21,193][106226] Updated weights for policy 0, policy_version 814213 (0.0008) [2023-12-28 01:06:21,581][106225] Updated weights for policy 1, policy_version 816301 (0.0007) [2023-12-28 01:06:21,656][106225] Updated weights for policy 1, policy_version 816311 (0.0009) [2023-12-28 01:06:21,722][106225] Updated weights for policy 1, policy_version 816321 (0.0008) [2023-12-28 01:06:22,014][106226] Updated weights for policy 0, policy_version 814223 (0.0010) [2023-12-28 01:06:22,067][106226] Updated weights for policy 0, policy_version 814233 (0.0007) [2023-12-28 01:06:22,136][106226] Updated weights for policy 0, policy_version 814243 (0.0006) [2023-12-28 01:06:22,449][106225] Updated weights for policy 1, policy_version 816331 (0.0008) [2023-12-28 01:06:22,518][106225] Updated weights for policy 1, policy_version 816341 (0.0008) [2023-12-28 01:06:22,582][106225] Updated weights for policy 1, policy_version 816351 (0.0007) [2023-12-28 01:06:22,896][106226] Updated weights for policy 0, policy_version 814253 (0.0009) [2023-12-28 01:06:22,960][106226] Updated weights for policy 0, policy_version 814263 (0.0009) [2023-12-28 01:06:23,014][106226] Updated weights for policy 0, policy_version 814273 (0.0009) [2023-12-28 01:06:23,267][106225] Updated weights for policy 1, policy_version 816361 (0.0007) [2023-12-28 01:06:23,326][106225] Updated weights for policy 1, policy_version 816371 (0.0005) [2023-12-28 01:06:23,372][106225] Updated weights for policy 1, policy_version 816381 (0.0005) [2023-12-28 01:06:23,426][106225] Updated weights for policy 1, policy_version 816391 (0.0008) [2023-12-28 01:06:23,678][106226] Updated weights for policy 0, policy_version 814283 (0.0007) [2023-12-28 01:06:23,743][106226] Updated weights for policy 0, policy_version 814293 (0.0006) [2023-12-28 01:06:23,809][106226] Updated weights for policy 0, policy_version 814303 (0.0008) [2023-12-28 01:06:24,123][106225] Updated weights for policy 1, policy_version 816401 (0.0008) [2023-12-28 01:06:24,183][106225] Updated weights for policy 1, policy_version 816411 (0.0008) [2023-12-28 01:06:24,247][106225] Updated weights for policy 1, policy_version 816421 (0.0008) [2023-12-28 01:06:24,473][106226] Updated weights for policy 0, policy_version 814313 (0.0007) [2023-12-28 01:06:24,528][106226] Updated weights for policy 0, policy_version 814323 (0.0008) [2023-12-28 01:06:24,584][106226] Updated weights for policy 0, policy_version 814333 (0.0009) [2023-12-28 01:06:24,637][106226] Updated weights for policy 0, policy_version 814343 (0.0008) [2023-12-28 01:06:24,979][106225] Updated weights for policy 1, policy_version 816431 (0.0009) [2023-12-28 01:06:25,032][106225] Updated weights for policy 1, policy_version 816441 (0.0008) [2023-12-28 01:06:25,082][106225] Updated weights for policy 1, policy_version 816451 (0.0005) [2023-12-28 01:06:25,350][106226] Updated weights for policy 0, policy_version 814353 (0.0008) [2023-12-28 01:06:25,409][106226] Updated weights for policy 0, policy_version 814363 (0.0008) [2023-12-28 01:06:25,467][106226] Updated weights for policy 0, policy_version 814373 (0.0008) [2023-12-28 01:06:25,769][106225] Updated weights for policy 1, policy_version 816461 (0.0007) [2023-12-28 01:06:25,830][106225] Updated weights for policy 1, policy_version 816471 (0.0005) [2023-12-28 01:06:25,890][106225] Updated weights for policy 1, policy_version 816481 (0.0008) [2023-12-28 01:06:26,133][106226] Updated weights for policy 0, policy_version 814383 (0.0009) [2023-12-28 01:06:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 417595392. Throughput: 0: 9788.2, 1: 9987.0. Samples: 417566056. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:26,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-5.004')] [2023-12-28 01:06:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000816488_209059840.pth... [2023-12-28 01:06:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000815304_208756736.pth [2023-12-28 01:06:26,190][106226] Updated weights for policy 0, policy_version 814393 (0.0009) [2023-12-28 01:06:26,239][106226] Updated weights for policy 0, policy_version 814403 (0.0008) [2023-12-28 01:06:26,270][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000814408_208543744.pth... [2023-12-28 01:06:26,274][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000813256_208248832.pth [2023-12-28 01:06:26,598][106225] Updated weights for policy 1, policy_version 816491 (0.0009) [2023-12-28 01:06:26,659][106225] Updated weights for policy 1, policy_version 816501 (0.0008) [2023-12-28 01:06:26,721][106225] Updated weights for policy 1, policy_version 816511 (0.0008) [2023-12-28 01:06:26,975][106226] Updated weights for policy 0, policy_version 814413 (0.0008) [2023-12-28 01:06:27,023][106226] Updated weights for policy 0, policy_version 814423 (0.0008) [2023-12-28 01:06:27,078][106226] Updated weights for policy 0, policy_version 814433 (0.0009) [2023-12-28 01:06:27,365][106225] Updated weights for policy 1, policy_version 816521 (0.0008) [2023-12-28 01:06:27,422][106225] Updated weights for policy 1, policy_version 816531 (0.0006) [2023-12-28 01:06:27,480][106225] Updated weights for policy 1, policy_version 816541 (0.0008) [2023-12-28 01:06:27,530][106225] Updated weights for policy 1, policy_version 816551 (0.0008) [2023-12-28 01:06:27,825][106226] Updated weights for policy 0, policy_version 814443 (0.0007) [2023-12-28 01:06:27,890][106226] Updated weights for policy 0, policy_version 814453 (0.0006) [2023-12-28 01:06:27,938][106226] Updated weights for policy 0, policy_version 814463 (0.0005) [2023-12-28 01:06:28,243][106225] Updated weights for policy 1, policy_version 816561 (0.0008) [2023-12-28 01:06:28,303][106225] Updated weights for policy 1, policy_version 816571 (0.0008) [2023-12-28 01:06:28,368][106225] Updated weights for policy 1, policy_version 816581 (0.0009) [2023-12-28 01:06:28,609][106226] Updated weights for policy 0, policy_version 814473 (0.0006) [2023-12-28 01:06:28,666][106226] Updated weights for policy 0, policy_version 814483 (0.0010) [2023-12-28 01:06:28,716][106226] Updated weights for policy 0, policy_version 814493 (0.0010) [2023-12-28 01:06:28,774][106226] Updated weights for policy 0, policy_version 814503 (0.0010) [2023-12-28 01:06:29,084][106225] Updated weights for policy 1, policy_version 816591 (0.0008) [2023-12-28 01:06:29,133][106225] Updated weights for policy 1, policy_version 816601 (0.0008) [2023-12-28 01:06:29,187][106225] Updated weights for policy 1, policy_version 816611 (0.0009) [2023-12-28 01:06:29,431][106226] Updated weights for policy 0, policy_version 814513 (0.0008) [2023-12-28 01:06:29,497][106226] Updated weights for policy 0, policy_version 814523 (0.0007) [2023-12-28 01:06:29,558][106226] Updated weights for policy 0, policy_version 814533 (0.0007) [2023-12-28 01:06:30,002][106225] Updated weights for policy 1, policy_version 816621 (0.0009) [2023-12-28 01:06:30,059][106225] Updated weights for policy 1, policy_version 816631 (0.0009) [2023-12-28 01:06:30,113][106225] Updated weights for policy 1, policy_version 816641 (0.0008) [2023-12-28 01:06:30,242][106226] Updated weights for policy 0, policy_version 814543 (0.0009) [2023-12-28 01:06:30,291][106226] Updated weights for policy 0, policy_version 814553 (0.0008) [2023-12-28 01:06:30,344][106226] Updated weights for policy 0, policy_version 814563 (0.0009) [2023-12-28 01:06:30,751][106225] Updated weights for policy 1, policy_version 816651 (0.0008) [2023-12-28 01:06:30,800][106225] Updated weights for policy 1, policy_version 816661 (0.0005) [2023-12-28 01:06:30,850][106225] Updated weights for policy 1, policy_version 816671 (0.0005) [2023-12-28 01:06:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 417693696. Throughput: 0: 9881.3, 1: 10007.2. Samples: 417684380. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:31,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-5.312')] [2023-12-28 01:06:31,191][106226] Updated weights for policy 0, policy_version 814573 (0.0009) [2023-12-28 01:06:31,256][106226] Updated weights for policy 0, policy_version 814583 (0.0008) [2023-12-28 01:06:31,311][106226] Updated weights for policy 0, policy_version 814593 (0.0007) [2023-12-28 01:06:31,459][106225] Updated weights for policy 1, policy_version 816681 (0.0005) [2023-12-28 01:06:31,512][106225] Updated weights for policy 1, policy_version 816691 (0.0005) [2023-12-28 01:06:31,565][106225] Updated weights for policy 1, policy_version 816701 (0.0005) [2023-12-28 01:06:31,633][106225] Updated weights for policy 1, policy_version 816711 (0.0006) [2023-12-28 01:06:32,000][106226] Updated weights for policy 0, policy_version 814603 (0.0007) [2023-12-28 01:06:32,065][106226] Updated weights for policy 0, policy_version 814613 (0.0005) [2023-12-28 01:06:32,130][106226] Updated weights for policy 0, policy_version 814623 (0.0005) [2023-12-28 01:06:32,253][106225] Updated weights for policy 1, policy_version 816721 (0.0006) [2023-12-28 01:06:32,326][106225] Updated weights for policy 1, policy_version 816731 (0.0007) [2023-12-28 01:06:32,390][106225] Updated weights for policy 1, policy_version 816741 (0.0008) [2023-12-28 01:06:32,731][106226] Updated weights for policy 0, policy_version 814633 (0.0006) [2023-12-28 01:06:32,798][106226] Updated weights for policy 0, policy_version 814643 (0.0005) [2023-12-28 01:06:32,864][106226] Updated weights for policy 0, policy_version 814653 (0.0007) [2023-12-28 01:06:32,933][106226] Updated weights for policy 0, policy_version 814663 (0.0008) [2023-12-28 01:06:33,122][106225] Updated weights for policy 1, policy_version 816751 (0.0006) [2023-12-28 01:06:33,176][106225] Updated weights for policy 1, policy_version 816761 (0.0005) [2023-12-28 01:06:33,225][106225] Updated weights for policy 1, policy_version 816771 (0.0005) [2023-12-28 01:06:33,548][106226] Updated weights for policy 0, policy_version 814673 (0.0005) [2023-12-28 01:06:33,598][106226] Updated weights for policy 0, policy_version 814683 (0.0005) [2023-12-28 01:06:33,642][106226] Updated weights for policy 0, policy_version 814693 (0.0007) [2023-12-28 01:06:33,848][106225] Updated weights for policy 1, policy_version 816781 (0.0008) [2023-12-28 01:06:33,907][106225] Updated weights for policy 1, policy_version 816791 (0.0010) [2023-12-28 01:06:33,962][106225] Updated weights for policy 1, policy_version 816801 (0.0010) [2023-12-28 01:06:34,300][106226] Updated weights for policy 0, policy_version 814703 (0.0009) [2023-12-28 01:06:34,357][106226] Updated weights for policy 0, policy_version 814713 (0.0008) [2023-12-28 01:06:34,422][106226] Updated weights for policy 0, policy_version 814723 (0.0006) [2023-12-28 01:06:34,750][106225] Updated weights for policy 1, policy_version 816811 (0.0009) [2023-12-28 01:06:34,802][106225] Updated weights for policy 1, policy_version 816821 (0.0007) [2023-12-28 01:06:34,853][106225] Updated weights for policy 1, policy_version 816831 (0.0007) [2023-12-28 01:06:35,020][106226] Updated weights for policy 0, policy_version 814733 (0.0008) [2023-12-28 01:06:35,069][106226] Updated weights for policy 0, policy_version 814743 (0.0010) [2023-12-28 01:06:35,115][106226] Updated weights for policy 0, policy_version 814753 (0.0010) [2023-12-28 01:06:35,504][106225] Updated weights for policy 1, policy_version 816841 (0.0005) [2023-12-28 01:06:35,565][106225] Updated weights for policy 1, policy_version 816851 (0.0005) [2023-12-28 01:06:35,638][106225] Updated weights for policy 1, policy_version 816861 (0.0010) [2023-12-28 01:06:35,694][106225] Updated weights for policy 1, policy_version 816871 (0.0005) [2023-12-28 01:06:35,737][106226] Updated weights for policy 0, policy_version 814763 (0.0010) [2023-12-28 01:06:35,783][106226] Updated weights for policy 0, policy_version 814773 (0.0010) [2023-12-28 01:06:35,843][106226] Updated weights for policy 0, policy_version 814783 (0.0010) [2023-12-28 01:06:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 417800192. Throughput: 0: 9881.6, 1: 10096.9. Samples: 417808684. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:36,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.662')] [2023-12-28 01:06:36,278][106225] Updated weights for policy 1, policy_version 816881 (0.0008) [2023-12-28 01:06:36,338][106225] Updated weights for policy 1, policy_version 816891 (0.0008) [2023-12-28 01:06:36,403][106225] Updated weights for policy 1, policy_version 816901 (0.0006) [2023-12-28 01:06:36,500][106226] Updated weights for policy 0, policy_version 814793 (0.0008) [2023-12-28 01:06:36,563][106226] Updated weights for policy 0, policy_version 814803 (0.0005) [2023-12-28 01:06:36,625][106226] Updated weights for policy 0, policy_version 814813 (0.0008) [2023-12-28 01:06:36,686][106226] Updated weights for policy 0, policy_version 814823 (0.0007) [2023-12-28 01:06:37,137][106225] Updated weights for policy 1, policy_version 816911 (0.0011) [2023-12-28 01:06:37,203][106225] Updated weights for policy 1, policy_version 816921 (0.0011) [2023-12-28 01:06:37,265][106225] Updated weights for policy 1, policy_version 816931 (0.0008) [2023-12-28 01:06:37,280][106226] Updated weights for policy 0, policy_version 814833 (0.0006) [2023-12-28 01:06:37,344][106226] Updated weights for policy 0, policy_version 814843 (0.0007) [2023-12-28 01:06:37,400][106226] Updated weights for policy 0, policy_version 814853 (0.0008) [2023-12-28 01:06:37,888][106225] Updated weights for policy 1, policy_version 816941 (0.0006) [2023-12-28 01:06:37,952][106225] Updated weights for policy 1, policy_version 816951 (0.0006) [2023-12-28 01:06:37,993][106226] Updated weights for policy 0, policy_version 814863 (0.0008) [2023-12-28 01:06:38,015][106225] Updated weights for policy 1, policy_version 816961 (0.0006) [2023-12-28 01:06:38,045][106226] Updated weights for policy 0, policy_version 814873 (0.0007) [2023-12-28 01:06:38,104][106226] Updated weights for policy 0, policy_version 814883 (0.0005) [2023-12-28 01:06:38,665][106225] Updated weights for policy 1, policy_version 816971 (0.0008) [2023-12-28 01:06:38,728][106225] Updated weights for policy 1, policy_version 816981 (0.0007) [2023-12-28 01:06:38,787][106225] Updated weights for policy 1, policy_version 816991 (0.0007) [2023-12-28 01:06:38,800][106226] Updated weights for policy 0, policy_version 814893 (0.0007) [2023-12-28 01:06:38,861][106226] Updated weights for policy 0, policy_version 814903 (0.0008) [2023-12-28 01:06:38,928][106226] Updated weights for policy 0, policy_version 814913 (0.0008) [2023-12-28 01:06:39,549][106225] Updated weights for policy 1, policy_version 817001 (0.0007) [2023-12-28 01:06:39,608][106225] Updated weights for policy 1, policy_version 817011 (0.0006) [2023-12-28 01:06:39,660][106225] Updated weights for policy 1, policy_version 817021 (0.0006) [2023-12-28 01:06:39,715][106225] Updated weights for policy 1, policy_version 817031 (0.0008) [2023-12-28 01:06:39,737][106226] Updated weights for policy 0, policy_version 814923 (0.0009) [2023-12-28 01:06:39,796][106226] Updated weights for policy 0, policy_version 814933 (0.0010) [2023-12-28 01:06:39,866][106226] Updated weights for policy 0, policy_version 814943 (0.0011) [2023-12-28 01:06:40,488][106225] Updated weights for policy 1, policy_version 817041 (0.0008) [2023-12-28 01:06:40,492][106226] Updated weights for policy 0, policy_version 814953 (0.0010) [2023-12-28 01:06:40,544][106225] Updated weights for policy 1, policy_version 817051 (0.0009) [2023-12-28 01:06:40,550][106226] Updated weights for policy 0, policy_version 814963 (0.0007) [2023-12-28 01:06:40,602][106225] Updated weights for policy 1, policy_version 817061 (0.0008) [2023-12-28 01:06:40,609][106226] Updated weights for policy 0, policy_version 814973 (0.0006) [2023-12-28 01:06:40,655][106226] Updated weights for policy 0, policy_version 814983 (0.0007) [2023-12-28 01:06:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 417898496. Throughput: 0: 9968.9, 1: 10121.5. Samples: 417871200. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:41,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.894')] [2023-12-28 01:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000817064_209207296.pth... [2023-12-28 01:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000814984_208691200.pth... [2023-12-28 01:06:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000813832_208396288.pth [2023-12-28 01:06:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000815912_208912384.pth [2023-12-28 01:06:41,355][106226] Updated weights for policy 0, policy_version 814993 (0.0007) [2023-12-28 01:06:41,402][106225] Updated weights for policy 1, policy_version 817071 (0.0007) [2023-12-28 01:06:41,427][106226] Updated weights for policy 0, policy_version 815003 (0.0007) [2023-12-28 01:06:41,462][106225] Updated weights for policy 1, policy_version 817081 (0.0008) [2023-12-28 01:06:41,495][106226] Updated weights for policy 0, policy_version 815013 (0.0006) [2023-12-28 01:06:41,511][106225] Updated weights for policy 1, policy_version 817091 (0.0008) [2023-12-28 01:06:42,173][106226] Updated weights for policy 0, policy_version 815023 (0.0009) [2023-12-28 01:06:42,242][106226] Updated weights for policy 0, policy_version 815033 (0.0011) [2023-12-28 01:06:42,292][106225] Updated weights for policy 1, policy_version 817101 (0.0008) [2023-12-28 01:06:42,307][106226] Updated weights for policy 0, policy_version 815043 (0.0009) [2023-12-28 01:06:42,357][106225] Updated weights for policy 1, policy_version 817111 (0.0008) [2023-12-28 01:06:42,432][106225] Updated weights for policy 1, policy_version 817121 (0.0008) [2023-12-28 01:06:42,982][106226] Updated weights for policy 0, policy_version 815053 (0.0008) [2023-12-28 01:06:43,028][106225] Updated weights for policy 1, policy_version 817131 (0.0007) [2023-12-28 01:06:43,043][106226] Updated weights for policy 0, policy_version 815063 (0.0008) [2023-12-28 01:06:43,083][106225] Updated weights for policy 1, policy_version 817141 (0.0007) [2023-12-28 01:06:43,099][106226] Updated weights for policy 0, policy_version 815073 (0.0008) [2023-12-28 01:06:43,145][106225] Updated weights for policy 1, policy_version 817151 (0.0006) [2023-12-28 01:06:43,823][106225] Updated weights for policy 1, policy_version 817161 (0.0007) [2023-12-28 01:06:43,825][106226] Updated weights for policy 0, policy_version 815083 (0.0009) [2023-12-28 01:06:43,875][106225] Updated weights for policy 1, policy_version 817171 (0.0006) [2023-12-28 01:06:43,889][106226] Updated weights for policy 0, policy_version 815093 (0.0009) [2023-12-28 01:06:43,930][106225] Updated weights for policy 1, policy_version 817181 (0.0006) [2023-12-28 01:06:43,950][106226] Updated weights for policy 0, policy_version 815103 (0.0008) [2023-12-28 01:06:43,984][106225] Updated weights for policy 1, policy_version 817191 (0.0006) [2023-12-28 01:06:44,656][106226] Updated weights for policy 0, policy_version 815113 (0.0009) [2023-12-28 01:06:44,694][106225] Updated weights for policy 1, policy_version 817201 (0.0008) [2023-12-28 01:06:44,703][106226] Updated weights for policy 0, policy_version 815123 (0.0006) [2023-12-28 01:06:44,741][106225] Updated weights for policy 1, policy_version 817211 (0.0007) [2023-12-28 01:06:44,764][106226] Updated weights for policy 0, policy_version 815133 (0.0006) [2023-12-28 01:06:44,807][106225] Updated weights for policy 1, policy_version 817221 (0.0008) [2023-12-28 01:06:44,830][106226] Updated weights for policy 0, policy_version 815143 (0.0008) [2023-12-28 01:06:45,500][106226] Updated weights for policy 0, policy_version 815153 (0.0006) [2023-12-28 01:06:45,557][106226] Updated weights for policy 0, policy_version 815163 (0.0005) [2023-12-28 01:06:45,596][106225] Updated weights for policy 1, policy_version 817231 (0.0008) [2023-12-28 01:06:45,615][106226] Updated weights for policy 0, policy_version 815173 (0.0005) [2023-12-28 01:06:45,654][106225] Updated weights for policy 1, policy_version 817241 (0.0008) [2023-12-28 01:06:45,713][106225] Updated weights for policy 1, policy_version 817251 (0.0008) [2023-12-28 01:06:46,140][106226] Updated weights for policy 0, policy_version 815183 (0.0005) [2023-12-28 01:06:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 417996800. Throughput: 0: 9954.9, 1: 9987.6. Samples: 417987732. Policy #0 lag: (min: 29.0, avg: 29.3, max: 37.0) [2023-12-28 01:06:46,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.876')] [2023-12-28 01:06:46,208][106226] Updated weights for policy 0, policy_version 815193 (0.0005) [2023-12-28 01:06:46,278][106226] Updated weights for policy 0, policy_version 815203 (0.0005) [2023-12-28 01:06:46,538][106225] Updated weights for policy 1, policy_version 817261 (0.0009) [2023-12-28 01:06:46,586][106225] Updated weights for policy 1, policy_version 817271 (0.0009) [2023-12-28 01:06:46,631][106225] Updated weights for policy 1, policy_version 817281 (0.0008) [2023-12-28 01:06:46,867][106226] Updated weights for policy 0, policy_version 815213 (0.0006) [2023-12-28 01:06:46,934][106226] Updated weights for policy 0, policy_version 815223 (0.0005) [2023-12-28 01:06:47,002][106226] Updated weights for policy 0, policy_version 815233 (0.0005) [2023-12-28 01:06:47,402][106225] Updated weights for policy 1, policy_version 817291 (0.0008) [2023-12-28 01:06:47,445][106225] Updated weights for policy 1, policy_version 817301 (0.0008) [2023-12-28 01:06:47,497][106225] Updated weights for policy 1, policy_version 817311 (0.0008) [2023-12-28 01:06:47,647][106226] Updated weights for policy 0, policy_version 815243 (0.0005) [2023-12-28 01:06:47,715][106226] Updated weights for policy 0, policy_version 815253 (0.0005) [2023-12-28 01:06:47,781][106226] Updated weights for policy 0, policy_version 815263 (0.0005) [2023-12-28 01:06:48,308][106225] Updated weights for policy 1, policy_version 817321 (0.0008) [2023-12-28 01:06:48,344][106226] Updated weights for policy 0, policy_version 815273 (0.0006) [2023-12-28 01:06:48,372][106225] Updated weights for policy 1, policy_version 817331 (0.0008) [2023-12-28 01:06:48,401][106226] Updated weights for policy 0, policy_version 815283 (0.0008) [2023-12-28 01:06:48,439][106225] Updated weights for policy 1, policy_version 817341 (0.0007) [2023-12-28 01:06:48,457][106226] Updated weights for policy 0, policy_version 815293 (0.0006) [2023-12-28 01:06:48,502][106225] Updated weights for policy 1, policy_version 817351 (0.0007) [2023-12-28 01:06:48,516][106226] Updated weights for policy 0, policy_version 815303 (0.0006) [2023-12-28 01:06:49,144][106226] Updated weights for policy 0, policy_version 815313 (0.0006) [2023-12-28 01:06:49,190][106226] Updated weights for policy 0, policy_version 815323 (0.0005) [2023-12-28 01:06:49,258][106226] Updated weights for policy 0, policy_version 815333 (0.0008) [2023-12-28 01:06:49,295][106225] Updated weights for policy 1, policy_version 817361 (0.0009) [2023-12-28 01:06:49,356][106225] Updated weights for policy 1, policy_version 817371 (0.0008) [2023-12-28 01:06:49,423][106225] Updated weights for policy 1, policy_version 817381 (0.0008) [2023-12-28 01:06:50,019][106226] Updated weights for policy 0, policy_version 815343 (0.0009) [2023-12-28 01:06:50,069][106226] Updated weights for policy 0, policy_version 815353 (0.0008) [2023-12-28 01:06:50,123][106226] Updated weights for policy 0, policy_version 815363 (0.0007) [2023-12-28 01:06:50,141][106225] Updated weights for policy 1, policy_version 817391 (0.0008) [2023-12-28 01:06:50,189][106225] Updated weights for policy 1, policy_version 817401 (0.0008) [2023-12-28 01:06:50,239][106225] Updated weights for policy 1, policy_version 817412 (0.0009) [2023-12-28 01:06:50,805][106226] Updated weights for policy 0, policy_version 815373 (0.0007) [2023-12-28 01:06:50,855][106226] Updated weights for policy 0, policy_version 815383 (0.0009) [2023-12-28 01:06:50,904][106226] Updated weights for policy 0, policy_version 815393 (0.0006) [2023-12-28 01:06:51,054][106225] Updated weights for policy 1, policy_version 817422 (0.0009) [2023-12-28 01:06:51,116][106225] Updated weights for policy 1, policy_version 817432 (0.0008) [2023-12-28 01:06:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 418095104. Throughput: 0: 10072.4, 1: 9813.7. Samples: 418105672. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:06:51,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.952')] [2023-12-28 01:06:51,185][106225] Updated weights for policy 1, policy_version 817442 (0.0008) [2023-12-28 01:06:51,650][106226] Updated weights for policy 0, policy_version 815403 (0.0008) [2023-12-28 01:06:51,709][106226] Updated weights for policy 0, policy_version 815413 (0.0008) [2023-12-28 01:06:51,787][106226] Updated weights for policy 0, policy_version 815423 (0.0009) [2023-12-28 01:06:51,947][106225] Updated weights for policy 1, policy_version 817452 (0.0008) [2023-12-28 01:06:52,005][106225] Updated weights for policy 1, policy_version 817462 (0.0010) [2023-12-28 01:06:52,065][106225] Updated weights for policy 1, policy_version 817472 (0.0010) [2023-12-28 01:06:52,500][106226] Updated weights for policy 0, policy_version 815433 (0.0007) [2023-12-28 01:06:52,560][106226] Updated weights for policy 0, policy_version 815443 (0.0005) [2023-12-28 01:06:52,616][106226] Updated weights for policy 0, policy_version 815453 (0.0005) [2023-12-28 01:06:52,674][106226] Updated weights for policy 0, policy_version 815463 (0.0005) [2023-12-28 01:06:52,759][106225] Updated weights for policy 1, policy_version 817482 (0.0010) [2023-12-28 01:06:52,807][106225] Updated weights for policy 1, policy_version 817492 (0.0010) [2023-12-28 01:06:52,859][106225] Updated weights for policy 1, policy_version 817502 (0.0010) [2023-12-28 01:06:52,916][106225] Updated weights for policy 1, policy_version 817512 (0.0010) [2023-12-28 01:06:53,311][106226] Updated weights for policy 0, policy_version 815473 (0.0007) [2023-12-28 01:06:53,361][106226] Updated weights for policy 0, policy_version 815483 (0.0007) [2023-12-28 01:06:53,407][106226] Updated weights for policy 0, policy_version 815493 (0.0007) [2023-12-28 01:06:53,598][106225] Updated weights for policy 1, policy_version 817522 (0.0010) [2023-12-28 01:06:53,656][106225] Updated weights for policy 1, policy_version 817532 (0.0010) [2023-12-28 01:06:53,713][106225] Updated weights for policy 1, policy_version 817542 (0.0010) [2023-12-28 01:06:54,098][106226] Updated weights for policy 0, policy_version 815503 (0.0007) [2023-12-28 01:06:54,150][106226] Updated weights for policy 0, policy_version 815513 (0.0008) [2023-12-28 01:06:54,199][106226] Updated weights for policy 0, policy_version 815523 (0.0008) [2023-12-28 01:06:54,383][106225] Updated weights for policy 1, policy_version 817552 (0.0010) [2023-12-28 01:06:54,451][106225] Updated weights for policy 1, policy_version 817562 (0.0010) [2023-12-28 01:06:54,503][106225] Updated weights for policy 1, policy_version 817572 (0.0010) [2023-12-28 01:06:54,938][106226] Updated weights for policy 0, policy_version 815533 (0.0006) [2023-12-28 01:06:54,994][106226] Updated weights for policy 0, policy_version 815543 (0.0007) [2023-12-28 01:06:55,047][106226] Updated weights for policy 0, policy_version 815553 (0.0008) [2023-12-28 01:06:55,188][106225] Updated weights for policy 1, policy_version 817582 (0.0010) [2023-12-28 01:06:55,251][106225] Updated weights for policy 1, policy_version 817592 (0.0008) [2023-12-28 01:06:55,314][106225] Updated weights for policy 1, policy_version 817602 (0.0010) [2023-12-28 01:06:55,744][106226] Updated weights for policy 0, policy_version 815563 (0.0008) [2023-12-28 01:06:55,802][106226] Updated weights for policy 0, policy_version 815573 (0.0008) [2023-12-28 01:06:55,861][106226] Updated weights for policy 0, policy_version 815583 (0.0007) [2023-12-28 01:06:56,001][106225] Updated weights for policy 1, policy_version 817612 (0.0010) [2023-12-28 01:06:56,056][106225] Updated weights for policy 1, policy_version 817622 (0.0010) [2023-12-28 01:06:56,115][106225] Updated weights for policy 1, policy_version 817632 (0.0009) [2023-12-28 01:06:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 418201600. Throughput: 0: 10036.8, 1: 9770.4. Samples: 418164200. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:06:56,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.440')] [2023-12-28 01:06:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000815592_208846848.pth... [2023-12-28 01:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000817640_209354752.pth... [2023-12-28 01:06:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000814408_208543744.pth [2023-12-28 01:06:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000816488_209059840.pth [2023-12-28 01:06:56,463][106226] Updated weights for policy 0, policy_version 815593 (0.0005) [2023-12-28 01:06:56,520][106226] Updated weights for policy 0, policy_version 815603 (0.0008) [2023-12-28 01:06:56,579][106226] Updated weights for policy 0, policy_version 815613 (0.0006) [2023-12-28 01:06:56,648][106226] Updated weights for policy 0, policy_version 815623 (0.0005) [2023-12-28 01:06:56,737][106225] Updated weights for policy 1, policy_version 817643 (0.0007) [2023-12-28 01:06:56,788][106225] Updated weights for policy 1, policy_version 817653 (0.0006) [2023-12-28 01:06:56,839][106225] Updated weights for policy 1, policy_version 817663 (0.0007) [2023-12-28 01:06:57,202][106226] Updated weights for policy 0, policy_version 815633 (0.0008) [2023-12-28 01:06:57,250][106226] Updated weights for policy 0, policy_version 815643 (0.0008) [2023-12-28 01:06:57,305][106226] Updated weights for policy 0, policy_version 815654 (0.0009) [2023-12-28 01:06:57,356][106225] Updated weights for policy 1, policy_version 817673 (0.0006) [2023-12-28 01:06:57,410][106225] Updated weights for policy 1, policy_version 817683 (0.0008) [2023-12-28 01:06:57,469][106225] Updated weights for policy 1, policy_version 817693 (0.0008) [2023-12-28 01:06:57,532][106225] Updated weights for policy 1, policy_version 817703 (0.0006) [2023-12-28 01:06:58,023][106226] Updated weights for policy 0, policy_version 815664 (0.0010) [2023-12-28 01:06:58,079][106226] Updated weights for policy 0, policy_version 815674 (0.0010) [2023-12-28 01:06:58,138][106226] Updated weights for policy 0, policy_version 815684 (0.0010) [2023-12-28 01:06:58,163][106225] Updated weights for policy 1, policy_version 817713 (0.0010) [2023-12-28 01:06:58,227][106225] Updated weights for policy 1, policy_version 817723 (0.0010) [2023-12-28 01:06:58,297][106225] Updated weights for policy 1, policy_version 817733 (0.0008) [2023-12-28 01:06:59,040][106226] Updated weights for policy 0, policy_version 815694 (0.0010) [2023-12-28 01:06:59,097][106226] Updated weights for policy 0, policy_version 815704 (0.0008) [2023-12-28 01:06:59,126][106225] Updated weights for policy 1, policy_version 817743 (0.0007) [2023-12-28 01:06:59,163][106226] Updated weights for policy 0, policy_version 815714 (0.0005) [2023-12-28 01:06:59,184][106225] Updated weights for policy 1, policy_version 817753 (0.0007) [2023-12-28 01:06:59,252][106225] Updated weights for policy 1, policy_version 817763 (0.0009) [2023-12-28 01:06:59,878][106226] Updated weights for policy 0, policy_version 815724 (0.0006) [2023-12-28 01:06:59,941][106226] Updated weights for policy 0, policy_version 815734 (0.0007) [2023-12-28 01:06:59,999][106226] Updated weights for policy 0, policy_version 815744 (0.0006) [2023-12-28 01:07:00,019][106225] Updated weights for policy 1, policy_version 817773 (0.0008) [2023-12-28 01:07:00,067][106225] Updated weights for policy 1, policy_version 817783 (0.0008) [2023-12-28 01:07:00,117][106225] Updated weights for policy 1, policy_version 817793 (0.0008) [2023-12-28 01:07:00,658][106226] Updated weights for policy 0, policy_version 815754 (0.0006) [2023-12-28 01:07:00,723][106226] Updated weights for policy 0, policy_version 815764 (0.0008) [2023-12-28 01:07:00,790][106226] Updated weights for policy 0, policy_version 815774 (0.0008) [2023-12-28 01:07:00,820][106225] Updated weights for policy 1, policy_version 817804 (0.0007) [2023-12-28 01:07:00,851][106226] Updated weights for policy 0, policy_version 815784 (0.0007) [2023-12-28 01:07:00,876][106225] Updated weights for policy 1, policy_version 817814 (0.0007) [2023-12-28 01:07:00,926][106225] Updated weights for policy 1, policy_version 817824 (0.0008) [2023-12-28 01:07:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 418299904. Throughput: 0: 10106.4, 1: 9835.2. Samples: 418285328. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:01,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.110')] [2023-12-28 01:07:01,614][106226] Updated weights for policy 0, policy_version 815794 (0.0009) [2023-12-28 01:07:01,667][106226] Updated weights for policy 0, policy_version 815804 (0.0007) [2023-12-28 01:07:01,723][106226] Updated weights for policy 0, policy_version 815814 (0.0008) [2023-12-28 01:07:01,765][106225] Updated weights for policy 1, policy_version 817834 (0.0009) [2023-12-28 01:07:01,820][106225] Updated weights for policy 1, policy_version 817844 (0.0009) [2023-12-28 01:07:01,887][106225] Updated weights for policy 1, policy_version 817854 (0.0009) [2023-12-28 01:07:01,951][106225] Updated weights for policy 1, policy_version 817864 (0.0010) [2023-12-28 01:07:02,343][106226] Updated weights for policy 0, policy_version 815824 (0.0007) [2023-12-28 01:07:02,403][106226] Updated weights for policy 0, policy_version 815834 (0.0009) [2023-12-28 01:07:02,459][106226] Updated weights for policy 0, policy_version 815844 (0.0007) [2023-12-28 01:07:02,688][106225] Updated weights for policy 1, policy_version 817874 (0.0009) [2023-12-28 01:07:02,733][106225] Updated weights for policy 1, policy_version 817884 (0.0009) [2023-12-28 01:07:02,781][106225] Updated weights for policy 1, policy_version 817894 (0.0008) [2023-12-28 01:07:03,169][106226] Updated weights for policy 0, policy_version 815854 (0.0010) [2023-12-28 01:07:03,232][106226] Updated weights for policy 0, policy_version 815864 (0.0010) [2023-12-28 01:07:03,292][106226] Updated weights for policy 0, policy_version 815874 (0.0008) [2023-12-28 01:07:03,533][106225] Updated weights for policy 1, policy_version 817904 (0.0010) [2023-12-28 01:07:03,583][106225] Updated weights for policy 1, policy_version 817914 (0.0007) [2023-12-28 01:07:03,633][106225] Updated weights for policy 1, policy_version 817924 (0.0008) [2023-12-28 01:07:03,986][106226] Updated weights for policy 0, policy_version 815884 (0.0010) [2023-12-28 01:07:04,045][106226] Updated weights for policy 0, policy_version 815894 (0.0008) [2023-12-28 01:07:04,112][106226] Updated weights for policy 0, policy_version 815904 (0.0007) [2023-12-28 01:07:04,411][106225] Updated weights for policy 1, policy_version 817934 (0.0008) [2023-12-28 01:07:04,475][106225] Updated weights for policy 1, policy_version 817944 (0.0008) [2023-12-28 01:07:04,534][106225] Updated weights for policy 1, policy_version 817954 (0.0009) [2023-12-28 01:07:04,813][106226] Updated weights for policy 0, policy_version 815914 (0.0009) [2023-12-28 01:07:04,880][106226] Updated weights for policy 0, policy_version 815924 (0.0008) [2023-12-28 01:07:04,944][106226] Updated weights for policy 0, policy_version 815934 (0.0009) [2023-12-28 01:07:05,012][106226] Updated weights for policy 0, policy_version 815944 (0.0007) [2023-12-28 01:07:05,258][106225] Updated weights for policy 1, policy_version 817964 (0.0008) [2023-12-28 01:07:05,322][106225] Updated weights for policy 1, policy_version 817974 (0.0008) [2023-12-28 01:07:05,382][106225] Updated weights for policy 1, policy_version 817984 (0.0008) [2023-12-28 01:07:05,660][106226] Updated weights for policy 0, policy_version 815954 (0.0005) [2023-12-28 01:07:05,711][106226] Updated weights for policy 0, policy_version 815964 (0.0006) [2023-12-28 01:07:05,757][106226] Updated weights for policy 0, policy_version 815974 (0.0005) [2023-12-28 01:07:06,159][106225] Updated weights for policy 1, policy_version 817994 (0.0010) [2023-12-28 01:07:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 418390016. Throughput: 0: 10115.6, 1: 9752.5. Samples: 418402296. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:06,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.153')] [2023-12-28 01:07:06,225][106225] Updated weights for policy 1, policy_version 818004 (0.0008) [2023-12-28 01:07:06,289][106225] Updated weights for policy 1, policy_version 818014 (0.0009) [2023-12-28 01:07:06,357][106225] Updated weights for policy 1, policy_version 818024 (0.0009) [2023-12-28 01:07:06,438][106226] Updated weights for policy 0, policy_version 815984 (0.0010) [2023-12-28 01:07:06,500][106226] Updated weights for policy 0, policy_version 815994 (0.0011) [2023-12-28 01:07:06,560][106226] Updated weights for policy 0, policy_version 816004 (0.0011) [2023-12-28 01:07:07,023][106225] Updated weights for policy 1, policy_version 818034 (0.0010) [2023-12-28 01:07:07,086][106225] Updated weights for policy 1, policy_version 818044 (0.0010) [2023-12-28 01:07:07,135][106225] Updated weights for policy 1, policy_version 818054 (0.0008) [2023-12-28 01:07:07,170][106226] Updated weights for policy 0, policy_version 816014 (0.0008) [2023-12-28 01:07:07,230][106226] Updated weights for policy 0, policy_version 816024 (0.0006) [2023-12-28 01:07:07,290][106226] Updated weights for policy 0, policy_version 816034 (0.0005) [2023-12-28 01:07:07,801][106226] Updated weights for policy 0, policy_version 816044 (0.0005) [2023-12-28 01:07:07,856][106226] Updated weights for policy 0, policy_version 816054 (0.0005) [2023-12-28 01:07:07,905][106226] Updated weights for policy 0, policy_version 816064 (0.0005) [2023-12-28 01:07:07,963][106225] Updated weights for policy 1, policy_version 818064 (0.0009) [2023-12-28 01:07:08,011][106225] Updated weights for policy 1, policy_version 818074 (0.0008) [2023-12-28 01:07:08,056][106225] Updated weights for policy 1, policy_version 818084 (0.0008) [2023-12-28 01:07:08,606][106226] Updated weights for policy 0, policy_version 816074 (0.0006) [2023-12-28 01:07:08,660][106226] Updated weights for policy 0, policy_version 816084 (0.0009) [2023-12-28 01:07:08,706][106226] Updated weights for policy 0, policy_version 816094 (0.0008) [2023-12-28 01:07:08,769][106226] Updated weights for policy 0, policy_version 816104 (0.0009) [2023-12-28 01:07:08,848][106225] Updated weights for policy 1, policy_version 818094 (0.0008) [2023-12-28 01:07:08,914][106225] Updated weights for policy 1, policy_version 818104 (0.0009) [2023-12-28 01:07:08,968][106225] Updated weights for policy 1, policy_version 818114 (0.0008) [2023-12-28 01:07:09,533][106226] Updated weights for policy 0, policy_version 816114 (0.0010) [2023-12-28 01:07:09,598][106226] Updated weights for policy 0, policy_version 816124 (0.0009) [2023-12-28 01:07:09,657][106226] Updated weights for policy 0, policy_version 816134 (0.0009) [2023-12-28 01:07:09,716][106225] Updated weights for policy 1, policy_version 818124 (0.0008) [2023-12-28 01:07:09,775][106225] Updated weights for policy 1, policy_version 818134 (0.0008) [2023-12-28 01:07:09,844][106225] Updated weights for policy 1, policy_version 818144 (0.0008) [2023-12-28 01:07:10,434][106226] Updated weights for policy 0, policy_version 816144 (0.0009) [2023-12-28 01:07:10,484][106226] Updated weights for policy 0, policy_version 816154 (0.0008) [2023-12-28 01:07:10,534][106226] Updated weights for policy 0, policy_version 816164 (0.0008) [2023-12-28 01:07:10,557][106225] Updated weights for policy 1, policy_version 818154 (0.0008) [2023-12-28 01:07:10,611][106225] Updated weights for policy 1, policy_version 818164 (0.0006) [2023-12-28 01:07:10,668][106225] Updated weights for policy 1, policy_version 818174 (0.0005) [2023-12-28 01:07:10,738][106225] Updated weights for policy 1, policy_version 818184 (0.0005) [2023-12-28 01:07:11,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 418488320. Throughput: 0: 10193.0, 1: 9718.5. Samples: 418462072. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:11,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.872')] [2023-12-28 01:07:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000818184_209494016.pth... [2023-12-28 01:07:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000816168_208994304.pth... [2023-12-28 01:07:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000817064_209207296.pth [2023-12-28 01:07:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000814984_208691200.pth [2023-12-28 01:07:11,302][106225] Updated weights for policy 1, policy_version 818194 (0.0008) [2023-12-28 01:07:11,362][106225] Updated weights for policy 1, policy_version 818204 (0.0008) [2023-12-28 01:07:11,403][106226] Updated weights for policy 0, policy_version 816174 (0.0008) [2023-12-28 01:07:11,427][106225] Updated weights for policy 1, policy_version 818214 (0.0008) [2023-12-28 01:07:11,470][106226] Updated weights for policy 0, policy_version 816184 (0.0008) [2023-12-28 01:07:11,529][106226] Updated weights for policy 0, policy_version 816194 (0.0008) [2023-12-28 01:07:12,148][106225] Updated weights for policy 1, policy_version 818224 (0.0006) [2023-12-28 01:07:12,218][106225] Updated weights for policy 1, policy_version 818234 (0.0006) [2023-12-28 01:07:12,282][106225] Updated weights for policy 1, policy_version 818244 (0.0008) [2023-12-28 01:07:12,310][106226] Updated weights for policy 0, policy_version 816204 (0.0006) [2023-12-28 01:07:12,384][106226] Updated weights for policy 0, policy_version 816214 (0.0008) [2023-12-28 01:07:12,442][106226] Updated weights for policy 0, policy_version 816224 (0.0008) [2023-12-28 01:07:12,982][106225] Updated weights for policy 1, policy_version 818254 (0.0009) [2023-12-28 01:07:13,035][106225] Updated weights for policy 1, policy_version 818264 (0.0008) [2023-12-28 01:07:13,091][106225] Updated weights for policy 1, policy_version 818274 (0.0009) [2023-12-28 01:07:13,160][106226] Updated weights for policy 0, policy_version 816234 (0.0008) [2023-12-28 01:07:13,219][106226] Updated weights for policy 0, policy_version 816244 (0.0009) [2023-12-28 01:07:13,269][106226] Updated weights for policy 0, policy_version 816254 (0.0008) [2023-12-28 01:07:13,317][106226] Updated weights for policy 0, policy_version 816264 (0.0009) [2023-12-28 01:07:13,774][106225] Updated weights for policy 1, policy_version 818284 (0.0008) [2023-12-28 01:07:13,828][106225] Updated weights for policy 1, policy_version 818294 (0.0009) [2023-12-28 01:07:13,888][106225] Updated weights for policy 1, policy_version 818304 (0.0009) [2023-12-28 01:07:14,106][106226] Updated weights for policy 0, policy_version 816274 (0.0009) [2023-12-28 01:07:14,162][106226] Updated weights for policy 0, policy_version 816284 (0.0009) [2023-12-28 01:07:14,214][106226] Updated weights for policy 0, policy_version 816294 (0.0008) [2023-12-28 01:07:14,584][106225] Updated weights for policy 1, policy_version 818314 (0.0009) [2023-12-28 01:07:14,652][106225] Updated weights for policy 1, policy_version 818324 (0.0011) [2023-12-28 01:07:14,699][106225] Updated weights for policy 1, policy_version 818334 (0.0010) [2023-12-28 01:07:14,752][106225] Updated weights for policy 1, policy_version 818344 (0.0010) [2023-12-28 01:07:14,948][106226] Updated weights for policy 0, policy_version 816304 (0.0007) [2023-12-28 01:07:15,015][106226] Updated weights for policy 0, policy_version 816314 (0.0007) [2023-12-28 01:07:15,080][106226] Updated weights for policy 0, policy_version 816324 (0.0006) [2023-12-28 01:07:15,530][106225] Updated weights for policy 1, policy_version 818354 (0.0008) [2023-12-28 01:07:15,587][106225] Updated weights for policy 1, policy_version 818364 (0.0008) [2023-12-28 01:07:15,647][106225] Updated weights for policy 1, policy_version 818374 (0.0008) [2023-12-28 01:07:15,737][106226] Updated weights for policy 0, policy_version 816334 (0.0008) [2023-12-28 01:07:15,792][106226] Updated weights for policy 0, policy_version 816344 (0.0008) [2023-12-28 01:07:15,857][106226] Updated weights for policy 0, policy_version 816354 (0.0009) [2023-12-28 01:07:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 418586624. Throughput: 0: 10083.4, 1: 9739.2. Samples: 418576400. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:16,176][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.851')] [2023-12-28 01:07:16,366][106225] Updated weights for policy 1, policy_version 818384 (0.0010) [2023-12-28 01:07:16,434][106225] Updated weights for policy 1, policy_version 818394 (0.0007) [2023-12-28 01:07:16,497][106225] Updated weights for policy 1, policy_version 818404 (0.0006) [2023-12-28 01:07:16,539][106226] Updated weights for policy 0, policy_version 816364 (0.0007) [2023-12-28 01:07:16,592][106226] Updated weights for policy 0, policy_version 816374 (0.0005) [2023-12-28 01:07:16,655][106226] Updated weights for policy 0, policy_version 816384 (0.0005) [2023-12-28 01:07:17,150][106225] Updated weights for policy 1, policy_version 818414 (0.0010) [2023-12-28 01:07:17,199][106225] Updated weights for policy 1, policy_version 818424 (0.0008) [2023-12-28 01:07:17,250][106225] Updated weights for policy 1, policy_version 818434 (0.0009) [2023-12-28 01:07:17,253][106226] Updated weights for policy 0, policy_version 816394 (0.0006) [2023-12-28 01:07:17,312][106226] Updated weights for policy 0, policy_version 816404 (0.0007) [2023-12-28 01:07:17,369][106226] Updated weights for policy 0, policy_version 816414 (0.0008) [2023-12-28 01:07:17,430][106226] Updated weights for policy 0, policy_version 816424 (0.0008) [2023-12-28 01:07:17,922][106225] Updated weights for policy 1, policy_version 818444 (0.0008) [2023-12-28 01:07:17,978][106225] Updated weights for policy 1, policy_version 818454 (0.0010) [2023-12-28 01:07:18,036][106225] Updated weights for policy 1, policy_version 818464 (0.0009) [2023-12-28 01:07:18,143][106226] Updated weights for policy 0, policy_version 816434 (0.0005) [2023-12-28 01:07:18,193][106226] Updated weights for policy 0, policy_version 816444 (0.0005) [2023-12-28 01:07:18,241][106226] Updated weights for policy 0, policy_version 816454 (0.0007) [2023-12-28 01:07:18,734][106225] Updated weights for policy 1, policy_version 818474 (0.0010) [2023-12-28 01:07:18,795][106225] Updated weights for policy 1, policy_version 818484 (0.0010) [2023-12-28 01:07:18,855][106225] Updated weights for policy 1, policy_version 818494 (0.0010) [2023-12-28 01:07:18,915][106225] Updated weights for policy 1, policy_version 818504 (0.0010) [2023-12-28 01:07:18,968][106226] Updated weights for policy 0, policy_version 816464 (0.0007) [2023-12-28 01:07:19,022][106226] Updated weights for policy 0, policy_version 816474 (0.0008) [2023-12-28 01:07:19,076][106226] Updated weights for policy 0, policy_version 816484 (0.0008) [2023-12-28 01:07:19,676][106225] Updated weights for policy 1, policy_version 818514 (0.0011) [2023-12-28 01:07:19,740][106225] Updated weights for policy 1, policy_version 818524 (0.0010) [2023-12-28 01:07:19,807][106225] Updated weights for policy 1, policy_version 818534 (0.0006) [2023-12-28 01:07:19,880][106226] Updated weights for policy 0, policy_version 816494 (0.0009) [2023-12-28 01:07:19,947][106226] Updated weights for policy 0, policy_version 816504 (0.0008) [2023-12-28 01:07:20,015][106226] Updated weights for policy 0, policy_version 816514 (0.0008) [2023-12-28 01:07:20,533][106225] Updated weights for policy 1, policy_version 818544 (0.0008) [2023-12-28 01:07:20,591][106225] Updated weights for policy 1, policy_version 818554 (0.0008) [2023-12-28 01:07:20,651][106225] Updated weights for policy 1, policy_version 818564 (0.0008) [2023-12-28 01:07:20,749][106226] Updated weights for policy 0, policy_version 816524 (0.0009) [2023-12-28 01:07:20,816][106226] Updated weights for policy 0, policy_version 816534 (0.0008) [2023-12-28 01:07:20,875][106226] Updated weights for policy 0, policy_version 816544 (0.0008) [2023-12-28 01:07:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 418684928. Throughput: 0: 9995.3, 1: 9640.0. Samples: 418692272. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:21,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-5.148')] [2023-12-28 01:07:21,454][106225] Updated weights for policy 1, policy_version 818574 (0.0008) [2023-12-28 01:07:21,515][106225] Updated weights for policy 1, policy_version 818584 (0.0008) [2023-12-28 01:07:21,575][106225] Updated weights for policy 1, policy_version 818594 (0.0008) [2023-12-28 01:07:21,644][106226] Updated weights for policy 0, policy_version 816554 (0.0009) [2023-12-28 01:07:21,709][106226] Updated weights for policy 0, policy_version 816564 (0.0007) [2023-12-28 01:07:21,789][106226] Updated weights for policy 0, policy_version 816574 (0.0006) [2023-12-28 01:07:21,853][106226] Updated weights for policy 0, policy_version 816584 (0.0007) [2023-12-28 01:07:22,300][106225] Updated weights for policy 1, policy_version 818604 (0.0008) [2023-12-28 01:07:22,365][106225] Updated weights for policy 1, policy_version 818614 (0.0008) [2023-12-28 01:07:22,424][106225] Updated weights for policy 1, policy_version 818624 (0.0007) [2023-12-28 01:07:22,616][106226] Updated weights for policy 0, policy_version 816594 (0.0009) [2023-12-28 01:07:22,670][106226] Updated weights for policy 0, policy_version 816604 (0.0009) [2023-12-28 01:07:22,722][106226] Updated weights for policy 0, policy_version 816614 (0.0009) [2023-12-28 01:07:23,050][106225] Updated weights for policy 1, policy_version 818634 (0.0007) [2023-12-28 01:07:23,103][106225] Updated weights for policy 1, policy_version 818644 (0.0007) [2023-12-28 01:07:23,158][106225] Updated weights for policy 1, policy_version 818654 (0.0008) [2023-12-28 01:07:23,210][106225] Updated weights for policy 1, policy_version 818664 (0.0008) [2023-12-28 01:07:23,514][106226] Updated weights for policy 0, policy_version 816624 (0.0008) [2023-12-28 01:07:23,574][106226] Updated weights for policy 0, policy_version 816634 (0.0009) [2023-12-28 01:07:23,631][106226] Updated weights for policy 0, policy_version 816644 (0.0008) [2023-12-28 01:07:23,909][106225] Updated weights for policy 1, policy_version 818674 (0.0007) [2023-12-28 01:07:23,968][106225] Updated weights for policy 1, policy_version 818684 (0.0008) [2023-12-28 01:07:24,029][106225] Updated weights for policy 1, policy_version 818694 (0.0008) [2023-12-28 01:07:24,371][106226] Updated weights for policy 0, policy_version 816654 (0.0008) [2023-12-28 01:07:24,419][106226] Updated weights for policy 0, policy_version 816664 (0.0005) [2023-12-28 01:07:24,467][106226] Updated weights for policy 0, policy_version 816674 (0.0005) [2023-12-28 01:07:24,729][106225] Updated weights for policy 1, policy_version 818704 (0.0006) [2023-12-28 01:07:24,784][106225] Updated weights for policy 1, policy_version 818714 (0.0005) [2023-12-28 01:07:24,846][106225] Updated weights for policy 1, policy_version 818724 (0.0005) [2023-12-28 01:07:25,207][106226] Updated weights for policy 0, policy_version 816684 (0.0006) [2023-12-28 01:07:25,260][106226] Updated weights for policy 0, policy_version 816694 (0.0005) [2023-12-28 01:07:25,313][106226] Updated weights for policy 0, policy_version 816704 (0.0005) [2023-12-28 01:07:25,453][106225] Updated weights for policy 1, policy_version 818734 (0.0007) [2023-12-28 01:07:25,497][106225] Updated weights for policy 1, policy_version 818744 (0.0005) [2023-12-28 01:07:25,551][106225] Updated weights for policy 1, policy_version 818754 (0.0006) [2023-12-28 01:07:25,966][106226] Updated weights for policy 0, policy_version 816714 (0.0007) [2023-12-28 01:07:26,023][106226] Updated weights for policy 0, policy_version 816724 (0.0006) [2023-12-28 01:07:26,083][106226] Updated weights for policy 0, policy_version 816734 (0.0009) [2023-12-28 01:07:26,142][106226] Updated weights for policy 0, policy_version 816744 (0.0009) [2023-12-28 01:07:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 418783232. Throughput: 0: 9893.8, 1: 9616.9. Samples: 418749180. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:26,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-5.118')] [2023-12-28 01:07:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000818760_209641472.pth... [2023-12-28 01:07:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000816744_209141760.pth... [2023-12-28 01:07:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000817640_209354752.pth [2023-12-28 01:07:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000815592_208846848.pth [2023-12-28 01:07:26,246][106225] Updated weights for policy 1, policy_version 818765 (0.0008) [2023-12-28 01:07:26,290][106225] Updated weights for policy 1, policy_version 818775 (0.0005) [2023-12-28 01:07:26,342][106225] Updated weights for policy 1, policy_version 818785 (0.0007) [2023-12-28 01:07:26,771][106226] Updated weights for policy 0, policy_version 816754 (0.0007) [2023-12-28 01:07:26,823][106226] Updated weights for policy 0, policy_version 816764 (0.0005) [2023-12-28 01:07:26,876][106226] Updated weights for policy 0, policy_version 816774 (0.0010) [2023-12-28 01:07:27,033][106225] Updated weights for policy 1, policy_version 818795 (0.0007) [2023-12-28 01:07:27,091][106225] Updated weights for policy 1, policy_version 818805 (0.0010) [2023-12-28 01:07:27,154][106225] Updated weights for policy 1, policy_version 818815 (0.0010) [2023-12-28 01:07:27,451][106226] Updated weights for policy 0, policy_version 816784 (0.0010) [2023-12-28 01:07:27,497][106226] Updated weights for policy 0, policy_version 816794 (0.0010) [2023-12-28 01:07:27,541][106226] Updated weights for policy 0, policy_version 816804 (0.0010) [2023-12-28 01:07:27,694][106225] Updated weights for policy 1, policy_version 818825 (0.0010) [2023-12-28 01:07:27,757][106225] Updated weights for policy 1, policy_version 818835 (0.0005) [2023-12-28 01:07:27,815][106225] Updated weights for policy 1, policy_version 818845 (0.0008) [2023-12-28 01:07:27,861][106225] Updated weights for policy 1, policy_version 818855 (0.0010) [2023-12-28 01:07:28,142][106226] Updated weights for policy 0, policy_version 816814 (0.0010) [2023-12-28 01:07:28,186][106226] Updated weights for policy 0, policy_version 816824 (0.0010) [2023-12-28 01:07:28,238][106226] Updated weights for policy 0, policy_version 816834 (0.0010) [2023-12-28 01:07:28,540][106225] Updated weights for policy 1, policy_version 818865 (0.0008) [2023-12-28 01:07:28,590][106225] Updated weights for policy 1, policy_version 818875 (0.0007) [2023-12-28 01:07:28,647][106225] Updated weights for policy 1, policy_version 818885 (0.0008) [2023-12-28 01:07:28,920][106226] Updated weights for policy 0, policy_version 816844 (0.0008) [2023-12-28 01:07:28,970][106226] Updated weights for policy 0, policy_version 816854 (0.0007) [2023-12-28 01:07:29,022][106226] Updated weights for policy 0, policy_version 816864 (0.0006) [2023-12-28 01:07:29,417][106225] Updated weights for policy 1, policy_version 818895 (0.0008) [2023-12-28 01:07:29,476][106225] Updated weights for policy 1, policy_version 818905 (0.0007) [2023-12-28 01:07:29,545][106225] Updated weights for policy 1, policy_version 818915 (0.0005) [2023-12-28 01:07:29,686][106226] Updated weights for policy 0, policy_version 816874 (0.0006) [2023-12-28 01:07:29,738][106226] Updated weights for policy 0, policy_version 816884 (0.0006) [2023-12-28 01:07:29,797][106226] Updated weights for policy 0, policy_version 816894 (0.0008) [2023-12-28 01:07:29,867][106226] Updated weights for policy 0, policy_version 816904 (0.0008) [2023-12-28 01:07:30,176][106225] Updated weights for policy 1, policy_version 818925 (0.0005) [2023-12-28 01:07:30,239][106225] Updated weights for policy 1, policy_version 818935 (0.0005) [2023-12-28 01:07:30,307][106225] Updated weights for policy 1, policy_version 818945 (0.0005) [2023-12-28 01:07:30,506][106226] Updated weights for policy 0, policy_version 816914 (0.0010) [2023-12-28 01:07:30,553][106226] Updated weights for policy 0, policy_version 816924 (0.0010) [2023-12-28 01:07:30,599][106226] Updated weights for policy 0, policy_version 816934 (0.0007) [2023-12-28 01:07:30,834][106225] Updated weights for policy 1, policy_version 818955 (0.0007) [2023-12-28 01:07:30,884][106225] Updated weights for policy 1, policy_version 818965 (0.0009) [2023-12-28 01:07:30,932][106225] Updated weights for policy 1, policy_version 818975 (0.0005) [2023-12-28 01:07:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 418889728. Throughput: 0: 10007.8, 1: 9713.3. Samples: 418875180. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:31,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-5.193')] [2023-12-28 01:07:31,252][106226] Updated weights for policy 0, policy_version 816944 (0.0008) [2023-12-28 01:07:31,311][106226] Updated weights for policy 0, policy_version 816954 (0.0008) [2023-12-28 01:07:31,375][106226] Updated weights for policy 0, policy_version 816964 (0.0008) [2023-12-28 01:07:31,760][106225] Updated weights for policy 1, policy_version 818985 (0.0010) [2023-12-28 01:07:31,824][106225] Updated weights for policy 1, policy_version 818995 (0.0010) [2023-12-28 01:07:31,877][106225] Updated weights for policy 1, policy_version 819005 (0.0010) [2023-12-28 01:07:31,930][106225] Updated weights for policy 1, policy_version 819015 (0.0006) [2023-12-28 01:07:31,999][106226] Updated weights for policy 0, policy_version 816974 (0.0008) [2023-12-28 01:07:32,053][106226] Updated weights for policy 0, policy_version 816984 (0.0008) [2023-12-28 01:07:32,114][106226] Updated weights for policy 0, policy_version 816994 (0.0008) [2023-12-28 01:07:32,598][106225] Updated weights for policy 1, policy_version 819025 (0.0010) [2023-12-28 01:07:32,648][106225] Updated weights for policy 1, policy_version 819035 (0.0010) [2023-12-28 01:07:32,708][106225] Updated weights for policy 1, policy_version 819045 (0.0010) [2023-12-28 01:07:32,883][106226] Updated weights for policy 0, policy_version 817004 (0.0008) [2023-12-28 01:07:32,941][106226] Updated weights for policy 0, policy_version 817014 (0.0008) [2023-12-28 01:07:32,997][106226] Updated weights for policy 0, policy_version 817024 (0.0007) [2023-12-28 01:07:33,372][106225] Updated weights for policy 1, policy_version 819055 (0.0007) [2023-12-28 01:07:33,421][106225] Updated weights for policy 1, policy_version 819065 (0.0010) [2023-12-28 01:07:33,466][106225] Updated weights for policy 1, policy_version 819075 (0.0010) [2023-12-28 01:07:33,615][106226] Updated weights for policy 0, policy_version 817034 (0.0008) [2023-12-28 01:07:33,666][106226] Updated weights for policy 0, policy_version 817044 (0.0010) [2023-12-28 01:07:33,725][106226] Updated weights for policy 0, policy_version 817054 (0.0010) [2023-12-28 01:07:33,790][106226] Updated weights for policy 0, policy_version 817064 (0.0010) [2023-12-28 01:07:34,171][106225] Updated weights for policy 1, policy_version 819085 (0.0010) [2023-12-28 01:07:34,229][106225] Updated weights for policy 1, policy_version 819095 (0.0008) [2023-12-28 01:07:34,297][106225] Updated weights for policy 1, policy_version 819105 (0.0011) [2023-12-28 01:07:34,461][106226] Updated weights for policy 0, policy_version 817074 (0.0010) [2023-12-28 01:07:34,521][106226] Updated weights for policy 0, policy_version 817084 (0.0011) [2023-12-28 01:07:34,581][106226] Updated weights for policy 0, policy_version 817094 (0.0010) [2023-12-28 01:07:35,021][106225] Updated weights for policy 1, policy_version 819115 (0.0010) [2023-12-28 01:07:35,078][106225] Updated weights for policy 1, policy_version 819125 (0.0010) [2023-12-28 01:07:35,131][106225] Updated weights for policy 1, policy_version 819135 (0.0010) [2023-12-28 01:07:35,276][106226] Updated weights for policy 0, policy_version 817104 (0.0006) [2023-12-28 01:07:35,322][106226] Updated weights for policy 0, policy_version 817114 (0.0005) [2023-12-28 01:07:35,381][106226] Updated weights for policy 0, policy_version 817124 (0.0005) [2023-12-28 01:07:35,785][106225] Updated weights for policy 1, policy_version 819145 (0.0010) [2023-12-28 01:07:35,843][106225] Updated weights for policy 1, policy_version 819155 (0.0005) [2023-12-28 01:07:35,894][106225] Updated weights for policy 1, policy_version 819165 (0.0005) [2023-12-28 01:07:35,944][106226] Updated weights for policy 0, policy_version 817134 (0.0008) [2023-12-28 01:07:35,948][106225] Updated weights for policy 1, policy_version 819175 (0.0005) [2023-12-28 01:07:36,007][106226] Updated weights for policy 0, policy_version 817144 (0.0010) [2023-12-28 01:07:36,064][106226] Updated weights for policy 0, policy_version 817154 (0.0005) [2023-12-28 01:07:36,175][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 418996224. Throughput: 0: 9981.6, 1: 9890.7. Samples: 418999928. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:36,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.267')] [2023-12-28 01:07:36,610][106225] Updated weights for policy 1, policy_version 819185 (0.0008) [2023-12-28 01:07:36,673][106225] Updated weights for policy 1, policy_version 819195 (0.0008) [2023-12-28 01:07:36,734][106225] Updated weights for policy 1, policy_version 819205 (0.0008) [2023-12-28 01:07:36,780][106226] Updated weights for policy 0, policy_version 817164 (0.0007) [2023-12-28 01:07:36,832][106226] Updated weights for policy 0, policy_version 817174 (0.0010) [2023-12-28 01:07:36,882][106226] Updated weights for policy 0, policy_version 817184 (0.0009) [2023-12-28 01:07:37,435][106225] Updated weights for policy 1, policy_version 819215 (0.0008) [2023-12-28 01:07:37,501][106225] Updated weights for policy 1, policy_version 819225 (0.0007) [2023-12-28 01:07:37,543][106226] Updated weights for policy 0, policy_version 817194 (0.0007) [2023-12-28 01:07:37,562][106225] Updated weights for policy 1, policy_version 819235 (0.0008) [2023-12-28 01:07:37,605][106226] Updated weights for policy 0, policy_version 817204 (0.0007) [2023-12-28 01:07:37,678][106226] Updated weights for policy 0, policy_version 817214 (0.0005) [2023-12-28 01:07:37,740][106226] Updated weights for policy 0, policy_version 817224 (0.0006) [2023-12-28 01:07:38,289][106225] Updated weights for policy 1, policy_version 819245 (0.0007) [2023-12-28 01:07:38,327][106226] Updated weights for policy 0, policy_version 817234 (0.0007) [2023-12-28 01:07:38,350][106225] Updated weights for policy 1, policy_version 819255 (0.0007) [2023-12-28 01:07:38,390][106226] Updated weights for policy 0, policy_version 817244 (0.0008) [2023-12-28 01:07:38,415][106225] Updated weights for policy 1, policy_version 819265 (0.0008) [2023-12-28 01:07:38,437][106226] Updated weights for policy 0, policy_version 817254 (0.0008) [2023-12-28 01:07:39,103][106225] Updated weights for policy 1, policy_version 819275 (0.0009) [2023-12-28 01:07:39,159][106226] Updated weights for policy 0, policy_version 817264 (0.0005) [2023-12-28 01:07:39,161][106225] Updated weights for policy 1, policy_version 819285 (0.0010) [2023-12-28 01:07:39,216][106225] Updated weights for policy 1, policy_version 819295 (0.0010) [2023-12-28 01:07:39,222][106226] Updated weights for policy 0, policy_version 817274 (0.0006) [2023-12-28 01:07:39,289][106226] Updated weights for policy 0, policy_version 817284 (0.0008) [2023-12-28 01:07:39,959][106225] Updated weights for policy 1, policy_version 819305 (0.0007) [2023-12-28 01:07:39,977][106226] Updated weights for policy 0, policy_version 817294 (0.0011) [2023-12-28 01:07:40,019][106225] Updated weights for policy 1, policy_version 819315 (0.0006) [2023-12-28 01:07:40,043][106226] Updated weights for policy 0, policy_version 817304 (0.0008) [2023-12-28 01:07:40,079][106225] Updated weights for policy 1, policy_version 819325 (0.0008) [2023-12-28 01:07:40,103][106226] Updated weights for policy 0, policy_version 817314 (0.0008) [2023-12-28 01:07:40,150][106225] Updated weights for policy 1, policy_version 819336 (0.0009) [2023-12-28 01:07:40,834][106226] Updated weights for policy 0, policy_version 817324 (0.0011) [2023-12-28 01:07:40,867][106225] Updated weights for policy 1, policy_version 819346 (0.0009) [2023-12-28 01:07:40,892][106226] Updated weights for policy 0, policy_version 817334 (0.0011) [2023-12-28 01:07:40,926][106225] Updated weights for policy 1, policy_version 819356 (0.0008) [2023-12-28 01:07:40,949][106226] Updated weights for policy 0, policy_version 817344 (0.0010) [2023-12-28 01:07:40,977][106225] Updated weights for policy 1, policy_version 819366 (0.0010) [2023-12-28 01:07:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 419094528. Throughput: 0: 10015.6, 1: 9900.9. Samples: 419060440. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:41,175][105115] Avg episode reward: [(0, '-4.297'), (1, '-5.028')] [2023-12-28 01:07:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000819368_209797120.pth... [2023-12-28 01:07:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000817352_209297408.pth... [2023-12-28 01:07:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000816168_208994304.pth [2023-12-28 01:07:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000818184_209494016.pth [2023-12-28 01:07:41,702][106225] Updated weights for policy 1, policy_version 819376 (0.0009) [2023-12-28 01:07:41,714][106226] Updated weights for policy 0, policy_version 817354 (0.0011) [2023-12-28 01:07:41,775][106225] Updated weights for policy 1, policy_version 819386 (0.0009) [2023-12-28 01:07:41,788][106226] Updated weights for policy 0, policy_version 817364 (0.0009) [2023-12-28 01:07:41,831][106225] Updated weights for policy 1, policy_version 819396 (0.0008) [2023-12-28 01:07:41,851][106226] Updated weights for policy 0, policy_version 817374 (0.0008) [2023-12-28 01:07:41,911][106226] Updated weights for policy 0, policy_version 817384 (0.0008) [2023-12-28 01:07:42,534][106225] Updated weights for policy 1, policy_version 819406 (0.0008) [2023-12-28 01:07:42,588][106225] Updated weights for policy 1, policy_version 819416 (0.0010) [2023-12-28 01:07:42,649][106225] Updated weights for policy 1, policy_version 819426 (0.0010) [2023-12-28 01:07:42,669][106226] Updated weights for policy 0, policy_version 817394 (0.0011) [2023-12-28 01:07:42,759][106226] Updated weights for policy 0, policy_version 817404 (0.0011) [2023-12-28 01:07:42,819][106226] Updated weights for policy 0, policy_version 817414 (0.0011) [2023-12-28 01:07:43,361][106225] Updated weights for policy 1, policy_version 819436 (0.0011) [2023-12-28 01:07:43,414][106225] Updated weights for policy 1, policy_version 819446 (0.0010) [2023-12-28 01:07:43,427][106226] Updated weights for policy 0, policy_version 817424 (0.0006) [2023-12-28 01:07:43,471][106225] Updated weights for policy 1, policy_version 819456 (0.0010) [2023-12-28 01:07:43,482][106226] Updated weights for policy 0, policy_version 817434 (0.0006) [2023-12-28 01:07:43,540][106226] Updated weights for policy 0, policy_version 817444 (0.0008) [2023-12-28 01:07:44,075][106225] Updated weights for policy 1, policy_version 819466 (0.0009) [2023-12-28 01:07:44,136][106225] Updated weights for policy 1, policy_version 819476 (0.0005) [2023-12-28 01:07:44,206][106225] Updated weights for policy 1, policy_version 819486 (0.0006) [2023-12-28 01:07:44,273][106225] Updated weights for policy 1, policy_version 819496 (0.0006) [2023-12-28 01:07:44,306][106226] Updated weights for policy 0, policy_version 817454 (0.0006) [2023-12-28 01:07:44,355][106226] Updated weights for policy 0, policy_version 817464 (0.0006) [2023-12-28 01:07:44,408][106226] Updated weights for policy 0, policy_version 817474 (0.0006) [2023-12-28 01:07:44,823][106225] Updated weights for policy 1, policy_version 819506 (0.0011) [2023-12-28 01:07:44,888][106225] Updated weights for policy 1, policy_version 819516 (0.0010) [2023-12-28 01:07:44,952][106225] Updated weights for policy 1, policy_version 819526 (0.0010) [2023-12-28 01:07:45,069][106226] Updated weights for policy 0, policy_version 817484 (0.0007) [2023-12-28 01:07:45,138][106226] Updated weights for policy 0, policy_version 817494 (0.0009) [2023-12-28 01:07:45,199][106226] Updated weights for policy 0, policy_version 817504 (0.0008) [2023-12-28 01:07:45,669][106225] Updated weights for policy 1, policy_version 819536 (0.0006) [2023-12-28 01:07:45,721][106225] Updated weights for policy 1, policy_version 819546 (0.0007) [2023-12-28 01:07:45,775][106225] Updated weights for policy 1, policy_version 819556 (0.0007) [2023-12-28 01:07:45,969][106226] Updated weights for policy 0, policy_version 817514 (0.0008) [2023-12-28 01:07:46,032][106226] Updated weights for policy 0, policy_version 817524 (0.0006) [2023-12-28 01:07:46,092][106226] Updated weights for policy 0, policy_version 817534 (0.0006) [2023-12-28 01:07:46,149][106226] Updated weights for policy 0, policy_version 817544 (0.0005) [2023-12-28 01:07:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 419192832. Throughput: 0: 9993.3, 1: 9875.1. Samples: 419179404. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:46,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-4.909')] [2023-12-28 01:07:46,416][106225] Updated weights for policy 1, policy_version 819566 (0.0008) [2023-12-28 01:07:46,469][106225] Updated weights for policy 1, policy_version 819576 (0.0008) [2023-12-28 01:07:46,527][106225] Updated weights for policy 1, policy_version 819586 (0.0007) [2023-12-28 01:07:46,748][106226] Updated weights for policy 0, policy_version 817554 (0.0007) [2023-12-28 01:07:46,800][106226] Updated weights for policy 0, policy_version 817564 (0.0006) [2023-12-28 01:07:46,855][106226] Updated weights for policy 0, policy_version 817574 (0.0005) [2023-12-28 01:07:47,248][106225] Updated weights for policy 1, policy_version 819596 (0.0008) [2023-12-28 01:07:47,306][106225] Updated weights for policy 1, policy_version 819606 (0.0006) [2023-12-28 01:07:47,349][106225] Updated weights for policy 1, policy_version 819616 (0.0005) [2023-12-28 01:07:47,591][106226] Updated weights for policy 0, policy_version 817584 (0.0009) [2023-12-28 01:07:47,657][106226] Updated weights for policy 0, policy_version 817594 (0.0006) [2023-12-28 01:07:47,720][106226] Updated weights for policy 0, policy_version 817604 (0.0006) [2023-12-28 01:07:48,058][106225] Updated weights for policy 1, policy_version 819626 (0.0006) [2023-12-28 01:07:48,114][106225] Updated weights for policy 1, policy_version 819636 (0.0010) [2023-12-28 01:07:48,162][106225] Updated weights for policy 1, policy_version 819646 (0.0008) [2023-12-28 01:07:48,216][106225] Updated weights for policy 1, policy_version 819656 (0.0006) [2023-12-28 01:07:48,321][106226] Updated weights for policy 0, policy_version 817614 (0.0008) [2023-12-28 01:07:48,387][106226] Updated weights for policy 0, policy_version 817624 (0.0008) [2023-12-28 01:07:48,452][106226] Updated weights for policy 0, policy_version 817634 (0.0006) [2023-12-28 01:07:49,043][106226] Updated weights for policy 0, policy_version 817644 (0.0006) [2023-12-28 01:07:49,051][106225] Updated weights for policy 1, policy_version 819666 (0.0008) [2023-12-28 01:07:49,096][106226] Updated weights for policy 0, policy_version 817654 (0.0007) [2023-12-28 01:07:49,102][106225] Updated weights for policy 1, policy_version 819676 (0.0007) [2023-12-28 01:07:49,141][106226] Updated weights for policy 0, policy_version 817664 (0.0005) [2023-12-28 01:07:49,157][106225] Updated weights for policy 1, policy_version 819686 (0.0007) [2023-12-28 01:07:49,889][106226] Updated weights for policy 0, policy_version 817674 (0.0005) [2023-12-28 01:07:49,938][106225] Updated weights for policy 1, policy_version 819696 (0.0009) [2023-12-28 01:07:49,958][106226] Updated weights for policy 0, policy_version 817684 (0.0008) [2023-12-28 01:07:50,003][106225] Updated weights for policy 1, policy_version 819706 (0.0008) [2023-12-28 01:07:50,025][106226] Updated weights for policy 0, policy_version 817694 (0.0007) [2023-12-28 01:07:50,068][106225] Updated weights for policy 1, policy_version 819716 (0.0007) [2023-12-28 01:07:50,091][106226] Updated weights for policy 0, policy_version 817704 (0.0007) [2023-12-28 01:07:50,664][106226] Updated weights for policy 0, policy_version 817714 (0.0007) [2023-12-28 01:07:50,730][106226] Updated weights for policy 0, policy_version 817724 (0.0008) [2023-12-28 01:07:50,789][106226] Updated weights for policy 0, policy_version 817734 (0.0009) [2023-12-28 01:07:50,861][106225] Updated weights for policy 1, policy_version 819726 (0.0009) [2023-12-28 01:07:50,924][106225] Updated weights for policy 1, policy_version 819736 (0.0008) [2023-12-28 01:07:50,984][106225] Updated weights for policy 1, policy_version 819746 (0.0009) [2023-12-28 01:07:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 419291136. Throughput: 0: 10004.5, 1: 9889.2. Samples: 419297516. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:51,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.947')] [2023-12-28 01:07:51,470][106226] Updated weights for policy 0, policy_version 817744 (0.0009) [2023-12-28 01:07:51,530][106226] Updated weights for policy 0, policy_version 817754 (0.0010) [2023-12-28 01:07:51,592][106226] Updated weights for policy 0, policy_version 817764 (0.0008) [2023-12-28 01:07:51,868][106225] Updated weights for policy 1, policy_version 819756 (0.0007) [2023-12-28 01:07:51,921][106225] Updated weights for policy 1, policy_version 819766 (0.0006) [2023-12-28 01:07:51,983][106225] Updated weights for policy 1, policy_version 819776 (0.0009) [2023-12-28 01:07:52,301][106226] Updated weights for policy 0, policy_version 817774 (0.0007) [2023-12-28 01:07:52,366][106226] Updated weights for policy 0, policy_version 817784 (0.0008) [2023-12-28 01:07:52,428][106226] Updated weights for policy 0, policy_version 817794 (0.0008) [2023-12-28 01:07:52,716][106225] Updated weights for policy 1, policy_version 819786 (0.0008) [2023-12-28 01:07:52,766][106225] Updated weights for policy 1, policy_version 819796 (0.0006) [2023-12-28 01:07:52,821][106225] Updated weights for policy 1, policy_version 819806 (0.0007) [2023-12-28 01:07:52,875][106225] Updated weights for policy 1, policy_version 819816 (0.0005) [2023-12-28 01:07:53,105][106226] Updated weights for policy 0, policy_version 817804 (0.0006) [2023-12-28 01:07:53,169][106226] Updated weights for policy 0, policy_version 817814 (0.0007) [2023-12-28 01:07:53,229][106226] Updated weights for policy 0, policy_version 817824 (0.0008) [2023-12-28 01:07:53,556][106225] Updated weights for policy 1, policy_version 819826 (0.0008) [2023-12-28 01:07:53,607][106225] Updated weights for policy 1, policy_version 819836 (0.0008) [2023-12-28 01:07:53,673][106225] Updated weights for policy 1, policy_version 819846 (0.0008) [2023-12-28 01:07:53,933][106226] Updated weights for policy 0, policy_version 817834 (0.0009) [2023-12-28 01:07:53,995][106226] Updated weights for policy 0, policy_version 817844 (0.0009) [2023-12-28 01:07:54,056][106226] Updated weights for policy 0, policy_version 817854 (0.0008) [2023-12-28 01:07:54,115][106226] Updated weights for policy 0, policy_version 817864 (0.0009) [2023-12-28 01:07:54,386][106225] Updated weights for policy 1, policy_version 819856 (0.0006) [2023-12-28 01:07:54,456][106225] Updated weights for policy 1, policy_version 819866 (0.0005) [2023-12-28 01:07:54,524][106225] Updated weights for policy 1, policy_version 819876 (0.0006) [2023-12-28 01:07:54,755][106226] Updated weights for policy 0, policy_version 817874 (0.0006) [2023-12-28 01:07:54,813][106226] Updated weights for policy 0, policy_version 817884 (0.0006) [2023-12-28 01:07:54,872][106226] Updated weights for policy 0, policy_version 817894 (0.0006) [2023-12-28 01:07:55,072][106225] Updated weights for policy 1, policy_version 819886 (0.0007) [2023-12-28 01:07:55,129][106225] Updated weights for policy 1, policy_version 819896 (0.0008) [2023-12-28 01:07:55,186][106225] Updated weights for policy 1, policy_version 819906 (0.0008) [2023-12-28 01:07:55,553][106226] Updated weights for policy 0, policy_version 817904 (0.0006) [2023-12-28 01:07:55,616][106226] Updated weights for policy 0, policy_version 817914 (0.0005) [2023-12-28 01:07:55,674][106226] Updated weights for policy 0, policy_version 817924 (0.0005) [2023-12-28 01:07:55,943][106225] Updated weights for policy 1, policy_version 819916 (0.0008) [2023-12-28 01:07:56,005][106225] Updated weights for policy 1, policy_version 819926 (0.0007) [2023-12-28 01:07:56,068][106225] Updated weights for policy 1, policy_version 819936 (0.0007) [2023-12-28 01:07:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 419389440. Throughput: 0: 9941.5, 1: 9903.3. Samples: 419355088. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:07:56,175][105115] Avg episode reward: [(0, '-4.270'), (1, '-5.122')] [2023-12-28 01:07:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000819944_209944576.pth... [2023-12-28 01:07:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000817928_209444864.pth... [2023-12-28 01:07:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000816744_209141760.pth [2023-12-28 01:07:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000818760_209641472.pth [2023-12-28 01:07:56,279][106226] Updated weights for policy 0, policy_version 817934 (0.0005) [2023-12-28 01:07:56,329][106226] Updated weights for policy 0, policy_version 817944 (0.0005) [2023-12-28 01:07:56,386][106226] Updated weights for policy 0, policy_version 817954 (0.0007) [2023-12-28 01:07:56,823][106225] Updated weights for policy 1, policy_version 819946 (0.0008) [2023-12-28 01:07:56,884][106225] Updated weights for policy 1, policy_version 819956 (0.0008) [2023-12-28 01:07:56,937][106225] Updated weights for policy 1, policy_version 819966 (0.0009) [2023-12-28 01:07:56,991][106225] Updated weights for policy 1, policy_version 819976 (0.0006) [2023-12-28 01:07:57,009][106226] Updated weights for policy 0, policy_version 817964 (0.0007) [2023-12-28 01:07:57,065][106226] Updated weights for policy 0, policy_version 817974 (0.0010) [2023-12-28 01:07:57,115][106226] Updated weights for policy 0, policy_version 817984 (0.0010) [2023-12-28 01:07:57,626][106225] Updated weights for policy 1, policy_version 819986 (0.0010) [2023-12-28 01:07:57,687][106225] Updated weights for policy 1, policy_version 819996 (0.0010) [2023-12-28 01:07:57,724][106226] Updated weights for policy 0, policy_version 817994 (0.0005) [2023-12-28 01:07:57,744][106225] Updated weights for policy 1, policy_version 820006 (0.0010) [2023-12-28 01:07:57,789][106226] Updated weights for policy 0, policy_version 818004 (0.0005) [2023-12-28 01:07:57,852][106226] Updated weights for policy 0, policy_version 818014 (0.0008) [2023-12-28 01:07:57,903][106226] Updated weights for policy 0, policy_version 818024 (0.0010) [2023-12-28 01:07:58,386][106225] Updated weights for policy 1, policy_version 820016 (0.0008) [2023-12-28 01:07:58,457][106225] Updated weights for policy 1, policy_version 820026 (0.0009) [2023-12-28 01:07:58,519][106225] Updated weights for policy 1, policy_version 820036 (0.0011) [2023-12-28 01:07:58,626][106226] Updated weights for policy 0, policy_version 818034 (0.0010) [2023-12-28 01:07:58,692][106226] Updated weights for policy 0, policy_version 818044 (0.0010) [2023-12-28 01:07:58,758][106226] Updated weights for policy 0, policy_version 818054 (0.0008) [2023-12-28 01:07:59,382][106225] Updated weights for policy 1, policy_version 820046 (0.0010) [2023-12-28 01:07:59,446][106225] Updated weights for policy 1, policy_version 820056 (0.0009) [2023-12-28 01:07:59,505][106225] Updated weights for policy 1, policy_version 820066 (0.0009) [2023-12-28 01:07:59,657][106226] Updated weights for policy 0, policy_version 818064 (0.0007) [2023-12-28 01:07:59,715][106226] Updated weights for policy 0, policy_version 818074 (0.0009) [2023-12-28 01:07:59,775][106226] Updated weights for policy 0, policy_version 818084 (0.0009) [2023-12-28 01:08:00,271][106225] Updated weights for policy 1, policy_version 820076 (0.0007) [2023-12-28 01:08:00,340][106225] Updated weights for policy 1, policy_version 820086 (0.0007) [2023-12-28 01:08:00,393][106225] Updated weights for policy 1, policy_version 820096 (0.0006) [2023-12-28 01:08:00,520][106226] Updated weights for policy 0, policy_version 818094 (0.0006) [2023-12-28 01:08:00,583][106226] Updated weights for policy 0, policy_version 818104 (0.0005) [2023-12-28 01:08:00,640][106226] Updated weights for policy 0, policy_version 818114 (0.0005) [2023-12-28 01:08:00,962][106225] Updated weights for policy 1, policy_version 820106 (0.0007) [2023-12-28 01:08:01,011][106225] Updated weights for policy 1, policy_version 820116 (0.0010) [2023-12-28 01:08:01,080][106225] Updated weights for policy 1, policy_version 820126 (0.0010) [2023-12-28 01:08:01,150][106225] Updated weights for policy 1, policy_version 820136 (0.0010) [2023-12-28 01:08:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 419487744. Throughput: 0: 10077.0, 1: 9888.2. Samples: 419474832. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:01,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.856')] [2023-12-28 01:08:01,192][106226] Updated weights for policy 0, policy_version 818124 (0.0007) [2023-12-28 01:08:01,243][106226] Updated weights for policy 0, policy_version 818134 (0.0008) [2023-12-28 01:08:01,304][106226] Updated weights for policy 0, policy_version 818144 (0.0008) [2023-12-28 01:08:01,847][106225] Updated weights for policy 1, policy_version 820146 (0.0007) [2023-12-28 01:08:01,907][106225] Updated weights for policy 1, policy_version 820156 (0.0007) [2023-12-28 01:08:01,973][106225] Updated weights for policy 1, policy_version 820166 (0.0006) [2023-12-28 01:08:02,066][106226] Updated weights for policy 0, policy_version 818154 (0.0008) [2023-12-28 01:08:02,132][106226] Updated weights for policy 0, policy_version 818164 (0.0009) [2023-12-28 01:08:02,191][106226] Updated weights for policy 0, policy_version 818174 (0.0009) [2023-12-28 01:08:02,253][106226] Updated weights for policy 0, policy_version 818184 (0.0009) [2023-12-28 01:08:02,652][106225] Updated weights for policy 1, policy_version 820176 (0.0006) [2023-12-28 01:08:02,714][106225] Updated weights for policy 1, policy_version 820186 (0.0006) [2023-12-28 01:08:02,774][106225] Updated weights for policy 1, policy_version 820196 (0.0005) [2023-12-28 01:08:03,012][106226] Updated weights for policy 0, policy_version 818194 (0.0006) [2023-12-28 01:08:03,063][106226] Updated weights for policy 0, policy_version 818204 (0.0005) [2023-12-28 01:08:03,112][106226] Updated weights for policy 0, policy_version 818214 (0.0009) [2023-12-28 01:08:03,398][106225] Updated weights for policy 1, policy_version 820206 (0.0006) [2023-12-28 01:08:03,457][106225] Updated weights for policy 1, policy_version 820216 (0.0005) [2023-12-28 01:08:03,502][106225] Updated weights for policy 1, policy_version 820226 (0.0005) [2023-12-28 01:08:03,856][106226] Updated weights for policy 0, policy_version 818224 (0.0008) [2023-12-28 01:08:03,914][106226] Updated weights for policy 0, policy_version 818234 (0.0010) [2023-12-28 01:08:03,976][106226] Updated weights for policy 0, policy_version 818244 (0.0008) [2023-12-28 01:08:04,127][106225] Updated weights for policy 1, policy_version 820236 (0.0006) [2023-12-28 01:08:04,188][106225] Updated weights for policy 1, policy_version 820246 (0.0005) [2023-12-28 01:08:04,254][106225] Updated weights for policy 1, policy_version 820256 (0.0009) [2023-12-28 01:08:04,723][106226] Updated weights for policy 0, policy_version 818254 (0.0006) [2023-12-28 01:08:04,774][106226] Updated weights for policy 0, policy_version 818264 (0.0005) [2023-12-28 01:08:04,830][106226] Updated weights for policy 0, policy_version 818274 (0.0005) [2023-12-28 01:08:04,864][106225] Updated weights for policy 1, policy_version 820266 (0.0010) [2023-12-28 01:08:04,919][106225] Updated weights for policy 1, policy_version 820276 (0.0005) [2023-12-28 01:08:04,972][106225] Updated weights for policy 1, policy_version 820286 (0.0005) [2023-12-28 01:08:05,024][106225] Updated weights for policy 1, policy_version 820296 (0.0005) [2023-12-28 01:08:05,494][106226] Updated weights for policy 0, policy_version 818284 (0.0006) [2023-12-28 01:08:05,547][106226] Updated weights for policy 0, policy_version 818294 (0.0010) [2023-12-28 01:08:05,593][106226] Updated weights for policy 0, policy_version 818304 (0.0008) [2023-12-28 01:08:05,595][106225] Updated weights for policy 1, policy_version 820306 (0.0005) [2023-12-28 01:08:05,645][106225] Updated weights for policy 1, policy_version 820316 (0.0006) [2023-12-28 01:08:05,701][106225] Updated weights for policy 1, policy_version 820326 (0.0007) [2023-12-28 01:08:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 419586048. Throughput: 0: 10096.1, 1: 10042.6. Samples: 419598512. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:06,175][105115] Avg episode reward: [(0, '-4.107'), (1, '-4.628')] [2023-12-28 01:08:06,261][106226] Updated weights for policy 0, policy_version 818314 (0.0005) [2023-12-28 01:08:06,323][106226] Updated weights for policy 0, policy_version 818324 (0.0007) [2023-12-28 01:08:06,366][106225] Updated weights for policy 1, policy_version 820336 (0.0011) [2023-12-28 01:08:06,390][106226] Updated weights for policy 0, policy_version 818334 (0.0010) [2023-12-28 01:08:06,432][106225] Updated weights for policy 1, policy_version 820346 (0.0010) [2023-12-28 01:08:06,461][106226] Updated weights for policy 0, policy_version 818344 (0.0007) [2023-12-28 01:08:06,498][106225] Updated weights for policy 1, policy_version 820356 (0.0011) [2023-12-28 01:08:07,074][106226] Updated weights for policy 0, policy_version 818354 (0.0006) [2023-12-28 01:08:07,133][106226] Updated weights for policy 0, policy_version 818364 (0.0006) [2023-12-28 01:08:07,175][106225] Updated weights for policy 1, policy_version 820366 (0.0007) [2023-12-28 01:08:07,181][106226] Updated weights for policy 0, policy_version 818374 (0.0008) [2023-12-28 01:08:07,235][106225] Updated weights for policy 1, policy_version 820376 (0.0005) [2023-12-28 01:08:07,296][106225] Updated weights for policy 1, policy_version 820386 (0.0008) [2023-12-28 01:08:07,801][106226] Updated weights for policy 0, policy_version 818384 (0.0008) [2023-12-28 01:08:07,866][106226] Updated weights for policy 0, policy_version 818394 (0.0008) [2023-12-28 01:08:07,929][106226] Updated weights for policy 0, policy_version 818404 (0.0009) [2023-12-28 01:08:07,969][106225] Updated weights for policy 1, policy_version 820396 (0.0008) [2023-12-28 01:08:08,032][106225] Updated weights for policy 1, policy_version 820406 (0.0007) [2023-12-28 01:08:08,088][106225] Updated weights for policy 1, policy_version 820416 (0.0007) [2023-12-28 01:08:08,608][106226] Updated weights for policy 0, policy_version 818414 (0.0007) [2023-12-28 01:08:08,668][106226] Updated weights for policy 0, policy_version 818424 (0.0006) [2023-12-28 01:08:08,725][106226] Updated weights for policy 0, policy_version 818434 (0.0005) [2023-12-28 01:08:08,874][106225] Updated weights for policy 1, policy_version 820426 (0.0009) [2023-12-28 01:08:08,930][106225] Updated weights for policy 1, policy_version 820436 (0.0009) [2023-12-28 01:08:08,985][106225] Updated weights for policy 1, policy_version 820446 (0.0008) [2023-12-28 01:08:09,038][106225] Updated weights for policy 1, policy_version 820456 (0.0005) [2023-12-28 01:08:09,361][106226] Updated weights for policy 0, policy_version 818444 (0.0007) [2023-12-28 01:08:09,434][106226] Updated weights for policy 0, policy_version 818454 (0.0008) [2023-12-28 01:08:09,498][106226] Updated weights for policy 0, policy_version 818464 (0.0009) [2023-12-28 01:08:09,774][106225] Updated weights for policy 1, policy_version 820466 (0.0010) [2023-12-28 01:08:09,838][106225] Updated weights for policy 1, policy_version 820476 (0.0009) [2023-12-28 01:08:09,903][106225] Updated weights for policy 1, policy_version 820486 (0.0007) [2023-12-28 01:08:10,197][106226] Updated weights for policy 0, policy_version 818474 (0.0009) [2023-12-28 01:08:10,261][106226] Updated weights for policy 0, policy_version 818484 (0.0009) [2023-12-28 01:08:10,319][106226] Updated weights for policy 0, policy_version 818494 (0.0007) [2023-12-28 01:08:10,378][106226] Updated weights for policy 0, policy_version 818504 (0.0008) [2023-12-28 01:08:10,655][106225] Updated weights for policy 1, policy_version 820496 (0.0006) [2023-12-28 01:08:10,714][106225] Updated weights for policy 1, policy_version 820506 (0.0005) [2023-12-28 01:08:10,768][106225] Updated weights for policy 1, policy_version 820516 (0.0005) [2023-12-28 01:08:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 419684352. Throughput: 0: 10209.0, 1: 10036.5. Samples: 419660224. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:11,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.971')] [2023-12-28 01:08:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000820520_210092032.pth... [2023-12-28 01:08:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000819368_209797120.pth [2023-12-28 01:08:11,196][106226] Updated weights for policy 0, policy_version 818514 (0.0008) [2023-12-28 01:08:11,264][106226] Updated weights for policy 0, policy_version 818524 (0.0006) [2023-12-28 01:08:11,329][106226] Updated weights for policy 0, policy_version 818534 (0.0008) [2023-12-28 01:08:11,340][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000818536_209600512.pth... [2023-12-28 01:08:11,346][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000817352_209297408.pth [2023-12-28 01:08:11,446][106225] Updated weights for policy 1, policy_version 820526 (0.0007) [2023-12-28 01:08:11,511][106225] Updated weights for policy 1, policy_version 820536 (0.0009) [2023-12-28 01:08:11,571][106225] Updated weights for policy 1, policy_version 820546 (0.0008) [2023-12-28 01:08:12,047][106226] Updated weights for policy 0, policy_version 818544 (0.0008) [2023-12-28 01:08:12,095][106226] Updated weights for policy 0, policy_version 818554 (0.0007) [2023-12-28 01:08:12,142][106226] Updated weights for policy 0, policy_version 818564 (0.0006) [2023-12-28 01:08:12,328][106225] Updated weights for policy 1, policy_version 820556 (0.0009) [2023-12-28 01:08:12,393][106225] Updated weights for policy 1, policy_version 820566 (0.0009) [2023-12-28 01:08:12,455][106225] Updated weights for policy 1, policy_version 820576 (0.0008) [2023-12-28 01:08:12,928][106226] Updated weights for policy 0, policy_version 818574 (0.0009) [2023-12-28 01:08:12,989][106226] Updated weights for policy 0, policy_version 818584 (0.0009) [2023-12-28 01:08:13,052][106226] Updated weights for policy 0, policy_version 818594 (0.0009) [2023-12-28 01:08:13,186][106225] Updated weights for policy 1, policy_version 820586 (0.0008) [2023-12-28 01:08:13,235][106225] Updated weights for policy 1, policy_version 820596 (0.0007) [2023-12-28 01:08:13,291][106225] Updated weights for policy 1, policy_version 820606 (0.0008) [2023-12-28 01:08:13,340][106225] Updated weights for policy 1, policy_version 820616 (0.0009) [2023-12-28 01:08:13,821][106226] Updated weights for policy 0, policy_version 818604 (0.0008) [2023-12-28 01:08:13,879][106226] Updated weights for policy 0, policy_version 818614 (0.0005) [2023-12-28 01:08:13,926][106225] Updated weights for policy 1, policy_version 820626 (0.0005) [2023-12-28 01:08:13,947][106226] Updated weights for policy 0, policy_version 818624 (0.0007) [2023-12-28 01:08:13,987][106225] Updated weights for policy 1, policy_version 820636 (0.0005) [2023-12-28 01:08:14,044][106225] Updated weights for policy 1, policy_version 820646 (0.0006) [2023-12-28 01:08:14,613][106226] Updated weights for policy 0, policy_version 818634 (0.0009) [2023-12-28 01:08:14,672][106226] Updated weights for policy 0, policy_version 818644 (0.0008) [2023-12-28 01:08:14,727][106226] Updated weights for policy 0, policy_version 818654 (0.0008) [2023-12-28 01:08:14,730][106225] Updated weights for policy 1, policy_version 820656 (0.0010) [2023-12-28 01:08:14,788][106226] Updated weights for policy 0, policy_version 818664 (0.0006) [2023-12-28 01:08:14,788][106225] Updated weights for policy 1, policy_version 820666 (0.0010) [2023-12-28 01:08:14,848][106225] Updated weights for policy 1, policy_version 820677 (0.0007) [2023-12-28 01:08:15,456][106226] Updated weights for policy 0, policy_version 818674 (0.0009) [2023-12-28 01:08:15,534][106226] Updated weights for policy 0, policy_version 818684 (0.0006) [2023-12-28 01:08:15,595][106226] Updated weights for policy 0, policy_version 818694 (0.0005) [2023-12-28 01:08:15,610][106225] Updated weights for policy 1, policy_version 820687 (0.0009) [2023-12-28 01:08:15,662][106225] Updated weights for policy 1, policy_version 820697 (0.0007) [2023-12-28 01:08:15,728][106225] Updated weights for policy 1, policy_version 820707 (0.0005) [2023-12-28 01:08:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 419782656. Throughput: 0: 10038.0, 1: 9952.0. Samples: 419774732. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:16,175][105115] Avg episode reward: [(0, '-4.164'), (1, '-4.949')] [2023-12-28 01:08:16,256][106226] Updated weights for policy 0, policy_version 818704 (0.0007) [2023-12-28 01:08:16,321][106226] Updated weights for policy 0, policy_version 818714 (0.0009) [2023-12-28 01:08:16,356][106225] Updated weights for policy 1, policy_version 820717 (0.0008) [2023-12-28 01:08:16,378][106226] Updated weights for policy 0, policy_version 818724 (0.0007) [2023-12-28 01:08:16,414][106225] Updated weights for policy 1, policy_version 820727 (0.0009) [2023-12-28 01:08:16,474][106225] Updated weights for policy 1, policy_version 820737 (0.0010) [2023-12-28 01:08:17,069][106225] Updated weights for policy 1, policy_version 820747 (0.0009) [2023-12-28 01:08:17,094][106226] Updated weights for policy 0, policy_version 818734 (0.0006) [2023-12-28 01:08:17,135][106225] Updated weights for policy 1, policy_version 820757 (0.0007) [2023-12-28 01:08:17,156][106226] Updated weights for policy 0, policy_version 818744 (0.0006) [2023-12-28 01:08:17,185][106225] Updated weights for policy 1, policy_version 820767 (0.0010) [2023-12-28 01:08:17,205][106226] Updated weights for policy 0, policy_version 818754 (0.0005) [2023-12-28 01:08:17,882][106225] Updated weights for policy 1, policy_version 820777 (0.0009) [2023-12-28 01:08:17,895][106226] Updated weights for policy 0, policy_version 818764 (0.0007) [2023-12-28 01:08:17,946][106226] Updated weights for policy 0, policy_version 818774 (0.0009) [2023-12-28 01:08:17,952][106225] Updated weights for policy 1, policy_version 820787 (0.0007) [2023-12-28 01:08:18,000][106226] Updated weights for policy 0, policy_version 818784 (0.0006) [2023-12-28 01:08:18,023][106225] Updated weights for policy 1, policy_version 820797 (0.0010) [2023-12-28 01:08:18,090][106225] Updated weights for policy 1, policy_version 820807 (0.0010) [2023-12-28 01:08:18,734][106226] Updated weights for policy 0, policy_version 818794 (0.0007) [2023-12-28 01:08:18,770][106225] Updated weights for policy 1, policy_version 820817 (0.0006) [2023-12-28 01:08:18,796][106226] Updated weights for policy 0, policy_version 818804 (0.0007) [2023-12-28 01:08:18,830][106225] Updated weights for policy 1, policy_version 820827 (0.0007) [2023-12-28 01:08:18,856][106226] Updated weights for policy 0, policy_version 818814 (0.0008) [2023-12-28 01:08:18,894][106225] Updated weights for policy 1, policy_version 820837 (0.0008) [2023-12-28 01:08:18,916][106226] Updated weights for policy 0, policy_version 818824 (0.0007) [2023-12-28 01:08:19,627][106225] Updated weights for policy 1, policy_version 820847 (0.0007) [2023-12-28 01:08:19,684][106226] Updated weights for policy 0, policy_version 818834 (0.0006) [2023-12-28 01:08:19,690][106225] Updated weights for policy 1, policy_version 820857 (0.0007) [2023-12-28 01:08:19,744][106226] Updated weights for policy 0, policy_version 818844 (0.0006) [2023-12-28 01:08:19,753][106225] Updated weights for policy 1, policy_version 820867 (0.0008) [2023-12-28 01:08:19,811][106226] Updated weights for policy 0, policy_version 818854 (0.0008) [2023-12-28 01:08:20,451][106225] Updated weights for policy 1, policy_version 820877 (0.0008) [2023-12-28 01:08:20,496][106226] Updated weights for policy 0, policy_version 818864 (0.0006) [2023-12-28 01:08:20,515][106225] Updated weights for policy 1, policy_version 820887 (0.0010) [2023-12-28 01:08:20,557][106226] Updated weights for policy 0, policy_version 818874 (0.0007) [2023-12-28 01:08:20,578][106225] Updated weights for policy 1, policy_version 820897 (0.0010) [2023-12-28 01:08:20,622][106226] Updated weights for policy 0, policy_version 818884 (0.0007) [2023-12-28 01:08:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 419880960. Throughput: 0: 9944.0, 1: 9907.6. Samples: 419893252. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:21,175][105115] Avg episode reward: [(0, '-4.290'), (1, '-5.067')] [2023-12-28 01:08:21,299][106226] Updated weights for policy 0, policy_version 818894 (0.0008) [2023-12-28 01:08:21,343][106225] Updated weights for policy 1, policy_version 820907 (0.0010) [2023-12-28 01:08:21,365][106226] Updated weights for policy 0, policy_version 818904 (0.0007) [2023-12-28 01:08:21,417][106225] Updated weights for policy 1, policy_version 820917 (0.0009) [2023-12-28 01:08:21,435][106226] Updated weights for policy 0, policy_version 818914 (0.0008) [2023-12-28 01:08:21,477][106225] Updated weights for policy 1, policy_version 820927 (0.0011) [2023-12-28 01:08:22,168][106226] Updated weights for policy 0, policy_version 818924 (0.0007) [2023-12-28 01:08:22,233][106226] Updated weights for policy 0, policy_version 818934 (0.0006) [2023-12-28 01:08:22,251][106225] Updated weights for policy 1, policy_version 820937 (0.0009) [2023-12-28 01:08:22,300][106226] Updated weights for policy 0, policy_version 818944 (0.0007) [2023-12-28 01:08:22,320][106225] Updated weights for policy 1, policy_version 820947 (0.0008) [2023-12-28 01:08:22,387][106225] Updated weights for policy 1, policy_version 820957 (0.0008) [2023-12-28 01:08:22,451][106225] Updated weights for policy 1, policy_version 820967 (0.0006) [2023-12-28 01:08:22,995][106226] Updated weights for policy 0, policy_version 818954 (0.0007) [2023-12-28 01:08:23,061][106226] Updated weights for policy 0, policy_version 818964 (0.0010) [2023-12-28 01:08:23,087][106225] Updated weights for policy 1, policy_version 820977 (0.0006) [2023-12-28 01:08:23,124][106226] Updated weights for policy 0, policy_version 818974 (0.0006) [2023-12-28 01:08:23,156][106225] Updated weights for policy 1, policy_version 820987 (0.0009) [2023-12-28 01:08:23,183][106226] Updated weights for policy 0, policy_version 818984 (0.0006) [2023-12-28 01:08:23,217][106225] Updated weights for policy 1, policy_version 820997 (0.0007) [2023-12-28 01:08:23,819][106225] Updated weights for policy 1, policy_version 821007 (0.0006) [2023-12-28 01:08:23,874][106225] Updated weights for policy 1, policy_version 821017 (0.0007) [2023-12-28 01:08:23,912][106226] Updated weights for policy 0, policy_version 818994 (0.0007) [2023-12-28 01:08:23,933][106225] Updated weights for policy 1, policy_version 821027 (0.0008) [2023-12-28 01:08:23,973][106226] Updated weights for policy 0, policy_version 819004 (0.0008) [2023-12-28 01:08:24,029][106226] Updated weights for policy 0, policy_version 819014 (0.0009) [2023-12-28 01:08:24,594][106225] Updated weights for policy 1, policy_version 821037 (0.0006) [2023-12-28 01:08:24,652][106225] Updated weights for policy 1, policy_version 821047 (0.0005) [2023-12-28 01:08:24,709][106225] Updated weights for policy 1, policy_version 821057 (0.0005) [2023-12-28 01:08:24,747][106226] Updated weights for policy 0, policy_version 819024 (0.0008) [2023-12-28 01:08:24,799][106226] Updated weights for policy 0, policy_version 819034 (0.0008) [2023-12-28 01:08:24,853][106226] Updated weights for policy 0, policy_version 819044 (0.0008) [2023-12-28 01:08:25,263][106225] Updated weights for policy 1, policy_version 821067 (0.0007) [2023-12-28 01:08:25,319][106225] Updated weights for policy 1, policy_version 821077 (0.0010) [2023-12-28 01:08:25,362][106225] Updated weights for policy 1, policy_version 821087 (0.0010) [2023-12-28 01:08:25,653][106226] Updated weights for policy 0, policy_version 819054 (0.0009) [2023-12-28 01:08:25,706][106226] Updated weights for policy 0, policy_version 819064 (0.0009) [2023-12-28 01:08:25,756][106226] Updated weights for policy 0, policy_version 819074 (0.0008) [2023-12-28 01:08:26,060][106225] Updated weights for policy 1, policy_version 821097 (0.0009) [2023-12-28 01:08:26,114][106225] Updated weights for policy 1, policy_version 821107 (0.0010) [2023-12-28 01:08:26,163][106225] Updated weights for policy 1, policy_version 821117 (0.0010) [2023-12-28 01:08:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 419979264. Throughput: 0: 9876.4, 1: 9926.9. Samples: 419951588. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:26,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-5.095')] [2023-12-28 01:08:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000819080_209739776.pth... [2023-12-28 01:08:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000817928_209444864.pth [2023-12-28 01:08:26,213][106225] Updated weights for policy 1, policy_version 821127 (0.0008) [2023-12-28 01:08:26,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000821128_210247680.pth... [2023-12-28 01:08:26,223][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000819944_209944576.pth [2023-12-28 01:08:26,501][106226] Updated weights for policy 0, policy_version 819084 (0.0008) [2023-12-28 01:08:26,555][106226] Updated weights for policy 0, policy_version 819094 (0.0009) [2023-12-28 01:08:26,609][106226] Updated weights for policy 0, policy_version 819104 (0.0009) [2023-12-28 01:08:26,850][106225] Updated weights for policy 1, policy_version 821137 (0.0006) [2023-12-28 01:08:26,910][106225] Updated weights for policy 1, policy_version 821147 (0.0006) [2023-12-28 01:08:26,965][106225] Updated weights for policy 1, policy_version 821157 (0.0005) [2023-12-28 01:08:27,424][106226] Updated weights for policy 0, policy_version 819114 (0.0010) [2023-12-28 01:08:27,489][106226] Updated weights for policy 0, policy_version 819124 (0.0009) [2023-12-28 01:08:27,525][106225] Updated weights for policy 1, policy_version 821167 (0.0007) [2023-12-28 01:08:27,548][106226] Updated weights for policy 0, policy_version 819134 (0.0008) [2023-12-28 01:08:27,572][106225] Updated weights for policy 1, policy_version 821177 (0.0008) [2023-12-28 01:08:27,605][106226] Updated weights for policy 0, policy_version 819144 (0.0007) [2023-12-28 01:08:27,613][106225] Updated weights for policy 1, policy_version 821187 (0.0008) [2023-12-28 01:08:28,340][106226] Updated weights for policy 0, policy_version 819154 (0.0008) [2023-12-28 01:08:28,350][106225] Updated weights for policy 1, policy_version 821197 (0.0008) [2023-12-28 01:08:28,401][106226] Updated weights for policy 0, policy_version 819164 (0.0007) [2023-12-28 01:08:28,407][106225] Updated weights for policy 1, policy_version 821207 (0.0007) [2023-12-28 01:08:28,455][106225] Updated weights for policy 1, policy_version 821217 (0.0006) [2023-12-28 01:08:28,456][106226] Updated weights for policy 0, policy_version 819174 (0.0006) [2023-12-28 01:08:29,090][106226] Updated weights for policy 0, policy_version 819184 (0.0008) [2023-12-28 01:08:29,145][106226] Updated weights for policy 0, policy_version 819194 (0.0009) [2023-12-28 01:08:29,192][106225] Updated weights for policy 1, policy_version 821227 (0.0008) [2023-12-28 01:08:29,210][106226] Updated weights for policy 0, policy_version 819204 (0.0007) [2023-12-28 01:08:29,251][106225] Updated weights for policy 1, policy_version 821237 (0.0009) [2023-12-28 01:08:29,319][106225] Updated weights for policy 1, policy_version 821247 (0.0008) [2023-12-28 01:08:29,969][106226] Updated weights for policy 0, policy_version 819214 (0.0006) [2023-12-28 01:08:30,028][106226] Updated weights for policy 0, policy_version 819224 (0.0006) [2023-12-28 01:08:30,051][106225] Updated weights for policy 1, policy_version 821257 (0.0008) [2023-12-28 01:08:30,083][106226] Updated weights for policy 0, policy_version 819234 (0.0005) [2023-12-28 01:08:30,115][106225] Updated weights for policy 1, policy_version 821267 (0.0008) [2023-12-28 01:08:30,176][106225] Updated weights for policy 1, policy_version 821277 (0.0010) [2023-12-28 01:08:30,233][106225] Updated weights for policy 1, policy_version 821287 (0.0010) [2023-12-28 01:08:30,633][106226] Updated weights for policy 0, policy_version 819244 (0.0006) [2023-12-28 01:08:30,689][106226] Updated weights for policy 0, policy_version 819254 (0.0006) [2023-12-28 01:08:30,748][106226] Updated weights for policy 0, policy_version 819264 (0.0006) [2023-12-28 01:08:30,991][106225] Updated weights for policy 1, policy_version 821297 (0.0008) [2023-12-28 01:08:31,043][106225] Updated weights for policy 1, policy_version 821307 (0.0008) [2023-12-28 01:08:31,101][106225] Updated weights for policy 1, policy_version 821317 (0.0008) [2023-12-28 01:08:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 420085760. Throughput: 0: 9845.0, 1: 9971.3. Samples: 420071136. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-28 01:08:31,175][105115] Avg episode reward: [(0, '-4.232'), (1, '-5.070')] [2023-12-28 01:08:31,413][106226] Updated weights for policy 0, policy_version 819274 (0.0006) [2023-12-28 01:08:31,465][106226] Updated weights for policy 0, policy_version 819284 (0.0005) [2023-12-28 01:08:31,524][106226] Updated weights for policy 0, policy_version 819294 (0.0005) [2023-12-28 01:08:31,579][106226] Updated weights for policy 0, policy_version 819304 (0.0005) [2023-12-28 01:08:31,831][106225] Updated weights for policy 1, policy_version 821327 (0.0008) [2023-12-28 01:08:31,897][106225] Updated weights for policy 1, policy_version 821337 (0.0006) [2023-12-28 01:08:31,955][106225] Updated weights for policy 1, policy_version 821347 (0.0009) [2023-12-28 01:08:32,298][106226] Updated weights for policy 0, policy_version 819314 (0.0008) [2023-12-28 01:08:32,365][106226] Updated weights for policy 0, policy_version 819324 (0.0011) [2023-12-28 01:08:32,413][106226] Updated weights for policy 0, policy_version 819334 (0.0010) [2023-12-28 01:08:32,678][106225] Updated weights for policy 1, policy_version 821357 (0.0008) [2023-12-28 01:08:32,741][106225] Updated weights for policy 1, policy_version 821367 (0.0008) [2023-12-28 01:08:32,802][106225] Updated weights for policy 1, policy_version 821377 (0.0008) [2023-12-28 01:08:33,138][106226] Updated weights for policy 0, policy_version 819344 (0.0010) [2023-12-28 01:08:33,194][106226] Updated weights for policy 0, policy_version 819354 (0.0010) [2023-12-28 01:08:33,268][106226] Updated weights for policy 0, policy_version 819364 (0.0010) [2023-12-28 01:08:33,500][106225] Updated weights for policy 1, policy_version 821387 (0.0008) [2023-12-28 01:08:33,552][106225] Updated weights for policy 1, policy_version 821397 (0.0007) [2023-12-28 01:08:33,612][106225] Updated weights for policy 1, policy_version 821407 (0.0006) [2023-12-28 01:08:33,944][106226] Updated weights for policy 0, policy_version 819374 (0.0010) [2023-12-28 01:08:33,993][106226] Updated weights for policy 0, policy_version 819384 (0.0010) [2023-12-28 01:08:34,049][106226] Updated weights for policy 0, policy_version 819394 (0.0010) [2023-12-28 01:08:34,351][106225] Updated weights for policy 1, policy_version 821417 (0.0005) [2023-12-28 01:08:34,406][106225] Updated weights for policy 1, policy_version 821427 (0.0007) [2023-12-28 01:08:34,468][106225] Updated weights for policy 1, policy_version 821437 (0.0008) [2023-12-28 01:08:34,529][106225] Updated weights for policy 1, policy_version 821447 (0.0008) [2023-12-28 01:08:34,777][106226] Updated weights for policy 0, policy_version 819404 (0.0010) [2023-12-28 01:08:34,826][106226] Updated weights for policy 0, policy_version 819414 (0.0008) [2023-12-28 01:08:34,872][106226] Updated weights for policy 0, policy_version 819424 (0.0009) [2023-12-28 01:08:35,287][106225] Updated weights for policy 1, policy_version 821457 (0.0009) [2023-12-28 01:08:35,332][106225] Updated weights for policy 1, policy_version 821467 (0.0008) [2023-12-28 01:08:35,376][106225] Updated weights for policy 1, policy_version 821477 (0.0008) [2023-12-28 01:08:35,520][106226] Updated weights for policy 0, policy_version 819434 (0.0008) [2023-12-28 01:08:35,575][106226] Updated weights for policy 0, policy_version 819444 (0.0005) [2023-12-28 01:08:35,631][106226] Updated weights for policy 0, policy_version 819454 (0.0006) [2023-12-28 01:08:35,685][106226] Updated weights for policy 0, policy_version 819464 (0.0006) [2023-12-28 01:08:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 420175872. Throughput: 0: 9867.8, 1: 9973.1. Samples: 420190352. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:08:36,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.839')] [2023-12-28 01:08:36,179][106225] Updated weights for policy 1, policy_version 821487 (0.0008) [2023-12-28 01:08:36,240][106225] Updated weights for policy 1, policy_version 821497 (0.0008) [2023-12-28 01:08:36,289][106225] Updated weights for policy 1, policy_version 821507 (0.0008) [2023-12-28 01:08:36,329][106226] Updated weights for policy 0, policy_version 819474 (0.0011) [2023-12-28 01:08:36,394][106226] Updated weights for policy 0, policy_version 819484 (0.0011) [2023-12-28 01:08:36,449][106226] Updated weights for policy 0, policy_version 819494 (0.0011) [2023-12-28 01:08:37,035][106225] Updated weights for policy 1, policy_version 821517 (0.0007) [2023-12-28 01:08:37,102][106225] Updated weights for policy 1, policy_version 821527 (0.0007) [2023-12-28 01:08:37,170][106225] Updated weights for policy 1, policy_version 821537 (0.0006) [2023-12-28 01:08:37,172][106226] Updated weights for policy 0, policy_version 819504 (0.0010) [2023-12-28 01:08:37,232][106226] Updated weights for policy 0, policy_version 819514 (0.0006) [2023-12-28 01:08:37,296][106226] Updated weights for policy 0, policy_version 819524 (0.0011) [2023-12-28 01:08:37,880][106225] Updated weights for policy 1, policy_version 821547 (0.0007) [2023-12-28 01:08:37,932][106225] Updated weights for policy 1, policy_version 821557 (0.0010) [2023-12-28 01:08:37,986][106226] Updated weights for policy 0, policy_version 819534 (0.0007) [2023-12-28 01:08:37,988][106225] Updated weights for policy 1, policy_version 821567 (0.0008) [2023-12-28 01:08:38,038][106226] Updated weights for policy 0, policy_version 819544 (0.0006) [2023-12-28 01:08:38,091][106226] Updated weights for policy 0, policy_version 819554 (0.0005) [2023-12-28 01:08:38,752][106225] Updated weights for policy 1, policy_version 821577 (0.0008) [2023-12-28 01:08:38,762][106226] Updated weights for policy 0, policy_version 819564 (0.0007) [2023-12-28 01:08:38,818][106225] Updated weights for policy 1, policy_version 821587 (0.0005) [2023-12-28 01:08:38,826][106226] Updated weights for policy 0, policy_version 819574 (0.0008) [2023-12-28 01:08:38,881][106225] Updated weights for policy 1, policy_version 821597 (0.0006) [2023-12-28 01:08:38,896][106226] Updated weights for policy 0, policy_version 819584 (0.0007) [2023-12-28 01:08:38,943][106225] Updated weights for policy 1, policy_version 821607 (0.0006) [2023-12-28 01:08:39,615][106226] Updated weights for policy 0, policy_version 819594 (0.0008) [2023-12-28 01:08:39,677][106226] Updated weights for policy 0, policy_version 819604 (0.0011) [2023-12-28 01:08:39,687][106225] Updated weights for policy 1, policy_version 821617 (0.0006) [2023-12-28 01:08:39,733][106226] Updated weights for policy 0, policy_version 819614 (0.0011) [2023-12-28 01:08:39,750][106225] Updated weights for policy 1, policy_version 821627 (0.0007) [2023-12-28 01:08:39,792][106226] Updated weights for policy 0, policy_version 819624 (0.0011) [2023-12-28 01:08:39,814][106225] Updated weights for policy 1, policy_version 821637 (0.0006) [2023-12-28 01:08:40,538][106226] Updated weights for policy 0, policy_version 819634 (0.0011) [2023-12-28 01:08:40,587][106225] Updated weights for policy 1, policy_version 821647 (0.0006) [2023-12-28 01:08:40,600][106226] Updated weights for policy 0, policy_version 819644 (0.0011) [2023-12-28 01:08:40,637][106225] Updated weights for policy 1, policy_version 821657 (0.0005) [2023-12-28 01:08:40,654][106226] Updated weights for policy 0, policy_version 819654 (0.0011) [2023-12-28 01:08:40,696][106225] Updated weights for policy 1, policy_version 821667 (0.0007) [2023-12-28 01:08:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 420274176. Throughput: 0: 9871.5, 1: 9965.5. Samples: 420247752. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:08:41,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.107')] [2023-12-28 01:08:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000821672_210386944.pth... [2023-12-28 01:08:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000819656_209887232.pth... [2023-12-28 01:08:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000818536_209600512.pth [2023-12-28 01:08:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000820520_210092032.pth [2023-12-28 01:08:41,413][106226] Updated weights for policy 0, policy_version 819664 (0.0010) [2023-12-28 01:08:41,472][106226] Updated weights for policy 0, policy_version 819674 (0.0011) [2023-12-28 01:08:41,531][106225] Updated weights for policy 1, policy_version 821677 (0.0008) [2023-12-28 01:08:41,532][106226] Updated weights for policy 0, policy_version 819684 (0.0011) [2023-12-28 01:08:41,586][106225] Updated weights for policy 1, policy_version 821687 (0.0007) [2023-12-28 01:08:41,650][106225] Updated weights for policy 1, policy_version 821697 (0.0008) [2023-12-28 01:08:42,331][106225] Updated weights for policy 1, policy_version 821707 (0.0008) [2023-12-28 01:08:42,354][106226] Updated weights for policy 0, policy_version 819694 (0.0009) [2023-12-28 01:08:42,402][106225] Updated weights for policy 1, policy_version 821717 (0.0007) [2023-12-28 01:08:42,422][106226] Updated weights for policy 0, policy_version 819704 (0.0009) [2023-12-28 01:08:42,463][106225] Updated weights for policy 1, policy_version 821727 (0.0006) [2023-12-28 01:08:42,484][106226] Updated weights for policy 0, policy_version 819714 (0.0008) [2023-12-28 01:08:43,061][106225] Updated weights for policy 1, policy_version 821737 (0.0006) [2023-12-28 01:08:43,118][106225] Updated weights for policy 1, policy_version 821747 (0.0005) [2023-12-28 01:08:43,174][106225] Updated weights for policy 1, policy_version 821757 (0.0006) [2023-12-28 01:08:43,229][106225] Updated weights for policy 1, policy_version 821767 (0.0005) [2023-12-28 01:08:43,253][106226] Updated weights for policy 0, policy_version 819724 (0.0010) [2023-12-28 01:08:43,303][106226] Updated weights for policy 0, policy_version 819734 (0.0010) [2023-12-28 01:08:43,370][106226] Updated weights for policy 0, policy_version 819744 (0.0011) [2023-12-28 01:08:43,739][106225] Updated weights for policy 1, policy_version 821777 (0.0005) [2023-12-28 01:08:43,789][106225] Updated weights for policy 1, policy_version 821787 (0.0005) [2023-12-28 01:08:43,861][106225] Updated weights for policy 1, policy_version 821797 (0.0006) [2023-12-28 01:08:44,055][106226] Updated weights for policy 0, policy_version 819754 (0.0010) [2023-12-28 01:08:44,112][106226] Updated weights for policy 0, policy_version 819764 (0.0006) [2023-12-28 01:08:44,169][106226] Updated weights for policy 0, policy_version 819774 (0.0008) [2023-12-28 01:08:44,220][106226] Updated weights for policy 0, policy_version 819784 (0.0008) [2023-12-28 01:08:44,441][106225] Updated weights for policy 1, policy_version 821807 (0.0008) [2023-12-28 01:08:44,501][106225] Updated weights for policy 1, policy_version 821817 (0.0008) [2023-12-28 01:08:44,564][106225] Updated weights for policy 1, policy_version 821827 (0.0009) [2023-12-28 01:08:45,038][106226] Updated weights for policy 0, policy_version 819794 (0.0011) [2023-12-28 01:08:45,098][106226] Updated weights for policy 0, policy_version 819804 (0.0011) [2023-12-28 01:08:45,161][106226] Updated weights for policy 0, policy_version 819814 (0.0011) [2023-12-28 01:08:45,262][106225] Updated weights for policy 1, policy_version 821837 (0.0008) [2023-12-28 01:08:45,323][106225] Updated weights for policy 1, policy_version 821847 (0.0009) [2023-12-28 01:08:45,379][106225] Updated weights for policy 1, policy_version 821857 (0.0007) [2023-12-28 01:08:45,800][106226] Updated weights for policy 0, policy_version 819824 (0.0006) [2023-12-28 01:08:45,853][106226] Updated weights for policy 0, policy_version 819834 (0.0005) [2023-12-28 01:08:45,920][106226] Updated weights for policy 0, policy_version 819844 (0.0005) [2023-12-28 01:08:45,956][106225] Updated weights for policy 1, policy_version 821867 (0.0007) [2023-12-28 01:08:46,006][106225] Updated weights for policy 1, policy_version 821877 (0.0005) [2023-12-28 01:08:46,063][106225] Updated weights for policy 1, policy_version 821887 (0.0005) [2023-12-28 01:08:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 420380672. Throughput: 0: 9757.6, 1: 10010.6. Samples: 420364400. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:08:46,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-5.195')] [2023-12-28 01:08:46,490][106226] Updated weights for policy 0, policy_version 819854 (0.0006) [2023-12-28 01:08:46,539][106226] Updated weights for policy 0, policy_version 819864 (0.0005) [2023-12-28 01:08:46,588][106226] Updated weights for policy 0, policy_version 819874 (0.0005) [2023-12-28 01:08:46,598][106225] Updated weights for policy 1, policy_version 821897 (0.0006) [2023-12-28 01:08:46,662][106225] Updated weights for policy 1, policy_version 821907 (0.0008) [2023-12-28 01:08:46,725][106225] Updated weights for policy 1, policy_version 821917 (0.0008) [2023-12-28 01:08:46,777][106225] Updated weights for policy 1, policy_version 821927 (0.0006) [2023-12-28 01:08:47,194][106226] Updated weights for policy 0, policy_version 819884 (0.0007) [2023-12-28 01:08:47,237][106226] Updated weights for policy 0, policy_version 819894 (0.0009) [2023-12-28 01:08:47,291][106226] Updated weights for policy 0, policy_version 819904 (0.0010) [2023-12-28 01:08:47,488][106225] Updated weights for policy 1, policy_version 821937 (0.0006) [2023-12-28 01:08:47,537][106225] Updated weights for policy 1, policy_version 821947 (0.0005) [2023-12-28 01:08:47,596][106225] Updated weights for policy 1, policy_version 821957 (0.0005) [2023-12-28 01:08:48,037][106226] Updated weights for policy 0, policy_version 819914 (0.0011) [2023-12-28 01:08:48,104][106226] Updated weights for policy 0, policy_version 819924 (0.0011) [2023-12-28 01:08:48,139][106225] Updated weights for policy 1, policy_version 821967 (0.0007) [2023-12-28 01:08:48,164][106226] Updated weights for policy 0, policy_version 819934 (0.0011) [2023-12-28 01:08:48,204][106225] Updated weights for policy 1, policy_version 821977 (0.0008) [2023-12-28 01:08:48,232][106226] Updated weights for policy 0, policy_version 819944 (0.0011) [2023-12-28 01:08:48,273][106225] Updated weights for policy 1, policy_version 821987 (0.0008) [2023-12-28 01:08:48,879][106225] Updated weights for policy 1, policy_version 821997 (0.0007) [2023-12-28 01:08:48,918][106226] Updated weights for policy 0, policy_version 819954 (0.0008) [2023-12-28 01:08:48,946][106225] Updated weights for policy 1, policy_version 822007 (0.0008) [2023-12-28 01:08:48,966][106226] Updated weights for policy 0, policy_version 819964 (0.0009) [2023-12-28 01:08:49,010][106225] Updated weights for policy 1, policy_version 822017 (0.0008) [2023-12-28 01:08:49,016][106226] Updated weights for policy 0, policy_version 819974 (0.0007) [2023-12-28 01:08:49,747][106225] Updated weights for policy 1, policy_version 822027 (0.0007) [2023-12-28 01:08:49,809][106225] Updated weights for policy 1, policy_version 822037 (0.0011) [2023-12-28 01:08:49,812][106226] Updated weights for policy 0, policy_version 819984 (0.0007) [2023-12-28 01:08:49,878][106225] Updated weights for policy 1, policy_version 822047 (0.0010) [2023-12-28 01:08:49,884][106226] Updated weights for policy 0, policy_version 819994 (0.0007) [2023-12-28 01:08:49,957][106226] Updated weights for policy 0, policy_version 820004 (0.0008) [2023-12-28 01:08:50,649][106225] Updated weights for policy 1, policy_version 822057 (0.0010) [2023-12-28 01:08:50,668][106226] Updated weights for policy 0, policy_version 820014 (0.0006) [2023-12-28 01:08:50,711][106225] Updated weights for policy 1, policy_version 822067 (0.0008) [2023-12-28 01:08:50,730][106226] Updated weights for policy 0, policy_version 820024 (0.0007) [2023-12-28 01:08:50,773][106225] Updated weights for policy 1, policy_version 822077 (0.0007) [2023-12-28 01:08:50,791][106226] Updated weights for policy 0, policy_version 820034 (0.0010) [2023-12-28 01:08:50,835][106225] Updated weights for policy 1, policy_version 822087 (0.0006) [2023-12-28 01:08:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 420478976. Throughput: 0: 9778.7, 1: 9978.6. Samples: 420487588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:08:51,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-4.990')] [2023-12-28 01:08:51,502][106225] Updated weights for policy 1, policy_version 822097 (0.0009) [2023-12-28 01:08:51,541][106226] Updated weights for policy 0, policy_version 820044 (0.0007) [2023-12-28 01:08:51,565][106225] Updated weights for policy 1, policy_version 822107 (0.0008) [2023-12-28 01:08:51,601][106226] Updated weights for policy 0, policy_version 820054 (0.0006) [2023-12-28 01:08:51,635][106225] Updated weights for policy 1, policy_version 822117 (0.0008) [2023-12-28 01:08:51,661][106226] Updated weights for policy 0, policy_version 820064 (0.0008) [2023-12-28 01:08:52,378][106226] Updated weights for policy 0, policy_version 820074 (0.0008) [2023-12-28 01:08:52,404][106225] Updated weights for policy 1, policy_version 822127 (0.0008) [2023-12-28 01:08:52,446][106226] Updated weights for policy 0, policy_version 820084 (0.0008) [2023-12-28 01:08:52,468][106225] Updated weights for policy 1, policy_version 822137 (0.0007) [2023-12-28 01:08:52,511][106226] Updated weights for policy 0, policy_version 820094 (0.0007) [2023-12-28 01:08:52,532][106225] Updated weights for policy 1, policy_version 822147 (0.0008) [2023-12-28 01:08:52,573][106226] Updated weights for policy 0, policy_version 820104 (0.0007) [2023-12-28 01:08:53,229][106225] Updated weights for policy 1, policy_version 822157 (0.0007) [2023-12-28 01:08:53,284][106226] Updated weights for policy 0, policy_version 820114 (0.0009) [2023-12-28 01:08:53,292][106225] Updated weights for policy 1, policy_version 822167 (0.0005) [2023-12-28 01:08:53,331][106226] Updated weights for policy 0, policy_version 820124 (0.0008) [2023-12-28 01:08:53,342][106225] Updated weights for policy 1, policy_version 822177 (0.0005) [2023-12-28 01:08:53,380][106226] Updated weights for policy 0, policy_version 820134 (0.0008) [2023-12-28 01:08:53,882][106225] Updated weights for policy 1, policy_version 822187 (0.0007) [2023-12-28 01:08:53,929][106225] Updated weights for policy 1, policy_version 822197 (0.0008) [2023-12-28 01:08:53,984][106225] Updated weights for policy 1, policy_version 822207 (0.0008) [2023-12-28 01:08:54,113][106226] Updated weights for policy 0, policy_version 820144 (0.0005) [2023-12-28 01:08:54,179][106226] Updated weights for policy 0, policy_version 820154 (0.0008) [2023-12-28 01:08:54,249][106226] Updated weights for policy 0, policy_version 820164 (0.0007) [2023-12-28 01:08:54,597][106225] Updated weights for policy 1, policy_version 822217 (0.0005) [2023-12-28 01:08:54,648][106225] Updated weights for policy 1, policy_version 822227 (0.0007) [2023-12-28 01:08:54,699][106225] Updated weights for policy 1, policy_version 822237 (0.0008) [2023-12-28 01:08:54,750][106225] Updated weights for policy 1, policy_version 822247 (0.0008) [2023-12-28 01:08:54,927][106226] Updated weights for policy 0, policy_version 820174 (0.0006) [2023-12-28 01:08:54,986][106226] Updated weights for policy 0, policy_version 820184 (0.0007) [2023-12-28 01:08:55,049][106226] Updated weights for policy 0, policy_version 820194 (0.0008) [2023-12-28 01:08:55,392][106225] Updated weights for policy 1, policy_version 822257 (0.0008) [2023-12-28 01:08:55,450][106225] Updated weights for policy 1, policy_version 822267 (0.0009) [2023-12-28 01:08:55,503][106225] Updated weights for policy 1, policy_version 822277 (0.0008) [2023-12-28 01:08:55,731][106226] Updated weights for policy 0, policy_version 820204 (0.0009) [2023-12-28 01:08:55,788][106226] Updated weights for policy 0, policy_version 820214 (0.0008) [2023-12-28 01:08:55,849][106226] Updated weights for policy 0, policy_version 820224 (0.0009) [2023-12-28 01:08:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 420577280. Throughput: 0: 9706.2, 1: 9993.5. Samples: 420546712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:08:56,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-5.036')] [2023-12-28 01:08:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000820232_210034688.pth... [2023-12-28 01:08:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000819080_209739776.pth [2023-12-28 01:08:56,221][106225] Updated weights for policy 1, policy_version 822287 (0.0007) [2023-12-28 01:08:56,270][106225] Updated weights for policy 1, policy_version 822297 (0.0008) [2023-12-28 01:08:56,322][106225] Updated weights for policy 1, policy_version 822307 (0.0009) [2023-12-28 01:08:56,351][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000822312_210550784.pth... [2023-12-28 01:08:56,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000821128_210247680.pth [2023-12-28 01:08:56,479][106226] Updated weights for policy 0, policy_version 820234 (0.0008) [2023-12-28 01:08:56,529][106226] Updated weights for policy 0, policy_version 820244 (0.0005) [2023-12-28 01:08:56,585][106226] Updated weights for policy 0, policy_version 820254 (0.0005) [2023-12-28 01:08:56,642][106226] Updated weights for policy 0, policy_version 820264 (0.0005) [2023-12-28 01:08:57,156][106225] Updated weights for policy 1, policy_version 822317 (0.0009) [2023-12-28 01:08:57,209][106225] Updated weights for policy 1, policy_version 822327 (0.0008) [2023-12-28 01:08:57,225][106226] Updated weights for policy 0, policy_version 820274 (0.0005) [2023-12-28 01:08:57,262][106225] Updated weights for policy 1, policy_version 822337 (0.0008) [2023-12-28 01:08:57,291][106226] Updated weights for policy 0, policy_version 820284 (0.0006) [2023-12-28 01:08:57,351][106226] Updated weights for policy 0, policy_version 820294 (0.0006) [2023-12-28 01:08:57,934][106226] Updated weights for policy 0, policy_version 820304 (0.0006) [2023-12-28 01:08:57,994][106226] Updated weights for policy 0, policy_version 820314 (0.0005) [2023-12-28 01:08:58,046][106225] Updated weights for policy 1, policy_version 822347 (0.0009) [2023-12-28 01:08:58,057][106226] Updated weights for policy 0, policy_version 820324 (0.0005) [2023-12-28 01:08:58,092][106225] Updated weights for policy 1, policy_version 822357 (0.0008) [2023-12-28 01:08:58,146][106225] Updated weights for policy 1, policy_version 822367 (0.0008) [2023-12-28 01:08:58,716][106226] Updated weights for policy 0, policy_version 820334 (0.0007) [2023-12-28 01:08:58,779][106226] Updated weights for policy 0, policy_version 820344 (0.0008) [2023-12-28 01:08:58,847][106226] Updated weights for policy 0, policy_version 820354 (0.0009) [2023-12-28 01:08:58,949][106225] Updated weights for policy 1, policy_version 822377 (0.0008) [2023-12-28 01:08:59,016][106225] Updated weights for policy 1, policy_version 822387 (0.0008) [2023-12-28 01:08:59,080][106225] Updated weights for policy 1, policy_version 822397 (0.0008) [2023-12-28 01:08:59,139][106225] Updated weights for policy 1, policy_version 822407 (0.0009) [2023-12-28 01:08:59,673][106226] Updated weights for policy 0, policy_version 820364 (0.0007) [2023-12-28 01:08:59,734][106226] Updated weights for policy 0, policy_version 820374 (0.0007) [2023-12-28 01:08:59,790][106226] Updated weights for policy 0, policy_version 820384 (0.0006) [2023-12-28 01:08:59,901][106225] Updated weights for policy 1, policy_version 822417 (0.0008) [2023-12-28 01:08:59,965][106225] Updated weights for policy 1, policy_version 822427 (0.0008) [2023-12-28 01:09:00,029][106225] Updated weights for policy 1, policy_version 822437 (0.0006) [2023-12-28 01:09:00,441][106226] Updated weights for policy 0, policy_version 820394 (0.0007) [2023-12-28 01:09:00,494][106226] Updated weights for policy 0, policy_version 820404 (0.0009) [2023-12-28 01:09:00,542][106226] Updated weights for policy 0, policy_version 820414 (0.0008) [2023-12-28 01:09:00,597][106226] Updated weights for policy 0, policy_version 820424 (0.0008) [2023-12-28 01:09:00,715][106225] Updated weights for policy 1, policy_version 822447 (0.0005) [2023-12-28 01:09:00,766][106225] Updated weights for policy 1, policy_version 822457 (0.0005) [2023-12-28 01:09:00,813][106225] Updated weights for policy 1, policy_version 822467 (0.0005) [2023-12-28 01:09:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 420675584. Throughput: 0: 9814.3, 1: 9980.1. Samples: 420665480. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:01,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.285')] [2023-12-28 01:09:01,395][106226] Updated weights for policy 0, policy_version 820434 (0.0007) [2023-12-28 01:09:01,447][106226] Updated weights for policy 0, policy_version 820444 (0.0005) [2023-12-28 01:09:01,453][106225] Updated weights for policy 1, policy_version 822477 (0.0008) [2023-12-28 01:09:01,503][106226] Updated weights for policy 0, policy_version 820454 (0.0006) [2023-12-28 01:09:01,516][106225] Updated weights for policy 1, policy_version 822487 (0.0007) [2023-12-28 01:09:01,575][106225] Updated weights for policy 1, policy_version 822497 (0.0005) [2023-12-28 01:09:02,207][106225] Updated weights for policy 1, policy_version 822507 (0.0008) [2023-12-28 01:09:02,266][106225] Updated weights for policy 1, policy_version 822517 (0.0007) [2023-12-28 01:09:02,270][106226] Updated weights for policy 0, policy_version 820464 (0.0008) [2023-12-28 01:09:02,325][106226] Updated weights for policy 0, policy_version 820474 (0.0008) [2023-12-28 01:09:02,326][106225] Updated weights for policy 1, policy_version 822527 (0.0010) [2023-12-28 01:09:02,391][106226] Updated weights for policy 0, policy_version 820484 (0.0008) [2023-12-28 01:09:02,941][106225] Updated weights for policy 1, policy_version 822537 (0.0011) [2023-12-28 01:09:02,960][106226] Updated weights for policy 0, policy_version 820494 (0.0008) [2023-12-28 01:09:02,987][106225] Updated weights for policy 1, policy_version 822547 (0.0010) [2023-12-28 01:09:03,020][106226] Updated weights for policy 0, policy_version 820504 (0.0010) [2023-12-28 01:09:03,040][106225] Updated weights for policy 1, policy_version 822557 (0.0010) [2023-12-28 01:09:03,078][106226] Updated weights for policy 0, policy_version 820514 (0.0008) [2023-12-28 01:09:03,093][106225] Updated weights for policy 1, policy_version 822567 (0.0010) [2023-12-28 01:09:03,614][106226] Updated weights for policy 0, policy_version 820524 (0.0005) [2023-12-28 01:09:03,672][106226] Updated weights for policy 0, policy_version 820534 (0.0007) [2023-12-28 01:09:03,727][106226] Updated weights for policy 0, policy_version 820544 (0.0010) [2023-12-28 01:09:03,767][106225] Updated weights for policy 1, policy_version 822577 (0.0006) [2023-12-28 01:09:03,825][106225] Updated weights for policy 1, policy_version 822587 (0.0005) [2023-12-28 01:09:03,892][106225] Updated weights for policy 1, policy_version 822597 (0.0009) [2023-12-28 01:09:04,448][106226] Updated weights for policy 0, policy_version 820554 (0.0010) [2023-12-28 01:09:04,502][106226] Updated weights for policy 0, policy_version 820564 (0.0009) [2023-12-28 01:09:04,537][106225] Updated weights for policy 1, policy_version 822607 (0.0007) [2023-12-28 01:09:04,548][106226] Updated weights for policy 0, policy_version 820574 (0.0007) [2023-12-28 01:09:04,589][106225] Updated weights for policy 1, policy_version 822617 (0.0005) [2023-12-28 01:09:04,597][106226] Updated weights for policy 0, policy_version 820584 (0.0008) [2023-12-28 01:09:04,641][106225] Updated weights for policy 1, policy_version 822627 (0.0005) [2023-12-28 01:09:05,247][106225] Updated weights for policy 1, policy_version 822637 (0.0006) [2023-12-28 01:09:05,313][106225] Updated weights for policy 1, policy_version 822647 (0.0006) [2023-12-28 01:09:05,316][106226] Updated weights for policy 0, policy_version 820594 (0.0007) [2023-12-28 01:09:05,367][106225] Updated weights for policy 1, policy_version 822657 (0.0006) [2023-12-28 01:09:05,383][106226] Updated weights for policy 0, policy_version 820604 (0.0008) [2023-12-28 01:09:05,452][106226] Updated weights for policy 0, policy_version 820614 (0.0009) [2023-12-28 01:09:06,049][106226] Updated weights for policy 0, policy_version 820624 (0.0007) [2023-12-28 01:09:06,081][106225] Updated weights for policy 1, policy_version 822667 (0.0007) [2023-12-28 01:09:06,115][106226] Updated weights for policy 0, policy_version 820634 (0.0009) [2023-12-28 01:09:06,149][106225] Updated weights for policy 1, policy_version 822677 (0.0011) [2023-12-28 01:09:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 420773888. Throughput: 0: 9890.0, 1: 10072.7. Samples: 420791576. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:06,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.425')] [2023-12-28 01:09:06,178][106226] Updated weights for policy 0, policy_version 820644 (0.0007) [2023-12-28 01:09:06,210][106225] Updated weights for policy 1, policy_version 822687 (0.0011) [2023-12-28 01:09:06,943][106226] Updated weights for policy 0, policy_version 820654 (0.0007) [2023-12-28 01:09:06,949][106225] Updated weights for policy 1, policy_version 822697 (0.0011) [2023-12-28 01:09:07,003][106225] Updated weights for policy 1, policy_version 822707 (0.0010) [2023-12-28 01:09:07,005][106226] Updated weights for policy 0, policy_version 820664 (0.0005) [2023-12-28 01:09:07,057][106225] Updated weights for policy 1, policy_version 822717 (0.0010) [2023-12-28 01:09:07,070][106226] Updated weights for policy 0, policy_version 820674 (0.0006) [2023-12-28 01:09:07,110][106225] Updated weights for policy 1, policy_version 822727 (0.0010) [2023-12-28 01:09:07,731][106226] Updated weights for policy 0, policy_version 820684 (0.0006) [2023-12-28 01:09:07,768][106225] Updated weights for policy 1, policy_version 822737 (0.0007) [2023-12-28 01:09:07,793][106226] Updated weights for policy 0, policy_version 820694 (0.0009) [2023-12-28 01:09:07,821][106225] Updated weights for policy 1, policy_version 822747 (0.0010) [2023-12-28 01:09:07,854][106226] Updated weights for policy 0, policy_version 820704 (0.0008) [2023-12-28 01:09:07,876][106225] Updated weights for policy 1, policy_version 822757 (0.0010) [2023-12-28 01:09:08,486][106226] Updated weights for policy 0, policy_version 820714 (0.0010) [2023-12-28 01:09:08,531][106225] Updated weights for policy 1, policy_version 822767 (0.0010) [2023-12-28 01:09:08,546][106226] Updated weights for policy 0, policy_version 820724 (0.0010) [2023-12-28 01:09:08,589][106225] Updated weights for policy 1, policy_version 822777 (0.0010) [2023-12-28 01:09:08,612][106226] Updated weights for policy 0, policy_version 820734 (0.0011) [2023-12-28 01:09:08,640][106225] Updated weights for policy 1, policy_version 822787 (0.0010) [2023-12-28 01:09:08,673][106226] Updated weights for policy 0, policy_version 820744 (0.0010) [2023-12-28 01:09:09,318][106225] Updated weights for policy 1, policy_version 822797 (0.0008) [2023-12-28 01:09:09,368][106226] Updated weights for policy 0, policy_version 820754 (0.0008) [2023-12-28 01:09:09,391][106225] Updated weights for policy 1, policy_version 822807 (0.0009) [2023-12-28 01:09:09,442][106226] Updated weights for policy 0, policy_version 820764 (0.0008) [2023-12-28 01:09:09,455][106225] Updated weights for policy 1, policy_version 822817 (0.0008) [2023-12-28 01:09:09,500][106226] Updated weights for policy 0, policy_version 820774 (0.0007) [2023-12-28 01:09:10,157][106225] Updated weights for policy 1, policy_version 822827 (0.0008) [2023-12-28 01:09:10,213][106225] Updated weights for policy 1, policy_version 822837 (0.0006) [2023-12-28 01:09:10,214][106226] Updated weights for policy 0, policy_version 820784 (0.0008) [2023-12-28 01:09:10,268][106225] Updated weights for policy 1, policy_version 822847 (0.0006) [2023-12-28 01:09:10,273][106226] Updated weights for policy 0, policy_version 820794 (0.0009) [2023-12-28 01:09:10,334][106226] Updated weights for policy 0, policy_version 820804 (0.0008) [2023-12-28 01:09:10,913][106225] Updated weights for policy 1, policy_version 822857 (0.0008) [2023-12-28 01:09:10,972][106226] Updated weights for policy 0, policy_version 820814 (0.0009) [2023-12-28 01:09:10,978][106225] Updated weights for policy 1, policy_version 822867 (0.0005) [2023-12-28 01:09:11,040][106225] Updated weights for policy 1, policy_version 822877 (0.0006) [2023-12-28 01:09:11,043][106226] Updated weights for policy 0, policy_version 820826 (0.0007) [2023-12-28 01:09:11,096][106225] Updated weights for policy 1, policy_version 822887 (0.0008) [2023-12-28 01:09:11,106][106226] Updated weights for policy 0, policy_version 820836 (0.0007) [2023-12-28 01:09:11,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 420888576. Throughput: 0: 9917.2, 1: 10065.4. Samples: 420850808. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:11,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.075')] [2023-12-28 01:09:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000822888_210698240.pth... [2023-12-28 01:09:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000820840_210190336.pth... [2023-12-28 01:09:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000819656_209887232.pth [2023-12-28 01:09:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000821672_210386944.pth [2023-12-28 01:09:11,878][106225] Updated weights for policy 1, policy_version 822897 (0.0008) [2023-12-28 01:09:11,923][106226] Updated weights for policy 0, policy_version 820846 (0.0007) [2023-12-28 01:09:11,941][106225] Updated weights for policy 1, policy_version 822907 (0.0007) [2023-12-28 01:09:11,982][106226] Updated weights for policy 0, policy_version 820856 (0.0007) [2023-12-28 01:09:12,000][106225] Updated weights for policy 1, policy_version 822917 (0.0005) [2023-12-28 01:09:12,043][106226] Updated weights for policy 0, policy_version 820866 (0.0007) [2023-12-28 01:09:12,759][106225] Updated weights for policy 1, policy_version 822927 (0.0005) [2023-12-28 01:09:12,788][106226] Updated weights for policy 0, policy_version 820876 (0.0009) [2023-12-28 01:09:12,817][106225] Updated weights for policy 1, policy_version 822937 (0.0005) [2023-12-28 01:09:12,851][106226] Updated weights for policy 0, policy_version 820886 (0.0007) [2023-12-28 01:09:12,872][106225] Updated weights for policy 1, policy_version 822947 (0.0007) [2023-12-28 01:09:12,917][106226] Updated weights for policy 0, policy_version 820896 (0.0008) [2023-12-28 01:09:13,496][106225] Updated weights for policy 1, policy_version 822957 (0.0008) [2023-12-28 01:09:13,553][106225] Updated weights for policy 1, policy_version 822967 (0.0008) [2023-12-28 01:09:13,614][106225] Updated weights for policy 1, policy_version 822977 (0.0008) [2023-12-28 01:09:13,656][106226] Updated weights for policy 0, policy_version 820906 (0.0008) [2023-12-28 01:09:13,711][106226] Updated weights for policy 0, policy_version 820916 (0.0008) [2023-12-28 01:09:13,776][106226] Updated weights for policy 0, policy_version 820926 (0.0006) [2023-12-28 01:09:13,834][106226] Updated weights for policy 0, policy_version 820936 (0.0008) [2023-12-28 01:09:14,227][106225] Updated weights for policy 1, policy_version 822987 (0.0007) [2023-12-28 01:09:14,291][106225] Updated weights for policy 1, policy_version 822997 (0.0006) [2023-12-28 01:09:14,347][106225] Updated weights for policy 1, policy_version 823007 (0.0005) [2023-12-28 01:09:14,551][106226] Updated weights for policy 0, policy_version 820946 (0.0009) [2023-12-28 01:09:14,615][106226] Updated weights for policy 0, policy_version 820956 (0.0008) [2023-12-28 01:09:14,670][106226] Updated weights for policy 0, policy_version 820966 (0.0009) [2023-12-28 01:09:14,918][106225] Updated weights for policy 1, policy_version 823017 (0.0006) [2023-12-28 01:09:14,981][106225] Updated weights for policy 1, policy_version 823027 (0.0008) [2023-12-28 01:09:15,049][106225] Updated weights for policy 1, policy_version 823037 (0.0008) [2023-12-28 01:09:15,115][106225] Updated weights for policy 1, policy_version 823047 (0.0007) [2023-12-28 01:09:15,496][106226] Updated weights for policy 0, policy_version 820976 (0.0010) [2023-12-28 01:09:15,556][106226] Updated weights for policy 0, policy_version 820986 (0.0010) [2023-12-28 01:09:15,615][106226] Updated weights for policy 0, policy_version 820996 (0.0009) [2023-12-28 01:09:15,756][106225] Updated weights for policy 1, policy_version 823057 (0.0010) [2023-12-28 01:09:15,810][106225] Updated weights for policy 1, policy_version 823067 (0.0008) [2023-12-28 01:09:15,867][106225] Updated weights for policy 1, policy_version 823077 (0.0005) [2023-12-28 01:09:16,171][106226] Updated weights for policy 0, policy_version 821006 (0.0007) [2023-12-28 01:09:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 420978688. Throughput: 0: 9919.8, 1: 10041.6. Samples: 420969404. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:16,176][105115] Avg episode reward: [(0, '-4.172'), (1, '-4.995')] [2023-12-28 01:09:16,226][106226] Updated weights for policy 0, policy_version 821016 (0.0010) [2023-12-28 01:09:16,279][106226] Updated weights for policy 0, policy_version 821026 (0.0010) [2023-12-28 01:09:16,588][106225] Updated weights for policy 1, policy_version 823087 (0.0005) [2023-12-28 01:09:16,651][106225] Updated weights for policy 1, policy_version 823097 (0.0006) [2023-12-28 01:09:16,714][106225] Updated weights for policy 1, policy_version 823107 (0.0010) [2023-12-28 01:09:16,922][106226] Updated weights for policy 0, policy_version 821036 (0.0010) [2023-12-28 01:09:16,988][106226] Updated weights for policy 0, policy_version 821046 (0.0007) [2023-12-28 01:09:17,045][106226] Updated weights for policy 0, policy_version 821056 (0.0008) [2023-12-28 01:09:17,350][106225] Updated weights for policy 1, policy_version 823117 (0.0010) [2023-12-28 01:09:17,406][106225] Updated weights for policy 1, policy_version 823127 (0.0010) [2023-12-28 01:09:17,467][106225] Updated weights for policy 1, policy_version 823137 (0.0010) [2023-12-28 01:09:17,799][106226] Updated weights for policy 0, policy_version 821066 (0.0007) [2023-12-28 01:09:17,859][106226] Updated weights for policy 0, policy_version 821076 (0.0005) [2023-12-28 01:09:17,927][106226] Updated weights for policy 0, policy_version 821086 (0.0007) [2023-12-28 01:09:17,994][106226] Updated weights for policy 0, policy_version 821096 (0.0009) [2023-12-28 01:09:18,064][106225] Updated weights for policy 1, policy_version 823147 (0.0010) [2023-12-28 01:09:18,114][106225] Updated weights for policy 1, policy_version 823157 (0.0010) [2023-12-28 01:09:18,173][106225] Updated weights for policy 1, policy_version 823167 (0.0010) [2023-12-28 01:09:18,711][106226] Updated weights for policy 0, policy_version 821106 (0.0008) [2023-12-28 01:09:18,773][106226] Updated weights for policy 0, policy_version 821116 (0.0009) [2023-12-28 01:09:18,838][106226] Updated weights for policy 0, policy_version 821126 (0.0009) [2023-12-28 01:09:18,842][106225] Updated weights for policy 1, policy_version 823177 (0.0010) [2023-12-28 01:09:18,907][106225] Updated weights for policy 1, policy_version 823187 (0.0005) [2023-12-28 01:09:18,964][106225] Updated weights for policy 1, policy_version 823197 (0.0005) [2023-12-28 01:09:19,022][106225] Updated weights for policy 1, policy_version 823207 (0.0005) [2023-12-28 01:09:19,645][106226] Updated weights for policy 0, policy_version 821136 (0.0009) [2023-12-28 01:09:19,664][106225] Updated weights for policy 1, policy_version 823217 (0.0006) [2023-12-28 01:09:19,710][106226] Updated weights for policy 0, policy_version 821146 (0.0008) [2023-12-28 01:09:19,727][106225] Updated weights for policy 1, policy_version 823227 (0.0009) [2023-12-28 01:09:19,776][106226] Updated weights for policy 0, policy_version 821156 (0.0006) [2023-12-28 01:09:19,787][106225] Updated weights for policy 1, policy_version 823237 (0.0009) [2023-12-28 01:09:20,431][106226] Updated weights for policy 0, policy_version 821166 (0.0007) [2023-12-28 01:09:20,501][106226] Updated weights for policy 0, policy_version 821176 (0.0009) [2023-12-28 01:09:20,570][106226] Updated weights for policy 0, policy_version 821186 (0.0009) [2023-12-28 01:09:20,590][106225] Updated weights for policy 1, policy_version 823247 (0.0008) [2023-12-28 01:09:20,652][106225] Updated weights for policy 1, policy_version 823257 (0.0009) [2023-12-28 01:09:20,719][106225] Updated weights for policy 1, policy_version 823267 (0.0009) [2023-12-28 01:09:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 421076992. Throughput: 0: 9822.6, 1: 10126.4. Samples: 421088056. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:21,175][105115] Avg episode reward: [(0, '-4.067'), (1, '-5.263')] [2023-12-28 01:09:21,310][106226] Updated weights for policy 0, policy_version 821196 (0.0008) [2023-12-28 01:09:21,396][106226] Updated weights for policy 0, policy_version 821206 (0.0007) [2023-12-28 01:09:21,461][106226] Updated weights for policy 0, policy_version 821216 (0.0007) [2023-12-28 01:09:21,513][106225] Updated weights for policy 1, policy_version 823277 (0.0008) [2023-12-28 01:09:21,577][106225] Updated weights for policy 1, policy_version 823287 (0.0008) [2023-12-28 01:09:21,645][106225] Updated weights for policy 1, policy_version 823297 (0.0008) [2023-12-28 01:09:22,169][106226] Updated weights for policy 0, policy_version 821226 (0.0008) [2023-12-28 01:09:22,225][106226] Updated weights for policy 0, policy_version 821236 (0.0008) [2023-12-28 01:09:22,285][106226] Updated weights for policy 0, policy_version 821246 (0.0009) [2023-12-28 01:09:22,344][106226] Updated weights for policy 0, policy_version 821256 (0.0008) [2023-12-28 01:09:22,391][106225] Updated weights for policy 1, policy_version 823307 (0.0009) [2023-12-28 01:09:22,448][106225] Updated weights for policy 1, policy_version 823317 (0.0007) [2023-12-28 01:09:22,517][106225] Updated weights for policy 1, policy_version 823327 (0.0008) [2023-12-28 01:09:23,029][106226] Updated weights for policy 0, policy_version 821266 (0.0011) [2023-12-28 01:09:23,089][106226] Updated weights for policy 0, policy_version 821276 (0.0010) [2023-12-28 01:09:23,147][106226] Updated weights for policy 0, policy_version 821286 (0.0011) [2023-12-28 01:09:23,298][106225] Updated weights for policy 1, policy_version 823337 (0.0009) [2023-12-28 01:09:23,348][106225] Updated weights for policy 1, policy_version 823347 (0.0005) [2023-12-28 01:09:23,406][106225] Updated weights for policy 1, policy_version 823357 (0.0008) [2023-12-28 01:09:23,464][106225] Updated weights for policy 1, policy_version 823367 (0.0008) [2023-12-28 01:09:23,798][106226] Updated weights for policy 0, policy_version 821296 (0.0006) [2023-12-28 01:09:23,867][106226] Updated weights for policy 0, policy_version 821306 (0.0008) [2023-12-28 01:09:23,925][106226] Updated weights for policy 0, policy_version 821316 (0.0009) [2023-12-28 01:09:24,191][106225] Updated weights for policy 1, policy_version 823377 (0.0006) [2023-12-28 01:09:24,252][106225] Updated weights for policy 1, policy_version 823387 (0.0005) [2023-12-28 01:09:24,317][106225] Updated weights for policy 1, policy_version 823397 (0.0007) [2023-12-28 01:09:24,590][106226] Updated weights for policy 0, policy_version 821326 (0.0007) [2023-12-28 01:09:24,637][106226] Updated weights for policy 0, policy_version 821336 (0.0008) [2023-12-28 01:09:24,697][106226] Updated weights for policy 0, policy_version 821346 (0.0009) [2023-12-28 01:09:24,965][106225] Updated weights for policy 1, policy_version 823407 (0.0008) [2023-12-28 01:09:25,018][106225] Updated weights for policy 1, policy_version 823417 (0.0009) [2023-12-28 01:09:25,070][106225] Updated weights for policy 1, policy_version 823427 (0.0009) [2023-12-28 01:09:25,482][106226] Updated weights for policy 0, policy_version 821356 (0.0007) [2023-12-28 01:09:25,552][106226] Updated weights for policy 0, policy_version 821366 (0.0005) [2023-12-28 01:09:25,620][106226] Updated weights for policy 0, policy_version 821376 (0.0005) [2023-12-28 01:09:25,659][106225] Updated weights for policy 1, policy_version 823437 (0.0006) [2023-12-28 01:09:25,712][106225] Updated weights for policy 1, policy_version 823447 (0.0005) [2023-12-28 01:09:25,773][106225] Updated weights for policy 1, policy_version 823457 (0.0005) [2023-12-28 01:09:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 421175296. Throughput: 0: 9833.9, 1: 10111.1. Samples: 421145280. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:26,176][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.809')] [2023-12-28 01:09:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000823464_210845696.pth... [2023-12-28 01:09:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000821384_210329600.pth... [2023-12-28 01:09:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000820232_210034688.pth [2023-12-28 01:09:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000822312_210550784.pth [2023-12-28 01:09:26,219][106226] Updated weights for policy 0, policy_version 821386 (0.0009) [2023-12-28 01:09:26,282][106226] Updated weights for policy 0, policy_version 821396 (0.0009) [2023-12-28 01:09:26,349][106226] Updated weights for policy 0, policy_version 821406 (0.0005) [2023-12-28 01:09:26,400][106225] Updated weights for policy 1, policy_version 823467 (0.0010) [2023-12-28 01:09:26,414][106226] Updated weights for policy 0, policy_version 821416 (0.0009) [2023-12-28 01:09:26,453][106225] Updated weights for policy 1, policy_version 823477 (0.0010) [2023-12-28 01:09:26,512][106225] Updated weights for policy 1, policy_version 823487 (0.0010) [2023-12-28 01:09:26,986][106226] Updated weights for policy 0, policy_version 821426 (0.0008) [2023-12-28 01:09:27,038][106226] Updated weights for policy 0, policy_version 821436 (0.0008) [2023-12-28 01:09:27,090][106226] Updated weights for policy 0, policy_version 821446 (0.0006) [2023-12-28 01:09:27,142][106225] Updated weights for policy 1, policy_version 823497 (0.0010) [2023-12-28 01:09:27,194][106225] Updated weights for policy 1, policy_version 823507 (0.0005) [2023-12-28 01:09:27,251][106225] Updated weights for policy 1, policy_version 823517 (0.0005) [2023-12-28 01:09:27,306][106225] Updated weights for policy 1, policy_version 823527 (0.0006) [2023-12-28 01:09:27,778][106226] Updated weights for policy 0, policy_version 821456 (0.0005) [2023-12-28 01:09:27,834][106226] Updated weights for policy 0, policy_version 821466 (0.0008) [2023-12-28 01:09:27,835][106225] Updated weights for policy 1, policy_version 823537 (0.0005) [2023-12-28 01:09:27,885][106225] Updated weights for policy 1, policy_version 823547 (0.0005) [2023-12-28 01:09:27,886][106226] Updated weights for policy 0, policy_version 821476 (0.0008) [2023-12-28 01:09:27,928][106225] Updated weights for policy 1, policy_version 823557 (0.0005) [2023-12-28 01:09:28,469][106225] Updated weights for policy 1, policy_version 823567 (0.0007) [2023-12-28 01:09:28,537][106225] Updated weights for policy 1, policy_version 823577 (0.0008) [2023-12-28 01:09:28,596][106225] Updated weights for policy 1, policy_version 823587 (0.0008) [2023-12-28 01:09:28,603][106226] Updated weights for policy 0, policy_version 821486 (0.0008) [2023-12-28 01:09:28,658][106226] Updated weights for policy 0, policy_version 821496 (0.0007) [2023-12-28 01:09:28,723][106226] Updated weights for policy 0, policy_version 821506 (0.0009) [2023-12-28 01:09:29,233][106225] Updated weights for policy 1, policy_version 823597 (0.0009) [2023-12-28 01:09:29,297][106225] Updated weights for policy 1, policy_version 823607 (0.0009) [2023-12-28 01:09:29,371][106225] Updated weights for policy 1, policy_version 823617 (0.0010) [2023-12-28 01:09:29,481][106226] Updated weights for policy 0, policy_version 821516 (0.0007) [2023-12-28 01:09:29,545][106226] Updated weights for policy 0, policy_version 821526 (0.0008) [2023-12-28 01:09:29,610][106226] Updated weights for policy 0, policy_version 821536 (0.0006) [2023-12-28 01:09:30,109][106225] Updated weights for policy 1, policy_version 823627 (0.0008) [2023-12-28 01:09:30,160][106225] Updated weights for policy 1, policy_version 823637 (0.0008) [2023-12-28 01:09:30,203][106225] Updated weights for policy 1, policy_version 823647 (0.0008) [2023-12-28 01:09:30,270][106226] Updated weights for policy 0, policy_version 821546 (0.0007) [2023-12-28 01:09:30,328][106226] Updated weights for policy 0, policy_version 821556 (0.0010) [2023-12-28 01:09:30,383][106226] Updated weights for policy 0, policy_version 821566 (0.0008) [2023-12-28 01:09:30,443][106226] Updated weights for policy 0, policy_version 821576 (0.0008) [2023-12-28 01:09:30,982][106225] Updated weights for policy 1, policy_version 823657 (0.0007) [2023-12-28 01:09:31,040][106225] Updated weights for policy 1, policy_version 823667 (0.0007) [2023-12-28 01:09:31,074][106226] Updated weights for policy 0, policy_version 821586 (0.0009) [2023-12-28 01:09:31,102][106225] Updated weights for policy 1, policy_version 823677 (0.0006) [2023-12-28 01:09:31,136][106226] Updated weights for policy 0, policy_version 821596 (0.0008) [2023-12-28 01:09:31,168][106225] Updated weights for policy 1, policy_version 823687 (0.0007) [2023-12-28 01:09:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 421281792. Throughput: 0: 9929.8, 1: 10225.7. Samples: 421271400. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:31,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.818')] [2023-12-28 01:09:31,195][106226] Updated weights for policy 0, policy_version 821606 (0.0008) [2023-12-28 01:09:31,909][106225] Updated weights for policy 1, policy_version 823697 (0.0007) [2023-12-28 01:09:31,969][106225] Updated weights for policy 1, policy_version 823707 (0.0006) [2023-12-28 01:09:31,971][106226] Updated weights for policy 0, policy_version 821616 (0.0008) [2023-12-28 01:09:32,024][106225] Updated weights for policy 1, policy_version 823717 (0.0005) [2023-12-28 01:09:32,027][106226] Updated weights for policy 0, policy_version 821626 (0.0009) [2023-12-28 01:09:32,084][106226] Updated weights for policy 0, policy_version 821636 (0.0010) [2023-12-28 01:09:32,657][106225] Updated weights for policy 1, policy_version 823727 (0.0007) [2023-12-28 01:09:32,716][106225] Updated weights for policy 1, policy_version 823737 (0.0008) [2023-12-28 01:09:32,766][106225] Updated weights for policy 1, policy_version 823747 (0.0008) [2023-12-28 01:09:32,877][106226] Updated weights for policy 0, policy_version 821646 (0.0008) [2023-12-28 01:09:32,935][106226] Updated weights for policy 0, policy_version 821656 (0.0008) [2023-12-28 01:09:32,991][106226] Updated weights for policy 0, policy_version 821666 (0.0008) [2023-12-28 01:09:33,395][106225] Updated weights for policy 1, policy_version 823757 (0.0008) [2023-12-28 01:09:33,456][106225] Updated weights for policy 1, policy_version 823767 (0.0008) [2023-12-28 01:09:33,510][106225] Updated weights for policy 1, policy_version 823777 (0.0008) [2023-12-28 01:09:33,753][106226] Updated weights for policy 0, policy_version 821677 (0.0009) [2023-12-28 01:09:33,803][106226] Updated weights for policy 0, policy_version 821687 (0.0008) [2023-12-28 01:09:33,847][106226] Updated weights for policy 0, policy_version 821697 (0.0005) [2023-12-28 01:09:34,264][106225] Updated weights for policy 1, policy_version 823787 (0.0008) [2023-12-28 01:09:34,332][106225] Updated weights for policy 1, policy_version 823797 (0.0008) [2023-12-28 01:09:34,392][106225] Updated weights for policy 1, policy_version 823807 (0.0009) [2023-12-28 01:09:34,494][106226] Updated weights for policy 0, policy_version 821707 (0.0006) [2023-12-28 01:09:34,565][106226] Updated weights for policy 0, policy_version 821717 (0.0006) [2023-12-28 01:09:34,630][106226] Updated weights for policy 0, policy_version 821727 (0.0006) [2023-12-28 01:09:35,158][106226] Updated weights for policy 0, policy_version 821737 (0.0006) [2023-12-28 01:09:35,171][106225] Updated weights for policy 1, policy_version 823817 (0.0007) [2023-12-28 01:09:35,220][106226] Updated weights for policy 0, policy_version 821747 (0.0010) [2023-12-28 01:09:35,231][106225] Updated weights for policy 1, policy_version 823827 (0.0009) [2023-12-28 01:09:35,280][106226] Updated weights for policy 0, policy_version 821757 (0.0010) [2023-12-28 01:09:35,282][106225] Updated weights for policy 1, policy_version 823837 (0.0007) [2023-12-28 01:09:35,338][106226] Updated weights for policy 0, policy_version 821767 (0.0009) [2023-12-28 01:09:35,340][106225] Updated weights for policy 1, policy_version 823847 (0.0006) [2023-12-28 01:09:35,915][106226] Updated weights for policy 0, policy_version 821777 (0.0005) [2023-12-28 01:09:35,980][106226] Updated weights for policy 0, policy_version 821787 (0.0007) [2023-12-28 01:09:36,039][106226] Updated weights for policy 0, policy_version 821797 (0.0005) [2023-12-28 01:09:36,088][106225] Updated weights for policy 1, policy_version 823857 (0.0010) [2023-12-28 01:09:36,153][106225] Updated weights for policy 1, policy_version 823867 (0.0011) [2023-12-28 01:09:36,175][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 421380096. Throughput: 0: 9964.7, 1: 10102.9. Samples: 421390632. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:36,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-5.270')] [2023-12-28 01:09:36,213][106225] Updated weights for policy 1, policy_version 823877 (0.0008) [2023-12-28 01:09:36,644][106226] Updated weights for policy 0, policy_version 821807 (0.0007) [2023-12-28 01:09:36,709][106226] Updated weights for policy 0, policy_version 821817 (0.0005) [2023-12-28 01:09:36,768][106226] Updated weights for policy 0, policy_version 821827 (0.0007) [2023-12-28 01:09:36,975][106225] Updated weights for policy 1, policy_version 823887 (0.0010) [2023-12-28 01:09:37,030][106225] Updated weights for policy 1, policy_version 823897 (0.0010) [2023-12-28 01:09:37,090][106225] Updated weights for policy 1, policy_version 823907 (0.0010) [2023-12-28 01:09:37,443][106226] Updated weights for policy 0, policy_version 821837 (0.0009) [2023-12-28 01:09:37,490][106226] Updated weights for policy 0, policy_version 821847 (0.0005) [2023-12-28 01:09:37,537][106226] Updated weights for policy 0, policy_version 821857 (0.0005) [2023-12-28 01:09:37,702][106225] Updated weights for policy 1, policy_version 823917 (0.0008) [2023-12-28 01:09:37,765][106225] Updated weights for policy 1, policy_version 823927 (0.0010) [2023-12-28 01:09:37,816][106225] Updated weights for policy 1, policy_version 823937 (0.0010) [2023-12-28 01:09:38,166][106226] Updated weights for policy 0, policy_version 821867 (0.0007) [2023-12-28 01:09:38,212][106226] Updated weights for policy 0, policy_version 821877 (0.0010) [2023-12-28 01:09:38,258][106226] Updated weights for policy 0, policy_version 821887 (0.0006) [2023-12-28 01:09:38,495][106225] Updated weights for policy 1, policy_version 823947 (0.0009) [2023-12-28 01:09:38,558][106225] Updated weights for policy 1, policy_version 823957 (0.0008) [2023-12-28 01:09:38,618][106225] Updated weights for policy 1, policy_version 823967 (0.0008) [2023-12-28 01:09:38,868][106226] Updated weights for policy 0, policy_version 821897 (0.0006) [2023-12-28 01:09:38,923][106226] Updated weights for policy 0, policy_version 821907 (0.0009) [2023-12-28 01:09:38,990][106226] Updated weights for policy 0, policy_version 821917 (0.0006) [2023-12-28 01:09:39,050][106226] Updated weights for policy 0, policy_version 821927 (0.0007) [2023-12-28 01:09:39,334][106225] Updated weights for policy 1, policy_version 823977 (0.0008) [2023-12-28 01:09:39,404][106225] Updated weights for policy 1, policy_version 823987 (0.0008) [2023-12-28 01:09:39,469][106225] Updated weights for policy 1, policy_version 823997 (0.0008) [2023-12-28 01:09:39,533][106225] Updated weights for policy 1, policy_version 824007 (0.0006) [2023-12-28 01:09:39,768][106226] Updated weights for policy 0, policy_version 821937 (0.0007) [2023-12-28 01:09:39,845][106226] Updated weights for policy 0, policy_version 821947 (0.0010) [2023-12-28 01:09:39,908][106226] Updated weights for policy 0, policy_version 821957 (0.0008) [2023-12-28 01:09:40,279][106225] Updated weights for policy 1, policy_version 824017 (0.0010) [2023-12-28 01:09:40,348][106225] Updated weights for policy 1, policy_version 824027 (0.0009) [2023-12-28 01:09:40,406][106225] Updated weights for policy 1, policy_version 824037 (0.0009) [2023-12-28 01:09:40,561][106226] Updated weights for policy 0, policy_version 821967 (0.0008) [2023-12-28 01:09:40,612][106226] Updated weights for policy 0, policy_version 821977 (0.0009) [2023-12-28 01:09:40,665][106226] Updated weights for policy 0, policy_version 821987 (0.0006) [2023-12-28 01:09:41,017][106225] Updated weights for policy 1, policy_version 824047 (0.0009) [2023-12-28 01:09:41,083][106225] Updated weights for policy 1, policy_version 824057 (0.0009) [2023-12-28 01:09:41,144][106225] Updated weights for policy 1, policy_version 824067 (0.0008) [2023-12-28 01:09:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 421478400. Throughput: 0: 10042.4, 1: 10091.0. Samples: 421452716. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:41,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-5.188')] [2023-12-28 01:09:41,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000824072_211001344.pth... [2023-12-28 01:09:41,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000821992_210485248.pth... [2023-12-28 01:09:41,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000822888_210698240.pth [2023-12-28 01:09:41,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000820840_210190336.pth [2023-12-28 01:09:41,340][106226] Updated weights for policy 0, policy_version 821997 (0.0006) [2023-12-28 01:09:41,413][106226] Updated weights for policy 0, policy_version 822007 (0.0009) [2023-12-28 01:09:41,478][106226] Updated weights for policy 0, policy_version 822017 (0.0008) [2023-12-28 01:09:42,009][106225] Updated weights for policy 1, policy_version 824077 (0.0009) [2023-12-28 01:09:42,073][106225] Updated weights for policy 1, policy_version 824087 (0.0007) [2023-12-28 01:09:42,133][106225] Updated weights for policy 1, policy_version 824097 (0.0008) [2023-12-28 01:09:42,182][106226] Updated weights for policy 0, policy_version 822027 (0.0007) [2023-12-28 01:09:42,245][106226] Updated weights for policy 0, policy_version 822037 (0.0008) [2023-12-28 01:09:42,317][106226] Updated weights for policy 0, policy_version 822047 (0.0008) [2023-12-28 01:09:42,913][106225] Updated weights for policy 1, policy_version 824107 (0.0009) [2023-12-28 01:09:42,982][106225] Updated weights for policy 1, policy_version 824117 (0.0009) [2023-12-28 01:09:43,014][106226] Updated weights for policy 0, policy_version 822057 (0.0008) [2023-12-28 01:09:43,034][106225] Updated weights for policy 1, policy_version 824127 (0.0010) [2023-12-28 01:09:43,072][106226] Updated weights for policy 0, policy_version 822067 (0.0008) [2023-12-28 01:09:43,130][106226] Updated weights for policy 0, policy_version 822077 (0.0008) [2023-12-28 01:09:43,184][106226] Updated weights for policy 0, policy_version 822087 (0.0008) [2023-12-28 01:09:43,701][106225] Updated weights for policy 1, policy_version 824137 (0.0009) [2023-12-28 01:09:43,764][106225] Updated weights for policy 1, policy_version 824147 (0.0010) [2023-12-28 01:09:43,811][106225] Updated weights for policy 1, policy_version 824157 (0.0006) [2023-12-28 01:09:43,875][106225] Updated weights for policy 1, policy_version 824167 (0.0010) [2023-12-28 01:09:43,963][106226] Updated weights for policy 0, policy_version 822097 (0.0007) [2023-12-28 01:09:44,020][106226] Updated weights for policy 0, policy_version 822107 (0.0007) [2023-12-28 01:09:44,079][106226] Updated weights for policy 0, policy_version 822117 (0.0008) [2023-12-28 01:09:44,586][106225] Updated weights for policy 1, policy_version 824177 (0.0010) [2023-12-28 01:09:44,646][106225] Updated weights for policy 1, policy_version 824187 (0.0010) [2023-12-28 01:09:44,707][106225] Updated weights for policy 1, policy_version 824197 (0.0010) [2023-12-28 01:09:44,811][106226] Updated weights for policy 0, policy_version 822127 (0.0009) [2023-12-28 01:09:44,873][106226] Updated weights for policy 0, policy_version 822137 (0.0009) [2023-12-28 01:09:44,939][106226] Updated weights for policy 0, policy_version 822147 (0.0008) [2023-12-28 01:09:45,457][106225] Updated weights for policy 1, policy_version 824207 (0.0010) [2023-12-28 01:09:45,509][106225] Updated weights for policy 1, policy_version 824217 (0.0010) [2023-12-28 01:09:45,559][106225] Updated weights for policy 1, policy_version 824227 (0.0010) [2023-12-28 01:09:45,673][106226] Updated weights for policy 0, policy_version 822157 (0.0008) [2023-12-28 01:09:45,725][106226] Updated weights for policy 0, policy_version 822167 (0.0009) [2023-12-28 01:09:45,780][106226] Updated weights for policy 0, policy_version 822177 (0.0009) [2023-12-28 01:09:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 421576704. Throughput: 0: 9966.4, 1: 10082.5. Samples: 421567680. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:46,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.184')] [2023-12-28 01:09:46,256][106225] Updated weights for policy 1, policy_version 824237 (0.0010) [2023-12-28 01:09:46,316][106225] Updated weights for policy 1, policy_version 824247 (0.0010) [2023-12-28 01:09:46,378][106225] Updated weights for policy 1, policy_version 824257 (0.0010) [2023-12-28 01:09:46,540][106226] Updated weights for policy 0, policy_version 822187 (0.0008) [2023-12-28 01:09:46,586][106226] Updated weights for policy 0, policy_version 822197 (0.0008) [2023-12-28 01:09:46,636][106226] Updated weights for policy 0, policy_version 822207 (0.0008) [2023-12-28 01:09:47,038][106225] Updated weights for policy 1, policy_version 824267 (0.0009) [2023-12-28 01:09:47,102][106225] Updated weights for policy 1, policy_version 824277 (0.0005) [2023-12-28 01:09:47,163][106225] Updated weights for policy 1, policy_version 824287 (0.0005) [2023-12-28 01:09:47,299][106226] Updated weights for policy 0, policy_version 822217 (0.0007) [2023-12-28 01:09:47,359][106226] Updated weights for policy 0, policy_version 822227 (0.0011) [2023-12-28 01:09:47,415][106226] Updated weights for policy 0, policy_version 822237 (0.0010) [2023-12-28 01:09:47,467][106226] Updated weights for policy 0, policy_version 822247 (0.0010) [2023-12-28 01:09:47,783][106225] Updated weights for policy 1, policy_version 824297 (0.0010) [2023-12-28 01:09:47,839][106225] Updated weights for policy 1, policy_version 824307 (0.0010) [2023-12-28 01:09:47,903][106225] Updated weights for policy 1, policy_version 824317 (0.0010) [2023-12-28 01:09:47,959][106225] Updated weights for policy 1, policy_version 824327 (0.0010) [2023-12-28 01:09:48,072][106226] Updated weights for policy 0, policy_version 822257 (0.0010) [2023-12-28 01:09:48,122][106226] Updated weights for policy 0, policy_version 822267 (0.0010) [2023-12-28 01:09:48,185][106226] Updated weights for policy 0, policy_version 822277 (0.0008) [2023-12-28 01:09:48,690][106225] Updated weights for policy 1, policy_version 824337 (0.0008) [2023-12-28 01:09:48,748][106225] Updated weights for policy 1, policy_version 824347 (0.0008) [2023-12-28 01:09:48,802][106225] Updated weights for policy 1, policy_version 824357 (0.0009) [2023-12-28 01:09:48,869][106226] Updated weights for policy 0, policy_version 822287 (0.0007) [2023-12-28 01:09:48,929][106226] Updated weights for policy 0, policy_version 822297 (0.0008) [2023-12-28 01:09:48,979][106226] Updated weights for policy 0, policy_version 822307 (0.0007) [2023-12-28 01:09:49,541][106225] Updated weights for policy 1, policy_version 824367 (0.0009) [2023-12-28 01:09:49,600][106225] Updated weights for policy 1, policy_version 824377 (0.0009) [2023-12-28 01:09:49,661][106226] Updated weights for policy 0, policy_version 822317 (0.0007) [2023-12-28 01:09:49,663][106225] Updated weights for policy 1, policy_version 824387 (0.0008) [2023-12-28 01:09:49,716][106226] Updated weights for policy 0, policy_version 822327 (0.0008) [2023-12-28 01:09:49,765][106226] Updated weights for policy 0, policy_version 822337 (0.0008) [2023-12-28 01:09:50,349][106225] Updated weights for policy 1, policy_version 824397 (0.0006) [2023-12-28 01:09:50,415][106225] Updated weights for policy 1, policy_version 824407 (0.0006) [2023-12-28 01:09:50,488][106225] Updated weights for policy 1, policy_version 824417 (0.0005) [2023-12-28 01:09:50,535][106226] Updated weights for policy 0, policy_version 822347 (0.0008) [2023-12-28 01:09:50,597][106226] Updated weights for policy 0, policy_version 822357 (0.0009) [2023-12-28 01:09:50,656][106226] Updated weights for policy 0, policy_version 822367 (0.0008) [2023-12-28 01:09:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 421675008. Throughput: 0: 9937.5, 1: 9992.4. Samples: 421688420. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:51,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.323')] [2023-12-28 01:09:51,198][106225] Updated weights for policy 1, policy_version 824427 (0.0007) [2023-12-28 01:09:51,264][106225] Updated weights for policy 1, policy_version 824437 (0.0008) [2023-12-28 01:09:51,306][106226] Updated weights for policy 0, policy_version 822377 (0.0006) [2023-12-28 01:09:51,322][106225] Updated weights for policy 1, policy_version 824447 (0.0007) [2023-12-28 01:09:51,375][106226] Updated weights for policy 0, policy_version 822387 (0.0007) [2023-12-28 01:09:51,435][106226] Updated weights for policy 0, policy_version 822397 (0.0007) [2023-12-28 01:09:51,498][106226] Updated weights for policy 0, policy_version 822407 (0.0005) [2023-12-28 01:09:52,120][106226] Updated weights for policy 0, policy_version 822417 (0.0008) [2023-12-28 01:09:52,122][106225] Updated weights for policy 1, policy_version 824457 (0.0008) [2023-12-28 01:09:52,179][106226] Updated weights for policy 0, policy_version 822427 (0.0005) [2023-12-28 01:09:52,181][106225] Updated weights for policy 1, policy_version 824467 (0.0008) [2023-12-28 01:09:52,243][106225] Updated weights for policy 1, policy_version 824477 (0.0007) [2023-12-28 01:09:52,246][106226] Updated weights for policy 0, policy_version 822437 (0.0006) [2023-12-28 01:09:52,313][106225] Updated weights for policy 1, policy_version 824487 (0.0008) [2023-12-28 01:09:52,896][106226] Updated weights for policy 0, policy_version 822447 (0.0008) [2023-12-28 01:09:52,964][106226] Updated weights for policy 0, policy_version 822457 (0.0008) [2023-12-28 01:09:53,026][106226] Updated weights for policy 0, policy_version 822467 (0.0008) [2023-12-28 01:09:53,062][106225] Updated weights for policy 1, policy_version 824497 (0.0006) [2023-12-28 01:09:53,117][106225] Updated weights for policy 1, policy_version 824507 (0.0005) [2023-12-28 01:09:53,175][106225] Updated weights for policy 1, policy_version 824517 (0.0007) [2023-12-28 01:09:53,734][106226] Updated weights for policy 0, policy_version 822477 (0.0007) [2023-12-28 01:09:53,798][106225] Updated weights for policy 1, policy_version 824528 (0.0009) [2023-12-28 01:09:53,810][106226] Updated weights for policy 0, policy_version 822487 (0.0005) [2023-12-28 01:09:53,853][106225] Updated weights for policy 1, policy_version 824538 (0.0007) [2023-12-28 01:09:53,867][106226] Updated weights for policy 0, policy_version 822497 (0.0006) [2023-12-28 01:09:53,907][106225] Updated weights for policy 1, policy_version 824548 (0.0007) [2023-12-28 01:09:54,428][106226] Updated weights for policy 0, policy_version 822507 (0.0007) [2023-12-28 01:09:54,490][106226] Updated weights for policy 0, policy_version 822517 (0.0006) [2023-12-28 01:09:54,540][106225] Updated weights for policy 1, policy_version 824558 (0.0007) [2023-12-28 01:09:54,555][106226] Updated weights for policy 0, policy_version 822527 (0.0005) [2023-12-28 01:09:54,595][106225] Updated weights for policy 1, policy_version 824568 (0.0009) [2023-12-28 01:09:54,652][106225] Updated weights for policy 1, policy_version 824578 (0.0009) [2023-12-28 01:09:55,214][106226] Updated weights for policy 0, policy_version 822537 (0.0006) [2023-12-28 01:09:55,267][106226] Updated weights for policy 0, policy_version 822547 (0.0008) [2023-12-28 01:09:55,320][106226] Updated weights for policy 0, policy_version 822557 (0.0008) [2023-12-28 01:09:55,363][106225] Updated weights for policy 1, policy_version 824588 (0.0009) [2023-12-28 01:09:55,369][106226] Updated weights for policy 0, policy_version 822567 (0.0007) [2023-12-28 01:09:55,422][106225] Updated weights for policy 1, policy_version 824598 (0.0010) [2023-12-28 01:09:55,485][106225] Updated weights for policy 1, policy_version 824608 (0.0010) [2023-12-28 01:09:56,107][106226] Updated weights for policy 0, policy_version 822577 (0.0006) [2023-12-28 01:09:56,164][106226] Updated weights for policy 0, policy_version 822587 (0.0006) [2023-12-28 01:09:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 421773312. Throughput: 0: 9958.7, 1: 9956.8. Samples: 421747004. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:09:56,175][105115] Avg episode reward: [(0, '-4.270'), (1, '-4.973')] [2023-12-28 01:09:56,209][106225] Updated weights for policy 1, policy_version 824618 (0.0009) [2023-12-28 01:09:56,223][106226] Updated weights for policy 0, policy_version 822597 (0.0007) [2023-12-28 01:09:56,239][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000822600_210640896.pth... [2023-12-28 01:09:56,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000821384_210329600.pth [2023-12-28 01:09:56,267][106225] Updated weights for policy 1, policy_version 824628 (0.0007) [2023-12-28 01:09:56,326][106225] Updated weights for policy 1, policy_version 824638 (0.0008) [2023-12-28 01:09:56,384][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000824648_211148800.pth... [2023-12-28 01:09:56,386][106225] Updated weights for policy 1, policy_version 824648 (0.0008) [2023-12-28 01:09:56,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000823464_210845696.pth [2023-12-28 01:09:56,860][106226] Updated weights for policy 0, policy_version 822607 (0.0006) [2023-12-28 01:09:56,913][106226] Updated weights for policy 0, policy_version 822617 (0.0005) [2023-12-28 01:09:56,966][106226] Updated weights for policy 0, policy_version 822627 (0.0005) [2023-12-28 01:09:57,058][106225] Updated weights for policy 1, policy_version 824658 (0.0006) [2023-12-28 01:09:57,108][106225] Updated weights for policy 1, policy_version 824668 (0.0007) [2023-12-28 01:09:57,168][106225] Updated weights for policy 1, policy_version 824678 (0.0005) [2023-12-28 01:09:57,542][106226] Updated weights for policy 0, policy_version 822637 (0.0007) [2023-12-28 01:09:57,591][106226] Updated weights for policy 0, policy_version 822647 (0.0009) [2023-12-28 01:09:57,642][106226] Updated weights for policy 0, policy_version 822657 (0.0005) [2023-12-28 01:09:57,724][106225] Updated weights for policy 1, policy_version 824688 (0.0006) [2023-12-28 01:09:57,780][106225] Updated weights for policy 1, policy_version 824698 (0.0008) [2023-12-28 01:09:57,835][106225] Updated weights for policy 1, policy_version 824708 (0.0008) [2023-12-28 01:09:58,315][106226] Updated weights for policy 0, policy_version 822667 (0.0007) [2023-12-28 01:09:58,385][106226] Updated weights for policy 0, policy_version 822677 (0.0009) [2023-12-28 01:09:58,449][106226] Updated weights for policy 0, policy_version 822687 (0.0009) [2023-12-28 01:09:58,577][106225] Updated weights for policy 1, policy_version 824718 (0.0008) [2023-12-28 01:09:58,635][106225] Updated weights for policy 1, policy_version 824728 (0.0008) [2023-12-28 01:09:58,706][106225] Updated weights for policy 1, policy_version 824738 (0.0008) [2023-12-28 01:09:59,309][106226] Updated weights for policy 0, policy_version 822697 (0.0008) [2023-12-28 01:09:59,385][106226] Updated weights for policy 0, policy_version 822707 (0.0008) [2023-12-28 01:09:59,453][106226] Updated weights for policy 0, policy_version 822717 (0.0008) [2023-12-28 01:09:59,511][106226] Updated weights for policy 0, policy_version 822727 (0.0009) [2023-12-28 01:09:59,511][106225] Updated weights for policy 1, policy_version 824748 (0.0010) [2023-12-28 01:09:59,563][106225] Updated weights for policy 1, policy_version 824758 (0.0009) [2023-12-28 01:09:59,616][106225] Updated weights for policy 1, policy_version 824768 (0.0008) [2023-12-28 01:10:00,219][106226] Updated weights for policy 0, policy_version 822737 (0.0009) [2023-12-28 01:10:00,283][106226] Updated weights for policy 0, policy_version 822747 (0.0008) [2023-12-28 01:10:00,343][106226] Updated weights for policy 0, policy_version 822757 (0.0008) [2023-12-28 01:10:00,368][106225] Updated weights for policy 1, policy_version 824778 (0.0008) [2023-12-28 01:10:00,430][106225] Updated weights for policy 1, policy_version 824788 (0.0009) [2023-12-28 01:10:00,488][106225] Updated weights for policy 1, policy_version 824798 (0.0008) [2023-12-28 01:10:00,553][106225] Updated weights for policy 1, policy_version 824808 (0.0008) [2023-12-28 01:10:01,096][106226] Updated weights for policy 0, policy_version 822767 (0.0008) [2023-12-28 01:10:01,153][106226] Updated weights for policy 0, policy_version 822777 (0.0008) [2023-12-28 01:10:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 421871616. Throughput: 0: 10040.2, 1: 9907.8. Samples: 421867064. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:10:01,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-4.903')] [2023-12-28 01:10:01,223][106226] Updated weights for policy 0, policy_version 822787 (0.0009) [2023-12-28 01:10:01,302][106225] Updated weights for policy 1, policy_version 824818 (0.0007) [2023-12-28 01:10:01,362][106225] Updated weights for policy 1, policy_version 824828 (0.0007) [2023-12-28 01:10:01,422][106225] Updated weights for policy 1, policy_version 824838 (0.0008) [2023-12-28 01:10:01,951][106226] Updated weights for policy 0, policy_version 822797 (0.0008) [2023-12-28 01:10:02,021][106226] Updated weights for policy 0, policy_version 822807 (0.0010) [2023-12-28 01:10:02,090][106226] Updated weights for policy 0, policy_version 822817 (0.0010) [2023-12-28 01:10:02,122][106225] Updated weights for policy 1, policy_version 824848 (0.0008) [2023-12-28 01:10:02,175][106225] Updated weights for policy 1, policy_version 824858 (0.0008) [2023-12-28 01:10:02,242][106225] Updated weights for policy 1, policy_version 824868 (0.0009) [2023-12-28 01:10:02,776][106226] Updated weights for policy 0, policy_version 822827 (0.0008) [2023-12-28 01:10:02,836][106226] Updated weights for policy 0, policy_version 822837 (0.0008) [2023-12-28 01:10:02,885][106226] Updated weights for policy 0, policy_version 822847 (0.0008) [2023-12-28 01:10:02,938][106225] Updated weights for policy 1, policy_version 824878 (0.0007) [2023-12-28 01:10:02,992][106225] Updated weights for policy 1, policy_version 824888 (0.0009) [2023-12-28 01:10:03,046][106225] Updated weights for policy 1, policy_version 824898 (0.0008) [2023-12-28 01:10:03,614][106226] Updated weights for policy 0, policy_version 822857 (0.0007) [2023-12-28 01:10:03,666][106226] Updated weights for policy 0, policy_version 822867 (0.0008) [2023-12-28 01:10:03,721][106225] Updated weights for policy 1, policy_version 824908 (0.0007) [2023-12-28 01:10:03,722][106226] Updated weights for policy 0, policy_version 822877 (0.0009) [2023-12-28 01:10:03,765][106225] Updated weights for policy 1, policy_version 824918 (0.0005) [2023-12-28 01:10:03,766][106226] Updated weights for policy 0, policy_version 822887 (0.0008) [2023-12-28 01:10:03,814][106225] Updated weights for policy 1, policy_version 824928 (0.0005) [2023-12-28 01:10:04,480][106225] Updated weights for policy 1, policy_version 824938 (0.0007) [2023-12-28 01:10:04,542][106225] Updated weights for policy 1, policy_version 824948 (0.0008) [2023-12-28 01:10:04,582][106226] Updated weights for policy 0, policy_version 822897 (0.0008) [2023-12-28 01:10:04,603][106225] Updated weights for policy 1, policy_version 824958 (0.0007) [2023-12-28 01:10:04,634][106226] Updated weights for policy 0, policy_version 822907 (0.0007) [2023-12-28 01:10:04,656][106225] Updated weights for policy 1, policy_version 824968 (0.0008) [2023-12-28 01:10:04,695][106226] Updated weights for policy 0, policy_version 822917 (0.0008) [2023-12-28 01:10:05,294][106225] Updated weights for policy 1, policy_version 824978 (0.0005) [2023-12-28 01:10:05,350][106225] Updated weights for policy 1, policy_version 824989 (0.0007) [2023-12-28 01:10:05,393][106225] Updated weights for policy 1, policy_version 824999 (0.0006) [2023-12-28 01:10:05,403][106226] Updated weights for policy 0, policy_version 822927 (0.0007) [2023-12-28 01:10:05,462][106226] Updated weights for policy 0, policy_version 822937 (0.0007) [2023-12-28 01:10:05,515][106226] Updated weights for policy 0, policy_version 822947 (0.0010) [2023-12-28 01:10:06,012][106225] Updated weights for policy 1, policy_version 825009 (0.0008) [2023-12-28 01:10:06,058][106225] Updated weights for policy 1, policy_version 825019 (0.0008) [2023-12-28 01:10:06,109][106225] Updated weights for policy 1, policy_version 825029 (0.0008) [2023-12-28 01:10:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 421978112. Throughput: 0: 10024.0, 1: 9919.4. Samples: 421985508. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:10:06,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.121')] [2023-12-28 01:10:06,245][106226] Updated weights for policy 0, policy_version 822957 (0.0009) [2023-12-28 01:10:06,310][106226] Updated weights for policy 0, policy_version 822967 (0.0009) [2023-12-28 01:10:06,372][106226] Updated weights for policy 0, policy_version 822977 (0.0009) [2023-12-28 01:10:06,829][106225] Updated weights for policy 1, policy_version 825039 (0.0009) [2023-12-28 01:10:06,889][106225] Updated weights for policy 1, policy_version 825049 (0.0008) [2023-12-28 01:10:06,950][106225] Updated weights for policy 1, policy_version 825059 (0.0006) [2023-12-28 01:10:07,158][106226] Updated weights for policy 0, policy_version 822987 (0.0009) [2023-12-28 01:10:07,223][106226] Updated weights for policy 0, policy_version 822997 (0.0008) [2023-12-28 01:10:07,290][106226] Updated weights for policy 0, policy_version 823007 (0.0008) [2023-12-28 01:10:07,650][106225] Updated weights for policy 1, policy_version 825069 (0.0010) [2023-12-28 01:10:07,699][106225] Updated weights for policy 1, policy_version 825079 (0.0010) [2023-12-28 01:10:07,764][106225] Updated weights for policy 1, policy_version 825089 (0.0010) [2023-12-28 01:10:07,870][106226] Updated weights for policy 0, policy_version 823017 (0.0008) [2023-12-28 01:10:07,932][106226] Updated weights for policy 0, policy_version 823027 (0.0007) [2023-12-28 01:10:07,995][106226] Updated weights for policy 0, policy_version 823037 (0.0007) [2023-12-28 01:10:08,055][106226] Updated weights for policy 0, policy_version 823047 (0.0007) [2023-12-28 01:10:08,446][106225] Updated weights for policy 1, policy_version 825099 (0.0010) [2023-12-28 01:10:08,499][106225] Updated weights for policy 1, policy_version 825109 (0.0010) [2023-12-28 01:10:08,557][106225] Updated weights for policy 1, policy_version 825119 (0.0010) [2023-12-28 01:10:08,763][106226] Updated weights for policy 0, policy_version 823057 (0.0008) [2023-12-28 01:10:08,820][106226] Updated weights for policy 0, policy_version 823067 (0.0008) [2023-12-28 01:10:08,872][106226] Updated weights for policy 0, policy_version 823077 (0.0008) [2023-12-28 01:10:09,311][106225] Updated weights for policy 1, policy_version 825129 (0.0010) [2023-12-28 01:10:09,377][106225] Updated weights for policy 1, policy_version 825139 (0.0008) [2023-12-28 01:10:09,448][106225] Updated weights for policy 1, policy_version 825149 (0.0009) [2023-12-28 01:10:09,514][106225] Updated weights for policy 1, policy_version 825159 (0.0008) [2023-12-28 01:10:09,657][106226] Updated weights for policy 0, policy_version 823087 (0.0008) [2023-12-28 01:10:09,725][106226] Updated weights for policy 0, policy_version 823097 (0.0008) [2023-12-28 01:10:09,778][106226] Updated weights for policy 0, policy_version 823107 (0.0008) [2023-12-28 01:10:10,298][106225] Updated weights for policy 1, policy_version 825169 (0.0009) [2023-12-28 01:10:10,364][106225] Updated weights for policy 1, policy_version 825179 (0.0008) [2023-12-28 01:10:10,425][106225] Updated weights for policy 1, policy_version 825189 (0.0010) [2023-12-28 01:10:10,579][106226] Updated weights for policy 0, policy_version 823117 (0.0008) [2023-12-28 01:10:10,638][106226] Updated weights for policy 0, policy_version 823127 (0.0008) [2023-12-28 01:10:10,702][106226] Updated weights for policy 0, policy_version 823137 (0.0009) [2023-12-28 01:10:11,153][106225] Updated weights for policy 1, policy_version 825199 (0.0009) [2023-12-28 01:10:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 422068224. Throughput: 0: 10012.2, 1: 9974.1. Samples: 422044660. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:10:11,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-5.113')] [2023-12-28 01:10:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000823144_210780160.pth... [2023-12-28 01:10:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000821992_210485248.pth [2023-12-28 01:10:11,220][106225] Updated weights for policy 1, policy_version 825209 (0.0009) [2023-12-28 01:10:11,291][106225] Updated weights for policy 1, policy_version 825219 (0.0009) [2023-12-28 01:10:11,323][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000825224_211296256.pth... [2023-12-28 01:10:11,327][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000824072_211001344.pth [2023-12-28 01:10:11,459][106226] Updated weights for policy 0, policy_version 823147 (0.0007) [2023-12-28 01:10:11,516][106226] Updated weights for policy 0, policy_version 823157 (0.0009) [2023-12-28 01:10:11,575][106226] Updated weights for policy 0, policy_version 823167 (0.0006) [2023-12-28 01:10:12,026][106225] Updated weights for policy 1, policy_version 825229 (0.0009) [2023-12-28 01:10:12,084][106225] Updated weights for policy 1, policy_version 825239 (0.0007) [2023-12-28 01:10:12,140][106225] Updated weights for policy 1, policy_version 825249 (0.0006) [2023-12-28 01:10:12,401][106226] Updated weights for policy 0, policy_version 823177 (0.0007) [2023-12-28 01:10:12,458][106226] Updated weights for policy 0, policy_version 823187 (0.0008) [2023-12-28 01:10:12,517][106226] Updated weights for policy 0, policy_version 823197 (0.0008) [2023-12-28 01:10:12,570][106226] Updated weights for policy 0, policy_version 823207 (0.0008) [2023-12-28 01:10:12,851][106225] Updated weights for policy 1, policy_version 825259 (0.0005) [2023-12-28 01:10:12,911][106225] Updated weights for policy 1, policy_version 825269 (0.0007) [2023-12-28 01:10:12,974][106225] Updated weights for policy 1, policy_version 825279 (0.0009) [2023-12-28 01:10:13,350][106226] Updated weights for policy 0, policy_version 823217 (0.0008) [2023-12-28 01:10:13,399][106226] Updated weights for policy 0, policy_version 823227 (0.0009) [2023-12-28 01:10:13,447][106226] Updated weights for policy 0, policy_version 823237 (0.0008) [2023-12-28 01:10:13,663][106225] Updated weights for policy 1, policy_version 825289 (0.0008) [2023-12-28 01:10:13,730][106225] Updated weights for policy 1, policy_version 825299 (0.0007) [2023-12-28 01:10:13,790][106225] Updated weights for policy 1, policy_version 825309 (0.0009) [2023-12-28 01:10:13,855][106225] Updated weights for policy 1, policy_version 825319 (0.0010) [2023-12-28 01:10:14,195][106226] Updated weights for policy 0, policy_version 823247 (0.0009) [2023-12-28 01:10:14,243][106226] Updated weights for policy 0, policy_version 823257 (0.0007) [2023-12-28 01:10:14,310][106226] Updated weights for policy 0, policy_version 823267 (0.0011) [2023-12-28 01:10:14,405][106225] Updated weights for policy 1, policy_version 825329 (0.0011) [2023-12-28 01:10:14,466][106225] Updated weights for policy 1, policy_version 825339 (0.0010) [2023-12-28 01:10:14,529][106225] Updated weights for policy 1, policy_version 825349 (0.0010) [2023-12-28 01:10:14,959][106226] Updated weights for policy 0, policy_version 823277 (0.0010) [2023-12-28 01:10:15,022][106226] Updated weights for policy 0, policy_version 823287 (0.0008) [2023-12-28 01:10:15,085][106226] Updated weights for policy 0, policy_version 823297 (0.0008) [2023-12-28 01:10:15,271][106225] Updated weights for policy 1, policy_version 825359 (0.0010) [2023-12-28 01:10:15,340][106225] Updated weights for policy 1, policy_version 825369 (0.0011) [2023-12-28 01:10:15,380][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000006 [2023-12-28 01:10:15,837][106226] Updated weights for policy 0, policy_version 823307 (0.0008) [2023-12-28 01:10:15,905][106226] Updated weights for policy 0, policy_version 823317 (0.0007) [2023-12-28 01:10:15,966][106226] Updated weights for policy 0, policy_version 823327 (0.0007) [2023-12-28 01:10:16,053][106225] Updated weights for policy 1, policy_version 825379 (0.0009) [2023-12-28 01:10:16,120][106225] Updated weights for policy 1, policy_version 825389 (0.0005) [2023-12-28 01:10:16,172][106225] Updated weights for policy 1, policy_version 825399 (0.0005) [2023-12-28 01:10:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 422166528. Throughput: 0: 9920.8, 1: 9798.4. Samples: 422158764. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:10:16,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-5.096')] [2023-12-28 01:10:16,695][106225] Updated weights for policy 1, policy_version 825409 (0.0006) [2023-12-28 01:10:16,707][106226] Updated weights for policy 0, policy_version 823337 (0.0007) [2023-12-28 01:10:16,748][106225] Updated weights for policy 1, policy_version 825419 (0.0006) [2023-12-28 01:10:16,757][106226] Updated weights for policy 0, policy_version 823347 (0.0011) [2023-12-28 01:10:16,795][106225] Updated weights for policy 1, policy_version 825429 (0.0005) [2023-12-28 01:10:16,807][106226] Updated weights for policy 0, policy_version 823357 (0.0010) [2023-12-28 01:10:16,848][106225] Updated weights for policy 1, policy_version 825439 (0.0006) [2023-12-28 01:10:16,857][106226] Updated weights for policy 0, policy_version 823367 (0.0008) [2023-12-28 01:10:17,578][106226] Updated weights for policy 0, policy_version 823377 (0.0011) [2023-12-28 01:10:17,584][106225] Updated weights for policy 1, policy_version 825449 (0.0006) [2023-12-28 01:10:17,637][106226] Updated weights for policy 0, policy_version 823387 (0.0009) [2023-12-28 01:10:17,644][106225] Updated weights for policy 1, policy_version 825459 (0.0007) [2023-12-28 01:10:17,696][106226] Updated weights for policy 0, policy_version 823397 (0.0006) [2023-12-28 01:10:17,703][106225] Updated weights for policy 1, policy_version 825469 (0.0008) [2023-12-28 01:10:18,273][106226] Updated weights for policy 0, policy_version 823407 (0.0006) [2023-12-28 01:10:18,342][106226] Updated weights for policy 0, policy_version 823417 (0.0008) [2023-12-28 01:10:18,409][106226] Updated weights for policy 0, policy_version 823427 (0.0008) [2023-12-28 01:10:18,467][106225] Updated weights for policy 1, policy_version 825479 (0.0008) [2023-12-28 01:10:18,531][106225] Updated weights for policy 1, policy_version 825489 (0.0007) [2023-12-28 01:10:18,592][106225] Updated weights for policy 1, policy_version 825499 (0.0009) [2023-12-28 01:10:19,016][106226] Updated weights for policy 0, policy_version 823437 (0.0009) [2023-12-28 01:10:19,067][106226] Updated weights for policy 0, policy_version 823447 (0.0010) [2023-12-28 01:10:19,121][106226] Updated weights for policy 0, policy_version 823457 (0.0010) [2023-12-28 01:10:19,390][106225] Updated weights for policy 1, policy_version 825509 (0.0010) [2023-12-28 01:10:19,440][106225] Updated weights for policy 1, policy_version 825519 (0.0009) [2023-12-28 01:10:19,494][106225] Updated weights for policy 1, policy_version 825529 (0.0009) [2023-12-28 01:10:19,812][106226] Updated weights for policy 0, policy_version 823467 (0.0009) [2023-12-28 01:10:19,899][106226] Updated weights for policy 0, policy_version 823480 (0.0007) [2023-12-28 01:10:19,968][106226] Updated weights for policy 0, policy_version 823490 (0.0010) [2023-12-28 01:10:20,307][106225] Updated weights for policy 1, policy_version 825539 (0.0007) [2023-12-28 01:10:20,372][106225] Updated weights for policy 1, policy_version 825549 (0.0007) [2023-12-28 01:10:20,437][106225] Updated weights for policy 1, policy_version 825559 (0.0006) [2023-12-28 01:10:20,754][106226] Updated weights for policy 0, policy_version 823500 (0.0007) [2023-12-28 01:10:20,821][106226] Updated weights for policy 0, policy_version 823510 (0.0007) [2023-12-28 01:10:20,875][106226] Updated weights for policy 0, policy_version 823520 (0.0006) [2023-12-28 01:10:21,150][106225] Updated weights for policy 1, policy_version 825569 (0.0009) [2023-12-28 01:10:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 422264832. Throughput: 0: 9871.0, 1: 9806.5. Samples: 422276120. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:10:21,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-5.339')] [2023-12-28 01:10:21,214][106225] Updated weights for policy 1, policy_version 825579 (0.0010) [2023-12-28 01:10:21,277][106225] Updated weights for policy 1, policy_version 825589 (0.0011) [2023-12-28 01:10:21,344][106225] Updated weights for policy 1, policy_version 825599 (0.0012) [2023-12-28 01:10:21,547][106226] Updated weights for policy 0, policy_version 823530 (0.0007) [2023-12-28 01:10:21,612][106226] Updated weights for policy 0, policy_version 823540 (0.0006) [2023-12-28 01:10:21,684][106226] Updated weights for policy 0, policy_version 823550 (0.0009) [2023-12-28 01:10:21,755][106226] Updated weights for policy 0, policy_version 823560 (0.0008) [2023-12-28 01:10:22,122][106225] Updated weights for policy 1, policy_version 825609 (0.0008) [2023-12-28 01:10:22,195][106225] Updated weights for policy 1, policy_version 825619 (0.0008) [2023-12-28 01:10:22,263][106225] Updated weights for policy 1, policy_version 825629 (0.0008) [2023-12-28 01:10:22,513][106226] Updated weights for policy 0, policy_version 823570 (0.0009) [2023-12-28 01:10:22,570][106226] Updated weights for policy 0, policy_version 823580 (0.0009) [2023-12-28 01:10:22,629][106226] Updated weights for policy 0, policy_version 823590 (0.0009) [2023-12-28 01:10:22,964][106225] Updated weights for policy 1, policy_version 825639 (0.0009) [2023-12-28 01:10:23,025][106225] Updated weights for policy 1, policy_version 825649 (0.0005) [2023-12-28 01:10:23,085][106225] Updated weights for policy 1, policy_version 825659 (0.0005) [2023-12-28 01:10:23,338][106226] Updated weights for policy 0, policy_version 823600 (0.0008) [2023-12-28 01:10:23,409][106226] Updated weights for policy 0, policy_version 823610 (0.0008) [2023-12-28 01:10:23,473][106226] Updated weights for policy 0, policy_version 823620 (0.0008) [2023-12-28 01:10:23,721][106225] Updated weights for policy 1, policy_version 825669 (0.0007) [2023-12-28 01:10:23,780][106225] Updated weights for policy 1, policy_version 825679 (0.0008) [2023-12-28 01:10:23,844][106225] Updated weights for policy 1, policy_version 825689 (0.0005) [2023-12-28 01:10:24,079][106226] Updated weights for policy 0, policy_version 823630 (0.0007) [2023-12-28 01:10:24,126][106226] Updated weights for policy 0, policy_version 823640 (0.0007) [2023-12-28 01:10:24,179][106226] Updated weights for policy 0, policy_version 823650 (0.0009) [2023-12-28 01:10:24,557][106225] Updated weights for policy 1, policy_version 825699 (0.0006) [2023-12-28 01:10:24,621][106225] Updated weights for policy 1, policy_version 825709 (0.0009) [2023-12-28 01:10:24,677][106225] Updated weights for policy 1, policy_version 825719 (0.0008) [2023-12-28 01:10:24,794][106226] Updated weights for policy 0, policy_version 823660 (0.0007) [2023-12-28 01:10:24,858][106226] Updated weights for policy 0, policy_version 823670 (0.0005) [2023-12-28 01:10:24,925][106226] Updated weights for policy 0, policy_version 823680 (0.0006) [2023-12-28 01:10:25,370][106225] Updated weights for policy 1, policy_version 825729 (0.0009) [2023-12-28 01:10:25,434][106225] Updated weights for policy 1, policy_version 825739 (0.0006) [2023-12-28 01:10:25,496][106225] Updated weights for policy 1, policy_version 825749 (0.0005) [2023-12-28 01:10:25,553][106225] Updated weights for policy 1, policy_version 825759 (0.0005) [2023-12-28 01:10:25,644][106226] Updated weights for policy 0, policy_version 823690 (0.0008) [2023-12-28 01:10:25,708][106226] Updated weights for policy 0, policy_version 823700 (0.0009) [2023-12-28 01:10:25,763][106226] Updated weights for policy 0, policy_version 823710 (0.0008) [2023-12-28 01:10:25,823][106226] Updated weights for policy 0, policy_version 823720 (0.0008) [2023-12-28 01:10:26,130][106225] Updated weights for policy 1, policy_version 825769 (0.0005) [2023-12-28 01:10:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 422363136. Throughput: 0: 9811.0, 1: 9787.3. Samples: 422334636. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:26,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.757')] [2023-12-28 01:10:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000823720_210927616.pth... [2023-12-28 01:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000822600_210640896.pth [2023-12-28 01:10:26,191][106225] Updated weights for policy 1, policy_version 825779 (0.0005) [2023-12-28 01:10:26,250][106225] Updated weights for policy 1, policy_version 825789 (0.0006) [2023-12-28 01:10:26,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000825792_211443712.pth... [2023-12-28 01:10:26,271][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000824648_211148800.pth [2023-12-28 01:10:26,475][106226] Updated weights for policy 0, policy_version 823730 (0.0008) [2023-12-28 01:10:26,547][106226] Updated weights for policy 0, policy_version 823740 (0.0011) [2023-12-28 01:10:26,623][106226] Updated weights for policy 0, policy_version 823750 (0.0011) [2023-12-28 01:10:26,817][106225] Updated weights for policy 1, policy_version 825799 (0.0009) [2023-12-28 01:10:26,873][106225] Updated weights for policy 1, policy_version 825809 (0.0010) [2023-12-28 01:10:26,920][106225] Updated weights for policy 1, policy_version 825819 (0.0010) [2023-12-28 01:10:27,237][106226] Updated weights for policy 0, policy_version 823760 (0.0006) [2023-12-28 01:10:27,287][106226] Updated weights for policy 0, policy_version 823770 (0.0005) [2023-12-28 01:10:27,348][106226] Updated weights for policy 0, policy_version 823780 (0.0007) [2023-12-28 01:10:27,641][106225] Updated weights for policy 1, policy_version 825829 (0.0010) [2023-12-28 01:10:27,698][106225] Updated weights for policy 1, policy_version 825839 (0.0008) [2023-12-28 01:10:27,756][106225] Updated weights for policy 1, policy_version 825849 (0.0005) [2023-12-28 01:10:28,027][106226] Updated weights for policy 0, policy_version 823790 (0.0009) [2023-12-28 01:10:28,080][106226] Updated weights for policy 0, policy_version 823800 (0.0010) [2023-12-28 01:10:28,132][106226] Updated weights for policy 0, policy_version 823810 (0.0010) [2023-12-28 01:10:28,331][106225] Updated weights for policy 1, policy_version 825859 (0.0005) [2023-12-28 01:10:28,401][106225] Updated weights for policy 1, policy_version 825869 (0.0009) [2023-12-28 01:10:28,457][106225] Updated weights for policy 1, policy_version 825879 (0.0010) [2023-12-28 01:10:28,823][106226] Updated weights for policy 0, policy_version 823820 (0.0010) [2023-12-28 01:10:28,875][106226] Updated weights for policy 0, policy_version 823830 (0.0010) [2023-12-28 01:10:28,925][106226] Updated weights for policy 0, policy_version 823840 (0.0010) [2023-12-28 01:10:29,024][106225] Updated weights for policy 1, policy_version 825889 (0.0009) [2023-12-28 01:10:29,084][106225] Updated weights for policy 1, policy_version 825899 (0.0010) [2023-12-28 01:10:29,138][106225] Updated weights for policy 1, policy_version 825909 (0.0010) [2023-12-28 01:10:29,188][106225] Updated weights for policy 1, policy_version 825919 (0.0010) [2023-12-28 01:10:29,675][106226] Updated weights for policy 0, policy_version 823850 (0.0010) [2023-12-28 01:10:29,725][106226] Updated weights for policy 0, policy_version 823860 (0.0010) [2023-12-28 01:10:29,776][106226] Updated weights for policy 0, policy_version 823870 (0.0010) [2023-12-28 01:10:29,836][106226] Updated weights for policy 0, policy_version 823880 (0.0010) [2023-12-28 01:10:29,922][106225] Updated weights for policy 1, policy_version 825929 (0.0006) [2023-12-28 01:10:29,984][106225] Updated weights for policy 1, policy_version 825939 (0.0008) [2023-12-28 01:10:30,044][106225] Updated weights for policy 1, policy_version 825949 (0.0008) [2023-12-28 01:10:30,523][106226] Updated weights for policy 0, policy_version 823890 (0.0008) [2023-12-28 01:10:30,582][106226] Updated weights for policy 0, policy_version 823900 (0.0011) [2023-12-28 01:10:30,639][106226] Updated weights for policy 0, policy_version 823910 (0.0010) [2023-12-28 01:10:30,711][106225] Updated weights for policy 1, policy_version 825959 (0.0008) [2023-12-28 01:10:30,767][106225] Updated weights for policy 1, policy_version 825969 (0.0008) [2023-12-28 01:10:30,828][106225] Updated weights for policy 1, policy_version 825979 (0.0009) [2023-12-28 01:10:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 422469632. Throughput: 0: 9882.1, 1: 9929.2. Samples: 422459192. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:31,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.900')] [2023-12-28 01:10:31,344][106226] Updated weights for policy 0, policy_version 823920 (0.0011) [2023-12-28 01:10:31,415][106226] Updated weights for policy 0, policy_version 823930 (0.0010) [2023-12-28 01:10:31,471][106226] Updated weights for policy 0, policy_version 823940 (0.0008) [2023-12-28 01:10:31,573][106225] Updated weights for policy 1, policy_version 825989 (0.0006) [2023-12-28 01:10:31,637][106225] Updated weights for policy 1, policy_version 825999 (0.0007) [2023-12-28 01:10:31,706][106225] Updated weights for policy 1, policy_version 826009 (0.0007) [2023-12-28 01:10:32,231][106226] Updated weights for policy 0, policy_version 823950 (0.0008) [2023-12-28 01:10:32,298][106226] Updated weights for policy 0, policy_version 823960 (0.0009) [2023-12-28 01:10:32,312][106225] Updated weights for policy 1, policy_version 826019 (0.0007) [2023-12-28 01:10:32,364][106226] Updated weights for policy 0, policy_version 823970 (0.0008) [2023-12-28 01:10:32,367][106225] Updated weights for policy 1, policy_version 826029 (0.0008) [2023-12-28 01:10:32,429][106225] Updated weights for policy 1, policy_version 826039 (0.0009) [2023-12-28 01:10:33,003][106226] Updated weights for policy 0, policy_version 823980 (0.0007) [2023-12-28 01:10:33,054][106226] Updated weights for policy 0, policy_version 823990 (0.0008) [2023-12-28 01:10:33,105][106226] Updated weights for policy 0, policy_version 824000 (0.0008) [2023-12-28 01:10:33,184][106225] Updated weights for policy 1, policy_version 826049 (0.0009) [2023-12-28 01:10:33,231][106225] Updated weights for policy 1, policy_version 826059 (0.0008) [2023-12-28 01:10:33,284][106225] Updated weights for policy 1, policy_version 826069 (0.0008) [2023-12-28 01:10:33,331][106225] Updated weights for policy 1, policy_version 826079 (0.0008) [2023-12-28 01:10:33,839][106226] Updated weights for policy 0, policy_version 824010 (0.0008) [2023-12-28 01:10:33,895][106226] Updated weights for policy 0, policy_version 824020 (0.0008) [2023-12-28 01:10:33,942][106226] Updated weights for policy 0, policy_version 824030 (0.0010) [2023-12-28 01:10:33,972][106225] Updated weights for policy 1, policy_version 826089 (0.0007) [2023-12-28 01:10:33,989][106226] Updated weights for policy 0, policy_version 824040 (0.0008) [2023-12-28 01:10:34,018][106225] Updated weights for policy 1, policy_version 826099 (0.0007) [2023-12-28 01:10:34,074][106225] Updated weights for policy 1, policy_version 826109 (0.0009) [2023-12-28 01:10:34,759][106226] Updated weights for policy 0, policy_version 824050 (0.0008) [2023-12-28 01:10:34,790][106225] Updated weights for policy 1, policy_version 826119 (0.0009) [2023-12-28 01:10:34,819][106226] Updated weights for policy 0, policy_version 824060 (0.0009) [2023-12-28 01:10:34,848][106225] Updated weights for policy 1, policy_version 826129 (0.0007) [2023-12-28 01:10:34,873][106226] Updated weights for policy 0, policy_version 824070 (0.0006) [2023-12-28 01:10:34,903][106225] Updated weights for policy 1, policy_version 826139 (0.0006) [2023-12-28 01:10:35,593][106226] Updated weights for policy 0, policy_version 824080 (0.0007) [2023-12-28 01:10:35,602][106225] Updated weights for policy 1, policy_version 826149 (0.0009) [2023-12-28 01:10:35,650][106226] Updated weights for policy 0, policy_version 824090 (0.0006) [2023-12-28 01:10:35,658][106225] Updated weights for policy 1, policy_version 826159 (0.0010) [2023-12-28 01:10:35,711][106226] Updated weights for policy 0, policy_version 824100 (0.0006) [2023-12-28 01:10:35,716][106225] Updated weights for policy 1, policy_version 826169 (0.0010) [2023-12-28 01:10:36,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.2, 300 sec: 19882.9). Total num frames: 422567936. Throughput: 0: 9815.7, 1: 9940.5. Samples: 422577460. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:36,176][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.974')] [2023-12-28 01:10:36,326][106225] Updated weights for policy 1, policy_version 826179 (0.0007) [2023-12-28 01:10:36,384][106225] Updated weights for policy 1, policy_version 826189 (0.0011) [2023-12-28 01:10:36,450][106225] Updated weights for policy 1, policy_version 826199 (0.0006) [2023-12-28 01:10:36,487][106226] Updated weights for policy 0, policy_version 824110 (0.0009) [2023-12-28 01:10:36,550][106226] Updated weights for policy 0, policy_version 824120 (0.0010) [2023-12-28 01:10:36,619][106226] Updated weights for policy 0, policy_version 824130 (0.0008) [2023-12-28 01:10:37,145][106225] Updated weights for policy 1, policy_version 826209 (0.0008) [2023-12-28 01:10:37,202][106225] Updated weights for policy 1, policy_version 826219 (0.0010) [2023-12-28 01:10:37,262][106225] Updated weights for policy 1, policy_version 826229 (0.0010) [2023-12-28 01:10:37,339][106226] Updated weights for policy 0, policy_version 824140 (0.0009) [2023-12-28 01:10:37,350][106225] Updated weights for policy 1, policy_version 826239 (0.0010) [2023-12-28 01:10:37,399][106226] Updated weights for policy 0, policy_version 824150 (0.0006) [2023-12-28 01:10:37,459][106226] Updated weights for policy 0, policy_version 824160 (0.0005) [2023-12-28 01:10:38,038][106226] Updated weights for policy 0, policy_version 824170 (0.0006) [2023-12-28 01:10:38,042][106225] Updated weights for policy 1, policy_version 826249 (0.0010) [2023-12-28 01:10:38,084][106226] Updated weights for policy 0, policy_version 824180 (0.0010) [2023-12-28 01:10:38,104][106225] Updated weights for policy 1, policy_version 826259 (0.0010) [2023-12-28 01:10:38,130][106226] Updated weights for policy 0, policy_version 824190 (0.0008) [2023-12-28 01:10:38,163][106225] Updated weights for policy 1, policy_version 826269 (0.0008) [2023-12-28 01:10:38,180][106226] Updated weights for policy 0, policy_version 824200 (0.0007) [2023-12-28 01:10:38,894][106226] Updated weights for policy 0, policy_version 824210 (0.0006) [2023-12-28 01:10:38,904][106225] Updated weights for policy 1, policy_version 826279 (0.0010) [2023-12-28 01:10:38,960][106225] Updated weights for policy 1, policy_version 826289 (0.0009) [2023-12-28 01:10:38,960][106226] Updated weights for policy 0, policy_version 824220 (0.0009) [2023-12-28 01:10:39,020][106225] Updated weights for policy 1, policy_version 826299 (0.0005) [2023-12-28 01:10:39,022][106226] Updated weights for policy 0, policy_version 824230 (0.0010) [2023-12-28 01:10:39,706][106225] Updated weights for policy 1, policy_version 826309 (0.0007) [2023-12-28 01:10:39,762][106225] Updated weights for policy 1, policy_version 826319 (0.0006) [2023-12-28 01:10:39,772][106226] Updated weights for policy 0, policy_version 824240 (0.0010) [2023-12-28 01:10:39,821][106225] Updated weights for policy 1, policy_version 826329 (0.0009) [2023-12-28 01:10:39,838][106226] Updated weights for policy 0, policy_version 824250 (0.0010) [2023-12-28 01:10:39,898][106226] Updated weights for policy 0, policy_version 824260 (0.0010) [2023-12-28 01:10:40,641][106226] Updated weights for policy 0, policy_version 824270 (0.0008) [2023-12-28 01:10:40,658][106225] Updated weights for policy 1, policy_version 826339 (0.0009) [2023-12-28 01:10:40,695][106226] Updated weights for policy 0, policy_version 824280 (0.0006) [2023-12-28 01:10:40,709][106225] Updated weights for policy 1, policy_version 826349 (0.0007) [2023-12-28 01:10:40,753][106226] Updated weights for policy 0, policy_version 824290 (0.0008) [2023-12-28 01:10:40,767][106225] Updated weights for policy 1, policy_version 826359 (0.0007) [2023-12-28 01:10:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 422666240. Throughput: 0: 9818.0, 1: 9981.0. Samples: 422637956. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:41,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.937')] [2023-12-28 01:10:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000826368_211591168.pth... [2023-12-28 01:10:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000824296_211075072.pth... [2023-12-28 01:10:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000825224_211296256.pth [2023-12-28 01:10:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000823144_210780160.pth [2023-12-28 01:10:41,547][106226] Updated weights for policy 0, policy_version 824300 (0.0010) [2023-12-28 01:10:41,575][106225] Updated weights for policy 1, policy_version 826369 (0.0007) [2023-12-28 01:10:41,612][106226] Updated weights for policy 0, policy_version 824310 (0.0008) [2023-12-28 01:10:41,641][106225] Updated weights for policy 1, policy_version 826379 (0.0008) [2023-12-28 01:10:41,680][106226] Updated weights for policy 0, policy_version 824320 (0.0008) [2023-12-28 01:10:41,710][106225] Updated weights for policy 1, policy_version 826389 (0.0008) [2023-12-28 01:10:41,781][106225] Updated weights for policy 1, policy_version 826399 (0.0008) [2023-12-28 01:10:42,425][106226] Updated weights for policy 0, policy_version 824330 (0.0008) [2023-12-28 01:10:42,496][106226] Updated weights for policy 0, policy_version 824340 (0.0006) [2023-12-28 01:10:42,551][106226] Updated weights for policy 0, policy_version 824350 (0.0006) [2023-12-28 01:10:42,586][106225] Updated weights for policy 1, policy_version 826409 (0.0007) [2023-12-28 01:10:42,617][106226] Updated weights for policy 0, policy_version 824360 (0.0007) [2023-12-28 01:10:42,633][106225] Updated weights for policy 1, policy_version 826419 (0.0005) [2023-12-28 01:10:42,692][106225] Updated weights for policy 1, policy_version 826429 (0.0006) [2023-12-28 01:10:43,209][106226] Updated weights for policy 0, policy_version 824370 (0.0005) [2023-12-28 01:10:43,265][106226] Updated weights for policy 0, policy_version 824380 (0.0005) [2023-12-28 01:10:43,323][106226] Updated weights for policy 0, policy_version 824390 (0.0006) [2023-12-28 01:10:43,454][106225] Updated weights for policy 1, policy_version 826439 (0.0010) [2023-12-28 01:10:43,500][106225] Updated weights for policy 1, policy_version 826449 (0.0010) [2023-12-28 01:10:43,553][106225] Updated weights for policy 1, policy_version 826459 (0.0010) [2023-12-28 01:10:43,994][106226] Updated weights for policy 0, policy_version 824400 (0.0008) [2023-12-28 01:10:44,059][106226] Updated weights for policy 0, policy_version 824410 (0.0008) [2023-12-28 01:10:44,115][106226] Updated weights for policy 0, policy_version 824420 (0.0006) [2023-12-28 01:10:44,273][106225] Updated weights for policy 1, policy_version 826469 (0.0010) [2023-12-28 01:10:44,336][106225] Updated weights for policy 1, policy_version 826479 (0.0007) [2023-12-28 01:10:44,399][106225] Updated weights for policy 1, policy_version 826489 (0.0008) [2023-12-28 01:10:44,792][106226] Updated weights for policy 0, policy_version 824430 (0.0007) [2023-12-28 01:10:44,853][106226] Updated weights for policy 0, policy_version 824440 (0.0008) [2023-12-28 01:10:44,915][106226] Updated weights for policy 0, policy_version 824450 (0.0009) [2023-12-28 01:10:45,085][106225] Updated weights for policy 1, policy_version 826499 (0.0007) [2023-12-28 01:10:45,148][106225] Updated weights for policy 1, policy_version 826509 (0.0008) [2023-12-28 01:10:45,209][106225] Updated weights for policy 1, policy_version 826519 (0.0008) [2023-12-28 01:10:45,671][106226] Updated weights for policy 0, policy_version 824460 (0.0009) [2023-12-28 01:10:45,736][106226] Updated weights for policy 0, policy_version 824470 (0.0009) [2023-12-28 01:10:45,793][106226] Updated weights for policy 0, policy_version 824480 (0.0008) [2023-12-28 01:10:45,942][106225] Updated weights for policy 1, policy_version 826529 (0.0009) [2023-12-28 01:10:46,001][106225] Updated weights for policy 1, policy_version 826539 (0.0006) [2023-12-28 01:10:46,065][106225] Updated weights for policy 1, policy_version 826549 (0.0007) [2023-12-28 01:10:46,133][106225] Updated weights for policy 1, policy_version 826559 (0.0005) [2023-12-28 01:10:46,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 422764544. Throughput: 0: 9760.8, 1: 9896.5. Samples: 422751640. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:46,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-5.400')] [2023-12-28 01:10:46,474][106226] Updated weights for policy 0, policy_version 824490 (0.0009) [2023-12-28 01:10:46,526][106226] Updated weights for policy 0, policy_version 824500 (0.0011) [2023-12-28 01:10:46,580][106226] Updated weights for policy 0, policy_version 824510 (0.0011) [2023-12-28 01:10:46,641][106226] Updated weights for policy 0, policy_version 824520 (0.0011) [2023-12-28 01:10:46,667][106225] Updated weights for policy 1, policy_version 826569 (0.0005) [2023-12-28 01:10:46,728][106225] Updated weights for policy 1, policy_version 826579 (0.0008) [2023-12-28 01:10:46,792][106225] Updated weights for policy 1, policy_version 826589 (0.0010) [2023-12-28 01:10:47,310][106226] Updated weights for policy 0, policy_version 824530 (0.0009) [2023-12-28 01:10:47,366][106226] Updated weights for policy 0, policy_version 824540 (0.0010) [2023-12-28 01:10:47,428][106226] Updated weights for policy 0, policy_version 824550 (0.0010) [2023-12-28 01:10:47,478][106225] Updated weights for policy 1, policy_version 826599 (0.0010) [2023-12-28 01:10:47,539][106225] Updated weights for policy 1, policy_version 826609 (0.0010) [2023-12-28 01:10:47,598][106225] Updated weights for policy 1, policy_version 826619 (0.0010) [2023-12-28 01:10:48,041][106226] Updated weights for policy 0, policy_version 824560 (0.0006) [2023-12-28 01:10:48,093][106226] Updated weights for policy 0, policy_version 824570 (0.0005) [2023-12-28 01:10:48,152][106226] Updated weights for policy 0, policy_version 824580 (0.0005) [2023-12-28 01:10:48,258][106225] Updated weights for policy 1, policy_version 826629 (0.0010) [2023-12-28 01:10:48,311][106225] Updated weights for policy 1, policy_version 826639 (0.0006) [2023-12-28 01:10:48,379][106225] Updated weights for policy 1, policy_version 826649 (0.0008) [2023-12-28 01:10:48,791][106226] Updated weights for policy 0, policy_version 824590 (0.0008) [2023-12-28 01:10:48,844][106226] Updated weights for policy 0, policy_version 824600 (0.0008) [2023-12-28 01:10:48,895][106226] Updated weights for policy 0, policy_version 824610 (0.0008) [2023-12-28 01:10:49,107][106225] Updated weights for policy 1, policy_version 826659 (0.0008) [2023-12-28 01:10:49,152][106225] Updated weights for policy 1, policy_version 826669 (0.0008) [2023-12-28 01:10:49,197][106225] Updated weights for policy 1, policy_version 826679 (0.0008) [2023-12-28 01:10:49,643][106226] Updated weights for policy 0, policy_version 824620 (0.0009) [2023-12-28 01:10:49,695][106226] Updated weights for policy 0, policy_version 824630 (0.0008) [2023-12-28 01:10:49,752][106226] Updated weights for policy 0, policy_version 824640 (0.0009) [2023-12-28 01:10:50,011][106225] Updated weights for policy 1, policy_version 826689 (0.0009) [2023-12-28 01:10:50,068][106225] Updated weights for policy 1, policy_version 826699 (0.0006) [2023-12-28 01:10:50,125][106225] Updated weights for policy 1, policy_version 826709 (0.0006) [2023-12-28 01:10:50,189][106225] Updated weights for policy 1, policy_version 826719 (0.0006) [2023-12-28 01:10:50,492][106226] Updated weights for policy 0, policy_version 824650 (0.0008) [2023-12-28 01:10:50,548][106226] Updated weights for policy 0, policy_version 824660 (0.0006) [2023-12-28 01:10:50,610][106226] Updated weights for policy 0, policy_version 824670 (0.0010) [2023-12-28 01:10:50,669][106226] Updated weights for policy 0, policy_version 824680 (0.0010) [2023-12-28 01:10:50,758][106225] Updated weights for policy 1, policy_version 826729 (0.0005) [2023-12-28 01:10:50,824][106225] Updated weights for policy 1, policy_version 826739 (0.0006) [2023-12-28 01:10:50,886][106225] Updated weights for policy 1, policy_version 826749 (0.0008) [2023-12-28 01:10:51,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 422862848. Throughput: 0: 9816.3, 1: 9889.6. Samples: 422872272. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:51,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.112')] [2023-12-28 01:10:51,416][106226] Updated weights for policy 0, policy_version 824690 (0.0008) [2023-12-28 01:10:51,476][106226] Updated weights for policy 0, policy_version 824700 (0.0006) [2023-12-28 01:10:51,528][106226] Updated weights for policy 0, policy_version 824710 (0.0007) [2023-12-28 01:10:51,632][106225] Updated weights for policy 1, policy_version 826759 (0.0009) [2023-12-28 01:10:51,702][106225] Updated weights for policy 1, policy_version 826769 (0.0009) [2023-12-28 01:10:51,767][106225] Updated weights for policy 1, policy_version 826779 (0.0009) [2023-12-28 01:10:52,238][106226] Updated weights for policy 0, policy_version 824720 (0.0006) [2023-12-28 01:10:52,303][106226] Updated weights for policy 0, policy_version 824730 (0.0008) [2023-12-28 01:10:52,370][106226] Updated weights for policy 0, policy_version 824740 (0.0007) [2023-12-28 01:10:52,547][106225] Updated weights for policy 1, policy_version 826789 (0.0009) [2023-12-28 01:10:52,610][106225] Updated weights for policy 1, policy_version 826799 (0.0008) [2023-12-28 01:10:52,678][106225] Updated weights for policy 1, policy_version 826809 (0.0008) [2023-12-28 01:10:53,068][106226] Updated weights for policy 0, policy_version 824750 (0.0010) [2023-12-28 01:10:53,124][106226] Updated weights for policy 0, policy_version 824760 (0.0010) [2023-12-28 01:10:53,177][106226] Updated weights for policy 0, policy_version 824770 (0.0009) [2023-12-28 01:10:53,318][106225] Updated weights for policy 1, policy_version 826819 (0.0007) [2023-12-28 01:10:53,379][106225] Updated weights for policy 1, policy_version 826829 (0.0009) [2023-12-28 01:10:53,436][106225] Updated weights for policy 1, policy_version 826839 (0.0010) [2023-12-28 01:10:53,765][106226] Updated weights for policy 0, policy_version 824780 (0.0007) [2023-12-28 01:10:53,831][106226] Updated weights for policy 0, policy_version 824790 (0.0006) [2023-12-28 01:10:53,901][106226] Updated weights for policy 0, policy_version 824800 (0.0009) [2023-12-28 01:10:54,077][106225] Updated weights for policy 1, policy_version 826849 (0.0010) [2023-12-28 01:10:54,133][106225] Updated weights for policy 1, policy_version 826859 (0.0008) [2023-12-28 01:10:54,185][106225] Updated weights for policy 1, policy_version 826869 (0.0008) [2023-12-28 01:10:54,243][106225] Updated weights for policy 1, policy_version 826879 (0.0008) [2023-12-28 01:10:54,571][106226] Updated weights for policy 0, policy_version 824810 (0.0006) [2023-12-28 01:10:54,627][106226] Updated weights for policy 0, policy_version 824820 (0.0008) [2023-12-28 01:10:54,690][106226] Updated weights for policy 0, policy_version 824830 (0.0006) [2023-12-28 01:10:54,744][106226] Updated weights for policy 0, policy_version 824840 (0.0005) [2023-12-28 01:10:54,823][106225] Updated weights for policy 1, policy_version 826889 (0.0006) [2023-12-28 01:10:54,870][106225] Updated weights for policy 1, policy_version 826899 (0.0009) [2023-12-28 01:10:54,927][106225] Updated weights for policy 1, policy_version 826909 (0.0008) [2023-12-28 01:10:55,345][106226] Updated weights for policy 0, policy_version 824850 (0.0005) [2023-12-28 01:10:55,404][106226] Updated weights for policy 0, policy_version 824860 (0.0005) [2023-12-28 01:10:55,456][106226] Updated weights for policy 0, policy_version 824870 (0.0006) [2023-12-28 01:10:55,710][106225] Updated weights for policy 1, policy_version 826919 (0.0007) [2023-12-28 01:10:55,780][106225] Updated weights for policy 1, policy_version 826929 (0.0005) [2023-12-28 01:10:55,849][106225] Updated weights for policy 1, policy_version 826939 (0.0006) [2023-12-28 01:10:56,162][106226] Updated weights for policy 0, policy_version 824880 (0.0009) [2023-12-28 01:10:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 422961152. Throughput: 0: 9842.2, 1: 9866.0. Samples: 422931528. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:10:56,176][105115] Avg episode reward: [(0, '-4.004'), (1, '-5.215')] [2023-12-28 01:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000826944_211738624.pth... [2023-12-28 01:10:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000825792_211443712.pth [2023-12-28 01:10:56,215][106226] Updated weights for policy 0, policy_version 824890 (0.0007) [2023-12-28 01:10:56,266][106226] Updated weights for policy 0, policy_version 824900 (0.0005) [2023-12-28 01:10:56,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000824904_211230720.pth... [2023-12-28 01:10:56,288][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000823720_210927616.pth [2023-12-28 01:10:56,440][106225] Updated weights for policy 1, policy_version 826949 (0.0009) [2023-12-28 01:10:56,501][106225] Updated weights for policy 1, policy_version 826959 (0.0008) [2023-12-28 01:10:56,550][106225] Updated weights for policy 1, policy_version 826969 (0.0008) [2023-12-28 01:10:56,825][106226] Updated weights for policy 0, policy_version 824910 (0.0006) [2023-12-28 01:10:56,881][106226] Updated weights for policy 0, policy_version 824920 (0.0008) [2023-12-28 01:10:56,949][106226] Updated weights for policy 0, policy_version 824930 (0.0008) [2023-12-28 01:10:57,281][106225] Updated weights for policy 1, policy_version 826980 (0.0009) [2023-12-28 01:10:57,333][106225] Updated weights for policy 1, policy_version 826990 (0.0007) [2023-12-28 01:10:57,392][106225] Updated weights for policy 1, policy_version 827000 (0.0005) [2023-12-28 01:10:57,580][106226] Updated weights for policy 0, policy_version 824940 (0.0007) [2023-12-28 01:10:57,637][106226] Updated weights for policy 0, policy_version 824950 (0.0007) [2023-12-28 01:10:57,701][106226] Updated weights for policy 0, policy_version 824960 (0.0005) [2023-12-28 01:10:57,983][106225] Updated weights for policy 1, policy_version 827010 (0.0005) [2023-12-28 01:10:58,038][106225] Updated weights for policy 1, policy_version 827020 (0.0005) [2023-12-28 01:10:58,097][106225] Updated weights for policy 1, policy_version 827030 (0.0005) [2023-12-28 01:10:58,164][106225] Updated weights for policy 1, policy_version 827040 (0.0005) [2023-12-28 01:10:58,461][106226] Updated weights for policy 0, policy_version 824970 (0.0009) [2023-12-28 01:10:58,531][106226] Updated weights for policy 0, policy_version 824980 (0.0011) [2023-12-28 01:10:58,599][106226] Updated weights for policy 0, policy_version 824990 (0.0011) [2023-12-28 01:10:58,671][106226] Updated weights for policy 0, policy_version 825000 (0.0008) [2023-12-28 01:10:58,831][106225] Updated weights for policy 1, policy_version 827050 (0.0009) [2023-12-28 01:10:58,896][106225] Updated weights for policy 1, policy_version 827060 (0.0009) [2023-12-28 01:10:58,974][106225] Updated weights for policy 1, policy_version 827070 (0.0007) [2023-12-28 01:10:59,488][106226] Updated weights for policy 0, policy_version 825010 (0.0009) [2023-12-28 01:10:59,551][106226] Updated weights for policy 0, policy_version 825020 (0.0010) [2023-12-28 01:10:59,619][106226] Updated weights for policy 0, policy_version 825030 (0.0007) [2023-12-28 01:10:59,667][106225] Updated weights for policy 1, policy_version 827080 (0.0009) [2023-12-28 01:10:59,721][106225] Updated weights for policy 1, policy_version 827090 (0.0010) [2023-12-28 01:10:59,788][106225] Updated weights for policy 1, policy_version 827100 (0.0010) [2023-12-28 01:11:00,376][106226] Updated weights for policy 0, policy_version 825040 (0.0008) [2023-12-28 01:11:00,433][106226] Updated weights for policy 0, policy_version 825050 (0.0008) [2023-12-28 01:11:00,494][106226] Updated weights for policy 0, policy_version 825060 (0.0007) [2023-12-28 01:11:00,503][106225] Updated weights for policy 1, policy_version 827110 (0.0009) [2023-12-28 01:11:00,556][106225] Updated weights for policy 1, policy_version 827120 (0.0005) [2023-12-28 01:11:00,608][106225] Updated weights for policy 1, policy_version 827130 (0.0005) [2023-12-28 01:11:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 423059456. Throughput: 0: 9913.5, 1: 9948.8. Samples: 423052568. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:01,175][105115] Avg episode reward: [(0, '-4.299'), (1, '-4.934')] [2023-12-28 01:11:01,270][106226] Updated weights for policy 0, policy_version 825070 (0.0007) [2023-12-28 01:11:01,272][106225] Updated weights for policy 1, policy_version 827140 (0.0008) [2023-12-28 01:11:01,327][106225] Updated weights for policy 1, policy_version 827150 (0.0005) [2023-12-28 01:11:01,334][106226] Updated weights for policy 0, policy_version 825080 (0.0008) [2023-12-28 01:11:01,393][106225] Updated weights for policy 1, policy_version 827160 (0.0007) [2023-12-28 01:11:01,399][106226] Updated weights for policy 0, policy_version 825090 (0.0008) [2023-12-28 01:11:02,121][106225] Updated weights for policy 1, policy_version 827170 (0.0008) [2023-12-28 01:11:02,166][106226] Updated weights for policy 0, policy_version 825100 (0.0006) [2023-12-28 01:11:02,184][106225] Updated weights for policy 1, policy_version 827180 (0.0008) [2023-12-28 01:11:02,225][106226] Updated weights for policy 0, policy_version 825110 (0.0007) [2023-12-28 01:11:02,244][106225] Updated weights for policy 1, policy_version 827190 (0.0009) [2023-12-28 01:11:02,290][106226] Updated weights for policy 0, policy_version 825120 (0.0008) [2023-12-28 01:11:02,314][106225] Updated weights for policy 1, policy_version 827200 (0.0008) [2023-12-28 01:11:02,932][106225] Updated weights for policy 1, policy_version 827210 (0.0008) [2023-12-28 01:11:02,993][106225] Updated weights for policy 1, policy_version 827220 (0.0007) [2023-12-28 01:11:03,054][106225] Updated weights for policy 1, policy_version 827230 (0.0007) [2023-12-28 01:11:03,064][106226] Updated weights for policy 0, policy_version 825130 (0.0007) [2023-12-28 01:11:03,123][106226] Updated weights for policy 0, policy_version 825140 (0.0008) [2023-12-28 01:11:03,184][106226] Updated weights for policy 0, policy_version 825150 (0.0008) [2023-12-28 01:11:03,232][106226] Updated weights for policy 0, policy_version 825160 (0.0008) [2023-12-28 01:11:03,630][106225] Updated weights for policy 1, policy_version 827240 (0.0006) [2023-12-28 01:11:03,679][106225] Updated weights for policy 1, policy_version 827250 (0.0008) [2023-12-28 01:11:03,735][106225] Updated weights for policy 1, policy_version 827260 (0.0008) [2023-12-28 01:11:04,008][106226] Updated weights for policy 0, policy_version 825170 (0.0008) [2023-12-28 01:11:04,072][106226] Updated weights for policy 0, policy_version 825180 (0.0009) [2023-12-28 01:11:04,141][106226] Updated weights for policy 0, policy_version 825190 (0.0009) [2023-12-28 01:11:04,438][106225] Updated weights for policy 1, policy_version 827270 (0.0007) [2023-12-28 01:11:04,496][106225] Updated weights for policy 1, policy_version 827280 (0.0008) [2023-12-28 01:11:04,555][106225] Updated weights for policy 1, policy_version 827290 (0.0009) [2023-12-28 01:11:04,797][106226] Updated weights for policy 0, policy_version 825200 (0.0008) [2023-12-28 01:11:04,852][106226] Updated weights for policy 0, policy_version 825210 (0.0006) [2023-12-28 01:11:04,903][106226] Updated weights for policy 0, policy_version 825220 (0.0005) [2023-12-28 01:11:05,385][106225] Updated weights for policy 1, policy_version 827300 (0.0007) [2023-12-28 01:11:05,431][106225] Updated weights for policy 1, policy_version 827310 (0.0005) [2023-12-28 01:11:05,450][106226] Updated weights for policy 0, policy_version 825230 (0.0008) [2023-12-28 01:11:05,480][106225] Updated weights for policy 1, policy_version 827320 (0.0005) [2023-12-28 01:11:05,494][106226] Updated weights for policy 0, policy_version 825240 (0.0010) [2023-12-28 01:11:05,540][106226] Updated weights for policy 0, policy_version 825250 (0.0010) [2023-12-28 01:11:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 423157760. Throughput: 0: 9880.1, 1: 9995.4. Samples: 423170516. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:06,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-5.011')] [2023-12-28 01:11:06,191][106225] Updated weights for policy 1, policy_version 827330 (0.0006) [2023-12-28 01:11:06,248][106225] Updated weights for policy 1, policy_version 827340 (0.0007) [2023-12-28 01:11:06,304][106225] Updated weights for policy 1, policy_version 827350 (0.0008) [2023-12-28 01:11:06,320][106226] Updated weights for policy 0, policy_version 825260 (0.0010) [2023-12-28 01:11:06,354][106225] Updated weights for policy 1, policy_version 827360 (0.0007) [2023-12-28 01:11:06,385][106226] Updated weights for policy 0, policy_version 825270 (0.0011) [2023-12-28 01:11:06,453][106226] Updated weights for policy 0, policy_version 825280 (0.0011) [2023-12-28 01:11:07,007][106225] Updated weights for policy 1, policy_version 827370 (0.0005) [2023-12-28 01:11:07,058][106225] Updated weights for policy 1, policy_version 827380 (0.0007) [2023-12-28 01:11:07,103][106226] Updated weights for policy 0, policy_version 825290 (0.0011) [2023-12-28 01:11:07,114][106225] Updated weights for policy 1, policy_version 827390 (0.0008) [2023-12-28 01:11:07,166][106226] Updated weights for policy 0, policy_version 825300 (0.0011) [2023-12-28 01:11:07,217][106226] Updated weights for policy 0, policy_version 825310 (0.0010) [2023-12-28 01:11:07,270][106226] Updated weights for policy 0, policy_version 825320 (0.0010) [2023-12-28 01:11:07,790][106225] Updated weights for policy 1, policy_version 827400 (0.0009) [2023-12-28 01:11:07,844][106225] Updated weights for policy 1, policy_version 827410 (0.0005) [2023-12-28 01:11:07,900][106225] Updated weights for policy 1, policy_version 827420 (0.0005) [2023-12-28 01:11:07,988][106226] Updated weights for policy 0, policy_version 825330 (0.0008) [2023-12-28 01:11:08,059][106226] Updated weights for policy 0, policy_version 825340 (0.0009) [2023-12-28 01:11:08,108][106226] Updated weights for policy 0, policy_version 825350 (0.0007) [2023-12-28 01:11:08,528][106225] Updated weights for policy 1, policy_version 827430 (0.0005) [2023-12-28 01:11:08,589][106225] Updated weights for policy 1, policy_version 827440 (0.0006) [2023-12-28 01:11:08,656][106225] Updated weights for policy 1, policy_version 827450 (0.0008) [2023-12-28 01:11:08,804][106226] Updated weights for policy 0, policy_version 825360 (0.0006) [2023-12-28 01:11:08,867][106226] Updated weights for policy 0, policy_version 825370 (0.0008) [2023-12-28 01:11:08,935][106226] Updated weights for policy 0, policy_version 825380 (0.0009) [2023-12-28 01:11:09,388][106225] Updated weights for policy 1, policy_version 827460 (0.0008) [2023-12-28 01:11:09,458][106225] Updated weights for policy 1, policy_version 827470 (0.0011) [2023-12-28 01:11:09,525][106225] Updated weights for policy 1, policy_version 827480 (0.0008) [2023-12-28 01:11:09,569][106226] Updated weights for policy 0, policy_version 825390 (0.0006) [2023-12-28 01:11:09,636][106226] Updated weights for policy 0, policy_version 825400 (0.0006) [2023-12-28 01:11:09,703][106226] Updated weights for policy 0, policy_version 825410 (0.0007) [2023-12-28 01:11:10,262][106225] Updated weights for policy 1, policy_version 827490 (0.0010) [2023-12-28 01:11:10,315][106225] Updated weights for policy 1, policy_version 827500 (0.0008) [2023-12-28 01:11:10,373][106225] Updated weights for policy 1, policy_version 827510 (0.0008) [2023-12-28 01:11:10,429][106225] Updated weights for policy 1, policy_version 827520 (0.0009) [2023-12-28 01:11:10,437][106226] Updated weights for policy 0, policy_version 825420 (0.0008) [2023-12-28 01:11:10,500][106226] Updated weights for policy 0, policy_version 825430 (0.0009) [2023-12-28 01:11:10,561][106226] Updated weights for policy 0, policy_version 825440 (0.0008) [2023-12-28 01:11:11,066][106225] Updated weights for policy 1, policy_version 827530 (0.0008) [2023-12-28 01:11:11,127][106225] Updated weights for policy 1, policy_version 827540 (0.0008) [2023-12-28 01:11:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 423256064. Throughput: 0: 9884.8, 1: 10057.1. Samples: 423232024. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:11,176][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.022')] [2023-12-28 01:11:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000825448_211369984.pth... [2023-12-28 01:11:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000824296_211075072.pth [2023-12-28 01:11:11,190][106225] Updated weights for policy 1, policy_version 827550 (0.0008) [2023-12-28 01:11:11,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000827552_211894272.pth... [2023-12-28 01:11:11,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000826368_211591168.pth [2023-12-28 01:11:11,226][106226] Updated weights for policy 0, policy_version 825450 (0.0009) [2023-12-28 01:11:11,290][106226] Updated weights for policy 0, policy_version 825460 (0.0008) [2023-12-28 01:11:11,357][106226] Updated weights for policy 0, policy_version 825470 (0.0008) [2023-12-28 01:11:11,420][106226] Updated weights for policy 0, policy_version 825480 (0.0008) [2023-12-28 01:11:11,998][106225] Updated weights for policy 1, policy_version 827560 (0.0008) [2023-12-28 01:11:12,062][106225] Updated weights for policy 1, policy_version 827570 (0.0008) [2023-12-28 01:11:12,124][106226] Updated weights for policy 0, policy_version 825490 (0.0007) [2023-12-28 01:11:12,125][106225] Updated weights for policy 1, policy_version 827580 (0.0007) [2023-12-28 01:11:12,185][106226] Updated weights for policy 0, policy_version 825500 (0.0007) [2023-12-28 01:11:12,254][106226] Updated weights for policy 0, policy_version 825510 (0.0009) [2023-12-28 01:11:12,843][106225] Updated weights for policy 1, policy_version 827590 (0.0007) [2023-12-28 01:11:12,903][106225] Updated weights for policy 1, policy_version 827600 (0.0009) [2023-12-28 01:11:12,957][106225] Updated weights for policy 1, policy_version 827610 (0.0008) [2023-12-28 01:11:12,961][106226] Updated weights for policy 0, policy_version 825520 (0.0006) [2023-12-28 01:11:13,023][106226] Updated weights for policy 0, policy_version 825530 (0.0007) [2023-12-28 01:11:13,087][106226] Updated weights for policy 0, policy_version 825540 (0.0009) [2023-12-28 01:11:13,695][106225] Updated weights for policy 1, policy_version 827620 (0.0009) [2023-12-28 01:11:13,714][106226] Updated weights for policy 0, policy_version 825550 (0.0007) [2023-12-28 01:11:13,755][106225] Updated weights for policy 1, policy_version 827630 (0.0007) [2023-12-28 01:11:13,770][106226] Updated weights for policy 0, policy_version 825560 (0.0005) [2023-12-28 01:11:13,818][106225] Updated weights for policy 1, policy_version 827640 (0.0008) [2023-12-28 01:11:13,826][106226] Updated weights for policy 0, policy_version 825570 (0.0005) [2023-12-28 01:11:14,358][106226] Updated weights for policy 0, policy_version 825580 (0.0007) [2023-12-28 01:11:14,414][106226] Updated weights for policy 0, policy_version 825590 (0.0006) [2023-12-28 01:11:14,470][106226] Updated weights for policy 0, policy_version 825600 (0.0005) [2023-12-28 01:11:14,529][106225] Updated weights for policy 1, policy_version 827650 (0.0008) [2023-12-28 01:11:14,593][106225] Updated weights for policy 1, policy_version 827660 (0.0009) [2023-12-28 01:11:14,652][106225] Updated weights for policy 1, policy_version 827670 (0.0008) [2023-12-28 01:11:14,714][106225] Updated weights for policy 1, policy_version 827680 (0.0009) [2023-12-28 01:11:15,135][106226] Updated weights for policy 0, policy_version 825610 (0.0005) [2023-12-28 01:11:15,202][106226] Updated weights for policy 0, policy_version 825620 (0.0007) [2023-12-28 01:11:15,279][106226] Updated weights for policy 0, policy_version 825630 (0.0009) [2023-12-28 01:11:15,343][106226] Updated weights for policy 0, policy_version 825640 (0.0008) [2023-12-28 01:11:15,387][106225] Updated weights for policy 1, policy_version 827690 (0.0008) [2023-12-28 01:11:15,436][106225] Updated weights for policy 1, policy_version 827700 (0.0009) [2023-12-28 01:11:15,495][106225] Updated weights for policy 1, policy_version 827710 (0.0008) [2023-12-28 01:11:16,014][106226] Updated weights for policy 0, policy_version 825650 (0.0009) [2023-12-28 01:11:16,079][106226] Updated weights for policy 0, policy_version 825660 (0.0009) [2023-12-28 01:11:16,142][106226] Updated weights for policy 0, policy_version 825670 (0.0008) [2023-12-28 01:11:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 423362560. Throughput: 0: 9903.8, 1: 9890.0. Samples: 423349912. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:16,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.887')] [2023-12-28 01:11:16,217][106225] Updated weights for policy 1, policy_version 827720 (0.0008) [2023-12-28 01:11:16,268][106225] Updated weights for policy 1, policy_version 827730 (0.0008) [2023-12-28 01:11:16,322][106225] Updated weights for policy 1, policy_version 827740 (0.0008) [2023-12-28 01:11:16,850][106226] Updated weights for policy 0, policy_version 825680 (0.0006) [2023-12-28 01:11:16,905][106226] Updated weights for policy 0, policy_version 825690 (0.0005) [2023-12-28 01:11:16,957][106226] Updated weights for policy 0, policy_version 825700 (0.0005) [2023-12-28 01:11:17,067][106225] Updated weights for policy 1, policy_version 827750 (0.0007) [2023-12-28 01:11:17,124][106225] Updated weights for policy 1, policy_version 827760 (0.0008) [2023-12-28 01:11:17,179][106225] Updated weights for policy 1, policy_version 827770 (0.0009) [2023-12-28 01:11:17,531][106226] Updated weights for policy 0, policy_version 825710 (0.0007) [2023-12-28 01:11:17,577][106226] Updated weights for policy 0, policy_version 825720 (0.0008) [2023-12-28 01:11:17,623][106226] Updated weights for policy 0, policy_version 825730 (0.0009) [2023-12-28 01:11:17,920][106225] Updated weights for policy 1, policy_version 827780 (0.0010) [2023-12-28 01:11:17,971][106225] Updated weights for policy 1, policy_version 827790 (0.0008) [2023-12-28 01:11:18,029][106225] Updated weights for policy 1, policy_version 827800 (0.0007) [2023-12-28 01:11:18,391][106226] Updated weights for policy 0, policy_version 825740 (0.0008) [2023-12-28 01:11:18,456][106226] Updated weights for policy 0, policy_version 825750 (0.0009) [2023-12-28 01:11:18,516][106226] Updated weights for policy 0, policy_version 825760 (0.0009) [2023-12-28 01:11:18,770][106225] Updated weights for policy 1, policy_version 827810 (0.0008) [2023-12-28 01:11:18,839][106225] Updated weights for policy 1, policy_version 827820 (0.0007) [2023-12-28 01:11:18,910][106225] Updated weights for policy 1, policy_version 827830 (0.0009) [2023-12-28 01:11:18,974][106225] Updated weights for policy 1, policy_version 827840 (0.0009) [2023-12-28 01:11:19,281][106226] Updated weights for policy 0, policy_version 825770 (0.0009) [2023-12-28 01:11:19,341][106226] Updated weights for policy 0, policy_version 825780 (0.0009) [2023-12-28 01:11:19,410][106226] Updated weights for policy 0, policy_version 825790 (0.0009) [2023-12-28 01:11:19,467][106226] Updated weights for policy 0, policy_version 825800 (0.0009) [2023-12-28 01:11:19,685][106225] Updated weights for policy 1, policy_version 827850 (0.0008) [2023-12-28 01:11:19,745][106225] Updated weights for policy 1, policy_version 827860 (0.0009) [2023-12-28 01:11:19,805][106225] Updated weights for policy 1, policy_version 827870 (0.0009) [2023-12-28 01:11:20,204][106226] Updated weights for policy 0, policy_version 825810 (0.0008) [2023-12-28 01:11:20,266][106226] Updated weights for policy 0, policy_version 825820 (0.0008) [2023-12-28 01:11:20,322][106226] Updated weights for policy 0, policy_version 825830 (0.0008) [2023-12-28 01:11:20,594][106225] Updated weights for policy 1, policy_version 827880 (0.0008) [2023-12-28 01:11:20,658][106225] Updated weights for policy 1, policy_version 827890 (0.0009) [2023-12-28 01:11:20,717][106225] Updated weights for policy 1, policy_version 827900 (0.0009) [2023-12-28 01:11:21,017][106226] Updated weights for policy 0, policy_version 825840 (0.0008) [2023-12-28 01:11:21,082][106226] Updated weights for policy 0, policy_version 825850 (0.0008) [2023-12-28 01:11:21,148][106226] Updated weights for policy 0, policy_version 825860 (0.0008) [2023-12-28 01:11:21,174][105115] Fps is (10 sec: 20480.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 423460864. Throughput: 0: 9913.0, 1: 9825.2. Samples: 423465672. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:21,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-5.139')] [2023-12-28 01:11:21,511][106225] Updated weights for policy 1, policy_version 827910 (0.0007) [2023-12-28 01:11:21,580][106225] Updated weights for policy 1, policy_version 827920 (0.0006) [2023-12-28 01:11:21,650][106225] Updated weights for policy 1, policy_version 827930 (0.0007) [2023-12-28 01:11:21,908][106226] Updated weights for policy 0, policy_version 825870 (0.0009) [2023-12-28 01:11:21,979][106226] Updated weights for policy 0, policy_version 825880 (0.0007) [2023-12-28 01:11:22,045][106226] Updated weights for policy 0, policy_version 825890 (0.0006) [2023-12-28 01:11:22,349][106225] Updated weights for policy 1, policy_version 827940 (0.0007) [2023-12-28 01:11:22,422][106225] Updated weights for policy 1, policy_version 827950 (0.0006) [2023-12-28 01:11:22,493][106225] Updated weights for policy 1, policy_version 827960 (0.0006) [2023-12-28 01:11:22,724][106226] Updated weights for policy 0, policy_version 825900 (0.0007) [2023-12-28 01:11:22,787][106226] Updated weights for policy 0, policy_version 825910 (0.0007) [2023-12-28 01:11:22,853][106226] Updated weights for policy 0, policy_version 825920 (0.0006) [2023-12-28 01:11:23,168][106225] Updated weights for policy 1, policy_version 827970 (0.0007) [2023-12-28 01:11:23,223][106225] Updated weights for policy 1, policy_version 827980 (0.0008) [2023-12-28 01:11:23,281][106225] Updated weights for policy 1, policy_version 827990 (0.0008) [2023-12-28 01:11:23,330][106225] Updated weights for policy 1, policy_version 828000 (0.0008) [2023-12-28 01:11:23,502][106226] Updated weights for policy 0, policy_version 825930 (0.0006) [2023-12-28 01:11:23,553][106226] Updated weights for policy 0, policy_version 825940 (0.0009) [2023-12-28 01:11:23,598][106226] Updated weights for policy 0, policy_version 825950 (0.0008) [2023-12-28 01:11:23,643][106226] Updated weights for policy 0, policy_version 825960 (0.0008) [2023-12-28 01:11:24,056][106225] Updated weights for policy 1, policy_version 828010 (0.0010) [2023-12-28 01:11:24,109][106225] Updated weights for policy 1, policy_version 828020 (0.0010) [2023-12-28 01:11:24,165][106225] Updated weights for policy 1, policy_version 828030 (0.0010) [2023-12-28 01:11:24,432][106226] Updated weights for policy 0, policy_version 825970 (0.0010) [2023-12-28 01:11:24,493][106226] Updated weights for policy 0, policy_version 825980 (0.0011) [2023-12-28 01:11:24,552][106226] Updated weights for policy 0, policy_version 825990 (0.0010) [2023-12-28 01:11:24,828][106225] Updated weights for policy 1, policy_version 828040 (0.0006) [2023-12-28 01:11:24,884][106225] Updated weights for policy 1, policy_version 828050 (0.0005) [2023-12-28 01:11:24,934][106225] Updated weights for policy 1, policy_version 828060 (0.0005) [2023-12-28 01:11:25,259][106226] Updated weights for policy 0, policy_version 826000 (0.0008) [2023-12-28 01:11:25,308][106226] Updated weights for policy 0, policy_version 826010 (0.0010) [2023-12-28 01:11:25,358][106226] Updated weights for policy 0, policy_version 826020 (0.0010) [2023-12-28 01:11:25,470][106225] Updated weights for policy 1, policy_version 828070 (0.0008) [2023-12-28 01:11:25,519][106225] Updated weights for policy 1, policy_version 828080 (0.0010) [2023-12-28 01:11:25,568][106225] Updated weights for policy 1, policy_version 828090 (0.0010) [2023-12-28 01:11:26,024][106226] Updated weights for policy 0, policy_version 826030 (0.0008) [2023-12-28 01:11:26,082][106226] Updated weights for policy 0, policy_version 826040 (0.0007) [2023-12-28 01:11:26,138][106226] Updated weights for policy 0, policy_version 826050 (0.0010) [2023-12-28 01:11:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 423559168. Throughput: 0: 9883.3, 1: 9796.7. Samples: 423523556. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:26,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-5.088')] [2023-12-28 01:11:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000826056_211525632.pth... [2023-12-28 01:11:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000824904_211230720.pth [2023-12-28 01:11:26,203][106225] Updated weights for policy 1, policy_version 828100 (0.0010) [2023-12-28 01:11:26,254][106225] Updated weights for policy 1, policy_version 828110 (0.0009) [2023-12-28 01:11:26,301][106225] Updated weights for policy 1, policy_version 828120 (0.0005) [2023-12-28 01:11:26,336][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000828128_212041728.pth... [2023-12-28 01:11:26,339][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000826944_211738624.pth [2023-12-28 01:11:26,837][106226] Updated weights for policy 0, policy_version 826060 (0.0010) [2023-12-28 01:11:26,900][106226] Updated weights for policy 0, policy_version 826070 (0.0009) [2023-12-28 01:11:26,969][106226] Updated weights for policy 0, policy_version 826080 (0.0005) [2023-12-28 01:11:26,980][106225] Updated weights for policy 1, policy_version 828130 (0.0006) [2023-12-28 01:11:27,046][106225] Updated weights for policy 1, policy_version 828140 (0.0010) [2023-12-28 01:11:27,112][106225] Updated weights for policy 1, policy_version 828150 (0.0010) [2023-12-28 01:11:27,171][106225] Updated weights for policy 1, policy_version 828160 (0.0010) [2023-12-28 01:11:27,521][106226] Updated weights for policy 0, policy_version 826090 (0.0006) [2023-12-28 01:11:27,580][106226] Updated weights for policy 0, policy_version 826100 (0.0006) [2023-12-28 01:11:27,634][106226] Updated weights for policy 0, policy_version 826110 (0.0006) [2023-12-28 01:11:27,699][106226] Updated weights for policy 0, policy_version 826120 (0.0006) [2023-12-28 01:11:27,740][106225] Updated weights for policy 1, policy_version 828170 (0.0005) [2023-12-28 01:11:27,800][106225] Updated weights for policy 1, policy_version 828180 (0.0010) [2023-12-28 01:11:27,863][106225] Updated weights for policy 1, policy_version 828190 (0.0010) [2023-12-28 01:11:28,370][106226] Updated weights for policy 0, policy_version 826130 (0.0008) [2023-12-28 01:11:28,434][106226] Updated weights for policy 0, policy_version 826140 (0.0010) [2023-12-28 01:11:28,456][106225] Updated weights for policy 1, policy_version 828200 (0.0008) [2023-12-28 01:11:28,495][106226] Updated weights for policy 0, policy_version 826150 (0.0011) [2023-12-28 01:11:28,520][106225] Updated weights for policy 1, policy_version 828210 (0.0008) [2023-12-28 01:11:28,585][106225] Updated weights for policy 1, policy_version 828220 (0.0008) [2023-12-28 01:11:29,110][106226] Updated weights for policy 0, policy_version 826160 (0.0010) [2023-12-28 01:11:29,172][106226] Updated weights for policy 0, policy_version 826170 (0.0010) [2023-12-28 01:11:29,192][106225] Updated weights for policy 1, policy_version 828230 (0.0009) [2023-12-28 01:11:29,244][106226] Updated weights for policy 0, policy_version 826180 (0.0011) [2023-12-28 01:11:29,257][106225] Updated weights for policy 1, policy_version 828240 (0.0009) [2023-12-28 01:11:29,313][106225] Updated weights for policy 1, policy_version 828250 (0.0010) [2023-12-28 01:11:29,953][106226] Updated weights for policy 0, policy_version 826190 (0.0009) [2023-12-28 01:11:30,017][106226] Updated weights for policy 0, policy_version 826200 (0.0009) [2023-12-28 01:11:30,033][106225] Updated weights for policy 1, policy_version 828260 (0.0010) [2023-12-28 01:11:30,073][106226] Updated weights for policy 0, policy_version 826210 (0.0009) [2023-12-28 01:11:30,086][106225] Updated weights for policy 1, policy_version 828270 (0.0010) [2023-12-28 01:11:30,152][106225] Updated weights for policy 1, policy_version 828280 (0.0010) [2023-12-28 01:11:30,744][106226] Updated weights for policy 0, policy_version 826220 (0.0010) [2023-12-28 01:11:30,790][106226] Updated weights for policy 0, policy_version 826230 (0.0010) [2023-12-28 01:11:30,827][106225] Updated weights for policy 1, policy_version 828290 (0.0009) [2023-12-28 01:11:30,842][106226] Updated weights for policy 0, policy_version 826240 (0.0010) [2023-12-28 01:11:30,887][106225] Updated weights for policy 1, policy_version 828300 (0.0007) [2023-12-28 01:11:30,952][106225] Updated weights for policy 1, policy_version 828310 (0.0010) [2023-12-28 01:11:31,012][106225] Updated weights for policy 1, policy_version 828320 (0.0011) [2023-12-28 01:11:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 423665664. Throughput: 0: 9964.5, 1: 10019.7. Samples: 423650924. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:31,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-4.804')] [2023-12-28 01:11:31,641][106226] Updated weights for policy 0, policy_version 826250 (0.0007) [2023-12-28 01:11:31,708][106226] Updated weights for policy 0, policy_version 826260 (0.0007) [2023-12-28 01:11:31,760][106225] Updated weights for policy 1, policy_version 828330 (0.0008) [2023-12-28 01:11:31,778][106226] Updated weights for policy 0, policy_version 826270 (0.0008) [2023-12-28 01:11:31,805][106225] Updated weights for policy 1, policy_version 828340 (0.0005) [2023-12-28 01:11:31,840][106226] Updated weights for policy 0, policy_version 826280 (0.0008) [2023-12-28 01:11:31,850][106225] Updated weights for policy 1, policy_version 828350 (0.0005) [2023-12-28 01:11:32,524][106225] Updated weights for policy 1, policy_version 828360 (0.0008) [2023-12-28 01:11:32,583][106225] Updated weights for policy 1, policy_version 828370 (0.0007) [2023-12-28 01:11:32,593][106226] Updated weights for policy 0, policy_version 826290 (0.0007) [2023-12-28 01:11:32,639][106225] Updated weights for policy 1, policy_version 828380 (0.0007) [2023-12-28 01:11:32,652][106226] Updated weights for policy 0, policy_version 826300 (0.0006) [2023-12-28 01:11:32,716][106226] Updated weights for policy 0, policy_version 826310 (0.0008) [2023-12-28 01:11:33,391][106225] Updated weights for policy 1, policy_version 828390 (0.0008) [2023-12-28 01:11:33,401][106226] Updated weights for policy 0, policy_version 826320 (0.0007) [2023-12-28 01:11:33,446][106225] Updated weights for policy 1, policy_version 828400 (0.0007) [2023-12-28 01:11:33,463][106226] Updated weights for policy 0, policy_version 826330 (0.0006) [2023-12-28 01:11:33,500][106225] Updated weights for policy 1, policy_version 828410 (0.0006) [2023-12-28 01:11:33,525][106226] Updated weights for policy 0, policy_version 826340 (0.0007) [2023-12-28 01:11:34,247][106225] Updated weights for policy 1, policy_version 828420 (0.0009) [2023-12-28 01:11:34,253][106226] Updated weights for policy 0, policy_version 826350 (0.0007) [2023-12-28 01:11:34,305][106226] Updated weights for policy 0, policy_version 826360 (0.0006) [2023-12-28 01:11:34,309][106225] Updated weights for policy 1, policy_version 828430 (0.0009) [2023-12-28 01:11:34,353][106226] Updated weights for policy 0, policy_version 826370 (0.0008) [2023-12-28 01:11:34,370][106225] Updated weights for policy 1, policy_version 828440 (0.0007) [2023-12-28 01:11:35,062][106226] Updated weights for policy 0, policy_version 826380 (0.0009) [2023-12-28 01:11:35,107][106225] Updated weights for policy 1, policy_version 828450 (0.0008) [2023-12-28 01:11:35,111][106226] Updated weights for policy 0, policy_version 826390 (0.0008) [2023-12-28 01:11:35,163][106225] Updated weights for policy 1, policy_version 828460 (0.0008) [2023-12-28 01:11:35,170][106226] Updated weights for policy 0, policy_version 826400 (0.0005) [2023-12-28 01:11:35,220][106225] Updated weights for policy 1, policy_version 828470 (0.0007) [2023-12-28 01:11:35,274][106225] Updated weights for policy 1, policy_version 828480 (0.0007) [2023-12-28 01:11:35,708][106226] Updated weights for policy 0, policy_version 826410 (0.0005) [2023-12-28 01:11:35,769][106226] Updated weights for policy 0, policy_version 826420 (0.0005) [2023-12-28 01:11:35,822][106226] Updated weights for policy 0, policy_version 826430 (0.0008) [2023-12-28 01:11:35,876][106226] Updated weights for policy 0, policy_version 826440 (0.0007) [2023-12-28 01:11:36,071][106225] Updated weights for policy 1, policy_version 828490 (0.0005) [2023-12-28 01:11:36,139][106225] Updated weights for policy 1, policy_version 828500 (0.0008) [2023-12-28 01:11:36,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 423755776. Throughput: 0: 9984.2, 1: 9959.5. Samples: 423769744. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:36,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.914')] [2023-12-28 01:11:36,196][106225] Updated weights for policy 1, policy_version 828510 (0.0008) [2023-12-28 01:11:36,524][106226] Updated weights for policy 0, policy_version 826450 (0.0010) [2023-12-28 01:11:36,591][106226] Updated weights for policy 0, policy_version 826460 (0.0007) [2023-12-28 01:11:36,651][106226] Updated weights for policy 0, policy_version 826470 (0.0010) [2023-12-28 01:11:36,808][106225] Updated weights for policy 1, policy_version 828520 (0.0008) [2023-12-28 01:11:36,863][106225] Updated weights for policy 1, policy_version 828530 (0.0006) [2023-12-28 01:11:36,932][106225] Updated weights for policy 1, policy_version 828540 (0.0005) [2023-12-28 01:11:37,430][106226] Updated weights for policy 0, policy_version 826480 (0.0010) [2023-12-28 01:11:37,477][106226] Updated weights for policy 0, policy_version 826490 (0.0010) [2023-12-28 01:11:37,502][106225] Updated weights for policy 1, policy_version 828550 (0.0006) [2023-12-28 01:11:37,525][106226] Updated weights for policy 0, policy_version 826500 (0.0010) [2023-12-28 01:11:37,568][106225] Updated weights for policy 1, policy_version 828560 (0.0008) [2023-12-28 01:11:37,626][106225] Updated weights for policy 1, policy_version 828570 (0.0010) [2023-12-28 01:11:38,148][106226] Updated weights for policy 0, policy_version 826510 (0.0007) [2023-12-28 01:11:38,206][106226] Updated weights for policy 0, policy_version 826520 (0.0006) [2023-12-28 01:11:38,259][106226] Updated weights for policy 0, policy_version 826530 (0.0007) [2023-12-28 01:11:38,297][106225] Updated weights for policy 1, policy_version 828580 (0.0010) [2023-12-28 01:11:38,368][106225] Updated weights for policy 1, policy_version 828590 (0.0009) [2023-12-28 01:11:38,428][106225] Updated weights for policy 1, policy_version 828600 (0.0009) [2023-12-28 01:11:38,899][106226] Updated weights for policy 0, policy_version 826540 (0.0008) [2023-12-28 01:11:38,950][106226] Updated weights for policy 0, policy_version 826550 (0.0007) [2023-12-28 01:11:39,006][106226] Updated weights for policy 0, policy_version 826560 (0.0005) [2023-12-28 01:11:39,105][106225] Updated weights for policy 1, policy_version 828610 (0.0009) [2023-12-28 01:11:39,167][106225] Updated weights for policy 1, policy_version 828620 (0.0011) [2023-12-28 01:11:39,241][106225] Updated weights for policy 1, policy_version 828630 (0.0010) [2023-12-28 01:11:39,303][106225] Updated weights for policy 1, policy_version 828640 (0.0010) [2023-12-28 01:11:39,698][106226] Updated weights for policy 0, policy_version 826570 (0.0007) [2023-12-28 01:11:39,768][106226] Updated weights for policy 0, policy_version 826580 (0.0006) [2023-12-28 01:11:39,840][106226] Updated weights for policy 0, policy_version 826590 (0.0008) [2023-12-28 01:11:39,908][106226] Updated weights for policy 0, policy_version 826600 (0.0007) [2023-12-28 01:11:40,117][106225] Updated weights for policy 1, policy_version 828650 (0.0008) [2023-12-28 01:11:40,173][106225] Updated weights for policy 1, policy_version 828660 (0.0008) [2023-12-28 01:11:40,229][106225] Updated weights for policy 1, policy_version 828670 (0.0008) [2023-12-28 01:11:40,532][106226] Updated weights for policy 0, policy_version 826610 (0.0010) [2023-12-28 01:11:40,586][106226] Updated weights for policy 0, policy_version 826620 (0.0010) [2023-12-28 01:11:40,646][106226] Updated weights for policy 0, policy_version 826630 (0.0009) [2023-12-28 01:11:40,950][106225] Updated weights for policy 1, policy_version 828680 (0.0007) [2023-12-28 01:11:41,015][106225] Updated weights for policy 1, policy_version 828690 (0.0007) [2023-12-28 01:11:41,083][106225] Updated weights for policy 1, policy_version 828700 (0.0007) [2023-12-28 01:11:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 423862272. Throughput: 0: 9972.3, 1: 10019.6. Samples: 423831160. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:41,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-5.119')] [2023-12-28 01:11:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000826632_211673088.pth... [2023-12-28 01:11:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000828704_212189184.pth... [2023-12-28 01:11:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000827552_211894272.pth [2023-12-28 01:11:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000825448_211369984.pth [2023-12-28 01:11:41,374][106226] Updated weights for policy 0, policy_version 826640 (0.0010) [2023-12-28 01:11:41,436][106226] Updated weights for policy 0, policy_version 826650 (0.0006) [2023-12-28 01:11:41,492][106226] Updated weights for policy 0, policy_version 826660 (0.0008) [2023-12-28 01:11:41,838][106225] Updated weights for policy 1, policy_version 828710 (0.0007) [2023-12-28 01:11:41,899][106225] Updated weights for policy 1, policy_version 828720 (0.0009) [2023-12-28 01:11:41,968][106225] Updated weights for policy 1, policy_version 828730 (0.0010) [2023-12-28 01:11:42,151][106226] Updated weights for policy 0, policy_version 826670 (0.0009) [2023-12-28 01:11:42,213][106226] Updated weights for policy 0, policy_version 826680 (0.0009) [2023-12-28 01:11:42,275][106226] Updated weights for policy 0, policy_version 826690 (0.0008) [2023-12-28 01:11:42,745][106225] Updated weights for policy 1, policy_version 828740 (0.0009) [2023-12-28 01:11:42,813][106225] Updated weights for policy 1, policy_version 828750 (0.0008) [2023-12-28 01:11:42,867][106225] Updated weights for policy 1, policy_version 828760 (0.0007) [2023-12-28 01:11:42,948][106226] Updated weights for policy 0, policy_version 826700 (0.0008) [2023-12-28 01:11:43,016][106226] Updated weights for policy 0, policy_version 826710 (0.0008) [2023-12-28 01:11:43,075][106226] Updated weights for policy 0, policy_version 826720 (0.0008) [2023-12-28 01:11:43,579][106225] Updated weights for policy 1, policy_version 828770 (0.0008) [2023-12-28 01:11:43,628][106225] Updated weights for policy 1, policy_version 828780 (0.0005) [2023-12-28 01:11:43,650][106226] Updated weights for policy 0, policy_version 826730 (0.0007) [2023-12-28 01:11:43,674][106225] Updated weights for policy 1, policy_version 828790 (0.0005) [2023-12-28 01:11:43,707][106226] Updated weights for policy 0, policy_version 826740 (0.0009) [2023-12-28 01:11:43,724][106225] Updated weights for policy 1, policy_version 828800 (0.0006) [2023-12-28 01:11:43,754][106226] Updated weights for policy 0, policy_version 826750 (0.0010) [2023-12-28 01:11:43,807][106226] Updated weights for policy 0, policy_version 826760 (0.0010) [2023-12-28 01:11:44,401][106225] Updated weights for policy 1, policy_version 828810 (0.0010) [2023-12-28 01:11:44,459][106225] Updated weights for policy 1, policy_version 828820 (0.0010) [2023-12-28 01:11:44,503][106226] Updated weights for policy 0, policy_version 826770 (0.0008) [2023-12-28 01:11:44,517][106225] Updated weights for policy 1, policy_version 828830 (0.0010) [2023-12-28 01:11:44,560][106226] Updated weights for policy 0, policy_version 826780 (0.0005) [2023-12-28 01:11:44,626][106226] Updated weights for policy 0, policy_version 826790 (0.0009) [2023-12-28 01:11:45,251][106225] Updated weights for policy 1, policy_version 828840 (0.0010) [2023-12-28 01:11:45,316][106225] Updated weights for policy 1, policy_version 828850 (0.0010) [2023-12-28 01:11:45,365][106226] Updated weights for policy 0, policy_version 826800 (0.0007) [2023-12-28 01:11:45,377][106225] Updated weights for policy 1, policy_version 828860 (0.0010) [2023-12-28 01:11:45,425][106226] Updated weights for policy 0, policy_version 826810 (0.0008) [2023-12-28 01:11:45,480][106226] Updated weights for policy 0, policy_version 826820 (0.0009) [2023-12-28 01:11:45,932][106225] Updated weights for policy 1, policy_version 828870 (0.0010) [2023-12-28 01:11:45,979][106225] Updated weights for policy 1, policy_version 828880 (0.0010) [2023-12-28 01:11:46,043][106225] Updated weights for policy 1, policy_version 828890 (0.0015) [2023-12-28 01:11:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 423960576. Throughput: 0: 10014.8, 1: 9893.7. Samples: 423948452. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:46,176][105115] Avg episode reward: [(0, '-4.095'), (1, '-5.210')] [2023-12-28 01:11:46,242][106226] Updated weights for policy 0, policy_version 826830 (0.0010) [2023-12-28 01:11:46,314][106226] Updated weights for policy 0, policy_version 826840 (0.0011) [2023-12-28 01:11:46,377][106226] Updated weights for policy 0, policy_version 826850 (0.0011) [2023-12-28 01:11:46,774][106225] Updated weights for policy 1, policy_version 828900 (0.0006) [2023-12-28 01:11:46,834][106225] Updated weights for policy 1, policy_version 828910 (0.0005) [2023-12-28 01:11:46,891][106225] Updated weights for policy 1, policy_version 828920 (0.0005) [2023-12-28 01:11:47,033][106226] Updated weights for policy 0, policy_version 826860 (0.0011) [2023-12-28 01:11:47,089][106226] Updated weights for policy 0, policy_version 826870 (0.0010) [2023-12-28 01:11:47,156][106226] Updated weights for policy 0, policy_version 826880 (0.0010) [2023-12-28 01:11:47,468][106225] Updated weights for policy 1, policy_version 828930 (0.0009) [2023-12-28 01:11:47,521][106225] Updated weights for policy 1, policy_version 828940 (0.0005) [2023-12-28 01:11:47,584][106225] Updated weights for policy 1, policy_version 828950 (0.0009) [2023-12-28 01:11:47,640][106225] Updated weights for policy 1, policy_version 828960 (0.0010) [2023-12-28 01:11:47,849][106226] Updated weights for policy 0, policy_version 826890 (0.0011) [2023-12-28 01:11:47,904][106226] Updated weights for policy 0, policy_version 826900 (0.0011) [2023-12-28 01:11:47,960][106226] Updated weights for policy 0, policy_version 826910 (0.0010) [2023-12-28 01:11:48,027][106226] Updated weights for policy 0, policy_version 826920 (0.0009) [2023-12-28 01:11:48,210][106225] Updated weights for policy 1, policy_version 828970 (0.0009) [2023-12-28 01:11:48,270][106225] Updated weights for policy 1, policy_version 828980 (0.0010) [2023-12-28 01:11:48,331][106225] Updated weights for policy 1, policy_version 828990 (0.0008) [2023-12-28 01:11:48,601][106226] Updated weights for policy 0, policy_version 826930 (0.0008) [2023-12-28 01:11:48,665][106226] Updated weights for policy 0, policy_version 826940 (0.0010) [2023-12-28 01:11:48,729][106226] Updated weights for policy 0, policy_version 826950 (0.0011) [2023-12-28 01:11:49,022][106225] Updated weights for policy 1, policy_version 829000 (0.0009) [2023-12-28 01:11:49,077][106225] Updated weights for policy 1, policy_version 829010 (0.0007) [2023-12-28 01:11:49,124][106225] Updated weights for policy 1, policy_version 829020 (0.0005) [2023-12-28 01:11:49,388][106226] Updated weights for policy 0, policy_version 826960 (0.0008) [2023-12-28 01:11:49,448][106226] Updated weights for policy 0, policy_version 826971 (0.0009) [2023-12-28 01:11:49,507][106226] Updated weights for policy 0, policy_version 826981 (0.0008) [2023-12-28 01:11:49,787][106225] Updated weights for policy 1, policy_version 829030 (0.0005) [2023-12-28 01:11:49,856][106225] Updated weights for policy 1, policy_version 829040 (0.0008) [2023-12-28 01:11:49,925][106225] Updated weights for policy 1, policy_version 829050 (0.0009) [2023-12-28 01:11:50,332][106226] Updated weights for policy 0, policy_version 826991 (0.0009) [2023-12-28 01:11:50,400][106226] Updated weights for policy 0, policy_version 827001 (0.0009) [2023-12-28 01:11:50,459][106226] Updated weights for policy 0, policy_version 827011 (0.0006) [2023-12-28 01:11:50,646][106225] Updated weights for policy 1, policy_version 829060 (0.0009) [2023-12-28 01:11:50,708][106225] Updated weights for policy 1, policy_version 829070 (0.0008) [2023-12-28 01:11:50,769][106225] Updated weights for policy 1, policy_version 829080 (0.0008) [2023-12-28 01:11:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 424058880. Throughput: 0: 10031.9, 1: 9955.3. Samples: 424069940. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:51,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.770')] [2023-12-28 01:11:51,226][106226] Updated weights for policy 0, policy_version 827021 (0.0008) [2023-12-28 01:11:51,298][106226] Updated weights for policy 0, policy_version 827031 (0.0010) [2023-12-28 01:11:51,363][106226] Updated weights for policy 0, policy_version 827041 (0.0010) [2023-12-28 01:11:51,460][106225] Updated weights for policy 1, policy_version 829090 (0.0007) [2023-12-28 01:11:51,516][106225] Updated weights for policy 1, policy_version 829100 (0.0007) [2023-12-28 01:11:51,581][106225] Updated weights for policy 1, policy_version 829110 (0.0005) [2023-12-28 01:11:51,655][106225] Updated weights for policy 1, policy_version 829120 (0.0007) [2023-12-28 01:11:52,049][106226] Updated weights for policy 0, policy_version 827051 (0.0009) [2023-12-28 01:11:52,115][106226] Updated weights for policy 0, policy_version 827061 (0.0009) [2023-12-28 01:11:52,172][106226] Updated weights for policy 0, policy_version 827071 (0.0008) [2023-12-28 01:11:52,302][106225] Updated weights for policy 1, policy_version 829130 (0.0007) [2023-12-28 01:11:52,368][106225] Updated weights for policy 1, policy_version 829140 (0.0008) [2023-12-28 01:11:52,431][106225] Updated weights for policy 1, policy_version 829150 (0.0009) [2023-12-28 01:11:52,834][106226] Updated weights for policy 0, policy_version 827081 (0.0008) [2023-12-28 01:11:52,896][106226] Updated weights for policy 0, policy_version 827091 (0.0008) [2023-12-28 01:11:52,956][106226] Updated weights for policy 0, policy_version 827101 (0.0009) [2023-12-28 01:11:53,002][106226] Updated weights for policy 0, policy_version 827111 (0.0008) [2023-12-28 01:11:53,135][106225] Updated weights for policy 1, policy_version 829160 (0.0006) [2023-12-28 01:11:53,192][106225] Updated weights for policy 1, policy_version 829170 (0.0006) [2023-12-28 01:11:53,246][106225] Updated weights for policy 1, policy_version 829180 (0.0007) [2023-12-28 01:11:53,693][106226] Updated weights for policy 0, policy_version 827121 (0.0006) [2023-12-28 01:11:53,763][106226] Updated weights for policy 0, policy_version 827131 (0.0006) [2023-12-28 01:11:53,835][106226] Updated weights for policy 0, policy_version 827141 (0.0005) [2023-12-28 01:11:53,852][106225] Updated weights for policy 1, policy_version 829190 (0.0008) [2023-12-28 01:11:53,909][106225] Updated weights for policy 1, policy_version 829200 (0.0010) [2023-12-28 01:11:53,973][106225] Updated weights for policy 1, policy_version 829210 (0.0011) [2023-12-28 01:11:54,365][106226] Updated weights for policy 0, policy_version 827151 (0.0010) [2023-12-28 01:11:54,418][106226] Updated weights for policy 0, policy_version 827161 (0.0008) [2023-12-28 01:11:54,465][106226] Updated weights for policy 0, policy_version 827171 (0.0010) [2023-12-28 01:11:54,651][106225] Updated weights for policy 1, policy_version 829220 (0.0010) [2023-12-28 01:11:54,707][106225] Updated weights for policy 1, policy_version 829230 (0.0010) [2023-12-28 01:11:54,759][106225] Updated weights for policy 1, policy_version 829240 (0.0007) [2023-12-28 01:11:55,102][106226] Updated weights for policy 0, policy_version 827181 (0.0010) [2023-12-28 01:11:55,162][106226] Updated weights for policy 0, policy_version 827191 (0.0011) [2023-12-28 01:11:55,219][106226] Updated weights for policy 0, policy_version 827201 (0.0011) [2023-12-28 01:11:55,398][106225] Updated weights for policy 1, policy_version 829250 (0.0008) [2023-12-28 01:11:55,460][106225] Updated weights for policy 1, policy_version 829260 (0.0008) [2023-12-28 01:11:55,526][106225] Updated weights for policy 1, policy_version 829270 (0.0009) [2023-12-28 01:11:55,583][106225] Updated weights for policy 1, policy_version 829280 (0.0008) [2023-12-28 01:11:55,806][106226] Updated weights for policy 0, policy_version 827211 (0.0009) [2023-12-28 01:11:55,867][106226] Updated weights for policy 0, policy_version 827221 (0.0010) [2023-12-28 01:11:55,928][106226] Updated weights for policy 0, policy_version 827231 (0.0010) [2023-12-28 01:11:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 424165376. Throughput: 0: 10039.5, 1: 9940.5. Samples: 424131120. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:11:56,175][105115] Avg episode reward: [(0, '-3.974'), (1, '-4.863')] [2023-12-28 01:11:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000827240_211828736.pth... [2023-12-28 01:11:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000829280_212336640.pth... [2023-12-28 01:11:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000828128_212041728.pth [2023-12-28 01:11:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000826056_211525632.pth [2023-12-28 01:11:56,187][106140] Saving new best policy, reward=-3.974! [2023-12-28 01:11:56,297][106225] Updated weights for policy 1, policy_version 829290 (0.0007) [2023-12-28 01:11:56,349][106225] Updated weights for policy 1, policy_version 829300 (0.0007) [2023-12-28 01:11:56,414][106225] Updated weights for policy 1, policy_version 829310 (0.0007) [2023-12-28 01:11:56,625][106226] Updated weights for policy 0, policy_version 827241 (0.0010) [2023-12-28 01:11:56,677][106226] Updated weights for policy 0, policy_version 827251 (0.0010) [2023-12-28 01:11:56,729][106226] Updated weights for policy 0, policy_version 827261 (0.0010) [2023-12-28 01:11:56,784][106226] Updated weights for policy 0, policy_version 827271 (0.0010) [2023-12-28 01:11:57,123][106225] Updated weights for policy 1, policy_version 829320 (0.0008) [2023-12-28 01:11:57,175][106225] Updated weights for policy 1, policy_version 829330 (0.0007) [2023-12-28 01:11:57,228][106225] Updated weights for policy 1, policy_version 829340 (0.0008) [2023-12-28 01:11:57,513][106226] Updated weights for policy 0, policy_version 827281 (0.0006) [2023-12-28 01:11:57,569][106226] Updated weights for policy 0, policy_version 827291 (0.0006) [2023-12-28 01:11:57,626][106226] Updated weights for policy 0, policy_version 827301 (0.0010) [2023-12-28 01:11:57,874][106225] Updated weights for policy 1, policy_version 829350 (0.0006) [2023-12-28 01:11:57,931][106225] Updated weights for policy 1, policy_version 829360 (0.0005) [2023-12-28 01:11:57,993][106225] Updated weights for policy 1, policy_version 829370 (0.0005) [2023-12-28 01:11:58,271][106226] Updated weights for policy 0, policy_version 827311 (0.0009) [2023-12-28 01:11:58,338][106226] Updated weights for policy 0, policy_version 827321 (0.0008) [2023-12-28 01:11:58,404][106226] Updated weights for policy 0, policy_version 827331 (0.0008) [2023-12-28 01:11:58,663][106225] Updated weights for policy 1, policy_version 829380 (0.0007) [2023-12-28 01:11:58,730][106225] Updated weights for policy 1, policy_version 829390 (0.0008) [2023-12-28 01:11:58,799][106225] Updated weights for policy 1, policy_version 829400 (0.0011) [2023-12-28 01:11:59,235][106226] Updated weights for policy 0, policy_version 827341 (0.0009) [2023-12-28 01:11:59,307][106226] Updated weights for policy 0, policy_version 827351 (0.0009) [2023-12-28 01:11:59,380][106226] Updated weights for policy 0, policy_version 827361 (0.0009) [2023-12-28 01:11:59,645][106225] Updated weights for policy 1, policy_version 829410 (0.0010) [2023-12-28 01:11:59,701][106225] Updated weights for policy 1, policy_version 829420 (0.0008) [2023-12-28 01:11:59,760][106225] Updated weights for policy 1, policy_version 829430 (0.0006) [2023-12-28 01:11:59,829][106225] Updated weights for policy 1, policy_version 829440 (0.0006) [2023-12-28 01:12:00,079][106226] Updated weights for policy 0, policy_version 827371 (0.0007) [2023-12-28 01:12:00,138][106226] Updated weights for policy 0, policy_version 827381 (0.0007) [2023-12-28 01:12:00,192][106226] Updated weights for policy 0, policy_version 827391 (0.0005) [2023-12-28 01:12:00,492][106225] Updated weights for policy 1, policy_version 829450 (0.0006) [2023-12-28 01:12:00,541][106225] Updated weights for policy 1, policy_version 829460 (0.0006) [2023-12-28 01:12:00,589][106225] Updated weights for policy 1, policy_version 829470 (0.0008) [2023-12-28 01:12:00,755][106226] Updated weights for policy 0, policy_version 827401 (0.0007) [2023-12-28 01:12:00,814][106226] Updated weights for policy 0, policy_version 827411 (0.0009) [2023-12-28 01:12:00,876][106226] Updated weights for policy 0, policy_version 827421 (0.0008) [2023-12-28 01:12:00,939][106226] Updated weights for policy 0, policy_version 827431 (0.0007) [2023-12-28 01:12:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 424263680. Throughput: 0: 10023.3, 1: 9999.8. Samples: 424250952. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:12:01,175][105115] Avg episode reward: [(0, '-4.160'), (1, '-5.031')] [2023-12-28 01:12:01,408][106225] Updated weights for policy 1, policy_version 829480 (0.0006) [2023-12-28 01:12:01,469][106225] Updated weights for policy 1, policy_version 829490 (0.0007) [2023-12-28 01:12:01,531][106225] Updated weights for policy 1, policy_version 829500 (0.0009) [2023-12-28 01:12:01,648][106226] Updated weights for policy 0, policy_version 827441 (0.0008) [2023-12-28 01:12:01,712][106226] Updated weights for policy 0, policy_version 827451 (0.0006) [2023-12-28 01:12:01,783][106226] Updated weights for policy 0, policy_version 827461 (0.0007) [2023-12-28 01:12:02,219][106225] Updated weights for policy 1, policy_version 829510 (0.0008) [2023-12-28 01:12:02,279][106225] Updated weights for policy 1, policy_version 829520 (0.0006) [2023-12-28 01:12:02,343][106225] Updated weights for policy 1, policy_version 829530 (0.0006) [2023-12-28 01:12:02,419][106226] Updated weights for policy 0, policy_version 827471 (0.0007) [2023-12-28 01:12:02,482][106226] Updated weights for policy 0, policy_version 827481 (0.0008) [2023-12-28 01:12:02,528][106226] Updated weights for policy 0, policy_version 827491 (0.0008) [2023-12-28 01:12:03,007][106225] Updated weights for policy 1, policy_version 829540 (0.0006) [2023-12-28 01:12:03,074][106225] Updated weights for policy 1, policy_version 829550 (0.0008) [2023-12-28 01:12:03,134][106225] Updated weights for policy 1, policy_version 829560 (0.0008) [2023-12-28 01:12:03,220][106226] Updated weights for policy 0, policy_version 827501 (0.0009) [2023-12-28 01:12:03,273][106226] Updated weights for policy 0, policy_version 827511 (0.0005) [2023-12-28 01:12:03,318][106226] Updated weights for policy 0, policy_version 827521 (0.0005) [2023-12-28 01:12:03,824][106225] Updated weights for policy 1, policy_version 829570 (0.0008) [2023-12-28 01:12:03,893][106225] Updated weights for policy 1, policy_version 829580 (0.0009) [2023-12-28 01:12:03,942][106225] Updated weights for policy 1, policy_version 829590 (0.0010) [2023-12-28 01:12:03,986][106226] Updated weights for policy 0, policy_version 827531 (0.0007) [2023-12-28 01:12:03,996][106225] Updated weights for policy 1, policy_version 829600 (0.0008) [2023-12-28 01:12:04,047][106226] Updated weights for policy 0, policy_version 827541 (0.0006) [2023-12-28 01:12:04,115][106226] Updated weights for policy 0, policy_version 827551 (0.0007) [2023-12-28 01:12:04,769][106225] Updated weights for policy 1, policy_version 829610 (0.0008) [2023-12-28 01:12:04,783][106226] Updated weights for policy 0, policy_version 827561 (0.0009) [2023-12-28 01:12:04,829][106225] Updated weights for policy 1, policy_version 829620 (0.0007) [2023-12-28 01:12:04,867][106226] Updated weights for policy 0, policy_version 827571 (0.0007) [2023-12-28 01:12:04,892][106225] Updated weights for policy 1, policy_version 829630 (0.0009) [2023-12-28 01:12:04,927][106226] Updated weights for policy 0, policy_version 827581 (0.0007) [2023-12-28 01:12:04,987][106226] Updated weights for policy 0, policy_version 827591 (0.0007) [2023-12-28 01:12:05,569][106226] Updated weights for policy 0, policy_version 827601 (0.0008) [2023-12-28 01:12:05,628][106226] Updated weights for policy 0, policy_version 827611 (0.0007) [2023-12-28 01:12:05,642][106225] Updated weights for policy 1, policy_version 829640 (0.0008) [2023-12-28 01:12:05,685][106226] Updated weights for policy 0, policy_version 827621 (0.0007) [2023-12-28 01:12:05,694][106225] Updated weights for policy 1, policy_version 829650 (0.0008) [2023-12-28 01:12:05,751][106225] Updated weights for policy 1, policy_version 829660 (0.0008) [2023-12-28 01:12:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 424361984. Throughput: 0: 10118.9, 1: 10024.8. Samples: 424372140. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:12:06,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-5.103')] [2023-12-28 01:12:06,321][106226] Updated weights for policy 0, policy_version 827631 (0.0006) [2023-12-28 01:12:06,384][106226] Updated weights for policy 0, policy_version 827641 (0.0008) [2023-12-28 01:12:06,442][106226] Updated weights for policy 0, policy_version 827651 (0.0009) [2023-12-28 01:12:06,590][106225] Updated weights for policy 1, policy_version 829670 (0.0007) [2023-12-28 01:12:06,651][106225] Updated weights for policy 1, policy_version 829680 (0.0005) [2023-12-28 01:12:06,721][106225] Updated weights for policy 1, policy_version 829690 (0.0005) [2023-12-28 01:12:07,162][106226] Updated weights for policy 0, policy_version 827661 (0.0008) [2023-12-28 01:12:07,218][106226] Updated weights for policy 0, policy_version 827671 (0.0008) [2023-12-28 01:12:07,270][106226] Updated weights for policy 0, policy_version 827681 (0.0008) [2023-12-28 01:12:07,334][106225] Updated weights for policy 1, policy_version 829700 (0.0007) [2023-12-28 01:12:07,384][106225] Updated weights for policy 1, policy_version 829710 (0.0008) [2023-12-28 01:12:07,437][106225] Updated weights for policy 1, policy_version 829720 (0.0009) [2023-12-28 01:12:07,909][106226] Updated weights for policy 0, policy_version 827691 (0.0009) [2023-12-28 01:12:07,966][106226] Updated weights for policy 0, policy_version 827701 (0.0010) [2023-12-28 01:12:08,029][106226] Updated weights for policy 0, policy_version 827711 (0.0009) [2023-12-28 01:12:08,159][106225] Updated weights for policy 1, policy_version 829730 (0.0009) [2023-12-28 01:12:08,209][106225] Updated weights for policy 1, policy_version 829740 (0.0005) [2023-12-28 01:12:08,270][106225] Updated weights for policy 1, policy_version 829750 (0.0008) [2023-12-28 01:12:08,338][106225] Updated weights for policy 1, policy_version 829760 (0.0009) [2023-12-28 01:12:08,716][106226] Updated weights for policy 0, policy_version 827721 (0.0005) [2023-12-28 01:12:08,778][106226] Updated weights for policy 0, policy_version 827731 (0.0007) [2023-12-28 01:12:08,836][106226] Updated weights for policy 0, policy_version 827741 (0.0005) [2023-12-28 01:12:08,897][106226] Updated weights for policy 0, policy_version 827751 (0.0005) [2023-12-28 01:12:09,068][106225] Updated weights for policy 1, policy_version 829770 (0.0008) [2023-12-28 01:12:09,116][106225] Updated weights for policy 1, policy_version 829780 (0.0008) [2023-12-28 01:12:09,165][106225] Updated weights for policy 1, policy_version 829790 (0.0007) [2023-12-28 01:12:09,598][106226] Updated weights for policy 0, policy_version 827761 (0.0005) [2023-12-28 01:12:09,659][106226] Updated weights for policy 0, policy_version 827771 (0.0006) [2023-12-28 01:12:09,715][106226] Updated weights for policy 0, policy_version 827781 (0.0005) [2023-12-28 01:12:09,978][106225] Updated weights for policy 1, policy_version 829800 (0.0010) [2023-12-28 01:12:10,042][106225] Updated weights for policy 1, policy_version 829810 (0.0011) [2023-12-28 01:12:10,103][106225] Updated weights for policy 1, policy_version 829820 (0.0010) [2023-12-28 01:12:10,366][106226] Updated weights for policy 0, policy_version 827791 (0.0007) [2023-12-28 01:12:10,435][106226] Updated weights for policy 0, policy_version 827801 (0.0008) [2023-12-28 01:12:10,494][106226] Updated weights for policy 0, policy_version 827811 (0.0007) [2023-12-28 01:12:10,841][106225] Updated weights for policy 1, policy_version 829830 (0.0011) [2023-12-28 01:12:10,906][106225] Updated weights for policy 1, policy_version 829840 (0.0010) [2023-12-28 01:12:10,974][106225] Updated weights for policy 1, policy_version 829850 (0.0011) [2023-12-28 01:12:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 424460288. Throughput: 0: 10164.8, 1: 10037.9. Samples: 424432680. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-28 01:12:11,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.958')] [2023-12-28 01:12:11,177][106226] Updated weights for policy 0, policy_version 827821 (0.0008) [2023-12-28 01:12:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000829856_212484096.pth... [2023-12-28 01:12:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000828704_212189184.pth [2023-12-28 01:12:11,242][106226] Updated weights for policy 0, policy_version 827831 (0.0008) [2023-12-28 01:12:11,308][106226] Updated weights for policy 0, policy_version 827841 (0.0008) [2023-12-28 01:12:11,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000827848_211984384.pth... [2023-12-28 01:12:11,360][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000826632_211673088.pth [2023-12-28 01:12:11,729][106225] Updated weights for policy 1, policy_version 829860 (0.0010) [2023-12-28 01:12:11,798][106225] Updated weights for policy 1, policy_version 829870 (0.0008) [2023-12-28 01:12:11,867][106225] Updated weights for policy 1, policy_version 829880 (0.0007) [2023-12-28 01:12:12,099][106226] Updated weights for policy 0, policy_version 827851 (0.0009) [2023-12-28 01:12:12,155][106226] Updated weights for policy 0, policy_version 827861 (0.0008) [2023-12-28 01:12:12,217][106226] Updated weights for policy 0, policy_version 827871 (0.0008) [2023-12-28 01:12:12,625][106225] Updated weights for policy 1, policy_version 829890 (0.0009) [2023-12-28 01:12:12,685][106225] Updated weights for policy 1, policy_version 829900 (0.0009) [2023-12-28 01:12:12,748][106225] Updated weights for policy 1, policy_version 829910 (0.0008) [2023-12-28 01:12:12,811][106225] Updated weights for policy 1, policy_version 829920 (0.0009) [2023-12-28 01:12:12,945][106226] Updated weights for policy 0, policy_version 827881 (0.0009) [2023-12-28 01:12:13,001][106226] Updated weights for policy 0, policy_version 827891 (0.0006) [2023-12-28 01:12:13,052][106226] Updated weights for policy 0, policy_version 827901 (0.0008) [2023-12-28 01:12:13,098][106226] Updated weights for policy 0, policy_version 827911 (0.0008) [2023-12-28 01:12:13,518][106225] Updated weights for policy 1, policy_version 829930 (0.0010) [2023-12-28 01:12:13,568][106225] Updated weights for policy 1, policy_version 829940 (0.0010) [2023-12-28 01:12:13,614][106225] Updated weights for policy 1, policy_version 829950 (0.0006) [2023-12-28 01:12:13,822][106226] Updated weights for policy 0, policy_version 827921 (0.0009) [2023-12-28 01:12:13,887][106226] Updated weights for policy 0, policy_version 827931 (0.0008) [2023-12-28 01:12:13,937][106226] Updated weights for policy 0, policy_version 827941 (0.0009) [2023-12-28 01:12:14,188][106225] Updated weights for policy 1, policy_version 829960 (0.0009) [2023-12-28 01:12:14,248][106225] Updated weights for policy 1, policy_version 829970 (0.0008) [2023-12-28 01:12:14,307][106225] Updated weights for policy 1, policy_version 829980 (0.0008) [2023-12-28 01:12:14,656][106226] Updated weights for policy 0, policy_version 827951 (0.0008) [2023-12-28 01:12:14,702][106226] Updated weights for policy 0, policy_version 827961 (0.0008) [2023-12-28 01:12:14,750][106226] Updated weights for policy 0, policy_version 827971 (0.0008) [2023-12-28 01:12:15,054][106225] Updated weights for policy 1, policy_version 829990 (0.0008) [2023-12-28 01:12:15,116][106225] Updated weights for policy 1, policy_version 830000 (0.0010) [2023-12-28 01:12:15,171][106225] Updated weights for policy 1, policy_version 830010 (0.0010) [2023-12-28 01:12:15,521][106226] Updated weights for policy 0, policy_version 827981 (0.0009) [2023-12-28 01:12:15,576][106226] Updated weights for policy 0, policy_version 827991 (0.0009) [2023-12-28 01:12:15,630][106226] Updated weights for policy 0, policy_version 828001 (0.0006) [2023-12-28 01:12:15,880][106225] Updated weights for policy 1, policy_version 830020 (0.0010) [2023-12-28 01:12:15,928][106225] Updated weights for policy 1, policy_version 830030 (0.0008) [2023-12-28 01:12:15,975][106225] Updated weights for policy 1, policy_version 830040 (0.0008) [2023-12-28 01:12:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 424558592. Throughput: 0: 10068.7, 1: 9846.3. Samples: 424547100. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:16,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-4.890')] [2023-12-28 01:12:16,246][106226] Updated weights for policy 0, policy_version 828011 (0.0007) [2023-12-28 01:12:16,313][106226] Updated weights for policy 0, policy_version 828021 (0.0009) [2023-12-28 01:12:16,373][106226] Updated weights for policy 0, policy_version 828031 (0.0009) [2023-12-28 01:12:16,783][106225] Updated weights for policy 1, policy_version 830050 (0.0009) [2023-12-28 01:12:16,837][106225] Updated weights for policy 1, policy_version 830060 (0.0009) [2023-12-28 01:12:16,890][106225] Updated weights for policy 1, policy_version 830070 (0.0009) [2023-12-28 01:12:16,941][106225] Updated weights for policy 1, policy_version 830080 (0.0009) [2023-12-28 01:12:17,115][106226] Updated weights for policy 0, policy_version 828041 (0.0008) [2023-12-28 01:12:17,169][106226] Updated weights for policy 0, policy_version 828051 (0.0006) [2023-12-28 01:12:17,214][106226] Updated weights for policy 0, policy_version 828061 (0.0008) [2023-12-28 01:12:17,258][106226] Updated weights for policy 0, policy_version 828071 (0.0008) [2023-12-28 01:12:17,671][106225] Updated weights for policy 1, policy_version 830090 (0.0007) [2023-12-28 01:12:17,734][106225] Updated weights for policy 1, policy_version 830100 (0.0007) [2023-12-28 01:12:17,790][106225] Updated weights for policy 1, policy_version 830110 (0.0008) [2023-12-28 01:12:17,968][106226] Updated weights for policy 0, policy_version 828081 (0.0005) [2023-12-28 01:12:18,023][106226] Updated weights for policy 0, policy_version 828091 (0.0007) [2023-12-28 01:12:18,084][106226] Updated weights for policy 0, policy_version 828101 (0.0009) [2023-12-28 01:12:18,514][106225] Updated weights for policy 1, policy_version 830120 (0.0008) [2023-12-28 01:12:18,571][106225] Updated weights for policy 1, policy_version 830130 (0.0008) [2023-12-28 01:12:18,624][106225] Updated weights for policy 1, policy_version 830140 (0.0008) [2023-12-28 01:12:18,725][106226] Updated weights for policy 0, policy_version 828111 (0.0006) [2023-12-28 01:12:18,774][106226] Updated weights for policy 0, policy_version 828121 (0.0005) [2023-12-28 01:12:18,827][106226] Updated weights for policy 0, policy_version 828131 (0.0005) [2023-12-28 01:12:19,445][106225] Updated weights for policy 1, policy_version 830150 (0.0009) [2023-12-28 01:12:19,502][106225] Updated weights for policy 1, policy_version 830160 (0.0008) [2023-12-28 01:12:19,509][106226] Updated weights for policy 0, policy_version 828141 (0.0008) [2023-12-28 01:12:19,558][106225] Updated weights for policy 1, policy_version 830170 (0.0007) [2023-12-28 01:12:19,577][106226] Updated weights for policy 0, policy_version 828151 (0.0009) [2023-12-28 01:12:19,643][106226] Updated weights for policy 0, policy_version 828161 (0.0007) [2023-12-28 01:12:20,237][106225] Updated weights for policy 1, policy_version 830180 (0.0009) [2023-12-28 01:12:20,300][106225] Updated weights for policy 1, policy_version 830190 (0.0008) [2023-12-28 01:12:20,308][106226] Updated weights for policy 0, policy_version 828171 (0.0007) [2023-12-28 01:12:20,366][106225] Updated weights for policy 1, policy_version 830200 (0.0007) [2023-12-28 01:12:20,371][106226] Updated weights for policy 0, policy_version 828181 (0.0010) [2023-12-28 01:12:20,426][106226] Updated weights for policy 0, policy_version 828191 (0.0011) [2023-12-28 01:12:21,125][106226] Updated weights for policy 0, policy_version 828201 (0.0010) [2023-12-28 01:12:21,142][106225] Updated weights for policy 1, policy_version 830210 (0.0006) [2023-12-28 01:12:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 424648704. Throughput: 0: 10085.8, 1: 9822.7. Samples: 424665624. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:21,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.146')] [2023-12-28 01:12:21,190][106226] Updated weights for policy 0, policy_version 828211 (0.0008) [2023-12-28 01:12:21,202][106225] Updated weights for policy 1, policy_version 830220 (0.0008) [2023-12-28 01:12:21,250][106226] Updated weights for policy 0, policy_version 828221 (0.0008) [2023-12-28 01:12:21,265][106225] Updated weights for policy 1, policy_version 830230 (0.0008) [2023-12-28 01:12:21,312][106226] Updated weights for policy 0, policy_version 828231 (0.0008) [2023-12-28 01:12:21,328][106225] Updated weights for policy 1, policy_version 830240 (0.0007) [2023-12-28 01:12:22,057][106226] Updated weights for policy 0, policy_version 828241 (0.0006) [2023-12-28 01:12:22,101][106225] Updated weights for policy 1, policy_version 830250 (0.0009) [2023-12-28 01:12:22,122][106226] Updated weights for policy 0, policy_version 828251 (0.0007) [2023-12-28 01:12:22,167][106225] Updated weights for policy 1, policy_version 830260 (0.0008) [2023-12-28 01:12:22,181][106226] Updated weights for policy 0, policy_version 828261 (0.0006) [2023-12-28 01:12:22,224][106225] Updated weights for policy 1, policy_version 830270 (0.0007) [2023-12-28 01:12:22,850][106226] Updated weights for policy 0, policy_version 828271 (0.0008) [2023-12-28 01:12:22,905][106226] Updated weights for policy 0, policy_version 828281 (0.0006) [2023-12-28 01:12:22,961][106226] Updated weights for policy 0, policy_version 828291 (0.0006) [2023-12-28 01:12:22,993][106225] Updated weights for policy 1, policy_version 830280 (0.0009) [2023-12-28 01:12:23,042][106225] Updated weights for policy 1, policy_version 830290 (0.0006) [2023-12-28 01:12:23,092][106225] Updated weights for policy 1, policy_version 830300 (0.0006) [2023-12-28 01:12:23,498][106226] Updated weights for policy 0, policy_version 828301 (0.0005) [2023-12-28 01:12:23,561][106226] Updated weights for policy 0, policy_version 828311 (0.0009) [2023-12-28 01:12:23,623][106226] Updated weights for policy 0, policy_version 828321 (0.0005) [2023-12-28 01:12:23,710][106225] Updated weights for policy 1, policy_version 830310 (0.0005) [2023-12-28 01:12:23,766][106225] Updated weights for policy 1, policy_version 830320 (0.0005) [2023-12-28 01:12:23,826][106225] Updated weights for policy 1, policy_version 830330 (0.0008) [2023-12-28 01:12:24,279][106226] Updated weights for policy 0, policy_version 828331 (0.0006) [2023-12-28 01:12:24,334][106226] Updated weights for policy 0, policy_version 828341 (0.0009) [2023-12-28 01:12:24,402][106226] Updated weights for policy 0, policy_version 828351 (0.0009) [2023-12-28 01:12:24,506][106225] Updated weights for policy 1, policy_version 830340 (0.0008) [2023-12-28 01:12:24,555][106225] Updated weights for policy 1, policy_version 830350 (0.0008) [2023-12-28 01:12:24,610][106225] Updated weights for policy 1, policy_version 830360 (0.0008) [2023-12-28 01:12:25,133][106226] Updated weights for policy 0, policy_version 828361 (0.0009) [2023-12-28 01:12:25,185][106226] Updated weights for policy 0, policy_version 828371 (0.0008) [2023-12-28 01:12:25,244][106226] Updated weights for policy 0, policy_version 828381 (0.0008) [2023-12-28 01:12:25,299][106226] Updated weights for policy 0, policy_version 828391 (0.0008) [2023-12-28 01:12:25,343][106225] Updated weights for policy 1, policy_version 830370 (0.0008) [2023-12-28 01:12:25,400][106225] Updated weights for policy 1, policy_version 830380 (0.0009) [2023-12-28 01:12:25,465][106225] Updated weights for policy 1, policy_version 830390 (0.0008) [2023-12-28 01:12:25,517][106225] Updated weights for policy 1, policy_version 830400 (0.0008) [2023-12-28 01:12:25,900][106226] Updated weights for policy 0, policy_version 828401 (0.0009) [2023-12-28 01:12:25,948][106226] Updated weights for policy 0, policy_version 828411 (0.0008) [2023-12-28 01:12:26,001][106226] Updated weights for policy 0, policy_version 828421 (0.0008) [2023-12-28 01:12:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 424755200. Throughput: 0: 10102.7, 1: 9753.6. Samples: 424724700. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:26,176][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.154')] [2023-12-28 01:12:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000828424_212131840.pth... [2023-12-28 01:12:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000830400_212623360.pth... [2023-12-28 01:12:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000827240_211828736.pth [2023-12-28 01:12:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000829280_212336640.pth [2023-12-28 01:12:26,267][106225] Updated weights for policy 1, policy_version 830410 (0.0008) [2023-12-28 01:12:26,323][106225] Updated weights for policy 1, policy_version 830420 (0.0008) [2023-12-28 01:12:26,377][106225] Updated weights for policy 1, policy_version 830430 (0.0008) [2023-12-28 01:12:26,779][106226] Updated weights for policy 0, policy_version 828431 (0.0009) [2023-12-28 01:12:26,827][106226] Updated weights for policy 0, policy_version 828441 (0.0008) [2023-12-28 01:12:26,878][106226] Updated weights for policy 0, policy_version 828451 (0.0008) [2023-12-28 01:12:27,017][106225] Updated weights for policy 1, policy_version 830440 (0.0006) [2023-12-28 01:12:27,080][106225] Updated weights for policy 1, policy_version 830450 (0.0005) [2023-12-28 01:12:27,132][106225] Updated weights for policy 1, policy_version 830460 (0.0005) [2023-12-28 01:12:27,570][106226] Updated weights for policy 0, policy_version 828461 (0.0007) [2023-12-28 01:12:27,627][106226] Updated weights for policy 0, policy_version 828471 (0.0005) [2023-12-28 01:12:27,682][106226] Updated weights for policy 0, policy_version 828481 (0.0005) [2023-12-28 01:12:27,718][106225] Updated weights for policy 1, policy_version 830470 (0.0007) [2023-12-28 01:12:27,779][106225] Updated weights for policy 1, policy_version 830480 (0.0008) [2023-12-28 01:12:27,830][106225] Updated weights for policy 1, policy_version 830490 (0.0009) [2023-12-28 01:12:28,299][106226] Updated weights for policy 0, policy_version 828491 (0.0006) [2023-12-28 01:12:28,363][106226] Updated weights for policy 0, policy_version 828501 (0.0007) [2023-12-28 01:12:28,421][106226] Updated weights for policy 0, policy_version 828511 (0.0008) [2023-12-28 01:12:28,603][106225] Updated weights for policy 1, policy_version 830500 (0.0008) [2023-12-28 01:12:28,652][106225] Updated weights for policy 1, policy_version 830510 (0.0008) [2023-12-28 01:12:28,702][106225] Updated weights for policy 1, policy_version 830520 (0.0008) [2023-12-28 01:12:29,133][106226] Updated weights for policy 0, policy_version 828521 (0.0008) [2023-12-28 01:12:29,188][106226] Updated weights for policy 0, policy_version 828531 (0.0005) [2023-12-28 01:12:29,253][106226] Updated weights for policy 0, policy_version 828541 (0.0007) [2023-12-28 01:12:29,319][106226] Updated weights for policy 0, policy_version 828551 (0.0010) [2023-12-28 01:12:29,342][106225] Updated weights for policy 1, policy_version 830530 (0.0008) [2023-12-28 01:12:29,408][106225] Updated weights for policy 1, policy_version 830540 (0.0008) [2023-12-28 01:12:29,474][106225] Updated weights for policy 1, policy_version 830550 (0.0007) [2023-12-28 01:12:29,537][106225] Updated weights for policy 1, policy_version 830560 (0.0007) [2023-12-28 01:12:29,997][106226] Updated weights for policy 0, policy_version 828561 (0.0009) [2023-12-28 01:12:30,063][106226] Updated weights for policy 0, policy_version 828571 (0.0008) [2023-12-28 01:12:30,135][106226] Updated weights for policy 0, policy_version 828581 (0.0011) [2023-12-28 01:12:30,237][106225] Updated weights for policy 1, policy_version 830570 (0.0008) [2023-12-28 01:12:30,303][106225] Updated weights for policy 1, policy_version 830580 (0.0008) [2023-12-28 01:12:30,367][106225] Updated weights for policy 1, policy_version 830590 (0.0008) [2023-12-28 01:12:30,807][106226] Updated weights for policy 0, policy_version 828591 (0.0007) [2023-12-28 01:12:30,861][106226] Updated weights for policy 0, policy_version 828601 (0.0005) [2023-12-28 01:12:30,918][106226] Updated weights for policy 0, policy_version 828611 (0.0009) [2023-12-28 01:12:31,121][106225] Updated weights for policy 1, policy_version 830600 (0.0008) [2023-12-28 01:12:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 424853504. Throughput: 0: 10091.0, 1: 9836.7. Samples: 424845192. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:31,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-5.025')] [2023-12-28 01:12:31,185][106225] Updated weights for policy 1, policy_version 830610 (0.0008) [2023-12-28 01:12:31,244][106225] Updated weights for policy 1, policy_version 830620 (0.0008) [2023-12-28 01:12:31,602][106226] Updated weights for policy 0, policy_version 828621 (0.0009) [2023-12-28 01:12:31,668][106226] Updated weights for policy 0, policy_version 828631 (0.0008) [2023-12-28 01:12:31,736][106226] Updated weights for policy 0, policy_version 828641 (0.0008) [2023-12-28 01:12:31,967][106225] Updated weights for policy 1, policy_version 830630 (0.0009) [2023-12-28 01:12:32,029][106225] Updated weights for policy 1, policy_version 830640 (0.0009) [2023-12-28 01:12:32,091][106225] Updated weights for policy 1, policy_version 830650 (0.0008) [2023-12-28 01:12:32,469][106226] Updated weights for policy 0, policy_version 828651 (0.0009) [2023-12-28 01:12:32,524][106226] Updated weights for policy 0, policy_version 828661 (0.0008) [2023-12-28 01:12:32,573][106226] Updated weights for policy 0, policy_version 828671 (0.0008) [2023-12-28 01:12:32,809][106225] Updated weights for policy 1, policy_version 830660 (0.0007) [2023-12-28 01:12:32,865][106225] Updated weights for policy 1, policy_version 830670 (0.0006) [2023-12-28 01:12:32,919][106225] Updated weights for policy 1, policy_version 830680 (0.0005) [2023-12-28 01:12:33,248][106226] Updated weights for policy 0, policy_version 828681 (0.0009) [2023-12-28 01:12:33,294][106226] Updated weights for policy 0, policy_version 828691 (0.0009) [2023-12-28 01:12:33,343][106226] Updated weights for policy 0, policy_version 828701 (0.0008) [2023-12-28 01:12:33,390][106226] Updated weights for policy 0, policy_version 828711 (0.0008) [2023-12-28 01:12:33,482][106225] Updated weights for policy 1, policy_version 830690 (0.0005) [2023-12-28 01:12:33,532][106225] Updated weights for policy 1, policy_version 830700 (0.0005) [2023-12-28 01:12:33,578][106225] Updated weights for policy 1, policy_version 830710 (0.0005) [2023-12-28 01:12:33,625][106225] Updated weights for policy 1, policy_version 830720 (0.0005) [2023-12-28 01:12:34,186][106226] Updated weights for policy 0, policy_version 828721 (0.0009) [2023-12-28 01:12:34,252][106226] Updated weights for policy 0, policy_version 828731 (0.0008) [2023-12-28 01:12:34,296][106225] Updated weights for policy 1, policy_version 830730 (0.0008) [2023-12-28 01:12:34,319][106226] Updated weights for policy 0, policy_version 828741 (0.0006) [2023-12-28 01:12:34,360][106225] Updated weights for policy 1, policy_version 830740 (0.0007) [2023-12-28 01:12:34,418][106225] Updated weights for policy 1, policy_version 830750 (0.0005) [2023-12-28 01:12:35,035][106226] Updated weights for policy 0, policy_version 828751 (0.0007) [2023-12-28 01:12:35,059][106225] Updated weights for policy 1, policy_version 830760 (0.0006) [2023-12-28 01:12:35,094][106226] Updated weights for policy 0, policy_version 828761 (0.0005) [2023-12-28 01:12:35,106][106225] Updated weights for policy 1, policy_version 830770 (0.0008) [2023-12-28 01:12:35,153][106226] Updated weights for policy 0, policy_version 828771 (0.0007) [2023-12-28 01:12:35,167][106225] Updated weights for policy 1, policy_version 830780 (0.0009) [2023-12-28 01:12:35,757][106225] Updated weights for policy 1, policy_version 830790 (0.0006) [2023-12-28 01:12:35,828][106225] Updated weights for policy 1, policy_version 830800 (0.0006) [2023-12-28 01:12:35,889][106225] Updated weights for policy 1, policy_version 830810 (0.0007) [2023-12-28 01:12:35,894][106226] Updated weights for policy 0, policy_version 828781 (0.0009) [2023-12-28 01:12:35,939][106226] Updated weights for policy 0, policy_version 828791 (0.0010) [2023-12-28 01:12:35,997][106226] Updated weights for policy 0, policy_version 828801 (0.0011) [2023-12-28 01:12:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 424960000. Throughput: 0: 10073.9, 1: 9815.5. Samples: 424964960. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:36,175][105115] Avg episode reward: [(0, '-4.247'), (1, '-5.079')] [2023-12-28 01:12:36,631][106225] Updated weights for policy 1, policy_version 830820 (0.0009) [2023-12-28 01:12:36,687][106225] Updated weights for policy 1, policy_version 830830 (0.0008) [2023-12-28 01:12:36,746][106226] Updated weights for policy 0, policy_version 828811 (0.0011) [2023-12-28 01:12:36,752][106225] Updated weights for policy 1, policy_version 830840 (0.0007) [2023-12-28 01:12:36,807][106226] Updated weights for policy 0, policy_version 828821 (0.0011) [2023-12-28 01:12:36,864][106226] Updated weights for policy 0, policy_version 828831 (0.0007) [2023-12-28 01:12:37,518][106225] Updated weights for policy 1, policy_version 830850 (0.0007) [2023-12-28 01:12:37,562][106226] Updated weights for policy 0, policy_version 828841 (0.0008) [2023-12-28 01:12:37,576][106225] Updated weights for policy 1, policy_version 830860 (0.0008) [2023-12-28 01:12:37,623][106226] Updated weights for policy 0, policy_version 828851 (0.0009) [2023-12-28 01:12:37,634][106225] Updated weights for policy 1, policy_version 830870 (0.0007) [2023-12-28 01:12:37,683][106225] Updated weights for policy 1, policy_version 830880 (0.0008) [2023-12-28 01:12:37,689][106226] Updated weights for policy 0, policy_version 828861 (0.0006) [2023-12-28 01:12:37,742][106226] Updated weights for policy 0, policy_version 828871 (0.0007) [2023-12-28 01:12:38,424][106225] Updated weights for policy 1, policy_version 830890 (0.0008) [2023-12-28 01:12:38,460][106226] Updated weights for policy 0, policy_version 828881 (0.0009) [2023-12-28 01:12:38,488][106225] Updated weights for policy 1, policy_version 830900 (0.0007) [2023-12-28 01:12:38,521][106226] Updated weights for policy 0, policy_version 828891 (0.0007) [2023-12-28 01:12:38,548][106225] Updated weights for policy 1, policy_version 830910 (0.0009) [2023-12-28 01:12:38,583][106226] Updated weights for policy 0, policy_version 828901 (0.0005) [2023-12-28 01:12:39,238][106225] Updated weights for policy 1, policy_version 830920 (0.0008) [2023-12-28 01:12:39,259][106226] Updated weights for policy 0, policy_version 828911 (0.0007) [2023-12-28 01:12:39,298][106225] Updated weights for policy 1, policy_version 830930 (0.0006) [2023-12-28 01:12:39,326][106226] Updated weights for policy 0, policy_version 828921 (0.0010) [2023-12-28 01:12:39,360][106225] Updated weights for policy 1, policy_version 830940 (0.0009) [2023-12-28 01:12:39,391][106226] Updated weights for policy 0, policy_version 828931 (0.0009) [2023-12-28 01:12:40,048][106225] Updated weights for policy 1, policy_version 830950 (0.0009) [2023-12-28 01:12:40,113][106225] Updated weights for policy 1, policy_version 830960 (0.0008) [2023-12-28 01:12:40,116][106226] Updated weights for policy 0, policy_version 828941 (0.0008) [2023-12-28 01:12:40,173][106225] Updated weights for policy 1, policy_version 830970 (0.0008) [2023-12-28 01:12:40,179][106226] Updated weights for policy 0, policy_version 828951 (0.0009) [2023-12-28 01:12:40,238][106226] Updated weights for policy 0, policy_version 828961 (0.0011) [2023-12-28 01:12:40,894][106226] Updated weights for policy 0, policy_version 828971 (0.0009) [2023-12-28 01:12:40,903][106225] Updated weights for policy 1, policy_version 830980 (0.0006) [2023-12-28 01:12:40,958][106226] Updated weights for policy 0, policy_version 828981 (0.0006) [2023-12-28 01:12:40,964][106225] Updated weights for policy 1, policy_version 830990 (0.0010) [2023-12-28 01:12:41,015][106226] Updated weights for policy 0, policy_version 828991 (0.0006) [2023-12-28 01:12:41,027][106225] Updated weights for policy 1, policy_version 831000 (0.0011) [2023-12-28 01:12:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 425058304. Throughput: 0: 10058.7, 1: 9747.8. Samples: 425022408. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:41,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-5.073')] [2023-12-28 01:12:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000831008_212779008.pth... [2023-12-28 01:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000829000_212279296.pth... [2023-12-28 01:12:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000829856_212484096.pth [2023-12-28 01:12:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000827848_211984384.pth [2023-12-28 01:12:41,784][106226] Updated weights for policy 0, policy_version 829001 (0.0007) [2023-12-28 01:12:41,824][106225] Updated weights for policy 1, policy_version 831010 (0.0010) [2023-12-28 01:12:41,853][106226] Updated weights for policy 0, policy_version 829011 (0.0006) [2023-12-28 01:12:41,889][106225] Updated weights for policy 1, policy_version 831020 (0.0008) [2023-12-28 01:12:41,915][106226] Updated weights for policy 0, policy_version 829021 (0.0006) [2023-12-28 01:12:41,946][106225] Updated weights for policy 1, policy_version 831030 (0.0007) [2023-12-28 01:12:41,979][106226] Updated weights for policy 0, policy_version 829031 (0.0007) [2023-12-28 01:12:42,005][106225] Updated weights for policy 1, policy_version 831040 (0.0007) [2023-12-28 01:12:42,743][106226] Updated weights for policy 0, policy_version 829041 (0.0009) [2023-12-28 01:12:42,788][106225] Updated weights for policy 1, policy_version 831050 (0.0006) [2023-12-28 01:12:42,794][106226] Updated weights for policy 0, policy_version 829051 (0.0007) [2023-12-28 01:12:42,848][106226] Updated weights for policy 0, policy_version 829061 (0.0005) [2023-12-28 01:12:42,849][106225] Updated weights for policy 1, policy_version 831060 (0.0008) [2023-12-28 01:12:42,900][106225] Updated weights for policy 1, policy_version 831070 (0.0006) [2023-12-28 01:12:43,560][106225] Updated weights for policy 1, policy_version 831080 (0.0005) [2023-12-28 01:12:43,595][106226] Updated weights for policy 0, policy_version 829071 (0.0008) [2023-12-28 01:12:43,612][106225] Updated weights for policy 1, policy_version 831090 (0.0005) [2023-12-28 01:12:43,644][106226] Updated weights for policy 0, policy_version 829081 (0.0008) [2023-12-28 01:12:43,664][106225] Updated weights for policy 1, policy_version 831100 (0.0005) [2023-12-28 01:12:43,700][106226] Updated weights for policy 0, policy_version 829091 (0.0007) [2023-12-28 01:12:44,292][106225] Updated weights for policy 1, policy_version 831110 (0.0008) [2023-12-28 01:12:44,355][106225] Updated weights for policy 1, policy_version 831120 (0.0010) [2023-12-28 01:12:44,364][106226] Updated weights for policy 0, policy_version 829101 (0.0007) [2023-12-28 01:12:44,409][106225] Updated weights for policy 1, policy_version 831130 (0.0010) [2023-12-28 01:12:44,425][106226] Updated weights for policy 0, policy_version 829111 (0.0007) [2023-12-28 01:12:44,491][106226] Updated weights for policy 0, policy_version 829121 (0.0009) [2023-12-28 01:12:45,014][106225] Updated weights for policy 1, policy_version 831140 (0.0010) [2023-12-28 01:12:45,068][106225] Updated weights for policy 1, policy_version 831150 (0.0010) [2023-12-28 01:12:45,126][106225] Updated weights for policy 1, policy_version 831160 (0.0010) [2023-12-28 01:12:45,159][106226] Updated weights for policy 0, policy_version 829131 (0.0009) [2023-12-28 01:12:45,218][106226] Updated weights for policy 0, policy_version 829141 (0.0011) [2023-12-28 01:12:45,269][106226] Updated weights for policy 0, policy_version 829151 (0.0010) [2023-12-28 01:12:45,776][106225] Updated weights for policy 1, policy_version 831170 (0.0008) [2023-12-28 01:12:45,830][106225] Updated weights for policy 1, policy_version 831180 (0.0006) [2023-12-28 01:12:45,876][106225] Updated weights for policy 1, policy_version 831190 (0.0005) [2023-12-28 01:12:45,930][106225] Updated weights for policy 1, policy_version 831200 (0.0005) [2023-12-28 01:12:45,994][106226] Updated weights for policy 0, policy_version 829161 (0.0008) [2023-12-28 01:12:46,048][106226] Updated weights for policy 0, policy_version 829171 (0.0010) [2023-12-28 01:12:46,105][106226] Updated weights for policy 0, policy_version 829181 (0.0011) [2023-12-28 01:12:46,151][106226] Updated weights for policy 0, policy_version 829191 (0.0010) [2023-12-28 01:12:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 425156608. Throughput: 0: 9994.6, 1: 9743.4. Samples: 425139168. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:46,176][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.898')] [2023-12-28 01:12:46,476][106225] Updated weights for policy 1, policy_version 831210 (0.0008) [2023-12-28 01:12:46,543][106225] Updated weights for policy 1, policy_version 831220 (0.0007) [2023-12-28 01:12:46,605][106225] Updated weights for policy 1, policy_version 831230 (0.0006) [2023-12-28 01:12:46,868][106226] Updated weights for policy 0, policy_version 829201 (0.0006) [2023-12-28 01:12:46,929][106226] Updated weights for policy 0, policy_version 829211 (0.0006) [2023-12-28 01:12:46,984][106226] Updated weights for policy 0, policy_version 829221 (0.0006) [2023-12-28 01:12:47,320][106225] Updated weights for policy 1, policy_version 831240 (0.0008) [2023-12-28 01:12:47,376][106225] Updated weights for policy 1, policy_version 831250 (0.0008) [2023-12-28 01:12:47,430][106225] Updated weights for policy 1, policy_version 831260 (0.0009) [2023-12-28 01:12:47,569][106226] Updated weights for policy 0, policy_version 829231 (0.0009) [2023-12-28 01:12:47,625][106226] Updated weights for policy 0, policy_version 829241 (0.0010) [2023-12-28 01:12:47,682][106226] Updated weights for policy 0, policy_version 829251 (0.0010) [2023-12-28 01:12:48,164][106225] Updated weights for policy 1, policy_version 831270 (0.0008) [2023-12-28 01:12:48,227][106225] Updated weights for policy 1, policy_version 831280 (0.0009) [2023-12-28 01:12:48,277][106225] Updated weights for policy 1, policy_version 831290 (0.0006) [2023-12-28 01:12:48,418][106226] Updated weights for policy 0, policy_version 829261 (0.0008) [2023-12-28 01:12:48,484][106226] Updated weights for policy 0, policy_version 829271 (0.0007) [2023-12-28 01:12:48,548][106226] Updated weights for policy 0, policy_version 829281 (0.0008) [2023-12-28 01:12:48,983][106225] Updated weights for policy 1, policy_version 831300 (0.0007) [2023-12-28 01:12:49,044][106225] Updated weights for policy 1, policy_version 831310 (0.0010) [2023-12-28 01:12:49,100][106225] Updated weights for policy 1, policy_version 831320 (0.0010) [2023-12-28 01:12:49,257][106226] Updated weights for policy 0, policy_version 829291 (0.0009) [2023-12-28 01:12:49,318][106226] Updated weights for policy 0, policy_version 829301 (0.0010) [2023-12-28 01:12:49,388][106226] Updated weights for policy 0, policy_version 829311 (0.0007) [2023-12-28 01:12:49,852][106225] Updated weights for policy 1, policy_version 831330 (0.0010) [2023-12-28 01:12:49,912][106225] Updated weights for policy 1, policy_version 831340 (0.0010) [2023-12-28 01:12:49,979][106225] Updated weights for policy 1, policy_version 831350 (0.0008) [2023-12-28 01:12:50,037][106225] Updated weights for policy 1, policy_version 831360 (0.0009) [2023-12-28 01:12:50,132][106226] Updated weights for policy 0, policy_version 829321 (0.0010) [2023-12-28 01:12:50,188][106226] Updated weights for policy 0, policy_version 829331 (0.0009) [2023-12-28 01:12:50,248][106226] Updated weights for policy 0, policy_version 829341 (0.0008) [2023-12-28 01:12:50,301][106226] Updated weights for policy 0, policy_version 829351 (0.0009) [2023-12-28 01:12:50,738][106225] Updated weights for policy 1, policy_version 831370 (0.0007) [2023-12-28 01:12:50,806][106225] Updated weights for policy 1, policy_version 831380 (0.0008) [2023-12-28 01:12:50,867][106225] Updated weights for policy 1, policy_version 831390 (0.0008) [2023-12-28 01:12:51,092][106226] Updated weights for policy 0, policy_version 829361 (0.0008) [2023-12-28 01:12:51,160][106226] Updated weights for policy 0, policy_version 829371 (0.0008) [2023-12-28 01:12:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 425246720. Throughput: 0: 9896.8, 1: 9820.3. Samples: 425259408. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:51,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.900')] [2023-12-28 01:12:51,216][106226] Updated weights for policy 0, policy_version 829381 (0.0006) [2023-12-28 01:12:51,630][106225] Updated weights for policy 1, policy_version 831400 (0.0008) [2023-12-28 01:12:51,706][106225] Updated weights for policy 1, policy_version 831410 (0.0008) [2023-12-28 01:12:51,771][106225] Updated weights for policy 1, policy_version 831420 (0.0008) [2023-12-28 01:12:51,969][106226] Updated weights for policy 0, policy_version 829391 (0.0008) [2023-12-28 01:12:52,028][106226] Updated weights for policy 0, policy_version 829401 (0.0008) [2023-12-28 01:12:52,086][106226] Updated weights for policy 0, policy_version 829411 (0.0008) [2023-12-28 01:12:52,504][106225] Updated weights for policy 1, policy_version 831430 (0.0009) [2023-12-28 01:12:52,561][106225] Updated weights for policy 1, policy_version 831440 (0.0009) [2023-12-28 01:12:52,619][106225] Updated weights for policy 1, policy_version 831450 (0.0008) [2023-12-28 01:12:52,826][106226] Updated weights for policy 0, policy_version 829421 (0.0007) [2023-12-28 01:12:52,882][106226] Updated weights for policy 0, policy_version 829431 (0.0006) [2023-12-28 01:12:52,942][106226] Updated weights for policy 0, policy_version 829441 (0.0010) [2023-12-28 01:12:53,372][106225] Updated weights for policy 1, policy_version 831460 (0.0009) [2023-12-28 01:12:53,421][106225] Updated weights for policy 1, policy_version 831470 (0.0010) [2023-12-28 01:12:53,472][106225] Updated weights for policy 1, policy_version 831480 (0.0010) [2023-12-28 01:12:53,589][106226] Updated weights for policy 0, policy_version 829451 (0.0010) [2023-12-28 01:12:53,650][106226] Updated weights for policy 0, policy_version 829461 (0.0009) [2023-12-28 01:12:53,709][106226] Updated weights for policy 0, policy_version 829471 (0.0010) [2023-12-28 01:12:54,190][106225] Updated weights for policy 1, policy_version 831490 (0.0010) [2023-12-28 01:12:54,240][106225] Updated weights for policy 1, policy_version 831500 (0.0010) [2023-12-28 01:12:54,261][106226] Updated weights for policy 0, policy_version 829481 (0.0006) [2023-12-28 01:12:54,293][106225] Updated weights for policy 1, policy_version 831510 (0.0010) [2023-12-28 01:12:54,321][106226] Updated weights for policy 0, policy_version 829491 (0.0008) [2023-12-28 01:12:54,355][106225] Updated weights for policy 1, policy_version 831520 (0.0010) [2023-12-28 01:12:54,378][106226] Updated weights for policy 0, policy_version 829501 (0.0010) [2023-12-28 01:12:54,431][106226] Updated weights for policy 0, policy_version 829511 (0.0010) [2023-12-28 01:12:55,055][106225] Updated weights for policy 1, policy_version 831530 (0.0007) [2023-12-28 01:12:55,095][106226] Updated weights for policy 0, policy_version 829521 (0.0011) [2023-12-28 01:12:55,109][106225] Updated weights for policy 1, policy_version 831540 (0.0007) [2023-12-28 01:12:55,155][106226] Updated weights for policy 0, policy_version 829531 (0.0011) [2023-12-28 01:12:55,171][106225] Updated weights for policy 1, policy_version 831550 (0.0007) [2023-12-28 01:12:55,217][106226] Updated weights for policy 0, policy_version 829541 (0.0011) [2023-12-28 01:12:55,799][106225] Updated weights for policy 1, policy_version 831560 (0.0005) [2023-12-28 01:12:55,830][106226] Updated weights for policy 0, policy_version 829551 (0.0010) [2023-12-28 01:12:55,853][106225] Updated weights for policy 1, policy_version 831570 (0.0005) [2023-12-28 01:12:55,877][106226] Updated weights for policy 0, policy_version 829561 (0.0010) [2023-12-28 01:12:55,907][106225] Updated weights for policy 1, policy_version 831580 (0.0006) [2023-12-28 01:12:55,923][106226] Updated weights for policy 0, policy_version 829571 (0.0010) [2023-12-28 01:12:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 425353216. Throughput: 0: 9865.3, 1: 9777.3. Samples: 425316592. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:12:56,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-5.181')] [2023-12-28 01:12:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000831584_212926464.pth... [2023-12-28 01:12:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000829576_212426752.pth... [2023-12-28 01:12:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000828424_212131840.pth [2023-12-28 01:12:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000830400_212623360.pth [2023-12-28 01:12:56,514][106225] Updated weights for policy 1, policy_version 831590 (0.0007) [2023-12-28 01:12:56,549][106226] Updated weights for policy 0, policy_version 829581 (0.0008) [2023-12-28 01:12:56,560][106225] Updated weights for policy 1, policy_version 831600 (0.0005) [2023-12-28 01:12:56,610][106225] Updated weights for policy 1, policy_version 831610 (0.0006) [2023-12-28 01:12:56,631][106226] Updated weights for policy 0, policy_version 829591 (0.0006) [2023-12-28 01:12:56,698][106226] Updated weights for policy 0, policy_version 829601 (0.0009) [2023-12-28 01:12:57,308][106226] Updated weights for policy 0, policy_version 829611 (0.0008) [2023-12-28 01:12:57,311][106225] Updated weights for policy 1, policy_version 831621 (0.0009) [2023-12-28 01:12:57,369][106225] Updated weights for policy 1, policy_version 831631 (0.0010) [2023-12-28 01:12:57,369][106226] Updated weights for policy 0, policy_version 829621 (0.0006) [2023-12-28 01:12:57,423][106226] Updated weights for policy 0, policy_version 829631 (0.0005) [2023-12-28 01:12:57,435][106225] Updated weights for policy 1, policy_version 831641 (0.0008) [2023-12-28 01:12:58,026][106226] Updated weights for policy 0, policy_version 829641 (0.0006) [2023-12-28 01:12:58,072][106226] Updated weights for policy 0, policy_version 829651 (0.0008) [2023-12-28 01:12:58,094][106225] Updated weights for policy 1, policy_version 831651 (0.0010) [2023-12-28 01:12:58,122][106226] Updated weights for policy 0, policy_version 829661 (0.0006) [2023-12-28 01:12:58,136][106225] Updated weights for policy 1, policy_version 831661 (0.0010) [2023-12-28 01:12:58,170][106226] Updated weights for policy 0, policy_version 829671 (0.0008) [2023-12-28 01:12:58,196][106225] Updated weights for policy 1, policy_version 831671 (0.0010) [2023-12-28 01:12:58,969][106225] Updated weights for policy 1, policy_version 831681 (0.0008) [2023-12-28 01:12:59,024][106225] Updated weights for policy 1, policy_version 831691 (0.0008) [2023-12-28 01:12:59,052][106226] Updated weights for policy 0, policy_version 829681 (0.0006) [2023-12-28 01:12:59,083][106225] Updated weights for policy 1, policy_version 831701 (0.0007) [2023-12-28 01:12:59,114][106226] Updated weights for policy 0, policy_version 829691 (0.0009) [2023-12-28 01:12:59,149][106225] Updated weights for policy 1, policy_version 831711 (0.0007) [2023-12-28 01:12:59,180][106226] Updated weights for policy 0, policy_version 829701 (0.0009) [2023-12-28 01:12:59,863][106226] Updated weights for policy 0, policy_version 829711 (0.0007) [2023-12-28 01:12:59,868][106225] Updated weights for policy 1, policy_version 831721 (0.0007) [2023-12-28 01:12:59,925][106226] Updated weights for policy 0, policy_version 829721 (0.0009) [2023-12-28 01:12:59,939][106225] Updated weights for policy 1, policy_version 831731 (0.0006) [2023-12-28 01:12:59,989][106226] Updated weights for policy 0, policy_version 829731 (0.0007) [2023-12-28 01:12:59,998][106225] Updated weights for policy 1, policy_version 831741 (0.0008) [2023-12-28 01:13:00,643][106226] Updated weights for policy 0, policy_version 829741 (0.0008) [2023-12-28 01:13:00,673][106225] Updated weights for policy 1, policy_version 831751 (0.0008) [2023-12-28 01:13:00,706][106226] Updated weights for policy 0, policy_version 829751 (0.0005) [2023-12-28 01:13:00,740][106225] Updated weights for policy 1, policy_version 831761 (0.0005) [2023-12-28 01:13:00,758][106226] Updated weights for policy 0, policy_version 829761 (0.0008) [2023-12-28 01:13:00,799][106225] Updated weights for policy 1, policy_version 831771 (0.0005) [2023-12-28 01:13:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 425451520. Throughput: 0: 9970.4, 1: 9862.3. Samples: 425439572. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:01,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-5.168')] [2023-12-28 01:13:01,432][106226] Updated weights for policy 0, policy_version 829771 (0.0010) [2023-12-28 01:13:01,469][106225] Updated weights for policy 1, policy_version 831781 (0.0008) [2023-12-28 01:13:01,484][106226] Updated weights for policy 0, policy_version 829781 (0.0011) [2023-12-28 01:13:01,520][106225] Updated weights for policy 1, policy_version 831791 (0.0010) [2023-12-28 01:13:01,541][106226] Updated weights for policy 0, policy_version 829791 (0.0011) [2023-12-28 01:13:01,580][106225] Updated weights for policy 1, policy_version 831801 (0.0008) [2023-12-28 01:13:02,232][106226] Updated weights for policy 0, policy_version 829801 (0.0010) [2023-12-28 01:13:02,302][106226] Updated weights for policy 0, policy_version 829811 (0.0010) [2023-12-28 01:13:02,369][106226] Updated weights for policy 0, policy_version 829821 (0.0012) [2023-12-28 01:13:02,392][106225] Updated weights for policy 1, policy_version 831811 (0.0009) [2023-12-28 01:13:02,435][106226] Updated weights for policy 0, policy_version 829831 (0.0011) [2023-12-28 01:13:02,441][106225] Updated weights for policy 1, policy_version 831821 (0.0010) [2023-12-28 01:13:02,501][106225] Updated weights for policy 1, policy_version 831831 (0.0010) [2023-12-28 01:13:03,112][106226] Updated weights for policy 0, policy_version 829841 (0.0008) [2023-12-28 01:13:03,140][106225] Updated weights for policy 1, policy_version 831841 (0.0008) [2023-12-28 01:13:03,168][106226] Updated weights for policy 0, policy_version 829851 (0.0010) [2023-12-28 01:13:03,190][106225] Updated weights for policy 1, policy_version 831851 (0.0007) [2023-12-28 01:13:03,222][106226] Updated weights for policy 0, policy_version 829861 (0.0010) [2023-12-28 01:13:03,246][106225] Updated weights for policy 1, policy_version 831861 (0.0006) [2023-12-28 01:13:03,296][106225] Updated weights for policy 1, policy_version 831871 (0.0008) [2023-12-28 01:13:03,867][106226] Updated weights for policy 0, policy_version 829871 (0.0010) [2023-12-28 01:13:03,933][106226] Updated weights for policy 0, policy_version 829881 (0.0008) [2023-12-28 01:13:03,989][106226] Updated weights for policy 0, policy_version 829891 (0.0008) [2023-12-28 01:13:03,996][106225] Updated weights for policy 1, policy_version 831881 (0.0006) [2023-12-28 01:13:04,049][106225] Updated weights for policy 1, policy_version 831891 (0.0006) [2023-12-28 01:13:04,107][106225] Updated weights for policy 1, policy_version 831901 (0.0009) [2023-12-28 01:13:04,742][106226] Updated weights for policy 0, policy_version 829901 (0.0007) [2023-12-28 01:13:04,753][106225] Updated weights for policy 1, policy_version 831911 (0.0008) [2023-12-28 01:13:04,800][106226] Updated weights for policy 0, policy_version 829911 (0.0007) [2023-12-28 01:13:04,806][106225] Updated weights for policy 1, policy_version 831921 (0.0008) [2023-12-28 01:13:04,852][106225] Updated weights for policy 1, policy_version 831931 (0.0010) [2023-12-28 01:13:04,858][106226] Updated weights for policy 0, policy_version 829921 (0.0005) [2023-12-28 01:13:05,495][106226] Updated weights for policy 0, policy_version 829931 (0.0007) [2023-12-28 01:13:05,547][106226] Updated weights for policy 0, policy_version 829941 (0.0008) [2023-12-28 01:13:05,560][106225] Updated weights for policy 1, policy_version 831941 (0.0007) [2023-12-28 01:13:05,598][106226] Updated weights for policy 0, policy_version 829951 (0.0008) [2023-12-28 01:13:05,612][106225] Updated weights for policy 1, policy_version 831951 (0.0005) [2023-12-28 01:13:05,672][106225] Updated weights for policy 1, policy_version 831961 (0.0010) [2023-12-28 01:13:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 425549824. Throughput: 0: 9950.7, 1: 9936.9. Samples: 425560568. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:06,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.066')] [2023-12-28 01:13:06,315][106225] Updated weights for policy 1, policy_version 831971 (0.0010) [2023-12-28 01:13:06,352][106226] Updated weights for policy 0, policy_version 829961 (0.0008) [2023-12-28 01:13:06,381][106225] Updated weights for policy 1, policy_version 831981 (0.0011) [2023-12-28 01:13:06,416][106226] Updated weights for policy 0, policy_version 829971 (0.0006) [2023-12-28 01:13:06,439][106225] Updated weights for policy 1, policy_version 831991 (0.0011) [2023-12-28 01:13:06,481][106226] Updated weights for policy 0, policy_version 829981 (0.0007) [2023-12-28 01:13:06,544][106226] Updated weights for policy 0, policy_version 829991 (0.0008) [2023-12-28 01:13:07,164][106225] Updated weights for policy 1, policy_version 832001 (0.0010) [2023-12-28 01:13:07,219][106225] Updated weights for policy 1, policy_version 832011 (0.0011) [2023-12-28 01:13:07,258][106226] Updated weights for policy 0, policy_version 830001 (0.0006) [2023-12-28 01:13:07,284][106225] Updated weights for policy 1, policy_version 832021 (0.0011) [2023-12-28 01:13:07,322][106226] Updated weights for policy 0, policy_version 830011 (0.0005) [2023-12-28 01:13:07,335][106225] Updated weights for policy 1, policy_version 832031 (0.0010) [2023-12-28 01:13:07,383][106226] Updated weights for policy 0, policy_version 830021 (0.0005) [2023-12-28 01:13:07,938][106226] Updated weights for policy 0, policy_version 830031 (0.0005) [2023-12-28 01:13:08,003][106226] Updated weights for policy 0, policy_version 830041 (0.0008) [2023-12-28 01:13:08,058][106225] Updated weights for policy 1, policy_version 832041 (0.0010) [2023-12-28 01:13:08,064][106226] Updated weights for policy 0, policy_version 830051 (0.0006) [2023-12-28 01:13:08,111][106225] Updated weights for policy 1, policy_version 832051 (0.0009) [2023-12-28 01:13:08,161][106225] Updated weights for policy 1, policy_version 832061 (0.0009) [2023-12-28 01:13:08,719][106226] Updated weights for policy 0, policy_version 830061 (0.0006) [2023-12-28 01:13:08,774][106226] Updated weights for policy 0, policy_version 830071 (0.0005) [2023-12-28 01:13:08,838][106226] Updated weights for policy 0, policy_version 830081 (0.0006) [2023-12-28 01:13:08,890][106225] Updated weights for policy 1, policy_version 832071 (0.0007) [2023-12-28 01:13:08,955][106225] Updated weights for policy 1, policy_version 832081 (0.0007) [2023-12-28 01:13:09,020][106225] Updated weights for policy 1, policy_version 832091 (0.0008) [2023-12-28 01:13:09,560][106226] Updated weights for policy 0, policy_version 830091 (0.0009) [2023-12-28 01:13:09,626][106226] Updated weights for policy 0, policy_version 830101 (0.0009) [2023-12-28 01:13:09,667][106225] Updated weights for policy 1, policy_version 832101 (0.0007) [2023-12-28 01:13:09,685][106226] Updated weights for policy 0, policy_version 830111 (0.0007) [2023-12-28 01:13:09,724][106225] Updated weights for policy 1, policy_version 832111 (0.0006) [2023-12-28 01:13:09,792][106225] Updated weights for policy 1, policy_version 832121 (0.0008) [2023-12-28 01:13:10,418][106226] Updated weights for policy 0, policy_version 830121 (0.0008) [2023-12-28 01:13:10,473][106226] Updated weights for policy 0, policy_version 830131 (0.0009) [2023-12-28 01:13:10,535][106226] Updated weights for policy 0, policy_version 830141 (0.0008) [2023-12-28 01:13:10,541][106225] Updated weights for policy 1, policy_version 832131 (0.0007) [2023-12-28 01:13:10,590][106226] Updated weights for policy 0, policy_version 830151 (0.0006) [2023-12-28 01:13:10,605][106225] Updated weights for policy 1, policy_version 832141 (0.0007) [2023-12-28 01:13:10,676][106225] Updated weights for policy 1, policy_version 832151 (0.0010) [2023-12-28 01:13:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 425648128. Throughput: 0: 9962.8, 1: 9971.5. Samples: 425621740. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:11,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.966')] [2023-12-28 01:13:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000832160_213073920.pth... [2023-12-28 01:13:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000831008_212779008.pth [2023-12-28 01:13:11,194][106226] Updated weights for policy 0, policy_version 830161 (0.0008) [2023-12-28 01:13:11,250][106226] Updated weights for policy 0, policy_version 830171 (0.0008) [2023-12-28 01:13:11,309][106226] Updated weights for policy 0, policy_version 830181 (0.0008) [2023-12-28 01:13:11,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000830184_212582400.pth... [2023-12-28 01:13:11,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000829000_212279296.pth [2023-12-28 01:13:11,439][106225] Updated weights for policy 1, policy_version 832161 (0.0008) [2023-12-28 01:13:11,507][106225] Updated weights for policy 1, policy_version 832171 (0.0007) [2023-12-28 01:13:11,568][106225] Updated weights for policy 1, policy_version 832181 (0.0007) [2023-12-28 01:13:11,638][106225] Updated weights for policy 1, policy_version 832191 (0.0008) [2023-12-28 01:13:12,053][106226] Updated weights for policy 0, policy_version 830191 (0.0008) [2023-12-28 01:13:12,113][106226] Updated weights for policy 0, policy_version 830201 (0.0008) [2023-12-28 01:13:12,173][106226] Updated weights for policy 0, policy_version 830211 (0.0008) [2023-12-28 01:13:12,365][106225] Updated weights for policy 1, policy_version 832201 (0.0008) [2023-12-28 01:13:12,437][106225] Updated weights for policy 1, policy_version 832211 (0.0009) [2023-12-28 01:13:12,510][106225] Updated weights for policy 1, policy_version 832221 (0.0008) [2023-12-28 01:13:12,901][106226] Updated weights for policy 0, policy_version 830221 (0.0008) [2023-12-28 01:13:12,959][106226] Updated weights for policy 0, policy_version 830231 (0.0007) [2023-12-28 01:13:13,018][106226] Updated weights for policy 0, policy_version 830241 (0.0008) [2023-12-28 01:13:13,135][106225] Updated weights for policy 1, policy_version 832231 (0.0009) [2023-12-28 01:13:13,185][106225] Updated weights for policy 1, policy_version 832241 (0.0010) [2023-12-28 01:13:13,244][106225] Updated weights for policy 1, policy_version 832251 (0.0009) [2023-12-28 01:13:13,690][106226] Updated weights for policy 0, policy_version 830251 (0.0008) [2023-12-28 01:13:13,757][106226] Updated weights for policy 0, policy_version 830261 (0.0006) [2023-12-28 01:13:13,817][106226] Updated weights for policy 0, policy_version 830271 (0.0009) [2023-12-28 01:13:13,976][106225] Updated weights for policy 1, policy_version 832261 (0.0009) [2023-12-28 01:13:14,024][106225] Updated weights for policy 1, policy_version 832271 (0.0008) [2023-12-28 01:13:14,078][106225] Updated weights for policy 1, policy_version 832281 (0.0008) [2023-12-28 01:13:14,564][106226] Updated weights for policy 0, policy_version 830281 (0.0010) [2023-12-28 01:13:14,620][106226] Updated weights for policy 0, policy_version 830291 (0.0005) [2023-12-28 01:13:14,678][106226] Updated weights for policy 0, policy_version 830301 (0.0005) [2023-12-28 01:13:14,723][106225] Updated weights for policy 1, policy_version 832291 (0.0007) [2023-12-28 01:13:14,741][106226] Updated weights for policy 0, policy_version 830311 (0.0006) [2023-12-28 01:13:14,775][106225] Updated weights for policy 1, policy_version 832301 (0.0007) [2023-12-28 01:13:14,837][106225] Updated weights for policy 1, policy_version 832311 (0.0008) [2023-12-28 01:13:15,399][106226] Updated weights for policy 0, policy_version 830321 (0.0007) [2023-12-28 01:13:15,468][106226] Updated weights for policy 0, policy_version 830331 (0.0007) [2023-12-28 01:13:15,468][106225] Updated weights for policy 1, policy_version 832321 (0.0009) [2023-12-28 01:13:15,528][106225] Updated weights for policy 1, policy_version 832331 (0.0010) [2023-12-28 01:13:15,530][106226] Updated weights for policy 0, policy_version 830341 (0.0008) [2023-12-28 01:13:15,585][106225] Updated weights for policy 1, policy_version 832341 (0.0008) [2023-12-28 01:13:15,645][106225] Updated weights for policy 1, policy_version 832351 (0.0008) [2023-12-28 01:13:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 425746432. Throughput: 0: 9930.5, 1: 9940.2. Samples: 425739376. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:16,175][105115] Avg episode reward: [(0, '-4.254'), (1, '-4.920')] [2023-12-28 01:13:16,236][106226] Updated weights for policy 0, policy_version 830351 (0.0005) [2023-12-28 01:13:16,285][106225] Updated weights for policy 1, policy_version 832361 (0.0006) [2023-12-28 01:13:16,298][106226] Updated weights for policy 0, policy_version 830361 (0.0010) [2023-12-28 01:13:16,343][106225] Updated weights for policy 1, policy_version 832371 (0.0009) [2023-12-28 01:13:16,359][106226] Updated weights for policy 0, policy_version 830371 (0.0011) [2023-12-28 01:13:16,396][106225] Updated weights for policy 1, policy_version 832381 (0.0008) [2023-12-28 01:13:17,007][106225] Updated weights for policy 1, policy_version 832391 (0.0007) [2023-12-28 01:13:17,073][106225] Updated weights for policy 1, policy_version 832401 (0.0009) [2023-12-28 01:13:17,107][106226] Updated weights for policy 0, policy_version 830381 (0.0007) [2023-12-28 01:13:17,141][106225] Updated weights for policy 1, policy_version 832411 (0.0008) [2023-12-28 01:13:17,172][106226] Updated weights for policy 0, policy_version 830391 (0.0007) [2023-12-28 01:13:17,235][106226] Updated weights for policy 0, policy_version 830401 (0.0006) [2023-12-28 01:13:17,768][106226] Updated weights for policy 0, policy_version 830411 (0.0006) [2023-12-28 01:13:17,832][106226] Updated weights for policy 0, policy_version 830421 (0.0005) [2023-12-28 01:13:17,892][106226] Updated weights for policy 0, policy_version 830431 (0.0006) [2023-12-28 01:13:17,927][106225] Updated weights for policy 1, policy_version 832421 (0.0007) [2023-12-28 01:13:17,988][106225] Updated weights for policy 1, policy_version 832431 (0.0008) [2023-12-28 01:13:18,054][106225] Updated weights for policy 1, policy_version 832441 (0.0008) [2023-12-28 01:13:18,450][106226] Updated weights for policy 0, policy_version 830441 (0.0005) [2023-12-28 01:13:18,516][106226] Updated weights for policy 0, policy_version 830451 (0.0005) [2023-12-28 01:13:18,584][106226] Updated weights for policy 0, policy_version 830461 (0.0008) [2023-12-28 01:13:18,645][106226] Updated weights for policy 0, policy_version 830471 (0.0008) [2023-12-28 01:13:18,767][106225] Updated weights for policy 1, policy_version 832451 (0.0009) [2023-12-28 01:13:18,819][106225] Updated weights for policy 1, policy_version 832461 (0.0010) [2023-12-28 01:13:18,874][106225] Updated weights for policy 1, policy_version 832471 (0.0010) [2023-12-28 01:13:19,411][106226] Updated weights for policy 0, policy_version 830481 (0.0008) [2023-12-28 01:13:19,467][106226] Updated weights for policy 0, policy_version 830491 (0.0008) [2023-12-28 01:13:19,532][106225] Updated weights for policy 1, policy_version 832481 (0.0006) [2023-12-28 01:13:19,534][106226] Updated weights for policy 0, policy_version 830501 (0.0009) [2023-12-28 01:13:19,584][106225] Updated weights for policy 1, policy_version 832491 (0.0006) [2023-12-28 01:13:19,649][106225] Updated weights for policy 1, policy_version 832501 (0.0009) [2023-12-28 01:13:19,700][106225] Updated weights for policy 1, policy_version 832511 (0.0010) [2023-12-28 01:13:20,205][106226] Updated weights for policy 0, policy_version 830511 (0.0009) [2023-12-28 01:13:20,275][106226] Updated weights for policy 0, policy_version 830521 (0.0008) [2023-12-28 01:13:20,333][106226] Updated weights for policy 0, policy_version 830531 (0.0008) [2023-12-28 01:13:20,507][106225] Updated weights for policy 1, policy_version 832521 (0.0010) [2023-12-28 01:13:20,565][106225] Updated weights for policy 1, policy_version 832531 (0.0010) [2023-12-28 01:13:20,624][106225] Updated weights for policy 1, policy_version 832541 (0.0009) [2023-12-28 01:13:21,033][106226] Updated weights for policy 0, policy_version 830541 (0.0008) [2023-12-28 01:13:21,113][106226] Updated weights for policy 0, policy_version 830551 (0.0009) [2023-12-28 01:13:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 425844736. Throughput: 0: 9990.5, 1: 9888.8. Samples: 425859528. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:21,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.903')] [2023-12-28 01:13:21,184][106226] Updated weights for policy 0, policy_version 830561 (0.0009) [2023-12-28 01:13:21,399][106225] Updated weights for policy 1, policy_version 832551 (0.0010) [2023-12-28 01:13:21,464][106225] Updated weights for policy 1, policy_version 832561 (0.0009) [2023-12-28 01:13:21,520][106225] Updated weights for policy 1, policy_version 832571 (0.0008) [2023-12-28 01:13:21,949][106226] Updated weights for policy 0, policy_version 830571 (0.0010) [2023-12-28 01:13:22,019][106226] Updated weights for policy 0, policy_version 830581 (0.0011) [2023-12-28 01:13:22,087][106226] Updated weights for policy 0, policy_version 830591 (0.0011) [2023-12-28 01:13:22,263][106225] Updated weights for policy 1, policy_version 832581 (0.0008) [2023-12-28 01:13:22,329][106225] Updated weights for policy 1, policy_version 832591 (0.0008) [2023-12-28 01:13:22,395][106225] Updated weights for policy 1, policy_version 832601 (0.0009) [2023-12-28 01:13:22,817][106226] Updated weights for policy 0, policy_version 830601 (0.0009) [2023-12-28 01:13:22,871][106226] Updated weights for policy 0, policy_version 830611 (0.0006) [2023-12-28 01:13:22,923][106226] Updated weights for policy 0, policy_version 830621 (0.0005) [2023-12-28 01:13:22,977][106226] Updated weights for policy 0, policy_version 830631 (0.0006) [2023-12-28 01:13:23,155][106225] Updated weights for policy 1, policy_version 832611 (0.0009) [2023-12-28 01:13:23,204][106225] Updated weights for policy 1, policy_version 832621 (0.0008) [2023-12-28 01:13:23,269][106225] Updated weights for policy 1, policy_version 832631 (0.0009) [2023-12-28 01:13:23,570][106226] Updated weights for policy 0, policy_version 830641 (0.0005) [2023-12-28 01:13:23,617][106226] Updated weights for policy 0, policy_version 830651 (0.0005) [2023-12-28 01:13:23,682][106226] Updated weights for policy 0, policy_version 830661 (0.0005) [2023-12-28 01:13:23,883][106225] Updated weights for policy 1, policy_version 832641 (0.0008) [2023-12-28 01:13:23,929][106225] Updated weights for policy 1, policy_version 832651 (0.0005) [2023-12-28 01:13:23,995][106225] Updated weights for policy 1, policy_version 832661 (0.0008) [2023-12-28 01:13:24,046][106225] Updated weights for policy 1, policy_version 832671 (0.0008) [2023-12-28 01:13:24,298][106226] Updated weights for policy 0, policy_version 830671 (0.0009) [2023-12-28 01:13:24,345][106226] Updated weights for policy 0, policy_version 830681 (0.0011) [2023-12-28 01:13:24,390][106226] Updated weights for policy 0, policy_version 830691 (0.0006) [2023-12-28 01:13:24,798][106225] Updated weights for policy 1, policy_version 832681 (0.0008) [2023-12-28 01:13:24,864][106225] Updated weights for policy 1, policy_version 832691 (0.0009) [2023-12-28 01:13:24,922][106225] Updated weights for policy 1, policy_version 832701 (0.0007) [2023-12-28 01:13:25,055][106226] Updated weights for policy 0, policy_version 830701 (0.0008) [2023-12-28 01:13:25,108][106226] Updated weights for policy 0, policy_version 830711 (0.0010) [2023-12-28 01:13:25,159][106226] Updated weights for policy 0, policy_version 830721 (0.0010) [2023-12-28 01:13:25,612][106225] Updated weights for policy 1, policy_version 832711 (0.0007) [2023-12-28 01:13:25,669][106225] Updated weights for policy 1, policy_version 832721 (0.0008) [2023-12-28 01:13:25,726][106225] Updated weights for policy 1, policy_version 832731 (0.0010) [2023-12-28 01:13:25,825][106226] Updated weights for policy 0, policy_version 830731 (0.0009) [2023-12-28 01:13:25,884][106226] Updated weights for policy 0, policy_version 830741 (0.0005) [2023-12-28 01:13:25,936][106226] Updated weights for policy 0, policy_version 830751 (0.0005) [2023-12-28 01:13:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 425951232. Throughput: 0: 10007.1, 1: 9901.4. Samples: 425918292. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:26,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.936')] [2023-12-28 01:13:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000832736_213221376.pth... [2023-12-28 01:13:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000830760_212729856.pth... [2023-12-28 01:13:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000831584_212926464.pth [2023-12-28 01:13:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000829576_212426752.pth [2023-12-28 01:13:26,466][106226] Updated weights for policy 0, policy_version 830761 (0.0006) [2023-12-28 01:13:26,512][106226] Updated weights for policy 0, policy_version 830771 (0.0005) [2023-12-28 01:13:26,557][106226] Updated weights for policy 0, policy_version 830781 (0.0005) [2023-12-28 01:13:26,563][106225] Updated weights for policy 1, policy_version 832741 (0.0009) [2023-12-28 01:13:26,603][106226] Updated weights for policy 0, policy_version 830791 (0.0005) [2023-12-28 01:13:26,615][106225] Updated weights for policy 1, policy_version 832751 (0.0008) [2023-12-28 01:13:26,663][106225] Updated weights for policy 1, policy_version 832761 (0.0008) [2023-12-28 01:13:27,182][106226] Updated weights for policy 0, policy_version 830801 (0.0008) [2023-12-28 01:13:27,239][106226] Updated weights for policy 0, policy_version 830811 (0.0007) [2023-12-28 01:13:27,308][106226] Updated weights for policy 0, policy_version 830821 (0.0008) [2023-12-28 01:13:27,449][106225] Updated weights for policy 1, policy_version 832771 (0.0008) [2023-12-28 01:13:27,497][106225] Updated weights for policy 1, policy_version 832781 (0.0008) [2023-12-28 01:13:27,547][106225] Updated weights for policy 1, policy_version 832792 (0.0009) [2023-12-28 01:13:27,872][106226] Updated weights for policy 0, policy_version 830831 (0.0008) [2023-12-28 01:13:27,917][106226] Updated weights for policy 0, policy_version 830841 (0.0008) [2023-12-28 01:13:27,964][106226] Updated weights for policy 0, policy_version 830851 (0.0008) [2023-12-28 01:13:28,341][106225] Updated weights for policy 1, policy_version 832802 (0.0008) [2023-12-28 01:13:28,401][106225] Updated weights for policy 1, policy_version 832812 (0.0009) [2023-12-28 01:13:28,462][106225] Updated weights for policy 1, policy_version 832822 (0.0008) [2023-12-28 01:13:28,515][106225] Updated weights for policy 1, policy_version 832832 (0.0009) [2023-12-28 01:13:28,607][106226] Updated weights for policy 0, policy_version 830861 (0.0007) [2023-12-28 01:13:28,660][106226] Updated weights for policy 0, policy_version 830871 (0.0005) [2023-12-28 01:13:28,718][106226] Updated weights for policy 0, policy_version 830881 (0.0007) [2023-12-28 01:13:29,333][106225] Updated weights for policy 1, policy_version 832842 (0.0008) [2023-12-28 01:13:29,337][106226] Updated weights for policy 0, policy_version 830891 (0.0009) [2023-12-28 01:13:29,392][106225] Updated weights for policy 1, policy_version 832852 (0.0007) [2023-12-28 01:13:29,399][106226] Updated weights for policy 0, policy_version 830901 (0.0008) [2023-12-28 01:13:29,444][106225] Updated weights for policy 1, policy_version 832862 (0.0006) [2023-12-28 01:13:29,447][106226] Updated weights for policy 0, policy_version 830911 (0.0007) [2023-12-28 01:13:30,161][106226] Updated weights for policy 0, policy_version 830921 (0.0006) [2023-12-28 01:13:30,212][106225] Updated weights for policy 1, policy_version 832872 (0.0009) [2023-12-28 01:13:30,226][106226] Updated weights for policy 0, policy_version 830931 (0.0007) [2023-12-28 01:13:30,275][106225] Updated weights for policy 1, policy_version 832882 (0.0010) [2023-12-28 01:13:30,285][106226] Updated weights for policy 0, policy_version 830941 (0.0006) [2023-12-28 01:13:30,329][106225] Updated weights for policy 1, policy_version 832892 (0.0010) [2023-12-28 01:13:30,351][106226] Updated weights for policy 0, policy_version 830951 (0.0005) [2023-12-28 01:13:30,876][106226] Updated weights for policy 0, policy_version 830961 (0.0005) [2023-12-28 01:13:30,938][106226] Updated weights for policy 0, policy_version 830971 (0.0005) [2023-12-28 01:13:30,979][106225] Updated weights for policy 1, policy_version 832902 (0.0010) [2023-12-28 01:13:30,992][106226] Updated weights for policy 0, policy_version 830981 (0.0005) [2023-12-28 01:13:31,038][106225] Updated weights for policy 1, policy_version 832912 (0.0010) [2023-12-28 01:13:31,102][106225] Updated weights for policy 1, policy_version 832922 (0.0009) [2023-12-28 01:13:31,174][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 426057728. Throughput: 0: 10196.0, 1: 9822.1. Samples: 426039980. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:31,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.315')] [2023-12-28 01:13:31,723][106226] Updated weights for policy 0, policy_version 830991 (0.0009) [2023-12-28 01:13:31,790][106226] Updated weights for policy 0, policy_version 831001 (0.0009) [2023-12-28 01:13:31,831][106225] Updated weights for policy 1, policy_version 832932 (0.0011) [2023-12-28 01:13:31,855][106226] Updated weights for policy 0, policy_version 831011 (0.0010) [2023-12-28 01:13:31,892][106225] Updated weights for policy 1, policy_version 832942 (0.0005) [2023-12-28 01:13:31,955][106225] Updated weights for policy 1, policy_version 832952 (0.0007) [2023-12-28 01:13:32,541][106226] Updated weights for policy 0, policy_version 831021 (0.0007) [2023-12-28 01:13:32,590][106226] Updated weights for policy 0, policy_version 831031 (0.0008) [2023-12-28 01:13:32,639][106226] Updated weights for policy 0, policy_version 831041 (0.0009) [2023-12-28 01:13:32,717][106225] Updated weights for policy 1, policy_version 832962 (0.0009) [2023-12-28 01:13:32,778][106225] Updated weights for policy 1, policy_version 832972 (0.0007) [2023-12-28 01:13:32,836][106225] Updated weights for policy 1, policy_version 832982 (0.0006) [2023-12-28 01:13:32,888][106225] Updated weights for policy 1, policy_version 832992 (0.0008) [2023-12-28 01:13:33,353][106226] Updated weights for policy 0, policy_version 831051 (0.0008) [2023-12-28 01:13:33,398][106226] Updated weights for policy 0, policy_version 831061 (0.0009) [2023-12-28 01:13:33,461][106226] Updated weights for policy 0, policy_version 831071 (0.0009) [2023-12-28 01:13:33,614][106225] Updated weights for policy 1, policy_version 833002 (0.0008) [2023-12-28 01:13:33,676][106225] Updated weights for policy 1, policy_version 833012 (0.0009) [2023-12-28 01:13:33,745][106225] Updated weights for policy 1, policy_version 833022 (0.0008) [2023-12-28 01:13:34,161][106226] Updated weights for policy 0, policy_version 831081 (0.0009) [2023-12-28 01:13:34,218][106226] Updated weights for policy 0, policy_version 831091 (0.0008) [2023-12-28 01:13:34,276][106226] Updated weights for policy 0, policy_version 831101 (0.0009) [2023-12-28 01:13:34,339][106226] Updated weights for policy 0, policy_version 831111 (0.0008) [2023-12-28 01:13:34,459][106225] Updated weights for policy 1, policy_version 833032 (0.0008) [2023-12-28 01:13:34,519][106225] Updated weights for policy 1, policy_version 833042 (0.0009) [2023-12-28 01:13:34,582][106225] Updated weights for policy 1, policy_version 833052 (0.0008) [2023-12-28 01:13:34,957][106226] Updated weights for policy 0, policy_version 831121 (0.0005) [2023-12-28 01:13:35,017][106226] Updated weights for policy 0, policy_version 831131 (0.0005) [2023-12-28 01:13:35,074][106226] Updated weights for policy 0, policy_version 831141 (0.0005) [2023-12-28 01:13:35,373][106225] Updated weights for policy 1, policy_version 833062 (0.0007) [2023-12-28 01:13:35,431][106225] Updated weights for policy 1, policy_version 833072 (0.0005) [2023-12-28 01:13:35,480][106225] Updated weights for policy 1, policy_version 833082 (0.0008) [2023-12-28 01:13:35,685][106226] Updated weights for policy 0, policy_version 831151 (0.0005) [2023-12-28 01:13:35,746][106226] Updated weights for policy 0, policy_version 831161 (0.0005) [2023-12-28 01:13:35,815][106226] Updated weights for policy 0, policy_version 831171 (0.0005) [2023-12-28 01:13:36,126][106225] Updated weights for policy 1, policy_version 833092 (0.0008) [2023-12-28 01:13:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 426147840. Throughput: 0: 10316.4, 1: 9728.3. Samples: 426161420. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:36,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-5.113')] [2023-12-28 01:13:36,189][106225] Updated weights for policy 1, policy_version 833102 (0.0008) [2023-12-28 01:13:36,241][106225] Updated weights for policy 1, policy_version 833112 (0.0008) [2023-12-28 01:13:36,364][106226] Updated weights for policy 0, policy_version 831181 (0.0006) [2023-12-28 01:13:36,423][106226] Updated weights for policy 0, policy_version 831191 (0.0007) [2023-12-28 01:13:36,484][106226] Updated weights for policy 0, policy_version 831201 (0.0008) [2023-12-28 01:13:37,012][106225] Updated weights for policy 1, policy_version 833122 (0.0009) [2023-12-28 01:13:37,062][106225] Updated weights for policy 1, policy_version 833132 (0.0009) [2023-12-28 01:13:37,077][106226] Updated weights for policy 0, policy_version 831211 (0.0007) [2023-12-28 01:13:37,107][106225] Updated weights for policy 1, policy_version 833142 (0.0005) [2023-12-28 01:13:37,135][106226] Updated weights for policy 0, policy_version 831221 (0.0006) [2023-12-28 01:13:37,160][106225] Updated weights for policy 1, policy_version 833152 (0.0005) [2023-12-28 01:13:37,193][106226] Updated weights for policy 0, policy_version 831231 (0.0007) [2023-12-28 01:13:37,743][106225] Updated weights for policy 1, policy_version 833162 (0.0006) [2023-12-28 01:13:37,759][106226] Updated weights for policy 0, policy_version 831241 (0.0005) [2023-12-28 01:13:37,798][106225] Updated weights for policy 1, policy_version 833172 (0.0006) [2023-12-28 01:13:37,816][106226] Updated weights for policy 0, policy_version 831251 (0.0005) [2023-12-28 01:13:37,865][106225] Updated weights for policy 1, policy_version 833182 (0.0006) [2023-12-28 01:13:37,869][106226] Updated weights for policy 0, policy_version 831261 (0.0006) [2023-12-28 01:13:37,933][106226] Updated weights for policy 0, policy_version 831271 (0.0006) [2023-12-28 01:13:38,417][106225] Updated weights for policy 1, policy_version 833192 (0.0010) [2023-12-28 01:13:38,487][106225] Updated weights for policy 1, policy_version 833202 (0.0011) [2023-12-28 01:13:38,497][106226] Updated weights for policy 0, policy_version 831281 (0.0006) [2023-12-28 01:13:38,555][106225] Updated weights for policy 1, policy_version 833212 (0.0010) [2023-12-28 01:13:38,561][106226] Updated weights for policy 0, policy_version 831291 (0.0006) [2023-12-28 01:13:38,625][106226] Updated weights for policy 0, policy_version 831301 (0.0007) [2023-12-28 01:13:39,169][106225] Updated weights for policy 1, policy_version 833222 (0.0007) [2023-12-28 01:13:39,238][106225] Updated weights for policy 1, policy_version 833232 (0.0006) [2023-12-28 01:13:39,293][106225] Updated weights for policy 1, policy_version 833242 (0.0008) [2023-12-28 01:13:39,364][106226] Updated weights for policy 0, policy_version 831311 (0.0006) [2023-12-28 01:13:39,436][106226] Updated weights for policy 0, policy_version 831321 (0.0009) [2023-12-28 01:13:39,494][106226] Updated weights for policy 0, policy_version 831331 (0.0011) [2023-12-28 01:13:40,009][106225] Updated weights for policy 1, policy_version 833252 (0.0007) [2023-12-28 01:13:40,070][106225] Updated weights for policy 1, policy_version 833262 (0.0008) [2023-12-28 01:13:40,132][106225] Updated weights for policy 1, policy_version 833272 (0.0007) [2023-12-28 01:13:40,240][106226] Updated weights for policy 0, policy_version 831341 (0.0009) [2023-12-28 01:13:40,296][106226] Updated weights for policy 0, policy_version 831351 (0.0008) [2023-12-28 01:13:40,358][106226] Updated weights for policy 0, policy_version 831361 (0.0008) [2023-12-28 01:13:40,850][106225] Updated weights for policy 1, policy_version 833282 (0.0008) [2023-12-28 01:13:40,916][106225] Updated weights for policy 1, policy_version 833292 (0.0008) [2023-12-28 01:13:40,966][106225] Updated weights for policy 1, policy_version 833302 (0.0008) [2023-12-28 01:13:41,020][106225] Updated weights for policy 1, policy_version 833312 (0.0007) [2023-12-28 01:13:41,144][106226] Updated weights for policy 0, policy_version 831371 (0.0009) [2023-12-28 01:13:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 426254336. Throughput: 0: 10402.4, 1: 9828.9. Samples: 426227000. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:41,175][105115] Avg episode reward: [(0, '-4.103'), (1, '-4.965')] [2023-12-28 01:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000833312_213368832.pth... [2023-12-28 01:13:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000832160_213073920.pth [2023-12-28 01:13:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000833312_213368832.pth [2023-12-28 01:13:41,209][106226] Updated weights for policy 0, policy_version 831381 (0.0011) [2023-12-28 01:13:41,278][106226] Updated weights for policy 0, policy_version 831391 (0.0011) [2023-12-28 01:13:41,335][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000831400_212893696.pth... [2023-12-28 01:13:41,339][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000830184_212582400.pth [2023-12-28 01:13:41,340][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000831400_212893696.pth [2023-12-28 01:13:41,798][106225] Updated weights for policy 1, policy_version 833322 (0.0008) [2023-12-28 01:13:41,856][106225] Updated weights for policy 1, policy_version 833332 (0.0008) [2023-12-28 01:13:41,919][106225] Updated weights for policy 1, policy_version 833342 (0.0008) [2023-12-28 01:13:42,004][106226] Updated weights for policy 0, policy_version 831401 (0.0011) [2023-12-28 01:13:42,066][106226] Updated weights for policy 0, policy_version 831411 (0.0011) [2023-12-28 01:13:42,126][106226] Updated weights for policy 0, policy_version 831421 (0.0011) [2023-12-28 01:13:42,191][106226] Updated weights for policy 0, policy_version 831431 (0.0011) [2023-12-28 01:13:42,677][106225] Updated weights for policy 1, policy_version 833352 (0.0007) [2023-12-28 01:13:42,741][106225] Updated weights for policy 1, policy_version 833362 (0.0006) [2023-12-28 01:13:42,803][106225] Updated weights for policy 1, policy_version 833372 (0.0008) [2023-12-28 01:13:42,922][106226] Updated weights for policy 0, policy_version 831441 (0.0011) [2023-12-28 01:13:42,982][106226] Updated weights for policy 0, policy_version 831451 (0.0011) [2023-12-28 01:13:43,040][106226] Updated weights for policy 0, policy_version 831461 (0.0011) [2023-12-28 01:13:43,518][106225] Updated weights for policy 1, policy_version 833382 (0.0009) [2023-12-28 01:13:43,569][106225] Updated weights for policy 1, policy_version 833393 (0.0009) [2023-12-28 01:13:43,618][106225] Updated weights for policy 1, policy_version 833403 (0.0007) [2023-12-28 01:13:43,653][106226] Updated weights for policy 0, policy_version 831471 (0.0010) [2023-12-28 01:13:43,716][106226] Updated weights for policy 0, policy_version 831481 (0.0009) [2023-12-28 01:13:43,778][106226] Updated weights for policy 0, policy_version 831491 (0.0008) [2023-12-28 01:13:44,313][106225] Updated weights for policy 1, policy_version 833413 (0.0006) [2023-12-28 01:13:44,371][106225] Updated weights for policy 1, policy_version 833423 (0.0005) [2023-12-28 01:13:44,394][106226] Updated weights for policy 0, policy_version 831501 (0.0010) [2023-12-28 01:13:44,433][106225] Updated weights for policy 1, policy_version 833433 (0.0006) [2023-12-28 01:13:44,452][106226] Updated weights for policy 0, policy_version 831511 (0.0011) [2023-12-28 01:13:44,512][106226] Updated weights for policy 0, policy_version 831521 (0.0011) [2023-12-28 01:13:45,039][106225] Updated weights for policy 1, policy_version 833443 (0.0005) [2023-12-28 01:13:45,097][106225] Updated weights for policy 1, policy_version 833453 (0.0006) [2023-12-28 01:13:45,160][106225] Updated weights for policy 1, policy_version 833463 (0.0006) [2023-12-28 01:13:45,240][106226] Updated weights for policy 0, policy_version 831531 (0.0011) [2023-12-28 01:13:45,305][106226] Updated weights for policy 0, policy_version 831541 (0.0011) [2023-12-28 01:13:45,374][106226] Updated weights for policy 0, policy_version 831551 (0.0008) [2023-12-28 01:13:45,908][106226] Updated weights for policy 0, policy_version 831561 (0.0009) [2023-12-28 01:13:45,908][106225] Updated weights for policy 1, policy_version 833473 (0.0007) [2023-12-28 01:13:45,961][106225] Updated weights for policy 1, policy_version 833483 (0.0006) [2023-12-28 01:13:45,962][106226] Updated weights for policy 0, policy_version 831571 (0.0009) [2023-12-28 01:13:46,011][106225] Updated weights for policy 1, policy_version 833493 (0.0007) [2023-12-28 01:13:46,028][106226] Updated weights for policy 0, policy_version 831581 (0.0011) [2023-12-28 01:13:46,069][106225] Updated weights for policy 1, policy_version 833503 (0.0005) [2023-12-28 01:13:46,085][106226] Updated weights for policy 0, policy_version 831591 (0.0011) [2023-12-28 01:13:46,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 426360832. Throughput: 0: 10296.1, 1: 9774.8. Samples: 426342764. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:46,176][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.801')] [2023-12-28 01:13:46,687][106226] Updated weights for policy 0, policy_version 831601 (0.0010) [2023-12-28 01:13:46,737][106226] Updated weights for policy 0, policy_version 831611 (0.0010) [2023-12-28 01:13:46,786][106226] Updated weights for policy 0, policy_version 831621 (0.0010) [2023-12-28 01:13:46,860][106225] Updated weights for policy 1, policy_version 833513 (0.0009) [2023-12-28 01:13:46,915][106225] Updated weights for policy 1, policy_version 833523 (0.0007) [2023-12-28 01:13:46,967][106225] Updated weights for policy 1, policy_version 833533 (0.0009) [2023-12-28 01:13:47,474][106226] Updated weights for policy 0, policy_version 831631 (0.0010) [2023-12-28 01:13:47,534][106226] Updated weights for policy 0, policy_version 831641 (0.0008) [2023-12-28 01:13:47,585][106226] Updated weights for policy 0, policy_version 831651 (0.0008) [2023-12-28 01:13:47,670][106225] Updated weights for policy 1, policy_version 833543 (0.0009) [2023-12-28 01:13:47,727][106225] Updated weights for policy 1, policy_version 833553 (0.0010) [2023-12-28 01:13:47,787][106225] Updated weights for policy 1, policy_version 833563 (0.0010) [2023-12-28 01:13:48,203][106226] Updated weights for policy 0, policy_version 831661 (0.0006) [2023-12-28 01:13:48,256][106226] Updated weights for policy 0, policy_version 831671 (0.0007) [2023-12-28 01:13:48,309][106226] Updated weights for policy 0, policy_version 831681 (0.0008) [2023-12-28 01:13:48,526][106225] Updated weights for policy 1, policy_version 833573 (0.0010) [2023-12-28 01:13:48,578][106225] Updated weights for policy 1, policy_version 833583 (0.0010) [2023-12-28 01:13:48,634][106225] Updated weights for policy 1, policy_version 833593 (0.0010) [2023-12-28 01:13:49,013][106226] Updated weights for policy 0, policy_version 831691 (0.0008) [2023-12-28 01:13:49,066][106226] Updated weights for policy 0, policy_version 831701 (0.0005) [2023-12-28 01:13:49,122][106226] Updated weights for policy 0, policy_version 831711 (0.0005) [2023-12-28 01:13:49,373][106225] Updated weights for policy 1, policy_version 833603 (0.0010) [2023-12-28 01:13:49,428][106225] Updated weights for policy 1, policy_version 833613 (0.0009) [2023-12-28 01:13:49,478][106225] Updated weights for policy 1, policy_version 833623 (0.0010) [2023-12-28 01:13:49,812][106226] Updated weights for policy 0, policy_version 831721 (0.0006) [2023-12-28 01:13:49,883][106226] Updated weights for policy 0, policy_version 831731 (0.0008) [2023-12-28 01:13:49,953][106226] Updated weights for policy 0, policy_version 831741 (0.0008) [2023-12-28 01:13:50,015][106226] Updated weights for policy 0, policy_version 831751 (0.0006) [2023-12-28 01:13:50,186][106225] Updated weights for policy 1, policy_version 833633 (0.0010) [2023-12-28 01:13:50,248][106225] Updated weights for policy 1, policy_version 833643 (0.0009) [2023-12-28 01:13:50,308][106225] Updated weights for policy 1, policy_version 833653 (0.0009) [2023-12-28 01:13:50,366][106225] Updated weights for policy 1, policy_version 833663 (0.0009) [2023-12-28 01:13:50,728][106226] Updated weights for policy 0, policy_version 831761 (0.0008) [2023-12-28 01:13:50,797][106226] Updated weights for policy 0, policy_version 831771 (0.0008) [2023-12-28 01:13:50,861][106226] Updated weights for policy 0, policy_version 831781 (0.0009) [2023-12-28 01:13:51,028][106225] Updated weights for policy 1, policy_version 833673 (0.0011) [2023-12-28 01:13:51,095][106225] Updated weights for policy 1, policy_version 833683 (0.0010) [2023-12-28 01:13:51,161][106225] Updated weights for policy 1, policy_version 833693 (0.0011) [2023-12-28 01:13:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 426450944. Throughput: 0: 10325.9, 1: 9709.9. Samples: 426462180. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:51,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.993')] [2023-12-28 01:13:51,669][106226] Updated weights for policy 0, policy_version 831791 (0.0008) [2023-12-28 01:13:51,732][106226] Updated weights for policy 0, policy_version 831801 (0.0006) [2023-12-28 01:13:51,795][106226] Updated weights for policy 0, policy_version 831811 (0.0008) [2023-12-28 01:13:51,949][106225] Updated weights for policy 1, policy_version 833703 (0.0010) [2023-12-28 01:13:52,009][106225] Updated weights for policy 1, policy_version 833713 (0.0010) [2023-12-28 01:13:52,068][106225] Updated weights for policy 1, policy_version 833723 (0.0010) [2023-12-28 01:13:52,452][106226] Updated weights for policy 0, policy_version 831821 (0.0008) [2023-12-28 01:13:52,523][106226] Updated weights for policy 0, policy_version 831831 (0.0006) [2023-12-28 01:13:52,586][106226] Updated weights for policy 0, policy_version 831841 (0.0006) [2023-12-28 01:13:52,793][106225] Updated weights for policy 1, policy_version 833733 (0.0010) [2023-12-28 01:13:52,852][106225] Updated weights for policy 1, policy_version 833743 (0.0010) [2023-12-28 01:13:52,924][106225] Updated weights for policy 1, policy_version 833753 (0.0010) [2023-12-28 01:13:53,191][106226] Updated weights for policy 0, policy_version 831851 (0.0007) [2023-12-28 01:13:53,249][106226] Updated weights for policy 0, policy_version 831861 (0.0008) [2023-12-28 01:13:53,307][106226] Updated weights for policy 0, policy_version 831871 (0.0008) [2023-12-28 01:13:53,570][106225] Updated weights for policy 1, policy_version 833763 (0.0009) [2023-12-28 01:13:53,620][106225] Updated weights for policy 1, policy_version 833773 (0.0005) [2023-12-28 01:13:53,673][106225] Updated weights for policy 1, policy_version 833783 (0.0005) [2023-12-28 01:13:53,982][106226] Updated weights for policy 0, policy_version 831881 (0.0008) [2023-12-28 01:13:54,038][106226] Updated weights for policy 0, policy_version 831891 (0.0010) [2023-12-28 01:13:54,098][106226] Updated weights for policy 0, policy_version 831901 (0.0010) [2023-12-28 01:13:54,159][106226] Updated weights for policy 0, policy_version 831911 (0.0010) [2023-12-28 01:13:54,278][106225] Updated weights for policy 1, policy_version 833793 (0.0006) [2023-12-28 01:13:54,333][106225] Updated weights for policy 1, policy_version 833803 (0.0005) [2023-12-28 01:13:54,387][106225] Updated weights for policy 1, policy_version 833813 (0.0005) [2023-12-28 01:13:54,444][106225] Updated weights for policy 1, policy_version 833823 (0.0008) [2023-12-28 01:13:54,854][106226] Updated weights for policy 0, policy_version 831921 (0.0006) [2023-12-28 01:13:54,911][106226] Updated weights for policy 0, policy_version 831931 (0.0009) [2023-12-28 01:13:54,968][106226] Updated weights for policy 0, policy_version 831941 (0.0011) [2023-12-28 01:13:55,019][106225] Updated weights for policy 1, policy_version 833833 (0.0007) [2023-12-28 01:13:55,075][106225] Updated weights for policy 1, policy_version 833843 (0.0007) [2023-12-28 01:13:55,130][106225] Updated weights for policy 1, policy_version 833853 (0.0008) [2023-12-28 01:13:55,666][106226] Updated weights for policy 0, policy_version 831951 (0.0011) [2023-12-28 01:13:55,725][106226] Updated weights for policy 0, policy_version 831961 (0.0010) [2023-12-28 01:13:55,779][106226] Updated weights for policy 0, policy_version 831971 (0.0010) [2023-12-28 01:13:55,827][106225] Updated weights for policy 1, policy_version 833863 (0.0006) [2023-12-28 01:13:55,890][106225] Updated weights for policy 1, policy_version 833873 (0.0005) [2023-12-28 01:13:55,953][106225] Updated weights for policy 1, policy_version 833883 (0.0005) [2023-12-28 01:13:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 426557440. Throughput: 0: 10297.0, 1: 9692.2. Samples: 426521252. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:13:56,175][105115] Avg episode reward: [(0, '-4.249'), (1, '-5.243')] [2023-12-28 01:13:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000833888_213516288.pth... [2023-12-28 01:13:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000831976_213041152.pth... [2023-12-28 01:13:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000830760_212729856.pth [2023-12-28 01:13:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000832736_213221376.pth [2023-12-28 01:13:56,503][106226] Updated weights for policy 0, policy_version 831981 (0.0011) [2023-12-28 01:13:56,562][106226] Updated weights for policy 0, policy_version 831991 (0.0010) [2023-12-28 01:13:56,609][106225] Updated weights for policy 1, policy_version 833893 (0.0005) [2023-12-28 01:13:56,619][106226] Updated weights for policy 0, policy_version 832001 (0.0010) [2023-12-28 01:13:56,663][106225] Updated weights for policy 1, policy_version 833903 (0.0006) [2023-12-28 01:13:56,713][106225] Updated weights for policy 1, policy_version 833913 (0.0007) [2023-12-28 01:13:57,331][106226] Updated weights for policy 0, policy_version 832011 (0.0010) [2023-12-28 01:13:57,383][106226] Updated weights for policy 0, policy_version 832021 (0.0010) [2023-12-28 01:13:57,398][106225] Updated weights for policy 1, policy_version 833923 (0.0008) [2023-12-28 01:13:57,432][106226] Updated weights for policy 0, policy_version 832031 (0.0010) [2023-12-28 01:13:57,447][106225] Updated weights for policy 1, policy_version 833933 (0.0010) [2023-12-28 01:13:57,500][106225] Updated weights for policy 1, policy_version 833943 (0.0010) [2023-12-28 01:13:58,088][106226] Updated weights for policy 0, policy_version 832041 (0.0010) [2023-12-28 01:13:58,143][106226] Updated weights for policy 0, policy_version 832051 (0.0005) [2023-12-28 01:13:58,165][106225] Updated weights for policy 1, policy_version 833953 (0.0010) [2023-12-28 01:13:58,204][106226] Updated weights for policy 0, policy_version 832061 (0.0007) [2023-12-28 01:13:58,226][106225] Updated weights for policy 1, policy_version 833963 (0.0009) [2023-12-28 01:13:58,271][106226] Updated weights for policy 0, policy_version 832071 (0.0010) [2023-12-28 01:13:58,288][106225] Updated weights for policy 1, policy_version 833973 (0.0008) [2023-12-28 01:13:58,369][106225] Updated weights for policy 1, policy_version 833983 (0.0007) [2023-12-28 01:13:59,013][106226] Updated weights for policy 0, policy_version 832081 (0.0009) [2023-12-28 01:13:59,070][106226] Updated weights for policy 0, policy_version 832091 (0.0008) [2023-12-28 01:13:59,127][106226] Updated weights for policy 0, policy_version 832101 (0.0009) [2023-12-28 01:13:59,194][106225] Updated weights for policy 1, policy_version 833993 (0.0008) [2023-12-28 01:13:59,259][106225] Updated weights for policy 1, policy_version 834003 (0.0008) [2023-12-28 01:13:59,322][106225] Updated weights for policy 1, policy_version 834013 (0.0010) [2023-12-28 01:13:59,810][106226] Updated weights for policy 0, policy_version 832111 (0.0006) [2023-12-28 01:13:59,874][106226] Updated weights for policy 0, policy_version 832121 (0.0008) [2023-12-28 01:13:59,937][106226] Updated weights for policy 0, policy_version 832131 (0.0007) [2023-12-28 01:14:00,143][106225] Updated weights for policy 1, policy_version 834023 (0.0009) [2023-12-28 01:14:00,196][106225] Updated weights for policy 1, policy_version 834033 (0.0009) [2023-12-28 01:14:00,255][106225] Updated weights for policy 1, policy_version 834043 (0.0009) [2023-12-28 01:14:00,566][106226] Updated weights for policy 0, policy_version 832141 (0.0007) [2023-12-28 01:14:00,621][106226] Updated weights for policy 0, policy_version 832151 (0.0008) [2023-12-28 01:14:00,669][106226] Updated weights for policy 0, policy_version 832161 (0.0008) [2023-12-28 01:14:01,007][106225] Updated weights for policy 1, policy_version 834053 (0.0010) [2023-12-28 01:14:01,072][106225] Updated weights for policy 1, policy_version 834063 (0.0010) [2023-12-28 01:14:01,126][106225] Updated weights for policy 1, policy_version 834073 (0.0010) [2023-12-28 01:14:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 426647552. Throughput: 0: 10312.2, 1: 9732.8. Samples: 426641400. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-28 01:14:01,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-5.271')] [2023-12-28 01:14:01,390][106226] Updated weights for policy 0, policy_version 832171 (0.0009) [2023-12-28 01:14:01,448][106226] Updated weights for policy 0, policy_version 832181 (0.0008) [2023-12-28 01:14:01,512][106226] Updated weights for policy 0, policy_version 832191 (0.0009) [2023-12-28 01:14:01,845][106225] Updated weights for policy 1, policy_version 834083 (0.0009) [2023-12-28 01:14:01,908][106225] Updated weights for policy 1, policy_version 834093 (0.0009) [2023-12-28 01:14:01,968][106225] Updated weights for policy 1, policy_version 834103 (0.0009) [2023-12-28 01:14:02,265][106226] Updated weights for policy 0, policy_version 832201 (0.0009) [2023-12-28 01:14:02,329][106226] Updated weights for policy 0, policy_version 832211 (0.0008) [2023-12-28 01:14:02,379][106226] Updated weights for policy 0, policy_version 832221 (0.0008) [2023-12-28 01:14:02,426][106226] Updated weights for policy 0, policy_version 832231 (0.0008) [2023-12-28 01:14:02,648][106225] Updated weights for policy 1, policy_version 834113 (0.0006) [2023-12-28 01:14:02,709][106225] Updated weights for policy 1, policy_version 834123 (0.0005) [2023-12-28 01:14:02,771][106225] Updated weights for policy 1, policy_version 834133 (0.0005) [2023-12-28 01:14:02,833][106225] Updated weights for policy 1, policy_version 834143 (0.0005) [2023-12-28 01:14:03,235][106226] Updated weights for policy 0, policy_version 832241 (0.0009) [2023-12-28 01:14:03,286][106226] Updated weights for policy 0, policy_version 832251 (0.0008) [2023-12-28 01:14:03,345][106226] Updated weights for policy 0, policy_version 832261 (0.0008) [2023-12-28 01:14:03,414][106225] Updated weights for policy 1, policy_version 834153 (0.0008) [2023-12-28 01:14:03,464][106225] Updated weights for policy 1, policy_version 834163 (0.0008) [2023-12-28 01:14:03,507][106225] Updated weights for policy 1, policy_version 834173 (0.0008) [2023-12-28 01:14:04,117][106226] Updated weights for policy 0, policy_version 832271 (0.0009) [2023-12-28 01:14:04,163][106226] Updated weights for policy 0, policy_version 832281 (0.0008) [2023-12-28 01:14:04,200][106225] Updated weights for policy 1, policy_version 834183 (0.0008) [2023-12-28 01:14:04,218][106226] Updated weights for policy 0, policy_version 832291 (0.0006) [2023-12-28 01:14:04,257][106225] Updated weights for policy 1, policy_version 834193 (0.0008) [2023-12-28 01:14:04,321][106225] Updated weights for policy 1, policy_version 834203 (0.0009) [2023-12-28 01:14:04,991][106226] Updated weights for policy 0, policy_version 832301 (0.0009) [2023-12-28 01:14:05,040][106225] Updated weights for policy 1, policy_version 834213 (0.0007) [2023-12-28 01:14:05,059][106226] Updated weights for policy 0, policy_version 832311 (0.0011) [2023-12-28 01:14:05,103][106225] Updated weights for policy 1, policy_version 834223 (0.0005) [2023-12-28 01:14:05,120][106226] Updated weights for policy 0, policy_version 832321 (0.0010) [2023-12-28 01:14:05,166][106225] Updated weights for policy 1, policy_version 834233 (0.0005) [2023-12-28 01:14:05,731][106225] Updated weights for policy 1, policy_version 834243 (0.0007) [2023-12-28 01:14:05,780][106225] Updated weights for policy 1, policy_version 834253 (0.0007) [2023-12-28 01:14:05,799][106226] Updated weights for policy 0, policy_version 832331 (0.0011) [2023-12-28 01:14:05,831][106225] Updated weights for policy 1, policy_version 834263 (0.0006) [2023-12-28 01:14:05,849][106226] Updated weights for policy 0, policy_version 832341 (0.0010) [2023-12-28 01:14:05,899][106226] Updated weights for policy 0, policy_version 832351 (0.0010) [2023-12-28 01:14:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 426754048. Throughput: 0: 10227.0, 1: 9758.9. Samples: 426758896. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:06,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-5.110')] [2023-12-28 01:14:06,493][106225] Updated weights for policy 1, policy_version 834273 (0.0006) [2023-12-28 01:14:06,557][106225] Updated weights for policy 1, policy_version 834283 (0.0009) [2023-12-28 01:14:06,611][106225] Updated weights for policy 1, policy_version 834293 (0.0006) [2023-12-28 01:14:06,647][106226] Updated weights for policy 0, policy_version 832361 (0.0010) [2023-12-28 01:14:06,672][106225] Updated weights for policy 1, policy_version 834303 (0.0006) [2023-12-28 01:14:06,713][106226] Updated weights for policy 0, policy_version 832371 (0.0011) [2023-12-28 01:14:06,772][106226] Updated weights for policy 0, policy_version 832381 (0.0011) [2023-12-28 01:14:06,829][106226] Updated weights for policy 0, policy_version 832391 (0.0011) [2023-12-28 01:14:07,378][106225] Updated weights for policy 1, policy_version 834313 (0.0005) [2023-12-28 01:14:07,439][106226] Updated weights for policy 0, policy_version 832401 (0.0006) [2023-12-28 01:14:07,440][106225] Updated weights for policy 1, policy_version 834323 (0.0006) [2023-12-28 01:14:07,497][106225] Updated weights for policy 1, policy_version 834333 (0.0006) [2023-12-28 01:14:07,503][106226] Updated weights for policy 0, policy_version 832411 (0.0008) [2023-12-28 01:14:07,568][106226] Updated weights for policy 0, policy_version 832421 (0.0008) [2023-12-28 01:14:08,139][106225] Updated weights for policy 1, policy_version 834343 (0.0009) [2023-12-28 01:14:08,202][106225] Updated weights for policy 1, policy_version 834353 (0.0010) [2023-12-28 01:14:08,212][106226] Updated weights for policy 0, policy_version 832431 (0.0010) [2023-12-28 01:14:08,258][106225] Updated weights for policy 1, policy_version 834363 (0.0010) [2023-12-28 01:14:08,265][106226] Updated weights for policy 0, policy_version 832441 (0.0010) [2023-12-28 01:14:08,317][106226] Updated weights for policy 0, policy_version 832451 (0.0006) [2023-12-28 01:14:08,994][106225] Updated weights for policy 1, policy_version 834373 (0.0008) [2023-12-28 01:14:09,030][106226] Updated weights for policy 0, policy_version 832461 (0.0008) [2023-12-28 01:14:09,051][106225] Updated weights for policy 1, policy_version 834383 (0.0006) [2023-12-28 01:14:09,088][106226] Updated weights for policy 0, policy_version 832471 (0.0009) [2023-12-28 01:14:09,134][106225] Updated weights for policy 1, policy_version 834393 (0.0009) [2023-12-28 01:14:09,148][106226] Updated weights for policy 0, policy_version 832481 (0.0007) [2023-12-28 01:14:09,831][106225] Updated weights for policy 1, policy_version 834403 (0.0010) [2023-12-28 01:14:09,901][106225] Updated weights for policy 1, policy_version 834413 (0.0010) [2023-12-28 01:14:09,968][106225] Updated weights for policy 1, policy_version 834423 (0.0010) [2023-12-28 01:14:09,990][106226] Updated weights for policy 0, policy_version 832491 (0.0007) [2023-12-28 01:14:10,050][106226] Updated weights for policy 0, policy_version 832501 (0.0008) [2023-12-28 01:14:10,116][106226] Updated weights for policy 0, policy_version 832511 (0.0008) [2023-12-28 01:14:10,705][106225] Updated weights for policy 1, policy_version 834433 (0.0010) [2023-12-28 01:14:10,765][106225] Updated weights for policy 1, policy_version 834443 (0.0010) [2023-12-28 01:14:10,826][106225] Updated weights for policy 1, policy_version 834453 (0.0010) [2023-12-28 01:14:10,863][106226] Updated weights for policy 0, policy_version 832521 (0.0007) [2023-12-28 01:14:10,874][106225] Updated weights for policy 1, policy_version 834463 (0.0010) [2023-12-28 01:14:10,921][106226] Updated weights for policy 0, policy_version 832531 (0.0007) [2023-12-28 01:14:10,975][106226] Updated weights for policy 0, policy_version 832541 (0.0008) [2023-12-28 01:14:11,028][106226] Updated weights for policy 0, policy_version 832551 (0.0008) [2023-12-28 01:14:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 426852352. Throughput: 0: 10235.7, 1: 9807.8. Samples: 426820252. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:11,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-5.063')] [2023-12-28 01:14:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000834464_213663744.pth... [2023-12-28 01:14:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000832552_213188608.pth... [2023-12-28 01:14:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000831400_212893696.pth [2023-12-28 01:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000833312_213368832.pth [2023-12-28 01:14:11,626][106225] Updated weights for policy 1, policy_version 834473 (0.0008) [2023-12-28 01:14:11,694][106225] Updated weights for policy 1, policy_version 834483 (0.0009) [2023-12-28 01:14:11,764][106225] Updated weights for policy 1, policy_version 834493 (0.0008) [2023-12-28 01:14:11,916][106226] Updated weights for policy 0, policy_version 832561 (0.0009) [2023-12-28 01:14:11,976][106226] Updated weights for policy 0, policy_version 832571 (0.0009) [2023-12-28 01:14:12,036][106226] Updated weights for policy 0, policy_version 832581 (0.0008) [2023-12-28 01:14:12,484][106225] Updated weights for policy 1, policy_version 834503 (0.0008) [2023-12-28 01:14:12,549][106225] Updated weights for policy 1, policy_version 834513 (0.0009) [2023-12-28 01:14:12,615][106225] Updated weights for policy 1, policy_version 834523 (0.0008) [2023-12-28 01:14:12,785][106226] Updated weights for policy 0, policy_version 832591 (0.0009) [2023-12-28 01:14:12,848][106226] Updated weights for policy 0, policy_version 832601 (0.0011) [2023-12-28 01:14:12,919][106226] Updated weights for policy 0, policy_version 832611 (0.0011) [2023-12-28 01:14:13,290][106225] Updated weights for policy 1, policy_version 834533 (0.0008) [2023-12-28 01:14:13,343][106225] Updated weights for policy 1, policy_version 834543 (0.0008) [2023-12-28 01:14:13,397][106225] Updated weights for policy 1, policy_version 834553 (0.0009) [2023-12-28 01:14:13,534][106226] Updated weights for policy 0, policy_version 832621 (0.0008) [2023-12-28 01:14:13,602][106226] Updated weights for policy 0, policy_version 832631 (0.0005) [2023-12-28 01:14:13,662][106226] Updated weights for policy 0, policy_version 832641 (0.0005) [2023-12-28 01:14:14,133][106225] Updated weights for policy 1, policy_version 834563 (0.0008) [2023-12-28 01:14:14,182][106225] Updated weights for policy 1, policy_version 834573 (0.0006) [2023-12-28 01:14:14,242][106225] Updated weights for policy 1, policy_version 834583 (0.0008) [2023-12-28 01:14:14,288][106226] Updated weights for policy 0, policy_version 832651 (0.0007) [2023-12-28 01:14:14,338][106226] Updated weights for policy 0, policy_version 832661 (0.0010) [2023-12-28 01:14:14,394][106226] Updated weights for policy 0, policy_version 832671 (0.0010) [2023-12-28 01:14:14,921][106225] Updated weights for policy 1, policy_version 834593 (0.0007) [2023-12-28 01:14:14,985][106225] Updated weights for policy 1, policy_version 834603 (0.0008) [2023-12-28 01:14:15,045][106225] Updated weights for policy 1, policy_version 834613 (0.0009) [2023-12-28 01:14:15,109][106225] Updated weights for policy 1, policy_version 834623 (0.0008) [2023-12-28 01:14:15,118][106226] Updated weights for policy 0, policy_version 832681 (0.0010) [2023-12-28 01:14:15,180][106226] Updated weights for policy 0, policy_version 832691 (0.0008) [2023-12-28 01:14:15,248][106226] Updated weights for policy 0, policy_version 832701 (0.0008) [2023-12-28 01:14:15,309][106226] Updated weights for policy 0, policy_version 832711 (0.0009) [2023-12-28 01:14:15,815][106225] Updated weights for policy 1, policy_version 834633 (0.0008) [2023-12-28 01:14:15,870][106225] Updated weights for policy 1, policy_version 834643 (0.0006) [2023-12-28 01:14:15,918][106225] Updated weights for policy 1, policy_version 834653 (0.0006) [2023-12-28 01:14:15,920][106226] Updated weights for policy 0, policy_version 832721 (0.0007) [2023-12-28 01:14:15,993][106226] Updated weights for policy 0, policy_version 832731 (0.0009) [2023-12-28 01:14:16,052][106226] Updated weights for policy 0, policy_version 832741 (0.0009) [2023-12-28 01:14:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 426950656. Throughput: 0: 10015.3, 1: 9865.5. Samples: 426934616. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:16,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-5.094')] [2023-12-28 01:14:16,623][106225] Updated weights for policy 1, policy_version 834663 (0.0007) [2023-12-28 01:14:16,680][106225] Updated weights for policy 1, policy_version 834673 (0.0008) [2023-12-28 01:14:16,681][106226] Updated weights for policy 0, policy_version 832751 (0.0008) [2023-12-28 01:14:16,732][106226] Updated weights for policy 0, policy_version 832761 (0.0005) [2023-12-28 01:14:16,739][106225] Updated weights for policy 1, policy_version 834683 (0.0008) [2023-12-28 01:14:16,797][106226] Updated weights for policy 0, policy_version 832771 (0.0005) [2023-12-28 01:14:17,431][106225] Updated weights for policy 1, policy_version 834693 (0.0008) [2023-12-28 01:14:17,487][106226] Updated weights for policy 0, policy_version 832781 (0.0008) [2023-12-28 01:14:17,498][106225] Updated weights for policy 1, policy_version 834703 (0.0008) [2023-12-28 01:14:17,546][106226] Updated weights for policy 0, policy_version 832791 (0.0008) [2023-12-28 01:14:17,559][106225] Updated weights for policy 1, policy_version 834713 (0.0009) [2023-12-28 01:14:17,609][106226] Updated weights for policy 0, policy_version 832801 (0.0007) [2023-12-28 01:14:18,290][106226] Updated weights for policy 0, policy_version 832811 (0.0008) [2023-12-28 01:14:18,301][106225] Updated weights for policy 1, policy_version 834723 (0.0007) [2023-12-28 01:14:18,359][106226] Updated weights for policy 0, policy_version 832821 (0.0007) [2023-12-28 01:14:18,365][106225] Updated weights for policy 1, policy_version 834733 (0.0007) [2023-12-28 01:14:18,418][106226] Updated weights for policy 0, policy_version 832831 (0.0009) [2023-12-28 01:14:18,426][106225] Updated weights for policy 1, policy_version 834743 (0.0005) [2023-12-28 01:14:19,106][106225] Updated weights for policy 1, policy_version 834753 (0.0006) [2023-12-28 01:14:19,167][106225] Updated weights for policy 1, policy_version 834763 (0.0008) [2023-12-28 01:14:19,182][106226] Updated weights for policy 0, policy_version 832841 (0.0008) [2023-12-28 01:14:19,223][106225] Updated weights for policy 1, policy_version 834773 (0.0008) [2023-12-28 01:14:19,256][106226] Updated weights for policy 0, policy_version 832851 (0.0007) [2023-12-28 01:14:19,282][106225] Updated weights for policy 1, policy_version 834783 (0.0007) [2023-12-28 01:14:19,318][106226] Updated weights for policy 0, policy_version 832861 (0.0007) [2023-12-28 01:14:19,386][106226] Updated weights for policy 0, policy_version 832871 (0.0009) [2023-12-28 01:14:20,101][106226] Updated weights for policy 0, policy_version 832881 (0.0008) [2023-12-28 01:14:20,115][106225] Updated weights for policy 1, policy_version 834793 (0.0007) [2023-12-28 01:14:20,161][106226] Updated weights for policy 0, policy_version 832891 (0.0006) [2023-12-28 01:14:20,170][106225] Updated weights for policy 1, policy_version 834803 (0.0007) [2023-12-28 01:14:20,223][106226] Updated weights for policy 0, policy_version 832901 (0.0007) [2023-12-28 01:14:20,237][106225] Updated weights for policy 1, policy_version 834813 (0.0008) [2023-12-28 01:14:20,951][106226] Updated weights for policy 0, policy_version 832911 (0.0008) [2023-12-28 01:14:20,988][106225] Updated weights for policy 1, policy_version 834823 (0.0009) [2023-12-28 01:14:21,015][106226] Updated weights for policy 0, policy_version 832921 (0.0007) [2023-12-28 01:14:21,053][106225] Updated weights for policy 1, policy_version 834833 (0.0007) [2023-12-28 01:14:21,081][106226] Updated weights for policy 0, policy_version 832931 (0.0008) [2023-12-28 01:14:21,106][106225] Updated weights for policy 1, policy_version 834843 (0.0007) [2023-12-28 01:14:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 427048960. Throughput: 0: 9902.8, 1: 9868.2. Samples: 427051116. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:21,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-5.031')] [2023-12-28 01:14:21,881][106225] Updated weights for policy 1, policy_version 834853 (0.0008) [2023-12-28 01:14:21,894][106226] Updated weights for policy 0, policy_version 832941 (0.0009) [2023-12-28 01:14:21,944][106225] Updated weights for policy 1, policy_version 834863 (0.0006) [2023-12-28 01:14:21,954][106226] Updated weights for policy 0, policy_version 832951 (0.0008) [2023-12-28 01:14:22,005][106225] Updated weights for policy 1, policy_version 834873 (0.0008) [2023-12-28 01:14:22,019][106226] Updated weights for policy 0, policy_version 832961 (0.0006) [2023-12-28 01:14:22,703][106226] Updated weights for policy 0, policy_version 832971 (0.0008) [2023-12-28 01:14:22,763][106226] Updated weights for policy 0, policy_version 832981 (0.0008) [2023-12-28 01:14:22,795][106225] Updated weights for policy 1, policy_version 834883 (0.0006) [2023-12-28 01:14:22,822][106226] Updated weights for policy 0, policy_version 832991 (0.0007) [2023-12-28 01:14:22,856][106225] Updated weights for policy 1, policy_version 834893 (0.0008) [2023-12-28 01:14:22,920][106225] Updated weights for policy 1, policy_version 834903 (0.0008) [2023-12-28 01:14:23,504][106226] Updated weights for policy 0, policy_version 833001 (0.0008) [2023-12-28 01:14:23,563][106226] Updated weights for policy 0, policy_version 833011 (0.0008) [2023-12-28 01:14:23,614][106226] Updated weights for policy 0, policy_version 833021 (0.0005) [2023-12-28 01:14:23,669][106226] Updated weights for policy 0, policy_version 833031 (0.0005) [2023-12-28 01:14:23,693][106225] Updated weights for policy 1, policy_version 834913 (0.0008) [2023-12-28 01:14:23,754][106225] Updated weights for policy 1, policy_version 834923 (0.0009) [2023-12-28 01:14:23,814][106225] Updated weights for policy 1, policy_version 834933 (0.0009) [2023-12-28 01:14:23,865][106225] Updated weights for policy 1, policy_version 834943 (0.0008) [2023-12-28 01:14:24,402][106226] Updated weights for policy 0, policy_version 833041 (0.0007) [2023-12-28 01:14:24,458][106226] Updated weights for policy 0, policy_version 833051 (0.0007) [2023-12-28 01:14:24,506][106225] Updated weights for policy 1, policy_version 834953 (0.0010) [2023-12-28 01:14:24,516][106226] Updated weights for policy 0, policy_version 833061 (0.0006) [2023-12-28 01:14:24,559][106225] Updated weights for policy 1, policy_version 834963 (0.0010) [2023-12-28 01:14:24,607][106225] Updated weights for policy 1, policy_version 834973 (0.0010) [2023-12-28 01:14:25,160][106225] Updated weights for policy 1, policy_version 834983 (0.0007) [2023-12-28 01:14:25,213][106225] Updated weights for policy 1, policy_version 834993 (0.0005) [2023-12-28 01:14:25,267][106225] Updated weights for policy 1, policy_version 835003 (0.0005) [2023-12-28 01:14:25,350][106226] Updated weights for policy 0, policy_version 833071 (0.0008) [2023-12-28 01:14:25,406][106226] Updated weights for policy 0, policy_version 833081 (0.0008) [2023-12-28 01:14:25,463][106226] Updated weights for policy 0, policy_version 833091 (0.0007) [2023-12-28 01:14:25,912][106225] Updated weights for policy 1, policy_version 835013 (0.0008) [2023-12-28 01:14:25,959][106225] Updated weights for policy 1, policy_version 835023 (0.0006) [2023-12-28 01:14:26,017][106225] Updated weights for policy 1, policy_version 835033 (0.0005) [2023-12-28 01:14:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 427139072. Throughput: 0: 9818.0, 1: 9769.2. Samples: 427108424. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:26,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.796')] [2023-12-28 01:14:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000835040_213811200.pth... [2023-12-28 01:14:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000833096_213327872.pth... [2023-12-28 01:14:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000833888_213516288.pth [2023-12-28 01:14:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000831976_213041152.pth [2023-12-28 01:14:26,239][106226] Updated weights for policy 0, policy_version 833101 (0.0008) [2023-12-28 01:14:26,301][106226] Updated weights for policy 0, policy_version 833111 (0.0006) [2023-12-28 01:14:26,368][106226] Updated weights for policy 0, policy_version 833121 (0.0008) [2023-12-28 01:14:26,702][106225] Updated weights for policy 1, policy_version 835043 (0.0007) [2023-12-28 01:14:26,761][106225] Updated weights for policy 1, policy_version 835053 (0.0010) [2023-12-28 01:14:26,822][106225] Updated weights for policy 1, policy_version 835063 (0.0010) [2023-12-28 01:14:27,010][106226] Updated weights for policy 0, policy_version 833131 (0.0009) [2023-12-28 01:14:27,061][106226] Updated weights for policy 0, policy_version 833141 (0.0010) [2023-12-28 01:14:27,113][106226] Updated weights for policy 0, policy_version 833151 (0.0010) [2023-12-28 01:14:27,425][106225] Updated weights for policy 1, policy_version 835073 (0.0010) [2023-12-28 01:14:27,478][106225] Updated weights for policy 1, policy_version 835083 (0.0005) [2023-12-28 01:14:27,523][106225] Updated weights for policy 1, policy_version 835093 (0.0006) [2023-12-28 01:14:27,569][106225] Updated weights for policy 1, policy_version 835103 (0.0005) [2023-12-28 01:14:27,747][106226] Updated weights for policy 0, policy_version 833161 (0.0010) [2023-12-28 01:14:27,804][106226] Updated weights for policy 0, policy_version 833171 (0.0008) [2023-12-28 01:14:27,861][106226] Updated weights for policy 0, policy_version 833181 (0.0009) [2023-12-28 01:14:27,914][106226] Updated weights for policy 0, policy_version 833191 (0.0008) [2023-12-28 01:14:28,146][106225] Updated weights for policy 1, policy_version 835113 (0.0005) [2023-12-28 01:14:28,207][106225] Updated weights for policy 1, policy_version 835123 (0.0005) [2023-12-28 01:14:28,273][106225] Updated weights for policy 1, policy_version 835133 (0.0006) [2023-12-28 01:14:28,556][106226] Updated weights for policy 0, policy_version 833201 (0.0006) [2023-12-28 01:14:28,617][106226] Updated weights for policy 0, policy_version 833211 (0.0006) [2023-12-28 01:14:28,678][106226] Updated weights for policy 0, policy_version 833221 (0.0006) [2023-12-28 01:14:28,942][106225] Updated weights for policy 1, policy_version 835143 (0.0009) [2023-12-28 01:14:28,993][106225] Updated weights for policy 1, policy_version 835153 (0.0009) [2023-12-28 01:14:29,057][106225] Updated weights for policy 1, policy_version 835163 (0.0010) [2023-12-28 01:14:29,306][106226] Updated weights for policy 0, policy_version 833231 (0.0006) [2023-12-28 01:14:29,377][106226] Updated weights for policy 0, policy_version 833241 (0.0007) [2023-12-28 01:14:29,431][106226] Updated weights for policy 0, policy_version 833251 (0.0007) [2023-12-28 01:14:29,794][106225] Updated weights for policy 1, policy_version 835173 (0.0011) [2023-12-28 01:14:29,866][106225] Updated weights for policy 1, policy_version 835183 (0.0010) [2023-12-28 01:14:29,928][106225] Updated weights for policy 1, policy_version 835193 (0.0010) [2023-12-28 01:14:30,041][106226] Updated weights for policy 0, policy_version 833261 (0.0008) [2023-12-28 01:14:30,105][106226] Updated weights for policy 0, policy_version 833271 (0.0007) [2023-12-28 01:14:30,169][106226] Updated weights for policy 0, policy_version 833281 (0.0010) [2023-12-28 01:14:30,554][106225] Updated weights for policy 1, policy_version 835203 (0.0009) [2023-12-28 01:14:30,608][106225] Updated weights for policy 1, policy_version 835213 (0.0008) [2023-12-28 01:14:30,663][106225] Updated weights for policy 1, policy_version 835223 (0.0007) [2023-12-28 01:14:30,931][106226] Updated weights for policy 0, policy_version 833291 (0.0009) [2023-12-28 01:14:30,976][106226] Updated weights for policy 0, policy_version 833301 (0.0008) [2023-12-28 01:14:31,039][106226] Updated weights for policy 0, policy_version 833311 (0.0011) [2023-12-28 01:14:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 427245568. Throughput: 0: 9875.6, 1: 9911.9. Samples: 427233200. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:31,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.037')] [2023-12-28 01:14:31,342][106225] Updated weights for policy 1, policy_version 835233 (0.0005) [2023-12-28 01:14:31,404][106225] Updated weights for policy 1, policy_version 835243 (0.0008) [2023-12-28 01:14:31,451][106225] Updated weights for policy 1, policy_version 835253 (0.0006) [2023-12-28 01:14:31,500][106225] Updated weights for policy 1, policy_version 835263 (0.0008) [2023-12-28 01:14:31,820][106226] Updated weights for policy 0, policy_version 833321 (0.0010) [2023-12-28 01:14:31,878][106226] Updated weights for policy 0, policy_version 833331 (0.0008) [2023-12-28 01:14:31,941][106226] Updated weights for policy 0, policy_version 833341 (0.0008) [2023-12-28 01:14:31,995][106226] Updated weights for policy 0, policy_version 833351 (0.0008) [2023-12-28 01:14:32,254][106225] Updated weights for policy 1, policy_version 835273 (0.0008) [2023-12-28 01:14:32,312][106225] Updated weights for policy 1, policy_version 835283 (0.0008) [2023-12-28 01:14:32,379][106225] Updated weights for policy 1, policy_version 835293 (0.0008) [2023-12-28 01:14:32,684][106226] Updated weights for policy 0, policy_version 833361 (0.0008) [2023-12-28 01:14:32,735][106226] Updated weights for policy 0, policy_version 833371 (0.0008) [2023-12-28 01:14:32,780][106226] Updated weights for policy 0, policy_version 833381 (0.0008) [2023-12-28 01:14:33,136][106225] Updated weights for policy 1, policy_version 835303 (0.0006) [2023-12-28 01:14:33,198][106225] Updated weights for policy 1, policy_version 835313 (0.0006) [2023-12-28 01:14:33,252][106225] Updated weights for policy 1, policy_version 835323 (0.0010) [2023-12-28 01:14:33,446][106226] Updated weights for policy 0, policy_version 833391 (0.0007) [2023-12-28 01:14:33,506][106226] Updated weights for policy 0, policy_version 833401 (0.0008) [2023-12-28 01:14:33,558][106226] Updated weights for policy 0, policy_version 833411 (0.0008) [2023-12-28 01:14:33,882][106225] Updated weights for policy 1, policy_version 835333 (0.0010) [2023-12-28 01:14:33,949][106225] Updated weights for policy 1, policy_version 835343 (0.0010) [2023-12-28 01:14:34,002][106225] Updated weights for policy 1, policy_version 835353 (0.0010) [2023-12-28 01:14:34,227][106226] Updated weights for policy 0, policy_version 833421 (0.0010) [2023-12-28 01:14:34,298][106226] Updated weights for policy 0, policy_version 833431 (0.0011) [2023-12-28 01:14:34,366][106226] Updated weights for policy 0, policy_version 833441 (0.0010) [2023-12-28 01:14:34,692][106225] Updated weights for policy 1, policy_version 835363 (0.0009) [2023-12-28 01:14:34,741][106225] Updated weights for policy 1, policy_version 835373 (0.0007) [2023-12-28 01:14:34,787][106225] Updated weights for policy 1, policy_version 835383 (0.0008) [2023-12-28 01:14:35,065][106226] Updated weights for policy 0, policy_version 833451 (0.0010) [2023-12-28 01:14:35,114][106226] Updated weights for policy 0, policy_version 833461 (0.0007) [2023-12-28 01:14:35,171][106226] Updated weights for policy 0, policy_version 833471 (0.0010) [2023-12-28 01:14:35,533][106225] Updated weights for policy 1, policy_version 835393 (0.0009) [2023-12-28 01:14:35,587][106225] Updated weights for policy 1, policy_version 835403 (0.0008) [2023-12-28 01:14:35,645][106225] Updated weights for policy 1, policy_version 835413 (0.0006) [2023-12-28 01:14:35,703][106225] Updated weights for policy 1, policy_version 835423 (0.0005) [2023-12-28 01:14:35,876][106226] Updated weights for policy 0, policy_version 833481 (0.0010) [2023-12-28 01:14:35,943][106226] Updated weights for policy 0, policy_version 833491 (0.0009) [2023-12-28 01:14:35,998][106226] Updated weights for policy 0, policy_version 833501 (0.0008) [2023-12-28 01:14:36,050][106226] Updated weights for policy 0, policy_version 833511 (0.0008) [2023-12-28 01:14:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 427343872. Throughput: 0: 9797.3, 1: 9962.6. Samples: 427351372. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:36,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.821')] [2023-12-28 01:14:36,410][106225] Updated weights for policy 1, policy_version 835433 (0.0006) [2023-12-28 01:14:36,480][106225] Updated weights for policy 1, policy_version 835443 (0.0010) [2023-12-28 01:14:36,545][106225] Updated weights for policy 1, policy_version 835453 (0.0010) [2023-12-28 01:14:36,779][106226] Updated weights for policy 0, policy_version 833521 (0.0006) [2023-12-28 01:14:36,846][106226] Updated weights for policy 0, policy_version 833531 (0.0006) [2023-12-28 01:14:36,910][106226] Updated weights for policy 0, policy_version 833541 (0.0007) [2023-12-28 01:14:37,195][106225] Updated weights for policy 1, policy_version 835463 (0.0011) [2023-12-28 01:14:37,254][106225] Updated weights for policy 1, policy_version 835473 (0.0011) [2023-12-28 01:14:37,315][106225] Updated weights for policy 1, policy_version 835483 (0.0010) [2023-12-28 01:14:37,508][106226] Updated weights for policy 0, policy_version 833551 (0.0007) [2023-12-28 01:14:37,561][106226] Updated weights for policy 0, policy_version 833561 (0.0005) [2023-12-28 01:14:37,620][106226] Updated weights for policy 0, policy_version 833571 (0.0005) [2023-12-28 01:14:37,993][106225] Updated weights for policy 1, policy_version 835493 (0.0010) [2023-12-28 01:14:38,053][106225] Updated weights for policy 1, policy_version 835503 (0.0010) [2023-12-28 01:14:38,113][106225] Updated weights for policy 1, policy_version 835513 (0.0010) [2023-12-28 01:14:38,160][106226] Updated weights for policy 0, policy_version 833581 (0.0005) [2023-12-28 01:14:38,209][106226] Updated weights for policy 0, policy_version 833591 (0.0007) [2023-12-28 01:14:38,265][106226] Updated weights for policy 0, policy_version 833601 (0.0008) [2023-12-28 01:14:38,798][106225] Updated weights for policy 1, policy_version 835523 (0.0008) [2023-12-28 01:14:38,866][106225] Updated weights for policy 1, policy_version 835533 (0.0006) [2023-12-28 01:14:38,927][106225] Updated weights for policy 1, policy_version 835543 (0.0006) [2023-12-28 01:14:39,007][106226] Updated weights for policy 0, policy_version 833611 (0.0007) [2023-12-28 01:14:39,073][106226] Updated weights for policy 0, policy_version 833621 (0.0006) [2023-12-28 01:14:39,134][106226] Updated weights for policy 0, policy_version 833631 (0.0007) [2023-12-28 01:14:39,584][106225] Updated weights for policy 1, policy_version 835553 (0.0006) [2023-12-28 01:14:39,642][106225] Updated weights for policy 1, policy_version 835563 (0.0007) [2023-12-28 01:14:39,712][106225] Updated weights for policy 1, policy_version 835573 (0.0011) [2023-12-28 01:14:39,781][106225] Updated weights for policy 1, policy_version 835583 (0.0011) [2023-12-28 01:14:39,865][106226] Updated weights for policy 0, policy_version 833641 (0.0009) [2023-12-28 01:14:39,933][106226] Updated weights for policy 0, policy_version 833651 (0.0008) [2023-12-28 01:14:39,995][106226] Updated weights for policy 0, policy_version 833661 (0.0008) [2023-12-28 01:14:40,064][106226] Updated weights for policy 0, policy_version 833671 (0.0008) [2023-12-28 01:14:40,503][106225] Updated weights for policy 1, policy_version 835593 (0.0008) [2023-12-28 01:14:40,555][106225] Updated weights for policy 1, policy_version 835603 (0.0008) [2023-12-28 01:14:40,609][106225] Updated weights for policy 1, policy_version 835613 (0.0008) [2023-12-28 01:14:40,689][106226] Updated weights for policy 0, policy_version 833681 (0.0008) [2023-12-28 01:14:40,758][106226] Updated weights for policy 0, policy_version 833691 (0.0008) [2023-12-28 01:14:40,822][106226] Updated weights for policy 0, policy_version 833701 (0.0008) [2023-12-28 01:14:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 427442176. Throughput: 0: 9842.6, 1: 9980.1. Samples: 427413276. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:41,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-5.000')] [2023-12-28 01:14:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000833704_213483520.pth... [2023-12-28 01:14:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000835616_213958656.pth... [2023-12-28 01:14:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000832552_213188608.pth [2023-12-28 01:14:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000834464_213663744.pth [2023-12-28 01:14:41,339][106225] Updated weights for policy 1, policy_version 835623 (0.0006) [2023-12-28 01:14:41,412][106225] Updated weights for policy 1, policy_version 835633 (0.0007) [2023-12-28 01:14:41,475][106225] Updated weights for policy 1, policy_version 835643 (0.0007) [2023-12-28 01:14:41,501][106226] Updated weights for policy 0, policy_version 833711 (0.0009) [2023-12-28 01:14:41,556][106226] Updated weights for policy 0, policy_version 833721 (0.0008) [2023-12-28 01:14:41,609][106226] Updated weights for policy 0, policy_version 833731 (0.0008) [2023-12-28 01:14:42,202][106225] Updated weights for policy 1, policy_version 835653 (0.0007) [2023-12-28 01:14:42,262][106225] Updated weights for policy 1, policy_version 835663 (0.0008) [2023-12-28 01:14:42,314][106226] Updated weights for policy 0, policy_version 833741 (0.0010) [2023-12-28 01:14:42,327][106225] Updated weights for policy 1, policy_version 835673 (0.0008) [2023-12-28 01:14:42,386][106226] Updated weights for policy 0, policy_version 833751 (0.0009) [2023-12-28 01:14:42,453][106226] Updated weights for policy 0, policy_version 833761 (0.0007) [2023-12-28 01:14:43,046][106225] Updated weights for policy 1, policy_version 835683 (0.0009) [2023-12-28 01:14:43,095][106225] Updated weights for policy 1, policy_version 835693 (0.0009) [2023-12-28 01:14:43,141][106226] Updated weights for policy 0, policy_version 833771 (0.0008) [2023-12-28 01:14:43,152][106225] Updated weights for policy 1, policy_version 835703 (0.0009) [2023-12-28 01:14:43,200][106226] Updated weights for policy 0, policy_version 833781 (0.0007) [2023-12-28 01:14:43,252][106226] Updated weights for policy 0, policy_version 833791 (0.0009) [2023-12-28 01:14:43,901][106225] Updated weights for policy 1, policy_version 835713 (0.0006) [2023-12-28 01:14:43,952][106226] Updated weights for policy 0, policy_version 833801 (0.0008) [2023-12-28 01:14:43,956][106225] Updated weights for policy 1, policy_version 835723 (0.0009) [2023-12-28 01:14:44,011][106226] Updated weights for policy 0, policy_version 833811 (0.0006) [2023-12-28 01:14:44,016][106225] Updated weights for policy 1, policy_version 835733 (0.0007) [2023-12-28 01:14:44,071][106225] Updated weights for policy 1, policy_version 835743 (0.0006) [2023-12-28 01:14:44,077][106226] Updated weights for policy 0, policy_version 833821 (0.0008) [2023-12-28 01:14:44,140][106226] Updated weights for policy 0, policy_version 833831 (0.0005) [2023-12-28 01:14:44,709][106226] Updated weights for policy 0, policy_version 833841 (0.0006) [2023-12-28 01:14:44,767][106226] Updated weights for policy 0, policy_version 833851 (0.0006) [2023-12-28 01:14:44,833][106226] Updated weights for policy 0, policy_version 833861 (0.0006) [2023-12-28 01:14:44,904][106225] Updated weights for policy 1, policy_version 835753 (0.0009) [2023-12-28 01:14:44,961][106225] Updated weights for policy 1, policy_version 835763 (0.0009) [2023-12-28 01:14:45,022][106225] Updated weights for policy 1, policy_version 835773 (0.0009) [2023-12-28 01:14:45,457][106226] Updated weights for policy 0, policy_version 833871 (0.0007) [2023-12-28 01:14:45,520][106226] Updated weights for policy 0, policy_version 833881 (0.0005) [2023-12-28 01:14:45,586][106226] Updated weights for policy 0, policy_version 833891 (0.0008) [2023-12-28 01:14:45,792][106225] Updated weights for policy 1, policy_version 835783 (0.0008) [2023-12-28 01:14:45,842][106225] Updated weights for policy 1, policy_version 835793 (0.0009) [2023-12-28 01:14:45,894][106225] Updated weights for policy 1, policy_version 835803 (0.0009) [2023-12-28 01:14:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 427540480. Throughput: 0: 9871.6, 1: 9898.8. Samples: 427531068. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:46,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-5.297')] [2023-12-28 01:14:46,191][106226] Updated weights for policy 0, policy_version 833901 (0.0008) [2023-12-28 01:14:46,252][106226] Updated weights for policy 0, policy_version 833911 (0.0010) [2023-12-28 01:14:46,303][106226] Updated weights for policy 0, policy_version 833921 (0.0010) [2023-12-28 01:14:46,694][106225] Updated weights for policy 1, policy_version 835813 (0.0008) [2023-12-28 01:14:46,755][106225] Updated weights for policy 1, policy_version 835823 (0.0009) [2023-12-28 01:14:46,817][106225] Updated weights for policy 1, policy_version 835833 (0.0008) [2023-12-28 01:14:46,923][106226] Updated weights for policy 0, policy_version 833931 (0.0009) [2023-12-28 01:14:46,978][106226] Updated weights for policy 0, policy_version 833941 (0.0005) [2023-12-28 01:14:47,039][106226] Updated weights for policy 0, policy_version 833951 (0.0005) [2023-12-28 01:14:47,598][106226] Updated weights for policy 0, policy_version 833961 (0.0006) [2023-12-28 01:14:47,611][106225] Updated weights for policy 1, policy_version 835843 (0.0009) [2023-12-28 01:14:47,661][106226] Updated weights for policy 0, policy_version 833971 (0.0008) [2023-12-28 01:14:47,671][106225] Updated weights for policy 1, policy_version 835853 (0.0006) [2023-12-28 01:14:47,724][106226] Updated weights for policy 0, policy_version 833981 (0.0008) [2023-12-28 01:14:47,727][106225] Updated weights for policy 1, policy_version 835863 (0.0006) [2023-12-28 01:14:47,788][106226] Updated weights for policy 0, policy_version 833991 (0.0008) [2023-12-28 01:14:48,397][106225] Updated weights for policy 1, policy_version 835873 (0.0007) [2023-12-28 01:14:48,459][106225] Updated weights for policy 1, policy_version 835883 (0.0008) [2023-12-28 01:14:48,520][106225] Updated weights for policy 1, policy_version 835893 (0.0008) [2023-12-28 01:14:48,534][106226] Updated weights for policy 0, policy_version 834001 (0.0006) [2023-12-28 01:14:48,578][106225] Updated weights for policy 1, policy_version 835903 (0.0010) [2023-12-28 01:14:48,597][106226] Updated weights for policy 0, policy_version 834011 (0.0007) [2023-12-28 01:14:48,650][106226] Updated weights for policy 0, policy_version 834021 (0.0008) [2023-12-28 01:14:49,290][106225] Updated weights for policy 1, policy_version 835913 (0.0006) [2023-12-28 01:14:49,360][106226] Updated weights for policy 0, policy_version 834031 (0.0008) [2023-12-28 01:14:49,372][106225] Updated weights for policy 1, policy_version 835923 (0.0007) [2023-12-28 01:14:49,428][106226] Updated weights for policy 0, policy_version 834041 (0.0008) [2023-12-28 01:14:49,436][106225] Updated weights for policy 1, policy_version 835933 (0.0008) [2023-12-28 01:14:49,497][106226] Updated weights for policy 0, policy_version 834051 (0.0008) [2023-12-28 01:14:50,146][106225] Updated weights for policy 1, policy_version 835943 (0.0008) [2023-12-28 01:14:50,202][106225] Updated weights for policy 1, policy_version 835953 (0.0009) [2023-12-28 01:14:50,243][106226] Updated weights for policy 0, policy_version 834061 (0.0008) [2023-12-28 01:14:50,257][106225] Updated weights for policy 1, policy_version 835963 (0.0007) [2023-12-28 01:14:50,303][106226] Updated weights for policy 0, policy_version 834071 (0.0008) [2023-12-28 01:14:50,363][106226] Updated weights for policy 0, policy_version 834081 (0.0008) [2023-12-28 01:14:50,956][106225] Updated weights for policy 1, policy_version 835973 (0.0006) [2023-12-28 01:14:51,020][106225] Updated weights for policy 1, policy_version 835983 (0.0006) [2023-12-28 01:14:51,093][106225] Updated weights for policy 1, policy_version 835993 (0.0008) [2023-12-28 01:14:51,167][106226] Updated weights for policy 0, policy_version 834091 (0.0008) [2023-12-28 01:14:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 427638784. Throughput: 0: 9942.8, 1: 9783.7. Samples: 427646584. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:51,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.718')] [2023-12-28 01:14:51,216][106226] Updated weights for policy 0, policy_version 834101 (0.0008) [2023-12-28 01:14:51,283][106226] Updated weights for policy 0, policy_version 834111 (0.0009) [2023-12-28 01:14:51,702][106225] Updated weights for policy 1, policy_version 836003 (0.0008) [2023-12-28 01:14:51,770][106225] Updated weights for policy 1, policy_version 836013 (0.0008) [2023-12-28 01:14:51,831][106225] Updated weights for policy 1, policy_version 836023 (0.0007) [2023-12-28 01:14:52,154][106226] Updated weights for policy 0, policy_version 834121 (0.0009) [2023-12-28 01:14:52,214][106226] Updated weights for policy 0, policy_version 834131 (0.0008) [2023-12-28 01:14:52,276][106226] Updated weights for policy 0, policy_version 834141 (0.0008) [2023-12-28 01:14:52,333][106226] Updated weights for policy 0, policy_version 834151 (0.0009) [2023-12-28 01:14:52,482][106225] Updated weights for policy 1, policy_version 836033 (0.0007) [2023-12-28 01:14:52,542][106225] Updated weights for policy 1, policy_version 836043 (0.0009) [2023-12-28 01:14:52,601][106225] Updated weights for policy 1, policy_version 836053 (0.0008) [2023-12-28 01:14:52,663][106225] Updated weights for policy 1, policy_version 836063 (0.0009) [2023-12-28 01:14:53,004][106226] Updated weights for policy 0, policy_version 834161 (0.0006) [2023-12-28 01:14:53,054][106226] Updated weights for policy 0, policy_version 834171 (0.0006) [2023-12-28 01:14:53,109][106226] Updated weights for policy 0, policy_version 834181 (0.0005) [2023-12-28 01:14:53,387][106225] Updated weights for policy 1, policy_version 836073 (0.0006) [2023-12-28 01:14:53,439][106225] Updated weights for policy 1, policy_version 836083 (0.0008) [2023-12-28 01:14:53,504][106225] Updated weights for policy 1, policy_version 836093 (0.0008) [2023-12-28 01:14:53,748][106226] Updated weights for policy 0, policy_version 834191 (0.0005) [2023-12-28 01:14:53,807][106226] Updated weights for policy 0, policy_version 834201 (0.0008) [2023-12-28 01:14:53,859][106226] Updated weights for policy 0, policy_version 834211 (0.0009) [2023-12-28 01:14:54,084][106225] Updated weights for policy 1, policy_version 836103 (0.0010) [2023-12-28 01:14:54,141][106225] Updated weights for policy 1, policy_version 836113 (0.0010) [2023-12-28 01:14:54,204][106225] Updated weights for policy 1, policy_version 836123 (0.0010) [2023-12-28 01:14:54,577][106226] Updated weights for policy 0, policy_version 834221 (0.0010) [2023-12-28 01:14:54,631][106226] Updated weights for policy 0, policy_version 834231 (0.0007) [2023-12-28 01:14:54,688][106226] Updated weights for policy 0, policy_version 834241 (0.0009) [2023-12-28 01:14:54,900][106225] Updated weights for policy 1, policy_version 836133 (0.0009) [2023-12-28 01:14:54,962][106225] Updated weights for policy 1, policy_version 836143 (0.0008) [2023-12-28 01:14:55,024][106225] Updated weights for policy 1, policy_version 836153 (0.0007) [2023-12-28 01:14:55,296][106226] Updated weights for policy 0, policy_version 834251 (0.0008) [2023-12-28 01:14:55,344][106226] Updated weights for policy 0, policy_version 834261 (0.0008) [2023-12-28 01:14:55,398][106226] Updated weights for policy 0, policy_version 834271 (0.0009) [2023-12-28 01:14:55,695][106225] Updated weights for policy 1, policy_version 836163 (0.0008) [2023-12-28 01:14:55,754][106225] Updated weights for policy 1, policy_version 836173 (0.0006) [2023-12-28 01:14:55,815][106225] Updated weights for policy 1, policy_version 836183 (0.0005) [2023-12-28 01:14:55,989][106226] Updated weights for policy 0, policy_version 834281 (0.0007) [2023-12-28 01:14:56,042][106226] Updated weights for policy 0, policy_version 834291 (0.0005) [2023-12-28 01:14:56,106][106226] Updated weights for policy 0, policy_version 834301 (0.0005) [2023-12-28 01:14:56,171][106226] Updated weights for policy 0, policy_version 834311 (0.0005) [2023-12-28 01:14:56,175][105115] Fps is (10 sec: 19659.9, 60 sec: 19660.6, 300 sec: 19882.9). Total num frames: 427737088. Throughput: 0: 9897.9, 1: 9786.6. Samples: 427706060. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:14:56,176][105115] Avg episode reward: [(0, '-4.264'), (1, '-5.018')] [2023-12-28 01:14:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000834312_213639168.pth... [2023-12-28 01:14:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000836192_214106112.pth... [2023-12-28 01:14:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000833096_213327872.pth [2023-12-28 01:14:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000835040_213811200.pth [2023-12-28 01:14:56,469][106225] Updated weights for policy 1, policy_version 836193 (0.0007) [2023-12-28 01:14:56,516][106225] Updated weights for policy 1, policy_version 836203 (0.0010) [2023-12-28 01:14:56,561][106225] Updated weights for policy 1, policy_version 836213 (0.0010) [2023-12-28 01:14:56,610][106225] Updated weights for policy 1, policy_version 836223 (0.0010) [2023-12-28 01:14:56,692][106226] Updated weights for policy 0, policy_version 834321 (0.0007) [2023-12-28 01:14:56,741][106226] Updated weights for policy 0, policy_version 834331 (0.0005) [2023-12-28 01:14:56,789][106226] Updated weights for policy 0, policy_version 834341 (0.0005) [2023-12-28 01:14:57,344][106225] Updated weights for policy 1, policy_version 836233 (0.0010) [2023-12-28 01:14:57,404][106225] Updated weights for policy 1, policy_version 836243 (0.0010) [2023-12-28 01:14:57,451][106226] Updated weights for policy 0, policy_version 834351 (0.0009) [2023-12-28 01:14:57,465][106225] Updated weights for policy 1, policy_version 836253 (0.0010) [2023-12-28 01:14:57,494][106226] Updated weights for policy 0, policy_version 834361 (0.0010) [2023-12-28 01:14:57,552][106226] Updated weights for policy 0, policy_version 834371 (0.0010) [2023-12-28 01:14:58,095][106225] Updated weights for policy 1, policy_version 836263 (0.0010) [2023-12-28 01:14:58,147][106225] Updated weights for policy 1, policy_version 836273 (0.0010) [2023-12-28 01:14:58,174][106226] Updated weights for policy 0, policy_version 834381 (0.0010) [2023-12-28 01:14:58,188][106225] Updated weights for policy 1, policy_version 836283 (0.0010) [2023-12-28 01:14:58,237][106226] Updated weights for policy 0, policy_version 834391 (0.0010) [2023-12-28 01:14:58,294][106226] Updated weights for policy 0, policy_version 834401 (0.0011) [2023-12-28 01:14:59,041][106225] Updated weights for policy 1, policy_version 836293 (0.0009) [2023-12-28 01:14:59,103][106226] Updated weights for policy 0, policy_version 834411 (0.0008) [2023-12-28 01:14:59,105][106225] Updated weights for policy 1, policy_version 836303 (0.0007) [2023-12-28 01:14:59,162][106225] Updated weights for policy 1, policy_version 836313 (0.0007) [2023-12-28 01:14:59,163][106226] Updated weights for policy 0, policy_version 834421 (0.0008) [2023-12-28 01:14:59,222][106226] Updated weights for policy 0, policy_version 834431 (0.0008) [2023-12-28 01:14:59,904][106226] Updated weights for policy 0, policy_version 834441 (0.0008) [2023-12-28 01:14:59,957][106225] Updated weights for policy 1, policy_version 836323 (0.0008) [2023-12-28 01:14:59,974][106226] Updated weights for policy 0, policy_version 834451 (0.0008) [2023-12-28 01:15:00,009][106225] Updated weights for policy 1, policy_version 836333 (0.0006) [2023-12-28 01:15:00,028][106226] Updated weights for policy 0, policy_version 834461 (0.0008) [2023-12-28 01:15:00,064][106225] Updated weights for policy 1, policy_version 836343 (0.0006) [2023-12-28 01:15:00,085][106226] Updated weights for policy 0, policy_version 834471 (0.0007) [2023-12-28 01:15:00,737][106225] Updated weights for policy 1, policy_version 836353 (0.0006) [2023-12-28 01:15:00,789][106225] Updated weights for policy 1, policy_version 836363 (0.0007) [2023-12-28 01:15:00,835][106225] Updated weights for policy 1, policy_version 836373 (0.0007) [2023-12-28 01:15:00,844][106226] Updated weights for policy 0, policy_version 834481 (0.0010) [2023-12-28 01:15:00,888][106225] Updated weights for policy 1, policy_version 836383 (0.0006) [2023-12-28 01:15:00,901][106226] Updated weights for policy 0, policy_version 834491 (0.0010) [2023-12-28 01:15:00,954][106226] Updated weights for policy 0, policy_version 834501 (0.0009) [2023-12-28 01:15:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 427843584. Throughput: 0: 10049.2, 1: 9820.4. Samples: 427828744. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:01,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.846')] [2023-12-28 01:15:01,638][106225] Updated weights for policy 1, policy_version 836393 (0.0007) [2023-12-28 01:15:01,699][106225] Updated weights for policy 1, policy_version 836403 (0.0006) [2023-12-28 01:15:01,735][106226] Updated weights for policy 0, policy_version 834511 (0.0009) [2023-12-28 01:15:01,763][106225] Updated weights for policy 1, policy_version 836413 (0.0008) [2023-12-28 01:15:01,794][106226] Updated weights for policy 0, policy_version 834521 (0.0007) [2023-12-28 01:15:01,853][106226] Updated weights for policy 0, policy_version 834531 (0.0005) [2023-12-28 01:15:02,383][106225] Updated weights for policy 1, policy_version 836423 (0.0008) [2023-12-28 01:15:02,444][106225] Updated weights for policy 1, policy_version 836433 (0.0005) [2023-12-28 01:15:02,508][106225] Updated weights for policy 1, policy_version 836443 (0.0005) [2023-12-28 01:15:02,551][106226] Updated weights for policy 0, policy_version 834541 (0.0006) [2023-12-28 01:15:02,614][106226] Updated weights for policy 0, policy_version 834551 (0.0008) [2023-12-28 01:15:02,676][106226] Updated weights for policy 0, policy_version 834561 (0.0009) [2023-12-28 01:15:03,172][106225] Updated weights for policy 1, policy_version 836453 (0.0006) [2023-12-28 01:15:03,222][106225] Updated weights for policy 1, policy_version 836463 (0.0008) [2023-12-28 01:15:03,271][106225] Updated weights for policy 1, policy_version 836473 (0.0008) [2023-12-28 01:15:03,447][106226] Updated weights for policy 0, policy_version 834571 (0.0009) [2023-12-28 01:15:03,509][106226] Updated weights for policy 0, policy_version 834581 (0.0008) [2023-12-28 01:15:03,577][106226] Updated weights for policy 0, policy_version 834591 (0.0005) [2023-12-28 01:15:03,983][106225] Updated weights for policy 1, policy_version 836483 (0.0008) [2023-12-28 01:15:04,039][106225] Updated weights for policy 1, policy_version 836493 (0.0008) [2023-12-28 01:15:04,093][106225] Updated weights for policy 1, policy_version 836503 (0.0009) [2023-12-28 01:15:04,238][106226] Updated weights for policy 0, policy_version 834601 (0.0006) [2023-12-28 01:15:04,300][106226] Updated weights for policy 0, policy_version 834611 (0.0006) [2023-12-28 01:15:04,360][106226] Updated weights for policy 0, policy_version 834621 (0.0007) [2023-12-28 01:15:04,416][106226] Updated weights for policy 0, policy_version 834631 (0.0008) [2023-12-28 01:15:04,872][106225] Updated weights for policy 1, policy_version 836513 (0.0008) [2023-12-28 01:15:04,932][106225] Updated weights for policy 1, policy_version 836523 (0.0009) [2023-12-28 01:15:04,981][106225] Updated weights for policy 1, policy_version 836533 (0.0008) [2023-12-28 01:15:05,036][106225] Updated weights for policy 1, policy_version 836543 (0.0009) [2023-12-28 01:15:05,068][106226] Updated weights for policy 0, policy_version 834641 (0.0009) [2023-12-28 01:15:05,125][106226] Updated weights for policy 0, policy_version 834651 (0.0008) [2023-12-28 01:15:05,188][106226] Updated weights for policy 0, policy_version 834661 (0.0009) [2023-12-28 01:15:05,773][106226] Updated weights for policy 0, policy_version 834671 (0.0006) [2023-12-28 01:15:05,831][106225] Updated weights for policy 1, policy_version 836553 (0.0007) [2023-12-28 01:15:05,836][106226] Updated weights for policy 0, policy_version 834681 (0.0006) [2023-12-28 01:15:05,891][106226] Updated weights for policy 0, policy_version 834691 (0.0007) [2023-12-28 01:15:05,893][106225] Updated weights for policy 1, policy_version 836563 (0.0007) [2023-12-28 01:15:05,944][106225] Updated weights for policy 1, policy_version 836573 (0.0009) [2023-12-28 01:15:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 427941888. Throughput: 0: 10082.6, 1: 9846.5. Samples: 427947928. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:06,176][105115] Avg episode reward: [(0, '-4.119'), (1, '-4.818')] [2023-12-28 01:15:06,524][106226] Updated weights for policy 0, policy_version 834701 (0.0007) [2023-12-28 01:15:06,585][106226] Updated weights for policy 0, policy_version 834711 (0.0009) [2023-12-28 01:15:06,647][106226] Updated weights for policy 0, policy_version 834721 (0.0007) [2023-12-28 01:15:06,687][106225] Updated weights for policy 1, policy_version 836583 (0.0009) [2023-12-28 01:15:06,750][106225] Updated weights for policy 1, policy_version 836593 (0.0010) [2023-12-28 01:15:06,809][106225] Updated weights for policy 1, policy_version 836603 (0.0009) [2023-12-28 01:15:07,246][106226] Updated weights for policy 0, policy_version 834731 (0.0010) [2023-12-28 01:15:07,301][106226] Updated weights for policy 0, policy_version 834741 (0.0009) [2023-12-28 01:15:07,360][106226] Updated weights for policy 0, policy_version 834751 (0.0008) [2023-12-28 01:15:07,454][106225] Updated weights for policy 1, policy_version 836613 (0.0009) [2023-12-28 01:15:07,503][106225] Updated weights for policy 1, policy_version 836623 (0.0008) [2023-12-28 01:15:07,555][106225] Updated weights for policy 1, policy_version 836633 (0.0008) [2023-12-28 01:15:08,069][106226] Updated weights for policy 0, policy_version 834761 (0.0011) [2023-12-28 01:15:08,131][106226] Updated weights for policy 0, policy_version 834771 (0.0008) [2023-12-28 01:15:08,185][106226] Updated weights for policy 0, policy_version 834781 (0.0008) [2023-12-28 01:15:08,234][106226] Updated weights for policy 0, policy_version 834791 (0.0009) [2023-12-28 01:15:08,316][106225] Updated weights for policy 1, policy_version 836643 (0.0008) [2023-12-28 01:15:08,383][106225] Updated weights for policy 1, policy_version 836653 (0.0006) [2023-12-28 01:15:08,440][106225] Updated weights for policy 1, policy_version 836663 (0.0008) [2023-12-28 01:15:09,016][106226] Updated weights for policy 0, policy_version 834801 (0.0010) [2023-12-28 01:15:09,055][106225] Updated weights for policy 1, policy_version 836673 (0.0006) [2023-12-28 01:15:09,069][106226] Updated weights for policy 0, policy_version 834811 (0.0010) [2023-12-28 01:15:09,107][106225] Updated weights for policy 1, policy_version 836683 (0.0006) [2023-12-28 01:15:09,135][106226] Updated weights for policy 0, policy_version 834821 (0.0010) [2023-12-28 01:15:09,157][106225] Updated weights for policy 1, policy_version 836693 (0.0006) [2023-12-28 01:15:09,213][106225] Updated weights for policy 1, policy_version 836703 (0.0009) [2023-12-28 01:15:09,794][106226] Updated weights for policy 0, policy_version 834831 (0.0009) [2023-12-28 01:15:09,859][106226] Updated weights for policy 0, policy_version 834841 (0.0009) [2023-12-28 01:15:09,916][106226] Updated weights for policy 0, policy_version 834851 (0.0008) [2023-12-28 01:15:10,069][106225] Updated weights for policy 1, policy_version 836713 (0.0007) [2023-12-28 01:15:10,130][106225] Updated weights for policy 1, policy_version 836723 (0.0009) [2023-12-28 01:15:10,189][106225] Updated weights for policy 1, policy_version 836733 (0.0007) [2023-12-28 01:15:10,621][106226] Updated weights for policy 0, policy_version 834861 (0.0007) [2023-12-28 01:15:10,679][106226] Updated weights for policy 0, policy_version 834871 (0.0008) [2023-12-28 01:15:10,731][106226] Updated weights for policy 0, policy_version 834881 (0.0009) [2023-12-28 01:15:10,921][106225] Updated weights for policy 1, policy_version 836743 (0.0008) [2023-12-28 01:15:10,978][106225] Updated weights for policy 1, policy_version 836753 (0.0007) [2023-12-28 01:15:11,044][106225] Updated weights for policy 1, policy_version 836763 (0.0009) [2023-12-28 01:15:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 428040192. Throughput: 0: 10078.7, 1: 9893.3. Samples: 428007160. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:11,175][105115] Avg episode reward: [(0, '-4.165'), (1, '-4.776')] [2023-12-28 01:15:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000836768_214253568.pth... [2023-12-28 01:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000834888_213786624.pth... [2023-12-28 01:15:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000835616_213958656.pth [2023-12-28 01:15:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000833704_213483520.pth [2023-12-28 01:15:11,506][106226] Updated weights for policy 0, policy_version 834891 (0.0006) [2023-12-28 01:15:11,568][106226] Updated weights for policy 0, policy_version 834901 (0.0008) [2023-12-28 01:15:11,633][106226] Updated weights for policy 0, policy_version 834911 (0.0009) [2023-12-28 01:15:11,831][106225] Updated weights for policy 1, policy_version 836773 (0.0008) [2023-12-28 01:15:11,887][106225] Updated weights for policy 1, policy_version 836783 (0.0010) [2023-12-28 01:15:11,938][106225] Updated weights for policy 1, policy_version 836793 (0.0010) [2023-12-28 01:15:12,349][106226] Updated weights for policy 0, policy_version 834921 (0.0009) [2023-12-28 01:15:12,404][106226] Updated weights for policy 0, policy_version 834931 (0.0008) [2023-12-28 01:15:12,452][106226] Updated weights for policy 0, policy_version 834941 (0.0008) [2023-12-28 01:15:12,511][106226] Updated weights for policy 0, policy_version 834951 (0.0008) [2023-12-28 01:15:12,672][106225] Updated weights for policy 1, policy_version 836803 (0.0009) [2023-12-28 01:15:12,728][106225] Updated weights for policy 1, policy_version 836813 (0.0010) [2023-12-28 01:15:12,784][106225] Updated weights for policy 1, policy_version 836823 (0.0007) [2023-12-28 01:15:13,315][106226] Updated weights for policy 0, policy_version 834961 (0.0005) [2023-12-28 01:15:13,367][106226] Updated weights for policy 0, policy_version 834971 (0.0005) [2023-12-28 01:15:13,426][106226] Updated weights for policy 0, policy_version 834981 (0.0005) [2023-12-28 01:15:13,441][106225] Updated weights for policy 1, policy_version 836833 (0.0010) [2023-12-28 01:15:13,501][106225] Updated weights for policy 1, policy_version 836843 (0.0010) [2023-12-28 01:15:13,558][106225] Updated weights for policy 1, policy_version 836853 (0.0010) [2023-12-28 01:15:13,617][106225] Updated weights for policy 1, policy_version 836863 (0.0010) [2023-12-28 01:15:13,955][106226] Updated weights for policy 0, policy_version 834991 (0.0005) [2023-12-28 01:15:14,001][106226] Updated weights for policy 0, policy_version 835001 (0.0005) [2023-12-28 01:15:14,049][106226] Updated weights for policy 0, policy_version 835011 (0.0005) [2023-12-28 01:15:14,302][106225] Updated weights for policy 1, policy_version 836873 (0.0010) [2023-12-28 01:15:14,366][106225] Updated weights for policy 1, policy_version 836883 (0.0010) [2023-12-28 01:15:14,430][106225] Updated weights for policy 1, policy_version 836893 (0.0010) [2023-12-28 01:15:14,580][106226] Updated weights for policy 0, policy_version 835021 (0.0007) [2023-12-28 01:15:14,640][106226] Updated weights for policy 0, policy_version 835031 (0.0006) [2023-12-28 01:15:14,705][106226] Updated weights for policy 0, policy_version 835041 (0.0009) [2023-12-28 01:15:15,052][106225] Updated weights for policy 1, policy_version 836903 (0.0009) [2023-12-28 01:15:15,107][106225] Updated weights for policy 1, policy_version 836913 (0.0009) [2023-12-28 01:15:15,169][106225] Updated weights for policy 1, policy_version 836923 (0.0009) [2023-12-28 01:15:15,466][106226] Updated weights for policy 0, policy_version 835051 (0.0008) [2023-12-28 01:15:15,538][106226] Updated weights for policy 0, policy_version 835061 (0.0009) [2023-12-28 01:15:15,602][106226] Updated weights for policy 0, policy_version 835071 (0.0009) [2023-12-28 01:15:15,853][106225] Updated weights for policy 1, policy_version 836933 (0.0009) [2023-12-28 01:15:15,919][106225] Updated weights for policy 1, policy_version 836943 (0.0008) [2023-12-28 01:15:15,969][106225] Updated weights for policy 1, policy_version 836953 (0.0007) [2023-12-28 01:15:16,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 428138496. Throughput: 0: 10103.3, 1: 9735.6. Samples: 428125948. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:16,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.965')] [2023-12-28 01:15:16,300][106226] Updated weights for policy 0, policy_version 835081 (0.0008) [2023-12-28 01:15:16,358][106226] Updated weights for policy 0, policy_version 835091 (0.0008) [2023-12-28 01:15:16,411][106226] Updated weights for policy 0, policy_version 835101 (0.0008) [2023-12-28 01:15:16,463][106226] Updated weights for policy 0, policy_version 835111 (0.0009) [2023-12-28 01:15:16,629][106225] Updated weights for policy 1, policy_version 836963 (0.0006) [2023-12-28 01:15:16,685][106225] Updated weights for policy 1, policy_version 836973 (0.0005) [2023-12-28 01:15:16,740][106225] Updated weights for policy 1, policy_version 836983 (0.0005) [2023-12-28 01:15:17,137][106226] Updated weights for policy 0, policy_version 835121 (0.0005) [2023-12-28 01:15:17,211][106226] Updated weights for policy 0, policy_version 835131 (0.0005) [2023-12-28 01:15:17,269][106226] Updated weights for policy 0, policy_version 835141 (0.0008) [2023-12-28 01:15:17,348][106225] Updated weights for policy 1, policy_version 836993 (0.0006) [2023-12-28 01:15:17,399][106225] Updated weights for policy 1, policy_version 837003 (0.0008) [2023-12-28 01:15:17,454][106225] Updated weights for policy 1, policy_version 837013 (0.0008) [2023-12-28 01:15:17,507][106225] Updated weights for policy 1, policy_version 837023 (0.0010) [2023-12-28 01:15:17,897][106226] Updated weights for policy 0, policy_version 835151 (0.0009) [2023-12-28 01:15:17,957][106226] Updated weights for policy 0, policy_version 835161 (0.0011) [2023-12-28 01:15:18,008][106226] Updated weights for policy 0, policy_version 835171 (0.0010) [2023-12-28 01:15:18,207][106225] Updated weights for policy 1, policy_version 837033 (0.0010) [2023-12-28 01:15:18,261][106225] Updated weights for policy 1, policy_version 837043 (0.0010) [2023-12-28 01:15:18,315][106225] Updated weights for policy 1, policy_version 837053 (0.0010) [2023-12-28 01:15:18,752][106226] Updated weights for policy 0, policy_version 835181 (0.0009) [2023-12-28 01:15:18,809][106226] Updated weights for policy 0, policy_version 835191 (0.0011) [2023-12-28 01:15:18,872][106226] Updated weights for policy 0, policy_version 835201 (0.0011) [2023-12-28 01:15:18,928][106225] Updated weights for policy 1, policy_version 837063 (0.0006) [2023-12-28 01:15:18,979][106225] Updated weights for policy 1, policy_version 837073 (0.0005) [2023-12-28 01:15:19,026][106225] Updated weights for policy 1, policy_version 837083 (0.0005) [2023-12-28 01:15:19,565][106226] Updated weights for policy 0, policy_version 835211 (0.0009) [2023-12-28 01:15:19,627][106226] Updated weights for policy 0, policy_version 835221 (0.0009) [2023-12-28 01:15:19,675][106225] Updated weights for policy 1, policy_version 837093 (0.0005) [2023-12-28 01:15:19,687][106226] Updated weights for policy 0, policy_version 835231 (0.0008) [2023-12-28 01:15:19,743][106225] Updated weights for policy 1, policy_version 837103 (0.0006) [2023-12-28 01:15:19,808][106225] Updated weights for policy 1, policy_version 837113 (0.0009) [2023-12-28 01:15:20,385][106226] Updated weights for policy 0, policy_version 835241 (0.0009) [2023-12-28 01:15:20,444][106226] Updated weights for policy 0, policy_version 835251 (0.0008) [2023-12-28 01:15:20,504][106225] Updated weights for policy 1, policy_version 837123 (0.0008) [2023-12-28 01:15:20,506][106226] Updated weights for policy 0, policy_version 835261 (0.0009) [2023-12-28 01:15:20,566][106226] Updated weights for policy 0, policy_version 835271 (0.0008) [2023-12-28 01:15:20,566][106225] Updated weights for policy 1, policy_version 837133 (0.0008) [2023-12-28 01:15:20,631][106225] Updated weights for policy 1, policy_version 837143 (0.0009) [2023-12-28 01:15:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 428236800. Throughput: 0: 10104.0, 1: 9807.8. Samples: 428247400. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:21,175][105115] Avg episode reward: [(0, '-4.233'), (1, '-5.078')] [2023-12-28 01:15:21,396][106226] Updated weights for policy 0, policy_version 835281 (0.0009) [2023-12-28 01:15:21,404][106225] Updated weights for policy 1, policy_version 837153 (0.0009) [2023-12-28 01:15:21,457][106226] Updated weights for policy 0, policy_version 835291 (0.0009) [2023-12-28 01:15:21,462][106225] Updated weights for policy 1, policy_version 837163 (0.0009) [2023-12-28 01:15:21,520][106225] Updated weights for policy 1, policy_version 837173 (0.0009) [2023-12-28 01:15:21,535][106226] Updated weights for policy 0, policy_version 835301 (0.0009) [2023-12-28 01:15:21,585][106225] Updated weights for policy 1, policy_version 837183 (0.0009) [2023-12-28 01:15:22,263][106226] Updated weights for policy 0, policy_version 835311 (0.0006) [2023-12-28 01:15:22,336][106226] Updated weights for policy 0, policy_version 835321 (0.0008) [2023-12-28 01:15:22,352][106225] Updated weights for policy 1, policy_version 837193 (0.0007) [2023-12-28 01:15:22,404][106226] Updated weights for policy 0, policy_version 835331 (0.0010) [2023-12-28 01:15:22,418][106225] Updated weights for policy 1, policy_version 837203 (0.0009) [2023-12-28 01:15:22,474][106225] Updated weights for policy 1, policy_version 837213 (0.0008) [2023-12-28 01:15:23,102][106226] Updated weights for policy 0, policy_version 835341 (0.0010) [2023-12-28 01:15:23,148][106225] Updated weights for policy 1, policy_version 837223 (0.0009) [2023-12-28 01:15:23,166][106226] Updated weights for policy 0, policy_version 835351 (0.0011) [2023-12-28 01:15:23,197][106225] Updated weights for policy 1, policy_version 837233 (0.0010) [2023-12-28 01:15:23,221][106226] Updated weights for policy 0, policy_version 835361 (0.0010) [2023-12-28 01:15:23,252][106225] Updated weights for policy 1, policy_version 837243 (0.0009) [2023-12-28 01:15:23,769][106226] Updated weights for policy 0, policy_version 835371 (0.0006) [2023-12-28 01:15:23,818][106226] Updated weights for policy 0, policy_version 835381 (0.0005) [2023-12-28 01:15:23,866][106226] Updated weights for policy 0, policy_version 835391 (0.0005) [2023-12-28 01:15:23,871][106225] Updated weights for policy 1, policy_version 837253 (0.0008) [2023-12-28 01:15:23,932][106225] Updated weights for policy 1, policy_version 837263 (0.0010) [2023-12-28 01:15:23,986][106225] Updated weights for policy 1, policy_version 837273 (0.0010) [2023-12-28 01:15:24,502][106226] Updated weights for policy 0, policy_version 835401 (0.0006) [2023-12-28 01:15:24,562][106226] Updated weights for policy 0, policy_version 835411 (0.0011) [2023-12-28 01:15:24,611][106226] Updated weights for policy 0, policy_version 835421 (0.0010) [2023-12-28 01:15:24,661][106226] Updated weights for policy 0, policy_version 835431 (0.0010) [2023-12-28 01:15:24,698][106225] Updated weights for policy 1, policy_version 837283 (0.0009) [2023-12-28 01:15:24,749][106225] Updated weights for policy 1, policy_version 837293 (0.0008) [2023-12-28 01:15:24,816][106225] Updated weights for policy 1, policy_version 837303 (0.0006) [2023-12-28 01:15:25,338][106226] Updated weights for policy 0, policy_version 835441 (0.0006) [2023-12-28 01:15:25,400][106226] Updated weights for policy 0, policy_version 835451 (0.0005) [2023-12-28 01:15:25,431][106225] Updated weights for policy 1, policy_version 837313 (0.0008) [2023-12-28 01:15:25,461][106226] Updated weights for policy 0, policy_version 835461 (0.0005) [2023-12-28 01:15:25,487][106225] Updated weights for policy 1, policy_version 837323 (0.0010) [2023-12-28 01:15:25,533][106225] Updated weights for policy 1, policy_version 837333 (0.0010) [2023-12-28 01:15:25,582][106225] Updated weights for policy 1, policy_version 837343 (0.0010) [2023-12-28 01:15:25,972][106226] Updated weights for policy 0, policy_version 835471 (0.0007) [2023-12-28 01:15:26,028][106226] Updated weights for policy 0, policy_version 835481 (0.0006) [2023-12-28 01:15:26,088][106226] Updated weights for policy 0, policy_version 835491 (0.0005) [2023-12-28 01:15:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 428343296. Throughput: 0: 10073.1, 1: 9789.2. Samples: 428307080. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:26,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-4.916')] [2023-12-28 01:15:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000835496_213942272.pth... [2023-12-28 01:15:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000834312_213639168.pth [2023-12-28 01:15:26,221][106225] Updated weights for policy 1, policy_version 837353 (0.0006) [2023-12-28 01:15:26,272][106225] Updated weights for policy 1, policy_version 837363 (0.0006) [2023-12-28 01:15:26,333][106225] Updated weights for policy 1, policy_version 837373 (0.0010) [2023-12-28 01:15:26,350][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000837376_214409216.pth... [2023-12-28 01:15:26,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000836192_214106112.pth [2023-12-28 01:15:26,707][106226] Updated weights for policy 0, policy_version 835501 (0.0005) [2023-12-28 01:15:26,768][106226] Updated weights for policy 0, policy_version 835511 (0.0005) [2023-12-28 01:15:26,830][106226] Updated weights for policy 0, policy_version 835521 (0.0005) [2023-12-28 01:15:26,968][106225] Updated weights for policy 1, policy_version 837383 (0.0010) [2023-12-28 01:15:27,014][106225] Updated weights for policy 1, policy_version 837393 (0.0010) [2023-12-28 01:15:27,063][106225] Updated weights for policy 1, policy_version 837403 (0.0010) [2023-12-28 01:15:27,463][106226] Updated weights for policy 0, policy_version 835531 (0.0006) [2023-12-28 01:15:27,512][106226] Updated weights for policy 0, policy_version 835541 (0.0005) [2023-12-28 01:15:27,578][106226] Updated weights for policy 0, policy_version 835551 (0.0009) [2023-12-28 01:15:27,679][106225] Updated weights for policy 1, policy_version 837413 (0.0009) [2023-12-28 01:15:27,732][106225] Updated weights for policy 1, policy_version 837423 (0.0010) [2023-12-28 01:15:27,778][106225] Updated weights for policy 1, policy_version 837433 (0.0010) [2023-12-28 01:15:28,290][106226] Updated weights for policy 0, policy_version 835561 (0.0010) [2023-12-28 01:15:28,390][106226] Updated weights for policy 0, policy_version 835571 (0.0007) [2023-12-28 01:15:28,462][106226] Updated weights for policy 0, policy_version 835581 (0.0008) [2023-12-28 01:15:28,469][106225] Updated weights for policy 1, policy_version 837443 (0.0009) [2023-12-28 01:15:28,523][106226] Updated weights for policy 0, policy_version 835591 (0.0008) [2023-12-28 01:15:28,528][106225] Updated weights for policy 1, policy_version 837453 (0.0008) [2023-12-28 01:15:28,588][106225] Updated weights for policy 1, policy_version 837463 (0.0010) [2023-12-28 01:15:29,172][106226] Updated weights for policy 0, policy_version 835601 (0.0009) [2023-12-28 01:15:29,228][106225] Updated weights for policy 1, policy_version 837473 (0.0010) [2023-12-28 01:15:29,230][106226] Updated weights for policy 0, policy_version 835611 (0.0008) [2023-12-28 01:15:29,289][106225] Updated weights for policy 1, policy_version 837483 (0.0007) [2023-12-28 01:15:29,292][106226] Updated weights for policy 0, policy_version 835621 (0.0009) [2023-12-28 01:15:29,352][106225] Updated weights for policy 1, policy_version 837493 (0.0008) [2023-12-28 01:15:29,411][106225] Updated weights for policy 1, policy_version 837503 (0.0010) [2023-12-28 01:15:30,076][106225] Updated weights for policy 1, policy_version 837513 (0.0009) [2023-12-28 01:15:30,097][106226] Updated weights for policy 0, policy_version 835631 (0.0007) [2023-12-28 01:15:30,136][106225] Updated weights for policy 1, policy_version 837523 (0.0010) [2023-12-28 01:15:30,159][106226] Updated weights for policy 0, policy_version 835641 (0.0006) [2023-12-28 01:15:30,194][106225] Updated weights for policy 1, policy_version 837533 (0.0010) [2023-12-28 01:15:30,224][106226] Updated weights for policy 0, policy_version 835651 (0.0005) [2023-12-28 01:15:30,780][106226] Updated weights for policy 0, policy_version 835661 (0.0007) [2023-12-28 01:15:30,840][106226] Updated weights for policy 0, policy_version 835671 (0.0009) [2023-12-28 01:15:30,904][106226] Updated weights for policy 0, policy_version 835681 (0.0007) [2023-12-28 01:15:30,905][106225] Updated weights for policy 1, policy_version 837543 (0.0007) [2023-12-28 01:15:30,960][106225] Updated weights for policy 1, policy_version 837553 (0.0006) [2023-12-28 01:15:31,025][106225] Updated weights for policy 1, policy_version 837563 (0.0006) [2023-12-28 01:15:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 428449792. Throughput: 0: 10092.7, 1: 9928.7. Samples: 428432032. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:31,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.050')] [2023-12-28 01:15:31,644][106226] Updated weights for policy 0, policy_version 835691 (0.0006) [2023-12-28 01:15:31,709][106226] Updated weights for policy 0, policy_version 835701 (0.0008) [2023-12-28 01:15:31,724][106225] Updated weights for policy 1, policy_version 837573 (0.0010) [2023-12-28 01:15:31,773][106226] Updated weights for policy 0, policy_version 835711 (0.0008) [2023-12-28 01:15:31,788][106225] Updated weights for policy 1, policy_version 837583 (0.0008) [2023-12-28 01:15:31,852][106225] Updated weights for policy 1, policy_version 837593 (0.0008) [2023-12-28 01:15:32,474][106225] Updated weights for policy 1, policy_version 837603 (0.0009) [2023-12-28 01:15:32,536][106225] Updated weights for policy 1, policy_version 837613 (0.0010) [2023-12-28 01:15:32,596][106225] Updated weights for policy 1, policy_version 837623 (0.0010) [2023-12-28 01:15:32,620][106226] Updated weights for policy 0, policy_version 835721 (0.0008) [2023-12-28 01:15:32,683][106226] Updated weights for policy 0, policy_version 835731 (0.0007) [2023-12-28 01:15:32,750][106226] Updated weights for policy 0, policy_version 835741 (0.0008) [2023-12-28 01:15:32,813][106226] Updated weights for policy 0, policy_version 835751 (0.0008) [2023-12-28 01:15:33,315][106225] Updated weights for policy 1, policy_version 837633 (0.0010) [2023-12-28 01:15:33,375][106225] Updated weights for policy 1, policy_version 837643 (0.0010) [2023-12-28 01:15:33,438][106225] Updated weights for policy 1, policy_version 837653 (0.0010) [2023-12-28 01:15:33,498][106225] Updated weights for policy 1, policy_version 837663 (0.0010) [2023-12-28 01:15:33,546][106226] Updated weights for policy 0, policy_version 835761 (0.0008) [2023-12-28 01:15:33,603][106226] Updated weights for policy 0, policy_version 835771 (0.0008) [2023-12-28 01:15:33,662][106226] Updated weights for policy 0, policy_version 835781 (0.0008) [2023-12-28 01:15:34,210][106225] Updated weights for policy 1, policy_version 837673 (0.0009) [2023-12-28 01:15:34,270][106225] Updated weights for policy 1, policy_version 837683 (0.0008) [2023-12-28 01:15:34,333][106225] Updated weights for policy 1, policy_version 837693 (0.0008) [2023-12-28 01:15:34,371][106226] Updated weights for policy 0, policy_version 835791 (0.0009) [2023-12-28 01:15:34,436][106226] Updated weights for policy 0, policy_version 835801 (0.0008) [2023-12-28 01:15:34,503][106226] Updated weights for policy 0, policy_version 835811 (0.0009) [2023-12-28 01:15:35,091][106225] Updated weights for policy 1, policy_version 837703 (0.0006) [2023-12-28 01:15:35,149][106225] Updated weights for policy 1, policy_version 837713 (0.0006) [2023-12-28 01:15:35,208][106225] Updated weights for policy 1, policy_version 837723 (0.0005) [2023-12-28 01:15:35,215][106226] Updated weights for policy 0, policy_version 835821 (0.0008) [2023-12-28 01:15:35,267][106226] Updated weights for policy 0, policy_version 835831 (0.0009) [2023-12-28 01:15:35,316][106226] Updated weights for policy 0, policy_version 835841 (0.0008) [2023-12-28 01:15:35,827][106225] Updated weights for policy 1, policy_version 837733 (0.0005) [2023-12-28 01:15:35,877][106225] Updated weights for policy 1, policy_version 837743 (0.0005) [2023-12-28 01:15:35,923][106225] Updated weights for policy 1, policy_version 837753 (0.0005) [2023-12-28 01:15:36,064][106226] Updated weights for policy 0, policy_version 835851 (0.0009) [2023-12-28 01:15:36,122][106226] Updated weights for policy 0, policy_version 835861 (0.0008) [2023-12-28 01:15:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 428539904. Throughput: 0: 10046.7, 1: 10035.6. Samples: 428550292. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:36,175][105115] Avg episode reward: [(0, '-4.129'), (1, '-4.834')] [2023-12-28 01:15:36,189][106226] Updated weights for policy 0, policy_version 835871 (0.0007) [2023-12-28 01:15:36,641][106225] Updated weights for policy 1, policy_version 837763 (0.0007) [2023-12-28 01:15:36,702][106225] Updated weights for policy 1, policy_version 837773 (0.0009) [2023-12-28 01:15:36,762][106225] Updated weights for policy 1, policy_version 837783 (0.0009) [2023-12-28 01:15:36,894][106226] Updated weights for policy 0, policy_version 835881 (0.0009) [2023-12-28 01:15:36,947][106226] Updated weights for policy 0, policy_version 835891 (0.0009) [2023-12-28 01:15:37,006][106226] Updated weights for policy 0, policy_version 835901 (0.0008) [2023-12-28 01:15:37,058][106226] Updated weights for policy 0, policy_version 835911 (0.0008) [2023-12-28 01:15:37,384][106225] Updated weights for policy 1, policy_version 837793 (0.0006) [2023-12-28 01:15:37,447][106225] Updated weights for policy 1, policy_version 837803 (0.0006) [2023-12-28 01:15:37,508][106225] Updated weights for policy 1, policy_version 837813 (0.0008) [2023-12-28 01:15:37,560][106225] Updated weights for policy 1, policy_version 837823 (0.0009) [2023-12-28 01:15:37,842][106226] Updated weights for policy 0, policy_version 835921 (0.0006) [2023-12-28 01:15:37,908][106226] Updated weights for policy 0, policy_version 835931 (0.0005) [2023-12-28 01:15:37,958][106226] Updated weights for policy 0, policy_version 835941 (0.0007) [2023-12-28 01:15:38,226][106225] Updated weights for policy 1, policy_version 837833 (0.0010) [2023-12-28 01:15:38,286][106225] Updated weights for policy 1, policy_version 837843 (0.0010) [2023-12-28 01:15:38,348][106225] Updated weights for policy 1, policy_version 837853 (0.0010) [2023-12-28 01:15:38,651][106226] Updated weights for policy 0, policy_version 835951 (0.0008) [2023-12-28 01:15:38,700][106226] Updated weights for policy 0, policy_version 835961 (0.0008) [2023-12-28 01:15:38,755][106226] Updated weights for policy 0, policy_version 835971 (0.0008) [2023-12-28 01:15:39,021][106225] Updated weights for policy 1, policy_version 837863 (0.0007) [2023-12-28 01:15:39,078][106225] Updated weights for policy 1, policy_version 837873 (0.0005) [2023-12-28 01:15:39,138][106225] Updated weights for policy 1, policy_version 837883 (0.0006) [2023-12-28 01:15:39,505][106226] Updated weights for policy 0, policy_version 835981 (0.0007) [2023-12-28 01:15:39,565][106226] Updated weights for policy 0, policy_version 835991 (0.0007) [2023-12-28 01:15:39,628][106226] Updated weights for policy 0, policy_version 836001 (0.0009) [2023-12-28 01:15:39,861][106225] Updated weights for policy 1, policy_version 837893 (0.0010) [2023-12-28 01:15:39,918][106225] Updated weights for policy 1, policy_version 837903 (0.0010) [2023-12-28 01:15:39,986][106225] Updated weights for policy 1, policy_version 837913 (0.0011) [2023-12-28 01:15:40,394][106226] Updated weights for policy 0, policy_version 836011 (0.0009) [2023-12-28 01:15:40,462][106226] Updated weights for policy 0, policy_version 836021 (0.0011) [2023-12-28 01:15:40,519][106226] Updated weights for policy 0, policy_version 836031 (0.0011) [2023-12-28 01:15:40,692][106225] Updated weights for policy 1, policy_version 837923 (0.0009) [2023-12-28 01:15:40,745][106225] Updated weights for policy 1, policy_version 837933 (0.0006) [2023-12-28 01:15:40,800][106225] Updated weights for policy 1, policy_version 837943 (0.0006) [2023-12-28 01:15:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 428638208. Throughput: 0: 10038.7, 1: 10041.9. Samples: 428609680. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:41,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.801')] [2023-12-28 01:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000837952_214556672.pth... [2023-12-28 01:15:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000836040_214081536.pth... [2023-12-28 01:15:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000836768_214253568.pth [2023-12-28 01:15:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000834888_213786624.pth [2023-12-28 01:15:41,253][106226] Updated weights for policy 0, policy_version 836041 (0.0010) [2023-12-28 01:15:41,325][106226] Updated weights for policy 0, policy_version 836051 (0.0008) [2023-12-28 01:15:41,395][106226] Updated weights for policy 0, policy_version 836061 (0.0008) [2023-12-28 01:15:41,464][106226] Updated weights for policy 0, policy_version 836071 (0.0008) [2023-12-28 01:15:41,573][106225] Updated weights for policy 1, policy_version 837953 (0.0010) [2023-12-28 01:15:41,640][106225] Updated weights for policy 1, policy_version 837963 (0.0010) [2023-12-28 01:15:41,711][106225] Updated weights for policy 1, policy_version 837973 (0.0008) [2023-12-28 01:15:41,780][106225] Updated weights for policy 1, policy_version 837983 (0.0011) [2023-12-28 01:15:42,167][106226] Updated weights for policy 0, policy_version 836081 (0.0006) [2023-12-28 01:15:42,224][106226] Updated weights for policy 0, policy_version 836091 (0.0006) [2023-12-28 01:15:42,294][106226] Updated weights for policy 0, policy_version 836101 (0.0008) [2023-12-28 01:15:42,476][106225] Updated weights for policy 1, policy_version 837993 (0.0010) [2023-12-28 01:15:42,534][106225] Updated weights for policy 1, policy_version 838003 (0.0011) [2023-12-28 01:15:42,602][106225] Updated weights for policy 1, policy_version 838013 (0.0011) [2023-12-28 01:15:42,925][106226] Updated weights for policy 0, policy_version 836111 (0.0008) [2023-12-28 01:15:42,978][106226] Updated weights for policy 0, policy_version 836121 (0.0007) [2023-12-28 01:15:43,029][106226] Updated weights for policy 0, policy_version 836131 (0.0006) [2023-12-28 01:15:43,304][106225] Updated weights for policy 1, policy_version 838023 (0.0010) [2023-12-28 01:15:43,356][106225] Updated weights for policy 1, policy_version 838033 (0.0008) [2023-12-28 01:15:43,406][106225] Updated weights for policy 1, policy_version 838043 (0.0010) [2023-12-28 01:15:43,687][106226] Updated weights for policy 0, policy_version 836141 (0.0008) [2023-12-28 01:15:43,738][106226] Updated weights for policy 0, policy_version 836151 (0.0007) [2023-12-28 01:15:43,784][106226] Updated weights for policy 0, policy_version 836161 (0.0008) [2023-12-28 01:15:44,129][106225] Updated weights for policy 1, policy_version 838053 (0.0010) [2023-12-28 01:15:44,185][106225] Updated weights for policy 1, policy_version 838063 (0.0010) [2023-12-28 01:15:44,246][106225] Updated weights for policy 1, policy_version 838073 (0.0010) [2023-12-28 01:15:44,413][106226] Updated weights for policy 0, policy_version 836171 (0.0009) [2023-12-28 01:15:44,479][106226] Updated weights for policy 0, policy_version 836181 (0.0011) [2023-12-28 01:15:44,536][106226] Updated weights for policy 0, policy_version 836191 (0.0010) [2023-12-28 01:15:44,987][106225] Updated weights for policy 1, policy_version 838083 (0.0010) [2023-12-28 01:15:45,048][106225] Updated weights for policy 1, policy_version 838093 (0.0008) [2023-12-28 01:15:45,105][106225] Updated weights for policy 1, policy_version 838103 (0.0008) [2023-12-28 01:15:45,207][106226] Updated weights for policy 0, policy_version 836201 (0.0011) [2023-12-28 01:15:45,271][106226] Updated weights for policy 0, policy_version 836211 (0.0009) [2023-12-28 01:15:45,332][106226] Updated weights for policy 0, policy_version 836221 (0.0011) [2023-12-28 01:15:45,392][106226] Updated weights for policy 0, policy_version 836231 (0.0011) [2023-12-28 01:15:45,724][106225] Updated weights for policy 1, policy_version 838113 (0.0008) [2023-12-28 01:15:45,777][106225] Updated weights for policy 1, policy_version 838123 (0.0010) [2023-12-28 01:15:45,829][106225] Updated weights for policy 1, policy_version 838133 (0.0006) [2023-12-28 01:15:45,890][106225] Updated weights for policy 1, policy_version 838143 (0.0005) [2023-12-28 01:15:46,033][106226] Updated weights for policy 0, policy_version 836241 (0.0006) [2023-12-28 01:15:46,089][106226] Updated weights for policy 0, policy_version 836251 (0.0005) [2023-12-28 01:15:46,150][106226] Updated weights for policy 0, policy_version 836261 (0.0005) [2023-12-28 01:15:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.3, 300 sec: 19938.5). Total num frames: 428744704. Throughput: 0: 9971.0, 1: 10001.8. Samples: 428727528. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 01:15:46,176][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.990')] [2023-12-28 01:15:46,487][106225] Updated weights for policy 1, policy_version 838153 (0.0010) [2023-12-28 01:15:46,540][106225] Updated weights for policy 1, policy_version 838163 (0.0010) [2023-12-28 01:15:46,594][106225] Updated weights for policy 1, policy_version 838173 (0.0010) [2023-12-28 01:15:46,666][106226] Updated weights for policy 0, policy_version 836271 (0.0005) [2023-12-28 01:15:46,723][106226] Updated weights for policy 0, policy_version 836281 (0.0006) [2023-12-28 01:15:46,783][106226] Updated weights for policy 0, policy_version 836291 (0.0008) [2023-12-28 01:15:47,307][106225] Updated weights for policy 1, policy_version 838183 (0.0010) [2023-12-28 01:15:47,354][106225] Updated weights for policy 1, policy_version 838193 (0.0010) [2023-12-28 01:15:47,405][106225] Updated weights for policy 1, policy_version 838203 (0.0009) [2023-12-28 01:15:47,438][106226] Updated weights for policy 0, policy_version 836301 (0.0008) [2023-12-28 01:15:47,502][106226] Updated weights for policy 0, policy_version 836311 (0.0006) [2023-12-28 01:15:47,560][106226] Updated weights for policy 0, policy_version 836321 (0.0006) [2023-12-28 01:15:47,967][106225] Updated weights for policy 1, policy_version 838213 (0.0006) [2023-12-28 01:15:48,016][106225] Updated weights for policy 1, policy_version 838223 (0.0005) [2023-12-28 01:15:48,062][106225] Updated weights for policy 1, policy_version 838233 (0.0005) [2023-12-28 01:15:48,256][106226] Updated weights for policy 0, policy_version 836331 (0.0006) [2023-12-28 01:15:48,314][106226] Updated weights for policy 0, policy_version 836341 (0.0005) [2023-12-28 01:15:48,376][106226] Updated weights for policy 0, policy_version 836351 (0.0008) [2023-12-28 01:15:48,749][106225] Updated weights for policy 1, policy_version 838243 (0.0006) [2023-12-28 01:15:48,812][106225] Updated weights for policy 1, policy_version 838253 (0.0010) [2023-12-28 01:15:48,878][106225] Updated weights for policy 1, policy_version 838263 (0.0010) [2023-12-28 01:15:49,054][106226] Updated weights for policy 0, policy_version 836361 (0.0007) [2023-12-28 01:15:49,109][106226] Updated weights for policy 0, policy_version 836371 (0.0005) [2023-12-28 01:15:49,170][106226] Updated weights for policy 0, policy_version 836381 (0.0005) [2023-12-28 01:15:49,233][106226] Updated weights for policy 0, policy_version 836391 (0.0009) [2023-12-28 01:15:49,588][106225] Updated weights for policy 1, policy_version 838273 (0.0010) [2023-12-28 01:15:49,652][106225] Updated weights for policy 1, policy_version 838283 (0.0006) [2023-12-28 01:15:49,723][106225] Updated weights for policy 1, policy_version 838293 (0.0008) [2023-12-28 01:15:49,790][106225] Updated weights for policy 1, policy_version 838303 (0.0009) [2023-12-28 01:15:49,916][106226] Updated weights for policy 0, policy_version 836401 (0.0010) [2023-12-28 01:15:49,982][106226] Updated weights for policy 0, policy_version 836411 (0.0008) [2023-12-28 01:15:50,054][106226] Updated weights for policy 0, policy_version 836421 (0.0011) [2023-12-28 01:15:50,471][106225] Updated weights for policy 1, policy_version 838313 (0.0006) [2023-12-28 01:15:50,518][106225] Updated weights for policy 1, policy_version 838323 (0.0005) [2023-12-28 01:15:50,570][106225] Updated weights for policy 1, policy_version 838333 (0.0007) [2023-12-28 01:15:50,757][106226] Updated weights for policy 0, policy_version 836431 (0.0011) [2023-12-28 01:15:50,816][106226] Updated weights for policy 0, policy_version 836441 (0.0011) [2023-12-28 01:15:50,873][106226] Updated weights for policy 0, policy_version 836451 (0.0011) [2023-12-28 01:15:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 428843008. Throughput: 0: 10008.2, 1: 10096.5. Samples: 428852632. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:15:51,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.963')] [2023-12-28 01:15:51,278][106225] Updated weights for policy 1, policy_version 838343 (0.0008) [2023-12-28 01:15:51,342][106225] Updated weights for policy 1, policy_version 838353 (0.0008) [2023-12-28 01:15:51,410][106225] Updated weights for policy 1, policy_version 838363 (0.0009) [2023-12-28 01:15:51,658][106226] Updated weights for policy 0, policy_version 836461 (0.0011) [2023-12-28 01:15:51,724][106226] Updated weights for policy 0, policy_version 836471 (0.0009) [2023-12-28 01:15:51,795][106226] Updated weights for policy 0, policy_version 836481 (0.0011) [2023-12-28 01:15:52,152][106225] Updated weights for policy 1, policy_version 838373 (0.0008) [2023-12-28 01:15:52,202][106225] Updated weights for policy 1, policy_version 838383 (0.0008) [2023-12-28 01:15:52,263][106225] Updated weights for policy 1, policy_version 838393 (0.0008) [2023-12-28 01:15:52,498][106226] Updated weights for policy 0, policy_version 836491 (0.0007) [2023-12-28 01:15:52,569][106226] Updated weights for policy 0, policy_version 836501 (0.0006) [2023-12-28 01:15:52,631][106226] Updated weights for policy 0, policy_version 836511 (0.0006) [2023-12-28 01:15:53,040][106225] Updated weights for policy 1, policy_version 838403 (0.0008) [2023-12-28 01:15:53,086][106225] Updated weights for policy 1, policy_version 838413 (0.0007) [2023-12-28 01:15:53,132][106225] Updated weights for policy 1, policy_version 838423 (0.0007) [2023-12-28 01:15:53,219][106226] Updated weights for policy 0, policy_version 836521 (0.0006) [2023-12-28 01:15:53,280][106226] Updated weights for policy 0, policy_version 836531 (0.0005) [2023-12-28 01:15:53,342][106226] Updated weights for policy 0, policy_version 836541 (0.0006) [2023-12-28 01:15:53,392][106226] Updated weights for policy 0, policy_version 836551 (0.0008) [2023-12-28 01:15:53,906][106225] Updated weights for policy 1, policy_version 838433 (0.0008) [2023-12-28 01:15:53,968][106225] Updated weights for policy 1, policy_version 838443 (0.0009) [2023-12-28 01:15:54,026][106225] Updated weights for policy 1, policy_version 838453 (0.0008) [2023-12-28 01:15:54,050][106226] Updated weights for policy 0, policy_version 836561 (0.0006) [2023-12-28 01:15:54,079][106225] Updated weights for policy 1, policy_version 838463 (0.0007) [2023-12-28 01:15:54,098][106226] Updated weights for policy 0, policy_version 836571 (0.0006) [2023-12-28 01:15:54,146][106226] Updated weights for policy 0, policy_version 836581 (0.0009) [2023-12-28 01:15:54,719][106225] Updated weights for policy 1, policy_version 838473 (0.0010) [2023-12-28 01:15:54,776][106225] Updated weights for policy 1, policy_version 838483 (0.0008) [2023-12-28 01:15:54,807][106226] Updated weights for policy 0, policy_version 836591 (0.0009) [2023-12-28 01:15:54,834][106225] Updated weights for policy 1, policy_version 838493 (0.0008) [2023-12-28 01:15:54,863][106226] Updated weights for policy 0, policy_version 836601 (0.0007) [2023-12-28 01:15:54,913][106226] Updated weights for policy 0, policy_version 836611 (0.0009) [2023-12-28 01:15:55,516][106225] Updated weights for policy 1, policy_version 838503 (0.0007) [2023-12-28 01:15:55,567][106225] Updated weights for policy 1, policy_version 838513 (0.0007) [2023-12-28 01:15:55,612][106226] Updated weights for policy 0, policy_version 836621 (0.0008) [2023-12-28 01:15:55,614][106225] Updated weights for policy 1, policy_version 838523 (0.0010) [2023-12-28 01:15:55,664][106226] Updated weights for policy 0, policy_version 836631 (0.0007) [2023-12-28 01:15:55,712][106226] Updated weights for policy 0, policy_version 836641 (0.0008) [2023-12-28 01:15:56,175][105115] Fps is (10 sec: 19661.3, 60 sec: 20070.6, 300 sec: 19938.5). Total num frames: 428941312. Throughput: 0: 10022.1, 1: 10059.7. Samples: 428910836. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:15:56,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.775')] [2023-12-28 01:15:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000838528_214704128.pth... [2023-12-28 01:15:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000836648_214237184.pth... [2023-12-28 01:15:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000835496_213942272.pth [2023-12-28 01:15:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000837376_214409216.pth [2023-12-28 01:15:56,314][106225] Updated weights for policy 1, policy_version 838533 (0.0010) [2023-12-28 01:15:56,376][106225] Updated weights for policy 1, policy_version 838543 (0.0009) [2023-12-28 01:15:56,422][106226] Updated weights for policy 0, policy_version 836651 (0.0008) [2023-12-28 01:15:56,435][106225] Updated weights for policy 1, policy_version 838553 (0.0007) [2023-12-28 01:15:56,484][106226] Updated weights for policy 0, policy_version 836661 (0.0007) [2023-12-28 01:15:56,540][106226] Updated weights for policy 0, policy_version 836671 (0.0008) [2023-12-28 01:15:57,060][106225] Updated weights for policy 1, policy_version 838563 (0.0010) [2023-12-28 01:15:57,134][106225] Updated weights for policy 1, policy_version 838573 (0.0010) [2023-12-28 01:15:57,188][106225] Updated weights for policy 1, policy_version 838583 (0.0010) [2023-12-28 01:15:57,280][106226] Updated weights for policy 0, policy_version 836681 (0.0008) [2023-12-28 01:15:57,337][106226] Updated weights for policy 0, policy_version 836691 (0.0008) [2023-12-28 01:15:57,400][106226] Updated weights for policy 0, policy_version 836701 (0.0008) [2023-12-28 01:15:57,465][106226] Updated weights for policy 0, policy_version 836711 (0.0006) [2023-12-28 01:15:57,780][106225] Updated weights for policy 1, policy_version 838593 (0.0005) [2023-12-28 01:15:57,839][106225] Updated weights for policy 1, policy_version 838603 (0.0007) [2023-12-28 01:15:57,895][106225] Updated weights for policy 1, policy_version 838613 (0.0010) [2023-12-28 01:15:57,956][106225] Updated weights for policy 1, policy_version 838623 (0.0008) [2023-12-28 01:15:58,089][106226] Updated weights for policy 0, policy_version 836721 (0.0008) [2023-12-28 01:15:58,153][106226] Updated weights for policy 0, policy_version 836731 (0.0010) [2023-12-28 01:15:58,220][106226] Updated weights for policy 0, policy_version 836741 (0.0010) [2023-12-28 01:15:58,693][106225] Updated weights for policy 1, policy_version 838633 (0.0008) [2023-12-28 01:15:58,764][106225] Updated weights for policy 1, policy_version 838643 (0.0008) [2023-12-28 01:15:58,834][106225] Updated weights for policy 1, policy_version 838653 (0.0008) [2023-12-28 01:15:59,083][106226] Updated weights for policy 0, policy_version 836751 (0.0008) [2023-12-28 01:15:59,145][106226] Updated weights for policy 0, policy_version 836761 (0.0008) [2023-12-28 01:15:59,211][106226] Updated weights for policy 0, policy_version 836771 (0.0008) [2023-12-28 01:15:59,640][106225] Updated weights for policy 1, policy_version 838663 (0.0007) [2023-12-28 01:15:59,699][106225] Updated weights for policy 1, policy_version 838673 (0.0008) [2023-12-28 01:15:59,758][106225] Updated weights for policy 1, policy_version 838683 (0.0008) [2023-12-28 01:15:59,983][106226] Updated weights for policy 0, policy_version 836781 (0.0008) [2023-12-28 01:16:00,048][106226] Updated weights for policy 0, policy_version 836791 (0.0009) [2023-12-28 01:16:00,111][106226] Updated weights for policy 0, policy_version 836801 (0.0010) [2023-12-28 01:16:00,508][106225] Updated weights for policy 1, policy_version 838693 (0.0008) [2023-12-28 01:16:00,556][106225] Updated weights for policy 1, policy_version 838703 (0.0007) [2023-12-28 01:16:00,609][106225] Updated weights for policy 1, policy_version 838713 (0.0007) [2023-12-28 01:16:00,855][106226] Updated weights for policy 0, policy_version 836811 (0.0009) [2023-12-28 01:16:00,913][106226] Updated weights for policy 0, policy_version 836821 (0.0008) [2023-12-28 01:16:00,971][106226] Updated weights for policy 0, policy_version 836831 (0.0009) [2023-12-28 01:16:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 429039616. Throughput: 0: 9937.4, 1: 10119.8. Samples: 429028520. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:01,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.899')] [2023-12-28 01:16:01,247][106225] Updated weights for policy 1, policy_version 838723 (0.0006) [2023-12-28 01:16:01,311][106225] Updated weights for policy 1, policy_version 838733 (0.0008) [2023-12-28 01:16:01,377][106225] Updated weights for policy 1, policy_version 838743 (0.0008) [2023-12-28 01:16:01,728][106226] Updated weights for policy 0, policy_version 836841 (0.0008) [2023-12-28 01:16:01,796][106226] Updated weights for policy 0, policy_version 836851 (0.0007) [2023-12-28 01:16:01,855][106226] Updated weights for policy 0, policy_version 836861 (0.0007) [2023-12-28 01:16:01,912][106226] Updated weights for policy 0, policy_version 836871 (0.0005) [2023-12-28 01:16:02,183][106225] Updated weights for policy 1, policy_version 838753 (0.0010) [2023-12-28 01:16:02,243][106225] Updated weights for policy 1, policy_version 838763 (0.0008) [2023-12-28 01:16:02,306][106225] Updated weights for policy 1, policy_version 838773 (0.0008) [2023-12-28 01:16:02,369][106225] Updated weights for policy 1, policy_version 838783 (0.0009) [2023-12-28 01:16:02,543][106226] Updated weights for policy 0, policy_version 836881 (0.0008) [2023-12-28 01:16:02,606][106226] Updated weights for policy 0, policy_version 836891 (0.0008) [2023-12-28 01:16:02,662][106226] Updated weights for policy 0, policy_version 836901 (0.0009) [2023-12-28 01:16:03,160][106225] Updated weights for policy 1, policy_version 838793 (0.0007) [2023-12-28 01:16:03,215][106225] Updated weights for policy 1, policy_version 838803 (0.0005) [2023-12-28 01:16:03,278][106225] Updated weights for policy 1, policy_version 838813 (0.0007) [2023-12-28 01:16:03,417][106226] Updated weights for policy 0, policy_version 836911 (0.0008) [2023-12-28 01:16:03,473][106226] Updated weights for policy 0, policy_version 836921 (0.0008) [2023-12-28 01:16:03,527][106226] Updated weights for policy 0, policy_version 836931 (0.0008) [2023-12-28 01:16:04,044][106225] Updated weights for policy 1, policy_version 838823 (0.0008) [2023-12-28 01:16:04,106][106225] Updated weights for policy 1, policy_version 838833 (0.0008) [2023-12-28 01:16:04,170][106225] Updated weights for policy 1, policy_version 838843 (0.0007) [2023-12-28 01:16:04,221][106226] Updated weights for policy 0, policy_version 836941 (0.0009) [2023-12-28 01:16:04,283][106226] Updated weights for policy 0, policy_version 836951 (0.0007) [2023-12-28 01:16:04,344][106226] Updated weights for policy 0, policy_version 836961 (0.0011) [2023-12-28 01:16:04,899][106225] Updated weights for policy 1, policy_version 838853 (0.0008) [2023-12-28 01:16:04,958][106225] Updated weights for policy 1, policy_version 838863 (0.0008) [2023-12-28 01:16:05,012][106226] Updated weights for policy 0, policy_version 836971 (0.0011) [2023-12-28 01:16:05,022][106225] Updated weights for policy 1, policy_version 838873 (0.0006) [2023-12-28 01:16:05,072][106226] Updated weights for policy 0, policy_version 836981 (0.0011) [2023-12-28 01:16:05,134][106226] Updated weights for policy 0, policy_version 836991 (0.0011) [2023-12-28 01:16:05,736][106225] Updated weights for policy 1, policy_version 838883 (0.0007) [2023-12-28 01:16:05,752][106226] Updated weights for policy 0, policy_version 837001 (0.0010) [2023-12-28 01:16:05,795][106225] Updated weights for policy 1, policy_version 838893 (0.0006) [2023-12-28 01:16:05,808][106226] Updated weights for policy 0, policy_version 837011 (0.0010) [2023-12-28 01:16:05,852][106225] Updated weights for policy 1, policy_version 838903 (0.0006) [2023-12-28 01:16:05,857][106226] Updated weights for policy 0, policy_version 837021 (0.0010) [2023-12-28 01:16:05,904][106226] Updated weights for policy 0, policy_version 837031 (0.0010) [2023-12-28 01:16:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 429137920. Throughput: 0: 9952.1, 1: 9973.3. Samples: 429144044. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:06,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.929')] [2023-12-28 01:16:06,586][106225] Updated weights for policy 1, policy_version 838913 (0.0005) [2023-12-28 01:16:06,599][106226] Updated weights for policy 0, policy_version 837041 (0.0006) [2023-12-28 01:16:06,650][106225] Updated weights for policy 1, policy_version 838923 (0.0007) [2023-12-28 01:16:06,663][106226] Updated weights for policy 0, policy_version 837051 (0.0007) [2023-12-28 01:16:06,712][106225] Updated weights for policy 1, policy_version 838933 (0.0007) [2023-12-28 01:16:06,726][106226] Updated weights for policy 0, policy_version 837061 (0.0008) [2023-12-28 01:16:06,777][106225] Updated weights for policy 1, policy_version 838943 (0.0008) [2023-12-28 01:16:07,371][106226] Updated weights for policy 0, policy_version 837071 (0.0008) [2023-12-28 01:16:07,373][106225] Updated weights for policy 1, policy_version 838953 (0.0006) [2023-12-28 01:16:07,430][106226] Updated weights for policy 0, policy_version 837081 (0.0011) [2023-12-28 01:16:07,434][106225] Updated weights for policy 1, policy_version 838963 (0.0009) [2023-12-28 01:16:07,485][106226] Updated weights for policy 0, policy_version 837091 (0.0011) [2023-12-28 01:16:07,495][106225] Updated weights for policy 1, policy_version 838973 (0.0005) [2023-12-28 01:16:08,113][106225] Updated weights for policy 1, policy_version 838983 (0.0005) [2023-12-28 01:16:08,113][106226] Updated weights for policy 0, policy_version 837101 (0.0011) [2023-12-28 01:16:08,168][106226] Updated weights for policy 0, policy_version 837111 (0.0011) [2023-12-28 01:16:08,171][106225] Updated weights for policy 1, policy_version 838993 (0.0005) [2023-12-28 01:16:08,230][106226] Updated weights for policy 0, policy_version 837121 (0.0011) [2023-12-28 01:16:08,232][106225] Updated weights for policy 1, policy_version 839003 (0.0006) [2023-12-28 01:16:08,843][106225] Updated weights for policy 1, policy_version 839013 (0.0007) [2023-12-28 01:16:08,848][106226] Updated weights for policy 0, policy_version 837131 (0.0010) [2023-12-28 01:16:08,899][106225] Updated weights for policy 1, policy_version 839023 (0.0008) [2023-12-28 01:16:08,910][106226] Updated weights for policy 0, policy_version 837141 (0.0010) [2023-12-28 01:16:08,954][106225] Updated weights for policy 1, policy_version 839033 (0.0009) [2023-12-28 01:16:08,972][106226] Updated weights for policy 0, policy_version 837151 (0.0011) [2023-12-28 01:16:09,732][106225] Updated weights for policy 1, policy_version 839043 (0.0010) [2023-12-28 01:16:09,764][106226] Updated weights for policy 0, policy_version 837161 (0.0011) [2023-12-28 01:16:09,793][106225] Updated weights for policy 1, policy_version 839053 (0.0009) [2023-12-28 01:16:09,827][106226] Updated weights for policy 0, policy_version 837171 (0.0010) [2023-12-28 01:16:09,869][106225] Updated weights for policy 1, policy_version 839063 (0.0011) [2023-12-28 01:16:09,891][106226] Updated weights for policy 0, policy_version 837181 (0.0011) [2023-12-28 01:16:09,958][106226] Updated weights for policy 0, policy_version 837191 (0.0009) [2023-12-28 01:16:10,573][106225] Updated weights for policy 1, policy_version 839073 (0.0010) [2023-12-28 01:16:10,624][106225] Updated weights for policy 1, policy_version 839083 (0.0010) [2023-12-28 01:16:10,650][106226] Updated weights for policy 0, policy_version 837201 (0.0006) [2023-12-28 01:16:10,671][106225] Updated weights for policy 1, policy_version 839093 (0.0010) [2023-12-28 01:16:10,700][106226] Updated weights for policy 0, policy_version 837211 (0.0007) [2023-12-28 01:16:10,722][106225] Updated weights for policy 1, policy_version 839103 (0.0009) [2023-12-28 01:16:10,767][106226] Updated weights for policy 0, policy_version 837221 (0.0007) [2023-12-28 01:16:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 429236224. Throughput: 0: 9973.2, 1: 10032.8. Samples: 429207352. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:11,176][105115] Avg episode reward: [(0, '-4.352'), (1, '-5.158')] [2023-12-28 01:16:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000839104_214851584.pth... [2023-12-28 01:16:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000837224_214384640.pth... [2023-12-28 01:16:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000837952_214556672.pth [2023-12-28 01:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000836040_214081536.pth [2023-12-28 01:16:11,464][106225] Updated weights for policy 1, policy_version 839113 (0.0009) [2023-12-28 01:16:11,523][106225] Updated weights for policy 1, policy_version 839123 (0.0007) [2023-12-28 01:16:11,534][106226] Updated weights for policy 0, policy_version 837231 (0.0007) [2023-12-28 01:16:11,589][106225] Updated weights for policy 1, policy_version 839133 (0.0009) [2023-12-28 01:16:11,605][106226] Updated weights for policy 0, policy_version 837241 (0.0007) [2023-12-28 01:16:11,678][106226] Updated weights for policy 0, policy_version 837251 (0.0007) [2023-12-28 01:16:12,344][106225] Updated weights for policy 1, policy_version 839143 (0.0009) [2023-12-28 01:16:12,407][106225] Updated weights for policy 1, policy_version 839153 (0.0008) [2023-12-28 01:16:12,451][106226] Updated weights for policy 0, policy_version 837261 (0.0008) [2023-12-28 01:16:12,458][106225] Updated weights for policy 1, policy_version 839163 (0.0010) [2023-12-28 01:16:12,512][106226] Updated weights for policy 0, policy_version 837271 (0.0005) [2023-12-28 01:16:12,571][106226] Updated weights for policy 0, policy_version 837281 (0.0008) [2023-12-28 01:16:13,204][106225] Updated weights for policy 1, policy_version 839173 (0.0009) [2023-12-28 01:16:13,214][106226] Updated weights for policy 0, policy_version 837291 (0.0007) [2023-12-28 01:16:13,258][106225] Updated weights for policy 1, policy_version 839183 (0.0007) [2023-12-28 01:16:13,276][106226] Updated weights for policy 0, policy_version 837301 (0.0005) [2023-12-28 01:16:13,307][106225] Updated weights for policy 1, policy_version 839193 (0.0008) [2023-12-28 01:16:13,331][106226] Updated weights for policy 0, policy_version 837311 (0.0005) [2023-12-28 01:16:13,876][106225] Updated weights for policy 1, policy_version 839203 (0.0005) [2023-12-28 01:16:13,949][106225] Updated weights for policy 1, policy_version 839213 (0.0005) [2023-12-28 01:16:13,977][106226] Updated weights for policy 0, policy_version 837321 (0.0006) [2023-12-28 01:16:14,009][106225] Updated weights for policy 1, policy_version 839223 (0.0006) [2023-12-28 01:16:14,043][106226] Updated weights for policy 0, policy_version 837331 (0.0009) [2023-12-28 01:16:14,108][106226] Updated weights for policy 0, policy_version 837341 (0.0010) [2023-12-28 01:16:14,164][106226] Updated weights for policy 0, policy_version 837351 (0.0008) [2023-12-28 01:16:14,639][106225] Updated weights for policy 1, policy_version 839233 (0.0006) [2023-12-28 01:16:14,688][106225] Updated weights for policy 1, policy_version 839243 (0.0005) [2023-12-28 01:16:14,744][106225] Updated weights for policy 1, policy_version 839253 (0.0006) [2023-12-28 01:16:14,798][106226] Updated weights for policy 0, policy_version 837361 (0.0007) [2023-12-28 01:16:14,811][106225] Updated weights for policy 1, policy_version 839264 (0.0008) [2023-12-28 01:16:14,854][106226] Updated weights for policy 0, policy_version 837371 (0.0009) [2023-12-28 01:16:14,916][106226] Updated weights for policy 0, policy_version 837381 (0.0008) [2023-12-28 01:16:15,525][106225] Updated weights for policy 1, policy_version 839274 (0.0011) [2023-12-28 01:16:15,582][106225] Updated weights for policy 1, policy_version 839284 (0.0010) [2023-12-28 01:16:15,611][106226] Updated weights for policy 0, policy_version 837391 (0.0006) [2023-12-28 01:16:15,652][106225] Updated weights for policy 1, policy_version 839294 (0.0008) [2023-12-28 01:16:15,678][106226] Updated weights for policy 0, policy_version 837401 (0.0007) [2023-12-28 01:16:15,746][106226] Updated weights for policy 0, policy_version 837411 (0.0008) [2023-12-28 01:16:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 429334528. Throughput: 0: 9906.3, 1: 9949.0. Samples: 429325520. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:16,176][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.902')] [2023-12-28 01:16:16,272][106225] Updated weights for policy 1, policy_version 839304 (0.0009) [2023-12-28 01:16:16,339][106225] Updated weights for policy 1, policy_version 839314 (0.0009) [2023-12-28 01:16:16,396][106225] Updated weights for policy 1, policy_version 839324 (0.0008) [2023-12-28 01:16:16,477][106226] Updated weights for policy 0, policy_version 837421 (0.0008) [2023-12-28 01:16:16,537][106226] Updated weights for policy 0, policy_version 837431 (0.0008) [2023-12-28 01:16:16,591][106226] Updated weights for policy 0, policy_version 837441 (0.0008) [2023-12-28 01:16:17,027][106225] Updated weights for policy 1, policy_version 839334 (0.0007) [2023-12-28 01:16:17,085][106225] Updated weights for policy 1, policy_version 839344 (0.0009) [2023-12-28 01:16:17,135][106225] Updated weights for policy 1, policy_version 839354 (0.0009) [2023-12-28 01:16:17,233][106226] Updated weights for policy 0, policy_version 837451 (0.0008) [2023-12-28 01:16:17,295][106226] Updated weights for policy 0, policy_version 837461 (0.0007) [2023-12-28 01:16:17,357][106226] Updated weights for policy 0, policy_version 837471 (0.0008) [2023-12-28 01:16:17,888][106225] Updated weights for policy 1, policy_version 839364 (0.0009) [2023-12-28 01:16:17,947][106225] Updated weights for policy 1, policy_version 839374 (0.0010) [2023-12-28 01:16:18,001][106225] Updated weights for policy 1, policy_version 839384 (0.0010) [2023-12-28 01:16:18,055][106226] Updated weights for policy 0, policy_version 837481 (0.0009) [2023-12-28 01:16:18,118][106226] Updated weights for policy 0, policy_version 837491 (0.0008) [2023-12-28 01:16:18,178][106226] Updated weights for policy 0, policy_version 837501 (0.0008) [2023-12-28 01:16:18,235][106226] Updated weights for policy 0, policy_version 837511 (0.0008) [2023-12-28 01:16:18,705][106225] Updated weights for policy 1, policy_version 839394 (0.0007) [2023-12-28 01:16:18,774][106225] Updated weights for policy 1, policy_version 839404 (0.0007) [2023-12-28 01:16:18,836][106225] Updated weights for policy 1, policy_version 839414 (0.0006) [2023-12-28 01:16:18,897][106225] Updated weights for policy 1, policy_version 839424 (0.0006) [2023-12-28 01:16:19,051][106226] Updated weights for policy 0, policy_version 837521 (0.0008) [2023-12-28 01:16:19,105][106226] Updated weights for policy 0, policy_version 837531 (0.0008) [2023-12-28 01:16:19,155][106226] Updated weights for policy 0, policy_version 837541 (0.0008) [2023-12-28 01:16:19,529][106225] Updated weights for policy 1, policy_version 839434 (0.0009) [2023-12-28 01:16:19,574][106225] Updated weights for policy 1, policy_version 839444 (0.0008) [2023-12-28 01:16:19,623][106225] Updated weights for policy 1, policy_version 839454 (0.0008) [2023-12-28 01:16:19,987][106226] Updated weights for policy 0, policy_version 837551 (0.0010) [2023-12-28 01:16:20,050][106226] Updated weights for policy 0, policy_version 837561 (0.0011) [2023-12-28 01:16:20,102][106226] Updated weights for policy 0, policy_version 837571 (0.0011) [2023-12-28 01:16:20,432][106225] Updated weights for policy 1, policy_version 839464 (0.0008) [2023-12-28 01:16:20,485][106225] Updated weights for policy 1, policy_version 839474 (0.0008) [2023-12-28 01:16:20,536][106225] Updated weights for policy 1, policy_version 839484 (0.0009) [2023-12-28 01:16:20,829][106226] Updated weights for policy 0, policy_version 837581 (0.0011) [2023-12-28 01:16:20,896][106226] Updated weights for policy 0, policy_version 837591 (0.0009) [2023-12-28 01:16:20,965][106226] Updated weights for policy 0, policy_version 837601 (0.0008) [2023-12-28 01:16:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 429432832. Throughput: 0: 9881.2, 1: 9924.3. Samples: 429441536. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:21,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-5.191')] [2023-12-28 01:16:21,353][106225] Updated weights for policy 1, policy_version 839494 (0.0008) [2023-12-28 01:16:21,425][106225] Updated weights for policy 1, policy_version 839504 (0.0009) [2023-12-28 01:16:21,488][106225] Updated weights for policy 1, policy_version 839514 (0.0009) [2023-12-28 01:16:21,699][106226] Updated weights for policy 0, policy_version 837611 (0.0008) [2023-12-28 01:16:21,775][106226] Updated weights for policy 0, policy_version 837621 (0.0009) [2023-12-28 01:16:21,829][106226] Updated weights for policy 0, policy_version 837631 (0.0008) [2023-12-28 01:16:22,225][106225] Updated weights for policy 1, policy_version 839524 (0.0007) [2023-12-28 01:16:22,295][106225] Updated weights for policy 1, policy_version 839534 (0.0006) [2023-12-28 01:16:22,366][106225] Updated weights for policy 1, policy_version 839544 (0.0007) [2023-12-28 01:16:22,586][106226] Updated weights for policy 0, policy_version 837641 (0.0009) [2023-12-28 01:16:22,659][106226] Updated weights for policy 0, policy_version 837651 (0.0010) [2023-12-28 01:16:22,721][106226] Updated weights for policy 0, policy_version 837661 (0.0009) [2023-12-28 01:16:22,788][106226] Updated weights for policy 0, policy_version 837671 (0.0010) [2023-12-28 01:16:22,977][106225] Updated weights for policy 1, policy_version 839554 (0.0008) [2023-12-28 01:16:23,043][106225] Updated weights for policy 1, policy_version 839564 (0.0009) [2023-12-28 01:16:23,095][106225] Updated weights for policy 1, policy_version 839574 (0.0008) [2023-12-28 01:16:23,155][106225] Updated weights for policy 1, policy_version 839584 (0.0008) [2023-12-28 01:16:23,488][106226] Updated weights for policy 0, policy_version 837681 (0.0006) [2023-12-28 01:16:23,542][106226] Updated weights for policy 0, policy_version 837691 (0.0005) [2023-12-28 01:16:23,599][106226] Updated weights for policy 0, policy_version 837701 (0.0005) [2023-12-28 01:16:23,920][106225] Updated weights for policy 1, policy_version 839594 (0.0010) [2023-12-28 01:16:23,971][106225] Updated weights for policy 1, policy_version 839604 (0.0009) [2023-12-28 01:16:24,023][106225] Updated weights for policy 1, policy_version 839614 (0.0009) [2023-12-28 01:16:24,241][106226] Updated weights for policy 0, policy_version 837711 (0.0010) [2023-12-28 01:16:24,311][106226] Updated weights for policy 0, policy_version 837721 (0.0009) [2023-12-28 01:16:24,361][106226] Updated weights for policy 0, policy_version 837731 (0.0010) [2023-12-28 01:16:24,741][106225] Updated weights for policy 1, policy_version 839624 (0.0008) [2023-12-28 01:16:24,795][106225] Updated weights for policy 1, policy_version 839634 (0.0008) [2023-12-28 01:16:24,844][106225] Updated weights for policy 1, policy_version 839644 (0.0009) [2023-12-28 01:16:24,941][106226] Updated weights for policy 0, policy_version 837741 (0.0008) [2023-12-28 01:16:25,000][106226] Updated weights for policy 0, policy_version 837751 (0.0010) [2023-12-28 01:16:25,061][106226] Updated weights for policy 0, policy_version 837761 (0.0011) [2023-12-28 01:16:25,488][106225] Updated weights for policy 1, policy_version 839654 (0.0009) [2023-12-28 01:16:25,550][106225] Updated weights for policy 1, policy_version 839664 (0.0010) [2023-12-28 01:16:25,616][106225] Updated weights for policy 1, policy_version 839674 (0.0010) [2023-12-28 01:16:25,625][106226] Updated weights for policy 0, policy_version 837771 (0.0009) [2023-12-28 01:16:25,685][106226] Updated weights for policy 0, policy_version 837781 (0.0005) [2023-12-28 01:16:25,743][106226] Updated weights for policy 0, policy_version 837791 (0.0006) [2023-12-28 01:16:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 429531136. Throughput: 0: 9889.3, 1: 9868.4. Samples: 429498776. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:26,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-5.134')] [2023-12-28 01:16:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000837800_214532096.pth... [2023-12-28 01:16:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000839680_214999040.pth... [2023-12-28 01:16:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000838528_214704128.pth [2023-12-28 01:16:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000836648_214237184.pth [2023-12-28 01:16:26,260][106225] Updated weights for policy 1, policy_version 839684 (0.0010) [2023-12-28 01:16:26,306][106225] Updated weights for policy 1, policy_version 839694 (0.0007) [2023-12-28 01:16:26,306][106226] Updated weights for policy 0, policy_version 837801 (0.0006) [2023-12-28 01:16:26,353][106225] Updated weights for policy 1, policy_version 839704 (0.0005) [2023-12-28 01:16:26,367][106226] Updated weights for policy 0, policy_version 837811 (0.0011) [2023-12-28 01:16:26,431][106226] Updated weights for policy 0, policy_version 837821 (0.0011) [2023-12-28 01:16:26,483][106226] Updated weights for policy 0, policy_version 837831 (0.0010) [2023-12-28 01:16:26,946][106225] Updated weights for policy 1, policy_version 839714 (0.0005) [2023-12-28 01:16:27,003][106225] Updated weights for policy 1, policy_version 839724 (0.0010) [2023-12-28 01:16:27,050][106225] Updated weights for policy 1, policy_version 839734 (0.0010) [2023-12-28 01:16:27,103][106225] Updated weights for policy 1, policy_version 839744 (0.0010) [2023-12-28 01:16:27,162][106226] Updated weights for policy 0, policy_version 837841 (0.0010) [2023-12-28 01:16:27,221][106226] Updated weights for policy 0, policy_version 837851 (0.0010) [2023-12-28 01:16:27,279][106226] Updated weights for policy 0, policy_version 837861 (0.0010) [2023-12-28 01:16:27,824][106225] Updated weights for policy 1, policy_version 839754 (0.0010) [2023-12-28 01:16:27,868][106226] Updated weights for policy 0, policy_version 837871 (0.0007) [2023-12-28 01:16:27,880][106225] Updated weights for policy 1, policy_version 839764 (0.0010) [2023-12-28 01:16:27,929][106226] Updated weights for policy 0, policy_version 837881 (0.0005) [2023-12-28 01:16:27,943][106225] Updated weights for policy 1, policy_version 839774 (0.0010) [2023-12-28 01:16:27,978][106226] Updated weights for policy 0, policy_version 837891 (0.0006) [2023-12-28 01:16:28,604][106226] Updated weights for policy 0, policy_version 837901 (0.0009) [2023-12-28 01:16:28,656][106226] Updated weights for policy 0, policy_version 837911 (0.0008) [2023-12-28 01:16:28,673][106225] Updated weights for policy 1, policy_version 839784 (0.0011) [2023-12-28 01:16:28,706][106226] Updated weights for policy 0, policy_version 837921 (0.0008) [2023-12-28 01:16:28,735][106225] Updated weights for policy 1, policy_version 839794 (0.0010) [2023-12-28 01:16:28,799][106225] Updated weights for policy 1, policy_version 839804 (0.0011) [2023-12-28 01:16:29,374][106226] Updated weights for policy 0, policy_version 837931 (0.0007) [2023-12-28 01:16:29,440][106226] Updated weights for policy 0, policy_version 837941 (0.0008) [2023-12-28 01:16:29,454][106225] Updated weights for policy 1, policy_version 839814 (0.0009) [2023-12-28 01:16:29,488][106226] Updated weights for policy 0, policy_version 837951 (0.0008) [2023-12-28 01:16:29,507][106225] Updated weights for policy 1, policy_version 839824 (0.0007) [2023-12-28 01:16:29,558][106225] Updated weights for policy 1, policy_version 839834 (0.0007) [2023-12-28 01:16:30,197][106226] Updated weights for policy 0, policy_version 837961 (0.0008) [2023-12-28 01:16:30,253][106226] Updated weights for policy 0, policy_version 837971 (0.0009) [2023-12-28 01:16:30,297][106225] Updated weights for policy 1, policy_version 839844 (0.0007) [2023-12-28 01:16:30,307][106226] Updated weights for policy 0, policy_version 837981 (0.0006) [2023-12-28 01:16:30,351][106225] Updated weights for policy 1, policy_version 839854 (0.0006) [2023-12-28 01:16:30,362][106226] Updated weights for policy 0, policy_version 837991 (0.0008) [2023-12-28 01:16:30,410][106225] Updated weights for policy 1, policy_version 839864 (0.0007) [2023-12-28 01:16:30,962][106226] Updated weights for policy 0, policy_version 838001 (0.0005) [2023-12-28 01:16:30,984][106225] Updated weights for policy 1, policy_version 839874 (0.0006) [2023-12-28 01:16:31,032][106226] Updated weights for policy 0, policy_version 838011 (0.0006) [2023-12-28 01:16:31,059][106225] Updated weights for policy 1, policy_version 839884 (0.0006) [2023-12-28 01:16:31,099][106226] Updated weights for policy 0, policy_version 838021 (0.0008) [2023-12-28 01:16:31,117][106225] Updated weights for policy 1, policy_version 839894 (0.0008) [2023-12-28 01:16:31,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 429637632. Throughput: 0: 10018.7, 1: 9954.8. Samples: 429626336. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:31,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-5.229')] [2023-12-28 01:16:31,184][106225] Updated weights for policy 1, policy_version 839904 (0.0008) [2023-12-28 01:16:31,788][106226] Updated weights for policy 0, policy_version 838031 (0.0008) [2023-12-28 01:16:31,847][106226] Updated weights for policy 0, policy_version 838041 (0.0008) [2023-12-28 01:16:31,906][106226] Updated weights for policy 0, policy_version 838051 (0.0009) [2023-12-28 01:16:31,944][106225] Updated weights for policy 1, policy_version 839914 (0.0006) [2023-12-28 01:16:32,002][106225] Updated weights for policy 1, policy_version 839924 (0.0008) [2023-12-28 01:16:32,060][106225] Updated weights for policy 1, policy_version 839934 (0.0008) [2023-12-28 01:16:32,629][106226] Updated weights for policy 0, policy_version 838061 (0.0006) [2023-12-28 01:16:32,686][106226] Updated weights for policy 0, policy_version 838071 (0.0005) [2023-12-28 01:16:32,738][106226] Updated weights for policy 0, policy_version 838081 (0.0005) [2023-12-28 01:16:32,813][106225] Updated weights for policy 1, policy_version 839944 (0.0009) [2023-12-28 01:16:32,876][106225] Updated weights for policy 1, policy_version 839954 (0.0009) [2023-12-28 01:16:32,931][106225] Updated weights for policy 1, policy_version 839964 (0.0009) [2023-12-28 01:16:33,301][106226] Updated weights for policy 0, policy_version 838091 (0.0005) [2023-12-28 01:16:33,355][106226] Updated weights for policy 0, policy_version 838101 (0.0006) [2023-12-28 01:16:33,404][106226] Updated weights for policy 0, policy_version 838111 (0.0010) [2023-12-28 01:16:33,600][106225] Updated weights for policy 1, policy_version 839974 (0.0008) [2023-12-28 01:16:33,659][106225] Updated weights for policy 1, policy_version 839984 (0.0007) [2023-12-28 01:16:33,711][106225] Updated weights for policy 1, policy_version 839994 (0.0008) [2023-12-28 01:16:34,175][106226] Updated weights for policy 0, policy_version 838121 (0.0006) [2023-12-28 01:16:34,241][106226] Updated weights for policy 0, policy_version 838131 (0.0010) [2023-12-28 01:16:34,304][106226] Updated weights for policy 0, policy_version 838141 (0.0007) [2023-12-28 01:16:34,373][106226] Updated weights for policy 0, policy_version 838151 (0.0008) [2023-12-28 01:16:34,418][106225] Updated weights for policy 1, policy_version 840004 (0.0007) [2023-12-28 01:16:34,483][106225] Updated weights for policy 1, policy_version 840014 (0.0006) [2023-12-28 01:16:34,553][106225] Updated weights for policy 1, policy_version 840024 (0.0010) [2023-12-28 01:16:35,035][106226] Updated weights for policy 0, policy_version 838161 (0.0007) [2023-12-28 01:16:35,088][106226] Updated weights for policy 0, policy_version 838171 (0.0005) [2023-12-28 01:16:35,139][106226] Updated weights for policy 0, policy_version 838181 (0.0005) [2023-12-28 01:16:35,145][106225] Updated weights for policy 1, policy_version 840034 (0.0009) [2023-12-28 01:16:35,195][106225] Updated weights for policy 1, policy_version 840044 (0.0005) [2023-12-28 01:16:35,247][106225] Updated weights for policy 1, policy_version 840054 (0.0005) [2023-12-28 01:16:35,295][106225] Updated weights for policy 1, policy_version 840064 (0.0005) [2023-12-28 01:16:35,783][106226] Updated weights for policy 0, policy_version 838191 (0.0007) [2023-12-28 01:16:35,846][106226] Updated weights for policy 0, policy_version 838201 (0.0010) [2023-12-28 01:16:35,908][106226] Updated weights for policy 0, policy_version 838211 (0.0010) [2023-12-28 01:16:35,945][106225] Updated weights for policy 1, policy_version 840074 (0.0005) [2023-12-28 01:16:36,007][106225] Updated weights for policy 1, policy_version 840084 (0.0006) [2023-12-28 01:16:36,056][106225] Updated weights for policy 1, policy_version 840094 (0.0005) [2023-12-28 01:16:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 429744128. Throughput: 0: 10026.5, 1: 9918.2. Samples: 429750144. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:36,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-5.058')] [2023-12-28 01:16:36,510][106226] Updated weights for policy 0, policy_version 838221 (0.0010) [2023-12-28 01:16:36,567][106226] Updated weights for policy 0, policy_version 838231 (0.0011) [2023-12-28 01:16:36,618][106226] Updated weights for policy 0, policy_version 838241 (0.0011) [2023-12-28 01:16:36,690][106225] Updated weights for policy 1, policy_version 840104 (0.0009) [2023-12-28 01:16:36,755][106225] Updated weights for policy 1, policy_version 840114 (0.0010) [2023-12-28 01:16:36,818][106225] Updated weights for policy 1, policy_version 840124 (0.0010) [2023-12-28 01:16:37,304][106226] Updated weights for policy 0, policy_version 838251 (0.0010) [2023-12-28 01:16:37,373][106226] Updated weights for policy 0, policy_version 838261 (0.0009) [2023-12-28 01:16:37,425][106225] Updated weights for policy 1, policy_version 840134 (0.0009) [2023-12-28 01:16:37,426][106226] Updated weights for policy 0, policy_version 838271 (0.0009) [2023-12-28 01:16:37,481][106225] Updated weights for policy 1, policy_version 840144 (0.0006) [2023-12-28 01:16:37,540][106225] Updated weights for policy 1, policy_version 840154 (0.0008) [2023-12-28 01:16:38,067][106226] Updated weights for policy 0, policy_version 838281 (0.0010) [2023-12-28 01:16:38,107][106225] Updated weights for policy 1, policy_version 840164 (0.0007) [2023-12-28 01:16:38,125][106226] Updated weights for policy 0, policy_version 838291 (0.0010) [2023-12-28 01:16:38,157][106225] Updated weights for policy 1, policy_version 840174 (0.0005) [2023-12-28 01:16:38,179][106226] Updated weights for policy 0, policy_version 838301 (0.0010) [2023-12-28 01:16:38,211][106225] Updated weights for policy 1, policy_version 840184 (0.0006) [2023-12-28 01:16:38,232][106226] Updated weights for policy 0, policy_version 838311 (0.0008) [2023-12-28 01:16:38,861][106225] Updated weights for policy 1, policy_version 840194 (0.0005) [2023-12-28 01:16:38,916][106225] Updated weights for policy 1, policy_version 840204 (0.0006) [2023-12-28 01:16:38,971][106225] Updated weights for policy 1, policy_version 840214 (0.0008) [2023-12-28 01:16:39,023][106226] Updated weights for policy 0, policy_version 838321 (0.0007) [2023-12-28 01:16:39,031][106225] Updated weights for policy 1, policy_version 840224 (0.0007) [2023-12-28 01:16:39,072][106226] Updated weights for policy 0, policy_version 838331 (0.0009) [2023-12-28 01:16:39,136][106226] Updated weights for policy 0, policy_version 838341 (0.0008) [2023-12-28 01:16:39,776][106225] Updated weights for policy 1, policy_version 840234 (0.0009) [2023-12-28 01:16:39,845][106225] Updated weights for policy 1, policy_version 840244 (0.0008) [2023-12-28 01:16:39,888][106226] Updated weights for policy 0, policy_version 838351 (0.0007) [2023-12-28 01:16:39,906][106225] Updated weights for policy 1, policy_version 840254 (0.0008) [2023-12-28 01:16:39,958][106226] Updated weights for policy 0, policy_version 838361 (0.0008) [2023-12-28 01:16:40,024][106226] Updated weights for policy 0, policy_version 838371 (0.0009) [2023-12-28 01:16:40,659][106225] Updated weights for policy 1, policy_version 840264 (0.0008) [2023-12-28 01:16:40,708][106225] Updated weights for policy 1, policy_version 840274 (0.0006) [2023-12-28 01:16:40,761][106225] Updated weights for policy 1, policy_version 840284 (0.0005) [2023-12-28 01:16:40,760][106226] Updated weights for policy 0, policy_version 838381 (0.0009) [2023-12-28 01:16:40,816][106226] Updated weights for policy 0, policy_version 838391 (0.0009) [2023-12-28 01:16:40,872][106226] Updated weights for policy 0, policy_version 838401 (0.0009) [2023-12-28 01:16:41,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 429842432. Throughput: 0: 10025.5, 1: 10031.3. Samples: 429813392. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:41,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.288')] [2023-12-28 01:16:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000840288_215154688.pth... [2023-12-28 01:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000838408_214687744.pth... [2023-12-28 01:16:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000839104_214851584.pth [2023-12-28 01:16:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000837224_214384640.pth [2023-12-28 01:16:41,499][106225] Updated weights for policy 1, policy_version 840294 (0.0009) [2023-12-28 01:16:41,564][106225] Updated weights for policy 1, policy_version 840304 (0.0010) [2023-12-28 01:16:41,600][106226] Updated weights for policy 0, policy_version 838411 (0.0007) [2023-12-28 01:16:41,632][106225] Updated weights for policy 1, policy_version 840314 (0.0010) [2023-12-28 01:16:41,668][106226] Updated weights for policy 0, policy_version 838421 (0.0007) [2023-12-28 01:16:41,737][106226] Updated weights for policy 0, policy_version 838431 (0.0008) [2023-12-28 01:16:42,369][106225] Updated weights for policy 1, policy_version 840324 (0.0010) [2023-12-28 01:16:42,427][106225] Updated weights for policy 1, policy_version 840334 (0.0008) [2023-12-28 01:16:42,453][106226] Updated weights for policy 0, policy_version 838441 (0.0006) [2023-12-28 01:16:42,493][106225] Updated weights for policy 1, policy_version 840344 (0.0008) [2023-12-28 01:16:42,515][106226] Updated weights for policy 0, policy_version 838451 (0.0008) [2023-12-28 01:16:42,571][106226] Updated weights for policy 0, policy_version 838461 (0.0008) [2023-12-28 01:16:42,639][106226] Updated weights for policy 0, policy_version 838471 (0.0008) [2023-12-28 01:16:43,163][106225] Updated weights for policy 1, policy_version 840354 (0.0008) [2023-12-28 01:16:43,223][106225] Updated weights for policy 1, policy_version 840364 (0.0009) [2023-12-28 01:16:43,312][106225] Updated weights for policy 1, policy_version 840374 (0.0009) [2023-12-28 01:16:43,371][106225] Updated weights for policy 1, policy_version 840384 (0.0008) [2023-12-28 01:16:43,392][106226] Updated weights for policy 0, policy_version 838481 (0.0008) [2023-12-28 01:16:43,451][106226] Updated weights for policy 0, policy_version 838491 (0.0008) [2023-12-28 01:16:43,499][106226] Updated weights for policy 0, policy_version 838501 (0.0008) [2023-12-28 01:16:43,972][106225] Updated weights for policy 1, policy_version 840394 (0.0008) [2023-12-28 01:16:44,036][106225] Updated weights for policy 1, policy_version 840404 (0.0008) [2023-12-28 01:16:44,098][106225] Updated weights for policy 1, policy_version 840414 (0.0008) [2023-12-28 01:16:44,271][106226] Updated weights for policy 0, policy_version 838511 (0.0009) [2023-12-28 01:16:44,334][106226] Updated weights for policy 0, policy_version 838521 (0.0008) [2023-12-28 01:16:44,398][106226] Updated weights for policy 0, policy_version 838531 (0.0009) [2023-12-28 01:16:44,736][106225] Updated weights for policy 1, policy_version 840424 (0.0006) [2023-12-28 01:16:44,804][106225] Updated weights for policy 1, policy_version 840434 (0.0008) [2023-12-28 01:16:44,869][106225] Updated weights for policy 1, policy_version 840444 (0.0005) [2023-12-28 01:16:45,084][106226] Updated weights for policy 0, policy_version 838541 (0.0009) [2023-12-28 01:16:45,148][106226] Updated weights for policy 0, policy_version 838551 (0.0008) [2023-12-28 01:16:45,212][106226] Updated weights for policy 0, policy_version 838561 (0.0008) [2023-12-28 01:16:45,546][106225] Updated weights for policy 1, policy_version 840454 (0.0008) [2023-12-28 01:16:45,608][106225] Updated weights for policy 1, policy_version 840464 (0.0010) [2023-12-28 01:16:45,672][106225] Updated weights for policy 1, policy_version 840474 (0.0008) [2023-12-28 01:16:45,928][106226] Updated weights for policy 0, policy_version 838571 (0.0007) [2023-12-28 01:16:45,991][106226] Updated weights for policy 0, policy_version 838581 (0.0009) [2023-12-28 01:16:46,047][106226] Updated weights for policy 0, policy_version 838591 (0.0008) [2023-12-28 01:16:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19938.5). Total num frames: 429940736. Throughput: 0: 9994.1, 1: 10011.6. Samples: 429928772. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:46,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.969')] [2023-12-28 01:16:46,269][106225] Updated weights for policy 1, policy_version 840484 (0.0008) [2023-12-28 01:16:46,334][106225] Updated weights for policy 1, policy_version 840494 (0.0005) [2023-12-28 01:16:46,388][106225] Updated weights for policy 1, policy_version 840504 (0.0008) [2023-12-28 01:16:46,838][106226] Updated weights for policy 0, policy_version 838601 (0.0008) [2023-12-28 01:16:46,910][106226] Updated weights for policy 0, policy_version 838611 (0.0006) [2023-12-28 01:16:46,923][106225] Updated weights for policy 1, policy_version 840514 (0.0009) [2023-12-28 01:16:46,976][106225] Updated weights for policy 1, policy_version 840524 (0.0006) [2023-12-28 01:16:46,978][106226] Updated weights for policy 0, policy_version 838621 (0.0006) [2023-12-28 01:16:47,036][106225] Updated weights for policy 1, policy_version 840534 (0.0008) [2023-12-28 01:16:47,042][106226] Updated weights for policy 0, policy_version 838631 (0.0005) [2023-12-28 01:16:47,085][106225] Updated weights for policy 1, policy_version 840544 (0.0005) [2023-12-28 01:16:47,661][106226] Updated weights for policy 0, policy_version 838641 (0.0005) [2023-12-28 01:16:47,714][106226] Updated weights for policy 0, policy_version 838651 (0.0008) [2023-12-28 01:16:47,768][106226] Updated weights for policy 0, policy_version 838661 (0.0010) [2023-12-28 01:16:47,785][106225] Updated weights for policy 1, policy_version 840554 (0.0010) [2023-12-28 01:16:47,837][106225] Updated weights for policy 1, policy_version 840564 (0.0010) [2023-12-28 01:16:47,887][106225] Updated weights for policy 1, policy_version 840574 (0.0010) [2023-12-28 01:16:48,411][106226] Updated weights for policy 0, policy_version 838671 (0.0009) [2023-12-28 01:16:48,477][106226] Updated weights for policy 0, policy_version 838681 (0.0008) [2023-12-28 01:16:48,523][106225] Updated weights for policy 1, policy_version 840584 (0.0006) [2023-12-28 01:16:48,543][106226] Updated weights for policy 0, policy_version 838691 (0.0008) [2023-12-28 01:16:48,582][106225] Updated weights for policy 1, policy_version 840594 (0.0007) [2023-12-28 01:16:48,654][106225] Updated weights for policy 1, policy_version 840604 (0.0011) [2023-12-28 01:16:49,213][106226] Updated weights for policy 0, policy_version 838701 (0.0009) [2023-12-28 01:16:49,271][106226] Updated weights for policy 0, policy_version 838711 (0.0008) [2023-12-28 01:16:49,319][106226] Updated weights for policy 0, policy_version 838721 (0.0008) [2023-12-28 01:16:49,346][106225] Updated weights for policy 1, policy_version 840614 (0.0011) [2023-12-28 01:16:49,419][106225] Updated weights for policy 1, policy_version 840624 (0.0009) [2023-12-28 01:16:49,480][106225] Updated weights for policy 1, policy_version 840634 (0.0009) [2023-12-28 01:16:50,071][106226] Updated weights for policy 0, policy_version 838731 (0.0008) [2023-12-28 01:16:50,128][106226] Updated weights for policy 0, policy_version 838741 (0.0007) [2023-12-28 01:16:50,187][106226] Updated weights for policy 0, policy_version 838751 (0.0008) [2023-12-28 01:16:50,228][106225] Updated weights for policy 1, policy_version 840644 (0.0009) [2023-12-28 01:16:50,282][106225] Updated weights for policy 1, policy_version 840654 (0.0010) [2023-12-28 01:16:50,333][106225] Updated weights for policy 1, policy_version 840664 (0.0010) [2023-12-28 01:16:50,903][106226] Updated weights for policy 0, policy_version 838761 (0.0006) [2023-12-28 01:16:50,969][106226] Updated weights for policy 0, policy_version 838771 (0.0006) [2023-12-28 01:16:50,994][106225] Updated weights for policy 1, policy_version 840674 (0.0010) [2023-12-28 01:16:51,040][106226] Updated weights for policy 0, policy_version 838781 (0.0008) [2023-12-28 01:16:51,062][106225] Updated weights for policy 1, policy_version 840684 (0.0010) [2023-12-28 01:16:51,108][106226] Updated weights for policy 0, policy_version 838791 (0.0009) [2023-12-28 01:16:51,119][106225] Updated weights for policy 1, policy_version 840694 (0.0009) [2023-12-28 01:16:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 430039040. Throughput: 0: 9985.7, 1: 10124.4. Samples: 430049000. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:51,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-5.302')] [2023-12-28 01:16:51,178][106225] Updated weights for policy 1, policy_version 840704 (0.0010) [2023-12-28 01:16:51,825][106226] Updated weights for policy 0, policy_version 838801 (0.0008) [2023-12-28 01:16:51,889][106226] Updated weights for policy 0, policy_version 838811 (0.0007) [2023-12-28 01:16:51,941][106225] Updated weights for policy 1, policy_version 840714 (0.0008) [2023-12-28 01:16:51,945][106226] Updated weights for policy 0, policy_version 838821 (0.0007) [2023-12-28 01:16:52,000][106225] Updated weights for policy 1, policy_version 840724 (0.0008) [2023-12-28 01:16:52,063][106225] Updated weights for policy 1, policy_version 840734 (0.0008) [2023-12-28 01:16:52,618][106226] Updated weights for policy 0, policy_version 838831 (0.0005) [2023-12-28 01:16:52,668][106226] Updated weights for policy 0, policy_version 838841 (0.0005) [2023-12-28 01:16:52,719][106226] Updated weights for policy 0, policy_version 838851 (0.0006) [2023-12-28 01:16:52,784][106225] Updated weights for policy 1, policy_version 840744 (0.0006) [2023-12-28 01:16:52,843][106225] Updated weights for policy 1, policy_version 840754 (0.0005) [2023-12-28 01:16:52,904][106225] Updated weights for policy 1, policy_version 840764 (0.0009) [2023-12-28 01:16:53,377][106226] Updated weights for policy 0, policy_version 838861 (0.0007) [2023-12-28 01:16:53,437][106226] Updated weights for policy 0, policy_version 838871 (0.0008) [2023-12-28 01:16:53,490][106226] Updated weights for policy 0, policy_version 838881 (0.0008) [2023-12-28 01:16:53,541][106225] Updated weights for policy 1, policy_version 840774 (0.0009) [2023-12-28 01:16:53,599][106225] Updated weights for policy 1, policy_version 840784 (0.0009) [2023-12-28 01:16:53,651][106225] Updated weights for policy 1, policy_version 840794 (0.0009) [2023-12-28 01:16:54,241][106226] Updated weights for policy 0, policy_version 838891 (0.0008) [2023-12-28 01:16:54,294][106226] Updated weights for policy 0, policy_version 838901 (0.0008) [2023-12-28 01:16:54,344][106225] Updated weights for policy 1, policy_version 840804 (0.0009) [2023-12-28 01:16:54,350][106226] Updated weights for policy 0, policy_version 838911 (0.0008) [2023-12-28 01:16:54,403][106225] Updated weights for policy 1, policy_version 840814 (0.0007) [2023-12-28 01:16:54,463][106225] Updated weights for policy 1, policy_version 840824 (0.0010) [2023-12-28 01:16:55,047][106226] Updated weights for policy 0, policy_version 838921 (0.0008) [2023-12-28 01:16:55,052][106225] Updated weights for policy 1, policy_version 840834 (0.0009) [2023-12-28 01:16:55,096][106226] Updated weights for policy 0, policy_version 838931 (0.0009) [2023-12-28 01:16:55,099][106225] Updated weights for policy 1, policy_version 840844 (0.0007) [2023-12-28 01:16:55,151][106226] Updated weights for policy 0, policy_version 838941 (0.0005) [2023-12-28 01:16:55,157][106225] Updated weights for policy 1, policy_version 840854 (0.0010) [2023-12-28 01:16:55,199][106226] Updated weights for policy 0, policy_version 838951 (0.0006) [2023-12-28 01:16:55,209][106225] Updated weights for policy 1, policy_version 840864 (0.0010) [2023-12-28 01:16:55,906][106225] Updated weights for policy 1, policy_version 840874 (0.0005) [2023-12-28 01:16:55,959][106225] Updated weights for policy 1, policy_version 840884 (0.0005) [2023-12-28 01:16:55,970][106226] Updated weights for policy 0, policy_version 838961 (0.0008) [2023-12-28 01:16:56,016][106225] Updated weights for policy 1, policy_version 840894 (0.0006) [2023-12-28 01:16:56,034][106226] Updated weights for policy 0, policy_version 838971 (0.0008) [2023-12-28 01:16:56,094][106226] Updated weights for policy 0, policy_version 838981 (0.0008) [2023-12-28 01:16:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19938.5). Total num frames: 430145536. Throughput: 0: 9938.9, 1: 10074.3. Samples: 430107948. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:16:56,176][105115] Avg episode reward: [(0, '-4.387'), (1, '-5.137')] [2023-12-28 01:16:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000840896_215310336.pth... [2023-12-28 01:16:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000838984_214835200.pth... [2023-12-28 01:16:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000839680_214999040.pth [2023-12-28 01:16:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000837800_214532096.pth [2023-12-28 01:16:56,629][106225] Updated weights for policy 1, policy_version 840904 (0.0006) [2023-12-28 01:16:56,680][106225] Updated weights for policy 1, policy_version 840914 (0.0008) [2023-12-28 01:16:56,725][106225] Updated weights for policy 1, policy_version 840924 (0.0008) [2023-12-28 01:16:56,839][106226] Updated weights for policy 0, policy_version 838991 (0.0010) [2023-12-28 01:16:56,893][106226] Updated weights for policy 0, policy_version 839001 (0.0008) [2023-12-28 01:16:56,953][106226] Updated weights for policy 0, policy_version 839011 (0.0008) [2023-12-28 01:16:57,437][106225] Updated weights for policy 1, policy_version 840934 (0.0008) [2023-12-28 01:16:57,491][106225] Updated weights for policy 1, policy_version 840944 (0.0008) [2023-12-28 01:16:57,548][106225] Updated weights for policy 1, policy_version 840954 (0.0007) [2023-12-28 01:16:57,675][106226] Updated weights for policy 0, policy_version 839021 (0.0008) [2023-12-28 01:16:57,736][106226] Updated weights for policy 0, policy_version 839031 (0.0008) [2023-12-28 01:16:57,794][106226] Updated weights for policy 0, policy_version 839041 (0.0008) [2023-12-28 01:16:58,272][106225] Updated weights for policy 1, policy_version 840964 (0.0009) [2023-12-28 01:16:58,356][106225] Updated weights for policy 1, policy_version 840974 (0.0010) [2023-12-28 01:16:58,426][106225] Updated weights for policy 1, policy_version 840984 (0.0007) [2023-12-28 01:16:58,543][106226] Updated weights for policy 0, policy_version 839051 (0.0009) [2023-12-28 01:16:58,610][106226] Updated weights for policy 0, policy_version 839061 (0.0010) [2023-12-28 01:16:58,679][106226] Updated weights for policy 0, policy_version 839071 (0.0007) [2023-12-28 01:16:59,221][106225] Updated weights for policy 1, policy_version 840994 (0.0008) [2023-12-28 01:16:59,289][106225] Updated weights for policy 1, policy_version 841004 (0.0008) [2023-12-28 01:16:59,356][106225] Updated weights for policy 1, policy_version 841014 (0.0009) [2023-12-28 01:16:59,416][106225] Updated weights for policy 1, policy_version 841024 (0.0009) [2023-12-28 01:16:59,496][106226] Updated weights for policy 0, policy_version 839081 (0.0009) [2023-12-28 01:16:59,561][106226] Updated weights for policy 0, policy_version 839091 (0.0007) [2023-12-28 01:16:59,624][106226] Updated weights for policy 0, policy_version 839101 (0.0011) [2023-12-28 01:16:59,692][106226] Updated weights for policy 0, policy_version 839111 (0.0011) [2023-12-28 01:17:00,143][106225] Updated weights for policy 1, policy_version 841034 (0.0006) [2023-12-28 01:17:00,205][106225] Updated weights for policy 1, policy_version 841044 (0.0006) [2023-12-28 01:17:00,268][106225] Updated weights for policy 1, policy_version 841054 (0.0006) [2023-12-28 01:17:00,362][106226] Updated weights for policy 0, policy_version 839121 (0.0011) [2023-12-28 01:17:00,421][106226] Updated weights for policy 0, policy_version 839131 (0.0010) [2023-12-28 01:17:00,478][106226] Updated weights for policy 0, policy_version 839141 (0.0010) [2023-12-28 01:17:00,857][106225] Updated weights for policy 1, policy_version 841064 (0.0006) [2023-12-28 01:17:00,907][106225] Updated weights for policy 1, policy_version 841074 (0.0007) [2023-12-28 01:17:00,966][106225] Updated weights for policy 1, policy_version 841084 (0.0008) [2023-12-28 01:17:01,125][106226] Updated weights for policy 0, policy_version 839151 (0.0010) [2023-12-28 01:17:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 430235648. Throughput: 0: 9884.2, 1: 10094.5. Samples: 430224560. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:01,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.302')] [2023-12-28 01:17:01,199][106226] Updated weights for policy 0, policy_version 839161 (0.0008) [2023-12-28 01:17:01,265][106226] Updated weights for policy 0, policy_version 839171 (0.0009) [2023-12-28 01:17:01,724][106225] Updated weights for policy 1, policy_version 841094 (0.0008) [2023-12-28 01:17:01,788][106225] Updated weights for policy 1, policy_version 841104 (0.0008) [2023-12-28 01:17:01,856][106225] Updated weights for policy 1, policy_version 841114 (0.0009) [2023-12-28 01:17:01,967][106226] Updated weights for policy 0, policy_version 839181 (0.0007) [2023-12-28 01:17:02,022][106226] Updated weights for policy 0, policy_version 839191 (0.0005) [2023-12-28 01:17:02,079][106226] Updated weights for policy 0, policy_version 839201 (0.0008) [2023-12-28 01:17:02,599][106225] Updated weights for policy 1, policy_version 841124 (0.0010) [2023-12-28 01:17:02,662][106225] Updated weights for policy 1, policy_version 841134 (0.0010) [2023-12-28 01:17:02,722][106225] Updated weights for policy 1, policy_version 841144 (0.0010) [2023-12-28 01:17:02,741][106226] Updated weights for policy 0, policy_version 839211 (0.0009) [2023-12-28 01:17:02,795][106226] Updated weights for policy 0, policy_version 839221 (0.0008) [2023-12-28 01:17:02,844][106226] Updated weights for policy 0, policy_version 839231 (0.0007) [2023-12-28 01:17:03,424][106225] Updated weights for policy 1, policy_version 841154 (0.0010) [2023-12-28 01:17:03,438][106226] Updated weights for policy 0, policy_version 839241 (0.0005) [2023-12-28 01:17:03,470][106225] Updated weights for policy 1, policy_version 841164 (0.0010) [2023-12-28 01:17:03,484][106226] Updated weights for policy 0, policy_version 839251 (0.0005) [2023-12-28 01:17:03,525][106225] Updated weights for policy 1, policy_version 841174 (0.0010) [2023-12-28 01:17:03,549][106226] Updated weights for policy 0, policy_version 839261 (0.0008) [2023-12-28 01:17:03,581][106225] Updated weights for policy 1, policy_version 841184 (0.0010) [2023-12-28 01:17:03,603][106226] Updated weights for policy 0, policy_version 839271 (0.0010) [2023-12-28 01:17:04,309][106225] Updated weights for policy 1, policy_version 841194 (0.0007) [2023-12-28 01:17:04,311][106226] Updated weights for policy 0, policy_version 839281 (0.0008) [2023-12-28 01:17:04,370][106226] Updated weights for policy 0, policy_version 839291 (0.0006) [2023-12-28 01:17:04,372][106225] Updated weights for policy 1, policy_version 841204 (0.0008) [2023-12-28 01:17:04,428][106225] Updated weights for policy 1, policy_version 841214 (0.0007) [2023-12-28 01:17:04,428][106226] Updated weights for policy 0, policy_version 839301 (0.0008) [2023-12-28 01:17:05,063][106225] Updated weights for policy 1, policy_version 841224 (0.0008) [2023-12-28 01:17:05,133][106225] Updated weights for policy 1, policy_version 841234 (0.0005) [2023-12-28 01:17:05,200][106225] Updated weights for policy 1, policy_version 841244 (0.0006) [2023-12-28 01:17:05,217][106226] Updated weights for policy 0, policy_version 839311 (0.0008) [2023-12-28 01:17:05,288][106226] Updated weights for policy 0, policy_version 839321 (0.0010) [2023-12-28 01:17:05,342][106226] Updated weights for policy 0, policy_version 839331 (0.0006) [2023-12-28 01:17:05,895][106225] Updated weights for policy 1, policy_version 841254 (0.0006) [2023-12-28 01:17:05,896][106226] Updated weights for policy 0, policy_version 839341 (0.0006) [2023-12-28 01:17:05,951][106226] Updated weights for policy 0, policy_version 839351 (0.0008) [2023-12-28 01:17:05,952][106225] Updated weights for policy 1, policy_version 841264 (0.0008) [2023-12-28 01:17:06,011][106226] Updated weights for policy 0, policy_version 839361 (0.0010) [2023-12-28 01:17:06,014][106225] Updated weights for policy 1, policy_version 841274 (0.0005) [2023-12-28 01:17:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 430342144. Throughput: 0: 10000.2, 1: 10108.4. Samples: 430346424. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:06,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.972')] [2023-12-28 01:17:06,737][106226] Updated weights for policy 0, policy_version 839371 (0.0010) [2023-12-28 01:17:06,741][106225] Updated weights for policy 1, policy_version 841284 (0.0006) [2023-12-28 01:17:06,791][106226] Updated weights for policy 0, policy_version 839381 (0.0010) [2023-12-28 01:17:06,798][106225] Updated weights for policy 1, policy_version 841294 (0.0006) [2023-12-28 01:17:06,842][106226] Updated weights for policy 0, policy_version 839391 (0.0011) [2023-12-28 01:17:06,863][106225] Updated weights for policy 1, policy_version 841304 (0.0005) [2023-12-28 01:17:07,399][106225] Updated weights for policy 1, policy_version 841314 (0.0006) [2023-12-28 01:17:07,465][106225] Updated weights for policy 1, policy_version 841324 (0.0006) [2023-12-28 01:17:07,521][106226] Updated weights for policy 0, policy_version 839401 (0.0010) [2023-12-28 01:17:07,529][106225] Updated weights for policy 1, policy_version 841334 (0.0007) [2023-12-28 01:17:07,581][106226] Updated weights for policy 0, policy_version 839411 (0.0006) [2023-12-28 01:17:07,584][106225] Updated weights for policy 1, policy_version 841344 (0.0007) [2023-12-28 01:17:07,635][106226] Updated weights for policy 0, policy_version 839421 (0.0008) [2023-12-28 01:17:07,687][106226] Updated weights for policy 0, policy_version 839431 (0.0008) [2023-12-28 01:17:08,248][106225] Updated weights for policy 1, policy_version 841354 (0.0010) [2023-12-28 01:17:08,297][106225] Updated weights for policy 1, policy_version 841364 (0.0010) [2023-12-28 01:17:08,356][106225] Updated weights for policy 1, policy_version 841374 (0.0010) [2023-12-28 01:17:08,408][106226] Updated weights for policy 0, policy_version 839441 (0.0011) [2023-12-28 01:17:08,473][106226] Updated weights for policy 0, policy_version 839451 (0.0011) [2023-12-28 01:17:08,538][106226] Updated weights for policy 0, policy_version 839461 (0.0011) [2023-12-28 01:17:09,107][106225] Updated weights for policy 1, policy_version 841384 (0.0006) [2023-12-28 01:17:09,124][106226] Updated weights for policy 0, policy_version 839471 (0.0008) [2023-12-28 01:17:09,162][106225] Updated weights for policy 1, policy_version 841394 (0.0009) [2023-12-28 01:17:09,178][106226] Updated weights for policy 0, policy_version 839481 (0.0005) [2023-12-28 01:17:09,237][106225] Updated weights for policy 1, policy_version 841404 (0.0010) [2023-12-28 01:17:09,243][106226] Updated weights for policy 0, policy_version 839491 (0.0007) [2023-12-28 01:17:09,837][106225] Updated weights for policy 1, policy_version 841414 (0.0010) [2023-12-28 01:17:09,905][106225] Updated weights for policy 1, policy_version 841424 (0.0011) [2023-12-28 01:17:09,960][106226] Updated weights for policy 0, policy_version 839501 (0.0007) [2023-12-28 01:17:09,976][106225] Updated weights for policy 1, policy_version 841434 (0.0010) [2023-12-28 01:17:10,020][106226] Updated weights for policy 0, policy_version 839511 (0.0007) [2023-12-28 01:17:10,086][106226] Updated weights for policy 0, policy_version 839521 (0.0006) [2023-12-28 01:17:10,619][106225] Updated weights for policy 1, policy_version 841444 (0.0008) [2023-12-28 01:17:10,678][106225] Updated weights for policy 1, policy_version 841454 (0.0010) [2023-12-28 01:17:10,741][106225] Updated weights for policy 1, policy_version 841464 (0.0008) [2023-12-28 01:17:10,825][106226] Updated weights for policy 0, policy_version 839531 (0.0008) [2023-12-28 01:17:10,881][106226] Updated weights for policy 0, policy_version 839541 (0.0006) [2023-12-28 01:17:10,943][106226] Updated weights for policy 0, policy_version 839551 (0.0006) [2023-12-28 01:17:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 430440448. Throughput: 0: 10039.2, 1: 10161.8. Samples: 430407820. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:11,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.135')] [2023-12-28 01:17:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000841472_215457792.pth... [2023-12-28 01:17:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000839560_214982656.pth... [2023-12-28 01:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000840288_215154688.pth [2023-12-28 01:17:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000838408_214687744.pth [2023-12-28 01:17:11,450][106225] Updated weights for policy 1, policy_version 841474 (0.0007) [2023-12-28 01:17:11,511][106225] Updated weights for policy 1, policy_version 841484 (0.0008) [2023-12-28 01:17:11,579][106225] Updated weights for policy 1, policy_version 841494 (0.0008) [2023-12-28 01:17:11,651][106225] Updated weights for policy 1, policy_version 841504 (0.0008) [2023-12-28 01:17:11,746][106226] Updated weights for policy 0, policy_version 839561 (0.0010) [2023-12-28 01:17:11,809][106226] Updated weights for policy 0, policy_version 839571 (0.0009) [2023-12-28 01:17:11,873][106226] Updated weights for policy 0, policy_version 839581 (0.0009) [2023-12-28 01:17:11,930][106226] Updated weights for policy 0, policy_version 839591 (0.0009) [2023-12-28 01:17:12,376][106225] Updated weights for policy 1, policy_version 841514 (0.0008) [2023-12-28 01:17:12,443][106225] Updated weights for policy 1, policy_version 841524 (0.0008) [2023-12-28 01:17:12,511][106225] Updated weights for policy 1, policy_version 841534 (0.0009) [2023-12-28 01:17:12,675][106226] Updated weights for policy 0, policy_version 839601 (0.0007) [2023-12-28 01:17:12,735][106226] Updated weights for policy 0, policy_version 839611 (0.0007) [2023-12-28 01:17:12,794][106226] Updated weights for policy 0, policy_version 839621 (0.0008) [2023-12-28 01:17:13,124][106225] Updated weights for policy 1, policy_version 841544 (0.0010) [2023-12-28 01:17:13,168][106225] Updated weights for policy 1, policy_version 841554 (0.0006) [2023-12-28 01:17:13,217][106225] Updated weights for policy 1, policy_version 841564 (0.0005) [2023-12-28 01:17:13,484][106226] Updated weights for policy 0, policy_version 839631 (0.0006) [2023-12-28 01:17:13,542][106226] Updated weights for policy 0, policy_version 839641 (0.0009) [2023-12-28 01:17:13,604][106226] Updated weights for policy 0, policy_version 839652 (0.0009) [2023-12-28 01:17:13,835][106225] Updated weights for policy 1, policy_version 841574 (0.0008) [2023-12-28 01:17:13,903][106225] Updated weights for policy 1, policy_version 841584 (0.0011) [2023-12-28 01:17:13,967][106225] Updated weights for policy 1, policy_version 841594 (0.0010) [2023-12-28 01:17:14,288][106226] Updated weights for policy 0, policy_version 839662 (0.0008) [2023-12-28 01:17:14,339][106226] Updated weights for policy 0, policy_version 839672 (0.0008) [2023-12-28 01:17:14,393][106226] Updated weights for policy 0, policy_version 839682 (0.0008) [2023-12-28 01:17:14,656][106225] Updated weights for policy 1, policy_version 841604 (0.0010) [2023-12-28 01:17:14,702][106225] Updated weights for policy 1, policy_version 841614 (0.0006) [2023-12-28 01:17:14,759][106225] Updated weights for policy 1, policy_version 841624 (0.0006) [2023-12-28 01:17:15,121][106226] Updated weights for policy 0, policy_version 839692 (0.0008) [2023-12-28 01:17:15,183][106226] Updated weights for policy 0, policy_version 839702 (0.0007) [2023-12-28 01:17:15,253][106226] Updated weights for policy 0, policy_version 839712 (0.0007) [2023-12-28 01:17:15,534][106225] Updated weights for policy 1, policy_version 841634 (0.0010) [2023-12-28 01:17:15,601][106225] Updated weights for policy 1, policy_version 841644 (0.0011) [2023-12-28 01:17:15,669][106225] Updated weights for policy 1, policy_version 841654 (0.0011) [2023-12-28 01:17:15,731][106225] Updated weights for policy 1, policy_version 841664 (0.0010) [2023-12-28 01:17:15,908][106226] Updated weights for policy 0, policy_version 839722 (0.0007) [2023-12-28 01:17:15,962][106226] Updated weights for policy 0, policy_version 839732 (0.0008) [2023-12-28 01:17:16,012][106226] Updated weights for policy 0, policy_version 839742 (0.0009) [2023-12-28 01:17:16,061][106226] Updated weights for policy 0, policy_version 839752 (0.0008) [2023-12-28 01:17:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 430538752. Throughput: 0: 9836.8, 1: 10167.1. Samples: 430526508. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:16,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.001')] [2023-12-28 01:17:16,290][106225] Updated weights for policy 1, policy_version 841674 (0.0005) [2023-12-28 01:17:16,348][106225] Updated weights for policy 1, policy_version 841684 (0.0005) [2023-12-28 01:17:16,406][106225] Updated weights for policy 1, policy_version 841694 (0.0005) [2023-12-28 01:17:16,884][106226] Updated weights for policy 0, policy_version 839762 (0.0005) [2023-12-28 01:17:16,943][106226] Updated weights for policy 0, policy_version 839772 (0.0006) [2023-12-28 01:17:16,961][106225] Updated weights for policy 1, policy_version 841704 (0.0010) [2023-12-28 01:17:17,005][106226] Updated weights for policy 0, policy_version 839782 (0.0007) [2023-12-28 01:17:17,020][106225] Updated weights for policy 1, policy_version 841714 (0.0010) [2023-12-28 01:17:17,074][106225] Updated weights for policy 1, policy_version 841724 (0.0010) [2023-12-28 01:17:17,674][106226] Updated weights for policy 0, policy_version 839792 (0.0005) [2023-12-28 01:17:17,680][106225] Updated weights for policy 1, policy_version 841734 (0.0010) [2023-12-28 01:17:17,730][106226] Updated weights for policy 0, policy_version 839802 (0.0006) [2023-12-28 01:17:17,739][106225] Updated weights for policy 1, policy_version 841744 (0.0008) [2023-12-28 01:17:17,787][106226] Updated weights for policy 0, policy_version 839812 (0.0011) [2023-12-28 01:17:17,806][106225] Updated weights for policy 1, policy_version 841754 (0.0006) [2023-12-28 01:17:18,392][106225] Updated weights for policy 1, policy_version 841764 (0.0007) [2023-12-28 01:17:18,424][106226] Updated weights for policy 0, policy_version 839822 (0.0011) [2023-12-28 01:17:18,455][106225] Updated weights for policy 1, policy_version 841774 (0.0007) [2023-12-28 01:17:18,477][106226] Updated weights for policy 0, policy_version 839832 (0.0010) [2023-12-28 01:17:18,516][106225] Updated weights for policy 1, policy_version 841784 (0.0005) [2023-12-28 01:17:18,537][106226] Updated weights for policy 0, policy_version 839842 (0.0010) [2023-12-28 01:17:19,217][106225] Updated weights for policy 1, policy_version 841794 (0.0006) [2023-12-28 01:17:19,293][106225] Updated weights for policy 1, policy_version 841804 (0.0008) [2023-12-28 01:17:19,312][106226] Updated weights for policy 0, policy_version 839852 (0.0008) [2023-12-28 01:17:19,357][106225] Updated weights for policy 1, policy_version 841814 (0.0009) [2023-12-28 01:17:19,381][106226] Updated weights for policy 0, policy_version 839862 (0.0010) [2023-12-28 01:17:19,427][106225] Updated weights for policy 1, policy_version 841824 (0.0009) [2023-12-28 01:17:19,452][106226] Updated weights for policy 0, policy_version 839872 (0.0012) [2023-12-28 01:17:20,127][106225] Updated weights for policy 1, policy_version 841834 (0.0007) [2023-12-28 01:17:20,180][106226] Updated weights for policy 0, policy_version 839882 (0.0010) [2023-12-28 01:17:20,198][106225] Updated weights for policy 1, policy_version 841844 (0.0007) [2023-12-28 01:17:20,232][106226] Updated weights for policy 0, policy_version 839892 (0.0011) [2023-12-28 01:17:20,262][106225] Updated weights for policy 1, policy_version 841854 (0.0006) [2023-12-28 01:17:20,283][106226] Updated weights for policy 0, policy_version 839902 (0.0011) [2023-12-28 01:17:20,338][106226] Updated weights for policy 0, policy_version 839912 (0.0011) [2023-12-28 01:17:20,980][106225] Updated weights for policy 1, policy_version 841864 (0.0008) [2023-12-28 01:17:21,045][106225] Updated weights for policy 1, policy_version 841874 (0.0008) [2023-12-28 01:17:21,100][106225] Updated weights for policy 1, policy_version 841884 (0.0007) [2023-12-28 01:17:21,102][106226] Updated weights for policy 0, policy_version 839922 (0.0011) [2023-12-28 01:17:21,164][106226] Updated weights for policy 0, policy_version 839932 (0.0010) [2023-12-28 01:17:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 430637056. Throughput: 0: 9738.0, 1: 10203.8. Samples: 430647528. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:21,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-5.062')] [2023-12-28 01:17:21,224][106226] Updated weights for policy 0, policy_version 839942 (0.0011) [2023-12-28 01:17:21,834][106225] Updated weights for policy 1, policy_version 841894 (0.0006) [2023-12-28 01:17:21,897][106225] Updated weights for policy 1, policy_version 841904 (0.0008) [2023-12-28 01:17:21,955][106225] Updated weights for policy 1, policy_version 841914 (0.0007) [2023-12-28 01:17:22,025][106226] Updated weights for policy 0, policy_version 839952 (0.0011) [2023-12-28 01:17:22,094][106226] Updated weights for policy 0, policy_version 839962 (0.0011) [2023-12-28 01:17:22,149][106226] Updated weights for policy 0, policy_version 839972 (0.0011) [2023-12-28 01:17:22,739][106225] Updated weights for policy 1, policy_version 841924 (0.0009) [2023-12-28 01:17:22,798][106225] Updated weights for policy 1, policy_version 841934 (0.0010) [2023-12-28 01:17:22,832][106226] Updated weights for policy 0, policy_version 839982 (0.0008) [2023-12-28 01:17:22,859][106225] Updated weights for policy 1, policy_version 841944 (0.0008) [2023-12-28 01:17:22,892][106226] Updated weights for policy 0, policy_version 839992 (0.0007) [2023-12-28 01:17:22,951][106226] Updated weights for policy 0, policy_version 840002 (0.0009) [2023-12-28 01:17:23,574][106225] Updated weights for policy 1, policy_version 841954 (0.0008) [2023-12-28 01:17:23,637][106225] Updated weights for policy 1, policy_version 841964 (0.0005) [2023-12-28 01:17:23,683][106226] Updated weights for policy 0, policy_version 840012 (0.0009) [2023-12-28 01:17:23,693][106225] Updated weights for policy 1, policy_version 841974 (0.0006) [2023-12-28 01:17:23,739][106226] Updated weights for policy 0, policy_version 840022 (0.0008) [2023-12-28 01:17:23,752][106225] Updated weights for policy 1, policy_version 841984 (0.0009) [2023-12-28 01:17:23,798][106226] Updated weights for policy 0, policy_version 840032 (0.0009) [2023-12-28 01:17:24,289][106225] Updated weights for policy 1, policy_version 841994 (0.0008) [2023-12-28 01:17:24,345][106225] Updated weights for policy 1, policy_version 842004 (0.0010) [2023-12-28 01:17:24,406][106225] Updated weights for policy 1, policy_version 842014 (0.0009) [2023-12-28 01:17:24,451][106226] Updated weights for policy 0, policy_version 840042 (0.0010) [2023-12-28 01:17:24,519][106226] Updated weights for policy 0, policy_version 840052 (0.0008) [2023-12-28 01:17:24,580][106226] Updated weights for policy 0, policy_version 840062 (0.0008) [2023-12-28 01:17:24,647][106226] Updated weights for policy 0, policy_version 840072 (0.0010) [2023-12-28 01:17:25,041][106225] Updated weights for policy 1, policy_version 842024 (0.0009) [2023-12-28 01:17:25,095][106225] Updated weights for policy 1, policy_version 842034 (0.0010) [2023-12-28 01:17:25,157][106225] Updated weights for policy 1, policy_version 842044 (0.0007) [2023-12-28 01:17:25,210][106226] Updated weights for policy 0, policy_version 840082 (0.0005) [2023-12-28 01:17:25,275][106226] Updated weights for policy 0, policy_version 840092 (0.0006) [2023-12-28 01:17:25,329][106226] Updated weights for policy 0, policy_version 840102 (0.0009) [2023-12-28 01:17:25,757][106225] Updated weights for policy 1, policy_version 842054 (0.0007) [2023-12-28 01:17:25,808][106225] Updated weights for policy 1, policy_version 842064 (0.0008) [2023-12-28 01:17:25,869][106225] Updated weights for policy 1, policy_version 842074 (0.0008) [2023-12-28 01:17:25,990][106226] Updated weights for policy 0, policy_version 840112 (0.0011) [2023-12-28 01:17:26,058][106226] Updated weights for policy 0, policy_version 840122 (0.0010) [2023-12-28 01:17:26,128][106226] Updated weights for policy 0, policy_version 840132 (0.0010) [2023-12-28 01:17:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 430743552. Throughput: 0: 9692.0, 1: 10093.6. Samples: 430703744. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:26,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-5.187')] [2023-12-28 01:17:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000840136_215130112.pth... [2023-12-28 01:17:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000842080_215613440.pth... [2023-12-28 01:17:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000840896_215310336.pth [2023-12-28 01:17:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000838984_214835200.pth [2023-12-28 01:17:26,488][106225] Updated weights for policy 1, policy_version 842084 (0.0007) [2023-12-28 01:17:26,550][106225] Updated weights for policy 1, policy_version 842094 (0.0005) [2023-12-28 01:17:26,608][106225] Updated weights for policy 1, policy_version 842104 (0.0007) [2023-12-28 01:17:26,811][106226] Updated weights for policy 0, policy_version 840142 (0.0010) [2023-12-28 01:17:26,876][106226] Updated weights for policy 0, policy_version 840152 (0.0010) [2023-12-28 01:17:26,935][106226] Updated weights for policy 0, policy_version 840162 (0.0010) [2023-12-28 01:17:27,136][106225] Updated weights for policy 1, policy_version 842114 (0.0005) [2023-12-28 01:17:27,202][106225] Updated weights for policy 1, policy_version 842124 (0.0005) [2023-12-28 01:17:27,273][106225] Updated weights for policy 1, policy_version 842134 (0.0005) [2023-12-28 01:17:27,338][106225] Updated weights for policy 1, policy_version 842144 (0.0006) [2023-12-28 01:17:27,622][106226] Updated weights for policy 0, policy_version 840172 (0.0010) [2023-12-28 01:17:27,683][106226] Updated weights for policy 0, policy_version 840182 (0.0011) [2023-12-28 01:17:27,735][106226] Updated weights for policy 0, policy_version 840192 (0.0010) [2023-12-28 01:17:27,857][106225] Updated weights for policy 1, policy_version 842154 (0.0009) [2023-12-28 01:17:27,904][106225] Updated weights for policy 1, policy_version 842164 (0.0008) [2023-12-28 01:17:27,949][106225] Updated weights for policy 1, policy_version 842174 (0.0008) [2023-12-28 01:17:28,435][106226] Updated weights for policy 0, policy_version 840202 (0.0008) [2023-12-28 01:17:28,500][106226] Updated weights for policy 0, policy_version 840212 (0.0008) [2023-12-28 01:17:28,554][106226] Updated weights for policy 0, policy_version 840222 (0.0008) [2023-12-28 01:17:28,610][106226] Updated weights for policy 0, policy_version 840232 (0.0009) [2023-12-28 01:17:28,638][106225] Updated weights for policy 1, policy_version 842184 (0.0007) [2023-12-28 01:17:28,697][106225] Updated weights for policy 1, policy_version 842194 (0.0008) [2023-12-28 01:17:28,750][106225] Updated weights for policy 1, policy_version 842204 (0.0007) [2023-12-28 01:17:29,357][106226] Updated weights for policy 0, policy_version 840242 (0.0010) [2023-12-28 01:17:29,420][106226] Updated weights for policy 0, policy_version 840252 (0.0008) [2023-12-28 01:17:29,474][106226] Updated weights for policy 0, policy_version 840262 (0.0010) [2023-12-28 01:17:29,541][106225] Updated weights for policy 1, policy_version 842214 (0.0008) [2023-12-28 01:17:29,601][106225] Updated weights for policy 1, policy_version 842224 (0.0008) [2023-12-28 01:17:29,668][106225] Updated weights for policy 1, policy_version 842234 (0.0008) [2023-12-28 01:17:30,207][106226] Updated weights for policy 0, policy_version 840272 (0.0011) [2023-12-28 01:17:30,271][106226] Updated weights for policy 0, policy_version 840282 (0.0011) [2023-12-28 01:17:30,331][106226] Updated weights for policy 0, policy_version 840292 (0.0010) [2023-12-28 01:17:30,432][106225] Updated weights for policy 1, policy_version 842244 (0.0008) [2023-12-28 01:17:30,492][106225] Updated weights for policy 1, policy_version 842254 (0.0007) [2023-12-28 01:17:30,547][106225] Updated weights for policy 1, policy_version 842264 (0.0007) [2023-12-28 01:17:31,040][106226] Updated weights for policy 0, policy_version 840302 (0.0011) [2023-12-28 01:17:31,096][106226] Updated weights for policy 0, policy_version 840312 (0.0010) [2023-12-28 01:17:31,165][106226] Updated weights for policy 0, policy_version 840322 (0.0008) [2023-12-28 01:17:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 430833664. Throughput: 0: 9803.0, 1: 10225.8. Samples: 430830068. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:31,175][105115] Avg episode reward: [(0, '-4.222'), (1, '-5.010')] [2023-12-28 01:17:31,286][106225] Updated weights for policy 1, policy_version 842274 (0.0008) [2023-12-28 01:17:31,344][106225] Updated weights for policy 1, policy_version 842284 (0.0008) [2023-12-28 01:17:31,403][106225] Updated weights for policy 1, policy_version 842294 (0.0008) [2023-12-28 01:17:31,454][106225] Updated weights for policy 1, policy_version 842304 (0.0008) [2023-12-28 01:17:31,870][106226] Updated weights for policy 0, policy_version 840332 (0.0008) [2023-12-28 01:17:31,929][106226] Updated weights for policy 0, policy_version 840342 (0.0008) [2023-12-28 01:17:31,987][106226] Updated weights for policy 0, policy_version 840352 (0.0008) [2023-12-28 01:17:32,221][106225] Updated weights for policy 1, policy_version 842314 (0.0008) [2023-12-28 01:17:32,288][106225] Updated weights for policy 1, policy_version 842324 (0.0009) [2023-12-28 01:17:32,344][106225] Updated weights for policy 1, policy_version 842334 (0.0008) [2023-12-28 01:17:32,741][106226] Updated weights for policy 0, policy_version 840362 (0.0008) [2023-12-28 01:17:32,803][106226] Updated weights for policy 0, policy_version 840372 (0.0006) [2023-12-28 01:17:32,864][106226] Updated weights for policy 0, policy_version 840382 (0.0008) [2023-12-28 01:17:32,924][106226] Updated weights for policy 0, policy_version 840392 (0.0008) [2023-12-28 01:17:33,029][106225] Updated weights for policy 1, policy_version 842344 (0.0006) [2023-12-28 01:17:33,091][106225] Updated weights for policy 1, policy_version 842354 (0.0008) [2023-12-28 01:17:33,156][106225] Updated weights for policy 1, policy_version 842364 (0.0008) [2023-12-28 01:17:33,534][106226] Updated weights for policy 0, policy_version 840402 (0.0009) [2023-12-28 01:17:33,591][106226] Updated weights for policy 0, policy_version 840412 (0.0008) [2023-12-28 01:17:33,641][106226] Updated weights for policy 0, policy_version 840422 (0.0008) [2023-12-28 01:17:33,701][106225] Updated weights for policy 1, policy_version 842374 (0.0006) [2023-12-28 01:17:33,764][106225] Updated weights for policy 1, policy_version 842384 (0.0005) [2023-12-28 01:17:33,823][106225] Updated weights for policy 1, policy_version 842394 (0.0005) [2023-12-28 01:17:34,379][106225] Updated weights for policy 1, policy_version 842404 (0.0007) [2023-12-28 01:17:34,441][106225] Updated weights for policy 1, policy_version 842414 (0.0007) [2023-12-28 01:17:34,455][106226] Updated weights for policy 0, policy_version 840432 (0.0009) [2023-12-28 01:17:34,502][106225] Updated weights for policy 1, policy_version 842424 (0.0007) [2023-12-28 01:17:34,516][106226] Updated weights for policy 0, policy_version 840442 (0.0006) [2023-12-28 01:17:34,580][106226] Updated weights for policy 0, policy_version 840452 (0.0008) [2023-12-28 01:17:35,110][106225] Updated weights for policy 1, policy_version 842434 (0.0008) [2023-12-28 01:17:35,170][106225] Updated weights for policy 1, policy_version 842444 (0.0009) [2023-12-28 01:17:35,227][106225] Updated weights for policy 1, policy_version 842454 (0.0009) [2023-12-28 01:17:35,274][106225] Updated weights for policy 1, policy_version 842464 (0.0008) [2023-12-28 01:17:35,313][106226] Updated weights for policy 0, policy_version 840462 (0.0007) [2023-12-28 01:17:35,364][106226] Updated weights for policy 0, policy_version 840472 (0.0008) [2023-12-28 01:17:35,420][106226] Updated weights for policy 0, policy_version 840482 (0.0009) [2023-12-28 01:17:36,013][106225] Updated weights for policy 1, policy_version 842474 (0.0006) [2023-12-28 01:17:36,013][106226] Updated weights for policy 0, policy_version 840492 (0.0006) [2023-12-28 01:17:36,062][106225] Updated weights for policy 1, policy_version 842484 (0.0005) [2023-12-28 01:17:36,078][106226] Updated weights for policy 0, policy_version 840502 (0.0006) [2023-12-28 01:17:36,115][106225] Updated weights for policy 1, policy_version 842494 (0.0007) [2023-12-28 01:17:36,147][106226] Updated weights for policy 0, policy_version 840512 (0.0008) [2023-12-28 01:17:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 430940160. Throughput: 0: 9825.4, 1: 10214.6. Samples: 430950800. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:36,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-5.411')] [2023-12-28 01:17:36,789][106226] Updated weights for policy 0, policy_version 840522 (0.0009) [2023-12-28 01:17:36,856][106226] Updated weights for policy 0, policy_version 840532 (0.0005) [2023-12-28 01:17:36,913][106226] Updated weights for policy 0, policy_version 840542 (0.0006) [2023-12-28 01:17:36,919][106225] Updated weights for policy 1, policy_version 842504 (0.0008) [2023-12-28 01:17:36,964][106226] Updated weights for policy 0, policy_version 840552 (0.0006) [2023-12-28 01:17:36,977][106225] Updated weights for policy 1, policy_version 842514 (0.0008) [2023-12-28 01:17:37,042][106225] Updated weights for policy 1, policy_version 842524 (0.0007) [2023-12-28 01:17:37,609][106225] Updated weights for policy 1, policy_version 842534 (0.0006) [2023-12-28 01:17:37,640][106226] Updated weights for policy 0, policy_version 840562 (0.0005) [2023-12-28 01:17:37,674][106225] Updated weights for policy 1, policy_version 842544 (0.0007) [2023-12-28 01:17:37,704][106226] Updated weights for policy 0, policy_version 840572 (0.0007) [2023-12-28 01:17:37,734][106225] Updated weights for policy 1, policy_version 842554 (0.0005) [2023-12-28 01:17:37,765][106226] Updated weights for policy 0, policy_version 840582 (0.0008) [2023-12-28 01:17:38,377][106225] Updated weights for policy 1, policy_version 842564 (0.0006) [2023-12-28 01:17:38,437][106225] Updated weights for policy 1, policy_version 842574 (0.0006) [2023-12-28 01:17:38,487][106226] Updated weights for policy 0, policy_version 840592 (0.0009) [2023-12-28 01:17:38,501][106225] Updated weights for policy 1, policy_version 842584 (0.0005) [2023-12-28 01:17:38,550][106226] Updated weights for policy 0, policy_version 840602 (0.0007) [2023-12-28 01:17:38,609][106226] Updated weights for policy 0, policy_version 840612 (0.0008) [2023-12-28 01:17:39,181][106225] Updated weights for policy 1, policy_version 842594 (0.0006) [2023-12-28 01:17:39,245][106225] Updated weights for policy 1, policy_version 842604 (0.0009) [2023-12-28 01:17:39,302][106225] Updated weights for policy 1, policy_version 842614 (0.0008) [2023-12-28 01:17:39,356][106226] Updated weights for policy 0, policy_version 840622 (0.0009) [2023-12-28 01:17:39,374][106225] Updated weights for policy 1, policy_version 842624 (0.0008) [2023-12-28 01:17:39,436][106226] Updated weights for policy 0, policy_version 840632 (0.0008) [2023-12-28 01:17:39,503][106226] Updated weights for policy 0, policy_version 840642 (0.0008) [2023-12-28 01:17:40,136][106225] Updated weights for policy 1, policy_version 842634 (0.0007) [2023-12-28 01:17:40,184][106225] Updated weights for policy 1, policy_version 842644 (0.0008) [2023-12-28 01:17:40,222][106226] Updated weights for policy 0, policy_version 840652 (0.0008) [2023-12-28 01:17:40,256][106225] Updated weights for policy 1, policy_version 842654 (0.0007) [2023-12-28 01:17:40,290][106226] Updated weights for policy 0, policy_version 840662 (0.0006) [2023-12-28 01:17:40,363][106226] Updated weights for policy 0, policy_version 840672 (0.0008) [2023-12-28 01:17:40,941][106225] Updated weights for policy 1, policy_version 842664 (0.0011) [2023-12-28 01:17:41,002][106225] Updated weights for policy 1, policy_version 842674 (0.0011) [2023-12-28 01:17:41,065][106225] Updated weights for policy 1, policy_version 842684 (0.0009) [2023-12-28 01:17:41,102][106226] Updated weights for policy 0, policy_version 840682 (0.0008) [2023-12-28 01:17:41,165][106226] Updated weights for policy 0, policy_version 840692 (0.0008) [2023-12-28 01:17:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 431038464. Throughput: 0: 9827.1, 1: 10259.7. Samples: 431011852. Policy #0 lag: (min: 28.0, avg: 38.8, max: 60.0) [2023-12-28 01:17:41,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-5.167')] [2023-12-28 01:17:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000842688_215769088.pth... [2023-12-28 01:17:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000841472_215457792.pth [2023-12-28 01:17:41,218][106226] Updated weights for policy 0, policy_version 840702 (0.0007) [2023-12-28 01:17:41,280][106226] Updated weights for policy 0, policy_version 840712 (0.0008) [2023-12-28 01:17:41,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000840712_215277568.pth... [2023-12-28 01:17:41,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000839560_214982656.pth [2023-12-28 01:17:41,879][106225] Updated weights for policy 1, policy_version 842694 (0.0007) [2023-12-28 01:17:41,942][106225] Updated weights for policy 1, policy_version 842704 (0.0006) [2023-12-28 01:17:42,008][106225] Updated weights for policy 1, policy_version 842714 (0.0008) [2023-12-28 01:17:42,045][106226] Updated weights for policy 0, policy_version 840722 (0.0011) [2023-12-28 01:17:42,106][106226] Updated weights for policy 0, policy_version 840732 (0.0010) [2023-12-28 01:17:42,168][106226] Updated weights for policy 0, policy_version 840742 (0.0010) [2023-12-28 01:17:42,681][106225] Updated weights for policy 1, policy_version 842724 (0.0007) [2023-12-28 01:17:42,735][106225] Updated weights for policy 1, policy_version 842734 (0.0008) [2023-12-28 01:17:42,783][106225] Updated weights for policy 1, policy_version 842744 (0.0007) [2023-12-28 01:17:42,848][106226] Updated weights for policy 0, policy_version 840752 (0.0006) [2023-12-28 01:17:42,902][106226] Updated weights for policy 0, policy_version 840762 (0.0010) [2023-12-28 01:17:42,960][106226] Updated weights for policy 0, policy_version 840772 (0.0011) [2023-12-28 01:17:43,465][106225] Updated weights for policy 1, policy_version 842754 (0.0009) [2023-12-28 01:17:43,529][106225] Updated weights for policy 1, policy_version 842764 (0.0010) [2023-12-28 01:17:43,583][106225] Updated weights for policy 1, policy_version 842774 (0.0009) [2023-12-28 01:17:43,642][106225] Updated weights for policy 1, policy_version 842784 (0.0010) [2023-12-28 01:17:43,657][106226] Updated weights for policy 0, policy_version 840782 (0.0010) [2023-12-28 01:17:43,713][106226] Updated weights for policy 0, policy_version 840792 (0.0010) [2023-12-28 01:17:43,769][106226] Updated weights for policy 0, policy_version 840802 (0.0010) [2023-12-28 01:17:44,299][106225] Updated weights for policy 1, policy_version 842794 (0.0010) [2023-12-28 01:17:44,359][106225] Updated weights for policy 1, policy_version 842804 (0.0010) [2023-12-28 01:17:44,416][106225] Updated weights for policy 1, policy_version 842814 (0.0010) [2023-12-28 01:17:44,482][106226] Updated weights for policy 0, policy_version 840812 (0.0008) [2023-12-28 01:17:44,540][106226] Updated weights for policy 0, policy_version 840822 (0.0009) [2023-12-28 01:17:44,596][106226] Updated weights for policy 0, policy_version 840832 (0.0010) [2023-12-28 01:17:45,098][106225] Updated weights for policy 1, policy_version 842824 (0.0007) [2023-12-28 01:17:45,156][106225] Updated weights for policy 1, policy_version 842834 (0.0008) [2023-12-28 01:17:45,224][106225] Updated weights for policy 1, policy_version 842844 (0.0007) [2023-12-28 01:17:45,259][106226] Updated weights for policy 0, policy_version 840842 (0.0010) [2023-12-28 01:17:45,329][106226] Updated weights for policy 0, policy_version 840852 (0.0010) [2023-12-28 01:17:45,391][106226] Updated weights for policy 0, policy_version 840862 (0.0010) [2023-12-28 01:17:45,454][106226] Updated weights for policy 0, policy_version 840872 (0.0011) [2023-12-28 01:17:45,843][106225] Updated weights for policy 1, policy_version 842854 (0.0006) [2023-12-28 01:17:45,896][106225] Updated weights for policy 1, policy_version 842864 (0.0005) [2023-12-28 01:17:45,943][106225] Updated weights for policy 1, policy_version 842874 (0.0005) [2023-12-28 01:17:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.7, 300 sec: 19966.2). Total num frames: 431136768. Throughput: 0: 9863.4, 1: 10202.3. Samples: 431127524. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:17:46,176][105115] Avg episode reward: [(0, '-4.307'), (1, '-5.349')] [2023-12-28 01:17:46,184][106226] Updated weights for policy 0, policy_version 840882 (0.0006) [2023-12-28 01:17:46,251][106226] Updated weights for policy 0, policy_version 840892 (0.0006) [2023-12-28 01:17:46,308][106226] Updated weights for policy 0, policy_version 840902 (0.0005) [2023-12-28 01:17:46,502][106225] Updated weights for policy 1, policy_version 842884 (0.0007) [2023-12-28 01:17:46,547][106225] Updated weights for policy 1, policy_version 842894 (0.0005) [2023-12-28 01:17:46,592][106225] Updated weights for policy 1, policy_version 842904 (0.0005) [2023-12-28 01:17:46,991][106226] Updated weights for policy 0, policy_version 840912 (0.0007) [2023-12-28 01:17:47,048][106226] Updated weights for policy 0, policy_version 840922 (0.0009) [2023-12-28 01:17:47,108][106226] Updated weights for policy 0, policy_version 840932 (0.0009) [2023-12-28 01:17:47,195][106225] Updated weights for policy 1, policy_version 842914 (0.0006) [2023-12-28 01:17:47,250][106225] Updated weights for policy 1, policy_version 842924 (0.0008) [2023-12-28 01:17:47,302][106225] Updated weights for policy 1, policy_version 842934 (0.0008) [2023-12-28 01:17:47,366][106225] Updated weights for policy 1, policy_version 842944 (0.0009) [2023-12-28 01:17:47,738][106226] Updated weights for policy 0, policy_version 840942 (0.0006) [2023-12-28 01:17:47,795][106226] Updated weights for policy 0, policy_version 840952 (0.0005) [2023-12-28 01:17:47,853][106226] Updated weights for policy 0, policy_version 840962 (0.0005) [2023-12-28 01:17:48,159][106225] Updated weights for policy 1, policy_version 842954 (0.0008) [2023-12-28 01:17:48,216][106225] Updated weights for policy 1, policy_version 842964 (0.0007) [2023-12-28 01:17:48,267][106225] Updated weights for policy 1, policy_version 842974 (0.0005) [2023-12-28 01:17:48,483][106226] Updated weights for policy 0, policy_version 840972 (0.0005) [2023-12-28 01:17:48,532][106226] Updated weights for policy 0, policy_version 840982 (0.0005) [2023-12-28 01:17:48,588][106226] Updated weights for policy 0, policy_version 840992 (0.0008) [2023-12-28 01:17:49,044][106225] Updated weights for policy 1, policy_version 842984 (0.0008) [2023-12-28 01:17:49,096][106225] Updated weights for policy 1, policy_version 842994 (0.0008) [2023-12-28 01:17:49,154][106225] Updated weights for policy 1, policy_version 843004 (0.0009) [2023-12-28 01:17:49,197][106226] Updated weights for policy 0, policy_version 841002 (0.0008) [2023-12-28 01:17:49,263][106226] Updated weights for policy 0, policy_version 841012 (0.0009) [2023-12-28 01:17:49,328][106226] Updated weights for policy 0, policy_version 841022 (0.0008) [2023-12-28 01:17:49,394][106226] Updated weights for policy 0, policy_version 841032 (0.0008) [2023-12-28 01:17:49,853][106225] Updated weights for policy 1, policy_version 843014 (0.0008) [2023-12-28 01:17:49,921][106225] Updated weights for policy 1, policy_version 843024 (0.0008) [2023-12-28 01:17:49,987][106225] Updated weights for policy 1, policy_version 843034 (0.0008) [2023-12-28 01:17:50,179][106226] Updated weights for policy 0, policy_version 841042 (0.0007) [2023-12-28 01:17:50,240][106226] Updated weights for policy 0, policy_version 841052 (0.0009) [2023-12-28 01:17:50,300][106226] Updated weights for policy 0, policy_version 841062 (0.0009) [2023-12-28 01:17:50,734][106225] Updated weights for policy 1, policy_version 843044 (0.0008) [2023-12-28 01:17:50,797][106225] Updated weights for policy 1, policy_version 843054 (0.0008) [2023-12-28 01:17:50,860][106225] Updated weights for policy 1, policy_version 843064 (0.0008) [2023-12-28 01:17:51,027][106226] Updated weights for policy 0, policy_version 841072 (0.0009) [2023-12-28 01:17:51,087][106226] Updated weights for policy 0, policy_version 841082 (0.0009) [2023-12-28 01:17:51,149][106226] Updated weights for policy 0, policy_version 841092 (0.0009) [2023-12-28 01:17:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 431243264. Throughput: 0: 9802.9, 1: 10230.2. Samples: 431247912. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:17:51,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.312')] [2023-12-28 01:17:51,599][106225] Updated weights for policy 1, policy_version 843074 (0.0009) [2023-12-28 01:17:51,676][106225] Updated weights for policy 1, policy_version 843084 (0.0009) [2023-12-28 01:17:51,745][106225] Updated weights for policy 1, policy_version 843094 (0.0009) [2023-12-28 01:17:51,813][106225] Updated weights for policy 1, policy_version 843104 (0.0009) [2023-12-28 01:17:51,904][106226] Updated weights for policy 0, policy_version 841102 (0.0006) [2023-12-28 01:17:51,950][106226] Updated weights for policy 0, policy_version 841112 (0.0005) [2023-12-28 01:17:52,003][106226] Updated weights for policy 0, policy_version 841122 (0.0007) [2023-12-28 01:17:52,589][106225] Updated weights for policy 1, policy_version 843114 (0.0008) [2023-12-28 01:17:52,620][106226] Updated weights for policy 0, policy_version 841132 (0.0008) [2023-12-28 01:17:52,649][106225] Updated weights for policy 1, policy_version 843124 (0.0007) [2023-12-28 01:17:52,680][106226] Updated weights for policy 0, policy_version 841142 (0.0007) [2023-12-28 01:17:52,706][106225] Updated weights for policy 1, policy_version 843134 (0.0006) [2023-12-28 01:17:52,742][106226] Updated weights for policy 0, policy_version 841152 (0.0008) [2023-12-28 01:17:53,405][106225] Updated weights for policy 1, policy_version 843144 (0.0007) [2023-12-28 01:17:53,455][106225] Updated weights for policy 1, policy_version 843155 (0.0010) [2023-12-28 01:17:53,463][106226] Updated weights for policy 0, policy_version 841162 (0.0009) [2023-12-28 01:17:53,505][106225] Updated weights for policy 1, policy_version 843165 (0.0010) [2023-12-28 01:17:53,519][106226] Updated weights for policy 0, policy_version 841172 (0.0005) [2023-12-28 01:17:53,577][106226] Updated weights for policy 0, policy_version 841182 (0.0008) [2023-12-28 01:17:53,640][106226] Updated weights for policy 0, policy_version 841192 (0.0008) [2023-12-28 01:17:54,128][106225] Updated weights for policy 1, policy_version 843175 (0.0007) [2023-12-28 01:17:54,190][106225] Updated weights for policy 1, policy_version 843185 (0.0005) [2023-12-28 01:17:54,248][106225] Updated weights for policy 1, policy_version 843195 (0.0005) [2023-12-28 01:17:54,467][106226] Updated weights for policy 0, policy_version 841202 (0.0006) [2023-12-28 01:17:54,535][106226] Updated weights for policy 0, policy_version 841212 (0.0005) [2023-12-28 01:17:54,593][106226] Updated weights for policy 0, policy_version 841222 (0.0005) [2023-12-28 01:17:54,790][106225] Updated weights for policy 1, policy_version 843205 (0.0006) [2023-12-28 01:17:54,850][106225] Updated weights for policy 1, policy_version 843215 (0.0005) [2023-12-28 01:17:54,904][106225] Updated weights for policy 1, policy_version 843225 (0.0005) [2023-12-28 01:17:55,304][106226] Updated weights for policy 0, policy_version 841232 (0.0006) [2023-12-28 01:17:55,367][106226] Updated weights for policy 0, policy_version 841242 (0.0006) [2023-12-28 01:17:55,428][106226] Updated weights for policy 0, policy_version 841252 (0.0005) [2023-12-28 01:17:55,444][106225] Updated weights for policy 1, policy_version 843235 (0.0005) [2023-12-28 01:17:55,495][106225] Updated weights for policy 1, policy_version 843245 (0.0005) [2023-12-28 01:17:55,539][106225] Updated weights for policy 1, policy_version 843255 (0.0005) [2023-12-28 01:17:55,972][106226] Updated weights for policy 0, policy_version 841262 (0.0008) [2023-12-28 01:17:56,040][106226] Updated weights for policy 0, policy_version 841272 (0.0011) [2023-12-28 01:17:56,104][106226] Updated weights for policy 0, policy_version 841282 (0.0011) [2023-12-28 01:17:56,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 431341568. Throughput: 0: 9769.2, 1: 10154.9. Samples: 431304408. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:17:56,175][105115] Avg episode reward: [(0, '-4.173'), (1, '-4.826')] [2023-12-28 01:17:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000841288_215425024.pth... [2023-12-28 01:17:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000840136_215130112.pth [2023-12-28 01:17:56,192][106225] Updated weights for policy 1, policy_version 843265 (0.0006) [2023-12-28 01:17:56,249][106225] Updated weights for policy 1, policy_version 843275 (0.0008) [2023-12-28 01:17:56,310][106225] Updated weights for policy 1, policy_version 843285 (0.0008) [2023-12-28 01:17:56,357][106225] Updated weights for policy 1, policy_version 843295 (0.0007) [2023-12-28 01:17:56,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000843296_215924736.pth... [2023-12-28 01:17:56,362][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000842080_215613440.pth [2023-12-28 01:17:56,740][106226] Updated weights for policy 0, policy_version 841292 (0.0008) [2023-12-28 01:17:56,793][106226] Updated weights for policy 0, policy_version 841302 (0.0006) [2023-12-28 01:17:56,846][106226] Updated weights for policy 0, policy_version 841312 (0.0005) [2023-12-28 01:17:57,111][106225] Updated weights for policy 1, policy_version 843305 (0.0007) [2023-12-28 01:17:57,163][106225] Updated weights for policy 1, policy_version 843315 (0.0007) [2023-12-28 01:17:57,206][106225] Updated weights for policy 1, policy_version 843325 (0.0005) [2023-12-28 01:17:57,476][106226] Updated weights for policy 0, policy_version 841322 (0.0006) [2023-12-28 01:17:57,522][106226] Updated weights for policy 0, policy_version 841332 (0.0010) [2023-12-28 01:17:57,575][106226] Updated weights for policy 0, policy_version 841342 (0.0010) [2023-12-28 01:17:57,624][106226] Updated weights for policy 0, policy_version 841352 (0.0010) [2023-12-28 01:17:57,840][106225] Updated weights for policy 1, policy_version 843335 (0.0007) [2023-12-28 01:17:57,895][106225] Updated weights for policy 1, policy_version 843345 (0.0007) [2023-12-28 01:17:57,955][106225] Updated weights for policy 1, policy_version 843355 (0.0007) [2023-12-28 01:17:58,374][106226] Updated weights for policy 0, policy_version 841362 (0.0008) [2023-12-28 01:17:58,445][106226] Updated weights for policy 0, policy_version 841372 (0.0010) [2023-12-28 01:17:58,505][106226] Updated weights for policy 0, policy_version 841382 (0.0010) [2023-12-28 01:17:58,697][106225] Updated weights for policy 1, policy_version 843365 (0.0008) [2023-12-28 01:17:58,773][106225] Updated weights for policy 1, policy_version 843375 (0.0007) [2023-12-28 01:17:58,841][106225] Updated weights for policy 1, policy_version 843385 (0.0007) [2023-12-28 01:17:59,389][106226] Updated weights for policy 0, policy_version 841392 (0.0010) [2023-12-28 01:17:59,443][106226] Updated weights for policy 0, policy_version 841402 (0.0007) [2023-12-28 01:17:59,492][106226] Updated weights for policy 0, policy_version 841412 (0.0008) [2023-12-28 01:17:59,591][106225] Updated weights for policy 1, policy_version 843395 (0.0007) [2023-12-28 01:17:59,654][106225] Updated weights for policy 1, policy_version 843405 (0.0006) [2023-12-28 01:17:59,711][106225] Updated weights for policy 1, policy_version 843415 (0.0008) [2023-12-28 01:18:00,185][106226] Updated weights for policy 0, policy_version 841422 (0.0008) [2023-12-28 01:18:00,245][106226] Updated weights for policy 0, policy_version 841432 (0.0008) [2023-12-28 01:18:00,306][106226] Updated weights for policy 0, policy_version 841442 (0.0008) [2023-12-28 01:18:00,403][106225] Updated weights for policy 1, policy_version 843425 (0.0010) [2023-12-28 01:18:00,451][106225] Updated weights for policy 1, policy_version 843435 (0.0006) [2023-12-28 01:18:00,499][106225] Updated weights for policy 1, policy_version 843445 (0.0006) [2023-12-28 01:18:00,549][106225] Updated weights for policy 1, policy_version 843455 (0.0007) [2023-12-28 01:18:00,908][106226] Updated weights for policy 0, policy_version 841452 (0.0006) [2023-12-28 01:18:00,964][106226] Updated weights for policy 0, policy_version 841462 (0.0006) [2023-12-28 01:18:01,031][106226] Updated weights for policy 0, policy_version 841472 (0.0006) [2023-12-28 01:18:01,152][106225] Updated weights for policy 1, policy_version 843465 (0.0009) [2023-12-28 01:18:01,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 431439872. Throughput: 0: 9829.7, 1: 10197.2. Samples: 431427720. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:01,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-5.079')] [2023-12-28 01:18:01,210][106225] Updated weights for policy 1, policy_version 843475 (0.0010) [2023-12-28 01:18:01,273][106225] Updated weights for policy 1, policy_version 843485 (0.0010) [2023-12-28 01:18:01,735][106226] Updated weights for policy 0, policy_version 841482 (0.0008) [2023-12-28 01:18:01,796][106226] Updated weights for policy 0, policy_version 841492 (0.0010) [2023-12-28 01:18:01,848][106226] Updated weights for policy 0, policy_version 841502 (0.0006) [2023-12-28 01:18:01,905][106226] Updated weights for policy 0, policy_version 841512 (0.0006) [2023-12-28 01:18:02,062][106225] Updated weights for policy 1, policy_version 843495 (0.0009) [2023-12-28 01:18:02,128][106225] Updated weights for policy 1, policy_version 843505 (0.0008) [2023-12-28 01:18:02,188][106225] Updated weights for policy 1, policy_version 843515 (0.0009) [2023-12-28 01:18:02,534][106226] Updated weights for policy 0, policy_version 841522 (0.0006) [2023-12-28 01:18:02,593][106226] Updated weights for policy 0, policy_version 841532 (0.0006) [2023-12-28 01:18:02,653][106226] Updated weights for policy 0, policy_version 841542 (0.0005) [2023-12-28 01:18:02,864][106225] Updated weights for policy 1, policy_version 843525 (0.0010) [2023-12-28 01:18:02,927][106225] Updated weights for policy 1, policy_version 843535 (0.0008) [2023-12-28 01:18:02,985][106225] Updated weights for policy 1, policy_version 843545 (0.0008) [2023-12-28 01:18:03,201][106226] Updated weights for policy 0, policy_version 841552 (0.0007) [2023-12-28 01:18:03,267][106226] Updated weights for policy 0, policy_version 841562 (0.0009) [2023-12-28 01:18:03,323][106226] Updated weights for policy 0, policy_version 841572 (0.0009) [2023-12-28 01:18:03,695][106225] Updated weights for policy 1, policy_version 843555 (0.0008) [2023-12-28 01:18:03,749][106225] Updated weights for policy 1, policy_version 843565 (0.0006) [2023-12-28 01:18:03,795][106225] Updated weights for policy 1, policy_version 843575 (0.0008) [2023-12-28 01:18:03,890][106226] Updated weights for policy 0, policy_version 841582 (0.0008) [2023-12-28 01:18:03,951][106226] Updated weights for policy 0, policy_version 841592 (0.0010) [2023-12-28 01:18:04,008][106226] Updated weights for policy 0, policy_version 841602 (0.0010) [2023-12-28 01:18:04,485][106225] Updated weights for policy 1, policy_version 843585 (0.0008) [2023-12-28 01:18:04,546][106225] Updated weights for policy 1, policy_version 843595 (0.0010) [2023-12-28 01:18:04,602][106225] Updated weights for policy 1, policy_version 843605 (0.0011) [2023-12-28 01:18:04,665][106225] Updated weights for policy 1, policy_version 843615 (0.0011) [2023-12-28 01:18:04,696][106226] Updated weights for policy 0, policy_version 841612 (0.0011) [2023-12-28 01:18:04,760][106226] Updated weights for policy 0, policy_version 841622 (0.0011) [2023-12-28 01:18:04,824][106226] Updated weights for policy 0, policy_version 841632 (0.0011) [2023-12-28 01:18:05,270][106225] Updated weights for policy 1, policy_version 843625 (0.0006) [2023-12-28 01:18:05,316][106225] Updated weights for policy 1, policy_version 843635 (0.0005) [2023-12-28 01:18:05,361][106225] Updated weights for policy 1, policy_version 843645 (0.0006) [2023-12-28 01:18:05,511][106226] Updated weights for policy 0, policy_version 841642 (0.0010) [2023-12-28 01:18:05,564][106226] Updated weights for policy 0, policy_version 841652 (0.0010) [2023-12-28 01:18:05,613][106226] Updated weights for policy 0, policy_version 841662 (0.0010) [2023-12-28 01:18:05,659][106226] Updated weights for policy 0, policy_version 841672 (0.0010) [2023-12-28 01:18:06,015][106225] Updated weights for policy 1, policy_version 843655 (0.0009) [2023-12-28 01:18:06,072][106225] Updated weights for policy 1, policy_version 843665 (0.0010) [2023-12-28 01:18:06,133][106225] Updated weights for policy 1, policy_version 843675 (0.0010) [2023-12-28 01:18:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 431546368. Throughput: 0: 9961.4, 1: 10155.8. Samples: 431552804. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:06,175][105115] Avg episode reward: [(0, '-4.294'), (1, '-4.955')] [2023-12-28 01:18:06,401][106226] Updated weights for policy 0, policy_version 841682 (0.0011) [2023-12-28 01:18:06,456][106226] Updated weights for policy 0, policy_version 841692 (0.0011) [2023-12-28 01:18:06,507][106226] Updated weights for policy 0, policy_version 841702 (0.0011) [2023-12-28 01:18:06,751][106225] Updated weights for policy 1, policy_version 843685 (0.0008) [2023-12-28 01:18:06,801][106225] Updated weights for policy 1, policy_version 843695 (0.0010) [2023-12-28 01:18:06,855][106225] Updated weights for policy 1, policy_version 843705 (0.0010) [2023-12-28 01:18:07,239][106226] Updated weights for policy 0, policy_version 841712 (0.0009) [2023-12-28 01:18:07,301][106226] Updated weights for policy 0, policy_version 841722 (0.0011) [2023-12-28 01:18:07,368][106226] Updated weights for policy 0, policy_version 841732 (0.0011) [2023-12-28 01:18:07,533][106225] Updated weights for policy 1, policy_version 843715 (0.0010) [2023-12-28 01:18:07,590][106225] Updated weights for policy 1, policy_version 843725 (0.0010) [2023-12-28 01:18:07,643][106225] Updated weights for policy 1, policy_version 843735 (0.0010) [2023-12-28 01:18:08,004][106226] Updated weights for policy 0, policy_version 841742 (0.0009) [2023-12-28 01:18:08,050][106226] Updated weights for policy 0, policy_version 841752 (0.0007) [2023-12-28 01:18:08,106][106226] Updated weights for policy 0, policy_version 841762 (0.0007) [2023-12-28 01:18:08,273][106225] Updated weights for policy 1, policy_version 843745 (0.0010) [2023-12-28 01:18:08,335][106225] Updated weights for policy 1, policy_version 843755 (0.0010) [2023-12-28 01:18:08,395][106225] Updated weights for policy 1, policy_version 843765 (0.0010) [2023-12-28 01:18:08,450][106225] Updated weights for policy 1, policy_version 843775 (0.0010) [2023-12-28 01:18:08,829][106226] Updated weights for policy 0, policy_version 841772 (0.0007) [2023-12-28 01:18:08,886][106226] Updated weights for policy 0, policy_version 841782 (0.0008) [2023-12-28 01:18:08,942][106226] Updated weights for policy 0, policy_version 841792 (0.0008) [2023-12-28 01:18:09,156][106225] Updated weights for policy 1, policy_version 843785 (0.0006) [2023-12-28 01:18:09,208][106225] Updated weights for policy 1, policy_version 843795 (0.0006) [2023-12-28 01:18:09,275][106225] Updated weights for policy 1, policy_version 843805 (0.0008) [2023-12-28 01:18:09,774][106226] Updated weights for policy 0, policy_version 841802 (0.0010) [2023-12-28 01:18:09,844][106226] Updated weights for policy 0, policy_version 841812 (0.0008) [2023-12-28 01:18:09,914][106226] Updated weights for policy 0, policy_version 841822 (0.0009) [2023-12-28 01:18:09,980][106226] Updated weights for policy 0, policy_version 841832 (0.0008) [2023-12-28 01:18:10,005][106225] Updated weights for policy 1, policy_version 843815 (0.0008) [2023-12-28 01:18:10,072][106225] Updated weights for policy 1, policy_version 843825 (0.0008) [2023-12-28 01:18:10,134][106225] Updated weights for policy 1, policy_version 843835 (0.0009) [2023-12-28 01:18:10,741][106226] Updated weights for policy 0, policy_version 841842 (0.0008) [2023-12-28 01:18:10,801][106226] Updated weights for policy 0, policy_version 841852 (0.0008) [2023-12-28 01:18:10,859][106226] Updated weights for policy 0, policy_version 841862 (0.0009) [2023-12-28 01:18:10,873][106225] Updated weights for policy 1, policy_version 843845 (0.0008) [2023-12-28 01:18:10,926][106225] Updated weights for policy 1, policy_version 843855 (0.0006) [2023-12-28 01:18:10,987][106225] Updated weights for policy 1, policy_version 843865 (0.0007) [2023-12-28 01:18:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 431644672. Throughput: 0: 9986.6, 1: 10226.3. Samples: 431613324. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:11,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.957')] [2023-12-28 01:18:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000843872_216072192.pth... [2023-12-28 01:18:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000841864_215572480.pth... [2023-12-28 01:18:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000840712_215277568.pth [2023-12-28 01:18:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000842688_215769088.pth [2023-12-28 01:18:11,597][106226] Updated weights for policy 0, policy_version 841872 (0.0007) [2023-12-28 01:18:11,685][106226] Updated weights for policy 0, policy_version 841882 (0.0009) [2023-12-28 01:18:11,755][106226] Updated weights for policy 0, policy_version 841892 (0.0011) [2023-12-28 01:18:11,836][106225] Updated weights for policy 1, policy_version 843875 (0.0008) [2023-12-28 01:18:11,901][106225] Updated weights for policy 1, policy_version 843885 (0.0008) [2023-12-28 01:18:11,958][106225] Updated weights for policy 1, policy_version 843895 (0.0008) [2023-12-28 01:18:12,470][106226] Updated weights for policy 0, policy_version 841902 (0.0009) [2023-12-28 01:18:12,527][106226] Updated weights for policy 0, policy_version 841912 (0.0008) [2023-12-28 01:18:12,589][106226] Updated weights for policy 0, policy_version 841922 (0.0007) [2023-12-28 01:18:12,733][106225] Updated weights for policy 1, policy_version 843905 (0.0007) [2023-12-28 01:18:12,794][106225] Updated weights for policy 1, policy_version 843915 (0.0007) [2023-12-28 01:18:12,857][106225] Updated weights for policy 1, policy_version 843925 (0.0009) [2023-12-28 01:18:12,913][106225] Updated weights for policy 1, policy_version 843935 (0.0010) [2023-12-28 01:18:13,218][106226] Updated weights for policy 0, policy_version 841932 (0.0005) [2023-12-28 01:18:13,284][106226] Updated weights for policy 0, policy_version 841942 (0.0009) [2023-12-28 01:18:13,347][106226] Updated weights for policy 0, policy_version 841952 (0.0009) [2023-12-28 01:18:13,556][106225] Updated weights for policy 1, policy_version 843945 (0.0010) [2023-12-28 01:18:13,602][106225] Updated weights for policy 1, policy_version 843955 (0.0007) [2023-12-28 01:18:13,662][106225] Updated weights for policy 1, policy_version 843965 (0.0010) [2023-12-28 01:18:13,918][106226] Updated weights for policy 0, policy_version 841962 (0.0008) [2023-12-28 01:18:13,976][106226] Updated weights for policy 0, policy_version 841972 (0.0007) [2023-12-28 01:18:14,032][106226] Updated weights for policy 0, policy_version 841982 (0.0007) [2023-12-28 01:18:14,084][106226] Updated weights for policy 0, policy_version 841992 (0.0010) [2023-12-28 01:18:14,328][106225] Updated weights for policy 1, policy_version 843975 (0.0010) [2023-12-28 01:18:14,392][106225] Updated weights for policy 1, policy_version 843985 (0.0010) [2023-12-28 01:18:14,455][106225] Updated weights for policy 1, policy_version 843995 (0.0010) [2023-12-28 01:18:14,726][106226] Updated weights for policy 0, policy_version 842002 (0.0006) [2023-12-28 01:18:14,786][106226] Updated weights for policy 0, policy_version 842012 (0.0007) [2023-12-28 01:18:14,851][106226] Updated weights for policy 0, policy_version 842022 (0.0008) [2023-12-28 01:18:15,142][106225] Updated weights for policy 1, policy_version 844005 (0.0009) [2023-12-28 01:18:15,205][106225] Updated weights for policy 1, policy_version 844015 (0.0011) [2023-12-28 01:18:15,270][106225] Updated weights for policy 1, policy_version 844025 (0.0011) [2023-12-28 01:18:15,574][106226] Updated weights for policy 0, policy_version 842032 (0.0006) [2023-12-28 01:18:15,633][106226] Updated weights for policy 0, policy_version 842042 (0.0008) [2023-12-28 01:18:15,688][106226] Updated weights for policy 0, policy_version 842052 (0.0005) [2023-12-28 01:18:16,007][106225] Updated weights for policy 1, policy_version 844035 (0.0009) [2023-12-28 01:18:16,076][106225] Updated weights for policy 1, policy_version 844045 (0.0005) [2023-12-28 01:18:16,137][106225] Updated weights for policy 1, policy_version 844055 (0.0005) [2023-12-28 01:18:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 431734784. Throughput: 0: 9949.2, 1: 10058.8. Samples: 431730428. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:16,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.038')] [2023-12-28 01:18:16,374][106226] Updated weights for policy 0, policy_version 842062 (0.0008) [2023-12-28 01:18:16,431][106226] Updated weights for policy 0, policy_version 842072 (0.0009) [2023-12-28 01:18:16,488][106226] Updated weights for policy 0, policy_version 842082 (0.0009) [2023-12-28 01:18:16,729][106225] Updated weights for policy 1, policy_version 844065 (0.0006) [2023-12-28 01:18:16,793][106225] Updated weights for policy 1, policy_version 844075 (0.0009) [2023-12-28 01:18:16,847][106225] Updated weights for policy 1, policy_version 844085 (0.0008) [2023-12-28 01:18:16,904][106225] Updated weights for policy 1, policy_version 844095 (0.0008) [2023-12-28 01:18:17,189][106226] Updated weights for policy 0, policy_version 842092 (0.0009) [2023-12-28 01:18:17,242][106226] Updated weights for policy 0, policy_version 842102 (0.0009) [2023-12-28 01:18:17,295][106226] Updated weights for policy 0, policy_version 842112 (0.0009) [2023-12-28 01:18:17,580][106225] Updated weights for policy 1, policy_version 844105 (0.0009) [2023-12-28 01:18:17,643][106225] Updated weights for policy 1, policy_version 844115 (0.0008) [2023-12-28 01:18:17,694][106225] Updated weights for policy 1, policy_version 844125 (0.0008) [2023-12-28 01:18:18,123][106226] Updated weights for policy 0, policy_version 842122 (0.0009) [2023-12-28 01:18:18,186][106226] Updated weights for policy 0, policy_version 842132 (0.0009) [2023-12-28 01:18:18,248][106226] Updated weights for policy 0, policy_version 842142 (0.0009) [2023-12-28 01:18:18,264][106225] Updated weights for policy 1, policy_version 844135 (0.0006) [2023-12-28 01:18:18,304][106226] Updated weights for policy 0, policy_version 842152 (0.0008) [2023-12-28 01:18:18,321][106225] Updated weights for policy 1, policy_version 844145 (0.0009) [2023-12-28 01:18:18,383][106225] Updated weights for policy 1, policy_version 844155 (0.0009) [2023-12-28 01:18:19,090][106226] Updated weights for policy 0, policy_version 842162 (0.0008) [2023-12-28 01:18:19,099][106225] Updated weights for policy 1, policy_version 844165 (0.0009) [2023-12-28 01:18:19,149][106226] Updated weights for policy 0, policy_version 842172 (0.0006) [2023-12-28 01:18:19,155][106225] Updated weights for policy 1, policy_version 844175 (0.0007) [2023-12-28 01:18:19,208][106226] Updated weights for policy 0, policy_version 842182 (0.0007) [2023-12-28 01:18:19,217][106225] Updated weights for policy 1, policy_version 844185 (0.0006) [2023-12-28 01:18:19,936][106226] Updated weights for policy 0, policy_version 842192 (0.0007) [2023-12-28 01:18:19,957][106225] Updated weights for policy 1, policy_version 844195 (0.0009) [2023-12-28 01:18:19,998][106226] Updated weights for policy 0, policy_version 842202 (0.0008) [2023-12-28 01:18:20,019][106225] Updated weights for policy 1, policy_version 844205 (0.0006) [2023-12-28 01:18:20,060][106226] Updated weights for policy 0, policy_version 842212 (0.0009) [2023-12-28 01:18:20,086][106225] Updated weights for policy 1, policy_version 844215 (0.0006) [2023-12-28 01:18:20,778][106225] Updated weights for policy 1, policy_version 844225 (0.0006) [2023-12-28 01:18:20,825][106226] Updated weights for policy 0, policy_version 842222 (0.0008) [2023-12-28 01:18:20,844][106225] Updated weights for policy 1, policy_version 844235 (0.0006) [2023-12-28 01:18:20,887][106226] Updated weights for policy 0, policy_version 842232 (0.0008) [2023-12-28 01:18:20,910][106225] Updated weights for policy 1, policy_version 844245 (0.0006) [2023-12-28 01:18:20,946][106226] Updated weights for policy 0, policy_version 842242 (0.0008) [2023-12-28 01:18:20,976][106225] Updated weights for policy 1, policy_version 844255 (0.0007) [2023-12-28 01:18:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 431841280. Throughput: 0: 9856.5, 1: 10054.6. Samples: 431846796. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:21,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-5.232')] [2023-12-28 01:18:21,710][106226] Updated weights for policy 0, policy_version 842252 (0.0008) [2023-12-28 01:18:21,717][106225] Updated weights for policy 1, policy_version 844265 (0.0008) [2023-12-28 01:18:21,774][106226] Updated weights for policy 0, policy_version 842262 (0.0008) [2023-12-28 01:18:21,776][106225] Updated weights for policy 1, policy_version 844275 (0.0007) [2023-12-28 01:18:21,837][106226] Updated weights for policy 0, policy_version 842272 (0.0007) [2023-12-28 01:18:21,838][106225] Updated weights for policy 1, policy_version 844285 (0.0009) [2023-12-28 01:18:22,517][106225] Updated weights for policy 1, policy_version 844295 (0.0008) [2023-12-28 01:18:22,576][106225] Updated weights for policy 1, policy_version 844305 (0.0009) [2023-12-28 01:18:22,596][106226] Updated weights for policy 0, policy_version 842282 (0.0007) [2023-12-28 01:18:22,637][106225] Updated weights for policy 1, policy_version 844315 (0.0009) [2023-12-28 01:18:22,655][106226] Updated weights for policy 0, policy_version 842292 (0.0007) [2023-12-28 01:18:22,719][106226] Updated weights for policy 0, policy_version 842302 (0.0009) [2023-12-28 01:18:22,784][106226] Updated weights for policy 0, policy_version 842312 (0.0007) [2023-12-28 01:18:23,299][106225] Updated weights for policy 1, policy_version 844325 (0.0005) [2023-12-28 01:18:23,348][106225] Updated weights for policy 1, policy_version 844335 (0.0005) [2023-12-28 01:18:23,409][106225] Updated weights for policy 1, policy_version 844345 (0.0005) [2023-12-28 01:18:23,518][106226] Updated weights for policy 0, policy_version 842322 (0.0009) [2023-12-28 01:18:23,574][106226] Updated weights for policy 0, policy_version 842332 (0.0008) [2023-12-28 01:18:23,633][106226] Updated weights for policy 0, policy_version 842342 (0.0010) [2023-12-28 01:18:23,962][106225] Updated weights for policy 1, policy_version 844355 (0.0006) [2023-12-28 01:18:24,020][106225] Updated weights for policy 1, policy_version 844365 (0.0008) [2023-12-28 01:18:24,066][106225] Updated weights for policy 1, policy_version 844375 (0.0008) [2023-12-28 01:18:24,349][106226] Updated weights for policy 0, policy_version 842352 (0.0008) [2023-12-28 01:18:24,398][106226] Updated weights for policy 0, policy_version 842362 (0.0008) [2023-12-28 01:18:24,447][106226] Updated weights for policy 0, policy_version 842372 (0.0008) [2023-12-28 01:18:24,799][106225] Updated weights for policy 1, policy_version 844385 (0.0008) [2023-12-28 01:18:24,864][106225] Updated weights for policy 1, policy_version 844395 (0.0005) [2023-12-28 01:18:24,932][106225] Updated weights for policy 1, policy_version 844405 (0.0005) [2023-12-28 01:18:24,995][106225] Updated weights for policy 1, policy_version 844415 (0.0007) [2023-12-28 01:18:25,216][106226] Updated weights for policy 0, policy_version 842382 (0.0008) [2023-12-28 01:18:25,264][106226] Updated weights for policy 0, policy_version 842392 (0.0008) [2023-12-28 01:18:25,308][106226] Updated weights for policy 0, policy_version 842402 (0.0008) [2023-12-28 01:18:25,562][106225] Updated weights for policy 1, policy_version 844425 (0.0007) [2023-12-28 01:18:25,619][106225] Updated weights for policy 1, policy_version 844435 (0.0009) [2023-12-28 01:18:25,673][106225] Updated weights for policy 1, policy_version 844445 (0.0008) [2023-12-28 01:18:26,002][106226] Updated weights for policy 0, policy_version 842412 (0.0008) [2023-12-28 01:18:26,056][106226] Updated weights for policy 0, policy_version 842422 (0.0008) [2023-12-28 01:18:26,109][106226] Updated weights for policy 0, policy_version 842432 (0.0009) [2023-12-28 01:18:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 431939584. Throughput: 0: 9816.2, 1: 10030.4. Samples: 431904948. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:26,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.936')] [2023-12-28 01:18:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000842440_215719936.pth... [2023-12-28 01:18:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000844448_216219648.pth... [2023-12-28 01:18:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000843296_215924736.pth [2023-12-28 01:18:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000841288_215425024.pth [2023-12-28 01:18:26,356][106225] Updated weights for policy 1, policy_version 844455 (0.0009) [2023-12-28 01:18:26,415][106225] Updated weights for policy 1, policy_version 844465 (0.0008) [2023-12-28 01:18:26,475][106225] Updated weights for policy 1, policy_version 844475 (0.0008) [2023-12-28 01:18:26,814][106226] Updated weights for policy 0, policy_version 842442 (0.0007) [2023-12-28 01:18:26,862][106226] Updated weights for policy 0, policy_version 842452 (0.0005) [2023-12-28 01:18:26,909][106226] Updated weights for policy 0, policy_version 842462 (0.0005) [2023-12-28 01:18:26,954][106226] Updated weights for policy 0, policy_version 842472 (0.0005) [2023-12-28 01:18:27,206][106225] Updated weights for policy 1, policy_version 844485 (0.0009) [2023-12-28 01:18:27,263][106225] Updated weights for policy 1, policy_version 844495 (0.0007) [2023-12-28 01:18:27,313][106225] Updated weights for policy 1, policy_version 844505 (0.0008) [2023-12-28 01:18:27,635][106226] Updated weights for policy 0, policy_version 842482 (0.0007) [2023-12-28 01:18:27,689][106226] Updated weights for policy 0, policy_version 842492 (0.0007) [2023-12-28 01:18:27,744][106226] Updated weights for policy 0, policy_version 842502 (0.0008) [2023-12-28 01:18:28,047][106225] Updated weights for policy 1, policy_version 844515 (0.0009) [2023-12-28 01:18:28,094][106225] Updated weights for policy 1, policy_version 844525 (0.0008) [2023-12-28 01:18:28,138][106225] Updated weights for policy 1, policy_version 844535 (0.0009) [2023-12-28 01:18:28,451][106226] Updated weights for policy 0, policy_version 842512 (0.0008) [2023-12-28 01:18:28,511][106226] Updated weights for policy 0, policy_version 842522 (0.0009) [2023-12-28 01:18:28,570][106226] Updated weights for policy 0, policy_version 842532 (0.0008) [2023-12-28 01:18:28,861][106225] Updated weights for policy 1, policy_version 844545 (0.0008) [2023-12-28 01:18:28,910][106225] Updated weights for policy 1, policy_version 844555 (0.0005) [2023-12-28 01:18:28,963][106225] Updated weights for policy 1, policy_version 844565 (0.0005) [2023-12-28 01:18:29,009][106225] Updated weights for policy 1, policy_version 844575 (0.0005) [2023-12-28 01:18:29,329][106226] Updated weights for policy 0, policy_version 842542 (0.0009) [2023-12-28 01:18:29,398][106226] Updated weights for policy 0, policy_version 842552 (0.0009) [2023-12-28 01:18:29,462][106226] Updated weights for policy 0, policy_version 842562 (0.0009) [2023-12-28 01:18:29,670][106225] Updated weights for policy 1, policy_version 844585 (0.0005) [2023-12-28 01:18:29,716][106225] Updated weights for policy 1, policy_version 844595 (0.0007) [2023-12-28 01:18:29,762][106225] Updated weights for policy 1, policy_version 844605 (0.0008) [2023-12-28 01:18:30,216][106226] Updated weights for policy 0, policy_version 842572 (0.0009) [2023-12-28 01:18:30,272][106226] Updated weights for policy 0, policy_version 842582 (0.0009) [2023-12-28 01:18:30,337][106226] Updated weights for policy 0, policy_version 842592 (0.0009) [2023-12-28 01:18:30,384][106225] Updated weights for policy 1, policy_version 844615 (0.0007) [2023-12-28 01:18:30,444][106225] Updated weights for policy 1, policy_version 844625 (0.0005) [2023-12-28 01:18:30,503][106225] Updated weights for policy 1, policy_version 844635 (0.0007) [2023-12-28 01:18:31,056][106226] Updated weights for policy 0, policy_version 842602 (0.0008) [2023-12-28 01:18:31,117][106226] Updated weights for policy 0, policy_version 842612 (0.0008) [2023-12-28 01:18:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 432029696. Throughput: 0: 9832.9, 1: 10103.5. Samples: 432024656. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:31,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-5.113')] [2023-12-28 01:18:31,186][106226] Updated weights for policy 0, policy_version 842622 (0.0007) [2023-12-28 01:18:31,201][106225] Updated weights for policy 1, policy_version 844645 (0.0007) [2023-12-28 01:18:31,247][106226] Updated weights for policy 0, policy_version 842632 (0.0007) [2023-12-28 01:18:31,257][106225] Updated weights for policy 1, policy_version 844655 (0.0008) [2023-12-28 01:18:31,324][106225] Updated weights for policy 1, policy_version 844665 (0.0009) [2023-12-28 01:18:31,951][106226] Updated weights for policy 0, policy_version 842642 (0.0007) [2023-12-28 01:18:32,010][106226] Updated weights for policy 0, policy_version 842652 (0.0006) [2023-12-28 01:18:32,077][106226] Updated weights for policy 0, policy_version 842662 (0.0006) [2023-12-28 01:18:32,095][106225] Updated weights for policy 1, policy_version 844675 (0.0008) [2023-12-28 01:18:32,151][106225] Updated weights for policy 1, policy_version 844685 (0.0005) [2023-12-28 01:18:32,219][106225] Updated weights for policy 1, policy_version 844695 (0.0006) [2023-12-28 01:18:32,761][106226] Updated weights for policy 0, policy_version 842672 (0.0006) [2023-12-28 01:18:32,830][106226] Updated weights for policy 0, policy_version 842682 (0.0006) [2023-12-28 01:18:32,836][106225] Updated weights for policy 1, policy_version 844705 (0.0007) [2023-12-28 01:18:32,886][106225] Updated weights for policy 1, policy_version 844715 (0.0010) [2023-12-28 01:18:32,895][106226] Updated weights for policy 0, policy_version 842692 (0.0006) [2023-12-28 01:18:32,933][106225] Updated weights for policy 1, policy_version 844725 (0.0010) [2023-12-28 01:18:32,979][106225] Updated weights for policy 1, policy_version 844735 (0.0010) [2023-12-28 01:18:33,535][106226] Updated weights for policy 0, policy_version 842702 (0.0007) [2023-12-28 01:18:33,584][106226] Updated weights for policy 0, policy_version 842712 (0.0006) [2023-12-28 01:18:33,650][106226] Updated weights for policy 0, policy_version 842722 (0.0005) [2023-12-28 01:18:33,655][106225] Updated weights for policy 1, policy_version 844745 (0.0006) [2023-12-28 01:18:33,714][106225] Updated weights for policy 1, policy_version 844755 (0.0006) [2023-12-28 01:18:33,773][106225] Updated weights for policy 1, policy_version 844765 (0.0005) [2023-12-28 01:18:34,308][106225] Updated weights for policy 1, policy_version 844775 (0.0009) [2023-12-28 01:18:34,356][106226] Updated weights for policy 0, policy_version 842732 (0.0008) [2023-12-28 01:18:34,372][106225] Updated weights for policy 1, policy_version 844785 (0.0010) [2023-12-28 01:18:34,416][106226] Updated weights for policy 0, policy_version 842742 (0.0010) [2023-12-28 01:18:34,434][106225] Updated weights for policy 1, policy_version 844795 (0.0010) [2023-12-28 01:18:34,478][106226] Updated weights for policy 0, policy_version 842752 (0.0011) [2023-12-28 01:18:35,163][106226] Updated weights for policy 0, policy_version 842762 (0.0009) [2023-12-28 01:18:35,195][106225] Updated weights for policy 1, policy_version 844805 (0.0010) [2023-12-28 01:18:35,225][106226] Updated weights for policy 0, policy_version 842772 (0.0007) [2023-12-28 01:18:35,255][106225] Updated weights for policy 1, policy_version 844815 (0.0010) [2023-12-28 01:18:35,273][106226] Updated weights for policy 0, policy_version 842782 (0.0006) [2023-12-28 01:18:35,308][106225] Updated weights for policy 1, policy_version 844825 (0.0010) [2023-12-28 01:18:35,325][106226] Updated weights for policy 0, policy_version 842792 (0.0005) [2023-12-28 01:18:35,984][106226] Updated weights for policy 0, policy_version 842802 (0.0010) [2023-12-28 01:18:35,995][106225] Updated weights for policy 1, policy_version 844835 (0.0009) [2023-12-28 01:18:36,052][106226] Updated weights for policy 0, policy_version 842812 (0.0007) [2023-12-28 01:18:36,060][106225] Updated weights for policy 1, policy_version 844845 (0.0005) [2023-12-28 01:18:36,116][106225] Updated weights for policy 1, policy_version 844855 (0.0006) [2023-12-28 01:18:36,123][106226] Updated weights for policy 0, policy_version 842823 (0.0008) [2023-12-28 01:18:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 432144384. Throughput: 0: 9833.9, 1: 10121.0. Samples: 432145888. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:36,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-4.980')] [2023-12-28 01:18:36,843][106225] Updated weights for policy 1, policy_version 844865 (0.0008) [2023-12-28 01:18:36,857][106226] Updated weights for policy 0, policy_version 842833 (0.0009) [2023-12-28 01:18:36,898][106225] Updated weights for policy 1, policy_version 844875 (0.0010) [2023-12-28 01:18:36,915][106226] Updated weights for policy 0, policy_version 842843 (0.0006) [2023-12-28 01:18:36,949][106225] Updated weights for policy 1, policy_version 844885 (0.0010) [2023-12-28 01:18:36,970][106226] Updated weights for policy 0, policy_version 842853 (0.0005) [2023-12-28 01:18:37,012][106225] Updated weights for policy 1, policy_version 844895 (0.0010) [2023-12-28 01:18:37,590][106225] Updated weights for policy 1, policy_version 844905 (0.0007) [2023-12-28 01:18:37,616][106226] Updated weights for policy 0, policy_version 842863 (0.0006) [2023-12-28 01:18:37,648][106225] Updated weights for policy 1, policy_version 844915 (0.0011) [2023-12-28 01:18:37,674][106226] Updated weights for policy 0, policy_version 842873 (0.0009) [2023-12-28 01:18:37,701][106225] Updated weights for policy 1, policy_version 844925 (0.0010) [2023-12-28 01:18:37,732][106226] Updated weights for policy 0, policy_version 842883 (0.0008) [2023-12-28 01:18:38,411][106225] Updated weights for policy 1, policy_version 844935 (0.0009) [2023-12-28 01:18:38,430][106226] Updated weights for policy 0, policy_version 842893 (0.0009) [2023-12-28 01:18:38,471][106225] Updated weights for policy 1, policy_version 844945 (0.0006) [2023-12-28 01:18:38,488][106226] Updated weights for policy 0, policy_version 842903 (0.0011) [2023-12-28 01:18:38,530][106225] Updated weights for policy 1, policy_version 844955 (0.0008) [2023-12-28 01:18:38,544][106226] Updated weights for policy 0, policy_version 842913 (0.0008) [2023-12-28 01:18:39,240][106225] Updated weights for policy 1, policy_version 844965 (0.0010) [2023-12-28 01:18:39,243][106226] Updated weights for policy 0, policy_version 842923 (0.0009) [2023-12-28 01:18:39,304][106225] Updated weights for policy 1, policy_version 844975 (0.0010) [2023-12-28 01:18:39,308][106226] Updated weights for policy 0, policy_version 842933 (0.0010) [2023-12-28 01:18:39,372][106226] Updated weights for policy 0, policy_version 842943 (0.0009) [2023-12-28 01:18:39,388][106225] Updated weights for policy 1, policy_version 844985 (0.0009) [2023-12-28 01:18:40,080][106226] Updated weights for policy 0, policy_version 842953 (0.0009) [2023-12-28 01:18:40,101][106225] Updated weights for policy 1, policy_version 844995 (0.0008) [2023-12-28 01:18:40,141][106226] Updated weights for policy 0, policy_version 842963 (0.0008) [2023-12-28 01:18:40,155][106225] Updated weights for policy 1, policy_version 845005 (0.0007) [2023-12-28 01:18:40,199][106226] Updated weights for policy 0, policy_version 842973 (0.0008) [2023-12-28 01:18:40,208][106225] Updated weights for policy 1, policy_version 845015 (0.0006) [2023-12-28 01:18:40,254][106226] Updated weights for policy 0, policy_version 842983 (0.0008) [2023-12-28 01:18:40,853][106225] Updated weights for policy 1, policy_version 845025 (0.0007) [2023-12-28 01:18:40,922][106225] Updated weights for policy 1, policy_version 845035 (0.0006) [2023-12-28 01:18:40,982][106225] Updated weights for policy 1, policy_version 845045 (0.0006) [2023-12-28 01:18:40,996][106226] Updated weights for policy 0, policy_version 842993 (0.0006) [2023-12-28 01:18:41,042][106225] Updated weights for policy 1, policy_version 845055 (0.0006) [2023-12-28 01:18:41,064][106226] Updated weights for policy 0, policy_version 843003 (0.0009) [2023-12-28 01:18:41,132][106226] Updated weights for policy 0, policy_version 843013 (0.0010) [2023-12-28 01:18:41,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 432242688. Throughput: 0: 9859.5, 1: 10189.6. Samples: 432206616. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:41,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-5.355')] [2023-12-28 01:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000843016_215867392.pth... [2023-12-28 01:18:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000845056_216375296.pth... [2023-12-28 01:18:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000841864_215572480.pth [2023-12-28 01:18:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000843872_216072192.pth [2023-12-28 01:18:41,845][106225] Updated weights for policy 1, policy_version 845065 (0.0008) [2023-12-28 01:18:41,868][106226] Updated weights for policy 0, policy_version 843023 (0.0006) [2023-12-28 01:18:41,905][106225] Updated weights for policy 1, policy_version 845075 (0.0008) [2023-12-28 01:18:41,934][106226] Updated weights for policy 0, policy_version 843033 (0.0007) [2023-12-28 01:18:41,968][106225] Updated weights for policy 1, policy_version 845085 (0.0006) [2023-12-28 01:18:41,995][106226] Updated weights for policy 0, policy_version 843043 (0.0007) [2023-12-28 01:18:42,642][106225] Updated weights for policy 1, policy_version 845095 (0.0007) [2023-12-28 01:18:42,701][106225] Updated weights for policy 1, policy_version 845105 (0.0007) [2023-12-28 01:18:42,742][106226] Updated weights for policy 0, policy_version 843053 (0.0010) [2023-12-28 01:18:42,756][106225] Updated weights for policy 1, policy_version 845115 (0.0009) [2023-12-28 01:18:42,800][106226] Updated weights for policy 0, policy_version 843063 (0.0010) [2023-12-28 01:18:42,869][106226] Updated weights for policy 0, policy_version 843073 (0.0006) [2023-12-28 01:18:43,462][106226] Updated weights for policy 0, policy_version 843083 (0.0006) [2023-12-28 01:18:43,485][106225] Updated weights for policy 1, policy_version 845125 (0.0010) [2023-12-28 01:18:43,525][106226] Updated weights for policy 0, policy_version 843093 (0.0006) [2023-12-28 01:18:43,541][106225] Updated weights for policy 1, policy_version 845135 (0.0010) [2023-12-28 01:18:43,592][106226] Updated weights for policy 0, policy_version 843103 (0.0005) [2023-12-28 01:18:43,595][106225] Updated weights for policy 1, policy_version 845145 (0.0010) [2023-12-28 01:18:44,152][106226] Updated weights for policy 0, policy_version 843113 (0.0005) [2023-12-28 01:18:44,211][106226] Updated weights for policy 0, policy_version 843123 (0.0005) [2023-12-28 01:18:44,272][106226] Updated weights for policy 0, policy_version 843133 (0.0005) [2023-12-28 01:18:44,308][106225] Updated weights for policy 1, policy_version 845155 (0.0010) [2023-12-28 01:18:44,328][106226] Updated weights for policy 0, policy_version 843143 (0.0005) [2023-12-28 01:18:44,359][106225] Updated weights for policy 1, policy_version 845165 (0.0010) [2023-12-28 01:18:44,409][106225] Updated weights for policy 1, policy_version 845175 (0.0010) [2023-12-28 01:18:44,949][106226] Updated weights for policy 0, policy_version 843153 (0.0008) [2023-12-28 01:18:45,013][106226] Updated weights for policy 0, policy_version 843163 (0.0008) [2023-12-28 01:18:45,084][106226] Updated weights for policy 0, policy_version 843173 (0.0008) [2023-12-28 01:18:45,159][106225] Updated weights for policy 1, policy_version 845185 (0.0010) [2023-12-28 01:18:45,224][106225] Updated weights for policy 1, policy_version 845195 (0.0011) [2023-12-28 01:18:45,287][106225] Updated weights for policy 1, policy_version 845205 (0.0010) [2023-12-28 01:18:45,350][106225] Updated weights for policy 1, policy_version 845215 (0.0008) [2023-12-28 01:18:45,808][106226] Updated weights for policy 0, policy_version 843183 (0.0008) [2023-12-28 01:18:45,862][106226] Updated weights for policy 0, policy_version 843193 (0.0008) [2023-12-28 01:18:45,923][106226] Updated weights for policy 0, policy_version 843203 (0.0008) [2023-12-28 01:18:46,050][106225] Updated weights for policy 1, policy_version 845225 (0.0010) [2023-12-28 01:18:46,116][106225] Updated weights for policy 1, policy_version 845235 (0.0008) [2023-12-28 01:18:46,171][106225] Updated weights for policy 1, policy_version 845245 (0.0006) [2023-12-28 01:18:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19934.0, 300 sec: 19938.5). Total num frames: 432332800. Throughput: 0: 9877.1, 1: 10073.9. Samples: 432325512. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:46,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.971')] [2023-12-28 01:18:46,688][106226] Updated weights for policy 0, policy_version 843213 (0.0007) [2023-12-28 01:18:46,745][106226] Updated weights for policy 0, policy_version 843223 (0.0009) [2023-12-28 01:18:46,806][106226] Updated weights for policy 0, policy_version 843233 (0.0008) [2023-12-28 01:18:46,827][106225] Updated weights for policy 1, policy_version 845255 (0.0008) [2023-12-28 01:18:46,892][106225] Updated weights for policy 1, policy_version 845265 (0.0008) [2023-12-28 01:18:46,946][106225] Updated weights for policy 1, policy_version 845275 (0.0005) [2023-12-28 01:18:47,444][106226] Updated weights for policy 0, policy_version 843243 (0.0006) [2023-12-28 01:18:47,495][106226] Updated weights for policy 0, policy_version 843253 (0.0005) [2023-12-28 01:18:47,550][106226] Updated weights for policy 0, policy_version 843263 (0.0005) [2023-12-28 01:18:47,612][106225] Updated weights for policy 1, policy_version 845285 (0.0005) [2023-12-28 01:18:47,675][106225] Updated weights for policy 1, policy_version 845295 (0.0007) [2023-12-28 01:18:47,741][106225] Updated weights for policy 1, policy_version 845305 (0.0008) [2023-12-28 01:18:48,120][106226] Updated weights for policy 0, policy_version 843273 (0.0005) [2023-12-28 01:18:48,172][106226] Updated weights for policy 0, policy_version 843283 (0.0008) [2023-12-28 01:18:48,222][106226] Updated weights for policy 0, policy_version 843293 (0.0008) [2023-12-28 01:18:48,286][106226] Updated weights for policy 0, policy_version 843303 (0.0008) [2023-12-28 01:18:48,425][106225] Updated weights for policy 1, policy_version 845315 (0.0010) [2023-12-28 01:18:48,491][106225] Updated weights for policy 1, policy_version 845325 (0.0006) [2023-12-28 01:18:48,558][106225] Updated weights for policy 1, policy_version 845335 (0.0009) [2023-12-28 01:18:49,074][106226] Updated weights for policy 0, policy_version 843313 (0.0009) [2023-12-28 01:18:49,133][106226] Updated weights for policy 0, policy_version 843323 (0.0008) [2023-12-28 01:18:49,193][106226] Updated weights for policy 0, policy_version 843333 (0.0009) [2023-12-28 01:18:49,252][106225] Updated weights for policy 1, policy_version 845345 (0.0008) [2023-12-28 01:18:49,308][106225] Updated weights for policy 1, policy_version 845355 (0.0008) [2023-12-28 01:18:49,364][106225] Updated weights for policy 1, policy_version 845365 (0.0008) [2023-12-28 01:18:49,421][106225] Updated weights for policy 1, policy_version 845375 (0.0008) [2023-12-28 01:18:49,965][106226] Updated weights for policy 0, policy_version 843343 (0.0009) [2023-12-28 01:18:50,027][106226] Updated weights for policy 0, policy_version 843353 (0.0008) [2023-12-28 01:18:50,089][106226] Updated weights for policy 0, policy_version 843363 (0.0008) [2023-12-28 01:18:50,273][106225] Updated weights for policy 1, policy_version 845385 (0.0009) [2023-12-28 01:18:50,329][106225] Updated weights for policy 1, policy_version 845395 (0.0009) [2023-12-28 01:18:50,388][106225] Updated weights for policy 1, policy_version 845405 (0.0008) [2023-12-28 01:18:50,821][106226] Updated weights for policy 0, policy_version 843373 (0.0009) [2023-12-28 01:18:50,875][106226] Updated weights for policy 0, policy_version 843383 (0.0008) [2023-12-28 01:18:50,935][106226] Updated weights for policy 0, policy_version 843393 (0.0009) [2023-12-28 01:18:51,145][106225] Updated weights for policy 1, policy_version 845415 (0.0008) [2023-12-28 01:18:51,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 432431104. Throughput: 0: 9744.2, 1: 9996.3. Samples: 432441128. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:51,175][105115] Avg episode reward: [(0, '-4.219'), (1, '-5.187')] [2023-12-28 01:18:51,215][106225] Updated weights for policy 1, policy_version 845425 (0.0008) [2023-12-28 01:18:51,283][106225] Updated weights for policy 1, policy_version 845435 (0.0008) [2023-12-28 01:18:51,730][106226] Updated weights for policy 0, policy_version 843403 (0.0008) [2023-12-28 01:18:51,790][106226] Updated weights for policy 0, policy_version 843413 (0.0008) [2023-12-28 01:18:51,841][106226] Updated weights for policy 0, policy_version 843423 (0.0008) [2023-12-28 01:18:52,046][106225] Updated weights for policy 1, policy_version 845445 (0.0008) [2023-12-28 01:18:52,106][106225] Updated weights for policy 1, policy_version 845455 (0.0008) [2023-12-28 01:18:52,169][106225] Updated weights for policy 1, policy_version 845465 (0.0008) [2023-12-28 01:18:52,642][106226] Updated weights for policy 0, policy_version 843433 (0.0009) [2023-12-28 01:18:52,708][106226] Updated weights for policy 0, policy_version 843443 (0.0010) [2023-12-28 01:18:52,775][106226] Updated weights for policy 0, policy_version 843453 (0.0010) [2023-12-28 01:18:52,826][106225] Updated weights for policy 1, policy_version 845475 (0.0006) [2023-12-28 01:18:52,839][106226] Updated weights for policy 0, policy_version 843463 (0.0009) [2023-12-28 01:18:52,890][106225] Updated weights for policy 1, policy_version 845485 (0.0010) [2023-12-28 01:18:52,948][106225] Updated weights for policy 1, policy_version 845495 (0.0009) [2023-12-28 01:18:53,506][106226] Updated weights for policy 0, policy_version 843473 (0.0006) [2023-12-28 01:18:53,562][106226] Updated weights for policy 0, policy_version 843483 (0.0005) [2023-12-28 01:18:53,618][106226] Updated weights for policy 0, policy_version 843493 (0.0006) [2023-12-28 01:18:53,632][106225] Updated weights for policy 1, policy_version 845505 (0.0010) [2023-12-28 01:18:53,690][106225] Updated weights for policy 1, policy_version 845515 (0.0006) [2023-12-28 01:18:53,742][106225] Updated weights for policy 1, policy_version 845525 (0.0007) [2023-12-28 01:18:53,805][106225] Updated weights for policy 1, policy_version 845535 (0.0008) [2023-12-28 01:18:54,245][106226] Updated weights for policy 0, policy_version 843503 (0.0007) [2023-12-28 01:18:54,310][106226] Updated weights for policy 0, policy_version 843513 (0.0006) [2023-12-28 01:18:54,378][106226] Updated weights for policy 0, policy_version 843523 (0.0006) [2023-12-28 01:18:54,539][106225] Updated weights for policy 1, policy_version 845545 (0.0008) [2023-12-28 01:18:54,608][106225] Updated weights for policy 1, policy_version 845555 (0.0006) [2023-12-28 01:18:54,674][106225] Updated weights for policy 1, policy_version 845565 (0.0005) [2023-12-28 01:18:54,902][106226] Updated weights for policy 0, policy_version 843533 (0.0005) [2023-12-28 01:18:54,957][106226] Updated weights for policy 0, policy_version 843543 (0.0005) [2023-12-28 01:18:55,021][106226] Updated weights for policy 0, policy_version 843553 (0.0007) [2023-12-28 01:18:55,199][106225] Updated weights for policy 1, policy_version 845575 (0.0005) [2023-12-28 01:18:55,265][106225] Updated weights for policy 1, policy_version 845585 (0.0005) [2023-12-28 01:18:55,311][106225] Updated weights for policy 1, policy_version 845595 (0.0005) [2023-12-28 01:18:55,674][106226] Updated weights for policy 0, policy_version 843563 (0.0009) [2023-12-28 01:18:55,740][106226] Updated weights for policy 0, policy_version 843573 (0.0005) [2023-12-28 01:18:55,802][106226] Updated weights for policy 0, policy_version 843583 (0.0006) [2023-12-28 01:18:55,939][106225] Updated weights for policy 1, policy_version 845605 (0.0005) [2023-12-28 01:18:56,001][106225] Updated weights for policy 1, policy_version 845615 (0.0005) [2023-12-28 01:18:56,063][106225] Updated weights for policy 1, policy_version 845625 (0.0005) [2023-12-28 01:18:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 432537600. Throughput: 0: 9740.1, 1: 9950.8. Samples: 432499416. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:18:56,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-5.070')] [2023-12-28 01:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000843592_216014848.pth... [2023-12-28 01:18:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000845632_216522752.pth... [2023-12-28 01:18:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000842440_215719936.pth [2023-12-28 01:18:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000844448_216219648.pth [2023-12-28 01:18:56,408][106226] Updated weights for policy 0, policy_version 843593 (0.0010) [2023-12-28 01:18:56,465][106226] Updated weights for policy 0, policy_version 843603 (0.0005) [2023-12-28 01:18:56,520][106226] Updated weights for policy 0, policy_version 843613 (0.0005) [2023-12-28 01:18:56,565][106226] Updated weights for policy 0, policy_version 843623 (0.0005) [2023-12-28 01:18:56,706][106225] Updated weights for policy 1, policy_version 845635 (0.0006) [2023-12-28 01:18:56,768][106225] Updated weights for policy 1, policy_version 845645 (0.0010) [2023-12-28 01:18:56,823][106225] Updated weights for policy 1, policy_version 845655 (0.0010) [2023-12-28 01:18:57,199][106226] Updated weights for policy 0, policy_version 843633 (0.0008) [2023-12-28 01:18:57,258][106226] Updated weights for policy 0, policy_version 843643 (0.0010) [2023-12-28 01:18:57,319][106226] Updated weights for policy 0, policy_version 843653 (0.0009) [2023-12-28 01:18:57,514][106225] Updated weights for policy 1, policy_version 845665 (0.0010) [2023-12-28 01:18:57,559][106225] Updated weights for policy 1, policy_version 845675 (0.0010) [2023-12-28 01:18:57,603][106225] Updated weights for policy 1, policy_version 845685 (0.0007) [2023-12-28 01:18:57,646][106225] Updated weights for policy 1, policy_version 845695 (0.0005) [2023-12-28 01:18:57,970][106226] Updated weights for policy 0, policy_version 843663 (0.0009) [2023-12-28 01:18:58,033][106226] Updated weights for policy 0, policy_version 843673 (0.0009) [2023-12-28 01:18:58,089][106226] Updated weights for policy 0, policy_version 843683 (0.0007) [2023-12-28 01:18:58,263][106225] Updated weights for policy 1, policy_version 845705 (0.0010) [2023-12-28 01:18:58,330][106225] Updated weights for policy 1, policy_version 845715 (0.0010) [2023-12-28 01:18:58,398][106225] Updated weights for policy 1, policy_version 845725 (0.0009) [2023-12-28 01:18:58,900][106226] Updated weights for policy 0, policy_version 843693 (0.0007) [2023-12-28 01:18:58,962][106226] Updated weights for policy 0, policy_version 843703 (0.0007) [2023-12-28 01:18:59,031][106226] Updated weights for policy 0, policy_version 843713 (0.0007) [2023-12-28 01:18:59,242][106225] Updated weights for policy 1, policy_version 845735 (0.0010) [2023-12-28 01:18:59,311][106225] Updated weights for policy 1, policy_version 845745 (0.0009) [2023-12-28 01:18:59,375][106225] Updated weights for policy 1, policy_version 845755 (0.0008) [2023-12-28 01:18:59,777][106226] Updated weights for policy 0, policy_version 843723 (0.0008) [2023-12-28 01:18:59,839][106226] Updated weights for policy 0, policy_version 843733 (0.0008) [2023-12-28 01:18:59,900][106226] Updated weights for policy 0, policy_version 843743 (0.0008) [2023-12-28 01:19:00,097][106225] Updated weights for policy 1, policy_version 845765 (0.0007) [2023-12-28 01:19:00,146][106225] Updated weights for policy 1, policy_version 845775 (0.0007) [2023-12-28 01:19:00,194][106225] Updated weights for policy 1, policy_version 845785 (0.0008) [2023-12-28 01:19:00,618][106226] Updated weights for policy 0, policy_version 843753 (0.0008) [2023-12-28 01:19:00,680][106226] Updated weights for policy 0, policy_version 843763 (0.0006) [2023-12-28 01:19:00,732][106226] Updated weights for policy 0, policy_version 843773 (0.0005) [2023-12-28 01:19:00,773][106225] Updated weights for policy 1, policy_version 845795 (0.0008) [2023-12-28 01:19:00,787][106226] Updated weights for policy 0, policy_version 843783 (0.0006) [2023-12-28 01:19:00,820][106225] Updated weights for policy 1, policy_version 845805 (0.0009) [2023-12-28 01:19:00,880][106225] Updated weights for policy 1, policy_version 845815 (0.0009) [2023-12-28 01:19:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 432635904. Throughput: 0: 9803.2, 1: 10023.8. Samples: 432622644. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:01,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-5.233')] [2023-12-28 01:19:01,418][106226] Updated weights for policy 0, policy_version 843793 (0.0010) [2023-12-28 01:19:01,471][106226] Updated weights for policy 0, policy_version 843803 (0.0010) [2023-12-28 01:19:01,535][106226] Updated weights for policy 0, policy_version 843813 (0.0010) [2023-12-28 01:19:01,744][106225] Updated weights for policy 1, policy_version 845825 (0.0010) [2023-12-28 01:19:01,808][106225] Updated weights for policy 1, policy_version 845835 (0.0007) [2023-12-28 01:19:01,856][106225] Updated weights for policy 1, policy_version 845845 (0.0008) [2023-12-28 01:19:01,904][106225] Updated weights for policy 1, policy_version 845855 (0.0008) [2023-12-28 01:19:02,280][106226] Updated weights for policy 0, policy_version 843823 (0.0010) [2023-12-28 01:19:02,337][106226] Updated weights for policy 0, policy_version 843833 (0.0008) [2023-12-28 01:19:02,406][106226] Updated weights for policy 0, policy_version 843843 (0.0006) [2023-12-28 01:19:02,617][106225] Updated weights for policy 1, policy_version 845865 (0.0008) [2023-12-28 01:19:02,679][106225] Updated weights for policy 1, policy_version 845875 (0.0008) [2023-12-28 01:19:02,742][106225] Updated weights for policy 1, policy_version 845885 (0.0008) [2023-12-28 01:19:03,014][106226] Updated weights for policy 0, policy_version 843853 (0.0005) [2023-12-28 01:19:03,079][106226] Updated weights for policy 0, policy_version 843863 (0.0009) [2023-12-28 01:19:03,130][106226] Updated weights for policy 0, policy_version 843873 (0.0006) [2023-12-28 01:19:03,443][106225] Updated weights for policy 1, policy_version 845895 (0.0006) [2023-12-28 01:19:03,487][106225] Updated weights for policy 1, policy_version 845905 (0.0005) [2023-12-28 01:19:03,541][106225] Updated weights for policy 1, policy_version 845915 (0.0005) [2023-12-28 01:19:03,711][106226] Updated weights for policy 0, policy_version 843883 (0.0007) [2023-12-28 01:19:03,779][106226] Updated weights for policy 0, policy_version 843893 (0.0005) [2023-12-28 01:19:03,839][106226] Updated weights for policy 0, policy_version 843903 (0.0006) [2023-12-28 01:19:04,165][106225] Updated weights for policy 1, policy_version 845925 (0.0007) [2023-12-28 01:19:04,225][106225] Updated weights for policy 1, policy_version 845935 (0.0008) [2023-12-28 01:19:04,280][106225] Updated weights for policy 1, policy_version 845945 (0.0008) [2023-12-28 01:19:04,485][106226] Updated weights for policy 0, policy_version 843913 (0.0009) [2023-12-28 01:19:04,539][106226] Updated weights for policy 0, policy_version 843923 (0.0011) [2023-12-28 01:19:04,591][106226] Updated weights for policy 0, policy_version 843933 (0.0006) [2023-12-28 01:19:04,644][106226] Updated weights for policy 0, policy_version 843943 (0.0005) [2023-12-28 01:19:05,042][106225] Updated weights for policy 1, policy_version 845955 (0.0008) [2023-12-28 01:19:05,107][106225] Updated weights for policy 1, policy_version 845965 (0.0009) [2023-12-28 01:19:05,169][106225] Updated weights for policy 1, policy_version 845975 (0.0005) [2023-12-28 01:19:05,295][106226] Updated weights for policy 0, policy_version 843953 (0.0009) [2023-12-28 01:19:05,356][106226] Updated weights for policy 0, policy_version 843963 (0.0006) [2023-12-28 01:19:05,415][106226] Updated weights for policy 0, policy_version 843973 (0.0006) [2023-12-28 01:19:05,902][106225] Updated weights for policy 1, policy_version 845985 (0.0007) [2023-12-28 01:19:05,953][106225] Updated weights for policy 1, policy_version 845995 (0.0006) [2023-12-28 01:19:06,006][106225] Updated weights for policy 1, policy_version 846005 (0.0005) [2023-12-28 01:19:06,022][106226] Updated weights for policy 0, policy_version 843983 (0.0009) [2023-12-28 01:19:06,058][106225] Updated weights for policy 1, policy_version 846015 (0.0005) [2023-12-28 01:19:06,076][106226] Updated weights for policy 0, policy_version 843993 (0.0010) [2023-12-28 01:19:06,142][106226] Updated weights for policy 0, policy_version 844003 (0.0010) [2023-12-28 01:19:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 432742400. Throughput: 0: 9965.8, 1: 9994.1. Samples: 432744988. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:06,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.731')] [2023-12-28 01:19:06,783][106225] Updated weights for policy 1, policy_version 846025 (0.0010) [2023-12-28 01:19:06,844][106225] Updated weights for policy 1, policy_version 846035 (0.0006) [2023-12-28 01:19:06,863][106226] Updated weights for policy 0, policy_version 844013 (0.0008) [2023-12-28 01:19:06,897][106225] Updated weights for policy 1, policy_version 846045 (0.0008) [2023-12-28 01:19:06,926][106226] Updated weights for policy 0, policy_version 844023 (0.0006) [2023-12-28 01:19:06,985][106226] Updated weights for policy 0, policy_version 844033 (0.0005) [2023-12-28 01:19:07,527][106226] Updated weights for policy 0, policy_version 844043 (0.0005) [2023-12-28 01:19:07,540][106225] Updated weights for policy 1, policy_version 846055 (0.0009) [2023-12-28 01:19:07,580][106226] Updated weights for policy 0, policy_version 844053 (0.0005) [2023-12-28 01:19:07,598][106225] Updated weights for policy 1, policy_version 846065 (0.0010) [2023-12-28 01:19:07,629][106226] Updated weights for policy 0, policy_version 844063 (0.0006) [2023-12-28 01:19:07,658][106225] Updated weights for policy 1, policy_version 846075 (0.0010) [2023-12-28 01:19:08,245][106226] Updated weights for policy 0, policy_version 844073 (0.0010) [2023-12-28 01:19:08,307][106226] Updated weights for policy 0, policy_version 844083 (0.0006) [2023-12-28 01:19:08,345][106225] Updated weights for policy 1, policy_version 846085 (0.0009) [2023-12-28 01:19:08,374][106226] Updated weights for policy 0, policy_version 844093 (0.0006) [2023-12-28 01:19:08,409][106225] Updated weights for policy 1, policy_version 846095 (0.0007) [2023-12-28 01:19:08,441][106226] Updated weights for policy 0, policy_version 844103 (0.0006) [2023-12-28 01:19:08,464][106225] Updated weights for policy 1, policy_version 846105 (0.0008) [2023-12-28 01:19:09,050][106226] Updated weights for policy 0, policy_version 844113 (0.0010) [2023-12-28 01:19:09,107][106226] Updated weights for policy 0, policy_version 844123 (0.0010) [2023-12-28 01:19:09,139][106225] Updated weights for policy 1, policy_version 846115 (0.0010) [2023-12-28 01:19:09,169][106226] Updated weights for policy 0, policy_version 844133 (0.0008) [2023-12-28 01:19:09,191][106225] Updated weights for policy 1, policy_version 846125 (0.0008) [2023-12-28 01:19:09,259][106225] Updated weights for policy 1, policy_version 846135 (0.0008) [2023-12-28 01:19:09,925][106226] Updated weights for policy 0, policy_version 844143 (0.0007) [2023-12-28 01:19:09,992][106226] Updated weights for policy 0, policy_version 844153 (0.0009) [2023-12-28 01:19:10,012][106225] Updated weights for policy 1, policy_version 846145 (0.0008) [2023-12-28 01:19:10,056][106226] Updated weights for policy 0, policy_version 844163 (0.0008) [2023-12-28 01:19:10,074][106225] Updated weights for policy 1, policy_version 846155 (0.0007) [2023-12-28 01:19:10,136][106225] Updated weights for policy 1, policy_version 846165 (0.0008) [2023-12-28 01:19:10,203][106225] Updated weights for policy 1, policy_version 846175 (0.0009) [2023-12-28 01:19:10,806][106226] Updated weights for policy 0, policy_version 844173 (0.0007) [2023-12-28 01:19:10,886][106226] Updated weights for policy 0, policy_version 844183 (0.0007) [2023-12-28 01:19:10,888][106225] Updated weights for policy 1, policy_version 846185 (0.0010) [2023-12-28 01:19:10,940][106226] Updated weights for policy 0, policy_version 844193 (0.0006) [2023-12-28 01:19:10,949][106225] Updated weights for policy 1, policy_version 846195 (0.0010) [2023-12-28 01:19:10,999][106225] Updated weights for policy 1, policy_version 846205 (0.0010) [2023-12-28 01:19:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 432840704. Throughput: 0: 10078.4, 1: 9975.7. Samples: 432807384. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:11,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-5.111')] [2023-12-28 01:19:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000846208_216670208.pth... [2023-12-28 01:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000844200_216170496.pth... [2023-12-28 01:19:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000845056_216375296.pth [2023-12-28 01:19:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000843016_215867392.pth [2023-12-28 01:19:11,748][106226] Updated weights for policy 0, policy_version 844203 (0.0006) [2023-12-28 01:19:11,771][106225] Updated weights for policy 1, policy_version 846215 (0.0008) [2023-12-28 01:19:11,805][106226] Updated weights for policy 0, policy_version 844213 (0.0008) [2023-12-28 01:19:11,835][106225] Updated weights for policy 1, policy_version 846225 (0.0006) [2023-12-28 01:19:11,864][106226] Updated weights for policy 0, policy_version 844223 (0.0008) [2023-12-28 01:19:11,895][106225] Updated weights for policy 1, policy_version 846235 (0.0008) [2023-12-28 01:19:12,612][106226] Updated weights for policy 0, policy_version 844233 (0.0007) [2023-12-28 01:19:12,649][106225] Updated weights for policy 1, policy_version 846245 (0.0007) [2023-12-28 01:19:12,678][106226] Updated weights for policy 0, policy_version 844243 (0.0006) [2023-12-28 01:19:12,708][106225] Updated weights for policy 1, policy_version 846255 (0.0007) [2023-12-28 01:19:12,739][106226] Updated weights for policy 0, policy_version 844253 (0.0007) [2023-12-28 01:19:12,771][106225] Updated weights for policy 1, policy_version 846265 (0.0007) [2023-12-28 01:19:12,802][106226] Updated weights for policy 0, policy_version 844263 (0.0008) [2023-12-28 01:19:13,466][106225] Updated weights for policy 1, policy_version 846275 (0.0009) [2023-12-28 01:19:13,521][106225] Updated weights for policy 1, policy_version 846285 (0.0008) [2023-12-28 01:19:13,523][106226] Updated weights for policy 0, policy_version 844273 (0.0007) [2023-12-28 01:19:13,575][106225] Updated weights for policy 1, policy_version 846295 (0.0006) [2023-12-28 01:19:13,585][106226] Updated weights for policy 0, policy_version 844283 (0.0008) [2023-12-28 01:19:13,636][106226] Updated weights for policy 0, policy_version 844293 (0.0010) [2023-12-28 01:19:14,158][106225] Updated weights for policy 1, policy_version 846305 (0.0006) [2023-12-28 01:19:14,218][106225] Updated weights for policy 1, policy_version 846315 (0.0008) [2023-12-28 01:19:14,282][106225] Updated weights for policy 1, policy_version 846325 (0.0008) [2023-12-28 01:19:14,338][106226] Updated weights for policy 0, policy_version 844303 (0.0010) [2023-12-28 01:19:14,340][106225] Updated weights for policy 1, policy_version 846335 (0.0006) [2023-12-28 01:19:14,395][106226] Updated weights for policy 0, policy_version 844313 (0.0010) [2023-12-28 01:19:14,452][106226] Updated weights for policy 0, policy_version 844323 (0.0009) [2023-12-28 01:19:15,072][106225] Updated weights for policy 1, policy_version 846345 (0.0008) [2023-12-28 01:19:15,164][106225] Updated weights for policy 1, policy_version 846355 (0.0008) [2023-12-28 01:19:15,170][106226] Updated weights for policy 0, policy_version 844333 (0.0006) [2023-12-28 01:19:15,231][106225] Updated weights for policy 1, policy_version 846365 (0.0007) [2023-12-28 01:19:15,233][106226] Updated weights for policy 0, policy_version 844343 (0.0008) [2023-12-28 01:19:15,297][106226] Updated weights for policy 0, policy_version 844353 (0.0011) [2023-12-28 01:19:15,862][106226] Updated weights for policy 0, policy_version 844363 (0.0009) [2023-12-28 01:19:15,866][106225] Updated weights for policy 1, policy_version 846375 (0.0007) [2023-12-28 01:19:15,913][106225] Updated weights for policy 1, policy_version 846385 (0.0007) [2023-12-28 01:19:15,924][106226] Updated weights for policy 0, policy_version 844373 (0.0006) [2023-12-28 01:19:15,969][106225] Updated weights for policy 1, policy_version 846395 (0.0008) [2023-12-28 01:19:15,985][106226] Updated weights for policy 0, policy_version 844383 (0.0007) [2023-12-28 01:19:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 432939008. Throughput: 0: 10013.3, 1: 9930.7. Samples: 432922136. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:16,176][105115] Avg episode reward: [(0, '-4.345'), (1, '-5.228')] [2023-12-28 01:19:16,597][106225] Updated weights for policy 1, policy_version 846405 (0.0007) [2023-12-28 01:19:16,634][106226] Updated weights for policy 0, policy_version 844393 (0.0006) [2023-12-28 01:19:16,657][106225] Updated weights for policy 1, policy_version 846415 (0.0006) [2023-12-28 01:19:16,694][106226] Updated weights for policy 0, policy_version 844403 (0.0007) [2023-12-28 01:19:16,707][106225] Updated weights for policy 1, policy_version 846425 (0.0007) [2023-12-28 01:19:16,760][106226] Updated weights for policy 0, policy_version 844413 (0.0006) [2023-12-28 01:19:16,821][106226] Updated weights for policy 0, policy_version 844423 (0.0006) [2023-12-28 01:19:17,338][106225] Updated weights for policy 1, policy_version 846435 (0.0007) [2023-12-28 01:19:17,383][106226] Updated weights for policy 0, policy_version 844433 (0.0005) [2023-12-28 01:19:17,398][106225] Updated weights for policy 1, policy_version 846445 (0.0006) [2023-12-28 01:19:17,435][106226] Updated weights for policy 0, policy_version 844443 (0.0006) [2023-12-28 01:19:17,460][106225] Updated weights for policy 1, policy_version 846455 (0.0008) [2023-12-28 01:19:17,489][106226] Updated weights for policy 0, policy_version 844453 (0.0006) [2023-12-28 01:19:18,015][106226] Updated weights for policy 0, policy_version 844463 (0.0008) [2023-12-28 01:19:18,076][106226] Updated weights for policy 0, policy_version 844473 (0.0009) [2023-12-28 01:19:18,126][106226] Updated weights for policy 0, policy_version 844483 (0.0010) [2023-12-28 01:19:18,211][106225] Updated weights for policy 1, policy_version 846465 (0.0008) [2023-12-28 01:19:18,270][106225] Updated weights for policy 1, policy_version 846475 (0.0006) [2023-12-28 01:19:18,347][106225] Updated weights for policy 1, policy_version 846485 (0.0006) [2023-12-28 01:19:18,413][106225] Updated weights for policy 1, policy_version 846495 (0.0007) [2023-12-28 01:19:18,896][106226] Updated weights for policy 0, policy_version 844493 (0.0010) [2023-12-28 01:19:18,953][106226] Updated weights for policy 0, policy_version 844503 (0.0011) [2023-12-28 01:19:19,001][106225] Updated weights for policy 1, policy_version 846505 (0.0007) [2023-12-28 01:19:19,019][106226] Updated weights for policy 0, policy_version 844513 (0.0011) [2023-12-28 01:19:19,061][106225] Updated weights for policy 1, policy_version 846515 (0.0008) [2023-12-28 01:19:19,125][106225] Updated weights for policy 1, policy_version 846525 (0.0005) [2023-12-28 01:19:19,873][106225] Updated weights for policy 1, policy_version 846535 (0.0007) [2023-12-28 01:19:19,875][106226] Updated weights for policy 0, policy_version 844523 (0.0011) [2023-12-28 01:19:19,937][106225] Updated weights for policy 1, policy_version 846545 (0.0007) [2023-12-28 01:19:19,938][106226] Updated weights for policy 0, policy_version 844533 (0.0011) [2023-12-28 01:19:20,000][106225] Updated weights for policy 1, policy_version 846555 (0.0008) [2023-12-28 01:19:20,002][106226] Updated weights for policy 0, policy_version 844543 (0.0011) [2023-12-28 01:19:20,714][106225] Updated weights for policy 1, policy_version 846565 (0.0007) [2023-12-28 01:19:20,766][106226] Updated weights for policy 0, policy_version 844553 (0.0011) [2023-12-28 01:19:20,778][106225] Updated weights for policy 1, policy_version 846575 (0.0007) [2023-12-28 01:19:20,825][106226] Updated weights for policy 0, policy_version 844563 (0.0011) [2023-12-28 01:19:20,842][106225] Updated weights for policy 1, policy_version 846585 (0.0008) [2023-12-28 01:19:20,878][106226] Updated weights for policy 0, policy_version 844573 (0.0010) [2023-12-28 01:19:20,932][106226] Updated weights for policy 0, policy_version 844583 (0.0012) [2023-12-28 01:19:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19994.0). Total num frames: 433037312. Throughput: 0: 10055.2, 1: 9901.6. Samples: 433043944. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:21,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-5.043')] [2023-12-28 01:19:21,574][106225] Updated weights for policy 1, policy_version 846595 (0.0006) [2023-12-28 01:19:21,635][106225] Updated weights for policy 1, policy_version 846605 (0.0006) [2023-12-28 01:19:21,698][106225] Updated weights for policy 1, policy_version 846615 (0.0008) [2023-12-28 01:19:21,713][106226] Updated weights for policy 0, policy_version 844593 (0.0009) [2023-12-28 01:19:21,780][106226] Updated weights for policy 0, policy_version 844603 (0.0008) [2023-12-28 01:19:21,844][106226] Updated weights for policy 0, policy_version 844613 (0.0009) [2023-12-28 01:19:22,474][106225] Updated weights for policy 1, policy_version 846625 (0.0008) [2023-12-28 01:19:22,539][106225] Updated weights for policy 1, policy_version 846635 (0.0011) [2023-12-28 01:19:22,568][106226] Updated weights for policy 0, policy_version 844623 (0.0006) [2023-12-28 01:19:22,597][106225] Updated weights for policy 1, policy_version 846645 (0.0010) [2023-12-28 01:19:22,631][106226] Updated weights for policy 0, policy_version 844633 (0.0008) [2023-12-28 01:19:22,659][106225] Updated weights for policy 1, policy_version 846655 (0.0010) [2023-12-28 01:19:22,689][106226] Updated weights for policy 0, policy_version 844643 (0.0009) [2023-12-28 01:19:23,300][106225] Updated weights for policy 1, policy_version 846665 (0.0007) [2023-12-28 01:19:23,365][106225] Updated weights for policy 1, policy_version 846675 (0.0008) [2023-12-28 01:19:23,390][106226] Updated weights for policy 0, policy_version 844653 (0.0007) [2023-12-28 01:19:23,419][106225] Updated weights for policy 1, policy_version 846685 (0.0005) [2023-12-28 01:19:23,455][106226] Updated weights for policy 0, policy_version 844663 (0.0007) [2023-12-28 01:19:23,520][106226] Updated weights for policy 0, policy_version 844673 (0.0011) [2023-12-28 01:19:23,929][106225] Updated weights for policy 1, policy_version 846695 (0.0006) [2023-12-28 01:19:23,986][106225] Updated weights for policy 1, policy_version 846705 (0.0008) [2023-12-28 01:19:24,033][106225] Updated weights for policy 1, policy_version 846715 (0.0006) [2023-12-28 01:19:24,163][106226] Updated weights for policy 0, policy_version 844683 (0.0009) [2023-12-28 01:19:24,223][106226] Updated weights for policy 0, policy_version 844693 (0.0006) [2023-12-28 01:19:24,287][106226] Updated weights for policy 0, policy_version 844703 (0.0011) [2023-12-28 01:19:24,787][106225] Updated weights for policy 1, policy_version 846725 (0.0006) [2023-12-28 01:19:24,840][106225] Updated weights for policy 1, policy_version 846735 (0.0005) [2023-12-28 01:19:24,871][106226] Updated weights for policy 0, policy_version 844713 (0.0011) [2023-12-28 01:19:24,893][106225] Updated weights for policy 1, policy_version 846745 (0.0007) [2023-12-28 01:19:24,925][106226] Updated weights for policy 0, policy_version 844723 (0.0010) [2023-12-28 01:19:24,984][106226] Updated weights for policy 0, policy_version 844733 (0.0010) [2023-12-28 01:19:25,045][106226] Updated weights for policy 0, policy_version 844743 (0.0006) [2023-12-28 01:19:25,571][106225] Updated weights for policy 1, policy_version 846755 (0.0006) [2023-12-28 01:19:25,627][106225] Updated weights for policy 1, policy_version 846765 (0.0007) [2023-12-28 01:19:25,675][106225] Updated weights for policy 1, policy_version 846775 (0.0007) [2023-12-28 01:19:25,724][106226] Updated weights for policy 0, policy_version 844753 (0.0010) [2023-12-28 01:19:25,773][106226] Updated weights for policy 0, policy_version 844763 (0.0010) [2023-12-28 01:19:25,836][106226] Updated weights for policy 0, policy_version 844773 (0.0010) [2023-12-28 01:19:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 433135616. Throughput: 0: 10033.5, 1: 9896.1. Samples: 433103452. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:26,176][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.912')] [2023-12-28 01:19:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000846784_216817664.pth... [2023-12-28 01:19:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000844776_216317952.pth... [2023-12-28 01:19:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000845632_216522752.pth [2023-12-28 01:19:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000843592_216014848.pth [2023-12-28 01:19:26,367][106225] Updated weights for policy 1, policy_version 846785 (0.0006) [2023-12-28 01:19:26,412][106225] Updated weights for policy 1, policy_version 846795 (0.0008) [2023-12-28 01:19:26,473][106225] Updated weights for policy 1, policy_version 846805 (0.0008) [2023-12-28 01:19:26,537][106225] Updated weights for policy 1, policy_version 846815 (0.0007) [2023-12-28 01:19:26,557][106226] Updated weights for policy 0, policy_version 844783 (0.0010) [2023-12-28 01:19:26,606][106226] Updated weights for policy 0, policy_version 844793 (0.0010) [2023-12-28 01:19:26,658][106226] Updated weights for policy 0, policy_version 844803 (0.0010) [2023-12-28 01:19:27,262][106225] Updated weights for policy 1, policy_version 846825 (0.0007) [2023-12-28 01:19:27,321][106225] Updated weights for policy 1, policy_version 846835 (0.0008) [2023-12-28 01:19:27,355][106226] Updated weights for policy 0, policy_version 844813 (0.0009) [2023-12-28 01:19:27,375][106225] Updated weights for policy 1, policy_version 846845 (0.0009) [2023-12-28 01:19:27,410][106226] Updated weights for policy 0, policy_version 844823 (0.0010) [2023-12-28 01:19:27,470][106226] Updated weights for policy 0, policy_version 844833 (0.0010) [2023-12-28 01:19:28,051][106225] Updated weights for policy 1, policy_version 846855 (0.0006) [2023-12-28 01:19:28,064][106226] Updated weights for policy 0, policy_version 844843 (0.0010) [2023-12-28 01:19:28,114][106226] Updated weights for policy 0, policy_version 844853 (0.0010) [2023-12-28 01:19:28,114][106225] Updated weights for policy 1, policy_version 846865 (0.0006) [2023-12-28 01:19:28,160][106226] Updated weights for policy 0, policy_version 844863 (0.0010) [2023-12-28 01:19:28,171][106225] Updated weights for policy 1, policy_version 846875 (0.0007) [2023-12-28 01:19:28,778][106225] Updated weights for policy 1, policy_version 846885 (0.0005) [2023-12-28 01:19:28,831][106225] Updated weights for policy 1, policy_version 846895 (0.0005) [2023-12-28 01:19:28,882][106225] Updated weights for policy 1, policy_version 846905 (0.0005) [2023-12-28 01:19:28,887][106226] Updated weights for policy 0, policy_version 844873 (0.0010) [2023-12-28 01:19:28,942][106226] Updated weights for policy 0, policy_version 844883 (0.0011) [2023-12-28 01:19:28,997][106226] Updated weights for policy 0, policy_version 844893 (0.0010) [2023-12-28 01:19:29,054][106226] Updated weights for policy 0, policy_version 844903 (0.0011) [2023-12-28 01:19:29,487][106225] Updated weights for policy 1, policy_version 846915 (0.0006) [2023-12-28 01:19:29,541][106225] Updated weights for policy 1, policy_version 846925 (0.0008) [2023-12-28 01:19:29,593][106225] Updated weights for policy 1, policy_version 846935 (0.0008) [2023-12-28 01:19:29,839][106226] Updated weights for policy 0, policy_version 844913 (0.0011) [2023-12-28 01:19:29,900][106226] Updated weights for policy 0, policy_version 844923 (0.0011) [2023-12-28 01:19:29,971][106226] Updated weights for policy 0, policy_version 844933 (0.0008) [2023-12-28 01:19:30,355][106225] Updated weights for policy 1, policy_version 846945 (0.0007) [2023-12-28 01:19:30,418][106225] Updated weights for policy 1, policy_version 846955 (0.0005) [2023-12-28 01:19:30,477][106225] Updated weights for policy 1, policy_version 846965 (0.0005) [2023-12-28 01:19:30,528][106225] Updated weights for policy 1, policy_version 846975 (0.0006) [2023-12-28 01:19:30,673][106226] Updated weights for policy 0, policy_version 844943 (0.0010) [2023-12-28 01:19:30,725][106226] Updated weights for policy 0, policy_version 844953 (0.0010) [2023-12-28 01:19:30,777][106226] Updated weights for policy 0, policy_version 844963 (0.0010) [2023-12-28 01:19:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 433233920. Throughput: 0: 10040.3, 1: 9974.7. Samples: 433226184. Policy #0 lag: (min: 31.0, avg: 46.4, max: 63.0) [2023-12-28 01:19:31,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.117')] [2023-12-28 01:19:31,186][106225] Updated weights for policy 1, policy_version 846985 (0.0008) [2023-12-28 01:19:31,254][106225] Updated weights for policy 1, policy_version 846995 (0.0009) [2023-12-28 01:19:31,314][106225] Updated weights for policy 1, policy_version 847005 (0.0009) [2023-12-28 01:19:31,507][106226] Updated weights for policy 0, policy_version 844973 (0.0008) [2023-12-28 01:19:31,567][106226] Updated weights for policy 0, policy_version 844983 (0.0006) [2023-12-28 01:19:31,636][106226] Updated weights for policy 0, policy_version 844993 (0.0009) [2023-12-28 01:19:32,041][106225] Updated weights for policy 1, policy_version 847015 (0.0009) [2023-12-28 01:19:32,094][106225] Updated weights for policy 1, policy_version 847025 (0.0010) [2023-12-28 01:19:32,155][106225] Updated weights for policy 1, policy_version 847035 (0.0010) [2023-12-28 01:19:32,330][106226] Updated weights for policy 0, policy_version 845003 (0.0007) [2023-12-28 01:19:32,398][106226] Updated weights for policy 0, policy_version 845013 (0.0008) [2023-12-28 01:19:32,456][106226] Updated weights for policy 0, policy_version 845023 (0.0008) [2023-12-28 01:19:32,922][106225] Updated weights for policy 1, policy_version 847045 (0.0010) [2023-12-28 01:19:32,973][106225] Updated weights for policy 1, policy_version 847055 (0.0010) [2023-12-28 01:19:33,022][106225] Updated weights for policy 1, policy_version 847065 (0.0010) [2023-12-28 01:19:33,035][106226] Updated weights for policy 0, policy_version 845033 (0.0008) [2023-12-28 01:19:33,088][106226] Updated weights for policy 0, policy_version 845043 (0.0007) [2023-12-28 01:19:33,140][106226] Updated weights for policy 0, policy_version 845053 (0.0008) [2023-12-28 01:19:33,203][106226] Updated weights for policy 0, policy_version 845063 (0.0007) [2023-12-28 01:19:33,571][106225] Updated weights for policy 1, policy_version 847075 (0.0009) [2023-12-28 01:19:33,618][106225] Updated weights for policy 1, policy_version 847085 (0.0006) [2023-12-28 01:19:33,668][106225] Updated weights for policy 1, policy_version 847095 (0.0010) [2023-12-28 01:19:33,786][106226] Updated weights for policy 0, policy_version 845073 (0.0005) [2023-12-28 01:19:33,846][106226] Updated weights for policy 0, policy_version 845083 (0.0005) [2023-12-28 01:19:33,894][106226] Updated weights for policy 0, policy_version 845093 (0.0005) [2023-12-28 01:19:34,362][106225] Updated weights for policy 1, policy_version 847105 (0.0010) [2023-12-28 01:19:34,428][106225] Updated weights for policy 1, policy_version 847115 (0.0008) [2023-12-28 01:19:34,491][106225] Updated weights for policy 1, policy_version 847125 (0.0009) [2023-12-28 01:19:34,524][106226] Updated weights for policy 0, policy_version 845103 (0.0009) [2023-12-28 01:19:34,548][106225] Updated weights for policy 1, policy_version 847135 (0.0010) [2023-12-28 01:19:34,573][106226] Updated weights for policy 0, policy_version 845113 (0.0010) [2023-12-28 01:19:34,634][106226] Updated weights for policy 0, policy_version 845123 (0.0011) [2023-12-28 01:19:35,302][106225] Updated weights for policy 1, policy_version 847145 (0.0006) [2023-12-28 01:19:35,350][106225] Updated weights for policy 1, policy_version 847155 (0.0007) [2023-12-28 01:19:35,377][106226] Updated weights for policy 0, policy_version 845133 (0.0011) [2023-12-28 01:19:35,399][106225] Updated weights for policy 1, policy_version 847165 (0.0007) [2023-12-28 01:19:35,435][106226] Updated weights for policy 0, policy_version 845143 (0.0011) [2023-12-28 01:19:35,492][106226] Updated weights for policy 0, policy_version 845153 (0.0011) [2023-12-28 01:19:36,123][106226] Updated weights for policy 0, policy_version 845163 (0.0010) [2023-12-28 01:19:36,164][106225] Updated weights for policy 1, policy_version 847175 (0.0008) [2023-12-28 01:19:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19966.3). Total num frames: 433332224. Throughput: 0: 10147.4, 1: 10026.2. Samples: 433348936. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:19:36,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.062')] [2023-12-28 01:19:36,190][106226] Updated weights for policy 0, policy_version 845173 (0.0008) [2023-12-28 01:19:36,227][106225] Updated weights for policy 1, policy_version 847185 (0.0007) [2023-12-28 01:19:36,251][106226] Updated weights for policy 0, policy_version 845183 (0.0009) [2023-12-28 01:19:36,288][106225] Updated weights for policy 1, policy_version 847195 (0.0006) [2023-12-28 01:19:36,876][106226] Updated weights for policy 0, policy_version 845193 (0.0010) [2023-12-28 01:19:36,940][106226] Updated weights for policy 0, policy_version 845203 (0.0006) [2023-12-28 01:19:36,970][106225] Updated weights for policy 1, policy_version 847205 (0.0006) [2023-12-28 01:19:37,008][106226] Updated weights for policy 0, policy_version 845213 (0.0006) [2023-12-28 01:19:37,030][106225] Updated weights for policy 1, policy_version 847215 (0.0006) [2023-12-28 01:19:37,069][106226] Updated weights for policy 0, policy_version 845223 (0.0006) [2023-12-28 01:19:37,088][106225] Updated weights for policy 1, policy_version 847225 (0.0007) [2023-12-28 01:19:37,686][106225] Updated weights for policy 1, policy_version 847235 (0.0007) [2023-12-28 01:19:37,693][106226] Updated weights for policy 0, policy_version 845233 (0.0010) [2023-12-28 01:19:37,741][106225] Updated weights for policy 1, policy_version 847245 (0.0006) [2023-12-28 01:19:37,755][106226] Updated weights for policy 0, policy_version 845243 (0.0011) [2023-12-28 01:19:37,794][106225] Updated weights for policy 1, policy_version 847255 (0.0006) [2023-12-28 01:19:37,818][106226] Updated weights for policy 0, policy_version 845253 (0.0011) [2023-12-28 01:19:38,344][106225] Updated weights for policy 1, policy_version 847265 (0.0006) [2023-12-28 01:19:38,407][106225] Updated weights for policy 1, policy_version 847275 (0.0007) [2023-12-28 01:19:38,470][106225] Updated weights for policy 1, policy_version 847285 (0.0006) [2023-12-28 01:19:38,533][106225] Updated weights for policy 1, policy_version 847295 (0.0010) [2023-12-28 01:19:38,545][106226] Updated weights for policy 0, policy_version 845263 (0.0011) [2023-12-28 01:19:38,596][106226] Updated weights for policy 0, policy_version 845273 (0.0009) [2023-12-28 01:19:38,650][106226] Updated weights for policy 0, policy_version 845283 (0.0009) [2023-12-28 01:19:39,232][106225] Updated weights for policy 1, policy_version 847305 (0.0010) [2023-12-28 01:19:39,292][106225] Updated weights for policy 1, policy_version 847315 (0.0008) [2023-12-28 01:19:39,343][106225] Updated weights for policy 1, policy_version 847325 (0.0009) [2023-12-28 01:19:39,371][106226] Updated weights for policy 0, policy_version 845293 (0.0009) [2023-12-28 01:19:39,439][106226] Updated weights for policy 0, policy_version 845303 (0.0008) [2023-12-28 01:19:39,506][106226] Updated weights for policy 0, policy_version 845313 (0.0009) [2023-12-28 01:19:40,162][106225] Updated weights for policy 1, policy_version 847335 (0.0010) [2023-12-28 01:19:40,197][106226] Updated weights for policy 0, policy_version 845323 (0.0008) [2023-12-28 01:19:40,229][106225] Updated weights for policy 1, policy_version 847345 (0.0009) [2023-12-28 01:19:40,260][106226] Updated weights for policy 0, policy_version 845333 (0.0007) [2023-12-28 01:19:40,290][106225] Updated weights for policy 1, policy_version 847355 (0.0010) [2023-12-28 01:19:40,329][106226] Updated weights for policy 0, policy_version 845343 (0.0006) [2023-12-28 01:19:40,924][106225] Updated weights for policy 1, policy_version 847365 (0.0011) [2023-12-28 01:19:40,977][106225] Updated weights for policy 1, policy_version 847375 (0.0010) [2023-12-28 01:19:40,998][106226] Updated weights for policy 0, policy_version 845353 (0.0007) [2023-12-28 01:19:41,046][106225] Updated weights for policy 1, policy_version 847385 (0.0010) [2023-12-28 01:19:41,064][106226] Updated weights for policy 0, policy_version 845363 (0.0007) [2023-12-28 01:19:41,137][106226] Updated weights for policy 0, policy_version 845373 (0.0007) [2023-12-28 01:19:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19994.0). Total num frames: 433438720. Throughput: 0: 10174.0, 1: 10077.8. Samples: 433410744. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:19:41,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.110')] [2023-12-28 01:19:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000847392_216973312.pth... [2023-12-28 01:19:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000846208_216670208.pth [2023-12-28 01:19:41,200][106226] Updated weights for policy 0, policy_version 845383 (0.0007) [2023-12-28 01:19:41,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000845384_216473600.pth... [2023-12-28 01:19:41,209][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000844200_216170496.pth [2023-12-28 01:19:41,751][106225] Updated weights for policy 1, policy_version 847395 (0.0008) [2023-12-28 01:19:41,823][106225] Updated weights for policy 1, policy_version 847405 (0.0007) [2023-12-28 01:19:41,887][106225] Updated weights for policy 1, policy_version 847415 (0.0008) [2023-12-28 01:19:41,961][106226] Updated weights for policy 0, policy_version 845393 (0.0007) [2023-12-28 01:19:42,012][106226] Updated weights for policy 0, policy_version 845403 (0.0008) [2023-12-28 01:19:42,065][106226] Updated weights for policy 0, policy_version 845413 (0.0008) [2023-12-28 01:19:42,575][106225] Updated weights for policy 1, policy_version 847425 (0.0007) [2023-12-28 01:19:42,634][106225] Updated weights for policy 1, policy_version 847435 (0.0009) [2023-12-28 01:19:42,690][106225] Updated weights for policy 1, policy_version 847445 (0.0008) [2023-12-28 01:19:42,750][106225] Updated weights for policy 1, policy_version 847455 (0.0008) [2023-12-28 01:19:42,793][106226] Updated weights for policy 0, policy_version 845423 (0.0007) [2023-12-28 01:19:42,853][106226] Updated weights for policy 0, policy_version 845433 (0.0009) [2023-12-28 01:19:42,915][106226] Updated weights for policy 0, policy_version 845443 (0.0008) [2023-12-28 01:19:43,485][106225] Updated weights for policy 1, policy_version 847465 (0.0006) [2023-12-28 01:19:43,539][106225] Updated weights for policy 1, policy_version 847475 (0.0006) [2023-12-28 01:19:43,590][106225] Updated weights for policy 1, policy_version 847485 (0.0006) [2023-12-28 01:19:43,644][106226] Updated weights for policy 0, policy_version 845453 (0.0008) [2023-12-28 01:19:43,686][106226] Updated weights for policy 0, policy_version 845463 (0.0008) [2023-12-28 01:19:43,738][106226] Updated weights for policy 0, policy_version 845473 (0.0008) [2023-12-28 01:19:44,151][106225] Updated weights for policy 1, policy_version 847495 (0.0010) [2023-12-28 01:19:44,216][106225] Updated weights for policy 1, policy_version 847505 (0.0009) [2023-12-28 01:19:44,270][106225] Updated weights for policy 1, policy_version 847515 (0.0005) [2023-12-28 01:19:44,574][106226] Updated weights for policy 0, policy_version 845484 (0.0010) [2023-12-28 01:19:44,632][106226] Updated weights for policy 0, policy_version 845494 (0.0008) [2023-12-28 01:19:44,682][106226] Updated weights for policy 0, policy_version 845504 (0.0008) [2023-12-28 01:19:44,863][106225] Updated weights for policy 1, policy_version 847525 (0.0006) [2023-12-28 01:19:44,930][106225] Updated weights for policy 1, policy_version 847535 (0.0007) [2023-12-28 01:19:44,997][106225] Updated weights for policy 1, policy_version 847545 (0.0007) [2023-12-28 01:19:45,542][106226] Updated weights for policy 0, policy_version 845514 (0.0009) [2023-12-28 01:19:45,571][106225] Updated weights for policy 1, policy_version 847555 (0.0006) [2023-12-28 01:19:45,604][106226] Updated weights for policy 0, policy_version 845524 (0.0009) [2023-12-28 01:19:45,629][106225] Updated weights for policy 1, policy_version 847565 (0.0006) [2023-12-28 01:19:45,665][106226] Updated weights for policy 0, policy_version 845534 (0.0008) [2023-12-28 01:19:45,688][106225] Updated weights for policy 1, policy_version 847575 (0.0005) [2023-12-28 01:19:45,711][106226] Updated weights for policy 0, policy_version 845544 (0.0008) [2023-12-28 01:19:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19994.0). Total num frames: 433537024. Throughput: 0: 10036.0, 1: 10084.1. Samples: 433528048. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:19:46,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-5.149')] [2023-12-28 01:19:46,222][106225] Updated weights for policy 1, policy_version 847585 (0.0005) [2023-12-28 01:19:46,293][106225] Updated weights for policy 1, policy_version 847595 (0.0005) [2023-12-28 01:19:46,357][106225] Updated weights for policy 1, policy_version 847605 (0.0006) [2023-12-28 01:19:46,423][106225] Updated weights for policy 1, policy_version 847615 (0.0005) [2023-12-28 01:19:46,495][106226] Updated weights for policy 0, policy_version 845554 (0.0009) [2023-12-28 01:19:46,552][106226] Updated weights for policy 0, policy_version 845564 (0.0007) [2023-12-28 01:19:46,609][106226] Updated weights for policy 0, policy_version 845574 (0.0007) [2023-12-28 01:19:47,027][106225] Updated weights for policy 1, policy_version 847625 (0.0005) [2023-12-28 01:19:47,088][106225] Updated weights for policy 1, policy_version 847635 (0.0005) [2023-12-28 01:19:47,147][106225] Updated weights for policy 1, policy_version 847645 (0.0005) [2023-12-28 01:19:47,368][106226] Updated weights for policy 0, policy_version 845584 (0.0008) [2023-12-28 01:19:47,414][106226] Updated weights for policy 0, policy_version 845594 (0.0007) [2023-12-28 01:19:47,466][106226] Updated weights for policy 0, policy_version 845604 (0.0007) [2023-12-28 01:19:47,794][106225] Updated weights for policy 1, policy_version 847655 (0.0009) [2023-12-28 01:19:47,860][106225] Updated weights for policy 1, policy_version 847665 (0.0010) [2023-12-28 01:19:47,910][106225] Updated weights for policy 1, policy_version 847675 (0.0010) [2023-12-28 01:19:48,208][106226] Updated weights for policy 0, policy_version 845614 (0.0008) [2023-12-28 01:19:48,255][106226] Updated weights for policy 0, policy_version 845624 (0.0007) [2023-12-28 01:19:48,303][106226] Updated weights for policy 0, policy_version 845634 (0.0007) [2023-12-28 01:19:48,612][106225] Updated weights for policy 1, policy_version 847685 (0.0010) [2023-12-28 01:19:48,683][106225] Updated weights for policy 1, policy_version 847695 (0.0010) [2023-12-28 01:19:48,750][106225] Updated weights for policy 1, policy_version 847705 (0.0010) [2023-12-28 01:19:48,993][106226] Updated weights for policy 0, policy_version 845644 (0.0007) [2023-12-28 01:19:49,056][106226] Updated weights for policy 0, policy_version 845654 (0.0006) [2023-12-28 01:19:49,111][106226] Updated weights for policy 0, policy_version 845664 (0.0011) [2023-12-28 01:19:49,452][106225] Updated weights for policy 1, policy_version 847715 (0.0009) [2023-12-28 01:19:49,511][106225] Updated weights for policy 1, policy_version 847725 (0.0006) [2023-12-28 01:19:49,570][106225] Updated weights for policy 1, policy_version 847735 (0.0006) [2023-12-28 01:19:49,801][106226] Updated weights for policy 0, policy_version 845674 (0.0010) [2023-12-28 01:19:49,895][106226] Updated weights for policy 0, policy_version 845684 (0.0010) [2023-12-28 01:19:49,962][106226] Updated weights for policy 0, policy_version 845694 (0.0009) [2023-12-28 01:19:50,034][106226] Updated weights for policy 0, policy_version 845704 (0.0011) [2023-12-28 01:19:50,263][106225] Updated weights for policy 1, policy_version 847745 (0.0007) [2023-12-28 01:19:50,325][106225] Updated weights for policy 1, policy_version 847755 (0.0009) [2023-12-28 01:19:50,387][106225] Updated weights for policy 1, policy_version 847765 (0.0008) [2023-12-28 01:19:50,450][106225] Updated weights for policy 1, policy_version 847775 (0.0008) [2023-12-28 01:19:50,796][106226] Updated weights for policy 0, policy_version 845714 (0.0006) [2023-12-28 01:19:50,860][106226] Updated weights for policy 0, policy_version 845724 (0.0007) [2023-12-28 01:19:50,926][106226] Updated weights for policy 0, policy_version 845734 (0.0008) [2023-12-28 01:19:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19994.1). Total num frames: 433635328. Throughput: 0: 9898.9, 1: 10150.2. Samples: 433647200. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:19:51,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-5.098')] [2023-12-28 01:19:51,222][106225] Updated weights for policy 1, policy_version 847785 (0.0009) [2023-12-28 01:19:51,286][106225] Updated weights for policy 1, policy_version 847795 (0.0008) [2023-12-28 01:19:51,347][106225] Updated weights for policy 1, policy_version 847805 (0.0008) [2023-12-28 01:19:51,668][106226] Updated weights for policy 0, policy_version 845744 (0.0009) [2023-12-28 01:19:51,731][106226] Updated weights for policy 0, policy_version 845754 (0.0010) [2023-12-28 01:19:51,807][106226] Updated weights for policy 0, policy_version 845764 (0.0008) [2023-12-28 01:19:52,056][106225] Updated weights for policy 1, policy_version 847815 (0.0009) [2023-12-28 01:19:52,122][106225] Updated weights for policy 1, policy_version 847825 (0.0009) [2023-12-28 01:19:52,181][106225] Updated weights for policy 1, policy_version 847835 (0.0009) [2023-12-28 01:19:52,475][106226] Updated weights for policy 0, policy_version 845774 (0.0009) [2023-12-28 01:19:52,539][106226] Updated weights for policy 0, policy_version 845784 (0.0009) [2023-12-28 01:19:52,603][106226] Updated weights for policy 0, policy_version 845794 (0.0009) [2023-12-28 01:19:52,963][106225] Updated weights for policy 1, policy_version 847845 (0.0008) [2023-12-28 01:19:53,027][106225] Updated weights for policy 1, policy_version 847855 (0.0008) [2023-12-28 01:19:53,088][106225] Updated weights for policy 1, policy_version 847865 (0.0008) [2023-12-28 01:19:53,292][106226] Updated weights for policy 0, policy_version 845804 (0.0010) [2023-12-28 01:19:53,347][106226] Updated weights for policy 0, policy_version 845814 (0.0008) [2023-12-28 01:19:53,405][106226] Updated weights for policy 0, policy_version 845824 (0.0007) [2023-12-28 01:19:53,860][106225] Updated weights for policy 1, policy_version 847875 (0.0008) [2023-12-28 01:19:53,914][106225] Updated weights for policy 1, policy_version 847885 (0.0008) [2023-12-28 01:19:53,970][106225] Updated weights for policy 1, policy_version 847895 (0.0007) [2023-12-28 01:19:54,020][106226] Updated weights for policy 0, policy_version 845834 (0.0009) [2023-12-28 01:19:54,073][106226] Updated weights for policy 0, policy_version 845844 (0.0009) [2023-12-28 01:19:54,123][106226] Updated weights for policy 0, policy_version 845854 (0.0010) [2023-12-28 01:19:54,176][106226] Updated weights for policy 0, policy_version 845864 (0.0010) [2023-12-28 01:19:54,751][106225] Updated weights for policy 1, policy_version 847905 (0.0009) [2023-12-28 01:19:54,797][106226] Updated weights for policy 0, policy_version 845874 (0.0008) [2023-12-28 01:19:54,816][106225] Updated weights for policy 1, policy_version 847915 (0.0008) [2023-12-28 01:19:54,851][106226] Updated weights for policy 0, policy_version 845884 (0.0006) [2023-12-28 01:19:54,875][106225] Updated weights for policy 1, policy_version 847925 (0.0008) [2023-12-28 01:19:54,898][106226] Updated weights for policy 0, policy_version 845894 (0.0008) [2023-12-28 01:19:54,926][106225] Updated weights for policy 1, policy_version 847935 (0.0006) [2023-12-28 01:19:55,640][106225] Updated weights for policy 1, policy_version 847945 (0.0007) [2023-12-28 01:19:55,664][106226] Updated weights for policy 0, policy_version 845904 (0.0010) [2023-12-28 01:19:55,700][106225] Updated weights for policy 1, policy_version 847955 (0.0005) [2023-12-28 01:19:55,710][106226] Updated weights for policy 0, policy_version 845914 (0.0010) [2023-12-28 01:19:55,755][106225] Updated weights for policy 1, policy_version 847965 (0.0005) [2023-12-28 01:19:55,767][106226] Updated weights for policy 0, policy_version 845924 (0.0011) [2023-12-28 01:19:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 433733632. Throughput: 0: 9838.6, 1: 10110.3. Samples: 433705084. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:19:56,175][105115] Avg episode reward: [(0, '-3.953'), (1, '-4.976')] [2023-12-28 01:19:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000845928_216612864.pth... [2023-12-28 01:19:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000847968_217120768.pth... [2023-12-28 01:19:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000844776_216317952.pth [2023-12-28 01:19:56,187][106140] Saving new best policy, reward=-3.953! [2023-12-28 01:19:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000846784_216817664.pth [2023-12-28 01:19:56,375][106226] Updated weights for policy 0, policy_version 845934 (0.0007) [2023-12-28 01:19:56,437][106226] Updated weights for policy 0, policy_version 845944 (0.0005) [2023-12-28 01:19:56,479][106225] Updated weights for policy 1, policy_version 847975 (0.0009) [2023-12-28 01:19:56,495][106226] Updated weights for policy 0, policy_version 845954 (0.0005) [2023-12-28 01:19:56,540][106225] Updated weights for policy 1, policy_version 847985 (0.0009) [2023-12-28 01:19:56,589][106225] Updated weights for policy 1, policy_version 847995 (0.0008) [2023-12-28 01:19:56,989][106226] Updated weights for policy 0, policy_version 845964 (0.0006) [2023-12-28 01:19:57,043][106226] Updated weights for policy 0, policy_version 845974 (0.0005) [2023-12-28 01:19:57,102][106226] Updated weights for policy 0, policy_version 845984 (0.0005) [2023-12-28 01:19:57,403][106225] Updated weights for policy 1, policy_version 848005 (0.0008) [2023-12-28 01:19:57,455][106225] Updated weights for policy 1, policy_version 848015 (0.0007) [2023-12-28 01:19:57,518][106225] Updated weights for policy 1, policy_version 848025 (0.0007) [2023-12-28 01:19:57,731][106226] Updated weights for policy 0, policy_version 845994 (0.0006) [2023-12-28 01:19:57,777][106226] Updated weights for policy 0, policy_version 846004 (0.0010) [2023-12-28 01:19:57,823][106226] Updated weights for policy 0, policy_version 846014 (0.0010) [2023-12-28 01:19:57,881][106226] Updated weights for policy 0, policy_version 846024 (0.0010) [2023-12-28 01:19:58,246][106225] Updated weights for policy 1, policy_version 848035 (0.0008) [2023-12-28 01:19:58,308][106225] Updated weights for policy 1, policy_version 848045 (0.0008) [2023-12-28 01:19:58,384][106225] Updated weights for policy 1, policy_version 848055 (0.0008) [2023-12-28 01:19:58,667][106226] Updated weights for policy 0, policy_version 846034 (0.0010) [2023-12-28 01:19:58,741][106226] Updated weights for policy 0, policy_version 846044 (0.0007) [2023-12-28 01:19:58,808][106226] Updated weights for policy 0, policy_version 846054 (0.0009) [2023-12-28 01:19:59,185][106225] Updated weights for policy 1, policy_version 848065 (0.0008) [2023-12-28 01:19:59,256][106225] Updated weights for policy 1, policy_version 848075 (0.0008) [2023-12-28 01:19:59,325][106225] Updated weights for policy 1, policy_version 848085 (0.0006) [2023-12-28 01:19:59,393][106225] Updated weights for policy 1, policy_version 848095 (0.0009) [2023-12-28 01:19:59,602][106226] Updated weights for policy 0, policy_version 846064 (0.0006) [2023-12-28 01:19:59,658][106226] Updated weights for policy 0, policy_version 846074 (0.0006) [2023-12-28 01:19:59,717][106226] Updated weights for policy 0, policy_version 846084 (0.0010) [2023-12-28 01:20:00,046][106225] Updated weights for policy 1, policy_version 848105 (0.0008) [2023-12-28 01:20:00,116][106225] Updated weights for policy 1, policy_version 848115 (0.0007) [2023-12-28 01:20:00,180][106225] Updated weights for policy 1, policy_version 848125 (0.0008) [2023-12-28 01:20:00,365][106226] Updated weights for policy 0, policy_version 846094 (0.0009) [2023-12-28 01:20:00,419][106226] Updated weights for policy 0, policy_version 846104 (0.0008) [2023-12-28 01:20:00,477][106226] Updated weights for policy 0, policy_version 846114 (0.0011) [2023-12-28 01:20:00,881][106225] Updated weights for policy 1, policy_version 848135 (0.0007) [2023-12-28 01:20:00,931][106225] Updated weights for policy 1, policy_version 848145 (0.0006) [2023-12-28 01:20:00,977][106225] Updated weights for policy 1, policy_version 848155 (0.0007) [2023-12-28 01:20:01,123][106226] Updated weights for policy 0, policy_version 846124 (0.0011) [2023-12-28 01:20:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 433831936. Throughput: 0: 9973.4, 1: 10021.2. Samples: 433821888. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:01,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.732')] [2023-12-28 01:20:01,185][106226] Updated weights for policy 0, policy_version 846134 (0.0008) [2023-12-28 01:20:01,234][106226] Updated weights for policy 0, policy_version 846144 (0.0009) [2023-12-28 01:20:01,717][106225] Updated weights for policy 1, policy_version 848165 (0.0007) [2023-12-28 01:20:01,779][106225] Updated weights for policy 1, policy_version 848175 (0.0008) [2023-12-28 01:20:01,838][106225] Updated weights for policy 1, policy_version 848185 (0.0007) [2023-12-28 01:20:01,989][106226] Updated weights for policy 0, policy_version 846154 (0.0007) [2023-12-28 01:20:02,051][106226] Updated weights for policy 0, policy_version 846164 (0.0008) [2023-12-28 01:20:02,106][106226] Updated weights for policy 0, policy_version 846174 (0.0008) [2023-12-28 01:20:02,167][106226] Updated weights for policy 0, policy_version 846184 (0.0005) [2023-12-28 01:20:02,617][106225] Updated weights for policy 1, policy_version 848195 (0.0009) [2023-12-28 01:20:02,679][106225] Updated weights for policy 1, policy_version 848205 (0.0008) [2023-12-28 01:20:02,732][106225] Updated weights for policy 1, policy_version 848215 (0.0008) [2023-12-28 01:20:02,863][106226] Updated weights for policy 0, policy_version 846194 (0.0009) [2023-12-28 01:20:02,920][106226] Updated weights for policy 0, policy_version 846204 (0.0009) [2023-12-28 01:20:02,966][106226] Updated weights for policy 0, policy_version 846214 (0.0009) [2023-12-28 01:20:03,367][106225] Updated weights for policy 1, policy_version 848225 (0.0009) [2023-12-28 01:20:03,421][106225] Updated weights for policy 1, policy_version 848235 (0.0008) [2023-12-28 01:20:03,475][106225] Updated weights for policy 1, policy_version 848245 (0.0008) [2023-12-28 01:20:03,518][106225] Updated weights for policy 1, policy_version 848255 (0.0008) [2023-12-28 01:20:03,753][106226] Updated weights for policy 0, policy_version 846224 (0.0008) [2023-12-28 01:20:03,797][106226] Updated weights for policy 0, policy_version 846234 (0.0008) [2023-12-28 01:20:03,848][106226] Updated weights for policy 0, policy_version 846244 (0.0009) [2023-12-28 01:20:04,273][106225] Updated weights for policy 1, policy_version 848265 (0.0009) [2023-12-28 01:20:04,341][106225] Updated weights for policy 1, policy_version 848275 (0.0010) [2023-12-28 01:20:04,401][106225] Updated weights for policy 1, policy_version 848285 (0.0008) [2023-12-28 01:20:04,560][106226] Updated weights for policy 0, policy_version 846254 (0.0009) [2023-12-28 01:20:04,620][106226] Updated weights for policy 0, policy_version 846264 (0.0008) [2023-12-28 01:20:04,683][106226] Updated weights for policy 0, policy_version 846274 (0.0005) [2023-12-28 01:20:05,104][106225] Updated weights for policy 1, policy_version 848295 (0.0008) [2023-12-28 01:20:05,157][106225] Updated weights for policy 1, policy_version 848305 (0.0008) [2023-12-28 01:20:05,206][106225] Updated weights for policy 1, policy_version 848315 (0.0008) [2023-12-28 01:20:05,337][106226] Updated weights for policy 0, policy_version 846284 (0.0007) [2023-12-28 01:20:05,388][106226] Updated weights for policy 0, policy_version 846294 (0.0008) [2023-12-28 01:20:05,451][106226] Updated weights for policy 0, policy_version 846304 (0.0008) [2023-12-28 01:20:05,964][106225] Updated weights for policy 1, policy_version 848325 (0.0008) [2023-12-28 01:20:06,018][106225] Updated weights for policy 1, policy_version 848335 (0.0009) [2023-12-28 01:20:06,067][106225] Updated weights for policy 1, policy_version 848345 (0.0008) [2023-12-28 01:20:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 433930240. Throughput: 0: 9930.5, 1: 9962.1. Samples: 433939108. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:06,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-5.087')] [2023-12-28 01:20:06,215][106226] Updated weights for policy 0, policy_version 846314 (0.0009) [2023-12-28 01:20:06,281][106226] Updated weights for policy 0, policy_version 846324 (0.0008) [2023-12-28 01:20:06,354][106226] Updated weights for policy 0, policy_version 846334 (0.0008) [2023-12-28 01:20:06,424][106226] Updated weights for policy 0, policy_version 846344 (0.0009) [2023-12-28 01:20:06,836][106225] Updated weights for policy 1, policy_version 848355 (0.0009) [2023-12-28 01:20:06,889][106225] Updated weights for policy 1, policy_version 848365 (0.0008) [2023-12-28 01:20:06,943][106225] Updated weights for policy 1, policy_version 848375 (0.0009) [2023-12-28 01:20:07,098][106226] Updated weights for policy 0, policy_version 846354 (0.0008) [2023-12-28 01:20:07,155][106226] Updated weights for policy 0, policy_version 846364 (0.0009) [2023-12-28 01:20:07,214][106226] Updated weights for policy 0, policy_version 846374 (0.0007) [2023-12-28 01:20:07,721][106225] Updated weights for policy 1, policy_version 848385 (0.0009) [2023-12-28 01:20:07,785][106225] Updated weights for policy 1, policy_version 848395 (0.0008) [2023-12-28 01:20:07,847][106225] Updated weights for policy 1, policy_version 848405 (0.0008) [2023-12-28 01:20:07,883][106226] Updated weights for policy 0, policy_version 846384 (0.0008) [2023-12-28 01:20:07,901][106225] Updated weights for policy 1, policy_version 848415 (0.0005) [2023-12-28 01:20:07,941][106226] Updated weights for policy 0, policy_version 846394 (0.0007) [2023-12-28 01:20:07,988][106226] Updated weights for policy 0, policy_version 846404 (0.0005) [2023-12-28 01:20:08,675][106225] Updated weights for policy 1, policy_version 848425 (0.0007) [2023-12-28 01:20:08,681][106226] Updated weights for policy 0, policy_version 846414 (0.0006) [2023-12-28 01:20:08,732][106225] Updated weights for policy 1, policy_version 848435 (0.0008) [2023-12-28 01:20:08,734][106226] Updated weights for policy 0, policy_version 846424 (0.0006) [2023-12-28 01:20:08,790][106226] Updated weights for policy 0, policy_version 846434 (0.0007) [2023-12-28 01:20:08,791][106225] Updated weights for policy 1, policy_version 848445 (0.0006) [2023-12-28 01:20:09,569][106226] Updated weights for policy 0, policy_version 846444 (0.0009) [2023-12-28 01:20:09,583][106225] Updated weights for policy 1, policy_version 848455 (0.0007) [2023-12-28 01:20:09,633][106226] Updated weights for policy 0, policy_version 846454 (0.0008) [2023-12-28 01:20:09,644][106225] Updated weights for policy 1, policy_version 848465 (0.0006) [2023-12-28 01:20:09,693][106226] Updated weights for policy 0, policy_version 846464 (0.0008) [2023-12-28 01:20:09,707][106225] Updated weights for policy 1, policy_version 848475 (0.0008) [2023-12-28 01:20:10,436][106225] Updated weights for policy 1, policy_version 848485 (0.0009) [2023-12-28 01:20:10,450][106226] Updated weights for policy 0, policy_version 846474 (0.0007) [2023-12-28 01:20:10,497][106225] Updated weights for policy 1, policy_version 848495 (0.0009) [2023-12-28 01:20:10,513][106226] Updated weights for policy 0, policy_version 846484 (0.0009) [2023-12-28 01:20:10,563][106225] Updated weights for policy 1, policy_version 848505 (0.0007) [2023-12-28 01:20:10,577][106226] Updated weights for policy 0, policy_version 846494 (0.0008) [2023-12-28 01:20:10,638][106226] Updated weights for policy 0, policy_version 846504 (0.0008) [2023-12-28 01:20:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 434020352. Throughput: 0: 9944.0, 1: 9907.2. Samples: 433996756. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:11,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-4.878')] [2023-12-28 01:20:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000848512_217260032.pth... [2023-12-28 01:20:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000846504_216760320.pth... [2023-12-28 01:20:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000847392_216973312.pth [2023-12-28 01:20:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000845384_216473600.pth [2023-12-28 01:20:11,327][106225] Updated weights for policy 1, policy_version 848515 (0.0008) [2023-12-28 01:20:11,388][106226] Updated weights for policy 0, policy_version 846514 (0.0010) [2023-12-28 01:20:11,402][106225] Updated weights for policy 1, policy_version 848525 (0.0008) [2023-12-28 01:20:11,445][106226] Updated weights for policy 0, policy_version 846524 (0.0006) [2023-12-28 01:20:11,472][106225] Updated weights for policy 1, policy_version 848535 (0.0009) [2023-12-28 01:20:11,507][106226] Updated weights for policy 0, policy_version 846534 (0.0008) [2023-12-28 01:20:12,211][106225] Updated weights for policy 1, policy_version 848545 (0.0007) [2023-12-28 01:20:12,241][106226] Updated weights for policy 0, policy_version 846544 (0.0011) [2023-12-28 01:20:12,268][106225] Updated weights for policy 1, policy_version 848555 (0.0006) [2023-12-28 01:20:12,306][106226] Updated weights for policy 0, policy_version 846554 (0.0011) [2023-12-28 01:20:12,329][106225] Updated weights for policy 1, policy_version 848565 (0.0007) [2023-12-28 01:20:12,370][106226] Updated weights for policy 0, policy_version 846564 (0.0011) [2023-12-28 01:20:12,393][106225] Updated weights for policy 1, policy_version 848575 (0.0007) [2023-12-28 01:20:13,021][106226] Updated weights for policy 0, policy_version 846574 (0.0011) [2023-12-28 01:20:13,057][106225] Updated weights for policy 1, policy_version 848585 (0.0007) [2023-12-28 01:20:13,082][106226] Updated weights for policy 0, policy_version 846584 (0.0006) [2023-12-28 01:20:13,114][106225] Updated weights for policy 1, policy_version 848595 (0.0008) [2023-12-28 01:20:13,145][106226] Updated weights for policy 0, policy_version 846594 (0.0005) [2023-12-28 01:20:13,161][106225] Updated weights for policy 1, policy_version 848605 (0.0008) [2023-12-28 01:20:13,663][106226] Updated weights for policy 0, policy_version 846604 (0.0007) [2023-12-28 01:20:13,725][106226] Updated weights for policy 0, policy_version 846614 (0.0009) [2023-12-28 01:20:13,777][106225] Updated weights for policy 1, policy_version 848615 (0.0006) [2023-12-28 01:20:13,789][106226] Updated weights for policy 0, policy_version 846624 (0.0008) [2023-12-28 01:20:13,837][106225] Updated weights for policy 1, policy_version 848625 (0.0005) [2023-12-28 01:20:13,903][106225] Updated weights for policy 1, policy_version 848635 (0.0005) [2023-12-28 01:20:14,393][106226] Updated weights for policy 0, policy_version 846634 (0.0007) [2023-12-28 01:20:14,450][106226] Updated weights for policy 0, policy_version 846644 (0.0006) [2023-12-28 01:20:14,513][106226] Updated weights for policy 0, policy_version 846654 (0.0006) [2023-12-28 01:20:14,519][106225] Updated weights for policy 1, policy_version 848645 (0.0006) [2023-12-28 01:20:14,570][106226] Updated weights for policy 0, policy_version 846664 (0.0007) [2023-12-28 01:20:14,580][106225] Updated weights for policy 1, policy_version 848655 (0.0006) [2023-12-28 01:20:14,639][106225] Updated weights for policy 1, policy_version 848665 (0.0008) [2023-12-28 01:20:15,295][106226] Updated weights for policy 0, policy_version 846674 (0.0008) [2023-12-28 01:20:15,316][106225] Updated weights for policy 1, policy_version 848675 (0.0009) [2023-12-28 01:20:15,361][106226] Updated weights for policy 0, policy_version 846684 (0.0007) [2023-12-28 01:20:15,380][106225] Updated weights for policy 1, policy_version 848685 (0.0006) [2023-12-28 01:20:15,420][106226] Updated weights for policy 0, policy_version 846694 (0.0009) [2023-12-28 01:20:15,438][106225] Updated weights for policy 1, policy_version 848695 (0.0006) [2023-12-28 01:20:16,086][106225] Updated weights for policy 1, policy_version 848705 (0.0010) [2023-12-28 01:20:16,116][106226] Updated weights for policy 0, policy_version 846704 (0.0007) [2023-12-28 01:20:16,139][106225] Updated weights for policy 1, policy_version 848715 (0.0008) [2023-12-28 01:20:16,164][106226] Updated weights for policy 0, policy_version 846714 (0.0006) [2023-12-28 01:20:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 434118656. Throughput: 0: 9919.5, 1: 9822.7. Samples: 434114584. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:16,175][105115] Avg episode reward: [(0, '-4.182'), (1, '-5.135')] [2023-12-28 01:20:16,196][106225] Updated weights for policy 1, policy_version 848725 (0.0010) [2023-12-28 01:20:16,212][106226] Updated weights for policy 0, policy_version 846724 (0.0006) [2023-12-28 01:20:16,254][106225] Updated weights for policy 1, policy_version 848735 (0.0011) [2023-12-28 01:20:16,868][106225] Updated weights for policy 1, policy_version 848745 (0.0006) [2023-12-28 01:20:16,913][106226] Updated weights for policy 0, policy_version 846734 (0.0009) [2023-12-28 01:20:16,918][106225] Updated weights for policy 1, policy_version 848755 (0.0007) [2023-12-28 01:20:16,971][106226] Updated weights for policy 0, policy_version 846744 (0.0006) [2023-12-28 01:20:16,972][106225] Updated weights for policy 1, policy_version 848765 (0.0008) [2023-12-28 01:20:17,026][106226] Updated weights for policy 0, policy_version 846754 (0.0005) [2023-12-28 01:20:17,659][106226] Updated weights for policy 0, policy_version 846764 (0.0007) [2023-12-28 01:20:17,712][106225] Updated weights for policy 1, policy_version 848775 (0.0006) [2023-12-28 01:20:17,720][106226] Updated weights for policy 0, policy_version 846774 (0.0008) [2023-12-28 01:20:17,773][106225] Updated weights for policy 1, policy_version 848785 (0.0007) [2023-12-28 01:20:17,776][106226] Updated weights for policy 0, policy_version 846784 (0.0007) [2023-12-28 01:20:17,828][106225] Updated weights for policy 1, policy_version 848795 (0.0006) [2023-12-28 01:20:18,516][106226] Updated weights for policy 0, policy_version 846794 (0.0006) [2023-12-28 01:20:18,549][106225] Updated weights for policy 1, policy_version 848805 (0.0008) [2023-12-28 01:20:18,578][106226] Updated weights for policy 0, policy_version 846804 (0.0007) [2023-12-28 01:20:18,601][106225] Updated weights for policy 1, policy_version 848815 (0.0006) [2023-12-28 01:20:18,637][106226] Updated weights for policy 0, policy_version 846814 (0.0007) [2023-12-28 01:20:18,659][106225] Updated weights for policy 1, policy_version 848825 (0.0008) [2023-12-28 01:20:18,698][106226] Updated weights for policy 0, policy_version 846824 (0.0007) [2023-12-28 01:20:19,409][106225] Updated weights for policy 1, policy_version 848835 (0.0007) [2023-12-28 01:20:19,444][106226] Updated weights for policy 0, policy_version 846834 (0.0008) [2023-12-28 01:20:19,467][106225] Updated weights for policy 1, policy_version 848845 (0.0008) [2023-12-28 01:20:19,502][106226] Updated weights for policy 0, policy_version 846844 (0.0009) [2023-12-28 01:20:19,530][106225] Updated weights for policy 1, policy_version 848855 (0.0008) [2023-12-28 01:20:19,566][106226] Updated weights for policy 0, policy_version 846854 (0.0010) [2023-12-28 01:20:20,261][106226] Updated weights for policy 0, policy_version 846864 (0.0009) [2023-12-28 01:20:20,290][106225] Updated weights for policy 1, policy_version 848865 (0.0007) [2023-12-28 01:20:20,329][106226] Updated weights for policy 0, policy_version 846874 (0.0011) [2023-12-28 01:20:20,354][106225] Updated weights for policy 1, policy_version 848875 (0.0008) [2023-12-28 01:20:20,395][106226] Updated weights for policy 0, policy_version 846884 (0.0007) [2023-12-28 01:20:20,419][106225] Updated weights for policy 1, policy_version 848885 (0.0008) [2023-12-28 01:20:20,481][106225] Updated weights for policy 1, policy_version 848895 (0.0010) [2023-12-28 01:20:21,088][106226] Updated weights for policy 0, policy_version 846894 (0.0009) [2023-12-28 01:20:21,156][106226] Updated weights for policy 0, policy_version 846904 (0.0010) [2023-12-28 01:20:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 434216960. Throughput: 0: 9836.7, 1: 9804.7. Samples: 434232800. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:21,175][105115] Avg episode reward: [(0, '-4.130'), (1, '-4.996')] [2023-12-28 01:20:21,217][106226] Updated weights for policy 0, policy_version 846914 (0.0009) [2023-12-28 01:20:21,286][106225] Updated weights for policy 1, policy_version 848905 (0.0007) [2023-12-28 01:20:21,348][106225] Updated weights for policy 1, policy_version 848915 (0.0008) [2023-12-28 01:20:21,416][106225] Updated weights for policy 1, policy_version 848925 (0.0007) [2023-12-28 01:20:22,048][106226] Updated weights for policy 0, policy_version 846924 (0.0008) [2023-12-28 01:20:22,112][106226] Updated weights for policy 0, policy_version 846934 (0.0008) [2023-12-28 01:20:22,160][106225] Updated weights for policy 1, policy_version 848935 (0.0007) [2023-12-28 01:20:22,168][106226] Updated weights for policy 0, policy_version 846944 (0.0008) [2023-12-28 01:20:22,211][106225] Updated weights for policy 1, policy_version 848945 (0.0007) [2023-12-28 01:20:22,278][106225] Updated weights for policy 1, policy_version 848955 (0.0006) [2023-12-28 01:20:22,920][106226] Updated weights for policy 0, policy_version 846954 (0.0007) [2023-12-28 01:20:22,988][106226] Updated weights for policy 0, policy_version 846964 (0.0006) [2023-12-28 01:20:23,054][106226] Updated weights for policy 0, policy_version 846974 (0.0007) [2023-12-28 01:20:23,055][106225] Updated weights for policy 1, policy_version 848965 (0.0006) [2023-12-28 01:20:23,112][106225] Updated weights for policy 1, policy_version 848975 (0.0007) [2023-12-28 01:20:23,117][106226] Updated weights for policy 0, policy_version 846984 (0.0008) [2023-12-28 01:20:23,173][106225] Updated weights for policy 1, policy_version 848985 (0.0008) [2023-12-28 01:20:23,750][106226] Updated weights for policy 0, policy_version 846994 (0.0007) [2023-12-28 01:20:23,808][106226] Updated weights for policy 0, policy_version 847004 (0.0005) [2023-12-28 01:20:23,865][106226] Updated weights for policy 0, policy_version 847014 (0.0010) [2023-12-28 01:20:23,951][106225] Updated weights for policy 1, policy_version 848995 (0.0007) [2023-12-28 01:20:24,017][106225] Updated weights for policy 1, policy_version 849005 (0.0006) [2023-12-28 01:20:24,069][106225] Updated weights for policy 1, policy_version 849015 (0.0005) [2023-12-28 01:20:24,541][106226] Updated weights for policy 0, policy_version 847024 (0.0011) [2023-12-28 01:20:24,591][106226] Updated weights for policy 0, policy_version 847034 (0.0010) [2023-12-28 01:20:24,614][106225] Updated weights for policy 1, policy_version 849025 (0.0009) [2023-12-28 01:20:24,645][106226] Updated weights for policy 0, policy_version 847044 (0.0006) [2023-12-28 01:20:24,679][106225] Updated weights for policy 1, policy_version 849035 (0.0010) [2023-12-28 01:20:24,735][106225] Updated weights for policy 1, policy_version 849045 (0.0010) [2023-12-28 01:20:24,790][106225] Updated weights for policy 1, policy_version 849055 (0.0010) [2023-12-28 01:20:25,238][106226] Updated weights for policy 0, policy_version 847054 (0.0008) [2023-12-28 01:20:25,293][106226] Updated weights for policy 0, policy_version 847064 (0.0010) [2023-12-28 01:20:25,346][106226] Updated weights for policy 0, policy_version 847074 (0.0010) [2023-12-28 01:20:25,473][106225] Updated weights for policy 1, policy_version 849065 (0.0006) [2023-12-28 01:20:25,519][106225] Updated weights for policy 1, policy_version 849075 (0.0005) [2023-12-28 01:20:25,568][106225] Updated weights for policy 1, policy_version 849085 (0.0005) [2023-12-28 01:20:26,036][106226] Updated weights for policy 0, policy_version 847084 (0.0008) [2023-12-28 01:20:26,097][106226] Updated weights for policy 0, policy_version 847094 (0.0006) [2023-12-28 01:20:26,147][106226] Updated weights for policy 0, policy_version 847104 (0.0008) [2023-12-28 01:20:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 434315264. Throughput: 0: 9790.1, 1: 9712.5. Samples: 434288364. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:26,175][105115] Avg episode reward: [(0, '-4.179'), (1, '-4.922')] [2023-12-28 01:20:26,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000847112_216915968.pth... [2023-12-28 01:20:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000845928_216612864.pth [2023-12-28 01:20:26,207][106225] Updated weights for policy 1, policy_version 849095 (0.0010) [2023-12-28 01:20:26,264][106225] Updated weights for policy 1, policy_version 849105 (0.0010) [2023-12-28 01:20:26,313][106225] Updated weights for policy 1, policy_version 849115 (0.0010) [2023-12-28 01:20:26,338][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000849120_217415680.pth... [2023-12-28 01:20:26,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000847968_217120768.pth [2023-12-28 01:20:26,779][106226] Updated weights for policy 0, policy_version 847114 (0.0007) [2023-12-28 01:20:26,834][106226] Updated weights for policy 0, policy_version 847124 (0.0010) [2023-12-28 01:20:26,887][106226] Updated weights for policy 0, policy_version 847134 (0.0010) [2023-12-28 01:20:26,910][106225] Updated weights for policy 1, policy_version 849125 (0.0008) [2023-12-28 01:20:26,939][106226] Updated weights for policy 0, policy_version 847144 (0.0010) [2023-12-28 01:20:26,961][106225] Updated weights for policy 1, policy_version 849135 (0.0005) [2023-12-28 01:20:27,021][106225] Updated weights for policy 1, policy_version 849145 (0.0006) [2023-12-28 01:20:27,636][106226] Updated weights for policy 0, policy_version 847154 (0.0010) [2023-12-28 01:20:27,672][106225] Updated weights for policy 1, policy_version 849155 (0.0007) [2023-12-28 01:20:27,697][106226] Updated weights for policy 0, policy_version 847164 (0.0009) [2023-12-28 01:20:27,723][106225] Updated weights for policy 1, policy_version 849165 (0.0005) [2023-12-28 01:20:27,753][106226] Updated weights for policy 0, policy_version 847174 (0.0005) [2023-12-28 01:20:27,769][106225] Updated weights for policy 1, policy_version 849175 (0.0005) [2023-12-28 01:20:28,416][106226] Updated weights for policy 0, policy_version 847184 (0.0009) [2023-12-28 01:20:28,453][106225] Updated weights for policy 1, policy_version 849185 (0.0006) [2023-12-28 01:20:28,483][106226] Updated weights for policy 0, policy_version 847194 (0.0011) [2023-12-28 01:20:28,511][106225] Updated weights for policy 1, policy_version 849195 (0.0006) [2023-12-28 01:20:28,540][106226] Updated weights for policy 0, policy_version 847204 (0.0011) [2023-12-28 01:20:28,568][106225] Updated weights for policy 1, policy_version 849205 (0.0006) [2023-12-28 01:20:28,628][106225] Updated weights for policy 1, policy_version 849215 (0.0006) [2023-12-28 01:20:29,251][106226] Updated weights for policy 0, policy_version 847214 (0.0009) [2023-12-28 01:20:29,257][106225] Updated weights for policy 1, policy_version 849225 (0.0007) [2023-12-28 01:20:29,311][106226] Updated weights for policy 0, policy_version 847224 (0.0010) [2023-12-28 01:20:29,323][106225] Updated weights for policy 1, policy_version 849235 (0.0007) [2023-12-28 01:20:29,381][106226] Updated weights for policy 0, policy_version 847234 (0.0009) [2023-12-28 01:20:29,394][106225] Updated weights for policy 1, policy_version 849245 (0.0009) [2023-12-28 01:20:30,064][106226] Updated weights for policy 0, policy_version 847244 (0.0008) [2023-12-28 01:20:30,099][106225] Updated weights for policy 1, policy_version 849255 (0.0006) [2023-12-28 01:20:30,124][106226] Updated weights for policy 0, policy_version 847254 (0.0009) [2023-12-28 01:20:30,146][106225] Updated weights for policy 1, policy_version 849265 (0.0007) [2023-12-28 01:20:30,184][106226] Updated weights for policy 0, policy_version 847264 (0.0007) [2023-12-28 01:20:30,202][106225] Updated weights for policy 1, policy_version 849275 (0.0008) [2023-12-28 01:20:30,777][106226] Updated weights for policy 0, policy_version 847274 (0.0007) [2023-12-28 01:20:30,835][106226] Updated weights for policy 0, policy_version 847284 (0.0005) [2023-12-28 01:20:30,844][106225] Updated weights for policy 1, policy_version 849285 (0.0006) [2023-12-28 01:20:30,888][106226] Updated weights for policy 0, policy_version 847294 (0.0005) [2023-12-28 01:20:30,900][106225] Updated weights for policy 1, policy_version 849295 (0.0006) [2023-12-28 01:20:30,943][106226] Updated weights for policy 0, policy_version 847304 (0.0005) [2023-12-28 01:20:30,956][106225] Updated weights for policy 1, policy_version 849305 (0.0009) [2023-12-28 01:20:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.8, 300 sec: 19966.3). Total num frames: 434429952. Throughput: 0: 9924.7, 1: 9772.3. Samples: 434414416. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:31,175][105115] Avg episode reward: [(0, '-4.238'), (1, '-5.261')] [2023-12-28 01:20:31,616][106226] Updated weights for policy 0, policy_version 847314 (0.0008) [2023-12-28 01:20:31,682][106226] Updated weights for policy 0, policy_version 847324 (0.0008) [2023-12-28 01:20:31,683][106225] Updated weights for policy 1, policy_version 849315 (0.0010) [2023-12-28 01:20:31,745][106225] Updated weights for policy 1, policy_version 849325 (0.0011) [2023-12-28 01:20:31,750][106226] Updated weights for policy 0, policy_version 847334 (0.0009) [2023-12-28 01:20:31,799][106225] Updated weights for policy 1, policy_version 849335 (0.0010) [2023-12-28 01:20:32,414][106226] Updated weights for policy 0, policy_version 847344 (0.0008) [2023-12-28 01:20:32,466][106225] Updated weights for policy 1, policy_version 849345 (0.0010) [2023-12-28 01:20:32,480][106226] Updated weights for policy 0, policy_version 847354 (0.0011) [2023-12-28 01:20:32,523][106225] Updated weights for policy 1, policy_version 849355 (0.0007) [2023-12-28 01:20:32,537][106226] Updated weights for policy 0, policy_version 847364 (0.0007) [2023-12-28 01:20:32,573][106225] Updated weights for policy 1, policy_version 849365 (0.0007) [2023-12-28 01:20:32,622][106225] Updated weights for policy 1, policy_version 849375 (0.0008) [2023-12-28 01:20:33,230][106226] Updated weights for policy 0, policy_version 847374 (0.0008) [2023-12-28 01:20:33,272][106226] Updated weights for policy 0, policy_version 847384 (0.0007) [2023-12-28 01:20:33,332][106226] Updated weights for policy 0, policy_version 847394 (0.0006) [2023-12-28 01:20:33,339][106225] Updated weights for policy 1, policy_version 849385 (0.0010) [2023-12-28 01:20:33,392][106225] Updated weights for policy 1, policy_version 849395 (0.0007) [2023-12-28 01:20:33,450][106225] Updated weights for policy 1, policy_version 849405 (0.0005) [2023-12-28 01:20:34,014][106225] Updated weights for policy 1, policy_version 849415 (0.0007) [2023-12-28 01:20:34,076][106225] Updated weights for policy 1, policy_version 849425 (0.0010) [2023-12-28 01:20:34,114][106226] Updated weights for policy 0, policy_version 847404 (0.0009) [2023-12-28 01:20:34,130][106225] Updated weights for policy 1, policy_version 849435 (0.0009) [2023-12-28 01:20:34,184][106226] Updated weights for policy 0, policy_version 847414 (0.0008) [2023-12-28 01:20:34,249][106226] Updated weights for policy 0, policy_version 847424 (0.0008) [2023-12-28 01:20:34,801][106225] Updated weights for policy 1, policy_version 849445 (0.0009) [2023-12-28 01:20:34,857][106225] Updated weights for policy 1, policy_version 849455 (0.0010) [2023-12-28 01:20:34,911][106225] Updated weights for policy 1, policy_version 849465 (0.0010) [2023-12-28 01:20:34,913][106226] Updated weights for policy 0, policy_version 847434 (0.0008) [2023-12-28 01:20:34,973][106226] Updated weights for policy 0, policy_version 847444 (0.0007) [2023-12-28 01:20:35,029][106226] Updated weights for policy 0, policy_version 847454 (0.0008) [2023-12-28 01:20:35,088][106226] Updated weights for policy 0, policy_version 847464 (0.0007) [2023-12-28 01:20:35,557][106225] Updated weights for policy 1, policy_version 849475 (0.0010) [2023-12-28 01:20:35,601][106225] Updated weights for policy 1, policy_version 849485 (0.0008) [2023-12-28 01:20:35,658][106225] Updated weights for policy 1, policy_version 849495 (0.0008) [2023-12-28 01:20:35,883][106226] Updated weights for policy 0, policy_version 847474 (0.0009) [2023-12-28 01:20:35,950][106226] Updated weights for policy 0, policy_version 847484 (0.0009) [2023-12-28 01:20:36,020][106226] Updated weights for policy 0, policy_version 847494 (0.0009) [2023-12-28 01:20:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 434528256. Throughput: 0: 9968.8, 1: 9760.1. Samples: 434535000. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:36,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.739')] [2023-12-28 01:20:36,306][106225] Updated weights for policy 1, policy_version 849505 (0.0007) [2023-12-28 01:20:36,358][106225] Updated weights for policy 1, policy_version 849515 (0.0005) [2023-12-28 01:20:36,413][106225] Updated weights for policy 1, policy_version 849525 (0.0008) [2023-12-28 01:20:36,466][106225] Updated weights for policy 1, policy_version 849535 (0.0008) [2023-12-28 01:20:36,795][106226] Updated weights for policy 0, policy_version 847504 (0.0008) [2023-12-28 01:20:36,851][106226] Updated weights for policy 0, policy_version 847514 (0.0009) [2023-12-28 01:20:36,909][106226] Updated weights for policy 0, policy_version 847524 (0.0009) [2023-12-28 01:20:37,167][106225] Updated weights for policy 1, policy_version 849545 (0.0007) [2023-12-28 01:20:37,229][106225] Updated weights for policy 1, policy_version 849555 (0.0008) [2023-12-28 01:20:37,286][106225] Updated weights for policy 1, policy_version 849565 (0.0009) [2023-12-28 01:20:37,659][106226] Updated weights for policy 0, policy_version 847534 (0.0008) [2023-12-28 01:20:37,719][106226] Updated weights for policy 0, policy_version 847544 (0.0008) [2023-12-28 01:20:37,774][106226] Updated weights for policy 0, policy_version 847554 (0.0009) [2023-12-28 01:20:37,986][106225] Updated weights for policy 1, policy_version 849575 (0.0009) [2023-12-28 01:20:38,046][106225] Updated weights for policy 1, policy_version 849585 (0.0008) [2023-12-28 01:20:38,095][106225] Updated weights for policy 1, policy_version 849596 (0.0009) [2023-12-28 01:20:38,483][106226] Updated weights for policy 0, policy_version 847564 (0.0008) [2023-12-28 01:20:38,541][106226] Updated weights for policy 0, policy_version 847574 (0.0008) [2023-12-28 01:20:38,602][106226] Updated weights for policy 0, policy_version 847584 (0.0008) [2023-12-28 01:20:38,904][106225] Updated weights for policy 1, policy_version 849606 (0.0009) [2023-12-28 01:20:38,954][106225] Updated weights for policy 1, policy_version 849616 (0.0008) [2023-12-28 01:20:38,998][106225] Updated weights for policy 1, policy_version 849626 (0.0005) [2023-12-28 01:20:39,205][106226] Updated weights for policy 0, policy_version 847594 (0.0006) [2023-12-28 01:20:39,274][106226] Updated weights for policy 0, policy_version 847604 (0.0008) [2023-12-28 01:20:39,343][106226] Updated weights for policy 0, policy_version 847614 (0.0008) [2023-12-28 01:20:39,404][106226] Updated weights for policy 0, policy_version 847624 (0.0008) [2023-12-28 01:20:39,669][106225] Updated weights for policy 1, policy_version 849636 (0.0008) [2023-12-28 01:20:39,718][106225] Updated weights for policy 1, policy_version 849646 (0.0010) [2023-12-28 01:20:39,772][106225] Updated weights for policy 1, policy_version 849656 (0.0010) [2023-12-28 01:20:40,240][106226] Updated weights for policy 0, policy_version 847634 (0.0009) [2023-12-28 01:20:40,301][106226] Updated weights for policy 0, policy_version 847644 (0.0009) [2023-12-28 01:20:40,367][106226] Updated weights for policy 0, policy_version 847654 (0.0008) [2023-12-28 01:20:40,425][106225] Updated weights for policy 1, policy_version 849666 (0.0010) [2023-12-28 01:20:40,482][106225] Updated weights for policy 1, policy_version 849676 (0.0010) [2023-12-28 01:20:40,542][106225] Updated weights for policy 1, policy_version 849686 (0.0008) [2023-12-28 01:20:40,600][106225] Updated weights for policy 1, policy_version 849696 (0.0005) [2023-12-28 01:20:41,078][106226] Updated weights for policy 0, policy_version 847664 (0.0008) [2023-12-28 01:20:41,129][106226] Updated weights for policy 0, policy_version 847674 (0.0008) [2023-12-28 01:20:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 434618368. Throughput: 0: 9960.2, 1: 9817.4. Samples: 434595080. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:41,175][105115] Avg episode reward: [(0, '-4.196'), (1, '-5.118')] [2023-12-28 01:20:41,200][106226] Updated weights for policy 0, policy_version 847684 (0.0008) [2023-12-28 01:20:41,224][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000847688_217063424.pth... [2023-12-28 01:20:41,228][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000846504_216760320.pth [2023-12-28 01:20:41,240][106225] Updated weights for policy 1, policy_version 849706 (0.0012) [2023-12-28 01:20:41,305][106225] Updated weights for policy 1, policy_version 849716 (0.0011) [2023-12-28 01:20:41,375][106225] Updated weights for policy 1, policy_version 849726 (0.0010) [2023-12-28 01:20:41,386][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000849728_217571328.pth... [2023-12-28 01:20:41,391][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000848512_217260032.pth [2023-12-28 01:20:41,993][106226] Updated weights for policy 0, policy_version 847694 (0.0007) [2023-12-28 01:20:42,063][106226] Updated weights for policy 0, policy_version 847704 (0.0006) [2023-12-28 01:20:42,132][106225] Updated weights for policy 1, policy_version 849736 (0.0010) [2023-12-28 01:20:42,133][106226] Updated weights for policy 0, policy_version 847714 (0.0005) [2023-12-28 01:20:42,200][106225] Updated weights for policy 1, policy_version 849746 (0.0010) [2023-12-28 01:20:42,274][106225] Updated weights for policy 1, policy_version 849756 (0.0011) [2023-12-28 01:20:42,732][106226] Updated weights for policy 0, policy_version 847724 (0.0006) [2023-12-28 01:20:42,784][106226] Updated weights for policy 0, policy_version 847734 (0.0008) [2023-12-28 01:20:42,842][106226] Updated weights for policy 0, policy_version 847744 (0.0006) [2023-12-28 01:20:42,949][106225] Updated weights for policy 1, policy_version 849766 (0.0011) [2023-12-28 01:20:43,004][106225] Updated weights for policy 1, policy_version 849776 (0.0010) [2023-12-28 01:20:43,065][106225] Updated weights for policy 1, policy_version 849786 (0.0010) [2023-12-28 01:20:43,507][106226] Updated weights for policy 0, policy_version 847754 (0.0005) [2023-12-28 01:20:43,554][106226] Updated weights for policy 0, policy_version 847764 (0.0005) [2023-12-28 01:20:43,601][106226] Updated weights for policy 0, policy_version 847774 (0.0005) [2023-12-28 01:20:43,649][106226] Updated weights for policy 0, policy_version 847784 (0.0005) [2023-12-28 01:20:43,690][106225] Updated weights for policy 1, policy_version 849796 (0.0008) [2023-12-28 01:20:43,751][106225] Updated weights for policy 1, policy_version 849806 (0.0005) [2023-12-28 01:20:43,799][106225] Updated weights for policy 1, policy_version 849816 (0.0005) [2023-12-28 01:20:44,304][106226] Updated weights for policy 0, policy_version 847794 (0.0010) [2023-12-28 01:20:44,356][106225] Updated weights for policy 1, policy_version 849826 (0.0006) [2023-12-28 01:20:44,360][106226] Updated weights for policy 0, policy_version 847804 (0.0010) [2023-12-28 01:20:44,411][106225] Updated weights for policy 1, policy_version 849836 (0.0010) [2023-12-28 01:20:44,417][106226] Updated weights for policy 0, policy_version 847814 (0.0010) [2023-12-28 01:20:44,467][106225] Updated weights for policy 1, policy_version 849846 (0.0010) [2023-12-28 01:20:44,523][106225] Updated weights for policy 1, policy_version 849856 (0.0010) [2023-12-28 01:20:45,139][106226] Updated weights for policy 0, policy_version 847824 (0.0010) [2023-12-28 01:20:45,193][106226] Updated weights for policy 0, policy_version 847834 (0.0010) [2023-12-28 01:20:45,208][106225] Updated weights for policy 1, policy_version 849866 (0.0006) [2023-12-28 01:20:45,251][106226] Updated weights for policy 0, policy_version 847844 (0.0010) [2023-12-28 01:20:45,269][106225] Updated weights for policy 1, policy_version 849876 (0.0008) [2023-12-28 01:20:45,328][106225] Updated weights for policy 1, policy_version 849886 (0.0008) [2023-12-28 01:20:45,997][106226] Updated weights for policy 0, policy_version 847854 (0.0011) [2023-12-28 01:20:46,041][106225] Updated weights for policy 1, policy_version 849896 (0.0007) [2023-12-28 01:20:46,057][106226] Updated weights for policy 0, policy_version 847864 (0.0010) [2023-12-28 01:20:46,098][106225] Updated weights for policy 1, policy_version 849906 (0.0008) [2023-12-28 01:20:46,117][106226] Updated weights for policy 0, policy_version 847874 (0.0010) [2023-12-28 01:20:46,157][106225] Updated weights for policy 1, policy_version 849916 (0.0007) [2023-12-28 01:20:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 434733056. Throughput: 0: 9882.5, 1: 9972.6. Samples: 434715368. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:46,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-5.142')] [2023-12-28 01:20:46,806][106226] Updated weights for policy 0, policy_version 847884 (0.0010) [2023-12-28 01:20:46,840][106225] Updated weights for policy 1, policy_version 849926 (0.0008) [2023-12-28 01:20:46,873][106226] Updated weights for policy 0, policy_version 847894 (0.0011) [2023-12-28 01:20:46,894][106225] Updated weights for policy 1, policy_version 849936 (0.0007) [2023-12-28 01:20:46,943][106226] Updated weights for policy 0, policy_version 847904 (0.0010) [2023-12-28 01:20:46,947][106225] Updated weights for policy 1, policy_version 849946 (0.0006) [2023-12-28 01:20:47,537][106226] Updated weights for policy 0, policy_version 847914 (0.0009) [2023-12-28 01:20:47,598][106226] Updated weights for policy 0, policy_version 847924 (0.0010) [2023-12-28 01:20:47,660][106226] Updated weights for policy 0, policy_version 847934 (0.0008) [2023-12-28 01:20:47,666][106225] Updated weights for policy 1, policy_version 849956 (0.0007) [2023-12-28 01:20:47,721][106226] Updated weights for policy 0, policy_version 847944 (0.0011) [2023-12-28 01:20:47,727][106225] Updated weights for policy 1, policy_version 849966 (0.0008) [2023-12-28 01:20:47,791][106225] Updated weights for policy 1, policy_version 849976 (0.0008) [2023-12-28 01:20:48,407][106226] Updated weights for policy 0, policy_version 847954 (0.0010) [2023-12-28 01:20:48,469][106226] Updated weights for policy 0, policy_version 847964 (0.0008) [2023-12-28 01:20:48,528][106226] Updated weights for policy 0, policy_version 847974 (0.0010) [2023-12-28 01:20:48,548][106225] Updated weights for policy 1, policy_version 849986 (0.0008) [2023-12-28 01:20:48,609][106225] Updated weights for policy 1, policy_version 849996 (0.0009) [2023-12-28 01:20:48,678][106225] Updated weights for policy 1, policy_version 850006 (0.0009) [2023-12-28 01:20:48,738][106225] Updated weights for policy 1, policy_version 850016 (0.0008) [2023-12-28 01:20:49,261][106226] Updated weights for policy 0, policy_version 847984 (0.0008) [2023-12-28 01:20:49,334][106226] Updated weights for policy 0, policy_version 847994 (0.0007) [2023-12-28 01:20:49,399][106226] Updated weights for policy 0, policy_version 848004 (0.0009) [2023-12-28 01:20:49,451][106225] Updated weights for policy 1, policy_version 850026 (0.0007) [2023-12-28 01:20:49,506][106225] Updated weights for policy 1, policy_version 850036 (0.0008) [2023-12-28 01:20:49,562][106225] Updated weights for policy 1, policy_version 850046 (0.0007) [2023-12-28 01:20:50,048][106226] Updated weights for policy 0, policy_version 848014 (0.0008) [2023-12-28 01:20:50,092][106226] Updated weights for policy 0, policy_version 848024 (0.0008) [2023-12-28 01:20:50,145][106226] Updated weights for policy 0, policy_version 848034 (0.0007) [2023-12-28 01:20:50,307][106225] Updated weights for policy 1, policy_version 850056 (0.0008) [2023-12-28 01:20:50,366][106225] Updated weights for policy 1, policy_version 850066 (0.0008) [2023-12-28 01:20:50,428][106225] Updated weights for policy 1, policy_version 850076 (0.0007) [2023-12-28 01:20:50,904][106226] Updated weights for policy 0, policy_version 848044 (0.0007) [2023-12-28 01:20:50,966][106226] Updated weights for policy 0, policy_version 848054 (0.0007) [2023-12-28 01:20:51,032][106226] Updated weights for policy 0, policy_version 848064 (0.0008) [2023-12-28 01:20:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 434823168. Throughput: 0: 9875.7, 1: 9965.1. Samples: 434831944. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:51,175][105115] Avg episode reward: [(0, '-4.147'), (1, '-4.992')] [2023-12-28 01:20:51,229][106225] Updated weights for policy 1, policy_version 850086 (0.0008) [2023-12-28 01:20:51,296][106225] Updated weights for policy 1, policy_version 850096 (0.0008) [2023-12-28 01:20:51,366][106225] Updated weights for policy 1, policy_version 850106 (0.0008) [2023-12-28 01:20:51,807][106226] Updated weights for policy 0, policy_version 848074 (0.0008) [2023-12-28 01:20:51,858][106226] Updated weights for policy 0, policy_version 848084 (0.0008) [2023-12-28 01:20:51,916][106226] Updated weights for policy 0, policy_version 848094 (0.0008) [2023-12-28 01:20:51,975][106226] Updated weights for policy 0, policy_version 848104 (0.0008) [2023-12-28 01:20:52,113][106225] Updated weights for policy 1, policy_version 850116 (0.0007) [2023-12-28 01:20:52,167][106225] Updated weights for policy 1, policy_version 850126 (0.0007) [2023-12-28 01:20:52,210][106225] Updated weights for policy 1, policy_version 850136 (0.0009) [2023-12-28 01:20:52,746][106226] Updated weights for policy 0, policy_version 848114 (0.0011) [2023-12-28 01:20:52,802][106226] Updated weights for policy 0, policy_version 848124 (0.0010) [2023-12-28 01:20:52,859][106226] Updated weights for policy 0, policy_version 848134 (0.0011) [2023-12-28 01:20:52,964][106225] Updated weights for policy 1, policy_version 850146 (0.0008) [2023-12-28 01:20:53,018][106225] Updated weights for policy 1, policy_version 850156 (0.0008) [2023-12-28 01:20:53,083][106225] Updated weights for policy 1, policy_version 850166 (0.0008) [2023-12-28 01:20:53,136][106225] Updated weights for policy 1, policy_version 850176 (0.0008) [2023-12-28 01:20:53,542][106226] Updated weights for policy 0, policy_version 848144 (0.0011) [2023-12-28 01:20:53,600][106226] Updated weights for policy 0, policy_version 848154 (0.0011) [2023-12-28 01:20:53,658][106226] Updated weights for policy 0, policy_version 848164 (0.0008) [2023-12-28 01:20:53,889][106225] Updated weights for policy 1, policy_version 850186 (0.0007) [2023-12-28 01:20:53,946][106225] Updated weights for policy 1, policy_version 850196 (0.0008) [2023-12-28 01:20:54,000][106225] Updated weights for policy 1, policy_version 850206 (0.0008) [2023-12-28 01:20:54,370][106226] Updated weights for policy 0, policy_version 848174 (0.0009) [2023-12-28 01:20:54,430][106226] Updated weights for policy 0, policy_version 848184 (0.0011) [2023-12-28 01:20:54,490][106226] Updated weights for policy 0, policy_version 848194 (0.0011) [2023-12-28 01:20:54,695][106225] Updated weights for policy 1, policy_version 850216 (0.0007) [2023-12-28 01:20:54,756][106225] Updated weights for policy 1, policy_version 850226 (0.0008) [2023-12-28 01:20:54,813][106225] Updated weights for policy 1, policy_version 850236 (0.0007) [2023-12-28 01:20:55,207][106226] Updated weights for policy 0, policy_version 848204 (0.0009) [2023-12-28 01:20:55,258][106226] Updated weights for policy 0, policy_version 848214 (0.0005) [2023-12-28 01:20:55,323][106226] Updated weights for policy 0, policy_version 848224 (0.0009) [2023-12-28 01:20:55,525][106225] Updated weights for policy 1, policy_version 850246 (0.0007) [2023-12-28 01:20:55,569][106225] Updated weights for policy 1, policy_version 850256 (0.0008) [2023-12-28 01:20:55,616][106225] Updated weights for policy 1, policy_version 850266 (0.0008) [2023-12-28 01:20:56,018][106226] Updated weights for policy 0, policy_version 848234 (0.0010) [2023-12-28 01:20:56,072][106226] Updated weights for policy 0, policy_version 848244 (0.0009) [2023-12-28 01:20:56,135][106226] Updated weights for policy 0, policy_version 848254 (0.0009) [2023-12-28 01:20:56,175][105115] Fps is (10 sec: 18022.1, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 434913280. Throughput: 0: 9856.3, 1: 9954.1. Samples: 434888224. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:20:56,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.991')] [2023-12-28 01:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000850272_217710592.pth... [2023-12-28 01:20:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000849120_217415680.pth [2023-12-28 01:20:56,208][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000848264_217210880.pth... [2023-12-28 01:20:56,209][106226] Updated weights for policy 0, policy_version 848264 (0.0006) [2023-12-28 01:20:56,213][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000847112_216915968.pth [2023-12-28 01:20:56,331][106225] Updated weights for policy 1, policy_version 850276 (0.0007) [2023-12-28 01:20:56,383][106225] Updated weights for policy 1, policy_version 850286 (0.0005) [2023-12-28 01:20:56,434][106225] Updated weights for policy 1, policy_version 850296 (0.0005) [2023-12-28 01:20:56,804][106226] Updated weights for policy 0, policy_version 848274 (0.0007) [2023-12-28 01:20:56,865][106226] Updated weights for policy 0, policy_version 848284 (0.0009) [2023-12-28 01:20:56,927][106226] Updated weights for policy 0, policy_version 848294 (0.0006) [2023-12-28 01:20:57,030][106225] Updated weights for policy 1, policy_version 850306 (0.0006) [2023-12-28 01:20:57,089][106225] Updated weights for policy 1, policy_version 850316 (0.0008) [2023-12-28 01:20:57,137][106225] Updated weights for policy 1, policy_version 850326 (0.0008) [2023-12-28 01:20:57,191][106225] Updated weights for policy 1, policy_version 850336 (0.0008) [2023-12-28 01:20:57,483][106226] Updated weights for policy 0, policy_version 848304 (0.0006) [2023-12-28 01:20:57,530][106226] Updated weights for policy 0, policy_version 848314 (0.0008) [2023-12-28 01:20:57,585][106226] Updated weights for policy 0, policy_version 848324 (0.0008) [2023-12-28 01:20:57,890][106225] Updated weights for policy 1, policy_version 850346 (0.0005) [2023-12-28 01:20:57,938][106225] Updated weights for policy 1, policy_version 850356 (0.0005) [2023-12-28 01:20:57,993][106225] Updated weights for policy 1, policy_version 850366 (0.0005) [2023-12-28 01:20:58,319][106226] Updated weights for policy 0, policy_version 848334 (0.0009) [2023-12-28 01:20:58,406][106226] Updated weights for policy 0, policy_version 848344 (0.0008) [2023-12-28 01:20:58,471][106226] Updated weights for policy 0, policy_version 848354 (0.0007) [2023-12-28 01:20:58,624][106225] Updated weights for policy 1, policy_version 850376 (0.0007) [2023-12-28 01:20:58,696][106225] Updated weights for policy 1, policy_version 850386 (0.0006) [2023-12-28 01:20:58,769][106225] Updated weights for policy 1, policy_version 850396 (0.0007) [2023-12-28 01:20:59,254][106226] Updated weights for policy 0, policy_version 848364 (0.0008) [2023-12-28 01:20:59,325][106226] Updated weights for policy 0, policy_version 848374 (0.0010) [2023-12-28 01:20:59,393][106226] Updated weights for policy 0, policy_version 848384 (0.0010) [2023-12-28 01:20:59,506][106225] Updated weights for policy 1, policy_version 850406 (0.0006) [2023-12-28 01:20:59,566][106225] Updated weights for policy 1, policy_version 850416 (0.0010) [2023-12-28 01:20:59,637][106225] Updated weights for policy 1, policy_version 850426 (0.0010) [2023-12-28 01:21:00,101][106226] Updated weights for policy 0, policy_version 848394 (0.0010) [2023-12-28 01:21:00,158][106226] Updated weights for policy 0, policy_version 848404 (0.0011) [2023-12-28 01:21:00,211][106226] Updated weights for policy 0, policy_version 848414 (0.0010) [2023-12-28 01:21:00,303][106226] Updated weights for policy 0, policy_version 848424 (0.0008) [2023-12-28 01:21:00,343][106225] Updated weights for policy 1, policy_version 850436 (0.0010) [2023-12-28 01:21:00,401][106225] Updated weights for policy 1, policy_version 850446 (0.0007) [2023-12-28 01:21:00,467][106225] Updated weights for policy 1, policy_version 850456 (0.0009) [2023-12-28 01:21:00,914][106226] Updated weights for policy 0, policy_version 848434 (0.0007) [2023-12-28 01:21:00,972][106226] Updated weights for policy 0, policy_version 848444 (0.0007) [2023-12-28 01:21:01,041][106225] Updated weights for policy 1, policy_version 850466 (0.0006) [2023-12-28 01:21:01,052][106226] Updated weights for policy 0, policy_version 848455 (0.0012) [2023-12-28 01:21:01,104][106225] Updated weights for policy 1, policy_version 850476 (0.0011) [2023-12-28 01:21:01,170][106225] Updated weights for policy 1, policy_version 850486 (0.0010) [2023-12-28 01:21:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 435019776. Throughput: 0: 9857.1, 1: 10011.9. Samples: 435008692. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:21:01,175][105115] Avg episode reward: [(0, '-4.070'), (1, '-5.181')] [2023-12-28 01:21:01,235][106225] Updated weights for policy 1, policy_version 850496 (0.0007) [2023-12-28 01:21:01,674][106226] Updated weights for policy 0, policy_version 848465 (0.0008) [2023-12-28 01:21:01,729][106226] Updated weights for policy 0, policy_version 848475 (0.0008) [2023-12-28 01:21:01,798][106226] Updated weights for policy 0, policy_version 848485 (0.0006) [2023-12-28 01:21:01,992][106225] Updated weights for policy 1, policy_version 850506 (0.0008) [2023-12-28 01:21:02,054][106225] Updated weights for policy 1, policy_version 850516 (0.0008) [2023-12-28 01:21:02,110][106225] Updated weights for policy 1, policy_version 850526 (0.0008) [2023-12-28 01:21:02,454][106226] Updated weights for policy 0, policy_version 848495 (0.0008) [2023-12-28 01:21:02,506][106226] Updated weights for policy 0, policy_version 848505 (0.0008) [2023-12-28 01:21:02,572][106226] Updated weights for policy 0, policy_version 848515 (0.0006) [2023-12-28 01:21:02,918][106225] Updated weights for policy 1, policy_version 850536 (0.0008) [2023-12-28 01:21:02,982][106225] Updated weights for policy 1, policy_version 850546 (0.0008) [2023-12-28 01:21:03,040][106225] Updated weights for policy 1, policy_version 850556 (0.0010) [2023-12-28 01:21:03,148][106226] Updated weights for policy 0, policy_version 848525 (0.0006) [2023-12-28 01:21:03,199][106226] Updated weights for policy 0, policy_version 848535 (0.0006) [2023-12-28 01:21:03,261][106226] Updated weights for policy 0, policy_version 848545 (0.0008) [2023-12-28 01:21:03,728][106225] Updated weights for policy 1, policy_version 850566 (0.0007) [2023-12-28 01:21:03,774][106225] Updated weights for policy 1, policy_version 850576 (0.0005) [2023-12-28 01:21:03,826][106225] Updated weights for policy 1, policy_version 850586 (0.0008) [2023-12-28 01:21:03,901][106226] Updated weights for policy 0, policy_version 848555 (0.0008) [2023-12-28 01:21:03,961][106226] Updated weights for policy 0, policy_version 848565 (0.0006) [2023-12-28 01:21:04,025][106226] Updated weights for policy 0, policy_version 848575 (0.0006) [2023-12-28 01:21:04,596][106225] Updated weights for policy 1, policy_version 850596 (0.0009) [2023-12-28 01:21:04,646][106225] Updated weights for policy 1, policy_version 850606 (0.0010) [2023-12-28 01:21:04,706][106225] Updated weights for policy 1, policy_version 850616 (0.0008) [2023-12-28 01:21:04,728][106226] Updated weights for policy 0, policy_version 848585 (0.0008) [2023-12-28 01:21:04,785][106226] Updated weights for policy 0, policy_version 848595 (0.0005) [2023-12-28 01:21:04,832][106226] Updated weights for policy 0, policy_version 848605 (0.0005) [2023-12-28 01:21:04,881][106226] Updated weights for policy 0, policy_version 848615 (0.0005) [2023-12-28 01:21:05,282][106225] Updated weights for policy 1, policy_version 850626 (0.0010) [2023-12-28 01:21:05,334][106225] Updated weights for policy 1, policy_version 850636 (0.0010) [2023-12-28 01:21:05,384][106225] Updated weights for policy 1, policy_version 850646 (0.0010) [2023-12-28 01:21:05,441][106225] Updated weights for policy 1, policy_version 850656 (0.0010) [2023-12-28 01:21:05,476][106226] Updated weights for policy 0, policy_version 848625 (0.0010) [2023-12-28 01:21:05,534][106226] Updated weights for policy 0, policy_version 848635 (0.0010) [2023-12-28 01:21:05,586][106226] Updated weights for policy 0, policy_version 848645 (0.0010) [2023-12-28 01:21:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 435118080. Throughput: 0: 9950.0, 1: 10016.6. Samples: 435131296. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:21:06,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-4.649')] [2023-12-28 01:21:06,205][106225] Updated weights for policy 1, policy_version 850666 (0.0008) [2023-12-28 01:21:06,270][106225] Updated weights for policy 1, policy_version 850676 (0.0010) [2023-12-28 01:21:06,332][106225] Updated weights for policy 1, policy_version 850686 (0.0011) [2023-12-28 01:21:06,348][106226] Updated weights for policy 0, policy_version 848655 (0.0011) [2023-12-28 01:21:06,404][106226] Updated weights for policy 0, policy_version 848665 (0.0008) [2023-12-28 01:21:06,462][106226] Updated weights for policy 0, policy_version 848675 (0.0011) [2023-12-28 01:21:07,010][106225] Updated weights for policy 1, policy_version 850696 (0.0010) [2023-12-28 01:21:07,064][106225] Updated weights for policy 1, policy_version 850706 (0.0010) [2023-12-28 01:21:07,118][106225] Updated weights for policy 1, policy_version 850716 (0.0010) [2023-12-28 01:21:07,192][106226] Updated weights for policy 0, policy_version 848685 (0.0011) [2023-12-28 01:21:07,253][106226] Updated weights for policy 0, policy_version 848695 (0.0011) [2023-12-28 01:21:07,314][106226] Updated weights for policy 0, policy_version 848705 (0.0011) [2023-12-28 01:21:07,827][106225] Updated weights for policy 1, policy_version 850726 (0.0009) [2023-12-28 01:21:07,890][106225] Updated weights for policy 1, policy_version 850736 (0.0005) [2023-12-28 01:21:07,946][106225] Updated weights for policy 1, policy_version 850746 (0.0007) [2023-12-28 01:21:08,013][106226] Updated weights for policy 0, policy_version 848715 (0.0010) [2023-12-28 01:21:08,070][106226] Updated weights for policy 0, policy_version 848725 (0.0007) [2023-12-28 01:21:08,121][106226] Updated weights for policy 0, policy_version 848735 (0.0008) [2023-12-28 01:21:08,643][106225] Updated weights for policy 1, policy_version 850756 (0.0010) [2023-12-28 01:21:08,706][106225] Updated weights for policy 1, policy_version 850766 (0.0008) [2023-12-28 01:21:08,766][106225] Updated weights for policy 1, policy_version 850776 (0.0009) [2023-12-28 01:21:08,899][106226] Updated weights for policy 0, policy_version 848745 (0.0008) [2023-12-28 01:21:08,957][106226] Updated weights for policy 0, policy_version 848755 (0.0006) [2023-12-28 01:21:09,011][106226] Updated weights for policy 0, policy_version 848765 (0.0005) [2023-12-28 01:21:09,067][106226] Updated weights for policy 0, policy_version 848775 (0.0006) [2023-12-28 01:21:09,598][106225] Updated weights for policy 1, policy_version 850786 (0.0009) [2023-12-28 01:21:09,663][106225] Updated weights for policy 1, policy_version 850796 (0.0007) [2023-12-28 01:21:09,722][106225] Updated weights for policy 1, policy_version 850806 (0.0006) [2023-12-28 01:21:09,728][106226] Updated weights for policy 0, policy_version 848785 (0.0006) [2023-12-28 01:21:09,784][106225] Updated weights for policy 1, policy_version 850816 (0.0005) [2023-12-28 01:21:09,787][106226] Updated weights for policy 0, policy_version 848795 (0.0007) [2023-12-28 01:21:09,854][106226] Updated weights for policy 0, policy_version 848805 (0.0010) [2023-12-28 01:21:10,432][106225] Updated weights for policy 1, policy_version 850826 (0.0008) [2023-12-28 01:21:10,491][106225] Updated weights for policy 1, policy_version 850836 (0.0008) [2023-12-28 01:21:10,549][106225] Updated weights for policy 1, policy_version 850846 (0.0008) [2023-12-28 01:21:10,622][106226] Updated weights for policy 0, policy_version 848815 (0.0011) [2023-12-28 01:21:10,686][106226] Updated weights for policy 0, policy_version 848825 (0.0011) [2023-12-28 01:21:10,751][106226] Updated weights for policy 0, policy_version 848835 (0.0011) [2023-12-28 01:21:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 435216384. Throughput: 0: 9962.9, 1: 10070.4. Samples: 435189864. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:21:11,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-4.958')] [2023-12-28 01:21:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000848840_217358336.pth... [2023-12-28 01:21:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000850848_217858048.pth... [2023-12-28 01:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000847688_217063424.pth [2023-12-28 01:21:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000849728_217571328.pth [2023-12-28 01:21:11,257][106225] Updated weights for policy 1, policy_version 850856 (0.0009) [2023-12-28 01:21:11,320][106225] Updated weights for policy 1, policy_version 850866 (0.0007) [2023-12-28 01:21:11,402][106225] Updated weights for policy 1, policy_version 850876 (0.0007) [2023-12-28 01:21:11,412][106226] Updated weights for policy 0, policy_version 848845 (0.0014) [2023-12-28 01:21:11,476][106226] Updated weights for policy 0, policy_version 848855 (0.0007) [2023-12-28 01:21:11,543][106226] Updated weights for policy 0, policy_version 848865 (0.0008) [2023-12-28 01:21:12,051][106225] Updated weights for policy 1, policy_version 850886 (0.0007) [2023-12-28 01:21:12,113][106225] Updated weights for policy 1, policy_version 850896 (0.0009) [2023-12-28 01:21:12,169][106225] Updated weights for policy 1, policy_version 850906 (0.0008) [2023-12-28 01:21:12,232][106226] Updated weights for policy 0, policy_version 848875 (0.0009) [2023-12-28 01:21:12,299][106226] Updated weights for policy 0, policy_version 848885 (0.0008) [2023-12-28 01:21:12,362][106226] Updated weights for policy 0, policy_version 848895 (0.0009) [2023-12-28 01:21:12,965][106225] Updated weights for policy 1, policy_version 850916 (0.0009) [2023-12-28 01:21:13,018][106225] Updated weights for policy 1, policy_version 850926 (0.0009) [2023-12-28 01:21:13,066][106225] Updated weights for policy 1, policy_version 850936 (0.0009) [2023-12-28 01:21:13,211][106226] Updated weights for policy 0, policy_version 848905 (0.0009) [2023-12-28 01:21:13,265][106226] Updated weights for policy 0, policy_version 848915 (0.0005) [2023-12-28 01:21:13,323][106226] Updated weights for policy 0, policy_version 848925 (0.0005) [2023-12-28 01:21:13,383][106226] Updated weights for policy 0, policy_version 848935 (0.0005) [2023-12-28 01:21:13,791][106225] Updated weights for policy 1, policy_version 850946 (0.0009) [2023-12-28 01:21:13,837][106225] Updated weights for policy 1, policy_version 850956 (0.0010) [2023-12-28 01:21:13,893][106225] Updated weights for policy 1, policy_version 850966 (0.0008) [2023-12-28 01:21:13,942][106225] Updated weights for policy 1, policy_version 850976 (0.0010) [2023-12-28 01:21:13,970][106226] Updated weights for policy 0, policy_version 848945 (0.0007) [2023-12-28 01:21:14,029][106226] Updated weights for policy 0, policy_version 848955 (0.0008) [2023-12-28 01:21:14,086][106226] Updated weights for policy 0, policy_version 848965 (0.0008) [2023-12-28 01:21:14,642][106225] Updated weights for policy 1, policy_version 850986 (0.0010) [2023-12-28 01:21:14,692][106225] Updated weights for policy 1, policy_version 850996 (0.0010) [2023-12-28 01:21:14,753][106225] Updated weights for policy 1, policy_version 851006 (0.0010) [2023-12-28 01:21:14,813][106226] Updated weights for policy 0, policy_version 848975 (0.0011) [2023-12-28 01:21:14,873][106226] Updated weights for policy 0, policy_version 848985 (0.0011) [2023-12-28 01:21:14,940][106226] Updated weights for policy 0, policy_version 848995 (0.0011) [2023-12-28 01:21:15,521][106225] Updated weights for policy 1, policy_version 851016 (0.0011) [2023-12-28 01:21:15,580][106225] Updated weights for policy 1, policy_version 851026 (0.0011) [2023-12-28 01:21:15,634][106225] Updated weights for policy 1, policy_version 851036 (0.0010) [2023-12-28 01:21:15,697][106226] Updated weights for policy 0, policy_version 849005 (0.0011) [2023-12-28 01:21:15,754][106226] Updated weights for policy 0, policy_version 849015 (0.0010) [2023-12-28 01:21:15,815][106226] Updated weights for policy 0, policy_version 849025 (0.0010) [2023-12-28 01:21:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 435314688. Throughput: 0: 9882.9, 1: 9925.1. Samples: 435305772. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:21:16,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-5.324')] [2023-12-28 01:21:16,315][106225] Updated weights for policy 1, policy_version 851046 (0.0010) [2023-12-28 01:21:16,361][106225] Updated weights for policy 1, policy_version 851056 (0.0010) [2023-12-28 01:21:16,417][106225] Updated weights for policy 1, policy_version 851066 (0.0010) [2023-12-28 01:21:16,472][106226] Updated weights for policy 0, policy_version 849035 (0.0011) [2023-12-28 01:21:16,538][106226] Updated weights for policy 0, policy_version 849045 (0.0011) [2023-12-28 01:21:16,601][106226] Updated weights for policy 0, policy_version 849055 (0.0010) [2023-12-28 01:21:17,055][106225] Updated weights for policy 1, policy_version 851076 (0.0010) [2023-12-28 01:21:17,127][106225] Updated weights for policy 1, policy_version 851086 (0.0009) [2023-12-28 01:21:17,184][106225] Updated weights for policy 1, policy_version 851096 (0.0009) [2023-12-28 01:21:17,263][106226] Updated weights for policy 0, policy_version 849065 (0.0010) [2023-12-28 01:21:17,329][106226] Updated weights for policy 0, policy_version 849075 (0.0008) [2023-12-28 01:21:17,380][106226] Updated weights for policy 0, policy_version 849085 (0.0008) [2023-12-28 01:21:17,428][106226] Updated weights for policy 0, policy_version 849095 (0.0008) [2023-12-28 01:21:17,877][106225] Updated weights for policy 1, policy_version 851106 (0.0007) [2023-12-28 01:21:17,929][106225] Updated weights for policy 1, policy_version 851116 (0.0008) [2023-12-28 01:21:17,980][106225] Updated weights for policy 1, policy_version 851126 (0.0009) [2023-12-28 01:21:18,033][106225] Updated weights for policy 1, policy_version 851136 (0.0007) [2023-12-28 01:21:18,121][106226] Updated weights for policy 0, policy_version 849105 (0.0006) [2023-12-28 01:21:18,186][106226] Updated weights for policy 0, policy_version 849115 (0.0007) [2023-12-28 01:21:18,249][106226] Updated weights for policy 0, policy_version 849125 (0.0008) [2023-12-28 01:21:18,779][106225] Updated weights for policy 1, policy_version 851146 (0.0008) [2023-12-28 01:21:18,832][106225] Updated weights for policy 1, policy_version 851156 (0.0009) [2023-12-28 01:21:18,882][106225] Updated weights for policy 1, policy_version 851166 (0.0008) [2023-12-28 01:21:18,919][106226] Updated weights for policy 0, policy_version 849135 (0.0006) [2023-12-28 01:21:18,989][106226] Updated weights for policy 0, policy_version 849145 (0.0008) [2023-12-28 01:21:19,052][106226] Updated weights for policy 0, policy_version 849155 (0.0008) [2023-12-28 01:21:19,719][106225] Updated weights for policy 1, policy_version 851176 (0.0008) [2023-12-28 01:21:19,752][106226] Updated weights for policy 0, policy_version 849165 (0.0008) [2023-12-28 01:21:19,775][106225] Updated weights for policy 1, policy_version 851186 (0.0005) [2023-12-28 01:21:19,818][106226] Updated weights for policy 0, policy_version 849175 (0.0009) [2023-12-28 01:21:19,839][106225] Updated weights for policy 1, policy_version 851196 (0.0009) [2023-12-28 01:21:19,889][106226] Updated weights for policy 0, policy_version 849185 (0.0010) [2023-12-28 01:21:20,560][106225] Updated weights for policy 1, policy_version 851206 (0.0007) [2023-12-28 01:21:20,628][106225] Updated weights for policy 1, policy_version 851216 (0.0007) [2023-12-28 01:21:20,693][106225] Updated weights for policy 1, policy_version 851226 (0.0009) [2023-12-28 01:21:20,698][106226] Updated weights for policy 0, policy_version 849195 (0.0008) [2023-12-28 01:21:20,762][106226] Updated weights for policy 0, policy_version 849205 (0.0007) [2023-12-28 01:21:20,831][106226] Updated weights for policy 0, policy_version 849215 (0.0006) [2023-12-28 01:21:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 435412992. Throughput: 0: 9889.1, 1: 9839.4. Samples: 435422780. Policy #0 lag: (min: 27.0, avg: 28.5, max: 54.0) [2023-12-28 01:21:21,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-5.057')] [2023-12-28 01:21:21,406][106225] Updated weights for policy 1, policy_version 851236 (0.0010) [2023-12-28 01:21:21,468][106225] Updated weights for policy 1, policy_version 851246 (0.0011) [2023-12-28 01:21:21,516][106226] Updated weights for policy 0, policy_version 849225 (0.0006) [2023-12-28 01:21:21,534][106225] Updated weights for policy 1, policy_version 851256 (0.0009) [2023-12-28 01:21:21,575][106226] Updated weights for policy 0, policy_version 849235 (0.0006) [2023-12-28 01:21:21,637][106226] Updated weights for policy 0, policy_version 849245 (0.0008) [2023-12-28 01:21:21,708][106226] Updated weights for policy 0, policy_version 849255 (0.0008) [2023-12-28 01:21:22,334][106225] Updated weights for policy 1, policy_version 851266 (0.0010) [2023-12-28 01:21:22,403][106225] Updated weights for policy 1, policy_version 851276 (0.0010) [2023-12-28 01:21:22,456][106225] Updated weights for policy 1, policy_version 851286 (0.0009) [2023-12-28 01:21:22,473][106226] Updated weights for policy 0, policy_version 849265 (0.0007) [2023-12-28 01:21:22,510][106225] Updated weights for policy 1, policy_version 851296 (0.0009) [2023-12-28 01:21:22,533][106226] Updated weights for policy 0, policy_version 849275 (0.0007) [2023-12-28 01:21:22,594][106226] Updated weights for policy 0, policy_version 849285 (0.0007) [2023-12-28 01:21:23,271][106226] Updated weights for policy 0, policy_version 849295 (0.0007) [2023-12-28 01:21:23,301][106225] Updated weights for policy 1, policy_version 851306 (0.0007) [2023-12-28 01:21:23,325][106226] Updated weights for policy 0, policy_version 849305 (0.0007) [2023-12-28 01:21:23,348][106225] Updated weights for policy 1, policy_version 851316 (0.0007) [2023-12-28 01:21:23,376][106226] Updated weights for policy 0, policy_version 849315 (0.0010) [2023-12-28 01:21:23,398][106225] Updated weights for policy 1, policy_version 851326 (0.0008) [2023-12-28 01:21:24,090][106226] Updated weights for policy 0, policy_version 849325 (0.0007) [2023-12-28 01:21:24,150][106225] Updated weights for policy 1, policy_version 851336 (0.0008) [2023-12-28 01:21:24,152][106226] Updated weights for policy 0, policy_version 849335 (0.0009) [2023-12-28 01:21:24,212][106226] Updated weights for policy 0, policy_version 849345 (0.0006) [2023-12-28 01:21:24,216][106225] Updated weights for policy 1, policy_version 851346 (0.0008) [2023-12-28 01:21:24,278][106225] Updated weights for policy 1, policy_version 851356 (0.0008) [2023-12-28 01:21:24,931][106226] Updated weights for policy 0, policy_version 849355 (0.0006) [2023-12-28 01:21:24,976][106225] Updated weights for policy 1, policy_version 851366 (0.0007) [2023-12-28 01:21:24,989][106226] Updated weights for policy 0, policy_version 849365 (0.0006) [2023-12-28 01:21:25,035][106225] Updated weights for policy 1, policy_version 851376 (0.0007) [2023-12-28 01:21:25,057][106226] Updated weights for policy 0, policy_version 849375 (0.0005) [2023-12-28 01:21:25,093][106225] Updated weights for policy 1, policy_version 851386 (0.0007) [2023-12-28 01:21:25,753][106226] Updated weights for policy 0, policy_version 849385 (0.0007) [2023-12-28 01:21:25,813][106226] Updated weights for policy 0, policy_version 849395 (0.0008) [2023-12-28 01:21:25,819][106225] Updated weights for policy 1, policy_version 851396 (0.0006) [2023-12-28 01:21:25,868][106226] Updated weights for policy 0, policy_version 849405 (0.0007) [2023-12-28 01:21:25,875][106225] Updated weights for policy 1, policy_version 851406 (0.0005) [2023-12-28 01:21:25,921][106226] Updated weights for policy 0, policy_version 849415 (0.0008) [2023-12-28 01:21:25,931][106225] Updated weights for policy 1, policy_version 851416 (0.0005) [2023-12-28 01:21:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 435511296. Throughput: 0: 9870.6, 1: 9765.6. Samples: 435478708. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:26,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.872')] [2023-12-28 01:21:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000849416_217505792.pth... [2023-12-28 01:21:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000851424_218005504.pth... [2023-12-28 01:21:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000848264_217210880.pth [2023-12-28 01:21:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000850272_217710592.pth [2023-12-28 01:21:26,615][106226] Updated weights for policy 0, policy_version 849425 (0.0006) [2023-12-28 01:21:26,626][106225] Updated weights for policy 1, policy_version 851426 (0.0008) [2023-12-28 01:21:26,670][106226] Updated weights for policy 0, policy_version 849435 (0.0006) [2023-12-28 01:21:26,687][106225] Updated weights for policy 1, policy_version 851436 (0.0007) [2023-12-28 01:21:26,730][106226] Updated weights for policy 0, policy_version 849445 (0.0007) [2023-12-28 01:21:26,743][106225] Updated weights for policy 1, policy_version 851446 (0.0007) [2023-12-28 01:21:26,801][106225] Updated weights for policy 1, policy_version 851456 (0.0009) [2023-12-28 01:21:27,409][106225] Updated weights for policy 1, policy_version 851466 (0.0009) [2023-12-28 01:21:27,456][106225] Updated weights for policy 1, policy_version 851476 (0.0007) [2023-12-28 01:21:27,458][106226] Updated weights for policy 0, policy_version 849455 (0.0008) [2023-12-28 01:21:27,510][106225] Updated weights for policy 1, policy_version 851486 (0.0006) [2023-12-28 01:21:27,512][106226] Updated weights for policy 0, policy_version 849465 (0.0006) [2023-12-28 01:21:27,568][106226] Updated weights for policy 0, policy_version 849475 (0.0008) [2023-12-28 01:21:28,220][106225] Updated weights for policy 1, policy_version 851496 (0.0008) [2023-12-28 01:21:28,226][106226] Updated weights for policy 0, policy_version 849485 (0.0008) [2023-12-28 01:21:28,268][106225] Updated weights for policy 1, policy_version 851506 (0.0007) [2023-12-28 01:21:28,279][106226] Updated weights for policy 0, policy_version 849495 (0.0007) [2023-12-28 01:21:28,332][106225] Updated weights for policy 1, policy_version 851516 (0.0006) [2023-12-28 01:21:28,342][106226] Updated weights for policy 0, policy_version 849505 (0.0008) [2023-12-28 01:21:29,045][106225] Updated weights for policy 1, policy_version 851526 (0.0008) [2023-12-28 01:21:29,084][106226] Updated weights for policy 0, policy_version 849515 (0.0007) [2023-12-28 01:21:29,105][106225] Updated weights for policy 1, policy_version 851536 (0.0008) [2023-12-28 01:21:29,144][106226] Updated weights for policy 0, policy_version 849525 (0.0006) [2023-12-28 01:21:29,162][106225] Updated weights for policy 1, policy_version 851546 (0.0006) [2023-12-28 01:21:29,201][106226] Updated weights for policy 0, policy_version 849535 (0.0008) [2023-12-28 01:21:29,936][106225] Updated weights for policy 1, policy_version 851556 (0.0007) [2023-12-28 01:21:29,943][106226] Updated weights for policy 0, policy_version 849545 (0.0008) [2023-12-28 01:21:29,997][106225] Updated weights for policy 1, policy_version 851566 (0.0008) [2023-12-28 01:21:30,007][106226] Updated weights for policy 0, policy_version 849555 (0.0007) [2023-12-28 01:21:30,052][106225] Updated weights for policy 1, policy_version 851576 (0.0008) [2023-12-28 01:21:30,067][106226] Updated weights for policy 0, policy_version 849565 (0.0008) [2023-12-28 01:21:30,122][106226] Updated weights for policy 0, policy_version 849575 (0.0008) [2023-12-28 01:21:30,775][106225] Updated weights for policy 1, policy_version 851586 (0.0007) [2023-12-28 01:21:30,822][106225] Updated weights for policy 1, policy_version 851596 (0.0007) [2023-12-28 01:21:30,847][106226] Updated weights for policy 0, policy_version 849585 (0.0006) [2023-12-28 01:21:30,876][106225] Updated weights for policy 1, policy_version 851606 (0.0010) [2023-12-28 01:21:30,902][106226] Updated weights for policy 0, policy_version 849595 (0.0007) [2023-12-28 01:21:30,926][106225] Updated weights for policy 1, policy_version 851616 (0.0010) [2023-12-28 01:21:30,953][106226] Updated weights for policy 0, policy_version 849605 (0.0007) [2023-12-28 01:21:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 435609600. Throughput: 0: 9874.6, 1: 9708.8. Samples: 435596620. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:31,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.992')] [2023-12-28 01:21:31,684][106225] Updated weights for policy 1, policy_version 851626 (0.0007) [2023-12-28 01:21:31,705][106226] Updated weights for policy 0, policy_version 849615 (0.0008) [2023-12-28 01:21:31,745][106225] Updated weights for policy 1, policy_version 851636 (0.0007) [2023-12-28 01:21:31,773][106226] Updated weights for policy 0, policy_version 849625 (0.0009) [2023-12-28 01:21:31,810][106225] Updated weights for policy 1, policy_version 851646 (0.0006) [2023-12-28 01:21:31,838][106226] Updated weights for policy 0, policy_version 849635 (0.0006) [2023-12-28 01:21:32,511][106225] Updated weights for policy 1, policy_version 851656 (0.0007) [2023-12-28 01:21:32,516][106226] Updated weights for policy 0, policy_version 849645 (0.0008) [2023-12-28 01:21:32,560][106225] Updated weights for policy 1, policy_version 851666 (0.0007) [2023-12-28 01:21:32,571][106226] Updated weights for policy 0, policy_version 849655 (0.0006) [2023-12-28 01:21:32,613][106225] Updated weights for policy 1, policy_version 851676 (0.0007) [2023-12-28 01:21:32,632][106226] Updated weights for policy 0, policy_version 849665 (0.0008) [2023-12-28 01:21:33,260][106226] Updated weights for policy 0, policy_version 849675 (0.0011) [2023-12-28 01:21:33,326][106226] Updated weights for policy 0, policy_version 849685 (0.0007) [2023-12-28 01:21:33,386][106226] Updated weights for policy 0, policy_version 849695 (0.0008) [2023-12-28 01:21:33,400][106225] Updated weights for policy 1, policy_version 851686 (0.0009) [2023-12-28 01:21:33,475][106225] Updated weights for policy 1, policy_version 851696 (0.0008) [2023-12-28 01:21:33,541][106225] Updated weights for policy 1, policy_version 851706 (0.0008) [2023-12-28 01:21:33,916][106226] Updated weights for policy 0, policy_version 849705 (0.0005) [2023-12-28 01:21:33,971][106226] Updated weights for policy 0, policy_version 849715 (0.0005) [2023-12-28 01:21:34,029][106226] Updated weights for policy 0, policy_version 849725 (0.0005) [2023-12-28 01:21:34,079][106226] Updated weights for policy 0, policy_version 849735 (0.0005) [2023-12-28 01:21:34,098][106225] Updated weights for policy 1, policy_version 851716 (0.0008) [2023-12-28 01:21:34,167][106225] Updated weights for policy 1, policy_version 851726 (0.0009) [2023-12-28 01:21:34,223][106225] Updated weights for policy 1, policy_version 851736 (0.0010) [2023-12-28 01:21:34,741][106226] Updated weights for policy 0, policy_version 849745 (0.0007) [2023-12-28 01:21:34,806][106226] Updated weights for policy 0, policy_version 849755 (0.0006) [2023-12-28 01:21:34,866][106226] Updated weights for policy 0, policy_version 849765 (0.0008) [2023-12-28 01:21:34,936][106225] Updated weights for policy 1, policy_version 851746 (0.0010) [2023-12-28 01:21:34,993][106225] Updated weights for policy 1, policy_version 851756 (0.0010) [2023-12-28 01:21:35,051][106225] Updated weights for policy 1, policy_version 851766 (0.0010) [2023-12-28 01:21:35,111][106225] Updated weights for policy 1, policy_version 851776 (0.0010) [2023-12-28 01:21:35,522][106226] Updated weights for policy 0, policy_version 849775 (0.0009) [2023-12-28 01:21:35,579][106226] Updated weights for policy 0, policy_version 849785 (0.0009) [2023-12-28 01:21:35,638][106226] Updated weights for policy 0, policy_version 849795 (0.0010) [2023-12-28 01:21:35,746][106225] Updated weights for policy 1, policy_version 851786 (0.0009) [2023-12-28 01:21:35,801][106225] Updated weights for policy 1, policy_version 851796 (0.0010) [2023-12-28 01:21:35,856][106225] Updated weights for policy 1, policy_version 851806 (0.0010) [2023-12-28 01:21:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 435707904. Throughput: 0: 9941.8, 1: 9758.3. Samples: 435718448. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:36,175][105115] Avg episode reward: [(0, '-3.983'), (1, '-5.175')] [2023-12-28 01:21:36,334][106226] Updated weights for policy 0, policy_version 849805 (0.0011) [2023-12-28 01:21:36,384][106226] Updated weights for policy 0, policy_version 849815 (0.0009) [2023-12-28 01:21:36,435][106226] Updated weights for policy 0, policy_version 849825 (0.0010) [2023-12-28 01:21:36,529][106225] Updated weights for policy 1, policy_version 851816 (0.0008) [2023-12-28 01:21:36,577][106225] Updated weights for policy 1, policy_version 851826 (0.0008) [2023-12-28 01:21:36,628][106225] Updated weights for policy 1, policy_version 851836 (0.0009) [2023-12-28 01:21:37,120][106226] Updated weights for policy 0, policy_version 849835 (0.0009) [2023-12-28 01:21:37,170][106226] Updated weights for policy 0, policy_version 849845 (0.0008) [2023-12-28 01:21:37,219][106226] Updated weights for policy 0, policy_version 849855 (0.0005) [2023-12-28 01:21:37,250][106225] Updated weights for policy 1, policy_version 851846 (0.0005) [2023-12-28 01:21:37,307][106225] Updated weights for policy 1, policy_version 851856 (0.0005) [2023-12-28 01:21:37,373][106225] Updated weights for policy 1, policy_version 851866 (0.0006) [2023-12-28 01:21:37,823][106226] Updated weights for policy 0, policy_version 849865 (0.0006) [2023-12-28 01:21:37,880][106226] Updated weights for policy 0, policy_version 849875 (0.0011) [2023-12-28 01:21:37,940][106226] Updated weights for policy 0, policy_version 849885 (0.0010) [2023-12-28 01:21:37,949][106225] Updated weights for policy 1, policy_version 851877 (0.0007) [2023-12-28 01:21:37,997][106226] Updated weights for policy 0, policy_version 849895 (0.0010) [2023-12-28 01:21:38,001][106225] Updated weights for policy 1, policy_version 851887 (0.0005) [2023-12-28 01:21:38,048][106225] Updated weights for policy 1, policy_version 851897 (0.0005) [2023-12-28 01:21:38,748][106226] Updated weights for policy 0, policy_version 849905 (0.0008) [2023-12-28 01:21:38,767][106225] Updated weights for policy 1, policy_version 851907 (0.0006) [2023-12-28 01:21:38,801][106226] Updated weights for policy 0, policy_version 849915 (0.0007) [2023-12-28 01:21:38,827][106225] Updated weights for policy 1, policy_version 851917 (0.0006) [2023-12-28 01:21:38,846][106226] Updated weights for policy 0, policy_version 849925 (0.0006) [2023-12-28 01:21:38,883][106225] Updated weights for policy 1, policy_version 851927 (0.0008) [2023-12-28 01:21:39,614][106226] Updated weights for policy 0, policy_version 849935 (0.0009) [2023-12-28 01:21:39,670][106225] Updated weights for policy 1, policy_version 851937 (0.0008) [2023-12-28 01:21:39,679][106226] Updated weights for policy 0, policy_version 849945 (0.0009) [2023-12-28 01:21:39,720][106225] Updated weights for policy 1, policy_version 851947 (0.0006) [2023-12-28 01:21:39,738][106226] Updated weights for policy 0, policy_version 849955 (0.0006) [2023-12-28 01:21:39,769][106225] Updated weights for policy 1, policy_version 851957 (0.0006) [2023-12-28 01:21:39,836][106225] Updated weights for policy 1, policy_version 851967 (0.0009) [2023-12-28 01:21:40,521][106225] Updated weights for policy 1, policy_version 851977 (0.0006) [2023-12-28 01:21:40,529][106226] Updated weights for policy 0, policy_version 849965 (0.0007) [2023-12-28 01:21:40,571][106225] Updated weights for policy 1, policy_version 851987 (0.0005) [2023-12-28 01:21:40,578][106226] Updated weights for policy 0, policy_version 849975 (0.0007) [2023-12-28 01:21:40,620][106225] Updated weights for policy 1, policy_version 851997 (0.0006) [2023-12-28 01:21:40,630][106226] Updated weights for policy 0, policy_version 849985 (0.0008) [2023-12-28 01:21:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 435806208. Throughput: 0: 9980.1, 1: 9857.2. Samples: 435780904. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:41,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.974')] [2023-12-28 01:21:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000852000_218152960.pth... [2023-12-28 01:21:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000849992_217653248.pth... [2023-12-28 01:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000848840_217358336.pth [2023-12-28 01:21:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000850848_217858048.pth [2023-12-28 01:21:41,380][106225] Updated weights for policy 1, policy_version 852007 (0.0008) [2023-12-28 01:21:41,408][106226] Updated weights for policy 0, policy_version 849995 (0.0008) [2023-12-28 01:21:41,444][106225] Updated weights for policy 1, policy_version 852017 (0.0008) [2023-12-28 01:21:41,464][106226] Updated weights for policy 0, policy_version 850005 (0.0008) [2023-12-28 01:21:41,488][106225] Updated weights for policy 1, policy_version 852027 (0.0006) [2023-12-28 01:21:41,524][106226] Updated weights for policy 0, policy_version 850015 (0.0008) [2023-12-28 01:21:42,264][106225] Updated weights for policy 1, policy_version 852037 (0.0007) [2023-12-28 01:21:42,287][106226] Updated weights for policy 0, policy_version 850025 (0.0008) [2023-12-28 01:21:42,327][106225] Updated weights for policy 1, policy_version 852047 (0.0007) [2023-12-28 01:21:42,350][106226] Updated weights for policy 0, policy_version 850035 (0.0008) [2023-12-28 01:21:42,389][106225] Updated weights for policy 1, policy_version 852057 (0.0007) [2023-12-28 01:21:42,416][106226] Updated weights for policy 0, policy_version 850045 (0.0007) [2023-12-28 01:21:42,469][106226] Updated weights for policy 0, policy_version 850055 (0.0009) [2023-12-28 01:21:43,025][106225] Updated weights for policy 1, policy_version 852067 (0.0006) [2023-12-28 01:21:43,076][106225] Updated weights for policy 1, policy_version 852077 (0.0007) [2023-12-28 01:21:43,135][106225] Updated weights for policy 1, policy_version 852087 (0.0009) [2023-12-28 01:21:43,256][106226] Updated weights for policy 0, policy_version 850065 (0.0006) [2023-12-28 01:21:43,303][106226] Updated weights for policy 0, policy_version 850075 (0.0008) [2023-12-28 01:21:43,357][106226] Updated weights for policy 0, policy_version 850085 (0.0005) [2023-12-28 01:21:43,878][106225] Updated weights for policy 1, policy_version 852097 (0.0008) [2023-12-28 01:21:43,940][106225] Updated weights for policy 1, policy_version 852107 (0.0010) [2023-12-28 01:21:43,948][106226] Updated weights for policy 0, policy_version 850095 (0.0008) [2023-12-28 01:21:43,987][106225] Updated weights for policy 1, policy_version 852117 (0.0010) [2023-12-28 01:21:44,000][106226] Updated weights for policy 0, policy_version 850105 (0.0010) [2023-12-28 01:21:44,041][106225] Updated weights for policy 1, policy_version 852127 (0.0010) [2023-12-28 01:21:44,049][106226] Updated weights for policy 0, policy_version 850115 (0.0009) [2023-12-28 01:21:44,681][106226] Updated weights for policy 0, policy_version 850125 (0.0011) [2023-12-28 01:21:44,739][106226] Updated weights for policy 0, policy_version 850135 (0.0011) [2023-12-28 01:21:44,759][106225] Updated weights for policy 1, policy_version 852137 (0.0010) [2023-12-28 01:21:44,806][106226] Updated weights for policy 0, policy_version 850145 (0.0010) [2023-12-28 01:21:44,822][106225] Updated weights for policy 1, policy_version 852147 (0.0010) [2023-12-28 01:21:44,883][106225] Updated weights for policy 1, policy_version 852157 (0.0007) [2023-12-28 01:21:45,415][106226] Updated weights for policy 0, policy_version 850155 (0.0009) [2023-12-28 01:21:45,476][106226] Updated weights for policy 0, policy_version 850165 (0.0005) [2023-12-28 01:21:45,541][106226] Updated weights for policy 0, policy_version 850175 (0.0008) [2023-12-28 01:21:45,678][106225] Updated weights for policy 1, policy_version 852167 (0.0009) [2023-12-28 01:21:45,732][106225] Updated weights for policy 1, policy_version 852177 (0.0010) [2023-12-28 01:21:45,779][106225] Updated weights for policy 1, policy_version 852187 (0.0010) [2023-12-28 01:21:46,173][106226] Updated weights for policy 0, policy_version 850185 (0.0011) [2023-12-28 01:21:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19882.9). Total num frames: 435904512. Throughput: 0: 9933.1, 1: 9793.5. Samples: 435896388. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:46,176][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.800')] [2023-12-28 01:21:46,220][106226] Updated weights for policy 0, policy_version 850195 (0.0010) [2023-12-28 01:21:46,266][106226] Updated weights for policy 0, policy_version 850205 (0.0010) [2023-12-28 01:21:46,311][106226] Updated weights for policy 0, policy_version 850215 (0.0007) [2023-12-28 01:21:46,507][106225] Updated weights for policy 1, policy_version 852197 (0.0008) [2023-12-28 01:21:46,563][106225] Updated weights for policy 1, policy_version 852207 (0.0005) [2023-12-28 01:21:46,616][106225] Updated weights for policy 1, policy_version 852217 (0.0006) [2023-12-28 01:21:46,996][106226] Updated weights for policy 0, policy_version 850225 (0.0010) [2023-12-28 01:21:47,062][106226] Updated weights for policy 0, policy_version 850235 (0.0010) [2023-12-28 01:21:47,125][106226] Updated weights for policy 0, policy_version 850245 (0.0010) [2023-12-28 01:21:47,177][106225] Updated weights for policy 1, policy_version 852227 (0.0006) [2023-12-28 01:21:47,241][106225] Updated weights for policy 1, policy_version 852237 (0.0008) [2023-12-28 01:21:47,309][106225] Updated weights for policy 1, policy_version 852247 (0.0009) [2023-12-28 01:21:47,702][106226] Updated weights for policy 0, policy_version 850255 (0.0010) [2023-12-28 01:21:47,752][106226] Updated weights for policy 0, policy_version 850265 (0.0010) [2023-12-28 01:21:47,819][106226] Updated weights for policy 0, policy_version 850275 (0.0010) [2023-12-28 01:21:48,062][106225] Updated weights for policy 1, policy_version 852257 (0.0008) [2023-12-28 01:21:48,116][106225] Updated weights for policy 1, policy_version 852267 (0.0007) [2023-12-28 01:21:48,162][106225] Updated weights for policy 1, policy_version 852277 (0.0007) [2023-12-28 01:21:48,212][106225] Updated weights for policy 1, policy_version 852287 (0.0008) [2023-12-28 01:21:48,521][106226] Updated weights for policy 0, policy_version 850285 (0.0006) [2023-12-28 01:21:48,586][106226] Updated weights for policy 0, policy_version 850295 (0.0010) [2023-12-28 01:21:48,648][106226] Updated weights for policy 0, policy_version 850305 (0.0011) [2023-12-28 01:21:48,975][106225] Updated weights for policy 1, policy_version 852297 (0.0006) [2023-12-28 01:21:49,037][106225] Updated weights for policy 1, policy_version 852307 (0.0008) [2023-12-28 01:21:49,084][106225] Updated weights for policy 1, policy_version 852317 (0.0008) [2023-12-28 01:21:49,299][106226] Updated weights for policy 0, policy_version 850315 (0.0010) [2023-12-28 01:21:49,367][106226] Updated weights for policy 0, policy_version 850325 (0.0008) [2023-12-28 01:21:49,431][106226] Updated weights for policy 0, policy_version 850335 (0.0009) [2023-12-28 01:21:49,772][106225] Updated weights for policy 1, policy_version 852327 (0.0006) [2023-12-28 01:21:49,828][106225] Updated weights for policy 1, policy_version 852337 (0.0006) [2023-12-28 01:21:49,891][106225] Updated weights for policy 1, policy_version 852347 (0.0007) [2023-12-28 01:21:50,220][106226] Updated weights for policy 0, policy_version 850345 (0.0010) [2023-12-28 01:21:50,281][106226] Updated weights for policy 0, policy_version 850355 (0.0011) [2023-12-28 01:21:50,342][106226] Updated weights for policy 0, policy_version 850365 (0.0011) [2023-12-28 01:21:50,402][106226] Updated weights for policy 0, policy_version 850375 (0.0011) [2023-12-28 01:21:50,590][106225] Updated weights for policy 1, policy_version 852357 (0.0007) [2023-12-28 01:21:50,641][106225] Updated weights for policy 1, policy_version 852367 (0.0007) [2023-12-28 01:21:50,708][106225] Updated weights for policy 1, policy_version 852377 (0.0008) [2023-12-28 01:21:51,138][106226] Updated weights for policy 0, policy_version 850385 (0.0008) [2023-12-28 01:21:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 436002816. Throughput: 0: 9890.3, 1: 9769.0. Samples: 436015968. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:51,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.069')] [2023-12-28 01:21:51,208][106226] Updated weights for policy 0, policy_version 850395 (0.0009) [2023-12-28 01:21:51,275][106226] Updated weights for policy 0, policy_version 850405 (0.0008) [2023-12-28 01:21:51,456][106225] Updated weights for policy 1, policy_version 852387 (0.0008) [2023-12-28 01:21:51,503][106225] Updated weights for policy 1, policy_version 852397 (0.0008) [2023-12-28 01:21:51,555][106225] Updated weights for policy 1, policy_version 852407 (0.0008) [2023-12-28 01:21:52,065][106226] Updated weights for policy 0, policy_version 850415 (0.0009) [2023-12-28 01:21:52,125][106226] Updated weights for policy 0, policy_version 850425 (0.0009) [2023-12-28 01:21:52,186][106226] Updated weights for policy 0, policy_version 850435 (0.0009) [2023-12-28 01:21:52,259][106225] Updated weights for policy 1, policy_version 852417 (0.0008) [2023-12-28 01:21:52,322][106225] Updated weights for policy 1, policy_version 852427 (0.0007) [2023-12-28 01:21:52,381][106225] Updated weights for policy 1, policy_version 852437 (0.0008) [2023-12-28 01:21:52,434][106225] Updated weights for policy 1, policy_version 852447 (0.0009) [2023-12-28 01:21:52,895][106226] Updated weights for policy 0, policy_version 850445 (0.0007) [2023-12-28 01:21:52,958][106226] Updated weights for policy 0, policy_version 850455 (0.0005) [2023-12-28 01:21:53,013][106226] Updated weights for policy 0, policy_version 850465 (0.0005) [2023-12-28 01:21:53,098][106225] Updated weights for policy 1, policy_version 852457 (0.0005) [2023-12-28 01:21:53,146][106225] Updated weights for policy 1, policy_version 852467 (0.0005) [2023-12-28 01:21:53,199][106225] Updated weights for policy 1, policy_version 852477 (0.0005) [2023-12-28 01:21:53,708][106225] Updated weights for policy 1, policy_version 852487 (0.0008) [2023-12-28 01:21:53,727][106226] Updated weights for policy 0, policy_version 850475 (0.0006) [2023-12-28 01:21:53,757][106225] Updated weights for policy 1, policy_version 852497 (0.0006) [2023-12-28 01:21:53,776][106226] Updated weights for policy 0, policy_version 850485 (0.0006) [2023-12-28 01:21:53,811][106225] Updated weights for policy 1, policy_version 852507 (0.0008) [2023-12-28 01:21:53,821][106226] Updated weights for policy 0, policy_version 850495 (0.0008) [2023-12-28 01:21:54,548][106225] Updated weights for policy 1, policy_version 852517 (0.0006) [2023-12-28 01:21:54,551][106226] Updated weights for policy 0, policy_version 850505 (0.0007) [2023-12-28 01:21:54,605][106226] Updated weights for policy 0, policy_version 850515 (0.0008) [2023-12-28 01:21:54,618][106225] Updated weights for policy 1, policy_version 852527 (0.0005) [2023-12-28 01:21:54,664][106226] Updated weights for policy 0, policy_version 850525 (0.0009) [2023-12-28 01:21:54,671][106225] Updated weights for policy 1, policy_version 852537 (0.0006) [2023-12-28 01:21:54,734][106226] Updated weights for policy 0, policy_version 850535 (0.0009) [2023-12-28 01:21:55,378][106225] Updated weights for policy 1, policy_version 852547 (0.0008) [2023-12-28 01:21:55,426][106226] Updated weights for policy 0, policy_version 850545 (0.0006) [2023-12-28 01:21:55,435][106225] Updated weights for policy 1, policy_version 852557 (0.0010) [2023-12-28 01:21:55,475][106226] Updated weights for policy 0, policy_version 850555 (0.0006) [2023-12-28 01:21:55,485][106225] Updated weights for policy 1, policy_version 852567 (0.0010) [2023-12-28 01:21:55,528][106226] Updated weights for policy 0, policy_version 850565 (0.0010) [2023-12-28 01:21:56,172][106225] Updated weights for policy 1, policy_version 852577 (0.0006) [2023-12-28 01:21:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 436101120. Throughput: 0: 9868.5, 1: 9823.7. Samples: 436076012. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:21:56,175][105115] Avg episode reward: [(0, '-4.032'), (1, '-5.105')] [2023-12-28 01:21:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000850568_217800704.pth... [2023-12-28 01:21:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000849416_217505792.pth [2023-12-28 01:21:56,226][106225] Updated weights for policy 1, policy_version 852587 (0.0010) [2023-12-28 01:21:56,232][106226] Updated weights for policy 0, policy_version 850575 (0.0007) [2023-12-28 01:21:56,281][106225] Updated weights for policy 1, policy_version 852597 (0.0010) [2023-12-28 01:21:56,283][106226] Updated weights for policy 0, policy_version 850585 (0.0007) [2023-12-28 01:21:56,328][106226] Updated weights for policy 0, policy_version 850595 (0.0007) [2023-12-28 01:21:56,338][106225] Updated weights for policy 1, policy_version 852607 (0.0010) [2023-12-28 01:21:56,342][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000852608_218308608.pth... [2023-12-28 01:21:56,346][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000851424_218005504.pth [2023-12-28 01:21:57,049][106226] Updated weights for policy 0, policy_version 850605 (0.0006) [2023-12-28 01:21:57,068][106225] Updated weights for policy 1, policy_version 852617 (0.0010) [2023-12-28 01:21:57,104][106226] Updated weights for policy 0, policy_version 850615 (0.0006) [2023-12-28 01:21:57,115][106225] Updated weights for policy 1, policy_version 852627 (0.0007) [2023-12-28 01:21:57,162][106226] Updated weights for policy 0, policy_version 850625 (0.0008) [2023-12-28 01:21:57,169][106225] Updated weights for policy 1, policy_version 852637 (0.0006) [2023-12-28 01:21:57,776][106225] Updated weights for policy 1, policy_version 852647 (0.0007) [2023-12-28 01:21:57,826][106225] Updated weights for policy 1, policy_version 852657 (0.0010) [2023-12-28 01:21:57,854][106226] Updated weights for policy 0, policy_version 850635 (0.0007) [2023-12-28 01:21:57,876][106225] Updated weights for policy 1, policy_version 852667 (0.0010) [2023-12-28 01:21:57,915][106226] Updated weights for policy 0, policy_version 850645 (0.0008) [2023-12-28 01:21:57,978][106226] Updated weights for policy 0, policy_version 850655 (0.0011) [2023-12-28 01:21:58,528][106225] Updated weights for policy 1, policy_version 852677 (0.0007) [2023-12-28 01:21:58,591][106225] Updated weights for policy 1, policy_version 852687 (0.0008) [2023-12-28 01:21:58,648][106225] Updated weights for policy 1, policy_version 852697 (0.0008) [2023-12-28 01:21:58,811][106226] Updated weights for policy 0, policy_version 850665 (0.0009) [2023-12-28 01:21:58,881][106226] Updated weights for policy 0, policy_version 850675 (0.0009) [2023-12-28 01:21:58,950][106226] Updated weights for policy 0, policy_version 850685 (0.0008) [2023-12-28 01:21:59,026][106226] Updated weights for policy 0, policy_version 850695 (0.0010) [2023-12-28 01:21:59,463][106225] Updated weights for policy 1, policy_version 852707 (0.0009) [2023-12-28 01:21:59,525][106225] Updated weights for policy 1, policy_version 852717 (0.0008) [2023-12-28 01:21:59,590][106225] Updated weights for policy 1, policy_version 852727 (0.0008) [2023-12-28 01:21:59,838][106226] Updated weights for policy 0, policy_version 850705 (0.0008) [2023-12-28 01:21:59,901][106226] Updated weights for policy 0, policy_version 850715 (0.0005) [2023-12-28 01:21:59,973][106226] Updated weights for policy 0, policy_version 850725 (0.0009) [2023-12-28 01:22:00,237][106225] Updated weights for policy 1, policy_version 852737 (0.0006) [2023-12-28 01:22:00,302][106225] Updated weights for policy 1, policy_version 852747 (0.0009) [2023-12-28 01:22:00,354][106225] Updated weights for policy 1, policy_version 852757 (0.0007) [2023-12-28 01:22:00,421][106225] Updated weights for policy 1, policy_version 852767 (0.0009) [2023-12-28 01:22:00,575][106226] Updated weights for policy 0, policy_version 850735 (0.0007) [2023-12-28 01:22:00,628][106226] Updated weights for policy 0, policy_version 850745 (0.0009) [2023-12-28 01:22:00,683][106226] Updated weights for policy 0, policy_version 850755 (0.0009) [2023-12-28 01:22:01,064][106225] Updated weights for policy 1, policy_version 852777 (0.0007) [2023-12-28 01:22:01,133][106225] Updated weights for policy 1, policy_version 852787 (0.0007) [2023-12-28 01:22:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 436199424. Throughput: 0: 9831.6, 1: 9863.5. Samples: 436192056. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:01,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.258')] [2023-12-28 01:22:01,200][106225] Updated weights for policy 1, policy_version 852797 (0.0008) [2023-12-28 01:22:01,411][106226] Updated weights for policy 0, policy_version 850766 (0.0009) [2023-12-28 01:22:01,474][106226] Updated weights for policy 0, policy_version 850776 (0.0005) [2023-12-28 01:22:01,536][106226] Updated weights for policy 0, policy_version 850786 (0.0005) [2023-12-28 01:22:01,963][106225] Updated weights for policy 1, policy_version 852807 (0.0008) [2023-12-28 01:22:02,025][106225] Updated weights for policy 1, policy_version 852817 (0.0008) [2023-12-28 01:22:02,088][106225] Updated weights for policy 1, policy_version 852827 (0.0008) [2023-12-28 01:22:02,185][106226] Updated weights for policy 0, policy_version 850796 (0.0007) [2023-12-28 01:22:02,249][106226] Updated weights for policy 0, policy_version 850806 (0.0009) [2023-12-28 01:22:02,315][106226] Updated weights for policy 0, policy_version 850816 (0.0009) [2023-12-28 01:22:02,744][106225] Updated weights for policy 1, policy_version 852837 (0.0008) [2023-12-28 01:22:02,805][106225] Updated weights for policy 1, policy_version 852847 (0.0008) [2023-12-28 01:22:02,870][106225] Updated weights for policy 1, policy_version 852857 (0.0008) [2023-12-28 01:22:03,092][106226] Updated weights for policy 0, policy_version 850826 (0.0008) [2023-12-28 01:22:03,147][106226] Updated weights for policy 0, policy_version 850836 (0.0010) [2023-12-28 01:22:03,210][106226] Updated weights for policy 0, policy_version 850846 (0.0010) [2023-12-28 01:22:03,270][106226] Updated weights for policy 0, policy_version 850856 (0.0011) [2023-12-28 01:22:03,564][106225] Updated weights for policy 1, policy_version 852867 (0.0008) [2023-12-28 01:22:03,610][106225] Updated weights for policy 1, policy_version 852877 (0.0007) [2023-12-28 01:22:03,664][106225] Updated weights for policy 1, policy_version 852887 (0.0008) [2023-12-28 01:22:03,944][106226] Updated weights for policy 0, policy_version 850866 (0.0006) [2023-12-28 01:22:04,011][106226] Updated weights for policy 0, policy_version 850876 (0.0006) [2023-12-28 01:22:04,082][106226] Updated weights for policy 0, policy_version 850886 (0.0006) [2023-12-28 01:22:04,462][106225] Updated weights for policy 1, policy_version 852897 (0.0008) [2023-12-28 01:22:04,513][106225] Updated weights for policy 1, policy_version 852907 (0.0008) [2023-12-28 01:22:04,570][106225] Updated weights for policy 1, policy_version 852917 (0.0008) [2023-12-28 01:22:04,625][106225] Updated weights for policy 1, policy_version 852927 (0.0008) [2023-12-28 01:22:04,671][106226] Updated weights for policy 0, policy_version 850896 (0.0009) [2023-12-28 01:22:04,721][106226] Updated weights for policy 0, policy_version 850906 (0.0010) [2023-12-28 01:22:04,776][106226] Updated weights for policy 0, policy_version 850916 (0.0010) [2023-12-28 01:22:05,398][106225] Updated weights for policy 1, policy_version 852937 (0.0007) [2023-12-28 01:22:05,445][106225] Updated weights for policy 1, policy_version 852947 (0.0008) [2023-12-28 01:22:05,451][106226] Updated weights for policy 0, policy_version 850926 (0.0010) [2023-12-28 01:22:05,494][106225] Updated weights for policy 1, policy_version 852957 (0.0007) [2023-12-28 01:22:05,507][106226] Updated weights for policy 0, policy_version 850936 (0.0005) [2023-12-28 01:22:05,565][106226] Updated weights for policy 0, policy_version 850946 (0.0006) [2023-12-28 01:22:06,111][106226] Updated weights for policy 0, policy_version 850956 (0.0006) [2023-12-28 01:22:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 436297728. Throughput: 0: 9913.1, 1: 9864.8. Samples: 436312788. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:06,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-5.069')] [2023-12-28 01:22:06,178][106226] Updated weights for policy 0, policy_version 850966 (0.0007) [2023-12-28 01:22:06,249][106226] Updated weights for policy 0, policy_version 850976 (0.0007) [2023-12-28 01:22:06,283][106225] Updated weights for policy 1, policy_version 852967 (0.0008) [2023-12-28 01:22:06,342][106225] Updated weights for policy 1, policy_version 852977 (0.0010) [2023-12-28 01:22:06,396][106225] Updated weights for policy 1, policy_version 852987 (0.0008) [2023-12-28 01:22:06,909][106226] Updated weights for policy 0, policy_version 850986 (0.0006) [2023-12-28 01:22:06,975][106226] Updated weights for policy 0, policy_version 850996 (0.0005) [2023-12-28 01:22:07,041][106226] Updated weights for policy 0, policy_version 851006 (0.0008) [2023-12-28 01:22:07,098][106226] Updated weights for policy 0, policy_version 851016 (0.0010) [2023-12-28 01:22:07,164][106225] Updated weights for policy 1, policy_version 852997 (0.0008) [2023-12-28 01:22:07,223][106225] Updated weights for policy 1, policy_version 853007 (0.0008) [2023-12-28 01:22:07,280][106225] Updated weights for policy 1, policy_version 853017 (0.0009) [2023-12-28 01:22:07,717][106226] Updated weights for policy 0, policy_version 851026 (0.0006) [2023-12-28 01:22:07,781][106226] Updated weights for policy 0, policy_version 851036 (0.0010) [2023-12-28 01:22:07,830][106226] Updated weights for policy 0, policy_version 851046 (0.0010) [2023-12-28 01:22:08,034][106225] Updated weights for policy 1, policy_version 853027 (0.0009) [2023-12-28 01:22:08,087][106225] Updated weights for policy 1, policy_version 853037 (0.0008) [2023-12-28 01:22:08,144][106225] Updated weights for policy 1, policy_version 853047 (0.0008) [2023-12-28 01:22:08,442][106226] Updated weights for policy 0, policy_version 851056 (0.0010) [2023-12-28 01:22:08,499][106226] Updated weights for policy 0, policy_version 851066 (0.0011) [2023-12-28 01:22:08,555][106226] Updated weights for policy 0, policy_version 851076 (0.0010) [2023-12-28 01:22:08,925][106225] Updated weights for policy 1, policy_version 853057 (0.0008) [2023-12-28 01:22:08,974][106225] Updated weights for policy 1, policy_version 853067 (0.0007) [2023-12-28 01:22:09,035][106225] Updated weights for policy 1, policy_version 853077 (0.0005) [2023-12-28 01:22:09,101][106225] Updated weights for policy 1, policy_version 853087 (0.0007) [2023-12-28 01:22:09,277][106226] Updated weights for policy 0, policy_version 851086 (0.0009) [2023-12-28 01:22:09,341][106226] Updated weights for policy 0, policy_version 851096 (0.0008) [2023-12-28 01:22:09,409][106226] Updated weights for policy 0, policy_version 851106 (0.0009) [2023-12-28 01:22:09,852][106225] Updated weights for policy 1, policy_version 853097 (0.0008) [2023-12-28 01:22:09,902][106225] Updated weights for policy 1, policy_version 853107 (0.0008) [2023-12-28 01:22:09,970][106225] Updated weights for policy 1, policy_version 853117 (0.0009) [2023-12-28 01:22:10,192][106226] Updated weights for policy 0, policy_version 851116 (0.0009) [2023-12-28 01:22:10,263][106226] Updated weights for policy 0, policy_version 851126 (0.0008) [2023-12-28 01:22:10,326][106226] Updated weights for policy 0, policy_version 851136 (0.0008) [2023-12-28 01:22:10,749][106225] Updated weights for policy 1, policy_version 853127 (0.0009) [2023-12-28 01:22:10,806][106225] Updated weights for policy 1, policy_version 853137 (0.0008) [2023-12-28 01:22:10,852][106225] Updated weights for policy 1, policy_version 853147 (0.0008) [2023-12-28 01:22:10,973][106226] Updated weights for policy 0, policy_version 851146 (0.0007) [2023-12-28 01:22:11,028][106226] Updated weights for policy 0, policy_version 851156 (0.0008) [2023-12-28 01:22:11,100][106226] Updated weights for policy 0, policy_version 851166 (0.0009) [2023-12-28 01:22:11,171][106226] Updated weights for policy 0, policy_version 851176 (0.0009) [2023-12-28 01:22:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 436404224. Throughput: 0: 9966.3, 1: 9874.6. Samples: 436371548. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:11,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.961')] [2023-12-28 01:22:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000853152_218447872.pth... [2023-12-28 01:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000851176_217956352.pth... [2023-12-28 01:22:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000852000_218152960.pth [2023-12-28 01:22:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000849992_217653248.pth [2023-12-28 01:22:11,605][106225] Updated weights for policy 1, policy_version 853157 (0.0009) [2023-12-28 01:22:11,673][106225] Updated weights for policy 1, policy_version 853167 (0.0009) [2023-12-28 01:22:11,742][106225] Updated weights for policy 1, policy_version 853177 (0.0009) [2023-12-28 01:22:11,957][106226] Updated weights for policy 0, policy_version 851186 (0.0011) [2023-12-28 01:22:12,021][106226] Updated weights for policy 0, policy_version 851196 (0.0010) [2023-12-28 01:22:12,083][106226] Updated weights for policy 0, policy_version 851206 (0.0010) [2023-12-28 01:22:12,553][106225] Updated weights for policy 1, policy_version 853187 (0.0008) [2023-12-28 01:22:12,619][106225] Updated weights for policy 1, policy_version 853197 (0.0008) [2023-12-28 01:22:12,680][106225] Updated weights for policy 1, policy_version 853207 (0.0008) [2023-12-28 01:22:12,837][106226] Updated weights for policy 0, policy_version 851216 (0.0011) [2023-12-28 01:22:12,891][106226] Updated weights for policy 0, policy_version 851226 (0.0011) [2023-12-28 01:22:12,950][106226] Updated weights for policy 0, policy_version 851236 (0.0010) [2023-12-28 01:22:13,357][106225] Updated weights for policy 1, policy_version 853217 (0.0008) [2023-12-28 01:22:13,410][106225] Updated weights for policy 1, policy_version 853227 (0.0008) [2023-12-28 01:22:13,461][106225] Updated weights for policy 1, policy_version 853237 (0.0007) [2023-12-28 01:22:13,519][106225] Updated weights for policy 1, policy_version 853247 (0.0008) [2023-12-28 01:22:13,610][106226] Updated weights for policy 0, policy_version 851246 (0.0010) [2023-12-28 01:22:13,659][106226] Updated weights for policy 0, policy_version 851256 (0.0010) [2023-12-28 01:22:13,713][106226] Updated weights for policy 0, policy_version 851266 (0.0010) [2023-12-28 01:22:14,254][106225] Updated weights for policy 1, policy_version 853257 (0.0008) [2023-12-28 01:22:14,317][106225] Updated weights for policy 1, policy_version 853267 (0.0007) [2023-12-28 01:22:14,364][106225] Updated weights for policy 1, policy_version 853277 (0.0005) [2023-12-28 01:22:14,442][106226] Updated weights for policy 0, policy_version 851276 (0.0009) [2023-12-28 01:22:14,502][106226] Updated weights for policy 0, policy_version 851286 (0.0006) [2023-12-28 01:22:14,556][106226] Updated weights for policy 0, policy_version 851296 (0.0005) [2023-12-28 01:22:14,961][106225] Updated weights for policy 1, policy_version 853287 (0.0007) [2023-12-28 01:22:15,024][106225] Updated weights for policy 1, policy_version 853297 (0.0008) [2023-12-28 01:22:15,080][106225] Updated weights for policy 1, policy_version 853307 (0.0008) [2023-12-28 01:22:15,205][106226] Updated weights for policy 0, policy_version 851306 (0.0007) [2023-12-28 01:22:15,262][106226] Updated weights for policy 0, policy_version 851316 (0.0010) [2023-12-28 01:22:15,330][106226] Updated weights for policy 0, policy_version 851326 (0.0011) [2023-12-28 01:22:15,383][106226] Updated weights for policy 0, policy_version 851336 (0.0010) [2023-12-28 01:22:15,817][106225] Updated weights for policy 1, policy_version 853317 (0.0007) [2023-12-28 01:22:15,873][106225] Updated weights for policy 1, policy_version 853327 (0.0005) [2023-12-28 01:22:15,926][106225] Updated weights for policy 1, policy_version 853337 (0.0005) [2023-12-28 01:22:16,003][106226] Updated weights for policy 0, policy_version 851346 (0.0009) [2023-12-28 01:22:16,055][106226] Updated weights for policy 0, policy_version 851356 (0.0009) [2023-12-28 01:22:16,104][106226] Updated weights for policy 0, policy_version 851366 (0.0008) [2023-12-28 01:22:16,175][105115] Fps is (10 sec: 20478.9, 60 sec: 19797.1, 300 sec: 19882.9). Total num frames: 436502528. Throughput: 0: 9956.7, 1: 9835.1. Samples: 436487268. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:16,176][105115] Avg episode reward: [(0, '-4.327'), (1, '-5.456')] [2023-12-28 01:22:16,482][106225] Updated weights for policy 1, policy_version 853347 (0.0005) [2023-12-28 01:22:16,528][106225] Updated weights for policy 1, policy_version 853357 (0.0006) [2023-12-28 01:22:16,595][106225] Updated weights for policy 1, policy_version 853367 (0.0008) [2023-12-28 01:22:16,852][106226] Updated weights for policy 0, policy_version 851376 (0.0010) [2023-12-28 01:22:16,898][106226] Updated weights for policy 0, policy_version 851386 (0.0010) [2023-12-28 01:22:16,945][106226] Updated weights for policy 0, policy_version 851396 (0.0010) [2023-12-28 01:22:17,310][106225] Updated weights for policy 1, policy_version 853377 (0.0007) [2023-12-28 01:22:17,359][106225] Updated weights for policy 1, policy_version 853387 (0.0008) [2023-12-28 01:22:17,404][106225] Updated weights for policy 1, policy_version 853397 (0.0007) [2023-12-28 01:22:17,460][106225] Updated weights for policy 1, policy_version 853407 (0.0008) [2023-12-28 01:22:17,658][106226] Updated weights for policy 0, policy_version 851406 (0.0007) [2023-12-28 01:22:17,728][106226] Updated weights for policy 0, policy_version 851416 (0.0005) [2023-12-28 01:22:17,790][106226] Updated weights for policy 0, policy_version 851426 (0.0006) [2023-12-28 01:22:18,074][106225] Updated weights for policy 1, policy_version 853417 (0.0007) [2023-12-28 01:22:18,136][106225] Updated weights for policy 1, policy_version 853427 (0.0008) [2023-12-28 01:22:18,190][106225] Updated weights for policy 1, policy_version 853437 (0.0008) [2023-12-28 01:22:18,319][106226] Updated weights for policy 0, policy_version 851436 (0.0005) [2023-12-28 01:22:18,387][106226] Updated weights for policy 0, policy_version 851446 (0.0006) [2023-12-28 01:22:18,440][106226] Updated weights for policy 0, policy_version 851456 (0.0005) [2023-12-28 01:22:18,938][106225] Updated weights for policy 1, policy_version 853447 (0.0009) [2023-12-28 01:22:18,981][106225] Updated weights for policy 1, policy_version 853457 (0.0008) [2023-12-28 01:22:19,029][106225] Updated weights for policy 1, policy_version 853467 (0.0008) [2023-12-28 01:22:19,094][106226] Updated weights for policy 0, policy_version 851466 (0.0007) [2023-12-28 01:22:19,151][106226] Updated weights for policy 0, policy_version 851476 (0.0011) [2023-12-28 01:22:19,207][106226] Updated weights for policy 0, policy_version 851486 (0.0010) [2023-12-28 01:22:19,271][106226] Updated weights for policy 0, policy_version 851496 (0.0009) [2023-12-28 01:22:19,923][106225] Updated weights for policy 1, policy_version 853477 (0.0008) [2023-12-28 01:22:19,991][106225] Updated weights for policy 1, policy_version 853487 (0.0007) [2023-12-28 01:22:20,025][106226] Updated weights for policy 0, policy_version 851506 (0.0011) [2023-12-28 01:22:20,060][106225] Updated weights for policy 1, policy_version 853497 (0.0006) [2023-12-28 01:22:20,091][106226] Updated weights for policy 0, policy_version 851516 (0.0008) [2023-12-28 01:22:20,153][106226] Updated weights for policy 0, policy_version 851526 (0.0008) [2023-12-28 01:22:20,770][106225] Updated weights for policy 1, policy_version 853507 (0.0007) [2023-12-28 01:22:20,818][106225] Updated weights for policy 1, policy_version 853517 (0.0005) [2023-12-28 01:22:20,875][106225] Updated weights for policy 1, policy_version 853527 (0.0006) [2023-12-28 01:22:20,920][106226] Updated weights for policy 0, policy_version 851536 (0.0009) [2023-12-28 01:22:20,982][106226] Updated weights for policy 0, policy_version 851546 (0.0006) [2023-12-28 01:22:21,056][106226] Updated weights for policy 0, policy_version 851556 (0.0007) [2023-12-28 01:22:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 436600832. Throughput: 0: 9911.9, 1: 9828.9. Samples: 436606784. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:21,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-5.152')] [2023-12-28 01:22:21,645][106225] Updated weights for policy 1, policy_version 853537 (0.0006) [2023-12-28 01:22:21,704][106225] Updated weights for policy 1, policy_version 853547 (0.0008) [2023-12-28 01:22:21,763][106225] Updated weights for policy 1, policy_version 853557 (0.0008) [2023-12-28 01:22:21,782][106226] Updated weights for policy 0, policy_version 851566 (0.0008) [2023-12-28 01:22:21,819][106225] Updated weights for policy 1, policy_version 853567 (0.0007) [2023-12-28 01:22:21,842][106226] Updated weights for policy 0, policy_version 851576 (0.0007) [2023-12-28 01:22:21,909][106226] Updated weights for policy 0, policy_version 851586 (0.0009) [2023-12-28 01:22:22,590][106225] Updated weights for policy 1, policy_version 853577 (0.0008) [2023-12-28 01:22:22,648][106225] Updated weights for policy 1, policy_version 853587 (0.0008) [2023-12-28 01:22:22,663][106226] Updated weights for policy 0, policy_version 851596 (0.0007) [2023-12-28 01:22:22,709][106225] Updated weights for policy 1, policy_version 853597 (0.0008) [2023-12-28 01:22:22,723][106226] Updated weights for policy 0, policy_version 851606 (0.0006) [2023-12-28 01:22:22,790][106226] Updated weights for policy 0, policy_version 851616 (0.0009) [2023-12-28 01:22:23,475][106226] Updated weights for policy 0, policy_version 851626 (0.0008) [2023-12-28 01:22:23,489][106225] Updated weights for policy 1, policy_version 853607 (0.0007) [2023-12-28 01:22:23,530][106226] Updated weights for policy 0, policy_version 851636 (0.0007) [2023-12-28 01:22:23,548][106225] Updated weights for policy 1, policy_version 853617 (0.0007) [2023-12-28 01:22:23,585][106226] Updated weights for policy 0, policy_version 851646 (0.0007) [2023-12-28 01:22:23,605][106225] Updated weights for policy 1, policy_version 853627 (0.0008) [2023-12-28 01:22:23,634][106226] Updated weights for policy 0, policy_version 851656 (0.0007) [2023-12-28 01:22:24,289][106225] Updated weights for policy 1, policy_version 853637 (0.0010) [2023-12-28 01:22:24,336][106226] Updated weights for policy 0, policy_version 851666 (0.0010) [2023-12-28 01:22:24,346][106225] Updated weights for policy 1, policy_version 853647 (0.0010) [2023-12-28 01:22:24,386][106226] Updated weights for policy 0, policy_version 851676 (0.0010) [2023-12-28 01:22:24,401][106225] Updated weights for policy 1, policy_version 853657 (0.0010) [2023-12-28 01:22:24,433][106226] Updated weights for policy 0, policy_version 851686 (0.0010) [2023-12-28 01:22:25,084][106226] Updated weights for policy 0, policy_version 851696 (0.0010) [2023-12-28 01:22:25,130][106225] Updated weights for policy 1, policy_version 853667 (0.0010) [2023-12-28 01:22:25,147][106226] Updated weights for policy 0, policy_version 851706 (0.0010) [2023-12-28 01:22:25,184][106225] Updated weights for policy 1, policy_version 853677 (0.0010) [2023-12-28 01:22:25,212][106226] Updated weights for policy 0, policy_version 851716 (0.0011) [2023-12-28 01:22:25,242][106225] Updated weights for policy 1, policy_version 853687 (0.0010) [2023-12-28 01:22:25,911][106226] Updated weights for policy 0, policy_version 851726 (0.0011) [2023-12-28 01:22:25,967][106225] Updated weights for policy 1, policy_version 853697 (0.0010) [2023-12-28 01:22:25,972][106226] Updated weights for policy 0, policy_version 851736 (0.0010) [2023-12-28 01:22:26,024][106225] Updated weights for policy 1, policy_version 853707 (0.0006) [2023-12-28 01:22:26,033][106226] Updated weights for policy 0, policy_version 851746 (0.0011) [2023-12-28 01:22:26,083][106225] Updated weights for policy 1, policy_version 853717 (0.0005) [2023-12-28 01:22:26,134][106225] Updated weights for policy 1, policy_version 853727 (0.0005) [2023-12-28 01:22:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.2, 300 sec: 19882.9). Total num frames: 436699136. Throughput: 0: 9878.7, 1: 9721.9. Samples: 436662936. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:26,176][105115] Avg episode reward: [(0, '-4.273'), (1, '-4.769')] [2023-12-28 01:22:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000851752_218103808.pth... [2023-12-28 01:22:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000853728_218595328.pth... [2023-12-28 01:22:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000850568_217800704.pth [2023-12-28 01:22:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000852608_218308608.pth [2023-12-28 01:22:26,718][106226] Updated weights for policy 0, policy_version 851756 (0.0011) [2023-12-28 01:22:26,772][106225] Updated weights for policy 1, policy_version 853737 (0.0007) [2023-12-28 01:22:26,780][106226] Updated weights for policy 0, policy_version 851766 (0.0010) [2023-12-28 01:22:26,820][106225] Updated weights for policy 1, policy_version 853747 (0.0007) [2023-12-28 01:22:26,836][106226] Updated weights for policy 0, policy_version 851776 (0.0010) [2023-12-28 01:22:26,879][106225] Updated weights for policy 1, policy_version 853757 (0.0006) [2023-12-28 01:22:27,529][106225] Updated weights for policy 1, policy_version 853767 (0.0007) [2023-12-28 01:22:27,544][106226] Updated weights for policy 0, policy_version 851786 (0.0011) [2023-12-28 01:22:27,583][106225] Updated weights for policy 1, policy_version 853777 (0.0005) [2023-12-28 01:22:27,601][106226] Updated weights for policy 0, policy_version 851796 (0.0010) [2023-12-28 01:22:27,639][106225] Updated weights for policy 1, policy_version 853787 (0.0005) [2023-12-28 01:22:27,648][106226] Updated weights for policy 0, policy_version 851806 (0.0010) [2023-12-28 01:22:27,698][106226] Updated weights for policy 0, policy_version 851816 (0.0010) [2023-12-28 01:22:28,205][106225] Updated weights for policy 1, policy_version 853797 (0.0008) [2023-12-28 01:22:28,265][106225] Updated weights for policy 1, policy_version 853807 (0.0010) [2023-12-28 01:22:28,321][106225] Updated weights for policy 1, policy_version 853817 (0.0010) [2023-12-28 01:22:28,447][106226] Updated weights for policy 0, policy_version 851826 (0.0011) [2023-12-28 01:22:28,501][106226] Updated weights for policy 0, policy_version 851836 (0.0010) [2023-12-28 01:22:28,551][106226] Updated weights for policy 0, policy_version 851846 (0.0010) [2023-12-28 01:22:29,017][106225] Updated weights for policy 1, policy_version 853827 (0.0010) [2023-12-28 01:22:29,068][106225] Updated weights for policy 1, policy_version 853837 (0.0010) [2023-12-28 01:22:29,131][106225] Updated weights for policy 1, policy_version 853847 (0.0010) [2023-12-28 01:22:29,295][106226] Updated weights for policy 0, policy_version 851856 (0.0008) [2023-12-28 01:22:29,370][106226] Updated weights for policy 0, policy_version 851866 (0.0010) [2023-12-28 01:22:29,430][106226] Updated weights for policy 0, policy_version 851876 (0.0011) [2023-12-28 01:22:29,831][106225] Updated weights for policy 1, policy_version 853857 (0.0010) [2023-12-28 01:22:29,902][106225] Updated weights for policy 1, policy_version 853867 (0.0008) [2023-12-28 01:22:29,970][106225] Updated weights for policy 1, policy_version 853877 (0.0008) [2023-12-28 01:22:30,032][106225] Updated weights for policy 1, policy_version 853887 (0.0008) [2023-12-28 01:22:30,127][106226] Updated weights for policy 0, policy_version 851886 (0.0008) [2023-12-28 01:22:30,196][106226] Updated weights for policy 0, policy_version 851896 (0.0008) [2023-12-28 01:22:30,258][106226] Updated weights for policy 0, policy_version 851906 (0.0011) [2023-12-28 01:22:30,754][106225] Updated weights for policy 1, policy_version 853897 (0.0009) [2023-12-28 01:22:30,802][106225] Updated weights for policy 1, policy_version 853907 (0.0009) [2023-12-28 01:22:30,811][106226] Updated weights for policy 0, policy_version 851916 (0.0009) [2023-12-28 01:22:30,856][106225] Updated weights for policy 1, policy_version 853917 (0.0007) [2023-12-28 01:22:30,866][106226] Updated weights for policy 0, policy_version 851926 (0.0006) [2023-12-28 01:22:30,919][106226] Updated weights for policy 0, policy_version 851936 (0.0007) [2023-12-28 01:22:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 436797440. Throughput: 0: 9907.1, 1: 9816.3. Samples: 436783936. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:31,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-5.030')] [2023-12-28 01:22:31,612][106225] Updated weights for policy 1, policy_version 853927 (0.0006) [2023-12-28 01:22:31,637][106226] Updated weights for policy 0, policy_version 851946 (0.0006) [2023-12-28 01:22:31,683][106225] Updated weights for policy 1, policy_version 853937 (0.0008) [2023-12-28 01:22:31,701][106226] Updated weights for policy 0, policy_version 851956 (0.0006) [2023-12-28 01:22:31,745][106225] Updated weights for policy 1, policy_version 853947 (0.0008) [2023-12-28 01:22:31,767][106226] Updated weights for policy 0, policy_version 851966 (0.0009) [2023-12-28 01:22:31,829][106226] Updated weights for policy 0, policy_version 851976 (0.0008) [2023-12-28 01:22:32,464][106225] Updated weights for policy 1, policy_version 853957 (0.0006) [2023-12-28 01:22:32,519][106225] Updated weights for policy 1, policy_version 853967 (0.0005) [2023-12-28 01:22:32,563][106226] Updated weights for policy 0, policy_version 851986 (0.0009) [2023-12-28 01:22:32,574][106225] Updated weights for policy 1, policy_version 853977 (0.0005) [2023-12-28 01:22:32,628][106226] Updated weights for policy 0, policy_version 851996 (0.0009) [2023-12-28 01:22:32,690][106226] Updated weights for policy 0, policy_version 852006 (0.0010) [2023-12-28 01:22:33,274][106226] Updated weights for policy 0, policy_version 852016 (0.0010) [2023-12-28 01:22:33,297][106225] Updated weights for policy 1, policy_version 853987 (0.0006) [2023-12-28 01:22:33,329][106226] Updated weights for policy 0, policy_version 852026 (0.0011) [2023-12-28 01:22:33,354][106225] Updated weights for policy 1, policy_version 853997 (0.0006) [2023-12-28 01:22:33,371][106226] Updated weights for policy 0, policy_version 852036 (0.0010) [2023-12-28 01:22:33,407][106225] Updated weights for policy 1, policy_version 854007 (0.0006) [2023-12-28 01:22:34,090][106226] Updated weights for policy 0, policy_version 852046 (0.0008) [2023-12-28 01:22:34,139][106226] Updated weights for policy 0, policy_version 852056 (0.0010) [2023-12-28 01:22:34,146][106225] Updated weights for policy 1, policy_version 854017 (0.0008) [2023-12-28 01:22:34,207][106226] Updated weights for policy 0, policy_version 852066 (0.0011) [2023-12-28 01:22:34,214][106225] Updated weights for policy 1, policy_version 854027 (0.0007) [2023-12-28 01:22:34,278][106225] Updated weights for policy 1, policy_version 854037 (0.0008) [2023-12-28 01:22:34,335][106225] Updated weights for policy 1, policy_version 854047 (0.0008) [2023-12-28 01:22:34,833][106226] Updated weights for policy 0, policy_version 852076 (0.0011) [2023-12-28 01:22:34,901][106226] Updated weights for policy 0, policy_version 852086 (0.0008) [2023-12-28 01:22:34,958][106226] Updated weights for policy 0, policy_version 852096 (0.0011) [2023-12-28 01:22:35,100][106225] Updated weights for policy 1, policy_version 854057 (0.0008) [2023-12-28 01:22:35,142][106225] Updated weights for policy 1, policy_version 854067 (0.0007) [2023-12-28 01:22:35,190][106225] Updated weights for policy 1, policy_version 854077 (0.0008) [2023-12-28 01:22:35,665][106226] Updated weights for policy 0, policy_version 852106 (0.0011) [2023-12-28 01:22:35,725][106226] Updated weights for policy 0, policy_version 852116 (0.0011) [2023-12-28 01:22:35,778][106226] Updated weights for policy 0, policy_version 852126 (0.0010) [2023-12-28 01:22:35,834][106226] Updated weights for policy 0, policy_version 852136 (0.0010) [2023-12-28 01:22:35,965][106225] Updated weights for policy 1, policy_version 854087 (0.0008) [2023-12-28 01:22:36,015][106225] Updated weights for policy 1, policy_version 854097 (0.0007) [2023-12-28 01:22:36,062][106225] Updated weights for policy 1, policy_version 854107 (0.0008) [2023-12-28 01:22:36,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 436895744. Throughput: 0: 9915.8, 1: 9776.7. Samples: 436902132. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:36,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.055')] [2023-12-28 01:22:36,598][106226] Updated weights for policy 0, policy_version 852146 (0.0011) [2023-12-28 01:22:36,661][106226] Updated weights for policy 0, policy_version 852156 (0.0011) [2023-12-28 01:22:36,729][106226] Updated weights for policy 0, policy_version 852166 (0.0012) [2023-12-28 01:22:36,841][106225] Updated weights for policy 1, policy_version 854117 (0.0008) [2023-12-28 01:22:36,908][106225] Updated weights for policy 1, policy_version 854127 (0.0007) [2023-12-28 01:22:36,973][106225] Updated weights for policy 1, policy_version 854137 (0.0008) [2023-12-28 01:22:37,392][106226] Updated weights for policy 0, policy_version 852176 (0.0010) [2023-12-28 01:22:37,458][106226] Updated weights for policy 0, policy_version 852186 (0.0011) [2023-12-28 01:22:37,515][106226] Updated weights for policy 0, policy_version 852196 (0.0011) [2023-12-28 01:22:37,678][106225] Updated weights for policy 1, policy_version 854147 (0.0007) [2023-12-28 01:22:37,733][106225] Updated weights for policy 1, policy_version 854157 (0.0008) [2023-12-28 01:22:37,786][106225] Updated weights for policy 1, policy_version 854167 (0.0008) [2023-12-28 01:22:38,180][106226] Updated weights for policy 0, policy_version 852206 (0.0011) [2023-12-28 01:22:38,232][106226] Updated weights for policy 0, policy_version 852216 (0.0010) [2023-12-28 01:22:38,292][106226] Updated weights for policy 0, policy_version 852226 (0.0009) [2023-12-28 01:22:38,550][106225] Updated weights for policy 1, policy_version 854177 (0.0008) [2023-12-28 01:22:38,602][106225] Updated weights for policy 1, policy_version 854187 (0.0008) [2023-12-28 01:22:38,666][106225] Updated weights for policy 1, policy_version 854197 (0.0008) [2023-12-28 01:22:38,728][106225] Updated weights for policy 1, policy_version 854207 (0.0008) [2023-12-28 01:22:38,938][106226] Updated weights for policy 0, policy_version 852236 (0.0008) [2023-12-28 01:22:38,993][106226] Updated weights for policy 0, policy_version 852246 (0.0005) [2023-12-28 01:22:39,055][106226] Updated weights for policy 0, policy_version 852256 (0.0006) [2023-12-28 01:22:39,517][106225] Updated weights for policy 1, policy_version 854217 (0.0009) [2023-12-28 01:22:39,579][106225] Updated weights for policy 1, policy_version 854227 (0.0010) [2023-12-28 01:22:39,638][106225] Updated weights for policy 1, policy_version 854237 (0.0011) [2023-12-28 01:22:39,690][106226] Updated weights for policy 0, policy_version 852266 (0.0005) [2023-12-28 01:22:39,752][106226] Updated weights for policy 0, policy_version 852276 (0.0006) [2023-12-28 01:22:39,811][106226] Updated weights for policy 0, policy_version 852286 (0.0009) [2023-12-28 01:22:39,881][106226] Updated weights for policy 0, policy_version 852296 (0.0008) [2023-12-28 01:22:40,348][106225] Updated weights for policy 1, policy_version 854247 (0.0010) [2023-12-28 01:22:40,415][106225] Updated weights for policy 1, policy_version 854257 (0.0008) [2023-12-28 01:22:40,471][106225] Updated weights for policy 1, policy_version 854267 (0.0008) [2023-12-28 01:22:40,620][106226] Updated weights for policy 0, policy_version 852306 (0.0006) [2023-12-28 01:22:40,679][106226] Updated weights for policy 0, policy_version 852316 (0.0009) [2023-12-28 01:22:40,741][106226] Updated weights for policy 0, policy_version 852326 (0.0010) [2023-12-28 01:22:41,125][106225] Updated weights for policy 1, policy_version 854277 (0.0008) [2023-12-28 01:22:41,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 436985856. Throughput: 0: 9983.8, 1: 9674.8. Samples: 436960652. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:41,175][105115] Avg episode reward: [(0, '-4.205'), (1, '-5.278')] [2023-12-28 01:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000852328_218251264.pth... [2023-12-28 01:22:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000851176_217956352.pth [2023-12-28 01:22:41,197][106225] Updated weights for policy 1, policy_version 854287 (0.0009) [2023-12-28 01:22:41,263][106225] Updated weights for policy 1, policy_version 854297 (0.0007) [2023-12-28 01:22:41,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000854304_218742784.pth... [2023-12-28 01:22:41,308][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000853152_218447872.pth [2023-12-28 01:22:41,537][106226] Updated weights for policy 0, policy_version 852336 (0.0008) [2023-12-28 01:22:41,609][106226] Updated weights for policy 0, policy_version 852346 (0.0007) [2023-12-28 01:22:41,677][106226] Updated weights for policy 0, policy_version 852356 (0.0007) [2023-12-28 01:22:42,048][106225] Updated weights for policy 1, policy_version 854307 (0.0008) [2023-12-28 01:22:42,112][106225] Updated weights for policy 1, policy_version 854317 (0.0009) [2023-12-28 01:22:42,176][106225] Updated weights for policy 1, policy_version 854327 (0.0008) [2023-12-28 01:22:42,341][106226] Updated weights for policy 0, policy_version 852366 (0.0007) [2023-12-28 01:22:42,409][106226] Updated weights for policy 0, policy_version 852376 (0.0008) [2023-12-28 01:22:42,470][106226] Updated weights for policy 0, policy_version 852386 (0.0006) [2023-12-28 01:22:42,910][106225] Updated weights for policy 1, policy_version 854337 (0.0009) [2023-12-28 01:22:42,958][106225] Updated weights for policy 1, policy_version 854347 (0.0008) [2023-12-28 01:22:43,006][106225] Updated weights for policy 1, policy_version 854357 (0.0009) [2023-12-28 01:22:43,074][106225] Updated weights for policy 1, policy_version 854367 (0.0008) [2023-12-28 01:22:43,158][106226] Updated weights for policy 0, policy_version 852396 (0.0007) [2023-12-28 01:22:43,216][106226] Updated weights for policy 0, policy_version 852406 (0.0008) [2023-12-28 01:22:43,266][106226] Updated weights for policy 0, policy_version 852416 (0.0008) [2023-12-28 01:22:43,800][106225] Updated weights for policy 1, policy_version 854377 (0.0008) [2023-12-28 01:22:43,852][106225] Updated weights for policy 1, policy_version 854387 (0.0009) [2023-12-28 01:22:43,907][106225] Updated weights for policy 1, policy_version 854397 (0.0008) [2023-12-28 01:22:43,989][106226] Updated weights for policy 0, policy_version 852426 (0.0007) [2023-12-28 01:22:44,044][106226] Updated weights for policy 0, policy_version 852436 (0.0005) [2023-12-28 01:22:44,105][106226] Updated weights for policy 0, policy_version 852446 (0.0005) [2023-12-28 01:22:44,166][106226] Updated weights for policy 0, policy_version 852456 (0.0010) [2023-12-28 01:22:44,666][106225] Updated weights for policy 1, policy_version 854407 (0.0009) [2023-12-28 01:22:44,716][106226] Updated weights for policy 0, policy_version 852466 (0.0005) [2023-12-28 01:22:44,719][106225] Updated weights for policy 1, policy_version 854417 (0.0008) [2023-12-28 01:22:44,772][106226] Updated weights for policy 0, policy_version 852476 (0.0006) [2023-12-28 01:22:44,781][106225] Updated weights for policy 1, policy_version 854427 (0.0009) [2023-12-28 01:22:44,838][106226] Updated weights for policy 0, policy_version 852486 (0.0010) [2023-12-28 01:22:45,515][106225] Updated weights for policy 1, policy_version 854437 (0.0006) [2023-12-28 01:22:45,522][106226] Updated weights for policy 0, policy_version 852496 (0.0011) [2023-12-28 01:22:45,569][106225] Updated weights for policy 1, policy_version 854447 (0.0005) [2023-12-28 01:22:45,581][106226] Updated weights for policy 0, policy_version 852506 (0.0010) [2023-12-28 01:22:45,617][106225] Updated weights for policy 1, policy_version 854457 (0.0006) [2023-12-28 01:22:45,642][106226] Updated weights for policy 0, policy_version 852516 (0.0008) [2023-12-28 01:22:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 437084160. Throughput: 0: 10062.5, 1: 9620.6. Samples: 437077792. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:46,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.179')] [2023-12-28 01:22:46,263][106225] Updated weights for policy 1, policy_version 854467 (0.0007) [2023-12-28 01:22:46,315][106225] Updated weights for policy 1, policy_version 854477 (0.0005) [2023-12-28 01:22:46,363][106225] Updated weights for policy 1, policy_version 854487 (0.0005) [2023-12-28 01:22:46,382][106226] Updated weights for policy 0, policy_version 852526 (0.0007) [2023-12-28 01:22:46,434][106226] Updated weights for policy 0, policy_version 852536 (0.0009) [2023-12-28 01:22:46,493][106226] Updated weights for policy 0, policy_version 852546 (0.0007) [2023-12-28 01:22:46,875][106225] Updated weights for policy 1, policy_version 854497 (0.0005) [2023-12-28 01:22:46,927][106225] Updated weights for policy 1, policy_version 854507 (0.0005) [2023-12-28 01:22:46,975][106225] Updated weights for policy 1, policy_version 854517 (0.0005) [2023-12-28 01:22:47,023][106225] Updated weights for policy 1, policy_version 854527 (0.0008) [2023-12-28 01:22:47,279][106226] Updated weights for policy 0, policy_version 852556 (0.0007) [2023-12-28 01:22:47,336][106226] Updated weights for policy 0, policy_version 852566 (0.0009) [2023-12-28 01:22:47,395][106226] Updated weights for policy 0, policy_version 852576 (0.0009) [2023-12-28 01:22:47,671][106225] Updated weights for policy 1, policy_version 854537 (0.0006) [2023-12-28 01:22:47,719][106225] Updated weights for policy 1, policy_version 854547 (0.0005) [2023-12-28 01:22:47,762][106225] Updated weights for policy 1, policy_version 854557 (0.0005) [2023-12-28 01:22:48,195][106226] Updated weights for policy 0, policy_version 852586 (0.0009) [2023-12-28 01:22:48,244][106226] Updated weights for policy 0, policy_version 852596 (0.0008) [2023-12-28 01:22:48,292][106226] Updated weights for policy 0, policy_version 852606 (0.0008) [2023-12-28 01:22:48,353][106226] Updated weights for policy 0, policy_version 852616 (0.0008) [2023-12-28 01:22:48,379][106225] Updated weights for policy 1, policy_version 854567 (0.0008) [2023-12-28 01:22:48,441][106225] Updated weights for policy 1, policy_version 854577 (0.0008) [2023-12-28 01:22:48,500][106225] Updated weights for policy 1, policy_version 854587 (0.0008) [2023-12-28 01:22:49,082][106226] Updated weights for policy 0, policy_version 852626 (0.0008) [2023-12-28 01:22:49,143][106226] Updated weights for policy 0, policy_version 852636 (0.0008) [2023-12-28 01:22:49,209][106226] Updated weights for policy 0, policy_version 852646 (0.0008) [2023-12-28 01:22:49,215][106225] Updated weights for policy 1, policy_version 854597 (0.0010) [2023-12-28 01:22:49,279][106225] Updated weights for policy 1, policy_version 854607 (0.0007) [2023-12-28 01:22:49,338][106225] Updated weights for policy 1, policy_version 854617 (0.0006) [2023-12-28 01:22:49,913][106226] Updated weights for policy 0, policy_version 852656 (0.0006) [2023-12-28 01:22:49,989][106226] Updated weights for policy 0, policy_version 852666 (0.0007) [2023-12-28 01:22:50,004][106225] Updated weights for policy 1, policy_version 854627 (0.0008) [2023-12-28 01:22:50,055][106226] Updated weights for policy 0, policy_version 852676 (0.0006) [2023-12-28 01:22:50,067][106225] Updated weights for policy 1, policy_version 854637 (0.0008) [2023-12-28 01:22:50,133][106225] Updated weights for policy 1, policy_version 854647 (0.0008) [2023-12-28 01:22:50,725][106226] Updated weights for policy 0, policy_version 852686 (0.0007) [2023-12-28 01:22:50,784][106226] Updated weights for policy 0, policy_version 852696 (0.0008) [2023-12-28 01:22:50,842][106226] Updated weights for policy 0, policy_version 852706 (0.0008) [2023-12-28 01:22:50,878][106225] Updated weights for policy 1, policy_version 854657 (0.0009) [2023-12-28 01:22:50,932][106225] Updated weights for policy 1, policy_version 854667 (0.0010) [2023-12-28 01:22:50,988][106225] Updated weights for policy 1, policy_version 854677 (0.0010) [2023-12-28 01:22:51,061][106225] Updated weights for policy 1, policy_version 854687 (0.0011) [2023-12-28 01:22:51,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 437190656. Throughput: 0: 9914.8, 1: 9736.5. Samples: 437197092. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:51,175][105115] Avg episode reward: [(0, '-4.225'), (1, '-5.152')] [2023-12-28 01:22:51,589][106226] Updated weights for policy 0, policy_version 852716 (0.0008) [2023-12-28 01:22:51,654][106226] Updated weights for policy 0, policy_version 852726 (0.0009) [2023-12-28 01:22:51,717][106226] Updated weights for policy 0, policy_version 852736 (0.0009) [2023-12-28 01:22:51,791][106225] Updated weights for policy 1, policy_version 854697 (0.0010) [2023-12-28 01:22:51,853][106225] Updated weights for policy 1, policy_version 854707 (0.0008) [2023-12-28 01:22:51,914][106225] Updated weights for policy 1, policy_version 854717 (0.0006) [2023-12-28 01:22:52,547][106226] Updated weights for policy 0, policy_version 852746 (0.0008) [2023-12-28 01:22:52,578][106225] Updated weights for policy 1, policy_version 854727 (0.0007) [2023-12-28 01:22:52,620][106226] Updated weights for policy 0, policy_version 852756 (0.0008) [2023-12-28 01:22:52,638][106225] Updated weights for policy 1, policy_version 854737 (0.0008) [2023-12-28 01:22:52,683][106226] Updated weights for policy 0, policy_version 852766 (0.0008) [2023-12-28 01:22:52,686][106225] Updated weights for policy 1, policy_version 854747 (0.0010) [2023-12-28 01:22:52,743][106226] Updated weights for policy 0, policy_version 852776 (0.0007) [2023-12-28 01:22:53,399][106225] Updated weights for policy 1, policy_version 854757 (0.0010) [2023-12-28 01:22:53,417][106226] Updated weights for policy 0, policy_version 852786 (0.0007) [2023-12-28 01:22:53,463][106225] Updated weights for policy 1, policy_version 854767 (0.0010) [2023-12-28 01:22:53,471][106226] Updated weights for policy 0, policy_version 852796 (0.0008) [2023-12-28 01:22:53,519][106225] Updated weights for policy 1, policy_version 854777 (0.0010) [2023-12-28 01:22:53,528][106226] Updated weights for policy 0, policy_version 852806 (0.0005) [2023-12-28 01:22:54,240][106225] Updated weights for policy 1, policy_version 854787 (0.0010) [2023-12-28 01:22:54,253][106226] Updated weights for policy 0, policy_version 852816 (0.0007) [2023-12-28 01:22:54,297][106225] Updated weights for policy 1, policy_version 854797 (0.0010) [2023-12-28 01:22:54,305][106226] Updated weights for policy 0, policy_version 852826 (0.0005) [2023-12-28 01:22:54,358][106225] Updated weights for policy 1, policy_version 854807 (0.0010) [2023-12-28 01:22:54,363][106226] Updated weights for policy 0, policy_version 852836 (0.0006) [2023-12-28 01:22:54,923][106226] Updated weights for policy 0, policy_version 852846 (0.0006) [2023-12-28 01:22:54,980][106226] Updated weights for policy 0, policy_version 852856 (0.0006) [2023-12-28 01:22:55,043][106226] Updated weights for policy 0, policy_version 852866 (0.0008) [2023-12-28 01:22:55,072][106225] Updated weights for policy 1, policy_version 854817 (0.0010) [2023-12-28 01:22:55,120][106225] Updated weights for policy 1, policy_version 854827 (0.0010) [2023-12-28 01:22:55,183][106225] Updated weights for policy 1, policy_version 854837 (0.0010) [2023-12-28 01:22:55,237][106225] Updated weights for policy 1, policy_version 854847 (0.0010) [2023-12-28 01:22:55,721][106226] Updated weights for policy 0, policy_version 852876 (0.0007) [2023-12-28 01:22:55,768][106226] Updated weights for policy 0, policy_version 852886 (0.0008) [2023-12-28 01:22:55,814][106226] Updated weights for policy 0, policy_version 852896 (0.0008) [2023-12-28 01:22:55,974][106225] Updated weights for policy 1, policy_version 854857 (0.0010) [2023-12-28 01:22:56,031][106225] Updated weights for policy 1, policy_version 854867 (0.0009) [2023-12-28 01:22:56,084][106225] Updated weights for policy 1, policy_version 854877 (0.0007) [2023-12-28 01:22:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 437288960. Throughput: 0: 9841.0, 1: 9772.4. Samples: 437254152. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:22:56,175][105115] Avg episode reward: [(0, '-4.072'), (1, '-5.171')] [2023-12-28 01:22:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000854880_218890240.pth... [2023-12-28 01:22:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000852904_218398720.pth... [2023-12-28 01:22:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000851752_218103808.pth [2023-12-28 01:22:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000853728_218595328.pth [2023-12-28 01:22:56,586][106226] Updated weights for policy 0, policy_version 852906 (0.0008) [2023-12-28 01:22:56,643][106226] Updated weights for policy 0, policy_version 852916 (0.0009) [2023-12-28 01:22:56,705][106226] Updated weights for policy 0, policy_version 852926 (0.0008) [2023-12-28 01:22:56,707][106225] Updated weights for policy 1, policy_version 854887 (0.0007) [2023-12-28 01:22:56,754][106226] Updated weights for policy 0, policy_version 852936 (0.0006) [2023-12-28 01:22:56,756][106225] Updated weights for policy 1, policy_version 854897 (0.0010) [2023-12-28 01:22:56,806][106225] Updated weights for policy 1, policy_version 854907 (0.0010) [2023-12-28 01:22:57,480][106226] Updated weights for policy 0, policy_version 852946 (0.0008) [2023-12-28 01:22:57,512][106225] Updated weights for policy 1, policy_version 854917 (0.0009) [2023-12-28 01:22:57,545][106226] Updated weights for policy 0, policy_version 852956 (0.0008) [2023-12-28 01:22:57,577][106225] Updated weights for policy 1, policy_version 854927 (0.0006) [2023-12-28 01:22:57,607][106226] Updated weights for policy 0, policy_version 852966 (0.0007) [2023-12-28 01:22:57,634][106225] Updated weights for policy 1, policy_version 854937 (0.0007) [2023-12-28 01:22:58,328][106225] Updated weights for policy 1, policy_version 854947 (0.0009) [2023-12-28 01:22:58,336][106226] Updated weights for policy 0, policy_version 852976 (0.0008) [2023-12-28 01:22:58,397][106225] Updated weights for policy 1, policy_version 854957 (0.0009) [2023-12-28 01:22:58,409][106226] Updated weights for policy 0, policy_version 852987 (0.0009) [2023-12-28 01:22:58,463][106225] Updated weights for policy 1, policy_version 854967 (0.0011) [2023-12-28 01:22:58,474][106226] Updated weights for policy 0, policy_version 852997 (0.0007) [2023-12-28 01:22:59,223][106225] Updated weights for policy 1, policy_version 854977 (0.0010) [2023-12-28 01:22:59,273][106226] Updated weights for policy 0, policy_version 853007 (0.0008) [2023-12-28 01:22:59,289][106225] Updated weights for policy 1, policy_version 854987 (0.0008) [2023-12-28 01:22:59,341][106226] Updated weights for policy 0, policy_version 853017 (0.0009) [2023-12-28 01:22:59,356][106225] Updated weights for policy 1, policy_version 854997 (0.0008) [2023-12-28 01:22:59,409][106226] Updated weights for policy 0, policy_version 853027 (0.0008) [2023-12-28 01:22:59,419][106225] Updated weights for policy 1, policy_version 855007 (0.0008) [2023-12-28 01:23:00,118][106225] Updated weights for policy 1, policy_version 855017 (0.0008) [2023-12-28 01:23:00,141][106226] Updated weights for policy 0, policy_version 853037 (0.0007) [2023-12-28 01:23:00,171][106225] Updated weights for policy 1, policy_version 855027 (0.0007) [2023-12-28 01:23:00,211][106226] Updated weights for policy 0, policy_version 853047 (0.0008) [2023-12-28 01:23:00,222][106225] Updated weights for policy 1, policy_version 855037 (0.0006) [2023-12-28 01:23:00,280][106226] Updated weights for policy 0, policy_version 853057 (0.0008) [2023-12-28 01:23:00,915][106226] Updated weights for policy 0, policy_version 853067 (0.0008) [2023-12-28 01:23:00,922][106225] Updated weights for policy 1, policy_version 855047 (0.0007) [2023-12-28 01:23:00,968][106225] Updated weights for policy 1, policy_version 855057 (0.0008) [2023-12-28 01:23:00,970][106226] Updated weights for policy 0, policy_version 853077 (0.0005) [2023-12-28 01:23:01,027][106225] Updated weights for policy 1, policy_version 855067 (0.0008) [2023-12-28 01:23:01,029][106226] Updated weights for policy 0, policy_version 853087 (0.0006) [2023-12-28 01:23:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 437387264. Throughput: 0: 9840.7, 1: 9787.3. Samples: 437370512. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:23:01,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.261')] [2023-12-28 01:23:01,677][106226] Updated weights for policy 0, policy_version 853097 (0.0008) [2023-12-28 01:23:01,750][106226] Updated weights for policy 0, policy_version 853107 (0.0008) [2023-12-28 01:23:01,790][106225] Updated weights for policy 1, policy_version 855077 (0.0007) [2023-12-28 01:23:01,806][106226] Updated weights for policy 0, policy_version 853117 (0.0008) [2023-12-28 01:23:01,845][106225] Updated weights for policy 1, policy_version 855087 (0.0007) [2023-12-28 01:23:01,866][106226] Updated weights for policy 0, policy_version 853127 (0.0008) [2023-12-28 01:23:01,907][106225] Updated weights for policy 1, policy_version 855097 (0.0007) [2023-12-28 01:23:02,470][106226] Updated weights for policy 0, policy_version 853137 (0.0006) [2023-12-28 01:23:02,529][106226] Updated weights for policy 0, policy_version 853147 (0.0009) [2023-12-28 01:23:02,586][106225] Updated weights for policy 1, policy_version 855107 (0.0009) [2023-12-28 01:23:02,594][106226] Updated weights for policy 0, policy_version 853157 (0.0008) [2023-12-28 01:23:02,645][106225] Updated weights for policy 1, policy_version 855117 (0.0010) [2023-12-28 01:23:02,707][106225] Updated weights for policy 1, policy_version 855127 (0.0010) [2023-12-28 01:23:03,221][106226] Updated weights for policy 0, policy_version 853167 (0.0007) [2023-12-28 01:23:03,270][106226] Updated weights for policy 0, policy_version 853177 (0.0008) [2023-12-28 01:23:03,336][106226] Updated weights for policy 0, policy_version 853187 (0.0006) [2023-12-28 01:23:03,360][106225] Updated weights for policy 1, policy_version 855137 (0.0009) [2023-12-28 01:23:03,418][106225] Updated weights for policy 1, policy_version 855147 (0.0007) [2023-12-28 01:23:03,480][106225] Updated weights for policy 1, policy_version 855157 (0.0008) [2023-12-28 01:23:03,535][106225] Updated weights for policy 1, policy_version 855167 (0.0008) [2023-12-28 01:23:04,071][106226] Updated weights for policy 0, policy_version 853197 (0.0007) [2023-12-28 01:23:04,134][106226] Updated weights for policy 0, policy_version 853207 (0.0008) [2023-12-28 01:23:04,141][106225] Updated weights for policy 1, policy_version 855177 (0.0006) [2023-12-28 01:23:04,193][106226] Updated weights for policy 0, policy_version 853217 (0.0008) [2023-12-28 01:23:04,211][106225] Updated weights for policy 1, policy_version 855187 (0.0006) [2023-12-28 01:23:04,277][106225] Updated weights for policy 1, policy_version 855197 (0.0006) [2023-12-28 01:23:04,916][106226] Updated weights for policy 0, policy_version 853227 (0.0008) [2023-12-28 01:23:04,961][106225] Updated weights for policy 1, policy_version 855207 (0.0007) [2023-12-28 01:23:04,979][106226] Updated weights for policy 0, policy_version 853237 (0.0006) [2023-12-28 01:23:05,022][106225] Updated weights for policy 1, policy_version 855217 (0.0008) [2023-12-28 01:23:05,047][106226] Updated weights for policy 0, policy_version 853247 (0.0007) [2023-12-28 01:23:05,079][106225] Updated weights for policy 1, policy_version 855227 (0.0006) [2023-12-28 01:23:05,691][106226] Updated weights for policy 0, policy_version 853257 (0.0009) [2023-12-28 01:23:05,697][106225] Updated weights for policy 1, policy_version 855237 (0.0008) [2023-12-28 01:23:05,746][106226] Updated weights for policy 0, policy_version 853267 (0.0011) [2023-12-28 01:23:05,752][106225] Updated weights for policy 1, policy_version 855247 (0.0010) [2023-12-28 01:23:05,804][106226] Updated weights for policy 0, policy_version 853277 (0.0010) [2023-12-28 01:23:05,806][106225] Updated weights for policy 1, policy_version 855257 (0.0010) [2023-12-28 01:23:05,863][106226] Updated weights for policy 0, policy_version 853287 (0.0010) [2023-12-28 01:23:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 437485568. Throughput: 0: 9871.7, 1: 9835.7. Samples: 437493620. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:23:06,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.910')] [2023-12-28 01:23:06,551][106225] Updated weights for policy 1, policy_version 855267 (0.0010) [2023-12-28 01:23:06,568][106226] Updated weights for policy 0, policy_version 853297 (0.0007) [2023-12-28 01:23:06,613][106225] Updated weights for policy 1, policy_version 855277 (0.0011) [2023-12-28 01:23:06,631][106226] Updated weights for policy 0, policy_version 853307 (0.0006) [2023-12-28 01:23:06,679][106225] Updated weights for policy 1, policy_version 855287 (0.0011) [2023-12-28 01:23:06,699][106226] Updated weights for policy 0, policy_version 853317 (0.0006) [2023-12-28 01:23:07,271][106226] Updated weights for policy 0, policy_version 853327 (0.0006) [2023-12-28 01:23:07,328][106226] Updated weights for policy 0, policy_version 853337 (0.0007) [2023-12-28 01:23:07,383][106226] Updated weights for policy 0, policy_version 853347 (0.0008) [2023-12-28 01:23:07,434][106225] Updated weights for policy 1, policy_version 855297 (0.0011) [2023-12-28 01:23:07,500][106225] Updated weights for policy 1, policy_version 855307 (0.0011) [2023-12-28 01:23:07,561][106225] Updated weights for policy 1, policy_version 855317 (0.0010) [2023-12-28 01:23:07,620][106225] Updated weights for policy 1, policy_version 855327 (0.0010) [2023-12-28 01:23:08,085][106226] Updated weights for policy 0, policy_version 853357 (0.0007) [2023-12-28 01:23:08,145][106226] Updated weights for policy 0, policy_version 853367 (0.0008) [2023-12-28 01:23:08,191][106226] Updated weights for policy 0, policy_version 853377 (0.0007) [2023-12-28 01:23:08,300][106225] Updated weights for policy 1, policy_version 855337 (0.0010) [2023-12-28 01:23:08,362][106225] Updated weights for policy 1, policy_version 855347 (0.0011) [2023-12-28 01:23:08,427][106225] Updated weights for policy 1, policy_version 855357 (0.0007) [2023-12-28 01:23:08,972][106226] Updated weights for policy 0, policy_version 853387 (0.0008) [2023-12-28 01:23:09,029][106226] Updated weights for policy 0, policy_version 853397 (0.0009) [2023-12-28 01:23:09,081][106226] Updated weights for policy 0, policy_version 853407 (0.0008) [2023-12-28 01:23:09,109][106225] Updated weights for policy 1, policy_version 855367 (0.0007) [2023-12-28 01:23:09,164][106225] Updated weights for policy 1, policy_version 855377 (0.0006) [2023-12-28 01:23:09,228][106225] Updated weights for policy 1, policy_version 855387 (0.0008) [2023-12-28 01:23:09,776][106226] Updated weights for policy 0, policy_version 853417 (0.0008) [2023-12-28 01:23:09,837][106226] Updated weights for policy 0, policy_version 853427 (0.0010) [2023-12-28 01:23:09,899][106226] Updated weights for policy 0, policy_version 853437 (0.0010) [2023-12-28 01:23:09,970][106226] Updated weights for policy 0, policy_version 853447 (0.0011) [2023-12-28 01:23:10,044][106225] Updated weights for policy 1, policy_version 855397 (0.0009) [2023-12-28 01:23:10,101][106225] Updated weights for policy 1, policy_version 855407 (0.0006) [2023-12-28 01:23:10,166][106225] Updated weights for policy 1, policy_version 855417 (0.0007) [2023-12-28 01:23:10,754][106226] Updated weights for policy 0, policy_version 853457 (0.0008) [2023-12-28 01:23:10,788][106225] Updated weights for policy 1, policy_version 855427 (0.0008) [2023-12-28 01:23:10,820][106226] Updated weights for policy 0, policy_version 853467 (0.0008) [2023-12-28 01:23:10,854][106225] Updated weights for policy 1, policy_version 855437 (0.0006) [2023-12-28 01:23:10,885][106226] Updated weights for policy 0, policy_version 853477 (0.0008) [2023-12-28 01:23:10,915][106225] Updated weights for policy 1, policy_version 855447 (0.0006) [2023-12-28 01:23:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 437583872. Throughput: 0: 9889.9, 1: 9869.8. Samples: 437552112. Policy #0 lag: (min: 3.0, avg: 15.7, max: 35.0) [2023-12-28 01:23:11,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-5.315')] [2023-12-28 01:23:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000855456_219037696.pth... [2023-12-28 01:23:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000853480_218546176.pth... [2023-12-28 01:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000854304_218742784.pth [2023-12-28 01:23:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000852328_218251264.pth [2023-12-28 01:23:11,592][106225] Updated weights for policy 1, policy_version 855457 (0.0006) [2023-12-28 01:23:11,666][106225] Updated weights for policy 1, policy_version 855467 (0.0009) [2023-12-28 01:23:11,672][106226] Updated weights for policy 0, policy_version 853487 (0.0009) [2023-12-28 01:23:11,740][106225] Updated weights for policy 1, policy_version 855477 (0.0010) [2023-12-28 01:23:11,742][106226] Updated weights for policy 0, policy_version 853497 (0.0008) [2023-12-28 01:23:11,794][106225] Updated weights for policy 1, policy_version 855487 (0.0010) [2023-12-28 01:23:11,808][106226] Updated weights for policy 0, policy_version 853507 (0.0006) [2023-12-28 01:23:12,533][106225] Updated weights for policy 1, policy_version 855497 (0.0010) [2023-12-28 01:23:12,539][106226] Updated weights for policy 0, policy_version 853517 (0.0007) [2023-12-28 01:23:12,598][106226] Updated weights for policy 0, policy_version 853527 (0.0007) [2023-12-28 01:23:12,599][106225] Updated weights for policy 1, policy_version 855507 (0.0011) [2023-12-28 01:23:12,658][106225] Updated weights for policy 1, policy_version 855517 (0.0010) [2023-12-28 01:23:12,664][106226] Updated weights for policy 0, policy_version 853537 (0.0006) [2023-12-28 01:23:13,356][106226] Updated weights for policy 0, policy_version 853547 (0.0009) [2023-12-28 01:23:13,374][106225] Updated weights for policy 1, policy_version 855527 (0.0007) [2023-12-28 01:23:13,402][106226] Updated weights for policy 0, policy_version 853557 (0.0008) [2023-12-28 01:23:13,432][106225] Updated weights for policy 1, policy_version 855537 (0.0008) [2023-12-28 01:23:13,445][106226] Updated weights for policy 0, policy_version 853567 (0.0007) [2023-12-28 01:23:13,488][106225] Updated weights for policy 1, policy_version 855547 (0.0008) [2023-12-28 01:23:14,044][106226] Updated weights for policy 0, policy_version 853577 (0.0005) [2023-12-28 01:23:14,073][106225] Updated weights for policy 1, policy_version 855557 (0.0010) [2023-12-28 01:23:14,099][106226] Updated weights for policy 0, policy_version 853587 (0.0007) [2023-12-28 01:23:14,128][106225] Updated weights for policy 1, policy_version 855567 (0.0010) [2023-12-28 01:23:14,153][106226] Updated weights for policy 0, policy_version 853597 (0.0006) [2023-12-28 01:23:14,177][106225] Updated weights for policy 1, policy_version 855577 (0.0010) [2023-12-28 01:23:14,200][106226] Updated weights for policy 0, policy_version 853607 (0.0009) [2023-12-28 01:23:14,849][106226] Updated weights for policy 0, policy_version 853617 (0.0010) [2023-12-28 01:23:14,909][106226] Updated weights for policy 0, policy_version 853627 (0.0011) [2023-12-28 01:23:14,935][106225] Updated weights for policy 1, policy_version 855587 (0.0009) [2023-12-28 01:23:14,972][106226] Updated weights for policy 0, policy_version 853637 (0.0010) [2023-12-28 01:23:14,996][106225] Updated weights for policy 1, policy_version 855597 (0.0007) [2023-12-28 01:23:15,059][106225] Updated weights for policy 1, policy_version 855607 (0.0010) [2023-12-28 01:23:15,717][106226] Updated weights for policy 0, policy_version 853647 (0.0007) [2023-12-28 01:23:15,756][106225] Updated weights for policy 1, policy_version 855617 (0.0010) [2023-12-28 01:23:15,774][106226] Updated weights for policy 0, policy_version 853657 (0.0008) [2023-12-28 01:23:15,809][106225] Updated weights for policy 1, policy_version 855627 (0.0007) [2023-12-28 01:23:15,836][106226] Updated weights for policy 0, policy_version 853667 (0.0006) [2023-12-28 01:23:15,870][106225] Updated weights for policy 1, policy_version 855637 (0.0007) [2023-12-28 01:23:15,922][106225] Updated weights for policy 1, policy_version 855647 (0.0008) [2023-12-28 01:23:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 437682176. Throughput: 0: 9876.9, 1: 9813.1. Samples: 437669992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:16,176][105115] Avg episode reward: [(0, '-4.462'), (1, '-5.089')] [2023-12-28 01:23:16,416][106226] Updated weights for policy 0, policy_version 853677 (0.0008) [2023-12-28 01:23:16,475][106226] Updated weights for policy 0, policy_version 853687 (0.0005) [2023-12-28 01:23:16,532][106226] Updated weights for policy 0, policy_version 853697 (0.0010) [2023-12-28 01:23:16,672][106225] Updated weights for policy 1, policy_version 855657 (0.0008) [2023-12-28 01:23:16,729][106225] Updated weights for policy 1, policy_version 855667 (0.0010) [2023-12-28 01:23:16,778][106225] Updated weights for policy 1, policy_version 855677 (0.0008) [2023-12-28 01:23:17,162][106226] Updated weights for policy 0, policy_version 853707 (0.0011) [2023-12-28 01:23:17,218][106226] Updated weights for policy 0, policy_version 853717 (0.0011) [2023-12-28 01:23:17,271][106226] Updated weights for policy 0, policy_version 853727 (0.0010) [2023-12-28 01:23:17,500][106225] Updated weights for policy 1, policy_version 855687 (0.0007) [2023-12-28 01:23:17,561][106225] Updated weights for policy 1, policy_version 855697 (0.0005) [2023-12-28 01:23:17,621][106225] Updated weights for policy 1, policy_version 855707 (0.0005) [2023-12-28 01:23:17,975][106226] Updated weights for policy 0, policy_version 853737 (0.0010) [2023-12-28 01:23:18,036][106226] Updated weights for policy 0, policy_version 853747 (0.0010) [2023-12-28 01:23:18,106][106226] Updated weights for policy 0, policy_version 853757 (0.0010) [2023-12-28 01:23:18,163][106226] Updated weights for policy 0, policy_version 853767 (0.0010) [2023-12-28 01:23:18,167][106225] Updated weights for policy 1, policy_version 855717 (0.0008) [2023-12-28 01:23:18,224][106225] Updated weights for policy 1, policy_version 855727 (0.0008) [2023-12-28 01:23:18,280][106225] Updated weights for policy 1, policy_version 855737 (0.0010) [2023-12-28 01:23:18,869][106225] Updated weights for policy 1, policy_version 855747 (0.0009) [2023-12-28 01:23:18,890][106226] Updated weights for policy 0, policy_version 853777 (0.0011) [2023-12-28 01:23:18,926][106225] Updated weights for policy 1, policy_version 855757 (0.0005) [2023-12-28 01:23:18,955][106226] Updated weights for policy 0, policy_version 853787 (0.0011) [2023-12-28 01:23:18,988][106225] Updated weights for policy 1, policy_version 855767 (0.0007) [2023-12-28 01:23:19,015][106226] Updated weights for policy 0, policy_version 853797 (0.0008) [2023-12-28 01:23:19,678][106225] Updated weights for policy 1, policy_version 855777 (0.0010) [2023-12-28 01:23:19,714][106226] Updated weights for policy 0, policy_version 853807 (0.0009) [2023-12-28 01:23:19,742][106225] Updated weights for policy 1, policy_version 855787 (0.0007) [2023-12-28 01:23:19,777][106226] Updated weights for policy 0, policy_version 853817 (0.0008) [2023-12-28 01:23:19,804][106225] Updated weights for policy 1, policy_version 855797 (0.0007) [2023-12-28 01:23:19,841][106226] Updated weights for policy 0, policy_version 853827 (0.0007) [2023-12-28 01:23:19,873][106225] Updated weights for policy 1, policy_version 855807 (0.0010) [2023-12-28 01:23:20,446][106226] Updated weights for policy 0, policy_version 853837 (0.0007) [2023-12-28 01:23:20,505][106226] Updated weights for policy 0, policy_version 853847 (0.0008) [2023-12-28 01:23:20,563][106226] Updated weights for policy 0, policy_version 853857 (0.0008) [2023-12-28 01:23:20,616][106225] Updated weights for policy 1, policy_version 855817 (0.0011) [2023-12-28 01:23:20,679][106225] Updated weights for policy 1, policy_version 855827 (0.0012) [2023-12-28 01:23:20,745][106225] Updated weights for policy 1, policy_version 855837 (0.0010) [2023-12-28 01:23:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 437780480. Throughput: 0: 9871.2, 1: 9886.1. Samples: 437791212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:21,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.990')] [2023-12-28 01:23:21,329][106226] Updated weights for policy 0, policy_version 853867 (0.0007) [2023-12-28 01:23:21,404][106226] Updated weights for policy 0, policy_version 853877 (0.0009) [2023-12-28 01:23:21,474][106226] Updated weights for policy 0, policy_version 853887 (0.0009) [2023-12-28 01:23:21,514][106225] Updated weights for policy 1, policy_version 855847 (0.0008) [2023-12-28 01:23:21,576][106225] Updated weights for policy 1, policy_version 855857 (0.0008) [2023-12-28 01:23:21,648][106225] Updated weights for policy 1, policy_version 855867 (0.0008) [2023-12-28 01:23:22,141][106226] Updated weights for policy 0, policy_version 853897 (0.0007) [2023-12-28 01:23:22,200][106226] Updated weights for policy 0, policy_version 853907 (0.0006) [2023-12-28 01:23:22,269][106226] Updated weights for policy 0, policy_version 853917 (0.0007) [2023-12-28 01:23:22,339][106226] Updated weights for policy 0, policy_version 853927 (0.0007) [2023-12-28 01:23:22,394][106225] Updated weights for policy 1, policy_version 855877 (0.0009) [2023-12-28 01:23:22,456][106225] Updated weights for policy 1, policy_version 855887 (0.0008) [2023-12-28 01:23:22,522][106225] Updated weights for policy 1, policy_version 855897 (0.0008) [2023-12-28 01:23:23,064][106226] Updated weights for policy 0, policy_version 853937 (0.0008) [2023-12-28 01:23:23,125][106226] Updated weights for policy 0, policy_version 853947 (0.0009) [2023-12-28 01:23:23,176][106226] Updated weights for policy 0, policy_version 853957 (0.0007) [2023-12-28 01:23:23,260][106225] Updated weights for policy 1, policy_version 855907 (0.0009) [2023-12-28 01:23:23,309][106225] Updated weights for policy 1, policy_version 855917 (0.0010) [2023-12-28 01:23:23,356][106225] Updated weights for policy 1, policy_version 855927 (0.0010) [2023-12-28 01:23:23,798][106226] Updated weights for policy 0, policy_version 853967 (0.0007) [2023-12-28 01:23:23,864][106226] Updated weights for policy 0, policy_version 853977 (0.0008) [2023-12-28 01:23:23,916][106226] Updated weights for policy 0, policy_version 853987 (0.0007) [2023-12-28 01:23:24,075][106225] Updated weights for policy 1, policy_version 855937 (0.0010) [2023-12-28 01:23:24,125][106225] Updated weights for policy 1, policy_version 855947 (0.0007) [2023-12-28 01:23:24,192][106225] Updated weights for policy 1, policy_version 855957 (0.0006) [2023-12-28 01:23:24,254][106225] Updated weights for policy 1, policy_version 855967 (0.0005) [2023-12-28 01:23:24,572][106226] Updated weights for policy 0, policy_version 853997 (0.0007) [2023-12-28 01:23:24,642][106226] Updated weights for policy 0, policy_version 854007 (0.0007) [2023-12-28 01:23:24,714][106226] Updated weights for policy 0, policy_version 854017 (0.0006) [2023-12-28 01:23:24,865][106225] Updated weights for policy 1, policy_version 855977 (0.0009) [2023-12-28 01:23:24,927][106225] Updated weights for policy 1, policy_version 855987 (0.0010) [2023-12-28 01:23:24,985][106225] Updated weights for policy 1, policy_version 855997 (0.0010) [2023-12-28 01:23:25,354][106226] Updated weights for policy 0, policy_version 854027 (0.0006) [2023-12-28 01:23:25,413][106226] Updated weights for policy 0, policy_version 854037 (0.0007) [2023-12-28 01:23:25,473][106226] Updated weights for policy 0, policy_version 854047 (0.0008) [2023-12-28 01:23:25,706][106225] Updated weights for policy 1, policy_version 856007 (0.0010) [2023-12-28 01:23:25,759][106225] Updated weights for policy 1, policy_version 856017 (0.0010) [2023-12-28 01:23:25,815][106225] Updated weights for policy 1, policy_version 856027 (0.0010) [2023-12-28 01:23:26,137][106226] Updated weights for policy 0, policy_version 854057 (0.0008) [2023-12-28 01:23:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 437878784. Throughput: 0: 9840.2, 1: 9899.7. Samples: 437848944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:26,175][105115] Avg episode reward: [(0, '-4.286'), (1, '-5.045')] [2023-12-28 01:23:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000856032_219185152.pth... [2023-12-28 01:23:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000854880_218890240.pth [2023-12-28 01:23:26,186][106226] Updated weights for policy 0, policy_version 854067 (0.0010) [2023-12-28 01:23:26,242][106226] Updated weights for policy 0, policy_version 854077 (0.0010) [2023-12-28 01:23:26,299][106226] Updated weights for policy 0, policy_version 854087 (0.0010) [2023-12-28 01:23:26,302][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000854088_218701824.pth... [2023-12-28 01:23:26,307][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000852904_218398720.pth [2023-12-28 01:23:26,532][106225] Updated weights for policy 1, policy_version 856037 (0.0010) [2023-12-28 01:23:26,591][106225] Updated weights for policy 1, policy_version 856047 (0.0010) [2023-12-28 01:23:26,650][106225] Updated weights for policy 1, policy_version 856057 (0.0010) [2023-12-28 01:23:26,974][106226] Updated weights for policy 0, policy_version 854097 (0.0008) [2023-12-28 01:23:27,022][106226] Updated weights for policy 0, policy_version 854107 (0.0008) [2023-12-28 01:23:27,067][106226] Updated weights for policy 0, policy_version 854117 (0.0005) [2023-12-28 01:23:27,291][106225] Updated weights for policy 1, policy_version 856067 (0.0009) [2023-12-28 01:23:27,342][106225] Updated weights for policy 1, policy_version 856077 (0.0008) [2023-12-28 01:23:27,397][106225] Updated weights for policy 1, policy_version 856087 (0.0008) [2023-12-28 01:23:27,717][106226] Updated weights for policy 0, policy_version 854127 (0.0008) [2023-12-28 01:23:27,768][106226] Updated weights for policy 0, policy_version 854137 (0.0009) [2023-12-28 01:23:27,816][106226] Updated weights for policy 0, policy_version 854147 (0.0008) [2023-12-28 01:23:28,116][106225] Updated weights for policy 1, policy_version 856097 (0.0008) [2023-12-28 01:23:28,176][106225] Updated weights for policy 1, policy_version 856108 (0.0009) [2023-12-28 01:23:28,242][106225] Updated weights for policy 1, policy_version 856118 (0.0010) [2023-12-28 01:23:28,304][106225] Updated weights for policy 1, policy_version 856128 (0.0009) [2023-12-28 01:23:28,445][106226] Updated weights for policy 0, policy_version 854157 (0.0008) [2023-12-28 01:23:28,492][106226] Updated weights for policy 0, policy_version 854167 (0.0008) [2023-12-28 01:23:28,550][106226] Updated weights for policy 0, policy_version 854177 (0.0008) [2023-12-28 01:23:29,122][106225] Updated weights for policy 1, policy_version 856138 (0.0008) [2023-12-28 01:23:29,165][106226] Updated weights for policy 0, policy_version 854187 (0.0006) [2023-12-28 01:23:29,179][106225] Updated weights for policy 1, policy_version 856148 (0.0008) [2023-12-28 01:23:29,235][106226] Updated weights for policy 0, policy_version 854197 (0.0007) [2023-12-28 01:23:29,244][106225] Updated weights for policy 1, policy_version 856158 (0.0007) [2023-12-28 01:23:29,302][106226] Updated weights for policy 0, policy_version 854207 (0.0009) [2023-12-28 01:23:29,969][106226] Updated weights for policy 0, policy_version 854217 (0.0009) [2023-12-28 01:23:30,023][106225] Updated weights for policy 1, policy_version 856168 (0.0007) [2023-12-28 01:23:30,025][106226] Updated weights for policy 0, policy_version 854227 (0.0009) [2023-12-28 01:23:30,082][106225] Updated weights for policy 1, policy_version 856178 (0.0008) [2023-12-28 01:23:30,096][106226] Updated weights for policy 0, policy_version 854237 (0.0005) [2023-12-28 01:23:30,142][106225] Updated weights for policy 1, policy_version 856188 (0.0008) [2023-12-28 01:23:30,159][106226] Updated weights for policy 0, policy_version 854247 (0.0006) [2023-12-28 01:23:30,824][106226] Updated weights for policy 0, policy_version 854257 (0.0008) [2023-12-28 01:23:30,871][106225] Updated weights for policy 1, policy_version 856198 (0.0006) [2023-12-28 01:23:30,874][106226] Updated weights for policy 0, policy_version 854267 (0.0008) [2023-12-28 01:23:30,923][106225] Updated weights for policy 1, policy_version 856208 (0.0005) [2023-12-28 01:23:30,925][106226] Updated weights for policy 0, policy_version 854277 (0.0007) [2023-12-28 01:23:30,973][106225] Updated weights for policy 1, policy_version 856218 (0.0005) [2023-12-28 01:23:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 437985280. Throughput: 0: 9918.8, 1: 9938.4. Samples: 437971364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:31,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-5.023')] [2023-12-28 01:23:31,639][106225] Updated weights for policy 1, policy_version 856228 (0.0007) [2023-12-28 01:23:31,706][106225] Updated weights for policy 1, policy_version 856238 (0.0009) [2023-12-28 01:23:31,746][106226] Updated weights for policy 0, policy_version 854287 (0.0008) [2023-12-28 01:23:31,771][106225] Updated weights for policy 1, policy_version 856248 (0.0008) [2023-12-28 01:23:31,804][106226] Updated weights for policy 0, policy_version 854297 (0.0007) [2023-12-28 01:23:31,864][106226] Updated weights for policy 0, policy_version 854307 (0.0007) [2023-12-28 01:23:32,546][106225] Updated weights for policy 1, policy_version 856258 (0.0007) [2023-12-28 01:23:32,591][106226] Updated weights for policy 0, policy_version 854317 (0.0009) [2023-12-28 01:23:32,612][106225] Updated weights for policy 1, policy_version 856268 (0.0007) [2023-12-28 01:23:32,650][106226] Updated weights for policy 0, policy_version 854327 (0.0007) [2023-12-28 01:23:32,668][106225] Updated weights for policy 1, policy_version 856278 (0.0006) [2023-12-28 01:23:32,707][106226] Updated weights for policy 0, policy_version 854337 (0.0006) [2023-12-28 01:23:32,718][106225] Updated weights for policy 1, policy_version 856288 (0.0007) [2023-12-28 01:23:33,430][106226] Updated weights for policy 0, policy_version 854347 (0.0009) [2023-12-28 01:23:33,448][106225] Updated weights for policy 1, policy_version 856298 (0.0007) [2023-12-28 01:23:33,477][106226] Updated weights for policy 0, policy_version 854357 (0.0006) [2023-12-28 01:23:33,506][106225] Updated weights for policy 1, policy_version 856308 (0.0006) [2023-12-28 01:23:33,523][106226] Updated weights for policy 0, policy_version 854367 (0.0005) [2023-12-28 01:23:33,566][106225] Updated weights for policy 1, policy_version 856318 (0.0008) [2023-12-28 01:23:34,249][106226] Updated weights for policy 0, policy_version 854377 (0.0007) [2023-12-28 01:23:34,284][106225] Updated weights for policy 1, policy_version 856328 (0.0008) [2023-12-28 01:23:34,309][106226] Updated weights for policy 0, policy_version 854387 (0.0007) [2023-12-28 01:23:34,349][106225] Updated weights for policy 1, policy_version 856338 (0.0008) [2023-12-28 01:23:34,395][106226] Updated weights for policy 0, policy_version 854397 (0.0006) [2023-12-28 01:23:34,411][106225] Updated weights for policy 1, policy_version 856348 (0.0007) [2023-12-28 01:23:34,457][106226] Updated weights for policy 0, policy_version 854407 (0.0008) [2023-12-28 01:23:35,029][106225] Updated weights for policy 1, policy_version 856358 (0.0009) [2023-12-28 01:23:35,090][106225] Updated weights for policy 1, policy_version 856368 (0.0008) [2023-12-28 01:23:35,151][106225] Updated weights for policy 1, policy_version 856378 (0.0007) [2023-12-28 01:23:35,169][106226] Updated weights for policy 0, policy_version 854417 (0.0007) [2023-12-28 01:23:35,218][106226] Updated weights for policy 0, policy_version 854427 (0.0007) [2023-12-28 01:23:35,268][106226] Updated weights for policy 0, policy_version 854437 (0.0008) [2023-12-28 01:23:35,876][106225] Updated weights for policy 1, policy_version 856388 (0.0008) [2023-12-28 01:23:35,934][106225] Updated weights for policy 1, policy_version 856398 (0.0008) [2023-12-28 01:23:35,979][106226] Updated weights for policy 0, policy_version 854447 (0.0007) [2023-12-28 01:23:35,992][106225] Updated weights for policy 1, policy_version 856408 (0.0007) [2023-12-28 01:23:36,034][106226] Updated weights for policy 0, policy_version 854457 (0.0006) [2023-12-28 01:23:36,079][106226] Updated weights for policy 0, policy_version 854467 (0.0009) [2023-12-28 01:23:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 438083584. Throughput: 0: 9953.9, 1: 9830.2. Samples: 438087380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:36,175][105115] Avg episode reward: [(0, '-4.196'), (1, '-5.079')] [2023-12-28 01:23:36,710][106225] Updated weights for policy 1, policy_version 856418 (0.0007) [2023-12-28 01:23:36,756][106226] Updated weights for policy 0, policy_version 854477 (0.0009) [2023-12-28 01:23:36,765][106225] Updated weights for policy 1, policy_version 856428 (0.0006) [2023-12-28 01:23:36,815][106226] Updated weights for policy 0, policy_version 854487 (0.0006) [2023-12-28 01:23:36,821][106225] Updated weights for policy 1, policy_version 856438 (0.0008) [2023-12-28 01:23:36,870][106226] Updated weights for policy 0, policy_version 854497 (0.0006) [2023-12-28 01:23:36,876][106225] Updated weights for policy 1, policy_version 856448 (0.0007) [2023-12-28 01:23:37,613][106225] Updated weights for policy 1, policy_version 856458 (0.0006) [2023-12-28 01:23:37,621][106226] Updated weights for policy 0, policy_version 854507 (0.0008) [2023-12-28 01:23:37,679][106225] Updated weights for policy 1, policy_version 856468 (0.0006) [2023-12-28 01:23:37,681][106226] Updated weights for policy 0, policy_version 854517 (0.0007) [2023-12-28 01:23:37,747][106225] Updated weights for policy 1, policy_version 856478 (0.0007) [2023-12-28 01:23:37,749][106226] Updated weights for policy 0, policy_version 854527 (0.0007) [2023-12-28 01:23:38,419][106226] Updated weights for policy 0, policy_version 854537 (0.0008) [2023-12-28 01:23:38,476][106226] Updated weights for policy 0, policy_version 854547 (0.0009) [2023-12-28 01:23:38,495][106225] Updated weights for policy 1, policy_version 856488 (0.0008) [2023-12-28 01:23:38,530][106226] Updated weights for policy 0, policy_version 854557 (0.0008) [2023-12-28 01:23:38,552][106225] Updated weights for policy 1, policy_version 856498 (0.0007) [2023-12-28 01:23:38,589][106226] Updated weights for policy 0, policy_version 854567 (0.0008) [2023-12-28 01:23:38,609][106225] Updated weights for policy 1, policy_version 856508 (0.0006) [2023-12-28 01:23:39,298][106225] Updated weights for policy 1, policy_version 856518 (0.0007) [2023-12-28 01:23:39,368][106225] Updated weights for policy 1, policy_version 856528 (0.0009) [2023-12-28 01:23:39,381][106226] Updated weights for policy 0, policy_version 854577 (0.0008) [2023-12-28 01:23:39,442][106225] Updated weights for policy 1, policy_version 856538 (0.0009) [2023-12-28 01:23:39,451][106226] Updated weights for policy 0, policy_version 854587 (0.0006) [2023-12-28 01:23:39,500][106226] Updated weights for policy 0, policy_version 854597 (0.0007) [2023-12-28 01:23:40,167][106225] Updated weights for policy 1, policy_version 856548 (0.0009) [2023-12-28 01:23:40,190][106226] Updated weights for policy 0, policy_version 854607 (0.0007) [2023-12-28 01:23:40,223][106225] Updated weights for policy 1, policy_version 856558 (0.0010) [2023-12-28 01:23:40,249][106226] Updated weights for policy 0, policy_version 854617 (0.0006) [2023-12-28 01:23:40,279][106225] Updated weights for policy 1, policy_version 856568 (0.0011) [2023-12-28 01:23:40,312][106226] Updated weights for policy 0, policy_version 854627 (0.0007) [2023-12-28 01:23:40,938][106226] Updated weights for policy 0, policy_version 854637 (0.0006) [2023-12-28 01:23:40,990][106226] Updated weights for policy 0, policy_version 854647 (0.0005) [2023-12-28 01:23:40,993][106225] Updated weights for policy 1, policy_version 856578 (0.0011) [2023-12-28 01:23:41,056][106226] Updated weights for policy 0, policy_version 854657 (0.0010) [2023-12-28 01:23:41,057][106225] Updated weights for policy 1, policy_version 856588 (0.0010) [2023-12-28 01:23:41,119][106225] Updated weights for policy 1, policy_version 856598 (0.0010) [2023-12-28 01:23:41,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 438173696. Throughput: 0: 9987.1, 1: 9813.7. Samples: 438145188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:41,175][105115] Avg episode reward: [(0, '-4.024'), (1, '-5.112')] [2023-12-28 01:23:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000854664_218849280.pth... [2023-12-28 01:23:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000853480_218546176.pth [2023-12-28 01:23:41,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000856608_219332608.pth... [2023-12-28 01:23:41,188][106225] Updated weights for policy 1, policy_version 856608 (0.0010) [2023-12-28 01:23:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000855456_219037696.pth [2023-12-28 01:23:41,788][106226] Updated weights for policy 0, policy_version 854667 (0.0007) [2023-12-28 01:23:41,847][106226] Updated weights for policy 0, policy_version 854677 (0.0008) [2023-12-28 01:23:41,906][106226] Updated weights for policy 0, policy_version 854687 (0.0008) [2023-12-28 01:23:41,916][106225] Updated weights for policy 1, policy_version 856618 (0.0007) [2023-12-28 01:23:41,974][106225] Updated weights for policy 1, policy_version 856628 (0.0007) [2023-12-28 01:23:42,032][106225] Updated weights for policy 1, policy_version 856638 (0.0007) [2023-12-28 01:23:42,657][106226] Updated weights for policy 0, policy_version 854697 (0.0008) [2023-12-28 01:23:42,683][106225] Updated weights for policy 1, policy_version 856648 (0.0007) [2023-12-28 01:23:42,717][106226] Updated weights for policy 0, policy_version 854707 (0.0008) [2023-12-28 01:23:42,743][106225] Updated weights for policy 1, policy_version 856658 (0.0006) [2023-12-28 01:23:42,773][106226] Updated weights for policy 0, policy_version 854717 (0.0007) [2023-12-28 01:23:42,801][106225] Updated weights for policy 1, policy_version 856668 (0.0008) [2023-12-28 01:23:42,826][106226] Updated weights for policy 0, policy_version 854727 (0.0010) [2023-12-28 01:23:43,519][106225] Updated weights for policy 1, policy_version 856678 (0.0008) [2023-12-28 01:23:43,575][106226] Updated weights for policy 0, policy_version 854737 (0.0008) [2023-12-28 01:23:43,577][106225] Updated weights for policy 1, policy_version 856688 (0.0009) [2023-12-28 01:23:43,630][106225] Updated weights for policy 1, policy_version 856698 (0.0007) [2023-12-28 01:23:43,636][106226] Updated weights for policy 0, policy_version 854747 (0.0007) [2023-12-28 01:23:43,700][106226] Updated weights for policy 0, policy_version 854757 (0.0007) [2023-12-28 01:23:44,285][106225] Updated weights for policy 1, policy_version 856708 (0.0007) [2023-12-28 01:23:44,295][106226] Updated weights for policy 0, policy_version 854767 (0.0008) [2023-12-28 01:23:44,349][106225] Updated weights for policy 1, policy_version 856718 (0.0005) [2023-12-28 01:23:44,351][106226] Updated weights for policy 0, policy_version 854777 (0.0006) [2023-12-28 01:23:44,403][106225] Updated weights for policy 1, policy_version 856728 (0.0006) [2023-12-28 01:23:44,405][106226] Updated weights for policy 0, policy_version 854787 (0.0008) [2023-12-28 01:23:45,110][106225] Updated weights for policy 1, policy_version 856738 (0.0008) [2023-12-28 01:23:45,112][106226] Updated weights for policy 0, policy_version 854797 (0.0008) [2023-12-28 01:23:45,170][106225] Updated weights for policy 1, policy_version 856748 (0.0010) [2023-12-28 01:23:45,176][106226] Updated weights for policy 0, policy_version 854807 (0.0007) [2023-12-28 01:23:45,229][106225] Updated weights for policy 1, policy_version 856758 (0.0010) [2023-12-28 01:23:45,231][106226] Updated weights for policy 0, policy_version 854817 (0.0006) [2023-12-28 01:23:45,290][106225] Updated weights for policy 1, policy_version 856768 (0.0010) [2023-12-28 01:23:45,798][106226] Updated weights for policy 0, policy_version 854827 (0.0005) [2023-12-28 01:23:45,860][106226] Updated weights for policy 0, policy_version 854837 (0.0005) [2023-12-28 01:23:45,887][106225] Updated weights for policy 1, policy_version 856778 (0.0005) [2023-12-28 01:23:45,919][106226] Updated weights for policy 0, policy_version 854847 (0.0005) [2023-12-28 01:23:45,941][106225] Updated weights for policy 1, policy_version 856788 (0.0005) [2023-12-28 01:23:45,993][106225] Updated weights for policy 1, policy_version 856798 (0.0005) [2023-12-28 01:23:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 438280192. Throughput: 0: 10017.1, 1: 9826.4. Samples: 438263468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:46,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.927')] [2023-12-28 01:23:46,541][106225] Updated weights for policy 1, policy_version 856808 (0.0005) [2023-12-28 01:23:46,555][106226] Updated weights for policy 0, policy_version 854857 (0.0006) [2023-12-28 01:23:46,606][106226] Updated weights for policy 0, policy_version 854867 (0.0010) [2023-12-28 01:23:46,612][106225] Updated weights for policy 1, policy_version 856818 (0.0005) [2023-12-28 01:23:46,663][106226] Updated weights for policy 0, policy_version 854877 (0.0011) [2023-12-28 01:23:46,676][106225] Updated weights for policy 1, policy_version 856828 (0.0005) [2023-12-28 01:23:46,713][106226] Updated weights for policy 0, policy_version 854887 (0.0011) [2023-12-28 01:23:47,269][106225] Updated weights for policy 1, policy_version 856838 (0.0008) [2023-12-28 01:23:47,335][106225] Updated weights for policy 1, policy_version 856848 (0.0010) [2023-12-28 01:23:47,394][106225] Updated weights for policy 1, policy_version 856858 (0.0006) [2023-12-28 01:23:47,404][106226] Updated weights for policy 0, policy_version 854897 (0.0008) [2023-12-28 01:23:47,459][106226] Updated weights for policy 0, policy_version 854907 (0.0005) [2023-12-28 01:23:47,521][106226] Updated weights for policy 0, policy_version 854917 (0.0005) [2023-12-28 01:23:48,057][106225] Updated weights for policy 1, policy_version 856868 (0.0006) [2023-12-28 01:23:48,123][106225] Updated weights for policy 1, policy_version 856878 (0.0005) [2023-12-28 01:23:48,165][106226] Updated weights for policy 0, policy_version 854927 (0.0010) [2023-12-28 01:23:48,182][106225] Updated weights for policy 1, policy_version 856888 (0.0006) [2023-12-28 01:23:48,225][106226] Updated weights for policy 0, policy_version 854937 (0.0011) [2023-12-28 01:23:48,288][106226] Updated weights for policy 0, policy_version 854947 (0.0010) [2023-12-28 01:23:48,845][106225] Updated weights for policy 1, policy_version 856898 (0.0007) [2023-12-28 01:23:48,904][106225] Updated weights for policy 1, policy_version 856908 (0.0010) [2023-12-28 01:23:48,968][106225] Updated weights for policy 1, policy_version 856918 (0.0011) [2023-12-28 01:23:49,017][106226] Updated weights for policy 0, policy_version 854957 (0.0009) [2023-12-28 01:23:49,031][106225] Updated weights for policy 1, policy_version 856928 (0.0011) [2023-12-28 01:23:49,078][106226] Updated weights for policy 0, policy_version 854967 (0.0009) [2023-12-28 01:23:49,131][106226] Updated weights for policy 0, policy_version 854977 (0.0010) [2023-12-28 01:23:49,750][106225] Updated weights for policy 1, policy_version 856938 (0.0008) [2023-12-28 01:23:49,812][106225] Updated weights for policy 1, policy_version 856948 (0.0008) [2023-12-28 01:23:49,870][106226] Updated weights for policy 0, policy_version 854987 (0.0009) [2023-12-28 01:23:49,879][106225] Updated weights for policy 1, policy_version 856958 (0.0007) [2023-12-28 01:23:49,936][106226] Updated weights for policy 0, policy_version 854997 (0.0009) [2023-12-28 01:23:50,007][106226] Updated weights for policy 0, policy_version 855007 (0.0010) [2023-12-28 01:23:50,579][106225] Updated weights for policy 1, policy_version 856968 (0.0009) [2023-12-28 01:23:50,643][106225] Updated weights for policy 1, policy_version 856978 (0.0009) [2023-12-28 01:23:50,704][106225] Updated weights for policy 1, policy_version 856988 (0.0008) [2023-12-28 01:23:50,780][106226] Updated weights for policy 0, policy_version 855017 (0.0009) [2023-12-28 01:23:50,839][106226] Updated weights for policy 0, policy_version 855027 (0.0009) [2023-12-28 01:23:50,903][106226] Updated weights for policy 0, policy_version 855037 (0.0007) [2023-12-28 01:23:50,964][106226] Updated weights for policy 0, policy_version 855047 (0.0008) [2023-12-28 01:23:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 438378496. Throughput: 0: 9984.5, 1: 9845.8. Samples: 438385984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:51,175][105115] Avg episode reward: [(0, '-3.970'), (1, '-5.073')] [2023-12-28 01:23:51,441][106225] Updated weights for policy 1, policy_version 856998 (0.0008) [2023-12-28 01:23:51,494][106225] Updated weights for policy 1, policy_version 857008 (0.0008) [2023-12-28 01:23:51,547][106225] Updated weights for policy 1, policy_version 857018 (0.0008) [2023-12-28 01:23:51,780][106226] Updated weights for policy 0, policy_version 855057 (0.0008) [2023-12-28 01:23:51,832][106226] Updated weights for policy 0, policy_version 855067 (0.0008) [2023-12-28 01:23:51,880][106226] Updated weights for policy 0, policy_version 855077 (0.0008) [2023-12-28 01:23:52,285][106225] Updated weights for policy 1, policy_version 857028 (0.0008) [2023-12-28 01:23:52,351][106225] Updated weights for policy 1, policy_version 857038 (0.0009) [2023-12-28 01:23:52,420][106225] Updated weights for policy 1, policy_version 857048 (0.0010) [2023-12-28 01:23:52,658][106226] Updated weights for policy 0, policy_version 855087 (0.0010) [2023-12-28 01:23:52,719][106226] Updated weights for policy 0, policy_version 855097 (0.0011) [2023-12-28 01:23:52,779][106226] Updated weights for policy 0, policy_version 855107 (0.0011) [2023-12-28 01:23:53,123][106225] Updated weights for policy 1, policy_version 857058 (0.0010) [2023-12-28 01:23:53,176][106225] Updated weights for policy 1, policy_version 857068 (0.0005) [2023-12-28 01:23:53,229][106225] Updated weights for policy 1, policy_version 857078 (0.0005) [2023-12-28 01:23:53,287][106225] Updated weights for policy 1, policy_version 857088 (0.0005) [2023-12-28 01:23:53,449][106226] Updated weights for policy 0, policy_version 855117 (0.0009) [2023-12-28 01:23:53,507][106226] Updated weights for policy 0, policy_version 855127 (0.0006) [2023-12-28 01:23:53,567][106226] Updated weights for policy 0, policy_version 855137 (0.0007) [2023-12-28 01:23:53,963][106225] Updated weights for policy 1, policy_version 857098 (0.0007) [2023-12-28 01:23:54,024][106225] Updated weights for policy 1, policy_version 857108 (0.0010) [2023-12-28 01:23:54,091][106225] Updated weights for policy 1, policy_version 857118 (0.0005) [2023-12-28 01:23:54,172][106226] Updated weights for policy 0, policy_version 855147 (0.0007) [2023-12-28 01:23:54,221][106226] Updated weights for policy 0, policy_version 855157 (0.0005) [2023-12-28 01:23:54,273][106226] Updated weights for policy 0, policy_version 855167 (0.0005) [2023-12-28 01:23:54,660][106225] Updated weights for policy 1, policy_version 857128 (0.0009) [2023-12-28 01:23:54,710][106225] Updated weights for policy 1, policy_version 857138 (0.0010) [2023-12-28 01:23:54,761][106225] Updated weights for policy 1, policy_version 857148 (0.0010) [2023-12-28 01:23:54,880][106226] Updated weights for policy 0, policy_version 855177 (0.0005) [2023-12-28 01:23:54,942][106226] Updated weights for policy 0, policy_version 855187 (0.0005) [2023-12-28 01:23:55,010][106226] Updated weights for policy 0, policy_version 855197 (0.0008) [2023-12-28 01:23:55,075][106226] Updated weights for policy 0, policy_version 855207 (0.0006) [2023-12-28 01:23:55,471][106225] Updated weights for policy 1, policy_version 857158 (0.0007) [2023-12-28 01:23:55,532][106225] Updated weights for policy 1, policy_version 857168 (0.0007) [2023-12-28 01:23:55,585][106225] Updated weights for policy 1, policy_version 857178 (0.0007) [2023-12-28 01:23:55,712][106226] Updated weights for policy 0, policy_version 855217 (0.0008) [2023-12-28 01:23:55,761][106226] Updated weights for policy 0, policy_version 855227 (0.0007) [2023-12-28 01:23:55,813][106226] Updated weights for policy 0, policy_version 855237 (0.0008) [2023-12-28 01:23:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 438476800. Throughput: 0: 9975.5, 1: 9862.7. Samples: 438444828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:23:56,175][105115] Avg episode reward: [(0, '-4.234'), (1, '-5.084')] [2023-12-28 01:23:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000855240_218996736.pth... [2023-12-28 01:23:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000857184_219480064.pth... [2023-12-28 01:23:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000854088_218701824.pth [2023-12-28 01:23:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000856032_219185152.pth [2023-12-28 01:23:56,247][106225] Updated weights for policy 1, policy_version 857188 (0.0010) [2023-12-28 01:23:56,295][106225] Updated weights for policy 1, policy_version 857198 (0.0010) [2023-12-28 01:23:56,352][106225] Updated weights for policy 1, policy_version 857208 (0.0010) [2023-12-28 01:23:56,472][106226] Updated weights for policy 0, policy_version 855247 (0.0007) [2023-12-28 01:23:56,533][106226] Updated weights for policy 0, policy_version 855257 (0.0009) [2023-12-28 01:23:56,585][106226] Updated weights for policy 0, policy_version 855267 (0.0009) [2023-12-28 01:23:56,929][106225] Updated weights for policy 1, policy_version 857218 (0.0010) [2023-12-28 01:23:56,985][106225] Updated weights for policy 1, policy_version 857228 (0.0010) [2023-12-28 01:23:57,042][106225] Updated weights for policy 1, policy_version 857238 (0.0010) [2023-12-28 01:23:57,101][106225] Updated weights for policy 1, policy_version 857248 (0.0010) [2023-12-28 01:23:57,320][106226] Updated weights for policy 0, policy_version 855277 (0.0010) [2023-12-28 01:23:57,376][106226] Updated weights for policy 0, policy_version 855287 (0.0010) [2023-12-28 01:23:57,436][106226] Updated weights for policy 0, policy_version 855297 (0.0010) [2023-12-28 01:23:57,787][106225] Updated weights for policy 1, policy_version 857258 (0.0010) [2023-12-28 01:23:57,845][106225] Updated weights for policy 1, policy_version 857268 (0.0010) [2023-12-28 01:23:57,896][106225] Updated weights for policy 1, policy_version 857278 (0.0010) [2023-12-28 01:23:58,131][106226] Updated weights for policy 0, policy_version 855307 (0.0010) [2023-12-28 01:23:58,180][106226] Updated weights for policy 0, policy_version 855317 (0.0010) [2023-12-28 01:23:58,239][106226] Updated weights for policy 0, policy_version 855327 (0.0010) [2023-12-28 01:23:58,633][106225] Updated weights for policy 1, policy_version 857288 (0.0009) [2023-12-28 01:23:58,700][106225] Updated weights for policy 1, policy_version 857298 (0.0010) [2023-12-28 01:23:58,769][106225] Updated weights for policy 1, policy_version 857308 (0.0008) [2023-12-28 01:23:59,113][106226] Updated weights for policy 0, policy_version 855337 (0.0009) [2023-12-28 01:23:59,172][106226] Updated weights for policy 0, policy_version 855347 (0.0008) [2023-12-28 01:23:59,242][106226] Updated weights for policy 0, policy_version 855357 (0.0008) [2023-12-28 01:23:59,317][106226] Updated weights for policy 0, policy_version 855367 (0.0009) [2023-12-28 01:23:59,572][106225] Updated weights for policy 1, policy_version 857318 (0.0008) [2023-12-28 01:23:59,634][106225] Updated weights for policy 1, policy_version 857328 (0.0009) [2023-12-28 01:23:59,699][106225] Updated weights for policy 1, policy_version 857338 (0.0008) [2023-12-28 01:24:00,048][106226] Updated weights for policy 0, policy_version 855377 (0.0008) [2023-12-28 01:24:00,094][106226] Updated weights for policy 0, policy_version 855387 (0.0008) [2023-12-28 01:24:00,152][106226] Updated weights for policy 0, policy_version 855397 (0.0008) [2023-12-28 01:24:00,427][106225] Updated weights for policy 1, policy_version 857348 (0.0007) [2023-12-28 01:24:00,476][106225] Updated weights for policy 1, policy_version 857358 (0.0008) [2023-12-28 01:24:00,529][106225] Updated weights for policy 1, policy_version 857368 (0.0008) [2023-12-28 01:24:00,862][106226] Updated weights for policy 0, policy_version 855407 (0.0008) [2023-12-28 01:24:00,907][106226] Updated weights for policy 0, policy_version 855417 (0.0009) [2023-12-28 01:24:00,951][106226] Updated weights for policy 0, policy_version 855427 (0.0008) [2023-12-28 01:24:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 438575104. Throughput: 0: 9988.5, 1: 9893.9. Samples: 438564692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:01,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-5.246')] [2023-12-28 01:24:01,270][106225] Updated weights for policy 1, policy_version 857378 (0.0008) [2023-12-28 01:24:01,320][106225] Updated weights for policy 1, policy_version 857388 (0.0009) [2023-12-28 01:24:01,381][106225] Updated weights for policy 1, policy_version 857398 (0.0007) [2023-12-28 01:24:01,435][106225] Updated weights for policy 1, policy_version 857408 (0.0008) [2023-12-28 01:24:01,727][106226] Updated weights for policy 0, policy_version 855437 (0.0008) [2023-12-28 01:24:01,795][106226] Updated weights for policy 0, policy_version 855447 (0.0009) [2023-12-28 01:24:01,855][106226] Updated weights for policy 0, policy_version 855457 (0.0009) [2023-12-28 01:24:02,140][106225] Updated weights for policy 1, policy_version 857418 (0.0009) [2023-12-28 01:24:02,195][106225] Updated weights for policy 1, policy_version 857428 (0.0008) [2023-12-28 01:24:02,248][106225] Updated weights for policy 1, policy_version 857438 (0.0008) [2023-12-28 01:24:02,615][106226] Updated weights for policy 0, policy_version 855467 (0.0007) [2023-12-28 01:24:02,673][106226] Updated weights for policy 0, policy_version 855477 (0.0008) [2023-12-28 01:24:02,726][106226] Updated weights for policy 0, policy_version 855487 (0.0008) [2023-12-28 01:24:02,992][106225] Updated weights for policy 1, policy_version 857448 (0.0010) [2023-12-28 01:24:03,051][106225] Updated weights for policy 1, policy_version 857458 (0.0010) [2023-12-28 01:24:03,100][106225] Updated weights for policy 1, policy_version 857468 (0.0010) [2023-12-28 01:24:03,424][106226] Updated weights for policy 0, policy_version 855497 (0.0007) [2023-12-28 01:24:03,484][106226] Updated weights for policy 0, policy_version 855507 (0.0007) [2023-12-28 01:24:03,535][106226] Updated weights for policy 0, policy_version 855517 (0.0007) [2023-12-28 01:24:03,585][106226] Updated weights for policy 0, policy_version 855527 (0.0008) [2023-12-28 01:24:03,789][106225] Updated weights for policy 1, policy_version 857478 (0.0007) [2023-12-28 01:24:03,859][106225] Updated weights for policy 1, policy_version 857488 (0.0008) [2023-12-28 01:24:03,918][106225] Updated weights for policy 1, policy_version 857498 (0.0008) [2023-12-28 01:24:04,290][106226] Updated weights for policy 0, policy_version 855537 (0.0011) [2023-12-28 01:24:04,355][106226] Updated weights for policy 0, policy_version 855547 (0.0011) [2023-12-28 01:24:04,418][106226] Updated weights for policy 0, policy_version 855557 (0.0006) [2023-12-28 01:24:04,652][106225] Updated weights for policy 1, policy_version 857509 (0.0009) [2023-12-28 01:24:04,712][106225] Updated weights for policy 1, policy_version 857519 (0.0008) [2023-12-28 01:24:04,761][106225] Updated weights for policy 1, policy_version 857529 (0.0008) [2023-12-28 01:24:05,055][106226] Updated weights for policy 0, policy_version 855567 (0.0009) [2023-12-28 01:24:05,105][106226] Updated weights for policy 0, policy_version 855577 (0.0010) [2023-12-28 01:24:05,152][106226] Updated weights for policy 0, policy_version 855587 (0.0010) [2023-12-28 01:24:05,380][106225] Updated weights for policy 1, policy_version 857539 (0.0007) [2023-12-28 01:24:05,449][106225] Updated weights for policy 1, policy_version 857549 (0.0005) [2023-12-28 01:24:05,511][106225] Updated weights for policy 1, policy_version 857559 (0.0008) [2023-12-28 01:24:05,835][106226] Updated weights for policy 0, policy_version 855597 (0.0009) [2023-12-28 01:24:05,897][106226] Updated weights for policy 0, policy_version 855607 (0.0009) [2023-12-28 01:24:05,956][106226] Updated weights for policy 0, policy_version 855617 (0.0009) [2023-12-28 01:24:06,150][106225] Updated weights for policy 1, policy_version 857569 (0.0012) [2023-12-28 01:24:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 438673408. Throughput: 0: 9932.6, 1: 9893.2. Samples: 438683372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:06,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-5.199')] [2023-12-28 01:24:06,208][106225] Updated weights for policy 1, policy_version 857579 (0.0006) [2023-12-28 01:24:06,266][106225] Updated weights for policy 1, policy_version 857589 (0.0009) [2023-12-28 01:24:06,334][106225] Updated weights for policy 1, policy_version 857599 (0.0008) [2023-12-28 01:24:06,692][106226] Updated weights for policy 0, policy_version 855627 (0.0010) [2023-12-28 01:24:06,748][106226] Updated weights for policy 0, policy_version 855637 (0.0008) [2023-12-28 01:24:06,801][106226] Updated weights for policy 0, policy_version 855647 (0.0009) [2023-12-28 01:24:07,070][106225] Updated weights for policy 1, policy_version 857609 (0.0006) [2023-12-28 01:24:07,130][106225] Updated weights for policy 1, policy_version 857619 (0.0007) [2023-12-28 01:24:07,181][106225] Updated weights for policy 1, policy_version 857629 (0.0005) [2023-12-28 01:24:07,432][106226] Updated weights for policy 0, policy_version 855657 (0.0009) [2023-12-28 01:24:07,493][106226] Updated weights for policy 0, policy_version 855667 (0.0009) [2023-12-28 01:24:07,550][106226] Updated weights for policy 0, policy_version 855677 (0.0009) [2023-12-28 01:24:07,611][106226] Updated weights for policy 0, policy_version 855687 (0.0009) [2023-12-28 01:24:07,812][106225] Updated weights for policy 1, policy_version 857639 (0.0007) [2023-12-28 01:24:07,861][106225] Updated weights for policy 1, policy_version 857649 (0.0009) [2023-12-28 01:24:07,928][106225] Updated weights for policy 1, policy_version 857659 (0.0009) [2023-12-28 01:24:08,251][106226] Updated weights for policy 0, policy_version 855697 (0.0006) [2023-12-28 01:24:08,308][106226] Updated weights for policy 0, policy_version 855707 (0.0005) [2023-12-28 01:24:08,379][106226] Updated weights for policy 0, policy_version 855717 (0.0008) [2023-12-28 01:24:08,750][106225] Updated weights for policy 1, policy_version 857669 (0.0010) [2023-12-28 01:24:08,818][106225] Updated weights for policy 1, policy_version 857679 (0.0011) [2023-12-28 01:24:08,883][106225] Updated weights for policy 1, policy_version 857689 (0.0009) [2023-12-28 01:24:09,040][106226] Updated weights for policy 0, policy_version 855727 (0.0009) [2023-12-28 01:24:09,102][106226] Updated weights for policy 0, policy_version 855737 (0.0007) [2023-12-28 01:24:09,152][106226] Updated weights for policy 0, policy_version 855747 (0.0010) [2023-12-28 01:24:09,621][106225] Updated weights for policy 1, policy_version 857699 (0.0008) [2023-12-28 01:24:09,681][106225] Updated weights for policy 1, policy_version 857709 (0.0006) [2023-12-28 01:24:09,743][106225] Updated weights for policy 1, policy_version 857719 (0.0008) [2023-12-28 01:24:09,939][106226] Updated weights for policy 0, policy_version 855757 (0.0009) [2023-12-28 01:24:09,991][106226] Updated weights for policy 0, policy_version 855767 (0.0007) [2023-12-28 01:24:10,047][106226] Updated weights for policy 0, policy_version 855777 (0.0008) [2023-12-28 01:24:10,485][106225] Updated weights for policy 1, policy_version 857729 (0.0010) [2023-12-28 01:24:10,538][106225] Updated weights for policy 1, policy_version 857739 (0.0006) [2023-12-28 01:24:10,582][106225] Updated weights for policy 1, policy_version 857749 (0.0007) [2023-12-28 01:24:10,643][106225] Updated weights for policy 1, policy_version 857759 (0.0006) [2023-12-28 01:24:10,765][106226] Updated weights for policy 0, policy_version 855787 (0.0009) [2023-12-28 01:24:10,827][106226] Updated weights for policy 0, policy_version 855797 (0.0009) [2023-12-28 01:24:10,893][106226] Updated weights for policy 0, policy_version 855807 (0.0008) [2023-12-28 01:24:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 438771712. Throughput: 0: 9975.6, 1: 9914.0. Samples: 438743976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:11,175][105115] Avg episode reward: [(0, '-4.132'), (1, '-5.026')] [2023-12-28 01:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000855816_219144192.pth... [2023-12-28 01:24:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000857760_219627520.pth... [2023-12-28 01:24:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000856608_219332608.pth [2023-12-28 01:24:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000854664_218849280.pth [2023-12-28 01:24:11,297][106225] Updated weights for policy 1, policy_version 857769 (0.0007) [2023-12-28 01:24:11,361][106225] Updated weights for policy 1, policy_version 857779 (0.0009) [2023-12-28 01:24:11,424][106225] Updated weights for policy 1, policy_version 857789 (0.0009) [2023-12-28 01:24:11,708][106226] Updated weights for policy 0, policy_version 855817 (0.0008) [2023-12-28 01:24:11,780][106226] Updated weights for policy 0, policy_version 855827 (0.0008) [2023-12-28 01:24:11,831][106226] Updated weights for policy 0, policy_version 855837 (0.0006) [2023-12-28 01:24:11,891][106226] Updated weights for policy 0, policy_version 855847 (0.0007) [2023-12-28 01:24:12,096][106225] Updated weights for policy 1, policy_version 857799 (0.0009) [2023-12-28 01:24:12,149][106225] Updated weights for policy 1, policy_version 857809 (0.0007) [2023-12-28 01:24:12,208][106225] Updated weights for policy 1, policy_version 857819 (0.0009) [2023-12-28 01:24:12,544][106226] Updated weights for policy 0, policy_version 855857 (0.0008) [2023-12-28 01:24:12,609][106226] Updated weights for policy 0, policy_version 855867 (0.0008) [2023-12-28 01:24:12,675][106226] Updated weights for policy 0, policy_version 855877 (0.0008) [2023-12-28 01:24:12,944][106225] Updated weights for policy 1, policy_version 857829 (0.0009) [2023-12-28 01:24:13,014][106225] Updated weights for policy 1, policy_version 857839 (0.0010) [2023-12-28 01:24:13,079][106225] Updated weights for policy 1, policy_version 857849 (0.0010) [2023-12-28 01:24:13,369][106226] Updated weights for policy 0, policy_version 855887 (0.0009) [2023-12-28 01:24:13,422][106226] Updated weights for policy 0, policy_version 855897 (0.0008) [2023-12-28 01:24:13,477][106226] Updated weights for policy 0, policy_version 855907 (0.0008) [2023-12-28 01:24:13,643][106225] Updated weights for policy 1, policy_version 857859 (0.0010) [2023-12-28 01:24:13,709][106225] Updated weights for policy 1, policy_version 857869 (0.0010) [2023-12-28 01:24:13,764][106225] Updated weights for policy 1, policy_version 857879 (0.0010) [2023-12-28 01:24:14,120][106226] Updated weights for policy 0, policy_version 855917 (0.0008) [2023-12-28 01:24:14,176][106226] Updated weights for policy 0, policy_version 855927 (0.0006) [2023-12-28 01:24:14,237][106226] Updated weights for policy 0, policy_version 855937 (0.0009) [2023-12-28 01:24:14,458][106225] Updated weights for policy 1, policy_version 857889 (0.0008) [2023-12-28 01:24:14,513][106225] Updated weights for policy 1, policy_version 857899 (0.0008) [2023-12-28 01:24:14,579][106225] Updated weights for policy 1, policy_version 857909 (0.0006) [2023-12-28 01:24:14,631][106225] Updated weights for policy 1, policy_version 857919 (0.0008) [2023-12-28 01:24:15,028][106226] Updated weights for policy 0, policy_version 855947 (0.0008) [2023-12-28 01:24:15,094][106226] Updated weights for policy 0, policy_version 855957 (0.0009) [2023-12-28 01:24:15,158][106226] Updated weights for policy 0, policy_version 855967 (0.0008) [2023-12-28 01:24:15,265][106225] Updated weights for policy 1, policy_version 857929 (0.0007) [2023-12-28 01:24:15,321][106225] Updated weights for policy 1, policy_version 857939 (0.0008) [2023-12-28 01:24:15,370][106225] Updated weights for policy 1, policy_version 857949 (0.0008) [2023-12-28 01:24:15,814][106226] Updated weights for policy 0, policy_version 855977 (0.0008) [2023-12-28 01:24:15,872][106226] Updated weights for policy 0, policy_version 855987 (0.0008) [2023-12-28 01:24:15,920][106226] Updated weights for policy 0, policy_version 855997 (0.0008) [2023-12-28 01:24:15,969][106226] Updated weights for policy 0, policy_version 856007 (0.0009) [2023-12-28 01:24:16,146][106225] Updated weights for policy 1, policy_version 857959 (0.0008) [2023-12-28 01:24:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 438870016. Throughput: 0: 9823.6, 1: 9938.7. Samples: 438860668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:16,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.991')] [2023-12-28 01:24:16,191][106225] Updated weights for policy 1, policy_version 857969 (0.0008) [2023-12-28 01:24:16,252][106225] Updated weights for policy 1, policy_version 857979 (0.0008) [2023-12-28 01:24:16,662][106226] Updated weights for policy 0, policy_version 856017 (0.0006) [2023-12-28 01:24:16,718][106226] Updated weights for policy 0, policy_version 856027 (0.0008) [2023-12-28 01:24:16,766][106226] Updated weights for policy 0, policy_version 856037 (0.0008) [2023-12-28 01:24:16,905][106225] Updated weights for policy 1, policy_version 857989 (0.0008) [2023-12-28 01:24:16,967][106225] Updated weights for policy 1, policy_version 857999 (0.0009) [2023-12-28 01:24:17,032][106225] Updated weights for policy 1, policy_version 858009 (0.0008) [2023-12-28 01:24:17,500][106226] Updated weights for policy 0, policy_version 856047 (0.0009) [2023-12-28 01:24:17,560][106226] Updated weights for policy 0, policy_version 856057 (0.0008) [2023-12-28 01:24:17,616][106226] Updated weights for policy 0, policy_version 856067 (0.0009) [2023-12-28 01:24:17,715][106225] Updated weights for policy 1, policy_version 858019 (0.0009) [2023-12-28 01:24:17,776][106225] Updated weights for policy 1, policy_version 858029 (0.0008) [2023-12-28 01:24:17,833][106225] Updated weights for policy 1, policy_version 858040 (0.0009) [2023-12-28 01:24:18,271][106226] Updated weights for policy 0, policy_version 856077 (0.0007) [2023-12-28 01:24:18,319][106226] Updated weights for policy 0, policy_version 856087 (0.0005) [2023-12-28 01:24:18,390][106226] Updated weights for policy 0, policy_version 856097 (0.0007) [2023-12-28 01:24:18,606][106225] Updated weights for policy 1, policy_version 858050 (0.0009) [2023-12-28 01:24:18,660][106225] Updated weights for policy 1, policy_version 858060 (0.0010) [2023-12-28 01:24:18,711][106225] Updated weights for policy 1, policy_version 858070 (0.0010) [2023-12-28 01:24:18,765][106225] Updated weights for policy 1, policy_version 858080 (0.0010) [2023-12-28 01:24:18,991][106226] Updated weights for policy 0, policy_version 856107 (0.0006) [2023-12-28 01:24:19,041][106226] Updated weights for policy 0, policy_version 856117 (0.0005) [2023-12-28 01:24:19,095][106226] Updated weights for policy 0, policy_version 856127 (0.0005) [2023-12-28 01:24:19,515][106225] Updated weights for policy 1, policy_version 858090 (0.0008) [2023-12-28 01:24:19,581][106225] Updated weights for policy 1, policy_version 858100 (0.0006) [2023-12-28 01:24:19,643][106225] Updated weights for policy 1, policy_version 858110 (0.0010) [2023-12-28 01:24:19,762][106226] Updated weights for policy 0, policy_version 856137 (0.0006) [2023-12-28 01:24:19,829][106226] Updated weights for policy 0, policy_version 856147 (0.0009) [2023-12-28 01:24:19,897][106226] Updated weights for policy 0, policy_version 856157 (0.0009) [2023-12-28 01:24:19,960][106226] Updated weights for policy 0, policy_version 856167 (0.0009) [2023-12-28 01:24:20,405][106225] Updated weights for policy 1, policy_version 858120 (0.0008) [2023-12-28 01:24:20,472][106225] Updated weights for policy 1, policy_version 858130 (0.0010) [2023-12-28 01:24:20,534][106225] Updated weights for policy 1, policy_version 858140 (0.0010) [2023-12-28 01:24:20,620][106226] Updated weights for policy 0, policy_version 856177 (0.0008) [2023-12-28 01:24:20,685][106226] Updated weights for policy 0, policy_version 856187 (0.0008) [2023-12-28 01:24:20,744][106226] Updated weights for policy 0, policy_version 856197 (0.0011) [2023-12-28 01:24:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 438968320. Throughput: 0: 9902.9, 1: 9934.7. Samples: 438980076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:21,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-5.117')] [2023-12-28 01:24:21,256][106225] Updated weights for policy 1, policy_version 858150 (0.0010) [2023-12-28 01:24:21,322][106225] Updated weights for policy 1, policy_version 858160 (0.0010) [2023-12-28 01:24:21,390][106225] Updated weights for policy 1, policy_version 858170 (0.0012) [2023-12-28 01:24:21,493][106226] Updated weights for policy 0, policy_version 856207 (0.0009) [2023-12-28 01:24:21,559][106226] Updated weights for policy 0, policy_version 856217 (0.0009) [2023-12-28 01:24:21,626][106226] Updated weights for policy 0, policy_version 856227 (0.0009) [2023-12-28 01:24:22,063][106225] Updated weights for policy 1, policy_version 858180 (0.0007) [2023-12-28 01:24:22,123][106225] Updated weights for policy 1, policy_version 858190 (0.0006) [2023-12-28 01:24:22,179][106225] Updated weights for policy 1, policy_version 858200 (0.0006) [2023-12-28 01:24:22,468][106226] Updated weights for policy 0, policy_version 856237 (0.0008) [2023-12-28 01:24:22,525][106226] Updated weights for policy 0, policy_version 856247 (0.0009) [2023-12-28 01:24:22,588][106226] Updated weights for policy 0, policy_version 856257 (0.0009) [2023-12-28 01:24:22,848][106225] Updated weights for policy 1, policy_version 858210 (0.0006) [2023-12-28 01:24:22,900][106225] Updated weights for policy 1, policy_version 858220 (0.0009) [2023-12-28 01:24:22,955][106225] Updated weights for policy 1, policy_version 858230 (0.0007) [2023-12-28 01:24:23,017][106225] Updated weights for policy 1, policy_version 858240 (0.0005) [2023-12-28 01:24:23,267][106226] Updated weights for policy 0, policy_version 856267 (0.0008) [2023-12-28 01:24:23,319][106226] Updated weights for policy 0, policy_version 856277 (0.0009) [2023-12-28 01:24:23,371][106226] Updated weights for policy 0, policy_version 856287 (0.0010) [2023-12-28 01:24:23,565][106225] Updated weights for policy 1, policy_version 858250 (0.0005) [2023-12-28 01:24:23,626][106225] Updated weights for policy 1, policy_version 858260 (0.0007) [2023-12-28 01:24:23,685][106225] Updated weights for policy 1, policy_version 858270 (0.0008) [2023-12-28 01:24:24,129][106226] Updated weights for policy 0, policy_version 856297 (0.0009) [2023-12-28 01:24:24,191][106226] Updated weights for policy 0, policy_version 856307 (0.0008) [2023-12-28 01:24:24,253][106226] Updated weights for policy 0, policy_version 856317 (0.0008) [2023-12-28 01:24:24,307][106226] Updated weights for policy 0, policy_version 856327 (0.0009) [2023-12-28 01:24:24,374][106225] Updated weights for policy 1, policy_version 858280 (0.0006) [2023-12-28 01:24:24,442][106225] Updated weights for policy 1, policy_version 858290 (0.0005) [2023-12-28 01:24:24,502][106225] Updated weights for policy 1, policy_version 858300 (0.0007) [2023-12-28 01:24:25,093][106226] Updated weights for policy 0, policy_version 856337 (0.0008) [2023-12-28 01:24:25,114][106225] Updated weights for policy 1, policy_version 858310 (0.0011) [2023-12-28 01:24:25,155][106226] Updated weights for policy 0, policy_version 856347 (0.0007) [2023-12-28 01:24:25,165][106225] Updated weights for policy 1, policy_version 858320 (0.0008) [2023-12-28 01:24:25,221][106226] Updated weights for policy 0, policy_version 856357 (0.0008) [2023-12-28 01:24:25,223][106225] Updated weights for policy 1, policy_version 858330 (0.0005) [2023-12-28 01:24:25,919][106225] Updated weights for policy 1, policy_version 858340 (0.0009) [2023-12-28 01:24:25,948][106226] Updated weights for policy 0, policy_version 856367 (0.0006) [2023-12-28 01:24:25,976][106225] Updated weights for policy 1, policy_version 858350 (0.0009) [2023-12-28 01:24:26,003][106226] Updated weights for policy 0, policy_version 856377 (0.0007) [2023-12-28 01:24:26,033][106225] Updated weights for policy 1, policy_version 858360 (0.0007) [2023-12-28 01:24:26,059][106226] Updated weights for policy 0, policy_version 856387 (0.0006) [2023-12-28 01:24:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 439074816. Throughput: 0: 9865.7, 1: 9999.6. Samples: 439039128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:26,175][105115] Avg episode reward: [(0, '-4.292'), (1, '-4.846')] [2023-12-28 01:24:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000858368_219783168.pth... [2023-12-28 01:24:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000856392_219291648.pth... [2023-12-28 01:24:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000857184_219480064.pth [2023-12-28 01:24:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000855240_218996736.pth [2023-12-28 01:24:26,703][106226] Updated weights for policy 0, policy_version 856397 (0.0008) [2023-12-28 01:24:26,751][106226] Updated weights for policy 0, policy_version 856407 (0.0008) [2023-12-28 01:24:26,805][106225] Updated weights for policy 1, policy_version 858370 (0.0007) [2023-12-28 01:24:26,807][106226] Updated weights for policy 0, policy_version 856417 (0.0008) [2023-12-28 01:24:26,859][106225] Updated weights for policy 1, policy_version 858380 (0.0007) [2023-12-28 01:24:26,913][106225] Updated weights for policy 1, policy_version 858390 (0.0008) [2023-12-28 01:24:26,960][106225] Updated weights for policy 1, policy_version 858400 (0.0008) [2023-12-28 01:24:27,566][106225] Updated weights for policy 1, policy_version 858410 (0.0008) [2023-12-28 01:24:27,584][106226] Updated weights for policy 0, policy_version 856427 (0.0006) [2023-12-28 01:24:27,610][106225] Updated weights for policy 1, policy_version 858420 (0.0006) [2023-12-28 01:24:27,643][106226] Updated weights for policy 0, policy_version 856437 (0.0008) [2023-12-28 01:24:27,657][106225] Updated weights for policy 1, policy_version 858430 (0.0006) [2023-12-28 01:24:27,697][106226] Updated weights for policy 0, policy_version 856447 (0.0008) [2023-12-28 01:24:28,424][106225] Updated weights for policy 1, policy_version 858440 (0.0007) [2023-12-28 01:24:28,443][106226] Updated weights for policy 0, policy_version 856457 (0.0008) [2023-12-28 01:24:28,483][106225] Updated weights for policy 1, policy_version 858450 (0.0008) [2023-12-28 01:24:28,502][106226] Updated weights for policy 0, policy_version 856467 (0.0006) [2023-12-28 01:24:28,537][106225] Updated weights for policy 1, policy_version 858460 (0.0008) [2023-12-28 01:24:28,550][106226] Updated weights for policy 0, policy_version 856477 (0.0007) [2023-12-28 01:24:28,602][106226] Updated weights for policy 0, policy_version 856487 (0.0007) [2023-12-28 01:24:29,249][106226] Updated weights for policy 0, policy_version 856497 (0.0009) [2023-12-28 01:24:29,264][106225] Updated weights for policy 1, policy_version 858470 (0.0008) [2023-12-28 01:24:29,309][106226] Updated weights for policy 0, policy_version 856507 (0.0008) [2023-12-28 01:24:29,319][106225] Updated weights for policy 1, policy_version 858480 (0.0006) [2023-12-28 01:24:29,373][106226] Updated weights for policy 0, policy_version 856517 (0.0009) [2023-12-28 01:24:29,388][106225] Updated weights for policy 1, policy_version 858490 (0.0009) [2023-12-28 01:24:30,083][106225] Updated weights for policy 1, policy_version 858500 (0.0008) [2023-12-28 01:24:30,109][106226] Updated weights for policy 0, policy_version 856527 (0.0008) [2023-12-28 01:24:30,145][106225] Updated weights for policy 1, policy_version 858510 (0.0008) [2023-12-28 01:24:30,172][106226] Updated weights for policy 0, policy_version 856537 (0.0007) [2023-12-28 01:24:30,207][106225] Updated weights for policy 1, policy_version 858520 (0.0007) [2023-12-28 01:24:30,233][106226] Updated weights for policy 0, policy_version 856547 (0.0008) [2023-12-28 01:24:30,910][106225] Updated weights for policy 1, policy_version 858530 (0.0007) [2023-12-28 01:24:30,955][106225] Updated weights for policy 1, policy_version 858540 (0.0006) [2023-12-28 01:24:30,981][106226] Updated weights for policy 0, policy_version 856557 (0.0006) [2023-12-28 01:24:31,010][106225] Updated weights for policy 1, policy_version 858550 (0.0007) [2023-12-28 01:24:31,039][106226] Updated weights for policy 0, policy_version 856567 (0.0007) [2023-12-28 01:24:31,072][106225] Updated weights for policy 1, policy_version 858560 (0.0007) [2023-12-28 01:24:31,100][106226] Updated weights for policy 0, policy_version 856577 (0.0009) [2023-12-28 01:24:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 439173120. Throughput: 0: 9829.0, 1: 10022.2. Samples: 439156772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:31,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-4.997')] [2023-12-28 01:24:31,799][106226] Updated weights for policy 0, policy_version 856587 (0.0010) [2023-12-28 01:24:31,827][106225] Updated weights for policy 1, policy_version 858570 (0.0006) [2023-12-28 01:24:31,860][106226] Updated weights for policy 0, policy_version 856597 (0.0007) [2023-12-28 01:24:31,886][106225] Updated weights for policy 1, policy_version 858580 (0.0007) [2023-12-28 01:24:31,926][106226] Updated weights for policy 0, policy_version 856607 (0.0008) [2023-12-28 01:24:31,951][106225] Updated weights for policy 1, policy_version 858590 (0.0007) [2023-12-28 01:24:32,622][106225] Updated weights for policy 1, policy_version 858600 (0.0008) [2023-12-28 01:24:32,623][106226] Updated weights for policy 0, policy_version 856617 (0.0008) [2023-12-28 01:24:32,674][106226] Updated weights for policy 0, policy_version 856627 (0.0011) [2023-12-28 01:24:32,680][106225] Updated weights for policy 1, policy_version 858610 (0.0006) [2023-12-28 01:24:32,721][106226] Updated weights for policy 0, policy_version 856637 (0.0010) [2023-12-28 01:24:32,736][106225] Updated weights for policy 1, policy_version 858620 (0.0006) [2023-12-28 01:24:32,769][106226] Updated weights for policy 0, policy_version 856647 (0.0010) [2023-12-28 01:24:33,444][106225] Updated weights for policy 1, policy_version 858630 (0.0008) [2023-12-28 01:24:33,496][106225] Updated weights for policy 1, policy_version 858640 (0.0010) [2023-12-28 01:24:33,511][106226] Updated weights for policy 0, policy_version 856657 (0.0010) [2023-12-28 01:24:33,543][106225] Updated weights for policy 1, policy_version 858650 (0.0010) [2023-12-28 01:24:33,574][106226] Updated weights for policy 0, policy_version 856667 (0.0009) [2023-12-28 01:24:33,629][106226] Updated weights for policy 0, policy_version 856677 (0.0010) [2023-12-28 01:24:34,154][106225] Updated weights for policy 1, policy_version 858660 (0.0010) [2023-12-28 01:24:34,216][106225] Updated weights for policy 1, policy_version 858670 (0.0008) [2023-12-28 01:24:34,267][106225] Updated weights for policy 1, policy_version 858680 (0.0008) [2023-12-28 01:24:34,344][106226] Updated weights for policy 0, policy_version 856687 (0.0010) [2023-12-28 01:24:34,396][106226] Updated weights for policy 0, policy_version 856697 (0.0010) [2023-12-28 01:24:34,461][106226] Updated weights for policy 0, policy_version 856707 (0.0011) [2023-12-28 01:24:35,043][106225] Updated weights for policy 1, policy_version 858690 (0.0009) [2023-12-28 01:24:35,093][106225] Updated weights for policy 1, policy_version 858700 (0.0010) [2023-12-28 01:24:35,154][106225] Updated weights for policy 1, policy_version 858710 (0.0010) [2023-12-28 01:24:35,154][106226] Updated weights for policy 0, policy_version 856717 (0.0008) [2023-12-28 01:24:35,214][106225] Updated weights for policy 1, policy_version 858720 (0.0010) [2023-12-28 01:24:35,215][106226] Updated weights for policy 0, policy_version 856727 (0.0006) [2023-12-28 01:24:35,271][106226] Updated weights for policy 0, policy_version 856737 (0.0007) [2023-12-28 01:24:35,917][106226] Updated weights for policy 0, policy_version 856747 (0.0006) [2023-12-28 01:24:35,945][106225] Updated weights for policy 1, policy_version 858730 (0.0010) [2023-12-28 01:24:35,975][106226] Updated weights for policy 0, policy_version 856757 (0.0006) [2023-12-28 01:24:35,993][106225] Updated weights for policy 1, policy_version 858740 (0.0008) [2023-12-28 01:24:36,033][106226] Updated weights for policy 0, policy_version 856767 (0.0007) [2023-12-28 01:24:36,045][106225] Updated weights for policy 1, policy_version 858750 (0.0005) [2023-12-28 01:24:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 439271424. Throughput: 0: 9801.9, 1: 9945.5. Samples: 439274616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:36,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.274')] [2023-12-28 01:24:36,819][106225] Updated weights for policy 1, policy_version 858760 (0.0007) [2023-12-28 01:24:36,830][106226] Updated weights for policy 0, policy_version 856777 (0.0008) [2023-12-28 01:24:36,875][106225] Updated weights for policy 1, policy_version 858770 (0.0007) [2023-12-28 01:24:36,890][106226] Updated weights for policy 0, policy_version 856787 (0.0009) [2023-12-28 01:24:36,933][106225] Updated weights for policy 1, policy_version 858780 (0.0005) [2023-12-28 01:24:36,941][106226] Updated weights for policy 0, policy_version 856797 (0.0009) [2023-12-28 01:24:36,998][106226] Updated weights for policy 0, policy_version 856808 (0.0009) [2023-12-28 01:24:37,631][106225] Updated weights for policy 1, policy_version 858790 (0.0007) [2023-12-28 01:24:37,679][106225] Updated weights for policy 1, policy_version 858801 (0.0008) [2023-12-28 01:24:37,728][106226] Updated weights for policy 0, policy_version 856818 (0.0007) [2023-12-28 01:24:37,741][106225] Updated weights for policy 1, policy_version 858811 (0.0007) [2023-12-28 01:24:37,786][106226] Updated weights for policy 0, policy_version 856828 (0.0008) [2023-12-28 01:24:37,852][106226] Updated weights for policy 0, policy_version 856838 (0.0007) [2023-12-28 01:24:38,524][106225] Updated weights for policy 1, policy_version 858821 (0.0005) [2023-12-28 01:24:38,531][106226] Updated weights for policy 0, policy_version 856848 (0.0008) [2023-12-28 01:24:38,588][106225] Updated weights for policy 1, policy_version 858831 (0.0009) [2023-12-28 01:24:38,603][106226] Updated weights for policy 0, policy_version 856858 (0.0007) [2023-12-28 01:24:38,648][106225] Updated weights for policy 1, policy_version 858841 (0.0008) [2023-12-28 01:24:38,662][106226] Updated weights for policy 0, policy_version 856868 (0.0006) [2023-12-28 01:24:39,382][106226] Updated weights for policy 0, policy_version 856878 (0.0008) [2023-12-28 01:24:39,434][106225] Updated weights for policy 1, policy_version 858851 (0.0008) [2023-12-28 01:24:39,455][106226] Updated weights for policy 0, policy_version 856888 (0.0007) [2023-12-28 01:24:39,499][106225] Updated weights for policy 1, policy_version 858861 (0.0009) [2023-12-28 01:24:39,516][106226] Updated weights for policy 0, policy_version 856898 (0.0008) [2023-12-28 01:24:39,554][106225] Updated weights for policy 1, policy_version 858871 (0.0007) [2023-12-28 01:24:40,260][106225] Updated weights for policy 1, policy_version 858881 (0.0008) [2023-12-28 01:24:40,292][106226] Updated weights for policy 0, policy_version 856908 (0.0008) [2023-12-28 01:24:40,323][106225] Updated weights for policy 1, policy_version 858891 (0.0008) [2023-12-28 01:24:40,345][106226] Updated weights for policy 0, policy_version 856918 (0.0008) [2023-12-28 01:24:40,386][106225] Updated weights for policy 1, policy_version 858901 (0.0007) [2023-12-28 01:24:40,401][106226] Updated weights for policy 0, policy_version 856928 (0.0006) [2023-12-28 01:24:40,449][106225] Updated weights for policy 1, policy_version 858911 (0.0008) [2023-12-28 01:24:41,123][106225] Updated weights for policy 1, policy_version 858921 (0.0008) [2023-12-28 01:24:41,172][106226] Updated weights for policy 0, policy_version 856938 (0.0007) [2023-12-28 01:24:41,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 439353344. Throughput: 0: 9781.0, 1: 9920.1. Samples: 439331376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:41,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.282')] [2023-12-28 01:24:41,198][106225] Updated weights for policy 1, policy_version 858931 (0.0008) [2023-12-28 01:24:41,247][106226] Updated weights for policy 0, policy_version 856948 (0.0008) [2023-12-28 01:24:41,265][106225] Updated weights for policy 1, policy_version 858941 (0.0008) [2023-12-28 01:24:41,286][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000858944_219930624.pth... [2023-12-28 01:24:41,291][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000857760_219627520.pth [2023-12-28 01:24:41,309][106226] Updated weights for policy 0, policy_version 856958 (0.0006) [2023-12-28 01:24:41,378][106226] Updated weights for policy 0, policy_version 856968 (0.0008) [2023-12-28 01:24:41,378][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000856968_219439104.pth... [2023-12-28 01:24:41,382][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000855816_219144192.pth [2023-12-28 01:24:42,047][106225] Updated weights for policy 1, policy_version 858951 (0.0011) [2023-12-28 01:24:42,116][106225] Updated weights for policy 1, policy_version 858961 (0.0011) [2023-12-28 01:24:42,119][106226] Updated weights for policy 0, policy_version 856978 (0.0006) [2023-12-28 01:24:42,177][106225] Updated weights for policy 1, policy_version 858971 (0.0010) [2023-12-28 01:24:42,182][106226] Updated weights for policy 0, policy_version 856988 (0.0006) [2023-12-28 01:24:42,244][106226] Updated weights for policy 0, policy_version 856998 (0.0007) [2023-12-28 01:24:42,900][106225] Updated weights for policy 1, policy_version 858981 (0.0010) [2023-12-28 01:24:42,965][106225] Updated weights for policy 1, policy_version 858991 (0.0009) [2023-12-28 01:24:42,979][106226] Updated weights for policy 0, policy_version 857008 (0.0006) [2023-12-28 01:24:43,018][106225] Updated weights for policy 1, policy_version 859001 (0.0008) [2023-12-28 01:24:43,031][106226] Updated weights for policy 0, policy_version 857018 (0.0006) [2023-12-28 01:24:43,088][106226] Updated weights for policy 0, policy_version 857028 (0.0007) [2023-12-28 01:24:43,721][106225] Updated weights for policy 1, policy_version 859011 (0.0008) [2023-12-28 01:24:43,770][106225] Updated weights for policy 1, policy_version 859021 (0.0008) [2023-12-28 01:24:43,788][106226] Updated weights for policy 0, policy_version 857038 (0.0008) [2023-12-28 01:24:43,821][106225] Updated weights for policy 1, policy_version 859031 (0.0007) [2023-12-28 01:24:43,846][106226] Updated weights for policy 0, policy_version 857048 (0.0008) [2023-12-28 01:24:43,892][106226] Updated weights for policy 0, policy_version 857058 (0.0007) [2023-12-28 01:24:44,473][106225] Updated weights for policy 1, policy_version 859041 (0.0006) [2023-12-28 01:24:44,530][106225] Updated weights for policy 1, policy_version 859051 (0.0007) [2023-12-28 01:24:44,535][106226] Updated weights for policy 0, policy_version 857068 (0.0008) [2023-12-28 01:24:44,583][106225] Updated weights for policy 1, policy_version 859061 (0.0006) [2023-12-28 01:24:44,600][106226] Updated weights for policy 0, policy_version 857078 (0.0009) [2023-12-28 01:24:44,640][106225] Updated weights for policy 1, policy_version 859071 (0.0005) [2023-12-28 01:24:44,655][106226] Updated weights for policy 0, policy_version 857088 (0.0007) [2023-12-28 01:24:45,309][106225] Updated weights for policy 1, policy_version 859081 (0.0008) [2023-12-28 01:24:45,367][106225] Updated weights for policy 1, policy_version 859091 (0.0006) [2023-12-28 01:24:45,420][106225] Updated weights for policy 1, policy_version 859101 (0.0008) [2023-12-28 01:24:45,423][106226] Updated weights for policy 0, policy_version 857098 (0.0008) [2023-12-28 01:24:45,480][106226] Updated weights for policy 0, policy_version 857108 (0.0008) [2023-12-28 01:24:45,543][106226] Updated weights for policy 0, policy_version 857118 (0.0008) [2023-12-28 01:24:45,603][106226] Updated weights for policy 0, policy_version 857128 (0.0009) [2023-12-28 01:24:46,110][106225] Updated weights for policy 1, policy_version 859111 (0.0007) [2023-12-28 01:24:46,157][106225] Updated weights for policy 1, policy_version 859121 (0.0010) [2023-12-28 01:24:46,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 439451648. Throughput: 0: 9733.6, 1: 9848.8. Samples: 439445900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:46,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.862')] [2023-12-28 01:24:46,208][106225] Updated weights for policy 1, policy_version 859131 (0.0010) [2023-12-28 01:24:46,333][106226] Updated weights for policy 0, policy_version 857138 (0.0008) [2023-12-28 01:24:46,387][106226] Updated weights for policy 0, policy_version 857148 (0.0008) [2023-12-28 01:24:46,449][106226] Updated weights for policy 0, policy_version 857158 (0.0009) [2023-12-28 01:24:46,809][106225] Updated weights for policy 1, policy_version 859141 (0.0009) [2023-12-28 01:24:46,861][106225] Updated weights for policy 1, policy_version 859151 (0.0008) [2023-12-28 01:24:46,912][106225] Updated weights for policy 1, policy_version 859161 (0.0008) [2023-12-28 01:24:47,277][106226] Updated weights for policy 0, policy_version 857168 (0.0009) [2023-12-28 01:24:47,323][106226] Updated weights for policy 0, policy_version 857178 (0.0008) [2023-12-28 01:24:47,375][106226] Updated weights for policy 0, policy_version 857188 (0.0008) [2023-12-28 01:24:47,525][106225] Updated weights for policy 1, policy_version 859171 (0.0006) [2023-12-28 01:24:47,573][106225] Updated weights for policy 1, policy_version 859181 (0.0005) [2023-12-28 01:24:47,621][106225] Updated weights for policy 1, policy_version 859191 (0.0005) [2023-12-28 01:24:48,151][106225] Updated weights for policy 1, policy_version 859201 (0.0005) [2023-12-28 01:24:48,210][106226] Updated weights for policy 0, policy_version 857198 (0.0008) [2023-12-28 01:24:48,212][106225] Updated weights for policy 1, policy_version 859211 (0.0007) [2023-12-28 01:24:48,264][106226] Updated weights for policy 0, policy_version 857208 (0.0007) [2023-12-28 01:24:48,270][106225] Updated weights for policy 1, policy_version 859221 (0.0010) [2023-12-28 01:24:48,329][106226] Updated weights for policy 0, policy_version 857218 (0.0007) [2023-12-28 01:24:48,338][106225] Updated weights for policy 1, policy_version 859231 (0.0008) [2023-12-28 01:24:48,922][106225] Updated weights for policy 1, policy_version 859241 (0.0006) [2023-12-28 01:24:48,979][106225] Updated weights for policy 1, policy_version 859251 (0.0005) [2023-12-28 01:24:49,029][106225] Updated weights for policy 1, policy_version 859261 (0.0005) [2023-12-28 01:24:49,107][106226] Updated weights for policy 0, policy_version 857228 (0.0009) [2023-12-28 01:24:49,165][106226] Updated weights for policy 0, policy_version 857238 (0.0009) [2023-12-28 01:24:49,222][106226] Updated weights for policy 0, policy_version 857248 (0.0010) [2023-12-28 01:24:49,706][106225] Updated weights for policy 1, policy_version 859271 (0.0005) [2023-12-28 01:24:49,756][106225] Updated weights for policy 1, policy_version 859281 (0.0007) [2023-12-28 01:24:49,819][106225] Updated weights for policy 1, policy_version 859291 (0.0008) [2023-12-28 01:24:50,019][106226] Updated weights for policy 0, policy_version 857258 (0.0007) [2023-12-28 01:24:50,079][106226] Updated weights for policy 0, policy_version 857268 (0.0009) [2023-12-28 01:24:50,131][106226] Updated weights for policy 0, policy_version 857278 (0.0009) [2023-12-28 01:24:50,180][106226] Updated weights for policy 0, policy_version 857288 (0.0009) [2023-12-28 01:24:50,537][106225] Updated weights for policy 1, policy_version 859301 (0.0008) [2023-12-28 01:24:50,610][106225] Updated weights for policy 1, policy_version 859311 (0.0008) [2023-12-28 01:24:50,674][106225] Updated weights for policy 1, policy_version 859321 (0.0008) [2023-12-28 01:24:50,908][106226] Updated weights for policy 0, policy_version 857298 (0.0011) [2023-12-28 01:24:50,969][106226] Updated weights for policy 0, policy_version 857308 (0.0010) [2023-12-28 01:24:51,032][106226] Updated weights for policy 0, policy_version 857318 (0.0010) [2023-12-28 01:24:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 439558144. Throughput: 0: 9629.5, 1: 9944.3. Samples: 439564192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:51,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-5.109')] [2023-12-28 01:24:51,492][106225] Updated weights for policy 1, policy_version 859331 (0.0008) [2023-12-28 01:24:51,557][106225] Updated weights for policy 1, policy_version 859341 (0.0008) [2023-12-28 01:24:51,618][106225] Updated weights for policy 1, policy_version 859351 (0.0008) [2023-12-28 01:24:51,848][106226] Updated weights for policy 0, policy_version 857328 (0.0008) [2023-12-28 01:24:51,907][106226] Updated weights for policy 0, policy_version 857338 (0.0008) [2023-12-28 01:24:51,967][106226] Updated weights for policy 0, policy_version 857348 (0.0009) [2023-12-28 01:24:52,336][106225] Updated weights for policy 1, policy_version 859361 (0.0008) [2023-12-28 01:24:52,407][106225] Updated weights for policy 1, policy_version 859371 (0.0009) [2023-12-28 01:24:52,461][106225] Updated weights for policy 1, policy_version 859381 (0.0008) [2023-12-28 01:24:52,517][106225] Updated weights for policy 1, policy_version 859391 (0.0008) [2023-12-28 01:24:52,682][106226] Updated weights for policy 0, policy_version 857358 (0.0007) [2023-12-28 01:24:52,744][106226] Updated weights for policy 0, policy_version 857368 (0.0005) [2023-12-28 01:24:52,806][106226] Updated weights for policy 0, policy_version 857378 (0.0008) [2023-12-28 01:24:53,271][106225] Updated weights for policy 1, policy_version 859401 (0.0006) [2023-12-28 01:24:53,324][106225] Updated weights for policy 1, policy_version 859411 (0.0005) [2023-12-28 01:24:53,380][106225] Updated weights for policy 1, policy_version 859421 (0.0006) [2023-12-28 01:24:53,505][106226] Updated weights for policy 0, policy_version 857388 (0.0008) [2023-12-28 01:24:53,575][106226] Updated weights for policy 0, policy_version 857398 (0.0010) [2023-12-28 01:24:53,637][106226] Updated weights for policy 0, policy_version 857408 (0.0009) [2023-12-28 01:24:54,004][106225] Updated weights for policy 1, policy_version 859431 (0.0008) [2023-12-28 01:24:54,060][106225] Updated weights for policy 1, policy_version 859441 (0.0008) [2023-12-28 01:24:54,119][106225] Updated weights for policy 1, policy_version 859452 (0.0009) [2023-12-28 01:24:54,238][106226] Updated weights for policy 0, policy_version 857418 (0.0009) [2023-12-28 01:24:54,301][106226] Updated weights for policy 0, policy_version 857428 (0.0008) [2023-12-28 01:24:54,350][106226] Updated weights for policy 0, policy_version 857438 (0.0008) [2023-12-28 01:24:54,402][106226] Updated weights for policy 0, policy_version 857448 (0.0008) [2023-12-28 01:24:54,818][106225] Updated weights for policy 1, policy_version 859462 (0.0010) [2023-12-28 01:24:54,874][106225] Updated weights for policy 1, policy_version 859472 (0.0010) [2023-12-28 01:24:54,920][106225] Updated weights for policy 1, policy_version 859482 (0.0010) [2023-12-28 01:24:55,055][106226] Updated weights for policy 0, policy_version 857458 (0.0010) [2023-12-28 01:24:55,122][106226] Updated weights for policy 0, policy_version 857468 (0.0011) [2023-12-28 01:24:55,182][106226] Updated weights for policy 0, policy_version 857478 (0.0011) [2023-12-28 01:24:55,548][106225] Updated weights for policy 1, policy_version 859492 (0.0008) [2023-12-28 01:24:55,608][106225] Updated weights for policy 1, policy_version 859502 (0.0008) [2023-12-28 01:24:55,661][106225] Updated weights for policy 1, policy_version 859512 (0.0010) [2023-12-28 01:24:55,803][106226] Updated weights for policy 0, policy_version 857488 (0.0010) [2023-12-28 01:24:55,863][106226] Updated weights for policy 0, policy_version 857498 (0.0010) [2023-12-28 01:24:55,910][106226] Updated weights for policy 0, policy_version 857508 (0.0010) [2023-12-28 01:24:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 439656448. Throughput: 0: 9577.6, 1: 9948.2. Samples: 439622636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:24:56,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-4.877')] [2023-12-28 01:24:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000859520_220078080.pth... [2023-12-28 01:24:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000857512_219578368.pth... [2023-12-28 01:24:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000858368_219783168.pth [2023-12-28 01:24:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000856392_219291648.pth [2023-12-28 01:24:56,223][106225] Updated weights for policy 1, policy_version 859522 (0.0010) [2023-12-28 01:24:56,277][106225] Updated weights for policy 1, policy_version 859532 (0.0010) [2023-12-28 01:24:56,338][106225] Updated weights for policy 1, policy_version 859542 (0.0010) [2023-12-28 01:24:56,397][106225] Updated weights for policy 1, policy_version 859552 (0.0010) [2023-12-28 01:24:56,605][106226] Updated weights for policy 0, policy_version 857518 (0.0010) [2023-12-28 01:24:56,668][106226] Updated weights for policy 0, policy_version 857528 (0.0005) [2023-12-28 01:24:56,731][106226] Updated weights for policy 0, policy_version 857538 (0.0005) [2023-12-28 01:24:57,101][106225] Updated weights for policy 1, policy_version 859562 (0.0010) [2023-12-28 01:24:57,159][106225] Updated weights for policy 1, policy_version 859572 (0.0010) [2023-12-28 01:24:57,214][106225] Updated weights for policy 1, policy_version 859582 (0.0010) [2023-12-28 01:24:57,317][106226] Updated weights for policy 0, policy_version 857548 (0.0005) [2023-12-28 01:24:57,370][106226] Updated weights for policy 0, policy_version 857558 (0.0006) [2023-12-28 01:24:57,415][106226] Updated weights for policy 0, policy_version 857568 (0.0006) [2023-12-28 01:24:57,917][106225] Updated weights for policy 1, policy_version 859592 (0.0010) [2023-12-28 01:24:57,985][106225] Updated weights for policy 1, policy_version 859602 (0.0010) [2023-12-28 01:24:58,016][106226] Updated weights for policy 0, policy_version 857578 (0.0009) [2023-12-28 01:24:58,045][106225] Updated weights for policy 1, policy_version 859612 (0.0010) [2023-12-28 01:24:58,085][106226] Updated weights for policy 0, policy_version 857588 (0.0006) [2023-12-28 01:24:58,147][106226] Updated weights for policy 0, policy_version 857598 (0.0008) [2023-12-28 01:24:58,216][106226] Updated weights for policy 0, policy_version 857608 (0.0008) [2023-12-28 01:24:58,817][106225] Updated weights for policy 1, policy_version 859622 (0.0012) [2023-12-28 01:24:58,897][106225] Updated weights for policy 1, policy_version 859632 (0.0011) [2023-12-28 01:24:58,974][106225] Updated weights for policy 1, policy_version 859642 (0.0009) [2023-12-28 01:24:59,039][106226] Updated weights for policy 0, policy_version 857618 (0.0008) [2023-12-28 01:24:59,094][106226] Updated weights for policy 0, policy_version 857628 (0.0008) [2023-12-28 01:24:59,146][106226] Updated weights for policy 0, policy_version 857638 (0.0008) [2023-12-28 01:24:59,683][106225] Updated weights for policy 1, policy_version 859652 (0.0010) [2023-12-28 01:24:59,744][106225] Updated weights for policy 1, policy_version 859662 (0.0010) [2023-12-28 01:24:59,798][106225] Updated weights for policy 1, policy_version 859672 (0.0009) [2023-12-28 01:24:59,920][106226] Updated weights for policy 0, policy_version 857648 (0.0006) [2023-12-28 01:24:59,991][106226] Updated weights for policy 0, policy_version 857658 (0.0008) [2023-12-28 01:25:00,047][106226] Updated weights for policy 0, policy_version 857668 (0.0007) [2023-12-28 01:25:00,522][106225] Updated weights for policy 1, policy_version 859682 (0.0010) [2023-12-28 01:25:00,584][106225] Updated weights for policy 1, policy_version 859692 (0.0010) [2023-12-28 01:25:00,646][106225] Updated weights for policy 1, policy_version 859702 (0.0005) [2023-12-28 01:25:00,694][106226] Updated weights for policy 0, policy_version 857678 (0.0007) [2023-12-28 01:25:00,703][106225] Updated weights for policy 1, policy_version 859712 (0.0005) [2023-12-28 01:25:00,747][106226] Updated weights for policy 0, policy_version 857688 (0.0008) [2023-12-28 01:25:00,795][106226] Updated weights for policy 0, policy_version 857698 (0.0008) [2023-12-28 01:25:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 439754752. Throughput: 0: 9677.6, 1: 9943.2. Samples: 439743604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:25:01,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-5.200')] [2023-12-28 01:25:01,328][106225] Updated weights for policy 1, policy_version 859722 (0.0007) [2023-12-28 01:25:01,399][106225] Updated weights for policy 1, policy_version 859732 (0.0008) [2023-12-28 01:25:01,451][106225] Updated weights for policy 1, policy_version 859742 (0.0009) [2023-12-28 01:25:01,594][106226] Updated weights for policy 0, policy_version 857708 (0.0008) [2023-12-28 01:25:01,667][106226] Updated weights for policy 0, policy_version 857718 (0.0009) [2023-12-28 01:25:01,723][106226] Updated weights for policy 0, policy_version 857728 (0.0008) [2023-12-28 01:25:02,222][106225] Updated weights for policy 1, policy_version 859752 (0.0007) [2023-12-28 01:25:02,288][106225] Updated weights for policy 1, policy_version 859762 (0.0008) [2023-12-28 01:25:02,354][106225] Updated weights for policy 1, policy_version 859772 (0.0008) [2023-12-28 01:25:02,390][106226] Updated weights for policy 0, policy_version 857738 (0.0007) [2023-12-28 01:25:02,437][106226] Updated weights for policy 0, policy_version 857748 (0.0008) [2023-12-28 01:25:02,491][106226] Updated weights for policy 0, policy_version 857758 (0.0008) [2023-12-28 01:25:02,545][106226] Updated weights for policy 0, policy_version 857768 (0.0008) [2023-12-28 01:25:02,994][106225] Updated weights for policy 1, policy_version 859782 (0.0006) [2023-12-28 01:25:03,049][106225] Updated weights for policy 1, policy_version 859792 (0.0005) [2023-12-28 01:25:03,098][106225] Updated weights for policy 1, policy_version 859802 (0.0005) [2023-12-28 01:25:03,288][106226] Updated weights for policy 0, policy_version 857778 (0.0010) [2023-12-28 01:25:03,333][106226] Updated weights for policy 0, policy_version 857788 (0.0010) [2023-12-28 01:25:03,382][106226] Updated weights for policy 0, policy_version 857798 (0.0006) [2023-12-28 01:25:03,596][106225] Updated weights for policy 1, policy_version 859812 (0.0006) [2023-12-28 01:25:03,649][106225] Updated weights for policy 1, policy_version 859822 (0.0009) [2023-12-28 01:25:03,706][106225] Updated weights for policy 1, policy_version 859832 (0.0009) [2023-12-28 01:25:04,002][106226] Updated weights for policy 0, policy_version 857808 (0.0007) [2023-12-28 01:25:04,075][106226] Updated weights for policy 0, policy_version 857818 (0.0007) [2023-12-28 01:25:04,140][106226] Updated weights for policy 0, policy_version 857828 (0.0011) [2023-12-28 01:25:04,428][106225] Updated weights for policy 1, policy_version 859842 (0.0009) [2023-12-28 01:25:04,484][106225] Updated weights for policy 1, policy_version 859852 (0.0008) [2023-12-28 01:25:04,540][106225] Updated weights for policy 1, policy_version 859862 (0.0007) [2023-12-28 01:25:04,595][106225] Updated weights for policy 1, policy_version 859872 (0.0008) [2023-12-28 01:25:04,821][106226] Updated weights for policy 0, policy_version 857838 (0.0010) [2023-12-28 01:25:04,897][106226] Updated weights for policy 0, policy_version 857848 (0.0011) [2023-12-28 01:25:04,953][106226] Updated weights for policy 0, policy_version 857858 (0.0010) [2023-12-28 01:25:05,185][106225] Updated weights for policy 1, policy_version 859882 (0.0007) [2023-12-28 01:25:05,239][106225] Updated weights for policy 1, policy_version 859892 (0.0005) [2023-12-28 01:25:05,286][106225] Updated weights for policy 1, policy_version 859902 (0.0005) [2023-12-28 01:25:05,646][106226] Updated weights for policy 0, policy_version 857868 (0.0010) [2023-12-28 01:25:05,702][106226] Updated weights for policy 0, policy_version 857878 (0.0010) [2023-12-28 01:25:05,765][106226] Updated weights for policy 0, policy_version 857888 (0.0010) [2023-12-28 01:25:05,928][106225] Updated weights for policy 1, policy_version 859912 (0.0006) [2023-12-28 01:25:05,983][106225] Updated weights for policy 1, policy_version 859922 (0.0010) [2023-12-28 01:25:06,033][106225] Updated weights for policy 1, policy_version 859932 (0.0010) [2023-12-28 01:25:06,175][105115] Fps is (10 sec: 20479.1, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 439861248. Throughput: 0: 9644.6, 1: 10050.8. Samples: 439866376. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:06,176][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.792')] [2023-12-28 01:25:06,493][106226] Updated weights for policy 0, policy_version 857898 (0.0011) [2023-12-28 01:25:06,555][106226] Updated weights for policy 0, policy_version 857908 (0.0010) [2023-12-28 01:25:06,621][106226] Updated weights for policy 0, policy_version 857918 (0.0011) [2023-12-28 01:25:06,684][106226] Updated weights for policy 0, policy_version 857928 (0.0011) [2023-12-28 01:25:06,752][106225] Updated weights for policy 1, policy_version 859942 (0.0010) [2023-12-28 01:25:06,812][106225] Updated weights for policy 1, policy_version 859952 (0.0010) [2023-12-28 01:25:06,866][106225] Updated weights for policy 1, policy_version 859962 (0.0010) [2023-12-28 01:25:07,449][106226] Updated weights for policy 0, policy_version 857938 (0.0009) [2023-12-28 01:25:07,506][106226] Updated weights for policy 0, policy_version 857948 (0.0006) [2023-12-28 01:25:07,573][106226] Updated weights for policy 0, policy_version 857958 (0.0006) [2023-12-28 01:25:07,623][106225] Updated weights for policy 1, policy_version 859972 (0.0009) [2023-12-28 01:25:07,685][106225] Updated weights for policy 1, policy_version 859982 (0.0009) [2023-12-28 01:25:07,755][106225] Updated weights for policy 1, policy_version 859992 (0.0006) [2023-12-28 01:25:08,224][106226] Updated weights for policy 0, policy_version 857968 (0.0007) [2023-12-28 01:25:08,291][106226] Updated weights for policy 0, policy_version 857978 (0.0006) [2023-12-28 01:25:08,353][106226] Updated weights for policy 0, policy_version 857988 (0.0008) [2023-12-28 01:25:08,463][106225] Updated weights for policy 1, policy_version 860002 (0.0009) [2023-12-28 01:25:08,514][106225] Updated weights for policy 1, policy_version 860012 (0.0010) [2023-12-28 01:25:08,579][106225] Updated weights for policy 1, policy_version 860022 (0.0010) [2023-12-28 01:25:08,646][106225] Updated weights for policy 1, policy_version 860032 (0.0011) [2023-12-28 01:25:08,984][106226] Updated weights for policy 0, policy_version 857998 (0.0008) [2023-12-28 01:25:09,035][106226] Updated weights for policy 0, policy_version 858008 (0.0008) [2023-12-28 01:25:09,086][106226] Updated weights for policy 0, policy_version 858018 (0.0007) [2023-12-28 01:25:09,365][106225] Updated weights for policy 1, policy_version 860042 (0.0009) [2023-12-28 01:25:09,436][106225] Updated weights for policy 1, policy_version 860052 (0.0008) [2023-12-28 01:25:09,501][106225] Updated weights for policy 1, policy_version 860062 (0.0008) [2023-12-28 01:25:09,871][106226] Updated weights for policy 0, policy_version 858028 (0.0008) [2023-12-28 01:25:09,938][106226] Updated weights for policy 0, policy_version 858038 (0.0009) [2023-12-28 01:25:10,002][106226] Updated weights for policy 0, policy_version 858048 (0.0011) [2023-12-28 01:25:10,313][106225] Updated weights for policy 1, policy_version 860072 (0.0009) [2023-12-28 01:25:10,376][106225] Updated weights for policy 1, policy_version 860082 (0.0008) [2023-12-28 01:25:10,431][106225] Updated weights for policy 1, policy_version 860092 (0.0009) [2023-12-28 01:25:10,674][106226] Updated weights for policy 0, policy_version 858058 (0.0010) [2023-12-28 01:25:10,737][106226] Updated weights for policy 0, policy_version 858068 (0.0007) [2023-12-28 01:25:10,800][106226] Updated weights for policy 0, policy_version 858078 (0.0008) [2023-12-28 01:25:10,863][106226] Updated weights for policy 0, policy_version 858088 (0.0009) [2023-12-28 01:25:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 439951360. Throughput: 0: 9679.8, 1: 9991.5. Samples: 439924340. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:11,175][105115] Avg episode reward: [(0, '-4.117'), (1, '-5.183')] [2023-12-28 01:25:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000858088_219725824.pth... [2023-12-28 01:25:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000856968_219439104.pth [2023-12-28 01:25:11,214][106225] Updated weights for policy 1, policy_version 860102 (0.0007) [2023-12-28 01:25:11,281][106225] Updated weights for policy 1, policy_version 860112 (0.0009) [2023-12-28 01:25:11,340][106225] Updated weights for policy 1, policy_version 860122 (0.0009) [2023-12-28 01:25:11,377][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000860128_220233728.pth... [2023-12-28 01:25:11,382][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000858944_219930624.pth [2023-12-28 01:25:11,662][106226] Updated weights for policy 0, policy_version 858098 (0.0009) [2023-12-28 01:25:11,731][106226] Updated weights for policy 0, policy_version 858108 (0.0008) [2023-12-28 01:25:11,792][106226] Updated weights for policy 0, policy_version 858118 (0.0008) [2023-12-28 01:25:12,102][106225] Updated weights for policy 1, policy_version 860132 (0.0009) [2023-12-28 01:25:12,168][106225] Updated weights for policy 1, policy_version 860142 (0.0010) [2023-12-28 01:25:12,231][106225] Updated weights for policy 1, policy_version 860152 (0.0008) [2023-12-28 01:25:12,510][106226] Updated weights for policy 0, policy_version 858128 (0.0009) [2023-12-28 01:25:12,576][106226] Updated weights for policy 0, policy_version 858138 (0.0009) [2023-12-28 01:25:12,635][106226] Updated weights for policy 0, policy_version 858148 (0.0009) [2023-12-28 01:25:12,971][106225] Updated weights for policy 1, policy_version 860162 (0.0008) [2023-12-28 01:25:13,042][106225] Updated weights for policy 1, policy_version 860172 (0.0006) [2023-12-28 01:25:13,099][106225] Updated weights for policy 1, policy_version 860182 (0.0009) [2023-12-28 01:25:13,161][106225] Updated weights for policy 1, policy_version 860192 (0.0008) [2023-12-28 01:25:13,368][106226] Updated weights for policy 0, policy_version 858158 (0.0009) [2023-12-28 01:25:13,415][106226] Updated weights for policy 0, policy_version 858168 (0.0008) [2023-12-28 01:25:13,459][106226] Updated weights for policy 0, policy_version 858178 (0.0009) [2023-12-28 01:25:13,791][106225] Updated weights for policy 1, policy_version 860202 (0.0007) [2023-12-28 01:25:13,835][106225] Updated weights for policy 1, policy_version 860212 (0.0005) [2023-12-28 01:25:13,884][106225] Updated weights for policy 1, policy_version 860222 (0.0006) [2023-12-28 01:25:14,204][106226] Updated weights for policy 0, policy_version 858188 (0.0009) [2023-12-28 01:25:14,261][106226] Updated weights for policy 0, policy_version 858198 (0.0009) [2023-12-28 01:25:14,314][106226] Updated weights for policy 0, policy_version 858208 (0.0008) [2023-12-28 01:25:14,463][106225] Updated weights for policy 1, policy_version 860232 (0.0010) [2023-12-28 01:25:14,522][106225] Updated weights for policy 1, policy_version 860242 (0.0010) [2023-12-28 01:25:14,576][106225] Updated weights for policy 1, policy_version 860252 (0.0009) [2023-12-28 01:25:15,076][106226] Updated weights for policy 0, policy_version 858218 (0.0009) [2023-12-28 01:25:15,139][106226] Updated weights for policy 0, policy_version 858228 (0.0011) [2023-12-28 01:25:15,198][106226] Updated weights for policy 0, policy_version 858238 (0.0011) [2023-12-28 01:25:15,263][106226] Updated weights for policy 0, policy_version 858248 (0.0011) [2023-12-28 01:25:15,317][106225] Updated weights for policy 1, policy_version 860262 (0.0008) [2023-12-28 01:25:15,385][106225] Updated weights for policy 1, policy_version 860272 (0.0006) [2023-12-28 01:25:15,454][106225] Updated weights for policy 1, policy_version 860282 (0.0007) [2023-12-28 01:25:15,943][106226] Updated weights for policy 0, policy_version 858258 (0.0010) [2023-12-28 01:25:16,003][106226] Updated weights for policy 0, policy_version 858268 (0.0010) [2023-12-28 01:25:16,067][106226] Updated weights for policy 0, policy_version 858278 (0.0011) [2023-12-28 01:25:16,117][106225] Updated weights for policy 1, policy_version 860292 (0.0010) [2023-12-28 01:25:16,170][106225] Updated weights for policy 1, policy_version 860302 (0.0010) [2023-12-28 01:25:16,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 440049664. Throughput: 0: 9651.0, 1: 9950.9. Samples: 440038860. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:16,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-4.912')] [2023-12-28 01:25:16,229][106225] Updated weights for policy 1, policy_version 860312 (0.0010) [2023-12-28 01:25:16,766][106226] Updated weights for policy 0, policy_version 858288 (0.0008) [2023-12-28 01:25:16,826][106226] Updated weights for policy 0, policy_version 858298 (0.0005) [2023-12-28 01:25:16,890][106226] Updated weights for policy 0, policy_version 858308 (0.0006) [2023-12-28 01:25:16,947][106225] Updated weights for policy 1, policy_version 860322 (0.0010) [2023-12-28 01:25:17,010][106225] Updated weights for policy 1, policy_version 860332 (0.0010) [2023-12-28 01:25:17,067][106225] Updated weights for policy 1, policy_version 860342 (0.0010) [2023-12-28 01:25:17,120][106225] Updated weights for policy 1, policy_version 860352 (0.0010) [2023-12-28 01:25:17,545][106226] Updated weights for policy 0, policy_version 858318 (0.0011) [2023-12-28 01:25:17,591][106226] Updated weights for policy 0, policy_version 858328 (0.0008) [2023-12-28 01:25:17,654][106226] Updated weights for policy 0, policy_version 858338 (0.0006) [2023-12-28 01:25:17,844][106225] Updated weights for policy 1, policy_version 860362 (0.0010) [2023-12-28 01:25:17,894][106225] Updated weights for policy 1, policy_version 860372 (0.0010) [2023-12-28 01:25:17,953][106225] Updated weights for policy 1, policy_version 860382 (0.0010) [2023-12-28 01:25:18,286][106226] Updated weights for policy 0, policy_version 858348 (0.0005) [2023-12-28 01:25:18,356][106226] Updated weights for policy 0, policy_version 858358 (0.0008) [2023-12-28 01:25:18,416][106226] Updated weights for policy 0, policy_version 858368 (0.0006) [2023-12-28 01:25:18,653][106225] Updated weights for policy 1, policy_version 860392 (0.0010) [2023-12-28 01:25:18,708][106225] Updated weights for policy 1, policy_version 860402 (0.0010) [2023-12-28 01:25:18,762][106225] Updated weights for policy 1, policy_version 860412 (0.0010) [2023-12-28 01:25:19,021][106226] Updated weights for policy 0, policy_version 858378 (0.0007) [2023-12-28 01:25:19,068][106226] Updated weights for policy 0, policy_version 858388 (0.0010) [2023-12-28 01:25:19,114][106226] Updated weights for policy 0, policy_version 858398 (0.0010) [2023-12-28 01:25:19,164][106226] Updated weights for policy 0, policy_version 858408 (0.0007) [2023-12-28 01:25:19,585][106225] Updated weights for policy 1, policy_version 860422 (0.0009) [2023-12-28 01:25:19,634][106225] Updated weights for policy 1, policy_version 860432 (0.0008) [2023-12-28 01:25:19,696][106225] Updated weights for policy 1, policy_version 860442 (0.0008) [2023-12-28 01:25:19,919][106226] Updated weights for policy 0, policy_version 858418 (0.0009) [2023-12-28 01:25:19,988][106226] Updated weights for policy 0, policy_version 858428 (0.0006) [2023-12-28 01:25:20,055][106226] Updated weights for policy 0, policy_version 858438 (0.0010) [2023-12-28 01:25:20,467][106225] Updated weights for policy 1, policy_version 860452 (0.0008) [2023-12-28 01:25:20,534][106225] Updated weights for policy 1, policy_version 860462 (0.0008) [2023-12-28 01:25:20,600][106225] Updated weights for policy 1, policy_version 860472 (0.0008) [2023-12-28 01:25:20,760][106226] Updated weights for policy 0, policy_version 858448 (0.0011) [2023-12-28 01:25:20,826][106226] Updated weights for policy 0, policy_version 858458 (0.0011) [2023-12-28 01:25:20,888][106226] Updated weights for policy 0, policy_version 858468 (0.0009) [2023-12-28 01:25:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 440147968. Throughput: 0: 9699.7, 1: 9913.1. Samples: 440157196. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:21,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-5.133')] [2023-12-28 01:25:21,521][106225] Updated weights for policy 1, policy_version 860482 (0.0008) [2023-12-28 01:25:21,554][106226] Updated weights for policy 0, policy_version 858478 (0.0006) [2023-12-28 01:25:21,587][106225] Updated weights for policy 1, policy_version 860492 (0.0009) [2023-12-28 01:25:21,623][106226] Updated weights for policy 0, policy_version 858488 (0.0006) [2023-12-28 01:25:21,665][106225] Updated weights for policy 1, policy_version 860502 (0.0008) [2023-12-28 01:25:21,690][106226] Updated weights for policy 0, policy_version 858498 (0.0010) [2023-12-28 01:25:21,726][106225] Updated weights for policy 1, policy_version 860512 (0.0008) [2023-12-28 01:25:22,406][106226] Updated weights for policy 0, policy_version 858508 (0.0010) [2023-12-28 01:25:22,464][106226] Updated weights for policy 0, policy_version 858518 (0.0011) [2023-12-28 01:25:22,497][106225] Updated weights for policy 1, policy_version 860522 (0.0006) [2023-12-28 01:25:22,522][106226] Updated weights for policy 0, policy_version 858528 (0.0011) [2023-12-28 01:25:22,555][106225] Updated weights for policy 1, policy_version 860532 (0.0006) [2023-12-28 01:25:22,614][106225] Updated weights for policy 1, policy_version 860542 (0.0006) [2023-12-28 01:25:23,296][106226] Updated weights for policy 0, policy_version 858538 (0.0011) [2023-12-28 01:25:23,319][106225] Updated weights for policy 1, policy_version 860552 (0.0007) [2023-12-28 01:25:23,356][106226] Updated weights for policy 0, policy_version 858548 (0.0011) [2023-12-28 01:25:23,370][106225] Updated weights for policy 1, policy_version 860562 (0.0006) [2023-12-28 01:25:23,417][106226] Updated weights for policy 0, policy_version 858558 (0.0011) [2023-12-28 01:25:23,425][106225] Updated weights for policy 1, policy_version 860572 (0.0005) [2023-12-28 01:25:23,479][106226] Updated weights for policy 0, policy_version 858568 (0.0011) [2023-12-28 01:25:24,177][106225] Updated weights for policy 1, policy_version 860582 (0.0006) [2023-12-28 01:25:24,187][106226] Updated weights for policy 0, policy_version 858578 (0.0011) [2023-12-28 01:25:24,231][106225] Updated weights for policy 1, policy_version 860592 (0.0006) [2023-12-28 01:25:24,240][106226] Updated weights for policy 0, policy_version 858588 (0.0010) [2023-12-28 01:25:24,282][106225] Updated weights for policy 1, policy_version 860602 (0.0005) [2023-12-28 01:25:24,287][106226] Updated weights for policy 0, policy_version 858598 (0.0010) [2023-12-28 01:25:25,003][106225] Updated weights for policy 1, policy_version 860612 (0.0007) [2023-12-28 01:25:25,020][106226] Updated weights for policy 0, policy_version 858608 (0.0011) [2023-12-28 01:25:25,060][106225] Updated weights for policy 1, policy_version 860622 (0.0006) [2023-12-28 01:25:25,072][106226] Updated weights for policy 0, policy_version 858618 (0.0010) [2023-12-28 01:25:25,114][106225] Updated weights for policy 1, policy_version 860632 (0.0005) [2023-12-28 01:25:25,127][106226] Updated weights for policy 0, policy_version 858628 (0.0010) [2023-12-28 01:25:25,828][106226] Updated weights for policy 0, policy_version 858638 (0.0011) [2023-12-28 01:25:25,849][106225] Updated weights for policy 1, policy_version 860642 (0.0006) [2023-12-28 01:25:25,888][106226] Updated weights for policy 0, policy_version 858648 (0.0010) [2023-12-28 01:25:25,904][106225] Updated weights for policy 1, policy_version 860652 (0.0008) [2023-12-28 01:25:25,937][106226] Updated weights for policy 0, policy_version 858658 (0.0010) [2023-12-28 01:25:25,959][106225] Updated weights for policy 1, policy_version 860662 (0.0005) [2023-12-28 01:25:26,015][106225] Updated weights for policy 1, policy_version 860672 (0.0007) [2023-12-28 01:25:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 440246272. Throughput: 0: 9699.7, 1: 9886.8. Samples: 440212764. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:26,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-5.102')] [2023-12-28 01:25:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000860672_220372992.pth... [2023-12-28 01:25:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000858664_219873280.pth... [2023-12-28 01:25:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000857512_219578368.pth [2023-12-28 01:25:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000859520_220078080.pth [2023-12-28 01:25:26,615][106226] Updated weights for policy 0, policy_version 858668 (0.0008) [2023-12-28 01:25:26,660][106226] Updated weights for policy 0, policy_version 858678 (0.0005) [2023-12-28 01:25:26,708][106226] Updated weights for policy 0, policy_version 858688 (0.0005) [2023-12-28 01:25:26,719][106225] Updated weights for policy 1, policy_version 860682 (0.0005) [2023-12-28 01:25:26,763][106225] Updated weights for policy 1, policy_version 860692 (0.0005) [2023-12-28 01:25:26,818][106225] Updated weights for policy 1, policy_version 860702 (0.0006) [2023-12-28 01:25:27,280][106226] Updated weights for policy 0, policy_version 858698 (0.0006) [2023-12-28 01:25:27,342][106226] Updated weights for policy 0, policy_version 858708 (0.0007) [2023-12-28 01:25:27,407][106226] Updated weights for policy 0, policy_version 858718 (0.0010) [2023-12-28 01:25:27,467][106226] Updated weights for policy 0, policy_version 858728 (0.0010) [2023-12-28 01:25:27,510][106225] Updated weights for policy 1, policy_version 860712 (0.0010) [2023-12-28 01:25:27,569][106225] Updated weights for policy 1, policy_version 860722 (0.0010) [2023-12-28 01:25:27,623][106225] Updated weights for policy 1, policy_version 860732 (0.0007) [2023-12-28 01:25:28,084][106226] Updated weights for policy 0, policy_version 858738 (0.0006) [2023-12-28 01:25:28,136][106226] Updated weights for policy 0, policy_version 858748 (0.0011) [2023-12-28 01:25:28,167][106225] Updated weights for policy 1, policy_version 860742 (0.0005) [2023-12-28 01:25:28,191][106226] Updated weights for policy 0, policy_version 858758 (0.0005) [2023-12-28 01:25:28,229][106225] Updated weights for policy 1, policy_version 860752 (0.0008) [2023-12-28 01:25:28,287][106225] Updated weights for policy 1, policy_version 860762 (0.0009) [2023-12-28 01:25:28,801][106226] Updated weights for policy 0, policy_version 858768 (0.0007) [2023-12-28 01:25:28,858][106226] Updated weights for policy 0, policy_version 858778 (0.0008) [2023-12-28 01:25:28,904][106225] Updated weights for policy 1, policy_version 860772 (0.0010) [2023-12-28 01:25:28,921][106226] Updated weights for policy 0, policy_version 858788 (0.0006) [2023-12-28 01:25:28,965][106225] Updated weights for policy 1, policy_version 860782 (0.0010) [2023-12-28 01:25:29,017][106225] Updated weights for policy 1, policy_version 860792 (0.0010) [2023-12-28 01:25:29,537][106226] Updated weights for policy 0, policy_version 858798 (0.0007) [2023-12-28 01:25:29,603][106226] Updated weights for policy 0, policy_version 858808 (0.0009) [2023-12-28 01:25:29,665][106226] Updated weights for policy 0, policy_version 858818 (0.0008) [2023-12-28 01:25:29,748][106225] Updated weights for policy 1, policy_version 860802 (0.0010) [2023-12-28 01:25:29,809][106225] Updated weights for policy 1, policy_version 860812 (0.0009) [2023-12-28 01:25:29,875][106225] Updated weights for policy 1, policy_version 860822 (0.0008) [2023-12-28 01:25:29,948][106225] Updated weights for policy 1, policy_version 860832 (0.0008) [2023-12-28 01:25:30,377][106226] Updated weights for policy 0, policy_version 858828 (0.0007) [2023-12-28 01:25:30,430][106226] Updated weights for policy 0, policy_version 858838 (0.0007) [2023-12-28 01:25:30,479][106226] Updated weights for policy 0, policy_version 858848 (0.0008) [2023-12-28 01:25:30,627][106225] Updated weights for policy 1, policy_version 860842 (0.0009) [2023-12-28 01:25:30,675][106225] Updated weights for policy 1, policy_version 860852 (0.0009) [2023-12-28 01:25:30,727][106225] Updated weights for policy 1, policy_version 860862 (0.0008) [2023-12-28 01:25:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 440344576. Throughput: 0: 9836.5, 1: 9968.5. Samples: 440337124. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:31,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.718')] [2023-12-28 01:25:31,189][106226] Updated weights for policy 0, policy_version 858858 (0.0007) [2023-12-28 01:25:31,248][106226] Updated weights for policy 0, policy_version 858868 (0.0008) [2023-12-28 01:25:31,307][106226] Updated weights for policy 0, policy_version 858878 (0.0008) [2023-12-28 01:25:31,381][106226] Updated weights for policy 0, policy_version 858888 (0.0008) [2023-12-28 01:25:31,462][106225] Updated weights for policy 1, policy_version 860872 (0.0007) [2023-12-28 01:25:31,517][106225] Updated weights for policy 1, policy_version 860882 (0.0005) [2023-12-28 01:25:31,579][106225] Updated weights for policy 1, policy_version 860892 (0.0005) [2023-12-28 01:25:32,155][106226] Updated weights for policy 0, policy_version 858898 (0.0011) [2023-12-28 01:25:32,217][106226] Updated weights for policy 0, policy_version 858908 (0.0011) [2023-12-28 01:25:32,277][106226] Updated weights for policy 0, policy_version 858918 (0.0010) [2023-12-28 01:25:32,283][106225] Updated weights for policy 1, policy_version 860902 (0.0006) [2023-12-28 01:25:32,333][106225] Updated weights for policy 1, policy_version 860912 (0.0007) [2023-12-28 01:25:32,404][106225] Updated weights for policy 1, policy_version 860922 (0.0007) [2023-12-28 01:25:32,947][106226] Updated weights for policy 0, policy_version 858928 (0.0006) [2023-12-28 01:25:33,006][106226] Updated weights for policy 0, policy_version 858938 (0.0008) [2023-12-28 01:25:33,068][106226] Updated weights for policy 0, policy_version 858948 (0.0009) [2023-12-28 01:25:33,142][106225] Updated weights for policy 1, policy_version 860932 (0.0007) [2023-12-28 01:25:33,186][106225] Updated weights for policy 1, policy_version 860942 (0.0008) [2023-12-28 01:25:33,238][106225] Updated weights for policy 1, policy_version 860952 (0.0009) [2023-12-28 01:25:33,668][106226] Updated weights for policy 0, policy_version 858958 (0.0009) [2023-12-28 01:25:33,712][106226] Updated weights for policy 0, policy_version 858968 (0.0008) [2023-12-28 01:25:33,761][106226] Updated weights for policy 0, policy_version 858978 (0.0009) [2023-12-28 01:25:34,009][106225] Updated weights for policy 1, policy_version 860962 (0.0009) [2023-12-28 01:25:34,075][106225] Updated weights for policy 1, policy_version 860972 (0.0009) [2023-12-28 01:25:34,156][106225] Updated weights for policy 1, policy_version 860982 (0.0006) [2023-12-28 01:25:34,221][106225] Updated weights for policy 1, policy_version 860992 (0.0008) [2023-12-28 01:25:34,476][106226] Updated weights for policy 0, policy_version 858988 (0.0008) [2023-12-28 01:25:34,525][106226] Updated weights for policy 0, policy_version 858998 (0.0009) [2023-12-28 01:25:34,574][106226] Updated weights for policy 0, policy_version 859008 (0.0008) [2023-12-28 01:25:34,900][106225] Updated weights for policy 1, policy_version 861002 (0.0005) [2023-12-28 01:25:34,947][106225] Updated weights for policy 1, policy_version 861012 (0.0005) [2023-12-28 01:25:34,995][106225] Updated weights for policy 1, policy_version 861022 (0.0005) [2023-12-28 01:25:35,271][106226] Updated weights for policy 0, policy_version 859018 (0.0008) [2023-12-28 01:25:35,324][106226] Updated weights for policy 0, policy_version 859028 (0.0010) [2023-12-28 01:25:35,380][106226] Updated weights for policy 0, policy_version 859038 (0.0010) [2023-12-28 01:25:35,439][106226] Updated weights for policy 0, policy_version 859048 (0.0010) [2023-12-28 01:25:35,632][106225] Updated weights for policy 1, policy_version 861032 (0.0005) [2023-12-28 01:25:35,690][106225] Updated weights for policy 1, policy_version 861042 (0.0005) [2023-12-28 01:25:35,741][106225] Updated weights for policy 1, policy_version 861052 (0.0005) [2023-12-28 01:25:36,121][106226] Updated weights for policy 0, policy_version 859058 (0.0010) [2023-12-28 01:25:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 440442880. Throughput: 0: 9982.0, 1: 9861.7. Samples: 440457160. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:36,175][105115] Avg episode reward: [(0, '-4.100'), (1, '-5.152')] [2023-12-28 01:25:36,184][106226] Updated weights for policy 0, policy_version 859068 (0.0011) [2023-12-28 01:25:36,256][106226] Updated weights for policy 0, policy_version 859078 (0.0011) [2023-12-28 01:25:36,347][106225] Updated weights for policy 1, policy_version 861062 (0.0006) [2023-12-28 01:25:36,418][106225] Updated weights for policy 1, policy_version 861072 (0.0009) [2023-12-28 01:25:36,489][106225] Updated weights for policy 1, policy_version 861082 (0.0007) [2023-12-28 01:25:36,933][106226] Updated weights for policy 0, policy_version 859088 (0.0007) [2023-12-28 01:25:37,002][106226] Updated weights for policy 0, policy_version 859098 (0.0005) [2023-12-28 01:25:37,063][106226] Updated weights for policy 0, policy_version 859108 (0.0008) [2023-12-28 01:25:37,159][106225] Updated weights for policy 1, policy_version 861092 (0.0006) [2023-12-28 01:25:37,214][106225] Updated weights for policy 1, policy_version 861102 (0.0006) [2023-12-28 01:25:37,271][106225] Updated weights for policy 1, policy_version 861112 (0.0006) [2023-12-28 01:25:37,628][106226] Updated weights for policy 0, policy_version 859118 (0.0005) [2023-12-28 01:25:37,683][106226] Updated weights for policy 0, policy_version 859128 (0.0006) [2023-12-28 01:25:37,745][106226] Updated weights for policy 0, policy_version 859138 (0.0008) [2023-12-28 01:25:37,826][106225] Updated weights for policy 1, policy_version 861122 (0.0005) [2023-12-28 01:25:37,887][106225] Updated weights for policy 1, policy_version 861132 (0.0005) [2023-12-28 01:25:37,945][106225] Updated weights for policy 1, policy_version 861142 (0.0005) [2023-12-28 01:25:38,012][106225] Updated weights for policy 1, policy_version 861152 (0.0006) [2023-12-28 01:25:38,487][106226] Updated weights for policy 0, policy_version 859148 (0.0007) [2023-12-28 01:25:38,542][106226] Updated weights for policy 0, policy_version 859158 (0.0008) [2023-12-28 01:25:38,610][106226] Updated weights for policy 0, policy_version 859168 (0.0008) [2023-12-28 01:25:38,629][106225] Updated weights for policy 1, policy_version 861162 (0.0006) [2023-12-28 01:25:38,691][106225] Updated weights for policy 1, policy_version 861172 (0.0008) [2023-12-28 01:25:38,755][106225] Updated weights for policy 1, policy_version 861182 (0.0009) [2023-12-28 01:25:39,314][106226] Updated weights for policy 0, policy_version 859178 (0.0007) [2023-12-28 01:25:39,390][106226] Updated weights for policy 0, policy_version 859188 (0.0008) [2023-12-28 01:25:39,460][106226] Updated weights for policy 0, policy_version 859198 (0.0008) [2023-12-28 01:25:39,520][106226] Updated weights for policy 0, policy_version 859208 (0.0008) [2023-12-28 01:25:39,534][106225] Updated weights for policy 1, policy_version 861192 (0.0008) [2023-12-28 01:25:39,592][106225] Updated weights for policy 1, policy_version 861202 (0.0008) [2023-12-28 01:25:39,659][106225] Updated weights for policy 1, policy_version 861212 (0.0010) [2023-12-28 01:25:40,256][106226] Updated weights for policy 0, policy_version 859218 (0.0008) [2023-12-28 01:25:40,323][106226] Updated weights for policy 0, policy_version 859228 (0.0008) [2023-12-28 01:25:40,389][106226] Updated weights for policy 0, policy_version 859238 (0.0008) [2023-12-28 01:25:40,398][106225] Updated weights for policy 1, policy_version 861222 (0.0011) [2023-12-28 01:25:40,462][106225] Updated weights for policy 1, policy_version 861232 (0.0010) [2023-12-28 01:25:40,529][106225] Updated weights for policy 1, policy_version 861242 (0.0011) [2023-12-28 01:25:41,113][106226] Updated weights for policy 0, policy_version 859248 (0.0007) [2023-12-28 01:25:41,157][106225] Updated weights for policy 1, policy_version 861252 (0.0007) [2023-12-28 01:25:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 440541184. Throughput: 0: 10006.1, 1: 9919.9. Samples: 440519308. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:41,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-5.033')] [2023-12-28 01:25:41,195][106226] Updated weights for policy 0, policy_version 859258 (0.0009) [2023-12-28 01:25:41,223][106225] Updated weights for policy 1, policy_version 861262 (0.0008) [2023-12-28 01:25:41,263][106226] Updated weights for policy 0, policy_version 859268 (0.0007) [2023-12-28 01:25:41,287][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000859272_220028928.pth... [2023-12-28 01:25:41,290][106225] Updated weights for policy 1, policy_version 861272 (0.0008) [2023-12-28 01:25:41,291][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000858088_219725824.pth [2023-12-28 01:25:41,335][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000861280_220528640.pth... [2023-12-28 01:25:41,338][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000860128_220233728.pth [2023-12-28 01:25:41,975][106226] Updated weights for policy 0, policy_version 859278 (0.0009) [2023-12-28 01:25:42,038][106226] Updated weights for policy 0, policy_version 859288 (0.0008) [2023-12-28 01:25:42,101][106226] Updated weights for policy 0, policy_version 859298 (0.0008) [2023-12-28 01:25:42,113][106225] Updated weights for policy 1, policy_version 861282 (0.0008) [2023-12-28 01:25:42,165][106225] Updated weights for policy 1, policy_version 861292 (0.0006) [2023-12-28 01:25:42,217][106225] Updated weights for policy 1, policy_version 861302 (0.0005) [2023-12-28 01:25:42,284][106225] Updated weights for policy 1, policy_version 861312 (0.0008) [2023-12-28 01:25:42,771][106226] Updated weights for policy 0, policy_version 859308 (0.0008) [2023-12-28 01:25:42,827][106226] Updated weights for policy 0, policy_version 859318 (0.0008) [2023-12-28 01:25:42,886][106226] Updated weights for policy 0, policy_version 859328 (0.0008) [2023-12-28 01:25:43,022][106225] Updated weights for policy 1, policy_version 861322 (0.0006) [2023-12-28 01:25:43,077][106225] Updated weights for policy 1, policy_version 861332 (0.0005) [2023-12-28 01:25:43,131][106225] Updated weights for policy 1, policy_version 861342 (0.0005) [2023-12-28 01:25:43,572][106226] Updated weights for policy 0, policy_version 859338 (0.0009) [2023-12-28 01:25:43,631][106226] Updated weights for policy 0, policy_version 859348 (0.0010) [2023-12-28 01:25:43,690][106226] Updated weights for policy 0, policy_version 859358 (0.0010) [2023-12-28 01:25:43,749][106226] Updated weights for policy 0, policy_version 859368 (0.0010) [2023-12-28 01:25:43,775][106225] Updated weights for policy 1, policy_version 861352 (0.0006) [2023-12-28 01:25:43,839][106225] Updated weights for policy 1, policy_version 861362 (0.0005) [2023-12-28 01:25:43,905][106225] Updated weights for policy 1, policy_version 861372 (0.0005) [2023-12-28 01:25:44,383][106226] Updated weights for policy 0, policy_version 859378 (0.0010) [2023-12-28 01:25:44,443][106226] Updated weights for policy 0, policy_version 859388 (0.0007) [2023-12-28 01:25:44,508][106226] Updated weights for policy 0, policy_version 859398 (0.0006) [2023-12-28 01:25:44,536][106225] Updated weights for policy 1, policy_version 861382 (0.0006) [2023-12-28 01:25:44,585][106225] Updated weights for policy 1, policy_version 861392 (0.0008) [2023-12-28 01:25:44,645][106225] Updated weights for policy 1, policy_version 861402 (0.0009) [2023-12-28 01:25:45,134][106226] Updated weights for policy 0, policy_version 859408 (0.0008) [2023-12-28 01:25:45,197][106226] Updated weights for policy 0, policy_version 859418 (0.0009) [2023-12-28 01:25:45,256][106226] Updated weights for policy 0, policy_version 859428 (0.0010) [2023-12-28 01:25:45,427][106225] Updated weights for policy 1, policy_version 861412 (0.0007) [2023-12-28 01:25:45,483][106225] Updated weights for policy 1, policy_version 861422 (0.0008) [2023-12-28 01:25:45,534][106225] Updated weights for policy 1, policy_version 861432 (0.0006) [2023-12-28 01:25:45,972][106226] Updated weights for policy 0, policy_version 859438 (0.0011) [2023-12-28 01:25:46,035][106226] Updated weights for policy 0, policy_version 859448 (0.0010) [2023-12-28 01:25:46,091][106226] Updated weights for policy 0, policy_version 859458 (0.0010) [2023-12-28 01:25:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 440647680. Throughput: 0: 9965.6, 1: 9868.6. Samples: 440636144. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:46,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.459')] [2023-12-28 01:25:46,260][106225] Updated weights for policy 1, policy_version 861442 (0.0007) [2023-12-28 01:25:46,313][106225] Updated weights for policy 1, policy_version 861452 (0.0007) [2023-12-28 01:25:46,360][106225] Updated weights for policy 1, policy_version 861462 (0.0008) [2023-12-28 01:25:46,410][106225] Updated weights for policy 1, policy_version 861472 (0.0008) [2023-12-28 01:25:46,804][106226] Updated weights for policy 0, policy_version 859468 (0.0010) [2023-12-28 01:25:46,861][106226] Updated weights for policy 0, policy_version 859478 (0.0010) [2023-12-28 01:25:46,919][106226] Updated weights for policy 0, policy_version 859488 (0.0010) [2023-12-28 01:25:47,056][106225] Updated weights for policy 1, policy_version 861482 (0.0008) [2023-12-28 01:25:47,102][106225] Updated weights for policy 1, policy_version 861492 (0.0010) [2023-12-28 01:25:47,153][106225] Updated weights for policy 1, policy_version 861502 (0.0010) [2023-12-28 01:25:47,546][106226] Updated weights for policy 0, policy_version 859498 (0.0010) [2023-12-28 01:25:47,603][106226] Updated weights for policy 0, policy_version 859508 (0.0010) [2023-12-28 01:25:47,652][106226] Updated weights for policy 0, policy_version 859518 (0.0010) [2023-12-28 01:25:47,702][106226] Updated weights for policy 0, policy_version 859528 (0.0010) [2023-12-28 01:25:47,830][106225] Updated weights for policy 1, policy_version 861512 (0.0006) [2023-12-28 01:25:47,891][106225] Updated weights for policy 1, policy_version 861522 (0.0005) [2023-12-28 01:25:47,948][106225] Updated weights for policy 1, policy_version 861532 (0.0009) [2023-12-28 01:25:48,372][106226] Updated weights for policy 0, policy_version 859538 (0.0008) [2023-12-28 01:25:48,428][106226] Updated weights for policy 0, policy_version 859548 (0.0008) [2023-12-28 01:25:48,482][106226] Updated weights for policy 0, policy_version 859558 (0.0008) [2023-12-28 01:25:48,643][106225] Updated weights for policy 1, policy_version 861542 (0.0010) [2023-12-28 01:25:48,700][106225] Updated weights for policy 1, policy_version 861552 (0.0010) [2023-12-28 01:25:48,755][106225] Updated weights for policy 1, policy_version 861562 (0.0010) [2023-12-28 01:25:49,047][106226] Updated weights for policy 0, policy_version 859568 (0.0008) [2023-12-28 01:25:49,097][106226] Updated weights for policy 0, policy_version 859578 (0.0008) [2023-12-28 01:25:49,155][106226] Updated weights for policy 0, policy_version 859588 (0.0007) [2023-12-28 01:25:49,540][106225] Updated weights for policy 1, policy_version 861572 (0.0010) [2023-12-28 01:25:49,591][106225] Updated weights for policy 1, policy_version 861582 (0.0010) [2023-12-28 01:25:49,645][106225] Updated weights for policy 1, policy_version 861592 (0.0010) [2023-12-28 01:25:49,941][106226] Updated weights for policy 0, policy_version 859598 (0.0007) [2023-12-28 01:25:50,011][106226] Updated weights for policy 0, policy_version 859608 (0.0007) [2023-12-28 01:25:50,071][106226] Updated weights for policy 0, policy_version 859618 (0.0005) [2023-12-28 01:25:50,412][106225] Updated weights for policy 1, policy_version 861602 (0.0010) [2023-12-28 01:25:50,465][106225] Updated weights for policy 1, policy_version 861612 (0.0010) [2023-12-28 01:25:50,515][106225] Updated weights for policy 1, policy_version 861622 (0.0010) [2023-12-28 01:25:50,571][106225] Updated weights for policy 1, policy_version 861632 (0.0010) [2023-12-28 01:25:50,722][106226] Updated weights for policy 0, policy_version 859628 (0.0006) [2023-12-28 01:25:50,788][106226] Updated weights for policy 0, policy_version 859638 (0.0006) [2023-12-28 01:25:50,857][106226] Updated weights for policy 0, policy_version 859648 (0.0006) [2023-12-28 01:25:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 440745984. Throughput: 0: 10012.6, 1: 9773.6. Samples: 440756748. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:51,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-4.940')] [2023-12-28 01:25:51,403][106225] Updated weights for policy 1, policy_version 861642 (0.0009) [2023-12-28 01:25:51,467][106225] Updated weights for policy 1, policy_version 861652 (0.0006) [2023-12-28 01:25:51,470][106226] Updated weights for policy 0, policy_version 859658 (0.0007) [2023-12-28 01:25:51,523][106225] Updated weights for policy 1, policy_version 861662 (0.0005) [2023-12-28 01:25:51,538][106226] Updated weights for policy 0, policy_version 859668 (0.0011) [2023-12-28 01:25:51,602][106226] Updated weights for policy 0, policy_version 859678 (0.0011) [2023-12-28 01:25:51,672][106226] Updated weights for policy 0, policy_version 859688 (0.0011) [2023-12-28 01:25:52,181][106225] Updated weights for policy 1, policy_version 861672 (0.0007) [2023-12-28 01:25:52,233][106225] Updated weights for policy 1, policy_version 861682 (0.0006) [2023-12-28 01:25:52,294][106225] Updated weights for policy 1, policy_version 861692 (0.0006) [2023-12-28 01:25:52,408][106226] Updated weights for policy 0, policy_version 859698 (0.0009) [2023-12-28 01:25:52,463][106226] Updated weights for policy 0, policy_version 859708 (0.0005) [2023-12-28 01:25:52,514][106226] Updated weights for policy 0, policy_version 859718 (0.0005) [2023-12-28 01:25:53,039][106225] Updated weights for policy 1, policy_version 861702 (0.0009) [2023-12-28 01:25:53,097][106225] Updated weights for policy 1, policy_version 861712 (0.0010) [2023-12-28 01:25:53,157][106225] Updated weights for policy 1, policy_version 861722 (0.0008) [2023-12-28 01:25:53,161][106226] Updated weights for policy 0, policy_version 859728 (0.0007) [2023-12-28 01:25:53,220][106226] Updated weights for policy 0, policy_version 859738 (0.0006) [2023-12-28 01:25:53,280][106226] Updated weights for policy 0, policy_version 859748 (0.0008) [2023-12-28 01:25:53,883][106226] Updated weights for policy 0, policy_version 859758 (0.0008) [2023-12-28 01:25:53,936][106225] Updated weights for policy 1, policy_version 861732 (0.0006) [2023-12-28 01:25:53,946][106226] Updated weights for policy 0, policy_version 859768 (0.0008) [2023-12-28 01:25:53,997][106225] Updated weights for policy 1, policy_version 861742 (0.0008) [2023-12-28 01:25:54,002][106226] Updated weights for policy 0, policy_version 859778 (0.0005) [2023-12-28 01:25:54,065][106225] Updated weights for policy 1, policy_version 861752 (0.0008) [2023-12-28 01:25:54,692][106226] Updated weights for policy 0, policy_version 859788 (0.0007) [2023-12-28 01:25:54,752][106226] Updated weights for policy 0, policy_version 859798 (0.0011) [2023-12-28 01:25:54,776][106225] Updated weights for policy 1, policy_version 861762 (0.0009) [2023-12-28 01:25:54,801][106226] Updated weights for policy 0, policy_version 859808 (0.0009) [2023-12-28 01:25:54,832][106225] Updated weights for policy 1, policy_version 861772 (0.0007) [2023-12-28 01:25:54,889][106225] Updated weights for policy 1, policy_version 861782 (0.0007) [2023-12-28 01:25:54,946][106225] Updated weights for policy 1, policy_version 861792 (0.0008) [2023-12-28 01:25:55,518][106226] Updated weights for policy 0, policy_version 859818 (0.0009) [2023-12-28 01:25:55,570][106226] Updated weights for policy 0, policy_version 859828 (0.0008) [2023-12-28 01:25:55,617][106225] Updated weights for policy 1, policy_version 861802 (0.0008) [2023-12-28 01:25:55,619][106226] Updated weights for policy 0, policy_version 859838 (0.0005) [2023-12-28 01:25:55,666][106225] Updated weights for policy 1, policy_version 861812 (0.0007) [2023-12-28 01:25:55,670][106226] Updated weights for policy 0, policy_version 859848 (0.0005) [2023-12-28 01:25:55,718][106225] Updated weights for policy 1, policy_version 861822 (0.0008) [2023-12-28 01:25:56,175][105115] Fps is (10 sec: 19659.9, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 440844288. Throughput: 0: 10033.2, 1: 9763.4. Samples: 440815192. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:25:56,176][105115] Avg episode reward: [(0, '-4.081'), (1, '-5.031')] [2023-12-28 01:25:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000861824_220667904.pth... [2023-12-28 01:25:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000860672_220372992.pth [2023-12-28 01:25:56,222][106226] Updated weights for policy 0, policy_version 859858 (0.0009) [2023-12-28 01:25:56,279][106226] Updated weights for policy 0, policy_version 859868 (0.0008) [2023-12-28 01:25:56,333][106226] Updated weights for policy 0, policy_version 859878 (0.0009) [2023-12-28 01:25:56,342][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000859880_220184576.pth... [2023-12-28 01:25:56,345][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000858664_219873280.pth [2023-12-28 01:25:56,353][106225] Updated weights for policy 1, policy_version 861832 (0.0007) [2023-12-28 01:25:56,407][106225] Updated weights for policy 1, policy_version 861842 (0.0008) [2023-12-28 01:25:56,460][106225] Updated weights for policy 1, policy_version 861852 (0.0008) [2023-12-28 01:25:56,992][106226] Updated weights for policy 0, policy_version 859888 (0.0006) [2023-12-28 01:25:57,040][106226] Updated weights for policy 0, policy_version 859898 (0.0005) [2023-12-28 01:25:57,086][106226] Updated weights for policy 0, policy_version 859908 (0.0005) [2023-12-28 01:25:57,245][106225] Updated weights for policy 1, policy_version 861862 (0.0008) [2023-12-28 01:25:57,303][106225] Updated weights for policy 1, policy_version 861872 (0.0008) [2023-12-28 01:25:57,362][106225] Updated weights for policy 1, policy_version 861882 (0.0006) [2023-12-28 01:25:57,755][106226] Updated weights for policy 0, policy_version 859918 (0.0007) [2023-12-28 01:25:57,802][106226] Updated weights for policy 0, policy_version 859928 (0.0009) [2023-12-28 01:25:57,861][106226] Updated weights for policy 0, policy_version 859938 (0.0009) [2023-12-28 01:25:57,974][106225] Updated weights for policy 1, policy_version 861892 (0.0005) [2023-12-28 01:25:58,028][106225] Updated weights for policy 1, policy_version 861902 (0.0008) [2023-12-28 01:25:58,084][106225] Updated weights for policy 1, policy_version 861912 (0.0008) [2023-12-28 01:25:58,613][106226] Updated weights for policy 0, policy_version 859948 (0.0010) [2023-12-28 01:25:58,679][106226] Updated weights for policy 0, policy_version 859958 (0.0011) [2023-12-28 01:25:58,745][106226] Updated weights for policy 0, policy_version 859968 (0.0008) [2023-12-28 01:25:58,840][106225] Updated weights for policy 1, policy_version 861922 (0.0006) [2023-12-28 01:25:58,914][106225] Updated weights for policy 1, policy_version 861932 (0.0008) [2023-12-28 01:25:58,986][106225] Updated weights for policy 1, policy_version 861942 (0.0008) [2023-12-28 01:25:59,041][106225] Updated weights for policy 1, policy_version 861952 (0.0008) [2023-12-28 01:25:59,591][106226] Updated weights for policy 0, policy_version 859978 (0.0007) [2023-12-28 01:25:59,645][106226] Updated weights for policy 0, policy_version 859988 (0.0009) [2023-12-28 01:25:59,691][106226] Updated weights for policy 0, policy_version 859998 (0.0008) [2023-12-28 01:25:59,746][106226] Updated weights for policy 0, policy_version 860008 (0.0008) [2023-12-28 01:25:59,767][106225] Updated weights for policy 1, policy_version 861962 (0.0009) [2023-12-28 01:25:59,825][106225] Updated weights for policy 1, policy_version 861972 (0.0007) [2023-12-28 01:25:59,888][106225] Updated weights for policy 1, policy_version 861982 (0.0008) [2023-12-28 01:26:00,478][106226] Updated weights for policy 0, policy_version 860018 (0.0006) [2023-12-28 01:26:00,529][106226] Updated weights for policy 0, policy_version 860028 (0.0008) [2023-12-28 01:26:00,588][106226] Updated weights for policy 0, policy_version 860038 (0.0007) [2023-12-28 01:26:00,594][106225] Updated weights for policy 1, policy_version 861992 (0.0006) [2023-12-28 01:26:00,646][106225] Updated weights for policy 1, policy_version 862003 (0.0009) [2023-12-28 01:26:00,694][106225] Updated weights for policy 1, policy_version 862013 (0.0008) [2023-12-28 01:26:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 440942592. Throughput: 0: 10103.6, 1: 9787.8. Samples: 440933972. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:01,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-5.194')] [2023-12-28 01:26:01,208][106226] Updated weights for policy 0, policy_version 860048 (0.0009) [2023-12-28 01:26:01,268][106226] Updated weights for policy 0, policy_version 860058 (0.0007) [2023-12-28 01:26:01,326][106226] Updated weights for policy 0, policy_version 860068 (0.0007) [2023-12-28 01:26:01,521][106225] Updated weights for policy 1, policy_version 862023 (0.0008) [2023-12-28 01:26:01,578][106225] Updated weights for policy 1, policy_version 862033 (0.0009) [2023-12-28 01:26:01,638][106225] Updated weights for policy 1, policy_version 862043 (0.0009) [2023-12-28 01:26:01,989][106226] Updated weights for policy 0, policy_version 860078 (0.0007) [2023-12-28 01:26:02,054][106226] Updated weights for policy 0, policy_version 860088 (0.0005) [2023-12-28 01:26:02,115][106226] Updated weights for policy 0, policy_version 860098 (0.0005) [2023-12-28 01:26:02,405][106225] Updated weights for policy 1, policy_version 862053 (0.0008) [2023-12-28 01:26:02,463][106225] Updated weights for policy 1, policy_version 862063 (0.0009) [2023-12-28 01:26:02,521][106225] Updated weights for policy 1, policy_version 862073 (0.0008) [2023-12-28 01:26:02,805][106226] Updated weights for policy 0, policy_version 860108 (0.0007) [2023-12-28 01:26:02,868][106226] Updated weights for policy 0, policy_version 860118 (0.0008) [2023-12-28 01:26:02,930][106226] Updated weights for policy 0, policy_version 860128 (0.0009) [2023-12-28 01:26:03,251][106225] Updated weights for policy 1, policy_version 862083 (0.0008) [2023-12-28 01:26:03,300][106225] Updated weights for policy 1, policy_version 862093 (0.0009) [2023-12-28 01:26:03,348][106225] Updated weights for policy 1, policy_version 862103 (0.0008) [2023-12-28 01:26:03,624][106226] Updated weights for policy 0, policy_version 860138 (0.0008) [2023-12-28 01:26:03,678][106226] Updated weights for policy 0, policy_version 860148 (0.0007) [2023-12-28 01:26:03,729][106226] Updated weights for policy 0, policy_version 860158 (0.0007) [2023-12-28 01:26:03,784][106226] Updated weights for policy 0, policy_version 860168 (0.0005) [2023-12-28 01:26:04,109][106225] Updated weights for policy 1, policy_version 862113 (0.0007) [2023-12-28 01:26:04,172][106225] Updated weights for policy 1, policy_version 862123 (0.0009) [2023-12-28 01:26:04,234][106225] Updated weights for policy 1, policy_version 862133 (0.0010) [2023-12-28 01:26:04,299][106225] Updated weights for policy 1, policy_version 862143 (0.0009) [2023-12-28 01:26:04,362][106226] Updated weights for policy 0, policy_version 860178 (0.0007) [2023-12-28 01:26:04,416][106226] Updated weights for policy 0, policy_version 860188 (0.0008) [2023-12-28 01:26:04,474][106226] Updated weights for policy 0, policy_version 860198 (0.0009) [2023-12-28 01:26:04,984][106225] Updated weights for policy 1, policy_version 862153 (0.0008) [2023-12-28 01:26:05,034][106225] Updated weights for policy 1, policy_version 862163 (0.0008) [2023-12-28 01:26:05,087][106225] Updated weights for policy 1, policy_version 862173 (0.0009) [2023-12-28 01:26:05,171][106226] Updated weights for policy 0, policy_version 860208 (0.0008) [2023-12-28 01:26:05,237][106226] Updated weights for policy 0, policy_version 860218 (0.0011) [2023-12-28 01:26:05,297][106226] Updated weights for policy 0, policy_version 860228 (0.0011) [2023-12-28 01:26:05,831][106225] Updated weights for policy 1, policy_version 862183 (0.0006) [2023-12-28 01:26:05,896][106225] Updated weights for policy 1, policy_version 862193 (0.0005) [2023-12-28 01:26:05,897][106226] Updated weights for policy 0, policy_version 860238 (0.0008) [2023-12-28 01:26:05,951][106226] Updated weights for policy 0, policy_version 860248 (0.0006) [2023-12-28 01:26:05,964][106225] Updated weights for policy 1, policy_version 862203 (0.0005) [2023-12-28 01:26:06,004][106226] Updated weights for policy 0, policy_version 860258 (0.0008) [2023-12-28 01:26:06,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 441049088. Throughput: 0: 10149.2, 1: 9769.8. Samples: 441053548. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:06,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.958')] [2023-12-28 01:26:06,523][106225] Updated weights for policy 1, policy_version 862213 (0.0006) [2023-12-28 01:26:06,588][106225] Updated weights for policy 1, policy_version 862223 (0.0008) [2023-12-28 01:26:06,650][106225] Updated weights for policy 1, policy_version 862233 (0.0010) [2023-12-28 01:26:06,753][106226] Updated weights for policy 0, policy_version 860268 (0.0007) [2023-12-28 01:26:06,817][106226] Updated weights for policy 0, policy_version 860278 (0.0011) [2023-12-28 01:26:06,877][106226] Updated weights for policy 0, policy_version 860288 (0.0011) [2023-12-28 01:26:07,337][106225] Updated weights for policy 1, policy_version 862243 (0.0008) [2023-12-28 01:26:07,392][106225] Updated weights for policy 1, policy_version 862253 (0.0010) [2023-12-28 01:26:07,448][106225] Updated weights for policy 1, policy_version 862263 (0.0010) [2023-12-28 01:26:07,484][106226] Updated weights for policy 0, policy_version 860298 (0.0010) [2023-12-28 01:26:07,547][106226] Updated weights for policy 0, policy_version 860308 (0.0005) [2023-12-28 01:26:07,610][106226] Updated weights for policy 0, policy_version 860318 (0.0008) [2023-12-28 01:26:07,670][106226] Updated weights for policy 0, policy_version 860328 (0.0010) [2023-12-28 01:26:08,168][106225] Updated weights for policy 1, policy_version 862273 (0.0010) [2023-12-28 01:26:08,215][106225] Updated weights for policy 1, policy_version 862283 (0.0010) [2023-12-28 01:26:08,265][106225] Updated weights for policy 1, policy_version 862293 (0.0010) [2023-12-28 01:26:08,321][106225] Updated weights for policy 1, policy_version 862303 (0.0010) [2023-12-28 01:26:08,329][106226] Updated weights for policy 0, policy_version 860338 (0.0010) [2023-12-28 01:26:08,396][106226] Updated weights for policy 0, policy_version 860348 (0.0008) [2023-12-28 01:26:08,459][106226] Updated weights for policy 0, policy_version 860358 (0.0010) [2023-12-28 01:26:09,111][106225] Updated weights for policy 1, policy_version 862313 (0.0006) [2023-12-28 01:26:09,156][106226] Updated weights for policy 0, policy_version 860368 (0.0011) [2023-12-28 01:26:09,167][106225] Updated weights for policy 1, policy_version 862323 (0.0005) [2023-12-28 01:26:09,223][106226] Updated weights for policy 0, policy_version 860378 (0.0010) [2023-12-28 01:26:09,228][106225] Updated weights for policy 1, policy_version 862333 (0.0006) [2023-12-28 01:26:09,296][106226] Updated weights for policy 0, policy_version 860388 (0.0006) [2023-12-28 01:26:09,950][106225] Updated weights for policy 1, policy_version 862343 (0.0011) [2023-12-28 01:26:10,004][106226] Updated weights for policy 0, policy_version 860398 (0.0008) [2023-12-28 01:26:10,014][106225] Updated weights for policy 1, policy_version 862353 (0.0011) [2023-12-28 01:26:10,064][106226] Updated weights for policy 0, policy_version 860408 (0.0006) [2023-12-28 01:26:10,067][106225] Updated weights for policy 1, policy_version 862363 (0.0007) [2023-12-28 01:26:10,125][106226] Updated weights for policy 0, policy_version 860418 (0.0007) [2023-12-28 01:26:10,828][106225] Updated weights for policy 1, policy_version 862373 (0.0009) [2023-12-28 01:26:10,889][106225] Updated weights for policy 1, policy_version 862383 (0.0011) [2023-12-28 01:26:10,902][106226] Updated weights for policy 0, policy_version 860428 (0.0007) [2023-12-28 01:26:10,943][106225] Updated weights for policy 1, policy_version 862393 (0.0009) [2023-12-28 01:26:10,952][106226] Updated weights for policy 0, policy_version 860438 (0.0009) [2023-12-28 01:26:11,009][106226] Updated weights for policy 0, policy_version 860448 (0.0005) [2023-12-28 01:26:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 441147392. Throughput: 0: 10193.6, 1: 9837.8. Samples: 441114176. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:11,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.882')] [2023-12-28 01:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000860456_220332032.pth... [2023-12-28 01:26:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000862400_220815360.pth... [2023-12-28 01:26:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000859272_220028928.pth [2023-12-28 01:26:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000861280_220528640.pth [2023-12-28 01:26:11,764][106226] Updated weights for policy 0, policy_version 860458 (0.0008) [2023-12-28 01:26:11,778][106225] Updated weights for policy 1, policy_version 862403 (0.0007) [2023-12-28 01:26:11,830][106226] Updated weights for policy 0, policy_version 860468 (0.0006) [2023-12-28 01:26:11,845][106225] Updated weights for policy 1, policy_version 862413 (0.0008) [2023-12-28 01:26:11,895][106226] Updated weights for policy 0, policy_version 860478 (0.0007) [2023-12-28 01:26:11,901][106225] Updated weights for policy 1, policy_version 862423 (0.0006) [2023-12-28 01:26:11,951][106226] Updated weights for policy 0, policy_version 860488 (0.0007) [2023-12-28 01:26:12,624][106225] Updated weights for policy 1, policy_version 862433 (0.0006) [2023-12-28 01:26:12,627][106226] Updated weights for policy 0, policy_version 860498 (0.0008) [2023-12-28 01:26:12,684][106225] Updated weights for policy 1, policy_version 862443 (0.0008) [2023-12-28 01:26:12,685][106226] Updated weights for policy 0, policy_version 860508 (0.0008) [2023-12-28 01:26:12,740][106226] Updated weights for policy 0, policy_version 860518 (0.0007) [2023-12-28 01:26:12,744][106225] Updated weights for policy 1, policy_version 862453 (0.0007) [2023-12-28 01:26:12,806][106225] Updated weights for policy 1, policy_version 862463 (0.0009) [2023-12-28 01:26:13,509][106225] Updated weights for policy 1, policy_version 862473 (0.0010) [2023-12-28 01:26:13,523][106226] Updated weights for policy 0, policy_version 860528 (0.0008) [2023-12-28 01:26:13,569][106225] Updated weights for policy 1, policy_version 862483 (0.0010) [2023-12-28 01:26:13,571][106226] Updated weights for policy 0, policy_version 860538 (0.0008) [2023-12-28 01:26:13,625][106226] Updated weights for policy 0, policy_version 860548 (0.0008) [2023-12-28 01:26:13,631][106225] Updated weights for policy 1, policy_version 862493 (0.0006) [2023-12-28 01:26:14,186][106225] Updated weights for policy 1, policy_version 862503 (0.0006) [2023-12-28 01:26:14,241][106225] Updated weights for policy 1, policy_version 862513 (0.0007) [2023-12-28 01:26:14,292][106225] Updated weights for policy 1, policy_version 862523 (0.0005) [2023-12-28 01:26:14,321][106226] Updated weights for policy 0, policy_version 860558 (0.0009) [2023-12-28 01:26:14,382][106226] Updated weights for policy 0, policy_version 860568 (0.0008) [2023-12-28 01:26:14,436][106226] Updated weights for policy 0, policy_version 860578 (0.0007) [2023-12-28 01:26:14,967][106225] Updated weights for policy 1, policy_version 862533 (0.0007) [2023-12-28 01:26:15,034][106225] Updated weights for policy 1, policy_version 862543 (0.0008) [2023-12-28 01:26:15,100][106225] Updated weights for policy 1, policy_version 862553 (0.0008) [2023-12-28 01:26:15,106][106226] Updated weights for policy 0, policy_version 860588 (0.0008) [2023-12-28 01:26:15,168][106226] Updated weights for policy 0, policy_version 860598 (0.0011) [2023-12-28 01:26:15,229][106226] Updated weights for policy 0, policy_version 860608 (0.0011) [2023-12-28 01:26:15,826][106225] Updated weights for policy 1, policy_version 862563 (0.0009) [2023-12-28 01:26:15,892][106225] Updated weights for policy 1, policy_version 862573 (0.0010) [2023-12-28 01:26:15,920][106226] Updated weights for policy 0, policy_version 860618 (0.0011) [2023-12-28 01:26:15,948][106225] Updated weights for policy 1, policy_version 862583 (0.0010) [2023-12-28 01:26:15,983][106226] Updated weights for policy 0, policy_version 860628 (0.0010) [2023-12-28 01:26:16,034][106226] Updated weights for policy 0, policy_version 860638 (0.0010) [2023-12-28 01:26:16,083][106226] Updated weights for policy 0, policy_version 860648 (0.0010) [2023-12-28 01:26:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 441245696. Throughput: 0: 10074.4, 1: 9775.1. Samples: 441230352. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:16,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.857')] [2023-12-28 01:26:16,646][106225] Updated weights for policy 1, policy_version 862593 (0.0010) [2023-12-28 01:26:16,679][106226] Updated weights for policy 0, policy_version 860658 (0.0005) [2023-12-28 01:26:16,702][106225] Updated weights for policy 1, policy_version 862603 (0.0010) [2023-12-28 01:26:16,735][106226] Updated weights for policy 0, policy_version 860668 (0.0006) [2023-12-28 01:26:16,765][106225] Updated weights for policy 1, policy_version 862613 (0.0010) [2023-12-28 01:26:16,787][106226] Updated weights for policy 0, policy_version 860678 (0.0006) [2023-12-28 01:26:16,820][106225] Updated weights for policy 1, policy_version 862623 (0.0010) [2023-12-28 01:26:17,399][106226] Updated weights for policy 0, policy_version 860688 (0.0006) [2023-12-28 01:26:17,457][106226] Updated weights for policy 0, policy_version 860698 (0.0010) [2023-12-28 01:26:17,513][106226] Updated weights for policy 0, policy_version 860708 (0.0010) [2023-12-28 01:26:17,529][106225] Updated weights for policy 1, policy_version 862633 (0.0010) [2023-12-28 01:26:17,581][106225] Updated weights for policy 1, policy_version 862643 (0.0010) [2023-12-28 01:26:17,633][106225] Updated weights for policy 1, policy_version 862653 (0.0010) [2023-12-28 01:26:18,195][106226] Updated weights for policy 0, policy_version 860718 (0.0010) [2023-12-28 01:26:18,242][106226] Updated weights for policy 0, policy_version 860728 (0.0010) [2023-12-28 01:26:18,291][106226] Updated weights for policy 0, policy_version 860738 (0.0010) [2023-12-28 01:26:18,336][106225] Updated weights for policy 1, policy_version 862663 (0.0010) [2023-12-28 01:26:18,403][106225] Updated weights for policy 1, policy_version 862673 (0.0010) [2023-12-28 01:26:18,472][106225] Updated weights for policy 1, policy_version 862683 (0.0006) [2023-12-28 01:26:19,004][106226] Updated weights for policy 0, policy_version 860748 (0.0010) [2023-12-28 01:26:19,060][106226] Updated weights for policy 0, policy_version 860758 (0.0008) [2023-12-28 01:26:19,128][106226] Updated weights for policy 0, policy_version 860768 (0.0006) [2023-12-28 01:26:19,159][106225] Updated weights for policy 1, policy_version 862693 (0.0007) [2023-12-28 01:26:19,222][106225] Updated weights for policy 1, policy_version 862703 (0.0008) [2023-12-28 01:26:19,284][106225] Updated weights for policy 1, policy_version 862713 (0.0012) [2023-12-28 01:26:19,875][106226] Updated weights for policy 0, policy_version 860778 (0.0007) [2023-12-28 01:26:19,946][106226] Updated weights for policy 0, policy_version 860788 (0.0007) [2023-12-28 01:26:20,015][106226] Updated weights for policy 0, policy_version 860798 (0.0009) [2023-12-28 01:26:20,078][106225] Updated weights for policy 1, policy_version 862723 (0.0010) [2023-12-28 01:26:20,080][106226] Updated weights for policy 0, policy_version 860808 (0.0008) [2023-12-28 01:26:20,141][106225] Updated weights for policy 1, policy_version 862733 (0.0009) [2023-12-28 01:26:20,209][106225] Updated weights for policy 1, policy_version 862743 (0.0009) [2023-12-28 01:26:20,770][106226] Updated weights for policy 0, policy_version 860818 (0.0007) [2023-12-28 01:26:20,827][106226] Updated weights for policy 0, policy_version 860828 (0.0007) [2023-12-28 01:26:20,891][106226] Updated weights for policy 0, policy_version 860838 (0.0007) [2023-12-28 01:26:20,978][106225] Updated weights for policy 1, policy_version 862753 (0.0009) [2023-12-28 01:26:21,046][106225] Updated weights for policy 1, policy_version 862763 (0.0009) [2023-12-28 01:26:21,116][106225] Updated weights for policy 1, policy_version 862773 (0.0007) [2023-12-28 01:26:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 441335808. Throughput: 0: 10076.1, 1: 9722.8. Samples: 441348108. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:21,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.923')] [2023-12-28 01:26:21,186][106225] Updated weights for policy 1, policy_version 862783 (0.0008) [2023-12-28 01:26:21,589][106226] Updated weights for policy 0, policy_version 860848 (0.0010) [2023-12-28 01:26:21,660][106226] Updated weights for policy 0, policy_version 860858 (0.0010) [2023-12-28 01:26:21,726][106226] Updated weights for policy 0, policy_version 860868 (0.0011) [2023-12-28 01:26:21,991][106225] Updated weights for policy 1, policy_version 862793 (0.0006) [2023-12-28 01:26:22,045][106225] Updated weights for policy 1, policy_version 862803 (0.0007) [2023-12-28 01:26:22,095][106225] Updated weights for policy 1, policy_version 862813 (0.0007) [2023-12-28 01:26:22,465][106226] Updated weights for policy 0, policy_version 860878 (0.0011) [2023-12-28 01:26:22,512][106226] Updated weights for policy 0, policy_version 860888 (0.0011) [2023-12-28 01:26:22,574][106226] Updated weights for policy 0, policy_version 860898 (0.0011) [2023-12-28 01:26:22,734][106225] Updated weights for policy 1, policy_version 862823 (0.0008) [2023-12-28 01:26:22,784][106225] Updated weights for policy 1, policy_version 862833 (0.0005) [2023-12-28 01:26:22,837][106225] Updated weights for policy 1, policy_version 862843 (0.0006) [2023-12-28 01:26:23,301][106226] Updated weights for policy 0, policy_version 860908 (0.0010) [2023-12-28 01:26:23,362][106226] Updated weights for policy 0, policy_version 860918 (0.0008) [2023-12-28 01:26:23,415][106226] Updated weights for policy 0, policy_version 860928 (0.0009) [2023-12-28 01:26:23,448][106225] Updated weights for policy 1, policy_version 862853 (0.0005) [2023-12-28 01:26:23,503][106225] Updated weights for policy 1, policy_version 862863 (0.0005) [2023-12-28 01:26:23,556][106225] Updated weights for policy 1, policy_version 862873 (0.0005) [2023-12-28 01:26:24,174][106225] Updated weights for policy 1, policy_version 862883 (0.0006) [2023-12-28 01:26:24,183][106226] Updated weights for policy 0, policy_version 860938 (0.0009) [2023-12-28 01:26:24,229][106225] Updated weights for policy 1, policy_version 862893 (0.0006) [2023-12-28 01:26:24,243][106226] Updated weights for policy 0, policy_version 860948 (0.0008) [2023-12-28 01:26:24,294][106225] Updated weights for policy 1, policy_version 862903 (0.0007) [2023-12-28 01:26:24,307][106226] Updated weights for policy 0, policy_version 860958 (0.0006) [2023-12-28 01:26:24,356][106226] Updated weights for policy 0, policy_version 860968 (0.0007) [2023-12-28 01:26:24,907][106226] Updated weights for policy 0, policy_version 860978 (0.0008) [2023-12-28 01:26:24,921][106225] Updated weights for policy 1, policy_version 862913 (0.0007) [2023-12-28 01:26:24,969][106226] Updated weights for policy 0, policy_version 860988 (0.0006) [2023-12-28 01:26:24,975][106225] Updated weights for policy 1, policy_version 862923 (0.0007) [2023-12-28 01:26:25,024][106226] Updated weights for policy 0, policy_version 860998 (0.0006) [2023-12-28 01:26:25,030][106225] Updated weights for policy 1, policy_version 862933 (0.0006) [2023-12-28 01:26:25,076][106225] Updated weights for policy 1, policy_version 862943 (0.0008) [2023-12-28 01:26:25,734][106225] Updated weights for policy 1, policy_version 862953 (0.0006) [2023-12-28 01:26:25,788][106225] Updated weights for policy 1, policy_version 862963 (0.0007) [2023-12-28 01:26:25,794][106226] Updated weights for policy 0, policy_version 861008 (0.0006) [2023-12-28 01:26:25,844][106225] Updated weights for policy 1, policy_version 862973 (0.0007) [2023-12-28 01:26:25,852][106226] Updated weights for policy 0, policy_version 861018 (0.0008) [2023-12-28 01:26:25,916][106226] Updated weights for policy 0, policy_version 861028 (0.0009) [2023-12-28 01:26:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 441442304. Throughput: 0: 10030.4, 1: 9694.5. Samples: 441406928. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:26,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.976')] [2023-12-28 01:26:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000862976_220962816.pth... [2023-12-28 01:26:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000861032_220479488.pth... [2023-12-28 01:26:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000861824_220667904.pth [2023-12-28 01:26:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000859880_220184576.pth [2023-12-28 01:26:26,515][106225] Updated weights for policy 1, policy_version 862983 (0.0009) [2023-12-28 01:26:26,561][106225] Updated weights for policy 1, policy_version 862993 (0.0010) [2023-12-28 01:26:26,605][106225] Updated weights for policy 1, policy_version 863003 (0.0009) [2023-12-28 01:26:26,630][106226] Updated weights for policy 0, policy_version 861038 (0.0008) [2023-12-28 01:26:26,683][106226] Updated weights for policy 0, policy_version 861048 (0.0007) [2023-12-28 01:26:26,735][106226] Updated weights for policy 0, policy_version 861058 (0.0008) [2023-12-28 01:26:27,192][106225] Updated weights for policy 1, policy_version 863013 (0.0008) [2023-12-28 01:26:27,242][106225] Updated weights for policy 1, policy_version 863023 (0.0008) [2023-12-28 01:26:27,296][106225] Updated weights for policy 1, policy_version 863033 (0.0008) [2023-12-28 01:26:27,528][106226] Updated weights for policy 0, policy_version 861068 (0.0008) [2023-12-28 01:26:27,584][106226] Updated weights for policy 0, policy_version 861078 (0.0008) [2023-12-28 01:26:27,636][106226] Updated weights for policy 0, policy_version 861088 (0.0009) [2023-12-28 01:26:27,953][106225] Updated weights for policy 1, policy_version 863043 (0.0007) [2023-12-28 01:26:28,015][106225] Updated weights for policy 1, policy_version 863053 (0.0008) [2023-12-28 01:26:28,062][106225] Updated weights for policy 1, policy_version 863063 (0.0007) [2023-12-28 01:26:28,318][106226] Updated weights for policy 0, policy_version 861098 (0.0008) [2023-12-28 01:26:28,386][106226] Updated weights for policy 0, policy_version 861108 (0.0009) [2023-12-28 01:26:28,442][106226] Updated weights for policy 0, policy_version 861118 (0.0008) [2023-12-28 01:26:28,490][106226] Updated weights for policy 0, policy_version 861128 (0.0008) [2023-12-28 01:26:28,754][106225] Updated weights for policy 1, policy_version 863073 (0.0005) [2023-12-28 01:26:28,824][106225] Updated weights for policy 1, policy_version 863083 (0.0006) [2023-12-28 01:26:28,894][106225] Updated weights for policy 1, policy_version 863093 (0.0006) [2023-12-28 01:26:28,955][106225] Updated weights for policy 1, policy_version 863103 (0.0008) [2023-12-28 01:26:29,208][106226] Updated weights for policy 0, policy_version 861138 (0.0006) [2023-12-28 01:26:29,269][106226] Updated weights for policy 0, policy_version 861148 (0.0008) [2023-12-28 01:26:29,331][106226] Updated weights for policy 0, policy_version 861158 (0.0008) [2023-12-28 01:26:29,633][106225] Updated weights for policy 1, policy_version 863113 (0.0010) [2023-12-28 01:26:29,683][106225] Updated weights for policy 1, policy_version 863123 (0.0010) [2023-12-28 01:26:29,735][106225] Updated weights for policy 1, policy_version 863133 (0.0010) [2023-12-28 01:26:29,932][106226] Updated weights for policy 0, policy_version 861168 (0.0008) [2023-12-28 01:26:29,995][106226] Updated weights for policy 0, policy_version 861178 (0.0008) [2023-12-28 01:26:30,054][106226] Updated weights for policy 0, policy_version 861188 (0.0008) [2023-12-28 01:26:30,475][106225] Updated weights for policy 1, policy_version 863143 (0.0010) [2023-12-28 01:26:30,526][106225] Updated weights for policy 1, policy_version 863153 (0.0010) [2023-12-28 01:26:30,579][106225] Updated weights for policy 1, policy_version 863163 (0.0010) [2023-12-28 01:26:30,762][106226] Updated weights for policy 0, policy_version 861198 (0.0009) [2023-12-28 01:26:30,822][106226] Updated weights for policy 0, policy_version 861208 (0.0007) [2023-12-28 01:26:30,886][106226] Updated weights for policy 0, policy_version 861218 (0.0008) [2023-12-28 01:26:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 441540608. Throughput: 0: 10040.5, 1: 9822.1. Samples: 441529964. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:31,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.208')] [2023-12-28 01:26:31,251][106225] Updated weights for policy 1, policy_version 863173 (0.0008) [2023-12-28 01:26:31,310][106225] Updated weights for policy 1, policy_version 863183 (0.0009) [2023-12-28 01:26:31,370][106225] Updated weights for policy 1, policy_version 863193 (0.0009) [2023-12-28 01:26:31,639][106226] Updated weights for policy 0, policy_version 861228 (0.0008) [2023-12-28 01:26:31,698][106226] Updated weights for policy 0, policy_version 861238 (0.0009) [2023-12-28 01:26:31,762][106226] Updated weights for policy 0, policy_version 861248 (0.0009) [2023-12-28 01:26:32,123][106225] Updated weights for policy 1, policy_version 863203 (0.0009) [2023-12-28 01:26:32,183][106225] Updated weights for policy 1, policy_version 863213 (0.0009) [2023-12-28 01:26:32,246][106225] Updated weights for policy 1, policy_version 863223 (0.0009) [2023-12-28 01:26:32,491][106226] Updated weights for policy 0, policy_version 861258 (0.0009) [2023-12-28 01:26:32,560][106226] Updated weights for policy 0, policy_version 861268 (0.0008) [2023-12-28 01:26:32,613][106226] Updated weights for policy 0, policy_version 861278 (0.0008) [2023-12-28 01:26:32,672][106226] Updated weights for policy 0, policy_version 861288 (0.0005) [2023-12-28 01:26:32,900][106225] Updated weights for policy 1, policy_version 863233 (0.0007) [2023-12-28 01:26:32,958][106225] Updated weights for policy 1, policy_version 863243 (0.0008) [2023-12-28 01:26:33,016][106225] Updated weights for policy 1, policy_version 863253 (0.0008) [2023-12-28 01:26:33,076][106225] Updated weights for policy 1, policy_version 863263 (0.0007) [2023-12-28 01:26:33,387][106226] Updated weights for policy 0, policy_version 861298 (0.0011) [2023-12-28 01:26:33,450][106226] Updated weights for policy 0, policy_version 861308 (0.0010) [2023-12-28 01:26:33,504][106226] Updated weights for policy 0, policy_version 861318 (0.0010) [2023-12-28 01:26:33,734][106225] Updated weights for policy 1, policy_version 863273 (0.0009) [2023-12-28 01:26:33,788][106225] Updated weights for policy 1, policy_version 863283 (0.0009) [2023-12-28 01:26:33,839][106225] Updated weights for policy 1, policy_version 863293 (0.0008) [2023-12-28 01:26:34,061][106226] Updated weights for policy 0, policy_version 861328 (0.0006) [2023-12-28 01:26:34,122][106226] Updated weights for policy 0, policy_version 861338 (0.0005) [2023-12-28 01:26:34,189][106226] Updated weights for policy 0, policy_version 861349 (0.0007) [2023-12-28 01:26:34,534][106225] Updated weights for policy 1, policy_version 863303 (0.0007) [2023-12-28 01:26:34,595][106225] Updated weights for policy 1, policy_version 863313 (0.0008) [2023-12-28 01:26:34,657][106225] Updated weights for policy 1, policy_version 863323 (0.0008) [2023-12-28 01:26:34,834][106226] Updated weights for policy 0, policy_version 861359 (0.0006) [2023-12-28 01:26:34,900][106226] Updated weights for policy 0, policy_version 861369 (0.0006) [2023-12-28 01:26:34,969][106226] Updated weights for policy 0, policy_version 861379 (0.0005) [2023-12-28 01:26:35,301][106225] Updated weights for policy 1, policy_version 863333 (0.0008) [2023-12-28 01:26:35,360][106225] Updated weights for policy 1, policy_version 863343 (0.0008) [2023-12-28 01:26:35,416][106225] Updated weights for policy 1, policy_version 863353 (0.0009) [2023-12-28 01:26:35,580][106226] Updated weights for policy 0, policy_version 861389 (0.0007) [2023-12-28 01:26:35,638][106226] Updated weights for policy 0, policy_version 861399 (0.0009) [2023-12-28 01:26:35,692][106226] Updated weights for policy 0, policy_version 861409 (0.0009) [2023-12-28 01:26:36,115][106225] Updated weights for policy 1, policy_version 863363 (0.0008) [2023-12-28 01:26:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 441638912. Throughput: 0: 10023.5, 1: 9851.5. Samples: 441651124. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:36,177][105115] Avg episode reward: [(0, '-4.361'), (1, '-5.093')] [2023-12-28 01:26:36,180][106225] Updated weights for policy 1, policy_version 863373 (0.0008) [2023-12-28 01:26:36,238][106225] Updated weights for policy 1, policy_version 863383 (0.0010) [2023-12-28 01:26:36,395][106226] Updated weights for policy 0, policy_version 861419 (0.0008) [2023-12-28 01:26:36,457][106226] Updated weights for policy 0, policy_version 861429 (0.0009) [2023-12-28 01:26:36,521][106226] Updated weights for policy 0, policy_version 861439 (0.0009) [2023-12-28 01:26:37,020][106225] Updated weights for policy 1, policy_version 863393 (0.0010) [2023-12-28 01:26:37,072][106225] Updated weights for policy 1, policy_version 863403 (0.0008) [2023-12-28 01:26:37,120][106225] Updated weights for policy 1, policy_version 863413 (0.0007) [2023-12-28 01:26:37,168][106226] Updated weights for policy 0, policy_version 861449 (0.0008) [2023-12-28 01:26:37,174][106225] Updated weights for policy 1, policy_version 863423 (0.0009) [2023-12-28 01:26:37,230][106226] Updated weights for policy 0, policy_version 861459 (0.0007) [2023-12-28 01:26:37,295][106226] Updated weights for policy 0, policy_version 861469 (0.0009) [2023-12-28 01:26:37,360][106226] Updated weights for policy 0, policy_version 861479 (0.0008) [2023-12-28 01:26:37,926][106225] Updated weights for policy 1, policy_version 863433 (0.0008) [2023-12-28 01:26:37,986][106225] Updated weights for policy 1, policy_version 863443 (0.0009) [2023-12-28 01:26:38,034][106225] Updated weights for policy 1, policy_version 863453 (0.0007) [2023-12-28 01:26:38,051][106226] Updated weights for policy 0, policy_version 861489 (0.0006) [2023-12-28 01:26:38,102][106226] Updated weights for policy 0, policy_version 861499 (0.0005) [2023-12-28 01:26:38,153][106226] Updated weights for policy 0, policy_version 861509 (0.0005) [2023-12-28 01:26:38,808][106226] Updated weights for policy 0, policy_version 861519 (0.0005) [2023-12-28 01:26:38,833][106225] Updated weights for policy 1, policy_version 863463 (0.0007) [2023-12-28 01:26:38,873][106226] Updated weights for policy 0, policy_version 861529 (0.0007) [2023-12-28 01:26:38,893][106225] Updated weights for policy 1, policy_version 863473 (0.0007) [2023-12-28 01:26:38,939][106226] Updated weights for policy 0, policy_version 861539 (0.0008) [2023-12-28 01:26:38,961][106225] Updated weights for policy 1, policy_version 863483 (0.0006) [2023-12-28 01:26:39,651][106225] Updated weights for policy 1, policy_version 863493 (0.0007) [2023-12-28 01:26:39,687][106226] Updated weights for policy 0, policy_version 861549 (0.0008) [2023-12-28 01:26:39,717][106225] Updated weights for policy 1, policy_version 863503 (0.0006) [2023-12-28 01:26:39,749][106226] Updated weights for policy 0, policy_version 861559 (0.0006) [2023-12-28 01:26:39,777][106225] Updated weights for policy 1, policy_version 863513 (0.0006) [2023-12-28 01:26:39,823][106226] Updated weights for policy 0, policy_version 861569 (0.0006) [2023-12-28 01:26:40,476][106225] Updated weights for policy 1, policy_version 863523 (0.0009) [2023-12-28 01:26:40,528][106226] Updated weights for policy 0, policy_version 861579 (0.0007) [2023-12-28 01:26:40,534][106225] Updated weights for policy 1, policy_version 863533 (0.0008) [2023-12-28 01:26:40,591][106226] Updated weights for policy 0, policy_version 861589 (0.0006) [2023-12-28 01:26:40,592][106225] Updated weights for policy 1, policy_version 863543 (0.0006) [2023-12-28 01:26:40,655][106226] Updated weights for policy 0, policy_version 861599 (0.0008) [2023-12-28 01:26:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 441737216. Throughput: 0: 10032.7, 1: 9842.1. Samples: 441709552. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:41,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.053')] [2023-12-28 01:26:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000863552_221110272.pth... [2023-12-28 01:26:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000861608_220626944.pth... [2023-12-28 01:26:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000862400_220815360.pth [2023-12-28 01:26:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000860456_220332032.pth [2023-12-28 01:26:41,321][106226] Updated weights for policy 0, policy_version 861609 (0.0006) [2023-12-28 01:26:41,393][106226] Updated weights for policy 0, policy_version 861619 (0.0010) [2023-12-28 01:26:41,409][106225] Updated weights for policy 1, policy_version 863553 (0.0006) [2023-12-28 01:26:41,450][106226] Updated weights for policy 0, policy_version 861629 (0.0008) [2023-12-28 01:26:41,467][106225] Updated weights for policy 1, policy_version 863563 (0.0008) [2023-12-28 01:26:41,505][106226] Updated weights for policy 0, policy_version 861639 (0.0006) [2023-12-28 01:26:41,527][106225] Updated weights for policy 1, policy_version 863573 (0.0008) [2023-12-28 01:26:41,591][106225] Updated weights for policy 1, policy_version 863583 (0.0009) [2023-12-28 01:26:42,279][106226] Updated weights for policy 0, policy_version 861649 (0.0008) [2023-12-28 01:26:42,352][106226] Updated weights for policy 0, policy_version 861659 (0.0008) [2023-12-28 01:26:42,370][106225] Updated weights for policy 1, policy_version 863593 (0.0009) [2023-12-28 01:26:42,426][106226] Updated weights for policy 0, policy_version 861670 (0.0008) [2023-12-28 01:26:42,435][106225] Updated weights for policy 1, policy_version 863603 (0.0008) [2023-12-28 01:26:42,495][106225] Updated weights for policy 1, policy_version 863613 (0.0008) [2023-12-28 01:26:43,153][106225] Updated weights for policy 1, policy_version 863623 (0.0006) [2023-12-28 01:26:43,211][106226] Updated weights for policy 0, policy_version 861680 (0.0007) [2023-12-28 01:26:43,214][106225] Updated weights for policy 1, policy_version 863633 (0.0005) [2023-12-28 01:26:43,268][106226] Updated weights for policy 0, policy_version 861690 (0.0006) [2023-12-28 01:26:43,270][106225] Updated weights for policy 1, policy_version 863643 (0.0009) [2023-12-28 01:26:43,325][106226] Updated weights for policy 0, policy_version 861700 (0.0007) [2023-12-28 01:26:43,885][106225] Updated weights for policy 1, policy_version 863653 (0.0005) [2023-12-28 01:26:43,942][106225] Updated weights for policy 1, policy_version 863663 (0.0007) [2023-12-28 01:26:43,980][106226] Updated weights for policy 0, policy_version 861710 (0.0007) [2023-12-28 01:26:44,000][106225] Updated weights for policy 1, policy_version 863673 (0.0009) [2023-12-28 01:26:44,038][106226] Updated weights for policy 0, policy_version 861720 (0.0007) [2023-12-28 01:26:44,097][106226] Updated weights for policy 0, policy_version 861730 (0.0008) [2023-12-28 01:26:44,697][106225] Updated weights for policy 1, policy_version 863683 (0.0006) [2023-12-28 01:26:44,774][106225] Updated weights for policy 1, policy_version 863696 (0.0008) [2023-12-28 01:26:44,805][106226] Updated weights for policy 0, policy_version 861740 (0.0008) [2023-12-28 01:26:44,846][106225] Updated weights for policy 1, policy_version 863710 (0.0008) [2023-12-28 01:26:44,866][106226] Updated weights for policy 0, policy_version 861750 (0.0007) [2023-12-28 01:26:44,924][106226] Updated weights for policy 0, policy_version 861760 (0.0008) [2023-12-28 01:26:45,534][106225] Updated weights for policy 1, policy_version 863720 (0.0006) [2023-12-28 01:26:45,592][106225] Updated weights for policy 1, policy_version 863730 (0.0007) [2023-12-28 01:26:45,654][106225] Updated weights for policy 1, policy_version 863740 (0.0008) [2023-12-28 01:26:45,698][106226] Updated weights for policy 0, policy_version 861770 (0.0009) [2023-12-28 01:26:45,757][106226] Updated weights for policy 0, policy_version 861780 (0.0010) [2023-12-28 01:26:45,811][106226] Updated weights for policy 0, policy_version 861790 (0.0009) [2023-12-28 01:26:45,856][106226] Updated weights for policy 0, policy_version 861800 (0.0008) [2023-12-28 01:26:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 441835520. Throughput: 0: 9965.0, 1: 9823.8. Samples: 441824472. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:46,176][105115] Avg episode reward: [(0, '-4.649'), (1, '-4.710')] [2023-12-28 01:26:46,319][106225] Updated weights for policy 1, policy_version 863750 (0.0009) [2023-12-28 01:26:46,372][106225] Updated weights for policy 1, policy_version 863760 (0.0009) [2023-12-28 01:26:46,428][106225] Updated weights for policy 1, policy_version 863770 (0.0005) [2023-12-28 01:26:46,539][106226] Updated weights for policy 0, policy_version 861810 (0.0008) [2023-12-28 01:26:46,600][106226] Updated weights for policy 0, policy_version 861820 (0.0007) [2023-12-28 01:26:46,659][106226] Updated weights for policy 0, policy_version 861830 (0.0008) [2023-12-28 01:26:47,043][106225] Updated weights for policy 1, policy_version 863780 (0.0005) [2023-12-28 01:26:47,101][106225] Updated weights for policy 1, policy_version 863790 (0.0005) [2023-12-28 01:26:47,164][106225] Updated weights for policy 1, policy_version 863800 (0.0006) [2023-12-28 01:26:47,463][106226] Updated weights for policy 0, policy_version 861840 (0.0009) [2023-12-28 01:26:47,520][106226] Updated weights for policy 0, policy_version 861850 (0.0009) [2023-12-28 01:26:47,575][106226] Updated weights for policy 0, policy_version 861860 (0.0009) [2023-12-28 01:26:47,683][106225] Updated weights for policy 1, policy_version 863810 (0.0006) [2023-12-28 01:26:47,730][106225] Updated weights for policy 1, policy_version 863820 (0.0010) [2023-12-28 01:26:47,776][106225] Updated weights for policy 1, policy_version 863830 (0.0010) [2023-12-28 01:26:47,830][106225] Updated weights for policy 1, policy_version 863840 (0.0010) [2023-12-28 01:26:48,358][106226] Updated weights for policy 0, policy_version 861870 (0.0009) [2023-12-28 01:26:48,417][106226] Updated weights for policy 0, policy_version 861880 (0.0008) [2023-12-28 01:26:48,476][106226] Updated weights for policy 0, policy_version 861890 (0.0008) [2023-12-28 01:26:48,574][106225] Updated weights for policy 1, policy_version 863850 (0.0011) [2023-12-28 01:26:48,638][106225] Updated weights for policy 1, policy_version 863860 (0.0010) [2023-12-28 01:26:48,696][106225] Updated weights for policy 1, policy_version 863870 (0.0010) [2023-12-28 01:26:49,171][106226] Updated weights for policy 0, policy_version 861900 (0.0007) [2023-12-28 01:26:49,233][106226] Updated weights for policy 0, policy_version 861910 (0.0009) [2023-12-28 01:26:49,300][106226] Updated weights for policy 0, policy_version 861920 (0.0009) [2023-12-28 01:26:49,420][106225] Updated weights for policy 1, policy_version 863880 (0.0008) [2023-12-28 01:26:49,471][106225] Updated weights for policy 1, policy_version 863890 (0.0009) [2023-12-28 01:26:49,529][106225] Updated weights for policy 1, policy_version 863900 (0.0010) [2023-12-28 01:26:49,924][106226] Updated weights for policy 0, policy_version 861930 (0.0008) [2023-12-28 01:26:49,991][106226] Updated weights for policy 0, policy_version 861940 (0.0008) [2023-12-28 01:26:50,050][106226] Updated weights for policy 0, policy_version 861950 (0.0008) [2023-12-28 01:26:50,106][106226] Updated weights for policy 0, policy_version 861960 (0.0008) [2023-12-28 01:26:50,262][106225] Updated weights for policy 1, policy_version 863910 (0.0010) [2023-12-28 01:26:50,323][106225] Updated weights for policy 1, policy_version 863920 (0.0010) [2023-12-28 01:26:50,384][106225] Updated weights for policy 1, policy_version 863930 (0.0011) [2023-12-28 01:26:50,819][106226] Updated weights for policy 0, policy_version 861970 (0.0007) [2023-12-28 01:26:50,886][106226] Updated weights for policy 0, policy_version 861980 (0.0006) [2023-12-28 01:26:50,938][106226] Updated weights for policy 0, policy_version 861990 (0.0008) [2023-12-28 01:26:51,123][106225] Updated weights for policy 1, policy_version 863940 (0.0009) [2023-12-28 01:26:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 441933824. Throughput: 0: 9850.2, 1: 9925.8. Samples: 441943468. Policy #0 lag: (min: 13.0, avg: 16.9, max: 45.0) [2023-12-28 01:26:51,175][105115] Avg episode reward: [(0, '-4.192'), (1, '-5.038')] [2023-12-28 01:26:51,191][106225] Updated weights for policy 1, policy_version 863950 (0.0009) [2023-12-28 01:26:51,252][106225] Updated weights for policy 1, policy_version 863960 (0.0009) [2023-12-28 01:26:51,768][106226] Updated weights for policy 0, policy_version 862000 (0.0008) [2023-12-28 01:26:51,829][106226] Updated weights for policy 0, policy_version 862010 (0.0010) [2023-12-28 01:26:51,896][106226] Updated weights for policy 0, policy_version 862020 (0.0010) [2023-12-28 01:26:51,934][106225] Updated weights for policy 1, policy_version 863970 (0.0008) [2023-12-28 01:26:51,992][106225] Updated weights for policy 1, policy_version 863980 (0.0005) [2023-12-28 01:26:52,058][106225] Updated weights for policy 1, policy_version 863990 (0.0005) [2023-12-28 01:26:52,118][106225] Updated weights for policy 1, policy_version 864000 (0.0005) [2023-12-28 01:26:52,670][106226] Updated weights for policy 0, policy_version 862030 (0.0011) [2023-12-28 01:26:52,718][106226] Updated weights for policy 0, policy_version 862040 (0.0007) [2023-12-28 01:26:52,748][106225] Updated weights for policy 1, policy_version 864010 (0.0007) [2023-12-28 01:26:52,775][106226] Updated weights for policy 0, policy_version 862050 (0.0008) [2023-12-28 01:26:52,808][106225] Updated weights for policy 1, policy_version 864020 (0.0007) [2023-12-28 01:26:52,868][106225] Updated weights for policy 1, policy_version 864030 (0.0008) [2023-12-28 01:26:53,483][106225] Updated weights for policy 1, policy_version 864040 (0.0006) [2023-12-28 01:26:53,530][106226] Updated weights for policy 0, policy_version 862060 (0.0006) [2023-12-28 01:26:53,538][106225] Updated weights for policy 1, policy_version 864050 (0.0006) [2023-12-28 01:26:53,582][106226] Updated weights for policy 0, policy_version 862070 (0.0005) [2023-12-28 01:26:53,588][106225] Updated weights for policy 1, policy_version 864060 (0.0005) [2023-12-28 01:26:53,643][106226] Updated weights for policy 0, policy_version 862080 (0.0006) [2023-12-28 01:26:54,211][106226] Updated weights for policy 0, policy_version 862090 (0.0008) [2023-12-28 01:26:54,265][106225] Updated weights for policy 1, policy_version 864070 (0.0008) [2023-12-28 01:26:54,273][106226] Updated weights for policy 0, policy_version 862100 (0.0007) [2023-12-28 01:26:54,327][106225] Updated weights for policy 1, policy_version 864080 (0.0008) [2023-12-28 01:26:54,342][106226] Updated weights for policy 0, policy_version 862110 (0.0008) [2023-12-28 01:26:54,384][106225] Updated weights for policy 1, policy_version 864090 (0.0008) [2023-12-28 01:26:54,411][106226] Updated weights for policy 0, policy_version 862120 (0.0008) [2023-12-28 01:26:55,005][106226] Updated weights for policy 0, policy_version 862130 (0.0011) [2023-12-28 01:26:55,061][106226] Updated weights for policy 0, policy_version 862140 (0.0009) [2023-12-28 01:26:55,115][106226] Updated weights for policy 0, policy_version 862150 (0.0011) [2023-12-28 01:26:55,130][106225] Updated weights for policy 1, policy_version 864100 (0.0008) [2023-12-28 01:26:55,195][106225] Updated weights for policy 1, policy_version 864110 (0.0007) [2023-12-28 01:26:55,254][106225] Updated weights for policy 1, policy_version 864120 (0.0007) [2023-12-28 01:26:55,302][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000008 [2023-12-28 01:26:55,832][106226] Updated weights for policy 0, policy_version 862160 (0.0010) [2023-12-28 01:26:55,861][106225] Updated weights for policy 1, policy_version 864130 (0.0005) [2023-12-28 01:26:55,878][106226] Updated weights for policy 0, policy_version 862170 (0.0010) [2023-12-28 01:26:55,924][106225] Updated weights for policy 1, policy_version 864140 (0.0009) [2023-12-28 01:26:55,925][106226] Updated weights for policy 0, policy_version 862180 (0.0010) [2023-12-28 01:26:55,977][106225] Updated weights for policy 1, policy_version 864150 (0.0010) [2023-12-28 01:26:56,033][106225] Updated weights for policy 1, policy_version 864160 (0.0010) [2023-12-28 01:26:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 442040320. Throughput: 0: 9813.9, 1: 9959.6. Samples: 442003988. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:26:56,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-5.052')] [2023-12-28 01:26:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000864160_221265920.pth... [2023-12-28 01:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000862184_220774400.pth... [2023-12-28 01:26:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000862976_220962816.pth [2023-12-28 01:26:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000861032_220479488.pth [2023-12-28 01:26:56,658][106226] Updated weights for policy 0, policy_version 862190 (0.0011) [2023-12-28 01:26:56,684][106225] Updated weights for policy 1, policy_version 864170 (0.0010) [2023-12-28 01:26:56,712][106226] Updated weights for policy 0, policy_version 862200 (0.0010) [2023-12-28 01:26:56,744][106225] Updated weights for policy 1, policy_version 864180 (0.0010) [2023-12-28 01:26:56,762][106226] Updated weights for policy 0, policy_version 862210 (0.0010) [2023-12-28 01:26:56,790][106225] Updated weights for policy 1, policy_version 864190 (0.0006) [2023-12-28 01:26:57,358][106225] Updated weights for policy 1, policy_version 864200 (0.0009) [2023-12-28 01:26:57,410][106225] Updated weights for policy 1, policy_version 864210 (0.0010) [2023-12-28 01:26:57,454][106225] Updated weights for policy 1, policy_version 864220 (0.0009) [2023-12-28 01:26:57,465][106226] Updated weights for policy 0, policy_version 862220 (0.0008) [2023-12-28 01:26:57,522][106226] Updated weights for policy 0, policy_version 862230 (0.0006) [2023-12-28 01:26:57,578][106226] Updated weights for policy 0, policy_version 862240 (0.0010) [2023-12-28 01:26:58,063][106225] Updated weights for policy 1, policy_version 864230 (0.0005) [2023-12-28 01:26:58,119][106225] Updated weights for policy 1, policy_version 864240 (0.0008) [2023-12-28 01:26:58,172][106226] Updated weights for policy 0, policy_version 862250 (0.0009) [2023-12-28 01:26:58,175][106225] Updated weights for policy 1, policy_version 864250 (0.0009) [2023-12-28 01:26:58,237][106226] Updated weights for policy 0, policy_version 862260 (0.0007) [2023-12-28 01:26:58,305][106226] Updated weights for policy 0, policy_version 862270 (0.0008) [2023-12-28 01:26:58,374][106226] Updated weights for policy 0, policy_version 862280 (0.0008) [2023-12-28 01:26:59,051][106225] Updated weights for policy 1, policy_version 864260 (0.0009) [2023-12-28 01:26:59,109][106225] Updated weights for policy 1, policy_version 864270 (0.0011) [2023-12-28 01:26:59,136][106226] Updated weights for policy 0, policy_version 862290 (0.0006) [2023-12-28 01:26:59,165][106225] Updated weights for policy 1, policy_version 864280 (0.0009) [2023-12-28 01:26:59,192][106226] Updated weights for policy 0, policy_version 862300 (0.0007) [2023-12-28 01:26:59,264][106226] Updated weights for policy 0, policy_version 862310 (0.0009) [2023-12-28 01:27:00,004][106225] Updated weights for policy 1, policy_version 864291 (0.0008) [2023-12-28 01:27:00,035][106226] Updated weights for policy 0, policy_version 862320 (0.0007) [2023-12-28 01:27:00,060][106225] Updated weights for policy 1, policy_version 864301 (0.0007) [2023-12-28 01:27:00,102][106226] Updated weights for policy 0, policy_version 862330 (0.0007) [2023-12-28 01:27:00,112][106225] Updated weights for policy 1, policy_version 864311 (0.0007) [2023-12-28 01:27:00,173][106226] Updated weights for policy 0, policy_version 862340 (0.0008) [2023-12-28 01:27:00,767][106225] Updated weights for policy 1, policy_version 864321 (0.0007) [2023-12-28 01:27:00,814][106225] Updated weights for policy 1, policy_version 864331 (0.0005) [2023-12-28 01:27:00,866][106225] Updated weights for policy 1, policy_version 864341 (0.0005) [2023-12-28 01:27:00,914][106226] Updated weights for policy 0, policy_version 862350 (0.0010) [2023-12-28 01:27:00,920][106225] Updated weights for policy 1, policy_version 864351 (0.0006) [2023-12-28 01:27:00,973][106226] Updated weights for policy 0, policy_version 862360 (0.0009) [2023-12-28 01:27:01,034][106226] Updated weights for policy 0, policy_version 862370 (0.0009) [2023-12-28 01:27:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 442138624. Throughput: 0: 9862.8, 1: 10000.4. Samples: 442124200. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:01,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.976')] [2023-12-28 01:27:01,599][106225] Updated weights for policy 1, policy_version 864361 (0.0008) [2023-12-28 01:27:01,664][106225] Updated weights for policy 1, policy_version 864371 (0.0009) [2023-12-28 01:27:01,737][106225] Updated weights for policy 1, policy_version 864381 (0.0009) [2023-12-28 01:27:01,801][106226] Updated weights for policy 0, policy_version 862380 (0.0008) [2023-12-28 01:27:01,848][106226] Updated weights for policy 0, policy_version 862390 (0.0008) [2023-12-28 01:27:01,905][106226] Updated weights for policy 0, policy_version 862400 (0.0007) [2023-12-28 01:27:02,377][106225] Updated weights for policy 1, policy_version 864391 (0.0008) [2023-12-28 01:27:02,440][106225] Updated weights for policy 1, policy_version 864401 (0.0008) [2023-12-28 01:27:02,492][106225] Updated weights for policy 1, policy_version 864411 (0.0008) [2023-12-28 01:27:02,701][106226] Updated weights for policy 0, policy_version 862410 (0.0009) [2023-12-28 01:27:02,768][106226] Updated weights for policy 0, policy_version 862420 (0.0005) [2023-12-28 01:27:02,823][106226] Updated weights for policy 0, policy_version 862430 (0.0005) [2023-12-28 01:27:02,894][106226] Updated weights for policy 0, policy_version 862440 (0.0005) [2023-12-28 01:27:03,150][106225] Updated weights for policy 1, policy_version 864421 (0.0007) [2023-12-28 01:27:03,212][106225] Updated weights for policy 1, policy_version 864431 (0.0007) [2023-12-28 01:27:03,273][106225] Updated weights for policy 1, policy_version 864441 (0.0011) [2023-12-28 01:27:03,449][106226] Updated weights for policy 0, policy_version 862450 (0.0006) [2023-12-28 01:27:03,504][106226] Updated weights for policy 0, policy_version 862460 (0.0005) [2023-12-28 01:27:03,556][106226] Updated weights for policy 0, policy_version 862470 (0.0006) [2023-12-28 01:27:03,854][106225] Updated weights for policy 1, policy_version 864451 (0.0010) [2023-12-28 01:27:03,919][106225] Updated weights for policy 1, policy_version 864461 (0.0006) [2023-12-28 01:27:03,994][106225] Updated weights for policy 1, policy_version 864471 (0.0006) [2023-12-28 01:27:04,106][106226] Updated weights for policy 0, policy_version 862480 (0.0008) [2023-12-28 01:27:04,169][106226] Updated weights for policy 0, policy_version 862490 (0.0008) [2023-12-28 01:27:04,229][106226] Updated weights for policy 0, policy_version 862500 (0.0009) [2023-12-28 01:27:04,650][106225] Updated weights for policy 1, policy_version 864481 (0.0008) [2023-12-28 01:27:04,706][106225] Updated weights for policy 1, policy_version 864491 (0.0007) [2023-12-28 01:27:04,754][106225] Updated weights for policy 1, policy_version 864501 (0.0008) [2023-12-28 01:27:04,801][106225] Updated weights for policy 1, policy_version 864511 (0.0008) [2023-12-28 01:27:04,968][106226] Updated weights for policy 0, policy_version 862510 (0.0009) [2023-12-28 01:27:05,017][106226] Updated weights for policy 0, policy_version 862520 (0.0008) [2023-12-28 01:27:05,078][106226] Updated weights for policy 0, policy_version 862530 (0.0010) [2023-12-28 01:27:05,490][106225] Updated weights for policy 1, policy_version 864521 (0.0005) [2023-12-28 01:27:05,548][106225] Updated weights for policy 1, policy_version 864531 (0.0005) [2023-12-28 01:27:05,594][106225] Updated weights for policy 1, policy_version 864541 (0.0005) [2023-12-28 01:27:05,866][106226] Updated weights for policy 0, policy_version 862540 (0.0009) [2023-12-28 01:27:05,915][106226] Updated weights for policy 0, policy_version 862550 (0.0009) [2023-12-28 01:27:05,963][106226] Updated weights for policy 0, policy_version 862560 (0.0008) [2023-12-28 01:27:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 442236928. Throughput: 0: 9804.6, 1: 10127.7. Samples: 442245064. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:06,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.820')] [2023-12-28 01:27:06,192][106225] Updated weights for policy 1, policy_version 864551 (0.0007) [2023-12-28 01:27:06,250][106225] Updated weights for policy 1, policy_version 864561 (0.0008) [2023-12-28 01:27:06,308][106225] Updated weights for policy 1, policy_version 864571 (0.0008) [2023-12-28 01:27:06,754][106226] Updated weights for policy 0, policy_version 862570 (0.0009) [2023-12-28 01:27:06,817][106226] Updated weights for policy 0, policy_version 862580 (0.0006) [2023-12-28 01:27:06,868][106226] Updated weights for policy 0, policy_version 862590 (0.0007) [2023-12-28 01:27:06,918][106226] Updated weights for policy 0, policy_version 862600 (0.0007) [2023-12-28 01:27:07,048][106225] Updated weights for policy 1, policy_version 864581 (0.0008) [2023-12-28 01:27:07,104][106225] Updated weights for policy 1, policy_version 864591 (0.0008) [2023-12-28 01:27:07,151][106225] Updated weights for policy 1, policy_version 864601 (0.0006) [2023-12-28 01:27:07,654][106226] Updated weights for policy 0, policy_version 862610 (0.0009) [2023-12-28 01:27:07,698][106225] Updated weights for policy 1, policy_version 864611 (0.0005) [2023-12-28 01:27:07,708][106226] Updated weights for policy 0, policy_version 862620 (0.0008) [2023-12-28 01:27:07,750][106225] Updated weights for policy 1, policy_version 864621 (0.0005) [2023-12-28 01:27:07,756][106226] Updated weights for policy 0, policy_version 862630 (0.0008) [2023-12-28 01:27:07,807][106225] Updated weights for policy 1, policy_version 864631 (0.0006) [2023-12-28 01:27:08,370][106225] Updated weights for policy 1, policy_version 864641 (0.0006) [2023-12-28 01:27:08,440][106225] Updated weights for policy 1, policy_version 864651 (0.0006) [2023-12-28 01:27:08,503][106225] Updated weights for policy 1, policy_version 864661 (0.0008) [2023-12-28 01:27:08,538][106226] Updated weights for policy 0, policy_version 862640 (0.0008) [2023-12-28 01:27:08,564][106225] Updated weights for policy 1, policy_version 864671 (0.0007) [2023-12-28 01:27:08,598][106226] Updated weights for policy 0, policy_version 862650 (0.0007) [2023-12-28 01:27:08,657][106226] Updated weights for policy 0, policy_version 862660 (0.0010) [2023-12-28 01:27:09,168][106225] Updated weights for policy 1, policy_version 864681 (0.0006) [2023-12-28 01:27:09,231][106225] Updated weights for policy 1, policy_version 864691 (0.0007) [2023-12-28 01:27:09,299][106225] Updated weights for policy 1, policy_version 864701 (0.0009) [2023-12-28 01:27:09,408][106226] Updated weights for policy 0, policy_version 862670 (0.0010) [2023-12-28 01:27:09,474][106226] Updated weights for policy 0, policy_version 862680 (0.0011) [2023-12-28 01:27:09,538][106226] Updated weights for policy 0, policy_version 862690 (0.0009) [2023-12-28 01:27:10,067][106225] Updated weights for policy 1, policy_version 864711 (0.0007) [2023-12-28 01:27:10,125][106225] Updated weights for policy 1, policy_version 864721 (0.0008) [2023-12-28 01:27:10,183][106225] Updated weights for policy 1, policy_version 864731 (0.0008) [2023-12-28 01:27:10,292][106226] Updated weights for policy 0, policy_version 862700 (0.0011) [2023-12-28 01:27:10,350][106226] Updated weights for policy 0, policy_version 862710 (0.0011) [2023-12-28 01:27:10,408][106226] Updated weights for policy 0, policy_version 862720 (0.0011) [2023-12-28 01:27:10,927][106225] Updated weights for policy 1, policy_version 864741 (0.0008) [2023-12-28 01:27:10,985][106225] Updated weights for policy 1, policy_version 864751 (0.0007) [2023-12-28 01:27:11,053][106225] Updated weights for policy 1, policy_version 864761 (0.0008) [2023-12-28 01:27:11,147][106226] Updated weights for policy 0, policy_version 862730 (0.0010) [2023-12-28 01:27:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 442335232. Throughput: 0: 9811.1, 1: 10170.7. Samples: 442306108. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:11,176][105115] Avg episode reward: [(0, '-4.164'), (1, '-4.913')] [2023-12-28 01:27:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000864768_221421568.pth... [2023-12-28 01:27:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000863552_221110272.pth [2023-12-28 01:27:11,217][106226] Updated weights for policy 0, policy_version 862740 (0.0008) [2023-12-28 01:27:11,284][106226] Updated weights for policy 0, policy_version 862750 (0.0007) [2023-12-28 01:27:11,337][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000862760_220921856.pth... [2023-12-28 01:27:11,339][106226] Updated weights for policy 0, policy_version 862760 (0.0008) [2023-12-28 01:27:11,343][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000861608_220626944.pth [2023-12-28 01:27:11,868][106225] Updated weights for policy 1, policy_version 864771 (0.0008) [2023-12-28 01:27:11,928][106225] Updated weights for policy 1, policy_version 864781 (0.0008) [2023-12-28 01:27:11,989][106225] Updated weights for policy 1, policy_version 864791 (0.0008) [2023-12-28 01:27:12,027][106226] Updated weights for policy 0, policy_version 862770 (0.0007) [2023-12-28 01:27:12,098][106226] Updated weights for policy 0, policy_version 862780 (0.0008) [2023-12-28 01:27:12,160][106226] Updated weights for policy 0, policy_version 862790 (0.0008) [2023-12-28 01:27:12,715][106225] Updated weights for policy 1, policy_version 864801 (0.0007) [2023-12-28 01:27:12,780][106225] Updated weights for policy 1, policy_version 864811 (0.0009) [2023-12-28 01:27:12,842][106225] Updated weights for policy 1, policy_version 864821 (0.0008) [2023-12-28 01:27:12,892][106226] Updated weights for policy 0, policy_version 862800 (0.0006) [2023-12-28 01:27:12,898][106225] Updated weights for policy 1, policy_version 864831 (0.0007) [2023-12-28 01:27:12,954][106226] Updated weights for policy 0, policy_version 862810 (0.0008) [2023-12-28 01:27:13,011][106226] Updated weights for policy 0, policy_version 862820 (0.0009) [2023-12-28 01:27:13,615][106225] Updated weights for policy 1, policy_version 864841 (0.0005) [2023-12-28 01:27:13,675][106225] Updated weights for policy 1, policy_version 864851 (0.0005) [2023-12-28 01:27:13,733][106225] Updated weights for policy 1, policy_version 864861 (0.0008) [2023-12-28 01:27:13,753][106226] Updated weights for policy 0, policy_version 862830 (0.0007) [2023-12-28 01:27:13,814][106226] Updated weights for policy 0, policy_version 862840 (0.0005) [2023-12-28 01:27:13,879][106226] Updated weights for policy 0, policy_version 862850 (0.0008) [2023-12-28 01:27:14,424][106225] Updated weights for policy 1, policy_version 864871 (0.0008) [2023-12-28 01:27:14,494][106225] Updated weights for policy 1, policy_version 864881 (0.0008) [2023-12-28 01:27:14,542][106225] Updated weights for policy 1, policy_version 864891 (0.0007) [2023-12-28 01:27:14,562][106226] Updated weights for policy 0, policy_version 862860 (0.0008) [2023-12-28 01:27:14,619][106226] Updated weights for policy 0, policy_version 862870 (0.0007) [2023-12-28 01:27:14,667][106226] Updated weights for policy 0, policy_version 862880 (0.0008) [2023-12-28 01:27:15,296][106225] Updated weights for policy 1, policy_version 864901 (0.0007) [2023-12-28 01:27:15,350][106225] Updated weights for policy 1, policy_version 864911 (0.0009) [2023-12-28 01:27:15,412][106225] Updated weights for policy 1, policy_version 864921 (0.0009) [2023-12-28 01:27:15,425][106226] Updated weights for policy 0, policy_version 862890 (0.0009) [2023-12-28 01:27:15,479][106226] Updated weights for policy 0, policy_version 862900 (0.0007) [2023-12-28 01:27:15,533][106226] Updated weights for policy 0, policy_version 862910 (0.0009) [2023-12-28 01:27:15,582][106226] Updated weights for policy 0, policy_version 862920 (0.0008) [2023-12-28 01:27:15,996][106225] Updated weights for policy 1, policy_version 864931 (0.0008) [2023-12-28 01:27:16,052][106225] Updated weights for policy 1, policy_version 864941 (0.0009) [2023-12-28 01:27:16,120][106225] Updated weights for policy 1, policy_version 864951 (0.0010) [2023-12-28 01:27:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 442433536. Throughput: 0: 9733.0, 1: 10037.0. Samples: 442419612. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:16,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.018')] [2023-12-28 01:27:16,366][106226] Updated weights for policy 0, policy_version 862930 (0.0009) [2023-12-28 01:27:16,433][106226] Updated weights for policy 0, policy_version 862940 (0.0009) [2023-12-28 01:27:16,495][106226] Updated weights for policy 0, policy_version 862950 (0.0008) [2023-12-28 01:27:16,701][106225] Updated weights for policy 1, policy_version 864961 (0.0010) [2023-12-28 01:27:16,758][106225] Updated weights for policy 1, policy_version 864971 (0.0005) [2023-12-28 01:27:16,818][106225] Updated weights for policy 1, policy_version 864981 (0.0005) [2023-12-28 01:27:16,879][106225] Updated weights for policy 1, policy_version 864991 (0.0006) [2023-12-28 01:27:17,174][106226] Updated weights for policy 0, policy_version 862960 (0.0009) [2023-12-28 01:27:17,235][106226] Updated weights for policy 0, policy_version 862970 (0.0008) [2023-12-28 01:27:17,291][106226] Updated weights for policy 0, policy_version 862980 (0.0005) [2023-12-28 01:27:17,406][106225] Updated weights for policy 1, policy_version 865001 (0.0006) [2023-12-28 01:27:17,462][106225] Updated weights for policy 1, policy_version 865011 (0.0005) [2023-12-28 01:27:17,517][106225] Updated weights for policy 1, policy_version 865021 (0.0005) [2023-12-28 01:27:17,950][106226] Updated weights for policy 0, policy_version 862990 (0.0007) [2023-12-28 01:27:17,997][106226] Updated weights for policy 0, policy_version 863000 (0.0009) [2023-12-28 01:27:18,046][106226] Updated weights for policy 0, policy_version 863010 (0.0009) [2023-12-28 01:27:18,114][106225] Updated weights for policy 1, policy_version 865031 (0.0007) [2023-12-28 01:27:18,168][106225] Updated weights for policy 1, policy_version 865041 (0.0007) [2023-12-28 01:27:18,217][106225] Updated weights for policy 1, policy_version 865051 (0.0009) [2023-12-28 01:27:18,804][106226] Updated weights for policy 0, policy_version 863020 (0.0010) [2023-12-28 01:27:18,846][106225] Updated weights for policy 1, policy_version 865061 (0.0007) [2023-12-28 01:27:18,863][106226] Updated weights for policy 0, policy_version 863030 (0.0008) [2023-12-28 01:27:18,901][106225] Updated weights for policy 1, policy_version 865071 (0.0005) [2023-12-28 01:27:18,928][106226] Updated weights for policy 0, policy_version 863040 (0.0008) [2023-12-28 01:27:18,961][106225] Updated weights for policy 1, policy_version 865081 (0.0006) [2023-12-28 01:27:19,721][106226] Updated weights for policy 0, policy_version 863050 (0.0008) [2023-12-28 01:27:19,730][106225] Updated weights for policy 1, policy_version 865091 (0.0007) [2023-12-28 01:27:19,781][106226] Updated weights for policy 0, policy_version 863060 (0.0009) [2023-12-28 01:27:19,787][106225] Updated weights for policy 1, policy_version 865101 (0.0008) [2023-12-28 01:27:19,844][106226] Updated weights for policy 0, policy_version 863070 (0.0007) [2023-12-28 01:27:19,851][106225] Updated weights for policy 1, policy_version 865111 (0.0007) [2023-12-28 01:27:19,907][106226] Updated weights for policy 0, policy_version 863080 (0.0006) [2023-12-28 01:27:20,546][106225] Updated weights for policy 1, policy_version 865121 (0.0008) [2023-12-28 01:27:20,619][106225] Updated weights for policy 1, policy_version 865131 (0.0009) [2023-12-28 01:27:20,650][106226] Updated weights for policy 0, policy_version 863090 (0.0008) [2023-12-28 01:27:20,673][106225] Updated weights for policy 1, policy_version 865141 (0.0008) [2023-12-28 01:27:20,714][106226] Updated weights for policy 0, policy_version 863100 (0.0006) [2023-12-28 01:27:20,739][106225] Updated weights for policy 1, policy_version 865151 (0.0010) [2023-12-28 01:27:20,776][106226] Updated weights for policy 0, policy_version 863110 (0.0006) [2023-12-28 01:27:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 442531840. Throughput: 0: 9646.7, 1: 10138.2. Samples: 442541448. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:21,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-4.656')] [2023-12-28 01:27:21,463][106225] Updated weights for policy 1, policy_version 865161 (0.0007) [2023-12-28 01:27:21,511][106226] Updated weights for policy 0, policy_version 863120 (0.0008) [2023-12-28 01:27:21,526][106225] Updated weights for policy 1, policy_version 865171 (0.0005) [2023-12-28 01:27:21,577][106226] Updated weights for policy 0, policy_version 863130 (0.0007) [2023-12-28 01:27:21,586][106225] Updated weights for policy 1, policy_version 865181 (0.0007) [2023-12-28 01:27:21,649][106226] Updated weights for policy 0, policy_version 863140 (0.0008) [2023-12-28 01:27:22,232][106225] Updated weights for policy 1, policy_version 865191 (0.0007) [2023-12-28 01:27:22,297][106225] Updated weights for policy 1, policy_version 865201 (0.0008) [2023-12-28 01:27:22,359][106225] Updated weights for policy 1, policy_version 865211 (0.0009) [2023-12-28 01:27:22,418][106226] Updated weights for policy 0, policy_version 863150 (0.0009) [2023-12-28 01:27:22,478][106226] Updated weights for policy 0, policy_version 863160 (0.0009) [2023-12-28 01:27:22,542][106226] Updated weights for policy 0, policy_version 863170 (0.0009) [2023-12-28 01:27:23,022][106225] Updated weights for policy 1, policy_version 865221 (0.0007) [2023-12-28 01:27:23,085][106225] Updated weights for policy 1, policy_version 865231 (0.0005) [2023-12-28 01:27:23,149][106225] Updated weights for policy 1, policy_version 865241 (0.0005) [2023-12-28 01:27:23,371][106226] Updated weights for policy 0, policy_version 863180 (0.0009) [2023-12-28 01:27:23,428][106226] Updated weights for policy 0, policy_version 863190 (0.0009) [2023-12-28 01:27:23,490][106226] Updated weights for policy 0, policy_version 863200 (0.0009) [2023-12-28 01:27:23,684][106225] Updated weights for policy 1, policy_version 865251 (0.0007) [2023-12-28 01:27:23,734][106225] Updated weights for policy 1, policy_version 865261 (0.0010) [2023-12-28 01:27:23,776][106225] Updated weights for policy 1, policy_version 865271 (0.0010) [2023-12-28 01:27:24,271][106226] Updated weights for policy 0, policy_version 863210 (0.0008) [2023-12-28 01:27:24,332][106226] Updated weights for policy 0, policy_version 863220 (0.0008) [2023-12-28 01:27:24,399][106226] Updated weights for policy 0, policy_version 863230 (0.0008) [2023-12-28 01:27:24,456][106226] Updated weights for policy 0, policy_version 863240 (0.0009) [2023-12-28 01:27:24,502][106225] Updated weights for policy 1, policy_version 865281 (0.0010) [2023-12-28 01:27:24,562][106225] Updated weights for policy 1, policy_version 865291 (0.0008) [2023-12-28 01:27:24,626][106225] Updated weights for policy 1, policy_version 865301 (0.0009) [2023-12-28 01:27:24,687][106225] Updated weights for policy 1, policy_version 865311 (0.0009) [2023-12-28 01:27:25,209][106226] Updated weights for policy 0, policy_version 863250 (0.0009) [2023-12-28 01:27:25,272][106226] Updated weights for policy 0, policy_version 863260 (0.0009) [2023-12-28 01:27:25,334][106225] Updated weights for policy 1, policy_version 865321 (0.0006) [2023-12-28 01:27:25,335][106226] Updated weights for policy 0, policy_version 863270 (0.0009) [2023-12-28 01:27:25,381][106225] Updated weights for policy 1, policy_version 865331 (0.0008) [2023-12-28 01:27:25,431][106225] Updated weights for policy 1, policy_version 865341 (0.0008) [2023-12-28 01:27:26,014][106226] Updated weights for policy 0, policy_version 863280 (0.0008) [2023-12-28 01:27:26,063][106226] Updated weights for policy 0, policy_version 863290 (0.0008) [2023-12-28 01:27:26,112][106226] Updated weights for policy 0, policy_version 863300 (0.0008) [2023-12-28 01:27:26,168][106225] Updated weights for policy 1, policy_version 865351 (0.0008) [2023-12-28 01:27:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 442630144. Throughput: 0: 9547.0, 1: 10211.3. Samples: 442598676. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:26,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.951')] [2023-12-28 01:27:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000863304_221061120.pth... [2023-12-28 01:27:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000862184_220774400.pth [2023-12-28 01:27:26,220][106225] Updated weights for policy 1, policy_version 865361 (0.0008) [2023-12-28 01:27:26,279][106225] Updated weights for policy 1, policy_version 865371 (0.0009) [2023-12-28 01:27:26,306][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000865376_221577216.pth... [2023-12-28 01:27:26,311][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000864160_221265920.pth [2023-12-28 01:27:26,802][106226] Updated weights for policy 0, policy_version 863310 (0.0009) [2023-12-28 01:27:26,862][106226] Updated weights for policy 0, policy_version 863320 (0.0009) [2023-12-28 01:27:26,928][106226] Updated weights for policy 0, policy_version 863330 (0.0008) [2023-12-28 01:27:27,009][106225] Updated weights for policy 1, policy_version 865381 (0.0009) [2023-12-28 01:27:27,067][106225] Updated weights for policy 1, policy_version 865391 (0.0008) [2023-12-28 01:27:27,122][106225] Updated weights for policy 1, policy_version 865401 (0.0008) [2023-12-28 01:27:27,623][106226] Updated weights for policy 0, policy_version 863340 (0.0008) [2023-12-28 01:27:27,669][106226] Updated weights for policy 0, policy_version 863350 (0.0005) [2023-12-28 01:27:27,717][106225] Updated weights for policy 1, policy_version 865411 (0.0008) [2023-12-28 01:27:27,724][106226] Updated weights for policy 0, policy_version 863360 (0.0005) [2023-12-28 01:27:27,764][106225] Updated weights for policy 1, policy_version 865421 (0.0006) [2023-12-28 01:27:27,806][106225] Updated weights for policy 1, policy_version 865431 (0.0007) [2023-12-28 01:27:28,294][106226] Updated weights for policy 0, policy_version 863370 (0.0007) [2023-12-28 01:27:28,359][106226] Updated weights for policy 0, policy_version 863380 (0.0007) [2023-12-28 01:27:28,416][106226] Updated weights for policy 0, policy_version 863390 (0.0009) [2023-12-28 01:27:28,471][106226] Updated weights for policy 0, policy_version 863400 (0.0009) [2023-12-28 01:27:28,553][106225] Updated weights for policy 1, policy_version 865441 (0.0007) [2023-12-28 01:27:28,608][106225] Updated weights for policy 1, policy_version 865451 (0.0005) [2023-12-28 01:27:28,670][106225] Updated weights for policy 1, policy_version 865461 (0.0006) [2023-12-28 01:27:28,727][106225] Updated weights for policy 1, policy_version 865471 (0.0008) [2023-12-28 01:27:29,172][106226] Updated weights for policy 0, policy_version 863410 (0.0010) [2023-12-28 01:27:29,229][106226] Updated weights for policy 0, policy_version 863420 (0.0009) [2023-12-28 01:27:29,301][106226] Updated weights for policy 0, policy_version 863430 (0.0006) [2023-12-28 01:27:29,413][106225] Updated weights for policy 1, policy_version 865481 (0.0008) [2023-12-28 01:27:29,477][106225] Updated weights for policy 1, policy_version 865491 (0.0008) [2023-12-28 01:27:29,540][106225] Updated weights for policy 1, policy_version 865501 (0.0008) [2023-12-28 01:27:30,032][106226] Updated weights for policy 0, policy_version 863440 (0.0007) [2023-12-28 01:27:30,089][106226] Updated weights for policy 0, policy_version 863450 (0.0007) [2023-12-28 01:27:30,146][106226] Updated weights for policy 0, policy_version 863460 (0.0008) [2023-12-28 01:27:30,271][106225] Updated weights for policy 1, policy_version 865511 (0.0009) [2023-12-28 01:27:30,331][106225] Updated weights for policy 1, policy_version 865521 (0.0009) [2023-12-28 01:27:30,390][106225] Updated weights for policy 1, policy_version 865531 (0.0008) [2023-12-28 01:27:30,861][106226] Updated weights for policy 0, policy_version 863470 (0.0008) [2023-12-28 01:27:30,919][106226] Updated weights for policy 0, policy_version 863480 (0.0008) [2023-12-28 01:27:30,974][106226] Updated weights for policy 0, policy_version 863490 (0.0008) [2023-12-28 01:27:31,134][106225] Updated weights for policy 1, policy_version 865541 (0.0009) [2023-12-28 01:27:31,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 442728448. Throughput: 0: 9616.5, 1: 10251.7. Samples: 442718536. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:31,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.784')] [2023-12-28 01:27:31,201][106225] Updated weights for policy 1, policy_version 865551 (0.0009) [2023-12-28 01:27:31,264][106225] Updated weights for policy 1, policy_version 865561 (0.0008) [2023-12-28 01:27:31,706][106226] Updated weights for policy 0, policy_version 863500 (0.0009) [2023-12-28 01:27:31,770][106226] Updated weights for policy 0, policy_version 863510 (0.0008) [2023-12-28 01:27:31,825][106226] Updated weights for policy 0, policy_version 863520 (0.0009) [2023-12-28 01:27:32,020][106225] Updated weights for policy 1, policy_version 865571 (0.0007) [2023-12-28 01:27:32,076][106225] Updated weights for policy 1, policy_version 865581 (0.0006) [2023-12-28 01:27:32,137][106225] Updated weights for policy 1, policy_version 865591 (0.0005) [2023-12-28 01:27:32,541][106226] Updated weights for policy 0, policy_version 863530 (0.0009) [2023-12-28 01:27:32,605][106226] Updated weights for policy 0, policy_version 863540 (0.0008) [2023-12-28 01:27:32,668][106226] Updated weights for policy 0, policy_version 863550 (0.0009) [2023-12-28 01:27:32,730][106226] Updated weights for policy 0, policy_version 863560 (0.0008) [2023-12-28 01:27:32,794][106225] Updated weights for policy 1, policy_version 865601 (0.0006) [2023-12-28 01:27:32,849][106225] Updated weights for policy 1, policy_version 865611 (0.0009) [2023-12-28 01:27:32,906][106225] Updated weights for policy 1, policy_version 865621 (0.0009) [2023-12-28 01:27:32,964][106225] Updated weights for policy 1, policy_version 865631 (0.0008) [2023-12-28 01:27:33,420][106226] Updated weights for policy 0, policy_version 863570 (0.0008) [2023-12-28 01:27:33,476][106226] Updated weights for policy 0, policy_version 863580 (0.0008) [2023-12-28 01:27:33,530][106226] Updated weights for policy 0, policy_version 863590 (0.0008) [2023-12-28 01:27:33,689][106225] Updated weights for policy 1, policy_version 865641 (0.0008) [2023-12-28 01:27:33,742][106225] Updated weights for policy 1, policy_version 865651 (0.0008) [2023-12-28 01:27:33,788][106225] Updated weights for policy 1, policy_version 865661 (0.0008) [2023-12-28 01:27:34,255][106226] Updated weights for policy 0, policy_version 863600 (0.0008) [2023-12-28 01:27:34,307][106226] Updated weights for policy 0, policy_version 863610 (0.0008) [2023-12-28 01:27:34,360][106226] Updated weights for policy 0, policy_version 863620 (0.0008) [2023-12-28 01:27:34,576][106225] Updated weights for policy 1, policy_version 865671 (0.0009) [2023-12-28 01:27:34,642][106225] Updated weights for policy 1, policy_version 865681 (0.0009) [2023-12-28 01:27:34,702][106225] Updated weights for policy 1, policy_version 865691 (0.0008) [2023-12-28 01:27:35,120][106226] Updated weights for policy 0, policy_version 863630 (0.0008) [2023-12-28 01:27:35,176][106226] Updated weights for policy 0, policy_version 863640 (0.0008) [2023-12-28 01:27:35,230][106226] Updated weights for policy 0, policy_version 863650 (0.0008) [2023-12-28 01:27:35,413][106225] Updated weights for policy 1, policy_version 865701 (0.0010) [2023-12-28 01:27:35,462][106225] Updated weights for policy 1, policy_version 865711 (0.0010) [2023-12-28 01:27:35,511][106225] Updated weights for policy 1, policy_version 865721 (0.0010) [2023-12-28 01:27:35,956][106226] Updated weights for policy 0, policy_version 863660 (0.0008) [2023-12-28 01:27:36,029][106226] Updated weights for policy 0, policy_version 863670 (0.0008) [2023-12-28 01:27:36,084][106226] Updated weights for policy 0, policy_version 863680 (0.0008) [2023-12-28 01:27:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 442826752. Throughput: 0: 9612.4, 1: 10171.7. Samples: 442833752. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:36,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.970')] [2023-12-28 01:27:36,190][106225] Updated weights for policy 1, policy_version 865731 (0.0010) [2023-12-28 01:27:36,247][106225] Updated weights for policy 1, policy_version 865741 (0.0010) [2023-12-28 01:27:36,302][106225] Updated weights for policy 1, policy_version 865751 (0.0010) [2023-12-28 01:27:36,839][106226] Updated weights for policy 0, policy_version 863690 (0.0008) [2023-12-28 01:27:36,887][106226] Updated weights for policy 0, policy_version 863700 (0.0008) [2023-12-28 01:27:36,944][106226] Updated weights for policy 0, policy_version 863710 (0.0009) [2023-12-28 01:27:37,006][106226] Updated weights for policy 0, policy_version 863720 (0.0010) [2023-12-28 01:27:37,021][106225] Updated weights for policy 1, policy_version 865761 (0.0010) [2023-12-28 01:27:37,072][106225] Updated weights for policy 1, policy_version 865771 (0.0009) [2023-12-28 01:27:37,125][106225] Updated weights for policy 1, policy_version 865781 (0.0008) [2023-12-28 01:27:37,177][106225] Updated weights for policy 1, policy_version 865791 (0.0005) [2023-12-28 01:27:37,713][106225] Updated weights for policy 1, policy_version 865801 (0.0010) [2023-12-28 01:27:37,770][106225] Updated weights for policy 1, policy_version 865811 (0.0010) [2023-12-28 01:27:37,832][106225] Updated weights for policy 1, policy_version 865821 (0.0011) [2023-12-28 01:27:37,860][106226] Updated weights for policy 0, policy_version 863730 (0.0006) [2023-12-28 01:27:37,925][106226] Updated weights for policy 0, policy_version 863740 (0.0007) [2023-12-28 01:27:37,981][106226] Updated weights for policy 0, policy_version 863750 (0.0005) [2023-12-28 01:27:38,539][106225] Updated weights for policy 1, policy_version 865831 (0.0010) [2023-12-28 01:27:38,596][106225] Updated weights for policy 1, policy_version 865841 (0.0011) [2023-12-28 01:27:38,657][106225] Updated weights for policy 1, policy_version 865851 (0.0010) [2023-12-28 01:27:38,679][106226] Updated weights for policy 0, policy_version 863760 (0.0006) [2023-12-28 01:27:38,737][106226] Updated weights for policy 0, policy_version 863770 (0.0008) [2023-12-28 01:27:38,796][106226] Updated weights for policy 0, policy_version 863780 (0.0008) [2023-12-28 01:27:39,385][106225] Updated weights for policy 1, policy_version 865861 (0.0010) [2023-12-28 01:27:39,455][106225] Updated weights for policy 1, policy_version 865871 (0.0008) [2023-12-28 01:27:39,520][106225] Updated weights for policy 1, policy_version 865881 (0.0010) [2023-12-28 01:27:39,534][106226] Updated weights for policy 0, policy_version 863790 (0.0007) [2023-12-28 01:27:39,590][106226] Updated weights for policy 0, policy_version 863800 (0.0007) [2023-12-28 01:27:39,645][106226] Updated weights for policy 0, policy_version 863810 (0.0008) [2023-12-28 01:27:40,293][106225] Updated weights for policy 1, policy_version 865891 (0.0009) [2023-12-28 01:27:40,357][106225] Updated weights for policy 1, policy_version 865901 (0.0007) [2023-12-28 01:27:40,377][106226] Updated weights for policy 0, policy_version 863820 (0.0008) [2023-12-28 01:27:40,422][106225] Updated weights for policy 1, policy_version 865911 (0.0010) [2023-12-28 01:27:40,438][106226] Updated weights for policy 0, policy_version 863830 (0.0008) [2023-12-28 01:27:40,490][106226] Updated weights for policy 0, policy_version 863840 (0.0006) [2023-12-28 01:27:41,120][106225] Updated weights for policy 1, policy_version 865921 (0.0009) [2023-12-28 01:27:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 442916864. Throughput: 0: 9576.2, 1: 10168.7. Samples: 442892504. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:41,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.941')] [2023-12-28 01:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000863848_221200384.pth... [2023-12-28 01:27:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000862760_220921856.pth [2023-12-28 01:27:41,191][106225] Updated weights for policy 1, policy_version 865931 (0.0009) [2023-12-28 01:27:41,257][106225] Updated weights for policy 1, policy_version 865941 (0.0009) [2023-12-28 01:27:41,277][106226] Updated weights for policy 0, policy_version 863850 (0.0007) [2023-12-28 01:27:41,322][106225] Updated weights for policy 1, policy_version 865951 (0.0008) [2023-12-28 01:27:41,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000865952_221724672.pth... [2023-12-28 01:27:41,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000864768_221421568.pth [2023-12-28 01:27:41,343][106226] Updated weights for policy 0, policy_version 863860 (0.0007) [2023-12-28 01:27:41,416][106226] Updated weights for policy 0, policy_version 863870 (0.0009) [2023-12-28 01:27:41,485][106226] Updated weights for policy 0, policy_version 863880 (0.0008) [2023-12-28 01:27:42,132][106226] Updated weights for policy 0, policy_version 863890 (0.0006) [2023-12-28 01:27:42,164][106225] Updated weights for policy 1, policy_version 865961 (0.0008) [2023-12-28 01:27:42,180][106226] Updated weights for policy 0, policy_version 863900 (0.0005) [2023-12-28 01:27:42,228][106225] Updated weights for policy 1, policy_version 865971 (0.0008) [2023-12-28 01:27:42,241][106226] Updated weights for policy 0, policy_version 863910 (0.0006) [2023-12-28 01:27:42,293][106225] Updated weights for policy 1, policy_version 865981 (0.0009) [2023-12-28 01:27:42,951][106226] Updated weights for policy 0, policy_version 863920 (0.0008) [2023-12-28 01:27:43,000][106226] Updated weights for policy 0, policy_version 863930 (0.0007) [2023-12-28 01:27:43,047][106225] Updated weights for policy 1, policy_version 865991 (0.0008) [2023-12-28 01:27:43,058][106226] Updated weights for policy 0, policy_version 863940 (0.0006) [2023-12-28 01:27:43,102][106225] Updated weights for policy 1, policy_version 866001 (0.0008) [2023-12-28 01:27:43,166][106225] Updated weights for policy 1, policy_version 866011 (0.0009) [2023-12-28 01:27:43,665][106226] Updated weights for policy 0, policy_version 863950 (0.0007) [2023-12-28 01:27:43,725][106226] Updated weights for policy 0, policy_version 863960 (0.0008) [2023-12-28 01:27:43,785][106226] Updated weights for policy 0, policy_version 863970 (0.0008) [2023-12-28 01:27:43,917][106225] Updated weights for policy 1, policy_version 866021 (0.0010) [2023-12-28 01:27:43,980][106225] Updated weights for policy 1, policy_version 866031 (0.0009) [2023-12-28 01:27:44,050][106225] Updated weights for policy 1, policy_version 866041 (0.0008) [2023-12-28 01:27:44,439][106226] Updated weights for policy 0, policy_version 863980 (0.0008) [2023-12-28 01:27:44,491][106226] Updated weights for policy 0, policy_version 863990 (0.0008) [2023-12-28 01:27:44,546][106226] Updated weights for policy 0, policy_version 864000 (0.0008) [2023-12-28 01:27:44,770][106225] Updated weights for policy 1, policy_version 866051 (0.0008) [2023-12-28 01:27:44,832][106225] Updated weights for policy 1, policy_version 866061 (0.0009) [2023-12-28 01:27:44,895][106225] Updated weights for policy 1, policy_version 866071 (0.0010) [2023-12-28 01:27:45,261][106226] Updated weights for policy 0, policy_version 864010 (0.0007) [2023-12-28 01:27:45,328][106226] Updated weights for policy 0, policy_version 864020 (0.0006) [2023-12-28 01:27:45,393][106226] Updated weights for policy 0, policy_version 864030 (0.0008) [2023-12-28 01:27:45,450][106226] Updated weights for policy 0, policy_version 864040 (0.0009) [2023-12-28 01:27:45,682][106225] Updated weights for policy 1, policy_version 866081 (0.0009) [2023-12-28 01:27:45,747][106225] Updated weights for policy 1, policy_version 866091 (0.0008) [2023-12-28 01:27:45,810][106225] Updated weights for policy 1, policy_version 866101 (0.0009) [2023-12-28 01:27:45,875][106225] Updated weights for policy 1, policy_version 866111 (0.0008) [2023-12-28 01:27:46,085][106226] Updated weights for policy 0, policy_version 864050 (0.0008) [2023-12-28 01:27:46,133][106226] Updated weights for policy 0, policy_version 864060 (0.0008) [2023-12-28 01:27:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 443015168. Throughput: 0: 9570.4, 1: 10054.7. Samples: 443007328. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:46,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.884')] [2023-12-28 01:27:46,182][106226] Updated weights for policy 0, policy_version 864070 (0.0008) [2023-12-28 01:27:46,589][106225] Updated weights for policy 1, policy_version 866121 (0.0009) [2023-12-28 01:27:46,640][106225] Updated weights for policy 1, policy_version 866131 (0.0009) [2023-12-28 01:27:46,700][106225] Updated weights for policy 1, policy_version 866141 (0.0009) [2023-12-28 01:27:46,877][106226] Updated weights for policy 0, policy_version 864080 (0.0008) [2023-12-28 01:27:46,932][106226] Updated weights for policy 0, policy_version 864090 (0.0008) [2023-12-28 01:27:46,993][106226] Updated weights for policy 0, policy_version 864100 (0.0009) [2023-12-28 01:27:47,438][106225] Updated weights for policy 1, policy_version 866151 (0.0009) [2023-12-28 01:27:47,499][106225] Updated weights for policy 1, policy_version 866161 (0.0008) [2023-12-28 01:27:47,556][106225] Updated weights for policy 1, policy_version 866171 (0.0008) [2023-12-28 01:27:47,729][106226] Updated weights for policy 0, policy_version 864110 (0.0008) [2023-12-28 01:27:47,791][106226] Updated weights for policy 0, policy_version 864120 (0.0007) [2023-12-28 01:27:47,842][106226] Updated weights for policy 0, policy_version 864130 (0.0008) [2023-12-28 01:27:48,180][106225] Updated weights for policy 1, policy_version 866181 (0.0009) [2023-12-28 01:27:48,242][106225] Updated weights for policy 1, policy_version 866191 (0.0009) [2023-12-28 01:27:48,307][106225] Updated weights for policy 1, policy_version 866201 (0.0007) [2023-12-28 01:27:48,565][106226] Updated weights for policy 0, policy_version 864140 (0.0006) [2023-12-28 01:27:48,629][106226] Updated weights for policy 0, policy_version 864150 (0.0006) [2023-12-28 01:27:48,693][106226] Updated weights for policy 0, policy_version 864160 (0.0008) [2023-12-28 01:27:48,990][106225] Updated weights for policy 1, policy_version 866211 (0.0008) [2023-12-28 01:27:49,053][106225] Updated weights for policy 1, policy_version 866221 (0.0005) [2023-12-28 01:27:49,115][106225] Updated weights for policy 1, policy_version 866231 (0.0005) [2023-12-28 01:27:49,438][106226] Updated weights for policy 0, policy_version 864170 (0.0008) [2023-12-28 01:27:49,499][106226] Updated weights for policy 0, policy_version 864180 (0.0009) [2023-12-28 01:27:49,561][106226] Updated weights for policy 0, policy_version 864190 (0.0009) [2023-12-28 01:27:49,622][106226] Updated weights for policy 0, policy_version 864200 (0.0008) [2023-12-28 01:27:49,658][106225] Updated weights for policy 1, policy_version 866241 (0.0005) [2023-12-28 01:27:49,717][106225] Updated weights for policy 1, policy_version 866251 (0.0009) [2023-12-28 01:27:49,782][106225] Updated weights for policy 1, policy_version 866261 (0.0009) [2023-12-28 01:27:49,846][106225] Updated weights for policy 1, policy_version 866271 (0.0007) [2023-12-28 01:27:50,398][106226] Updated weights for policy 0, policy_version 864210 (0.0005) [2023-12-28 01:27:50,458][106226] Updated weights for policy 0, policy_version 864220 (0.0009) [2023-12-28 01:27:50,514][106226] Updated weights for policy 0, policy_version 864230 (0.0008) [2023-12-28 01:27:50,545][106225] Updated weights for policy 1, policy_version 866281 (0.0010) [2023-12-28 01:27:50,610][106225] Updated weights for policy 1, policy_version 866291 (0.0008) [2023-12-28 01:27:50,667][106225] Updated weights for policy 1, policy_version 866301 (0.0007) [2023-12-28 01:27:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 443113472. Throughput: 0: 9557.8, 1: 9972.4. Samples: 443123924. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:51,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-5.042')] [2023-12-28 01:27:51,303][106225] Updated weights for policy 1, policy_version 866311 (0.0007) [2023-12-28 01:27:51,322][106226] Updated weights for policy 0, policy_version 864240 (0.0008) [2023-12-28 01:27:51,366][106225] Updated weights for policy 1, policy_version 866321 (0.0008) [2023-12-28 01:27:51,388][106226] Updated weights for policy 0, policy_version 864250 (0.0008) [2023-12-28 01:27:51,437][106225] Updated weights for policy 1, policy_version 866331 (0.0007) [2023-12-28 01:27:51,457][106226] Updated weights for policy 0, policy_version 864260 (0.0009) [2023-12-28 01:27:52,085][106225] Updated weights for policy 1, policy_version 866341 (0.0008) [2023-12-28 01:27:52,147][106225] Updated weights for policy 1, policy_version 866351 (0.0009) [2023-12-28 01:27:52,206][106225] Updated weights for policy 1, policy_version 866361 (0.0008) [2023-12-28 01:27:52,229][106226] Updated weights for policy 0, policy_version 864270 (0.0007) [2023-12-28 01:27:52,292][106226] Updated weights for policy 0, policy_version 864280 (0.0008) [2023-12-28 01:27:52,358][106226] Updated weights for policy 0, policy_version 864290 (0.0007) [2023-12-28 01:27:52,958][106225] Updated weights for policy 1, policy_version 866371 (0.0008) [2023-12-28 01:27:53,017][106225] Updated weights for policy 1, policy_version 866381 (0.0008) [2023-12-28 01:27:53,076][106225] Updated weights for policy 1, policy_version 866391 (0.0008) [2023-12-28 01:27:53,097][106226] Updated weights for policy 0, policy_version 864300 (0.0006) [2023-12-28 01:27:53,158][106226] Updated weights for policy 0, policy_version 864310 (0.0007) [2023-12-28 01:27:53,219][106226] Updated weights for policy 0, policy_version 864320 (0.0008) [2023-12-28 01:27:53,798][106225] Updated weights for policy 1, policy_version 866401 (0.0009) [2023-12-28 01:27:53,861][106225] Updated weights for policy 1, policy_version 866411 (0.0009) [2023-12-28 01:27:53,912][106225] Updated weights for policy 1, policy_version 866421 (0.0008) [2023-12-28 01:27:53,926][106226] Updated weights for policy 0, policy_version 864330 (0.0008) [2023-12-28 01:27:53,962][106225] Updated weights for policy 1, policy_version 866431 (0.0006) [2023-12-28 01:27:53,986][106226] Updated weights for policy 0, policy_version 864340 (0.0008) [2023-12-28 01:27:54,045][106226] Updated weights for policy 0, policy_version 864350 (0.0008) [2023-12-28 01:27:54,097][106226] Updated weights for policy 0, policy_version 864360 (0.0008) [2023-12-28 01:27:54,733][106225] Updated weights for policy 1, policy_version 866441 (0.0011) [2023-12-28 01:27:54,799][106225] Updated weights for policy 1, policy_version 866451 (0.0011) [2023-12-28 01:27:54,817][106226] Updated weights for policy 0, policy_version 864370 (0.0006) [2023-12-28 01:27:54,856][106225] Updated weights for policy 1, policy_version 866461 (0.0010) [2023-12-28 01:27:54,878][106226] Updated weights for policy 0, policy_version 864380 (0.0006) [2023-12-28 01:27:54,937][106226] Updated weights for policy 0, policy_version 864390 (0.0008) [2023-12-28 01:27:55,556][106225] Updated weights for policy 1, policy_version 866471 (0.0007) [2023-12-28 01:27:55,615][106225] Updated weights for policy 1, policy_version 866481 (0.0006) [2023-12-28 01:27:55,654][106226] Updated weights for policy 0, policy_version 864400 (0.0009) [2023-12-28 01:27:55,662][106225] Updated weights for policy 1, policy_version 866491 (0.0005) [2023-12-28 01:27:55,710][106226] Updated weights for policy 0, policy_version 864410 (0.0010) [2023-12-28 01:27:55,779][106226] Updated weights for policy 0, policy_version 864420 (0.0010) [2023-12-28 01:27:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 443211776. Throughput: 0: 9551.5, 1: 9914.1. Samples: 443182056. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:27:56,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.764')] [2023-12-28 01:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000866496_221863936.pth... [2023-12-28 01:27:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000864424_221347840.pth... [2023-12-28 01:27:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000865376_221577216.pth [2023-12-28 01:27:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000863304_221061120.pth [2023-12-28 01:27:56,251][106225] Updated weights for policy 1, policy_version 866501 (0.0007) [2023-12-28 01:27:56,316][106225] Updated weights for policy 1, policy_version 866511 (0.0006) [2023-12-28 01:27:56,376][106225] Updated weights for policy 1, policy_version 866521 (0.0009) [2023-12-28 01:27:56,437][106226] Updated weights for policy 0, policy_version 864430 (0.0009) [2023-12-28 01:27:56,491][106226] Updated weights for policy 0, policy_version 864440 (0.0008) [2023-12-28 01:27:56,538][106226] Updated weights for policy 0, policy_version 864450 (0.0008) [2023-12-28 01:27:56,918][106225] Updated weights for policy 1, policy_version 866531 (0.0006) [2023-12-28 01:27:56,983][106225] Updated weights for policy 1, policy_version 866541 (0.0007) [2023-12-28 01:27:57,043][106225] Updated weights for policy 1, policy_version 866551 (0.0005) [2023-12-28 01:27:57,297][106226] Updated weights for policy 0, policy_version 864460 (0.0008) [2023-12-28 01:27:57,359][106226] Updated weights for policy 0, policy_version 864470 (0.0009) [2023-12-28 01:27:57,427][106226] Updated weights for policy 0, policy_version 864480 (0.0009) [2023-12-28 01:27:57,607][106225] Updated weights for policy 1, policy_version 866561 (0.0005) [2023-12-28 01:27:57,661][106225] Updated weights for policy 1, policy_version 866571 (0.0005) [2023-12-28 01:27:57,721][106225] Updated weights for policy 1, policy_version 866581 (0.0005) [2023-12-28 01:27:57,780][106225] Updated weights for policy 1, policy_version 866591 (0.0005) [2023-12-28 01:27:58,183][106226] Updated weights for policy 0, policy_version 864490 (0.0010) [2023-12-28 01:27:58,248][106226] Updated weights for policy 0, policy_version 864500 (0.0009) [2023-12-28 01:27:58,303][106226] Updated weights for policy 0, policy_version 864510 (0.0008) [2023-12-28 01:27:58,383][106226] Updated weights for policy 0, policy_version 864520 (0.0009) [2023-12-28 01:27:58,419][106225] Updated weights for policy 1, policy_version 866601 (0.0009) [2023-12-28 01:27:58,486][106225] Updated weights for policy 1, policy_version 866611 (0.0008) [2023-12-28 01:27:58,545][106225] Updated weights for policy 1, policy_version 866621 (0.0008) [2023-12-28 01:27:59,215][106226] Updated weights for policy 0, policy_version 864530 (0.0008) [2023-12-28 01:27:59,287][106226] Updated weights for policy 0, policy_version 864540 (0.0008) [2023-12-28 01:27:59,331][106225] Updated weights for policy 1, policy_version 866631 (0.0008) [2023-12-28 01:27:59,352][106226] Updated weights for policy 0, policy_version 864550 (0.0008) [2023-12-28 01:27:59,393][106225] Updated weights for policy 1, policy_version 866641 (0.0009) [2023-12-28 01:27:59,451][106225] Updated weights for policy 1, policy_version 866651 (0.0008) [2023-12-28 01:28:00,097][106226] Updated weights for policy 0, policy_version 864560 (0.0008) [2023-12-28 01:28:00,152][106225] Updated weights for policy 1, policy_version 866661 (0.0008) [2023-12-28 01:28:00,155][106226] Updated weights for policy 0, policy_version 864570 (0.0009) [2023-12-28 01:28:00,214][106226] Updated weights for policy 0, policy_version 864580 (0.0006) [2023-12-28 01:28:00,219][106225] Updated weights for policy 1, policy_version 866671 (0.0006) [2023-12-28 01:28:00,281][106225] Updated weights for policy 1, policy_version 866681 (0.0006) [2023-12-28 01:28:00,914][106226] Updated weights for policy 0, policy_version 864590 (0.0007) [2023-12-28 01:28:00,927][106225] Updated weights for policy 1, policy_version 866691 (0.0006) [2023-12-28 01:28:00,968][106226] Updated weights for policy 0, policy_version 864600 (0.0008) [2023-12-28 01:28:00,984][106225] Updated weights for policy 1, policy_version 866701 (0.0006) [2023-12-28 01:28:01,051][106226] Updated weights for policy 0, policy_version 864612 (0.0008) [2023-12-28 01:28:01,053][106225] Updated weights for policy 1, policy_version 866711 (0.0008) [2023-12-28 01:28:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 443318272. Throughput: 0: 9554.8, 1: 10026.1. Samples: 443300756. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:01,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.984')] [2023-12-28 01:28:01,833][106225] Updated weights for policy 1, policy_version 866721 (0.0008) [2023-12-28 01:28:01,843][106226] Updated weights for policy 0, policy_version 864622 (0.0006) [2023-12-28 01:28:01,894][106225] Updated weights for policy 1, policy_version 866731 (0.0009) [2023-12-28 01:28:01,903][106226] Updated weights for policy 0, policy_version 864632 (0.0005) [2023-12-28 01:28:01,953][106225] Updated weights for policy 1, policy_version 866741 (0.0008) [2023-12-28 01:28:01,964][106226] Updated weights for policy 0, policy_version 864642 (0.0006) [2023-12-28 01:28:02,016][106225] Updated weights for policy 1, policy_version 866751 (0.0008) [2023-12-28 01:28:02,568][106226] Updated weights for policy 0, policy_version 864652 (0.0008) [2023-12-28 01:28:02,622][106226] Updated weights for policy 0, policy_version 864662 (0.0008) [2023-12-28 01:28:02,676][106226] Updated weights for policy 0, policy_version 864672 (0.0005) [2023-12-28 01:28:02,801][106225] Updated weights for policy 1, policy_version 866761 (0.0008) [2023-12-28 01:28:02,855][106225] Updated weights for policy 1, policy_version 866771 (0.0008) [2023-12-28 01:28:02,901][106225] Updated weights for policy 1, policy_version 866781 (0.0008) [2023-12-28 01:28:03,368][106226] Updated weights for policy 0, policy_version 864682 (0.0008) [2023-12-28 01:28:03,419][106226] Updated weights for policy 0, policy_version 864692 (0.0005) [2023-12-28 01:28:03,472][106226] Updated weights for policy 0, policy_version 864702 (0.0005) [2023-12-28 01:28:03,529][106226] Updated weights for policy 0, policy_version 864712 (0.0006) [2023-12-28 01:28:03,636][106225] Updated weights for policy 1, policy_version 866791 (0.0006) [2023-12-28 01:28:03,684][106225] Updated weights for policy 1, policy_version 866801 (0.0009) [2023-12-28 01:28:03,732][106225] Updated weights for policy 1, policy_version 866811 (0.0008) [2023-12-28 01:28:04,168][106226] Updated weights for policy 0, policy_version 864722 (0.0009) [2023-12-28 01:28:04,234][106226] Updated weights for policy 0, policy_version 864732 (0.0009) [2023-12-28 01:28:04,298][106226] Updated weights for policy 0, policy_version 864742 (0.0009) [2023-12-28 01:28:04,435][106225] Updated weights for policy 1, policy_version 866821 (0.0010) [2023-12-28 01:28:04,492][106225] Updated weights for policy 1, policy_version 866831 (0.0007) [2023-12-28 01:28:04,552][106225] Updated weights for policy 1, policy_version 866841 (0.0008) [2023-12-28 01:28:04,942][106226] Updated weights for policy 0, policy_version 864752 (0.0009) [2023-12-28 01:28:04,999][106226] Updated weights for policy 0, policy_version 864762 (0.0008) [2023-12-28 01:28:05,058][106226] Updated weights for policy 0, policy_version 864772 (0.0009) [2023-12-28 01:28:05,317][106225] Updated weights for policy 1, policy_version 866851 (0.0008) [2023-12-28 01:28:05,371][106225] Updated weights for policy 1, policy_version 866861 (0.0008) [2023-12-28 01:28:05,423][106225] Updated weights for policy 1, policy_version 866871 (0.0008) [2023-12-28 01:28:05,788][106226] Updated weights for policy 0, policy_version 864782 (0.0008) [2023-12-28 01:28:05,837][106226] Updated weights for policy 0, policy_version 864792 (0.0008) [2023-12-28 01:28:05,889][106226] Updated weights for policy 0, policy_version 864802 (0.0009) [2023-12-28 01:28:06,105][106225] Updated weights for policy 1, policy_version 866881 (0.0008) [2023-12-28 01:28:06,171][106225] Updated weights for policy 1, policy_version 866891 (0.0008) [2023-12-28 01:28:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 443408384. Throughput: 0: 9611.9, 1: 9884.0. Samples: 443418764. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:06,176][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.788')] [2023-12-28 01:28:06,226][106225] Updated weights for policy 1, policy_version 866901 (0.0008) [2023-12-28 01:28:06,291][106225] Updated weights for policy 1, policy_version 866911 (0.0008) [2023-12-28 01:28:06,668][106226] Updated weights for policy 0, policy_version 864812 (0.0009) [2023-12-28 01:28:06,729][106226] Updated weights for policy 0, policy_version 864822 (0.0009) [2023-12-28 01:28:06,792][106226] Updated weights for policy 0, policy_version 864832 (0.0008) [2023-12-28 01:28:06,977][106225] Updated weights for policy 1, policy_version 866921 (0.0008) [2023-12-28 01:28:07,036][106225] Updated weights for policy 1, policy_version 866931 (0.0008) [2023-12-28 01:28:07,099][106225] Updated weights for policy 1, policy_version 866941 (0.0008) [2023-12-28 01:28:07,514][106226] Updated weights for policy 0, policy_version 864842 (0.0009) [2023-12-28 01:28:07,571][106226] Updated weights for policy 0, policy_version 864852 (0.0007) [2023-12-28 01:28:07,635][106226] Updated weights for policy 0, policy_version 864862 (0.0006) [2023-12-28 01:28:07,707][106226] Updated weights for policy 0, policy_version 864872 (0.0006) [2023-12-28 01:28:07,829][106225] Updated weights for policy 1, policy_version 866951 (0.0007) [2023-12-28 01:28:07,887][106225] Updated weights for policy 1, policy_version 866961 (0.0009) [2023-12-28 01:28:07,945][106225] Updated weights for policy 1, policy_version 866971 (0.0009) [2023-12-28 01:28:08,249][106226] Updated weights for policy 0, policy_version 864882 (0.0006) [2023-12-28 01:28:08,309][106226] Updated weights for policy 0, policy_version 864892 (0.0006) [2023-12-28 01:28:08,375][106226] Updated weights for policy 0, policy_version 864902 (0.0008) [2023-12-28 01:28:08,752][106225] Updated weights for policy 1, policy_version 866981 (0.0009) [2023-12-28 01:28:08,799][106225] Updated weights for policy 1, policy_version 866991 (0.0008) [2023-12-28 01:28:08,853][106225] Updated weights for policy 1, policy_version 867001 (0.0008) [2023-12-28 01:28:09,024][106226] Updated weights for policy 0, policy_version 864912 (0.0005) [2023-12-28 01:28:09,091][106226] Updated weights for policy 0, policy_version 864922 (0.0006) [2023-12-28 01:28:09,151][106226] Updated weights for policy 0, policy_version 864932 (0.0008) [2023-12-28 01:28:09,593][106225] Updated weights for policy 1, policy_version 867011 (0.0007) [2023-12-28 01:28:09,653][106225] Updated weights for policy 1, policy_version 867021 (0.0009) [2023-12-28 01:28:09,707][106225] Updated weights for policy 1, policy_version 867031 (0.0008) [2023-12-28 01:28:09,901][106226] Updated weights for policy 0, policy_version 864942 (0.0008) [2023-12-28 01:28:09,961][106226] Updated weights for policy 0, policy_version 864952 (0.0008) [2023-12-28 01:28:10,024][106226] Updated weights for policy 0, policy_version 864962 (0.0008) [2023-12-28 01:28:10,466][106225] Updated weights for policy 1, policy_version 867041 (0.0007) [2023-12-28 01:28:10,516][106225] Updated weights for policy 1, policy_version 867051 (0.0006) [2023-12-28 01:28:10,562][106225] Updated weights for policy 1, policy_version 867061 (0.0007) [2023-12-28 01:28:10,619][106225] Updated weights for policy 1, policy_version 867071 (0.0005) [2023-12-28 01:28:10,759][106226] Updated weights for policy 0, policy_version 864972 (0.0007) [2023-12-28 01:28:10,806][106226] Updated weights for policy 0, policy_version 864982 (0.0006) [2023-12-28 01:28:10,858][106226] Updated weights for policy 0, policy_version 864992 (0.0008) [2023-12-28 01:28:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 443506688. Throughput: 0: 9718.6, 1: 9842.5. Samples: 443478928. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:11,175][105115] Avg episode reward: [(0, '-4.162'), (1, '-4.779')] [2023-12-28 01:28:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000867072_222011392.pth... [2023-12-28 01:28:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000865000_221495296.pth... [2023-12-28 01:28:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000865952_221724672.pth [2023-12-28 01:28:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000863848_221200384.pth [2023-12-28 01:28:11,332][106225] Updated weights for policy 1, policy_version 867081 (0.0006) [2023-12-28 01:28:11,401][106225] Updated weights for policy 1, policy_version 867091 (0.0009) [2023-12-28 01:28:11,456][106225] Updated weights for policy 1, policy_version 867101 (0.0008) [2023-12-28 01:28:11,674][106226] Updated weights for policy 0, policy_version 865002 (0.0008) [2023-12-28 01:28:11,742][106226] Updated weights for policy 0, policy_version 865012 (0.0010) [2023-12-28 01:28:11,812][106226] Updated weights for policy 0, policy_version 865022 (0.0008) [2023-12-28 01:28:11,878][106226] Updated weights for policy 0, policy_version 865032 (0.0008) [2023-12-28 01:28:12,246][106225] Updated weights for policy 1, policy_version 867111 (0.0007) [2023-12-28 01:28:12,313][106225] Updated weights for policy 1, policy_version 867121 (0.0008) [2023-12-28 01:28:12,379][106225] Updated weights for policy 1, policy_version 867131 (0.0008) [2023-12-28 01:28:12,607][106226] Updated weights for policy 0, policy_version 865042 (0.0008) [2023-12-28 01:28:12,666][106226] Updated weights for policy 0, policy_version 865052 (0.0009) [2023-12-28 01:28:12,735][106226] Updated weights for policy 0, policy_version 865062 (0.0009) [2023-12-28 01:28:13,058][106225] Updated weights for policy 1, policy_version 867141 (0.0007) [2023-12-28 01:28:13,104][106225] Updated weights for policy 1, policy_version 867151 (0.0008) [2023-12-28 01:28:13,148][106225] Updated weights for policy 1, policy_version 867161 (0.0008) [2023-12-28 01:28:13,439][106226] Updated weights for policy 0, policy_version 865072 (0.0008) [2023-12-28 01:28:13,490][106226] Updated weights for policy 0, policy_version 865082 (0.0009) [2023-12-28 01:28:13,542][106226] Updated weights for policy 0, policy_version 865092 (0.0008) [2023-12-28 01:28:13,894][106225] Updated weights for policy 1, policy_version 867171 (0.0008) [2023-12-28 01:28:13,956][106225] Updated weights for policy 1, policy_version 867181 (0.0009) [2023-12-28 01:28:14,023][106225] Updated weights for policy 1, policy_version 867191 (0.0008) [2023-12-28 01:28:14,292][106226] Updated weights for policy 0, policy_version 865102 (0.0008) [2023-12-28 01:28:14,346][106226] Updated weights for policy 0, policy_version 865112 (0.0009) [2023-12-28 01:28:14,402][106226] Updated weights for policy 0, policy_version 865122 (0.0008) [2023-12-28 01:28:14,686][106225] Updated weights for policy 1, policy_version 867201 (0.0008) [2023-12-28 01:28:14,731][106225] Updated weights for policy 1, policy_version 867211 (0.0007) [2023-12-28 01:28:14,782][106225] Updated weights for policy 1, policy_version 867221 (0.0009) [2023-12-28 01:28:14,849][106225] Updated weights for policy 1, policy_version 867231 (0.0008) [2023-12-28 01:28:15,169][106226] Updated weights for policy 0, policy_version 865132 (0.0009) [2023-12-28 01:28:15,226][106226] Updated weights for policy 0, policy_version 865142 (0.0008) [2023-12-28 01:28:15,278][106226] Updated weights for policy 0, policy_version 865152 (0.0009) [2023-12-28 01:28:15,603][106225] Updated weights for policy 1, policy_version 867241 (0.0009) [2023-12-28 01:28:15,656][106225] Updated weights for policy 1, policy_version 867252 (0.0009) [2023-12-28 01:28:15,711][106225] Updated weights for policy 1, policy_version 867262 (0.0009) [2023-12-28 01:28:15,926][106226] Updated weights for policy 0, policy_version 865162 (0.0008) [2023-12-28 01:28:15,975][106226] Updated weights for policy 0, policy_version 865172 (0.0006) [2023-12-28 01:28:16,024][106226] Updated weights for policy 0, policy_version 865182 (0.0008) [2023-12-28 01:28:16,071][106226] Updated weights for policy 0, policy_version 865192 (0.0008) [2023-12-28 01:28:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 443604992. Throughput: 0: 9628.2, 1: 9791.3. Samples: 443592412. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:16,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-4.997')] [2023-12-28 01:28:16,490][106225] Updated weights for policy 1, policy_version 867272 (0.0009) [2023-12-28 01:28:16,543][106225] Updated weights for policy 1, policy_version 867282 (0.0008) [2023-12-28 01:28:16,606][106225] Updated weights for policy 1, policy_version 867292 (0.0008) [2023-12-28 01:28:16,776][106226] Updated weights for policy 0, policy_version 865202 (0.0011) [2023-12-28 01:28:16,838][106226] Updated weights for policy 0, policy_version 865212 (0.0008) [2023-12-28 01:28:16,896][106226] Updated weights for policy 0, policy_version 865222 (0.0011) [2023-12-28 01:28:17,379][106225] Updated weights for policy 1, policy_version 867302 (0.0008) [2023-12-28 01:28:17,429][106225] Updated weights for policy 1, policy_version 867312 (0.0007) [2023-12-28 01:28:17,482][106225] Updated weights for policy 1, policy_version 867322 (0.0008) [2023-12-28 01:28:17,622][106226] Updated weights for policy 0, policy_version 865232 (0.0011) [2023-12-28 01:28:17,678][106226] Updated weights for policy 0, policy_version 865242 (0.0010) [2023-12-28 01:28:17,737][106226] Updated weights for policy 0, policy_version 865252 (0.0011) [2023-12-28 01:28:18,245][106225] Updated weights for policy 1, policy_version 867332 (0.0008) [2023-12-28 01:28:18,306][106225] Updated weights for policy 1, policy_version 867342 (0.0008) [2023-12-28 01:28:18,370][106225] Updated weights for policy 1, policy_version 867352 (0.0008) [2023-12-28 01:28:18,450][106226] Updated weights for policy 0, policy_version 865262 (0.0011) [2023-12-28 01:28:18,510][106226] Updated weights for policy 0, policy_version 865272 (0.0011) [2023-12-28 01:28:18,569][106226] Updated weights for policy 0, policy_version 865282 (0.0011) [2023-12-28 01:28:19,113][106225] Updated weights for policy 1, policy_version 867362 (0.0008) [2023-12-28 01:28:19,169][106225] Updated weights for policy 1, policy_version 867372 (0.0008) [2023-12-28 01:28:19,224][106225] Updated weights for policy 1, policy_version 867382 (0.0007) [2023-12-28 01:28:19,290][106225] Updated weights for policy 1, policy_version 867392 (0.0007) [2023-12-28 01:28:19,292][106226] Updated weights for policy 0, policy_version 865292 (0.0011) [2023-12-28 01:28:19,360][106226] Updated weights for policy 0, policy_version 865302 (0.0010) [2023-12-28 01:28:19,430][106226] Updated weights for policy 0, policy_version 865312 (0.0011) [2023-12-28 01:28:20,032][106225] Updated weights for policy 1, policy_version 867402 (0.0008) [2023-12-28 01:28:20,092][106225] Updated weights for policy 1, policy_version 867412 (0.0008) [2023-12-28 01:28:20,159][106225] Updated weights for policy 1, policy_version 867422 (0.0008) [2023-12-28 01:28:20,205][106226] Updated weights for policy 0, policy_version 865322 (0.0010) [2023-12-28 01:28:20,272][106226] Updated weights for policy 0, policy_version 865332 (0.0008) [2023-12-28 01:28:20,338][106226] Updated weights for policy 0, policy_version 865342 (0.0008) [2023-12-28 01:28:20,406][106226] Updated weights for policy 0, policy_version 865352 (0.0007) [2023-12-28 01:28:20,865][106225] Updated weights for policy 1, policy_version 867432 (0.0008) [2023-12-28 01:28:20,926][106225] Updated weights for policy 1, policy_version 867442 (0.0008) [2023-12-28 01:28:20,976][106225] Updated weights for policy 1, policy_version 867452 (0.0007) [2023-12-28 01:28:21,100][106226] Updated weights for policy 0, policy_version 865362 (0.0009) [2023-12-28 01:28:21,152][106226] Updated weights for policy 0, policy_version 865372 (0.0009) [2023-12-28 01:28:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19716.3). Total num frames: 443695104. Throughput: 0: 9647.4, 1: 9743.4. Samples: 443706336. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:21,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-4.853')] [2023-12-28 01:28:21,220][106226] Updated weights for policy 0, policy_version 865382 (0.0009) [2023-12-28 01:28:21,691][106225] Updated weights for policy 1, policy_version 867462 (0.0008) [2023-12-28 01:28:21,765][106225] Updated weights for policy 1, policy_version 867472 (0.0008) [2023-12-28 01:28:21,823][106225] Updated weights for policy 1, policy_version 867482 (0.0008) [2023-12-28 01:28:21,969][106226] Updated weights for policy 0, policy_version 865392 (0.0007) [2023-12-28 01:28:22,033][106226] Updated weights for policy 0, policy_version 865402 (0.0006) [2023-12-28 01:28:22,090][106226] Updated weights for policy 0, policy_version 865412 (0.0007) [2023-12-28 01:28:22,561][106225] Updated weights for policy 1, policy_version 867492 (0.0007) [2023-12-28 01:28:22,623][106225] Updated weights for policy 1, policy_version 867502 (0.0008) [2023-12-28 01:28:22,674][106225] Updated weights for policy 1, policy_version 867512 (0.0006) [2023-12-28 01:28:22,807][106226] Updated weights for policy 0, policy_version 865422 (0.0008) [2023-12-28 01:28:22,874][106226] Updated weights for policy 0, policy_version 865432 (0.0009) [2023-12-28 01:28:22,934][106226] Updated weights for policy 0, policy_version 865442 (0.0009) [2023-12-28 01:28:23,373][106225] Updated weights for policy 1, policy_version 867522 (0.0006) [2023-12-28 01:28:23,434][106225] Updated weights for policy 1, policy_version 867532 (0.0008) [2023-12-28 01:28:23,503][106225] Updated weights for policy 1, policy_version 867542 (0.0009) [2023-12-28 01:28:23,525][106226] Updated weights for policy 0, policy_version 865452 (0.0007) [2023-12-28 01:28:23,564][106225] Updated weights for policy 1, policy_version 867552 (0.0008) [2023-12-28 01:28:23,579][106226] Updated weights for policy 0, policy_version 865462 (0.0005) [2023-12-28 01:28:23,636][106226] Updated weights for policy 0, policy_version 865472 (0.0005) [2023-12-28 01:28:24,209][106225] Updated weights for policy 1, policy_version 867562 (0.0007) [2023-12-28 01:28:24,271][106225] Updated weights for policy 1, policy_version 867572 (0.0008) [2023-12-28 01:28:24,295][106226] Updated weights for policy 0, policy_version 865482 (0.0006) [2023-12-28 01:28:24,332][106225] Updated weights for policy 1, policy_version 867582 (0.0009) [2023-12-28 01:28:24,355][106226] Updated weights for policy 0, policy_version 865492 (0.0011) [2023-12-28 01:28:24,423][106226] Updated weights for policy 0, policy_version 865502 (0.0008) [2023-12-28 01:28:24,478][106226] Updated weights for policy 0, policy_version 865512 (0.0009) [2023-12-28 01:28:25,068][106225] Updated weights for policy 1, policy_version 867592 (0.0009) [2023-12-28 01:28:25,125][106226] Updated weights for policy 0, policy_version 865522 (0.0006) [2023-12-28 01:28:25,125][106225] Updated weights for policy 1, policy_version 867602 (0.0009) [2023-12-28 01:28:25,186][106225] Updated weights for policy 1, policy_version 867612 (0.0008) [2023-12-28 01:28:25,186][106226] Updated weights for policy 0, policy_version 865532 (0.0006) [2023-12-28 01:28:25,250][106226] Updated weights for policy 0, policy_version 865542 (0.0009) [2023-12-28 01:28:25,870][106226] Updated weights for policy 0, policy_version 865552 (0.0008) [2023-12-28 01:28:25,902][106225] Updated weights for policy 1, policy_version 867622 (0.0007) [2023-12-28 01:28:25,928][106226] Updated weights for policy 0, policy_version 865562 (0.0007) [2023-12-28 01:28:25,950][106225] Updated weights for policy 1, policy_version 867632 (0.0006) [2023-12-28 01:28:25,985][106226] Updated weights for policy 0, policy_version 865572 (0.0007) [2023-12-28 01:28:25,995][106225] Updated weights for policy 1, policy_version 867642 (0.0007) [2023-12-28 01:28:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 443801600. Throughput: 0: 9711.0, 1: 9676.7. Samples: 443764952. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:26,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.907')] [2023-12-28 01:28:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000867648_222158848.pth... [2023-12-28 01:28:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000865576_221642752.pth... [2023-12-28 01:28:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000864424_221347840.pth [2023-12-28 01:28:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000866496_221863936.pth [2023-12-28 01:28:26,699][106226] Updated weights for policy 0, policy_version 865582 (0.0007) [2023-12-28 01:28:26,746][106225] Updated weights for policy 1, policy_version 867652 (0.0007) [2023-12-28 01:28:26,755][106226] Updated weights for policy 0, policy_version 865592 (0.0007) [2023-12-28 01:28:26,790][106225] Updated weights for policy 1, policy_version 867662 (0.0006) [2023-12-28 01:28:26,808][106226] Updated weights for policy 0, policy_version 865602 (0.0007) [2023-12-28 01:28:26,838][106225] Updated weights for policy 1, policy_version 867672 (0.0005) [2023-12-28 01:28:27,485][106225] Updated weights for policy 1, policy_version 867682 (0.0008) [2023-12-28 01:28:27,537][106225] Updated weights for policy 1, policy_version 867692 (0.0008) [2023-12-28 01:28:27,542][106226] Updated weights for policy 0, policy_version 865612 (0.0007) [2023-12-28 01:28:27,590][106225] Updated weights for policy 1, policy_version 867702 (0.0009) [2023-12-28 01:28:27,597][106226] Updated weights for policy 0, policy_version 865622 (0.0007) [2023-12-28 01:28:27,639][106225] Updated weights for policy 1, policy_version 867712 (0.0008) [2023-12-28 01:28:27,654][106226] Updated weights for policy 0, policy_version 865632 (0.0006) [2023-12-28 01:28:28,305][106226] Updated weights for policy 0, policy_version 865642 (0.0008) [2023-12-28 01:28:28,378][106226] Updated weights for policy 0, policy_version 865652 (0.0007) [2023-12-28 01:28:28,399][106225] Updated weights for policy 1, policy_version 867722 (0.0008) [2023-12-28 01:28:28,439][106226] Updated weights for policy 0, policy_version 865662 (0.0006) [2023-12-28 01:28:28,462][106225] Updated weights for policy 1, policy_version 867732 (0.0008) [2023-12-28 01:28:28,492][106226] Updated weights for policy 0, policy_version 865672 (0.0007) [2023-12-28 01:28:28,528][106225] Updated weights for policy 1, policy_version 867742 (0.0008) [2023-12-28 01:28:29,067][106226] Updated weights for policy 0, policy_version 865682 (0.0005) [2023-12-28 01:28:29,120][106226] Updated weights for policy 0, policy_version 865692 (0.0005) [2023-12-28 01:28:29,166][106226] Updated weights for policy 0, policy_version 865702 (0.0005) [2023-12-28 01:28:29,279][106225] Updated weights for policy 1, policy_version 867752 (0.0007) [2023-12-28 01:28:29,346][106225] Updated weights for policy 1, policy_version 867762 (0.0007) [2023-12-28 01:28:29,405][106225] Updated weights for policy 1, policy_version 867772 (0.0007) [2023-12-28 01:28:29,832][106226] Updated weights for policy 0, policy_version 865712 (0.0006) [2023-12-28 01:28:29,897][106226] Updated weights for policy 0, policy_version 865722 (0.0007) [2023-12-28 01:28:29,967][106226] Updated weights for policy 0, policy_version 865732 (0.0007) [2023-12-28 01:28:30,148][106225] Updated weights for policy 1, policy_version 867782 (0.0007) [2023-12-28 01:28:30,203][106225] Updated weights for policy 1, policy_version 867792 (0.0006) [2023-12-28 01:28:30,259][106225] Updated weights for policy 1, policy_version 867802 (0.0005) [2023-12-28 01:28:30,695][106226] Updated weights for policy 0, policy_version 865742 (0.0010) [2023-12-28 01:28:30,755][106226] Updated weights for policy 0, policy_version 865752 (0.0010) [2023-12-28 01:28:30,809][106226] Updated weights for policy 0, policy_version 865762 (0.0008) [2023-12-28 01:28:30,831][106225] Updated weights for policy 1, policy_version 867812 (0.0006) [2023-12-28 01:28:30,883][106225] Updated weights for policy 1, policy_version 867822 (0.0009) [2023-12-28 01:28:30,934][106225] Updated weights for policy 1, policy_version 867832 (0.0005) [2023-12-28 01:28:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 443899904. Throughput: 0: 9759.9, 1: 9755.5. Samples: 443885520. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:31,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-5.282')] [2023-12-28 01:28:31,512][106226] Updated weights for policy 0, policy_version 865772 (0.0007) [2023-12-28 01:28:31,578][106226] Updated weights for policy 0, policy_version 865782 (0.0010) [2023-12-28 01:28:31,640][106225] Updated weights for policy 1, policy_version 867842 (0.0005) [2023-12-28 01:28:31,655][106226] Updated weights for policy 0, policy_version 865792 (0.0007) [2023-12-28 01:28:31,707][106225] Updated weights for policy 1, policy_version 867852 (0.0009) [2023-12-28 01:28:31,780][106225] Updated weights for policy 1, policy_version 867862 (0.0007) [2023-12-28 01:28:31,845][106225] Updated weights for policy 1, policy_version 867872 (0.0008) [2023-12-28 01:28:32,439][106226] Updated weights for policy 0, policy_version 865802 (0.0008) [2023-12-28 01:28:32,445][106225] Updated weights for policy 1, policy_version 867882 (0.0008) [2023-12-28 01:28:32,493][106225] Updated weights for policy 1, policy_version 867892 (0.0007) [2023-12-28 01:28:32,499][106226] Updated weights for policy 0, policy_version 865812 (0.0007) [2023-12-28 01:28:32,549][106225] Updated weights for policy 1, policy_version 867902 (0.0006) [2023-12-28 01:28:32,563][106226] Updated weights for policy 0, policy_version 865822 (0.0006) [2023-12-28 01:28:32,629][106226] Updated weights for policy 0, policy_version 865832 (0.0009) [2023-12-28 01:28:33,312][106226] Updated weights for policy 0, policy_version 865842 (0.0008) [2023-12-28 01:28:33,313][106225] Updated weights for policy 1, policy_version 867912 (0.0009) [2023-12-28 01:28:33,362][106225] Updated weights for policy 1, policy_version 867922 (0.0005) [2023-12-28 01:28:33,364][106226] Updated weights for policy 0, policy_version 865852 (0.0006) [2023-12-28 01:28:33,411][106226] Updated weights for policy 0, policy_version 865862 (0.0006) [2023-12-28 01:28:33,415][106225] Updated weights for policy 1, policy_version 867932 (0.0007) [2023-12-28 01:28:34,042][106226] Updated weights for policy 0, policy_version 865872 (0.0009) [2023-12-28 01:28:34,095][106226] Updated weights for policy 0, policy_version 865882 (0.0010) [2023-12-28 01:28:34,162][106226] Updated weights for policy 0, policy_version 865892 (0.0011) [2023-12-28 01:28:34,176][106225] Updated weights for policy 1, policy_version 867942 (0.0009) [2023-12-28 01:28:34,246][106225] Updated weights for policy 1, policy_version 867952 (0.0006) [2023-12-28 01:28:34,312][106225] Updated weights for policy 1, policy_version 867962 (0.0008) [2023-12-28 01:28:34,871][106226] Updated weights for policy 0, policy_version 865902 (0.0008) [2023-12-28 01:28:34,933][106226] Updated weights for policy 0, policy_version 865912 (0.0006) [2023-12-28 01:28:34,985][106225] Updated weights for policy 1, policy_version 867972 (0.0007) [2023-12-28 01:28:34,991][106226] Updated weights for policy 0, policy_version 865922 (0.0007) [2023-12-28 01:28:35,047][106225] Updated weights for policy 1, policy_version 867982 (0.0006) [2023-12-28 01:28:35,103][106225] Updated weights for policy 1, policy_version 867992 (0.0008) [2023-12-28 01:28:35,549][106226] Updated weights for policy 0, policy_version 865932 (0.0008) [2023-12-28 01:28:35,603][106226] Updated weights for policy 0, policy_version 865942 (0.0005) [2023-12-28 01:28:35,650][106226] Updated weights for policy 0, policy_version 865952 (0.0005) [2023-12-28 01:28:35,731][106225] Updated weights for policy 1, policy_version 868002 (0.0008) [2023-12-28 01:28:35,784][106225] Updated weights for policy 1, policy_version 868012 (0.0008) [2023-12-28 01:28:35,830][106225] Updated weights for policy 1, policy_version 868022 (0.0008) [2023-12-28 01:28:35,877][106225] Updated weights for policy 1, policy_version 868032 (0.0007) [2023-12-28 01:28:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 443998208. Throughput: 0: 9830.0, 1: 9790.0. Samples: 444006820. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:36,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.862')] [2023-12-28 01:28:36,243][106226] Updated weights for policy 0, policy_version 865962 (0.0006) [2023-12-28 01:28:36,301][106226] Updated weights for policy 0, policy_version 865972 (0.0009) [2023-12-28 01:28:36,358][106226] Updated weights for policy 0, policy_version 865982 (0.0006) [2023-12-28 01:28:36,411][106226] Updated weights for policy 0, policy_version 865992 (0.0008) [2023-12-28 01:28:36,718][106225] Updated weights for policy 1, policy_version 868042 (0.0008) [2023-12-28 01:28:36,775][106225] Updated weights for policy 1, policy_version 868052 (0.0008) [2023-12-28 01:28:36,818][106225] Updated weights for policy 1, policy_version 868062 (0.0008) [2023-12-28 01:28:37,092][106226] Updated weights for policy 0, policy_version 866002 (0.0007) [2023-12-28 01:28:37,153][106226] Updated weights for policy 0, policy_version 866012 (0.0007) [2023-12-28 01:28:37,213][106226] Updated weights for policy 0, policy_version 866022 (0.0006) [2023-12-28 01:28:37,493][106225] Updated weights for policy 1, policy_version 868072 (0.0009) [2023-12-28 01:28:37,547][106225] Updated weights for policy 1, policy_version 868082 (0.0010) [2023-12-28 01:28:37,597][106225] Updated weights for policy 1, policy_version 868092 (0.0010) [2023-12-28 01:28:37,859][106226] Updated weights for policy 0, policy_version 866032 (0.0007) [2023-12-28 01:28:37,922][106226] Updated weights for policy 0, policy_version 866042 (0.0009) [2023-12-28 01:28:37,987][106226] Updated weights for policy 0, policy_version 866052 (0.0009) [2023-12-28 01:28:38,214][106225] Updated weights for policy 1, policy_version 868102 (0.0007) [2023-12-28 01:28:38,267][106225] Updated weights for policy 1, policy_version 868112 (0.0007) [2023-12-28 01:28:38,319][106225] Updated weights for policy 1, policy_version 868122 (0.0008) [2023-12-28 01:28:38,757][106226] Updated weights for policy 0, policy_version 866062 (0.0008) [2023-12-28 01:28:38,825][106226] Updated weights for policy 0, policy_version 866072 (0.0009) [2023-12-28 01:28:38,885][106226] Updated weights for policy 0, policy_version 866082 (0.0010) [2023-12-28 01:28:39,028][106225] Updated weights for policy 1, policy_version 868132 (0.0007) [2023-12-28 01:28:39,091][106225] Updated weights for policy 1, policy_version 868142 (0.0008) [2023-12-28 01:28:39,142][106225] Updated weights for policy 1, policy_version 868152 (0.0009) [2023-12-28 01:28:39,672][106226] Updated weights for policy 0, policy_version 866092 (0.0010) [2023-12-28 01:28:39,733][106226] Updated weights for policy 0, policy_version 866102 (0.0008) [2023-12-28 01:28:39,802][106226] Updated weights for policy 0, policy_version 866112 (0.0008) [2023-12-28 01:28:39,944][106225] Updated weights for policy 1, policy_version 868162 (0.0007) [2023-12-28 01:28:40,006][106225] Updated weights for policy 1, policy_version 868172 (0.0008) [2023-12-28 01:28:40,060][106225] Updated weights for policy 1, policy_version 868182 (0.0009) [2023-12-28 01:28:40,121][106225] Updated weights for policy 1, policy_version 868192 (0.0008) [2023-12-28 01:28:40,494][106226] Updated weights for policy 0, policy_version 866122 (0.0008) [2023-12-28 01:28:40,554][106226] Updated weights for policy 0, policy_version 866132 (0.0005) [2023-12-28 01:28:40,611][106226] Updated weights for policy 0, policy_version 866142 (0.0005) [2023-12-28 01:28:40,666][106226] Updated weights for policy 0, policy_version 866152 (0.0005) [2023-12-28 01:28:40,901][106225] Updated weights for policy 1, policy_version 868202 (0.0007) [2023-12-28 01:28:40,964][106225] Updated weights for policy 1, policy_version 868212 (0.0006) [2023-12-28 01:28:41,021][106225] Updated weights for policy 1, policy_version 868222 (0.0009) [2023-12-28 01:28:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 444096512. Throughput: 0: 9855.4, 1: 9778.9. Samples: 444065600. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:41,175][105115] Avg episode reward: [(0, '-4.148'), (1, '-4.761')] [2023-12-28 01:28:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000868224_222306304.pth... [2023-12-28 01:28:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000866152_221790208.pth... [2023-12-28 01:28:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000867072_222011392.pth [2023-12-28 01:28:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000865000_221495296.pth [2023-12-28 01:28:41,334][106226] Updated weights for policy 0, policy_version 866162 (0.0009) [2023-12-28 01:28:41,400][106226] Updated weights for policy 0, policy_version 866172 (0.0008) [2023-12-28 01:28:41,464][106226] Updated weights for policy 0, policy_version 866182 (0.0008) [2023-12-28 01:28:41,775][106225] Updated weights for policy 1, policy_version 868232 (0.0009) [2023-12-28 01:28:41,839][106225] Updated weights for policy 1, policy_version 868242 (0.0008) [2023-12-28 01:28:41,905][106225] Updated weights for policy 1, policy_version 868252 (0.0008) [2023-12-28 01:28:42,234][106226] Updated weights for policy 0, policy_version 866192 (0.0009) [2023-12-28 01:28:42,298][106226] Updated weights for policy 0, policy_version 866202 (0.0007) [2023-12-28 01:28:42,361][106226] Updated weights for policy 0, policy_version 866212 (0.0008) [2023-12-28 01:28:42,601][106225] Updated weights for policy 1, policy_version 868262 (0.0009) [2023-12-28 01:28:42,671][106225] Updated weights for policy 1, policy_version 868272 (0.0008) [2023-12-28 01:28:42,736][106225] Updated weights for policy 1, policy_version 868282 (0.0005) [2023-12-28 01:28:43,085][106226] Updated weights for policy 0, policy_version 866222 (0.0006) [2023-12-28 01:28:43,143][106226] Updated weights for policy 0, policy_version 866232 (0.0007) [2023-12-28 01:28:43,192][106226] Updated weights for policy 0, policy_version 866242 (0.0005) [2023-12-28 01:28:43,280][106225] Updated weights for policy 1, policy_version 868292 (0.0005) [2023-12-28 01:28:43,327][106225] Updated weights for policy 1, policy_version 868302 (0.0005) [2023-12-28 01:28:43,387][106225] Updated weights for policy 1, policy_version 868312 (0.0005) [2023-12-28 01:28:43,821][106226] Updated weights for policy 0, policy_version 866252 (0.0005) [2023-12-28 01:28:43,870][106226] Updated weights for policy 0, policy_version 866262 (0.0005) [2023-12-28 01:28:43,927][106226] Updated weights for policy 0, policy_version 866272 (0.0008) [2023-12-28 01:28:44,005][106225] Updated weights for policy 1, policy_version 868322 (0.0006) [2023-12-28 01:28:44,071][106225] Updated weights for policy 1, policy_version 868332 (0.0005) [2023-12-28 01:28:44,129][106225] Updated weights for policy 1, policy_version 868342 (0.0005) [2023-12-28 01:28:44,180][106225] Updated weights for policy 1, policy_version 868352 (0.0007) [2023-12-28 01:28:44,682][106226] Updated weights for policy 0, policy_version 866282 (0.0008) [2023-12-28 01:28:44,735][106225] Updated weights for policy 1, policy_version 868362 (0.0007) [2023-12-28 01:28:44,737][106226] Updated weights for policy 0, policy_version 866292 (0.0007) [2023-12-28 01:28:44,803][106225] Updated weights for policy 1, policy_version 868372 (0.0009) [2023-12-28 01:28:44,824][106226] Updated weights for policy 0, policy_version 866302 (0.0007) [2023-12-28 01:28:44,870][106225] Updated weights for policy 1, policy_version 868382 (0.0008) [2023-12-28 01:28:44,884][106226] Updated weights for policy 0, policy_version 866312 (0.0007) [2023-12-28 01:28:45,567][106225] Updated weights for policy 1, policy_version 868392 (0.0010) [2023-12-28 01:28:45,610][106226] Updated weights for policy 0, policy_version 866322 (0.0005) [2023-12-28 01:28:45,623][106225] Updated weights for policy 1, policy_version 868402 (0.0010) [2023-12-28 01:28:45,667][106226] Updated weights for policy 0, policy_version 866332 (0.0005) [2023-12-28 01:28:45,677][106225] Updated weights for policy 1, policy_version 868412 (0.0009) [2023-12-28 01:28:45,718][106226] Updated weights for policy 0, policy_version 866342 (0.0009) [2023-12-28 01:28:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 444194816. Throughput: 0: 9898.2, 1: 9758.4. Samples: 444185300. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 01:28:46,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-4.889')] [2023-12-28 01:28:46,309][106226] Updated weights for policy 0, policy_version 866352 (0.0006) [2023-12-28 01:28:46,355][106226] Updated weights for policy 0, policy_version 866362 (0.0005) [2023-12-28 01:28:46,402][106226] Updated weights for policy 0, policy_version 866372 (0.0005) [2023-12-28 01:28:46,416][106225] Updated weights for policy 1, policy_version 868422 (0.0008) [2023-12-28 01:28:46,472][106225] Updated weights for policy 1, policy_version 868432 (0.0007) [2023-12-28 01:28:46,523][106225] Updated weights for policy 1, policy_version 868442 (0.0005) [2023-12-28 01:28:46,945][106226] Updated weights for policy 0, policy_version 866382 (0.0007) [2023-12-28 01:28:47,005][106226] Updated weights for policy 0, policy_version 866392 (0.0008) [2023-12-28 01:28:47,066][106226] Updated weights for policy 0, policy_version 866402 (0.0009) [2023-12-28 01:28:47,238][106225] Updated weights for policy 1, policy_version 868452 (0.0008) [2023-12-28 01:28:47,288][106225] Updated weights for policy 1, policy_version 868462 (0.0010) [2023-12-28 01:28:47,341][106225] Updated weights for policy 1, policy_version 868472 (0.0010) [2023-12-28 01:28:47,811][106226] Updated weights for policy 0, policy_version 866412 (0.0009) [2023-12-28 01:28:47,883][106226] Updated weights for policy 0, policy_version 866422 (0.0011) [2023-12-28 01:28:47,941][106226] Updated weights for policy 0, policy_version 866432 (0.0011) [2023-12-28 01:28:47,943][106225] Updated weights for policy 1, policy_version 868482 (0.0009) [2023-12-28 01:28:47,998][106225] Updated weights for policy 1, policy_version 868492 (0.0006) [2023-12-28 01:28:48,056][106225] Updated weights for policy 1, policy_version 868502 (0.0007) [2023-12-28 01:28:48,118][106225] Updated weights for policy 1, policy_version 868512 (0.0008) [2023-12-28 01:28:48,616][106226] Updated weights for policy 0, policy_version 866442 (0.0011) [2023-12-28 01:28:48,668][106226] Updated weights for policy 0, policy_version 866452 (0.0010) [2023-12-28 01:28:48,734][106226] Updated weights for policy 0, policy_version 866462 (0.0008) [2023-12-28 01:28:48,799][106226] Updated weights for policy 0, policy_version 866472 (0.0008) [2023-12-28 01:28:48,836][106225] Updated weights for policy 1, policy_version 868522 (0.0008) [2023-12-28 01:28:48,896][106225] Updated weights for policy 1, policy_version 868532 (0.0008) [2023-12-28 01:28:48,952][106225] Updated weights for policy 1, policy_version 868542 (0.0009) [2023-12-28 01:28:49,458][106226] Updated weights for policy 0, policy_version 866482 (0.0006) [2023-12-28 01:28:49,520][106226] Updated weights for policy 0, policy_version 866492 (0.0005) [2023-12-28 01:28:49,589][106226] Updated weights for policy 0, policy_version 866502 (0.0006) [2023-12-28 01:28:49,723][106225] Updated weights for policy 1, policy_version 868552 (0.0009) [2023-12-28 01:28:49,786][106225] Updated weights for policy 1, policy_version 868562 (0.0009) [2023-12-28 01:28:49,854][106225] Updated weights for policy 1, policy_version 868572 (0.0008) [2023-12-28 01:28:50,249][106226] Updated weights for policy 0, policy_version 866512 (0.0007) [2023-12-28 01:28:50,312][106226] Updated weights for policy 0, policy_version 866522 (0.0009) [2023-12-28 01:28:50,380][106226] Updated weights for policy 0, policy_version 866532 (0.0009) [2023-12-28 01:28:50,574][106225] Updated weights for policy 1, policy_version 868582 (0.0009) [2023-12-28 01:28:50,642][106225] Updated weights for policy 1, policy_version 868592 (0.0009) [2023-12-28 01:28:50,707][106225] Updated weights for policy 1, policy_version 868602 (0.0009) [2023-12-28 01:28:51,008][106226] Updated weights for policy 0, policy_version 866542 (0.0007) [2023-12-28 01:28:51,076][106226] Updated weights for policy 0, policy_version 866552 (0.0008) [2023-12-28 01:28:51,130][106226] Updated weights for policy 0, policy_version 866562 (0.0009) [2023-12-28 01:28:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 444301312. Throughput: 0: 9971.7, 1: 9761.8. Samples: 444306768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:28:51,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-5.006')] [2023-12-28 01:28:51,497][106225] Updated weights for policy 1, policy_version 868612 (0.0009) [2023-12-28 01:28:51,545][106225] Updated weights for policy 1, policy_version 868622 (0.0008) [2023-12-28 01:28:51,595][106225] Updated weights for policy 1, policy_version 868632 (0.0008) [2023-12-28 01:28:51,904][106226] Updated weights for policy 0, policy_version 866572 (0.0009) [2023-12-28 01:28:51,966][106226] Updated weights for policy 0, policy_version 866582 (0.0008) [2023-12-28 01:28:52,027][106226] Updated weights for policy 0, policy_version 866592 (0.0009) [2023-12-28 01:28:52,288][106225] Updated weights for policy 1, policy_version 868642 (0.0009) [2023-12-28 01:28:52,357][106225] Updated weights for policy 1, policy_version 868652 (0.0007) [2023-12-28 01:28:52,421][106225] Updated weights for policy 1, policy_version 868662 (0.0007) [2023-12-28 01:28:52,470][106225] Updated weights for policy 1, policy_version 868672 (0.0007) [2023-12-28 01:28:52,729][106226] Updated weights for policy 0, policy_version 866602 (0.0009) [2023-12-28 01:28:52,787][106226] Updated weights for policy 0, policy_version 866612 (0.0008) [2023-12-28 01:28:52,854][106226] Updated weights for policy 0, policy_version 866622 (0.0010) [2023-12-28 01:28:52,921][106226] Updated weights for policy 0, policy_version 866632 (0.0009) [2023-12-28 01:28:53,167][106225] Updated weights for policy 1, policy_version 868682 (0.0009) [2023-12-28 01:28:53,220][106225] Updated weights for policy 1, policy_version 868692 (0.0009) [2023-12-28 01:28:53,275][106225] Updated weights for policy 1, policy_version 868702 (0.0008) [2023-12-28 01:28:53,556][106226] Updated weights for policy 0, policy_version 866642 (0.0007) [2023-12-28 01:28:53,621][106226] Updated weights for policy 0, policy_version 866652 (0.0008) [2023-12-28 01:28:53,683][106226] Updated weights for policy 0, policy_version 866662 (0.0007) [2023-12-28 01:28:53,879][106225] Updated weights for policy 1, policy_version 868712 (0.0006) [2023-12-28 01:28:53,926][106225] Updated weights for policy 1, policy_version 868722 (0.0005) [2023-12-28 01:28:53,976][106225] Updated weights for policy 1, policy_version 868732 (0.0007) [2023-12-28 01:28:54,413][106226] Updated weights for policy 0, policy_version 866672 (0.0008) [2023-12-28 01:28:54,465][106226] Updated weights for policy 0, policy_version 866682 (0.0008) [2023-12-28 01:28:54,513][106226] Updated weights for policy 0, policy_version 866692 (0.0008) [2023-12-28 01:28:54,671][106225] Updated weights for policy 1, policy_version 868742 (0.0007) [2023-12-28 01:28:54,725][106225] Updated weights for policy 1, policy_version 868752 (0.0005) [2023-12-28 01:28:54,783][106225] Updated weights for policy 1, policy_version 868762 (0.0008) [2023-12-28 01:28:55,244][106226] Updated weights for policy 0, policy_version 866702 (0.0007) [2023-12-28 01:28:55,307][106226] Updated weights for policy 0, policy_version 866712 (0.0005) [2023-12-28 01:28:55,373][106226] Updated weights for policy 0, policy_version 866722 (0.0008) [2023-12-28 01:28:55,425][106225] Updated weights for policy 1, policy_version 868772 (0.0009) [2023-12-28 01:28:55,486][106225] Updated weights for policy 1, policy_version 868782 (0.0010) [2023-12-28 01:28:55,554][106225] Updated weights for policy 1, policy_version 868792 (0.0009) [2023-12-28 01:28:55,935][106226] Updated weights for policy 0, policy_version 866732 (0.0008) [2023-12-28 01:28:55,991][106226] Updated weights for policy 0, policy_version 866742 (0.0007) [2023-12-28 01:28:56,042][106226] Updated weights for policy 0, policy_version 866752 (0.0005) [2023-12-28 01:28:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 444399616. Throughput: 0: 9926.9, 1: 9771.8. Samples: 444365364. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:28:56,175][105115] Avg episode reward: [(0, '-4.178'), (1, '-4.667')] [2023-12-28 01:28:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000868800_222453760.pth... [2023-12-28 01:28:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000866760_221945856.pth... [2023-12-28 01:28:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000867648_222158848.pth [2023-12-28 01:28:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000865576_221642752.pth [2023-12-28 01:28:56,244][106225] Updated weights for policy 1, policy_version 868802 (0.0009) [2023-12-28 01:28:56,300][106225] Updated weights for policy 1, policy_version 868812 (0.0010) [2023-12-28 01:28:56,349][106225] Updated weights for policy 1, policy_version 868822 (0.0010) [2023-12-28 01:28:56,395][106225] Updated weights for policy 1, policy_version 868832 (0.0010) [2023-12-28 01:28:56,709][106226] Updated weights for policy 0, policy_version 866762 (0.0007) [2023-12-28 01:28:56,769][106226] Updated weights for policy 0, policy_version 866772 (0.0008) [2023-12-28 01:28:56,830][106226] Updated weights for policy 0, policy_version 866782 (0.0007) [2023-12-28 01:28:56,888][106226] Updated weights for policy 0, policy_version 866792 (0.0007) [2023-12-28 01:28:57,067][106225] Updated weights for policy 1, policy_version 868842 (0.0005) [2023-12-28 01:28:57,123][106225] Updated weights for policy 1, policy_version 868852 (0.0005) [2023-12-28 01:28:57,181][106225] Updated weights for policy 1, policy_version 868862 (0.0005) [2023-12-28 01:28:57,574][106226] Updated weights for policy 0, policy_version 866802 (0.0006) [2023-12-28 01:28:57,629][106226] Updated weights for policy 0, policy_version 866812 (0.0007) [2023-12-28 01:28:57,682][106226] Updated weights for policy 0, policy_version 866822 (0.0010) [2023-12-28 01:28:57,818][106225] Updated weights for policy 1, policy_version 868872 (0.0007) [2023-12-28 01:28:57,875][106225] Updated weights for policy 1, policy_version 868882 (0.0009) [2023-12-28 01:28:57,927][106225] Updated weights for policy 1, policy_version 868892 (0.0009) [2023-12-28 01:28:58,342][106226] Updated weights for policy 0, policy_version 866832 (0.0008) [2023-12-28 01:28:58,408][106226] Updated weights for policy 0, policy_version 866842 (0.0008) [2023-12-28 01:28:58,469][106226] Updated weights for policy 0, policy_version 866852 (0.0006) [2023-12-28 01:28:58,736][106225] Updated weights for policy 1, policy_version 868902 (0.0008) [2023-12-28 01:28:58,805][106225] Updated weights for policy 1, policy_version 868912 (0.0007) [2023-12-28 01:28:58,879][106225] Updated weights for policy 1, policy_version 868922 (0.0008) [2023-12-28 01:28:59,307][106226] Updated weights for policy 0, policy_version 866862 (0.0007) [2023-12-28 01:28:59,370][106226] Updated weights for policy 0, policy_version 866872 (0.0007) [2023-12-28 01:28:59,437][106226] Updated weights for policy 0, policy_version 866882 (0.0008) [2023-12-28 01:28:59,660][106225] Updated weights for policy 1, policy_version 868932 (0.0008) [2023-12-28 01:28:59,715][106225] Updated weights for policy 1, policy_version 868942 (0.0009) [2023-12-28 01:28:59,773][106225] Updated weights for policy 1, policy_version 868952 (0.0007) [2023-12-28 01:29:00,174][106226] Updated weights for policy 0, policy_version 866892 (0.0008) [2023-12-28 01:29:00,226][106226] Updated weights for policy 0, policy_version 866902 (0.0008) [2023-12-28 01:29:00,282][106226] Updated weights for policy 0, policy_version 866912 (0.0009) [2023-12-28 01:29:00,523][106225] Updated weights for policy 1, policy_version 868962 (0.0007) [2023-12-28 01:29:00,592][106225] Updated weights for policy 1, policy_version 868972 (0.0009) [2023-12-28 01:29:00,657][106225] Updated weights for policy 1, policy_version 868982 (0.0009) [2023-12-28 01:29:00,715][106225] Updated weights for policy 1, policy_version 868992 (0.0009) [2023-12-28 01:29:00,932][106226] Updated weights for policy 0, policy_version 866922 (0.0008) [2023-12-28 01:29:00,990][106226] Updated weights for policy 0, policy_version 866932 (0.0005) [2023-12-28 01:29:01,054][106226] Updated weights for policy 0, policy_version 866942 (0.0006) [2023-12-28 01:29:01,120][106226] Updated weights for policy 0, policy_version 866952 (0.0009) [2023-12-28 01:29:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 444497920. Throughput: 0: 10015.5, 1: 9807.1. Samples: 444484428. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:01,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.954')] [2023-12-28 01:29:01,490][106225] Updated weights for policy 1, policy_version 869002 (0.0005) [2023-12-28 01:29:01,542][106225] Updated weights for policy 1, policy_version 869012 (0.0006) [2023-12-28 01:29:01,601][106225] Updated weights for policy 1, policy_version 869022 (0.0005) [2023-12-28 01:29:01,845][106226] Updated weights for policy 0, policy_version 866962 (0.0011) [2023-12-28 01:29:01,914][106226] Updated weights for policy 0, policy_version 866972 (0.0010) [2023-12-28 01:29:01,982][106226] Updated weights for policy 0, policy_version 866982 (0.0010) [2023-12-28 01:29:02,236][106225] Updated weights for policy 1, policy_version 869032 (0.0006) [2023-12-28 01:29:02,302][106225] Updated weights for policy 1, policy_version 869042 (0.0007) [2023-12-28 01:29:02,364][106225] Updated weights for policy 1, policy_version 869052 (0.0009) [2023-12-28 01:29:02,655][106226] Updated weights for policy 0, policy_version 866992 (0.0006) [2023-12-28 01:29:02,720][106226] Updated weights for policy 0, policy_version 867002 (0.0007) [2023-12-28 01:29:02,777][106226] Updated weights for policy 0, policy_version 867012 (0.0008) [2023-12-28 01:29:03,089][106225] Updated weights for policy 1, policy_version 869062 (0.0010) [2023-12-28 01:29:03,136][106225] Updated weights for policy 1, policy_version 869072 (0.0010) [2023-12-28 01:29:03,186][106225] Updated weights for policy 1, policy_version 869082 (0.0010) [2023-12-28 01:29:03,411][106226] Updated weights for policy 0, policy_version 867022 (0.0006) [2023-12-28 01:29:03,462][106226] Updated weights for policy 0, policy_version 867032 (0.0005) [2023-12-28 01:29:03,511][106226] Updated weights for policy 0, policy_version 867042 (0.0006) [2023-12-28 01:29:03,774][106225] Updated weights for policy 1, policy_version 869092 (0.0007) [2023-12-28 01:29:03,825][106225] Updated weights for policy 1, policy_version 869102 (0.0005) [2023-12-28 01:29:03,890][106225] Updated weights for policy 1, policy_version 869112 (0.0009) [2023-12-28 01:29:04,128][106226] Updated weights for policy 0, policy_version 867052 (0.0009) [2023-12-28 01:29:04,196][106226] Updated weights for policy 0, policy_version 867062 (0.0011) [2023-12-28 01:29:04,254][106226] Updated weights for policy 0, policy_version 867072 (0.0011) [2023-12-28 01:29:04,442][106225] Updated weights for policy 1, policy_version 869122 (0.0007) [2023-12-28 01:29:04,489][106225] Updated weights for policy 1, policy_version 869132 (0.0010) [2023-12-28 01:29:04,548][106225] Updated weights for policy 1, policy_version 869142 (0.0010) [2023-12-28 01:29:04,612][106225] Updated weights for policy 1, policy_version 869152 (0.0010) [2023-12-28 01:29:04,935][106226] Updated weights for policy 0, policy_version 867082 (0.0011) [2023-12-28 01:29:04,988][106226] Updated weights for policy 0, policy_version 867092 (0.0010) [2023-12-28 01:29:05,049][106226] Updated weights for policy 0, policy_version 867102 (0.0011) [2023-12-28 01:29:05,103][106226] Updated weights for policy 0, policy_version 867112 (0.0010) [2023-12-28 01:29:05,247][106225] Updated weights for policy 1, policy_version 869162 (0.0008) [2023-12-28 01:29:05,307][106225] Updated weights for policy 1, policy_version 869172 (0.0008) [2023-12-28 01:29:05,368][106225] Updated weights for policy 1, policy_version 869182 (0.0007) [2023-12-28 01:29:05,721][106226] Updated weights for policy 0, policy_version 867122 (0.0005) [2023-12-28 01:29:05,769][106226] Updated weights for policy 0, policy_version 867132 (0.0005) [2023-12-28 01:29:05,833][106226] Updated weights for policy 0, policy_version 867142 (0.0006) [2023-12-28 01:29:06,031][106225] Updated weights for policy 1, policy_version 869192 (0.0007) [2023-12-28 01:29:06,088][106225] Updated weights for policy 1, policy_version 869202 (0.0007) [2023-12-28 01:29:06,153][106225] Updated weights for policy 1, policy_version 869212 (0.0008) [2023-12-28 01:29:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 444596224. Throughput: 0: 10092.5, 1: 9978.9. Samples: 444609552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:06,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.868')] [2023-12-28 01:29:06,495][106226] Updated weights for policy 0, policy_version 867152 (0.0008) [2023-12-28 01:29:06,550][106226] Updated weights for policy 0, policy_version 867162 (0.0009) [2023-12-28 01:29:06,607][106226] Updated weights for policy 0, policy_version 867172 (0.0005) [2023-12-28 01:29:06,926][106225] Updated weights for policy 1, policy_version 869222 (0.0009) [2023-12-28 01:29:06,976][106225] Updated weights for policy 1, policy_version 869232 (0.0008) [2023-12-28 01:29:07,024][106225] Updated weights for policy 1, policy_version 869242 (0.0008) [2023-12-28 01:29:07,258][106226] Updated weights for policy 0, policy_version 867182 (0.0010) [2023-12-28 01:29:07,328][106226] Updated weights for policy 0, policy_version 867192 (0.0010) [2023-12-28 01:29:07,390][106226] Updated weights for policy 0, policy_version 867202 (0.0008) [2023-12-28 01:29:07,710][106225] Updated weights for policy 1, policy_version 869252 (0.0007) [2023-12-28 01:29:07,769][106225] Updated weights for policy 1, policy_version 869262 (0.0006) [2023-12-28 01:29:07,820][106225] Updated weights for policy 1, policy_version 869272 (0.0008) [2023-12-28 01:29:08,142][106226] Updated weights for policy 0, policy_version 867212 (0.0008) [2023-12-28 01:29:08,197][106226] Updated weights for policy 0, policy_version 867222 (0.0008) [2023-12-28 01:29:08,253][106226] Updated weights for policy 0, policy_version 867232 (0.0008) [2023-12-28 01:29:08,502][106225] Updated weights for policy 1, policy_version 869282 (0.0008) [2023-12-28 01:29:08,558][106225] Updated weights for policy 1, policy_version 869292 (0.0008) [2023-12-28 01:29:08,617][106225] Updated weights for policy 1, policy_version 869302 (0.0009) [2023-12-28 01:29:08,671][106225] Updated weights for policy 1, policy_version 869312 (0.0009) [2023-12-28 01:29:08,950][106226] Updated weights for policy 0, policy_version 867242 (0.0007) [2023-12-28 01:29:09,015][106226] Updated weights for policy 0, policy_version 867252 (0.0006) [2023-12-28 01:29:09,073][106226] Updated weights for policy 0, policy_version 867262 (0.0008) [2023-12-28 01:29:09,132][106226] Updated weights for policy 0, policy_version 867272 (0.0009) [2023-12-28 01:29:09,449][106225] Updated weights for policy 1, policy_version 869322 (0.0008) [2023-12-28 01:29:09,504][106225] Updated weights for policy 1, policy_version 869332 (0.0009) [2023-12-28 01:29:09,557][106225] Updated weights for policy 1, policy_version 869342 (0.0007) [2023-12-28 01:29:09,845][106226] Updated weights for policy 0, policy_version 867282 (0.0008) [2023-12-28 01:29:09,915][106226] Updated weights for policy 0, policy_version 867292 (0.0009) [2023-12-28 01:29:09,986][106226] Updated weights for policy 0, policy_version 867302 (0.0008) [2023-12-28 01:29:10,387][106225] Updated weights for policy 1, policy_version 869352 (0.0008) [2023-12-28 01:29:10,449][106225] Updated weights for policy 1, policy_version 869362 (0.0008) [2023-12-28 01:29:10,512][106225] Updated weights for policy 1, policy_version 869372 (0.0008) [2023-12-28 01:29:10,694][106226] Updated weights for policy 0, policy_version 867312 (0.0006) [2023-12-28 01:29:10,758][106226] Updated weights for policy 0, policy_version 867322 (0.0008) [2023-12-28 01:29:10,822][106226] Updated weights for policy 0, policy_version 867332 (0.0011) [2023-12-28 01:29:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 444694528. Throughput: 0: 10085.5, 1: 9998.7. Samples: 444668740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:11,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-5.110')] [2023-12-28 01:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000867336_222093312.pth... [2023-12-28 01:29:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000866152_221790208.pth [2023-12-28 01:29:11,215][106225] Updated weights for policy 1, policy_version 869382 (0.0007) [2023-12-28 01:29:11,284][106225] Updated weights for policy 1, policy_version 869392 (0.0007) [2023-12-28 01:29:11,344][106225] Updated weights for policy 1, policy_version 869402 (0.0008) [2023-12-28 01:29:11,388][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000869408_222609408.pth... [2023-12-28 01:29:11,391][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000868224_222306304.pth [2023-12-28 01:29:11,552][106226] Updated weights for policy 0, policy_version 867342 (0.0011) [2023-12-28 01:29:11,641][106226] Updated weights for policy 0, policy_version 867352 (0.0011) [2023-12-28 01:29:11,702][106226] Updated weights for policy 0, policy_version 867362 (0.0011) [2023-12-28 01:29:12,000][106225] Updated weights for policy 1, policy_version 869412 (0.0008) [2023-12-28 01:29:12,064][106225] Updated weights for policy 1, policy_version 869422 (0.0008) [2023-12-28 01:29:12,130][106225] Updated weights for policy 1, policy_version 869432 (0.0006) [2023-12-28 01:29:12,444][106226] Updated weights for policy 0, policy_version 867372 (0.0008) [2023-12-28 01:29:12,508][106226] Updated weights for policy 0, policy_version 867382 (0.0008) [2023-12-28 01:29:12,570][106226] Updated weights for policy 0, policy_version 867392 (0.0006) [2023-12-28 01:29:12,823][106225] Updated weights for policy 1, policy_version 869442 (0.0008) [2023-12-28 01:29:12,890][106225] Updated weights for policy 1, policy_version 869452 (0.0008) [2023-12-28 01:29:12,953][106225] Updated weights for policy 1, policy_version 869462 (0.0006) [2023-12-28 01:29:13,011][106225] Updated weights for policy 1, policy_version 869472 (0.0007) [2023-12-28 01:29:13,168][106226] Updated weights for policy 0, policy_version 867402 (0.0006) [2023-12-28 01:29:13,228][106226] Updated weights for policy 0, policy_version 867412 (0.0005) [2023-12-28 01:29:13,279][106226] Updated weights for policy 0, policy_version 867422 (0.0008) [2023-12-28 01:29:13,328][106226] Updated weights for policy 0, policy_version 867432 (0.0009) [2023-12-28 01:29:13,693][106225] Updated weights for policy 1, policy_version 869482 (0.0009) [2023-12-28 01:29:13,752][106225] Updated weights for policy 1, policy_version 869492 (0.0009) [2023-12-28 01:29:13,802][106225] Updated weights for policy 1, policy_version 869502 (0.0008) [2023-12-28 01:29:13,965][106226] Updated weights for policy 0, policy_version 867442 (0.0008) [2023-12-28 01:29:14,024][106226] Updated weights for policy 0, policy_version 867452 (0.0008) [2023-12-28 01:29:14,084][106226] Updated weights for policy 0, policy_version 867462 (0.0008) [2023-12-28 01:29:14,502][106225] Updated weights for policy 1, policy_version 869512 (0.0006) [2023-12-28 01:29:14,565][106225] Updated weights for policy 1, policy_version 869522 (0.0005) [2023-12-28 01:29:14,627][106225] Updated weights for policy 1, policy_version 869532 (0.0006) [2023-12-28 01:29:14,819][106226] Updated weights for policy 0, policy_version 867472 (0.0008) [2023-12-28 01:29:14,870][106226] Updated weights for policy 0, policy_version 867482 (0.0009) [2023-12-28 01:29:14,919][106226] Updated weights for policy 0, policy_version 867492 (0.0008) [2023-12-28 01:29:15,310][106225] Updated weights for policy 1, policy_version 869542 (0.0007) [2023-12-28 01:29:15,374][106225] Updated weights for policy 1, policy_version 869552 (0.0008) [2023-12-28 01:29:15,441][106225] Updated weights for policy 1, policy_version 869562 (0.0008) [2023-12-28 01:29:15,661][106226] Updated weights for policy 0, policy_version 867502 (0.0007) [2023-12-28 01:29:15,726][106226] Updated weights for policy 0, policy_version 867512 (0.0005) [2023-12-28 01:29:15,787][106226] Updated weights for policy 0, policy_version 867522 (0.0005) [2023-12-28 01:29:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 444792832. Throughput: 0: 10012.3, 1: 9989.1. Samples: 444785588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:16,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.347')] [2023-12-28 01:29:16,216][106225] Updated weights for policy 1, policy_version 869572 (0.0010) [2023-12-28 01:29:16,272][106225] Updated weights for policy 1, policy_version 869582 (0.0008) [2023-12-28 01:29:16,286][106226] Updated weights for policy 0, policy_version 867532 (0.0007) [2023-12-28 01:29:16,326][106225] Updated weights for policy 1, policy_version 869592 (0.0005) [2023-12-28 01:29:16,339][106226] Updated weights for policy 0, policy_version 867542 (0.0010) [2023-12-28 01:29:16,389][106226] Updated weights for policy 0, policy_version 867552 (0.0010) [2023-12-28 01:29:16,974][106225] Updated weights for policy 1, policy_version 869602 (0.0006) [2023-12-28 01:29:17,034][106225] Updated weights for policy 1, policy_version 869612 (0.0008) [2023-12-28 01:29:17,095][106225] Updated weights for policy 1, policy_version 869622 (0.0008) [2023-12-28 01:29:17,116][106226] Updated weights for policy 0, policy_version 867562 (0.0010) [2023-12-28 01:29:17,149][106225] Updated weights for policy 1, policy_version 869632 (0.0007) [2023-12-28 01:29:17,166][106226] Updated weights for policy 0, policy_version 867572 (0.0010) [2023-12-28 01:29:17,227][106226] Updated weights for policy 0, policy_version 867582 (0.0007) [2023-12-28 01:29:17,290][106226] Updated weights for policy 0, policy_version 867592 (0.0009) [2023-12-28 01:29:17,878][106226] Updated weights for policy 0, policy_version 867602 (0.0006) [2023-12-28 01:29:17,921][106225] Updated weights for policy 1, policy_version 869642 (0.0007) [2023-12-28 01:29:17,929][106226] Updated weights for policy 0, policy_version 867612 (0.0005) [2023-12-28 01:29:17,978][106226] Updated weights for policy 0, policy_version 867622 (0.0005) [2023-12-28 01:29:17,981][106225] Updated weights for policy 1, policy_version 869652 (0.0008) [2023-12-28 01:29:18,042][106225] Updated weights for policy 1, policy_version 869662 (0.0008) [2023-12-28 01:29:18,633][106226] Updated weights for policy 0, policy_version 867632 (0.0010) [2023-12-28 01:29:18,683][106226] Updated weights for policy 0, policy_version 867642 (0.0010) [2023-12-28 01:29:18,744][106226] Updated weights for policy 0, policy_version 867652 (0.0011) [2023-12-28 01:29:18,811][106225] Updated weights for policy 1, policy_version 869672 (0.0007) [2023-12-28 01:29:18,870][106225] Updated weights for policy 1, policy_version 869682 (0.0008) [2023-12-28 01:29:18,931][106225] Updated weights for policy 1, policy_version 869692 (0.0007) [2023-12-28 01:29:19,447][106226] Updated weights for policy 0, policy_version 867662 (0.0012) [2023-12-28 01:29:19,513][106226] Updated weights for policy 0, policy_version 867672 (0.0008) [2023-12-28 01:29:19,575][106226] Updated weights for policy 0, policy_version 867682 (0.0008) [2023-12-28 01:29:19,732][106225] Updated weights for policy 1, policy_version 869702 (0.0007) [2023-12-28 01:29:19,797][106225] Updated weights for policy 1, policy_version 869712 (0.0007) [2023-12-28 01:29:19,866][106225] Updated weights for policy 1, policy_version 869722 (0.0009) [2023-12-28 01:29:20,387][106226] Updated weights for policy 0, policy_version 867692 (0.0007) [2023-12-28 01:29:20,450][106226] Updated weights for policy 0, policy_version 867702 (0.0006) [2023-12-28 01:29:20,516][106226] Updated weights for policy 0, policy_version 867712 (0.0009) [2023-12-28 01:29:20,568][106225] Updated weights for policy 1, policy_version 869732 (0.0008) [2023-12-28 01:29:20,630][106225] Updated weights for policy 1, policy_version 869742 (0.0008) [2023-12-28 01:29:20,691][106225] Updated weights for policy 1, policy_version 869752 (0.0009) [2023-12-28 01:29:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 444891136. Throughput: 0: 10032.2, 1: 9881.9. Samples: 444902956. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:21,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.740')] [2023-12-28 01:29:21,212][106226] Updated weights for policy 0, policy_version 867722 (0.0009) [2023-12-28 01:29:21,281][106226] Updated weights for policy 0, policy_version 867732 (0.0008) [2023-12-28 01:29:21,343][106226] Updated weights for policy 0, policy_version 867742 (0.0006) [2023-12-28 01:29:21,416][106226] Updated weights for policy 0, policy_version 867752 (0.0008) [2023-12-28 01:29:21,417][106225] Updated weights for policy 1, policy_version 869762 (0.0008) [2023-12-28 01:29:21,480][106225] Updated weights for policy 1, policy_version 869772 (0.0008) [2023-12-28 01:29:21,543][106225] Updated weights for policy 1, policy_version 869782 (0.0008) [2023-12-28 01:29:21,606][106225] Updated weights for policy 1, policy_version 869792 (0.0008) [2023-12-28 01:29:22,139][106226] Updated weights for policy 0, policy_version 867762 (0.0009) [2023-12-28 01:29:22,190][106226] Updated weights for policy 0, policy_version 867772 (0.0008) [2023-12-28 01:29:22,252][106226] Updated weights for policy 0, policy_version 867782 (0.0008) [2023-12-28 01:29:22,311][106225] Updated weights for policy 1, policy_version 869802 (0.0007) [2023-12-28 01:29:22,388][106225] Updated weights for policy 1, policy_version 869812 (0.0007) [2023-12-28 01:29:22,461][106225] Updated weights for policy 1, policy_version 869822 (0.0006) [2023-12-28 01:29:22,995][106226] Updated weights for policy 0, policy_version 867792 (0.0009) [2023-12-28 01:29:23,061][106226] Updated weights for policy 0, policy_version 867802 (0.0008) [2023-12-28 01:29:23,090][106225] Updated weights for policy 1, policy_version 869832 (0.0006) [2023-12-28 01:29:23,129][106226] Updated weights for policy 0, policy_version 867812 (0.0008) [2023-12-28 01:29:23,152][106225] Updated weights for policy 1, policy_version 869842 (0.0005) [2023-12-28 01:29:23,213][106225] Updated weights for policy 1, policy_version 869852 (0.0006) [2023-12-28 01:29:23,814][106225] Updated weights for policy 1, policy_version 869862 (0.0006) [2023-12-28 01:29:23,863][106225] Updated weights for policy 1, policy_version 869872 (0.0005) [2023-12-28 01:29:23,889][106226] Updated weights for policy 0, policy_version 867822 (0.0008) [2023-12-28 01:29:23,922][106225] Updated weights for policy 1, policy_version 869882 (0.0006) [2023-12-28 01:29:23,941][106226] Updated weights for policy 0, policy_version 867832 (0.0007) [2023-12-28 01:29:23,994][106226] Updated weights for policy 0, policy_version 867842 (0.0008) [2023-12-28 01:29:24,570][106225] Updated weights for policy 1, policy_version 869892 (0.0008) [2023-12-28 01:29:24,622][106225] Updated weights for policy 1, policy_version 869902 (0.0008) [2023-12-28 01:29:24,674][106225] Updated weights for policy 1, policy_version 869912 (0.0008) [2023-12-28 01:29:24,754][106226] Updated weights for policy 0, policy_version 867852 (0.0008) [2023-12-28 01:29:24,814][106226] Updated weights for policy 0, policy_version 867862 (0.0008) [2023-12-28 01:29:24,874][106226] Updated weights for policy 0, policy_version 867872 (0.0009) [2023-12-28 01:29:25,301][106225] Updated weights for policy 1, policy_version 869922 (0.0008) [2023-12-28 01:29:25,356][106225] Updated weights for policy 1, policy_version 869932 (0.0008) [2023-12-28 01:29:25,409][106225] Updated weights for policy 1, policy_version 869942 (0.0008) [2023-12-28 01:29:25,466][106225] Updated weights for policy 1, policy_version 869952 (0.0009) [2023-12-28 01:29:25,660][106226] Updated weights for policy 0, policy_version 867882 (0.0008) [2023-12-28 01:29:25,718][106226] Updated weights for policy 0, policy_version 867892 (0.0009) [2023-12-28 01:29:25,781][106226] Updated weights for policy 0, policy_version 867902 (0.0009) [2023-12-28 01:29:25,842][106226] Updated weights for policy 0, policy_version 867912 (0.0009) [2023-12-28 01:29:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 444989440. Throughput: 0: 9993.8, 1: 9908.3. Samples: 444961192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:26,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-4.653')] [2023-12-28 01:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000867912_222240768.pth... [2023-12-28 01:29:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000866760_221945856.pth [2023-12-28 01:29:26,220][106225] Updated weights for policy 1, policy_version 869962 (0.0006) [2023-12-28 01:29:26,269][106225] Updated weights for policy 1, policy_version 869972 (0.0008) [2023-12-28 01:29:26,331][106225] Updated weights for policy 1, policy_version 869982 (0.0009) [2023-12-28 01:29:26,341][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000869984_222756864.pth... [2023-12-28 01:29:26,344][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000868800_222453760.pth [2023-12-28 01:29:26,564][106226] Updated weights for policy 0, policy_version 867922 (0.0008) [2023-12-28 01:29:26,618][106226] Updated weights for policy 0, policy_version 867932 (0.0008) [2023-12-28 01:29:26,680][106226] Updated weights for policy 0, policy_version 867942 (0.0010) [2023-12-28 01:29:27,012][106225] Updated weights for policy 1, policy_version 869992 (0.0008) [2023-12-28 01:29:27,063][106225] Updated weights for policy 1, policy_version 870002 (0.0008) [2023-12-28 01:29:27,107][106225] Updated weights for policy 1, policy_version 870012 (0.0008) [2023-12-28 01:29:27,426][106226] Updated weights for policy 0, policy_version 867952 (0.0009) [2023-12-28 01:29:27,473][106226] Updated weights for policy 0, policy_version 867962 (0.0007) [2023-12-28 01:29:27,526][106226] Updated weights for policy 0, policy_version 867972 (0.0010) [2023-12-28 01:29:27,777][106225] Updated weights for policy 1, policy_version 870022 (0.0009) [2023-12-28 01:29:27,841][106225] Updated weights for policy 1, policy_version 870032 (0.0008) [2023-12-28 01:29:27,898][106225] Updated weights for policy 1, policy_version 870042 (0.0009) [2023-12-28 01:29:28,250][106226] Updated weights for policy 0, policy_version 867982 (0.0008) [2023-12-28 01:29:28,294][106226] Updated weights for policy 0, policy_version 867992 (0.0008) [2023-12-28 01:29:28,352][106226] Updated weights for policy 0, policy_version 868002 (0.0008) [2023-12-28 01:29:28,612][106225] Updated weights for policy 1, policy_version 870052 (0.0008) [2023-12-28 01:29:28,664][106225] Updated weights for policy 1, policy_version 870062 (0.0008) [2023-12-28 01:29:28,717][106225] Updated weights for policy 1, policy_version 870072 (0.0009) [2023-12-28 01:29:29,057][106226] Updated weights for policy 0, policy_version 868012 (0.0007) [2023-12-28 01:29:29,117][106226] Updated weights for policy 0, policy_version 868022 (0.0005) [2023-12-28 01:29:29,187][106226] Updated weights for policy 0, policy_version 868032 (0.0006) [2023-12-28 01:29:29,556][106225] Updated weights for policy 1, policy_version 870082 (0.0009) [2023-12-28 01:29:29,611][106225] Updated weights for policy 1, policy_version 870092 (0.0008) [2023-12-28 01:29:29,677][106225] Updated weights for policy 1, policy_version 870102 (0.0006) [2023-12-28 01:29:29,739][106225] Updated weights for policy 1, policy_version 870112 (0.0007) [2023-12-28 01:29:29,847][106226] Updated weights for policy 0, policy_version 868042 (0.0007) [2023-12-28 01:29:29,910][106226] Updated weights for policy 0, policy_version 868052 (0.0008) [2023-12-28 01:29:29,975][106226] Updated weights for policy 0, policy_version 868062 (0.0009) [2023-12-28 01:29:30,028][106226] Updated weights for policy 0, policy_version 868072 (0.0008) [2023-12-28 01:29:30,405][106225] Updated weights for policy 1, policy_version 870122 (0.0010) [2023-12-28 01:29:30,455][106225] Updated weights for policy 1, policy_version 870132 (0.0010) [2023-12-28 01:29:30,505][106225] Updated weights for policy 1, policy_version 870142 (0.0010) [2023-12-28 01:29:30,709][106226] Updated weights for policy 0, policy_version 868082 (0.0005) [2023-12-28 01:29:30,761][106226] Updated weights for policy 0, policy_version 868092 (0.0005) [2023-12-28 01:29:30,816][106226] Updated weights for policy 0, policy_version 868102 (0.0005) [2023-12-28 01:29:31,081][106225] Updated weights for policy 1, policy_version 870152 (0.0007) [2023-12-28 01:29:31,149][106225] Updated weights for policy 1, policy_version 870162 (0.0010) [2023-12-28 01:29:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 445087744. Throughput: 0: 9966.1, 1: 9879.1. Samples: 445078336. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:31,175][105115] Avg episode reward: [(0, '-4.260'), (1, '-4.863')] [2023-12-28 01:29:31,212][106225] Updated weights for policy 1, policy_version 870172 (0.0011) [2023-12-28 01:29:31,483][106226] Updated weights for policy 0, policy_version 868112 (0.0007) [2023-12-28 01:29:31,539][106226] Updated weights for policy 0, policy_version 868122 (0.0007) [2023-12-28 01:29:31,605][106226] Updated weights for policy 0, policy_version 868132 (0.0008) [2023-12-28 01:29:31,936][106225] Updated weights for policy 1, policy_version 870182 (0.0010) [2023-12-28 01:29:31,991][106225] Updated weights for policy 1, policy_version 870192 (0.0010) [2023-12-28 01:29:32,041][106225] Updated weights for policy 1, policy_version 870202 (0.0010) [2023-12-28 01:29:32,341][106226] Updated weights for policy 0, policy_version 868142 (0.0008) [2023-12-28 01:29:32,407][106226] Updated weights for policy 0, policy_version 868152 (0.0008) [2023-12-28 01:29:32,464][106226] Updated weights for policy 0, policy_version 868162 (0.0007) [2023-12-28 01:29:32,732][106225] Updated weights for policy 1, policy_version 870212 (0.0009) [2023-12-28 01:29:32,791][106225] Updated weights for policy 1, policy_version 870222 (0.0008) [2023-12-28 01:29:32,854][106225] Updated weights for policy 1, policy_version 870232 (0.0009) [2023-12-28 01:29:33,152][106226] Updated weights for policy 0, policy_version 868172 (0.0007) [2023-12-28 01:29:33,208][106226] Updated weights for policy 0, policy_version 868182 (0.0008) [2023-12-28 01:29:33,270][106226] Updated weights for policy 0, policy_version 868192 (0.0009) [2023-12-28 01:29:33,618][106225] Updated weights for policy 1, policy_version 870242 (0.0009) [2023-12-28 01:29:33,670][106225] Updated weights for policy 1, policy_version 870252 (0.0008) [2023-12-28 01:29:33,753][106225] Updated weights for policy 1, policy_version 870262 (0.0009) [2023-12-28 01:29:33,797][106225] Updated weights for policy 1, policy_version 870272 (0.0008) [2023-12-28 01:29:33,883][106226] Updated weights for policy 0, policy_version 868202 (0.0008) [2023-12-28 01:29:33,936][106226] Updated weights for policy 0, policy_version 868212 (0.0008) [2023-12-28 01:29:33,984][106226] Updated weights for policy 0, policy_version 868222 (0.0008) [2023-12-28 01:29:34,035][106226] Updated weights for policy 0, policy_version 868232 (0.0008) [2023-12-28 01:29:34,510][106225] Updated weights for policy 1, policy_version 870282 (0.0011) [2023-12-28 01:29:34,575][106225] Updated weights for policy 1, policy_version 870292 (0.0010) [2023-12-28 01:29:34,638][106225] Updated weights for policy 1, policy_version 870302 (0.0006) [2023-12-28 01:29:34,790][106226] Updated weights for policy 0, policy_version 868242 (0.0008) [2023-12-28 01:29:34,845][106226] Updated weights for policy 0, policy_version 868252 (0.0010) [2023-12-28 01:29:34,905][106226] Updated weights for policy 0, policy_version 868262 (0.0009) [2023-12-28 01:29:35,232][106225] Updated weights for policy 1, policy_version 870312 (0.0009) [2023-12-28 01:29:35,283][106225] Updated weights for policy 1, policy_version 870322 (0.0007) [2023-12-28 01:29:35,342][106225] Updated weights for policy 1, policy_version 870332 (0.0005) [2023-12-28 01:29:35,631][106226] Updated weights for policy 0, policy_version 868272 (0.0008) [2023-12-28 01:29:35,680][106226] Updated weights for policy 0, policy_version 868282 (0.0008) [2023-12-28 01:29:35,732][106226] Updated weights for policy 0, policy_version 868292 (0.0005) [2023-12-28 01:29:35,974][106225] Updated weights for policy 1, policy_version 870342 (0.0005) [2023-12-28 01:29:36,040][106225] Updated weights for policy 1, policy_version 870352 (0.0010) [2023-12-28 01:29:36,106][106225] Updated weights for policy 1, policy_version 870362 (0.0010) [2023-12-28 01:29:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 445194240. Throughput: 0: 9918.5, 1: 9939.3. Samples: 445200368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:36,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.880')] [2023-12-28 01:29:36,420][106226] Updated weights for policy 0, policy_version 868302 (0.0006) [2023-12-28 01:29:36,487][106226] Updated weights for policy 0, policy_version 868312 (0.0006) [2023-12-28 01:29:36,550][106226] Updated weights for policy 0, policy_version 868322 (0.0007) [2023-12-28 01:29:36,802][106225] Updated weights for policy 1, policy_version 870372 (0.0011) [2023-12-28 01:29:36,862][106225] Updated weights for policy 1, policy_version 870382 (0.0010) [2023-12-28 01:29:36,919][106225] Updated weights for policy 1, policy_version 870392 (0.0010) [2023-12-28 01:29:37,193][106226] Updated weights for policy 0, policy_version 868332 (0.0008) [2023-12-28 01:29:37,246][106226] Updated weights for policy 0, policy_version 868342 (0.0009) [2023-12-28 01:29:37,296][106226] Updated weights for policy 0, policy_version 868352 (0.0009) [2023-12-28 01:29:37,546][106225] Updated weights for policy 1, policy_version 870402 (0.0010) [2023-12-28 01:29:37,600][106225] Updated weights for policy 1, policy_version 870412 (0.0006) [2023-12-28 01:29:37,650][106225] Updated weights for policy 1, policy_version 870422 (0.0006) [2023-12-28 01:29:37,703][106225] Updated weights for policy 1, policy_version 870432 (0.0008) [2023-12-28 01:29:38,059][106226] Updated weights for policy 0, policy_version 868362 (0.0009) [2023-12-28 01:29:38,120][106226] Updated weights for policy 0, policy_version 868372 (0.0007) [2023-12-28 01:29:38,172][106226] Updated weights for policy 0, policy_version 868382 (0.0007) [2023-12-28 01:29:38,222][106226] Updated weights for policy 0, policy_version 868392 (0.0008) [2023-12-28 01:29:38,390][106225] Updated weights for policy 1, policy_version 870442 (0.0008) [2023-12-28 01:29:38,454][106225] Updated weights for policy 1, policy_version 870452 (0.0010) [2023-12-28 01:29:38,515][106225] Updated weights for policy 1, policy_version 870462 (0.0010) [2023-12-28 01:29:39,010][106226] Updated weights for policy 0, policy_version 868402 (0.0008) [2023-12-28 01:29:39,057][106226] Updated weights for policy 0, policy_version 868412 (0.0008) [2023-12-28 01:29:39,107][106226] Updated weights for policy 0, policy_version 868422 (0.0008) [2023-12-28 01:29:39,155][106225] Updated weights for policy 1, policy_version 870472 (0.0010) [2023-12-28 01:29:39,212][106225] Updated weights for policy 1, policy_version 870482 (0.0010) [2023-12-28 01:29:39,286][106225] Updated weights for policy 1, policy_version 870492 (0.0010) [2023-12-28 01:29:39,866][106226] Updated weights for policy 0, policy_version 868432 (0.0008) [2023-12-28 01:29:39,935][106226] Updated weights for policy 0, policy_version 868442 (0.0009) [2023-12-28 01:29:39,995][106226] Updated weights for policy 0, policy_version 868452 (0.0008) [2023-12-28 01:29:40,070][106225] Updated weights for policy 1, policy_version 870502 (0.0010) [2023-12-28 01:29:40,132][106225] Updated weights for policy 1, policy_version 870512 (0.0011) [2023-12-28 01:29:40,193][106225] Updated weights for policy 1, policy_version 870522 (0.0010) [2023-12-28 01:29:40,722][106226] Updated weights for policy 0, policy_version 868462 (0.0009) [2023-12-28 01:29:40,783][106226] Updated weights for policy 0, policy_version 868472 (0.0011) [2023-12-28 01:29:40,842][106226] Updated weights for policy 0, policy_version 868482 (0.0009) [2023-12-28 01:29:40,939][106225] Updated weights for policy 1, policy_version 870532 (0.0010) [2023-12-28 01:29:40,999][106225] Updated weights for policy 1, policy_version 870542 (0.0010) [2023-12-28 01:29:41,067][106225] Updated weights for policy 1, policy_version 870552 (0.0009) [2023-12-28 01:29:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 445292544. Throughput: 0: 9910.7, 1: 9967.6. Samples: 445259892. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:41,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.905')] [2023-12-28 01:29:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000868488_222388224.pth... [2023-12-28 01:29:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000870560_222904320.pth... [2023-12-28 01:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000869408_222609408.pth [2023-12-28 01:29:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000867336_222093312.pth [2023-12-28 01:29:41,499][106226] Updated weights for policy 0, policy_version 868492 (0.0005) [2023-12-28 01:29:41,564][106226] Updated weights for policy 0, policy_version 868502 (0.0007) [2023-12-28 01:29:41,630][106226] Updated weights for policy 0, policy_version 868512 (0.0008) [2023-12-28 01:29:41,887][106225] Updated weights for policy 1, policy_version 870562 (0.0008) [2023-12-28 01:29:41,953][106225] Updated weights for policy 1, policy_version 870572 (0.0009) [2023-12-28 01:29:42,019][106225] Updated weights for policy 1, policy_version 870582 (0.0008) [2023-12-28 01:29:42,081][106225] Updated weights for policy 1, policy_version 870592 (0.0008) [2023-12-28 01:29:42,265][106226] Updated weights for policy 0, policy_version 868522 (0.0008) [2023-12-28 01:29:42,330][106226] Updated weights for policy 0, policy_version 868532 (0.0009) [2023-12-28 01:29:42,396][106226] Updated weights for policy 0, policy_version 868542 (0.0009) [2023-12-28 01:29:42,450][106226] Updated weights for policy 0, policy_version 868552 (0.0008) [2023-12-28 01:29:42,802][106225] Updated weights for policy 1, policy_version 870602 (0.0008) [2023-12-28 01:29:42,868][106225] Updated weights for policy 1, policy_version 870612 (0.0008) [2023-12-28 01:29:42,923][106225] Updated weights for policy 1, policy_version 870622 (0.0008) [2023-12-28 01:29:43,140][106226] Updated weights for policy 0, policy_version 868562 (0.0005) [2023-12-28 01:29:43,202][106226] Updated weights for policy 0, policy_version 868572 (0.0005) [2023-12-28 01:29:43,260][106226] Updated weights for policy 0, policy_version 868582 (0.0005) [2023-12-28 01:29:43,526][106225] Updated weights for policy 1, policy_version 870632 (0.0006) [2023-12-28 01:29:43,597][106225] Updated weights for policy 1, policy_version 870642 (0.0006) [2023-12-28 01:29:43,654][106225] Updated weights for policy 1, policy_version 870652 (0.0009) [2023-12-28 01:29:43,920][106226] Updated weights for policy 0, policy_version 868592 (0.0008) [2023-12-28 01:29:43,970][106226] Updated weights for policy 0, policy_version 868602 (0.0009) [2023-12-28 01:29:44,024][106226] Updated weights for policy 0, policy_version 868612 (0.0009) [2023-12-28 01:29:44,336][106225] Updated weights for policy 1, policy_version 870662 (0.0006) [2023-12-28 01:29:44,394][106225] Updated weights for policy 1, policy_version 870672 (0.0005) [2023-12-28 01:29:44,439][106225] Updated weights for policy 1, policy_version 870682 (0.0005) [2023-12-28 01:29:44,782][106226] Updated weights for policy 0, policy_version 868622 (0.0008) [2023-12-28 01:29:44,841][106226] Updated weights for policy 0, policy_version 868632 (0.0008) [2023-12-28 01:29:44,901][106226] Updated weights for policy 0, policy_version 868642 (0.0008) [2023-12-28 01:29:45,152][106225] Updated weights for policy 1, policy_version 870692 (0.0007) [2023-12-28 01:29:45,214][106225] Updated weights for policy 1, policy_version 870702 (0.0011) [2023-12-28 01:29:45,270][106225] Updated weights for policy 1, policy_version 870712 (0.0011) [2023-12-28 01:29:45,617][106226] Updated weights for policy 0, policy_version 868652 (0.0008) [2023-12-28 01:29:45,666][106226] Updated weights for policy 0, policy_version 868662 (0.0009) [2023-12-28 01:29:45,716][106226] Updated weights for policy 0, policy_version 868672 (0.0009) [2023-12-28 01:29:45,890][106225] Updated weights for policy 1, policy_version 870722 (0.0009) [2023-12-28 01:29:45,947][106225] Updated weights for policy 1, policy_version 870732 (0.0005) [2023-12-28 01:29:46,007][106225] Updated weights for policy 1, policy_version 870742 (0.0007) [2023-12-28 01:29:46,058][106225] Updated weights for policy 1, policy_version 870752 (0.0007) [2023-12-28 01:29:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 445390848. Throughput: 0: 9895.7, 1: 9935.0. Samples: 445376812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:46,175][105115] Avg episode reward: [(0, '-4.160'), (1, '-4.718')] [2023-12-28 01:29:46,374][106226] Updated weights for policy 0, policy_version 868682 (0.0006) [2023-12-28 01:29:46,430][106226] Updated weights for policy 0, policy_version 868692 (0.0005) [2023-12-28 01:29:46,496][106226] Updated weights for policy 0, policy_version 868702 (0.0008) [2023-12-28 01:29:46,553][106226] Updated weights for policy 0, policy_version 868712 (0.0008) [2023-12-28 01:29:46,695][106225] Updated weights for policy 1, policy_version 870762 (0.0008) [2023-12-28 01:29:46,746][106225] Updated weights for policy 1, policy_version 870772 (0.0006) [2023-12-28 01:29:46,804][106225] Updated weights for policy 1, policy_version 870782 (0.0008) [2023-12-28 01:29:47,267][106226] Updated weights for policy 0, policy_version 868722 (0.0010) [2023-12-28 01:29:47,329][106226] Updated weights for policy 0, policy_version 868732 (0.0009) [2023-12-28 01:29:47,391][106226] Updated weights for policy 0, policy_version 868742 (0.0008) [2023-12-28 01:29:47,433][106225] Updated weights for policy 1, policy_version 870792 (0.0006) [2023-12-28 01:29:47,479][106225] Updated weights for policy 1, policy_version 870802 (0.0005) [2023-12-28 01:29:47,532][106225] Updated weights for policy 1, policy_version 870812 (0.0005) [2023-12-28 01:29:48,099][106225] Updated weights for policy 1, policy_version 870822 (0.0007) [2023-12-28 01:29:48,147][106226] Updated weights for policy 0, policy_version 868752 (0.0008) [2023-12-28 01:29:48,154][106225] Updated weights for policy 1, policy_version 870832 (0.0009) [2023-12-28 01:29:48,202][106226] Updated weights for policy 0, policy_version 868762 (0.0007) [2023-12-28 01:29:48,218][106225] Updated weights for policy 1, policy_version 870842 (0.0006) [2023-12-28 01:29:48,251][106226] Updated weights for policy 0, policy_version 868772 (0.0008) [2023-12-28 01:29:48,976][106225] Updated weights for policy 1, policy_version 870852 (0.0006) [2023-12-28 01:29:48,997][106226] Updated weights for policy 0, policy_version 868782 (0.0008) [2023-12-28 01:29:49,024][106225] Updated weights for policy 1, policy_version 870862 (0.0006) [2023-12-28 01:29:49,049][106226] Updated weights for policy 0, policy_version 868792 (0.0007) [2023-12-28 01:29:49,082][106225] Updated weights for policy 1, policy_version 870872 (0.0008) [2023-12-28 01:29:49,103][106226] Updated weights for policy 0, policy_version 868802 (0.0006) [2023-12-28 01:29:49,833][106225] Updated weights for policy 1, policy_version 870882 (0.0008) [2023-12-28 01:29:49,849][106226] Updated weights for policy 0, policy_version 868812 (0.0007) [2023-12-28 01:29:49,892][106225] Updated weights for policy 1, policy_version 870892 (0.0010) [2023-12-28 01:29:49,915][106226] Updated weights for policy 0, policy_version 868822 (0.0010) [2023-12-28 01:29:49,955][106225] Updated weights for policy 1, policy_version 870902 (0.0010) [2023-12-28 01:29:49,985][106226] Updated weights for policy 0, policy_version 868832 (0.0010) [2023-12-28 01:29:50,020][106225] Updated weights for policy 1, policy_version 870912 (0.0011) [2023-12-28 01:29:50,669][106226] Updated weights for policy 0, policy_version 868842 (0.0011) [2023-12-28 01:29:50,733][106226] Updated weights for policy 0, policy_version 868852 (0.0007) [2023-12-28 01:29:50,796][106226] Updated weights for policy 0, policy_version 868862 (0.0007) [2023-12-28 01:29:50,810][106225] Updated weights for policy 1, policy_version 870922 (0.0007) [2023-12-28 01:29:50,854][106226] Updated weights for policy 0, policy_version 868872 (0.0006) [2023-12-28 01:29:50,867][106225] Updated weights for policy 1, policy_version 870932 (0.0008) [2023-12-28 01:29:50,932][106225] Updated weights for policy 1, policy_version 870942 (0.0006) [2023-12-28 01:29:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 445489152. Throughput: 0: 9819.3, 1: 9885.7. Samples: 445496276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:51,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-5.122')] [2023-12-28 01:29:51,613][106226] Updated weights for policy 0, policy_version 868882 (0.0011) [2023-12-28 01:29:51,636][106225] Updated weights for policy 1, policy_version 870952 (0.0008) [2023-12-28 01:29:51,685][106226] Updated weights for policy 0, policy_version 868892 (0.0009) [2023-12-28 01:29:51,692][106225] Updated weights for policy 1, policy_version 870962 (0.0006) [2023-12-28 01:29:51,756][106226] Updated weights for policy 0, policy_version 868902 (0.0009) [2023-12-28 01:29:51,767][106225] Updated weights for policy 1, policy_version 870972 (0.0008) [2023-12-28 01:29:52,471][106226] Updated weights for policy 0, policy_version 868912 (0.0008) [2023-12-28 01:29:52,494][106225] Updated weights for policy 1, policy_version 870982 (0.0010) [2023-12-28 01:29:52,535][106226] Updated weights for policy 0, policy_version 868922 (0.0007) [2023-12-28 01:29:52,551][106225] Updated weights for policy 1, policy_version 870992 (0.0011) [2023-12-28 01:29:52,600][106226] Updated weights for policy 0, policy_version 868932 (0.0006) [2023-12-28 01:29:52,606][106225] Updated weights for policy 1, policy_version 871002 (0.0010) [2023-12-28 01:29:53,234][106226] Updated weights for policy 0, policy_version 868942 (0.0007) [2023-12-28 01:29:53,285][106226] Updated weights for policy 0, policy_version 868952 (0.0008) [2023-12-28 01:29:53,300][106225] Updated weights for policy 1, policy_version 871012 (0.0010) [2023-12-28 01:29:53,337][106226] Updated weights for policy 0, policy_version 868962 (0.0007) [2023-12-28 01:29:53,349][106225] Updated weights for policy 1, policy_version 871022 (0.0010) [2023-12-28 01:29:53,406][106225] Updated weights for policy 1, policy_version 871032 (0.0010) [2023-12-28 01:29:54,014][106226] Updated weights for policy 0, policy_version 868972 (0.0007) [2023-12-28 01:29:54,068][106226] Updated weights for policy 0, policy_version 868982 (0.0008) [2023-12-28 01:29:54,106][106225] Updated weights for policy 1, policy_version 871042 (0.0007) [2023-12-28 01:29:54,115][106226] Updated weights for policy 0, policy_version 868992 (0.0009) [2023-12-28 01:29:54,166][106225] Updated weights for policy 1, policy_version 871052 (0.0007) [2023-12-28 01:29:54,226][106225] Updated weights for policy 1, policy_version 871062 (0.0007) [2023-12-28 01:29:54,294][106225] Updated weights for policy 1, policy_version 871072 (0.0006) [2023-12-28 01:29:54,772][106226] Updated weights for policy 0, policy_version 869002 (0.0007) [2023-12-28 01:29:54,835][106226] Updated weights for policy 0, policy_version 869012 (0.0006) [2023-12-28 01:29:54,905][106226] Updated weights for policy 0, policy_version 869022 (0.0009) [2023-12-28 01:29:54,930][106225] Updated weights for policy 1, policy_version 871082 (0.0009) [2023-12-28 01:29:54,952][106226] Updated weights for policy 0, policy_version 869032 (0.0006) [2023-12-28 01:29:54,988][106225] Updated weights for policy 1, policy_version 871092 (0.0010) [2023-12-28 01:29:55,039][106225] Updated weights for policy 1, policy_version 871102 (0.0009) [2023-12-28 01:29:55,609][106225] Updated weights for policy 1, policy_version 871112 (0.0006) [2023-12-28 01:29:55,677][106225] Updated weights for policy 1, policy_version 871122 (0.0009) [2023-12-28 01:29:55,731][106226] Updated weights for policy 0, policy_version 869042 (0.0006) [2023-12-28 01:29:55,734][106225] Updated weights for policy 1, policy_version 871132 (0.0010) [2023-12-28 01:29:55,785][106226] Updated weights for policy 0, policy_version 869052 (0.0007) [2023-12-28 01:29:55,841][106226] Updated weights for policy 0, policy_version 869062 (0.0007) [2023-12-28 01:29:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 445587456. Throughput: 0: 9812.5, 1: 9891.5. Samples: 445555420. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:29:56,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-5.068')] [2023-12-28 01:29:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000871136_223051776.pth... [2023-12-28 01:29:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000869064_222535680.pth... [2023-12-28 01:29:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000867912_222240768.pth [2023-12-28 01:29:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000869984_222756864.pth [2023-12-28 01:29:56,367][106225] Updated weights for policy 1, policy_version 871142 (0.0009) [2023-12-28 01:29:56,419][106225] Updated weights for policy 1, policy_version 871152 (0.0012) [2023-12-28 01:29:56,482][106225] Updated weights for policy 1, policy_version 871162 (0.0008) [2023-12-28 01:29:56,614][106226] Updated weights for policy 0, policy_version 869072 (0.0009) [2023-12-28 01:29:56,663][106226] Updated weights for policy 0, policy_version 869082 (0.0008) [2023-12-28 01:29:56,712][106226] Updated weights for policy 0, policy_version 869092 (0.0009) [2023-12-28 01:29:57,062][106225] Updated weights for policy 1, policy_version 871172 (0.0007) [2023-12-28 01:29:57,129][106225] Updated weights for policy 1, policy_version 871182 (0.0010) [2023-12-28 01:29:57,188][106225] Updated weights for policy 1, policy_version 871192 (0.0006) [2023-12-28 01:29:57,450][106226] Updated weights for policy 0, policy_version 869102 (0.0007) [2023-12-28 01:29:57,506][106226] Updated weights for policy 0, policy_version 869112 (0.0008) [2023-12-28 01:29:57,561][106226] Updated weights for policy 0, policy_version 869122 (0.0007) [2023-12-28 01:29:57,851][106225] Updated weights for policy 1, policy_version 871202 (0.0007) [2023-12-28 01:29:57,904][106225] Updated weights for policy 1, policy_version 871212 (0.0005) [2023-12-28 01:29:57,959][106225] Updated weights for policy 1, policy_version 871222 (0.0005) [2023-12-28 01:29:58,010][106225] Updated weights for policy 1, policy_version 871232 (0.0006) [2023-12-28 01:29:58,296][106226] Updated weights for policy 0, policy_version 869132 (0.0008) [2023-12-28 01:29:58,383][106226] Updated weights for policy 0, policy_version 869142 (0.0008) [2023-12-28 01:29:58,448][106226] Updated weights for policy 0, policy_version 869152 (0.0007) [2023-12-28 01:29:58,732][106225] Updated weights for policy 1, policy_version 871242 (0.0008) [2023-12-28 01:29:58,796][106225] Updated weights for policy 1, policy_version 871252 (0.0009) [2023-12-28 01:29:58,865][106225] Updated weights for policy 1, policy_version 871262 (0.0007) [2023-12-28 01:29:59,180][106226] Updated weights for policy 0, policy_version 869162 (0.0007) [2023-12-28 01:29:59,245][106226] Updated weights for policy 0, policy_version 869172 (0.0010) [2023-12-28 01:29:59,314][106226] Updated weights for policy 0, policy_version 869182 (0.0009) [2023-12-28 01:29:59,382][106226] Updated weights for policy 0, policy_version 869192 (0.0008) [2023-12-28 01:29:59,669][106225] Updated weights for policy 1, policy_version 871272 (0.0009) [2023-12-28 01:29:59,736][106225] Updated weights for policy 1, policy_version 871282 (0.0010) [2023-12-28 01:29:59,795][106225] Updated weights for policy 1, policy_version 871292 (0.0008) [2023-12-28 01:30:00,043][106226] Updated weights for policy 0, policy_version 869202 (0.0007) [2023-12-28 01:30:00,107][106226] Updated weights for policy 0, policy_version 869212 (0.0009) [2023-12-28 01:30:00,167][106226] Updated weights for policy 0, policy_version 869222 (0.0009) [2023-12-28 01:30:00,507][106225] Updated weights for policy 1, policy_version 871302 (0.0007) [2023-12-28 01:30:00,557][106225] Updated weights for policy 1, policy_version 871312 (0.0006) [2023-12-28 01:30:00,612][106225] Updated weights for policy 1, policy_version 871322 (0.0007) [2023-12-28 01:30:00,898][106226] Updated weights for policy 0, policy_version 869232 (0.0007) [2023-12-28 01:30:00,952][106226] Updated weights for policy 0, policy_version 869242 (0.0010) [2023-12-28 01:30:01,004][106226] Updated weights for policy 0, policy_version 869252 (0.0007) [2023-12-28 01:30:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 445685760. Throughput: 0: 9783.7, 1: 9958.8. Samples: 445674004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:01,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-4.980')] [2023-12-28 01:30:01,191][106225] Updated weights for policy 1, policy_version 871332 (0.0008) [2023-12-28 01:30:01,247][106225] Updated weights for policy 1, policy_version 871342 (0.0008) [2023-12-28 01:30:01,313][106225] Updated weights for policy 1, policy_version 871352 (0.0009) [2023-12-28 01:30:01,641][106226] Updated weights for policy 0, policy_version 869262 (0.0009) [2023-12-28 01:30:01,692][106226] Updated weights for policy 0, policy_version 869272 (0.0010) [2023-12-28 01:30:01,764][106226] Updated weights for policy 0, policy_version 869282 (0.0007) [2023-12-28 01:30:02,006][106225] Updated weights for policy 1, policy_version 871362 (0.0008) [2023-12-28 01:30:02,066][106225] Updated weights for policy 1, policy_version 871372 (0.0007) [2023-12-28 01:30:02,129][106225] Updated weights for policy 1, policy_version 871382 (0.0008) [2023-12-28 01:30:02,189][106225] Updated weights for policy 1, policy_version 871392 (0.0005) [2023-12-28 01:30:02,483][106226] Updated weights for policy 0, policy_version 869292 (0.0011) [2023-12-28 01:30:02,537][106226] Updated weights for policy 0, policy_version 869302 (0.0010) [2023-12-28 01:30:02,591][106226] Updated weights for policy 0, policy_version 869312 (0.0010) [2023-12-28 01:30:02,873][106225] Updated weights for policy 1, policy_version 871402 (0.0008) [2023-12-28 01:30:02,926][106225] Updated weights for policy 1, policy_version 871412 (0.0008) [2023-12-28 01:30:02,984][106225] Updated weights for policy 1, policy_version 871422 (0.0008) [2023-12-28 01:30:03,310][106226] Updated weights for policy 0, policy_version 869322 (0.0011) [2023-12-28 01:30:03,359][106226] Updated weights for policy 0, policy_version 869332 (0.0010) [2023-12-28 01:30:03,405][106226] Updated weights for policy 0, policy_version 869342 (0.0010) [2023-12-28 01:30:03,463][106226] Updated weights for policy 0, policy_version 869352 (0.0005) [2023-12-28 01:30:03,649][106225] Updated weights for policy 1, policy_version 871432 (0.0006) [2023-12-28 01:30:03,700][106225] Updated weights for policy 1, policy_version 871442 (0.0008) [2023-12-28 01:30:03,746][106225] Updated weights for policy 1, policy_version 871452 (0.0010) [2023-12-28 01:30:04,141][106226] Updated weights for policy 0, policy_version 869362 (0.0008) [2023-12-28 01:30:04,198][106226] Updated weights for policy 0, policy_version 869372 (0.0008) [2023-12-28 01:30:04,268][106226] Updated weights for policy 0, policy_version 869382 (0.0011) [2023-12-28 01:30:04,467][106225] Updated weights for policy 1, policy_version 871462 (0.0008) [2023-12-28 01:30:04,524][106225] Updated weights for policy 1, policy_version 871472 (0.0006) [2023-12-28 01:30:04,586][106225] Updated weights for policy 1, policy_version 871482 (0.0007) [2023-12-28 01:30:04,972][106226] Updated weights for policy 0, policy_version 869392 (0.0010) [2023-12-28 01:30:05,033][106226] Updated weights for policy 0, policy_version 869402 (0.0010) [2023-12-28 01:30:05,092][106226] Updated weights for policy 0, policy_version 869412 (0.0010) [2023-12-28 01:30:05,173][106225] Updated weights for policy 1, policy_version 871492 (0.0006) [2023-12-28 01:30:05,234][106225] Updated weights for policy 1, policy_version 871502 (0.0005) [2023-12-28 01:30:05,290][106225] Updated weights for policy 1, policy_version 871512 (0.0005) [2023-12-28 01:30:05,782][106226] Updated weights for policy 0, policy_version 869422 (0.0011) [2023-12-28 01:30:05,835][106226] Updated weights for policy 0, policy_version 869432 (0.0010) [2023-12-28 01:30:05,878][106225] Updated weights for policy 1, policy_version 871522 (0.0007) [2023-12-28 01:30:05,891][106226] Updated weights for policy 0, policy_version 869442 (0.0010) [2023-12-28 01:30:05,931][106225] Updated weights for policy 1, policy_version 871532 (0.0006) [2023-12-28 01:30:05,981][106225] Updated weights for policy 1, policy_version 871542 (0.0007) [2023-12-28 01:30:06,035][106225] Updated weights for policy 1, policy_version 871552 (0.0008) [2023-12-28 01:30:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 445792256. Throughput: 0: 9747.8, 1: 10125.0. Samples: 445797228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:06,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-5.053')] [2023-12-28 01:30:06,617][106226] Updated weights for policy 0, policy_version 869452 (0.0011) [2023-12-28 01:30:06,672][106226] Updated weights for policy 0, policy_version 869462 (0.0011) [2023-12-28 01:30:06,740][106226] Updated weights for policy 0, policy_version 869472 (0.0011) [2023-12-28 01:30:06,812][106225] Updated weights for policy 1, policy_version 871562 (0.0007) [2023-12-28 01:30:06,858][106225] Updated weights for policy 1, policy_version 871572 (0.0007) [2023-12-28 01:30:06,912][106225] Updated weights for policy 1, policy_version 871582 (0.0008) [2023-12-28 01:30:07,405][106226] Updated weights for policy 0, policy_version 869482 (0.0010) [2023-12-28 01:30:07,459][106226] Updated weights for policy 0, policy_version 869492 (0.0011) [2023-12-28 01:30:07,508][106225] Updated weights for policy 1, policy_version 871592 (0.0005) [2023-12-28 01:30:07,509][106226] Updated weights for policy 0, policy_version 869502 (0.0010) [2023-12-28 01:30:07,554][106225] Updated weights for policy 1, policy_version 871602 (0.0007) [2023-12-28 01:30:07,559][106226] Updated weights for policy 0, policy_version 869512 (0.0010) [2023-12-28 01:30:07,603][106225] Updated weights for policy 1, policy_version 871612 (0.0007) [2023-12-28 01:30:08,275][106226] Updated weights for policy 0, policy_version 869522 (0.0005) [2023-12-28 01:30:08,339][106226] Updated weights for policy 0, policy_version 869532 (0.0007) [2023-12-28 01:30:08,380][106225] Updated weights for policy 1, policy_version 871622 (0.0008) [2023-12-28 01:30:08,408][106226] Updated weights for policy 0, policy_version 869542 (0.0007) [2023-12-28 01:30:08,443][106225] Updated weights for policy 1, policy_version 871632 (0.0009) [2023-12-28 01:30:08,506][106225] Updated weights for policy 1, policy_version 871642 (0.0008) [2023-12-28 01:30:09,109][106226] Updated weights for policy 0, policy_version 869552 (0.0007) [2023-12-28 01:30:09,132][106225] Updated weights for policy 1, policy_version 871652 (0.0007) [2023-12-28 01:30:09,171][106226] Updated weights for policy 0, policy_version 869562 (0.0010) [2023-12-28 01:30:09,191][106225] Updated weights for policy 1, policy_version 871662 (0.0006) [2023-12-28 01:30:09,240][106226] Updated weights for policy 0, policy_version 869572 (0.0011) [2023-12-28 01:30:09,268][106225] Updated weights for policy 1, policy_version 871672 (0.0007) [2023-12-28 01:30:09,935][106225] Updated weights for policy 1, policy_version 871682 (0.0008) [2023-12-28 01:30:09,988][106226] Updated weights for policy 0, policy_version 869582 (0.0010) [2023-12-28 01:30:10,004][106225] Updated weights for policy 1, policy_version 871692 (0.0007) [2023-12-28 01:30:10,053][106226] Updated weights for policy 0, policy_version 869592 (0.0009) [2023-12-28 01:30:10,065][106225] Updated weights for policy 1, policy_version 871702 (0.0005) [2023-12-28 01:30:10,117][106226] Updated weights for policy 0, policy_version 869602 (0.0009) [2023-12-28 01:30:10,126][106225] Updated weights for policy 1, policy_version 871712 (0.0006) [2023-12-28 01:30:10,813][106225] Updated weights for policy 1, policy_version 871722 (0.0008) [2023-12-28 01:30:10,875][106225] Updated weights for policy 1, policy_version 871732 (0.0008) [2023-12-28 01:30:10,900][106226] Updated weights for policy 0, policy_version 869612 (0.0010) [2023-12-28 01:30:10,934][106225] Updated weights for policy 1, policy_version 871742 (0.0008) [2023-12-28 01:30:10,961][106226] Updated weights for policy 0, policy_version 869622 (0.0008) [2023-12-28 01:30:11,022][106226] Updated weights for policy 0, policy_version 869632 (0.0010) [2023-12-28 01:30:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 445890560. Throughput: 0: 9803.0, 1: 10097.3. Samples: 445856708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:11,175][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.968')] [2023-12-28 01:30:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000869640_222683136.pth... [2023-12-28 01:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000871744_223207424.pth... [2023-12-28 01:30:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000868488_222388224.pth [2023-12-28 01:30:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000870560_222904320.pth [2023-12-28 01:30:11,700][106225] Updated weights for policy 1, policy_version 871752 (0.0008) [2023-12-28 01:30:11,767][106225] Updated weights for policy 1, policy_version 871762 (0.0008) [2023-12-28 01:30:11,815][106226] Updated weights for policy 0, policy_version 869642 (0.0009) [2023-12-28 01:30:11,829][106225] Updated weights for policy 1, policy_version 871772 (0.0008) [2023-12-28 01:30:11,879][106226] Updated weights for policy 0, policy_version 869652 (0.0008) [2023-12-28 01:30:11,933][106226] Updated weights for policy 0, policy_version 869662 (0.0009) [2023-12-28 01:30:11,990][106226] Updated weights for policy 0, policy_version 869672 (0.0008) [2023-12-28 01:30:12,517][106225] Updated weights for policy 1, policy_version 871782 (0.0008) [2023-12-28 01:30:12,575][106225] Updated weights for policy 1, policy_version 871792 (0.0009) [2023-12-28 01:30:12,624][106225] Updated weights for policy 1, policy_version 871802 (0.0010) [2023-12-28 01:30:12,732][106226] Updated weights for policy 0, policy_version 869682 (0.0008) [2023-12-28 01:30:12,785][106226] Updated weights for policy 0, policy_version 869692 (0.0009) [2023-12-28 01:30:12,845][106226] Updated weights for policy 0, policy_version 869702 (0.0009) [2023-12-28 01:30:13,376][106225] Updated weights for policy 1, policy_version 871812 (0.0008) [2023-12-28 01:30:13,442][106225] Updated weights for policy 1, policy_version 871822 (0.0008) [2023-12-28 01:30:13,500][106225] Updated weights for policy 1, policy_version 871832 (0.0008) [2023-12-28 01:30:13,531][106226] Updated weights for policy 0, policy_version 869712 (0.0007) [2023-12-28 01:30:13,588][106226] Updated weights for policy 0, policy_version 869722 (0.0008) [2023-12-28 01:30:13,649][106226] Updated weights for policy 0, policy_version 869732 (0.0009) [2023-12-28 01:30:14,191][106225] Updated weights for policy 1, policy_version 871842 (0.0009) [2023-12-28 01:30:14,247][106225] Updated weights for policy 1, policy_version 871852 (0.0010) [2023-12-28 01:30:14,301][106226] Updated weights for policy 0, policy_version 869742 (0.0006) [2023-12-28 01:30:14,308][106225] Updated weights for policy 1, policy_version 871862 (0.0008) [2023-12-28 01:30:14,349][106226] Updated weights for policy 0, policy_version 869752 (0.0005) [2023-12-28 01:30:14,364][106225] Updated weights for policy 1, policy_version 871872 (0.0007) [2023-12-28 01:30:14,409][106226] Updated weights for policy 0, policy_version 869762 (0.0009) [2023-12-28 01:30:15,044][106226] Updated weights for policy 0, policy_version 869772 (0.0009) [2023-12-28 01:30:15,108][106226] Updated weights for policy 0, policy_version 869782 (0.0008) [2023-12-28 01:30:15,156][106225] Updated weights for policy 1, policy_version 871882 (0.0008) [2023-12-28 01:30:15,169][106226] Updated weights for policy 0, policy_version 869792 (0.0011) [2023-12-28 01:30:15,218][106225] Updated weights for policy 1, policy_version 871892 (0.0007) [2023-12-28 01:30:15,267][106225] Updated weights for policy 1, policy_version 871902 (0.0008) [2023-12-28 01:30:15,815][106226] Updated weights for policy 0, policy_version 869802 (0.0007) [2023-12-28 01:30:15,880][106226] Updated weights for policy 0, policy_version 869812 (0.0009) [2023-12-28 01:30:15,937][106225] Updated weights for policy 1, policy_version 871912 (0.0006) [2023-12-28 01:30:15,942][106226] Updated weights for policy 0, policy_version 869822 (0.0009) [2023-12-28 01:30:15,987][106225] Updated weights for policy 1, policy_version 871922 (0.0005) [2023-12-28 01:30:16,001][106226] Updated weights for policy 0, policy_version 869832 (0.0007) [2023-12-28 01:30:16,041][106225] Updated weights for policy 1, policy_version 871932 (0.0005) [2023-12-28 01:30:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 445988864. Throughput: 0: 9800.4, 1: 10071.1. Samples: 445972552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:16,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.909')] [2023-12-28 01:30:16,634][106225] Updated weights for policy 1, policy_version 871942 (0.0007) [2023-12-28 01:30:16,679][106225] Updated weights for policy 1, policy_version 871952 (0.0007) [2023-12-28 01:30:16,728][106225] Updated weights for policy 1, policy_version 871962 (0.0007) [2023-12-28 01:30:16,767][106226] Updated weights for policy 0, policy_version 869842 (0.0010) [2023-12-28 01:30:16,823][106226] Updated weights for policy 0, policy_version 869852 (0.0010) [2023-12-28 01:30:16,879][106226] Updated weights for policy 0, policy_version 869862 (0.0010) [2023-12-28 01:30:17,487][106225] Updated weights for policy 1, policy_version 871972 (0.0008) [2023-12-28 01:30:17,530][106225] Updated weights for policy 1, policy_version 871982 (0.0007) [2023-12-28 01:30:17,579][106225] Updated weights for policy 1, policy_version 871992 (0.0007) [2023-12-28 01:30:17,607][106226] Updated weights for policy 0, policy_version 869872 (0.0010) [2023-12-28 01:30:17,660][106226] Updated weights for policy 0, policy_version 869882 (0.0010) [2023-12-28 01:30:17,714][106226] Updated weights for policy 0, policy_version 869892 (0.0008) [2023-12-28 01:30:18,312][106225] Updated weights for policy 1, policy_version 872002 (0.0006) [2023-12-28 01:30:18,376][106225] Updated weights for policy 1, policy_version 872012 (0.0008) [2023-12-28 01:30:18,392][106226] Updated weights for policy 0, policy_version 869902 (0.0007) [2023-12-28 01:30:18,439][106225] Updated weights for policy 1, policy_version 872022 (0.0007) [2023-12-28 01:30:18,454][106226] Updated weights for policy 0, policy_version 869912 (0.0008) [2023-12-28 01:30:18,502][106225] Updated weights for policy 1, policy_version 872032 (0.0006) [2023-12-28 01:30:18,511][106226] Updated weights for policy 0, policy_version 869922 (0.0007) [2023-12-28 01:30:19,142][106225] Updated weights for policy 1, policy_version 872042 (0.0005) [2023-12-28 01:30:19,203][106225] Updated weights for policy 1, policy_version 872052 (0.0005) [2023-12-28 01:30:19,228][106226] Updated weights for policy 0, policy_version 869932 (0.0009) [2023-12-28 01:30:19,270][106225] Updated weights for policy 1, policy_version 872062 (0.0008) [2023-12-28 01:30:19,287][106226] Updated weights for policy 0, policy_version 869942 (0.0009) [2023-12-28 01:30:19,351][106226] Updated weights for policy 0, policy_version 869952 (0.0008) [2023-12-28 01:30:19,882][106225] Updated weights for policy 1, policy_version 872072 (0.0008) [2023-12-28 01:30:19,950][106225] Updated weights for policy 1, policy_version 872082 (0.0008) [2023-12-28 01:30:20,016][106225] Updated weights for policy 1, policy_version 872092 (0.0008) [2023-12-28 01:30:20,138][106226] Updated weights for policy 0, policy_version 869962 (0.0008) [2023-12-28 01:30:20,196][106226] Updated weights for policy 0, policy_version 869972 (0.0009) [2023-12-28 01:30:20,258][106226] Updated weights for policy 0, policy_version 869982 (0.0009) [2023-12-28 01:30:20,316][106226] Updated weights for policy 0, policy_version 869992 (0.0009) [2023-12-28 01:30:20,752][106225] Updated weights for policy 1, policy_version 872102 (0.0008) [2023-12-28 01:30:20,811][106225] Updated weights for policy 1, policy_version 872112 (0.0009) [2023-12-28 01:30:20,864][106225] Updated weights for policy 1, policy_version 872122 (0.0008) [2023-12-28 01:30:21,081][106226] Updated weights for policy 0, policy_version 870002 (0.0008) [2023-12-28 01:30:21,146][106226] Updated weights for policy 0, policy_version 870012 (0.0008) [2023-12-28 01:30:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 446078976. Throughput: 0: 9724.5, 1: 10070.3. Samples: 446091132. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:21,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-4.912')] [2023-12-28 01:30:21,217][106226] Updated weights for policy 0, policy_version 870022 (0.0008) [2023-12-28 01:30:21,640][106225] Updated weights for policy 1, policy_version 872132 (0.0008) [2023-12-28 01:30:21,704][106225] Updated weights for policy 1, policy_version 872142 (0.0010) [2023-12-28 01:30:21,775][106225] Updated weights for policy 1, policy_version 872152 (0.0007) [2023-12-28 01:30:21,958][106226] Updated weights for policy 0, policy_version 870032 (0.0007) [2023-12-28 01:30:22,017][106226] Updated weights for policy 0, policy_version 870042 (0.0008) [2023-12-28 01:30:22,074][106226] Updated weights for policy 0, policy_version 870052 (0.0009) [2023-12-28 01:30:22,467][106225] Updated weights for policy 1, policy_version 872162 (0.0006) [2023-12-28 01:30:22,523][106225] Updated weights for policy 1, policy_version 872172 (0.0008) [2023-12-28 01:30:22,589][106225] Updated weights for policy 1, policy_version 872182 (0.0005) [2023-12-28 01:30:22,654][106225] Updated weights for policy 1, policy_version 872192 (0.0006) [2023-12-28 01:30:22,881][106226] Updated weights for policy 0, policy_version 870062 (0.0009) [2023-12-28 01:30:22,929][106226] Updated weights for policy 0, policy_version 870072 (0.0009) [2023-12-28 01:30:22,979][106226] Updated weights for policy 0, policy_version 870082 (0.0009) [2023-12-28 01:30:23,326][106225] Updated weights for policy 1, policy_version 872202 (0.0009) [2023-12-28 01:30:23,375][106225] Updated weights for policy 1, policy_version 872212 (0.0008) [2023-12-28 01:30:23,434][106225] Updated weights for policy 1, policy_version 872222 (0.0008) [2023-12-28 01:30:23,755][106226] Updated weights for policy 0, policy_version 870092 (0.0007) [2023-12-28 01:30:23,819][106226] Updated weights for policy 0, policy_version 870102 (0.0005) [2023-12-28 01:30:23,873][106226] Updated weights for policy 0, policy_version 870112 (0.0005) [2023-12-28 01:30:24,204][106225] Updated weights for policy 1, policy_version 872232 (0.0009) [2023-12-28 01:30:24,259][106225] Updated weights for policy 1, policy_version 872242 (0.0008) [2023-12-28 01:30:24,317][106225] Updated weights for policy 1, policy_version 872252 (0.0008) [2023-12-28 01:30:24,547][106226] Updated weights for policy 0, policy_version 870122 (0.0006) [2023-12-28 01:30:24,598][106226] Updated weights for policy 0, policy_version 870132 (0.0009) [2023-12-28 01:30:24,656][106226] Updated weights for policy 0, policy_version 870142 (0.0009) [2023-12-28 01:30:24,718][106226] Updated weights for policy 0, policy_version 870152 (0.0008) [2023-12-28 01:30:24,910][106225] Updated weights for policy 1, policy_version 872262 (0.0007) [2023-12-28 01:30:24,965][106225] Updated weights for policy 1, policy_version 872272 (0.0008) [2023-12-28 01:30:25,024][106225] Updated weights for policy 1, policy_version 872282 (0.0008) [2023-12-28 01:30:25,504][106226] Updated weights for policy 0, policy_version 870162 (0.0008) [2023-12-28 01:30:25,550][106226] Updated weights for policy 0, policy_version 870172 (0.0009) [2023-12-28 01:30:25,602][106226] Updated weights for policy 0, policy_version 870182 (0.0008) [2023-12-28 01:30:25,679][106225] Updated weights for policy 1, policy_version 872292 (0.0008) [2023-12-28 01:30:25,724][106225] Updated weights for policy 1, policy_version 872302 (0.0009) [2023-12-28 01:30:25,778][106225] Updated weights for policy 1, policy_version 872312 (0.0008) [2023-12-28 01:30:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 446177280. Throughput: 0: 9713.3, 1: 10006.4. Samples: 446147276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:26,175][105115] Avg episode reward: [(0, '-4.064'), (1, '-5.005')] [2023-12-28 01:30:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000870184_222822400.pth... [2023-12-28 01:30:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000872320_223354880.pth... [2023-12-28 01:30:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000871136_223051776.pth [2023-12-28 01:30:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000869064_222535680.pth [2023-12-28 01:30:26,371][106226] Updated weights for policy 0, policy_version 870192 (0.0008) [2023-12-28 01:30:26,420][106226] Updated weights for policy 0, policy_version 870202 (0.0009) [2023-12-28 01:30:26,471][106226] Updated weights for policy 0, policy_version 870212 (0.0007) [2023-12-28 01:30:26,537][106225] Updated weights for policy 1, policy_version 872322 (0.0009) [2023-12-28 01:30:26,598][106225] Updated weights for policy 1, policy_version 872332 (0.0007) [2023-12-28 01:30:26,652][106225] Updated weights for policy 1, policy_version 872342 (0.0008) [2023-12-28 01:30:26,699][106225] Updated weights for policy 1, policy_version 872352 (0.0008) [2023-12-28 01:30:27,133][106226] Updated weights for policy 0, policy_version 870222 (0.0007) [2023-12-28 01:30:27,182][106226] Updated weights for policy 0, policy_version 870232 (0.0008) [2023-12-28 01:30:27,235][106226] Updated weights for policy 0, policy_version 870243 (0.0009) [2023-12-28 01:30:27,367][106225] Updated weights for policy 1, policy_version 872362 (0.0008) [2023-12-28 01:30:27,426][106225] Updated weights for policy 1, policy_version 872372 (0.0008) [2023-12-28 01:30:27,485][106225] Updated weights for policy 1, policy_version 872382 (0.0008) [2023-12-28 01:30:27,994][106226] Updated weights for policy 0, policy_version 870253 (0.0009) [2023-12-28 01:30:28,049][106226] Updated weights for policy 0, policy_version 870263 (0.0008) [2023-12-28 01:30:28,098][106226] Updated weights for policy 0, policy_version 870273 (0.0007) [2023-12-28 01:30:28,220][106225] Updated weights for policy 1, policy_version 872392 (0.0010) [2023-12-28 01:30:28,285][106225] Updated weights for policy 1, policy_version 872402 (0.0007) [2023-12-28 01:30:28,352][106225] Updated weights for policy 1, policy_version 872412 (0.0008) [2023-12-28 01:30:28,691][106226] Updated weights for policy 0, policy_version 870283 (0.0006) [2023-12-28 01:30:28,751][106226] Updated weights for policy 0, policy_version 870293 (0.0009) [2023-12-28 01:30:28,799][106226] Updated weights for policy 0, policy_version 870303 (0.0008) [2023-12-28 01:30:29,119][106225] Updated weights for policy 1, policy_version 872422 (0.0009) [2023-12-28 01:30:29,181][106225] Updated weights for policy 1, policy_version 872432 (0.0010) [2023-12-28 01:30:29,249][106225] Updated weights for policy 1, policy_version 872442 (0.0007) [2023-12-28 01:30:29,485][106226] Updated weights for policy 0, policy_version 870313 (0.0010) [2023-12-28 01:30:29,556][106226] Updated weights for policy 0, policy_version 870323 (0.0009) [2023-12-28 01:30:29,616][106226] Updated weights for policy 0, policy_version 870333 (0.0010) [2023-12-28 01:30:29,674][106226] Updated weights for policy 0, policy_version 870343 (0.0010) [2023-12-28 01:30:29,881][106225] Updated weights for policy 1, policy_version 872452 (0.0007) [2023-12-28 01:30:29,945][106225] Updated weights for policy 1, policy_version 872462 (0.0006) [2023-12-28 01:30:30,008][106225] Updated weights for policy 1, policy_version 872472 (0.0008) [2023-12-28 01:30:30,383][106226] Updated weights for policy 0, policy_version 870353 (0.0010) [2023-12-28 01:30:30,441][106226] Updated weights for policy 0, policy_version 870363 (0.0011) [2023-12-28 01:30:30,499][106226] Updated weights for policy 0, policy_version 870373 (0.0009) [2023-12-28 01:30:30,716][106225] Updated weights for policy 1, policy_version 872482 (0.0007) [2023-12-28 01:30:30,782][106225] Updated weights for policy 1, policy_version 872492 (0.0006) [2023-12-28 01:30:30,838][106225] Updated weights for policy 1, policy_version 872502 (0.0005) [2023-12-28 01:30:30,885][106225] Updated weights for policy 1, policy_version 872512 (0.0005) [2023-12-28 01:30:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 446275584. Throughput: 0: 9702.4, 1: 10048.7. Samples: 446265608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:31,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.812')] [2023-12-28 01:30:31,244][106226] Updated weights for policy 0, policy_version 870383 (0.0008) [2023-12-28 01:30:31,303][106226] Updated weights for policy 0, policy_version 870393 (0.0008) [2023-12-28 01:30:31,375][106226] Updated weights for policy 0, policy_version 870403 (0.0007) [2023-12-28 01:30:31,484][106225] Updated weights for policy 1, policy_version 872522 (0.0005) [2023-12-28 01:30:31,542][106225] Updated weights for policy 1, policy_version 872532 (0.0005) [2023-12-28 01:30:31,603][106225] Updated weights for policy 1, policy_version 872542 (0.0005) [2023-12-28 01:30:32,129][106226] Updated weights for policy 0, policy_version 870413 (0.0008) [2023-12-28 01:30:32,177][106226] Updated weights for policy 0, policy_version 870423 (0.0005) [2023-12-28 01:30:32,238][106226] Updated weights for policy 0, policy_version 870433 (0.0006) [2023-12-28 01:30:32,302][106225] Updated weights for policy 1, policy_version 872552 (0.0008) [2023-12-28 01:30:32,359][106225] Updated weights for policy 1, policy_version 872562 (0.0008) [2023-12-28 01:30:32,426][106225] Updated weights for policy 1, policy_version 872572 (0.0008) [2023-12-28 01:30:32,867][106226] Updated weights for policy 0, policy_version 870443 (0.0008) [2023-12-28 01:30:32,925][106226] Updated weights for policy 0, policy_version 870453 (0.0007) [2023-12-28 01:30:32,982][106226] Updated weights for policy 0, policy_version 870463 (0.0006) [2023-12-28 01:30:33,150][106225] Updated weights for policy 1, policy_version 872582 (0.0009) [2023-12-28 01:30:33,207][106225] Updated weights for policy 1, policy_version 872592 (0.0010) [2023-12-28 01:30:33,273][106225] Updated weights for policy 1, policy_version 872602 (0.0005) [2023-12-28 01:30:33,575][106226] Updated weights for policy 0, policy_version 870473 (0.0007) [2023-12-28 01:30:33,623][106226] Updated weights for policy 0, policy_version 870483 (0.0005) [2023-12-28 01:30:33,672][106226] Updated weights for policy 0, policy_version 870493 (0.0005) [2023-12-28 01:30:33,725][106226] Updated weights for policy 0, policy_version 870503 (0.0005) [2023-12-28 01:30:33,856][106225] Updated weights for policy 1, policy_version 872612 (0.0005) [2023-12-28 01:30:33,907][106225] Updated weights for policy 1, policy_version 872622 (0.0005) [2023-12-28 01:30:33,962][106225] Updated weights for policy 1, policy_version 872632 (0.0005) [2023-12-28 01:30:34,393][106226] Updated weights for policy 0, policy_version 870513 (0.0009) [2023-12-28 01:30:34,454][106226] Updated weights for policy 0, policy_version 870523 (0.0009) [2023-12-28 01:30:34,515][106226] Updated weights for policy 0, policy_version 870533 (0.0008) [2023-12-28 01:30:34,644][106225] Updated weights for policy 1, policy_version 872642 (0.0005) [2023-12-28 01:30:34,708][106225] Updated weights for policy 1, policy_version 872652 (0.0006) [2023-12-28 01:30:34,768][106225] Updated weights for policy 1, policy_version 872662 (0.0008) [2023-12-28 01:30:34,824][106225] Updated weights for policy 1, policy_version 872672 (0.0009) [2023-12-28 01:30:35,319][106226] Updated weights for policy 0, policy_version 870543 (0.0008) [2023-12-28 01:30:35,376][106226] Updated weights for policy 0, policy_version 870553 (0.0007) [2023-12-28 01:30:35,430][106225] Updated weights for policy 1, policy_version 872682 (0.0010) [2023-12-28 01:30:35,436][106226] Updated weights for policy 0, policy_version 870563 (0.0005) [2023-12-28 01:30:35,489][106225] Updated weights for policy 1, policy_version 872692 (0.0008) [2023-12-28 01:30:35,555][106225] Updated weights for policy 1, policy_version 872702 (0.0005) [2023-12-28 01:30:36,149][106225] Updated weights for policy 1, policy_version 872712 (0.0011) [2023-12-28 01:30:36,159][106226] Updated weights for policy 0, policy_version 870573 (0.0007) [2023-12-28 01:30:36,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 446373888. Throughput: 0: 9746.3, 1: 10092.6. Samples: 446389028. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 01:30:36,176][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.768')] [2023-12-28 01:30:36,208][106225] Updated weights for policy 1, policy_version 872722 (0.0011) [2023-12-28 01:30:36,226][106226] Updated weights for policy 0, policy_version 870583 (0.0006) [2023-12-28 01:30:36,270][106225] Updated weights for policy 1, policy_version 872732 (0.0011) [2023-12-28 01:30:36,279][106226] Updated weights for policy 0, policy_version 870593 (0.0008) [2023-12-28 01:30:36,960][106225] Updated weights for policy 1, policy_version 872742 (0.0008) [2023-12-28 01:30:37,015][106225] Updated weights for policy 1, policy_version 872752 (0.0005) [2023-12-28 01:30:37,041][106226] Updated weights for policy 0, policy_version 870603 (0.0007) [2023-12-28 01:30:37,064][106225] Updated weights for policy 1, policy_version 872762 (0.0005) [2023-12-28 01:30:37,095][106226] Updated weights for policy 0, policy_version 870613 (0.0009) [2023-12-28 01:30:37,156][106226] Updated weights for policy 0, policy_version 870623 (0.0009) [2023-12-28 01:30:37,625][106225] Updated weights for policy 1, policy_version 872772 (0.0006) [2023-12-28 01:30:37,682][106225] Updated weights for policy 1, policy_version 872782 (0.0008) [2023-12-28 01:30:37,731][106225] Updated weights for policy 1, policy_version 872792 (0.0007) [2023-12-28 01:30:37,957][106226] Updated weights for policy 0, policy_version 870633 (0.0009) [2023-12-28 01:30:38,010][106226] Updated weights for policy 0, policy_version 870643 (0.0009) [2023-12-28 01:30:38,061][106226] Updated weights for policy 0, policy_version 870653 (0.0008) [2023-12-28 01:30:38,121][106226] Updated weights for policy 0, policy_version 870663 (0.0008) [2023-12-28 01:30:38,483][106225] Updated weights for policy 1, policy_version 872802 (0.0009) [2023-12-28 01:30:38,544][106225] Updated weights for policy 1, policy_version 872812 (0.0008) [2023-12-28 01:30:38,603][106225] Updated weights for policy 1, policy_version 872822 (0.0008) [2023-12-28 01:30:38,662][106225] Updated weights for policy 1, policy_version 872832 (0.0009) [2023-12-28 01:30:38,803][106226] Updated weights for policy 0, policy_version 870673 (0.0009) [2023-12-28 01:30:38,856][106226] Updated weights for policy 0, policy_version 870683 (0.0009) [2023-12-28 01:30:38,915][106226] Updated weights for policy 0, policy_version 870693 (0.0010) [2023-12-28 01:30:39,376][106225] Updated weights for policy 1, policy_version 872842 (0.0008) [2023-12-28 01:30:39,443][106225] Updated weights for policy 1, policy_version 872852 (0.0008) [2023-12-28 01:30:39,501][106225] Updated weights for policy 1, policy_version 872862 (0.0008) [2023-12-28 01:30:39,706][106226] Updated weights for policy 0, policy_version 870703 (0.0010) [2023-12-28 01:30:39,772][106226] Updated weights for policy 0, policy_version 870713 (0.0008) [2023-12-28 01:30:39,842][106226] Updated weights for policy 0, policy_version 870723 (0.0010) [2023-12-28 01:30:40,304][106225] Updated weights for policy 1, policy_version 872872 (0.0010) [2023-12-28 01:30:40,372][106225] Updated weights for policy 1, policy_version 872882 (0.0011) [2023-12-28 01:30:40,434][106225] Updated weights for policy 1, policy_version 872892 (0.0009) [2023-12-28 01:30:40,530][106226] Updated weights for policy 0, policy_version 870733 (0.0011) [2023-12-28 01:30:40,605][106226] Updated weights for policy 0, policy_version 870743 (0.0005) [2023-12-28 01:30:40,661][106226] Updated weights for policy 0, policy_version 870753 (0.0008) [2023-12-28 01:30:41,110][106225] Updated weights for policy 1, policy_version 872902 (0.0007) [2023-12-28 01:30:41,166][106225] Updated weights for policy 1, policy_version 872912 (0.0010) [2023-12-28 01:30:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 446472192. Throughput: 0: 9705.8, 1: 10111.9. Samples: 446447220. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:30:41,175][105115] Avg episode reward: [(0, '-4.235'), (1, '-4.843')] [2023-12-28 01:30:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000870760_222969856.pth... [2023-12-28 01:30:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000869640_222683136.pth [2023-12-28 01:30:41,223][106225] Updated weights for policy 1, policy_version 872922 (0.0009) [2023-12-28 01:30:41,258][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000872928_223510528.pth... [2023-12-28 01:30:41,262][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000871744_223207424.pth [2023-12-28 01:30:41,340][106226] Updated weights for policy 0, policy_version 870763 (0.0008) [2023-12-28 01:30:41,411][106226] Updated weights for policy 0, policy_version 870773 (0.0009) [2023-12-28 01:30:41,474][106226] Updated weights for policy 0, policy_version 870783 (0.0008) [2023-12-28 01:30:41,939][106225] Updated weights for policy 1, policy_version 872932 (0.0007) [2023-12-28 01:30:42,002][106225] Updated weights for policy 1, policy_version 872942 (0.0007) [2023-12-28 01:30:42,064][106225] Updated weights for policy 1, policy_version 872952 (0.0009) [2023-12-28 01:30:42,142][106226] Updated weights for policy 0, policy_version 870793 (0.0008) [2023-12-28 01:30:42,211][106226] Updated weights for policy 0, policy_version 870803 (0.0009) [2023-12-28 01:30:42,270][106226] Updated weights for policy 0, policy_version 870813 (0.0006) [2023-12-28 01:30:42,335][106226] Updated weights for policy 0, policy_version 870823 (0.0008) [2023-12-28 01:30:42,765][106225] Updated weights for policy 1, policy_version 872962 (0.0008) [2023-12-28 01:30:42,829][106225] Updated weights for policy 1, policy_version 872972 (0.0008) [2023-12-28 01:30:42,876][106225] Updated weights for policy 1, policy_version 872982 (0.0007) [2023-12-28 01:30:42,934][106225] Updated weights for policy 1, policy_version 872992 (0.0008) [2023-12-28 01:30:42,981][106226] Updated weights for policy 0, policy_version 870833 (0.0008) [2023-12-28 01:30:43,035][106226] Updated weights for policy 0, policy_version 870843 (0.0009) [2023-12-28 01:30:43,090][106226] Updated weights for policy 0, policy_version 870853 (0.0008) [2023-12-28 01:30:43,571][106225] Updated weights for policy 1, policy_version 873002 (0.0010) [2023-12-28 01:30:43,627][106225] Updated weights for policy 1, policy_version 873012 (0.0010) [2023-12-28 01:30:43,686][106225] Updated weights for policy 1, policy_version 873022 (0.0010) [2023-12-28 01:30:43,866][106226] Updated weights for policy 0, policy_version 870863 (0.0009) [2023-12-28 01:30:43,930][106226] Updated weights for policy 0, policy_version 870873 (0.0008) [2023-12-28 01:30:43,997][106226] Updated weights for policy 0, policy_version 870883 (0.0009) [2023-12-28 01:30:44,263][106225] Updated weights for policy 1, policy_version 873032 (0.0010) [2023-12-28 01:30:44,326][106225] Updated weights for policy 1, policy_version 873042 (0.0010) [2023-12-28 01:30:44,376][106225] Updated weights for policy 1, policy_version 873052 (0.0006) [2023-12-28 01:30:44,766][106226] Updated weights for policy 0, policy_version 870893 (0.0009) [2023-12-28 01:30:44,829][106226] Updated weights for policy 0, policy_version 870903 (0.0008) [2023-12-28 01:30:44,892][106226] Updated weights for policy 0, policy_version 870913 (0.0008) [2023-12-28 01:30:45,070][106225] Updated weights for policy 1, policy_version 873062 (0.0010) [2023-12-28 01:30:45,132][106225] Updated weights for policy 1, policy_version 873072 (0.0011) [2023-12-28 01:30:45,192][106225] Updated weights for policy 1, policy_version 873082 (0.0010) [2023-12-28 01:30:45,658][106226] Updated weights for policy 0, policy_version 870923 (0.0008) [2023-12-28 01:30:45,722][106226] Updated weights for policy 0, policy_version 870933 (0.0009) [2023-12-28 01:30:45,785][106226] Updated weights for policy 0, policy_version 870943 (0.0009) [2023-12-28 01:30:45,864][106225] Updated weights for policy 1, policy_version 873092 (0.0011) [2023-12-28 01:30:45,917][106225] Updated weights for policy 1, policy_version 873102 (0.0010) [2023-12-28 01:30:45,973][106225] Updated weights for policy 1, policy_version 873112 (0.0010) [2023-12-28 01:30:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 446578688. Throughput: 0: 9707.3, 1: 10092.4. Samples: 446564996. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:30:46,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.790')] [2023-12-28 01:30:46,430][106226] Updated weights for policy 0, policy_version 870953 (0.0009) [2023-12-28 01:30:46,487][106226] Updated weights for policy 0, policy_version 870963 (0.0008) [2023-12-28 01:30:46,548][106226] Updated weights for policy 0, policy_version 870973 (0.0008) [2023-12-28 01:30:46,604][106226] Updated weights for policy 0, policy_version 870983 (0.0008) [2023-12-28 01:30:46,650][106225] Updated weights for policy 1, policy_version 873122 (0.0006) [2023-12-28 01:30:46,699][106225] Updated weights for policy 1, policy_version 873132 (0.0009) [2023-12-28 01:30:46,753][106225] Updated weights for policy 1, policy_version 873142 (0.0010) [2023-12-28 01:30:46,809][106225] Updated weights for policy 1, policy_version 873152 (0.0010) [2023-12-28 01:30:47,287][106226] Updated weights for policy 0, policy_version 870993 (0.0008) [2023-12-28 01:30:47,333][106226] Updated weights for policy 0, policy_version 871003 (0.0008) [2023-12-28 01:30:47,379][106226] Updated weights for policy 0, policy_version 871013 (0.0008) [2023-12-28 01:30:47,491][106225] Updated weights for policy 1, policy_version 873162 (0.0008) [2023-12-28 01:30:47,545][106225] Updated weights for policy 1, policy_version 873172 (0.0008) [2023-12-28 01:30:47,589][106225] Updated weights for policy 1, policy_version 873182 (0.0008) [2023-12-28 01:30:48,039][106226] Updated weights for policy 0, policy_version 871023 (0.0009) [2023-12-28 01:30:48,090][106226] Updated weights for policy 0, policy_version 871033 (0.0010) [2023-12-28 01:30:48,147][106226] Updated weights for policy 0, policy_version 871043 (0.0008) [2023-12-28 01:30:48,309][106225] Updated weights for policy 1, policy_version 873192 (0.0009) [2023-12-28 01:30:48,376][106225] Updated weights for policy 1, policy_version 873202 (0.0007) [2023-12-28 01:30:48,441][106225] Updated weights for policy 1, policy_version 873212 (0.0007) [2023-12-28 01:30:48,827][106226] Updated weights for policy 0, policy_version 871053 (0.0008) [2023-12-28 01:30:48,874][106226] Updated weights for policy 0, policy_version 871063 (0.0008) [2023-12-28 01:30:48,926][106226] Updated weights for policy 0, policy_version 871073 (0.0005) [2023-12-28 01:30:49,071][106225] Updated weights for policy 1, policy_version 873222 (0.0008) [2023-12-28 01:30:49,133][106225] Updated weights for policy 1, policy_version 873232 (0.0005) [2023-12-28 01:30:49,179][106225] Updated weights for policy 1, policy_version 873242 (0.0005) [2023-12-28 01:30:49,644][106226] Updated weights for policy 0, policy_version 871083 (0.0009) [2023-12-28 01:30:49,705][106226] Updated weights for policy 0, policy_version 871093 (0.0008) [2023-12-28 01:30:49,770][106226] Updated weights for policy 0, policy_version 871103 (0.0008) [2023-12-28 01:30:49,911][106225] Updated weights for policy 1, policy_version 873252 (0.0007) [2023-12-28 01:30:49,974][106225] Updated weights for policy 1, policy_version 873262 (0.0011) [2023-12-28 01:30:50,029][106225] Updated weights for policy 1, policy_version 873272 (0.0011) [2023-12-28 01:30:50,544][106226] Updated weights for policy 0, policy_version 871113 (0.0007) [2023-12-28 01:30:50,611][106226] Updated weights for policy 0, policy_version 871123 (0.0008) [2023-12-28 01:30:50,678][106226] Updated weights for policy 0, policy_version 871133 (0.0009) [2023-12-28 01:30:50,717][106225] Updated weights for policy 1, policy_version 873282 (0.0010) [2023-12-28 01:30:50,741][106226] Updated weights for policy 0, policy_version 871143 (0.0008) [2023-12-28 01:30:50,771][106225] Updated weights for policy 1, policy_version 873292 (0.0008) [2023-12-28 01:30:50,833][106225] Updated weights for policy 1, policy_version 873302 (0.0009) [2023-12-28 01:30:50,891][106225] Updated weights for policy 1, policy_version 873312 (0.0008) [2023-12-28 01:30:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 446676992. Throughput: 0: 9684.1, 1: 10035.1. Samples: 446684592. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:30:51,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.736')] [2023-12-28 01:30:51,557][106226] Updated weights for policy 0, policy_version 871153 (0.0007) [2023-12-28 01:30:51,592][106225] Updated weights for policy 1, policy_version 873322 (0.0007) [2023-12-28 01:30:51,607][106226] Updated weights for policy 0, policy_version 871163 (0.0007) [2023-12-28 01:30:51,657][106225] Updated weights for policy 1, policy_version 873332 (0.0008) [2023-12-28 01:30:51,676][106226] Updated weights for policy 0, policy_version 871173 (0.0008) [2023-12-28 01:30:51,724][106225] Updated weights for policy 1, policy_version 873342 (0.0008) [2023-12-28 01:30:52,453][106226] Updated weights for policy 0, policy_version 871183 (0.0007) [2023-12-28 01:30:52,476][106225] Updated weights for policy 1, policy_version 873352 (0.0008) [2023-12-28 01:30:52,510][106226] Updated weights for policy 0, policy_version 871193 (0.0007) [2023-12-28 01:30:52,544][106225] Updated weights for policy 1, policy_version 873362 (0.0008) [2023-12-28 01:30:52,569][106226] Updated weights for policy 0, policy_version 871203 (0.0009) [2023-12-28 01:30:52,610][106225] Updated weights for policy 1, policy_version 873372 (0.0007) [2023-12-28 01:30:53,174][106225] Updated weights for policy 1, policy_version 873382 (0.0006) [2023-12-28 01:30:53,225][106225] Updated weights for policy 1, policy_version 873392 (0.0005) [2023-12-28 01:30:53,276][106225] Updated weights for policy 1, policy_version 873402 (0.0005) [2023-12-28 01:30:53,304][106226] Updated weights for policy 0, policy_version 871213 (0.0007) [2023-12-28 01:30:53,353][106226] Updated weights for policy 0, policy_version 871223 (0.0006) [2023-12-28 01:30:53,410][106226] Updated weights for policy 0, policy_version 871233 (0.0007) [2023-12-28 01:30:53,912][106225] Updated weights for policy 1, policy_version 873412 (0.0007) [2023-12-28 01:30:53,969][106225] Updated weights for policy 1, policy_version 873422 (0.0006) [2023-12-28 01:30:54,033][106225] Updated weights for policy 1, policy_version 873432 (0.0006) [2023-12-28 01:30:54,046][106226] Updated weights for policy 0, policy_version 871243 (0.0007) [2023-12-28 01:30:54,108][106226] Updated weights for policy 0, policy_version 871253 (0.0008) [2023-12-28 01:30:54,165][106226] Updated weights for policy 0, policy_version 871263 (0.0008) [2023-12-28 01:30:54,732][106225] Updated weights for policy 1, policy_version 873442 (0.0007) [2023-12-28 01:30:54,787][106225] Updated weights for policy 1, policy_version 873452 (0.0010) [2023-12-28 01:30:54,834][106225] Updated weights for policy 1, policy_version 873462 (0.0010) [2023-12-28 01:30:54,890][106225] Updated weights for policy 1, policy_version 873472 (0.0009) [2023-12-28 01:30:54,916][106226] Updated weights for policy 0, policy_version 871273 (0.0008) [2023-12-28 01:30:54,968][106226] Updated weights for policy 0, policy_version 871283 (0.0008) [2023-12-28 01:30:55,026][106226] Updated weights for policy 0, policy_version 871293 (0.0008) [2023-12-28 01:30:55,084][106226] Updated weights for policy 0, policy_version 871303 (0.0008) [2023-12-28 01:30:55,557][106225] Updated weights for policy 1, policy_version 873482 (0.0007) [2023-12-28 01:30:55,604][106225] Updated weights for policy 1, policy_version 873492 (0.0010) [2023-12-28 01:30:55,666][106225] Updated weights for policy 1, policy_version 873502 (0.0010) [2023-12-28 01:30:55,766][106226] Updated weights for policy 0, policy_version 871313 (0.0006) [2023-12-28 01:30:55,830][106226] Updated weights for policy 0, policy_version 871323 (0.0006) [2023-12-28 01:30:55,890][106226] Updated weights for policy 0, policy_version 871333 (0.0005) [2023-12-28 01:30:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 446775296. Throughput: 0: 9655.2, 1: 10062.9. Samples: 446744024. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:30:56,175][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.814')] [2023-12-28 01:30:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000873504_223657984.pth... [2023-12-28 01:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000871336_223117312.pth... [2023-12-28 01:30:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000872320_223354880.pth [2023-12-28 01:30:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000870184_222822400.pth [2023-12-28 01:30:56,399][106225] Updated weights for policy 1, policy_version 873512 (0.0010) [2023-12-28 01:30:56,464][106226] Updated weights for policy 0, policy_version 871343 (0.0005) [2023-12-28 01:30:56,469][106225] Updated weights for policy 1, policy_version 873522 (0.0011) [2023-12-28 01:30:56,530][106225] Updated weights for policy 1, policy_version 873532 (0.0010) [2023-12-28 01:30:56,532][106226] Updated weights for policy 0, policy_version 871353 (0.0005) [2023-12-28 01:30:56,597][106226] Updated weights for policy 0, policy_version 871363 (0.0008) [2023-12-28 01:30:57,213][106225] Updated weights for policy 1, policy_version 873542 (0.0010) [2023-12-28 01:30:57,232][106226] Updated weights for policy 0, policy_version 871373 (0.0006) [2023-12-28 01:30:57,271][106225] Updated weights for policy 1, policy_version 873552 (0.0010) [2023-12-28 01:30:57,286][106226] Updated weights for policy 0, policy_version 871383 (0.0006) [2023-12-28 01:30:57,330][106225] Updated weights for policy 1, policy_version 873562 (0.0010) [2023-12-28 01:30:57,347][106226] Updated weights for policy 0, policy_version 871393 (0.0006) [2023-12-28 01:30:58,018][106225] Updated weights for policy 1, policy_version 873572 (0.0009) [2023-12-28 01:30:58,021][106226] Updated weights for policy 0, policy_version 871403 (0.0008) [2023-12-28 01:30:58,073][106226] Updated weights for policy 0, policy_version 871413 (0.0006) [2023-12-28 01:30:58,074][106225] Updated weights for policy 1, policy_version 873582 (0.0006) [2023-12-28 01:30:58,123][106226] Updated weights for policy 0, policy_version 871423 (0.0006) [2023-12-28 01:30:58,139][106225] Updated weights for policy 1, policy_version 873592 (0.0009) [2023-12-28 01:30:58,946][106225] Updated weights for policy 1, policy_version 873602 (0.0010) [2023-12-28 01:30:58,970][106226] Updated weights for policy 0, policy_version 871433 (0.0007) [2023-12-28 01:30:59,013][106225] Updated weights for policy 1, policy_version 873612 (0.0006) [2023-12-28 01:30:59,040][106226] Updated weights for policy 0, policy_version 871443 (0.0007) [2023-12-28 01:30:59,079][106225] Updated weights for policy 1, policy_version 873622 (0.0006) [2023-12-28 01:30:59,104][106226] Updated weights for policy 0, policy_version 871453 (0.0008) [2023-12-28 01:30:59,141][106225] Updated weights for policy 1, policy_version 873632 (0.0006) [2023-12-28 01:30:59,172][106226] Updated weights for policy 0, policy_version 871463 (0.0008) [2023-12-28 01:30:59,807][106225] Updated weights for policy 1, policy_version 873642 (0.0008) [2023-12-28 01:30:59,881][106225] Updated weights for policy 1, policy_version 873652 (0.0007) [2023-12-28 01:30:59,946][106225] Updated weights for policy 1, policy_version 873662 (0.0008) [2023-12-28 01:30:59,953][106226] Updated weights for policy 0, policy_version 871473 (0.0008) [2023-12-28 01:31:00,025][106226] Updated weights for policy 0, policy_version 871483 (0.0007) [2023-12-28 01:31:00,091][106226] Updated weights for policy 0, policy_version 871493 (0.0007) [2023-12-28 01:31:00,658][106225] Updated weights for policy 1, policy_version 873672 (0.0006) [2023-12-28 01:31:00,720][106225] Updated weights for policy 1, policy_version 873682 (0.0006) [2023-12-28 01:31:00,751][106226] Updated weights for policy 0, policy_version 871503 (0.0009) [2023-12-28 01:31:00,779][106225] Updated weights for policy 1, policy_version 873692 (0.0009) [2023-12-28 01:31:00,809][106226] Updated weights for policy 0, policy_version 871513 (0.0011) [2023-12-28 01:31:00,866][106226] Updated weights for policy 0, policy_version 871523 (0.0010) [2023-12-28 01:31:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 446873600. Throughput: 0: 9686.3, 1: 10090.4. Samples: 446862508. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:01,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.897')] [2023-12-28 01:31:01,533][106225] Updated weights for policy 1, policy_version 873702 (0.0005) [2023-12-28 01:31:01,599][106225] Updated weights for policy 1, policy_version 873712 (0.0009) [2023-12-28 01:31:01,658][106226] Updated weights for policy 0, policy_version 871533 (0.0008) [2023-12-28 01:31:01,675][106225] Updated weights for policy 1, policy_version 873722 (0.0011) [2023-12-28 01:31:01,736][106226] Updated weights for policy 0, policy_version 871543 (0.0007) [2023-12-28 01:31:01,801][106226] Updated weights for policy 0, policy_version 871553 (0.0008) [2023-12-28 01:31:02,417][106225] Updated weights for policy 1, policy_version 873732 (0.0008) [2023-12-28 01:31:02,481][106225] Updated weights for policy 1, policy_version 873742 (0.0010) [2023-12-28 01:31:02,549][106225] Updated weights for policy 1, policy_version 873752 (0.0010) [2023-12-28 01:31:02,557][106226] Updated weights for policy 0, policy_version 871563 (0.0010) [2023-12-28 01:31:02,611][106226] Updated weights for policy 0, policy_version 871573 (0.0010) [2023-12-28 01:31:02,665][106226] Updated weights for policy 0, policy_version 871583 (0.0010) [2023-12-28 01:31:03,216][106225] Updated weights for policy 1, policy_version 873762 (0.0008) [2023-12-28 01:31:03,263][106225] Updated weights for policy 1, policy_version 873772 (0.0010) [2023-12-28 01:31:03,312][106225] Updated weights for policy 1, policy_version 873782 (0.0010) [2023-12-28 01:31:03,346][106226] Updated weights for policy 0, policy_version 871593 (0.0010) [2023-12-28 01:31:03,365][106225] Updated weights for policy 1, policy_version 873792 (0.0010) [2023-12-28 01:31:03,399][106226] Updated weights for policy 0, policy_version 871603 (0.0005) [2023-12-28 01:31:03,452][106226] Updated weights for policy 0, policy_version 871613 (0.0005) [2023-12-28 01:31:03,506][106226] Updated weights for policy 0, policy_version 871623 (0.0007) [2023-12-28 01:31:04,123][106225] Updated weights for policy 1, policy_version 873802 (0.0008) [2023-12-28 01:31:04,141][106226] Updated weights for policy 0, policy_version 871633 (0.0011) [2023-12-28 01:31:04,187][106225] Updated weights for policy 1, policy_version 873812 (0.0008) [2023-12-28 01:31:04,201][106226] Updated weights for policy 0, policy_version 871643 (0.0009) [2023-12-28 01:31:04,254][106225] Updated weights for policy 1, policy_version 873822 (0.0008) [2023-12-28 01:31:04,271][106226] Updated weights for policy 0, policy_version 871653 (0.0011) [2023-12-28 01:31:04,952][106225] Updated weights for policy 1, policy_version 873832 (0.0006) [2023-12-28 01:31:04,962][106226] Updated weights for policy 0, policy_version 871663 (0.0011) [2023-12-28 01:31:05,002][106225] Updated weights for policy 1, policy_version 873842 (0.0006) [2023-12-28 01:31:05,023][106226] Updated weights for policy 0, policy_version 871673 (0.0010) [2023-12-28 01:31:05,064][106225] Updated weights for policy 1, policy_version 873852 (0.0008) [2023-12-28 01:31:05,078][106226] Updated weights for policy 0, policy_version 871683 (0.0010) [2023-12-28 01:31:05,752][106226] Updated weights for policy 0, policy_version 871693 (0.0010) [2023-12-28 01:31:05,792][106225] Updated weights for policy 1, policy_version 873862 (0.0006) [2023-12-28 01:31:05,814][106226] Updated weights for policy 0, policy_version 871703 (0.0008) [2023-12-28 01:31:05,858][106225] Updated weights for policy 1, policy_version 873872 (0.0007) [2023-12-28 01:31:05,871][106226] Updated weights for policy 0, policy_version 871713 (0.0007) [2023-12-28 01:31:05,916][106225] Updated weights for policy 1, policy_version 873882 (0.0006) [2023-12-28 01:31:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 446971904. Throughput: 0: 9724.9, 1: 10006.6. Samples: 446979048. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:06,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.166')] [2023-12-28 01:31:06,635][106226] Updated weights for policy 0, policy_version 871723 (0.0009) [2023-12-28 01:31:06,709][106226] Updated weights for policy 0, policy_version 871733 (0.0007) [2023-12-28 01:31:06,709][106225] Updated weights for policy 1, policy_version 873892 (0.0007) [2023-12-28 01:31:06,775][106225] Updated weights for policy 1, policy_version 873902 (0.0006) [2023-12-28 01:31:06,776][106226] Updated weights for policy 0, policy_version 871743 (0.0008) [2023-12-28 01:31:06,838][106225] Updated weights for policy 1, policy_version 873912 (0.0006) [2023-12-28 01:31:07,378][106226] Updated weights for policy 0, policy_version 871753 (0.0007) [2023-12-28 01:31:07,440][106226] Updated weights for policy 0, policy_version 871763 (0.0006) [2023-12-28 01:31:07,503][106226] Updated weights for policy 0, policy_version 871773 (0.0006) [2023-12-28 01:31:07,538][106225] Updated weights for policy 1, policy_version 873922 (0.0007) [2023-12-28 01:31:07,571][106226] Updated weights for policy 0, policy_version 871783 (0.0008) [2023-12-28 01:31:07,605][106225] Updated weights for policy 1, policy_version 873932 (0.0009) [2023-12-28 01:31:07,678][106225] Updated weights for policy 1, policy_version 873942 (0.0009) [2023-12-28 01:31:07,745][106225] Updated weights for policy 1, policy_version 873952 (0.0009) [2023-12-28 01:31:08,190][106226] Updated weights for policy 0, policy_version 871793 (0.0008) [2023-12-28 01:31:08,243][106226] Updated weights for policy 0, policy_version 871803 (0.0007) [2023-12-28 01:31:08,306][106226] Updated weights for policy 0, policy_version 871813 (0.0007) [2023-12-28 01:31:08,416][106225] Updated weights for policy 1, policy_version 873962 (0.0010) [2023-12-28 01:31:08,487][106225] Updated weights for policy 1, policy_version 873972 (0.0011) [2023-12-28 01:31:08,546][106225] Updated weights for policy 1, policy_version 873982 (0.0009) [2023-12-28 01:31:09,021][106226] Updated weights for policy 0, policy_version 871823 (0.0007) [2023-12-28 01:31:09,076][106226] Updated weights for policy 0, policy_version 871833 (0.0008) [2023-12-28 01:31:09,139][106226] Updated weights for policy 0, policy_version 871843 (0.0009) [2023-12-28 01:31:09,253][106225] Updated weights for policy 1, policy_version 873992 (0.0009) [2023-12-28 01:31:09,314][106225] Updated weights for policy 1, policy_version 874002 (0.0010) [2023-12-28 01:31:09,382][106225] Updated weights for policy 1, policy_version 874012 (0.0010) [2023-12-28 01:31:09,896][106226] Updated weights for policy 0, policy_version 871853 (0.0008) [2023-12-28 01:31:09,964][106226] Updated weights for policy 0, policy_version 871863 (0.0010) [2023-12-28 01:31:10,026][106226] Updated weights for policy 0, policy_version 871873 (0.0007) [2023-12-28 01:31:10,108][106225] Updated weights for policy 1, policy_version 874022 (0.0008) [2023-12-28 01:31:10,167][106225] Updated weights for policy 1, policy_version 874032 (0.0009) [2023-12-28 01:31:10,225][106225] Updated weights for policy 1, policy_version 874042 (0.0008) [2023-12-28 01:31:10,714][106226] Updated weights for policy 0, policy_version 871883 (0.0007) [2023-12-28 01:31:10,775][106226] Updated weights for policy 0, policy_version 871893 (0.0009) [2023-12-28 01:31:10,829][106226] Updated weights for policy 0, policy_version 871903 (0.0010) [2023-12-28 01:31:10,917][106225] Updated weights for policy 1, policy_version 874052 (0.0008) [2023-12-28 01:31:10,979][106225] Updated weights for policy 1, policy_version 874062 (0.0008) [2023-12-28 01:31:11,040][106225] Updated weights for policy 1, policy_version 874072 (0.0009) [2023-12-28 01:31:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 447070208. Throughput: 0: 9774.6, 1: 10008.0. Samples: 447037496. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:11,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.972')] [2023-12-28 01:31:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000874080_223805440.pth... [2023-12-28 01:31:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000871912_223264768.pth... [2023-12-28 01:31:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000872928_223510528.pth [2023-12-28 01:31:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000870760_222969856.pth [2023-12-28 01:31:11,581][106226] Updated weights for policy 0, policy_version 871913 (0.0009) [2023-12-28 01:31:11,654][106226] Updated weights for policy 0, policy_version 871923 (0.0008) [2023-12-28 01:31:11,715][106226] Updated weights for policy 0, policy_version 871933 (0.0009) [2023-12-28 01:31:11,812][106226] Updated weights for policy 0, policy_version 871943 (0.0009) [2023-12-28 01:31:11,850][106225] Updated weights for policy 1, policy_version 874082 (0.0009) [2023-12-28 01:31:11,912][106225] Updated weights for policy 1, policy_version 874092 (0.0009) [2023-12-28 01:31:11,974][106225] Updated weights for policy 1, policy_version 874102 (0.0009) [2023-12-28 01:31:12,035][106225] Updated weights for policy 1, policy_version 874112 (0.0009) [2023-12-28 01:31:12,619][106226] Updated weights for policy 0, policy_version 871953 (0.0011) [2023-12-28 01:31:12,680][106226] Updated weights for policy 0, policy_version 871963 (0.0011) [2023-12-28 01:31:12,732][106226] Updated weights for policy 0, policy_version 871973 (0.0011) [2023-12-28 01:31:12,820][106225] Updated weights for policy 1, policy_version 874122 (0.0007) [2023-12-28 01:31:12,871][106225] Updated weights for policy 1, policy_version 874132 (0.0008) [2023-12-28 01:31:12,929][106225] Updated weights for policy 1, policy_version 874142 (0.0008) [2023-12-28 01:31:13,452][106226] Updated weights for policy 0, policy_version 871983 (0.0010) [2023-12-28 01:31:13,502][106226] Updated weights for policy 0, policy_version 871993 (0.0010) [2023-12-28 01:31:13,553][106226] Updated weights for policy 0, policy_version 872003 (0.0006) [2023-12-28 01:31:13,642][106225] Updated weights for policy 1, policy_version 874152 (0.0006) [2023-12-28 01:31:13,695][106225] Updated weights for policy 1, policy_version 874162 (0.0006) [2023-12-28 01:31:13,752][106225] Updated weights for policy 1, policy_version 874172 (0.0009) [2023-12-28 01:31:14,209][106226] Updated weights for policy 0, policy_version 872013 (0.0007) [2023-12-28 01:31:14,261][106226] Updated weights for policy 0, policy_version 872023 (0.0008) [2023-12-28 01:31:14,317][106226] Updated weights for policy 0, policy_version 872033 (0.0008) [2023-12-28 01:31:14,474][106225] Updated weights for policy 1, policy_version 874182 (0.0010) [2023-12-28 01:31:14,534][106225] Updated weights for policy 1, policy_version 874192 (0.0010) [2023-12-28 01:31:14,594][106225] Updated weights for policy 1, policy_version 874202 (0.0006) [2023-12-28 01:31:15,005][106226] Updated weights for policy 0, policy_version 872043 (0.0008) [2023-12-28 01:31:15,064][106226] Updated weights for policy 0, policy_version 872053 (0.0006) [2023-12-28 01:31:15,123][106226] Updated weights for policy 0, policy_version 872063 (0.0008) [2023-12-28 01:31:15,297][106225] Updated weights for policy 1, policy_version 874212 (0.0007) [2023-12-28 01:31:15,356][106225] Updated weights for policy 1, policy_version 874222 (0.0009) [2023-12-28 01:31:15,427][106225] Updated weights for policy 1, policy_version 874232 (0.0009) [2023-12-28 01:31:15,733][106226] Updated weights for policy 0, policy_version 872073 (0.0008) [2023-12-28 01:31:15,795][106226] Updated weights for policy 0, policy_version 872083 (0.0008) [2023-12-28 01:31:15,860][106226] Updated weights for policy 0, policy_version 872093 (0.0008) [2023-12-28 01:31:15,923][106226] Updated weights for policy 0, policy_version 872103 (0.0008) [2023-12-28 01:31:16,175][105115] Fps is (10 sec: 18840.8, 60 sec: 19524.1, 300 sec: 19744.1). Total num frames: 447160320. Throughput: 0: 9748.2, 1: 9931.6. Samples: 447151204. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:16,176][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.812')] [2023-12-28 01:31:16,201][106225] Updated weights for policy 1, policy_version 874242 (0.0008) [2023-12-28 01:31:16,263][106225] Updated weights for policy 1, policy_version 874252 (0.0009) [2023-12-28 01:31:16,325][106225] Updated weights for policy 1, policy_version 874262 (0.0010) [2023-12-28 01:31:16,385][106225] Updated weights for policy 1, policy_version 874272 (0.0010) [2023-12-28 01:31:16,595][106226] Updated weights for policy 0, policy_version 872113 (0.0005) [2023-12-28 01:31:16,657][106226] Updated weights for policy 0, policy_version 872123 (0.0008) [2023-12-28 01:31:16,717][106226] Updated weights for policy 0, policy_version 872133 (0.0010) [2023-12-28 01:31:17,075][106225] Updated weights for policy 1, policy_version 874282 (0.0006) [2023-12-28 01:31:17,138][106225] Updated weights for policy 1, policy_version 874292 (0.0008) [2023-12-28 01:31:17,191][106225] Updated weights for policy 1, policy_version 874302 (0.0005) [2023-12-28 01:31:17,366][106226] Updated weights for policy 0, policy_version 872143 (0.0008) [2023-12-28 01:31:17,433][106226] Updated weights for policy 0, policy_version 872153 (0.0009) [2023-12-28 01:31:17,491][106226] Updated weights for policy 0, policy_version 872163 (0.0005) [2023-12-28 01:31:17,697][106225] Updated weights for policy 1, policy_version 874312 (0.0005) [2023-12-28 01:31:17,759][106225] Updated weights for policy 1, policy_version 874322 (0.0010) [2023-12-28 01:31:17,822][106225] Updated weights for policy 1, policy_version 874332 (0.0010) [2023-12-28 01:31:18,129][106226] Updated weights for policy 0, policy_version 872173 (0.0009) [2023-12-28 01:31:18,185][106226] Updated weights for policy 0, policy_version 872183 (0.0008) [2023-12-28 01:31:18,239][106226] Updated weights for policy 0, policy_version 872193 (0.0008) [2023-12-28 01:31:18,395][106225] Updated weights for policy 1, policy_version 874342 (0.0006) [2023-12-28 01:31:18,447][106225] Updated weights for policy 1, policy_version 874352 (0.0006) [2023-12-28 01:31:18,512][106225] Updated weights for policy 1, policy_version 874362 (0.0009) [2023-12-28 01:31:18,971][106226] Updated weights for policy 0, policy_version 872203 (0.0008) [2023-12-28 01:31:19,026][106226] Updated weights for policy 0, policy_version 872213 (0.0008) [2023-12-28 01:31:19,069][106226] Updated weights for policy 0, policy_version 872223 (0.0008) [2023-12-28 01:31:19,156][106225] Updated weights for policy 1, policy_version 874372 (0.0010) [2023-12-28 01:31:19,203][106225] Updated weights for policy 1, policy_version 874382 (0.0010) [2023-12-28 01:31:19,270][106225] Updated weights for policy 1, policy_version 874392 (0.0010) [2023-12-28 01:31:19,878][106226] Updated weights for policy 0, policy_version 872233 (0.0008) [2023-12-28 01:31:19,907][106225] Updated weights for policy 1, policy_version 874403 (0.0011) [2023-12-28 01:31:19,940][106226] Updated weights for policy 0, policy_version 872243 (0.0007) [2023-12-28 01:31:19,972][106225] Updated weights for policy 1, policy_version 874413 (0.0009) [2023-12-28 01:31:20,003][106226] Updated weights for policy 0, policy_version 872253 (0.0006) [2023-12-28 01:31:20,038][106225] Updated weights for policy 1, policy_version 874423 (0.0007) [2023-12-28 01:31:20,067][106226] Updated weights for policy 0, policy_version 872263 (0.0008) [2023-12-28 01:31:20,722][106225] Updated weights for policy 1, policy_version 874433 (0.0007) [2023-12-28 01:31:20,788][106225] Updated weights for policy 1, policy_version 874443 (0.0007) [2023-12-28 01:31:20,802][106226] Updated weights for policy 0, policy_version 872273 (0.0008) [2023-12-28 01:31:20,854][106225] Updated weights for policy 1, policy_version 874453 (0.0009) [2023-12-28 01:31:20,864][106226] Updated weights for policy 0, policy_version 872283 (0.0006) [2023-12-28 01:31:20,916][106225] Updated weights for policy 1, policy_version 874463 (0.0009) [2023-12-28 01:31:20,930][106226] Updated weights for policy 0, policy_version 872293 (0.0007) [2023-12-28 01:31:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 447266816. Throughput: 0: 9725.4, 1: 9924.8. Samples: 447273280. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:21,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.099')] [2023-12-28 01:31:21,694][106226] Updated weights for policy 0, policy_version 872303 (0.0007) [2023-12-28 01:31:21,730][106225] Updated weights for policy 1, policy_version 874473 (0.0008) [2023-12-28 01:31:21,770][106226] Updated weights for policy 0, policy_version 872313 (0.0011) [2023-12-28 01:31:21,803][106225] Updated weights for policy 1, policy_version 874483 (0.0008) [2023-12-28 01:31:21,839][106226] Updated weights for policy 0, policy_version 872323 (0.0008) [2023-12-28 01:31:21,861][106225] Updated weights for policy 1, policy_version 874493 (0.0007) [2023-12-28 01:31:22,467][106226] Updated weights for policy 0, policy_version 872333 (0.0011) [2023-12-28 01:31:22,523][106226] Updated weights for policy 0, policy_version 872343 (0.0011) [2023-12-28 01:31:22,575][106225] Updated weights for policy 1, policy_version 874503 (0.0007) [2023-12-28 01:31:22,588][106226] Updated weights for policy 0, policy_version 872353 (0.0011) [2023-12-28 01:31:22,636][106225] Updated weights for policy 1, policy_version 874513 (0.0006) [2023-12-28 01:31:22,694][106225] Updated weights for policy 1, policy_version 874523 (0.0008) [2023-12-28 01:31:23,258][106226] Updated weights for policy 0, policy_version 872363 (0.0009) [2023-12-28 01:31:23,318][106226] Updated weights for policy 0, policy_version 872373 (0.0005) [2023-12-28 01:31:23,372][106226] Updated weights for policy 0, policy_version 872383 (0.0005) [2023-12-28 01:31:23,460][106225] Updated weights for policy 1, policy_version 874533 (0.0007) [2023-12-28 01:31:23,524][106225] Updated weights for policy 1, policy_version 874543 (0.0007) [2023-12-28 01:31:23,582][106225] Updated weights for policy 1, policy_version 874553 (0.0010) [2023-12-28 01:31:23,953][106226] Updated weights for policy 0, policy_version 872393 (0.0005) [2023-12-28 01:31:24,031][106226] Updated weights for policy 0, policy_version 872403 (0.0007) [2023-12-28 01:31:24,089][106226] Updated weights for policy 0, policy_version 872413 (0.0005) [2023-12-28 01:31:24,151][106226] Updated weights for policy 0, policy_version 872423 (0.0005) [2023-12-28 01:31:24,240][106225] Updated weights for policy 1, policy_version 874563 (0.0009) [2023-12-28 01:31:24,304][106225] Updated weights for policy 1, policy_version 874573 (0.0007) [2023-12-28 01:31:24,351][106225] Updated weights for policy 1, policy_version 874583 (0.0008) [2023-12-28 01:31:24,694][106226] Updated weights for policy 0, policy_version 872433 (0.0006) [2023-12-28 01:31:24,747][106226] Updated weights for policy 0, policy_version 872443 (0.0005) [2023-12-28 01:31:24,801][106226] Updated weights for policy 0, policy_version 872453 (0.0006) [2023-12-28 01:31:25,125][106225] Updated weights for policy 1, policy_version 874593 (0.0008) [2023-12-28 01:31:25,179][106225] Updated weights for policy 1, policy_version 874603 (0.0008) [2023-12-28 01:31:25,231][106225] Updated weights for policy 1, policy_version 874613 (0.0008) [2023-12-28 01:31:25,277][106225] Updated weights for policy 1, policy_version 874623 (0.0008) [2023-12-28 01:31:25,398][106226] Updated weights for policy 0, policy_version 872463 (0.0009) [2023-12-28 01:31:25,446][106226] Updated weights for policy 0, policy_version 872473 (0.0009) [2023-12-28 01:31:25,492][106226] Updated weights for policy 0, policy_version 872483 (0.0009) [2023-12-28 01:31:26,041][106225] Updated weights for policy 1, policy_version 874633 (0.0009) [2023-12-28 01:31:26,107][106225] Updated weights for policy 1, policy_version 874643 (0.0008) [2023-12-28 01:31:26,165][106225] Updated weights for policy 1, policy_version 874653 (0.0009) [2023-12-28 01:31:26,175][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 447356928. Throughput: 0: 9800.0, 1: 9872.4. Samples: 447332476. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:26,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-5.110')] [2023-12-28 01:31:26,178][106226] Updated weights for policy 0, policy_version 872493 (0.0007) [2023-12-28 01:31:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000874656_223952896.pth... [2023-12-28 01:31:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000873504_223657984.pth [2023-12-28 01:31:26,239][106226] Updated weights for policy 0, policy_version 872503 (0.0010) [2023-12-28 01:31:26,300][106226] Updated weights for policy 0, policy_version 872513 (0.0006) [2023-12-28 01:31:26,350][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000872520_223420416.pth... [2023-12-28 01:31:26,354][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000871336_223117312.pth [2023-12-28 01:31:26,827][106225] Updated weights for policy 1, policy_version 874663 (0.0006) [2023-12-28 01:31:26,881][106225] Updated weights for policy 1, policy_version 874673 (0.0005) [2023-12-28 01:31:26,942][106225] Updated weights for policy 1, policy_version 874683 (0.0005) [2023-12-28 01:31:26,959][106226] Updated weights for policy 0, policy_version 872523 (0.0006) [2023-12-28 01:31:27,023][106226] Updated weights for policy 0, policy_version 872533 (0.0005) [2023-12-28 01:31:27,078][106226] Updated weights for policy 0, policy_version 872543 (0.0005) [2023-12-28 01:31:27,474][106225] Updated weights for policy 1, policy_version 874693 (0.0005) [2023-12-28 01:31:27,535][106225] Updated weights for policy 1, policy_version 874703 (0.0005) [2023-12-28 01:31:27,589][106225] Updated weights for policy 1, policy_version 874713 (0.0009) [2023-12-28 01:31:27,675][106226] Updated weights for policy 0, policy_version 872553 (0.0006) [2023-12-28 01:31:27,725][106226] Updated weights for policy 0, policy_version 872563 (0.0010) [2023-12-28 01:31:27,791][106226] Updated weights for policy 0, policy_version 872573 (0.0011) [2023-12-28 01:31:27,840][106226] Updated weights for policy 0, policy_version 872583 (0.0010) [2023-12-28 01:31:28,183][106225] Updated weights for policy 1, policy_version 874723 (0.0005) [2023-12-28 01:31:28,241][106225] Updated weights for policy 1, policy_version 874733 (0.0006) [2023-12-28 01:31:28,305][106225] Updated weights for policy 1, policy_version 874743 (0.0007) [2023-12-28 01:31:28,548][106226] Updated weights for policy 0, policy_version 872593 (0.0010) [2023-12-28 01:31:28,604][106226] Updated weights for policy 0, policy_version 872603 (0.0010) [2023-12-28 01:31:28,661][106226] Updated weights for policy 0, policy_version 872613 (0.0010) [2023-12-28 01:31:28,926][106225] Updated weights for policy 1, policy_version 874753 (0.0007) [2023-12-28 01:31:28,989][106225] Updated weights for policy 1, policy_version 874763 (0.0010) [2023-12-28 01:31:29,041][106225] Updated weights for policy 1, policy_version 874773 (0.0006) [2023-12-28 01:31:29,096][106225] Updated weights for policy 1, policy_version 874783 (0.0005) [2023-12-28 01:31:29,385][106226] Updated weights for policy 0, policy_version 872623 (0.0009) [2023-12-28 01:31:29,446][106226] Updated weights for policy 0, policy_version 872633 (0.0011) [2023-12-28 01:31:29,506][106226] Updated weights for policy 0, policy_version 872643 (0.0010) [2023-12-28 01:31:29,779][106225] Updated weights for policy 1, policy_version 874793 (0.0008) [2023-12-28 01:31:29,846][106225] Updated weights for policy 1, policy_version 874803 (0.0007) [2023-12-28 01:31:29,907][106225] Updated weights for policy 1, policy_version 874813 (0.0007) [2023-12-28 01:31:30,260][106226] Updated weights for policy 0, policy_version 872654 (0.0009) [2023-12-28 01:31:30,328][106226] Updated weights for policy 0, policy_version 872664 (0.0009) [2023-12-28 01:31:30,390][106226] Updated weights for policy 0, policy_version 872674 (0.0008) [2023-12-28 01:31:30,583][106225] Updated weights for policy 1, policy_version 874823 (0.0009) [2023-12-28 01:31:30,639][106225] Updated weights for policy 1, policy_version 874833 (0.0010) [2023-12-28 01:31:30,702][106225] Updated weights for policy 1, policy_version 874843 (0.0010) [2023-12-28 01:31:31,088][106226] Updated weights for policy 0, policy_version 872684 (0.0008) [2023-12-28 01:31:31,158][106226] Updated weights for policy 0, policy_version 872694 (0.0008) [2023-12-28 01:31:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 447463424. Throughput: 0: 9914.9, 1: 9906.4. Samples: 447456956. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:31,176][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.926')] [2023-12-28 01:31:31,223][106226] Updated weights for policy 0, policy_version 872704 (0.0008) [2023-12-28 01:31:31,310][106225] Updated weights for policy 1, policy_version 874853 (0.0010) [2023-12-28 01:31:31,376][106225] Updated weights for policy 1, policy_version 874863 (0.0011) [2023-12-28 01:31:31,431][106225] Updated weights for policy 1, policy_version 874873 (0.0010) [2023-12-28 01:31:31,944][106226] Updated weights for policy 0, policy_version 872714 (0.0008) [2023-12-28 01:31:32,002][106226] Updated weights for policy 0, policy_version 872724 (0.0008) [2023-12-28 01:31:32,066][106226] Updated weights for policy 0, policy_version 872734 (0.0008) [2023-12-28 01:31:32,129][106226] Updated weights for policy 0, policy_version 872744 (0.0007) [2023-12-28 01:31:32,187][106225] Updated weights for policy 1, policy_version 874883 (0.0010) [2023-12-28 01:31:32,234][106225] Updated weights for policy 1, policy_version 874893 (0.0008) [2023-12-28 01:31:32,295][106225] Updated weights for policy 1, policy_version 874903 (0.0010) [2023-12-28 01:31:32,872][106226] Updated weights for policy 0, policy_version 872754 (0.0008) [2023-12-28 01:31:32,934][106226] Updated weights for policy 0, policy_version 872764 (0.0008) [2023-12-28 01:31:32,987][106226] Updated weights for policy 0, policy_version 872774 (0.0008) [2023-12-28 01:31:32,991][106225] Updated weights for policy 1, policy_version 874913 (0.0011) [2023-12-28 01:31:33,050][106225] Updated weights for policy 1, policy_version 874923 (0.0010) [2023-12-28 01:31:33,100][106225] Updated weights for policy 1, policy_version 874933 (0.0010) [2023-12-28 01:31:33,156][106225] Updated weights for policy 1, policy_version 874943 (0.0010) [2023-12-28 01:31:33,627][106226] Updated weights for policy 0, policy_version 872784 (0.0006) [2023-12-28 01:31:33,693][106226] Updated weights for policy 0, policy_version 872794 (0.0006) [2023-12-28 01:31:33,742][106226] Updated weights for policy 0, policy_version 872804 (0.0009) [2023-12-28 01:31:33,763][106225] Updated weights for policy 1, policy_version 874953 (0.0007) [2023-12-28 01:31:33,815][106225] Updated weights for policy 1, policy_version 874963 (0.0010) [2023-12-28 01:31:33,874][106225] Updated weights for policy 1, policy_version 874973 (0.0010) [2023-12-28 01:31:34,463][106226] Updated weights for policy 0, policy_version 872814 (0.0009) [2023-12-28 01:31:34,521][106226] Updated weights for policy 0, policy_version 872824 (0.0008) [2023-12-28 01:31:34,553][106225] Updated weights for policy 1, policy_version 874983 (0.0011) [2023-12-28 01:31:34,588][106226] Updated weights for policy 0, policy_version 872834 (0.0005) [2023-12-28 01:31:34,609][106225] Updated weights for policy 1, policy_version 874993 (0.0010) [2023-12-28 01:31:34,663][106225] Updated weights for policy 1, policy_version 875003 (0.0010) [2023-12-28 01:31:35,270][106226] Updated weights for policy 0, policy_version 872844 (0.0006) [2023-12-28 01:31:35,321][106226] Updated weights for policy 0, policy_version 872854 (0.0006) [2023-12-28 01:31:35,323][106225] Updated weights for policy 1, policy_version 875013 (0.0008) [2023-12-28 01:31:35,370][106225] Updated weights for policy 1, policy_version 875023 (0.0005) [2023-12-28 01:31:35,372][106226] Updated weights for policy 0, policy_version 872864 (0.0009) [2023-12-28 01:31:35,417][106225] Updated weights for policy 1, policy_version 875033 (0.0007) [2023-12-28 01:31:35,928][106226] Updated weights for policy 0, policy_version 872874 (0.0010) [2023-12-28 01:31:35,994][106226] Updated weights for policy 0, policy_version 872884 (0.0005) [2023-12-28 01:31:36,055][106226] Updated weights for policy 0, policy_version 872894 (0.0006) [2023-12-28 01:31:36,110][106226] Updated weights for policy 0, policy_version 872904 (0.0010) [2023-12-28 01:31:36,158][106225] Updated weights for policy 1, policy_version 875043 (0.0009) [2023-12-28 01:31:36,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 447569920. Throughput: 0: 9938.6, 1: 9929.9. Samples: 447578676. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:36,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.982')] [2023-12-28 01:31:36,221][106225] Updated weights for policy 1, policy_version 875053 (0.0008) [2023-12-28 01:31:36,285][106225] Updated weights for policy 1, policy_version 875063 (0.0009) [2023-12-28 01:31:36,877][106226] Updated weights for policy 0, policy_version 872914 (0.0009) [2023-12-28 01:31:36,933][106226] Updated weights for policy 0, policy_version 872924 (0.0009) [2023-12-28 01:31:36,942][106225] Updated weights for policy 1, policy_version 875073 (0.0009) [2023-12-28 01:31:36,980][106226] Updated weights for policy 0, policy_version 872934 (0.0009) [2023-12-28 01:31:36,989][106225] Updated weights for policy 1, policy_version 875083 (0.0007) [2023-12-28 01:31:37,032][106225] Updated weights for policy 1, policy_version 875093 (0.0008) [2023-12-28 01:31:37,085][106225] Updated weights for policy 1, policy_version 875103 (0.0009) [2023-12-28 01:31:37,654][106226] Updated weights for policy 0, policy_version 872944 (0.0007) [2023-12-28 01:31:37,711][106226] Updated weights for policy 0, policy_version 872954 (0.0007) [2023-12-28 01:31:37,768][106226] Updated weights for policy 0, policy_version 872964 (0.0011) [2023-12-28 01:31:37,779][106225] Updated weights for policy 1, policy_version 875113 (0.0006) [2023-12-28 01:31:37,825][106225] Updated weights for policy 1, policy_version 875123 (0.0007) [2023-12-28 01:31:37,871][106225] Updated weights for policy 1, policy_version 875133 (0.0008) [2023-12-28 01:31:38,497][106226] Updated weights for policy 0, policy_version 872974 (0.0011) [2023-12-28 01:31:38,562][106226] Updated weights for policy 0, policy_version 872984 (0.0011) [2023-12-28 01:31:38,625][106226] Updated weights for policy 0, policy_version 872994 (0.0011) [2023-12-28 01:31:38,653][106225] Updated weights for policy 1, policy_version 875143 (0.0006) [2023-12-28 01:31:38,712][106225] Updated weights for policy 1, policy_version 875153 (0.0007) [2023-12-28 01:31:38,767][106225] Updated weights for policy 1, policy_version 875163 (0.0008) [2023-12-28 01:31:39,318][106226] Updated weights for policy 0, policy_version 873004 (0.0009) [2023-12-28 01:31:39,390][106226] Updated weights for policy 0, policy_version 873014 (0.0008) [2023-12-28 01:31:39,464][106226] Updated weights for policy 0, policy_version 873024 (0.0009) [2023-12-28 01:31:39,492][106225] Updated weights for policy 1, policy_version 875173 (0.0008) [2023-12-28 01:31:39,557][106225] Updated weights for policy 1, policy_version 875183 (0.0008) [2023-12-28 01:31:39,623][106225] Updated weights for policy 1, policy_version 875193 (0.0008) [2023-12-28 01:31:40,237][106226] Updated weights for policy 0, policy_version 873034 (0.0008) [2023-12-28 01:31:40,291][106225] Updated weights for policy 1, policy_version 875203 (0.0006) [2023-12-28 01:31:40,305][106226] Updated weights for policy 0, policy_version 873044 (0.0009) [2023-12-28 01:31:40,347][106225] Updated weights for policy 1, policy_version 875213 (0.0006) [2023-12-28 01:31:40,374][106226] Updated weights for policy 0, policy_version 873054 (0.0009) [2023-12-28 01:31:40,412][106225] Updated weights for policy 1, policy_version 875223 (0.0006) [2023-12-28 01:31:40,436][106226] Updated weights for policy 0, policy_version 873064 (0.0007) [2023-12-28 01:31:40,983][106225] Updated weights for policy 1, policy_version 875233 (0.0006) [2023-12-28 01:31:41,041][106225] Updated weights for policy 1, policy_version 875243 (0.0008) [2023-12-28 01:31:41,105][106225] Updated weights for policy 1, policy_version 875253 (0.0008) [2023-12-28 01:31:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 447660032. Throughput: 0: 9947.9, 1: 9899.5. Samples: 447637160. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:41,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.853')] [2023-12-28 01:31:41,186][106225] Updated weights for policy 1, policy_version 875263 (0.0008) [2023-12-28 01:31:41,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000875264_224108544.pth... [2023-12-28 01:31:41,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000874080_223805440.pth [2023-12-28 01:31:41,255][106226] Updated weights for policy 0, policy_version 873074 (0.0008) [2023-12-28 01:31:41,319][106226] Updated weights for policy 0, policy_version 873084 (0.0007) [2023-12-28 01:31:41,387][106226] Updated weights for policy 0, policy_version 873094 (0.0008) [2023-12-28 01:31:41,398][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000873096_223567872.pth... [2023-12-28 01:31:41,402][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000871912_223264768.pth [2023-12-28 01:31:42,097][106225] Updated weights for policy 1, policy_version 875273 (0.0010) [2023-12-28 01:31:42,161][106225] Updated weights for policy 1, policy_version 875283 (0.0011) [2023-12-28 01:31:42,179][106226] Updated weights for policy 0, policy_version 873104 (0.0008) [2023-12-28 01:31:42,223][106225] Updated weights for policy 1, policy_version 875293 (0.0010) [2023-12-28 01:31:42,243][106226] Updated weights for policy 0, policy_version 873114 (0.0007) [2023-12-28 01:31:42,309][106226] Updated weights for policy 0, policy_version 873124 (0.0009) [2023-12-28 01:31:42,984][106226] Updated weights for policy 0, policy_version 873134 (0.0008) [2023-12-28 01:31:43,012][106225] Updated weights for policy 1, policy_version 875303 (0.0009) [2023-12-28 01:31:43,045][106226] Updated weights for policy 0, policy_version 873144 (0.0005) [2023-12-28 01:31:43,065][106225] Updated weights for policy 1, policy_version 875313 (0.0009) [2023-12-28 01:31:43,103][106226] Updated weights for policy 0, policy_version 873154 (0.0005) [2023-12-28 01:31:43,122][106225] Updated weights for policy 1, policy_version 875323 (0.0007) [2023-12-28 01:31:43,683][106226] Updated weights for policy 0, policy_version 873164 (0.0005) [2023-12-28 01:31:43,724][106225] Updated weights for policy 1, policy_version 875333 (0.0010) [2023-12-28 01:31:43,730][106226] Updated weights for policy 0, policy_version 873174 (0.0005) [2023-12-28 01:31:43,771][106225] Updated weights for policy 1, policy_version 875343 (0.0010) [2023-12-28 01:31:43,787][106226] Updated weights for policy 0, policy_version 873184 (0.0010) [2023-12-28 01:31:43,821][106225] Updated weights for policy 1, policy_version 875353 (0.0010) [2023-12-28 01:31:44,448][106226] Updated weights for policy 0, policy_version 873194 (0.0010) [2023-12-28 01:31:44,513][106226] Updated weights for policy 0, policy_version 873204 (0.0011) [2023-12-28 01:31:44,543][106225] Updated weights for policy 1, policy_version 875363 (0.0009) [2023-12-28 01:31:44,578][106226] Updated weights for policy 0, policy_version 873214 (0.0010) [2023-12-28 01:31:44,597][106225] Updated weights for policy 1, policy_version 875373 (0.0010) [2023-12-28 01:31:44,634][106226] Updated weights for policy 0, policy_version 873224 (0.0010) [2023-12-28 01:31:44,649][106225] Updated weights for policy 1, policy_version 875383 (0.0010) [2023-12-28 01:31:45,343][106226] Updated weights for policy 0, policy_version 873234 (0.0011) [2023-12-28 01:31:45,403][106226] Updated weights for policy 0, policy_version 873244 (0.0011) [2023-12-28 01:31:45,439][106225] Updated weights for policy 1, policy_version 875393 (0.0010) [2023-12-28 01:31:45,468][106226] Updated weights for policy 0, policy_version 873254 (0.0009) [2023-12-28 01:31:45,500][106225] Updated weights for policy 1, policy_version 875403 (0.0010) [2023-12-28 01:31:45,557][106225] Updated weights for policy 1, policy_version 875413 (0.0010) [2023-12-28 01:31:45,607][106225] Updated weights for policy 1, policy_version 875423 (0.0010) [2023-12-28 01:31:46,093][106226] Updated weights for policy 0, policy_version 873264 (0.0011) [2023-12-28 01:31:46,152][106226] Updated weights for policy 0, policy_version 873274 (0.0010) [2023-12-28 01:31:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 447758336. Throughput: 0: 9926.3, 1: 9869.1. Samples: 447753300. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:46,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.823')] [2023-12-28 01:31:46,208][106226] Updated weights for policy 0, policy_version 873284 (0.0010) [2023-12-28 01:31:46,328][106225] Updated weights for policy 1, policy_version 875433 (0.0010) [2023-12-28 01:31:46,380][106225] Updated weights for policy 1, policy_version 875443 (0.0010) [2023-12-28 01:31:46,430][106225] Updated weights for policy 1, policy_version 875453 (0.0010) [2023-12-28 01:31:46,852][106226] Updated weights for policy 0, policy_version 873294 (0.0010) [2023-12-28 01:31:46,898][106226] Updated weights for policy 0, policy_version 873304 (0.0010) [2023-12-28 01:31:46,948][106226] Updated weights for policy 0, policy_version 873314 (0.0010) [2023-12-28 01:31:47,114][106225] Updated weights for policy 1, policy_version 875463 (0.0010) [2023-12-28 01:31:47,167][106225] Updated weights for policy 1, policy_version 875473 (0.0010) [2023-12-28 01:31:47,230][106225] Updated weights for policy 1, policy_version 875483 (0.0010) [2023-12-28 01:31:47,657][106226] Updated weights for policy 0, policy_version 873324 (0.0010) [2023-12-28 01:31:47,704][106226] Updated weights for policy 0, policy_version 873334 (0.0010) [2023-12-28 01:31:47,758][106226] Updated weights for policy 0, policy_version 873344 (0.0010) [2023-12-28 01:31:47,884][106225] Updated weights for policy 1, policy_version 875493 (0.0008) [2023-12-28 01:31:47,937][106225] Updated weights for policy 1, policy_version 875503 (0.0005) [2023-12-28 01:31:47,996][106225] Updated weights for policy 1, policy_version 875513 (0.0010) [2023-12-28 01:31:48,487][106226] Updated weights for policy 0, policy_version 873354 (0.0011) [2023-12-28 01:31:48,551][106226] Updated weights for policy 0, policy_version 873364 (0.0011) [2023-12-28 01:31:48,617][106226] Updated weights for policy 0, policy_version 873374 (0.0011) [2023-12-28 01:31:48,623][106225] Updated weights for policy 1, policy_version 875523 (0.0010) [2023-12-28 01:31:48,672][106225] Updated weights for policy 1, policy_version 875533 (0.0010) [2023-12-28 01:31:48,676][106226] Updated weights for policy 0, policy_version 873384 (0.0011) [2023-12-28 01:31:48,728][106225] Updated weights for policy 1, policy_version 875543 (0.0007) [2023-12-28 01:31:49,388][106226] Updated weights for policy 0, policy_version 873394 (0.0008) [2023-12-28 01:31:49,398][106225] Updated weights for policy 1, policy_version 875553 (0.0006) [2023-12-28 01:31:49,453][106226] Updated weights for policy 0, policy_version 873404 (0.0006) [2023-12-28 01:31:49,455][106225] Updated weights for policy 1, policy_version 875563 (0.0008) [2023-12-28 01:31:49,512][106225] Updated weights for policy 1, policy_version 875573 (0.0008) [2023-12-28 01:31:49,513][106226] Updated weights for policy 0, policy_version 873414 (0.0011) [2023-12-28 01:31:49,568][106225] Updated weights for policy 1, policy_version 875583 (0.0008) [2023-12-28 01:31:50,191][106226] Updated weights for policy 0, policy_version 873424 (0.0011) [2023-12-28 01:31:50,256][106226] Updated weights for policy 0, policy_version 873434 (0.0011) [2023-12-28 01:31:50,320][106226] Updated weights for policy 0, policy_version 873444 (0.0011) [2023-12-28 01:31:50,338][106225] Updated weights for policy 1, policy_version 875593 (0.0006) [2023-12-28 01:31:50,395][106225] Updated weights for policy 1, policy_version 875603 (0.0007) [2023-12-28 01:31:50,445][106225] Updated weights for policy 1, policy_version 875613 (0.0007) [2023-12-28 01:31:51,015][106226] Updated weights for policy 0, policy_version 873454 (0.0007) [2023-12-28 01:31:51,084][106226] Updated weights for policy 0, policy_version 873464 (0.0009) [2023-12-28 01:31:51,142][106226] Updated weights for policy 0, policy_version 873474 (0.0008) [2023-12-28 01:31:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 447856640. Throughput: 0: 9953.9, 1: 9924.3. Samples: 447873572. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:51,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.721')] [2023-12-28 01:31:51,214][106225] Updated weights for policy 1, policy_version 875623 (0.0008) [2023-12-28 01:31:51,277][106225] Updated weights for policy 1, policy_version 875633 (0.0008) [2023-12-28 01:31:51,334][106225] Updated weights for policy 1, policy_version 875643 (0.0008) [2023-12-28 01:31:51,829][106226] Updated weights for policy 0, policy_version 873484 (0.0008) [2023-12-28 01:31:51,885][106226] Updated weights for policy 0, policy_version 873494 (0.0009) [2023-12-28 01:31:51,941][106226] Updated weights for policy 0, policy_version 873504 (0.0008) [2023-12-28 01:31:52,116][106225] Updated weights for policy 1, policy_version 875653 (0.0009) [2023-12-28 01:31:52,166][106225] Updated weights for policy 1, policy_version 875663 (0.0009) [2023-12-28 01:31:52,215][106225] Updated weights for policy 1, policy_version 875673 (0.0009) [2023-12-28 01:31:52,676][106226] Updated weights for policy 0, policy_version 873514 (0.0008) [2023-12-28 01:31:52,745][106226] Updated weights for policy 0, policy_version 873524 (0.0009) [2023-12-28 01:31:52,798][106226] Updated weights for policy 0, policy_version 873534 (0.0008) [2023-12-28 01:31:52,848][106226] Updated weights for policy 0, policy_version 873544 (0.0010) [2023-12-28 01:31:52,864][106225] Updated weights for policy 1, policy_version 875683 (0.0008) [2023-12-28 01:31:52,929][106225] Updated weights for policy 1, policy_version 875693 (0.0008) [2023-12-28 01:31:52,988][106225] Updated weights for policy 1, policy_version 875703 (0.0009) [2023-12-28 01:31:53,485][106226] Updated weights for policy 0, policy_version 873554 (0.0009) [2023-12-28 01:31:53,534][106226] Updated weights for policy 0, policy_version 873564 (0.0008) [2023-12-28 01:31:53,589][106226] Updated weights for policy 0, policy_version 873574 (0.0008) [2023-12-28 01:31:53,723][106225] Updated weights for policy 1, policy_version 875713 (0.0008) [2023-12-28 01:31:53,774][106225] Updated weights for policy 1, policy_version 875723 (0.0007) [2023-12-28 01:31:53,824][106225] Updated weights for policy 1, policy_version 875733 (0.0007) [2023-12-28 01:31:53,874][106225] Updated weights for policy 1, policy_version 875743 (0.0007) [2023-12-28 01:31:54,289][106226] Updated weights for policy 0, policy_version 873584 (0.0006) [2023-12-28 01:31:54,345][106226] Updated weights for policy 0, policy_version 873594 (0.0009) [2023-12-28 01:31:54,393][106226] Updated weights for policy 0, policy_version 873604 (0.0010) [2023-12-28 01:31:54,683][106225] Updated weights for policy 1, policy_version 875753 (0.0009) [2023-12-28 01:31:54,752][106225] Updated weights for policy 1, policy_version 875763 (0.0010) [2023-12-28 01:31:54,820][106225] Updated weights for policy 1, policy_version 875773 (0.0008) [2023-12-28 01:31:54,980][106226] Updated weights for policy 0, policy_version 873614 (0.0009) [2023-12-28 01:31:55,037][106226] Updated weights for policy 0, policy_version 873624 (0.0010) [2023-12-28 01:31:55,087][106226] Updated weights for policy 0, policy_version 873634 (0.0010) [2023-12-28 01:31:55,497][106225] Updated weights for policy 1, policy_version 875783 (0.0006) [2023-12-28 01:31:55,557][106225] Updated weights for policy 1, policy_version 875793 (0.0005) [2023-12-28 01:31:55,608][106225] Updated weights for policy 1, policy_version 875803 (0.0008) [2023-12-28 01:31:55,663][106226] Updated weights for policy 0, policy_version 873644 (0.0008) [2023-12-28 01:31:55,723][106226] Updated weights for policy 0, policy_version 873654 (0.0006) [2023-12-28 01:31:55,782][106226] Updated weights for policy 0, policy_version 873664 (0.0006) [2023-12-28 01:31:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 447963136. Throughput: 0: 9940.8, 1: 9936.9. Samples: 447931992. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:31:56,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.937')] [2023-12-28 01:31:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000873672_223715328.pth... [2023-12-28 01:31:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000872520_223420416.pth [2023-12-28 01:31:56,197][106225] Updated weights for policy 1, policy_version 875813 (0.0007) [2023-12-28 01:31:56,270][106225] Updated weights for policy 1, policy_version 875823 (0.0006) [2023-12-28 01:31:56,323][106226] Updated weights for policy 0, policy_version 873674 (0.0009) [2023-12-28 01:31:56,335][106225] Updated weights for policy 1, policy_version 875833 (0.0006) [2023-12-28 01:31:56,376][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000875840_224256000.pth... [2023-12-28 01:31:56,380][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000874656_223952896.pth [2023-12-28 01:31:56,384][106226] Updated weights for policy 0, policy_version 873684 (0.0005) [2023-12-28 01:31:56,436][106226] Updated weights for policy 0, policy_version 873694 (0.0006) [2023-12-28 01:31:56,494][106226] Updated weights for policy 0, policy_version 873704 (0.0005) [2023-12-28 01:31:56,912][106225] Updated weights for policy 1, policy_version 875843 (0.0008) [2023-12-28 01:31:56,977][106225] Updated weights for policy 1, policy_version 875853 (0.0007) [2023-12-28 01:31:57,032][106226] Updated weights for policy 0, policy_version 873714 (0.0005) [2023-12-28 01:31:57,047][106225] Updated weights for policy 1, policy_version 875863 (0.0010) [2023-12-28 01:31:57,098][106226] Updated weights for policy 0, policy_version 873724 (0.0006) [2023-12-28 01:31:57,166][106226] Updated weights for policy 0, policy_version 873734 (0.0006) [2023-12-28 01:31:57,733][106225] Updated weights for policy 1, policy_version 875873 (0.0008) [2023-12-28 01:31:57,781][106226] Updated weights for policy 0, policy_version 873744 (0.0010) [2023-12-28 01:31:57,783][106225] Updated weights for policy 1, policy_version 875883 (0.0006) [2023-12-28 01:31:57,831][106225] Updated weights for policy 1, policy_version 875893 (0.0008) [2023-12-28 01:31:57,844][106226] Updated weights for policy 0, policy_version 873754 (0.0010) [2023-12-28 01:31:57,888][106225] Updated weights for policy 1, policy_version 875903 (0.0005) [2023-12-28 01:31:57,901][106226] Updated weights for policy 0, policy_version 873764 (0.0010) [2023-12-28 01:31:58,649][106226] Updated weights for policy 0, policy_version 873774 (0.0009) [2023-12-28 01:31:58,673][106225] Updated weights for policy 1, policy_version 875913 (0.0010) [2023-12-28 01:31:58,710][106226] Updated weights for policy 0, policy_version 873784 (0.0008) [2023-12-28 01:31:58,738][106225] Updated weights for policy 1, policy_version 875923 (0.0010) [2023-12-28 01:31:58,775][106226] Updated weights for policy 0, policy_version 873794 (0.0008) [2023-12-28 01:31:58,807][106225] Updated weights for policy 1, policy_version 875933 (0.0009) [2023-12-28 01:31:59,594][106226] Updated weights for policy 0, policy_version 873804 (0.0007) [2023-12-28 01:31:59,645][106225] Updated weights for policy 1, policy_version 875943 (0.0006) [2023-12-28 01:31:59,661][106226] Updated weights for policy 0, policy_version 873814 (0.0010) [2023-12-28 01:31:59,697][106225] Updated weights for policy 1, policy_version 875953 (0.0005) [2023-12-28 01:31:59,725][106226] Updated weights for policy 0, policy_version 873824 (0.0011) [2023-12-28 01:31:59,761][106225] Updated weights for policy 1, policy_version 875963 (0.0005) [2023-12-28 01:32:00,436][106226] Updated weights for policy 0, policy_version 873834 (0.0009) [2023-12-28 01:32:00,445][106225] Updated weights for policy 1, policy_version 875973 (0.0008) [2023-12-28 01:32:00,491][106226] Updated weights for policy 0, policy_version 873844 (0.0005) [2023-12-28 01:32:00,493][106225] Updated weights for policy 1, policy_version 875983 (0.0010) [2023-12-28 01:32:00,541][106226] Updated weights for policy 0, policy_version 873854 (0.0005) [2023-12-28 01:32:00,542][106225] Updated weights for policy 1, policy_version 875993 (0.0010) [2023-12-28 01:32:00,592][106226] Updated weights for policy 0, policy_version 873864 (0.0006) [2023-12-28 01:32:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 448061440. Throughput: 0: 10089.0, 1: 9992.5. Samples: 448054868. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:01,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-5.114')] [2023-12-28 01:32:01,289][106225] Updated weights for policy 1, policy_version 876003 (0.0010) [2023-12-28 01:32:01,347][106225] Updated weights for policy 1, policy_version 876013 (0.0010) [2023-12-28 01:32:01,363][106226] Updated weights for policy 0, policy_version 873874 (0.0006) [2023-12-28 01:32:01,415][106225] Updated weights for policy 1, policy_version 876023 (0.0008) [2023-12-28 01:32:01,428][106226] Updated weights for policy 0, policy_version 873884 (0.0006) [2023-12-28 01:32:01,493][106226] Updated weights for policy 0, policy_version 873894 (0.0006) [2023-12-28 01:32:02,136][106225] Updated weights for policy 1, policy_version 876033 (0.0009) [2023-12-28 01:32:02,188][106225] Updated weights for policy 1, policy_version 876043 (0.0008) [2023-12-28 01:32:02,192][106226] Updated weights for policy 0, policy_version 873904 (0.0008) [2023-12-28 01:32:02,248][106225] Updated weights for policy 1, policy_version 876053 (0.0007) [2023-12-28 01:32:02,255][106226] Updated weights for policy 0, policy_version 873914 (0.0007) [2023-12-28 01:32:02,310][106225] Updated weights for policy 1, policy_version 876063 (0.0008) [2023-12-28 01:32:02,311][106226] Updated weights for policy 0, policy_version 873924 (0.0008) [2023-12-28 01:32:02,968][106226] Updated weights for policy 0, policy_version 873934 (0.0008) [2023-12-28 01:32:03,021][106226] Updated weights for policy 0, policy_version 873944 (0.0008) [2023-12-28 01:32:03,070][106225] Updated weights for policy 1, policy_version 876073 (0.0008) [2023-12-28 01:32:03,083][106226] Updated weights for policy 0, policy_version 873954 (0.0007) [2023-12-28 01:32:03,126][106225] Updated weights for policy 1, policy_version 876083 (0.0007) [2023-12-28 01:32:03,185][106225] Updated weights for policy 1, policy_version 876093 (0.0010) [2023-12-28 01:32:03,826][106226] Updated weights for policy 0, policy_version 873964 (0.0009) [2023-12-28 01:32:03,853][106225] Updated weights for policy 1, policy_version 876103 (0.0008) [2023-12-28 01:32:03,890][106226] Updated weights for policy 0, policy_version 873974 (0.0010) [2023-12-28 01:32:03,916][106225] Updated weights for policy 1, policy_version 876113 (0.0010) [2023-12-28 01:32:03,949][106226] Updated weights for policy 0, policy_version 873984 (0.0008) [2023-12-28 01:32:03,981][106225] Updated weights for policy 1, policy_version 876123 (0.0010) [2023-12-28 01:32:04,683][106226] Updated weights for policy 0, policy_version 873994 (0.0009) [2023-12-28 01:32:04,712][106225] Updated weights for policy 1, policy_version 876133 (0.0010) [2023-12-28 01:32:04,746][106226] Updated weights for policy 0, policy_version 874004 (0.0011) [2023-12-28 01:32:04,765][106225] Updated weights for policy 1, policy_version 876143 (0.0010) [2023-12-28 01:32:04,805][106226] Updated weights for policy 0, policy_version 874014 (0.0007) [2023-12-28 01:32:04,813][106225] Updated weights for policy 1, policy_version 876153 (0.0010) [2023-12-28 01:32:04,867][106226] Updated weights for policy 0, policy_version 874024 (0.0010) [2023-12-28 01:32:05,397][106225] Updated weights for policy 1, policy_version 876163 (0.0010) [2023-12-28 01:32:05,452][106226] Updated weights for policy 0, policy_version 874034 (0.0005) [2023-12-28 01:32:05,458][106225] Updated weights for policy 1, policy_version 876173 (0.0008) [2023-12-28 01:32:05,516][106226] Updated weights for policy 0, policy_version 874044 (0.0009) [2023-12-28 01:32:05,521][106225] Updated weights for policy 1, policy_version 876183 (0.0008) [2023-12-28 01:32:05,574][106226] Updated weights for policy 0, policy_version 874054 (0.0006) [2023-12-28 01:32:06,120][106225] Updated weights for policy 1, policy_version 876193 (0.0009) [2023-12-28 01:32:06,165][106226] Updated weights for policy 0, policy_version 874064 (0.0008) [2023-12-28 01:32:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 448159744. Throughput: 0: 10112.9, 1: 9914.9. Samples: 448174532. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:06,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.839')] [2023-12-28 01:32:06,181][106225] Updated weights for policy 1, policy_version 876203 (0.0006) [2023-12-28 01:32:06,217][106226] Updated weights for policy 0, policy_version 874074 (0.0009) [2023-12-28 01:32:06,242][106225] Updated weights for policy 1, policy_version 876213 (0.0009) [2023-12-28 01:32:06,273][106226] Updated weights for policy 0, policy_version 874084 (0.0007) [2023-12-28 01:32:06,311][106225] Updated weights for policy 1, policy_version 876223 (0.0005) [2023-12-28 01:32:06,984][106225] Updated weights for policy 1, policy_version 876233 (0.0010) [2023-12-28 01:32:07,040][106226] Updated weights for policy 0, policy_version 874094 (0.0007) [2023-12-28 01:32:07,073][106225] Updated weights for policy 1, policy_version 876243 (0.0010) [2023-12-28 01:32:07,093][106226] Updated weights for policy 0, policy_version 874104 (0.0006) [2023-12-28 01:32:07,137][106225] Updated weights for policy 1, policy_version 876253 (0.0010) [2023-12-28 01:32:07,150][106226] Updated weights for policy 0, policy_version 874114 (0.0005) [2023-12-28 01:32:07,763][106225] Updated weights for policy 1, policy_version 876263 (0.0007) [2023-12-28 01:32:07,788][106226] Updated weights for policy 0, policy_version 874124 (0.0007) [2023-12-28 01:32:07,812][106225] Updated weights for policy 1, policy_version 876273 (0.0005) [2023-12-28 01:32:07,839][106226] Updated weights for policy 0, policy_version 874134 (0.0010) [2023-12-28 01:32:07,867][106225] Updated weights for policy 1, policy_version 876283 (0.0005) [2023-12-28 01:32:07,903][106226] Updated weights for policy 0, policy_version 874144 (0.0009) [2023-12-28 01:32:08,467][106225] Updated weights for policy 1, policy_version 876293 (0.0009) [2023-12-28 01:32:08,527][106225] Updated weights for policy 1, policy_version 876303 (0.0010) [2023-12-28 01:32:08,584][106225] Updated weights for policy 1, policy_version 876313 (0.0006) [2023-12-28 01:32:08,606][106226] Updated weights for policy 0, policy_version 874154 (0.0010) [2023-12-28 01:32:08,675][106226] Updated weights for policy 0, policy_version 874164 (0.0010) [2023-12-28 01:32:08,747][106226] Updated weights for policy 0, policy_version 874174 (0.0010) [2023-12-28 01:32:08,815][106226] Updated weights for policy 0, policy_version 874184 (0.0006) [2023-12-28 01:32:09,248][106225] Updated weights for policy 1, policy_version 876323 (0.0007) [2023-12-28 01:32:09,316][106225] Updated weights for policy 1, policy_version 876333 (0.0007) [2023-12-28 01:32:09,384][106225] Updated weights for policy 1, policy_version 876343 (0.0009) [2023-12-28 01:32:09,412][106226] Updated weights for policy 0, policy_version 874194 (0.0010) [2023-12-28 01:32:09,484][106226] Updated weights for policy 0, policy_version 874204 (0.0011) [2023-12-28 01:32:09,547][106226] Updated weights for policy 0, policy_version 874214 (0.0008) [2023-12-28 01:32:10,050][106225] Updated weights for policy 1, policy_version 876353 (0.0008) [2023-12-28 01:32:10,118][106225] Updated weights for policy 1, policy_version 876363 (0.0006) [2023-12-28 01:32:10,181][106225] Updated weights for policy 1, policy_version 876373 (0.0008) [2023-12-28 01:32:10,246][106225] Updated weights for policy 1, policy_version 876383 (0.0009) [2023-12-28 01:32:10,347][106226] Updated weights for policy 0, policy_version 874224 (0.0009) [2023-12-28 01:32:10,408][106226] Updated weights for policy 0, policy_version 874234 (0.0009) [2023-12-28 01:32:10,471][106226] Updated weights for policy 0, policy_version 874244 (0.0008) [2023-12-28 01:32:10,955][106225] Updated weights for policy 1, policy_version 876393 (0.0006) [2023-12-28 01:32:11,008][106225] Updated weights for policy 1, policy_version 876403 (0.0007) [2023-12-28 01:32:11,073][106225] Updated weights for policy 1, policy_version 876413 (0.0007) [2023-12-28 01:32:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 448266240. Throughput: 0: 10092.3, 1: 10004.2. Samples: 448236824. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:11,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-4.952')] [2023-12-28 01:32:11,180][106226] Updated weights for policy 0, policy_version 874254 (0.0008) [2023-12-28 01:32:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000876416_224403456.pth... [2023-12-28 01:32:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000875264_224108544.pth [2023-12-28 01:32:11,251][106226] Updated weights for policy 0, policy_version 874264 (0.0007) [2023-12-28 01:32:11,314][106226] Updated weights for policy 0, policy_version 874274 (0.0009) [2023-12-28 01:32:11,352][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000874280_223870976.pth... [2023-12-28 01:32:11,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000873096_223567872.pth [2023-12-28 01:32:11,909][106225] Updated weights for policy 1, policy_version 876423 (0.0008) [2023-12-28 01:32:11,973][106225] Updated weights for policy 1, policy_version 876433 (0.0008) [2023-12-28 01:32:12,037][106225] Updated weights for policy 1, policy_version 876443 (0.0006) [2023-12-28 01:32:12,066][106226] Updated weights for policy 0, policy_version 874284 (0.0009) [2023-12-28 01:32:12,133][106226] Updated weights for policy 0, policy_version 874294 (0.0008) [2023-12-28 01:32:12,191][106226] Updated weights for policy 0, policy_version 874304 (0.0008) [2023-12-28 01:32:12,676][106225] Updated weights for policy 1, policy_version 876453 (0.0007) [2023-12-28 01:32:12,742][106225] Updated weights for policy 1, policy_version 876463 (0.0007) [2023-12-28 01:32:12,795][106225] Updated weights for policy 1, policy_version 876473 (0.0008) [2023-12-28 01:32:12,869][106226] Updated weights for policy 0, policy_version 874314 (0.0008) [2023-12-28 01:32:12,924][106226] Updated weights for policy 0, policy_version 874324 (0.0005) [2023-12-28 01:32:12,988][106226] Updated weights for policy 0, policy_version 874334 (0.0009) [2023-12-28 01:32:13,058][106226] Updated weights for policy 0, policy_version 874344 (0.0010) [2023-12-28 01:32:13,411][106225] Updated weights for policy 1, policy_version 876483 (0.0009) [2023-12-28 01:32:13,463][106225] Updated weights for policy 1, policy_version 876493 (0.0010) [2023-12-28 01:32:13,524][106225] Updated weights for policy 1, policy_version 876503 (0.0010) [2023-12-28 01:32:13,791][106226] Updated weights for policy 0, policy_version 874354 (0.0008) [2023-12-28 01:32:13,841][106226] Updated weights for policy 0, policy_version 874364 (0.0005) [2023-12-28 01:32:13,893][106226] Updated weights for policy 0, policy_version 874374 (0.0005) [2023-12-28 01:32:14,206][106225] Updated weights for policy 1, policy_version 876513 (0.0010) [2023-12-28 01:32:14,270][106225] Updated weights for policy 1, policy_version 876523 (0.0005) [2023-12-28 01:32:14,333][106225] Updated weights for policy 1, policy_version 876533 (0.0010) [2023-12-28 01:32:14,395][106225] Updated weights for policy 1, policy_version 876543 (0.0008) [2023-12-28 01:32:14,513][106226] Updated weights for policy 0, policy_version 874384 (0.0009) [2023-12-28 01:32:14,563][106226] Updated weights for policy 0, policy_version 874394 (0.0010) [2023-12-28 01:32:14,632][106226] Updated weights for policy 0, policy_version 874404 (0.0011) [2023-12-28 01:32:15,003][106225] Updated weights for policy 1, policy_version 876553 (0.0006) [2023-12-28 01:32:15,066][106225] Updated weights for policy 1, policy_version 876563 (0.0007) [2023-12-28 01:32:15,134][106225] Updated weights for policy 1, policy_version 876573 (0.0009) [2023-12-28 01:32:15,394][106226] Updated weights for policy 0, policy_version 874414 (0.0011) [2023-12-28 01:32:15,461][106226] Updated weights for policy 0, policy_version 874424 (0.0011) [2023-12-28 01:32:15,530][106226] Updated weights for policy 0, policy_version 874434 (0.0011) [2023-12-28 01:32:15,741][106225] Updated weights for policy 1, policy_version 876583 (0.0007) [2023-12-28 01:32:15,801][106225] Updated weights for policy 1, policy_version 876593 (0.0005) [2023-12-28 01:32:15,863][106225] Updated weights for policy 1, policy_version 876603 (0.0007) [2023-12-28 01:32:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 448364544. Throughput: 0: 9986.3, 1: 9972.1. Samples: 448355080. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:16,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.911')] [2023-12-28 01:32:16,190][106226] Updated weights for policy 0, policy_version 874444 (0.0011) [2023-12-28 01:32:16,254][106226] Updated weights for policy 0, policy_version 874454 (0.0010) [2023-12-28 01:32:16,314][106226] Updated weights for policy 0, policy_version 874464 (0.0011) [2023-12-28 01:32:16,560][106225] Updated weights for policy 1, policy_version 876613 (0.0009) [2023-12-28 01:32:16,619][106225] Updated weights for policy 1, policy_version 876623 (0.0010) [2023-12-28 01:32:16,675][106225] Updated weights for policy 1, policy_version 876633 (0.0010) [2023-12-28 01:32:16,958][106226] Updated weights for policy 0, policy_version 874474 (0.0010) [2023-12-28 01:32:17,018][106226] Updated weights for policy 0, policy_version 874484 (0.0008) [2023-12-28 01:32:17,066][106226] Updated weights for policy 0, policy_version 874494 (0.0008) [2023-12-28 01:32:17,120][106226] Updated weights for policy 0, policy_version 874504 (0.0008) [2023-12-28 01:32:17,354][106225] Updated weights for policy 1, policy_version 876643 (0.0010) [2023-12-28 01:32:17,418][106225] Updated weights for policy 1, policy_version 876653 (0.0010) [2023-12-28 01:32:17,472][106225] Updated weights for policy 1, policy_version 876663 (0.0010) [2023-12-28 01:32:17,794][106226] Updated weights for policy 0, policy_version 874514 (0.0010) [2023-12-28 01:32:17,851][106226] Updated weights for policy 0, policy_version 874524 (0.0010) [2023-12-28 01:32:17,900][106226] Updated weights for policy 0, policy_version 874534 (0.0007) [2023-12-28 01:32:18,183][106225] Updated weights for policy 1, policy_version 876673 (0.0010) [2023-12-28 01:32:18,242][106225] Updated weights for policy 1, policy_version 876683 (0.0005) [2023-12-28 01:32:18,296][106225] Updated weights for policy 1, policy_version 876693 (0.0010) [2023-12-28 01:32:18,355][106225] Updated weights for policy 1, policy_version 876703 (0.0008) [2023-12-28 01:32:18,577][106226] Updated weights for policy 0, policy_version 874544 (0.0008) [2023-12-28 01:32:18,636][106226] Updated weights for policy 0, policy_version 874554 (0.0008) [2023-12-28 01:32:18,691][106226] Updated weights for policy 0, policy_version 874564 (0.0007) [2023-12-28 01:32:19,034][106225] Updated weights for policy 1, policy_version 876713 (0.0010) [2023-12-28 01:32:19,081][106225] Updated weights for policy 1, policy_version 876723 (0.0010) [2023-12-28 01:32:19,131][106225] Updated weights for policy 1, policy_version 876733 (0.0010) [2023-12-28 01:32:19,413][106226] Updated weights for policy 0, policy_version 874574 (0.0008) [2023-12-28 01:32:19,472][106226] Updated weights for policy 0, policy_version 874584 (0.0008) [2023-12-28 01:32:19,542][106226] Updated weights for policy 0, policy_version 874594 (0.0008) [2023-12-28 01:32:19,916][106225] Updated weights for policy 1, policy_version 876743 (0.0009) [2023-12-28 01:32:19,985][106225] Updated weights for policy 1, policy_version 876753 (0.0008) [2023-12-28 01:32:20,048][106225] Updated weights for policy 1, policy_version 876763 (0.0010) [2023-12-28 01:32:20,281][106226] Updated weights for policy 0, policy_version 874604 (0.0007) [2023-12-28 01:32:20,337][106226] Updated weights for policy 0, policy_version 874614 (0.0008) [2023-12-28 01:32:20,394][106226] Updated weights for policy 0, policy_version 874624 (0.0008) [2023-12-28 01:32:20,757][106225] Updated weights for policy 1, policy_version 876773 (0.0010) [2023-12-28 01:32:20,824][106225] Updated weights for policy 1, policy_version 876783 (0.0011) [2023-12-28 01:32:20,885][106225] Updated weights for policy 1, policy_version 876793 (0.0010) [2023-12-28 01:32:21,127][106226] Updated weights for policy 0, policy_version 874634 (0.0009) [2023-12-28 01:32:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 448462848. Throughput: 0: 9974.5, 1: 9928.0. Samples: 448474288. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:21,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.795')] [2023-12-28 01:32:21,199][106226] Updated weights for policy 0, policy_version 874644 (0.0010) [2023-12-28 01:32:21,264][106226] Updated weights for policy 0, policy_version 874654 (0.0009) [2023-12-28 01:32:21,332][106226] Updated weights for policy 0, policy_version 874664 (0.0011) [2023-12-28 01:32:21,628][106225] Updated weights for policy 1, policy_version 876803 (0.0008) [2023-12-28 01:32:21,702][106225] Updated weights for policy 1, policy_version 876813 (0.0007) [2023-12-28 01:32:21,770][106225] Updated weights for policy 1, policy_version 876823 (0.0009) [2023-12-28 01:32:22,052][106226] Updated weights for policy 0, policy_version 874674 (0.0011) [2023-12-28 01:32:22,110][106226] Updated weights for policy 0, policy_version 874684 (0.0011) [2023-12-28 01:32:22,167][106226] Updated weights for policy 0, policy_version 874694 (0.0011) [2023-12-28 01:32:22,516][106225] Updated weights for policy 1, policy_version 876833 (0.0008) [2023-12-28 01:32:22,578][106225] Updated weights for policy 1, policy_version 876843 (0.0008) [2023-12-28 01:32:22,633][106225] Updated weights for policy 1, policy_version 876853 (0.0008) [2023-12-28 01:32:22,697][106225] Updated weights for policy 1, policy_version 876863 (0.0008) [2023-12-28 01:32:22,915][106226] Updated weights for policy 0, policy_version 874704 (0.0011) [2023-12-28 01:32:22,973][106226] Updated weights for policy 0, policy_version 874714 (0.0011) [2023-12-28 01:32:23,024][106226] Updated weights for policy 0, policy_version 874724 (0.0011) [2023-12-28 01:32:23,423][106225] Updated weights for policy 1, policy_version 876873 (0.0008) [2023-12-28 01:32:23,480][106225] Updated weights for policy 1, policy_version 876883 (0.0007) [2023-12-28 01:32:23,537][106225] Updated weights for policy 1, policy_version 876893 (0.0008) [2023-12-28 01:32:23,729][106226] Updated weights for policy 0, policy_version 874734 (0.0007) [2023-12-28 01:32:23,795][106226] Updated weights for policy 0, policy_version 874744 (0.0008) [2023-12-28 01:32:23,853][106226] Updated weights for policy 0, policy_version 874754 (0.0008) [2023-12-28 01:32:24,196][106225] Updated weights for policy 1, policy_version 876903 (0.0006) [2023-12-28 01:32:24,257][106225] Updated weights for policy 1, policy_version 876913 (0.0007) [2023-12-28 01:32:24,315][106225] Updated weights for policy 1, policy_version 876923 (0.0008) [2023-12-28 01:32:24,533][106226] Updated weights for policy 0, policy_version 874764 (0.0007) [2023-12-28 01:32:24,591][106226] Updated weights for policy 0, policy_version 874774 (0.0006) [2023-12-28 01:32:24,647][106226] Updated weights for policy 0, policy_version 874784 (0.0005) [2023-12-28 01:32:24,917][106225] Updated weights for policy 1, policy_version 876933 (0.0006) [2023-12-28 01:32:24,963][106225] Updated weights for policy 1, policy_version 876943 (0.0005) [2023-12-28 01:32:25,012][106225] Updated weights for policy 1, policy_version 876953 (0.0007) [2023-12-28 01:32:25,262][106226] Updated weights for policy 0, policy_version 874794 (0.0005) [2023-12-28 01:32:25,336][106226] Updated weights for policy 0, policy_version 874804 (0.0009) [2023-12-28 01:32:25,400][106226] Updated weights for policy 0, policy_version 874814 (0.0009) [2023-12-28 01:32:25,459][106226] Updated weights for policy 0, policy_version 874824 (0.0005) [2023-12-28 01:32:25,636][106225] Updated weights for policy 1, policy_version 876963 (0.0005) [2023-12-28 01:32:25,690][106225] Updated weights for policy 1, policy_version 876973 (0.0005) [2023-12-28 01:32:25,742][106225] Updated weights for policy 1, policy_version 876983 (0.0006) [2023-12-28 01:32:26,134][106226] Updated weights for policy 0, policy_version 874834 (0.0009) [2023-12-28 01:32:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 448561152. Throughput: 0: 9972.5, 1: 9888.9. Samples: 448530924. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:26,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-4.832')] [2023-12-28 01:32:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000876992_224550912.pth... [2023-12-28 01:32:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000875840_224256000.pth [2023-12-28 01:32:26,190][106226] Updated weights for policy 0, policy_version 874844 (0.0008) [2023-12-28 01:32:26,253][106226] Updated weights for policy 0, policy_version 874854 (0.0009) [2023-12-28 01:32:26,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000874856_224018432.pth... [2023-12-28 01:32:26,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000873672_223715328.pth [2023-12-28 01:32:26,325][106225] Updated weights for policy 1, policy_version 876993 (0.0005) [2023-12-28 01:32:26,388][106225] Updated weights for policy 1, policy_version 877003 (0.0006) [2023-12-28 01:32:26,444][106225] Updated weights for policy 1, policy_version 877013 (0.0008) [2023-12-28 01:32:26,505][106225] Updated weights for policy 1, policy_version 877023 (0.0007) [2023-12-28 01:32:26,984][106226] Updated weights for policy 0, policy_version 874864 (0.0009) [2023-12-28 01:32:27,049][106226] Updated weights for policy 0, policy_version 874874 (0.0009) [2023-12-28 01:32:27,101][106226] Updated weights for policy 0, policy_version 874884 (0.0006) [2023-12-28 01:32:27,174][106225] Updated weights for policy 1, policy_version 877033 (0.0009) [2023-12-28 01:32:27,226][106225] Updated weights for policy 1, policy_version 877043 (0.0008) [2023-12-28 01:32:27,290][106225] Updated weights for policy 1, policy_version 877053 (0.0008) [2023-12-28 01:32:27,709][106226] Updated weights for policy 0, policy_version 874894 (0.0006) [2023-12-28 01:32:27,764][106226] Updated weights for policy 0, policy_version 874904 (0.0009) [2023-12-28 01:32:27,824][106226] Updated weights for policy 0, policy_version 874914 (0.0010) [2023-12-28 01:32:28,019][106225] Updated weights for policy 1, policy_version 877063 (0.0007) [2023-12-28 01:32:28,075][106225] Updated weights for policy 1, policy_version 877073 (0.0008) [2023-12-28 01:32:28,127][106225] Updated weights for policy 1, policy_version 877083 (0.0007) [2023-12-28 01:32:28,503][106226] Updated weights for policy 0, policy_version 874924 (0.0009) [2023-12-28 01:32:28,556][106226] Updated weights for policy 0, policy_version 874934 (0.0008) [2023-12-28 01:32:28,609][106226] Updated weights for policy 0, policy_version 874944 (0.0009) [2023-12-28 01:32:28,868][106225] Updated weights for policy 1, policy_version 877093 (0.0008) [2023-12-28 01:32:28,924][106225] Updated weights for policy 1, policy_version 877103 (0.0008) [2023-12-28 01:32:28,979][106225] Updated weights for policy 1, policy_version 877113 (0.0008) [2023-12-28 01:32:29,350][106226] Updated weights for policy 0, policy_version 874954 (0.0008) [2023-12-28 01:32:29,417][106226] Updated weights for policy 0, policy_version 874964 (0.0008) [2023-12-28 01:32:29,475][106226] Updated weights for policy 0, policy_version 874974 (0.0008) [2023-12-28 01:32:29,530][106226] Updated weights for policy 0, policy_version 874984 (0.0008) [2023-12-28 01:32:29,636][106225] Updated weights for policy 1, policy_version 877123 (0.0007) [2023-12-28 01:32:29,697][106225] Updated weights for policy 1, policy_version 877133 (0.0005) [2023-12-28 01:32:29,761][106225] Updated weights for policy 1, policy_version 877143 (0.0005) [2023-12-28 01:32:30,255][106226] Updated weights for policy 0, policy_version 874994 (0.0005) [2023-12-28 01:32:30,311][106226] Updated weights for policy 0, policy_version 875004 (0.0006) [2023-12-28 01:32:30,372][106226] Updated weights for policy 0, policy_version 875014 (0.0009) [2023-12-28 01:32:30,428][106225] Updated weights for policy 1, policy_version 877153 (0.0008) [2023-12-28 01:32:30,477][106225] Updated weights for policy 1, policy_version 877163 (0.0005) [2023-12-28 01:32:30,524][106225] Updated weights for policy 1, policy_version 877173 (0.0005) [2023-12-28 01:32:30,571][106225] Updated weights for policy 1, policy_version 877183 (0.0005) [2023-12-28 01:32:31,033][106226] Updated weights for policy 0, policy_version 875024 (0.0008) [2023-12-28 01:32:31,098][106226] Updated weights for policy 0, policy_version 875034 (0.0008) [2023-12-28 01:32:31,167][106226] Updated weights for policy 0, policy_version 875044 (0.0008) [2023-12-28 01:32:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 448659456. Throughput: 0: 10030.0, 1: 10004.8. Samples: 448654864. Policy #0 lag: (min: 4.0, avg: 29.2, max: 32.0) [2023-12-28 01:32:31,175][105115] Avg episode reward: [(0, '-4.206'), (1, '-4.794')] [2023-12-28 01:32:31,307][106225] Updated weights for policy 1, policy_version 877193 (0.0008) [2023-12-28 01:32:31,380][106225] Updated weights for policy 1, policy_version 877203 (0.0008) [2023-12-28 01:32:31,430][106225] Updated weights for policy 1, policy_version 877213 (0.0008) [2023-12-28 01:32:32,015][106226] Updated weights for policy 0, policy_version 875054 (0.0008) [2023-12-28 01:32:32,066][106225] Updated weights for policy 1, policy_version 877223 (0.0007) [2023-12-28 01:32:32,082][106226] Updated weights for policy 0, policy_version 875064 (0.0007) [2023-12-28 01:32:32,116][106225] Updated weights for policy 1, policy_version 877233 (0.0006) [2023-12-28 01:32:32,140][106226] Updated weights for policy 0, policy_version 875074 (0.0008) [2023-12-28 01:32:32,168][106225] Updated weights for policy 1, policy_version 877243 (0.0005) [2023-12-28 01:32:32,888][106226] Updated weights for policy 0, policy_version 875084 (0.0009) [2023-12-28 01:32:32,902][106225] Updated weights for policy 1, policy_version 877253 (0.0008) [2023-12-28 01:32:32,935][106226] Updated weights for policy 0, policy_version 875094 (0.0008) [2023-12-28 01:32:32,961][106225] Updated weights for policy 1, policy_version 877263 (0.0008) [2023-12-28 01:32:32,989][106226] Updated weights for policy 0, policy_version 875104 (0.0009) [2023-12-28 01:32:33,013][106225] Updated weights for policy 1, policy_version 877273 (0.0005) [2023-12-28 01:32:33,704][106225] Updated weights for policy 1, policy_version 877283 (0.0007) [2023-12-28 01:32:33,711][106226] Updated weights for policy 0, policy_version 875114 (0.0007) [2023-12-28 01:32:33,761][106225] Updated weights for policy 1, policy_version 877293 (0.0006) [2023-12-28 01:32:33,769][106226] Updated weights for policy 0, policy_version 875124 (0.0006) [2023-12-28 01:32:33,822][106225] Updated weights for policy 1, policy_version 877303 (0.0005) [2023-12-28 01:32:33,830][106226] Updated weights for policy 0, policy_version 875134 (0.0008) [2023-12-28 01:32:33,891][106226] Updated weights for policy 0, policy_version 875144 (0.0006) [2023-12-28 01:32:34,479][106225] Updated weights for policy 1, policy_version 877313 (0.0007) [2023-12-28 01:32:34,513][106226] Updated weights for policy 0, policy_version 875154 (0.0011) [2023-12-28 01:32:34,540][106225] Updated weights for policy 1, policy_version 877323 (0.0006) [2023-12-28 01:32:34,578][106226] Updated weights for policy 0, policy_version 875164 (0.0011) [2023-12-28 01:32:34,608][106225] Updated weights for policy 1, policy_version 877333 (0.0006) [2023-12-28 01:32:34,649][106226] Updated weights for policy 0, policy_version 875174 (0.0008) [2023-12-28 01:32:34,666][106225] Updated weights for policy 1, policy_version 877343 (0.0006) [2023-12-28 01:32:35,305][106225] Updated weights for policy 1, policy_version 877353 (0.0010) [2023-12-28 01:32:35,308][106226] Updated weights for policy 0, policy_version 875184 (0.0006) [2023-12-28 01:32:35,355][106225] Updated weights for policy 1, policy_version 877363 (0.0010) [2023-12-28 01:32:35,357][106226] Updated weights for policy 0, policy_version 875194 (0.0006) [2023-12-28 01:32:35,411][106226] Updated weights for policy 0, policy_version 875204 (0.0008) [2023-12-28 01:32:35,412][106225] Updated weights for policy 1, policy_version 877373 (0.0010) [2023-12-28 01:32:36,046][106226] Updated weights for policy 0, policy_version 875214 (0.0006) [2023-12-28 01:32:36,116][106226] Updated weights for policy 0, policy_version 875224 (0.0007) [2023-12-28 01:32:36,136][106225] Updated weights for policy 1, policy_version 877383 (0.0009) [2023-12-28 01:32:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 448757760. Throughput: 0: 10016.8, 1: 10021.4. Samples: 448775292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:32:36,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.865')] [2023-12-28 01:32:36,183][106226] Updated weights for policy 0, policy_version 875234 (0.0008) [2023-12-28 01:32:36,204][106225] Updated weights for policy 1, policy_version 877393 (0.0008) [2023-12-28 01:32:36,274][106225] Updated weights for policy 1, policy_version 877403 (0.0007) [2023-12-28 01:32:36,882][106226] Updated weights for policy 0, policy_version 875244 (0.0010) [2023-12-28 01:32:36,932][106225] Updated weights for policy 1, policy_version 877413 (0.0008) [2023-12-28 01:32:36,951][106226] Updated weights for policy 0, policy_version 875254 (0.0011) [2023-12-28 01:32:36,984][106225] Updated weights for policy 1, policy_version 877423 (0.0007) [2023-12-28 01:32:37,006][106226] Updated weights for policy 0, policy_version 875264 (0.0008) [2023-12-28 01:32:37,032][106225] Updated weights for policy 1, policy_version 877433 (0.0005) [2023-12-28 01:32:37,584][106226] Updated weights for policy 0, policy_version 875274 (0.0007) [2023-12-28 01:32:37,643][106226] Updated weights for policy 0, policy_version 875284 (0.0010) [2023-12-28 01:32:37,694][106226] Updated weights for policy 0, policy_version 875294 (0.0011) [2023-12-28 01:32:37,742][106225] Updated weights for policy 1, policy_version 877443 (0.0006) [2023-12-28 01:32:37,757][106226] Updated weights for policy 0, policy_version 875304 (0.0006) [2023-12-28 01:32:37,801][106225] Updated weights for policy 1, policy_version 877453 (0.0006) [2023-12-28 01:32:37,853][106225] Updated weights for policy 1, policy_version 877463 (0.0007) [2023-12-28 01:32:38,400][106226] Updated weights for policy 0, policy_version 875314 (0.0006) [2023-12-28 01:32:38,428][106225] Updated weights for policy 1, policy_version 877473 (0.0006) [2023-12-28 01:32:38,464][106226] Updated weights for policy 0, policy_version 875324 (0.0007) [2023-12-28 01:32:38,493][106225] Updated weights for policy 1, policy_version 877483 (0.0010) [2023-12-28 01:32:38,515][106226] Updated weights for policy 0, policy_version 875334 (0.0007) [2023-12-28 01:32:38,550][106225] Updated weights for policy 1, policy_version 877493 (0.0010) [2023-12-28 01:32:38,601][106225] Updated weights for policy 1, policy_version 877503 (0.0010) [2023-12-28 01:32:39,206][106226] Updated weights for policy 0, policy_version 875344 (0.0007) [2023-12-28 01:32:39,211][106225] Updated weights for policy 1, policy_version 877513 (0.0010) [2023-12-28 01:32:39,274][106226] Updated weights for policy 0, policy_version 875354 (0.0008) [2023-12-28 01:32:39,277][106225] Updated weights for policy 1, policy_version 877523 (0.0009) [2023-12-28 01:32:39,340][106226] Updated weights for policy 0, policy_version 875364 (0.0007) [2023-12-28 01:32:39,343][106225] Updated weights for policy 1, policy_version 877533 (0.0008) [2023-12-28 01:32:40,051][106225] Updated weights for policy 1, policy_version 877543 (0.0008) [2023-12-28 01:32:40,097][106226] Updated weights for policy 0, policy_version 875374 (0.0006) [2023-12-28 01:32:40,111][106225] Updated weights for policy 1, policy_version 877553 (0.0008) [2023-12-28 01:32:40,159][106226] Updated weights for policy 0, policy_version 875384 (0.0007) [2023-12-28 01:32:40,169][106225] Updated weights for policy 1, policy_version 877563 (0.0008) [2023-12-28 01:32:40,222][106226] Updated weights for policy 0, policy_version 875394 (0.0006) [2023-12-28 01:32:40,909][106226] Updated weights for policy 0, policy_version 875404 (0.0008) [2023-12-28 01:32:40,930][106225] Updated weights for policy 1, policy_version 877573 (0.0010) [2023-12-28 01:32:40,975][106226] Updated weights for policy 0, policy_version 875414 (0.0006) [2023-12-28 01:32:40,984][106225] Updated weights for policy 1, policy_version 877583 (0.0010) [2023-12-28 01:32:41,042][106226] Updated weights for policy 0, policy_version 875424 (0.0007) [2023-12-28 01:32:41,051][106225] Updated weights for policy 1, policy_version 877593 (0.0010) [2023-12-28 01:32:41,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 448872448. Throughput: 0: 10045.4, 1: 10068.9. Samples: 448837136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:32:41,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.706')] [2023-12-28 01:32:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000877600_224706560.pth... [2023-12-28 01:32:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000875432_224165888.pth... [2023-12-28 01:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000876416_224403456.pth [2023-12-28 01:32:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000874280_223870976.pth [2023-12-28 01:32:41,793][106226] Updated weights for policy 0, policy_version 875434 (0.0009) [2023-12-28 01:32:41,827][106225] Updated weights for policy 1, policy_version 877603 (0.0008) [2023-12-28 01:32:41,855][106226] Updated weights for policy 0, policy_version 875444 (0.0007) [2023-12-28 01:32:41,886][106225] Updated weights for policy 1, policy_version 877613 (0.0008) [2023-12-28 01:32:41,916][106226] Updated weights for policy 0, policy_version 875454 (0.0006) [2023-12-28 01:32:41,953][106225] Updated weights for policy 1, policy_version 877623 (0.0008) [2023-12-28 01:32:41,978][106226] Updated weights for policy 0, policy_version 875464 (0.0007) [2023-12-28 01:32:42,678][106226] Updated weights for policy 0, policy_version 875474 (0.0007) [2023-12-28 01:32:42,704][106225] Updated weights for policy 1, policy_version 877633 (0.0007) [2023-12-28 01:32:42,741][106226] Updated weights for policy 0, policy_version 875484 (0.0006) [2023-12-28 01:32:42,758][106225] Updated weights for policy 1, policy_version 877643 (0.0010) [2023-12-28 01:32:42,803][106226] Updated weights for policy 0, policy_version 875494 (0.0006) [2023-12-28 01:32:42,826][106225] Updated weights for policy 1, policy_version 877653 (0.0011) [2023-12-28 01:32:42,887][106225] Updated weights for policy 1, policy_version 877663 (0.0008) [2023-12-28 01:32:43,418][106225] Updated weights for policy 1, policy_version 877673 (0.0005) [2023-12-28 01:32:43,480][106225] Updated weights for policy 1, policy_version 877683 (0.0006) [2023-12-28 01:32:43,544][106225] Updated weights for policy 1, policy_version 877693 (0.0010) [2023-12-28 01:32:43,575][106226] Updated weights for policy 0, policy_version 875504 (0.0008) [2023-12-28 01:32:43,631][106226] Updated weights for policy 0, policy_version 875514 (0.0008) [2023-12-28 01:32:43,690][106226] Updated weights for policy 0, policy_version 875524 (0.0006) [2023-12-28 01:32:44,212][106225] Updated weights for policy 1, policy_version 877703 (0.0010) [2023-12-28 01:32:44,264][106225] Updated weights for policy 1, policy_version 877713 (0.0010) [2023-12-28 01:32:44,322][106225] Updated weights for policy 1, policy_version 877723 (0.0007) [2023-12-28 01:32:44,359][106226] Updated weights for policy 0, policy_version 875534 (0.0007) [2023-12-28 01:32:44,422][106226] Updated weights for policy 0, policy_version 875544 (0.0008) [2023-12-28 01:32:44,483][106226] Updated weights for policy 0, policy_version 875554 (0.0007) [2023-12-28 01:32:45,046][106225] Updated weights for policy 1, policy_version 877733 (0.0010) [2023-12-28 01:32:45,107][106225] Updated weights for policy 1, policy_version 877743 (0.0011) [2023-12-28 01:32:45,169][106225] Updated weights for policy 1, policy_version 877753 (0.0011) [2023-12-28 01:32:45,169][106226] Updated weights for policy 0, policy_version 875564 (0.0009) [2023-12-28 01:32:45,224][106226] Updated weights for policy 0, policy_version 875574 (0.0011) [2023-12-28 01:32:45,288][106226] Updated weights for policy 0, policy_version 875584 (0.0009) [2023-12-28 01:32:45,828][106225] Updated weights for policy 1, policy_version 877763 (0.0010) [2023-12-28 01:32:45,873][106225] Updated weights for policy 1, policy_version 877773 (0.0007) [2023-12-28 01:32:45,926][106225] Updated weights for policy 1, policy_version 877783 (0.0008) [2023-12-28 01:32:46,007][106226] Updated weights for policy 0, policy_version 875594 (0.0009) [2023-12-28 01:32:46,064][106226] Updated weights for policy 0, policy_version 875604 (0.0009) [2023-12-28 01:32:46,135][106226] Updated weights for policy 0, policy_version 875614 (0.0007) [2023-12-28 01:32:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 448962560. Throughput: 0: 9888.1, 1: 10088.7. Samples: 448953816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:32:46,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.862')] [2023-12-28 01:32:46,195][106226] Updated weights for policy 0, policy_version 875624 (0.0010) [2023-12-28 01:32:46,591][106225] Updated weights for policy 1, policy_version 877793 (0.0007) [2023-12-28 01:32:46,638][106225] Updated weights for policy 1, policy_version 877803 (0.0005) [2023-12-28 01:32:46,687][106225] Updated weights for policy 1, policy_version 877813 (0.0007) [2023-12-28 01:32:46,746][106225] Updated weights for policy 1, policy_version 877823 (0.0006) [2023-12-28 01:32:46,921][106226] Updated weights for policy 0, policy_version 875634 (0.0008) [2023-12-28 01:32:46,977][106226] Updated weights for policy 0, policy_version 875644 (0.0006) [2023-12-28 01:32:47,031][106226] Updated weights for policy 0, policy_version 875654 (0.0009) [2023-12-28 01:32:47,368][106225] Updated weights for policy 1, policy_version 877833 (0.0008) [2023-12-28 01:32:47,428][106225] Updated weights for policy 1, policy_version 877843 (0.0007) [2023-12-28 01:32:47,493][106225] Updated weights for policy 1, policy_version 877853 (0.0010) [2023-12-28 01:32:47,672][106226] Updated weights for policy 0, policy_version 875664 (0.0008) [2023-12-28 01:32:47,737][106226] Updated weights for policy 0, policy_version 875674 (0.0007) [2023-12-28 01:32:47,794][106226] Updated weights for policy 0, policy_version 875684 (0.0006) [2023-12-28 01:32:48,195][106225] Updated weights for policy 1, policy_version 877863 (0.0007) [2023-12-28 01:32:48,241][106225] Updated weights for policy 1, policy_version 877873 (0.0005) [2023-12-28 01:32:48,288][106225] Updated weights for policy 1, policy_version 877883 (0.0005) [2023-12-28 01:32:48,446][106226] Updated weights for policy 0, policy_version 875694 (0.0007) [2023-12-28 01:32:48,509][106226] Updated weights for policy 0, policy_version 875704 (0.0006) [2023-12-28 01:32:48,577][106226] Updated weights for policy 0, policy_version 875714 (0.0009) [2023-12-28 01:32:48,903][106225] Updated weights for policy 1, policy_version 877893 (0.0008) [2023-12-28 01:32:48,962][106225] Updated weights for policy 1, policy_version 877903 (0.0008) [2023-12-28 01:32:49,013][106225] Updated weights for policy 1, policy_version 877913 (0.0008) [2023-12-28 01:32:49,257][106226] Updated weights for policy 0, policy_version 875724 (0.0010) [2023-12-28 01:32:49,316][106226] Updated weights for policy 0, policy_version 875734 (0.0008) [2023-12-28 01:32:49,380][106226] Updated weights for policy 0, policy_version 875744 (0.0008) [2023-12-28 01:32:49,679][106225] Updated weights for policy 1, policy_version 877923 (0.0006) [2023-12-28 01:32:49,732][106225] Updated weights for policy 1, policy_version 877933 (0.0008) [2023-12-28 01:32:49,782][106225] Updated weights for policy 1, policy_version 877943 (0.0008) [2023-12-28 01:32:50,187][106226] Updated weights for policy 0, policy_version 875754 (0.0008) [2023-12-28 01:32:50,240][106226] Updated weights for policy 0, policy_version 875764 (0.0008) [2023-12-28 01:32:50,297][106226] Updated weights for policy 0, policy_version 875774 (0.0009) [2023-12-28 01:32:50,353][106226] Updated weights for policy 0, policy_version 875784 (0.0009) [2023-12-28 01:32:50,469][106225] Updated weights for policy 1, policy_version 877953 (0.0008) [2023-12-28 01:32:50,520][106225] Updated weights for policy 1, policy_version 877963 (0.0005) [2023-12-28 01:32:50,580][106225] Updated weights for policy 1, policy_version 877973 (0.0006) [2023-12-28 01:32:50,636][106225] Updated weights for policy 1, policy_version 877983 (0.0006) [2023-12-28 01:32:51,140][106226] Updated weights for policy 0, policy_version 875794 (0.0007) [2023-12-28 01:32:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 449060864. Throughput: 0: 9826.7, 1: 10175.5. Samples: 449074628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:32:51,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-5.063')] [2023-12-28 01:32:51,209][106226] Updated weights for policy 0, policy_version 875804 (0.0006) [2023-12-28 01:32:51,276][106226] Updated weights for policy 0, policy_version 875814 (0.0008) [2023-12-28 01:32:51,314][106225] Updated weights for policy 1, policy_version 877993 (0.0008) [2023-12-28 01:32:51,380][106225] Updated weights for policy 1, policy_version 878003 (0.0008) [2023-12-28 01:32:51,442][106225] Updated weights for policy 1, policy_version 878013 (0.0006) [2023-12-28 01:32:51,983][106226] Updated weights for policy 0, policy_version 875824 (0.0006) [2023-12-28 01:32:52,040][106226] Updated weights for policy 0, policy_version 875834 (0.0005) [2023-12-28 01:32:52,104][106226] Updated weights for policy 0, policy_version 875844 (0.0008) [2023-12-28 01:32:52,149][106225] Updated weights for policy 1, policy_version 878023 (0.0007) [2023-12-28 01:32:52,208][106225] Updated weights for policy 1, policy_version 878033 (0.0009) [2023-12-28 01:32:52,270][106225] Updated weights for policy 1, policy_version 878043 (0.0008) [2023-12-28 01:32:52,860][106226] Updated weights for policy 0, policy_version 875854 (0.0008) [2023-12-28 01:32:52,875][106225] Updated weights for policy 1, policy_version 878053 (0.0007) [2023-12-28 01:32:52,923][106226] Updated weights for policy 0, policy_version 875864 (0.0008) [2023-12-28 01:32:52,940][106225] Updated weights for policy 1, policy_version 878063 (0.0006) [2023-12-28 01:32:52,974][106226] Updated weights for policy 0, policy_version 875874 (0.0008) [2023-12-28 01:32:52,997][106225] Updated weights for policy 1, policy_version 878073 (0.0005) [2023-12-28 01:32:53,553][106225] Updated weights for policy 1, policy_version 878083 (0.0005) [2023-12-28 01:32:53,613][106225] Updated weights for policy 1, policy_version 878093 (0.0006) [2023-12-28 01:32:53,680][106225] Updated weights for policy 1, policy_version 878103 (0.0005) [2023-12-28 01:32:53,744][106226] Updated weights for policy 0, policy_version 875884 (0.0009) [2023-12-28 01:32:53,808][106226] Updated weights for policy 0, policy_version 875894 (0.0008) [2023-12-28 01:32:53,862][106226] Updated weights for policy 0, policy_version 875904 (0.0008) [2023-12-28 01:32:54,305][106225] Updated weights for policy 1, policy_version 878113 (0.0006) [2023-12-28 01:32:54,354][106225] Updated weights for policy 1, policy_version 878123 (0.0008) [2023-12-28 01:32:54,421][106225] Updated weights for policy 1, policy_version 878133 (0.0006) [2023-12-28 01:32:54,483][106225] Updated weights for policy 1, policy_version 878143 (0.0009) [2023-12-28 01:32:54,582][106226] Updated weights for policy 0, policy_version 875914 (0.0009) [2023-12-28 01:32:54,630][106226] Updated weights for policy 0, policy_version 875924 (0.0008) [2023-12-28 01:32:54,684][106226] Updated weights for policy 0, policy_version 875934 (0.0008) [2023-12-28 01:32:54,743][106226] Updated weights for policy 0, policy_version 875944 (0.0009) [2023-12-28 01:32:55,195][106225] Updated weights for policy 1, policy_version 878153 (0.0008) [2023-12-28 01:32:55,247][106225] Updated weights for policy 1, policy_version 878163 (0.0008) [2023-12-28 01:32:55,292][106225] Updated weights for policy 1, policy_version 878173 (0.0007) [2023-12-28 01:32:55,500][106226] Updated weights for policy 0, policy_version 875954 (0.0009) [2023-12-28 01:32:55,551][106226] Updated weights for policy 0, policy_version 875964 (0.0009) [2023-12-28 01:32:55,602][106226] Updated weights for policy 0, policy_version 875974 (0.0008) [2023-12-28 01:32:55,982][106225] Updated weights for policy 1, policy_version 878183 (0.0007) [2023-12-28 01:32:56,043][106225] Updated weights for policy 1, policy_version 878193 (0.0007) [2023-12-28 01:32:56,100][106225] Updated weights for policy 1, policy_version 878203 (0.0007) [2023-12-28 01:32:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 449167360. Throughput: 0: 9785.0, 1: 10172.6. Samples: 449134916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:32:56,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.909')] [2023-12-28 01:32:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000875976_224305152.pth... [2023-12-28 01:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000878208_224862208.pth... [2023-12-28 01:32:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000874856_224018432.pth [2023-12-28 01:32:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000876992_224550912.pth [2023-12-28 01:32:56,357][106226] Updated weights for policy 0, policy_version 875984 (0.0008) [2023-12-28 01:32:56,407][106226] Updated weights for policy 0, policy_version 875994 (0.0008) [2023-12-28 01:32:56,451][106226] Updated weights for policy 0, policy_version 876004 (0.0008) [2023-12-28 01:32:56,781][106225] Updated weights for policy 1, policy_version 878213 (0.0007) [2023-12-28 01:32:56,842][106225] Updated weights for policy 1, policy_version 878223 (0.0008) [2023-12-28 01:32:56,904][106225] Updated weights for policy 1, policy_version 878233 (0.0008) [2023-12-28 01:32:57,145][106226] Updated weights for policy 0, policy_version 876014 (0.0009) [2023-12-28 01:32:57,199][106226] Updated weights for policy 0, policy_version 876024 (0.0008) [2023-12-28 01:32:57,251][106226] Updated weights for policy 0, policy_version 876034 (0.0008) [2023-12-28 01:32:57,656][106225] Updated weights for policy 1, policy_version 878243 (0.0009) [2023-12-28 01:32:57,712][106225] Updated weights for policy 1, policy_version 878253 (0.0008) [2023-12-28 01:32:57,774][106225] Updated weights for policy 1, policy_version 878263 (0.0009) [2023-12-28 01:32:58,005][106226] Updated weights for policy 0, policy_version 876044 (0.0009) [2023-12-28 01:32:58,050][106226] Updated weights for policy 0, policy_version 876054 (0.0008) [2023-12-28 01:32:58,102][106226] Updated weights for policy 0, policy_version 876064 (0.0008) [2023-12-28 01:32:58,465][106225] Updated weights for policy 1, policy_version 878273 (0.0008) [2023-12-28 01:32:58,531][106225] Updated weights for policy 1, policy_version 878283 (0.0009) [2023-12-28 01:32:58,597][106225] Updated weights for policy 1, policy_version 878293 (0.0008) [2023-12-28 01:32:58,663][106225] Updated weights for policy 1, policy_version 878303 (0.0009) [2023-12-28 01:32:58,938][106226] Updated weights for policy 0, policy_version 876074 (0.0008) [2023-12-28 01:32:58,999][106226] Updated weights for policy 0, policy_version 876084 (0.0008) [2023-12-28 01:32:59,058][106226] Updated weights for policy 0, policy_version 876094 (0.0008) [2023-12-28 01:32:59,111][106226] Updated weights for policy 0, policy_version 876104 (0.0009) [2023-12-28 01:32:59,504][106225] Updated weights for policy 1, policy_version 878313 (0.0006) [2023-12-28 01:32:59,566][106225] Updated weights for policy 1, policy_version 878323 (0.0005) [2023-12-28 01:32:59,635][106225] Updated weights for policy 1, policy_version 878333 (0.0007) [2023-12-28 01:32:59,838][106226] Updated weights for policy 0, policy_version 876114 (0.0007) [2023-12-28 01:32:59,906][106226] Updated weights for policy 0, policy_version 876124 (0.0006) [2023-12-28 01:32:59,973][106226] Updated weights for policy 0, policy_version 876134 (0.0007) [2023-12-28 01:33:00,412][106225] Updated weights for policy 1, policy_version 878343 (0.0007) [2023-12-28 01:33:00,476][106225] Updated weights for policy 1, policy_version 878353 (0.0008) [2023-12-28 01:33:00,537][106226] Updated weights for policy 0, policy_version 876144 (0.0006) [2023-12-28 01:33:00,538][106225] Updated weights for policy 1, policy_version 878363 (0.0009) [2023-12-28 01:33:00,603][106226] Updated weights for policy 0, policy_version 876154 (0.0006) [2023-12-28 01:33:00,671][106226] Updated weights for policy 0, policy_version 876164 (0.0006) [2023-12-28 01:33:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 449257472. Throughput: 0: 9786.5, 1: 10112.6. Samples: 449250540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:01,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.046')] [2023-12-28 01:33:01,310][106225] Updated weights for policy 1, policy_version 878373 (0.0009) [2023-12-28 01:33:01,353][106226] Updated weights for policy 0, policy_version 876174 (0.0008) [2023-12-28 01:33:01,374][106225] Updated weights for policy 1, policy_version 878383 (0.0007) [2023-12-28 01:33:01,417][106226] Updated weights for policy 0, policy_version 876184 (0.0008) [2023-12-28 01:33:01,431][106225] Updated weights for policy 1, policy_version 878393 (0.0008) [2023-12-28 01:33:01,469][106226] Updated weights for policy 0, policy_version 876194 (0.0008) [2023-12-28 01:33:02,097][106226] Updated weights for policy 0, policy_version 876204 (0.0006) [2023-12-28 01:33:02,160][106225] Updated weights for policy 1, policy_version 878403 (0.0006) [2023-12-28 01:33:02,166][106226] Updated weights for policy 0, policy_version 876214 (0.0006) [2023-12-28 01:33:02,222][106225] Updated weights for policy 1, policy_version 878413 (0.0008) [2023-12-28 01:33:02,234][106226] Updated weights for policy 0, policy_version 876224 (0.0008) [2023-12-28 01:33:02,287][106225] Updated weights for policy 1, policy_version 878423 (0.0008) [2023-12-28 01:33:02,828][106226] Updated weights for policy 0, policy_version 876234 (0.0008) [2023-12-28 01:33:02,888][106226] Updated weights for policy 0, policy_version 876244 (0.0009) [2023-12-28 01:33:02,949][106226] Updated weights for policy 0, policy_version 876254 (0.0008) [2023-12-28 01:33:02,961][106225] Updated weights for policy 1, policy_version 878433 (0.0006) [2023-12-28 01:33:03,007][106226] Updated weights for policy 0, policy_version 876264 (0.0008) [2023-12-28 01:33:03,009][106225] Updated weights for policy 1, policy_version 878443 (0.0008) [2023-12-28 01:33:03,058][106225] Updated weights for policy 1, policy_version 878453 (0.0009) [2023-12-28 01:33:03,102][106225] Updated weights for policy 1, policy_version 878463 (0.0008) [2023-12-28 01:33:03,582][106226] Updated weights for policy 0, policy_version 876274 (0.0005) [2023-12-28 01:33:03,629][106226] Updated weights for policy 0, policy_version 876284 (0.0005) [2023-12-28 01:33:03,679][106226] Updated weights for policy 0, policy_version 876294 (0.0005) [2023-12-28 01:33:03,947][106225] Updated weights for policy 1, policy_version 878473 (0.0009) [2023-12-28 01:33:03,995][106225] Updated weights for policy 1, policy_version 878483 (0.0008) [2023-12-28 01:33:04,055][106225] Updated weights for policy 1, policy_version 878493 (0.0009) [2023-12-28 01:33:04,305][106226] Updated weights for policy 0, policy_version 876304 (0.0008) [2023-12-28 01:33:04,362][106226] Updated weights for policy 0, policy_version 876314 (0.0009) [2023-12-28 01:33:04,426][106226] Updated weights for policy 0, policy_version 876324 (0.0008) [2023-12-28 01:33:04,842][106225] Updated weights for policy 1, policy_version 878503 (0.0008) [2023-12-28 01:33:04,902][106225] Updated weights for policy 1, policy_version 878513 (0.0008) [2023-12-28 01:33:04,952][106225] Updated weights for policy 1, policy_version 878523 (0.0008) [2023-12-28 01:33:05,061][106226] Updated weights for policy 0, policy_version 876334 (0.0010) [2023-12-28 01:33:05,107][106226] Updated weights for policy 0, policy_version 876344 (0.0010) [2023-12-28 01:33:05,164][106226] Updated weights for policy 0, policy_version 876354 (0.0010) [2023-12-28 01:33:05,662][106225] Updated weights for policy 1, policy_version 878533 (0.0008) [2023-12-28 01:33:05,715][106225] Updated weights for policy 1, policy_version 878543 (0.0007) [2023-12-28 01:33:05,781][106225] Updated weights for policy 1, policy_version 878553 (0.0007) [2023-12-28 01:33:05,894][106226] Updated weights for policy 0, policy_version 876364 (0.0010) [2023-12-28 01:33:05,961][106226] Updated weights for policy 0, policy_version 876374 (0.0010) [2023-12-28 01:33:06,023][106226] Updated weights for policy 0, policy_version 876384 (0.0008) [2023-12-28 01:33:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 449363968. Throughput: 0: 9903.4, 1: 10020.8. Samples: 449370876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:06,175][105115] Avg episode reward: [(0, '-3.959'), (1, '-4.941')] [2023-12-28 01:33:06,556][106225] Updated weights for policy 1, policy_version 878563 (0.0007) [2023-12-28 01:33:06,614][106225] Updated weights for policy 1, policy_version 878573 (0.0008) [2023-12-28 01:33:06,686][106225] Updated weights for policy 1, policy_version 878583 (0.0008) [2023-12-28 01:33:06,736][106226] Updated weights for policy 0, policy_version 876394 (0.0006) [2023-12-28 01:33:06,799][106226] Updated weights for policy 0, policy_version 876404 (0.0006) [2023-12-28 01:33:06,864][106226] Updated weights for policy 0, policy_version 876414 (0.0005) [2023-12-28 01:33:06,918][106226] Updated weights for policy 0, policy_version 876424 (0.0007) [2023-12-28 01:33:07,450][106225] Updated weights for policy 1, policy_version 878593 (0.0008) [2023-12-28 01:33:07,513][106225] Updated weights for policy 1, policy_version 878603 (0.0008) [2023-12-28 01:33:07,538][106226] Updated weights for policy 0, policy_version 876434 (0.0005) [2023-12-28 01:33:07,576][106225] Updated weights for policy 1, policy_version 878613 (0.0008) [2023-12-28 01:33:07,597][106226] Updated weights for policy 0, policy_version 876444 (0.0007) [2023-12-28 01:33:07,630][106225] Updated weights for policy 1, policy_version 878623 (0.0006) [2023-12-28 01:33:07,658][106226] Updated weights for policy 0, policy_version 876454 (0.0007) [2023-12-28 01:33:08,293][106226] Updated weights for policy 0, policy_version 876464 (0.0007) [2023-12-28 01:33:08,355][106226] Updated weights for policy 0, policy_version 876474 (0.0007) [2023-12-28 01:33:08,373][106225] Updated weights for policy 1, policy_version 878633 (0.0010) [2023-12-28 01:33:08,418][106226] Updated weights for policy 0, policy_version 876484 (0.0008) [2023-12-28 01:33:08,434][106225] Updated weights for policy 1, policy_version 878643 (0.0010) [2023-12-28 01:33:08,491][106225] Updated weights for policy 1, policy_version 878653 (0.0010) [2023-12-28 01:33:09,123][106226] Updated weights for policy 0, policy_version 876494 (0.0008) [2023-12-28 01:33:09,167][106225] Updated weights for policy 1, policy_version 878663 (0.0008) [2023-12-28 01:33:09,173][106226] Updated weights for policy 0, policy_version 876504 (0.0007) [2023-12-28 01:33:09,218][106225] Updated weights for policy 1, policy_version 878673 (0.0007) [2023-12-28 01:33:09,227][106226] Updated weights for policy 0, policy_version 876514 (0.0006) [2023-12-28 01:33:09,282][106225] Updated weights for policy 1, policy_version 878683 (0.0008) [2023-12-28 01:33:09,978][106226] Updated weights for policy 0, policy_version 876524 (0.0008) [2023-12-28 01:33:10,041][106226] Updated weights for policy 0, policy_version 876534 (0.0007) [2023-12-28 01:33:10,072][106225] Updated weights for policy 1, policy_version 878693 (0.0007) [2023-12-28 01:33:10,101][106226] Updated weights for policy 0, policy_version 876544 (0.0008) [2023-12-28 01:33:10,139][106225] Updated weights for policy 1, policy_version 878703 (0.0007) [2023-12-28 01:33:10,208][106225] Updated weights for policy 1, policy_version 878713 (0.0007) [2023-12-28 01:33:10,704][106226] Updated weights for policy 0, policy_version 876554 (0.0007) [2023-12-28 01:33:10,757][106226] Updated weights for policy 0, policy_version 876564 (0.0009) [2023-12-28 01:33:10,822][106226] Updated weights for policy 0, policy_version 876574 (0.0009) [2023-12-28 01:33:10,887][106226] Updated weights for policy 0, policy_version 876584 (0.0009) [2023-12-28 01:33:10,925][106225] Updated weights for policy 1, policy_version 878723 (0.0008) [2023-12-28 01:33:10,975][106225] Updated weights for policy 1, policy_version 878733 (0.0008) [2023-12-28 01:33:11,041][106225] Updated weights for policy 1, policy_version 878743 (0.0007) [2023-12-28 01:33:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 449462272. Throughput: 0: 9944.0, 1: 10021.9. Samples: 449429388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:11,175][105115] Avg episode reward: [(0, '-4.206'), (1, '-4.799')] [2023-12-28 01:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000876584_224460800.pth... [2023-12-28 01:33:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000878752_225001472.pth... [2023-12-28 01:33:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000875432_224165888.pth [2023-12-28 01:33:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000877600_224706560.pth [2023-12-28 01:33:11,753][106226] Updated weights for policy 0, policy_version 876594 (0.0009) [2023-12-28 01:33:11,795][106225] Updated weights for policy 1, policy_version 878753 (0.0009) [2023-12-28 01:33:11,819][106226] Updated weights for policy 0, policy_version 876604 (0.0010) [2023-12-28 01:33:11,856][106225] Updated weights for policy 1, policy_version 878763 (0.0007) [2023-12-28 01:33:11,878][106226] Updated weights for policy 0, policy_version 876614 (0.0009) [2023-12-28 01:33:11,918][106225] Updated weights for policy 1, policy_version 878773 (0.0007) [2023-12-28 01:33:11,986][106225] Updated weights for policy 1, policy_version 878783 (0.0009) [2023-12-28 01:33:12,611][106226] Updated weights for policy 0, policy_version 876624 (0.0010) [2023-12-28 01:33:12,682][106225] Updated weights for policy 1, policy_version 878793 (0.0007) [2023-12-28 01:33:12,684][106226] Updated weights for policy 0, policy_version 876634 (0.0008) [2023-12-28 01:33:12,733][106225] Updated weights for policy 1, policy_version 878803 (0.0006) [2023-12-28 01:33:12,747][106226] Updated weights for policy 0, policy_version 876644 (0.0009) [2023-12-28 01:33:12,791][106225] Updated weights for policy 1, policy_version 878813 (0.0006) [2023-12-28 01:33:13,373][106226] Updated weights for policy 0, policy_version 876654 (0.0008) [2023-12-28 01:33:13,383][106225] Updated weights for policy 1, policy_version 878823 (0.0006) [2023-12-28 01:33:13,421][106226] Updated weights for policy 0, policy_version 876664 (0.0008) [2023-12-28 01:33:13,438][106225] Updated weights for policy 1, policy_version 878833 (0.0006) [2023-12-28 01:33:13,472][106226] Updated weights for policy 0, policy_version 876674 (0.0007) [2023-12-28 01:33:13,484][106225] Updated weights for policy 1, policy_version 878843 (0.0006) [2023-12-28 01:33:14,155][106226] Updated weights for policy 0, policy_version 876684 (0.0010) [2023-12-28 01:33:14,204][106226] Updated weights for policy 0, policy_version 876694 (0.0008) [2023-12-28 01:33:14,219][106225] Updated weights for policy 1, policy_version 878853 (0.0006) [2023-12-28 01:33:14,261][106226] Updated weights for policy 0, policy_version 876704 (0.0008) [2023-12-28 01:33:14,279][106225] Updated weights for policy 1, policy_version 878863 (0.0005) [2023-12-28 01:33:14,349][106225] Updated weights for policy 1, policy_version 878873 (0.0005) [2023-12-28 01:33:14,963][106225] Updated weights for policy 1, policy_version 878883 (0.0005) [2023-12-28 01:33:15,022][106225] Updated weights for policy 1, policy_version 878893 (0.0011) [2023-12-28 01:33:15,043][106226] Updated weights for policy 0, policy_version 876714 (0.0009) [2023-12-28 01:33:15,079][106225] Updated weights for policy 1, policy_version 878903 (0.0006) [2023-12-28 01:33:15,106][106226] Updated weights for policy 0, policy_version 876724 (0.0009) [2023-12-28 01:33:15,171][106226] Updated weights for policy 0, policy_version 876734 (0.0009) [2023-12-28 01:33:15,225][106226] Updated weights for policy 0, policy_version 876744 (0.0009) [2023-12-28 01:33:15,728][106225] Updated weights for policy 1, policy_version 878913 (0.0006) [2023-12-28 01:33:15,784][106225] Updated weights for policy 1, policy_version 878923 (0.0010) [2023-12-28 01:33:15,844][106225] Updated weights for policy 1, policy_version 878933 (0.0010) [2023-12-28 01:33:15,871][106226] Updated weights for policy 0, policy_version 876754 (0.0006) [2023-12-28 01:33:15,904][106225] Updated weights for policy 1, policy_version 878943 (0.0007) [2023-12-28 01:33:15,934][106226] Updated weights for policy 0, policy_version 876764 (0.0009) [2023-12-28 01:33:15,987][106226] Updated weights for policy 0, policy_version 876774 (0.0006) [2023-12-28 01:33:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 449560576. Throughput: 0: 9889.8, 1: 9920.8. Samples: 449546340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:16,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.756')] [2023-12-28 01:33:16,607][106225] Updated weights for policy 1, policy_version 878953 (0.0009) [2023-12-28 01:33:16,613][106226] Updated weights for policy 0, policy_version 876784 (0.0005) [2023-12-28 01:33:16,668][106225] Updated weights for policy 1, policy_version 878963 (0.0008) [2023-12-28 01:33:16,677][106226] Updated weights for policy 0, policy_version 876794 (0.0006) [2023-12-28 01:33:16,728][106225] Updated weights for policy 1, policy_version 878973 (0.0007) [2023-12-28 01:33:16,738][106226] Updated weights for policy 0, policy_version 876804 (0.0007) [2023-12-28 01:33:17,289][106226] Updated weights for policy 0, policy_version 876814 (0.0008) [2023-12-28 01:33:17,337][106226] Updated weights for policy 0, policy_version 876824 (0.0008) [2023-12-28 01:33:17,384][106226] Updated weights for policy 0, policy_version 876834 (0.0007) [2023-12-28 01:33:17,401][106225] Updated weights for policy 1, policy_version 878983 (0.0007) [2023-12-28 01:33:17,444][106225] Updated weights for policy 1, policy_version 878993 (0.0007) [2023-12-28 01:33:17,500][106225] Updated weights for policy 1, policy_version 879003 (0.0008) [2023-12-28 01:33:18,164][106225] Updated weights for policy 1, policy_version 879013 (0.0008) [2023-12-28 01:33:18,166][106226] Updated weights for policy 0, policy_version 876844 (0.0006) [2023-12-28 01:33:18,214][106225] Updated weights for policy 1, policy_version 879023 (0.0006) [2023-12-28 01:33:18,221][106226] Updated weights for policy 0, policy_version 876854 (0.0007) [2023-12-28 01:33:18,266][106225] Updated weights for policy 1, policy_version 879033 (0.0007) [2023-12-28 01:33:18,272][106226] Updated weights for policy 0, policy_version 876864 (0.0006) [2023-12-28 01:33:19,025][106225] Updated weights for policy 1, policy_version 879043 (0.0009) [2023-12-28 01:33:19,030][106226] Updated weights for policy 0, policy_version 876874 (0.0006) [2023-12-28 01:33:19,082][106225] Updated weights for policy 1, policy_version 879053 (0.0011) [2023-12-28 01:33:19,088][106226] Updated weights for policy 0, policy_version 876884 (0.0005) [2023-12-28 01:33:19,129][106225] Updated weights for policy 1, policy_version 879063 (0.0010) [2023-12-28 01:33:19,139][106226] Updated weights for policy 0, policy_version 876894 (0.0005) [2023-12-28 01:33:19,187][106226] Updated weights for policy 0, policy_version 876904 (0.0006) [2023-12-28 01:33:19,975][106225] Updated weights for policy 1, policy_version 879073 (0.0010) [2023-12-28 01:33:19,977][106226] Updated weights for policy 0, policy_version 876914 (0.0008) [2023-12-28 01:33:20,031][106225] Updated weights for policy 1, policy_version 879083 (0.0007) [2023-12-28 01:33:20,042][106226] Updated weights for policy 0, policy_version 876924 (0.0007) [2023-12-28 01:33:20,087][106225] Updated weights for policy 1, policy_version 879093 (0.0007) [2023-12-28 01:33:20,098][106226] Updated weights for policy 0, policy_version 876934 (0.0007) [2023-12-28 01:33:20,142][106225] Updated weights for policy 1, policy_version 879103 (0.0010) [2023-12-28 01:33:20,808][106226] Updated weights for policy 0, policy_version 876944 (0.0008) [2023-12-28 01:33:20,860][106225] Updated weights for policy 1, policy_version 879113 (0.0009) [2023-12-28 01:33:20,865][106226] Updated weights for policy 0, policy_version 876954 (0.0009) [2023-12-28 01:33:20,914][106225] Updated weights for policy 1, policy_version 879123 (0.0009) [2023-12-28 01:33:20,923][106226] Updated weights for policy 0, policy_version 876964 (0.0009) [2023-12-28 01:33:20,976][106225] Updated weights for policy 1, policy_version 879133 (0.0007) [2023-12-28 01:33:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 449658880. Throughput: 0: 9872.4, 1: 9889.1. Samples: 449664560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:21,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-5.029')] [2023-12-28 01:33:21,663][106225] Updated weights for policy 1, policy_version 879143 (0.0007) [2023-12-28 01:33:21,671][106226] Updated weights for policy 0, policy_version 876974 (0.0008) [2023-12-28 01:33:21,712][106225] Updated weights for policy 1, policy_version 879153 (0.0008) [2023-12-28 01:33:21,739][106226] Updated weights for policy 0, policy_version 876984 (0.0007) [2023-12-28 01:33:21,784][106225] Updated weights for policy 1, policy_version 879163 (0.0009) [2023-12-28 01:33:21,810][106226] Updated weights for policy 0, policy_version 876994 (0.0007) [2023-12-28 01:33:22,514][106225] Updated weights for policy 1, policy_version 879173 (0.0006) [2023-12-28 01:33:22,548][106226] Updated weights for policy 0, policy_version 877004 (0.0008) [2023-12-28 01:33:22,571][106225] Updated weights for policy 1, policy_version 879183 (0.0008) [2023-12-28 01:33:22,611][106226] Updated weights for policy 0, policy_version 877014 (0.0006) [2023-12-28 01:33:22,630][106225] Updated weights for policy 1, policy_version 879193 (0.0009) [2023-12-28 01:33:22,677][106226] Updated weights for policy 0, policy_version 877024 (0.0008) [2023-12-28 01:33:23,332][106225] Updated weights for policy 1, policy_version 879203 (0.0008) [2023-12-28 01:33:23,344][106226] Updated weights for policy 0, policy_version 877034 (0.0011) [2023-12-28 01:33:23,387][106225] Updated weights for policy 1, policy_version 879213 (0.0006) [2023-12-28 01:33:23,392][106226] Updated weights for policy 0, policy_version 877044 (0.0010) [2023-12-28 01:33:23,443][106225] Updated weights for policy 1, policy_version 879223 (0.0005) [2023-12-28 01:33:23,449][106226] Updated weights for policy 0, policy_version 877054 (0.0011) [2023-12-28 01:33:23,502][106226] Updated weights for policy 0, policy_version 877064 (0.0009) [2023-12-28 01:33:24,178][106225] Updated weights for policy 1, policy_version 879233 (0.0008) [2023-12-28 01:33:24,233][106225] Updated weights for policy 1, policy_version 879243 (0.0006) [2023-12-28 01:33:24,237][106226] Updated weights for policy 0, policy_version 877074 (0.0011) [2023-12-28 01:33:24,285][106225] Updated weights for policy 1, policy_version 879253 (0.0006) [2023-12-28 01:33:24,297][106226] Updated weights for policy 0, policy_version 877084 (0.0011) [2023-12-28 01:33:24,341][106225] Updated weights for policy 1, policy_version 879263 (0.0006) [2023-12-28 01:33:24,351][106226] Updated weights for policy 0, policy_version 877094 (0.0010) [2023-12-28 01:33:25,072][106225] Updated weights for policy 1, policy_version 879273 (0.0008) [2023-12-28 01:33:25,077][106226] Updated weights for policy 0, policy_version 877104 (0.0011) [2023-12-28 01:33:25,125][106226] Updated weights for policy 0, policy_version 877114 (0.0010) [2023-12-28 01:33:25,130][106225] Updated weights for policy 1, policy_version 879283 (0.0007) [2023-12-28 01:33:25,179][106226] Updated weights for policy 0, policy_version 877124 (0.0009) [2023-12-28 01:33:25,190][106225] Updated weights for policy 1, policy_version 879293 (0.0009) [2023-12-28 01:33:25,904][106225] Updated weights for policy 1, policy_version 879303 (0.0008) [2023-12-28 01:33:25,906][106226] Updated weights for policy 0, policy_version 877134 (0.0009) [2023-12-28 01:33:25,956][106226] Updated weights for policy 0, policy_version 877144 (0.0010) [2023-12-28 01:33:25,957][106225] Updated weights for policy 1, policy_version 879313 (0.0005) [2023-12-28 01:33:26,013][106226] Updated weights for policy 0, policy_version 877154 (0.0011) [2023-12-28 01:33:26,015][106225] Updated weights for policy 1, policy_version 879323 (0.0006) [2023-12-28 01:33:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 449757184. Throughput: 0: 9828.3, 1: 9849.0. Samples: 449722620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:26,176][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.863')] [2023-12-28 01:33:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000877160_224608256.pth... [2023-12-28 01:33:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000879328_225148928.pth... [2023-12-28 01:33:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000875976_224305152.pth [2023-12-28 01:33:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000878208_224862208.pth [2023-12-28 01:33:26,737][106226] Updated weights for policy 0, policy_version 877164 (0.0010) [2023-12-28 01:33:26,749][106225] Updated weights for policy 1, policy_version 879333 (0.0008) [2023-12-28 01:33:26,790][106226] Updated weights for policy 0, policy_version 877174 (0.0010) [2023-12-28 01:33:26,802][106225] Updated weights for policy 1, policy_version 879343 (0.0010) [2023-12-28 01:33:26,839][106226] Updated weights for policy 0, policy_version 877184 (0.0010) [2023-12-28 01:33:26,851][106225] Updated weights for policy 1, policy_version 879353 (0.0010) [2023-12-28 01:33:27,532][106226] Updated weights for policy 0, policy_version 877194 (0.0010) [2023-12-28 01:33:27,565][106225] Updated weights for policy 1, policy_version 879363 (0.0010) [2023-12-28 01:33:27,583][106226] Updated weights for policy 0, policy_version 877204 (0.0006) [2023-12-28 01:33:27,626][106225] Updated weights for policy 1, policy_version 879373 (0.0010) [2023-12-28 01:33:27,645][106226] Updated weights for policy 0, policy_version 877214 (0.0008) [2023-12-28 01:33:27,683][106225] Updated weights for policy 1, policy_version 879383 (0.0010) [2023-12-28 01:33:27,706][106226] Updated weights for policy 0, policy_version 877224 (0.0010) [2023-12-28 01:33:28,255][106225] Updated weights for policy 1, policy_version 879393 (0.0009) [2023-12-28 01:33:28,314][106225] Updated weights for policy 1, policy_version 879403 (0.0005) [2023-12-28 01:33:28,375][106225] Updated weights for policy 1, policy_version 879413 (0.0006) [2023-12-28 01:33:28,407][106226] Updated weights for policy 0, policy_version 877234 (0.0011) [2023-12-28 01:33:28,434][106225] Updated weights for policy 1, policy_version 879423 (0.0006) [2023-12-28 01:33:28,471][106226] Updated weights for policy 0, policy_version 877244 (0.0011) [2023-12-28 01:33:28,535][106226] Updated weights for policy 0, policy_version 877254 (0.0011) [2023-12-28 01:33:29,025][106225] Updated weights for policy 1, policy_version 879433 (0.0007) [2023-12-28 01:33:29,092][106225] Updated weights for policy 1, policy_version 879443 (0.0006) [2023-12-28 01:33:29,156][106225] Updated weights for policy 1, policy_version 879453 (0.0007) [2023-12-28 01:33:29,261][106226] Updated weights for policy 0, policy_version 877264 (0.0009) [2023-12-28 01:33:29,329][106226] Updated weights for policy 0, policy_version 877274 (0.0007) [2023-12-28 01:33:29,399][106226] Updated weights for policy 0, policy_version 877284 (0.0006) [2023-12-28 01:33:29,822][106225] Updated weights for policy 1, policy_version 879463 (0.0006) [2023-12-28 01:33:29,892][106225] Updated weights for policy 1, policy_version 879473 (0.0009) [2023-12-28 01:33:29,963][106225] Updated weights for policy 1, policy_version 879483 (0.0009) [2023-12-28 01:33:30,080][106226] Updated weights for policy 0, policy_version 877294 (0.0007) [2023-12-28 01:33:30,145][106226] Updated weights for policy 0, policy_version 877304 (0.0007) [2023-12-28 01:33:30,208][106226] Updated weights for policy 0, policy_version 877314 (0.0007) [2023-12-28 01:33:30,614][106225] Updated weights for policy 1, policy_version 879493 (0.0008) [2023-12-28 01:33:30,670][106225] Updated weights for policy 1, policy_version 879503 (0.0008) [2023-12-28 01:33:30,718][106225] Updated weights for policy 1, policy_version 879513 (0.0008) [2023-12-28 01:33:30,941][106226] Updated weights for policy 0, policy_version 877324 (0.0009) [2023-12-28 01:33:30,996][106226] Updated weights for policy 0, policy_version 877334 (0.0008) [2023-12-28 01:33:31,052][106226] Updated weights for policy 0, policy_version 877344 (0.0007) [2023-12-28 01:33:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 449855488. Throughput: 0: 9862.8, 1: 9875.8. Samples: 449842056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:31,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-5.084')] [2023-12-28 01:33:31,435][106225] Updated weights for policy 1, policy_version 879523 (0.0007) [2023-12-28 01:33:31,501][106225] Updated weights for policy 1, policy_version 879533 (0.0006) [2023-12-28 01:33:31,565][106225] Updated weights for policy 1, policy_version 879543 (0.0005) [2023-12-28 01:33:31,752][106226] Updated weights for policy 0, policy_version 877354 (0.0007) [2023-12-28 01:33:31,810][106226] Updated weights for policy 0, policy_version 877364 (0.0011) [2023-12-28 01:33:31,874][106226] Updated weights for policy 0, policy_version 877374 (0.0011) [2023-12-28 01:33:31,934][106226] Updated weights for policy 0, policy_version 877384 (0.0010) [2023-12-28 01:33:32,235][106225] Updated weights for policy 1, policy_version 879553 (0.0009) [2023-12-28 01:33:32,309][106225] Updated weights for policy 1, policy_version 879563 (0.0008) [2023-12-28 01:33:32,363][106225] Updated weights for policy 1, policy_version 879573 (0.0008) [2023-12-28 01:33:32,421][106225] Updated weights for policy 1, policy_version 879583 (0.0008) [2023-12-28 01:33:32,691][106226] Updated weights for policy 0, policy_version 877394 (0.0007) [2023-12-28 01:33:32,743][106226] Updated weights for policy 0, policy_version 877404 (0.0007) [2023-12-28 01:33:32,797][106226] Updated weights for policy 0, policy_version 877414 (0.0008) [2023-12-28 01:33:33,192][106225] Updated weights for policy 1, policy_version 879593 (0.0006) [2023-12-28 01:33:33,241][106225] Updated weights for policy 1, policy_version 879603 (0.0005) [2023-12-28 01:33:33,296][106225] Updated weights for policy 1, policy_version 879613 (0.0005) [2023-12-28 01:33:33,582][106226] Updated weights for policy 0, policy_version 877424 (0.0008) [2023-12-28 01:33:33,639][106226] Updated weights for policy 0, policy_version 877434 (0.0008) [2023-12-28 01:33:33,686][106226] Updated weights for policy 0, policy_version 877444 (0.0008) [2023-12-28 01:33:33,890][106225] Updated weights for policy 1, policy_version 879623 (0.0010) [2023-12-28 01:33:33,942][106225] Updated weights for policy 1, policy_version 879633 (0.0010) [2023-12-28 01:33:33,991][106225] Updated weights for policy 1, policy_version 879643 (0.0007) [2023-12-28 01:33:34,392][106226] Updated weights for policy 0, policy_version 877454 (0.0009) [2023-12-28 01:33:34,451][106226] Updated weights for policy 0, policy_version 877464 (0.0009) [2023-12-28 01:33:34,514][106226] Updated weights for policy 0, policy_version 877474 (0.0009) [2023-12-28 01:33:34,684][106225] Updated weights for policy 1, policy_version 879653 (0.0006) [2023-12-28 01:33:34,737][106225] Updated weights for policy 1, policy_version 879663 (0.0008) [2023-12-28 01:33:34,789][106225] Updated weights for policy 1, policy_version 879673 (0.0008) [2023-12-28 01:33:35,251][106226] Updated weights for policy 0, policy_version 877484 (0.0009) [2023-12-28 01:33:35,313][106226] Updated weights for policy 0, policy_version 877494 (0.0008) [2023-12-28 01:33:35,366][106226] Updated weights for policy 0, policy_version 877504 (0.0008) [2023-12-28 01:33:35,530][106225] Updated weights for policy 1, policy_version 879683 (0.0008) [2023-12-28 01:33:35,583][106225] Updated weights for policy 1, policy_version 879693 (0.0008) [2023-12-28 01:33:35,642][106225] Updated weights for policy 1, policy_version 879703 (0.0008) [2023-12-28 01:33:36,099][106226] Updated weights for policy 0, policy_version 877514 (0.0008) [2023-12-28 01:33:36,171][106226] Updated weights for policy 0, policy_version 877524 (0.0009) [2023-12-28 01:33:36,175][105115] Fps is (10 sec: 18842.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 449945600. Throughput: 0: 9848.7, 1: 9795.8. Samples: 449958632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:36,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.684')] [2023-12-28 01:33:36,228][106226] Updated weights for policy 0, policy_version 877534 (0.0008) [2023-12-28 01:33:36,289][106226] Updated weights for policy 0, policy_version 877544 (0.0008) [2023-12-28 01:33:36,375][106225] Updated weights for policy 1, policy_version 879713 (0.0008) [2023-12-28 01:33:36,441][106225] Updated weights for policy 1, policy_version 879723 (0.0008) [2023-12-28 01:33:36,505][106225] Updated weights for policy 1, policy_version 879733 (0.0008) [2023-12-28 01:33:36,570][106225] Updated weights for policy 1, policy_version 879743 (0.0009) [2023-12-28 01:33:36,993][106226] Updated weights for policy 0, policy_version 877554 (0.0009) [2023-12-28 01:33:37,056][106226] Updated weights for policy 0, policy_version 877564 (0.0009) [2023-12-28 01:33:37,119][106226] Updated weights for policy 0, policy_version 877574 (0.0008) [2023-12-28 01:33:37,313][106225] Updated weights for policy 1, policy_version 879753 (0.0006) [2023-12-28 01:33:37,381][106225] Updated weights for policy 1, policy_version 879763 (0.0006) [2023-12-28 01:33:37,452][106225] Updated weights for policy 1, policy_version 879773 (0.0006) [2023-12-28 01:33:37,859][106226] Updated weights for policy 0, policy_version 877584 (0.0010) [2023-12-28 01:33:37,921][106226] Updated weights for policy 0, policy_version 877594 (0.0010) [2023-12-28 01:33:37,972][106226] Updated weights for policy 0, policy_version 877604 (0.0010) [2023-12-28 01:33:38,032][106225] Updated weights for policy 1, policy_version 879783 (0.0006) [2023-12-28 01:33:38,082][106225] Updated weights for policy 1, policy_version 879793 (0.0006) [2023-12-28 01:33:38,129][106225] Updated weights for policy 1, policy_version 879803 (0.0010) [2023-12-28 01:33:38,697][106226] Updated weights for policy 0, policy_version 877614 (0.0009) [2023-12-28 01:33:38,763][106226] Updated weights for policy 0, policy_version 877624 (0.0008) [2023-12-28 01:33:38,827][106226] Updated weights for policy 0, policy_version 877634 (0.0008) [2023-12-28 01:33:38,834][106225] Updated weights for policy 1, policy_version 879813 (0.0009) [2023-12-28 01:33:38,893][106225] Updated weights for policy 1, policy_version 879823 (0.0010) [2023-12-28 01:33:38,943][106225] Updated weights for policy 1, policy_version 879833 (0.0010) [2023-12-28 01:33:39,483][106226] Updated weights for policy 0, policy_version 877644 (0.0009) [2023-12-28 01:33:39,550][106226] Updated weights for policy 0, policy_version 877654 (0.0007) [2023-12-28 01:33:39,607][106226] Updated weights for policy 0, policy_version 877664 (0.0008) [2023-12-28 01:33:39,696][106225] Updated weights for policy 1, policy_version 879843 (0.0010) [2023-12-28 01:33:39,753][106225] Updated weights for policy 1, policy_version 879853 (0.0008) [2023-12-28 01:33:39,822][106225] Updated weights for policy 1, policy_version 879863 (0.0008) [2023-12-28 01:33:40,361][106226] Updated weights for policy 0, policy_version 877674 (0.0008) [2023-12-28 01:33:40,424][106226] Updated weights for policy 0, policy_version 877684 (0.0008) [2023-12-28 01:33:40,492][106226] Updated weights for policy 0, policy_version 877694 (0.0009) [2023-12-28 01:33:40,551][106226] Updated weights for policy 0, policy_version 877704 (0.0009) [2023-12-28 01:33:40,558][106225] Updated weights for policy 1, policy_version 879873 (0.0008) [2023-12-28 01:33:40,616][106225] Updated weights for policy 1, policy_version 879883 (0.0005) [2023-12-28 01:33:40,673][106225] Updated weights for policy 1, policy_version 879893 (0.0006) [2023-12-28 01:33:40,730][106225] Updated weights for policy 1, policy_version 879903 (0.0008) [2023-12-28 01:33:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 450043904. Throughput: 0: 9851.3, 1: 9757.3. Samples: 450017304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:41,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.794')] [2023-12-28 01:33:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000879904_225296384.pth... [2023-12-28 01:33:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000877704_224747520.pth... [2023-12-28 01:33:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000876584_224460800.pth [2023-12-28 01:33:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000878752_225001472.pth [2023-12-28 01:33:41,185][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000877704_224747520.pth [2023-12-28 01:33:41,185][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000879904_225296384.pth [2023-12-28 01:33:41,303][106226] Updated weights for policy 0, policy_version 877714 (0.0008) [2023-12-28 01:33:41,380][106226] Updated weights for policy 0, policy_version 877724 (0.0009) [2023-12-28 01:33:41,393][106225] Updated weights for policy 1, policy_version 879913 (0.0008) [2023-12-28 01:33:41,447][106226] Updated weights for policy 0, policy_version 877734 (0.0007) [2023-12-28 01:33:41,460][106225] Updated weights for policy 1, policy_version 879923 (0.0006) [2023-12-28 01:33:41,520][106225] Updated weights for policy 1, policy_version 879933 (0.0009) [2023-12-28 01:33:42,220][106226] Updated weights for policy 0, policy_version 877744 (0.0007) [2023-12-28 01:33:42,246][106225] Updated weights for policy 1, policy_version 879943 (0.0007) [2023-12-28 01:33:42,287][106226] Updated weights for policy 0, policy_version 877754 (0.0006) [2023-12-28 01:33:42,306][106225] Updated weights for policy 1, policy_version 879953 (0.0008) [2023-12-28 01:33:42,350][106226] Updated weights for policy 0, policy_version 877764 (0.0008) [2023-12-28 01:33:42,363][106225] Updated weights for policy 1, policy_version 879963 (0.0008) [2023-12-28 01:33:43,095][106225] Updated weights for policy 1, policy_version 879973 (0.0008) [2023-12-28 01:33:43,141][106225] Updated weights for policy 1, policy_version 879983 (0.0008) [2023-12-28 01:33:43,159][106226] Updated weights for policy 0, policy_version 877774 (0.0007) [2023-12-28 01:33:43,189][106225] Updated weights for policy 1, policy_version 879993 (0.0008) [2023-12-28 01:33:43,211][106226] Updated weights for policy 0, policy_version 877784 (0.0007) [2023-12-28 01:33:43,272][106226] Updated weights for policy 0, policy_version 877794 (0.0007) [2023-12-28 01:33:43,826][106225] Updated weights for policy 1, policy_version 880003 (0.0006) [2023-12-28 01:33:43,880][106225] Updated weights for policy 1, policy_version 880013 (0.0008) [2023-12-28 01:33:43,910][106226] Updated weights for policy 0, policy_version 877804 (0.0007) [2023-12-28 01:33:43,937][106225] Updated weights for policy 1, policy_version 880023 (0.0008) [2023-12-28 01:33:43,973][106226] Updated weights for policy 0, policy_version 877814 (0.0005) [2023-12-28 01:33:44,023][106226] Updated weights for policy 0, policy_version 877824 (0.0006) [2023-12-28 01:33:44,491][106225] Updated weights for policy 1, policy_version 880033 (0.0008) [2023-12-28 01:33:44,554][106225] Updated weights for policy 1, policy_version 880043 (0.0009) [2023-12-28 01:33:44,603][106225] Updated weights for policy 1, policy_version 880053 (0.0007) [2023-12-28 01:33:44,654][106226] Updated weights for policy 0, policy_version 877834 (0.0006) [2023-12-28 01:33:44,663][106225] Updated weights for policy 1, policy_version 880063 (0.0005) [2023-12-28 01:33:44,722][106226] Updated weights for policy 0, policy_version 877844 (0.0009) [2023-12-28 01:33:44,780][106226] Updated weights for policy 0, policy_version 877854 (0.0009) [2023-12-28 01:33:44,849][106226] Updated weights for policy 0, policy_version 877864 (0.0008) [2023-12-28 01:33:45,346][106225] Updated weights for policy 1, policy_version 880073 (0.0009) [2023-12-28 01:33:45,399][106225] Updated weights for policy 1, policy_version 880083 (0.0009) [2023-12-28 01:33:45,461][106225] Updated weights for policy 1, policy_version 880093 (0.0008) [2023-12-28 01:33:45,490][106226] Updated weights for policy 0, policy_version 877874 (0.0008) [2023-12-28 01:33:45,537][106226] Updated weights for policy 0, policy_version 877884 (0.0010) [2023-12-28 01:33:45,587][106226] Updated weights for policy 0, policy_version 877894 (0.0010) [2023-12-28 01:33:46,166][106225] Updated weights for policy 1, policy_version 880103 (0.0009) [2023-12-28 01:33:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 450142208. Throughput: 0: 9845.2, 1: 9824.8. Samples: 450135688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:46,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.677')] [2023-12-28 01:33:46,222][106225] Updated weights for policy 1, policy_version 880113 (0.0010) [2023-12-28 01:33:46,270][106225] Updated weights for policy 1, policy_version 880123 (0.0010) [2023-12-28 01:33:46,285][106226] Updated weights for policy 0, policy_version 877904 (0.0011) [2023-12-28 01:33:46,344][106226] Updated weights for policy 0, policy_version 877914 (0.0010) [2023-12-28 01:33:46,392][106226] Updated weights for policy 0, policy_version 877924 (0.0010) [2023-12-28 01:33:46,955][106225] Updated weights for policy 1, policy_version 880133 (0.0008) [2023-12-28 01:33:47,011][106225] Updated weights for policy 1, policy_version 880143 (0.0006) [2023-12-28 01:33:47,073][106225] Updated weights for policy 1, policy_version 880153 (0.0008) [2023-12-28 01:33:47,093][106226] Updated weights for policy 0, policy_version 877934 (0.0010) [2023-12-28 01:33:47,146][106226] Updated weights for policy 0, policy_version 877944 (0.0010) [2023-12-28 01:33:47,193][106226] Updated weights for policy 0, policy_version 877954 (0.0005) [2023-12-28 01:33:47,687][106225] Updated weights for policy 1, policy_version 880163 (0.0009) [2023-12-28 01:33:47,741][106225] Updated weights for policy 1, policy_version 880173 (0.0010) [2023-12-28 01:33:47,795][106225] Updated weights for policy 1, policy_version 880183 (0.0008) [2023-12-28 01:33:47,907][106226] Updated weights for policy 0, policy_version 877964 (0.0010) [2023-12-28 01:33:47,964][106226] Updated weights for policy 0, policy_version 877974 (0.0010) [2023-12-28 01:33:48,014][106226] Updated weights for policy 0, policy_version 877984 (0.0010) [2023-12-28 01:33:48,476][106225] Updated weights for policy 1, policy_version 880193 (0.0010) [2023-12-28 01:33:48,527][106225] Updated weights for policy 1, policy_version 880203 (0.0008) [2023-12-28 01:33:48,586][106225] Updated weights for policy 1, policy_version 880213 (0.0008) [2023-12-28 01:33:48,652][106225] Updated weights for policy 1, policy_version 880223 (0.0008) [2023-12-28 01:33:48,769][106226] Updated weights for policy 0, policy_version 877994 (0.0010) [2023-12-28 01:33:48,827][106226] Updated weights for policy 0, policy_version 878004 (0.0011) [2023-12-28 01:33:48,884][106226] Updated weights for policy 0, policy_version 878014 (0.0011) [2023-12-28 01:33:48,950][106226] Updated weights for policy 0, policy_version 878024 (0.0011) [2023-12-28 01:33:49,438][106225] Updated weights for policy 1, policy_version 880233 (0.0007) [2023-12-28 01:33:49,497][106225] Updated weights for policy 1, policy_version 880243 (0.0008) [2023-12-28 01:33:49,555][106225] Updated weights for policy 1, policy_version 880253 (0.0006) [2023-12-28 01:33:49,749][106226] Updated weights for policy 0, policy_version 878034 (0.0009) [2023-12-28 01:33:49,805][106226] Updated weights for policy 0, policy_version 878044 (0.0009) [2023-12-28 01:33:49,869][106226] Updated weights for policy 0, policy_version 878054 (0.0009) [2023-12-28 01:33:50,253][106225] Updated weights for policy 1, policy_version 880263 (0.0008) [2023-12-28 01:33:50,313][106225] Updated weights for policy 1, policy_version 880273 (0.0006) [2023-12-28 01:33:50,373][106225] Updated weights for policy 1, policy_version 880283 (0.0008) [2023-12-28 01:33:50,637][106226] Updated weights for policy 0, policy_version 878064 (0.0009) [2023-12-28 01:33:50,693][106226] Updated weights for policy 0, policy_version 878074 (0.0008) [2023-12-28 01:33:50,756][106226] Updated weights for policy 0, policy_version 878084 (0.0009) [2023-12-28 01:33:51,097][106225] Updated weights for policy 1, policy_version 880293 (0.0009) [2023-12-28 01:33:51,169][106225] Updated weights for policy 1, policy_version 880303 (0.0008) [2023-12-28 01:33:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 450240512. Throughput: 0: 9680.9, 1: 9910.4. Samples: 450252484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:51,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.717')] [2023-12-28 01:33:51,231][106225] Updated weights for policy 1, policy_version 880313 (0.0008) [2023-12-28 01:33:51,539][106226] Updated weights for policy 0, policy_version 878094 (0.0010) [2023-12-28 01:33:51,594][106226] Updated weights for policy 0, policy_version 878104 (0.0011) [2023-12-28 01:33:51,660][106226] Updated weights for policy 0, policy_version 878114 (0.0009) [2023-12-28 01:33:52,023][106225] Updated weights for policy 1, policy_version 880323 (0.0007) [2023-12-28 01:33:52,087][106225] Updated weights for policy 1, policy_version 880333 (0.0008) [2023-12-28 01:33:52,149][106225] Updated weights for policy 1, policy_version 880343 (0.0008) [2023-12-28 01:33:52,408][106226] Updated weights for policy 0, policy_version 878124 (0.0010) [2023-12-28 01:33:52,472][106226] Updated weights for policy 0, policy_version 878134 (0.0011) [2023-12-28 01:33:52,534][106226] Updated weights for policy 0, policy_version 878144 (0.0011) [2023-12-28 01:33:52,900][106225] Updated weights for policy 1, policy_version 880353 (0.0009) [2023-12-28 01:33:52,957][106225] Updated weights for policy 1, policy_version 880363 (0.0008) [2023-12-28 01:33:53,026][106225] Updated weights for policy 1, policy_version 880373 (0.0009) [2023-12-28 01:33:53,081][106225] Updated weights for policy 1, policy_version 880383 (0.0008) [2023-12-28 01:33:53,222][106226] Updated weights for policy 0, policy_version 878154 (0.0011) [2023-12-28 01:33:53,289][106226] Updated weights for policy 0, policy_version 878164 (0.0006) [2023-12-28 01:33:53,342][106226] Updated weights for policy 0, policy_version 878174 (0.0009) [2023-12-28 01:33:53,402][106226] Updated weights for policy 0, policy_version 878184 (0.0010) [2023-12-28 01:33:53,746][106225] Updated weights for policy 1, policy_version 880393 (0.0006) [2023-12-28 01:33:53,812][106225] Updated weights for policy 1, policy_version 880403 (0.0005) [2023-12-28 01:33:53,867][106225] Updated weights for policy 1, policy_version 880413 (0.0005) [2023-12-28 01:33:54,072][106226] Updated weights for policy 0, policy_version 878194 (0.0010) [2023-12-28 01:33:54,125][106226] Updated weights for policy 0, policy_version 878204 (0.0010) [2023-12-28 01:33:54,186][106226] Updated weights for policy 0, policy_version 878214 (0.0010) [2023-12-28 01:33:54,439][106225] Updated weights for policy 1, policy_version 880423 (0.0007) [2023-12-28 01:33:54,500][106225] Updated weights for policy 1, policy_version 880433 (0.0008) [2023-12-28 01:33:54,564][106225] Updated weights for policy 1, policy_version 880443 (0.0008) [2023-12-28 01:33:54,897][106226] Updated weights for policy 0, policy_version 878224 (0.0011) [2023-12-28 01:33:54,949][106226] Updated weights for policy 0, policy_version 878234 (0.0010) [2023-12-28 01:33:55,004][106226] Updated weights for policy 0, policy_version 878244 (0.0011) [2023-12-28 01:33:55,266][106225] Updated weights for policy 1, policy_version 880453 (0.0008) [2023-12-28 01:33:55,319][106225] Updated weights for policy 1, policy_version 880463 (0.0007) [2023-12-28 01:33:55,370][106225] Updated weights for policy 1, policy_version 880473 (0.0006) [2023-12-28 01:33:55,731][106226] Updated weights for policy 0, policy_version 878254 (0.0010) [2023-12-28 01:33:55,787][106226] Updated weights for policy 0, policy_version 878264 (0.0010) [2023-12-28 01:33:55,839][106226] Updated weights for policy 0, policy_version 878274 (0.0010) [2023-12-28 01:33:56,061][106225] Updated weights for policy 1, policy_version 880483 (0.0006) [2023-12-28 01:33:56,127][106225] Updated weights for policy 1, policy_version 880493 (0.0008) [2023-12-28 01:33:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 450338816. Throughput: 0: 9640.7, 1: 9932.2. Samples: 450310172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:33:56,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-5.048')] [2023-12-28 01:33:56,178][106225] Updated weights for policy 1, policy_version 880503 (0.0008) [2023-12-28 01:33:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000878280_224894976.pth... [2023-12-28 01:33:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000877160_224608256.pth [2023-12-28 01:33:56,230][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000880512_225452032.pth... [2023-12-28 01:33:56,234][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000879328_225148928.pth [2023-12-28 01:33:56,559][106226] Updated weights for policy 0, policy_version 878284 (0.0010) [2023-12-28 01:33:56,613][106226] Updated weights for policy 0, policy_version 878294 (0.0009) [2023-12-28 01:33:56,663][106226] Updated weights for policy 0, policy_version 878304 (0.0007) [2023-12-28 01:33:56,855][106225] Updated weights for policy 1, policy_version 880513 (0.0007) [2023-12-28 01:33:56,905][106225] Updated weights for policy 1, policy_version 880523 (0.0009) [2023-12-28 01:33:56,954][106225] Updated weights for policy 1, policy_version 880533 (0.0006) [2023-12-28 01:33:57,012][106225] Updated weights for policy 1, policy_version 880543 (0.0005) [2023-12-28 01:33:57,314][106226] Updated weights for policy 0, policy_version 878314 (0.0007) [2023-12-28 01:33:57,376][106226] Updated weights for policy 0, policy_version 878324 (0.0005) [2023-12-28 01:33:57,434][106226] Updated weights for policy 0, policy_version 878334 (0.0005) [2023-12-28 01:33:57,490][106226] Updated weights for policy 0, policy_version 878344 (0.0005) [2023-12-28 01:33:57,663][106225] Updated weights for policy 1, policy_version 880553 (0.0005) [2023-12-28 01:33:57,727][106225] Updated weights for policy 1, policy_version 880563 (0.0007) [2023-12-28 01:33:57,789][106225] Updated weights for policy 1, policy_version 880573 (0.0008) [2023-12-28 01:33:58,078][106226] Updated weights for policy 0, policy_version 878354 (0.0011) [2023-12-28 01:33:58,142][106226] Updated weights for policy 0, policy_version 878364 (0.0011) [2023-12-28 01:33:58,212][106226] Updated weights for policy 0, policy_version 878374 (0.0011) [2023-12-28 01:33:58,499][106225] Updated weights for policy 1, policy_version 880583 (0.0009) [2023-12-28 01:33:58,564][106225] Updated weights for policy 1, policy_version 880593 (0.0008) [2023-12-28 01:33:58,626][106225] Updated weights for policy 1, policy_version 880603 (0.0008) [2023-12-28 01:33:59,008][106226] Updated weights for policy 0, policy_version 878384 (0.0008) [2023-12-28 01:33:59,065][106226] Updated weights for policy 0, policy_version 878394 (0.0008) [2023-12-28 01:33:59,124][106226] Updated weights for policy 0, policy_version 878404 (0.0009) [2023-12-28 01:33:59,475][106225] Updated weights for policy 1, policy_version 880613 (0.0007) [2023-12-28 01:33:59,537][106225] Updated weights for policy 1, policy_version 880623 (0.0007) [2023-12-28 01:33:59,600][106225] Updated weights for policy 1, policy_version 880633 (0.0010) [2023-12-28 01:33:59,952][106226] Updated weights for policy 0, policy_version 878414 (0.0009) [2023-12-28 01:34:00,011][106226] Updated weights for policy 0, policy_version 878424 (0.0009) [2023-12-28 01:34:00,060][106226] Updated weights for policy 0, policy_version 878434 (0.0008) [2023-12-28 01:34:00,262][106225] Updated weights for policy 1, policy_version 880643 (0.0009) [2023-12-28 01:34:00,329][106225] Updated weights for policy 1, policy_version 880653 (0.0009) [2023-12-28 01:34:00,379][106225] Updated weights for policy 1, policy_version 880663 (0.0008) [2023-12-28 01:34:00,821][106226] Updated weights for policy 0, policy_version 878444 (0.0008) [2023-12-28 01:34:00,878][106226] Updated weights for policy 0, policy_version 878454 (0.0009) [2023-12-28 01:34:00,926][106226] Updated weights for policy 0, policy_version 878464 (0.0007) [2023-12-28 01:34:00,939][106225] Updated weights for policy 1, policy_version 880673 (0.0007) [2023-12-28 01:34:00,995][106225] Updated weights for policy 1, policy_version 880683 (0.0007) [2023-12-28 01:34:01,048][106225] Updated weights for policy 1, policy_version 880693 (0.0008) [2023-12-28 01:34:01,108][106225] Updated weights for policy 1, policy_version 880703 (0.0008) [2023-12-28 01:34:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 450445312. Throughput: 0: 9643.3, 1: 9939.0. Samples: 450427544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:01,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.881')] [2023-12-28 01:34:01,840][106226] Updated weights for policy 0, policy_version 878474 (0.0006) [2023-12-28 01:34:01,843][106225] Updated weights for policy 1, policy_version 880713 (0.0007) [2023-12-28 01:34:01,898][106225] Updated weights for policy 1, policy_version 880723 (0.0006) [2023-12-28 01:34:01,902][106226] Updated weights for policy 0, policy_version 878484 (0.0008) [2023-12-28 01:34:01,956][106225] Updated weights for policy 1, policy_version 880733 (0.0007) [2023-12-28 01:34:01,962][106226] Updated weights for policy 0, policy_version 878494 (0.0007) [2023-12-28 01:34:02,024][106226] Updated weights for policy 0, policy_version 878504 (0.0009) [2023-12-28 01:34:02,661][106225] Updated weights for policy 1, policy_version 880743 (0.0010) [2023-12-28 01:34:02,720][106225] Updated weights for policy 1, policy_version 880753 (0.0010) [2023-12-28 01:34:02,746][106226] Updated weights for policy 0, policy_version 878514 (0.0009) [2023-12-28 01:34:02,780][106225] Updated weights for policy 1, policy_version 880763 (0.0010) [2023-12-28 01:34:02,806][106226] Updated weights for policy 0, policy_version 878524 (0.0011) [2023-12-28 01:34:02,860][106226] Updated weights for policy 0, policy_version 878534 (0.0010) [2023-12-28 01:34:03,451][106225] Updated weights for policy 1, policy_version 880773 (0.0010) [2023-12-28 01:34:03,478][106226] Updated weights for policy 0, policy_version 878544 (0.0007) [2023-12-28 01:34:03,498][106225] Updated weights for policy 1, policy_version 880783 (0.0010) [2023-12-28 01:34:03,539][106226] Updated weights for policy 0, policy_version 878554 (0.0008) [2023-12-28 01:34:03,558][106225] Updated weights for policy 1, policy_version 880793 (0.0010) [2023-12-28 01:34:03,605][106226] Updated weights for policy 0, policy_version 878564 (0.0008) [2023-12-28 01:34:04,216][106226] Updated weights for policy 0, policy_version 878574 (0.0010) [2023-12-28 01:34:04,263][106225] Updated weights for policy 1, policy_version 880803 (0.0010) [2023-12-28 01:34:04,279][106226] Updated weights for policy 0, policy_version 878584 (0.0008) [2023-12-28 01:34:04,329][106225] Updated weights for policy 1, policy_version 880813 (0.0011) [2023-12-28 01:34:04,346][106226] Updated weights for policy 0, policy_version 878594 (0.0011) [2023-12-28 01:34:04,392][106225] Updated weights for policy 1, policy_version 880823 (0.0011) [2023-12-28 01:34:05,081][106225] Updated weights for policy 1, policy_version 880833 (0.0011) [2023-12-28 01:34:05,089][106226] Updated weights for policy 0, policy_version 878604 (0.0009) [2023-12-28 01:34:05,131][106225] Updated weights for policy 1, policy_version 880843 (0.0010) [2023-12-28 01:34:05,141][106226] Updated weights for policy 0, policy_version 878614 (0.0006) [2023-12-28 01:34:05,184][106225] Updated weights for policy 1, policy_version 880853 (0.0010) [2023-12-28 01:34:05,207][106226] Updated weights for policy 0, policy_version 878624 (0.0006) [2023-12-28 01:34:05,238][106225] Updated weights for policy 1, policy_version 880863 (0.0010) [2023-12-28 01:34:05,754][106226] Updated weights for policy 0, policy_version 878634 (0.0006) [2023-12-28 01:34:05,816][106226] Updated weights for policy 0, policy_version 878644 (0.0010) [2023-12-28 01:34:05,860][106225] Updated weights for policy 1, policy_version 880873 (0.0006) [2023-12-28 01:34:05,879][106226] Updated weights for policy 0, policy_version 878654 (0.0008) [2023-12-28 01:34:05,931][106225] Updated weights for policy 1, policy_version 880883 (0.0008) [2023-12-28 01:34:05,938][106226] Updated weights for policy 0, policy_version 878664 (0.0006) [2023-12-28 01:34:05,994][106225] Updated weights for policy 1, policy_version 880893 (0.0008) [2023-12-28 01:34:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 450543616. Throughput: 0: 9654.6, 1: 10002.0. Samples: 450549108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:06,175][105115] Avg episode reward: [(0, '-3.982'), (1, '-4.837')] [2023-12-28 01:34:06,576][106225] Updated weights for policy 1, policy_version 880903 (0.0006) [2023-12-28 01:34:06,635][106225] Updated weights for policy 1, policy_version 880913 (0.0006) [2023-12-28 01:34:06,695][106225] Updated weights for policy 1, policy_version 880923 (0.0008) [2023-12-28 01:34:06,778][106226] Updated weights for policy 0, policy_version 878674 (0.0008) [2023-12-28 01:34:06,832][106226] Updated weights for policy 0, policy_version 878684 (0.0008) [2023-12-28 01:34:06,883][106226] Updated weights for policy 0, policy_version 878694 (0.0008) [2023-12-28 01:34:07,306][106225] Updated weights for policy 1, policy_version 880933 (0.0008) [2023-12-28 01:34:07,369][106225] Updated weights for policy 1, policy_version 880943 (0.0006) [2023-12-28 01:34:07,429][106225] Updated weights for policy 1, policy_version 880953 (0.0005) [2023-12-28 01:34:07,519][106226] Updated weights for policy 0, policy_version 878704 (0.0008) [2023-12-28 01:34:07,589][106226] Updated weights for policy 0, policy_version 878714 (0.0009) [2023-12-28 01:34:07,654][106226] Updated weights for policy 0, policy_version 878724 (0.0009) [2023-12-28 01:34:07,963][106225] Updated weights for policy 1, policy_version 880963 (0.0006) [2023-12-28 01:34:08,023][106225] Updated weights for policy 1, policy_version 880973 (0.0005) [2023-12-28 01:34:08,078][106225] Updated weights for policy 1, policy_version 880983 (0.0007) [2023-12-28 01:34:08,380][106226] Updated weights for policy 0, policy_version 878734 (0.0008) [2023-12-28 01:34:08,445][106226] Updated weights for policy 0, policy_version 878744 (0.0009) [2023-12-28 01:34:08,511][106226] Updated weights for policy 0, policy_version 878754 (0.0008) [2023-12-28 01:34:08,824][106225] Updated weights for policy 1, policy_version 880993 (0.0008) [2023-12-28 01:34:08,890][106225] Updated weights for policy 1, policy_version 881003 (0.0007) [2023-12-28 01:34:08,955][106225] Updated weights for policy 1, policy_version 881013 (0.0008) [2023-12-28 01:34:09,021][106225] Updated weights for policy 1, policy_version 881023 (0.0008) [2023-12-28 01:34:09,204][106226] Updated weights for policy 0, policy_version 878764 (0.0008) [2023-12-28 01:34:09,275][106226] Updated weights for policy 0, policy_version 878774 (0.0007) [2023-12-28 01:34:09,349][106226] Updated weights for policy 0, policy_version 878784 (0.0008) [2023-12-28 01:34:09,805][106225] Updated weights for policy 1, policy_version 881033 (0.0008) [2023-12-28 01:34:09,872][106225] Updated weights for policy 1, policy_version 881043 (0.0007) [2023-12-28 01:34:09,943][106225] Updated weights for policy 1, policy_version 881053 (0.0007) [2023-12-28 01:34:10,042][106226] Updated weights for policy 0, policy_version 878794 (0.0011) [2023-12-28 01:34:10,111][106226] Updated weights for policy 0, policy_version 878804 (0.0009) [2023-12-28 01:34:10,172][106226] Updated weights for policy 0, policy_version 878814 (0.0009) [2023-12-28 01:34:10,234][106226] Updated weights for policy 0, policy_version 878824 (0.0009) [2023-12-28 01:34:10,604][106225] Updated weights for policy 1, policy_version 881063 (0.0008) [2023-12-28 01:34:10,674][106225] Updated weights for policy 1, policy_version 881073 (0.0009) [2023-12-28 01:34:10,726][106225] Updated weights for policy 1, policy_version 881083 (0.0009) [2023-12-28 01:34:10,893][106226] Updated weights for policy 0, policy_version 878834 (0.0010) [2023-12-28 01:34:10,954][106226] Updated weights for policy 0, policy_version 878844 (0.0011) [2023-12-28 01:34:11,018][106226] Updated weights for policy 0, policy_version 878854 (0.0011) [2023-12-28 01:34:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 450641920. Throughput: 0: 9642.0, 1: 10091.4. Samples: 450610620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:11,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-5.135')] [2023-12-28 01:34:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000878856_225042432.pth... [2023-12-28 01:34:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000881088_225599488.pth... [2023-12-28 01:34:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000877704_224747520.pth [2023-12-28 01:34:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000879904_225296384.pth [2023-12-28 01:34:11,471][106225] Updated weights for policy 1, policy_version 881093 (0.0008) [2023-12-28 01:34:11,534][106225] Updated weights for policy 1, policy_version 881103 (0.0007) [2023-12-28 01:34:11,594][106225] Updated weights for policy 1, policy_version 881113 (0.0007) [2023-12-28 01:34:11,823][106226] Updated weights for policy 0, policy_version 878864 (0.0010) [2023-12-28 01:34:11,892][106226] Updated weights for policy 0, policy_version 878874 (0.0011) [2023-12-28 01:34:11,956][106226] Updated weights for policy 0, policy_version 878884 (0.0010) [2023-12-28 01:34:12,383][106225] Updated weights for policy 1, policy_version 881123 (0.0008) [2023-12-28 01:34:12,446][106225] Updated weights for policy 1, policy_version 881133 (0.0009) [2023-12-28 01:34:12,509][106225] Updated weights for policy 1, policy_version 881143 (0.0010) [2023-12-28 01:34:12,705][106226] Updated weights for policy 0, policy_version 878894 (0.0009) [2023-12-28 01:34:12,770][106226] Updated weights for policy 0, policy_version 878904 (0.0006) [2023-12-28 01:34:12,835][106226] Updated weights for policy 0, policy_version 878914 (0.0010) [2023-12-28 01:34:13,264][106225] Updated weights for policy 1, policy_version 881153 (0.0010) [2023-12-28 01:34:13,328][106225] Updated weights for policy 1, policy_version 881163 (0.0010) [2023-12-28 01:34:13,382][106225] Updated weights for policy 1, policy_version 881173 (0.0010) [2023-12-28 01:34:13,446][106225] Updated weights for policy 1, policy_version 881183 (0.0010) [2023-12-28 01:34:13,471][106226] Updated weights for policy 0, policy_version 878924 (0.0011) [2023-12-28 01:34:13,524][106226] Updated weights for policy 0, policy_version 878934 (0.0005) [2023-12-28 01:34:13,585][106226] Updated weights for policy 0, policy_version 878944 (0.0005) [2023-12-28 01:34:14,172][106225] Updated weights for policy 1, policy_version 881193 (0.0010) [2023-12-28 01:34:14,207][106226] Updated weights for policy 0, policy_version 878954 (0.0005) [2023-12-28 01:34:14,227][106225] Updated weights for policy 1, policy_version 881203 (0.0006) [2023-12-28 01:34:14,258][106226] Updated weights for policy 0, policy_version 878964 (0.0008) [2023-12-28 01:34:14,276][106225] Updated weights for policy 1, policy_version 881213 (0.0005) [2023-12-28 01:34:14,307][106226] Updated weights for policy 0, policy_version 878974 (0.0010) [2023-12-28 01:34:14,370][106226] Updated weights for policy 0, policy_version 878984 (0.0011) [2023-12-28 01:34:14,835][106225] Updated weights for policy 1, policy_version 881223 (0.0006) [2023-12-28 01:34:14,900][106225] Updated weights for policy 1, policy_version 881233 (0.0008) [2023-12-28 01:34:14,964][106225] Updated weights for policy 1, policy_version 881243 (0.0009) [2023-12-28 01:34:15,098][106226] Updated weights for policy 0, policy_version 878994 (0.0008) [2023-12-28 01:34:15,166][106226] Updated weights for policy 0, policy_version 879004 (0.0009) [2023-12-28 01:34:15,234][106226] Updated weights for policy 0, policy_version 879014 (0.0008) [2023-12-28 01:34:15,583][106225] Updated weights for policy 1, policy_version 881253 (0.0008) [2023-12-28 01:34:15,652][106225] Updated weights for policy 1, policy_version 881263 (0.0005) [2023-12-28 01:34:15,711][106225] Updated weights for policy 1, policy_version 881273 (0.0005) [2023-12-28 01:34:16,050][106226] Updated weights for policy 0, policy_version 879024 (0.0009) [2023-12-28 01:34:16,104][106226] Updated weights for policy 0, policy_version 879034 (0.0008) [2023-12-28 01:34:16,155][106226] Updated weights for policy 0, policy_version 879044 (0.0007) [2023-12-28 01:34:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 450740224. Throughput: 0: 9642.7, 1: 10006.8. Samples: 450726280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:16,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.747')] [2023-12-28 01:34:16,255][106225] Updated weights for policy 1, policy_version 881283 (0.0007) [2023-12-28 01:34:16,311][106225] Updated weights for policy 1, policy_version 881293 (0.0010) [2023-12-28 01:34:16,365][106225] Updated weights for policy 1, policy_version 881303 (0.0010) [2023-12-28 01:34:16,811][106226] Updated weights for policy 0, policy_version 879054 (0.0006) [2023-12-28 01:34:16,883][106226] Updated weights for policy 0, policy_version 879064 (0.0005) [2023-12-28 01:34:16,950][106226] Updated weights for policy 0, policy_version 879074 (0.0008) [2023-12-28 01:34:16,975][106225] Updated weights for policy 1, policy_version 881313 (0.0010) [2023-12-28 01:34:17,031][106225] Updated weights for policy 1, policy_version 881323 (0.0005) [2023-12-28 01:34:17,092][106225] Updated weights for policy 1, policy_version 881333 (0.0005) [2023-12-28 01:34:17,157][106225] Updated weights for policy 1, policy_version 881343 (0.0006) [2023-12-28 01:34:17,577][106226] Updated weights for policy 0, policy_version 879084 (0.0010) [2023-12-28 01:34:17,624][106226] Updated weights for policy 0, policy_version 879094 (0.0010) [2023-12-28 01:34:17,674][106226] Updated weights for policy 0, policy_version 879104 (0.0010) [2023-12-28 01:34:17,760][106225] Updated weights for policy 1, policy_version 881353 (0.0008) [2023-12-28 01:34:17,808][106225] Updated weights for policy 1, policy_version 881363 (0.0008) [2023-12-28 01:34:17,860][106225] Updated weights for policy 1, policy_version 881373 (0.0008) [2023-12-28 01:34:18,443][106226] Updated weights for policy 0, policy_version 879114 (0.0009) [2023-12-28 01:34:18,508][106226] Updated weights for policy 0, policy_version 879124 (0.0010) [2023-12-28 01:34:18,567][106226] Updated weights for policy 0, policy_version 879134 (0.0006) [2023-12-28 01:34:18,589][106225] Updated weights for policy 1, policy_version 881383 (0.0010) [2023-12-28 01:34:18,627][106226] Updated weights for policy 0, policy_version 879144 (0.0006) [2023-12-28 01:34:18,652][106225] Updated weights for policy 1, policy_version 881393 (0.0008) [2023-12-28 01:34:18,709][106225] Updated weights for policy 1, policy_version 881403 (0.0009) [2023-12-28 01:34:19,363][106225] Updated weights for policy 1, policy_version 881413 (0.0010) [2023-12-28 01:34:19,422][106225] Updated weights for policy 1, policy_version 881423 (0.0009) [2023-12-28 01:34:19,479][106226] Updated weights for policy 0, policy_version 879154 (0.0008) [2023-12-28 01:34:19,499][106225] Updated weights for policy 1, policy_version 881433 (0.0009) [2023-12-28 01:34:19,540][106226] Updated weights for policy 0, policy_version 879164 (0.0007) [2023-12-28 01:34:19,595][106226] Updated weights for policy 0, policy_version 879174 (0.0008) [2023-12-28 01:34:20,293][106225] Updated weights for policy 1, policy_version 881443 (0.0008) [2023-12-28 01:34:20,358][106225] Updated weights for policy 1, policy_version 881453 (0.0008) [2023-12-28 01:34:20,393][106226] Updated weights for policy 0, policy_version 879184 (0.0011) [2023-12-28 01:34:20,423][106225] Updated weights for policy 1, policy_version 881463 (0.0006) [2023-12-28 01:34:20,455][106226] Updated weights for policy 0, policy_version 879194 (0.0011) [2023-12-28 01:34:20,510][106226] Updated weights for policy 0, policy_version 879204 (0.0011) [2023-12-28 01:34:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 450830336. Throughput: 0: 9615.0, 1: 10059.4. Samples: 450843980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:21,175][105115] Avg episode reward: [(0, '-4.082'), (1, '-5.062')] [2023-12-28 01:34:21,220][106225] Updated weights for policy 1, policy_version 881473 (0.0006) [2023-12-28 01:34:21,273][106226] Updated weights for policy 0, policy_version 879214 (0.0008) [2023-12-28 01:34:21,286][106225] Updated weights for policy 1, policy_version 881483 (0.0008) [2023-12-28 01:34:21,336][106226] Updated weights for policy 0, policy_version 879224 (0.0008) [2023-12-28 01:34:21,351][106225] Updated weights for policy 1, policy_version 881493 (0.0008) [2023-12-28 01:34:21,417][106226] Updated weights for policy 0, policy_version 879234 (0.0009) [2023-12-28 01:34:21,425][106225] Updated weights for policy 1, policy_version 881503 (0.0008) [2023-12-28 01:34:22,205][106225] Updated weights for policy 1, policy_version 881513 (0.0008) [2023-12-28 01:34:22,209][106226] Updated weights for policy 0, policy_version 879244 (0.0009) [2023-12-28 01:34:22,272][106225] Updated weights for policy 1, policy_version 881523 (0.0009) [2023-12-28 01:34:22,286][106226] Updated weights for policy 0, policy_version 879254 (0.0008) [2023-12-28 01:34:22,336][106225] Updated weights for policy 1, policy_version 881533 (0.0007) [2023-12-28 01:34:22,355][106226] Updated weights for policy 0, policy_version 879264 (0.0008) [2023-12-28 01:34:22,990][106225] Updated weights for policy 1, policy_version 881543 (0.0010) [2023-12-28 01:34:23,053][106225] Updated weights for policy 1, policy_version 881553 (0.0011) [2023-12-28 01:34:23,107][106225] Updated weights for policy 1, policy_version 881563 (0.0009) [2023-12-28 01:34:23,116][106226] Updated weights for policy 0, policy_version 879274 (0.0008) [2023-12-28 01:34:23,181][106226] Updated weights for policy 0, policy_version 879284 (0.0007) [2023-12-28 01:34:23,235][106226] Updated weights for policy 0, policy_version 879294 (0.0008) [2023-12-28 01:34:23,284][106226] Updated weights for policy 0, policy_version 879304 (0.0006) [2023-12-28 01:34:23,819][106225] Updated weights for policy 1, policy_version 881573 (0.0011) [2023-12-28 01:34:23,878][106225] Updated weights for policy 1, policy_version 881583 (0.0009) [2023-12-28 01:34:23,933][106225] Updated weights for policy 1, policy_version 881593 (0.0009) [2023-12-28 01:34:23,934][106226] Updated weights for policy 0, policy_version 879314 (0.0008) [2023-12-28 01:34:23,992][106226] Updated weights for policy 0, policy_version 879324 (0.0006) [2023-12-28 01:34:24,050][106226] Updated weights for policy 0, policy_version 879334 (0.0008) [2023-12-28 01:34:24,524][106225] Updated weights for policy 1, policy_version 881603 (0.0009) [2023-12-28 01:34:24,577][106225] Updated weights for policy 1, policy_version 881613 (0.0006) [2023-12-28 01:34:24,631][106225] Updated weights for policy 1, policy_version 881623 (0.0010) [2023-12-28 01:34:24,825][106226] Updated weights for policy 0, policy_version 879344 (0.0008) [2023-12-28 01:34:24,884][106226] Updated weights for policy 0, policy_version 879354 (0.0007) [2023-12-28 01:34:24,944][106226] Updated weights for policy 0, policy_version 879364 (0.0007) [2023-12-28 01:34:25,302][106225] Updated weights for policy 1, policy_version 881633 (0.0010) [2023-12-28 01:34:25,365][106225] Updated weights for policy 1, policy_version 881643 (0.0005) [2023-12-28 01:34:25,416][106225] Updated weights for policy 1, policy_version 881653 (0.0006) [2023-12-28 01:34:25,477][106225] Updated weights for policy 1, policy_version 881663 (0.0005) [2023-12-28 01:34:25,622][106226] Updated weights for policy 0, policy_version 879374 (0.0007) [2023-12-28 01:34:25,675][106226] Updated weights for policy 0, policy_version 879384 (0.0005) [2023-12-28 01:34:25,733][106226] Updated weights for policy 0, policy_version 879394 (0.0005) [2023-12-28 01:34:26,158][106225] Updated weights for policy 1, policy_version 881673 (0.0010) [2023-12-28 01:34:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.4, 300 sec: 19799.6). Total num frames: 450928640. Throughput: 0: 9600.5, 1: 10020.1. Samples: 450900228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:26,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.865')] [2023-12-28 01:34:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000879400_225181696.pth... [2023-12-28 01:34:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000878280_224894976.pth [2023-12-28 01:34:26,222][106225] Updated weights for policy 1, policy_version 881683 (0.0010) [2023-12-28 01:34:26,271][106226] Updated weights for policy 0, policy_version 879404 (0.0007) [2023-12-28 01:34:26,275][106225] Updated weights for policy 1, policy_version 881693 (0.0010) [2023-12-28 01:34:26,288][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000881696_225755136.pth... [2023-12-28 01:34:26,291][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000880512_225452032.pth [2023-12-28 01:34:26,328][106226] Updated weights for policy 0, policy_version 879414 (0.0010) [2023-12-28 01:34:26,381][106226] Updated weights for policy 0, policy_version 879424 (0.0010) [2023-12-28 01:34:26,940][106226] Updated weights for policy 0, policy_version 879434 (0.0010) [2023-12-28 01:34:26,986][106225] Updated weights for policy 1, policy_version 881703 (0.0010) [2023-12-28 01:34:26,998][106226] Updated weights for policy 0, policy_version 879444 (0.0008) [2023-12-28 01:34:27,042][106225] Updated weights for policy 1, policy_version 881713 (0.0010) [2023-12-28 01:34:27,052][106226] Updated weights for policy 0, policy_version 879454 (0.0005) [2023-12-28 01:34:27,104][106225] Updated weights for policy 1, policy_version 881723 (0.0011) [2023-12-28 01:34:27,112][106226] Updated weights for policy 0, policy_version 879464 (0.0005) [2023-12-28 01:34:27,709][106226] Updated weights for policy 0, policy_version 879474 (0.0006) [2023-12-28 01:34:27,772][106226] Updated weights for policy 0, policy_version 879484 (0.0011) [2023-12-28 01:34:27,783][106225] Updated weights for policy 1, policy_version 881733 (0.0010) [2023-12-28 01:34:27,825][106226] Updated weights for policy 0, policy_version 879494 (0.0010) [2023-12-28 01:34:27,837][106225] Updated weights for policy 1, policy_version 881743 (0.0010) [2023-12-28 01:34:27,894][106225] Updated weights for policy 1, policy_version 881753 (0.0010) [2023-12-28 01:34:28,491][106226] Updated weights for policy 0, policy_version 879504 (0.0008) [2023-12-28 01:34:28,549][106226] Updated weights for policy 0, policy_version 879514 (0.0008) [2023-12-28 01:34:28,613][106226] Updated weights for policy 0, policy_version 879524 (0.0008) [2023-12-28 01:34:28,669][106225] Updated weights for policy 1, policy_version 881763 (0.0010) [2023-12-28 01:34:28,729][106225] Updated weights for policy 1, policy_version 881773 (0.0010) [2023-12-28 01:34:28,785][106225] Updated weights for policy 1, policy_version 881783 (0.0010) [2023-12-28 01:34:29,329][106226] Updated weights for policy 0, policy_version 879534 (0.0007) [2023-12-28 01:34:29,418][106226] Updated weights for policy 0, policy_version 879544 (0.0010) [2023-12-28 01:34:29,484][106226] Updated weights for policy 0, policy_version 879554 (0.0008) [2023-12-28 01:34:29,505][106225] Updated weights for policy 1, policy_version 881793 (0.0010) [2023-12-28 01:34:29,566][106225] Updated weights for policy 1, policy_version 881803 (0.0009) [2023-12-28 01:34:29,622][106225] Updated weights for policy 1, policy_version 881813 (0.0008) [2023-12-28 01:34:29,682][106225] Updated weights for policy 1, policy_version 881823 (0.0006) [2023-12-28 01:34:30,032][106226] Updated weights for policy 0, policy_version 879564 (0.0006) [2023-12-28 01:34:30,099][106226] Updated weights for policy 0, policy_version 879574 (0.0011) [2023-12-28 01:34:30,166][106226] Updated weights for policy 0, policy_version 879584 (0.0011) [2023-12-28 01:34:30,265][106225] Updated weights for policy 1, policy_version 881833 (0.0006) [2023-12-28 01:34:30,314][106225] Updated weights for policy 1, policy_version 881843 (0.0005) [2023-12-28 01:34:30,360][106225] Updated weights for policy 1, policy_version 881853 (0.0005) [2023-12-28 01:34:30,800][106226] Updated weights for policy 0, policy_version 879594 (0.0010) [2023-12-28 01:34:30,847][106226] Updated weights for policy 0, policy_version 879604 (0.0005) [2023-12-28 01:34:30,906][106226] Updated weights for policy 0, policy_version 879614 (0.0005) [2023-12-28 01:34:30,956][106226] Updated weights for policy 0, policy_version 879624 (0.0005) [2023-12-28 01:34:31,102][106225] Updated weights for policy 1, policy_version 881863 (0.0008) [2023-12-28 01:34:31,166][106225] Updated weights for policy 1, policy_version 881873 (0.0008) [2023-12-28 01:34:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 451035136. Throughput: 0: 9760.9, 1: 9999.3. Samples: 451024900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:31,175][105115] Avg episode reward: [(0, '-4.228'), (1, '-5.075')] [2023-12-28 01:34:31,219][106225] Updated weights for policy 1, policy_version 881883 (0.0007) [2023-12-28 01:34:31,601][106226] Updated weights for policy 0, policy_version 879634 (0.0009) [2023-12-28 01:34:31,664][106226] Updated weights for policy 0, policy_version 879644 (0.0008) [2023-12-28 01:34:31,729][106226] Updated weights for policy 0, policy_version 879654 (0.0008) [2023-12-28 01:34:31,947][106225] Updated weights for policy 1, policy_version 881893 (0.0008) [2023-12-28 01:34:32,006][106225] Updated weights for policy 1, policy_version 881903 (0.0007) [2023-12-28 01:34:32,060][106225] Updated weights for policy 1, policy_version 881913 (0.0009) [2023-12-28 01:34:32,340][106226] Updated weights for policy 0, policy_version 879664 (0.0008) [2023-12-28 01:34:32,409][106226] Updated weights for policy 0, policy_version 879674 (0.0010) [2023-12-28 01:34:32,466][106226] Updated weights for policy 0, policy_version 879684 (0.0008) [2023-12-28 01:34:32,827][106225] Updated weights for policy 1, policy_version 881923 (0.0009) [2023-12-28 01:34:32,879][106225] Updated weights for policy 1, policy_version 881933 (0.0008) [2023-12-28 01:34:32,933][106225] Updated weights for policy 1, policy_version 881943 (0.0008) [2023-12-28 01:34:33,211][106226] Updated weights for policy 0, policy_version 879694 (0.0008) [2023-12-28 01:34:33,258][106226] Updated weights for policy 0, policy_version 879704 (0.0008) [2023-12-28 01:34:33,306][106226] Updated weights for policy 0, policy_version 879714 (0.0009) [2023-12-28 01:34:33,659][106225] Updated weights for policy 1, policy_version 881953 (0.0006) [2023-12-28 01:34:33,729][106225] Updated weights for policy 1, policy_version 881963 (0.0008) [2023-12-28 01:34:33,792][106225] Updated weights for policy 1, policy_version 881973 (0.0009) [2023-12-28 01:34:33,846][106225] Updated weights for policy 1, policy_version 881983 (0.0008) [2023-12-28 01:34:33,967][106226] Updated weights for policy 0, policy_version 879724 (0.0008) [2023-12-28 01:34:34,013][106226] Updated weights for policy 0, policy_version 879734 (0.0007) [2023-12-28 01:34:34,069][106226] Updated weights for policy 0, policy_version 879744 (0.0008) [2023-12-28 01:34:34,566][106225] Updated weights for policy 1, policy_version 881993 (0.0008) [2023-12-28 01:34:34,619][106225] Updated weights for policy 1, policy_version 882003 (0.0008) [2023-12-28 01:34:34,676][106225] Updated weights for policy 1, policy_version 882013 (0.0009) [2023-12-28 01:34:34,802][106226] Updated weights for policy 0, policy_version 879754 (0.0008) [2023-12-28 01:34:34,865][106226] Updated weights for policy 0, policy_version 879764 (0.0005) [2023-12-28 01:34:34,920][106226] Updated weights for policy 0, policy_version 879774 (0.0005) [2023-12-28 01:34:34,975][106226] Updated weights for policy 0, policy_version 879784 (0.0005) [2023-12-28 01:34:35,490][106225] Updated weights for policy 1, policy_version 882023 (0.0009) [2023-12-28 01:34:35,534][106226] Updated weights for policy 0, policy_version 879794 (0.0006) [2023-12-28 01:34:35,551][106225] Updated weights for policy 1, policy_version 882033 (0.0008) [2023-12-28 01:34:35,582][106226] Updated weights for policy 0, policy_version 879804 (0.0006) [2023-12-28 01:34:35,600][106225] Updated weights for policy 1, policy_version 882043 (0.0006) [2023-12-28 01:34:35,634][106226] Updated weights for policy 0, policy_version 879814 (0.0007) [2023-12-28 01:34:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 451133440. Throughput: 0: 9875.0, 1: 9953.4. Samples: 451144764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:36,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.075')] [2023-12-28 01:34:36,266][106225] Updated weights for policy 1, policy_version 882053 (0.0008) [2023-12-28 01:34:36,317][106225] Updated weights for policy 1, policy_version 882063 (0.0009) [2023-12-28 01:34:36,373][106225] Updated weights for policy 1, policy_version 882073 (0.0008) [2023-12-28 01:34:36,407][106226] Updated weights for policy 0, policy_version 879824 (0.0008) [2023-12-28 01:34:36,471][106226] Updated weights for policy 0, policy_version 879834 (0.0008) [2023-12-28 01:34:36,529][106226] Updated weights for policy 0, policy_version 879844 (0.0009) [2023-12-28 01:34:37,139][106225] Updated weights for policy 1, policy_version 882083 (0.0007) [2023-12-28 01:34:37,196][106225] Updated weights for policy 1, policy_version 882093 (0.0009) [2023-12-28 01:34:37,257][106225] Updated weights for policy 1, policy_version 882103 (0.0007) [2023-12-28 01:34:37,262][106226] Updated weights for policy 0, policy_version 879854 (0.0008) [2023-12-28 01:34:37,321][106226] Updated weights for policy 0, policy_version 879864 (0.0008) [2023-12-28 01:34:37,376][106226] Updated weights for policy 0, policy_version 879874 (0.0008) [2023-12-28 01:34:38,026][106225] Updated weights for policy 1, policy_version 882113 (0.0006) [2023-12-28 01:34:38,049][106226] Updated weights for policy 0, policy_version 879884 (0.0007) [2023-12-28 01:34:38,088][106225] Updated weights for policy 1, policy_version 882123 (0.0009) [2023-12-28 01:34:38,114][106226] Updated weights for policy 0, policy_version 879894 (0.0007) [2023-12-28 01:34:38,154][106225] Updated weights for policy 1, policy_version 882133 (0.0006) [2023-12-28 01:34:38,182][106226] Updated weights for policy 0, policy_version 879904 (0.0008) [2023-12-28 01:34:38,215][106225] Updated weights for policy 1, policy_version 882143 (0.0006) [2023-12-28 01:34:38,837][106226] Updated weights for policy 0, policy_version 879914 (0.0009) [2023-12-28 01:34:38,901][106226] Updated weights for policy 0, policy_version 879924 (0.0009) [2023-12-28 01:34:38,947][106225] Updated weights for policy 1, policy_version 882153 (0.0008) [2023-12-28 01:34:38,961][106226] Updated weights for policy 0, policy_version 879934 (0.0007) [2023-12-28 01:34:39,004][106225] Updated weights for policy 1, policy_version 882163 (0.0007) [2023-12-28 01:34:39,019][106226] Updated weights for policy 0, policy_version 879944 (0.0008) [2023-12-28 01:34:39,057][106225] Updated weights for policy 1, policy_version 882173 (0.0007) [2023-12-28 01:34:39,785][106226] Updated weights for policy 0, policy_version 879954 (0.0008) [2023-12-28 01:34:39,803][106225] Updated weights for policy 1, policy_version 882183 (0.0007) [2023-12-28 01:34:39,855][106226] Updated weights for policy 0, policy_version 879964 (0.0007) [2023-12-28 01:34:39,873][106225] Updated weights for policy 1, policy_version 882193 (0.0006) [2023-12-28 01:34:39,919][106226] Updated weights for policy 0, policy_version 879974 (0.0009) [2023-12-28 01:34:39,934][106225] Updated weights for policy 1, policy_version 882203 (0.0006) [2023-12-28 01:34:40,613][106226] Updated weights for policy 0, policy_version 879984 (0.0007) [2023-12-28 01:34:40,663][106226] Updated weights for policy 0, policy_version 879994 (0.0010) [2023-12-28 01:34:40,712][106225] Updated weights for policy 1, policy_version 882213 (0.0007) [2023-12-28 01:34:40,718][106226] Updated weights for policy 0, policy_version 880004 (0.0009) [2023-12-28 01:34:40,764][106225] Updated weights for policy 1, policy_version 882223 (0.0006) [2023-12-28 01:34:40,824][106225] Updated weights for policy 1, policy_version 882233 (0.0007) [2023-12-28 01:34:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 451231744. Throughput: 0: 9880.1, 1: 9951.7. Samples: 451202604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:41,175][105115] Avg episode reward: [(0, '-4.134'), (1, '-4.854')] [2023-12-28 01:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000882240_225894400.pth... [2023-12-28 01:34:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000880008_225337344.pth... [2023-12-28 01:34:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000881088_225599488.pth [2023-12-28 01:34:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000878856_225042432.pth [2023-12-28 01:34:41,448][106226] Updated weights for policy 0, policy_version 880014 (0.0011) [2023-12-28 01:34:41,513][106226] Updated weights for policy 0, policy_version 880024 (0.0011) [2023-12-28 01:34:41,560][106225] Updated weights for policy 1, policy_version 882243 (0.0008) [2023-12-28 01:34:41,579][106226] Updated weights for policy 0, policy_version 880034 (0.0011) [2023-12-28 01:34:41,628][106225] Updated weights for policy 1, policy_version 882253 (0.0009) [2023-12-28 01:34:41,696][106225] Updated weights for policy 1, policy_version 882263 (0.0007) [2023-12-28 01:34:42,353][106226] Updated weights for policy 0, policy_version 880044 (0.0011) [2023-12-28 01:34:42,417][106226] Updated weights for policy 0, policy_version 880054 (0.0011) [2023-12-28 01:34:42,440][106225] Updated weights for policy 1, policy_version 882273 (0.0007) [2023-12-28 01:34:42,478][106226] Updated weights for policy 0, policy_version 880064 (0.0010) [2023-12-28 01:34:42,502][106225] Updated weights for policy 1, policy_version 882283 (0.0007) [2023-12-28 01:34:42,557][106225] Updated weights for policy 1, policy_version 882293 (0.0008) [2023-12-28 01:34:42,623][106225] Updated weights for policy 1, policy_version 882303 (0.0008) [2023-12-28 01:34:43,152][106226] Updated weights for policy 0, policy_version 880074 (0.0009) [2023-12-28 01:34:43,218][106226] Updated weights for policy 0, policy_version 880084 (0.0007) [2023-12-28 01:34:43,289][106226] Updated weights for policy 0, policy_version 880094 (0.0006) [2023-12-28 01:34:43,358][106226] Updated weights for policy 0, policy_version 880104 (0.0006) [2023-12-28 01:34:43,391][106225] Updated weights for policy 1, policy_version 882313 (0.0006) [2023-12-28 01:34:43,445][106225] Updated weights for policy 1, policy_version 882323 (0.0006) [2023-12-28 01:34:43,500][106225] Updated weights for policy 1, policy_version 882333 (0.0008) [2023-12-28 01:34:43,918][106226] Updated weights for policy 0, policy_version 880114 (0.0005) [2023-12-28 01:34:43,974][106226] Updated weights for policy 0, policy_version 880124 (0.0005) [2023-12-28 01:34:44,028][106226] Updated weights for policy 0, policy_version 880134 (0.0005) [2023-12-28 01:34:44,130][106225] Updated weights for policy 1, policy_version 882343 (0.0006) [2023-12-28 01:34:44,186][106225] Updated weights for policy 1, policy_version 882353 (0.0005) [2023-12-28 01:34:44,239][106225] Updated weights for policy 1, policy_version 882363 (0.0005) [2023-12-28 01:34:44,728][106226] Updated weights for policy 0, policy_version 880144 (0.0009) [2023-12-28 01:34:44,788][106225] Updated weights for policy 1, policy_version 882373 (0.0007) [2023-12-28 01:34:44,796][106226] Updated weights for policy 0, policy_version 880154 (0.0009) [2023-12-28 01:34:44,858][106226] Updated weights for policy 0, policy_version 880164 (0.0006) [2023-12-28 01:34:44,859][106225] Updated weights for policy 1, policy_version 882383 (0.0008) [2023-12-28 01:34:44,932][106225] Updated weights for policy 1, policy_version 882393 (0.0010) [2023-12-28 01:34:45,580][106226] Updated weights for policy 0, policy_version 880174 (0.0007) [2023-12-28 01:34:45,626][106225] Updated weights for policy 1, policy_version 882403 (0.0008) [2023-12-28 01:34:45,636][106226] Updated weights for policy 0, policy_version 880184 (0.0007) [2023-12-28 01:34:45,693][106225] Updated weights for policy 1, policy_version 882413 (0.0007) [2023-12-28 01:34:45,697][106226] Updated weights for policy 0, policy_version 880194 (0.0006) [2023-12-28 01:34:45,758][106225] Updated weights for policy 1, policy_version 882423 (0.0009) [2023-12-28 01:34:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 451330048. Throughput: 0: 9886.0, 1: 9950.0. Samples: 451320168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:46,176][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.822')] [2023-12-28 01:34:46,394][106226] Updated weights for policy 0, policy_version 880204 (0.0006) [2023-12-28 01:34:46,439][106225] Updated weights for policy 1, policy_version 882433 (0.0008) [2023-12-28 01:34:46,444][106226] Updated weights for policy 0, policy_version 880214 (0.0008) [2023-12-28 01:34:46,492][106226] Updated weights for policy 0, policy_version 880224 (0.0007) [2023-12-28 01:34:46,499][106225] Updated weights for policy 1, policy_version 882443 (0.0006) [2023-12-28 01:34:46,553][106225] Updated weights for policy 1, policy_version 882453 (0.0008) [2023-12-28 01:34:46,613][106225] Updated weights for policy 1, policy_version 882463 (0.0006) [2023-12-28 01:34:47,082][106226] Updated weights for policy 0, policy_version 880234 (0.0006) [2023-12-28 01:34:47,144][106226] Updated weights for policy 0, policy_version 880244 (0.0008) [2023-12-28 01:34:47,202][106226] Updated weights for policy 0, policy_version 880254 (0.0010) [2023-12-28 01:34:47,239][106225] Updated weights for policy 1, policy_version 882473 (0.0006) [2023-12-28 01:34:47,263][106226] Updated weights for policy 0, policy_version 880264 (0.0010) [2023-12-28 01:34:47,289][106225] Updated weights for policy 1, policy_version 882483 (0.0008) [2023-12-28 01:34:47,356][106225] Updated weights for policy 1, policy_version 882493 (0.0010) [2023-12-28 01:34:47,815][106226] Updated weights for policy 0, policy_version 880274 (0.0009) [2023-12-28 01:34:47,871][106226] Updated weights for policy 0, policy_version 880284 (0.0005) [2023-12-28 01:34:47,930][106226] Updated weights for policy 0, policy_version 880294 (0.0005) [2023-12-28 01:34:48,166][106225] Updated weights for policy 1, policy_version 882503 (0.0008) [2023-12-28 01:34:48,230][106225] Updated weights for policy 1, policy_version 882513 (0.0010) [2023-12-28 01:34:48,287][106225] Updated weights for policy 1, policy_version 882523 (0.0009) [2023-12-28 01:34:48,575][106226] Updated weights for policy 0, policy_version 880304 (0.0009) [2023-12-28 01:34:48,638][106226] Updated weights for policy 0, policy_version 880314 (0.0009) [2023-12-28 01:34:48,698][106226] Updated weights for policy 0, policy_version 880324 (0.0009) [2023-12-28 01:34:49,076][106225] Updated weights for policy 1, policy_version 882533 (0.0009) [2023-12-28 01:34:49,132][106225] Updated weights for policy 1, policy_version 882543 (0.0010) [2023-12-28 01:34:49,185][106225] Updated weights for policy 1, policy_version 882553 (0.0010) [2023-12-28 01:34:49,327][106226] Updated weights for policy 0, policy_version 880334 (0.0007) [2023-12-28 01:34:49,392][106226] Updated weights for policy 0, policy_version 880344 (0.0009) [2023-12-28 01:34:49,450][106226] Updated weights for policy 0, policy_version 880354 (0.0011) [2023-12-28 01:34:49,998][106225] Updated weights for policy 1, policy_version 882563 (0.0010) [2023-12-28 01:34:50,056][106225] Updated weights for policy 1, policy_version 882573 (0.0008) [2023-12-28 01:34:50,119][106225] Updated weights for policy 1, policy_version 882583 (0.0008) [2023-12-28 01:34:50,135][106226] Updated weights for policy 0, policy_version 880364 (0.0010) [2023-12-28 01:34:50,195][106226] Updated weights for policy 0, policy_version 880374 (0.0008) [2023-12-28 01:34:50,246][106226] Updated weights for policy 0, policy_version 880384 (0.0008) [2023-12-28 01:34:50,878][106226] Updated weights for policy 0, policy_version 880394 (0.0008) [2023-12-28 01:34:50,909][106225] Updated weights for policy 1, policy_version 882593 (0.0008) [2023-12-28 01:34:50,946][106226] Updated weights for policy 0, policy_version 880404 (0.0006) [2023-12-28 01:34:50,968][106225] Updated weights for policy 1, policy_version 882603 (0.0008) [2023-12-28 01:34:51,016][106226] Updated weights for policy 0, policy_version 880414 (0.0008) [2023-12-28 01:34:51,028][106225] Updated weights for policy 1, policy_version 882613 (0.0008) [2023-12-28 01:34:51,087][106226] Updated weights for policy 0, policy_version 880424 (0.0011) [2023-12-28 01:34:51,095][106225] Updated weights for policy 1, policy_version 882623 (0.0007) [2023-12-28 01:34:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 451436544. Throughput: 0: 9978.7, 1: 9818.3. Samples: 451439976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:51,176][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.873')] [2023-12-28 01:34:51,769][106226] Updated weights for policy 0, policy_version 880434 (0.0008) [2023-12-28 01:34:51,834][106226] Updated weights for policy 0, policy_version 880444 (0.0008) [2023-12-28 01:34:51,855][106225] Updated weights for policy 1, policy_version 882633 (0.0010) [2023-12-28 01:34:51,888][106226] Updated weights for policy 0, policy_version 880454 (0.0006) [2023-12-28 01:34:51,913][106225] Updated weights for policy 1, policy_version 882643 (0.0010) [2023-12-28 01:34:51,967][106225] Updated weights for policy 1, policy_version 882653 (0.0010) [2023-12-28 01:34:52,613][106226] Updated weights for policy 0, policy_version 880464 (0.0007) [2023-12-28 01:34:52,662][106225] Updated weights for policy 1, policy_version 882663 (0.0007) [2023-12-28 01:34:52,673][106226] Updated weights for policy 0, policy_version 880474 (0.0008) [2023-12-28 01:34:52,716][106225] Updated weights for policy 1, policy_version 882673 (0.0007) [2023-12-28 01:34:52,732][106226] Updated weights for policy 0, policy_version 880484 (0.0009) [2023-12-28 01:34:52,768][106225] Updated weights for policy 1, policy_version 882683 (0.0008) [2023-12-28 01:34:53,400][106226] Updated weights for policy 0, policy_version 880494 (0.0010) [2023-12-28 01:34:53,450][106226] Updated weights for policy 0, policy_version 880504 (0.0010) [2023-12-28 01:34:53,492][106225] Updated weights for policy 1, policy_version 882693 (0.0009) [2023-12-28 01:34:53,508][106226] Updated weights for policy 0, policy_version 880514 (0.0011) [2023-12-28 01:34:53,543][106225] Updated weights for policy 1, policy_version 882703 (0.0010) [2023-12-28 01:34:53,597][106225] Updated weights for policy 1, policy_version 882713 (0.0010) [2023-12-28 01:34:54,231][106226] Updated weights for policy 0, policy_version 880524 (0.0011) [2023-12-28 01:34:54,234][106225] Updated weights for policy 1, policy_version 882723 (0.0009) [2023-12-28 01:34:54,285][106225] Updated weights for policy 1, policy_version 882733 (0.0006) [2023-12-28 01:34:54,295][106226] Updated weights for policy 0, policy_version 880534 (0.0011) [2023-12-28 01:34:54,338][106225] Updated weights for policy 1, policy_version 882743 (0.0008) [2023-12-28 01:34:54,352][106226] Updated weights for policy 0, policy_version 880544 (0.0010) [2023-12-28 01:34:54,990][106226] Updated weights for policy 0, policy_version 880554 (0.0010) [2023-12-28 01:34:55,054][106226] Updated weights for policy 0, policy_version 880564 (0.0006) [2023-12-28 01:34:55,057][106225] Updated weights for policy 1, policy_version 882753 (0.0008) [2023-12-28 01:34:55,110][106226] Updated weights for policy 0, policy_version 880574 (0.0005) [2023-12-28 01:34:55,111][106225] Updated weights for policy 1, policy_version 882763 (0.0010) [2023-12-28 01:34:55,168][106225] Updated weights for policy 1, policy_version 882773 (0.0010) [2023-12-28 01:34:55,170][106226] Updated weights for policy 0, policy_version 880584 (0.0006) [2023-12-28 01:34:55,227][106225] Updated weights for policy 1, policy_version 882783 (0.0010) [2023-12-28 01:34:55,767][106226] Updated weights for policy 0, policy_version 880594 (0.0008) [2023-12-28 01:34:55,829][106226] Updated weights for policy 0, policy_version 880604 (0.0010) [2023-12-28 01:34:55,889][106226] Updated weights for policy 0, policy_version 880614 (0.0010) [2023-12-28 01:34:55,936][106225] Updated weights for policy 1, policy_version 882793 (0.0008) [2023-12-28 01:34:55,986][106225] Updated weights for policy 1, policy_version 882803 (0.0007) [2023-12-28 01:34:56,036][106225] Updated weights for policy 1, policy_version 882813 (0.0008) [2023-12-28 01:34:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 451534848. Throughput: 0: 9990.8, 1: 9715.6. Samples: 451497404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:34:56,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.731')] [2023-12-28 01:34:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000882816_226041856.pth... [2023-12-28 01:34:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000880616_225492992.pth... [2023-12-28 01:34:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000881696_225755136.pth [2023-12-28 01:34:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000879400_225181696.pth [2023-12-28 01:34:56,558][106226] Updated weights for policy 0, policy_version 880624 (0.0011) [2023-12-28 01:34:56,621][106226] Updated weights for policy 0, policy_version 880634 (0.0010) [2023-12-28 01:34:56,687][106226] Updated weights for policy 0, policy_version 880644 (0.0011) [2023-12-28 01:34:56,717][106225] Updated weights for policy 1, policy_version 882823 (0.0008) [2023-12-28 01:34:56,770][106225] Updated weights for policy 1, policy_version 882833 (0.0008) [2023-12-28 01:34:56,826][106225] Updated weights for policy 1, policy_version 882843 (0.0007) [2023-12-28 01:34:57,367][106226] Updated weights for policy 0, policy_version 880654 (0.0011) [2023-12-28 01:34:57,423][106226] Updated weights for policy 0, policy_version 880664 (0.0010) [2023-12-28 01:34:57,473][106226] Updated weights for policy 0, policy_version 880674 (0.0010) [2023-12-28 01:34:57,498][106225] Updated weights for policy 1, policy_version 882853 (0.0007) [2023-12-28 01:34:57,546][106225] Updated weights for policy 1, policy_version 882863 (0.0007) [2023-12-28 01:34:57,591][106225] Updated weights for policy 1, policy_version 882873 (0.0007) [2023-12-28 01:34:58,201][106226] Updated weights for policy 0, policy_version 880684 (0.0010) [2023-12-28 01:34:58,262][106226] Updated weights for policy 0, policy_version 880694 (0.0008) [2023-12-28 01:34:58,332][106226] Updated weights for policy 0, policy_version 880704 (0.0008) [2023-12-28 01:34:58,409][106225] Updated weights for policy 1, policy_version 882883 (0.0008) [2023-12-28 01:34:58,478][106225] Updated weights for policy 1, policy_version 882893 (0.0008) [2023-12-28 01:34:58,542][106225] Updated weights for policy 1, policy_version 882903 (0.0008) [2023-12-28 01:34:59,224][106226] Updated weights for policy 0, policy_version 880714 (0.0008) [2023-12-28 01:34:59,265][106225] Updated weights for policy 1, policy_version 882913 (0.0008) [2023-12-28 01:34:59,292][106226] Updated weights for policy 0, policy_version 880724 (0.0008) [2023-12-28 01:34:59,328][106225] Updated weights for policy 1, policy_version 882923 (0.0007) [2023-12-28 01:34:59,360][106226] Updated weights for policy 0, policy_version 880734 (0.0008) [2023-12-28 01:34:59,396][106225] Updated weights for policy 1, policy_version 882933 (0.0008) [2023-12-28 01:34:59,430][106226] Updated weights for policy 0, policy_version 880744 (0.0008) [2023-12-28 01:34:59,457][106225] Updated weights for policy 1, policy_version 882943 (0.0008) [2023-12-28 01:35:00,085][106226] Updated weights for policy 0, policy_version 880754 (0.0008) [2023-12-28 01:35:00,139][106226] Updated weights for policy 0, policy_version 880764 (0.0008) [2023-12-28 01:35:00,209][106226] Updated weights for policy 0, policy_version 880774 (0.0008) [2023-12-28 01:35:00,212][106225] Updated weights for policy 1, policy_version 882953 (0.0006) [2023-12-28 01:35:00,277][106225] Updated weights for policy 1, policy_version 882963 (0.0007) [2023-12-28 01:35:00,341][106225] Updated weights for policy 1, policy_version 882973 (0.0006) [2023-12-28 01:35:00,898][106226] Updated weights for policy 0, policy_version 880784 (0.0009) [2023-12-28 01:35:00,951][106226] Updated weights for policy 0, policy_version 880794 (0.0009) [2023-12-28 01:35:00,964][106225] Updated weights for policy 1, policy_version 882983 (0.0006) [2023-12-28 01:35:01,003][106226] Updated weights for policy 0, policy_version 880804 (0.0008) [2023-12-28 01:35:01,025][106225] Updated weights for policy 1, policy_version 882993 (0.0008) [2023-12-28 01:35:01,083][106225] Updated weights for policy 1, policy_version 883003 (0.0008) [2023-12-28 01:35:01,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 451633152. Throughput: 0: 10002.3, 1: 9756.7. Samples: 451615436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:01,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.883')] [2023-12-28 01:35:01,752][106225] Updated weights for policy 1, policy_version 883013 (0.0008) [2023-12-28 01:35:01,789][106226] Updated weights for policy 0, policy_version 880814 (0.0008) [2023-12-28 01:35:01,806][106225] Updated weights for policy 1, policy_version 883023 (0.0007) [2023-12-28 01:35:01,844][106226] Updated weights for policy 0, policy_version 880824 (0.0006) [2023-12-28 01:35:01,862][106225] Updated weights for policy 1, policy_version 883033 (0.0008) [2023-12-28 01:35:01,892][106226] Updated weights for policy 0, policy_version 880834 (0.0007) [2023-12-28 01:35:02,457][106226] Updated weights for policy 0, policy_version 880844 (0.0007) [2023-12-28 01:35:02,515][106226] Updated weights for policy 0, policy_version 880854 (0.0007) [2023-12-28 01:35:02,575][106226] Updated weights for policy 0, policy_version 880864 (0.0010) [2023-12-28 01:35:02,634][106225] Updated weights for policy 1, policy_version 883043 (0.0007) [2023-12-28 01:35:02,691][106225] Updated weights for policy 1, policy_version 883053 (0.0008) [2023-12-28 01:35:02,751][106225] Updated weights for policy 1, policy_version 883063 (0.0008) [2023-12-28 01:35:03,258][106226] Updated weights for policy 0, policy_version 880874 (0.0008) [2023-12-28 01:35:03,311][106226] Updated weights for policy 0, policy_version 880884 (0.0008) [2023-12-28 01:35:03,358][106226] Updated weights for policy 0, policy_version 880894 (0.0008) [2023-12-28 01:35:03,410][106226] Updated weights for policy 0, policy_version 880904 (0.0008) [2023-12-28 01:35:03,484][106225] Updated weights for policy 1, policy_version 883073 (0.0009) [2023-12-28 01:35:03,546][106225] Updated weights for policy 1, policy_version 883083 (0.0010) [2023-12-28 01:35:03,603][106225] Updated weights for policy 1, policy_version 883093 (0.0008) [2023-12-28 01:35:03,658][106225] Updated weights for policy 1, policy_version 883103 (0.0008) [2023-12-28 01:35:04,130][106226] Updated weights for policy 0, policy_version 880914 (0.0008) [2023-12-28 01:35:04,191][106226] Updated weights for policy 0, policy_version 880924 (0.0008) [2023-12-28 01:35:04,252][106226] Updated weights for policy 0, policy_version 880934 (0.0009) [2023-12-28 01:35:04,407][106225] Updated weights for policy 1, policy_version 883113 (0.0009) [2023-12-28 01:35:04,468][106225] Updated weights for policy 1, policy_version 883123 (0.0008) [2023-12-28 01:35:04,517][106225] Updated weights for policy 1, policy_version 883133 (0.0008) [2023-12-28 01:35:04,994][106226] Updated weights for policy 0, policy_version 880944 (0.0010) [2023-12-28 01:35:05,054][106226] Updated weights for policy 0, policy_version 880954 (0.0008) [2023-12-28 01:35:05,125][106226] Updated weights for policy 0, policy_version 880964 (0.0009) [2023-12-28 01:35:05,205][106225] Updated weights for policy 1, policy_version 883143 (0.0007) [2023-12-28 01:35:05,258][106225] Updated weights for policy 1, policy_version 883153 (0.0005) [2023-12-28 01:35:05,306][106225] Updated weights for policy 1, policy_version 883163 (0.0005) [2023-12-28 01:35:05,819][106226] Updated weights for policy 0, policy_version 880974 (0.0008) [2023-12-28 01:35:05,886][106226] Updated weights for policy 0, policy_version 880984 (0.0008) [2023-12-28 01:35:05,942][106225] Updated weights for policy 1, policy_version 883173 (0.0008) [2023-12-28 01:35:05,947][106226] Updated weights for policy 0, policy_version 880994 (0.0009) [2023-12-28 01:35:05,999][106225] Updated weights for policy 1, policy_version 883183 (0.0010) [2023-12-28 01:35:06,061][106225] Updated weights for policy 1, policy_version 883193 (0.0009) [2023-12-28 01:35:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 451731456. Throughput: 0: 10084.8, 1: 9714.5. Samples: 451734948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:06,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.824')] [2023-12-28 01:35:06,696][106226] Updated weights for policy 0, policy_version 881004 (0.0007) [2023-12-28 01:35:06,763][106226] Updated weights for policy 0, policy_version 881014 (0.0008) [2023-12-28 01:35:06,798][106225] Updated weights for policy 1, policy_version 883203 (0.0008) [2023-12-28 01:35:06,821][106226] Updated weights for policy 0, policy_version 881024 (0.0008) [2023-12-28 01:35:06,867][106225] Updated weights for policy 1, policy_version 883213 (0.0008) [2023-12-28 01:35:06,927][106225] Updated weights for policy 1, policy_version 883223 (0.0007) [2023-12-28 01:35:07,498][106225] Updated weights for policy 1, policy_version 883233 (0.0008) [2023-12-28 01:35:07,504][106226] Updated weights for policy 0, policy_version 881034 (0.0007) [2023-12-28 01:35:07,561][106225] Updated weights for policy 1, policy_version 883243 (0.0010) [2023-12-28 01:35:07,563][106226] Updated weights for policy 0, policy_version 881044 (0.0006) [2023-12-28 01:35:07,622][106226] Updated weights for policy 0, policy_version 881054 (0.0007) [2023-12-28 01:35:07,624][106225] Updated weights for policy 1, policy_version 883253 (0.0010) [2023-12-28 01:35:07,668][106226] Updated weights for policy 0, policy_version 881064 (0.0006) [2023-12-28 01:35:07,677][106225] Updated weights for policy 1, policy_version 883263 (0.0007) [2023-12-28 01:35:08,275][106226] Updated weights for policy 0, policy_version 881074 (0.0008) [2023-12-28 01:35:08,342][106226] Updated weights for policy 0, policy_version 881084 (0.0008) [2023-12-28 01:35:08,391][106226] Updated weights for policy 0, policy_version 881094 (0.0009) [2023-12-28 01:35:08,421][106225] Updated weights for policy 1, policy_version 883273 (0.0008) [2023-12-28 01:35:08,474][106225] Updated weights for policy 1, policy_version 883283 (0.0008) [2023-12-28 01:35:08,526][106225] Updated weights for policy 1, policy_version 883293 (0.0008) [2023-12-28 01:35:09,138][106226] Updated weights for policy 0, policy_version 881104 (0.0006) [2023-12-28 01:35:09,188][106226] Updated weights for policy 0, policy_version 881114 (0.0007) [2023-12-28 01:35:09,254][106226] Updated weights for policy 0, policy_version 881124 (0.0008) [2023-12-28 01:35:09,266][106225] Updated weights for policy 1, policy_version 883304 (0.0008) [2023-12-28 01:35:09,324][106225] Updated weights for policy 1, policy_version 883314 (0.0008) [2023-12-28 01:35:09,431][106225] Updated weights for policy 1, policy_version 883324 (0.0008) [2023-12-28 01:35:10,009][106226] Updated weights for policy 0, policy_version 881134 (0.0006) [2023-12-28 01:35:10,068][106226] Updated weights for policy 0, policy_version 881144 (0.0008) [2023-12-28 01:35:10,127][106226] Updated weights for policy 0, policy_version 881154 (0.0008) [2023-12-28 01:35:10,207][106225] Updated weights for policy 1, policy_version 883334 (0.0009) [2023-12-28 01:35:10,259][106225] Updated weights for policy 1, policy_version 883344 (0.0008) [2023-12-28 01:35:10,316][106225] Updated weights for policy 1, policy_version 883354 (0.0009) [2023-12-28 01:35:10,834][106226] Updated weights for policy 0, policy_version 881164 (0.0008) [2023-12-28 01:35:10,889][106226] Updated weights for policy 0, policy_version 881174 (0.0009) [2023-12-28 01:35:10,952][106226] Updated weights for policy 0, policy_version 881184 (0.0010) [2023-12-28 01:35:11,020][106225] Updated weights for policy 1, policy_version 883364 (0.0007) [2023-12-28 01:35:11,086][106225] Updated weights for policy 1, policy_version 883374 (0.0007) [2023-12-28 01:35:11,147][106225] Updated weights for policy 1, policy_version 883384 (0.0008) [2023-12-28 01:35:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 451821568. Throughput: 0: 10133.7, 1: 9733.7. Samples: 451794260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:11,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.938')] [2023-12-28 01:35:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000881192_225640448.pth... [2023-12-28 01:35:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000880008_225337344.pth [2023-12-28 01:35:11,201][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000883392_226189312.pth... [2023-12-28 01:35:11,206][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000882240_225894400.pth [2023-12-28 01:35:11,816][106226] Updated weights for policy 0, policy_version 881194 (0.0010) [2023-12-28 01:35:11,875][106226] Updated weights for policy 0, policy_version 881204 (0.0008) [2023-12-28 01:35:11,937][106226] Updated weights for policy 0, policy_version 881214 (0.0011) [2023-12-28 01:35:11,940][106225] Updated weights for policy 1, policy_version 883394 (0.0007) [2023-12-28 01:35:12,003][106225] Updated weights for policy 1, policy_version 883404 (0.0007) [2023-12-28 01:35:12,005][106226] Updated weights for policy 0, policy_version 881224 (0.0011) [2023-12-28 01:35:12,066][106225] Updated weights for policy 1, policy_version 883414 (0.0008) [2023-12-28 01:35:12,129][106225] Updated weights for policy 1, policy_version 883424 (0.0008) [2023-12-28 01:35:12,740][106226] Updated weights for policy 0, policy_version 881234 (0.0008) [2023-12-28 01:35:12,804][106226] Updated weights for policy 0, policy_version 881244 (0.0007) [2023-12-28 01:35:12,822][106225] Updated weights for policy 1, policy_version 883434 (0.0008) [2023-12-28 01:35:12,864][106226] Updated weights for policy 0, policy_version 881254 (0.0007) [2023-12-28 01:35:12,881][106225] Updated weights for policy 1, policy_version 883444 (0.0006) [2023-12-28 01:35:12,932][106225] Updated weights for policy 1, policy_version 883454 (0.0008) [2023-12-28 01:35:13,608][106226] Updated weights for policy 0, policy_version 881264 (0.0007) [2023-12-28 01:35:13,649][106225] Updated weights for policy 1, policy_version 883464 (0.0010) [2023-12-28 01:35:13,664][106226] Updated weights for policy 0, policy_version 881274 (0.0007) [2023-12-28 01:35:13,707][106225] Updated weights for policy 1, policy_version 883474 (0.0010) [2023-12-28 01:35:13,729][106226] Updated weights for policy 0, policy_version 881284 (0.0006) [2023-12-28 01:35:13,771][106225] Updated weights for policy 1, policy_version 883484 (0.0010) [2023-12-28 01:35:14,456][106225] Updated weights for policy 1, policy_version 883494 (0.0009) [2023-12-28 01:35:14,479][106226] Updated weights for policy 0, policy_version 881294 (0.0009) [2023-12-28 01:35:14,515][106225] Updated weights for policy 1, policy_version 883504 (0.0010) [2023-12-28 01:35:14,533][106226] Updated weights for policy 0, policy_version 881304 (0.0006) [2023-12-28 01:35:14,573][106225] Updated weights for policy 1, policy_version 883514 (0.0010) [2023-12-28 01:35:14,587][106226] Updated weights for policy 0, policy_version 881314 (0.0005) [2023-12-28 01:35:15,311][106225] Updated weights for policy 1, policy_version 883524 (0.0010) [2023-12-28 01:35:15,373][106225] Updated weights for policy 1, policy_version 883534 (0.0009) [2023-12-28 01:35:15,407][106226] Updated weights for policy 0, policy_version 881324 (0.0008) [2023-12-28 01:35:15,425][106225] Updated weights for policy 1, policy_version 883544 (0.0009) [2023-12-28 01:35:15,462][106226] Updated weights for policy 0, policy_version 881334 (0.0008) [2023-12-28 01:35:15,529][106226] Updated weights for policy 0, policy_version 881344 (0.0009) [2023-12-28 01:35:16,098][106225] Updated weights for policy 1, policy_version 883554 (0.0007) [2023-12-28 01:35:16,156][106225] Updated weights for policy 1, policy_version 883564 (0.0008) [2023-12-28 01:35:16,174][105115] Fps is (10 sec: 18022.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 451911680. Throughput: 0: 9940.5, 1: 9667.9. Samples: 451907276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:16,175][105115] Avg episode reward: [(0, '-4.056'), (1, '-5.027')] [2023-12-28 01:35:16,209][106225] Updated weights for policy 1, policy_version 883574 (0.0007) [2023-12-28 01:35:16,246][106226] Updated weights for policy 0, policy_version 881354 (0.0008) [2023-12-28 01:35:16,278][106225] Updated weights for policy 1, policy_version 883584 (0.0009) [2023-12-28 01:35:16,301][106226] Updated weights for policy 0, policy_version 881364 (0.0006) [2023-12-28 01:35:16,356][106226] Updated weights for policy 0, policy_version 881374 (0.0006) [2023-12-28 01:35:16,410][106226] Updated weights for policy 0, policy_version 881384 (0.0008) [2023-12-28 01:35:16,874][106225] Updated weights for policy 1, policy_version 883594 (0.0008) [2023-12-28 01:35:16,927][106225] Updated weights for policy 1, policy_version 883604 (0.0006) [2023-12-28 01:35:16,991][106225] Updated weights for policy 1, policy_version 883614 (0.0007) [2023-12-28 01:35:17,132][106226] Updated weights for policy 0, policy_version 881394 (0.0011) [2023-12-28 01:35:17,183][106226] Updated weights for policy 0, policy_version 881404 (0.0011) [2023-12-28 01:35:17,242][106226] Updated weights for policy 0, policy_version 881414 (0.0010) [2023-12-28 01:35:17,757][106225] Updated weights for policy 1, policy_version 883624 (0.0008) [2023-12-28 01:35:17,820][106225] Updated weights for policy 1, policy_version 883634 (0.0009) [2023-12-28 01:35:17,874][106226] Updated weights for policy 0, policy_version 881424 (0.0007) [2023-12-28 01:35:17,882][106225] Updated weights for policy 1, policy_version 883644 (0.0008) [2023-12-28 01:35:17,922][106226] Updated weights for policy 0, policy_version 881434 (0.0009) [2023-12-28 01:35:17,975][106226] Updated weights for policy 0, policy_version 881444 (0.0009) [2023-12-28 01:35:18,637][106225] Updated weights for policy 1, policy_version 883654 (0.0007) [2023-12-28 01:35:18,646][106226] Updated weights for policy 0, policy_version 881454 (0.0008) [2023-12-28 01:35:18,698][106225] Updated weights for policy 1, policy_version 883664 (0.0007) [2023-12-28 01:35:18,712][106226] Updated weights for policy 0, policy_version 881464 (0.0008) [2023-12-28 01:35:18,757][106225] Updated weights for policy 1, policy_version 883674 (0.0006) [2023-12-28 01:35:18,775][106226] Updated weights for policy 0, policy_version 881474 (0.0007) [2023-12-28 01:35:19,463][106226] Updated weights for policy 0, policy_version 881484 (0.0007) [2023-12-28 01:35:19,515][106225] Updated weights for policy 1, policy_version 883684 (0.0007) [2023-12-28 01:35:19,534][106226] Updated weights for policy 0, policy_version 881494 (0.0010) [2023-12-28 01:35:19,580][106225] Updated weights for policy 1, policy_version 883694 (0.0006) [2023-12-28 01:35:19,596][106226] Updated weights for policy 0, policy_version 881504 (0.0011) [2023-12-28 01:35:19,627][106225] Updated weights for policy 1, policy_version 883704 (0.0007) [2023-12-28 01:35:20,317][106226] Updated weights for policy 0, policy_version 881514 (0.0011) [2023-12-28 01:35:20,383][106226] Updated weights for policy 0, policy_version 881524 (0.0010) [2023-12-28 01:35:20,407][106225] Updated weights for policy 1, policy_version 883714 (0.0008) [2023-12-28 01:35:20,448][106226] Updated weights for policy 0, policy_version 881534 (0.0011) [2023-12-28 01:35:20,466][106225] Updated weights for policy 1, policy_version 883724 (0.0006) [2023-12-28 01:35:20,507][106226] Updated weights for policy 0, policy_version 881544 (0.0010) [2023-12-28 01:35:20,525][106225] Updated weights for policy 1, policy_version 883734 (0.0006) [2023-12-28 01:35:20,588][106225] Updated weights for policy 1, policy_version 883744 (0.0008) [2023-12-28 01:35:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 452009984. Throughput: 0: 9861.1, 1: 9664.1. Samples: 452023396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:21,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.964')] [2023-12-28 01:35:21,217][106226] Updated weights for policy 0, policy_version 881554 (0.0008) [2023-12-28 01:35:21,284][106226] Updated weights for policy 0, policy_version 881564 (0.0009) [2023-12-28 01:35:21,345][106226] Updated weights for policy 0, policy_version 881574 (0.0007) [2023-12-28 01:35:21,359][106225] Updated weights for policy 1, policy_version 883754 (0.0009) [2023-12-28 01:35:21,430][106225] Updated weights for policy 1, policy_version 883764 (0.0008) [2023-12-28 01:35:21,488][106225] Updated weights for policy 1, policy_version 883774 (0.0006) [2023-12-28 01:35:22,135][106226] Updated weights for policy 0, policy_version 881584 (0.0008) [2023-12-28 01:35:22,201][106226] Updated weights for policy 0, policy_version 881594 (0.0009) [2023-12-28 01:35:22,211][106225] Updated weights for policy 1, policy_version 883784 (0.0007) [2023-12-28 01:35:22,270][106226] Updated weights for policy 0, policy_version 881604 (0.0007) [2023-12-28 01:35:22,283][106225] Updated weights for policy 1, policy_version 883794 (0.0009) [2023-12-28 01:35:22,349][106225] Updated weights for policy 1, policy_version 883804 (0.0008) [2023-12-28 01:35:23,025][106225] Updated weights for policy 1, policy_version 883814 (0.0007) [2023-12-28 01:35:23,063][106226] Updated weights for policy 0, policy_version 881614 (0.0008) [2023-12-28 01:35:23,082][106225] Updated weights for policy 1, policy_version 883824 (0.0008) [2023-12-28 01:35:23,119][106226] Updated weights for policy 0, policy_version 881624 (0.0008) [2023-12-28 01:35:23,144][106225] Updated weights for policy 1, policy_version 883834 (0.0008) [2023-12-28 01:35:23,181][106226] Updated weights for policy 0, policy_version 881634 (0.0006) [2023-12-28 01:35:23,862][106225] Updated weights for policy 1, policy_version 883844 (0.0008) [2023-12-28 01:35:23,892][106226] Updated weights for policy 0, policy_version 881644 (0.0010) [2023-12-28 01:35:23,910][106225] Updated weights for policy 1, policy_version 883854 (0.0006) [2023-12-28 01:35:23,949][106226] Updated weights for policy 0, policy_version 881654 (0.0010) [2023-12-28 01:35:23,958][106225] Updated weights for policy 1, policy_version 883864 (0.0008) [2023-12-28 01:35:24,008][106226] Updated weights for policy 0, policy_version 881664 (0.0011) [2023-12-28 01:35:24,578][106226] Updated weights for policy 0, policy_version 881674 (0.0008) [2023-12-28 01:35:24,644][106226] Updated weights for policy 0, policy_version 881684 (0.0005) [2023-12-28 01:35:24,678][106225] Updated weights for policy 1, policy_version 883874 (0.0005) [2023-12-28 01:35:24,712][106226] Updated weights for policy 0, policy_version 881694 (0.0008) [2023-12-28 01:35:24,749][106225] Updated weights for policy 1, policy_version 883884 (0.0007) [2023-12-28 01:35:24,766][106226] Updated weights for policy 0, policy_version 881704 (0.0007) [2023-12-28 01:35:24,816][106225] Updated weights for policy 1, policy_version 883894 (0.0009) [2023-12-28 01:35:24,885][106225] Updated weights for policy 1, policy_version 883904 (0.0010) [2023-12-28 01:35:25,395][106226] Updated weights for policy 0, policy_version 881714 (0.0009) [2023-12-28 01:35:25,436][106225] Updated weights for policy 1, policy_version 883914 (0.0006) [2023-12-28 01:35:25,448][106226] Updated weights for policy 0, policy_version 881724 (0.0006) [2023-12-28 01:35:25,486][106225] Updated weights for policy 1, policy_version 883924 (0.0008) [2023-12-28 01:35:25,508][106226] Updated weights for policy 0, policy_version 881734 (0.0007) [2023-12-28 01:35:25,531][106225] Updated weights for policy 1, policy_version 883934 (0.0006) [2023-12-28 01:35:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 452108288. Throughput: 0: 9812.0, 1: 9677.2. Samples: 452079616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:26,175][105115] Avg episode reward: [(0, '-4.194'), (1, '-4.766')] [2023-12-28 01:35:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000883936_226328576.pth... [2023-12-28 01:35:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000882816_226041856.pth [2023-12-28 01:35:26,214][106226] Updated weights for policy 0, policy_version 881744 (0.0005) [2023-12-28 01:35:26,269][106226] Updated weights for policy 0, policy_version 881754 (0.0005) [2023-12-28 01:35:26,275][106225] Updated weights for policy 1, policy_version 883944 (0.0007) [2023-12-28 01:35:26,316][106226] Updated weights for policy 0, policy_version 881764 (0.0007) [2023-12-28 01:35:26,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000881768_225787904.pth... [2023-12-28 01:35:26,334][106225] Updated weights for policy 1, policy_version 883954 (0.0007) [2023-12-28 01:35:26,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000880616_225492992.pth [2023-12-28 01:35:26,390][106225] Updated weights for policy 1, policy_version 883964 (0.0008) [2023-12-28 01:35:26,913][106226] Updated weights for policy 0, policy_version 881774 (0.0006) [2023-12-28 01:35:26,963][106226] Updated weights for policy 0, policy_version 881784 (0.0005) [2023-12-28 01:35:27,016][106226] Updated weights for policy 0, policy_version 881794 (0.0005) [2023-12-28 01:35:27,130][106225] Updated weights for policy 1, policy_version 883974 (0.0007) [2023-12-28 01:35:27,180][106225] Updated weights for policy 1, policy_version 883984 (0.0009) [2023-12-28 01:35:27,229][106225] Updated weights for policy 1, policy_version 883994 (0.0009) [2023-12-28 01:35:27,618][106226] Updated weights for policy 0, policy_version 881804 (0.0006) [2023-12-28 01:35:27,669][106226] Updated weights for policy 0, policy_version 881814 (0.0009) [2023-12-28 01:35:27,717][106226] Updated weights for policy 0, policy_version 881824 (0.0008) [2023-12-28 01:35:27,953][106225] Updated weights for policy 1, policy_version 884004 (0.0009) [2023-12-28 01:35:27,999][106225] Updated weights for policy 1, policy_version 884014 (0.0007) [2023-12-28 01:35:28,053][106225] Updated weights for policy 1, policy_version 884024 (0.0008) [2023-12-28 01:35:28,462][106226] Updated weights for policy 0, policy_version 881834 (0.0008) [2023-12-28 01:35:28,521][106226] Updated weights for policy 0, policy_version 881844 (0.0009) [2023-12-28 01:35:28,587][106226] Updated weights for policy 0, policy_version 881854 (0.0006) [2023-12-28 01:35:28,648][106226] Updated weights for policy 0, policy_version 881864 (0.0007) [2023-12-28 01:35:28,794][106225] Updated weights for policy 1, policy_version 884034 (0.0008) [2023-12-28 01:35:28,850][106225] Updated weights for policy 1, policy_version 884044 (0.0009) [2023-12-28 01:35:28,910][106225] Updated weights for policy 1, policy_version 884054 (0.0008) [2023-12-28 01:35:28,970][106225] Updated weights for policy 1, policy_version 884064 (0.0009) [2023-12-28 01:35:29,385][106226] Updated weights for policy 0, policy_version 881874 (0.0008) [2023-12-28 01:35:29,451][106226] Updated weights for policy 0, policy_version 881884 (0.0008) [2023-12-28 01:35:29,514][106226] Updated weights for policy 0, policy_version 881894 (0.0009) [2023-12-28 01:35:29,663][106225] Updated weights for policy 1, policy_version 884074 (0.0008) [2023-12-28 01:35:29,729][106225] Updated weights for policy 1, policy_version 884084 (0.0007) [2023-12-28 01:35:29,793][106225] Updated weights for policy 1, policy_version 884094 (0.0005) [2023-12-28 01:35:30,235][106226] Updated weights for policy 0, policy_version 881904 (0.0010) [2023-12-28 01:35:30,295][106226] Updated weights for policy 0, policy_version 881914 (0.0011) [2023-12-28 01:35:30,356][106226] Updated weights for policy 0, policy_version 881924 (0.0010) [2023-12-28 01:35:30,465][106225] Updated weights for policy 1, policy_version 884104 (0.0005) [2023-12-28 01:35:30,522][106225] Updated weights for policy 1, policy_version 884114 (0.0006) [2023-12-28 01:35:30,596][106225] Updated weights for policy 1, policy_version 884124 (0.0008) [2023-12-28 01:35:30,963][106226] Updated weights for policy 0, policy_version 881934 (0.0009) [2023-12-28 01:35:31,017][106226] Updated weights for policy 0, policy_version 881944 (0.0009) [2023-12-28 01:35:31,080][106226] Updated weights for policy 0, policy_version 881954 (0.0008) [2023-12-28 01:35:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 452214784. Throughput: 0: 9923.1, 1: 9680.7. Samples: 452202332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:31,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.801')] [2023-12-28 01:35:31,376][106225] Updated weights for policy 1, policy_version 884134 (0.0008) [2023-12-28 01:35:31,435][106225] Updated weights for policy 1, policy_version 884144 (0.0009) [2023-12-28 01:35:31,492][106225] Updated weights for policy 1, policy_version 884155 (0.0007) [2023-12-28 01:35:31,844][106226] Updated weights for policy 0, policy_version 881964 (0.0007) [2023-12-28 01:35:31,900][106226] Updated weights for policy 0, policy_version 881974 (0.0005) [2023-12-28 01:35:31,949][106226] Updated weights for policy 0, policy_version 881984 (0.0007) [2023-12-28 01:35:32,282][106225] Updated weights for policy 1, policy_version 884165 (0.0009) [2023-12-28 01:35:32,342][106225] Updated weights for policy 1, policy_version 884175 (0.0010) [2023-12-28 01:35:32,409][106225] Updated weights for policy 1, policy_version 884185 (0.0008) [2023-12-28 01:35:32,569][106226] Updated weights for policy 0, policy_version 881994 (0.0008) [2023-12-28 01:35:32,620][106226] Updated weights for policy 0, policy_version 882004 (0.0007) [2023-12-28 01:35:32,678][106226] Updated weights for policy 0, policy_version 882014 (0.0006) [2023-12-28 01:35:32,729][106226] Updated weights for policy 0, policy_version 882024 (0.0007) [2023-12-28 01:35:33,032][106225] Updated weights for policy 1, policy_version 884195 (0.0009) [2023-12-28 01:35:33,084][106225] Updated weights for policy 1, policy_version 884205 (0.0010) [2023-12-28 01:35:33,146][106225] Updated weights for policy 1, policy_version 884215 (0.0010) [2023-12-28 01:35:33,388][106226] Updated weights for policy 0, policy_version 882034 (0.0005) [2023-12-28 01:35:33,448][106226] Updated weights for policy 0, policy_version 882044 (0.0005) [2023-12-28 01:35:33,516][106226] Updated weights for policy 0, policy_version 882054 (0.0005) [2023-12-28 01:35:33,745][106225] Updated weights for policy 1, policy_version 884225 (0.0010) [2023-12-28 01:35:33,813][106225] Updated weights for policy 1, policy_version 884235 (0.0005) [2023-12-28 01:35:33,862][106225] Updated weights for policy 1, policy_version 884245 (0.0005) [2023-12-28 01:35:33,907][106225] Updated weights for policy 1, policy_version 884255 (0.0005) [2023-12-28 01:35:34,038][106226] Updated weights for policy 0, policy_version 882064 (0.0007) [2023-12-28 01:35:34,087][106226] Updated weights for policy 0, policy_version 882074 (0.0007) [2023-12-28 01:35:34,156][106226] Updated weights for policy 0, policy_version 882084 (0.0007) [2023-12-28 01:35:34,590][106225] Updated weights for policy 1, policy_version 884265 (0.0005) [2023-12-28 01:35:34,645][106225] Updated weights for policy 1, policy_version 884275 (0.0006) [2023-12-28 01:35:34,698][106225] Updated weights for policy 1, policy_version 884285 (0.0005) [2023-12-28 01:35:34,920][106226] Updated weights for policy 0, policy_version 882094 (0.0008) [2023-12-28 01:35:34,980][106226] Updated weights for policy 0, policy_version 882104 (0.0008) [2023-12-28 01:35:35,045][106226] Updated weights for policy 0, policy_version 882114 (0.0009) [2023-12-28 01:35:35,354][106225] Updated weights for policy 1, policy_version 884295 (0.0008) [2023-12-28 01:35:35,416][106225] Updated weights for policy 1, policy_version 884305 (0.0009) [2023-12-28 01:35:35,471][106225] Updated weights for policy 1, policy_version 884315 (0.0007) [2023-12-28 01:35:35,660][106226] Updated weights for policy 0, policy_version 882124 (0.0007) [2023-12-28 01:35:35,714][106226] Updated weights for policy 0, policy_version 882134 (0.0005) [2023-12-28 01:35:35,760][106226] Updated weights for policy 0, policy_version 882144 (0.0005) [2023-12-28 01:35:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 452313088. Throughput: 0: 9905.0, 1: 9774.9. Samples: 452325568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:36,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.734')] [2023-12-28 01:35:36,209][106225] Updated weights for policy 1, policy_version 884325 (0.0009) [2023-12-28 01:35:36,270][106225] Updated weights for policy 1, policy_version 884335 (0.0009) [2023-12-28 01:35:36,330][106225] Updated weights for policy 1, policy_version 884345 (0.0009) [2023-12-28 01:35:36,459][106226] Updated weights for policy 0, policy_version 882154 (0.0006) [2023-12-28 01:35:36,530][106226] Updated weights for policy 0, policy_version 882164 (0.0009) [2023-12-28 01:35:36,593][106226] Updated weights for policy 0, policy_version 882174 (0.0008) [2023-12-28 01:35:36,660][106226] Updated weights for policy 0, policy_version 882184 (0.0009) [2023-12-28 01:35:37,063][106225] Updated weights for policy 1, policy_version 884355 (0.0007) [2023-12-28 01:35:37,134][106225] Updated weights for policy 1, policy_version 884365 (0.0008) [2023-12-28 01:35:37,196][106225] Updated weights for policy 1, policy_version 884375 (0.0005) [2023-12-28 01:35:37,317][106226] Updated weights for policy 0, policy_version 882194 (0.0006) [2023-12-28 01:35:37,382][106226] Updated weights for policy 0, policy_version 882204 (0.0005) [2023-12-28 01:35:37,439][106226] Updated weights for policy 0, policy_version 882214 (0.0005) [2023-12-28 01:35:37,828][106225] Updated weights for policy 1, policy_version 884385 (0.0006) [2023-12-28 01:35:37,881][106225] Updated weights for policy 1, policy_version 884395 (0.0010) [2023-12-28 01:35:37,929][106225] Updated weights for policy 1, policy_version 884405 (0.0010) [2023-12-28 01:35:37,975][106225] Updated weights for policy 1, policy_version 884415 (0.0010) [2023-12-28 01:35:38,015][106226] Updated weights for policy 0, policy_version 882224 (0.0009) [2023-12-28 01:35:38,073][106226] Updated weights for policy 0, policy_version 882234 (0.0011) [2023-12-28 01:35:38,133][106226] Updated weights for policy 0, policy_version 882244 (0.0011) [2023-12-28 01:35:38,708][106225] Updated weights for policy 1, policy_version 884425 (0.0006) [2023-12-28 01:35:38,775][106225] Updated weights for policy 1, policy_version 884435 (0.0008) [2023-12-28 01:35:38,834][106225] Updated weights for policy 1, policy_version 884445 (0.0011) [2023-12-28 01:35:38,851][106226] Updated weights for policy 0, policy_version 882254 (0.0011) [2023-12-28 01:35:38,917][106226] Updated weights for policy 0, policy_version 882264 (0.0011) [2023-12-28 01:35:38,992][106226] Updated weights for policy 0, policy_version 882274 (0.0011) [2023-12-28 01:35:39,493][106225] Updated weights for policy 1, policy_version 884455 (0.0009) [2023-12-28 01:35:39,559][106225] Updated weights for policy 1, policy_version 884465 (0.0008) [2023-12-28 01:35:39,625][106225] Updated weights for policy 1, policy_version 884475 (0.0008) [2023-12-28 01:35:39,717][106226] Updated weights for policy 0, policy_version 882284 (0.0010) [2023-12-28 01:35:39,780][106226] Updated weights for policy 0, policy_version 882294 (0.0009) [2023-12-28 01:35:39,849][106226] Updated weights for policy 0, policy_version 882304 (0.0009) [2023-12-28 01:35:40,326][106225] Updated weights for policy 1, policy_version 884485 (0.0009) [2023-12-28 01:35:40,388][106225] Updated weights for policy 1, policy_version 884495 (0.0010) [2023-12-28 01:35:40,455][106225] Updated weights for policy 1, policy_version 884505 (0.0007) [2023-12-28 01:35:40,614][106226] Updated weights for policy 0, policy_version 882314 (0.0010) [2023-12-28 01:35:40,668][106226] Updated weights for policy 0, policy_version 882324 (0.0011) [2023-12-28 01:35:40,730][106226] Updated weights for policy 0, policy_version 882334 (0.0011) [2023-12-28 01:35:40,794][106226] Updated weights for policy 0, policy_version 882344 (0.0011) [2023-12-28 01:35:41,149][106225] Updated weights for policy 1, policy_version 884515 (0.0008) [2023-12-28 01:35:41,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 452411392. Throughput: 0: 9934.6, 1: 9807.1. Samples: 452385784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:41,176][105115] Avg episode reward: [(0, '-4.501'), (1, '-4.711')] [2023-12-28 01:35:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000882344_225935360.pth... [2023-12-28 01:35:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000881192_225640448.pth [2023-12-28 01:35:41,219][106225] Updated weights for policy 1, policy_version 884525 (0.0009) [2023-12-28 01:35:41,286][106225] Updated weights for policy 1, policy_version 884535 (0.0009) [2023-12-28 01:35:41,342][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000884544_226484224.pth... [2023-12-28 01:35:41,346][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000883392_226189312.pth [2023-12-28 01:35:41,561][106226] Updated weights for policy 0, policy_version 882354 (0.0009) [2023-12-28 01:35:41,625][106226] Updated weights for policy 0, policy_version 882364 (0.0008) [2023-12-28 01:35:41,694][106226] Updated weights for policy 0, policy_version 882374 (0.0007) [2023-12-28 01:35:42,076][106225] Updated weights for policy 1, policy_version 884545 (0.0009) [2023-12-28 01:35:42,130][106225] Updated weights for policy 1, policy_version 884555 (0.0009) [2023-12-28 01:35:42,178][106225] Updated weights for policy 1, policy_version 884565 (0.0008) [2023-12-28 01:35:42,238][106225] Updated weights for policy 1, policy_version 884575 (0.0009) [2023-12-28 01:35:42,344][106226] Updated weights for policy 0, policy_version 882384 (0.0009) [2023-12-28 01:35:42,412][106226] Updated weights for policy 0, policy_version 882394 (0.0008) [2023-12-28 01:35:42,472][106226] Updated weights for policy 0, policy_version 882404 (0.0008) [2023-12-28 01:35:43,009][106225] Updated weights for policy 1, policy_version 884585 (0.0008) [2023-12-28 01:35:43,067][106225] Updated weights for policy 1, policy_version 884595 (0.0009) [2023-12-28 01:35:43,125][106225] Updated weights for policy 1, policy_version 884605 (0.0008) [2023-12-28 01:35:43,201][106226] Updated weights for policy 0, policy_version 882414 (0.0008) [2023-12-28 01:35:43,256][106226] Updated weights for policy 0, policy_version 882424 (0.0008) [2023-12-28 01:35:43,312][106226] Updated weights for policy 0, policy_version 882434 (0.0008) [2023-12-28 01:35:43,832][106225] Updated weights for policy 1, policy_version 884615 (0.0008) [2023-12-28 01:35:43,894][106225] Updated weights for policy 1, policy_version 884625 (0.0008) [2023-12-28 01:35:43,956][106225] Updated weights for policy 1, policy_version 884635 (0.0008) [2023-12-28 01:35:44,053][106226] Updated weights for policy 0, policy_version 882444 (0.0008) [2023-12-28 01:35:44,124][106226] Updated weights for policy 0, policy_version 882454 (0.0007) [2023-12-28 01:35:44,191][106226] Updated weights for policy 0, policy_version 882464 (0.0009) [2023-12-28 01:35:44,692][106225] Updated weights for policy 1, policy_version 884645 (0.0008) [2023-12-28 01:35:44,748][106225] Updated weights for policy 1, policy_version 884655 (0.0009) [2023-12-28 01:35:44,815][106225] Updated weights for policy 1, policy_version 884665 (0.0007) [2023-12-28 01:35:44,882][106226] Updated weights for policy 0, policy_version 882474 (0.0009) [2023-12-28 01:35:44,943][106226] Updated weights for policy 0, policy_version 882484 (0.0008) [2023-12-28 01:35:45,004][106226] Updated weights for policy 0, policy_version 882494 (0.0009) [2023-12-28 01:35:45,062][106226] Updated weights for policy 0, policy_version 882504 (0.0009) [2023-12-28 01:35:45,533][106225] Updated weights for policy 1, policy_version 884675 (0.0008) [2023-12-28 01:35:45,595][106225] Updated weights for policy 1, policy_version 884685 (0.0008) [2023-12-28 01:35:45,650][106225] Updated weights for policy 1, policy_version 884695 (0.0007) [2023-12-28 01:35:45,832][106226] Updated weights for policy 0, policy_version 882514 (0.0008) [2023-12-28 01:35:45,891][106226] Updated weights for policy 0, policy_version 882524 (0.0009) [2023-12-28 01:35:45,942][106226] Updated weights for policy 0, policy_version 882534 (0.0008) [2023-12-28 01:35:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 452509696. Throughput: 0: 9878.8, 1: 9754.9. Samples: 452498948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:46,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.656')] [2023-12-28 01:35:46,353][106225] Updated weights for policy 1, policy_version 884705 (0.0008) [2023-12-28 01:35:46,405][106225] Updated weights for policy 1, policy_version 884715 (0.0008) [2023-12-28 01:35:46,461][106225] Updated weights for policy 1, policy_version 884725 (0.0009) [2023-12-28 01:35:46,523][106225] Updated weights for policy 1, policy_version 884735 (0.0008) [2023-12-28 01:35:46,618][106226] Updated weights for policy 0, policy_version 882544 (0.0009) [2023-12-28 01:35:46,664][106226] Updated weights for policy 0, policy_version 882554 (0.0008) [2023-12-28 01:35:46,718][106226] Updated weights for policy 0, policy_version 882564 (0.0009) [2023-12-28 01:35:47,191][106225] Updated weights for policy 1, policy_version 884745 (0.0006) [2023-12-28 01:35:47,247][106225] Updated weights for policy 1, policy_version 884755 (0.0005) [2023-12-28 01:35:47,316][106225] Updated weights for policy 1, policy_version 884765 (0.0005) [2023-12-28 01:35:47,485][106226] Updated weights for policy 0, policy_version 882574 (0.0008) [2023-12-28 01:35:47,536][106226] Updated weights for policy 0, policy_version 882584 (0.0009) [2023-12-28 01:35:47,585][106226] Updated weights for policy 0, policy_version 882594 (0.0008) [2023-12-28 01:35:47,921][106225] Updated weights for policy 1, policy_version 884775 (0.0008) [2023-12-28 01:35:47,979][106225] Updated weights for policy 1, policy_version 884785 (0.0008) [2023-12-28 01:35:48,037][106225] Updated weights for policy 1, policy_version 884795 (0.0008) [2023-12-28 01:35:48,357][106226] Updated weights for policy 0, policy_version 882604 (0.0009) [2023-12-28 01:35:48,424][106226] Updated weights for policy 0, policy_version 882614 (0.0006) [2023-12-28 01:35:48,479][106226] Updated weights for policy 0, policy_version 882624 (0.0008) [2023-12-28 01:35:48,767][106225] Updated weights for policy 1, policy_version 884805 (0.0009) [2023-12-28 01:35:48,830][106225] Updated weights for policy 1, policy_version 884815 (0.0009) [2023-12-28 01:35:48,882][106225] Updated weights for policy 1, policy_version 884825 (0.0008) [2023-12-28 01:35:49,124][106226] Updated weights for policy 0, policy_version 882634 (0.0008) [2023-12-28 01:35:49,174][106226] Updated weights for policy 0, policy_version 882644 (0.0008) [2023-12-28 01:35:49,241][106226] Updated weights for policy 0, policy_version 882654 (0.0007) [2023-12-28 01:35:49,296][106226] Updated weights for policy 0, policy_version 882664 (0.0007) [2023-12-28 01:35:49,601][106225] Updated weights for policy 1, policy_version 884835 (0.0005) [2023-12-28 01:35:49,659][106225] Updated weights for policy 1, policy_version 884845 (0.0005) [2023-12-28 01:35:49,721][106225] Updated weights for policy 1, policy_version 884855 (0.0006) [2023-12-28 01:35:50,113][106226] Updated weights for policy 0, policy_version 882674 (0.0008) [2023-12-28 01:35:50,171][106226] Updated weights for policy 0, policy_version 882684 (0.0009) [2023-12-28 01:35:50,235][106226] Updated weights for policy 0, policy_version 882694 (0.0009) [2023-12-28 01:35:50,389][106225] Updated weights for policy 1, policy_version 884865 (0.0009) [2023-12-28 01:35:50,457][106225] Updated weights for policy 1, policy_version 884875 (0.0010) [2023-12-28 01:35:50,515][106225] Updated weights for policy 1, policy_version 884885 (0.0008) [2023-12-28 01:35:50,580][106225] Updated weights for policy 1, policy_version 884895 (0.0006) [2023-12-28 01:35:50,959][106226] Updated weights for policy 0, policy_version 882704 (0.0008) [2023-12-28 01:35:51,019][106226] Updated weights for policy 0, policy_version 882714 (0.0009) [2023-12-28 01:35:51,092][106226] Updated weights for policy 0, policy_version 882724 (0.0008) [2023-12-28 01:35:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 452608000. Throughput: 0: 9829.7, 1: 9752.5. Samples: 452616148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:51,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.920')] [2023-12-28 01:35:51,311][106225] Updated weights for policy 1, policy_version 884905 (0.0008) [2023-12-28 01:35:51,377][106225] Updated weights for policy 1, policy_version 884915 (0.0009) [2023-12-28 01:35:51,448][106225] Updated weights for policy 1, policy_version 884925 (0.0010) [2023-12-28 01:35:51,845][106226] Updated weights for policy 0, policy_version 882734 (0.0009) [2023-12-28 01:35:51,900][106226] Updated weights for policy 0, policy_version 882744 (0.0007) [2023-12-28 01:35:51,967][106226] Updated weights for policy 0, policy_version 882754 (0.0009) [2023-12-28 01:35:52,193][106225] Updated weights for policy 1, policy_version 884935 (0.0009) [2023-12-28 01:35:52,256][106225] Updated weights for policy 1, policy_version 884945 (0.0008) [2023-12-28 01:35:52,323][106225] Updated weights for policy 1, policy_version 884955 (0.0009) [2023-12-28 01:35:52,719][106226] Updated weights for policy 0, policy_version 882764 (0.0008) [2023-12-28 01:35:52,783][106226] Updated weights for policy 0, policy_version 882774 (0.0009) [2023-12-28 01:35:52,844][106226] Updated weights for policy 0, policy_version 882784 (0.0009) [2023-12-28 01:35:53,042][106225] Updated weights for policy 1, policy_version 884965 (0.0009) [2023-12-28 01:35:53,096][106225] Updated weights for policy 1, policy_version 884975 (0.0007) [2023-12-28 01:35:53,152][106225] Updated weights for policy 1, policy_version 884985 (0.0006) [2023-12-28 01:35:53,548][106226] Updated weights for policy 0, policy_version 882794 (0.0009) [2023-12-28 01:35:53,612][106226] Updated weights for policy 0, policy_version 882804 (0.0011) [2023-12-28 01:35:53,674][106226] Updated weights for policy 0, policy_version 882814 (0.0011) [2023-12-28 01:35:53,736][106226] Updated weights for policy 0, policy_version 882824 (0.0008) [2023-12-28 01:35:53,813][106225] Updated weights for policy 1, policy_version 884995 (0.0008) [2023-12-28 01:35:53,863][106225] Updated weights for policy 1, policy_version 885005 (0.0009) [2023-12-28 01:35:53,916][106225] Updated weights for policy 1, policy_version 885015 (0.0009) [2023-12-28 01:35:54,362][106226] Updated weights for policy 0, policy_version 882834 (0.0011) [2023-12-28 01:35:54,425][106226] Updated weights for policy 0, policy_version 882844 (0.0010) [2023-12-28 01:35:54,491][106226] Updated weights for policy 0, policy_version 882854 (0.0010) [2023-12-28 01:35:54,673][106225] Updated weights for policy 1, policy_version 885025 (0.0009) [2023-12-28 01:35:54,724][106225] Updated weights for policy 1, policy_version 885035 (0.0007) [2023-12-28 01:35:54,776][106225] Updated weights for policy 1, policy_version 885045 (0.0008) [2023-12-28 01:35:54,836][106225] Updated weights for policy 1, policy_version 885055 (0.0010) [2023-12-28 01:35:55,134][106226] Updated weights for policy 0, policy_version 882864 (0.0009) [2023-12-28 01:35:55,188][106226] Updated weights for policy 0, policy_version 882874 (0.0009) [2023-12-28 01:35:55,241][106226] Updated weights for policy 0, policy_version 882884 (0.0010) [2023-12-28 01:35:55,434][106225] Updated weights for policy 1, policy_version 885065 (0.0010) [2023-12-28 01:35:55,487][106225] Updated weights for policy 1, policy_version 885075 (0.0010) [2023-12-28 01:35:55,533][106225] Updated weights for policy 1, policy_version 885085 (0.0010) [2023-12-28 01:35:55,998][106226] Updated weights for policy 0, policy_version 882894 (0.0007) [2023-12-28 01:35:56,057][106226] Updated weights for policy 0, policy_version 882904 (0.0007) [2023-12-28 01:35:56,116][106226] Updated weights for policy 0, policy_version 882914 (0.0008) [2023-12-28 01:35:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 452706304. Throughput: 0: 9804.2, 1: 9743.6. Samples: 452673916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:35:56,176][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.805')] [2023-12-28 01:35:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000885088_226623488.pth... [2023-12-28 01:35:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000882920_226082816.pth... [2023-12-28 01:35:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000883936_226328576.pth [2023-12-28 01:35:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000881768_225787904.pth [2023-12-28 01:35:56,241][106225] Updated weights for policy 1, policy_version 885095 (0.0010) [2023-12-28 01:35:56,292][106225] Updated weights for policy 1, policy_version 885105 (0.0010) [2023-12-28 01:35:56,342][106225] Updated weights for policy 1, policy_version 885115 (0.0010) [2023-12-28 01:35:56,841][106226] Updated weights for policy 0, policy_version 882924 (0.0008) [2023-12-28 01:35:56,904][106226] Updated weights for policy 0, policy_version 882934 (0.0006) [2023-12-28 01:35:56,959][106226] Updated weights for policy 0, policy_version 882944 (0.0010) [2023-12-28 01:35:57,027][106225] Updated weights for policy 1, policy_version 885125 (0.0010) [2023-12-28 01:35:57,073][106225] Updated weights for policy 1, policy_version 885135 (0.0010) [2023-12-28 01:35:57,126][106225] Updated weights for policy 1, policy_version 885145 (0.0010) [2023-12-28 01:35:57,576][106226] Updated weights for policy 0, policy_version 882954 (0.0010) [2023-12-28 01:35:57,640][106226] Updated weights for policy 0, policy_version 882964 (0.0008) [2023-12-28 01:35:57,704][106226] Updated weights for policy 0, policy_version 882974 (0.0008) [2023-12-28 01:35:57,765][106225] Updated weights for policy 1, policy_version 885155 (0.0009) [2023-12-28 01:35:57,766][106226] Updated weights for policy 0, policy_version 882984 (0.0006) [2023-12-28 01:35:57,811][106225] Updated weights for policy 1, policy_version 885165 (0.0005) [2023-12-28 01:35:57,860][106225] Updated weights for policy 1, policy_version 885175 (0.0005) [2023-12-28 01:35:58,356][106226] Updated weights for policy 0, policy_version 882994 (0.0008) [2023-12-28 01:35:58,427][106226] Updated weights for policy 0, policy_version 883004 (0.0008) [2023-12-28 01:35:58,497][106226] Updated weights for policy 0, policy_version 883014 (0.0009) [2023-12-28 01:35:58,539][106225] Updated weights for policy 1, policy_version 885185 (0.0007) [2023-12-28 01:35:58,601][106225] Updated weights for policy 1, policy_version 885195 (0.0011) [2023-12-28 01:35:58,669][106225] Updated weights for policy 1, policy_version 885205 (0.0011) [2023-12-28 01:35:58,731][106225] Updated weights for policy 1, policy_version 885215 (0.0007) [2023-12-28 01:35:59,284][106226] Updated weights for policy 0, policy_version 883024 (0.0007) [2023-12-28 01:35:59,350][106226] Updated weights for policy 0, policy_version 883034 (0.0008) [2023-12-28 01:35:59,427][106226] Updated weights for policy 0, policy_version 883044 (0.0009) [2023-12-28 01:35:59,666][106225] Updated weights for policy 1, policy_version 885225 (0.0007) [2023-12-28 01:35:59,726][106225] Updated weights for policy 1, policy_version 885235 (0.0008) [2023-12-28 01:35:59,776][106225] Updated weights for policy 1, policy_version 885245 (0.0006) [2023-12-28 01:36:00,147][106226] Updated weights for policy 0, policy_version 883054 (0.0009) [2023-12-28 01:36:00,205][106226] Updated weights for policy 0, policy_version 883064 (0.0009) [2023-12-28 01:36:00,261][106226] Updated weights for policy 0, policy_version 883074 (0.0009) [2023-12-28 01:36:00,462][106225] Updated weights for policy 1, policy_version 885255 (0.0007) [2023-12-28 01:36:00,513][106225] Updated weights for policy 1, policy_version 885265 (0.0008) [2023-12-28 01:36:00,570][106225] Updated weights for policy 1, policy_version 885275 (0.0009) [2023-12-28 01:36:00,916][106226] Updated weights for policy 0, policy_version 883084 (0.0010) [2023-12-28 01:36:00,979][106226] Updated weights for policy 0, policy_version 883094 (0.0010) [2023-12-28 01:36:01,049][106226] Updated weights for policy 0, policy_version 883104 (0.0008) [2023-12-28 01:36:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 452804608. Throughput: 0: 9871.5, 1: 9811.6. Samples: 452793012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:36:01,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-4.676')] [2023-12-28 01:36:01,385][106225] Updated weights for policy 1, policy_version 885285 (0.0008) [2023-12-28 01:36:01,447][106225] Updated weights for policy 1, policy_version 885295 (0.0008) [2023-12-28 01:36:01,511][106225] Updated weights for policy 1, policy_version 885305 (0.0006) [2023-12-28 01:36:01,720][106226] Updated weights for policy 0, policy_version 883114 (0.0007) [2023-12-28 01:36:01,785][106226] Updated weights for policy 0, policy_version 883124 (0.0007) [2023-12-28 01:36:01,844][106226] Updated weights for policy 0, policy_version 883134 (0.0008) [2023-12-28 01:36:01,914][106226] Updated weights for policy 0, policy_version 883144 (0.0008) [2023-12-28 01:36:02,186][106225] Updated weights for policy 1, policy_version 885315 (0.0007) [2023-12-28 01:36:02,239][106225] Updated weights for policy 1, policy_version 885325 (0.0010) [2023-12-28 01:36:02,298][106225] Updated weights for policy 1, policy_version 885335 (0.0008) [2023-12-28 01:36:02,697][106226] Updated weights for policy 0, policy_version 883154 (0.0007) [2023-12-28 01:36:02,751][106226] Updated weights for policy 0, policy_version 883164 (0.0008) [2023-12-28 01:36:02,809][106226] Updated weights for policy 0, policy_version 883174 (0.0006) [2023-12-28 01:36:03,108][106225] Updated weights for policy 1, policy_version 885345 (0.0008) [2023-12-28 01:36:03,170][106225] Updated weights for policy 1, policy_version 885355 (0.0009) [2023-12-28 01:36:03,231][106225] Updated weights for policy 1, policy_version 885365 (0.0008) [2023-12-28 01:36:03,283][106225] Updated weights for policy 1, policy_version 885375 (0.0008) [2023-12-28 01:36:03,328][106226] Updated weights for policy 0, policy_version 883184 (0.0006) [2023-12-28 01:36:03,376][106226] Updated weights for policy 0, policy_version 883194 (0.0009) [2023-12-28 01:36:03,425][106226] Updated weights for policy 0, policy_version 883204 (0.0008) [2023-12-28 01:36:04,036][106225] Updated weights for policy 1, policy_version 885385 (0.0006) [2023-12-28 01:36:04,108][106225] Updated weights for policy 1, policy_version 885395 (0.0006) [2023-12-28 01:36:04,119][106226] Updated weights for policy 0, policy_version 883214 (0.0009) [2023-12-28 01:36:04,174][106225] Updated weights for policy 1, policy_version 885405 (0.0007) [2023-12-28 01:36:04,181][106226] Updated weights for policy 0, policy_version 883224 (0.0007) [2023-12-28 01:36:04,249][106226] Updated weights for policy 0, policy_version 883234 (0.0007) [2023-12-28 01:36:04,838][106225] Updated weights for policy 1, policy_version 885415 (0.0008) [2023-12-28 01:36:04,890][106225] Updated weights for policy 1, policy_version 885425 (0.0008) [2023-12-28 01:36:04,937][106225] Updated weights for policy 1, policy_version 885435 (0.0008) [2023-12-28 01:36:04,957][106226] Updated weights for policy 0, policy_version 883244 (0.0009) [2023-12-28 01:36:05,009][106226] Updated weights for policy 0, policy_version 883254 (0.0008) [2023-12-28 01:36:05,075][106226] Updated weights for policy 0, policy_version 883264 (0.0008) [2023-12-28 01:36:05,625][106225] Updated weights for policy 1, policy_version 885445 (0.0008) [2023-12-28 01:36:05,679][106225] Updated weights for policy 1, policy_version 885455 (0.0005) [2023-12-28 01:36:05,729][106225] Updated weights for policy 1, policy_version 885465 (0.0006) [2023-12-28 01:36:05,765][106226] Updated weights for policy 0, policy_version 883274 (0.0008) [2023-12-28 01:36:05,817][106226] Updated weights for policy 0, policy_version 883284 (0.0009) [2023-12-28 01:36:05,869][106226] Updated weights for policy 0, policy_version 883294 (0.0009) [2023-12-28 01:36:05,923][106226] Updated weights for policy 0, policy_version 883304 (0.0008) [2023-12-28 01:36:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 452902912. Throughput: 0: 9904.4, 1: 9820.1. Samples: 452910996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:36:06,175][105115] Avg episode reward: [(0, '-4.392'), (1, '-4.869')] [2023-12-28 01:36:06,380][106225] Updated weights for policy 1, policy_version 885475 (0.0008) [2023-12-28 01:36:06,442][106225] Updated weights for policy 1, policy_version 885485 (0.0007) [2023-12-28 01:36:06,510][106225] Updated weights for policy 1, policy_version 885495 (0.0009) [2023-12-28 01:36:06,736][106226] Updated weights for policy 0, policy_version 883314 (0.0008) [2023-12-28 01:36:06,798][106226] Updated weights for policy 0, policy_version 883324 (0.0008) [2023-12-28 01:36:06,863][106226] Updated weights for policy 0, policy_version 883334 (0.0008) [2023-12-28 01:36:07,217][106225] Updated weights for policy 1, policy_version 885505 (0.0008) [2023-12-28 01:36:07,279][106225] Updated weights for policy 1, policy_version 885515 (0.0009) [2023-12-28 01:36:07,336][106225] Updated weights for policy 1, policy_version 885525 (0.0009) [2023-12-28 01:36:07,401][106225] Updated weights for policy 1, policy_version 885535 (0.0006) [2023-12-28 01:36:07,455][106226] Updated weights for policy 0, policy_version 883344 (0.0009) [2023-12-28 01:36:07,505][106226] Updated weights for policy 0, policy_version 883354 (0.0009) [2023-12-28 01:36:07,557][106226] Updated weights for policy 0, policy_version 883364 (0.0008) [2023-12-28 01:36:08,094][106225] Updated weights for policy 1, policy_version 885545 (0.0008) [2023-12-28 01:36:08,168][106225] Updated weights for policy 1, policy_version 885555 (0.0007) [2023-12-28 01:36:08,238][106225] Updated weights for policy 1, policy_version 885565 (0.0008) [2023-12-28 01:36:08,275][106226] Updated weights for policy 0, policy_version 883374 (0.0007) [2023-12-28 01:36:08,337][106226] Updated weights for policy 0, policy_version 883384 (0.0009) [2023-12-28 01:36:08,397][106226] Updated weights for policy 0, policy_version 883394 (0.0009) [2023-12-28 01:36:08,822][106225] Updated weights for policy 1, policy_version 885575 (0.0005) [2023-12-28 01:36:08,885][106225] Updated weights for policy 1, policy_version 885585 (0.0007) [2023-12-28 01:36:08,948][106225] Updated weights for policy 1, policy_version 885595 (0.0007) [2023-12-28 01:36:09,233][106226] Updated weights for policy 0, policy_version 883404 (0.0009) [2023-12-28 01:36:09,301][106226] Updated weights for policy 0, policy_version 883414 (0.0009) [2023-12-28 01:36:09,370][106226] Updated weights for policy 0, policy_version 883424 (0.0009) [2023-12-28 01:36:09,553][106225] Updated weights for policy 1, policy_version 885605 (0.0007) [2023-12-28 01:36:09,613][106225] Updated weights for policy 1, policy_version 885615 (0.0008) [2023-12-28 01:36:09,682][106225] Updated weights for policy 1, policy_version 885625 (0.0008) [2023-12-28 01:36:10,154][106226] Updated weights for policy 0, policy_version 883434 (0.0008) [2023-12-28 01:36:10,220][106226] Updated weights for policy 0, policy_version 883444 (0.0008) [2023-12-28 01:36:10,283][106226] Updated weights for policy 0, policy_version 883454 (0.0008) [2023-12-28 01:36:10,354][106226] Updated weights for policy 0, policy_version 883464 (0.0008) [2023-12-28 01:36:10,475][106225] Updated weights for policy 1, policy_version 885635 (0.0008) [2023-12-28 01:36:10,532][106225] Updated weights for policy 1, policy_version 885645 (0.0008) [2023-12-28 01:36:10,581][106225] Updated weights for policy 1, policy_version 885655 (0.0008) [2023-12-28 01:36:11,076][106226] Updated weights for policy 0, policy_version 883474 (0.0007) [2023-12-28 01:36:11,145][106226] Updated weights for policy 0, policy_version 883484 (0.0007) [2023-12-28 01:36:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 452993024. Throughput: 0: 9953.8, 1: 9858.4. Samples: 452971164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:36:11,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-5.079')] [2023-12-28 01:36:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000885664_226770944.pth... [2023-12-28 01:36:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000884544_226484224.pth [2023-12-28 01:36:11,209][106226] Updated weights for policy 0, policy_version 883494 (0.0008) [2023-12-28 01:36:11,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000883496_226230272.pth... [2023-12-28 01:36:11,225][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000882344_225935360.pth [2023-12-28 01:36:11,348][106225] Updated weights for policy 1, policy_version 885665 (0.0008) [2023-12-28 01:36:11,419][106225] Updated weights for policy 1, policy_version 885675 (0.0009) [2023-12-28 01:36:11,491][106225] Updated weights for policy 1, policy_version 885685 (0.0010) [2023-12-28 01:36:11,557][106225] Updated weights for policy 1, policy_version 885695 (0.0008) [2023-12-28 01:36:11,965][106226] Updated weights for policy 0, policy_version 883504 (0.0010) [2023-12-28 01:36:12,028][106226] Updated weights for policy 0, policy_version 883514 (0.0011) [2023-12-28 01:36:12,088][106226] Updated weights for policy 0, policy_version 883524 (0.0010) [2023-12-28 01:36:12,286][106225] Updated weights for policy 1, policy_version 885705 (0.0008) [2023-12-28 01:36:12,343][106225] Updated weights for policy 1, policy_version 885715 (0.0008) [2023-12-28 01:36:12,417][106225] Updated weights for policy 1, policy_version 885725 (0.0008) [2023-12-28 01:36:12,847][106226] Updated weights for policy 0, policy_version 883534 (0.0011) [2023-12-28 01:36:12,912][106226] Updated weights for policy 0, policy_version 883544 (0.0011) [2023-12-28 01:36:12,969][106226] Updated weights for policy 0, policy_version 883554 (0.0010) [2023-12-28 01:36:13,197][106225] Updated weights for policy 1, policy_version 885735 (0.0008) [2023-12-28 01:36:13,246][106225] Updated weights for policy 1, policy_version 885745 (0.0008) [2023-12-28 01:36:13,297][106225] Updated weights for policy 1, policy_version 885755 (0.0008) [2023-12-28 01:36:13,680][106226] Updated weights for policy 0, policy_version 883564 (0.0011) [2023-12-28 01:36:13,740][106226] Updated weights for policy 0, policy_version 883574 (0.0010) [2023-12-28 01:36:13,794][106226] Updated weights for policy 0, policy_version 883584 (0.0010) [2023-12-28 01:36:14,045][106225] Updated weights for policy 1, policy_version 885765 (0.0008) [2023-12-28 01:36:14,107][106225] Updated weights for policy 1, policy_version 885775 (0.0008) [2023-12-28 01:36:14,167][106225] Updated weights for policy 1, policy_version 885785 (0.0008) [2023-12-28 01:36:14,503][106226] Updated weights for policy 0, policy_version 883594 (0.0010) [2023-12-28 01:36:14,571][106226] Updated weights for policy 0, policy_version 883604 (0.0010) [2023-12-28 01:36:14,632][106226] Updated weights for policy 0, policy_version 883614 (0.0011) [2023-12-28 01:36:14,694][106226] Updated weights for policy 0, policy_version 883624 (0.0009) [2023-12-28 01:36:14,913][106225] Updated weights for policy 1, policy_version 885795 (0.0008) [2023-12-28 01:36:14,975][106225] Updated weights for policy 1, policy_version 885805 (0.0008) [2023-12-28 01:36:15,034][106225] Updated weights for policy 1, policy_version 885815 (0.0008) [2023-12-28 01:36:15,495][106226] Updated weights for policy 0, policy_version 883634 (0.0005) [2023-12-28 01:36:15,551][106226] Updated weights for policy 0, policy_version 883644 (0.0006) [2023-12-28 01:36:15,609][106226] Updated weights for policy 0, policy_version 883654 (0.0006) [2023-12-28 01:36:15,762][106225] Updated weights for policy 1, policy_version 885825 (0.0008) [2023-12-28 01:36:15,817][106225] Updated weights for policy 1, policy_version 885835 (0.0009) [2023-12-28 01:36:15,866][106225] Updated weights for policy 1, policy_version 885845 (0.0008) [2023-12-28 01:36:15,917][106225] Updated weights for policy 1, policy_version 885855 (0.0009) [2023-12-28 01:36:16,139][106226] Updated weights for policy 0, policy_version 883664 (0.0005) [2023-12-28 01:36:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 453091328. Throughput: 0: 9778.8, 1: 9777.0. Samples: 453082348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:36:16,175][105115] Avg episode reward: [(0, '-4.038'), (1, '-4.810')] [2023-12-28 01:36:16,196][106226] Updated weights for policy 0, policy_version 883674 (0.0007) [2023-12-28 01:36:16,260][106226] Updated weights for policy 0, policy_version 883684 (0.0006) [2023-12-28 01:36:16,700][106225] Updated weights for policy 1, policy_version 885865 (0.0009) [2023-12-28 01:36:16,753][106225] Updated weights for policy 1, policy_version 885875 (0.0008) [2023-12-28 01:36:16,812][106225] Updated weights for policy 1, policy_version 885885 (0.0009) [2023-12-28 01:36:16,871][106226] Updated weights for policy 0, policy_version 883694 (0.0007) [2023-12-28 01:36:16,922][106226] Updated weights for policy 0, policy_version 883704 (0.0005) [2023-12-28 01:36:16,970][106226] Updated weights for policy 0, policy_version 883714 (0.0005) [2023-12-28 01:36:17,535][106226] Updated weights for policy 0, policy_version 883724 (0.0008) [2023-12-28 01:36:17,588][106226] Updated weights for policy 0, policy_version 883734 (0.0007) [2023-12-28 01:36:17,616][106225] Updated weights for policy 1, policy_version 885895 (0.0008) [2023-12-28 01:36:17,650][106226] Updated weights for policy 0, policy_version 883744 (0.0005) [2023-12-28 01:36:17,679][106225] Updated weights for policy 1, policy_version 885905 (0.0007) [2023-12-28 01:36:17,741][106225] Updated weights for policy 1, policy_version 885915 (0.0009) [2023-12-28 01:36:18,311][106226] Updated weights for policy 0, policy_version 883754 (0.0008) [2023-12-28 01:36:18,374][106226] Updated weights for policy 0, policy_version 883764 (0.0009) [2023-12-28 01:36:18,432][106226] Updated weights for policy 0, policy_version 883774 (0.0010) [2023-12-28 01:36:18,496][106226] Updated weights for policy 0, policy_version 883784 (0.0008) [2023-12-28 01:36:18,511][106225] Updated weights for policy 1, policy_version 885925 (0.0008) [2023-12-28 01:36:18,577][106225] Updated weights for policy 1, policy_version 885935 (0.0009) [2023-12-28 01:36:18,647][106225] Updated weights for policy 1, policy_version 885945 (0.0009) [2023-12-28 01:36:19,266][106226] Updated weights for policy 0, policy_version 883794 (0.0009) [2023-12-28 01:36:19,330][106226] Updated weights for policy 0, policy_version 883804 (0.0007) [2023-12-28 01:36:19,360][106225] Updated weights for policy 1, policy_version 885955 (0.0008) [2023-12-28 01:36:19,397][106226] Updated weights for policy 0, policy_version 883814 (0.0007) [2023-12-28 01:36:19,426][106225] Updated weights for policy 1, policy_version 885965 (0.0009) [2023-12-28 01:36:19,488][106225] Updated weights for policy 1, policy_version 885975 (0.0007) [2023-12-28 01:36:20,165][106226] Updated weights for policy 0, policy_version 883824 (0.0007) [2023-12-28 01:36:20,222][106226] Updated weights for policy 0, policy_version 883834 (0.0008) [2023-12-28 01:36:20,270][106226] Updated weights for policy 0, policy_version 883844 (0.0008) [2023-12-28 01:36:20,306][106225] Updated weights for policy 1, policy_version 885985 (0.0009) [2023-12-28 01:36:20,369][106225] Updated weights for policy 1, policy_version 885995 (0.0011) [2023-12-28 01:36:20,428][106225] Updated weights for policy 1, policy_version 886005 (0.0010) [2023-12-28 01:36:20,489][106225] Updated weights for policy 1, policy_version 886015 (0.0011) [2023-12-28 01:36:21,048][106226] Updated weights for policy 0, policy_version 883854 (0.0007) [2023-12-28 01:36:21,113][106226] Updated weights for policy 0, policy_version 883864 (0.0008) [2023-12-28 01:36:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 453181440. Throughput: 0: 9745.0, 1: 9657.4. Samples: 453198676. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:21,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-5.126')] [2023-12-28 01:36:21,176][106225] Updated weights for policy 1, policy_version 886025 (0.0008) [2023-12-28 01:36:21,182][106226] Updated weights for policy 0, policy_version 883874 (0.0008) [2023-12-28 01:36:21,233][106225] Updated weights for policy 1, policy_version 886035 (0.0007) [2023-12-28 01:36:21,297][106225] Updated weights for policy 1, policy_version 886045 (0.0008) [2023-12-28 01:36:21,920][106226] Updated weights for policy 0, policy_version 883884 (0.0009) [2023-12-28 01:36:21,978][106226] Updated weights for policy 0, policy_version 883894 (0.0009) [2023-12-28 01:36:22,033][106225] Updated weights for policy 1, policy_version 886055 (0.0008) [2023-12-28 01:36:22,035][106226] Updated weights for policy 0, policy_version 883904 (0.0006) [2023-12-28 01:36:22,094][106225] Updated weights for policy 1, policy_version 886065 (0.0007) [2023-12-28 01:36:22,155][106225] Updated weights for policy 1, policy_version 886075 (0.0008) [2023-12-28 01:36:22,779][106226] Updated weights for policy 0, policy_version 883914 (0.0006) [2023-12-28 01:36:22,837][106226] Updated weights for policy 0, policy_version 883924 (0.0009) [2023-12-28 01:36:22,890][106226] Updated weights for policy 0, policy_version 883934 (0.0009) [2023-12-28 01:36:22,923][106225] Updated weights for policy 1, policy_version 886085 (0.0007) [2023-12-28 01:36:22,949][106226] Updated weights for policy 0, policy_version 883944 (0.0007) [2023-12-28 01:36:22,986][106225] Updated weights for policy 1, policy_version 886095 (0.0008) [2023-12-28 01:36:23,050][106225] Updated weights for policy 1, policy_version 886105 (0.0006) [2023-12-28 01:36:23,620][106225] Updated weights for policy 1, policy_version 886115 (0.0006) [2023-12-28 01:36:23,674][106225] Updated weights for policy 1, policy_version 886125 (0.0008) [2023-12-28 01:36:23,729][106225] Updated weights for policy 1, policy_version 886135 (0.0007) [2023-12-28 01:36:23,779][106226] Updated weights for policy 0, policy_version 883954 (0.0007) [2023-12-28 01:36:23,841][106226] Updated weights for policy 0, policy_version 883964 (0.0009) [2023-12-28 01:36:23,893][106226] Updated weights for policy 0, policy_version 883974 (0.0009) [2023-12-28 01:36:24,375][106225] Updated weights for policy 1, policy_version 886145 (0.0007) [2023-12-28 01:36:24,442][106225] Updated weights for policy 1, policy_version 886155 (0.0006) [2023-12-28 01:36:24,506][106225] Updated weights for policy 1, policy_version 886165 (0.0010) [2023-12-28 01:36:24,563][106225] Updated weights for policy 1, policy_version 886175 (0.0008) [2023-12-28 01:36:24,585][106226] Updated weights for policy 0, policy_version 883984 (0.0007) [2023-12-28 01:36:24,645][106226] Updated weights for policy 0, policy_version 883994 (0.0009) [2023-12-28 01:36:24,707][106226] Updated weights for policy 0, policy_version 884004 (0.0009) [2023-12-28 01:36:25,264][106225] Updated weights for policy 1, policy_version 886185 (0.0008) [2023-12-28 01:36:25,322][106225] Updated weights for policy 1, policy_version 886195 (0.0008) [2023-12-28 01:36:25,376][106225] Updated weights for policy 1, policy_version 886205 (0.0008) [2023-12-28 01:36:25,418][106226] Updated weights for policy 0, policy_version 884014 (0.0008) [2023-12-28 01:36:25,466][106226] Updated weights for policy 0, policy_version 884024 (0.0008) [2023-12-28 01:36:25,513][106226] Updated weights for policy 0, policy_version 884034 (0.0007) [2023-12-28 01:36:26,036][106225] Updated weights for policy 1, policy_version 886215 (0.0006) [2023-12-28 01:36:26,084][106225] Updated weights for policy 1, policy_version 886225 (0.0005) [2023-12-28 01:36:26,141][106225] Updated weights for policy 1, policy_version 886235 (0.0006) [2023-12-28 01:36:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 453287936. Throughput: 0: 9667.3, 1: 9667.6. Samples: 453255852. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:26,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.769')] [2023-12-28 01:36:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000884040_226369536.pth... [2023-12-28 01:36:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000886240_226918400.pth... [2023-12-28 01:36:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000882920_226082816.pth [2023-12-28 01:36:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000885088_226623488.pth [2023-12-28 01:36:26,259][106226] Updated weights for policy 0, policy_version 884044 (0.0009) [2023-12-28 01:36:26,316][106226] Updated weights for policy 0, policy_version 884054 (0.0008) [2023-12-28 01:36:26,368][106226] Updated weights for policy 0, policy_version 884064 (0.0008) [2023-12-28 01:36:26,825][106225] Updated weights for policy 1, policy_version 886245 (0.0008) [2023-12-28 01:36:26,872][106225] Updated weights for policy 1, policy_version 886255 (0.0008) [2023-12-28 01:36:26,925][106225] Updated weights for policy 1, policy_version 886265 (0.0008) [2023-12-28 01:36:27,066][106226] Updated weights for policy 0, policy_version 884074 (0.0008) [2023-12-28 01:36:27,118][106226] Updated weights for policy 0, policy_version 884084 (0.0007) [2023-12-28 01:36:27,170][106226] Updated weights for policy 0, policy_version 884094 (0.0008) [2023-12-28 01:36:27,223][106226] Updated weights for policy 0, policy_version 884104 (0.0008) [2023-12-28 01:36:27,547][106225] Updated weights for policy 1, policy_version 886275 (0.0008) [2023-12-28 01:36:27,599][106225] Updated weights for policy 1, policy_version 886285 (0.0005) [2023-12-28 01:36:27,643][106225] Updated weights for policy 1, policy_version 886295 (0.0005) [2023-12-28 01:36:27,988][106226] Updated weights for policy 0, policy_version 884114 (0.0008) [2023-12-28 01:36:28,045][106226] Updated weights for policy 0, policy_version 884124 (0.0008) [2023-12-28 01:36:28,103][106226] Updated weights for policy 0, policy_version 884134 (0.0009) [2023-12-28 01:36:28,287][106225] Updated weights for policy 1, policy_version 886305 (0.0005) [2023-12-28 01:36:28,357][106225] Updated weights for policy 1, policy_version 886315 (0.0008) [2023-12-28 01:36:28,422][106225] Updated weights for policy 1, policy_version 886325 (0.0008) [2023-12-28 01:36:28,481][106225] Updated weights for policy 1, policy_version 886335 (0.0009) [2023-12-28 01:36:28,854][106226] Updated weights for policy 0, policy_version 884144 (0.0008) [2023-12-28 01:36:28,919][106226] Updated weights for policy 0, policy_version 884154 (0.0009) [2023-12-28 01:36:28,980][106226] Updated weights for policy 0, policy_version 884164 (0.0008) [2023-12-28 01:36:29,139][106225] Updated weights for policy 1, policy_version 886345 (0.0008) [2023-12-28 01:36:29,203][106225] Updated weights for policy 1, policy_version 886355 (0.0008) [2023-12-28 01:36:29,269][106225] Updated weights for policy 1, policy_version 886365 (0.0008) [2023-12-28 01:36:29,718][106226] Updated weights for policy 0, policy_version 884174 (0.0006) [2023-12-28 01:36:29,776][106226] Updated weights for policy 0, policy_version 884184 (0.0005) [2023-12-28 01:36:29,836][106226] Updated weights for policy 0, policy_version 884194 (0.0007) [2023-12-28 01:36:29,983][106225] Updated weights for policy 1, policy_version 886375 (0.0009) [2023-12-28 01:36:30,050][106225] Updated weights for policy 1, policy_version 886385 (0.0007) [2023-12-28 01:36:30,114][106225] Updated weights for policy 1, policy_version 886395 (0.0005) [2023-12-28 01:36:30,571][106226] Updated weights for policy 0, policy_version 884204 (0.0008) [2023-12-28 01:36:30,618][106226] Updated weights for policy 0, policy_version 884214 (0.0005) [2023-12-28 01:36:30,642][106225] Updated weights for policy 1, policy_version 886405 (0.0006) [2023-12-28 01:36:30,663][106226] Updated weights for policy 0, policy_version 884224 (0.0008) [2023-12-28 01:36:30,690][106225] Updated weights for policy 1, policy_version 886415 (0.0005) [2023-12-28 01:36:30,736][106225] Updated weights for policy 1, policy_version 886425 (0.0005) [2023-12-28 01:36:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 453386240. Throughput: 0: 9699.6, 1: 9785.8. Samples: 453375792. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:31,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-5.063')] [2023-12-28 01:36:31,390][106225] Updated weights for policy 1, policy_version 886435 (0.0008) [2023-12-28 01:36:31,419][106226] Updated weights for policy 0, policy_version 884234 (0.0007) [2023-12-28 01:36:31,450][106225] Updated weights for policy 1, policy_version 886445 (0.0008) [2023-12-28 01:36:31,480][106226] Updated weights for policy 0, policy_version 884244 (0.0008) [2023-12-28 01:36:31,501][106225] Updated weights for policy 1, policy_version 886455 (0.0008) [2023-12-28 01:36:31,540][106226] Updated weights for policy 0, policy_version 884254 (0.0006) [2023-12-28 01:36:31,596][106226] Updated weights for policy 0, policy_version 884264 (0.0008) [2023-12-28 01:36:32,284][106225] Updated weights for policy 1, policy_version 886465 (0.0008) [2023-12-28 01:36:32,338][106225] Updated weights for policy 1, policy_version 886475 (0.0006) [2023-12-28 01:36:32,348][106226] Updated weights for policy 0, policy_version 884274 (0.0009) [2023-12-28 01:36:32,402][106226] Updated weights for policy 0, policy_version 884284 (0.0008) [2023-12-28 01:36:32,407][106225] Updated weights for policy 1, policy_version 886485 (0.0008) [2023-12-28 01:36:32,455][106225] Updated weights for policy 1, policy_version 886495 (0.0007) [2023-12-28 01:36:32,457][106226] Updated weights for policy 0, policy_version 884294 (0.0007) [2023-12-28 01:36:33,083][106225] Updated weights for policy 1, policy_version 886505 (0.0006) [2023-12-28 01:36:33,141][106225] Updated weights for policy 1, policy_version 886515 (0.0005) [2023-12-28 01:36:33,197][106225] Updated weights for policy 1, policy_version 886525 (0.0005) [2023-12-28 01:36:33,261][106226] Updated weights for policy 0, policy_version 884304 (0.0010) [2023-12-28 01:36:33,309][106226] Updated weights for policy 0, policy_version 884314 (0.0009) [2023-12-28 01:36:33,359][106226] Updated weights for policy 0, policy_version 884324 (0.0010) [2023-12-28 01:36:33,851][106225] Updated weights for policy 1, policy_version 886535 (0.0006) [2023-12-28 01:36:33,915][106225] Updated weights for policy 1, policy_version 886545 (0.0005) [2023-12-28 01:36:33,981][106225] Updated weights for policy 1, policy_version 886555 (0.0005) [2023-12-28 01:36:34,076][106226] Updated weights for policy 0, policy_version 884334 (0.0010) [2023-12-28 01:36:34,127][106226] Updated weights for policy 0, policy_version 884344 (0.0010) [2023-12-28 01:36:34,201][106226] Updated weights for policy 0, policy_version 884354 (0.0011) [2023-12-28 01:36:34,585][106225] Updated weights for policy 1, policy_version 886565 (0.0007) [2023-12-28 01:36:34,646][106225] Updated weights for policy 1, policy_version 886575 (0.0008) [2023-12-28 01:36:34,711][106225] Updated weights for policy 1, policy_version 886585 (0.0008) [2023-12-28 01:36:34,930][106226] Updated weights for policy 0, policy_version 884364 (0.0011) [2023-12-28 01:36:34,990][106226] Updated weights for policy 0, policy_version 884374 (0.0010) [2023-12-28 01:36:35,043][106226] Updated weights for policy 0, policy_version 884384 (0.0009) [2023-12-28 01:36:35,371][106225] Updated weights for policy 1, policy_version 886595 (0.0008) [2023-12-28 01:36:35,430][106225] Updated weights for policy 1, policy_version 886605 (0.0007) [2023-12-28 01:36:35,480][106225] Updated weights for policy 1, policy_version 886615 (0.0007) [2023-12-28 01:36:35,673][106226] Updated weights for policy 0, policy_version 884394 (0.0005) [2023-12-28 01:36:35,729][106226] Updated weights for policy 0, policy_version 884404 (0.0005) [2023-12-28 01:36:35,794][106226] Updated weights for policy 0, policy_version 884414 (0.0005) [2023-12-28 01:36:35,854][106226] Updated weights for policy 0, policy_version 884424 (0.0005) [2023-12-28 01:36:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 453484544. Throughput: 0: 9722.5, 1: 9858.5. Samples: 453497292. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:36,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.969')] [2023-12-28 01:36:36,271][106225] Updated weights for policy 1, policy_version 886625 (0.0008) [2023-12-28 01:36:36,335][106225] Updated weights for policy 1, policy_version 886635 (0.0008) [2023-12-28 01:36:36,397][106225] Updated weights for policy 1, policy_version 886645 (0.0008) [2023-12-28 01:36:36,411][106226] Updated weights for policy 0, policy_version 884434 (0.0006) [2023-12-28 01:36:36,460][106225] Updated weights for policy 1, policy_version 886655 (0.0007) [2023-12-28 01:36:36,473][106226] Updated weights for policy 0, policy_version 884444 (0.0008) [2023-12-28 01:36:36,534][106226] Updated weights for policy 0, policy_version 884454 (0.0008) [2023-12-28 01:36:37,111][106225] Updated weights for policy 1, policy_version 886665 (0.0006) [2023-12-28 01:36:37,160][106225] Updated weights for policy 1, policy_version 886675 (0.0005) [2023-12-28 01:36:37,209][106225] Updated weights for policy 1, policy_version 886685 (0.0005) [2023-12-28 01:36:37,210][106226] Updated weights for policy 0, policy_version 884464 (0.0011) [2023-12-28 01:36:37,267][106226] Updated weights for policy 0, policy_version 884474 (0.0010) [2023-12-28 01:36:37,327][106226] Updated weights for policy 0, policy_version 884484 (0.0011) [2023-12-28 01:36:37,920][106225] Updated weights for policy 1, policy_version 886695 (0.0008) [2023-12-28 01:36:37,967][106225] Updated weights for policy 1, policy_version 886705 (0.0007) [2023-12-28 01:36:38,017][106226] Updated weights for policy 0, policy_version 884494 (0.0009) [2023-12-28 01:36:38,018][106225] Updated weights for policy 1, policy_version 886715 (0.0007) [2023-12-28 01:36:38,078][106226] Updated weights for policy 0, policy_version 884504 (0.0010) [2023-12-28 01:36:38,137][106226] Updated weights for policy 0, policy_version 884514 (0.0009) [2023-12-28 01:36:38,728][106225] Updated weights for policy 1, policy_version 886725 (0.0007) [2023-12-28 01:36:38,793][106225] Updated weights for policy 1, policy_version 886735 (0.0006) [2023-12-28 01:36:38,833][106226] Updated weights for policy 0, policy_version 884524 (0.0009) [2023-12-28 01:36:38,858][106225] Updated weights for policy 1, policy_version 886745 (0.0008) [2023-12-28 01:36:38,902][106226] Updated weights for policy 0, policy_version 884534 (0.0006) [2023-12-28 01:36:38,962][106226] Updated weights for policy 0, policy_version 884544 (0.0011) [2023-12-28 01:36:39,636][106225] Updated weights for policy 1, policy_version 886755 (0.0008) [2023-12-28 01:36:39,697][106225] Updated weights for policy 1, policy_version 886765 (0.0008) [2023-12-28 01:36:39,715][106226] Updated weights for policy 0, policy_version 884554 (0.0010) [2023-12-28 01:36:39,764][106225] Updated weights for policy 1, policy_version 886775 (0.0008) [2023-12-28 01:36:39,774][106226] Updated weights for policy 0, policy_version 884564 (0.0011) [2023-12-28 01:36:39,843][106226] Updated weights for policy 0, policy_version 884574 (0.0009) [2023-12-28 01:36:39,920][106226] Updated weights for policy 0, policy_version 884584 (0.0008) [2023-12-28 01:36:40,482][106225] Updated weights for policy 1, policy_version 886785 (0.0008) [2023-12-28 01:36:40,547][106225] Updated weights for policy 1, policy_version 886795 (0.0008) [2023-12-28 01:36:40,576][106226] Updated weights for policy 0, policy_version 884594 (0.0006) [2023-12-28 01:36:40,604][106225] Updated weights for policy 1, policy_version 886805 (0.0007) [2023-12-28 01:36:40,633][106226] Updated weights for policy 0, policy_version 884604 (0.0005) [2023-12-28 01:36:40,664][106225] Updated weights for policy 1, policy_version 886815 (0.0008) [2023-12-28 01:36:40,694][106226] Updated weights for policy 0, policy_version 884614 (0.0007) [2023-12-28 01:36:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 453582848. Throughput: 0: 9755.5, 1: 9877.3. Samples: 453557388. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:41,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-5.089')] [2023-12-28 01:36:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000886816_227065856.pth... [2023-12-28 01:36:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000884616_226516992.pth... [2023-12-28 01:36:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000885664_226770944.pth [2023-12-28 01:36:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000883496_226230272.pth [2023-12-28 01:36:41,447][106226] Updated weights for policy 0, policy_version 884624 (0.0008) [2023-12-28 01:36:41,459][106225] Updated weights for policy 1, policy_version 886825 (0.0007) [2023-12-28 01:36:41,511][106226] Updated weights for policy 0, policy_version 884634 (0.0006) [2023-12-28 01:36:41,524][106225] Updated weights for policy 1, policy_version 886835 (0.0008) [2023-12-28 01:36:41,572][106226] Updated weights for policy 0, policy_version 884644 (0.0007) [2023-12-28 01:36:41,586][106225] Updated weights for policy 1, policy_version 886845 (0.0010) [2023-12-28 01:36:42,299][106226] Updated weights for policy 0, policy_version 884654 (0.0008) [2023-12-28 01:36:42,368][106226] Updated weights for policy 0, policy_version 884664 (0.0008) [2023-12-28 01:36:42,369][106225] Updated weights for policy 1, policy_version 886855 (0.0008) [2023-12-28 01:36:42,433][106226] Updated weights for policy 0, policy_version 884674 (0.0008) [2023-12-28 01:36:42,438][106225] Updated weights for policy 1, policy_version 886865 (0.0008) [2023-12-28 01:36:42,504][106225] Updated weights for policy 1, policy_version 886875 (0.0006) [2023-12-28 01:36:43,149][106226] Updated weights for policy 0, policy_version 884684 (0.0007) [2023-12-28 01:36:43,154][106225] Updated weights for policy 1, policy_version 886885 (0.0007) [2023-12-28 01:36:43,209][106226] Updated weights for policy 0, policy_version 884694 (0.0005) [2023-12-28 01:36:43,220][106225] Updated weights for policy 1, policy_version 886895 (0.0007) [2023-12-28 01:36:43,260][106226] Updated weights for policy 0, policy_version 884704 (0.0005) [2023-12-28 01:36:43,281][106225] Updated weights for policy 1, policy_version 886905 (0.0009) [2023-12-28 01:36:43,972][106226] Updated weights for policy 0, policy_version 884714 (0.0006) [2023-12-28 01:36:43,973][106225] Updated weights for policy 1, policy_version 886915 (0.0008) [2023-12-28 01:36:44,027][106226] Updated weights for policy 0, policy_version 884724 (0.0008) [2023-12-28 01:36:44,029][106225] Updated weights for policy 1, policy_version 886925 (0.0005) [2023-12-28 01:36:44,076][106226] Updated weights for policy 0, policy_version 884734 (0.0008) [2023-12-28 01:36:44,082][106225] Updated weights for policy 1, policy_version 886935 (0.0005) [2023-12-28 01:36:44,129][106226] Updated weights for policy 0, policy_version 884744 (0.0008) [2023-12-28 01:36:44,750][106225] Updated weights for policy 1, policy_version 886945 (0.0006) [2023-12-28 01:36:44,819][106225] Updated weights for policy 1, policy_version 886955 (0.0008) [2023-12-28 01:36:44,880][106225] Updated weights for policy 1, policy_version 886965 (0.0006) [2023-12-28 01:36:44,901][106226] Updated weights for policy 0, policy_version 884754 (0.0009) [2023-12-28 01:36:44,940][106225] Updated weights for policy 1, policy_version 886975 (0.0006) [2023-12-28 01:36:44,959][106226] Updated weights for policy 0, policy_version 884764 (0.0007) [2023-12-28 01:36:45,029][106226] Updated weights for policy 0, policy_version 884774 (0.0009) [2023-12-28 01:36:45,633][106225] Updated weights for policy 1, policy_version 886985 (0.0008) [2023-12-28 01:36:45,693][106225] Updated weights for policy 1, policy_version 886995 (0.0008) [2023-12-28 01:36:45,751][106225] Updated weights for policy 1, policy_version 887005 (0.0008) [2023-12-28 01:36:45,763][106226] Updated weights for policy 0, policy_version 884784 (0.0007) [2023-12-28 01:36:45,822][106226] Updated weights for policy 0, policy_version 884794 (0.0006) [2023-12-28 01:36:45,879][106226] Updated weights for policy 0, policy_version 884804 (0.0009) [2023-12-28 01:36:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 453681152. Throughput: 0: 9702.4, 1: 9799.3. Samples: 453670588. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:46,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.737')] [2023-12-28 01:36:46,363][106225] Updated weights for policy 1, policy_version 887015 (0.0006) [2023-12-28 01:36:46,424][106225] Updated weights for policy 1, policy_version 887025 (0.0005) [2023-12-28 01:36:46,452][106226] Updated weights for policy 0, policy_version 884814 (0.0007) [2023-12-28 01:36:46,491][106225] Updated weights for policy 1, policy_version 887035 (0.0005) [2023-12-28 01:36:46,520][106226] Updated weights for policy 0, policy_version 884824 (0.0008) [2023-12-28 01:36:46,565][106226] Updated weights for policy 0, policy_version 884834 (0.0008) [2023-12-28 01:36:47,115][106225] Updated weights for policy 1, policy_version 887045 (0.0007) [2023-12-28 01:36:47,176][106225] Updated weights for policy 1, policy_version 887055 (0.0009) [2023-12-28 01:36:47,227][106226] Updated weights for policy 0, policy_version 884844 (0.0008) [2023-12-28 01:36:47,228][106225] Updated weights for policy 1, policy_version 887065 (0.0009) [2023-12-28 01:36:47,271][106226] Updated weights for policy 0, policy_version 884854 (0.0006) [2023-12-28 01:36:47,322][106226] Updated weights for policy 0, policy_version 884864 (0.0008) [2023-12-28 01:36:47,997][106225] Updated weights for policy 1, policy_version 887075 (0.0007) [2023-12-28 01:36:47,999][106226] Updated weights for policy 0, policy_version 884874 (0.0008) [2023-12-28 01:36:48,050][106225] Updated weights for policy 1, policy_version 887085 (0.0006) [2023-12-28 01:36:48,057][106226] Updated weights for policy 0, policy_version 884884 (0.0006) [2023-12-28 01:36:48,107][106225] Updated weights for policy 1, policy_version 887095 (0.0009) [2023-12-28 01:36:48,115][106226] Updated weights for policy 0, policy_version 884894 (0.0010) [2023-12-28 01:36:48,173][106226] Updated weights for policy 0, policy_version 884904 (0.0009) [2023-12-28 01:36:48,857][106225] Updated weights for policy 1, policy_version 887105 (0.0008) [2023-12-28 01:36:48,918][106225] Updated weights for policy 1, policy_version 887115 (0.0011) [2023-12-28 01:36:48,959][106226] Updated weights for policy 0, policy_version 884914 (0.0006) [2023-12-28 01:36:48,979][106225] Updated weights for policy 1, policy_version 887125 (0.0011) [2023-12-28 01:36:49,017][106226] Updated weights for policy 0, policy_version 884924 (0.0006) [2023-12-28 01:36:49,038][106225] Updated weights for policy 1, policy_version 887135 (0.0010) [2023-12-28 01:36:49,078][106226] Updated weights for policy 0, policy_version 884934 (0.0008) [2023-12-28 01:36:49,692][106225] Updated weights for policy 1, policy_version 887145 (0.0006) [2023-12-28 01:36:49,757][106225] Updated weights for policy 1, policy_version 887155 (0.0007) [2023-12-28 01:36:49,826][106225] Updated weights for policy 1, policy_version 887165 (0.0008) [2023-12-28 01:36:49,871][106226] Updated weights for policy 0, policy_version 884944 (0.0008) [2023-12-28 01:36:49,940][106226] Updated weights for policy 0, policy_version 884954 (0.0008) [2023-12-28 01:36:50,000][106226] Updated weights for policy 0, policy_version 884964 (0.0010) [2023-12-28 01:36:50,549][106225] Updated weights for policy 1, policy_version 887175 (0.0008) [2023-12-28 01:36:50,613][106225] Updated weights for policy 1, policy_version 887185 (0.0008) [2023-12-28 01:36:50,675][106225] Updated weights for policy 1, policy_version 887195 (0.0009) [2023-12-28 01:36:50,704][106226] Updated weights for policy 0, policy_version 884974 (0.0007) [2023-12-28 01:36:50,771][106226] Updated weights for policy 0, policy_version 884984 (0.0006) [2023-12-28 01:36:50,833][106226] Updated weights for policy 0, policy_version 884994 (0.0007) [2023-12-28 01:36:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 453779456. Throughput: 0: 9672.1, 1: 9836.9. Samples: 453788900. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:51,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.905')] [2023-12-28 01:36:51,466][106225] Updated weights for policy 1, policy_version 887205 (0.0008) [2023-12-28 01:36:51,530][106225] Updated weights for policy 1, policy_version 887215 (0.0008) [2023-12-28 01:36:51,591][106226] Updated weights for policy 0, policy_version 885004 (0.0009) [2023-12-28 01:36:51,593][106225] Updated weights for policy 1, policy_version 887225 (0.0007) [2023-12-28 01:36:51,654][106226] Updated weights for policy 0, policy_version 885014 (0.0008) [2023-12-28 01:36:51,717][106226] Updated weights for policy 0, policy_version 885024 (0.0007) [2023-12-28 01:36:52,363][106225] Updated weights for policy 1, policy_version 887235 (0.0008) [2023-12-28 01:36:52,426][106225] Updated weights for policy 1, policy_version 887245 (0.0009) [2023-12-28 01:36:52,473][106226] Updated weights for policy 0, policy_version 885034 (0.0008) [2023-12-28 01:36:52,491][106225] Updated weights for policy 1, policy_version 887255 (0.0007) [2023-12-28 01:36:52,541][106226] Updated weights for policy 0, policy_version 885044 (0.0008) [2023-12-28 01:36:52,610][106226] Updated weights for policy 0, policy_version 885054 (0.0008) [2023-12-28 01:36:52,670][106226] Updated weights for policy 0, policy_version 885064 (0.0009) [2023-12-28 01:36:53,235][106225] Updated weights for policy 1, policy_version 887265 (0.0007) [2023-12-28 01:36:53,298][106225] Updated weights for policy 1, policy_version 887275 (0.0008) [2023-12-28 01:36:53,347][106226] Updated weights for policy 0, policy_version 885074 (0.0006) [2023-12-28 01:36:53,356][106225] Updated weights for policy 1, policy_version 887285 (0.0008) [2023-12-28 01:36:53,395][106226] Updated weights for policy 0, policy_version 885084 (0.0006) [2023-12-28 01:36:53,412][106225] Updated weights for policy 1, policy_version 887295 (0.0008) [2023-12-28 01:36:53,444][106226] Updated weights for policy 0, policy_version 885094 (0.0007) [2023-12-28 01:36:54,115][106226] Updated weights for policy 0, policy_version 885104 (0.0009) [2023-12-28 01:36:54,168][106225] Updated weights for policy 1, policy_version 887305 (0.0007) [2023-12-28 01:36:54,174][106226] Updated weights for policy 0, policy_version 885114 (0.0006) [2023-12-28 01:36:54,222][106225] Updated weights for policy 1, policy_version 887315 (0.0007) [2023-12-28 01:36:54,231][106226] Updated weights for policy 0, policy_version 885124 (0.0008) [2023-12-28 01:36:54,271][106225] Updated weights for policy 1, policy_version 887325 (0.0006) [2023-12-28 01:36:54,789][106226] Updated weights for policy 0, policy_version 885134 (0.0006) [2023-12-28 01:36:54,844][106226] Updated weights for policy 0, policy_version 885144 (0.0005) [2023-12-28 01:36:54,903][106226] Updated weights for policy 0, policy_version 885154 (0.0005) [2023-12-28 01:36:55,088][106225] Updated weights for policy 1, policy_version 887335 (0.0006) [2023-12-28 01:36:55,159][106225] Updated weights for policy 1, policy_version 887345 (0.0005) [2023-12-28 01:36:55,220][106225] Updated weights for policy 1, policy_version 887355 (0.0005) [2023-12-28 01:36:55,453][106226] Updated weights for policy 0, policy_version 885164 (0.0005) [2023-12-28 01:36:55,515][106226] Updated weights for policy 0, policy_version 885174 (0.0005) [2023-12-28 01:36:55,578][106226] Updated weights for policy 0, policy_version 885184 (0.0005) [2023-12-28 01:36:55,924][106225] Updated weights for policy 1, policy_version 887365 (0.0007) [2023-12-28 01:36:55,975][106225] Updated weights for policy 1, policy_version 887375 (0.0008) [2023-12-28 01:36:56,026][106225] Updated weights for policy 1, policy_version 887385 (0.0008) [2023-12-28 01:36:56,112][106226] Updated weights for policy 0, policy_version 885194 (0.0006) [2023-12-28 01:36:56,168][106226] Updated weights for policy 0, policy_version 885204 (0.0010) [2023-12-28 01:36:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 453877760. Throughput: 0: 9672.7, 1: 9766.7. Samples: 453845944. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:36:56,176][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.790')] [2023-12-28 01:36:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000887392_227213312.pth... [2023-12-28 01:36:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000886240_226918400.pth [2023-12-28 01:36:56,226][106226] Updated weights for policy 0, policy_version 885214 (0.0009) [2023-12-28 01:36:56,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000885224_226672640.pth... [2023-12-28 01:36:56,282][106226] Updated weights for policy 0, policy_version 885224 (0.0010) [2023-12-28 01:36:56,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000884040_226369536.pth [2023-12-28 01:36:56,773][106225] Updated weights for policy 1, policy_version 887395 (0.0007) [2023-12-28 01:36:56,829][106225] Updated weights for policy 1, policy_version 887405 (0.0008) [2023-12-28 01:36:56,893][106225] Updated weights for policy 1, policy_version 887415 (0.0008) [2023-12-28 01:36:56,959][106226] Updated weights for policy 0, policy_version 885234 (0.0006) [2023-12-28 01:36:57,025][106226] Updated weights for policy 0, policy_version 885244 (0.0005) [2023-12-28 01:36:57,087][106226] Updated weights for policy 0, policy_version 885254 (0.0006) [2023-12-28 01:36:57,641][106225] Updated weights for policy 1, policy_version 887425 (0.0007) [2023-12-28 01:36:57,691][106225] Updated weights for policy 1, policy_version 887435 (0.0006) [2023-12-28 01:36:57,701][106226] Updated weights for policy 0, policy_version 885264 (0.0009) [2023-12-28 01:36:57,748][106226] Updated weights for policy 0, policy_version 885274 (0.0010) [2023-12-28 01:36:57,750][106225] Updated weights for policy 1, policy_version 887445 (0.0006) [2023-12-28 01:36:57,797][106226] Updated weights for policy 0, policy_version 885284 (0.0010) [2023-12-28 01:36:57,806][106225] Updated weights for policy 1, policy_version 887455 (0.0005) [2023-12-28 01:36:58,506][106225] Updated weights for policy 1, policy_version 887465 (0.0008) [2023-12-28 01:36:58,570][106225] Updated weights for policy 1, policy_version 887475 (0.0007) [2023-12-28 01:36:58,577][106226] Updated weights for policy 0, policy_version 885294 (0.0009) [2023-12-28 01:36:58,633][106225] Updated weights for policy 1, policy_version 887485 (0.0008) [2023-12-28 01:36:58,635][106226] Updated weights for policy 0, policy_version 885304 (0.0008) [2023-12-28 01:36:58,691][106226] Updated weights for policy 0, policy_version 885314 (0.0008) [2023-12-28 01:36:59,418][106225] Updated weights for policy 1, policy_version 887495 (0.0008) [2023-12-28 01:36:59,493][106225] Updated weights for policy 1, policy_version 887505 (0.0009) [2023-12-28 01:36:59,536][106226] Updated weights for policy 0, policy_version 885324 (0.0009) [2023-12-28 01:36:59,557][106225] Updated weights for policy 1, policy_version 887515 (0.0009) [2023-12-28 01:36:59,597][106226] Updated weights for policy 0, policy_version 885334 (0.0010) [2023-12-28 01:36:59,658][106226] Updated weights for policy 0, policy_version 885344 (0.0010) [2023-12-28 01:37:00,243][106225] Updated weights for policy 1, policy_version 887525 (0.0008) [2023-12-28 01:37:00,295][106225] Updated weights for policy 1, policy_version 887535 (0.0010) [2023-12-28 01:37:00,335][106226] Updated weights for policy 0, policy_version 885354 (0.0009) [2023-12-28 01:37:00,349][106225] Updated weights for policy 1, policy_version 887545 (0.0010) [2023-12-28 01:37:00,399][106226] Updated weights for policy 0, policy_version 885364 (0.0010) [2023-12-28 01:37:00,452][106226] Updated weights for policy 0, policy_version 885374 (0.0010) [2023-12-28 01:37:00,512][106226] Updated weights for policy 0, policy_version 885384 (0.0008) [2023-12-28 01:37:01,064][106226] Updated weights for policy 0, policy_version 885394 (0.0007) [2023-12-28 01:37:01,071][106225] Updated weights for policy 1, policy_version 887555 (0.0008) [2023-12-28 01:37:01,123][106226] Updated weights for policy 0, policy_version 885404 (0.0008) [2023-12-28 01:37:01,137][106225] Updated weights for policy 1, policy_version 887565 (0.0010) [2023-12-28 01:37:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 453967872. Throughput: 0: 9842.8, 1: 9757.9. Samples: 453964376. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:01,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.492')] [2023-12-28 01:37:01,187][106226] Updated weights for policy 0, policy_version 885414 (0.0007) [2023-12-28 01:37:01,204][106225] Updated weights for policy 1, policy_version 887575 (0.0010) [2023-12-28 01:37:01,253][106141] Saving new best policy, reward=-4.492! [2023-12-28 01:37:01,917][106226] Updated weights for policy 0, policy_version 885424 (0.0008) [2023-12-28 01:37:01,973][106225] Updated weights for policy 1, policy_version 887585 (0.0009) [2023-12-28 01:37:01,981][106226] Updated weights for policy 0, policy_version 885434 (0.0008) [2023-12-28 01:37:02,031][106225] Updated weights for policy 1, policy_version 887595 (0.0010) [2023-12-28 01:37:02,036][106226] Updated weights for policy 0, policy_version 885444 (0.0007) [2023-12-28 01:37:02,092][106225] Updated weights for policy 1, policy_version 887605 (0.0010) [2023-12-28 01:37:02,159][106225] Updated weights for policy 1, policy_version 887615 (0.0010) [2023-12-28 01:37:02,628][106226] Updated weights for policy 0, policy_version 885454 (0.0005) [2023-12-28 01:37:02,682][106226] Updated weights for policy 0, policy_version 885464 (0.0005) [2023-12-28 01:37:02,729][106226] Updated weights for policy 0, policy_version 885474 (0.0005) [2023-12-28 01:37:02,886][106225] Updated weights for policy 1, policy_version 887625 (0.0010) [2023-12-28 01:37:02,943][106225] Updated weights for policy 1, policy_version 887635 (0.0010) [2023-12-28 01:37:02,999][106225] Updated weights for policy 1, policy_version 887645 (0.0010) [2023-12-28 01:37:03,258][106226] Updated weights for policy 0, policy_version 885484 (0.0005) [2023-12-28 01:37:03,307][106226] Updated weights for policy 0, policy_version 885494 (0.0005) [2023-12-28 01:37:03,354][106226] Updated weights for policy 0, policy_version 885504 (0.0005) [2023-12-28 01:37:03,638][106225] Updated weights for policy 1, policy_version 887655 (0.0010) [2023-12-28 01:37:03,703][106225] Updated weights for policy 1, policy_version 887665 (0.0010) [2023-12-28 01:37:03,763][106225] Updated weights for policy 1, policy_version 887675 (0.0010) [2023-12-28 01:37:03,942][106226] Updated weights for policy 0, policy_version 885514 (0.0006) [2023-12-28 01:37:03,997][106226] Updated weights for policy 0, policy_version 885524 (0.0008) [2023-12-28 01:37:04,060][106226] Updated weights for policy 0, policy_version 885534 (0.0006) [2023-12-28 01:37:04,127][106226] Updated weights for policy 0, policy_version 885544 (0.0007) [2023-12-28 01:37:04,471][106225] Updated weights for policy 1, policy_version 887685 (0.0010) [2023-12-28 01:37:04,522][106225] Updated weights for policy 1, policy_version 887695 (0.0010) [2023-12-28 01:37:04,569][106225] Updated weights for policy 1, policy_version 887705 (0.0010) [2023-12-28 01:37:04,822][106226] Updated weights for policy 0, policy_version 885554 (0.0005) [2023-12-28 01:37:04,870][106226] Updated weights for policy 0, policy_version 885564 (0.0005) [2023-12-28 01:37:04,921][106226] Updated weights for policy 0, policy_version 885574 (0.0007) [2023-12-28 01:37:05,298][106225] Updated weights for policy 1, policy_version 887715 (0.0008) [2023-12-28 01:37:05,348][106225] Updated weights for policy 1, policy_version 887725 (0.0010) [2023-12-28 01:37:05,398][106225] Updated weights for policy 1, policy_version 887735 (0.0010) [2023-12-28 01:37:05,607][106226] Updated weights for policy 0, policy_version 885584 (0.0007) [2023-12-28 01:37:05,666][106226] Updated weights for policy 0, policy_version 885594 (0.0008) [2023-12-28 01:37:05,727][106226] Updated weights for policy 0, policy_version 885604 (0.0007) [2023-12-28 01:37:06,152][106225] Updated weights for policy 1, policy_version 887745 (0.0010) [2023-12-28 01:37:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 454074368. Throughput: 0: 9921.2, 1: 9839.9. Samples: 454087932. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:06,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-4.855')] [2023-12-28 01:37:06,214][106225] Updated weights for policy 1, policy_version 887755 (0.0008) [2023-12-28 01:37:06,280][106225] Updated weights for policy 1, policy_version 887765 (0.0010) [2023-12-28 01:37:06,345][106225] Updated weights for policy 1, policy_version 887775 (0.0011) [2023-12-28 01:37:06,427][106226] Updated weights for policy 0, policy_version 885614 (0.0007) [2023-12-28 01:37:06,493][106226] Updated weights for policy 0, policy_version 885624 (0.0008) [2023-12-28 01:37:06,558][106226] Updated weights for policy 0, policy_version 885634 (0.0008) [2023-12-28 01:37:07,051][106225] Updated weights for policy 1, policy_version 887785 (0.0010) [2023-12-28 01:37:07,100][106225] Updated weights for policy 1, policy_version 887795 (0.0010) [2023-12-28 01:37:07,125][106226] Updated weights for policy 0, policy_version 885644 (0.0007) [2023-12-28 01:37:07,147][106225] Updated weights for policy 1, policy_version 887805 (0.0008) [2023-12-28 01:37:07,188][106226] Updated weights for policy 0, policy_version 885654 (0.0006) [2023-12-28 01:37:07,244][106226] Updated weights for policy 0, policy_version 885664 (0.0006) [2023-12-28 01:37:07,761][106226] Updated weights for policy 0, policy_version 885674 (0.0005) [2023-12-28 01:37:07,824][106226] Updated weights for policy 0, policy_version 885684 (0.0005) [2023-12-28 01:37:07,882][106226] Updated weights for policy 0, policy_version 885694 (0.0010) [2023-12-28 01:37:07,901][106225] Updated weights for policy 1, policy_version 887815 (0.0009) [2023-12-28 01:37:07,938][106226] Updated weights for policy 0, policy_version 885704 (0.0010) [2023-12-28 01:37:07,948][106225] Updated weights for policy 1, policy_version 887825 (0.0010) [2023-12-28 01:37:07,993][106225] Updated weights for policy 1, policy_version 887835 (0.0009) [2023-12-28 01:37:08,588][106226] Updated weights for policy 0, policy_version 885714 (0.0011) [2023-12-28 01:37:08,655][106226] Updated weights for policy 0, policy_version 885724 (0.0011) [2023-12-28 01:37:08,703][106225] Updated weights for policy 1, policy_version 887845 (0.0005) [2023-12-28 01:37:08,719][106226] Updated weights for policy 0, policy_version 885734 (0.0011) [2023-12-28 01:37:08,758][106225] Updated weights for policy 1, policy_version 887855 (0.0008) [2023-12-28 01:37:08,820][106225] Updated weights for policy 1, policy_version 887865 (0.0007) [2023-12-28 01:37:09,472][106226] Updated weights for policy 0, policy_version 885744 (0.0011) [2023-12-28 01:37:09,540][106226] Updated weights for policy 0, policy_version 885754 (0.0011) [2023-12-28 01:37:09,563][106225] Updated weights for policy 1, policy_version 887875 (0.0008) [2023-12-28 01:37:09,606][106226] Updated weights for policy 0, policy_version 885764 (0.0010) [2023-12-28 01:37:09,619][106225] Updated weights for policy 1, policy_version 887885 (0.0009) [2023-12-28 01:37:09,670][106225] Updated weights for policy 1, policy_version 887895 (0.0007) [2023-12-28 01:37:10,327][106226] Updated weights for policy 0, policy_version 885774 (0.0011) [2023-12-28 01:37:10,363][106225] Updated weights for policy 1, policy_version 887905 (0.0007) [2023-12-28 01:37:10,384][106226] Updated weights for policy 0, policy_version 885784 (0.0010) [2023-12-28 01:37:10,427][106225] Updated weights for policy 1, policy_version 887915 (0.0007) [2023-12-28 01:37:10,447][106226] Updated weights for policy 0, policy_version 885794 (0.0011) [2023-12-28 01:37:10,484][106225] Updated weights for policy 1, policy_version 887925 (0.0006) [2023-12-28 01:37:10,538][106225] Updated weights for policy 1, policy_version 887935 (0.0007) [2023-12-28 01:37:11,163][106226] Updated weights for policy 0, policy_version 885804 (0.0010) [2023-12-28 01:37:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 454172672. Throughput: 0: 10055.2, 1: 9817.8. Samples: 454150136. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:11,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.624')] [2023-12-28 01:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000887936_227352576.pth... [2023-12-28 01:37:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000886816_227065856.pth [2023-12-28 01:37:11,234][106226] Updated weights for policy 0, policy_version 885814 (0.0010) [2023-12-28 01:37:11,286][106225] Updated weights for policy 1, policy_version 887945 (0.0010) [2023-12-28 01:37:11,306][106226] Updated weights for policy 0, policy_version 885824 (0.0009) [2023-12-28 01:37:11,354][106225] Updated weights for policy 1, policy_version 887955 (0.0011) [2023-12-28 01:37:11,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000885832_226828288.pth... [2023-12-28 01:37:11,362][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000884616_226516992.pth [2023-12-28 01:37:11,437][106225] Updated weights for policy 1, policy_version 887965 (0.0017) [2023-12-28 01:37:12,079][106226] Updated weights for policy 0, policy_version 885834 (0.0009) [2023-12-28 01:37:12,142][106226] Updated weights for policy 0, policy_version 885844 (0.0006) [2023-12-28 01:37:12,205][106225] Updated weights for policy 1, policy_version 887975 (0.0011) [2023-12-28 01:37:12,209][106226] Updated weights for policy 0, policy_version 885854 (0.0007) [2023-12-28 01:37:12,272][106225] Updated weights for policy 1, policy_version 887985 (0.0011) [2023-12-28 01:37:12,287][106226] Updated weights for policy 0, policy_version 885864 (0.0006) [2023-12-28 01:37:12,340][106225] Updated weights for policy 1, policy_version 887995 (0.0012) [2023-12-28 01:37:12,944][106226] Updated weights for policy 0, policy_version 885874 (0.0009) [2023-12-28 01:37:13,008][106226] Updated weights for policy 0, policy_version 885884 (0.0009) [2023-12-28 01:37:13,055][106225] Updated weights for policy 1, policy_version 888005 (0.0008) [2023-12-28 01:37:13,065][106226] Updated weights for policy 0, policy_version 885894 (0.0008) [2023-12-28 01:37:13,104][106225] Updated weights for policy 1, policy_version 888015 (0.0006) [2023-12-28 01:37:13,156][106225] Updated weights for policy 1, policy_version 888025 (0.0008) [2023-12-28 01:37:13,766][106226] Updated weights for policy 0, policy_version 885904 (0.0008) [2023-12-28 01:37:13,811][106225] Updated weights for policy 1, policy_version 888035 (0.0008) [2023-12-28 01:37:13,830][106226] Updated weights for policy 0, policy_version 885914 (0.0008) [2023-12-28 01:37:13,872][106225] Updated weights for policy 1, policy_version 888045 (0.0005) [2023-12-28 01:37:13,883][106226] Updated weights for policy 0, policy_version 885924 (0.0008) [2023-12-28 01:37:13,936][106225] Updated weights for policy 1, policy_version 888055 (0.0009) [2023-12-28 01:37:14,588][106226] Updated weights for policy 0, policy_version 885934 (0.0008) [2023-12-28 01:37:14,594][106225] Updated weights for policy 1, policy_version 888065 (0.0008) [2023-12-28 01:37:14,650][106226] Updated weights for policy 0, policy_version 885944 (0.0008) [2023-12-28 01:37:14,660][106225] Updated weights for policy 1, policy_version 888075 (0.0008) [2023-12-28 01:37:14,707][106226] Updated weights for policy 0, policy_version 885954 (0.0006) [2023-12-28 01:37:14,716][106225] Updated weights for policy 1, policy_version 888085 (0.0008) [2023-12-28 01:37:14,773][106225] Updated weights for policy 1, policy_version 888095 (0.0008) [2023-12-28 01:37:15,470][106226] Updated weights for policy 0, policy_version 885964 (0.0007) [2023-12-28 01:37:15,529][106226] Updated weights for policy 0, policy_version 885974 (0.0007) [2023-12-28 01:37:15,546][106225] Updated weights for policy 1, policy_version 888105 (0.0007) [2023-12-28 01:37:15,585][106226] Updated weights for policy 0, policy_version 885984 (0.0006) [2023-12-28 01:37:15,603][106225] Updated weights for policy 1, policy_version 888115 (0.0006) [2023-12-28 01:37:15,659][106225] Updated weights for policy 1, policy_version 888125 (0.0007) [2023-12-28 01:37:16,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 454270976. Throughput: 0: 10019.2, 1: 9715.2. Samples: 454263840. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:16,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.841')] [2023-12-28 01:37:16,293][106225] Updated weights for policy 1, policy_version 888135 (0.0008) [2023-12-28 01:37:16,323][106226] Updated weights for policy 0, policy_version 885994 (0.0007) [2023-12-28 01:37:16,348][106225] Updated weights for policy 1, policy_version 888145 (0.0008) [2023-12-28 01:37:16,389][106226] Updated weights for policy 0, policy_version 886004 (0.0007) [2023-12-28 01:37:16,395][106225] Updated weights for policy 1, policy_version 888155 (0.0007) [2023-12-28 01:37:16,450][106226] Updated weights for policy 0, policy_version 886014 (0.0009) [2023-12-28 01:37:16,517][106226] Updated weights for policy 0, policy_version 886024 (0.0009) [2023-12-28 01:37:17,151][106226] Updated weights for policy 0, policy_version 886034 (0.0008) [2023-12-28 01:37:17,167][106225] Updated weights for policy 1, policy_version 888165 (0.0008) [2023-12-28 01:37:17,201][106226] Updated weights for policy 0, policy_version 886044 (0.0006) [2023-12-28 01:37:17,221][106225] Updated weights for policy 1, policy_version 888175 (0.0009) [2023-12-28 01:37:17,250][106226] Updated weights for policy 0, policy_version 886054 (0.0008) [2023-12-28 01:37:17,282][106225] Updated weights for policy 1, policy_version 888185 (0.0010) [2023-12-28 01:37:17,882][106225] Updated weights for policy 1, policy_version 888195 (0.0007) [2023-12-28 01:37:17,941][106225] Updated weights for policy 1, policy_version 888205 (0.0005) [2023-12-28 01:37:17,997][106225] Updated weights for policy 1, policy_version 888215 (0.0009) [2023-12-28 01:37:18,041][106226] Updated weights for policy 0, policy_version 886064 (0.0006) [2023-12-28 01:37:18,104][106226] Updated weights for policy 0, policy_version 886074 (0.0008) [2023-12-28 01:37:18,171][106226] Updated weights for policy 0, policy_version 886084 (0.0008) [2023-12-28 01:37:18,647][106225] Updated weights for policy 1, policy_version 888225 (0.0010) [2023-12-28 01:37:18,708][106225] Updated weights for policy 1, policy_version 888235 (0.0011) [2023-12-28 01:37:18,773][106225] Updated weights for policy 1, policy_version 888245 (0.0010) [2023-12-28 01:37:18,833][106225] Updated weights for policy 1, policy_version 888255 (0.0010) [2023-12-28 01:37:18,910][106226] Updated weights for policy 0, policy_version 886094 (0.0008) [2023-12-28 01:37:18,960][106226] Updated weights for policy 0, policy_version 886104 (0.0007) [2023-12-28 01:37:19,017][106226] Updated weights for policy 0, policy_version 886114 (0.0008) [2023-12-28 01:37:19,526][106225] Updated weights for policy 1, policy_version 888265 (0.0008) [2023-12-28 01:37:19,598][106225] Updated weights for policy 1, policy_version 888275 (0.0009) [2023-12-28 01:37:19,666][106225] Updated weights for policy 1, policy_version 888285 (0.0009) [2023-12-28 01:37:19,765][106226] Updated weights for policy 0, policy_version 886124 (0.0008) [2023-12-28 01:37:19,828][106226] Updated weights for policy 0, policy_version 886134 (0.0008) [2023-12-28 01:37:19,897][106226] Updated weights for policy 0, policy_version 886144 (0.0009) [2023-12-28 01:37:20,350][106225] Updated weights for policy 1, policy_version 888295 (0.0006) [2023-12-28 01:37:20,410][106225] Updated weights for policy 1, policy_version 888305 (0.0008) [2023-12-28 01:37:20,472][106225] Updated weights for policy 1, policy_version 888315 (0.0009) [2023-12-28 01:37:20,690][106226] Updated weights for policy 0, policy_version 886154 (0.0008) [2023-12-28 01:37:20,755][106226] Updated weights for policy 0, policy_version 886164 (0.0006) [2023-12-28 01:37:20,818][106226] Updated weights for policy 0, policy_version 886174 (0.0008) [2023-12-28 01:37:20,878][106226] Updated weights for policy 0, policy_version 886184 (0.0008) [2023-12-28 01:37:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 454369280. Throughput: 0: 9973.2, 1: 9663.1. Samples: 454380924. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:21,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.823')] [2023-12-28 01:37:21,210][106225] Updated weights for policy 1, policy_version 888325 (0.0009) [2023-12-28 01:37:21,275][106225] Updated weights for policy 1, policy_version 888335 (0.0008) [2023-12-28 01:37:21,369][106225] Updated weights for policy 1, policy_version 888345 (0.0009) [2023-12-28 01:37:21,629][106226] Updated weights for policy 0, policy_version 886194 (0.0007) [2023-12-28 01:37:21,694][106226] Updated weights for policy 0, policy_version 886204 (0.0007) [2023-12-28 01:37:21,766][106226] Updated weights for policy 0, policy_version 886214 (0.0011) [2023-12-28 01:37:22,056][106225] Updated weights for policy 1, policy_version 888355 (0.0008) [2023-12-28 01:37:22,105][106225] Updated weights for policy 1, policy_version 888365 (0.0008) [2023-12-28 01:37:22,160][106225] Updated weights for policy 1, policy_version 888375 (0.0008) [2023-12-28 01:37:22,524][106226] Updated weights for policy 0, policy_version 886224 (0.0010) [2023-12-28 01:37:22,593][106226] Updated weights for policy 0, policy_version 886234 (0.0007) [2023-12-28 01:37:22,669][106226] Updated weights for policy 0, policy_version 886244 (0.0006) [2023-12-28 01:37:22,875][106225] Updated weights for policy 1, policy_version 888385 (0.0008) [2023-12-28 01:37:22,933][106225] Updated weights for policy 1, policy_version 888395 (0.0006) [2023-12-28 01:37:22,991][106225] Updated weights for policy 1, policy_version 888405 (0.0010) [2023-12-28 01:37:23,045][106225] Updated weights for policy 1, policy_version 888415 (0.0010) [2023-12-28 01:37:23,253][106226] Updated weights for policy 0, policy_version 886254 (0.0005) [2023-12-28 01:37:23,310][106226] Updated weights for policy 0, policy_version 886264 (0.0006) [2023-12-28 01:37:23,364][106226] Updated weights for policy 0, policy_version 886274 (0.0005) [2023-12-28 01:37:23,734][106225] Updated weights for policy 1, policy_version 888425 (0.0010) [2023-12-28 01:37:23,797][106225] Updated weights for policy 1, policy_version 888435 (0.0010) [2023-12-28 01:37:23,857][106225] Updated weights for policy 1, policy_version 888445 (0.0010) [2023-12-28 01:37:23,968][106226] Updated weights for policy 0, policy_version 886284 (0.0008) [2023-12-28 01:37:24,024][106226] Updated weights for policy 0, policy_version 886294 (0.0008) [2023-12-28 01:37:24,082][106226] Updated weights for policy 0, policy_version 886304 (0.0006) [2023-12-28 01:37:24,503][106225] Updated weights for policy 1, policy_version 888455 (0.0007) [2023-12-28 01:37:24,566][106225] Updated weights for policy 1, policy_version 888465 (0.0005) [2023-12-28 01:37:24,616][106225] Updated weights for policy 1, policy_version 888475 (0.0005) [2023-12-28 01:37:24,708][106226] Updated weights for policy 0, policy_version 886314 (0.0007) [2023-12-28 01:37:24,773][106226] Updated weights for policy 0, policy_version 886324 (0.0011) [2023-12-28 01:37:24,829][106226] Updated weights for policy 0, policy_version 886334 (0.0011) [2023-12-28 01:37:24,875][106226] Updated weights for policy 0, policy_version 886344 (0.0010) [2023-12-28 01:37:25,174][106225] Updated weights for policy 1, policy_version 888485 (0.0005) [2023-12-28 01:37:25,234][106225] Updated weights for policy 1, policy_version 888495 (0.0005) [2023-12-28 01:37:25,289][106225] Updated weights for policy 1, policy_version 888505 (0.0008) [2023-12-28 01:37:25,532][106226] Updated weights for policy 0, policy_version 886354 (0.0011) [2023-12-28 01:37:25,596][106226] Updated weights for policy 0, policy_version 886364 (0.0010) [2023-12-28 01:37:25,663][106226] Updated weights for policy 0, policy_version 886374 (0.0011) [2023-12-28 01:37:25,979][106225] Updated weights for policy 1, policy_version 888515 (0.0008) [2023-12-28 01:37:26,037][106225] Updated weights for policy 1, policy_version 888525 (0.0008) [2023-12-28 01:37:26,095][106225] Updated weights for policy 1, policy_version 888535 (0.0008) [2023-12-28 01:37:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 454475776. Throughput: 0: 9976.6, 1: 9644.5. Samples: 454440336. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:26,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.944')] [2023-12-28 01:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000886376_226967552.pth... [2023-12-28 01:37:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000888544_227508224.pth... [2023-12-28 01:37:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000887392_227213312.pth [2023-12-28 01:37:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000885224_226672640.pth [2023-12-28 01:37:26,349][106226] Updated weights for policy 0, policy_version 886384 (0.0010) [2023-12-28 01:37:26,408][106226] Updated weights for policy 0, policy_version 886394 (0.0011) [2023-12-28 01:37:26,462][106226] Updated weights for policy 0, policy_version 886404 (0.0010) [2023-12-28 01:37:26,771][106225] Updated weights for policy 1, policy_version 888545 (0.0008) [2023-12-28 01:37:26,824][106225] Updated weights for policy 1, policy_version 888555 (0.0006) [2023-12-28 01:37:26,888][106225] Updated weights for policy 1, policy_version 888565 (0.0005) [2023-12-28 01:37:26,954][106225] Updated weights for policy 1, policy_version 888575 (0.0005) [2023-12-28 01:37:27,112][106226] Updated weights for policy 0, policy_version 886414 (0.0011) [2023-12-28 01:37:27,172][106226] Updated weights for policy 0, policy_version 886424 (0.0011) [2023-12-28 01:37:27,229][106226] Updated weights for policy 0, policy_version 886434 (0.0011) [2023-12-28 01:37:27,575][106225] Updated weights for policy 1, policy_version 888585 (0.0005) [2023-12-28 01:37:27,623][106225] Updated weights for policy 1, policy_version 888595 (0.0005) [2023-12-28 01:37:27,674][106225] Updated weights for policy 1, policy_version 888605 (0.0005) [2023-12-28 01:37:27,905][106226] Updated weights for policy 0, policy_version 886444 (0.0011) [2023-12-28 01:37:27,974][106226] Updated weights for policy 0, policy_version 886454 (0.0011) [2023-12-28 01:37:28,033][106226] Updated weights for policy 0, policy_version 886464 (0.0011) [2023-12-28 01:37:28,209][106225] Updated weights for policy 1, policy_version 888615 (0.0005) [2023-12-28 01:37:28,266][106225] Updated weights for policy 1, policy_version 888625 (0.0005) [2023-12-28 01:37:28,343][106225] Updated weights for policy 1, policy_version 888635 (0.0007) [2023-12-28 01:37:28,760][106226] Updated weights for policy 0, policy_version 886474 (0.0011) [2023-12-28 01:37:28,826][106226] Updated weights for policy 0, policy_version 886484 (0.0010) [2023-12-28 01:37:28,890][106226] Updated weights for policy 0, policy_version 886494 (0.0011) [2023-12-28 01:37:28,918][106225] Updated weights for policy 1, policy_version 888645 (0.0007) [2023-12-28 01:37:28,960][106226] Updated weights for policy 0, policy_version 886504 (0.0011) [2023-12-28 01:37:28,975][106225] Updated weights for policy 1, policy_version 888655 (0.0005) [2023-12-28 01:37:29,037][106225] Updated weights for policy 1, policy_version 888665 (0.0007) [2023-12-28 01:37:29,667][106226] Updated weights for policy 0, policy_version 886514 (0.0008) [2023-12-28 01:37:29,673][106225] Updated weights for policy 1, policy_version 888675 (0.0007) [2023-12-28 01:37:29,721][106226] Updated weights for policy 0, policy_version 886524 (0.0006) [2023-12-28 01:37:29,737][106225] Updated weights for policy 1, policy_version 888685 (0.0008) [2023-12-28 01:37:29,782][106226] Updated weights for policy 0, policy_version 886534 (0.0008) [2023-12-28 01:37:29,800][106225] Updated weights for policy 1, policy_version 888695 (0.0006) [2023-12-28 01:37:30,415][106225] Updated weights for policy 1, policy_version 888705 (0.0008) [2023-12-28 01:37:30,475][106225] Updated weights for policy 1, policy_version 888715 (0.0007) [2023-12-28 01:37:30,500][106226] Updated weights for policy 0, policy_version 886544 (0.0008) [2023-12-28 01:37:30,530][106225] Updated weights for policy 1, policy_version 888725 (0.0006) [2023-12-28 01:37:30,547][106226] Updated weights for policy 0, policy_version 886554 (0.0005) [2023-12-28 01:37:30,585][106225] Updated weights for policy 1, policy_version 888735 (0.0007) [2023-12-28 01:37:30,606][106226] Updated weights for policy 0, policy_version 886564 (0.0009) [2023-12-28 01:37:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 454574080. Throughput: 0: 10062.6, 1: 9850.8. Samples: 454566688. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:31,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.676')] [2023-12-28 01:37:31,269][106225] Updated weights for policy 1, policy_version 888745 (0.0008) [2023-12-28 01:37:31,327][106225] Updated weights for policy 1, policy_version 888755 (0.0008) [2023-12-28 01:37:31,393][106225] Updated weights for policy 1, policy_version 888765 (0.0007) [2023-12-28 01:37:31,412][106226] Updated weights for policy 0, policy_version 886574 (0.0008) [2023-12-28 01:37:31,464][106226] Updated weights for policy 0, policy_version 886584 (0.0009) [2023-12-28 01:37:31,512][106226] Updated weights for policy 0, policy_version 886594 (0.0008) [2023-12-28 01:37:32,002][106225] Updated weights for policy 1, policy_version 888775 (0.0007) [2023-12-28 01:37:32,066][106225] Updated weights for policy 1, policy_version 888785 (0.0010) [2023-12-28 01:37:32,123][106225] Updated weights for policy 1, policy_version 888795 (0.0010) [2023-12-28 01:37:32,343][106226] Updated weights for policy 0, policy_version 886604 (0.0009) [2023-12-28 01:37:32,410][106226] Updated weights for policy 0, policy_version 886614 (0.0008) [2023-12-28 01:37:32,475][106226] Updated weights for policy 0, policy_version 886624 (0.0007) [2023-12-28 01:37:32,843][106225] Updated weights for policy 1, policy_version 888805 (0.0008) [2023-12-28 01:37:32,910][106225] Updated weights for policy 1, policy_version 888815 (0.0005) [2023-12-28 01:37:32,967][106225] Updated weights for policy 1, policy_version 888825 (0.0008) [2023-12-28 01:37:33,060][106226] Updated weights for policy 0, policy_version 886634 (0.0006) [2023-12-28 01:37:33,111][106226] Updated weights for policy 0, policy_version 886644 (0.0007) [2023-12-28 01:37:33,158][106226] Updated weights for policy 0, policy_version 886654 (0.0008) [2023-12-28 01:37:33,206][106226] Updated weights for policy 0, policy_version 886664 (0.0008) [2023-12-28 01:37:33,651][106225] Updated weights for policy 1, policy_version 888835 (0.0008) [2023-12-28 01:37:33,701][106225] Updated weights for policy 1, policy_version 888845 (0.0008) [2023-12-28 01:37:33,749][106225] Updated weights for policy 1, policy_version 888855 (0.0008) [2023-12-28 01:37:33,920][106226] Updated weights for policy 0, policy_version 886674 (0.0005) [2023-12-28 01:37:33,972][106226] Updated weights for policy 0, policy_version 886684 (0.0005) [2023-12-28 01:37:34,030][106226] Updated weights for policy 0, policy_version 886694 (0.0008) [2023-12-28 01:37:34,501][106225] Updated weights for policy 1, policy_version 888865 (0.0006) [2023-12-28 01:37:34,559][106225] Updated weights for policy 1, policy_version 888875 (0.0009) [2023-12-28 01:37:34,622][106225] Updated weights for policy 1, policy_version 888885 (0.0008) [2023-12-28 01:37:34,656][106226] Updated weights for policy 0, policy_version 886704 (0.0008) [2023-12-28 01:37:34,686][106225] Updated weights for policy 1, policy_version 888895 (0.0009) [2023-12-28 01:37:34,714][106226] Updated weights for policy 0, policy_version 886714 (0.0007) [2023-12-28 01:37:34,770][106226] Updated weights for policy 0, policy_version 886724 (0.0006) [2023-12-28 01:37:35,411][106226] Updated weights for policy 0, policy_version 886734 (0.0006) [2023-12-28 01:37:35,452][106225] Updated weights for policy 1, policy_version 888905 (0.0006) [2023-12-28 01:37:35,470][106226] Updated weights for policy 0, policy_version 886744 (0.0007) [2023-12-28 01:37:35,510][106225] Updated weights for policy 1, policy_version 888915 (0.0007) [2023-12-28 01:37:35,531][106226] Updated weights for policy 0, policy_version 886754 (0.0005) [2023-12-28 01:37:35,559][106225] Updated weights for policy 1, policy_version 888925 (0.0008) [2023-12-28 01:37:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 454672384. Throughput: 0: 10090.2, 1: 9859.4. Samples: 454686632. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:36,176][105115] Avg episode reward: [(0, '-4.375'), (1, '-4.613')] [2023-12-28 01:37:36,201][106226] Updated weights for policy 0, policy_version 886764 (0.0005) [2023-12-28 01:37:36,258][106226] Updated weights for policy 0, policy_version 886774 (0.0006) [2023-12-28 01:37:36,315][106225] Updated weights for policy 1, policy_version 888935 (0.0007) [2023-12-28 01:37:36,319][106226] Updated weights for policy 0, policy_version 886784 (0.0006) [2023-12-28 01:37:36,376][106225] Updated weights for policy 1, policy_version 888945 (0.0008) [2023-12-28 01:37:36,435][106225] Updated weights for policy 1, policy_version 888955 (0.0008) [2023-12-28 01:37:37,051][106226] Updated weights for policy 0, policy_version 886794 (0.0006) [2023-12-28 01:37:37,111][106226] Updated weights for policy 0, policy_version 886804 (0.0009) [2023-12-28 01:37:37,132][106225] Updated weights for policy 1, policy_version 888965 (0.0008) [2023-12-28 01:37:37,170][106226] Updated weights for policy 0, policy_version 886814 (0.0006) [2023-12-28 01:37:37,180][106225] Updated weights for policy 1, policy_version 888975 (0.0006) [2023-12-28 01:37:37,223][106226] Updated weights for policy 0, policy_version 886824 (0.0007) [2023-12-28 01:37:37,232][106225] Updated weights for policy 1, policy_version 888985 (0.0007) [2023-12-28 01:37:37,900][106225] Updated weights for policy 1, policy_version 888995 (0.0007) [2023-12-28 01:37:37,967][106225] Updated weights for policy 1, policy_version 889005 (0.0005) [2023-12-28 01:37:37,969][106226] Updated weights for policy 0, policy_version 886834 (0.0008) [2023-12-28 01:37:38,025][106226] Updated weights for policy 0, policy_version 886844 (0.0008) [2023-12-28 01:37:38,031][106225] Updated weights for policy 1, policy_version 889015 (0.0005) [2023-12-28 01:37:38,081][106226] Updated weights for policy 0, policy_version 886854 (0.0007) [2023-12-28 01:37:38,613][106225] Updated weights for policy 1, policy_version 889025 (0.0005) [2023-12-28 01:37:38,667][106225] Updated weights for policy 1, policy_version 889035 (0.0005) [2023-12-28 01:37:38,727][106225] Updated weights for policy 1, policy_version 889045 (0.0007) [2023-12-28 01:37:38,785][106225] Updated weights for policy 1, policy_version 889055 (0.0006) [2023-12-28 01:37:38,879][106226] Updated weights for policy 0, policy_version 886864 (0.0008) [2023-12-28 01:37:38,938][106226] Updated weights for policy 0, policy_version 886874 (0.0009) [2023-12-28 01:37:38,997][106226] Updated weights for policy 0, policy_version 886884 (0.0008) [2023-12-28 01:37:39,511][106225] Updated weights for policy 1, policy_version 889065 (0.0009) [2023-12-28 01:37:39,569][106225] Updated weights for policy 1, policy_version 889075 (0.0009) [2023-12-28 01:37:39,631][106225] Updated weights for policy 1, policy_version 889085 (0.0008) [2023-12-28 01:37:39,746][106226] Updated weights for policy 0, policy_version 886894 (0.0008) [2023-12-28 01:37:39,806][106226] Updated weights for policy 0, policy_version 886904 (0.0009) [2023-12-28 01:37:39,874][106226] Updated weights for policy 0, policy_version 886914 (0.0007) [2023-12-28 01:37:40,430][106225] Updated weights for policy 1, policy_version 889095 (0.0008) [2023-12-28 01:37:40,497][106225] Updated weights for policy 1, policy_version 889105 (0.0009) [2023-12-28 01:37:40,550][106225] Updated weights for policy 1, policy_version 889115 (0.0007) [2023-12-28 01:37:40,590][106226] Updated weights for policy 0, policy_version 886924 (0.0008) [2023-12-28 01:37:40,643][106226] Updated weights for policy 0, policy_version 886934 (0.0007) [2023-12-28 01:37:40,695][106226] Updated weights for policy 0, policy_version 886944 (0.0009) [2023-12-28 01:37:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 454770688. Throughput: 0: 10052.1, 1: 9930.0. Samples: 454745136. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:41,175][105115] Avg episode reward: [(0, '-3.993'), (1, '-4.943')] [2023-12-28 01:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000889120_227655680.pth... [2023-12-28 01:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000886952_227115008.pth... [2023-12-28 01:37:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000885832_226828288.pth [2023-12-28 01:37:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000887936_227352576.pth [2023-12-28 01:37:41,236][106225] Updated weights for policy 1, policy_version 889125 (0.0009) [2023-12-28 01:37:41,299][106225] Updated weights for policy 1, policy_version 889135 (0.0009) [2023-12-28 01:37:41,376][106225] Updated weights for policy 1, policy_version 889145 (0.0009) [2023-12-28 01:37:41,484][106226] Updated weights for policy 0, policy_version 886954 (0.0008) [2023-12-28 01:37:41,546][106226] Updated weights for policy 0, policy_version 886964 (0.0006) [2023-12-28 01:37:41,616][106226] Updated weights for policy 0, policy_version 886974 (0.0007) [2023-12-28 01:37:41,682][106226] Updated weights for policy 0, policy_version 886984 (0.0007) [2023-12-28 01:37:42,183][106225] Updated weights for policy 1, policy_version 889155 (0.0009) [2023-12-28 01:37:42,241][106225] Updated weights for policy 1, policy_version 889165 (0.0010) [2023-12-28 01:37:42,308][106225] Updated weights for policy 1, policy_version 889175 (0.0011) [2023-12-28 01:37:42,374][106226] Updated weights for policy 0, policy_version 886994 (0.0006) [2023-12-28 01:37:42,423][106226] Updated weights for policy 0, policy_version 887004 (0.0008) [2023-12-28 01:37:42,481][106226] Updated weights for policy 0, policy_version 887014 (0.0008) [2023-12-28 01:37:43,091][106225] Updated weights for policy 1, policy_version 889185 (0.0011) [2023-12-28 01:37:43,137][106226] Updated weights for policy 0, policy_version 887024 (0.0007) [2023-12-28 01:37:43,151][106225] Updated weights for policy 1, policy_version 889195 (0.0007) [2023-12-28 01:37:43,190][106226] Updated weights for policy 0, policy_version 887034 (0.0006) [2023-12-28 01:37:43,209][106225] Updated weights for policy 1, policy_version 889205 (0.0008) [2023-12-28 01:37:43,237][106226] Updated weights for policy 0, policy_version 887044 (0.0007) [2023-12-28 01:37:43,269][106225] Updated weights for policy 1, policy_version 889215 (0.0005) [2023-12-28 01:37:43,826][106225] Updated weights for policy 1, policy_version 889225 (0.0006) [2023-12-28 01:37:43,877][106225] Updated weights for policy 1, policy_version 889235 (0.0008) [2023-12-28 01:37:43,924][106226] Updated weights for policy 0, policy_version 887054 (0.0006) [2023-12-28 01:37:43,930][106225] Updated weights for policy 1, policy_version 889245 (0.0007) [2023-12-28 01:37:43,973][106226] Updated weights for policy 0, policy_version 887064 (0.0007) [2023-12-28 01:37:44,020][106226] Updated weights for policy 0, policy_version 887074 (0.0008) [2023-12-28 01:37:44,658][106225] Updated weights for policy 1, policy_version 889255 (0.0008) [2023-12-28 01:37:44,717][106225] Updated weights for policy 1, policy_version 889265 (0.0009) [2023-12-28 01:37:44,737][106226] Updated weights for policy 0, policy_version 887084 (0.0007) [2023-12-28 01:37:44,768][106225] Updated weights for policy 1, policy_version 889275 (0.0008) [2023-12-28 01:37:44,800][106226] Updated weights for policy 0, policy_version 887094 (0.0007) [2023-12-28 01:37:44,871][106226] Updated weights for policy 0, policy_version 887104 (0.0008) [2023-12-28 01:37:45,542][106225] Updated weights for policy 1, policy_version 889285 (0.0007) [2023-12-28 01:37:45,611][106225] Updated weights for policy 1, policy_version 889295 (0.0009) [2023-12-28 01:37:45,613][106226] Updated weights for policy 0, policy_version 887114 (0.0007) [2023-12-28 01:37:45,659][106225] Updated weights for policy 1, policy_version 889305 (0.0006) [2023-12-28 01:37:45,665][106226] Updated weights for policy 0, policy_version 887124 (0.0008) [2023-12-28 01:37:45,713][106226] Updated weights for policy 0, policy_version 887134 (0.0007) [2023-12-28 01:37:45,759][106226] Updated weights for policy 0, policy_version 887144 (0.0008) [2023-12-28 01:37:46,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 454868992. Throughput: 0: 9943.8, 1: 9965.1. Samples: 454860276. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:46,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.917')] [2023-12-28 01:37:46,303][106225] Updated weights for policy 1, policy_version 889315 (0.0008) [2023-12-28 01:37:46,354][106225] Updated weights for policy 1, policy_version 889325 (0.0006) [2023-12-28 01:37:46,416][106226] Updated weights for policy 0, policy_version 887154 (0.0005) [2023-12-28 01:37:46,416][106225] Updated weights for policy 1, policy_version 889335 (0.0009) [2023-12-28 01:37:46,471][106226] Updated weights for policy 0, policy_version 887164 (0.0007) [2023-12-28 01:37:46,516][106226] Updated weights for policy 0, policy_version 887174 (0.0008) [2023-12-28 01:37:47,104][106225] Updated weights for policy 1, policy_version 889345 (0.0006) [2023-12-28 01:37:47,159][106225] Updated weights for policy 1, policy_version 889355 (0.0008) [2023-12-28 01:37:47,213][106225] Updated weights for policy 1, policy_version 889365 (0.0008) [2023-12-28 01:37:47,258][106226] Updated weights for policy 0, policy_version 887184 (0.0007) [2023-12-28 01:37:47,268][106225] Updated weights for policy 1, policy_version 889375 (0.0006) [2023-12-28 01:37:47,316][106226] Updated weights for policy 0, policy_version 887194 (0.0008) [2023-12-28 01:37:47,378][106226] Updated weights for policy 0, policy_version 887204 (0.0009) [2023-12-28 01:37:47,975][106225] Updated weights for policy 1, policy_version 889385 (0.0008) [2023-12-28 01:37:48,036][106225] Updated weights for policy 1, policy_version 889395 (0.0008) [2023-12-28 01:37:48,084][106225] Updated weights for policy 1, policy_version 889405 (0.0010) [2023-12-28 01:37:48,123][106226] Updated weights for policy 0, policy_version 887214 (0.0010) [2023-12-28 01:37:48,177][106226] Updated weights for policy 0, policy_version 887224 (0.0011) [2023-12-28 01:37:48,236][106226] Updated weights for policy 0, policy_version 887234 (0.0011) [2023-12-28 01:37:48,725][106225] Updated weights for policy 1, policy_version 889415 (0.0010) [2023-12-28 01:37:48,776][106225] Updated weights for policy 1, policy_version 889425 (0.0010) [2023-12-28 01:37:48,828][106225] Updated weights for policy 1, policy_version 889435 (0.0010) [2023-12-28 01:37:48,977][106226] Updated weights for policy 0, policy_version 887244 (0.0011) [2023-12-28 01:37:49,035][106226] Updated weights for policy 0, policy_version 887254 (0.0010) [2023-12-28 01:37:49,092][106226] Updated weights for policy 0, policy_version 887264 (0.0010) [2023-12-28 01:37:49,583][106225] Updated weights for policy 1, policy_version 889445 (0.0010) [2023-12-28 01:37:49,641][106225] Updated weights for policy 1, policy_version 889455 (0.0010) [2023-12-28 01:37:49,696][106225] Updated weights for policy 1, policy_version 889465 (0.0010) [2023-12-28 01:37:49,825][106226] Updated weights for policy 0, policy_version 887274 (0.0010) [2023-12-28 01:37:49,887][106226] Updated weights for policy 0, policy_version 887284 (0.0008) [2023-12-28 01:37:49,942][106226] Updated weights for policy 0, policy_version 887294 (0.0011) [2023-12-28 01:37:50,008][106226] Updated weights for policy 0, policy_version 887304 (0.0011) [2023-12-28 01:37:50,425][106225] Updated weights for policy 1, policy_version 889475 (0.0010) [2023-12-28 01:37:50,479][106225] Updated weights for policy 1, policy_version 889485 (0.0008) [2023-12-28 01:37:50,535][106225] Updated weights for policy 1, policy_version 889495 (0.0008) [2023-12-28 01:37:50,729][106226] Updated weights for policy 0, policy_version 887314 (0.0011) [2023-12-28 01:37:50,779][106226] Updated weights for policy 0, policy_version 887324 (0.0010) [2023-12-28 01:37:50,838][106226] Updated weights for policy 0, policy_version 887334 (0.0009) [2023-12-28 01:37:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 454967296. Throughput: 0: 9783.9, 1: 9979.9. Samples: 454977300. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:51,175][105115] Avg episode reward: [(0, '-4.185'), (1, '-4.853')] [2023-12-28 01:37:51,245][106225] Updated weights for policy 1, policy_version 889505 (0.0008) [2023-12-28 01:37:51,309][106225] Updated weights for policy 1, policy_version 889515 (0.0008) [2023-12-28 01:37:51,377][106225] Updated weights for policy 1, policy_version 889525 (0.0008) [2023-12-28 01:37:51,430][106225] Updated weights for policy 1, policy_version 889535 (0.0009) [2023-12-28 01:37:51,628][106226] Updated weights for policy 0, policy_version 887344 (0.0008) [2023-12-28 01:37:51,692][106226] Updated weights for policy 0, policy_version 887354 (0.0009) [2023-12-28 01:37:51,762][106226] Updated weights for policy 0, policy_version 887364 (0.0009) [2023-12-28 01:37:52,227][106225] Updated weights for policy 1, policy_version 889545 (0.0008) [2023-12-28 01:37:52,289][106225] Updated weights for policy 1, policy_version 889555 (0.0007) [2023-12-28 01:37:52,355][106225] Updated weights for policy 1, policy_version 889565 (0.0008) [2023-12-28 01:37:52,597][106226] Updated weights for policy 0, policy_version 887374 (0.0009) [2023-12-28 01:37:52,661][106226] Updated weights for policy 0, policy_version 887384 (0.0009) [2023-12-28 01:37:52,726][106226] Updated weights for policy 0, policy_version 887394 (0.0008) [2023-12-28 01:37:53,037][106225] Updated weights for policy 1, policy_version 889575 (0.0008) [2023-12-28 01:37:53,096][106225] Updated weights for policy 1, policy_version 889585 (0.0008) [2023-12-28 01:37:53,154][106225] Updated weights for policy 1, policy_version 889595 (0.0008) [2023-12-28 01:37:53,466][106226] Updated weights for policy 0, policy_version 887404 (0.0007) [2023-12-28 01:37:53,525][106226] Updated weights for policy 0, policy_version 887414 (0.0007) [2023-12-28 01:37:53,571][106226] Updated weights for policy 0, policy_version 887424 (0.0008) [2023-12-28 01:37:53,912][106225] Updated weights for policy 1, policy_version 889605 (0.0009) [2023-12-28 01:37:53,967][106225] Updated weights for policy 1, policy_version 889615 (0.0009) [2023-12-28 01:37:54,019][106225] Updated weights for policy 1, policy_version 889625 (0.0009) [2023-12-28 01:37:54,210][106226] Updated weights for policy 0, policy_version 887434 (0.0007) [2023-12-28 01:37:54,271][106226] Updated weights for policy 0, policy_version 887444 (0.0009) [2023-12-28 01:37:54,333][106226] Updated weights for policy 0, policy_version 887454 (0.0009) [2023-12-28 01:37:54,386][106226] Updated weights for policy 0, policy_version 887464 (0.0008) [2023-12-28 01:37:54,759][106225] Updated weights for policy 1, policy_version 889635 (0.0008) [2023-12-28 01:37:54,815][106225] Updated weights for policy 1, policy_version 889645 (0.0008) [2023-12-28 01:37:54,877][106225] Updated weights for policy 1, policy_version 889655 (0.0008) [2023-12-28 01:37:55,118][106226] Updated weights for policy 0, policy_version 887474 (0.0006) [2023-12-28 01:37:55,175][106226] Updated weights for policy 0, policy_version 887484 (0.0006) [2023-12-28 01:37:55,231][106226] Updated weights for policy 0, policy_version 887494 (0.0008) [2023-12-28 01:37:55,528][106225] Updated weights for policy 1, policy_version 889665 (0.0009) [2023-12-28 01:37:55,577][106225] Updated weights for policy 1, policy_version 889675 (0.0008) [2023-12-28 01:37:55,626][106225] Updated weights for policy 1, policy_version 889685 (0.0008) [2023-12-28 01:37:55,669][106225] Updated weights for policy 1, policy_version 889695 (0.0008) [2023-12-28 01:37:55,870][106226] Updated weights for policy 0, policy_version 887504 (0.0009) [2023-12-28 01:37:55,924][106226] Updated weights for policy 0, policy_version 887514 (0.0008) [2023-12-28 01:37:55,988][106226] Updated weights for policy 0, policy_version 887524 (0.0009) [2023-12-28 01:37:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 455065600. Throughput: 0: 9679.5, 1: 9960.7. Samples: 455033944. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:37:56,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.892')] [2023-12-28 01:37:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000889696_227803136.pth... [2023-12-28 01:37:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000887528_227262464.pth... [2023-12-28 01:37:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000886376_226967552.pth [2023-12-28 01:37:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000888544_227508224.pth [2023-12-28 01:37:56,381][106225] Updated weights for policy 1, policy_version 889705 (0.0008) [2023-12-28 01:37:56,428][106225] Updated weights for policy 1, policy_version 889715 (0.0008) [2023-12-28 01:37:56,481][106225] Updated weights for policy 1, policy_version 889725 (0.0010) [2023-12-28 01:37:56,692][106226] Updated weights for policy 0, policy_version 887534 (0.0009) [2023-12-28 01:37:56,744][106226] Updated weights for policy 0, policy_version 887544 (0.0008) [2023-12-28 01:37:56,803][106226] Updated weights for policy 0, policy_version 887554 (0.0008) [2023-12-28 01:37:57,210][106225] Updated weights for policy 1, policy_version 889735 (0.0010) [2023-12-28 01:37:57,262][106225] Updated weights for policy 1, policy_version 889745 (0.0010) [2023-12-28 01:37:57,309][106225] Updated weights for policy 1, policy_version 889755 (0.0010) [2023-12-28 01:37:57,386][106226] Updated weights for policy 0, policy_version 887564 (0.0006) [2023-12-28 01:37:57,443][106226] Updated weights for policy 0, policy_version 887574 (0.0008) [2023-12-28 01:37:57,499][106226] Updated weights for policy 0, policy_version 887584 (0.0008) [2023-12-28 01:37:57,966][106225] Updated weights for policy 1, policy_version 889765 (0.0008) [2023-12-28 01:37:58,020][106225] Updated weights for policy 1, policy_version 889775 (0.0005) [2023-12-28 01:37:58,085][106225] Updated weights for policy 1, policy_version 889785 (0.0005) [2023-12-28 01:37:58,243][106226] Updated weights for policy 0, policy_version 887594 (0.0008) [2023-12-28 01:37:58,308][106226] Updated weights for policy 0, policy_version 887604 (0.0011) [2023-12-28 01:37:58,374][106226] Updated weights for policy 0, policy_version 887614 (0.0011) [2023-12-28 01:37:58,440][106226] Updated weights for policy 0, policy_version 887624 (0.0010) [2023-12-28 01:37:58,761][106225] Updated weights for policy 1, policy_version 889795 (0.0006) [2023-12-28 01:37:58,836][106225] Updated weights for policy 1, policy_version 889805 (0.0009) [2023-12-28 01:37:58,916][106225] Updated weights for policy 1, policy_version 889815 (0.0010) [2023-12-28 01:37:59,276][106226] Updated weights for policy 0, policy_version 887634 (0.0009) [2023-12-28 01:37:59,347][106226] Updated weights for policy 0, policy_version 887644 (0.0010) [2023-12-28 01:37:59,408][106226] Updated weights for policy 0, policy_version 887654 (0.0009) [2023-12-28 01:37:59,613][106225] Updated weights for policy 1, policy_version 889825 (0.0007) [2023-12-28 01:37:59,674][106225] Updated weights for policy 1, policy_version 889835 (0.0008) [2023-12-28 01:37:59,733][106225] Updated weights for policy 1, policy_version 889845 (0.0008) [2023-12-28 01:37:59,797][106225] Updated weights for policy 1, policy_version 889855 (0.0008) [2023-12-28 01:38:00,156][106226] Updated weights for policy 0, policy_version 887664 (0.0009) [2023-12-28 01:38:00,212][106226] Updated weights for policy 0, policy_version 887674 (0.0008) [2023-12-28 01:38:00,276][106226] Updated weights for policy 0, policy_version 887684 (0.0006) [2023-12-28 01:38:00,557][106225] Updated weights for policy 1, policy_version 889865 (0.0009) [2023-12-28 01:38:00,604][106225] Updated weights for policy 1, policy_version 889875 (0.0008) [2023-12-28 01:38:00,661][106225] Updated weights for policy 1, policy_version 889885 (0.0008) [2023-12-28 01:38:00,967][106226] Updated weights for policy 0, policy_version 887694 (0.0007) [2023-12-28 01:38:01,013][106226] Updated weights for policy 0, policy_version 887704 (0.0008) [2023-12-28 01:38:01,073][106226] Updated weights for policy 0, policy_version 887714 (0.0009) [2023-12-28 01:38:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 455163904. Throughput: 0: 9724.7, 1: 10017.0. Samples: 455152220. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:38:01,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-4.995')] [2023-12-28 01:38:01,434][106225] Updated weights for policy 1, policy_version 889895 (0.0008) [2023-12-28 01:38:01,490][106225] Updated weights for policy 1, policy_version 889905 (0.0010) [2023-12-28 01:38:01,540][106225] Updated weights for policy 1, policy_version 889915 (0.0010) [2023-12-28 01:38:01,872][106226] Updated weights for policy 0, policy_version 887724 (0.0008) [2023-12-28 01:38:01,923][106226] Updated weights for policy 0, policy_version 887734 (0.0008) [2023-12-28 01:38:01,978][106226] Updated weights for policy 0, policy_version 887744 (0.0008) [2023-12-28 01:38:02,250][106225] Updated weights for policy 1, policy_version 889925 (0.0008) [2023-12-28 01:38:02,306][106225] Updated weights for policy 1, policy_version 889935 (0.0008) [2023-12-28 01:38:02,364][106225] Updated weights for policy 1, policy_version 889945 (0.0007) [2023-12-28 01:38:02,679][106226] Updated weights for policy 0, policy_version 887754 (0.0008) [2023-12-28 01:38:02,741][106226] Updated weights for policy 0, policy_version 887764 (0.0008) [2023-12-28 01:38:02,803][106226] Updated weights for policy 0, policy_version 887774 (0.0008) [2023-12-28 01:38:02,863][106226] Updated weights for policy 0, policy_version 887784 (0.0008) [2023-12-28 01:38:03,016][106225] Updated weights for policy 1, policy_version 889955 (0.0006) [2023-12-28 01:38:03,071][106225] Updated weights for policy 1, policy_version 889965 (0.0006) [2023-12-28 01:38:03,126][106225] Updated weights for policy 1, policy_version 889975 (0.0008) [2023-12-28 01:38:03,616][106226] Updated weights for policy 0, policy_version 887794 (0.0008) [2023-12-28 01:38:03,670][106226] Updated weights for policy 0, policy_version 887804 (0.0009) [2023-12-28 01:38:03,731][106226] Updated weights for policy 0, policy_version 887814 (0.0009) [2023-12-28 01:38:03,739][106225] Updated weights for policy 1, policy_version 889985 (0.0007) [2023-12-28 01:38:03,786][106225] Updated weights for policy 1, policy_version 889995 (0.0009) [2023-12-28 01:38:03,846][106225] Updated weights for policy 1, policy_version 890005 (0.0008) [2023-12-28 01:38:03,905][106225] Updated weights for policy 1, policy_version 890015 (0.0007) [2023-12-28 01:38:04,536][106226] Updated weights for policy 0, policy_version 887824 (0.0008) [2023-12-28 01:38:04,569][106225] Updated weights for policy 1, policy_version 890025 (0.0009) [2023-12-28 01:38:04,591][106226] Updated weights for policy 0, policy_version 887834 (0.0006) [2023-12-28 01:38:04,624][106225] Updated weights for policy 1, policy_version 890035 (0.0006) [2023-12-28 01:38:04,651][106226] Updated weights for policy 0, policy_version 887844 (0.0006) [2023-12-28 01:38:04,683][106225] Updated weights for policy 1, policy_version 890045 (0.0008) [2023-12-28 01:38:05,368][106226] Updated weights for policy 0, policy_version 887854 (0.0006) [2023-12-28 01:38:05,409][106225] Updated weights for policy 1, policy_version 890055 (0.0007) [2023-12-28 01:38:05,423][106226] Updated weights for policy 0, policy_version 887864 (0.0006) [2023-12-28 01:38:05,463][106225] Updated weights for policy 1, policy_version 890065 (0.0007) [2023-12-28 01:38:05,477][106226] Updated weights for policy 0, policy_version 887874 (0.0006) [2023-12-28 01:38:05,525][106225] Updated weights for policy 1, policy_version 890075 (0.0008) [2023-12-28 01:38:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19633.0). Total num frames: 455254016. Throughput: 0: 9730.0, 1: 9985.0. Samples: 455268100. Policy #0 lag: (min: 2.0, avg: 20.4, max: 34.0) [2023-12-28 01:38:06,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-5.031')] [2023-12-28 01:38:06,207][106226] Updated weights for policy 0, policy_version 887884 (0.0006) [2023-12-28 01:38:06,267][106226] Updated weights for policy 0, policy_version 887894 (0.0006) [2023-12-28 01:38:06,306][106225] Updated weights for policy 1, policy_version 890085 (0.0007) [2023-12-28 01:38:06,321][106226] Updated weights for policy 0, policy_version 887904 (0.0007) [2023-12-28 01:38:06,374][106225] Updated weights for policy 1, policy_version 890095 (0.0007) [2023-12-28 01:38:06,438][106225] Updated weights for policy 1, policy_version 890105 (0.0008) [2023-12-28 01:38:07,054][106226] Updated weights for policy 0, policy_version 887914 (0.0008) [2023-12-28 01:38:07,112][106226] Updated weights for policy 0, policy_version 887924 (0.0007) [2023-12-28 01:38:07,121][106225] Updated weights for policy 1, policy_version 890115 (0.0008) [2023-12-28 01:38:07,174][106226] Updated weights for policy 0, policy_version 887934 (0.0005) [2023-12-28 01:38:07,176][106225] Updated weights for policy 1, policy_version 890125 (0.0007) [2023-12-28 01:38:07,230][106226] Updated weights for policy 0, policy_version 887944 (0.0007) [2023-12-28 01:38:07,235][106225] Updated weights for policy 1, policy_version 890135 (0.0006) [2023-12-28 01:38:07,907][106225] Updated weights for policy 1, policy_version 890145 (0.0008) [2023-12-28 01:38:07,961][106225] Updated weights for policy 1, policy_version 890155 (0.0006) [2023-12-28 01:38:07,975][106226] Updated weights for policy 0, policy_version 887954 (0.0007) [2023-12-28 01:38:08,016][106225] Updated weights for policy 1, policy_version 890165 (0.0006) [2023-12-28 01:38:08,033][106226] Updated weights for policy 0, policy_version 887964 (0.0006) [2023-12-28 01:38:08,077][106225] Updated weights for policy 1, policy_version 890175 (0.0007) [2023-12-28 01:38:08,097][106226] Updated weights for policy 0, policy_version 887974 (0.0005) [2023-12-28 01:38:08,764][106225] Updated weights for policy 1, policy_version 890185 (0.0008) [2023-12-28 01:38:08,799][106226] Updated weights for policy 0, policy_version 887984 (0.0007) [2023-12-28 01:38:08,812][106225] Updated weights for policy 1, policy_version 890195 (0.0005) [2023-12-28 01:38:08,866][106225] Updated weights for policy 1, policy_version 890205 (0.0006) [2023-12-28 01:38:08,867][106226] Updated weights for policy 0, policy_version 887994 (0.0008) [2023-12-28 01:38:08,925][106226] Updated weights for policy 0, policy_version 888004 (0.0009) [2023-12-28 01:38:09,631][106225] Updated weights for policy 1, policy_version 890215 (0.0007) [2023-12-28 01:38:09,692][106226] Updated weights for policy 0, policy_version 888014 (0.0007) [2023-12-28 01:38:09,694][106225] Updated weights for policy 1, policy_version 890225 (0.0007) [2023-12-28 01:38:09,752][106226] Updated weights for policy 0, policy_version 888024 (0.0007) [2023-12-28 01:38:09,754][106225] Updated weights for policy 1, policy_version 890235 (0.0006) [2023-12-28 01:38:09,821][106226] Updated weights for policy 0, policy_version 888034 (0.0008) [2023-12-28 01:38:10,482][106225] Updated weights for policy 1, policy_version 890245 (0.0007) [2023-12-28 01:38:10,545][106225] Updated weights for policy 1, policy_version 890255 (0.0008) [2023-12-28 01:38:10,575][106226] Updated weights for policy 0, policy_version 888044 (0.0007) [2023-12-28 01:38:10,603][106225] Updated weights for policy 1, policy_version 890265 (0.0010) [2023-12-28 01:38:10,639][106226] Updated weights for policy 0, policy_version 888054 (0.0006) [2023-12-28 01:38:10,701][106226] Updated weights for policy 0, policy_version 888064 (0.0006) [2023-12-28 01:38:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 455352320. Throughput: 0: 9680.1, 1: 10006.6. Samples: 455326236. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:11,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.839')] [2023-12-28 01:38:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000890272_227950592.pth... [2023-12-28 01:38:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000888072_227401728.pth... [2023-12-28 01:38:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000889120_227655680.pth [2023-12-28 01:38:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000886952_227115008.pth [2023-12-28 01:38:11,293][106225] Updated weights for policy 1, policy_version 890275 (0.0007) [2023-12-28 01:38:11,357][106225] Updated weights for policy 1, policy_version 890285 (0.0008) [2023-12-28 01:38:11,418][106226] Updated weights for policy 0, policy_version 888074 (0.0007) [2023-12-28 01:38:11,443][106225] Updated weights for policy 1, policy_version 890295 (0.0010) [2023-12-28 01:38:11,479][106226] Updated weights for policy 0, policy_version 888084 (0.0007) [2023-12-28 01:38:11,532][106226] Updated weights for policy 0, policy_version 888094 (0.0008) [2023-12-28 01:38:11,579][106226] Updated weights for policy 0, policy_version 888104 (0.0009) [2023-12-28 01:38:12,195][106225] Updated weights for policy 1, policy_version 890305 (0.0006) [2023-12-28 01:38:12,246][106225] Updated weights for policy 1, policy_version 890315 (0.0009) [2023-12-28 01:38:12,310][106225] Updated weights for policy 1, policy_version 890325 (0.0010) [2023-12-28 01:38:12,345][106226] Updated weights for policy 0, policy_version 888114 (0.0006) [2023-12-28 01:38:12,376][106225] Updated weights for policy 1, policy_version 890335 (0.0009) [2023-12-28 01:38:12,414][106226] Updated weights for policy 0, policy_version 888124 (0.0008) [2023-12-28 01:38:12,479][106226] Updated weights for policy 0, policy_version 888134 (0.0007) [2023-12-28 01:38:13,124][106225] Updated weights for policy 1, policy_version 890345 (0.0009) [2023-12-28 01:38:13,179][106225] Updated weights for policy 1, policy_version 890355 (0.0010) [2023-12-28 01:38:13,187][106226] Updated weights for policy 0, policy_version 888144 (0.0007) [2023-12-28 01:38:13,237][106225] Updated weights for policy 1, policy_version 890365 (0.0010) [2023-12-28 01:38:13,251][106226] Updated weights for policy 0, policy_version 888154 (0.0006) [2023-12-28 01:38:13,309][106226] Updated weights for policy 0, policy_version 888164 (0.0008) [2023-12-28 01:38:13,951][106225] Updated weights for policy 1, policy_version 890375 (0.0010) [2023-12-28 01:38:14,011][106225] Updated weights for policy 1, policy_version 890385 (0.0010) [2023-12-28 01:38:14,030][106226] Updated weights for policy 0, policy_version 888174 (0.0008) [2023-12-28 01:38:14,061][106225] Updated weights for policy 1, policy_version 890395 (0.0010) [2023-12-28 01:38:14,081][106226] Updated weights for policy 0, policy_version 888184 (0.0008) [2023-12-28 01:38:14,135][106226] Updated weights for policy 0, policy_version 888194 (0.0008) [2023-12-28 01:38:14,794][106225] Updated weights for policy 1, policy_version 890405 (0.0010) [2023-12-28 01:38:14,847][106225] Updated weights for policy 1, policy_version 890415 (0.0010) [2023-12-28 01:38:14,909][106226] Updated weights for policy 0, policy_version 888204 (0.0007) [2023-12-28 01:38:14,911][106225] Updated weights for policy 1, policy_version 890425 (0.0012) [2023-12-28 01:38:14,976][106226] Updated weights for policy 0, policy_version 888214 (0.0006) [2023-12-28 01:38:15,046][106226] Updated weights for policy 0, policy_version 888224 (0.0009) [2023-12-28 01:38:15,698][106225] Updated weights for policy 1, policy_version 890435 (0.0009) [2023-12-28 01:38:15,724][106226] Updated weights for policy 0, policy_version 888234 (0.0009) [2023-12-28 01:38:15,753][106225] Updated weights for policy 1, policy_version 890445 (0.0005) [2023-12-28 01:38:15,785][106226] Updated weights for policy 0, policy_version 888244 (0.0009) [2023-12-28 01:38:15,812][106225] Updated weights for policy 1, policy_version 890455 (0.0005) [2023-12-28 01:38:15,849][106226] Updated weights for policy 0, policy_version 888254 (0.0007) [2023-12-28 01:38:15,904][106226] Updated weights for policy 0, policy_version 888264 (0.0007) [2023-12-28 01:38:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19633.0). Total num frames: 455450624. Throughput: 0: 9583.2, 1: 9806.0. Samples: 455439204. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:16,176][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.712')] [2023-12-28 01:38:16,462][106225] Updated weights for policy 1, policy_version 890465 (0.0005) [2023-12-28 01:38:16,532][106225] Updated weights for policy 1, policy_version 890475 (0.0005) [2023-12-28 01:38:16,596][106225] Updated weights for policy 1, policy_version 890485 (0.0007) [2023-12-28 01:38:16,632][106226] Updated weights for policy 0, policy_version 888274 (0.0005) [2023-12-28 01:38:16,651][106225] Updated weights for policy 1, policy_version 890495 (0.0006) [2023-12-28 01:38:16,684][106226] Updated weights for policy 0, policy_version 888284 (0.0008) [2023-12-28 01:38:16,732][106226] Updated weights for policy 0, policy_version 888294 (0.0008) [2023-12-28 01:38:17,275][106225] Updated weights for policy 1, policy_version 890505 (0.0008) [2023-12-28 01:38:17,339][106225] Updated weights for policy 1, policy_version 890515 (0.0008) [2023-12-28 01:38:17,357][106226] Updated weights for policy 0, policy_version 888304 (0.0010) [2023-12-28 01:38:17,391][106225] Updated weights for policy 1, policy_version 890525 (0.0006) [2023-12-28 01:38:17,408][106226] Updated weights for policy 0, policy_version 888314 (0.0010) [2023-12-28 01:38:17,455][106226] Updated weights for policy 0, policy_version 888324 (0.0010) [2023-12-28 01:38:18,024][106225] Updated weights for policy 1, policy_version 890535 (0.0009) [2023-12-28 01:38:18,070][106225] Updated weights for policy 1, policy_version 890545 (0.0010) [2023-12-28 01:38:18,125][106226] Updated weights for policy 0, policy_version 888334 (0.0010) [2023-12-28 01:38:18,127][106225] Updated weights for policy 1, policy_version 890555 (0.0007) [2023-12-28 01:38:18,181][106226] Updated weights for policy 0, policy_version 888344 (0.0010) [2023-12-28 01:38:18,248][106226] Updated weights for policy 0, policy_version 888354 (0.0010) [2023-12-28 01:38:18,838][106225] Updated weights for policy 1, policy_version 890565 (0.0007) [2023-12-28 01:38:18,903][106225] Updated weights for policy 1, policy_version 890575 (0.0009) [2023-12-28 01:38:18,940][106226] Updated weights for policy 0, policy_version 888364 (0.0011) [2023-12-28 01:38:18,959][106225] Updated weights for policy 1, policy_version 890585 (0.0006) [2023-12-28 01:38:18,988][106226] Updated weights for policy 0, policy_version 888374 (0.0007) [2023-12-28 01:38:19,033][106226] Updated weights for policy 0, policy_version 888384 (0.0009) [2023-12-28 01:38:19,630][106225] Updated weights for policy 1, policy_version 890595 (0.0010) [2023-12-28 01:38:19,681][106225] Updated weights for policy 1, policy_version 890605 (0.0010) [2023-12-28 01:38:19,740][106225] Updated weights for policy 1, policy_version 890615 (0.0010) [2023-12-28 01:38:19,836][106226] Updated weights for policy 0, policy_version 888394 (0.0010) [2023-12-28 01:38:19,898][106226] Updated weights for policy 0, policy_version 888404 (0.0008) [2023-12-28 01:38:19,964][106226] Updated weights for policy 0, policy_version 888414 (0.0008) [2023-12-28 01:38:20,020][106226] Updated weights for policy 0, policy_version 888424 (0.0008) [2023-12-28 01:38:20,517][106225] Updated weights for policy 1, policy_version 890625 (0.0010) [2023-12-28 01:38:20,601][106225] Updated weights for policy 1, policy_version 890635 (0.0010) [2023-12-28 01:38:20,667][106225] Updated weights for policy 1, policy_version 890645 (0.0011) [2023-12-28 01:38:20,731][106225] Updated weights for policy 1, policy_version 890655 (0.0010) [2023-12-28 01:38:20,757][106226] Updated weights for policy 0, policy_version 888434 (0.0007) [2023-12-28 01:38:20,817][106226] Updated weights for policy 0, policy_version 888444 (0.0009) [2023-12-28 01:38:20,878][106226] Updated weights for policy 0, policy_version 888454 (0.0008) [2023-12-28 01:38:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19633.1). Total num frames: 455548928. Throughput: 0: 9566.4, 1: 9807.4. Samples: 455558452. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:21,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-5.176')] [2023-12-28 01:38:21,471][106225] Updated weights for policy 1, policy_version 890665 (0.0009) [2023-12-28 01:38:21,533][106225] Updated weights for policy 1, policy_version 890675 (0.0008) [2023-12-28 01:38:21,592][106226] Updated weights for policy 0, policy_version 888464 (0.0007) [2023-12-28 01:38:21,593][106225] Updated weights for policy 1, policy_version 890685 (0.0008) [2023-12-28 01:38:21,663][106226] Updated weights for policy 0, policy_version 888475 (0.0009) [2023-12-28 01:38:21,730][106226] Updated weights for policy 0, policy_version 888485 (0.0007) [2023-12-28 01:38:22,294][106225] Updated weights for policy 1, policy_version 890695 (0.0008) [2023-12-28 01:38:22,359][106225] Updated weights for policy 1, policy_version 890705 (0.0008) [2023-12-28 01:38:22,429][106225] Updated weights for policy 1, policy_version 890715 (0.0008) [2023-12-28 01:38:22,511][106226] Updated weights for policy 0, policy_version 888495 (0.0009) [2023-12-28 01:38:22,572][106226] Updated weights for policy 0, policy_version 888505 (0.0011) [2023-12-28 01:38:22,636][106226] Updated weights for policy 0, policy_version 888515 (0.0009) [2023-12-28 01:38:23,185][106225] Updated weights for policy 1, policy_version 890725 (0.0007) [2023-12-28 01:38:23,251][106225] Updated weights for policy 1, policy_version 890735 (0.0005) [2023-12-28 01:38:23,275][106226] Updated weights for policy 0, policy_version 888525 (0.0008) [2023-12-28 01:38:23,311][106225] Updated weights for policy 1, policy_version 890745 (0.0005) [2023-12-28 01:38:23,332][106226] Updated weights for policy 0, policy_version 888535 (0.0010) [2023-12-28 01:38:23,392][106226] Updated weights for policy 0, policy_version 888545 (0.0010) [2023-12-28 01:38:23,831][106225] Updated weights for policy 1, policy_version 890755 (0.0007) [2023-12-28 01:38:23,884][106225] Updated weights for policy 1, policy_version 890765 (0.0010) [2023-12-28 01:38:23,949][106225] Updated weights for policy 1, policy_version 890775 (0.0010) [2023-12-28 01:38:24,062][106226] Updated weights for policy 0, policy_version 888555 (0.0009) [2023-12-28 01:38:24,119][106226] Updated weights for policy 0, policy_version 888565 (0.0011) [2023-12-28 01:38:24,183][106226] Updated weights for policy 0, policy_version 888575 (0.0011) [2023-12-28 01:38:24,494][106225] Updated weights for policy 1, policy_version 890785 (0.0007) [2023-12-28 01:38:24,548][106225] Updated weights for policy 1, policy_version 890795 (0.0005) [2023-12-28 01:38:24,605][106225] Updated weights for policy 1, policy_version 890805 (0.0005) [2023-12-28 01:38:24,661][106225] Updated weights for policy 1, policy_version 890815 (0.0008) [2023-12-28 01:38:24,869][106226] Updated weights for policy 0, policy_version 888585 (0.0011) [2023-12-28 01:38:24,927][106226] Updated weights for policy 0, policy_version 888595 (0.0010) [2023-12-28 01:38:24,977][106226] Updated weights for policy 0, policy_version 888605 (0.0008) [2023-12-28 01:38:25,028][106226] Updated weights for policy 0, policy_version 888615 (0.0008) [2023-12-28 01:38:25,313][106225] Updated weights for policy 1, policy_version 890825 (0.0006) [2023-12-28 01:38:25,362][106225] Updated weights for policy 1, policy_version 890835 (0.0006) [2023-12-28 01:38:25,427][106225] Updated weights for policy 1, policy_version 890845 (0.0010) [2023-12-28 01:38:25,674][106226] Updated weights for policy 0, policy_version 888625 (0.0007) [2023-12-28 01:38:25,736][106226] Updated weights for policy 0, policy_version 888635 (0.0008) [2023-12-28 01:38:25,793][106226] Updated weights for policy 0, policy_version 888645 (0.0008) [2023-12-28 01:38:26,116][106225] Updated weights for policy 1, policy_version 890855 (0.0010) [2023-12-28 01:38:26,166][106225] Updated weights for policy 1, policy_version 890865 (0.0010) [2023-12-28 01:38:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 455647232. Throughput: 0: 9606.4, 1: 9788.4. Samples: 455617904. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:26,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-5.118')] [2023-12-28 01:38:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000888648_227549184.pth... [2023-12-28 01:38:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000887528_227262464.pth [2023-12-28 01:38:26,226][106225] Updated weights for policy 1, policy_version 890875 (0.0010) [2023-12-28 01:38:26,257][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000890880_228106240.pth... [2023-12-28 01:38:26,261][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000889696_227803136.pth [2023-12-28 01:38:26,414][106226] Updated weights for policy 0, policy_version 888655 (0.0010) [2023-12-28 01:38:26,464][106226] Updated weights for policy 0, policy_version 888665 (0.0010) [2023-12-28 01:38:26,519][106226] Updated weights for policy 0, policy_version 888675 (0.0010) [2023-12-28 01:38:26,944][106225] Updated weights for policy 1, policy_version 890885 (0.0010) [2023-12-28 01:38:26,993][106225] Updated weights for policy 1, policy_version 890895 (0.0010) [2023-12-28 01:38:27,038][106225] Updated weights for policy 1, policy_version 890905 (0.0010) [2023-12-28 01:38:27,143][106226] Updated weights for policy 0, policy_version 888685 (0.0009) [2023-12-28 01:38:27,193][106226] Updated weights for policy 0, policy_version 888695 (0.0009) [2023-12-28 01:38:27,241][106226] Updated weights for policy 0, policy_version 888705 (0.0010) [2023-12-28 01:38:27,707][106225] Updated weights for policy 1, policy_version 890915 (0.0010) [2023-12-28 01:38:27,756][106225] Updated weights for policy 1, policy_version 890925 (0.0010) [2023-12-28 01:38:27,809][106225] Updated weights for policy 1, policy_version 890935 (0.0010) [2023-12-28 01:38:27,921][106226] Updated weights for policy 0, policy_version 888715 (0.0010) [2023-12-28 01:38:27,970][106226] Updated weights for policy 0, policy_version 888725 (0.0010) [2023-12-28 01:38:28,025][106226] Updated weights for policy 0, policy_version 888735 (0.0010) [2023-12-28 01:38:28,468][106225] Updated weights for policy 1, policy_version 890945 (0.0010) [2023-12-28 01:38:28,521][106225] Updated weights for policy 1, policy_version 890955 (0.0010) [2023-12-28 01:38:28,572][106225] Updated weights for policy 1, policy_version 890965 (0.0010) [2023-12-28 01:38:28,622][106225] Updated weights for policy 1, policy_version 890975 (0.0010) [2023-12-28 01:38:28,752][106226] Updated weights for policy 0, policy_version 888745 (0.0010) [2023-12-28 01:38:28,811][106226] Updated weights for policy 0, policy_version 888755 (0.0008) [2023-12-28 01:38:28,863][106226] Updated weights for policy 0, policy_version 888765 (0.0008) [2023-12-28 01:38:28,928][106226] Updated weights for policy 0, policy_version 888775 (0.0008) [2023-12-28 01:38:29,381][106225] Updated weights for policy 1, policy_version 890985 (0.0010) [2023-12-28 01:38:29,436][106225] Updated weights for policy 1, policy_version 890995 (0.0010) [2023-12-28 01:38:29,482][106225] Updated weights for policy 1, policy_version 891005 (0.0010) [2023-12-28 01:38:29,683][106226] Updated weights for policy 0, policy_version 888785 (0.0010) [2023-12-28 01:38:29,742][106226] Updated weights for policy 0, policy_version 888795 (0.0009) [2023-12-28 01:38:29,794][106226] Updated weights for policy 0, policy_version 888805 (0.0009) [2023-12-28 01:38:30,178][106225] Updated weights for policy 1, policy_version 891015 (0.0010) [2023-12-28 01:38:30,237][106225] Updated weights for policy 1, policy_version 891025 (0.0010) [2023-12-28 01:38:30,297][106225] Updated weights for policy 1, policy_version 891035 (0.0010) [2023-12-28 01:38:30,540][106226] Updated weights for policy 0, policy_version 888815 (0.0010) [2023-12-28 01:38:30,594][106226] Updated weights for policy 0, policy_version 888825 (0.0010) [2023-12-28 01:38:30,653][106226] Updated weights for policy 0, policy_version 888835 (0.0010) [2023-12-28 01:38:31,012][106225] Updated weights for policy 1, policy_version 891045 (0.0010) [2023-12-28 01:38:31,074][106225] Updated weights for policy 1, policy_version 891055 (0.0008) [2023-12-28 01:38:31,143][106225] Updated weights for policy 1, policy_version 891065 (0.0006) [2023-12-28 01:38:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 455745536. Throughput: 0: 9676.5, 1: 9906.2. Samples: 455741500. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:31,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.995')] [2023-12-28 01:38:31,382][106226] Updated weights for policy 0, policy_version 888845 (0.0011) [2023-12-28 01:38:31,435][106226] Updated weights for policy 0, policy_version 888855 (0.0009) [2023-12-28 01:38:31,482][106226] Updated weights for policy 0, policy_version 888865 (0.0010) [2023-12-28 01:38:31,886][106225] Updated weights for policy 1, policy_version 891075 (0.0009) [2023-12-28 01:38:31,941][106225] Updated weights for policy 1, policy_version 891085 (0.0009) [2023-12-28 01:38:32,011][106225] Updated weights for policy 1, policy_version 891095 (0.0010) [2023-12-28 01:38:32,118][106226] Updated weights for policy 0, policy_version 888875 (0.0006) [2023-12-28 01:38:32,175][106226] Updated weights for policy 0, policy_version 888885 (0.0005) [2023-12-28 01:38:32,228][106226] Updated weights for policy 0, policy_version 888895 (0.0005) [2023-12-28 01:38:32,719][106225] Updated weights for policy 1, policy_version 891105 (0.0010) [2023-12-28 01:38:32,782][106225] Updated weights for policy 1, policy_version 891115 (0.0009) [2023-12-28 01:38:32,840][106225] Updated weights for policy 1, policy_version 891125 (0.0009) [2023-12-28 01:38:32,895][106225] Updated weights for policy 1, policy_version 891135 (0.0009) [2023-12-28 01:38:32,899][106226] Updated weights for policy 0, policy_version 888905 (0.0008) [2023-12-28 01:38:32,963][106226] Updated weights for policy 0, policy_version 888915 (0.0009) [2023-12-28 01:38:33,020][106226] Updated weights for policy 0, policy_version 888925 (0.0008) [2023-12-28 01:38:33,077][106226] Updated weights for policy 0, policy_version 888935 (0.0009) [2023-12-28 01:38:33,480][106225] Updated weights for policy 1, policy_version 891145 (0.0005) [2023-12-28 01:38:33,535][106225] Updated weights for policy 1, policy_version 891155 (0.0008) [2023-12-28 01:38:33,592][106225] Updated weights for policy 1, policy_version 891165 (0.0006) [2023-12-28 01:38:33,782][106226] Updated weights for policy 0, policy_version 888945 (0.0008) [2023-12-28 01:38:33,836][106226] Updated weights for policy 0, policy_version 888955 (0.0008) [2023-12-28 01:38:33,885][106226] Updated weights for policy 0, policy_version 888965 (0.0009) [2023-12-28 01:38:34,306][106225] Updated weights for policy 1, policy_version 891175 (0.0007) [2023-12-28 01:38:34,372][106225] Updated weights for policy 1, policy_version 891185 (0.0008) [2023-12-28 01:38:34,429][106225] Updated weights for policy 1, policy_version 891195 (0.0008) [2023-12-28 01:38:34,568][106226] Updated weights for policy 0, policy_version 888975 (0.0010) [2023-12-28 01:38:34,632][106226] Updated weights for policy 0, policy_version 888985 (0.0011) [2023-12-28 01:38:34,693][106226] Updated weights for policy 0, policy_version 888995 (0.0011) [2023-12-28 01:38:35,096][106225] Updated weights for policy 1, policy_version 891205 (0.0008) [2023-12-28 01:38:35,152][106225] Updated weights for policy 1, policy_version 891215 (0.0008) [2023-12-28 01:38:35,215][106225] Updated weights for policy 1, policy_version 891225 (0.0008) [2023-12-28 01:38:35,411][106226] Updated weights for policy 0, policy_version 889005 (0.0011) [2023-12-28 01:38:35,460][106226] Updated weights for policy 0, policy_version 889015 (0.0010) [2023-12-28 01:38:35,516][106226] Updated weights for policy 0, policy_version 889025 (0.0010) [2023-12-28 01:38:35,929][106225] Updated weights for policy 1, policy_version 891235 (0.0008) [2023-12-28 01:38:35,983][106225] Updated weights for policy 1, policy_version 891245 (0.0007) [2023-12-28 01:38:36,037][106225] Updated weights for policy 1, policy_version 891255 (0.0007) [2023-12-28 01:38:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 455852032. Throughput: 0: 9724.9, 1: 9913.5. Samples: 455861028. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:36,176][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.913')] [2023-12-28 01:38:36,226][106226] Updated weights for policy 0, policy_version 889035 (0.0009) [2023-12-28 01:38:36,277][106226] Updated weights for policy 0, policy_version 889045 (0.0008) [2023-12-28 01:38:36,324][106226] Updated weights for policy 0, policy_version 889055 (0.0007) [2023-12-28 01:38:36,868][106225] Updated weights for policy 1, policy_version 891265 (0.0010) [2023-12-28 01:38:36,931][106225] Updated weights for policy 1, policy_version 891275 (0.0008) [2023-12-28 01:38:36,970][106226] Updated weights for policy 0, policy_version 889065 (0.0008) [2023-12-28 01:38:36,995][106225] Updated weights for policy 1, policy_version 891285 (0.0008) [2023-12-28 01:38:37,024][106226] Updated weights for policy 0, policy_version 889075 (0.0005) [2023-12-28 01:38:37,053][106225] Updated weights for policy 1, policy_version 891295 (0.0008) [2023-12-28 01:38:37,079][106226] Updated weights for policy 0, policy_version 889085 (0.0006) [2023-12-28 01:38:37,137][106226] Updated weights for policy 0, policy_version 889095 (0.0005) [2023-12-28 01:38:37,793][106225] Updated weights for policy 1, policy_version 891305 (0.0008) [2023-12-28 01:38:37,848][106225] Updated weights for policy 1, policy_version 891315 (0.0006) [2023-12-28 01:38:37,849][106226] Updated weights for policy 0, policy_version 889105 (0.0007) [2023-12-28 01:38:37,907][106226] Updated weights for policy 0, policy_version 889115 (0.0007) [2023-12-28 01:38:37,913][106225] Updated weights for policy 1, policy_version 891325 (0.0007) [2023-12-28 01:38:37,965][106226] Updated weights for policy 0, policy_version 889125 (0.0007) [2023-12-28 01:38:38,559][106225] Updated weights for policy 1, policy_version 891335 (0.0006) [2023-12-28 01:38:38,619][106225] Updated weights for policy 1, policy_version 891345 (0.0008) [2023-12-28 01:38:38,682][106225] Updated weights for policy 1, policy_version 891355 (0.0007) [2023-12-28 01:38:38,744][106226] Updated weights for policy 0, policy_version 889135 (0.0008) [2023-12-28 01:38:38,802][106226] Updated weights for policy 0, policy_version 889145 (0.0009) [2023-12-28 01:38:38,860][106226] Updated weights for policy 0, policy_version 889155 (0.0009) [2023-12-28 01:38:39,299][106225] Updated weights for policy 1, policy_version 891365 (0.0008) [2023-12-28 01:38:39,371][106225] Updated weights for policy 1, policy_version 891375 (0.0008) [2023-12-28 01:38:39,440][106225] Updated weights for policy 1, policy_version 891385 (0.0008) [2023-12-28 01:38:39,703][106226] Updated weights for policy 0, policy_version 889165 (0.0009) [2023-12-28 01:38:39,756][106226] Updated weights for policy 0, policy_version 889175 (0.0008) [2023-12-28 01:38:39,808][106226] Updated weights for policy 0, policy_version 889185 (0.0008) [2023-12-28 01:38:40,114][106225] Updated weights for policy 1, policy_version 891395 (0.0007) [2023-12-28 01:38:40,177][106225] Updated weights for policy 1, policy_version 891405 (0.0008) [2023-12-28 01:38:40,240][106225] Updated weights for policy 1, policy_version 891415 (0.0008) [2023-12-28 01:38:40,561][106226] Updated weights for policy 0, policy_version 889195 (0.0007) [2023-12-28 01:38:40,627][106226] Updated weights for policy 0, policy_version 889205 (0.0010) [2023-12-28 01:38:40,687][106226] Updated weights for policy 0, policy_version 889215 (0.0010) [2023-12-28 01:38:40,962][106225] Updated weights for policy 1, policy_version 891425 (0.0009) [2023-12-28 01:38:41,027][106225] Updated weights for policy 1, policy_version 891435 (0.0008) [2023-12-28 01:38:41,083][106225] Updated weights for policy 1, policy_version 891445 (0.0008) [2023-12-28 01:38:41,143][106225] Updated weights for policy 1, policy_version 891455 (0.0008) [2023-12-28 01:38:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 455950336. Throughput: 0: 9738.5, 1: 9920.1. Samples: 455918580. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:41,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.710')] [2023-12-28 01:38:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000889224_227696640.pth... [2023-12-28 01:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000891456_228253696.pth... [2023-12-28 01:38:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000888072_227401728.pth [2023-12-28 01:38:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000890272_227950592.pth [2023-12-28 01:38:41,453][106226] Updated weights for policy 0, policy_version 889225 (0.0010) [2023-12-28 01:38:41,507][106226] Updated weights for policy 0, policy_version 889235 (0.0008) [2023-12-28 01:38:41,572][106226] Updated weights for policy 0, policy_version 889245 (0.0008) [2023-12-28 01:38:41,648][106226] Updated weights for policy 0, policy_version 889255 (0.0010) [2023-12-28 01:38:41,975][106225] Updated weights for policy 1, policy_version 891465 (0.0008) [2023-12-28 01:38:42,037][106225] Updated weights for policy 1, policy_version 891475 (0.0009) [2023-12-28 01:38:42,098][106225] Updated weights for policy 1, policy_version 891485 (0.0008) [2023-12-28 01:38:42,423][106226] Updated weights for policy 0, policy_version 889265 (0.0008) [2023-12-28 01:38:42,487][106226] Updated weights for policy 0, policy_version 889275 (0.0006) [2023-12-28 01:38:42,545][106226] Updated weights for policy 0, policy_version 889285 (0.0005) [2023-12-28 01:38:42,810][106225] Updated weights for policy 1, policy_version 891495 (0.0009) [2023-12-28 01:38:42,866][106225] Updated weights for policy 1, policy_version 891505 (0.0009) [2023-12-28 01:38:42,925][106225] Updated weights for policy 1, policy_version 891515 (0.0006) [2023-12-28 01:38:43,139][106226] Updated weights for policy 0, policy_version 889295 (0.0007) [2023-12-28 01:38:43,185][106226] Updated weights for policy 0, policy_version 889305 (0.0008) [2023-12-28 01:38:43,237][106226] Updated weights for policy 0, policy_version 889315 (0.0007) [2023-12-28 01:38:43,619][106225] Updated weights for policy 1, policy_version 891525 (0.0006) [2023-12-28 01:38:43,682][106225] Updated weights for policy 1, policy_version 891535 (0.0009) [2023-12-28 01:38:43,735][106225] Updated weights for policy 1, policy_version 891545 (0.0010) [2023-12-28 01:38:43,841][106226] Updated weights for policy 0, policy_version 889325 (0.0007) [2023-12-28 01:38:43,897][106226] Updated weights for policy 0, policy_version 889335 (0.0008) [2023-12-28 01:38:43,951][106226] Updated weights for policy 0, policy_version 889345 (0.0010) [2023-12-28 01:38:44,421][106225] Updated weights for policy 1, policy_version 891555 (0.0010) [2023-12-28 01:38:44,481][106225] Updated weights for policy 1, policy_version 891565 (0.0008) [2023-12-28 01:38:44,532][106225] Updated weights for policy 1, policy_version 891575 (0.0008) [2023-12-28 01:38:44,682][106226] Updated weights for policy 0, policy_version 889355 (0.0011) [2023-12-28 01:38:44,729][106226] Updated weights for policy 0, policy_version 889365 (0.0010) [2023-12-28 01:38:44,791][106226] Updated weights for policy 0, policy_version 889375 (0.0009) [2023-12-28 01:38:45,276][106225] Updated weights for policy 1, policy_version 891585 (0.0008) [2023-12-28 01:38:45,342][106225] Updated weights for policy 1, policy_version 891595 (0.0008) [2023-12-28 01:38:45,396][106225] Updated weights for policy 1, policy_version 891605 (0.0008) [2023-12-28 01:38:45,459][106225] Updated weights for policy 1, policy_version 891615 (0.0009) [2023-12-28 01:38:45,546][106226] Updated weights for policy 0, policy_version 889385 (0.0008) [2023-12-28 01:38:45,610][106226] Updated weights for policy 0, policy_version 889395 (0.0008) [2023-12-28 01:38:45,671][106226] Updated weights for policy 0, policy_version 889405 (0.0008) [2023-12-28 01:38:45,726][106226] Updated weights for policy 0, policy_version 889415 (0.0008) [2023-12-28 01:38:46,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 456040448. Throughput: 0: 9735.8, 1: 9870.7. Samples: 456034512. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:46,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-4.545')] [2023-12-28 01:38:46,218][106225] Updated weights for policy 1, policy_version 891625 (0.0010) [2023-12-28 01:38:46,282][106225] Updated weights for policy 1, policy_version 891635 (0.0010) [2023-12-28 01:38:46,337][106225] Updated weights for policy 1, policy_version 891645 (0.0010) [2023-12-28 01:38:46,395][106226] Updated weights for policy 0, policy_version 889425 (0.0010) [2023-12-28 01:38:46,447][106226] Updated weights for policy 0, policy_version 889435 (0.0008) [2023-12-28 01:38:46,515][106226] Updated weights for policy 0, policy_version 889445 (0.0005) [2023-12-28 01:38:46,948][106225] Updated weights for policy 1, policy_version 891655 (0.0009) [2023-12-28 01:38:46,994][106225] Updated weights for policy 1, policy_version 891665 (0.0010) [2023-12-28 01:38:47,051][106225] Updated weights for policy 1, policy_version 891675 (0.0010) [2023-12-28 01:38:47,083][106226] Updated weights for policy 0, policy_version 889455 (0.0006) [2023-12-28 01:38:47,139][106226] Updated weights for policy 0, policy_version 889465 (0.0005) [2023-12-28 01:38:47,203][106226] Updated weights for policy 0, policy_version 889475 (0.0005) [2023-12-28 01:38:47,699][106225] Updated weights for policy 1, policy_version 891685 (0.0008) [2023-12-28 01:38:47,749][106225] Updated weights for policy 1, policy_version 891695 (0.0009) [2023-12-28 01:38:47,760][106226] Updated weights for policy 0, policy_version 889485 (0.0007) [2023-12-28 01:38:47,814][106225] Updated weights for policy 1, policy_version 891705 (0.0011) [2023-12-28 01:38:47,826][106226] Updated weights for policy 0, policy_version 889495 (0.0006) [2023-12-28 01:38:47,893][106226] Updated weights for policy 0, policy_version 889505 (0.0008) [2023-12-28 01:38:48,515][106226] Updated weights for policy 0, policy_version 889515 (0.0007) [2023-12-28 01:38:48,559][106225] Updated weights for policy 1, policy_version 891715 (0.0009) [2023-12-28 01:38:48,576][106226] Updated weights for policy 0, policy_version 889525 (0.0008) [2023-12-28 01:38:48,629][106225] Updated weights for policy 1, policy_version 891725 (0.0009) [2023-12-28 01:38:48,634][106226] Updated weights for policy 0, policy_version 889535 (0.0007) [2023-12-28 01:38:48,694][106225] Updated weights for policy 1, policy_version 891735 (0.0010) [2023-12-28 01:38:49,228][106226] Updated weights for policy 0, policy_version 889545 (0.0006) [2023-12-28 01:38:49,290][106226] Updated weights for policy 0, policy_version 889555 (0.0009) [2023-12-28 01:38:49,357][106226] Updated weights for policy 0, policy_version 889565 (0.0008) [2023-12-28 01:38:49,399][106225] Updated weights for policy 1, policy_version 891745 (0.0010) [2023-12-28 01:38:49,413][106226] Updated weights for policy 0, policy_version 889575 (0.0007) [2023-12-28 01:38:49,453][106225] Updated weights for policy 1, policy_version 891755 (0.0010) [2023-12-28 01:38:49,518][106225] Updated weights for policy 1, policy_version 891765 (0.0010) [2023-12-28 01:38:49,577][106225] Updated weights for policy 1, policy_version 891775 (0.0010) [2023-12-28 01:38:50,169][106226] Updated weights for policy 0, policy_version 889585 (0.0008) [2023-12-28 01:38:50,216][106226] Updated weights for policy 0, policy_version 889595 (0.0008) [2023-12-28 01:38:50,271][106226] Updated weights for policy 0, policy_version 889605 (0.0008) [2023-12-28 01:38:50,283][106225] Updated weights for policy 1, policy_version 891785 (0.0010) [2023-12-28 01:38:50,348][106225] Updated weights for policy 1, policy_version 891795 (0.0007) [2023-12-28 01:38:50,413][106225] Updated weights for policy 1, policy_version 891805 (0.0009) [2023-12-28 01:38:51,057][106226] Updated weights for policy 0, policy_version 889615 (0.0008) [2023-12-28 01:38:51,120][106226] Updated weights for policy 0, policy_version 889625 (0.0008) [2023-12-28 01:38:51,135][106225] Updated weights for policy 1, policy_version 891815 (0.0008) [2023-12-28 01:38:51,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 456138752. Throughput: 0: 9861.7, 1: 9861.0. Samples: 456155628. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:51,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.807')] [2023-12-28 01:38:51,178][106226] Updated weights for policy 0, policy_version 889635 (0.0007) [2023-12-28 01:38:51,200][106225] Updated weights for policy 1, policy_version 891825 (0.0009) [2023-12-28 01:38:51,269][106225] Updated weights for policy 1, policy_version 891835 (0.0008) [2023-12-28 01:38:51,965][106225] Updated weights for policy 1, policy_version 891845 (0.0009) [2023-12-28 01:38:52,019][106226] Updated weights for policy 0, policy_version 889645 (0.0007) [2023-12-28 01:38:52,026][106225] Updated weights for policy 1, policy_version 891855 (0.0008) [2023-12-28 01:38:52,085][106226] Updated weights for policy 0, policy_version 889655 (0.0007) [2023-12-28 01:38:52,087][106225] Updated weights for policy 1, policy_version 891865 (0.0006) [2023-12-28 01:38:52,144][106226] Updated weights for policy 0, policy_version 889665 (0.0009) [2023-12-28 01:38:52,787][106225] Updated weights for policy 1, policy_version 891875 (0.0008) [2023-12-28 01:38:52,838][106225] Updated weights for policy 1, policy_version 891885 (0.0008) [2023-12-28 01:38:52,885][106225] Updated weights for policy 1, policy_version 891895 (0.0008) [2023-12-28 01:38:52,892][106226] Updated weights for policy 0, policy_version 889675 (0.0008) [2023-12-28 01:38:52,950][106226] Updated weights for policy 0, policy_version 889685 (0.0007) [2023-12-28 01:38:53,003][106226] Updated weights for policy 0, policy_version 889695 (0.0008) [2023-12-28 01:38:53,598][106225] Updated weights for policy 1, policy_version 891905 (0.0008) [2023-12-28 01:38:53,642][106225] Updated weights for policy 1, policy_version 891915 (0.0008) [2023-12-28 01:38:53,686][106225] Updated weights for policy 1, policy_version 891925 (0.0008) [2023-12-28 01:38:53,740][106226] Updated weights for policy 0, policy_version 889705 (0.0009) [2023-12-28 01:38:53,744][106225] Updated weights for policy 1, policy_version 891936 (0.0007) [2023-12-28 01:38:53,789][106226] Updated weights for policy 0, policy_version 889715 (0.0009) [2023-12-28 01:38:53,839][106226] Updated weights for policy 0, policy_version 889725 (0.0009) [2023-12-28 01:38:53,903][106226] Updated weights for policy 0, policy_version 889735 (0.0009) [2023-12-28 01:38:54,339][106225] Updated weights for policy 1, policy_version 891946 (0.0005) [2023-12-28 01:38:54,387][106225] Updated weights for policy 1, policy_version 891956 (0.0005) [2023-12-28 01:38:54,448][106225] Updated weights for policy 1, policy_version 891966 (0.0008) [2023-12-28 01:38:54,729][106226] Updated weights for policy 0, policy_version 889745 (0.0008) [2023-12-28 01:38:54,773][106226] Updated weights for policy 0, policy_version 889755 (0.0008) [2023-12-28 01:38:54,819][106226] Updated weights for policy 0, policy_version 889765 (0.0008) [2023-12-28 01:38:55,074][106225] Updated weights for policy 1, policy_version 891976 (0.0008) [2023-12-28 01:38:55,132][106225] Updated weights for policy 1, policy_version 891986 (0.0008) [2023-12-28 01:38:55,195][106225] Updated weights for policy 1, policy_version 891996 (0.0008) [2023-12-28 01:38:55,577][106226] Updated weights for policy 0, policy_version 889775 (0.0009) [2023-12-28 01:38:55,633][106226] Updated weights for policy 0, policy_version 889785 (0.0008) [2023-12-28 01:38:55,692][106226] Updated weights for policy 0, policy_version 889795 (0.0009) [2023-12-28 01:38:55,862][106225] Updated weights for policy 1, policy_version 892006 (0.0006) [2023-12-28 01:38:55,908][106225] Updated weights for policy 1, policy_version 892016 (0.0005) [2023-12-28 01:38:55,959][106225] Updated weights for policy 1, policy_version 892026 (0.0005) [2023-12-28 01:38:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 456245248. Throughput: 0: 9831.2, 1: 9847.0. Samples: 456211756. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:38:56,176][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.783')] [2023-12-28 01:38:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000892032_228401152.pth... [2023-12-28 01:38:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000889800_227844096.pth... [2023-12-28 01:38:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000890880_228106240.pth [2023-12-28 01:38:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000888648_227549184.pth [2023-12-28 01:38:56,463][106226] Updated weights for policy 0, policy_version 889805 (0.0008) [2023-12-28 01:38:56,514][106226] Updated weights for policy 0, policy_version 889815 (0.0009) [2023-12-28 01:38:56,563][106226] Updated weights for policy 0, policy_version 889825 (0.0008) [2023-12-28 01:38:56,605][106225] Updated weights for policy 1, policy_version 892036 (0.0007) [2023-12-28 01:38:56,661][106225] Updated weights for policy 1, policy_version 892046 (0.0010) [2023-12-28 01:38:56,717][106225] Updated weights for policy 1, policy_version 892056 (0.0010) [2023-12-28 01:38:57,224][106226] Updated weights for policy 0, policy_version 889835 (0.0008) [2023-12-28 01:38:57,285][106226] Updated weights for policy 0, policy_version 889845 (0.0009) [2023-12-28 01:38:57,339][106226] Updated weights for policy 0, policy_version 889855 (0.0009) [2023-12-28 01:38:57,427][106225] Updated weights for policy 1, policy_version 892066 (0.0009) [2023-12-28 01:38:57,492][106225] Updated weights for policy 1, policy_version 892076 (0.0006) [2023-12-28 01:38:57,554][106225] Updated weights for policy 1, policy_version 892086 (0.0008) [2023-12-28 01:38:57,610][106225] Updated weights for policy 1, policy_version 892096 (0.0010) [2023-12-28 01:38:57,916][106226] Updated weights for policy 0, policy_version 889865 (0.0005) [2023-12-28 01:38:57,979][106226] Updated weights for policy 0, policy_version 889875 (0.0006) [2023-12-28 01:38:58,038][106226] Updated weights for policy 0, policy_version 889885 (0.0008) [2023-12-28 01:38:58,091][106226] Updated weights for policy 0, policy_version 889895 (0.0010) [2023-12-28 01:38:58,128][106225] Updated weights for policy 1, policy_version 892106 (0.0005) [2023-12-28 01:38:58,180][106225] Updated weights for policy 1, policy_version 892116 (0.0005) [2023-12-28 01:38:58,243][106225] Updated weights for policy 1, policy_version 892126 (0.0007) [2023-12-28 01:38:58,806][106226] Updated weights for policy 0, policy_version 889905 (0.0008) [2023-12-28 01:38:58,884][106226] Updated weights for policy 0, policy_version 889915 (0.0008) [2023-12-28 01:38:58,943][106226] Updated weights for policy 0, policy_version 889925 (0.0009) [2023-12-28 01:38:59,044][106225] Updated weights for policy 1, policy_version 892136 (0.0009) [2023-12-28 01:38:59,101][106225] Updated weights for policy 1, policy_version 892146 (0.0008) [2023-12-28 01:38:59,165][106225] Updated weights for policy 1, policy_version 892156 (0.0007) [2023-12-28 01:38:59,683][106226] Updated weights for policy 0, policy_version 889935 (0.0010) [2023-12-28 01:38:59,741][106226] Updated weights for policy 0, policy_version 889945 (0.0011) [2023-12-28 01:38:59,806][106226] Updated weights for policy 0, policy_version 889955 (0.0010) [2023-12-28 01:38:59,895][106225] Updated weights for policy 1, policy_version 892166 (0.0009) [2023-12-28 01:38:59,962][106225] Updated weights for policy 1, policy_version 892176 (0.0009) [2023-12-28 01:39:00,022][106225] Updated weights for policy 1, policy_version 892186 (0.0008) [2023-12-28 01:39:00,499][106226] Updated weights for policy 0, policy_version 889965 (0.0009) [2023-12-28 01:39:00,563][106226] Updated weights for policy 0, policy_version 889975 (0.0010) [2023-12-28 01:39:00,626][106226] Updated weights for policy 0, policy_version 889985 (0.0011) [2023-12-28 01:39:00,800][106225] Updated weights for policy 1, policy_version 892196 (0.0009) [2023-12-28 01:39:00,866][106225] Updated weights for policy 1, policy_version 892206 (0.0007) [2023-12-28 01:39:00,923][106225] Updated weights for policy 1, policy_version 892216 (0.0010) [2023-12-28 01:39:01,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 456343552. Throughput: 0: 9882.2, 1: 9992.4. Samples: 456333556. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:01,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.745')] [2023-12-28 01:39:01,278][106226] Updated weights for policy 0, policy_version 889995 (0.0011) [2023-12-28 01:39:01,338][106226] Updated weights for policy 0, policy_version 890005 (0.0010) [2023-12-28 01:39:01,403][106226] Updated weights for policy 0, policy_version 890015 (0.0008) [2023-12-28 01:39:01,667][106225] Updated weights for policy 1, policy_version 892226 (0.0009) [2023-12-28 01:39:01,730][106225] Updated weights for policy 1, policy_version 892236 (0.0007) [2023-12-28 01:39:01,793][106225] Updated weights for policy 1, policy_version 892246 (0.0007) [2023-12-28 01:39:01,855][106225] Updated weights for policy 1, policy_version 892256 (0.0008) [2023-12-28 01:39:02,115][106226] Updated weights for policy 0, policy_version 890025 (0.0008) [2023-12-28 01:39:02,179][106226] Updated weights for policy 0, policy_version 890035 (0.0011) [2023-12-28 01:39:02,242][106226] Updated weights for policy 0, policy_version 890045 (0.0011) [2023-12-28 01:39:02,305][106226] Updated weights for policy 0, policy_version 890055 (0.0009) [2023-12-28 01:39:02,581][106225] Updated weights for policy 1, policy_version 892266 (0.0007) [2023-12-28 01:39:02,639][106225] Updated weights for policy 1, policy_version 892276 (0.0008) [2023-12-28 01:39:02,696][106225] Updated weights for policy 1, policy_version 892286 (0.0008) [2023-12-28 01:39:03,015][106226] Updated weights for policy 0, policy_version 890065 (0.0008) [2023-12-28 01:39:03,078][106226] Updated weights for policy 0, policy_version 890075 (0.0010) [2023-12-28 01:39:03,141][106226] Updated weights for policy 0, policy_version 890085 (0.0010) [2023-12-28 01:39:03,400][106225] Updated weights for policy 1, policy_version 892296 (0.0008) [2023-12-28 01:39:03,449][106225] Updated weights for policy 1, policy_version 892307 (0.0009) [2023-12-28 01:39:03,511][106225] Updated weights for policy 1, policy_version 892317 (0.0007) [2023-12-28 01:39:03,712][106226] Updated weights for policy 0, policy_version 890095 (0.0007) [2023-12-28 01:39:03,757][106226] Updated weights for policy 0, policy_version 890105 (0.0005) [2023-12-28 01:39:03,802][106226] Updated weights for policy 0, policy_version 890115 (0.0005) [2023-12-28 01:39:04,102][106225] Updated weights for policy 1, policy_version 892327 (0.0007) [2023-12-28 01:39:04,166][106225] Updated weights for policy 1, policy_version 892337 (0.0010) [2023-12-28 01:39:04,232][106225] Updated weights for policy 1, policy_version 892347 (0.0009) [2023-12-28 01:39:04,420][106226] Updated weights for policy 0, policy_version 890125 (0.0007) [2023-12-28 01:39:04,482][106226] Updated weights for policy 0, policy_version 890135 (0.0009) [2023-12-28 01:39:04,545][106226] Updated weights for policy 0, policy_version 890145 (0.0009) [2023-12-28 01:39:04,924][106225] Updated weights for policy 1, policy_version 892357 (0.0006) [2023-12-28 01:39:04,981][106225] Updated weights for policy 1, policy_version 892367 (0.0005) [2023-12-28 01:39:05,045][106225] Updated weights for policy 1, policy_version 892377 (0.0006) [2023-12-28 01:39:05,124][106226] Updated weights for policy 0, policy_version 890155 (0.0007) [2023-12-28 01:39:05,180][106226] Updated weights for policy 0, policy_version 890165 (0.0007) [2023-12-28 01:39:05,223][106226] Updated weights for policy 0, policy_version 890175 (0.0008) [2023-12-28 01:39:05,631][106225] Updated weights for policy 1, policy_version 892387 (0.0005) [2023-12-28 01:39:05,691][106225] Updated weights for policy 1, policy_version 892397 (0.0005) [2023-12-28 01:39:05,737][106225] Updated weights for policy 1, policy_version 892407 (0.0005) [2023-12-28 01:39:05,829][106226] Updated weights for policy 0, policy_version 890185 (0.0007) [2023-12-28 01:39:05,884][106226] Updated weights for policy 0, policy_version 890195 (0.0005) [2023-12-28 01:39:05,935][106226] Updated weights for policy 0, policy_version 890205 (0.0005) [2023-12-28 01:39:05,985][106226] Updated weights for policy 0, policy_version 890215 (0.0006) [2023-12-28 01:39:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 456450048. Throughput: 0: 9990.5, 1: 10001.6. Samples: 456458100. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:06,176][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.971')] [2023-12-28 01:39:06,278][106225] Updated weights for policy 1, policy_version 892417 (0.0006) [2023-12-28 01:39:06,346][106225] Updated weights for policy 1, policy_version 892427 (0.0010) [2023-12-28 01:39:06,414][106225] Updated weights for policy 1, policy_version 892437 (0.0010) [2023-12-28 01:39:06,480][106225] Updated weights for policy 1, policy_version 892447 (0.0010) [2023-12-28 01:39:06,711][106226] Updated weights for policy 0, policy_version 890225 (0.0006) [2023-12-28 01:39:06,769][106226] Updated weights for policy 0, policy_version 890235 (0.0006) [2023-12-28 01:39:06,837][106226] Updated weights for policy 0, policy_version 890245 (0.0005) [2023-12-28 01:39:07,154][106225] Updated weights for policy 1, policy_version 892457 (0.0010) [2023-12-28 01:39:07,205][106225] Updated weights for policy 1, policy_version 892467 (0.0010) [2023-12-28 01:39:07,255][106225] Updated weights for policy 1, policy_version 892477 (0.0010) [2023-12-28 01:39:07,388][106226] Updated weights for policy 0, policy_version 890255 (0.0007) [2023-12-28 01:39:07,440][106226] Updated weights for policy 0, policy_version 890265 (0.0008) [2023-12-28 01:39:07,488][106226] Updated weights for policy 0, policy_version 890275 (0.0009) [2023-12-28 01:39:07,937][106225] Updated weights for policy 1, policy_version 892487 (0.0010) [2023-12-28 01:39:07,993][106225] Updated weights for policy 1, policy_version 892497 (0.0010) [2023-12-28 01:39:08,052][106225] Updated weights for policy 1, policy_version 892507 (0.0006) [2023-12-28 01:39:08,207][106226] Updated weights for policy 0, policy_version 890285 (0.0009) [2023-12-28 01:39:08,270][106226] Updated weights for policy 0, policy_version 890295 (0.0008) [2023-12-28 01:39:08,321][106226] Updated weights for policy 0, policy_version 890305 (0.0010) [2023-12-28 01:39:08,684][106225] Updated weights for policy 1, policy_version 892517 (0.0007) [2023-12-28 01:39:08,743][106225] Updated weights for policy 1, policy_version 892527 (0.0007) [2023-12-28 01:39:08,804][106225] Updated weights for policy 1, policy_version 892537 (0.0008) [2023-12-28 01:39:09,131][106226] Updated weights for policy 0, policy_version 890315 (0.0010) [2023-12-28 01:39:09,180][106226] Updated weights for policy 0, policy_version 890325 (0.0008) [2023-12-28 01:39:09,265][106226] Updated weights for policy 0, policy_version 890335 (0.0009) [2023-12-28 01:39:09,523][106225] Updated weights for policy 1, policy_version 892547 (0.0007) [2023-12-28 01:39:09,584][106225] Updated weights for policy 1, policy_version 892557 (0.0006) [2023-12-28 01:39:09,656][106225] Updated weights for policy 1, policy_version 892567 (0.0007) [2023-12-28 01:39:09,988][106226] Updated weights for policy 0, policy_version 890345 (0.0010) [2023-12-28 01:39:10,060][106226] Updated weights for policy 0, policy_version 890355 (0.0008) [2023-12-28 01:39:10,122][106226] Updated weights for policy 0, policy_version 890365 (0.0008) [2023-12-28 01:39:10,186][106226] Updated weights for policy 0, policy_version 890375 (0.0006) [2023-12-28 01:39:10,414][106225] Updated weights for policy 1, policy_version 892577 (0.0008) [2023-12-28 01:39:10,472][106225] Updated weights for policy 1, policy_version 892587 (0.0008) [2023-12-28 01:39:10,530][106225] Updated weights for policy 1, policy_version 892597 (0.0008) [2023-12-28 01:39:10,591][106225] Updated weights for policy 1, policy_version 892607 (0.0007) [2023-12-28 01:39:10,776][106226] Updated weights for policy 0, policy_version 890385 (0.0005) [2023-12-28 01:39:10,828][106226] Updated weights for policy 0, policy_version 890395 (0.0007) [2023-12-28 01:39:10,880][106226] Updated weights for policy 0, policy_version 890405 (0.0006) [2023-12-28 01:39:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 456548352. Throughput: 0: 9995.3, 1: 10043.8. Samples: 456519664. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:11,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.818')] [2023-12-28 01:39:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000892608_228548608.pth... [2023-12-28 01:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000890408_227999744.pth... [2023-12-28 01:39:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000889224_227696640.pth [2023-12-28 01:39:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000891456_228253696.pth [2023-12-28 01:39:11,264][106225] Updated weights for policy 1, policy_version 892617 (0.0008) [2023-12-28 01:39:11,323][106225] Updated weights for policy 1, policy_version 892627 (0.0008) [2023-12-28 01:39:11,394][106225] Updated weights for policy 1, policy_version 892637 (0.0008) [2023-12-28 01:39:11,597][106226] Updated weights for policy 0, policy_version 890415 (0.0006) [2023-12-28 01:39:11,665][106226] Updated weights for policy 0, policy_version 890425 (0.0008) [2023-12-28 01:39:11,736][106226] Updated weights for policy 0, policy_version 890435 (0.0010) [2023-12-28 01:39:12,133][106225] Updated weights for policy 1, policy_version 892647 (0.0010) [2023-12-28 01:39:12,193][106225] Updated weights for policy 1, policy_version 892657 (0.0008) [2023-12-28 01:39:12,253][106225] Updated weights for policy 1, policy_version 892667 (0.0008) [2023-12-28 01:39:12,490][106226] Updated weights for policy 0, policy_version 890445 (0.0007) [2023-12-28 01:39:12,553][106226] Updated weights for policy 0, policy_version 890455 (0.0006) [2023-12-28 01:39:12,622][106226] Updated weights for policy 0, policy_version 890465 (0.0008) [2023-12-28 01:39:13,048][106225] Updated weights for policy 1, policy_version 892677 (0.0008) [2023-12-28 01:39:13,107][106225] Updated weights for policy 1, policy_version 892687 (0.0007) [2023-12-28 01:39:13,165][106225] Updated weights for policy 1, policy_version 892697 (0.0009) [2023-12-28 01:39:13,286][106226] Updated weights for policy 0, policy_version 890475 (0.0008) [2023-12-28 01:39:13,345][106226] Updated weights for policy 0, policy_version 890485 (0.0005) [2023-12-28 01:39:13,406][106226] Updated weights for policy 0, policy_version 890495 (0.0007) [2023-12-28 01:39:13,854][106225] Updated weights for policy 1, policy_version 892707 (0.0009) [2023-12-28 01:39:13,920][106225] Updated weights for policy 1, policy_version 892717 (0.0010) [2023-12-28 01:39:13,974][106225] Updated weights for policy 1, policy_version 892727 (0.0010) [2023-12-28 01:39:14,040][106226] Updated weights for policy 0, policy_version 890505 (0.0008) [2023-12-28 01:39:14,107][106226] Updated weights for policy 0, policy_version 890515 (0.0005) [2023-12-28 01:39:14,167][106226] Updated weights for policy 0, policy_version 890525 (0.0006) [2023-12-28 01:39:14,225][106226] Updated weights for policy 0, policy_version 890535 (0.0008) [2023-12-28 01:39:14,659][106225] Updated weights for policy 1, policy_version 892737 (0.0010) [2023-12-28 01:39:14,713][106225] Updated weights for policy 1, policy_version 892747 (0.0005) [2023-12-28 01:39:14,760][106225] Updated weights for policy 1, policy_version 892757 (0.0006) [2023-12-28 01:39:14,827][106225] Updated weights for policy 1, policy_version 892767 (0.0010) [2023-12-28 01:39:14,846][106226] Updated weights for policy 0, policy_version 890545 (0.0010) [2023-12-28 01:39:14,904][106226] Updated weights for policy 0, policy_version 890555 (0.0011) [2023-12-28 01:39:14,966][106226] Updated weights for policy 0, policy_version 890565 (0.0011) [2023-12-28 01:39:15,525][106225] Updated weights for policy 1, policy_version 892777 (0.0010) [2023-12-28 01:39:15,597][106225] Updated weights for policy 1, policy_version 892787 (0.0011) [2023-12-28 01:39:15,658][106225] Updated weights for policy 1, policy_version 892797 (0.0010) [2023-12-28 01:39:15,723][106226] Updated weights for policy 0, policy_version 890575 (0.0009) [2023-12-28 01:39:15,789][106226] Updated weights for policy 0, policy_version 890585 (0.0010) [2023-12-28 01:39:15,851][106226] Updated weights for policy 0, policy_version 890595 (0.0011) [2023-12-28 01:39:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 456646656. Throughput: 0: 9976.7, 1: 9938.6. Samples: 456637688. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:16,176][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.675')] [2023-12-28 01:39:16,370][106225] Updated weights for policy 1, policy_version 892807 (0.0010) [2023-12-28 01:39:16,420][106225] Updated weights for policy 1, policy_version 892817 (0.0010) [2023-12-28 01:39:16,469][106225] Updated weights for policy 1, policy_version 892827 (0.0010) [2023-12-28 01:39:16,500][106226] Updated weights for policy 0, policy_version 890605 (0.0010) [2023-12-28 01:39:16,562][106226] Updated weights for policy 0, policy_version 890615 (0.0010) [2023-12-28 01:39:16,630][106226] Updated weights for policy 0, policy_version 890625 (0.0009) [2023-12-28 01:39:17,143][106225] Updated weights for policy 1, policy_version 892837 (0.0008) [2023-12-28 01:39:17,207][106225] Updated weights for policy 1, policy_version 892847 (0.0006) [2023-12-28 01:39:17,239][106226] Updated weights for policy 0, policy_version 890635 (0.0009) [2023-12-28 01:39:17,262][106225] Updated weights for policy 1, policy_version 892857 (0.0006) [2023-12-28 01:39:17,300][106226] Updated weights for policy 0, policy_version 890645 (0.0010) [2023-12-28 01:39:17,364][106226] Updated weights for policy 0, policy_version 890655 (0.0009) [2023-12-28 01:39:17,805][106225] Updated weights for policy 1, policy_version 892867 (0.0007) [2023-12-28 01:39:17,854][106225] Updated weights for policy 1, policy_version 892877 (0.0008) [2023-12-28 01:39:17,901][106225] Updated weights for policy 1, policy_version 892887 (0.0008) [2023-12-28 01:39:17,968][106226] Updated weights for policy 0, policy_version 890665 (0.0010) [2023-12-28 01:39:18,035][106226] Updated weights for policy 0, policy_version 890675 (0.0005) [2023-12-28 01:39:18,095][106226] Updated weights for policy 0, policy_version 890685 (0.0005) [2023-12-28 01:39:18,153][106226] Updated weights for policy 0, policy_version 890695 (0.0005) [2023-12-28 01:39:18,630][106225] Updated weights for policy 1, policy_version 892897 (0.0008) [2023-12-28 01:39:18,694][106225] Updated weights for policy 1, policy_version 892907 (0.0008) [2023-12-28 01:39:18,754][106225] Updated weights for policy 1, policy_version 892917 (0.0007) [2023-12-28 01:39:18,778][106226] Updated weights for policy 0, policy_version 890705 (0.0010) [2023-12-28 01:39:18,817][106225] Updated weights for policy 1, policy_version 892927 (0.0006) [2023-12-28 01:39:18,838][106226] Updated weights for policy 0, policy_version 890715 (0.0011) [2023-12-28 01:39:18,897][106226] Updated weights for policy 0, policy_version 890725 (0.0011) [2023-12-28 01:39:19,625][106226] Updated weights for policy 0, policy_version 890735 (0.0009) [2023-12-28 01:39:19,636][106225] Updated weights for policy 1, policy_version 892937 (0.0007) [2023-12-28 01:39:19,689][106226] Updated weights for policy 0, policy_version 890745 (0.0010) [2023-12-28 01:39:19,691][106225] Updated weights for policy 1, policy_version 892947 (0.0006) [2023-12-28 01:39:19,751][106225] Updated weights for policy 1, policy_version 892957 (0.0009) [2023-12-28 01:39:19,754][106226] Updated weights for policy 0, policy_version 890755 (0.0011) [2023-12-28 01:39:20,436][106225] Updated weights for policy 1, policy_version 892967 (0.0007) [2023-12-28 01:39:20,478][106226] Updated weights for policy 0, policy_version 890765 (0.0008) [2023-12-28 01:39:20,498][106225] Updated weights for policy 1, policy_version 892977 (0.0009) [2023-12-28 01:39:20,540][106226] Updated weights for policy 0, policy_version 890775 (0.0007) [2023-12-28 01:39:20,551][106225] Updated weights for policy 1, policy_version 892987 (0.0007) [2023-12-28 01:39:20,604][106226] Updated weights for policy 0, policy_version 890785 (0.0008) [2023-12-28 01:39:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 456744960. Throughput: 0: 9997.9, 1: 9933.0. Samples: 456757916. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:21,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-5.069')] [2023-12-28 01:39:21,288][106226] Updated weights for policy 0, policy_version 890795 (0.0007) [2023-12-28 01:39:21,348][106226] Updated weights for policy 0, policy_version 890805 (0.0008) [2023-12-28 01:39:21,350][106225] Updated weights for policy 1, policy_version 892997 (0.0007) [2023-12-28 01:39:21,418][106226] Updated weights for policy 0, policy_version 890815 (0.0007) [2023-12-28 01:39:21,419][106225] Updated weights for policy 1, policy_version 893007 (0.0009) [2023-12-28 01:39:21,486][106225] Updated weights for policy 1, policy_version 893017 (0.0009) [2023-12-28 01:39:22,128][106226] Updated weights for policy 0, policy_version 890825 (0.0006) [2023-12-28 01:39:22,175][106225] Updated weights for policy 1, policy_version 893027 (0.0009) [2023-12-28 01:39:22,193][106226] Updated weights for policy 0, policy_version 890835 (0.0008) [2023-12-28 01:39:22,238][106225] Updated weights for policy 1, policy_version 893037 (0.0006) [2023-12-28 01:39:22,266][106226] Updated weights for policy 0, policy_version 890845 (0.0009) [2023-12-28 01:39:22,309][106225] Updated weights for policy 1, policy_version 893047 (0.0008) [2023-12-28 01:39:22,328][106226] Updated weights for policy 0, policy_version 890855 (0.0007) [2023-12-28 01:39:23,002][106225] Updated weights for policy 1, policy_version 893057 (0.0008) [2023-12-28 01:39:23,052][106225] Updated weights for policy 1, policy_version 893067 (0.0009) [2023-12-28 01:39:23,094][106226] Updated weights for policy 0, policy_version 890865 (0.0007) [2023-12-28 01:39:23,100][106225] Updated weights for policy 1, policy_version 893077 (0.0006) [2023-12-28 01:39:23,144][106226] Updated weights for policy 0, policy_version 890875 (0.0006) [2023-12-28 01:39:23,146][106225] Updated weights for policy 1, policy_version 893087 (0.0006) [2023-12-28 01:39:23,202][106226] Updated weights for policy 0, policy_version 890885 (0.0005) [2023-12-28 01:39:23,830][106225] Updated weights for policy 1, policy_version 893097 (0.0009) [2023-12-28 01:39:23,887][106225] Updated weights for policy 1, policy_version 893107 (0.0008) [2023-12-28 01:39:23,952][106225] Updated weights for policy 1, policy_version 893117 (0.0007) [2023-12-28 01:39:23,956][106226] Updated weights for policy 0, policy_version 890895 (0.0006) [2023-12-28 01:39:24,010][106226] Updated weights for policy 0, policy_version 890905 (0.0009) [2023-12-28 01:39:24,062][106226] Updated weights for policy 0, policy_version 890915 (0.0009) [2023-12-28 01:39:24,639][106225] Updated weights for policy 1, policy_version 893127 (0.0008) [2023-12-28 01:39:24,701][106225] Updated weights for policy 1, policy_version 893137 (0.0008) [2023-12-28 01:39:24,760][106225] Updated weights for policy 1, policy_version 893147 (0.0008) [2023-12-28 01:39:24,817][106226] Updated weights for policy 0, policy_version 890925 (0.0008) [2023-12-28 01:39:24,884][106226] Updated weights for policy 0, policy_version 890935 (0.0009) [2023-12-28 01:39:24,940][106226] Updated weights for policy 0, policy_version 890945 (0.0006) [2023-12-28 01:39:25,448][106225] Updated weights for policy 1, policy_version 893157 (0.0007) [2023-12-28 01:39:25,500][106225] Updated weights for policy 1, policy_version 893167 (0.0008) [2023-12-28 01:39:25,562][106225] Updated weights for policy 1, policy_version 893177 (0.0007) [2023-12-28 01:39:25,635][106226] Updated weights for policy 0, policy_version 890955 (0.0007) [2023-12-28 01:39:25,692][106226] Updated weights for policy 0, policy_version 890965 (0.0007) [2023-12-28 01:39:25,752][106226] Updated weights for policy 0, policy_version 890975 (0.0008) [2023-12-28 01:39:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 456843264. Throughput: 0: 9971.0, 1: 9944.7. Samples: 456814788. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:26,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.814')] [2023-12-28 01:39:26,181][106225] Updated weights for policy 1, policy_version 893187 (0.0008) [2023-12-28 01:39:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000890984_228147200.pth... [2023-12-28 01:39:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000889800_227844096.pth [2023-12-28 01:39:26,238][106225] Updated weights for policy 1, policy_version 893197 (0.0010) [2023-12-28 01:39:26,285][106225] Updated weights for policy 1, policy_version 893207 (0.0010) [2023-12-28 01:39:26,334][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000893216_228704256.pth... [2023-12-28 01:39:26,338][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000892032_228401152.pth [2023-12-28 01:39:26,495][106226] Updated weights for policy 0, policy_version 890985 (0.0007) [2023-12-28 01:39:26,554][106226] Updated weights for policy 0, policy_version 890995 (0.0006) [2023-12-28 01:39:26,612][106226] Updated weights for policy 0, policy_version 891005 (0.0006) [2023-12-28 01:39:26,672][106226] Updated weights for policy 0, policy_version 891015 (0.0006) [2023-12-28 01:39:26,952][106225] Updated weights for policy 1, policy_version 893217 (0.0010) [2023-12-28 01:39:27,011][106225] Updated weights for policy 1, policy_version 893227 (0.0010) [2023-12-28 01:39:27,056][106225] Updated weights for policy 1, policy_version 893237 (0.0010) [2023-12-28 01:39:27,102][106225] Updated weights for policy 1, policy_version 893247 (0.0010) [2023-12-28 01:39:27,269][106226] Updated weights for policy 0, policy_version 891025 (0.0009) [2023-12-28 01:39:27,329][106226] Updated weights for policy 0, policy_version 891035 (0.0008) [2023-12-28 01:39:27,390][106226] Updated weights for policy 0, policy_version 891045 (0.0007) [2023-12-28 01:39:27,800][106225] Updated weights for policy 1, policy_version 893257 (0.0007) [2023-12-28 01:39:27,870][106225] Updated weights for policy 1, policy_version 893267 (0.0007) [2023-12-28 01:39:27,933][106225] Updated weights for policy 1, policy_version 893277 (0.0006) [2023-12-28 01:39:28,076][106226] Updated weights for policy 0, policy_version 891055 (0.0009) [2023-12-28 01:39:28,132][106226] Updated weights for policy 0, policy_version 891065 (0.0007) [2023-12-28 01:39:28,188][106226] Updated weights for policy 0, policy_version 891075 (0.0007) [2023-12-28 01:39:28,571][106225] Updated weights for policy 1, policy_version 893287 (0.0009) [2023-12-28 01:39:28,634][106225] Updated weights for policy 1, policy_version 893297 (0.0010) [2023-12-28 01:39:28,693][106225] Updated weights for policy 1, policy_version 893307 (0.0010) [2023-12-28 01:39:28,907][106226] Updated weights for policy 0, policy_version 891085 (0.0008) [2023-12-28 01:39:28,963][106226] Updated weights for policy 0, policy_version 891095 (0.0008) [2023-12-28 01:39:29,021][106226] Updated weights for policy 0, policy_version 891105 (0.0008) [2023-12-28 01:39:29,313][106225] Updated weights for policy 1, policy_version 893317 (0.0010) [2023-12-28 01:39:29,371][106225] Updated weights for policy 1, policy_version 893327 (0.0009) [2023-12-28 01:39:29,433][106225] Updated weights for policy 1, policy_version 893337 (0.0007) [2023-12-28 01:39:29,737][106226] Updated weights for policy 0, policy_version 891115 (0.0008) [2023-12-28 01:39:29,790][106226] Updated weights for policy 0, policy_version 891125 (0.0011) [2023-12-28 01:39:29,847][106226] Updated weights for policy 0, policy_version 891135 (0.0010) [2023-12-28 01:39:30,011][106225] Updated weights for policy 1, policy_version 893347 (0.0006) [2023-12-28 01:39:30,066][106225] Updated weights for policy 1, policy_version 893357 (0.0006) [2023-12-28 01:39:30,128][106225] Updated weights for policy 1, policy_version 893367 (0.0009) [2023-12-28 01:39:30,615][106226] Updated weights for policy 0, policy_version 891145 (0.0008) [2023-12-28 01:39:30,672][106226] Updated weights for policy 0, policy_version 891155 (0.0006) [2023-12-28 01:39:30,735][106226] Updated weights for policy 0, policy_version 891165 (0.0008) [2023-12-28 01:39:30,799][106226] Updated weights for policy 0, policy_version 891175 (0.0006) [2023-12-28 01:39:30,827][106225] Updated weights for policy 1, policy_version 893377 (0.0011) [2023-12-28 01:39:30,886][106225] Updated weights for policy 1, policy_version 893387 (0.0010) [2023-12-28 01:39:30,947][106225] Updated weights for policy 1, policy_version 893397 (0.0008) [2023-12-28 01:39:31,005][106225] Updated weights for policy 1, policy_version 893407 (0.0010) [2023-12-28 01:39:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 456949760. Throughput: 0: 9979.5, 1: 10063.5. Samples: 456936452. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:31,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.907')] [2023-12-28 01:39:31,507][106226] Updated weights for policy 0, policy_version 891185 (0.0010) [2023-12-28 01:39:31,564][106226] Updated weights for policy 0, policy_version 891195 (0.0010) [2023-12-28 01:39:31,616][106226] Updated weights for policy 0, policy_version 891205 (0.0010) [2023-12-28 01:39:31,731][106225] Updated weights for policy 1, policy_version 893417 (0.0009) [2023-12-28 01:39:31,803][106225] Updated weights for policy 1, policy_version 893427 (0.0009) [2023-12-28 01:39:31,865][106225] Updated weights for policy 1, policy_version 893437 (0.0009) [2023-12-28 01:39:32,328][106226] Updated weights for policy 0, policy_version 891215 (0.0010) [2023-12-28 01:39:32,395][106226] Updated weights for policy 0, policy_version 891225 (0.0011) [2023-12-28 01:39:32,446][106226] Updated weights for policy 0, policy_version 891235 (0.0010) [2023-12-28 01:39:32,590][106225] Updated weights for policy 1, policy_version 893447 (0.0007) [2023-12-28 01:39:32,646][106225] Updated weights for policy 1, policy_version 893457 (0.0007) [2023-12-28 01:39:32,699][106225] Updated weights for policy 1, policy_version 893467 (0.0008) [2023-12-28 01:39:33,164][106226] Updated weights for policy 0, policy_version 891245 (0.0008) [2023-12-28 01:39:33,219][106226] Updated weights for policy 0, policy_version 891255 (0.0005) [2023-12-28 01:39:33,274][106226] Updated weights for policy 0, policy_version 891265 (0.0006) [2023-12-28 01:39:33,369][106225] Updated weights for policy 1, policy_version 893477 (0.0009) [2023-12-28 01:39:33,415][106225] Updated weights for policy 1, policy_version 893487 (0.0010) [2023-12-28 01:39:33,461][106225] Updated weights for policy 1, policy_version 893497 (0.0010) [2023-12-28 01:39:33,809][106226] Updated weights for policy 0, policy_version 891275 (0.0005) [2023-12-28 01:39:33,873][106226] Updated weights for policy 0, policy_version 891285 (0.0005) [2023-12-28 01:39:33,923][106226] Updated weights for policy 0, policy_version 891295 (0.0005) [2023-12-28 01:39:34,082][106225] Updated weights for policy 1, policy_version 893507 (0.0009) [2023-12-28 01:39:34,142][106225] Updated weights for policy 1, policy_version 893517 (0.0007) [2023-12-28 01:39:34,207][106225] Updated weights for policy 1, policy_version 893527 (0.0008) [2023-12-28 01:39:34,572][106226] Updated weights for policy 0, policy_version 891305 (0.0006) [2023-12-28 01:39:34,636][106226] Updated weights for policy 0, policy_version 891315 (0.0008) [2023-12-28 01:39:34,687][106226] Updated weights for policy 0, policy_version 891325 (0.0007) [2023-12-28 01:39:34,738][106226] Updated weights for policy 0, policy_version 891335 (0.0008) [2023-12-28 01:39:34,905][106225] Updated weights for policy 1, policy_version 893537 (0.0007) [2023-12-28 01:39:34,952][106225] Updated weights for policy 1, policy_version 893547 (0.0010) [2023-12-28 01:39:35,002][106225] Updated weights for policy 1, policy_version 893557 (0.0010) [2023-12-28 01:39:35,055][106225] Updated weights for policy 1, policy_version 893567 (0.0010) [2023-12-28 01:39:35,480][106226] Updated weights for policy 0, policy_version 891345 (0.0007) [2023-12-28 01:39:35,544][106226] Updated weights for policy 0, policy_version 891355 (0.0008) [2023-12-28 01:39:35,609][106226] Updated weights for policy 0, policy_version 891365 (0.0007) [2023-12-28 01:39:35,777][106225] Updated weights for policy 1, policy_version 893577 (0.0006) [2023-12-28 01:39:35,829][106225] Updated weights for policy 1, policy_version 893587 (0.0006) [2023-12-28 01:39:35,876][106225] Updated weights for policy 1, policy_version 893597 (0.0010) [2023-12-28 01:39:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19934.0, 300 sec: 19716.4). Total num frames: 457048064. Throughput: 0: 9966.3, 1: 10095.3. Samples: 457058392. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:36,175][105115] Avg episode reward: [(0, '-4.195'), (1, '-5.243')] [2023-12-28 01:39:36,213][106226] Updated weights for policy 0, policy_version 891375 (0.0007) [2023-12-28 01:39:36,271][106226] Updated weights for policy 0, policy_version 891385 (0.0010) [2023-12-28 01:39:36,328][106226] Updated weights for policy 0, policy_version 891395 (0.0008) [2023-12-28 01:39:36,503][106225] Updated weights for policy 1, policy_version 893607 (0.0010) [2023-12-28 01:39:36,550][106225] Updated weights for policy 1, policy_version 893617 (0.0010) [2023-12-28 01:39:36,602][106225] Updated weights for policy 1, policy_version 893627 (0.0010) [2023-12-28 01:39:37,017][106226] Updated weights for policy 0, policy_version 891405 (0.0009) [2023-12-28 01:39:37,077][106226] Updated weights for policy 0, policy_version 891415 (0.0010) [2023-12-28 01:39:37,139][106226] Updated weights for policy 0, policy_version 891425 (0.0011) [2023-12-28 01:39:37,304][106225] Updated weights for policy 1, policy_version 893637 (0.0010) [2023-12-28 01:39:37,354][106225] Updated weights for policy 1, policy_version 893647 (0.0010) [2023-12-28 01:39:37,418][106225] Updated weights for policy 1, policy_version 893657 (0.0010) [2023-12-28 01:39:37,806][106226] Updated weights for policy 0, policy_version 891435 (0.0011) [2023-12-28 01:39:37,856][106226] Updated weights for policy 0, policy_version 891445 (0.0010) [2023-12-28 01:39:37,905][106226] Updated weights for policy 0, policy_version 891455 (0.0010) [2023-12-28 01:39:38,121][106225] Updated weights for policy 1, policy_version 893667 (0.0009) [2023-12-28 01:39:38,184][106225] Updated weights for policy 1, policy_version 893677 (0.0010) [2023-12-28 01:39:38,241][106225] Updated weights for policy 1, policy_version 893687 (0.0010) [2023-12-28 01:39:38,593][106226] Updated weights for policy 0, policy_version 891465 (0.0011) [2023-12-28 01:39:38,644][106226] Updated weights for policy 0, policy_version 891475 (0.0010) [2023-12-28 01:39:38,695][106226] Updated weights for policy 0, policy_version 891485 (0.0010) [2023-12-28 01:39:38,750][106226] Updated weights for policy 0, policy_version 891495 (0.0011) [2023-12-28 01:39:38,973][106225] Updated weights for policy 1, policy_version 893697 (0.0010) [2023-12-28 01:39:39,033][106225] Updated weights for policy 1, policy_version 893707 (0.0010) [2023-12-28 01:39:39,092][106225] Updated weights for policy 1, policy_version 893717 (0.0010) [2023-12-28 01:39:39,149][106225] Updated weights for policy 1, policy_version 893727 (0.0010) [2023-12-28 01:39:39,463][106226] Updated weights for policy 0, policy_version 891505 (0.0008) [2023-12-28 01:39:39,528][106226] Updated weights for policy 0, policy_version 891515 (0.0008) [2023-12-28 01:39:39,598][106226] Updated weights for policy 0, policy_version 891525 (0.0007) [2023-12-28 01:39:39,889][106225] Updated weights for policy 1, policy_version 893737 (0.0009) [2023-12-28 01:39:39,960][106225] Updated weights for policy 1, policy_version 893747 (0.0009) [2023-12-28 01:39:40,021][106225] Updated weights for policy 1, policy_version 893757 (0.0009) [2023-12-28 01:39:40,340][106226] Updated weights for policy 0, policy_version 891535 (0.0007) [2023-12-28 01:39:40,411][106226] Updated weights for policy 0, policy_version 891545 (0.0008) [2023-12-28 01:39:40,478][106226] Updated weights for policy 0, policy_version 891555 (0.0008) [2023-12-28 01:39:40,699][106225] Updated weights for policy 1, policy_version 893767 (0.0008) [2023-12-28 01:39:40,754][106225] Updated weights for policy 1, policy_version 893777 (0.0008) [2023-12-28 01:39:40,817][106225] Updated weights for policy 1, policy_version 893787 (0.0008) [2023-12-28 01:39:41,170][106226] Updated weights for policy 0, policy_version 891565 (0.0008) [2023-12-28 01:39:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 457146368. Throughput: 0: 10043.2, 1: 10122.1. Samples: 457119192. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:41,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.837')] [2023-12-28 01:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000893792_228851712.pth... [2023-12-28 01:39:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000892608_228548608.pth [2023-12-28 01:39:41,230][106226] Updated weights for policy 0, policy_version 891575 (0.0009) [2023-12-28 01:39:41,298][106226] Updated weights for policy 0, policy_version 891585 (0.0007) [2023-12-28 01:39:41,368][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000891592_228302848.pth... [2023-12-28 01:39:41,373][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000890408_227999744.pth [2023-12-28 01:39:41,556][106225] Updated weights for policy 1, policy_version 893797 (0.0008) [2023-12-28 01:39:41,623][106225] Updated weights for policy 1, policy_version 893807 (0.0009) [2023-12-28 01:39:41,693][106225] Updated weights for policy 1, policy_version 893817 (0.0007) [2023-12-28 01:39:42,055][106226] Updated weights for policy 0, policy_version 891595 (0.0008) [2023-12-28 01:39:42,107][106226] Updated weights for policy 0, policy_version 891605 (0.0011) [2023-12-28 01:39:42,162][106226] Updated weights for policy 0, policy_version 891615 (0.0009) [2023-12-28 01:39:42,327][106225] Updated weights for policy 1, policy_version 893827 (0.0008) [2023-12-28 01:39:42,400][106225] Updated weights for policy 1, policy_version 893837 (0.0007) [2023-12-28 01:39:42,467][106225] Updated weights for policy 1, policy_version 893847 (0.0008) [2023-12-28 01:39:42,885][106226] Updated weights for policy 0, policy_version 891625 (0.0010) [2023-12-28 01:39:42,942][106226] Updated weights for policy 0, policy_version 891635 (0.0008) [2023-12-28 01:39:43,006][106226] Updated weights for policy 0, policy_version 891645 (0.0008) [2023-12-28 01:39:43,063][106226] Updated weights for policy 0, policy_version 891655 (0.0007) [2023-12-28 01:39:43,178][106225] Updated weights for policy 1, policy_version 893857 (0.0010) [2023-12-28 01:39:43,246][106225] Updated weights for policy 1, policy_version 893867 (0.0010) [2023-12-28 01:39:43,306][106225] Updated weights for policy 1, policy_version 893877 (0.0010) [2023-12-28 01:39:43,363][106225] Updated weights for policy 1, policy_version 893887 (0.0010) [2023-12-28 01:39:43,766][106226] Updated weights for policy 0, policy_version 891665 (0.0008) [2023-12-28 01:39:43,826][106226] Updated weights for policy 0, policy_version 891675 (0.0008) [2023-12-28 01:39:43,879][106226] Updated weights for policy 0, policy_version 891685 (0.0008) [2023-12-28 01:39:44,080][106225] Updated weights for policy 1, policy_version 893897 (0.0010) [2023-12-28 01:39:44,136][106225] Updated weights for policy 1, policy_version 893907 (0.0010) [2023-12-28 01:39:44,190][106225] Updated weights for policy 1, policy_version 893917 (0.0010) [2023-12-28 01:39:44,629][106226] Updated weights for policy 0, policy_version 891695 (0.0006) [2023-12-28 01:39:44,692][106226] Updated weights for policy 0, policy_version 891705 (0.0008) [2023-12-28 01:39:44,754][106226] Updated weights for policy 0, policy_version 891715 (0.0008) [2023-12-28 01:39:44,928][106225] Updated weights for policy 1, policy_version 893927 (0.0010) [2023-12-28 01:39:44,987][106225] Updated weights for policy 1, policy_version 893937 (0.0010) [2023-12-28 01:39:45,053][106225] Updated weights for policy 1, policy_version 893947 (0.0010) [2023-12-28 01:39:45,505][106226] Updated weights for policy 0, policy_version 891725 (0.0009) [2023-12-28 01:39:45,565][106226] Updated weights for policy 0, policy_version 891735 (0.0010) [2023-12-28 01:39:45,627][106226] Updated weights for policy 0, policy_version 891745 (0.0010) [2023-12-28 01:39:45,770][106225] Updated weights for policy 1, policy_version 893957 (0.0010) [2023-12-28 01:39:45,825][106225] Updated weights for policy 1, policy_version 893967 (0.0010) [2023-12-28 01:39:45,880][106225] Updated weights for policy 1, policy_version 893977 (0.0010) [2023-12-28 01:39:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19688.6). Total num frames: 457244672. Throughput: 0: 10009.1, 1: 9999.5. Samples: 457233940. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:46,175][105115] Avg episode reward: [(0, '-4.238'), (1, '-4.701')] [2023-12-28 01:39:46,304][106226] Updated weights for policy 0, policy_version 891755 (0.0009) [2023-12-28 01:39:46,365][106226] Updated weights for policy 0, policy_version 891765 (0.0011) [2023-12-28 01:39:46,427][106226] Updated weights for policy 0, policy_version 891775 (0.0011) [2023-12-28 01:39:46,645][106225] Updated weights for policy 1, policy_version 893987 (0.0009) [2023-12-28 01:39:46,695][106225] Updated weights for policy 1, policy_version 893997 (0.0008) [2023-12-28 01:39:46,757][106225] Updated weights for policy 1, policy_version 894007 (0.0007) [2023-12-28 01:39:47,140][106226] Updated weights for policy 0, policy_version 891785 (0.0011) [2023-12-28 01:39:47,189][106226] Updated weights for policy 0, policy_version 891795 (0.0010) [2023-12-28 01:39:47,245][106226] Updated weights for policy 0, policy_version 891805 (0.0010) [2023-12-28 01:39:47,294][106226] Updated weights for policy 0, policy_version 891815 (0.0010) [2023-12-28 01:39:47,469][106225] Updated weights for policy 1, policy_version 894017 (0.0008) [2023-12-28 01:39:47,522][106225] Updated weights for policy 1, policy_version 894027 (0.0008) [2023-12-28 01:39:47,578][106225] Updated weights for policy 1, policy_version 894037 (0.0008) [2023-12-28 01:39:47,632][106225] Updated weights for policy 1, policy_version 894047 (0.0008) [2023-12-28 01:39:48,003][106226] Updated weights for policy 0, policy_version 891825 (0.0008) [2023-12-28 01:39:48,061][106226] Updated weights for policy 0, policy_version 891835 (0.0008) [2023-12-28 01:39:48,115][106226] Updated weights for policy 0, policy_version 891845 (0.0007) [2023-12-28 01:39:48,387][106225] Updated weights for policy 1, policy_version 894057 (0.0008) [2023-12-28 01:39:48,445][106225] Updated weights for policy 1, policy_version 894067 (0.0008) [2023-12-28 01:39:48,497][106225] Updated weights for policy 1, policy_version 894077 (0.0008) [2023-12-28 01:39:48,806][106226] Updated weights for policy 0, policy_version 891855 (0.0006) [2023-12-28 01:39:48,865][106226] Updated weights for policy 0, policy_version 891865 (0.0006) [2023-12-28 01:39:48,931][106226] Updated weights for policy 0, policy_version 891875 (0.0008) [2023-12-28 01:39:49,238][106225] Updated weights for policy 1, policy_version 894087 (0.0007) [2023-12-28 01:39:49,304][106225] Updated weights for policy 1, policy_version 894097 (0.0007) [2023-12-28 01:39:49,375][106225] Updated weights for policy 1, policy_version 894107 (0.0007) [2023-12-28 01:39:49,659][106226] Updated weights for policy 0, policy_version 891885 (0.0008) [2023-12-28 01:39:49,718][106226] Updated weights for policy 0, policy_version 891895 (0.0008) [2023-12-28 01:39:49,777][106226] Updated weights for policy 0, policy_version 891905 (0.0008) [2023-12-28 01:39:50,039][106225] Updated weights for policy 1, policy_version 894117 (0.0008) [2023-12-28 01:39:50,094][106225] Updated weights for policy 1, policy_version 894127 (0.0007) [2023-12-28 01:39:50,154][106225] Updated weights for policy 1, policy_version 894137 (0.0008) [2023-12-28 01:39:50,486][106226] Updated weights for policy 0, policy_version 891915 (0.0009) [2023-12-28 01:39:50,546][106226] Updated weights for policy 0, policy_version 891925 (0.0009) [2023-12-28 01:39:50,611][106226] Updated weights for policy 0, policy_version 891935 (0.0008) [2023-12-28 01:39:50,978][106225] Updated weights for policy 1, policy_version 894147 (0.0009) [2023-12-28 01:39:51,053][106225] Updated weights for policy 1, policy_version 894157 (0.0008) [2023-12-28 01:39:51,118][106225] Updated weights for policy 1, policy_version 894167 (0.0008) [2023-12-28 01:39:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19934.0, 300 sec: 19660.8). Total num frames: 457334784. Throughput: 0: 9872.4, 1: 9932.8. Samples: 457349328. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:51,175][105115] Avg episode reward: [(0, '-4.161'), (1, '-4.705')] [2023-12-28 01:39:51,405][106226] Updated weights for policy 0, policy_version 891945 (0.0009) [2023-12-28 01:39:51,481][106226] Updated weights for policy 0, policy_version 891955 (0.0008) [2023-12-28 01:39:51,553][106226] Updated weights for policy 0, policy_version 891965 (0.0010) [2023-12-28 01:39:51,617][106226] Updated weights for policy 0, policy_version 891975 (0.0008) [2023-12-28 01:39:51,881][106225] Updated weights for policy 1, policy_version 894177 (0.0009) [2023-12-28 01:39:51,943][106225] Updated weights for policy 1, policy_version 894187 (0.0008) [2023-12-28 01:39:52,011][106225] Updated weights for policy 1, policy_version 894197 (0.0005) [2023-12-28 01:39:52,077][106225] Updated weights for policy 1, policy_version 894207 (0.0006) [2023-12-28 01:39:52,337][106226] Updated weights for policy 0, policy_version 891985 (0.0008) [2023-12-28 01:39:52,405][106226] Updated weights for policy 0, policy_version 891995 (0.0007) [2023-12-28 01:39:52,454][106226] Updated weights for policy 0, policy_version 892005 (0.0008) [2023-12-28 01:39:52,686][106225] Updated weights for policy 1, policy_version 894217 (0.0006) [2023-12-28 01:39:52,748][106225] Updated weights for policy 1, policy_version 894227 (0.0008) [2023-12-28 01:39:52,808][106225] Updated weights for policy 1, policy_version 894237 (0.0008) [2023-12-28 01:39:53,207][106226] Updated weights for policy 0, policy_version 892015 (0.0009) [2023-12-28 01:39:53,276][106226] Updated weights for policy 0, policy_version 892025 (0.0009) [2023-12-28 01:39:53,343][106226] Updated weights for policy 0, policy_version 892035 (0.0010) [2023-12-28 01:39:53,454][106225] Updated weights for policy 1, policy_version 894247 (0.0007) [2023-12-28 01:39:53,522][106225] Updated weights for policy 1, policy_version 894257 (0.0005) [2023-12-28 01:39:53,590][106225] Updated weights for policy 1, policy_version 894267 (0.0005) [2023-12-28 01:39:53,989][106226] Updated weights for policy 0, policy_version 892045 (0.0009) [2023-12-28 01:39:54,052][106226] Updated weights for policy 0, policy_version 892055 (0.0008) [2023-12-28 01:39:54,115][106226] Updated weights for policy 0, policy_version 892065 (0.0007) [2023-12-28 01:39:54,234][106225] Updated weights for policy 1, policy_version 894277 (0.0006) [2023-12-28 01:39:54,289][106225] Updated weights for policy 1, policy_version 894287 (0.0010) [2023-12-28 01:39:54,340][106225] Updated weights for policy 1, policy_version 894297 (0.0010) [2023-12-28 01:39:54,850][106226] Updated weights for policy 0, policy_version 892075 (0.0008) [2023-12-28 01:39:54,909][106226] Updated weights for policy 0, policy_version 892085 (0.0007) [2023-12-28 01:39:54,954][106225] Updated weights for policy 1, policy_version 894307 (0.0007) [2023-12-28 01:39:54,968][106226] Updated weights for policy 0, policy_version 892095 (0.0006) [2023-12-28 01:39:55,007][106225] Updated weights for policy 1, policy_version 894317 (0.0010) [2023-12-28 01:39:55,086][106225] Updated weights for policy 1, policy_version 894327 (0.0011) [2023-12-28 01:39:55,634][106226] Updated weights for policy 0, policy_version 892105 (0.0007) [2023-12-28 01:39:55,696][106226] Updated weights for policy 0, policy_version 892115 (0.0007) [2023-12-28 01:39:55,759][106226] Updated weights for policy 0, policy_version 892125 (0.0006) [2023-12-28 01:39:55,790][106225] Updated weights for policy 1, policy_version 894337 (0.0010) [2023-12-28 01:39:55,811][106226] Updated weights for policy 0, policy_version 892135 (0.0007) [2023-12-28 01:39:55,856][106225] Updated weights for policy 1, policy_version 894347 (0.0010) [2023-12-28 01:39:55,914][106225] Updated weights for policy 1, policy_version 894357 (0.0010) [2023-12-28 01:39:55,961][106225] Updated weights for policy 1, policy_version 894367 (0.0010) [2023-12-28 01:39:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 457441280. Throughput: 0: 9855.7, 1: 9892.8. Samples: 457408348. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:39:56,175][105115] Avg episode reward: [(0, '-4.113'), (1, '-4.892')] [2023-12-28 01:39:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000894368_228999168.pth... [2023-12-28 01:39:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000892136_228442112.pth... [2023-12-28 01:39:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000893216_228704256.pth [2023-12-28 01:39:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000890984_228147200.pth [2023-12-28 01:39:56,403][106226] Updated weights for policy 0, policy_version 892145 (0.0005) [2023-12-28 01:39:56,462][106226] Updated weights for policy 0, policy_version 892155 (0.0005) [2023-12-28 01:39:56,515][106226] Updated weights for policy 0, policy_version 892165 (0.0006) [2023-12-28 01:39:56,697][106225] Updated weights for policy 1, policy_version 894377 (0.0010) [2023-12-28 01:39:56,744][106225] Updated weights for policy 1, policy_version 894387 (0.0010) [2023-12-28 01:39:56,787][106225] Updated weights for policy 1, policy_version 894397 (0.0010) [2023-12-28 01:39:57,031][106226] Updated weights for policy 0, policy_version 892175 (0.0007) [2023-12-28 01:39:57,096][106226] Updated weights for policy 0, policy_version 892185 (0.0008) [2023-12-28 01:39:57,159][106226] Updated weights for policy 0, policy_version 892195 (0.0008) [2023-12-28 01:39:57,480][106225] Updated weights for policy 1, policy_version 894407 (0.0009) [2023-12-28 01:39:57,530][106225] Updated weights for policy 1, policy_version 894417 (0.0010) [2023-12-28 01:39:57,590][106225] Updated weights for policy 1, policy_version 894427 (0.0010) [2023-12-28 01:39:57,881][106226] Updated weights for policy 0, policy_version 892205 (0.0008) [2023-12-28 01:39:57,946][106226] Updated weights for policy 0, policy_version 892215 (0.0008) [2023-12-28 01:39:58,010][106226] Updated weights for policy 0, policy_version 892225 (0.0008) [2023-12-28 01:39:58,300][106225] Updated weights for policy 1, policy_version 894437 (0.0010) [2023-12-28 01:39:58,373][106225] Updated weights for policy 1, policy_version 894447 (0.0010) [2023-12-28 01:39:58,439][106225] Updated weights for policy 1, policy_version 894457 (0.0007) [2023-12-28 01:39:58,793][106226] Updated weights for policy 0, policy_version 892235 (0.0008) [2023-12-28 01:39:58,857][106226] Updated weights for policy 0, policy_version 892245 (0.0008) [2023-12-28 01:39:58,920][106226] Updated weights for policy 0, policy_version 892255 (0.0009) [2023-12-28 01:39:59,176][106225] Updated weights for policy 1, policy_version 894467 (0.0008) [2023-12-28 01:39:59,241][106225] Updated weights for policy 1, policy_version 894477 (0.0008) [2023-12-28 01:39:59,304][106225] Updated weights for policy 1, policy_version 894487 (0.0008) [2023-12-28 01:39:59,765][106226] Updated weights for policy 0, policy_version 892265 (0.0009) [2023-12-28 01:39:59,817][106226] Updated weights for policy 0, policy_version 892275 (0.0008) [2023-12-28 01:39:59,883][106226] Updated weights for policy 0, policy_version 892285 (0.0009) [2023-12-28 01:39:59,944][106225] Updated weights for policy 1, policy_version 894497 (0.0007) [2023-12-28 01:39:59,954][106226] Updated weights for policy 0, policy_version 892295 (0.0009) [2023-12-28 01:39:59,988][106225] Updated weights for policy 1, policy_version 894507 (0.0005) [2023-12-28 01:40:00,051][106225] Updated weights for policy 1, policy_version 894517 (0.0009) [2023-12-28 01:40:00,110][106225] Updated weights for policy 1, policy_version 894527 (0.0008) [2023-12-28 01:40:00,693][106226] Updated weights for policy 0, policy_version 892305 (0.0008) [2023-12-28 01:40:00,739][106225] Updated weights for policy 1, policy_version 894537 (0.0007) [2023-12-28 01:40:00,745][106226] Updated weights for policy 0, policy_version 892315 (0.0007) [2023-12-28 01:40:00,791][106226] Updated weights for policy 0, policy_version 892325 (0.0007) [2023-12-28 01:40:00,798][106225] Updated weights for policy 1, policy_version 894547 (0.0008) [2023-12-28 01:40:00,844][106225] Updated weights for policy 1, policy_version 894557 (0.0007) [2023-12-28 01:40:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 457539584. Throughput: 0: 9837.7, 1: 9934.9. Samples: 457527452. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 01:40:01,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.015')] [2023-12-28 01:40:01,566][106226] Updated weights for policy 0, policy_version 892335 (0.0007) [2023-12-28 01:40:01,570][106225] Updated weights for policy 1, policy_version 894567 (0.0007) [2023-12-28 01:40:01,624][106226] Updated weights for policy 0, policy_version 892345 (0.0007) [2023-12-28 01:40:01,631][106225] Updated weights for policy 1, policy_version 894577 (0.0007) [2023-12-28 01:40:01,690][106226] Updated weights for policy 0, policy_version 892355 (0.0007) [2023-12-28 01:40:01,695][106225] Updated weights for policy 1, policy_version 894587 (0.0006) [2023-12-28 01:40:02,335][106226] Updated weights for policy 0, policy_version 892365 (0.0008) [2023-12-28 01:40:02,404][106226] Updated weights for policy 0, policy_version 892375 (0.0007) [2023-12-28 01:40:02,439][106225] Updated weights for policy 1, policy_version 894597 (0.0009) [2023-12-28 01:40:02,465][106226] Updated weights for policy 0, policy_version 892385 (0.0006) [2023-12-28 01:40:02,500][106225] Updated weights for policy 1, policy_version 894607 (0.0008) [2023-12-28 01:40:02,559][106225] Updated weights for policy 1, policy_version 894617 (0.0007) [2023-12-28 01:40:03,134][106226] Updated weights for policy 0, policy_version 892395 (0.0008) [2023-12-28 01:40:03,186][106226] Updated weights for policy 0, policy_version 892405 (0.0009) [2023-12-28 01:40:03,245][106225] Updated weights for policy 1, policy_version 894627 (0.0007) [2023-12-28 01:40:03,253][106226] Updated weights for policy 0, policy_version 892415 (0.0009) [2023-12-28 01:40:03,298][106225] Updated weights for policy 1, policy_version 894637 (0.0005) [2023-12-28 01:40:03,352][106225] Updated weights for policy 1, policy_version 894647 (0.0008) [2023-12-28 01:40:03,988][106226] Updated weights for policy 0, policy_version 892425 (0.0006) [2023-12-28 01:40:04,048][106226] Updated weights for policy 0, policy_version 892435 (0.0008) [2023-12-28 01:40:04,065][106225] Updated weights for policy 1, policy_version 894657 (0.0007) [2023-12-28 01:40:04,106][106226] Updated weights for policy 0, policy_version 892445 (0.0009) [2023-12-28 01:40:04,120][106225] Updated weights for policy 1, policy_version 894667 (0.0005) [2023-12-28 01:40:04,174][106226] Updated weights for policy 0, policy_version 892455 (0.0007) [2023-12-28 01:40:04,178][106225] Updated weights for policy 1, policy_version 894677 (0.0005) [2023-12-28 01:40:04,239][106225] Updated weights for policy 1, policy_version 894687 (0.0006) [2023-12-28 01:40:04,821][106226] Updated weights for policy 0, policy_version 892465 (0.0009) [2023-12-28 01:40:04,876][106226] Updated weights for policy 0, policy_version 892475 (0.0008) [2023-12-28 01:40:04,936][106226] Updated weights for policy 0, policy_version 892485 (0.0008) [2023-12-28 01:40:04,953][106225] Updated weights for policy 1, policy_version 894697 (0.0006) [2023-12-28 01:40:04,998][106225] Updated weights for policy 1, policy_version 894707 (0.0008) [2023-12-28 01:40:05,061][106225] Updated weights for policy 1, policy_version 894717 (0.0008) [2023-12-28 01:40:05,648][106226] Updated weights for policy 0, policy_version 892495 (0.0010) [2023-12-28 01:40:05,694][106226] Updated weights for policy 0, policy_version 892505 (0.0010) [2023-12-28 01:40:05,749][106226] Updated weights for policy 0, policy_version 892515 (0.0011) [2023-12-28 01:40:05,788][106225] Updated weights for policy 1, policy_version 894727 (0.0007) [2023-12-28 01:40:05,848][106225] Updated weights for policy 1, policy_version 894737 (0.0008) [2023-12-28 01:40:05,898][106225] Updated weights for policy 1, policy_version 894747 (0.0007) [2023-12-28 01:40:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 457637888. Throughput: 0: 9797.3, 1: 9928.5. Samples: 457645580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:06,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.846')] [2023-12-28 01:40:06,482][106226] Updated weights for policy 0, policy_version 892525 (0.0011) [2023-12-28 01:40:06,544][106226] Updated weights for policy 0, policy_version 892535 (0.0011) [2023-12-28 01:40:06,555][106225] Updated weights for policy 1, policy_version 894757 (0.0007) [2023-12-28 01:40:06,603][106226] Updated weights for policy 0, policy_version 892545 (0.0011) [2023-12-28 01:40:06,619][106225] Updated weights for policy 1, policy_version 894767 (0.0006) [2023-12-28 01:40:06,684][106225] Updated weights for policy 1, policy_version 894777 (0.0006) [2023-12-28 01:40:07,210][106225] Updated weights for policy 1, policy_version 894787 (0.0007) [2023-12-28 01:40:07,228][106226] Updated weights for policy 0, policy_version 892555 (0.0011) [2023-12-28 01:40:07,267][106225] Updated weights for policy 1, policy_version 894797 (0.0007) [2023-12-28 01:40:07,287][106226] Updated weights for policy 0, policy_version 892565 (0.0011) [2023-12-28 01:40:07,329][106225] Updated weights for policy 1, policy_version 894807 (0.0010) [2023-12-28 01:40:07,347][106226] Updated weights for policy 0, policy_version 892575 (0.0011) [2023-12-28 01:40:07,938][106225] Updated weights for policy 1, policy_version 894817 (0.0006) [2023-12-28 01:40:07,991][106225] Updated weights for policy 1, policy_version 894827 (0.0005) [2023-12-28 01:40:08,032][106226] Updated weights for policy 0, policy_version 892585 (0.0010) [2023-12-28 01:40:08,045][106225] Updated weights for policy 1, policy_version 894837 (0.0005) [2023-12-28 01:40:08,089][106226] Updated weights for policy 0, policy_version 892595 (0.0008) [2023-12-28 01:40:08,095][106225] Updated weights for policy 1, policy_version 894847 (0.0005) [2023-12-28 01:40:08,141][106226] Updated weights for policy 0, policy_version 892605 (0.0009) [2023-12-28 01:40:08,203][106226] Updated weights for policy 0, policy_version 892615 (0.0009) [2023-12-28 01:40:08,776][106225] Updated weights for policy 1, policy_version 894857 (0.0007) [2023-12-28 01:40:08,840][106225] Updated weights for policy 1, policy_version 894867 (0.0008) [2023-12-28 01:40:08,897][106226] Updated weights for policy 0, policy_version 892625 (0.0008) [2023-12-28 01:40:08,904][106225] Updated weights for policy 1, policy_version 894877 (0.0009) [2023-12-28 01:40:08,961][106226] Updated weights for policy 0, policy_version 892635 (0.0007) [2023-12-28 01:40:09,021][106226] Updated weights for policy 0, policy_version 892645 (0.0010) [2023-12-28 01:40:09,715][106225] Updated weights for policy 1, policy_version 894887 (0.0010) [2023-12-28 01:40:09,716][106226] Updated weights for policy 0, policy_version 892655 (0.0011) [2023-12-28 01:40:09,777][106225] Updated weights for policy 1, policy_version 894897 (0.0007) [2023-12-28 01:40:09,778][106226] Updated weights for policy 0, policy_version 892665 (0.0011) [2023-12-28 01:40:09,847][106226] Updated weights for policy 0, policy_version 892675 (0.0010) [2023-12-28 01:40:09,848][106225] Updated weights for policy 1, policy_version 894907 (0.0009) [2023-12-28 01:40:10,474][106225] Updated weights for policy 1, policy_version 894917 (0.0006) [2023-12-28 01:40:10,536][106225] Updated weights for policy 1, policy_version 894927 (0.0011) [2023-12-28 01:40:10,594][106225] Updated weights for policy 1, policy_version 894937 (0.0010) [2023-12-28 01:40:10,629][106226] Updated weights for policy 0, policy_version 892685 (0.0006) [2023-12-28 01:40:10,696][106226] Updated weights for policy 0, policy_version 892695 (0.0010) [2023-12-28 01:40:10,760][106226] Updated weights for policy 0, policy_version 892705 (0.0009) [2023-12-28 01:40:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 457736192. Throughput: 0: 9858.9, 1: 10010.8. Samples: 457708920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:11,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.922')] [2023-12-28 01:40:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000894944_229146624.pth... [2023-12-28 01:40:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000892712_228589568.pth... [2023-12-28 01:40:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000893792_228851712.pth [2023-12-28 01:40:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000891592_228302848.pth [2023-12-28 01:40:11,259][106225] Updated weights for policy 1, policy_version 894947 (0.0010) [2023-12-28 01:40:11,324][106225] Updated weights for policy 1, policy_version 894957 (0.0008) [2023-12-28 01:40:11,385][106225] Updated weights for policy 1, policy_version 894967 (0.0009) [2023-12-28 01:40:11,550][106226] Updated weights for policy 0, policy_version 892715 (0.0008) [2023-12-28 01:40:11,604][106226] Updated weights for policy 0, policy_version 892725 (0.0008) [2023-12-28 01:40:11,671][106226] Updated weights for policy 0, policy_version 892735 (0.0010) [2023-12-28 01:40:12,055][106225] Updated weights for policy 1, policy_version 894977 (0.0008) [2023-12-28 01:40:12,113][106225] Updated weights for policy 1, policy_version 894987 (0.0010) [2023-12-28 01:40:12,166][106225] Updated weights for policy 1, policy_version 894997 (0.0010) [2023-12-28 01:40:12,212][106225] Updated weights for policy 1, policy_version 895007 (0.0009) [2023-12-28 01:40:12,496][106226] Updated weights for policy 0, policy_version 892745 (0.0009) [2023-12-28 01:40:12,557][106226] Updated weights for policy 0, policy_version 892755 (0.0007) [2023-12-28 01:40:12,622][106226] Updated weights for policy 0, policy_version 892765 (0.0007) [2023-12-28 01:40:12,686][106226] Updated weights for policy 0, policy_version 892775 (0.0011) [2023-12-28 01:40:12,952][106225] Updated weights for policy 1, policy_version 895017 (0.0008) [2023-12-28 01:40:13,006][106225] Updated weights for policy 1, policy_version 895027 (0.0009) [2023-12-28 01:40:13,074][106225] Updated weights for policy 1, policy_version 895037 (0.0006) [2023-12-28 01:40:13,293][106226] Updated weights for policy 0, policy_version 892785 (0.0007) [2023-12-28 01:40:13,349][106226] Updated weights for policy 0, policy_version 892795 (0.0010) [2023-12-28 01:40:13,412][106226] Updated weights for policy 0, policy_version 892805 (0.0010) [2023-12-28 01:40:13,693][106225] Updated weights for policy 1, policy_version 895047 (0.0005) [2023-12-28 01:40:13,757][106225] Updated weights for policy 1, policy_version 895057 (0.0005) [2023-12-28 01:40:13,818][106225] Updated weights for policy 1, policy_version 895067 (0.0007) [2023-12-28 01:40:14,093][106226] Updated weights for policy 0, policy_version 892815 (0.0010) [2023-12-28 01:40:14,154][106226] Updated weights for policy 0, policy_version 892825 (0.0010) [2023-12-28 01:40:14,210][106226] Updated weights for policy 0, policy_version 892835 (0.0010) [2023-12-28 01:40:14,477][106225] Updated weights for policy 1, policy_version 895077 (0.0008) [2023-12-28 01:40:14,523][106225] Updated weights for policy 1, policy_version 895087 (0.0007) [2023-12-28 01:40:14,573][106225] Updated weights for policy 1, policy_version 895097 (0.0007) [2023-12-28 01:40:14,946][106226] Updated weights for policy 0, policy_version 892845 (0.0009) [2023-12-28 01:40:15,008][106226] Updated weights for policy 0, policy_version 892855 (0.0006) [2023-12-28 01:40:15,076][106226] Updated weights for policy 0, policy_version 892865 (0.0006) [2023-12-28 01:40:15,400][106225] Updated weights for policy 1, policy_version 895107 (0.0008) [2023-12-28 01:40:15,464][106225] Updated weights for policy 1, policy_version 895117 (0.0008) [2023-12-28 01:40:15,527][106225] Updated weights for policy 1, policy_version 895127 (0.0008) [2023-12-28 01:40:15,681][106226] Updated weights for policy 0, policy_version 892875 (0.0006) [2023-12-28 01:40:15,739][106226] Updated weights for policy 0, policy_version 892885 (0.0006) [2023-12-28 01:40:15,816][106226] Updated weights for policy 0, policy_version 892895 (0.0006) [2023-12-28 01:40:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 457834496. Throughput: 0: 9816.3, 1: 9946.9. Samples: 457825796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:16,175][105115] Avg episode reward: [(0, '-4.304'), (1, '-4.873')] [2023-12-28 01:40:16,230][106225] Updated weights for policy 1, policy_version 895137 (0.0008) [2023-12-28 01:40:16,286][106225] Updated weights for policy 1, policy_version 895147 (0.0007) [2023-12-28 01:40:16,353][106225] Updated weights for policy 1, policy_version 895157 (0.0007) [2023-12-28 01:40:16,367][106226] Updated weights for policy 0, policy_version 892905 (0.0006) [2023-12-28 01:40:16,413][106225] Updated weights for policy 1, policy_version 895167 (0.0007) [2023-12-28 01:40:16,433][106226] Updated weights for policy 0, policy_version 892915 (0.0011) [2023-12-28 01:40:16,494][106226] Updated weights for policy 0, policy_version 892925 (0.0011) [2023-12-28 01:40:16,556][106226] Updated weights for policy 0, policy_version 892935 (0.0011) [2023-12-28 01:40:17,175][106225] Updated weights for policy 1, policy_version 895177 (0.0008) [2023-12-28 01:40:17,177][106226] Updated weights for policy 0, policy_version 892945 (0.0007) [2023-12-28 01:40:17,227][106225] Updated weights for policy 1, policy_version 895187 (0.0006) [2023-12-28 01:40:17,240][106226] Updated weights for policy 0, policy_version 892955 (0.0007) [2023-12-28 01:40:17,291][106225] Updated weights for policy 1, policy_version 895197 (0.0007) [2023-12-28 01:40:17,301][106226] Updated weights for policy 0, policy_version 892965 (0.0006) [2023-12-28 01:40:17,961][106225] Updated weights for policy 1, policy_version 895207 (0.0006) [2023-12-28 01:40:17,982][106226] Updated weights for policy 0, policy_version 892975 (0.0008) [2023-12-28 01:40:18,023][106225] Updated weights for policy 1, policy_version 895217 (0.0010) [2023-12-28 01:40:18,036][106226] Updated weights for policy 0, policy_version 892985 (0.0005) [2023-12-28 01:40:18,079][106225] Updated weights for policy 1, policy_version 895227 (0.0010) [2023-12-28 01:40:18,090][106226] Updated weights for policy 0, policy_version 892995 (0.0008) [2023-12-28 01:40:18,660][106225] Updated weights for policy 1, policy_version 895237 (0.0009) [2023-12-28 01:40:18,720][106225] Updated weights for policy 1, policy_version 895247 (0.0010) [2023-12-28 01:40:18,782][106225] Updated weights for policy 1, policy_version 895257 (0.0010) [2023-12-28 01:40:18,880][106226] Updated weights for policy 0, policy_version 893005 (0.0008) [2023-12-28 01:40:18,937][106226] Updated weights for policy 0, policy_version 893015 (0.0007) [2023-12-28 01:40:18,998][106226] Updated weights for policy 0, policy_version 893025 (0.0008) [2023-12-28 01:40:19,534][106225] Updated weights for policy 1, policy_version 895267 (0.0010) [2023-12-28 01:40:19,596][106225] Updated weights for policy 1, policy_version 895277 (0.0008) [2023-12-28 01:40:19,659][106225] Updated weights for policy 1, policy_version 895287 (0.0008) [2023-12-28 01:40:19,745][106226] Updated weights for policy 0, policy_version 893035 (0.0008) [2023-12-28 01:40:19,803][106226] Updated weights for policy 0, policy_version 893045 (0.0008) [2023-12-28 01:40:19,877][106226] Updated weights for policy 0, policy_version 893055 (0.0009) [2023-12-28 01:40:20,359][106225] Updated weights for policy 1, policy_version 895297 (0.0008) [2023-12-28 01:40:20,426][106225] Updated weights for policy 1, policy_version 895307 (0.0008) [2023-12-28 01:40:20,490][106225] Updated weights for policy 1, policy_version 895317 (0.0008) [2023-12-28 01:40:20,544][106225] Updated weights for policy 1, policy_version 895327 (0.0006) [2023-12-28 01:40:20,647][106226] Updated weights for policy 0, policy_version 893065 (0.0008) [2023-12-28 01:40:20,710][106226] Updated weights for policy 0, policy_version 893075 (0.0008) [2023-12-28 01:40:20,774][106226] Updated weights for policy 0, policy_version 893085 (0.0008) [2023-12-28 01:40:20,835][106226] Updated weights for policy 0, policy_version 893095 (0.0009) [2023-12-28 01:40:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 457932800. Throughput: 0: 9763.4, 1: 9900.0. Samples: 457943244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:21,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-5.298')] [2023-12-28 01:40:21,254][106225] Updated weights for policy 1, policy_version 895337 (0.0009) [2023-12-28 01:40:21,311][106225] Updated weights for policy 1, policy_version 895347 (0.0010) [2023-12-28 01:40:21,361][106225] Updated weights for policy 1, policy_version 895357 (0.0008) [2023-12-28 01:40:21,583][106226] Updated weights for policy 0, policy_version 893105 (0.0009) [2023-12-28 01:40:21,647][106226] Updated weights for policy 0, policy_version 893115 (0.0008) [2023-12-28 01:40:21,721][106226] Updated weights for policy 0, policy_version 893125 (0.0010) [2023-12-28 01:40:22,153][106225] Updated weights for policy 1, policy_version 895367 (0.0009) [2023-12-28 01:40:22,216][106225] Updated weights for policy 1, policy_version 895377 (0.0008) [2023-12-28 01:40:22,285][106225] Updated weights for policy 1, policy_version 895387 (0.0009) [2023-12-28 01:40:22,454][106226] Updated weights for policy 0, policy_version 893135 (0.0010) [2023-12-28 01:40:22,508][106226] Updated weights for policy 0, policy_version 893145 (0.0009) [2023-12-28 01:40:22,563][106226] Updated weights for policy 0, policy_version 893155 (0.0009) [2023-12-28 01:40:22,930][106225] Updated weights for policy 1, policy_version 895397 (0.0009) [2023-12-28 01:40:22,995][106225] Updated weights for policy 1, policy_version 895407 (0.0009) [2023-12-28 01:40:23,064][106225] Updated weights for policy 1, policy_version 895417 (0.0008) [2023-12-28 01:40:23,300][106226] Updated weights for policy 0, policy_version 893165 (0.0007) [2023-12-28 01:40:23,361][106226] Updated weights for policy 0, policy_version 893175 (0.0005) [2023-12-28 01:40:23,417][106226] Updated weights for policy 0, policy_version 893185 (0.0005) [2023-12-28 01:40:23,748][106225] Updated weights for policy 1, policy_version 895427 (0.0010) [2023-12-28 01:40:23,800][106225] Updated weights for policy 1, policy_version 895437 (0.0009) [2023-12-28 01:40:23,857][106225] Updated weights for policy 1, policy_version 895447 (0.0010) [2023-12-28 01:40:24,082][106226] Updated weights for policy 0, policy_version 893195 (0.0007) [2023-12-28 01:40:24,133][106226] Updated weights for policy 0, policy_version 893205 (0.0010) [2023-12-28 01:40:24,186][106226] Updated weights for policy 0, policy_version 893215 (0.0007) [2023-12-28 01:40:24,565][106225] Updated weights for policy 1, policy_version 895457 (0.0010) [2023-12-28 01:40:24,622][106225] Updated weights for policy 1, policy_version 895467 (0.0010) [2023-12-28 01:40:24,685][106225] Updated weights for policy 1, policy_version 895477 (0.0010) [2023-12-28 01:40:24,749][106225] Updated weights for policy 1, policy_version 895487 (0.0010) [2023-12-28 01:40:24,840][106226] Updated weights for policy 0, policy_version 893225 (0.0006) [2023-12-28 01:40:24,899][106226] Updated weights for policy 0, policy_version 893235 (0.0010) [2023-12-28 01:40:24,954][106226] Updated weights for policy 0, policy_version 893245 (0.0010) [2023-12-28 01:40:25,010][106226] Updated weights for policy 0, policy_version 893255 (0.0010) [2023-12-28 01:40:25,401][106225] Updated weights for policy 1, policy_version 895497 (0.0010) [2023-12-28 01:40:25,450][106225] Updated weights for policy 1, policy_version 895507 (0.0010) [2023-12-28 01:40:25,499][106225] Updated weights for policy 1, policy_version 895517 (0.0009) [2023-12-28 01:40:25,706][106226] Updated weights for policy 0, policy_version 893265 (0.0010) [2023-12-28 01:40:25,756][106226] Updated weights for policy 0, policy_version 893275 (0.0011) [2023-12-28 01:40:25,807][106226] Updated weights for policy 0, policy_version 893285 (0.0006) [2023-12-28 01:40:26,058][106225] Updated weights for policy 1, policy_version 895527 (0.0005) [2023-12-28 01:40:26,121][106225] Updated weights for policy 1, policy_version 895537 (0.0006) [2023-12-28 01:40:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 458031104. Throughput: 0: 9731.7, 1: 9873.3. Samples: 458001420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:26,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.647')] [2023-12-28 01:40:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000893288_228737024.pth... [2023-12-28 01:40:26,183][106225] Updated weights for policy 1, policy_version 895547 (0.0005) [2023-12-28 01:40:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000892136_228442112.pth [2023-12-28 01:40:26,216][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000895552_229302272.pth... [2023-12-28 01:40:26,219][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000894368_228999168.pth [2023-12-28 01:40:26,397][106226] Updated weights for policy 0, policy_version 893295 (0.0009) [2023-12-28 01:40:26,460][106226] Updated weights for policy 0, policy_version 893305 (0.0011) [2023-12-28 01:40:26,519][106226] Updated weights for policy 0, policy_version 893315 (0.0010) [2023-12-28 01:40:26,743][106225] Updated weights for policy 1, policy_version 895557 (0.0008) [2023-12-28 01:40:26,799][106225] Updated weights for policy 1, policy_version 895567 (0.0010) [2023-12-28 01:40:26,858][106225] Updated weights for policy 1, policy_version 895577 (0.0010) [2023-12-28 01:40:27,233][106226] Updated weights for policy 0, policy_version 893325 (0.0009) [2023-12-28 01:40:27,286][106226] Updated weights for policy 0, policy_version 893335 (0.0008) [2023-12-28 01:40:27,337][106226] Updated weights for policy 0, policy_version 893345 (0.0007) [2023-12-28 01:40:27,526][106225] Updated weights for policy 1, policy_version 895587 (0.0010) [2023-12-28 01:40:27,572][106225] Updated weights for policy 1, policy_version 895597 (0.0010) [2023-12-28 01:40:27,629][106225] Updated weights for policy 1, policy_version 895607 (0.0010) [2023-12-28 01:40:27,960][106226] Updated weights for policy 0, policy_version 893355 (0.0007) [2023-12-28 01:40:28,014][106226] Updated weights for policy 0, policy_version 893365 (0.0006) [2023-12-28 01:40:28,071][106226] Updated weights for policy 0, policy_version 893375 (0.0006) [2023-12-28 01:40:28,278][106225] Updated weights for policy 1, policy_version 895617 (0.0006) [2023-12-28 01:40:28,328][106225] Updated weights for policy 1, policy_version 895627 (0.0010) [2023-12-28 01:40:28,396][106225] Updated weights for policy 1, policy_version 895637 (0.0007) [2023-12-28 01:40:28,444][106225] Updated weights for policy 1, policy_version 895647 (0.0006) [2023-12-28 01:40:28,689][106226] Updated weights for policy 0, policy_version 893385 (0.0006) [2023-12-28 01:40:28,740][106226] Updated weights for policy 0, policy_version 893395 (0.0005) [2023-12-28 01:40:28,819][106226] Updated weights for policy 0, policy_version 893405 (0.0008) [2023-12-28 01:40:28,883][106226] Updated weights for policy 0, policy_version 893415 (0.0011) [2023-12-28 01:40:29,017][106225] Updated weights for policy 1, policy_version 895657 (0.0008) [2023-12-28 01:40:29,064][106225] Updated weights for policy 1, policy_version 895667 (0.0010) [2023-12-28 01:40:29,122][106225] Updated weights for policy 1, policy_version 895677 (0.0010) [2023-12-28 01:40:29,563][106226] Updated weights for policy 0, policy_version 893425 (0.0010) [2023-12-28 01:40:29,613][106226] Updated weights for policy 0, policy_version 893435 (0.0007) [2023-12-28 01:40:29,676][106226] Updated weights for policy 0, policy_version 893445 (0.0007) [2023-12-28 01:40:29,751][106225] Updated weights for policy 1, policy_version 895687 (0.0008) [2023-12-28 01:40:29,817][106225] Updated weights for policy 1, policy_version 895697 (0.0006) [2023-12-28 01:40:29,879][106225] Updated weights for policy 1, policy_version 895707 (0.0010) [2023-12-28 01:40:30,346][106226] Updated weights for policy 0, policy_version 893455 (0.0009) [2023-12-28 01:40:30,403][106226] Updated weights for policy 0, policy_version 893465 (0.0008) [2023-12-28 01:40:30,457][106226] Updated weights for policy 0, policy_version 893475 (0.0007) [2023-12-28 01:40:30,516][106225] Updated weights for policy 1, policy_version 895717 (0.0009) [2023-12-28 01:40:30,569][106225] Updated weights for policy 1, policy_version 895727 (0.0010) [2023-12-28 01:40:30,622][106225] Updated weights for policy 1, policy_version 895737 (0.0010) [2023-12-28 01:40:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 458137600. Throughput: 0: 9859.6, 1: 10050.0. Samples: 458129872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:31,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-5.036')] [2023-12-28 01:40:31,212][106226] Updated weights for policy 0, policy_version 893485 (0.0009) [2023-12-28 01:40:31,278][106226] Updated weights for policy 0, policy_version 893495 (0.0011) [2023-12-28 01:40:31,342][106226] Updated weights for policy 0, policy_version 893505 (0.0010) [2023-12-28 01:40:31,365][106225] Updated weights for policy 1, policy_version 895747 (0.0009) [2023-12-28 01:40:31,430][106225] Updated weights for policy 1, policy_version 895757 (0.0006) [2023-12-28 01:40:31,489][106225] Updated weights for policy 1, policy_version 895767 (0.0007) [2023-12-28 01:40:32,025][106226] Updated weights for policy 0, policy_version 893515 (0.0009) [2023-12-28 01:40:32,083][106226] Updated weights for policy 0, policy_version 893525 (0.0011) [2023-12-28 01:40:32,145][106226] Updated weights for policy 0, policy_version 893535 (0.0011) [2023-12-28 01:40:32,188][106225] Updated weights for policy 1, policy_version 895777 (0.0007) [2023-12-28 01:40:32,241][106225] Updated weights for policy 1, policy_version 895787 (0.0006) [2023-12-28 01:40:32,301][106225] Updated weights for policy 1, policy_version 895797 (0.0008) [2023-12-28 01:40:32,372][106225] Updated weights for policy 1, policy_version 895807 (0.0009) [2023-12-28 01:40:32,883][106226] Updated weights for policy 0, policy_version 893545 (0.0010) [2023-12-28 01:40:32,937][106226] Updated weights for policy 0, policy_version 893555 (0.0008) [2023-12-28 01:40:32,992][106226] Updated weights for policy 0, policy_version 893565 (0.0009) [2023-12-28 01:40:33,042][106226] Updated weights for policy 0, policy_version 893575 (0.0008) [2023-12-28 01:40:33,054][106225] Updated weights for policy 1, policy_version 895817 (0.0006) [2023-12-28 01:40:33,108][106225] Updated weights for policy 1, policy_version 895827 (0.0008) [2023-12-28 01:40:33,169][106225] Updated weights for policy 1, policy_version 895837 (0.0008) [2023-12-28 01:40:33,605][106226] Updated weights for policy 0, policy_version 893585 (0.0005) [2023-12-28 01:40:33,652][106226] Updated weights for policy 0, policy_version 893595 (0.0005) [2023-12-28 01:40:33,697][106226] Updated weights for policy 0, policy_version 893605 (0.0005) [2023-12-28 01:40:33,994][106225] Updated weights for policy 1, policy_version 895847 (0.0008) [2023-12-28 01:40:34,049][106225] Updated weights for policy 1, policy_version 895857 (0.0008) [2023-12-28 01:40:34,111][106225] Updated weights for policy 1, policy_version 895867 (0.0009) [2023-12-28 01:40:34,273][106226] Updated weights for policy 0, policy_version 893615 (0.0007) [2023-12-28 01:40:34,327][106226] Updated weights for policy 0, policy_version 893625 (0.0008) [2023-12-28 01:40:34,394][106226] Updated weights for policy 0, policy_version 893635 (0.0009) [2023-12-28 01:40:34,795][106225] Updated weights for policy 1, policy_version 895877 (0.0008) [2023-12-28 01:40:34,847][106225] Updated weights for policy 1, policy_version 895887 (0.0008) [2023-12-28 01:40:34,902][106225] Updated weights for policy 1, policy_version 895897 (0.0008) [2023-12-28 01:40:35,153][106226] Updated weights for policy 0, policy_version 893646 (0.0008) [2023-12-28 01:40:35,207][106226] Updated weights for policy 0, policy_version 893656 (0.0005) [2023-12-28 01:40:35,263][106226] Updated weights for policy 0, policy_version 893666 (0.0008) [2023-12-28 01:40:35,648][106225] Updated weights for policy 1, policy_version 895907 (0.0008) [2023-12-28 01:40:35,709][106225] Updated weights for policy 1, policy_version 895917 (0.0008) [2023-12-28 01:40:35,765][106225] Updated weights for policy 1, policy_version 895927 (0.0008) [2023-12-28 01:40:35,879][106226] Updated weights for policy 0, policy_version 893676 (0.0008) [2023-12-28 01:40:35,940][106226] Updated weights for policy 0, policy_version 893686 (0.0005) [2023-12-28 01:40:36,010][106226] Updated weights for policy 0, policy_version 893696 (0.0005) [2023-12-28 01:40:36,175][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 458244096. Throughput: 0: 9955.4, 1: 10064.7. Samples: 458250232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:36,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.935')] [2023-12-28 01:40:36,547][106225] Updated weights for policy 1, policy_version 895937 (0.0008) [2023-12-28 01:40:36,602][106225] Updated weights for policy 1, policy_version 895947 (0.0007) [2023-12-28 01:40:36,626][106226] Updated weights for policy 0, policy_version 893706 (0.0006) [2023-12-28 01:40:36,663][106225] Updated weights for policy 1, policy_version 895957 (0.0008) [2023-12-28 01:40:36,690][106226] Updated weights for policy 0, policy_version 893716 (0.0011) [2023-12-28 01:40:36,724][106225] Updated weights for policy 1, policy_version 895967 (0.0009) [2023-12-28 01:40:36,747][106226] Updated weights for policy 0, policy_version 893726 (0.0011) [2023-12-28 01:40:36,803][106226] Updated weights for policy 0, policy_version 893736 (0.0010) [2023-12-28 01:40:37,420][106226] Updated weights for policy 0, policy_version 893746 (0.0005) [2023-12-28 01:40:37,477][106225] Updated weights for policy 1, policy_version 895977 (0.0008) [2023-12-28 01:40:37,482][106226] Updated weights for policy 0, policy_version 893756 (0.0007) [2023-12-28 01:40:37,535][106225] Updated weights for policy 1, policy_version 895987 (0.0007) [2023-12-28 01:40:37,541][106226] Updated weights for policy 0, policy_version 893766 (0.0006) [2023-12-28 01:40:37,589][106225] Updated weights for policy 1, policy_version 895997 (0.0008) [2023-12-28 01:40:38,124][106226] Updated weights for policy 0, policy_version 893776 (0.0007) [2023-12-28 01:40:38,171][106226] Updated weights for policy 0, policy_version 893786 (0.0005) [2023-12-28 01:40:38,222][106226] Updated weights for policy 0, policy_version 893796 (0.0005) [2023-12-28 01:40:38,388][106225] Updated weights for policy 1, policy_version 896007 (0.0007) [2023-12-28 01:40:38,445][106225] Updated weights for policy 1, policy_version 896017 (0.0008) [2023-12-28 01:40:38,510][106225] Updated weights for policy 1, policy_version 896027 (0.0009) [2023-12-28 01:40:38,785][106226] Updated weights for policy 0, policy_version 893806 (0.0008) [2023-12-28 01:40:38,833][106226] Updated weights for policy 0, policy_version 893816 (0.0005) [2023-12-28 01:40:38,882][106226] Updated weights for policy 0, policy_version 893826 (0.0005) [2023-12-28 01:40:39,297][106225] Updated weights for policy 1, policy_version 896037 (0.0009) [2023-12-28 01:40:39,371][106225] Updated weights for policy 1, policy_version 896047 (0.0009) [2023-12-28 01:40:39,440][106225] Updated weights for policy 1, policy_version 896057 (0.0009) [2023-12-28 01:40:39,556][106226] Updated weights for policy 0, policy_version 893836 (0.0008) [2023-12-28 01:40:39,605][106226] Updated weights for policy 0, policy_version 893846 (0.0008) [2023-12-28 01:40:39,662][106226] Updated weights for policy 0, policy_version 893856 (0.0008) [2023-12-28 01:40:40,160][106225] Updated weights for policy 1, policy_version 896067 (0.0010) [2023-12-28 01:40:40,223][106225] Updated weights for policy 1, policy_version 896077 (0.0009) [2023-12-28 01:40:40,282][106225] Updated weights for policy 1, policy_version 896087 (0.0008) [2023-12-28 01:40:40,406][106226] Updated weights for policy 0, policy_version 893866 (0.0008) [2023-12-28 01:40:40,463][106226] Updated weights for policy 0, policy_version 893876 (0.0011) [2023-12-28 01:40:40,524][106226] Updated weights for policy 0, policy_version 893886 (0.0010) [2023-12-28 01:40:40,571][106226] Updated weights for policy 0, policy_version 893896 (0.0006) [2023-12-28 01:40:40,958][106225] Updated weights for policy 1, policy_version 896097 (0.0008) [2023-12-28 01:40:41,023][106225] Updated weights for policy 1, policy_version 896107 (0.0009) [2023-12-28 01:40:41,087][106225] Updated weights for policy 1, policy_version 896117 (0.0008) [2023-12-28 01:40:41,154][106225] Updated weights for policy 1, policy_version 896127 (0.0007) [2023-12-28 01:40:41,155][106226] Updated weights for policy 0, policy_version 893906 (0.0008) [2023-12-28 01:40:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 458342400. Throughput: 0: 10058.0, 1: 9999.3. Samples: 458310924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:41,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.937')] [2023-12-28 01:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000896128_229449728.pth... [2023-12-28 01:40:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000894944_229146624.pth [2023-12-28 01:40:41,218][106226] Updated weights for policy 0, policy_version 893916 (0.0009) [2023-12-28 01:40:41,286][106226] Updated weights for policy 0, policy_version 893926 (0.0009) [2023-12-28 01:40:41,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000893928_228900864.pth... [2023-12-28 01:40:41,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000892712_228589568.pth [2023-12-28 01:40:42,001][106225] Updated weights for policy 1, policy_version 896137 (0.0010) [2023-12-28 01:40:42,064][106225] Updated weights for policy 1, policy_version 896147 (0.0007) [2023-12-28 01:40:42,071][106226] Updated weights for policy 0, policy_version 893937 (0.0009) [2023-12-28 01:40:42,120][106225] Updated weights for policy 1, policy_version 896157 (0.0006) [2023-12-28 01:40:42,122][106226] Updated weights for policy 0, policy_version 893947 (0.0007) [2023-12-28 01:40:42,174][106226] Updated weights for policy 0, policy_version 893957 (0.0009) [2023-12-28 01:40:42,817][106225] Updated weights for policy 1, policy_version 896167 (0.0007) [2023-12-28 01:40:42,869][106225] Updated weights for policy 1, policy_version 896177 (0.0008) [2023-12-28 01:40:42,932][106225] Updated weights for policy 1, policy_version 896187 (0.0006) [2023-12-28 01:40:42,947][106226] Updated weights for policy 0, policy_version 893967 (0.0008) [2023-12-28 01:40:43,002][106226] Updated weights for policy 0, policy_version 893977 (0.0009) [2023-12-28 01:40:43,056][106226] Updated weights for policy 0, policy_version 893987 (0.0010) [2023-12-28 01:40:43,575][106225] Updated weights for policy 1, policy_version 896197 (0.0006) [2023-12-28 01:40:43,624][106225] Updated weights for policy 1, policy_version 896207 (0.0007) [2023-12-28 01:40:43,671][106225] Updated weights for policy 1, policy_version 896217 (0.0006) [2023-12-28 01:40:43,762][106226] Updated weights for policy 0, policy_version 893997 (0.0007) [2023-12-28 01:40:43,821][106226] Updated weights for policy 0, policy_version 894007 (0.0005) [2023-12-28 01:40:43,881][106226] Updated weights for policy 0, policy_version 894017 (0.0005) [2023-12-28 01:40:44,401][106225] Updated weights for policy 1, policy_version 896227 (0.0009) [2023-12-28 01:40:44,453][106225] Updated weights for policy 1, policy_version 896237 (0.0008) [2023-12-28 01:40:44,476][106226] Updated weights for policy 0, policy_version 894027 (0.0006) [2023-12-28 01:40:44,503][106225] Updated weights for policy 1, policy_version 896247 (0.0008) [2023-12-28 01:40:44,520][106226] Updated weights for policy 0, policy_version 894037 (0.0009) [2023-12-28 01:40:44,572][106226] Updated weights for policy 0, policy_version 894047 (0.0006) [2023-12-28 01:40:45,285][106225] Updated weights for policy 1, policy_version 896257 (0.0007) [2023-12-28 01:40:45,346][106225] Updated weights for policy 1, policy_version 896267 (0.0009) [2023-12-28 01:40:45,347][106226] Updated weights for policy 0, policy_version 894057 (0.0008) [2023-12-28 01:40:45,394][106225] Updated weights for policy 1, policy_version 896277 (0.0006) [2023-12-28 01:40:45,399][106226] Updated weights for policy 0, policy_version 894067 (0.0009) [2023-12-28 01:40:45,445][106225] Updated weights for policy 1, policy_version 896287 (0.0006) [2023-12-28 01:40:45,454][106226] Updated weights for policy 0, policy_version 894077 (0.0007) [2023-12-28 01:40:45,502][106226] Updated weights for policy 0, policy_version 894087 (0.0008) [2023-12-28 01:40:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 458432512. Throughput: 0: 10059.0, 1: 9949.6. Samples: 458427840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:46,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.202')] [2023-12-28 01:40:46,203][106225] Updated weights for policy 1, policy_version 896297 (0.0007) [2023-12-28 01:40:46,215][106226] Updated weights for policy 0, policy_version 894097 (0.0008) [2023-12-28 01:40:46,264][106225] Updated weights for policy 1, policy_version 896307 (0.0007) [2023-12-28 01:40:46,273][106226] Updated weights for policy 0, policy_version 894107 (0.0007) [2023-12-28 01:40:46,325][106225] Updated weights for policy 1, policy_version 896317 (0.0006) [2023-12-28 01:40:46,332][106226] Updated weights for policy 0, policy_version 894117 (0.0006) [2023-12-28 01:40:47,016][106225] Updated weights for policy 1, policy_version 896327 (0.0006) [2023-12-28 01:40:47,071][106225] Updated weights for policy 1, policy_version 896337 (0.0009) [2023-12-28 01:40:47,080][106226] Updated weights for policy 0, policy_version 894127 (0.0007) [2023-12-28 01:40:47,124][106225] Updated weights for policy 1, policy_version 896347 (0.0010) [2023-12-28 01:40:47,140][106226] Updated weights for policy 0, policy_version 894137 (0.0005) [2023-12-28 01:40:47,203][106226] Updated weights for policy 0, policy_version 894147 (0.0007) [2023-12-28 01:40:47,728][106225] Updated weights for policy 1, policy_version 896357 (0.0008) [2023-12-28 01:40:47,777][106225] Updated weights for policy 1, policy_version 896367 (0.0005) [2023-12-28 01:40:47,835][106225] Updated weights for policy 1, policy_version 896377 (0.0009) [2023-12-28 01:40:47,943][106226] Updated weights for policy 0, policy_version 894157 (0.0007) [2023-12-28 01:40:48,007][106226] Updated weights for policy 0, policy_version 894167 (0.0008) [2023-12-28 01:40:48,073][106226] Updated weights for policy 0, policy_version 894177 (0.0008) [2023-12-28 01:40:48,525][106225] Updated weights for policy 1, policy_version 896387 (0.0009) [2023-12-28 01:40:48,592][106225] Updated weights for policy 1, policy_version 896397 (0.0008) [2023-12-28 01:40:48,649][106225] Updated weights for policy 1, policy_version 896407 (0.0005) [2023-12-28 01:40:48,845][106226] Updated weights for policy 0, policy_version 894187 (0.0009) [2023-12-28 01:40:48,904][106226] Updated weights for policy 0, policy_version 894197 (0.0008) [2023-12-28 01:40:48,961][106226] Updated weights for policy 0, policy_version 894207 (0.0008) [2023-12-28 01:40:49,222][106225] Updated weights for policy 1, policy_version 896417 (0.0006) [2023-12-28 01:40:49,292][106225] Updated weights for policy 1, policy_version 896427 (0.0007) [2023-12-28 01:40:49,359][106225] Updated weights for policy 1, policy_version 896437 (0.0008) [2023-12-28 01:40:49,414][106225] Updated weights for policy 1, policy_version 896447 (0.0010) [2023-12-28 01:40:49,689][106226] Updated weights for policy 0, policy_version 894217 (0.0009) [2023-12-28 01:40:49,741][106226] Updated weights for policy 0, policy_version 894227 (0.0005) [2023-12-28 01:40:49,792][106226] Updated weights for policy 0, policy_version 894237 (0.0006) [2023-12-28 01:40:49,850][106226] Updated weights for policy 0, policy_version 894247 (0.0007) [2023-12-28 01:40:50,179][106225] Updated weights for policy 1, policy_version 896457 (0.0009) [2023-12-28 01:40:50,233][106225] Updated weights for policy 1, policy_version 896467 (0.0010) [2023-12-28 01:40:50,294][106225] Updated weights for policy 1, policy_version 896477 (0.0010) [2023-12-28 01:40:50,508][106226] Updated weights for policy 0, policy_version 894257 (0.0009) [2023-12-28 01:40:50,565][106226] Updated weights for policy 0, policy_version 894267 (0.0008) [2023-12-28 01:40:50,634][106226] Updated weights for policy 0, policy_version 894277 (0.0011) [2023-12-28 01:40:51,024][106225] Updated weights for policy 1, policy_version 896487 (0.0008) [2023-12-28 01:40:51,081][106225] Updated weights for policy 1, policy_version 896497 (0.0008) [2023-12-28 01:40:51,144][106225] Updated weights for policy 1, policy_version 896507 (0.0008) [2023-12-28 01:40:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 458539008. Throughput: 0: 10014.5, 1: 9970.0. Samples: 458544880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:51,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-5.179')] [2023-12-28 01:40:51,407][106226] Updated weights for policy 0, policy_version 894287 (0.0010) [2023-12-28 01:40:51,472][106226] Updated weights for policy 0, policy_version 894297 (0.0010) [2023-12-28 01:40:51,537][106226] Updated weights for policy 0, policy_version 894307 (0.0011) [2023-12-28 01:40:51,902][106225] Updated weights for policy 1, policy_version 896517 (0.0008) [2023-12-28 01:40:51,966][106225] Updated weights for policy 1, policy_version 896527 (0.0007) [2023-12-28 01:40:52,021][106225] Updated weights for policy 1, policy_version 896537 (0.0009) [2023-12-28 01:40:52,213][106226] Updated weights for policy 0, policy_version 894317 (0.0011) [2023-12-28 01:40:52,267][106226] Updated weights for policy 0, policy_version 894327 (0.0009) [2023-12-28 01:40:52,326][106226] Updated weights for policy 0, policy_version 894337 (0.0007) [2023-12-28 01:40:52,761][106225] Updated weights for policy 1, policy_version 896547 (0.0007) [2023-12-28 01:40:52,815][106225] Updated weights for policy 1, policy_version 896557 (0.0008) [2023-12-28 01:40:52,876][106225] Updated weights for policy 1, policy_version 896567 (0.0008) [2023-12-28 01:40:53,094][106226] Updated weights for policy 0, policy_version 894347 (0.0014) [2023-12-28 01:40:53,153][106226] Updated weights for policy 0, policy_version 894357 (0.0008) [2023-12-28 01:40:53,209][106226] Updated weights for policy 0, policy_version 894367 (0.0009) [2023-12-28 01:40:53,558][106225] Updated weights for policy 1, policy_version 896577 (0.0008) [2023-12-28 01:40:53,620][106225] Updated weights for policy 1, policy_version 896587 (0.0010) [2023-12-28 01:40:53,686][106225] Updated weights for policy 1, policy_version 896597 (0.0010) [2023-12-28 01:40:53,750][106225] Updated weights for policy 1, policy_version 896607 (0.0007) [2023-12-28 01:40:53,949][106226] Updated weights for policy 0, policy_version 894377 (0.0008) [2023-12-28 01:40:54,016][106226] Updated weights for policy 0, policy_version 894387 (0.0010) [2023-12-28 01:40:54,068][106226] Updated weights for policy 0, policy_version 894397 (0.0009) [2023-12-28 01:40:54,120][106226] Updated weights for policy 0, policy_version 894407 (0.0008) [2023-12-28 01:40:54,347][106225] Updated weights for policy 1, policy_version 896617 (0.0008) [2023-12-28 01:40:54,416][106225] Updated weights for policy 1, policy_version 896627 (0.0006) [2023-12-28 01:40:54,480][106225] Updated weights for policy 1, policy_version 896637 (0.0008) [2023-12-28 01:40:54,843][106226] Updated weights for policy 0, policy_version 894417 (0.0008) [2023-12-28 01:40:54,909][106226] Updated weights for policy 0, policy_version 894427 (0.0009) [2023-12-28 01:40:54,973][106226] Updated weights for policy 0, policy_version 894437 (0.0008) [2023-12-28 01:40:55,116][106225] Updated weights for policy 1, policy_version 896647 (0.0008) [2023-12-28 01:40:55,164][106225] Updated weights for policy 1, policy_version 896657 (0.0006) [2023-12-28 01:40:55,218][106225] Updated weights for policy 1, policy_version 896667 (0.0008) [2023-12-28 01:40:55,752][106226] Updated weights for policy 0, policy_version 894447 (0.0010) [2023-12-28 01:40:55,805][106225] Updated weights for policy 1, policy_version 896677 (0.0007) [2023-12-28 01:40:55,813][106226] Updated weights for policy 0, policy_version 894457 (0.0011) [2023-12-28 01:40:55,869][106225] Updated weights for policy 1, policy_version 896687 (0.0007) [2023-12-28 01:40:55,885][106226] Updated weights for policy 0, policy_version 894467 (0.0010) [2023-12-28 01:40:55,929][106225] Updated weights for policy 1, policy_version 896697 (0.0010) [2023-12-28 01:40:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 458637312. Throughput: 0: 9974.4, 1: 9871.4. Samples: 458601988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:40:56,176][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.064')] [2023-12-28 01:40:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000894472_229040128.pth... [2023-12-28 01:40:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000896704_229597184.pth... [2023-12-28 01:40:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000893288_228737024.pth [2023-12-28 01:40:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000895552_229302272.pth [2023-12-28 01:40:56,525][106226] Updated weights for policy 0, policy_version 894477 (0.0008) [2023-12-28 01:40:56,575][106226] Updated weights for policy 0, policy_version 894487 (0.0005) [2023-12-28 01:40:56,579][106225] Updated weights for policy 1, policy_version 896707 (0.0009) [2023-12-28 01:40:56,634][106226] Updated weights for policy 0, policy_version 894497 (0.0010) [2023-12-28 01:40:56,639][106225] Updated weights for policy 1, policy_version 896717 (0.0005) [2023-12-28 01:40:56,693][106225] Updated weights for policy 1, policy_version 896727 (0.0006) [2023-12-28 01:40:57,313][106226] Updated weights for policy 0, policy_version 894507 (0.0009) [2023-12-28 01:40:57,365][106226] Updated weights for policy 0, policy_version 894517 (0.0008) [2023-12-28 01:40:57,366][106225] Updated weights for policy 1, policy_version 896737 (0.0007) [2023-12-28 01:40:57,421][106225] Updated weights for policy 1, policy_version 896747 (0.0007) [2023-12-28 01:40:57,425][106226] Updated weights for policy 0, policy_version 894527 (0.0007) [2023-12-28 01:40:57,481][106225] Updated weights for policy 1, policy_version 896757 (0.0008) [2023-12-28 01:40:57,539][106225] Updated weights for policy 1, policy_version 896767 (0.0008) [2023-12-28 01:40:58,112][106226] Updated weights for policy 0, policy_version 894537 (0.0009) [2023-12-28 01:40:58,157][106226] Updated weights for policy 0, policy_version 894547 (0.0007) [2023-12-28 01:40:58,216][106226] Updated weights for policy 0, policy_version 894557 (0.0008) [2023-12-28 01:40:58,267][106225] Updated weights for policy 1, policy_version 896777 (0.0008) [2023-12-28 01:40:58,279][106226] Updated weights for policy 0, policy_version 894567 (0.0008) [2023-12-28 01:40:58,332][106225] Updated weights for policy 1, policy_version 896787 (0.0010) [2023-12-28 01:40:58,404][106225] Updated weights for policy 1, policy_version 896797 (0.0010) [2023-12-28 01:40:59,111][106226] Updated weights for policy 0, policy_version 894577 (0.0011) [2023-12-28 01:40:59,174][106226] Updated weights for policy 0, policy_version 894587 (0.0011) [2023-12-28 01:40:59,240][106226] Updated weights for policy 0, policy_version 894597 (0.0009) [2023-12-28 01:40:59,266][106225] Updated weights for policy 1, policy_version 896807 (0.0009) [2023-12-28 01:40:59,329][106225] Updated weights for policy 1, policy_version 896817 (0.0010) [2023-12-28 01:40:59,397][106225] Updated weights for policy 1, policy_version 896827 (0.0009) [2023-12-28 01:41:00,094][106226] Updated weights for policy 0, policy_version 894607 (0.0006) [2023-12-28 01:41:00,153][106225] Updated weights for policy 1, policy_version 896837 (0.0009) [2023-12-28 01:41:00,159][106226] Updated weights for policy 0, policy_version 894617 (0.0008) [2023-12-28 01:41:00,212][106225] Updated weights for policy 1, policy_version 896847 (0.0008) [2023-12-28 01:41:00,222][106226] Updated weights for policy 0, policy_version 894627 (0.0007) [2023-12-28 01:41:00,269][106225] Updated weights for policy 1, policy_version 896857 (0.0008) [2023-12-28 01:41:00,841][106226] Updated weights for policy 0, policy_version 894637 (0.0007) [2023-12-28 01:41:00,887][106226] Updated weights for policy 0, policy_version 894647 (0.0005) [2023-12-28 01:41:00,948][106226] Updated weights for policy 0, policy_version 894657 (0.0006) [2023-12-28 01:41:00,954][106225] Updated weights for policy 1, policy_version 896867 (0.0007) [2023-12-28 01:41:01,005][106225] Updated weights for policy 1, policy_version 896877 (0.0008) [2023-12-28 01:41:01,071][106225] Updated weights for policy 1, policy_version 896887 (0.0008) [2023-12-28 01:41:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 458735616. Throughput: 0: 9977.8, 1: 9872.3. Samples: 458719048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:01,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-4.815')] [2023-12-28 01:41:01,711][106226] Updated weights for policy 0, policy_version 894667 (0.0008) [2023-12-28 01:41:01,755][106225] Updated weights for policy 1, policy_version 896897 (0.0007) [2023-12-28 01:41:01,774][106226] Updated weights for policy 0, policy_version 894677 (0.0005) [2023-12-28 01:41:01,819][106225] Updated weights for policy 1, policy_version 896907 (0.0005) [2023-12-28 01:41:01,837][106226] Updated weights for policy 0, policy_version 894687 (0.0008) [2023-12-28 01:41:01,878][106225] Updated weights for policy 1, policy_version 896917 (0.0005) [2023-12-28 01:41:01,936][106225] Updated weights for policy 1, policy_version 896927 (0.0006) [2023-12-28 01:41:02,458][106226] Updated weights for policy 0, policy_version 894697 (0.0008) [2023-12-28 01:41:02,525][106226] Updated weights for policy 0, policy_version 894707 (0.0007) [2023-12-28 01:41:02,566][106225] Updated weights for policy 1, policy_version 896937 (0.0006) [2023-12-28 01:41:02,586][106226] Updated weights for policy 0, policy_version 894717 (0.0008) [2023-12-28 01:41:02,628][106225] Updated weights for policy 1, policy_version 896947 (0.0005) [2023-12-28 01:41:02,636][106226] Updated weights for policy 0, policy_version 894727 (0.0008) [2023-12-28 01:41:02,685][106225] Updated weights for policy 1, policy_version 896957 (0.0006) [2023-12-28 01:41:03,249][106226] Updated weights for policy 0, policy_version 894737 (0.0006) [2023-12-28 01:41:03,305][106226] Updated weights for policy 0, policy_version 894747 (0.0008) [2023-12-28 01:41:03,361][106226] Updated weights for policy 0, policy_version 894757 (0.0007) [2023-12-28 01:41:03,362][106225] Updated weights for policy 1, policy_version 896967 (0.0007) [2023-12-28 01:41:03,421][106225] Updated weights for policy 1, policy_version 896977 (0.0007) [2023-12-28 01:41:03,485][106225] Updated weights for policy 1, policy_version 896987 (0.0006) [2023-12-28 01:41:03,976][106226] Updated weights for policy 0, policy_version 894767 (0.0006) [2023-12-28 01:41:04,045][106226] Updated weights for policy 0, policy_version 894777 (0.0007) [2023-12-28 01:41:04,112][106226] Updated weights for policy 0, policy_version 894787 (0.0008) [2023-12-28 01:41:04,284][106225] Updated weights for policy 1, policy_version 896997 (0.0008) [2023-12-28 01:41:04,355][106225] Updated weights for policy 1, policy_version 897007 (0.0009) [2023-12-28 01:41:04,417][106225] Updated weights for policy 1, policy_version 897017 (0.0008) [2023-12-28 01:41:04,785][106226] Updated weights for policy 0, policy_version 894797 (0.0009) [2023-12-28 01:41:04,842][106226] Updated weights for policy 0, policy_version 894807 (0.0009) [2023-12-28 01:41:04,897][106226] Updated weights for policy 0, policy_version 894817 (0.0008) [2023-12-28 01:41:05,099][106225] Updated weights for policy 1, policy_version 897027 (0.0008) [2023-12-28 01:41:05,156][106225] Updated weights for policy 1, policy_version 897037 (0.0008) [2023-12-28 01:41:05,211][106225] Updated weights for policy 1, policy_version 897047 (0.0009) [2023-12-28 01:41:05,527][106226] Updated weights for policy 0, policy_version 894827 (0.0008) [2023-12-28 01:41:05,594][106226] Updated weights for policy 0, policy_version 894837 (0.0005) [2023-12-28 01:41:05,658][106226] Updated weights for policy 0, policy_version 894847 (0.0005) [2023-12-28 01:41:06,010][106225] Updated weights for policy 1, policy_version 897057 (0.0008) [2023-12-28 01:41:06,058][106225] Updated weights for policy 1, policy_version 897067 (0.0008) [2023-12-28 01:41:06,122][106225] Updated weights for policy 1, policy_version 897077 (0.0008) [2023-12-28 01:41:06,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 458825728. Throughput: 0: 10085.1, 1: 9888.7. Samples: 458842064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:06,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-4.903')] [2023-12-28 01:41:06,182][106225] Updated weights for policy 1, policy_version 897087 (0.0009) [2023-12-28 01:41:06,184][106226] Updated weights for policy 0, policy_version 894857 (0.0005) [2023-12-28 01:41:06,254][106226] Updated weights for policy 0, policy_version 894867 (0.0006) [2023-12-28 01:41:06,323][106226] Updated weights for policy 0, policy_version 894877 (0.0006) [2023-12-28 01:41:06,390][106226] Updated weights for policy 0, policy_version 894887 (0.0007) [2023-12-28 01:41:06,901][106225] Updated weights for policy 1, policy_version 897097 (0.0006) [2023-12-28 01:41:06,962][106225] Updated weights for policy 1, policy_version 897107 (0.0006) [2023-12-28 01:41:07,020][106225] Updated weights for policy 1, policy_version 897117 (0.0005) [2023-12-28 01:41:07,099][106226] Updated weights for policy 0, policy_version 894897 (0.0009) [2023-12-28 01:41:07,159][106226] Updated weights for policy 0, policy_version 894907 (0.0008) [2023-12-28 01:41:07,216][106226] Updated weights for policy 0, policy_version 894917 (0.0008) [2023-12-28 01:41:07,662][106225] Updated weights for policy 1, policy_version 897127 (0.0008) [2023-12-28 01:41:07,726][106225] Updated weights for policy 1, policy_version 897137 (0.0008) [2023-12-28 01:41:07,781][106225] Updated weights for policy 1, policy_version 897147 (0.0008) [2023-12-28 01:41:07,942][106226] Updated weights for policy 0, policy_version 894927 (0.0009) [2023-12-28 01:41:08,003][106226] Updated weights for policy 0, policy_version 894937 (0.0010) [2023-12-28 01:41:08,066][106226] Updated weights for policy 0, policy_version 894947 (0.0010) [2023-12-28 01:41:08,543][106225] Updated weights for policy 1, policy_version 897157 (0.0007) [2023-12-28 01:41:08,599][106225] Updated weights for policy 1, policy_version 897167 (0.0007) [2023-12-28 01:41:08,660][106225] Updated weights for policy 1, policy_version 897177 (0.0007) [2023-12-28 01:41:08,750][106226] Updated weights for policy 0, policy_version 894957 (0.0010) [2023-12-28 01:41:08,810][106226] Updated weights for policy 0, policy_version 894967 (0.0011) [2023-12-28 01:41:08,871][106226] Updated weights for policy 0, policy_version 894977 (0.0010) [2023-12-28 01:41:09,339][106225] Updated weights for policy 1, policy_version 897187 (0.0008) [2023-12-28 01:41:09,414][106225] Updated weights for policy 1, policy_version 897197 (0.0009) [2023-12-28 01:41:09,478][106225] Updated weights for policy 1, policy_version 897207 (0.0008) [2023-12-28 01:41:09,630][106226] Updated weights for policy 0, policy_version 894987 (0.0011) [2023-12-28 01:41:09,695][106226] Updated weights for policy 0, policy_version 894997 (0.0011) [2023-12-28 01:41:09,763][106226] Updated weights for policy 0, policy_version 895007 (0.0011) [2023-12-28 01:41:10,203][106225] Updated weights for policy 1, policy_version 897217 (0.0008) [2023-12-28 01:41:10,271][106225] Updated weights for policy 1, policy_version 897227 (0.0008) [2023-12-28 01:41:10,326][106225] Updated weights for policy 1, policy_version 897237 (0.0006) [2023-12-28 01:41:10,382][106225] Updated weights for policy 1, policy_version 897247 (0.0007) [2023-12-28 01:41:10,469][106226] Updated weights for policy 0, policy_version 895017 (0.0010) [2023-12-28 01:41:10,533][106226] Updated weights for policy 0, policy_version 895027 (0.0007) [2023-12-28 01:41:10,604][106226] Updated weights for policy 0, policy_version 895037 (0.0005) [2023-12-28 01:41:10,658][106226] Updated weights for policy 0, policy_version 895047 (0.0008) [2023-12-28 01:41:11,075][106225] Updated weights for policy 1, policy_version 897257 (0.0011) [2023-12-28 01:41:11,141][106225] Updated weights for policy 1, policy_version 897267 (0.0010) [2023-12-28 01:41:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 458924032. Throughput: 0: 10085.0, 1: 9882.9. Samples: 458899972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:11,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.883')] [2023-12-28 01:41:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000895048_229187584.pth... [2023-12-28 01:41:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000893928_228900864.pth [2023-12-28 01:41:11,208][106225] Updated weights for policy 1, policy_version 897277 (0.0009) [2023-12-28 01:41:11,224][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000897280_229744640.pth... [2023-12-28 01:41:11,227][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000896128_229449728.pth [2023-12-28 01:41:11,329][106226] Updated weights for policy 0, policy_version 895057 (0.0006) [2023-12-28 01:41:11,399][106226] Updated weights for policy 0, policy_version 895067 (0.0009) [2023-12-28 01:41:11,461][106226] Updated weights for policy 0, policy_version 895077 (0.0009) [2023-12-28 01:41:11,937][106225] Updated weights for policy 1, policy_version 897287 (0.0010) [2023-12-28 01:41:12,009][106225] Updated weights for policy 1, policy_version 897297 (0.0011) [2023-12-28 01:41:12,071][106225] Updated weights for policy 1, policy_version 897307 (0.0010) [2023-12-28 01:41:12,265][106226] Updated weights for policy 0, policy_version 895087 (0.0009) [2023-12-28 01:41:12,334][106226] Updated weights for policy 0, policy_version 895097 (0.0007) [2023-12-28 01:41:12,402][106226] Updated weights for policy 0, policy_version 895107 (0.0008) [2023-12-28 01:41:12,795][106225] Updated weights for policy 1, policy_version 897317 (0.0010) [2023-12-28 01:41:12,856][106225] Updated weights for policy 1, policy_version 897327 (0.0011) [2023-12-28 01:41:12,912][106225] Updated weights for policy 1, policy_version 897337 (0.0010) [2023-12-28 01:41:13,049][106226] Updated weights for policy 0, policy_version 895117 (0.0009) [2023-12-28 01:41:13,095][106226] Updated weights for policy 0, policy_version 895127 (0.0008) [2023-12-28 01:41:13,138][106226] Updated weights for policy 0, policy_version 895137 (0.0007) [2023-12-28 01:41:13,638][106225] Updated weights for policy 1, policy_version 897347 (0.0011) [2023-12-28 01:41:13,695][106225] Updated weights for policy 1, policy_version 897357 (0.0010) [2023-12-28 01:41:13,748][106225] Updated weights for policy 1, policy_version 897367 (0.0009) [2023-12-28 01:41:13,844][106226] Updated weights for policy 0, policy_version 895147 (0.0007) [2023-12-28 01:41:13,897][106226] Updated weights for policy 0, policy_version 895157 (0.0005) [2023-12-28 01:41:13,961][106226] Updated weights for policy 0, policy_version 895167 (0.0006) [2023-12-28 01:41:14,337][106225] Updated weights for policy 1, policy_version 897377 (0.0006) [2023-12-28 01:41:14,394][106225] Updated weights for policy 1, policy_version 897387 (0.0010) [2023-12-28 01:41:14,456][106225] Updated weights for policy 1, policy_version 897397 (0.0010) [2023-12-28 01:41:14,521][106225] Updated weights for policy 1, policy_version 897407 (0.0007) [2023-12-28 01:41:14,599][106226] Updated weights for policy 0, policy_version 895177 (0.0007) [2023-12-28 01:41:14,663][106226] Updated weights for policy 0, policy_version 895187 (0.0008) [2023-12-28 01:41:14,738][106226] Updated weights for policy 0, policy_version 895197 (0.0007) [2023-12-28 01:41:14,819][106226] Updated weights for policy 0, policy_version 895207 (0.0008) [2023-12-28 01:41:15,128][106225] Updated weights for policy 1, policy_version 897417 (0.0007) [2023-12-28 01:41:15,187][106225] Updated weights for policy 1, policy_version 897427 (0.0010) [2023-12-28 01:41:15,245][106225] Updated weights for policy 1, policy_version 897437 (0.0010) [2023-12-28 01:41:15,587][106226] Updated weights for policy 0, policy_version 895217 (0.0008) [2023-12-28 01:41:15,645][106226] Updated weights for policy 0, policy_version 895227 (0.0008) [2023-12-28 01:41:15,706][106226] Updated weights for policy 0, policy_version 895237 (0.0008) [2023-12-28 01:41:15,960][106225] Updated weights for policy 1, policy_version 897447 (0.0010) [2023-12-28 01:41:16,014][106225] Updated weights for policy 1, policy_version 897457 (0.0010) [2023-12-28 01:41:16,065][106225] Updated weights for policy 1, policy_version 897467 (0.0010) [2023-12-28 01:41:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 459030528. Throughput: 0: 9975.9, 1: 9749.3. Samples: 459017508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:16,176][105115] Avg episode reward: [(0, '-4.079'), (1, '-4.685')] [2023-12-28 01:41:16,310][106226] Updated weights for policy 0, policy_version 895247 (0.0006) [2023-12-28 01:41:16,364][106226] Updated weights for policy 0, policy_version 895257 (0.0008) [2023-12-28 01:41:16,415][106226] Updated weights for policy 0, policy_version 895267 (0.0007) [2023-12-28 01:41:16,766][106225] Updated weights for policy 1, policy_version 897477 (0.0009) [2023-12-28 01:41:16,826][106225] Updated weights for policy 1, policy_version 897487 (0.0008) [2023-12-28 01:41:16,889][106225] Updated weights for policy 1, policy_version 897497 (0.0008) [2023-12-28 01:41:17,065][106226] Updated weights for policy 0, policy_version 895277 (0.0007) [2023-12-28 01:41:17,122][106226] Updated weights for policy 0, policy_version 895287 (0.0007) [2023-12-28 01:41:17,192][106226] Updated weights for policy 0, policy_version 895297 (0.0006) [2023-12-28 01:41:17,574][106225] Updated weights for policy 1, policy_version 897507 (0.0009) [2023-12-28 01:41:17,627][106225] Updated weights for policy 1, policy_version 897517 (0.0009) [2023-12-28 01:41:17,678][106225] Updated weights for policy 1, policy_version 897527 (0.0008) [2023-12-28 01:41:17,924][106226] Updated weights for policy 0, policy_version 895307 (0.0008) [2023-12-28 01:41:17,983][106226] Updated weights for policy 0, policy_version 895317 (0.0009) [2023-12-28 01:41:18,046][106226] Updated weights for policy 0, policy_version 895327 (0.0008) [2023-12-28 01:41:18,298][106225] Updated weights for policy 1, policy_version 897537 (0.0008) [2023-12-28 01:41:18,363][106225] Updated weights for policy 1, policy_version 897547 (0.0007) [2023-12-28 01:41:18,425][106225] Updated weights for policy 1, policy_version 897557 (0.0008) [2023-12-28 01:41:18,489][106225] Updated weights for policy 1, policy_version 897567 (0.0008) [2023-12-28 01:41:18,855][106226] Updated weights for policy 0, policy_version 895337 (0.0010) [2023-12-28 01:41:18,920][106226] Updated weights for policy 0, policy_version 895347 (0.0009) [2023-12-28 01:41:18,977][106226] Updated weights for policy 0, policy_version 895357 (0.0009) [2023-12-28 01:41:19,026][106226] Updated weights for policy 0, policy_version 895367 (0.0008) [2023-12-28 01:41:19,107][106225] Updated weights for policy 1, policy_version 897577 (0.0008) [2023-12-28 01:41:19,166][106225] Updated weights for policy 1, policy_version 897587 (0.0008) [2023-12-28 01:41:19,237][106225] Updated weights for policy 1, policy_version 897597 (0.0008) [2023-12-28 01:41:19,765][106226] Updated weights for policy 0, policy_version 895377 (0.0008) [2023-12-28 01:41:19,834][106226] Updated weights for policy 0, policy_version 895387 (0.0007) [2023-12-28 01:41:19,907][106226] Updated weights for policy 0, policy_version 895397 (0.0007) [2023-12-28 01:41:19,993][106225] Updated weights for policy 1, policy_version 897607 (0.0009) [2023-12-28 01:41:20,050][106225] Updated weights for policy 1, policy_version 897617 (0.0008) [2023-12-28 01:41:20,113][106225] Updated weights for policy 1, policy_version 897627 (0.0008) [2023-12-28 01:41:20,659][106226] Updated weights for policy 0, policy_version 895407 (0.0007) [2023-12-28 01:41:20,723][106226] Updated weights for policy 0, policy_version 895417 (0.0009) [2023-12-28 01:41:20,788][106226] Updated weights for policy 0, policy_version 895427 (0.0009) [2023-12-28 01:41:20,871][106225] Updated weights for policy 1, policy_version 897637 (0.0009) [2023-12-28 01:41:20,932][106225] Updated weights for policy 1, policy_version 897647 (0.0009) [2023-12-28 01:41:20,995][106225] Updated weights for policy 1, policy_version 897657 (0.0008) [2023-12-28 01:41:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 459128832. Throughput: 0: 9871.6, 1: 9785.5. Samples: 459134800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:21,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-5.027')] [2023-12-28 01:41:21,547][106226] Updated weights for policy 0, policy_version 895437 (0.0009) [2023-12-28 01:41:21,614][106226] Updated weights for policy 0, policy_version 895447 (0.0009) [2023-12-28 01:41:21,681][106226] Updated weights for policy 0, policy_version 895457 (0.0010) [2023-12-28 01:41:21,873][106225] Updated weights for policy 1, policy_version 897667 (0.0008) [2023-12-28 01:41:21,938][106225] Updated weights for policy 1, policy_version 897677 (0.0008) [2023-12-28 01:41:22,004][106225] Updated weights for policy 1, policy_version 897687 (0.0008) [2023-12-28 01:41:22,458][106226] Updated weights for policy 0, policy_version 895467 (0.0009) [2023-12-28 01:41:22,516][106226] Updated weights for policy 0, policy_version 895477 (0.0011) [2023-12-28 01:41:22,573][106226] Updated weights for policy 0, policy_version 895487 (0.0011) [2023-12-28 01:41:22,674][106225] Updated weights for policy 1, policy_version 897697 (0.0007) [2023-12-28 01:41:22,735][106225] Updated weights for policy 1, policy_version 897707 (0.0006) [2023-12-28 01:41:22,798][106225] Updated weights for policy 1, policy_version 897717 (0.0006) [2023-12-28 01:41:22,849][106225] Updated weights for policy 1, policy_version 897727 (0.0006) [2023-12-28 01:41:23,222][106226] Updated weights for policy 0, policy_version 895497 (0.0009) [2023-12-28 01:41:23,277][106226] Updated weights for policy 0, policy_version 895507 (0.0005) [2023-12-28 01:41:23,329][106226] Updated weights for policy 0, policy_version 895517 (0.0010) [2023-12-28 01:41:23,379][106226] Updated weights for policy 0, policy_version 895527 (0.0010) [2023-12-28 01:41:23,449][106225] Updated weights for policy 1, policy_version 897737 (0.0007) [2023-12-28 01:41:23,509][106225] Updated weights for policy 1, policy_version 897747 (0.0010) [2023-12-28 01:41:23,563][106225] Updated weights for policy 1, policy_version 897757 (0.0010) [2023-12-28 01:41:24,066][106226] Updated weights for policy 0, policy_version 895537 (0.0008) [2023-12-28 01:41:24,124][106226] Updated weights for policy 0, policy_version 895547 (0.0008) [2023-12-28 01:41:24,178][106226] Updated weights for policy 0, policy_version 895557 (0.0008) [2023-12-28 01:41:24,237][106225] Updated weights for policy 1, policy_version 897767 (0.0010) [2023-12-28 01:41:24,287][106225] Updated weights for policy 1, policy_version 897777 (0.0009) [2023-12-28 01:41:24,348][106225] Updated weights for policy 1, policy_version 897787 (0.0009) [2023-12-28 01:41:24,952][106225] Updated weights for policy 1, policy_version 897797 (0.0008) [2023-12-28 01:41:24,959][106226] Updated weights for policy 0, policy_version 895567 (0.0008) [2023-12-28 01:41:25,002][106225] Updated weights for policy 1, policy_version 897807 (0.0005) [2023-12-28 01:41:25,005][106226] Updated weights for policy 0, policy_version 895577 (0.0008) [2023-12-28 01:41:25,052][106226] Updated weights for policy 0, policy_version 895587 (0.0007) [2023-12-28 01:41:25,055][106225] Updated weights for policy 1, policy_version 897817 (0.0005) [2023-12-28 01:41:25,735][106225] Updated weights for policy 1, policy_version 897827 (0.0006) [2023-12-28 01:41:25,792][106225] Updated weights for policy 1, policy_version 897837 (0.0008) [2023-12-28 01:41:25,815][106226] Updated weights for policy 0, policy_version 895597 (0.0008) [2023-12-28 01:41:25,852][106225] Updated weights for policy 1, policy_version 897847 (0.0007) [2023-12-28 01:41:25,870][106226] Updated weights for policy 0, policy_version 895607 (0.0008) [2023-12-28 01:41:25,923][106226] Updated weights for policy 0, policy_version 895617 (0.0007) [2023-12-28 01:41:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 459227136. Throughput: 0: 9782.0, 1: 9833.2. Samples: 459193612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:26,176][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.864')] [2023-12-28 01:41:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000897856_229892096.pth... [2023-12-28 01:41:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000895624_229335040.pth... [2023-12-28 01:41:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000896704_229597184.pth [2023-12-28 01:41:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000894472_229040128.pth [2023-12-28 01:41:26,492][106225] Updated weights for policy 1, policy_version 897857 (0.0006) [2023-12-28 01:41:26,539][106225] Updated weights for policy 1, policy_version 897867 (0.0008) [2023-12-28 01:41:26,585][106225] Updated weights for policy 1, policy_version 897877 (0.0008) [2023-12-28 01:41:26,640][106225] Updated weights for policy 1, policy_version 897887 (0.0008) [2023-12-28 01:41:26,680][106226] Updated weights for policy 0, policy_version 895627 (0.0008) [2023-12-28 01:41:26,737][106226] Updated weights for policy 0, policy_version 895637 (0.0009) [2023-12-28 01:41:26,798][106226] Updated weights for policy 0, policy_version 895647 (0.0008) [2023-12-28 01:41:27,238][106225] Updated weights for policy 1, policy_version 897897 (0.0006) [2023-12-28 01:41:27,285][106225] Updated weights for policy 1, policy_version 897907 (0.0005) [2023-12-28 01:41:27,352][106225] Updated weights for policy 1, policy_version 897917 (0.0006) [2023-12-28 01:41:27,565][106226] Updated weights for policy 0, policy_version 895657 (0.0008) [2023-12-28 01:41:27,627][106226] Updated weights for policy 0, policy_version 895667 (0.0010) [2023-12-28 01:41:27,692][106226] Updated weights for policy 0, policy_version 895677 (0.0010) [2023-12-28 01:41:27,757][106226] Updated weights for policy 0, policy_version 895687 (0.0010) [2023-12-28 01:41:27,843][106225] Updated weights for policy 1, policy_version 897927 (0.0005) [2023-12-28 01:41:27,888][106225] Updated weights for policy 1, policy_version 897937 (0.0005) [2023-12-28 01:41:27,933][106225] Updated weights for policy 1, policy_version 897947 (0.0005) [2023-12-28 01:41:28,495][106226] Updated weights for policy 0, policy_version 895697 (0.0011) [2023-12-28 01:41:28,561][106226] Updated weights for policy 0, policy_version 895707 (0.0010) [2023-12-28 01:41:28,580][106225] Updated weights for policy 1, policy_version 897957 (0.0007) [2023-12-28 01:41:28,610][106226] Updated weights for policy 0, policy_version 895717 (0.0010) [2023-12-28 01:41:28,636][106225] Updated weights for policy 1, policy_version 897967 (0.0006) [2023-12-28 01:41:28,690][106225] Updated weights for policy 1, policy_version 897977 (0.0007) [2023-12-28 01:41:29,272][106226] Updated weights for policy 0, policy_version 895727 (0.0010) [2023-12-28 01:41:29,335][106226] Updated weights for policy 0, policy_version 895737 (0.0010) [2023-12-28 01:41:29,380][106225] Updated weights for policy 1, policy_version 897987 (0.0007) [2023-12-28 01:41:29,404][106226] Updated weights for policy 0, policy_version 895747 (0.0011) [2023-12-28 01:41:29,439][106225] Updated weights for policy 1, policy_version 897997 (0.0007) [2023-12-28 01:41:29,491][106225] Updated weights for policy 1, policy_version 898007 (0.0006) [2023-12-28 01:41:30,124][106226] Updated weights for policy 0, policy_version 895757 (0.0007) [2023-12-28 01:41:30,146][106225] Updated weights for policy 1, policy_version 898017 (0.0006) [2023-12-28 01:41:30,191][106226] Updated weights for policy 0, policy_version 895767 (0.0008) [2023-12-28 01:41:30,198][106225] Updated weights for policy 1, policy_version 898027 (0.0006) [2023-12-28 01:41:30,249][106225] Updated weights for policy 1, policy_version 898037 (0.0006) [2023-12-28 01:41:30,251][106226] Updated weights for policy 0, policy_version 895777 (0.0009) [2023-12-28 01:41:30,303][106225] Updated weights for policy 1, policy_version 898047 (0.0007) [2023-12-28 01:41:30,830][106226] Updated weights for policy 0, policy_version 895787 (0.0007) [2023-12-28 01:41:30,878][106226] Updated weights for policy 0, policy_version 895797 (0.0005) [2023-12-28 01:41:30,925][106226] Updated weights for policy 0, policy_version 895807 (0.0006) [2023-12-28 01:41:31,073][106225] Updated weights for policy 1, policy_version 898057 (0.0009) [2023-12-28 01:41:31,130][106225] Updated weights for policy 1, policy_version 898067 (0.0009) [2023-12-28 01:41:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 459325440. Throughput: 0: 9714.6, 1: 10038.8. Samples: 459316740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:31,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-4.848')] [2023-12-28 01:41:31,196][106225] Updated weights for policy 1, policy_version 898077 (0.0009) [2023-12-28 01:41:31,636][106226] Updated weights for policy 0, policy_version 895817 (0.0009) [2023-12-28 01:41:31,699][106226] Updated weights for policy 0, policy_version 895827 (0.0007) [2023-12-28 01:41:31,772][106226] Updated weights for policy 0, policy_version 895837 (0.0009) [2023-12-28 01:41:31,836][106226] Updated weights for policy 0, policy_version 895847 (0.0008) [2023-12-28 01:41:31,949][106225] Updated weights for policy 1, policy_version 898087 (0.0006) [2023-12-28 01:41:32,014][106225] Updated weights for policy 1, policy_version 898097 (0.0008) [2023-12-28 01:41:32,076][106225] Updated weights for policy 1, policy_version 898107 (0.0008) [2023-12-28 01:41:32,558][106226] Updated weights for policy 0, policy_version 895857 (0.0010) [2023-12-28 01:41:32,613][106226] Updated weights for policy 0, policy_version 895867 (0.0008) [2023-12-28 01:41:32,669][106226] Updated weights for policy 0, policy_version 895877 (0.0008) [2023-12-28 01:41:32,746][106225] Updated weights for policy 1, policy_version 898117 (0.0009) [2023-12-28 01:41:32,806][106225] Updated weights for policy 1, policy_version 898127 (0.0006) [2023-12-28 01:41:32,865][106225] Updated weights for policy 1, policy_version 898137 (0.0008) [2023-12-28 01:41:33,300][106226] Updated weights for policy 0, policy_version 895887 (0.0006) [2023-12-28 01:41:33,352][106226] Updated weights for policy 0, policy_version 895897 (0.0006) [2023-12-28 01:41:33,405][106226] Updated weights for policy 0, policy_version 895907 (0.0008) [2023-12-28 01:41:33,612][106225] Updated weights for policy 1, policy_version 898147 (0.0009) [2023-12-28 01:41:33,664][106225] Updated weights for policy 1, policy_version 898157 (0.0010) [2023-12-28 01:41:33,709][106225] Updated weights for policy 1, policy_version 898167 (0.0010) [2023-12-28 01:41:34,105][106226] Updated weights for policy 0, policy_version 895917 (0.0008) [2023-12-28 01:41:34,170][106226] Updated weights for policy 0, policy_version 895927 (0.0008) [2023-12-28 01:41:34,229][106226] Updated weights for policy 0, policy_version 895937 (0.0008) [2023-12-28 01:41:34,451][106225] Updated weights for policy 1, policy_version 898177 (0.0010) [2023-12-28 01:41:34,513][106225] Updated weights for policy 1, policy_version 898187 (0.0010) [2023-12-28 01:41:34,574][106225] Updated weights for policy 1, policy_version 898197 (0.0010) [2023-12-28 01:41:34,632][106225] Updated weights for policy 1, policy_version 898207 (0.0010) [2023-12-28 01:41:35,005][106226] Updated weights for policy 0, policy_version 895947 (0.0009) [2023-12-28 01:41:35,063][106226] Updated weights for policy 0, policy_version 895957 (0.0008) [2023-12-28 01:41:35,126][106226] Updated weights for policy 0, policy_version 895967 (0.0008) [2023-12-28 01:41:35,352][106225] Updated weights for policy 1, policy_version 898217 (0.0010) [2023-12-28 01:41:35,410][106225] Updated weights for policy 1, policy_version 898227 (0.0010) [2023-12-28 01:41:35,469][106225] Updated weights for policy 1, policy_version 898237 (0.0010) [2023-12-28 01:41:35,842][106226] Updated weights for policy 0, policy_version 895977 (0.0008) [2023-12-28 01:41:35,909][106226] Updated weights for policy 0, policy_version 895987 (0.0008) [2023-12-28 01:41:35,965][106226] Updated weights for policy 0, policy_version 895997 (0.0007) [2023-12-28 01:41:36,019][106226] Updated weights for policy 0, policy_version 896007 (0.0008) [2023-12-28 01:41:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 459423744. Throughput: 0: 9767.6, 1: 9967.0. Samples: 459432940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:36,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.787')] [2023-12-28 01:41:36,188][106225] Updated weights for policy 1, policy_version 898247 (0.0007) [2023-12-28 01:41:36,252][106225] Updated weights for policy 1, policy_version 898257 (0.0006) [2023-12-28 01:41:36,314][106225] Updated weights for policy 1, policy_version 898267 (0.0007) [2023-12-28 01:41:36,737][106226] Updated weights for policy 0, policy_version 896017 (0.0008) [2023-12-28 01:41:36,785][106226] Updated weights for policy 0, policy_version 896027 (0.0010) [2023-12-28 01:41:36,840][106226] Updated weights for policy 0, policy_version 896037 (0.0011) [2023-12-28 01:41:37,024][106225] Updated weights for policy 1, policy_version 898277 (0.0008) [2023-12-28 01:41:37,088][106225] Updated weights for policy 1, policy_version 898287 (0.0008) [2023-12-28 01:41:37,148][106225] Updated weights for policy 1, policy_version 898297 (0.0008) [2023-12-28 01:41:37,612][106226] Updated weights for policy 0, policy_version 896047 (0.0011) [2023-12-28 01:41:37,659][106226] Updated weights for policy 0, policy_version 896057 (0.0010) [2023-12-28 01:41:37,706][106226] Updated weights for policy 0, policy_version 896067 (0.0010) [2023-12-28 01:41:37,871][106225] Updated weights for policy 1, policy_version 898307 (0.0007) [2023-12-28 01:41:37,920][106225] Updated weights for policy 1, policy_version 898317 (0.0007) [2023-12-28 01:41:37,973][106225] Updated weights for policy 1, policy_version 898327 (0.0010) [2023-12-28 01:41:38,369][106226] Updated weights for policy 0, policy_version 896077 (0.0009) [2023-12-28 01:41:38,429][106226] Updated weights for policy 0, policy_version 896087 (0.0008) [2023-12-28 01:41:38,484][106226] Updated weights for policy 0, policy_version 896097 (0.0008) [2023-12-28 01:41:38,631][106225] Updated weights for policy 1, policy_version 898337 (0.0008) [2023-12-28 01:41:38,686][106225] Updated weights for policy 1, policy_version 898347 (0.0010) [2023-12-28 01:41:38,742][106225] Updated weights for policy 1, policy_version 898357 (0.0010) [2023-12-28 01:41:38,799][106225] Updated weights for policy 1, policy_version 898367 (0.0010) [2023-12-28 01:41:39,206][106226] Updated weights for policy 0, policy_version 896107 (0.0008) [2023-12-28 01:41:39,276][106226] Updated weights for policy 0, policy_version 896117 (0.0009) [2023-12-28 01:41:39,341][106226] Updated weights for policy 0, policy_version 896127 (0.0010) [2023-12-28 01:41:39,592][106225] Updated weights for policy 1, policy_version 898377 (0.0008) [2023-12-28 01:41:39,645][106225] Updated weights for policy 1, policy_version 898387 (0.0008) [2023-12-28 01:41:39,702][106225] Updated weights for policy 1, policy_version 898397 (0.0008) [2023-12-28 01:41:40,088][106226] Updated weights for policy 0, policy_version 896137 (0.0008) [2023-12-28 01:41:40,156][106226] Updated weights for policy 0, policy_version 896147 (0.0006) [2023-12-28 01:41:40,222][106226] Updated weights for policy 0, policy_version 896157 (0.0007) [2023-12-28 01:41:40,275][106226] Updated weights for policy 0, policy_version 896167 (0.0006) [2023-12-28 01:41:40,422][106225] Updated weights for policy 1, policy_version 898407 (0.0008) [2023-12-28 01:41:40,483][106225] Updated weights for policy 1, policy_version 898417 (0.0009) [2023-12-28 01:41:40,537][106225] Updated weights for policy 1, policy_version 898427 (0.0007) [2023-12-28 01:41:40,861][106226] Updated weights for policy 0, policy_version 896177 (0.0005) [2023-12-28 01:41:40,926][106226] Updated weights for policy 0, policy_version 896187 (0.0008) [2023-12-28 01:41:40,986][106226] Updated weights for policy 0, policy_version 896197 (0.0009) [2023-12-28 01:41:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 459522048. Throughput: 0: 9793.0, 1: 9986.8. Samples: 459492076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:41,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-5.037')] [2023-12-28 01:41:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000896200_229482496.pth... [2023-12-28 01:41:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000898432_230039552.pth... [2023-12-28 01:41:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000895048_229187584.pth [2023-12-28 01:41:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000897280_229744640.pth [2023-12-28 01:41:41,289][106225] Updated weights for policy 1, policy_version 898437 (0.0009) [2023-12-28 01:41:41,352][106225] Updated weights for policy 1, policy_version 898447 (0.0011) [2023-12-28 01:41:41,420][106225] Updated weights for policy 1, policy_version 898457 (0.0009) [2023-12-28 01:41:41,686][106226] Updated weights for policy 0, policy_version 896207 (0.0009) [2023-12-28 01:41:41,760][106226] Updated weights for policy 0, policy_version 896217 (0.0009) [2023-12-28 01:41:41,823][106226] Updated weights for policy 0, policy_version 896227 (0.0010) [2023-12-28 01:41:42,093][106225] Updated weights for policy 1, policy_version 898467 (0.0008) [2023-12-28 01:41:42,142][106225] Updated weights for policy 1, policy_version 898477 (0.0008) [2023-12-28 01:41:42,197][106225] Updated weights for policy 1, policy_version 898487 (0.0008) [2023-12-28 01:41:42,596][106226] Updated weights for policy 0, policy_version 896237 (0.0008) [2023-12-28 01:41:42,661][106226] Updated weights for policy 0, policy_version 896247 (0.0008) [2023-12-28 01:41:42,726][106226] Updated weights for policy 0, policy_version 896257 (0.0007) [2023-12-28 01:41:42,971][106225] Updated weights for policy 1, policy_version 898497 (0.0008) [2023-12-28 01:41:43,025][106225] Updated weights for policy 1, policy_version 898507 (0.0008) [2023-12-28 01:41:43,069][106225] Updated weights for policy 1, policy_version 898517 (0.0008) [2023-12-28 01:41:43,121][106225] Updated weights for policy 1, policy_version 898527 (0.0008) [2023-12-28 01:41:43,388][106226] Updated weights for policy 0, policy_version 896267 (0.0006) [2023-12-28 01:41:43,451][106226] Updated weights for policy 0, policy_version 896277 (0.0007) [2023-12-28 01:41:43,503][106226] Updated weights for policy 0, policy_version 896287 (0.0005) [2023-12-28 01:41:43,875][106225] Updated weights for policy 1, policy_version 898537 (0.0006) [2023-12-28 01:41:43,945][106225] Updated weights for policy 1, policy_version 898547 (0.0005) [2023-12-28 01:41:44,009][106225] Updated weights for policy 1, policy_version 898557 (0.0008) [2023-12-28 01:41:44,146][106226] Updated weights for policy 0, policy_version 896297 (0.0005) [2023-12-28 01:41:44,203][106226] Updated weights for policy 0, policy_version 896307 (0.0005) [2023-12-28 01:41:44,284][106226] Updated weights for policy 0, policy_version 896317 (0.0006) [2023-12-28 01:41:44,340][106226] Updated weights for policy 0, policy_version 896327 (0.0009) [2023-12-28 01:41:44,587][106225] Updated weights for policy 1, policy_version 898567 (0.0006) [2023-12-28 01:41:44,633][106225] Updated weights for policy 1, policy_version 898577 (0.0005) [2023-12-28 01:41:44,676][106225] Updated weights for policy 1, policy_version 898587 (0.0005) [2023-12-28 01:41:45,086][106226] Updated weights for policy 0, policy_version 896337 (0.0007) [2023-12-28 01:41:45,141][106226] Updated weights for policy 0, policy_version 896347 (0.0008) [2023-12-28 01:41:45,203][106226] Updated weights for policy 0, policy_version 896357 (0.0008) [2023-12-28 01:41:45,375][106225] Updated weights for policy 1, policy_version 898597 (0.0008) [2023-12-28 01:41:45,439][106225] Updated weights for policy 1, policy_version 898607 (0.0008) [2023-12-28 01:41:45,506][106225] Updated weights for policy 1, policy_version 898617 (0.0006) [2023-12-28 01:41:45,918][106226] Updated weights for policy 0, policy_version 896367 (0.0008) [2023-12-28 01:41:45,970][106226] Updated weights for policy 0, policy_version 896377 (0.0009) [2023-12-28 01:41:46,028][106226] Updated weights for policy 0, policy_version 896387 (0.0009) [2023-12-28 01:41:46,160][106225] Updated weights for policy 1, policy_version 898627 (0.0007) [2023-12-28 01:41:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 459620352. Throughput: 0: 9838.7, 1: 9943.1. Samples: 459609228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:46,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-4.845')] [2023-12-28 01:41:46,222][106225] Updated weights for policy 1, policy_version 898637 (0.0008) [2023-12-28 01:41:46,280][106225] Updated weights for policy 1, policy_version 898647 (0.0008) [2023-12-28 01:41:46,713][106226] Updated weights for policy 0, policy_version 896397 (0.0010) [2023-12-28 01:41:46,781][106226] Updated weights for policy 0, policy_version 896407 (0.0009) [2023-12-28 01:41:46,838][106226] Updated weights for policy 0, policy_version 896417 (0.0009) [2023-12-28 01:41:46,975][106225] Updated weights for policy 1, policy_version 898657 (0.0008) [2023-12-28 01:41:47,035][106225] Updated weights for policy 1, policy_version 898667 (0.0008) [2023-12-28 01:41:47,095][106225] Updated weights for policy 1, policy_version 898677 (0.0009) [2023-12-28 01:41:47,158][106225] Updated weights for policy 1, policy_version 898687 (0.0008) [2023-12-28 01:41:47,587][106226] Updated weights for policy 0, policy_version 896427 (0.0010) [2023-12-28 01:41:47,650][106226] Updated weights for policy 0, policy_version 896437 (0.0010) [2023-12-28 01:41:47,709][106226] Updated weights for policy 0, policy_version 896447 (0.0010) [2023-12-28 01:41:47,839][106225] Updated weights for policy 1, policy_version 898697 (0.0006) [2023-12-28 01:41:47,905][106225] Updated weights for policy 1, policy_version 898707 (0.0006) [2023-12-28 01:41:47,968][106225] Updated weights for policy 1, policy_version 898717 (0.0005) [2023-12-28 01:41:48,504][106226] Updated weights for policy 0, policy_version 896457 (0.0009) [2023-12-28 01:41:48,519][106225] Updated weights for policy 1, policy_version 898727 (0.0006) [2023-12-28 01:41:48,565][106226] Updated weights for policy 0, policy_version 896467 (0.0007) [2023-12-28 01:41:48,579][106225] Updated weights for policy 1, policy_version 898737 (0.0006) [2023-12-28 01:41:48,625][106226] Updated weights for policy 0, policy_version 896477 (0.0006) [2023-12-28 01:41:48,641][106225] Updated weights for policy 1, policy_version 898747 (0.0008) [2023-12-28 01:41:48,690][106226] Updated weights for policy 0, policy_version 896487 (0.0008) [2023-12-28 01:41:49,372][106225] Updated weights for policy 1, policy_version 898757 (0.0006) [2023-12-28 01:41:49,439][106225] Updated weights for policy 1, policy_version 898767 (0.0008) [2023-12-28 01:41:49,478][106226] Updated weights for policy 0, policy_version 896497 (0.0008) [2023-12-28 01:41:49,501][106225] Updated weights for policy 1, policy_version 898777 (0.0007) [2023-12-28 01:41:49,538][106226] Updated weights for policy 0, policy_version 896507 (0.0008) [2023-12-28 01:41:49,607][106226] Updated weights for policy 0, policy_version 896517 (0.0009) [2023-12-28 01:41:50,232][106225] Updated weights for policy 1, policy_version 898787 (0.0008) [2023-12-28 01:41:50,295][106225] Updated weights for policy 1, policy_version 898797 (0.0006) [2023-12-28 01:41:50,302][106226] Updated weights for policy 0, policy_version 896527 (0.0008) [2023-12-28 01:41:50,355][106225] Updated weights for policy 1, policy_version 898807 (0.0007) [2023-12-28 01:41:50,362][106226] Updated weights for policy 0, policy_version 896537 (0.0007) [2023-12-28 01:41:50,424][106226] Updated weights for policy 0, policy_version 896547 (0.0007) [2023-12-28 01:41:51,076][106225] Updated weights for policy 1, policy_version 898817 (0.0008) [2023-12-28 01:41:51,140][106225] Updated weights for policy 1, policy_version 898827 (0.0008) [2023-12-28 01:41:51,162][106226] Updated weights for policy 0, policy_version 896557 (0.0008) [2023-12-28 01:41:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 459710464. Throughput: 0: 9662.1, 1: 9972.8. Samples: 459725636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:51,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.732')] [2023-12-28 01:41:51,199][106225] Updated weights for policy 1, policy_version 898837 (0.0005) [2023-12-28 01:41:51,223][106226] Updated weights for policy 0, policy_version 896567 (0.0007) [2023-12-28 01:41:51,269][106225] Updated weights for policy 1, policy_version 898847 (0.0008) [2023-12-28 01:41:51,289][106226] Updated weights for policy 0, policy_version 896577 (0.0008) [2023-12-28 01:41:52,003][106226] Updated weights for policy 0, policy_version 896587 (0.0009) [2023-12-28 01:41:52,015][106225] Updated weights for policy 1, policy_version 898857 (0.0008) [2023-12-28 01:41:52,064][106226] Updated weights for policy 0, policy_version 896597 (0.0008) [2023-12-28 01:41:52,076][106225] Updated weights for policy 1, policy_version 898867 (0.0006) [2023-12-28 01:41:52,129][106226] Updated weights for policy 0, policy_version 896607 (0.0006) [2023-12-28 01:41:52,141][106225] Updated weights for policy 1, policy_version 898877 (0.0006) [2023-12-28 01:41:52,798][106225] Updated weights for policy 1, policy_version 898887 (0.0008) [2023-12-28 01:41:52,844][106225] Updated weights for policy 1, policy_version 898897 (0.0007) [2023-12-28 01:41:52,901][106226] Updated weights for policy 0, policy_version 896617 (0.0009) [2023-12-28 01:41:52,902][106225] Updated weights for policy 1, policy_version 898907 (0.0005) [2023-12-28 01:41:52,952][106226] Updated weights for policy 0, policy_version 896627 (0.0008) [2023-12-28 01:41:53,003][106226] Updated weights for policy 0, policy_version 896637 (0.0009) [2023-12-28 01:41:53,074][106226] Updated weights for policy 0, policy_version 896647 (0.0010) [2023-12-28 01:41:53,501][106225] Updated weights for policy 1, policy_version 898917 (0.0007) [2023-12-28 01:41:53,549][106225] Updated weights for policy 1, policy_version 898927 (0.0005) [2023-12-28 01:41:53,600][106225] Updated weights for policy 1, policy_version 898937 (0.0005) [2023-12-28 01:41:53,930][106226] Updated weights for policy 0, policy_version 896657 (0.0009) [2023-12-28 01:41:53,984][106226] Updated weights for policy 0, policy_version 896667 (0.0009) [2023-12-28 01:41:54,038][106226] Updated weights for policy 0, policy_version 896677 (0.0008) [2023-12-28 01:41:54,159][106225] Updated weights for policy 1, policy_version 898947 (0.0005) [2023-12-28 01:41:54,218][106225] Updated weights for policy 1, policy_version 898957 (0.0006) [2023-12-28 01:41:54,269][106225] Updated weights for policy 1, policy_version 898967 (0.0005) [2023-12-28 01:41:54,787][106226] Updated weights for policy 0, policy_version 896687 (0.0008) [2023-12-28 01:41:54,841][106226] Updated weights for policy 0, policy_version 896697 (0.0008) [2023-12-28 01:41:54,867][106225] Updated weights for policy 1, policy_version 898977 (0.0008) [2023-12-28 01:41:54,891][106226] Updated weights for policy 0, policy_version 896707 (0.0009) [2023-12-28 01:41:54,909][106225] Updated weights for policy 1, policy_version 898987 (0.0010) [2023-12-28 01:41:54,956][106225] Updated weights for policy 1, policy_version 898997 (0.0010) [2023-12-28 01:41:55,021][106225] Updated weights for policy 1, policy_version 899007 (0.0010) [2023-12-28 01:41:55,607][106226] Updated weights for policy 0, policy_version 896717 (0.0007) [2023-12-28 01:41:55,658][106226] Updated weights for policy 0, policy_version 896727 (0.0008) [2023-12-28 01:41:55,709][106226] Updated weights for policy 0, policy_version 896737 (0.0008) [2023-12-28 01:41:55,751][106225] Updated weights for policy 1, policy_version 899017 (0.0010) [2023-12-28 01:41:55,804][106225] Updated weights for policy 1, policy_version 899027 (0.0010) [2023-12-28 01:41:55,859][106225] Updated weights for policy 1, policy_version 899037 (0.0010) [2023-12-28 01:41:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 459816960. Throughput: 0: 9606.9, 1: 10025.1. Samples: 459783412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:41:56,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-4.915')] [2023-12-28 01:41:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000896744_229621760.pth... [2023-12-28 01:41:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000899040_230195200.pth... [2023-12-28 01:41:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000895624_229335040.pth [2023-12-28 01:41:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000897856_229892096.pth [2023-12-28 01:41:56,464][106226] Updated weights for policy 0, policy_version 896747 (0.0009) [2023-12-28 01:41:56,519][106226] Updated weights for policy 0, policy_version 896757 (0.0008) [2023-12-28 01:41:56,567][106226] Updated weights for policy 0, policy_version 896767 (0.0009) [2023-12-28 01:41:56,578][106225] Updated weights for policy 1, policy_version 899047 (0.0010) [2023-12-28 01:41:56,631][106225] Updated weights for policy 1, policy_version 899057 (0.0010) [2023-12-28 01:41:56,681][106225] Updated weights for policy 1, policy_version 899067 (0.0010) [2023-12-28 01:41:57,307][106226] Updated weights for policy 0, policy_version 896777 (0.0006) [2023-12-28 01:41:57,365][106226] Updated weights for policy 0, policy_version 896787 (0.0009) [2023-12-28 01:41:57,393][106225] Updated weights for policy 1, policy_version 899077 (0.0008) [2023-12-28 01:41:57,429][106226] Updated weights for policy 0, policy_version 896797 (0.0007) [2023-12-28 01:41:57,453][106225] Updated weights for policy 1, policy_version 899087 (0.0008) [2023-12-28 01:41:57,497][106226] Updated weights for policy 0, policy_version 896807 (0.0007) [2023-12-28 01:41:57,509][106225] Updated weights for policy 1, policy_version 899097 (0.0008) [2023-12-28 01:41:58,039][106225] Updated weights for policy 1, policy_version 899107 (0.0010) [2023-12-28 01:41:58,092][106225] Updated weights for policy 1, policy_version 899117 (0.0010) [2023-12-28 01:41:58,138][106225] Updated weights for policy 1, policy_version 899127 (0.0010) [2023-12-28 01:41:58,270][106226] Updated weights for policy 0, policy_version 896817 (0.0008) [2023-12-28 01:41:58,344][106226] Updated weights for policy 0, policy_version 896827 (0.0008) [2023-12-28 01:41:58,415][106226] Updated weights for policy 0, policy_version 896837 (0.0007) [2023-12-28 01:41:58,965][106225] Updated weights for policy 1, policy_version 899137 (0.0010) [2023-12-28 01:41:59,022][106225] Updated weights for policy 1, policy_version 899147 (0.0008) [2023-12-28 01:41:59,081][106225] Updated weights for policy 1, policy_version 899157 (0.0008) [2023-12-28 01:41:59,112][106226] Updated weights for policy 0, policy_version 896847 (0.0009) [2023-12-28 01:41:59,143][106225] Updated weights for policy 1, policy_version 899167 (0.0009) [2023-12-28 01:41:59,173][106226] Updated weights for policy 0, policy_version 896857 (0.0010) [2023-12-28 01:41:59,240][106226] Updated weights for policy 0, policy_version 896867 (0.0008) [2023-12-28 01:41:59,998][106225] Updated weights for policy 1, policy_version 899177 (0.0008) [2023-12-28 01:42:00,059][106225] Updated weights for policy 1, policy_version 899187 (0.0008) [2023-12-28 01:42:00,060][106226] Updated weights for policy 0, policy_version 896877 (0.0008) [2023-12-28 01:42:00,105][106226] Updated weights for policy 0, policy_version 896887 (0.0007) [2023-12-28 01:42:00,120][106225] Updated weights for policy 1, policy_version 899197 (0.0007) [2023-12-28 01:42:00,155][106226] Updated weights for policy 0, policy_version 896897 (0.0009) [2023-12-28 01:42:00,842][106225] Updated weights for policy 1, policy_version 899207 (0.0007) [2023-12-28 01:42:00,892][106225] Updated weights for policy 1, policy_version 899217 (0.0007) [2023-12-28 01:42:00,928][106226] Updated weights for policy 0, policy_version 896907 (0.0007) [2023-12-28 01:42:00,953][106225] Updated weights for policy 1, policy_version 899227 (0.0005) [2023-12-28 01:42:00,994][106226] Updated weights for policy 0, policy_version 896917 (0.0005) [2023-12-28 01:42:01,060][106226] Updated weights for policy 0, policy_version 896927 (0.0010) [2023-12-28 01:42:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 459915264. Throughput: 0: 9577.3, 1: 10046.2. Samples: 459900564. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:01,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.715')] [2023-12-28 01:42:01,746][106225] Updated weights for policy 1, policy_version 899237 (0.0007) [2023-12-28 01:42:01,748][106226] Updated weights for policy 0, policy_version 896937 (0.0011) [2023-12-28 01:42:01,814][106225] Updated weights for policy 1, policy_version 899247 (0.0008) [2023-12-28 01:42:01,814][106226] Updated weights for policy 0, policy_version 896947 (0.0010) [2023-12-28 01:42:01,869][106226] Updated weights for policy 0, policy_version 896957 (0.0010) [2023-12-28 01:42:01,871][106225] Updated weights for policy 1, policy_version 899257 (0.0006) [2023-12-28 01:42:01,926][106226] Updated weights for policy 0, policy_version 896967 (0.0010) [2023-12-28 01:42:02,637][106225] Updated weights for policy 1, policy_version 899267 (0.0006) [2023-12-28 01:42:02,671][106226] Updated weights for policy 0, policy_version 896977 (0.0007) [2023-12-28 01:42:02,703][106225] Updated weights for policy 1, policy_version 899277 (0.0007) [2023-12-28 01:42:02,723][106226] Updated weights for policy 0, policy_version 896987 (0.0007) [2023-12-28 01:42:02,765][106225] Updated weights for policy 1, policy_version 899287 (0.0008) [2023-12-28 01:42:02,784][106226] Updated weights for policy 0, policy_version 896997 (0.0006) [2023-12-28 01:42:03,412][106225] Updated weights for policy 1, policy_version 899297 (0.0008) [2023-12-28 01:42:03,446][106226] Updated weights for policy 0, policy_version 897007 (0.0009) [2023-12-28 01:42:03,456][106225] Updated weights for policy 1, policy_version 899307 (0.0006) [2023-12-28 01:42:03,505][106226] Updated weights for policy 0, policy_version 897017 (0.0010) [2023-12-28 01:42:03,505][106225] Updated weights for policy 1, policy_version 899317 (0.0007) [2023-12-28 01:42:03,556][106225] Updated weights for policy 1, policy_version 899327 (0.0006) [2023-12-28 01:42:03,561][106226] Updated weights for policy 0, policy_version 897027 (0.0010) [2023-12-28 01:42:04,277][106225] Updated weights for policy 1, policy_version 899337 (0.0008) [2023-12-28 01:42:04,283][106226] Updated weights for policy 0, policy_version 897037 (0.0010) [2023-12-28 01:42:04,336][106225] Updated weights for policy 1, policy_version 899347 (0.0006) [2023-12-28 01:42:04,344][106226] Updated weights for policy 0, policy_version 897047 (0.0010) [2023-12-28 01:42:04,400][106225] Updated weights for policy 1, policy_version 899357 (0.0007) [2023-12-28 01:42:04,409][106226] Updated weights for policy 0, policy_version 897057 (0.0011) [2023-12-28 01:42:05,118][106225] Updated weights for policy 1, policy_version 899367 (0.0007) [2023-12-28 01:42:05,118][106226] Updated weights for policy 0, policy_version 897067 (0.0011) [2023-12-28 01:42:05,175][106226] Updated weights for policy 0, policy_version 897077 (0.0010) [2023-12-28 01:42:05,178][106225] Updated weights for policy 1, policy_version 899377 (0.0009) [2023-12-28 01:42:05,235][106225] Updated weights for policy 1, policy_version 899387 (0.0007) [2023-12-28 01:42:05,235][106226] Updated weights for policy 0, policy_version 897087 (0.0010) [2023-12-28 01:42:05,901][106226] Updated weights for policy 0, policy_version 897097 (0.0010) [2023-12-28 01:42:05,957][106226] Updated weights for policy 0, policy_version 897107 (0.0007) [2023-12-28 01:42:05,961][106225] Updated weights for policy 1, policy_version 899397 (0.0007) [2023-12-28 01:42:06,013][106226] Updated weights for policy 0, policy_version 897117 (0.0011) [2023-12-28 01:42:06,015][106225] Updated weights for policy 1, policy_version 899407 (0.0006) [2023-12-28 01:42:06,065][106226] Updated weights for policy 0, policy_version 897127 (0.0010) [2023-12-28 01:42:06,075][106225] Updated weights for policy 1, policy_version 899417 (0.0006) [2023-12-28 01:42:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 460013568. Throughput: 0: 9603.1, 1: 10015.5. Samples: 460017636. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:06,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.734')] [2023-12-28 01:42:06,669][106226] Updated weights for policy 0, policy_version 897137 (0.0006) [2023-12-28 01:42:06,728][106226] Updated weights for policy 0, policy_version 897147 (0.0005) [2023-12-28 01:42:06,793][106226] Updated weights for policy 0, policy_version 897157 (0.0005) [2023-12-28 01:42:06,904][106225] Updated weights for policy 1, policy_version 899427 (0.0009) [2023-12-28 01:42:06,953][106225] Updated weights for policy 1, policy_version 899437 (0.0006) [2023-12-28 01:42:07,002][106225] Updated weights for policy 1, policy_version 899447 (0.0007) [2023-12-28 01:42:07,435][106226] Updated weights for policy 0, policy_version 897167 (0.0005) [2023-12-28 01:42:07,500][106226] Updated weights for policy 0, policy_version 897177 (0.0005) [2023-12-28 01:42:07,565][106226] Updated weights for policy 0, policy_version 897187 (0.0005) [2023-12-28 01:42:07,634][106225] Updated weights for policy 1, policy_version 899457 (0.0008) [2023-12-28 01:42:07,695][106225] Updated weights for policy 1, policy_version 899467 (0.0010) [2023-12-28 01:42:07,750][106225] Updated weights for policy 1, policy_version 899477 (0.0011) [2023-12-28 01:42:07,808][106225] Updated weights for policy 1, policy_version 899487 (0.0010) [2023-12-28 01:42:08,144][106226] Updated weights for policy 0, policy_version 897197 (0.0008) [2023-12-28 01:42:08,197][106226] Updated weights for policy 0, policy_version 897207 (0.0010) [2023-12-28 01:42:08,243][106226] Updated weights for policy 0, policy_version 897217 (0.0010) [2023-12-28 01:42:08,520][106225] Updated weights for policy 1, policy_version 899497 (0.0006) [2023-12-28 01:42:08,575][106225] Updated weights for policy 1, policy_version 899507 (0.0008) [2023-12-28 01:42:08,624][106225] Updated weights for policy 1, policy_version 899517 (0.0009) [2023-12-28 01:42:08,967][106226] Updated weights for policy 0, policy_version 897227 (0.0010) [2023-12-28 01:42:09,024][106226] Updated weights for policy 0, policy_version 897237 (0.0011) [2023-12-28 01:42:09,086][106226] Updated weights for policy 0, policy_version 897247 (0.0010) [2023-12-28 01:42:09,367][106225] Updated weights for policy 1, policy_version 899527 (0.0008) [2023-12-28 01:42:09,435][106225] Updated weights for policy 1, policy_version 899537 (0.0011) [2023-12-28 01:42:09,492][106225] Updated weights for policy 1, policy_version 899547 (0.0010) [2023-12-28 01:42:09,804][106226] Updated weights for policy 0, policy_version 897257 (0.0010) [2023-12-28 01:42:09,871][106226] Updated weights for policy 0, policy_version 897267 (0.0008) [2023-12-28 01:42:09,934][106226] Updated weights for policy 0, policy_version 897277 (0.0008) [2023-12-28 01:42:10,008][106226] Updated weights for policy 0, policy_version 897287 (0.0008) [2023-12-28 01:42:10,264][106225] Updated weights for policy 1, policy_version 899557 (0.0010) [2023-12-28 01:42:10,326][106225] Updated weights for policy 1, policy_version 899567 (0.0011) [2023-12-28 01:42:10,386][106225] Updated weights for policy 1, policy_version 899577 (0.0011) [2023-12-28 01:42:10,667][106226] Updated weights for policy 0, policy_version 897297 (0.0006) [2023-12-28 01:42:10,719][106226] Updated weights for policy 0, policy_version 897307 (0.0005) [2023-12-28 01:42:10,769][106226] Updated weights for policy 0, policy_version 897317 (0.0005) [2023-12-28 01:42:11,077][106225] Updated weights for policy 1, policy_version 899587 (0.0010) [2023-12-28 01:42:11,146][106225] Updated weights for policy 1, policy_version 899597 (0.0008) [2023-12-28 01:42:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 460103680. Throughput: 0: 9659.0, 1: 10017.4. Samples: 460079048. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:11,176][105115] Avg episode reward: [(0, '-4.127'), (1, '-4.608')] [2023-12-28 01:42:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000897320_229769216.pth... [2023-12-28 01:42:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000896200_229482496.pth [2023-12-28 01:42:11,211][106225] Updated weights for policy 1, policy_version 899607 (0.0008) [2023-12-28 01:42:11,269][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000899616_230342656.pth... [2023-12-28 01:42:11,273][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000898432_230039552.pth [2023-12-28 01:42:11,504][106226] Updated weights for policy 0, policy_version 897327 (0.0010) [2023-12-28 01:42:11,562][106226] Updated weights for policy 0, policy_version 897337 (0.0011) [2023-12-28 01:42:11,633][106226] Updated weights for policy 0, policy_version 897347 (0.0010) [2023-12-28 01:42:11,935][106225] Updated weights for policy 1, policy_version 899617 (0.0008) [2023-12-28 01:42:11,994][106225] Updated weights for policy 1, policy_version 899627 (0.0008) [2023-12-28 01:42:12,049][106225] Updated weights for policy 1, policy_version 899637 (0.0008) [2023-12-28 01:42:12,107][106225] Updated weights for policy 1, policy_version 899647 (0.0008) [2023-12-28 01:42:12,328][106226] Updated weights for policy 0, policy_version 897357 (0.0008) [2023-12-28 01:42:12,395][106226] Updated weights for policy 0, policy_version 897367 (0.0007) [2023-12-28 01:42:12,456][106226] Updated weights for policy 0, policy_version 897377 (0.0006) [2023-12-28 01:42:12,904][106225] Updated weights for policy 1, policy_version 899657 (0.0007) [2023-12-28 01:42:12,970][106225] Updated weights for policy 1, policy_version 899667 (0.0009) [2023-12-28 01:42:13,024][106225] Updated weights for policy 1, policy_version 899677 (0.0008) [2023-12-28 01:42:13,156][106226] Updated weights for policy 0, policy_version 897387 (0.0007) [2023-12-28 01:42:13,202][106226] Updated weights for policy 0, policy_version 897397 (0.0010) [2023-12-28 01:42:13,259][106226] Updated weights for policy 0, policy_version 897407 (0.0010) [2023-12-28 01:42:13,704][106225] Updated weights for policy 1, policy_version 899687 (0.0006) [2023-12-28 01:42:13,750][106225] Updated weights for policy 1, policy_version 899697 (0.0005) [2023-12-28 01:42:13,798][106225] Updated weights for policy 1, policy_version 899707 (0.0005) [2023-12-28 01:42:13,991][106226] Updated weights for policy 0, policy_version 897417 (0.0010) [2023-12-28 01:42:14,041][106226] Updated weights for policy 0, policy_version 897427 (0.0010) [2023-12-28 01:42:14,088][106226] Updated weights for policy 0, policy_version 897437 (0.0010) [2023-12-28 01:42:14,150][106226] Updated weights for policy 0, policy_version 897447 (0.0011) [2023-12-28 01:42:14,381][106225] Updated weights for policy 1, policy_version 899717 (0.0007) [2023-12-28 01:42:14,438][106225] Updated weights for policy 1, policy_version 899727 (0.0010) [2023-12-28 01:42:14,498][106225] Updated weights for policy 1, policy_version 899737 (0.0005) [2023-12-28 01:42:14,880][106226] Updated weights for policy 0, policy_version 897457 (0.0011) [2023-12-28 01:42:14,948][106226] Updated weights for policy 0, policy_version 897467 (0.0011) [2023-12-28 01:42:15,011][106226] Updated weights for policy 0, policy_version 897477 (0.0011) [2023-12-28 01:42:15,239][106225] Updated weights for policy 1, policy_version 899747 (0.0007) [2023-12-28 01:42:15,303][106225] Updated weights for policy 1, policy_version 899757 (0.0008) [2023-12-28 01:42:15,369][106225] Updated weights for policy 1, policy_version 899767 (0.0008) [2023-12-28 01:42:15,716][106226] Updated weights for policy 0, policy_version 897487 (0.0010) [2023-12-28 01:42:15,769][106226] Updated weights for policy 0, policy_version 897497 (0.0010) [2023-12-28 01:42:15,825][106226] Updated weights for policy 0, policy_version 897507 (0.0010) [2023-12-28 01:42:16,066][106225] Updated weights for policy 1, policy_version 899777 (0.0008) [2023-12-28 01:42:16,116][106225] Updated weights for policy 1, policy_version 899787 (0.0007) [2023-12-28 01:42:16,165][106225] Updated weights for policy 1, policy_version 899797 (0.0008) [2023-12-28 01:42:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 460201984. Throughput: 0: 9704.4, 1: 9832.8. Samples: 460195912. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:16,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.731')] [2023-12-28 01:42:16,218][106225] Updated weights for policy 1, policy_version 899807 (0.0008) [2023-12-28 01:42:16,548][106226] Updated weights for policy 0, policy_version 897517 (0.0010) [2023-12-28 01:42:16,607][106226] Updated weights for policy 0, policy_version 897527 (0.0010) [2023-12-28 01:42:16,667][106226] Updated weights for policy 0, policy_version 897537 (0.0010) [2023-12-28 01:42:16,881][106225] Updated weights for policy 1, policy_version 899817 (0.0006) [2023-12-28 01:42:16,927][106225] Updated weights for policy 1, policy_version 899827 (0.0005) [2023-12-28 01:42:16,983][106225] Updated weights for policy 1, policy_version 899837 (0.0005) [2023-12-28 01:42:17,349][106226] Updated weights for policy 0, policy_version 897547 (0.0011) [2023-12-28 01:42:17,401][106226] Updated weights for policy 0, policy_version 897557 (0.0011) [2023-12-28 01:42:17,456][106226] Updated weights for policy 0, policy_version 897567 (0.0010) [2023-12-28 01:42:17,607][106225] Updated weights for policy 1, policy_version 899847 (0.0007) [2023-12-28 01:42:17,673][106225] Updated weights for policy 1, policy_version 899857 (0.0006) [2023-12-28 01:42:17,731][106225] Updated weights for policy 1, policy_version 899867 (0.0007) [2023-12-28 01:42:18,214][106226] Updated weights for policy 0, policy_version 897577 (0.0009) [2023-12-28 01:42:18,270][106226] Updated weights for policy 0, policy_version 897587 (0.0006) [2023-12-28 01:42:18,305][106225] Updated weights for policy 1, policy_version 899877 (0.0007) [2023-12-28 01:42:18,325][106226] Updated weights for policy 0, policy_version 897597 (0.0008) [2023-12-28 01:42:18,373][106225] Updated weights for policy 1, policy_version 899887 (0.0008) [2023-12-28 01:42:18,390][106226] Updated weights for policy 0, policy_version 897607 (0.0008) [2023-12-28 01:42:18,433][106225] Updated weights for policy 1, policy_version 899897 (0.0008) [2023-12-28 01:42:19,076][106226] Updated weights for policy 0, policy_version 897617 (0.0007) [2023-12-28 01:42:19,084][106225] Updated weights for policy 1, policy_version 899907 (0.0007) [2023-12-28 01:42:19,133][106225] Updated weights for policy 1, policy_version 899917 (0.0007) [2023-12-28 01:42:19,147][106226] Updated weights for policy 0, policy_version 897627 (0.0006) [2023-12-28 01:42:19,183][106225] Updated weights for policy 1, policy_version 899927 (0.0006) [2023-12-28 01:42:19,197][106226] Updated weights for policy 0, policy_version 897637 (0.0006) [2023-12-28 01:42:19,859][106225] Updated weights for policy 1, policy_version 899937 (0.0008) [2023-12-28 01:42:19,919][106225] Updated weights for policy 1, policy_version 899947 (0.0008) [2023-12-28 01:42:19,967][106226] Updated weights for policy 0, policy_version 897647 (0.0007) [2023-12-28 01:42:19,980][106225] Updated weights for policy 1, policy_version 899957 (0.0007) [2023-12-28 01:42:20,041][106225] Updated weights for policy 1, policy_version 899967 (0.0006) [2023-12-28 01:42:20,041][106226] Updated weights for policy 0, policy_version 897657 (0.0008) [2023-12-28 01:42:20,111][106226] Updated weights for policy 0, policy_version 897667 (0.0009) [2023-12-28 01:42:20,806][106225] Updated weights for policy 1, policy_version 899977 (0.0010) [2023-12-28 01:42:20,812][106226] Updated weights for policy 0, policy_version 897677 (0.0007) [2023-12-28 01:42:20,854][106225] Updated weights for policy 1, policy_version 899987 (0.0011) [2023-12-28 01:42:20,868][106226] Updated weights for policy 0, policy_version 897687 (0.0006) [2023-12-28 01:42:20,916][106225] Updated weights for policy 1, policy_version 899997 (0.0010) [2023-12-28 01:42:20,921][106226] Updated weights for policy 0, policy_version 897697 (0.0009) [2023-12-28 01:42:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 460308480. Throughput: 0: 9655.4, 1: 9946.2. Samples: 460315008. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:21,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.890')] [2023-12-28 01:42:21,697][106225] Updated weights for policy 1, policy_version 900007 (0.0011) [2023-12-28 01:42:21,758][106226] Updated weights for policy 0, policy_version 897707 (0.0008) [2023-12-28 01:42:21,769][106225] Updated weights for policy 1, policy_version 900017 (0.0009) [2023-12-28 01:42:21,817][106226] Updated weights for policy 0, policy_version 897717 (0.0009) [2023-12-28 01:42:21,824][106225] Updated weights for policy 1, policy_version 900027 (0.0011) [2023-12-28 01:42:21,878][106226] Updated weights for policy 0, policy_version 897727 (0.0007) [2023-12-28 01:42:22,601][106225] Updated weights for policy 1, policy_version 900037 (0.0011) [2023-12-28 01:42:22,645][106226] Updated weights for policy 0, policy_version 897737 (0.0008) [2023-12-28 01:42:22,660][106225] Updated weights for policy 1, policy_version 900047 (0.0011) [2023-12-28 01:42:22,710][106226] Updated weights for policy 0, policy_version 897747 (0.0006) [2023-12-28 01:42:22,723][106225] Updated weights for policy 1, policy_version 900057 (0.0011) [2023-12-28 01:42:22,776][106226] Updated weights for policy 0, policy_version 897757 (0.0007) [2023-12-28 01:42:22,840][106226] Updated weights for policy 0, policy_version 897767 (0.0008) [2023-12-28 01:42:23,418][106225] Updated weights for policy 1, policy_version 900067 (0.0009) [2023-12-28 01:42:23,485][106225] Updated weights for policy 1, policy_version 900077 (0.0006) [2023-12-28 01:42:23,530][106226] Updated weights for policy 0, policy_version 897777 (0.0007) [2023-12-28 01:42:23,543][106225] Updated weights for policy 1, policy_version 900087 (0.0007) [2023-12-28 01:42:23,592][106226] Updated weights for policy 0, policy_version 897787 (0.0007) [2023-12-28 01:42:23,639][106226] Updated weights for policy 0, policy_version 897797 (0.0008) [2023-12-28 01:42:24,208][106225] Updated weights for policy 1, policy_version 900097 (0.0006) [2023-12-28 01:42:24,244][106226] Updated weights for policy 0, policy_version 897807 (0.0008) [2023-12-28 01:42:24,263][106225] Updated weights for policy 1, policy_version 900107 (0.0005) [2023-12-28 01:42:24,306][106226] Updated weights for policy 0, policy_version 897817 (0.0008) [2023-12-28 01:42:24,313][106225] Updated weights for policy 1, policy_version 900117 (0.0008) [2023-12-28 01:42:24,365][106225] Updated weights for policy 1, policy_version 900127 (0.0008) [2023-12-28 01:42:24,370][106226] Updated weights for policy 0, policy_version 897827 (0.0008) [2023-12-28 01:42:24,957][106225] Updated weights for policy 1, policy_version 900137 (0.0008) [2023-12-28 01:42:25,018][106225] Updated weights for policy 1, policy_version 900147 (0.0009) [2023-12-28 01:42:25,083][106225] Updated weights for policy 1, policy_version 900157 (0.0009) [2023-12-28 01:42:25,129][106226] Updated weights for policy 0, policy_version 897837 (0.0009) [2023-12-28 01:42:25,191][106226] Updated weights for policy 0, policy_version 897847 (0.0008) [2023-12-28 01:42:25,257][106226] Updated weights for policy 0, policy_version 897857 (0.0009) [2023-12-28 01:42:25,744][106225] Updated weights for policy 1, policy_version 900167 (0.0005) [2023-12-28 01:42:25,806][106225] Updated weights for policy 1, policy_version 900177 (0.0007) [2023-12-28 01:42:25,870][106225] Updated weights for policy 1, policy_version 900187 (0.0008) [2023-12-28 01:42:26,001][106226] Updated weights for policy 0, policy_version 897867 (0.0009) [2023-12-28 01:42:26,048][106226] Updated weights for policy 0, policy_version 897877 (0.0006) [2023-12-28 01:42:26,096][106226] Updated weights for policy 0, policy_version 897887 (0.0008) [2023-12-28 01:42:26,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 460406784. Throughput: 0: 9628.6, 1: 9912.1. Samples: 460371408. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:26,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.839')] [2023-12-28 01:42:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000897896_229916672.pth... [2023-12-28 01:42:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000900192_230490112.pth... [2023-12-28 01:42:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000896744_229621760.pth [2023-12-28 01:42:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000899040_230195200.pth [2023-12-28 01:42:26,549][106225] Updated weights for policy 1, policy_version 900197 (0.0008) [2023-12-28 01:42:26,596][106225] Updated weights for policy 1, policy_version 900207 (0.0008) [2023-12-28 01:42:26,641][106225] Updated weights for policy 1, policy_version 900217 (0.0008) [2023-12-28 01:42:26,826][106226] Updated weights for policy 0, policy_version 897897 (0.0008) [2023-12-28 01:42:26,874][106226] Updated weights for policy 0, policy_version 897907 (0.0009) [2023-12-28 01:42:26,922][106226] Updated weights for policy 0, policy_version 897917 (0.0008) [2023-12-28 01:42:26,976][106226] Updated weights for policy 0, policy_version 897927 (0.0008) [2023-12-28 01:42:27,341][106225] Updated weights for policy 1, policy_version 900227 (0.0008) [2023-12-28 01:42:27,399][106225] Updated weights for policy 1, policy_version 900237 (0.0007) [2023-12-28 01:42:27,453][106225] Updated weights for policy 1, policy_version 900247 (0.0006) [2023-12-28 01:42:27,782][106226] Updated weights for policy 0, policy_version 897937 (0.0009) [2023-12-28 01:42:27,832][106226] Updated weights for policy 0, policy_version 897947 (0.0009) [2023-12-28 01:42:27,892][106226] Updated weights for policy 0, policy_version 897957 (0.0009) [2023-12-28 01:42:27,989][106225] Updated weights for policy 1, policy_version 900257 (0.0006) [2023-12-28 01:42:28,057][106225] Updated weights for policy 1, policy_version 900267 (0.0005) [2023-12-28 01:42:28,125][106225] Updated weights for policy 1, policy_version 900277 (0.0005) [2023-12-28 01:42:28,185][106225] Updated weights for policy 1, policy_version 900287 (0.0008) [2023-12-28 01:42:28,641][106226] Updated weights for policy 0, policy_version 897967 (0.0009) [2023-12-28 01:42:28,701][106226] Updated weights for policy 0, policy_version 897977 (0.0009) [2023-12-28 01:42:28,760][106226] Updated weights for policy 0, policy_version 897987 (0.0009) [2023-12-28 01:42:28,865][106225] Updated weights for policy 1, policy_version 900297 (0.0007) [2023-12-28 01:42:28,922][106225] Updated weights for policy 1, policy_version 900307 (0.0009) [2023-12-28 01:42:28,978][106225] Updated weights for policy 1, policy_version 900317 (0.0008) [2023-12-28 01:42:29,485][106226] Updated weights for policy 0, policy_version 897997 (0.0009) [2023-12-28 01:42:29,543][106226] Updated weights for policy 0, policy_version 898007 (0.0009) [2023-12-28 01:42:29,603][106226] Updated weights for policy 0, policy_version 898017 (0.0008) [2023-12-28 01:42:29,686][106225] Updated weights for policy 1, policy_version 900327 (0.0007) [2023-12-28 01:42:29,745][106225] Updated weights for policy 1, policy_version 900337 (0.0008) [2023-12-28 01:42:29,804][106225] Updated weights for policy 1, policy_version 900347 (0.0008) [2023-12-28 01:42:30,339][106226] Updated weights for policy 0, policy_version 898027 (0.0009) [2023-12-28 01:42:30,400][106226] Updated weights for policy 0, policy_version 898037 (0.0008) [2023-12-28 01:42:30,462][106226] Updated weights for policy 0, policy_version 898047 (0.0008) [2023-12-28 01:42:30,539][106225] Updated weights for policy 1, policy_version 900357 (0.0007) [2023-12-28 01:42:30,593][106225] Updated weights for policy 1, policy_version 900367 (0.0007) [2023-12-28 01:42:30,651][106225] Updated weights for policy 1, policy_version 900377 (0.0005) [2023-12-28 01:42:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 460496896. Throughput: 0: 9579.2, 1: 10012.8. Samples: 460490868. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:31,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-4.630')] [2023-12-28 01:42:31,219][106225] Updated weights for policy 1, policy_version 900387 (0.0006) [2023-12-28 01:42:31,267][106226] Updated weights for policy 0, policy_version 898057 (0.0008) [2023-12-28 01:42:31,281][106225] Updated weights for policy 1, policy_version 900397 (0.0008) [2023-12-28 01:42:31,330][106226] Updated weights for policy 0, policy_version 898067 (0.0007) [2023-12-28 01:42:31,336][106225] Updated weights for policy 1, policy_version 900407 (0.0006) [2023-12-28 01:42:31,398][106226] Updated weights for policy 0, policy_version 898077 (0.0008) [2023-12-28 01:42:31,451][106226] Updated weights for policy 0, policy_version 898087 (0.0008) [2023-12-28 01:42:32,107][106225] Updated weights for policy 1, policy_version 900417 (0.0007) [2023-12-28 01:42:32,137][106226] Updated weights for policy 0, policy_version 898097 (0.0007) [2023-12-28 01:42:32,162][106225] Updated weights for policy 1, policy_version 900427 (0.0007) [2023-12-28 01:42:32,194][106226] Updated weights for policy 0, policy_version 898107 (0.0008) [2023-12-28 01:42:32,212][106225] Updated weights for policy 1, policy_version 900437 (0.0006) [2023-12-28 01:42:32,250][106226] Updated weights for policy 0, policy_version 898117 (0.0006) [2023-12-28 01:42:32,276][106225] Updated weights for policy 1, policy_version 900447 (0.0007) [2023-12-28 01:42:32,948][106226] Updated weights for policy 0, policy_version 898127 (0.0006) [2023-12-28 01:42:32,971][106225] Updated weights for policy 1, policy_version 900457 (0.0008) [2023-12-28 01:42:32,997][106226] Updated weights for policy 0, policy_version 898137 (0.0007) [2023-12-28 01:42:33,021][106225] Updated weights for policy 1, policy_version 900467 (0.0008) [2023-12-28 01:42:33,043][106226] Updated weights for policy 0, policy_version 898147 (0.0007) [2023-12-28 01:42:33,063][106225] Updated weights for policy 1, policy_version 900477 (0.0007) [2023-12-28 01:42:33,708][106226] Updated weights for policy 0, policy_version 898157 (0.0009) [2023-12-28 01:42:33,761][106226] Updated weights for policy 0, policy_version 898167 (0.0007) [2023-12-28 01:42:33,778][106225] Updated weights for policy 1, policy_version 900487 (0.0006) [2023-12-28 01:42:33,811][106226] Updated weights for policy 0, policy_version 898177 (0.0006) [2023-12-28 01:42:33,836][106225] Updated weights for policy 1, policy_version 900497 (0.0006) [2023-12-28 01:42:33,880][106225] Updated weights for policy 1, policy_version 900507 (0.0005) [2023-12-28 01:42:34,523][106226] Updated weights for policy 0, policy_version 898187 (0.0007) [2023-12-28 01:42:34,589][106226] Updated weights for policy 0, policy_version 898197 (0.0008) [2023-12-28 01:42:34,612][106225] Updated weights for policy 1, policy_version 900517 (0.0007) [2023-12-28 01:42:34,649][106226] Updated weights for policy 0, policy_version 898207 (0.0008) [2023-12-28 01:42:34,673][106225] Updated weights for policy 1, policy_version 900527 (0.0009) [2023-12-28 01:42:34,733][106225] Updated weights for policy 1, policy_version 900537 (0.0007) [2023-12-28 01:42:35,362][106226] Updated weights for policy 0, policy_version 898217 (0.0008) [2023-12-28 01:42:35,419][106226] Updated weights for policy 0, policy_version 898227 (0.0008) [2023-12-28 01:42:35,466][106225] Updated weights for policy 1, policy_version 900547 (0.0009) [2023-12-28 01:42:35,484][106226] Updated weights for policy 0, policy_version 898237 (0.0007) [2023-12-28 01:42:35,518][106225] Updated weights for policy 1, policy_version 900557 (0.0006) [2023-12-28 01:42:35,539][106226] Updated weights for policy 0, policy_version 898247 (0.0007) [2023-12-28 01:42:35,576][106225] Updated weights for policy 1, policy_version 900567 (0.0007) [2023-12-28 01:42:36,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 460595200. Throughput: 0: 9637.2, 1: 9983.7. Samples: 460608576. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:36,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.987')] [2023-12-28 01:42:36,204][106226] Updated weights for policy 0, policy_version 898257 (0.0008) [2023-12-28 01:42:36,264][106226] Updated weights for policy 0, policy_version 898267 (0.0008) [2023-12-28 01:42:36,320][106225] Updated weights for policy 1, policy_version 900577 (0.0009) [2023-12-28 01:42:36,328][106226] Updated weights for policy 0, policy_version 898277 (0.0007) [2023-12-28 01:42:36,384][106225] Updated weights for policy 1, policy_version 900587 (0.0008) [2023-12-28 01:42:36,451][106225] Updated weights for policy 1, policy_version 900597 (0.0008) [2023-12-28 01:42:36,511][106225] Updated weights for policy 1, policy_version 900607 (0.0009) [2023-12-28 01:42:37,078][106226] Updated weights for policy 0, policy_version 898287 (0.0009) [2023-12-28 01:42:37,139][106226] Updated weights for policy 0, policy_version 898297 (0.0007) [2023-12-28 01:42:37,198][106226] Updated weights for policy 0, policy_version 898307 (0.0006) [2023-12-28 01:42:37,211][106225] Updated weights for policy 1, policy_version 900617 (0.0008) [2023-12-28 01:42:37,271][106225] Updated weights for policy 1, policy_version 900627 (0.0008) [2023-12-28 01:42:37,328][106225] Updated weights for policy 1, policy_version 900637 (0.0009) [2023-12-28 01:42:37,779][106226] Updated weights for policy 0, policy_version 898317 (0.0006) [2023-12-28 01:42:37,825][106226] Updated weights for policy 0, policy_version 898327 (0.0005) [2023-12-28 01:42:37,870][106226] Updated weights for policy 0, policy_version 898337 (0.0005) [2023-12-28 01:42:38,165][106225] Updated weights for policy 1, policy_version 900647 (0.0009) [2023-12-28 01:42:38,212][106225] Updated weights for policy 1, policy_version 900657 (0.0008) [2023-12-28 01:42:38,274][106225] Updated weights for policy 1, policy_version 900667 (0.0008) [2023-12-28 01:42:38,488][106226] Updated weights for policy 0, policy_version 898347 (0.0007) [2023-12-28 01:42:38,545][106226] Updated weights for policy 0, policy_version 898357 (0.0009) [2023-12-28 01:42:38,605][106226] Updated weights for policy 0, policy_version 898367 (0.0009) [2023-12-28 01:42:38,995][106225] Updated weights for policy 1, policy_version 900677 (0.0008) [2023-12-28 01:42:39,060][106225] Updated weights for policy 1, policy_version 900687 (0.0008) [2023-12-28 01:42:39,124][106225] Updated weights for policy 1, policy_version 900697 (0.0008) [2023-12-28 01:42:39,320][106226] Updated weights for policy 0, policy_version 898377 (0.0008) [2023-12-28 01:42:39,393][106226] Updated weights for policy 0, policy_version 898387 (0.0009) [2023-12-28 01:42:39,461][106226] Updated weights for policy 0, policy_version 898397 (0.0009) [2023-12-28 01:42:39,522][106226] Updated weights for policy 0, policy_version 898407 (0.0009) [2023-12-28 01:42:39,911][106225] Updated weights for policy 1, policy_version 900707 (0.0007) [2023-12-28 01:42:39,972][106225] Updated weights for policy 1, policy_version 900717 (0.0008) [2023-12-28 01:42:40,032][106225] Updated weights for policy 1, policy_version 900727 (0.0009) [2023-12-28 01:42:40,251][106226] Updated weights for policy 0, policy_version 898417 (0.0008) [2023-12-28 01:42:40,304][106226] Updated weights for policy 0, policy_version 898427 (0.0008) [2023-12-28 01:42:40,353][106226] Updated weights for policy 0, policy_version 898437 (0.0006) [2023-12-28 01:42:40,773][106225] Updated weights for policy 1, policy_version 900737 (0.0008) [2023-12-28 01:42:40,818][106225] Updated weights for policy 1, policy_version 900747 (0.0009) [2023-12-28 01:42:40,863][106225] Updated weights for policy 1, policy_version 900757 (0.0008) [2023-12-28 01:42:40,911][106225] Updated weights for policy 1, policy_version 900767 (0.0009) [2023-12-28 01:42:41,064][106226] Updated weights for policy 0, policy_version 898447 (0.0008) [2023-12-28 01:42:41,127][106226] Updated weights for policy 0, policy_version 898457 (0.0009) [2023-12-28 01:42:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 460693504. Throughput: 0: 9735.5, 1: 9914.2. Samples: 460667652. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:41,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.831')] [2023-12-28 01:42:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000900768_230637568.pth... [2023-12-28 01:42:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000899616_230342656.pth [2023-12-28 01:42:41,197][106226] Updated weights for policy 0, policy_version 898467 (0.0008) [2023-12-28 01:42:41,232][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000898472_230064128.pth... [2023-12-28 01:42:41,237][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000897320_229769216.pth [2023-12-28 01:42:41,765][106225] Updated weights for policy 1, policy_version 900777 (0.0009) [2023-12-28 01:42:41,829][106225] Updated weights for policy 1, policy_version 900787 (0.0008) [2023-12-28 01:42:41,889][106225] Updated weights for policy 1, policy_version 900797 (0.0008) [2023-12-28 01:42:42,026][106226] Updated weights for policy 0, policy_version 898477 (0.0009) [2023-12-28 01:42:42,080][106226] Updated weights for policy 0, policy_version 898487 (0.0009) [2023-12-28 01:42:42,137][106226] Updated weights for policy 0, policy_version 898497 (0.0008) [2023-12-28 01:42:42,613][106225] Updated weights for policy 1, policy_version 900807 (0.0008) [2023-12-28 01:42:42,674][106225] Updated weights for policy 1, policy_version 900817 (0.0008) [2023-12-28 01:42:42,733][106225] Updated weights for policy 1, policy_version 900827 (0.0009) [2023-12-28 01:42:42,809][106226] Updated weights for policy 0, policy_version 898507 (0.0009) [2023-12-28 01:42:42,861][106226] Updated weights for policy 0, policy_version 898517 (0.0008) [2023-12-28 01:42:42,911][106226] Updated weights for policy 0, policy_version 898527 (0.0009) [2023-12-28 01:42:43,433][106225] Updated weights for policy 1, policy_version 900837 (0.0008) [2023-12-28 01:42:43,493][106225] Updated weights for policy 1, policy_version 900847 (0.0008) [2023-12-28 01:42:43,554][106225] Updated weights for policy 1, policy_version 900857 (0.0009) [2023-12-28 01:42:43,630][106226] Updated weights for policy 0, policy_version 898537 (0.0008) [2023-12-28 01:42:43,692][106226] Updated weights for policy 0, policy_version 898547 (0.0010) [2023-12-28 01:42:43,751][106226] Updated weights for policy 0, policy_version 898557 (0.0010) [2023-12-28 01:42:43,813][106226] Updated weights for policy 0, policy_version 898567 (0.0007) [2023-12-28 01:42:44,352][106225] Updated weights for policy 1, policy_version 900867 (0.0009) [2023-12-28 01:42:44,382][106226] Updated weights for policy 0, policy_version 898577 (0.0005) [2023-12-28 01:42:44,405][106225] Updated weights for policy 1, policy_version 900877 (0.0006) [2023-12-28 01:42:44,438][106226] Updated weights for policy 0, policy_version 898587 (0.0007) [2023-12-28 01:42:44,459][106225] Updated weights for policy 1, policy_version 900887 (0.0006) [2023-12-28 01:42:44,491][106226] Updated weights for policy 0, policy_version 898597 (0.0006) [2023-12-28 01:42:45,149][106226] Updated weights for policy 0, policy_version 898607 (0.0007) [2023-12-28 01:42:45,208][106225] Updated weights for policy 1, policy_version 900897 (0.0007) [2023-12-28 01:42:45,211][106226] Updated weights for policy 0, policy_version 898617 (0.0009) [2023-12-28 01:42:45,269][106225] Updated weights for policy 1, policy_version 900907 (0.0009) [2023-12-28 01:42:45,275][106226] Updated weights for policy 0, policy_version 898627 (0.0010) [2023-12-28 01:42:45,329][106225] Updated weights for policy 1, policy_version 900917 (0.0010) [2023-12-28 01:42:45,392][106225] Updated weights for policy 1, policy_version 900927 (0.0005) [2023-12-28 01:42:45,998][106226] Updated weights for policy 0, policy_version 898637 (0.0009) [2023-12-28 01:42:46,011][106225] Updated weights for policy 1, policy_version 900937 (0.0008) [2023-12-28 01:42:46,055][106226] Updated weights for policy 0, policy_version 898647 (0.0007) [2023-12-28 01:42:46,062][106225] Updated weights for policy 1, policy_version 900947 (0.0006) [2023-12-28 01:42:46,111][106226] Updated weights for policy 0, policy_version 898657 (0.0006) [2023-12-28 01:42:46,116][106225] Updated weights for policy 1, policy_version 900957 (0.0006) [2023-12-28 01:42:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 460800000. Throughput: 0: 9806.5, 1: 9788.8. Samples: 460782352. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:46,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-4.804')] [2023-12-28 01:42:46,718][106225] Updated weights for policy 1, policy_version 900967 (0.0006) [2023-12-28 01:42:46,778][106225] Updated weights for policy 1, policy_version 900977 (0.0005) [2023-12-28 01:42:46,834][106225] Updated weights for policy 1, policy_version 900987 (0.0006) [2023-12-28 01:42:46,859][106226] Updated weights for policy 0, policy_version 898667 (0.0009) [2023-12-28 01:42:46,907][106226] Updated weights for policy 0, policy_version 898677 (0.0005) [2023-12-28 01:42:46,966][106226] Updated weights for policy 0, policy_version 898687 (0.0005) [2023-12-28 01:42:47,445][106225] Updated weights for policy 1, policy_version 900997 (0.0008) [2023-12-28 01:42:47,511][106225] Updated weights for policy 1, policy_version 901007 (0.0010) [2023-12-28 01:42:47,571][106225] Updated weights for policy 1, policy_version 901017 (0.0010) [2023-12-28 01:42:47,626][106226] Updated weights for policy 0, policy_version 898697 (0.0006) [2023-12-28 01:42:47,688][106226] Updated weights for policy 0, policy_version 898707 (0.0011) [2023-12-28 01:42:47,740][106226] Updated weights for policy 0, policy_version 898717 (0.0010) [2023-12-28 01:42:47,791][106226] Updated weights for policy 0, policy_version 898727 (0.0010) [2023-12-28 01:42:48,275][106225] Updated weights for policy 1, policy_version 901027 (0.0010) [2023-12-28 01:42:48,341][106225] Updated weights for policy 1, policy_version 901037 (0.0011) [2023-12-28 01:42:48,405][106225] Updated weights for policy 1, policy_version 901047 (0.0011) [2023-12-28 01:42:48,451][106226] Updated weights for policy 0, policy_version 898737 (0.0007) [2023-12-28 01:42:48,513][106226] Updated weights for policy 0, policy_version 898747 (0.0008) [2023-12-28 01:42:48,579][106226] Updated weights for policy 0, policy_version 898757 (0.0006) [2023-12-28 01:42:49,134][106225] Updated weights for policy 1, policy_version 901057 (0.0011) [2023-12-28 01:42:49,169][106226] Updated weights for policy 0, policy_version 898767 (0.0006) [2023-12-28 01:42:49,190][106225] Updated weights for policy 1, policy_version 901067 (0.0010) [2023-12-28 01:42:49,232][106226] Updated weights for policy 0, policy_version 898777 (0.0006) [2023-12-28 01:42:49,261][106225] Updated weights for policy 1, policy_version 901077 (0.0009) [2023-12-28 01:42:49,295][106226] Updated weights for policy 0, policy_version 898787 (0.0008) [2023-12-28 01:42:49,320][106225] Updated weights for policy 1, policy_version 901087 (0.0006) [2023-12-28 01:42:49,938][106226] Updated weights for policy 0, policy_version 898797 (0.0008) [2023-12-28 01:42:49,996][106226] Updated weights for policy 0, policy_version 898807 (0.0009) [2023-12-28 01:42:50,051][106225] Updated weights for policy 1, policy_version 901097 (0.0007) [2023-12-28 01:42:50,054][106226] Updated weights for policy 0, policy_version 898817 (0.0006) [2023-12-28 01:42:50,101][106225] Updated weights for policy 1, policy_version 901107 (0.0006) [2023-12-28 01:42:50,154][106225] Updated weights for policy 1, policy_version 901117 (0.0008) [2023-12-28 01:42:50,764][106226] Updated weights for policy 0, policy_version 898827 (0.0008) [2023-12-28 01:42:50,823][106226] Updated weights for policy 0, policy_version 898837 (0.0008) [2023-12-28 01:42:50,886][106226] Updated weights for policy 0, policy_version 898847 (0.0010) [2023-12-28 01:42:50,912][106225] Updated weights for policy 1, policy_version 901127 (0.0008) [2023-12-28 01:42:50,975][106225] Updated weights for policy 1, policy_version 901137 (0.0008) [2023-12-28 01:42:51,043][106225] Updated weights for policy 1, policy_version 901147 (0.0007) [2023-12-28 01:42:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 460898304. Throughput: 0: 9842.1, 1: 9832.9. Samples: 460903012. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:51,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-5.198')] [2023-12-28 01:42:51,705][106226] Updated weights for policy 0, policy_version 898857 (0.0010) [2023-12-28 01:42:51,772][106226] Updated weights for policy 0, policy_version 898867 (0.0008) [2023-12-28 01:42:51,795][106225] Updated weights for policy 1, policy_version 901157 (0.0006) [2023-12-28 01:42:51,838][106226] Updated weights for policy 0, policy_version 898877 (0.0008) [2023-12-28 01:42:51,854][106225] Updated weights for policy 1, policy_version 901167 (0.0007) [2023-12-28 01:42:51,894][106226] Updated weights for policy 0, policy_version 898887 (0.0008) [2023-12-28 01:42:51,909][106225] Updated weights for policy 1, policy_version 901177 (0.0006) [2023-12-28 01:42:52,587][106225] Updated weights for policy 1, policy_version 901187 (0.0006) [2023-12-28 01:42:52,634][106226] Updated weights for policy 0, policy_version 898897 (0.0007) [2023-12-28 01:42:52,649][106225] Updated weights for policy 1, policy_version 901197 (0.0006) [2023-12-28 01:42:52,697][106226] Updated weights for policy 0, policy_version 898907 (0.0006) [2023-12-28 01:42:52,713][106225] Updated weights for policy 1, policy_version 901207 (0.0008) [2023-12-28 01:42:52,759][106226] Updated weights for policy 0, policy_version 898917 (0.0006) [2023-12-28 01:42:53,374][106226] Updated weights for policy 0, policy_version 898927 (0.0008) [2023-12-28 01:42:53,429][106226] Updated weights for policy 0, policy_version 898937 (0.0008) [2023-12-28 01:42:53,449][106225] Updated weights for policy 1, policy_version 901217 (0.0008) [2023-12-28 01:42:53,483][106226] Updated weights for policy 0, policy_version 898947 (0.0008) [2023-12-28 01:42:53,512][106225] Updated weights for policy 1, policy_version 901227 (0.0008) [2023-12-28 01:42:53,576][106225] Updated weights for policy 1, policy_version 901237 (0.0005) [2023-12-28 01:42:53,632][106225] Updated weights for policy 1, policy_version 901247 (0.0005) [2023-12-28 01:42:54,144][106226] Updated weights for policy 0, policy_version 898957 (0.0009) [2023-12-28 01:42:54,208][106226] Updated weights for policy 0, policy_version 898967 (0.0011) [2023-12-28 01:42:54,229][106225] Updated weights for policy 1, policy_version 901257 (0.0010) [2023-12-28 01:42:54,269][106226] Updated weights for policy 0, policy_version 898977 (0.0011) [2023-12-28 01:42:54,289][106225] Updated weights for policy 1, policy_version 901267 (0.0010) [2023-12-28 01:42:54,345][106225] Updated weights for policy 1, policy_version 901277 (0.0008) [2023-12-28 01:42:54,856][106226] Updated weights for policy 0, policy_version 898987 (0.0009) [2023-12-28 01:42:54,917][106226] Updated weights for policy 0, policy_version 898997 (0.0008) [2023-12-28 01:42:54,971][106226] Updated weights for policy 0, policy_version 899007 (0.0005) [2023-12-28 01:42:55,025][106225] Updated weights for policy 1, policy_version 901287 (0.0008) [2023-12-28 01:42:55,092][106225] Updated weights for policy 1, policy_version 901297 (0.0005) [2023-12-28 01:42:55,153][106225] Updated weights for policy 1, policy_version 901307 (0.0005) [2023-12-28 01:42:55,718][106226] Updated weights for policy 0, policy_version 899017 (0.0007) [2023-12-28 01:42:55,765][106226] Updated weights for policy 0, policy_version 899027 (0.0008) [2023-12-28 01:42:55,786][106225] Updated weights for policy 1, policy_version 901317 (0.0009) [2023-12-28 01:42:55,815][106226] Updated weights for policy 0, policy_version 899037 (0.0006) [2023-12-28 01:42:55,843][106225] Updated weights for policy 1, policy_version 901327 (0.0006) [2023-12-28 01:42:55,879][106226] Updated weights for policy 0, policy_version 899047 (0.0008) [2023-12-28 01:42:55,904][106225] Updated weights for policy 1, policy_version 901337 (0.0006) [2023-12-28 01:42:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 460996608. Throughput: 0: 9788.0, 1: 9833.5. Samples: 460962016. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:42:56,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-5.111')] [2023-12-28 01:42:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000901344_230785024.pth... [2023-12-28 01:42:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000899048_230211584.pth... [2023-12-28 01:42:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000897896_229916672.pth [2023-12-28 01:42:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000900192_230490112.pth [2023-12-28 01:42:56,477][106225] Updated weights for policy 1, policy_version 901347 (0.0007) [2023-12-28 01:42:56,539][106225] Updated weights for policy 1, policy_version 901357 (0.0005) [2023-12-28 01:42:56,598][106226] Updated weights for policy 0, policy_version 899057 (0.0009) [2023-12-28 01:42:56,602][106225] Updated weights for policy 1, policy_version 901367 (0.0008) [2023-12-28 01:42:56,647][106226] Updated weights for policy 0, policy_version 899067 (0.0005) [2023-12-28 01:42:56,700][106226] Updated weights for policy 0, policy_version 899077 (0.0008) [2023-12-28 01:42:57,299][106225] Updated weights for policy 1, policy_version 901377 (0.0006) [2023-12-28 01:42:57,356][106225] Updated weights for policy 1, policy_version 901387 (0.0007) [2023-12-28 01:42:57,362][106226] Updated weights for policy 0, policy_version 899087 (0.0007) [2023-12-28 01:42:57,406][106225] Updated weights for policy 1, policy_version 901397 (0.0006) [2023-12-28 01:42:57,412][106226] Updated weights for policy 0, policy_version 899097 (0.0006) [2023-12-28 01:42:57,463][106225] Updated weights for policy 1, policy_version 901407 (0.0007) [2023-12-28 01:42:57,469][106226] Updated weights for policy 0, policy_version 899107 (0.0006) [2023-12-28 01:42:58,137][106226] Updated weights for policy 0, policy_version 899117 (0.0007) [2023-12-28 01:42:58,173][106225] Updated weights for policy 1, policy_version 901417 (0.0007) [2023-12-28 01:42:58,197][106226] Updated weights for policy 0, policy_version 899127 (0.0010) [2023-12-28 01:42:58,241][106225] Updated weights for policy 1, policy_version 901427 (0.0008) [2023-12-28 01:42:58,258][106226] Updated weights for policy 0, policy_version 899137 (0.0011) [2023-12-28 01:42:58,302][106225] Updated weights for policy 1, policy_version 901437 (0.0005) [2023-12-28 01:42:59,073][106226] Updated weights for policy 0, policy_version 899147 (0.0009) [2023-12-28 01:42:59,106][106225] Updated weights for policy 1, policy_version 901447 (0.0008) [2023-12-28 01:42:59,131][106226] Updated weights for policy 0, policy_version 899157 (0.0006) [2023-12-28 01:42:59,165][106225] Updated weights for policy 1, policy_version 901457 (0.0007) [2023-12-28 01:42:59,197][106226] Updated weights for policy 0, policy_version 899167 (0.0006) [2023-12-28 01:42:59,235][106225] Updated weights for policy 1, policy_version 901467 (0.0009) [2023-12-28 01:42:59,846][106226] Updated weights for policy 0, policy_version 899177 (0.0008) [2023-12-28 01:42:59,911][106226] Updated weights for policy 0, policy_version 899187 (0.0006) [2023-12-28 01:42:59,981][106226] Updated weights for policy 0, policy_version 899197 (0.0008) [2023-12-28 01:43:00,036][106226] Updated weights for policy 0, policy_version 899207 (0.0008) [2023-12-28 01:43:00,069][106225] Updated weights for policy 1, policy_version 901477 (0.0008) [2023-12-28 01:43:00,122][106225] Updated weights for policy 1, policy_version 901487 (0.0008) [2023-12-28 01:43:00,173][106225] Updated weights for policy 1, policy_version 901497 (0.0005) [2023-12-28 01:43:00,774][106226] Updated weights for policy 0, policy_version 899217 (0.0008) [2023-12-28 01:43:00,827][106225] Updated weights for policy 1, policy_version 901507 (0.0006) [2023-12-28 01:43:00,835][106226] Updated weights for policy 0, policy_version 899227 (0.0008) [2023-12-28 01:43:00,877][106225] Updated weights for policy 1, policy_version 901517 (0.0005) [2023-12-28 01:43:00,901][106226] Updated weights for policy 0, policy_version 899237 (0.0011) [2023-12-28 01:43:00,940][106225] Updated weights for policy 1, policy_version 901527 (0.0006) [2023-12-28 01:43:01,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 461094912. Throughput: 0: 9819.2, 1: 9856.2. Samples: 461081312. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:01,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.606')] [2023-12-28 01:43:01,617][106226] Updated weights for policy 0, policy_version 899247 (0.0009) [2023-12-28 01:43:01,635][106225] Updated weights for policy 1, policy_version 901537 (0.0008) [2023-12-28 01:43:01,686][106226] Updated weights for policy 0, policy_version 899257 (0.0007) [2023-12-28 01:43:01,703][106225] Updated weights for policy 1, policy_version 901547 (0.0011) [2023-12-28 01:43:01,759][106226] Updated weights for policy 0, policy_version 899267 (0.0007) [2023-12-28 01:43:01,785][106225] Updated weights for policy 1, policy_version 901557 (0.0012) [2023-12-28 01:43:01,838][106225] Updated weights for policy 1, policy_version 901567 (0.0010) [2023-12-28 01:43:02,382][106226] Updated weights for policy 0, policy_version 899277 (0.0007) [2023-12-28 01:43:02,445][106226] Updated weights for policy 0, policy_version 899287 (0.0009) [2023-12-28 01:43:02,491][106225] Updated weights for policy 1, policy_version 901577 (0.0006) [2023-12-28 01:43:02,508][106226] Updated weights for policy 0, policy_version 899297 (0.0007) [2023-12-28 01:43:02,555][106225] Updated weights for policy 1, policy_version 901587 (0.0007) [2023-12-28 01:43:02,618][106225] Updated weights for policy 1, policy_version 901597 (0.0008) [2023-12-28 01:43:03,111][106226] Updated weights for policy 0, policy_version 899307 (0.0006) [2023-12-28 01:43:03,159][106226] Updated weights for policy 0, policy_version 899317 (0.0005) [2023-12-28 01:43:03,222][106226] Updated weights for policy 0, policy_version 899327 (0.0005) [2023-12-28 01:43:03,382][106225] Updated weights for policy 1, policy_version 901607 (0.0009) [2023-12-28 01:43:03,425][106225] Updated weights for policy 1, policy_version 901617 (0.0008) [2023-12-28 01:43:03,469][106225] Updated weights for policy 1, policy_version 901627 (0.0008) [2023-12-28 01:43:03,840][106226] Updated weights for policy 0, policy_version 899337 (0.0005) [2023-12-28 01:43:03,900][106226] Updated weights for policy 0, policy_version 899347 (0.0008) [2023-12-28 01:43:03,955][106226] Updated weights for policy 0, policy_version 899357 (0.0006) [2023-12-28 01:43:04,008][106226] Updated weights for policy 0, policy_version 899367 (0.0006) [2023-12-28 01:43:04,231][106225] Updated weights for policy 1, policy_version 901637 (0.0007) [2023-12-28 01:43:04,298][106225] Updated weights for policy 1, policy_version 901647 (0.0008) [2023-12-28 01:43:04,366][106225] Updated weights for policy 1, policy_version 901657 (0.0008) [2023-12-28 01:43:04,628][106226] Updated weights for policy 0, policy_version 899377 (0.0010) [2023-12-28 01:43:04,690][106226] Updated weights for policy 0, policy_version 899387 (0.0007) [2023-12-28 01:43:04,741][106226] Updated weights for policy 0, policy_version 899397 (0.0005) [2023-12-28 01:43:05,041][106225] Updated weights for policy 1, policy_version 901667 (0.0007) [2023-12-28 01:43:05,094][106225] Updated weights for policy 1, policy_version 901677 (0.0005) [2023-12-28 01:43:05,148][106225] Updated weights for policy 1, policy_version 901687 (0.0006) [2023-12-28 01:43:05,353][106226] Updated weights for policy 0, policy_version 899407 (0.0005) [2023-12-28 01:43:05,412][106226] Updated weights for policy 0, policy_version 899417 (0.0006) [2023-12-28 01:43:05,479][106226] Updated weights for policy 0, policy_version 899427 (0.0009) [2023-12-28 01:43:05,758][106225] Updated weights for policy 1, policy_version 901697 (0.0008) [2023-12-28 01:43:05,812][106225] Updated weights for policy 1, policy_version 901707 (0.0008) [2023-12-28 01:43:05,873][106225] Updated weights for policy 1, policy_version 901717 (0.0008) [2023-12-28 01:43:05,929][106225] Updated weights for policy 1, policy_version 901727 (0.0008) [2023-12-28 01:43:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 461193216. Throughput: 0: 9935.3, 1: 9804.8. Samples: 461203312. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:06,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.966')] [2023-12-28 01:43:06,178][106226] Updated weights for policy 0, policy_version 899437 (0.0010) [2023-12-28 01:43:06,227][106226] Updated weights for policy 0, policy_version 899447 (0.0010) [2023-12-28 01:43:06,290][106226] Updated weights for policy 0, policy_version 899457 (0.0011) [2023-12-28 01:43:06,610][106225] Updated weights for policy 1, policy_version 901737 (0.0007) [2023-12-28 01:43:06,675][106225] Updated weights for policy 1, policy_version 901747 (0.0006) [2023-12-28 01:43:06,740][106225] Updated weights for policy 1, policy_version 901757 (0.0008) [2023-12-28 01:43:07,040][106226] Updated weights for policy 0, policy_version 899467 (0.0009) [2023-12-28 01:43:07,092][106226] Updated weights for policy 0, policy_version 899477 (0.0005) [2023-12-28 01:43:07,145][106226] Updated weights for policy 0, policy_version 899487 (0.0006) [2023-12-28 01:43:07,447][106225] Updated weights for policy 1, policy_version 901767 (0.0008) [2023-12-28 01:43:07,506][106225] Updated weights for policy 1, policy_version 901777 (0.0007) [2023-12-28 01:43:07,565][106225] Updated weights for policy 1, policy_version 901787 (0.0008) [2023-12-28 01:43:07,808][106226] Updated weights for policy 0, policy_version 899497 (0.0007) [2023-12-28 01:43:07,864][106226] Updated weights for policy 0, policy_version 899507 (0.0010) [2023-12-28 01:43:07,924][106226] Updated weights for policy 0, policy_version 899517 (0.0010) [2023-12-28 01:43:07,976][106226] Updated weights for policy 0, policy_version 899527 (0.0009) [2023-12-28 01:43:08,310][106225] Updated weights for policy 1, policy_version 901797 (0.0008) [2023-12-28 01:43:08,370][106225] Updated weights for policy 1, policy_version 901807 (0.0008) [2023-12-28 01:43:08,431][106225] Updated weights for policy 1, policy_version 901817 (0.0009) [2023-12-28 01:43:08,767][106226] Updated weights for policy 0, policy_version 899537 (0.0006) [2023-12-28 01:43:08,824][106226] Updated weights for policy 0, policy_version 899547 (0.0008) [2023-12-28 01:43:08,876][106226] Updated weights for policy 0, policy_version 899557 (0.0007) [2023-12-28 01:43:09,126][106225] Updated weights for policy 1, policy_version 901827 (0.0010) [2023-12-28 01:43:09,191][106225] Updated weights for policy 1, policy_version 901837 (0.0010) [2023-12-28 01:43:09,259][106225] Updated weights for policy 1, policy_version 901847 (0.0010) [2023-12-28 01:43:09,647][106226] Updated weights for policy 0, policy_version 899567 (0.0008) [2023-12-28 01:43:09,698][106226] Updated weights for policy 0, policy_version 899577 (0.0007) [2023-12-28 01:43:09,753][106226] Updated weights for policy 0, policy_version 899587 (0.0007) [2023-12-28 01:43:10,006][106225] Updated weights for policy 1, policy_version 901857 (0.0011) [2023-12-28 01:43:10,064][106225] Updated weights for policy 1, policy_version 901867 (0.0008) [2023-12-28 01:43:10,124][106225] Updated weights for policy 1, policy_version 901877 (0.0010) [2023-12-28 01:43:10,188][106225] Updated weights for policy 1, policy_version 901887 (0.0010) [2023-12-28 01:43:10,556][106226] Updated weights for policy 0, policy_version 899597 (0.0008) [2023-12-28 01:43:10,625][106226] Updated weights for policy 0, policy_version 899607 (0.0010) [2023-12-28 01:43:10,690][106226] Updated weights for policy 0, policy_version 899617 (0.0008) [2023-12-28 01:43:10,765][106225] Updated weights for policy 1, policy_version 901897 (0.0010) [2023-12-28 01:43:10,828][106225] Updated weights for policy 1, policy_version 901907 (0.0010) [2023-12-28 01:43:10,884][106225] Updated weights for policy 1, policy_version 901917 (0.0009) [2023-12-28 01:43:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 461291520. Throughput: 0: 9946.1, 1: 9828.9. Samples: 461261288. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:11,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.839')] [2023-12-28 01:43:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000901920_230932480.pth... [2023-12-28 01:43:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000899624_230359040.pth... [2023-12-28 01:43:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000900768_230637568.pth [2023-12-28 01:43:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000898472_230064128.pth [2023-12-28 01:43:11,498][106226] Updated weights for policy 0, policy_version 899627 (0.0008) [2023-12-28 01:43:11,563][106226] Updated weights for policy 0, policy_version 899637 (0.0009) [2023-12-28 01:43:11,595][106225] Updated weights for policy 1, policy_version 901927 (0.0007) [2023-12-28 01:43:11,630][106226] Updated weights for policy 0, policy_version 899647 (0.0007) [2023-12-28 01:43:11,663][106225] Updated weights for policy 1, policy_version 901937 (0.0008) [2023-12-28 01:43:11,724][106225] Updated weights for policy 1, policy_version 901947 (0.0009) [2023-12-28 01:43:12,305][106226] Updated weights for policy 0, policy_version 899657 (0.0007) [2023-12-28 01:43:12,367][106226] Updated weights for policy 0, policy_version 899667 (0.0009) [2023-12-28 01:43:12,422][106226] Updated weights for policy 0, policy_version 899677 (0.0008) [2023-12-28 01:43:12,476][106226] Updated weights for policy 0, policy_version 899687 (0.0008) [2023-12-28 01:43:12,500][106225] Updated weights for policy 1, policy_version 901957 (0.0008) [2023-12-28 01:43:12,568][106225] Updated weights for policy 1, policy_version 901967 (0.0008) [2023-12-28 01:43:12,632][106225] Updated weights for policy 1, policy_version 901977 (0.0006) [2023-12-28 01:43:13,167][106226] Updated weights for policy 0, policy_version 899697 (0.0008) [2023-12-28 01:43:13,225][106226] Updated weights for policy 0, policy_version 899707 (0.0008) [2023-12-28 01:43:13,268][106225] Updated weights for policy 1, policy_version 901987 (0.0005) [2023-12-28 01:43:13,284][106226] Updated weights for policy 0, policy_version 899717 (0.0008) [2023-12-28 01:43:13,316][106225] Updated weights for policy 1, policy_version 901997 (0.0009) [2023-12-28 01:43:13,372][106225] Updated weights for policy 1, policy_version 902007 (0.0009) [2023-12-28 01:43:13,939][106226] Updated weights for policy 0, policy_version 899727 (0.0007) [2023-12-28 01:43:13,987][106226] Updated weights for policy 0, policy_version 899737 (0.0005) [2023-12-28 01:43:14,038][106226] Updated weights for policy 0, policy_version 899747 (0.0005) [2023-12-28 01:43:14,136][106225] Updated weights for policy 1, policy_version 902017 (0.0009) [2023-12-28 01:43:14,188][106225] Updated weights for policy 1, policy_version 902027 (0.0008) [2023-12-28 01:43:14,243][106225] Updated weights for policy 1, policy_version 902037 (0.0008) [2023-12-28 01:43:14,302][106225] Updated weights for policy 1, policy_version 902047 (0.0008) [2023-12-28 01:43:14,722][106226] Updated weights for policy 0, policy_version 899757 (0.0008) [2023-12-28 01:43:14,782][106226] Updated weights for policy 0, policy_version 899767 (0.0008) [2023-12-28 01:43:14,849][106226] Updated weights for policy 0, policy_version 899777 (0.0007) [2023-12-28 01:43:15,056][106225] Updated weights for policy 1, policy_version 902057 (0.0009) [2023-12-28 01:43:15,111][106225] Updated weights for policy 1, policy_version 902067 (0.0009) [2023-12-28 01:43:15,171][106225] Updated weights for policy 1, policy_version 902077 (0.0010) [2023-12-28 01:43:15,475][106226] Updated weights for policy 0, policy_version 899787 (0.0009) [2023-12-28 01:43:15,536][106226] Updated weights for policy 0, policy_version 899797 (0.0009) [2023-12-28 01:43:15,596][106226] Updated weights for policy 0, policy_version 899807 (0.0009) [2023-12-28 01:43:15,909][106225] Updated weights for policy 1, policy_version 902087 (0.0009) [2023-12-28 01:43:15,960][106225] Updated weights for policy 1, policy_version 902097 (0.0008) [2023-12-28 01:43:16,009][106225] Updated weights for policy 1, policy_version 902107 (0.0008) [2023-12-28 01:43:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 461389824. Throughput: 0: 9971.7, 1: 9727.1. Samples: 461377316. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:16,175][105115] Avg episode reward: [(0, '-4.194'), (1, '-4.772')] [2023-12-28 01:43:16,231][106226] Updated weights for policy 0, policy_version 899817 (0.0008) [2023-12-28 01:43:16,284][106226] Updated weights for policy 0, policy_version 899827 (0.0005) [2023-12-28 01:43:16,335][106226] Updated weights for policy 0, policy_version 899837 (0.0005) [2023-12-28 01:43:16,400][106226] Updated weights for policy 0, policy_version 899847 (0.0006) [2023-12-28 01:43:16,793][106225] Updated weights for policy 1, policy_version 902117 (0.0008) [2023-12-28 01:43:16,847][106225] Updated weights for policy 1, policy_version 902127 (0.0009) [2023-12-28 01:43:16,896][106225] Updated weights for policy 1, policy_version 902137 (0.0008) [2023-12-28 01:43:16,991][106226] Updated weights for policy 0, policy_version 899857 (0.0005) [2023-12-28 01:43:17,044][106226] Updated weights for policy 0, policy_version 899867 (0.0005) [2023-12-28 01:43:17,090][106226] Updated weights for policy 0, policy_version 899877 (0.0005) [2023-12-28 01:43:17,677][106226] Updated weights for policy 0, policy_version 899887 (0.0008) [2023-12-28 01:43:17,715][106225] Updated weights for policy 1, policy_version 902147 (0.0008) [2023-12-28 01:43:17,734][106226] Updated weights for policy 0, policy_version 899897 (0.0006) [2023-12-28 01:43:17,773][106225] Updated weights for policy 1, policy_version 902157 (0.0009) [2023-12-28 01:43:17,792][106226] Updated weights for policy 0, policy_version 899907 (0.0007) [2023-12-28 01:43:17,834][106225] Updated weights for policy 1, policy_version 902167 (0.0009) [2023-12-28 01:43:18,496][106226] Updated weights for policy 0, policy_version 899917 (0.0009) [2023-12-28 01:43:18,555][106226] Updated weights for policy 0, policy_version 899927 (0.0006) [2023-12-28 01:43:18,603][106225] Updated weights for policy 1, policy_version 902177 (0.0008) [2023-12-28 01:43:18,621][106226] Updated weights for policy 0, policy_version 899937 (0.0010) [2023-12-28 01:43:18,661][106225] Updated weights for policy 1, policy_version 902187 (0.0007) [2023-12-28 01:43:18,721][106225] Updated weights for policy 1, policy_version 902197 (0.0007) [2023-12-28 01:43:18,777][106225] Updated weights for policy 1, policy_version 902207 (0.0010) [2023-12-28 01:43:19,232][106226] Updated weights for policy 0, policy_version 899947 (0.0010) [2023-12-28 01:43:19,296][106226] Updated weights for policy 0, policy_version 899957 (0.0011) [2023-12-28 01:43:19,370][106226] Updated weights for policy 0, policy_version 899967 (0.0009) [2023-12-28 01:43:19,616][106225] Updated weights for policy 1, policy_version 902217 (0.0007) [2023-12-28 01:43:19,671][106225] Updated weights for policy 1, policy_version 902227 (0.0008) [2023-12-28 01:43:19,734][106225] Updated weights for policy 1, policy_version 902237 (0.0007) [2023-12-28 01:43:20,122][106226] Updated weights for policy 0, policy_version 899977 (0.0008) [2023-12-28 01:43:20,182][106226] Updated weights for policy 0, policy_version 899987 (0.0010) [2023-12-28 01:43:20,248][106226] Updated weights for policy 0, policy_version 899997 (0.0011) [2023-12-28 01:43:20,306][106226] Updated weights for policy 0, policy_version 900007 (0.0011) [2023-12-28 01:43:20,474][106225] Updated weights for policy 1, policy_version 902247 (0.0009) [2023-12-28 01:43:20,527][106225] Updated weights for policy 1, policy_version 902257 (0.0007) [2023-12-28 01:43:20,586][106225] Updated weights for policy 1, policy_version 902267 (0.0008) [2023-12-28 01:43:21,027][106226] Updated weights for policy 0, policy_version 900017 (0.0011) [2023-12-28 01:43:21,087][106226] Updated weights for policy 0, policy_version 900027 (0.0009) [2023-12-28 01:43:21,136][106226] Updated weights for policy 0, policy_version 900037 (0.0009) [2023-12-28 01:43:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 461488128. Throughput: 0: 10055.5, 1: 9626.3. Samples: 461494256. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:21,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.700')] [2023-12-28 01:43:21,416][106225] Updated weights for policy 1, policy_version 902277 (0.0007) [2023-12-28 01:43:21,470][106225] Updated weights for policy 1, policy_version 902287 (0.0008) [2023-12-28 01:43:21,522][106225] Updated weights for policy 1, policy_version 902297 (0.0008) [2023-12-28 01:43:21,878][106226] Updated weights for policy 0, policy_version 900047 (0.0008) [2023-12-28 01:43:21,941][106226] Updated weights for policy 0, policy_version 900057 (0.0010) [2023-12-28 01:43:22,011][106226] Updated weights for policy 0, policy_version 900067 (0.0011) [2023-12-28 01:43:22,221][106225] Updated weights for policy 1, policy_version 902307 (0.0007) [2023-12-28 01:43:22,289][106225] Updated weights for policy 1, policy_version 902317 (0.0009) [2023-12-28 01:43:22,351][106225] Updated weights for policy 1, policy_version 902327 (0.0007) [2023-12-28 01:43:22,728][106226] Updated weights for policy 0, policy_version 900077 (0.0009) [2023-12-28 01:43:22,785][106226] Updated weights for policy 0, policy_version 900087 (0.0009) [2023-12-28 01:43:22,835][106226] Updated weights for policy 0, policy_version 900097 (0.0009) [2023-12-28 01:43:23,035][106225] Updated weights for policy 1, policy_version 902337 (0.0009) [2023-12-28 01:43:23,089][106225] Updated weights for policy 1, policy_version 902347 (0.0006) [2023-12-28 01:43:23,148][106225] Updated weights for policy 1, policy_version 902357 (0.0008) [2023-12-28 01:43:23,212][106225] Updated weights for policy 1, policy_version 902367 (0.0007) [2023-12-28 01:43:23,558][106226] Updated weights for policy 0, policy_version 900107 (0.0007) [2023-12-28 01:43:23,616][106226] Updated weights for policy 0, policy_version 900117 (0.0005) [2023-12-28 01:43:23,684][106226] Updated weights for policy 0, policy_version 900127 (0.0005) [2023-12-28 01:43:23,904][106225] Updated weights for policy 1, policy_version 902377 (0.0010) [2023-12-28 01:43:23,971][106225] Updated weights for policy 1, policy_version 902387 (0.0010) [2023-12-28 01:43:24,027][106225] Updated weights for policy 1, policy_version 902397 (0.0010) [2023-12-28 01:43:24,309][106226] Updated weights for policy 0, policy_version 900137 (0.0006) [2023-12-28 01:43:24,368][106226] Updated weights for policy 0, policy_version 900147 (0.0007) [2023-12-28 01:43:24,424][106226] Updated weights for policy 0, policy_version 900157 (0.0006) [2023-12-28 01:43:24,481][106226] Updated weights for policy 0, policy_version 900167 (0.0005) [2023-12-28 01:43:24,683][106225] Updated weights for policy 1, policy_version 902407 (0.0007) [2023-12-28 01:43:24,740][106225] Updated weights for policy 1, policy_version 902417 (0.0005) [2023-12-28 01:43:24,799][106225] Updated weights for policy 1, policy_version 902427 (0.0008) [2023-12-28 01:43:25,142][106226] Updated weights for policy 0, policy_version 900178 (0.0008) [2023-12-28 01:43:25,193][106226] Updated weights for policy 0, policy_version 900188 (0.0007) [2023-12-28 01:43:25,244][106226] Updated weights for policy 0, policy_version 900198 (0.0006) [2023-12-28 01:43:25,387][106225] Updated weights for policy 1, policy_version 902437 (0.0010) [2023-12-28 01:43:25,449][106225] Updated weights for policy 1, policy_version 902447 (0.0010) [2023-12-28 01:43:25,509][106225] Updated weights for policy 1, policy_version 902457 (0.0010) [2023-12-28 01:43:25,861][106226] Updated weights for policy 0, policy_version 900208 (0.0008) [2023-12-28 01:43:25,918][106226] Updated weights for policy 0, policy_version 900218 (0.0008) [2023-12-28 01:43:25,970][106226] Updated weights for policy 0, policy_version 900228 (0.0007) [2023-12-28 01:43:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 461586432. Throughput: 0: 10025.1, 1: 9646.8. Samples: 461552884. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:26,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.932')] [2023-12-28 01:43:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000900232_230514688.pth... [2023-12-28 01:43:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000899048_230211584.pth [2023-12-28 01:43:26,198][106225] Updated weights for policy 1, policy_version 902467 (0.0010) [2023-12-28 01:43:26,266][106225] Updated weights for policy 1, policy_version 902477 (0.0008) [2023-12-28 01:43:26,328][106225] Updated weights for policy 1, policy_version 902487 (0.0008) [2023-12-28 01:43:26,385][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000902496_231079936.pth... [2023-12-28 01:43:26,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000901344_230785024.pth [2023-12-28 01:43:26,675][106226] Updated weights for policy 0, policy_version 900238 (0.0007) [2023-12-28 01:43:26,733][106226] Updated weights for policy 0, policy_version 900248 (0.0006) [2023-12-28 01:43:26,791][106226] Updated weights for policy 0, policy_version 900258 (0.0005) [2023-12-28 01:43:27,035][106225] Updated weights for policy 1, policy_version 902497 (0.0008) [2023-12-28 01:43:27,085][106225] Updated weights for policy 1, policy_version 902507 (0.0010) [2023-12-28 01:43:27,131][106225] Updated weights for policy 1, policy_version 902517 (0.0008) [2023-12-28 01:43:27,182][106225] Updated weights for policy 1, policy_version 902527 (0.0010) [2023-12-28 01:43:27,335][106226] Updated weights for policy 0, policy_version 900268 (0.0005) [2023-12-28 01:43:27,388][106226] Updated weights for policy 0, policy_version 900278 (0.0005) [2023-12-28 01:43:27,433][106226] Updated weights for policy 0, policy_version 900288 (0.0006) [2023-12-28 01:43:27,903][106225] Updated weights for policy 1, policy_version 902537 (0.0010) [2023-12-28 01:43:27,958][106225] Updated weights for policy 1, policy_version 902547 (0.0010) [2023-12-28 01:43:28,030][106225] Updated weights for policy 1, policy_version 902558 (0.0010) [2023-12-28 01:43:28,035][106226] Updated weights for policy 0, policy_version 900298 (0.0007) [2023-12-28 01:43:28,082][106226] Updated weights for policy 0, policy_version 900308 (0.0005) [2023-12-28 01:43:28,135][106226] Updated weights for policy 0, policy_version 900318 (0.0005) [2023-12-28 01:43:28,199][106226] Updated weights for policy 0, policy_version 900328 (0.0007) [2023-12-28 01:43:28,738][106225] Updated weights for policy 1, policy_version 902568 (0.0007) [2023-12-28 01:43:28,796][106225] Updated weights for policy 1, policy_version 902578 (0.0007) [2023-12-28 01:43:28,859][106225] Updated weights for policy 1, policy_version 902588 (0.0007) [2023-12-28 01:43:28,868][106226] Updated weights for policy 0, policy_version 900338 (0.0010) [2023-12-28 01:43:28,918][106226] Updated weights for policy 0, policy_version 900348 (0.0010) [2023-12-28 01:43:28,964][106226] Updated weights for policy 0, policy_version 900358 (0.0010) [2023-12-28 01:43:29,557][106225] Updated weights for policy 1, policy_version 902598 (0.0008) [2023-12-28 01:43:29,618][106225] Updated weights for policy 1, policy_version 902608 (0.0008) [2023-12-28 01:43:29,679][106225] Updated weights for policy 1, policy_version 902618 (0.0008) [2023-12-28 01:43:29,740][106226] Updated weights for policy 0, policy_version 900368 (0.0007) [2023-12-28 01:43:29,800][106226] Updated weights for policy 0, policy_version 900378 (0.0008) [2023-12-28 01:43:29,870][106226] Updated weights for policy 0, policy_version 900388 (0.0008) [2023-12-28 01:43:30,369][106225] Updated weights for policy 1, policy_version 902628 (0.0008) [2023-12-28 01:43:30,424][106225] Updated weights for policy 1, policy_version 902638 (0.0008) [2023-12-28 01:43:30,482][106225] Updated weights for policy 1, policy_version 902648 (0.0008) [2023-12-28 01:43:30,611][106226] Updated weights for policy 0, policy_version 900398 (0.0008) [2023-12-28 01:43:30,657][106226] Updated weights for policy 0, policy_version 900408 (0.0008) [2023-12-28 01:43:30,701][106226] Updated weights for policy 0, policy_version 900418 (0.0008) [2023-12-28 01:43:31,162][106225] Updated weights for policy 1, policy_version 902658 (0.0006) [2023-12-28 01:43:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 461684736. Throughput: 0: 10101.6, 1: 9758.6. Samples: 461676060. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:31,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-4.884')] [2023-12-28 01:43:31,236][106225] Updated weights for policy 1, policy_version 902668 (0.0011) [2023-12-28 01:43:31,300][106225] Updated weights for policy 1, policy_version 902678 (0.0009) [2023-12-28 01:43:31,375][106225] Updated weights for policy 1, policy_version 902688 (0.0010) [2023-12-28 01:43:31,497][106226] Updated weights for policy 0, policy_version 900428 (0.0007) [2023-12-28 01:43:31,558][106226] Updated weights for policy 0, policy_version 900438 (0.0006) [2023-12-28 01:43:31,623][106226] Updated weights for policy 0, policy_version 900448 (0.0008) [2023-12-28 01:43:32,131][106225] Updated weights for policy 1, policy_version 902698 (0.0007) [2023-12-28 01:43:32,200][106225] Updated weights for policy 1, policy_version 902708 (0.0008) [2023-12-28 01:43:32,207][106226] Updated weights for policy 0, policy_version 900458 (0.0007) [2023-12-28 01:43:32,263][106225] Updated weights for policy 1, policy_version 902718 (0.0011) [2023-12-28 01:43:32,273][106226] Updated weights for policy 0, policy_version 900468 (0.0009) [2023-12-28 01:43:32,337][106226] Updated weights for policy 0, policy_version 900478 (0.0009) [2023-12-28 01:43:32,410][106226] Updated weights for policy 0, policy_version 900488 (0.0010) [2023-12-28 01:43:32,981][106225] Updated weights for policy 1, policy_version 902728 (0.0008) [2023-12-28 01:43:33,045][106225] Updated weights for policy 1, policy_version 902738 (0.0008) [2023-12-28 01:43:33,110][106225] Updated weights for policy 1, policy_version 902748 (0.0007) [2023-12-28 01:43:33,128][106226] Updated weights for policy 0, policy_version 900498 (0.0008) [2023-12-28 01:43:33,182][106226] Updated weights for policy 0, policy_version 900508 (0.0008) [2023-12-28 01:43:33,242][106226] Updated weights for policy 0, policy_version 900518 (0.0010) [2023-12-28 01:43:33,718][106225] Updated weights for policy 1, policy_version 902758 (0.0005) [2023-12-28 01:43:33,763][106225] Updated weights for policy 1, policy_version 902768 (0.0005) [2023-12-28 01:43:33,832][106225] Updated weights for policy 1, policy_version 902778 (0.0005) [2023-12-28 01:43:33,842][106226] Updated weights for policy 0, policy_version 900528 (0.0009) [2023-12-28 01:43:33,894][106226] Updated weights for policy 0, policy_version 900538 (0.0005) [2023-12-28 01:43:33,951][106226] Updated weights for policy 0, policy_version 900548 (0.0005) [2023-12-28 01:43:34,528][106225] Updated weights for policy 1, policy_version 902788 (0.0007) [2023-12-28 01:43:34,591][106225] Updated weights for policy 1, policy_version 902798 (0.0008) [2023-12-28 01:43:34,591][106226] Updated weights for policy 0, policy_version 900558 (0.0005) [2023-12-28 01:43:34,650][106225] Updated weights for policy 1, policy_version 902808 (0.0008) [2023-12-28 01:43:34,657][106226] Updated weights for policy 0, policy_version 900568 (0.0006) [2023-12-28 01:43:34,720][106226] Updated weights for policy 0, policy_version 900578 (0.0006) [2023-12-28 01:43:35,232][106226] Updated weights for policy 0, policy_version 900588 (0.0006) [2023-12-28 01:43:35,283][106226] Updated weights for policy 0, policy_version 900598 (0.0005) [2023-12-28 01:43:35,317][106225] Updated weights for policy 1, policy_version 902818 (0.0008) [2023-12-28 01:43:35,332][106226] Updated weights for policy 0, policy_version 900608 (0.0006) [2023-12-28 01:43:35,369][106225] Updated weights for policy 1, policy_version 902828 (0.0008) [2023-12-28 01:43:35,423][106225] Updated weights for policy 1, policy_version 902838 (0.0008) [2023-12-28 01:43:35,488][106225] Updated weights for policy 1, policy_version 902848 (0.0009) [2023-12-28 01:43:35,933][106226] Updated weights for policy 0, policy_version 900618 (0.0011) [2023-12-28 01:43:35,986][106226] Updated weights for policy 0, policy_version 900628 (0.0010) [2023-12-28 01:43:36,041][106226] Updated weights for policy 0, policy_version 900638 (0.0011) [2023-12-28 01:43:36,095][106226] Updated weights for policy 0, policy_version 900648 (0.0010) [2023-12-28 01:43:36,104][106225] Updated weights for policy 1, policy_version 902858 (0.0006) [2023-12-28 01:43:36,164][106225] Updated weights for policy 1, policy_version 902868 (0.0008) [2023-12-28 01:43:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 461791232. Throughput: 0: 10165.5, 1: 9763.0. Samples: 461799796. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:36,175][105115] Avg episode reward: [(0, '-4.281'), (1, '-5.034')] [2023-12-28 01:43:36,218][106225] Updated weights for policy 1, policy_version 902878 (0.0008) [2023-12-28 01:43:36,849][106226] Updated weights for policy 0, policy_version 900658 (0.0010) [2023-12-28 01:43:36,908][106226] Updated weights for policy 0, policy_version 900668 (0.0005) [2023-12-28 01:43:36,965][106226] Updated weights for policy 0, policy_version 900678 (0.0008) [2023-12-28 01:43:37,002][106225] Updated weights for policy 1, policy_version 902888 (0.0008) [2023-12-28 01:43:37,059][106225] Updated weights for policy 1, policy_version 902898 (0.0008) [2023-12-28 01:43:37,117][106225] Updated weights for policy 1, policy_version 902908 (0.0008) [2023-12-28 01:43:37,600][106226] Updated weights for policy 0, policy_version 900688 (0.0011) [2023-12-28 01:43:37,654][106226] Updated weights for policy 0, policy_version 900698 (0.0010) [2023-12-28 01:43:37,715][106226] Updated weights for policy 0, policy_version 900708 (0.0006) [2023-12-28 01:43:37,900][106225] Updated weights for policy 1, policy_version 902918 (0.0010) [2023-12-28 01:43:37,947][106225] Updated weights for policy 1, policy_version 902928 (0.0010) [2023-12-28 01:43:38,001][106225] Updated weights for policy 1, policy_version 902938 (0.0010) [2023-12-28 01:43:38,257][106226] Updated weights for policy 0, policy_version 900718 (0.0008) [2023-12-28 01:43:38,317][106226] Updated weights for policy 0, policy_version 900728 (0.0008) [2023-12-28 01:43:38,385][106226] Updated weights for policy 0, policy_version 900738 (0.0008) [2023-12-28 01:43:38,742][106225] Updated weights for policy 1, policy_version 902948 (0.0008) [2023-12-28 01:43:38,806][106225] Updated weights for policy 1, policy_version 902958 (0.0006) [2023-12-28 01:43:38,871][106225] Updated weights for policy 1, policy_version 902968 (0.0008) [2023-12-28 01:43:39,086][106226] Updated weights for policy 0, policy_version 900748 (0.0009) [2023-12-28 01:43:39,149][106226] Updated weights for policy 0, policy_version 900758 (0.0009) [2023-12-28 01:43:39,213][106226] Updated weights for policy 0, policy_version 900768 (0.0009) [2023-12-28 01:43:39,484][106225] Updated weights for policy 1, policy_version 902978 (0.0008) [2023-12-28 01:43:39,537][106225] Updated weights for policy 1, policy_version 902988 (0.0008) [2023-12-28 01:43:39,594][106225] Updated weights for policy 1, policy_version 902998 (0.0009) [2023-12-28 01:43:39,644][106225] Updated weights for policy 1, policy_version 903008 (0.0006) [2023-12-28 01:43:40,025][106226] Updated weights for policy 0, policy_version 900778 (0.0008) [2023-12-28 01:43:40,080][106226] Updated weights for policy 0, policy_version 900788 (0.0011) [2023-12-28 01:43:40,142][106226] Updated weights for policy 0, policy_version 900798 (0.0011) [2023-12-28 01:43:40,200][106226] Updated weights for policy 0, policy_version 900808 (0.0006) [2023-12-28 01:43:40,354][106225] Updated weights for policy 1, policy_version 903018 (0.0009) [2023-12-28 01:43:40,420][106225] Updated weights for policy 1, policy_version 903028 (0.0010) [2023-12-28 01:43:40,474][106225] Updated weights for policy 1, policy_version 903038 (0.0008) [2023-12-28 01:43:40,802][106226] Updated weights for policy 0, policy_version 900818 (0.0011) [2023-12-28 01:43:40,852][106226] Updated weights for policy 0, policy_version 900828 (0.0011) [2023-12-28 01:43:40,906][106226] Updated weights for policy 0, policy_version 900838 (0.0010) [2023-12-28 01:43:41,092][106225] Updated weights for policy 1, policy_version 903048 (0.0007) [2023-12-28 01:43:41,154][106225] Updated weights for policy 1, policy_version 903058 (0.0006) [2023-12-28 01:43:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 461889536. Throughput: 0: 10214.4, 1: 9749.0. Samples: 461860372. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:41,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.054')] [2023-12-28 01:43:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000900840_230670336.pth... [2023-12-28 01:43:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000899624_230359040.pth [2023-12-28 01:43:41,217][106225] Updated weights for policy 1, policy_version 903068 (0.0008) [2023-12-28 01:43:41,238][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000903072_231227392.pth... [2023-12-28 01:43:41,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000901920_230932480.pth [2023-12-28 01:43:41,707][106226] Updated weights for policy 0, policy_version 900848 (0.0008) [2023-12-28 01:43:41,775][106226] Updated weights for policy 0, policy_version 900858 (0.0008) [2023-12-28 01:43:41,829][106226] Updated weights for policy 0, policy_version 900868 (0.0008) [2023-12-28 01:43:41,991][106225] Updated weights for policy 1, policy_version 903078 (0.0007) [2023-12-28 01:43:42,043][106225] Updated weights for policy 1, policy_version 903088 (0.0009) [2023-12-28 01:43:42,103][106225] Updated weights for policy 1, policy_version 903098 (0.0009) [2023-12-28 01:43:42,595][106226] Updated weights for policy 0, policy_version 900878 (0.0008) [2023-12-28 01:43:42,645][106226] Updated weights for policy 0, policy_version 900888 (0.0008) [2023-12-28 01:43:42,692][106226] Updated weights for policy 0, policy_version 900898 (0.0007) [2023-12-28 01:43:42,858][106225] Updated weights for policy 1, policy_version 903108 (0.0009) [2023-12-28 01:43:42,909][106225] Updated weights for policy 1, policy_version 903118 (0.0010) [2023-12-28 01:43:42,963][106225] Updated weights for policy 1, policy_version 903128 (0.0010) [2023-12-28 01:43:43,443][106226] Updated weights for policy 0, policy_version 900908 (0.0009) [2023-12-28 01:43:43,505][106226] Updated weights for policy 0, policy_version 900918 (0.0010) [2023-12-28 01:43:43,571][106226] Updated weights for policy 0, policy_version 900928 (0.0010) [2023-12-28 01:43:43,691][106225] Updated weights for policy 1, policy_version 903138 (0.0010) [2023-12-28 01:43:43,737][106225] Updated weights for policy 1, policy_version 903148 (0.0010) [2023-12-28 01:43:43,800][106225] Updated weights for policy 1, policy_version 903158 (0.0010) [2023-12-28 01:43:43,850][106225] Updated weights for policy 1, policy_version 903168 (0.0010) [2023-12-28 01:43:44,257][106226] Updated weights for policy 0, policy_version 900938 (0.0010) [2023-12-28 01:43:44,312][106226] Updated weights for policy 0, policy_version 900948 (0.0008) [2023-12-28 01:43:44,366][106226] Updated weights for policy 0, policy_version 900958 (0.0009) [2023-12-28 01:43:44,431][106226] Updated weights for policy 0, policy_version 900968 (0.0007) [2023-12-28 01:43:44,550][106225] Updated weights for policy 1, policy_version 903178 (0.0010) [2023-12-28 01:43:44,607][106225] Updated weights for policy 1, policy_version 903188 (0.0007) [2023-12-28 01:43:44,665][106225] Updated weights for policy 1, policy_version 903198 (0.0008) [2023-12-28 01:43:45,126][106226] Updated weights for policy 0, policy_version 900978 (0.0011) [2023-12-28 01:43:45,181][106226] Updated weights for policy 0, policy_version 900988 (0.0011) [2023-12-28 01:43:45,240][106226] Updated weights for policy 0, policy_version 900998 (0.0011) [2023-12-28 01:43:45,392][106225] Updated weights for policy 1, policy_version 903208 (0.0008) [2023-12-28 01:43:45,438][106225] Updated weights for policy 1, policy_version 903218 (0.0006) [2023-12-28 01:43:45,487][106225] Updated weights for policy 1, policy_version 903228 (0.0005) [2023-12-28 01:43:45,968][106226] Updated weights for policy 0, policy_version 901008 (0.0006) [2023-12-28 01:43:46,015][106226] Updated weights for policy 0, policy_version 901018 (0.0005) [2023-12-28 01:43:46,063][106226] Updated weights for policy 0, policy_version 901028 (0.0005) [2023-12-28 01:43:46,119][106225] Updated weights for policy 1, policy_version 903238 (0.0007) [2023-12-28 01:43:46,168][106225] Updated weights for policy 1, policy_version 903248 (0.0008) [2023-12-28 01:43:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 461987840. Throughput: 0: 10163.1, 1: 9739.9. Samples: 461976940. Policy #0 lag: (min: 13.0, avg: 21.0, max: 45.0) [2023-12-28 01:43:46,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.862')] [2023-12-28 01:43:46,217][106225] Updated weights for policy 1, policy_version 903258 (0.0008) [2023-12-28 01:43:46,597][106226] Updated weights for policy 0, policy_version 901038 (0.0005) [2023-12-28 01:43:46,647][106226] Updated weights for policy 0, policy_version 901048 (0.0009) [2023-12-28 01:43:46,701][106226] Updated weights for policy 0, policy_version 901058 (0.0011) [2023-12-28 01:43:46,998][106225] Updated weights for policy 1, policy_version 903268 (0.0008) [2023-12-28 01:43:47,058][106225] Updated weights for policy 1, policy_version 903278 (0.0008) [2023-12-28 01:43:47,114][106225] Updated weights for policy 1, policy_version 903288 (0.0007) [2023-12-28 01:43:47,414][106226] Updated weights for policy 0, policy_version 901068 (0.0010) [2023-12-28 01:43:47,474][106226] Updated weights for policy 0, policy_version 901078 (0.0011) [2023-12-28 01:43:47,531][106226] Updated weights for policy 0, policy_version 901088 (0.0010) [2023-12-28 01:43:47,778][106225] Updated weights for policy 1, policy_version 903298 (0.0008) [2023-12-28 01:43:47,835][106225] Updated weights for policy 1, policy_version 903308 (0.0007) [2023-12-28 01:43:47,890][106225] Updated weights for policy 1, policy_version 903318 (0.0008) [2023-12-28 01:43:47,951][106225] Updated weights for policy 1, policy_version 903328 (0.0007) [2023-12-28 01:43:48,292][106226] Updated weights for policy 0, policy_version 901098 (0.0010) [2023-12-28 01:43:48,362][106226] Updated weights for policy 0, policy_version 901108 (0.0011) [2023-12-28 01:43:48,422][106226] Updated weights for policy 0, policy_version 901118 (0.0009) [2023-12-28 01:43:48,486][106226] Updated weights for policy 0, policy_version 901128 (0.0009) [2023-12-28 01:43:48,732][106225] Updated weights for policy 1, policy_version 903338 (0.0008) [2023-12-28 01:43:48,796][106225] Updated weights for policy 1, policy_version 903348 (0.0007) [2023-12-28 01:43:48,850][106225] Updated weights for policy 1, policy_version 903358 (0.0007) [2023-12-28 01:43:49,152][106226] Updated weights for policy 0, policy_version 901138 (0.0006) [2023-12-28 01:43:49,216][106226] Updated weights for policy 0, policy_version 901148 (0.0006) [2023-12-28 01:43:49,287][106226] Updated weights for policy 0, policy_version 901158 (0.0009) [2023-12-28 01:43:49,588][106225] Updated weights for policy 1, policy_version 903368 (0.0007) [2023-12-28 01:43:49,649][106225] Updated weights for policy 1, policy_version 903378 (0.0007) [2023-12-28 01:43:49,716][106225] Updated weights for policy 1, policy_version 903388 (0.0008) [2023-12-28 01:43:50,010][106226] Updated weights for policy 0, policy_version 901168 (0.0010) [2023-12-28 01:43:50,075][106226] Updated weights for policy 0, policy_version 901178 (0.0011) [2023-12-28 01:43:50,141][106226] Updated weights for policy 0, policy_version 901188 (0.0009) [2023-12-28 01:43:50,393][106225] Updated weights for policy 1, policy_version 903398 (0.0009) [2023-12-28 01:43:50,448][106225] Updated weights for policy 1, policy_version 903408 (0.0008) [2023-12-28 01:43:50,507][106225] Updated weights for policy 1, policy_version 903418 (0.0008) [2023-12-28 01:43:50,929][106226] Updated weights for policy 0, policy_version 901198 (0.0010) [2023-12-28 01:43:50,979][106226] Updated weights for policy 0, policy_version 901208 (0.0009) [2023-12-28 01:43:51,053][106226] Updated weights for policy 0, policy_version 901218 (0.0009) [2023-12-28 01:43:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 462086144. Throughput: 0: 10079.8, 1: 9723.3. Samples: 462094456. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:43:51,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.841')] [2023-12-28 01:43:51,180][106225] Updated weights for policy 1, policy_version 903428 (0.0007) [2023-12-28 01:43:51,239][106225] Updated weights for policy 1, policy_version 903438 (0.0008) [2023-12-28 01:43:51,305][106225] Updated weights for policy 1, policy_version 903448 (0.0009) [2023-12-28 01:43:51,878][106226] Updated weights for policy 0, policy_version 901228 (0.0009) [2023-12-28 01:43:51,938][106226] Updated weights for policy 0, policy_version 901238 (0.0010) [2023-12-28 01:43:51,993][106226] Updated weights for policy 0, policy_version 901248 (0.0010) [2023-12-28 01:43:52,021][106225] Updated weights for policy 1, policy_version 903458 (0.0007) [2023-12-28 01:43:52,077][106225] Updated weights for policy 1, policy_version 903468 (0.0007) [2023-12-28 01:43:52,129][106225] Updated weights for policy 1, policy_version 903478 (0.0010) [2023-12-28 01:43:52,183][106225] Updated weights for policy 1, policy_version 903488 (0.0010) [2023-12-28 01:43:52,776][106226] Updated weights for policy 0, policy_version 901258 (0.0009) [2023-12-28 01:43:52,831][106226] Updated weights for policy 0, policy_version 901268 (0.0008) [2023-12-28 01:43:52,888][106226] Updated weights for policy 0, policy_version 901278 (0.0007) [2023-12-28 01:43:52,892][106225] Updated weights for policy 1, policy_version 903498 (0.0011) [2023-12-28 01:43:52,941][106226] Updated weights for policy 0, policy_version 901288 (0.0006) [2023-12-28 01:43:52,953][106225] Updated weights for policy 1, policy_version 903508 (0.0010) [2023-12-28 01:43:53,010][106225] Updated weights for policy 1, policy_version 903518 (0.0010) [2023-12-28 01:43:53,693][106225] Updated weights for policy 1, policy_version 903528 (0.0006) [2023-12-28 01:43:53,721][106226] Updated weights for policy 0, policy_version 901298 (0.0008) [2023-12-28 01:43:53,753][106225] Updated weights for policy 1, policy_version 903538 (0.0009) [2023-12-28 01:43:53,778][106226] Updated weights for policy 0, policy_version 901308 (0.0006) [2023-12-28 01:43:53,810][106225] Updated weights for policy 1, policy_version 903548 (0.0010) [2023-12-28 01:43:53,828][106226] Updated weights for policy 0, policy_version 901318 (0.0006) [2023-12-28 01:43:54,497][106225] Updated weights for policy 1, policy_version 903558 (0.0011) [2023-12-28 01:43:54,556][106225] Updated weights for policy 1, policy_version 903568 (0.0010) [2023-12-28 01:43:54,585][106226] Updated weights for policy 0, policy_version 901328 (0.0006) [2023-12-28 01:43:54,614][106225] Updated weights for policy 1, policy_version 903578 (0.0010) [2023-12-28 01:43:54,632][106226] Updated weights for policy 0, policy_version 901338 (0.0006) [2023-12-28 01:43:54,685][106226] Updated weights for policy 0, policy_version 901348 (0.0008) [2023-12-28 01:43:55,335][106225] Updated weights for policy 1, policy_version 903588 (0.0010) [2023-12-28 01:43:55,381][106225] Updated weights for policy 1, policy_version 903598 (0.0010) [2023-12-28 01:43:55,414][106226] Updated weights for policy 0, policy_version 901358 (0.0006) [2023-12-28 01:43:55,441][106225] Updated weights for policy 1, policy_version 903608 (0.0010) [2023-12-28 01:43:55,464][106226] Updated weights for policy 0, policy_version 901368 (0.0006) [2023-12-28 01:43:55,524][106226] Updated weights for policy 0, policy_version 901378 (0.0007) [2023-12-28 01:43:56,143][106226] Updated weights for policy 0, policy_version 901388 (0.0007) [2023-12-28 01:43:56,163][106225] Updated weights for policy 1, policy_version 903618 (0.0009) [2023-12-28 01:43:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 462176256. Throughput: 0: 10031.0, 1: 9761.4. Samples: 462151948. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:43:56,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-5.057')] [2023-12-28 01:43:56,207][106226] Updated weights for policy 0, policy_version 901398 (0.0006) [2023-12-28 01:43:56,224][106225] Updated weights for policy 1, policy_version 903628 (0.0010) [2023-12-28 01:43:56,268][106226] Updated weights for policy 0, policy_version 901408 (0.0005) [2023-12-28 01:43:56,288][106225] Updated weights for policy 1, policy_version 903638 (0.0010) [2023-12-28 01:43:56,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000901416_230817792.pth... [2023-12-28 01:43:56,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000900232_230514688.pth [2023-12-28 01:43:56,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000903648_231374848.pth... [2023-12-28 01:43:56,351][106225] Updated weights for policy 1, policy_version 903648 (0.0010) [2023-12-28 01:43:56,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000902496_231079936.pth [2023-12-28 01:43:56,879][106226] Updated weights for policy 0, policy_version 901418 (0.0005) [2023-12-28 01:43:56,944][106226] Updated weights for policy 0, policy_version 901428 (0.0005) [2023-12-28 01:43:56,997][106226] Updated weights for policy 0, policy_version 901438 (0.0005) [2023-12-28 01:43:57,006][106225] Updated weights for policy 1, policy_version 903658 (0.0010) [2023-12-28 01:43:57,053][106225] Updated weights for policy 1, policy_version 903668 (0.0010) [2023-12-28 01:43:57,055][106226] Updated weights for policy 0, policy_version 901448 (0.0005) [2023-12-28 01:43:57,103][106225] Updated weights for policy 1, policy_version 903678 (0.0010) [2023-12-28 01:43:57,608][106226] Updated weights for policy 0, policy_version 901458 (0.0008) [2023-12-28 01:43:57,664][106226] Updated weights for policy 0, policy_version 901468 (0.0007) [2023-12-28 01:43:57,718][106226] Updated weights for policy 0, policy_version 901478 (0.0008) [2023-12-28 01:43:57,828][106225] Updated weights for policy 1, policy_version 903688 (0.0010) [2023-12-28 01:43:57,884][106225] Updated weights for policy 1, policy_version 903698 (0.0010) [2023-12-28 01:43:57,949][106225] Updated weights for policy 1, policy_version 903708 (0.0010) [2023-12-28 01:43:58,503][106226] Updated weights for policy 0, policy_version 901488 (0.0009) [2023-12-28 01:43:58,573][106226] Updated weights for policy 0, policy_version 901498 (0.0009) [2023-12-28 01:43:58,639][106226] Updated weights for policy 0, policy_version 901508 (0.0009) [2023-12-28 01:43:58,756][106225] Updated weights for policy 1, policy_version 903718 (0.0009) [2023-12-28 01:43:58,824][106225] Updated weights for policy 1, policy_version 903728 (0.0009) [2023-12-28 01:43:58,893][106225] Updated weights for policy 1, policy_version 903738 (0.0009) [2023-12-28 01:43:59,453][106226] Updated weights for policy 0, policy_version 901518 (0.0007) [2023-12-28 01:43:59,514][106226] Updated weights for policy 0, policy_version 901528 (0.0006) [2023-12-28 01:43:59,570][106226] Updated weights for policy 0, policy_version 901538 (0.0006) [2023-12-28 01:43:59,702][106225] Updated weights for policy 1, policy_version 903748 (0.0009) [2023-12-28 01:43:59,752][106225] Updated weights for policy 1, policy_version 903758 (0.0008) [2023-12-28 01:43:59,806][106225] Updated weights for policy 1, policy_version 903768 (0.0006) [2023-12-28 01:44:00,278][106226] Updated weights for policy 0, policy_version 901548 (0.0008) [2023-12-28 01:44:00,332][106226] Updated weights for policy 0, policy_version 901558 (0.0008) [2023-12-28 01:44:00,384][106226] Updated weights for policy 0, policy_version 901568 (0.0007) [2023-12-28 01:44:00,449][106225] Updated weights for policy 1, policy_version 903778 (0.0008) [2023-12-28 01:44:00,500][106225] Updated weights for policy 1, policy_version 903788 (0.0005) [2023-12-28 01:44:00,553][106225] Updated weights for policy 1, policy_version 903798 (0.0005) [2023-12-28 01:44:00,607][106225] Updated weights for policy 1, policy_version 903808 (0.0006) [2023-12-28 01:44:01,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 462274560. Throughput: 0: 10078.5, 1: 9724.4. Samples: 462268444. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:01,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.978')] [2023-12-28 01:44:01,185][106226] Updated weights for policy 0, policy_version 901578 (0.0008) [2023-12-28 01:44:01,205][106225] Updated weights for policy 1, policy_version 903818 (0.0010) [2023-12-28 01:44:01,242][106226] Updated weights for policy 0, policy_version 901588 (0.0009) [2023-12-28 01:44:01,260][106225] Updated weights for policy 1, policy_version 903828 (0.0010) [2023-12-28 01:44:01,302][106226] Updated weights for policy 0, policy_version 901598 (0.0011) [2023-12-28 01:44:01,325][106225] Updated weights for policy 1, policy_version 903838 (0.0010) [2023-12-28 01:44:01,353][106226] Updated weights for policy 0, policy_version 901608 (0.0010) [2023-12-28 01:44:02,053][106225] Updated weights for policy 1, policy_version 903848 (0.0009) [2023-12-28 01:44:02,106][106225] Updated weights for policy 1, policy_version 903858 (0.0009) [2023-12-28 01:44:02,137][106226] Updated weights for policy 0, policy_version 901618 (0.0007) [2023-12-28 01:44:02,158][106225] Updated weights for policy 1, policy_version 903868 (0.0007) [2023-12-28 01:44:02,194][106226] Updated weights for policy 0, policy_version 901628 (0.0008) [2023-12-28 01:44:02,261][106226] Updated weights for policy 0, policy_version 901638 (0.0009) [2023-12-28 01:44:02,927][106225] Updated weights for policy 1, policy_version 903878 (0.0009) [2023-12-28 01:44:02,944][106226] Updated weights for policy 0, policy_version 901648 (0.0009) [2023-12-28 01:44:02,982][106225] Updated weights for policy 1, policy_version 903888 (0.0007) [2023-12-28 01:44:02,993][106226] Updated weights for policy 0, policy_version 901658 (0.0005) [2023-12-28 01:44:03,036][106225] Updated weights for policy 1, policy_version 903898 (0.0009) [2023-12-28 01:44:03,054][106226] Updated weights for policy 0, policy_version 901668 (0.0008) [2023-12-28 01:44:03,747][106225] Updated weights for policy 1, policy_version 903908 (0.0008) [2023-12-28 01:44:03,799][106225] Updated weights for policy 1, policy_version 903918 (0.0005) [2023-12-28 01:44:03,847][106226] Updated weights for policy 0, policy_version 901678 (0.0008) [2023-12-28 01:44:03,869][106225] Updated weights for policy 1, policy_version 903928 (0.0008) [2023-12-28 01:44:03,917][106226] Updated weights for policy 0, policy_version 901688 (0.0007) [2023-12-28 01:44:03,976][106226] Updated weights for policy 0, policy_version 901698 (0.0009) [2023-12-28 01:44:04,565][106225] Updated weights for policy 1, policy_version 903938 (0.0006) [2023-12-28 01:44:04,615][106225] Updated weights for policy 1, policy_version 903948 (0.0009) [2023-12-28 01:44:04,674][106225] Updated weights for policy 1, policy_version 903958 (0.0008) [2023-12-28 01:44:04,676][106226] Updated weights for policy 0, policy_version 901708 (0.0007) [2023-12-28 01:44:04,729][106226] Updated weights for policy 0, policy_version 901718 (0.0006) [2023-12-28 01:44:04,730][106225] Updated weights for policy 1, policy_version 903968 (0.0007) [2023-12-28 01:44:04,780][106226] Updated weights for policy 0, policy_version 901728 (0.0008) [2023-12-28 01:44:05,421][106225] Updated weights for policy 1, policy_version 903978 (0.0008) [2023-12-28 01:44:05,469][106225] Updated weights for policy 1, policy_version 903988 (0.0008) [2023-12-28 01:44:05,512][106225] Updated weights for policy 1, policy_version 903998 (0.0008) [2023-12-28 01:44:05,519][106226] Updated weights for policy 0, policy_version 901738 (0.0009) [2023-12-28 01:44:05,574][106226] Updated weights for policy 0, policy_version 901748 (0.0009) [2023-12-28 01:44:05,623][106226] Updated weights for policy 0, policy_version 901758 (0.0008) [2023-12-28 01:44:05,676][106226] Updated weights for policy 0, policy_version 901768 (0.0008) [2023-12-28 01:44:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 462372864. Throughput: 0: 9922.6, 1: 9843.7. Samples: 462383744. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:06,176][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.923')] [2023-12-28 01:44:06,258][106225] Updated weights for policy 1, policy_version 904008 (0.0008) [2023-12-28 01:44:06,313][106225] Updated weights for policy 1, policy_version 904018 (0.0008) [2023-12-28 01:44:06,372][106225] Updated weights for policy 1, policy_version 904028 (0.0008) [2023-12-28 01:44:06,436][106226] Updated weights for policy 0, policy_version 901778 (0.0008) [2023-12-28 01:44:06,487][106226] Updated weights for policy 0, policy_version 901788 (0.0008) [2023-12-28 01:44:06,540][106226] Updated weights for policy 0, policy_version 901798 (0.0008) [2023-12-28 01:44:07,044][106225] Updated weights for policy 1, policy_version 904038 (0.0006) [2023-12-28 01:44:07,120][106225] Updated weights for policy 1, policy_version 904048 (0.0008) [2023-12-28 01:44:07,177][106225] Updated weights for policy 1, policy_version 904058 (0.0009) [2023-12-28 01:44:07,215][106226] Updated weights for policy 0, policy_version 901808 (0.0008) [2023-12-28 01:44:07,275][106226] Updated weights for policy 0, policy_version 901818 (0.0009) [2023-12-28 01:44:07,323][106226] Updated weights for policy 0, policy_version 901828 (0.0009) [2023-12-28 01:44:07,815][106225] Updated weights for policy 1, policy_version 904068 (0.0005) [2023-12-28 01:44:07,864][106225] Updated weights for policy 1, policy_version 904078 (0.0005) [2023-12-28 01:44:07,908][106225] Updated weights for policy 1, policy_version 904088 (0.0005) [2023-12-28 01:44:08,091][106226] Updated weights for policy 0, policy_version 901838 (0.0008) [2023-12-28 01:44:08,139][106226] Updated weights for policy 0, policy_version 901848 (0.0009) [2023-12-28 01:44:08,189][106226] Updated weights for policy 0, policy_version 901858 (0.0009) [2023-12-28 01:44:08,545][106225] Updated weights for policy 1, policy_version 904098 (0.0006) [2023-12-28 01:44:08,597][106225] Updated weights for policy 1, policy_version 904108 (0.0006) [2023-12-28 01:44:08,651][106225] Updated weights for policy 1, policy_version 904118 (0.0006) [2023-12-28 01:44:08,702][106225] Updated weights for policy 1, policy_version 904128 (0.0005) [2023-12-28 01:44:09,020][106226] Updated weights for policy 0, policy_version 901868 (0.0009) [2023-12-28 01:44:09,067][106226] Updated weights for policy 0, policy_version 901878 (0.0008) [2023-12-28 01:44:09,117][106226] Updated weights for policy 0, policy_version 901888 (0.0008) [2023-12-28 01:44:09,396][106225] Updated weights for policy 1, policy_version 904138 (0.0010) [2023-12-28 01:44:09,458][106225] Updated weights for policy 1, policy_version 904148 (0.0008) [2023-12-28 01:44:09,518][106225] Updated weights for policy 1, policy_version 904158 (0.0008) [2023-12-28 01:44:09,957][106226] Updated weights for policy 0, policy_version 901898 (0.0009) [2023-12-28 01:44:10,018][106226] Updated weights for policy 0, policy_version 901908 (0.0009) [2023-12-28 01:44:10,078][106226] Updated weights for policy 0, policy_version 901918 (0.0007) [2023-12-28 01:44:10,150][106226] Updated weights for policy 0, policy_version 901928 (0.0008) [2023-12-28 01:44:10,288][106225] Updated weights for policy 1, policy_version 904168 (0.0008) [2023-12-28 01:44:10,353][106225] Updated weights for policy 1, policy_version 904178 (0.0007) [2023-12-28 01:44:10,412][106225] Updated weights for policy 1, policy_version 904188 (0.0010) [2023-12-28 01:44:10,837][106226] Updated weights for policy 0, policy_version 901938 (0.0005) [2023-12-28 01:44:10,903][106226] Updated weights for policy 0, policy_version 901948 (0.0006) [2023-12-28 01:44:10,968][106226] Updated weights for policy 0, policy_version 901958 (0.0010) [2023-12-28 01:44:11,069][106225] Updated weights for policy 1, policy_version 904198 (0.0009) [2023-12-28 01:44:11,128][106225] Updated weights for policy 1, policy_version 904208 (0.0010) [2023-12-28 01:44:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 462471168. Throughput: 0: 9893.7, 1: 9899.5. Samples: 462443580. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:11,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.833')] [2023-12-28 01:44:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000901960_230957056.pth... [2023-12-28 01:44:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000900840_230670336.pth [2023-12-28 01:44:11,190][106225] Updated weights for policy 1, policy_version 904218 (0.0009) [2023-12-28 01:44:11,227][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000904224_231522304.pth... [2023-12-28 01:44:11,232][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000903072_231227392.pth [2023-12-28 01:44:11,744][106226] Updated weights for policy 0, policy_version 901968 (0.0009) [2023-12-28 01:44:11,810][106226] Updated weights for policy 0, policy_version 901978 (0.0006) [2023-12-28 01:44:11,871][106226] Updated weights for policy 0, policy_version 901988 (0.0006) [2023-12-28 01:44:11,915][106225] Updated weights for policy 1, policy_version 904228 (0.0009) [2023-12-28 01:44:11,978][106225] Updated weights for policy 1, policy_version 904238 (0.0008) [2023-12-28 01:44:12,037][106225] Updated weights for policy 1, policy_version 904248 (0.0009) [2023-12-28 01:44:12,562][106226] Updated weights for policy 0, policy_version 901998 (0.0009) [2023-12-28 01:44:12,633][106226] Updated weights for policy 0, policy_version 902008 (0.0009) [2023-12-28 01:44:12,690][106226] Updated weights for policy 0, policy_version 902018 (0.0009) [2023-12-28 01:44:12,747][106225] Updated weights for policy 1, policy_version 904258 (0.0009) [2023-12-28 01:44:12,803][106225] Updated weights for policy 1, policy_version 904268 (0.0010) [2023-12-28 01:44:12,871][106225] Updated weights for policy 1, policy_version 904278 (0.0010) [2023-12-28 01:44:12,932][106225] Updated weights for policy 1, policy_version 904288 (0.0010) [2023-12-28 01:44:13,351][106226] Updated weights for policy 0, policy_version 902028 (0.0008) [2023-12-28 01:44:13,407][106226] Updated weights for policy 0, policy_version 902038 (0.0007) [2023-12-28 01:44:13,470][106226] Updated weights for policy 0, policy_version 902048 (0.0007) [2023-12-28 01:44:13,612][106225] Updated weights for policy 1, policy_version 904298 (0.0010) [2023-12-28 01:44:13,658][106225] Updated weights for policy 1, policy_version 904308 (0.0010) [2023-12-28 01:44:13,708][106225] Updated weights for policy 1, policy_version 904318 (0.0010) [2023-12-28 01:44:14,044][106226] Updated weights for policy 0, policy_version 902058 (0.0007) [2023-12-28 01:44:14,100][106226] Updated weights for policy 0, policy_version 902068 (0.0008) [2023-12-28 01:44:14,156][106226] Updated weights for policy 0, policy_version 902078 (0.0007) [2023-12-28 01:44:14,216][106226] Updated weights for policy 0, policy_version 902088 (0.0008) [2023-12-28 01:44:14,422][106225] Updated weights for policy 1, policy_version 904328 (0.0010) [2023-12-28 01:44:14,480][106225] Updated weights for policy 1, policy_version 904338 (0.0010) [2023-12-28 01:44:14,531][106225] Updated weights for policy 1, policy_version 904348 (0.0010) [2023-12-28 01:44:14,975][106226] Updated weights for policy 0, policy_version 902098 (0.0008) [2023-12-28 01:44:15,040][106226] Updated weights for policy 0, policy_version 902108 (0.0011) [2023-12-28 01:44:15,100][106226] Updated weights for policy 0, policy_version 902118 (0.0011) [2023-12-28 01:44:15,294][106225] Updated weights for policy 1, policy_version 904358 (0.0010) [2023-12-28 01:44:15,361][106225] Updated weights for policy 1, policy_version 904368 (0.0005) [2023-12-28 01:44:15,409][106225] Updated weights for policy 1, policy_version 904378 (0.0010) [2023-12-28 01:44:15,774][106226] Updated weights for policy 0, policy_version 902128 (0.0010) [2023-12-28 01:44:15,824][106226] Updated weights for policy 0, policy_version 902138 (0.0010) [2023-12-28 01:44:15,877][106226] Updated weights for policy 0, policy_version 902148 (0.0008) [2023-12-28 01:44:16,003][106225] Updated weights for policy 1, policy_version 904388 (0.0010) [2023-12-28 01:44:16,057][106225] Updated weights for policy 1, policy_version 904398 (0.0010) [2023-12-28 01:44:16,115][106225] Updated weights for policy 1, policy_version 904408 (0.0010) [2023-12-28 01:44:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 462577664. Throughput: 0: 9807.4, 1: 9853.0. Samples: 462560780. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:16,176][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.805')] [2023-12-28 01:44:16,550][106226] Updated weights for policy 0, policy_version 902158 (0.0006) [2023-12-28 01:44:16,607][106226] Updated weights for policy 0, policy_version 902168 (0.0006) [2023-12-28 01:44:16,665][106226] Updated weights for policy 0, policy_version 902178 (0.0008) [2023-12-28 01:44:16,809][106225] Updated weights for policy 1, policy_version 904418 (0.0010) [2023-12-28 01:44:16,858][106225] Updated weights for policy 1, policy_version 904428 (0.0009) [2023-12-28 01:44:16,901][106225] Updated weights for policy 1, policy_version 904438 (0.0006) [2023-12-28 01:44:16,954][106225] Updated weights for policy 1, policy_version 904448 (0.0007) [2023-12-28 01:44:17,411][106226] Updated weights for policy 0, policy_version 902188 (0.0009) [2023-12-28 01:44:17,469][106226] Updated weights for policy 0, policy_version 902198 (0.0008) [2023-12-28 01:44:17,540][106226] Updated weights for policy 0, policy_version 902208 (0.0007) [2023-12-28 01:44:17,579][106225] Updated weights for policy 1, policy_version 904458 (0.0006) [2023-12-28 01:44:17,633][106225] Updated weights for policy 1, policy_version 904468 (0.0005) [2023-12-28 01:44:17,684][106225] Updated weights for policy 1, policy_version 904478 (0.0005) [2023-12-28 01:44:18,274][106226] Updated weights for policy 0, policy_version 902218 (0.0007) [2023-12-28 01:44:18,302][106225] Updated weights for policy 1, policy_version 904488 (0.0007) [2023-12-28 01:44:18,341][106226] Updated weights for policy 0, policy_version 902228 (0.0008) [2023-12-28 01:44:18,372][106225] Updated weights for policy 1, policy_version 904498 (0.0007) [2023-12-28 01:44:18,410][106226] Updated weights for policy 0, policy_version 902238 (0.0009) [2023-12-28 01:44:18,434][106225] Updated weights for policy 1, policy_version 904508 (0.0006) [2023-12-28 01:44:18,473][106226] Updated weights for policy 0, policy_version 902248 (0.0006) [2023-12-28 01:44:19,129][106225] Updated weights for policy 1, policy_version 904518 (0.0006) [2023-12-28 01:44:19,182][106225] Updated weights for policy 1, policy_version 904528 (0.0005) [2023-12-28 01:44:19,219][106226] Updated weights for policy 0, policy_version 902258 (0.0009) [2023-12-28 01:44:19,245][106225] Updated weights for policy 1, policy_version 904538 (0.0007) [2023-12-28 01:44:19,282][106226] Updated weights for policy 0, policy_version 902268 (0.0010) [2023-12-28 01:44:19,345][106226] Updated weights for policy 0, policy_version 902278 (0.0011) [2023-12-28 01:44:19,911][106225] Updated weights for policy 1, policy_version 904548 (0.0007) [2023-12-28 01:44:19,980][106225] Updated weights for policy 1, policy_version 904558 (0.0008) [2023-12-28 01:44:20,039][106225] Updated weights for policy 1, policy_version 904568 (0.0007) [2023-12-28 01:44:20,071][106226] Updated weights for policy 0, policy_version 902288 (0.0009) [2023-12-28 01:44:20,154][106226] Updated weights for policy 0, policy_version 902298 (0.0011) [2023-12-28 01:44:20,209][106226] Updated weights for policy 0, policy_version 902308 (0.0011) [2023-12-28 01:44:20,748][106225] Updated weights for policy 1, policy_version 904578 (0.0006) [2023-12-28 01:44:20,809][106225] Updated weights for policy 1, policy_version 904588 (0.0008) [2023-12-28 01:44:20,870][106225] Updated weights for policy 1, policy_version 904598 (0.0008) [2023-12-28 01:44:20,883][106226] Updated weights for policy 0, policy_version 902318 (0.0010) [2023-12-28 01:44:20,932][106225] Updated weights for policy 1, policy_version 904608 (0.0006) [2023-12-28 01:44:20,945][106226] Updated weights for policy 0, policy_version 902328 (0.0011) [2023-12-28 01:44:21,000][106226] Updated weights for policy 0, policy_version 902338 (0.0011) [2023-12-28 01:44:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 462675968. Throughput: 0: 9668.8, 1: 9904.5. Samples: 462680596. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:21,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.942')] [2023-12-28 01:44:21,752][106225] Updated weights for policy 1, policy_version 904618 (0.0008) [2023-12-28 01:44:21,808][106225] Updated weights for policy 1, policy_version 904628 (0.0009) [2023-12-28 01:44:21,810][106226] Updated weights for policy 0, policy_version 902348 (0.0009) [2023-12-28 01:44:21,864][106225] Updated weights for policy 1, policy_version 904638 (0.0008) [2023-12-28 01:44:21,866][106226] Updated weights for policy 0, policy_version 902358 (0.0007) [2023-12-28 01:44:21,922][106226] Updated weights for policy 0, policy_version 902368 (0.0009) [2023-12-28 01:44:22,627][106225] Updated weights for policy 1, policy_version 904648 (0.0008) [2023-12-28 01:44:22,647][106226] Updated weights for policy 0, policy_version 902378 (0.0010) [2023-12-28 01:44:22,680][106225] Updated weights for policy 1, policy_version 904658 (0.0009) [2023-12-28 01:44:22,705][106226] Updated weights for policy 0, policy_version 902388 (0.0006) [2023-12-28 01:44:22,737][106225] Updated weights for policy 1, policy_version 904668 (0.0009) [2023-12-28 01:44:22,766][106226] Updated weights for policy 0, policy_version 902398 (0.0008) [2023-12-28 01:44:22,830][106226] Updated weights for policy 0, policy_version 902408 (0.0011) [2023-12-28 01:44:23,487][106226] Updated weights for policy 0, policy_version 902418 (0.0005) [2023-12-28 01:44:23,489][106225] Updated weights for policy 1, policy_version 904678 (0.0009) [2023-12-28 01:44:23,537][106226] Updated weights for policy 0, policy_version 902428 (0.0005) [2023-12-28 01:44:23,547][106225] Updated weights for policy 1, policy_version 904688 (0.0008) [2023-12-28 01:44:23,590][106226] Updated weights for policy 0, policy_version 902438 (0.0005) [2023-12-28 01:44:23,599][106225] Updated weights for policy 1, policy_version 904698 (0.0008) [2023-12-28 01:44:24,126][106226] Updated weights for policy 0, policy_version 902448 (0.0010) [2023-12-28 01:44:24,189][106226] Updated weights for policy 0, policy_version 902458 (0.0011) [2023-12-28 01:44:24,248][106226] Updated weights for policy 0, policy_version 902468 (0.0006) [2023-12-28 01:44:24,412][106225] Updated weights for policy 1, policy_version 904708 (0.0008) [2023-12-28 01:44:24,475][106225] Updated weights for policy 1, policy_version 904718 (0.0008) [2023-12-28 01:44:24,547][106225] Updated weights for policy 1, policy_version 904728 (0.0009) [2023-12-28 01:44:24,833][106226] Updated weights for policy 0, policy_version 902478 (0.0008) [2023-12-28 01:44:24,895][106226] Updated weights for policy 0, policy_version 902488 (0.0011) [2023-12-28 01:44:24,961][106226] Updated weights for policy 0, policy_version 902498 (0.0007) [2023-12-28 01:44:25,332][106225] Updated weights for policy 1, policy_version 904738 (0.0009) [2023-12-28 01:44:25,384][106225] Updated weights for policy 1, policy_version 904748 (0.0007) [2023-12-28 01:44:25,434][106225] Updated weights for policy 1, policy_version 904758 (0.0008) [2023-12-28 01:44:25,482][106225] Updated weights for policy 1, policy_version 904768 (0.0009) [2023-12-28 01:44:25,549][106226] Updated weights for policy 0, policy_version 902508 (0.0006) [2023-12-28 01:44:25,601][106226] Updated weights for policy 0, policy_version 902518 (0.0005) [2023-12-28 01:44:25,653][106226] Updated weights for policy 0, policy_version 902528 (0.0010) [2023-12-28 01:44:26,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 462766080. Throughput: 0: 9648.4, 1: 9859.9. Samples: 462738244. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:26,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.042')] [2023-12-28 01:44:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000902536_231104512.pth... [2023-12-28 01:44:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000904768_231661568.pth... [2023-12-28 01:44:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000901416_230817792.pth [2023-12-28 01:44:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000903648_231374848.pth [2023-12-28 01:44:26,250][106225] Updated weights for policy 1, policy_version 904778 (0.0007) [2023-12-28 01:44:26,299][106225] Updated weights for policy 1, policy_version 904788 (0.0008) [2023-12-28 01:44:26,343][106226] Updated weights for policy 0, policy_version 902538 (0.0010) [2023-12-28 01:44:26,353][106225] Updated weights for policy 1, policy_version 904798 (0.0007) [2023-12-28 01:44:26,390][106226] Updated weights for policy 0, policy_version 902548 (0.0010) [2023-12-28 01:44:26,432][106226] Updated weights for policy 0, policy_version 902558 (0.0010) [2023-12-28 01:44:26,479][106226] Updated weights for policy 0, policy_version 902568 (0.0010) [2023-12-28 01:44:27,082][106225] Updated weights for policy 1, policy_version 904808 (0.0007) [2023-12-28 01:44:27,131][106225] Updated weights for policy 1, policy_version 904818 (0.0008) [2023-12-28 01:44:27,182][106225] Updated weights for policy 1, policy_version 904828 (0.0007) [2023-12-28 01:44:27,228][106226] Updated weights for policy 0, policy_version 902578 (0.0010) [2023-12-28 01:44:27,273][106226] Updated weights for policy 0, policy_version 902588 (0.0010) [2023-12-28 01:44:27,336][106226] Updated weights for policy 0, policy_version 902598 (0.0010) [2023-12-28 01:44:27,915][106225] Updated weights for policy 1, policy_version 904838 (0.0007) [2023-12-28 01:44:27,963][106225] Updated weights for policy 1, policy_version 904848 (0.0007) [2023-12-28 01:44:28,015][106225] Updated weights for policy 1, policy_version 904858 (0.0007) [2023-12-28 01:44:28,051][106226] Updated weights for policy 0, policy_version 902608 (0.0010) [2023-12-28 01:44:28,106][106226] Updated weights for policy 0, policy_version 902618 (0.0010) [2023-12-28 01:44:28,156][106226] Updated weights for policy 0, policy_version 902628 (0.0010) [2023-12-28 01:44:28,711][106225] Updated weights for policy 1, policy_version 904868 (0.0009) [2023-12-28 01:44:28,764][106225] Updated weights for policy 1, policy_version 904878 (0.0007) [2023-12-28 01:44:28,820][106225] Updated weights for policy 1, policy_version 904888 (0.0007) [2023-12-28 01:44:28,863][106226] Updated weights for policy 0, policy_version 902638 (0.0010) [2023-12-28 01:44:28,912][106226] Updated weights for policy 0, policy_version 902648 (0.0007) [2023-12-28 01:44:28,964][106226] Updated weights for policy 0, policy_version 902658 (0.0005) [2023-12-28 01:44:29,548][106225] Updated weights for policy 1, policy_version 904898 (0.0005) [2023-12-28 01:44:29,608][106225] Updated weights for policy 1, policy_version 904908 (0.0007) [2023-12-28 01:44:29,610][106226] Updated weights for policy 0, policy_version 902668 (0.0006) [2023-12-28 01:44:29,666][106226] Updated weights for policy 0, policy_version 902678 (0.0006) [2023-12-28 01:44:29,668][106225] Updated weights for policy 1, policy_version 904918 (0.0006) [2023-12-28 01:44:29,726][106226] Updated weights for policy 0, policy_version 902688 (0.0005) [2023-12-28 01:44:29,730][106225] Updated weights for policy 1, policy_version 904928 (0.0008) [2023-12-28 01:44:30,323][106226] Updated weights for policy 0, policy_version 902698 (0.0005) [2023-12-28 01:44:30,384][106226] Updated weights for policy 0, policy_version 902708 (0.0007) [2023-12-28 01:44:30,446][106226] Updated weights for policy 0, policy_version 902718 (0.0009) [2023-12-28 01:44:30,494][106226] Updated weights for policy 0, policy_version 902728 (0.0008) [2023-12-28 01:44:30,511][106225] Updated weights for policy 1, policy_version 904938 (0.0007) [2023-12-28 01:44:30,571][106225] Updated weights for policy 1, policy_version 904948 (0.0008) [2023-12-28 01:44:30,619][106225] Updated weights for policy 1, policy_version 904958 (0.0010) [2023-12-28 01:44:31,087][106226] Updated weights for policy 0, policy_version 902738 (0.0008) [2023-12-28 01:44:31,163][106226] Updated weights for policy 0, policy_version 902748 (0.0008) [2023-12-28 01:44:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 462864384. Throughput: 0: 9763.4, 1: 9811.8. Samples: 462857828. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:31,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-5.041')] [2023-12-28 01:44:31,230][106226] Updated weights for policy 0, policy_version 902758 (0.0010) [2023-12-28 01:44:31,435][106225] Updated weights for policy 1, policy_version 904968 (0.0008) [2023-12-28 01:44:31,502][106225] Updated weights for policy 1, policy_version 904978 (0.0008) [2023-12-28 01:44:31,557][106225] Updated weights for policy 1, policy_version 904988 (0.0006) [2023-12-28 01:44:31,953][106226] Updated weights for policy 0, policy_version 902768 (0.0011) [2023-12-28 01:44:32,011][106226] Updated weights for policy 0, policy_version 902778 (0.0011) [2023-12-28 01:44:32,073][106226] Updated weights for policy 0, policy_version 902788 (0.0011) [2023-12-28 01:44:32,289][106225] Updated weights for policy 1, policy_version 904998 (0.0008) [2023-12-28 01:44:32,352][106225] Updated weights for policy 1, policy_version 905008 (0.0008) [2023-12-28 01:44:32,417][106225] Updated weights for policy 1, policy_version 905018 (0.0006) [2023-12-28 01:44:32,767][106226] Updated weights for policy 0, policy_version 902798 (0.0009) [2023-12-28 01:44:32,822][106226] Updated weights for policy 0, policy_version 902808 (0.0009) [2023-12-28 01:44:32,868][106226] Updated weights for policy 0, policy_version 902818 (0.0005) [2023-12-28 01:44:33,077][106225] Updated weights for policy 1, policy_version 905028 (0.0007) [2023-12-28 01:44:33,136][106225] Updated weights for policy 1, policy_version 905038 (0.0008) [2023-12-28 01:44:33,196][106225] Updated weights for policy 1, policy_version 905048 (0.0008) [2023-12-28 01:44:33,584][106226] Updated weights for policy 0, policy_version 902828 (0.0007) [2023-12-28 01:44:33,646][106226] Updated weights for policy 0, policy_version 902838 (0.0009) [2023-12-28 01:44:33,711][106226] Updated weights for policy 0, policy_version 902848 (0.0007) [2023-12-28 01:44:33,898][106225] Updated weights for policy 1, policy_version 905058 (0.0007) [2023-12-28 01:44:33,958][106225] Updated weights for policy 1, policy_version 905068 (0.0005) [2023-12-28 01:44:34,009][106225] Updated weights for policy 1, policy_version 905078 (0.0005) [2023-12-28 01:44:34,060][106225] Updated weights for policy 1, policy_version 905088 (0.0005) [2023-12-28 01:44:34,495][106226] Updated weights for policy 0, policy_version 902858 (0.0009) [2023-12-28 01:44:34,543][106226] Updated weights for policy 0, policy_version 902868 (0.0008) [2023-12-28 01:44:34,604][106226] Updated weights for policy 0, policy_version 902878 (0.0007) [2023-12-28 01:44:34,626][106225] Updated weights for policy 1, policy_version 905098 (0.0008) [2023-12-28 01:44:34,657][106226] Updated weights for policy 0, policy_version 902888 (0.0006) [2023-12-28 01:44:34,694][106225] Updated weights for policy 1, policy_version 905108 (0.0007) [2023-12-28 01:44:34,754][106225] Updated weights for policy 1, policy_version 905118 (0.0008) [2023-12-28 01:44:35,286][106226] Updated weights for policy 0, policy_version 902898 (0.0005) [2023-12-28 01:44:35,355][106226] Updated weights for policy 0, policy_version 902908 (0.0008) [2023-12-28 01:44:35,415][106226] Updated weights for policy 0, policy_version 902918 (0.0009) [2023-12-28 01:44:35,534][106225] Updated weights for policy 1, policy_version 905128 (0.0008) [2023-12-28 01:44:35,594][106225] Updated weights for policy 1, policy_version 905138 (0.0008) [2023-12-28 01:44:35,656][106225] Updated weights for policy 1, policy_version 905148 (0.0008) [2023-12-28 01:44:36,120][106226] Updated weights for policy 0, policy_version 902928 (0.0009) [2023-12-28 01:44:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 462962688. Throughput: 0: 9806.9, 1: 9792.3. Samples: 462976420. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:36,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-5.079')] [2023-12-28 01:44:36,185][106226] Updated weights for policy 0, policy_version 902938 (0.0008) [2023-12-28 01:44:36,249][106226] Updated weights for policy 0, policy_version 902948 (0.0009) [2023-12-28 01:44:36,374][106225] Updated weights for policy 1, policy_version 905158 (0.0008) [2023-12-28 01:44:36,434][106225] Updated weights for policy 1, policy_version 905168 (0.0010) [2023-12-28 01:44:36,496][106225] Updated weights for policy 1, policy_version 905178 (0.0007) [2023-12-28 01:44:36,887][106226] Updated weights for policy 0, policy_version 902958 (0.0007) [2023-12-28 01:44:36,941][106226] Updated weights for policy 0, policy_version 902968 (0.0005) [2023-12-28 01:44:37,006][106226] Updated weights for policy 0, policy_version 902978 (0.0009) [2023-12-28 01:44:37,208][106225] Updated weights for policy 1, policy_version 905188 (0.0007) [2023-12-28 01:44:37,274][106225] Updated weights for policy 1, policy_version 905198 (0.0008) [2023-12-28 01:44:37,338][106225] Updated weights for policy 1, policy_version 905208 (0.0008) [2023-12-28 01:44:37,679][106226] Updated weights for policy 0, policy_version 902988 (0.0011) [2023-12-28 01:44:37,732][106226] Updated weights for policy 0, policy_version 902998 (0.0010) [2023-12-28 01:44:37,792][106226] Updated weights for policy 0, policy_version 903008 (0.0011) [2023-12-28 01:44:38,042][106225] Updated weights for policy 1, policy_version 905218 (0.0008) [2023-12-28 01:44:38,108][106225] Updated weights for policy 1, policy_version 905228 (0.0007) [2023-12-28 01:44:38,174][106225] Updated weights for policy 1, policy_version 905238 (0.0007) [2023-12-28 01:44:38,232][106225] Updated weights for policy 1, policy_version 905248 (0.0007) [2023-12-28 01:44:38,462][106226] Updated weights for policy 0, policy_version 903018 (0.0011) [2023-12-28 01:44:38,527][106226] Updated weights for policy 0, policy_version 903028 (0.0008) [2023-12-28 01:44:38,584][106226] Updated weights for policy 0, policy_version 903038 (0.0008) [2023-12-28 01:44:38,642][106226] Updated weights for policy 0, policy_version 903048 (0.0011) [2023-12-28 01:44:38,989][106225] Updated weights for policy 1, policy_version 905258 (0.0006) [2023-12-28 01:44:39,058][106225] Updated weights for policy 1, policy_version 905268 (0.0006) [2023-12-28 01:44:39,121][106225] Updated weights for policy 1, policy_version 905278 (0.0009) [2023-12-28 01:44:39,282][106226] Updated weights for policy 0, policy_version 903058 (0.0008) [2023-12-28 01:44:39,343][106226] Updated weights for policy 0, policy_version 903068 (0.0008) [2023-12-28 01:44:39,411][106226] Updated weights for policy 0, policy_version 903078 (0.0009) [2023-12-28 01:44:39,812][106225] Updated weights for policy 1, policy_version 905288 (0.0010) [2023-12-28 01:44:39,878][106225] Updated weights for policy 1, policy_version 905298 (0.0009) [2023-12-28 01:44:39,938][106225] Updated weights for policy 1, policy_version 905308 (0.0011) [2023-12-28 01:44:40,205][106226] Updated weights for policy 0, policy_version 903088 (0.0008) [2023-12-28 01:44:40,268][106226] Updated weights for policy 0, policy_version 903098 (0.0008) [2023-12-28 01:44:40,331][106226] Updated weights for policy 0, policy_version 903108 (0.0008) [2023-12-28 01:44:40,664][106225] Updated weights for policy 1, policy_version 905318 (0.0010) [2023-12-28 01:44:40,710][106225] Updated weights for policy 1, policy_version 905328 (0.0010) [2023-12-28 01:44:40,760][106225] Updated weights for policy 1, policy_version 905338 (0.0010) [2023-12-28 01:44:41,137][106226] Updated weights for policy 0, policy_version 903118 (0.0009) [2023-12-28 01:44:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 463060992. Throughput: 0: 9910.0, 1: 9751.6. Samples: 463036720. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:41,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-5.128')] [2023-12-28 01:44:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000905344_231809024.pth... [2023-12-28 01:44:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000904224_231522304.pth [2023-12-28 01:44:41,199][106226] Updated weights for policy 0, policy_version 903128 (0.0008) [2023-12-28 01:44:41,259][106226] Updated weights for policy 0, policy_version 903138 (0.0009) [2023-12-28 01:44:41,291][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000903144_231260160.pth... [2023-12-28 01:44:41,295][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000901960_230957056.pth [2023-12-28 01:44:41,546][106225] Updated weights for policy 1, policy_version 905348 (0.0010) [2023-12-28 01:44:41,612][106225] Updated weights for policy 1, policy_version 905358 (0.0008) [2023-12-28 01:44:41,682][106225] Updated weights for policy 1, policy_version 905368 (0.0009) [2023-12-28 01:44:42,034][106226] Updated weights for policy 0, policy_version 903148 (0.0009) [2023-12-28 01:44:42,098][106226] Updated weights for policy 0, policy_version 903158 (0.0009) [2023-12-28 01:44:42,161][106226] Updated weights for policy 0, policy_version 903168 (0.0006) [2023-12-28 01:44:42,448][106225] Updated weights for policy 1, policy_version 905378 (0.0009) [2023-12-28 01:44:42,513][106225] Updated weights for policy 1, policy_version 905388 (0.0009) [2023-12-28 01:44:42,569][106225] Updated weights for policy 1, policy_version 905398 (0.0010) [2023-12-28 01:44:42,627][106225] Updated weights for policy 1, policy_version 905408 (0.0008) [2023-12-28 01:44:42,823][106226] Updated weights for policy 0, policy_version 903178 (0.0008) [2023-12-28 01:44:42,883][106226] Updated weights for policy 0, policy_version 903188 (0.0008) [2023-12-28 01:44:42,944][106226] Updated weights for policy 0, policy_version 903198 (0.0008) [2023-12-28 01:44:42,998][106226] Updated weights for policy 0, policy_version 903208 (0.0008) [2023-12-28 01:44:43,315][106225] Updated weights for policy 1, policy_version 905418 (0.0008) [2023-12-28 01:44:43,362][106225] Updated weights for policy 1, policy_version 905428 (0.0008) [2023-12-28 01:44:43,414][106225] Updated weights for policy 1, policy_version 905438 (0.0009) [2023-12-28 01:44:43,657][106226] Updated weights for policy 0, policy_version 903218 (0.0005) [2023-12-28 01:44:43,704][106226] Updated weights for policy 0, policy_version 903228 (0.0005) [2023-12-28 01:44:43,757][106226] Updated weights for policy 0, policy_version 903238 (0.0005) [2023-12-28 01:44:44,240][106225] Updated weights for policy 1, policy_version 905448 (0.0008) [2023-12-28 01:44:44,297][106225] Updated weights for policy 1, policy_version 905458 (0.0008) [2023-12-28 01:44:44,321][106226] Updated weights for policy 0, policy_version 903248 (0.0007) [2023-12-28 01:44:44,353][106225] Updated weights for policy 1, policy_version 905468 (0.0007) [2023-12-28 01:44:44,380][106226] Updated weights for policy 0, policy_version 903258 (0.0008) [2023-12-28 01:44:44,446][106226] Updated weights for policy 0, policy_version 903268 (0.0008) [2023-12-28 01:44:45,102][106225] Updated weights for policy 1, policy_version 905478 (0.0009) [2023-12-28 01:44:45,169][106225] Updated weights for policy 1, policy_version 905488 (0.0009) [2023-12-28 01:44:45,191][106226] Updated weights for policy 0, policy_version 903278 (0.0007) [2023-12-28 01:44:45,231][106225] Updated weights for policy 1, policy_version 905498 (0.0007) [2023-12-28 01:44:45,252][106226] Updated weights for policy 0, policy_version 903288 (0.0006) [2023-12-28 01:44:45,317][106226] Updated weights for policy 0, policy_version 903298 (0.0006) [2023-12-28 01:44:45,970][106225] Updated weights for policy 1, policy_version 905508 (0.0008) [2023-12-28 01:44:45,975][106226] Updated weights for policy 0, policy_version 903308 (0.0005) [2023-12-28 01:44:46,033][106225] Updated weights for policy 1, policy_version 905518 (0.0007) [2023-12-28 01:44:46,039][106226] Updated weights for policy 0, policy_version 903318 (0.0007) [2023-12-28 01:44:46,089][106225] Updated weights for policy 1, policy_version 905528 (0.0006) [2023-12-28 01:44:46,097][106226] Updated weights for policy 0, policy_version 903328 (0.0009) [2023-12-28 01:44:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 463167488. Throughput: 0: 9873.6, 1: 9726.5. Samples: 463150448. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:46,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.922')] [2023-12-28 01:44:46,783][106226] Updated weights for policy 0, policy_version 903338 (0.0008) [2023-12-28 01:44:46,811][106225] Updated weights for policy 1, policy_version 905538 (0.0006) [2023-12-28 01:44:46,840][106226] Updated weights for policy 0, policy_version 903348 (0.0008) [2023-12-28 01:44:46,858][106225] Updated weights for policy 1, policy_version 905548 (0.0006) [2023-12-28 01:44:46,895][106226] Updated weights for policy 0, policy_version 903358 (0.0007) [2023-12-28 01:44:46,905][106225] Updated weights for policy 1, policy_version 905558 (0.0006) [2023-12-28 01:44:46,953][106226] Updated weights for policy 0, policy_version 903368 (0.0006) [2023-12-28 01:44:46,963][106225] Updated weights for policy 1, policy_version 905568 (0.0008) [2023-12-28 01:44:47,678][106226] Updated weights for policy 0, policy_version 903378 (0.0008) [2023-12-28 01:44:47,692][106225] Updated weights for policy 1, policy_version 905578 (0.0005) [2023-12-28 01:44:47,739][106226] Updated weights for policy 0, policy_version 903388 (0.0008) [2023-12-28 01:44:47,750][106225] Updated weights for policy 1, policy_version 905588 (0.0006) [2023-12-28 01:44:47,798][106226] Updated weights for policy 0, policy_version 903398 (0.0008) [2023-12-28 01:44:47,800][106225] Updated weights for policy 1, policy_version 905598 (0.0005) [2023-12-28 01:44:48,535][106225] Updated weights for policy 1, policy_version 905608 (0.0007) [2023-12-28 01:44:48,538][106226] Updated weights for policy 0, policy_version 903408 (0.0005) [2023-12-28 01:44:48,595][106225] Updated weights for policy 1, policy_version 905618 (0.0008) [2023-12-28 01:44:48,596][106226] Updated weights for policy 0, policy_version 903418 (0.0006) [2023-12-28 01:44:48,650][106226] Updated weights for policy 0, policy_version 903428 (0.0005) [2023-12-28 01:44:48,656][106225] Updated weights for policy 1, policy_version 905628 (0.0008) [2023-12-28 01:44:49,349][106226] Updated weights for policy 0, policy_version 903438 (0.0008) [2023-12-28 01:44:49,382][106225] Updated weights for policy 1, policy_version 905638 (0.0007) [2023-12-28 01:44:49,412][106226] Updated weights for policy 0, policy_version 903448 (0.0007) [2023-12-28 01:44:49,438][106225] Updated weights for policy 1, policy_version 905648 (0.0007) [2023-12-28 01:44:49,463][106226] Updated weights for policy 0, policy_version 903458 (0.0007) [2023-12-28 01:44:49,493][106225] Updated weights for policy 1, policy_version 905658 (0.0006) [2023-12-28 01:44:50,141][106226] Updated weights for policy 0, policy_version 903468 (0.0007) [2023-12-28 01:44:50,211][106226] Updated weights for policy 0, policy_version 903478 (0.0006) [2023-12-28 01:44:50,279][106226] Updated weights for policy 0, policy_version 903488 (0.0007) [2023-12-28 01:44:50,324][106225] Updated weights for policy 1, policy_version 905668 (0.0007) [2023-12-28 01:44:50,384][106225] Updated weights for policy 1, policy_version 905678 (0.0007) [2023-12-28 01:44:50,447][106225] Updated weights for policy 1, policy_version 905688 (0.0008) [2023-12-28 01:44:50,922][106226] Updated weights for policy 0, policy_version 903498 (0.0010) [2023-12-28 01:44:51,001][106226] Updated weights for policy 0, policy_version 903508 (0.0011) [2023-12-28 01:44:51,066][106226] Updated weights for policy 0, policy_version 903518 (0.0009) [2023-12-28 01:44:51,134][106226] Updated weights for policy 0, policy_version 903528 (0.0007) [2023-12-28 01:44:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.4). Total num frames: 463257600. Throughput: 0: 9954.4, 1: 9647.7. Samples: 463265836. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:51,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-4.570')] [2023-12-28 01:44:51,248][106225] Updated weights for policy 1, policy_version 905698 (0.0008) [2023-12-28 01:44:51,313][106225] Updated weights for policy 1, policy_version 905708 (0.0008) [2023-12-28 01:44:51,385][106225] Updated weights for policy 1, policy_version 905718 (0.0009) [2023-12-28 01:44:51,453][106225] Updated weights for policy 1, policy_version 905728 (0.0008) [2023-12-28 01:44:51,883][106226] Updated weights for policy 0, policy_version 903538 (0.0009) [2023-12-28 01:44:51,952][106226] Updated weights for policy 0, policy_version 903548 (0.0007) [2023-12-28 01:44:52,014][106226] Updated weights for policy 0, policy_version 903558 (0.0010) [2023-12-28 01:44:52,165][106225] Updated weights for policy 1, policy_version 905738 (0.0008) [2023-12-28 01:44:52,224][106225] Updated weights for policy 1, policy_version 905748 (0.0008) [2023-12-28 01:44:52,291][106225] Updated weights for policy 1, policy_version 905758 (0.0009) [2023-12-28 01:44:52,706][106226] Updated weights for policy 0, policy_version 903568 (0.0009) [2023-12-28 01:44:52,772][106226] Updated weights for policy 0, policy_version 903578 (0.0009) [2023-12-28 01:44:52,831][106226] Updated weights for policy 0, policy_version 903588 (0.0008) [2023-12-28 01:44:53,030][106225] Updated weights for policy 1, policy_version 905768 (0.0006) [2023-12-28 01:44:53,079][106225] Updated weights for policy 1, policy_version 905778 (0.0005) [2023-12-28 01:44:53,129][106225] Updated weights for policy 1, policy_version 905788 (0.0005) [2023-12-28 01:44:53,578][106226] Updated weights for policy 0, policy_version 903598 (0.0009) [2023-12-28 01:44:53,632][106226] Updated weights for policy 0, policy_version 903608 (0.0008) [2023-12-28 01:44:53,682][106226] Updated weights for policy 0, policy_version 903618 (0.0009) [2023-12-28 01:44:53,778][106225] Updated weights for policy 1, policy_version 905798 (0.0008) [2023-12-28 01:44:53,826][106225] Updated weights for policy 1, policy_version 905808 (0.0008) [2023-12-28 01:44:53,874][106225] Updated weights for policy 1, policy_version 905818 (0.0008) [2023-12-28 01:44:54,476][106226] Updated weights for policy 0, policy_version 903628 (0.0009) [2023-12-28 01:44:54,500][106225] Updated weights for policy 1, policy_version 905828 (0.0007) [2023-12-28 01:44:54,529][106226] Updated weights for policy 0, policy_version 903638 (0.0007) [2023-12-28 01:44:54,561][106225] Updated weights for policy 1, policy_version 905838 (0.0007) [2023-12-28 01:44:54,588][106226] Updated weights for policy 0, policy_version 903648 (0.0007) [2023-12-28 01:44:54,611][106225] Updated weights for policy 1, policy_version 905848 (0.0007) [2023-12-28 01:44:55,205][106225] Updated weights for policy 1, policy_version 905858 (0.0008) [2023-12-28 01:44:55,257][106225] Updated weights for policy 1, policy_version 905868 (0.0010) [2023-12-28 01:44:55,327][106225] Updated weights for policy 1, policy_version 905878 (0.0010) [2023-12-28 01:44:55,349][106226] Updated weights for policy 0, policy_version 903658 (0.0007) [2023-12-28 01:44:55,377][106225] Updated weights for policy 1, policy_version 905888 (0.0010) [2023-12-28 01:44:55,409][106226] Updated weights for policy 0, policy_version 903668 (0.0007) [2023-12-28 01:44:55,471][106226] Updated weights for policy 0, policy_version 903678 (0.0008) [2023-12-28 01:44:55,539][106226] Updated weights for policy 0, policy_version 903688 (0.0008) [2023-12-28 01:44:56,080][106225] Updated weights for policy 1, policy_version 905898 (0.0010) [2023-12-28 01:44:56,133][106225] Updated weights for policy 1, policy_version 905908 (0.0010) [2023-12-28 01:44:56,149][106226] Updated weights for policy 0, policy_version 903698 (0.0011) [2023-12-28 01:44:56,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 463347712. Throughput: 0: 9946.8, 1: 9590.0. Samples: 463322736. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:44:56,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.982')] [2023-12-28 01:44:56,190][106225] Updated weights for policy 1, policy_version 905918 (0.0010) [2023-12-28 01:44:56,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000905920_231956480.pth... [2023-12-28 01:44:56,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000904768_231661568.pth [2023-12-28 01:44:56,208][106226] Updated weights for policy 0, policy_version 903708 (0.0011) [2023-12-28 01:44:56,267][106226] Updated weights for policy 0, policy_version 903718 (0.0008) [2023-12-28 01:44:56,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000903720_231407616.pth... [2023-12-28 01:44:56,286][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000902536_231104512.pth [2023-12-28 01:44:56,769][106225] Updated weights for policy 1, policy_version 905928 (0.0010) [2023-12-28 01:44:56,833][106225] Updated weights for policy 1, policy_version 905938 (0.0010) [2023-12-28 01:44:56,887][106225] Updated weights for policy 1, policy_version 905948 (0.0010) [2023-12-28 01:44:56,956][106226] Updated weights for policy 0, policy_version 903728 (0.0007) [2023-12-28 01:44:57,012][106226] Updated weights for policy 0, policy_version 903738 (0.0008) [2023-12-28 01:44:57,065][106226] Updated weights for policy 0, policy_version 903748 (0.0008) [2023-12-28 01:44:57,604][106225] Updated weights for policy 1, policy_version 905958 (0.0010) [2023-12-28 01:44:57,648][106225] Updated weights for policy 1, policy_version 905968 (0.0008) [2023-12-28 01:44:57,701][106225] Updated weights for policy 1, policy_version 905978 (0.0009) [2023-12-28 01:44:57,708][106226] Updated weights for policy 0, policy_version 903758 (0.0007) [2023-12-28 01:44:57,773][106226] Updated weights for policy 0, policy_version 903768 (0.0008) [2023-12-28 01:44:57,833][106226] Updated weights for policy 0, policy_version 903778 (0.0011) [2023-12-28 01:44:58,469][106225] Updated weights for policy 1, policy_version 905988 (0.0009) [2023-12-28 01:44:58,526][106226] Updated weights for policy 0, policy_version 903788 (0.0010) [2023-12-28 01:44:58,529][106225] Updated weights for policy 1, policy_version 905998 (0.0008) [2023-12-28 01:44:58,588][106226] Updated weights for policy 0, policy_version 903798 (0.0009) [2023-12-28 01:44:58,592][106225] Updated weights for policy 1, policy_version 906008 (0.0008) [2023-12-28 01:44:58,653][106226] Updated weights for policy 0, policy_version 903808 (0.0008) [2023-12-28 01:44:59,359][106225] Updated weights for policy 1, policy_version 906018 (0.0007) [2023-12-28 01:44:59,415][106225] Updated weights for policy 1, policy_version 906028 (0.0007) [2023-12-28 01:44:59,421][106226] Updated weights for policy 0, policy_version 903818 (0.0009) [2023-12-28 01:44:59,465][106225] Updated weights for policy 1, policy_version 906038 (0.0009) [2023-12-28 01:44:59,481][106226] Updated weights for policy 0, policy_version 903828 (0.0006) [2023-12-28 01:44:59,511][106225] Updated weights for policy 1, policy_version 906048 (0.0005) [2023-12-28 01:44:59,532][106226] Updated weights for policy 0, policy_version 903838 (0.0009) [2023-12-28 01:44:59,585][106226] Updated weights for policy 0, policy_version 903848 (0.0009) [2023-12-28 01:45:00,187][106225] Updated weights for policy 1, policy_version 906058 (0.0006) [2023-12-28 01:45:00,242][106225] Updated weights for policy 1, policy_version 906068 (0.0008) [2023-12-28 01:45:00,298][106225] Updated weights for policy 1, policy_version 906078 (0.0008) [2023-12-28 01:45:00,395][106226] Updated weights for policy 0, policy_version 903858 (0.0008) [2023-12-28 01:45:00,454][106226] Updated weights for policy 0, policy_version 903868 (0.0009) [2023-12-28 01:45:00,504][106226] Updated weights for policy 0, policy_version 903878 (0.0008) [2023-12-28 01:45:00,896][106225] Updated weights for policy 1, policy_version 906088 (0.0006) [2023-12-28 01:45:00,951][106225] Updated weights for policy 1, policy_version 906098 (0.0005) [2023-12-28 01:45:01,010][106225] Updated weights for policy 1, policy_version 906108 (0.0010) [2023-12-28 01:45:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 463454208. Throughput: 0: 9915.8, 1: 9660.7. Samples: 463441720. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:01,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.935')] [2023-12-28 01:45:01,216][106226] Updated weights for policy 0, policy_version 903888 (0.0009) [2023-12-28 01:45:01,278][106226] Updated weights for policy 0, policy_version 903898 (0.0008) [2023-12-28 01:45:01,337][106226] Updated weights for policy 0, policy_version 903908 (0.0005) [2023-12-28 01:45:01,734][106225] Updated weights for policy 1, policy_version 906118 (0.0008) [2023-12-28 01:45:01,801][106225] Updated weights for policy 1, policy_version 906128 (0.0005) [2023-12-28 01:45:01,865][106225] Updated weights for policy 1, policy_version 906138 (0.0007) [2023-12-28 01:45:02,057][106226] Updated weights for policy 0, policy_version 903918 (0.0009) [2023-12-28 01:45:02,122][106226] Updated weights for policy 0, policy_version 903928 (0.0008) [2023-12-28 01:45:02,186][106226] Updated weights for policy 0, policy_version 903938 (0.0009) [2023-12-28 01:45:02,578][106225] Updated weights for policy 1, policy_version 906148 (0.0009) [2023-12-28 01:45:02,631][106225] Updated weights for policy 1, policy_version 906158 (0.0005) [2023-12-28 01:45:02,685][106225] Updated weights for policy 1, policy_version 906168 (0.0005) [2023-12-28 01:45:02,938][106226] Updated weights for policy 0, policy_version 903948 (0.0008) [2023-12-28 01:45:02,985][106226] Updated weights for policy 0, policy_version 903958 (0.0008) [2023-12-28 01:45:03,029][106226] Updated weights for policy 0, policy_version 903968 (0.0006) [2023-12-28 01:45:03,324][106225] Updated weights for policy 1, policy_version 906178 (0.0005) [2023-12-28 01:45:03,382][106225] Updated weights for policy 1, policy_version 906188 (0.0009) [2023-12-28 01:45:03,432][106225] Updated weights for policy 1, policy_version 906198 (0.0009) [2023-12-28 01:45:03,494][106225] Updated weights for policy 1, policy_version 906208 (0.0006) [2023-12-28 01:45:03,757][106226] Updated weights for policy 0, policy_version 903978 (0.0008) [2023-12-28 01:45:03,815][106226] Updated weights for policy 0, policy_version 903988 (0.0008) [2023-12-28 01:45:03,874][106226] Updated weights for policy 0, policy_version 903998 (0.0007) [2023-12-28 01:45:03,931][106226] Updated weights for policy 0, policy_version 904008 (0.0008) [2023-12-28 01:45:04,243][106225] Updated weights for policy 1, policy_version 906218 (0.0008) [2023-12-28 01:45:04,309][106225] Updated weights for policy 1, policy_version 906228 (0.0006) [2023-12-28 01:45:04,368][106225] Updated weights for policy 1, policy_version 906238 (0.0005) [2023-12-28 01:45:04,733][106226] Updated weights for policy 0, policy_version 904018 (0.0005) [2023-12-28 01:45:04,787][106226] Updated weights for policy 0, policy_version 904028 (0.0005) [2023-12-28 01:45:04,837][106226] Updated weights for policy 0, policy_version 904038 (0.0005) [2023-12-28 01:45:04,993][106225] Updated weights for policy 1, policy_version 906248 (0.0006) [2023-12-28 01:45:05,059][106225] Updated weights for policy 1, policy_version 906258 (0.0008) [2023-12-28 01:45:05,122][106225] Updated weights for policy 1, policy_version 906268 (0.0009) [2023-12-28 01:45:05,348][106226] Updated weights for policy 0, policy_version 904048 (0.0005) [2023-12-28 01:45:05,403][106226] Updated weights for policy 0, policy_version 904058 (0.0007) [2023-12-28 01:45:05,450][106226] Updated weights for policy 0, policy_version 904068 (0.0008) [2023-12-28 01:45:05,823][106225] Updated weights for policy 1, policy_version 906278 (0.0007) [2023-12-28 01:45:05,889][106225] Updated weights for policy 1, policy_version 906288 (0.0008) [2023-12-28 01:45:05,947][106225] Updated weights for policy 1, policy_version 906298 (0.0009) [2023-12-28 01:45:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 463552512. Throughput: 0: 9955.6, 1: 9628.7. Samples: 463561892. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:06,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.963')] [2023-12-28 01:45:06,212][106226] Updated weights for policy 0, policy_version 904078 (0.0009) [2023-12-28 01:45:06,283][106226] Updated weights for policy 0, policy_version 904088 (0.0007) [2023-12-28 01:45:06,343][106226] Updated weights for policy 0, policy_version 904098 (0.0008) [2023-12-28 01:45:06,606][106225] Updated weights for policy 1, policy_version 906308 (0.0008) [2023-12-28 01:45:06,675][106225] Updated weights for policy 1, policy_version 906318 (0.0009) [2023-12-28 01:45:06,738][106225] Updated weights for policy 1, policy_version 906328 (0.0010) [2023-12-28 01:45:07,039][106226] Updated weights for policy 0, policy_version 904108 (0.0009) [2023-12-28 01:45:07,087][106226] Updated weights for policy 0, policy_version 904118 (0.0009) [2023-12-28 01:45:07,150][106226] Updated weights for policy 0, policy_version 904128 (0.0008) [2023-12-28 01:45:07,419][106225] Updated weights for policy 1, policy_version 906338 (0.0009) [2023-12-28 01:45:07,476][106225] Updated weights for policy 1, policy_version 906348 (0.0006) [2023-12-28 01:45:07,526][106225] Updated weights for policy 1, policy_version 906358 (0.0006) [2023-12-28 01:45:07,581][106225] Updated weights for policy 1, policy_version 906368 (0.0005) [2023-12-28 01:45:07,850][106226] Updated weights for policy 0, policy_version 904138 (0.0008) [2023-12-28 01:45:07,906][106226] Updated weights for policy 0, policy_version 904148 (0.0005) [2023-12-28 01:45:07,960][106226] Updated weights for policy 0, policy_version 904158 (0.0005) [2023-12-28 01:45:08,012][106226] Updated weights for policy 0, policy_version 904168 (0.0005) [2023-12-28 01:45:08,209][106225] Updated weights for policy 1, policy_version 906378 (0.0009) [2023-12-28 01:45:08,270][106225] Updated weights for policy 1, policy_version 906388 (0.0010) [2023-12-28 01:45:08,321][106225] Updated weights for policy 1, policy_version 906398 (0.0008) [2023-12-28 01:45:08,633][106226] Updated weights for policy 0, policy_version 904178 (0.0008) [2023-12-28 01:45:08,689][106226] Updated weights for policy 0, policy_version 904188 (0.0009) [2023-12-28 01:45:08,749][106226] Updated weights for policy 0, policy_version 904198 (0.0009) [2023-12-28 01:45:09,043][106225] Updated weights for policy 1, policy_version 906408 (0.0009) [2023-12-28 01:45:09,108][106225] Updated weights for policy 1, policy_version 906418 (0.0009) [2023-12-28 01:45:09,164][106225] Updated weights for policy 1, policy_version 906428 (0.0008) [2023-12-28 01:45:09,498][106226] Updated weights for policy 0, policy_version 904208 (0.0009) [2023-12-28 01:45:09,552][106226] Updated weights for policy 0, policy_version 904218 (0.0008) [2023-12-28 01:45:09,608][106226] Updated weights for policy 0, policy_version 904228 (0.0009) [2023-12-28 01:45:09,975][106225] Updated weights for policy 1, policy_version 906438 (0.0009) [2023-12-28 01:45:10,038][106225] Updated weights for policy 1, policy_version 906448 (0.0008) [2023-12-28 01:45:10,088][106225] Updated weights for policy 1, policy_version 906458 (0.0005) [2023-12-28 01:45:10,321][106226] Updated weights for policy 0, policy_version 904238 (0.0008) [2023-12-28 01:45:10,392][106226] Updated weights for policy 0, policy_version 904248 (0.0006) [2023-12-28 01:45:10,450][106226] Updated weights for policy 0, policy_version 904258 (0.0008) [2023-12-28 01:45:10,779][106225] Updated weights for policy 1, policy_version 906468 (0.0009) [2023-12-28 01:45:10,839][106225] Updated weights for policy 1, policy_version 906478 (0.0009) [2023-12-28 01:45:10,898][106225] Updated weights for policy 1, policy_version 906488 (0.0008) [2023-12-28 01:45:11,144][106226] Updated weights for policy 0, policy_version 904268 (0.0006) [2023-12-28 01:45:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 463650816. Throughput: 0: 9933.7, 1: 9720.0. Samples: 463622660. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:11,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-5.135')] [2023-12-28 01:45:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000906496_232103936.pth... [2023-12-28 01:45:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000905344_231809024.pth [2023-12-28 01:45:11,203][106226] Updated weights for policy 0, policy_version 904278 (0.0007) [2023-12-28 01:45:11,272][106226] Updated weights for policy 0, policy_version 904288 (0.0007) [2023-12-28 01:45:11,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000904296_231555072.pth... [2023-12-28 01:45:11,326][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000903144_231260160.pth [2023-12-28 01:45:11,675][106225] Updated weights for policy 1, policy_version 906498 (0.0008) [2023-12-28 01:45:11,744][106225] Updated weights for policy 1, policy_version 906508 (0.0008) [2023-12-28 01:45:11,810][106225] Updated weights for policy 1, policy_version 906518 (0.0007) [2023-12-28 01:45:11,866][106225] Updated weights for policy 1, policy_version 906528 (0.0008) [2023-12-28 01:45:12,054][106226] Updated weights for policy 0, policy_version 904298 (0.0008) [2023-12-28 01:45:12,117][106226] Updated weights for policy 0, policy_version 904308 (0.0008) [2023-12-28 01:45:12,181][106226] Updated weights for policy 0, policy_version 904318 (0.0008) [2023-12-28 01:45:12,237][106226] Updated weights for policy 0, policy_version 904328 (0.0008) [2023-12-28 01:45:12,646][106225] Updated weights for policy 1, policy_version 906538 (0.0008) [2023-12-28 01:45:12,706][106225] Updated weights for policy 1, policy_version 906548 (0.0007) [2023-12-28 01:45:12,763][106225] Updated weights for policy 1, policy_version 906558 (0.0008) [2023-12-28 01:45:12,969][106226] Updated weights for policy 0, policy_version 904338 (0.0011) [2023-12-28 01:45:13,032][106226] Updated weights for policy 0, policy_version 904348 (0.0010) [2023-12-28 01:45:13,091][106226] Updated weights for policy 0, policy_version 904358 (0.0010) [2023-12-28 01:45:13,485][106225] Updated weights for policy 1, policy_version 906568 (0.0007) [2023-12-28 01:45:13,545][106225] Updated weights for policy 1, policy_version 906578 (0.0005) [2023-12-28 01:45:13,606][106225] Updated weights for policy 1, policy_version 906588 (0.0007) [2023-12-28 01:45:13,788][106226] Updated weights for policy 0, policy_version 904368 (0.0011) [2023-12-28 01:45:13,844][106226] Updated weights for policy 0, policy_version 904378 (0.0010) [2023-12-28 01:45:13,903][106226] Updated weights for policy 0, policy_version 904388 (0.0010) [2023-12-28 01:45:14,279][106225] Updated weights for policy 1, policy_version 906598 (0.0007) [2023-12-28 01:45:14,328][106225] Updated weights for policy 1, policy_version 906608 (0.0008) [2023-12-28 01:45:14,384][106225] Updated weights for policy 1, policy_version 906618 (0.0008) [2023-12-28 01:45:14,609][106226] Updated weights for policy 0, policy_version 904398 (0.0008) [2023-12-28 01:45:14,663][106226] Updated weights for policy 0, policy_version 904408 (0.0008) [2023-12-28 01:45:14,717][106226] Updated weights for policy 0, policy_version 904418 (0.0007) [2023-12-28 01:45:15,058][106225] Updated weights for policy 1, policy_version 906628 (0.0009) [2023-12-28 01:45:15,127][106225] Updated weights for policy 1, policy_version 906638 (0.0008) [2023-12-28 01:45:15,194][106225] Updated weights for policy 1, policy_version 906648 (0.0008) [2023-12-28 01:45:15,427][106226] Updated weights for policy 0, policy_version 904428 (0.0009) [2023-12-28 01:45:15,479][106226] Updated weights for policy 0, policy_version 904438 (0.0009) [2023-12-28 01:45:15,526][106226] Updated weights for policy 0, policy_version 904448 (0.0008) [2023-12-28 01:45:15,800][106225] Updated weights for policy 1, policy_version 906658 (0.0009) [2023-12-28 01:45:15,856][106225] Updated weights for policy 1, policy_version 906668 (0.0008) [2023-12-28 01:45:15,920][106225] Updated weights for policy 1, policy_version 906678 (0.0005) [2023-12-28 01:45:15,984][106225] Updated weights for policy 1, policy_version 906688 (0.0005) [2023-12-28 01:45:16,102][106226] Updated weights for policy 0, policy_version 904458 (0.0005) [2023-12-28 01:45:16,168][106226] Updated weights for policy 0, policy_version 904468 (0.0005) [2023-12-28 01:45:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 463749120. Throughput: 0: 9818.1, 1: 9724.8. Samples: 463737260. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:16,176][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.633')] [2023-12-28 01:45:16,234][106226] Updated weights for policy 0, policy_version 904478 (0.0005) [2023-12-28 01:45:16,302][106226] Updated weights for policy 0, policy_version 904488 (0.0006) [2023-12-28 01:45:16,701][106225] Updated weights for policy 1, policy_version 906698 (0.0005) [2023-12-28 01:45:16,757][106225] Updated weights for policy 1, policy_version 906708 (0.0005) [2023-12-28 01:45:16,813][106225] Updated weights for policy 1, policy_version 906718 (0.0005) [2023-12-28 01:45:16,815][106226] Updated weights for policy 0, policy_version 904498 (0.0011) [2023-12-28 01:45:16,861][106226] Updated weights for policy 0, policy_version 904508 (0.0010) [2023-12-28 01:45:16,914][106226] Updated weights for policy 0, policy_version 904518 (0.0010) [2023-12-28 01:45:17,417][106225] Updated weights for policy 1, policy_version 906728 (0.0009) [2023-12-28 01:45:17,463][106225] Updated weights for policy 1, policy_version 906738 (0.0010) [2023-12-28 01:45:17,510][106225] Updated weights for policy 1, policy_version 906748 (0.0010) [2023-12-28 01:45:17,634][106226] Updated weights for policy 0, policy_version 904528 (0.0011) [2023-12-28 01:45:17,692][106226] Updated weights for policy 0, policy_version 904538 (0.0011) [2023-12-28 01:45:17,746][106226] Updated weights for policy 0, policy_version 904548 (0.0010) [2023-12-28 01:45:18,210][106225] Updated weights for policy 1, policy_version 906758 (0.0010) [2023-12-28 01:45:18,270][106225] Updated weights for policy 1, policy_version 906768 (0.0010) [2023-12-28 01:45:18,326][106225] Updated weights for policy 1, policy_version 906778 (0.0010) [2023-12-28 01:45:18,496][106226] Updated weights for policy 0, policy_version 904558 (0.0009) [2023-12-28 01:45:18,551][106226] Updated weights for policy 0, policy_version 904568 (0.0008) [2023-12-28 01:45:18,606][106226] Updated weights for policy 0, policy_version 904578 (0.0008) [2023-12-28 01:45:19,040][106225] Updated weights for policy 1, policy_version 906788 (0.0007) [2023-12-28 01:45:19,103][106225] Updated weights for policy 1, policy_version 906798 (0.0010) [2023-12-28 01:45:19,165][106225] Updated weights for policy 1, policy_version 906808 (0.0010) [2023-12-28 01:45:19,277][106226] Updated weights for policy 0, policy_version 904588 (0.0008) [2023-12-28 01:45:19,342][106226] Updated weights for policy 0, policy_version 904598 (0.0008) [2023-12-28 01:45:19,403][106226] Updated weights for policy 0, policy_version 904608 (0.0008) [2023-12-28 01:45:19,852][106225] Updated weights for policy 1, policy_version 906818 (0.0007) [2023-12-28 01:45:19,912][106225] Updated weights for policy 1, policy_version 906828 (0.0008) [2023-12-28 01:45:19,982][106225] Updated weights for policy 1, policy_version 906838 (0.0006) [2023-12-28 01:45:20,046][106225] Updated weights for policy 1, policy_version 906848 (0.0007) [2023-12-28 01:45:20,186][106226] Updated weights for policy 0, policy_version 904618 (0.0007) [2023-12-28 01:45:20,250][106226] Updated weights for policy 0, policy_version 904628 (0.0009) [2023-12-28 01:45:20,310][106226] Updated weights for policy 0, policy_version 904638 (0.0008) [2023-12-28 01:45:20,375][106226] Updated weights for policy 0, policy_version 904648 (0.0008) [2023-12-28 01:45:20,767][106225] Updated weights for policy 1, policy_version 906858 (0.0008) [2023-12-28 01:45:20,826][106225] Updated weights for policy 1, policy_version 906868 (0.0008) [2023-12-28 01:45:20,888][106225] Updated weights for policy 1, policy_version 906878 (0.0008) [2023-12-28 01:45:21,156][106226] Updated weights for policy 0, policy_version 904658 (0.0008) [2023-12-28 01:45:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 463847424. Throughput: 0: 9816.5, 1: 9787.6. Samples: 463858608. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:21,175][105115] Avg episode reward: [(0, '-4.210'), (1, '-5.146')] [2023-12-28 01:45:21,224][106226] Updated weights for policy 0, policy_version 904668 (0.0008) [2023-12-28 01:45:21,294][106226] Updated weights for policy 0, policy_version 904678 (0.0007) [2023-12-28 01:45:21,697][106225] Updated weights for policy 1, policy_version 906888 (0.0007) [2023-12-28 01:45:21,775][106225] Updated weights for policy 1, policy_version 906898 (0.0009) [2023-12-28 01:45:21,843][106225] Updated weights for policy 1, policy_version 906908 (0.0010) [2023-12-28 01:45:21,975][106226] Updated weights for policy 0, policy_version 904688 (0.0008) [2023-12-28 01:45:22,029][106226] Updated weights for policy 0, policy_version 904698 (0.0009) [2023-12-28 01:45:22,089][106226] Updated weights for policy 0, policy_version 904708 (0.0009) [2023-12-28 01:45:22,608][106225] Updated weights for policy 1, policy_version 906918 (0.0009) [2023-12-28 01:45:22,671][106225] Updated weights for policy 1, policy_version 906928 (0.0009) [2023-12-28 01:45:22,724][106225] Updated weights for policy 1, policy_version 906938 (0.0008) [2023-12-28 01:45:22,825][106226] Updated weights for policy 0, policy_version 904718 (0.0008) [2023-12-28 01:45:22,881][106226] Updated weights for policy 0, policy_version 904728 (0.0009) [2023-12-28 01:45:22,944][106226] Updated weights for policy 0, policy_version 904738 (0.0009) [2023-12-28 01:45:23,542][106225] Updated weights for policy 1, policy_version 906948 (0.0008) [2023-12-28 01:45:23,543][106226] Updated weights for policy 0, policy_version 904748 (0.0008) [2023-12-28 01:45:23,595][106225] Updated weights for policy 1, policy_version 906958 (0.0006) [2023-12-28 01:45:23,598][106226] Updated weights for policy 0, policy_version 904758 (0.0006) [2023-12-28 01:45:23,647][106225] Updated weights for policy 1, policy_version 906968 (0.0007) [2023-12-28 01:45:23,653][106226] Updated weights for policy 0, policy_version 904768 (0.0006) [2023-12-28 01:45:24,353][106225] Updated weights for policy 1, policy_version 906978 (0.0008) [2023-12-28 01:45:24,397][106226] Updated weights for policy 0, policy_version 904778 (0.0007) [2023-12-28 01:45:24,412][106225] Updated weights for policy 1, policy_version 906988 (0.0008) [2023-12-28 01:45:24,453][106226] Updated weights for policy 0, policy_version 904788 (0.0007) [2023-12-28 01:45:24,473][106225] Updated weights for policy 1, policy_version 906998 (0.0007) [2023-12-28 01:45:24,511][106226] Updated weights for policy 0, policy_version 904798 (0.0006) [2023-12-28 01:45:24,528][106225] Updated weights for policy 1, policy_version 907008 (0.0007) [2023-12-28 01:45:24,570][106226] Updated weights for policy 0, policy_version 904808 (0.0007) [2023-12-28 01:45:25,180][106225] Updated weights for policy 1, policy_version 907018 (0.0005) [2023-12-28 01:45:25,230][106225] Updated weights for policy 1, policy_version 907028 (0.0005) [2023-12-28 01:45:25,282][106225] Updated weights for policy 1, policy_version 907038 (0.0005) [2023-12-28 01:45:25,356][106226] Updated weights for policy 0, policy_version 904818 (0.0008) [2023-12-28 01:45:25,415][106226] Updated weights for policy 0, policy_version 904828 (0.0009) [2023-12-28 01:45:25,469][106226] Updated weights for policy 0, policy_version 904838 (0.0009) [2023-12-28 01:45:25,916][106225] Updated weights for policy 1, policy_version 907048 (0.0008) [2023-12-28 01:45:25,965][106225] Updated weights for policy 1, policy_version 907058 (0.0007) [2023-12-28 01:45:26,013][106225] Updated weights for policy 1, policy_version 907068 (0.0008) [2023-12-28 01:45:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 463945728. Throughput: 0: 9778.2, 1: 9730.7. Samples: 463914624. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:26,176][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.008')] [2023-12-28 01:45:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000907072_232251392.pth... [2023-12-28 01:45:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000905920_231956480.pth [2023-12-28 01:45:26,194][106226] Updated weights for policy 0, policy_version 904848 (0.0009) [2023-12-28 01:45:26,243][106226] Updated weights for policy 0, policy_version 904858 (0.0009) [2023-12-28 01:45:26,296][106226] Updated weights for policy 0, policy_version 904868 (0.0008) [2023-12-28 01:45:26,316][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000904872_231702528.pth... [2023-12-28 01:45:26,320][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000903720_231407616.pth [2023-12-28 01:45:26,755][106225] Updated weights for policy 1, policy_version 907078 (0.0008) [2023-12-28 01:45:26,810][106225] Updated weights for policy 1, policy_version 907088 (0.0009) [2023-12-28 01:45:26,862][106225] Updated weights for policy 1, policy_version 907098 (0.0008) [2023-12-28 01:45:27,054][106226] Updated weights for policy 0, policy_version 904878 (0.0009) [2023-12-28 01:45:27,106][106226] Updated weights for policy 0, policy_version 904888 (0.0008) [2023-12-28 01:45:27,165][106226] Updated weights for policy 0, policy_version 904898 (0.0008) [2023-12-28 01:45:27,579][106225] Updated weights for policy 1, policy_version 907108 (0.0008) [2023-12-28 01:45:27,630][106225] Updated weights for policy 1, policy_version 907118 (0.0009) [2023-12-28 01:45:27,684][106225] Updated weights for policy 1, policy_version 907128 (0.0009) [2023-12-28 01:45:27,771][106226] Updated weights for policy 0, policy_version 904908 (0.0007) [2023-12-28 01:45:27,819][106226] Updated weights for policy 0, policy_version 904918 (0.0005) [2023-12-28 01:45:27,872][106226] Updated weights for policy 0, policy_version 904928 (0.0005) [2023-12-28 01:45:28,434][106225] Updated weights for policy 1, policy_version 907138 (0.0009) [2023-12-28 01:45:28,449][106226] Updated weights for policy 0, policy_version 904938 (0.0006) [2023-12-28 01:45:28,485][106225] Updated weights for policy 1, policy_version 907148 (0.0008) [2023-12-28 01:45:28,504][106226] Updated weights for policy 0, policy_version 904948 (0.0007) [2023-12-28 01:45:28,547][106225] Updated weights for policy 1, policy_version 907158 (0.0008) [2023-12-28 01:45:28,565][106226] Updated weights for policy 0, policy_version 904958 (0.0005) [2023-12-28 01:45:28,605][106225] Updated weights for policy 1, policy_version 907168 (0.0008) [2023-12-28 01:45:28,632][106226] Updated weights for policy 0, policy_version 904968 (0.0007) [2023-12-28 01:45:29,252][106225] Updated weights for policy 1, policy_version 907178 (0.0008) [2023-12-28 01:45:29,320][106225] Updated weights for policy 1, policy_version 907188 (0.0007) [2023-12-28 01:45:29,385][106225] Updated weights for policy 1, policy_version 907198 (0.0007) [2023-12-28 01:45:29,404][106226] Updated weights for policy 0, policy_version 904978 (0.0008) [2023-12-28 01:45:29,463][106226] Updated weights for policy 0, policy_version 904988 (0.0008) [2023-12-28 01:45:29,521][106226] Updated weights for policy 0, policy_version 904998 (0.0008) [2023-12-28 01:45:30,075][106225] Updated weights for policy 1, policy_version 907208 (0.0008) [2023-12-28 01:45:30,133][106225] Updated weights for policy 1, policy_version 907218 (0.0008) [2023-12-28 01:45:30,192][106225] Updated weights for policy 1, policy_version 907228 (0.0008) [2023-12-28 01:45:30,283][106226] Updated weights for policy 0, policy_version 905008 (0.0009) [2023-12-28 01:45:30,335][106226] Updated weights for policy 0, policy_version 905018 (0.0009) [2023-12-28 01:45:30,390][106226] Updated weights for policy 0, policy_version 905028 (0.0009) [2023-12-28 01:45:30,891][106225] Updated weights for policy 1, policy_version 907238 (0.0008) [2023-12-28 01:45:30,939][106225] Updated weights for policy 1, policy_version 907248 (0.0008) [2023-12-28 01:45:30,983][106225] Updated weights for policy 1, policy_version 907258 (0.0008) [2023-12-28 01:45:31,148][106226] Updated weights for policy 0, policy_version 905038 (0.0009) [2023-12-28 01:45:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 464044032. Throughput: 0: 9786.4, 1: 9857.1. Samples: 464034404. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:31,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-5.027')] [2023-12-28 01:45:31,212][106226] Updated weights for policy 0, policy_version 905048 (0.0010) [2023-12-28 01:45:31,279][106226] Updated weights for policy 0, policy_version 905058 (0.0010) [2023-12-28 01:45:31,829][106225] Updated weights for policy 1, policy_version 907268 (0.0007) [2023-12-28 01:45:31,877][106225] Updated weights for policy 1, policy_version 907278 (0.0006) [2023-12-28 01:45:31,932][106225] Updated weights for policy 1, policy_version 907288 (0.0008) [2023-12-28 01:45:31,971][106226] Updated weights for policy 0, policy_version 905068 (0.0011) [2023-12-28 01:45:32,019][106226] Updated weights for policy 0, policy_version 905078 (0.0010) [2023-12-28 01:45:32,080][106226] Updated weights for policy 0, policy_version 905088 (0.0007) [2023-12-28 01:45:32,602][106225] Updated weights for policy 1, policy_version 907298 (0.0008) [2023-12-28 01:45:32,661][106225] Updated weights for policy 1, policy_version 907308 (0.0005) [2023-12-28 01:45:32,721][106225] Updated weights for policy 1, policy_version 907318 (0.0006) [2023-12-28 01:45:32,785][106225] Updated weights for policy 1, policy_version 907328 (0.0008) [2023-12-28 01:45:32,818][106226] Updated weights for policy 0, policy_version 905098 (0.0010) [2023-12-28 01:45:32,880][106226] Updated weights for policy 0, policy_version 905108 (0.0009) [2023-12-28 01:45:32,933][106226] Updated weights for policy 0, policy_version 905118 (0.0010) [2023-12-28 01:45:32,980][106226] Updated weights for policy 0, policy_version 905128 (0.0010) [2023-12-28 01:45:33,467][106225] Updated weights for policy 1, policy_version 907338 (0.0008) [2023-12-28 01:45:33,529][106225] Updated weights for policy 1, policy_version 907348 (0.0008) [2023-12-28 01:45:33,587][106225] Updated weights for policy 1, policy_version 907358 (0.0007) [2023-12-28 01:45:33,670][106226] Updated weights for policy 0, policy_version 905138 (0.0010) [2023-12-28 01:45:33,720][106226] Updated weights for policy 0, policy_version 905148 (0.0010) [2023-12-28 01:45:33,769][106226] Updated weights for policy 0, policy_version 905158 (0.0010) [2023-12-28 01:45:34,329][106225] Updated weights for policy 1, policy_version 907368 (0.0010) [2023-12-28 01:45:34,395][106225] Updated weights for policy 1, policy_version 907378 (0.0009) [2023-12-28 01:45:34,460][106225] Updated weights for policy 1, policy_version 907388 (0.0010) [2023-12-28 01:45:34,509][106226] Updated weights for policy 0, policy_version 905168 (0.0010) [2023-12-28 01:45:34,576][106226] Updated weights for policy 0, policy_version 905178 (0.0009) [2023-12-28 01:45:34,643][106226] Updated weights for policy 0, policy_version 905188 (0.0007) [2023-12-28 01:45:35,180][106225] Updated weights for policy 1, policy_version 907398 (0.0010) [2023-12-28 01:45:35,239][106225] Updated weights for policy 1, policy_version 907408 (0.0010) [2023-12-28 01:45:35,306][106225] Updated weights for policy 1, policy_version 907418 (0.0010) [2023-12-28 01:45:35,328][106226] Updated weights for policy 0, policy_version 905198 (0.0006) [2023-12-28 01:45:35,379][106226] Updated weights for policy 0, policy_version 905208 (0.0005) [2023-12-28 01:45:35,428][106226] Updated weights for policy 0, policy_version 905218 (0.0005) [2023-12-28 01:45:35,992][106225] Updated weights for policy 1, policy_version 907428 (0.0010) [2023-12-28 01:45:36,005][106226] Updated weights for policy 0, policy_version 905228 (0.0008) [2023-12-28 01:45:36,053][106225] Updated weights for policy 1, policy_version 907438 (0.0010) [2023-12-28 01:45:36,065][106226] Updated weights for policy 0, policy_version 905238 (0.0010) [2023-12-28 01:45:36,116][106225] Updated weights for policy 1, policy_version 907448 (0.0010) [2023-12-28 01:45:36,121][106226] Updated weights for policy 0, policy_version 905248 (0.0010) [2023-12-28 01:45:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 464150528. Throughput: 0: 9803.3, 1: 9910.8. Samples: 464152972. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:36,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.986')] [2023-12-28 01:45:36,845][106225] Updated weights for policy 1, policy_version 907458 (0.0009) [2023-12-28 01:45:36,891][106226] Updated weights for policy 0, policy_version 905258 (0.0010) [2023-12-28 01:45:36,911][106225] Updated weights for policy 1, policy_version 907468 (0.0006) [2023-12-28 01:45:36,960][106226] Updated weights for policy 0, policy_version 905268 (0.0009) [2023-12-28 01:45:36,972][106225] Updated weights for policy 1, policy_version 907478 (0.0006) [2023-12-28 01:45:37,026][106226] Updated weights for policy 0, policy_version 905278 (0.0009) [2023-12-28 01:45:37,036][106225] Updated weights for policy 1, policy_version 907488 (0.0007) [2023-12-28 01:45:37,074][106226] Updated weights for policy 0, policy_version 905288 (0.0008) [2023-12-28 01:45:37,593][106225] Updated weights for policy 1, policy_version 907498 (0.0006) [2023-12-28 01:45:37,655][106225] Updated weights for policy 1, policy_version 907508 (0.0006) [2023-12-28 01:45:37,724][106225] Updated weights for policy 1, policy_version 907518 (0.0006) [2023-12-28 01:45:37,880][106226] Updated weights for policy 0, policy_version 905298 (0.0007) [2023-12-28 01:45:37,945][106226] Updated weights for policy 0, policy_version 905308 (0.0005) [2023-12-28 01:45:38,006][106226] Updated weights for policy 0, policy_version 905318 (0.0008) [2023-12-28 01:45:38,421][106225] Updated weights for policy 1, policy_version 907528 (0.0009) [2023-12-28 01:45:38,479][106225] Updated weights for policy 1, policy_version 907538 (0.0010) [2023-12-28 01:45:38,540][106225] Updated weights for policy 1, policy_version 907548 (0.0011) [2023-12-28 01:45:38,642][106226] Updated weights for policy 0, policy_version 905328 (0.0008) [2023-12-28 01:45:38,696][106226] Updated weights for policy 0, policy_version 905338 (0.0008) [2023-12-28 01:45:38,753][106226] Updated weights for policy 0, policy_version 905348 (0.0009) [2023-12-28 01:45:39,263][106225] Updated weights for policy 1, policy_version 907558 (0.0010) [2023-12-28 01:45:39,329][106225] Updated weights for policy 1, policy_version 907568 (0.0007) [2023-12-28 01:45:39,400][106225] Updated weights for policy 1, policy_version 907579 (0.0008) [2023-12-28 01:45:39,561][106226] Updated weights for policy 0, policy_version 905358 (0.0010) [2023-12-28 01:45:39,626][106226] Updated weights for policy 0, policy_version 905368 (0.0009) [2023-12-28 01:45:39,689][106226] Updated weights for policy 0, policy_version 905378 (0.0008) [2023-12-28 01:45:40,119][106225] Updated weights for policy 1, policy_version 907589 (0.0009) [2023-12-28 01:45:40,188][106225] Updated weights for policy 1, policy_version 907599 (0.0010) [2023-12-28 01:45:40,252][106225] Updated weights for policy 1, policy_version 907609 (0.0010) [2023-12-28 01:45:40,452][106226] Updated weights for policy 0, policy_version 905388 (0.0007) [2023-12-28 01:45:40,518][106226] Updated weights for policy 0, policy_version 905398 (0.0005) [2023-12-28 01:45:40,583][106226] Updated weights for policy 0, policy_version 905408 (0.0005) [2023-12-28 01:45:40,976][106225] Updated weights for policy 1, policy_version 907619 (0.0009) [2023-12-28 01:45:41,059][106225] Updated weights for policy 1, policy_version 907629 (0.0010) [2023-12-28 01:45:41,125][106225] Updated weights for policy 1, policy_version 907639 (0.0010) [2023-12-28 01:45:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 464232448. Throughput: 0: 9801.1, 1: 9937.5. Samples: 464210972. Policy #0 lag: (min: 28.0, avg: 30.7, max: 60.0) [2023-12-28 01:45:41,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-5.011')] [2023-12-28 01:45:41,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000907648_232398848.pth... [2023-12-28 01:45:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000906496_232103936.pth [2023-12-28 01:45:41,193][106226] Updated weights for policy 0, policy_version 905418 (0.0006) [2023-12-28 01:45:41,257][106226] Updated weights for policy 0, policy_version 905428 (0.0011) [2023-12-28 01:45:41,323][106226] Updated weights for policy 0, policy_version 905438 (0.0011) [2023-12-28 01:45:41,399][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000905448_231849984.pth... [2023-12-28 01:45:41,401][106226] Updated weights for policy 0, policy_version 905448 (0.0009) [2023-12-28 01:45:41,404][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000904296_231555072.pth [2023-12-28 01:45:41,925][106225] Updated weights for policy 1, policy_version 907649 (0.0010) [2023-12-28 01:45:41,991][106225] Updated weights for policy 1, policy_version 907659 (0.0010) [2023-12-28 01:45:42,048][106226] Updated weights for policy 0, policy_version 905458 (0.0006) [2023-12-28 01:45:42,054][106225] Updated weights for policy 1, policy_version 907669 (0.0011) [2023-12-28 01:45:42,111][106225] Updated weights for policy 1, policy_version 907679 (0.0010) [2023-12-28 01:45:42,112][106226] Updated weights for policy 0, policy_version 905468 (0.0008) [2023-12-28 01:45:42,167][106226] Updated weights for policy 0, policy_version 905478 (0.0008) [2023-12-28 01:45:42,843][106225] Updated weights for policy 1, policy_version 907689 (0.0010) [2023-12-28 01:45:42,890][106225] Updated weights for policy 1, policy_version 907699 (0.0010) [2023-12-28 01:45:42,908][106226] Updated weights for policy 0, policy_version 905488 (0.0007) [2023-12-28 01:45:42,935][106225] Updated weights for policy 1, policy_version 907709 (0.0009) [2023-12-28 01:45:42,967][106226] Updated weights for policy 0, policy_version 905498 (0.0007) [2023-12-28 01:45:43,032][106226] Updated weights for policy 0, policy_version 905508 (0.0009) [2023-12-28 01:45:43,541][106225] Updated weights for policy 1, policy_version 907719 (0.0008) [2023-12-28 01:45:43,603][106225] Updated weights for policy 1, policy_version 907729 (0.0009) [2023-12-28 01:45:43,660][106225] Updated weights for policy 1, policy_version 907739 (0.0006) [2023-12-28 01:45:43,816][106226] Updated weights for policy 0, policy_version 905518 (0.0009) [2023-12-28 01:45:43,862][106226] Updated weights for policy 0, policy_version 905528 (0.0009) [2023-12-28 01:45:43,918][106226] Updated weights for policy 0, policy_version 905538 (0.0008) [2023-12-28 01:45:44,338][106225] Updated weights for policy 1, policy_version 907749 (0.0005) [2023-12-28 01:45:44,400][106225] Updated weights for policy 1, policy_version 907759 (0.0005) [2023-12-28 01:45:44,459][106225] Updated weights for policy 1, policy_version 907769 (0.0006) [2023-12-28 01:45:44,666][106226] Updated weights for policy 0, policy_version 905548 (0.0007) [2023-12-28 01:45:44,725][106226] Updated weights for policy 0, policy_version 905558 (0.0005) [2023-12-28 01:45:44,788][106226] Updated weights for policy 0, policy_version 905568 (0.0007) [2023-12-28 01:45:45,110][106225] Updated weights for policy 1, policy_version 907779 (0.0009) [2023-12-28 01:45:45,172][106225] Updated weights for policy 1, policy_version 907789 (0.0009) [2023-12-28 01:45:45,236][106225] Updated weights for policy 1, policy_version 907799 (0.0009) [2023-12-28 01:45:45,489][106226] Updated weights for policy 0, policy_version 905578 (0.0009) [2023-12-28 01:45:45,553][106226] Updated weights for policy 0, policy_version 905588 (0.0009) [2023-12-28 01:45:45,626][106226] Updated weights for policy 0, policy_version 905598 (0.0009) [2023-12-28 01:45:45,686][106226] Updated weights for policy 0, policy_version 905608 (0.0008) [2023-12-28 01:45:45,961][106225] Updated weights for policy 1, policy_version 907809 (0.0009) [2023-12-28 01:45:46,018][106225] Updated weights for policy 1, policy_version 907819 (0.0007) [2023-12-28 01:45:46,072][106225] Updated weights for policy 1, policy_version 907829 (0.0006) [2023-12-28 01:45:46,121][106225] Updated weights for policy 1, policy_version 907839 (0.0009) [2023-12-28 01:45:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 464338944. Throughput: 0: 9786.6, 1: 9872.4. Samples: 464326372. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:45:46,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.991')] [2023-12-28 01:45:46,386][106226] Updated weights for policy 0, policy_version 905618 (0.0005) [2023-12-28 01:45:46,441][106226] Updated weights for policy 0, policy_version 905628 (0.0005) [2023-12-28 01:45:46,501][106226] Updated weights for policy 0, policy_version 905638 (0.0005) [2023-12-28 01:45:46,816][106225] Updated weights for policy 1, policy_version 907849 (0.0006) [2023-12-28 01:45:46,863][106225] Updated weights for policy 1, policy_version 907859 (0.0008) [2023-12-28 01:45:46,909][106225] Updated weights for policy 1, policy_version 907869 (0.0005) [2023-12-28 01:45:47,229][106226] Updated weights for policy 0, policy_version 905648 (0.0009) [2023-12-28 01:45:47,282][106226] Updated weights for policy 0, policy_version 905658 (0.0008) [2023-12-28 01:45:47,339][106226] Updated weights for policy 0, policy_version 905668 (0.0009) [2023-12-28 01:45:47,452][106225] Updated weights for policy 1, policy_version 907879 (0.0007) [2023-12-28 01:45:47,515][106225] Updated weights for policy 1, policy_version 907889 (0.0008) [2023-12-28 01:45:47,587][106225] Updated weights for policy 1, policy_version 907899 (0.0008) [2023-12-28 01:45:48,007][106226] Updated weights for policy 0, policy_version 905678 (0.0008) [2023-12-28 01:45:48,060][106226] Updated weights for policy 0, policy_version 905688 (0.0007) [2023-12-28 01:45:48,119][106226] Updated weights for policy 0, policy_version 905698 (0.0006) [2023-12-28 01:45:48,220][106225] Updated weights for policy 1, policy_version 907909 (0.0010) [2023-12-28 01:45:48,272][106225] Updated weights for policy 1, policy_version 907919 (0.0009) [2023-12-28 01:45:48,322][106225] Updated weights for policy 1, policy_version 907929 (0.0008) [2023-12-28 01:45:48,742][106226] Updated weights for policy 0, policy_version 905708 (0.0007) [2023-12-28 01:45:48,804][106226] Updated weights for policy 0, policy_version 905718 (0.0008) [2023-12-28 01:45:48,870][106226] Updated weights for policy 0, policy_version 905728 (0.0009) [2023-12-28 01:45:49,101][106225] Updated weights for policy 1, policy_version 907939 (0.0009) [2023-12-28 01:45:49,164][106225] Updated weights for policy 1, policy_version 907949 (0.0007) [2023-12-28 01:45:49,233][106225] Updated weights for policy 1, policy_version 907959 (0.0007) [2023-12-28 01:45:49,562][106226] Updated weights for policy 0, policy_version 905738 (0.0007) [2023-12-28 01:45:49,621][106226] Updated weights for policy 0, policy_version 905748 (0.0008) [2023-12-28 01:45:49,675][106226] Updated weights for policy 0, policy_version 905758 (0.0008) [2023-12-28 01:45:49,730][106226] Updated weights for policy 0, policy_version 905768 (0.0008) [2023-12-28 01:45:49,980][106225] Updated weights for policy 1, policy_version 907969 (0.0007) [2023-12-28 01:45:50,048][106225] Updated weights for policy 1, policy_version 907979 (0.0010) [2023-12-28 01:45:50,112][106225] Updated weights for policy 1, policy_version 907989 (0.0010) [2023-12-28 01:45:50,174][106225] Updated weights for policy 1, policy_version 907999 (0.0011) [2023-12-28 01:45:50,525][106226] Updated weights for policy 0, policy_version 905778 (0.0010) [2023-12-28 01:45:50,590][106226] Updated weights for policy 0, policy_version 905788 (0.0009) [2023-12-28 01:45:50,645][106226] Updated weights for policy 0, policy_version 905798 (0.0008) [2023-12-28 01:45:50,849][106225] Updated weights for policy 1, policy_version 908009 (0.0009) [2023-12-28 01:45:50,902][106225] Updated weights for policy 1, policy_version 908019 (0.0009) [2023-12-28 01:45:50,962][106225] Updated weights for policy 1, policy_version 908029 (0.0009) [2023-12-28 01:45:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 464437248. Throughput: 0: 9783.4, 1: 9861.0. Samples: 464445892. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:45:51,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.923')] [2023-12-28 01:45:51,382][106226] Updated weights for policy 0, policy_version 905808 (0.0011) [2023-12-28 01:45:51,444][106226] Updated weights for policy 0, policy_version 905818 (0.0009) [2023-12-28 01:45:51,506][106226] Updated weights for policy 0, policy_version 905828 (0.0008) [2023-12-28 01:45:51,766][106225] Updated weights for policy 1, policy_version 908039 (0.0009) [2023-12-28 01:45:51,827][106225] Updated weights for policy 1, policy_version 908049 (0.0009) [2023-12-28 01:45:51,884][106225] Updated weights for policy 1, policy_version 908059 (0.0008) [2023-12-28 01:45:52,258][106226] Updated weights for policy 0, policy_version 905838 (0.0009) [2023-12-28 01:45:52,324][106226] Updated weights for policy 0, policy_version 905848 (0.0009) [2023-12-28 01:45:52,395][106226] Updated weights for policy 0, policy_version 905858 (0.0008) [2023-12-28 01:45:52,658][106225] Updated weights for policy 1, policy_version 908069 (0.0007) [2023-12-28 01:45:52,710][106225] Updated weights for policy 1, policy_version 908079 (0.0008) [2023-12-28 01:45:52,764][106225] Updated weights for policy 1, policy_version 908089 (0.0007) [2023-12-28 01:45:53,138][106226] Updated weights for policy 0, policy_version 905868 (0.0010) [2023-12-28 01:45:53,192][106226] Updated weights for policy 0, policy_version 905878 (0.0010) [2023-12-28 01:45:53,258][106226] Updated weights for policy 0, policy_version 905888 (0.0010) [2023-12-28 01:45:53,417][106225] Updated weights for policy 1, policy_version 908099 (0.0008) [2023-12-28 01:45:53,472][106225] Updated weights for policy 1, policy_version 908109 (0.0007) [2023-12-28 01:45:53,527][106225] Updated weights for policy 1, policy_version 908119 (0.0008) [2023-12-28 01:45:53,910][106226] Updated weights for policy 0, policy_version 905898 (0.0010) [2023-12-28 01:45:53,977][106226] Updated weights for policy 0, policy_version 905908 (0.0008) [2023-12-28 01:45:54,041][106226] Updated weights for policy 0, policy_version 905918 (0.0006) [2023-12-28 01:45:54,101][106226] Updated weights for policy 0, policy_version 905928 (0.0008) [2023-12-28 01:45:54,188][106225] Updated weights for policy 1, policy_version 908129 (0.0006) [2023-12-28 01:45:54,252][106225] Updated weights for policy 1, policy_version 908139 (0.0005) [2023-12-28 01:45:54,313][106225] Updated weights for policy 1, policy_version 908149 (0.0005) [2023-12-28 01:45:54,371][106225] Updated weights for policy 1, policy_version 908159 (0.0007) [2023-12-28 01:45:54,665][106226] Updated weights for policy 0, policy_version 905938 (0.0008) [2023-12-28 01:45:54,727][106226] Updated weights for policy 0, policy_version 905948 (0.0007) [2023-12-28 01:45:54,789][106226] Updated weights for policy 0, policy_version 905958 (0.0009) [2023-12-28 01:45:55,075][106225] Updated weights for policy 1, policy_version 908169 (0.0009) [2023-12-28 01:45:55,139][106225] Updated weights for policy 1, policy_version 908179 (0.0005) [2023-12-28 01:45:55,195][106225] Updated weights for policy 1, policy_version 908189 (0.0005) [2023-12-28 01:45:55,483][106226] Updated weights for policy 0, policy_version 905968 (0.0006) [2023-12-28 01:45:55,542][106226] Updated weights for policy 0, policy_version 905978 (0.0005) [2023-12-28 01:45:55,602][106226] Updated weights for policy 0, policy_version 905988 (0.0007) [2023-12-28 01:45:55,781][106225] Updated weights for policy 1, policy_version 908199 (0.0009) [2023-12-28 01:45:55,831][106225] Updated weights for policy 1, policy_version 908209 (0.0010) [2023-12-28 01:45:55,877][106225] Updated weights for policy 1, policy_version 908219 (0.0010) [2023-12-28 01:45:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 464535552. Throughput: 0: 9761.4, 1: 9811.0. Samples: 464503416. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:45:56,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-5.091')] [2023-12-28 01:45:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000908224_232546304.pth... [2023-12-28 01:45:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000905992_231989248.pth... [2023-12-28 01:45:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000907072_232251392.pth [2023-12-28 01:45:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000904872_231702528.pth [2023-12-28 01:45:56,290][106226] Updated weights for policy 0, policy_version 905998 (0.0008) [2023-12-28 01:45:56,340][106226] Updated weights for policy 0, policy_version 906008 (0.0009) [2023-12-28 01:45:56,403][106226] Updated weights for policy 0, policy_version 906018 (0.0009) [2023-12-28 01:45:56,485][106225] Updated weights for policy 1, policy_version 908229 (0.0008) [2023-12-28 01:45:56,557][106225] Updated weights for policy 1, policy_version 908239 (0.0008) [2023-12-28 01:45:56,621][106225] Updated weights for policy 1, policy_version 908249 (0.0008) [2023-12-28 01:45:57,129][106226] Updated weights for policy 0, policy_version 906028 (0.0010) [2023-12-28 01:45:57,191][106226] Updated weights for policy 0, policy_version 906038 (0.0008) [2023-12-28 01:45:57,251][106226] Updated weights for policy 0, policy_version 906048 (0.0008) [2023-12-28 01:45:57,297][106225] Updated weights for policy 1, policy_version 908259 (0.0007) [2023-12-28 01:45:57,354][106225] Updated weights for policy 1, policy_version 908269 (0.0007) [2023-12-28 01:45:57,403][106225] Updated weights for policy 1, policy_version 908279 (0.0005) [2023-12-28 01:45:57,979][106226] Updated weights for policy 0, policy_version 906058 (0.0008) [2023-12-28 01:45:58,004][106225] Updated weights for policy 1, policy_version 908289 (0.0007) [2023-12-28 01:45:58,037][106226] Updated weights for policy 0, policy_version 906068 (0.0006) [2023-12-28 01:45:58,060][106225] Updated weights for policy 1, policy_version 908299 (0.0006) [2023-12-28 01:45:58,095][106226] Updated weights for policy 0, policy_version 906078 (0.0008) [2023-12-28 01:45:58,124][106225] Updated weights for policy 1, policy_version 908309 (0.0006) [2023-12-28 01:45:58,143][106226] Updated weights for policy 0, policy_version 906088 (0.0008) [2023-12-28 01:45:58,187][106225] Updated weights for policy 1, policy_version 908319 (0.0006) [2023-12-28 01:45:58,971][106225] Updated weights for policy 1, policy_version 908329 (0.0008) [2023-12-28 01:45:58,972][106226] Updated weights for policy 0, policy_version 906098 (0.0009) [2023-12-28 01:45:59,035][106225] Updated weights for policy 1, policy_version 908339 (0.0008) [2023-12-28 01:45:59,038][106226] Updated weights for policy 0, policy_version 906108 (0.0007) [2023-12-28 01:45:59,094][106226] Updated weights for policy 0, policy_version 906118 (0.0007) [2023-12-28 01:45:59,099][106225] Updated weights for policy 1, policy_version 908349 (0.0008) [2023-12-28 01:45:59,859][106225] Updated weights for policy 1, policy_version 908359 (0.0007) [2023-12-28 01:45:59,922][106226] Updated weights for policy 0, policy_version 906128 (0.0007) [2023-12-28 01:45:59,930][106225] Updated weights for policy 1, policy_version 908369 (0.0007) [2023-12-28 01:45:59,997][106226] Updated weights for policy 0, policy_version 906138 (0.0009) [2023-12-28 01:46:00,000][106225] Updated weights for policy 1, policy_version 908379 (0.0007) [2023-12-28 01:46:00,063][106226] Updated weights for policy 0, policy_version 906148 (0.0009) [2023-12-28 01:46:00,626][106225] Updated weights for policy 1, policy_version 908389 (0.0008) [2023-12-28 01:46:00,675][106226] Updated weights for policy 0, policy_version 906158 (0.0008) [2023-12-28 01:46:00,682][106225] Updated weights for policy 1, policy_version 908399 (0.0005) [2023-12-28 01:46:00,729][106226] Updated weights for policy 0, policy_version 906168 (0.0006) [2023-12-28 01:46:00,739][106225] Updated weights for policy 1, policy_version 908409 (0.0005) [2023-12-28 01:46:00,782][106226] Updated weights for policy 0, policy_version 906178 (0.0007) [2023-12-28 01:46:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 464633856. Throughput: 0: 9746.4, 1: 9910.2. Samples: 464621800. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:01,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.101')] [2023-12-28 01:46:01,410][106225] Updated weights for policy 1, policy_version 908419 (0.0005) [2023-12-28 01:46:01,465][106225] Updated weights for policy 1, policy_version 908429 (0.0006) [2023-12-28 01:46:01,527][106225] Updated weights for policy 1, policy_version 908439 (0.0005) [2023-12-28 01:46:01,536][106226] Updated weights for policy 0, policy_version 906188 (0.0007) [2023-12-28 01:46:01,591][106226] Updated weights for policy 0, policy_version 906198 (0.0007) [2023-12-28 01:46:01,654][106226] Updated weights for policy 0, policy_version 906208 (0.0007) [2023-12-28 01:46:02,237][106225] Updated weights for policy 1, policy_version 908449 (0.0005) [2023-12-28 01:46:02,309][106225] Updated weights for policy 1, policy_version 908459 (0.0007) [2023-12-28 01:46:02,376][106225] Updated weights for policy 1, policy_version 908469 (0.0008) [2023-12-28 01:46:02,416][106226] Updated weights for policy 0, policy_version 906218 (0.0008) [2023-12-28 01:46:02,445][106225] Updated weights for policy 1, policy_version 908479 (0.0008) [2023-12-28 01:46:02,487][106226] Updated weights for policy 0, policy_version 906228 (0.0008) [2023-12-28 01:46:02,553][106226] Updated weights for policy 0, policy_version 906238 (0.0008) [2023-12-28 01:46:02,607][106226] Updated weights for policy 0, policy_version 906248 (0.0008) [2023-12-28 01:46:03,182][106225] Updated weights for policy 1, policy_version 908489 (0.0008) [2023-12-28 01:46:03,243][106225] Updated weights for policy 1, policy_version 908499 (0.0008) [2023-12-28 01:46:03,292][106226] Updated weights for policy 0, policy_version 906258 (0.0008) [2023-12-28 01:46:03,298][106225] Updated weights for policy 1, policy_version 908509 (0.0006) [2023-12-28 01:46:03,350][106226] Updated weights for policy 0, policy_version 906268 (0.0008) [2023-12-28 01:46:03,400][106226] Updated weights for policy 0, policy_version 906278 (0.0009) [2023-12-28 01:46:03,956][106225] Updated weights for policy 1, policy_version 908519 (0.0008) [2023-12-28 01:46:04,019][106225] Updated weights for policy 1, policy_version 908529 (0.0009) [2023-12-28 01:46:04,088][106225] Updated weights for policy 1, policy_version 908539 (0.0009) [2023-12-28 01:46:04,207][106226] Updated weights for policy 0, policy_version 906288 (0.0008) [2023-12-28 01:46:04,278][106226] Updated weights for policy 0, policy_version 906298 (0.0008) [2023-12-28 01:46:04,343][106226] Updated weights for policy 0, policy_version 906308 (0.0009) [2023-12-28 01:46:04,842][106225] Updated weights for policy 1, policy_version 908549 (0.0008) [2023-12-28 01:46:04,900][106225] Updated weights for policy 1, policy_version 908559 (0.0008) [2023-12-28 01:46:04,957][106225] Updated weights for policy 1, policy_version 908569 (0.0008) [2023-12-28 01:46:05,011][106226] Updated weights for policy 0, policy_version 906318 (0.0008) [2023-12-28 01:46:05,073][106226] Updated weights for policy 0, policy_version 906328 (0.0008) [2023-12-28 01:46:05,135][106226] Updated weights for policy 0, policy_version 906338 (0.0010) [2023-12-28 01:46:05,578][106225] Updated weights for policy 1, policy_version 908579 (0.0008) [2023-12-28 01:46:05,627][106225] Updated weights for policy 1, policy_version 908589 (0.0009) [2023-12-28 01:46:05,683][106225] Updated weights for policy 1, policy_version 908599 (0.0009) [2023-12-28 01:46:05,920][106226] Updated weights for policy 0, policy_version 906348 (0.0008) [2023-12-28 01:46:05,977][106226] Updated weights for policy 0, policy_version 906358 (0.0009) [2023-12-28 01:46:06,038][106226] Updated weights for policy 0, policy_version 906368 (0.0008) [2023-12-28 01:46:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 464732160. Throughput: 0: 9667.5, 1: 9880.8. Samples: 464738280. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:06,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.951')] [2023-12-28 01:46:06,434][106225] Updated weights for policy 1, policy_version 908609 (0.0009) [2023-12-28 01:46:06,501][106225] Updated weights for policy 1, policy_version 908619 (0.0008) [2023-12-28 01:46:06,567][106225] Updated weights for policy 1, policy_version 908629 (0.0008) [2023-12-28 01:46:06,634][106225] Updated weights for policy 1, policy_version 908639 (0.0007) [2023-12-28 01:46:06,903][106226] Updated weights for policy 0, policy_version 906378 (0.0009) [2023-12-28 01:46:06,970][106226] Updated weights for policy 0, policy_version 906388 (0.0008) [2023-12-28 01:46:07,034][106226] Updated weights for policy 0, policy_version 906398 (0.0010) [2023-12-28 01:46:07,100][106226] Updated weights for policy 0, policy_version 906408 (0.0009) [2023-12-28 01:46:07,208][106225] Updated weights for policy 1, policy_version 908649 (0.0006) [2023-12-28 01:46:07,266][106225] Updated weights for policy 1, policy_version 908659 (0.0007) [2023-12-28 01:46:07,326][106225] Updated weights for policy 1, policy_version 908669 (0.0009) [2023-12-28 01:46:07,840][106226] Updated weights for policy 0, policy_version 906418 (0.0008) [2023-12-28 01:46:07,897][106226] Updated weights for policy 0, policy_version 906428 (0.0009) [2023-12-28 01:46:07,956][106226] Updated weights for policy 0, policy_version 906438 (0.0009) [2023-12-28 01:46:08,036][106225] Updated weights for policy 1, policy_version 908679 (0.0008) [2023-12-28 01:46:08,105][106225] Updated weights for policy 1, policy_version 908689 (0.0009) [2023-12-28 01:46:08,153][106225] Updated weights for policy 1, policy_version 908699 (0.0009) [2023-12-28 01:46:08,705][106226] Updated weights for policy 0, policy_version 906448 (0.0009) [2023-12-28 01:46:08,771][106226] Updated weights for policy 0, policy_version 906458 (0.0011) [2023-12-28 01:46:08,835][106226] Updated weights for policy 0, policy_version 906468 (0.0011) [2023-12-28 01:46:08,911][106225] Updated weights for policy 1, policy_version 908709 (0.0008) [2023-12-28 01:46:08,971][106225] Updated weights for policy 1, policy_version 908719 (0.0008) [2023-12-28 01:46:09,022][106225] Updated weights for policy 1, policy_version 908729 (0.0008) [2023-12-28 01:46:09,586][106226] Updated weights for policy 0, policy_version 906478 (0.0010) [2023-12-28 01:46:09,645][106226] Updated weights for policy 0, policy_version 906488 (0.0009) [2023-12-28 01:46:09,710][106226] Updated weights for policy 0, policy_version 906498 (0.0008) [2023-12-28 01:46:09,779][106225] Updated weights for policy 1, policy_version 908739 (0.0007) [2023-12-28 01:46:09,849][106225] Updated weights for policy 1, policy_version 908749 (0.0009) [2023-12-28 01:46:09,916][106225] Updated weights for policy 1, policy_version 908759 (0.0009) [2023-12-28 01:46:10,492][106226] Updated weights for policy 0, policy_version 906508 (0.0008) [2023-12-28 01:46:10,556][106226] Updated weights for policy 0, policy_version 906518 (0.0008) [2023-12-28 01:46:10,613][106226] Updated weights for policy 0, policy_version 906528 (0.0009) [2023-12-28 01:46:10,651][106225] Updated weights for policy 1, policy_version 908769 (0.0009) [2023-12-28 01:46:10,708][106225] Updated weights for policy 1, policy_version 908779 (0.0009) [2023-12-28 01:46:10,769][106225] Updated weights for policy 1, policy_version 908789 (0.0006) [2023-12-28 01:46:10,831][106225] Updated weights for policy 1, policy_version 908799 (0.0006) [2023-12-28 01:46:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 464822272. Throughput: 0: 9611.6, 1: 9964.2. Samples: 464795532. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:11,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.914')] [2023-12-28 01:46:11,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000906536_232128512.pth... [2023-12-28 01:46:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000908800_232693760.pth... [2023-12-28 01:46:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000905448_231849984.pth [2023-12-28 01:46:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000907648_232398848.pth [2023-12-28 01:46:11,380][106226] Updated weights for policy 0, policy_version 906538 (0.0008) [2023-12-28 01:46:11,449][106226] Updated weights for policy 0, policy_version 906548 (0.0008) [2023-12-28 01:46:11,515][106226] Updated weights for policy 0, policy_version 906558 (0.0008) [2023-12-28 01:46:11,529][106225] Updated weights for policy 1, policy_version 908809 (0.0006) [2023-12-28 01:46:11,579][106226] Updated weights for policy 0, policy_version 906568 (0.0006) [2023-12-28 01:46:11,589][106225] Updated weights for policy 1, policy_version 908819 (0.0006) [2023-12-28 01:46:11,655][106225] Updated weights for policy 1, policy_version 908829 (0.0008) [2023-12-28 01:46:12,355][106226] Updated weights for policy 0, policy_version 906578 (0.0009) [2023-12-28 01:46:12,411][106225] Updated weights for policy 1, policy_version 908839 (0.0009) [2023-12-28 01:46:12,422][106226] Updated weights for policy 0, policy_version 906588 (0.0007) [2023-12-28 01:46:12,474][106225] Updated weights for policy 1, policy_version 908849 (0.0007) [2023-12-28 01:46:12,483][106226] Updated weights for policy 0, policy_version 906598 (0.0009) [2023-12-28 01:46:12,536][106225] Updated weights for policy 1, policy_version 908859 (0.0006) [2023-12-28 01:46:13,186][106225] Updated weights for policy 1, policy_version 908869 (0.0007) [2023-12-28 01:46:13,211][106226] Updated weights for policy 0, policy_version 906608 (0.0008) [2023-12-28 01:46:13,237][106225] Updated weights for policy 1, policy_version 908879 (0.0005) [2023-12-28 01:46:13,260][106226] Updated weights for policy 0, policy_version 906618 (0.0006) [2023-12-28 01:46:13,281][106225] Updated weights for policy 1, policy_version 908889 (0.0007) [2023-12-28 01:46:13,313][106226] Updated weights for policy 0, policy_version 906628 (0.0008) [2023-12-28 01:46:14,019][106225] Updated weights for policy 1, policy_version 908899 (0.0006) [2023-12-28 01:46:14,047][106226] Updated weights for policy 0, policy_version 906638 (0.0008) [2023-12-28 01:46:14,075][106225] Updated weights for policy 1, policy_version 908909 (0.0005) [2023-12-28 01:46:14,103][106226] Updated weights for policy 0, policy_version 906648 (0.0008) [2023-12-28 01:46:14,126][106225] Updated weights for policy 1, policy_version 908919 (0.0005) [2023-12-28 01:46:14,154][106226] Updated weights for policy 0, policy_version 906658 (0.0009) [2023-12-28 01:46:14,688][106225] Updated weights for policy 1, policy_version 908929 (0.0006) [2023-12-28 01:46:14,753][106225] Updated weights for policy 1, policy_version 908939 (0.0007) [2023-12-28 01:46:14,819][106225] Updated weights for policy 1, policy_version 908949 (0.0007) [2023-12-28 01:46:14,883][106225] Updated weights for policy 1, policy_version 908959 (0.0007) [2023-12-28 01:46:14,946][106226] Updated weights for policy 0, policy_version 906668 (0.0009) [2023-12-28 01:46:15,014][106226] Updated weights for policy 0, policy_version 906678 (0.0009) [2023-12-28 01:46:15,078][106226] Updated weights for policy 0, policy_version 906688 (0.0009) [2023-12-28 01:46:15,595][106225] Updated weights for policy 1, policy_version 908969 (0.0008) [2023-12-28 01:46:15,647][106225] Updated weights for policy 1, policy_version 908979 (0.0008) [2023-12-28 01:46:15,707][106225] Updated weights for policy 1, policy_version 908989 (0.0009) [2023-12-28 01:46:15,817][106226] Updated weights for policy 0, policy_version 906698 (0.0009) [2023-12-28 01:46:15,873][106226] Updated weights for policy 0, policy_version 906708 (0.0008) [2023-12-28 01:46:15,933][106226] Updated weights for policy 0, policy_version 906718 (0.0009) [2023-12-28 01:46:15,990][106226] Updated weights for policy 0, policy_version 906728 (0.0009) [2023-12-28 01:46:16,175][105115] Fps is (10 sec: 18840.6, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 464920576. Throughput: 0: 9520.1, 1: 9920.2. Samples: 464909232. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:16,176][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.820')] [2023-12-28 01:46:16,349][106225] Updated weights for policy 1, policy_version 908999 (0.0007) [2023-12-28 01:46:16,407][106225] Updated weights for policy 1, policy_version 909009 (0.0007) [2023-12-28 01:46:16,466][106225] Updated weights for policy 1, policy_version 909019 (0.0005) [2023-12-28 01:46:16,749][106226] Updated weights for policy 0, policy_version 906738 (0.0009) [2023-12-28 01:46:16,810][106226] Updated weights for policy 0, policy_version 906748 (0.0006) [2023-12-28 01:46:16,873][106226] Updated weights for policy 0, policy_version 906758 (0.0008) [2023-12-28 01:46:17,034][106225] Updated weights for policy 1, policy_version 909029 (0.0007) [2023-12-28 01:46:17,094][106225] Updated weights for policy 1, policy_version 909039 (0.0009) [2023-12-28 01:46:17,150][106225] Updated weights for policy 1, policy_version 909049 (0.0009) [2023-12-28 01:46:17,534][106226] Updated weights for policy 0, policy_version 906768 (0.0008) [2023-12-28 01:46:17,605][106226] Updated weights for policy 0, policy_version 906778 (0.0008) [2023-12-28 01:46:17,668][106226] Updated weights for policy 0, policy_version 906788 (0.0008) [2023-12-28 01:46:17,818][106225] Updated weights for policy 1, policy_version 909059 (0.0007) [2023-12-28 01:46:17,869][106225] Updated weights for policy 1, policy_version 909069 (0.0009) [2023-12-28 01:46:17,923][106225] Updated weights for policy 1, policy_version 909079 (0.0009) [2023-12-28 01:46:18,259][106226] Updated weights for policy 0, policy_version 906798 (0.0008) [2023-12-28 01:46:18,314][106226] Updated weights for policy 0, policy_version 906808 (0.0008) [2023-12-28 01:46:18,386][106226] Updated weights for policy 0, policy_version 906818 (0.0008) [2023-12-28 01:46:18,751][106225] Updated weights for policy 1, policy_version 909089 (0.0009) [2023-12-28 01:46:18,812][106225] Updated weights for policy 1, policy_version 909099 (0.0011) [2023-12-28 01:46:18,876][106225] Updated weights for policy 1, policy_version 909109 (0.0010) [2023-12-28 01:46:18,941][106225] Updated weights for policy 1, policy_version 909119 (0.0008) [2023-12-28 01:46:19,119][106226] Updated weights for policy 0, policy_version 906828 (0.0008) [2023-12-28 01:46:19,175][106226] Updated weights for policy 0, policy_version 906838 (0.0008) [2023-12-28 01:46:19,243][106226] Updated weights for policy 0, policy_version 906848 (0.0008) [2023-12-28 01:46:19,658][106225] Updated weights for policy 1, policy_version 909129 (0.0011) [2023-12-28 01:46:19,719][106225] Updated weights for policy 1, policy_version 909139 (0.0011) [2023-12-28 01:46:19,781][106225] Updated weights for policy 1, policy_version 909149 (0.0011) [2023-12-28 01:46:19,992][106226] Updated weights for policy 0, policy_version 906858 (0.0008) [2023-12-28 01:46:20,049][106226] Updated weights for policy 0, policy_version 906868 (0.0008) [2023-12-28 01:46:20,105][106226] Updated weights for policy 0, policy_version 906878 (0.0009) [2023-12-28 01:46:20,163][106226] Updated weights for policy 0, policy_version 906888 (0.0009) [2023-12-28 01:46:20,459][106225] Updated weights for policy 1, policy_version 909159 (0.0010) [2023-12-28 01:46:20,523][106225] Updated weights for policy 1, policy_version 909169 (0.0010) [2023-12-28 01:46:20,595][106225] Updated weights for policy 1, policy_version 909179 (0.0010) [2023-12-28 01:46:20,963][106226] Updated weights for policy 0, policy_version 906898 (0.0008) [2023-12-28 01:46:21,034][106226] Updated weights for policy 0, policy_version 906908 (0.0009) [2023-12-28 01:46:21,100][106226] Updated weights for policy 0, policy_version 906918 (0.0011) [2023-12-28 01:46:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 465018880. Throughput: 0: 9469.9, 1: 9937.8. Samples: 465026316. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:21,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.974')] [2023-12-28 01:46:21,345][106225] Updated weights for policy 1, policy_version 909189 (0.0009) [2023-12-28 01:46:21,415][106225] Updated weights for policy 1, policy_version 909199 (0.0008) [2023-12-28 01:46:21,473][106225] Updated weights for policy 1, policy_version 909209 (0.0010) [2023-12-28 01:46:21,824][106226] Updated weights for policy 0, policy_version 906928 (0.0009) [2023-12-28 01:46:21,887][106226] Updated weights for policy 0, policy_version 906938 (0.0008) [2023-12-28 01:46:21,952][106226] Updated weights for policy 0, policy_version 906948 (0.0008) [2023-12-28 01:46:22,205][106225] Updated weights for policy 1, policy_version 909219 (0.0011) [2023-12-28 01:46:22,275][106225] Updated weights for policy 1, policy_version 909229 (0.0011) [2023-12-28 01:46:22,330][106225] Updated weights for policy 1, policy_version 909239 (0.0010) [2023-12-28 01:46:22,664][106226] Updated weights for policy 0, policy_version 906958 (0.0007) [2023-12-28 01:46:22,719][106226] Updated weights for policy 0, policy_version 906968 (0.0006) [2023-12-28 01:46:22,770][106226] Updated weights for policy 0, policy_version 906978 (0.0005) [2023-12-28 01:46:23,078][106225] Updated weights for policy 1, policy_version 909249 (0.0008) [2023-12-28 01:46:23,133][106225] Updated weights for policy 1, policy_version 909259 (0.0009) [2023-12-28 01:46:23,188][106225] Updated weights for policy 1, policy_version 909269 (0.0008) [2023-12-28 01:46:23,238][106225] Updated weights for policy 1, policy_version 909279 (0.0008) [2023-12-28 01:46:23,436][106226] Updated weights for policy 0, policy_version 906988 (0.0007) [2023-12-28 01:46:23,490][106226] Updated weights for policy 0, policy_version 906998 (0.0005) [2023-12-28 01:46:23,549][106226] Updated weights for policy 0, policy_version 907008 (0.0006) [2023-12-28 01:46:23,915][106225] Updated weights for policy 1, policy_version 909289 (0.0005) [2023-12-28 01:46:23,971][106225] Updated weights for policy 1, policy_version 909299 (0.0005) [2023-12-28 01:46:24,020][106225] Updated weights for policy 1, policy_version 909309 (0.0005) [2023-12-28 01:46:24,265][106226] Updated weights for policy 0, policy_version 907018 (0.0009) [2023-12-28 01:46:24,316][106226] Updated weights for policy 0, policy_version 907028 (0.0005) [2023-12-28 01:46:24,367][106226] Updated weights for policy 0, policy_version 907038 (0.0009) [2023-12-28 01:46:24,433][106226] Updated weights for policy 0, policy_version 907048 (0.0006) [2023-12-28 01:46:24,625][106225] Updated weights for policy 1, policy_version 909319 (0.0006) [2023-12-28 01:46:24,687][106225] Updated weights for policy 1, policy_version 909329 (0.0006) [2023-12-28 01:46:24,758][106225] Updated weights for policy 1, policy_version 909339 (0.0006) [2023-12-28 01:46:25,101][106226] Updated weights for policy 0, policy_version 907058 (0.0005) [2023-12-28 01:46:25,154][106226] Updated weights for policy 0, policy_version 907068 (0.0005) [2023-12-28 01:46:25,210][106226] Updated weights for policy 0, policy_version 907078 (0.0007) [2023-12-28 01:46:25,361][106225] Updated weights for policy 1, policy_version 909349 (0.0008) [2023-12-28 01:46:25,413][106225] Updated weights for policy 1, policy_version 909359 (0.0007) [2023-12-28 01:46:25,458][106225] Updated weights for policy 1, policy_version 909369 (0.0005) [2023-12-28 01:46:25,818][106226] Updated weights for policy 0, policy_version 907088 (0.0006) [2023-12-28 01:46:25,879][106226] Updated weights for policy 0, policy_version 907098 (0.0005) [2023-12-28 01:46:25,943][106226] Updated weights for policy 0, policy_version 907108 (0.0005) [2023-12-28 01:46:26,084][106225] Updated weights for policy 1, policy_version 909379 (0.0005) [2023-12-28 01:46:26,141][106225] Updated weights for policy 1, policy_version 909389 (0.0010) [2023-12-28 01:46:26,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 465117184. Throughput: 0: 9516.8, 1: 9893.1. Samples: 465084420. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:26,176][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.892')] [2023-12-28 01:46:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000907112_232275968.pth... [2023-12-28 01:46:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000905992_231989248.pth [2023-12-28 01:46:26,192][106225] Updated weights for policy 1, policy_version 909399 (0.0010) [2023-12-28 01:46:26,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000909408_232849408.pth... [2023-12-28 01:46:26,240][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000908224_232546304.pth [2023-12-28 01:46:26,564][106226] Updated weights for policy 0, policy_version 907118 (0.0007) [2023-12-28 01:46:26,607][106226] Updated weights for policy 0, policy_version 907128 (0.0008) [2023-12-28 01:46:26,656][106226] Updated weights for policy 0, policy_version 907138 (0.0007) [2023-12-28 01:46:26,891][106225] Updated weights for policy 1, policy_version 909409 (0.0010) [2023-12-28 01:46:26,949][106225] Updated weights for policy 1, policy_version 909419 (0.0009) [2023-12-28 01:46:26,993][106225] Updated weights for policy 1, policy_version 909429 (0.0008) [2023-12-28 01:46:27,054][106225] Updated weights for policy 1, policy_version 909439 (0.0008) [2023-12-28 01:46:27,376][106226] Updated weights for policy 0, policy_version 907148 (0.0008) [2023-12-28 01:46:27,438][106226] Updated weights for policy 0, policy_version 907158 (0.0009) [2023-12-28 01:46:27,495][106226] Updated weights for policy 0, policy_version 907168 (0.0009) [2023-12-28 01:46:27,777][106225] Updated weights for policy 1, policy_version 909449 (0.0010) [2023-12-28 01:46:27,833][106225] Updated weights for policy 1, policy_version 909459 (0.0010) [2023-12-28 01:46:27,889][106225] Updated weights for policy 1, policy_version 909469 (0.0010) [2023-12-28 01:46:28,197][106226] Updated weights for policy 0, policy_version 907178 (0.0008) [2023-12-28 01:46:28,261][106226] Updated weights for policy 0, policy_version 907188 (0.0008) [2023-12-28 01:46:28,310][106226] Updated weights for policy 0, policy_version 907198 (0.0008) [2023-12-28 01:46:28,377][106226] Updated weights for policy 0, policy_version 907208 (0.0007) [2023-12-28 01:46:28,625][106225] Updated weights for policy 1, policy_version 909479 (0.0009) [2023-12-28 01:46:28,683][106225] Updated weights for policy 1, policy_version 909489 (0.0007) [2023-12-28 01:46:28,744][106225] Updated weights for policy 1, policy_version 909499 (0.0010) [2023-12-28 01:46:29,132][106226] Updated weights for policy 0, policy_version 907218 (0.0006) [2023-12-28 01:46:29,195][106226] Updated weights for policy 0, policy_version 907228 (0.0006) [2023-12-28 01:46:29,267][106226] Updated weights for policy 0, policy_version 907238 (0.0007) [2023-12-28 01:46:29,400][106225] Updated weights for policy 1, policy_version 909509 (0.0009) [2023-12-28 01:46:29,454][106225] Updated weights for policy 1, policy_version 909519 (0.0010) [2023-12-28 01:46:29,508][106225] Updated weights for policy 1, policy_version 909529 (0.0010) [2023-12-28 01:46:30,031][106226] Updated weights for policy 0, policy_version 907248 (0.0009) [2023-12-28 01:46:30,093][106226] Updated weights for policy 0, policy_version 907258 (0.0008) [2023-12-28 01:46:30,157][106226] Updated weights for policy 0, policy_version 907268 (0.0009) [2023-12-28 01:46:30,207][106225] Updated weights for policy 1, policy_version 909539 (0.0010) [2023-12-28 01:46:30,261][106225] Updated weights for policy 1, policy_version 909549 (0.0008) [2023-12-28 01:46:30,316][106225] Updated weights for policy 1, policy_version 909559 (0.0008) [2023-12-28 01:46:30,915][106226] Updated weights for policy 0, policy_version 907278 (0.0008) [2023-12-28 01:46:30,929][106225] Updated weights for policy 1, policy_version 909569 (0.0008) [2023-12-28 01:46:30,968][106226] Updated weights for policy 0, policy_version 907288 (0.0008) [2023-12-28 01:46:30,975][106225] Updated weights for policy 1, policy_version 909579 (0.0005) [2023-12-28 01:46:31,021][106226] Updated weights for policy 0, policy_version 907298 (0.0008) [2023-12-28 01:46:31,025][106225] Updated weights for policy 1, policy_version 909589 (0.0006) [2023-12-28 01:46:31,089][106225] Updated weights for policy 1, policy_version 909599 (0.0009) [2023-12-28 01:46:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 465223680. Throughput: 0: 9583.9, 1: 9979.4. Samples: 465206720. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:31,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.962')] [2023-12-28 01:46:31,798][106226] Updated weights for policy 0, policy_version 907308 (0.0008) [2023-12-28 01:46:31,824][106225] Updated weights for policy 1, policy_version 909609 (0.0007) [2023-12-28 01:46:31,864][106226] Updated weights for policy 0, policy_version 907318 (0.0008) [2023-12-28 01:46:31,882][106225] Updated weights for policy 1, policy_version 909619 (0.0007) [2023-12-28 01:46:31,933][106226] Updated weights for policy 0, policy_version 907328 (0.0008) [2023-12-28 01:46:31,940][106225] Updated weights for policy 1, policy_version 909629 (0.0006) [2023-12-28 01:46:32,547][106225] Updated weights for policy 1, policy_version 909639 (0.0008) [2023-12-28 01:46:32,599][106225] Updated weights for policy 1, policy_version 909649 (0.0008) [2023-12-28 01:46:32,601][106226] Updated weights for policy 0, policy_version 907338 (0.0008) [2023-12-28 01:46:32,657][106225] Updated weights for policy 1, policy_version 909659 (0.0006) [2023-12-28 01:46:32,663][106226] Updated weights for policy 0, policy_version 907348 (0.0006) [2023-12-28 01:46:32,732][106226] Updated weights for policy 0, policy_version 907358 (0.0009) [2023-12-28 01:46:32,790][106226] Updated weights for policy 0, policy_version 907368 (0.0009) [2023-12-28 01:46:33,397][106225] Updated weights for policy 1, policy_version 909669 (0.0007) [2023-12-28 01:46:33,412][106226] Updated weights for policy 0, policy_version 907378 (0.0005) [2023-12-28 01:46:33,448][106225] Updated weights for policy 1, policy_version 909679 (0.0007) [2023-12-28 01:46:33,464][106226] Updated weights for policy 0, policy_version 907388 (0.0008) [2023-12-28 01:46:33,505][106225] Updated weights for policy 1, policy_version 909689 (0.0008) [2023-12-28 01:46:33,521][106226] Updated weights for policy 0, policy_version 907398 (0.0005) [2023-12-28 01:46:34,203][106226] Updated weights for policy 0, policy_version 907408 (0.0008) [2023-12-28 01:46:34,242][106225] Updated weights for policy 1, policy_version 909699 (0.0007) [2023-12-28 01:46:34,260][106226] Updated weights for policy 0, policy_version 907418 (0.0008) [2023-12-28 01:46:34,303][106225] Updated weights for policy 1, policy_version 909709 (0.0007) [2023-12-28 01:46:34,318][106226] Updated weights for policy 0, policy_version 907428 (0.0006) [2023-12-28 01:46:34,369][106225] Updated weights for policy 1, policy_version 909719 (0.0007) [2023-12-28 01:46:34,968][106226] Updated weights for policy 0, policy_version 907438 (0.0008) [2023-12-28 01:46:35,021][106226] Updated weights for policy 0, policy_version 907448 (0.0009) [2023-12-28 01:46:35,053][106225] Updated weights for policy 1, policy_version 909729 (0.0009) [2023-12-28 01:46:35,073][106226] Updated weights for policy 0, policy_version 907458 (0.0007) [2023-12-28 01:46:35,112][106225] Updated weights for policy 1, policy_version 909739 (0.0006) [2023-12-28 01:46:35,166][106225] Updated weights for policy 1, policy_version 909749 (0.0010) [2023-12-28 01:46:35,222][106225] Updated weights for policy 1, policy_version 909759 (0.0010) [2023-12-28 01:46:35,859][106225] Updated weights for policy 1, policy_version 909769 (0.0006) [2023-12-28 01:46:35,861][106226] Updated weights for policy 0, policy_version 907468 (0.0008) [2023-12-28 01:46:35,913][106225] Updated weights for policy 1, policy_version 909779 (0.0005) [2023-12-28 01:46:35,918][106226] Updated weights for policy 0, policy_version 907478 (0.0010) [2023-12-28 01:46:35,967][106225] Updated weights for policy 1, policy_version 909789 (0.0005) [2023-12-28 01:46:35,971][106226] Updated weights for policy 0, policy_version 907488 (0.0010) [2023-12-28 01:46:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 465321984. Throughput: 0: 9563.8, 1: 9995.3. Samples: 465326052. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:36,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-5.002')] [2023-12-28 01:46:36,660][106225] Updated weights for policy 1, policy_version 909799 (0.0009) [2023-12-28 01:46:36,715][106225] Updated weights for policy 1, policy_version 909809 (0.0010) [2023-12-28 01:46:36,727][106226] Updated weights for policy 0, policy_version 907498 (0.0010) [2023-12-28 01:46:36,770][106225] Updated weights for policy 1, policy_version 909819 (0.0010) [2023-12-28 01:46:36,785][106226] Updated weights for policy 0, policy_version 907508 (0.0011) [2023-12-28 01:46:36,848][106226] Updated weights for policy 0, policy_version 907518 (0.0011) [2023-12-28 01:46:36,910][106226] Updated weights for policy 0, policy_version 907528 (0.0009) [2023-12-28 01:46:37,491][106225] Updated weights for policy 1, policy_version 909829 (0.0009) [2023-12-28 01:46:37,547][106225] Updated weights for policy 1, policy_version 909839 (0.0007) [2023-12-28 01:46:37,593][106226] Updated weights for policy 0, policy_version 907538 (0.0010) [2023-12-28 01:46:37,599][106225] Updated weights for policy 1, policy_version 909849 (0.0007) [2023-12-28 01:46:37,657][106226] Updated weights for policy 0, policy_version 907548 (0.0011) [2023-12-28 01:46:37,724][106226] Updated weights for policy 0, policy_version 907558 (0.0011) [2023-12-28 01:46:38,263][106225] Updated weights for policy 1, policy_version 909859 (0.0007) [2023-12-28 01:46:38,326][106225] Updated weights for policy 1, policy_version 909869 (0.0008) [2023-12-28 01:46:38,391][106225] Updated weights for policy 1, policy_version 909879 (0.0008) [2023-12-28 01:46:38,398][106226] Updated weights for policy 0, policy_version 907568 (0.0011) [2023-12-28 01:46:38,462][106226] Updated weights for policy 0, policy_version 907578 (0.0011) [2023-12-28 01:46:38,517][106226] Updated weights for policy 0, policy_version 907588 (0.0011) [2023-12-28 01:46:39,068][106225] Updated weights for policy 1, policy_version 909889 (0.0005) [2023-12-28 01:46:39,117][106226] Updated weights for policy 0, policy_version 907598 (0.0010) [2023-12-28 01:46:39,119][106225] Updated weights for policy 1, policy_version 909899 (0.0008) [2023-12-28 01:46:39,177][106226] Updated weights for policy 0, policy_version 907608 (0.0005) [2023-12-28 01:46:39,177][106225] Updated weights for policy 1, policy_version 909909 (0.0008) [2023-12-28 01:46:39,242][106226] Updated weights for policy 0, policy_version 907618 (0.0008) [2023-12-28 01:46:39,245][106225] Updated weights for policy 1, policy_version 909919 (0.0008) [2023-12-28 01:46:39,911][106225] Updated weights for policy 1, policy_version 909929 (0.0008) [2023-12-28 01:46:39,976][106225] Updated weights for policy 1, policy_version 909939 (0.0008) [2023-12-28 01:46:40,037][106226] Updated weights for policy 0, policy_version 907628 (0.0007) [2023-12-28 01:46:40,043][106225] Updated weights for policy 1, policy_version 909949 (0.0007) [2023-12-28 01:46:40,103][106226] Updated weights for policy 0, policy_version 907638 (0.0007) [2023-12-28 01:46:40,166][106226] Updated weights for policy 0, policy_version 907648 (0.0008) [2023-12-28 01:46:40,756][106225] Updated weights for policy 1, policy_version 909959 (0.0007) [2023-12-28 01:46:40,817][106225] Updated weights for policy 1, policy_version 909969 (0.0008) [2023-12-28 01:46:40,878][106225] Updated weights for policy 1, policy_version 909979 (0.0008) [2023-12-28 01:46:40,899][106226] Updated weights for policy 0, policy_version 907658 (0.0008) [2023-12-28 01:46:40,951][106226] Updated weights for policy 0, policy_version 907668 (0.0007) [2023-12-28 01:46:41,006][106226] Updated weights for policy 0, policy_version 907678 (0.0006) [2023-12-28 01:46:41,075][106226] Updated weights for policy 0, policy_version 907688 (0.0007) [2023-12-28 01:46:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 465420288. Throughput: 0: 9609.8, 1: 10011.2. Samples: 465386360. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:41,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.160')] [2023-12-28 01:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000909984_232996864.pth... [2023-12-28 01:46:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000907688_232423424.pth... [2023-12-28 01:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000908800_232693760.pth [2023-12-28 01:46:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000906536_232128512.pth [2023-12-28 01:46:41,625][106225] Updated weights for policy 1, policy_version 909989 (0.0009) [2023-12-28 01:46:41,691][106225] Updated weights for policy 1, policy_version 909999 (0.0009) [2023-12-28 01:46:41,765][106225] Updated weights for policy 1, policy_version 910009 (0.0009) [2023-12-28 01:46:41,819][106226] Updated weights for policy 0, policy_version 907698 (0.0008) [2023-12-28 01:46:41,879][106226] Updated weights for policy 0, policy_version 907708 (0.0008) [2023-12-28 01:46:41,935][106226] Updated weights for policy 0, policy_version 907718 (0.0008) [2023-12-28 01:46:42,501][106225] Updated weights for policy 1, policy_version 910019 (0.0007) [2023-12-28 01:46:42,563][106225] Updated weights for policy 1, policy_version 910029 (0.0008) [2023-12-28 01:46:42,625][106225] Updated weights for policy 1, policy_version 910039 (0.0008) [2023-12-28 01:46:42,706][106226] Updated weights for policy 0, policy_version 907728 (0.0007) [2023-12-28 01:46:42,762][106226] Updated weights for policy 0, policy_version 907738 (0.0008) [2023-12-28 01:46:42,821][106226] Updated weights for policy 0, policy_version 907748 (0.0009) [2023-12-28 01:46:43,379][106225] Updated weights for policy 1, policy_version 910049 (0.0008) [2023-12-28 01:46:43,432][106225] Updated weights for policy 1, policy_version 910059 (0.0007) [2023-12-28 01:46:43,471][106226] Updated weights for policy 0, policy_version 907758 (0.0007) [2023-12-28 01:46:43,488][106225] Updated weights for policy 1, policy_version 910069 (0.0008) [2023-12-28 01:46:43,523][106226] Updated weights for policy 0, policy_version 907768 (0.0005) [2023-12-28 01:46:43,548][106225] Updated weights for policy 1, policy_version 910079 (0.0008) [2023-12-28 01:46:43,576][106226] Updated weights for policy 0, policy_version 907778 (0.0005) [2023-12-28 01:46:44,213][106226] Updated weights for policy 0, policy_version 907788 (0.0007) [2023-12-28 01:46:44,270][106226] Updated weights for policy 0, policy_version 907798 (0.0007) [2023-12-28 01:46:44,282][106225] Updated weights for policy 1, policy_version 910089 (0.0008) [2023-12-28 01:46:44,320][106226] Updated weights for policy 0, policy_version 907808 (0.0007) [2023-12-28 01:46:44,338][106225] Updated weights for policy 1, policy_version 910099 (0.0008) [2023-12-28 01:46:44,389][106225] Updated weights for policy 1, policy_version 910109 (0.0007) [2023-12-28 01:46:44,996][106226] Updated weights for policy 0, policy_version 907818 (0.0007) [2023-12-28 01:46:45,055][106226] Updated weights for policy 0, policy_version 907828 (0.0008) [2023-12-28 01:46:45,115][106226] Updated weights for policy 0, policy_version 907838 (0.0008) [2023-12-28 01:46:45,174][106225] Updated weights for policy 1, policy_version 910119 (0.0008) [2023-12-28 01:46:45,178][106226] Updated weights for policy 0, policy_version 907848 (0.0008) [2023-12-28 01:46:45,235][106225] Updated weights for policy 1, policy_version 910129 (0.0007) [2023-12-28 01:46:45,295][106225] Updated weights for policy 1, policy_version 910139 (0.0006) [2023-12-28 01:46:45,808][106226] Updated weights for policy 0, policy_version 907858 (0.0005) [2023-12-28 01:46:45,873][106226] Updated weights for policy 0, policy_version 907868 (0.0005) [2023-12-28 01:46:45,931][106226] Updated weights for policy 0, policy_version 907878 (0.0005) [2023-12-28 01:46:46,019][106225] Updated weights for policy 1, policy_version 910149 (0.0008) [2023-12-28 01:46:46,068][106225] Updated weights for policy 1, policy_version 910159 (0.0009) [2023-12-28 01:46:46,120][106225] Updated weights for policy 1, policy_version 910169 (0.0009) [2023-12-28 01:46:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 465518592. Throughput: 0: 9632.2, 1: 9924.3. Samples: 465501848. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:46,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.973')] [2023-12-28 01:46:46,453][106226] Updated weights for policy 0, policy_version 907888 (0.0007) [2023-12-28 01:46:46,508][106226] Updated weights for policy 0, policy_version 907898 (0.0005) [2023-12-28 01:46:46,566][106226] Updated weights for policy 0, policy_version 907908 (0.0005) [2023-12-28 01:46:46,780][106225] Updated weights for policy 1, policy_version 910179 (0.0008) [2023-12-28 01:46:46,828][106225] Updated weights for policy 1, policy_version 910189 (0.0009) [2023-12-28 01:46:46,879][106225] Updated weights for policy 1, policy_version 910199 (0.0009) [2023-12-28 01:46:47,099][106226] Updated weights for policy 0, policy_version 907918 (0.0008) [2023-12-28 01:46:47,158][106226] Updated weights for policy 0, policy_version 907928 (0.0010) [2023-12-28 01:46:47,217][106226] Updated weights for policy 0, policy_version 907938 (0.0010) [2023-12-28 01:46:47,572][106225] Updated weights for policy 1, policy_version 910209 (0.0010) [2023-12-28 01:46:47,637][106225] Updated weights for policy 1, policy_version 910219 (0.0007) [2023-12-28 01:46:47,701][106225] Updated weights for policy 1, policy_version 910229 (0.0010) [2023-12-28 01:46:47,755][106225] Updated weights for policy 1, policy_version 910239 (0.0010) [2023-12-28 01:46:47,906][106226] Updated weights for policy 0, policy_version 907948 (0.0010) [2023-12-28 01:46:47,966][106226] Updated weights for policy 0, policy_version 907958 (0.0010) [2023-12-28 01:46:48,024][106226] Updated weights for policy 0, policy_version 907968 (0.0010) [2023-12-28 01:46:48,461][106225] Updated weights for policy 1, policy_version 910249 (0.0008) [2023-12-28 01:46:48,521][106225] Updated weights for policy 1, policy_version 910259 (0.0006) [2023-12-28 01:46:48,570][106225] Updated weights for policy 1, policy_version 910269 (0.0006) [2023-12-28 01:46:48,731][106226] Updated weights for policy 0, policy_version 907978 (0.0010) [2023-12-28 01:46:48,794][106226] Updated weights for policy 0, policy_version 907988 (0.0011) [2023-12-28 01:46:48,858][106226] Updated weights for policy 0, policy_version 907998 (0.0011) [2023-12-28 01:46:48,916][106226] Updated weights for policy 0, policy_version 908008 (0.0008) [2023-12-28 01:46:49,182][106225] Updated weights for policy 1, policy_version 910279 (0.0005) [2023-12-28 01:46:49,238][106225] Updated weights for policy 1, policy_version 910289 (0.0006) [2023-12-28 01:46:49,302][106225] Updated weights for policy 1, policy_version 910299 (0.0010) [2023-12-28 01:46:49,624][106226] Updated weights for policy 0, policy_version 908018 (0.0010) [2023-12-28 01:46:49,686][106226] Updated weights for policy 0, policy_version 908028 (0.0006) [2023-12-28 01:46:49,752][106226] Updated weights for policy 0, policy_version 908038 (0.0005) [2023-12-28 01:46:50,048][106225] Updated weights for policy 1, policy_version 910309 (0.0011) [2023-12-28 01:46:50,112][106225] Updated weights for policy 1, policy_version 910319 (0.0006) [2023-12-28 01:46:50,180][106225] Updated weights for policy 1, policy_version 910329 (0.0005) [2023-12-28 01:46:50,438][106226] Updated weights for policy 0, policy_version 908048 (0.0010) [2023-12-28 01:46:50,492][106226] Updated weights for policy 0, policy_version 908058 (0.0011) [2023-12-28 01:46:50,552][106226] Updated weights for policy 0, policy_version 908068 (0.0010) [2023-12-28 01:46:50,820][106225] Updated weights for policy 1, policy_version 910339 (0.0010) [2023-12-28 01:46:50,884][106225] Updated weights for policy 1, policy_version 910349 (0.0008) [2023-12-28 01:46:50,949][106225] Updated weights for policy 1, policy_version 910359 (0.0008) [2023-12-28 01:46:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 465616896. Throughput: 0: 9767.0, 1: 9952.4. Samples: 465625656. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:51,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-5.102')] [2023-12-28 01:46:51,304][106226] Updated weights for policy 0, policy_version 908078 (0.0009) [2023-12-28 01:46:51,378][106226] Updated weights for policy 0, policy_version 908088 (0.0009) [2023-12-28 01:46:51,444][106226] Updated weights for policy 0, policy_version 908098 (0.0007) [2023-12-28 01:46:51,681][106225] Updated weights for policy 1, policy_version 910369 (0.0007) [2023-12-28 01:46:51,749][106225] Updated weights for policy 1, policy_version 910379 (0.0008) [2023-12-28 01:46:51,814][106225] Updated weights for policy 1, policy_version 910389 (0.0009) [2023-12-28 01:46:51,878][106225] Updated weights for policy 1, policy_version 910399 (0.0008) [2023-12-28 01:46:52,227][106226] Updated weights for policy 0, policy_version 908108 (0.0009) [2023-12-28 01:46:52,296][106226] Updated weights for policy 0, policy_version 908118 (0.0011) [2023-12-28 01:46:52,369][106226] Updated weights for policy 0, policy_version 908128 (0.0009) [2023-12-28 01:46:52,630][106225] Updated weights for policy 1, policy_version 910409 (0.0007) [2023-12-28 01:46:52,684][106225] Updated weights for policy 1, policy_version 910419 (0.0007) [2023-12-28 01:46:52,753][106225] Updated weights for policy 1, policy_version 910429 (0.0006) [2023-12-28 01:46:53,078][106226] Updated weights for policy 0, policy_version 908138 (0.0011) [2023-12-28 01:46:53,131][106226] Updated weights for policy 0, policy_version 908148 (0.0010) [2023-12-28 01:46:53,184][106226] Updated weights for policy 0, policy_version 908158 (0.0010) [2023-12-28 01:46:53,244][106226] Updated weights for policy 0, policy_version 908168 (0.0011) [2023-12-28 01:46:53,323][106225] Updated weights for policy 1, policy_version 910439 (0.0006) [2023-12-28 01:46:53,388][106225] Updated weights for policy 1, policy_version 910449 (0.0005) [2023-12-28 01:46:53,444][106225] Updated weights for policy 1, policy_version 910459 (0.0008) [2023-12-28 01:46:53,965][106226] Updated weights for policy 0, policy_version 908178 (0.0010) [2023-12-28 01:46:54,013][106226] Updated weights for policy 0, policy_version 908188 (0.0010) [2023-12-28 01:46:54,069][106226] Updated weights for policy 0, policy_version 908198 (0.0010) [2023-12-28 01:46:54,118][106225] Updated weights for policy 1, policy_version 910469 (0.0007) [2023-12-28 01:46:54,176][106225] Updated weights for policy 1, policy_version 910479 (0.0008) [2023-12-28 01:46:54,234][106225] Updated weights for policy 1, policy_version 910489 (0.0007) [2023-12-28 01:46:54,758][106226] Updated weights for policy 0, policy_version 908208 (0.0010) [2023-12-28 01:46:54,818][106226] Updated weights for policy 0, policy_version 908218 (0.0010) [2023-12-28 01:46:54,869][106226] Updated weights for policy 0, policy_version 908228 (0.0009) [2023-12-28 01:46:54,983][106225] Updated weights for policy 1, policy_version 910499 (0.0008) [2023-12-28 01:46:55,045][106225] Updated weights for policy 1, policy_version 910509 (0.0006) [2023-12-28 01:46:55,107][106225] Updated weights for policy 1, policy_version 910519 (0.0007) [2023-12-28 01:46:55,491][106226] Updated weights for policy 0, policy_version 908238 (0.0008) [2023-12-28 01:46:55,557][106226] Updated weights for policy 0, policy_version 908248 (0.0011) [2023-12-28 01:46:55,622][106226] Updated weights for policy 0, policy_version 908258 (0.0011) [2023-12-28 01:46:55,697][106225] Updated weights for policy 1, policy_version 910529 (0.0006) [2023-12-28 01:46:55,753][106225] Updated weights for policy 1, policy_version 910539 (0.0008) [2023-12-28 01:46:55,803][106225] Updated weights for policy 1, policy_version 910549 (0.0006) [2023-12-28 01:46:55,858][106225] Updated weights for policy 1, policy_version 910559 (0.0005) [2023-12-28 01:46:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 465715200. Throughput: 0: 9784.8, 1: 9963.1. Samples: 465684188. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:46:56,175][105115] Avg episode reward: [(0, '-4.237'), (1, '-5.041')] [2023-12-28 01:46:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000910560_233144320.pth... [2023-12-28 01:46:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000908264_232570880.pth... [2023-12-28 01:46:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000907112_232275968.pth [2023-12-28 01:46:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000909408_232849408.pth [2023-12-28 01:46:56,254][106226] Updated weights for policy 0, policy_version 908268 (0.0009) [2023-12-28 01:46:56,300][106226] Updated weights for policy 0, policy_version 908278 (0.0005) [2023-12-28 01:46:56,346][106226] Updated weights for policy 0, policy_version 908288 (0.0006) [2023-12-28 01:46:56,569][106225] Updated weights for policy 1, policy_version 910569 (0.0008) [2023-12-28 01:46:56,623][106225] Updated weights for policy 1, policy_version 910580 (0.0008) [2023-12-28 01:46:56,673][106225] Updated weights for policy 1, policy_version 910590 (0.0005) [2023-12-28 01:46:56,925][106226] Updated weights for policy 0, policy_version 908298 (0.0006) [2023-12-28 01:46:56,974][106226] Updated weights for policy 0, policy_version 908308 (0.0009) [2023-12-28 01:46:57,027][106226] Updated weights for policy 0, policy_version 908318 (0.0008) [2023-12-28 01:46:57,077][106226] Updated weights for policy 0, policy_version 908328 (0.0008) [2023-12-28 01:46:57,286][106225] Updated weights for policy 1, policy_version 910600 (0.0006) [2023-12-28 01:46:57,340][106225] Updated weights for policy 1, policy_version 910610 (0.0009) [2023-12-28 01:46:57,399][106225] Updated weights for policy 1, policy_version 910620 (0.0007) [2023-12-28 01:46:57,737][106226] Updated weights for policy 0, policy_version 908338 (0.0006) [2023-12-28 01:46:57,798][106226] Updated weights for policy 0, policy_version 908348 (0.0005) [2023-12-28 01:46:57,857][106226] Updated weights for policy 0, policy_version 908358 (0.0008) [2023-12-28 01:46:58,085][106225] Updated weights for policy 1, policy_version 910630 (0.0008) [2023-12-28 01:46:58,143][106225] Updated weights for policy 1, policy_version 910640 (0.0008) [2023-12-28 01:46:58,207][106225] Updated weights for policy 1, policy_version 910650 (0.0007) [2023-12-28 01:46:58,561][106226] Updated weights for policy 0, policy_version 908368 (0.0008) [2023-12-28 01:46:58,625][106226] Updated weights for policy 0, policy_version 908378 (0.0006) [2023-12-28 01:46:58,692][106226] Updated weights for policy 0, policy_version 908388 (0.0007) [2023-12-28 01:46:59,018][106225] Updated weights for policy 1, policy_version 910660 (0.0009) [2023-12-28 01:46:59,081][106225] Updated weights for policy 1, policy_version 910670 (0.0008) [2023-12-28 01:46:59,144][106225] Updated weights for policy 1, policy_version 910680 (0.0008) [2023-12-28 01:46:59,482][106226] Updated weights for policy 0, policy_version 908398 (0.0008) [2023-12-28 01:46:59,543][106226] Updated weights for policy 0, policy_version 908408 (0.0007) [2023-12-28 01:46:59,597][106226] Updated weights for policy 0, policy_version 908418 (0.0007) [2023-12-28 01:46:59,844][106225] Updated weights for policy 1, policy_version 910690 (0.0008) [2023-12-28 01:46:59,911][106225] Updated weights for policy 1, policy_version 910700 (0.0008) [2023-12-28 01:46:59,985][106225] Updated weights for policy 1, policy_version 910710 (0.0006) [2023-12-28 01:47:00,060][106225] Updated weights for policy 1, policy_version 910720 (0.0005) [2023-12-28 01:47:00,217][106226] Updated weights for policy 0, policy_version 908428 (0.0007) [2023-12-28 01:47:00,273][106226] Updated weights for policy 0, policy_version 908438 (0.0008) [2023-12-28 01:47:00,332][106226] Updated weights for policy 0, policy_version 908448 (0.0008) [2023-12-28 01:47:00,713][106225] Updated weights for policy 1, policy_version 910730 (0.0008) [2023-12-28 01:47:00,769][106225] Updated weights for policy 1, policy_version 910740 (0.0006) [2023-12-28 01:47:00,821][106225] Updated weights for policy 1, policy_version 910750 (0.0005) [2023-12-28 01:47:01,014][106226] Updated weights for policy 0, policy_version 908458 (0.0007) [2023-12-28 01:47:01,080][106226] Updated weights for policy 0, policy_version 908468 (0.0008) [2023-12-28 01:47:01,150][106226] Updated weights for policy 0, policy_version 908478 (0.0008) [2023-12-28 01:47:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 465813504. Throughput: 0: 9950.8, 1: 9970.4. Samples: 465805676. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:01,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.143')] [2023-12-28 01:47:01,206][106226] Updated weights for policy 0, policy_version 908488 (0.0009) [2023-12-28 01:47:01,526][106225] Updated weights for policy 1, policy_version 910760 (0.0009) [2023-12-28 01:47:01,589][106225] Updated weights for policy 1, policy_version 910770 (0.0008) [2023-12-28 01:47:01,655][106225] Updated weights for policy 1, policy_version 910780 (0.0009) [2023-12-28 01:47:01,888][106226] Updated weights for policy 0, policy_version 908498 (0.0005) [2023-12-28 01:47:01,952][106226] Updated weights for policy 0, policy_version 908508 (0.0005) [2023-12-28 01:47:02,037][106226] Updated weights for policy 0, policy_version 908518 (0.0008) [2023-12-28 01:47:02,393][106225] Updated weights for policy 1, policy_version 910790 (0.0008) [2023-12-28 01:47:02,458][106225] Updated weights for policy 1, policy_version 910800 (0.0006) [2023-12-28 01:47:02,527][106225] Updated weights for policy 1, policy_version 910810 (0.0007) [2023-12-28 01:47:02,695][106226] Updated weights for policy 0, policy_version 908528 (0.0006) [2023-12-28 01:47:02,759][106226] Updated weights for policy 0, policy_version 908538 (0.0007) [2023-12-28 01:47:02,828][106226] Updated weights for policy 0, policy_version 908548 (0.0011) [2023-12-28 01:47:03,234][106225] Updated weights for policy 1, policy_version 910820 (0.0008) [2023-12-28 01:47:03,292][106225] Updated weights for policy 1, policy_version 910830 (0.0009) [2023-12-28 01:47:03,360][106225] Updated weights for policy 1, policy_version 910840 (0.0005) [2023-12-28 01:47:03,418][106226] Updated weights for policy 0, policy_version 908558 (0.0008) [2023-12-28 01:47:03,471][106226] Updated weights for policy 0, policy_version 908568 (0.0009) [2023-12-28 01:47:03,526][106226] Updated weights for policy 0, policy_version 908578 (0.0007) [2023-12-28 01:47:04,056][106225] Updated weights for policy 1, policy_version 910850 (0.0007) [2023-12-28 01:47:04,128][106225] Updated weights for policy 1, policy_version 910860 (0.0008) [2023-12-28 01:47:04,186][106225] Updated weights for policy 1, policy_version 910870 (0.0008) [2023-12-28 01:47:04,239][106226] Updated weights for policy 0, policy_version 908588 (0.0008) [2023-12-28 01:47:04,249][106225] Updated weights for policy 1, policy_version 910880 (0.0008) [2023-12-28 01:47:04,301][106226] Updated weights for policy 0, policy_version 908598 (0.0011) [2023-12-28 01:47:04,360][106226] Updated weights for policy 0, policy_version 908608 (0.0010) [2023-12-28 01:47:04,895][106225] Updated weights for policy 1, policy_version 910890 (0.0008) [2023-12-28 01:47:04,951][106225] Updated weights for policy 1, policy_version 910900 (0.0005) [2023-12-28 01:47:05,009][106225] Updated weights for policy 1, policy_version 910910 (0.0007) [2023-12-28 01:47:05,097][106226] Updated weights for policy 0, policy_version 908618 (0.0011) [2023-12-28 01:47:05,150][106226] Updated weights for policy 0, policy_version 908628 (0.0010) [2023-12-28 01:47:05,216][106226] Updated weights for policy 0, policy_version 908638 (0.0009) [2023-12-28 01:47:05,266][106226] Updated weights for policy 0, policy_version 908648 (0.0008) [2023-12-28 01:47:05,674][106225] Updated weights for policy 1, policy_version 910920 (0.0010) [2023-12-28 01:47:05,729][106225] Updated weights for policy 1, policy_version 910930 (0.0010) [2023-12-28 01:47:05,794][106225] Updated weights for policy 1, policy_version 910940 (0.0010) [2023-12-28 01:47:05,975][106226] Updated weights for policy 0, policy_version 908658 (0.0008) [2023-12-28 01:47:06,037][106226] Updated weights for policy 0, policy_version 908668 (0.0008) [2023-12-28 01:47:06,089][106226] Updated weights for policy 0, policy_version 908678 (0.0007) [2023-12-28 01:47:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 465920000. Throughput: 0: 10007.1, 1: 9969.4. Samples: 465925260. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:06,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-5.116')] [2023-12-28 01:47:06,463][106225] Updated weights for policy 1, policy_version 910950 (0.0009) [2023-12-28 01:47:06,536][106225] Updated weights for policy 1, policy_version 910960 (0.0008) [2023-12-28 01:47:06,594][106225] Updated weights for policy 1, policy_version 910970 (0.0011) [2023-12-28 01:47:06,754][106226] Updated weights for policy 0, policy_version 908688 (0.0009) [2023-12-28 01:47:06,810][106226] Updated weights for policy 0, policy_version 908698 (0.0006) [2023-12-28 01:47:06,866][106226] Updated weights for policy 0, policy_version 908708 (0.0005) [2023-12-28 01:47:07,286][106225] Updated weights for policy 1, policy_version 910980 (0.0008) [2023-12-28 01:47:07,341][106225] Updated weights for policy 1, policy_version 910990 (0.0005) [2023-12-28 01:47:07,405][106225] Updated weights for policy 1, policy_version 911000 (0.0008) [2023-12-28 01:47:07,446][106226] Updated weights for policy 0, policy_version 908718 (0.0006) [2023-12-28 01:47:07,510][106226] Updated weights for policy 0, policy_version 908728 (0.0008) [2023-12-28 01:47:07,566][106226] Updated weights for policy 0, policy_version 908738 (0.0008) [2023-12-28 01:47:08,100][106225] Updated weights for policy 1, policy_version 911010 (0.0011) [2023-12-28 01:47:08,156][106225] Updated weights for policy 1, policy_version 911020 (0.0010) [2023-12-28 01:47:08,213][106225] Updated weights for policy 1, policy_version 911030 (0.0010) [2023-12-28 01:47:08,266][106225] Updated weights for policy 1, policy_version 911040 (0.0010) [2023-12-28 01:47:08,307][106226] Updated weights for policy 0, policy_version 908748 (0.0008) [2023-12-28 01:47:08,370][106226] Updated weights for policy 0, policy_version 908758 (0.0013) [2023-12-28 01:47:08,434][106226] Updated weights for policy 0, policy_version 908768 (0.0007) [2023-12-28 01:47:09,037][106225] Updated weights for policy 1, policy_version 911050 (0.0008) [2023-12-28 01:47:09,081][106225] Updated weights for policy 1, policy_version 911060 (0.0007) [2023-12-28 01:47:09,127][106225] Updated weights for policy 1, policy_version 911070 (0.0009) [2023-12-28 01:47:09,163][106226] Updated weights for policy 0, policy_version 908778 (0.0008) [2023-12-28 01:47:09,230][106226] Updated weights for policy 0, policy_version 908789 (0.0006) [2023-12-28 01:47:09,291][106226] Updated weights for policy 0, policy_version 908799 (0.0009) [2023-12-28 01:47:09,988][106225] Updated weights for policy 1, policy_version 911080 (0.0008) [2023-12-28 01:47:10,053][106225] Updated weights for policy 1, policy_version 911090 (0.0006) [2023-12-28 01:47:10,062][106226] Updated weights for policy 0, policy_version 908809 (0.0010) [2023-12-28 01:47:10,119][106225] Updated weights for policy 1, policy_version 911100 (0.0006) [2023-12-28 01:47:10,126][106226] Updated weights for policy 0, policy_version 908819 (0.0009) [2023-12-28 01:47:10,190][106226] Updated weights for policy 0, policy_version 908829 (0.0009) [2023-12-28 01:47:10,264][106226] Updated weights for policy 0, policy_version 908839 (0.0009) [2023-12-28 01:47:10,670][106225] Updated weights for policy 1, policy_version 911110 (0.0007) [2023-12-28 01:47:10,729][106225] Updated weights for policy 1, policy_version 911120 (0.0008) [2023-12-28 01:47:10,788][106225] Updated weights for policy 1, policy_version 911130 (0.0007) [2023-12-28 01:47:11,089][106226] Updated weights for policy 0, policy_version 908849 (0.0007) [2023-12-28 01:47:11,156][106226] Updated weights for policy 0, policy_version 908859 (0.0009) [2023-12-28 01:47:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 466010112. Throughput: 0: 10021.0, 1: 9991.9. Samples: 465984996. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:11,175][105115] Avg episode reward: [(0, '-4.146'), (1, '-5.255')] [2023-12-28 01:47:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000911136_233291776.pth... [2023-12-28 01:47:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000909984_232996864.pth [2023-12-28 01:47:11,216][106226] Updated weights for policy 0, policy_version 908869 (0.0008) [2023-12-28 01:47:11,231][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000908872_232726528.pth... [2023-12-28 01:47:11,236][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000907688_232423424.pth [2023-12-28 01:47:11,471][106225] Updated weights for policy 1, policy_version 911140 (0.0007) [2023-12-28 01:47:11,525][106225] Updated weights for policy 1, policy_version 911150 (0.0009) [2023-12-28 01:47:11,580][106225] Updated weights for policy 1, policy_version 911160 (0.0010) [2023-12-28 01:47:11,922][106226] Updated weights for policy 0, policy_version 908879 (0.0009) [2023-12-28 01:47:11,985][106226] Updated weights for policy 0, policy_version 908889 (0.0008) [2023-12-28 01:47:12,048][106226] Updated weights for policy 0, policy_version 908899 (0.0009) [2023-12-28 01:47:12,405][106225] Updated weights for policy 1, policy_version 911170 (0.0008) [2023-12-28 01:47:12,462][106225] Updated weights for policy 1, policy_version 911180 (0.0007) [2023-12-28 01:47:12,521][106225] Updated weights for policy 1, policy_version 911190 (0.0008) [2023-12-28 01:47:12,589][106225] Updated weights for policy 1, policy_version 911200 (0.0008) [2023-12-28 01:47:12,775][106226] Updated weights for policy 0, policy_version 908909 (0.0009) [2023-12-28 01:47:12,840][106226] Updated weights for policy 0, policy_version 908919 (0.0009) [2023-12-28 01:47:12,905][106226] Updated weights for policy 0, policy_version 908929 (0.0011) [2023-12-28 01:47:13,328][106225] Updated weights for policy 1, policy_version 911210 (0.0007) [2023-12-28 01:47:13,389][106225] Updated weights for policy 1, policy_version 911220 (0.0006) [2023-12-28 01:47:13,455][106225] Updated weights for policy 1, policy_version 911230 (0.0005) [2023-12-28 01:47:13,539][106226] Updated weights for policy 0, policy_version 908939 (0.0010) [2023-12-28 01:47:13,589][106226] Updated weights for policy 0, policy_version 908949 (0.0008) [2023-12-28 01:47:13,644][106226] Updated weights for policy 0, policy_version 908959 (0.0009) [2023-12-28 01:47:14,004][106225] Updated weights for policy 1, policy_version 911240 (0.0005) [2023-12-28 01:47:14,052][106225] Updated weights for policy 1, policy_version 911250 (0.0007) [2023-12-28 01:47:14,109][106225] Updated weights for policy 1, policy_version 911260 (0.0005) [2023-12-28 01:47:14,371][106226] Updated weights for policy 0, policy_version 908969 (0.0009) [2023-12-28 01:47:14,429][106226] Updated weights for policy 0, policy_version 908979 (0.0007) [2023-12-28 01:47:14,483][106226] Updated weights for policy 0, policy_version 908989 (0.0005) [2023-12-28 01:47:14,543][106226] Updated weights for policy 0, policy_version 908999 (0.0008) [2023-12-28 01:47:14,703][106225] Updated weights for policy 1, policy_version 911270 (0.0006) [2023-12-28 01:47:14,749][106225] Updated weights for policy 1, policy_version 911280 (0.0005) [2023-12-28 01:47:14,815][106225] Updated weights for policy 1, policy_version 911290 (0.0010) [2023-12-28 01:47:15,279][106226] Updated weights for policy 0, policy_version 909009 (0.0008) [2023-12-28 01:47:15,331][106226] Updated weights for policy 0, policy_version 909019 (0.0010) [2023-12-28 01:47:15,385][106226] Updated weights for policy 0, policy_version 909029 (0.0009) [2023-12-28 01:47:15,434][106225] Updated weights for policy 1, policy_version 911300 (0.0010) [2023-12-28 01:47:15,495][106225] Updated weights for policy 1, policy_version 911310 (0.0010) [2023-12-28 01:47:15,551][106225] Updated weights for policy 1, policy_version 911320 (0.0010) [2023-12-28 01:47:16,173][106225] Updated weights for policy 1, policy_version 911330 (0.0007) [2023-12-28 01:47:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.5, 300 sec: 19660.8). Total num frames: 466108416. Throughput: 0: 9960.5, 1: 9953.6. Samples: 466102852. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:16,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.908')] [2023-12-28 01:47:16,176][106226] Updated weights for policy 0, policy_version 909039 (0.0009) [2023-12-28 01:47:16,224][106226] Updated weights for policy 0, policy_version 909049 (0.0008) [2023-12-28 01:47:16,230][106225] Updated weights for policy 1, policy_version 911340 (0.0007) [2023-12-28 01:47:16,276][106226] Updated weights for policy 0, policy_version 909059 (0.0006) [2023-12-28 01:47:16,288][106225] Updated weights for policy 1, policy_version 911350 (0.0009) [2023-12-28 01:47:16,347][106225] Updated weights for policy 1, policy_version 911360 (0.0005) [2023-12-28 01:47:16,849][106226] Updated weights for policy 0, policy_version 909069 (0.0008) [2023-12-28 01:47:16,910][106226] Updated weights for policy 0, policy_version 909079 (0.0008) [2023-12-28 01:47:16,970][106226] Updated weights for policy 0, policy_version 909089 (0.0008) [2023-12-28 01:47:17,006][106225] Updated weights for policy 1, policy_version 911370 (0.0010) [2023-12-28 01:47:17,059][106225] Updated weights for policy 1, policy_version 911380 (0.0010) [2023-12-28 01:47:17,119][106225] Updated weights for policy 1, policy_version 911390 (0.0010) [2023-12-28 01:47:17,661][106226] Updated weights for policy 0, policy_version 909099 (0.0007) [2023-12-28 01:47:17,711][106226] Updated weights for policy 0, policy_version 909109 (0.0008) [2023-12-28 01:47:17,764][106226] Updated weights for policy 0, policy_version 909119 (0.0009) [2023-12-28 01:47:17,833][106225] Updated weights for policy 1, policy_version 911400 (0.0008) [2023-12-28 01:47:17,875][106225] Updated weights for policy 1, policy_version 911410 (0.0010) [2023-12-28 01:47:17,929][106225] Updated weights for policy 1, policy_version 911420 (0.0010) [2023-12-28 01:47:18,371][106226] Updated weights for policy 0, policy_version 909129 (0.0007) [2023-12-28 01:47:18,428][106226] Updated weights for policy 0, policy_version 909139 (0.0008) [2023-12-28 01:47:18,481][106226] Updated weights for policy 0, policy_version 909149 (0.0007) [2023-12-28 01:47:18,536][106226] Updated weights for policy 0, policy_version 909159 (0.0008) [2023-12-28 01:47:18,674][106225] Updated weights for policy 1, policy_version 911430 (0.0009) [2023-12-28 01:47:18,742][106225] Updated weights for policy 1, policy_version 911440 (0.0007) [2023-12-28 01:47:18,804][106225] Updated weights for policy 1, policy_version 911450 (0.0010) [2023-12-28 01:47:19,235][106226] Updated weights for policy 0, policy_version 909169 (0.0009) [2023-12-28 01:47:19,301][106226] Updated weights for policy 0, policy_version 909179 (0.0011) [2023-12-28 01:47:19,368][106226] Updated weights for policy 0, policy_version 909189 (0.0008) [2023-12-28 01:47:19,542][106225] Updated weights for policy 1, policy_version 911460 (0.0011) [2023-12-28 01:47:19,595][106225] Updated weights for policy 1, policy_version 911470 (0.0012) [2023-12-28 01:47:19,642][106225] Updated weights for policy 1, policy_version 911480 (0.0010) [2023-12-28 01:47:20,033][106226] Updated weights for policy 0, policy_version 909199 (0.0008) [2023-12-28 01:47:20,094][106226] Updated weights for policy 0, policy_version 909209 (0.0008) [2023-12-28 01:47:20,157][106226] Updated weights for policy 0, policy_version 909219 (0.0008) [2023-12-28 01:47:20,461][106225] Updated weights for policy 1, policy_version 911490 (0.0010) [2023-12-28 01:47:20,519][106225] Updated weights for policy 1, policy_version 911500 (0.0008) [2023-12-28 01:47:20,582][106225] Updated weights for policy 1, policy_version 911510 (0.0011) [2023-12-28 01:47:20,925][106226] Updated weights for policy 0, policy_version 909229 (0.0007) [2023-12-28 01:47:20,984][106226] Updated weights for policy 0, policy_version 909239 (0.0008) [2023-12-28 01:47:21,044][106226] Updated weights for policy 0, policy_version 909249 (0.0008) [2023-12-28 01:47:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 466214912. Throughput: 0: 10001.5, 1: 9905.5. Samples: 466221868. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:21,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.005')] [2023-12-28 01:47:21,394][106225] Updated weights for policy 1, policy_version 911521 (0.0010) [2023-12-28 01:47:21,453][106225] Updated weights for policy 1, policy_version 911531 (0.0007) [2023-12-28 01:47:21,518][106225] Updated weights for policy 1, policy_version 911541 (0.0008) [2023-12-28 01:47:21,586][106225] Updated weights for policy 1, policy_version 911551 (0.0008) [2023-12-28 01:47:21,813][106226] Updated weights for policy 0, policy_version 909259 (0.0009) [2023-12-28 01:47:21,871][106226] Updated weights for policy 0, policy_version 909269 (0.0008) [2023-12-28 01:47:21,922][106226] Updated weights for policy 0, policy_version 909279 (0.0005) [2023-12-28 01:47:22,349][106225] Updated weights for policy 1, policy_version 911561 (0.0008) [2023-12-28 01:47:22,412][106225] Updated weights for policy 1, policy_version 911571 (0.0009) [2023-12-28 01:47:22,478][106225] Updated weights for policy 1, policy_version 911581 (0.0008) [2023-12-28 01:47:22,648][106226] Updated weights for policy 0, policy_version 909289 (0.0007) [2023-12-28 01:47:22,704][106226] Updated weights for policy 0, policy_version 909299 (0.0009) [2023-12-28 01:47:22,767][106226] Updated weights for policy 0, policy_version 909309 (0.0009) [2023-12-28 01:47:22,829][106226] Updated weights for policy 0, policy_version 909319 (0.0008) [2023-12-28 01:47:23,209][106225] Updated weights for policy 1, policy_version 911591 (0.0010) [2023-12-28 01:47:23,260][106225] Updated weights for policy 1, policy_version 911601 (0.0010) [2023-12-28 01:47:23,314][106225] Updated weights for policy 1, policy_version 911611 (0.0010) [2023-12-28 01:47:23,564][106226] Updated weights for policy 0, policy_version 909329 (0.0008) [2023-12-28 01:47:23,613][106226] Updated weights for policy 0, policy_version 909339 (0.0009) [2023-12-28 01:47:23,659][106226] Updated weights for policy 0, policy_version 909349 (0.0008) [2023-12-28 01:47:23,941][106225] Updated weights for policy 1, policy_version 911621 (0.0008) [2023-12-28 01:47:24,010][106225] Updated weights for policy 1, policy_version 911631 (0.0008) [2023-12-28 01:47:24,064][106225] Updated weights for policy 1, policy_version 911641 (0.0010) [2023-12-28 01:47:24,386][106226] Updated weights for policy 0, policy_version 909359 (0.0009) [2023-12-28 01:47:24,441][106226] Updated weights for policy 0, policy_version 909369 (0.0009) [2023-12-28 01:47:24,491][106226] Updated weights for policy 0, policy_version 909379 (0.0009) [2023-12-28 01:47:24,677][106225] Updated weights for policy 1, policy_version 911651 (0.0010) [2023-12-28 01:47:24,736][106225] Updated weights for policy 1, policy_version 911661 (0.0010) [2023-12-28 01:47:24,790][106225] Updated weights for policy 1, policy_version 911671 (0.0010) [2023-12-28 01:47:25,251][106226] Updated weights for policy 0, policy_version 909389 (0.0007) [2023-12-28 01:47:25,312][106226] Updated weights for policy 0, policy_version 909399 (0.0008) [2023-12-28 01:47:25,372][106226] Updated weights for policy 0, policy_version 909409 (0.0008) [2023-12-28 01:47:25,506][106225] Updated weights for policy 1, policy_version 911681 (0.0010) [2023-12-28 01:47:25,575][106225] Updated weights for policy 1, policy_version 911691 (0.0011) [2023-12-28 01:47:25,629][106225] Updated weights for policy 1, policy_version 911701 (0.0010) [2023-12-28 01:47:25,690][106225] Updated weights for policy 1, policy_version 911711 (0.0009) [2023-12-28 01:47:26,119][106226] Updated weights for policy 0, policy_version 909419 (0.0008) [2023-12-28 01:47:26,170][106226] Updated weights for policy 0, policy_version 909429 (0.0009) [2023-12-28 01:47:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 466305024. Throughput: 0: 9944.2, 1: 9883.3. Samples: 466278596. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:26,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.150')] [2023-12-28 01:47:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000911712_233439232.pth... [2023-12-28 01:47:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000910560_233144320.pth [2023-12-28 01:47:26,222][106226] Updated weights for policy 0, policy_version 909439 (0.0009) [2023-12-28 01:47:26,272][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000909448_232873984.pth... [2023-12-28 01:47:26,277][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000908264_232570880.pth [2023-12-28 01:47:26,302][106225] Updated weights for policy 1, policy_version 911721 (0.0010) [2023-12-28 01:47:26,360][106225] Updated weights for policy 1, policy_version 911731 (0.0010) [2023-12-28 01:47:26,420][106225] Updated weights for policy 1, policy_version 911741 (0.0010) [2023-12-28 01:47:26,939][106226] Updated weights for policy 0, policy_version 909449 (0.0007) [2023-12-28 01:47:26,988][106226] Updated weights for policy 0, policy_version 909459 (0.0008) [2023-12-28 01:47:27,044][106226] Updated weights for policy 0, policy_version 909469 (0.0007) [2023-12-28 01:47:27,078][106225] Updated weights for policy 1, policy_version 911751 (0.0010) [2023-12-28 01:47:27,096][106226] Updated weights for policy 0, policy_version 909479 (0.0008) [2023-12-28 01:47:27,133][106225] Updated weights for policy 1, policy_version 911761 (0.0010) [2023-12-28 01:47:27,191][106225] Updated weights for policy 1, policy_version 911771 (0.0010) [2023-12-28 01:47:27,794][106226] Updated weights for policy 0, policy_version 909489 (0.0005) [2023-12-28 01:47:27,839][106226] Updated weights for policy 0, policy_version 909499 (0.0007) [2023-12-28 01:47:27,856][106225] Updated weights for policy 1, policy_version 911781 (0.0008) [2023-12-28 01:47:27,889][106226] Updated weights for policy 0, policy_version 909509 (0.0007) [2023-12-28 01:47:27,901][106225] Updated weights for policy 1, policy_version 911791 (0.0005) [2023-12-28 01:47:27,946][106225] Updated weights for policy 1, policy_version 911801 (0.0005) [2023-12-28 01:47:28,579][106225] Updated weights for policy 1, policy_version 911811 (0.0007) [2023-12-28 01:47:28,600][106226] Updated weights for policy 0, policy_version 909519 (0.0010) [2023-12-28 01:47:28,633][106225] Updated weights for policy 1, policy_version 911821 (0.0010) [2023-12-28 01:47:28,661][106226] Updated weights for policy 0, policy_version 909529 (0.0011) [2023-12-28 01:47:28,693][106225] Updated weights for policy 1, policy_version 911831 (0.0010) [2023-12-28 01:47:28,719][106226] Updated weights for policy 0, policy_version 909539 (0.0010) [2023-12-28 01:47:29,300][106225] Updated weights for policy 1, policy_version 911841 (0.0010) [2023-12-28 01:47:29,366][106225] Updated weights for policy 1, policy_version 911851 (0.0009) [2023-12-28 01:47:29,429][106225] Updated weights for policy 1, policy_version 911861 (0.0010) [2023-12-28 01:47:29,431][106226] Updated weights for policy 0, policy_version 909549 (0.0008) [2023-12-28 01:47:29,483][106225] Updated weights for policy 1, policy_version 911871 (0.0010) [2023-12-28 01:47:29,485][106226] Updated weights for policy 0, policy_version 909559 (0.0006) [2023-12-28 01:47:29,536][106226] Updated weights for policy 0, policy_version 909569 (0.0008) [2023-12-28 01:47:30,168][106225] Updated weights for policy 1, policy_version 911881 (0.0006) [2023-12-28 01:47:30,221][106225] Updated weights for policy 1, policy_version 911891 (0.0005) [2023-12-28 01:47:30,271][106226] Updated weights for policy 0, policy_version 909579 (0.0007) [2023-12-28 01:47:30,281][106225] Updated weights for policy 1, policy_version 911901 (0.0009) [2023-12-28 01:47:30,320][106226] Updated weights for policy 0, policy_version 909589 (0.0007) [2023-12-28 01:47:30,384][106226] Updated weights for policy 0, policy_version 909599 (0.0009) [2023-12-28 01:47:30,911][106225] Updated weights for policy 1, policy_version 911911 (0.0010) [2023-12-28 01:47:30,958][106225] Updated weights for policy 1, policy_version 911921 (0.0010) [2023-12-28 01:47:31,005][106225] Updated weights for policy 1, policy_version 911931 (0.0010) [2023-12-28 01:47:31,087][106226] Updated weights for policy 0, policy_version 909609 (0.0010) [2023-12-28 01:47:31,153][106226] Updated weights for policy 0, policy_version 909619 (0.0007) [2023-12-28 01:47:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 466411520. Throughput: 0: 9952.3, 1: 10032.4. Samples: 466401156. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:31,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-4.884')] [2023-12-28 01:47:31,205][106226] Updated weights for policy 0, policy_version 909629 (0.0008) [2023-12-28 01:47:31,267][106226] Updated weights for policy 0, policy_version 909639 (0.0008) [2023-12-28 01:47:31,751][106225] Updated weights for policy 1, policy_version 911941 (0.0009) [2023-12-28 01:47:31,806][106225] Updated weights for policy 1, policy_version 911951 (0.0007) [2023-12-28 01:47:31,854][106225] Updated weights for policy 1, policy_version 911961 (0.0008) [2023-12-28 01:47:32,049][106226] Updated weights for policy 0, policy_version 909649 (0.0009) [2023-12-28 01:47:32,109][106226] Updated weights for policy 0, policy_version 909659 (0.0010) [2023-12-28 01:47:32,160][106226] Updated weights for policy 0, policy_version 909669 (0.0010) [2023-12-28 01:47:32,564][106225] Updated weights for policy 1, policy_version 911971 (0.0007) [2023-12-28 01:47:32,618][106225] Updated weights for policy 1, policy_version 911981 (0.0008) [2023-12-28 01:47:32,668][106225] Updated weights for policy 1, policy_version 911991 (0.0008) [2023-12-28 01:47:32,921][106226] Updated weights for policy 0, policy_version 909679 (0.0009) [2023-12-28 01:47:32,992][106226] Updated weights for policy 0, policy_version 909689 (0.0008) [2023-12-28 01:47:33,059][106226] Updated weights for policy 0, policy_version 909699 (0.0010) [2023-12-28 01:47:33,265][106225] Updated weights for policy 1, policy_version 912001 (0.0007) [2023-12-28 01:47:33,319][106225] Updated weights for policy 1, policy_version 912011 (0.0006) [2023-12-28 01:47:33,376][106225] Updated weights for policy 1, policy_version 912021 (0.0005) [2023-12-28 01:47:33,426][106225] Updated weights for policy 1, policy_version 912031 (0.0005) [2023-12-28 01:47:33,696][106226] Updated weights for policy 0, policy_version 909709 (0.0008) [2023-12-28 01:47:33,748][106226] Updated weights for policy 0, policy_version 909719 (0.0007) [2023-12-28 01:47:33,800][106226] Updated weights for policy 0, policy_version 909729 (0.0010) [2023-12-28 01:47:34,046][106225] Updated weights for policy 1, policy_version 912041 (0.0005) [2023-12-28 01:47:34,094][106225] Updated weights for policy 1, policy_version 912051 (0.0006) [2023-12-28 01:47:34,153][106225] Updated weights for policy 1, policy_version 912061 (0.0008) [2023-12-28 01:47:34,491][106226] Updated weights for policy 0, policy_version 909739 (0.0009) [2023-12-28 01:47:34,556][106226] Updated weights for policy 0, policy_version 909749 (0.0006) [2023-12-28 01:47:34,623][106226] Updated weights for policy 0, policy_version 909759 (0.0009) [2023-12-28 01:47:34,828][106225] Updated weights for policy 1, policy_version 912071 (0.0008) [2023-12-28 01:47:34,886][106225] Updated weights for policy 1, policy_version 912081 (0.0007) [2023-12-28 01:47:34,952][106225] Updated weights for policy 1, policy_version 912091 (0.0008) [2023-12-28 01:47:35,314][106226] Updated weights for policy 0, policy_version 909769 (0.0011) [2023-12-28 01:47:35,377][106226] Updated weights for policy 0, policy_version 909779 (0.0011) [2023-12-28 01:47:35,438][106226] Updated weights for policy 0, policy_version 909789 (0.0011) [2023-12-28 01:47:35,502][106226] Updated weights for policy 0, policy_version 909799 (0.0010) [2023-12-28 01:47:35,622][106225] Updated weights for policy 1, policy_version 912101 (0.0008) [2023-12-28 01:47:35,681][106225] Updated weights for policy 1, policy_version 912111 (0.0007) [2023-12-28 01:47:35,746][106225] Updated weights for policy 1, policy_version 912121 (0.0006) [2023-12-28 01:47:36,170][106226] Updated weights for policy 0, policy_version 909809 (0.0009) [2023-12-28 01:47:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 466509824. Throughput: 0: 9862.3, 1: 10069.2. Samples: 466522576. Policy #0 lag: (min: 18.0, avg: 32.4, max: 50.0) [2023-12-28 01:47:36,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.822')] [2023-12-28 01:47:36,232][106226] Updated weights for policy 0, policy_version 909819 (0.0008) [2023-12-28 01:47:36,295][106226] Updated weights for policy 0, policy_version 909829 (0.0008) [2023-12-28 01:47:36,341][106225] Updated weights for policy 1, policy_version 912131 (0.0006) [2023-12-28 01:47:36,409][106225] Updated weights for policy 1, policy_version 912141 (0.0009) [2023-12-28 01:47:36,473][106225] Updated weights for policy 1, policy_version 912151 (0.0007) [2023-12-28 01:47:36,999][106226] Updated weights for policy 0, policy_version 909839 (0.0008) [2023-12-28 01:47:37,058][106226] Updated weights for policy 0, policy_version 909849 (0.0008) [2023-12-28 01:47:37,117][106226] Updated weights for policy 0, policy_version 909859 (0.0008) [2023-12-28 01:47:37,177][106225] Updated weights for policy 1, policy_version 912161 (0.0007) [2023-12-28 01:47:37,233][106225] Updated weights for policy 1, policy_version 912171 (0.0008) [2023-12-28 01:47:37,292][106225] Updated weights for policy 1, policy_version 912181 (0.0009) [2023-12-28 01:47:37,344][106225] Updated weights for policy 1, policy_version 912191 (0.0008) [2023-12-28 01:47:37,910][106226] Updated weights for policy 0, policy_version 909869 (0.0009) [2023-12-28 01:47:37,948][106225] Updated weights for policy 1, policy_version 912201 (0.0010) [2023-12-28 01:47:37,973][106226] Updated weights for policy 0, policy_version 909879 (0.0006) [2023-12-28 01:47:37,999][106225] Updated weights for policy 1, policy_version 912211 (0.0010) [2023-12-28 01:47:38,040][106226] Updated weights for policy 0, policy_version 909889 (0.0006) [2023-12-28 01:47:38,049][106225] Updated weights for policy 1, policy_version 912221 (0.0010) [2023-12-28 01:47:38,780][106226] Updated weights for policy 0, policy_version 909899 (0.0007) [2023-12-28 01:47:38,781][106225] Updated weights for policy 1, policy_version 912231 (0.0009) [2023-12-28 01:47:38,832][106226] Updated weights for policy 0, policy_version 909909 (0.0008) [2023-12-28 01:47:38,838][106225] Updated weights for policy 1, policy_version 912241 (0.0011) [2023-12-28 01:47:38,891][106226] Updated weights for policy 0, policy_version 909919 (0.0008) [2023-12-28 01:47:38,923][106225] Updated weights for policy 1, policy_version 912251 (0.0010) [2023-12-28 01:47:39,562][106226] Updated weights for policy 0, policy_version 909929 (0.0008) [2023-12-28 01:47:39,632][106225] Updated weights for policy 1, policy_version 912261 (0.0007) [2023-12-28 01:47:39,632][106226] Updated weights for policy 0, policy_version 909939 (0.0009) [2023-12-28 01:47:39,700][106225] Updated weights for policy 1, policy_version 912271 (0.0007) [2023-12-28 01:47:39,701][106226] Updated weights for policy 0, policy_version 909949 (0.0009) [2023-12-28 01:47:39,762][106225] Updated weights for policy 1, policy_version 912281 (0.0008) [2023-12-28 01:47:39,763][106226] Updated weights for policy 0, policy_version 909959 (0.0008) [2023-12-28 01:47:40,468][106225] Updated weights for policy 1, policy_version 912291 (0.0007) [2023-12-28 01:47:40,534][106225] Updated weights for policy 1, policy_version 912301 (0.0007) [2023-12-28 01:47:40,549][106226] Updated weights for policy 0, policy_version 909969 (0.0009) [2023-12-28 01:47:40,586][106225] Updated weights for policy 1, policy_version 912311 (0.0007) [2023-12-28 01:47:40,609][106226] Updated weights for policy 0, policy_version 909979 (0.0006) [2023-12-28 01:47:40,668][106226] Updated weights for policy 0, policy_version 909989 (0.0007) [2023-12-28 01:47:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 466608128. Throughput: 0: 9853.9, 1: 10089.8. Samples: 466581652. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:47:41,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-5.275')] [2023-12-28 01:47:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000912320_233594880.pth... [2023-12-28 01:47:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000909992_233013248.pth... [2023-12-28 01:47:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000911136_233291776.pth [2023-12-28 01:47:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000908872_232726528.pth [2023-12-28 01:47:41,368][106225] Updated weights for policy 1, policy_version 912321 (0.0007) [2023-12-28 01:47:41,374][106226] Updated weights for policy 0, policy_version 909999 (0.0010) [2023-12-28 01:47:41,436][106225] Updated weights for policy 1, policy_version 912331 (0.0007) [2023-12-28 01:47:41,439][106226] Updated weights for policy 0, policy_version 910009 (0.0009) [2023-12-28 01:47:41,498][106225] Updated weights for policy 1, policy_version 912341 (0.0006) [2023-12-28 01:47:41,504][106226] Updated weights for policy 0, policy_version 910019 (0.0009) [2023-12-28 01:47:41,564][106225] Updated weights for policy 1, policy_version 912351 (0.0007) [2023-12-28 01:47:42,166][106226] Updated weights for policy 0, policy_version 910029 (0.0008) [2023-12-28 01:47:42,230][106226] Updated weights for policy 0, policy_version 910039 (0.0006) [2023-12-28 01:47:42,305][106226] Updated weights for policy 0, policy_version 910049 (0.0008) [2023-12-28 01:47:42,320][106225] Updated weights for policy 1, policy_version 912361 (0.0010) [2023-12-28 01:47:42,382][106225] Updated weights for policy 1, policy_version 912371 (0.0009) [2023-12-28 01:47:42,433][106225] Updated weights for policy 1, policy_version 912381 (0.0010) [2023-12-28 01:47:42,975][106226] Updated weights for policy 0, policy_version 910059 (0.0008) [2023-12-28 01:47:43,025][106226] Updated weights for policy 0, policy_version 910069 (0.0009) [2023-12-28 01:47:43,073][106226] Updated weights for policy 0, policy_version 910079 (0.0008) [2023-12-28 01:47:43,116][106225] Updated weights for policy 1, policy_version 912391 (0.0007) [2023-12-28 01:47:43,173][106225] Updated weights for policy 1, policy_version 912401 (0.0007) [2023-12-28 01:47:43,230][106225] Updated weights for policy 1, policy_version 912411 (0.0008) [2023-12-28 01:47:43,776][106226] Updated weights for policy 0, policy_version 910089 (0.0008) [2023-12-28 01:47:43,831][106226] Updated weights for policy 0, policy_version 910099 (0.0008) [2023-12-28 01:47:43,875][106225] Updated weights for policy 1, policy_version 912421 (0.0008) [2023-12-28 01:47:43,884][106226] Updated weights for policy 0, policy_version 910109 (0.0009) [2023-12-28 01:47:43,936][106225] Updated weights for policy 1, policy_version 912431 (0.0006) [2023-12-28 01:47:43,942][106226] Updated weights for policy 0, policy_version 910119 (0.0007) [2023-12-28 01:47:43,990][106225] Updated weights for policy 1, policy_version 912441 (0.0007) [2023-12-28 01:47:44,645][106225] Updated weights for policy 1, policy_version 912451 (0.0008) [2023-12-28 01:47:44,689][106226] Updated weights for policy 0, policy_version 910129 (0.0008) [2023-12-28 01:47:44,698][106225] Updated weights for policy 1, policy_version 912461 (0.0008) [2023-12-28 01:47:44,738][106226] Updated weights for policy 0, policy_version 910139 (0.0007) [2023-12-28 01:47:44,756][106225] Updated weights for policy 1, policy_version 912471 (0.0007) [2023-12-28 01:47:44,796][106226] Updated weights for policy 0, policy_version 910149 (0.0008) [2023-12-28 01:47:45,534][106226] Updated weights for policy 0, policy_version 910159 (0.0008) [2023-12-28 01:47:45,534][106225] Updated weights for policy 1, policy_version 912481 (0.0008) [2023-12-28 01:47:45,589][106226] Updated weights for policy 0, policy_version 910169 (0.0008) [2023-12-28 01:47:45,594][106225] Updated weights for policy 1, policy_version 912491 (0.0007) [2023-12-28 01:47:45,646][106225] Updated weights for policy 1, policy_version 912501 (0.0006) [2023-12-28 01:47:45,647][106226] Updated weights for policy 0, policy_version 910179 (0.0006) [2023-12-28 01:47:45,694][106225] Updated weights for policy 1, policy_version 912511 (0.0006) [2023-12-28 01:47:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 466706432. Throughput: 0: 9770.2, 1: 10055.5. Samples: 466697836. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:47:46,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-5.256')] [2023-12-28 01:47:46,352][106226] Updated weights for policy 0, policy_version 910189 (0.0006) [2023-12-28 01:47:46,403][106226] Updated weights for policy 0, policy_version 910199 (0.0005) [2023-12-28 01:47:46,430][106225] Updated weights for policy 1, policy_version 912521 (0.0007) [2023-12-28 01:47:46,465][106226] Updated weights for policy 0, policy_version 910209 (0.0007) [2023-12-28 01:47:46,479][106225] Updated weights for policy 1, policy_version 912531 (0.0007) [2023-12-28 01:47:46,529][106225] Updated weights for policy 1, policy_version 912541 (0.0006) [2023-12-28 01:47:47,050][106226] Updated weights for policy 0, policy_version 910219 (0.0010) [2023-12-28 01:47:47,115][106226] Updated weights for policy 0, policy_version 910229 (0.0010) [2023-12-28 01:47:47,159][106225] Updated weights for policy 1, policy_version 912551 (0.0006) [2023-12-28 01:47:47,175][106226] Updated weights for policy 0, policy_version 910239 (0.0010) [2023-12-28 01:47:47,216][106225] Updated weights for policy 1, policy_version 912561 (0.0008) [2023-12-28 01:47:47,268][106225] Updated weights for policy 1, policy_version 912571 (0.0008) [2023-12-28 01:47:47,855][106226] Updated weights for policy 0, policy_version 910249 (0.0010) [2023-12-28 01:47:47,913][106226] Updated weights for policy 0, policy_version 910259 (0.0006) [2023-12-28 01:47:47,963][106226] Updated weights for policy 0, policy_version 910269 (0.0005) [2023-12-28 01:47:48,019][106225] Updated weights for policy 1, policy_version 912581 (0.0008) [2023-12-28 01:47:48,020][106226] Updated weights for policy 0, policy_version 910279 (0.0005) [2023-12-28 01:47:48,071][106225] Updated weights for policy 1, policy_version 912591 (0.0008) [2023-12-28 01:47:48,125][106225] Updated weights for policy 1, policy_version 912601 (0.0008) [2023-12-28 01:47:48,752][106226] Updated weights for policy 0, policy_version 910289 (0.0008) [2023-12-28 01:47:48,797][106225] Updated weights for policy 1, policy_version 912611 (0.0008) [2023-12-28 01:47:48,812][106226] Updated weights for policy 0, policy_version 910299 (0.0006) [2023-12-28 01:47:48,854][106225] Updated weights for policy 1, policy_version 912621 (0.0007) [2023-12-28 01:47:48,869][106226] Updated weights for policy 0, policy_version 910309 (0.0007) [2023-12-28 01:47:48,914][106225] Updated weights for policy 1, policy_version 912631 (0.0009) [2023-12-28 01:47:49,551][106226] Updated weights for policy 0, policy_version 910319 (0.0007) [2023-12-28 01:47:49,601][106226] Updated weights for policy 0, policy_version 910329 (0.0009) [2023-12-28 01:47:49,618][106225] Updated weights for policy 1, policy_version 912641 (0.0009) [2023-12-28 01:47:49,656][106226] Updated weights for policy 0, policy_version 910339 (0.0008) [2023-12-28 01:47:49,687][106225] Updated weights for policy 1, policy_version 912651 (0.0005) [2023-12-28 01:47:49,753][106225] Updated weights for policy 1, policy_version 912661 (0.0005) [2023-12-28 01:47:49,826][106225] Updated weights for policy 1, policy_version 912671 (0.0007) [2023-12-28 01:47:50,440][106226] Updated weights for policy 0, policy_version 910349 (0.0008) [2023-12-28 01:47:50,498][106226] Updated weights for policy 0, policy_version 910359 (0.0008) [2023-12-28 01:47:50,527][106225] Updated weights for policy 1, policy_version 912681 (0.0009) [2023-12-28 01:47:50,556][106226] Updated weights for policy 0, policy_version 910369 (0.0007) [2023-12-28 01:47:50,577][106225] Updated weights for policy 1, policy_version 912691 (0.0006) [2023-12-28 01:47:50,638][106225] Updated weights for policy 1, policy_version 912701 (0.0009) [2023-12-28 01:47:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 466804736. Throughput: 0: 9744.2, 1: 10037.6. Samples: 466815440. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:47:51,175][105115] Avg episode reward: [(0, '-4.295'), (1, '-4.837')] [2023-12-28 01:47:51,311][106226] Updated weights for policy 0, policy_version 910379 (0.0006) [2023-12-28 01:47:51,382][106226] Updated weights for policy 0, policy_version 910389 (0.0011) [2023-12-28 01:47:51,401][106225] Updated weights for policy 1, policy_version 912711 (0.0008) [2023-12-28 01:47:51,443][106226] Updated weights for policy 0, policy_version 910399 (0.0008) [2023-12-28 01:47:51,460][106225] Updated weights for policy 1, policy_version 912721 (0.0007) [2023-12-28 01:47:51,511][106225] Updated weights for policy 1, policy_version 912731 (0.0008) [2023-12-28 01:47:52,138][106226] Updated weights for policy 0, policy_version 910409 (0.0006) [2023-12-28 01:47:52,198][106226] Updated weights for policy 0, policy_version 910419 (0.0011) [2023-12-28 01:47:52,257][106226] Updated weights for policy 0, policy_version 910429 (0.0010) [2023-12-28 01:47:52,310][106226] Updated weights for policy 0, policy_version 910439 (0.0008) [2023-12-28 01:47:52,312][106225] Updated weights for policy 1, policy_version 912741 (0.0008) [2023-12-28 01:47:52,376][106225] Updated weights for policy 1, policy_version 912751 (0.0007) [2023-12-28 01:47:52,430][106225] Updated weights for policy 1, policy_version 912761 (0.0010) [2023-12-28 01:47:53,002][106226] Updated weights for policy 0, policy_version 910449 (0.0010) [2023-12-28 01:47:53,060][106226] Updated weights for policy 0, policy_version 910459 (0.0011) [2023-12-28 01:47:53,120][106226] Updated weights for policy 0, policy_version 910469 (0.0010) [2023-12-28 01:47:53,173][106225] Updated weights for policy 1, policy_version 912771 (0.0009) [2023-12-28 01:47:53,230][106225] Updated weights for policy 1, policy_version 912781 (0.0009) [2023-12-28 01:47:53,291][106225] Updated weights for policy 1, policy_version 912791 (0.0007) [2023-12-28 01:47:53,678][106226] Updated weights for policy 0, policy_version 910479 (0.0007) [2023-12-28 01:47:53,738][106226] Updated weights for policy 0, policy_version 910489 (0.0005) [2023-12-28 01:47:53,801][106226] Updated weights for policy 0, policy_version 910499 (0.0005) [2023-12-28 01:47:54,143][106225] Updated weights for policy 1, policy_version 912801 (0.0009) [2023-12-28 01:47:54,200][106225] Updated weights for policy 1, policy_version 912811 (0.0007) [2023-12-28 01:47:54,253][106225] Updated weights for policy 1, policy_version 912821 (0.0007) [2023-12-28 01:47:54,316][106225] Updated weights for policy 1, policy_version 912831 (0.0008) [2023-12-28 01:47:54,351][106226] Updated weights for policy 0, policy_version 910509 (0.0008) [2023-12-28 01:47:54,412][106226] Updated weights for policy 0, policy_version 910519 (0.0010) [2023-12-28 01:47:54,472][106226] Updated weights for policy 0, policy_version 910529 (0.0011) [2023-12-28 01:47:55,055][106225] Updated weights for policy 1, policy_version 912841 (0.0008) [2023-12-28 01:47:55,114][106225] Updated weights for policy 1, policy_version 912851 (0.0008) [2023-12-28 01:47:55,172][106225] Updated weights for policy 1, policy_version 912861 (0.0008) [2023-12-28 01:47:55,180][106226] Updated weights for policy 0, policy_version 910539 (0.0009) [2023-12-28 01:47:55,229][106226] Updated weights for policy 0, policy_version 910549 (0.0005) [2023-12-28 01:47:55,279][106226] Updated weights for policy 0, policy_version 910559 (0.0005) [2023-12-28 01:47:55,821][106226] Updated weights for policy 0, policy_version 910569 (0.0005) [2023-12-28 01:47:55,882][106226] Updated weights for policy 0, policy_version 910579 (0.0008) [2023-12-28 01:47:55,938][106226] Updated weights for policy 0, policy_version 910589 (0.0008) [2023-12-28 01:47:55,974][106225] Updated weights for policy 1, policy_version 912871 (0.0009) [2023-12-28 01:47:56,001][106226] Updated weights for policy 0, policy_version 910599 (0.0007) [2023-12-28 01:47:56,035][106225] Updated weights for policy 1, policy_version 912881 (0.0008) [2023-12-28 01:47:56,097][106225] Updated weights for policy 1, policy_version 912891 (0.0008) [2023-12-28 01:47:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 466911232. Throughput: 0: 9793.9, 1: 9986.5. Samples: 466875112. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:47:56,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.684')] [2023-12-28 01:47:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000912896_233742336.pth... [2023-12-28 01:47:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000910600_233168896.pth... [2023-12-28 01:47:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000911712_233439232.pth [2023-12-28 01:47:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000909448_232873984.pth [2023-12-28 01:47:56,641][106226] Updated weights for policy 0, policy_version 910609 (0.0005) [2023-12-28 01:47:56,697][106226] Updated weights for policy 0, policy_version 910619 (0.0008) [2023-12-28 01:47:56,753][106226] Updated weights for policy 0, policy_version 910629 (0.0008) [2023-12-28 01:47:56,880][106225] Updated weights for policy 1, policy_version 912901 (0.0009) [2023-12-28 01:47:56,946][106225] Updated weights for policy 1, policy_version 912911 (0.0009) [2023-12-28 01:47:57,005][106225] Updated weights for policy 1, policy_version 912921 (0.0008) [2023-12-28 01:47:57,416][106226] Updated weights for policy 0, policy_version 910639 (0.0008) [2023-12-28 01:47:57,482][106226] Updated weights for policy 0, policy_version 910649 (0.0008) [2023-12-28 01:47:57,535][106226] Updated weights for policy 0, policy_version 910659 (0.0008) [2023-12-28 01:47:57,699][106225] Updated weights for policy 1, policy_version 912931 (0.0008) [2023-12-28 01:47:57,764][106225] Updated weights for policy 1, policy_version 912941 (0.0005) [2023-12-28 01:47:57,825][106225] Updated weights for policy 1, policy_version 912951 (0.0005) [2023-12-28 01:47:58,310][106226] Updated weights for policy 0, policy_version 910669 (0.0007) [2023-12-28 01:47:58,384][106226] Updated weights for policy 0, policy_version 910679 (0.0008) [2023-12-28 01:47:58,453][106226] Updated weights for policy 0, policy_version 910689 (0.0009) [2023-12-28 01:47:58,540][106225] Updated weights for policy 1, policy_version 912961 (0.0007) [2023-12-28 01:47:58,603][106225] Updated weights for policy 1, policy_version 912971 (0.0008) [2023-12-28 01:47:58,671][106225] Updated weights for policy 1, policy_version 912981 (0.0009) [2023-12-28 01:47:58,737][106225] Updated weights for policy 1, policy_version 912991 (0.0007) [2023-12-28 01:47:59,308][106226] Updated weights for policy 0, policy_version 910699 (0.0010) [2023-12-28 01:47:59,375][106226] Updated weights for policy 0, policy_version 910709 (0.0010) [2023-12-28 01:47:59,436][106226] Updated weights for policy 0, policy_version 910719 (0.0008) [2023-12-28 01:47:59,537][106225] Updated weights for policy 1, policy_version 913001 (0.0008) [2023-12-28 01:47:59,595][106225] Updated weights for policy 1, policy_version 913011 (0.0009) [2023-12-28 01:47:59,660][106225] Updated weights for policy 1, policy_version 913021 (0.0008) [2023-12-28 01:48:00,053][106226] Updated weights for policy 0, policy_version 910729 (0.0006) [2023-12-28 01:48:00,105][106226] Updated weights for policy 0, policy_version 910739 (0.0009) [2023-12-28 01:48:00,164][106226] Updated weights for policy 0, policy_version 910749 (0.0010) [2023-12-28 01:48:00,222][106226] Updated weights for policy 0, policy_version 910759 (0.0008) [2023-12-28 01:48:00,382][106225] Updated weights for policy 1, policy_version 913031 (0.0006) [2023-12-28 01:48:00,442][106225] Updated weights for policy 1, policy_version 913041 (0.0005) [2023-12-28 01:48:00,493][106225] Updated weights for policy 1, policy_version 913051 (0.0005) [2023-12-28 01:48:00,977][106226] Updated weights for policy 0, policy_version 910769 (0.0010) [2023-12-28 01:48:01,029][106226] Updated weights for policy 0, policy_version 910779 (0.0006) [2023-12-28 01:48:01,067][106225] Updated weights for policy 1, policy_version 913061 (0.0007) [2023-12-28 01:48:01,092][106226] Updated weights for policy 0, policy_version 910789 (0.0008) [2023-12-28 01:48:01,130][106225] Updated weights for policy 1, policy_version 913071 (0.0009) [2023-12-28 01:48:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 467001344. Throughput: 0: 9861.1, 1: 9857.0. Samples: 466990164. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:01,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-5.315')] [2023-12-28 01:48:01,188][106225] Updated weights for policy 1, policy_version 913081 (0.0008) [2023-12-28 01:48:01,838][106226] Updated weights for policy 0, policy_version 910799 (0.0008) [2023-12-28 01:48:01,886][106226] Updated weights for policy 0, policy_version 910809 (0.0008) [2023-12-28 01:48:01,935][106226] Updated weights for policy 0, policy_version 910819 (0.0008) [2023-12-28 01:48:01,974][106225] Updated weights for policy 1, policy_version 913091 (0.0009) [2023-12-28 01:48:02,037][106225] Updated weights for policy 1, policy_version 913101 (0.0009) [2023-12-28 01:48:02,102][106225] Updated weights for policy 1, policy_version 913111 (0.0010) [2023-12-28 01:48:02,648][106226] Updated weights for policy 0, policy_version 910829 (0.0008) [2023-12-28 01:48:02,710][106226] Updated weights for policy 0, policy_version 910839 (0.0005) [2023-12-28 01:48:02,749][106225] Updated weights for policy 1, policy_version 913121 (0.0010) [2023-12-28 01:48:02,770][106226] Updated weights for policy 0, policy_version 910849 (0.0007) [2023-12-28 01:48:02,811][106225] Updated weights for policy 1, policy_version 913131 (0.0007) [2023-12-28 01:48:02,872][106225] Updated weights for policy 1, policy_version 913141 (0.0008) [2023-12-28 01:48:02,935][106225] Updated weights for policy 1, policy_version 913151 (0.0006) [2023-12-28 01:48:03,368][106226] Updated weights for policy 0, policy_version 910859 (0.0006) [2023-12-28 01:48:03,418][106226] Updated weights for policy 0, policy_version 910869 (0.0009) [2023-12-28 01:48:03,467][106226] Updated weights for policy 0, policy_version 910879 (0.0009) [2023-12-28 01:48:03,563][106225] Updated weights for policy 1, policy_version 913161 (0.0008) [2023-12-28 01:48:03,614][106225] Updated weights for policy 1, policy_version 913171 (0.0008) [2023-12-28 01:48:03,658][106225] Updated weights for policy 1, policy_version 913181 (0.0008) [2023-12-28 01:48:04,231][106226] Updated weights for policy 0, policy_version 910889 (0.0009) [2023-12-28 01:48:04,285][106226] Updated weights for policy 0, policy_version 910899 (0.0011) [2023-12-28 01:48:04,349][106226] Updated weights for policy 0, policy_version 910909 (0.0011) [2023-12-28 01:48:04,392][106225] Updated weights for policy 1, policy_version 913191 (0.0008) [2023-12-28 01:48:04,413][106226] Updated weights for policy 0, policy_version 910919 (0.0011) [2023-12-28 01:48:04,449][106225] Updated weights for policy 1, policy_version 913201 (0.0006) [2023-12-28 01:48:04,503][106225] Updated weights for policy 1, policy_version 913211 (0.0008) [2023-12-28 01:48:05,034][106226] Updated weights for policy 0, policy_version 910929 (0.0008) [2023-12-28 01:48:05,093][106226] Updated weights for policy 0, policy_version 910939 (0.0010) [2023-12-28 01:48:05,141][106225] Updated weights for policy 1, policy_version 913221 (0.0007) [2023-12-28 01:48:05,155][106226] Updated weights for policy 0, policy_version 910949 (0.0007) [2023-12-28 01:48:05,195][106225] Updated weights for policy 1, policy_version 913231 (0.0010) [2023-12-28 01:48:05,264][106225] Updated weights for policy 1, policy_version 913241 (0.0009) [2023-12-28 01:48:05,799][106226] Updated weights for policy 0, policy_version 910959 (0.0007) [2023-12-28 01:48:05,856][106226] Updated weights for policy 0, policy_version 910969 (0.0005) [2023-12-28 01:48:05,921][106226] Updated weights for policy 0, policy_version 910979 (0.0005) [2023-12-28 01:48:05,942][106225] Updated weights for policy 1, policy_version 913251 (0.0008) [2023-12-28 01:48:05,993][106225] Updated weights for policy 1, policy_version 913261 (0.0010) [2023-12-28 01:48:06,038][106225] Updated weights for policy 1, policy_version 913271 (0.0005) [2023-12-28 01:48:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 467107840. Throughput: 0: 9889.2, 1: 9916.9. Samples: 467113144. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:06,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.875')] [2023-12-28 01:48:06,561][106226] Updated weights for policy 0, policy_version 910989 (0.0008) [2023-12-28 01:48:06,626][106226] Updated weights for policy 0, policy_version 910999 (0.0011) [2023-12-28 01:48:06,688][106226] Updated weights for policy 0, policy_version 911009 (0.0011) [2023-12-28 01:48:06,798][106225] Updated weights for policy 1, policy_version 913281 (0.0005) [2023-12-28 01:48:06,861][106225] Updated weights for policy 1, policy_version 913291 (0.0009) [2023-12-28 01:48:06,922][106225] Updated weights for policy 1, policy_version 913301 (0.0009) [2023-12-28 01:48:06,977][106225] Updated weights for policy 1, policy_version 913311 (0.0008) [2023-12-28 01:48:07,327][106226] Updated weights for policy 0, policy_version 911019 (0.0008) [2023-12-28 01:48:07,373][106226] Updated weights for policy 0, policy_version 911029 (0.0009) [2023-12-28 01:48:07,436][106226] Updated weights for policy 0, policy_version 911039 (0.0008) [2023-12-28 01:48:07,719][106225] Updated weights for policy 1, policy_version 913321 (0.0007) [2023-12-28 01:48:07,777][106225] Updated weights for policy 1, policy_version 913331 (0.0008) [2023-12-28 01:48:07,838][106225] Updated weights for policy 1, policy_version 913341 (0.0008) [2023-12-28 01:48:08,219][106226] Updated weights for policy 0, policy_version 911049 (0.0008) [2023-12-28 01:48:08,289][106226] Updated weights for policy 0, policy_version 911059 (0.0010) [2023-12-28 01:48:08,352][106226] Updated weights for policy 0, policy_version 911069 (0.0008) [2023-12-28 01:48:08,416][106226] Updated weights for policy 0, policy_version 911079 (0.0007) [2023-12-28 01:48:08,447][106225] Updated weights for policy 1, policy_version 913351 (0.0008) [2023-12-28 01:48:08,506][106225] Updated weights for policy 1, policy_version 913361 (0.0007) [2023-12-28 01:48:08,563][106225] Updated weights for policy 1, policy_version 913371 (0.0008) [2023-12-28 01:48:09,181][106225] Updated weights for policy 1, policy_version 913381 (0.0007) [2023-12-28 01:48:09,195][106226] Updated weights for policy 0, policy_version 911089 (0.0008) [2023-12-28 01:48:09,255][106225] Updated weights for policy 1, policy_version 913391 (0.0009) [2023-12-28 01:48:09,272][106226] Updated weights for policy 0, policy_version 911099 (0.0008) [2023-12-28 01:48:09,320][106225] Updated weights for policy 1, policy_version 913401 (0.0008) [2023-12-28 01:48:09,331][106226] Updated weights for policy 0, policy_version 911109 (0.0008) [2023-12-28 01:48:10,097][106225] Updated weights for policy 1, policy_version 913411 (0.0008) [2023-12-28 01:48:10,137][106226] Updated weights for policy 0, policy_version 911119 (0.0007) [2023-12-28 01:48:10,159][106225] Updated weights for policy 1, policy_version 913421 (0.0008) [2023-12-28 01:48:10,204][106226] Updated weights for policy 0, policy_version 911129 (0.0006) [2023-12-28 01:48:10,226][106225] Updated weights for policy 1, policy_version 913431 (0.0008) [2023-12-28 01:48:10,261][106226] Updated weights for policy 0, policy_version 911139 (0.0007) [2023-12-28 01:48:10,896][106226] Updated weights for policy 0, policy_version 911149 (0.0007) [2023-12-28 01:48:10,930][106225] Updated weights for policy 1, policy_version 913441 (0.0008) [2023-12-28 01:48:10,964][106226] Updated weights for policy 0, policy_version 911159 (0.0006) [2023-12-28 01:48:10,983][106225] Updated weights for policy 1, policy_version 913451 (0.0007) [2023-12-28 01:48:11,031][106226] Updated weights for policy 0, policy_version 911169 (0.0006) [2023-12-28 01:48:11,043][106225] Updated weights for policy 1, policy_version 913461 (0.0008) [2023-12-28 01:48:11,106][106225] Updated weights for policy 1, policy_version 913471 (0.0007) [2023-12-28 01:48:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 467206144. Throughput: 0: 9896.4, 1: 9942.0. Samples: 467171328. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:11,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-5.131')] [2023-12-28 01:48:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000913472_233889792.pth... [2023-12-28 01:48:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000911176_233316352.pth... [2023-12-28 01:48:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000909992_233013248.pth [2023-12-28 01:48:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000912320_233594880.pth [2023-12-28 01:48:11,799][106226] Updated weights for policy 0, policy_version 911179 (0.0008) [2023-12-28 01:48:11,862][106225] Updated weights for policy 1, policy_version 913481 (0.0007) [2023-12-28 01:48:11,865][106226] Updated weights for policy 0, policy_version 911189 (0.0006) [2023-12-28 01:48:11,923][106225] Updated weights for policy 1, policy_version 913491 (0.0008) [2023-12-28 01:48:11,930][106226] Updated weights for policy 0, policy_version 911199 (0.0008) [2023-12-28 01:48:11,983][106225] Updated weights for policy 1, policy_version 913501 (0.0007) [2023-12-28 01:48:12,681][106226] Updated weights for policy 0, policy_version 911209 (0.0007) [2023-12-28 01:48:12,687][106225] Updated weights for policy 1, policy_version 913511 (0.0007) [2023-12-28 01:48:12,734][106226] Updated weights for policy 0, policy_version 911219 (0.0007) [2023-12-28 01:48:12,751][106225] Updated weights for policy 1, policy_version 913521 (0.0008) [2023-12-28 01:48:12,797][106226] Updated weights for policy 0, policy_version 911229 (0.0007) [2023-12-28 01:48:12,810][106225] Updated weights for policy 1, policy_version 913531 (0.0007) [2023-12-28 01:48:12,859][106226] Updated weights for policy 0, policy_version 911239 (0.0007) [2023-12-28 01:48:13,450][106225] Updated weights for policy 1, policy_version 913541 (0.0006) [2023-12-28 01:48:13,511][106225] Updated weights for policy 1, policy_version 913551 (0.0005) [2023-12-28 01:48:13,573][106225] Updated weights for policy 1, policy_version 913561 (0.0006) [2023-12-28 01:48:13,652][106226] Updated weights for policy 0, policy_version 911249 (0.0008) [2023-12-28 01:48:13,712][106226] Updated weights for policy 0, policy_version 911259 (0.0008) [2023-12-28 01:48:13,780][106226] Updated weights for policy 0, policy_version 911269 (0.0008) [2023-12-28 01:48:14,161][106225] Updated weights for policy 1, policy_version 913571 (0.0009) [2023-12-28 01:48:14,214][106225] Updated weights for policy 1, policy_version 913581 (0.0008) [2023-12-28 01:48:14,264][106225] Updated weights for policy 1, policy_version 913591 (0.0010) [2023-12-28 01:48:14,548][106226] Updated weights for policy 0, policy_version 911279 (0.0008) [2023-12-28 01:48:14,603][106226] Updated weights for policy 0, policy_version 911289 (0.0008) [2023-12-28 01:48:14,662][106226] Updated weights for policy 0, policy_version 911299 (0.0009) [2023-12-28 01:48:14,872][106225] Updated weights for policy 1, policy_version 913601 (0.0010) [2023-12-28 01:48:14,934][106225] Updated weights for policy 1, policy_version 913611 (0.0008) [2023-12-28 01:48:14,995][106225] Updated weights for policy 1, policy_version 913621 (0.0010) [2023-12-28 01:48:15,056][106225] Updated weights for policy 1, policy_version 913631 (0.0010) [2023-12-28 01:48:15,377][106226] Updated weights for policy 0, policy_version 911309 (0.0010) [2023-12-28 01:48:15,430][106226] Updated weights for policy 0, policy_version 911319 (0.0010) [2023-12-28 01:48:15,481][106226] Updated weights for policy 0, policy_version 911329 (0.0011) [2023-12-28 01:48:15,767][106225] Updated weights for policy 1, policy_version 913641 (0.0007) [2023-12-28 01:48:15,821][106225] Updated weights for policy 1, policy_version 913651 (0.0005) [2023-12-28 01:48:15,889][106225] Updated weights for policy 1, policy_version 913661 (0.0009) [2023-12-28 01:48:16,160][106226] Updated weights for policy 0, policy_version 911339 (0.0010) [2023-12-28 01:48:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 467296256. Throughput: 0: 9804.2, 1: 9872.2. Samples: 467286592. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:16,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-5.088')] [2023-12-28 01:48:16,208][106226] Updated weights for policy 0, policy_version 911349 (0.0009) [2023-12-28 01:48:16,271][106226] Updated weights for policy 0, policy_version 911359 (0.0010) [2023-12-28 01:48:16,463][106225] Updated weights for policy 1, policy_version 913671 (0.0008) [2023-12-28 01:48:16,520][106225] Updated weights for policy 1, policy_version 913681 (0.0010) [2023-12-28 01:48:16,573][106225] Updated weights for policy 1, policy_version 913691 (0.0010) [2023-12-28 01:48:16,951][106226] Updated weights for policy 0, policy_version 911369 (0.0010) [2023-12-28 01:48:17,005][106226] Updated weights for policy 0, policy_version 911379 (0.0005) [2023-12-28 01:48:17,066][106226] Updated weights for policy 0, policy_version 911389 (0.0006) [2023-12-28 01:48:17,127][106226] Updated weights for policy 0, policy_version 911399 (0.0011) [2023-12-28 01:48:17,220][106225] Updated weights for policy 1, policy_version 913701 (0.0008) [2023-12-28 01:48:17,282][106225] Updated weights for policy 1, policy_version 913711 (0.0005) [2023-12-28 01:48:17,343][106225] Updated weights for policy 1, policy_version 913721 (0.0006) [2023-12-28 01:48:17,784][106226] Updated weights for policy 0, policy_version 911409 (0.0006) [2023-12-28 01:48:17,848][106226] Updated weights for policy 0, policy_version 911419 (0.0005) [2023-12-28 01:48:17,912][106226] Updated weights for policy 0, policy_version 911429 (0.0005) [2023-12-28 01:48:17,992][106225] Updated weights for policy 1, policy_version 913731 (0.0009) [2023-12-28 01:48:18,048][106225] Updated weights for policy 1, policy_version 913741 (0.0008) [2023-12-28 01:48:18,098][106225] Updated weights for policy 1, policy_version 913751 (0.0009) [2023-12-28 01:48:18,488][106226] Updated weights for policy 0, policy_version 911439 (0.0006) [2023-12-28 01:48:18,547][106226] Updated weights for policy 0, policy_version 911449 (0.0006) [2023-12-28 01:48:18,609][106226] Updated weights for policy 0, policy_version 911459 (0.0007) [2023-12-28 01:48:18,899][106225] Updated weights for policy 1, policy_version 913761 (0.0009) [2023-12-28 01:48:18,962][106225] Updated weights for policy 1, policy_version 913771 (0.0008) [2023-12-28 01:48:19,010][106225] Updated weights for policy 1, policy_version 913781 (0.0008) [2023-12-28 01:48:19,058][106225] Updated weights for policy 1, policy_version 913791 (0.0008) [2023-12-28 01:48:19,324][106226] Updated weights for policy 0, policy_version 911469 (0.0009) [2023-12-28 01:48:19,391][106226] Updated weights for policy 0, policy_version 911479 (0.0009) [2023-12-28 01:48:19,453][106226] Updated weights for policy 0, policy_version 911489 (0.0008) [2023-12-28 01:48:19,842][106225] Updated weights for policy 1, policy_version 913801 (0.0008) [2023-12-28 01:48:19,907][106225] Updated weights for policy 1, policy_version 913811 (0.0008) [2023-12-28 01:48:19,976][106225] Updated weights for policy 1, policy_version 913821 (0.0008) [2023-12-28 01:48:20,183][106226] Updated weights for policy 0, policy_version 911499 (0.0008) [2023-12-28 01:48:20,245][106226] Updated weights for policy 0, policy_version 911509 (0.0007) [2023-12-28 01:48:20,309][106226] Updated weights for policy 0, policy_version 911519 (0.0008) [2023-12-28 01:48:20,657][106225] Updated weights for policy 1, policy_version 913831 (0.0008) [2023-12-28 01:48:20,727][106225] Updated weights for policy 1, policy_version 913841 (0.0007) [2023-12-28 01:48:20,797][106225] Updated weights for policy 1, policy_version 913851 (0.0008) [2023-12-28 01:48:21,000][106226] Updated weights for policy 0, policy_version 911529 (0.0008) [2023-12-28 01:48:21,084][106226] Updated weights for policy 0, policy_version 911541 (0.0008) [2023-12-28 01:48:21,155][106226] Updated weights for policy 0, policy_version 911551 (0.0007) [2023-12-28 01:48:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 467394560. Throughput: 0: 9857.4, 1: 9813.4. Samples: 467407764. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:21,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.621')] [2023-12-28 01:48:21,576][106225] Updated weights for policy 1, policy_version 913861 (0.0007) [2023-12-28 01:48:21,641][106225] Updated weights for policy 1, policy_version 913871 (0.0009) [2023-12-28 01:48:21,706][106225] Updated weights for policy 1, policy_version 913881 (0.0007) [2023-12-28 01:48:21,882][106226] Updated weights for policy 0, policy_version 911561 (0.0009) [2023-12-28 01:48:21,946][106226] Updated weights for policy 0, policy_version 911571 (0.0006) [2023-12-28 01:48:22,019][106226] Updated weights for policy 0, policy_version 911581 (0.0010) [2023-12-28 01:48:22,081][106226] Updated weights for policy 0, policy_version 911591 (0.0009) [2023-12-28 01:48:22,510][106225] Updated weights for policy 1, policy_version 913891 (0.0008) [2023-12-28 01:48:22,571][106225] Updated weights for policy 1, policy_version 913901 (0.0008) [2023-12-28 01:48:22,630][106225] Updated weights for policy 1, policy_version 913911 (0.0008) [2023-12-28 01:48:22,793][106226] Updated weights for policy 0, policy_version 911601 (0.0009) [2023-12-28 01:48:22,855][106226] Updated weights for policy 0, policy_version 911611 (0.0009) [2023-12-28 01:48:22,919][106226] Updated weights for policy 0, policy_version 911621 (0.0010) [2023-12-28 01:48:23,365][106225] Updated weights for policy 1, policy_version 913921 (0.0009) [2023-12-28 01:48:23,428][106225] Updated weights for policy 1, policy_version 913931 (0.0010) [2023-12-28 01:48:23,489][106225] Updated weights for policy 1, policy_version 913941 (0.0010) [2023-12-28 01:48:23,536][106225] Updated weights for policy 1, policy_version 913951 (0.0010) [2023-12-28 01:48:23,573][106226] Updated weights for policy 0, policy_version 911631 (0.0008) [2023-12-28 01:48:23,630][106226] Updated weights for policy 0, policy_version 911641 (0.0005) [2023-12-28 01:48:23,694][106226] Updated weights for policy 0, policy_version 911651 (0.0005) [2023-12-28 01:48:24,188][106225] Updated weights for policy 1, policy_version 913961 (0.0008) [2023-12-28 01:48:24,239][106225] Updated weights for policy 1, policy_version 913971 (0.0008) [2023-12-28 01:48:24,256][106226] Updated weights for policy 0, policy_version 911661 (0.0005) [2023-12-28 01:48:24,302][106225] Updated weights for policy 1, policy_version 913981 (0.0008) [2023-12-28 01:48:24,320][106226] Updated weights for policy 0, policy_version 911671 (0.0010) [2023-12-28 01:48:24,383][106226] Updated weights for policy 0, policy_version 911681 (0.0008) [2023-12-28 01:48:24,926][106225] Updated weights for policy 1, policy_version 913991 (0.0006) [2023-12-28 01:48:24,986][106225] Updated weights for policy 1, policy_version 914001 (0.0006) [2023-12-28 01:48:25,013][106226] Updated weights for policy 0, policy_version 911691 (0.0008) [2023-12-28 01:48:25,045][106225] Updated weights for policy 1, policy_version 914011 (0.0008) [2023-12-28 01:48:25,071][106226] Updated weights for policy 0, policy_version 911701 (0.0005) [2023-12-28 01:48:25,141][106226] Updated weights for policy 0, policy_version 911711 (0.0005) [2023-12-28 01:48:25,750][106226] Updated weights for policy 0, policy_version 911721 (0.0009) [2023-12-28 01:48:25,767][106225] Updated weights for policy 1, policy_version 914021 (0.0008) [2023-12-28 01:48:25,798][106226] Updated weights for policy 0, policy_version 911731 (0.0006) [2023-12-28 01:48:25,814][106225] Updated weights for policy 1, policy_version 914031 (0.0005) [2023-12-28 01:48:25,844][106226] Updated weights for policy 0, policy_version 911741 (0.0010) [2023-12-28 01:48:25,865][106225] Updated weights for policy 1, policy_version 914041 (0.0005) [2023-12-28 01:48:25,894][106226] Updated weights for policy 0, policy_version 911751 (0.0010) [2023-12-28 01:48:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 467501056. Throughput: 0: 9926.2, 1: 9709.9. Samples: 467465280. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:26,176][105115] Avg episode reward: [(0, '-4.458'), (1, '-5.235')] [2023-12-28 01:48:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000911752_233463808.pth... [2023-12-28 01:48:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000914048_234037248.pth... [2023-12-28 01:48:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000910600_233168896.pth [2023-12-28 01:48:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000912896_233742336.pth [2023-12-28 01:48:26,513][106225] Updated weights for policy 1, policy_version 914051 (0.0006) [2023-12-28 01:48:26,568][106226] Updated weights for policy 0, policy_version 911761 (0.0010) [2023-12-28 01:48:26,569][106225] Updated weights for policy 1, policy_version 914061 (0.0005) [2023-12-28 01:48:26,620][106225] Updated weights for policy 1, policy_version 914071 (0.0005) [2023-12-28 01:48:26,621][106226] Updated weights for policy 0, policy_version 911771 (0.0010) [2023-12-28 01:48:26,674][106226] Updated weights for policy 0, policy_version 911781 (0.0010) [2023-12-28 01:48:27,137][106225] Updated weights for policy 1, policy_version 914081 (0.0005) [2023-12-28 01:48:27,196][106225] Updated weights for policy 1, policy_version 914091 (0.0009) [2023-12-28 01:48:27,244][106225] Updated weights for policy 1, policy_version 914101 (0.0010) [2023-12-28 01:48:27,304][106225] Updated weights for policy 1, policy_version 914111 (0.0010) [2023-12-28 01:48:27,396][106226] Updated weights for policy 0, policy_version 911791 (0.0010) [2023-12-28 01:48:27,467][106226] Updated weights for policy 0, policy_version 911801 (0.0008) [2023-12-28 01:48:27,530][106226] Updated weights for policy 0, policy_version 911811 (0.0005) [2023-12-28 01:48:27,972][106225] Updated weights for policy 1, policy_version 914121 (0.0008) [2023-12-28 01:48:28,037][106225] Updated weights for policy 1, policy_version 914131 (0.0008) [2023-12-28 01:48:28,090][106225] Updated weights for policy 1, policy_version 914141 (0.0008) [2023-12-28 01:48:28,189][106226] Updated weights for policy 0, policy_version 911821 (0.0008) [2023-12-28 01:48:28,244][106226] Updated weights for policy 0, policy_version 911831 (0.0008) [2023-12-28 01:48:28,296][106226] Updated weights for policy 0, policy_version 911841 (0.0007) [2023-12-28 01:48:28,762][106225] Updated weights for policy 1, policy_version 914151 (0.0008) [2023-12-28 01:48:28,820][106225] Updated weights for policy 1, policy_version 914161 (0.0006) [2023-12-28 01:48:28,882][106225] Updated weights for policy 1, policy_version 914171 (0.0006) [2023-12-28 01:48:29,023][106226] Updated weights for policy 0, policy_version 911851 (0.0009) [2023-12-28 01:48:29,077][106226] Updated weights for policy 0, policy_version 911861 (0.0009) [2023-12-28 01:48:29,122][106226] Updated weights for policy 0, policy_version 911871 (0.0009) [2023-12-28 01:48:29,533][106225] Updated weights for policy 1, policy_version 914181 (0.0008) [2023-12-28 01:48:29,595][106225] Updated weights for policy 1, policy_version 914191 (0.0008) [2023-12-28 01:48:29,656][106225] Updated weights for policy 1, policy_version 914201 (0.0007) [2023-12-28 01:48:29,871][106226] Updated weights for policy 0, policy_version 911881 (0.0009) [2023-12-28 01:48:29,939][106226] Updated weights for policy 0, policy_version 911891 (0.0007) [2023-12-28 01:48:29,994][106226] Updated weights for policy 0, policy_version 911901 (0.0008) [2023-12-28 01:48:30,055][106226] Updated weights for policy 0, policy_version 911911 (0.0008) [2023-12-28 01:48:30,370][106225] Updated weights for policy 1, policy_version 914211 (0.0008) [2023-12-28 01:48:30,423][106225] Updated weights for policy 1, policy_version 914221 (0.0008) [2023-12-28 01:48:30,471][106225] Updated weights for policy 1, policy_version 914231 (0.0007) [2023-12-28 01:48:30,770][106226] Updated weights for policy 0, policy_version 911921 (0.0006) [2023-12-28 01:48:30,822][106226] Updated weights for policy 0, policy_version 911931 (0.0006) [2023-12-28 01:48:30,872][106226] Updated weights for policy 0, policy_version 911941 (0.0008) [2023-12-28 01:48:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 467599360. Throughput: 0: 9979.0, 1: 9850.0. Samples: 467590140. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:31,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.315')] [2023-12-28 01:48:31,257][106225] Updated weights for policy 1, policy_version 914241 (0.0007) [2023-12-28 01:48:31,319][106225] Updated weights for policy 1, policy_version 914251 (0.0009) [2023-12-28 01:48:31,384][106225] Updated weights for policy 1, policy_version 914261 (0.0008) [2023-12-28 01:48:31,450][106225] Updated weights for policy 1, policy_version 914271 (0.0008) [2023-12-28 01:48:31,602][106226] Updated weights for policy 0, policy_version 911951 (0.0008) [2023-12-28 01:48:31,669][106226] Updated weights for policy 0, policy_version 911961 (0.0009) [2023-12-28 01:48:31,734][106226] Updated weights for policy 0, policy_version 911971 (0.0009) [2023-12-28 01:48:32,136][106225] Updated weights for policy 1, policy_version 914281 (0.0008) [2023-12-28 01:48:32,199][106225] Updated weights for policy 1, policy_version 914291 (0.0008) [2023-12-28 01:48:32,262][106225] Updated weights for policy 1, policy_version 914301 (0.0009) [2023-12-28 01:48:32,507][106226] Updated weights for policy 0, policy_version 911981 (0.0008) [2023-12-28 01:48:32,567][106226] Updated weights for policy 0, policy_version 911991 (0.0009) [2023-12-28 01:48:32,631][106226] Updated weights for policy 0, policy_version 912001 (0.0007) [2023-12-28 01:48:33,040][106225] Updated weights for policy 1, policy_version 914311 (0.0007) [2023-12-28 01:48:33,112][106225] Updated weights for policy 1, policy_version 914321 (0.0007) [2023-12-28 01:48:33,176][106225] Updated weights for policy 1, policy_version 914331 (0.0007) [2023-12-28 01:48:33,213][106226] Updated weights for policy 0, policy_version 912011 (0.0005) [2023-12-28 01:48:33,268][106226] Updated weights for policy 0, policy_version 912021 (0.0005) [2023-12-28 01:48:33,314][106226] Updated weights for policy 0, policy_version 912031 (0.0005) [2023-12-28 01:48:33,856][106226] Updated weights for policy 0, policy_version 912041 (0.0005) [2023-12-28 01:48:33,894][106225] Updated weights for policy 1, policy_version 914341 (0.0006) [2023-12-28 01:48:33,915][106226] Updated weights for policy 0, policy_version 912051 (0.0006) [2023-12-28 01:48:33,943][106225] Updated weights for policy 1, policy_version 914351 (0.0006) [2023-12-28 01:48:33,961][106226] Updated weights for policy 0, policy_version 912061 (0.0006) [2023-12-28 01:48:34,004][106225] Updated weights for policy 1, policy_version 914361 (0.0008) [2023-12-28 01:48:34,016][106226] Updated weights for policy 0, policy_version 912071 (0.0007) [2023-12-28 01:48:34,715][106226] Updated weights for policy 0, policy_version 912081 (0.0007) [2023-12-28 01:48:34,766][106226] Updated weights for policy 0, policy_version 912091 (0.0007) [2023-12-28 01:48:34,767][106225] Updated weights for policy 1, policy_version 914371 (0.0008) [2023-12-28 01:48:34,816][106226] Updated weights for policy 0, policy_version 912101 (0.0007) [2023-12-28 01:48:34,824][106225] Updated weights for policy 1, policy_version 914381 (0.0010) [2023-12-28 01:48:34,878][106225] Updated weights for policy 1, policy_version 914391 (0.0009) [2023-12-28 01:48:35,513][106226] Updated weights for policy 0, policy_version 912111 (0.0009) [2023-12-28 01:48:35,523][106225] Updated weights for policy 1, policy_version 914401 (0.0008) [2023-12-28 01:48:35,570][106226] Updated weights for policy 0, policy_version 912121 (0.0008) [2023-12-28 01:48:35,579][106225] Updated weights for policy 1, policy_version 914411 (0.0008) [2023-12-28 01:48:35,628][106226] Updated weights for policy 0, policy_version 912131 (0.0007) [2023-12-28 01:48:35,639][106225] Updated weights for policy 1, policy_version 914421 (0.0008) [2023-12-28 01:48:35,698][106225] Updated weights for policy 1, policy_version 914431 (0.0008) [2023-12-28 01:48:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 467697664. Throughput: 0: 10030.2, 1: 9819.8. Samples: 467708692. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:36,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-5.055')] [2023-12-28 01:48:36,400][106226] Updated weights for policy 0, policy_version 912141 (0.0008) [2023-12-28 01:48:36,415][106225] Updated weights for policy 1, policy_version 914441 (0.0006) [2023-12-28 01:48:36,466][106226] Updated weights for policy 0, policy_version 912151 (0.0006) [2023-12-28 01:48:36,480][106225] Updated weights for policy 1, policy_version 914451 (0.0007) [2023-12-28 01:48:36,533][106226] Updated weights for policy 0, policy_version 912161 (0.0007) [2023-12-28 01:48:36,547][106225] Updated weights for policy 1, policy_version 914461 (0.0006) [2023-12-28 01:48:37,159][106225] Updated weights for policy 1, policy_version 914471 (0.0005) [2023-12-28 01:48:37,218][106225] Updated weights for policy 1, policy_version 914481 (0.0008) [2023-12-28 01:48:37,253][106226] Updated weights for policy 0, policy_version 912171 (0.0007) [2023-12-28 01:48:37,272][106225] Updated weights for policy 1, policy_version 914491 (0.0010) [2023-12-28 01:48:37,310][106226] Updated weights for policy 0, policy_version 912181 (0.0007) [2023-12-28 01:48:37,375][106226] Updated weights for policy 0, policy_version 912191 (0.0009) [2023-12-28 01:48:37,922][106225] Updated weights for policy 1, policy_version 914501 (0.0008) [2023-12-28 01:48:37,975][106225] Updated weights for policy 1, policy_version 914511 (0.0005) [2023-12-28 01:48:38,036][106225] Updated weights for policy 1, policy_version 914521 (0.0006) [2023-12-28 01:48:38,107][106226] Updated weights for policy 0, policy_version 912201 (0.0008) [2023-12-28 01:48:38,169][106226] Updated weights for policy 0, policy_version 912211 (0.0009) [2023-12-28 01:48:38,225][106226] Updated weights for policy 0, policy_version 912221 (0.0006) [2023-12-28 01:48:38,277][106226] Updated weights for policy 0, policy_version 912231 (0.0005) [2023-12-28 01:48:38,697][106225] Updated weights for policy 1, policy_version 914531 (0.0007) [2023-12-28 01:48:38,751][106225] Updated weights for policy 1, policy_version 914541 (0.0010) [2023-12-28 01:48:38,812][106225] Updated weights for policy 1, policy_version 914551 (0.0010) [2023-12-28 01:48:38,996][106226] Updated weights for policy 0, policy_version 912241 (0.0008) [2023-12-28 01:48:39,059][106226] Updated weights for policy 0, policy_version 912251 (0.0008) [2023-12-28 01:48:39,117][106226] Updated weights for policy 0, policy_version 912261 (0.0008) [2023-12-28 01:48:39,567][106225] Updated weights for policy 1, policy_version 914561 (0.0010) [2023-12-28 01:48:39,628][106225] Updated weights for policy 1, policy_version 914571 (0.0008) [2023-12-28 01:48:39,693][106225] Updated weights for policy 1, policy_version 914581 (0.0009) [2023-12-28 01:48:39,753][106225] Updated weights for policy 1, policy_version 914591 (0.0008) [2023-12-28 01:48:39,912][106226] Updated weights for policy 0, policy_version 912271 (0.0008) [2023-12-28 01:48:39,979][106226] Updated weights for policy 0, policy_version 912281 (0.0007) [2023-12-28 01:48:40,046][106226] Updated weights for policy 0, policy_version 912291 (0.0009) [2023-12-28 01:48:40,441][106225] Updated weights for policy 1, policy_version 914601 (0.0009) [2023-12-28 01:48:40,504][106225] Updated weights for policy 1, policy_version 914611 (0.0008) [2023-12-28 01:48:40,562][106225] Updated weights for policy 1, policy_version 914621 (0.0008) [2023-12-28 01:48:40,839][106226] Updated weights for policy 0, policy_version 912301 (0.0009) [2023-12-28 01:48:40,902][106226] Updated weights for policy 0, policy_version 912311 (0.0009) [2023-12-28 01:48:40,958][106226] Updated weights for policy 0, policy_version 912321 (0.0009) [2023-12-28 01:48:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 467795968. Throughput: 0: 9935.5, 1: 9924.1. Samples: 467768796. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:41,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-4.680')] [2023-12-28 01:48:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000914624_234184704.pth... [2023-12-28 01:48:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000912328_233611264.pth... [2023-12-28 01:48:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000911176_233316352.pth [2023-12-28 01:48:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000913472_233889792.pth [2023-12-28 01:48:41,320][106225] Updated weights for policy 1, policy_version 914631 (0.0009) [2023-12-28 01:48:41,390][106225] Updated weights for policy 1, policy_version 914641 (0.0008) [2023-12-28 01:48:41,451][106225] Updated weights for policy 1, policy_version 914651 (0.0009) [2023-12-28 01:48:41,676][106226] Updated weights for policy 0, policy_version 912331 (0.0009) [2023-12-28 01:48:41,745][106226] Updated weights for policy 0, policy_version 912341 (0.0009) [2023-12-28 01:48:41,804][106226] Updated weights for policy 0, policy_version 912351 (0.0006) [2023-12-28 01:48:42,294][106225] Updated weights for policy 1, policy_version 914661 (0.0008) [2023-12-28 01:48:42,361][106225] Updated weights for policy 1, policy_version 914671 (0.0008) [2023-12-28 01:48:42,429][106225] Updated weights for policy 1, policy_version 914681 (0.0011) [2023-12-28 01:48:42,471][106226] Updated weights for policy 0, policy_version 912361 (0.0006) [2023-12-28 01:48:42,529][106226] Updated weights for policy 0, policy_version 912371 (0.0008) [2023-12-28 01:48:42,583][106226] Updated weights for policy 0, policy_version 912381 (0.0007) [2023-12-28 01:48:42,641][106226] Updated weights for policy 0, policy_version 912391 (0.0008) [2023-12-28 01:48:43,167][106225] Updated weights for policy 1, policy_version 914691 (0.0009) [2023-12-28 01:48:43,223][106225] Updated weights for policy 1, policy_version 914701 (0.0009) [2023-12-28 01:48:43,278][106225] Updated weights for policy 1, policy_version 914711 (0.0008) [2023-12-28 01:48:43,395][106226] Updated weights for policy 0, policy_version 912401 (0.0008) [2023-12-28 01:48:43,452][106226] Updated weights for policy 0, policy_version 912411 (0.0009) [2023-12-28 01:48:43,505][106226] Updated weights for policy 0, policy_version 912421 (0.0009) [2023-12-28 01:48:43,892][106225] Updated weights for policy 1, policy_version 914721 (0.0008) [2023-12-28 01:48:43,941][106225] Updated weights for policy 1, policy_version 914732 (0.0009) [2023-12-28 01:48:43,991][106225] Updated weights for policy 1, policy_version 914742 (0.0008) [2023-12-28 01:48:44,049][106225] Updated weights for policy 1, policy_version 914752 (0.0008) [2023-12-28 01:48:44,180][106226] Updated weights for policy 0, policy_version 912431 (0.0008) [2023-12-28 01:48:44,228][106226] Updated weights for policy 0, policy_version 912441 (0.0008) [2023-12-28 01:48:44,286][106226] Updated weights for policy 0, policy_version 912451 (0.0009) [2023-12-28 01:48:44,777][106225] Updated weights for policy 1, policy_version 914762 (0.0008) [2023-12-28 01:48:44,842][106225] Updated weights for policy 1, policy_version 914772 (0.0008) [2023-12-28 01:48:44,899][106225] Updated weights for policy 1, policy_version 914782 (0.0007) [2023-12-28 01:48:45,041][106226] Updated weights for policy 0, policy_version 912461 (0.0010) [2023-12-28 01:48:45,096][106226] Updated weights for policy 0, policy_version 912471 (0.0010) [2023-12-28 01:48:45,148][106226] Updated weights for policy 0, policy_version 912481 (0.0011) [2023-12-28 01:48:45,645][106225] Updated weights for policy 1, policy_version 914792 (0.0008) [2023-12-28 01:48:45,695][106225] Updated weights for policy 1, policy_version 914802 (0.0007) [2023-12-28 01:48:45,741][106225] Updated weights for policy 1, policy_version 914812 (0.0008) [2023-12-28 01:48:45,887][106226] Updated weights for policy 0, policy_version 912491 (0.0011) [2023-12-28 01:48:45,940][106226] Updated weights for policy 0, policy_version 912501 (0.0010) [2023-12-28 01:48:45,994][106226] Updated weights for policy 0, policy_version 912511 (0.0010) [2023-12-28 01:48:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 467894272. Throughput: 0: 9854.2, 1: 9985.4. Samples: 467882948. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:46,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.893')] [2023-12-28 01:48:46,484][106225] Updated weights for policy 1, policy_version 914822 (0.0007) [2023-12-28 01:48:46,535][106225] Updated weights for policy 1, policy_version 914832 (0.0007) [2023-12-28 01:48:46,581][106225] Updated weights for policy 1, policy_version 914842 (0.0008) [2023-12-28 01:48:46,708][106226] Updated weights for policy 0, policy_version 912521 (0.0010) [2023-12-28 01:48:46,771][106226] Updated weights for policy 0, policy_version 912531 (0.0011) [2023-12-28 01:48:46,824][106226] Updated weights for policy 0, policy_version 912541 (0.0010) [2023-12-28 01:48:46,874][106226] Updated weights for policy 0, policy_version 912551 (0.0010) [2023-12-28 01:48:47,328][106225] Updated weights for policy 1, policy_version 914852 (0.0008) [2023-12-28 01:48:47,386][106225] Updated weights for policy 1, policy_version 914862 (0.0007) [2023-12-28 01:48:47,443][106225] Updated weights for policy 1, policy_version 914872 (0.0008) [2023-12-28 01:48:47,624][106226] Updated weights for policy 0, policy_version 912561 (0.0009) [2023-12-28 01:48:47,685][106226] Updated weights for policy 0, policy_version 912571 (0.0009) [2023-12-28 01:48:47,742][106226] Updated weights for policy 0, policy_version 912581 (0.0008) [2023-12-28 01:48:48,127][106225] Updated weights for policy 1, policy_version 914882 (0.0007) [2023-12-28 01:48:48,183][106225] Updated weights for policy 1, policy_version 914892 (0.0005) [2023-12-28 01:48:48,241][106225] Updated weights for policy 1, policy_version 914902 (0.0007) [2023-12-28 01:48:48,304][106225] Updated weights for policy 1, policy_version 914912 (0.0009) [2023-12-28 01:48:48,427][106226] Updated weights for policy 0, policy_version 912591 (0.0009) [2023-12-28 01:48:48,488][106226] Updated weights for policy 0, policy_version 912601 (0.0009) [2023-12-28 01:48:48,557][106226] Updated weights for policy 0, policy_version 912611 (0.0009) [2023-12-28 01:48:48,944][106225] Updated weights for policy 1, policy_version 914922 (0.0009) [2023-12-28 01:48:48,993][106225] Updated weights for policy 1, policy_version 914932 (0.0008) [2023-12-28 01:48:49,045][106225] Updated weights for policy 1, policy_version 914942 (0.0007) [2023-12-28 01:48:49,336][106226] Updated weights for policy 0, policy_version 912621 (0.0010) [2023-12-28 01:48:49,407][106226] Updated weights for policy 0, policy_version 912631 (0.0009) [2023-12-28 01:48:49,468][106226] Updated weights for policy 0, policy_version 912641 (0.0009) [2023-12-28 01:48:49,705][106225] Updated weights for policy 1, policy_version 914952 (0.0007) [2023-12-28 01:48:49,766][106225] Updated weights for policy 1, policy_version 914962 (0.0006) [2023-12-28 01:48:49,835][106225] Updated weights for policy 1, policy_version 914972 (0.0008) [2023-12-28 01:48:50,237][106226] Updated weights for policy 0, policy_version 912651 (0.0010) [2023-12-28 01:48:50,298][106226] Updated weights for policy 0, policy_version 912661 (0.0011) [2023-12-28 01:48:50,356][106226] Updated weights for policy 0, policy_version 912671 (0.0011) [2023-12-28 01:48:50,613][106225] Updated weights for policy 1, policy_version 914982 (0.0009) [2023-12-28 01:48:50,672][106225] Updated weights for policy 1, policy_version 914992 (0.0010) [2023-12-28 01:48:50,730][106225] Updated weights for policy 1, policy_version 915002 (0.0010) [2023-12-28 01:48:51,077][106226] Updated weights for policy 0, policy_version 912681 (0.0011) [2023-12-28 01:48:51,144][106226] Updated weights for policy 0, policy_version 912691 (0.0008) [2023-12-28 01:48:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 467984384. Throughput: 0: 9756.5, 1: 9905.1. Samples: 467997920. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:51,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-5.316')] [2023-12-28 01:48:51,203][106226] Updated weights for policy 0, policy_version 912701 (0.0008) [2023-12-28 01:48:51,264][106226] Updated weights for policy 0, policy_version 912711 (0.0008) [2023-12-28 01:48:51,500][106225] Updated weights for policy 1, policy_version 915012 (0.0010) [2023-12-28 01:48:51,562][106225] Updated weights for policy 1, policy_version 915022 (0.0011) [2023-12-28 01:48:51,624][106225] Updated weights for policy 1, policy_version 915032 (0.0010) [2023-12-28 01:48:52,058][106226] Updated weights for policy 0, policy_version 912721 (0.0005) [2023-12-28 01:48:52,107][106226] Updated weights for policy 0, policy_version 912731 (0.0007) [2023-12-28 01:48:52,172][106226] Updated weights for policy 0, policy_version 912741 (0.0008) [2023-12-28 01:48:52,313][106225] Updated weights for policy 1, policy_version 915042 (0.0007) [2023-12-28 01:48:52,380][106225] Updated weights for policy 1, policy_version 915052 (0.0008) [2023-12-28 01:48:52,433][106225] Updated weights for policy 1, policy_version 915062 (0.0007) [2023-12-28 01:48:52,491][106225] Updated weights for policy 1, policy_version 915072 (0.0006) [2023-12-28 01:48:52,902][106226] Updated weights for policy 0, policy_version 912751 (0.0006) [2023-12-28 01:48:52,968][106226] Updated weights for policy 0, policy_version 912761 (0.0010) [2023-12-28 01:48:53,034][106226] Updated weights for policy 0, policy_version 912771 (0.0011) [2023-12-28 01:48:53,144][106225] Updated weights for policy 1, policy_version 915082 (0.0006) [2023-12-28 01:48:53,198][106225] Updated weights for policy 1, policy_version 915092 (0.0008) [2023-12-28 01:48:53,248][106225] Updated weights for policy 1, policy_version 915102 (0.0006) [2023-12-28 01:48:53,714][106226] Updated weights for policy 0, policy_version 912781 (0.0011) [2023-12-28 01:48:53,764][106226] Updated weights for policy 0, policy_version 912791 (0.0010) [2023-12-28 01:48:53,820][106226] Updated weights for policy 0, policy_version 912801 (0.0010) [2023-12-28 01:48:53,857][106225] Updated weights for policy 1, policy_version 915112 (0.0006) [2023-12-28 01:48:53,913][106225] Updated weights for policy 1, policy_version 915122 (0.0005) [2023-12-28 01:48:53,967][106225] Updated weights for policy 1, policy_version 915132 (0.0007) [2023-12-28 01:48:54,557][106226] Updated weights for policy 0, policy_version 912811 (0.0010) [2023-12-28 01:48:54,604][106226] Updated weights for policy 0, policy_version 912821 (0.0010) [2023-12-28 01:48:54,654][106226] Updated weights for policy 0, policy_version 912831 (0.0010) [2023-12-28 01:48:54,675][106225] Updated weights for policy 1, policy_version 915142 (0.0006) [2023-12-28 01:48:54,719][106225] Updated weights for policy 1, policy_version 915152 (0.0006) [2023-12-28 01:48:54,779][106225] Updated weights for policy 1, policy_version 915162 (0.0008) [2023-12-28 01:48:55,395][106226] Updated weights for policy 0, policy_version 912841 (0.0010) [2023-12-28 01:48:55,448][106226] Updated weights for policy 0, policy_version 912851 (0.0010) [2023-12-28 01:48:55,500][106226] Updated weights for policy 0, policy_version 912861 (0.0010) [2023-12-28 01:48:55,518][106225] Updated weights for policy 1, policy_version 915172 (0.0007) [2023-12-28 01:48:55,547][106226] Updated weights for policy 0, policy_version 912871 (0.0010) [2023-12-28 01:48:55,572][106225] Updated weights for policy 1, policy_version 915182 (0.0006) [2023-12-28 01:48:55,625][106225] Updated weights for policy 1, policy_version 915192 (0.0008) [2023-12-28 01:48:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 468082688. Throughput: 0: 9747.3, 1: 9927.8. Samples: 468056708. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:48:56,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.009')] [2023-12-28 01:48:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000915200_234332160.pth... [2023-12-28 01:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000912872_233750528.pth... [2023-12-28 01:48:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000914048_234037248.pth [2023-12-28 01:48:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000911752_233463808.pth [2023-12-28 01:48:56,279][106226] Updated weights for policy 0, policy_version 912881 (0.0010) [2023-12-28 01:48:56,345][106226] Updated weights for policy 0, policy_version 912891 (0.0011) [2023-12-28 01:48:56,359][106225] Updated weights for policy 1, policy_version 915202 (0.0007) [2023-12-28 01:48:56,399][106226] Updated weights for policy 0, policy_version 912901 (0.0011) [2023-12-28 01:48:56,410][106225] Updated weights for policy 1, policy_version 915212 (0.0009) [2023-12-28 01:48:56,461][106225] Updated weights for policy 1, policy_version 915222 (0.0007) [2023-12-28 01:48:56,511][106225] Updated weights for policy 1, policy_version 915232 (0.0007) [2023-12-28 01:48:57,103][106226] Updated weights for policy 0, policy_version 912911 (0.0007) [2023-12-28 01:48:57,155][106226] Updated weights for policy 0, policy_version 912921 (0.0005) [2023-12-28 01:48:57,213][106226] Updated weights for policy 0, policy_version 912931 (0.0005) [2023-12-28 01:48:57,274][106225] Updated weights for policy 1, policy_version 915242 (0.0009) [2023-12-28 01:48:57,332][106225] Updated weights for policy 1, policy_version 915252 (0.0009) [2023-12-28 01:48:57,385][106225] Updated weights for policy 1, policy_version 915262 (0.0008) [2023-12-28 01:48:57,732][106226] Updated weights for policy 0, policy_version 912941 (0.0008) [2023-12-28 01:48:57,792][106226] Updated weights for policy 0, policy_version 912951 (0.0009) [2023-12-28 01:48:57,857][106226] Updated weights for policy 0, policy_version 912961 (0.0008) [2023-12-28 01:48:58,195][106225] Updated weights for policy 1, policy_version 915272 (0.0008) [2023-12-28 01:48:58,256][106225] Updated weights for policy 1, policy_version 915282 (0.0009) [2023-12-28 01:48:58,315][106225] Updated weights for policy 1, policy_version 915292 (0.0009) [2023-12-28 01:48:58,519][106226] Updated weights for policy 0, policy_version 912971 (0.0006) [2023-12-28 01:48:58,584][106226] Updated weights for policy 0, policy_version 912981 (0.0009) [2023-12-28 01:48:58,647][106226] Updated weights for policy 0, policy_version 912991 (0.0008) [2023-12-28 01:48:59,164][106225] Updated weights for policy 1, policy_version 915302 (0.0008) [2023-12-28 01:48:59,213][106225] Updated weights for policy 1, policy_version 915312 (0.0008) [2023-12-28 01:48:59,289][106225] Updated weights for policy 1, policy_version 915322 (0.0008) [2023-12-28 01:48:59,560][106226] Updated weights for policy 0, policy_version 913001 (0.0008) [2023-12-28 01:48:59,621][106226] Updated weights for policy 0, policy_version 913011 (0.0008) [2023-12-28 01:48:59,685][106226] Updated weights for policy 0, policy_version 913021 (0.0005) [2023-12-28 01:48:59,744][106226] Updated weights for policy 0, policy_version 913031 (0.0008) [2023-12-28 01:49:00,096][106225] Updated weights for policy 1, policy_version 915332 (0.0008) [2023-12-28 01:49:00,154][106225] Updated weights for policy 1, policy_version 915342 (0.0008) [2023-12-28 01:49:00,209][106225] Updated weights for policy 1, policy_version 915352 (0.0006) [2023-12-28 01:49:00,408][106226] Updated weights for policy 0, policy_version 913041 (0.0008) [2023-12-28 01:49:00,462][106226] Updated weights for policy 0, policy_version 913051 (0.0009) [2023-12-28 01:49:00,515][106226] Updated weights for policy 0, policy_version 913061 (0.0009) [2023-12-28 01:49:00,792][106225] Updated weights for policy 1, policy_version 915362 (0.0006) [2023-12-28 01:49:00,852][106225] Updated weights for policy 1, policy_version 915372 (0.0008) [2023-12-28 01:49:00,908][106225] Updated weights for policy 1, policy_version 915382 (0.0008) [2023-12-28 01:49:00,967][106225] Updated weights for policy 1, policy_version 915392 (0.0008) [2023-12-28 01:49:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 468180992. Throughput: 0: 9844.6, 1: 9790.5. Samples: 468170172. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:01,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.159')] [2023-12-28 01:49:01,329][106226] Updated weights for policy 0, policy_version 913071 (0.0009) [2023-12-28 01:49:01,400][106226] Updated weights for policy 0, policy_version 913081 (0.0008) [2023-12-28 01:49:01,463][106226] Updated weights for policy 0, policy_version 913091 (0.0009) [2023-12-28 01:49:01,680][106225] Updated weights for policy 1, policy_version 915402 (0.0008) [2023-12-28 01:49:01,751][106225] Updated weights for policy 1, policy_version 915412 (0.0008) [2023-12-28 01:49:01,810][106225] Updated weights for policy 1, policy_version 915422 (0.0009) [2023-12-28 01:49:02,154][106226] Updated weights for policy 0, policy_version 913101 (0.0008) [2023-12-28 01:49:02,208][106226] Updated weights for policy 0, policy_version 913111 (0.0008) [2023-12-28 01:49:02,266][106226] Updated weights for policy 0, policy_version 913121 (0.0009) [2023-12-28 01:49:02,608][106225] Updated weights for policy 1, policy_version 915432 (0.0009) [2023-12-28 01:49:02,664][106225] Updated weights for policy 1, policy_version 915442 (0.0009) [2023-12-28 01:49:02,729][106225] Updated weights for policy 1, policy_version 915452 (0.0007) [2023-12-28 01:49:02,967][106226] Updated weights for policy 0, policy_version 913131 (0.0009) [2023-12-28 01:49:03,031][106226] Updated weights for policy 0, policy_version 913141 (0.0009) [2023-12-28 01:49:03,099][106226] Updated weights for policy 0, policy_version 913151 (0.0008) [2023-12-28 01:49:03,346][106225] Updated weights for policy 1, policy_version 915462 (0.0007) [2023-12-28 01:49:03,401][106225] Updated weights for policy 1, policy_version 915472 (0.0006) [2023-12-28 01:49:03,454][106225] Updated weights for policy 1, policy_version 915482 (0.0006) [2023-12-28 01:49:03,886][106226] Updated weights for policy 0, policy_version 913161 (0.0009) [2023-12-28 01:49:03,942][106226] Updated weights for policy 0, policy_version 913171 (0.0008) [2023-12-28 01:49:04,000][106226] Updated weights for policy 0, policy_version 913181 (0.0008) [2023-12-28 01:49:04,060][106226] Updated weights for policy 0, policy_version 913191 (0.0009) [2023-12-28 01:49:04,074][106225] Updated weights for policy 1, policy_version 915492 (0.0006) [2023-12-28 01:49:04,124][106225] Updated weights for policy 1, policy_version 915502 (0.0009) [2023-12-28 01:49:04,189][106225] Updated weights for policy 1, policy_version 915512 (0.0006) [2023-12-28 01:49:04,745][106226] Updated weights for policy 0, policy_version 913201 (0.0009) [2023-12-28 01:49:04,798][106226] Updated weights for policy 0, policy_version 913211 (0.0008) [2023-12-28 01:49:04,857][106226] Updated weights for policy 0, policy_version 913221 (0.0005) [2023-12-28 01:49:04,909][106225] Updated weights for policy 1, policy_version 915522 (0.0008) [2023-12-28 01:49:04,963][106225] Updated weights for policy 1, policy_version 915532 (0.0007) [2023-12-28 01:49:05,023][106225] Updated weights for policy 1, policy_version 915542 (0.0009) [2023-12-28 01:49:05,080][106225] Updated weights for policy 1, policy_version 915552 (0.0008) [2023-12-28 01:49:05,556][106226] Updated weights for policy 0, policy_version 913231 (0.0008) [2023-12-28 01:49:05,606][106226] Updated weights for policy 0, policy_version 913241 (0.0008) [2023-12-28 01:49:05,655][106226] Updated weights for policy 0, policy_version 913251 (0.0009) [2023-12-28 01:49:05,834][106225] Updated weights for policy 1, policy_version 915562 (0.0008) [2023-12-28 01:49:05,890][106225] Updated weights for policy 1, policy_version 915572 (0.0008) [2023-12-28 01:49:05,948][106225] Updated weights for policy 1, policy_version 915582 (0.0008) [2023-12-28 01:49:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 468279296. Throughput: 0: 9764.4, 1: 9803.6. Samples: 468288320. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:06,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-5.232')] [2023-12-28 01:49:06,412][106226] Updated weights for policy 0, policy_version 913261 (0.0009) [2023-12-28 01:49:06,485][106226] Updated weights for policy 0, policy_version 913271 (0.0009) [2023-12-28 01:49:06,559][106226] Updated weights for policy 0, policy_version 913281 (0.0009) [2023-12-28 01:49:06,597][106225] Updated weights for policy 1, policy_version 915592 (0.0006) [2023-12-28 01:49:06,654][106225] Updated weights for policy 1, policy_version 915602 (0.0005) [2023-12-28 01:49:06,707][106225] Updated weights for policy 1, policy_version 915612 (0.0005) [2023-12-28 01:49:07,250][106226] Updated weights for policy 0, policy_version 913291 (0.0008) [2023-12-28 01:49:07,294][106225] Updated weights for policy 1, policy_version 915622 (0.0007) [2023-12-28 01:49:07,303][106226] Updated weights for policy 0, policy_version 913301 (0.0009) [2023-12-28 01:49:07,352][106225] Updated weights for policy 1, policy_version 915632 (0.0007) [2023-12-28 01:49:07,364][106226] Updated weights for policy 0, policy_version 913311 (0.0009) [2023-12-28 01:49:07,409][106225] Updated weights for policy 1, policy_version 915642 (0.0008) [2023-12-28 01:49:07,970][106226] Updated weights for policy 0, policy_version 913321 (0.0006) [2023-12-28 01:49:07,979][106225] Updated weights for policy 1, policy_version 915652 (0.0008) [2023-12-28 01:49:08,025][106226] Updated weights for policy 0, policy_version 913331 (0.0011) [2023-12-28 01:49:08,039][106225] Updated weights for policy 1, policy_version 915662 (0.0006) [2023-12-28 01:49:08,078][106226] Updated weights for policy 0, policy_version 913341 (0.0011) [2023-12-28 01:49:08,093][106225] Updated weights for policy 1, policy_version 915672 (0.0006) [2023-12-28 01:49:08,136][106226] Updated weights for policy 0, policy_version 913351 (0.0010) [2023-12-28 01:49:08,830][106225] Updated weights for policy 1, policy_version 915682 (0.0008) [2023-12-28 01:49:08,887][106225] Updated weights for policy 1, policy_version 915692 (0.0008) [2023-12-28 01:49:08,897][106226] Updated weights for policy 0, policy_version 913361 (0.0011) [2023-12-28 01:49:08,946][106225] Updated weights for policy 1, policy_version 915702 (0.0006) [2023-12-28 01:49:08,951][106226] Updated weights for policy 0, policy_version 913371 (0.0010) [2023-12-28 01:49:08,997][106225] Updated weights for policy 1, policy_version 915712 (0.0008) [2023-12-28 01:49:09,006][106226] Updated weights for policy 0, policy_version 913381 (0.0006) [2023-12-28 01:49:09,685][106226] Updated weights for policy 0, policy_version 913391 (0.0008) [2023-12-28 01:49:09,721][106225] Updated weights for policy 1, policy_version 915722 (0.0006) [2023-12-28 01:49:09,752][106226] Updated weights for policy 0, policy_version 913401 (0.0009) [2023-12-28 01:49:09,782][106225] Updated weights for policy 1, policy_version 915732 (0.0006) [2023-12-28 01:49:09,816][106226] Updated weights for policy 0, policy_version 913411 (0.0008) [2023-12-28 01:49:09,858][106225] Updated weights for policy 1, policy_version 915742 (0.0007) [2023-12-28 01:49:10,524][106225] Updated weights for policy 1, policy_version 915752 (0.0009) [2023-12-28 01:49:10,584][106225] Updated weights for policy 1, policy_version 915762 (0.0006) [2023-12-28 01:49:10,616][106226] Updated weights for policy 0, policy_version 913421 (0.0008) [2023-12-28 01:49:10,642][106225] Updated weights for policy 1, policy_version 915772 (0.0007) [2023-12-28 01:49:10,688][106226] Updated weights for policy 0, policy_version 913431 (0.0007) [2023-12-28 01:49:10,758][106226] Updated weights for policy 0, policy_version 913441 (0.0008) [2023-12-28 01:49:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 468377600. Throughput: 0: 9743.0, 1: 9932.7. Samples: 468350684. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:11,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.913')] [2023-12-28 01:49:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000913448_233897984.pth... [2023-12-28 01:49:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000915776_234479616.pth... [2023-12-28 01:49:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000914624_234184704.pth [2023-12-28 01:49:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000912328_233611264.pth [2023-12-28 01:49:11,370][106225] Updated weights for policy 1, policy_version 915782 (0.0008) [2023-12-28 01:49:11,430][106225] Updated weights for policy 1, policy_version 915792 (0.0009) [2023-12-28 01:49:11,493][106225] Updated weights for policy 1, policy_version 915802 (0.0011) [2023-12-28 01:49:11,537][106226] Updated weights for policy 0, policy_version 913451 (0.0009) [2023-12-28 01:49:11,596][106226] Updated weights for policy 0, policy_version 913461 (0.0008) [2023-12-28 01:49:11,667][106226] Updated weights for policy 0, policy_version 913471 (0.0009) [2023-12-28 01:49:12,137][106225] Updated weights for policy 1, policy_version 915812 (0.0009) [2023-12-28 01:49:12,201][106225] Updated weights for policy 1, policy_version 915822 (0.0006) [2023-12-28 01:49:12,263][106225] Updated weights for policy 1, policy_version 915832 (0.0006) [2023-12-28 01:49:12,459][106226] Updated weights for policy 0, policy_version 913481 (0.0009) [2023-12-28 01:49:12,509][106226] Updated weights for policy 0, policy_version 913491 (0.0011) [2023-12-28 01:49:12,570][106226] Updated weights for policy 0, policy_version 913501 (0.0011) [2023-12-28 01:49:12,638][106226] Updated weights for policy 0, policy_version 913511 (0.0011) [2023-12-28 01:49:12,890][106225] Updated weights for policy 1, policy_version 915842 (0.0009) [2023-12-28 01:49:12,953][106225] Updated weights for policy 1, policy_version 915852 (0.0008) [2023-12-28 01:49:13,011][106225] Updated weights for policy 1, policy_version 915862 (0.0007) [2023-12-28 01:49:13,065][106225] Updated weights for policy 1, policy_version 915872 (0.0008) [2023-12-28 01:49:13,255][106226] Updated weights for policy 0, policy_version 913521 (0.0006) [2023-12-28 01:49:13,319][106226] Updated weights for policy 0, policy_version 913531 (0.0007) [2023-12-28 01:49:13,375][106226] Updated weights for policy 0, policy_version 913541 (0.0007) [2023-12-28 01:49:13,798][106225] Updated weights for policy 1, policy_version 915882 (0.0010) [2023-12-28 01:49:13,851][106225] Updated weights for policy 1, policy_version 915892 (0.0010) [2023-12-28 01:49:13,914][106225] Updated weights for policy 1, policy_version 915902 (0.0010) [2023-12-28 01:49:13,974][106226] Updated weights for policy 0, policy_version 913551 (0.0009) [2023-12-28 01:49:14,023][106226] Updated weights for policy 0, policy_version 913561 (0.0006) [2023-12-28 01:49:14,080][106226] Updated weights for policy 0, policy_version 913571 (0.0008) [2023-12-28 01:49:14,590][106225] Updated weights for policy 1, policy_version 915912 (0.0006) [2023-12-28 01:49:14,650][106225] Updated weights for policy 1, policy_version 915922 (0.0006) [2023-12-28 01:49:14,706][106225] Updated weights for policy 1, policy_version 915932 (0.0006) [2023-12-28 01:49:14,817][106226] Updated weights for policy 0, policy_version 913581 (0.0007) [2023-12-28 01:49:14,886][106226] Updated weights for policy 0, policy_version 913591 (0.0007) [2023-12-28 01:49:14,954][106226] Updated weights for policy 0, policy_version 913601 (0.0005) [2023-12-28 01:49:15,408][106225] Updated weights for policy 1, policy_version 915942 (0.0008) [2023-12-28 01:49:15,462][106225] Updated weights for policy 1, policy_version 915952 (0.0010) [2023-12-28 01:49:15,520][106225] Updated weights for policy 1, policy_version 915962 (0.0010) [2023-12-28 01:49:15,568][106226] Updated weights for policy 0, policy_version 913611 (0.0006) [2023-12-28 01:49:15,625][106226] Updated weights for policy 0, policy_version 913621 (0.0006) [2023-12-28 01:49:15,680][106226] Updated weights for policy 0, policy_version 913631 (0.0006) [2023-12-28 01:49:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 468475904. Throughput: 0: 9683.8, 1: 9834.9. Samples: 468468484. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:16,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.047')] [2023-12-28 01:49:16,236][106225] Updated weights for policy 1, policy_version 915972 (0.0010) [2023-12-28 01:49:16,288][106225] Updated weights for policy 1, policy_version 915982 (0.0010) [2023-12-28 01:49:16,335][106226] Updated weights for policy 0, policy_version 913641 (0.0005) [2023-12-28 01:49:16,345][106225] Updated weights for policy 1, policy_version 915992 (0.0010) [2023-12-28 01:49:16,394][106226] Updated weights for policy 0, policy_version 913651 (0.0008) [2023-12-28 01:49:16,443][106226] Updated weights for policy 0, policy_version 913661 (0.0008) [2023-12-28 01:49:16,491][106226] Updated weights for policy 0, policy_version 913671 (0.0010) [2023-12-28 01:49:17,058][106225] Updated weights for policy 1, policy_version 916002 (0.0006) [2023-12-28 01:49:17,102][106225] Updated weights for policy 1, policy_version 916012 (0.0008) [2023-12-28 01:49:17,145][106225] Updated weights for policy 1, policy_version 916022 (0.0008) [2023-12-28 01:49:17,193][106225] Updated weights for policy 1, policy_version 916032 (0.0008) [2023-12-28 01:49:17,203][106226] Updated weights for policy 0, policy_version 913681 (0.0007) [2023-12-28 01:49:17,263][106226] Updated weights for policy 0, policy_version 913691 (0.0008) [2023-12-28 01:49:17,318][106226] Updated weights for policy 0, policy_version 913702 (0.0009) [2023-12-28 01:49:17,892][106225] Updated weights for policy 1, policy_version 916042 (0.0008) [2023-12-28 01:49:17,939][106225] Updated weights for policy 1, policy_version 916052 (0.0008) [2023-12-28 01:49:17,983][106225] Updated weights for policy 1, policy_version 916062 (0.0008) [2023-12-28 01:49:18,016][106226] Updated weights for policy 0, policy_version 913712 (0.0008) [2023-12-28 01:49:18,071][106226] Updated weights for policy 0, policy_version 913722 (0.0008) [2023-12-28 01:49:18,138][106226] Updated weights for policy 0, policy_version 913732 (0.0008) [2023-12-28 01:49:18,755][106225] Updated weights for policy 1, policy_version 916072 (0.0008) [2023-12-28 01:49:18,814][106225] Updated weights for policy 1, policy_version 916082 (0.0007) [2023-12-28 01:49:18,835][106226] Updated weights for policy 0, policy_version 913742 (0.0010) [2023-12-28 01:49:18,873][106225] Updated weights for policy 1, policy_version 916092 (0.0007) [2023-12-28 01:49:18,894][106226] Updated weights for policy 0, policy_version 913752 (0.0009) [2023-12-28 01:49:18,952][106226] Updated weights for policy 0, policy_version 913762 (0.0008) [2023-12-28 01:49:19,559][106225] Updated weights for policy 1, policy_version 916102 (0.0008) [2023-12-28 01:49:19,619][106225] Updated weights for policy 1, policy_version 916112 (0.0007) [2023-12-28 01:49:19,686][106225] Updated weights for policy 1, policy_version 916122 (0.0007) [2023-12-28 01:49:19,767][106226] Updated weights for policy 0, policy_version 913772 (0.0009) [2023-12-28 01:49:19,844][106226] Updated weights for policy 0, policy_version 913782 (0.0013) [2023-12-28 01:49:19,908][106226] Updated weights for policy 0, policy_version 913792 (0.0008) [2023-12-28 01:49:20,434][106225] Updated weights for policy 1, policy_version 916132 (0.0008) [2023-12-28 01:49:20,496][106225] Updated weights for policy 1, policy_version 916142 (0.0008) [2023-12-28 01:49:20,561][106225] Updated weights for policy 1, policy_version 916152 (0.0009) [2023-12-28 01:49:20,631][106226] Updated weights for policy 0, policy_version 913802 (0.0008) [2023-12-28 01:49:20,698][106226] Updated weights for policy 0, policy_version 913812 (0.0008) [2023-12-28 01:49:20,758][106226] Updated weights for policy 0, policy_version 913822 (0.0007) [2023-12-28 01:49:20,822][106226] Updated weights for policy 0, policy_version 913832 (0.0010) [2023-12-28 01:49:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 468574208. Throughput: 0: 9621.0, 1: 9851.2. Samples: 468584940. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:21,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-4.843')] [2023-12-28 01:49:21,307][106225] Updated weights for policy 1, policy_version 916162 (0.0009) [2023-12-28 01:49:21,380][106225] Updated weights for policy 1, policy_version 916172 (0.0008) [2023-12-28 01:49:21,446][106225] Updated weights for policy 1, policy_version 916182 (0.0007) [2023-12-28 01:49:21,508][106225] Updated weights for policy 1, policy_version 916192 (0.0009) [2023-12-28 01:49:21,556][106226] Updated weights for policy 0, policy_version 913842 (0.0009) [2023-12-28 01:49:21,617][106226] Updated weights for policy 0, policy_version 913852 (0.0008) [2023-12-28 01:49:21,685][106226] Updated weights for policy 0, policy_version 913862 (0.0008) [2023-12-28 01:49:22,161][106225] Updated weights for policy 1, policy_version 916202 (0.0008) [2023-12-28 01:49:22,224][106225] Updated weights for policy 1, policy_version 916212 (0.0007) [2023-12-28 01:49:22,280][106225] Updated weights for policy 1, policy_version 916222 (0.0008) [2023-12-28 01:49:22,473][106226] Updated weights for policy 0, policy_version 913872 (0.0009) [2023-12-28 01:49:22,530][106226] Updated weights for policy 0, policy_version 913882 (0.0009) [2023-12-28 01:49:22,592][106226] Updated weights for policy 0, policy_version 913892 (0.0008) [2023-12-28 01:49:23,018][106225] Updated weights for policy 1, policy_version 916232 (0.0008) [2023-12-28 01:49:23,078][106225] Updated weights for policy 1, policy_version 916242 (0.0009) [2023-12-28 01:49:23,136][106225] Updated weights for policy 1, policy_version 916252 (0.0009) [2023-12-28 01:49:23,326][106226] Updated weights for policy 0, policy_version 913902 (0.0007) [2023-12-28 01:49:23,389][106226] Updated weights for policy 0, policy_version 913912 (0.0005) [2023-12-28 01:49:23,437][106226] Updated weights for policy 0, policy_version 913922 (0.0005) [2023-12-28 01:49:23,749][106225] Updated weights for policy 1, policy_version 916262 (0.0006) [2023-12-28 01:49:23,812][106225] Updated weights for policy 1, policy_version 916272 (0.0005) [2023-12-28 01:49:23,864][106225] Updated weights for policy 1, policy_version 916282 (0.0005) [2023-12-28 01:49:23,976][106226] Updated weights for policy 0, policy_version 913932 (0.0006) [2023-12-28 01:49:24,037][106226] Updated weights for policy 0, policy_version 913942 (0.0008) [2023-12-28 01:49:24,098][106226] Updated weights for policy 0, policy_version 913952 (0.0008) [2023-12-28 01:49:24,509][106225] Updated weights for policy 1, policy_version 916292 (0.0007) [2023-12-28 01:49:24,571][106225] Updated weights for policy 1, policy_version 916302 (0.0010) [2023-12-28 01:49:24,622][106225] Updated weights for policy 1, policy_version 916312 (0.0008) [2023-12-28 01:49:24,807][106226] Updated weights for policy 0, policy_version 913962 (0.0008) [2023-12-28 01:49:24,861][106226] Updated weights for policy 0, policy_version 913972 (0.0008) [2023-12-28 01:49:24,908][106226] Updated weights for policy 0, policy_version 913982 (0.0008) [2023-12-28 01:49:24,961][106226] Updated weights for policy 0, policy_version 913992 (0.0008) [2023-12-28 01:49:25,293][106225] Updated weights for policy 1, policy_version 916322 (0.0010) [2023-12-28 01:49:25,353][106225] Updated weights for policy 1, policy_version 916332 (0.0010) [2023-12-28 01:49:25,403][106225] Updated weights for policy 1, policy_version 916342 (0.0010) [2023-12-28 01:49:25,456][106225] Updated weights for policy 1, policy_version 916352 (0.0010) [2023-12-28 01:49:25,642][106226] Updated weights for policy 0, policy_version 914002 (0.0006) [2023-12-28 01:49:25,708][106226] Updated weights for policy 0, policy_version 914012 (0.0006) [2023-12-28 01:49:25,760][106226] Updated weights for policy 0, policy_version 914022 (0.0007) [2023-12-28 01:49:26,066][106225] Updated weights for policy 1, policy_version 916362 (0.0005) [2023-12-28 01:49:26,120][106225] Updated weights for policy 1, policy_version 916372 (0.0009) [2023-12-28 01:49:26,173][106225] Updated weights for policy 1, policy_version 916382 (0.0009) [2023-12-28 01:49:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 468672512. Throughput: 0: 9645.7, 1: 9821.0. Samples: 468644796. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:26,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.148')] [2023-12-28 01:49:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000914024_234045440.pth... [2023-12-28 01:49:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000912872_233750528.pth [2023-12-28 01:49:26,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000916384_234635264.pth... [2023-12-28 01:49:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000915200_234332160.pth [2023-12-28 01:49:26,351][106226] Updated weights for policy 0, policy_version 914032 (0.0006) [2023-12-28 01:49:26,412][106226] Updated weights for policy 0, policy_version 914042 (0.0005) [2023-12-28 01:49:26,479][106226] Updated weights for policy 0, policy_version 914052 (0.0006) [2023-12-28 01:49:26,705][106225] Updated weights for policy 1, policy_version 916392 (0.0006) [2023-12-28 01:49:26,748][106225] Updated weights for policy 1, policy_version 916402 (0.0005) [2023-12-28 01:49:26,813][106225] Updated weights for policy 1, policy_version 916412 (0.0010) [2023-12-28 01:49:26,986][106226] Updated weights for policy 0, policy_version 914062 (0.0006) [2023-12-28 01:49:27,052][106226] Updated weights for policy 0, policy_version 914072 (0.0005) [2023-12-28 01:49:27,109][106226] Updated weights for policy 0, policy_version 914082 (0.0007) [2023-12-28 01:49:27,415][106225] Updated weights for policy 1, policy_version 916422 (0.0009) [2023-12-28 01:49:27,477][106225] Updated weights for policy 1, policy_version 916432 (0.0010) [2023-12-28 01:49:27,532][106225] Updated weights for policy 1, policy_version 916442 (0.0010) [2023-12-28 01:49:27,668][106226] Updated weights for policy 0, policy_version 914092 (0.0006) [2023-12-28 01:49:27,725][106226] Updated weights for policy 0, policy_version 914102 (0.0008) [2023-12-28 01:49:27,784][106226] Updated weights for policy 0, policy_version 914112 (0.0008) [2023-12-28 01:49:28,122][106225] Updated weights for policy 1, policy_version 916452 (0.0008) [2023-12-28 01:49:28,167][106225] Updated weights for policy 1, policy_version 916462 (0.0005) [2023-12-28 01:49:28,211][106225] Updated weights for policy 1, policy_version 916472 (0.0005) [2023-12-28 01:49:28,552][106226] Updated weights for policy 0, policy_version 914122 (0.0009) [2023-12-28 01:49:28,615][106226] Updated weights for policy 0, policy_version 914132 (0.0008) [2023-12-28 01:49:28,669][106226] Updated weights for policy 0, policy_version 914142 (0.0008) [2023-12-28 01:49:28,725][106226] Updated weights for policy 0, policy_version 914152 (0.0009) [2023-12-28 01:49:28,835][106225] Updated weights for policy 1, policy_version 916482 (0.0006) [2023-12-28 01:49:28,896][106225] Updated weights for policy 1, policy_version 916492 (0.0010) [2023-12-28 01:49:28,950][106225] Updated weights for policy 1, policy_version 916502 (0.0010) [2023-12-28 01:49:28,998][106225] Updated weights for policy 1, policy_version 916512 (0.0009) [2023-12-28 01:49:29,503][106226] Updated weights for policy 0, policy_version 914162 (0.0008) [2023-12-28 01:49:29,571][106226] Updated weights for policy 0, policy_version 914172 (0.0008) [2023-12-28 01:49:29,628][106226] Updated weights for policy 0, policy_version 914182 (0.0007) [2023-12-28 01:49:29,666][106225] Updated weights for policy 1, policy_version 916522 (0.0011) [2023-12-28 01:49:29,726][106225] Updated weights for policy 1, policy_version 916532 (0.0009) [2023-12-28 01:49:29,784][106225] Updated weights for policy 1, policy_version 916542 (0.0007) [2023-12-28 01:49:30,427][106226] Updated weights for policy 0, policy_version 914192 (0.0006) [2023-12-28 01:49:30,472][106225] Updated weights for policy 1, policy_version 916552 (0.0009) [2023-12-28 01:49:30,486][106226] Updated weights for policy 0, policy_version 914202 (0.0006) [2023-12-28 01:49:30,523][106225] Updated weights for policy 1, policy_version 916562 (0.0010) [2023-12-28 01:49:30,541][106226] Updated weights for policy 0, policy_version 914212 (0.0006) [2023-12-28 01:49:30,573][106225] Updated weights for policy 1, policy_version 916572 (0.0010) [2023-12-28 01:49:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 468779008. Throughput: 0: 9750.1, 1: 10021.8. Samples: 468772684. Policy #0 lag: (min: 29.0, avg: 38.8, max: 61.0) [2023-12-28 01:49:31,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.907')] [2023-12-28 01:49:31,295][106226] Updated weights for policy 0, policy_version 914222 (0.0006) [2023-12-28 01:49:31,310][106225] Updated weights for policy 1, policy_version 916582 (0.0011) [2023-12-28 01:49:31,356][106226] Updated weights for policy 0, policy_version 914232 (0.0006) [2023-12-28 01:49:31,380][106225] Updated weights for policy 1, policy_version 916592 (0.0010) [2023-12-28 01:49:31,425][106226] Updated weights for policy 0, policy_version 914242 (0.0008) [2023-12-28 01:49:31,447][106225] Updated weights for policy 1, policy_version 916602 (0.0008) [2023-12-28 01:49:32,082][106225] Updated weights for policy 1, policy_version 916612 (0.0007) [2023-12-28 01:49:32,149][106225] Updated weights for policy 1, policy_version 916622 (0.0008) [2023-12-28 01:49:32,199][106226] Updated weights for policy 0, policy_version 914252 (0.0007) [2023-12-28 01:49:32,223][106225] Updated weights for policy 1, policy_version 916632 (0.0011) [2023-12-28 01:49:32,259][106226] Updated weights for policy 0, policy_version 914262 (0.0007) [2023-12-28 01:49:32,323][106226] Updated weights for policy 0, policy_version 914272 (0.0009) [2023-12-28 01:49:32,816][106225] Updated weights for policy 1, policy_version 916642 (0.0009) [2023-12-28 01:49:32,875][106225] Updated weights for policy 1, policy_version 916652 (0.0010) [2023-12-28 01:49:32,932][106225] Updated weights for policy 1, policy_version 916662 (0.0010) [2023-12-28 01:49:32,989][106225] Updated weights for policy 1, policy_version 916672 (0.0009) [2023-12-28 01:49:33,011][106226] Updated weights for policy 0, policy_version 914282 (0.0008) [2023-12-28 01:49:33,062][106226] Updated weights for policy 0, policy_version 914292 (0.0009) [2023-12-28 01:49:33,112][106226] Updated weights for policy 0, policy_version 914302 (0.0009) [2023-12-28 01:49:33,162][106226] Updated weights for policy 0, policy_version 914312 (0.0009) [2023-12-28 01:49:33,534][106225] Updated weights for policy 1, policy_version 916682 (0.0010) [2023-12-28 01:49:33,592][106225] Updated weights for policy 1, policy_version 916692 (0.0010) [2023-12-28 01:49:33,637][106225] Updated weights for policy 1, policy_version 916702 (0.0007) [2023-12-28 01:49:33,829][106226] Updated weights for policy 0, policy_version 914322 (0.0005) [2023-12-28 01:49:33,877][106226] Updated weights for policy 0, policy_version 914332 (0.0005) [2023-12-28 01:49:33,927][106226] Updated weights for policy 0, policy_version 914342 (0.0005) [2023-12-28 01:49:34,319][106225] Updated weights for policy 1, policy_version 916712 (0.0009) [2023-12-28 01:49:34,386][106225] Updated weights for policy 1, policy_version 916722 (0.0010) [2023-12-28 01:49:34,460][106225] Updated weights for policy 1, policy_version 916732 (0.0008) [2023-12-28 01:49:34,539][106226] Updated weights for policy 0, policy_version 914352 (0.0008) [2023-12-28 01:49:34,603][106226] Updated weights for policy 0, policy_version 914362 (0.0009) [2023-12-28 01:49:34,665][106226] Updated weights for policy 0, policy_version 914372 (0.0008) [2023-12-28 01:49:35,150][106225] Updated weights for policy 1, policy_version 916742 (0.0010) [2023-12-28 01:49:35,200][106225] Updated weights for policy 1, policy_version 916752 (0.0010) [2023-12-28 01:49:35,250][106225] Updated weights for policy 1, policy_version 916762 (0.0010) [2023-12-28 01:49:35,405][106226] Updated weights for policy 0, policy_version 914382 (0.0008) [2023-12-28 01:49:35,470][106226] Updated weights for policy 0, policy_version 914392 (0.0006) [2023-12-28 01:49:35,544][106226] Updated weights for policy 0, policy_version 914402 (0.0006) [2023-12-28 01:49:35,907][106225] Updated weights for policy 1, policy_version 916772 (0.0008) [2023-12-28 01:49:35,960][106225] Updated weights for policy 1, policy_version 916782 (0.0005) [2023-12-28 01:49:36,009][106225] Updated weights for policy 1, policy_version 916792 (0.0005) [2023-12-28 01:49:36,095][106226] Updated weights for policy 0, policy_version 914412 (0.0008) [2023-12-28 01:49:36,164][106226] Updated weights for policy 0, policy_version 914422 (0.0009) [2023-12-28 01:49:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 468885504. Throughput: 0: 9843.6, 1: 10112.9. Samples: 468895960. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:49:36,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.695')] [2023-12-28 01:49:36,233][106226] Updated weights for policy 0, policy_version 914432 (0.0009) [2023-12-28 01:49:36,739][106225] Updated weights for policy 1, policy_version 916802 (0.0010) [2023-12-28 01:49:36,797][106225] Updated weights for policy 1, policy_version 916812 (0.0008) [2023-12-28 01:49:36,858][106225] Updated weights for policy 1, policy_version 916822 (0.0007) [2023-12-28 01:49:36,913][106225] Updated weights for policy 1, policy_version 916832 (0.0006) [2023-12-28 01:49:36,986][106226] Updated weights for policy 0, policy_version 914442 (0.0010) [2023-12-28 01:49:37,049][106226] Updated weights for policy 0, policy_version 914452 (0.0009) [2023-12-28 01:49:37,101][106226] Updated weights for policy 0, policy_version 914462 (0.0009) [2023-12-28 01:49:37,156][106226] Updated weights for policy 0, policy_version 914472 (0.0008) [2023-12-28 01:49:37,488][106225] Updated weights for policy 1, policy_version 916842 (0.0008) [2023-12-28 01:49:37,561][106225] Updated weights for policy 1, policy_version 916852 (0.0005) [2023-12-28 01:49:37,630][106225] Updated weights for policy 1, policy_version 916862 (0.0005) [2023-12-28 01:49:37,950][106226] Updated weights for policy 0, policy_version 914482 (0.0009) [2023-12-28 01:49:38,010][106226] Updated weights for policy 0, policy_version 914492 (0.0009) [2023-12-28 01:49:38,060][106226] Updated weights for policy 0, policy_version 914502 (0.0009) [2023-12-28 01:49:38,140][106225] Updated weights for policy 1, policy_version 916872 (0.0007) [2023-12-28 01:49:38,201][106225] Updated weights for policy 1, policy_version 916882 (0.0008) [2023-12-28 01:49:38,258][106225] Updated weights for policy 1, policy_version 916892 (0.0006) [2023-12-28 01:49:38,784][106226] Updated weights for policy 0, policy_version 914512 (0.0006) [2023-12-28 01:49:38,851][106226] Updated weights for policy 0, policy_version 914522 (0.0008) [2023-12-28 01:49:38,908][106226] Updated weights for policy 0, policy_version 914532 (0.0008) [2023-12-28 01:49:38,920][106225] Updated weights for policy 1, policy_version 916902 (0.0006) [2023-12-28 01:49:38,977][106225] Updated weights for policy 1, policy_version 916912 (0.0007) [2023-12-28 01:49:39,039][106225] Updated weights for policy 1, policy_version 916922 (0.0009) [2023-12-28 01:49:39,575][106226] Updated weights for policy 0, policy_version 914542 (0.0009) [2023-12-28 01:49:39,642][106226] Updated weights for policy 0, policy_version 914552 (0.0009) [2023-12-28 01:49:39,704][106226] Updated weights for policy 0, policy_version 914562 (0.0009) [2023-12-28 01:49:39,821][106225] Updated weights for policy 1, policy_version 916932 (0.0008) [2023-12-28 01:49:39,887][106225] Updated weights for policy 1, policy_version 916942 (0.0008) [2023-12-28 01:49:39,946][106225] Updated weights for policy 1, policy_version 916952 (0.0007) [2023-12-28 01:49:40,509][106226] Updated weights for policy 0, policy_version 914572 (0.0009) [2023-12-28 01:49:40,568][106226] Updated weights for policy 0, policy_version 914582 (0.0008) [2023-12-28 01:49:40,577][106225] Updated weights for policy 1, policy_version 916962 (0.0008) [2023-12-28 01:49:40,632][106226] Updated weights for policy 0, policy_version 914592 (0.0006) [2023-12-28 01:49:40,635][106225] Updated weights for policy 1, policy_version 916972 (0.0007) [2023-12-28 01:49:40,696][106225] Updated weights for policy 1, policy_version 916982 (0.0006) [2023-12-28 01:49:40,754][106225] Updated weights for policy 1, policy_version 916992 (0.0006) [2023-12-28 01:49:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 468983808. Throughput: 0: 9827.1, 1: 10171.8. Samples: 468956660. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:49:41,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-4.840')] [2023-12-28 01:49:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000916992_234790912.pth... [2023-12-28 01:49:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000914600_234192896.pth... [2023-12-28 01:49:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000913448_233897984.pth [2023-12-28 01:49:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000915776_234479616.pth [2023-12-28 01:49:41,357][106226] Updated weights for policy 0, policy_version 914602 (0.0007) [2023-12-28 01:49:41,432][106226] Updated weights for policy 0, policy_version 914612 (0.0009) [2023-12-28 01:49:41,486][106225] Updated weights for policy 1, policy_version 917002 (0.0008) [2023-12-28 01:49:41,496][106226] Updated weights for policy 0, policy_version 914622 (0.0007) [2023-12-28 01:49:41,547][106225] Updated weights for policy 1, policy_version 917012 (0.0007) [2023-12-28 01:49:41,557][106226] Updated weights for policy 0, policy_version 914632 (0.0006) [2023-12-28 01:49:41,614][106225] Updated weights for policy 1, policy_version 917022 (0.0008) [2023-12-28 01:49:42,257][106226] Updated weights for policy 0, policy_version 914642 (0.0007) [2023-12-28 01:49:42,324][106226] Updated weights for policy 0, policy_version 914652 (0.0008) [2023-12-28 01:49:42,393][106226] Updated weights for policy 0, policy_version 914662 (0.0007) [2023-12-28 01:49:42,398][106225] Updated weights for policy 1, policy_version 917032 (0.0008) [2023-12-28 01:49:42,466][106225] Updated weights for policy 1, policy_version 917042 (0.0006) [2023-12-28 01:49:42,538][106225] Updated weights for policy 1, policy_version 917052 (0.0006) [2023-12-28 01:49:43,048][106226] Updated weights for policy 0, policy_version 914672 (0.0006) [2023-12-28 01:49:43,096][106226] Updated weights for policy 0, policy_version 914682 (0.0006) [2023-12-28 01:49:43,139][106225] Updated weights for policy 1, policy_version 917062 (0.0009) [2023-12-28 01:49:43,156][106226] Updated weights for policy 0, policy_version 914692 (0.0005) [2023-12-28 01:49:43,200][106225] Updated weights for policy 1, policy_version 917072 (0.0010) [2023-12-28 01:49:43,264][106225] Updated weights for policy 1, policy_version 917082 (0.0010) [2023-12-28 01:49:43,813][106226] Updated weights for policy 0, policy_version 914702 (0.0006) [2023-12-28 01:49:43,822][106225] Updated weights for policy 1, policy_version 917092 (0.0009) [2023-12-28 01:49:43,867][106226] Updated weights for policy 0, policy_version 914712 (0.0006) [2023-12-28 01:49:43,878][106225] Updated weights for policy 1, policy_version 917102 (0.0010) [2023-12-28 01:49:43,933][106225] Updated weights for policy 1, policy_version 917112 (0.0010) [2023-12-28 01:49:43,933][106226] Updated weights for policy 0, policy_version 914722 (0.0005) [2023-12-28 01:49:44,581][106225] Updated weights for policy 1, policy_version 917122 (0.0009) [2023-12-28 01:49:44,636][106225] Updated weights for policy 1, policy_version 917132 (0.0010) [2023-12-28 01:49:44,660][106226] Updated weights for policy 0, policy_version 914732 (0.0007) [2023-12-28 01:49:44,697][106225] Updated weights for policy 1, policy_version 917142 (0.0007) [2023-12-28 01:49:44,715][106226] Updated weights for policy 0, policy_version 914742 (0.0007) [2023-12-28 01:49:44,762][106225] Updated weights for policy 1, policy_version 917152 (0.0007) [2023-12-28 01:49:44,782][106226] Updated weights for policy 0, policy_version 914752 (0.0007) [2023-12-28 01:49:45,494][106225] Updated weights for policy 1, policy_version 917162 (0.0010) [2023-12-28 01:49:45,547][106225] Updated weights for policy 1, policy_version 917172 (0.0010) [2023-12-28 01:49:45,557][106226] Updated weights for policy 0, policy_version 914762 (0.0007) [2023-12-28 01:49:45,594][106225] Updated weights for policy 1, policy_version 917182 (0.0010) [2023-12-28 01:49:45,608][106226] Updated weights for policy 0, policy_version 914772 (0.0006) [2023-12-28 01:49:45,669][106226] Updated weights for policy 0, policy_version 914782 (0.0008) [2023-12-28 01:49:45,723][106226] Updated weights for policy 0, policy_version 914792 (0.0008) [2023-12-28 01:49:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 469082112. Throughput: 0: 9804.5, 1: 10302.1. Samples: 469074964. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:49:46,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-5.338')] [2023-12-28 01:49:46,303][106225] Updated weights for policy 1, policy_version 917192 (0.0006) [2023-12-28 01:49:46,364][106225] Updated weights for policy 1, policy_version 917202 (0.0005) [2023-12-28 01:49:46,419][106226] Updated weights for policy 0, policy_version 914802 (0.0008) [2023-12-28 01:49:46,426][106225] Updated weights for policy 1, policy_version 917212 (0.0007) [2023-12-28 01:49:46,473][106226] Updated weights for policy 0, policy_version 914812 (0.0007) [2023-12-28 01:49:46,521][106226] Updated weights for policy 0, policy_version 914822 (0.0008) [2023-12-28 01:49:47,048][106225] Updated weights for policy 1, policy_version 917222 (0.0010) [2023-12-28 01:49:47,115][106225] Updated weights for policy 1, policy_version 917232 (0.0010) [2023-12-28 01:49:47,175][106225] Updated weights for policy 1, policy_version 917242 (0.0009) [2023-12-28 01:49:47,268][106226] Updated weights for policy 0, policy_version 914832 (0.0007) [2023-12-28 01:49:47,320][106226] Updated weights for policy 0, policy_version 914842 (0.0009) [2023-12-28 01:49:47,378][106226] Updated weights for policy 0, policy_version 914852 (0.0008) [2023-12-28 01:49:47,830][106225] Updated weights for policy 1, policy_version 917252 (0.0008) [2023-12-28 01:49:47,886][106225] Updated weights for policy 1, policy_version 917262 (0.0005) [2023-12-28 01:49:47,939][106225] Updated weights for policy 1, policy_version 917272 (0.0005) [2023-12-28 01:49:48,163][106226] Updated weights for policy 0, policy_version 914862 (0.0009) [2023-12-28 01:49:48,215][106226] Updated weights for policy 0, policy_version 914872 (0.0008) [2023-12-28 01:49:48,271][106226] Updated weights for policy 0, policy_version 914882 (0.0009) [2023-12-28 01:49:48,599][106225] Updated weights for policy 1, policy_version 917282 (0.0008) [2023-12-28 01:49:48,665][106225] Updated weights for policy 1, policy_version 917292 (0.0008) [2023-12-28 01:49:48,722][106225] Updated weights for policy 1, policy_version 917302 (0.0009) [2023-12-28 01:49:48,771][106225] Updated weights for policy 1, policy_version 917312 (0.0008) [2023-12-28 01:49:49,043][106226] Updated weights for policy 0, policy_version 914892 (0.0009) [2023-12-28 01:49:49,098][106226] Updated weights for policy 0, policy_version 914903 (0.0009) [2023-12-28 01:49:49,154][106226] Updated weights for policy 0, policy_version 914913 (0.0009) [2023-12-28 01:49:49,455][106225] Updated weights for policy 1, policy_version 917322 (0.0009) [2023-12-28 01:49:49,515][106225] Updated weights for policy 1, policy_version 917332 (0.0009) [2023-12-28 01:49:49,574][106225] Updated weights for policy 1, policy_version 917342 (0.0008) [2023-12-28 01:49:49,876][106226] Updated weights for policy 0, policy_version 914923 (0.0009) [2023-12-28 01:49:49,931][106226] Updated weights for policy 0, policy_version 914933 (0.0008) [2023-12-28 01:49:49,997][106226] Updated weights for policy 0, policy_version 914943 (0.0009) [2023-12-28 01:49:50,327][106225] Updated weights for policy 1, policy_version 917352 (0.0009) [2023-12-28 01:49:50,389][106225] Updated weights for policy 1, policy_version 917362 (0.0008) [2023-12-28 01:49:50,454][106225] Updated weights for policy 1, policy_version 917372 (0.0009) [2023-12-28 01:49:50,778][106226] Updated weights for policy 0, policy_version 914953 (0.0010) [2023-12-28 01:49:50,846][106226] Updated weights for policy 0, policy_version 914963 (0.0007) [2023-12-28 01:49:50,909][106226] Updated weights for policy 0, policy_version 914973 (0.0006) [2023-12-28 01:49:50,975][106226] Updated weights for policy 0, policy_version 914983 (0.0006) [2023-12-28 01:49:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 469180416. Throughput: 0: 9774.0, 1: 10293.3. Samples: 469191352. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:49:51,175][106225] Updated weights for policy 1, policy_version 917382 (0.0008) [2023-12-28 01:49:51,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.943')] [2023-12-28 01:49:51,246][106225] Updated weights for policy 1, policy_version 917392 (0.0008) [2023-12-28 01:49:51,311][106225] Updated weights for policy 1, policy_version 917402 (0.0009) [2023-12-28 01:49:51,659][106226] Updated weights for policy 0, policy_version 914993 (0.0008) [2023-12-28 01:49:51,729][106226] Updated weights for policy 0, policy_version 915003 (0.0008) [2023-12-28 01:49:51,796][106226] Updated weights for policy 0, policy_version 915013 (0.0008) [2023-12-28 01:49:52,050][106225] Updated weights for policy 1, policy_version 917412 (0.0007) [2023-12-28 01:49:52,112][106225] Updated weights for policy 1, policy_version 917422 (0.0005) [2023-12-28 01:49:52,184][106225] Updated weights for policy 1, policy_version 917432 (0.0006) [2023-12-28 01:49:52,505][106226] Updated weights for policy 0, policy_version 915023 (0.0010) [2023-12-28 01:49:52,563][106226] Updated weights for policy 0, policy_version 915033 (0.0011) [2023-12-28 01:49:52,617][106226] Updated weights for policy 0, policy_version 915043 (0.0011) [2023-12-28 01:49:52,874][106225] Updated weights for policy 1, policy_version 917442 (0.0010) [2023-12-28 01:49:52,935][106225] Updated weights for policy 1, policy_version 917452 (0.0008) [2023-12-28 01:49:52,996][106225] Updated weights for policy 1, policy_version 917462 (0.0007) [2023-12-28 01:49:53,056][106225] Updated weights for policy 1, policy_version 917472 (0.0007) [2023-12-28 01:49:53,325][106226] Updated weights for policy 0, policy_version 915053 (0.0010) [2023-12-28 01:49:53,377][106226] Updated weights for policy 0, policy_version 915063 (0.0010) [2023-12-28 01:49:53,433][106226] Updated weights for policy 0, policy_version 915073 (0.0010) [2023-12-28 01:49:53,677][106225] Updated weights for policy 1, policy_version 917482 (0.0008) [2023-12-28 01:49:53,723][106225] Updated weights for policy 1, policy_version 917492 (0.0008) [2023-12-28 01:49:53,778][106225] Updated weights for policy 1, policy_version 917502 (0.0007) [2023-12-28 01:49:54,106][106226] Updated weights for policy 0, policy_version 915083 (0.0009) [2023-12-28 01:49:54,163][106226] Updated weights for policy 0, policy_version 915093 (0.0005) [2023-12-28 01:49:54,227][106226] Updated weights for policy 0, policy_version 915103 (0.0005) [2023-12-28 01:49:54,372][106225] Updated weights for policy 1, policy_version 917512 (0.0007) [2023-12-28 01:49:54,426][106225] Updated weights for policy 1, policy_version 917522 (0.0009) [2023-12-28 01:49:54,488][106225] Updated weights for policy 1, policy_version 917532 (0.0007) [2023-12-28 01:49:54,751][106226] Updated weights for policy 0, policy_version 915113 (0.0005) [2023-12-28 01:49:54,809][106226] Updated weights for policy 0, policy_version 915123 (0.0009) [2023-12-28 01:49:54,863][106226] Updated weights for policy 0, policy_version 915133 (0.0008) [2023-12-28 01:49:54,913][106226] Updated weights for policy 0, policy_version 915143 (0.0009) [2023-12-28 01:49:55,081][106225] Updated weights for policy 1, policy_version 917542 (0.0009) [2023-12-28 01:49:55,147][106225] Updated weights for policy 1, policy_version 917552 (0.0009) [2023-12-28 01:49:55,205][106225] Updated weights for policy 1, policy_version 917562 (0.0008) [2023-12-28 01:49:55,660][106226] Updated weights for policy 0, policy_version 915153 (0.0008) [2023-12-28 01:49:55,719][106226] Updated weights for policy 0, policy_version 915163 (0.0009) [2023-12-28 01:49:55,779][106226] Updated weights for policy 0, policy_version 915173 (0.0008) [2023-12-28 01:49:55,916][106225] Updated weights for policy 1, policy_version 917572 (0.0008) [2023-12-28 01:49:55,968][106225] Updated weights for policy 1, policy_version 917582 (0.0008) [2023-12-28 01:49:56,030][106225] Updated weights for policy 1, policy_version 917592 (0.0009) [2023-12-28 01:49:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 469286912. Throughput: 0: 9762.2, 1: 10229.1. Samples: 469250288. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:49:56,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.955')] [2023-12-28 01:49:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000915176_234340352.pth... [2023-12-28 01:49:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000917600_234946560.pth... [2023-12-28 01:49:56,182][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000914024_234045440.pth [2023-12-28 01:49:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000916384_234635264.pth [2023-12-28 01:49:56,503][106226] Updated weights for policy 0, policy_version 915183 (0.0009) [2023-12-28 01:49:56,554][106226] Updated weights for policy 0, policy_version 915193 (0.0009) [2023-12-28 01:49:56,604][106226] Updated weights for policy 0, policy_version 915203 (0.0009) [2023-12-28 01:49:56,674][106225] Updated weights for policy 1, policy_version 917602 (0.0008) [2023-12-28 01:49:56,735][106225] Updated weights for policy 1, policy_version 917612 (0.0008) [2023-12-28 01:49:56,779][106225] Updated weights for policy 1, policy_version 917622 (0.0008) [2023-12-28 01:49:56,830][106225] Updated weights for policy 1, policy_version 917632 (0.0008) [2023-12-28 01:49:57,347][106226] Updated weights for policy 0, policy_version 915213 (0.0009) [2023-12-28 01:49:57,397][106226] Updated weights for policy 0, policy_version 915223 (0.0008) [2023-12-28 01:49:57,448][106226] Updated weights for policy 0, policy_version 915233 (0.0008) [2023-12-28 01:49:57,548][106225] Updated weights for policy 1, policy_version 917642 (0.0008) [2023-12-28 01:49:57,601][106225] Updated weights for policy 1, policy_version 917652 (0.0009) [2023-12-28 01:49:57,646][106225] Updated weights for policy 1, policy_version 917662 (0.0008) [2023-12-28 01:49:58,122][106226] Updated weights for policy 0, policy_version 915243 (0.0008) [2023-12-28 01:49:58,172][106226] Updated weights for policy 0, policy_version 915253 (0.0009) [2023-12-28 01:49:58,240][106226] Updated weights for policy 0, policy_version 915263 (0.0008) [2023-12-28 01:49:58,414][106225] Updated weights for policy 1, policy_version 917672 (0.0008) [2023-12-28 01:49:58,477][106225] Updated weights for policy 1, policy_version 917682 (0.0008) [2023-12-28 01:49:58,536][106225] Updated weights for policy 1, policy_version 917692 (0.0008) [2023-12-28 01:49:59,097][106226] Updated weights for policy 0, policy_version 915273 (0.0008) [2023-12-28 01:49:59,154][106226] Updated weights for policy 0, policy_version 915283 (0.0007) [2023-12-28 01:49:59,215][106226] Updated weights for policy 0, policy_version 915293 (0.0007) [2023-12-28 01:49:59,289][106226] Updated weights for policy 0, policy_version 915303 (0.0008) [2023-12-28 01:49:59,349][106225] Updated weights for policy 1, policy_version 917702 (0.0009) [2023-12-28 01:49:59,408][106225] Updated weights for policy 1, policy_version 917712 (0.0010) [2023-12-28 01:49:59,462][106225] Updated weights for policy 1, policy_version 917722 (0.0010) [2023-12-28 01:49:59,951][106226] Updated weights for policy 0, policy_version 915313 (0.0008) [2023-12-28 01:50:00,012][106226] Updated weights for policy 0, policy_version 915323 (0.0008) [2023-12-28 01:50:00,078][106226] Updated weights for policy 0, policy_version 915333 (0.0008) [2023-12-28 01:50:00,216][106225] Updated weights for policy 1, policy_version 917732 (0.0009) [2023-12-28 01:50:00,288][106225] Updated weights for policy 1, policy_version 917742 (0.0007) [2023-12-28 01:50:00,352][106225] Updated weights for policy 1, policy_version 917752 (0.0008) [2023-12-28 01:50:00,732][106226] Updated weights for policy 0, policy_version 915343 (0.0008) [2023-12-28 01:50:00,792][106226] Updated weights for policy 0, policy_version 915353 (0.0007) [2023-12-28 01:50:00,851][106226] Updated weights for policy 0, policy_version 915363 (0.0007) [2023-12-28 01:50:01,001][106225] Updated weights for policy 1, policy_version 917762 (0.0008) [2023-12-28 01:50:01,070][106225] Updated weights for policy 1, policy_version 917772 (0.0007) [2023-12-28 01:50:01,134][106225] Updated weights for policy 1, policy_version 917782 (0.0009) [2023-12-28 01:50:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 469377024. Throughput: 0: 9790.6, 1: 10238.0. Samples: 469369772. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:01,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-5.040')] [2023-12-28 01:50:01,210][106225] Updated weights for policy 1, policy_version 917792 (0.0008) [2023-12-28 01:50:01,666][106226] Updated weights for policy 0, policy_version 915373 (0.0008) [2023-12-28 01:50:01,738][106226] Updated weights for policy 0, policy_version 915383 (0.0008) [2023-12-28 01:50:01,802][106226] Updated weights for policy 0, policy_version 915393 (0.0007) [2023-12-28 01:50:01,851][106225] Updated weights for policy 1, policy_version 917802 (0.0006) [2023-12-28 01:50:01,915][106225] Updated weights for policy 1, policy_version 917812 (0.0007) [2023-12-28 01:50:01,977][106225] Updated weights for policy 1, policy_version 917822 (0.0008) [2023-12-28 01:50:02,474][106226] Updated weights for policy 0, policy_version 915403 (0.0008) [2023-12-28 01:50:02,532][106226] Updated weights for policy 0, policy_version 915413 (0.0008) [2023-12-28 01:50:02,597][106226] Updated weights for policy 0, policy_version 915423 (0.0008) [2023-12-28 01:50:02,710][106225] Updated weights for policy 1, policy_version 917832 (0.0009) [2023-12-28 01:50:02,771][106225] Updated weights for policy 1, policy_version 917842 (0.0011) [2023-12-28 01:50:02,832][106225] Updated weights for policy 1, policy_version 917852 (0.0010) [2023-12-28 01:50:03,379][106226] Updated weights for policy 0, policy_version 915433 (0.0008) [2023-12-28 01:50:03,425][106225] Updated weights for policy 1, policy_version 917862 (0.0008) [2023-12-28 01:50:03,439][106226] Updated weights for policy 0, policy_version 915443 (0.0008) [2023-12-28 01:50:03,476][106225] Updated weights for policy 1, policy_version 917872 (0.0007) [2023-12-28 01:50:03,483][106226] Updated weights for policy 0, policy_version 915453 (0.0006) [2023-12-28 01:50:03,531][106226] Updated weights for policy 0, policy_version 915463 (0.0007) [2023-12-28 01:50:03,533][106225] Updated weights for policy 1, policy_version 917882 (0.0008) [2023-12-28 01:50:04,174][106225] Updated weights for policy 1, policy_version 917892 (0.0007) [2023-12-28 01:50:04,235][106225] Updated weights for policy 1, policy_version 917902 (0.0006) [2023-12-28 01:50:04,299][106225] Updated weights for policy 1, policy_version 917912 (0.0008) [2023-12-28 01:50:04,323][106226] Updated weights for policy 0, policy_version 915473 (0.0008) [2023-12-28 01:50:04,384][106226] Updated weights for policy 0, policy_version 915483 (0.0007) [2023-12-28 01:50:04,442][106226] Updated weights for policy 0, policy_version 915493 (0.0009) [2023-12-28 01:50:04,960][106225] Updated weights for policy 1, policy_version 917922 (0.0007) [2023-12-28 01:50:05,018][106225] Updated weights for policy 1, policy_version 917932 (0.0007) [2023-12-28 01:50:05,076][106225] Updated weights for policy 1, policy_version 917942 (0.0008) [2023-12-28 01:50:05,137][106225] Updated weights for policy 1, policy_version 917952 (0.0008) [2023-12-28 01:50:05,164][106226] Updated weights for policy 0, policy_version 915503 (0.0006) [2023-12-28 01:50:05,213][106226] Updated weights for policy 0, policy_version 915513 (0.0008) [2023-12-28 01:50:05,274][106226] Updated weights for policy 0, policy_version 915523 (0.0008) [2023-12-28 01:50:05,831][106225] Updated weights for policy 1, policy_version 917962 (0.0008) [2023-12-28 01:50:05,889][106225] Updated weights for policy 1, policy_version 917972 (0.0008) [2023-12-28 01:50:05,939][106225] Updated weights for policy 1, policy_version 917982 (0.0008) [2023-12-28 01:50:05,978][106226] Updated weights for policy 0, policy_version 915533 (0.0007) [2023-12-28 01:50:06,040][106226] Updated weights for policy 0, policy_version 915543 (0.0008) [2023-12-28 01:50:06,106][106226] Updated weights for policy 0, policy_version 915553 (0.0009) [2023-12-28 01:50:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 469483520. Throughput: 0: 9754.2, 1: 10307.3. Samples: 469487708. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:06,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.050')] [2023-12-28 01:50:06,696][106225] Updated weights for policy 1, policy_version 917992 (0.0008) [2023-12-28 01:50:06,754][106225] Updated weights for policy 1, policy_version 918002 (0.0008) [2023-12-28 01:50:06,811][106225] Updated weights for policy 1, policy_version 918012 (0.0009) [2023-12-28 01:50:06,833][106226] Updated weights for policy 0, policy_version 915563 (0.0008) [2023-12-28 01:50:06,891][106226] Updated weights for policy 0, policy_version 915573 (0.0008) [2023-12-28 01:50:06,952][106226] Updated weights for policy 0, policy_version 915583 (0.0011) [2023-12-28 01:50:07,583][106225] Updated weights for policy 1, policy_version 918022 (0.0007) [2023-12-28 01:50:07,604][106226] Updated weights for policy 0, policy_version 915593 (0.0011) [2023-12-28 01:50:07,634][106225] Updated weights for policy 1, policy_version 918032 (0.0007) [2023-12-28 01:50:07,652][106226] Updated weights for policy 0, policy_version 915603 (0.0010) [2023-12-28 01:50:07,697][106225] Updated weights for policy 1, policy_version 918042 (0.0006) [2023-12-28 01:50:07,707][106226] Updated weights for policy 0, policy_version 915613 (0.0010) [2023-12-28 01:50:07,758][106226] Updated weights for policy 0, policy_version 915623 (0.0008) [2023-12-28 01:50:08,397][106226] Updated weights for policy 0, policy_version 915633 (0.0008) [2023-12-28 01:50:08,445][106225] Updated weights for policy 1, policy_version 918052 (0.0007) [2023-12-28 01:50:08,461][106226] Updated weights for policy 0, policy_version 915643 (0.0007) [2023-12-28 01:50:08,513][106225] Updated weights for policy 1, policy_version 918062 (0.0006) [2023-12-28 01:50:08,523][106226] Updated weights for policy 0, policy_version 915653 (0.0007) [2023-12-28 01:50:08,578][106225] Updated weights for policy 1, policy_version 918072 (0.0008) [2023-12-28 01:50:09,259][106226] Updated weights for policy 0, policy_version 915663 (0.0008) [2023-12-28 01:50:09,280][106225] Updated weights for policy 1, policy_version 918082 (0.0008) [2023-12-28 01:50:09,326][106226] Updated weights for policy 0, policy_version 915673 (0.0007) [2023-12-28 01:50:09,349][106225] Updated weights for policy 1, policy_version 918092 (0.0009) [2023-12-28 01:50:09,393][106226] Updated weights for policy 0, policy_version 915683 (0.0008) [2023-12-28 01:50:09,417][106225] Updated weights for policy 1, policy_version 918102 (0.0008) [2023-12-28 01:50:09,480][106225] Updated weights for policy 1, policy_version 918112 (0.0008) [2023-12-28 01:50:10,167][106226] Updated weights for policy 0, policy_version 915693 (0.0008) [2023-12-28 01:50:10,192][106225] Updated weights for policy 1, policy_version 918122 (0.0007) [2023-12-28 01:50:10,235][106226] Updated weights for policy 0, policy_version 915703 (0.0007) [2023-12-28 01:50:10,247][106225] Updated weights for policy 1, policy_version 918132 (0.0008) [2023-12-28 01:50:10,305][106226] Updated weights for policy 0, policy_version 915713 (0.0007) [2023-12-28 01:50:10,308][106225] Updated weights for policy 1, policy_version 918142 (0.0007) [2023-12-28 01:50:10,954][106225] Updated weights for policy 1, policy_version 918152 (0.0007) [2023-12-28 01:50:11,010][106225] Updated weights for policy 1, policy_version 918162 (0.0008) [2023-12-28 01:50:11,020][106226] Updated weights for policy 0, policy_version 915723 (0.0008) [2023-12-28 01:50:11,073][106225] Updated weights for policy 1, policy_version 918172 (0.0007) [2023-12-28 01:50:11,086][106226] Updated weights for policy 0, policy_version 915733 (0.0007) [2023-12-28 01:50:11,158][106226] Updated weights for policy 0, policy_version 915743 (0.0009) [2023-12-28 01:50:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 469573632. Throughput: 0: 9770.7, 1: 10249.5. Samples: 469545704. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:11,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-5.077')] [2023-12-28 01:50:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000918176_235094016.pth... [2023-12-28 01:50:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000916992_234790912.pth [2023-12-28 01:50:11,218][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000915752_234487808.pth... [2023-12-28 01:50:11,223][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000914600_234192896.pth [2023-12-28 01:50:11,826][106225] Updated weights for policy 1, policy_version 918182 (0.0006) [2023-12-28 01:50:11,898][106225] Updated weights for policy 1, policy_version 918192 (0.0007) [2023-12-28 01:50:11,947][106226] Updated weights for policy 0, policy_version 915753 (0.0009) [2023-12-28 01:50:11,964][106225] Updated weights for policy 1, policy_version 918202 (0.0008) [2023-12-28 01:50:12,004][106226] Updated weights for policy 0, policy_version 915763 (0.0006) [2023-12-28 01:50:12,066][106226] Updated weights for policy 0, policy_version 915773 (0.0007) [2023-12-28 01:50:12,127][106226] Updated weights for policy 0, policy_version 915783 (0.0008) [2023-12-28 01:50:12,718][106225] Updated weights for policy 1, policy_version 918212 (0.0009) [2023-12-28 01:50:12,779][106225] Updated weights for policy 1, policy_version 918222 (0.0007) [2023-12-28 01:50:12,785][106226] Updated weights for policy 0, policy_version 915793 (0.0006) [2023-12-28 01:50:12,836][106225] Updated weights for policy 1, policy_version 918232 (0.0007) [2023-12-28 01:50:12,845][106226] Updated weights for policy 0, policy_version 915803 (0.0007) [2023-12-28 01:50:12,895][106226] Updated weights for policy 0, policy_version 915813 (0.0006) [2023-12-28 01:50:13,492][106225] Updated weights for policy 1, policy_version 918242 (0.0008) [2023-12-28 01:50:13,541][106225] Updated weights for policy 1, policy_version 918252 (0.0007) [2023-12-28 01:50:13,601][106225] Updated weights for policy 1, policy_version 918262 (0.0010) [2023-12-28 01:50:13,664][106225] Updated weights for policy 1, policy_version 918272 (0.0010) [2023-12-28 01:50:13,683][106226] Updated weights for policy 0, policy_version 915823 (0.0010) [2023-12-28 01:50:13,730][106226] Updated weights for policy 0, policy_version 915833 (0.0010) [2023-12-28 01:50:13,779][106226] Updated weights for policy 0, policy_version 915843 (0.0010) [2023-12-28 01:50:14,399][106225] Updated weights for policy 1, policy_version 918282 (0.0005) [2023-12-28 01:50:14,465][106225] Updated weights for policy 1, policy_version 918292 (0.0005) [2023-12-28 01:50:14,474][106226] Updated weights for policy 0, policy_version 915853 (0.0010) [2023-12-28 01:50:14,514][106225] Updated weights for policy 1, policy_version 918302 (0.0006) [2023-12-28 01:50:14,528][106226] Updated weights for policy 0, policy_version 915863 (0.0008) [2023-12-28 01:50:14,577][106226] Updated weights for policy 0, policy_version 915873 (0.0008) [2023-12-28 01:50:15,223][106226] Updated weights for policy 0, policy_version 915883 (0.0008) [2023-12-28 01:50:15,233][106225] Updated weights for policy 1, policy_version 918312 (0.0008) [2023-12-28 01:50:15,280][106226] Updated weights for policy 0, policy_version 915893 (0.0008) [2023-12-28 01:50:15,292][106225] Updated weights for policy 1, policy_version 918322 (0.0009) [2023-12-28 01:50:15,343][106226] Updated weights for policy 0, policy_version 915903 (0.0006) [2023-12-28 01:50:15,352][106225] Updated weights for policy 1, policy_version 918332 (0.0008) [2023-12-28 01:50:15,927][106225] Updated weights for policy 1, policy_version 918342 (0.0008) [2023-12-28 01:50:15,993][106225] Updated weights for policy 1, policy_version 918352 (0.0010) [2023-12-28 01:50:16,046][106225] Updated weights for policy 1, policy_version 918362 (0.0010) [2023-12-28 01:50:16,138][106226] Updated weights for policy 0, policy_version 915913 (0.0009) [2023-12-28 01:50:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 469671936. Throughput: 0: 9675.3, 1: 10081.2. Samples: 469661728. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:16,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.881')] [2023-12-28 01:50:16,193][106226] Updated weights for policy 0, policy_version 915923 (0.0011) [2023-12-28 01:50:16,247][106226] Updated weights for policy 0, policy_version 915933 (0.0010) [2023-12-28 01:50:16,300][106226] Updated weights for policy 0, policy_version 915943 (0.0010) [2023-12-28 01:50:16,632][106225] Updated weights for policy 1, policy_version 918372 (0.0010) [2023-12-28 01:50:16,681][106225] Updated weights for policy 1, policy_version 918382 (0.0010) [2023-12-28 01:50:16,732][106225] Updated weights for policy 1, policy_version 918392 (0.0010) [2023-12-28 01:50:16,932][106226] Updated weights for policy 0, policy_version 915953 (0.0008) [2023-12-28 01:50:16,986][106226] Updated weights for policy 0, policy_version 915963 (0.0007) [2023-12-28 01:50:17,044][106226] Updated weights for policy 0, policy_version 915973 (0.0008) [2023-12-28 01:50:17,460][106225] Updated weights for policy 1, policy_version 918402 (0.0010) [2023-12-28 01:50:17,506][106225] Updated weights for policy 1, policy_version 918412 (0.0010) [2023-12-28 01:50:17,552][106225] Updated weights for policy 1, policy_version 918422 (0.0010) [2023-12-28 01:50:17,618][106225] Updated weights for policy 1, policy_version 918432 (0.0010) [2023-12-28 01:50:17,781][106226] Updated weights for policy 0, policy_version 915983 (0.0008) [2023-12-28 01:50:17,832][106226] Updated weights for policy 0, policy_version 915993 (0.0008) [2023-12-28 01:50:17,889][106226] Updated weights for policy 0, policy_version 916003 (0.0008) [2023-12-28 01:50:18,361][106225] Updated weights for policy 1, policy_version 918442 (0.0010) [2023-12-28 01:50:18,420][106225] Updated weights for policy 1, policy_version 918452 (0.0008) [2023-12-28 01:50:18,480][106225] Updated weights for policy 1, policy_version 918462 (0.0009) [2023-12-28 01:50:18,636][106226] Updated weights for policy 0, policy_version 916013 (0.0008) [2023-12-28 01:50:18,705][106226] Updated weights for policy 0, policy_version 916023 (0.0009) [2023-12-28 01:50:18,762][106226] Updated weights for policy 0, policy_version 916033 (0.0008) [2023-12-28 01:50:19,176][106225] Updated weights for policy 1, policy_version 918472 (0.0008) [2023-12-28 01:50:19,246][106225] Updated weights for policy 1, policy_version 918482 (0.0008) [2023-12-28 01:50:19,312][106225] Updated weights for policy 1, policy_version 918492 (0.0009) [2023-12-28 01:50:19,440][106226] Updated weights for policy 0, policy_version 916043 (0.0009) [2023-12-28 01:50:19,495][106226] Updated weights for policy 0, policy_version 916053 (0.0009) [2023-12-28 01:50:19,552][106226] Updated weights for policy 0, policy_version 916063 (0.0009) [2023-12-28 01:50:20,030][106225] Updated weights for policy 1, policy_version 918502 (0.0008) [2023-12-28 01:50:20,092][106225] Updated weights for policy 1, policy_version 918512 (0.0008) [2023-12-28 01:50:20,148][106225] Updated weights for policy 1, policy_version 918522 (0.0008) [2023-12-28 01:50:20,363][106226] Updated weights for policy 0, policy_version 916073 (0.0008) [2023-12-28 01:50:20,429][106226] Updated weights for policy 0, policy_version 916083 (0.0008) [2023-12-28 01:50:20,481][106226] Updated weights for policy 0, policy_version 916093 (0.0009) [2023-12-28 01:50:20,545][106226] Updated weights for policy 0, policy_version 916103 (0.0009) [2023-12-28 01:50:20,853][106225] Updated weights for policy 1, policy_version 918532 (0.0007) [2023-12-28 01:50:20,925][106225] Updated weights for policy 1, policy_version 918542 (0.0006) [2023-12-28 01:50:20,994][106225] Updated weights for policy 1, policy_version 918552 (0.0007) [2023-12-28 01:50:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 469770240. Throughput: 0: 9583.3, 1: 10039.2. Samples: 469778972. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:21,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.326')] [2023-12-28 01:50:21,396][106226] Updated weights for policy 0, policy_version 916113 (0.0010) [2023-12-28 01:50:21,455][106226] Updated weights for policy 0, policy_version 916123 (0.0009) [2023-12-28 01:50:21,509][106226] Updated weights for policy 0, policy_version 916133 (0.0011) [2023-12-28 01:50:21,732][106225] Updated weights for policy 1, policy_version 918562 (0.0010) [2023-12-28 01:50:21,800][106225] Updated weights for policy 1, policy_version 918572 (0.0009) [2023-12-28 01:50:21,864][106225] Updated weights for policy 1, policy_version 918582 (0.0010) [2023-12-28 01:50:21,926][106225] Updated weights for policy 1, policy_version 918592 (0.0010) [2023-12-28 01:50:22,280][106226] Updated weights for policy 0, policy_version 916143 (0.0011) [2023-12-28 01:50:22,340][106226] Updated weights for policy 0, policy_version 916153 (0.0008) [2023-12-28 01:50:22,403][106226] Updated weights for policy 0, policy_version 916163 (0.0009) [2023-12-28 01:50:22,679][106225] Updated weights for policy 1, policy_version 918602 (0.0009) [2023-12-28 01:50:22,732][106225] Updated weights for policy 1, policy_version 918612 (0.0009) [2023-12-28 01:50:22,792][106225] Updated weights for policy 1, policy_version 918622 (0.0011) [2023-12-28 01:50:23,215][106226] Updated weights for policy 0, policy_version 916173 (0.0008) [2023-12-28 01:50:23,266][106226] Updated weights for policy 0, policy_version 916183 (0.0008) [2023-12-28 01:50:23,312][106226] Updated weights for policy 0, policy_version 916193 (0.0008) [2023-12-28 01:50:23,517][106225] Updated weights for policy 1, policy_version 918632 (0.0009) [2023-12-28 01:50:23,574][106225] Updated weights for policy 1, policy_version 918642 (0.0007) [2023-12-28 01:50:23,628][106225] Updated weights for policy 1, policy_version 918652 (0.0005) [2023-12-28 01:50:24,073][106226] Updated weights for policy 0, policy_version 916203 (0.0008) [2023-12-28 01:50:24,125][106226] Updated weights for policy 0, policy_version 916213 (0.0008) [2023-12-28 01:50:24,175][106226] Updated weights for policy 0, policy_version 916223 (0.0008) [2023-12-28 01:50:24,259][106225] Updated weights for policy 1, policy_version 918662 (0.0006) [2023-12-28 01:50:24,312][106225] Updated weights for policy 1, policy_version 918672 (0.0005) [2023-12-28 01:50:24,356][106225] Updated weights for policy 1, policy_version 918682 (0.0005) [2023-12-28 01:50:24,958][106226] Updated weights for policy 0, policy_version 916233 (0.0009) [2023-12-28 01:50:25,011][106225] Updated weights for policy 1, policy_version 918692 (0.0005) [2023-12-28 01:50:25,017][106226] Updated weights for policy 0, policy_version 916243 (0.0008) [2023-12-28 01:50:25,061][106225] Updated weights for policy 1, policy_version 918702 (0.0006) [2023-12-28 01:50:25,061][106226] Updated weights for policy 0, policy_version 916253 (0.0008) [2023-12-28 01:50:25,112][106226] Updated weights for policy 0, policy_version 916263 (0.0008) [2023-12-28 01:50:25,125][106225] Updated weights for policy 1, policy_version 918712 (0.0005) [2023-12-28 01:50:25,623][106225] Updated weights for policy 1, policy_version 918722 (0.0005) [2023-12-28 01:50:25,676][106225] Updated weights for policy 1, policy_version 918732 (0.0005) [2023-12-28 01:50:25,724][106225] Updated weights for policy 1, policy_version 918742 (0.0005) [2023-12-28 01:50:25,775][106225] Updated weights for policy 1, policy_version 918752 (0.0005) [2023-12-28 01:50:25,935][106226] Updated weights for policy 0, policy_version 916273 (0.0006) [2023-12-28 01:50:25,986][106226] Updated weights for policy 0, policy_version 916283 (0.0005) [2023-12-28 01:50:26,039][106226] Updated weights for policy 0, policy_version 916293 (0.0005) [2023-12-28 01:50:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 469868544. Throughput: 0: 9578.9, 1: 9926.8. Samples: 469834416. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:26,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.097')] [2023-12-28 01:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000916296_234627072.pth... [2023-12-28 01:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000918752_235241472.pth... [2023-12-28 01:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000915176_234340352.pth [2023-12-28 01:50:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000917600_234946560.pth [2023-12-28 01:50:26,470][106225] Updated weights for policy 1, policy_version 918762 (0.0009) [2023-12-28 01:50:26,533][106225] Updated weights for policy 1, policy_version 918772 (0.0007) [2023-12-28 01:50:26,583][106225] Updated weights for policy 1, policy_version 918782 (0.0005) [2023-12-28 01:50:26,627][106226] Updated weights for policy 0, policy_version 916303 (0.0007) [2023-12-28 01:50:26,688][106226] Updated weights for policy 0, policy_version 916313 (0.0008) [2023-12-28 01:50:26,746][106226] Updated weights for policy 0, policy_version 916323 (0.0009) [2023-12-28 01:50:27,143][106225] Updated weights for policy 1, policy_version 918792 (0.0008) [2023-12-28 01:50:27,195][106225] Updated weights for policy 1, policy_version 918802 (0.0008) [2023-12-28 01:50:27,248][106225] Updated weights for policy 1, policy_version 918812 (0.0008) [2023-12-28 01:50:27,373][106226] Updated weights for policy 0, policy_version 916333 (0.0007) [2023-12-28 01:50:27,420][106226] Updated weights for policy 0, policy_version 916343 (0.0006) [2023-12-28 01:50:27,480][106226] Updated weights for policy 0, policy_version 916353 (0.0010) [2023-12-28 01:50:27,852][106225] Updated weights for policy 1, policy_version 918822 (0.0007) [2023-12-28 01:50:27,910][106225] Updated weights for policy 1, policy_version 918832 (0.0005) [2023-12-28 01:50:27,967][106225] Updated weights for policy 1, policy_version 918842 (0.0005) [2023-12-28 01:50:28,138][106226] Updated weights for policy 0, policy_version 916363 (0.0010) [2023-12-28 01:50:28,194][106226] Updated weights for policy 0, policy_version 916373 (0.0010) [2023-12-28 01:50:28,247][106226] Updated weights for policy 0, policy_version 916383 (0.0010) [2023-12-28 01:50:28,529][106225] Updated weights for policy 1, policy_version 918852 (0.0006) [2023-12-28 01:50:28,590][106225] Updated weights for policy 1, policy_version 918862 (0.0005) [2023-12-28 01:50:28,655][106225] Updated weights for policy 1, policy_version 918872 (0.0006) [2023-12-28 01:50:28,909][106226] Updated weights for policy 0, policy_version 916393 (0.0010) [2023-12-28 01:50:28,971][106226] Updated weights for policy 0, policy_version 916403 (0.0010) [2023-12-28 01:50:29,040][106226] Updated weights for policy 0, policy_version 916413 (0.0006) [2023-12-28 01:50:29,104][106226] Updated weights for policy 0, policy_version 916423 (0.0010) [2023-12-28 01:50:29,232][106225] Updated weights for policy 1, policy_version 918882 (0.0006) [2023-12-28 01:50:29,294][106225] Updated weights for policy 1, policy_version 918892 (0.0008) [2023-12-28 01:50:29,358][106225] Updated weights for policy 1, policy_version 918902 (0.0008) [2023-12-28 01:50:29,417][106225] Updated weights for policy 1, policy_version 918912 (0.0008) [2023-12-28 01:50:29,824][106226] Updated weights for policy 0, policy_version 916433 (0.0008) [2023-12-28 01:50:29,891][106226] Updated weights for policy 0, policy_version 916443 (0.0009) [2023-12-28 01:50:29,954][106226] Updated weights for policy 0, policy_version 916453 (0.0009) [2023-12-28 01:50:30,070][106225] Updated weights for policy 1, policy_version 918922 (0.0009) [2023-12-28 01:50:30,132][106225] Updated weights for policy 1, policy_version 918932 (0.0009) [2023-12-28 01:50:30,183][106225] Updated weights for policy 1, policy_version 918942 (0.0008) [2023-12-28 01:50:30,568][106226] Updated weights for policy 0, policy_version 916463 (0.0007) [2023-12-28 01:50:30,618][106226] Updated weights for policy 0, policy_version 916473 (0.0005) [2023-12-28 01:50:30,675][106226] Updated weights for policy 0, policy_version 916483 (0.0008) [2023-12-28 01:50:30,922][106225] Updated weights for policy 1, policy_version 918952 (0.0006) [2023-12-28 01:50:30,982][106225] Updated weights for policy 1, policy_version 918962 (0.0005) [2023-12-28 01:50:31,040][106225] Updated weights for policy 1, policy_version 918972 (0.0007) [2023-12-28 01:50:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 469975040. Throughput: 0: 9612.3, 1: 10091.7. Samples: 469961648. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:31,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.946')] [2023-12-28 01:50:31,404][106226] Updated weights for policy 0, policy_version 916493 (0.0010) [2023-12-28 01:50:31,470][106226] Updated weights for policy 0, policy_version 916503 (0.0006) [2023-12-28 01:50:31,526][106226] Updated weights for policy 0, policy_version 916513 (0.0006) [2023-12-28 01:50:31,736][106225] Updated weights for policy 1, policy_version 918982 (0.0008) [2023-12-28 01:50:31,797][106225] Updated weights for policy 1, policy_version 918992 (0.0009) [2023-12-28 01:50:31,861][106225] Updated weights for policy 1, policy_version 919002 (0.0009) [2023-12-28 01:50:32,199][106226] Updated weights for policy 0, policy_version 916523 (0.0006) [2023-12-28 01:50:32,258][106226] Updated weights for policy 0, policy_version 916533 (0.0008) [2023-12-28 01:50:32,324][106226] Updated weights for policy 0, policy_version 916543 (0.0008) [2023-12-28 01:50:32,645][106225] Updated weights for policy 1, policy_version 919012 (0.0009) [2023-12-28 01:50:32,705][106225] Updated weights for policy 1, policy_version 919022 (0.0009) [2023-12-28 01:50:32,755][106225] Updated weights for policy 1, policy_version 919032 (0.0008) [2023-12-28 01:50:33,029][106226] Updated weights for policy 0, policy_version 916553 (0.0009) [2023-12-28 01:50:33,088][106226] Updated weights for policy 0, policy_version 916563 (0.0005) [2023-12-28 01:50:33,143][106226] Updated weights for policy 0, policy_version 916573 (0.0006) [2023-12-28 01:50:33,188][106226] Updated weights for policy 0, policy_version 916583 (0.0007) [2023-12-28 01:50:33,508][106225] Updated weights for policy 1, policy_version 919042 (0.0008) [2023-12-28 01:50:33,572][106225] Updated weights for policy 1, policy_version 919052 (0.0009) [2023-12-28 01:50:33,637][106225] Updated weights for policy 1, policy_version 919062 (0.0008) [2023-12-28 01:50:33,691][106225] Updated weights for policy 1, policy_version 919072 (0.0009) [2023-12-28 01:50:33,796][106226] Updated weights for policy 0, policy_version 916593 (0.0007) [2023-12-28 01:50:33,848][106226] Updated weights for policy 0, policy_version 916603 (0.0008) [2023-12-28 01:50:33,891][106226] Updated weights for policy 0, policy_version 916613 (0.0008) [2023-12-28 01:50:34,429][106225] Updated weights for policy 1, policy_version 919082 (0.0007) [2023-12-28 01:50:34,497][106225] Updated weights for policy 1, policy_version 919092 (0.0008) [2023-12-28 01:50:34,564][106225] Updated weights for policy 1, policy_version 919102 (0.0008) [2023-12-28 01:50:34,637][106226] Updated weights for policy 0, policy_version 916623 (0.0008) [2023-12-28 01:50:34,694][106226] Updated weights for policy 0, policy_version 916633 (0.0009) [2023-12-28 01:50:34,760][106226] Updated weights for policy 0, policy_version 916643 (0.0009) [2023-12-28 01:50:35,254][106225] Updated weights for policy 1, policy_version 919112 (0.0008) [2023-12-28 01:50:35,316][106225] Updated weights for policy 1, policy_version 919122 (0.0008) [2023-12-28 01:50:35,377][106225] Updated weights for policy 1, policy_version 919132 (0.0008) [2023-12-28 01:50:35,485][106226] Updated weights for policy 0, policy_version 916653 (0.0009) [2023-12-28 01:50:35,535][106226] Updated weights for policy 0, policy_version 916663 (0.0010) [2023-12-28 01:50:35,591][106226] Updated weights for policy 0, policy_version 916673 (0.0010) [2023-12-28 01:50:36,086][106225] Updated weights for policy 1, policy_version 919142 (0.0010) [2023-12-28 01:50:36,157][106225] Updated weights for policy 1, policy_version 919152 (0.0008) [2023-12-28 01:50:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 470065152. Throughput: 0: 9702.8, 1: 10026.8. Samples: 470079180. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:36,178][105115] Avg episode reward: [(0, '-4.515'), (1, '-5.078')] [2023-12-28 01:50:36,219][106225] Updated weights for policy 1, policy_version 919162 (0.0008) [2023-12-28 01:50:36,336][106226] Updated weights for policy 0, policy_version 916683 (0.0010) [2023-12-28 01:50:36,390][106226] Updated weights for policy 0, policy_version 916693 (0.0010) [2023-12-28 01:50:36,457][106226] Updated weights for policy 0, policy_version 916703 (0.0008) [2023-12-28 01:50:36,964][106225] Updated weights for policy 1, policy_version 919172 (0.0009) [2023-12-28 01:50:37,032][106225] Updated weights for policy 1, policy_version 919182 (0.0010) [2023-12-28 01:50:37,070][106226] Updated weights for policy 0, policy_version 916713 (0.0008) [2023-12-28 01:50:37,094][106225] Updated weights for policy 1, policy_version 919192 (0.0010) [2023-12-28 01:50:37,125][106226] Updated weights for policy 0, policy_version 916723 (0.0005) [2023-12-28 01:50:37,182][106226] Updated weights for policy 0, policy_version 916733 (0.0005) [2023-12-28 01:50:37,251][106226] Updated weights for policy 0, policy_version 916743 (0.0009) [2023-12-28 01:50:37,829][106225] Updated weights for policy 1, policy_version 919202 (0.0009) [2023-12-28 01:50:37,867][106226] Updated weights for policy 0, policy_version 916753 (0.0007) [2023-12-28 01:50:37,885][106225] Updated weights for policy 1, policy_version 919212 (0.0005) [2023-12-28 01:50:37,919][106226] Updated weights for policy 0, policy_version 916763 (0.0009) [2023-12-28 01:50:37,947][106225] Updated weights for policy 1, policy_version 919222 (0.0007) [2023-12-28 01:50:37,977][106226] Updated weights for policy 0, policy_version 916773 (0.0010) [2023-12-28 01:50:38,007][106225] Updated weights for policy 1, policy_version 919232 (0.0006) [2023-12-28 01:50:38,726][106226] Updated weights for policy 0, policy_version 916783 (0.0009) [2023-12-28 01:50:38,745][106225] Updated weights for policy 1, policy_version 919242 (0.0005) [2023-12-28 01:50:38,783][106226] Updated weights for policy 0, policy_version 916793 (0.0009) [2023-12-28 01:50:38,800][106225] Updated weights for policy 1, policy_version 919252 (0.0005) [2023-12-28 01:50:38,848][106226] Updated weights for policy 0, policy_version 916803 (0.0011) [2023-12-28 01:50:38,862][106225] Updated weights for policy 1, policy_version 919262 (0.0005) [2023-12-28 01:50:39,487][106225] Updated weights for policy 1, policy_version 919272 (0.0009) [2023-12-28 01:50:39,541][106225] Updated weights for policy 1, policy_version 919282 (0.0008) [2023-12-28 01:50:39,554][106226] Updated weights for policy 0, policy_version 916813 (0.0008) [2023-12-28 01:50:39,596][106225] Updated weights for policy 1, policy_version 919292 (0.0008) [2023-12-28 01:50:39,615][106226] Updated weights for policy 0, policy_version 916823 (0.0008) [2023-12-28 01:50:39,683][106226] Updated weights for policy 0, policy_version 916833 (0.0009) [2023-12-28 01:50:40,388][106226] Updated weights for policy 0, policy_version 916843 (0.0008) [2023-12-28 01:50:40,445][106225] Updated weights for policy 1, policy_version 919302 (0.0007) [2023-12-28 01:50:40,455][106226] Updated weights for policy 0, policy_version 916853 (0.0006) [2023-12-28 01:50:40,512][106225] Updated weights for policy 1, policy_version 919312 (0.0008) [2023-12-28 01:50:40,517][106226] Updated weights for policy 0, policy_version 916863 (0.0006) [2023-12-28 01:50:40,572][106225] Updated weights for policy 1, policy_version 919322 (0.0009) [2023-12-28 01:50:41,125][106226] Updated weights for policy 0, policy_version 916873 (0.0006) [2023-12-28 01:50:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 470163456. Throughput: 0: 9725.0, 1: 9998.8. Samples: 470137860. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:41,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-5.238')] [2023-12-28 01:50:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000919328_235388928.pth... [2023-12-28 01:50:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000918176_235094016.pth [2023-12-28 01:50:41,193][106226] Updated weights for policy 0, policy_version 916883 (0.0009) [2023-12-28 01:50:41,251][106226] Updated weights for policy 0, policy_version 916893 (0.0009) [2023-12-28 01:50:41,313][106226] Updated weights for policy 0, policy_version 916903 (0.0008) [2023-12-28 01:50:41,316][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000916904_234782720.pth... [2023-12-28 01:50:41,318][106225] Updated weights for policy 1, policy_version 919332 (0.0009) [2023-12-28 01:50:41,321][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000915752_234487808.pth [2023-12-28 01:50:41,387][106225] Updated weights for policy 1, policy_version 919342 (0.0011) [2023-12-28 01:50:41,454][106225] Updated weights for policy 1, policy_version 919352 (0.0008) [2023-12-28 01:50:42,116][106226] Updated weights for policy 0, policy_version 916913 (0.0009) [2023-12-28 01:50:42,179][106226] Updated weights for policy 0, policy_version 916923 (0.0008) [2023-12-28 01:50:42,207][106225] Updated weights for policy 1, policy_version 919362 (0.0009) [2023-12-28 01:50:42,241][106226] Updated weights for policy 0, policy_version 916933 (0.0007) [2023-12-28 01:50:42,279][106225] Updated weights for policy 1, policy_version 919372 (0.0010) [2023-12-28 01:50:42,347][106225] Updated weights for policy 1, policy_version 919382 (0.0010) [2023-12-28 01:50:42,411][106225] Updated weights for policy 1, policy_version 919392 (0.0007) [2023-12-28 01:50:43,003][106226] Updated weights for policy 0, policy_version 916943 (0.0006) [2023-12-28 01:50:43,063][106226] Updated weights for policy 0, policy_version 916953 (0.0008) [2023-12-28 01:50:43,085][106225] Updated weights for policy 1, policy_version 919402 (0.0010) [2023-12-28 01:50:43,118][106226] Updated weights for policy 0, policy_version 916963 (0.0006) [2023-12-28 01:50:43,149][106225] Updated weights for policy 1, policy_version 919412 (0.0010) [2023-12-28 01:50:43,212][106225] Updated weights for policy 1, policy_version 919422 (0.0009) [2023-12-28 01:50:43,685][106226] Updated weights for policy 0, policy_version 916973 (0.0008) [2023-12-28 01:50:43,740][106226] Updated weights for policy 0, policy_version 916983 (0.0009) [2023-12-28 01:50:43,790][106226] Updated weights for policy 0, policy_version 916993 (0.0005) [2023-12-28 01:50:43,829][106225] Updated weights for policy 1, policy_version 919432 (0.0009) [2023-12-28 01:50:43,876][106225] Updated weights for policy 1, policy_version 919442 (0.0008) [2023-12-28 01:50:43,928][106225] Updated weights for policy 1, policy_version 919452 (0.0008) [2023-12-28 01:50:44,493][106226] Updated weights for policy 0, policy_version 917003 (0.0007) [2023-12-28 01:50:44,561][106226] Updated weights for policy 0, policy_version 917013 (0.0011) [2023-12-28 01:50:44,587][106225] Updated weights for policy 1, policy_version 919462 (0.0008) [2023-12-28 01:50:44,628][106226] Updated weights for policy 0, policy_version 917023 (0.0010) [2023-12-28 01:50:44,635][106225] Updated weights for policy 1, policy_version 919472 (0.0007) [2023-12-28 01:50:44,685][106225] Updated weights for policy 1, policy_version 919482 (0.0006) [2023-12-28 01:50:45,331][106226] Updated weights for policy 0, policy_version 917033 (0.0010) [2023-12-28 01:50:45,389][106226] Updated weights for policy 0, policy_version 917043 (0.0008) [2023-12-28 01:50:45,427][106225] Updated weights for policy 1, policy_version 919492 (0.0008) [2023-12-28 01:50:45,441][106226] Updated weights for policy 0, policy_version 917053 (0.0006) [2023-12-28 01:50:45,474][106225] Updated weights for policy 1, policy_version 919502 (0.0010) [2023-12-28 01:50:45,491][106226] Updated weights for policy 0, policy_version 917063 (0.0005) [2023-12-28 01:50:45,523][106225] Updated weights for policy 1, policy_version 919512 (0.0010) [2023-12-28 01:50:46,126][106226] Updated weights for policy 0, policy_version 917073 (0.0005) [2023-12-28 01:50:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 470261760. Throughput: 0: 9737.0, 1: 9951.4. Samples: 470255748. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:46,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.169')] [2023-12-28 01:50:46,190][106226] Updated weights for policy 0, policy_version 917083 (0.0005) [2023-12-28 01:50:46,253][106226] Updated weights for policy 0, policy_version 917094 (0.0006) [2023-12-28 01:50:46,254][106225] Updated weights for policy 1, policy_version 919522 (0.0010) [2023-12-28 01:50:46,311][106225] Updated weights for policy 1, policy_version 919532 (0.0010) [2023-12-28 01:50:46,376][106225] Updated weights for policy 1, policy_version 919542 (0.0010) [2023-12-28 01:50:46,433][106225] Updated weights for policy 1, policy_version 919552 (0.0010) [2023-12-28 01:50:46,911][106226] Updated weights for policy 0, policy_version 917104 (0.0009) [2023-12-28 01:50:46,963][106226] Updated weights for policy 0, policy_version 917114 (0.0009) [2023-12-28 01:50:47,022][106226] Updated weights for policy 0, policy_version 917124 (0.0009) [2023-12-28 01:50:47,071][106225] Updated weights for policy 1, policy_version 919562 (0.0005) [2023-12-28 01:50:47,137][106225] Updated weights for policy 1, policy_version 919572 (0.0007) [2023-12-28 01:50:47,195][106225] Updated weights for policy 1, policy_version 919583 (0.0009) [2023-12-28 01:50:47,741][106225] Updated weights for policy 1, policy_version 919593 (0.0005) [2023-12-28 01:50:47,798][106225] Updated weights for policy 1, policy_version 919603 (0.0006) [2023-12-28 01:50:47,805][106226] Updated weights for policy 0, policy_version 917134 (0.0007) [2023-12-28 01:50:47,849][106225] Updated weights for policy 1, policy_version 919613 (0.0006) [2023-12-28 01:50:47,863][106226] Updated weights for policy 0, policy_version 917144 (0.0007) [2023-12-28 01:50:47,917][106226] Updated weights for policy 0, policy_version 917154 (0.0009) [2023-12-28 01:50:48,526][106225] Updated weights for policy 1, policy_version 919623 (0.0007) [2023-12-28 01:50:48,584][106225] Updated weights for policy 1, policy_version 919633 (0.0008) [2023-12-28 01:50:48,626][106226] Updated weights for policy 0, policy_version 917164 (0.0010) [2023-12-28 01:50:48,644][106225] Updated weights for policy 1, policy_version 919643 (0.0007) [2023-12-28 01:50:48,688][106226] Updated weights for policy 0, policy_version 917174 (0.0010) [2023-12-28 01:50:48,758][106226] Updated weights for policy 0, policy_version 917184 (0.0011) [2023-12-28 01:50:49,279][106225] Updated weights for policy 1, policy_version 919653 (0.0007) [2023-12-28 01:50:49,349][106225] Updated weights for policy 1, policy_version 919663 (0.0007) [2023-12-28 01:50:49,413][106225] Updated weights for policy 1, policy_version 919673 (0.0009) [2023-12-28 01:50:49,503][106226] Updated weights for policy 0, policy_version 917194 (0.0011) [2023-12-28 01:50:49,553][106226] Updated weights for policy 0, policy_version 917204 (0.0010) [2023-12-28 01:50:49,616][106226] Updated weights for policy 0, policy_version 917214 (0.0009) [2023-12-28 01:50:49,682][106226] Updated weights for policy 0, policy_version 917224 (0.0008) [2023-12-28 01:50:50,196][106225] Updated weights for policy 1, policy_version 919683 (0.0008) [2023-12-28 01:50:50,261][106225] Updated weights for policy 1, policy_version 919693 (0.0007) [2023-12-28 01:50:50,327][106225] Updated weights for policy 1, policy_version 919703 (0.0008) [2023-12-28 01:50:50,380][106226] Updated weights for policy 0, policy_version 917234 (0.0011) [2023-12-28 01:50:50,442][106226] Updated weights for policy 0, policy_version 917244 (0.0011) [2023-12-28 01:50:50,492][106226] Updated weights for policy 0, policy_version 917254 (0.0010) [2023-12-28 01:50:51,050][106225] Updated weights for policy 1, policy_version 919713 (0.0006) [2023-12-28 01:50:51,112][106225] Updated weights for policy 1, policy_version 919723 (0.0008) [2023-12-28 01:50:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 470360064. Throughput: 0: 9771.5, 1: 9947.7. Samples: 470375072. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:51,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-5.006')] [2023-12-28 01:50:51,179][106225] Updated weights for policy 1, policy_version 919733 (0.0008) [2023-12-28 01:50:51,237][106225] Updated weights for policy 1, policy_version 919743 (0.0007) [2023-12-28 01:50:51,266][106226] Updated weights for policy 0, policy_version 917264 (0.0009) [2023-12-28 01:50:51,325][106226] Updated weights for policy 0, policy_version 917274 (0.0006) [2023-12-28 01:50:51,399][106226] Updated weights for policy 0, policy_version 917284 (0.0007) [2023-12-28 01:50:52,046][106225] Updated weights for policy 1, policy_version 919753 (0.0007) [2023-12-28 01:50:52,091][106226] Updated weights for policy 0, policy_version 917294 (0.0007) [2023-12-28 01:50:52,104][106225] Updated weights for policy 1, policy_version 919763 (0.0009) [2023-12-28 01:50:52,146][106226] Updated weights for policy 0, policy_version 917304 (0.0005) [2023-12-28 01:50:52,161][106225] Updated weights for policy 1, policy_version 919773 (0.0008) [2023-12-28 01:50:52,194][106226] Updated weights for policy 0, policy_version 917314 (0.0009) [2023-12-28 01:50:52,772][106226] Updated weights for policy 0, policy_version 917324 (0.0010) [2023-12-28 01:50:52,830][106226] Updated weights for policy 0, policy_version 917334 (0.0005) [2023-12-28 01:50:52,899][106226] Updated weights for policy 0, policy_version 917344 (0.0007) [2023-12-28 01:50:52,926][106225] Updated weights for policy 1, policy_version 919783 (0.0007) [2023-12-28 01:50:52,980][106225] Updated weights for policy 1, policy_version 919793 (0.0007) [2023-12-28 01:50:53,041][106225] Updated weights for policy 1, policy_version 919803 (0.0007) [2023-12-28 01:50:53,549][106226] Updated weights for policy 0, policy_version 917354 (0.0007) [2023-12-28 01:50:53,615][106226] Updated weights for policy 0, policy_version 917364 (0.0010) [2023-12-28 01:50:53,676][106226] Updated weights for policy 0, policy_version 917374 (0.0011) [2023-12-28 01:50:53,716][106225] Updated weights for policy 1, policy_version 919813 (0.0006) [2023-12-28 01:50:53,737][106226] Updated weights for policy 0, policy_version 917384 (0.0010) [2023-12-28 01:50:53,768][106225] Updated weights for policy 1, policy_version 919823 (0.0007) [2023-12-28 01:50:53,819][106225] Updated weights for policy 1, policy_version 919833 (0.0008) [2023-12-28 01:50:54,376][106226] Updated weights for policy 0, policy_version 917394 (0.0010) [2023-12-28 01:50:54,441][106226] Updated weights for policy 0, policy_version 917404 (0.0010) [2023-12-28 01:50:54,501][106226] Updated weights for policy 0, policy_version 917414 (0.0011) [2023-12-28 01:50:54,595][106225] Updated weights for policy 1, policy_version 919843 (0.0009) [2023-12-28 01:50:54,648][106225] Updated weights for policy 1, policy_version 919853 (0.0008) [2023-12-28 01:50:54,707][106225] Updated weights for policy 1, policy_version 919863 (0.0007) [2023-12-28 01:50:55,191][106226] Updated weights for policy 0, policy_version 917424 (0.0009) [2023-12-28 01:50:55,244][106226] Updated weights for policy 0, policy_version 917434 (0.0007) [2023-12-28 01:50:55,300][106226] Updated weights for policy 0, policy_version 917444 (0.0007) [2023-12-28 01:50:55,353][106225] Updated weights for policy 1, policy_version 919873 (0.0008) [2023-12-28 01:50:55,404][106225] Updated weights for policy 1, policy_version 919883 (0.0009) [2023-12-28 01:50:55,462][106225] Updated weights for policy 1, policy_version 919893 (0.0009) [2023-12-28 01:50:55,528][106225] Updated weights for policy 1, policy_version 919903 (0.0009) [2023-12-28 01:50:55,916][106226] Updated weights for policy 0, policy_version 917454 (0.0009) [2023-12-28 01:50:55,970][106226] Updated weights for policy 0, policy_version 917464 (0.0008) [2023-12-28 01:50:56,018][106226] Updated weights for policy 0, policy_version 917474 (0.0008) [2023-12-28 01:50:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 470466560. Throughput: 0: 9797.7, 1: 9970.1. Samples: 470435260. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:50:56,176][105115] Avg episode reward: [(0, '-4.374'), (1, '-5.326')] [2023-12-28 01:50:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000917480_234930176.pth... [2023-12-28 01:50:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000916296_234627072.pth [2023-12-28 01:50:56,235][106225] Updated weights for policy 1, policy_version 919913 (0.0009) [2023-12-28 01:50:56,290][106225] Updated weights for policy 1, policy_version 919923 (0.0009) [2023-12-28 01:50:56,339][106225] Updated weights for policy 1, policy_version 919933 (0.0008) [2023-12-28 01:50:56,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000919936_235544576.pth... [2023-12-28 01:50:56,359][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000918752_235241472.pth [2023-12-28 01:50:56,724][106226] Updated weights for policy 0, policy_version 917484 (0.0008) [2023-12-28 01:50:56,784][106226] Updated weights for policy 0, policy_version 917494 (0.0009) [2023-12-28 01:50:56,828][106226] Updated weights for policy 0, policy_version 917504 (0.0008) [2023-12-28 01:50:56,981][106225] Updated weights for policy 1, policy_version 919943 (0.0007) [2023-12-28 01:50:57,053][106225] Updated weights for policy 1, policy_version 919953 (0.0007) [2023-12-28 01:50:57,097][106225] Updated weights for policy 1, policy_version 919963 (0.0006) [2023-12-28 01:50:57,549][106226] Updated weights for policy 0, policy_version 917514 (0.0008) [2023-12-28 01:50:57,600][106226] Updated weights for policy 0, policy_version 917524 (0.0008) [2023-12-28 01:50:57,661][106226] Updated weights for policy 0, policy_version 917534 (0.0008) [2023-12-28 01:50:57,719][106226] Updated weights for policy 0, policy_version 917544 (0.0008) [2023-12-28 01:50:57,749][106225] Updated weights for policy 1, policy_version 919973 (0.0007) [2023-12-28 01:50:57,809][106225] Updated weights for policy 1, policy_version 919983 (0.0009) [2023-12-28 01:50:57,878][106225] Updated weights for policy 1, policy_version 919993 (0.0009) [2023-12-28 01:50:58,385][106226] Updated weights for policy 0, policy_version 917554 (0.0008) [2023-12-28 01:50:58,445][106226] Updated weights for policy 0, policy_version 917564 (0.0009) [2023-12-28 01:50:58,513][106226] Updated weights for policy 0, policy_version 917574 (0.0009) [2023-12-28 01:50:58,621][106225] Updated weights for policy 1, policy_version 920003 (0.0008) [2023-12-28 01:50:58,689][106225] Updated weights for policy 1, policy_version 920013 (0.0008) [2023-12-28 01:50:58,752][106225] Updated weights for policy 1, policy_version 920023 (0.0008) [2023-12-28 01:50:59,383][106226] Updated weights for policy 0, policy_version 917584 (0.0008) [2023-12-28 01:50:59,452][106226] Updated weights for policy 0, policy_version 917594 (0.0007) [2023-12-28 01:50:59,503][106226] Updated weights for policy 0, policy_version 917604 (0.0008) [2023-12-28 01:50:59,559][106225] Updated weights for policy 1, policy_version 920033 (0.0009) [2023-12-28 01:50:59,617][106225] Updated weights for policy 1, policy_version 920043 (0.0008) [2023-12-28 01:50:59,670][106225] Updated weights for policy 1, policy_version 920053 (0.0009) [2023-12-28 01:50:59,726][106225] Updated weights for policy 1, policy_version 920063 (0.0008) [2023-12-28 01:51:00,208][106226] Updated weights for policy 0, policy_version 917614 (0.0010) [2023-12-28 01:51:00,269][106226] Updated weights for policy 0, policy_version 917624 (0.0011) [2023-12-28 01:51:00,326][106226] Updated weights for policy 0, policy_version 917634 (0.0010) [2023-12-28 01:51:00,487][106225] Updated weights for policy 1, policy_version 920073 (0.0006) [2023-12-28 01:51:00,545][106225] Updated weights for policy 1, policy_version 920083 (0.0005) [2023-12-28 01:51:00,603][106225] Updated weights for policy 1, policy_version 920093 (0.0007) [2023-12-28 01:51:00,964][106226] Updated weights for policy 0, policy_version 917644 (0.0011) [2023-12-28 01:51:01,027][106226] Updated weights for policy 0, policy_version 917654 (0.0009) [2023-12-28 01:51:01,084][106226] Updated weights for policy 0, policy_version 917664 (0.0009) [2023-12-28 01:51:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 470564864. Throughput: 0: 9834.0, 1: 9954.8. Samples: 470552224. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:01,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.802')] [2023-12-28 01:51:01,244][106225] Updated weights for policy 1, policy_version 920103 (0.0009) [2023-12-28 01:51:01,306][106225] Updated weights for policy 1, policy_version 920113 (0.0011) [2023-12-28 01:51:01,367][106225] Updated weights for policy 1, policy_version 920123 (0.0010) [2023-12-28 01:51:01,809][106226] Updated weights for policy 0, policy_version 917674 (0.0010) [2023-12-28 01:51:01,861][106226] Updated weights for policy 0, policy_version 917684 (0.0005) [2023-12-28 01:51:01,927][106226] Updated weights for policy 0, policy_version 917694 (0.0005) [2023-12-28 01:51:01,989][106226] Updated weights for policy 0, policy_version 917704 (0.0008) [2023-12-28 01:51:02,069][106225] Updated weights for policy 1, policy_version 920133 (0.0009) [2023-12-28 01:51:02,130][106225] Updated weights for policy 1, policy_version 920143 (0.0010) [2023-12-28 01:51:02,193][106225] Updated weights for policy 1, policy_version 920153 (0.0010) [2023-12-28 01:51:02,616][106226] Updated weights for policy 0, policy_version 917714 (0.0008) [2023-12-28 01:51:02,692][106226] Updated weights for policy 0, policy_version 917724 (0.0009) [2023-12-28 01:51:02,760][106226] Updated weights for policy 0, policy_version 917734 (0.0010) [2023-12-28 01:51:02,895][106225] Updated weights for policy 1, policy_version 920163 (0.0009) [2023-12-28 01:51:02,951][106225] Updated weights for policy 1, policy_version 920173 (0.0009) [2023-12-28 01:51:03,007][106225] Updated weights for policy 1, policy_version 920183 (0.0008) [2023-12-28 01:51:03,475][106226] Updated weights for policy 0, policy_version 917744 (0.0009) [2023-12-28 01:51:03,532][106226] Updated weights for policy 0, policy_version 917754 (0.0008) [2023-12-28 01:51:03,580][106226] Updated weights for policy 0, policy_version 917764 (0.0008) [2023-12-28 01:51:03,685][106225] Updated weights for policy 1, policy_version 920193 (0.0008) [2023-12-28 01:51:03,744][106225] Updated weights for policy 1, policy_version 920203 (0.0006) [2023-12-28 01:51:03,796][106225] Updated weights for policy 1, policy_version 920213 (0.0008) [2023-12-28 01:51:03,857][106225] Updated weights for policy 1, policy_version 920223 (0.0008) [2023-12-28 01:51:04,363][106226] Updated weights for policy 0, policy_version 917774 (0.0009) [2023-12-28 01:51:04,432][106226] Updated weights for policy 0, policy_version 917784 (0.0009) [2023-12-28 01:51:04,493][106226] Updated weights for policy 0, policy_version 917794 (0.0009) [2023-12-28 01:51:04,514][106225] Updated weights for policy 1, policy_version 920233 (0.0006) [2023-12-28 01:51:04,577][106225] Updated weights for policy 1, policy_version 920243 (0.0008) [2023-12-28 01:51:04,630][106225] Updated weights for policy 1, policy_version 920253 (0.0010) [2023-12-28 01:51:05,187][106226] Updated weights for policy 0, policy_version 917804 (0.0008) [2023-12-28 01:51:05,244][106226] Updated weights for policy 0, policy_version 917814 (0.0008) [2023-12-28 01:51:05,278][106225] Updated weights for policy 1, policy_version 920263 (0.0010) [2023-12-28 01:51:05,292][106226] Updated weights for policy 0, policy_version 917824 (0.0007) [2023-12-28 01:51:05,345][106225] Updated weights for policy 1, policy_version 920273 (0.0006) [2023-12-28 01:51:05,419][106225] Updated weights for policy 1, policy_version 920283 (0.0006) [2023-12-28 01:51:05,904][106226] Updated weights for policy 0, policy_version 917834 (0.0007) [2023-12-28 01:51:05,961][106226] Updated weights for policy 0, policy_version 917844 (0.0007) [2023-12-28 01:51:05,974][106225] Updated weights for policy 1, policy_version 920293 (0.0007) [2023-12-28 01:51:06,021][106226] Updated weights for policy 0, policy_version 917854 (0.0007) [2023-12-28 01:51:06,028][106225] Updated weights for policy 1, policy_version 920303 (0.0007) [2023-12-28 01:51:06,082][106226] Updated weights for policy 0, policy_version 917864 (0.0008) [2023-12-28 01:51:06,086][106225] Updated weights for policy 1, policy_version 920313 (0.0005) [2023-12-28 01:51:06,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 470671360. Throughput: 0: 9898.3, 1: 9987.5. Samples: 470673832. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:06,175][105115] Avg episode reward: [(0, '-4.164'), (1, '-4.932')] [2023-12-28 01:51:06,793][106226] Updated weights for policy 0, policy_version 917875 (0.0008) [2023-12-28 01:51:06,846][106226] Updated weights for policy 0, policy_version 917885 (0.0010) [2023-12-28 01:51:06,865][106225] Updated weights for policy 1, policy_version 920323 (0.0008) [2023-12-28 01:51:06,911][106226] Updated weights for policy 0, policy_version 917895 (0.0008) [2023-12-28 01:51:06,931][106225] Updated weights for policy 1, policy_version 920333 (0.0007) [2023-12-28 01:51:06,988][106225] Updated weights for policy 1, policy_version 920343 (0.0006) [2023-12-28 01:51:07,517][106226] Updated weights for policy 0, policy_version 917905 (0.0006) [2023-12-28 01:51:07,577][106226] Updated weights for policy 0, policy_version 917915 (0.0005) [2023-12-28 01:51:07,622][106226] Updated weights for policy 0, policy_version 917925 (0.0007) [2023-12-28 01:51:07,758][106225] Updated weights for policy 1, policy_version 920353 (0.0009) [2023-12-28 01:51:07,821][106225] Updated weights for policy 1, policy_version 920363 (0.0008) [2023-12-28 01:51:07,876][106225] Updated weights for policy 1, policy_version 920373 (0.0008) [2023-12-28 01:51:07,937][106225] Updated weights for policy 1, policy_version 920383 (0.0009) [2023-12-28 01:51:08,164][106226] Updated weights for policy 0, policy_version 917935 (0.0005) [2023-12-28 01:51:08,219][106226] Updated weights for policy 0, policy_version 917945 (0.0007) [2023-12-28 01:51:08,265][106226] Updated weights for policy 0, policy_version 917955 (0.0010) [2023-12-28 01:51:08,661][106225] Updated weights for policy 1, policy_version 920393 (0.0009) [2023-12-28 01:51:08,715][106225] Updated weights for policy 1, policy_version 920403 (0.0009) [2023-12-28 01:51:08,767][106225] Updated weights for policy 1, policy_version 920413 (0.0008) [2023-12-28 01:51:08,923][106226] Updated weights for policy 0, policy_version 917965 (0.0010) [2023-12-28 01:51:08,978][106226] Updated weights for policy 0, policy_version 917975 (0.0008) [2023-12-28 01:51:09,023][106226] Updated weights for policy 0, policy_version 917985 (0.0009) [2023-12-28 01:51:09,436][106225] Updated weights for policy 1, policy_version 920423 (0.0006) [2023-12-28 01:51:09,501][106225] Updated weights for policy 1, policy_version 920433 (0.0008) [2023-12-28 01:51:09,567][106225] Updated weights for policy 1, policy_version 920443 (0.0011) [2023-12-28 01:51:09,837][106226] Updated weights for policy 0, policy_version 917995 (0.0009) [2023-12-28 01:51:09,902][106226] Updated weights for policy 0, policy_version 918005 (0.0009) [2023-12-28 01:51:09,970][106226] Updated weights for policy 0, policy_version 918015 (0.0008) [2023-12-28 01:51:10,264][106225] Updated weights for policy 1, policy_version 920453 (0.0008) [2023-12-28 01:51:10,321][106225] Updated weights for policy 1, policy_version 920463 (0.0006) [2023-12-28 01:51:10,384][106225] Updated weights for policy 1, policy_version 920473 (0.0009) [2023-12-28 01:51:10,743][106226] Updated weights for policy 0, policy_version 918025 (0.0008) [2023-12-28 01:51:10,801][106226] Updated weights for policy 0, policy_version 918035 (0.0008) [2023-12-28 01:51:10,866][106226] Updated weights for policy 0, policy_version 918045 (0.0008) [2023-12-28 01:51:10,929][106226] Updated weights for policy 0, policy_version 918055 (0.0009) [2023-12-28 01:51:11,096][106225] Updated weights for policy 1, policy_version 920483 (0.0007) [2023-12-28 01:51:11,171][106225] Updated weights for policy 1, policy_version 920493 (0.0008) [2023-12-28 01:51:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 470761472. Throughput: 0: 10018.6, 1: 9978.3. Samples: 470734276. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:11,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-5.378')] [2023-12-28 01:51:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000918056_235077632.pth... [2023-12-28 01:51:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000916904_234782720.pth [2023-12-28 01:51:11,234][106225] Updated weights for policy 1, policy_version 920503 (0.0008) [2023-12-28 01:51:11,296][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000920512_235692032.pth... [2023-12-28 01:51:11,301][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000919328_235388928.pth [2023-12-28 01:51:11,735][106226] Updated weights for policy 0, policy_version 918065 (0.0009) [2023-12-28 01:51:11,807][106226] Updated weights for policy 0, policy_version 918075 (0.0008) [2023-12-28 01:51:11,873][106226] Updated weights for policy 0, policy_version 918085 (0.0008) [2023-12-28 01:51:11,998][106225] Updated weights for policy 1, policy_version 920513 (0.0009) [2023-12-28 01:51:12,059][106225] Updated weights for policy 1, policy_version 920523 (0.0008) [2023-12-28 01:51:12,111][106225] Updated weights for policy 1, policy_version 920533 (0.0008) [2023-12-28 01:51:12,168][106225] Updated weights for policy 1, policy_version 920543 (0.0007) [2023-12-28 01:51:12,603][106226] Updated weights for policy 0, policy_version 918095 (0.0007) [2023-12-28 01:51:12,679][106226] Updated weights for policy 0, policy_version 918105 (0.0009) [2023-12-28 01:51:12,728][106226] Updated weights for policy 0, policy_version 918115 (0.0007) [2023-12-28 01:51:12,911][106225] Updated weights for policy 1, policy_version 920553 (0.0009) [2023-12-28 01:51:12,961][106225] Updated weights for policy 1, policy_version 920563 (0.0007) [2023-12-28 01:51:13,029][106225] Updated weights for policy 1, policy_version 920573 (0.0006) [2023-12-28 01:51:13,485][106226] Updated weights for policy 0, policy_version 918125 (0.0007) [2023-12-28 01:51:13,541][106226] Updated weights for policy 0, policy_version 918135 (0.0010) [2023-12-28 01:51:13,586][106225] Updated weights for policy 1, policy_version 920583 (0.0006) [2023-12-28 01:51:13,599][106226] Updated weights for policy 0, policy_version 918145 (0.0011) [2023-12-28 01:51:13,645][106225] Updated weights for policy 1, policy_version 920593 (0.0008) [2023-12-28 01:51:13,704][106225] Updated weights for policy 1, policy_version 920603 (0.0008) [2023-12-28 01:51:14,297][106226] Updated weights for policy 0, policy_version 918155 (0.0011) [2023-12-28 01:51:14,351][106226] Updated weights for policy 0, policy_version 918165 (0.0007) [2023-12-28 01:51:14,410][106226] Updated weights for policy 0, policy_version 918175 (0.0011) [2023-12-28 01:51:14,422][106225] Updated weights for policy 1, policy_version 920613 (0.0007) [2023-12-28 01:51:14,478][106225] Updated weights for policy 1, policy_version 920623 (0.0005) [2023-12-28 01:51:14,538][106225] Updated weights for policy 1, policy_version 920633 (0.0005) [2023-12-28 01:51:15,084][106226] Updated weights for policy 0, policy_version 918185 (0.0010) [2023-12-28 01:51:15,140][106225] Updated weights for policy 1, policy_version 920643 (0.0005) [2023-12-28 01:51:15,153][106226] Updated weights for policy 0, policy_version 918195 (0.0010) [2023-12-28 01:51:15,204][106225] Updated weights for policy 1, policy_version 920653 (0.0008) [2023-12-28 01:51:15,216][106226] Updated weights for policy 0, policy_version 918205 (0.0007) [2023-12-28 01:51:15,273][106225] Updated weights for policy 1, policy_version 920663 (0.0009) [2023-12-28 01:51:15,288][106226] Updated weights for policy 0, policy_version 918215 (0.0006) [2023-12-28 01:51:15,835][106225] Updated weights for policy 1, policy_version 920673 (0.0006) [2023-12-28 01:51:15,903][106225] Updated weights for policy 1, policy_version 920683 (0.0006) [2023-12-28 01:51:15,940][106226] Updated weights for policy 0, policy_version 918225 (0.0010) [2023-12-28 01:51:15,970][106225] Updated weights for policy 1, policy_version 920693 (0.0006) [2023-12-28 01:51:15,995][106226] Updated weights for policy 0, policy_version 918235 (0.0011) [2023-12-28 01:51:16,037][106225] Updated weights for policy 1, policy_version 920703 (0.0006) [2023-12-28 01:51:16,058][106226] Updated weights for policy 0, policy_version 918245 (0.0008) [2023-12-28 01:51:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 470867968. Throughput: 0: 9947.7, 1: 9809.9. Samples: 470850736. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:16,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.986')] [2023-12-28 01:51:16,630][106225] Updated weights for policy 1, policy_version 920713 (0.0008) [2023-12-28 01:51:16,679][106225] Updated weights for policy 1, policy_version 920723 (0.0008) [2023-12-28 01:51:16,729][106225] Updated weights for policy 1, policy_version 920733 (0.0008) [2023-12-28 01:51:16,763][106226] Updated weights for policy 0, policy_version 918255 (0.0008) [2023-12-28 01:51:16,830][106226] Updated weights for policy 0, policy_version 918265 (0.0009) [2023-12-28 01:51:16,887][106226] Updated weights for policy 0, policy_version 918275 (0.0009) [2023-12-28 01:51:17,494][106225] Updated weights for policy 1, policy_version 920743 (0.0009) [2023-12-28 01:51:17,543][106225] Updated weights for policy 1, policy_version 920753 (0.0010) [2023-12-28 01:51:17,561][106226] Updated weights for policy 0, policy_version 918285 (0.0008) [2023-12-28 01:51:17,592][106225] Updated weights for policy 1, policy_version 920763 (0.0010) [2023-12-28 01:51:17,614][106226] Updated weights for policy 0, policy_version 918295 (0.0006) [2023-12-28 01:51:17,667][106226] Updated weights for policy 0, policy_version 918305 (0.0008) [2023-12-28 01:51:18,294][106225] Updated weights for policy 1, policy_version 920773 (0.0010) [2023-12-28 01:51:18,351][106225] Updated weights for policy 1, policy_version 920783 (0.0010) [2023-12-28 01:51:18,373][106226] Updated weights for policy 0, policy_version 918315 (0.0008) [2023-12-28 01:51:18,406][106225] Updated weights for policy 1, policy_version 920793 (0.0008) [2023-12-28 01:51:18,429][106226] Updated weights for policy 0, policy_version 918325 (0.0008) [2023-12-28 01:51:18,478][106226] Updated weights for policy 0, policy_version 918335 (0.0008) [2023-12-28 01:51:19,001][106225] Updated weights for policy 1, policy_version 920803 (0.0007) [2023-12-28 01:51:19,059][106225] Updated weights for policy 1, policy_version 920813 (0.0011) [2023-12-28 01:51:19,112][106225] Updated weights for policy 1, policy_version 920823 (0.0010) [2023-12-28 01:51:19,176][106226] Updated weights for policy 0, policy_version 918345 (0.0008) [2023-12-28 01:51:19,241][106226] Updated weights for policy 0, policy_version 918355 (0.0008) [2023-12-28 01:51:19,301][106226] Updated weights for policy 0, policy_version 918365 (0.0008) [2023-12-28 01:51:19,373][106226] Updated weights for policy 0, policy_version 918375 (0.0008) [2023-12-28 01:51:19,911][106225] Updated weights for policy 1, policy_version 920833 (0.0010) [2023-12-28 01:51:19,978][106225] Updated weights for policy 1, policy_version 920843 (0.0011) [2023-12-28 01:51:20,038][106225] Updated weights for policy 1, policy_version 920853 (0.0010) [2023-12-28 01:51:20,078][106226] Updated weights for policy 0, policy_version 918385 (0.0008) [2023-12-28 01:51:20,106][106225] Updated weights for policy 1, policy_version 920863 (0.0010) [2023-12-28 01:51:20,136][106226] Updated weights for policy 0, policy_version 918395 (0.0008) [2023-12-28 01:51:20,197][106226] Updated weights for policy 0, policy_version 918405 (0.0008) [2023-12-28 01:51:20,831][106225] Updated weights for policy 1, policy_version 920873 (0.0008) [2023-12-28 01:51:20,894][106225] Updated weights for policy 1, policy_version 920883 (0.0006) [2023-12-28 01:51:20,905][106226] Updated weights for policy 0, policy_version 918415 (0.0009) [2023-12-28 01:51:20,960][106226] Updated weights for policy 0, policy_version 918425 (0.0009) [2023-12-28 01:51:20,963][106225] Updated weights for policy 1, policy_version 920893 (0.0006) [2023-12-28 01:51:21,020][106226] Updated weights for policy 0, policy_version 918435 (0.0008) [2023-12-28 01:51:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 470966272. Throughput: 0: 9913.7, 1: 9912.8. Samples: 470971372. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:21,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-5.039')] [2023-12-28 01:51:21,666][106225] Updated weights for policy 1, policy_version 920903 (0.0008) [2023-12-28 01:51:21,730][106225] Updated weights for policy 1, policy_version 920913 (0.0009) [2023-12-28 01:51:21,794][106225] Updated weights for policy 1, policy_version 920923 (0.0008) [2023-12-28 01:51:21,863][106226] Updated weights for policy 0, policy_version 918445 (0.0008) [2023-12-28 01:51:21,926][106226] Updated weights for policy 0, policy_version 918455 (0.0009) [2023-12-28 01:51:21,993][106226] Updated weights for policy 0, policy_version 918465 (0.0008) [2023-12-28 01:51:22,547][106225] Updated weights for policy 1, policy_version 920933 (0.0007) [2023-12-28 01:51:22,616][106225] Updated weights for policy 1, policy_version 920943 (0.0009) [2023-12-28 01:51:22,655][106226] Updated weights for policy 0, policy_version 918475 (0.0008) [2023-12-28 01:51:22,685][106225] Updated weights for policy 1, policy_version 920953 (0.0011) [2023-12-28 01:51:22,720][106226] Updated weights for policy 0, policy_version 918485 (0.0008) [2023-12-28 01:51:22,785][106226] Updated weights for policy 0, policy_version 918495 (0.0007) [2023-12-28 01:51:23,376][106225] Updated weights for policy 1, policy_version 920963 (0.0011) [2023-12-28 01:51:23,399][106226] Updated weights for policy 0, policy_version 918505 (0.0007) [2023-12-28 01:51:23,429][106225] Updated weights for policy 1, policy_version 920973 (0.0010) [2023-12-28 01:51:23,454][106226] Updated weights for policy 0, policy_version 918515 (0.0007) [2023-12-28 01:51:23,479][106225] Updated weights for policy 1, policy_version 920983 (0.0010) [2023-12-28 01:51:23,508][106226] Updated weights for policy 0, policy_version 918525 (0.0005) [2023-12-28 01:51:23,570][106226] Updated weights for policy 0, policy_version 918535 (0.0007) [2023-12-28 01:51:24,153][106226] Updated weights for policy 0, policy_version 918545 (0.0007) [2023-12-28 01:51:24,208][106225] Updated weights for policy 1, policy_version 920993 (0.0010) [2023-12-28 01:51:24,233][106226] Updated weights for policy 0, policy_version 918555 (0.0007) [2023-12-28 01:51:24,261][106225] Updated weights for policy 1, policy_version 921003 (0.0010) [2023-12-28 01:51:24,293][106226] Updated weights for policy 0, policy_version 918565 (0.0006) [2023-12-28 01:51:24,317][106225] Updated weights for policy 1, policy_version 921013 (0.0010) [2023-12-28 01:51:24,377][106225] Updated weights for policy 1, policy_version 921023 (0.0010) [2023-12-28 01:51:24,991][106226] Updated weights for policy 0, policy_version 918575 (0.0008) [2023-12-28 01:51:25,060][106226] Updated weights for policy 0, policy_version 918585 (0.0008) [2023-12-28 01:51:25,102][106225] Updated weights for policy 1, policy_version 921033 (0.0010) [2023-12-28 01:51:25,123][106226] Updated weights for policy 0, policy_version 918595 (0.0007) [2023-12-28 01:51:25,160][106225] Updated weights for policy 1, policy_version 921043 (0.0010) [2023-12-28 01:51:25,221][106225] Updated weights for policy 1, policy_version 921053 (0.0011) [2023-12-28 01:51:25,738][106226] Updated weights for policy 0, policy_version 918605 (0.0007) [2023-12-28 01:51:25,796][106226] Updated weights for policy 0, policy_version 918615 (0.0009) [2023-12-28 01:51:25,847][106226] Updated weights for policy 0, policy_version 918626 (0.0009) [2023-12-28 01:51:25,872][106225] Updated weights for policy 1, policy_version 921063 (0.0010) [2023-12-28 01:51:25,933][106225] Updated weights for policy 1, policy_version 921073 (0.0010) [2023-12-28 01:51:25,996][106225] Updated weights for policy 1, policy_version 921083 (0.0010) [2023-12-28 01:51:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 471064576. Throughput: 0: 9919.4, 1: 9910.4. Samples: 471030200. Policy #0 lag: (min: 17.0, avg: 43.4, max: 49.0) [2023-12-28 01:51:26,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.117')] [2023-12-28 01:51:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000921088_235839488.pth... [2023-12-28 01:51:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000918632_235225088.pth... [2023-12-28 01:51:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000917480_234930176.pth [2023-12-28 01:51:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000919936_235544576.pth [2023-12-28 01:51:26,486][106226] Updated weights for policy 0, policy_version 918636 (0.0006) [2023-12-28 01:51:26,544][106226] Updated weights for policy 0, policy_version 918646 (0.0005) [2023-12-28 01:51:26,601][106226] Updated weights for policy 0, policy_version 918656 (0.0008) [2023-12-28 01:51:26,708][106225] Updated weights for policy 1, policy_version 921093 (0.0010) [2023-12-28 01:51:26,764][106225] Updated weights for policy 1, policy_version 921103 (0.0010) [2023-12-28 01:51:26,820][106225] Updated weights for policy 1, policy_version 921113 (0.0006) [2023-12-28 01:51:27,263][106226] Updated weights for policy 0, policy_version 918666 (0.0007) [2023-12-28 01:51:27,317][106226] Updated weights for policy 0, policy_version 918676 (0.0008) [2023-12-28 01:51:27,385][106226] Updated weights for policy 0, policy_version 918686 (0.0007) [2023-12-28 01:51:27,443][106226] Updated weights for policy 0, policy_version 918696 (0.0007) [2023-12-28 01:51:27,475][106225] Updated weights for policy 1, policy_version 921123 (0.0008) [2023-12-28 01:51:27,523][106225] Updated weights for policy 1, policy_version 921133 (0.0007) [2023-12-28 01:51:27,575][106225] Updated weights for policy 1, policy_version 921143 (0.0009) [2023-12-28 01:51:28,000][106226] Updated weights for policy 0, policy_version 918706 (0.0005) [2023-12-28 01:51:28,048][106226] Updated weights for policy 0, policy_version 918716 (0.0008) [2023-12-28 01:51:28,091][106226] Updated weights for policy 0, policy_version 918726 (0.0007) [2023-12-28 01:51:28,386][106225] Updated weights for policy 1, policy_version 921153 (0.0008) [2023-12-28 01:51:28,437][106225] Updated weights for policy 1, policy_version 921163 (0.0008) [2023-12-28 01:51:28,486][106225] Updated weights for policy 1, policy_version 921173 (0.0009) [2023-12-28 01:51:28,539][106225] Updated weights for policy 1, policy_version 921183 (0.0005) [2023-12-28 01:51:28,786][106226] Updated weights for policy 0, policy_version 918736 (0.0008) [2023-12-28 01:51:28,847][106226] Updated weights for policy 0, policy_version 918746 (0.0008) [2023-12-28 01:51:28,912][106226] Updated weights for policy 0, policy_version 918756 (0.0009) [2023-12-28 01:51:29,245][106225] Updated weights for policy 1, policy_version 921193 (0.0007) [2023-12-28 01:51:29,309][106225] Updated weights for policy 1, policy_version 921203 (0.0006) [2023-12-28 01:51:29,376][106225] Updated weights for policy 1, policy_version 921213 (0.0007) [2023-12-28 01:51:29,604][106226] Updated weights for policy 0, policy_version 918766 (0.0009) [2023-12-28 01:51:29,657][106226] Updated weights for policy 0, policy_version 918776 (0.0009) [2023-12-28 01:51:29,712][106226] Updated weights for policy 0, policy_version 918786 (0.0009) [2023-12-28 01:51:29,925][106225] Updated weights for policy 1, policy_version 921223 (0.0008) [2023-12-28 01:51:29,999][106225] Updated weights for policy 1, policy_version 921233 (0.0006) [2023-12-28 01:51:30,063][106225] Updated weights for policy 1, policy_version 921243 (0.0008) [2023-12-28 01:51:30,454][106226] Updated weights for policy 0, policy_version 918796 (0.0008) [2023-12-28 01:51:30,499][106226] Updated weights for policy 0, policy_version 918806 (0.0008) [2023-12-28 01:51:30,544][106226] Updated weights for policy 0, policy_version 918816 (0.0007) [2023-12-28 01:51:30,750][106225] Updated weights for policy 1, policy_version 921253 (0.0007) [2023-12-28 01:51:30,810][106225] Updated weights for policy 1, policy_version 921263 (0.0009) [2023-12-28 01:51:30,870][106225] Updated weights for policy 1, policy_version 921273 (0.0008) [2023-12-28 01:51:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 471162880. Throughput: 0: 9973.0, 1: 9959.4. Samples: 471152708. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:31,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-5.481')] [2023-12-28 01:51:31,275][106226] Updated weights for policy 0, policy_version 918826 (0.0008) [2023-12-28 01:51:31,329][106226] Updated weights for policy 0, policy_version 918836 (0.0005) [2023-12-28 01:51:31,399][106226] Updated weights for policy 0, policy_version 918846 (0.0009) [2023-12-28 01:51:31,462][106226] Updated weights for policy 0, policy_version 918856 (0.0009) [2023-12-28 01:51:31,594][106225] Updated weights for policy 1, policy_version 921283 (0.0008) [2023-12-28 01:51:31,659][106225] Updated weights for policy 1, policy_version 921293 (0.0008) [2023-12-28 01:51:31,721][106225] Updated weights for policy 1, policy_version 921303 (0.0008) [2023-12-28 01:51:32,202][106226] Updated weights for policy 0, policy_version 918866 (0.0006) [2023-12-28 01:51:32,268][106226] Updated weights for policy 0, policy_version 918876 (0.0008) [2023-12-28 01:51:32,331][106226] Updated weights for policy 0, policy_version 918886 (0.0009) [2023-12-28 01:51:32,460][106225] Updated weights for policy 1, policy_version 921313 (0.0009) [2023-12-28 01:51:32,519][106225] Updated weights for policy 1, policy_version 921323 (0.0009) [2023-12-28 01:51:32,572][106225] Updated weights for policy 1, policy_version 921333 (0.0008) [2023-12-28 01:51:32,618][106225] Updated weights for policy 1, policy_version 921343 (0.0008) [2023-12-28 01:51:33,021][106226] Updated weights for policy 0, policy_version 918896 (0.0008) [2023-12-28 01:51:33,074][106226] Updated weights for policy 0, policy_version 918906 (0.0008) [2023-12-28 01:51:33,135][106226] Updated weights for policy 0, policy_version 918916 (0.0008) [2023-12-28 01:51:33,360][106225] Updated weights for policy 1, policy_version 921353 (0.0010) [2023-12-28 01:51:33,414][106225] Updated weights for policy 1, policy_version 921363 (0.0010) [2023-12-28 01:51:33,470][106225] Updated weights for policy 1, policy_version 921373 (0.0010) [2023-12-28 01:51:33,879][106226] Updated weights for policy 0, policy_version 918926 (0.0009) [2023-12-28 01:51:33,940][106226] Updated weights for policy 0, policy_version 918936 (0.0005) [2023-12-28 01:51:34,000][106226] Updated weights for policy 0, policy_version 918946 (0.0005) [2023-12-28 01:51:34,196][106225] Updated weights for policy 1, policy_version 921383 (0.0010) [2023-12-28 01:51:34,257][106225] Updated weights for policy 1, policy_version 921393 (0.0009) [2023-12-28 01:51:34,321][106225] Updated weights for policy 1, policy_version 921403 (0.0009) [2023-12-28 01:51:34,637][106226] Updated weights for policy 0, policy_version 918956 (0.0005) [2023-12-28 01:51:34,710][106226] Updated weights for policy 0, policy_version 918966 (0.0005) [2023-12-28 01:51:34,778][106226] Updated weights for policy 0, policy_version 918976 (0.0008) [2023-12-28 01:51:34,964][106225] Updated weights for policy 1, policy_version 921413 (0.0010) [2023-12-28 01:51:35,020][106225] Updated weights for policy 1, policy_version 921423 (0.0010) [2023-12-28 01:51:35,071][106225] Updated weights for policy 1, policy_version 921433 (0.0010) [2023-12-28 01:51:35,436][106226] Updated weights for policy 0, policy_version 918986 (0.0008) [2023-12-28 01:51:35,489][106226] Updated weights for policy 0, policy_version 918996 (0.0010) [2023-12-28 01:51:35,562][106226] Updated weights for policy 0, policy_version 919006 (0.0010) [2023-12-28 01:51:35,625][106226] Updated weights for policy 0, policy_version 919016 (0.0010) [2023-12-28 01:51:35,771][106225] Updated weights for policy 1, policy_version 921443 (0.0009) [2023-12-28 01:51:35,824][106225] Updated weights for policy 1, policy_version 921453 (0.0005) [2023-12-28 01:51:35,881][106225] Updated weights for policy 1, policy_version 921463 (0.0010) [2023-12-28 01:51:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 471261184. Throughput: 0: 10016.4, 1: 9911.9. Samples: 471271844. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:36,175][105115] Avg episode reward: [(0, '-3.988'), (1, '-5.089')] [2023-12-28 01:51:36,254][106226] Updated weights for policy 0, policy_version 919026 (0.0008) [2023-12-28 01:51:36,320][106226] Updated weights for policy 0, policy_version 919036 (0.0008) [2023-12-28 01:51:36,381][106226] Updated weights for policy 0, policy_version 919046 (0.0008) [2023-12-28 01:51:36,593][106225] Updated weights for policy 1, policy_version 921473 (0.0010) [2023-12-28 01:51:36,647][106225] Updated weights for policy 1, policy_version 921483 (0.0005) [2023-12-28 01:51:36,710][106225] Updated weights for policy 1, policy_version 921493 (0.0005) [2023-12-28 01:51:36,783][106225] Updated weights for policy 1, policy_version 921503 (0.0006) [2023-12-28 01:51:37,081][106226] Updated weights for policy 0, policy_version 919056 (0.0007) [2023-12-28 01:51:37,139][106226] Updated weights for policy 0, policy_version 919066 (0.0007) [2023-12-28 01:51:37,202][106226] Updated weights for policy 0, policy_version 919076 (0.0010) [2023-12-28 01:51:37,422][106225] Updated weights for policy 1, policy_version 921513 (0.0011) [2023-12-28 01:51:37,480][106225] Updated weights for policy 1, policy_version 921523 (0.0010) [2023-12-28 01:51:37,545][106225] Updated weights for policy 1, policy_version 921533 (0.0011) [2023-12-28 01:51:37,867][106226] Updated weights for policy 0, policy_version 919086 (0.0011) [2023-12-28 01:51:37,914][106226] Updated weights for policy 0, policy_version 919096 (0.0010) [2023-12-28 01:51:37,965][106226] Updated weights for policy 0, policy_version 919106 (0.0009) [2023-12-28 01:51:38,272][106225] Updated weights for policy 1, policy_version 921543 (0.0010) [2023-12-28 01:51:38,322][106225] Updated weights for policy 1, policy_version 921553 (0.0010) [2023-12-28 01:51:38,387][106225] Updated weights for policy 1, policy_version 921563 (0.0008) [2023-12-28 01:51:38,643][106226] Updated weights for policy 0, policy_version 919116 (0.0006) [2023-12-28 01:51:38,709][106226] Updated weights for policy 0, policy_version 919126 (0.0008) [2023-12-28 01:51:38,773][106226] Updated weights for policy 0, policy_version 919136 (0.0009) [2023-12-28 01:51:39,097][106225] Updated weights for policy 1, policy_version 921573 (0.0008) [2023-12-28 01:51:39,147][106225] Updated weights for policy 1, policy_version 921583 (0.0010) [2023-12-28 01:51:39,201][106225] Updated weights for policy 1, policy_version 921593 (0.0010) [2023-12-28 01:51:39,568][106226] Updated weights for policy 0, policy_version 919146 (0.0009) [2023-12-28 01:51:39,627][106226] Updated weights for policy 0, policy_version 919156 (0.0008) [2023-12-28 01:51:39,690][106226] Updated weights for policy 0, policy_version 919166 (0.0008) [2023-12-28 01:51:39,754][106226] Updated weights for policy 0, policy_version 919176 (0.0008) [2023-12-28 01:51:39,931][106225] Updated weights for policy 1, policy_version 921603 (0.0009) [2023-12-28 01:51:39,991][106225] Updated weights for policy 1, policy_version 921613 (0.0008) [2023-12-28 01:51:40,050][106225] Updated weights for policy 1, policy_version 921623 (0.0008) [2023-12-28 01:51:40,529][106226] Updated weights for policy 0, policy_version 919186 (0.0007) [2023-12-28 01:51:40,587][106226] Updated weights for policy 0, policy_version 919196 (0.0008) [2023-12-28 01:51:40,650][106226] Updated weights for policy 0, policy_version 919206 (0.0009) [2023-12-28 01:51:40,776][106225] Updated weights for policy 1, policy_version 921633 (0.0008) [2023-12-28 01:51:40,835][106225] Updated weights for policy 1, policy_version 921643 (0.0009) [2023-12-28 01:51:40,893][106225] Updated weights for policy 1, policy_version 921653 (0.0008) [2023-12-28 01:51:40,955][106225] Updated weights for policy 1, policy_version 921663 (0.0009) [2023-12-28 01:51:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 471359488. Throughput: 0: 9983.0, 1: 9927.0. Samples: 471331204. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:41,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.926')] [2023-12-28 01:51:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000921664_235986944.pth... [2023-12-28 01:51:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000919208_235372544.pth... [2023-12-28 01:51:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000920512_235692032.pth [2023-12-28 01:51:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000918056_235077632.pth [2023-12-28 01:51:41,260][106226] Updated weights for policy 0, policy_version 919216 (0.0007) [2023-12-28 01:51:41,329][106226] Updated weights for policy 0, policy_version 919226 (0.0009) [2023-12-28 01:51:41,402][106226] Updated weights for policy 0, policy_version 919236 (0.0009) [2023-12-28 01:51:41,689][106225] Updated weights for policy 1, policy_version 921673 (0.0008) [2023-12-28 01:51:41,761][106225] Updated weights for policy 1, policy_version 921683 (0.0008) [2023-12-28 01:51:41,824][106225] Updated weights for policy 1, policy_version 921693 (0.0008) [2023-12-28 01:51:42,143][106226] Updated weights for policy 0, policy_version 919246 (0.0006) [2023-12-28 01:51:42,208][106226] Updated weights for policy 0, policy_version 919256 (0.0008) [2023-12-28 01:51:42,260][106226] Updated weights for policy 0, policy_version 919266 (0.0008) [2023-12-28 01:51:42,581][106225] Updated weights for policy 1, policy_version 921703 (0.0010) [2023-12-28 01:51:42,645][106225] Updated weights for policy 1, policy_version 921713 (0.0010) [2023-12-28 01:51:42,709][106225] Updated weights for policy 1, policy_version 921723 (0.0010) [2023-12-28 01:51:42,980][106226] Updated weights for policy 0, policy_version 919276 (0.0008) [2023-12-28 01:51:43,049][106226] Updated weights for policy 0, policy_version 919286 (0.0010) [2023-12-28 01:51:43,107][106226] Updated weights for policy 0, policy_version 919296 (0.0009) [2023-12-28 01:51:43,335][106225] Updated weights for policy 1, policy_version 921733 (0.0008) [2023-12-28 01:51:43,382][106225] Updated weights for policy 1, policy_version 921743 (0.0005) [2023-12-28 01:51:43,434][106225] Updated weights for policy 1, policy_version 921753 (0.0005) [2023-12-28 01:51:43,827][106226] Updated weights for policy 0, policy_version 919306 (0.0008) [2023-12-28 01:51:43,878][106226] Updated weights for policy 0, policy_version 919316 (0.0006) [2023-12-28 01:51:43,928][106226] Updated weights for policy 0, policy_version 919326 (0.0010) [2023-12-28 01:51:43,957][106225] Updated weights for policy 1, policy_version 921763 (0.0005) [2023-12-28 01:51:43,993][106226] Updated weights for policy 0, policy_version 919336 (0.0008) [2023-12-28 01:51:44,009][106225] Updated weights for policy 1, policy_version 921773 (0.0005) [2023-12-28 01:51:44,062][106225] Updated weights for policy 1, policy_version 921783 (0.0010) [2023-12-28 01:51:44,668][106225] Updated weights for policy 1, policy_version 921793 (0.0010) [2023-12-28 01:51:44,702][106226] Updated weights for policy 0, policy_version 919346 (0.0006) [2023-12-28 01:51:44,716][106225] Updated weights for policy 1, policy_version 921803 (0.0010) [2023-12-28 01:51:44,760][106226] Updated weights for policy 0, policy_version 919356 (0.0005) [2023-12-28 01:51:44,780][106225] Updated weights for policy 1, policy_version 921813 (0.0011) [2023-12-28 01:51:44,820][106226] Updated weights for policy 0, policy_version 919366 (0.0008) [2023-12-28 01:51:44,847][106225] Updated weights for policy 1, policy_version 921823 (0.0008) [2023-12-28 01:51:45,442][106226] Updated weights for policy 0, policy_version 919376 (0.0008) [2023-12-28 01:51:45,503][106226] Updated weights for policy 0, policy_version 919386 (0.0008) [2023-12-28 01:51:45,561][106226] Updated weights for policy 0, policy_version 919396 (0.0007) [2023-12-28 01:51:45,612][106225] Updated weights for policy 1, policy_version 921833 (0.0009) [2023-12-28 01:51:45,660][106225] Updated weights for policy 1, policy_version 921843 (0.0008) [2023-12-28 01:51:45,712][106225] Updated weights for policy 1, policy_version 921853 (0.0008) [2023-12-28 01:51:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 471457792. Throughput: 0: 9948.1, 1: 10007.4. Samples: 471450224. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:46,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.117')] [2023-12-28 01:51:46,208][106226] Updated weights for policy 0, policy_version 919406 (0.0008) [2023-12-28 01:51:46,266][106226] Updated weights for policy 0, policy_version 919416 (0.0010) [2023-12-28 01:51:46,325][106226] Updated weights for policy 0, policy_version 919426 (0.0009) [2023-12-28 01:51:46,379][106225] Updated weights for policy 1, policy_version 921863 (0.0009) [2023-12-28 01:51:46,428][106225] Updated weights for policy 1, policy_version 921873 (0.0010) [2023-12-28 01:51:46,480][106225] Updated weights for policy 1, policy_version 921883 (0.0007) [2023-12-28 01:51:46,925][106226] Updated weights for policy 0, policy_version 919436 (0.0007) [2023-12-28 01:51:46,997][106226] Updated weights for policy 0, policy_version 919446 (0.0007) [2023-12-28 01:51:47,055][106226] Updated weights for policy 0, policy_version 919456 (0.0009) [2023-12-28 01:51:47,156][106225] Updated weights for policy 1, policy_version 921893 (0.0009) [2023-12-28 01:51:47,212][106225] Updated weights for policy 1, policy_version 921903 (0.0008) [2023-12-28 01:51:47,277][106225] Updated weights for policy 1, policy_version 921913 (0.0007) [2023-12-28 01:51:47,736][106226] Updated weights for policy 0, policy_version 919466 (0.0007) [2023-12-28 01:51:47,792][106226] Updated weights for policy 0, policy_version 919476 (0.0005) [2023-12-28 01:51:47,854][106226] Updated weights for policy 0, policy_version 919486 (0.0006) [2023-12-28 01:51:47,925][106226] Updated weights for policy 0, policy_version 919496 (0.0008) [2023-12-28 01:51:47,941][106225] Updated weights for policy 1, policy_version 921923 (0.0008) [2023-12-28 01:51:47,990][106225] Updated weights for policy 1, policy_version 921933 (0.0006) [2023-12-28 01:51:48,052][106225] Updated weights for policy 1, policy_version 921943 (0.0010) [2023-12-28 01:51:48,558][106226] Updated weights for policy 0, policy_version 919506 (0.0011) [2023-12-28 01:51:48,625][106226] Updated weights for policy 0, policy_version 919516 (0.0011) [2023-12-28 01:51:48,686][106226] Updated weights for policy 0, policy_version 919526 (0.0011) [2023-12-28 01:51:48,761][106225] Updated weights for policy 1, policy_version 921953 (0.0008) [2023-12-28 01:51:48,814][106225] Updated weights for policy 1, policy_version 921963 (0.0009) [2023-12-28 01:51:48,875][106225] Updated weights for policy 1, policy_version 921973 (0.0009) [2023-12-28 01:51:48,929][106225] Updated weights for policy 1, policy_version 921983 (0.0009) [2023-12-28 01:51:49,358][106226] Updated weights for policy 0, policy_version 919536 (0.0008) [2023-12-28 01:51:49,422][106226] Updated weights for policy 0, policy_version 919546 (0.0007) [2023-12-28 01:51:49,479][106226] Updated weights for policy 0, policy_version 919556 (0.0008) [2023-12-28 01:51:49,662][106225] Updated weights for policy 1, policy_version 921993 (0.0008) [2023-12-28 01:51:49,717][106225] Updated weights for policy 1, policy_version 922003 (0.0008) [2023-12-28 01:51:49,774][106225] Updated weights for policy 1, policy_version 922013 (0.0008) [2023-12-28 01:51:50,266][106226] Updated weights for policy 0, policy_version 919566 (0.0009) [2023-12-28 01:51:50,323][106226] Updated weights for policy 0, policy_version 919576 (0.0010) [2023-12-28 01:51:50,380][106226] Updated weights for policy 0, policy_version 919586 (0.0008) [2023-12-28 01:51:50,416][106225] Updated weights for policy 1, policy_version 922023 (0.0008) [2023-12-28 01:51:50,462][106225] Updated weights for policy 1, policy_version 922033 (0.0007) [2023-12-28 01:51:50,512][106225] Updated weights for policy 1, policy_version 922043 (0.0009) [2023-12-28 01:51:51,067][106226] Updated weights for policy 0, policy_version 919596 (0.0007) [2023-12-28 01:51:51,129][106226] Updated weights for policy 0, policy_version 919606 (0.0008) [2023-12-28 01:51:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 471556096. Throughput: 0: 9981.3, 1: 9958.3. Samples: 471571116. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:51,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.984')] [2023-12-28 01:51:51,194][106226] Updated weights for policy 0, policy_version 919616 (0.0010) [2023-12-28 01:51:51,266][106225] Updated weights for policy 1, policy_version 922053 (0.0008) [2023-12-28 01:51:51,337][106225] Updated weights for policy 1, policy_version 922063 (0.0007) [2023-12-28 01:51:51,418][106225] Updated weights for policy 1, policy_version 922073 (0.0007) [2023-12-28 01:51:51,939][106226] Updated weights for policy 0, policy_version 919626 (0.0009) [2023-12-28 01:51:52,000][106226] Updated weights for policy 0, policy_version 919636 (0.0009) [2023-12-28 01:51:52,053][106226] Updated weights for policy 0, policy_version 919646 (0.0008) [2023-12-28 01:51:52,116][106226] Updated weights for policy 0, policy_version 919656 (0.0007) [2023-12-28 01:51:52,137][106225] Updated weights for policy 1, policy_version 922083 (0.0008) [2023-12-28 01:51:52,189][106225] Updated weights for policy 1, policy_version 922093 (0.0008) [2023-12-28 01:51:52,239][106225] Updated weights for policy 1, policy_version 922103 (0.0008) [2023-12-28 01:51:52,851][106226] Updated weights for policy 0, policy_version 919666 (0.0009) [2023-12-28 01:51:52,900][106226] Updated weights for policy 0, policy_version 919676 (0.0008) [2023-12-28 01:51:52,955][106226] Updated weights for policy 0, policy_version 919686 (0.0008) [2023-12-28 01:51:52,995][106225] Updated weights for policy 1, policy_version 922113 (0.0008) [2023-12-28 01:51:53,046][106225] Updated weights for policy 1, policy_version 922123 (0.0008) [2023-12-28 01:51:53,101][106225] Updated weights for policy 1, policy_version 922133 (0.0008) [2023-12-28 01:51:53,150][106225] Updated weights for policy 1, policy_version 922143 (0.0008) [2023-12-28 01:51:53,712][106226] Updated weights for policy 0, policy_version 919696 (0.0009) [2023-12-28 01:51:53,766][106226] Updated weights for policy 0, policy_version 919706 (0.0009) [2023-12-28 01:51:53,818][106226] Updated weights for policy 0, policy_version 919716 (0.0008) [2023-12-28 01:51:53,847][106225] Updated weights for policy 1, policy_version 922153 (0.0006) [2023-12-28 01:51:53,893][106225] Updated weights for policy 1, policy_version 922163 (0.0005) [2023-12-28 01:51:53,947][106225] Updated weights for policy 1, policy_version 922173 (0.0005) [2023-12-28 01:51:54,470][106226] Updated weights for policy 0, policy_version 919726 (0.0007) [2023-12-28 01:51:54,522][106226] Updated weights for policy 0, policy_version 919736 (0.0008) [2023-12-28 01:51:54,574][106226] Updated weights for policy 0, policy_version 919746 (0.0009) [2023-12-28 01:51:54,613][106225] Updated weights for policy 1, policy_version 922183 (0.0007) [2023-12-28 01:51:54,670][106225] Updated weights for policy 1, policy_version 922193 (0.0006) [2023-12-28 01:51:54,726][106225] Updated weights for policy 1, policy_version 922203 (0.0005) [2023-12-28 01:51:55,317][106225] Updated weights for policy 1, policy_version 922213 (0.0006) [2023-12-28 01:51:55,362][106226] Updated weights for policy 0, policy_version 919756 (0.0008) [2023-12-28 01:51:55,372][106225] Updated weights for policy 1, policy_version 922223 (0.0006) [2023-12-28 01:51:55,411][106226] Updated weights for policy 0, policy_version 919766 (0.0008) [2023-12-28 01:51:55,425][106225] Updated weights for policy 1, policy_version 922233 (0.0005) [2023-12-28 01:51:55,460][106226] Updated weights for policy 0, policy_version 919776 (0.0008) [2023-12-28 01:51:56,056][106225] Updated weights for policy 1, policy_version 922243 (0.0006) [2023-12-28 01:51:56,115][106225] Updated weights for policy 1, policy_version 922253 (0.0008) [2023-12-28 01:51:56,172][106225] Updated weights for policy 1, policy_version 922263 (0.0008) [2023-12-28 01:51:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 471654400. Throughput: 0: 9890.9, 1: 9973.8. Samples: 471628184. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:51:56,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.095')] [2023-12-28 01:51:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000919784_235520000.pth... [2023-12-28 01:51:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000918632_235225088.pth [2023-12-28 01:51:56,222][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000922272_236142592.pth... [2023-12-28 01:51:56,224][106226] Updated weights for policy 0, policy_version 919786 (0.0008) [2023-12-28 01:51:56,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000921088_235839488.pth [2023-12-28 01:51:56,286][106226] Updated weights for policy 0, policy_version 919796 (0.0009) [2023-12-28 01:51:56,349][106226] Updated weights for policy 0, policy_version 919806 (0.0009) [2023-12-28 01:51:56,411][106226] Updated weights for policy 0, policy_version 919816 (0.0009) [2023-12-28 01:51:56,918][106225] Updated weights for policy 1, policy_version 922273 (0.0008) [2023-12-28 01:51:56,976][106225] Updated weights for policy 1, policy_version 922283 (0.0008) [2023-12-28 01:51:57,023][106226] Updated weights for policy 0, policy_version 919826 (0.0008) [2023-12-28 01:51:57,029][106225] Updated weights for policy 1, policy_version 922293 (0.0005) [2023-12-28 01:51:57,072][106226] Updated weights for policy 0, policy_version 919836 (0.0007) [2023-12-28 01:51:57,082][106225] Updated weights for policy 1, policy_version 922303 (0.0007) [2023-12-28 01:51:57,123][106226] Updated weights for policy 0, policy_version 919846 (0.0008) [2023-12-28 01:51:57,783][106226] Updated weights for policy 0, policy_version 919856 (0.0009) [2023-12-28 01:51:57,836][106226] Updated weights for policy 0, policy_version 919866 (0.0009) [2023-12-28 01:51:57,850][106225] Updated weights for policy 1, policy_version 922313 (0.0005) [2023-12-28 01:51:57,889][106226] Updated weights for policy 0, policy_version 919876 (0.0010) [2023-12-28 01:51:57,895][106225] Updated weights for policy 1, policy_version 922323 (0.0006) [2023-12-28 01:51:57,939][106225] Updated weights for policy 1, policy_version 922333 (0.0007) [2023-12-28 01:51:58,547][106226] Updated weights for policy 0, policy_version 919886 (0.0010) [2023-12-28 01:51:58,615][106226] Updated weights for policy 0, policy_version 919896 (0.0010) [2023-12-28 01:51:58,678][106226] Updated weights for policy 0, policy_version 919906 (0.0009) [2023-12-28 01:51:58,855][106225] Updated weights for policy 1, policy_version 922343 (0.0010) [2023-12-28 01:51:58,926][106225] Updated weights for policy 1, policy_version 922353 (0.0009) [2023-12-28 01:51:58,982][106225] Updated weights for policy 1, policy_version 922363 (0.0008) [2023-12-28 01:51:59,455][106226] Updated weights for policy 0, policy_version 919916 (0.0009) [2023-12-28 01:51:59,515][106226] Updated weights for policy 0, policy_version 919926 (0.0005) [2023-12-28 01:51:59,579][106226] Updated weights for policy 0, policy_version 919936 (0.0006) [2023-12-28 01:51:59,756][106225] Updated weights for policy 1, policy_version 922373 (0.0007) [2023-12-28 01:51:59,823][106225] Updated weights for policy 1, policy_version 922383 (0.0008) [2023-12-28 01:51:59,880][106225] Updated weights for policy 1, policy_version 922393 (0.0008) [2023-12-28 01:52:00,219][106226] Updated weights for policy 0, policy_version 919946 (0.0008) [2023-12-28 01:52:00,276][106226] Updated weights for policy 0, policy_version 919956 (0.0005) [2023-12-28 01:52:00,336][106226] Updated weights for policy 0, policy_version 919966 (0.0006) [2023-12-28 01:52:00,395][106226] Updated weights for policy 0, policy_version 919976 (0.0008) [2023-12-28 01:52:00,553][106225] Updated weights for policy 1, policy_version 922403 (0.0008) [2023-12-28 01:52:00,609][106225] Updated weights for policy 1, policy_version 922413 (0.0005) [2023-12-28 01:52:00,660][106225] Updated weights for policy 1, policy_version 922423 (0.0005) [2023-12-28 01:52:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 471752704. Throughput: 0: 9977.9, 1: 9926.9. Samples: 471746456. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:01,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.248')] [2023-12-28 01:52:01,182][106226] Updated weights for policy 0, policy_version 919987 (0.0009) [2023-12-28 01:52:01,239][106226] Updated weights for policy 0, policy_version 919997 (0.0009) [2023-12-28 01:52:01,256][106225] Updated weights for policy 1, policy_version 922433 (0.0006) [2023-12-28 01:52:01,301][106226] Updated weights for policy 0, policy_version 920007 (0.0009) [2023-12-28 01:52:01,309][106225] Updated weights for policy 1, policy_version 922443 (0.0006) [2023-12-28 01:52:01,374][106225] Updated weights for policy 1, policy_version 922453 (0.0007) [2023-12-28 01:52:01,443][106225] Updated weights for policy 1, policy_version 922463 (0.0009) [2023-12-28 01:52:01,993][106226] Updated weights for policy 0, policy_version 920017 (0.0006) [2023-12-28 01:52:02,050][106226] Updated weights for policy 0, policy_version 920027 (0.0005) [2023-12-28 01:52:02,113][106226] Updated weights for policy 0, policy_version 920037 (0.0007) [2023-12-28 01:52:02,203][106225] Updated weights for policy 1, policy_version 922473 (0.0008) [2023-12-28 01:52:02,262][106225] Updated weights for policy 1, policy_version 922483 (0.0009) [2023-12-28 01:52:02,321][106225] Updated weights for policy 1, policy_version 922493 (0.0006) [2023-12-28 01:52:02,697][106226] Updated weights for policy 0, policy_version 920047 (0.0009) [2023-12-28 01:52:02,747][106226] Updated weights for policy 0, policy_version 920057 (0.0008) [2023-12-28 01:52:02,796][106226] Updated weights for policy 0, policy_version 920067 (0.0008) [2023-12-28 01:52:02,997][106225] Updated weights for policy 1, policy_version 922503 (0.0009) [2023-12-28 01:52:03,046][106225] Updated weights for policy 1, policy_version 922513 (0.0010) [2023-12-28 01:52:03,105][106225] Updated weights for policy 1, policy_version 922523 (0.0010) [2023-12-28 01:52:03,470][106226] Updated weights for policy 0, policy_version 920077 (0.0008) [2023-12-28 01:52:03,527][106226] Updated weights for policy 0, policy_version 920087 (0.0006) [2023-12-28 01:52:03,586][106226] Updated weights for policy 0, policy_version 920097 (0.0007) [2023-12-28 01:52:03,798][106225] Updated weights for policy 1, policy_version 922533 (0.0010) [2023-12-28 01:52:03,876][106225] Updated weights for policy 1, policy_version 922544 (0.0009) [2023-12-28 01:52:03,943][106225] Updated weights for policy 1, policy_version 922554 (0.0008) [2023-12-28 01:52:04,350][106226] Updated weights for policy 0, policy_version 920107 (0.0008) [2023-12-28 01:52:04,411][106226] Updated weights for policy 0, policy_version 920117 (0.0008) [2023-12-28 01:52:04,464][106226] Updated weights for policy 0, policy_version 920127 (0.0008) [2023-12-28 01:52:04,644][106225] Updated weights for policy 1, policy_version 922564 (0.0008) [2023-12-28 01:52:04,705][106225] Updated weights for policy 1, policy_version 922574 (0.0005) [2023-12-28 01:52:04,756][106225] Updated weights for policy 1, policy_version 922584 (0.0005) [2023-12-28 01:52:05,294][106226] Updated weights for policy 0, policy_version 920137 (0.0009) [2023-12-28 01:52:05,323][106225] Updated weights for policy 1, policy_version 922594 (0.0006) [2023-12-28 01:52:05,355][106226] Updated weights for policy 0, policy_version 920147 (0.0006) [2023-12-28 01:52:05,380][106225] Updated weights for policy 1, policy_version 922604 (0.0010) [2023-12-28 01:52:05,418][106226] Updated weights for policy 0, policy_version 920157 (0.0007) [2023-12-28 01:52:05,443][106225] Updated weights for policy 1, policy_version 922614 (0.0010) [2023-12-28 01:52:05,483][106226] Updated weights for policy 0, policy_version 920167 (0.0005) [2023-12-28 01:52:05,496][106225] Updated weights for policy 1, policy_version 922624 (0.0010) [2023-12-28 01:52:06,165][106225] Updated weights for policy 1, policy_version 922634 (0.0006) [2023-12-28 01:52:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 471851008. Throughput: 0: 9950.1, 1: 9927.4. Samples: 471865860. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:06,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.902')] [2023-12-28 01:52:06,233][106225] Updated weights for policy 1, policy_version 922644 (0.0006) [2023-12-28 01:52:06,234][106226] Updated weights for policy 0, policy_version 920177 (0.0008) [2023-12-28 01:52:06,292][106226] Updated weights for policy 0, policy_version 920187 (0.0008) [2023-12-28 01:52:06,298][106225] Updated weights for policy 1, policy_version 922654 (0.0006) [2023-12-28 01:52:06,346][106226] Updated weights for policy 0, policy_version 920197 (0.0008) [2023-12-28 01:52:06,894][106225] Updated weights for policy 1, policy_version 922664 (0.0009) [2023-12-28 01:52:06,958][106225] Updated weights for policy 1, policy_version 922674 (0.0008) [2023-12-28 01:52:07,019][106225] Updated weights for policy 1, policy_version 922684 (0.0008) [2023-12-28 01:52:07,164][106226] Updated weights for policy 0, policy_version 920207 (0.0008) [2023-12-28 01:52:07,218][106226] Updated weights for policy 0, policy_version 920217 (0.0009) [2023-12-28 01:52:07,291][106226] Updated weights for policy 0, policy_version 920227 (0.0008) [2023-12-28 01:52:07,670][106225] Updated weights for policy 1, policy_version 922694 (0.0008) [2023-12-28 01:52:07,737][106225] Updated weights for policy 1, policy_version 922704 (0.0010) [2023-12-28 01:52:07,804][106225] Updated weights for policy 1, policy_version 922714 (0.0009) [2023-12-28 01:52:08,076][106226] Updated weights for policy 0, policy_version 920237 (0.0010) [2023-12-28 01:52:08,139][106226] Updated weights for policy 0, policy_version 920247 (0.0008) [2023-12-28 01:52:08,199][106226] Updated weights for policy 0, policy_version 920257 (0.0009) [2023-12-28 01:52:08,487][106225] Updated weights for policy 1, policy_version 922724 (0.0008) [2023-12-28 01:52:08,547][106225] Updated weights for policy 1, policy_version 922734 (0.0008) [2023-12-28 01:52:08,602][106225] Updated weights for policy 1, policy_version 922744 (0.0008) [2023-12-28 01:52:08,946][106226] Updated weights for policy 0, policy_version 920267 (0.0008) [2023-12-28 01:52:08,992][106226] Updated weights for policy 0, policy_version 920277 (0.0008) [2023-12-28 01:52:09,042][106226] Updated weights for policy 0, policy_version 920287 (0.0009) [2023-12-28 01:52:09,321][106225] Updated weights for policy 1, policy_version 922754 (0.0009) [2023-12-28 01:52:09,389][106225] Updated weights for policy 1, policy_version 922764 (0.0008) [2023-12-28 01:52:09,460][106225] Updated weights for policy 1, policy_version 922774 (0.0008) [2023-12-28 01:52:09,523][106225] Updated weights for policy 1, policy_version 922784 (0.0009) [2023-12-28 01:52:09,863][106226] Updated weights for policy 0, policy_version 920297 (0.0009) [2023-12-28 01:52:09,925][106226] Updated weights for policy 0, policy_version 920307 (0.0009) [2023-12-28 01:52:09,982][106226] Updated weights for policy 0, policy_version 920317 (0.0009) [2023-12-28 01:52:10,040][106226] Updated weights for policy 0, policy_version 920327 (0.0010) [2023-12-28 01:52:10,225][106225] Updated weights for policy 1, policy_version 922794 (0.0009) [2023-12-28 01:52:10,296][106225] Updated weights for policy 1, policy_version 922804 (0.0008) [2023-12-28 01:52:10,361][106225] Updated weights for policy 1, policy_version 922814 (0.0007) [2023-12-28 01:52:10,843][106226] Updated weights for policy 0, policy_version 920337 (0.0009) [2023-12-28 01:52:10,902][106226] Updated weights for policy 0, policy_version 920347 (0.0008) [2023-12-28 01:52:10,953][106225] Updated weights for policy 1, policy_version 922824 (0.0006) [2023-12-28 01:52:10,958][106226] Updated weights for policy 0, policy_version 920357 (0.0009) [2023-12-28 01:52:11,005][106225] Updated weights for policy 1, policy_version 922834 (0.0009) [2023-12-28 01:52:11,069][106225] Updated weights for policy 1, policy_version 922844 (0.0008) [2023-12-28 01:52:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 471957504. Throughput: 0: 9859.4, 1: 9983.0. Samples: 471923108. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:11,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.697')] [2023-12-28 01:52:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000922848_236290048.pth... [2023-12-28 01:52:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000920360_235667456.pth... [2023-12-28 01:52:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000919208_235372544.pth [2023-12-28 01:52:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000921664_235986944.pth [2023-12-28 01:52:11,785][106226] Updated weights for policy 0, policy_version 920367 (0.0011) [2023-12-28 01:52:11,883][106226] Updated weights for policy 0, policy_version 920377 (0.0011) [2023-12-28 01:52:11,890][106225] Updated weights for policy 1, policy_version 922854 (0.0007) [2023-12-28 01:52:11,939][106226] Updated weights for policy 0, policy_version 920387 (0.0011) [2023-12-28 01:52:11,957][106225] Updated weights for policy 1, policy_version 922864 (0.0006) [2023-12-28 01:52:12,021][106225] Updated weights for policy 1, policy_version 922874 (0.0008) [2023-12-28 01:52:12,640][106226] Updated weights for policy 0, policy_version 920397 (0.0011) [2023-12-28 01:52:12,691][106226] Updated weights for policy 0, policy_version 920407 (0.0010) [2023-12-28 01:52:12,752][106226] Updated weights for policy 0, policy_version 920417 (0.0011) [2023-12-28 01:52:12,755][106225] Updated weights for policy 1, policy_version 922884 (0.0006) [2023-12-28 01:52:12,814][106225] Updated weights for policy 1, policy_version 922894 (0.0008) [2023-12-28 01:52:12,873][106225] Updated weights for policy 1, policy_version 922904 (0.0008) [2023-12-28 01:52:13,492][106226] Updated weights for policy 0, policy_version 920427 (0.0011) [2023-12-28 01:52:13,541][106226] Updated weights for policy 0, policy_version 920437 (0.0010) [2023-12-28 01:52:13,594][106226] Updated weights for policy 0, policy_version 920447 (0.0010) [2023-12-28 01:52:13,621][106225] Updated weights for policy 1, policy_version 922914 (0.0007) [2023-12-28 01:52:13,665][106225] Updated weights for policy 1, policy_version 922924 (0.0007) [2023-12-28 01:52:13,716][106225] Updated weights for policy 1, policy_version 922934 (0.0008) [2023-12-28 01:52:13,765][106225] Updated weights for policy 1, policy_version 922944 (0.0007) [2023-12-28 01:52:14,323][106226] Updated weights for policy 0, policy_version 920457 (0.0011) [2023-12-28 01:52:14,373][106226] Updated weights for policy 0, policy_version 920467 (0.0010) [2023-12-28 01:52:14,423][106226] Updated weights for policy 0, policy_version 920477 (0.0010) [2023-12-28 01:52:14,480][106226] Updated weights for policy 0, policy_version 920487 (0.0010) [2023-12-28 01:52:14,530][106225] Updated weights for policy 1, policy_version 922954 (0.0008) [2023-12-28 01:52:14,588][106225] Updated weights for policy 1, policy_version 922964 (0.0008) [2023-12-28 01:52:14,652][106225] Updated weights for policy 1, policy_version 922974 (0.0008) [2023-12-28 01:52:15,237][106226] Updated weights for policy 0, policy_version 920497 (0.0011) [2023-12-28 01:52:15,291][106226] Updated weights for policy 0, policy_version 920507 (0.0010) [2023-12-28 01:52:15,351][106226] Updated weights for policy 0, policy_version 920517 (0.0011) [2023-12-28 01:52:15,447][106225] Updated weights for policy 1, policy_version 922984 (0.0008) [2023-12-28 01:52:15,493][106225] Updated weights for policy 1, policy_version 922994 (0.0007) [2023-12-28 01:52:15,540][106225] Updated weights for policy 1, policy_version 923004 (0.0008) [2023-12-28 01:52:16,037][106226] Updated weights for policy 0, policy_version 920527 (0.0010) [2023-12-28 01:52:16,101][106226] Updated weights for policy 0, policy_version 920537 (0.0007) [2023-12-28 01:52:16,171][106226] Updated weights for policy 0, policy_version 920547 (0.0006) [2023-12-28 01:52:16,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 472039424. Throughput: 0: 9702.6, 1: 9907.5. Samples: 472035168. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:16,176][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.113')] [2023-12-28 01:52:16,298][106225] Updated weights for policy 1, policy_version 923014 (0.0006) [2023-12-28 01:52:16,353][106225] Updated weights for policy 1, policy_version 923024 (0.0006) [2023-12-28 01:52:16,396][106225] Updated weights for policy 1, policy_version 923034 (0.0008) [2023-12-28 01:52:16,805][106226] Updated weights for policy 0, policy_version 920557 (0.0005) [2023-12-28 01:52:16,875][106226] Updated weights for policy 0, policy_version 920567 (0.0005) [2023-12-28 01:52:16,938][106226] Updated weights for policy 0, policy_version 920577 (0.0005) [2023-12-28 01:52:17,040][106225] Updated weights for policy 1, policy_version 923044 (0.0009) [2023-12-28 01:52:17,091][106225] Updated weights for policy 1, policy_version 923054 (0.0009) [2023-12-28 01:52:17,140][106225] Updated weights for policy 1, policy_version 923064 (0.0009) [2023-12-28 01:52:17,420][106226] Updated weights for policy 0, policy_version 920587 (0.0005) [2023-12-28 01:52:17,481][106226] Updated weights for policy 0, policy_version 920597 (0.0006) [2023-12-28 01:52:17,540][106226] Updated weights for policy 0, policy_version 920607 (0.0005) [2023-12-28 01:52:17,968][106225] Updated weights for policy 1, policy_version 923074 (0.0008) [2023-12-28 01:52:18,025][106225] Updated weights for policy 1, policy_version 923084 (0.0008) [2023-12-28 01:52:18,068][106225] Updated weights for policy 1, policy_version 923094 (0.0007) [2023-12-28 01:52:18,112][106225] Updated weights for policy 1, policy_version 923104 (0.0007) [2023-12-28 01:52:18,147][106226] Updated weights for policy 0, policy_version 920617 (0.0005) [2023-12-28 01:52:18,209][106226] Updated weights for policy 0, policy_version 920627 (0.0010) [2023-12-28 01:52:18,273][106226] Updated weights for policy 0, policy_version 920637 (0.0008) [2023-12-28 01:52:18,339][106226] Updated weights for policy 0, policy_version 920647 (0.0008) [2023-12-28 01:52:18,903][106225] Updated weights for policy 1, policy_version 923114 (0.0008) [2023-12-28 01:52:18,955][106225] Updated weights for policy 1, policy_version 923124 (0.0007) [2023-12-28 01:52:19,004][106225] Updated weights for policy 1, policy_version 923134 (0.0007) [2023-12-28 01:52:19,028][106226] Updated weights for policy 0, policy_version 920657 (0.0011) [2023-12-28 01:52:19,087][106226] Updated weights for policy 0, policy_version 920667 (0.0010) [2023-12-28 01:52:19,140][106226] Updated weights for policy 0, policy_version 920677 (0.0009) [2023-12-28 01:52:19,807][106225] Updated weights for policy 1, policy_version 923144 (0.0008) [2023-12-28 01:52:19,869][106225] Updated weights for policy 1, policy_version 923154 (0.0007) [2023-12-28 01:52:19,923][106226] Updated weights for policy 0, policy_version 920687 (0.0007) [2023-12-28 01:52:19,946][106225] Updated weights for policy 1, policy_version 923164 (0.0007) [2023-12-28 01:52:19,991][106226] Updated weights for policy 0, policy_version 920697 (0.0008) [2023-12-28 01:52:20,053][106226] Updated weights for policy 0, policy_version 920707 (0.0008) [2023-12-28 01:52:20,711][106225] Updated weights for policy 1, policy_version 923174 (0.0009) [2023-12-28 01:52:20,778][106225] Updated weights for policy 1, policy_version 923184 (0.0008) [2023-12-28 01:52:20,817][106226] Updated weights for policy 0, policy_version 920717 (0.0007) [2023-12-28 01:52:20,839][106225] Updated weights for policy 1, policy_version 923194 (0.0008) [2023-12-28 01:52:20,883][106226] Updated weights for policy 0, policy_version 920727 (0.0006) [2023-12-28 01:52:20,945][106226] Updated weights for policy 0, policy_version 920737 (0.0006) [2023-12-28 01:52:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 472145920. Throughput: 0: 9725.8, 1: 9848.9. Samples: 472152704. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:21,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.090')] [2023-12-28 01:52:21,573][106226] Updated weights for policy 0, policy_version 920747 (0.0006) [2023-12-28 01:52:21,588][106225] Updated weights for policy 1, policy_version 923204 (0.0008) [2023-12-28 01:52:21,639][106226] Updated weights for policy 0, policy_version 920757 (0.0008) [2023-12-28 01:52:21,658][106225] Updated weights for policy 1, policy_version 923214 (0.0008) [2023-12-28 01:52:21,708][106226] Updated weights for policy 0, policy_version 920767 (0.0008) [2023-12-28 01:52:21,732][106225] Updated weights for policy 1, policy_version 923224 (0.0009) [2023-12-28 01:52:22,465][106225] Updated weights for policy 1, policy_version 923234 (0.0008) [2023-12-28 01:52:22,469][106226] Updated weights for policy 0, policy_version 920777 (0.0008) [2023-12-28 01:52:22,524][106226] Updated weights for policy 0, policy_version 920787 (0.0007) [2023-12-28 01:52:22,525][106225] Updated weights for policy 1, policy_version 923244 (0.0009) [2023-12-28 01:52:22,583][106226] Updated weights for policy 0, policy_version 920797 (0.0006) [2023-12-28 01:52:22,585][106225] Updated weights for policy 1, policy_version 923254 (0.0006) [2023-12-28 01:52:22,636][106226] Updated weights for policy 0, policy_version 920807 (0.0006) [2023-12-28 01:52:22,646][106225] Updated weights for policy 1, policy_version 923264 (0.0006) [2023-12-28 01:52:23,317][106225] Updated weights for policy 1, policy_version 923274 (0.0005) [2023-12-28 01:52:23,374][106225] Updated weights for policy 1, policy_version 923284 (0.0006) [2023-12-28 01:52:23,380][106226] Updated weights for policy 0, policy_version 920817 (0.0008) [2023-12-28 01:52:23,427][106226] Updated weights for policy 0, policy_version 920827 (0.0005) [2023-12-28 01:52:23,429][106225] Updated weights for policy 1, policy_version 923294 (0.0007) [2023-12-28 01:52:23,482][106226] Updated weights for policy 0, policy_version 920837 (0.0008) [2023-12-28 01:52:24,121][106225] Updated weights for policy 1, policy_version 923304 (0.0008) [2023-12-28 01:52:24,177][106225] Updated weights for policy 1, policy_version 923314 (0.0008) [2023-12-28 01:52:24,225][106225] Updated weights for policy 1, policy_version 923324 (0.0006) [2023-12-28 01:52:24,227][106226] Updated weights for policy 0, policy_version 920847 (0.0008) [2023-12-28 01:52:24,272][106226] Updated weights for policy 0, policy_version 920857 (0.0007) [2023-12-28 01:52:24,331][106226] Updated weights for policy 0, policy_version 920867 (0.0008) [2023-12-28 01:52:24,955][106225] Updated weights for policy 1, policy_version 923334 (0.0007) [2023-12-28 01:52:24,999][106225] Updated weights for policy 1, policy_version 923344 (0.0008) [2023-12-28 01:52:25,031][106226] Updated weights for policy 0, policy_version 920877 (0.0008) [2023-12-28 01:52:25,054][106225] Updated weights for policy 1, policy_version 923354 (0.0007) [2023-12-28 01:52:25,090][106226] Updated weights for policy 0, policy_version 920887 (0.0007) [2023-12-28 01:52:25,148][106226] Updated weights for policy 0, policy_version 920897 (0.0007) [2023-12-28 01:52:25,773][106226] Updated weights for policy 0, policy_version 920907 (0.0008) [2023-12-28 01:52:25,821][106226] Updated weights for policy 0, policy_version 920917 (0.0008) [2023-12-28 01:52:25,834][106225] Updated weights for policy 1, policy_version 923364 (0.0007) [2023-12-28 01:52:25,869][106226] Updated weights for policy 0, policy_version 920927 (0.0007) [2023-12-28 01:52:25,897][106225] Updated weights for policy 1, policy_version 923374 (0.0007) [2023-12-28 01:52:25,949][106225] Updated weights for policy 1, policy_version 923384 (0.0006) [2023-12-28 01:52:26,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 472244224. Throughput: 0: 9702.5, 1: 9833.1. Samples: 472210304. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:26,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.130')] [2023-12-28 01:52:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000923392_236429312.pth... [2023-12-28 01:52:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000920936_235814912.pth... [2023-12-28 01:52:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000922272_236142592.pth [2023-12-28 01:52:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000919784_235520000.pth [2023-12-28 01:52:26,528][106226] Updated weights for policy 0, policy_version 920937 (0.0005) [2023-12-28 01:52:26,581][106226] Updated weights for policy 0, policy_version 920947 (0.0005) [2023-12-28 01:52:26,626][106226] Updated weights for policy 0, policy_version 920957 (0.0005) [2023-12-28 01:52:26,632][106225] Updated weights for policy 1, policy_version 923394 (0.0005) [2023-12-28 01:52:26,682][106225] Updated weights for policy 1, policy_version 923404 (0.0005) [2023-12-28 01:52:26,685][106226] Updated weights for policy 0, policy_version 920967 (0.0010) [2023-12-28 01:52:26,741][106225] Updated weights for policy 1, policy_version 923414 (0.0005) [2023-12-28 01:52:26,793][106225] Updated weights for policy 1, policy_version 923424 (0.0005) [2023-12-28 01:52:27,275][106226] Updated weights for policy 0, policy_version 920977 (0.0010) [2023-12-28 01:52:27,321][106225] Updated weights for policy 1, policy_version 923434 (0.0007) [2023-12-28 01:52:27,324][106226] Updated weights for policy 0, policy_version 920987 (0.0008) [2023-12-28 01:52:27,382][106225] Updated weights for policy 1, policy_version 923444 (0.0008) [2023-12-28 01:52:27,386][106226] Updated weights for policy 0, policy_version 920997 (0.0005) [2023-12-28 01:52:27,436][106225] Updated weights for policy 1, policy_version 923454 (0.0007) [2023-12-28 01:52:27,917][106226] Updated weights for policy 0, policy_version 921007 (0.0005) [2023-12-28 01:52:27,970][106226] Updated weights for policy 0, policy_version 921017 (0.0005) [2023-12-28 01:52:28,035][106226] Updated weights for policy 0, policy_version 921027 (0.0007) [2023-12-28 01:52:28,234][106225] Updated weights for policy 1, policy_version 923464 (0.0007) [2023-12-28 01:52:28,298][106225] Updated weights for policy 1, policy_version 923474 (0.0008) [2023-12-28 01:52:28,359][106225] Updated weights for policy 1, policy_version 923484 (0.0009) [2023-12-28 01:52:28,722][106226] Updated weights for policy 0, policy_version 921037 (0.0010) [2023-12-28 01:52:28,782][106226] Updated weights for policy 0, policy_version 921047 (0.0008) [2023-12-28 01:52:28,842][106226] Updated weights for policy 0, policy_version 921057 (0.0007) [2023-12-28 01:52:29,023][106225] Updated weights for policy 1, policy_version 923494 (0.0008) [2023-12-28 01:52:29,077][106225] Updated weights for policy 1, policy_version 923504 (0.0008) [2023-12-28 01:52:29,137][106225] Updated weights for policy 1, policy_version 923514 (0.0008) [2023-12-28 01:52:29,593][106226] Updated weights for policy 0, policy_version 921067 (0.0007) [2023-12-28 01:52:29,659][106226] Updated weights for policy 0, policy_version 921077 (0.0011) [2023-12-28 01:52:29,726][106226] Updated weights for policy 0, policy_version 921087 (0.0011) [2023-12-28 01:52:29,850][106225] Updated weights for policy 1, policy_version 923524 (0.0007) [2023-12-28 01:52:29,907][106225] Updated weights for policy 1, policy_version 923534 (0.0009) [2023-12-28 01:52:29,972][106225] Updated weights for policy 1, policy_version 923544 (0.0009) [2023-12-28 01:52:30,430][106226] Updated weights for policy 0, policy_version 921097 (0.0010) [2023-12-28 01:52:30,483][106226] Updated weights for policy 0, policy_version 921107 (0.0008) [2023-12-28 01:52:30,539][106226] Updated weights for policy 0, policy_version 921117 (0.0007) [2023-12-28 01:52:30,594][106226] Updated weights for policy 0, policy_version 921127 (0.0010) [2023-12-28 01:52:30,669][106225] Updated weights for policy 1, policy_version 923554 (0.0007) [2023-12-28 01:52:30,733][106225] Updated weights for policy 1, policy_version 923564 (0.0005) [2023-12-28 01:52:30,783][106225] Updated weights for policy 1, policy_version 923574 (0.0005) [2023-12-28 01:52:30,843][106225] Updated weights for policy 1, policy_version 923584 (0.0006) [2023-12-28 01:52:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 472342528. Throughput: 0: 9831.6, 1: 9788.9. Samples: 472333144. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:31,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.981')] [2023-12-28 01:52:31,185][106226] Updated weights for policy 0, policy_version 921137 (0.0009) [2023-12-28 01:52:31,248][106226] Updated weights for policy 0, policy_version 921147 (0.0008) [2023-12-28 01:52:31,312][106226] Updated weights for policy 0, policy_version 921157 (0.0008) [2023-12-28 01:52:31,475][106225] Updated weights for policy 1, policy_version 923594 (0.0010) [2023-12-28 01:52:31,532][106225] Updated weights for policy 1, policy_version 923604 (0.0010) [2023-12-28 01:52:31,588][106225] Updated weights for policy 1, policy_version 923614 (0.0010) [2023-12-28 01:52:31,961][106226] Updated weights for policy 0, policy_version 921167 (0.0006) [2023-12-28 01:52:32,023][106226] Updated weights for policy 0, policy_version 921177 (0.0011) [2023-12-28 01:52:32,080][106226] Updated weights for policy 0, policy_version 921187 (0.0010) [2023-12-28 01:52:32,329][106225] Updated weights for policy 1, policy_version 923624 (0.0009) [2023-12-28 01:52:32,385][106225] Updated weights for policy 1, policy_version 923634 (0.0007) [2023-12-28 01:52:32,432][106225] Updated weights for policy 1, policy_version 923644 (0.0007) [2023-12-28 01:52:32,729][106226] Updated weights for policy 0, policy_version 921197 (0.0008) [2023-12-28 01:52:32,797][106226] Updated weights for policy 0, policy_version 921207 (0.0005) [2023-12-28 01:52:32,861][106226] Updated weights for policy 0, policy_version 921217 (0.0006) [2023-12-28 01:52:33,228][106225] Updated weights for policy 1, policy_version 923654 (0.0006) [2023-12-28 01:52:33,284][106225] Updated weights for policy 1, policy_version 923664 (0.0006) [2023-12-28 01:52:33,334][106225] Updated weights for policy 1, policy_version 923674 (0.0005) [2023-12-28 01:52:33,414][106226] Updated weights for policy 0, policy_version 921227 (0.0007) [2023-12-28 01:52:33,472][106226] Updated weights for policy 0, policy_version 921237 (0.0010) [2023-12-28 01:52:33,530][106226] Updated weights for policy 0, policy_version 921247 (0.0010) [2023-12-28 01:52:34,002][106225] Updated weights for policy 1, policy_version 923684 (0.0007) [2023-12-28 01:52:34,049][106225] Updated weights for policy 1, policy_version 923694 (0.0007) [2023-12-28 01:52:34,103][106225] Updated weights for policy 1, policy_version 923704 (0.0008) [2023-12-28 01:52:34,230][106226] Updated weights for policy 0, policy_version 921257 (0.0010) [2023-12-28 01:52:34,296][106226] Updated weights for policy 0, policy_version 921267 (0.0011) [2023-12-28 01:52:34,356][106226] Updated weights for policy 0, policy_version 921277 (0.0011) [2023-12-28 01:52:34,426][106226] Updated weights for policy 0, policy_version 921287 (0.0011) [2023-12-28 01:52:34,827][106225] Updated weights for policy 1, policy_version 923714 (0.0007) [2023-12-28 01:52:34,891][106225] Updated weights for policy 1, policy_version 923724 (0.0007) [2023-12-28 01:52:34,947][106225] Updated weights for policy 1, policy_version 923734 (0.0008) [2023-12-28 01:52:35,003][106225] Updated weights for policy 1, policy_version 923744 (0.0008) [2023-12-28 01:52:35,129][106226] Updated weights for policy 0, policy_version 921297 (0.0006) [2023-12-28 01:52:35,187][106226] Updated weights for policy 0, policy_version 921307 (0.0006) [2023-12-28 01:52:35,239][106226] Updated weights for policy 0, policy_version 921317 (0.0007) [2023-12-28 01:52:35,745][106225] Updated weights for policy 1, policy_version 923754 (0.0009) [2023-12-28 01:52:35,801][106225] Updated weights for policy 1, policy_version 923764 (0.0008) [2023-12-28 01:52:35,861][106225] Updated weights for policy 1, policy_version 923774 (0.0008) [2023-12-28 01:52:35,904][106226] Updated weights for policy 0, policy_version 921327 (0.0008) [2023-12-28 01:52:35,974][106226] Updated weights for policy 0, policy_version 921337 (0.0008) [2023-12-28 01:52:36,027][106226] Updated weights for policy 0, policy_version 921347 (0.0009) [2023-12-28 01:52:36,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 472449024. Throughput: 0: 9861.4, 1: 9759.2. Samples: 472454044. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:36,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.829')] [2023-12-28 01:52:36,530][106225] Updated weights for policy 1, policy_version 923784 (0.0010) [2023-12-28 01:52:36,592][106225] Updated weights for policy 1, policy_version 923794 (0.0010) [2023-12-28 01:52:36,640][106225] Updated weights for policy 1, policy_version 923804 (0.0010) [2023-12-28 01:52:36,809][106226] Updated weights for policy 0, policy_version 921357 (0.0008) [2023-12-28 01:52:36,871][106226] Updated weights for policy 0, policy_version 921367 (0.0009) [2023-12-28 01:52:36,929][106226] Updated weights for policy 0, policy_version 921377 (0.0010) [2023-12-28 01:52:37,294][106225] Updated weights for policy 1, policy_version 923814 (0.0007) [2023-12-28 01:52:37,354][106225] Updated weights for policy 1, policy_version 923824 (0.0005) [2023-12-28 01:52:37,419][106225] Updated weights for policy 1, policy_version 923834 (0.0008) [2023-12-28 01:52:37,593][106226] Updated weights for policy 0, policy_version 921387 (0.0008) [2023-12-28 01:52:37,642][106226] Updated weights for policy 0, policy_version 921397 (0.0009) [2023-12-28 01:52:37,699][106226] Updated weights for policy 0, policy_version 921407 (0.0009) [2023-12-28 01:52:38,118][106225] Updated weights for policy 1, policy_version 923844 (0.0007) [2023-12-28 01:52:38,174][106225] Updated weights for policy 1, policy_version 923854 (0.0008) [2023-12-28 01:52:38,226][106225] Updated weights for policy 1, policy_version 923864 (0.0008) [2023-12-28 01:52:38,504][106226] Updated weights for policy 0, policy_version 921417 (0.0008) [2023-12-28 01:52:38,563][106226] Updated weights for policy 0, policy_version 921427 (0.0008) [2023-12-28 01:52:38,616][106226] Updated weights for policy 0, policy_version 921437 (0.0007) [2023-12-28 01:52:38,679][106226] Updated weights for policy 0, policy_version 921447 (0.0008) [2023-12-28 01:52:38,952][106225] Updated weights for policy 1, policy_version 923874 (0.0007) [2023-12-28 01:52:39,008][106225] Updated weights for policy 1, policy_version 923884 (0.0008) [2023-12-28 01:52:39,068][106225] Updated weights for policy 1, policy_version 923894 (0.0008) [2023-12-28 01:52:39,120][106225] Updated weights for policy 1, policy_version 923904 (0.0008) [2023-12-28 01:52:39,424][106226] Updated weights for policy 0, policy_version 921457 (0.0008) [2023-12-28 01:52:39,489][106226] Updated weights for policy 0, policy_version 921467 (0.0008) [2023-12-28 01:52:39,544][106226] Updated weights for policy 0, policy_version 921477 (0.0008) [2023-12-28 01:52:39,879][106225] Updated weights for policy 1, policy_version 923914 (0.0010) [2023-12-28 01:52:39,949][106225] Updated weights for policy 1, policy_version 923924 (0.0010) [2023-12-28 01:52:40,012][106225] Updated weights for policy 1, policy_version 923934 (0.0011) [2023-12-28 01:52:40,275][106226] Updated weights for policy 0, policy_version 921487 (0.0009) [2023-12-28 01:52:40,345][106226] Updated weights for policy 0, policy_version 921497 (0.0009) [2023-12-28 01:52:40,413][106226] Updated weights for policy 0, policy_version 921507 (0.0008) [2023-12-28 01:52:40,677][106225] Updated weights for policy 1, policy_version 923944 (0.0010) [2023-12-28 01:52:40,740][106225] Updated weights for policy 1, policy_version 923954 (0.0010) [2023-12-28 01:52:40,790][106225] Updated weights for policy 1, policy_version 923964 (0.0010) [2023-12-28 01:52:41,086][106226] Updated weights for policy 0, policy_version 921517 (0.0009) [2023-12-28 01:52:41,155][106226] Updated weights for policy 0, policy_version 921527 (0.0009) [2023-12-28 01:52:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 472539136. Throughput: 0: 9863.0, 1: 9798.3. Samples: 472512948. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:41,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-5.120')] [2023-12-28 01:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000923968_236576768.pth... [2023-12-28 01:52:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000922848_236290048.pth [2023-12-28 01:52:41,222][106226] Updated weights for policy 0, policy_version 921537 (0.0009) [2023-12-28 01:52:41,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000921544_235970560.pth... [2023-12-28 01:52:41,271][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000920360_235667456.pth [2023-12-28 01:52:41,601][106225] Updated weights for policy 1, policy_version 923974 (0.0009) [2023-12-28 01:52:41,675][106225] Updated weights for policy 1, policy_version 923984 (0.0008) [2023-12-28 01:52:41,743][106225] Updated weights for policy 1, policy_version 923994 (0.0009) [2023-12-28 01:52:42,022][106226] Updated weights for policy 0, policy_version 921547 (0.0009) [2023-12-28 01:52:42,086][106226] Updated weights for policy 0, policy_version 921557 (0.0009) [2023-12-28 01:52:42,148][106226] Updated weights for policy 0, policy_version 921567 (0.0008) [2023-12-28 01:52:42,189][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000003 [2023-12-28 01:52:42,510][106225] Updated weights for policy 1, policy_version 924004 (0.0008) [2023-12-28 01:52:42,573][106225] Updated weights for policy 1, policy_version 924014 (0.0008) [2023-12-28 01:52:42,639][106225] Updated weights for policy 1, policy_version 924024 (0.0007) [2023-12-28 01:52:42,901][106226] Updated weights for policy 0, policy_version 921577 (0.0009) [2023-12-28 01:52:42,957][106226] Updated weights for policy 0, policy_version 921587 (0.0009) [2023-12-28 01:52:43,022][106226] Updated weights for policy 0, policy_version 921597 (0.0008) [2023-12-28 01:52:43,082][106226] Updated weights for policy 0, policy_version 921607 (0.0009) [2023-12-28 01:52:43,306][106225] Updated weights for policy 1, policy_version 924034 (0.0007) [2023-12-28 01:52:43,361][106225] Updated weights for policy 1, policy_version 924044 (0.0008) [2023-12-28 01:52:43,425][106225] Updated weights for policy 1, policy_version 924054 (0.0008) [2023-12-28 01:52:43,483][106225] Updated weights for policy 1, policy_version 924064 (0.0009) [2023-12-28 01:52:43,750][106226] Updated weights for policy 0, policy_version 921617 (0.0006) [2023-12-28 01:52:43,809][106226] Updated weights for policy 0, policy_version 921627 (0.0006) [2023-12-28 01:52:43,867][106226] Updated weights for policy 0, policy_version 921637 (0.0009) [2023-12-28 01:52:44,235][106225] Updated weights for policy 1, policy_version 924074 (0.0009) [2023-12-28 01:52:44,293][106225] Updated weights for policy 1, policy_version 924084 (0.0008) [2023-12-28 01:52:44,359][106225] Updated weights for policy 1, policy_version 924094 (0.0005) [2023-12-28 01:52:44,543][106226] Updated weights for policy 0, policy_version 921647 (0.0006) [2023-12-28 01:52:44,599][106226] Updated weights for policy 0, policy_version 921657 (0.0005) [2023-12-28 01:52:44,663][106226] Updated weights for policy 0, policy_version 921667 (0.0005) [2023-12-28 01:52:45,068][106225] Updated weights for policy 1, policy_version 924104 (0.0007) [2023-12-28 01:52:45,129][106225] Updated weights for policy 1, policy_version 924114 (0.0009) [2023-12-28 01:52:45,192][106225] Updated weights for policy 1, policy_version 924124 (0.0009) [2023-12-28 01:52:45,323][106226] Updated weights for policy 0, policy_version 921677 (0.0008) [2023-12-28 01:52:45,389][106226] Updated weights for policy 0, policy_version 921687 (0.0008) [2023-12-28 01:52:45,458][106226] Updated weights for policy 0, policy_version 921697 (0.0009) [2023-12-28 01:52:45,947][106225] Updated weights for policy 1, policy_version 924134 (0.0008) [2023-12-28 01:52:46,004][106225] Updated weights for policy 1, policy_version 924144 (0.0009) [2023-12-28 01:52:46,043][106226] Updated weights for policy 0, policy_version 921707 (0.0007) [2023-12-28 01:52:46,056][106225] Updated weights for policy 1, policy_version 924154 (0.0009) [2023-12-28 01:52:46,105][106226] Updated weights for policy 0, policy_version 921717 (0.0005) [2023-12-28 01:52:46,174][106226] Updated weights for policy 0, policy_version 921727 (0.0005) [2023-12-28 01:52:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 472637440. Throughput: 0: 9812.1, 1: 9760.0. Samples: 472627204. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:46,176][105115] Avg episode reward: [(0, '-4.323'), (1, '-5.058')] [2023-12-28 01:52:46,793][106226] Updated weights for policy 0, policy_version 921737 (0.0006) [2023-12-28 01:52:46,826][106225] Updated weights for policy 1, policy_version 924164 (0.0007) [2023-12-28 01:52:46,844][106226] Updated weights for policy 0, policy_version 921747 (0.0006) [2023-12-28 01:52:46,881][106225] Updated weights for policy 1, policy_version 924174 (0.0007) [2023-12-28 01:52:46,903][106226] Updated weights for policy 0, policy_version 921757 (0.0007) [2023-12-28 01:52:46,926][106225] Updated weights for policy 1, policy_version 924184 (0.0005) [2023-12-28 01:52:46,953][106226] Updated weights for policy 0, policy_version 921767 (0.0009) [2023-12-28 01:52:47,506][106225] Updated weights for policy 1, policy_version 924194 (0.0006) [2023-12-28 01:52:47,564][106225] Updated weights for policy 1, policy_version 924204 (0.0008) [2023-12-28 01:52:47,623][106225] Updated weights for policy 1, policy_version 924214 (0.0008) [2023-12-28 01:52:47,684][106225] Updated weights for policy 1, policy_version 924224 (0.0009) [2023-12-28 01:52:47,728][106226] Updated weights for policy 0, policy_version 921777 (0.0005) [2023-12-28 01:52:47,781][106226] Updated weights for policy 0, policy_version 921787 (0.0005) [2023-12-28 01:52:47,839][106226] Updated weights for policy 0, policy_version 921797 (0.0005) [2023-12-28 01:52:48,354][106225] Updated weights for policy 1, policy_version 924234 (0.0007) [2023-12-28 01:52:48,418][106225] Updated weights for policy 1, policy_version 924244 (0.0010) [2023-12-28 01:52:48,476][106225] Updated weights for policy 1, policy_version 924254 (0.0008) [2023-12-28 01:52:48,490][106226] Updated weights for policy 0, policy_version 921807 (0.0006) [2023-12-28 01:52:48,557][106226] Updated weights for policy 0, policy_version 921817 (0.0009) [2023-12-28 01:52:48,626][106226] Updated weights for policy 0, policy_version 921827 (0.0008) [2023-12-28 01:52:49,121][106225] Updated weights for policy 1, policy_version 924264 (0.0009) [2023-12-28 01:52:49,175][106225] Updated weights for policy 1, policy_version 924274 (0.0010) [2023-12-28 01:52:49,233][106225] Updated weights for policy 1, policy_version 924284 (0.0010) [2023-12-28 01:52:49,292][106226] Updated weights for policy 0, policy_version 921837 (0.0008) [2023-12-28 01:52:49,361][106226] Updated weights for policy 0, policy_version 921847 (0.0009) [2023-12-28 01:52:49,428][106226] Updated weights for policy 0, policy_version 921857 (0.0008) [2023-12-28 01:52:49,998][106225] Updated weights for policy 1, policy_version 924294 (0.0010) [2023-12-28 01:52:50,058][106225] Updated weights for policy 1, policy_version 924304 (0.0009) [2023-12-28 01:52:50,115][106225] Updated weights for policy 1, policy_version 924314 (0.0008) [2023-12-28 01:52:50,178][106226] Updated weights for policy 0, policy_version 921867 (0.0009) [2023-12-28 01:52:50,235][106226] Updated weights for policy 0, policy_version 921877 (0.0008) [2023-12-28 01:52:50,298][106226] Updated weights for policy 0, policy_version 921887 (0.0009) [2023-12-28 01:52:50,747][106225] Updated weights for policy 1, policy_version 924324 (0.0008) [2023-12-28 01:52:50,802][106225] Updated weights for policy 1, policy_version 924334 (0.0008) [2023-12-28 01:52:50,863][106225] Updated weights for policy 1, policy_version 924344 (0.0008) [2023-12-28 01:52:51,082][106226] Updated weights for policy 0, policy_version 921897 (0.0010) [2023-12-28 01:52:51,143][106226] Updated weights for policy 0, policy_version 921907 (0.0009) [2023-12-28 01:52:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 472735744. Throughput: 0: 9853.2, 1: 9723.0. Samples: 472746788. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:51,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.807')] [2023-12-28 01:52:51,210][106226] Updated weights for policy 0, policy_version 921917 (0.0007) [2023-12-28 01:52:51,277][106226] Updated weights for policy 0, policy_version 921927 (0.0008) [2023-12-28 01:52:51,646][106225] Updated weights for policy 1, policy_version 924354 (0.0007) [2023-12-28 01:52:51,707][106225] Updated weights for policy 1, policy_version 924364 (0.0008) [2023-12-28 01:52:51,781][106225] Updated weights for policy 1, policy_version 924374 (0.0008) [2023-12-28 01:52:51,838][106225] Updated weights for policy 1, policy_version 924384 (0.0008) [2023-12-28 01:52:52,066][106226] Updated weights for policy 0, policy_version 921937 (0.0009) [2023-12-28 01:52:52,129][106226] Updated weights for policy 0, policy_version 921947 (0.0008) [2023-12-28 01:52:52,187][106226] Updated weights for policy 0, policy_version 921957 (0.0008) [2023-12-28 01:52:52,556][106225] Updated weights for policy 1, policy_version 924394 (0.0010) [2023-12-28 01:52:52,614][106225] Updated weights for policy 1, policy_version 924404 (0.0010) [2023-12-28 01:52:52,678][106225] Updated weights for policy 1, policy_version 924414 (0.0010) [2023-12-28 01:52:52,971][106226] Updated weights for policy 0, policy_version 921967 (0.0008) [2023-12-28 01:52:53,025][106226] Updated weights for policy 0, policy_version 921977 (0.0008) [2023-12-28 01:52:53,075][106226] Updated weights for policy 0, policy_version 921987 (0.0008) [2023-12-28 01:52:53,391][106225] Updated weights for policy 1, policy_version 924424 (0.0008) [2023-12-28 01:52:53,449][106225] Updated weights for policy 1, policy_version 924434 (0.0008) [2023-12-28 01:52:53,506][106225] Updated weights for policy 1, policy_version 924444 (0.0009) [2023-12-28 01:52:53,863][106226] Updated weights for policy 0, policy_version 921997 (0.0008) [2023-12-28 01:52:53,919][106226] Updated weights for policy 0, policy_version 922007 (0.0009) [2023-12-28 01:52:53,984][106226] Updated weights for policy 0, policy_version 922017 (0.0008) [2023-12-28 01:52:54,165][106225] Updated weights for policy 1, policy_version 924454 (0.0006) [2023-12-28 01:52:54,222][106225] Updated weights for policy 1, policy_version 924464 (0.0007) [2023-12-28 01:52:54,277][106225] Updated weights for policy 1, policy_version 924474 (0.0005) [2023-12-28 01:52:54,602][106226] Updated weights for policy 0, policy_version 922027 (0.0008) [2023-12-28 01:52:54,650][106226] Updated weights for policy 0, policy_version 922037 (0.0005) [2023-12-28 01:52:54,693][106226] Updated weights for policy 0, policy_version 922047 (0.0005) [2023-12-28 01:52:54,914][106225] Updated weights for policy 1, policy_version 924484 (0.0007) [2023-12-28 01:52:54,976][106225] Updated weights for policy 1, policy_version 924494 (0.0007) [2023-12-28 01:52:55,029][106225] Updated weights for policy 1, policy_version 924504 (0.0009) [2023-12-28 01:52:55,316][106226] Updated weights for policy 0, policy_version 922057 (0.0005) [2023-12-28 01:52:55,369][106226] Updated weights for policy 0, policy_version 922067 (0.0005) [2023-12-28 01:52:55,415][106226] Updated weights for policy 0, policy_version 922077 (0.0005) [2023-12-28 01:52:55,470][106226] Updated weights for policy 0, policy_version 922087 (0.0005) [2023-12-28 01:52:55,750][106225] Updated weights for policy 1, policy_version 924514 (0.0006) [2023-12-28 01:52:55,800][106225] Updated weights for policy 1, policy_version 924524 (0.0008) [2023-12-28 01:52:55,856][106225] Updated weights for policy 1, policy_version 924535 (0.0010) [2023-12-28 01:52:55,998][106226] Updated weights for policy 0, policy_version 922097 (0.0008) [2023-12-28 01:52:56,050][106226] Updated weights for policy 0, policy_version 922107 (0.0008) [2023-12-28 01:52:56,101][106226] Updated weights for policy 0, policy_version 922117 (0.0008) [2023-12-28 01:52:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 472842240. Throughput: 0: 9867.0, 1: 9667.5. Samples: 472802160. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:52:56,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.993')] [2023-12-28 01:52:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000922120_236118016.pth... [2023-12-28 01:52:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000924544_236724224.pth... [2023-12-28 01:52:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000920936_235814912.pth [2023-12-28 01:52:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000923392_236429312.pth [2023-12-28 01:52:56,620][106225] Updated weights for policy 1, policy_version 924545 (0.0008) [2023-12-28 01:52:56,670][106225] Updated weights for policy 1, policy_version 924555 (0.0008) [2023-12-28 01:52:56,718][106225] Updated weights for policy 1, policy_version 924565 (0.0008) [2023-12-28 01:52:56,776][106225] Updated weights for policy 1, policy_version 924575 (0.0008) [2023-12-28 01:52:56,824][106226] Updated weights for policy 0, policy_version 922127 (0.0009) [2023-12-28 01:52:56,878][106226] Updated weights for policy 0, policy_version 922137 (0.0006) [2023-12-28 01:52:56,923][106226] Updated weights for policy 0, policy_version 922147 (0.0005) [2023-12-28 01:52:57,483][106225] Updated weights for policy 1, policy_version 924585 (0.0008) [2023-12-28 01:52:57,538][106225] Updated weights for policy 1, policy_version 924595 (0.0008) [2023-12-28 01:52:57,543][106226] Updated weights for policy 0, policy_version 922157 (0.0008) [2023-12-28 01:52:57,591][106225] Updated weights for policy 1, policy_version 924605 (0.0007) [2023-12-28 01:52:57,597][106226] Updated weights for policy 0, policy_version 922167 (0.0010) [2023-12-28 01:52:57,641][106226] Updated weights for policy 0, policy_version 922177 (0.0010) [2023-12-28 01:52:58,282][106225] Updated weights for policy 1, policy_version 924615 (0.0007) [2023-12-28 01:52:58,351][106225] Updated weights for policy 1, policy_version 924625 (0.0007) [2023-12-28 01:52:58,395][106226] Updated weights for policy 0, policy_version 922187 (0.0010) [2023-12-28 01:52:58,414][106225] Updated weights for policy 1, policy_version 924635 (0.0007) [2023-12-28 01:52:58,468][106226] Updated weights for policy 0, policy_version 922197 (0.0007) [2023-12-28 01:52:58,537][106226] Updated weights for policy 0, policy_version 922207 (0.0007) [2023-12-28 01:52:59,254][106225] Updated weights for policy 1, policy_version 924645 (0.0009) [2023-12-28 01:52:59,316][106226] Updated weights for policy 0, policy_version 922217 (0.0009) [2023-12-28 01:52:59,321][106225] Updated weights for policy 1, policy_version 924655 (0.0010) [2023-12-28 01:52:59,384][106226] Updated weights for policy 0, policy_version 922227 (0.0008) [2023-12-28 01:52:59,396][106225] Updated weights for policy 1, policy_version 924665 (0.0008) [2023-12-28 01:52:59,446][106226] Updated weights for policy 0, policy_version 922237 (0.0009) [2023-12-28 01:52:59,497][106226] Updated weights for policy 0, policy_version 922247 (0.0008) [2023-12-28 01:53:00,015][106225] Updated weights for policy 1, policy_version 924675 (0.0008) [2023-12-28 01:53:00,079][106225] Updated weights for policy 1, policy_version 924685 (0.0006) [2023-12-28 01:53:00,143][106225] Updated weights for policy 1, policy_version 924695 (0.0009) [2023-12-28 01:53:00,306][106226] Updated weights for policy 0, policy_version 922257 (0.0009) [2023-12-28 01:53:00,367][106226] Updated weights for policy 0, policy_version 922267 (0.0008) [2023-12-28 01:53:00,429][106226] Updated weights for policy 0, policy_version 922277 (0.0008) [2023-12-28 01:53:00,841][106225] Updated weights for policy 1, policy_version 924705 (0.0007) [2023-12-28 01:53:00,898][106225] Updated weights for policy 1, policy_version 924715 (0.0007) [2023-12-28 01:53:00,948][106225] Updated weights for policy 1, policy_version 924725 (0.0005) [2023-12-28 01:53:01,000][106225] Updated weights for policy 1, policy_version 924735 (0.0005) [2023-12-28 01:53:01,056][106226] Updated weights for policy 0, policy_version 922287 (0.0006) [2023-12-28 01:53:01,113][106226] Updated weights for policy 0, policy_version 922297 (0.0008) [2023-12-28 01:53:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 472932352. Throughput: 0: 10013.2, 1: 9715.0. Samples: 472922936. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:53:01,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-5.061')] [2023-12-28 01:53:01,180][106226] Updated weights for policy 0, policy_version 922307 (0.0009) [2023-12-28 01:53:01,633][106225] Updated weights for policy 1, policy_version 924745 (0.0008) [2023-12-28 01:53:01,699][106225] Updated weights for policy 1, policy_version 924755 (0.0008) [2023-12-28 01:53:01,762][106225] Updated weights for policy 1, policy_version 924765 (0.0008) [2023-12-28 01:53:01,884][106226] Updated weights for policy 0, policy_version 922317 (0.0009) [2023-12-28 01:53:01,936][106226] Updated weights for policy 0, policy_version 922327 (0.0010) [2023-12-28 01:53:01,995][106226] Updated weights for policy 0, policy_version 922337 (0.0005) [2023-12-28 01:53:02,540][106225] Updated weights for policy 1, policy_version 924775 (0.0009) [2023-12-28 01:53:02,606][106225] Updated weights for policy 1, policy_version 924785 (0.0007) [2023-12-28 01:53:02,649][106226] Updated weights for policy 0, policy_version 922347 (0.0006) [2023-12-28 01:53:02,659][106225] Updated weights for policy 1, policy_version 924795 (0.0007) [2023-12-28 01:53:02,709][106226] Updated weights for policy 0, policy_version 922357 (0.0008) [2023-12-28 01:53:02,772][106226] Updated weights for policy 0, policy_version 922367 (0.0007) [2023-12-28 01:53:03,337][106225] Updated weights for policy 1, policy_version 924805 (0.0006) [2023-12-28 01:53:03,368][106226] Updated weights for policy 0, policy_version 922377 (0.0006) [2023-12-28 01:53:03,392][106225] Updated weights for policy 1, policy_version 924815 (0.0008) [2023-12-28 01:53:03,422][106226] Updated weights for policy 0, policy_version 922387 (0.0010) [2023-12-28 01:53:03,447][106225] Updated weights for policy 1, policy_version 924825 (0.0007) [2023-12-28 01:53:03,484][106226] Updated weights for policy 0, policy_version 922397 (0.0007) [2023-12-28 01:53:03,539][106226] Updated weights for policy 0, policy_version 922407 (0.0005) [2023-12-28 01:53:04,074][106225] Updated weights for policy 1, policy_version 924835 (0.0007) [2023-12-28 01:53:04,131][106225] Updated weights for policy 1, policy_version 924845 (0.0010) [2023-12-28 01:53:04,173][106226] Updated weights for policy 0, policy_version 922417 (0.0010) [2023-12-28 01:53:04,196][106225] Updated weights for policy 1, policy_version 924855 (0.0011) [2023-12-28 01:53:04,232][106226] Updated weights for policy 0, policy_version 922427 (0.0009) [2023-12-28 01:53:04,296][106226] Updated weights for policy 0, policy_version 922437 (0.0011) [2023-12-28 01:53:04,925][106225] Updated weights for policy 1, policy_version 924865 (0.0011) [2023-12-28 01:53:04,979][106225] Updated weights for policy 1, policy_version 924875 (0.0010) [2023-12-28 01:53:05,010][106226] Updated weights for policy 0, policy_version 922447 (0.0011) [2023-12-28 01:53:05,030][106225] Updated weights for policy 1, policy_version 924885 (0.0007) [2023-12-28 01:53:05,065][106226] Updated weights for policy 0, policy_version 922457 (0.0011) [2023-12-28 01:53:05,084][106225] Updated weights for policy 1, policy_version 924895 (0.0006) [2023-12-28 01:53:05,137][106226] Updated weights for policy 0, policy_version 922467 (0.0011) [2023-12-28 01:53:05,796][106225] Updated weights for policy 1, policy_version 924905 (0.0008) [2023-12-28 01:53:05,843][106226] Updated weights for policy 0, policy_version 922477 (0.0010) [2023-12-28 01:53:05,854][106225] Updated weights for policy 1, policy_version 924915 (0.0005) [2023-12-28 01:53:05,890][106226] Updated weights for policy 0, policy_version 922487 (0.0010) [2023-12-28 01:53:05,919][106225] Updated weights for policy 1, policy_version 924925 (0.0005) [2023-12-28 01:53:05,944][106226] Updated weights for policy 0, policy_version 922497 (0.0011) [2023-12-28 01:53:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 473038848. Throughput: 0: 10005.1, 1: 9810.6. Samples: 473044408. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:53:06,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.022')] [2023-12-28 01:53:06,603][106225] Updated weights for policy 1, policy_version 924935 (0.0010) [2023-12-28 01:53:06,665][106225] Updated weights for policy 1, policy_version 924945 (0.0011) [2023-12-28 01:53:06,679][106226] Updated weights for policy 0, policy_version 922507 (0.0011) [2023-12-28 01:53:06,726][106225] Updated weights for policy 1, policy_version 924955 (0.0010) [2023-12-28 01:53:06,741][106226] Updated weights for policy 0, policy_version 922517 (0.0011) [2023-12-28 01:53:06,799][106226] Updated weights for policy 0, policy_version 922527 (0.0010) [2023-12-28 01:53:07,444][106225] Updated weights for policy 1, policy_version 924965 (0.0008) [2023-12-28 01:53:07,493][106225] Updated weights for policy 1, policy_version 924975 (0.0006) [2023-12-28 01:53:07,525][106226] Updated weights for policy 0, policy_version 922537 (0.0010) [2023-12-28 01:53:07,547][106225] Updated weights for policy 1, policy_version 924985 (0.0005) [2023-12-28 01:53:07,579][106226] Updated weights for policy 0, policy_version 922547 (0.0010) [2023-12-28 01:53:07,637][106226] Updated weights for policy 0, policy_version 922557 (0.0011) [2023-12-28 01:53:07,696][106226] Updated weights for policy 0, policy_version 922567 (0.0011) [2023-12-28 01:53:08,245][106225] Updated weights for policy 1, policy_version 924995 (0.0006) [2023-12-28 01:53:08,303][106225] Updated weights for policy 1, policy_version 925005 (0.0009) [2023-12-28 01:53:08,366][106225] Updated weights for policy 1, policy_version 925015 (0.0008) [2023-12-28 01:53:08,423][106226] Updated weights for policy 0, policy_version 922577 (0.0011) [2023-12-28 01:53:08,483][106226] Updated weights for policy 0, policy_version 922587 (0.0011) [2023-12-28 01:53:08,547][106226] Updated weights for policy 0, policy_version 922597 (0.0010) [2023-12-28 01:53:09,016][106225] Updated weights for policy 1, policy_version 925025 (0.0007) [2023-12-28 01:53:09,084][106225] Updated weights for policy 1, policy_version 925035 (0.0005) [2023-12-28 01:53:09,147][106225] Updated weights for policy 1, policy_version 925045 (0.0006) [2023-12-28 01:53:09,215][106225] Updated weights for policy 1, policy_version 925055 (0.0006) [2023-12-28 01:53:09,259][106226] Updated weights for policy 0, policy_version 922607 (0.0009) [2023-12-28 01:53:09,317][106226] Updated weights for policy 0, policy_version 922617 (0.0009) [2023-12-28 01:53:09,387][106226] Updated weights for policy 0, policy_version 922627 (0.0009) [2023-12-28 01:53:09,829][106225] Updated weights for policy 1, policy_version 925065 (0.0009) [2023-12-28 01:53:09,892][106225] Updated weights for policy 1, policy_version 925075 (0.0010) [2023-12-28 01:53:09,957][106225] Updated weights for policy 1, policy_version 925085 (0.0008) [2023-12-28 01:53:10,161][106226] Updated weights for policy 0, policy_version 922637 (0.0009) [2023-12-28 01:53:10,224][106226] Updated weights for policy 0, policy_version 922647 (0.0007) [2023-12-28 01:53:10,295][106226] Updated weights for policy 0, policy_version 922657 (0.0008) [2023-12-28 01:53:10,666][106225] Updated weights for policy 1, policy_version 925095 (0.0008) [2023-12-28 01:53:10,720][106225] Updated weights for policy 1, policy_version 925105 (0.0009) [2023-12-28 01:53:10,779][106225] Updated weights for policy 1, policy_version 925115 (0.0011) [2023-12-28 01:53:10,983][106226] Updated weights for policy 0, policy_version 922667 (0.0010) [2023-12-28 01:53:11,036][106226] Updated weights for policy 0, policy_version 922677 (0.0007) [2023-12-28 01:53:11,103][106226] Updated weights for policy 0, policy_version 922687 (0.0006) [2023-12-28 01:53:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 473137152. Throughput: 0: 10006.9, 1: 9826.7. Samples: 473102820. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:53:11,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-5.192')] [2023-12-28 01:53:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000925120_236871680.pth... [2023-12-28 01:53:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000922696_236265472.pth... [2023-12-28 01:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000921544_235970560.pth [2023-12-28 01:53:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000923968_236576768.pth [2023-12-28 01:53:11,506][106225] Updated weights for policy 1, policy_version 925125 (0.0007) [2023-12-28 01:53:11,569][106225] Updated weights for policy 1, policy_version 925135 (0.0010) [2023-12-28 01:53:11,630][106225] Updated weights for policy 1, policy_version 925145 (0.0009) [2023-12-28 01:53:11,827][106226] Updated weights for policy 0, policy_version 922697 (0.0008) [2023-12-28 01:53:11,886][106226] Updated weights for policy 0, policy_version 922707 (0.0008) [2023-12-28 01:53:11,944][106226] Updated weights for policy 0, policy_version 922717 (0.0007) [2023-12-28 01:53:12,005][106226] Updated weights for policy 0, policy_version 922727 (0.0008) [2023-12-28 01:53:12,397][106225] Updated weights for policy 1, policy_version 925156 (0.0009) [2023-12-28 01:53:12,456][106225] Updated weights for policy 1, policy_version 925166 (0.0009) [2023-12-28 01:53:12,506][106225] Updated weights for policy 1, policy_version 925176 (0.0008) [2023-12-28 01:53:12,718][106226] Updated weights for policy 0, policy_version 922737 (0.0008) [2023-12-28 01:53:12,780][106226] Updated weights for policy 0, policy_version 922747 (0.0009) [2023-12-28 01:53:12,841][106226] Updated weights for policy 0, policy_version 922757 (0.0009) [2023-12-28 01:53:13,196][106225] Updated weights for policy 1, policy_version 925186 (0.0007) [2023-12-28 01:53:13,250][106225] Updated weights for policy 1, policy_version 925196 (0.0007) [2023-12-28 01:53:13,303][106225] Updated weights for policy 1, policy_version 925206 (0.0008) [2023-12-28 01:53:13,363][106225] Updated weights for policy 1, policy_version 925216 (0.0007) [2023-12-28 01:53:13,635][106226] Updated weights for policy 0, policy_version 922767 (0.0010) [2023-12-28 01:53:13,700][106226] Updated weights for policy 0, policy_version 922777 (0.0008) [2023-12-28 01:53:13,771][106226] Updated weights for policy 0, policy_version 922787 (0.0009) [2023-12-28 01:53:13,989][106225] Updated weights for policy 1, policy_version 925226 (0.0005) [2023-12-28 01:53:14,053][106225] Updated weights for policy 1, policy_version 925236 (0.0006) [2023-12-28 01:53:14,114][106225] Updated weights for policy 1, policy_version 925246 (0.0008) [2023-12-28 01:53:14,468][106226] Updated weights for policy 0, policy_version 922797 (0.0009) [2023-12-28 01:53:14,518][106226] Updated weights for policy 0, policy_version 922807 (0.0010) [2023-12-28 01:53:14,577][106226] Updated weights for policy 0, policy_version 922817 (0.0007) [2023-12-28 01:53:14,820][106225] Updated weights for policy 1, policy_version 925256 (0.0008) [2023-12-28 01:53:14,883][106225] Updated weights for policy 1, policy_version 925266 (0.0008) [2023-12-28 01:53:14,946][106225] Updated weights for policy 1, policy_version 925276 (0.0008) [2023-12-28 01:53:15,260][106226] Updated weights for policy 0, policy_version 922827 (0.0007) [2023-12-28 01:53:15,325][106226] Updated weights for policy 0, policy_version 922837 (0.0011) [2023-12-28 01:53:15,392][106226] Updated weights for policy 0, policy_version 922847 (0.0011) [2023-12-28 01:53:15,617][106225] Updated weights for policy 1, policy_version 925286 (0.0007) [2023-12-28 01:53:15,677][106225] Updated weights for policy 1, policy_version 925296 (0.0009) [2023-12-28 01:53:15,728][106225] Updated weights for policy 1, policy_version 925306 (0.0008) [2023-12-28 01:53:15,998][106226] Updated weights for policy 0, policy_version 922857 (0.0010) [2023-12-28 01:53:16,061][106226] Updated weights for policy 0, policy_version 922867 (0.0005) [2023-12-28 01:53:16,111][106226] Updated weights for policy 0, policy_version 922877 (0.0006) [2023-12-28 01:53:16,166][106226] Updated weights for policy 0, policy_version 922887 (0.0005) [2023-12-28 01:53:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 473235456. Throughput: 0: 9877.1, 1: 9833.2. Samples: 473220104. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:53:16,175][105115] Avg episode reward: [(0, '-4.115'), (1, '-5.088')] [2023-12-28 01:53:16,536][106225] Updated weights for policy 1, policy_version 925316 (0.0008) [2023-12-28 01:53:16,582][106225] Updated weights for policy 1, policy_version 925326 (0.0008) [2023-12-28 01:53:16,634][106225] Updated weights for policy 1, policy_version 925336 (0.0008) [2023-12-28 01:53:16,771][106226] Updated weights for policy 0, policy_version 922897 (0.0007) [2023-12-28 01:53:16,821][106226] Updated weights for policy 0, policy_version 922907 (0.0010) [2023-12-28 01:53:16,870][106226] Updated weights for policy 0, policy_version 922917 (0.0010) [2023-12-28 01:53:17,381][106225] Updated weights for policy 1, policy_version 925346 (0.0009) [2023-12-28 01:53:17,434][106225] Updated weights for policy 1, policy_version 925356 (0.0008) [2023-12-28 01:53:17,492][106225] Updated weights for policy 1, policy_version 925366 (0.0007) [2023-12-28 01:53:17,508][106226] Updated weights for policy 0, policy_version 922927 (0.0011) [2023-12-28 01:53:17,549][106225] Updated weights for policy 1, policy_version 925376 (0.0008) [2023-12-28 01:53:17,561][106226] Updated weights for policy 0, policy_version 922937 (0.0006) [2023-12-28 01:53:17,616][106226] Updated weights for policy 0, policy_version 922947 (0.0005) [2023-12-28 01:53:18,177][106225] Updated weights for policy 1, policy_version 925386 (0.0008) [2023-12-28 01:53:18,239][106225] Updated weights for policy 1, policy_version 925396 (0.0007) [2023-12-28 01:53:18,278][106226] Updated weights for policy 0, policy_version 922957 (0.0008) [2023-12-28 01:53:18,294][106225] Updated weights for policy 1, policy_version 925406 (0.0005) [2023-12-28 01:53:18,346][106226] Updated weights for policy 0, policy_version 922967 (0.0011) [2023-12-28 01:53:18,404][106226] Updated weights for policy 0, policy_version 922977 (0.0010) [2023-12-28 01:53:18,991][106225] Updated weights for policy 1, policy_version 925416 (0.0007) [2023-12-28 01:53:19,055][106225] Updated weights for policy 1, policy_version 925426 (0.0006) [2023-12-28 01:53:19,109][106226] Updated weights for policy 0, policy_version 922987 (0.0009) [2023-12-28 01:53:19,115][106225] Updated weights for policy 1, policy_version 925436 (0.0007) [2023-12-28 01:53:19,163][106226] Updated weights for policy 0, policy_version 922997 (0.0010) [2023-12-28 01:53:19,219][106226] Updated weights for policy 0, policy_version 923007 (0.0009) [2023-12-28 01:53:19,920][106225] Updated weights for policy 1, policy_version 925446 (0.0007) [2023-12-28 01:53:19,935][106226] Updated weights for policy 0, policy_version 923017 (0.0008) [2023-12-28 01:53:19,988][106225] Updated weights for policy 1, policy_version 925456 (0.0009) [2023-12-28 01:53:20,003][106226] Updated weights for policy 0, policy_version 923027 (0.0007) [2023-12-28 01:53:20,053][106225] Updated weights for policy 1, policy_version 925466 (0.0008) [2023-12-28 01:53:20,068][106226] Updated weights for policy 0, policy_version 923037 (0.0006) [2023-12-28 01:53:20,129][106226] Updated weights for policy 0, policy_version 923047 (0.0008) [2023-12-28 01:53:20,777][106225] Updated weights for policy 1, policy_version 925476 (0.0007) [2023-12-28 01:53:20,798][106226] Updated weights for policy 0, policy_version 923057 (0.0006) [2023-12-28 01:53:20,847][106225] Updated weights for policy 1, policy_version 925486 (0.0006) [2023-12-28 01:53:20,867][106226] Updated weights for policy 0, policy_version 923067 (0.0006) [2023-12-28 01:53:20,914][106225] Updated weights for policy 1, policy_version 925496 (0.0008) [2023-12-28 01:53:20,927][106226] Updated weights for policy 0, policy_version 923077 (0.0007) [2023-12-28 01:53:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 473333760. Throughput: 0: 9873.6, 1: 9815.0. Samples: 473340032. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 01:53:21,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.870')] [2023-12-28 01:53:21,597][106226] Updated weights for policy 0, policy_version 923087 (0.0006) [2023-12-28 01:53:21,659][106226] Updated weights for policy 0, policy_version 923097 (0.0008) [2023-12-28 01:53:21,683][106225] Updated weights for policy 1, policy_version 925506 (0.0007) [2023-12-28 01:53:21,728][106226] Updated weights for policy 0, policy_version 923107 (0.0009) [2023-12-28 01:53:21,752][106225] Updated weights for policy 1, policy_version 925516 (0.0007) [2023-12-28 01:53:21,813][106225] Updated weights for policy 1, policy_version 925526 (0.0009) [2023-12-28 01:53:21,868][106225] Updated weights for policy 1, policy_version 925536 (0.0009) [2023-12-28 01:53:22,340][106226] Updated weights for policy 0, policy_version 923117 (0.0008) [2023-12-28 01:53:22,404][106226] Updated weights for policy 0, policy_version 923127 (0.0009) [2023-12-28 01:53:22,464][106226] Updated weights for policy 0, policy_version 923137 (0.0009) [2023-12-28 01:53:22,648][106225] Updated weights for policy 1, policy_version 925546 (0.0008) [2023-12-28 01:53:22,711][106225] Updated weights for policy 1, policy_version 925556 (0.0008) [2023-12-28 01:53:22,776][106225] Updated weights for policy 1, policy_version 925566 (0.0008) [2023-12-28 01:53:23,195][106226] Updated weights for policy 0, policy_version 923147 (0.0008) [2023-12-28 01:53:23,259][106226] Updated weights for policy 0, policy_version 923157 (0.0007) [2023-12-28 01:53:23,307][106226] Updated weights for policy 0, policy_version 923167 (0.0007) [2023-12-28 01:53:23,569][106225] Updated weights for policy 1, policy_version 925576 (0.0009) [2023-12-28 01:53:23,634][106225] Updated weights for policy 1, policy_version 925586 (0.0008) [2023-12-28 01:53:23,695][106225] Updated weights for policy 1, policy_version 925596 (0.0008) [2023-12-28 01:53:24,014][106226] Updated weights for policy 0, policy_version 923177 (0.0009) [2023-12-28 01:53:24,081][106226] Updated weights for policy 0, policy_version 923187 (0.0008) [2023-12-28 01:53:24,146][106226] Updated weights for policy 0, policy_version 923197 (0.0008) [2023-12-28 01:53:24,195][106226] Updated weights for policy 0, policy_version 923207 (0.0008) [2023-12-28 01:53:24,449][106225] Updated weights for policy 1, policy_version 925606 (0.0009) [2023-12-28 01:53:24,513][106225] Updated weights for policy 1, policy_version 925616 (0.0009) [2023-12-28 01:53:24,579][106225] Updated weights for policy 1, policy_version 925626 (0.0009) [2023-12-28 01:53:24,793][106226] Updated weights for policy 0, policy_version 923217 (0.0007) [2023-12-28 01:53:24,853][106226] Updated weights for policy 0, policy_version 923227 (0.0005) [2023-12-28 01:53:24,914][106226] Updated weights for policy 0, policy_version 923237 (0.0007) [2023-12-28 01:53:25,304][106225] Updated weights for policy 1, policy_version 925636 (0.0007) [2023-12-28 01:53:25,351][106225] Updated weights for policy 1, policy_version 925646 (0.0007) [2023-12-28 01:53:25,399][106225] Updated weights for policy 1, policy_version 925656 (0.0008) [2023-12-28 01:53:25,600][106226] Updated weights for policy 0, policy_version 923247 (0.0008) [2023-12-28 01:53:25,648][106226] Updated weights for policy 0, policy_version 923257 (0.0008) [2023-12-28 01:53:25,699][106226] Updated weights for policy 0, policy_version 923267 (0.0009) [2023-12-28 01:53:26,106][106225] Updated weights for policy 1, policy_version 925666 (0.0008) [2023-12-28 01:53:26,152][106225] Updated weights for policy 1, policy_version 925676 (0.0008) [2023-12-28 01:53:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 473423872. Throughput: 0: 9901.3, 1: 9733.2. Samples: 473396496. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:26,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-4.932')] [2023-12-28 01:53:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000923272_236412928.pth... [2023-12-28 01:53:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000922120_236118016.pth [2023-12-28 01:53:26,207][106225] Updated weights for policy 1, policy_version 925686 (0.0008) [2023-12-28 01:53:26,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000925696_237019136.pth... [2023-12-28 01:53:26,256][106225] Updated weights for policy 1, policy_version 925696 (0.0008) [2023-12-28 01:53:26,257][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000924544_236724224.pth [2023-12-28 01:53:26,451][106226] Updated weights for policy 0, policy_version 923277 (0.0008) [2023-12-28 01:53:26,502][106226] Updated weights for policy 0, policy_version 923287 (0.0008) [2023-12-28 01:53:26,546][106226] Updated weights for policy 0, policy_version 923297 (0.0008) [2023-12-28 01:53:26,962][106225] Updated weights for policy 1, policy_version 925706 (0.0010) [2023-12-28 01:53:27,021][106225] Updated weights for policy 1, policy_version 925716 (0.0010) [2023-12-28 01:53:27,086][106225] Updated weights for policy 1, policy_version 925726 (0.0010) [2023-12-28 01:53:27,176][106226] Updated weights for policy 0, policy_version 923307 (0.0007) [2023-12-28 01:53:27,238][106226] Updated weights for policy 0, policy_version 923317 (0.0005) [2023-12-28 01:53:27,290][106226] Updated weights for policy 0, policy_version 923327 (0.0007) [2023-12-28 01:53:27,644][106225] Updated weights for policy 1, policy_version 925736 (0.0009) [2023-12-28 01:53:27,700][106225] Updated weights for policy 1, policy_version 925746 (0.0010) [2023-12-28 01:53:27,757][106225] Updated weights for policy 1, policy_version 925756 (0.0010) [2023-12-28 01:53:27,833][106226] Updated weights for policy 0, policy_version 923337 (0.0009) [2023-12-28 01:53:27,895][106226] Updated weights for policy 0, policy_version 923347 (0.0005) [2023-12-28 01:53:27,951][106226] Updated weights for policy 0, policy_version 923357 (0.0009) [2023-12-28 01:53:28,011][106226] Updated weights for policy 0, policy_version 923367 (0.0011) [2023-12-28 01:53:28,385][106225] Updated weights for policy 1, policy_version 925766 (0.0009) [2023-12-28 01:53:28,444][106225] Updated weights for policy 1, policy_version 925776 (0.0008) [2023-12-28 01:53:28,505][106225] Updated weights for policy 1, policy_version 925786 (0.0008) [2023-12-28 01:53:28,561][106226] Updated weights for policy 0, policy_version 923377 (0.0008) [2023-12-28 01:53:28,635][106226] Updated weights for policy 0, policy_version 923387 (0.0010) [2023-12-28 01:53:28,704][106226] Updated weights for policy 0, policy_version 923397 (0.0009) [2023-12-28 01:53:29,117][106225] Updated weights for policy 1, policy_version 925796 (0.0006) [2023-12-28 01:53:29,180][106225] Updated weights for policy 1, policy_version 925806 (0.0007) [2023-12-28 01:53:29,245][106225] Updated weights for policy 1, policy_version 925816 (0.0008) [2023-12-28 01:53:29,490][106226] Updated weights for policy 0, policy_version 923407 (0.0008) [2023-12-28 01:53:29,556][106226] Updated weights for policy 0, policy_version 923417 (0.0007) [2023-12-28 01:53:29,615][106226] Updated weights for policy 0, policy_version 923427 (0.0009) [2023-12-28 01:53:29,898][106225] Updated weights for policy 1, policy_version 925826 (0.0008) [2023-12-28 01:53:29,967][106225] Updated weights for policy 1, policy_version 925836 (0.0008) [2023-12-28 01:53:30,031][106225] Updated weights for policy 1, policy_version 925846 (0.0008) [2023-12-28 01:53:30,090][106225] Updated weights for policy 1, policy_version 925856 (0.0008) [2023-12-28 01:53:30,328][106226] Updated weights for policy 0, policy_version 923437 (0.0008) [2023-12-28 01:53:30,382][106226] Updated weights for policy 0, policy_version 923447 (0.0008) [2023-12-28 01:53:30,443][106226] Updated weights for policy 0, policy_version 923457 (0.0008) [2023-12-28 01:53:30,837][106225] Updated weights for policy 1, policy_version 925866 (0.0009) [2023-12-28 01:53:30,890][106225] Updated weights for policy 1, policy_version 925876 (0.0008) [2023-12-28 01:53:30,946][106225] Updated weights for policy 1, policy_version 925886 (0.0008) [2023-12-28 01:53:30,980][106226] Updated weights for policy 0, policy_version 923467 (0.0005) [2023-12-28 01:53:31,044][106226] Updated weights for policy 0, policy_version 923477 (0.0007) [2023-12-28 01:53:31,101][106226] Updated weights for policy 0, policy_version 923487 (0.0009) [2023-12-28 01:53:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 473538560. Throughput: 0: 10019.2, 1: 9860.6. Samples: 473521792. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:31,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.734')] [2023-12-28 01:53:31,752][106225] Updated weights for policy 1, policy_version 925896 (0.0008) [2023-12-28 01:53:31,812][106226] Updated weights for policy 0, policy_version 923497 (0.0008) [2023-12-28 01:53:31,817][106225] Updated weights for policy 1, policy_version 925906 (0.0008) [2023-12-28 01:53:31,874][106225] Updated weights for policy 1, policy_version 925916 (0.0008) [2023-12-28 01:53:31,875][106226] Updated weights for policy 0, policy_version 923507 (0.0005) [2023-12-28 01:53:31,932][106226] Updated weights for policy 0, policy_version 923517 (0.0005) [2023-12-28 01:53:31,995][106226] Updated weights for policy 0, policy_version 923527 (0.0007) [2023-12-28 01:53:32,643][106225] Updated weights for policy 1, policy_version 925926 (0.0008) [2023-12-28 01:53:32,698][106225] Updated weights for policy 1, policy_version 925936 (0.0006) [2023-12-28 01:53:32,699][106226] Updated weights for policy 0, policy_version 923537 (0.0010) [2023-12-28 01:53:32,751][106225] Updated weights for policy 1, policy_version 925946 (0.0005) [2023-12-28 01:53:32,760][106226] Updated weights for policy 0, policy_version 923547 (0.0011) [2023-12-28 01:53:32,810][106226] Updated weights for policy 0, policy_version 923557 (0.0010) [2023-12-28 01:53:33,314][106225] Updated weights for policy 1, policy_version 925956 (0.0007) [2023-12-28 01:53:33,379][106225] Updated weights for policy 1, policy_version 925966 (0.0005) [2023-12-28 01:53:33,466][106225] Updated weights for policy 1, policy_version 925976 (0.0006) [2023-12-28 01:53:33,494][106226] Updated weights for policy 0, policy_version 923567 (0.0009) [2023-12-28 01:53:33,557][106226] Updated weights for policy 0, policy_version 923577 (0.0010) [2023-12-28 01:53:33,612][106226] Updated weights for policy 0, policy_version 923587 (0.0010) [2023-12-28 01:53:34,074][106225] Updated weights for policy 1, policy_version 925986 (0.0010) [2023-12-28 01:53:34,139][106225] Updated weights for policy 1, policy_version 925996 (0.0010) [2023-12-28 01:53:34,209][106225] Updated weights for policy 1, policy_version 926006 (0.0009) [2023-12-28 01:53:34,270][106225] Updated weights for policy 1, policy_version 926016 (0.0009) [2023-12-28 01:53:34,345][106226] Updated weights for policy 0, policy_version 923597 (0.0010) [2023-12-28 01:53:34,405][106226] Updated weights for policy 0, policy_version 923607 (0.0009) [2023-12-28 01:53:34,470][106226] Updated weights for policy 0, policy_version 923617 (0.0009) [2023-12-28 01:53:35,013][106225] Updated weights for policy 1, policy_version 926026 (0.0007) [2023-12-28 01:53:35,072][106225] Updated weights for policy 1, policy_version 926036 (0.0007) [2023-12-28 01:53:35,126][106225] Updated weights for policy 1, policy_version 926046 (0.0007) [2023-12-28 01:53:35,249][106226] Updated weights for policy 0, policy_version 923627 (0.0010) [2023-12-28 01:53:35,315][106226] Updated weights for policy 0, policy_version 923637 (0.0009) [2023-12-28 01:53:35,364][106226] Updated weights for policy 0, policy_version 923647 (0.0009) [2023-12-28 01:53:35,790][106225] Updated weights for policy 1, policy_version 926056 (0.0010) [2023-12-28 01:53:35,841][106225] Updated weights for policy 1, policy_version 926066 (0.0010) [2023-12-28 01:53:35,897][106225] Updated weights for policy 1, policy_version 926076 (0.0010) [2023-12-28 01:53:36,015][106226] Updated weights for policy 0, policy_version 923657 (0.0009) [2023-12-28 01:53:36,070][106226] Updated weights for policy 0, policy_version 923667 (0.0009) [2023-12-28 01:53:36,127][106226] Updated weights for policy 0, policy_version 923677 (0.0009) [2023-12-28 01:53:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 473628672. Throughput: 0: 10031.4, 1: 9831.9. Samples: 473640636. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:36,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.797')] [2023-12-28 01:53:36,195][106226] Updated weights for policy 0, policy_version 923687 (0.0010) [2023-12-28 01:53:36,571][106225] Updated weights for policy 1, policy_version 926086 (0.0007) [2023-12-28 01:53:36,633][106225] Updated weights for policy 1, policy_version 926096 (0.0007) [2023-12-28 01:53:36,695][106225] Updated weights for policy 1, policy_version 926106 (0.0009) [2023-12-28 01:53:37,054][106226] Updated weights for policy 0, policy_version 923697 (0.0008) [2023-12-28 01:53:37,106][106226] Updated weights for policy 0, policy_version 923707 (0.0008) [2023-12-28 01:53:37,163][106226] Updated weights for policy 0, policy_version 923717 (0.0008) [2023-12-28 01:53:37,341][106225] Updated weights for policy 1, policy_version 926116 (0.0009) [2023-12-28 01:53:37,391][106225] Updated weights for policy 1, policy_version 926126 (0.0007) [2023-12-28 01:53:37,441][106225] Updated weights for policy 1, policy_version 926136 (0.0008) [2023-12-28 01:53:37,936][106226] Updated weights for policy 0, policy_version 923727 (0.0008) [2023-12-28 01:53:38,000][106226] Updated weights for policy 0, policy_version 923737 (0.0008) [2023-12-28 01:53:38,068][106226] Updated weights for policy 0, policy_version 923747 (0.0006) [2023-12-28 01:53:38,095][106225] Updated weights for policy 1, policy_version 926146 (0.0007) [2023-12-28 01:53:38,162][106225] Updated weights for policy 1, policy_version 926156 (0.0010) [2023-12-28 01:53:38,226][106225] Updated weights for policy 1, policy_version 926166 (0.0010) [2023-12-28 01:53:38,291][106225] Updated weights for policy 1, policy_version 926176 (0.0011) [2023-12-28 01:53:38,778][106226] Updated weights for policy 0, policy_version 923757 (0.0008) [2023-12-28 01:53:38,838][106226] Updated weights for policy 0, policy_version 923767 (0.0009) [2023-12-28 01:53:38,888][106226] Updated weights for policy 0, policy_version 923777 (0.0009) [2023-12-28 01:53:38,995][106225] Updated weights for policy 1, policy_version 926186 (0.0008) [2023-12-28 01:53:39,040][106225] Updated weights for policy 1, policy_version 926196 (0.0008) [2023-12-28 01:53:39,091][106225] Updated weights for policy 1, policy_version 926206 (0.0007) [2023-12-28 01:53:39,638][106226] Updated weights for policy 0, policy_version 923787 (0.0008) [2023-12-28 01:53:39,703][106226] Updated weights for policy 0, policy_version 923797 (0.0011) [2023-12-28 01:53:39,764][106226] Updated weights for policy 0, policy_version 923807 (0.0010) [2023-12-28 01:53:39,925][106225] Updated weights for policy 1, policy_version 926216 (0.0010) [2023-12-28 01:53:39,989][106225] Updated weights for policy 1, policy_version 926226 (0.0010) [2023-12-28 01:53:40,051][106225] Updated weights for policy 1, policy_version 926236 (0.0010) [2023-12-28 01:53:40,538][106226] Updated weights for policy 0, policy_version 923817 (0.0010) [2023-12-28 01:53:40,606][106226] Updated weights for policy 0, policy_version 923827 (0.0011) [2023-12-28 01:53:40,667][106226] Updated weights for policy 0, policy_version 923837 (0.0011) [2023-12-28 01:53:40,732][106226] Updated weights for policy 0, policy_version 923847 (0.0008) [2023-12-28 01:53:40,797][106225] Updated weights for policy 1, policy_version 926246 (0.0009) [2023-12-28 01:53:40,858][106225] Updated weights for policy 1, policy_version 926256 (0.0005) [2023-12-28 01:53:40,914][106225] Updated weights for policy 1, policy_version 926266 (0.0008) [2023-12-28 01:53:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 473726976. Throughput: 0: 10029.4, 1: 9891.4. Samples: 473698600. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:41,176][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.195')] [2023-12-28 01:53:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000926272_237166592.pth... [2023-12-28 01:53:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000923848_236560384.pth... [2023-12-28 01:53:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000925120_236871680.pth [2023-12-28 01:53:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000922696_236265472.pth [2023-12-28 01:53:41,190][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000926272_237166592.pth [2023-12-28 01:53:41,190][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000923848_236560384.pth [2023-12-28 01:53:41,477][106226] Updated weights for policy 0, policy_version 923857 (0.0008) [2023-12-28 01:53:41,534][106226] Updated weights for policy 0, policy_version 923867 (0.0008) [2023-12-28 01:53:41,600][106226] Updated weights for policy 0, policy_version 923877 (0.0010) [2023-12-28 01:53:41,603][106225] Updated weights for policy 1, policy_version 926276 (0.0010) [2023-12-28 01:53:41,669][106225] Updated weights for policy 1, policy_version 926286 (0.0007) [2023-12-28 01:53:41,737][106225] Updated weights for policy 1, policy_version 926296 (0.0008) [2023-12-28 01:53:42,246][106226] Updated weights for policy 0, policy_version 923887 (0.0008) [2023-12-28 01:53:42,310][106226] Updated weights for policy 0, policy_version 923897 (0.0010) [2023-12-28 01:53:42,374][106226] Updated weights for policy 0, policy_version 923907 (0.0009) [2023-12-28 01:53:42,613][106225] Updated weights for policy 1, policy_version 926306 (0.0008) [2023-12-28 01:53:42,669][106225] Updated weights for policy 1, policy_version 926316 (0.0010) [2023-12-28 01:53:42,724][106225] Updated weights for policy 1, policy_version 926326 (0.0009) [2023-12-28 01:53:42,776][106225] Updated weights for policy 1, policy_version 926336 (0.0005) [2023-12-28 01:53:43,026][106226] Updated weights for policy 0, policy_version 923917 (0.0008) [2023-12-28 01:53:43,079][106226] Updated weights for policy 0, policy_version 923927 (0.0009) [2023-12-28 01:53:43,130][106226] Updated weights for policy 0, policy_version 923937 (0.0008) [2023-12-28 01:53:43,429][106225] Updated weights for policy 1, policy_version 926346 (0.0010) [2023-12-28 01:53:43,495][106225] Updated weights for policy 1, policy_version 926356 (0.0010) [2023-12-28 01:53:43,545][106225] Updated weights for policy 1, policy_version 926366 (0.0010) [2023-12-28 01:53:43,765][106226] Updated weights for policy 0, policy_version 923947 (0.0009) [2023-12-28 01:53:43,823][106226] Updated weights for policy 0, policy_version 923957 (0.0008) [2023-12-28 01:53:43,889][106226] Updated weights for policy 0, policy_version 923967 (0.0010) [2023-12-28 01:53:44,217][106225] Updated weights for policy 1, policy_version 926376 (0.0008) [2023-12-28 01:53:44,263][106225] Updated weights for policy 1, policy_version 926386 (0.0006) [2023-12-28 01:53:44,326][106225] Updated weights for policy 1, policy_version 926396 (0.0005) [2023-12-28 01:53:44,541][106226] Updated weights for policy 0, policy_version 923977 (0.0010) [2023-12-28 01:53:44,590][106226] Updated weights for policy 0, policy_version 923987 (0.0005) [2023-12-28 01:53:44,652][106226] Updated weights for policy 0, policy_version 923997 (0.0008) [2023-12-28 01:53:44,719][106226] Updated weights for policy 0, policy_version 924007 (0.0008) [2023-12-28 01:53:44,981][106225] Updated weights for policy 1, policy_version 926406 (0.0006) [2023-12-28 01:53:45,045][106225] Updated weights for policy 1, policy_version 926416 (0.0008) [2023-12-28 01:53:45,107][106225] Updated weights for policy 1, policy_version 926426 (0.0008) [2023-12-28 01:53:45,456][106226] Updated weights for policy 0, policy_version 924017 (0.0006) [2023-12-28 01:53:45,517][106226] Updated weights for policy 0, policy_version 924027 (0.0008) [2023-12-28 01:53:45,575][106226] Updated weights for policy 0, policy_version 924037 (0.0007) [2023-12-28 01:53:45,844][106225] Updated weights for policy 1, policy_version 926436 (0.0010) [2023-12-28 01:53:45,911][106225] Updated weights for policy 1, policy_version 926446 (0.0011) [2023-12-28 01:53:45,967][106225] Updated weights for policy 1, policy_version 926456 (0.0006) [2023-12-28 01:53:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 473825280. Throughput: 0: 9979.1, 1: 9868.0. Samples: 473816056. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:46,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-5.104')] [2023-12-28 01:53:46,185][106226] Updated weights for policy 0, policy_version 924047 (0.0006) [2023-12-28 01:53:46,249][106226] Updated weights for policy 0, policy_version 924057 (0.0006) [2023-12-28 01:53:46,307][106226] Updated weights for policy 0, policy_version 924067 (0.0005) [2023-12-28 01:53:46,680][106225] Updated weights for policy 1, policy_version 926466 (0.0007) [2023-12-28 01:53:46,732][106225] Updated weights for policy 1, policy_version 926476 (0.0008) [2023-12-28 01:53:46,780][106225] Updated weights for policy 1, policy_version 926486 (0.0008) [2023-12-28 01:53:46,829][106225] Updated weights for policy 1, policy_version 926496 (0.0008) [2023-12-28 01:53:46,860][106226] Updated weights for policy 0, policy_version 924077 (0.0006) [2023-12-28 01:53:46,912][106226] Updated weights for policy 0, policy_version 924087 (0.0008) [2023-12-28 01:53:46,962][106226] Updated weights for policy 0, policy_version 924097 (0.0008) [2023-12-28 01:53:47,550][106225] Updated weights for policy 1, policy_version 926506 (0.0005) [2023-12-28 01:53:47,601][106225] Updated weights for policy 1, policy_version 926516 (0.0007) [2023-12-28 01:53:47,627][106226] Updated weights for policy 0, policy_version 924107 (0.0007) [2023-12-28 01:53:47,646][106225] Updated weights for policy 1, policy_version 926526 (0.0010) [2023-12-28 01:53:47,677][106226] Updated weights for policy 0, policy_version 924117 (0.0005) [2023-12-28 01:53:47,731][106226] Updated weights for policy 0, policy_version 924127 (0.0005) [2023-12-28 01:53:48,267][106225] Updated weights for policy 1, policy_version 926536 (0.0006) [2023-12-28 01:53:48,315][106225] Updated weights for policy 1, policy_version 926546 (0.0006) [2023-12-28 01:53:48,324][106226] Updated weights for policy 0, policy_version 924137 (0.0010) [2023-12-28 01:53:48,377][106225] Updated weights for policy 1, policy_version 926556 (0.0007) [2023-12-28 01:53:48,391][106226] Updated weights for policy 0, policy_version 924147 (0.0008) [2023-12-28 01:53:48,450][106226] Updated weights for policy 0, policy_version 924157 (0.0008) [2023-12-28 01:53:48,512][106226] Updated weights for policy 0, policy_version 924167 (0.0008) [2023-12-28 01:53:49,135][106225] Updated weights for policy 1, policy_version 926566 (0.0006) [2023-12-28 01:53:49,167][106226] Updated weights for policy 0, policy_version 924177 (0.0006) [2023-12-28 01:53:49,192][106225] Updated weights for policy 1, policy_version 926576 (0.0006) [2023-12-28 01:53:49,239][106226] Updated weights for policy 0, policy_version 924187 (0.0008) [2023-12-28 01:53:49,259][106225] Updated weights for policy 1, policy_version 926586 (0.0009) [2023-12-28 01:53:49,303][106226] Updated weights for policy 0, policy_version 924197 (0.0008) [2023-12-28 01:53:49,885][106225] Updated weights for policy 1, policy_version 926596 (0.0007) [2023-12-28 01:53:49,953][106225] Updated weights for policy 1, policy_version 926606 (0.0008) [2023-12-28 01:53:50,018][106225] Updated weights for policy 1, policy_version 926616 (0.0008) [2023-12-28 01:53:50,106][106226] Updated weights for policy 0, policy_version 924207 (0.0009) [2023-12-28 01:53:50,172][106226] Updated weights for policy 0, policy_version 924217 (0.0009) [2023-12-28 01:53:50,239][106226] Updated weights for policy 0, policy_version 924227 (0.0006) [2023-12-28 01:53:50,714][106225] Updated weights for policy 1, policy_version 926626 (0.0006) [2023-12-28 01:53:50,782][106225] Updated weights for policy 1, policy_version 926636 (0.0009) [2023-12-28 01:53:50,840][106225] Updated weights for policy 1, policy_version 926646 (0.0009) [2023-12-28 01:53:50,897][106225] Updated weights for policy 1, policy_version 926656 (0.0009) [2023-12-28 01:53:50,901][106226] Updated weights for policy 0, policy_version 924237 (0.0007) [2023-12-28 01:53:50,962][106226] Updated weights for policy 0, policy_version 924247 (0.0006) [2023-12-28 01:53:51,030][106226] Updated weights for policy 0, policy_version 924257 (0.0007) [2023-12-28 01:53:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 473931776. Throughput: 0: 10007.7, 1: 9846.1. Samples: 473937824. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:51,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-5.127')] [2023-12-28 01:53:51,673][106225] Updated weights for policy 1, policy_version 926666 (0.0009) [2023-12-28 01:53:51,700][106226] Updated weights for policy 0, policy_version 924267 (0.0007) [2023-12-28 01:53:51,748][106225] Updated weights for policy 1, policy_version 926676 (0.0009) [2023-12-28 01:53:51,769][106226] Updated weights for policy 0, policy_version 924277 (0.0008) [2023-12-28 01:53:51,811][106225] Updated weights for policy 1, policy_version 926686 (0.0009) [2023-12-28 01:53:51,839][106226] Updated weights for policy 0, policy_version 924287 (0.0006) [2023-12-28 01:53:52,489][106226] Updated weights for policy 0, policy_version 924297 (0.0007) [2023-12-28 01:53:52,523][106225] Updated weights for policy 1, policy_version 926696 (0.0010) [2023-12-28 01:53:52,547][106226] Updated weights for policy 0, policy_version 924307 (0.0006) [2023-12-28 01:53:52,592][106225] Updated weights for policy 1, policy_version 926706 (0.0011) [2023-12-28 01:53:52,602][106226] Updated weights for policy 0, policy_version 924317 (0.0006) [2023-12-28 01:53:52,654][106225] Updated weights for policy 1, policy_version 926716 (0.0010) [2023-12-28 01:53:52,662][106226] Updated weights for policy 0, policy_version 924327 (0.0005) [2023-12-28 01:53:53,241][106226] Updated weights for policy 0, policy_version 924337 (0.0006) [2023-12-28 01:53:53,292][106226] Updated weights for policy 0, policy_version 924347 (0.0008) [2023-12-28 01:53:53,352][106225] Updated weights for policy 1, policy_version 926726 (0.0008) [2023-12-28 01:53:53,355][106226] Updated weights for policy 0, policy_version 924357 (0.0008) [2023-12-28 01:53:53,421][106225] Updated weights for policy 1, policy_version 926736 (0.0008) [2023-12-28 01:53:53,485][106225] Updated weights for policy 1, policy_version 926746 (0.0008) [2023-12-28 01:53:54,105][106226] Updated weights for policy 0, policy_version 924367 (0.0007) [2023-12-28 01:53:54,158][106225] Updated weights for policy 1, policy_version 926756 (0.0007) [2023-12-28 01:53:54,167][106226] Updated weights for policy 0, policy_version 924377 (0.0008) [2023-12-28 01:53:54,212][106225] Updated weights for policy 1, policy_version 926766 (0.0006) [2023-12-28 01:53:54,225][106226] Updated weights for policy 0, policy_version 924387 (0.0009) [2023-12-28 01:53:54,273][106225] Updated weights for policy 1, policy_version 926776 (0.0006) [2023-12-28 01:53:54,816][106226] Updated weights for policy 0, policy_version 924397 (0.0008) [2023-12-28 01:53:54,873][106225] Updated weights for policy 1, policy_version 926786 (0.0006) [2023-12-28 01:53:54,882][106226] Updated weights for policy 0, policy_version 924407 (0.0010) [2023-12-28 01:53:54,944][106225] Updated weights for policy 1, policy_version 926796 (0.0005) [2023-12-28 01:53:54,946][106226] Updated weights for policy 0, policy_version 924417 (0.0009) [2023-12-28 01:53:55,006][106225] Updated weights for policy 1, policy_version 926806 (0.0007) [2023-12-28 01:53:55,060][106225] Updated weights for policy 1, policy_version 926816 (0.0007) [2023-12-28 01:53:55,653][106226] Updated weights for policy 0, policy_version 924427 (0.0011) [2023-12-28 01:53:55,716][106226] Updated weights for policy 0, policy_version 924437 (0.0008) [2023-12-28 01:53:55,720][106225] Updated weights for policy 1, policy_version 926826 (0.0005) [2023-12-28 01:53:55,767][106225] Updated weights for policy 1, policy_version 926836 (0.0005) [2023-12-28 01:53:55,780][106226] Updated weights for policy 0, policy_version 924447 (0.0009) [2023-12-28 01:53:55,818][106225] Updated weights for policy 1, policy_version 926846 (0.0008) [2023-12-28 01:53:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 474030080. Throughput: 0: 10042.3, 1: 9811.8. Samples: 473996252. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:53:56,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.864')] [2023-12-28 01:53:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000926848_237314048.pth... [2023-12-28 01:53:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000924456_236716032.pth... [2023-12-28 01:53:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000923272_236412928.pth [2023-12-28 01:53:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000925696_237019136.pth [2023-12-28 01:53:56,324][106226] Updated weights for policy 0, policy_version 924457 (0.0005) [2023-12-28 01:53:56,393][106226] Updated weights for policy 0, policy_version 924467 (0.0006) [2023-12-28 01:53:56,458][106226] Updated weights for policy 0, policy_version 924477 (0.0005) [2023-12-28 01:53:56,522][106226] Updated weights for policy 0, policy_version 924487 (0.0006) [2023-12-28 01:53:56,625][106225] Updated weights for policy 1, policy_version 926856 (0.0006) [2023-12-28 01:53:56,677][106225] Updated weights for policy 1, policy_version 926866 (0.0005) [2023-12-28 01:53:56,723][106225] Updated weights for policy 1, policy_version 926876 (0.0007) [2023-12-28 01:53:57,095][106226] Updated weights for policy 0, policy_version 924497 (0.0008) [2023-12-28 01:53:57,142][106226] Updated weights for policy 0, policy_version 924507 (0.0010) [2023-12-28 01:53:57,199][106226] Updated weights for policy 0, policy_version 924517 (0.0010) [2023-12-28 01:53:57,353][106225] Updated weights for policy 1, policy_version 926886 (0.0008) [2023-12-28 01:53:57,406][106225] Updated weights for policy 1, policy_version 926896 (0.0007) [2023-12-28 01:53:57,459][106225] Updated weights for policy 1, policy_version 926906 (0.0008) [2023-12-28 01:53:57,836][106226] Updated weights for policy 0, policy_version 924527 (0.0007) [2023-12-28 01:53:57,886][106226] Updated weights for policy 0, policy_version 924537 (0.0005) [2023-12-28 01:53:57,938][106226] Updated weights for policy 0, policy_version 924547 (0.0007) [2023-12-28 01:53:58,145][106225] Updated weights for policy 1, policy_version 926916 (0.0008) [2023-12-28 01:53:58,203][106225] Updated weights for policy 1, policy_version 926926 (0.0005) [2023-12-28 01:53:58,266][106225] Updated weights for policy 1, policy_version 926936 (0.0008) [2023-12-28 01:53:58,667][106226] Updated weights for policy 0, policy_version 924557 (0.0009) [2023-12-28 01:53:58,731][106226] Updated weights for policy 0, policy_version 924567 (0.0008) [2023-12-28 01:53:58,794][106226] Updated weights for policy 0, policy_version 924577 (0.0008) [2023-12-28 01:53:59,055][106225] Updated weights for policy 1, policy_version 926946 (0.0010) [2023-12-28 01:53:59,113][106225] Updated weights for policy 1, policy_version 926956 (0.0009) [2023-12-28 01:53:59,172][106225] Updated weights for policy 1, policy_version 926966 (0.0009) [2023-12-28 01:53:59,236][106225] Updated weights for policy 1, policy_version 926976 (0.0009) [2023-12-28 01:53:59,685][106226] Updated weights for policy 0, policy_version 924587 (0.0008) [2023-12-28 01:53:59,747][106226] Updated weights for policy 0, policy_version 924597 (0.0008) [2023-12-28 01:53:59,805][106226] Updated weights for policy 0, policy_version 924607 (0.0008) [2023-12-28 01:54:00,040][106225] Updated weights for policy 1, policy_version 926986 (0.0009) [2023-12-28 01:54:00,106][106225] Updated weights for policy 1, policy_version 926996 (0.0008) [2023-12-28 01:54:00,167][106225] Updated weights for policy 1, policy_version 927006 (0.0009) [2023-12-28 01:54:00,533][106226] Updated weights for policy 0, policy_version 924617 (0.0008) [2023-12-28 01:54:00,586][106226] Updated weights for policy 0, policy_version 924627 (0.0009) [2023-12-28 01:54:00,639][106226] Updated weights for policy 0, policy_version 924637 (0.0008) [2023-12-28 01:54:00,690][106226] Updated weights for policy 0, policy_version 924647 (0.0005) [2023-12-28 01:54:00,796][106225] Updated weights for policy 1, policy_version 927016 (0.0006) [2023-12-28 01:54:00,844][106225] Updated weights for policy 1, policy_version 927026 (0.0005) [2023-12-28 01:54:00,900][106225] Updated weights for policy 1, policy_version 927036 (0.0005) [2023-12-28 01:54:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 474128384. Throughput: 0: 10127.3, 1: 9797.8. Samples: 474116736. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:01,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-5.140')] [2023-12-28 01:54:01,465][106226] Updated weights for policy 0, policy_version 924657 (0.0007) [2023-12-28 01:54:01,528][106226] Updated weights for policy 0, policy_version 924667 (0.0007) [2023-12-28 01:54:01,587][106225] Updated weights for policy 1, policy_version 927046 (0.0007) [2023-12-28 01:54:01,591][106226] Updated weights for policy 0, policy_version 924677 (0.0007) [2023-12-28 01:54:01,659][106225] Updated weights for policy 1, policy_version 927056 (0.0008) [2023-12-28 01:54:01,726][106225] Updated weights for policy 1, policy_version 927066 (0.0008) [2023-12-28 01:54:02,252][106226] Updated weights for policy 0, policy_version 924687 (0.0008) [2023-12-28 01:54:02,318][106226] Updated weights for policy 0, policy_version 924697 (0.0007) [2023-12-28 01:54:02,332][106225] Updated weights for policy 1, policy_version 927076 (0.0007) [2023-12-28 01:54:02,384][106226] Updated weights for policy 0, policy_version 924707 (0.0007) [2023-12-28 01:54:02,395][106225] Updated weights for policy 1, policy_version 927086 (0.0006) [2023-12-28 01:54:02,460][106225] Updated weights for policy 1, policy_version 927096 (0.0007) [2023-12-28 01:54:03,081][106226] Updated weights for policy 0, policy_version 924717 (0.0007) [2023-12-28 01:54:03,135][106226] Updated weights for policy 0, policy_version 924727 (0.0006) [2023-12-28 01:54:03,137][106225] Updated weights for policy 1, policy_version 927106 (0.0008) [2023-12-28 01:54:03,188][106225] Updated weights for policy 1, policy_version 927116 (0.0005) [2023-12-28 01:54:03,191][106226] Updated weights for policy 0, policy_version 924737 (0.0007) [2023-12-28 01:54:03,238][106225] Updated weights for policy 1, policy_version 927126 (0.0005) [2023-12-28 01:54:03,301][106225] Updated weights for policy 1, policy_version 927136 (0.0005) [2023-12-28 01:54:03,728][106226] Updated weights for policy 0, policy_version 924747 (0.0007) [2023-12-28 01:54:03,782][106226] Updated weights for policy 0, policy_version 924757 (0.0008) [2023-12-28 01:54:03,837][106226] Updated weights for policy 0, policy_version 924767 (0.0009) [2023-12-28 01:54:03,893][106225] Updated weights for policy 1, policy_version 927146 (0.0010) [2023-12-28 01:54:03,958][106225] Updated weights for policy 1, policy_version 927156 (0.0010) [2023-12-28 01:54:04,024][106225] Updated weights for policy 1, policy_version 927166 (0.0010) [2023-12-28 01:54:04,587][106226] Updated weights for policy 0, policy_version 924777 (0.0008) [2023-12-28 01:54:04,641][106226] Updated weights for policy 0, policy_version 924787 (0.0008) [2023-12-28 01:54:04,666][106225] Updated weights for policy 1, policy_version 927176 (0.0006) [2023-12-28 01:54:04,701][106226] Updated weights for policy 0, policy_version 924797 (0.0009) [2023-12-28 01:54:04,726][106225] Updated weights for policy 1, policy_version 927186 (0.0006) [2023-12-28 01:54:04,751][106226] Updated weights for policy 0, policy_version 924807 (0.0006) [2023-12-28 01:54:04,794][106225] Updated weights for policy 1, policy_version 927196 (0.0008) [2023-12-28 01:54:05,366][106226] Updated weights for policy 0, policy_version 924817 (0.0005) [2023-12-28 01:54:05,374][106225] Updated weights for policy 1, policy_version 927206 (0.0009) [2023-12-28 01:54:05,411][106226] Updated weights for policy 0, policy_version 924827 (0.0005) [2023-12-28 01:54:05,436][106225] Updated weights for policy 1, policy_version 927216 (0.0008) [2023-12-28 01:54:05,457][106226] Updated weights for policy 0, policy_version 924837 (0.0005) [2023-12-28 01:54:05,504][106225] Updated weights for policy 1, policy_version 927226 (0.0008) [2023-12-28 01:54:06,030][106226] Updated weights for policy 0, policy_version 924847 (0.0009) [2023-12-28 01:54:06,080][106225] Updated weights for policy 1, policy_version 927236 (0.0009) [2023-12-28 01:54:06,085][106226] Updated weights for policy 0, policy_version 924857 (0.0010) [2023-12-28 01:54:06,145][106225] Updated weights for policy 1, policy_version 927247 (0.0009) [2023-12-28 01:54:06,148][106226] Updated weights for policy 0, policy_version 924867 (0.0011) [2023-12-28 01:54:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 474226688. Throughput: 0: 10133.4, 1: 9931.6. Samples: 474242952. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:06,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.964')] [2023-12-28 01:54:06,200][106225] Updated weights for policy 1, policy_version 927257 (0.0007) [2023-12-28 01:54:06,881][106226] Updated weights for policy 0, policy_version 924877 (0.0008) [2023-12-28 01:54:06,951][106226] Updated weights for policy 0, policy_version 924887 (0.0011) [2023-12-28 01:54:06,994][106225] Updated weights for policy 1, policy_version 927267 (0.0007) [2023-12-28 01:54:07,019][106226] Updated weights for policy 0, policy_version 924897 (0.0011) [2023-12-28 01:54:07,049][106225] Updated weights for policy 1, policy_version 927277 (0.0006) [2023-12-28 01:54:07,111][106225] Updated weights for policy 1, policy_version 927287 (0.0008) [2023-12-28 01:54:07,702][106226] Updated weights for policy 0, policy_version 924907 (0.0011) [2023-12-28 01:54:07,751][106225] Updated weights for policy 1, policy_version 927297 (0.0006) [2023-12-28 01:54:07,759][106226] Updated weights for policy 0, policy_version 924917 (0.0010) [2023-12-28 01:54:07,810][106225] Updated weights for policy 1, policy_version 927307 (0.0008) [2023-12-28 01:54:07,819][106226] Updated weights for policy 0, policy_version 924927 (0.0010) [2023-12-28 01:54:07,869][106225] Updated weights for policy 1, policy_version 927317 (0.0006) [2023-12-28 01:54:07,918][106225] Updated weights for policy 1, policy_version 927327 (0.0008) [2023-12-28 01:54:08,575][106226] Updated weights for policy 0, policy_version 924937 (0.0010) [2023-12-28 01:54:08,632][106225] Updated weights for policy 1, policy_version 927337 (0.0010) [2023-12-28 01:54:08,646][106226] Updated weights for policy 0, policy_version 924947 (0.0006) [2023-12-28 01:54:08,687][106225] Updated weights for policy 1, policy_version 927347 (0.0010) [2023-12-28 01:54:08,716][106226] Updated weights for policy 0, policy_version 924957 (0.0007) [2023-12-28 01:54:08,745][106225] Updated weights for policy 1, policy_version 927357 (0.0009) [2023-12-28 01:54:08,782][106226] Updated weights for policy 0, policy_version 924967 (0.0007) [2023-12-28 01:54:09,438][106226] Updated weights for policy 0, policy_version 924977 (0.0008) [2023-12-28 01:54:09,503][106226] Updated weights for policy 0, policy_version 924987 (0.0009) [2023-12-28 01:54:09,532][106225] Updated weights for policy 1, policy_version 927367 (0.0008) [2023-12-28 01:54:09,561][106226] Updated weights for policy 0, policy_version 924997 (0.0007) [2023-12-28 01:54:09,592][106225] Updated weights for policy 1, policy_version 927377 (0.0009) [2023-12-28 01:54:09,655][106225] Updated weights for policy 1, policy_version 927387 (0.0005) [2023-12-28 01:54:10,290][106226] Updated weights for policy 0, policy_version 925007 (0.0010) [2023-12-28 01:54:10,335][106225] Updated weights for policy 1, policy_version 927397 (0.0008) [2023-12-28 01:54:10,355][106226] Updated weights for policy 0, policy_version 925017 (0.0011) [2023-12-28 01:54:10,386][106225] Updated weights for policy 1, policy_version 927407 (0.0010) [2023-12-28 01:54:10,420][106226] Updated weights for policy 0, policy_version 925027 (0.0011) [2023-12-28 01:54:10,445][106225] Updated weights for policy 1, policy_version 927417 (0.0010) [2023-12-28 01:54:11,078][106226] Updated weights for policy 0, policy_version 925037 (0.0008) [2023-12-28 01:54:11,150][106226] Updated weights for policy 0, policy_version 925047 (0.0008) [2023-12-28 01:54:11,152][106225] Updated weights for policy 1, policy_version 927427 (0.0009) [2023-12-28 01:54:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 474324992. Throughput: 0: 10101.9, 1: 10011.6. Samples: 474301600. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:11,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-4.830')] [2023-12-28 01:54:11,211][106225] Updated weights for policy 1, policy_version 927437 (0.0011) [2023-12-28 01:54:11,217][106226] Updated weights for policy 0, policy_version 925057 (0.0008) [2023-12-28 01:54:11,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000925064_236871680.pth... [2023-12-28 01:54:11,265][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000923848_236560384.pth [2023-12-28 01:54:11,274][106225] Updated weights for policy 1, policy_version 927447 (0.0010) [2023-12-28 01:54:11,327][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000927456_237469696.pth... [2023-12-28 01:54:11,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000926272_237166592.pth [2023-12-28 01:54:11,932][106226] Updated weights for policy 0, policy_version 925067 (0.0010) [2023-12-28 01:54:11,998][106226] Updated weights for policy 0, policy_version 925077 (0.0008) [2023-12-28 01:54:12,061][106226] Updated weights for policy 0, policy_version 925087 (0.0008) [2023-12-28 01:54:12,072][106225] Updated weights for policy 1, policy_version 927457 (0.0009) [2023-12-28 01:54:12,128][106225] Updated weights for policy 1, policy_version 927467 (0.0008) [2023-12-28 01:54:12,187][106225] Updated weights for policy 1, policy_version 927477 (0.0008) [2023-12-28 01:54:12,247][106225] Updated weights for policy 1, policy_version 927487 (0.0008) [2023-12-28 01:54:12,801][106226] Updated weights for policy 0, policy_version 925097 (0.0009) [2023-12-28 01:54:12,859][106226] Updated weights for policy 0, policy_version 925107 (0.0008) [2023-12-28 01:54:12,924][106226] Updated weights for policy 0, policy_version 925117 (0.0008) [2023-12-28 01:54:12,977][106225] Updated weights for policy 1, policy_version 927497 (0.0006) [2023-12-28 01:54:12,979][106226] Updated weights for policy 0, policy_version 925127 (0.0008) [2023-12-28 01:54:13,031][106225] Updated weights for policy 1, policy_version 927507 (0.0008) [2023-12-28 01:54:13,086][106225] Updated weights for policy 1, policy_version 927517 (0.0008) [2023-12-28 01:54:13,682][106226] Updated weights for policy 0, policy_version 925137 (0.0006) [2023-12-28 01:54:13,736][106226] Updated weights for policy 0, policy_version 925147 (0.0005) [2023-12-28 01:54:13,782][106226] Updated weights for policy 0, policy_version 925157 (0.0005) [2023-12-28 01:54:13,837][106225] Updated weights for policy 1, policy_version 927527 (0.0008) [2023-12-28 01:54:13,895][106225] Updated weights for policy 1, policy_version 927537 (0.0008) [2023-12-28 01:54:13,953][106225] Updated weights for policy 1, policy_version 927547 (0.0009) [2023-12-28 01:54:14,391][106226] Updated weights for policy 0, policy_version 925167 (0.0008) [2023-12-28 01:54:14,450][106226] Updated weights for policy 0, policy_version 925177 (0.0008) [2023-12-28 01:54:14,507][106226] Updated weights for policy 0, policy_version 925187 (0.0008) [2023-12-28 01:54:14,659][106225] Updated weights for policy 1, policy_version 927557 (0.0007) [2023-12-28 01:54:14,710][106225] Updated weights for policy 1, policy_version 927567 (0.0005) [2023-12-28 01:54:14,770][106225] Updated weights for policy 1, policy_version 927577 (0.0006) [2023-12-28 01:54:15,242][106226] Updated weights for policy 0, policy_version 925197 (0.0008) [2023-12-28 01:54:15,309][106226] Updated weights for policy 0, policy_version 925207 (0.0009) [2023-12-28 01:54:15,378][106226] Updated weights for policy 0, policy_version 925217 (0.0011) [2023-12-28 01:54:15,481][106225] Updated weights for policy 1, policy_version 927587 (0.0009) [2023-12-28 01:54:15,528][106225] Updated weights for policy 1, policy_version 927597 (0.0008) [2023-12-28 01:54:15,582][106225] Updated weights for policy 1, policy_version 927607 (0.0009) [2023-12-28 01:54:15,949][106226] Updated weights for policy 0, policy_version 925227 (0.0008) [2023-12-28 01:54:16,008][106226] Updated weights for policy 0, policy_version 925237 (0.0011) [2023-12-28 01:54:16,054][106226] Updated weights for policy 0, policy_version 925247 (0.0010) [2023-12-28 01:54:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 474431488. Throughput: 0: 10025.6, 1: 9900.1. Samples: 474418448. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:16,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.762')] [2023-12-28 01:54:16,393][106225] Updated weights for policy 1, policy_version 927617 (0.0007) [2023-12-28 01:54:16,451][106225] Updated weights for policy 1, policy_version 927627 (0.0008) [2023-12-28 01:54:16,510][106225] Updated weights for policy 1, policy_version 927637 (0.0008) [2023-12-28 01:54:16,568][106225] Updated weights for policy 1, policy_version 927647 (0.0008) [2023-12-28 01:54:16,782][106226] Updated weights for policy 0, policy_version 925257 (0.0010) [2023-12-28 01:54:16,833][106226] Updated weights for policy 0, policy_version 925267 (0.0008) [2023-12-28 01:54:16,888][106226] Updated weights for policy 0, policy_version 925277 (0.0008) [2023-12-28 01:54:16,945][106226] Updated weights for policy 0, policy_version 925287 (0.0008) [2023-12-28 01:54:17,282][106225] Updated weights for policy 1, policy_version 927657 (0.0008) [2023-12-28 01:54:17,348][106225] Updated weights for policy 1, policy_version 927667 (0.0008) [2023-12-28 01:54:17,411][106225] Updated weights for policy 1, policy_version 927677 (0.0009) [2023-12-28 01:54:17,638][106226] Updated weights for policy 0, policy_version 925297 (0.0006) [2023-12-28 01:54:17,696][106226] Updated weights for policy 0, policy_version 925307 (0.0005) [2023-12-28 01:54:17,749][106226] Updated weights for policy 0, policy_version 925317 (0.0005) [2023-12-28 01:54:18,172][106225] Updated weights for policy 1, policy_version 927688 (0.0009) [2023-12-28 01:54:18,227][106225] Updated weights for policy 1, policy_version 927698 (0.0008) [2023-12-28 01:54:18,290][106225] Updated weights for policy 1, policy_version 927708 (0.0008) [2023-12-28 01:54:18,368][106226] Updated weights for policy 0, policy_version 925327 (0.0007) [2023-12-28 01:54:18,431][106226] Updated weights for policy 0, policy_version 925337 (0.0006) [2023-12-28 01:54:18,494][106226] Updated weights for policy 0, policy_version 925347 (0.0006) [2023-12-28 01:54:19,035][106226] Updated weights for policy 0, policy_version 925357 (0.0006) [2023-12-28 01:54:19,062][106225] Updated weights for policy 1, policy_version 927718 (0.0008) [2023-12-28 01:54:19,096][106226] Updated weights for policy 0, policy_version 925367 (0.0005) [2023-12-28 01:54:19,115][106225] Updated weights for policy 1, policy_version 927728 (0.0008) [2023-12-28 01:54:19,162][106226] Updated weights for policy 0, policy_version 925377 (0.0006) [2023-12-28 01:54:19,185][106225] Updated weights for policy 1, policy_version 927738 (0.0008) [2023-12-28 01:54:19,868][106226] Updated weights for policy 0, policy_version 925387 (0.0006) [2023-12-28 01:54:19,904][106225] Updated weights for policy 1, policy_version 927748 (0.0007) [2023-12-28 01:54:19,933][106226] Updated weights for policy 0, policy_version 925397 (0.0008) [2023-12-28 01:54:19,968][106225] Updated weights for policy 1, policy_version 927758 (0.0007) [2023-12-28 01:54:19,989][106226] Updated weights for policy 0, policy_version 925407 (0.0008) [2023-12-28 01:54:20,027][106225] Updated weights for policy 1, policy_version 927768 (0.0006) [2023-12-28 01:54:20,671][106225] Updated weights for policy 1, policy_version 927778 (0.0007) [2023-12-28 01:54:20,729][106225] Updated weights for policy 1, policy_version 927788 (0.0009) [2023-12-28 01:54:20,766][106226] Updated weights for policy 0, policy_version 925417 (0.0007) [2023-12-28 01:54:20,789][106225] Updated weights for policy 1, policy_version 927798 (0.0007) [2023-12-28 01:54:20,832][106226] Updated weights for policy 0, policy_version 925427 (0.0008) [2023-12-28 01:54:20,845][106225] Updated weights for policy 1, policy_version 927808 (0.0008) [2023-12-28 01:54:20,894][106226] Updated weights for policy 0, policy_version 925437 (0.0008) [2023-12-28 01:54:20,957][106226] Updated weights for policy 0, policy_version 925447 (0.0009) [2023-12-28 01:54:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 474529792. Throughput: 0: 10052.8, 1: 9855.9. Samples: 474536528. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:21,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-5.102')] [2023-12-28 01:54:21,611][106225] Updated weights for policy 1, policy_version 927818 (0.0008) [2023-12-28 01:54:21,682][106225] Updated weights for policy 1, policy_version 927828 (0.0010) [2023-12-28 01:54:21,757][106225] Updated weights for policy 1, policy_version 927838 (0.0008) [2023-12-28 01:54:21,768][106226] Updated weights for policy 0, policy_version 925457 (0.0008) [2023-12-28 01:54:21,838][106226] Updated weights for policy 0, policy_version 925467 (0.0007) [2023-12-28 01:54:21,903][106226] Updated weights for policy 0, policy_version 925477 (0.0006) [2023-12-28 01:54:22,454][106226] Updated weights for policy 0, policy_version 925487 (0.0008) [2023-12-28 01:54:22,512][106226] Updated weights for policy 0, policy_version 925497 (0.0008) [2023-12-28 01:54:22,527][106225] Updated weights for policy 1, policy_version 927848 (0.0006) [2023-12-28 01:54:22,574][106226] Updated weights for policy 0, policy_version 925507 (0.0006) [2023-12-28 01:54:22,579][106225] Updated weights for policy 1, policy_version 927858 (0.0008) [2023-12-28 01:54:22,642][106225] Updated weights for policy 1, policy_version 927868 (0.0009) [2023-12-28 01:54:23,222][106226] Updated weights for policy 0, policy_version 925517 (0.0008) [2023-12-28 01:54:23,285][106226] Updated weights for policy 0, policy_version 925527 (0.0011) [2023-12-28 01:54:23,342][106226] Updated weights for policy 0, policy_version 925537 (0.0011) [2023-12-28 01:54:23,405][106225] Updated weights for policy 1, policy_version 927878 (0.0009) [2023-12-28 01:54:23,462][106225] Updated weights for policy 1, policy_version 927888 (0.0010) [2023-12-28 01:54:23,526][106225] Updated weights for policy 1, policy_version 927898 (0.0010) [2023-12-28 01:54:24,054][106226] Updated weights for policy 0, policy_version 925547 (0.0010) [2023-12-28 01:54:24,107][106226] Updated weights for policy 0, policy_version 925557 (0.0010) [2023-12-28 01:54:24,154][106226] Updated weights for policy 0, policy_version 925567 (0.0010) [2023-12-28 01:54:24,193][106225] Updated weights for policy 1, policy_version 927908 (0.0010) [2023-12-28 01:54:24,247][106225] Updated weights for policy 1, policy_version 927918 (0.0006) [2023-12-28 01:54:24,305][106225] Updated weights for policy 1, policy_version 927928 (0.0007) [2023-12-28 01:54:24,839][106226] Updated weights for policy 0, policy_version 925577 (0.0010) [2023-12-28 01:54:24,889][106226] Updated weights for policy 0, policy_version 925587 (0.0005) [2023-12-28 01:54:24,936][106225] Updated weights for policy 1, policy_version 927938 (0.0007) [2023-12-28 01:54:24,942][106226] Updated weights for policy 0, policy_version 925597 (0.0005) [2023-12-28 01:54:24,986][106225] Updated weights for policy 1, policy_version 927948 (0.0010) [2023-12-28 01:54:24,999][106226] Updated weights for policy 0, policy_version 925607 (0.0009) [2023-12-28 01:54:25,044][106225] Updated weights for policy 1, policy_version 927958 (0.0010) [2023-12-28 01:54:25,101][106225] Updated weights for policy 1, policy_version 927968 (0.0010) [2023-12-28 01:54:25,566][106226] Updated weights for policy 0, policy_version 925617 (0.0008) [2023-12-28 01:54:25,626][106226] Updated weights for policy 0, policy_version 925627 (0.0008) [2023-12-28 01:54:25,680][106226] Updated weights for policy 0, policy_version 925637 (0.0008) [2023-12-28 01:54:25,800][106225] Updated weights for policy 1, policy_version 927978 (0.0010) [2023-12-28 01:54:25,846][106225] Updated weights for policy 1, policy_version 927988 (0.0010) [2023-12-28 01:54:25,911][106225] Updated weights for policy 1, policy_version 927998 (0.0010) [2023-12-28 01:54:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 474628096. Throughput: 0: 10133.1, 1: 9764.8. Samples: 474594004. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:26,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.841')] [2023-12-28 01:54:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000928000_237608960.pth... [2023-12-28 01:54:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000925640_237019136.pth... [2023-12-28 01:54:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000924456_236716032.pth [2023-12-28 01:54:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000926848_237314048.pth [2023-12-28 01:54:26,356][106226] Updated weights for policy 0, policy_version 925647 (0.0009) [2023-12-28 01:54:26,427][106226] Updated weights for policy 0, policy_version 925657 (0.0008) [2023-12-28 01:54:26,490][106226] Updated weights for policy 0, policy_version 925667 (0.0008) [2023-12-28 01:54:26,530][106225] Updated weights for policy 1, policy_version 928008 (0.0006) [2023-12-28 01:54:26,588][106225] Updated weights for policy 1, policy_version 928018 (0.0005) [2023-12-28 01:54:26,636][106225] Updated weights for policy 1, policy_version 928028 (0.0008) [2023-12-28 01:54:27,089][106226] Updated weights for policy 0, policy_version 925677 (0.0007) [2023-12-28 01:54:27,142][106226] Updated weights for policy 0, policy_version 925687 (0.0008) [2023-12-28 01:54:27,186][106226] Updated weights for policy 0, policy_version 925697 (0.0005) [2023-12-28 01:54:27,261][106225] Updated weights for policy 1, policy_version 928038 (0.0007) [2023-12-28 01:54:27,309][106225] Updated weights for policy 1, policy_version 928048 (0.0008) [2023-12-28 01:54:27,367][106225] Updated weights for policy 1, policy_version 928058 (0.0010) [2023-12-28 01:54:27,741][106226] Updated weights for policy 0, policy_version 925707 (0.0005) [2023-12-28 01:54:27,790][106226] Updated weights for policy 0, policy_version 925717 (0.0005) [2023-12-28 01:54:27,841][106226] Updated weights for policy 0, policy_version 925727 (0.0005) [2023-12-28 01:54:27,957][106225] Updated weights for policy 1, policy_version 928068 (0.0005) [2023-12-28 01:54:28,010][106225] Updated weights for policy 1, policy_version 928078 (0.0008) [2023-12-28 01:54:28,063][106225] Updated weights for policy 1, policy_version 928088 (0.0005) [2023-12-28 01:54:28,400][106226] Updated weights for policy 0, policy_version 925737 (0.0006) [2023-12-28 01:54:28,457][106226] Updated weights for policy 0, policy_version 925747 (0.0008) [2023-12-28 01:54:28,511][106226] Updated weights for policy 0, policy_version 925757 (0.0008) [2023-12-28 01:54:28,568][106226] Updated weights for policy 0, policy_version 925767 (0.0008) [2023-12-28 01:54:28,783][106225] Updated weights for policy 1, policy_version 928098 (0.0008) [2023-12-28 01:54:28,843][106225] Updated weights for policy 1, policy_version 928108 (0.0010) [2023-12-28 01:54:28,892][106225] Updated weights for policy 1, policy_version 928118 (0.0010) [2023-12-28 01:54:28,944][106225] Updated weights for policy 1, policy_version 928128 (0.0010) [2023-12-28 01:54:29,315][106226] Updated weights for policy 0, policy_version 925777 (0.0008) [2023-12-28 01:54:29,384][106226] Updated weights for policy 0, policy_version 925787 (0.0009) [2023-12-28 01:54:29,436][106226] Updated weights for policy 0, policy_version 925797 (0.0007) [2023-12-28 01:54:29,699][106225] Updated weights for policy 1, policy_version 928138 (0.0010) [2023-12-28 01:54:29,763][106225] Updated weights for policy 1, policy_version 928148 (0.0010) [2023-12-28 01:54:29,830][106225] Updated weights for policy 1, policy_version 928158 (0.0010) [2023-12-28 01:54:30,207][106226] Updated weights for policy 0, policy_version 925807 (0.0009) [2023-12-28 01:54:30,265][106226] Updated weights for policy 0, policy_version 925817 (0.0008) [2023-12-28 01:54:30,325][106226] Updated weights for policy 0, policy_version 925827 (0.0008) [2023-12-28 01:54:30,544][106225] Updated weights for policy 1, policy_version 928168 (0.0006) [2023-12-28 01:54:30,601][106225] Updated weights for policy 1, policy_version 928178 (0.0005) [2023-12-28 01:54:30,651][106225] Updated weights for policy 1, policy_version 928188 (0.0005) [2023-12-28 01:54:30,951][106226] Updated weights for policy 0, policy_version 925837 (0.0007) [2023-12-28 01:54:30,997][106226] Updated weights for policy 0, policy_version 925847 (0.0007) [2023-12-28 01:54:31,052][106226] Updated weights for policy 0, policy_version 925857 (0.0007) [2023-12-28 01:54:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 474734592. Throughput: 0: 10243.2, 1: 9883.3. Samples: 474721748. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:31,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-4.927')] [2023-12-28 01:54:31,266][106225] Updated weights for policy 1, policy_version 928198 (0.0006) [2023-12-28 01:54:31,331][106225] Updated weights for policy 1, policy_version 928208 (0.0008) [2023-12-28 01:54:31,401][106225] Updated weights for policy 1, policy_version 928218 (0.0008) [2023-12-28 01:54:31,871][106226] Updated weights for policy 0, policy_version 925867 (0.0007) [2023-12-28 01:54:31,929][106226] Updated weights for policy 0, policy_version 925877 (0.0010) [2023-12-28 01:54:31,986][106226] Updated weights for policy 0, policy_version 925887 (0.0010) [2023-12-28 01:54:32,173][106225] Updated weights for policy 1, policy_version 928228 (0.0008) [2023-12-28 01:54:32,222][106225] Updated weights for policy 1, policy_version 928238 (0.0007) [2023-12-28 01:54:32,281][106225] Updated weights for policy 1, policy_version 928248 (0.0008) [2023-12-28 01:54:32,724][106226] Updated weights for policy 0, policy_version 925897 (0.0010) [2023-12-28 01:54:32,784][106226] Updated weights for policy 0, policy_version 925907 (0.0010) [2023-12-28 01:54:32,847][106226] Updated weights for policy 0, policy_version 925917 (0.0010) [2023-12-28 01:54:32,906][106226] Updated weights for policy 0, policy_version 925927 (0.0010) [2023-12-28 01:54:33,056][106225] Updated weights for policy 1, policy_version 928258 (0.0007) [2023-12-28 01:54:33,110][106225] Updated weights for policy 1, policy_version 928268 (0.0008) [2023-12-28 01:54:33,160][106225] Updated weights for policy 1, policy_version 928278 (0.0008) [2023-12-28 01:54:33,215][106225] Updated weights for policy 1, policy_version 928288 (0.0008) [2023-12-28 01:54:33,610][106226] Updated weights for policy 0, policy_version 925937 (0.0010) [2023-12-28 01:54:33,656][106226] Updated weights for policy 0, policy_version 925947 (0.0010) [2023-12-28 01:54:33,702][106226] Updated weights for policy 0, policy_version 925957 (0.0010) [2023-12-28 01:54:33,945][106225] Updated weights for policy 1, policy_version 928298 (0.0007) [2023-12-28 01:54:33,992][106225] Updated weights for policy 1, policy_version 928308 (0.0008) [2023-12-28 01:54:34,048][106225] Updated weights for policy 1, policy_version 928318 (0.0005) [2023-12-28 01:54:34,437][106226] Updated weights for policy 0, policy_version 925967 (0.0007) [2023-12-28 01:54:34,504][106226] Updated weights for policy 0, policy_version 925977 (0.0006) [2023-12-28 01:54:34,562][106226] Updated weights for policy 0, policy_version 925987 (0.0008) [2023-12-28 01:54:34,766][106225] Updated weights for policy 1, policy_version 928328 (0.0009) [2023-12-28 01:54:34,820][106225] Updated weights for policy 1, policy_version 928338 (0.0010) [2023-12-28 01:54:34,870][106225] Updated weights for policy 1, policy_version 928348 (0.0010) [2023-12-28 01:54:35,282][106226] Updated weights for policy 0, policy_version 925997 (0.0008) [2023-12-28 01:54:35,332][106226] Updated weights for policy 0, policy_version 926007 (0.0009) [2023-12-28 01:54:35,383][106226] Updated weights for policy 0, policy_version 926017 (0.0009) [2023-12-28 01:54:35,484][106225] Updated weights for policy 1, policy_version 928358 (0.0009) [2023-12-28 01:54:35,550][106225] Updated weights for policy 1, policy_version 928368 (0.0008) [2023-12-28 01:54:35,616][106225] Updated weights for policy 1, policy_version 928378 (0.0008) [2023-12-28 01:54:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 474824704. Throughput: 0: 10135.8, 1: 9884.3. Samples: 474838736. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:36,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-4.843')] [2023-12-28 01:54:36,189][106226] Updated weights for policy 0, policy_version 926027 (0.0008) [2023-12-28 01:54:36,251][106226] Updated weights for policy 0, policy_version 926037 (0.0008) [2023-12-28 01:54:36,254][106225] Updated weights for policy 1, policy_version 928388 (0.0006) [2023-12-28 01:54:36,315][106226] Updated weights for policy 0, policy_version 926047 (0.0007) [2023-12-28 01:54:36,319][106225] Updated weights for policy 1, policy_version 928398 (0.0007) [2023-12-28 01:54:36,384][106225] Updated weights for policy 1, policy_version 928408 (0.0008) [2023-12-28 01:54:36,928][106226] Updated weights for policy 0, policy_version 926057 (0.0008) [2023-12-28 01:54:36,999][106226] Updated weights for policy 0, policy_version 926067 (0.0007) [2023-12-28 01:54:37,048][106225] Updated weights for policy 1, policy_version 928418 (0.0007) [2023-12-28 01:54:37,063][106226] Updated weights for policy 0, policy_version 926077 (0.0006) [2023-12-28 01:54:37,109][106225] Updated weights for policy 1, policy_version 928428 (0.0008) [2023-12-28 01:54:37,119][106226] Updated weights for policy 0, policy_version 926087 (0.0006) [2023-12-28 01:54:37,174][106225] Updated weights for policy 1, policy_version 928438 (0.0009) [2023-12-28 01:54:37,238][106225] Updated weights for policy 1, policy_version 928448 (0.0009) [2023-12-28 01:54:37,800][106226] Updated weights for policy 0, policy_version 926097 (0.0008) [2023-12-28 01:54:37,860][106226] Updated weights for policy 0, policy_version 926107 (0.0008) [2023-12-28 01:54:37,923][106226] Updated weights for policy 0, policy_version 926117 (0.0009) [2023-12-28 01:54:37,951][106225] Updated weights for policy 1, policy_version 928458 (0.0007) [2023-12-28 01:54:38,009][106225] Updated weights for policy 1, policy_version 928468 (0.0006) [2023-12-28 01:54:38,067][106225] Updated weights for policy 1, policy_version 928478 (0.0007) [2023-12-28 01:54:38,664][106226] Updated weights for policy 0, policy_version 926127 (0.0007) [2023-12-28 01:54:38,725][106226] Updated weights for policy 0, policy_version 926137 (0.0006) [2023-12-28 01:54:38,791][106226] Updated weights for policy 0, policy_version 926147 (0.0007) [2023-12-28 01:54:38,794][106225] Updated weights for policy 1, policy_version 928488 (0.0007) [2023-12-28 01:54:38,849][106225] Updated weights for policy 1, policy_version 928498 (0.0008) [2023-12-28 01:54:38,901][106225] Updated weights for policy 1, policy_version 928508 (0.0008) [2023-12-28 01:54:39,463][106226] Updated weights for policy 0, policy_version 926157 (0.0007) [2023-12-28 01:54:39,527][106226] Updated weights for policy 0, policy_version 926167 (0.0007) [2023-12-28 01:54:39,593][106226] Updated weights for policy 0, policy_version 926177 (0.0008) [2023-12-28 01:54:39,609][106225] Updated weights for policy 1, policy_version 928518 (0.0009) [2023-12-28 01:54:39,669][106225] Updated weights for policy 1, policy_version 928528 (0.0010) [2023-12-28 01:54:39,731][106225] Updated weights for policy 1, policy_version 928538 (0.0008) [2023-12-28 01:54:40,307][106226] Updated weights for policy 0, policy_version 926187 (0.0008) [2023-12-28 01:54:40,368][106226] Updated weights for policy 0, policy_version 926197 (0.0009) [2023-12-28 01:54:40,433][106226] Updated weights for policy 0, policy_version 926207 (0.0009) [2023-12-28 01:54:40,495][106225] Updated weights for policy 1, policy_version 928548 (0.0009) [2023-12-28 01:54:40,552][106225] Updated weights for policy 1, policy_version 928558 (0.0008) [2023-12-28 01:54:40,611][106225] Updated weights for policy 1, policy_version 928568 (0.0008) [2023-12-28 01:54:41,100][106226] Updated weights for policy 0, policy_version 926217 (0.0007) [2023-12-28 01:54:41,156][106226] Updated weights for policy 0, policy_version 926227 (0.0009) [2023-12-28 01:54:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 474923008. Throughput: 0: 10130.2, 1: 9933.8. Samples: 474899132. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:41,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.911')] [2023-12-28 01:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000928576_237756416.pth... [2023-12-28 01:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000927456_237469696.pth [2023-12-28 01:54:41,219][106226] Updated weights for policy 0, policy_version 926237 (0.0007) [2023-12-28 01:54:41,276][106226] Updated weights for policy 0, policy_version 926247 (0.0007) [2023-12-28 01:54:41,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000926248_237174784.pth... [2023-12-28 01:54:41,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000925064_236871680.pth [2023-12-28 01:54:41,443][106225] Updated weights for policy 1, policy_version 928578 (0.0008) [2023-12-28 01:54:41,496][106225] Updated weights for policy 1, policy_version 928588 (0.0007) [2023-12-28 01:54:41,563][106225] Updated weights for policy 1, policy_version 928598 (0.0010) [2023-12-28 01:54:41,626][106225] Updated weights for policy 1, policy_version 928608 (0.0008) [2023-12-28 01:54:42,023][106226] Updated weights for policy 0, policy_version 926257 (0.0006) [2023-12-28 01:54:42,087][106226] Updated weights for policy 0, policy_version 926267 (0.0006) [2023-12-28 01:54:42,154][106226] Updated weights for policy 0, policy_version 926277 (0.0006) [2023-12-28 01:54:42,344][106225] Updated weights for policy 1, policy_version 928618 (0.0009) [2023-12-28 01:54:42,415][106225] Updated weights for policy 1, policy_version 928628 (0.0008) [2023-12-28 01:54:42,481][106225] Updated weights for policy 1, policy_version 928638 (0.0008) [2023-12-28 01:54:42,810][106226] Updated weights for policy 0, policy_version 926287 (0.0007) [2023-12-28 01:54:42,874][106226] Updated weights for policy 0, policy_version 926297 (0.0008) [2023-12-28 01:54:42,933][106226] Updated weights for policy 0, policy_version 926307 (0.0008) [2023-12-28 01:54:43,144][106225] Updated weights for policy 1, policy_version 928648 (0.0008) [2023-12-28 01:54:43,193][106225] Updated weights for policy 1, policy_version 928658 (0.0008) [2023-12-28 01:54:43,243][106225] Updated weights for policy 1, policy_version 928668 (0.0008) [2023-12-28 01:54:43,620][106226] Updated weights for policy 0, policy_version 926317 (0.0007) [2023-12-28 01:54:43,680][106226] Updated weights for policy 0, policy_version 926327 (0.0007) [2023-12-28 01:54:43,734][106226] Updated weights for policy 0, policy_version 926337 (0.0009) [2023-12-28 01:54:43,920][106225] Updated weights for policy 1, policy_version 928678 (0.0006) [2023-12-28 01:54:43,984][106225] Updated weights for policy 1, policy_version 928688 (0.0005) [2023-12-28 01:54:44,054][106225] Updated weights for policy 1, policy_version 928698 (0.0005) [2023-12-28 01:54:44,337][106226] Updated weights for policy 0, policy_version 926347 (0.0008) [2023-12-28 01:54:44,413][106226] Updated weights for policy 0, policy_version 926357 (0.0006) [2023-12-28 01:54:44,467][106226] Updated weights for policy 0, policy_version 926367 (0.0006) [2023-12-28 01:54:44,673][106225] Updated weights for policy 1, policy_version 928708 (0.0008) [2023-12-28 01:54:44,730][106225] Updated weights for policy 1, policy_version 928718 (0.0010) [2023-12-28 01:54:44,792][106225] Updated weights for policy 1, policy_version 928728 (0.0009) [2023-12-28 01:54:45,137][106226] Updated weights for policy 0, policy_version 926377 (0.0006) [2023-12-28 01:54:45,203][106226] Updated weights for policy 0, policy_version 926387 (0.0008) [2023-12-28 01:54:45,264][106226] Updated weights for policy 0, policy_version 926397 (0.0008) [2023-12-28 01:54:45,329][106226] Updated weights for policy 0, policy_version 926407 (0.0008) [2023-12-28 01:54:45,486][106225] Updated weights for policy 1, policy_version 928738 (0.0010) [2023-12-28 01:54:45,546][106225] Updated weights for policy 1, policy_version 928748 (0.0010) [2023-12-28 01:54:45,607][106225] Updated weights for policy 1, policy_version 928758 (0.0007) [2023-12-28 01:54:45,676][106225] Updated weights for policy 1, policy_version 928768 (0.0007) [2023-12-28 01:54:46,002][106226] Updated weights for policy 0, policy_version 926417 (0.0006) [2023-12-28 01:54:46,049][106226] Updated weights for policy 0, policy_version 926427 (0.0008) [2023-12-28 01:54:46,103][106226] Updated weights for policy 0, policy_version 926437 (0.0010) [2023-12-28 01:54:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 475029504. Throughput: 0: 10104.9, 1: 9907.6. Samples: 475017304. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:46,176][105115] Avg episode reward: [(0, '-4.232'), (1, '-4.894')] [2023-12-28 01:54:46,294][106225] Updated weights for policy 1, policy_version 928778 (0.0010) [2023-12-28 01:54:46,344][106225] Updated weights for policy 1, policy_version 928788 (0.0010) [2023-12-28 01:54:46,394][106225] Updated weights for policy 1, policy_version 928798 (0.0010) [2023-12-28 01:54:46,888][106226] Updated weights for policy 0, policy_version 926447 (0.0007) [2023-12-28 01:54:46,950][106226] Updated weights for policy 0, policy_version 926457 (0.0005) [2023-12-28 01:54:47,001][106226] Updated weights for policy 0, policy_version 926467 (0.0007) [2023-12-28 01:54:47,097][106225] Updated weights for policy 1, policy_version 928808 (0.0009) [2023-12-28 01:54:47,147][106225] Updated weights for policy 1, policy_version 928818 (0.0010) [2023-12-28 01:54:47,196][106225] Updated weights for policy 1, policy_version 928828 (0.0010) [2023-12-28 01:54:47,632][106226] Updated weights for policy 0, policy_version 926477 (0.0008) [2023-12-28 01:54:47,686][106226] Updated weights for policy 0, policy_version 926487 (0.0007) [2023-12-28 01:54:47,747][106226] Updated weights for policy 0, policy_version 926497 (0.0006) [2023-12-28 01:54:47,930][106225] Updated weights for policy 1, policy_version 928838 (0.0011) [2023-12-28 01:54:47,978][106225] Updated weights for policy 1, policy_version 928848 (0.0010) [2023-12-28 01:54:48,030][106225] Updated weights for policy 1, policy_version 928858 (0.0010) [2023-12-28 01:54:48,393][106226] Updated weights for policy 0, policy_version 926507 (0.0006) [2023-12-28 01:54:48,451][106226] Updated weights for policy 0, policy_version 926517 (0.0006) [2023-12-28 01:54:48,506][106226] Updated weights for policy 0, policy_version 926527 (0.0005) [2023-12-28 01:54:48,771][106225] Updated weights for policy 1, policy_version 928868 (0.0010) [2023-12-28 01:54:48,833][106225] Updated weights for policy 1, policy_version 928878 (0.0009) [2023-12-28 01:54:48,893][106225] Updated weights for policy 1, policy_version 928888 (0.0009) [2023-12-28 01:54:49,105][106226] Updated weights for policy 0, policy_version 926537 (0.0006) [2023-12-28 01:54:49,171][106226] Updated weights for policy 0, policy_version 926547 (0.0008) [2023-12-28 01:54:49,230][106226] Updated weights for policy 0, policy_version 926557 (0.0006) [2023-12-28 01:54:49,290][106226] Updated weights for policy 0, policy_version 926567 (0.0009) [2023-12-28 01:54:49,635][106225] Updated weights for policy 1, policy_version 928898 (0.0008) [2023-12-28 01:54:49,694][106225] Updated weights for policy 1, policy_version 928908 (0.0010) [2023-12-28 01:54:49,755][106225] Updated weights for policy 1, policy_version 928918 (0.0009) [2023-12-28 01:54:49,812][106225] Updated weights for policy 1, policy_version 928928 (0.0010) [2023-12-28 01:54:49,890][106226] Updated weights for policy 0, policy_version 926577 (0.0009) [2023-12-28 01:54:49,954][106226] Updated weights for policy 0, policy_version 926587 (0.0008) [2023-12-28 01:54:50,013][106226] Updated weights for policy 0, policy_version 926597 (0.0006) [2023-12-28 01:54:50,549][106225] Updated weights for policy 1, policy_version 928938 (0.0009) [2023-12-28 01:54:50,610][106225] Updated weights for policy 1, policy_version 928948 (0.0008) [2023-12-28 01:54:50,670][106225] Updated weights for policy 1, policy_version 928958 (0.0008) [2023-12-28 01:54:50,722][106226] Updated weights for policy 0, policy_version 926607 (0.0006) [2023-12-28 01:54:50,787][106226] Updated weights for policy 0, policy_version 926617 (0.0007) [2023-12-28 01:54:50,854][106226] Updated weights for policy 0, policy_version 926627 (0.0005) [2023-12-28 01:54:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 475127808. Throughput: 0: 10088.2, 1: 9792.7. Samples: 475137592. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:51,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.774')] [2023-12-28 01:54:51,449][106225] Updated weights for policy 1, policy_version 928968 (0.0009) [2023-12-28 01:54:51,509][106225] Updated weights for policy 1, policy_version 928978 (0.0010) [2023-12-28 01:54:51,535][106226] Updated weights for policy 0, policy_version 926637 (0.0005) [2023-12-28 01:54:51,557][106225] Updated weights for policy 1, policy_version 928988 (0.0010) [2023-12-28 01:54:51,596][106226] Updated weights for policy 0, policy_version 926647 (0.0008) [2023-12-28 01:54:51,663][106226] Updated weights for policy 0, policy_version 926657 (0.0008) [2023-12-28 01:54:52,234][106225] Updated weights for policy 1, policy_version 928998 (0.0009) [2023-12-28 01:54:52,306][106225] Updated weights for policy 1, policy_version 929008 (0.0008) [2023-12-28 01:54:52,343][106226] Updated weights for policy 0, policy_version 926667 (0.0008) [2023-12-28 01:54:52,374][106225] Updated weights for policy 1, policy_version 929018 (0.0008) [2023-12-28 01:54:52,408][106226] Updated weights for policy 0, policy_version 926677 (0.0007) [2023-12-28 01:54:52,471][106226] Updated weights for policy 0, policy_version 926687 (0.0008) [2023-12-28 01:54:53,017][106225] Updated weights for policy 1, policy_version 929028 (0.0010) [2023-12-28 01:54:53,083][106225] Updated weights for policy 1, policy_version 929038 (0.0010) [2023-12-28 01:54:53,154][106225] Updated weights for policy 1, policy_version 929048 (0.0005) [2023-12-28 01:54:53,235][106226] Updated weights for policy 0, policy_version 926697 (0.0008) [2023-12-28 01:54:53,288][106226] Updated weights for policy 0, policy_version 926707 (0.0008) [2023-12-28 01:54:53,344][106226] Updated weights for policy 0, policy_version 926717 (0.0009) [2023-12-28 01:54:53,399][106226] Updated weights for policy 0, policy_version 926727 (0.0007) [2023-12-28 01:54:53,827][106225] Updated weights for policy 1, policy_version 929058 (0.0006) [2023-12-28 01:54:53,889][106225] Updated weights for policy 1, policy_version 929068 (0.0007) [2023-12-28 01:54:53,951][106225] Updated weights for policy 1, policy_version 929078 (0.0007) [2023-12-28 01:54:54,008][106225] Updated weights for policy 1, policy_version 929088 (0.0008) [2023-12-28 01:54:54,043][106226] Updated weights for policy 0, policy_version 926737 (0.0008) [2023-12-28 01:54:54,106][106226] Updated weights for policy 0, policy_version 926747 (0.0008) [2023-12-28 01:54:54,171][106226] Updated weights for policy 0, policy_version 926757 (0.0008) [2023-12-28 01:54:54,629][106225] Updated weights for policy 1, policy_version 929098 (0.0006) [2023-12-28 01:54:54,694][106225] Updated weights for policy 1, policy_version 929108 (0.0009) [2023-12-28 01:54:54,759][106225] Updated weights for policy 1, policy_version 929118 (0.0007) [2023-12-28 01:54:54,875][106226] Updated weights for policy 0, policy_version 926767 (0.0009) [2023-12-28 01:54:54,932][106226] Updated weights for policy 0, policy_version 926777 (0.0007) [2023-12-28 01:54:54,980][106226] Updated weights for policy 0, policy_version 926787 (0.0005) [2023-12-28 01:54:55,411][106225] Updated weights for policy 1, policy_version 929128 (0.0006) [2023-12-28 01:54:55,471][106225] Updated weights for policy 1, policy_version 929138 (0.0005) [2023-12-28 01:54:55,523][106225] Updated weights for policy 1, policy_version 929148 (0.0005) [2023-12-28 01:54:55,624][106226] Updated weights for policy 0, policy_version 926797 (0.0006) [2023-12-28 01:54:55,691][106226] Updated weights for policy 0, policy_version 926807 (0.0010) [2023-12-28 01:54:55,762][106226] Updated weights for policy 0, policy_version 926817 (0.0010) [2023-12-28 01:54:56,132][106225] Updated weights for policy 1, policy_version 929158 (0.0006) [2023-12-28 01:54:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 475226112. Throughput: 0: 10106.6, 1: 9801.3. Samples: 475197452. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:54:56,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.778')] [2023-12-28 01:54:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000926824_237322240.pth... [2023-12-28 01:54:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000925640_237019136.pth [2023-12-28 01:54:56,204][106225] Updated weights for policy 1, policy_version 929168 (0.0008) [2023-12-28 01:54:56,261][106225] Updated weights for policy 1, policy_version 929178 (0.0008) [2023-12-28 01:54:56,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000929184_237912064.pth... [2023-12-28 01:54:56,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000928000_237608960.pth [2023-12-28 01:54:56,326][106226] Updated weights for policy 0, policy_version 926827 (0.0008) [2023-12-28 01:54:56,383][106226] Updated weights for policy 0, policy_version 926837 (0.0007) [2023-12-28 01:54:56,435][106226] Updated weights for policy 0, policy_version 926847 (0.0008) [2023-12-28 01:54:56,835][106225] Updated weights for policy 1, policy_version 929188 (0.0009) [2023-12-28 01:54:56,891][106225] Updated weights for policy 1, policy_version 929198 (0.0008) [2023-12-28 01:54:56,948][106225] Updated weights for policy 1, policy_version 929208 (0.0007) [2023-12-28 01:54:57,037][106226] Updated weights for policy 0, policy_version 926857 (0.0009) [2023-12-28 01:54:57,086][106226] Updated weights for policy 0, policy_version 926867 (0.0005) [2023-12-28 01:54:57,132][106226] Updated weights for policy 0, policy_version 926877 (0.0005) [2023-12-28 01:54:57,178][106226] Updated weights for policy 0, policy_version 926887 (0.0005) [2023-12-28 01:54:57,597][106225] Updated weights for policy 1, policy_version 929219 (0.0010) [2023-12-28 01:54:57,654][106225] Updated weights for policy 1, policy_version 929229 (0.0008) [2023-12-28 01:54:57,714][106225] Updated weights for policy 1, policy_version 929239 (0.0008) [2023-12-28 01:54:57,757][106226] Updated weights for policy 0, policy_version 926897 (0.0005) [2023-12-28 01:54:57,821][106226] Updated weights for policy 0, policy_version 926907 (0.0006) [2023-12-28 01:54:57,882][106226] Updated weights for policy 0, policy_version 926917 (0.0008) [2023-12-28 01:54:58,386][106225] Updated weights for policy 1, policy_version 929250 (0.0008) [2023-12-28 01:54:58,450][106225] Updated weights for policy 1, policy_version 929260 (0.0008) [2023-12-28 01:54:58,508][106225] Updated weights for policy 1, policy_version 929270 (0.0007) [2023-12-28 01:54:58,566][106225] Updated weights for policy 1, policy_version 929280 (0.0007) [2023-12-28 01:54:58,579][106226] Updated weights for policy 0, policy_version 926927 (0.0010) [2023-12-28 01:54:58,644][106226] Updated weights for policy 0, policy_version 926937 (0.0009) [2023-12-28 01:54:58,706][106226] Updated weights for policy 0, policy_version 926947 (0.0009) [2023-12-28 01:54:59,288][106225] Updated weights for policy 1, policy_version 929290 (0.0007) [2023-12-28 01:54:59,353][106225] Updated weights for policy 1, policy_version 929300 (0.0008) [2023-12-28 01:54:59,410][106225] Updated weights for policy 1, policy_version 929310 (0.0008) [2023-12-28 01:54:59,430][106226] Updated weights for policy 0, policy_version 926957 (0.0009) [2023-12-28 01:54:59,487][106226] Updated weights for policy 0, policy_version 926967 (0.0008) [2023-12-28 01:54:59,550][106226] Updated weights for policy 0, policy_version 926977 (0.0007) [2023-12-28 01:55:00,164][106225] Updated weights for policy 1, policy_version 929320 (0.0008) [2023-12-28 01:55:00,221][106225] Updated weights for policy 1, policy_version 929330 (0.0009) [2023-12-28 01:55:00,257][106226] Updated weights for policy 0, policy_version 926987 (0.0008) [2023-12-28 01:55:00,279][106225] Updated weights for policy 1, policy_version 929340 (0.0008) [2023-12-28 01:55:00,329][106226] Updated weights for policy 0, policy_version 926997 (0.0009) [2023-12-28 01:55:00,385][106226] Updated weights for policy 0, policy_version 927007 (0.0009) [2023-12-28 01:55:00,993][106225] Updated weights for policy 1, policy_version 929350 (0.0010) [2023-12-28 01:55:01,054][106225] Updated weights for policy 1, policy_version 929360 (0.0010) [2023-12-28 01:55:01,120][106225] Updated weights for policy 1, policy_version 929370 (0.0010) [2023-12-28 01:55:01,152][106226] Updated weights for policy 0, policy_version 927017 (0.0009) [2023-12-28 01:55:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 475332608. Throughput: 0: 10190.8, 1: 9908.5. Samples: 475322920. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:55:01,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-5.111')] [2023-12-28 01:55:01,219][106226] Updated weights for policy 0, policy_version 927027 (0.0008) [2023-12-28 01:55:01,286][106226] Updated weights for policy 0, policy_version 927037 (0.0008) [2023-12-28 01:55:01,350][106226] Updated weights for policy 0, policy_version 927047 (0.0008) [2023-12-28 01:55:01,911][106225] Updated weights for policy 1, policy_version 929380 (0.0008) [2023-12-28 01:55:01,970][106225] Updated weights for policy 1, policy_version 929390 (0.0009) [2023-12-28 01:55:02,034][106225] Updated weights for policy 1, policy_version 929400 (0.0009) [2023-12-28 01:55:02,066][106226] Updated weights for policy 0, policy_version 927057 (0.0006) [2023-12-28 01:55:02,127][106226] Updated weights for policy 0, policy_version 927067 (0.0007) [2023-12-28 01:55:02,197][106226] Updated weights for policy 0, policy_version 927077 (0.0009) [2023-12-28 01:55:02,758][106225] Updated weights for policy 1, policy_version 929410 (0.0008) [2023-12-28 01:55:02,804][106225] Updated weights for policy 1, policy_version 929420 (0.0008) [2023-12-28 01:55:02,852][106225] Updated weights for policy 1, policy_version 929430 (0.0008) [2023-12-28 01:55:02,891][106226] Updated weights for policy 0, policy_version 927087 (0.0009) [2023-12-28 01:55:02,915][106225] Updated weights for policy 1, policy_version 929440 (0.0007) [2023-12-28 01:55:02,939][106226] Updated weights for policy 0, policy_version 927097 (0.0009) [2023-12-28 01:55:02,992][106226] Updated weights for policy 0, policy_version 927107 (0.0008) [2023-12-28 01:55:03,618][106225] Updated weights for policy 1, policy_version 929450 (0.0005) [2023-12-28 01:55:03,670][106225] Updated weights for policy 1, policy_version 929460 (0.0008) [2023-12-28 01:55:03,726][106225] Updated weights for policy 1, policy_version 929470 (0.0008) [2023-12-28 01:55:03,760][106226] Updated weights for policy 0, policy_version 927117 (0.0008) [2023-12-28 01:55:03,812][106226] Updated weights for policy 0, policy_version 927127 (0.0008) [2023-12-28 01:55:03,870][106226] Updated weights for policy 0, policy_version 927137 (0.0009) [2023-12-28 01:55:04,431][106225] Updated weights for policy 1, policy_version 929480 (0.0006) [2023-12-28 01:55:04,491][106225] Updated weights for policy 1, policy_version 929490 (0.0007) [2023-12-28 01:55:04,541][106225] Updated weights for policy 1, policy_version 929500 (0.0009) [2023-12-28 01:55:04,569][106226] Updated weights for policy 0, policy_version 927147 (0.0006) [2023-12-28 01:55:04,630][106226] Updated weights for policy 0, policy_version 927157 (0.0005) [2023-12-28 01:55:04,686][106226] Updated weights for policy 0, policy_version 927167 (0.0007) [2023-12-28 01:55:05,184][106225] Updated weights for policy 1, policy_version 929510 (0.0007) [2023-12-28 01:55:05,237][106225] Updated weights for policy 1, policy_version 929520 (0.0005) [2023-12-28 01:55:05,306][106225] Updated weights for policy 1, policy_version 929530 (0.0005) [2023-12-28 01:55:05,405][106226] Updated weights for policy 0, policy_version 927177 (0.0008) [2023-12-28 01:55:05,465][106226] Updated weights for policy 0, policy_version 927187 (0.0008) [2023-12-28 01:55:05,521][106226] Updated weights for policy 0, policy_version 927197 (0.0010) [2023-12-28 01:55:05,587][106226] Updated weights for policy 0, policy_version 927207 (0.0010) [2023-12-28 01:55:05,930][106225] Updated weights for policy 1, policy_version 929540 (0.0008) [2023-12-28 01:55:05,980][106225] Updated weights for policy 1, policy_version 929550 (0.0010) [2023-12-28 01:55:06,033][106225] Updated weights for policy 1, policy_version 929560 (0.0010) [2023-12-28 01:55:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 475430912. Throughput: 0: 10116.8, 1: 9980.8. Samples: 475440920. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:55:06,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.131')] [2023-12-28 01:55:06,275][106226] Updated weights for policy 0, policy_version 927217 (0.0007) [2023-12-28 01:55:06,341][106226] Updated weights for policy 0, policy_version 927227 (0.0008) [2023-12-28 01:55:06,407][106226] Updated weights for policy 0, policy_version 927237 (0.0006) [2023-12-28 01:55:06,790][106225] Updated weights for policy 1, policy_version 929570 (0.0010) [2023-12-28 01:55:06,848][106225] Updated weights for policy 1, policy_version 929580 (0.0011) [2023-12-28 01:55:06,903][106225] Updated weights for policy 1, policy_version 929590 (0.0010) [2023-12-28 01:55:06,954][106225] Updated weights for policy 1, policy_version 929600 (0.0010) [2023-12-28 01:55:07,031][106226] Updated weights for policy 0, policy_version 927247 (0.0008) [2023-12-28 01:55:07,082][106226] Updated weights for policy 0, policy_version 927257 (0.0008) [2023-12-28 01:55:07,133][106226] Updated weights for policy 0, policy_version 927267 (0.0008) [2023-12-28 01:55:07,683][106225] Updated weights for policy 1, policy_version 929610 (0.0010) [2023-12-28 01:55:07,737][106225] Updated weights for policy 1, policy_version 929620 (0.0010) [2023-12-28 01:55:07,794][106225] Updated weights for policy 1, policy_version 929630 (0.0010) [2023-12-28 01:55:07,824][106226] Updated weights for policy 0, policy_version 927277 (0.0007) [2023-12-28 01:55:07,889][106226] Updated weights for policy 0, policy_version 927287 (0.0008) [2023-12-28 01:55:07,957][106226] Updated weights for policy 0, policy_version 927297 (0.0008) [2023-12-28 01:55:08,438][106225] Updated weights for policy 1, policy_version 929640 (0.0009) [2023-12-28 01:55:08,501][106225] Updated weights for policy 1, policy_version 929650 (0.0008) [2023-12-28 01:55:08,561][106225] Updated weights for policy 1, policy_version 929660 (0.0008) [2023-12-28 01:55:08,593][106226] Updated weights for policy 0, policy_version 927307 (0.0008) [2023-12-28 01:55:08,658][106226] Updated weights for policy 0, policy_version 927317 (0.0008) [2023-12-28 01:55:08,716][106226] Updated weights for policy 0, policy_version 927327 (0.0008) [2023-12-28 01:55:09,328][106225] Updated weights for policy 1, policy_version 929670 (0.0009) [2023-12-28 01:55:09,371][106226] Updated weights for policy 0, policy_version 927337 (0.0008) [2023-12-28 01:55:09,407][106225] Updated weights for policy 1, policy_version 929680 (0.0009) [2023-12-28 01:55:09,449][106226] Updated weights for policy 0, policy_version 927347 (0.0009) [2023-12-28 01:55:09,476][106225] Updated weights for policy 1, policy_version 929690 (0.0009) [2023-12-28 01:55:09,511][106226] Updated weights for policy 0, policy_version 927357 (0.0006) [2023-12-28 01:55:09,571][106226] Updated weights for policy 0, policy_version 927367 (0.0008) [2023-12-28 01:55:10,195][106225] Updated weights for policy 1, policy_version 929700 (0.0009) [2023-12-28 01:55:10,260][106225] Updated weights for policy 1, policy_version 929710 (0.0008) [2023-12-28 01:55:10,324][106225] Updated weights for policy 1, policy_version 929720 (0.0006) [2023-12-28 01:55:10,376][106226] Updated weights for policy 0, policy_version 927377 (0.0007) [2023-12-28 01:55:10,440][106226] Updated weights for policy 0, policy_version 927387 (0.0007) [2023-12-28 01:55:10,500][106226] Updated weights for policy 0, policy_version 927397 (0.0009) [2023-12-28 01:55:11,005][106225] Updated weights for policy 1, policy_version 929730 (0.0008) [2023-12-28 01:55:11,077][106225] Updated weights for policy 1, policy_version 929740 (0.0010) [2023-12-28 01:55:11,133][106225] Updated weights for policy 1, policy_version 929750 (0.0010) [2023-12-28 01:55:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 475521024. Throughput: 0: 10116.5, 1: 10032.2. Samples: 475500692. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:55:11,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-5.101')] [2023-12-28 01:55:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000927400_237469696.pth... [2023-12-28 01:55:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000926248_237174784.pth [2023-12-28 01:55:11,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000929760_238059520.pth... [2023-12-28 01:55:11,210][106225] Updated weights for policy 1, policy_version 929760 (0.0009) [2023-12-28 01:55:11,213][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000928576_237756416.pth [2023-12-28 01:55:11,277][106226] Updated weights for policy 0, policy_version 927407 (0.0008) [2023-12-28 01:55:11,345][106226] Updated weights for policy 0, policy_version 927417 (0.0008) [2023-12-28 01:55:11,417][106226] Updated weights for policy 0, policy_version 927427 (0.0008) [2023-12-28 01:55:11,960][106225] Updated weights for policy 1, policy_version 929770 (0.0010) [2023-12-28 01:55:12,022][106225] Updated weights for policy 1, policy_version 929780 (0.0006) [2023-12-28 01:55:12,078][106225] Updated weights for policy 1, policy_version 929790 (0.0009) [2023-12-28 01:55:12,145][106226] Updated weights for policy 0, policy_version 927437 (0.0009) [2023-12-28 01:55:12,196][106226] Updated weights for policy 0, policy_version 927447 (0.0009) [2023-12-28 01:55:12,245][106226] Updated weights for policy 0, policy_version 927457 (0.0009) [2023-12-28 01:55:12,784][106225] Updated weights for policy 1, policy_version 929800 (0.0009) [2023-12-28 01:55:12,846][106225] Updated weights for policy 1, policy_version 929810 (0.0007) [2023-12-28 01:55:12,907][106225] Updated weights for policy 1, policy_version 929820 (0.0008) [2023-12-28 01:55:13,021][106226] Updated weights for policy 0, policy_version 927467 (0.0009) [2023-12-28 01:55:13,087][106226] Updated weights for policy 0, policy_version 927477 (0.0011) [2023-12-28 01:55:13,146][106226] Updated weights for policy 0, policy_version 927487 (0.0011) [2023-12-28 01:55:13,605][106225] Updated weights for policy 1, policy_version 929830 (0.0009) [2023-12-28 01:55:13,663][106225] Updated weights for policy 1, policy_version 929840 (0.0009) [2023-12-28 01:55:13,718][106225] Updated weights for policy 1, policy_version 929850 (0.0008) [2023-12-28 01:55:13,755][106226] Updated weights for policy 0, policy_version 927497 (0.0011) [2023-12-28 01:55:13,811][106226] Updated weights for policy 0, policy_version 927507 (0.0010) [2023-12-28 01:55:13,861][106226] Updated weights for policy 0, policy_version 927517 (0.0010) [2023-12-28 01:55:13,911][106226] Updated weights for policy 0, policy_version 927527 (0.0010) [2023-12-28 01:55:14,494][106225] Updated weights for policy 1, policy_version 929860 (0.0007) [2023-12-28 01:55:14,564][106225] Updated weights for policy 1, policy_version 929870 (0.0006) [2023-12-28 01:55:14,608][106226] Updated weights for policy 0, policy_version 927537 (0.0011) [2023-12-28 01:55:14,623][106225] Updated weights for policy 1, policy_version 929880 (0.0009) [2023-12-28 01:55:14,665][106226] Updated weights for policy 0, policy_version 927547 (0.0010) [2023-12-28 01:55:14,722][106226] Updated weights for policy 0, policy_version 927557 (0.0011) [2023-12-28 01:55:15,318][106225] Updated weights for policy 1, policy_version 929890 (0.0009) [2023-12-28 01:55:15,379][106225] Updated weights for policy 1, policy_version 929900 (0.0009) [2023-12-28 01:55:15,443][106225] Updated weights for policy 1, policy_version 929910 (0.0008) [2023-12-28 01:55:15,460][106226] Updated weights for policy 0, policy_version 927567 (0.0011) [2023-12-28 01:55:15,501][106225] Updated weights for policy 1, policy_version 929920 (0.0007) [2023-12-28 01:55:15,520][106226] Updated weights for policy 0, policy_version 927577 (0.0010) [2023-12-28 01:55:15,581][106226] Updated weights for policy 0, policy_version 927587 (0.0010) [2023-12-28 01:55:16,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 475619328. Throughput: 0: 9976.7, 1: 9889.8. Samples: 475615748. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:55:16,176][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.050')] [2023-12-28 01:55:16,193][106225] Updated weights for policy 1, policy_version 929930 (0.0007) [2023-12-28 01:55:16,201][106226] Updated weights for policy 0, policy_version 927597 (0.0009) [2023-12-28 01:55:16,254][106225] Updated weights for policy 1, policy_version 929940 (0.0006) [2023-12-28 01:55:16,256][106226] Updated weights for policy 0, policy_version 927607 (0.0007) [2023-12-28 01:55:16,310][106225] Updated weights for policy 1, policy_version 929950 (0.0005) [2023-12-28 01:55:16,315][106226] Updated weights for policy 0, policy_version 927617 (0.0008) [2023-12-28 01:55:16,936][106225] Updated weights for policy 1, policy_version 929960 (0.0008) [2023-12-28 01:55:16,991][106225] Updated weights for policy 1, policy_version 929970 (0.0009) [2023-12-28 01:55:17,051][106225] Updated weights for policy 1, policy_version 929980 (0.0009) [2023-12-28 01:55:17,058][106226] Updated weights for policy 0, policy_version 927627 (0.0008) [2023-12-28 01:55:17,106][106226] Updated weights for policy 0, policy_version 927637 (0.0005) [2023-12-28 01:55:17,167][106226] Updated weights for policy 0, policy_version 927647 (0.0005) [2023-12-28 01:55:17,684][106226] Updated weights for policy 0, policy_version 927657 (0.0005) [2023-12-28 01:55:17,747][106226] Updated weights for policy 0, policy_version 927667 (0.0005) [2023-12-28 01:55:17,757][106225] Updated weights for policy 1, policy_version 929990 (0.0009) [2023-12-28 01:55:17,802][106226] Updated weights for policy 0, policy_version 927677 (0.0005) [2023-12-28 01:55:17,811][106225] Updated weights for policy 1, policy_version 930000 (0.0010) [2023-12-28 01:55:17,866][106226] Updated weights for policy 0, policy_version 927687 (0.0005) [2023-12-28 01:55:17,868][106225] Updated weights for policy 1, policy_version 930010 (0.0010) [2023-12-28 01:55:18,534][106226] Updated weights for policy 0, policy_version 927697 (0.0008) [2023-12-28 01:55:18,585][106225] Updated weights for policy 1, policy_version 930020 (0.0010) [2023-12-28 01:55:18,595][106226] Updated weights for policy 0, policy_version 927707 (0.0007) [2023-12-28 01:55:18,643][106225] Updated weights for policy 1, policy_version 930030 (0.0011) [2023-12-28 01:55:18,658][106226] Updated weights for policy 0, policy_version 927717 (0.0006) [2023-12-28 01:55:18,702][106225] Updated weights for policy 1, policy_version 930040 (0.0011) [2023-12-28 01:55:19,392][106225] Updated weights for policy 1, policy_version 930050 (0.0010) [2023-12-28 01:55:19,397][106226] Updated weights for policy 0, policy_version 927727 (0.0006) [2023-12-28 01:55:19,462][106225] Updated weights for policy 1, policy_version 930060 (0.0006) [2023-12-28 01:55:19,463][106226] Updated weights for policy 0, policy_version 927737 (0.0007) [2023-12-28 01:55:19,530][106225] Updated weights for policy 1, policy_version 930070 (0.0008) [2023-12-28 01:55:19,531][106226] Updated weights for policy 0, policy_version 927747 (0.0007) [2023-12-28 01:55:19,591][106225] Updated weights for policy 1, policy_version 930080 (0.0009) [2023-12-28 01:55:20,233][106226] Updated weights for policy 0, policy_version 927757 (0.0009) [2023-12-28 01:55:20,282][106225] Updated weights for policy 1, policy_version 930090 (0.0006) [2023-12-28 01:55:20,292][106226] Updated weights for policy 0, policy_version 927767 (0.0006) [2023-12-28 01:55:20,345][106225] Updated weights for policy 1, policy_version 930100 (0.0008) [2023-12-28 01:55:20,346][106226] Updated weights for policy 0, policy_version 927777 (0.0006) [2023-12-28 01:55:20,408][106225] Updated weights for policy 1, policy_version 930110 (0.0007) [2023-12-28 01:55:21,022][106226] Updated weights for policy 0, policy_version 927787 (0.0007) [2023-12-28 01:55:21,090][106226] Updated weights for policy 0, policy_version 927797 (0.0010) [2023-12-28 01:55:21,167][106226] Updated weights for policy 0, policy_version 927807 (0.0023) [2023-12-28 01:55:21,170][106225] Updated weights for policy 1, policy_version 930120 (0.0007) [2023-12-28 01:55:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 475717632. Throughput: 0: 10052.8, 1: 9879.7. Samples: 475735692. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 01:55:21,175][105115] Avg episode reward: [(0, '-4.397'), (1, '-4.680')] [2023-12-28 01:55:21,231][106225] Updated weights for policy 1, policy_version 930130 (0.0008) [2023-12-28 01:55:21,292][106225] Updated weights for policy 1, policy_version 930140 (0.0008) [2023-12-28 01:55:21,916][106226] Updated weights for policy 0, policy_version 927817 (0.0008) [2023-12-28 01:55:21,982][106226] Updated weights for policy 0, policy_version 927827 (0.0008) [2023-12-28 01:55:22,032][106226] Updated weights for policy 0, policy_version 927837 (0.0006) [2023-12-28 01:55:22,090][106226] Updated weights for policy 0, policy_version 927847 (0.0006) [2023-12-28 01:55:22,099][106225] Updated weights for policy 1, policy_version 930150 (0.0007) [2023-12-28 01:55:22,168][106225] Updated weights for policy 1, policy_version 930160 (0.0008) [2023-12-28 01:55:22,244][106225] Updated weights for policy 1, policy_version 930170 (0.0006) [2023-12-28 01:55:22,808][106226] Updated weights for policy 0, policy_version 927857 (0.0009) [2023-12-28 01:55:22,864][106226] Updated weights for policy 0, policy_version 927867 (0.0006) [2023-12-28 01:55:22,913][106226] Updated weights for policy 0, policy_version 927877 (0.0005) [2023-12-28 01:55:22,928][106225] Updated weights for policy 1, policy_version 930180 (0.0010) [2023-12-28 01:55:22,987][106225] Updated weights for policy 1, policy_version 930190 (0.0008) [2023-12-28 01:55:23,049][106225] Updated weights for policy 1, policy_version 930200 (0.0008) [2023-12-28 01:55:23,541][106226] Updated weights for policy 0, policy_version 927887 (0.0008) [2023-12-28 01:55:23,605][106226] Updated weights for policy 0, policy_version 927897 (0.0008) [2023-12-28 01:55:23,663][106226] Updated weights for policy 0, policy_version 927907 (0.0008) [2023-12-28 01:55:23,797][106225] Updated weights for policy 1, policy_version 930210 (0.0008) [2023-12-28 01:55:23,845][106225] Updated weights for policy 1, policy_version 930220 (0.0008) [2023-12-28 01:55:23,897][106225] Updated weights for policy 1, policy_version 930230 (0.0009) [2023-12-28 01:55:23,952][106225] Updated weights for policy 1, policy_version 930240 (0.0009) [2023-12-28 01:55:24,352][106226] Updated weights for policy 0, policy_version 927917 (0.0009) [2023-12-28 01:55:24,411][106226] Updated weights for policy 0, policy_version 927927 (0.0008) [2023-12-28 01:55:24,462][106226] Updated weights for policy 0, policy_version 927937 (0.0009) [2023-12-28 01:55:24,778][106225] Updated weights for policy 1, policy_version 930250 (0.0009) [2023-12-28 01:55:24,844][106225] Updated weights for policy 1, policy_version 930260 (0.0008) [2023-12-28 01:55:24,903][106225] Updated weights for policy 1, policy_version 930270 (0.0008) [2023-12-28 01:55:25,113][106226] Updated weights for policy 0, policy_version 927947 (0.0009) [2023-12-28 01:55:25,172][106226] Updated weights for policy 0, policy_version 927957 (0.0008) [2023-12-28 01:55:25,233][106226] Updated weights for policy 0, policy_version 927967 (0.0009) [2023-12-28 01:55:25,638][106225] Updated weights for policy 1, policy_version 930280 (0.0009) [2023-12-28 01:55:25,688][106225] Updated weights for policy 1, policy_version 930290 (0.0008) [2023-12-28 01:55:25,737][106225] Updated weights for policy 1, policy_version 930300 (0.0008) [2023-12-28 01:55:25,910][106226] Updated weights for policy 0, policy_version 927977 (0.0008) [2023-12-28 01:55:25,964][106226] Updated weights for policy 0, policy_version 927987 (0.0008) [2023-12-28 01:55:26,011][106226] Updated weights for policy 0, policy_version 927997 (0.0008) [2023-12-28 01:55:26,058][106226] Updated weights for policy 0, policy_version 928007 (0.0008) [2023-12-28 01:55:26,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 475824128. Throughput: 0: 10044.0, 1: 9824.5. Samples: 475793216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:26,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.137')] [2023-12-28 01:55:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000930304_238198784.pth... [2023-12-28 01:55:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000928008_237625344.pth... [2023-12-28 01:55:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000926824_237322240.pth [2023-12-28 01:55:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000929184_237912064.pth [2023-12-28 01:55:26,451][106225] Updated weights for policy 1, policy_version 930310 (0.0007) [2023-12-28 01:55:26,514][106225] Updated weights for policy 1, policy_version 930320 (0.0006) [2023-12-28 01:55:26,572][106225] Updated weights for policy 1, policy_version 930330 (0.0009) [2023-12-28 01:55:26,797][106226] Updated weights for policy 0, policy_version 928017 (0.0008) [2023-12-28 01:55:26,871][106226] Updated weights for policy 0, policy_version 928027 (0.0009) [2023-12-28 01:55:26,930][106226] Updated weights for policy 0, policy_version 928037 (0.0008) [2023-12-28 01:55:27,091][106225] Updated weights for policy 1, policy_version 930340 (0.0005) [2023-12-28 01:55:27,144][106225] Updated weights for policy 1, policy_version 930350 (0.0007) [2023-12-28 01:55:27,207][106225] Updated weights for policy 1, policy_version 930360 (0.0008) [2023-12-28 01:55:27,676][106226] Updated weights for policy 0, policy_version 928047 (0.0006) [2023-12-28 01:55:27,731][106226] Updated weights for policy 0, policy_version 928057 (0.0006) [2023-12-28 01:55:27,776][106226] Updated weights for policy 0, policy_version 928067 (0.0009) [2023-12-28 01:55:27,865][106225] Updated weights for policy 1, policy_version 930370 (0.0009) [2023-12-28 01:55:27,914][106225] Updated weights for policy 1, policy_version 930380 (0.0005) [2023-12-28 01:55:27,961][106225] Updated weights for policy 1, policy_version 930390 (0.0008) [2023-12-28 01:55:28,013][106225] Updated weights for policy 1, policy_version 930400 (0.0008) [2023-12-28 01:55:28,386][106226] Updated weights for policy 0, policy_version 928077 (0.0008) [2023-12-28 01:55:28,455][106226] Updated weights for policy 0, policy_version 928087 (0.0006) [2023-12-28 01:55:28,512][106226] Updated weights for policy 0, policy_version 928097 (0.0009) [2023-12-28 01:55:28,624][106225] Updated weights for policy 1, policy_version 930410 (0.0008) [2023-12-28 01:55:28,687][106225] Updated weights for policy 1, policy_version 930420 (0.0005) [2023-12-28 01:55:28,738][106225] Updated weights for policy 1, policy_version 930430 (0.0005) [2023-12-28 01:55:29,240][106226] Updated weights for policy 0, policy_version 928107 (0.0009) [2023-12-28 01:55:29,298][106226] Updated weights for policy 0, policy_version 928117 (0.0007) [2023-12-28 01:55:29,356][106226] Updated weights for policy 0, policy_version 928127 (0.0008) [2023-12-28 01:55:29,387][106225] Updated weights for policy 1, policy_version 930440 (0.0009) [2023-12-28 01:55:29,448][106225] Updated weights for policy 1, policy_version 930450 (0.0008) [2023-12-28 01:55:29,504][106225] Updated weights for policy 1, policy_version 930460 (0.0007) [2023-12-28 01:55:30,115][106226] Updated weights for policy 0, policy_version 928137 (0.0007) [2023-12-28 01:55:30,185][106226] Updated weights for policy 0, policy_version 928147 (0.0006) [2023-12-28 01:55:30,226][106225] Updated weights for policy 1, policy_version 930470 (0.0007) [2023-12-28 01:55:30,243][106226] Updated weights for policy 0, policy_version 928157 (0.0007) [2023-12-28 01:55:30,292][106225] Updated weights for policy 1, policy_version 930480 (0.0006) [2023-12-28 01:55:30,312][106226] Updated weights for policy 0, policy_version 928167 (0.0007) [2023-12-28 01:55:30,353][106225] Updated weights for policy 1, policy_version 930490 (0.0007) [2023-12-28 01:55:30,875][106226] Updated weights for policy 0, policy_version 928177 (0.0005) [2023-12-28 01:55:30,920][106226] Updated weights for policy 0, policy_version 928187 (0.0005) [2023-12-28 01:55:30,967][106226] Updated weights for policy 0, policy_version 928197 (0.0007) [2023-12-28 01:55:31,090][106225] Updated weights for policy 1, policy_version 930500 (0.0008) [2023-12-28 01:55:31,151][106225] Updated weights for policy 1, policy_version 930510 (0.0007) [2023-12-28 01:55:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 475922432. Throughput: 0: 10026.1, 1: 9908.0. Samples: 475914332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:31,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.224')] [2023-12-28 01:55:31,208][106225] Updated weights for policy 1, policy_version 930520 (0.0007) [2023-12-28 01:55:31,716][106226] Updated weights for policy 0, policy_version 928207 (0.0010) [2023-12-28 01:55:31,789][106226] Updated weights for policy 0, policy_version 928217 (0.0011) [2023-12-28 01:55:31,850][106226] Updated weights for policy 0, policy_version 928227 (0.0011) [2023-12-28 01:55:31,960][106225] Updated weights for policy 1, policy_version 930530 (0.0007) [2023-12-28 01:55:32,022][106225] Updated weights for policy 1, policy_version 930540 (0.0007) [2023-12-28 01:55:32,090][106225] Updated weights for policy 1, policy_version 930550 (0.0006) [2023-12-28 01:55:32,148][106225] Updated weights for policy 1, policy_version 930560 (0.0008) [2023-12-28 01:55:32,559][106226] Updated weights for policy 0, policy_version 928237 (0.0008) [2023-12-28 01:55:32,616][106226] Updated weights for policy 0, policy_version 928247 (0.0010) [2023-12-28 01:55:32,675][106226] Updated weights for policy 0, policy_version 928257 (0.0006) [2023-12-28 01:55:32,859][106225] Updated weights for policy 1, policy_version 930570 (0.0008) [2023-12-28 01:55:32,920][106225] Updated weights for policy 1, policy_version 930580 (0.0008) [2023-12-28 01:55:32,974][106225] Updated weights for policy 1, policy_version 930590 (0.0008) [2023-12-28 01:55:33,302][106226] Updated weights for policy 0, policy_version 928267 (0.0005) [2023-12-28 01:55:33,353][106226] Updated weights for policy 0, policy_version 928277 (0.0010) [2023-12-28 01:55:33,402][106226] Updated weights for policy 0, policy_version 928287 (0.0007) [2023-12-28 01:55:33,642][106225] Updated weights for policy 1, policy_version 930600 (0.0007) [2023-12-28 01:55:33,694][106225] Updated weights for policy 1, policy_version 930610 (0.0010) [2023-12-28 01:55:33,756][106225] Updated weights for policy 1, policy_version 930620 (0.0010) [2023-12-28 01:55:34,024][106226] Updated weights for policy 0, policy_version 928297 (0.0006) [2023-12-28 01:55:34,080][106226] Updated weights for policy 0, policy_version 928307 (0.0007) [2023-12-28 01:55:34,137][106226] Updated weights for policy 0, policy_version 928317 (0.0007) [2023-12-28 01:55:34,199][106226] Updated weights for policy 0, policy_version 928327 (0.0007) [2023-12-28 01:55:34,463][106225] Updated weights for policy 1, policy_version 930630 (0.0010) [2023-12-28 01:55:34,526][106225] Updated weights for policy 1, policy_version 930640 (0.0010) [2023-12-28 01:55:34,593][106225] Updated weights for policy 1, policy_version 930650 (0.0008) [2023-12-28 01:55:34,850][106226] Updated weights for policy 0, policy_version 928337 (0.0007) [2023-12-28 01:55:34,912][106226] Updated weights for policy 0, policy_version 928347 (0.0006) [2023-12-28 01:55:34,976][106226] Updated weights for policy 0, policy_version 928357 (0.0005) [2023-12-28 01:55:35,276][106225] Updated weights for policy 1, policy_version 930660 (0.0008) [2023-12-28 01:55:35,335][106225] Updated weights for policy 1, policy_version 930670 (0.0010) [2023-12-28 01:55:35,394][106225] Updated weights for policy 1, policy_version 930680 (0.0010) [2023-12-28 01:55:35,652][106226] Updated weights for policy 0, policy_version 928367 (0.0008) [2023-12-28 01:55:35,714][106226] Updated weights for policy 0, policy_version 928377 (0.0008) [2023-12-28 01:55:35,772][106226] Updated weights for policy 0, policy_version 928387 (0.0008) [2023-12-28 01:55:36,087][106225] Updated weights for policy 1, policy_version 930690 (0.0009) [2023-12-28 01:55:36,141][106225] Updated weights for policy 1, policy_version 930700 (0.0008) [2023-12-28 01:55:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 476020736. Throughput: 0: 10026.0, 1: 9898.2. Samples: 476034184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:36,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-5.227')] [2023-12-28 01:55:36,205][106225] Updated weights for policy 1, policy_version 930710 (0.0006) [2023-12-28 01:55:36,261][106225] Updated weights for policy 1, policy_version 930720 (0.0005) [2023-12-28 01:55:36,525][106226] Updated weights for policy 0, policy_version 928397 (0.0007) [2023-12-28 01:55:36,588][106226] Updated weights for policy 0, policy_version 928407 (0.0008) [2023-12-28 01:55:36,651][106226] Updated weights for policy 0, policy_version 928417 (0.0007) [2023-12-28 01:55:36,924][106225] Updated weights for policy 1, policy_version 930730 (0.0010) [2023-12-28 01:55:36,984][106225] Updated weights for policy 1, policy_version 930740 (0.0010) [2023-12-28 01:55:37,037][106225] Updated weights for policy 1, policy_version 930750 (0.0010) [2023-12-28 01:55:37,317][106226] Updated weights for policy 0, policy_version 928427 (0.0008) [2023-12-28 01:55:37,367][106226] Updated weights for policy 0, policy_version 928437 (0.0007) [2023-12-28 01:55:37,422][106226] Updated weights for policy 0, policy_version 928447 (0.0007) [2023-12-28 01:55:37,754][106225] Updated weights for policy 1, policy_version 930760 (0.0008) [2023-12-28 01:55:37,821][106225] Updated weights for policy 1, policy_version 930770 (0.0008) [2023-12-28 01:55:37,877][106225] Updated weights for policy 1, policy_version 930780 (0.0008) [2023-12-28 01:55:38,135][106226] Updated weights for policy 0, policy_version 928457 (0.0008) [2023-12-28 01:55:38,194][106226] Updated weights for policy 0, policy_version 928467 (0.0010) [2023-12-28 01:55:38,247][106226] Updated weights for policy 0, policy_version 928477 (0.0007) [2023-12-28 01:55:38,308][106226] Updated weights for policy 0, policy_version 928487 (0.0006) [2023-12-28 01:55:38,543][106225] Updated weights for policy 1, policy_version 930790 (0.0009) [2023-12-28 01:55:38,606][106225] Updated weights for policy 1, policy_version 930800 (0.0008) [2023-12-28 01:55:38,670][106225] Updated weights for policy 1, policy_version 930810 (0.0008) [2023-12-28 01:55:38,982][106226] Updated weights for policy 0, policy_version 928497 (0.0008) [2023-12-28 01:55:39,043][106226] Updated weights for policy 0, policy_version 928507 (0.0009) [2023-12-28 01:55:39,100][106226] Updated weights for policy 0, policy_version 928517 (0.0008) [2023-12-28 01:55:39,424][106225] Updated weights for policy 1, policy_version 930820 (0.0008) [2023-12-28 01:55:39,486][106225] Updated weights for policy 1, policy_version 930830 (0.0009) [2023-12-28 01:55:39,553][106225] Updated weights for policy 1, policy_version 930840 (0.0010) [2023-12-28 01:55:39,813][106226] Updated weights for policy 0, policy_version 928527 (0.0008) [2023-12-28 01:55:39,879][106226] Updated weights for policy 0, policy_version 928537 (0.0008) [2023-12-28 01:55:39,950][106226] Updated weights for policy 0, policy_version 928547 (0.0009) [2023-12-28 01:55:40,337][106225] Updated weights for policy 1, policy_version 930850 (0.0009) [2023-12-28 01:55:40,399][106225] Updated weights for policy 1, policy_version 930860 (0.0010) [2023-12-28 01:55:40,462][106225] Updated weights for policy 1, policy_version 930870 (0.0009) [2023-12-28 01:55:40,519][106225] Updated weights for policy 1, policy_version 930880 (0.0010) [2023-12-28 01:55:40,684][106226] Updated weights for policy 0, policy_version 928557 (0.0008) [2023-12-28 01:55:40,732][106226] Updated weights for policy 0, policy_version 928567 (0.0008) [2023-12-28 01:55:40,786][106226] Updated weights for policy 0, policy_version 928577 (0.0007) [2023-12-28 01:55:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 476119040. Throughput: 0: 10033.0, 1: 9886.3. Samples: 476093824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:41,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.896')] [2023-12-28 01:55:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000928584_237772800.pth... [2023-12-28 01:55:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000927400_237469696.pth [2023-12-28 01:55:41,216][106225] Updated weights for policy 1, policy_version 930890 (0.0007) [2023-12-28 01:55:41,283][106225] Updated weights for policy 1, policy_version 930900 (0.0009) [2023-12-28 01:55:41,344][106225] Updated weights for policy 1, policy_version 930910 (0.0011) [2023-12-28 01:55:41,358][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000930912_238354432.pth... [2023-12-28 01:55:41,363][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000929760_238059520.pth [2023-12-28 01:55:41,543][106226] Updated weights for policy 0, policy_version 928587 (0.0005) [2023-12-28 01:55:41,601][106226] Updated weights for policy 0, policy_version 928597 (0.0008) [2023-12-28 01:55:41,669][106226] Updated weights for policy 0, policy_version 928607 (0.0010) [2023-12-28 01:55:42,025][106225] Updated weights for policy 1, policy_version 930920 (0.0008) [2023-12-28 01:55:42,085][106225] Updated weights for policy 1, policy_version 930930 (0.0008) [2023-12-28 01:55:42,151][106225] Updated weights for policy 1, policy_version 930940 (0.0010) [2023-12-28 01:55:42,435][106226] Updated weights for policy 0, policy_version 928617 (0.0009) [2023-12-28 01:55:42,491][106226] Updated weights for policy 0, policy_version 928627 (0.0006) [2023-12-28 01:55:42,553][106226] Updated weights for policy 0, policy_version 928637 (0.0006) [2023-12-28 01:55:42,618][106226] Updated weights for policy 0, policy_version 928647 (0.0006) [2023-12-28 01:55:42,878][106225] Updated weights for policy 1, policy_version 930950 (0.0011) [2023-12-28 01:55:42,939][106225] Updated weights for policy 1, policy_version 930960 (0.0010) [2023-12-28 01:55:42,987][106225] Updated weights for policy 1, policy_version 930970 (0.0008) [2023-12-28 01:55:43,261][106226] Updated weights for policy 0, policy_version 928657 (0.0008) [2023-12-28 01:55:43,311][106226] Updated weights for policy 0, policy_version 928667 (0.0009) [2023-12-28 01:55:43,361][106226] Updated weights for policy 0, policy_version 928677 (0.0008) [2023-12-28 01:55:43,661][106225] Updated weights for policy 1, policy_version 930980 (0.0008) [2023-12-28 01:55:43,716][106225] Updated weights for policy 1, policy_version 930990 (0.0008) [2023-12-28 01:55:43,766][106225] Updated weights for policy 1, policy_version 931000 (0.0006) [2023-12-28 01:55:44,205][106226] Updated weights for policy 0, policy_version 928687 (0.0008) [2023-12-28 01:55:44,272][106226] Updated weights for policy 0, policy_version 928697 (0.0009) [2023-12-28 01:55:44,304][106225] Updated weights for policy 1, policy_version 931010 (0.0006) [2023-12-28 01:55:44,338][106226] Updated weights for policy 0, policy_version 928707 (0.0006) [2023-12-28 01:55:44,366][106225] Updated weights for policy 1, policy_version 931020 (0.0008) [2023-12-28 01:55:44,427][106225] Updated weights for policy 1, policy_version 931030 (0.0008) [2023-12-28 01:55:44,490][106225] Updated weights for policy 1, policy_version 931040 (0.0005) [2023-12-28 01:55:44,994][106226] Updated weights for policy 0, policy_version 928717 (0.0005) [2023-12-28 01:55:45,059][106226] Updated weights for policy 0, policy_version 928727 (0.0005) [2023-12-28 01:55:45,126][106226] Updated weights for policy 0, policy_version 928737 (0.0007) [2023-12-28 01:55:45,214][106225] Updated weights for policy 1, policy_version 931050 (0.0008) [2023-12-28 01:55:45,274][106225] Updated weights for policy 1, policy_version 931060 (0.0009) [2023-12-28 01:55:45,333][106225] Updated weights for policy 1, policy_version 931070 (0.0008) [2023-12-28 01:55:45,800][106226] Updated weights for policy 0, policy_version 928747 (0.0006) [2023-12-28 01:55:45,855][106226] Updated weights for policy 0, policy_version 928757 (0.0009) [2023-12-28 01:55:45,917][106226] Updated weights for policy 0, policy_version 928767 (0.0010) [2023-12-28 01:55:45,976][106225] Updated weights for policy 1, policy_version 931080 (0.0009) [2023-12-28 01:55:46,033][106225] Updated weights for policy 1, policy_version 931090 (0.0010) [2023-12-28 01:55:46,083][106225] Updated weights for policy 1, policy_version 931100 (0.0010) [2023-12-28 01:55:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 476225536. Throughput: 0: 9901.7, 1: 9827.2. Samples: 476210720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:46,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.934')] [2023-12-28 01:55:46,700][106226] Updated weights for policy 0, policy_version 928777 (0.0006) [2023-12-28 01:55:46,764][106226] Updated weights for policy 0, policy_version 928787 (0.0007) [2023-12-28 01:55:46,784][106225] Updated weights for policy 1, policy_version 931110 (0.0010) [2023-12-28 01:55:46,821][106226] Updated weights for policy 0, policy_version 928797 (0.0006) [2023-12-28 01:55:46,836][106225] Updated weights for policy 1, policy_version 931120 (0.0009) [2023-12-28 01:55:46,871][106226] Updated weights for policy 0, policy_version 928807 (0.0008) [2023-12-28 01:55:46,887][106225] Updated weights for policy 1, policy_version 931130 (0.0010) [2023-12-28 01:55:47,596][106225] Updated weights for policy 1, policy_version 931140 (0.0010) [2023-12-28 01:55:47,616][106226] Updated weights for policy 0, policy_version 928817 (0.0006) [2023-12-28 01:55:47,644][106225] Updated weights for policy 1, policy_version 931150 (0.0005) [2023-12-28 01:55:47,681][106226] Updated weights for policy 0, policy_version 928827 (0.0005) [2023-12-28 01:55:47,703][106225] Updated weights for policy 1, policy_version 931160 (0.0005) [2023-12-28 01:55:47,748][106226] Updated weights for policy 0, policy_version 928837 (0.0006) [2023-12-28 01:55:48,312][106225] Updated weights for policy 1, policy_version 931170 (0.0006) [2023-12-28 01:55:48,376][106225] Updated weights for policy 1, policy_version 931180 (0.0010) [2023-12-28 01:55:48,424][106226] Updated weights for policy 0, policy_version 928847 (0.0006) [2023-12-28 01:55:48,440][106225] Updated weights for policy 1, policy_version 931190 (0.0011) [2023-12-28 01:55:48,488][106226] Updated weights for policy 0, policy_version 928857 (0.0006) [2023-12-28 01:55:48,501][106225] Updated weights for policy 1, policy_version 931200 (0.0010) [2023-12-28 01:55:48,548][106226] Updated weights for policy 0, policy_version 928867 (0.0007) [2023-12-28 01:55:49,192][106225] Updated weights for policy 1, policy_version 931210 (0.0011) [2023-12-28 01:55:49,251][106226] Updated weights for policy 0, policy_version 928877 (0.0008) [2023-12-28 01:55:49,260][106225] Updated weights for policy 1, policy_version 931220 (0.0009) [2023-12-28 01:55:49,317][106225] Updated weights for policy 1, policy_version 931230 (0.0008) [2023-12-28 01:55:49,320][106226] Updated weights for policy 0, policy_version 928887 (0.0007) [2023-12-28 01:55:49,391][106226] Updated weights for policy 0, policy_version 928898 (0.0008) [2023-12-28 01:55:50,086][106225] Updated weights for policy 1, policy_version 931240 (0.0010) [2023-12-28 01:55:50,127][106226] Updated weights for policy 0, policy_version 928908 (0.0008) [2023-12-28 01:55:50,141][106225] Updated weights for policy 1, policy_version 931250 (0.0010) [2023-12-28 01:55:50,188][106226] Updated weights for policy 0, policy_version 928918 (0.0006) [2023-12-28 01:55:50,198][106225] Updated weights for policy 1, policy_version 931260 (0.0008) [2023-12-28 01:55:50,249][106226] Updated weights for policy 0, policy_version 928928 (0.0008) [2023-12-28 01:55:50,893][106225] Updated weights for policy 1, policy_version 931270 (0.0009) [2023-12-28 01:55:50,930][106226] Updated weights for policy 0, policy_version 928938 (0.0008) [2023-12-28 01:55:50,949][106225] Updated weights for policy 1, policy_version 931280 (0.0010) [2023-12-28 01:55:50,987][106226] Updated weights for policy 0, policy_version 928948 (0.0006) [2023-12-28 01:55:51,011][106225] Updated weights for policy 1, policy_version 931290 (0.0010) [2023-12-28 01:55:51,058][106226] Updated weights for policy 0, policy_version 928958 (0.0007) [2023-12-28 01:55:51,116][106226] Updated weights for policy 0, policy_version 928968 (0.0007) [2023-12-28 01:55:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 476323840. Throughput: 0: 9886.0, 1: 9818.2. Samples: 476327604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:51,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-5.107')] [2023-12-28 01:55:51,784][106225] Updated weights for policy 1, policy_version 931300 (0.0010) [2023-12-28 01:55:51,839][106225] Updated weights for policy 1, policy_version 931310 (0.0010) [2023-12-28 01:55:51,881][106226] Updated weights for policy 0, policy_version 928978 (0.0006) [2023-12-28 01:55:51,890][106225] Updated weights for policy 1, policy_version 931320 (0.0010) [2023-12-28 01:55:51,949][106226] Updated weights for policy 0, policy_version 928988 (0.0006) [2023-12-28 01:55:52,015][106226] Updated weights for policy 0, policy_version 928998 (0.0008) [2023-12-28 01:55:52,601][106225] Updated weights for policy 1, policy_version 931330 (0.0009) [2023-12-28 01:55:52,668][106225] Updated weights for policy 1, policy_version 931340 (0.0005) [2023-12-28 01:55:52,733][106225] Updated weights for policy 1, policy_version 931350 (0.0005) [2023-12-28 01:55:52,744][106226] Updated weights for policy 0, policy_version 929008 (0.0007) [2023-12-28 01:55:52,796][106225] Updated weights for policy 1, policy_version 931360 (0.0009) [2023-12-28 01:55:52,799][106226] Updated weights for policy 0, policy_version 929018 (0.0007) [2023-12-28 01:55:52,853][106226] Updated weights for policy 0, policy_version 929028 (0.0008) [2023-12-28 01:55:53,459][106225] Updated weights for policy 1, policy_version 931370 (0.0009) [2023-12-28 01:55:53,507][106225] Updated weights for policy 1, policy_version 931380 (0.0008) [2023-12-28 01:55:53,552][106225] Updated weights for policy 1, policy_version 931390 (0.0006) [2023-12-28 01:55:53,558][106226] Updated weights for policy 0, policy_version 929038 (0.0008) [2023-12-28 01:55:53,606][106226] Updated weights for policy 0, policy_version 929048 (0.0008) [2023-12-28 01:55:53,656][106226] Updated weights for policy 0, policy_version 929058 (0.0006) [2023-12-28 01:55:54,209][106226] Updated weights for policy 0, policy_version 929068 (0.0008) [2023-12-28 01:55:54,252][106225] Updated weights for policy 1, policy_version 931400 (0.0009) [2023-12-28 01:55:54,266][106226] Updated weights for policy 0, policy_version 929078 (0.0010) [2023-12-28 01:55:54,303][106225] Updated weights for policy 1, policy_version 931410 (0.0010) [2023-12-28 01:55:54,342][106226] Updated weights for policy 0, policy_version 929088 (0.0011) [2023-12-28 01:55:54,366][106225] Updated weights for policy 1, policy_version 931420 (0.0010) [2023-12-28 01:55:55,047][106226] Updated weights for policy 0, policy_version 929098 (0.0009) [2023-12-28 01:55:55,097][106226] Updated weights for policy 0, policy_version 929108 (0.0006) [2023-12-28 01:55:55,106][106225] Updated weights for policy 1, policy_version 931430 (0.0008) [2023-12-28 01:55:55,148][106226] Updated weights for policy 0, policy_version 929118 (0.0006) [2023-12-28 01:55:55,174][106225] Updated weights for policy 1, policy_version 931440 (0.0005) [2023-12-28 01:55:55,196][106226] Updated weights for policy 0, policy_version 929128 (0.0007) [2023-12-28 01:55:55,244][106225] Updated weights for policy 1, policy_version 931450 (0.0005) [2023-12-28 01:55:55,803][106226] Updated weights for policy 0, policy_version 929138 (0.0011) [2023-12-28 01:55:55,840][106225] Updated weights for policy 1, policy_version 931460 (0.0007) [2023-12-28 01:55:55,859][106226] Updated weights for policy 0, policy_version 929148 (0.0009) [2023-12-28 01:55:55,886][106225] Updated weights for policy 1, policy_version 931470 (0.0010) [2023-12-28 01:55:55,913][106226] Updated weights for policy 0, policy_version 929158 (0.0007) [2023-12-28 01:55:55,938][106225] Updated weights for policy 1, policy_version 931480 (0.0010) [2023-12-28 01:55:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 476422144. Throughput: 0: 9878.4, 1: 9806.1. Samples: 476386492. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:55:56,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-5.025')] [2023-12-28 01:55:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000929160_237920256.pth... [2023-12-28 01:55:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000931488_238501888.pth... [2023-12-28 01:55:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000928008_237625344.pth [2023-12-28 01:55:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000930304_238198784.pth [2023-12-28 01:55:56,601][106225] Updated weights for policy 1, policy_version 931490 (0.0009) [2023-12-28 01:55:56,604][106226] Updated weights for policy 0, policy_version 929168 (0.0008) [2023-12-28 01:55:56,654][106225] Updated weights for policy 1, policy_version 931500 (0.0005) [2023-12-28 01:55:56,668][106226] Updated weights for policy 0, policy_version 929178 (0.0008) [2023-12-28 01:55:56,714][106225] Updated weights for policy 1, policy_version 931510 (0.0005) [2023-12-28 01:55:56,714][106226] Updated weights for policy 0, policy_version 929188 (0.0009) [2023-12-28 01:55:56,773][106225] Updated weights for policy 1, policy_version 931520 (0.0006) [2023-12-28 01:55:57,295][106226] Updated weights for policy 0, policy_version 929198 (0.0006) [2023-12-28 01:55:57,348][106226] Updated weights for policy 0, policy_version 929208 (0.0005) [2023-12-28 01:55:57,403][106225] Updated weights for policy 1, policy_version 931530 (0.0008) [2023-12-28 01:55:57,405][106226] Updated weights for policy 0, policy_version 929218 (0.0005) [2023-12-28 01:55:57,456][106225] Updated weights for policy 1, policy_version 931540 (0.0009) [2023-12-28 01:55:57,520][106225] Updated weights for policy 1, policy_version 931550 (0.0009) [2023-12-28 01:55:57,920][106226] Updated weights for policy 0, policy_version 929228 (0.0006) [2023-12-28 01:55:57,983][106226] Updated weights for policy 0, policy_version 929238 (0.0010) [2023-12-28 01:55:58,039][106226] Updated weights for policy 0, policy_version 929248 (0.0010) [2023-12-28 01:55:58,236][106225] Updated weights for policy 1, policy_version 931560 (0.0008) [2023-12-28 01:55:58,297][106225] Updated weights for policy 1, policy_version 931570 (0.0008) [2023-12-28 01:55:58,367][106225] Updated weights for policy 1, policy_version 931580 (0.0008) [2023-12-28 01:55:58,891][106226] Updated weights for policy 0, policy_version 929258 (0.0009) [2023-12-28 01:55:58,956][106226] Updated weights for policy 0, policy_version 929268 (0.0008) [2023-12-28 01:55:59,018][106226] Updated weights for policy 0, policy_version 929278 (0.0007) [2023-12-28 01:55:59,084][106226] Updated weights for policy 0, policy_version 929288 (0.0007) [2023-12-28 01:55:59,176][106225] Updated weights for policy 1, policy_version 931590 (0.0008) [2023-12-28 01:55:59,257][106225] Updated weights for policy 1, policy_version 931600 (0.0009) [2023-12-28 01:55:59,321][106225] Updated weights for policy 1, policy_version 931610 (0.0008) [2023-12-28 01:55:59,885][106226] Updated weights for policy 0, policy_version 929298 (0.0009) [2023-12-28 01:55:59,943][106226] Updated weights for policy 0, policy_version 929308 (0.0009) [2023-12-28 01:56:00,009][106226] Updated weights for policy 0, policy_version 929318 (0.0008) [2023-12-28 01:56:00,037][106225] Updated weights for policy 1, policy_version 931620 (0.0008) [2023-12-28 01:56:00,102][106225] Updated weights for policy 1, policy_version 931630 (0.0009) [2023-12-28 01:56:00,164][106225] Updated weights for policy 1, policy_version 931640 (0.0008) [2023-12-28 01:56:00,689][106226] Updated weights for policy 0, policy_version 929328 (0.0005) [2023-12-28 01:56:00,740][106226] Updated weights for policy 0, policy_version 929338 (0.0005) [2023-12-28 01:56:00,789][106226] Updated weights for policy 0, policy_version 929348 (0.0005) [2023-12-28 01:56:00,918][106225] Updated weights for policy 1, policy_version 931650 (0.0009) [2023-12-28 01:56:00,970][106225] Updated weights for policy 1, policy_version 931660 (0.0010) [2023-12-28 01:56:01,023][106225] Updated weights for policy 1, policy_version 931670 (0.0010) [2023-12-28 01:56:01,097][106225] Updated weights for policy 1, policy_version 931680 (0.0007) [2023-12-28 01:56:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 476520448. Throughput: 0: 9936.2, 1: 9864.4. Samples: 476506772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:01,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.335')] [2023-12-28 01:56:01,484][106226] Updated weights for policy 0, policy_version 929358 (0.0005) [2023-12-28 01:56:01,550][106226] Updated weights for policy 0, policy_version 929368 (0.0005) [2023-12-28 01:56:01,620][106226] Updated weights for policy 0, policy_version 929378 (0.0009) [2023-12-28 01:56:01,832][106225] Updated weights for policy 1, policy_version 931690 (0.0007) [2023-12-28 01:56:01,903][106225] Updated weights for policy 1, policy_version 931700 (0.0006) [2023-12-28 01:56:01,962][106225] Updated weights for policy 1, policy_version 931710 (0.0007) [2023-12-28 01:56:02,227][106226] Updated weights for policy 0, policy_version 929388 (0.0007) [2023-12-28 01:56:02,288][106226] Updated weights for policy 0, policy_version 929398 (0.0009) [2023-12-28 01:56:02,347][106226] Updated weights for policy 0, policy_version 929408 (0.0008) [2023-12-28 01:56:02,580][106225] Updated weights for policy 1, policy_version 931720 (0.0009) [2023-12-28 01:56:02,638][106225] Updated weights for policy 1, policy_version 931730 (0.0007) [2023-12-28 01:56:02,684][106225] Updated weights for policy 1, policy_version 931740 (0.0008) [2023-12-28 01:56:03,108][106226] Updated weights for policy 0, policy_version 929418 (0.0008) [2023-12-28 01:56:03,160][106226] Updated weights for policy 0, policy_version 929428 (0.0009) [2023-12-28 01:56:03,215][106226] Updated weights for policy 0, policy_version 929438 (0.0008) [2023-12-28 01:56:03,269][106226] Updated weights for policy 0, policy_version 929448 (0.0008) [2023-12-28 01:56:03,402][106225] Updated weights for policy 1, policy_version 931750 (0.0007) [2023-12-28 01:56:03,468][106225] Updated weights for policy 1, policy_version 931760 (0.0005) [2023-12-28 01:56:03,527][106225] Updated weights for policy 1, policy_version 931770 (0.0005) [2023-12-28 01:56:03,871][106226] Updated weights for policy 0, policy_version 929458 (0.0008) [2023-12-28 01:56:03,935][106226] Updated weights for policy 0, policy_version 929468 (0.0010) [2023-12-28 01:56:04,004][106226] Updated weights for policy 0, policy_version 929478 (0.0009) [2023-12-28 01:56:04,096][106225] Updated weights for policy 1, policy_version 931780 (0.0007) [2023-12-28 01:56:04,162][106225] Updated weights for policy 1, policy_version 931790 (0.0008) [2023-12-28 01:56:04,227][106225] Updated weights for policy 1, policy_version 931800 (0.0009) [2023-12-28 01:56:04,730][106226] Updated weights for policy 0, policy_version 929488 (0.0007) [2023-12-28 01:56:04,780][106226] Updated weights for policy 0, policy_version 929498 (0.0008) [2023-12-28 01:56:04,830][106226] Updated weights for policy 0, policy_version 929508 (0.0008) [2023-12-28 01:56:04,841][106225] Updated weights for policy 1, policy_version 931810 (0.0006) [2023-12-28 01:56:04,908][106225] Updated weights for policy 1, policy_version 931820 (0.0005) [2023-12-28 01:56:04,961][106225] Updated weights for policy 1, policy_version 931830 (0.0005) [2023-12-28 01:56:05,011][106225] Updated weights for policy 1, policy_version 931840 (0.0005) [2023-12-28 01:56:05,602][106226] Updated weights for policy 0, policy_version 929518 (0.0009) [2023-12-28 01:56:05,641][106225] Updated weights for policy 1, policy_version 931850 (0.0007) [2023-12-28 01:56:05,657][106226] Updated weights for policy 0, policy_version 929528 (0.0006) [2023-12-28 01:56:05,694][106225] Updated weights for policy 1, policy_version 931860 (0.0008) [2023-12-28 01:56:05,716][106226] Updated weights for policy 0, policy_version 929538 (0.0005) [2023-12-28 01:56:05,751][106225] Updated weights for policy 1, policy_version 931870 (0.0007) [2023-12-28 01:56:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 476618752. Throughput: 0: 9923.2, 1: 9916.3. Samples: 476628468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:06,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.863')] [2023-12-28 01:56:06,349][106226] Updated weights for policy 0, policy_version 929548 (0.0008) [2023-12-28 01:56:06,402][106226] Updated weights for policy 0, policy_version 929558 (0.0009) [2023-12-28 01:56:06,452][106226] Updated weights for policy 0, policy_version 929568 (0.0008) [2023-12-28 01:56:06,512][106225] Updated weights for policy 1, policy_version 931880 (0.0008) [2023-12-28 01:56:06,574][106225] Updated weights for policy 1, policy_version 931890 (0.0009) [2023-12-28 01:56:06,633][106225] Updated weights for policy 1, policy_version 931900 (0.0008) [2023-12-28 01:56:07,154][106226] Updated weights for policy 0, policy_version 929578 (0.0008) [2023-12-28 01:56:07,217][106226] Updated weights for policy 0, policy_version 929588 (0.0009) [2023-12-28 01:56:07,280][106226] Updated weights for policy 0, policy_version 929598 (0.0008) [2023-12-28 01:56:07,351][106226] Updated weights for policy 0, policy_version 929608 (0.0008) [2023-12-28 01:56:07,372][106225] Updated weights for policy 1, policy_version 931910 (0.0008) [2023-12-28 01:56:07,432][106225] Updated weights for policy 1, policy_version 931920 (0.0009) [2023-12-28 01:56:07,489][106225] Updated weights for policy 1, policy_version 931930 (0.0009) [2023-12-28 01:56:08,055][106226] Updated weights for policy 0, policy_version 929618 (0.0007) [2023-12-28 01:56:08,102][106226] Updated weights for policy 0, policy_version 929628 (0.0009) [2023-12-28 01:56:08,158][106226] Updated weights for policy 0, policy_version 929638 (0.0009) [2023-12-28 01:56:08,212][106225] Updated weights for policy 1, policy_version 931940 (0.0008) [2023-12-28 01:56:08,264][106225] Updated weights for policy 1, policy_version 931950 (0.0008) [2023-12-28 01:56:08,316][106225] Updated weights for policy 1, policy_version 931960 (0.0007) [2023-12-28 01:56:08,927][106226] Updated weights for policy 0, policy_version 929648 (0.0009) [2023-12-28 01:56:08,989][106226] Updated weights for policy 0, policy_version 929658 (0.0009) [2023-12-28 01:56:09,049][106226] Updated weights for policy 0, policy_version 929668 (0.0009) [2023-12-28 01:56:09,067][106225] Updated weights for policy 1, policy_version 931970 (0.0009) [2023-12-28 01:56:09,123][106225] Updated weights for policy 1, policy_version 931980 (0.0009) [2023-12-28 01:56:09,178][106225] Updated weights for policy 1, policy_version 931990 (0.0008) [2023-12-28 01:56:09,245][106225] Updated weights for policy 1, policy_version 932000 (0.0009) [2023-12-28 01:56:09,787][106226] Updated weights for policy 0, policy_version 929678 (0.0008) [2023-12-28 01:56:09,852][106226] Updated weights for policy 0, policy_version 929688 (0.0009) [2023-12-28 01:56:09,917][106226] Updated weights for policy 0, policy_version 929698 (0.0009) [2023-12-28 01:56:10,111][106225] Updated weights for policy 1, policy_version 932010 (0.0009) [2023-12-28 01:56:10,177][106225] Updated weights for policy 1, policy_version 932020 (0.0008) [2023-12-28 01:56:10,247][106225] Updated weights for policy 1, policy_version 932030 (0.0008) [2023-12-28 01:56:10,657][106226] Updated weights for policy 0, policy_version 929708 (0.0009) [2023-12-28 01:56:10,706][106226] Updated weights for policy 0, policy_version 929718 (0.0008) [2023-12-28 01:56:10,762][106226] Updated weights for policy 0, policy_version 929728 (0.0009) [2023-12-28 01:56:10,955][106225] Updated weights for policy 1, policy_version 932040 (0.0008) [2023-12-28 01:56:11,013][106225] Updated weights for policy 1, policy_version 932050 (0.0008) [2023-12-28 01:56:11,080][106225] Updated weights for policy 1, policy_version 932060 (0.0008) [2023-12-28 01:56:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 476717056. Throughput: 0: 9894.6, 1: 9928.1. Samples: 476685236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:11,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.127')] [2023-12-28 01:56:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000932064_238649344.pth... [2023-12-28 01:56:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000929736_238067712.pth... [2023-12-28 01:56:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000928584_237772800.pth [2023-12-28 01:56:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000930912_238354432.pth [2023-12-28 01:56:11,556][106226] Updated weights for policy 0, policy_version 929738 (0.0008) [2023-12-28 01:56:11,620][106226] Updated weights for policy 0, policy_version 929748 (0.0007) [2023-12-28 01:56:11,687][106226] Updated weights for policy 0, policy_version 929758 (0.0010) [2023-12-28 01:56:11,761][106226] Updated weights for policy 0, policy_version 929768 (0.0008) [2023-12-28 01:56:11,852][106225] Updated weights for policy 1, policy_version 932070 (0.0008) [2023-12-28 01:56:11,899][106225] Updated weights for policy 1, policy_version 932080 (0.0007) [2023-12-28 01:56:11,953][106225] Updated weights for policy 1, policy_version 932090 (0.0007) [2023-12-28 01:56:12,497][106226] Updated weights for policy 0, policy_version 929778 (0.0008) [2023-12-28 01:56:12,553][106226] Updated weights for policy 0, policy_version 929788 (0.0008) [2023-12-28 01:56:12,613][106226] Updated weights for policy 0, policy_version 929798 (0.0008) [2023-12-28 01:56:12,712][106225] Updated weights for policy 1, policy_version 932100 (0.0008) [2023-12-28 01:56:12,770][106225] Updated weights for policy 1, policy_version 932110 (0.0009) [2023-12-28 01:56:12,827][106225] Updated weights for policy 1, policy_version 932120 (0.0010) [2023-12-28 01:56:13,394][106226] Updated weights for policy 0, policy_version 929808 (0.0009) [2023-12-28 01:56:13,445][106226] Updated weights for policy 0, policy_version 929818 (0.0008) [2023-12-28 01:56:13,497][106226] Updated weights for policy 0, policy_version 929828 (0.0008) [2023-12-28 01:56:13,509][106225] Updated weights for policy 1, policy_version 932130 (0.0010) [2023-12-28 01:56:13,564][106225] Updated weights for policy 1, policy_version 932140 (0.0008) [2023-12-28 01:56:13,610][106225] Updated weights for policy 1, policy_version 932150 (0.0009) [2023-12-28 01:56:13,668][106225] Updated weights for policy 1, policy_version 932160 (0.0010) [2023-12-28 01:56:14,250][106226] Updated weights for policy 0, policy_version 929838 (0.0009) [2023-12-28 01:56:14,272][106225] Updated weights for policy 1, policy_version 932170 (0.0010) [2023-12-28 01:56:14,309][106226] Updated weights for policy 0, policy_version 929848 (0.0011) [2023-12-28 01:56:14,334][106225] Updated weights for policy 1, policy_version 932180 (0.0008) [2023-12-28 01:56:14,370][106226] Updated weights for policy 0, policy_version 929858 (0.0011) [2023-12-28 01:56:14,397][106225] Updated weights for policy 1, policy_version 932190 (0.0007) [2023-12-28 01:56:15,054][106226] Updated weights for policy 0, policy_version 929868 (0.0009) [2023-12-28 01:56:15,113][106225] Updated weights for policy 1, policy_version 932200 (0.0009) [2023-12-28 01:56:15,116][106226] Updated weights for policy 0, policy_version 929878 (0.0009) [2023-12-28 01:56:15,171][106226] Updated weights for policy 0, policy_version 929888 (0.0011) [2023-12-28 01:56:15,171][106225] Updated weights for policy 1, policy_version 932210 (0.0010) [2023-12-28 01:56:15,237][106225] Updated weights for policy 1, policy_version 932220 (0.0011) [2023-12-28 01:56:15,834][106226] Updated weights for policy 0, policy_version 929898 (0.0011) [2023-12-28 01:56:15,887][106226] Updated weights for policy 0, policy_version 929908 (0.0010) [2023-12-28 01:56:15,939][106225] Updated weights for policy 1, policy_version 932230 (0.0008) [2023-12-28 01:56:15,941][106226] Updated weights for policy 0, policy_version 929918 (0.0010) [2023-12-28 01:56:15,995][106226] Updated weights for policy 0, policy_version 929928 (0.0010) [2023-12-28 01:56:15,996][106225] Updated weights for policy 1, policy_version 932240 (0.0006) [2023-12-28 01:56:16,053][106225] Updated weights for policy 1, policy_version 932250 (0.0007) [2023-12-28 01:56:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 476815360. Throughput: 0: 9828.9, 1: 9817.1. Samples: 476798408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:16,176][105115] Avg episode reward: [(0, '-4.453'), (1, '-4.921')] [2023-12-28 01:56:16,694][106225] Updated weights for policy 1, policy_version 932260 (0.0007) [2023-12-28 01:56:16,712][106226] Updated weights for policy 0, policy_version 929938 (0.0010) [2023-12-28 01:56:16,757][106225] Updated weights for policy 1, policy_version 932270 (0.0007) [2023-12-28 01:56:16,779][106226] Updated weights for policy 0, policy_version 929948 (0.0011) [2023-12-28 01:56:16,812][106225] Updated weights for policy 1, policy_version 932280 (0.0006) [2023-12-28 01:56:16,836][106226] Updated weights for policy 0, policy_version 929958 (0.0011) [2023-12-28 01:56:17,506][106226] Updated weights for policy 0, policy_version 929968 (0.0009) [2023-12-28 01:56:17,524][106225] Updated weights for policy 1, policy_version 932290 (0.0008) [2023-12-28 01:56:17,567][106226] Updated weights for policy 0, policy_version 929978 (0.0009) [2023-12-28 01:56:17,578][106225] Updated weights for policy 1, policy_version 932300 (0.0006) [2023-12-28 01:56:17,623][106226] Updated weights for policy 0, policy_version 929988 (0.0010) [2023-12-28 01:56:17,625][106225] Updated weights for policy 1, policy_version 932310 (0.0007) [2023-12-28 01:56:17,686][106225] Updated weights for policy 1, policy_version 932320 (0.0006) [2023-12-28 01:56:18,263][106226] Updated weights for policy 0, policy_version 929998 (0.0010) [2023-12-28 01:56:18,317][106226] Updated weights for policy 0, policy_version 930008 (0.0008) [2023-12-28 01:56:18,375][106226] Updated weights for policy 0, policy_version 930018 (0.0008) [2023-12-28 01:56:18,467][106225] Updated weights for policy 1, policy_version 932330 (0.0010) [2023-12-28 01:56:18,525][106225] Updated weights for policy 1, policy_version 932340 (0.0010) [2023-12-28 01:56:18,586][106225] Updated weights for policy 1, policy_version 932350 (0.0010) [2023-12-28 01:56:19,013][106226] Updated weights for policy 0, policy_version 930028 (0.0009) [2023-12-28 01:56:19,104][106226] Updated weights for policy 0, policy_version 930038 (0.0009) [2023-12-28 01:56:19,168][106226] Updated weights for policy 0, policy_version 930048 (0.0008) [2023-12-28 01:56:19,353][106225] Updated weights for policy 1, policy_version 932360 (0.0011) [2023-12-28 01:56:19,419][106225] Updated weights for policy 1, policy_version 932370 (0.0010) [2023-12-28 01:56:19,477][106225] Updated weights for policy 1, policy_version 932380 (0.0010) [2023-12-28 01:56:19,855][106226] Updated weights for policy 0, policy_version 930058 (0.0008) [2023-12-28 01:56:19,909][106226] Updated weights for policy 0, policy_version 930068 (0.0009) [2023-12-28 01:56:19,980][106226] Updated weights for policy 0, policy_version 930078 (0.0009) [2023-12-28 01:56:20,037][106226] Updated weights for policy 0, policy_version 930088 (0.0009) [2023-12-28 01:56:20,244][106225] Updated weights for policy 1, policy_version 932390 (0.0009) [2023-12-28 01:56:20,305][106225] Updated weights for policy 1, policy_version 932400 (0.0007) [2023-12-28 01:56:20,373][106225] Updated weights for policy 1, policy_version 932410 (0.0008) [2023-12-28 01:56:20,822][106226] Updated weights for policy 0, policy_version 930098 (0.0009) [2023-12-28 01:56:20,875][106226] Updated weights for policy 0, policy_version 930108 (0.0008) [2023-12-28 01:56:20,931][106226] Updated weights for policy 0, policy_version 930118 (0.0010) [2023-12-28 01:56:21,098][106225] Updated weights for policy 1, policy_version 932420 (0.0009) [2023-12-28 01:56:21,157][106225] Updated weights for policy 1, policy_version 932430 (0.0007) [2023-12-28 01:56:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 476905472. Throughput: 0: 9779.2, 1: 9798.9. Samples: 476915200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:21,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-5.012')] [2023-12-28 01:56:21,223][106225] Updated weights for policy 1, policy_version 932440 (0.0006) [2023-12-28 01:56:21,752][106226] Updated weights for policy 0, policy_version 930128 (0.0008) [2023-12-28 01:56:21,814][106226] Updated weights for policy 0, policy_version 930138 (0.0008) [2023-12-28 01:56:21,869][106226] Updated weights for policy 0, policy_version 930148 (0.0008) [2023-12-28 01:56:21,991][106225] Updated weights for policy 1, policy_version 932450 (0.0007) [2023-12-28 01:56:22,046][106225] Updated weights for policy 1, policy_version 932460 (0.0006) [2023-12-28 01:56:22,096][106225] Updated weights for policy 1, policy_version 932470 (0.0006) [2023-12-28 01:56:22,148][106225] Updated weights for policy 1, policy_version 932480 (0.0006) [2023-12-28 01:56:22,675][106226] Updated weights for policy 0, policy_version 930158 (0.0008) [2023-12-28 01:56:22,736][106226] Updated weights for policy 0, policy_version 930168 (0.0007) [2023-12-28 01:56:22,802][106226] Updated weights for policy 0, policy_version 930178 (0.0007) [2023-12-28 01:56:22,814][106225] Updated weights for policy 1, policy_version 932490 (0.0009) [2023-12-28 01:56:22,877][106225] Updated weights for policy 1, policy_version 932500 (0.0005) [2023-12-28 01:56:22,948][106225] Updated weights for policy 1, policy_version 932510 (0.0005) [2023-12-28 01:56:23,556][106225] Updated weights for policy 1, policy_version 932520 (0.0009) [2023-12-28 01:56:23,558][106226] Updated weights for policy 0, policy_version 930188 (0.0008) [2023-12-28 01:56:23,610][106225] Updated weights for policy 1, policy_version 932530 (0.0010) [2023-12-28 01:56:23,619][106226] Updated weights for policy 0, policy_version 930198 (0.0006) [2023-12-28 01:56:23,669][106226] Updated weights for policy 0, policy_version 930208 (0.0005) [2023-12-28 01:56:23,671][106225] Updated weights for policy 1, policy_version 932540 (0.0010) [2023-12-28 01:56:24,307][106225] Updated weights for policy 1, policy_version 932550 (0.0008) [2023-12-28 01:56:24,359][106225] Updated weights for policy 1, policy_version 932560 (0.0007) [2023-12-28 01:56:24,424][106225] Updated weights for policy 1, policy_version 932570 (0.0008) [2023-12-28 01:56:24,442][106226] Updated weights for policy 0, policy_version 930218 (0.0008) [2023-12-28 01:56:24,497][106226] Updated weights for policy 0, policy_version 930228 (0.0008) [2023-12-28 01:56:24,550][106226] Updated weights for policy 0, policy_version 930238 (0.0008) [2023-12-28 01:56:24,611][106226] Updated weights for policy 0, policy_version 930248 (0.0008) [2023-12-28 01:56:25,126][106225] Updated weights for policy 1, policy_version 932580 (0.0008) [2023-12-28 01:56:25,173][106225] Updated weights for policy 1, policy_version 932590 (0.0010) [2023-12-28 01:56:25,216][106225] Updated weights for policy 1, policy_version 932600 (0.0010) [2023-12-28 01:56:25,358][106226] Updated weights for policy 0, policy_version 930258 (0.0008) [2023-12-28 01:56:25,405][106226] Updated weights for policy 0, policy_version 930268 (0.0008) [2023-12-28 01:56:25,454][106226] Updated weights for policy 0, policy_version 930278 (0.0007) [2023-12-28 01:56:25,951][106225] Updated weights for policy 1, policy_version 932610 (0.0010) [2023-12-28 01:56:26,015][106225] Updated weights for policy 1, policy_version 932620 (0.0010) [2023-12-28 01:56:26,072][106225] Updated weights for policy 1, policy_version 932630 (0.0010) [2023-12-28 01:56:26,122][106225] Updated weights for policy 1, policy_version 932640 (0.0010) [2023-12-28 01:56:26,162][106226] Updated weights for policy 0, policy_version 930288 (0.0008) [2023-12-28 01:56:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 477003776. Throughput: 0: 9724.0, 1: 9813.2. Samples: 476972996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:26,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-5.101')] [2023-12-28 01:56:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000932640_238796800.pth... [2023-12-28 01:56:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000931488_238501888.pth [2023-12-28 01:56:26,218][106226] Updated weights for policy 0, policy_version 930298 (0.0008) [2023-12-28 01:56:26,267][106226] Updated weights for policy 0, policy_version 930308 (0.0007) [2023-12-28 01:56:26,287][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000930312_238215168.pth... [2023-12-28 01:56:26,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000929160_237920256.pth [2023-12-28 01:56:26,831][106225] Updated weights for policy 1, policy_version 932650 (0.0010) [2023-12-28 01:56:26,888][106225] Updated weights for policy 1, policy_version 932660 (0.0010) [2023-12-28 01:56:26,935][106225] Updated weights for policy 1, policy_version 932670 (0.0010) [2023-12-28 01:56:27,007][106226] Updated weights for policy 0, policy_version 930318 (0.0008) [2023-12-28 01:56:27,058][106226] Updated weights for policy 0, policy_version 930328 (0.0008) [2023-12-28 01:56:27,109][106226] Updated weights for policy 0, policy_version 930338 (0.0008) [2023-12-28 01:56:27,525][106225] Updated weights for policy 1, policy_version 932680 (0.0006) [2023-12-28 01:56:27,581][106225] Updated weights for policy 1, policy_version 932690 (0.0005) [2023-12-28 01:56:27,635][106225] Updated weights for policy 1, policy_version 932700 (0.0006) [2023-12-28 01:56:27,899][106226] Updated weights for policy 0, policy_version 930348 (0.0007) [2023-12-28 01:56:27,962][106226] Updated weights for policy 0, policy_version 930358 (0.0005) [2023-12-28 01:56:28,013][106226] Updated weights for policy 0, policy_version 930368 (0.0005) [2023-12-28 01:56:28,216][106225] Updated weights for policy 1, policy_version 932710 (0.0007) [2023-12-28 01:56:28,269][106225] Updated weights for policy 1, policy_version 932720 (0.0007) [2023-12-28 01:56:28,332][106225] Updated weights for policy 1, policy_version 932730 (0.0010) [2023-12-28 01:56:28,569][106226] Updated weights for policy 0, policy_version 930378 (0.0006) [2023-12-28 01:56:28,634][106226] Updated weights for policy 0, policy_version 930388 (0.0007) [2023-12-28 01:56:28,692][106226] Updated weights for policy 0, policy_version 930398 (0.0008) [2023-12-28 01:56:28,755][106226] Updated weights for policy 0, policy_version 930408 (0.0009) [2023-12-28 01:56:29,081][106225] Updated weights for policy 1, policy_version 932740 (0.0008) [2023-12-28 01:56:29,139][106225] Updated weights for policy 1, policy_version 932750 (0.0008) [2023-12-28 01:56:29,192][106225] Updated weights for policy 1, policy_version 932760 (0.0008) [2023-12-28 01:56:29,380][106226] Updated weights for policy 0, policy_version 930418 (0.0006) [2023-12-28 01:56:29,427][106226] Updated weights for policy 0, policy_version 930428 (0.0005) [2023-12-28 01:56:29,473][106226] Updated weights for policy 0, policy_version 930438 (0.0005) [2023-12-28 01:56:29,906][106225] Updated weights for policy 1, policy_version 932770 (0.0010) [2023-12-28 01:56:29,969][106225] Updated weights for policy 1, policy_version 932780 (0.0009) [2023-12-28 01:56:30,026][106225] Updated weights for policy 1, policy_version 932790 (0.0010) [2023-12-28 01:56:30,086][106225] Updated weights for policy 1, policy_version 932800 (0.0010) [2023-12-28 01:56:30,108][106226] Updated weights for policy 0, policy_version 930448 (0.0006) [2023-12-28 01:56:30,166][106226] Updated weights for policy 0, policy_version 930458 (0.0005) [2023-12-28 01:56:30,225][106226] Updated weights for policy 0, policy_version 930468 (0.0007) [2023-12-28 01:56:30,803][106225] Updated weights for policy 1, policy_version 932810 (0.0005) [2023-12-28 01:56:30,856][106225] Updated weights for policy 1, policy_version 932820 (0.0005) [2023-12-28 01:56:30,900][106226] Updated weights for policy 0, policy_version 930478 (0.0008) [2023-12-28 01:56:30,909][106225] Updated weights for policy 1, policy_version 932830 (0.0005) [2023-12-28 01:56:30,954][106226] Updated weights for policy 0, policy_version 930488 (0.0008) [2023-12-28 01:56:31,008][106226] Updated weights for policy 0, policy_version 930499 (0.0009) [2023-12-28 01:56:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 477110272. Throughput: 0: 9809.2, 1: 9861.8. Samples: 477095920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:31,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-4.975')] [2023-12-28 01:56:31,593][106225] Updated weights for policy 1, policy_version 932840 (0.0008) [2023-12-28 01:56:31,660][106225] Updated weights for policy 1, policy_version 932850 (0.0010) [2023-12-28 01:56:31,727][106225] Updated weights for policy 1, policy_version 932860 (0.0008) [2023-12-28 01:56:31,782][106226] Updated weights for policy 0, policy_version 930509 (0.0008) [2023-12-28 01:56:31,833][106226] Updated weights for policy 0, policy_version 930519 (0.0008) [2023-12-28 01:56:31,891][106226] Updated weights for policy 0, policy_version 930529 (0.0008) [2023-12-28 01:56:32,467][106225] Updated weights for policy 1, policy_version 932870 (0.0008) [2023-12-28 01:56:32,527][106225] Updated weights for policy 1, policy_version 932880 (0.0009) [2023-12-28 01:56:32,585][106225] Updated weights for policy 1, policy_version 932890 (0.0008) [2023-12-28 01:56:32,599][106226] Updated weights for policy 0, policy_version 930539 (0.0008) [2023-12-28 01:56:32,651][106226] Updated weights for policy 0, policy_version 930549 (0.0007) [2023-12-28 01:56:32,707][106226] Updated weights for policy 0, policy_version 930559 (0.0008) [2023-12-28 01:56:33,216][106225] Updated weights for policy 1, policy_version 932900 (0.0006) [2023-12-28 01:56:33,266][106225] Updated weights for policy 1, policy_version 932910 (0.0008) [2023-12-28 01:56:33,310][106225] Updated weights for policy 1, policy_version 932920 (0.0008) [2023-12-28 01:56:33,453][106226] Updated weights for policy 0, policy_version 930569 (0.0008) [2023-12-28 01:56:33,516][106226] Updated weights for policy 0, policy_version 930579 (0.0009) [2023-12-28 01:56:33,563][106226] Updated weights for policy 0, policy_version 930589 (0.0008) [2023-12-28 01:56:33,614][106226] Updated weights for policy 0, policy_version 930599 (0.0008) [2023-12-28 01:56:34,042][106225] Updated weights for policy 1, policy_version 932930 (0.0009) [2023-12-28 01:56:34,111][106225] Updated weights for policy 1, policy_version 932940 (0.0009) [2023-12-28 01:56:34,177][106225] Updated weights for policy 1, policy_version 932950 (0.0009) [2023-12-28 01:56:34,232][106225] Updated weights for policy 1, policy_version 932960 (0.0009) [2023-12-28 01:56:34,358][106226] Updated weights for policy 0, policy_version 930609 (0.0008) [2023-12-28 01:56:34,421][106226] Updated weights for policy 0, policy_version 930619 (0.0008) [2023-12-28 01:56:34,486][106226] Updated weights for policy 0, policy_version 930629 (0.0008) [2023-12-28 01:56:34,947][106225] Updated weights for policy 1, policy_version 932970 (0.0005) [2023-12-28 01:56:35,000][106225] Updated weights for policy 1, policy_version 932980 (0.0005) [2023-12-28 01:56:35,059][106225] Updated weights for policy 1, policy_version 932990 (0.0005) [2023-12-28 01:56:35,157][106226] Updated weights for policy 0, policy_version 930639 (0.0010) [2023-12-28 01:56:35,214][106226] Updated weights for policy 0, policy_version 930649 (0.0005) [2023-12-28 01:56:35,269][106226] Updated weights for policy 0, policy_version 930659 (0.0007) [2023-12-28 01:56:35,778][106225] Updated weights for policy 1, policy_version 933000 (0.0008) [2023-12-28 01:56:35,812][106226] Updated weights for policy 0, policy_version 930669 (0.0008) [2023-12-28 01:56:35,834][106225] Updated weights for policy 1, policy_version 933010 (0.0006) [2023-12-28 01:56:35,862][106226] Updated weights for policy 0, policy_version 930679 (0.0010) [2023-12-28 01:56:35,885][106225] Updated weights for policy 1, policy_version 933020 (0.0005) [2023-12-28 01:56:35,912][106226] Updated weights for policy 0, policy_version 930689 (0.0010) [2023-12-28 01:56:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 477208576. Throughput: 0: 9865.6, 1: 9848.5. Samples: 477214740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:36,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-5.230')] [2023-12-28 01:56:36,543][106225] Updated weights for policy 1, policy_version 933030 (0.0007) [2023-12-28 01:56:36,575][106226] Updated weights for policy 0, policy_version 930699 (0.0009) [2023-12-28 01:56:36,608][106225] Updated weights for policy 1, policy_version 933040 (0.0007) [2023-12-28 01:56:36,641][106226] Updated weights for policy 0, policy_version 930709 (0.0006) [2023-12-28 01:56:36,678][106225] Updated weights for policy 1, policy_version 933050 (0.0006) [2023-12-28 01:56:36,708][106226] Updated weights for policy 0, policy_version 930719 (0.0007) [2023-12-28 01:56:37,240][106225] Updated weights for policy 1, policy_version 933060 (0.0006) [2023-12-28 01:56:37,289][106225] Updated weights for policy 1, policy_version 933070 (0.0009) [2023-12-28 01:56:37,343][106225] Updated weights for policy 1, policy_version 933080 (0.0006) [2023-12-28 01:56:37,461][106226] Updated weights for policy 0, policy_version 930729 (0.0008) [2023-12-28 01:56:37,527][106226] Updated weights for policy 0, policy_version 930739 (0.0009) [2023-12-28 01:56:37,588][106226] Updated weights for policy 0, policy_version 930749 (0.0007) [2023-12-28 01:56:37,639][106226] Updated weights for policy 0, policy_version 930759 (0.0007) [2023-12-28 01:56:38,022][106225] Updated weights for policy 1, policy_version 933090 (0.0006) [2023-12-28 01:56:38,080][106225] Updated weights for policy 1, policy_version 933100 (0.0008) [2023-12-28 01:56:38,139][106225] Updated weights for policy 1, policy_version 933110 (0.0009) [2023-12-28 01:56:38,194][106225] Updated weights for policy 1, policy_version 933120 (0.0008) [2023-12-28 01:56:38,373][106226] Updated weights for policy 0, policy_version 930769 (0.0008) [2023-12-28 01:56:38,430][106226] Updated weights for policy 0, policy_version 930779 (0.0008) [2023-12-28 01:56:38,490][106226] Updated weights for policy 0, policy_version 930789 (0.0008) [2023-12-28 01:56:38,903][106225] Updated weights for policy 1, policy_version 933130 (0.0008) [2023-12-28 01:56:38,953][106225] Updated weights for policy 1, policy_version 933140 (0.0008) [2023-12-28 01:56:39,009][106225] Updated weights for policy 1, policy_version 933150 (0.0008) [2023-12-28 01:56:39,247][106226] Updated weights for policy 0, policy_version 930800 (0.0009) [2023-12-28 01:56:39,309][106226] Updated weights for policy 0, policy_version 930810 (0.0009) [2023-12-28 01:56:39,384][106226] Updated weights for policy 0, policy_version 930820 (0.0008) [2023-12-28 01:56:39,812][106225] Updated weights for policy 1, policy_version 933160 (0.0008) [2023-12-28 01:56:39,885][106225] Updated weights for policy 1, policy_version 933170 (0.0009) [2023-12-28 01:56:39,952][106225] Updated weights for policy 1, policy_version 933180 (0.0009) [2023-12-28 01:56:40,167][106226] Updated weights for policy 0, policy_version 930830 (0.0009) [2023-12-28 01:56:40,234][106226] Updated weights for policy 0, policy_version 930840 (0.0007) [2023-12-28 01:56:40,289][106226] Updated weights for policy 0, policy_version 930850 (0.0008) [2023-12-28 01:56:40,700][106225] Updated weights for policy 1, policy_version 933190 (0.0010) [2023-12-28 01:56:40,755][106225] Updated weights for policy 1, policy_version 933200 (0.0009) [2023-12-28 01:56:40,809][106225] Updated weights for policy 1, policy_version 933210 (0.0009) [2023-12-28 01:56:40,957][106226] Updated weights for policy 0, policy_version 930860 (0.0009) [2023-12-28 01:56:41,016][106226] Updated weights for policy 0, policy_version 930870 (0.0008) [2023-12-28 01:56:41,082][106226] Updated weights for policy 0, policy_version 930880 (0.0008) [2023-12-28 01:56:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 477306880. Throughput: 0: 9835.6, 1: 9913.4. Samples: 477275196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:41,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-5.037')] [2023-12-28 01:56:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000933216_238944256.pth... [2023-12-28 01:56:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000930888_238362624.pth... [2023-12-28 01:56:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000932064_238649344.pth [2023-12-28 01:56:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000929736_238067712.pth [2023-12-28 01:56:41,657][106225] Updated weights for policy 1, policy_version 933220 (0.0009) [2023-12-28 01:56:41,724][106225] Updated weights for policy 1, policy_version 933230 (0.0008) [2023-12-28 01:56:41,789][106225] Updated weights for policy 1, policy_version 933240 (0.0008) [2023-12-28 01:56:41,921][106226] Updated weights for policy 0, policy_version 930890 (0.0008) [2023-12-28 01:56:41,976][106226] Updated weights for policy 0, policy_version 930900 (0.0008) [2023-12-28 01:56:42,031][106226] Updated weights for policy 0, policy_version 930910 (0.0007) [2023-12-28 01:56:42,085][106226] Updated weights for policy 0, policy_version 930920 (0.0008) [2023-12-28 01:56:42,561][106225] Updated weights for policy 1, policy_version 933250 (0.0009) [2023-12-28 01:56:42,622][106225] Updated weights for policy 1, policy_version 933260 (0.0008) [2023-12-28 01:56:42,683][106225] Updated weights for policy 1, policy_version 933270 (0.0005) [2023-12-28 01:56:42,734][106225] Updated weights for policy 1, policy_version 933280 (0.0006) [2023-12-28 01:56:42,736][106226] Updated weights for policy 0, policy_version 930930 (0.0009) [2023-12-28 01:56:42,804][106226] Updated weights for policy 0, policy_version 930940 (0.0010) [2023-12-28 01:56:42,867][106226] Updated weights for policy 0, policy_version 930950 (0.0008) [2023-12-28 01:56:43,404][106225] Updated weights for policy 1, policy_version 933290 (0.0010) [2023-12-28 01:56:43,460][106225] Updated weights for policy 1, policy_version 933300 (0.0010) [2023-12-28 01:56:43,519][106225] Updated weights for policy 1, policy_version 933310 (0.0010) [2023-12-28 01:56:43,604][106226] Updated weights for policy 0, policy_version 930960 (0.0008) [2023-12-28 01:56:43,663][106226] Updated weights for policy 0, policy_version 930970 (0.0007) [2023-12-28 01:56:43,727][106226] Updated weights for policy 0, policy_version 930980 (0.0008) [2023-12-28 01:56:44,222][106225] Updated weights for policy 1, policy_version 933320 (0.0010) [2023-12-28 01:56:44,291][106225] Updated weights for policy 1, policy_version 933330 (0.0011) [2023-12-28 01:56:44,355][106225] Updated weights for policy 1, policy_version 933340 (0.0010) [2023-12-28 01:56:44,480][106226] Updated weights for policy 0, policy_version 930990 (0.0008) [2023-12-28 01:56:44,541][106226] Updated weights for policy 0, policy_version 931000 (0.0008) [2023-12-28 01:56:44,589][106226] Updated weights for policy 0, policy_version 931010 (0.0008) [2023-12-28 01:56:45,054][106225] Updated weights for policy 1, policy_version 933350 (0.0007) [2023-12-28 01:56:45,118][106225] Updated weights for policy 1, policy_version 933360 (0.0010) [2023-12-28 01:56:45,184][106225] Updated weights for policy 1, policy_version 933370 (0.0007) [2023-12-28 01:56:45,383][106226] Updated weights for policy 0, policy_version 931020 (0.0008) [2023-12-28 01:56:45,445][106226] Updated weights for policy 0, policy_version 931030 (0.0009) [2023-12-28 01:56:45,501][106226] Updated weights for policy 0, policy_version 931040 (0.0010) [2023-12-28 01:56:45,823][106225] Updated weights for policy 1, policy_version 933380 (0.0008) [2023-12-28 01:56:45,883][106225] Updated weights for policy 1, policy_version 933390 (0.0005) [2023-12-28 01:56:45,948][106225] Updated weights for policy 1, policy_version 933400 (0.0005) [2023-12-28 01:56:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 477396992. Throughput: 0: 9712.9, 1: 9831.3. Samples: 477386264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:46,176][105115] Avg episode reward: [(0, '-4.566'), (1, '-5.153')] [2023-12-28 01:56:46,201][106226] Updated weights for policy 0, policy_version 931050 (0.0010) [2023-12-28 01:56:46,257][106226] Updated weights for policy 0, policy_version 931060 (0.0009) [2023-12-28 01:56:46,306][106226] Updated weights for policy 0, policy_version 931070 (0.0006) [2023-12-28 01:56:46,360][106226] Updated weights for policy 0, policy_version 931080 (0.0010) [2023-12-28 01:56:46,461][106225] Updated weights for policy 1, policy_version 933410 (0.0005) [2023-12-28 01:56:46,504][106225] Updated weights for policy 1, policy_version 933420 (0.0005) [2023-12-28 01:56:46,552][106225] Updated weights for policy 1, policy_version 933430 (0.0006) [2023-12-28 01:56:46,597][106225] Updated weights for policy 1, policy_version 933440 (0.0005) [2023-12-28 01:56:46,958][106226] Updated weights for policy 0, policy_version 931090 (0.0005) [2023-12-28 01:56:47,015][106226] Updated weights for policy 0, policy_version 931100 (0.0006) [2023-12-28 01:56:47,066][106226] Updated weights for policy 0, policy_version 931110 (0.0006) [2023-12-28 01:56:47,226][106225] Updated weights for policy 1, policy_version 933450 (0.0010) [2023-12-28 01:56:47,283][106225] Updated weights for policy 1, policy_version 933460 (0.0010) [2023-12-28 01:56:47,339][106225] Updated weights for policy 1, policy_version 933470 (0.0010) [2023-12-28 01:56:47,745][106226] Updated weights for policy 0, policy_version 931120 (0.0005) [2023-12-28 01:56:47,808][106226] Updated weights for policy 0, policy_version 931130 (0.0006) [2023-12-28 01:56:47,868][106226] Updated weights for policy 0, policy_version 931140 (0.0008) [2023-12-28 01:56:48,038][106225] Updated weights for policy 1, policy_version 933480 (0.0007) [2023-12-28 01:56:48,097][106225] Updated weights for policy 1, policy_version 933490 (0.0005) [2023-12-28 01:56:48,162][106225] Updated weights for policy 1, policy_version 933500 (0.0005) [2023-12-28 01:56:48,554][106226] Updated weights for policy 0, policy_version 931150 (0.0006) [2023-12-28 01:56:48,621][106226] Updated weights for policy 0, policy_version 931160 (0.0005) [2023-12-28 01:56:48,678][106226] Updated weights for policy 0, policy_version 931170 (0.0005) [2023-12-28 01:56:48,811][106225] Updated weights for policy 1, policy_version 933510 (0.0008) [2023-12-28 01:56:48,872][106225] Updated weights for policy 1, policy_version 933520 (0.0010) [2023-12-28 01:56:48,941][106225] Updated weights for policy 1, policy_version 933530 (0.0006) [2023-12-28 01:56:49,263][106226] Updated weights for policy 0, policy_version 931180 (0.0006) [2023-12-28 01:56:49,325][106226] Updated weights for policy 0, policy_version 931190 (0.0009) [2023-12-28 01:56:49,392][106226] Updated weights for policy 0, policy_version 931200 (0.0008) [2023-12-28 01:56:49,644][106225] Updated weights for policy 1, policy_version 933540 (0.0009) [2023-12-28 01:56:49,697][106225] Updated weights for policy 1, policy_version 933550 (0.0009) [2023-12-28 01:56:49,747][106225] Updated weights for policy 1, policy_version 933560 (0.0009) [2023-12-28 01:56:50,087][106226] Updated weights for policy 0, policy_version 931210 (0.0009) [2023-12-28 01:56:50,145][106226] Updated weights for policy 0, policy_version 931220 (0.0008) [2023-12-28 01:56:50,208][106226] Updated weights for policy 0, policy_version 931230 (0.0008) [2023-12-28 01:56:50,278][106226] Updated weights for policy 0, policy_version 931240 (0.0008) [2023-12-28 01:56:50,542][106225] Updated weights for policy 1, policy_version 933570 (0.0009) [2023-12-28 01:56:50,607][106225] Updated weights for policy 1, policy_version 933580 (0.0007) [2023-12-28 01:56:50,666][106225] Updated weights for policy 1, policy_version 933590 (0.0011) [2023-12-28 01:56:50,725][106225] Updated weights for policy 1, policy_version 933600 (0.0010) [2023-12-28 01:56:51,045][106226] Updated weights for policy 0, policy_version 931250 (0.0008) [2023-12-28 01:56:51,111][106226] Updated weights for policy 0, policy_version 931260 (0.0009) [2023-12-28 01:56:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 477495296. Throughput: 0: 9719.2, 1: 9845.8. Samples: 477508896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:51,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.849')] [2023-12-28 01:56:51,183][106226] Updated weights for policy 0, policy_version 931270 (0.0008) [2023-12-28 01:56:51,451][106225] Updated weights for policy 1, policy_version 933610 (0.0010) [2023-12-28 01:56:51,506][106225] Updated weights for policy 1, policy_version 933620 (0.0011) [2023-12-28 01:56:51,564][106225] Updated weights for policy 1, policy_version 933630 (0.0010) [2023-12-28 01:56:51,921][106226] Updated weights for policy 0, policy_version 931280 (0.0007) [2023-12-28 01:56:51,972][106226] Updated weights for policy 0, policy_version 931290 (0.0008) [2023-12-28 01:56:52,037][106226] Updated weights for policy 0, policy_version 931300 (0.0008) [2023-12-28 01:56:52,320][106225] Updated weights for policy 1, policy_version 933640 (0.0010) [2023-12-28 01:56:52,384][106225] Updated weights for policy 1, policy_version 933650 (0.0010) [2023-12-28 01:56:52,445][106225] Updated weights for policy 1, policy_version 933660 (0.0010) [2023-12-28 01:56:52,789][106226] Updated weights for policy 0, policy_version 931310 (0.0008) [2023-12-28 01:56:52,847][106226] Updated weights for policy 0, policy_version 931320 (0.0008) [2023-12-28 01:56:52,902][106226] Updated weights for policy 0, policy_version 931330 (0.0008) [2023-12-28 01:56:53,145][106225] Updated weights for policy 1, policy_version 933670 (0.0010) [2023-12-28 01:56:53,201][106225] Updated weights for policy 1, policy_version 933680 (0.0010) [2023-12-28 01:56:53,250][106225] Updated weights for policy 1, policy_version 933690 (0.0010) [2023-12-28 01:56:53,645][106226] Updated weights for policy 0, policy_version 931340 (0.0008) [2023-12-28 01:56:53,711][106226] Updated weights for policy 0, policy_version 931350 (0.0009) [2023-12-28 01:56:53,771][106226] Updated weights for policy 0, policy_version 931360 (0.0009) [2023-12-28 01:56:53,906][106225] Updated weights for policy 1, policy_version 933700 (0.0008) [2023-12-28 01:56:53,968][106225] Updated weights for policy 1, policy_version 933710 (0.0005) [2023-12-28 01:56:54,024][106225] Updated weights for policy 1, policy_version 933720 (0.0005) [2023-12-28 01:56:54,384][106226] Updated weights for policy 0, policy_version 931370 (0.0008) [2023-12-28 01:56:54,431][106226] Updated weights for policy 0, policy_version 931380 (0.0008) [2023-12-28 01:56:54,477][106226] Updated weights for policy 0, policy_version 931390 (0.0008) [2023-12-28 01:56:54,535][106226] Updated weights for policy 0, policy_version 931400 (0.0009) [2023-12-28 01:56:54,589][106225] Updated weights for policy 1, policy_version 933730 (0.0005) [2023-12-28 01:56:54,648][106225] Updated weights for policy 1, policy_version 933740 (0.0007) [2023-12-28 01:56:54,696][106225] Updated weights for policy 1, policy_version 933750 (0.0008) [2023-12-28 01:56:54,748][106225] Updated weights for policy 1, policy_version 933760 (0.0007) [2023-12-28 01:56:55,298][106226] Updated weights for policy 0, policy_version 931410 (0.0009) [2023-12-28 01:56:55,358][106226] Updated weights for policy 0, policy_version 931420 (0.0008) [2023-12-28 01:56:55,421][106226] Updated weights for policy 0, policy_version 931430 (0.0008) [2023-12-28 01:56:55,449][106225] Updated weights for policy 1, policy_version 933770 (0.0005) [2023-12-28 01:56:55,518][106225] Updated weights for policy 1, policy_version 933780 (0.0005) [2023-12-28 01:56:55,586][106225] Updated weights for policy 1, policy_version 933790 (0.0006) [2023-12-28 01:56:56,105][106225] Updated weights for policy 1, policy_version 933800 (0.0007) [2023-12-28 01:56:56,150][106225] Updated weights for policy 1, policy_version 933810 (0.0008) [2023-12-28 01:56:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 477593600. Throughput: 0: 9707.0, 1: 9865.4. Samples: 477565996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:56:56,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-4.769')] [2023-12-28 01:56:56,200][106225] Updated weights for policy 1, policy_version 933820 (0.0008) [2023-12-28 01:56:56,211][106226] Updated weights for policy 0, policy_version 931440 (0.0007) [2023-12-28 01:56:56,220][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000933824_239099904.pth... [2023-12-28 01:56:56,224][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000932640_238796800.pth [2023-12-28 01:56:56,256][106226] Updated weights for policy 0, policy_version 931450 (0.0007) [2023-12-28 01:56:56,305][106226] Updated weights for policy 0, policy_version 931460 (0.0008) [2023-12-28 01:56:56,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000931464_238510080.pth... [2023-12-28 01:56:56,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000930312_238215168.pth [2023-12-28 01:56:56,899][106225] Updated weights for policy 1, policy_version 933830 (0.0008) [2023-12-28 01:56:56,947][106225] Updated weights for policy 1, policy_version 933840 (0.0008) [2023-12-28 01:56:57,000][106225] Updated weights for policy 1, policy_version 933850 (0.0008) [2023-12-28 01:56:57,056][106226] Updated weights for policy 0, policy_version 931470 (0.0008) [2023-12-28 01:56:57,104][106226] Updated weights for policy 0, policy_version 931480 (0.0008) [2023-12-28 01:56:57,150][106226] Updated weights for policy 0, policy_version 931490 (0.0006) [2023-12-28 01:56:57,654][106225] Updated weights for policy 1, policy_version 933860 (0.0007) [2023-12-28 01:56:57,701][106225] Updated weights for policy 1, policy_version 933870 (0.0009) [2023-12-28 01:56:57,746][106225] Updated weights for policy 1, policy_version 933880 (0.0010) [2023-12-28 01:56:57,936][106226] Updated weights for policy 0, policy_version 931500 (0.0008) [2023-12-28 01:56:57,990][106226] Updated weights for policy 0, policy_version 931510 (0.0008) [2023-12-28 01:56:58,048][106226] Updated weights for policy 0, policy_version 931520 (0.0007) [2023-12-28 01:56:58,368][106225] Updated weights for policy 1, policy_version 933890 (0.0009) [2023-12-28 01:56:58,440][106225] Updated weights for policy 1, policy_version 933900 (0.0006) [2023-12-28 01:56:58,506][106225] Updated weights for policy 1, policy_version 933910 (0.0009) [2023-12-28 01:56:58,568][106225] Updated weights for policy 1, policy_version 933920 (0.0009) [2023-12-28 01:56:58,876][106226] Updated weights for policy 0, policy_version 931530 (0.0008) [2023-12-28 01:56:58,937][106226] Updated weights for policy 0, policy_version 931540 (0.0008) [2023-12-28 01:56:58,999][106226] Updated weights for policy 0, policy_version 931550 (0.0008) [2023-12-28 01:56:59,060][106226] Updated weights for policy 0, policy_version 931560 (0.0008) [2023-12-28 01:56:59,382][106225] Updated weights for policy 1, policy_version 933930 (0.0009) [2023-12-28 01:56:59,438][106225] Updated weights for policy 1, policy_version 933940 (0.0010) [2023-12-28 01:56:59,498][106225] Updated weights for policy 1, policy_version 933950 (0.0010) [2023-12-28 01:56:59,856][106226] Updated weights for policy 0, policy_version 931570 (0.0008) [2023-12-28 01:56:59,911][106226] Updated weights for policy 0, policy_version 931580 (0.0008) [2023-12-28 01:56:59,976][106226] Updated weights for policy 0, policy_version 931590 (0.0007) [2023-12-28 01:57:00,194][106225] Updated weights for policy 1, policy_version 933960 (0.0009) [2023-12-28 01:57:00,255][106225] Updated weights for policy 1, policy_version 933970 (0.0010) [2023-12-28 01:57:00,312][106225] Updated weights for policy 1, policy_version 933980 (0.0009) [2023-12-28 01:57:00,737][106226] Updated weights for policy 0, policy_version 931600 (0.0008) [2023-12-28 01:57:00,797][106226] Updated weights for policy 0, policy_version 931610 (0.0008) [2023-12-28 01:57:00,849][106226] Updated weights for policy 0, policy_version 931620 (0.0007) [2023-12-28 01:57:01,033][106225] Updated weights for policy 1, policy_version 933990 (0.0008) [2023-12-28 01:57:01,093][106225] Updated weights for policy 1, policy_version 934000 (0.0009) [2023-12-28 01:57:01,157][106225] Updated weights for policy 1, policy_version 934010 (0.0010) [2023-12-28 01:57:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 477691904. Throughput: 0: 9682.1, 1: 9998.6. Samples: 477684036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:57:01,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.116')] [2023-12-28 01:57:01,590][106226] Updated weights for policy 0, policy_version 931630 (0.0008) [2023-12-28 01:57:01,651][106226] Updated weights for policy 0, policy_version 931640 (0.0010) [2023-12-28 01:57:01,704][106226] Updated weights for policy 0, policy_version 931650 (0.0009) [2023-12-28 01:57:01,910][106225] Updated weights for policy 1, policy_version 934020 (0.0009) [2023-12-28 01:57:01,970][106225] Updated weights for policy 1, policy_version 934030 (0.0008) [2023-12-28 01:57:02,031][106225] Updated weights for policy 1, policy_version 934040 (0.0008) [2023-12-28 01:57:02,445][106226] Updated weights for policy 0, policy_version 931660 (0.0009) [2023-12-28 01:57:02,501][106226] Updated weights for policy 0, policy_version 931670 (0.0010) [2023-12-28 01:57:02,558][106226] Updated weights for policy 0, policy_version 931680 (0.0010) [2023-12-28 01:57:02,663][106225] Updated weights for policy 1, policy_version 934050 (0.0007) [2023-12-28 01:57:02,731][106225] Updated weights for policy 1, policy_version 934060 (0.0005) [2023-12-28 01:57:02,795][106225] Updated weights for policy 1, policy_version 934070 (0.0007) [2023-12-28 01:57:02,859][106225] Updated weights for policy 1, policy_version 934080 (0.0008) [2023-12-28 01:57:03,317][106226] Updated weights for policy 0, policy_version 931690 (0.0008) [2023-12-28 01:57:03,366][106226] Updated weights for policy 0, policy_version 931700 (0.0009) [2023-12-28 01:57:03,420][106226] Updated weights for policy 0, policy_version 931710 (0.0007) [2023-12-28 01:57:03,421][106225] Updated weights for policy 1, policy_version 934090 (0.0006) [2023-12-28 01:57:03,466][106226] Updated weights for policy 0, policy_version 931720 (0.0005) [2023-12-28 01:57:03,468][106225] Updated weights for policy 1, policy_version 934100 (0.0005) [2023-12-28 01:57:03,518][106225] Updated weights for policy 1, policy_version 934110 (0.0009) [2023-12-28 01:57:04,065][106226] Updated weights for policy 0, policy_version 931730 (0.0008) [2023-12-28 01:57:04,127][106226] Updated weights for policy 0, policy_version 931740 (0.0008) [2023-12-28 01:57:04,177][106225] Updated weights for policy 1, policy_version 934120 (0.0010) [2023-12-28 01:57:04,183][106226] Updated weights for policy 0, policy_version 931750 (0.0006) [2023-12-28 01:57:04,235][106225] Updated weights for policy 1, policy_version 934130 (0.0010) [2023-12-28 01:57:04,296][106225] Updated weights for policy 1, policy_version 934140 (0.0010) [2023-12-28 01:57:04,936][106226] Updated weights for policy 0, policy_version 931760 (0.0007) [2023-12-28 01:57:05,005][106226] Updated weights for policy 0, policy_version 931770 (0.0008) [2023-12-28 01:57:05,020][106225] Updated weights for policy 1, policy_version 934150 (0.0009) [2023-12-28 01:57:05,068][106226] Updated weights for policy 0, policy_version 931780 (0.0006) [2023-12-28 01:57:05,078][106225] Updated weights for policy 1, policy_version 934160 (0.0010) [2023-12-28 01:57:05,131][106225] Updated weights for policy 1, policy_version 934170 (0.0010) [2023-12-28 01:57:05,699][106226] Updated weights for policy 0, policy_version 931790 (0.0007) [2023-12-28 01:57:05,758][106226] Updated weights for policy 0, policy_version 931800 (0.0008) [2023-12-28 01:57:05,812][106226] Updated weights for policy 0, policy_version 931810 (0.0008) [2023-12-28 01:57:05,872][106225] Updated weights for policy 1, policy_version 934180 (0.0010) [2023-12-28 01:57:05,915][106225] Updated weights for policy 1, policy_version 934190 (0.0010) [2023-12-28 01:57:05,962][106225] Updated weights for policy 1, policy_version 934200 (0.0010) [2023-12-28 01:57:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 477798400. Throughput: 0: 9673.4, 1: 10064.0. Samples: 477803384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:57:06,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.877')] [2023-12-28 01:57:06,587][106226] Updated weights for policy 0, policy_version 931820 (0.0008) [2023-12-28 01:57:06,647][106226] Updated weights for policy 0, policy_version 931830 (0.0008) [2023-12-28 01:57:06,702][106226] Updated weights for policy 0, policy_version 931840 (0.0007) [2023-12-28 01:57:06,708][106225] Updated weights for policy 1, policy_version 934210 (0.0010) [2023-12-28 01:57:06,758][106225] Updated weights for policy 1, policy_version 934220 (0.0010) [2023-12-28 01:57:06,805][106225] Updated weights for policy 1, policy_version 934230 (0.0010) [2023-12-28 01:57:06,853][106225] Updated weights for policy 1, policy_version 934240 (0.0010) [2023-12-28 01:57:07,468][106226] Updated weights for policy 0, policy_version 931850 (0.0006) [2023-12-28 01:57:07,523][106226] Updated weights for policy 0, policy_version 931860 (0.0008) [2023-12-28 01:57:07,565][106225] Updated weights for policy 1, policy_version 934250 (0.0008) [2023-12-28 01:57:07,573][106226] Updated weights for policy 0, policy_version 931870 (0.0005) [2023-12-28 01:57:07,626][106226] Updated weights for policy 0, policy_version 931880 (0.0005) [2023-12-28 01:57:07,627][106225] Updated weights for policy 1, policy_version 934260 (0.0008) [2023-12-28 01:57:07,688][106225] Updated weights for policy 1, policy_version 934270 (0.0010) [2023-12-28 01:57:08,227][106226] Updated weights for policy 0, policy_version 931890 (0.0009) [2023-12-28 01:57:08,242][106225] Updated weights for policy 1, policy_version 934280 (0.0010) [2023-12-28 01:57:08,288][106226] Updated weights for policy 0, policy_version 931900 (0.0008) [2023-12-28 01:57:08,295][106225] Updated weights for policy 1, policy_version 934290 (0.0006) [2023-12-28 01:57:08,357][106225] Updated weights for policy 1, policy_version 934300 (0.0008) [2023-12-28 01:57:08,367][106226] Updated weights for policy 0, policy_version 931910 (0.0007) [2023-12-28 01:57:08,972][106226] Updated weights for policy 0, policy_version 931920 (0.0006) [2023-12-28 01:57:09,039][106226] Updated weights for policy 0, policy_version 931930 (0.0007) [2023-12-28 01:57:09,057][106225] Updated weights for policy 1, policy_version 934310 (0.0006) [2023-12-28 01:57:09,097][106226] Updated weights for policy 0, policy_version 931940 (0.0008) [2023-12-28 01:57:09,111][106225] Updated weights for policy 1, policy_version 934320 (0.0007) [2023-12-28 01:57:09,158][106225] Updated weights for policy 1, policy_version 934330 (0.0007) [2023-12-28 01:57:09,804][106226] Updated weights for policy 0, policy_version 931950 (0.0009) [2023-12-28 01:57:09,883][106226] Updated weights for policy 0, policy_version 931960 (0.0007) [2023-12-28 01:57:09,952][106226] Updated weights for policy 0, policy_version 931970 (0.0009) [2023-12-28 01:57:10,050][106225] Updated weights for policy 1, policy_version 934340 (0.0007) [2023-12-28 01:57:10,117][106225] Updated weights for policy 1, policy_version 934350 (0.0008) [2023-12-28 01:57:10,171][106225] Updated weights for policy 1, policy_version 934360 (0.0006) [2023-12-28 01:57:10,712][106226] Updated weights for policy 0, policy_version 931980 (0.0009) [2023-12-28 01:57:10,774][106226] Updated weights for policy 0, policy_version 931990 (0.0008) [2023-12-28 01:57:10,843][106226] Updated weights for policy 0, policy_version 932000 (0.0005) [2023-12-28 01:57:10,903][106225] Updated weights for policy 1, policy_version 934370 (0.0009) [2023-12-28 01:57:10,961][106225] Updated weights for policy 1, policy_version 934380 (0.0008) [2023-12-28 01:57:11,025][106225] Updated weights for policy 1, policy_version 934390 (0.0010) [2023-12-28 01:57:11,088][106225] Updated weights for policy 1, policy_version 934400 (0.0008) [2023-12-28 01:57:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 477896704. Throughput: 0: 9745.1, 1: 10059.5. Samples: 477864200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:57:11,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.942')] [2023-12-28 01:57:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000934400_239247360.pth... [2023-12-28 01:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000932008_238649344.pth... [2023-12-28 01:57:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000933216_238944256.pth [2023-12-28 01:57:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000930888_238362624.pth [2023-12-28 01:57:11,535][106226] Updated weights for policy 0, policy_version 932010 (0.0008) [2023-12-28 01:57:11,599][106226] Updated weights for policy 0, policy_version 932020 (0.0009) [2023-12-28 01:57:11,672][106226] Updated weights for policy 0, policy_version 932030 (0.0009) [2023-12-28 01:57:11,731][106226] Updated weights for policy 0, policy_version 932040 (0.0008) [2023-12-28 01:57:11,885][106225] Updated weights for policy 1, policy_version 934410 (0.0008) [2023-12-28 01:57:11,956][106225] Updated weights for policy 1, policy_version 934420 (0.0008) [2023-12-28 01:57:12,020][106225] Updated weights for policy 1, policy_version 934430 (0.0008) [2023-12-28 01:57:12,477][106226] Updated weights for policy 0, policy_version 932050 (0.0006) [2023-12-28 01:57:12,545][106226] Updated weights for policy 0, policy_version 932060 (0.0008) [2023-12-28 01:57:12,612][106226] Updated weights for policy 0, policy_version 932070 (0.0009) [2023-12-28 01:57:12,752][106225] Updated weights for policy 1, policy_version 934440 (0.0008) [2023-12-28 01:57:12,816][106225] Updated weights for policy 1, policy_version 934450 (0.0009) [2023-12-28 01:57:12,878][106225] Updated weights for policy 1, policy_version 934460 (0.0008) [2023-12-28 01:57:13,354][106226] Updated weights for policy 0, policy_version 932080 (0.0009) [2023-12-28 01:57:13,411][106226] Updated weights for policy 0, policy_version 932090 (0.0008) [2023-12-28 01:57:13,470][106226] Updated weights for policy 0, policy_version 932100 (0.0009) [2023-12-28 01:57:13,471][106225] Updated weights for policy 1, policy_version 934470 (0.0006) [2023-12-28 01:57:13,527][106225] Updated weights for policy 1, policy_version 934480 (0.0005) [2023-12-28 01:57:13,586][106225] Updated weights for policy 1, policy_version 934490 (0.0009) [2023-12-28 01:57:14,214][106226] Updated weights for policy 0, policy_version 932110 (0.0007) [2023-12-28 01:57:14,269][106226] Updated weights for policy 0, policy_version 932120 (0.0006) [2023-12-28 01:57:14,278][106225] Updated weights for policy 1, policy_version 934500 (0.0008) [2023-12-28 01:57:14,324][106226] Updated weights for policy 0, policy_version 932130 (0.0006) [2023-12-28 01:57:14,330][106225] Updated weights for policy 1, policy_version 934510 (0.0006) [2023-12-28 01:57:14,376][106225] Updated weights for policy 1, policy_version 934520 (0.0007) [2023-12-28 01:57:14,991][106226] Updated weights for policy 0, policy_version 932140 (0.0008) [2023-12-28 01:57:15,055][106226] Updated weights for policy 0, policy_version 932150 (0.0008) [2023-12-28 01:57:15,119][106226] Updated weights for policy 0, policy_version 932160 (0.0009) [2023-12-28 01:57:15,125][106225] Updated weights for policy 1, policy_version 934530 (0.0008) [2023-12-28 01:57:15,182][106225] Updated weights for policy 1, policy_version 934540 (0.0007) [2023-12-28 01:57:15,242][106225] Updated weights for policy 1, policy_version 934550 (0.0009) [2023-12-28 01:57:15,307][106225] Updated weights for policy 1, policy_version 934560 (0.0009) [2023-12-28 01:57:15,884][106226] Updated weights for policy 0, policy_version 932170 (0.0007) [2023-12-28 01:57:15,945][106226] Updated weights for policy 0, policy_version 932180 (0.0007) [2023-12-28 01:57:15,971][106225] Updated weights for policy 1, policy_version 934570 (0.0007) [2023-12-28 01:57:16,004][106226] Updated weights for policy 0, policy_version 932190 (0.0006) [2023-12-28 01:57:16,018][106225] Updated weights for policy 1, policy_version 934580 (0.0006) [2023-12-28 01:57:16,063][106226] Updated weights for policy 0, policy_version 932200 (0.0007) [2023-12-28 01:57:16,077][106225] Updated weights for policy 1, policy_version 934590 (0.0006) [2023-12-28 01:57:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 477995008. Throughput: 0: 9637.0, 1: 9964.7. Samples: 477977996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 01:57:16,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.332')] [2023-12-28 01:57:16,773][106226] Updated weights for policy 0, policy_version 932210 (0.0008) [2023-12-28 01:57:16,794][106225] Updated weights for policy 1, policy_version 934600 (0.0008) [2023-12-28 01:57:16,828][106226] Updated weights for policy 0, policy_version 932220 (0.0006) [2023-12-28 01:57:16,848][106225] Updated weights for policy 1, policy_version 934610 (0.0006) [2023-12-28 01:57:16,886][106226] Updated weights for policy 0, policy_version 932230 (0.0007) [2023-12-28 01:57:16,912][106225] Updated weights for policy 1, policy_version 934620 (0.0008) [2023-12-28 01:57:17,621][106226] Updated weights for policy 0, policy_version 932240 (0.0008) [2023-12-28 01:57:17,638][106225] Updated weights for policy 1, policy_version 934630 (0.0008) [2023-12-28 01:57:17,675][106226] Updated weights for policy 0, policy_version 932250 (0.0006) [2023-12-28 01:57:17,702][106225] Updated weights for policy 1, policy_version 934640 (0.0008) [2023-12-28 01:57:17,732][106226] Updated weights for policy 0, policy_version 932260 (0.0007) [2023-12-28 01:57:17,762][106225] Updated weights for policy 1, policy_version 934650 (0.0006) [2023-12-28 01:57:18,337][106226] Updated weights for policy 0, policy_version 932270 (0.0007) [2023-12-28 01:57:18,407][106226] Updated weights for policy 0, policy_version 932280 (0.0008) [2023-12-28 01:57:18,472][106226] Updated weights for policy 0, policy_version 932290 (0.0008) [2023-12-28 01:57:18,527][106225] Updated weights for policy 1, policy_version 934660 (0.0008) [2023-12-28 01:57:18,582][106225] Updated weights for policy 1, policy_version 934670 (0.0009) [2023-12-28 01:57:18,634][106225] Updated weights for policy 1, policy_version 934680 (0.0008) [2023-12-28 01:57:19,097][106226] Updated weights for policy 0, policy_version 932300 (0.0006) [2023-12-28 01:57:19,153][106226] Updated weights for policy 0, policy_version 932310 (0.0009) [2023-12-28 01:57:19,204][106226] Updated weights for policy 0, policy_version 932320 (0.0006) [2023-12-28 01:57:19,327][106225] Updated weights for policy 1, policy_version 934690 (0.0009) [2023-12-28 01:57:19,415][106225] Updated weights for policy 1, policy_version 934700 (0.0007) [2023-12-28 01:57:19,471][106225] Updated weights for policy 1, policy_version 934710 (0.0007) [2023-12-28 01:57:19,541][106225] Updated weights for policy 1, policy_version 934720 (0.0008) [2023-12-28 01:57:19,860][106226] Updated weights for policy 0, policy_version 932330 (0.0009) [2023-12-28 01:57:19,960][106226] Updated weights for policy 0, policy_version 932340 (0.0009) [2023-12-28 01:57:20,025][106226] Updated weights for policy 0, policy_version 932350 (0.0006) [2023-12-28 01:57:20,094][106226] Updated weights for policy 0, policy_version 932360 (0.0006) [2023-12-28 01:57:20,228][106225] Updated weights for policy 1, policy_version 934730 (0.0007) [2023-12-28 01:57:20,292][106225] Updated weights for policy 1, policy_version 934740 (0.0006) [2023-12-28 01:57:20,359][106225] Updated weights for policy 1, policy_version 934750 (0.0006) [2023-12-28 01:57:20,664][106226] Updated weights for policy 0, policy_version 932370 (0.0009) [2023-12-28 01:57:20,732][106226] Updated weights for policy 0, policy_version 932380 (0.0006) [2023-12-28 01:57:20,801][106226] Updated weights for policy 0, policy_version 932390 (0.0006) [2023-12-28 01:57:21,126][106225] Updated weights for policy 1, policy_version 934760 (0.0007) [2023-12-28 01:57:21,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 478085120. Throughput: 0: 9667.8, 1: 9952.2. Samples: 478097640. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:21,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.825')] [2023-12-28 01:57:21,194][106225] Updated weights for policy 1, policy_version 934770 (0.0010) [2023-12-28 01:57:21,263][106225] Updated weights for policy 1, policy_version 934780 (0.0011) [2023-12-28 01:57:21,541][106226] Updated weights for policy 0, policy_version 932400 (0.0010) [2023-12-28 01:57:21,597][106226] Updated weights for policy 0, policy_version 932410 (0.0010) [2023-12-28 01:57:21,679][106226] Updated weights for policy 0, policy_version 932420 (0.0010) [2023-12-28 01:57:22,026][106225] Updated weights for policy 1, policy_version 934790 (0.0009) [2023-12-28 01:57:22,084][106225] Updated weights for policy 1, policy_version 934800 (0.0007) [2023-12-28 01:57:22,140][106225] Updated weights for policy 1, policy_version 934810 (0.0007) [2023-12-28 01:57:22,477][106226] Updated weights for policy 0, policy_version 932430 (0.0010) [2023-12-28 01:57:22,534][106226] Updated weights for policy 0, policy_version 932440 (0.0008) [2023-12-28 01:57:22,600][106226] Updated weights for policy 0, policy_version 932450 (0.0007) [2023-12-28 01:57:22,941][106225] Updated weights for policy 1, policy_version 934820 (0.0008) [2023-12-28 01:57:22,991][106225] Updated weights for policy 1, policy_version 934830 (0.0009) [2023-12-28 01:57:23,045][106225] Updated weights for policy 1, policy_version 934840 (0.0009) [2023-12-28 01:57:23,168][106226] Updated weights for policy 0, policy_version 932460 (0.0007) [2023-12-28 01:57:23,229][106226] Updated weights for policy 0, policy_version 932470 (0.0010) [2023-12-28 01:57:23,286][106226] Updated weights for policy 0, policy_version 932480 (0.0009) [2023-12-28 01:57:23,673][106225] Updated weights for policy 1, policy_version 934850 (0.0008) [2023-12-28 01:57:23,730][106225] Updated weights for policy 1, policy_version 934860 (0.0007) [2023-12-28 01:57:23,788][106225] Updated weights for policy 1, policy_version 934870 (0.0008) [2023-12-28 01:57:23,852][106225] Updated weights for policy 1, policy_version 934880 (0.0009) [2023-12-28 01:57:23,979][106226] Updated weights for policy 0, policy_version 932490 (0.0007) [2023-12-28 01:57:24,044][106226] Updated weights for policy 0, policy_version 932500 (0.0007) [2023-12-28 01:57:24,112][106226] Updated weights for policy 0, policy_version 932510 (0.0008) [2023-12-28 01:57:24,174][106226] Updated weights for policy 0, policy_version 932520 (0.0007) [2023-12-28 01:57:24,508][106225] Updated weights for policy 1, policy_version 934890 (0.0006) [2023-12-28 01:57:24,571][106225] Updated weights for policy 1, policy_version 934900 (0.0008) [2023-12-28 01:57:24,629][106225] Updated weights for policy 1, policy_version 934910 (0.0011) [2023-12-28 01:57:24,789][106226] Updated weights for policy 0, policy_version 932530 (0.0010) [2023-12-28 01:57:24,850][106226] Updated weights for policy 0, policy_version 932540 (0.0010) [2023-12-28 01:57:24,902][106226] Updated weights for policy 0, policy_version 932550 (0.0010) [2023-12-28 01:57:25,325][106225] Updated weights for policy 1, policy_version 934920 (0.0011) [2023-12-28 01:57:25,382][106225] Updated weights for policy 1, policy_version 934930 (0.0010) [2023-12-28 01:57:25,440][106225] Updated weights for policy 1, policy_version 934940 (0.0009) [2023-12-28 01:57:25,543][106226] Updated weights for policy 0, policy_version 932560 (0.0009) [2023-12-28 01:57:25,603][106226] Updated weights for policy 0, policy_version 932570 (0.0006) [2023-12-28 01:57:25,668][106226] Updated weights for policy 0, policy_version 932580 (0.0005) [2023-12-28 01:57:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 478183424. Throughput: 0: 9682.6, 1: 9875.9. Samples: 478155336. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:26,176][105115] Avg episode reward: [(0, '-4.649'), (1, '-5.242')] [2023-12-28 01:57:26,199][106226] Updated weights for policy 0, policy_version 932590 (0.0006) [2023-12-28 01:57:26,207][106225] Updated weights for policy 1, policy_version 934950 (0.0007) [2023-12-28 01:57:26,247][106226] Updated weights for policy 0, policy_version 932600 (0.0006) [2023-12-28 01:57:26,270][106225] Updated weights for policy 1, policy_version 934960 (0.0008) [2023-12-28 01:57:26,295][106226] Updated weights for policy 0, policy_version 932610 (0.0008) [2023-12-28 01:57:26,324][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000932616_238804992.pth... [2023-12-28 01:57:26,327][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000931464_238510080.pth [2023-12-28 01:57:26,334][106225] Updated weights for policy 1, policy_version 934970 (0.0006) [2023-12-28 01:57:26,376][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000934976_239394816.pth... [2023-12-28 01:57:26,379][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000933824_239099904.pth [2023-12-28 01:57:26,945][106226] Updated weights for policy 0, policy_version 932620 (0.0007) [2023-12-28 01:57:26,996][106226] Updated weights for policy 0, policy_version 932630 (0.0009) [2023-12-28 01:57:27,047][106226] Updated weights for policy 0, policy_version 932640 (0.0008) [2023-12-28 01:57:27,076][106225] Updated weights for policy 1, policy_version 934980 (0.0007) [2023-12-28 01:57:27,120][106225] Updated weights for policy 1, policy_version 934991 (0.0007) [2023-12-28 01:57:27,186][106225] Updated weights for policy 1, policy_version 935001 (0.0007) [2023-12-28 01:57:27,701][106226] Updated weights for policy 0, policy_version 932650 (0.0007) [2023-12-28 01:57:27,768][106226] Updated weights for policy 0, policy_version 932660 (0.0010) [2023-12-28 01:57:27,821][106226] Updated weights for policy 0, policy_version 932670 (0.0007) [2023-12-28 01:57:27,875][106226] Updated weights for policy 0, policy_version 932680 (0.0005) [2023-12-28 01:57:27,877][106225] Updated weights for policy 1, policy_version 935011 (0.0009) [2023-12-28 01:57:27,928][106225] Updated weights for policy 1, policy_version 935021 (0.0009) [2023-12-28 01:57:27,981][106225] Updated weights for policy 1, policy_version 935031 (0.0008) [2023-12-28 01:57:28,553][106226] Updated weights for policy 0, policy_version 932690 (0.0009) [2023-12-28 01:57:28,601][106226] Updated weights for policy 0, policy_version 932700 (0.0009) [2023-12-28 01:57:28,650][106226] Updated weights for policy 0, policy_version 932710 (0.0009) [2023-12-28 01:57:28,673][106225] Updated weights for policy 1, policy_version 935041 (0.0008) [2023-12-28 01:57:28,730][106225] Updated weights for policy 1, policy_version 935051 (0.0005) [2023-12-28 01:57:28,794][106225] Updated weights for policy 1, policy_version 935061 (0.0006) [2023-12-28 01:57:28,846][106225] Updated weights for policy 1, policy_version 935071 (0.0009) [2023-12-28 01:57:29,335][106226] Updated weights for policy 0, policy_version 932720 (0.0007) [2023-12-28 01:57:29,402][106226] Updated weights for policy 0, policy_version 932730 (0.0008) [2023-12-28 01:57:29,469][106226] Updated weights for policy 0, policy_version 932740 (0.0007) [2023-12-28 01:57:29,503][106225] Updated weights for policy 1, policy_version 935081 (0.0006) [2023-12-28 01:57:29,566][106225] Updated weights for policy 1, policy_version 935091 (0.0007) [2023-12-28 01:57:29,629][106225] Updated weights for policy 1, policy_version 935101 (0.0006) [2023-12-28 01:57:30,192][106226] Updated weights for policy 0, policy_version 932750 (0.0008) [2023-12-28 01:57:30,250][106226] Updated weights for policy 0, policy_version 932760 (0.0007) [2023-12-28 01:57:30,265][106225] Updated weights for policy 1, policy_version 935111 (0.0007) [2023-12-28 01:57:30,309][106225] Updated weights for policy 1, policy_version 935121 (0.0006) [2023-12-28 01:57:30,316][106226] Updated weights for policy 0, policy_version 932770 (0.0007) [2023-12-28 01:57:30,364][106225] Updated weights for policy 1, policy_version 935131 (0.0005) [2023-12-28 01:57:31,013][106226] Updated weights for policy 0, policy_version 932780 (0.0007) [2023-12-28 01:57:31,054][106225] Updated weights for policy 1, policy_version 935141 (0.0007) [2023-12-28 01:57:31,074][106226] Updated weights for policy 0, policy_version 932790 (0.0008) [2023-12-28 01:57:31,120][106225] Updated weights for policy 1, policy_version 935151 (0.0007) [2023-12-28 01:57:31,133][106226] Updated weights for policy 0, policy_version 932800 (0.0008) [2023-12-28 01:57:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 478281728. Throughput: 0: 9876.8, 1: 9959.9. Samples: 478278908. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:31,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.221')] [2023-12-28 01:57:31,187][106225] Updated weights for policy 1, policy_version 935161 (0.0008) [2023-12-28 01:57:31,887][106226] Updated weights for policy 0, policy_version 932810 (0.0008) [2023-12-28 01:57:31,945][106225] Updated weights for policy 1, policy_version 935171 (0.0009) [2023-12-28 01:57:31,952][106226] Updated weights for policy 0, policy_version 932820 (0.0006) [2023-12-28 01:57:32,005][106225] Updated weights for policy 1, policy_version 935181 (0.0008) [2023-12-28 01:57:32,020][106226] Updated weights for policy 0, policy_version 932830 (0.0008) [2023-12-28 01:57:32,055][106225] Updated weights for policy 1, policy_version 935191 (0.0005) [2023-12-28 01:57:32,081][106226] Updated weights for policy 0, policy_version 932840 (0.0008) [2023-12-28 01:57:32,670][106225] Updated weights for policy 1, policy_version 935201 (0.0005) [2023-12-28 01:57:32,728][106225] Updated weights for policy 1, policy_version 935211 (0.0005) [2023-12-28 01:57:32,789][106225] Updated weights for policy 1, policy_version 935221 (0.0005) [2023-12-28 01:57:32,820][106226] Updated weights for policy 0, policy_version 932850 (0.0008) [2023-12-28 01:57:32,848][106225] Updated weights for policy 1, policy_version 935231 (0.0005) [2023-12-28 01:57:32,875][106226] Updated weights for policy 0, policy_version 932860 (0.0008) [2023-12-28 01:57:32,938][106226] Updated weights for policy 0, policy_version 932870 (0.0009) [2023-12-28 01:57:33,428][106225] Updated weights for policy 1, policy_version 935241 (0.0008) [2023-12-28 01:57:33,476][106225] Updated weights for policy 1, policy_version 935251 (0.0008) [2023-12-28 01:57:33,524][106225] Updated weights for policy 1, policy_version 935261 (0.0008) [2023-12-28 01:57:33,683][106226] Updated weights for policy 0, policy_version 932880 (0.0009) [2023-12-28 01:57:33,727][106226] Updated weights for policy 0, policy_version 932890 (0.0008) [2023-12-28 01:57:33,784][106226] Updated weights for policy 0, policy_version 932900 (0.0008) [2023-12-28 01:57:34,227][106225] Updated weights for policy 1, policy_version 935271 (0.0008) [2023-12-28 01:57:34,283][106225] Updated weights for policy 1, policy_version 935281 (0.0008) [2023-12-28 01:57:34,345][106225] Updated weights for policy 1, policy_version 935291 (0.0008) [2023-12-28 01:57:34,579][106226] Updated weights for policy 0, policy_version 932910 (0.0009) [2023-12-28 01:57:34,633][106226] Updated weights for policy 0, policy_version 932920 (0.0009) [2023-12-28 01:57:34,688][106226] Updated weights for policy 0, policy_version 932930 (0.0008) [2023-12-28 01:57:35,014][106225] Updated weights for policy 1, policy_version 935301 (0.0007) [2023-12-28 01:57:35,083][106225] Updated weights for policy 1, policy_version 935311 (0.0005) [2023-12-28 01:57:35,146][106225] Updated weights for policy 1, policy_version 935321 (0.0006) [2023-12-28 01:57:35,482][106226] Updated weights for policy 0, policy_version 932940 (0.0007) [2023-12-28 01:57:35,540][106226] Updated weights for policy 0, policy_version 932950 (0.0005) [2023-12-28 01:57:35,600][106226] Updated weights for policy 0, policy_version 932960 (0.0005) [2023-12-28 01:57:35,680][106225] Updated weights for policy 1, policy_version 935331 (0.0007) [2023-12-28 01:57:35,746][106225] Updated weights for policy 1, policy_version 935341 (0.0005) [2023-12-28 01:57:35,812][106225] Updated weights for policy 1, policy_version 935351 (0.0006) [2023-12-28 01:57:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 478388224. Throughput: 0: 9801.9, 1: 9986.5. Samples: 478399376. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:36,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.307')] [2023-12-28 01:57:36,185][106226] Updated weights for policy 0, policy_version 932970 (0.0006) [2023-12-28 01:57:36,249][106226] Updated weights for policy 0, policy_version 932980 (0.0007) [2023-12-28 01:57:36,309][106226] Updated weights for policy 0, policy_version 932990 (0.0006) [2023-12-28 01:57:36,378][106226] Updated weights for policy 0, policy_version 933000 (0.0006) [2023-12-28 01:57:36,512][106225] Updated weights for policy 1, policy_version 935361 (0.0006) [2023-12-28 01:57:36,574][106225] Updated weights for policy 1, policy_version 935371 (0.0010) [2023-12-28 01:57:36,632][106225] Updated weights for policy 1, policy_version 935381 (0.0010) [2023-12-28 01:57:36,685][106225] Updated weights for policy 1, policy_version 935391 (0.0010) [2023-12-28 01:57:37,068][106226] Updated weights for policy 0, policy_version 933010 (0.0008) [2023-12-28 01:57:37,129][106226] Updated weights for policy 0, policy_version 933020 (0.0008) [2023-12-28 01:57:37,180][106226] Updated weights for policy 0, policy_version 933030 (0.0008) [2023-12-28 01:57:37,413][106225] Updated weights for policy 1, policy_version 935401 (0.0011) [2023-12-28 01:57:37,478][106225] Updated weights for policy 1, policy_version 935411 (0.0009) [2023-12-28 01:57:37,549][106225] Updated weights for policy 1, policy_version 935421 (0.0010) [2023-12-28 01:57:37,910][106226] Updated weights for policy 0, policy_version 933040 (0.0009) [2023-12-28 01:57:37,976][106226] Updated weights for policy 0, policy_version 933050 (0.0009) [2023-12-28 01:57:38,040][106226] Updated weights for policy 0, policy_version 933060 (0.0009) [2023-12-28 01:57:38,165][106225] Updated weights for policy 1, policy_version 935431 (0.0007) [2023-12-28 01:57:38,220][106225] Updated weights for policy 1, policy_version 935441 (0.0006) [2023-12-28 01:57:38,275][106225] Updated weights for policy 1, policy_version 935451 (0.0006) [2023-12-28 01:57:38,848][106226] Updated weights for policy 0, policy_version 933070 (0.0009) [2023-12-28 01:57:38,889][106225] Updated weights for policy 1, policy_version 935461 (0.0006) [2023-12-28 01:57:38,908][106226] Updated weights for policy 0, policy_version 933080 (0.0007) [2023-12-28 01:57:38,949][106225] Updated weights for policy 1, policy_version 935471 (0.0008) [2023-12-28 01:57:38,966][106226] Updated weights for policy 0, policy_version 933090 (0.0007) [2023-12-28 01:57:39,011][106225] Updated weights for policy 1, policy_version 935481 (0.0008) [2023-12-28 01:57:39,657][106226] Updated weights for policy 0, policy_version 933100 (0.0008) [2023-12-28 01:57:39,726][106226] Updated weights for policy 0, policy_version 933110 (0.0011) [2023-12-28 01:57:39,739][106225] Updated weights for policy 1, policy_version 935491 (0.0008) [2023-12-28 01:57:39,778][106226] Updated weights for policy 0, policy_version 933120 (0.0011) [2023-12-28 01:57:39,799][106225] Updated weights for policy 1, policy_version 935501 (0.0006) [2023-12-28 01:57:39,860][106225] Updated weights for policy 1, policy_version 935511 (0.0008) [2023-12-28 01:57:40,579][106226] Updated weights for policy 0, policy_version 933130 (0.0010) [2023-12-28 01:57:40,628][106225] Updated weights for policy 1, policy_version 935521 (0.0008) [2023-12-28 01:57:40,640][106226] Updated weights for policy 0, policy_version 933140 (0.0008) [2023-12-28 01:57:40,693][106225] Updated weights for policy 1, policy_version 935531 (0.0006) [2023-12-28 01:57:40,699][106226] Updated weights for policy 0, policy_version 933150 (0.0008) [2023-12-28 01:57:40,755][106225] Updated weights for policy 1, policy_version 935541 (0.0006) [2023-12-28 01:57:40,762][106226] Updated weights for policy 0, policy_version 933160 (0.0008) [2023-12-28 01:57:40,819][106225] Updated weights for policy 1, policy_version 935551 (0.0009) [2023-12-28 01:57:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 478486528. Throughput: 0: 9801.8, 1: 10019.9. Samples: 478457972. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:41,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-5.031')] [2023-12-28 01:57:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000935552_239542272.pth... [2023-12-28 01:57:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000933160_238944256.pth... [2023-12-28 01:57:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000934400_239247360.pth [2023-12-28 01:57:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000932008_238649344.pth [2023-12-28 01:57:41,572][106226] Updated weights for policy 0, policy_version 933170 (0.0008) [2023-12-28 01:57:41,633][106226] Updated weights for policy 0, policy_version 933180 (0.0008) [2023-12-28 01:57:41,658][106225] Updated weights for policy 1, policy_version 935562 (0.0008) [2023-12-28 01:57:41,687][106226] Updated weights for policy 0, policy_version 933190 (0.0007) [2023-12-28 01:57:41,726][106225] Updated weights for policy 1, policy_version 935572 (0.0009) [2023-12-28 01:57:41,791][106225] Updated weights for policy 1, policy_version 935582 (0.0008) [2023-12-28 01:57:42,436][106226] Updated weights for policy 0, policy_version 933200 (0.0009) [2023-12-28 01:57:42,502][106226] Updated weights for policy 0, policy_version 933210 (0.0009) [2023-12-28 01:57:42,537][106225] Updated weights for policy 1, policy_version 935592 (0.0007) [2023-12-28 01:57:42,558][106226] Updated weights for policy 0, policy_version 933220 (0.0008) [2023-12-28 01:57:42,597][106225] Updated weights for policy 1, policy_version 935602 (0.0008) [2023-12-28 01:57:42,655][106225] Updated weights for policy 1, policy_version 935612 (0.0008) [2023-12-28 01:57:43,229][106226] Updated weights for policy 0, policy_version 933230 (0.0006) [2023-12-28 01:57:43,291][106226] Updated weights for policy 0, policy_version 933240 (0.0005) [2023-12-28 01:57:43,353][106226] Updated weights for policy 0, policy_version 933250 (0.0005) [2023-12-28 01:57:43,369][106225] Updated weights for policy 1, policy_version 935622 (0.0009) [2023-12-28 01:57:43,431][106225] Updated weights for policy 1, policy_version 935632 (0.0010) [2023-12-28 01:57:43,491][106225] Updated weights for policy 1, policy_version 935642 (0.0010) [2023-12-28 01:57:43,944][106226] Updated weights for policy 0, policy_version 933260 (0.0005) [2023-12-28 01:57:44,010][106226] Updated weights for policy 0, policy_version 933270 (0.0008) [2023-12-28 01:57:44,079][106226] Updated weights for policy 0, policy_version 933280 (0.0009) [2023-12-28 01:57:44,101][106225] Updated weights for policy 1, policy_version 935652 (0.0009) [2023-12-28 01:57:44,151][106225] Updated weights for policy 1, policy_version 935662 (0.0010) [2023-12-28 01:57:44,209][106225] Updated weights for policy 1, policy_version 935672 (0.0010) [2023-12-28 01:57:44,770][106226] Updated weights for policy 0, policy_version 933290 (0.0006) [2023-12-28 01:57:44,837][106226] Updated weights for policy 0, policy_version 933300 (0.0008) [2023-12-28 01:57:44,903][106226] Updated weights for policy 0, policy_version 933310 (0.0008) [2023-12-28 01:57:44,943][106225] Updated weights for policy 1, policy_version 935682 (0.0010) [2023-12-28 01:57:44,961][106226] Updated weights for policy 0, policy_version 933320 (0.0007) [2023-12-28 01:57:45,008][106225] Updated weights for policy 1, policy_version 935692 (0.0010) [2023-12-28 01:57:45,070][106225] Updated weights for policy 1, policy_version 935702 (0.0010) [2023-12-28 01:57:45,131][106225] Updated weights for policy 1, policy_version 935712 (0.0010) [2023-12-28 01:57:45,605][106226] Updated weights for policy 0, policy_version 933330 (0.0007) [2023-12-28 01:57:45,658][106226] Updated weights for policy 0, policy_version 933340 (0.0008) [2023-12-28 01:57:45,718][106226] Updated weights for policy 0, policy_version 933350 (0.0008) [2023-12-28 01:57:45,846][106225] Updated weights for policy 1, policy_version 935722 (0.0010) [2023-12-28 01:57:45,902][106225] Updated weights for policy 1, policy_version 935732 (0.0010) [2023-12-28 01:57:45,961][106225] Updated weights for policy 1, policy_version 935742 (0.0010) [2023-12-28 01:57:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 478584832. Throughput: 0: 9858.1, 1: 9896.7. Samples: 478573004. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:46,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-5.036')] [2023-12-28 01:57:46,476][106226] Updated weights for policy 0, policy_version 933360 (0.0006) [2023-12-28 01:57:46,539][106226] Updated weights for policy 0, policy_version 933370 (0.0006) [2023-12-28 01:57:46,581][106225] Updated weights for policy 1, policy_version 935752 (0.0008) [2023-12-28 01:57:46,607][106226] Updated weights for policy 0, policy_version 933380 (0.0006) [2023-12-28 01:57:46,647][106225] Updated weights for policy 1, policy_version 935762 (0.0007) [2023-12-28 01:57:46,707][106225] Updated weights for policy 1, policy_version 935772 (0.0009) [2023-12-28 01:57:47,140][106226] Updated weights for policy 0, policy_version 933390 (0.0005) [2023-12-28 01:57:47,197][106226] Updated weights for policy 0, policy_version 933400 (0.0005) [2023-12-28 01:57:47,260][106226] Updated weights for policy 0, policy_version 933410 (0.0006) [2023-12-28 01:57:47,450][106225] Updated weights for policy 1, policy_version 935782 (0.0007) [2023-12-28 01:57:47,514][106225] Updated weights for policy 1, policy_version 935792 (0.0008) [2023-12-28 01:57:47,576][106225] Updated weights for policy 1, policy_version 935802 (0.0008) [2023-12-28 01:57:47,789][106226] Updated weights for policy 0, policy_version 933420 (0.0008) [2023-12-28 01:57:47,851][106226] Updated weights for policy 0, policy_version 933430 (0.0011) [2023-12-28 01:57:47,910][106226] Updated weights for policy 0, policy_version 933440 (0.0010) [2023-12-28 01:57:48,301][106225] Updated weights for policy 1, policy_version 935812 (0.0008) [2023-12-28 01:57:48,366][106225] Updated weights for policy 1, policy_version 935822 (0.0009) [2023-12-28 01:57:48,426][106225] Updated weights for policy 1, policy_version 935832 (0.0008) [2023-12-28 01:57:48,549][106226] Updated weights for policy 0, policy_version 933450 (0.0006) [2023-12-28 01:57:48,607][106226] Updated weights for policy 0, policy_version 933460 (0.0008) [2023-12-28 01:57:48,661][106226] Updated weights for policy 0, policy_version 933470 (0.0007) [2023-12-28 01:57:48,707][106226] Updated weights for policy 0, policy_version 933480 (0.0009) [2023-12-28 01:57:49,144][106225] Updated weights for policy 1, policy_version 935842 (0.0007) [2023-12-28 01:57:49,202][106225] Updated weights for policy 1, policy_version 935852 (0.0008) [2023-12-28 01:57:49,266][106225] Updated weights for policy 1, policy_version 935862 (0.0007) [2023-12-28 01:57:49,334][106225] Updated weights for policy 1, policy_version 935872 (0.0007) [2023-12-28 01:57:49,460][106226] Updated weights for policy 0, policy_version 933490 (0.0008) [2023-12-28 01:57:49,528][106226] Updated weights for policy 0, policy_version 933500 (0.0009) [2023-12-28 01:57:49,578][106226] Updated weights for policy 0, policy_version 933510 (0.0008) [2023-12-28 01:57:50,012][106225] Updated weights for policy 1, policy_version 935882 (0.0006) [2023-12-28 01:57:50,067][106225] Updated weights for policy 1, policy_version 935892 (0.0008) [2023-12-28 01:57:50,121][106225] Updated weights for policy 1, policy_version 935902 (0.0008) [2023-12-28 01:57:50,305][106226] Updated weights for policy 0, policy_version 933520 (0.0008) [2023-12-28 01:57:50,367][106226] Updated weights for policy 0, policy_version 933530 (0.0009) [2023-12-28 01:57:50,431][106226] Updated weights for policy 0, policy_version 933540 (0.0008) [2023-12-28 01:57:50,784][106225] Updated weights for policy 1, policy_version 935912 (0.0008) [2023-12-28 01:57:50,848][106225] Updated weights for policy 1, policy_version 935922 (0.0008) [2023-12-28 01:57:50,906][106225] Updated weights for policy 1, policy_version 935932 (0.0008) [2023-12-28 01:57:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 478683136. Throughput: 0: 9911.7, 1: 9869.7. Samples: 478693548. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:51,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-5.104')] [2023-12-28 01:57:51,177][106226] Updated weights for policy 0, policy_version 933550 (0.0008) [2023-12-28 01:57:51,248][106226] Updated weights for policy 0, policy_version 933560 (0.0010) [2023-12-28 01:57:51,310][106226] Updated weights for policy 0, policy_version 933570 (0.0011) [2023-12-28 01:57:51,633][106225] Updated weights for policy 1, policy_version 935942 (0.0008) [2023-12-28 01:57:51,696][106225] Updated weights for policy 1, policy_version 935952 (0.0009) [2023-12-28 01:57:51,767][106225] Updated weights for policy 1, policy_version 935962 (0.0009) [2023-12-28 01:57:52,102][106226] Updated weights for policy 0, policy_version 933580 (0.0011) [2023-12-28 01:57:52,153][106226] Updated weights for policy 0, policy_version 933590 (0.0011) [2023-12-28 01:57:52,203][106226] Updated weights for policy 0, policy_version 933600 (0.0010) [2023-12-28 01:57:52,526][106225] Updated weights for policy 1, policy_version 935972 (0.0009) [2023-12-28 01:57:52,589][106225] Updated weights for policy 1, policy_version 935982 (0.0006) [2023-12-28 01:57:52,648][106225] Updated weights for policy 1, policy_version 935992 (0.0005) [2023-12-28 01:57:52,943][106226] Updated weights for policy 0, policy_version 933610 (0.0008) [2023-12-28 01:57:53,001][106226] Updated weights for policy 0, policy_version 933620 (0.0011) [2023-12-28 01:57:53,057][106226] Updated weights for policy 0, policy_version 933630 (0.0011) [2023-12-28 01:57:53,111][106226] Updated weights for policy 0, policy_version 933640 (0.0011) [2023-12-28 01:57:53,359][106225] Updated weights for policy 1, policy_version 936002 (0.0008) [2023-12-28 01:57:53,416][106225] Updated weights for policy 1, policy_version 936012 (0.0008) [2023-12-28 01:57:53,476][106225] Updated weights for policy 1, policy_version 936022 (0.0008) [2023-12-28 01:57:53,533][106225] Updated weights for policy 1, policy_version 936032 (0.0008) [2023-12-28 01:57:53,850][106226] Updated weights for policy 0, policy_version 933650 (0.0011) [2023-12-28 01:57:53,919][106226] Updated weights for policy 0, policy_version 933660 (0.0010) [2023-12-28 01:57:53,979][106226] Updated weights for policy 0, policy_version 933670 (0.0011) [2023-12-28 01:57:54,157][106225] Updated weights for policy 1, policy_version 936042 (0.0005) [2023-12-28 01:57:54,217][106225] Updated weights for policy 1, policy_version 936052 (0.0007) [2023-12-28 01:57:54,272][106225] Updated weights for policy 1, policy_version 936062 (0.0007) [2023-12-28 01:57:54,675][106226] Updated weights for policy 0, policy_version 933680 (0.0011) [2023-12-28 01:57:54,725][106226] Updated weights for policy 0, policy_version 933690 (0.0010) [2023-12-28 01:57:54,772][106226] Updated weights for policy 0, policy_version 933700 (0.0010) [2023-12-28 01:57:54,859][106225] Updated weights for policy 1, policy_version 936072 (0.0006) [2023-12-28 01:57:54,905][106225] Updated weights for policy 1, policy_version 936082 (0.0005) [2023-12-28 01:57:54,956][106225] Updated weights for policy 1, policy_version 936092 (0.0005) [2023-12-28 01:57:55,527][106226] Updated weights for policy 0, policy_version 933710 (0.0009) [2023-12-28 01:57:55,587][106226] Updated weights for policy 0, policy_version 933720 (0.0009) [2023-12-28 01:57:55,648][106226] Updated weights for policy 0, policy_version 933730 (0.0007) [2023-12-28 01:57:55,668][106225] Updated weights for policy 1, policy_version 936102 (0.0008) [2023-12-28 01:57:55,731][106225] Updated weights for policy 1, policy_version 936112 (0.0008) [2023-12-28 01:57:55,790][106225] Updated weights for policy 1, policy_version 936122 (0.0008) [2023-12-28 01:57:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 478781440. Throughput: 0: 9864.6, 1: 9832.9. Samples: 478750588. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:57:56,176][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.965')] [2023-12-28 01:57:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000933736_239091712.pth... [2023-12-28 01:57:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000936128_239689728.pth... [2023-12-28 01:57:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000932616_238804992.pth [2023-12-28 01:57:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000934976_239394816.pth [2023-12-28 01:57:56,337][106226] Updated weights for policy 0, policy_version 933740 (0.0006) [2023-12-28 01:57:56,394][106226] Updated weights for policy 0, policy_version 933750 (0.0005) [2023-12-28 01:57:56,449][106226] Updated weights for policy 0, policy_version 933760 (0.0005) [2023-12-28 01:57:56,479][106225] Updated weights for policy 1, policy_version 936132 (0.0008) [2023-12-28 01:57:56,535][106225] Updated weights for policy 1, policy_version 936142 (0.0010) [2023-12-28 01:57:56,587][106225] Updated weights for policy 1, policy_version 936152 (0.0010) [2023-12-28 01:57:57,054][106226] Updated weights for policy 0, policy_version 933770 (0.0010) [2023-12-28 01:57:57,112][106226] Updated weights for policy 0, policy_version 933780 (0.0010) [2023-12-28 01:57:57,165][106226] Updated weights for policy 0, policy_version 933790 (0.0005) [2023-12-28 01:57:57,216][106226] Updated weights for policy 0, policy_version 933800 (0.0008) [2023-12-28 01:57:57,255][106225] Updated weights for policy 1, policy_version 936162 (0.0010) [2023-12-28 01:57:57,309][106225] Updated weights for policy 1, policy_version 936172 (0.0010) [2023-12-28 01:57:57,372][106225] Updated weights for policy 1, policy_version 936182 (0.0009) [2023-12-28 01:57:57,431][106225] Updated weights for policy 1, policy_version 936192 (0.0005) [2023-12-28 01:57:57,795][106226] Updated weights for policy 0, policy_version 933810 (0.0005) [2023-12-28 01:57:57,843][106226] Updated weights for policy 0, policy_version 933820 (0.0005) [2023-12-28 01:57:57,886][106226] Updated weights for policy 0, policy_version 933830 (0.0005) [2023-12-28 01:57:57,981][106225] Updated weights for policy 1, policy_version 936202 (0.0007) [2023-12-28 01:57:58,051][106225] Updated weights for policy 1, policy_version 936212 (0.0006) [2023-12-28 01:57:58,120][106225] Updated weights for policy 1, policy_version 936222 (0.0009) [2023-12-28 01:57:58,593][106226] Updated weights for policy 0, policy_version 933840 (0.0007) [2023-12-28 01:57:58,656][106226] Updated weights for policy 0, policy_version 933850 (0.0009) [2023-12-28 01:57:58,720][106226] Updated weights for policy 0, policy_version 933860 (0.0009) [2023-12-28 01:57:58,927][106225] Updated weights for policy 1, policy_version 936232 (0.0007) [2023-12-28 01:57:58,995][106225] Updated weights for policy 1, policy_version 936242 (0.0007) [2023-12-28 01:57:59,056][106225] Updated weights for policy 1, policy_version 936252 (0.0008) [2023-12-28 01:57:59,558][106226] Updated weights for policy 0, policy_version 933870 (0.0009) [2023-12-28 01:57:59,616][106226] Updated weights for policy 0, policy_version 933880 (0.0008) [2023-12-28 01:57:59,673][106226] Updated weights for policy 0, policy_version 933890 (0.0008) [2023-12-28 01:57:59,812][106225] Updated weights for policy 1, policy_version 936262 (0.0008) [2023-12-28 01:57:59,874][106225] Updated weights for policy 1, policy_version 936272 (0.0009) [2023-12-28 01:57:59,942][106225] Updated weights for policy 1, policy_version 936282 (0.0007) [2023-12-28 01:58:00,283][106226] Updated weights for policy 0, policy_version 933900 (0.0007) [2023-12-28 01:58:00,351][106226] Updated weights for policy 0, policy_version 933910 (0.0008) [2023-12-28 01:58:00,411][106226] Updated weights for policy 0, policy_version 933920 (0.0009) [2023-12-28 01:58:00,688][106225] Updated weights for policy 1, policy_version 936292 (0.0008) [2023-12-28 01:58:00,754][106225] Updated weights for policy 1, policy_version 936302 (0.0009) [2023-12-28 01:58:00,819][106225] Updated weights for policy 1, policy_version 936312 (0.0009) [2023-12-28 01:58:01,008][106226] Updated weights for policy 0, policy_version 933930 (0.0008) [2023-12-28 01:58:01,077][106226] Updated weights for policy 0, policy_version 933940 (0.0007) [2023-12-28 01:58:01,146][106226] Updated weights for policy 0, policy_version 933950 (0.0006) [2023-12-28 01:58:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 478879744. Throughput: 0: 9961.1, 1: 9920.3. Samples: 478872656. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:01,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-5.046')] [2023-12-28 01:58:01,214][106226] Updated weights for policy 0, policy_version 933960 (0.0009) [2023-12-28 01:58:01,548][106225] Updated weights for policy 1, policy_version 936322 (0.0009) [2023-12-28 01:58:01,615][106225] Updated weights for policy 1, policy_version 936332 (0.0009) [2023-12-28 01:58:01,683][106225] Updated weights for policy 1, policy_version 936342 (0.0008) [2023-12-28 01:58:01,752][106225] Updated weights for policy 1, policy_version 936352 (0.0009) [2023-12-28 01:58:01,938][106226] Updated weights for policy 0, policy_version 933970 (0.0009) [2023-12-28 01:58:02,004][106226] Updated weights for policy 0, policy_version 933980 (0.0008) [2023-12-28 01:58:02,067][106226] Updated weights for policy 0, policy_version 933990 (0.0008) [2023-12-28 01:58:02,435][106225] Updated weights for policy 1, policy_version 936362 (0.0009) [2023-12-28 01:58:02,497][106225] Updated weights for policy 1, policy_version 936372 (0.0008) [2023-12-28 01:58:02,554][106225] Updated weights for policy 1, policy_version 936382 (0.0008) [2023-12-28 01:58:02,789][106226] Updated weights for policy 0, policy_version 934000 (0.0010) [2023-12-28 01:58:02,845][106226] Updated weights for policy 0, policy_version 934010 (0.0010) [2023-12-28 01:58:02,895][106226] Updated weights for policy 0, policy_version 934020 (0.0010) [2023-12-28 01:58:03,266][106225] Updated weights for policy 1, policy_version 936392 (0.0008) [2023-12-28 01:58:03,316][106225] Updated weights for policy 1, policy_version 936403 (0.0008) [2023-12-28 01:58:03,362][106225] Updated weights for policy 1, policy_version 936413 (0.0008) [2023-12-28 01:58:03,538][106226] Updated weights for policy 0, policy_version 934030 (0.0008) [2023-12-28 01:58:03,587][106226] Updated weights for policy 0, policy_version 934040 (0.0010) [2023-12-28 01:58:03,640][106226] Updated weights for policy 0, policy_version 934050 (0.0010) [2023-12-28 01:58:04,167][106225] Updated weights for policy 1, policy_version 936423 (0.0008) [2023-12-28 01:58:04,230][106225] Updated weights for policy 1, policy_version 936433 (0.0007) [2023-12-28 01:58:04,295][106225] Updated weights for policy 1, policy_version 936443 (0.0006) [2023-12-28 01:58:04,351][106226] Updated weights for policy 0, policy_version 934060 (0.0010) [2023-12-28 01:58:04,422][106226] Updated weights for policy 0, policy_version 934070 (0.0008) [2023-12-28 01:58:04,485][106226] Updated weights for policy 0, policy_version 934080 (0.0008) [2023-12-28 01:58:04,970][106225] Updated weights for policy 1, policy_version 936453 (0.0008) [2023-12-28 01:58:05,024][106225] Updated weights for policy 1, policy_version 936463 (0.0007) [2023-12-28 01:58:05,071][106225] Updated weights for policy 1, policy_version 936473 (0.0007) [2023-12-28 01:58:05,133][106226] Updated weights for policy 0, policy_version 934090 (0.0009) [2023-12-28 01:58:05,200][106226] Updated weights for policy 0, policy_version 934100 (0.0010) [2023-12-28 01:58:05,261][106226] Updated weights for policy 0, policy_version 934110 (0.0009) [2023-12-28 01:58:05,323][106226] Updated weights for policy 0, policy_version 934120 (0.0008) [2023-12-28 01:58:05,802][106225] Updated weights for policy 1, policy_version 936483 (0.0007) [2023-12-28 01:58:05,861][106225] Updated weights for policy 1, policy_version 936493 (0.0009) [2023-12-28 01:58:05,915][106225] Updated weights for policy 1, policy_version 936503 (0.0009) [2023-12-28 01:58:06,012][106226] Updated weights for policy 0, policy_version 934130 (0.0008) [2023-12-28 01:58:06,063][106226] Updated weights for policy 0, policy_version 934140 (0.0008) [2023-12-28 01:58:06,126][106226] Updated weights for policy 0, policy_version 934150 (0.0009) [2023-12-28 01:58:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 478986240. Throughput: 0: 9949.9, 1: 9887.3. Samples: 478990316. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:06,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.879')] [2023-12-28 01:58:06,668][106225] Updated weights for policy 1, policy_version 936513 (0.0008) [2023-12-28 01:58:06,723][106225] Updated weights for policy 1, policy_version 936523 (0.0009) [2023-12-28 01:58:06,772][106226] Updated weights for policy 0, policy_version 934160 (0.0006) [2023-12-28 01:58:06,773][106225] Updated weights for policy 1, policy_version 936533 (0.0009) [2023-12-28 01:58:06,833][106225] Updated weights for policy 1, policy_version 936543 (0.0006) [2023-12-28 01:58:06,834][106226] Updated weights for policy 0, policy_version 934170 (0.0008) [2023-12-28 01:58:06,900][106226] Updated weights for policy 0, policy_version 934180 (0.0009) [2023-12-28 01:58:07,597][106225] Updated weights for policy 1, policy_version 936553 (0.0006) [2023-12-28 01:58:07,627][106226] Updated weights for policy 0, policy_version 934190 (0.0007) [2023-12-28 01:58:07,657][106225] Updated weights for policy 1, policy_version 936563 (0.0007) [2023-12-28 01:58:07,683][106226] Updated weights for policy 0, policy_version 934200 (0.0006) [2023-12-28 01:58:07,709][106225] Updated weights for policy 1, policy_version 936573 (0.0006) [2023-12-28 01:58:07,746][106226] Updated weights for policy 0, policy_version 934210 (0.0007) [2023-12-28 01:58:08,394][106225] Updated weights for policy 1, policy_version 936583 (0.0008) [2023-12-28 01:58:08,462][106225] Updated weights for policy 1, policy_version 936593 (0.0008) [2023-12-28 01:58:08,527][106225] Updated weights for policy 1, policy_version 936603 (0.0006) [2023-12-28 01:58:08,536][106226] Updated weights for policy 0, policy_version 934220 (0.0009) [2023-12-28 01:58:08,602][106226] Updated weights for policy 0, policy_version 934230 (0.0007) [2023-12-28 01:58:08,664][106226] Updated weights for policy 0, policy_version 934240 (0.0008) [2023-12-28 01:58:09,157][106225] Updated weights for policy 1, policy_version 936613 (0.0006) [2023-12-28 01:58:09,216][106225] Updated weights for policy 1, policy_version 936623 (0.0006) [2023-12-28 01:58:09,294][106225] Updated weights for policy 1, policy_version 936633 (0.0008) [2023-12-28 01:58:09,479][106226] Updated weights for policy 0, policy_version 934250 (0.0009) [2023-12-28 01:58:09,541][106226] Updated weights for policy 0, policy_version 934260 (0.0009) [2023-12-28 01:58:09,608][106226] Updated weights for policy 0, policy_version 934270 (0.0010) [2023-12-28 01:58:09,670][106226] Updated weights for policy 0, policy_version 934280 (0.0009) [2023-12-28 01:58:09,953][106225] Updated weights for policy 1, policy_version 936643 (0.0007) [2023-12-28 01:58:10,011][106225] Updated weights for policy 1, policy_version 936653 (0.0008) [2023-12-28 01:58:10,060][106225] Updated weights for policy 1, policy_version 936663 (0.0008) [2023-12-28 01:58:10,425][106226] Updated weights for policy 0, policy_version 934290 (0.0009) [2023-12-28 01:58:10,485][106226] Updated weights for policy 0, policy_version 934300 (0.0009) [2023-12-28 01:58:10,555][106226] Updated weights for policy 0, policy_version 934310 (0.0009) [2023-12-28 01:58:10,857][106225] Updated weights for policy 1, policy_version 936673 (0.0008) [2023-12-28 01:58:10,925][106225] Updated weights for policy 1, policy_version 936683 (0.0006) [2023-12-28 01:58:10,995][106225] Updated weights for policy 1, policy_version 936693 (0.0008) [2023-12-28 01:58:11,067][106225] Updated weights for policy 1, policy_version 936703 (0.0008) [2023-12-28 01:58:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 479076352. Throughput: 0: 9925.5, 1: 9901.2. Samples: 479047532. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:11,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.220')] [2023-12-28 01:58:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000936704_239837184.pth... [2023-12-28 01:58:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000934312_239239168.pth... [2023-12-28 01:58:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000935552_239542272.pth [2023-12-28 01:58:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000933160_238944256.pth [2023-12-28 01:58:11,426][106226] Updated weights for policy 0, policy_version 934320 (0.0008) [2023-12-28 01:58:11,495][106226] Updated weights for policy 0, policy_version 934330 (0.0008) [2023-12-28 01:58:11,557][106226] Updated weights for policy 0, policy_version 934340 (0.0011) [2023-12-28 01:58:11,827][106225] Updated weights for policy 1, policy_version 936713 (0.0008) [2023-12-28 01:58:11,891][106225] Updated weights for policy 1, policy_version 936723 (0.0008) [2023-12-28 01:58:11,954][106225] Updated weights for policy 1, policy_version 936733 (0.0008) [2023-12-28 01:58:12,372][106226] Updated weights for policy 0, policy_version 934350 (0.0009) [2023-12-28 01:58:12,434][106226] Updated weights for policy 0, policy_version 934360 (0.0006) [2023-12-28 01:58:12,503][106226] Updated weights for policy 0, policy_version 934370 (0.0006) [2023-12-28 01:58:12,635][106225] Updated weights for policy 1, policy_version 936743 (0.0008) [2023-12-28 01:58:12,693][106225] Updated weights for policy 1, policy_version 936753 (0.0008) [2023-12-28 01:58:12,746][106225] Updated weights for policy 1, policy_version 936763 (0.0008) [2023-12-28 01:58:13,190][106226] Updated weights for policy 0, policy_version 934380 (0.0008) [2023-12-28 01:58:13,244][106226] Updated weights for policy 0, policy_version 934390 (0.0009) [2023-12-28 01:58:13,293][106226] Updated weights for policy 0, policy_version 934400 (0.0008) [2023-12-28 01:58:13,415][106225] Updated weights for policy 1, policy_version 936773 (0.0008) [2023-12-28 01:58:13,464][106225] Updated weights for policy 1, policy_version 936783 (0.0009) [2023-12-28 01:58:13,519][106225] Updated weights for policy 1, policy_version 936793 (0.0009) [2023-12-28 01:58:13,917][106226] Updated weights for policy 0, policy_version 934410 (0.0009) [2023-12-28 01:58:13,985][106226] Updated weights for policy 0, policy_version 934420 (0.0009) [2023-12-28 01:58:14,051][106226] Updated weights for policy 0, policy_version 934430 (0.0010) [2023-12-28 01:58:14,112][106226] Updated weights for policy 0, policy_version 934440 (0.0011) [2023-12-28 01:58:14,191][106225] Updated weights for policy 1, policy_version 936803 (0.0008) [2023-12-28 01:58:14,253][106225] Updated weights for policy 1, policy_version 936813 (0.0008) [2023-12-28 01:58:14,306][106225] Updated weights for policy 1, policy_version 936823 (0.0008) [2023-12-28 01:58:14,822][106226] Updated weights for policy 0, policy_version 934450 (0.0010) [2023-12-28 01:58:14,886][106226] Updated weights for policy 0, policy_version 934460 (0.0011) [2023-12-28 01:58:14,952][106226] Updated weights for policy 0, policy_version 934470 (0.0011) [2023-12-28 01:58:14,993][106225] Updated weights for policy 1, policy_version 936833 (0.0008) [2023-12-28 01:58:15,050][106225] Updated weights for policy 1, policy_version 936843 (0.0009) [2023-12-28 01:58:15,108][106225] Updated weights for policy 1, policy_version 936853 (0.0009) [2023-12-28 01:58:15,161][106225] Updated weights for policy 1, policy_version 936863 (0.0007) [2023-12-28 01:58:15,680][106226] Updated weights for policy 0, policy_version 934480 (0.0009) [2023-12-28 01:58:15,734][106226] Updated weights for policy 0, policy_version 934490 (0.0006) [2023-12-28 01:58:15,797][106226] Updated weights for policy 0, policy_version 934500 (0.0008) [2023-12-28 01:58:15,865][106225] Updated weights for policy 1, policy_version 936873 (0.0010) [2023-12-28 01:58:15,926][106225] Updated weights for policy 1, policy_version 936883 (0.0010) [2023-12-28 01:58:15,988][106225] Updated weights for policy 1, policy_version 936893 (0.0010) [2023-12-28 01:58:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 479174656. Throughput: 0: 9729.2, 1: 9869.1. Samples: 479160832. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:16,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.851')] [2023-12-28 01:58:16,508][106226] Updated weights for policy 0, policy_version 934510 (0.0009) [2023-12-28 01:58:16,557][106226] Updated weights for policy 0, policy_version 934520 (0.0008) [2023-12-28 01:58:16,607][106226] Updated weights for policy 0, policy_version 934530 (0.0007) [2023-12-28 01:58:16,633][106225] Updated weights for policy 1, policy_version 936903 (0.0009) [2023-12-28 01:58:16,682][106225] Updated weights for policy 1, policy_version 936913 (0.0010) [2023-12-28 01:58:16,734][106225] Updated weights for policy 1, policy_version 936923 (0.0010) [2023-12-28 01:58:17,204][106226] Updated weights for policy 0, policy_version 934540 (0.0007) [2023-12-28 01:58:17,258][106226] Updated weights for policy 0, policy_version 934550 (0.0008) [2023-12-28 01:58:17,316][106226] Updated weights for policy 0, policy_version 934560 (0.0008) [2023-12-28 01:58:17,541][106225] Updated weights for policy 1, policy_version 936933 (0.0007) [2023-12-28 01:58:17,603][106225] Updated weights for policy 1, policy_version 936943 (0.0006) [2023-12-28 01:58:17,672][106225] Updated weights for policy 1, policy_version 936953 (0.0006) [2023-12-28 01:58:17,963][106226] Updated weights for policy 0, policy_version 934570 (0.0006) [2023-12-28 01:58:18,018][106226] Updated weights for policy 0, policy_version 934580 (0.0010) [2023-12-28 01:58:18,069][106226] Updated weights for policy 0, policy_version 934591 (0.0010) [2023-12-28 01:58:18,190][106225] Updated weights for policy 1, policy_version 936963 (0.0006) [2023-12-28 01:58:18,243][106225] Updated weights for policy 1, policy_version 936973 (0.0009) [2023-12-28 01:58:18,289][106225] Updated weights for policy 1, policy_version 936983 (0.0009) [2023-12-28 01:58:18,751][106226] Updated weights for policy 0, policy_version 934601 (0.0008) [2023-12-28 01:58:18,816][106226] Updated weights for policy 0, policy_version 934611 (0.0007) [2023-12-28 01:58:18,886][106226] Updated weights for policy 0, policy_version 934621 (0.0006) [2023-12-28 01:58:18,954][106226] Updated weights for policy 0, policy_version 934631 (0.0009) [2023-12-28 01:58:19,142][106225] Updated weights for policy 1, policy_version 936993 (0.0008) [2023-12-28 01:58:19,198][106225] Updated weights for policy 1, policy_version 937003 (0.0009) [2023-12-28 01:58:19,263][106225] Updated weights for policy 1, policy_version 937013 (0.0009) [2023-12-28 01:58:19,329][106225] Updated weights for policy 1, policy_version 937023 (0.0008) [2023-12-28 01:58:19,605][106226] Updated weights for policy 0, policy_version 934641 (0.0008) [2023-12-28 01:58:19,669][106226] Updated weights for policy 0, policy_version 934651 (0.0009) [2023-12-28 01:58:19,733][106226] Updated weights for policy 0, policy_version 934661 (0.0008) [2023-12-28 01:58:20,148][106225] Updated weights for policy 1, policy_version 937033 (0.0009) [2023-12-28 01:58:20,201][106225] Updated weights for policy 1, policy_version 937043 (0.0009) [2023-12-28 01:58:20,266][106225] Updated weights for policy 1, policy_version 937053 (0.0009) [2023-12-28 01:58:20,432][106226] Updated weights for policy 0, policy_version 934671 (0.0007) [2023-12-28 01:58:20,497][106226] Updated weights for policy 0, policy_version 934681 (0.0008) [2023-12-28 01:58:20,572][106226] Updated weights for policy 0, policy_version 934691 (0.0009) [2023-12-28 01:58:21,065][106225] Updated weights for policy 1, policy_version 937063 (0.0008) [2023-12-28 01:58:21,126][106225] Updated weights for policy 1, policy_version 937073 (0.0009) [2023-12-28 01:58:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 479264768. Throughput: 0: 9807.7, 1: 9760.3. Samples: 479279932. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:21,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.930')] [2023-12-28 01:58:21,193][106225] Updated weights for policy 1, policy_version 937083 (0.0007) [2023-12-28 01:58:21,300][106226] Updated weights for policy 0, policy_version 934701 (0.0008) [2023-12-28 01:58:21,373][106226] Updated weights for policy 0, policy_version 934711 (0.0009) [2023-12-28 01:58:21,436][106226] Updated weights for policy 0, policy_version 934721 (0.0008) [2023-12-28 01:58:21,900][106225] Updated weights for policy 1, policy_version 937093 (0.0009) [2023-12-28 01:58:21,964][106225] Updated weights for policy 1, policy_version 937103 (0.0008) [2023-12-28 01:58:22,029][106225] Updated weights for policy 1, policy_version 937113 (0.0009) [2023-12-28 01:58:22,248][106226] Updated weights for policy 0, policy_version 934731 (0.0009) [2023-12-28 01:58:22,322][106226] Updated weights for policy 0, policy_version 934741 (0.0008) [2023-12-28 01:58:22,398][106226] Updated weights for policy 0, policy_version 934751 (0.0008) [2023-12-28 01:58:22,813][106225] Updated weights for policy 1, policy_version 937123 (0.0009) [2023-12-28 01:58:22,872][106225] Updated weights for policy 1, policy_version 937133 (0.0011) [2023-12-28 01:58:22,932][106225] Updated weights for policy 1, policy_version 937143 (0.0009) [2023-12-28 01:58:23,143][106226] Updated weights for policy 0, policy_version 934761 (0.0008) [2023-12-28 01:58:23,192][106226] Updated weights for policy 0, policy_version 934771 (0.0008) [2023-12-28 01:58:23,243][106226] Updated weights for policy 0, policy_version 934781 (0.0008) [2023-12-28 01:58:23,296][106226] Updated weights for policy 0, policy_version 934791 (0.0008) [2023-12-28 01:58:23,662][106225] Updated weights for policy 1, policy_version 937153 (0.0009) [2023-12-28 01:58:23,723][106225] Updated weights for policy 1, policy_version 937163 (0.0010) [2023-12-28 01:58:23,784][106225] Updated weights for policy 1, policy_version 937173 (0.0010) [2023-12-28 01:58:23,844][106225] Updated weights for policy 1, policy_version 937183 (0.0007) [2023-12-28 01:58:24,036][106226] Updated weights for policy 0, policy_version 934801 (0.0008) [2023-12-28 01:58:24,087][106226] Updated weights for policy 0, policy_version 934811 (0.0009) [2023-12-28 01:58:24,150][106226] Updated weights for policy 0, policy_version 934821 (0.0006) [2023-12-28 01:58:24,507][106225] Updated weights for policy 1, policy_version 937193 (0.0007) [2023-12-28 01:58:24,563][106225] Updated weights for policy 1, policy_version 937203 (0.0008) [2023-12-28 01:58:24,625][106225] Updated weights for policy 1, policy_version 937213 (0.0009) [2023-12-28 01:58:24,860][106226] Updated weights for policy 0, policy_version 934831 (0.0007) [2023-12-28 01:58:24,925][106226] Updated weights for policy 0, policy_version 934841 (0.0008) [2023-12-28 01:58:24,996][106226] Updated weights for policy 0, policy_version 934851 (0.0005) [2023-12-28 01:58:25,307][106225] Updated weights for policy 1, policy_version 937223 (0.0008) [2023-12-28 01:58:25,358][106225] Updated weights for policy 1, policy_version 937233 (0.0010) [2023-12-28 01:58:25,411][106225] Updated weights for policy 1, policy_version 937243 (0.0007) [2023-12-28 01:58:25,628][106226] Updated weights for policy 0, policy_version 934861 (0.0007) [2023-12-28 01:58:25,697][106226] Updated weights for policy 0, policy_version 934871 (0.0008) [2023-12-28 01:58:25,754][106226] Updated weights for policy 0, policy_version 934881 (0.0008) [2023-12-28 01:58:26,143][106225] Updated weights for policy 1, policy_version 937253 (0.0006) [2023-12-28 01:58:26,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 479363072. Throughput: 0: 9784.9, 1: 9695.5. Samples: 479334588. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:26,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-4.867')] [2023-12-28 01:58:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000934888_239386624.pth... [2023-12-28 01:58:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000933736_239091712.pth [2023-12-28 01:58:26,206][106225] Updated weights for policy 1, policy_version 937263 (0.0006) [2023-12-28 01:58:26,265][106225] Updated weights for policy 1, policy_version 937273 (0.0006) [2023-12-28 01:58:26,305][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000937280_239984640.pth... [2023-12-28 01:58:26,309][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000936128_239689728.pth [2023-12-28 01:58:26,470][106226] Updated weights for policy 0, policy_version 934891 (0.0007) [2023-12-28 01:58:26,534][106226] Updated weights for policy 0, policy_version 934901 (0.0008) [2023-12-28 01:58:26,596][106226] Updated weights for policy 0, policy_version 934911 (0.0008) [2023-12-28 01:58:26,847][106225] Updated weights for policy 1, policy_version 937283 (0.0005) [2023-12-28 01:58:26,893][106225] Updated weights for policy 1, policy_version 937293 (0.0005) [2023-12-28 01:58:26,944][106225] Updated weights for policy 1, policy_version 937303 (0.0005) [2023-12-28 01:58:27,366][106226] Updated weights for policy 0, policy_version 934921 (0.0008) [2023-12-28 01:58:27,425][106226] Updated weights for policy 0, policy_version 934931 (0.0010) [2023-12-28 01:58:27,485][106226] Updated weights for policy 0, policy_version 934941 (0.0010) [2023-12-28 01:58:27,544][106226] Updated weights for policy 0, policy_version 934951 (0.0010) [2023-12-28 01:58:27,641][106225] Updated weights for policy 1, policy_version 937313 (0.0010) [2023-12-28 01:58:27,703][106225] Updated weights for policy 1, policy_version 937323 (0.0010) [2023-12-28 01:58:27,762][106225] Updated weights for policy 1, policy_version 937333 (0.0010) [2023-12-28 01:58:27,807][106225] Updated weights for policy 1, policy_version 937343 (0.0010) [2023-12-28 01:58:28,174][106226] Updated weights for policy 0, policy_version 934961 (0.0011) [2023-12-28 01:58:28,236][106226] Updated weights for policy 0, policy_version 934971 (0.0011) [2023-12-28 01:58:28,298][106226] Updated weights for policy 0, policy_version 934981 (0.0011) [2023-12-28 01:58:28,476][106225] Updated weights for policy 1, policy_version 937353 (0.0010) [2023-12-28 01:58:28,540][106225] Updated weights for policy 1, policy_version 937363 (0.0010) [2023-12-28 01:58:28,603][106225] Updated weights for policy 1, policy_version 937373 (0.0010) [2023-12-28 01:58:28,973][106226] Updated weights for policy 0, policy_version 934991 (0.0007) [2023-12-28 01:58:29,040][106226] Updated weights for policy 0, policy_version 935001 (0.0009) [2023-12-28 01:58:29,108][106226] Updated weights for policy 0, policy_version 935011 (0.0005) [2023-12-28 01:58:29,278][106225] Updated weights for policy 1, policy_version 937383 (0.0009) [2023-12-28 01:58:29,343][106225] Updated weights for policy 1, policy_version 937393 (0.0008) [2023-12-28 01:58:29,413][106225] Updated weights for policy 1, policy_version 937403 (0.0008) [2023-12-28 01:58:29,792][106226] Updated weights for policy 0, policy_version 935021 (0.0005) [2023-12-28 01:58:29,861][106226] Updated weights for policy 0, policy_version 935031 (0.0009) [2023-12-28 01:58:29,909][106226] Updated weights for policy 0, policy_version 935041 (0.0008) [2023-12-28 01:58:30,176][106225] Updated weights for policy 1, policy_version 937413 (0.0008) [2023-12-28 01:58:30,242][106225] Updated weights for policy 1, policy_version 937423 (0.0007) [2023-12-28 01:58:30,304][106225] Updated weights for policy 1, policy_version 937433 (0.0008) [2023-12-28 01:58:30,677][106226] Updated weights for policy 0, policy_version 935051 (0.0009) [2023-12-28 01:58:30,732][106226] Updated weights for policy 0, policy_version 935061 (0.0008) [2023-12-28 01:58:30,788][106226] Updated weights for policy 0, policy_version 935071 (0.0008) [2023-12-28 01:58:30,949][106225] Updated weights for policy 1, policy_version 937443 (0.0007) [2023-12-28 01:58:31,005][106225] Updated weights for policy 1, policy_version 937453 (0.0007) [2023-12-28 01:58:31,073][106225] Updated weights for policy 1, policy_version 937463 (0.0008) [2023-12-28 01:58:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 479469568. Throughput: 0: 9824.2, 1: 9785.2. Samples: 479455432. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:31,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-5.060')] [2023-12-28 01:58:31,506][106226] Updated weights for policy 0, policy_version 935081 (0.0008) [2023-12-28 01:58:31,568][106226] Updated weights for policy 0, policy_version 935091 (0.0006) [2023-12-28 01:58:31,634][106226] Updated weights for policy 0, policy_version 935101 (0.0009) [2023-12-28 01:58:31,697][106226] Updated weights for policy 0, policy_version 935111 (0.0008) [2023-12-28 01:58:31,867][106225] Updated weights for policy 1, policy_version 937473 (0.0009) [2023-12-28 01:58:31,916][106225] Updated weights for policy 1, policy_version 937483 (0.0008) [2023-12-28 01:58:31,981][106225] Updated weights for policy 1, policy_version 937493 (0.0006) [2023-12-28 01:58:32,049][106225] Updated weights for policy 1, policy_version 937503 (0.0007) [2023-12-28 01:58:32,299][106226] Updated weights for policy 0, policy_version 935121 (0.0010) [2023-12-28 01:58:32,348][106226] Updated weights for policy 0, policy_version 935131 (0.0008) [2023-12-28 01:58:32,415][106226] Updated weights for policy 0, policy_version 935141 (0.0008) [2023-12-28 01:58:32,718][106225] Updated weights for policy 1, policy_version 937513 (0.0007) [2023-12-28 01:58:32,782][106225] Updated weights for policy 1, policy_version 937523 (0.0008) [2023-12-28 01:58:32,850][106225] Updated weights for policy 1, policy_version 937533 (0.0005) [2023-12-28 01:58:33,208][106226] Updated weights for policy 0, policy_version 935151 (0.0009) [2023-12-28 01:58:33,265][106226] Updated weights for policy 0, policy_version 935161 (0.0009) [2023-12-28 01:58:33,319][106226] Updated weights for policy 0, policy_version 935171 (0.0008) [2023-12-28 01:58:33,484][106225] Updated weights for policy 1, policy_version 937543 (0.0005) [2023-12-28 01:58:33,549][106225] Updated weights for policy 1, policy_version 937553 (0.0008) [2023-12-28 01:58:33,611][106225] Updated weights for policy 1, policy_version 937563 (0.0008) [2023-12-28 01:58:34,054][106226] Updated weights for policy 0, policy_version 935181 (0.0009) [2023-12-28 01:58:34,105][106226] Updated weights for policy 0, policy_version 935191 (0.0009) [2023-12-28 01:58:34,167][106226] Updated weights for policy 0, policy_version 935201 (0.0009) [2023-12-28 01:58:34,306][106225] Updated weights for policy 1, policy_version 937573 (0.0008) [2023-12-28 01:58:34,369][106225] Updated weights for policy 1, policy_version 937583 (0.0009) [2023-12-28 01:58:34,435][106225] Updated weights for policy 1, policy_version 937593 (0.0010) [2023-12-28 01:58:34,853][106226] Updated weights for policy 0, policy_version 935211 (0.0008) [2023-12-28 01:58:34,906][106226] Updated weights for policy 0, policy_version 935221 (0.0009) [2023-12-28 01:58:34,963][106226] Updated weights for policy 0, policy_version 935231 (0.0009) [2023-12-28 01:58:35,183][106225] Updated weights for policy 1, policy_version 937603 (0.0009) [2023-12-28 01:58:35,237][106225] Updated weights for policy 1, policy_version 937613 (0.0007) [2023-12-28 01:58:35,300][106225] Updated weights for policy 1, policy_version 937623 (0.0007) [2023-12-28 01:58:35,651][106226] Updated weights for policy 0, policy_version 935241 (0.0009) [2023-12-28 01:58:35,714][106226] Updated weights for policy 0, policy_version 935251 (0.0010) [2023-12-28 01:58:35,768][106226] Updated weights for policy 0, policy_version 935261 (0.0009) [2023-12-28 01:58:35,820][106226] Updated weights for policy 0, policy_version 935271 (0.0005) [2023-12-28 01:58:36,076][106225] Updated weights for policy 1, policy_version 937633 (0.0009) [2023-12-28 01:58:36,144][106225] Updated weights for policy 1, policy_version 937643 (0.0009) [2023-12-28 01:58:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 479559680. Throughput: 0: 9774.9, 1: 9759.2. Samples: 479572584. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:36,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.896')] [2023-12-28 01:58:36,206][106225] Updated weights for policy 1, policy_version 937653 (0.0008) [2023-12-28 01:58:36,265][106225] Updated weights for policy 1, policy_version 937663 (0.0008) [2023-12-28 01:58:36,450][106226] Updated weights for policy 0, policy_version 935281 (0.0010) [2023-12-28 01:58:36,516][106226] Updated weights for policy 0, policy_version 935291 (0.0011) [2023-12-28 01:58:36,574][106226] Updated weights for policy 0, policy_version 935301 (0.0011) [2023-12-28 01:58:36,932][106225] Updated weights for policy 1, policy_version 937673 (0.0006) [2023-12-28 01:58:36,996][106225] Updated weights for policy 1, policy_version 937683 (0.0006) [2023-12-28 01:58:37,060][106225] Updated weights for policy 1, policy_version 937693 (0.0005) [2023-12-28 01:58:37,258][106226] Updated weights for policy 0, policy_version 935311 (0.0011) [2023-12-28 01:58:37,329][106226] Updated weights for policy 0, policy_version 935321 (0.0011) [2023-12-28 01:58:37,404][106226] Updated weights for policy 0, policy_version 935331 (0.0011) [2023-12-28 01:58:37,621][106225] Updated weights for policy 1, policy_version 937703 (0.0009) [2023-12-28 01:58:37,673][106225] Updated weights for policy 1, policy_version 937713 (0.0011) [2023-12-28 01:58:37,733][106225] Updated weights for policy 1, policy_version 937723 (0.0011) [2023-12-28 01:58:38,095][106226] Updated weights for policy 0, policy_version 935341 (0.0011) [2023-12-28 01:58:38,159][106226] Updated weights for policy 0, policy_version 935351 (0.0009) [2023-12-28 01:58:38,220][106226] Updated weights for policy 0, policy_version 935361 (0.0009) [2023-12-28 01:58:38,399][106225] Updated weights for policy 1, policy_version 937733 (0.0011) [2023-12-28 01:58:38,471][106225] Updated weights for policy 1, policy_version 937743 (0.0011) [2023-12-28 01:58:38,538][106225] Updated weights for policy 1, policy_version 937753 (0.0011) [2023-12-28 01:58:38,858][106226] Updated weights for policy 0, policy_version 935371 (0.0009) [2023-12-28 01:58:38,927][106226] Updated weights for policy 0, policy_version 935381 (0.0006) [2023-12-28 01:58:38,999][106226] Updated weights for policy 0, policy_version 935391 (0.0006) [2023-12-28 01:58:39,188][106225] Updated weights for policy 1, policy_version 937763 (0.0011) [2023-12-28 01:58:39,256][106225] Updated weights for policy 1, policy_version 937773 (0.0010) [2023-12-28 01:58:39,317][106225] Updated weights for policy 1, policy_version 937783 (0.0009) [2023-12-28 01:58:39,731][106226] Updated weights for policy 0, policy_version 935401 (0.0006) [2023-12-28 01:58:39,797][106226] Updated weights for policy 0, policy_version 935411 (0.0011) [2023-12-28 01:58:39,869][106226] Updated weights for policy 0, policy_version 935421 (0.0015) [2023-12-28 01:58:39,935][106226] Updated weights for policy 0, policy_version 935431 (0.0008) [2023-12-28 01:58:40,091][106225] Updated weights for policy 1, policy_version 937793 (0.0009) [2023-12-28 01:58:40,153][106225] Updated weights for policy 1, policy_version 937803 (0.0008) [2023-12-28 01:58:40,219][106225] Updated weights for policy 1, policy_version 937813 (0.0008) [2023-12-28 01:58:40,280][106225] Updated weights for policy 1, policy_version 937823 (0.0008) [2023-12-28 01:58:40,683][106226] Updated weights for policy 0, policy_version 935441 (0.0011) [2023-12-28 01:58:40,742][106226] Updated weights for policy 0, policy_version 935451 (0.0011) [2023-12-28 01:58:40,808][106226] Updated weights for policy 0, policy_version 935461 (0.0009) [2023-12-28 01:58:41,024][106225] Updated weights for policy 1, policy_version 937833 (0.0008) [2023-12-28 01:58:41,097][106225] Updated weights for policy 1, policy_version 937843 (0.0009) [2023-12-28 01:58:41,165][106225] Updated weights for policy 1, policy_version 937853 (0.0008) [2023-12-28 01:58:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 479657984. Throughput: 0: 9813.3, 1: 9808.9. Samples: 479633580. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:41,175][105115] Avg episode reward: [(0, '-4.685'), (1, '-4.983')] [2023-12-28 01:58:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000935464_239534080.pth... [2023-12-28 01:58:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000937856_240132096.pth... [2023-12-28 01:58:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000934312_239239168.pth [2023-12-28 01:58:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000936704_239837184.pth [2023-12-28 01:58:41,629][106226] Updated weights for policy 0, policy_version 935471 (0.0009) [2023-12-28 01:58:41,702][106226] Updated weights for policy 0, policy_version 935481 (0.0010) [2023-12-28 01:58:41,771][106226] Updated weights for policy 0, policy_version 935491 (0.0010) [2023-12-28 01:58:42,005][106225] Updated weights for policy 1, policy_version 937863 (0.0009) [2023-12-28 01:58:42,069][106225] Updated weights for policy 1, policy_version 937873 (0.0009) [2023-12-28 01:58:42,128][106225] Updated weights for policy 1, policy_version 937883 (0.0009) [2023-12-28 01:58:42,526][106226] Updated weights for policy 0, policy_version 935501 (0.0009) [2023-12-28 01:58:42,583][106226] Updated weights for policy 0, policy_version 935511 (0.0008) [2023-12-28 01:58:42,645][106226] Updated weights for policy 0, policy_version 935521 (0.0008) [2023-12-28 01:58:42,916][106225] Updated weights for policy 1, policy_version 937893 (0.0008) [2023-12-28 01:58:42,974][106225] Updated weights for policy 1, policy_version 937903 (0.0009) [2023-12-28 01:58:43,036][106225] Updated weights for policy 1, policy_version 937913 (0.0008) [2023-12-28 01:58:43,292][106226] Updated weights for policy 0, policy_version 935531 (0.0008) [2023-12-28 01:58:43,346][106226] Updated weights for policy 0, policy_version 935541 (0.0008) [2023-12-28 01:58:43,418][106226] Updated weights for policy 0, policy_version 935551 (0.0009) [2023-12-28 01:58:43,725][106225] Updated weights for policy 1, policy_version 937923 (0.0009) [2023-12-28 01:58:43,788][106225] Updated weights for policy 1, policy_version 937933 (0.0010) [2023-12-28 01:58:43,848][106225] Updated weights for policy 1, policy_version 937943 (0.0010) [2023-12-28 01:58:44,150][106226] Updated weights for policy 0, policy_version 935561 (0.0009) [2023-12-28 01:58:44,213][106226] Updated weights for policy 0, policy_version 935571 (0.0008) [2023-12-28 01:58:44,265][106226] Updated weights for policy 0, policy_version 935581 (0.0008) [2023-12-28 01:58:44,323][106226] Updated weights for policy 0, policy_version 935591 (0.0008) [2023-12-28 01:58:44,511][106225] Updated weights for policy 1, policy_version 937953 (0.0010) [2023-12-28 01:58:44,564][106225] Updated weights for policy 1, policy_version 937963 (0.0005) [2023-12-28 01:58:44,622][106225] Updated weights for policy 1, policy_version 937973 (0.0005) [2023-12-28 01:58:44,678][106225] Updated weights for policy 1, policy_version 937983 (0.0007) [2023-12-28 01:58:45,087][106226] Updated weights for policy 0, policy_version 935601 (0.0010) [2023-12-28 01:58:45,147][106226] Updated weights for policy 0, policy_version 935611 (0.0006) [2023-12-28 01:58:45,200][106226] Updated weights for policy 0, policy_version 935621 (0.0011) [2023-12-28 01:58:45,372][106225] Updated weights for policy 1, policy_version 937993 (0.0008) [2023-12-28 01:58:45,433][106225] Updated weights for policy 1, policy_version 938003 (0.0008) [2023-12-28 01:58:45,484][106225] Updated weights for policy 1, policy_version 938013 (0.0008) [2023-12-28 01:58:45,931][106226] Updated weights for policy 0, policy_version 935631 (0.0011) [2023-12-28 01:58:45,992][106226] Updated weights for policy 0, policy_version 935641 (0.0011) [2023-12-28 01:58:46,061][106226] Updated weights for policy 0, policy_version 935651 (0.0008) [2023-12-28 01:58:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 479756288. Throughput: 0: 9711.3, 1: 9696.8. Samples: 479746020. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:46,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.815')] [2023-12-28 01:58:46,179][106225] Updated weights for policy 1, policy_version 938023 (0.0008) [2023-12-28 01:58:46,246][106225] Updated weights for policy 1, policy_version 938033 (0.0006) [2023-12-28 01:58:46,298][106225] Updated weights for policy 1, policy_version 938043 (0.0007) [2023-12-28 01:58:46,756][106226] Updated weights for policy 0, policy_version 935661 (0.0009) [2023-12-28 01:58:46,821][106226] Updated weights for policy 0, policy_version 935671 (0.0006) [2023-12-28 01:58:46,873][106226] Updated weights for policy 0, policy_version 935681 (0.0008) [2023-12-28 01:58:46,962][106225] Updated weights for policy 1, policy_version 938053 (0.0007) [2023-12-28 01:58:47,011][106225] Updated weights for policy 1, policy_version 938063 (0.0008) [2023-12-28 01:58:47,057][106225] Updated weights for policy 1, policy_version 938073 (0.0008) [2023-12-28 01:58:47,553][106226] Updated weights for policy 0, policy_version 935691 (0.0007) [2023-12-28 01:58:47,615][106226] Updated weights for policy 0, policy_version 935701 (0.0010) [2023-12-28 01:58:47,676][106226] Updated weights for policy 0, policy_version 935711 (0.0011) [2023-12-28 01:58:47,830][106225] Updated weights for policy 1, policy_version 938083 (0.0007) [2023-12-28 01:58:47,890][106225] Updated weights for policy 1, policy_version 938093 (0.0008) [2023-12-28 01:58:47,951][106225] Updated weights for policy 1, policy_version 938103 (0.0008) [2023-12-28 01:58:48,355][106226] Updated weights for policy 0, policy_version 935721 (0.0010) [2023-12-28 01:58:48,412][106226] Updated weights for policy 0, policy_version 935731 (0.0008) [2023-12-28 01:58:48,484][106226] Updated weights for policy 0, policy_version 935741 (0.0009) [2023-12-28 01:58:48,548][106226] Updated weights for policy 0, policy_version 935751 (0.0008) [2023-12-28 01:58:48,627][106225] Updated weights for policy 1, policy_version 938113 (0.0009) [2023-12-28 01:58:48,694][106225] Updated weights for policy 1, policy_version 938123 (0.0007) [2023-12-28 01:58:48,752][106225] Updated weights for policy 1, policy_version 938133 (0.0006) [2023-12-28 01:58:48,815][106225] Updated weights for policy 1, policy_version 938143 (0.0008) [2023-12-28 01:58:49,367][106226] Updated weights for policy 0, policy_version 935761 (0.0012) [2023-12-28 01:58:49,430][106226] Updated weights for policy 0, policy_version 935771 (0.0008) [2023-12-28 01:58:49,444][106225] Updated weights for policy 1, policy_version 938153 (0.0008) [2023-12-28 01:58:49,487][106226] Updated weights for policy 0, policy_version 935781 (0.0006) [2023-12-28 01:58:49,501][106225] Updated weights for policy 1, policy_version 938163 (0.0008) [2023-12-28 01:58:49,557][106225] Updated weights for policy 1, policy_version 938173 (0.0008) [2023-12-28 01:58:50,279][106226] Updated weights for policy 0, policy_version 935791 (0.0007) [2023-12-28 01:58:50,293][106225] Updated weights for policy 1, policy_version 938183 (0.0007) [2023-12-28 01:58:50,331][106226] Updated weights for policy 0, policy_version 935801 (0.0006) [2023-12-28 01:58:50,344][106225] Updated weights for policy 1, policy_version 938193 (0.0008) [2023-12-28 01:58:50,391][106226] Updated weights for policy 0, policy_version 935811 (0.0007) [2023-12-28 01:58:50,405][106225] Updated weights for policy 1, policy_version 938203 (0.0006) [2023-12-28 01:58:51,004][106225] Updated weights for policy 1, policy_version 938213 (0.0005) [2023-12-28 01:58:51,069][106225] Updated weights for policy 1, policy_version 938223 (0.0008) [2023-12-28 01:58:51,140][106225] Updated weights for policy 1, policy_version 938233 (0.0009) [2023-12-28 01:58:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 479846400. Throughput: 0: 9602.9, 1: 9763.4. Samples: 479861800. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:51,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-4.870')] [2023-12-28 01:58:51,269][106226] Updated weights for policy 0, policy_version 935821 (0.0008) [2023-12-28 01:58:51,323][106226] Updated weights for policy 0, policy_version 935831 (0.0008) [2023-12-28 01:58:51,393][106226] Updated weights for policy 0, policy_version 935841 (0.0009) [2023-12-28 01:58:51,908][106225] Updated weights for policy 1, policy_version 938243 (0.0009) [2023-12-28 01:58:51,966][106225] Updated weights for policy 1, policy_version 938253 (0.0009) [2023-12-28 01:58:52,032][106225] Updated weights for policy 1, policy_version 938263 (0.0009) [2023-12-28 01:58:52,281][106226] Updated weights for policy 0, policy_version 935851 (0.0009) [2023-12-28 01:58:52,345][106226] Updated weights for policy 0, policy_version 935861 (0.0007) [2023-12-28 01:58:52,410][106226] Updated weights for policy 0, policy_version 935871 (0.0010) [2023-12-28 01:58:52,771][106225] Updated weights for policy 1, policy_version 938273 (0.0009) [2023-12-28 01:58:52,834][106225] Updated weights for policy 1, policy_version 938283 (0.0008) [2023-12-28 01:58:52,909][106225] Updated weights for policy 1, policy_version 938293 (0.0006) [2023-12-28 01:58:52,974][106225] Updated weights for policy 1, policy_version 938303 (0.0006) [2023-12-28 01:58:53,180][106226] Updated weights for policy 0, policy_version 935881 (0.0009) [2023-12-28 01:58:53,244][106226] Updated weights for policy 0, policy_version 935891 (0.0010) [2023-12-28 01:58:53,299][106226] Updated weights for policy 0, policy_version 935901 (0.0006) [2023-12-28 01:58:53,346][106226] Updated weights for policy 0, policy_version 935911 (0.0005) [2023-12-28 01:58:53,535][106225] Updated weights for policy 1, policy_version 938313 (0.0006) [2023-12-28 01:58:53,592][106225] Updated weights for policy 1, policy_version 938323 (0.0006) [2023-12-28 01:58:53,650][106225] Updated weights for policy 1, policy_version 938333 (0.0006) [2023-12-28 01:58:54,023][106226] Updated weights for policy 0, policy_version 935921 (0.0009) [2023-12-28 01:58:54,074][106226] Updated weights for policy 0, policy_version 935932 (0.0009) [2023-12-28 01:58:54,126][106226] Updated weights for policy 0, policy_version 935942 (0.0008) [2023-12-28 01:58:54,256][106225] Updated weights for policy 1, policy_version 938343 (0.0006) [2023-12-28 01:58:54,325][106225] Updated weights for policy 1, policy_version 938353 (0.0005) [2023-12-28 01:58:54,385][106225] Updated weights for policy 1, policy_version 938363 (0.0008) [2023-12-28 01:58:54,815][106226] Updated weights for policy 0, policy_version 935952 (0.0010) [2023-12-28 01:58:54,868][106226] Updated weights for policy 0, policy_version 935962 (0.0007) [2023-12-28 01:58:54,931][106226] Updated weights for policy 0, policy_version 935972 (0.0006) [2023-12-28 01:58:55,009][106225] Updated weights for policy 1, policy_version 938373 (0.0008) [2023-12-28 01:58:55,078][106225] Updated weights for policy 1, policy_version 938383 (0.0007) [2023-12-28 01:58:55,152][106225] Updated weights for policy 1, policy_version 938393 (0.0006) [2023-12-28 01:58:55,584][106226] Updated weights for policy 0, policy_version 935982 (0.0009) [2023-12-28 01:58:55,641][106226] Updated weights for policy 0, policy_version 935992 (0.0011) [2023-12-28 01:58:55,695][106226] Updated weights for policy 0, policy_version 936002 (0.0010) [2023-12-28 01:58:55,814][106225] Updated weights for policy 1, policy_version 938403 (0.0006) [2023-12-28 01:58:55,868][106225] Updated weights for policy 1, policy_version 938413 (0.0007) [2023-12-28 01:58:55,929][106225] Updated weights for policy 1, policy_version 938423 (0.0008) [2023-12-28 01:58:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 479952896. Throughput: 0: 9578.7, 1: 9785.1. Samples: 479918908. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:58:56,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-5.099')] [2023-12-28 01:58:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000938432_240279552.pth... [2023-12-28 01:58:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000936008_239673344.pth... [2023-12-28 01:58:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000937280_239984640.pth [2023-12-28 01:58:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000934888_239386624.pth [2023-12-28 01:58:56,472][106226] Updated weights for policy 0, policy_version 936012 (0.0010) [2023-12-28 01:58:56,532][106226] Updated weights for policy 0, policy_version 936022 (0.0008) [2023-12-28 01:58:56,590][106226] Updated weights for policy 0, policy_version 936032 (0.0008) [2023-12-28 01:58:56,661][106225] Updated weights for policy 1, policy_version 938433 (0.0009) [2023-12-28 01:58:56,711][106225] Updated weights for policy 1, policy_version 938443 (0.0008) [2023-12-28 01:58:56,760][106225] Updated weights for policy 1, policy_version 938453 (0.0009) [2023-12-28 01:58:56,818][106225] Updated weights for policy 1, policy_version 938463 (0.0009) [2023-12-28 01:58:57,222][106226] Updated weights for policy 0, policy_version 936042 (0.0008) [2023-12-28 01:58:57,278][106226] Updated weights for policy 0, policy_version 936052 (0.0010) [2023-12-28 01:58:57,336][106226] Updated weights for policy 0, policy_version 936062 (0.0011) [2023-12-28 01:58:57,399][106226] Updated weights for policy 0, policy_version 936072 (0.0006) [2023-12-28 01:58:57,614][106225] Updated weights for policy 1, policy_version 938473 (0.0008) [2023-12-28 01:58:57,673][106225] Updated weights for policy 1, policy_version 938483 (0.0007) [2023-12-28 01:58:57,723][106225] Updated weights for policy 1, policy_version 938493 (0.0008) [2023-12-28 01:58:58,010][106226] Updated weights for policy 0, policy_version 936082 (0.0005) [2023-12-28 01:58:58,080][106226] Updated weights for policy 0, policy_version 936092 (0.0007) [2023-12-28 01:58:58,143][106226] Updated weights for policy 0, policy_version 936102 (0.0006) [2023-12-28 01:58:58,541][106225] Updated weights for policy 1, policy_version 938503 (0.0008) [2023-12-28 01:58:58,605][106225] Updated weights for policy 1, policy_version 938513 (0.0007) [2023-12-28 01:58:58,678][106225] Updated weights for policy 1, policy_version 938523 (0.0007) [2023-12-28 01:58:58,863][106226] Updated weights for policy 0, policy_version 936112 (0.0008) [2023-12-28 01:58:58,932][106226] Updated weights for policy 0, policy_version 936122 (0.0010) [2023-12-28 01:58:59,000][106226] Updated weights for policy 0, policy_version 936132 (0.0010) [2023-12-28 01:58:59,585][106225] Updated weights for policy 1, policy_version 938533 (0.0014) [2023-12-28 01:58:59,647][106225] Updated weights for policy 1, policy_version 938543 (0.0010) [2023-12-28 01:58:59,712][106225] Updated weights for policy 1, policy_version 938553 (0.0010) [2023-12-28 01:58:59,746][106226] Updated weights for policy 0, policy_version 936142 (0.0011) [2023-12-28 01:58:59,806][106226] Updated weights for policy 0, policy_version 936152 (0.0010) [2023-12-28 01:58:59,873][106226] Updated weights for policy 0, policy_version 936162 (0.0009) [2023-12-28 01:59:00,418][106225] Updated weights for policy 1, policy_version 938563 (0.0007) [2023-12-28 01:59:00,471][106225] Updated weights for policy 1, policy_version 938573 (0.0010) [2023-12-28 01:59:00,527][106225] Updated weights for policy 1, policy_version 938583 (0.0010) [2023-12-28 01:59:00,566][106226] Updated weights for policy 0, policy_version 936172 (0.0007) [2023-12-28 01:59:00,624][106226] Updated weights for policy 0, policy_version 936182 (0.0007) [2023-12-28 01:59:00,685][106226] Updated weights for policy 0, policy_version 936192 (0.0009) [2023-12-28 01:59:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19716.3). Total num frames: 480043008. Throughput: 0: 9681.4, 1: 9752.4. Samples: 480035356. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:59:01,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-4.795')] [2023-12-28 01:59:01,267][106225] Updated weights for policy 1, policy_version 938593 (0.0010) [2023-12-28 01:59:01,319][106225] Updated weights for policy 1, policy_version 938603 (0.0006) [2023-12-28 01:59:01,343][106226] Updated weights for policy 0, policy_version 936202 (0.0009) [2023-12-28 01:59:01,401][106225] Updated weights for policy 1, policy_version 938613 (0.0011) [2023-12-28 01:59:01,417][106226] Updated weights for policy 0, policy_version 936212 (0.0009) [2023-12-28 01:59:01,461][106225] Updated weights for policy 1, policy_version 938623 (0.0009) [2023-12-28 01:59:01,474][106226] Updated weights for policy 0, policy_version 936222 (0.0009) [2023-12-28 01:59:01,538][106226] Updated weights for policy 0, policy_version 936232 (0.0010) [2023-12-28 01:59:02,257][106226] Updated weights for policy 0, policy_version 936242 (0.0008) [2023-12-28 01:59:02,274][106225] Updated weights for policy 1, policy_version 938633 (0.0006) [2023-12-28 01:59:02,316][106226] Updated weights for policy 0, policy_version 936252 (0.0007) [2023-12-28 01:59:02,333][106225] Updated weights for policy 1, policy_version 938643 (0.0006) [2023-12-28 01:59:02,386][106226] Updated weights for policy 0, policy_version 936262 (0.0008) [2023-12-28 01:59:02,405][106225] Updated weights for policy 1, policy_version 938654 (0.0009) [2023-12-28 01:59:03,108][106225] Updated weights for policy 1, policy_version 938664 (0.0006) [2023-12-28 01:59:03,125][106226] Updated weights for policy 0, policy_version 936272 (0.0007) [2023-12-28 01:59:03,165][106225] Updated weights for policy 1, policy_version 938674 (0.0005) [2023-12-28 01:59:03,182][106226] Updated weights for policy 0, policy_version 936282 (0.0006) [2023-12-28 01:59:03,225][106225] Updated weights for policy 1, policy_version 938684 (0.0005) [2023-12-28 01:59:03,240][106226] Updated weights for policy 0, policy_version 936292 (0.0006) [2023-12-28 01:59:03,805][106226] Updated weights for policy 0, policy_version 936302 (0.0007) [2023-12-28 01:59:03,853][106225] Updated weights for policy 1, policy_version 938694 (0.0007) [2023-12-28 01:59:03,868][106226] Updated weights for policy 0, policy_version 936312 (0.0008) [2023-12-28 01:59:03,913][106225] Updated weights for policy 1, policy_version 938704 (0.0010) [2023-12-28 01:59:03,935][106226] Updated weights for policy 0, policy_version 936322 (0.0006) [2023-12-28 01:59:03,973][106225] Updated weights for policy 1, policy_version 938714 (0.0009) [2023-12-28 01:59:04,671][106226] Updated weights for policy 0, policy_version 936332 (0.0008) [2023-12-28 01:59:04,681][106225] Updated weights for policy 1, policy_version 938724 (0.0005) [2023-12-28 01:59:04,724][106226] Updated weights for policy 0, policy_version 936342 (0.0008) [2023-12-28 01:59:04,738][106225] Updated weights for policy 1, policy_version 938734 (0.0010) [2023-12-28 01:59:04,782][106226] Updated weights for policy 0, policy_version 936352 (0.0005) [2023-12-28 01:59:04,794][106225] Updated weights for policy 1, policy_version 938744 (0.0010) [2023-12-28 01:59:05,493][106225] Updated weights for policy 1, policy_version 938754 (0.0010) [2023-12-28 01:59:05,517][106226] Updated weights for policy 0, policy_version 936362 (0.0005) [2023-12-28 01:59:05,546][106225] Updated weights for policy 1, policy_version 938764 (0.0008) [2023-12-28 01:59:05,581][106226] Updated weights for policy 0, policy_version 936372 (0.0007) [2023-12-28 01:59:05,604][106225] Updated weights for policy 1, policy_version 938774 (0.0007) [2023-12-28 01:59:05,631][106226] Updated weights for policy 0, policy_version 936382 (0.0006) [2023-12-28 01:59:05,660][106225] Updated weights for policy 1, policy_version 938784 (0.0007) [2023-12-28 01:59:05,685][106226] Updated weights for policy 0, policy_version 936392 (0.0005) [2023-12-28 01:59:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19251.2, 300 sec: 19716.3). Total num frames: 480141312. Throughput: 0: 9662.4, 1: 9761.3. Samples: 480154000. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:59:06,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.900')] [2023-12-28 01:59:06,351][106226] Updated weights for policy 0, policy_version 936402 (0.0011) [2023-12-28 01:59:06,399][106225] Updated weights for policy 1, policy_version 938794 (0.0007) [2023-12-28 01:59:06,416][106226] Updated weights for policy 0, policy_version 936412 (0.0011) [2023-12-28 01:59:06,461][106225] Updated weights for policy 1, policy_version 938804 (0.0006) [2023-12-28 01:59:06,482][106226] Updated weights for policy 0, policy_version 936422 (0.0010) [2023-12-28 01:59:06,529][106225] Updated weights for policy 1, policy_version 938814 (0.0007) [2023-12-28 01:59:07,178][106226] Updated weights for policy 0, policy_version 936432 (0.0009) [2023-12-28 01:59:07,230][106226] Updated weights for policy 0, policy_version 936442 (0.0008) [2023-12-28 01:59:07,270][106225] Updated weights for policy 1, policy_version 938824 (0.0008) [2023-12-28 01:59:07,293][106226] Updated weights for policy 0, policy_version 936452 (0.0008) [2023-12-28 01:59:07,327][106225] Updated weights for policy 1, policy_version 938834 (0.0008) [2023-12-28 01:59:07,392][106225] Updated weights for policy 1, policy_version 938844 (0.0008) [2023-12-28 01:59:07,967][106226] Updated weights for policy 0, policy_version 936462 (0.0006) [2023-12-28 01:59:08,029][106226] Updated weights for policy 0, policy_version 936472 (0.0007) [2023-12-28 01:59:08,092][106226] Updated weights for policy 0, policy_version 936482 (0.0010) [2023-12-28 01:59:08,104][106225] Updated weights for policy 1, policy_version 938854 (0.0008) [2023-12-28 01:59:08,149][106225] Updated weights for policy 1, policy_version 938864 (0.0007) [2023-12-28 01:59:08,206][106225] Updated weights for policy 1, policy_version 938874 (0.0008) [2023-12-28 01:59:08,730][106226] Updated weights for policy 0, policy_version 936492 (0.0011) [2023-12-28 01:59:08,786][106226] Updated weights for policy 0, policy_version 936502 (0.0008) [2023-12-28 01:59:08,855][106226] Updated weights for policy 0, policy_version 936512 (0.0005) [2023-12-28 01:59:08,968][106225] Updated weights for policy 1, policy_version 938884 (0.0007) [2023-12-28 01:59:09,017][106225] Updated weights for policy 1, policy_version 938894 (0.0009) [2023-12-28 01:59:09,079][106225] Updated weights for policy 1, policy_version 938904 (0.0007) [2023-12-28 01:59:09,477][106226] Updated weights for policy 0, policy_version 936522 (0.0006) [2023-12-28 01:59:09,536][106226] Updated weights for policy 0, policy_version 936532 (0.0006) [2023-12-28 01:59:09,599][106226] Updated weights for policy 0, policy_version 936542 (0.0008) [2023-12-28 01:59:09,662][106226] Updated weights for policy 0, policy_version 936552 (0.0008) [2023-12-28 01:59:09,912][106225] Updated weights for policy 1, policy_version 938914 (0.0008) [2023-12-28 01:59:09,983][106225] Updated weights for policy 1, policy_version 938924 (0.0008) [2023-12-28 01:59:10,044][106225] Updated weights for policy 1, policy_version 938934 (0.0009) [2023-12-28 01:59:10,115][106225] Updated weights for policy 1, policy_version 938944 (0.0008) [2023-12-28 01:59:10,332][106226] Updated weights for policy 0, policy_version 936562 (0.0009) [2023-12-28 01:59:10,392][106226] Updated weights for policy 0, policy_version 936572 (0.0009) [2023-12-28 01:59:10,458][106226] Updated weights for policy 0, policy_version 936582 (0.0008) [2023-12-28 01:59:10,879][106225] Updated weights for policy 1, policy_version 938954 (0.0010) [2023-12-28 01:59:10,934][106225] Updated weights for policy 1, policy_version 938964 (0.0009) [2023-12-28 01:59:10,994][106225] Updated weights for policy 1, policy_version 938974 (0.0009) [2023-12-28 01:59:11,116][106226] Updated weights for policy 0, policy_version 936592 (0.0008) [2023-12-28 01:59:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 480239616. Throughput: 0: 9745.3, 1: 9784.8. Samples: 480213444. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-28 01:59:11,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-5.222')] [2023-12-28 01:59:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000938976_240418816.pth... [2023-12-28 01:59:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000937856_240132096.pth [2023-12-28 01:59:11,197][106226] Updated weights for policy 0, policy_version 936602 (0.0008) [2023-12-28 01:59:11,267][106226] Updated weights for policy 0, policy_version 936612 (0.0009) [2023-12-28 01:59:11,294][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000936616_239828992.pth... [2023-12-28 01:59:11,298][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000935464_239534080.pth [2023-12-28 01:59:11,754][106225] Updated weights for policy 1, policy_version 938984 (0.0008) [2023-12-28 01:59:11,815][106225] Updated weights for policy 1, policy_version 938994 (0.0006) [2023-12-28 01:59:11,871][106225] Updated weights for policy 1, policy_version 939004 (0.0008) [2023-12-28 01:59:12,034][106226] Updated weights for policy 0, policy_version 936622 (0.0007) [2023-12-28 01:59:12,099][106226] Updated weights for policy 0, policy_version 936632 (0.0007) [2023-12-28 01:59:12,160][106226] Updated weights for policy 0, policy_version 936642 (0.0008) [2023-12-28 01:59:12,630][106225] Updated weights for policy 1, policy_version 939014 (0.0008) [2023-12-28 01:59:12,682][106225] Updated weights for policy 1, policy_version 939024 (0.0008) [2023-12-28 01:59:12,733][106225] Updated weights for policy 1, policy_version 939034 (0.0008) [2023-12-28 01:59:12,943][106226] Updated weights for policy 0, policy_version 936652 (0.0010) [2023-12-28 01:59:13,001][106226] Updated weights for policy 0, policy_version 936662 (0.0011) [2023-12-28 01:59:13,053][106226] Updated weights for policy 0, policy_version 936672 (0.0010) [2023-12-28 01:59:13,501][106225] Updated weights for policy 1, policy_version 939044 (0.0008) [2023-12-28 01:59:13,565][106225] Updated weights for policy 1, policy_version 939054 (0.0008) [2023-12-28 01:59:13,618][106225] Updated weights for policy 1, policy_version 939064 (0.0007) [2023-12-28 01:59:13,757][106226] Updated weights for policy 0, policy_version 936682 (0.0010) [2023-12-28 01:59:13,819][106226] Updated weights for policy 0, policy_version 936692 (0.0010) [2023-12-28 01:59:13,882][106226] Updated weights for policy 0, policy_version 936702 (0.0009) [2023-12-28 01:59:13,942][106226] Updated weights for policy 0, policy_version 936712 (0.0008) [2023-12-28 01:59:14,217][106225] Updated weights for policy 1, policy_version 939074 (0.0008) [2023-12-28 01:59:14,276][106225] Updated weights for policy 1, policy_version 939084 (0.0008) [2023-12-28 01:59:14,334][106225] Updated weights for policy 1, policy_version 939094 (0.0008) [2023-12-28 01:59:14,384][106225] Updated weights for policy 1, policy_version 939104 (0.0008) [2023-12-28 01:59:14,704][106226] Updated weights for policy 0, policy_version 936722 (0.0009) [2023-12-28 01:59:14,768][106226] Updated weights for policy 0, policy_version 936732 (0.0008) [2023-12-28 01:59:14,828][106226] Updated weights for policy 0, policy_version 936742 (0.0008) [2023-12-28 01:59:15,078][106225] Updated weights for policy 1, policy_version 939114 (0.0009) [2023-12-28 01:59:15,134][106225] Updated weights for policy 1, policy_version 939124 (0.0008) [2023-12-28 01:59:15,197][106225] Updated weights for policy 1, policy_version 939134 (0.0008) [2023-12-28 01:59:15,592][106226] Updated weights for policy 0, policy_version 936752 (0.0009) [2023-12-28 01:59:15,644][106226] Updated weights for policy 0, policy_version 936762 (0.0008) [2023-12-28 01:59:15,693][106226] Updated weights for policy 0, policy_version 936772 (0.0008) [2023-12-28 01:59:15,914][106225] Updated weights for policy 1, policy_version 939144 (0.0006) [2023-12-28 01:59:15,962][106225] Updated weights for policy 1, policy_version 939154 (0.0008) [2023-12-28 01:59:16,013][106225] Updated weights for policy 1, policy_version 939164 (0.0008) [2023-12-28 01:59:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 480337920. Throughput: 0: 9685.4, 1: 9670.7. Samples: 480326456. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:16,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.048')] [2023-12-28 01:59:16,350][106226] Updated weights for policy 0, policy_version 936782 (0.0008) [2023-12-28 01:59:16,415][106226] Updated weights for policy 0, policy_version 936792 (0.0008) [2023-12-28 01:59:16,470][106226] Updated weights for policy 0, policy_version 936802 (0.0005) [2023-12-28 01:59:16,847][106225] Updated weights for policy 1, policy_version 939175 (0.0007) [2023-12-28 01:59:16,905][106225] Updated weights for policy 1, policy_version 939185 (0.0007) [2023-12-28 01:59:16,965][106225] Updated weights for policy 1, policy_version 939195 (0.0009) [2023-12-28 01:59:17,060][106226] Updated weights for policy 0, policy_version 936812 (0.0007) [2023-12-28 01:59:17,122][106226] Updated weights for policy 0, policy_version 936822 (0.0007) [2023-12-28 01:59:17,173][106226] Updated weights for policy 0, policy_version 936832 (0.0008) [2023-12-28 01:59:17,662][106225] Updated weights for policy 1, policy_version 939205 (0.0007) [2023-12-28 01:59:17,732][106225] Updated weights for policy 1, policy_version 939215 (0.0007) [2023-12-28 01:59:17,800][106225] Updated weights for policy 1, policy_version 939225 (0.0007) [2023-12-28 01:59:17,898][106226] Updated weights for policy 0, policy_version 936842 (0.0007) [2023-12-28 01:59:17,959][106226] Updated weights for policy 0, policy_version 936852 (0.0008) [2023-12-28 01:59:18,008][106226] Updated weights for policy 0, policy_version 936862 (0.0006) [2023-12-28 01:59:18,065][106226] Updated weights for policy 0, policy_version 936872 (0.0009) [2023-12-28 01:59:18,553][106225] Updated weights for policy 1, policy_version 939235 (0.0007) [2023-12-28 01:59:18,612][106225] Updated weights for policy 1, policy_version 939245 (0.0009) [2023-12-28 01:59:18,671][106225] Updated weights for policy 1, policy_version 939255 (0.0009) [2023-12-28 01:59:18,805][106226] Updated weights for policy 0, policy_version 936882 (0.0009) [2023-12-28 01:59:18,865][106226] Updated weights for policy 0, policy_version 936892 (0.0008) [2023-12-28 01:59:18,917][106226] Updated weights for policy 0, policy_version 936902 (0.0009) [2023-12-28 01:59:19,330][106225] Updated weights for policy 1, policy_version 939265 (0.0008) [2023-12-28 01:59:19,395][106225] Updated weights for policy 1, policy_version 939275 (0.0008) [2023-12-28 01:59:19,444][106225] Updated weights for policy 1, policy_version 939285 (0.0010) [2023-12-28 01:59:19,508][106225] Updated weights for policy 1, policy_version 939295 (0.0008) [2023-12-28 01:59:19,717][106226] Updated weights for policy 0, policy_version 936912 (0.0009) [2023-12-28 01:59:19,779][106226] Updated weights for policy 0, policy_version 936922 (0.0009) [2023-12-28 01:59:19,848][106226] Updated weights for policy 0, policy_version 936932 (0.0010) [2023-12-28 01:59:20,310][106225] Updated weights for policy 1, policy_version 939305 (0.0009) [2023-12-28 01:59:20,370][106225] Updated weights for policy 1, policy_version 939315 (0.0008) [2023-12-28 01:59:20,424][106225] Updated weights for policy 1, policy_version 939325 (0.0009) [2023-12-28 01:59:20,597][106226] Updated weights for policy 0, policy_version 936942 (0.0009) [2023-12-28 01:59:20,657][106226] Updated weights for policy 0, policy_version 936952 (0.0009) [2023-12-28 01:59:20,724][106226] Updated weights for policy 0, policy_version 936962 (0.0007) [2023-12-28 01:59:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 480428032. Throughput: 0: 9669.7, 1: 9632.9. Samples: 480441200. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:21,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-4.987')] [2023-12-28 01:59:21,229][106225] Updated weights for policy 1, policy_version 939335 (0.0009) [2023-12-28 01:59:21,289][106225] Updated weights for policy 1, policy_version 939345 (0.0008) [2023-12-28 01:59:21,355][106225] Updated weights for policy 1, policy_version 939355 (0.0009) [2023-12-28 01:59:21,418][106226] Updated weights for policy 0, policy_version 936972 (0.0008) [2023-12-28 01:59:21,481][106226] Updated weights for policy 0, policy_version 936982 (0.0008) [2023-12-28 01:59:21,547][106226] Updated weights for policy 0, policy_version 936992 (0.0008) [2023-12-28 01:59:22,089][106225] Updated weights for policy 1, policy_version 939365 (0.0009) [2023-12-28 01:59:22,156][106225] Updated weights for policy 1, policy_version 939375 (0.0009) [2023-12-28 01:59:22,212][106225] Updated weights for policy 1, policy_version 939385 (0.0008) [2023-12-28 01:59:22,273][106226] Updated weights for policy 0, policy_version 937002 (0.0008) [2023-12-28 01:59:22,328][106226] Updated weights for policy 0, policy_version 937012 (0.0008) [2023-12-28 01:59:22,388][106226] Updated weights for policy 0, policy_version 937022 (0.0007) [2023-12-28 01:59:22,447][106226] Updated weights for policy 0, policy_version 937032 (0.0009) [2023-12-28 01:59:22,919][106225] Updated weights for policy 1, policy_version 939395 (0.0008) [2023-12-28 01:59:22,975][106225] Updated weights for policy 1, policy_version 939405 (0.0008) [2023-12-28 01:59:23,026][106225] Updated weights for policy 1, policy_version 939415 (0.0008) [2023-12-28 01:59:23,156][106226] Updated weights for policy 0, policy_version 937042 (0.0009) [2023-12-28 01:59:23,215][106226] Updated weights for policy 0, policy_version 937052 (0.0011) [2023-12-28 01:59:23,275][106226] Updated weights for policy 0, policy_version 937062 (0.0011) [2023-12-28 01:59:23,813][106225] Updated weights for policy 1, policy_version 939425 (0.0009) [2023-12-28 01:59:23,874][106225] Updated weights for policy 1, policy_version 939435 (0.0009) [2023-12-28 01:59:23,894][106226] Updated weights for policy 0, policy_version 937072 (0.0006) [2023-12-28 01:59:23,927][106225] Updated weights for policy 1, policy_version 939445 (0.0008) [2023-12-28 01:59:23,946][106226] Updated weights for policy 0, policy_version 937082 (0.0005) [2023-12-28 01:59:23,978][106225] Updated weights for policy 1, policy_version 939455 (0.0008) [2023-12-28 01:59:24,006][106226] Updated weights for policy 0, policy_version 937092 (0.0010) [2023-12-28 01:59:24,618][106226] Updated weights for policy 0, policy_version 937102 (0.0007) [2023-12-28 01:59:24,682][106226] Updated weights for policy 0, policy_version 937112 (0.0006) [2023-12-28 01:59:24,735][106226] Updated weights for policy 0, policy_version 937122 (0.0007) [2023-12-28 01:59:24,777][106225] Updated weights for policy 1, policy_version 939465 (0.0007) [2023-12-28 01:59:24,830][106225] Updated weights for policy 1, policy_version 939475 (0.0009) [2023-12-28 01:59:24,887][106225] Updated weights for policy 1, policy_version 939485 (0.0009) [2023-12-28 01:59:25,334][106226] Updated weights for policy 0, policy_version 937132 (0.0006) [2023-12-28 01:59:25,394][106226] Updated weights for policy 0, policy_version 937142 (0.0008) [2023-12-28 01:59:25,448][106226] Updated weights for policy 0, policy_version 937152 (0.0008) [2023-12-28 01:59:25,653][106225] Updated weights for policy 1, policy_version 939495 (0.0008) [2023-12-28 01:59:25,704][106225] Updated weights for policy 1, policy_version 939505 (0.0009) [2023-12-28 01:59:25,749][106225] Updated weights for policy 1, policy_version 939515 (0.0008) [2023-12-28 01:59:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 480526336. Throughput: 0: 9658.0, 1: 9563.4. Samples: 480498540. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:26,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-5.037')] [2023-12-28 01:59:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000939520_240558080.pth... [2023-12-28 01:59:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000938432_240279552.pth [2023-12-28 01:59:26,193][106226] Updated weights for policy 0, policy_version 937162 (0.0008) [2023-12-28 01:59:26,253][106226] Updated weights for policy 0, policy_version 937172 (0.0010) [2023-12-28 01:59:26,312][106226] Updated weights for policy 0, policy_version 937182 (0.0011) [2023-12-28 01:59:26,373][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000937192_239976448.pth... [2023-12-28 01:59:26,374][106226] Updated weights for policy 0, policy_version 937192 (0.0011) [2023-12-28 01:59:26,377][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000936008_239673344.pth [2023-12-28 01:59:26,416][106225] Updated weights for policy 1, policy_version 939525 (0.0008) [2023-12-28 01:59:26,478][106225] Updated weights for policy 1, policy_version 939535 (0.0008) [2023-12-28 01:59:26,544][106225] Updated weights for policy 1, policy_version 939545 (0.0008) [2023-12-28 01:59:27,039][106226] Updated weights for policy 0, policy_version 937202 (0.0005) [2023-12-28 01:59:27,093][106226] Updated weights for policy 0, policy_version 937212 (0.0005) [2023-12-28 01:59:27,146][106226] Updated weights for policy 0, policy_version 937222 (0.0005) [2023-12-28 01:59:27,333][106225] Updated weights for policy 1, policy_version 939555 (0.0007) [2023-12-28 01:59:27,384][106225] Updated weights for policy 1, policy_version 939565 (0.0005) [2023-12-28 01:59:27,431][106225] Updated weights for policy 1, policy_version 939575 (0.0005) [2023-12-28 01:59:27,760][106226] Updated weights for policy 0, policy_version 937232 (0.0006) [2023-12-28 01:59:27,805][106226] Updated weights for policy 0, policy_version 937242 (0.0005) [2023-12-28 01:59:27,866][106226] Updated weights for policy 0, policy_version 937252 (0.0005) [2023-12-28 01:59:28,199][106225] Updated weights for policy 1, policy_version 939585 (0.0007) [2023-12-28 01:59:28,257][106225] Updated weights for policy 1, policy_version 939595 (0.0010) [2023-12-28 01:59:28,323][106225] Updated weights for policy 1, policy_version 939605 (0.0009) [2023-12-28 01:59:28,384][106225] Updated weights for policy 1, policy_version 939615 (0.0007) [2023-12-28 01:59:28,413][106226] Updated weights for policy 0, policy_version 937262 (0.0006) [2023-12-28 01:59:28,480][106226] Updated weights for policy 0, policy_version 937272 (0.0009) [2023-12-28 01:59:28,539][106226] Updated weights for policy 0, policy_version 937282 (0.0009) [2023-12-28 01:59:29,120][106225] Updated weights for policy 1, policy_version 939625 (0.0007) [2023-12-28 01:59:29,170][106225] Updated weights for policy 1, policy_version 939635 (0.0008) [2023-12-28 01:59:29,197][106226] Updated weights for policy 0, policy_version 937292 (0.0009) [2023-12-28 01:59:29,226][106225] Updated weights for policy 1, policy_version 939645 (0.0008) [2023-12-28 01:59:29,259][106226] Updated weights for policy 0, policy_version 937302 (0.0007) [2023-12-28 01:59:29,316][106226] Updated weights for policy 0, policy_version 937312 (0.0009) [2023-12-28 01:59:29,882][106225] Updated weights for policy 1, policy_version 939655 (0.0007) [2023-12-28 01:59:29,951][106225] Updated weights for policy 1, policy_version 939665 (0.0006) [2023-12-28 01:59:30,010][106225] Updated weights for policy 1, policy_version 939675 (0.0008) [2023-12-28 01:59:30,133][106226] Updated weights for policy 0, policy_version 937322 (0.0009) [2023-12-28 01:59:30,182][106226] Updated weights for policy 0, policy_version 937332 (0.0010) [2023-12-28 01:59:30,230][106226] Updated weights for policy 0, policy_version 937342 (0.0010) [2023-12-28 01:59:30,276][106226] Updated weights for policy 0, policy_version 937352 (0.0010) [2023-12-28 01:59:30,572][106225] Updated weights for policy 1, policy_version 939685 (0.0007) [2023-12-28 01:59:30,639][106225] Updated weights for policy 1, policy_version 939695 (0.0006) [2023-12-28 01:59:30,718][106225] Updated weights for policy 1, policy_version 939705 (0.0008) [2023-12-28 01:59:31,010][106226] Updated weights for policy 0, policy_version 937362 (0.0011) [2023-12-28 01:59:31,079][106226] Updated weights for policy 0, policy_version 937372 (0.0011) [2023-12-28 01:59:31,139][106226] Updated weights for policy 0, policy_version 937382 (0.0011) [2023-12-28 01:59:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 480632832. Throughput: 0: 9813.8, 1: 9570.6. Samples: 480618320. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:31,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.157')] [2023-12-28 01:59:31,308][106225] Updated weights for policy 1, policy_version 939715 (0.0009) [2023-12-28 01:59:31,375][106225] Updated weights for policy 1, policy_version 939725 (0.0008) [2023-12-28 01:59:31,435][106225] Updated weights for policy 1, policy_version 939735 (0.0008) [2023-12-28 01:59:31,896][106226] Updated weights for policy 0, policy_version 937392 (0.0008) [2023-12-28 01:59:31,955][106226] Updated weights for policy 0, policy_version 937402 (0.0006) [2023-12-28 01:59:32,005][106226] Updated weights for policy 0, policy_version 937412 (0.0009) [2023-12-28 01:59:32,122][106225] Updated weights for policy 1, policy_version 939745 (0.0007) [2023-12-28 01:59:32,180][106225] Updated weights for policy 1, policy_version 939755 (0.0006) [2023-12-28 01:59:32,243][106225] Updated weights for policy 1, policy_version 939765 (0.0006) [2023-12-28 01:59:32,309][106225] Updated weights for policy 1, policy_version 939775 (0.0007) [2023-12-28 01:59:32,714][106226] Updated weights for policy 0, policy_version 937422 (0.0007) [2023-12-28 01:59:32,775][106226] Updated weights for policy 0, policy_version 937432 (0.0011) [2023-12-28 01:59:32,828][106226] Updated weights for policy 0, policy_version 937442 (0.0010) [2023-12-28 01:59:33,023][106225] Updated weights for policy 1, policy_version 939785 (0.0007) [2023-12-28 01:59:33,091][106225] Updated weights for policy 1, policy_version 939795 (0.0008) [2023-12-28 01:59:33,149][106225] Updated weights for policy 1, policy_version 939805 (0.0007) [2023-12-28 01:59:33,487][106226] Updated weights for policy 0, policy_version 937452 (0.0008) [2023-12-28 01:59:33,548][106226] Updated weights for policy 0, policy_version 937462 (0.0005) [2023-12-28 01:59:33,606][106226] Updated weights for policy 0, policy_version 937472 (0.0007) [2023-12-28 01:59:33,905][106225] Updated weights for policy 1, policy_version 939815 (0.0007) [2023-12-28 01:59:33,968][106225] Updated weights for policy 1, policy_version 939825 (0.0006) [2023-12-28 01:59:34,018][106225] Updated weights for policy 1, policy_version 939835 (0.0005) [2023-12-28 01:59:34,291][106226] Updated weights for policy 0, policy_version 937482 (0.0010) [2023-12-28 01:59:34,352][106226] Updated weights for policy 0, policy_version 937492 (0.0007) [2023-12-28 01:59:34,413][106226] Updated weights for policy 0, policy_version 937502 (0.0009) [2023-12-28 01:59:34,462][106226] Updated weights for policy 0, policy_version 937512 (0.0009) [2023-12-28 01:59:34,640][106225] Updated weights for policy 1, policy_version 939845 (0.0006) [2023-12-28 01:59:34,701][106225] Updated weights for policy 1, policy_version 939855 (0.0010) [2023-12-28 01:59:34,758][106225] Updated weights for policy 1, policy_version 939865 (0.0010) [2023-12-28 01:59:35,165][106226] Updated weights for policy 0, policy_version 937522 (0.0008) [2023-12-28 01:59:35,219][106226] Updated weights for policy 0, policy_version 937532 (0.0009) [2023-12-28 01:59:35,280][106226] Updated weights for policy 0, policy_version 937542 (0.0008) [2023-12-28 01:59:35,496][106225] Updated weights for policy 1, policy_version 939875 (0.0010) [2023-12-28 01:59:35,551][106225] Updated weights for policy 1, policy_version 939885 (0.0008) [2023-12-28 01:59:35,602][106225] Updated weights for policy 1, policy_version 939895 (0.0010) [2023-12-28 01:59:36,027][106226] Updated weights for policy 0, policy_version 937552 (0.0010) [2023-12-28 01:59:36,086][106226] Updated weights for policy 0, policy_version 937562 (0.0010) [2023-12-28 01:59:36,151][106226] Updated weights for policy 0, policy_version 937572 (0.0009) [2023-12-28 01:59:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 480731136. Throughput: 0: 9865.8, 1: 9598.8. Samples: 480737704. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:36,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.025')] [2023-12-28 01:59:36,246][106225] Updated weights for policy 1, policy_version 939905 (0.0011) [2023-12-28 01:59:36,302][106225] Updated weights for policy 1, policy_version 939915 (0.0007) [2023-12-28 01:59:36,371][106225] Updated weights for policy 1, policy_version 939925 (0.0008) [2023-12-28 01:59:36,432][106225] Updated weights for policy 1, policy_version 939935 (0.0008) [2023-12-28 01:59:36,918][106226] Updated weights for policy 0, policy_version 937582 (0.0008) [2023-12-28 01:59:36,984][106226] Updated weights for policy 0, policy_version 937592 (0.0009) [2023-12-28 01:59:37,045][106226] Updated weights for policy 0, policy_version 937602 (0.0009) [2023-12-28 01:59:37,083][106225] Updated weights for policy 1, policy_version 939945 (0.0008) [2023-12-28 01:59:37,137][106225] Updated weights for policy 1, policy_version 939955 (0.0007) [2023-12-28 01:59:37,205][106225] Updated weights for policy 1, policy_version 939965 (0.0009) [2023-12-28 01:59:37,799][106226] Updated weights for policy 0, policy_version 937612 (0.0008) [2023-12-28 01:59:37,841][106225] Updated weights for policy 1, policy_version 939975 (0.0006) [2023-12-28 01:59:37,861][106226] Updated weights for policy 0, policy_version 937622 (0.0008) [2023-12-28 01:59:37,900][106225] Updated weights for policy 1, policy_version 939985 (0.0008) [2023-12-28 01:59:37,924][106226] Updated weights for policy 0, policy_version 937632 (0.0008) [2023-12-28 01:59:37,957][106225] Updated weights for policy 1, policy_version 939995 (0.0006) [2023-12-28 01:59:38,651][106226] Updated weights for policy 0, policy_version 937642 (0.0006) [2023-12-28 01:59:38,666][106225] Updated weights for policy 1, policy_version 940005 (0.0007) [2023-12-28 01:59:38,716][106226] Updated weights for policy 0, policy_version 937652 (0.0007) [2023-12-28 01:59:38,726][106225] Updated weights for policy 1, policy_version 940015 (0.0008) [2023-12-28 01:59:38,777][106226] Updated weights for policy 0, policy_version 937662 (0.0006) [2023-12-28 01:59:38,781][106225] Updated weights for policy 1, policy_version 940025 (0.0008) [2023-12-28 01:59:38,835][106226] Updated weights for policy 0, policy_version 937672 (0.0006) [2023-12-28 01:59:39,562][106225] Updated weights for policy 1, policy_version 940035 (0.0007) [2023-12-28 01:59:39,581][106226] Updated weights for policy 0, policy_version 937682 (0.0010) [2023-12-28 01:59:39,618][106225] Updated weights for policy 1, policy_version 940045 (0.0009) [2023-12-28 01:59:39,646][106226] Updated weights for policy 0, policy_version 937692 (0.0009) [2023-12-28 01:59:39,684][106225] Updated weights for policy 1, policy_version 940055 (0.0008) [2023-12-28 01:59:39,699][106226] Updated weights for policy 0, policy_version 937702 (0.0006) [2023-12-28 01:59:40,402][106225] Updated weights for policy 1, policy_version 940065 (0.0008) [2023-12-28 01:59:40,462][106225] Updated weights for policy 1, policy_version 940075 (0.0006) [2023-12-28 01:59:40,472][106226] Updated weights for policy 0, policy_version 937712 (0.0010) [2023-12-28 01:59:40,517][106225] Updated weights for policy 1, policy_version 940085 (0.0005) [2023-12-28 01:59:40,538][106226] Updated weights for policy 0, policy_version 937722 (0.0011) [2023-12-28 01:59:40,579][106225] Updated weights for policy 1, policy_version 940095 (0.0006) [2023-12-28 01:59:40,599][106226] Updated weights for policy 0, policy_version 937732 (0.0010) [2023-12-28 01:59:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 480821248. Throughput: 0: 9882.7, 1: 9630.9. Samples: 480797020. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:41,176][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.136')] [2023-12-28 01:59:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000940096_240705536.pth... [2023-12-28 01:59:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000937736_240115712.pth... [2023-12-28 01:59:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000938976_240418816.pth [2023-12-28 01:59:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000936616_239828992.pth [2023-12-28 01:59:41,283][106225] Updated weights for policy 1, policy_version 940105 (0.0007) [2023-12-28 01:59:41,295][106226] Updated weights for policy 0, policy_version 937742 (0.0006) [2023-12-28 01:59:41,339][106225] Updated weights for policy 1, policy_version 940115 (0.0007) [2023-12-28 01:59:41,368][106226] Updated weights for policy 0, policy_version 937752 (0.0008) [2023-12-28 01:59:41,414][106225] Updated weights for policy 1, policy_version 940125 (0.0009) [2023-12-28 01:59:41,441][106226] Updated weights for policy 0, policy_version 937762 (0.0007) [2023-12-28 01:59:42,188][106226] Updated weights for policy 0, policy_version 937772 (0.0007) [2023-12-28 01:59:42,204][106225] Updated weights for policy 1, policy_version 940135 (0.0009) [2023-12-28 01:59:42,246][106226] Updated weights for policy 0, policy_version 937782 (0.0008) [2023-12-28 01:59:42,270][106225] Updated weights for policy 1, policy_version 940145 (0.0010) [2023-12-28 01:59:42,310][106226] Updated weights for policy 0, policy_version 937792 (0.0007) [2023-12-28 01:59:42,335][106225] Updated weights for policy 1, policy_version 940155 (0.0008) [2023-12-28 01:59:42,998][106226] Updated weights for policy 0, policy_version 937802 (0.0008) [2023-12-28 01:59:43,063][106226] Updated weights for policy 0, policy_version 937812 (0.0009) [2023-12-28 01:59:43,079][106225] Updated weights for policy 1, policy_version 940165 (0.0010) [2023-12-28 01:59:43,131][106226] Updated weights for policy 0, policy_version 937822 (0.0008) [2023-12-28 01:59:43,137][106225] Updated weights for policy 1, policy_version 940175 (0.0010) [2023-12-28 01:59:43,194][106225] Updated weights for policy 1, policy_version 940185 (0.0010) [2023-12-28 01:59:43,198][106226] Updated weights for policy 0, policy_version 937832 (0.0008) [2023-12-28 01:59:43,865][106225] Updated weights for policy 1, policy_version 940195 (0.0009) [2023-12-28 01:59:43,870][106226] Updated weights for policy 0, policy_version 937842 (0.0009) [2023-12-28 01:59:43,911][106225] Updated weights for policy 1, policy_version 940205 (0.0006) [2023-12-28 01:59:43,920][106226] Updated weights for policy 0, policy_version 937852 (0.0007) [2023-12-28 01:59:43,971][106225] Updated weights for policy 1, policy_version 940215 (0.0007) [2023-12-28 01:59:43,979][106226] Updated weights for policy 0, policy_version 937862 (0.0008) [2023-12-28 01:59:44,647][106225] Updated weights for policy 1, policy_version 940225 (0.0006) [2023-12-28 01:59:44,703][106225] Updated weights for policy 1, policy_version 940235 (0.0006) [2023-12-28 01:59:44,747][106226] Updated weights for policy 0, policy_version 937872 (0.0008) [2023-12-28 01:59:44,765][106225] Updated weights for policy 1, policy_version 940245 (0.0007) [2023-12-28 01:59:44,815][106226] Updated weights for policy 0, policy_version 937882 (0.0008) [2023-12-28 01:59:44,830][106225] Updated weights for policy 1, policy_version 940255 (0.0009) [2023-12-28 01:59:44,875][106226] Updated weights for policy 0, policy_version 937892 (0.0009) [2023-12-28 01:59:45,419][106225] Updated weights for policy 1, policy_version 940265 (0.0006) [2023-12-28 01:59:45,483][106225] Updated weights for policy 1, policy_version 940275 (0.0005) [2023-12-28 01:59:45,546][106225] Updated weights for policy 1, policy_version 940285 (0.0010) [2023-12-28 01:59:45,663][106226] Updated weights for policy 0, policy_version 937902 (0.0009) [2023-12-28 01:59:45,716][106226] Updated weights for policy 0, policy_version 937912 (0.0006) [2023-12-28 01:59:45,766][106226] Updated weights for policy 0, policy_version 937922 (0.0008) [2023-12-28 01:59:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 480919552. Throughput: 0: 9812.1, 1: 9643.2. Samples: 480910844. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:46,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.454')] [2023-12-28 01:59:46,208][106225] Updated weights for policy 1, policy_version 940295 (0.0010) [2023-12-28 01:59:46,264][106225] Updated weights for policy 1, policy_version 940305 (0.0010) [2023-12-28 01:59:46,320][106225] Updated weights for policy 1, policy_version 940315 (0.0010) [2023-12-28 01:59:46,410][106226] Updated weights for policy 0, policy_version 937932 (0.0007) [2023-12-28 01:59:46,467][106226] Updated weights for policy 0, policy_version 937942 (0.0005) [2023-12-28 01:59:46,513][106226] Updated weights for policy 0, policy_version 937952 (0.0005) [2023-12-28 01:59:46,940][106225] Updated weights for policy 1, policy_version 940325 (0.0008) [2023-12-28 01:59:46,993][106225] Updated weights for policy 1, policy_version 940335 (0.0005) [2023-12-28 01:59:47,048][106225] Updated weights for policy 1, policy_version 940345 (0.0005) [2023-12-28 01:59:47,193][106226] Updated weights for policy 0, policy_version 937962 (0.0005) [2023-12-28 01:59:47,251][106226] Updated weights for policy 0, policy_version 937972 (0.0010) [2023-12-28 01:59:47,305][106226] Updated weights for policy 0, policy_version 937982 (0.0008) [2023-12-28 01:59:47,359][106226] Updated weights for policy 0, policy_version 937992 (0.0009) [2023-12-28 01:59:47,559][106225] Updated weights for policy 1, policy_version 940355 (0.0005) [2023-12-28 01:59:47,617][106225] Updated weights for policy 1, policy_version 940365 (0.0006) [2023-12-28 01:59:47,678][106225] Updated weights for policy 1, policy_version 940375 (0.0005) [2023-12-28 01:59:47,982][106226] Updated weights for policy 0, policy_version 938002 (0.0008) [2023-12-28 01:59:48,042][106226] Updated weights for policy 0, policy_version 938012 (0.0009) [2023-12-28 01:59:48,092][106226] Updated weights for policy 0, policy_version 938022 (0.0009) [2023-12-28 01:59:48,258][106225] Updated weights for policy 1, policy_version 940385 (0.0008) [2023-12-28 01:59:48,323][106225] Updated weights for policy 1, policy_version 940395 (0.0010) [2023-12-28 01:59:48,393][106225] Updated weights for policy 1, policy_version 940405 (0.0010) [2023-12-28 01:59:48,454][106225] Updated weights for policy 1, policy_version 940415 (0.0010) [2023-12-28 01:59:48,868][106226] Updated weights for policy 0, policy_version 938032 (0.0011) [2023-12-28 01:59:48,931][106226] Updated weights for policy 0, policy_version 938042 (0.0009) [2023-12-28 01:59:48,993][106226] Updated weights for policy 0, policy_version 938052 (0.0007) [2023-12-28 01:59:49,130][106225] Updated weights for policy 1, policy_version 940425 (0.0008) [2023-12-28 01:59:49,183][106225] Updated weights for policy 1, policy_version 940435 (0.0007) [2023-12-28 01:59:49,255][106225] Updated weights for policy 1, policy_version 940445 (0.0009) [2023-12-28 01:59:49,727][106226] Updated weights for policy 0, policy_version 938062 (0.0008) [2023-12-28 01:59:49,788][106226] Updated weights for policy 0, policy_version 938072 (0.0008) [2023-12-28 01:59:49,855][106226] Updated weights for policy 0, policy_version 938082 (0.0009) [2023-12-28 01:59:50,055][106225] Updated weights for policy 1, policy_version 940455 (0.0009) [2023-12-28 01:59:50,107][106225] Updated weights for policy 1, policy_version 940465 (0.0010) [2023-12-28 01:59:50,154][106225] Updated weights for policy 1, policy_version 940475 (0.0010) [2023-12-28 01:59:50,575][106226] Updated weights for policy 0, policy_version 938092 (0.0008) [2023-12-28 01:59:50,647][106226] Updated weights for policy 0, policy_version 938102 (0.0008) [2023-12-28 01:59:50,714][106226] Updated weights for policy 0, policy_version 938112 (0.0009) [2023-12-28 01:59:50,929][106225] Updated weights for policy 1, policy_version 940485 (0.0011) [2023-12-28 01:59:50,992][106225] Updated weights for policy 1, policy_version 940495 (0.0010) [2023-12-28 01:59:51,065][106225] Updated weights for policy 1, policy_version 940505 (0.0010) [2023-12-28 01:59:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 481026048. Throughput: 0: 9786.9, 1: 9749.9. Samples: 481033152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:51,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-5.253')] [2023-12-28 01:59:51,512][106226] Updated weights for policy 0, policy_version 938122 (0.0008) [2023-12-28 01:59:51,574][106226] Updated weights for policy 0, policy_version 938132 (0.0006) [2023-12-28 01:59:51,648][106226] Updated weights for policy 0, policy_version 938142 (0.0008) [2023-12-28 01:59:51,712][106226] Updated weights for policy 0, policy_version 938152 (0.0009) [2023-12-28 01:59:51,773][106225] Updated weights for policy 1, policy_version 940515 (0.0007) [2023-12-28 01:59:51,828][106225] Updated weights for policy 1, policy_version 940525 (0.0006) [2023-12-28 01:59:51,891][106225] Updated weights for policy 1, policy_version 940535 (0.0007) [2023-12-28 01:59:52,413][106226] Updated weights for policy 0, policy_version 938162 (0.0009) [2023-12-28 01:59:52,476][106226] Updated weights for policy 0, policy_version 938172 (0.0008) [2023-12-28 01:59:52,547][106226] Updated weights for policy 0, policy_version 938182 (0.0006) [2023-12-28 01:59:52,591][106225] Updated weights for policy 1, policy_version 940545 (0.0008) [2023-12-28 01:59:52,652][106225] Updated weights for policy 1, policy_version 940555 (0.0007) [2023-12-28 01:59:52,706][106225] Updated weights for policy 1, policy_version 940565 (0.0008) [2023-12-28 01:59:52,757][106225] Updated weights for policy 1, policy_version 940575 (0.0007) [2023-12-28 01:59:53,154][106226] Updated weights for policy 0, policy_version 938192 (0.0005) [2023-12-28 01:59:53,211][106226] Updated weights for policy 0, policy_version 938202 (0.0006) [2023-12-28 01:59:53,273][106226] Updated weights for policy 0, policy_version 938212 (0.0008) [2023-12-28 01:59:53,541][106225] Updated weights for policy 1, policy_version 940585 (0.0006) [2023-12-28 01:59:53,598][106225] Updated weights for policy 1, policy_version 940595 (0.0005) [2023-12-28 01:59:53,656][106225] Updated weights for policy 1, policy_version 940605 (0.0005) [2023-12-28 01:59:53,796][106226] Updated weights for policy 0, policy_version 938222 (0.0005) [2023-12-28 01:59:53,855][106226] Updated weights for policy 0, policy_version 938232 (0.0006) [2023-12-28 01:59:53,913][106226] Updated weights for policy 0, policy_version 938242 (0.0006) [2023-12-28 01:59:54,212][106225] Updated weights for policy 1, policy_version 940615 (0.0007) [2023-12-28 01:59:54,262][106225] Updated weights for policy 1, policy_version 940625 (0.0008) [2023-12-28 01:59:54,317][106225] Updated weights for policy 1, policy_version 940635 (0.0006) [2023-12-28 01:59:54,482][106226] Updated weights for policy 0, policy_version 938252 (0.0006) [2023-12-28 01:59:54,546][106226] Updated weights for policy 0, policy_version 938262 (0.0006) [2023-12-28 01:59:54,604][106226] Updated weights for policy 0, policy_version 938272 (0.0006) [2023-12-28 01:59:55,010][106225] Updated weights for policy 1, policy_version 940645 (0.0007) [2023-12-28 01:59:55,070][106225] Updated weights for policy 1, policy_version 940655 (0.0010) [2023-12-28 01:59:55,133][106225] Updated weights for policy 1, policy_version 940665 (0.0010) [2023-12-28 01:59:55,190][106226] Updated weights for policy 0, policy_version 938282 (0.0006) [2023-12-28 01:59:55,249][106226] Updated weights for policy 0, policy_version 938292 (0.0008) [2023-12-28 01:59:55,315][106226] Updated weights for policy 0, policy_version 938302 (0.0010) [2023-12-28 01:59:55,380][106226] Updated weights for policy 0, policy_version 938312 (0.0010) [2023-12-28 01:59:55,819][106225] Updated weights for policy 1, policy_version 940675 (0.0010) [2023-12-28 01:59:55,862][106225] Updated weights for policy 1, policy_version 940685 (0.0010) [2023-12-28 01:59:55,908][106225] Updated weights for policy 1, policy_version 940695 (0.0010) [2023-12-28 01:59:56,004][106226] Updated weights for policy 0, policy_version 938322 (0.0008) [2023-12-28 01:59:56,057][106226] Updated weights for policy 0, policy_version 938332 (0.0010) [2023-12-28 01:59:56,111][106226] Updated weights for policy 0, policy_version 938342 (0.0010) [2023-12-28 01:59:56,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 481132544. Throughput: 0: 9801.7, 1: 9759.8. Samples: 481093712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 01:59:56,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.883')] [2023-12-28 01:59:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000940704_240861184.pth... [2023-12-28 01:59:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000938344_240271360.pth... [2023-12-28 01:59:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000939520_240558080.pth [2023-12-28 01:59:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000937192_239976448.pth [2023-12-28 01:59:56,579][106225] Updated weights for policy 1, policy_version 940705 (0.0010) [2023-12-28 01:59:56,641][106225] Updated weights for policy 1, policy_version 940715 (0.0005) [2023-12-28 01:59:56,698][106225] Updated weights for policy 1, policy_version 940725 (0.0005) [2023-12-28 01:59:56,759][106225] Updated weights for policy 1, policy_version 940735 (0.0008) [2023-12-28 01:59:56,791][106226] Updated weights for policy 0, policy_version 938352 (0.0008) [2023-12-28 01:59:56,837][106226] Updated weights for policy 0, policy_version 938362 (0.0006) [2023-12-28 01:59:56,885][106226] Updated weights for policy 0, policy_version 938372 (0.0005) [2023-12-28 01:59:57,377][106225] Updated weights for policy 1, policy_version 940745 (0.0006) [2023-12-28 01:59:57,422][106225] Updated weights for policy 1, policy_version 940755 (0.0005) [2023-12-28 01:59:57,480][106225] Updated weights for policy 1, policy_version 940765 (0.0005) [2023-12-28 01:59:57,642][106226] Updated weights for policy 0, policy_version 938382 (0.0006) [2023-12-28 01:59:57,703][106226] Updated weights for policy 0, policy_version 938392 (0.0009) [2023-12-28 01:59:57,769][106226] Updated weights for policy 0, policy_version 938402 (0.0008) [2023-12-28 01:59:58,005][106225] Updated weights for policy 1, policy_version 940775 (0.0005) [2023-12-28 01:59:58,063][106225] Updated weights for policy 1, policy_version 940785 (0.0005) [2023-12-28 01:59:58,109][106225] Updated weights for policy 1, policy_version 940795 (0.0005) [2023-12-28 01:59:58,375][106226] Updated weights for policy 0, policy_version 938412 (0.0007) [2023-12-28 01:59:58,439][106226] Updated weights for policy 0, policy_version 938422 (0.0007) [2023-12-28 01:59:58,507][106226] Updated weights for policy 0, policy_version 938432 (0.0008) [2023-12-28 01:59:58,803][106225] Updated weights for policy 1, policy_version 940805 (0.0007) [2023-12-28 01:59:58,869][106225] Updated weights for policy 1, policy_version 940815 (0.0009) [2023-12-28 01:59:58,941][106225] Updated weights for policy 1, policy_version 940825 (0.0010) [2023-12-28 01:59:59,329][106226] Updated weights for policy 0, policy_version 938442 (0.0008) [2023-12-28 01:59:59,404][106226] Updated weights for policy 0, policy_version 938452 (0.0007) [2023-12-28 01:59:59,464][106226] Updated weights for policy 0, policy_version 938462 (0.0006) [2023-12-28 01:59:59,517][106226] Updated weights for policy 0, policy_version 938472 (0.0006) [2023-12-28 01:59:59,743][106225] Updated weights for policy 1, policy_version 940835 (0.0010) [2023-12-28 01:59:59,799][106225] Updated weights for policy 1, policy_version 940845 (0.0010) [2023-12-28 01:59:59,867][106225] Updated weights for policy 1, policy_version 940855 (0.0009) [2023-12-28 02:00:00,203][106226] Updated weights for policy 0, policy_version 938482 (0.0007) [2023-12-28 02:00:00,264][106226] Updated weights for policy 0, policy_version 938492 (0.0009) [2023-12-28 02:00:00,320][106226] Updated weights for policy 0, policy_version 938502 (0.0007) [2023-12-28 02:00:00,587][106225] Updated weights for policy 1, policy_version 940865 (0.0008) [2023-12-28 02:00:00,660][106225] Updated weights for policy 1, policy_version 940875 (0.0009) [2023-12-28 02:00:00,719][106225] Updated weights for policy 1, policy_version 940885 (0.0008) [2023-12-28 02:00:00,775][106225] Updated weights for policy 1, policy_version 940895 (0.0008) [2023-12-28 02:00:00,967][106226] Updated weights for policy 0, policy_version 938512 (0.0008) [2023-12-28 02:00:01,022][106226] Updated weights for policy 0, policy_version 938522 (0.0008) [2023-12-28 02:00:01,083][106226] Updated weights for policy 0, policy_version 938532 (0.0007) [2023-12-28 02:00:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 481230848. Throughput: 0: 9913.0, 1: 9912.2. Samples: 481218592. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:01,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.963')] [2023-12-28 02:00:01,523][106225] Updated weights for policy 1, policy_version 940905 (0.0009) [2023-12-28 02:00:01,579][106225] Updated weights for policy 1, policy_version 940915 (0.0009) [2023-12-28 02:00:01,636][106225] Updated weights for policy 1, policy_version 940925 (0.0009) [2023-12-28 02:00:01,912][106226] Updated weights for policy 0, policy_version 938542 (0.0009) [2023-12-28 02:00:01,976][106226] Updated weights for policy 0, policy_version 938552 (0.0011) [2023-12-28 02:00:02,032][106226] Updated weights for policy 0, policy_version 938562 (0.0011) [2023-12-28 02:00:02,372][106225] Updated weights for policy 1, policy_version 940935 (0.0010) [2023-12-28 02:00:02,430][106225] Updated weights for policy 1, policy_version 940945 (0.0010) [2023-12-28 02:00:02,492][106225] Updated weights for policy 1, policy_version 940955 (0.0010) [2023-12-28 02:00:02,678][106226] Updated weights for policy 0, policy_version 938572 (0.0010) [2023-12-28 02:00:02,731][106226] Updated weights for policy 0, policy_version 938582 (0.0010) [2023-12-28 02:00:02,791][106226] Updated weights for policy 0, policy_version 938592 (0.0005) [2023-12-28 02:00:03,129][106225] Updated weights for policy 1, policy_version 940965 (0.0008) [2023-12-28 02:00:03,187][106225] Updated weights for policy 1, policy_version 940975 (0.0010) [2023-12-28 02:00:03,240][106225] Updated weights for policy 1, policy_version 940985 (0.0008) [2023-12-28 02:00:03,375][106226] Updated weights for policy 0, policy_version 938602 (0.0008) [2023-12-28 02:00:03,434][106226] Updated weights for policy 0, policy_version 938612 (0.0010) [2023-12-28 02:00:03,490][106226] Updated weights for policy 0, policy_version 938622 (0.0010) [2023-12-28 02:00:03,546][106226] Updated weights for policy 0, policy_version 938632 (0.0006) [2023-12-28 02:00:03,864][106225] Updated weights for policy 1, policy_version 940995 (0.0006) [2023-12-28 02:00:03,915][106225] Updated weights for policy 1, policy_version 941005 (0.0007) [2023-12-28 02:00:03,973][106225] Updated weights for policy 1, policy_version 941015 (0.0008) [2023-12-28 02:00:04,213][106226] Updated weights for policy 0, policy_version 938642 (0.0011) [2023-12-28 02:00:04,282][106226] Updated weights for policy 0, policy_version 938652 (0.0009) [2023-12-28 02:00:04,348][106226] Updated weights for policy 0, policy_version 938662 (0.0010) [2023-12-28 02:00:04,732][106225] Updated weights for policy 1, policy_version 941025 (0.0008) [2023-12-28 02:00:04,782][106225] Updated weights for policy 1, policy_version 941035 (0.0008) [2023-12-28 02:00:04,831][106225] Updated weights for policy 1, policy_version 941045 (0.0008) [2023-12-28 02:00:04,890][106225] Updated weights for policy 1, policy_version 941055 (0.0008) [2023-12-28 02:00:05,029][106226] Updated weights for policy 0, policy_version 938672 (0.0009) [2023-12-28 02:00:05,081][106226] Updated weights for policy 0, policy_version 938682 (0.0008) [2023-12-28 02:00:05,129][106226] Updated weights for policy 0, policy_version 938692 (0.0006) [2023-12-28 02:00:05,615][106225] Updated weights for policy 1, policy_version 941065 (0.0005) [2023-12-28 02:00:05,665][106225] Updated weights for policy 1, policy_version 941075 (0.0006) [2023-12-28 02:00:05,733][106225] Updated weights for policy 1, policy_version 941085 (0.0005) [2023-12-28 02:00:05,765][106226] Updated weights for policy 0, policy_version 938702 (0.0007) [2023-12-28 02:00:05,825][106226] Updated weights for policy 0, policy_version 938712 (0.0009) [2023-12-28 02:00:05,878][106226] Updated weights for policy 0, policy_version 938722 (0.0008) [2023-12-28 02:00:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 481329152. Throughput: 0: 9959.9, 1: 9969.6. Samples: 481338028. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:06,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.979')] [2023-12-28 02:00:06,323][106225] Updated weights for policy 1, policy_version 941095 (0.0009) [2023-12-28 02:00:06,381][106225] Updated weights for policy 1, policy_version 941105 (0.0008) [2023-12-28 02:00:06,449][106225] Updated weights for policy 1, policy_version 941115 (0.0009) [2023-12-28 02:00:06,637][106226] Updated weights for policy 0, policy_version 938732 (0.0009) [2023-12-28 02:00:06,706][106226] Updated weights for policy 0, policy_version 938742 (0.0009) [2023-12-28 02:00:06,766][106226] Updated weights for policy 0, policy_version 938752 (0.0009) [2023-12-28 02:00:07,208][106225] Updated weights for policy 1, policy_version 941125 (0.0007) [2023-12-28 02:00:07,270][106225] Updated weights for policy 1, policy_version 941135 (0.0007) [2023-12-28 02:00:07,330][106225] Updated weights for policy 1, policy_version 941145 (0.0008) [2023-12-28 02:00:07,457][106226] Updated weights for policy 0, policy_version 938762 (0.0009) [2023-12-28 02:00:07,516][106226] Updated weights for policy 0, policy_version 938772 (0.0008) [2023-12-28 02:00:07,576][106226] Updated weights for policy 0, policy_version 938782 (0.0009) [2023-12-28 02:00:07,631][106226] Updated weights for policy 0, policy_version 938792 (0.0008) [2023-12-28 02:00:07,967][106225] Updated weights for policy 1, policy_version 941155 (0.0009) [2023-12-28 02:00:08,037][106225] Updated weights for policy 1, policy_version 941165 (0.0009) [2023-12-28 02:00:08,103][106225] Updated weights for policy 1, policy_version 941175 (0.0006) [2023-12-28 02:00:08,281][106226] Updated weights for policy 0, policy_version 938802 (0.0005) [2023-12-28 02:00:08,349][106226] Updated weights for policy 0, policy_version 938812 (0.0007) [2023-12-28 02:00:08,419][106226] Updated weights for policy 0, policy_version 938822 (0.0008) [2023-12-28 02:00:08,834][106225] Updated weights for policy 1, policy_version 941185 (0.0006) [2023-12-28 02:00:08,884][106225] Updated weights for policy 1, policy_version 941195 (0.0009) [2023-12-28 02:00:08,939][106225] Updated weights for policy 1, policy_version 941205 (0.0010) [2023-12-28 02:00:08,992][106225] Updated weights for policy 1, policy_version 941215 (0.0010) [2023-12-28 02:00:09,078][106226] Updated weights for policy 0, policy_version 938832 (0.0008) [2023-12-28 02:00:09,132][106226] Updated weights for policy 0, policy_version 938842 (0.0008) [2023-12-28 02:00:09,190][106226] Updated weights for policy 0, policy_version 938852 (0.0009) [2023-12-28 02:00:09,746][106225] Updated weights for policy 1, policy_version 941225 (0.0007) [2023-12-28 02:00:09,810][106225] Updated weights for policy 1, policy_version 941235 (0.0009) [2023-12-28 02:00:09,868][106225] Updated weights for policy 1, policy_version 941245 (0.0009) [2023-12-28 02:00:09,944][106226] Updated weights for policy 0, policy_version 938862 (0.0009) [2023-12-28 02:00:09,997][106226] Updated weights for policy 0, policy_version 938872 (0.0008) [2023-12-28 02:00:10,063][106226] Updated weights for policy 0, policy_version 938882 (0.0009) [2023-12-28 02:00:10,555][106225] Updated weights for policy 1, policy_version 941255 (0.0006) [2023-12-28 02:00:10,613][106225] Updated weights for policy 1, policy_version 941265 (0.0008) [2023-12-28 02:00:10,664][106225] Updated weights for policy 1, policy_version 941275 (0.0009) [2023-12-28 02:00:10,776][106226] Updated weights for policy 0, policy_version 938892 (0.0007) [2023-12-28 02:00:10,832][106226] Updated weights for policy 0, policy_version 938902 (0.0005) [2023-12-28 02:00:10,890][106226] Updated weights for policy 0, policy_version 938912 (0.0005) [2023-12-28 02:00:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 481427456. Throughput: 0: 9973.8, 1: 10020.1. Samples: 481398264. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:11,175][105115] Avg episode reward: [(0, '-4.841'), (1, '-5.021')] [2023-12-28 02:00:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000941280_241008640.pth... [2023-12-28 02:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000938920_240418816.pth... [2023-12-28 02:00:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000937736_240115712.pth [2023-12-28 02:00:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000940096_240705536.pth [2023-12-28 02:00:11,443][106225] Updated weights for policy 1, policy_version 941285 (0.0009) [2023-12-28 02:00:11,491][106225] Updated weights for policy 1, policy_version 941295 (0.0008) [2023-12-28 02:00:11,546][106225] Updated weights for policy 1, policy_version 941305 (0.0008) [2023-12-28 02:00:11,644][106226] Updated weights for policy 0, policy_version 938922 (0.0008) [2023-12-28 02:00:11,721][106226] Updated weights for policy 0, policy_version 938932 (0.0010) [2023-12-28 02:00:11,786][106226] Updated weights for policy 0, policy_version 938942 (0.0009) [2023-12-28 02:00:11,847][106226] Updated weights for policy 0, policy_version 938952 (0.0009) [2023-12-28 02:00:12,232][106225] Updated weights for policy 1, policy_version 941315 (0.0008) [2023-12-28 02:00:12,297][106225] Updated weights for policy 1, policy_version 941325 (0.0009) [2023-12-28 02:00:12,367][106225] Updated weights for policy 1, policy_version 941335 (0.0009) [2023-12-28 02:00:12,617][106226] Updated weights for policy 0, policy_version 938962 (0.0005) [2023-12-28 02:00:12,685][106226] Updated weights for policy 0, policy_version 938972 (0.0006) [2023-12-28 02:00:12,746][106226] Updated weights for policy 0, policy_version 938982 (0.0006) [2023-12-28 02:00:13,089][106225] Updated weights for policy 1, policy_version 941345 (0.0007) [2023-12-28 02:00:13,156][106225] Updated weights for policy 1, policy_version 941355 (0.0006) [2023-12-28 02:00:13,218][106225] Updated weights for policy 1, policy_version 941365 (0.0006) [2023-12-28 02:00:13,281][106225] Updated weights for policy 1, policy_version 941375 (0.0006) [2023-12-28 02:00:13,343][106226] Updated weights for policy 0, policy_version 938992 (0.0009) [2023-12-28 02:00:13,407][106226] Updated weights for policy 0, policy_version 939002 (0.0009) [2023-12-28 02:00:13,467][106226] Updated weights for policy 0, policy_version 939012 (0.0009) [2023-12-28 02:00:13,923][106225] Updated weights for policy 1, policy_version 941385 (0.0008) [2023-12-28 02:00:13,979][106225] Updated weights for policy 1, policy_version 941395 (0.0008) [2023-12-28 02:00:14,032][106225] Updated weights for policy 1, policy_version 941405 (0.0008) [2023-12-28 02:00:14,183][106226] Updated weights for policy 0, policy_version 939022 (0.0009) [2023-12-28 02:00:14,236][106226] Updated weights for policy 0, policy_version 939032 (0.0008) [2023-12-28 02:00:14,289][106226] Updated weights for policy 0, policy_version 939042 (0.0008) [2023-12-28 02:00:14,752][106225] Updated weights for policy 1, policy_version 941415 (0.0007) [2023-12-28 02:00:14,819][106225] Updated weights for policy 1, policy_version 941425 (0.0008) [2023-12-28 02:00:14,874][106225] Updated weights for policy 1, policy_version 941435 (0.0009) [2023-12-28 02:00:15,044][106226] Updated weights for policy 0, policy_version 939052 (0.0007) [2023-12-28 02:00:15,105][106226] Updated weights for policy 0, policy_version 939062 (0.0009) [2023-12-28 02:00:15,162][106226] Updated weights for policy 0, policy_version 939072 (0.0009) [2023-12-28 02:00:15,659][106225] Updated weights for policy 1, policy_version 941445 (0.0008) [2023-12-28 02:00:15,720][106225] Updated weights for policy 1, policy_version 941455 (0.0008) [2023-12-28 02:00:15,775][106225] Updated weights for policy 1, policy_version 941465 (0.0009) [2023-12-28 02:00:15,803][106226] Updated weights for policy 0, policy_version 939082 (0.0006) [2023-12-28 02:00:15,862][106226] Updated weights for policy 0, policy_version 939092 (0.0009) [2023-12-28 02:00:15,929][106226] Updated weights for policy 0, policy_version 939102 (0.0011) [2023-12-28 02:00:15,986][106226] Updated weights for policy 0, policy_version 939112 (0.0010) [2023-12-28 02:00:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 481525760. Throughput: 0: 9857.3, 1: 10048.8. Samples: 481514092. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:16,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-5.120')] [2023-12-28 02:00:16,521][106225] Updated weights for policy 1, policy_version 941475 (0.0007) [2023-12-28 02:00:16,574][106225] Updated weights for policy 1, policy_version 941485 (0.0010) [2023-12-28 02:00:16,588][106226] Updated weights for policy 0, policy_version 939122 (0.0005) [2023-12-28 02:00:16,630][106225] Updated weights for policy 1, policy_version 941495 (0.0010) [2023-12-28 02:00:16,636][106226] Updated weights for policy 0, policy_version 939132 (0.0005) [2023-12-28 02:00:16,686][106226] Updated weights for policy 0, policy_version 939142 (0.0009) [2023-12-28 02:00:17,301][106225] Updated weights for policy 1, policy_version 941505 (0.0007) [2023-12-28 02:00:17,304][106226] Updated weights for policy 0, policy_version 939152 (0.0008) [2023-12-28 02:00:17,355][106225] Updated weights for policy 1, policy_version 941515 (0.0010) [2023-12-28 02:00:17,361][106226] Updated weights for policy 0, policy_version 939162 (0.0005) [2023-12-28 02:00:17,415][106225] Updated weights for policy 1, policy_version 941525 (0.0010) [2023-12-28 02:00:17,417][106226] Updated weights for policy 0, policy_version 939172 (0.0007) [2023-12-28 02:00:17,478][106225] Updated weights for policy 1, policy_version 941535 (0.0010) [2023-12-28 02:00:18,154][106226] Updated weights for policy 0, policy_version 939182 (0.0008) [2023-12-28 02:00:18,194][106225] Updated weights for policy 1, policy_version 941545 (0.0006) [2023-12-28 02:00:18,211][106226] Updated weights for policy 0, policy_version 939192 (0.0009) [2023-12-28 02:00:18,255][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000006 [2023-12-28 02:00:18,255][106225] Updated weights for policy 1, policy_version 941555 (0.0006) [2023-12-28 02:00:18,301][106225] Updated weights for policy 1, policy_version 941565 (0.0010) [2023-12-28 02:00:18,990][106226] Updated weights for policy 0, policy_version 939202 (0.0006) [2023-12-28 02:00:19,002][106225] Updated weights for policy 1, policy_version 941575 (0.0010) [2023-12-28 02:00:19,046][106226] Updated weights for policy 0, policy_version 939212 (0.0006) [2023-12-28 02:00:19,055][106225] Updated weights for policy 1, policy_version 941585 (0.0010) [2023-12-28 02:00:19,110][106225] Updated weights for policy 1, policy_version 941595 (0.0010) [2023-12-28 02:00:19,112][106226] Updated weights for policy 0, policy_version 939222 (0.0006) [2023-12-28 02:00:19,164][106226] Updated weights for policy 0, policy_version 939232 (0.0007) [2023-12-28 02:00:19,894][106225] Updated weights for policy 1, policy_version 941605 (0.0010) [2023-12-28 02:00:19,937][106226] Updated weights for policy 0, policy_version 939242 (0.0007) [2023-12-28 02:00:19,961][106225] Updated weights for policy 1, policy_version 941615 (0.0009) [2023-12-28 02:00:19,995][106226] Updated weights for policy 0, policy_version 939252 (0.0008) [2023-12-28 02:00:20,021][106225] Updated weights for policy 1, policy_version 941625 (0.0011) [2023-12-28 02:00:20,060][106226] Updated weights for policy 0, policy_version 939262 (0.0007) [2023-12-28 02:00:20,733][106225] Updated weights for policy 1, policy_version 941635 (0.0010) [2023-12-28 02:00:20,784][106225] Updated weights for policy 1, policy_version 941645 (0.0010) [2023-12-28 02:00:20,843][106225] Updated weights for policy 1, policy_version 941655 (0.0010) [2023-12-28 02:00:20,860][106226] Updated weights for policy 0, policy_version 939272 (0.0007) [2023-12-28 02:00:20,911][106226] Updated weights for policy 0, policy_version 939282 (0.0008) [2023-12-28 02:00:20,973][106226] Updated weights for policy 0, policy_version 939292 (0.0008) [2023-12-28 02:00:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 481624064. Throughput: 0: 9869.7, 1: 9966.8. Samples: 481630348. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:21,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.295')] [2023-12-28 02:00:21,596][106225] Updated weights for policy 1, policy_version 941665 (0.0007) [2023-12-28 02:00:21,668][106225] Updated weights for policy 1, policy_version 941675 (0.0009) [2023-12-28 02:00:21,737][106225] Updated weights for policy 1, policy_version 941685 (0.0009) [2023-12-28 02:00:21,790][106225] Updated weights for policy 1, policy_version 941695 (0.0008) [2023-12-28 02:00:21,820][106226] Updated weights for policy 0, policy_version 939302 (0.0009) [2023-12-28 02:00:21,883][106226] Updated weights for policy 0, policy_version 939312 (0.0009) [2023-12-28 02:00:21,947][106226] Updated weights for policy 0, policy_version 939322 (0.0008) [2023-12-28 02:00:22,575][106225] Updated weights for policy 1, policy_version 941705 (0.0009) [2023-12-28 02:00:22,638][106225] Updated weights for policy 1, policy_version 941715 (0.0008) [2023-12-28 02:00:22,688][106226] Updated weights for policy 0, policy_version 939332 (0.0009) [2023-12-28 02:00:22,699][106225] Updated weights for policy 1, policy_version 941725 (0.0009) [2023-12-28 02:00:22,749][106226] Updated weights for policy 0, policy_version 939342 (0.0010) [2023-12-28 02:00:22,811][106226] Updated weights for policy 0, policy_version 939352 (0.0008) [2023-12-28 02:00:23,388][106225] Updated weights for policy 1, policy_version 941735 (0.0006) [2023-12-28 02:00:23,433][106225] Updated weights for policy 1, policy_version 941745 (0.0007) [2023-12-28 02:00:23,481][106225] Updated weights for policy 1, policy_version 941755 (0.0005) [2023-12-28 02:00:23,527][106226] Updated weights for policy 0, policy_version 939362 (0.0009) [2023-12-28 02:00:23,586][106226] Updated weights for policy 0, policy_version 939372 (0.0008) [2023-12-28 02:00:23,650][106226] Updated weights for policy 0, policy_version 939382 (0.0008) [2023-12-28 02:00:23,701][106226] Updated weights for policy 0, policy_version 939392 (0.0008) [2023-12-28 02:00:24,149][106225] Updated weights for policy 1, policy_version 941765 (0.0006) [2023-12-28 02:00:24,207][106225] Updated weights for policy 1, policy_version 941775 (0.0007) [2023-12-28 02:00:24,268][106225] Updated weights for policy 1, policy_version 941785 (0.0008) [2023-12-28 02:00:24,420][106226] Updated weights for policy 0, policy_version 939402 (0.0009) [2023-12-28 02:00:24,474][106226] Updated weights for policy 0, policy_version 939412 (0.0008) [2023-12-28 02:00:24,530][106226] Updated weights for policy 0, policy_version 939422 (0.0008) [2023-12-28 02:00:24,957][106225] Updated weights for policy 1, policy_version 941795 (0.0009) [2023-12-28 02:00:25,013][106225] Updated weights for policy 1, policy_version 941805 (0.0009) [2023-12-28 02:00:25,057][106225] Updated weights for policy 1, policy_version 941815 (0.0008) [2023-12-28 02:00:25,280][106226] Updated weights for policy 0, policy_version 939432 (0.0009) [2023-12-28 02:00:25,334][106226] Updated weights for policy 0, policy_version 939442 (0.0009) [2023-12-28 02:00:25,385][106226] Updated weights for policy 0, policy_version 939452 (0.0008) [2023-12-28 02:00:25,780][106225] Updated weights for policy 1, policy_version 941825 (0.0008) [2023-12-28 02:00:25,842][106225] Updated weights for policy 1, policy_version 941835 (0.0009) [2023-12-28 02:00:25,900][106225] Updated weights for policy 1, policy_version 941845 (0.0008) [2023-12-28 02:00:25,952][106225] Updated weights for policy 1, policy_version 941855 (0.0008) [2023-12-28 02:00:26,110][106226] Updated weights for policy 0, policy_version 939462 (0.0009) [2023-12-28 02:00:26,157][106226] Updated weights for policy 0, policy_version 939472 (0.0008) [2023-12-28 02:00:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 481714176. Throughput: 0: 9868.7, 1: 9908.5. Samples: 481686992. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:26,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.154')] [2023-12-28 02:00:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000941856_241156096.pth... [2023-12-28 02:00:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000940704_240861184.pth [2023-12-28 02:00:26,218][106226] Updated weights for policy 0, policy_version 939482 (0.0009) [2023-12-28 02:00:26,247][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000939488_240566272.pth... [2023-12-28 02:00:26,251][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000938344_240271360.pth [2023-12-28 02:00:26,671][106225] Updated weights for policy 1, policy_version 941865 (0.0008) [2023-12-28 02:00:26,726][106225] Updated weights for policy 1, policy_version 941875 (0.0008) [2023-12-28 02:00:26,796][106225] Updated weights for policy 1, policy_version 941885 (0.0010) [2023-12-28 02:00:26,940][106226] Updated weights for policy 0, policy_version 939492 (0.0008) [2023-12-28 02:00:27,000][106226] Updated weights for policy 0, policy_version 939502 (0.0009) [2023-12-28 02:00:27,048][106226] Updated weights for policy 0, policy_version 939512 (0.0008) [2023-12-28 02:00:27,494][106225] Updated weights for policy 1, policy_version 941895 (0.0009) [2023-12-28 02:00:27,537][106225] Updated weights for policy 1, policy_version 941905 (0.0008) [2023-12-28 02:00:27,585][106225] Updated weights for policy 1, policy_version 941915 (0.0008) [2023-12-28 02:00:27,777][106226] Updated weights for policy 0, policy_version 939522 (0.0009) [2023-12-28 02:00:27,828][106226] Updated weights for policy 0, policy_version 939532 (0.0008) [2023-12-28 02:00:27,881][106226] Updated weights for policy 0, policy_version 939542 (0.0008) [2023-12-28 02:00:27,949][106226] Updated weights for policy 0, policy_version 939552 (0.0005) [2023-12-28 02:00:28,239][106225] Updated weights for policy 1, policy_version 941925 (0.0008) [2023-12-28 02:00:28,290][106225] Updated weights for policy 1, policy_version 941935 (0.0008) [2023-12-28 02:00:28,353][106225] Updated weights for policy 1, policy_version 941945 (0.0008) [2023-12-28 02:00:28,647][106226] Updated weights for policy 0, policy_version 939562 (0.0009) [2023-12-28 02:00:28,704][106226] Updated weights for policy 0, policy_version 939572 (0.0008) [2023-12-28 02:00:28,759][106226] Updated weights for policy 0, policy_version 939582 (0.0009) [2023-12-28 02:00:29,059][106225] Updated weights for policy 1, policy_version 941955 (0.0008) [2023-12-28 02:00:29,106][106225] Updated weights for policy 1, policy_version 941965 (0.0008) [2023-12-28 02:00:29,149][106225] Updated weights for policy 1, policy_version 941975 (0.0007) [2023-12-28 02:00:29,471][106226] Updated weights for policy 0, policy_version 939592 (0.0006) [2023-12-28 02:00:29,534][106226] Updated weights for policy 0, policy_version 939602 (0.0006) [2023-12-28 02:00:29,593][106226] Updated weights for policy 0, policy_version 939612 (0.0007) [2023-12-28 02:00:29,876][106225] Updated weights for policy 1, policy_version 941985 (0.0007) [2023-12-28 02:00:29,938][106225] Updated weights for policy 1, policy_version 941995 (0.0008) [2023-12-28 02:00:30,007][106225] Updated weights for policy 1, policy_version 942005 (0.0008) [2023-12-28 02:00:30,051][106225] Updated weights for policy 1, policy_version 942015 (0.0008) [2023-12-28 02:00:30,302][106226] Updated weights for policy 0, policy_version 939622 (0.0010) [2023-12-28 02:00:30,356][106226] Updated weights for policy 0, policy_version 939632 (0.0010) [2023-12-28 02:00:30,409][106226] Updated weights for policy 0, policy_version 939642 (0.0010) [2023-12-28 02:00:30,657][106225] Updated weights for policy 1, policy_version 942025 (0.0005) [2023-12-28 02:00:30,719][106225] Updated weights for policy 1, policy_version 942035 (0.0006) [2023-12-28 02:00:30,778][106225] Updated weights for policy 1, policy_version 942045 (0.0007) [2023-12-28 02:00:31,124][106226] Updated weights for policy 0, policy_version 939652 (0.0010) [2023-12-28 02:00:31,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 481812480. Throughput: 0: 9897.8, 1: 9971.4. Samples: 481804964. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:31,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-5.247')] [2023-12-28 02:00:31,205][106226] Updated weights for policy 0, policy_version 939662 (0.0011) [2023-12-28 02:00:31,267][106226] Updated weights for policy 0, policy_version 939672 (0.0010) [2023-12-28 02:00:31,457][106225] Updated weights for policy 1, policy_version 942055 (0.0008) [2023-12-28 02:00:31,514][106225] Updated weights for policy 1, policy_version 942065 (0.0008) [2023-12-28 02:00:31,566][106225] Updated weights for policy 1, policy_version 942075 (0.0008) [2023-12-28 02:00:31,979][106226] Updated weights for policy 0, policy_version 939682 (0.0010) [2023-12-28 02:00:32,033][106226] Updated weights for policy 0, policy_version 939692 (0.0008) [2023-12-28 02:00:32,094][106226] Updated weights for policy 0, policy_version 939702 (0.0009) [2023-12-28 02:00:32,160][106226] Updated weights for policy 0, policy_version 939712 (0.0006) [2023-12-28 02:00:32,292][106225] Updated weights for policy 1, policy_version 942085 (0.0006) [2023-12-28 02:00:32,344][106225] Updated weights for policy 1, policy_version 942095 (0.0005) [2023-12-28 02:00:32,414][106225] Updated weights for policy 1, policy_version 942105 (0.0007) [2023-12-28 02:00:32,828][106226] Updated weights for policy 0, policy_version 939722 (0.0009) [2023-12-28 02:00:32,872][106226] Updated weights for policy 0, policy_version 939732 (0.0008) [2023-12-28 02:00:32,930][106226] Updated weights for policy 0, policy_version 939742 (0.0008) [2023-12-28 02:00:33,036][106225] Updated weights for policy 1, policy_version 942115 (0.0005) [2023-12-28 02:00:33,092][106225] Updated weights for policy 1, policy_version 942125 (0.0009) [2023-12-28 02:00:33,147][106225] Updated weights for policy 1, policy_version 942135 (0.0006) [2023-12-28 02:00:33,618][106226] Updated weights for policy 0, policy_version 939752 (0.0007) [2023-12-28 02:00:33,670][106226] Updated weights for policy 0, policy_version 939762 (0.0010) [2023-12-28 02:00:33,713][106225] Updated weights for policy 1, policy_version 942145 (0.0005) [2023-12-28 02:00:33,736][106226] Updated weights for policy 0, policy_version 939772 (0.0010) [2023-12-28 02:00:33,758][106225] Updated weights for policy 1, policy_version 942155 (0.0006) [2023-12-28 02:00:33,807][106225] Updated weights for policy 1, policy_version 942165 (0.0005) [2023-12-28 02:00:33,863][106225] Updated weights for policy 1, policy_version 942175 (0.0005) [2023-12-28 02:00:34,392][106226] Updated weights for policy 0, policy_version 939782 (0.0009) [2023-12-28 02:00:34,454][106226] Updated weights for policy 0, policy_version 939792 (0.0007) [2023-12-28 02:00:34,460][106225] Updated weights for policy 1, policy_version 942185 (0.0007) [2023-12-28 02:00:34,516][106226] Updated weights for policy 0, policy_version 939802 (0.0008) [2023-12-28 02:00:34,528][106225] Updated weights for policy 1, policy_version 942195 (0.0006) [2023-12-28 02:00:34,591][106225] Updated weights for policy 1, policy_version 942205 (0.0006) [2023-12-28 02:00:35,165][106226] Updated weights for policy 0, policy_version 939812 (0.0008) [2023-12-28 02:00:35,183][106225] Updated weights for policy 1, policy_version 942215 (0.0005) [2023-12-28 02:00:35,235][106226] Updated weights for policy 0, policy_version 939822 (0.0005) [2023-12-28 02:00:35,237][106225] Updated weights for policy 1, policy_version 942225 (0.0005) [2023-12-28 02:00:35,287][106225] Updated weights for policy 1, policy_version 942235 (0.0005) [2023-12-28 02:00:35,298][106226] Updated weights for policy 0, policy_version 939832 (0.0005) [2023-12-28 02:00:35,874][106225] Updated weights for policy 1, policy_version 942245 (0.0006) [2023-12-28 02:00:35,922][106226] Updated weights for policy 0, policy_version 939842 (0.0006) [2023-12-28 02:00:35,937][106225] Updated weights for policy 1, policy_version 942255 (0.0008) [2023-12-28 02:00:35,981][106226] Updated weights for policy 0, policy_version 939852 (0.0006) [2023-12-28 02:00:35,995][106225] Updated weights for policy 1, policy_version 942265 (0.0007) [2023-12-28 02:00:36,039][106226] Updated weights for policy 0, policy_version 939862 (0.0006) [2023-12-28 02:00:36,096][106226] Updated weights for policy 0, policy_version 939872 (0.0008) [2023-12-28 02:00:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 481927168. Throughput: 0: 9934.9, 1: 10021.6. Samples: 481931196. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:36,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-5.176')] [2023-12-28 02:00:36,722][106225] Updated weights for policy 1, policy_version 942275 (0.0006) [2023-12-28 02:00:36,789][106225] Updated weights for policy 1, policy_version 942285 (0.0006) [2023-12-28 02:00:36,849][106226] Updated weights for policy 0, policy_version 939882 (0.0007) [2023-12-28 02:00:36,854][106225] Updated weights for policy 1, policy_version 942295 (0.0007) [2023-12-28 02:00:36,901][106226] Updated weights for policy 0, policy_version 939892 (0.0007) [2023-12-28 02:00:36,953][106226] Updated weights for policy 0, policy_version 939902 (0.0008) [2023-12-28 02:00:37,499][106225] Updated weights for policy 1, policy_version 942305 (0.0006) [2023-12-28 02:00:37,560][106225] Updated weights for policy 1, policy_version 942315 (0.0007) [2023-12-28 02:00:37,620][106225] Updated weights for policy 1, policy_version 942325 (0.0010) [2023-12-28 02:00:37,644][106226] Updated weights for policy 0, policy_version 939912 (0.0010) [2023-12-28 02:00:37,671][106225] Updated weights for policy 1, policy_version 942335 (0.0010) [2023-12-28 02:00:37,703][106226] Updated weights for policy 0, policy_version 939922 (0.0011) [2023-12-28 02:00:37,761][106226] Updated weights for policy 0, policy_version 939932 (0.0008) [2023-12-28 02:00:38,387][106225] Updated weights for policy 1, policy_version 942345 (0.0011) [2023-12-28 02:00:38,448][106225] Updated weights for policy 1, policy_version 942355 (0.0010) [2023-12-28 02:00:38,499][106226] Updated weights for policy 0, policy_version 939942 (0.0007) [2023-12-28 02:00:38,516][106225] Updated weights for policy 1, policy_version 942365 (0.0010) [2023-12-28 02:00:38,551][106226] Updated weights for policy 0, policy_version 939952 (0.0006) [2023-12-28 02:00:38,610][106226] Updated weights for policy 0, policy_version 939962 (0.0008) [2023-12-28 02:00:39,242][106225] Updated weights for policy 1, policy_version 942375 (0.0010) [2023-12-28 02:00:39,302][106225] Updated weights for policy 1, policy_version 942385 (0.0006) [2023-12-28 02:00:39,370][106225] Updated weights for policy 1, policy_version 942395 (0.0011) [2023-12-28 02:00:39,380][106226] Updated weights for policy 0, policy_version 939972 (0.0008) [2023-12-28 02:00:39,444][106226] Updated weights for policy 0, policy_version 939982 (0.0008) [2023-12-28 02:00:39,498][106226] Updated weights for policy 0, policy_version 939992 (0.0008) [2023-12-28 02:00:40,145][106225] Updated weights for policy 1, policy_version 942405 (0.0012) [2023-12-28 02:00:40,195][106225] Updated weights for policy 1, policy_version 942415 (0.0005) [2023-12-28 02:00:40,243][106225] Updated weights for policy 1, policy_version 942425 (0.0006) [2023-12-28 02:00:40,259][106226] Updated weights for policy 0, policy_version 940002 (0.0008) [2023-12-28 02:00:40,325][106226] Updated weights for policy 0, policy_version 940012 (0.0008) [2023-12-28 02:00:40,391][106226] Updated weights for policy 0, policy_version 940022 (0.0009) [2023-12-28 02:00:40,455][106226] Updated weights for policy 0, policy_version 940032 (0.0008) [2023-12-28 02:00:40,833][106225] Updated weights for policy 1, policy_version 942435 (0.0006) [2023-12-28 02:00:40,883][106225] Updated weights for policy 1, policy_version 942445 (0.0006) [2023-12-28 02:00:40,935][106225] Updated weights for policy 1, policy_version 942455 (0.0005) [2023-12-28 02:00:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19633.0). Total num frames: 482017280. Throughput: 0: 9875.4, 1: 10023.9. Samples: 481989184. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:41,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-5.208')] [2023-12-28 02:00:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000942464_241311744.pth... [2023-12-28 02:00:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000940032_240705536.pth... [2023-12-28 02:00:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000941280_241008640.pth [2023-12-28 02:00:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000938920_240418816.pth [2023-12-28 02:00:41,284][106226] Updated weights for policy 0, policy_version 940042 (0.0009) [2023-12-28 02:00:41,350][106226] Updated weights for policy 0, policy_version 940052 (0.0010) [2023-12-28 02:00:41,417][106226] Updated weights for policy 0, policy_version 940062 (0.0009) [2023-12-28 02:00:41,575][106225] Updated weights for policy 1, policy_version 942465 (0.0005) [2023-12-28 02:00:41,640][106225] Updated weights for policy 1, policy_version 942475 (0.0007) [2023-12-28 02:00:41,699][106225] Updated weights for policy 1, policy_version 942485 (0.0007) [2023-12-28 02:00:41,757][106225] Updated weights for policy 1, policy_version 942495 (0.0008) [2023-12-28 02:00:42,160][106226] Updated weights for policy 0, policy_version 940072 (0.0010) [2023-12-28 02:00:42,217][106226] Updated weights for policy 0, policy_version 940082 (0.0011) [2023-12-28 02:00:42,279][106226] Updated weights for policy 0, policy_version 940092 (0.0011) [2023-12-28 02:00:42,507][106225] Updated weights for policy 1, policy_version 942505 (0.0006) [2023-12-28 02:00:42,575][106225] Updated weights for policy 1, policy_version 942515 (0.0007) [2023-12-28 02:00:42,634][106225] Updated weights for policy 1, policy_version 942525 (0.0010) [2023-12-28 02:00:42,989][106226] Updated weights for policy 0, policy_version 940102 (0.0008) [2023-12-28 02:00:43,049][106226] Updated weights for policy 0, policy_version 940112 (0.0008) [2023-12-28 02:00:43,108][106226] Updated weights for policy 0, policy_version 940122 (0.0009) [2023-12-28 02:00:43,315][106225] Updated weights for policy 1, policy_version 942535 (0.0008) [2023-12-28 02:00:43,362][106225] Updated weights for policy 1, policy_version 942545 (0.0008) [2023-12-28 02:00:43,410][106225] Updated weights for policy 1, policy_version 942555 (0.0008) [2023-12-28 02:00:43,727][106226] Updated weights for policy 0, policy_version 940132 (0.0009) [2023-12-28 02:00:43,781][106226] Updated weights for policy 0, policy_version 940142 (0.0010) [2023-12-28 02:00:43,829][106226] Updated weights for policy 0, policy_version 940152 (0.0009) [2023-12-28 02:00:44,109][106225] Updated weights for policy 1, policy_version 942565 (0.0007) [2023-12-28 02:00:44,165][106225] Updated weights for policy 1, policy_version 942575 (0.0008) [2023-12-28 02:00:44,213][106225] Updated weights for policy 1, policy_version 942585 (0.0008) [2023-12-28 02:00:44,477][106226] Updated weights for policy 0, policy_version 940162 (0.0006) [2023-12-28 02:00:44,528][106226] Updated weights for policy 0, policy_version 940172 (0.0010) [2023-12-28 02:00:44,582][106226] Updated weights for policy 0, policy_version 940182 (0.0009) [2023-12-28 02:00:44,647][106226] Updated weights for policy 0, policy_version 940192 (0.0006) [2023-12-28 02:00:45,047][106225] Updated weights for policy 1, policy_version 942595 (0.0008) [2023-12-28 02:00:45,099][106225] Updated weights for policy 1, policy_version 942605 (0.0008) [2023-12-28 02:00:45,162][106225] Updated weights for policy 1, policy_version 942615 (0.0009) [2023-12-28 02:00:45,330][106226] Updated weights for policy 0, policy_version 940202 (0.0011) [2023-12-28 02:00:45,388][106226] Updated weights for policy 0, policy_version 940212 (0.0010) [2023-12-28 02:00:45,446][106226] Updated weights for policy 0, policy_version 940222 (0.0009) [2023-12-28 02:00:45,932][106225] Updated weights for policy 1, policy_version 942625 (0.0008) [2023-12-28 02:00:45,989][106225] Updated weights for policy 1, policy_version 942635 (0.0008) [2023-12-28 02:00:46,040][106225] Updated weights for policy 1, policy_version 942645 (0.0007) [2023-12-28 02:00:46,099][106225] Updated weights for policy 1, policy_version 942655 (0.0007) [2023-12-28 02:00:46,119][106226] Updated weights for policy 0, policy_version 940232 (0.0010) [2023-12-28 02:00:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.9, 300 sec: 19633.0). Total num frames: 482115584. Throughput: 0: 9786.2, 1: 9939.4. Samples: 482106240. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:46,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-4.831')] [2023-12-28 02:00:46,186][106226] Updated weights for policy 0, policy_version 940242 (0.0011) [2023-12-28 02:00:46,246][106226] Updated weights for policy 0, policy_version 940252 (0.0010) [2023-12-28 02:00:46,702][106225] Updated weights for policy 1, policy_version 942665 (0.0005) [2023-12-28 02:00:46,763][106225] Updated weights for policy 1, policy_version 942675 (0.0007) [2023-12-28 02:00:46,819][106225] Updated weights for policy 1, policy_version 942685 (0.0008) [2023-12-28 02:00:46,852][106226] Updated weights for policy 0, policy_version 940262 (0.0008) [2023-12-28 02:00:46,910][106226] Updated weights for policy 0, policy_version 940272 (0.0006) [2023-12-28 02:00:46,963][106226] Updated weights for policy 0, policy_version 940282 (0.0005) [2023-12-28 02:00:47,500][106225] Updated weights for policy 1, policy_version 942695 (0.0010) [2023-12-28 02:00:47,555][106226] Updated weights for policy 0, policy_version 940292 (0.0006) [2023-12-28 02:00:47,556][106225] Updated weights for policy 1, policy_version 942705 (0.0010) [2023-12-28 02:00:47,604][106225] Updated weights for policy 1, policy_version 942715 (0.0010) [2023-12-28 02:00:47,610][106226] Updated weights for policy 0, policy_version 940302 (0.0006) [2023-12-28 02:00:47,663][106226] Updated weights for policy 0, policy_version 940312 (0.0007) [2023-12-28 02:00:48,335][106225] Updated weights for policy 1, policy_version 942725 (0.0010) [2023-12-28 02:00:48,373][106226] Updated weights for policy 0, policy_version 940322 (0.0007) [2023-12-28 02:00:48,395][106225] Updated weights for policy 1, policy_version 942735 (0.0008) [2023-12-28 02:00:48,432][106226] Updated weights for policy 0, policy_version 940332 (0.0006) [2023-12-28 02:00:48,445][106225] Updated weights for policy 1, policy_version 942745 (0.0007) [2023-12-28 02:00:48,490][106226] Updated weights for policy 0, policy_version 940342 (0.0006) [2023-12-28 02:00:48,549][106226] Updated weights for policy 0, policy_version 940352 (0.0009) [2023-12-28 02:00:49,187][106225] Updated weights for policy 1, policy_version 942755 (0.0008) [2023-12-28 02:00:49,258][106225] Updated weights for policy 1, policy_version 942765 (0.0010) [2023-12-28 02:00:49,319][106225] Updated weights for policy 1, policy_version 942775 (0.0010) [2023-12-28 02:00:49,322][106226] Updated weights for policy 0, policy_version 940362 (0.0006) [2023-12-28 02:00:49,402][106226] Updated weights for policy 0, policy_version 940372 (0.0007) [2023-12-28 02:00:49,472][106226] Updated weights for policy 0, policy_version 940382 (0.0008) [2023-12-28 02:00:49,994][106225] Updated weights for policy 1, policy_version 942785 (0.0009) [2023-12-28 02:00:50,056][106225] Updated weights for policy 1, policy_version 942795 (0.0011) [2023-12-28 02:00:50,113][106225] Updated weights for policy 1, policy_version 942805 (0.0008) [2023-12-28 02:00:50,148][106226] Updated weights for policy 0, policy_version 940392 (0.0007) [2023-12-28 02:00:50,181][106225] Updated weights for policy 1, policy_version 942815 (0.0010) [2023-12-28 02:00:50,208][106226] Updated weights for policy 0, policy_version 940402 (0.0007) [2023-12-28 02:00:50,264][106226] Updated weights for policy 0, policy_version 940412 (0.0008) [2023-12-28 02:00:50,850][106225] Updated weights for policy 1, policy_version 942825 (0.0011) [2023-12-28 02:00:50,919][106225] Updated weights for policy 1, policy_version 942835 (0.0008) [2023-12-28 02:00:50,933][106226] Updated weights for policy 0, policy_version 940422 (0.0006) [2023-12-28 02:00:50,977][106225] Updated weights for policy 1, policy_version 942845 (0.0008) [2023-12-28 02:00:50,999][106226] Updated weights for policy 0, policy_version 940432 (0.0010) [2023-12-28 02:00:51,058][106226] Updated weights for policy 0, policy_version 940442 (0.0011) [2023-12-28 02:00:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 482222080. Throughput: 0: 9794.5, 1: 9954.9. Samples: 482226752. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:51,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.875')] [2023-12-28 02:00:51,734][106225] Updated weights for policy 1, policy_version 942855 (0.0008) [2023-12-28 02:00:51,791][106226] Updated weights for policy 0, policy_version 940452 (0.0009) [2023-12-28 02:00:51,794][106225] Updated weights for policy 1, policy_version 942865 (0.0007) [2023-12-28 02:00:51,854][106226] Updated weights for policy 0, policy_version 940462 (0.0006) [2023-12-28 02:00:51,855][106225] Updated weights for policy 1, policy_version 942875 (0.0007) [2023-12-28 02:00:51,910][106226] Updated weights for policy 0, policy_version 940472 (0.0007) [2023-12-28 02:00:52,581][106225] Updated weights for policy 1, policy_version 942885 (0.0008) [2023-12-28 02:00:52,643][106225] Updated weights for policy 1, policy_version 942895 (0.0009) [2023-12-28 02:00:52,679][106226] Updated weights for policy 0, policy_version 940482 (0.0008) [2023-12-28 02:00:52,705][106225] Updated weights for policy 1, policy_version 942905 (0.0008) [2023-12-28 02:00:52,744][106226] Updated weights for policy 0, policy_version 940492 (0.0009) [2023-12-28 02:00:52,808][106226] Updated weights for policy 0, policy_version 940502 (0.0009) [2023-12-28 02:00:52,870][106226] Updated weights for policy 0, policy_version 940512 (0.0009) [2023-12-28 02:00:53,435][106225] Updated weights for policy 1, policy_version 942915 (0.0008) [2023-12-28 02:00:53,488][106225] Updated weights for policy 1, policy_version 942925 (0.0007) [2023-12-28 02:00:53,535][106225] Updated weights for policy 1, policy_version 942935 (0.0005) [2023-12-28 02:00:53,642][106226] Updated weights for policy 0, policy_version 940522 (0.0010) [2023-12-28 02:00:53,690][106226] Updated weights for policy 0, policy_version 940532 (0.0009) [2023-12-28 02:00:53,743][106226] Updated weights for policy 0, policy_version 940542 (0.0008) [2023-12-28 02:00:54,154][106225] Updated weights for policy 1, policy_version 942945 (0.0005) [2023-12-28 02:00:54,220][106225] Updated weights for policy 1, policy_version 942955 (0.0006) [2023-12-28 02:00:54,284][106225] Updated weights for policy 1, policy_version 942965 (0.0008) [2023-12-28 02:00:54,340][106225] Updated weights for policy 1, policy_version 942975 (0.0008) [2023-12-28 02:00:54,509][106226] Updated weights for policy 0, policy_version 940552 (0.0009) [2023-12-28 02:00:54,567][106226] Updated weights for policy 0, policy_version 940562 (0.0009) [2023-12-28 02:00:54,632][106226] Updated weights for policy 0, policy_version 940572 (0.0008) [2023-12-28 02:00:55,028][106225] Updated weights for policy 1, policy_version 942985 (0.0007) [2023-12-28 02:00:55,082][106225] Updated weights for policy 1, policy_version 942995 (0.0005) [2023-12-28 02:00:55,143][106225] Updated weights for policy 1, policy_version 943005 (0.0007) [2023-12-28 02:00:55,386][106226] Updated weights for policy 0, policy_version 940582 (0.0008) [2023-12-28 02:00:55,438][106226] Updated weights for policy 0, policy_version 940592 (0.0007) [2023-12-28 02:00:55,493][106226] Updated weights for policy 0, policy_version 940602 (0.0005) [2023-12-28 02:00:55,808][106225] Updated weights for policy 1, policy_version 943015 (0.0008) [2023-12-28 02:00:55,862][106225] Updated weights for policy 1, policy_version 943026 (0.0009) [2023-12-28 02:00:55,928][106225] Updated weights for policy 1, policy_version 943036 (0.0009) [2023-12-28 02:00:56,041][106226] Updated weights for policy 0, policy_version 940612 (0.0005) [2023-12-28 02:00:56,099][106226] Updated weights for policy 0, policy_version 940622 (0.0005) [2023-12-28 02:00:56,168][106226] Updated weights for policy 0, policy_version 940632 (0.0005) [2023-12-28 02:00:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 482312192. Throughput: 0: 9733.6, 1: 9925.3. Samples: 482282912. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:00:56,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.902')] [2023-12-28 02:00:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000943040_241459200.pth... [2023-12-28 02:00:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000941856_241156096.pth [2023-12-28 02:00:56,223][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000940640_240861184.pth... [2023-12-28 02:00:56,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000939488_240566272.pth [2023-12-28 02:00:56,645][106225] Updated weights for policy 1, policy_version 943046 (0.0008) [2023-12-28 02:00:56,708][106225] Updated weights for policy 1, policy_version 943056 (0.0006) [2023-12-28 02:00:56,773][106226] Updated weights for policy 0, policy_version 940642 (0.0005) [2023-12-28 02:00:56,776][106225] Updated weights for policy 1, policy_version 943066 (0.0010) [2023-12-28 02:00:56,822][106226] Updated weights for policy 0, policy_version 940652 (0.0005) [2023-12-28 02:00:56,881][106226] Updated weights for policy 0, policy_version 940662 (0.0005) [2023-12-28 02:00:56,929][106226] Updated weights for policy 0, policy_version 940672 (0.0005) [2023-12-28 02:00:57,420][106225] Updated weights for policy 1, policy_version 943076 (0.0010) [2023-12-28 02:00:57,474][106225] Updated weights for policy 1, policy_version 943086 (0.0010) [2023-12-28 02:00:57,526][106226] Updated weights for policy 0, policy_version 940682 (0.0006) [2023-12-28 02:00:57,533][106225] Updated weights for policy 1, policy_version 943096 (0.0010) [2023-12-28 02:00:57,580][106226] Updated weights for policy 0, policy_version 940692 (0.0008) [2023-12-28 02:00:57,645][106226] Updated weights for policy 0, policy_version 940702 (0.0008) [2023-12-28 02:00:58,239][106225] Updated weights for policy 1, policy_version 943106 (0.0010) [2023-12-28 02:00:58,305][106225] Updated weights for policy 1, policy_version 943116 (0.0011) [2023-12-28 02:00:58,383][106225] Updated weights for policy 1, policy_version 943127 (0.0010) [2023-12-28 02:00:58,422][106226] Updated weights for policy 0, policy_version 940712 (0.0008) [2023-12-28 02:00:58,484][106226] Updated weights for policy 0, policy_version 940722 (0.0008) [2023-12-28 02:00:58,550][106226] Updated weights for policy 0, policy_version 940732 (0.0009) [2023-12-28 02:00:59,199][106225] Updated weights for policy 1, policy_version 943137 (0.0010) [2023-12-28 02:00:59,283][106225] Updated weights for policy 1, policy_version 943149 (0.0009) [2023-12-28 02:00:59,353][106225] Updated weights for policy 1, policy_version 943159 (0.0007) [2023-12-28 02:00:59,360][106226] Updated weights for policy 0, policy_version 940742 (0.0009) [2023-12-28 02:00:59,436][106226] Updated weights for policy 0, policy_version 940752 (0.0008) [2023-12-28 02:00:59,502][106226] Updated weights for policy 0, policy_version 940762 (0.0008) [2023-12-28 02:01:00,125][106225] Updated weights for policy 1, policy_version 943169 (0.0010) [2023-12-28 02:01:00,187][106225] Updated weights for policy 1, policy_version 943179 (0.0008) [2023-12-28 02:01:00,246][106225] Updated weights for policy 1, policy_version 943189 (0.0007) [2023-12-28 02:01:00,287][106226] Updated weights for policy 0, policy_version 940772 (0.0008) [2023-12-28 02:01:00,309][106225] Updated weights for policy 1, policy_version 943199 (0.0008) [2023-12-28 02:01:00,346][106226] Updated weights for policy 0, policy_version 940782 (0.0007) [2023-12-28 02:01:00,405][106226] Updated weights for policy 0, policy_version 940792 (0.0009) [2023-12-28 02:01:00,988][106225] Updated weights for policy 1, policy_version 943209 (0.0008) [2023-12-28 02:01:01,046][106225] Updated weights for policy 1, policy_version 943219 (0.0008) [2023-12-28 02:01:01,107][106225] Updated weights for policy 1, policy_version 943229 (0.0007) [2023-12-28 02:01:01,140][106226] Updated weights for policy 0, policy_version 940802 (0.0009) [2023-12-28 02:01:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 482410496. Throughput: 0: 9756.5, 1: 9922.9. Samples: 482399668. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:01:01,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-4.810')] [2023-12-28 02:01:01,205][106226] Updated weights for policy 0, policy_version 940812 (0.0010) [2023-12-28 02:01:01,270][106226] Updated weights for policy 0, policy_version 940822 (0.0007) [2023-12-28 02:01:01,342][106226] Updated weights for policy 0, policy_version 940832 (0.0008) [2023-12-28 02:01:01,859][106225] Updated weights for policy 1, policy_version 943239 (0.0007) [2023-12-28 02:01:01,916][106225] Updated weights for policy 1, policy_version 943249 (0.0006) [2023-12-28 02:01:01,972][106225] Updated weights for policy 1, policy_version 943259 (0.0007) [2023-12-28 02:01:02,098][106226] Updated weights for policy 0, policy_version 940842 (0.0010) [2023-12-28 02:01:02,155][106226] Updated weights for policy 0, policy_version 940852 (0.0006) [2023-12-28 02:01:02,206][106226] Updated weights for policy 0, policy_version 940862 (0.0006) [2023-12-28 02:01:02,699][106225] Updated weights for policy 1, policy_version 943269 (0.0008) [2023-12-28 02:01:02,758][106225] Updated weights for policy 1, policy_version 943279 (0.0008) [2023-12-28 02:01:02,818][106225] Updated weights for policy 1, policy_version 943289 (0.0007) [2023-12-28 02:01:02,948][106226] Updated weights for policy 0, policy_version 940872 (0.0010) [2023-12-28 02:01:03,002][106226] Updated weights for policy 0, policy_version 940882 (0.0010) [2023-12-28 02:01:03,057][106226] Updated weights for policy 0, policy_version 940892 (0.0008) [2023-12-28 02:01:03,464][106225] Updated weights for policy 1, policy_version 943299 (0.0010) [2023-12-28 02:01:03,513][106225] Updated weights for policy 1, policy_version 943309 (0.0010) [2023-12-28 02:01:03,561][106225] Updated weights for policy 1, policy_version 943319 (0.0010) [2023-12-28 02:01:03,738][106226] Updated weights for policy 0, policy_version 940902 (0.0009) [2023-12-28 02:01:03,798][106226] Updated weights for policy 0, policy_version 940912 (0.0010) [2023-12-28 02:01:03,867][106226] Updated weights for policy 0, policy_version 940922 (0.0009) [2023-12-28 02:01:04,358][106225] Updated weights for policy 1, policy_version 943329 (0.0010) [2023-12-28 02:01:04,428][106225] Updated weights for policy 1, policy_version 943339 (0.0010) [2023-12-28 02:01:04,495][106225] Updated weights for policy 1, policy_version 943349 (0.0008) [2023-12-28 02:01:04,548][106225] Updated weights for policy 1, policy_version 943359 (0.0006) [2023-12-28 02:01:04,606][106226] Updated weights for policy 0, policy_version 940932 (0.0011) [2023-12-28 02:01:04,665][106226] Updated weights for policy 0, policy_version 940942 (0.0011) [2023-12-28 02:01:04,723][106226] Updated weights for policy 0, policy_version 940952 (0.0011) [2023-12-28 02:01:05,175][106225] Updated weights for policy 1, policy_version 943369 (0.0005) [2023-12-28 02:01:05,231][106225] Updated weights for policy 1, policy_version 943379 (0.0007) [2023-12-28 02:01:05,284][106225] Updated weights for policy 1, policy_version 943389 (0.0007) [2023-12-28 02:01:05,447][106226] Updated weights for policy 0, policy_version 940962 (0.0009) [2023-12-28 02:01:05,518][106226] Updated weights for policy 0, policy_version 940972 (0.0008) [2023-12-28 02:01:05,585][106226] Updated weights for policy 0, policy_version 940982 (0.0011) [2023-12-28 02:01:05,653][106226] Updated weights for policy 0, policy_version 940992 (0.0009) [2023-12-28 02:01:05,852][106225] Updated weights for policy 1, policy_version 943399 (0.0009) [2023-12-28 02:01:05,909][106225] Updated weights for policy 1, policy_version 943409 (0.0010) [2023-12-28 02:01:05,964][106225] Updated weights for policy 1, policy_version 943419 (0.0010) [2023-12-28 02:01:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 482508800. Throughput: 0: 9729.1, 1: 9981.4. Samples: 482517320. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 02:01:06,175][105115] Avg episode reward: [(0, '-4.853'), (1, '-5.265')] [2023-12-28 02:01:06,322][106226] Updated weights for policy 0, policy_version 941002 (0.0008) [2023-12-28 02:01:06,381][106226] Updated weights for policy 0, policy_version 941012 (0.0011) [2023-12-28 02:01:06,443][106226] Updated weights for policy 0, policy_version 941022 (0.0011) [2023-12-28 02:01:06,710][106225] Updated weights for policy 1, policy_version 943429 (0.0009) [2023-12-28 02:01:06,766][106225] Updated weights for policy 1, policy_version 943439 (0.0008) [2023-12-28 02:01:06,818][106225] Updated weights for policy 1, policy_version 943449 (0.0008) [2023-12-28 02:01:07,140][106226] Updated weights for policy 0, policy_version 941032 (0.0011) [2023-12-28 02:01:07,201][106226] Updated weights for policy 0, policy_version 941042 (0.0011) [2023-12-28 02:01:07,262][106226] Updated weights for policy 0, policy_version 941052 (0.0009) [2023-12-28 02:01:07,589][106225] Updated weights for policy 1, policy_version 943459 (0.0007) [2023-12-28 02:01:07,646][106225] Updated weights for policy 1, policy_version 943469 (0.0005) [2023-12-28 02:01:07,700][106225] Updated weights for policy 1, policy_version 943479 (0.0005) [2023-12-28 02:01:07,912][106226] Updated weights for policy 0, policy_version 941062 (0.0011) [2023-12-28 02:01:07,978][106226] Updated weights for policy 0, policy_version 941072 (0.0011) [2023-12-28 02:01:08,035][106226] Updated weights for policy 0, policy_version 941082 (0.0007) [2023-12-28 02:01:08,381][106225] Updated weights for policy 1, policy_version 943489 (0.0007) [2023-12-28 02:01:08,448][106225] Updated weights for policy 1, policy_version 943499 (0.0011) [2023-12-28 02:01:08,519][106225] Updated weights for policy 1, policy_version 943509 (0.0011) [2023-12-28 02:01:08,583][106225] Updated weights for policy 1, policy_version 943519 (0.0010) [2023-12-28 02:01:08,742][106226] Updated weights for policy 0, policy_version 941092 (0.0009) [2023-12-28 02:01:08,802][106226] Updated weights for policy 0, policy_version 941102 (0.0008) [2023-12-28 02:01:08,864][106226] Updated weights for policy 0, policy_version 941112 (0.0008) [2023-12-28 02:01:09,319][106225] Updated weights for policy 1, policy_version 943529 (0.0008) [2023-12-28 02:01:09,390][106225] Updated weights for policy 1, policy_version 943539 (0.0009) [2023-12-28 02:01:09,452][106225] Updated weights for policy 1, policy_version 943549 (0.0008) [2023-12-28 02:01:09,670][106226] Updated weights for policy 0, policy_version 941122 (0.0008) [2023-12-28 02:01:09,729][106226] Updated weights for policy 0, policy_version 941132 (0.0008) [2023-12-28 02:01:09,799][106226] Updated weights for policy 0, policy_version 941142 (0.0008) [2023-12-28 02:01:09,875][106226] Updated weights for policy 0, policy_version 941152 (0.0008) [2023-12-28 02:01:10,235][106225] Updated weights for policy 1, policy_version 943559 (0.0008) [2023-12-28 02:01:10,307][106225] Updated weights for policy 1, policy_version 943569 (0.0006) [2023-12-28 02:01:10,376][106225] Updated weights for policy 1, policy_version 943579 (0.0005) [2023-12-28 02:01:10,561][106226] Updated weights for policy 0, policy_version 941162 (0.0010) [2023-12-28 02:01:10,612][106226] Updated weights for policy 0, policy_version 941172 (0.0009) [2023-12-28 02:01:10,666][106226] Updated weights for policy 0, policy_version 941182 (0.0009) [2023-12-28 02:01:10,987][106225] Updated weights for policy 1, policy_version 943589 (0.0006) [2023-12-28 02:01:11,072][106225] Updated weights for policy 1, policy_version 943599 (0.0008) [2023-12-28 02:01:11,142][106225] Updated weights for policy 1, policy_version 943609 (0.0009) [2023-12-28 02:01:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19605.3). Total num frames: 482598912. Throughput: 0: 9762.0, 1: 9982.0. Samples: 482575468. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:11,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.964')] [2023-12-28 02:01:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000941184_241000448.pth... [2023-12-28 02:01:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000940032_240705536.pth [2023-12-28 02:01:11,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000943616_241606656.pth... [2023-12-28 02:01:11,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000942464_241311744.pth [2023-12-28 02:01:11,481][106226] Updated weights for policy 0, policy_version 941192 (0.0007) [2023-12-28 02:01:11,544][106226] Updated weights for policy 0, policy_version 941202 (0.0007) [2023-12-28 02:01:11,605][106226] Updated weights for policy 0, policy_version 941212 (0.0008) [2023-12-28 02:01:11,866][106225] Updated weights for policy 1, policy_version 943619 (0.0007) [2023-12-28 02:01:11,933][106225] Updated weights for policy 1, policy_version 943629 (0.0007) [2023-12-28 02:01:11,996][106225] Updated weights for policy 1, policy_version 943639 (0.0007) [2023-12-28 02:01:12,364][106226] Updated weights for policy 0, policy_version 941222 (0.0008) [2023-12-28 02:01:12,424][106226] Updated weights for policy 0, policy_version 941232 (0.0007) [2023-12-28 02:01:12,474][106226] Updated weights for policy 0, policy_version 941242 (0.0007) [2023-12-28 02:01:12,696][106225] Updated weights for policy 1, policy_version 943649 (0.0010) [2023-12-28 02:01:12,759][106225] Updated weights for policy 1, policy_version 943659 (0.0009) [2023-12-28 02:01:12,812][106225] Updated weights for policy 1, policy_version 943669 (0.0008) [2023-12-28 02:01:12,862][106225] Updated weights for policy 1, policy_version 943679 (0.0010) [2023-12-28 02:01:13,210][106226] Updated weights for policy 0, policy_version 941252 (0.0009) [2023-12-28 02:01:13,261][106226] Updated weights for policy 0, policy_version 941262 (0.0008) [2023-12-28 02:01:13,310][106226] Updated weights for policy 0, policy_version 941272 (0.0008) [2023-12-28 02:01:13,580][106225] Updated weights for policy 1, policy_version 943689 (0.0006) [2023-12-28 02:01:13,633][106225] Updated weights for policy 1, policy_version 943699 (0.0005) [2023-12-28 02:01:13,682][106225] Updated weights for policy 1, policy_version 943709 (0.0005) [2023-12-28 02:01:14,107][106226] Updated weights for policy 0, policy_version 941282 (0.0007) [2023-12-28 02:01:14,167][106226] Updated weights for policy 0, policy_version 941292 (0.0008) [2023-12-28 02:01:14,226][106226] Updated weights for policy 0, policy_version 941302 (0.0008) [2023-12-28 02:01:14,280][106226] Updated weights for policy 0, policy_version 941312 (0.0007) [2023-12-28 02:01:14,297][106225] Updated weights for policy 1, policy_version 943719 (0.0009) [2023-12-28 02:01:14,347][106225] Updated weights for policy 1, policy_version 943729 (0.0010) [2023-12-28 02:01:14,404][106225] Updated weights for policy 1, policy_version 943739 (0.0010) [2023-12-28 02:01:14,991][106226] Updated weights for policy 0, policy_version 941322 (0.0009) [2023-12-28 02:01:15,054][106226] Updated weights for policy 0, policy_version 941332 (0.0009) [2023-12-28 02:01:15,112][106226] Updated weights for policy 0, policy_version 941342 (0.0009) [2023-12-28 02:01:15,124][106225] Updated weights for policy 1, policy_version 943749 (0.0008) [2023-12-28 02:01:15,186][106225] Updated weights for policy 1, policy_version 943759 (0.0007) [2023-12-28 02:01:15,245][106225] Updated weights for policy 1, policy_version 943769 (0.0009) [2023-12-28 02:01:15,862][106226] Updated weights for policy 0, policy_version 941352 (0.0008) [2023-12-28 02:01:15,911][106226] Updated weights for policy 0, policy_version 941362 (0.0008) [2023-12-28 02:01:15,929][106225] Updated weights for policy 1, policy_version 943779 (0.0007) [2023-12-28 02:01:15,965][106226] Updated weights for policy 0, policy_version 941372 (0.0007) [2023-12-28 02:01:15,986][106225] Updated weights for policy 1, policy_version 943789 (0.0006) [2023-12-28 02:01:16,045][106225] Updated weights for policy 1, policy_version 943799 (0.0005) [2023-12-28 02:01:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 482705408. Throughput: 0: 9694.3, 1: 9954.3. Samples: 482689152. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:16,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-4.771')] [2023-12-28 02:01:16,685][106225] Updated weights for policy 1, policy_version 943809 (0.0006) [2023-12-28 02:01:16,734][106226] Updated weights for policy 0, policy_version 941382 (0.0010) [2023-12-28 02:01:16,751][106225] Updated weights for policy 1, policy_version 943819 (0.0007) [2023-12-28 02:01:16,783][106226] Updated weights for policy 0, policy_version 941392 (0.0010) [2023-12-28 02:01:16,796][106225] Updated weights for policy 1, policy_version 943829 (0.0007) [2023-12-28 02:01:16,830][106226] Updated weights for policy 0, policy_version 941402 (0.0007) [2023-12-28 02:01:16,844][106225] Updated weights for policy 1, policy_version 943839 (0.0007) [2023-12-28 02:01:17,563][106226] Updated weights for policy 0, policy_version 941412 (0.0008) [2023-12-28 02:01:17,573][106225] Updated weights for policy 1, policy_version 943849 (0.0008) [2023-12-28 02:01:17,623][106226] Updated weights for policy 0, policy_version 941422 (0.0011) [2023-12-28 02:01:17,634][106225] Updated weights for policy 1, policy_version 943859 (0.0010) [2023-12-28 02:01:17,680][106226] Updated weights for policy 0, policy_version 941432 (0.0010) [2023-12-28 02:01:17,690][106225] Updated weights for policy 1, policy_version 943869 (0.0007) [2023-12-28 02:01:18,387][106226] Updated weights for policy 0, policy_version 941442 (0.0009) [2023-12-28 02:01:18,413][106225] Updated weights for policy 1, policy_version 943879 (0.0009) [2023-12-28 02:01:18,448][106226] Updated weights for policy 0, policy_version 941452 (0.0011) [2023-12-28 02:01:18,479][106225] Updated weights for policy 1, policy_version 943889 (0.0006) [2023-12-28 02:01:18,506][106226] Updated weights for policy 0, policy_version 941462 (0.0011) [2023-12-28 02:01:18,544][106225] Updated weights for policy 1, policy_version 943899 (0.0005) [2023-12-28 02:01:18,570][106226] Updated weights for policy 0, policy_version 941472 (0.0010) [2023-12-28 02:01:19,189][106225] Updated weights for policy 1, policy_version 943909 (0.0006) [2023-12-28 02:01:19,255][106225] Updated weights for policy 1, policy_version 943919 (0.0008) [2023-12-28 02:01:19,281][106226] Updated weights for policy 0, policy_version 941482 (0.0008) [2023-12-28 02:01:19,324][106225] Updated weights for policy 1, policy_version 943929 (0.0006) [2023-12-28 02:01:19,341][106226] Updated weights for policy 0, policy_version 941492 (0.0008) [2023-12-28 02:01:19,405][106226] Updated weights for policy 0, policy_version 941502 (0.0007) [2023-12-28 02:01:20,002][106225] Updated weights for policy 1, policy_version 943939 (0.0009) [2023-12-28 02:01:20,064][106225] Updated weights for policy 1, policy_version 943949 (0.0006) [2023-12-28 02:01:20,127][106225] Updated weights for policy 1, policy_version 943959 (0.0008) [2023-12-28 02:01:20,159][106226] Updated weights for policy 0, policy_version 941512 (0.0007) [2023-12-28 02:01:20,230][106226] Updated weights for policy 0, policy_version 941522 (0.0006) [2023-12-28 02:01:20,297][106226] Updated weights for policy 0, policy_version 941532 (0.0009) [2023-12-28 02:01:20,802][106225] Updated weights for policy 1, policy_version 943969 (0.0008) [2023-12-28 02:01:20,868][106225] Updated weights for policy 1, policy_version 943979 (0.0008) [2023-12-28 02:01:20,927][106225] Updated weights for policy 1, policy_version 943989 (0.0009) [2023-12-28 02:01:20,989][106225] Updated weights for policy 1, policy_version 943999 (0.0009) [2023-12-28 02:01:21,042][106226] Updated weights for policy 0, policy_version 941542 (0.0008) [2023-12-28 02:01:21,104][106226] Updated weights for policy 0, policy_version 941552 (0.0007) [2023-12-28 02:01:21,168][106226] Updated weights for policy 0, policy_version 941562 (0.0009) [2023-12-28 02:01:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 482795520. Throughput: 0: 9615.1, 1: 9827.3. Samples: 482806104. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:21,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-4.934')] [2023-12-28 02:01:21,781][106225] Updated weights for policy 1, policy_version 944009 (0.0007) [2023-12-28 02:01:21,848][106225] Updated weights for policy 1, policy_version 944019 (0.0009) [2023-12-28 02:01:21,914][106225] Updated weights for policy 1, policy_version 944029 (0.0009) [2023-12-28 02:01:21,927][106226] Updated weights for policy 0, policy_version 941572 (0.0007) [2023-12-28 02:01:21,983][106226] Updated weights for policy 0, policy_version 941582 (0.0007) [2023-12-28 02:01:22,051][106226] Updated weights for policy 0, policy_version 941592 (0.0006) [2023-12-28 02:01:22,704][106225] Updated weights for policy 1, policy_version 944039 (0.0008) [2023-12-28 02:01:22,731][106226] Updated weights for policy 0, policy_version 941602 (0.0006) [2023-12-28 02:01:22,766][106225] Updated weights for policy 1, policy_version 944049 (0.0008) [2023-12-28 02:01:22,793][106226] Updated weights for policy 0, policy_version 941612 (0.0007) [2023-12-28 02:01:22,831][106225] Updated weights for policy 1, policy_version 944059 (0.0009) [2023-12-28 02:01:22,853][106226] Updated weights for policy 0, policy_version 941622 (0.0007) [2023-12-28 02:01:22,904][106226] Updated weights for policy 0, policy_version 941632 (0.0008) [2023-12-28 02:01:23,527][106225] Updated weights for policy 1, policy_version 944069 (0.0006) [2023-12-28 02:01:23,585][106225] Updated weights for policy 1, policy_version 944079 (0.0005) [2023-12-28 02:01:23,638][106225] Updated weights for policy 1, policy_version 944089 (0.0005) [2023-12-28 02:01:23,671][106226] Updated weights for policy 0, policy_version 941642 (0.0008) [2023-12-28 02:01:23,729][106226] Updated weights for policy 0, policy_version 941652 (0.0008) [2023-12-28 02:01:23,786][106226] Updated weights for policy 0, policy_version 941662 (0.0009) [2023-12-28 02:01:24,310][106225] Updated weights for policy 1, policy_version 944099 (0.0008) [2023-12-28 02:01:24,377][106225] Updated weights for policy 1, policy_version 944109 (0.0008) [2023-12-28 02:01:24,423][106226] Updated weights for policy 0, policy_version 941672 (0.0008) [2023-12-28 02:01:24,431][106225] Updated weights for policy 1, policy_version 944119 (0.0010) [2023-12-28 02:01:24,477][106226] Updated weights for policy 0, policy_version 941682 (0.0008) [2023-12-28 02:01:24,543][106226] Updated weights for policy 0, policy_version 941692 (0.0006) [2023-12-28 02:01:25,091][106226] Updated weights for policy 0, policy_version 941702 (0.0007) [2023-12-28 02:01:25,102][106225] Updated weights for policy 1, policy_version 944129 (0.0010) [2023-12-28 02:01:25,147][106226] Updated weights for policy 0, policy_version 941712 (0.0007) [2023-12-28 02:01:25,157][106225] Updated weights for policy 1, policy_version 944139 (0.0006) [2023-12-28 02:01:25,209][106226] Updated weights for policy 0, policy_version 941722 (0.0009) [2023-12-28 02:01:25,215][106225] Updated weights for policy 1, policy_version 944149 (0.0006) [2023-12-28 02:01:25,278][106225] Updated weights for policy 1, policy_version 944159 (0.0007) [2023-12-28 02:01:25,940][106226] Updated weights for policy 0, policy_version 941732 (0.0007) [2023-12-28 02:01:26,009][106226] Updated weights for policy 0, policy_version 941742 (0.0007) [2023-12-28 02:01:26,024][106225] Updated weights for policy 1, policy_version 944169 (0.0006) [2023-12-28 02:01:26,071][106225] Updated weights for policy 1, policy_version 944179 (0.0007) [2023-12-28 02:01:26,073][106226] Updated weights for policy 0, policy_version 941752 (0.0008) [2023-12-28 02:01:26,128][106225] Updated weights for policy 1, policy_version 944189 (0.0006) [2023-12-28 02:01:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 482902016. Throughput: 0: 9603.2, 1: 9784.7. Samples: 482861640. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:26,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.862')] [2023-12-28 02:01:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000944192_241754112.pth... [2023-12-28 02:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000941760_241147904.pth... [2023-12-28 02:01:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000943040_241459200.pth [2023-12-28 02:01:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000940640_240861184.pth [2023-12-28 02:01:26,741][106226] Updated weights for policy 0, policy_version 941762 (0.0008) [2023-12-28 02:01:26,774][106225] Updated weights for policy 1, policy_version 944199 (0.0010) [2023-12-28 02:01:26,788][106226] Updated weights for policy 0, policy_version 941772 (0.0007) [2023-12-28 02:01:26,830][106225] Updated weights for policy 1, policy_version 944209 (0.0010) [2023-12-28 02:01:26,838][106226] Updated weights for policy 0, policy_version 941782 (0.0008) [2023-12-28 02:01:26,882][106225] Updated weights for policy 1, policy_version 944219 (0.0007) [2023-12-28 02:01:26,894][106226] Updated weights for policy 0, policy_version 941792 (0.0007) [2023-12-28 02:01:27,460][106225] Updated weights for policy 1, policy_version 944229 (0.0006) [2023-12-28 02:01:27,519][106225] Updated weights for policy 1, policy_version 944239 (0.0009) [2023-12-28 02:01:27,559][106226] Updated weights for policy 0, policy_version 941802 (0.0005) [2023-12-28 02:01:27,582][106225] Updated weights for policy 1, policy_version 944249 (0.0007) [2023-12-28 02:01:27,617][106226] Updated weights for policy 0, policy_version 941812 (0.0005) [2023-12-28 02:01:27,681][106226] Updated weights for policy 0, policy_version 941822 (0.0005) [2023-12-28 02:01:28,252][106225] Updated weights for policy 1, policy_version 944259 (0.0006) [2023-12-28 02:01:28,310][106226] Updated weights for policy 0, policy_version 941832 (0.0007) [2023-12-28 02:01:28,314][106225] Updated weights for policy 1, policy_version 944269 (0.0005) [2023-12-28 02:01:28,374][106226] Updated weights for policy 0, policy_version 941842 (0.0008) [2023-12-28 02:01:28,388][106225] Updated weights for policy 1, policy_version 944279 (0.0007) [2023-12-28 02:01:28,430][106226] Updated weights for policy 0, policy_version 941852 (0.0007) [2023-12-28 02:01:29,042][106226] Updated weights for policy 0, policy_version 941862 (0.0007) [2023-12-28 02:01:29,085][106225] Updated weights for policy 1, policy_version 944289 (0.0006) [2023-12-28 02:01:29,098][106226] Updated weights for policy 0, policy_version 941872 (0.0009) [2023-12-28 02:01:29,134][106225] Updated weights for policy 1, policy_version 944299 (0.0005) [2023-12-28 02:01:29,157][106226] Updated weights for policy 0, policy_version 941882 (0.0005) [2023-12-28 02:01:29,188][106225] Updated weights for policy 1, policy_version 944309 (0.0005) [2023-12-28 02:01:29,253][106225] Updated weights for policy 1, policy_version 944319 (0.0007) [2023-12-28 02:01:29,914][106226] Updated weights for policy 0, policy_version 941892 (0.0007) [2023-12-28 02:01:29,979][106226] Updated weights for policy 0, policy_version 941902 (0.0011) [2023-12-28 02:01:30,013][106225] Updated weights for policy 1, policy_version 944329 (0.0006) [2023-12-28 02:01:30,038][106226] Updated weights for policy 0, policy_version 941912 (0.0010) [2023-12-28 02:01:30,067][106225] Updated weights for policy 1, policy_version 944339 (0.0006) [2023-12-28 02:01:30,127][106225] Updated weights for policy 1, policy_version 944349 (0.0007) [2023-12-28 02:01:30,773][106226] Updated weights for policy 0, policy_version 941922 (0.0010) [2023-12-28 02:01:30,841][106226] Updated weights for policy 0, policy_version 941932 (0.0010) [2023-12-28 02:01:30,851][106225] Updated weights for policy 1, policy_version 944359 (0.0009) [2023-12-28 02:01:30,900][106226] Updated weights for policy 0, policy_version 941942 (0.0010) [2023-12-28 02:01:30,908][106225] Updated weights for policy 1, policy_version 944369 (0.0010) [2023-12-28 02:01:30,951][106226] Updated weights for policy 0, policy_version 941952 (0.0008) [2023-12-28 02:01:30,964][106225] Updated weights for policy 1, policy_version 944379 (0.0010) [2023-12-28 02:01:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19633.0). Total num frames: 483000320. Throughput: 0: 9724.4, 1: 9828.2. Samples: 482986104. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:31,175][105115] Avg episode reward: [(0, '-4.916'), (1, '-4.991')] [2023-12-28 02:01:31,672][106226] Updated weights for policy 0, policy_version 941962 (0.0010) [2023-12-28 02:01:31,729][106226] Updated weights for policy 0, policy_version 941972 (0.0010) [2023-12-28 02:01:31,733][106225] Updated weights for policy 1, policy_version 944389 (0.0009) [2023-12-28 02:01:31,794][106225] Updated weights for policy 1, policy_version 944399 (0.0007) [2023-12-28 02:01:31,795][106226] Updated weights for policy 0, policy_version 941982 (0.0009) [2023-12-28 02:01:31,846][106225] Updated weights for policy 1, policy_version 944409 (0.0007) [2023-12-28 02:01:32,482][106226] Updated weights for policy 0, policy_version 941992 (0.0009) [2023-12-28 02:01:32,545][106226] Updated weights for policy 0, policy_version 942002 (0.0009) [2023-12-28 02:01:32,558][106225] Updated weights for policy 1, policy_version 944419 (0.0007) [2023-12-28 02:01:32,599][106226] Updated weights for policy 0, policy_version 942012 (0.0009) [2023-12-28 02:01:32,618][106225] Updated weights for policy 1, policy_version 944429 (0.0005) [2023-12-28 02:01:32,678][106225] Updated weights for policy 1, policy_version 944439 (0.0007) [2023-12-28 02:01:33,229][106225] Updated weights for policy 1, policy_version 944449 (0.0007) [2023-12-28 02:01:33,268][106226] Updated weights for policy 0, policy_version 942022 (0.0007) [2023-12-28 02:01:33,295][106225] Updated weights for policy 1, policy_version 944459 (0.0005) [2023-12-28 02:01:33,318][106226] Updated weights for policy 0, policy_version 942032 (0.0005) [2023-12-28 02:01:33,356][106225] Updated weights for policy 1, policy_version 944469 (0.0007) [2023-12-28 02:01:33,372][106226] Updated weights for policy 0, policy_version 942042 (0.0005) [2023-12-28 02:01:33,406][106225] Updated weights for policy 1, policy_version 944479 (0.0005) [2023-12-28 02:01:33,920][106226] Updated weights for policy 0, policy_version 942052 (0.0007) [2023-12-28 02:01:33,975][106226] Updated weights for policy 0, policy_version 942062 (0.0009) [2023-12-28 02:01:33,980][106225] Updated weights for policy 1, policy_version 944489 (0.0006) [2023-12-28 02:01:34,022][106226] Updated weights for policy 0, policy_version 942072 (0.0010) [2023-12-28 02:01:34,030][106225] Updated weights for policy 1, policy_version 944499 (0.0007) [2023-12-28 02:01:34,080][106225] Updated weights for policy 1, policy_version 944509 (0.0006) [2023-12-28 02:01:34,709][106226] Updated weights for policy 0, policy_version 942082 (0.0010) [2023-12-28 02:01:34,774][106226] Updated weights for policy 0, policy_version 942092 (0.0008) [2023-12-28 02:01:34,818][106225] Updated weights for policy 1, policy_version 944519 (0.0007) [2023-12-28 02:01:34,825][106226] Updated weights for policy 0, policy_version 942102 (0.0006) [2023-12-28 02:01:34,876][106225] Updated weights for policy 1, policy_version 944529 (0.0009) [2023-12-28 02:01:34,883][106226] Updated weights for policy 0, policy_version 942112 (0.0009) [2023-12-28 02:01:34,930][106225] Updated weights for policy 1, policy_version 944539 (0.0007) [2023-12-28 02:01:35,488][106225] Updated weights for policy 1, policy_version 944549 (0.0006) [2023-12-28 02:01:35,538][106225] Updated weights for policy 1, policy_version 944559 (0.0006) [2023-12-28 02:01:35,570][106226] Updated weights for policy 0, policy_version 942122 (0.0010) [2023-12-28 02:01:35,585][106225] Updated weights for policy 1, policy_version 944569 (0.0010) [2023-12-28 02:01:35,626][106226] Updated weights for policy 0, policy_version 942132 (0.0010) [2023-12-28 02:01:35,682][106226] Updated weights for policy 0, policy_version 942142 (0.0010) [2023-12-28 02:01:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 483098624. Throughput: 0: 9713.7, 1: 9887.7. Samples: 483108816. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:36,175][105115] Avg episode reward: [(0, '-4.311'), (1, '-5.000')] [2023-12-28 02:01:36,214][106225] Updated weights for policy 1, policy_version 944579 (0.0010) [2023-12-28 02:01:36,276][106225] Updated weights for policy 1, policy_version 944589 (0.0008) [2023-12-28 02:01:36,342][106225] Updated weights for policy 1, policy_version 944599 (0.0006) [2023-12-28 02:01:36,409][106226] Updated weights for policy 0, policy_version 942152 (0.0011) [2023-12-28 02:01:36,471][106226] Updated weights for policy 0, policy_version 942162 (0.0011) [2023-12-28 02:01:36,536][106226] Updated weights for policy 0, policy_version 942172 (0.0011) [2023-12-28 02:01:36,932][106225] Updated weights for policy 1, policy_version 944609 (0.0010) [2023-12-28 02:01:36,983][106225] Updated weights for policy 1, policy_version 944619 (0.0005) [2023-12-28 02:01:37,035][106225] Updated weights for policy 1, policy_version 944629 (0.0007) [2023-12-28 02:01:37,096][106225] Updated weights for policy 1, policy_version 944639 (0.0010) [2023-12-28 02:01:37,249][106226] Updated weights for policy 0, policy_version 942182 (0.0010) [2023-12-28 02:01:37,303][106226] Updated weights for policy 0, policy_version 942192 (0.0010) [2023-12-28 02:01:37,356][106226] Updated weights for policy 0, policy_version 942202 (0.0010) [2023-12-28 02:01:37,764][106225] Updated weights for policy 1, policy_version 944649 (0.0010) [2023-12-28 02:01:37,816][106225] Updated weights for policy 1, policy_version 944659 (0.0010) [2023-12-28 02:01:37,870][106225] Updated weights for policy 1, policy_version 944669 (0.0010) [2023-12-28 02:01:38,091][106226] Updated weights for policy 0, policy_version 942212 (0.0010) [2023-12-28 02:01:38,145][106226] Updated weights for policy 0, policy_version 942222 (0.0010) [2023-12-28 02:01:38,194][106226] Updated weights for policy 0, policy_version 942232 (0.0010) [2023-12-28 02:01:38,573][106225] Updated weights for policy 1, policy_version 944679 (0.0011) [2023-12-28 02:01:38,637][106225] Updated weights for policy 1, policy_version 944689 (0.0010) [2023-12-28 02:01:38,701][106225] Updated weights for policy 1, policy_version 944699 (0.0010) [2023-12-28 02:01:38,863][106226] Updated weights for policy 0, policy_version 942242 (0.0010) [2023-12-28 02:01:38,914][106226] Updated weights for policy 0, policy_version 942252 (0.0010) [2023-12-28 02:01:38,968][106226] Updated weights for policy 0, policy_version 942262 (0.0010) [2023-12-28 02:01:39,019][106226] Updated weights for policy 0, policy_version 942272 (0.0010) [2023-12-28 02:01:39,412][106225] Updated weights for policy 1, policy_version 944709 (0.0010) [2023-12-28 02:01:39,472][106225] Updated weights for policy 1, policy_version 944719 (0.0009) [2023-12-28 02:01:39,532][106225] Updated weights for policy 1, policy_version 944729 (0.0007) [2023-12-28 02:01:39,769][106226] Updated weights for policy 0, policy_version 942282 (0.0007) [2023-12-28 02:01:39,836][106226] Updated weights for policy 0, policy_version 942292 (0.0008) [2023-12-28 02:01:39,903][106226] Updated weights for policy 0, policy_version 942302 (0.0007) [2023-12-28 02:01:40,199][106225] Updated weights for policy 1, policy_version 944739 (0.0007) [2023-12-28 02:01:40,263][106225] Updated weights for policy 1, policy_version 944749 (0.0009) [2023-12-28 02:01:40,328][106225] Updated weights for policy 1, policy_version 944759 (0.0009) [2023-12-28 02:01:40,570][106226] Updated weights for policy 0, policy_version 942312 (0.0007) [2023-12-28 02:01:40,630][106226] Updated weights for policy 0, policy_version 942322 (0.0007) [2023-12-28 02:01:40,681][106226] Updated weights for policy 0, policy_version 942332 (0.0009) [2023-12-28 02:01:41,060][106225] Updated weights for policy 1, policy_version 944769 (0.0009) [2023-12-28 02:01:41,122][106225] Updated weights for policy 1, policy_version 944779 (0.0009) [2023-12-28 02:01:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 483196928. Throughput: 0: 9757.6, 1: 9961.3. Samples: 483170268. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:41,176][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.238')] [2023-12-28 02:01:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000942336_241295360.pth... [2023-12-28 02:01:41,186][106225] Updated weights for policy 1, policy_version 944789 (0.0007) [2023-12-28 02:01:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000941184_241000448.pth [2023-12-28 02:01:41,242][106225] Updated weights for policy 1, policy_version 944799 (0.0009) [2023-12-28 02:01:41,248][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000944800_241909760.pth... [2023-12-28 02:01:41,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000943616_241606656.pth [2023-12-28 02:01:41,354][106226] Updated weights for policy 0, policy_version 942342 (0.0008) [2023-12-28 02:01:41,426][106226] Updated weights for policy 0, policy_version 942352 (0.0008) [2023-12-28 02:01:41,487][106226] Updated weights for policy 0, policy_version 942362 (0.0009) [2023-12-28 02:01:41,982][106225] Updated weights for policy 1, policy_version 944809 (0.0008) [2023-12-28 02:01:42,053][106225] Updated weights for policy 1, policy_version 944819 (0.0006) [2023-12-28 02:01:42,128][106225] Updated weights for policy 1, policy_version 944829 (0.0005) [2023-12-28 02:01:42,231][106226] Updated weights for policy 0, policy_version 942372 (0.0009) [2023-12-28 02:01:42,292][106226] Updated weights for policy 0, policy_version 942382 (0.0007) [2023-12-28 02:01:42,358][106226] Updated weights for policy 0, policy_version 942392 (0.0008) [2023-12-28 02:01:42,792][106225] Updated weights for policy 1, policy_version 944839 (0.0006) [2023-12-28 02:01:42,861][106225] Updated weights for policy 1, policy_version 944849 (0.0007) [2023-12-28 02:01:42,909][106225] Updated weights for policy 1, policy_version 944859 (0.0008) [2023-12-28 02:01:43,016][106226] Updated weights for policy 0, policy_version 942402 (0.0007) [2023-12-28 02:01:43,063][106226] Updated weights for policy 0, policy_version 942412 (0.0007) [2023-12-28 02:01:43,119][106226] Updated weights for policy 0, policy_version 942422 (0.0005) [2023-12-28 02:01:43,171][106226] Updated weights for policy 0, policy_version 942432 (0.0008) [2023-12-28 02:01:43,605][106225] Updated weights for policy 1, policy_version 944869 (0.0006) [2023-12-28 02:01:43,658][106225] Updated weights for policy 1, policy_version 944879 (0.0006) [2023-12-28 02:01:43,704][106225] Updated weights for policy 1, policy_version 944889 (0.0005) [2023-12-28 02:01:43,746][106226] Updated weights for policy 0, policy_version 942442 (0.0005) [2023-12-28 02:01:43,804][106226] Updated weights for policy 0, policy_version 942452 (0.0005) [2023-12-28 02:01:43,864][106226] Updated weights for policy 0, policy_version 942462 (0.0008) [2023-12-28 02:01:44,309][106225] Updated weights for policy 1, policy_version 944899 (0.0007) [2023-12-28 02:01:44,362][106225] Updated weights for policy 1, policy_version 944909 (0.0010) [2023-12-28 02:01:44,418][106225] Updated weights for policy 1, policy_version 944919 (0.0010) [2023-12-28 02:01:44,446][106226] Updated weights for policy 0, policy_version 942472 (0.0010) [2023-12-28 02:01:44,505][106226] Updated weights for policy 0, policy_version 942482 (0.0010) [2023-12-28 02:01:44,559][106226] Updated weights for policy 0, policy_version 942492 (0.0010) [2023-12-28 02:01:45,095][106225] Updated weights for policy 1, policy_version 944929 (0.0008) [2023-12-28 02:01:45,161][106225] Updated weights for policy 1, policy_version 944939 (0.0010) [2023-12-28 02:01:45,226][106225] Updated weights for policy 1, policy_version 944949 (0.0010) [2023-12-28 02:01:45,289][106225] Updated weights for policy 1, policy_version 944959 (0.0011) [2023-12-28 02:01:45,299][106226] Updated weights for policy 0, policy_version 942502 (0.0009) [2023-12-28 02:01:45,360][106226] Updated weights for policy 0, policy_version 942512 (0.0011) [2023-12-28 02:01:45,421][106226] Updated weights for policy 0, policy_version 942522 (0.0010) [2023-12-28 02:01:46,006][106225] Updated weights for policy 1, policy_version 944969 (0.0010) [2023-12-28 02:01:46,060][106225] Updated weights for policy 1, policy_version 944979 (0.0010) [2023-12-28 02:01:46,109][106226] Updated weights for policy 0, policy_version 942532 (0.0008) [2023-12-28 02:01:46,114][106225] Updated weights for policy 1, policy_version 944989 (0.0010) [2023-12-28 02:01:46,164][106226] Updated weights for policy 0, policy_version 942542 (0.0011) [2023-12-28 02:01:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 483303424. Throughput: 0: 9821.0, 1: 10002.0. Samples: 483291708. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:46,176][105115] Avg episode reward: [(0, '-4.730'), (1, '-5.135')] [2023-12-28 02:01:46,212][106226] Updated weights for policy 0, policy_version 942552 (0.0011) [2023-12-28 02:01:46,854][106225] Updated weights for policy 1, policy_version 944999 (0.0006) [2023-12-28 02:01:46,918][106225] Updated weights for policy 1, policy_version 945009 (0.0007) [2023-12-28 02:01:46,934][106226] Updated weights for policy 0, policy_version 942562 (0.0011) [2023-12-28 02:01:46,975][106225] Updated weights for policy 1, policy_version 945019 (0.0009) [2023-12-28 02:01:46,984][106226] Updated weights for policy 0, policy_version 942572 (0.0011) [2023-12-28 02:01:47,035][106226] Updated weights for policy 0, policy_version 942582 (0.0010) [2023-12-28 02:01:47,097][106226] Updated weights for policy 0, policy_version 942592 (0.0007) [2023-12-28 02:01:47,683][106225] Updated weights for policy 1, policy_version 945029 (0.0005) [2023-12-28 02:01:47,735][106225] Updated weights for policy 1, policy_version 945039 (0.0006) [2023-12-28 02:01:47,778][106226] Updated weights for policy 0, policy_version 942602 (0.0011) [2023-12-28 02:01:47,786][106225] Updated weights for policy 1, policy_version 945049 (0.0007) [2023-12-28 02:01:47,845][106226] Updated weights for policy 0, policy_version 942612 (0.0011) [2023-12-28 02:01:47,910][106226] Updated weights for policy 0, policy_version 942622 (0.0010) [2023-12-28 02:01:48,453][106225] Updated weights for policy 1, policy_version 945059 (0.0008) [2023-12-28 02:01:48,513][106225] Updated weights for policy 1, policy_version 945069 (0.0007) [2023-12-28 02:01:48,578][106225] Updated weights for policy 1, policy_version 945079 (0.0008) [2023-12-28 02:01:48,642][106226] Updated weights for policy 0, policy_version 942632 (0.0011) [2023-12-28 02:01:48,698][106226] Updated weights for policy 0, policy_version 942642 (0.0010) [2023-12-28 02:01:48,749][106226] Updated weights for policy 0, policy_version 942652 (0.0007) [2023-12-28 02:01:49,245][106225] Updated weights for policy 1, policy_version 945089 (0.0007) [2023-12-28 02:01:49,301][106225] Updated weights for policy 1, policy_version 945099 (0.0008) [2023-12-28 02:01:49,349][106225] Updated weights for policy 1, policy_version 945109 (0.0008) [2023-12-28 02:01:49,424][106225] Updated weights for policy 1, policy_version 945119 (0.0008) [2023-12-28 02:01:49,470][106226] Updated weights for policy 0, policy_version 942662 (0.0010) [2023-12-28 02:01:49,528][106226] Updated weights for policy 0, policy_version 942672 (0.0011) [2023-12-28 02:01:49,588][106226] Updated weights for policy 0, policy_version 942682 (0.0011) [2023-12-28 02:01:50,230][106225] Updated weights for policy 1, policy_version 945129 (0.0008) [2023-12-28 02:01:50,293][106225] Updated weights for policy 1, policy_version 945139 (0.0008) [2023-12-28 02:01:50,348][106225] Updated weights for policy 1, policy_version 945149 (0.0008) [2023-12-28 02:01:50,377][106226] Updated weights for policy 0, policy_version 942692 (0.0011) [2023-12-28 02:01:50,437][106226] Updated weights for policy 0, policy_version 942702 (0.0011) [2023-12-28 02:01:50,500][106226] Updated weights for policy 0, policy_version 942712 (0.0011) [2023-12-28 02:01:51,114][106225] Updated weights for policy 1, policy_version 945159 (0.0008) [2023-12-28 02:01:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 483393536. Throughput: 0: 9845.1, 1: 9954.4. Samples: 483408296. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:51,176][105115] Avg episode reward: [(0, '-4.316'), (1, '-5.121')] [2023-12-28 02:01:51,178][106225] Updated weights for policy 1, policy_version 945169 (0.0007) [2023-12-28 02:01:51,229][106226] Updated weights for policy 0, policy_version 942722 (0.0010) [2023-12-28 02:01:51,238][106225] Updated weights for policy 1, policy_version 945179 (0.0007) [2023-12-28 02:01:51,291][106226] Updated weights for policy 0, policy_version 942732 (0.0011) [2023-12-28 02:01:51,350][106226] Updated weights for policy 0, policy_version 942742 (0.0011) [2023-12-28 02:01:51,417][106226] Updated weights for policy 0, policy_version 942752 (0.0008) [2023-12-28 02:01:51,958][106225] Updated weights for policy 1, policy_version 945189 (0.0007) [2023-12-28 02:01:52,025][106225] Updated weights for policy 1, policy_version 945199 (0.0009) [2023-12-28 02:01:52,088][106225] Updated weights for policy 1, policy_version 945209 (0.0009) [2023-12-28 02:01:52,122][106226] Updated weights for policy 0, policy_version 942762 (0.0006) [2023-12-28 02:01:52,181][106226] Updated weights for policy 0, policy_version 942772 (0.0009) [2023-12-28 02:01:52,239][106226] Updated weights for policy 0, policy_version 942782 (0.0008) [2023-12-28 02:01:52,848][106226] Updated weights for policy 0, policy_version 942792 (0.0008) [2023-12-28 02:01:52,879][106225] Updated weights for policy 1, policy_version 945219 (0.0009) [2023-12-28 02:01:52,912][106226] Updated weights for policy 0, policy_version 942802 (0.0007) [2023-12-28 02:01:52,937][106225] Updated weights for policy 1, policy_version 945229 (0.0005) [2023-12-28 02:01:52,972][106226] Updated weights for policy 0, policy_version 942812 (0.0007) [2023-12-28 02:01:53,003][106225] Updated weights for policy 1, policy_version 945239 (0.0005) [2023-12-28 02:01:53,613][106225] Updated weights for policy 1, policy_version 945249 (0.0006) [2023-12-28 02:01:53,642][106226] Updated weights for policy 0, policy_version 942822 (0.0009) [2023-12-28 02:01:53,668][106225] Updated weights for policy 1, policy_version 945259 (0.0007) [2023-12-28 02:01:53,689][106226] Updated weights for policy 0, policy_version 942832 (0.0010) [2023-12-28 02:01:53,715][106225] Updated weights for policy 1, policy_version 945269 (0.0006) [2023-12-28 02:01:53,736][106226] Updated weights for policy 0, policy_version 942842 (0.0010) [2023-12-28 02:01:53,777][106225] Updated weights for policy 1, policy_version 945279 (0.0006) [2023-12-28 02:01:54,395][106226] Updated weights for policy 0, policy_version 942852 (0.0009) [2023-12-28 02:01:54,459][106226] Updated weights for policy 0, policy_version 942862 (0.0010) [2023-12-28 02:01:54,515][106225] Updated weights for policy 1, policy_version 945289 (0.0008) [2023-12-28 02:01:54,518][106226] Updated weights for policy 0, policy_version 942872 (0.0010) [2023-12-28 02:01:54,571][106225] Updated weights for policy 1, policy_version 945299 (0.0007) [2023-12-28 02:01:54,618][106225] Updated weights for policy 1, policy_version 945309 (0.0008) [2023-12-28 02:01:55,226][106226] Updated weights for policy 0, policy_version 942882 (0.0011) [2023-12-28 02:01:55,279][106226] Updated weights for policy 0, policy_version 942892 (0.0008) [2023-12-28 02:01:55,331][106226] Updated weights for policy 0, policy_version 942902 (0.0005) [2023-12-28 02:01:55,332][106225] Updated weights for policy 1, policy_version 945319 (0.0008) [2023-12-28 02:01:55,379][106225] Updated weights for policy 1, policy_version 945329 (0.0007) [2023-12-28 02:01:55,388][106226] Updated weights for policy 0, policy_version 942912 (0.0006) [2023-12-28 02:01:55,429][106225] Updated weights for policy 1, policy_version 945339 (0.0008) [2023-12-28 02:01:56,018][106226] Updated weights for policy 0, policy_version 942922 (0.0008) [2023-12-28 02:01:56,071][106226] Updated weights for policy 0, policy_version 942932 (0.0009) [2023-12-28 02:01:56,128][106226] Updated weights for policy 0, policy_version 942942 (0.0008) [2023-12-28 02:01:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 483500032. Throughput: 0: 9884.8, 1: 9956.5. Samples: 483468328. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:01:56,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-4.880')] [2023-12-28 02:01:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000942944_241451008.pth... [2023-12-28 02:01:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000941760_241147904.pth [2023-12-28 02:01:56,198][106225] Updated weights for policy 1, policy_version 945349 (0.0007) [2023-12-28 02:01:56,254][106225] Updated weights for policy 1, policy_version 945359 (0.0007) [2023-12-28 02:01:56,307][106225] Updated weights for policy 1, policy_version 945369 (0.0008) [2023-12-28 02:01:56,338][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000945376_242057216.pth... [2023-12-28 02:01:56,342][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000944192_241754112.pth [2023-12-28 02:01:56,807][106226] Updated weights for policy 0, policy_version 942952 (0.0009) [2023-12-28 02:01:56,852][106226] Updated weights for policy 0, policy_version 942962 (0.0008) [2023-12-28 02:01:56,902][106226] Updated weights for policy 0, policy_version 942972 (0.0009) [2023-12-28 02:01:57,057][106225] Updated weights for policy 1, policy_version 945379 (0.0008) [2023-12-28 02:01:57,105][106225] Updated weights for policy 1, policy_version 945389 (0.0008) [2023-12-28 02:01:57,161][106225] Updated weights for policy 1, policy_version 945399 (0.0008) [2023-12-28 02:01:57,573][106226] Updated weights for policy 0, policy_version 942982 (0.0009) [2023-12-28 02:01:57,630][106226] Updated weights for policy 0, policy_version 942992 (0.0009) [2023-12-28 02:01:57,688][106226] Updated weights for policy 0, policy_version 943002 (0.0008) [2023-12-28 02:01:57,942][106225] Updated weights for policy 1, policy_version 945409 (0.0008) [2023-12-28 02:01:57,992][106225] Updated weights for policy 1, policy_version 945419 (0.0008) [2023-12-28 02:01:58,039][106225] Updated weights for policy 1, policy_version 945429 (0.0008) [2023-12-28 02:01:58,081][106225] Updated weights for policy 1, policy_version 945439 (0.0006) [2023-12-28 02:01:58,457][106226] Updated weights for policy 0, policy_version 943012 (0.0009) [2023-12-28 02:01:58,519][106226] Updated weights for policy 0, policy_version 943022 (0.0011) [2023-12-28 02:01:58,586][106226] Updated weights for policy 0, policy_version 943032 (0.0010) [2023-12-28 02:01:58,875][106225] Updated weights for policy 1, policy_version 945449 (0.0007) [2023-12-28 02:01:58,946][106225] Updated weights for policy 1, policy_version 945459 (0.0008) [2023-12-28 02:01:59,013][106225] Updated weights for policy 1, policy_version 945469 (0.0007) [2023-12-28 02:01:59,404][106226] Updated weights for policy 0, policy_version 943042 (0.0009) [2023-12-28 02:01:59,467][106226] Updated weights for policy 0, policy_version 943052 (0.0010) [2023-12-28 02:01:59,521][106226] Updated weights for policy 0, policy_version 943062 (0.0006) [2023-12-28 02:01:59,577][106226] Updated weights for policy 0, policy_version 943072 (0.0006) [2023-12-28 02:01:59,839][106225] Updated weights for policy 1, policy_version 945479 (0.0008) [2023-12-28 02:01:59,894][106225] Updated weights for policy 1, policy_version 945489 (0.0010) [2023-12-28 02:01:59,955][106225] Updated weights for policy 1, policy_version 945499 (0.0010) [2023-12-28 02:02:00,254][106226] Updated weights for policy 0, policy_version 943082 (0.0006) [2023-12-28 02:02:00,313][106226] Updated weights for policy 0, policy_version 943092 (0.0005) [2023-12-28 02:02:00,374][106226] Updated weights for policy 0, policy_version 943102 (0.0006) [2023-12-28 02:02:00,625][106225] Updated weights for policy 1, policy_version 945509 (0.0010) [2023-12-28 02:02:00,685][106225] Updated weights for policy 1, policy_version 945519 (0.0010) [2023-12-28 02:02:00,744][106225] Updated weights for policy 1, policy_version 945529 (0.0010) [2023-12-28 02:02:01,098][106226] Updated weights for policy 0, policy_version 943112 (0.0008) [2023-12-28 02:02:01,159][106226] Updated weights for policy 0, policy_version 943122 (0.0008) [2023-12-28 02:02:01,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 483590144. Throughput: 0: 9976.1, 1: 9892.4. Samples: 483583232. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:01,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.998')] [2023-12-28 02:02:01,219][106226] Updated weights for policy 0, policy_version 943132 (0.0009) [2023-12-28 02:02:01,472][106225] Updated weights for policy 1, policy_version 945539 (0.0009) [2023-12-28 02:02:01,532][106225] Updated weights for policy 1, policy_version 945549 (0.0008) [2023-12-28 02:02:01,590][106225] Updated weights for policy 1, policy_version 945559 (0.0008) [2023-12-28 02:02:01,970][106226] Updated weights for policy 0, policy_version 943142 (0.0007) [2023-12-28 02:02:02,039][106226] Updated weights for policy 0, policy_version 943152 (0.0005) [2023-12-28 02:02:02,102][106226] Updated weights for policy 0, policy_version 943162 (0.0008) [2023-12-28 02:02:02,348][106225] Updated weights for policy 1, policy_version 945569 (0.0008) [2023-12-28 02:02:02,414][106225] Updated weights for policy 1, policy_version 945579 (0.0009) [2023-12-28 02:02:02,473][106225] Updated weights for policy 1, policy_version 945589 (0.0008) [2023-12-28 02:02:02,532][106225] Updated weights for policy 1, policy_version 945599 (0.0009) [2023-12-28 02:02:02,726][106226] Updated weights for policy 0, policy_version 943172 (0.0009) [2023-12-28 02:02:02,777][106226] Updated weights for policy 0, policy_version 943182 (0.0011) [2023-12-28 02:02:02,827][106226] Updated weights for policy 0, policy_version 943192 (0.0011) [2023-12-28 02:02:03,220][106225] Updated weights for policy 1, policy_version 945609 (0.0008) [2023-12-28 02:02:03,268][106225] Updated weights for policy 1, policy_version 945619 (0.0007) [2023-12-28 02:02:03,321][106225] Updated weights for policy 1, policy_version 945629 (0.0007) [2023-12-28 02:02:03,543][106226] Updated weights for policy 0, policy_version 943202 (0.0007) [2023-12-28 02:02:03,596][106226] Updated weights for policy 0, policy_version 943212 (0.0006) [2023-12-28 02:02:03,651][106226] Updated weights for policy 0, policy_version 943222 (0.0005) [2023-12-28 02:02:03,705][106226] Updated weights for policy 0, policy_version 943232 (0.0006) [2023-12-28 02:02:04,092][106225] Updated weights for policy 1, policy_version 945639 (0.0007) [2023-12-28 02:02:04,152][106225] Updated weights for policy 1, policy_version 945649 (0.0006) [2023-12-28 02:02:04,209][106225] Updated weights for policy 1, policy_version 945659 (0.0006) [2023-12-28 02:02:04,390][106226] Updated weights for policy 0, policy_version 943242 (0.0008) [2023-12-28 02:02:04,447][106226] Updated weights for policy 0, policy_version 943252 (0.0011) [2023-12-28 02:02:04,510][106226] Updated weights for policy 0, policy_version 943262 (0.0010) [2023-12-28 02:02:04,954][106225] Updated weights for policy 1, policy_version 945669 (0.0009) [2023-12-28 02:02:05,039][106225] Updated weights for policy 1, policy_version 945679 (0.0010) [2023-12-28 02:02:05,108][106225] Updated weights for policy 1, policy_version 945689 (0.0008) [2023-12-28 02:02:05,134][106226] Updated weights for policy 0, policy_version 943272 (0.0008) [2023-12-28 02:02:05,184][106226] Updated weights for policy 0, policy_version 943282 (0.0010) [2023-12-28 02:02:05,234][106226] Updated weights for policy 0, policy_version 943292 (0.0010) [2023-12-28 02:02:05,818][106225] Updated weights for policy 1, policy_version 945699 (0.0006) [2023-12-28 02:02:05,871][106225] Updated weights for policy 1, policy_version 945709 (0.0008) [2023-12-28 02:02:05,917][106225] Updated weights for policy 1, policy_version 945719 (0.0007) [2023-12-28 02:02:05,952][106226] Updated weights for policy 0, policy_version 943302 (0.0010) [2023-12-28 02:02:06,008][106226] Updated weights for policy 0, policy_version 943312 (0.0010) [2023-12-28 02:02:06,066][106226] Updated weights for policy 0, policy_version 943322 (0.0010) [2023-12-28 02:02:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 483696640. Throughput: 0: 10034.7, 1: 9832.4. Samples: 483700124. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:06,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.926')] [2023-12-28 02:02:06,640][106225] Updated weights for policy 1, policy_version 945729 (0.0007) [2023-12-28 02:02:06,702][106225] Updated weights for policy 1, policy_version 945739 (0.0008) [2023-12-28 02:02:06,766][106225] Updated weights for policy 1, policy_version 945749 (0.0008) [2023-12-28 02:02:06,831][106225] Updated weights for policy 1, policy_version 945759 (0.0007) [2023-12-28 02:02:06,845][106226] Updated weights for policy 0, policy_version 943332 (0.0008) [2023-12-28 02:02:06,909][106226] Updated weights for policy 0, policy_version 943342 (0.0008) [2023-12-28 02:02:06,955][106226] Updated weights for policy 0, policy_version 943352 (0.0008) [2023-12-28 02:02:07,562][106225] Updated weights for policy 1, policy_version 945769 (0.0010) [2023-12-28 02:02:07,624][106225] Updated weights for policy 1, policy_version 945779 (0.0009) [2023-12-28 02:02:07,684][106225] Updated weights for policy 1, policy_version 945789 (0.0006) [2023-12-28 02:02:07,695][106226] Updated weights for policy 0, policy_version 943362 (0.0008) [2023-12-28 02:02:07,747][106226] Updated weights for policy 0, policy_version 943372 (0.0009) [2023-12-28 02:02:07,807][106226] Updated weights for policy 0, policy_version 943382 (0.0010) [2023-12-28 02:02:07,856][106226] Updated weights for policy 0, policy_version 943392 (0.0010) [2023-12-28 02:02:08,392][106225] Updated weights for policy 1, policy_version 945799 (0.0010) [2023-12-28 02:02:08,455][106225] Updated weights for policy 1, policy_version 945809 (0.0010) [2023-12-28 02:02:08,516][106225] Updated weights for policy 1, policy_version 945819 (0.0010) [2023-12-28 02:02:08,571][106226] Updated weights for policy 0, policy_version 943402 (0.0007) [2023-12-28 02:02:08,637][106226] Updated weights for policy 0, policy_version 943412 (0.0008) [2023-12-28 02:02:08,702][106226] Updated weights for policy 0, policy_version 943422 (0.0008) [2023-12-28 02:02:09,199][106225] Updated weights for policy 1, policy_version 945829 (0.0010) [2023-12-28 02:02:09,263][106225] Updated weights for policy 1, policy_version 945839 (0.0010) [2023-12-28 02:02:09,315][106225] Updated weights for policy 1, policy_version 945849 (0.0010) [2023-12-28 02:02:09,432][106226] Updated weights for policy 0, policy_version 943432 (0.0009) [2023-12-28 02:02:09,492][106226] Updated weights for policy 0, policy_version 943442 (0.0009) [2023-12-28 02:02:09,557][106226] Updated weights for policy 0, policy_version 943452 (0.0009) [2023-12-28 02:02:10,069][106225] Updated weights for policy 1, policy_version 945859 (0.0010) [2023-12-28 02:02:10,118][106225] Updated weights for policy 1, policy_version 945869 (0.0008) [2023-12-28 02:02:10,172][106225] Updated weights for policy 1, policy_version 945879 (0.0009) [2023-12-28 02:02:10,280][106226] Updated weights for policy 0, policy_version 943462 (0.0007) [2023-12-28 02:02:10,338][106226] Updated weights for policy 0, policy_version 943472 (0.0008) [2023-12-28 02:02:10,394][106226] Updated weights for policy 0, policy_version 943482 (0.0008) [2023-12-28 02:02:10,831][106225] Updated weights for policy 1, policy_version 945889 (0.0011) [2023-12-28 02:02:10,888][106225] Updated weights for policy 1, policy_version 945899 (0.0010) [2023-12-28 02:02:10,947][106225] Updated weights for policy 1, policy_version 945909 (0.0010) [2023-12-28 02:02:11,004][106225] Updated weights for policy 1, policy_version 945919 (0.0010) [2023-12-28 02:02:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 483786752. Throughput: 0: 10046.7, 1: 9861.7. Samples: 483757516. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:11,175][106226] Updated weights for policy 0, policy_version 943492 (0.0008) [2023-12-28 02:02:11,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-5.000')] [2023-12-28 02:02:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000945920_242196480.pth... [2023-12-28 02:02:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000944800_241909760.pth [2023-12-28 02:02:11,240][106226] Updated weights for policy 0, policy_version 943502 (0.0006) [2023-12-28 02:02:11,305][106226] Updated weights for policy 0, policy_version 943512 (0.0007) [2023-12-28 02:02:11,358][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000943520_241598464.pth... [2023-12-28 02:02:11,363][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000942336_241295360.pth [2023-12-28 02:02:11,819][106225] Updated weights for policy 1, policy_version 945929 (0.0008) [2023-12-28 02:02:11,891][106225] Updated weights for policy 1, policy_version 945939 (0.0008) [2023-12-28 02:02:11,961][106225] Updated weights for policy 1, policy_version 945949 (0.0008) [2023-12-28 02:02:12,007][106226] Updated weights for policy 0, policy_version 943522 (0.0006) [2023-12-28 02:02:12,072][106226] Updated weights for policy 0, policy_version 943532 (0.0008) [2023-12-28 02:02:12,136][106226] Updated weights for policy 0, policy_version 943542 (0.0009) [2023-12-28 02:02:12,197][106226] Updated weights for policy 0, policy_version 943552 (0.0009) [2023-12-28 02:02:12,649][106225] Updated weights for policy 1, policy_version 945959 (0.0008) [2023-12-28 02:02:12,704][106225] Updated weights for policy 1, policy_version 945969 (0.0008) [2023-12-28 02:02:12,766][106225] Updated weights for policy 1, policy_version 945979 (0.0006) [2023-12-28 02:02:13,030][106226] Updated weights for policy 0, policy_version 943562 (0.0010) [2023-12-28 02:02:13,096][106226] Updated weights for policy 0, policy_version 943572 (0.0010) [2023-12-28 02:02:13,154][106226] Updated weights for policy 0, policy_version 943582 (0.0009) [2023-12-28 02:02:13,346][106225] Updated weights for policy 1, policy_version 945989 (0.0005) [2023-12-28 02:02:13,406][106225] Updated weights for policy 1, policy_version 945999 (0.0008) [2023-12-28 02:02:13,459][106225] Updated weights for policy 1, policy_version 946009 (0.0006) [2023-12-28 02:02:13,848][106226] Updated weights for policy 0, policy_version 943592 (0.0007) [2023-12-28 02:02:13,901][106226] Updated weights for policy 0, policy_version 943602 (0.0005) [2023-12-28 02:02:13,953][106226] Updated weights for policy 0, policy_version 943612 (0.0005) [2023-12-28 02:02:14,014][106225] Updated weights for policy 1, policy_version 946019 (0.0008) [2023-12-28 02:02:14,067][106225] Updated weights for policy 1, policy_version 946029 (0.0009) [2023-12-28 02:02:14,133][106225] Updated weights for policy 1, policy_version 946039 (0.0007) [2023-12-28 02:02:14,597][106226] Updated weights for policy 0, policy_version 943622 (0.0005) [2023-12-28 02:02:14,650][106226] Updated weights for policy 0, policy_version 943632 (0.0006) [2023-12-28 02:02:14,679][106225] Updated weights for policy 1, policy_version 946049 (0.0006) [2023-12-28 02:02:14,701][106226] Updated weights for policy 0, policy_version 943642 (0.0007) [2023-12-28 02:02:14,728][106225] Updated weights for policy 1, policy_version 946059 (0.0006) [2023-12-28 02:02:14,797][106225] Updated weights for policy 1, policy_version 946069 (0.0008) [2023-12-28 02:02:14,855][106225] Updated weights for policy 1, policy_version 946079 (0.0008) [2023-12-28 02:02:15,490][106226] Updated weights for policy 0, policy_version 943652 (0.0008) [2023-12-28 02:02:15,516][106225] Updated weights for policy 1, policy_version 946089 (0.0005) [2023-12-28 02:02:15,536][106226] Updated weights for policy 0, policy_version 943662 (0.0008) [2023-12-28 02:02:15,564][106225] Updated weights for policy 1, policy_version 946099 (0.0005) [2023-12-28 02:02:15,583][106226] Updated weights for policy 0, policy_version 943672 (0.0008) [2023-12-28 02:02:15,618][106225] Updated weights for policy 1, policy_version 946109 (0.0007) [2023-12-28 02:02:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 483885056. Throughput: 0: 9904.0, 1: 9888.5. Samples: 483876768. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:16,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-4.833')] [2023-12-28 02:02:16,288][106225] Updated weights for policy 1, policy_version 946119 (0.0007) [2023-12-28 02:02:16,339][106226] Updated weights for policy 0, policy_version 943682 (0.0008) [2023-12-28 02:02:16,344][106225] Updated weights for policy 1, policy_version 946129 (0.0005) [2023-12-28 02:02:16,401][106226] Updated weights for policy 0, policy_version 943692 (0.0011) [2023-12-28 02:02:16,404][106225] Updated weights for policy 1, policy_version 946139 (0.0007) [2023-12-28 02:02:16,463][106226] Updated weights for policy 0, policy_version 943702 (0.0011) [2023-12-28 02:02:16,521][106226] Updated weights for policy 0, policy_version 943712 (0.0011) [2023-12-28 02:02:17,012][106225] Updated weights for policy 1, policy_version 946149 (0.0007) [2023-12-28 02:02:17,075][106225] Updated weights for policy 1, policy_version 946159 (0.0010) [2023-12-28 02:02:17,098][106226] Updated weights for policy 0, policy_version 943722 (0.0010) [2023-12-28 02:02:17,141][106225] Updated weights for policy 1, policy_version 946169 (0.0011) [2023-12-28 02:02:17,153][106226] Updated weights for policy 0, policy_version 943732 (0.0007) [2023-12-28 02:02:17,210][106226] Updated weights for policy 0, policy_version 943742 (0.0005) [2023-12-28 02:02:17,758][106225] Updated weights for policy 1, policy_version 946179 (0.0010) [2023-12-28 02:02:17,790][106226] Updated weights for policy 0, policy_version 943752 (0.0007) [2023-12-28 02:02:17,817][106225] Updated weights for policy 1, policy_version 946189 (0.0009) [2023-12-28 02:02:17,852][106226] Updated weights for policy 0, policy_version 943762 (0.0007) [2023-12-28 02:02:17,866][106225] Updated weights for policy 1, policy_version 946199 (0.0005) [2023-12-28 02:02:17,922][106226] Updated weights for policy 0, policy_version 943772 (0.0008) [2023-12-28 02:02:18,514][106226] Updated weights for policy 0, policy_version 943782 (0.0008) [2023-12-28 02:02:18,563][106226] Updated weights for policy 0, policy_version 943792 (0.0011) [2023-12-28 02:02:18,568][106225] Updated weights for policy 1, policy_version 946209 (0.0006) [2023-12-28 02:02:18,616][106226] Updated weights for policy 0, policy_version 943802 (0.0010) [2023-12-28 02:02:18,619][106225] Updated weights for policy 1, policy_version 946219 (0.0010) [2023-12-28 02:02:18,670][106225] Updated weights for policy 1, policy_version 946229 (0.0010) [2023-12-28 02:02:18,725][106225] Updated weights for policy 1, policy_version 946239 (0.0010) [2023-12-28 02:02:19,227][106226] Updated weights for policy 0, policy_version 943812 (0.0009) [2023-12-28 02:02:19,296][106226] Updated weights for policy 0, policy_version 943822 (0.0006) [2023-12-28 02:02:19,364][106226] Updated weights for policy 0, policy_version 943832 (0.0007) [2023-12-28 02:02:19,377][106225] Updated weights for policy 1, policy_version 946249 (0.0008) [2023-12-28 02:02:19,441][106225] Updated weights for policy 1, policy_version 946259 (0.0008) [2023-12-28 02:02:19,504][106225] Updated weights for policy 1, policy_version 946269 (0.0008) [2023-12-28 02:02:20,014][106226] Updated weights for policy 0, policy_version 943842 (0.0008) [2023-12-28 02:02:20,071][106226] Updated weights for policy 0, policy_version 943852 (0.0009) [2023-12-28 02:02:20,139][106226] Updated weights for policy 0, policy_version 943862 (0.0008) [2023-12-28 02:02:20,205][106226] Updated weights for policy 0, policy_version 943872 (0.0011) [2023-12-28 02:02:20,359][106225] Updated weights for policy 1, policy_version 946279 (0.0008) [2023-12-28 02:02:20,423][106225] Updated weights for policy 1, policy_version 946289 (0.0007) [2023-12-28 02:02:20,480][106225] Updated weights for policy 1, policy_version 946299 (0.0008) [2023-12-28 02:02:20,857][106226] Updated weights for policy 0, policy_version 943882 (0.0008) [2023-12-28 02:02:20,912][106226] Updated weights for policy 0, policy_version 943892 (0.0008) [2023-12-28 02:02:20,975][106226] Updated weights for policy 0, policy_version 943902 (0.0008) [2023-12-28 02:02:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 483991552. Throughput: 0: 9953.5, 1: 9857.9. Samples: 484000328. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:21,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.767')] [2023-12-28 02:02:21,247][106225] Updated weights for policy 1, policy_version 946309 (0.0009) [2023-12-28 02:02:21,316][106225] Updated weights for policy 1, policy_version 946319 (0.0011) [2023-12-28 02:02:21,385][106225] Updated weights for policy 1, policy_version 946329 (0.0009) [2023-12-28 02:02:21,749][106226] Updated weights for policy 0, policy_version 943912 (0.0009) [2023-12-28 02:02:21,815][106226] Updated weights for policy 0, policy_version 943922 (0.0008) [2023-12-28 02:02:21,883][106226] Updated weights for policy 0, policy_version 943932 (0.0006) [2023-12-28 02:02:22,125][106225] Updated weights for policy 1, policy_version 946339 (0.0009) [2023-12-28 02:02:22,182][106225] Updated weights for policy 1, policy_version 946349 (0.0010) [2023-12-28 02:02:22,235][106225] Updated weights for policy 1, policy_version 946359 (0.0010) [2023-12-28 02:02:22,526][106226] Updated weights for policy 0, policy_version 943942 (0.0007) [2023-12-28 02:02:22,588][106226] Updated weights for policy 0, policy_version 943952 (0.0008) [2023-12-28 02:02:22,652][106226] Updated weights for policy 0, policy_version 943962 (0.0008) [2023-12-28 02:02:22,942][106225] Updated weights for policy 1, policy_version 946369 (0.0007) [2023-12-28 02:02:22,999][106225] Updated weights for policy 1, policy_version 946379 (0.0005) [2023-12-28 02:02:23,054][106225] Updated weights for policy 1, policy_version 946389 (0.0006) [2023-12-28 02:02:23,116][106225] Updated weights for policy 1, policy_version 946399 (0.0005) [2023-12-28 02:02:23,379][106226] Updated weights for policy 0, policy_version 943972 (0.0007) [2023-12-28 02:02:23,437][106226] Updated weights for policy 0, policy_version 943982 (0.0005) [2023-12-28 02:02:23,490][106226] Updated weights for policy 0, policy_version 943992 (0.0005) [2023-12-28 02:02:23,757][106225] Updated weights for policy 1, policy_version 946409 (0.0010) [2023-12-28 02:02:23,817][106225] Updated weights for policy 1, policy_version 946419 (0.0010) [2023-12-28 02:02:23,869][106225] Updated weights for policy 1, policy_version 946429 (0.0008) [2023-12-28 02:02:24,072][106226] Updated weights for policy 0, policy_version 944002 (0.0008) [2023-12-28 02:02:24,129][106226] Updated weights for policy 0, policy_version 944012 (0.0010) [2023-12-28 02:02:24,188][106226] Updated weights for policy 0, policy_version 944022 (0.0010) [2023-12-28 02:02:24,245][106226] Updated weights for policy 0, policy_version 944032 (0.0009) [2023-12-28 02:02:24,517][106225] Updated weights for policy 1, policy_version 946439 (0.0007) [2023-12-28 02:02:24,585][106225] Updated weights for policy 1, policy_version 946449 (0.0007) [2023-12-28 02:02:24,651][106225] Updated weights for policy 1, policy_version 946459 (0.0007) [2023-12-28 02:02:24,908][106226] Updated weights for policy 0, policy_version 944042 (0.0005) [2023-12-28 02:02:24,962][106226] Updated weights for policy 0, policy_version 944052 (0.0005) [2023-12-28 02:02:25,021][106226] Updated weights for policy 0, policy_version 944062 (0.0006) [2023-12-28 02:02:25,408][106225] Updated weights for policy 1, policy_version 946469 (0.0009) [2023-12-28 02:02:25,476][106225] Updated weights for policy 1, policy_version 946479 (0.0009) [2023-12-28 02:02:25,523][106225] Updated weights for policy 1, policy_version 946489 (0.0008) [2023-12-28 02:02:25,564][106226] Updated weights for policy 0, policy_version 944072 (0.0007) [2023-12-28 02:02:25,626][106226] Updated weights for policy 0, policy_version 944082 (0.0009) [2023-12-28 02:02:25,683][106226] Updated weights for policy 0, policy_version 944092 (0.0009) [2023-12-28 02:02:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 484089856. Throughput: 0: 9984.5, 1: 9803.9. Samples: 484060748. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:26,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-4.889')] [2023-12-28 02:02:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000946496_242343936.pth... [2023-12-28 02:02:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000944096_241745920.pth... [2023-12-28 02:02:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000942944_241451008.pth [2023-12-28 02:02:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000945376_242057216.pth [2023-12-28 02:02:26,241][106225] Updated weights for policy 1, policy_version 946499 (0.0009) [2023-12-28 02:02:26,288][106225] Updated weights for policy 1, policy_version 946509 (0.0008) [2023-12-28 02:02:26,342][106225] Updated weights for policy 1, policy_version 946519 (0.0007) [2023-12-28 02:02:26,431][106226] Updated weights for policy 0, policy_version 944102 (0.0007) [2023-12-28 02:02:26,475][106226] Updated weights for policy 0, policy_version 944112 (0.0005) [2023-12-28 02:02:26,524][106226] Updated weights for policy 0, policy_version 944122 (0.0005) [2023-12-28 02:02:27,032][106225] Updated weights for policy 1, policy_version 946529 (0.0006) [2023-12-28 02:02:27,068][106226] Updated weights for policy 0, policy_version 944132 (0.0006) [2023-12-28 02:02:27,089][106225] Updated weights for policy 1, policy_version 946539 (0.0010) [2023-12-28 02:02:27,119][106226] Updated weights for policy 0, policy_version 944142 (0.0005) [2023-12-28 02:02:27,139][106225] Updated weights for policy 1, policy_version 946549 (0.0010) [2023-12-28 02:02:27,173][106226] Updated weights for policy 0, policy_version 944152 (0.0008) [2023-12-28 02:02:27,194][106225] Updated weights for policy 1, policy_version 946559 (0.0010) [2023-12-28 02:02:27,857][106226] Updated weights for policy 0, policy_version 944162 (0.0010) [2023-12-28 02:02:27,910][106225] Updated weights for policy 1, policy_version 946569 (0.0010) [2023-12-28 02:02:27,915][106226] Updated weights for policy 0, policy_version 944172 (0.0009) [2023-12-28 02:02:27,970][106225] Updated weights for policy 1, policy_version 946579 (0.0009) [2023-12-28 02:02:27,973][106226] Updated weights for policy 0, policy_version 944182 (0.0009) [2023-12-28 02:02:28,031][106225] Updated weights for policy 1, policy_version 946589 (0.0010) [2023-12-28 02:02:28,031][106226] Updated weights for policy 0, policy_version 944192 (0.0011) [2023-12-28 02:02:28,678][106226] Updated weights for policy 0, policy_version 944202 (0.0010) [2023-12-28 02:02:28,730][106226] Updated weights for policy 0, policy_version 944212 (0.0008) [2023-12-28 02:02:28,737][106225] Updated weights for policy 1, policy_version 946599 (0.0010) [2023-12-28 02:02:28,790][106226] Updated weights for policy 0, policy_version 944222 (0.0005) [2023-12-28 02:02:28,798][106225] Updated weights for policy 1, policy_version 946609 (0.0010) [2023-12-28 02:02:28,859][106225] Updated weights for policy 1, policy_version 946619 (0.0010) [2023-12-28 02:02:29,346][106226] Updated weights for policy 0, policy_version 944232 (0.0008) [2023-12-28 02:02:29,406][106226] Updated weights for policy 0, policy_version 944242 (0.0010) [2023-12-28 02:02:29,468][106226] Updated weights for policy 0, policy_version 944252 (0.0009) [2023-12-28 02:02:29,564][106225] Updated weights for policy 1, policy_version 946629 (0.0008) [2023-12-28 02:02:29,620][106225] Updated weights for policy 1, policy_version 946639 (0.0007) [2023-12-28 02:02:29,677][106225] Updated weights for policy 1, policy_version 946649 (0.0006) [2023-12-28 02:02:30,116][106226] Updated weights for policy 0, policy_version 944262 (0.0009) [2023-12-28 02:02:30,176][106226] Updated weights for policy 0, policy_version 944272 (0.0010) [2023-12-28 02:02:30,230][106226] Updated weights for policy 0, policy_version 944282 (0.0010) [2023-12-28 02:02:30,328][106225] Updated weights for policy 1, policy_version 946659 (0.0006) [2023-12-28 02:02:30,376][106225] Updated weights for policy 1, policy_version 946669 (0.0007) [2023-12-28 02:02:30,426][106225] Updated weights for policy 1, policy_version 946679 (0.0008) [2023-12-28 02:02:30,939][106226] Updated weights for policy 0, policy_version 944292 (0.0010) [2023-12-28 02:02:30,986][106226] Updated weights for policy 0, policy_version 944302 (0.0010) [2023-12-28 02:02:31,035][106226] Updated weights for policy 0, policy_version 944312 (0.0009) [2023-12-28 02:02:31,076][106225] Updated weights for policy 1, policy_version 946689 (0.0007) [2023-12-28 02:02:31,142][106225] Updated weights for policy 1, policy_version 946699 (0.0006) [2023-12-28 02:02:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 484196352. Throughput: 0: 10063.5, 1: 9785.6. Samples: 484184916. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:31,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.089')] [2023-12-28 02:02:31,200][106225] Updated weights for policy 1, policy_version 946709 (0.0008) [2023-12-28 02:02:31,258][106225] Updated weights for policy 1, policy_version 946719 (0.0008) [2023-12-28 02:02:31,761][106226] Updated weights for policy 0, policy_version 944322 (0.0010) [2023-12-28 02:02:31,815][106226] Updated weights for policy 0, policy_version 944332 (0.0010) [2023-12-28 02:02:31,865][106226] Updated weights for policy 0, policy_version 944342 (0.0010) [2023-12-28 02:02:31,922][106226] Updated weights for policy 0, policy_version 944352 (0.0010) [2023-12-28 02:02:32,050][106225] Updated weights for policy 1, policy_version 946729 (0.0008) [2023-12-28 02:02:32,110][106225] Updated weights for policy 1, policy_version 946739 (0.0008) [2023-12-28 02:02:32,168][106225] Updated weights for policy 1, policy_version 946749 (0.0007) [2023-12-28 02:02:32,640][106226] Updated weights for policy 0, policy_version 944362 (0.0010) [2023-12-28 02:02:32,701][106226] Updated weights for policy 0, policy_version 944372 (0.0011) [2023-12-28 02:02:32,761][106226] Updated weights for policy 0, policy_version 944382 (0.0010) [2023-12-28 02:02:32,881][106225] Updated weights for policy 1, policy_version 946759 (0.0007) [2023-12-28 02:02:32,942][106225] Updated weights for policy 1, policy_version 946769 (0.0007) [2023-12-28 02:02:33,000][106225] Updated weights for policy 1, policy_version 946779 (0.0008) [2023-12-28 02:02:33,370][106226] Updated weights for policy 0, policy_version 944392 (0.0006) [2023-12-28 02:02:33,430][106226] Updated weights for policy 0, policy_version 944402 (0.0005) [2023-12-28 02:02:33,485][106226] Updated weights for policy 0, policy_version 944412 (0.0005) [2023-12-28 02:02:33,668][106225] Updated weights for policy 1, policy_version 946789 (0.0006) [2023-12-28 02:02:33,713][106225] Updated weights for policy 1, policy_version 946799 (0.0005) [2023-12-28 02:02:33,760][106225] Updated weights for policy 1, policy_version 946809 (0.0005) [2023-12-28 02:02:34,049][106226] Updated weights for policy 0, policy_version 944422 (0.0008) [2023-12-28 02:02:34,101][106226] Updated weights for policy 0, policy_version 944432 (0.0010) [2023-12-28 02:02:34,170][106226] Updated weights for policy 0, policy_version 944442 (0.0008) [2023-12-28 02:02:34,395][106225] Updated weights for policy 1, policy_version 946819 (0.0007) [2023-12-28 02:02:34,460][106225] Updated weights for policy 1, policy_version 946829 (0.0008) [2023-12-28 02:02:34,526][106225] Updated weights for policy 1, policy_version 946839 (0.0008) [2023-12-28 02:02:34,873][106226] Updated weights for policy 0, policy_version 944452 (0.0010) [2023-12-28 02:02:34,929][106226] Updated weights for policy 0, policy_version 944462 (0.0010) [2023-12-28 02:02:34,979][106226] Updated weights for policy 0, policy_version 944472 (0.0010) [2023-12-28 02:02:35,092][106225] Updated weights for policy 1, policy_version 946849 (0.0008) [2023-12-28 02:02:35,155][106225] Updated weights for policy 1, policy_version 946859 (0.0008) [2023-12-28 02:02:35,221][106225] Updated weights for policy 1, policy_version 946869 (0.0008) [2023-12-28 02:02:35,285][106225] Updated weights for policy 1, policy_version 946879 (0.0008) [2023-12-28 02:02:35,641][106226] Updated weights for policy 0, policy_version 944482 (0.0011) [2023-12-28 02:02:35,691][106226] Updated weights for policy 0, policy_version 944492 (0.0010) [2023-12-28 02:02:35,741][106226] Updated weights for policy 0, policy_version 944502 (0.0010) [2023-12-28 02:02:35,792][106226] Updated weights for policy 0, policy_version 944512 (0.0007) [2023-12-28 02:02:35,853][106225] Updated weights for policy 1, policy_version 946889 (0.0005) [2023-12-28 02:02:35,909][106225] Updated weights for policy 1, policy_version 946899 (0.0006) [2023-12-28 02:02:35,954][106225] Updated weights for policy 1, policy_version 946909 (0.0007) [2023-12-28 02:02:36,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 484302848. Throughput: 0: 10137.1, 1: 9878.7. Samples: 484309004. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:36,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.979')] [2023-12-28 02:02:36,534][106226] Updated weights for policy 0, policy_version 944522 (0.0010) [2023-12-28 02:02:36,572][106225] Updated weights for policy 1, policy_version 946919 (0.0008) [2023-12-28 02:02:36,596][106226] Updated weights for policy 0, policy_version 944532 (0.0011) [2023-12-28 02:02:36,636][106225] Updated weights for policy 1, policy_version 946929 (0.0010) [2023-12-28 02:02:36,667][106226] Updated weights for policy 0, policy_version 944542 (0.0010) [2023-12-28 02:02:36,703][106225] Updated weights for policy 1, policy_version 946939 (0.0010) [2023-12-28 02:02:37,333][106226] Updated weights for policy 0, policy_version 944552 (0.0009) [2023-12-28 02:02:37,368][106225] Updated weights for policy 1, policy_version 946949 (0.0009) [2023-12-28 02:02:37,379][106226] Updated weights for policy 0, policy_version 944562 (0.0005) [2023-12-28 02:02:37,417][106225] Updated weights for policy 1, policy_version 946959 (0.0006) [2023-12-28 02:02:37,430][106226] Updated weights for policy 0, policy_version 944572 (0.0011) [2023-12-28 02:02:37,475][106225] Updated weights for policy 1, policy_version 946969 (0.0008) [2023-12-28 02:02:38,103][106226] Updated weights for policy 0, policy_version 944582 (0.0007) [2023-12-28 02:02:38,149][106226] Updated weights for policy 0, policy_version 944592 (0.0005) [2023-12-28 02:02:38,203][106226] Updated weights for policy 0, policy_version 944602 (0.0005) [2023-12-28 02:02:38,247][106225] Updated weights for policy 1, policy_version 946979 (0.0010) [2023-12-28 02:02:38,303][106225] Updated weights for policy 1, policy_version 946989 (0.0009) [2023-12-28 02:02:38,367][106225] Updated weights for policy 1, policy_version 946999 (0.0008) [2023-12-28 02:02:38,836][106226] Updated weights for policy 0, policy_version 944612 (0.0007) [2023-12-28 02:02:38,889][106226] Updated weights for policy 0, policy_version 944622 (0.0009) [2023-12-28 02:02:38,938][106226] Updated weights for policy 0, policy_version 944632 (0.0009) [2023-12-28 02:02:39,112][106225] Updated weights for policy 1, policy_version 947009 (0.0006) [2023-12-28 02:02:39,170][106225] Updated weights for policy 1, policy_version 947019 (0.0008) [2023-12-28 02:02:39,230][106225] Updated weights for policy 1, policy_version 947029 (0.0008) [2023-12-28 02:02:39,293][106225] Updated weights for policy 1, policy_version 947039 (0.0009) [2023-12-28 02:02:39,759][106226] Updated weights for policy 0, policy_version 944642 (0.0008) [2023-12-28 02:02:39,822][106226] Updated weights for policy 0, policy_version 944652 (0.0009) [2023-12-28 02:02:39,892][106226] Updated weights for policy 0, policy_version 944662 (0.0010) [2023-12-28 02:02:39,961][106226] Updated weights for policy 0, policy_version 944672 (0.0009) [2023-12-28 02:02:40,064][106225] Updated weights for policy 1, policy_version 947049 (0.0009) [2023-12-28 02:02:40,122][106225] Updated weights for policy 1, policy_version 947059 (0.0008) [2023-12-28 02:02:40,182][106225] Updated weights for policy 1, policy_version 947069 (0.0008) [2023-12-28 02:02:40,717][106226] Updated weights for policy 0, policy_version 944682 (0.0009) [2023-12-28 02:02:40,778][106226] Updated weights for policy 0, policy_version 944692 (0.0009) [2023-12-28 02:02:40,826][106226] Updated weights for policy 0, policy_version 944702 (0.0009) [2023-12-28 02:02:40,942][106225] Updated weights for policy 1, policy_version 947079 (0.0009) [2023-12-28 02:02:41,003][106225] Updated weights for policy 1, policy_version 947089 (0.0009) [2023-12-28 02:02:41,068][106225] Updated weights for policy 1, policy_version 947099 (0.0006) [2023-12-28 02:02:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.5, 300 sec: 19716.3). Total num frames: 484401152. Throughput: 0: 10114.1, 1: 9905.2. Samples: 484369200. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:41,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-4.649')] [2023-12-28 02:02:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000947104_242499584.pth... [2023-12-28 02:02:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000944704_241901568.pth... [2023-12-28 02:02:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000945920_242196480.pth [2023-12-28 02:02:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000943520_241598464.pth [2023-12-28 02:02:41,636][106226] Updated weights for policy 0, policy_version 944712 (0.0008) [2023-12-28 02:02:41,706][106226] Updated weights for policy 0, policy_version 944722 (0.0008) [2023-12-28 02:02:41,776][106226] Updated weights for policy 0, policy_version 944732 (0.0010) [2023-12-28 02:02:41,874][106225] Updated weights for policy 1, policy_version 947109 (0.0008) [2023-12-28 02:02:41,931][106225] Updated weights for policy 1, policy_version 947119 (0.0005) [2023-12-28 02:02:41,993][106225] Updated weights for policy 1, policy_version 947129 (0.0008) [2023-12-28 02:02:42,543][106226] Updated weights for policy 0, policy_version 944742 (0.0009) [2023-12-28 02:02:42,592][106226] Updated weights for policy 0, policy_version 944752 (0.0009) [2023-12-28 02:02:42,645][106226] Updated weights for policy 0, policy_version 944762 (0.0008) [2023-12-28 02:02:42,716][106225] Updated weights for policy 1, policy_version 947139 (0.0010) [2023-12-28 02:02:42,765][106225] Updated weights for policy 1, policy_version 947149 (0.0008) [2023-12-28 02:02:42,814][106225] Updated weights for policy 1, policy_version 947159 (0.0008) [2023-12-28 02:02:43,388][106226] Updated weights for policy 0, policy_version 944772 (0.0008) [2023-12-28 02:02:43,451][106226] Updated weights for policy 0, policy_version 944782 (0.0009) [2023-12-28 02:02:43,509][106226] Updated weights for policy 0, policy_version 944792 (0.0008) [2023-12-28 02:02:43,568][106225] Updated weights for policy 1, policy_version 947169 (0.0008) [2023-12-28 02:02:43,630][106225] Updated weights for policy 1, policy_version 947179 (0.0008) [2023-12-28 02:02:43,696][106225] Updated weights for policy 1, policy_version 947189 (0.0007) [2023-12-28 02:02:43,751][106225] Updated weights for policy 1, policy_version 947199 (0.0008) [2023-12-28 02:02:44,258][106226] Updated weights for policy 0, policy_version 944802 (0.0009) [2023-12-28 02:02:44,308][106226] Updated weights for policy 0, policy_version 944812 (0.0009) [2023-12-28 02:02:44,358][106226] Updated weights for policy 0, policy_version 944822 (0.0007) [2023-12-28 02:02:44,384][106225] Updated weights for policy 1, policy_version 947209 (0.0006) [2023-12-28 02:02:44,421][106226] Updated weights for policy 0, policy_version 944832 (0.0008) [2023-12-28 02:02:44,435][106225] Updated weights for policy 1, policy_version 947219 (0.0008) [2023-12-28 02:02:44,483][106225] Updated weights for policy 1, policy_version 947229 (0.0008) [2023-12-28 02:02:45,195][106226] Updated weights for policy 0, policy_version 944842 (0.0008) [2023-12-28 02:02:45,238][106225] Updated weights for policy 1, policy_version 947239 (0.0007) [2023-12-28 02:02:45,257][106226] Updated weights for policy 0, policy_version 944852 (0.0008) [2023-12-28 02:02:45,292][106225] Updated weights for policy 1, policy_version 947249 (0.0009) [2023-12-28 02:02:45,306][106226] Updated weights for policy 0, policy_version 944862 (0.0009) [2023-12-28 02:02:45,345][106225] Updated weights for policy 1, policy_version 947259 (0.0007) [2023-12-28 02:02:46,047][106226] Updated weights for policy 0, policy_version 944872 (0.0008) [2023-12-28 02:02:46,070][106225] Updated weights for policy 1, policy_version 947269 (0.0008) [2023-12-28 02:02:46,090][106226] Updated weights for policy 0, policy_version 944882 (0.0006) [2023-12-28 02:02:46,121][106225] Updated weights for policy 1, policy_version 947279 (0.0007) [2023-12-28 02:02:46,141][106226] Updated weights for policy 0, policy_version 944892 (0.0008) [2023-12-28 02:02:46,172][106225] Updated weights for policy 1, policy_version 947289 (0.0008) [2023-12-28 02:02:46,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 484491264. Throughput: 0: 10022.0, 1: 9932.9. Samples: 484481200. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:46,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.984')] [2023-12-28 02:02:46,830][106225] Updated weights for policy 1, policy_version 947299 (0.0008) [2023-12-28 02:02:46,889][106225] Updated weights for policy 1, policy_version 947309 (0.0007) [2023-12-28 02:02:46,923][106226] Updated weights for policy 0, policy_version 944902 (0.0008) [2023-12-28 02:02:46,948][106225] Updated weights for policy 1, policy_version 947319 (0.0010) [2023-12-28 02:02:46,985][106226] Updated weights for policy 0, policy_version 944912 (0.0006) [2023-12-28 02:02:47,049][106226] Updated weights for policy 0, policy_version 944922 (0.0008) [2023-12-28 02:02:47,630][106225] Updated weights for policy 1, policy_version 947329 (0.0010) [2023-12-28 02:02:47,678][106225] Updated weights for policy 1, policy_version 947339 (0.0007) [2023-12-28 02:02:47,736][106225] Updated weights for policy 1, policy_version 947349 (0.0006) [2023-12-28 02:02:47,784][106226] Updated weights for policy 0, policy_version 944932 (0.0008) [2023-12-28 02:02:47,791][106225] Updated weights for policy 1, policy_version 947359 (0.0008) [2023-12-28 02:02:47,849][106226] Updated weights for policy 0, policy_version 944942 (0.0009) [2023-12-28 02:02:47,898][106226] Updated weights for policy 0, policy_version 944952 (0.0009) [2023-12-28 02:02:48,508][106225] Updated weights for policy 1, policy_version 947369 (0.0007) [2023-12-28 02:02:48,569][106225] Updated weights for policy 1, policy_version 947379 (0.0008) [2023-12-28 02:02:48,634][106225] Updated weights for policy 1, policy_version 947389 (0.0008) [2023-12-28 02:02:48,662][106226] Updated weights for policy 0, policy_version 944962 (0.0009) [2023-12-28 02:02:48,722][106226] Updated weights for policy 0, policy_version 944972 (0.0010) [2023-12-28 02:02:48,780][106226] Updated weights for policy 0, policy_version 944982 (0.0011) [2023-12-28 02:02:48,839][106226] Updated weights for policy 0, policy_version 944992 (0.0011) [2023-12-28 02:02:49,411][106225] Updated weights for policy 1, policy_version 947399 (0.0008) [2023-12-28 02:02:49,468][106225] Updated weights for policy 1, policy_version 947409 (0.0008) [2023-12-28 02:02:49,518][106226] Updated weights for policy 0, policy_version 945002 (0.0008) [2023-12-28 02:02:49,532][106225] Updated weights for policy 1, policy_version 947419 (0.0008) [2023-12-28 02:02:49,574][106226] Updated weights for policy 0, policy_version 945012 (0.0007) [2023-12-28 02:02:49,630][106226] Updated weights for policy 0, policy_version 945022 (0.0008) [2023-12-28 02:02:50,200][106225] Updated weights for policy 1, policy_version 947429 (0.0006) [2023-12-28 02:02:50,272][106225] Updated weights for policy 1, policy_version 947439 (0.0006) [2023-12-28 02:02:50,336][106225] Updated weights for policy 1, policy_version 947449 (0.0006) [2023-12-28 02:02:50,339][106226] Updated weights for policy 0, policy_version 945032 (0.0008) [2023-12-28 02:02:50,414][106226] Updated weights for policy 0, policy_version 945042 (0.0008) [2023-12-28 02:02:50,465][106226] Updated weights for policy 0, policy_version 945052 (0.0009) [2023-12-28 02:02:50,941][106225] Updated weights for policy 1, policy_version 947459 (0.0006) [2023-12-28 02:02:51,002][106225] Updated weights for policy 1, policy_version 947469 (0.0010) [2023-12-28 02:02:51,068][106225] Updated weights for policy 1, policy_version 947479 (0.0009) [2023-12-28 02:02:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 484589568. Throughput: 0: 9953.9, 1: 9986.0. Samples: 484597420. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:51,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.951')] [2023-12-28 02:02:51,237][106226] Updated weights for policy 0, policy_version 945062 (0.0008) [2023-12-28 02:02:51,300][106226] Updated weights for policy 0, policy_version 945072 (0.0009) [2023-12-28 02:02:51,372][106226] Updated weights for policy 0, policy_version 945082 (0.0010) [2023-12-28 02:02:51,771][106225] Updated weights for policy 1, policy_version 947489 (0.0008) [2023-12-28 02:02:51,833][106225] Updated weights for policy 1, policy_version 947499 (0.0008) [2023-12-28 02:02:51,892][106225] Updated weights for policy 1, policy_version 947509 (0.0008) [2023-12-28 02:02:51,955][106225] Updated weights for policy 1, policy_version 947519 (0.0008) [2023-12-28 02:02:52,121][106226] Updated weights for policy 0, policy_version 945092 (0.0007) [2023-12-28 02:02:52,180][106226] Updated weights for policy 0, policy_version 945102 (0.0005) [2023-12-28 02:02:52,243][106226] Updated weights for policy 0, policy_version 945112 (0.0006) [2023-12-28 02:02:52,732][106225] Updated weights for policy 1, policy_version 947529 (0.0009) [2023-12-28 02:02:52,783][106225] Updated weights for policy 1, policy_version 947539 (0.0009) [2023-12-28 02:02:52,836][106225] Updated weights for policy 1, policy_version 947549 (0.0008) [2023-12-28 02:02:52,897][106226] Updated weights for policy 0, policy_version 945122 (0.0009) [2023-12-28 02:02:52,957][106226] Updated weights for policy 0, policy_version 945132 (0.0010) [2023-12-28 02:02:53,014][106226] Updated weights for policy 0, policy_version 945142 (0.0011) [2023-12-28 02:02:53,075][106226] Updated weights for policy 0, policy_version 945152 (0.0011) [2023-12-28 02:02:53,575][106225] Updated weights for policy 1, policy_version 947559 (0.0007) [2023-12-28 02:02:53,626][106225] Updated weights for policy 1, policy_version 947569 (0.0008) [2023-12-28 02:02:53,674][106225] Updated weights for policy 1, policy_version 947579 (0.0007) [2023-12-28 02:02:53,785][106226] Updated weights for policy 0, policy_version 945162 (0.0011) [2023-12-28 02:02:53,831][106226] Updated weights for policy 0, policy_version 945172 (0.0010) [2023-12-28 02:02:53,878][106226] Updated weights for policy 0, policy_version 945182 (0.0010) [2023-12-28 02:02:54,426][106225] Updated weights for policy 1, policy_version 947589 (0.0008) [2023-12-28 02:02:54,484][106225] Updated weights for policy 1, policy_version 947599 (0.0008) [2023-12-28 02:02:54,530][106225] Updated weights for policy 1, policy_version 947609 (0.0007) [2023-12-28 02:02:54,614][106226] Updated weights for policy 0, policy_version 945192 (0.0007) [2023-12-28 02:02:54,674][106226] Updated weights for policy 0, policy_version 945202 (0.0009) [2023-12-28 02:02:54,730][106226] Updated weights for policy 0, policy_version 945212 (0.0010) [2023-12-28 02:02:55,326][106225] Updated weights for policy 1, policy_version 947619 (0.0008) [2023-12-28 02:02:55,330][106226] Updated weights for policy 0, policy_version 945222 (0.0007) [2023-12-28 02:02:55,374][106225] Updated weights for policy 1, policy_version 947629 (0.0009) [2023-12-28 02:02:55,381][106226] Updated weights for policy 0, policy_version 945232 (0.0008) [2023-12-28 02:02:55,428][106225] Updated weights for policy 1, policy_version 947639 (0.0006) [2023-12-28 02:02:55,430][106226] Updated weights for policy 0, policy_version 945242 (0.0010) [2023-12-28 02:02:56,007][106226] Updated weights for policy 0, policy_version 945252 (0.0008) [2023-12-28 02:02:56,064][106226] Updated weights for policy 0, policy_version 945262 (0.0005) [2023-12-28 02:02:56,131][106226] Updated weights for policy 0, policy_version 945272 (0.0006) [2023-12-28 02:02:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 484687872. Throughput: 0: 9967.3, 1: 9970.2. Samples: 484654704. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:02:56,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-5.104')] [2023-12-28 02:02:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000945280_242049024.pth... [2023-12-28 02:02:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000947648_242638848.pth... [2023-12-28 02:02:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000944096_241745920.pth [2023-12-28 02:02:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000946496_242343936.pth [2023-12-28 02:02:56,207][106225] Updated weights for policy 1, policy_version 947649 (0.0006) [2023-12-28 02:02:56,269][106225] Updated weights for policy 1, policy_version 947659 (0.0008) [2023-12-28 02:02:56,321][106225] Updated weights for policy 1, policy_version 947669 (0.0008) [2023-12-28 02:02:56,377][106225] Updated weights for policy 1, policy_version 947679 (0.0008) [2023-12-28 02:02:56,798][106226] Updated weights for policy 0, policy_version 945282 (0.0008) [2023-12-28 02:02:56,845][106226] Updated weights for policy 0, policy_version 945292 (0.0006) [2023-12-28 02:02:56,892][106226] Updated weights for policy 0, policy_version 945302 (0.0005) [2023-12-28 02:02:56,940][106226] Updated weights for policy 0, policy_version 945312 (0.0005) [2023-12-28 02:02:57,081][106225] Updated weights for policy 1, policy_version 947689 (0.0006) [2023-12-28 02:02:57,140][106225] Updated weights for policy 1, policy_version 947699 (0.0005) [2023-12-28 02:02:57,191][106225] Updated weights for policy 1, policy_version 947709 (0.0005) [2023-12-28 02:02:57,682][106226] Updated weights for policy 0, policy_version 945322 (0.0005) [2023-12-28 02:02:57,703][106225] Updated weights for policy 1, policy_version 947719 (0.0007) [2023-12-28 02:02:57,734][106226] Updated weights for policy 0, policy_version 945332 (0.0006) [2023-12-28 02:02:57,751][106225] Updated weights for policy 1, policy_version 947729 (0.0006) [2023-12-28 02:02:57,788][106226] Updated weights for policy 0, policy_version 945342 (0.0005) [2023-12-28 02:02:57,806][106225] Updated weights for policy 1, policy_version 947739 (0.0006) [2023-12-28 02:02:58,504][106226] Updated weights for policy 0, policy_version 945352 (0.0009) [2023-12-28 02:02:58,576][106226] Updated weights for policy 0, policy_version 945362 (0.0010) [2023-12-28 02:02:58,613][106225] Updated weights for policy 1, policy_version 947749 (0.0008) [2023-12-28 02:02:58,644][106226] Updated weights for policy 0, policy_version 945372 (0.0010) [2023-12-28 02:02:58,676][106225] Updated weights for policy 1, policy_version 947759 (0.0007) [2023-12-28 02:02:58,736][106225] Updated weights for policy 1, policy_version 947769 (0.0008) [2023-12-28 02:02:59,444][106226] Updated weights for policy 0, policy_version 945382 (0.0009) [2023-12-28 02:02:59,472][106225] Updated weights for policy 1, policy_version 947779 (0.0008) [2023-12-28 02:02:59,500][106226] Updated weights for policy 0, policy_version 945392 (0.0011) [2023-12-28 02:02:59,533][106225] Updated weights for policy 1, policy_version 947789 (0.0007) [2023-12-28 02:02:59,559][106226] Updated weights for policy 0, policy_version 945402 (0.0010) [2023-12-28 02:02:59,593][106225] Updated weights for policy 1, policy_version 947799 (0.0008) [2023-12-28 02:03:00,263][106225] Updated weights for policy 1, policy_version 947809 (0.0007) [2023-12-28 02:03:00,317][106225] Updated weights for policy 1, policy_version 947819 (0.0010) [2023-12-28 02:03:00,323][106226] Updated weights for policy 0, policy_version 945412 (0.0008) [2023-12-28 02:03:00,378][106225] Updated weights for policy 1, policy_version 947829 (0.0010) [2023-12-28 02:03:00,381][106226] Updated weights for policy 0, policy_version 945422 (0.0010) [2023-12-28 02:03:00,436][106226] Updated weights for policy 0, policy_version 945432 (0.0011) [2023-12-28 02:03:00,437][106225] Updated weights for policy 1, policy_version 947839 (0.0009) [2023-12-28 02:03:01,052][106225] Updated weights for policy 1, policy_version 947849 (0.0007) [2023-12-28 02:03:01,068][106226] Updated weights for policy 0, policy_version 945442 (0.0010) [2023-12-28 02:03:01,106][106225] Updated weights for policy 1, policy_version 947859 (0.0010) [2023-12-28 02:03:01,122][106226] Updated weights for policy 0, policy_version 945452 (0.0010) [2023-12-28 02:03:01,170][106225] Updated weights for policy 1, policy_version 947869 (0.0008) [2023-12-28 02:03:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 484777984. Throughput: 0: 10048.1, 1: 9868.9. Samples: 484773032. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:03:01,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.040')] [2023-12-28 02:03:01,184][106226] Updated weights for policy 0, policy_version 945462 (0.0011) [2023-12-28 02:03:01,244][106226] Updated weights for policy 0, policy_version 945472 (0.0010) [2023-12-28 02:03:01,911][106225] Updated weights for policy 1, policy_version 947879 (0.0008) [2023-12-28 02:03:01,918][106226] Updated weights for policy 0, policy_version 945482 (0.0007) [2023-12-28 02:03:01,964][106225] Updated weights for policy 1, policy_version 947889 (0.0007) [2023-12-28 02:03:01,969][106226] Updated weights for policy 0, policy_version 945492 (0.0010) [2023-12-28 02:03:02,019][106225] Updated weights for policy 1, policy_version 947899 (0.0006) [2023-12-28 02:03:02,031][106226] Updated weights for policy 0, policy_version 945502 (0.0008) [2023-12-28 02:03:02,696][106225] Updated weights for policy 1, policy_version 947909 (0.0008) [2023-12-28 02:03:02,757][106225] Updated weights for policy 1, policy_version 947919 (0.0006) [2023-12-28 02:03:02,759][106226] Updated weights for policy 0, policy_version 945512 (0.0007) [2023-12-28 02:03:02,810][106225] Updated weights for policy 1, policy_version 947929 (0.0007) [2023-12-28 02:03:02,823][106226] Updated weights for policy 0, policy_version 945522 (0.0007) [2023-12-28 02:03:02,882][106226] Updated weights for policy 0, policy_version 945532 (0.0007) [2023-12-28 02:03:03,478][106225] Updated weights for policy 1, policy_version 947939 (0.0006) [2023-12-28 02:03:03,530][106225] Updated weights for policy 1, policy_version 947949 (0.0008) [2023-12-28 02:03:03,588][106225] Updated weights for policy 1, policy_version 947959 (0.0006) [2023-12-28 02:03:03,592][106226] Updated weights for policy 0, policy_version 945542 (0.0010) [2023-12-28 02:03:03,648][106226] Updated weights for policy 0, policy_version 945552 (0.0009) [2023-12-28 02:03:03,702][106226] Updated weights for policy 0, policy_version 945562 (0.0010) [2023-12-28 02:03:04,323][106225] Updated weights for policy 1, policy_version 947969 (0.0006) [2023-12-28 02:03:04,378][106225] Updated weights for policy 1, policy_version 947979 (0.0007) [2023-12-28 02:03:04,381][106226] Updated weights for policy 0, policy_version 945572 (0.0011) [2023-12-28 02:03:04,437][106225] Updated weights for policy 1, policy_version 947989 (0.0006) [2023-12-28 02:03:04,446][106226] Updated weights for policy 0, policy_version 945582 (0.0011) [2023-12-28 02:03:04,495][106225] Updated weights for policy 1, policy_version 947999 (0.0007) [2023-12-28 02:03:04,510][106226] Updated weights for policy 0, policy_version 945592 (0.0011) [2023-12-28 02:03:05,176][106226] Updated weights for policy 0, policy_version 945602 (0.0010) [2023-12-28 02:03:05,232][106225] Updated weights for policy 1, policy_version 948009 (0.0006) [2023-12-28 02:03:05,246][106226] Updated weights for policy 0, policy_version 945612 (0.0010) [2023-12-28 02:03:05,293][106225] Updated weights for policy 1, policy_version 948019 (0.0006) [2023-12-28 02:03:05,306][106226] Updated weights for policy 0, policy_version 945622 (0.0010) [2023-12-28 02:03:05,348][106225] Updated weights for policy 1, policy_version 948029 (0.0007) [2023-12-28 02:03:05,365][106226] Updated weights for policy 0, policy_version 945632 (0.0006) [2023-12-28 02:03:06,049][106225] Updated weights for policy 1, policy_version 948039 (0.0007) [2023-12-28 02:03:06,055][106226] Updated weights for policy 0, policy_version 945642 (0.0010) [2023-12-28 02:03:06,101][106225] Updated weights for policy 1, policy_version 948049 (0.0007) [2023-12-28 02:03:06,113][106226] Updated weights for policy 0, policy_version 945652 (0.0010) [2023-12-28 02:03:06,168][106225] Updated weights for policy 1, policy_version 948059 (0.0007) [2023-12-28 02:03:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 484876288. Throughput: 0: 9986.5, 1: 9864.8. Samples: 484893636. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-28 02:03:06,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-5.002')] [2023-12-28 02:03:06,186][106226] Updated weights for policy 0, policy_version 945662 (0.0011) [2023-12-28 02:03:06,876][106225] Updated weights for policy 1, policy_version 948069 (0.0006) [2023-12-28 02:03:06,911][106226] Updated weights for policy 0, policy_version 945672 (0.0011) [2023-12-28 02:03:06,936][106225] Updated weights for policy 1, policy_version 948079 (0.0006) [2023-12-28 02:03:06,972][106226] Updated weights for policy 0, policy_version 945682 (0.0011) [2023-12-28 02:03:06,989][106225] Updated weights for policy 1, policy_version 948089 (0.0006) [2023-12-28 02:03:07,032][106226] Updated weights for policy 0, policy_version 945692 (0.0010) [2023-12-28 02:03:07,676][106225] Updated weights for policy 1, policy_version 948099 (0.0006) [2023-12-28 02:03:07,716][106226] Updated weights for policy 0, policy_version 945702 (0.0011) [2023-12-28 02:03:07,726][106225] Updated weights for policy 1, policy_version 948109 (0.0006) [2023-12-28 02:03:07,774][106225] Updated weights for policy 1, policy_version 948119 (0.0007) [2023-12-28 02:03:07,776][106226] Updated weights for policy 0, policy_version 945712 (0.0011) [2023-12-28 02:03:07,839][106226] Updated weights for policy 0, policy_version 945722 (0.0011) [2023-12-28 02:03:08,513][106226] Updated weights for policy 0, policy_version 945732 (0.0011) [2023-12-28 02:03:08,514][106225] Updated weights for policy 1, policy_version 948129 (0.0007) [2023-12-28 02:03:08,565][106225] Updated weights for policy 1, policy_version 948139 (0.0006) [2023-12-28 02:03:08,578][106226] Updated weights for policy 0, policy_version 945742 (0.0011) [2023-12-28 02:03:08,619][106225] Updated weights for policy 1, policy_version 948149 (0.0007) [2023-12-28 02:03:08,641][106226] Updated weights for policy 0, policy_version 945752 (0.0010) [2023-12-28 02:03:08,667][106225] Updated weights for policy 1, policy_version 948159 (0.0007) [2023-12-28 02:03:09,327][106226] Updated weights for policy 0, policy_version 945762 (0.0010) [2023-12-28 02:03:09,394][106226] Updated weights for policy 0, policy_version 945772 (0.0008) [2023-12-28 02:03:09,405][106225] Updated weights for policy 1, policy_version 948169 (0.0009) [2023-12-28 02:03:09,469][106225] Updated weights for policy 1, policy_version 948179 (0.0008) [2023-12-28 02:03:09,470][106226] Updated weights for policy 0, policy_version 945782 (0.0008) [2023-12-28 02:03:09,523][106225] Updated weights for policy 1, policy_version 948189 (0.0007) [2023-12-28 02:03:09,529][106226] Updated weights for policy 0, policy_version 945792 (0.0008) [2023-12-28 02:03:10,330][106226] Updated weights for policy 0, policy_version 945802 (0.0011) [2023-12-28 02:03:10,337][106225] Updated weights for policy 1, policy_version 948199 (0.0009) [2023-12-28 02:03:10,389][106225] Updated weights for policy 1, policy_version 948209 (0.0008) [2023-12-28 02:03:10,393][106226] Updated weights for policy 0, policy_version 945812 (0.0010) [2023-12-28 02:03:10,455][106226] Updated weights for policy 0, policy_version 945822 (0.0011) [2023-12-28 02:03:10,456][106225] Updated weights for policy 1, policy_version 948219 (0.0007) [2023-12-28 02:03:11,162][106225] Updated weights for policy 1, policy_version 948229 (0.0009) [2023-12-28 02:03:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 484974592. Throughput: 0: 9954.6, 1: 9852.1. Samples: 484952048. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:11,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-5.183')] [2023-12-28 02:03:11,197][106226] Updated weights for policy 0, policy_version 945832 (0.0008) [2023-12-28 02:03:11,226][106225] Updated weights for policy 1, policy_version 948239 (0.0008) [2023-12-28 02:03:11,260][106226] Updated weights for policy 0, policy_version 945842 (0.0006) [2023-12-28 02:03:11,293][106225] Updated weights for policy 1, policy_version 948249 (0.0010) [2023-12-28 02:03:11,319][106226] Updated weights for policy 0, policy_version 945852 (0.0006) [2023-12-28 02:03:11,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000948256_242794496.pth... [2023-12-28 02:03:11,336][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000947104_242499584.pth [2023-12-28 02:03:11,347][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000945856_242196480.pth... [2023-12-28 02:03:11,352][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000944704_241901568.pth [2023-12-28 02:03:12,011][106225] Updated weights for policy 1, policy_version 948259 (0.0010) [2023-12-28 02:03:12,061][106225] Updated weights for policy 1, policy_version 948269 (0.0006) [2023-12-28 02:03:12,099][106226] Updated weights for policy 0, policy_version 945862 (0.0008) [2023-12-28 02:03:12,118][106225] Updated weights for policy 1, policy_version 948279 (0.0006) [2023-12-28 02:03:12,156][106226] Updated weights for policy 0, policy_version 945872 (0.0008) [2023-12-28 02:03:12,208][106226] Updated weights for policy 0, policy_version 945882 (0.0008) [2023-12-28 02:03:12,848][106225] Updated weights for policy 1, policy_version 948289 (0.0010) [2023-12-28 02:03:12,901][106225] Updated weights for policy 1, policy_version 948299 (0.0008) [2023-12-28 02:03:12,949][106226] Updated weights for policy 0, policy_version 945892 (0.0008) [2023-12-28 02:03:12,955][106225] Updated weights for policy 1, policy_version 948309 (0.0008) [2023-12-28 02:03:13,004][106226] Updated weights for policy 0, policy_version 945902 (0.0006) [2023-12-28 02:03:13,010][106225] Updated weights for policy 1, policy_version 948319 (0.0006) [2023-12-28 02:03:13,058][106226] Updated weights for policy 0, policy_version 945912 (0.0008) [2023-12-28 02:03:13,742][106226] Updated weights for policy 0, policy_version 945922 (0.0008) [2023-12-28 02:03:13,757][106225] Updated weights for policy 1, policy_version 948329 (0.0008) [2023-12-28 02:03:13,809][106225] Updated weights for policy 1, policy_version 948339 (0.0006) [2023-12-28 02:03:13,814][106226] Updated weights for policy 0, policy_version 945932 (0.0008) [2023-12-28 02:03:13,870][106226] Updated weights for policy 0, policy_version 945942 (0.0007) [2023-12-28 02:03:13,871][106225] Updated weights for policy 1, policy_version 948349 (0.0007) [2023-12-28 02:03:13,933][106226] Updated weights for policy 0, policy_version 945952 (0.0008) [2023-12-28 02:03:14,449][106225] Updated weights for policy 1, policy_version 948359 (0.0006) [2023-12-28 02:03:14,508][106225] Updated weights for policy 1, policy_version 948369 (0.0007) [2023-12-28 02:03:14,562][106225] Updated weights for policy 1, policy_version 948379 (0.0006) [2023-12-28 02:03:14,713][106226] Updated weights for policy 0, policy_version 945962 (0.0009) [2023-12-28 02:03:14,779][106226] Updated weights for policy 0, policy_version 945972 (0.0009) [2023-12-28 02:03:14,836][106226] Updated weights for policy 0, policy_version 945982 (0.0007) [2023-12-28 02:03:15,178][106225] Updated weights for policy 1, policy_version 948389 (0.0007) [2023-12-28 02:03:15,249][106225] Updated weights for policy 1, policy_version 948399 (0.0007) [2023-12-28 02:03:15,313][106225] Updated weights for policy 1, policy_version 948409 (0.0007) [2023-12-28 02:03:15,596][106226] Updated weights for policy 0, policy_version 945992 (0.0010) [2023-12-28 02:03:15,649][106226] Updated weights for policy 0, policy_version 946002 (0.0010) [2023-12-28 02:03:15,699][106226] Updated weights for policy 0, policy_version 946012 (0.0010) [2023-12-28 02:03:15,952][106225] Updated weights for policy 1, policy_version 948419 (0.0007) [2023-12-28 02:03:16,002][106225] Updated weights for policy 1, policy_version 948429 (0.0009) [2023-12-28 02:03:16,057][106225] Updated weights for policy 1, policy_version 948439 (0.0008) [2023-12-28 02:03:16,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 485081088. Throughput: 0: 9734.9, 1: 9862.6. Samples: 485066808. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:16,176][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.791')] [2023-12-28 02:03:16,445][106226] Updated weights for policy 0, policy_version 946023 (0.0009) [2023-12-28 02:03:16,496][106226] Updated weights for policy 0, policy_version 946033 (0.0006) [2023-12-28 02:03:16,554][106226] Updated weights for policy 0, policy_version 946043 (0.0005) [2023-12-28 02:03:16,784][106225] Updated weights for policy 1, policy_version 948449 (0.0008) [2023-12-28 02:03:16,847][106225] Updated weights for policy 1, policy_version 948459 (0.0010) [2023-12-28 02:03:16,900][106225] Updated weights for policy 1, policy_version 948469 (0.0010) [2023-12-28 02:03:16,962][106225] Updated weights for policy 1, policy_version 948479 (0.0010) [2023-12-28 02:03:17,220][106226] Updated weights for policy 0, policy_version 946053 (0.0006) [2023-12-28 02:03:17,273][106226] Updated weights for policy 0, policy_version 946063 (0.0006) [2023-12-28 02:03:17,319][106226] Updated weights for policy 0, policy_version 946073 (0.0008) [2023-12-28 02:03:17,602][106225] Updated weights for policy 1, policy_version 948489 (0.0006) [2023-12-28 02:03:17,656][106225] Updated weights for policy 1, policy_version 948499 (0.0005) [2023-12-28 02:03:17,719][106225] Updated weights for policy 1, policy_version 948509 (0.0010) [2023-12-28 02:03:18,074][106226] Updated weights for policy 0, policy_version 946083 (0.0008) [2023-12-28 02:03:18,142][106226] Updated weights for policy 0, policy_version 946093 (0.0006) [2023-12-28 02:03:18,198][106226] Updated weights for policy 0, policy_version 946103 (0.0009) [2023-12-28 02:03:18,297][106225] Updated weights for policy 1, policy_version 948519 (0.0010) [2023-12-28 02:03:18,394][106225] Updated weights for policy 1, policy_version 948529 (0.0009) [2023-12-28 02:03:18,450][106225] Updated weights for policy 1, policy_version 948539 (0.0008) [2023-12-28 02:03:18,860][106226] Updated weights for policy 0, policy_version 946113 (0.0009) [2023-12-28 02:03:18,922][106226] Updated weights for policy 0, policy_version 946123 (0.0008) [2023-12-28 02:03:18,985][106226] Updated weights for policy 0, policy_version 946133 (0.0008) [2023-12-28 02:03:19,035][106226] Updated weights for policy 0, policy_version 946143 (0.0008) [2023-12-28 02:03:19,094][106225] Updated weights for policy 1, policy_version 948549 (0.0011) [2023-12-28 02:03:19,149][106225] Updated weights for policy 1, policy_version 948559 (0.0005) [2023-12-28 02:03:19,225][106225] Updated weights for policy 1, policy_version 948569 (0.0006) [2023-12-28 02:03:19,852][106226] Updated weights for policy 0, policy_version 946153 (0.0009) [2023-12-28 02:03:19,918][106226] Updated weights for policy 0, policy_version 946163 (0.0009) [2023-12-28 02:03:19,960][106225] Updated weights for policy 1, policy_version 948579 (0.0009) [2023-12-28 02:03:19,982][106226] Updated weights for policy 0, policy_version 946173 (0.0006) [2023-12-28 02:03:20,029][106225] Updated weights for policy 1, policy_version 948589 (0.0009) [2023-12-28 02:03:20,093][106225] Updated weights for policy 1, policy_version 948599 (0.0009) [2023-12-28 02:03:20,677][106226] Updated weights for policy 0, policy_version 946183 (0.0009) [2023-12-28 02:03:20,741][106226] Updated weights for policy 0, policy_version 946193 (0.0008) [2023-12-28 02:03:20,803][106226] Updated weights for policy 0, policy_version 946203 (0.0009) [2023-12-28 02:03:20,864][106225] Updated weights for policy 1, policy_version 948609 (0.0010) [2023-12-28 02:03:20,921][106225] Updated weights for policy 1, policy_version 948619 (0.0008) [2023-12-28 02:03:20,970][106225] Updated weights for policy 1, policy_version 948629 (0.0008) [2023-12-28 02:03:21,035][106225] Updated weights for policy 1, policy_version 948639 (0.0008) [2023-12-28 02:03:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 485179392. Throughput: 0: 9635.7, 1: 9825.1. Samples: 485184744. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:21,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-5.392')] [2023-12-28 02:03:21,540][106226] Updated weights for policy 0, policy_version 946213 (0.0008) [2023-12-28 02:03:21,608][106226] Updated weights for policy 0, policy_version 946223 (0.0008) [2023-12-28 02:03:21,683][106226] Updated weights for policy 0, policy_version 946233 (0.0009) [2023-12-28 02:03:21,857][106225] Updated weights for policy 1, policy_version 948649 (0.0008) [2023-12-28 02:03:21,922][106225] Updated weights for policy 1, policy_version 948659 (0.0008) [2023-12-28 02:03:21,981][106225] Updated weights for policy 1, policy_version 948669 (0.0008) [2023-12-28 02:03:22,431][106226] Updated weights for policy 0, policy_version 946243 (0.0008) [2023-12-28 02:03:22,489][106226] Updated weights for policy 0, policy_version 946253 (0.0008) [2023-12-28 02:03:22,548][106226] Updated weights for policy 0, policy_version 946263 (0.0006) [2023-12-28 02:03:22,754][106225] Updated weights for policy 1, policy_version 948679 (0.0008) [2023-12-28 02:03:22,815][106225] Updated weights for policy 1, policy_version 948689 (0.0007) [2023-12-28 02:03:22,883][106225] Updated weights for policy 1, policy_version 948699 (0.0006) [2023-12-28 02:03:23,192][106226] Updated weights for policy 0, policy_version 946273 (0.0006) [2023-12-28 02:03:23,251][106226] Updated weights for policy 0, policy_version 946283 (0.0005) [2023-12-28 02:03:23,310][106226] Updated weights for policy 0, policy_version 946293 (0.0007) [2023-12-28 02:03:23,360][106226] Updated weights for policy 0, policy_version 946303 (0.0008) [2023-12-28 02:03:23,521][106225] Updated weights for policy 1, policy_version 948709 (0.0007) [2023-12-28 02:03:23,570][106225] Updated weights for policy 1, policy_version 948719 (0.0008) [2023-12-28 02:03:23,617][106225] Updated weights for policy 1, policy_version 948729 (0.0008) [2023-12-28 02:03:24,015][106226] Updated weights for policy 0, policy_version 946313 (0.0009) [2023-12-28 02:03:24,069][106226] Updated weights for policy 0, policy_version 946323 (0.0008) [2023-12-28 02:03:24,123][106226] Updated weights for policy 0, policy_version 946333 (0.0008) [2023-12-28 02:03:24,315][106225] Updated weights for policy 1, policy_version 948739 (0.0009) [2023-12-28 02:03:24,372][106225] Updated weights for policy 1, policy_version 948749 (0.0008) [2023-12-28 02:03:24,430][106225] Updated weights for policy 1, policy_version 948759 (0.0008) [2023-12-28 02:03:24,829][106226] Updated weights for policy 0, policy_version 946343 (0.0010) [2023-12-28 02:03:24,879][106226] Updated weights for policy 0, policy_version 946353 (0.0010) [2023-12-28 02:03:24,925][106226] Updated weights for policy 0, policy_version 946363 (0.0010) [2023-12-28 02:03:25,040][106225] Updated weights for policy 1, policy_version 948769 (0.0006) [2023-12-28 02:03:25,098][106225] Updated weights for policy 1, policy_version 948779 (0.0009) [2023-12-28 02:03:25,160][106225] Updated weights for policy 1, policy_version 948789 (0.0008) [2023-12-28 02:03:25,223][106225] Updated weights for policy 1, policy_version 948799 (0.0008) [2023-12-28 02:03:25,583][106226] Updated weights for policy 0, policy_version 946373 (0.0007) [2023-12-28 02:03:25,633][106226] Updated weights for policy 0, policy_version 946383 (0.0006) [2023-12-28 02:03:25,685][106226] Updated weights for policy 0, policy_version 946393 (0.0006) [2023-12-28 02:03:25,992][106225] Updated weights for policy 1, policy_version 948809 (0.0008) [2023-12-28 02:03:26,046][106225] Updated weights for policy 1, policy_version 948819 (0.0007) [2023-12-28 02:03:26,100][106225] Updated weights for policy 1, policy_version 948829 (0.0007) [2023-12-28 02:03:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 485277696. Throughput: 0: 9629.2, 1: 9777.2. Samples: 485242492. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:26,176][105115] Avg episode reward: [(0, '-4.681'), (1, '-5.008')] [2023-12-28 02:03:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000948832_242941952.pth... [2023-12-28 02:03:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000946400_242335744.pth... [2023-12-28 02:03:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000945280_242049024.pth [2023-12-28 02:03:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000947648_242638848.pth [2023-12-28 02:03:26,361][106226] Updated weights for policy 0, policy_version 946403 (0.0011) [2023-12-28 02:03:26,414][106226] Updated weights for policy 0, policy_version 946413 (0.0010) [2023-12-28 02:03:26,465][106226] Updated weights for policy 0, policy_version 946423 (0.0009) [2023-12-28 02:03:26,854][106225] Updated weights for policy 1, policy_version 948839 (0.0008) [2023-12-28 02:03:26,914][106225] Updated weights for policy 1, policy_version 948849 (0.0007) [2023-12-28 02:03:26,974][106225] Updated weights for policy 1, policy_version 948859 (0.0005) [2023-12-28 02:03:27,170][106226] Updated weights for policy 0, policy_version 946433 (0.0009) [2023-12-28 02:03:27,232][106226] Updated weights for policy 0, policy_version 946443 (0.0006) [2023-12-28 02:03:27,299][106226] Updated weights for policy 0, policy_version 946453 (0.0005) [2023-12-28 02:03:27,361][106226] Updated weights for policy 0, policy_version 946463 (0.0009) [2023-12-28 02:03:27,668][106225] Updated weights for policy 1, policy_version 948869 (0.0007) [2023-12-28 02:03:27,717][106225] Updated weights for policy 1, policy_version 948879 (0.0007) [2023-12-28 02:03:27,774][106225] Updated weights for policy 1, policy_version 948889 (0.0008) [2023-12-28 02:03:28,007][106226] Updated weights for policy 0, policy_version 946473 (0.0008) [2023-12-28 02:03:28,066][106226] Updated weights for policy 0, policy_version 946483 (0.0009) [2023-12-28 02:03:28,118][106226] Updated weights for policy 0, policy_version 946493 (0.0009) [2023-12-28 02:03:28,522][106225] Updated weights for policy 1, policy_version 948899 (0.0008) [2023-12-28 02:03:28,578][106225] Updated weights for policy 1, policy_version 948909 (0.0009) [2023-12-28 02:03:28,641][106225] Updated weights for policy 1, policy_version 948919 (0.0009) [2023-12-28 02:03:28,788][106226] Updated weights for policy 0, policy_version 946503 (0.0006) [2023-12-28 02:03:28,849][106226] Updated weights for policy 0, policy_version 946513 (0.0005) [2023-12-28 02:03:28,895][106226] Updated weights for policy 0, policy_version 946523 (0.0005) [2023-12-28 02:03:29,449][106225] Updated weights for policy 1, policy_version 948929 (0.0010) [2023-12-28 02:03:29,509][106225] Updated weights for policy 1, policy_version 948939 (0.0008) [2023-12-28 02:03:29,561][106225] Updated weights for policy 1, policy_version 948949 (0.0009) [2023-12-28 02:03:29,593][106226] Updated weights for policy 0, policy_version 946533 (0.0007) [2023-12-28 02:03:29,619][106225] Updated weights for policy 1, policy_version 948959 (0.0007) [2023-12-28 02:03:29,650][106226] Updated weights for policy 0, policy_version 946543 (0.0007) [2023-12-28 02:03:29,700][106226] Updated weights for policy 0, policy_version 946553 (0.0009) [2023-12-28 02:03:30,365][106225] Updated weights for policy 1, policy_version 948969 (0.0008) [2023-12-28 02:03:30,417][106225] Updated weights for policy 1, policy_version 948979 (0.0007) [2023-12-28 02:03:30,434][106226] Updated weights for policy 0, policy_version 946563 (0.0009) [2023-12-28 02:03:30,474][106225] Updated weights for policy 1, policy_version 948989 (0.0006) [2023-12-28 02:03:30,488][106226] Updated weights for policy 0, policy_version 946573 (0.0006) [2023-12-28 02:03:30,546][106226] Updated weights for policy 0, policy_version 946583 (0.0008) [2023-12-28 02:03:31,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 485367808. Throughput: 0: 9766.9, 1: 9793.8. Samples: 485361432. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:31,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.993')] [2023-12-28 02:03:31,218][106226] Updated weights for policy 0, policy_version 946593 (0.0008) [2023-12-28 02:03:31,225][106225] Updated weights for policy 1, policy_version 948999 (0.0007) [2023-12-28 02:03:31,286][106226] Updated weights for policy 0, policy_version 946603 (0.0008) [2023-12-28 02:03:31,288][106225] Updated weights for policy 1, policy_version 949009 (0.0006) [2023-12-28 02:03:31,351][106226] Updated weights for policy 0, policy_version 946613 (0.0007) [2023-12-28 02:03:31,353][106225] Updated weights for policy 1, policy_version 949019 (0.0007) [2023-12-28 02:03:31,421][106226] Updated weights for policy 0, policy_version 946623 (0.0007) [2023-12-28 02:03:32,145][106225] Updated weights for policy 1, policy_version 949029 (0.0008) [2023-12-28 02:03:32,158][106226] Updated weights for policy 0, policy_version 946633 (0.0006) [2023-12-28 02:03:32,197][106225] Updated weights for policy 1, policy_version 949039 (0.0008) [2023-12-28 02:03:32,223][106226] Updated weights for policy 0, policy_version 946643 (0.0006) [2023-12-28 02:03:32,263][106225] Updated weights for policy 1, policy_version 949049 (0.0008) [2023-12-28 02:03:32,290][106226] Updated weights for policy 0, policy_version 946653 (0.0006) [2023-12-28 02:03:33,001][106226] Updated weights for policy 0, policy_version 946663 (0.0007) [2023-12-28 02:03:33,013][106225] Updated weights for policy 1, policy_version 949059 (0.0008) [2023-12-28 02:03:33,056][106226] Updated weights for policy 0, policy_version 946673 (0.0007) [2023-12-28 02:03:33,064][106225] Updated weights for policy 1, policy_version 949069 (0.0008) [2023-12-28 02:03:33,108][106226] Updated weights for policy 0, policy_version 946683 (0.0006) [2023-12-28 02:03:33,112][106225] Updated weights for policy 1, policy_version 949079 (0.0007) [2023-12-28 02:03:33,643][106226] Updated weights for policy 0, policy_version 946693 (0.0005) [2023-12-28 02:03:33,698][106226] Updated weights for policy 0, policy_version 946703 (0.0005) [2023-12-28 02:03:33,747][106226] Updated weights for policy 0, policy_version 946713 (0.0005) [2023-12-28 02:03:33,921][106225] Updated weights for policy 1, policy_version 949089 (0.0007) [2023-12-28 02:03:33,967][106225] Updated weights for policy 1, policy_version 949099 (0.0005) [2023-12-28 02:03:34,026][106225] Updated weights for policy 1, policy_version 949109 (0.0005) [2023-12-28 02:03:34,077][106225] Updated weights for policy 1, policy_version 949119 (0.0005) [2023-12-28 02:03:34,320][106226] Updated weights for policy 0, policy_version 946723 (0.0006) [2023-12-28 02:03:34,386][106226] Updated weights for policy 0, policy_version 946733 (0.0008) [2023-12-28 02:03:34,452][106226] Updated weights for policy 0, policy_version 946743 (0.0008) [2023-12-28 02:03:34,737][106225] Updated weights for policy 1, policy_version 949129 (0.0006) [2023-12-28 02:03:34,806][106225] Updated weights for policy 1, policy_version 949139 (0.0008) [2023-12-28 02:03:34,859][106225] Updated weights for policy 1, policy_version 949149 (0.0009) [2023-12-28 02:03:35,155][106226] Updated weights for policy 0, policy_version 946753 (0.0008) [2023-12-28 02:03:35,210][106226] Updated weights for policy 0, policy_version 946763 (0.0009) [2023-12-28 02:03:35,264][106226] Updated weights for policy 0, policy_version 946773 (0.0009) [2023-12-28 02:03:35,309][106226] Updated weights for policy 0, policy_version 946783 (0.0008) [2023-12-28 02:03:35,572][106225] Updated weights for policy 1, policy_version 949159 (0.0008) [2023-12-28 02:03:35,627][106225] Updated weights for policy 1, policy_version 949169 (0.0008) [2023-12-28 02:03:35,679][106225] Updated weights for policy 1, policy_version 949179 (0.0008) [2023-12-28 02:03:36,042][106226] Updated weights for policy 0, policy_version 946793 (0.0009) [2023-12-28 02:03:36,099][106226] Updated weights for policy 0, policy_version 946803 (0.0008) [2023-12-28 02:03:36,161][106226] Updated weights for policy 0, policy_version 946813 (0.0008) [2023-12-28 02:03:36,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19387.8, 300 sec: 19688.6). Total num frames: 485466112. Throughput: 0: 9877.6, 1: 9715.5. Samples: 485479108. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:36,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-5.194')] [2023-12-28 02:03:36,435][106225] Updated weights for policy 1, policy_version 949189 (0.0008) [2023-12-28 02:03:36,500][106225] Updated weights for policy 1, policy_version 949199 (0.0008) [2023-12-28 02:03:36,561][106225] Updated weights for policy 1, policy_version 949209 (0.0008) [2023-12-28 02:03:36,920][106226] Updated weights for policy 0, policy_version 946823 (0.0009) [2023-12-28 02:03:36,979][106226] Updated weights for policy 0, policy_version 946833 (0.0009) [2023-12-28 02:03:37,037][106226] Updated weights for policy 0, policy_version 946843 (0.0008) [2023-12-28 02:03:37,284][106225] Updated weights for policy 1, policy_version 949219 (0.0009) [2023-12-28 02:03:37,337][106225] Updated weights for policy 1, policy_version 949229 (0.0009) [2023-12-28 02:03:37,390][106225] Updated weights for policy 1, policy_version 949239 (0.0009) [2023-12-28 02:03:37,711][106226] Updated weights for policy 0, policy_version 946853 (0.0007) [2023-12-28 02:03:37,780][106226] Updated weights for policy 0, policy_version 946863 (0.0005) [2023-12-28 02:03:37,849][106226] Updated weights for policy 0, policy_version 946873 (0.0006) [2023-12-28 02:03:38,185][106225] Updated weights for policy 1, policy_version 949249 (0.0009) [2023-12-28 02:03:38,234][106225] Updated weights for policy 1, policy_version 949259 (0.0008) [2023-12-28 02:03:38,279][106225] Updated weights for policy 1, policy_version 949269 (0.0008) [2023-12-28 02:03:38,333][106225] Updated weights for policy 1, policy_version 949279 (0.0008) [2023-12-28 02:03:38,536][106226] Updated weights for policy 0, policy_version 946883 (0.0008) [2023-12-28 02:03:38,590][106226] Updated weights for policy 0, policy_version 946893 (0.0009) [2023-12-28 02:03:38,645][106226] Updated weights for policy 0, policy_version 946903 (0.0009) [2023-12-28 02:03:39,093][106225] Updated weights for policy 1, policy_version 949289 (0.0008) [2023-12-28 02:03:39,142][106225] Updated weights for policy 1, policy_version 949299 (0.0008) [2023-12-28 02:03:39,194][106225] Updated weights for policy 1, policy_version 949309 (0.0009) [2023-12-28 02:03:39,377][106226] Updated weights for policy 0, policy_version 946913 (0.0008) [2023-12-28 02:03:39,451][106226] Updated weights for policy 0, policy_version 946923 (0.0008) [2023-12-28 02:03:39,506][106226] Updated weights for policy 0, policy_version 946933 (0.0008) [2023-12-28 02:03:39,559][106226] Updated weights for policy 0, policy_version 946943 (0.0008) [2023-12-28 02:03:40,012][106225] Updated weights for policy 1, policy_version 949319 (0.0009) [2023-12-28 02:03:40,075][106225] Updated weights for policy 1, policy_version 949329 (0.0008) [2023-12-28 02:03:40,134][106225] Updated weights for policy 1, policy_version 949339 (0.0007) [2023-12-28 02:03:40,316][106226] Updated weights for policy 0, policy_version 946953 (0.0008) [2023-12-28 02:03:40,384][106226] Updated weights for policy 0, policy_version 946963 (0.0007) [2023-12-28 02:03:40,453][106226] Updated weights for policy 0, policy_version 946973 (0.0008) [2023-12-28 02:03:40,834][106225] Updated weights for policy 1, policy_version 949349 (0.0007) [2023-12-28 02:03:40,886][106225] Updated weights for policy 1, policy_version 949359 (0.0008) [2023-12-28 02:03:40,946][106225] Updated weights for policy 1, policy_version 949369 (0.0009) [2023-12-28 02:03:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 485564416. Throughput: 0: 9873.5, 1: 9725.9. Samples: 485536680. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:41,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.757')] [2023-12-28 02:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000949376_243081216.pth... [2023-12-28 02:03:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000948256_242794496.pth [2023-12-28 02:03:41,187][106226] Updated weights for policy 0, policy_version 946983 (0.0008) [2023-12-28 02:03:41,245][106226] Updated weights for policy 0, policy_version 946993 (0.0008) [2023-12-28 02:03:41,303][106226] Updated weights for policy 0, policy_version 947003 (0.0013) [2023-12-28 02:03:41,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000947008_242491392.pth... [2023-12-28 02:03:41,333][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000945856_242196480.pth [2023-12-28 02:03:41,823][106225] Updated weights for policy 1, policy_version 949379 (0.0009) [2023-12-28 02:03:41,898][106225] Updated weights for policy 1, policy_version 949389 (0.0008) [2023-12-28 02:03:41,962][106225] Updated weights for policy 1, policy_version 949399 (0.0008) [2023-12-28 02:03:42,038][106226] Updated weights for policy 0, policy_version 947013 (0.0008) [2023-12-28 02:03:42,095][106226] Updated weights for policy 0, policy_version 947023 (0.0007) [2023-12-28 02:03:42,161][106226] Updated weights for policy 0, policy_version 947033 (0.0008) [2023-12-28 02:03:42,666][106225] Updated weights for policy 1, policy_version 949409 (0.0008) [2023-12-28 02:03:42,716][106225] Updated weights for policy 1, policy_version 949419 (0.0006) [2023-12-28 02:03:42,764][106225] Updated weights for policy 1, policy_version 949429 (0.0005) [2023-12-28 02:03:42,819][106225] Updated weights for policy 1, policy_version 949439 (0.0006) [2023-12-28 02:03:42,893][106226] Updated weights for policy 0, policy_version 947043 (0.0009) [2023-12-28 02:03:42,960][106226] Updated weights for policy 0, policy_version 947053 (0.0011) [2023-12-28 02:03:43,027][106226] Updated weights for policy 0, policy_version 947063 (0.0010) [2023-12-28 02:03:43,515][106225] Updated weights for policy 1, policy_version 949449 (0.0008) [2023-12-28 02:03:43,583][106225] Updated weights for policy 1, policy_version 949459 (0.0006) [2023-12-28 02:03:43,645][106225] Updated weights for policy 1, policy_version 949469 (0.0005) [2023-12-28 02:03:43,696][106226] Updated weights for policy 0, policy_version 947073 (0.0010) [2023-12-28 02:03:43,751][106226] Updated weights for policy 0, policy_version 947083 (0.0007) [2023-12-28 02:03:43,808][106226] Updated weights for policy 0, policy_version 947093 (0.0009) [2023-12-28 02:03:43,871][106226] Updated weights for policy 0, policy_version 947103 (0.0009) [2023-12-28 02:03:44,371][106225] Updated weights for policy 1, policy_version 949479 (0.0008) [2023-12-28 02:03:44,430][106225] Updated weights for policy 1, policy_version 949489 (0.0009) [2023-12-28 02:03:44,478][106225] Updated weights for policy 1, policy_version 949499 (0.0008) [2023-12-28 02:03:44,560][106226] Updated weights for policy 0, policy_version 947113 (0.0008) [2023-12-28 02:03:44,612][106226] Updated weights for policy 0, policy_version 947123 (0.0009) [2023-12-28 02:03:44,667][106226] Updated weights for policy 0, policy_version 947133 (0.0008) [2023-12-28 02:03:45,164][106225] Updated weights for policy 1, policy_version 949509 (0.0008) [2023-12-28 02:03:45,231][106225] Updated weights for policy 1, policy_version 949519 (0.0006) [2023-12-28 02:03:45,294][106225] Updated weights for policy 1, policy_version 949529 (0.0008) [2023-12-28 02:03:45,486][106226] Updated weights for policy 0, policy_version 947143 (0.0007) [2023-12-28 02:03:45,546][106226] Updated weights for policy 0, policy_version 947153 (0.0006) [2023-12-28 02:03:45,609][106226] Updated weights for policy 0, policy_version 947163 (0.0009) [2023-12-28 02:03:45,882][106225] Updated weights for policy 1, policy_version 949539 (0.0005) [2023-12-28 02:03:45,938][106225] Updated weights for policy 1, policy_version 949549 (0.0005) [2023-12-28 02:03:46,001][106225] Updated weights for policy 1, policy_version 949559 (0.0005) [2023-12-28 02:03:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 485662720. Throughput: 0: 9802.8, 1: 9676.0. Samples: 485649584. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:46,176][105115] Avg episode reward: [(0, '-5.009'), (1, '-5.182')] [2023-12-28 02:03:46,315][106226] Updated weights for policy 0, policy_version 947173 (0.0007) [2023-12-28 02:03:46,377][106226] Updated weights for policy 0, policy_version 947183 (0.0009) [2023-12-28 02:03:46,433][106226] Updated weights for policy 0, policy_version 947193 (0.0005) [2023-12-28 02:03:46,537][106225] Updated weights for policy 1, policy_version 949569 (0.0005) [2023-12-28 02:03:46,592][106225] Updated weights for policy 1, policy_version 949579 (0.0008) [2023-12-28 02:03:46,641][106225] Updated weights for policy 1, policy_version 949589 (0.0008) [2023-12-28 02:03:46,693][106225] Updated weights for policy 1, policy_version 949599 (0.0007) [2023-12-28 02:03:47,102][106226] Updated weights for policy 0, policy_version 947203 (0.0009) [2023-12-28 02:03:47,157][106226] Updated weights for policy 0, policy_version 947213 (0.0011) [2023-12-28 02:03:47,214][106226] Updated weights for policy 0, policy_version 947223 (0.0011) [2023-12-28 02:03:47,386][106225] Updated weights for policy 1, policy_version 949609 (0.0008) [2023-12-28 02:03:47,445][106225] Updated weights for policy 1, policy_version 949619 (0.0005) [2023-12-28 02:03:47,509][106225] Updated weights for policy 1, policy_version 949629 (0.0005) [2023-12-28 02:03:47,926][106226] Updated weights for policy 0, policy_version 947233 (0.0011) [2023-12-28 02:03:47,979][106226] Updated weights for policy 0, policy_version 947243 (0.0010) [2023-12-28 02:03:48,035][106226] Updated weights for policy 0, policy_version 947253 (0.0009) [2023-12-28 02:03:48,098][106226] Updated weights for policy 0, policy_version 947263 (0.0010) [2023-12-28 02:03:48,123][106225] Updated weights for policy 1, policy_version 949639 (0.0007) [2023-12-28 02:03:48,177][106225] Updated weights for policy 1, policy_version 949649 (0.0008) [2023-12-28 02:03:48,240][106225] Updated weights for policy 1, policy_version 949659 (0.0008) [2023-12-28 02:03:48,773][106226] Updated weights for policy 0, policy_version 947273 (0.0010) [2023-12-28 02:03:48,838][106226] Updated weights for policy 0, policy_version 947283 (0.0011) [2023-12-28 02:03:48,905][106226] Updated weights for policy 0, policy_version 947293 (0.0011) [2023-12-28 02:03:49,031][106225] Updated weights for policy 1, policy_version 949669 (0.0009) [2023-12-28 02:03:49,095][106225] Updated weights for policy 1, policy_version 949679 (0.0009) [2023-12-28 02:03:49,156][106225] Updated weights for policy 1, policy_version 949689 (0.0005) [2023-12-28 02:03:49,615][106226] Updated weights for policy 0, policy_version 947303 (0.0011) [2023-12-28 02:03:49,680][106226] Updated weights for policy 0, policy_version 947313 (0.0011) [2023-12-28 02:03:49,748][106226] Updated weights for policy 0, policy_version 947323 (0.0011) [2023-12-28 02:03:49,790][106225] Updated weights for policy 1, policy_version 949699 (0.0005) [2023-12-28 02:03:49,857][106225] Updated weights for policy 1, policy_version 949709 (0.0007) [2023-12-28 02:03:49,919][106225] Updated weights for policy 1, policy_version 949719 (0.0009) [2023-12-28 02:03:50,512][106226] Updated weights for policy 0, policy_version 947333 (0.0010) [2023-12-28 02:03:50,572][106226] Updated weights for policy 0, policy_version 947343 (0.0008) [2023-12-28 02:03:50,636][106225] Updated weights for policy 1, policy_version 949729 (0.0007) [2023-12-28 02:03:50,636][106226] Updated weights for policy 0, policy_version 947353 (0.0009) [2023-12-28 02:03:50,693][106225] Updated weights for policy 1, policy_version 949739 (0.0008) [2023-12-28 02:03:50,747][106225] Updated weights for policy 1, policy_version 949749 (0.0008) [2023-12-28 02:03:50,808][106225] Updated weights for policy 1, policy_version 949759 (0.0008) [2023-12-28 02:03:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 485761024. Throughput: 0: 9761.2, 1: 9732.6. Samples: 485770860. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:51,175][105115] Avg episode reward: [(0, '-4.898'), (1, '-5.026')] [2023-12-28 02:03:51,352][106226] Updated weights for policy 0, policy_version 947363 (0.0008) [2023-12-28 02:03:51,425][106226] Updated weights for policy 0, policy_version 947373 (0.0008) [2023-12-28 02:03:51,487][106226] Updated weights for policy 0, policy_version 947383 (0.0007) [2023-12-28 02:03:51,553][106225] Updated weights for policy 1, policy_version 949769 (0.0009) [2023-12-28 02:03:51,620][106225] Updated weights for policy 1, policy_version 949779 (0.0009) [2023-12-28 02:03:51,685][106225] Updated weights for policy 1, policy_version 949789 (0.0007) [2023-12-28 02:03:52,201][106226] Updated weights for policy 0, policy_version 947393 (0.0007) [2023-12-28 02:03:52,262][106226] Updated weights for policy 0, policy_version 947403 (0.0008) [2023-12-28 02:03:52,336][106226] Updated weights for policy 0, policy_version 947413 (0.0006) [2023-12-28 02:03:52,405][106226] Updated weights for policy 0, policy_version 947423 (0.0008) [2023-12-28 02:03:52,446][106225] Updated weights for policy 1, policy_version 949799 (0.0009) [2023-12-28 02:03:52,504][106225] Updated weights for policy 1, policy_version 949809 (0.0010) [2023-12-28 02:03:52,566][106225] Updated weights for policy 1, policy_version 949819 (0.0010) [2023-12-28 02:03:53,094][106226] Updated weights for policy 0, policy_version 947433 (0.0008) [2023-12-28 02:03:53,147][106226] Updated weights for policy 0, policy_version 947443 (0.0008) [2023-12-28 02:03:53,204][106226] Updated weights for policy 0, policy_version 947453 (0.0008) [2023-12-28 02:03:53,293][106225] Updated weights for policy 1, policy_version 949829 (0.0010) [2023-12-28 02:03:53,356][106225] Updated weights for policy 1, policy_version 949839 (0.0010) [2023-12-28 02:03:53,414][106225] Updated weights for policy 1, policy_version 949849 (0.0009) [2023-12-28 02:03:53,946][106226] Updated weights for policy 0, policy_version 947463 (0.0008) [2023-12-28 02:03:54,006][106226] Updated weights for policy 0, policy_version 947473 (0.0007) [2023-12-28 02:03:54,066][106226] Updated weights for policy 0, policy_version 947483 (0.0007) [2023-12-28 02:03:54,068][106225] Updated weights for policy 1, policy_version 949859 (0.0009) [2023-12-28 02:03:54,126][106225] Updated weights for policy 1, policy_version 949869 (0.0010) [2023-12-28 02:03:54,191][106225] Updated weights for policy 1, policy_version 949879 (0.0010) [2023-12-28 02:03:54,713][106226] Updated weights for policy 0, policy_version 947493 (0.0008) [2023-12-28 02:03:54,752][106225] Updated weights for policy 1, policy_version 949889 (0.0010) [2023-12-28 02:03:54,765][106226] Updated weights for policy 0, policy_version 947503 (0.0010) [2023-12-28 02:03:54,798][106225] Updated weights for policy 1, policy_version 949899 (0.0010) [2023-12-28 02:03:54,819][106226] Updated weights for policy 0, policy_version 947513 (0.0010) [2023-12-28 02:03:54,865][106225] Updated weights for policy 1, policy_version 949909 (0.0010) [2023-12-28 02:03:54,924][106225] Updated weights for policy 1, policy_version 949919 (0.0010) [2023-12-28 02:03:55,463][106226] Updated weights for policy 0, policy_version 947523 (0.0011) [2023-12-28 02:03:55,527][106226] Updated weights for policy 0, policy_version 947533 (0.0005) [2023-12-28 02:03:55,589][106226] Updated weights for policy 0, policy_version 947543 (0.0005) [2023-12-28 02:03:55,618][106225] Updated weights for policy 1, policy_version 949929 (0.0010) [2023-12-28 02:03:55,664][106225] Updated weights for policy 1, policy_version 949939 (0.0010) [2023-12-28 02:03:55,711][106225] Updated weights for policy 1, policy_version 949949 (0.0010) [2023-12-28 02:03:56,163][106226] Updated weights for policy 0, policy_version 947553 (0.0008) [2023-12-28 02:03:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 485859328. Throughput: 0: 9741.1, 1: 9704.0. Samples: 485827080. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:03:56,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.240')] [2023-12-28 02:03:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000949952_243228672.pth... [2023-12-28 02:03:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000948832_242941952.pth [2023-12-28 02:03:56,225][106226] Updated weights for policy 0, policy_version 947563 (0.0007) [2023-12-28 02:03:56,284][106226] Updated weights for policy 0, policy_version 947573 (0.0010) [2023-12-28 02:03:56,350][106226] Updated weights for policy 0, policy_version 947583 (0.0009) [2023-12-28 02:03:56,355][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000947584_242638848.pth... [2023-12-28 02:03:56,360][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000946400_242335744.pth [2023-12-28 02:03:56,377][106225] Updated weights for policy 1, policy_version 949959 (0.0007) [2023-12-28 02:03:56,444][106225] Updated weights for policy 1, policy_version 949969 (0.0007) [2023-12-28 02:03:56,493][106225] Updated weights for policy 1, policy_version 949979 (0.0008) [2023-12-28 02:03:56,882][106226] Updated weights for policy 0, policy_version 947593 (0.0005) [2023-12-28 02:03:56,941][106226] Updated weights for policy 0, policy_version 947603 (0.0009) [2023-12-28 02:03:56,994][106226] Updated weights for policy 0, policy_version 947613 (0.0010) [2023-12-28 02:03:57,138][106225] Updated weights for policy 1, policy_version 949989 (0.0007) [2023-12-28 02:03:57,196][106225] Updated weights for policy 1, policy_version 949999 (0.0005) [2023-12-28 02:03:57,254][106225] Updated weights for policy 1, policy_version 950009 (0.0005) [2023-12-28 02:03:57,621][106226] Updated weights for policy 0, policy_version 947623 (0.0010) [2023-12-28 02:03:57,670][106226] Updated weights for policy 0, policy_version 947633 (0.0006) [2023-12-28 02:03:57,728][106226] Updated weights for policy 0, policy_version 947643 (0.0009) [2023-12-28 02:03:57,799][106225] Updated weights for policy 1, policy_version 950019 (0.0005) [2023-12-28 02:03:57,848][106225] Updated weights for policy 1, policy_version 950029 (0.0005) [2023-12-28 02:03:57,898][106225] Updated weights for policy 1, policy_version 950039 (0.0005) [2023-12-28 02:03:58,424][106226] Updated weights for policy 0, policy_version 947653 (0.0006) [2023-12-28 02:03:58,491][106226] Updated weights for policy 0, policy_version 947663 (0.0008) [2023-12-28 02:03:58,511][106225] Updated weights for policy 1, policy_version 950049 (0.0005) [2023-12-28 02:03:58,555][106226] Updated weights for policy 0, policy_version 947673 (0.0007) [2023-12-28 02:03:58,574][106225] Updated weights for policy 1, policy_version 950059 (0.0008) [2023-12-28 02:03:58,642][106225] Updated weights for policy 1, policy_version 950069 (0.0008) [2023-12-28 02:03:58,705][106225] Updated weights for policy 1, policy_version 950079 (0.0008) [2023-12-28 02:03:59,456][106226] Updated weights for policy 0, policy_version 947683 (0.0008) [2023-12-28 02:03:59,519][106226] Updated weights for policy 0, policy_version 947693 (0.0006) [2023-12-28 02:03:59,581][106226] Updated weights for policy 0, policy_version 947703 (0.0006) [2023-12-28 02:03:59,614][106225] Updated weights for policy 1, policy_version 950089 (0.0010) [2023-12-28 02:03:59,668][106225] Updated weights for policy 1, policy_version 950099 (0.0010) [2023-12-28 02:03:59,723][106225] Updated weights for policy 1, policy_version 950109 (0.0010) [2023-12-28 02:04:00,287][106226] Updated weights for policy 0, policy_version 947713 (0.0006) [2023-12-28 02:04:00,344][106226] Updated weights for policy 0, policy_version 947723 (0.0007) [2023-12-28 02:04:00,402][106226] Updated weights for policy 0, policy_version 947733 (0.0008) [2023-12-28 02:04:00,454][106226] Updated weights for policy 0, policy_version 947743 (0.0007) [2023-12-28 02:04:00,481][106225] Updated weights for policy 1, policy_version 950119 (0.0010) [2023-12-28 02:04:00,537][106225] Updated weights for policy 1, policy_version 950129 (0.0010) [2023-12-28 02:04:00,599][106225] Updated weights for policy 1, policy_version 950139 (0.0010) [2023-12-28 02:04:01,060][106226] Updated weights for policy 0, policy_version 947753 (0.0008) [2023-12-28 02:04:01,119][106226] Updated weights for policy 0, policy_version 947763 (0.0006) [2023-12-28 02:04:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 485957632. Throughput: 0: 9898.6, 1: 9783.1. Samples: 485952480. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:01,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.948')] [2023-12-28 02:04:01,185][106226] Updated weights for policy 0, policy_version 947773 (0.0008) [2023-12-28 02:04:01,339][106225] Updated weights for policy 1, policy_version 950149 (0.0010) [2023-12-28 02:04:01,405][106225] Updated weights for policy 1, policy_version 950159 (0.0012) [2023-12-28 02:04:01,454][106225] Updated weights for policy 1, policy_version 950169 (0.0009) [2023-12-28 02:04:01,892][106226] Updated weights for policy 0, policy_version 947783 (0.0007) [2023-12-28 02:04:01,952][106226] Updated weights for policy 0, policy_version 947793 (0.0007) [2023-12-28 02:04:02,013][106226] Updated weights for policy 0, policy_version 947803 (0.0008) [2023-12-28 02:04:02,197][106225] Updated weights for policy 1, policy_version 950179 (0.0010) [2023-12-28 02:04:02,259][106225] Updated weights for policy 1, policy_version 950189 (0.0008) [2023-12-28 02:04:02,313][106225] Updated weights for policy 1, policy_version 950199 (0.0010) [2023-12-28 02:04:02,747][106226] Updated weights for policy 0, policy_version 947813 (0.0008) [2023-12-28 02:04:02,813][106226] Updated weights for policy 0, policy_version 947823 (0.0008) [2023-12-28 02:04:02,872][106226] Updated weights for policy 0, policy_version 947833 (0.0008) [2023-12-28 02:04:03,045][106225] Updated weights for policy 1, policy_version 950209 (0.0009) [2023-12-28 02:04:03,115][106225] Updated weights for policy 1, policy_version 950219 (0.0011) [2023-12-28 02:04:03,183][106225] Updated weights for policy 1, policy_version 950229 (0.0010) [2023-12-28 02:04:03,240][106225] Updated weights for policy 1, policy_version 950239 (0.0010) [2023-12-28 02:04:03,519][106226] Updated weights for policy 0, policy_version 947843 (0.0007) [2023-12-28 02:04:03,574][106226] Updated weights for policy 0, policy_version 947853 (0.0005) [2023-12-28 02:04:03,632][106226] Updated weights for policy 0, policy_version 947863 (0.0005) [2023-12-28 02:04:03,890][106225] Updated weights for policy 1, policy_version 950249 (0.0010) [2023-12-28 02:04:03,957][106225] Updated weights for policy 1, policy_version 950259 (0.0010) [2023-12-28 02:04:04,013][106225] Updated weights for policy 1, policy_version 950269 (0.0010) [2023-12-28 02:04:04,214][106226] Updated weights for policy 0, policy_version 947873 (0.0006) [2023-12-28 02:04:04,272][106226] Updated weights for policy 0, policy_version 947883 (0.0011) [2023-12-28 02:04:04,333][106226] Updated weights for policy 0, policy_version 947893 (0.0011) [2023-12-28 02:04:04,400][106226] Updated weights for policy 0, policy_version 947903 (0.0010) [2023-12-28 02:04:04,748][106225] Updated weights for policy 1, policy_version 950279 (0.0009) [2023-12-28 02:04:04,806][106225] Updated weights for policy 1, policy_version 950289 (0.0008) [2023-12-28 02:04:04,868][106225] Updated weights for policy 1, policy_version 950299 (0.0006) [2023-12-28 02:04:05,084][106226] Updated weights for policy 0, policy_version 947913 (0.0006) [2023-12-28 02:04:05,157][106226] Updated weights for policy 0, policy_version 947923 (0.0005) [2023-12-28 02:04:05,224][106226] Updated weights for policy 0, policy_version 947933 (0.0007) [2023-12-28 02:04:05,483][106225] Updated weights for policy 1, policy_version 950309 (0.0007) [2023-12-28 02:04:05,549][106225] Updated weights for policy 1, policy_version 950319 (0.0006) [2023-12-28 02:04:05,613][106225] Updated weights for policy 1, policy_version 950329 (0.0005) [2023-12-28 02:04:05,721][106226] Updated weights for policy 0, policy_version 947943 (0.0005) [2023-12-28 02:04:05,785][106226] Updated weights for policy 0, policy_version 947953 (0.0005) [2023-12-28 02:04:05,844][106226] Updated weights for policy 0, policy_version 947963 (0.0005) [2023-12-28 02:04:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 486064128. Throughput: 0: 10042.1, 1: 9749.2. Samples: 486075352. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:06,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-5.057')] [2023-12-28 02:04:06,243][106225] Updated weights for policy 1, policy_version 950339 (0.0007) [2023-12-28 02:04:06,306][106225] Updated weights for policy 1, policy_version 950349 (0.0008) [2023-12-28 02:04:06,369][106225] Updated weights for policy 1, policy_version 950359 (0.0010) [2023-12-28 02:04:06,446][106226] Updated weights for policy 0, policy_version 947973 (0.0008) [2023-12-28 02:04:06,507][106226] Updated weights for policy 0, policy_version 947983 (0.0008) [2023-12-28 02:04:06,572][106226] Updated weights for policy 0, policy_version 947993 (0.0007) [2023-12-28 02:04:07,080][106225] Updated weights for policy 1, policy_version 950369 (0.0011) [2023-12-28 02:04:07,131][106225] Updated weights for policy 1, policy_version 950379 (0.0010) [2023-12-28 02:04:07,152][106226] Updated weights for policy 0, policy_version 948003 (0.0008) [2023-12-28 02:04:07,188][106225] Updated weights for policy 1, policy_version 950389 (0.0010) [2023-12-28 02:04:07,213][106226] Updated weights for policy 0, policy_version 948013 (0.0005) [2023-12-28 02:04:07,242][106225] Updated weights for policy 1, policy_version 950399 (0.0010) [2023-12-28 02:04:07,273][106226] Updated weights for policy 0, policy_version 948023 (0.0007) [2023-12-28 02:04:07,904][106226] Updated weights for policy 0, policy_version 948033 (0.0007) [2023-12-28 02:04:07,961][106225] Updated weights for policy 1, policy_version 950409 (0.0010) [2023-12-28 02:04:07,963][106226] Updated weights for policy 0, policy_version 948043 (0.0008) [2023-12-28 02:04:08,009][106225] Updated weights for policy 1, policy_version 950419 (0.0008) [2023-12-28 02:04:08,028][106226] Updated weights for policy 0, policy_version 948053 (0.0006) [2023-12-28 02:04:08,053][106225] Updated weights for policy 1, policy_version 950429 (0.0010) [2023-12-28 02:04:08,096][106226] Updated weights for policy 0, policy_version 948063 (0.0005) [2023-12-28 02:04:08,761][106226] Updated weights for policy 0, policy_version 948073 (0.0008) [2023-12-28 02:04:08,821][106226] Updated weights for policy 0, policy_version 948083 (0.0009) [2023-12-28 02:04:08,824][106225] Updated weights for policy 1, policy_version 950439 (0.0010) [2023-12-28 02:04:08,881][106226] Updated weights for policy 0, policy_version 948093 (0.0009) [2023-12-28 02:04:08,887][106225] Updated weights for policy 1, policy_version 950449 (0.0011) [2023-12-28 02:04:08,944][106225] Updated weights for policy 1, policy_version 950459 (0.0010) [2023-12-28 02:04:09,618][106226] Updated weights for policy 0, policy_version 948103 (0.0007) [2023-12-28 02:04:09,676][106225] Updated weights for policy 1, policy_version 950469 (0.0009) [2023-12-28 02:04:09,679][106226] Updated weights for policy 0, policy_version 948113 (0.0007) [2023-12-28 02:04:09,738][106225] Updated weights for policy 1, policy_version 950479 (0.0011) [2023-12-28 02:04:09,743][106226] Updated weights for policy 0, policy_version 948123 (0.0008) [2023-12-28 02:04:09,799][106225] Updated weights for policy 1, policy_version 950489 (0.0010) [2023-12-28 02:04:10,502][106226] Updated weights for policy 0, policy_version 948133 (0.0007) [2023-12-28 02:04:10,558][106225] Updated weights for policy 1, policy_version 950499 (0.0009) [2023-12-28 02:04:10,560][106226] Updated weights for policy 0, policy_version 948143 (0.0007) [2023-12-28 02:04:10,620][106226] Updated weights for policy 0, policy_version 948153 (0.0006) [2023-12-28 02:04:10,622][106225] Updated weights for policy 1, policy_version 950509 (0.0008) [2023-12-28 02:04:10,682][106225] Updated weights for policy 1, policy_version 950519 (0.0007) [2023-12-28 02:04:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 486162432. Throughput: 0: 10064.0, 1: 9786.2. Samples: 486135744. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:11,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.974')] [2023-12-28 02:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000950528_243376128.pth... [2023-12-28 02:04:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000948160_242786304.pth... [2023-12-28 02:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000949376_243081216.pth [2023-12-28 02:04:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000947008_242491392.pth [2023-12-28 02:04:11,378][106226] Updated weights for policy 0, policy_version 948163 (0.0007) [2023-12-28 02:04:11,443][106225] Updated weights for policy 1, policy_version 950529 (0.0009) [2023-12-28 02:04:11,448][106226] Updated weights for policy 0, policy_version 948173 (0.0006) [2023-12-28 02:04:11,506][106225] Updated weights for policy 1, policy_version 950539 (0.0008) [2023-12-28 02:04:11,510][106226] Updated weights for policy 0, policy_version 948183 (0.0006) [2023-12-28 02:04:11,574][106225] Updated weights for policy 1, policy_version 950549 (0.0006) [2023-12-28 02:04:11,658][106225] Updated weights for policy 1, policy_version 950559 (0.0008) [2023-12-28 02:04:12,261][106226] Updated weights for policy 0, policy_version 948193 (0.0008) [2023-12-28 02:04:12,326][106226] Updated weights for policy 0, policy_version 948203 (0.0008) [2023-12-28 02:04:12,351][106225] Updated weights for policy 1, policy_version 950569 (0.0008) [2023-12-28 02:04:12,410][106225] Updated weights for policy 1, policy_version 950579 (0.0008) [2023-12-28 02:04:12,416][106226] Updated weights for policy 0, policy_version 948213 (0.0008) [2023-12-28 02:04:12,465][106225] Updated weights for policy 1, policy_version 950589 (0.0008) [2023-12-28 02:04:12,475][106226] Updated weights for policy 0, policy_version 948223 (0.0007) [2023-12-28 02:04:13,098][106225] Updated weights for policy 1, policy_version 950599 (0.0008) [2023-12-28 02:04:13,158][106225] Updated weights for policy 1, policy_version 950609 (0.0007) [2023-12-28 02:04:13,170][106226] Updated weights for policy 0, policy_version 948233 (0.0007) [2023-12-28 02:04:13,211][106225] Updated weights for policy 1, policy_version 950619 (0.0009) [2023-12-28 02:04:13,231][106226] Updated weights for policy 0, policy_version 948243 (0.0008) [2023-12-28 02:04:13,287][106226] Updated weights for policy 0, policy_version 948253 (0.0009) [2023-12-28 02:04:13,739][106225] Updated weights for policy 1, policy_version 950629 (0.0005) [2023-12-28 02:04:13,806][106225] Updated weights for policy 1, policy_version 950639 (0.0010) [2023-12-28 02:04:13,867][106225] Updated weights for policy 1, policy_version 950649 (0.0011) [2023-12-28 02:04:14,061][106226] Updated weights for policy 0, policy_version 948263 (0.0009) [2023-12-28 02:04:14,119][106226] Updated weights for policy 0, policy_version 948273 (0.0008) [2023-12-28 02:04:14,184][106226] Updated weights for policy 0, policy_version 948283 (0.0008) [2023-12-28 02:04:14,567][106225] Updated weights for policy 1, policy_version 950659 (0.0011) [2023-12-28 02:04:14,627][106225] Updated weights for policy 1, policy_version 950669 (0.0010) [2023-12-28 02:04:14,688][106225] Updated weights for policy 1, policy_version 950679 (0.0010) [2023-12-28 02:04:14,892][106226] Updated weights for policy 0, policy_version 948293 (0.0008) [2023-12-28 02:04:14,959][106226] Updated weights for policy 0, policy_version 948303 (0.0008) [2023-12-28 02:04:15,027][106226] Updated weights for policy 0, policy_version 948313 (0.0008) [2023-12-28 02:04:15,375][106225] Updated weights for policy 1, policy_version 950689 (0.0010) [2023-12-28 02:04:15,440][106225] Updated weights for policy 1, policy_version 950699 (0.0011) [2023-12-28 02:04:15,501][106225] Updated weights for policy 1, policy_version 950709 (0.0011) [2023-12-28 02:04:15,567][106225] Updated weights for policy 1, policy_version 950719 (0.0010) [2023-12-28 02:04:15,647][106226] Updated weights for policy 0, policy_version 948323 (0.0009) [2023-12-28 02:04:15,701][106226] Updated weights for policy 0, policy_version 948333 (0.0010) [2023-12-28 02:04:15,759][106226] Updated weights for policy 0, policy_version 948343 (0.0010) [2023-12-28 02:04:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 486260736. Throughput: 0: 9945.3, 1: 9817.6. Samples: 486250760. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:16,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.174')] [2023-12-28 02:04:16,268][106225] Updated weights for policy 1, policy_version 950729 (0.0009) [2023-12-28 02:04:16,319][106225] Updated weights for policy 1, policy_version 950739 (0.0008) [2023-12-28 02:04:16,367][106225] Updated weights for policy 1, policy_version 950749 (0.0009) [2023-12-28 02:04:16,406][106226] Updated weights for policy 0, policy_version 948353 (0.0010) [2023-12-28 02:04:16,461][106226] Updated weights for policy 0, policy_version 948363 (0.0005) [2023-12-28 02:04:16,517][106226] Updated weights for policy 0, policy_version 948373 (0.0005) [2023-12-28 02:04:16,575][106226] Updated weights for policy 0, policy_version 948383 (0.0005) [2023-12-28 02:04:17,055][106225] Updated weights for policy 1, policy_version 950759 (0.0007) [2023-12-28 02:04:17,116][106225] Updated weights for policy 1, policy_version 950769 (0.0008) [2023-12-28 02:04:17,176][106225] Updated weights for policy 1, policy_version 950779 (0.0010) [2023-12-28 02:04:17,212][106226] Updated weights for policy 0, policy_version 948393 (0.0010) [2023-12-28 02:04:17,269][106226] Updated weights for policy 0, policy_version 948403 (0.0010) [2023-12-28 02:04:17,325][106226] Updated weights for policy 0, policy_version 948413 (0.0010) [2023-12-28 02:04:17,689][106225] Updated weights for policy 1, policy_version 950789 (0.0005) [2023-12-28 02:04:17,754][106225] Updated weights for policy 1, policy_version 950799 (0.0006) [2023-12-28 02:04:17,818][106225] Updated weights for policy 1, policy_version 950809 (0.0007) [2023-12-28 02:04:18,050][106226] Updated weights for policy 0, policy_version 948423 (0.0010) [2023-12-28 02:04:18,110][106226] Updated weights for policy 0, policy_version 948433 (0.0010) [2023-12-28 02:04:18,163][106226] Updated weights for policy 0, policy_version 948443 (0.0011) [2023-12-28 02:04:18,493][106225] Updated weights for policy 1, policy_version 950819 (0.0010) [2023-12-28 02:04:18,549][106225] Updated weights for policy 1, policy_version 950829 (0.0008) [2023-12-28 02:04:18,605][106225] Updated weights for policy 1, policy_version 950839 (0.0008) [2023-12-28 02:04:18,921][106226] Updated weights for policy 0, policy_version 948453 (0.0009) [2023-12-28 02:04:18,979][106226] Updated weights for policy 0, policy_version 948463 (0.0007) [2023-12-28 02:04:19,027][106226] Updated weights for policy 0, policy_version 948473 (0.0005) [2023-12-28 02:04:19,332][106225] Updated weights for policy 1, policy_version 950849 (0.0007) [2023-12-28 02:04:19,392][106225] Updated weights for policy 1, policy_version 950859 (0.0009) [2023-12-28 02:04:19,456][106225] Updated weights for policy 1, policy_version 950869 (0.0007) [2023-12-28 02:04:19,526][106225] Updated weights for policy 1, policy_version 950879 (0.0007) [2023-12-28 02:04:19,717][106226] Updated weights for policy 0, policy_version 948483 (0.0006) [2023-12-28 02:04:19,782][106226] Updated weights for policy 0, policy_version 948493 (0.0008) [2023-12-28 02:04:19,847][106226] Updated weights for policy 0, policy_version 948503 (0.0009) [2023-12-28 02:04:20,209][106225] Updated weights for policy 1, policy_version 950889 (0.0007) [2023-12-28 02:04:20,279][106225] Updated weights for policy 1, policy_version 950899 (0.0009) [2023-12-28 02:04:20,345][106225] Updated weights for policy 1, policy_version 950909 (0.0007) [2023-12-28 02:04:20,542][106226] Updated weights for policy 0, policy_version 948513 (0.0009) [2023-12-28 02:04:20,608][106226] Updated weights for policy 0, policy_version 948523 (0.0008) [2023-12-28 02:04:20,671][106226] Updated weights for policy 0, policy_version 948533 (0.0008) [2023-12-28 02:04:20,734][106226] Updated weights for policy 0, policy_version 948543 (0.0009) [2023-12-28 02:04:21,083][106225] Updated weights for policy 1, policy_version 950919 (0.0008) [2023-12-28 02:04:21,147][106225] Updated weights for policy 1, policy_version 950929 (0.0008) [2023-12-28 02:04:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 486359040. Throughput: 0: 9919.1, 1: 9931.2. Samples: 486372372. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:21,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-4.792')] [2023-12-28 02:04:21,211][106225] Updated weights for policy 1, policy_version 950939 (0.0009) [2023-12-28 02:04:21,604][106226] Updated weights for policy 0, policy_version 948553 (0.0010) [2023-12-28 02:04:21,673][106226] Updated weights for policy 0, policy_version 948563 (0.0008) [2023-12-28 02:04:21,744][106226] Updated weights for policy 0, policy_version 948573 (0.0010) [2023-12-28 02:04:21,924][106225] Updated weights for policy 1, policy_version 950949 (0.0009) [2023-12-28 02:04:21,979][106225] Updated weights for policy 1, policy_version 950959 (0.0005) [2023-12-28 02:04:22,042][106225] Updated weights for policy 1, policy_version 950969 (0.0005) [2023-12-28 02:04:22,508][106226] Updated weights for policy 0, policy_version 948583 (0.0011) [2023-12-28 02:04:22,584][106226] Updated weights for policy 0, policy_version 948593 (0.0011) [2023-12-28 02:04:22,654][106226] Updated weights for policy 0, policy_version 948603 (0.0011) [2023-12-28 02:04:22,707][106225] Updated weights for policy 1, policy_version 950979 (0.0006) [2023-12-28 02:04:22,773][106225] Updated weights for policy 1, policy_version 950989 (0.0006) [2023-12-28 02:04:22,839][106225] Updated weights for policy 1, policy_version 950999 (0.0007) [2023-12-28 02:04:23,347][106226] Updated weights for policy 0, policy_version 948613 (0.0011) [2023-12-28 02:04:23,425][106226] Updated weights for policy 0, policy_version 948623 (0.0011) [2023-12-28 02:04:23,461][106225] Updated weights for policy 1, policy_version 951009 (0.0005) [2023-12-28 02:04:23,486][106226] Updated weights for policy 0, policy_version 948633 (0.0006) [2023-12-28 02:04:23,523][106225] Updated weights for policy 1, policy_version 951019 (0.0006) [2023-12-28 02:04:23,573][106225] Updated weights for policy 1, policy_version 951029 (0.0005) [2023-12-28 02:04:23,619][106225] Updated weights for policy 1, policy_version 951039 (0.0005) [2023-12-28 02:04:24,048][106226] Updated weights for policy 0, policy_version 948643 (0.0005) [2023-12-28 02:04:24,104][106226] Updated weights for policy 0, policy_version 948653 (0.0010) [2023-12-28 02:04:24,158][106226] Updated weights for policy 0, policy_version 948663 (0.0010) [2023-12-28 02:04:24,265][106225] Updated weights for policy 1, policy_version 951049 (0.0006) [2023-12-28 02:04:24,327][106225] Updated weights for policy 1, policy_version 951059 (0.0006) [2023-12-28 02:04:24,387][106225] Updated weights for policy 1, policy_version 951069 (0.0006) [2023-12-28 02:04:24,802][106226] Updated weights for policy 0, policy_version 948673 (0.0011) [2023-12-28 02:04:24,859][106226] Updated weights for policy 0, policy_version 948683 (0.0011) [2023-12-28 02:04:24,905][106226] Updated weights for policy 0, policy_version 948693 (0.0010) [2023-12-28 02:04:24,962][106226] Updated weights for policy 0, policy_version 948703 (0.0011) [2023-12-28 02:04:24,992][106225] Updated weights for policy 1, policy_version 951079 (0.0005) [2023-12-28 02:04:25,050][106225] Updated weights for policy 1, policy_version 951089 (0.0006) [2023-12-28 02:04:25,115][106225] Updated weights for policy 1, policy_version 951099 (0.0005) [2023-12-28 02:04:25,677][106226] Updated weights for policy 0, policy_version 948713 (0.0009) [2023-12-28 02:04:25,732][106226] Updated weights for policy 0, policy_version 948723 (0.0009) [2023-12-28 02:04:25,771][106225] Updated weights for policy 1, policy_version 951109 (0.0005) [2023-12-28 02:04:25,779][106226] Updated weights for policy 0, policy_version 948733 (0.0007) [2023-12-28 02:04:25,838][106225] Updated weights for policy 1, policy_version 951119 (0.0005) [2023-12-28 02:04:25,900][106225] Updated weights for policy 1, policy_version 951129 (0.0006) [2023-12-28 02:04:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 486465536. Throughput: 0: 9916.3, 1: 9978.7. Samples: 486431952. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:26,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-4.984')] [2023-12-28 02:04:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000948736_242933760.pth... [2023-12-28 02:04:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000951136_243531776.pth... [2023-12-28 02:04:26,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000949952_243228672.pth [2023-12-28 02:04:26,196][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000947584_242638848.pth [2023-12-28 02:04:26,374][106226] Updated weights for policy 0, policy_version 948743 (0.0005) [2023-12-28 02:04:26,420][106226] Updated weights for policy 0, policy_version 948753 (0.0005) [2023-12-28 02:04:26,468][106226] Updated weights for policy 0, policy_version 948763 (0.0005) [2023-12-28 02:04:26,668][106225] Updated weights for policy 1, policy_version 951139 (0.0008) [2023-12-28 02:04:26,723][106225] Updated weights for policy 1, policy_version 951149 (0.0007) [2023-12-28 02:04:26,766][106225] Updated weights for policy 1, policy_version 951159 (0.0008) [2023-12-28 02:04:27,092][106226] Updated weights for policy 0, policy_version 948773 (0.0007) [2023-12-28 02:04:27,145][106226] Updated weights for policy 0, policy_version 948783 (0.0009) [2023-12-28 02:04:27,196][106226] Updated weights for policy 0, policy_version 948793 (0.0008) [2023-12-28 02:04:27,511][106225] Updated weights for policy 1, policy_version 951169 (0.0008) [2023-12-28 02:04:27,559][106225] Updated weights for policy 1, policy_version 951179 (0.0008) [2023-12-28 02:04:27,606][106225] Updated weights for policy 1, policy_version 951189 (0.0008) [2023-12-28 02:04:27,656][106225] Updated weights for policy 1, policy_version 951199 (0.0008) [2023-12-28 02:04:27,888][106226] Updated weights for policy 0, policy_version 948803 (0.0007) [2023-12-28 02:04:27,939][106226] Updated weights for policy 0, policy_version 948813 (0.0005) [2023-12-28 02:04:28,001][106226] Updated weights for policy 0, policy_version 948823 (0.0007) [2023-12-28 02:04:28,411][106225] Updated weights for policy 1, policy_version 951209 (0.0009) [2023-12-28 02:04:28,469][106225] Updated weights for policy 1, policy_version 951219 (0.0008) [2023-12-28 02:04:28,523][106225] Updated weights for policy 1, policy_version 951229 (0.0008) [2023-12-28 02:04:28,686][106226] Updated weights for policy 0, policy_version 948833 (0.0009) [2023-12-28 02:04:28,749][106226] Updated weights for policy 0, policy_version 948843 (0.0009) [2023-12-28 02:04:28,809][106226] Updated weights for policy 0, policy_version 948853 (0.0008) [2023-12-28 02:04:28,867][106226] Updated weights for policy 0, policy_version 948863 (0.0008) [2023-12-28 02:04:29,286][106225] Updated weights for policy 1, policy_version 951239 (0.0008) [2023-12-28 02:04:29,350][106225] Updated weights for policy 1, policy_version 951249 (0.0008) [2023-12-28 02:04:29,409][106225] Updated weights for policy 1, policy_version 951259 (0.0008) [2023-12-28 02:04:29,559][106226] Updated weights for policy 0, policy_version 948873 (0.0007) [2023-12-28 02:04:29,616][106226] Updated weights for policy 0, policy_version 948883 (0.0005) [2023-12-28 02:04:29,667][106226] Updated weights for policy 0, policy_version 948893 (0.0006) [2023-12-28 02:04:30,125][106225] Updated weights for policy 1, policy_version 951269 (0.0008) [2023-12-28 02:04:30,191][106225] Updated weights for policy 1, policy_version 951279 (0.0006) [2023-12-28 02:04:30,254][106225] Updated weights for policy 1, policy_version 951289 (0.0005) [2023-12-28 02:04:30,397][106226] Updated weights for policy 0, policy_version 948903 (0.0009) [2023-12-28 02:04:30,446][106226] Updated weights for policy 0, policy_version 948913 (0.0009) [2023-12-28 02:04:30,505][106226] Updated weights for policy 0, policy_version 948923 (0.0009) [2023-12-28 02:04:30,867][106225] Updated weights for policy 1, policy_version 951299 (0.0006) [2023-12-28 02:04:30,912][106225] Updated weights for policy 1, policy_version 951309 (0.0008) [2023-12-28 02:04:30,970][106225] Updated weights for policy 1, policy_version 951319 (0.0007) [2023-12-28 02:04:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 486563840. Throughput: 0: 10031.9, 1: 10042.6. Samples: 486552932. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:31,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.186')] [2023-12-28 02:04:31,277][106226] Updated weights for policy 0, policy_version 948933 (0.0008) [2023-12-28 02:04:31,337][106226] Updated weights for policy 0, policy_version 948943 (0.0006) [2023-12-28 02:04:31,396][106226] Updated weights for policy 0, policy_version 948953 (0.0007) [2023-12-28 02:04:31,736][106225] Updated weights for policy 1, policy_version 951329 (0.0007) [2023-12-28 02:04:31,799][106225] Updated weights for policy 1, policy_version 951339 (0.0009) [2023-12-28 02:04:31,860][106225] Updated weights for policy 1, policy_version 951349 (0.0007) [2023-12-28 02:04:31,925][106225] Updated weights for policy 1, policy_version 951359 (0.0008) [2023-12-28 02:04:32,096][106226] Updated weights for policy 0, policy_version 948963 (0.0010) [2023-12-28 02:04:32,152][106226] Updated weights for policy 0, policy_version 948973 (0.0008) [2023-12-28 02:04:32,207][106226] Updated weights for policy 0, policy_version 948983 (0.0009) [2023-12-28 02:04:32,574][106225] Updated weights for policy 1, policy_version 951369 (0.0008) [2023-12-28 02:04:32,630][106225] Updated weights for policy 1, policy_version 951379 (0.0008) [2023-12-28 02:04:32,689][106225] Updated weights for policy 1, policy_version 951389 (0.0008) [2023-12-28 02:04:32,969][106226] Updated weights for policy 0, policy_version 948993 (0.0008) [2023-12-28 02:04:33,028][106226] Updated weights for policy 0, policy_version 949003 (0.0009) [2023-12-28 02:04:33,076][106226] Updated weights for policy 0, policy_version 949013 (0.0009) [2023-12-28 02:04:33,127][106226] Updated weights for policy 0, policy_version 949023 (0.0008) [2023-12-28 02:04:33,426][106225] Updated weights for policy 1, policy_version 951399 (0.0008) [2023-12-28 02:04:33,474][106225] Updated weights for policy 1, policy_version 951409 (0.0008) [2023-12-28 02:04:33,546][106225] Updated weights for policy 1, policy_version 951419 (0.0009) [2023-12-28 02:04:33,724][106226] Updated weights for policy 0, policy_version 949033 (0.0008) [2023-12-28 02:04:33,775][106226] Updated weights for policy 0, policy_version 949043 (0.0007) [2023-12-28 02:04:33,840][106226] Updated weights for policy 0, policy_version 949053 (0.0006) [2023-12-28 02:04:34,235][106225] Updated weights for policy 1, policy_version 951429 (0.0010) [2023-12-28 02:04:34,301][106225] Updated weights for policy 1, policy_version 951439 (0.0008) [2023-12-28 02:04:34,365][106225] Updated weights for policy 1, policy_version 951449 (0.0008) [2023-12-28 02:04:34,601][106226] Updated weights for policy 0, policy_version 949063 (0.0008) [2023-12-28 02:04:34,671][106226] Updated weights for policy 0, policy_version 949073 (0.0008) [2023-12-28 02:04:34,734][106226] Updated weights for policy 0, policy_version 949083 (0.0009) [2023-12-28 02:04:35,133][106225] Updated weights for policy 1, policy_version 951459 (0.0009) [2023-12-28 02:04:35,182][106225] Updated weights for policy 1, policy_version 951469 (0.0008) [2023-12-28 02:04:35,240][106225] Updated weights for policy 1, policy_version 951479 (0.0008) [2023-12-28 02:04:35,381][106226] Updated weights for policy 0, policy_version 949093 (0.0008) [2023-12-28 02:04:35,433][106226] Updated weights for policy 0, policy_version 949103 (0.0008) [2023-12-28 02:04:35,484][106226] Updated weights for policy 0, policy_version 949113 (0.0008) [2023-12-28 02:04:35,902][106225] Updated weights for policy 1, policy_version 951489 (0.0008) [2023-12-28 02:04:35,951][106225] Updated weights for policy 1, policy_version 951499 (0.0005) [2023-12-28 02:04:35,999][106225] Updated weights for policy 1, policy_version 951509 (0.0007) [2023-12-28 02:04:36,049][106225] Updated weights for policy 1, policy_version 951519 (0.0010) [2023-12-28 02:04:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 486662144. Throughput: 0: 10036.6, 1: 9953.9. Samples: 486670432. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:36,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.906')] [2023-12-28 02:04:36,253][106226] Updated weights for policy 0, policy_version 949123 (0.0008) [2023-12-28 02:04:36,308][106226] Updated weights for policy 0, policy_version 949133 (0.0008) [2023-12-28 02:04:36,370][106226] Updated weights for policy 0, policy_version 949143 (0.0008) [2023-12-28 02:04:36,761][106225] Updated weights for policy 1, policy_version 951529 (0.0008) [2023-12-28 02:04:36,818][106225] Updated weights for policy 1, policy_version 951539 (0.0010) [2023-12-28 02:04:36,882][106225] Updated weights for policy 1, policy_version 951549 (0.0010) [2023-12-28 02:04:37,096][106226] Updated weights for policy 0, policy_version 949153 (0.0009) [2023-12-28 02:04:37,161][106226] Updated weights for policy 0, policy_version 949163 (0.0011) [2023-12-28 02:04:37,229][106226] Updated weights for policy 0, policy_version 949173 (0.0011) [2023-12-28 02:04:37,293][106226] Updated weights for policy 0, policy_version 949183 (0.0009) [2023-12-28 02:04:37,578][106225] Updated weights for policy 1, policy_version 951559 (0.0010) [2023-12-28 02:04:37,634][106225] Updated weights for policy 1, policy_version 951569 (0.0010) [2023-12-28 02:04:37,691][106225] Updated weights for policy 1, policy_version 951579 (0.0010) [2023-12-28 02:04:37,981][106226] Updated weights for policy 0, policy_version 949193 (0.0009) [2023-12-28 02:04:38,035][106226] Updated weights for policy 0, policy_version 949203 (0.0009) [2023-12-28 02:04:38,095][106226] Updated weights for policy 0, policy_version 949213 (0.0009) [2023-12-28 02:04:38,288][106225] Updated weights for policy 1, policy_version 951589 (0.0008) [2023-12-28 02:04:38,358][106225] Updated weights for policy 1, policy_version 951599 (0.0010) [2023-12-28 02:04:38,415][106225] Updated weights for policy 1, policy_version 951609 (0.0010) [2023-12-28 02:04:38,860][106226] Updated weights for policy 0, policy_version 949223 (0.0007) [2023-12-28 02:04:38,918][106226] Updated weights for policy 0, policy_version 949233 (0.0005) [2023-12-28 02:04:38,982][106226] Updated weights for policy 0, policy_version 949243 (0.0005) [2023-12-28 02:04:39,151][106225] Updated weights for policy 1, policy_version 951619 (0.0009) [2023-12-28 02:04:39,219][106225] Updated weights for policy 1, policy_version 951629 (0.0006) [2023-12-28 02:04:39,283][106225] Updated weights for policy 1, policy_version 951639 (0.0008) [2023-12-28 02:04:39,677][106226] Updated weights for policy 0, policy_version 949253 (0.0007) [2023-12-28 02:04:39,739][106226] Updated weights for policy 0, policy_version 949263 (0.0009) [2023-12-28 02:04:39,799][106226] Updated weights for policy 0, policy_version 949273 (0.0009) [2023-12-28 02:04:39,991][106225] Updated weights for policy 1, policy_version 951649 (0.0008) [2023-12-28 02:04:40,058][106225] Updated weights for policy 1, policy_version 951659 (0.0008) [2023-12-28 02:04:40,126][106225] Updated weights for policy 1, policy_version 951669 (0.0008) [2023-12-28 02:04:40,192][106225] Updated weights for policy 1, policy_version 951679 (0.0009) [2023-12-28 02:04:40,534][106226] Updated weights for policy 0, policy_version 949283 (0.0009) [2023-12-28 02:04:40,594][106226] Updated weights for policy 0, policy_version 949293 (0.0009) [2023-12-28 02:04:40,654][106226] Updated weights for policy 0, policy_version 949303 (0.0009) [2023-12-28 02:04:40,879][106225] Updated weights for policy 1, policy_version 951689 (0.0006) [2023-12-28 02:04:40,938][106225] Updated weights for policy 1, policy_version 951699 (0.0005) [2023-12-28 02:04:40,992][106225] Updated weights for policy 1, policy_version 951709 (0.0007) [2023-12-28 02:04:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 486760448. Throughput: 0: 10050.8, 1: 10027.1. Samples: 486730580. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:41,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.010')] [2023-12-28 02:04:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000949312_243081216.pth... [2023-12-28 02:04:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000951712_243679232.pth... [2023-12-28 02:04:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000950528_243376128.pth [2023-12-28 02:04:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000948160_242786304.pth [2023-12-28 02:04:41,382][106226] Updated weights for policy 0, policy_version 949313 (0.0008) [2023-12-28 02:04:41,447][106226] Updated weights for policy 0, policy_version 949323 (0.0006) [2023-12-28 02:04:41,515][106226] Updated weights for policy 0, policy_version 949333 (0.0007) [2023-12-28 02:04:41,575][106226] Updated weights for policy 0, policy_version 949343 (0.0009) [2023-12-28 02:04:41,717][106225] Updated weights for policy 1, policy_version 951719 (0.0006) [2023-12-28 02:04:41,783][106225] Updated weights for policy 1, policy_version 951729 (0.0008) [2023-12-28 02:04:41,851][106225] Updated weights for policy 1, policy_version 951739 (0.0008) [2023-12-28 02:04:42,304][106226] Updated weights for policy 0, policy_version 949353 (0.0008) [2023-12-28 02:04:42,377][106226] Updated weights for policy 0, policy_version 949363 (0.0008) [2023-12-28 02:04:42,442][106226] Updated weights for policy 0, policy_version 949373 (0.0010) [2023-12-28 02:04:42,546][106225] Updated weights for policy 1, policy_version 951749 (0.0007) [2023-12-28 02:04:42,606][106225] Updated weights for policy 1, policy_version 951759 (0.0005) [2023-12-28 02:04:42,660][106225] Updated weights for policy 1, policy_version 951769 (0.0005) [2023-12-28 02:04:43,114][106226] Updated weights for policy 0, policy_version 949383 (0.0009) [2023-12-28 02:04:43,180][106226] Updated weights for policy 0, policy_version 949393 (0.0007) [2023-12-28 02:04:43,236][106226] Updated weights for policy 0, policy_version 949403 (0.0011) [2023-12-28 02:04:43,302][106225] Updated weights for policy 1, policy_version 951779 (0.0005) [2023-12-28 02:04:43,368][106225] Updated weights for policy 1, policy_version 951789 (0.0008) [2023-12-28 02:04:43,421][106225] Updated weights for policy 1, policy_version 951799 (0.0008) [2023-12-28 02:04:43,897][106226] Updated weights for policy 0, policy_version 949413 (0.0011) [2023-12-28 02:04:43,963][106226] Updated weights for policy 0, policy_version 949423 (0.0010) [2023-12-28 02:04:44,022][106226] Updated weights for policy 0, policy_version 949433 (0.0010) [2023-12-28 02:04:44,044][106225] Updated weights for policy 1, policy_version 951809 (0.0008) [2023-12-28 02:04:44,126][106225] Updated weights for policy 1, policy_version 951819 (0.0008) [2023-12-28 02:04:44,182][106225] Updated weights for policy 1, policy_version 951829 (0.0008) [2023-12-28 02:04:44,243][106225] Updated weights for policy 1, policy_version 951839 (0.0010) [2023-12-28 02:04:44,719][106226] Updated weights for policy 0, policy_version 949443 (0.0010) [2023-12-28 02:04:44,791][106226] Updated weights for policy 0, policy_version 949453 (0.0009) [2023-12-28 02:04:44,855][106226] Updated weights for policy 0, policy_version 949463 (0.0009) [2023-12-28 02:04:44,968][106225] Updated weights for policy 1, policy_version 951849 (0.0008) [2023-12-28 02:04:45,025][106225] Updated weights for policy 1, policy_version 951859 (0.0007) [2023-12-28 02:04:45,088][106225] Updated weights for policy 1, policy_version 951869 (0.0009) [2023-12-28 02:04:45,599][106226] Updated weights for policy 0, policy_version 949473 (0.0008) [2023-12-28 02:04:45,656][106226] Updated weights for policy 0, policy_version 949483 (0.0010) [2023-12-28 02:04:45,706][106226] Updated weights for policy 0, policy_version 949493 (0.0010) [2023-12-28 02:04:45,762][106225] Updated weights for policy 1, policy_version 951879 (0.0010) [2023-12-28 02:04:45,764][106226] Updated weights for policy 0, policy_version 949503 (0.0005) [2023-12-28 02:04:45,829][106225] Updated weights for policy 1, policy_version 951889 (0.0010) [2023-12-28 02:04:45,892][106225] Updated weights for policy 1, policy_version 951899 (0.0008) [2023-12-28 02:04:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 486858752. Throughput: 0: 9946.6, 1: 9935.9. Samples: 486847192. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:46,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.902')] [2023-12-28 02:04:46,482][106226] Updated weights for policy 0, policy_version 949513 (0.0010) [2023-12-28 02:04:46,542][106226] Updated weights for policy 0, policy_version 949523 (0.0010) [2023-12-28 02:04:46,602][106226] Updated weights for policy 0, policy_version 949533 (0.0010) [2023-12-28 02:04:46,615][106225] Updated weights for policy 1, policy_version 951909 (0.0007) [2023-12-28 02:04:46,670][106225] Updated weights for policy 1, policy_version 951919 (0.0007) [2023-12-28 02:04:46,726][106225] Updated weights for policy 1, policy_version 951929 (0.0007) [2023-12-28 02:04:47,299][106226] Updated weights for policy 0, policy_version 949543 (0.0010) [2023-12-28 02:04:47,352][106226] Updated weights for policy 0, policy_version 949553 (0.0010) [2023-12-28 02:04:47,392][106225] Updated weights for policy 1, policy_version 951939 (0.0007) [2023-12-28 02:04:47,401][106226] Updated weights for policy 0, policy_version 949563 (0.0010) [2023-12-28 02:04:47,447][106225] Updated weights for policy 1, policy_version 951949 (0.0007) [2023-12-28 02:04:47,492][106225] Updated weights for policy 1, policy_version 951959 (0.0006) [2023-12-28 02:04:48,078][106226] Updated weights for policy 0, policy_version 949573 (0.0008) [2023-12-28 02:04:48,136][106226] Updated weights for policy 0, policy_version 949583 (0.0011) [2023-12-28 02:04:48,151][106225] Updated weights for policy 1, policy_version 951969 (0.0006) [2023-12-28 02:04:48,187][106226] Updated weights for policy 0, policy_version 949593 (0.0010) [2023-12-28 02:04:48,212][106225] Updated weights for policy 1, policy_version 951979 (0.0007) [2023-12-28 02:04:48,277][106225] Updated weights for policy 1, policy_version 951989 (0.0008) [2023-12-28 02:04:48,337][106225] Updated weights for policy 1, policy_version 951999 (0.0009) [2023-12-28 02:04:48,860][106226] Updated weights for policy 0, policy_version 949603 (0.0005) [2023-12-28 02:04:48,929][106226] Updated weights for policy 0, policy_version 949613 (0.0006) [2023-12-28 02:04:48,985][106225] Updated weights for policy 1, policy_version 952009 (0.0007) [2023-12-28 02:04:48,987][106226] Updated weights for policy 0, policy_version 949623 (0.0005) [2023-12-28 02:04:49,047][106225] Updated weights for policy 1, policy_version 952019 (0.0008) [2023-12-28 02:04:49,108][106225] Updated weights for policy 1, policy_version 952029 (0.0009) [2023-12-28 02:04:49,606][106226] Updated weights for policy 0, policy_version 949633 (0.0006) [2023-12-28 02:04:49,664][106226] Updated weights for policy 0, policy_version 949643 (0.0005) [2023-12-28 02:04:49,730][106226] Updated weights for policy 0, policy_version 949653 (0.0005) [2023-12-28 02:04:49,793][106226] Updated weights for policy 0, policy_version 949663 (0.0009) [2023-12-28 02:04:49,889][106225] Updated weights for policy 1, policy_version 952039 (0.0007) [2023-12-28 02:04:49,971][106225] Updated weights for policy 1, policy_version 952049 (0.0007) [2023-12-28 02:04:50,033][106225] Updated weights for policy 1, policy_version 952059 (0.0008) [2023-12-28 02:04:50,488][106226] Updated weights for policy 0, policy_version 949673 (0.0009) [2023-12-28 02:04:50,551][106226] Updated weights for policy 0, policy_version 949683 (0.0009) [2023-12-28 02:04:50,610][106226] Updated weights for policy 0, policy_version 949693 (0.0010) [2023-12-28 02:04:50,841][106225] Updated weights for policy 1, policy_version 952069 (0.0009) [2023-12-28 02:04:50,901][106225] Updated weights for policy 1, policy_version 952079 (0.0008) [2023-12-28 02:04:50,963][106225] Updated weights for policy 1, policy_version 952089 (0.0009) [2023-12-28 02:04:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 486957056. Throughput: 0: 9873.2, 1: 9940.3. Samples: 486966956. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:51,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-4.963')] [2023-12-28 02:04:51,334][106226] Updated weights for policy 0, policy_version 949703 (0.0009) [2023-12-28 02:04:51,407][106226] Updated weights for policy 0, policy_version 949713 (0.0009) [2023-12-28 02:04:51,461][106226] Updated weights for policy 0, policy_version 949723 (0.0008) [2023-12-28 02:04:51,709][106225] Updated weights for policy 1, policy_version 952099 (0.0008) [2023-12-28 02:04:51,775][106225] Updated weights for policy 1, policy_version 952109 (0.0008) [2023-12-28 02:04:51,830][106225] Updated weights for policy 1, policy_version 952119 (0.0008) [2023-12-28 02:04:52,221][106226] Updated weights for policy 0, policy_version 949733 (0.0007) [2023-12-28 02:04:52,286][106226] Updated weights for policy 0, policy_version 949743 (0.0008) [2023-12-28 02:04:52,354][106226] Updated weights for policy 0, policy_version 949753 (0.0008) [2023-12-28 02:04:52,572][106225] Updated weights for policy 1, policy_version 952129 (0.0008) [2023-12-28 02:04:52,641][106225] Updated weights for policy 1, policy_version 952139 (0.0007) [2023-12-28 02:04:52,708][106225] Updated weights for policy 1, policy_version 952149 (0.0008) [2023-12-28 02:04:52,775][106225] Updated weights for policy 1, policy_version 952159 (0.0010) [2023-12-28 02:04:53,015][106226] Updated weights for policy 0, policy_version 949763 (0.0009) [2023-12-28 02:04:53,073][106226] Updated weights for policy 0, policy_version 949773 (0.0006) [2023-12-28 02:04:53,132][106226] Updated weights for policy 0, policy_version 949783 (0.0006) [2023-12-28 02:04:53,493][106225] Updated weights for policy 1, policy_version 952169 (0.0009) [2023-12-28 02:04:53,551][106225] Updated weights for policy 1, policy_version 952179 (0.0009) [2023-12-28 02:04:53,604][106225] Updated weights for policy 1, policy_version 952189 (0.0007) [2023-12-28 02:04:53,754][106226] Updated weights for policy 0, policy_version 949793 (0.0009) [2023-12-28 02:04:53,810][106226] Updated weights for policy 0, policy_version 949803 (0.0005) [2023-12-28 02:04:53,864][106226] Updated weights for policy 0, policy_version 949813 (0.0005) [2023-12-28 02:04:53,922][106226] Updated weights for policy 0, policy_version 949823 (0.0005) [2023-12-28 02:04:54,417][106225] Updated weights for policy 1, policy_version 952199 (0.0009) [2023-12-28 02:04:54,467][106225] Updated weights for policy 1, policy_version 952209 (0.0008) [2023-12-28 02:04:54,492][106226] Updated weights for policy 0, policy_version 949833 (0.0006) [2023-12-28 02:04:54,529][106225] Updated weights for policy 1, policy_version 952219 (0.0007) [2023-12-28 02:04:54,540][106226] Updated weights for policy 0, policy_version 949843 (0.0006) [2023-12-28 02:04:54,592][106226] Updated weights for policy 0, policy_version 949853 (0.0005) [2023-12-28 02:04:55,237][106225] Updated weights for policy 1, policy_version 952229 (0.0008) [2023-12-28 02:04:55,295][106225] Updated weights for policy 1, policy_version 952239 (0.0008) [2023-12-28 02:04:55,314][106226] Updated weights for policy 0, policy_version 949863 (0.0005) [2023-12-28 02:04:55,361][106225] Updated weights for policy 1, policy_version 952249 (0.0007) [2023-12-28 02:04:55,367][106226] Updated weights for policy 0, policy_version 949873 (0.0007) [2023-12-28 02:04:55,413][106226] Updated weights for policy 0, policy_version 949883 (0.0006) [2023-12-28 02:04:55,969][106226] Updated weights for policy 0, policy_version 949893 (0.0005) [2023-12-28 02:04:56,031][106226] Updated weights for policy 0, policy_version 949903 (0.0007) [2023-12-28 02:04:56,092][106226] Updated weights for policy 0, policy_version 949913 (0.0008) [2023-12-28 02:04:56,152][106225] Updated weights for policy 1, policy_version 952259 (0.0007) [2023-12-28 02:04:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 487055360. Throughput: 0: 9858.0, 1: 9895.8. Samples: 487024664. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:04:56,175][105115] Avg episode reward: [(0, '-4.969'), (1, '-4.823')] [2023-12-28 02:04:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000949920_243236864.pth... [2023-12-28 02:04:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000948736_242933760.pth [2023-12-28 02:04:56,212][106225] Updated weights for policy 1, policy_version 952269 (0.0008) [2023-12-28 02:04:56,269][106225] Updated weights for policy 1, policy_version 952279 (0.0008) [2023-12-28 02:04:56,319][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000952288_243826688.pth... [2023-12-28 02:04:56,324][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000951136_243531776.pth [2023-12-28 02:04:56,793][106226] Updated weights for policy 0, policy_version 949923 (0.0009) [2023-12-28 02:04:56,857][106226] Updated weights for policy 0, policy_version 949933 (0.0006) [2023-12-28 02:04:56,922][106226] Updated weights for policy 0, policy_version 949943 (0.0005) [2023-12-28 02:04:56,984][106225] Updated weights for policy 1, policy_version 952289 (0.0008) [2023-12-28 02:04:57,038][106225] Updated weights for policy 1, policy_version 952299 (0.0008) [2023-12-28 02:04:57,089][106225] Updated weights for policy 1, policy_version 952309 (0.0007) [2023-12-28 02:04:57,143][106225] Updated weights for policy 1, policy_version 952319 (0.0008) [2023-12-28 02:04:57,454][106226] Updated weights for policy 0, policy_version 949953 (0.0006) [2023-12-28 02:04:57,509][106226] Updated weights for policy 0, policy_version 949963 (0.0008) [2023-12-28 02:04:57,560][106226] Updated weights for policy 0, policy_version 949973 (0.0008) [2023-12-28 02:04:57,611][106226] Updated weights for policy 0, policy_version 949983 (0.0009) [2023-12-28 02:04:57,924][106225] Updated weights for policy 1, policy_version 952329 (0.0009) [2023-12-28 02:04:57,974][106225] Updated weights for policy 1, policy_version 952339 (0.0008) [2023-12-28 02:04:58,023][106225] Updated weights for policy 1, policy_version 952349 (0.0008) [2023-12-28 02:04:58,222][106226] Updated weights for policy 0, policy_version 949993 (0.0007) [2023-12-28 02:04:58,277][106226] Updated weights for policy 0, policy_version 950003 (0.0008) [2023-12-28 02:04:58,344][106226] Updated weights for policy 0, policy_version 950013 (0.0006) [2023-12-28 02:04:58,838][106225] Updated weights for policy 1, policy_version 952359 (0.0008) [2023-12-28 02:04:58,901][106225] Updated weights for policy 1, policy_version 952369 (0.0010) [2023-12-28 02:04:58,985][106225] Updated weights for policy 1, policy_version 952379 (0.0007) [2023-12-28 02:04:59,081][106226] Updated weights for policy 0, policy_version 950023 (0.0008) [2023-12-28 02:04:59,136][106226] Updated weights for policy 0, policy_version 950033 (0.0008) [2023-12-28 02:04:59,191][106226] Updated weights for policy 0, policy_version 950043 (0.0007) [2023-12-28 02:04:59,781][106225] Updated weights for policy 1, policy_version 952389 (0.0008) [2023-12-28 02:04:59,839][106225] Updated weights for policy 1, policy_version 952399 (0.0006) [2023-12-28 02:04:59,906][106225] Updated weights for policy 1, policy_version 952409 (0.0007) [2023-12-28 02:04:59,970][106226] Updated weights for policy 0, policy_version 950053 (0.0008) [2023-12-28 02:05:00,019][106226] Updated weights for policy 0, policy_version 950063 (0.0009) [2023-12-28 02:05:00,090][106226] Updated weights for policy 0, policy_version 950073 (0.0010) [2023-12-28 02:05:00,598][106225] Updated weights for policy 1, policy_version 952419 (0.0007) [2023-12-28 02:05:00,652][106225] Updated weights for policy 1, policy_version 952429 (0.0010) [2023-12-28 02:05:00,710][106225] Updated weights for policy 1, policy_version 952439 (0.0010) [2023-12-28 02:05:00,752][106226] Updated weights for policy 0, policy_version 950083 (0.0008) [2023-12-28 02:05:00,816][106226] Updated weights for policy 0, policy_version 950093 (0.0005) [2023-12-28 02:05:00,885][106226] Updated weights for policy 0, policy_version 950103 (0.0005) [2023-12-28 02:05:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 487153664. Throughput: 0: 10006.6, 1: 9800.6. Samples: 487142084. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 02:05:01,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.980')] [2023-12-28 02:05:01,349][106225] Updated weights for policy 1, policy_version 952449 (0.0010) [2023-12-28 02:05:01,429][106225] Updated weights for policy 1, policy_version 952459 (0.0008) [2023-12-28 02:05:01,493][106225] Updated weights for policy 1, policy_version 952469 (0.0008) [2023-12-28 02:05:01,511][106226] Updated weights for policy 0, policy_version 950113 (0.0007) [2023-12-28 02:05:01,552][106225] Updated weights for policy 1, policy_version 952479 (0.0007) [2023-12-28 02:05:01,580][106226] Updated weights for policy 0, policy_version 950123 (0.0008) [2023-12-28 02:05:01,654][106226] Updated weights for policy 0, policy_version 950133 (0.0008) [2023-12-28 02:05:01,721][106226] Updated weights for policy 0, policy_version 950143 (0.0007) [2023-12-28 02:05:02,209][106225] Updated weights for policy 1, policy_version 952489 (0.0006) [2023-12-28 02:05:02,267][106225] Updated weights for policy 1, policy_version 952499 (0.0006) [2023-12-28 02:05:02,322][106225] Updated weights for policy 1, policy_version 952509 (0.0010) [2023-12-28 02:05:02,456][106226] Updated weights for policy 0, policy_version 950153 (0.0008) [2023-12-28 02:05:02,507][106226] Updated weights for policy 0, policy_version 950163 (0.0007) [2023-12-28 02:05:02,561][106226] Updated weights for policy 0, policy_version 950173 (0.0005) [2023-12-28 02:05:03,056][106225] Updated weights for policy 1, policy_version 952519 (0.0007) [2023-12-28 02:05:03,113][106225] Updated weights for policy 1, policy_version 952529 (0.0005) [2023-12-28 02:05:03,161][106225] Updated weights for policy 1, policy_version 952539 (0.0005) [2023-12-28 02:05:03,263][106226] Updated weights for policy 0, policy_version 950183 (0.0009) [2023-12-28 02:05:03,312][106226] Updated weights for policy 0, policy_version 950193 (0.0010) [2023-12-28 02:05:03,371][106226] Updated weights for policy 0, policy_version 950203 (0.0010) [2023-12-28 02:05:03,764][106225] Updated weights for policy 1, policy_version 952549 (0.0005) [2023-12-28 02:05:03,834][106225] Updated weights for policy 1, policy_version 952559 (0.0008) [2023-12-28 02:05:03,902][106225] Updated weights for policy 1, policy_version 952569 (0.0006) [2023-12-28 02:05:04,096][106226] Updated weights for policy 0, policy_version 950213 (0.0008) [2023-12-28 02:05:04,172][106226] Updated weights for policy 0, policy_version 950223 (0.0011) [2023-12-28 02:05:04,234][106226] Updated weights for policy 0, policy_version 950233 (0.0008) [2023-12-28 02:05:04,447][106225] Updated weights for policy 1, policy_version 952579 (0.0007) [2023-12-28 02:05:04,504][106225] Updated weights for policy 1, policy_version 952589 (0.0010) [2023-12-28 02:05:04,559][106225] Updated weights for policy 1, policy_version 952599 (0.0007) [2023-12-28 02:05:04,901][106226] Updated weights for policy 0, policy_version 950243 (0.0009) [2023-12-28 02:05:04,946][106226] Updated weights for policy 0, policy_version 950253 (0.0010) [2023-12-28 02:05:04,996][106226] Updated weights for policy 0, policy_version 950263 (0.0010) [2023-12-28 02:05:05,117][106225] Updated weights for policy 1, policy_version 952609 (0.0005) [2023-12-28 02:05:05,181][106225] Updated weights for policy 1, policy_version 952619 (0.0005) [2023-12-28 02:05:05,240][106225] Updated weights for policy 1, policy_version 952629 (0.0005) [2023-12-28 02:05:05,306][106225] Updated weights for policy 1, policy_version 952639 (0.0008) [2023-12-28 02:05:05,681][106226] Updated weights for policy 0, policy_version 950273 (0.0011) [2023-12-28 02:05:05,738][106226] Updated weights for policy 0, policy_version 950283 (0.0010) [2023-12-28 02:05:05,794][106226] Updated weights for policy 0, policy_version 950293 (0.0011) [2023-12-28 02:05:05,852][106225] Updated weights for policy 1, policy_version 952649 (0.0008) [2023-12-28 02:05:05,853][106226] Updated weights for policy 0, policy_version 950303 (0.0010) [2023-12-28 02:05:05,903][106225] Updated weights for policy 1, policy_version 952659 (0.0005) [2023-12-28 02:05:05,963][106225] Updated weights for policy 1, policy_version 952669 (0.0005) [2023-12-28 02:05:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 487260160. Throughput: 0: 10010.1, 1: 9877.0. Samples: 487267292. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:06,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.901')] [2023-12-28 02:05:06,539][106226] Updated weights for policy 0, policy_version 950313 (0.0009) [2023-12-28 02:05:06,602][106226] Updated weights for policy 0, policy_version 950323 (0.0009) [2023-12-28 02:05:06,667][106226] Updated weights for policy 0, policy_version 950333 (0.0008) [2023-12-28 02:05:06,713][106225] Updated weights for policy 1, policy_version 952679 (0.0008) [2023-12-28 02:05:06,770][106225] Updated weights for policy 1, policy_version 952689 (0.0009) [2023-12-28 02:05:06,825][106225] Updated weights for policy 1, policy_version 952699 (0.0008) [2023-12-28 02:05:07,297][106226] Updated weights for policy 0, policy_version 950343 (0.0006) [2023-12-28 02:05:07,355][106226] Updated weights for policy 0, policy_version 950353 (0.0005) [2023-12-28 02:05:07,412][106226] Updated weights for policy 0, policy_version 950363 (0.0008) [2023-12-28 02:05:07,565][106225] Updated weights for policy 1, policy_version 952709 (0.0009) [2023-12-28 02:05:07,624][106225] Updated weights for policy 1, policy_version 952719 (0.0009) [2023-12-28 02:05:07,684][106225] Updated weights for policy 1, policy_version 952729 (0.0007) [2023-12-28 02:05:07,977][106226] Updated weights for policy 0, policy_version 950373 (0.0007) [2023-12-28 02:05:08,037][106226] Updated weights for policy 0, policy_version 950383 (0.0006) [2023-12-28 02:05:08,088][106226] Updated weights for policy 0, policy_version 950393 (0.0005) [2023-12-28 02:05:08,466][106225] Updated weights for policy 1, policy_version 952739 (0.0010) [2023-12-28 02:05:08,521][106225] Updated weights for policy 1, policy_version 952749 (0.0008) [2023-12-28 02:05:08,574][106225] Updated weights for policy 1, policy_version 952759 (0.0008) [2023-12-28 02:05:08,793][106226] Updated weights for policy 0, policy_version 950403 (0.0007) [2023-12-28 02:05:08,844][106226] Updated weights for policy 0, policy_version 950413 (0.0008) [2023-12-28 02:05:08,896][106226] Updated weights for policy 0, policy_version 950423 (0.0009) [2023-12-28 02:05:09,228][106225] Updated weights for policy 1, policy_version 952769 (0.0008) [2023-12-28 02:05:09,292][106225] Updated weights for policy 1, policy_version 952779 (0.0010) [2023-12-28 02:05:09,351][106225] Updated weights for policy 1, policy_version 952789 (0.0010) [2023-12-28 02:05:09,421][106225] Updated weights for policy 1, policy_version 952799 (0.0009) [2023-12-28 02:05:09,765][106226] Updated weights for policy 0, policy_version 950433 (0.0009) [2023-12-28 02:05:09,830][106226] Updated weights for policy 0, policy_version 950443 (0.0009) [2023-12-28 02:05:09,901][106226] Updated weights for policy 0, policy_version 950453 (0.0010) [2023-12-28 02:05:09,969][106226] Updated weights for policy 0, policy_version 950463 (0.0008) [2023-12-28 02:05:10,112][106225] Updated weights for policy 1, policy_version 952809 (0.0006) [2023-12-28 02:05:10,185][106225] Updated weights for policy 1, policy_version 952819 (0.0006) [2023-12-28 02:05:10,242][106225] Updated weights for policy 1, policy_version 952829 (0.0008) [2023-12-28 02:05:10,711][106226] Updated weights for policy 0, policy_version 950473 (0.0009) [2023-12-28 02:05:10,763][106226] Updated weights for policy 0, policy_version 950483 (0.0008) [2023-12-28 02:05:10,824][106226] Updated weights for policy 0, policy_version 950493 (0.0009) [2023-12-28 02:05:10,900][106225] Updated weights for policy 1, policy_version 952839 (0.0009) [2023-12-28 02:05:10,959][106225] Updated weights for policy 1, policy_version 952849 (0.0008) [2023-12-28 02:05:11,018][106225] Updated weights for policy 1, policy_version 952859 (0.0008) [2023-12-28 02:05:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 487358464. Throughput: 0: 10049.3, 1: 9825.0. Samples: 487326296. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:11,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.950')] [2023-12-28 02:05:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000952864_243974144.pth... [2023-12-28 02:05:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000950496_243384320.pth... [2023-12-28 02:05:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000951712_243679232.pth [2023-12-28 02:05:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000949312_243081216.pth [2023-12-28 02:05:11,558][106226] Updated weights for policy 0, policy_version 950503 (0.0007) [2023-12-28 02:05:11,624][106226] Updated weights for policy 0, policy_version 950513 (0.0007) [2023-12-28 02:05:11,696][106226] Updated weights for policy 0, policy_version 950523 (0.0008) [2023-12-28 02:05:11,748][106225] Updated weights for policy 1, policy_version 952869 (0.0009) [2023-12-28 02:05:11,816][106225] Updated weights for policy 1, policy_version 952879 (0.0008) [2023-12-28 02:05:11,879][106225] Updated weights for policy 1, policy_version 952889 (0.0008) [2023-12-28 02:05:12,379][106226] Updated weights for policy 0, policy_version 950533 (0.0008) [2023-12-28 02:05:12,437][106226] Updated weights for policy 0, policy_version 950543 (0.0008) [2023-12-28 02:05:12,495][106226] Updated weights for policy 0, policy_version 950553 (0.0007) [2023-12-28 02:05:12,625][106225] Updated weights for policy 1, policy_version 952899 (0.0009) [2023-12-28 02:05:12,686][106225] Updated weights for policy 1, policy_version 952909 (0.0009) [2023-12-28 02:05:12,743][106225] Updated weights for policy 1, policy_version 952919 (0.0010) [2023-12-28 02:05:13,222][106226] Updated weights for policy 0, policy_version 950563 (0.0008) [2023-12-28 02:05:13,268][106226] Updated weights for policy 0, policy_version 950573 (0.0008) [2023-12-28 02:05:13,337][106226] Updated weights for policy 0, policy_version 950583 (0.0008) [2023-12-28 02:05:13,459][106225] Updated weights for policy 1, policy_version 952929 (0.0010) [2023-12-28 02:05:13,522][106225] Updated weights for policy 1, policy_version 952939 (0.0006) [2023-12-28 02:05:13,580][106225] Updated weights for policy 1, policy_version 952949 (0.0006) [2023-12-28 02:05:13,630][106225] Updated weights for policy 1, policy_version 952959 (0.0006) [2023-12-28 02:05:14,059][106226] Updated weights for policy 0, policy_version 950593 (0.0008) [2023-12-28 02:05:14,122][106226] Updated weights for policy 0, policy_version 950603 (0.0007) [2023-12-28 02:05:14,182][106226] Updated weights for policy 0, policy_version 950613 (0.0008) [2023-12-28 02:05:14,206][106225] Updated weights for policy 1, policy_version 952969 (0.0005) [2023-12-28 02:05:14,246][106226] Updated weights for policy 0, policy_version 950623 (0.0008) [2023-12-28 02:05:14,257][106225] Updated weights for policy 1, policy_version 952979 (0.0005) [2023-12-28 02:05:14,305][106225] Updated weights for policy 1, policy_version 952989 (0.0005) [2023-12-28 02:05:14,971][106225] Updated weights for policy 1, policy_version 952999 (0.0007) [2023-12-28 02:05:15,033][106225] Updated weights for policy 1, policy_version 953009 (0.0008) [2023-12-28 02:05:15,035][106226] Updated weights for policy 0, policy_version 950633 (0.0007) [2023-12-28 02:05:15,092][106225] Updated weights for policy 1, policy_version 953019 (0.0010) [2023-12-28 02:05:15,093][106226] Updated weights for policy 0, policy_version 950643 (0.0009) [2023-12-28 02:05:15,155][106226] Updated weights for policy 0, policy_version 950653 (0.0008) [2023-12-28 02:05:15,749][106225] Updated weights for policy 1, policy_version 953029 (0.0008) [2023-12-28 02:05:15,812][106225] Updated weights for policy 1, policy_version 953039 (0.0007) [2023-12-28 02:05:15,818][106226] Updated weights for policy 0, policy_version 950663 (0.0007) [2023-12-28 02:05:15,868][106226] Updated weights for policy 0, policy_version 950673 (0.0009) [2023-12-28 02:05:15,877][106225] Updated weights for policy 1, policy_version 953049 (0.0006) [2023-12-28 02:05:15,915][106226] Updated weights for policy 0, policy_version 950683 (0.0008) [2023-12-28 02:05:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 487456768. Throughput: 0: 9902.4, 1: 9862.3. Samples: 487442348. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:16,176][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.902')] [2023-12-28 02:05:16,434][106225] Updated weights for policy 1, policy_version 953059 (0.0006) [2023-12-28 02:05:16,493][106225] Updated weights for policy 1, policy_version 953069 (0.0010) [2023-12-28 02:05:16,559][106225] Updated weights for policy 1, policy_version 953079 (0.0010) [2023-12-28 02:05:16,720][106226] Updated weights for policy 0, policy_version 950693 (0.0007) [2023-12-28 02:05:16,778][106226] Updated weights for policy 0, policy_version 950703 (0.0008) [2023-12-28 02:05:16,838][106226] Updated weights for policy 0, policy_version 950713 (0.0009) [2023-12-28 02:05:17,211][106225] Updated weights for policy 1, policy_version 953089 (0.0010) [2023-12-28 02:05:17,270][106225] Updated weights for policy 1, policy_version 953099 (0.0007) [2023-12-28 02:05:17,324][106225] Updated weights for policy 1, policy_version 953109 (0.0007) [2023-12-28 02:05:17,384][106225] Updated weights for policy 1, policy_version 953119 (0.0009) [2023-12-28 02:05:17,494][106226] Updated weights for policy 0, policy_version 950723 (0.0006) [2023-12-28 02:05:17,553][106226] Updated weights for policy 0, policy_version 950733 (0.0006) [2023-12-28 02:05:17,620][106226] Updated weights for policy 0, policy_version 950743 (0.0005) [2023-12-28 02:05:18,046][106225] Updated weights for policy 1, policy_version 953129 (0.0010) [2023-12-28 02:05:18,089][106225] Updated weights for policy 1, policy_version 953139 (0.0010) [2023-12-28 02:05:18,141][106225] Updated weights for policy 1, policy_version 953149 (0.0010) [2023-12-28 02:05:18,187][106226] Updated weights for policy 0, policy_version 950753 (0.0006) [2023-12-28 02:05:18,255][106226] Updated weights for policy 0, policy_version 950763 (0.0008) [2023-12-28 02:05:18,311][106226] Updated weights for policy 0, policy_version 950773 (0.0008) [2023-12-28 02:05:18,375][106226] Updated weights for policy 0, policy_version 950783 (0.0009) [2023-12-28 02:05:18,870][106225] Updated weights for policy 1, policy_version 953159 (0.0009) [2023-12-28 02:05:18,926][106225] Updated weights for policy 1, policy_version 953169 (0.0010) [2023-12-28 02:05:18,988][106225] Updated weights for policy 1, policy_version 953179 (0.0010) [2023-12-28 02:05:19,061][106226] Updated weights for policy 0, policy_version 950793 (0.0006) [2023-12-28 02:05:19,126][106226] Updated weights for policy 0, policy_version 950803 (0.0008) [2023-12-28 02:05:19,187][106226] Updated weights for policy 0, policy_version 950813 (0.0009) [2023-12-28 02:05:19,720][106225] Updated weights for policy 1, policy_version 953189 (0.0010) [2023-12-28 02:05:19,784][106225] Updated weights for policy 1, policy_version 953199 (0.0007) [2023-12-28 02:05:19,846][106225] Updated weights for policy 1, policy_version 953209 (0.0007) [2023-12-28 02:05:19,956][106226] Updated weights for policy 0, policy_version 950823 (0.0010) [2023-12-28 02:05:20,021][106226] Updated weights for policy 0, policy_version 950833 (0.0011) [2023-12-28 02:05:20,085][106226] Updated weights for policy 0, policy_version 950843 (0.0010) [2023-12-28 02:05:20,630][106225] Updated weights for policy 1, policy_version 953219 (0.0009) [2023-12-28 02:05:20,692][106225] Updated weights for policy 1, policy_version 953229 (0.0010) [2023-12-28 02:05:20,758][106225] Updated weights for policy 1, policy_version 953239 (0.0011) [2023-12-28 02:05:20,777][106226] Updated weights for policy 0, policy_version 950853 (0.0010) [2023-12-28 02:05:20,839][106226] Updated weights for policy 0, policy_version 950863 (0.0010) [2023-12-28 02:05:20,901][106226] Updated weights for policy 0, policy_version 950873 (0.0011) [2023-12-28 02:05:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 487555072. Throughput: 0: 9919.6, 1: 9905.2. Samples: 487562548. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:21,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.986')] [2023-12-28 02:05:21,518][106225] Updated weights for policy 1, policy_version 953249 (0.0007) [2023-12-28 02:05:21,583][106225] Updated weights for policy 1, policy_version 953259 (0.0011) [2023-12-28 02:05:21,655][106225] Updated weights for policy 1, policy_version 953269 (0.0015) [2023-12-28 02:05:21,715][106226] Updated weights for policy 0, policy_version 950883 (0.0010) [2023-12-28 02:05:21,723][106225] Updated weights for policy 1, policy_version 953279 (0.0009) [2023-12-28 02:05:21,788][106226] Updated weights for policy 0, policy_version 950893 (0.0008) [2023-12-28 02:05:21,852][106226] Updated weights for policy 0, policy_version 950903 (0.0008) [2023-12-28 02:05:22,467][106225] Updated weights for policy 1, policy_version 953289 (0.0010) [2023-12-28 02:05:22,530][106225] Updated weights for policy 1, policy_version 953299 (0.0008) [2023-12-28 02:05:22,547][106226] Updated weights for policy 0, policy_version 950913 (0.0008) [2023-12-28 02:05:22,586][106225] Updated weights for policy 1, policy_version 953309 (0.0008) [2023-12-28 02:05:22,604][106226] Updated weights for policy 0, policy_version 950923 (0.0007) [2023-12-28 02:05:22,666][106226] Updated weights for policy 0, policy_version 950933 (0.0006) [2023-12-28 02:05:22,727][106226] Updated weights for policy 0, policy_version 950943 (0.0007) [2023-12-28 02:05:23,364][106225] Updated weights for policy 1, policy_version 953319 (0.0008) [2023-12-28 02:05:23,392][106226] Updated weights for policy 0, policy_version 950953 (0.0010) [2023-12-28 02:05:23,410][106225] Updated weights for policy 1, policy_version 953329 (0.0005) [2023-12-28 02:05:23,446][106226] Updated weights for policy 0, policy_version 950963 (0.0011) [2023-12-28 02:05:23,460][106225] Updated weights for policy 1, policy_version 953339 (0.0005) [2023-12-28 02:05:23,500][106226] Updated weights for policy 0, policy_version 950973 (0.0011) [2023-12-28 02:05:24,206][106225] Updated weights for policy 1, policy_version 953349 (0.0007) [2023-12-28 02:05:24,231][106226] Updated weights for policy 0, policy_version 950983 (0.0011) [2023-12-28 02:05:24,260][106225] Updated weights for policy 1, policy_version 953359 (0.0006) [2023-12-28 02:05:24,289][106226] Updated weights for policy 0, policy_version 950993 (0.0010) [2023-12-28 02:05:24,314][106225] Updated weights for policy 1, policy_version 953369 (0.0005) [2023-12-28 02:05:24,353][106226] Updated weights for policy 0, policy_version 951003 (0.0011) [2023-12-28 02:05:25,041][106225] Updated weights for policy 1, policy_version 953379 (0.0008) [2023-12-28 02:05:25,068][106226] Updated weights for policy 0, policy_version 951013 (0.0010) [2023-12-28 02:05:25,100][106225] Updated weights for policy 1, policy_version 953389 (0.0006) [2023-12-28 02:05:25,121][106226] Updated weights for policy 0, policy_version 951023 (0.0010) [2023-12-28 02:05:25,157][106225] Updated weights for policy 1, policy_version 953399 (0.0005) [2023-12-28 02:05:25,175][106226] Updated weights for policy 0, policy_version 951033 (0.0010) [2023-12-28 02:05:25,779][106225] Updated weights for policy 1, policy_version 953409 (0.0006) [2023-12-28 02:05:25,829][106225] Updated weights for policy 1, policy_version 953419 (0.0005) [2023-12-28 02:05:25,877][106225] Updated weights for policy 1, policy_version 953429 (0.0006) [2023-12-28 02:05:25,890][106226] Updated weights for policy 0, policy_version 951043 (0.0010) [2023-12-28 02:05:25,928][106225] Updated weights for policy 1, policy_version 953439 (0.0010) [2023-12-28 02:05:25,946][106226] Updated weights for policy 0, policy_version 951053 (0.0010) [2023-12-28 02:05:25,995][106226] Updated weights for policy 0, policy_version 951063 (0.0010) [2023-12-28 02:05:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 487653376. Throughput: 0: 9906.8, 1: 9822.2. Samples: 487618388. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:26,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-5.255')] [2023-12-28 02:05:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000953440_244121600.pth... [2023-12-28 02:05:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000951072_243531776.pth... [2023-12-28 02:05:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000949920_243236864.pth [2023-12-28 02:05:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000952288_243826688.pth [2023-12-28 02:05:26,542][106225] Updated weights for policy 1, policy_version 953449 (0.0010) [2023-12-28 02:05:26,601][106225] Updated weights for policy 1, policy_version 953459 (0.0010) [2023-12-28 02:05:26,646][106225] Updated weights for policy 1, policy_version 953469 (0.0010) [2023-12-28 02:05:26,695][106226] Updated weights for policy 0, policy_version 951073 (0.0010) [2023-12-28 02:05:26,747][106226] Updated weights for policy 0, policy_version 951083 (0.0010) [2023-12-28 02:05:26,803][106226] Updated weights for policy 0, policy_version 951093 (0.0010) [2023-12-28 02:05:26,859][106226] Updated weights for policy 0, policy_version 951103 (0.0010) [2023-12-28 02:05:27,353][106225] Updated weights for policy 1, policy_version 953479 (0.0010) [2023-12-28 02:05:27,403][106225] Updated weights for policy 1, policy_version 953489 (0.0010) [2023-12-28 02:05:27,465][106225] Updated weights for policy 1, policy_version 953499 (0.0010) [2023-12-28 02:05:27,532][106226] Updated weights for policy 0, policy_version 951113 (0.0010) [2023-12-28 02:05:27,581][106226] Updated weights for policy 0, policy_version 951123 (0.0010) [2023-12-28 02:05:27,634][106226] Updated weights for policy 0, policy_version 951133 (0.0009) [2023-12-28 02:05:28,062][106225] Updated weights for policy 1, policy_version 953509 (0.0009) [2023-12-28 02:05:28,115][106225] Updated weights for policy 1, policy_version 953519 (0.0010) [2023-12-28 02:05:28,162][106225] Updated weights for policy 1, policy_version 953529 (0.0006) [2023-12-28 02:05:28,284][106226] Updated weights for policy 0, policy_version 951143 (0.0010) [2023-12-28 02:05:28,333][106226] Updated weights for policy 0, policy_version 951153 (0.0010) [2023-12-28 02:05:28,394][106226] Updated weights for policy 0, policy_version 951163 (0.0010) [2023-12-28 02:05:28,883][106225] Updated weights for policy 1, policy_version 953539 (0.0010) [2023-12-28 02:05:28,934][106225] Updated weights for policy 1, policy_version 953549 (0.0010) [2023-12-28 02:05:28,987][106225] Updated weights for policy 1, policy_version 953559 (0.0010) [2023-12-28 02:05:29,115][106226] Updated weights for policy 0, policy_version 951173 (0.0005) [2023-12-28 02:05:29,168][106226] Updated weights for policy 0, policy_version 951183 (0.0005) [2023-12-28 02:05:29,216][106226] Updated weights for policy 0, policy_version 951193 (0.0007) [2023-12-28 02:05:29,754][106225] Updated weights for policy 1, policy_version 953569 (0.0010) [2023-12-28 02:05:29,803][106225] Updated weights for policy 1, policy_version 953579 (0.0010) [2023-12-28 02:05:29,864][106225] Updated weights for policy 1, policy_version 953589 (0.0008) [2023-12-28 02:05:29,928][106225] Updated weights for policy 1, policy_version 953599 (0.0008) [2023-12-28 02:05:29,954][106226] Updated weights for policy 0, policy_version 951203 (0.0008) [2023-12-28 02:05:30,015][106226] Updated weights for policy 0, policy_version 951213 (0.0006) [2023-12-28 02:05:30,082][106226] Updated weights for policy 0, policy_version 951223 (0.0005) [2023-12-28 02:05:30,684][106226] Updated weights for policy 0, policy_version 951233 (0.0005) [2023-12-28 02:05:30,692][106225] Updated weights for policy 1, policy_version 953609 (0.0008) [2023-12-28 02:05:30,742][106226] Updated weights for policy 0, policy_version 951243 (0.0006) [2023-12-28 02:05:30,748][106225] Updated weights for policy 1, policy_version 953619 (0.0007) [2023-12-28 02:05:30,793][106226] Updated weights for policy 0, policy_version 951253 (0.0006) [2023-12-28 02:05:30,799][106225] Updated weights for policy 1, policy_version 953629 (0.0006) [2023-12-28 02:05:30,846][106226] Updated weights for policy 0, policy_version 951263 (0.0006) [2023-12-28 02:05:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 487751680. Throughput: 0: 9959.3, 1: 9888.5. Samples: 487740340. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:31,175][105115] Avg episode reward: [(0, '-4.957'), (1, '-5.071')] [2023-12-28 02:05:31,494][106225] Updated weights for policy 1, policy_version 953639 (0.0008) [2023-12-28 02:05:31,544][106226] Updated weights for policy 0, policy_version 951273 (0.0007) [2023-12-28 02:05:31,554][106225] Updated weights for policy 1, policy_version 953649 (0.0007) [2023-12-28 02:05:31,598][106226] Updated weights for policy 0, policy_version 951283 (0.0006) [2023-12-28 02:05:31,613][106225] Updated weights for policy 1, policy_version 953659 (0.0008) [2023-12-28 02:05:31,659][106226] Updated weights for policy 0, policy_version 951293 (0.0009) [2023-12-28 02:05:32,318][106226] Updated weights for policy 0, policy_version 951303 (0.0009) [2023-12-28 02:05:32,381][106226] Updated weights for policy 0, policy_version 951313 (0.0009) [2023-12-28 02:05:32,418][106225] Updated weights for policy 1, policy_version 953669 (0.0007) [2023-12-28 02:05:32,445][106226] Updated weights for policy 0, policy_version 951323 (0.0009) [2023-12-28 02:05:32,483][106225] Updated weights for policy 1, policy_version 953679 (0.0008) [2023-12-28 02:05:32,555][106225] Updated weights for policy 1, policy_version 953689 (0.0007) [2023-12-28 02:05:33,173][106226] Updated weights for policy 0, policy_version 951333 (0.0007) [2023-12-28 02:05:33,231][106226] Updated weights for policy 0, policy_version 951343 (0.0006) [2023-12-28 02:05:33,237][106225] Updated weights for policy 1, policy_version 953699 (0.0007) [2023-12-28 02:05:33,283][106225] Updated weights for policy 1, policy_version 953709 (0.0006) [2023-12-28 02:05:33,285][106226] Updated weights for policy 0, policy_version 951353 (0.0007) [2023-12-28 02:05:33,333][106225] Updated weights for policy 1, policy_version 953719 (0.0009) [2023-12-28 02:05:33,943][106226] Updated weights for policy 0, policy_version 951363 (0.0006) [2023-12-28 02:05:34,000][106226] Updated weights for policy 0, policy_version 951373 (0.0005) [2023-12-28 02:05:34,019][106225] Updated weights for policy 1, policy_version 953729 (0.0008) [2023-12-28 02:05:34,051][106226] Updated weights for policy 0, policy_version 951383 (0.0005) [2023-12-28 02:05:34,072][106225] Updated weights for policy 1, policy_version 953739 (0.0010) [2023-12-28 02:05:34,128][106225] Updated weights for policy 1, policy_version 953749 (0.0009) [2023-12-28 02:05:34,193][106225] Updated weights for policy 1, policy_version 953759 (0.0008) [2023-12-28 02:05:34,670][106226] Updated weights for policy 0, policy_version 951393 (0.0006) [2023-12-28 02:05:34,724][106226] Updated weights for policy 0, policy_version 951403 (0.0007) [2023-12-28 02:05:34,775][106226] Updated weights for policy 0, policy_version 951413 (0.0008) [2023-12-28 02:05:34,836][106226] Updated weights for policy 0, policy_version 951423 (0.0008) [2023-12-28 02:05:34,899][106225] Updated weights for policy 1, policy_version 953769 (0.0010) [2023-12-28 02:05:34,958][106225] Updated weights for policy 1, policy_version 953779 (0.0006) [2023-12-28 02:05:35,012][106225] Updated weights for policy 1, policy_version 953789 (0.0009) [2023-12-28 02:05:35,589][106226] Updated weights for policy 0, policy_version 951433 (0.0007) [2023-12-28 02:05:35,606][106225] Updated weights for policy 1, policy_version 953799 (0.0008) [2023-12-28 02:05:35,640][106226] Updated weights for policy 0, policy_version 951443 (0.0005) [2023-12-28 02:05:35,660][106225] Updated weights for policy 1, policy_version 953809 (0.0007) [2023-12-28 02:05:35,691][106226] Updated weights for policy 0, policy_version 951453 (0.0007) [2023-12-28 02:05:35,714][106225] Updated weights for policy 1, policy_version 953819 (0.0007) [2023-12-28 02:05:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 487849984. Throughput: 0: 9976.2, 1: 9877.6. Samples: 487860376. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:36,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.957')] [2023-12-28 02:05:36,447][106226] Updated weights for policy 0, policy_version 951463 (0.0007) [2023-12-28 02:05:36,455][106225] Updated weights for policy 1, policy_version 953829 (0.0008) [2023-12-28 02:05:36,505][106226] Updated weights for policy 0, policy_version 951473 (0.0008) [2023-12-28 02:05:36,514][106225] Updated weights for policy 1, policy_version 953839 (0.0007) [2023-12-28 02:05:36,574][106226] Updated weights for policy 0, policy_version 951483 (0.0006) [2023-12-28 02:05:36,580][106225] Updated weights for policy 1, policy_version 953849 (0.0007) [2023-12-28 02:05:37,299][106225] Updated weights for policy 1, policy_version 953859 (0.0008) [2023-12-28 02:05:37,301][106226] Updated weights for policy 0, policy_version 951493 (0.0007) [2023-12-28 02:05:37,350][106226] Updated weights for policy 0, policy_version 951503 (0.0008) [2023-12-28 02:05:37,357][106225] Updated weights for policy 1, policy_version 953869 (0.0010) [2023-12-28 02:05:37,405][106226] Updated weights for policy 0, policy_version 951513 (0.0006) [2023-12-28 02:05:37,419][106225] Updated weights for policy 1, policy_version 953879 (0.0011) [2023-12-28 02:05:38,140][106225] Updated weights for policy 1, policy_version 953889 (0.0010) [2023-12-28 02:05:38,156][106226] Updated weights for policy 0, policy_version 951523 (0.0007) [2023-12-28 02:05:38,202][106225] Updated weights for policy 1, policy_version 953899 (0.0010) [2023-12-28 02:05:38,219][106226] Updated weights for policy 0, policy_version 951533 (0.0009) [2023-12-28 02:05:38,260][106225] Updated weights for policy 1, policy_version 953909 (0.0010) [2023-12-28 02:05:38,281][106226] Updated weights for policy 0, policy_version 951543 (0.0007) [2023-12-28 02:05:38,311][106225] Updated weights for policy 1, policy_version 953919 (0.0010) [2023-12-28 02:05:39,018][106226] Updated weights for policy 0, policy_version 951553 (0.0007) [2023-12-28 02:05:39,039][106225] Updated weights for policy 1, policy_version 953929 (0.0008) [2023-12-28 02:05:39,074][106226] Updated weights for policy 0, policy_version 951563 (0.0006) [2023-12-28 02:05:39,103][106225] Updated weights for policy 1, policy_version 953939 (0.0007) [2023-12-28 02:05:39,132][106226] Updated weights for policy 0, policy_version 951573 (0.0007) [2023-12-28 02:05:39,154][106225] Updated weights for policy 1, policy_version 953949 (0.0007) [2023-12-28 02:05:39,191][106226] Updated weights for policy 0, policy_version 951583 (0.0009) [2023-12-28 02:05:39,971][106226] Updated weights for policy 0, policy_version 951593 (0.0008) [2023-12-28 02:05:39,975][106225] Updated weights for policy 1, policy_version 953959 (0.0008) [2023-12-28 02:05:40,025][106226] Updated weights for policy 0, policy_version 951603 (0.0008) [2023-12-28 02:05:40,029][106225] Updated weights for policy 1, policy_version 953969 (0.0008) [2023-12-28 02:05:40,076][106226] Updated weights for policy 0, policy_version 951613 (0.0008) [2023-12-28 02:05:40,085][106225] Updated weights for policy 1, policy_version 953979 (0.0008) [2023-12-28 02:05:40,790][106225] Updated weights for policy 1, policy_version 953989 (0.0007) [2023-12-28 02:05:40,842][106225] Updated weights for policy 1, policy_version 953999 (0.0005) [2023-12-28 02:05:40,866][106226] Updated weights for policy 0, policy_version 951623 (0.0008) [2023-12-28 02:05:40,891][106225] Updated weights for policy 1, policy_version 954009 (0.0005) [2023-12-28 02:05:40,922][106226] Updated weights for policy 0, policy_version 951633 (0.0007) [2023-12-28 02:05:40,972][106226] Updated weights for policy 0, policy_version 951643 (0.0007) [2023-12-28 02:05:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 487948288. Throughput: 0: 9937.5, 1: 9912.0. Samples: 487917892. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:41,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.031')] [2023-12-28 02:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000954016_244269056.pth... [2023-12-28 02:05:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000951648_243679232.pth... [2023-12-28 02:05:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000950496_243384320.pth [2023-12-28 02:05:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000952864_243974144.pth [2023-12-28 02:05:41,567][106225] Updated weights for policy 1, policy_version 954019 (0.0010) [2023-12-28 02:05:41,628][106225] Updated weights for policy 1, policy_version 954029 (0.0008) [2023-12-28 02:05:41,694][106225] Updated weights for policy 1, policy_version 954039 (0.0008) [2023-12-28 02:05:41,746][106226] Updated weights for policy 0, policy_version 951653 (0.0009) [2023-12-28 02:05:41,817][106226] Updated weights for policy 0, policy_version 951663 (0.0008) [2023-12-28 02:05:41,885][106226] Updated weights for policy 0, policy_version 951673 (0.0008) [2023-12-28 02:05:42,463][106225] Updated weights for policy 1, policy_version 954049 (0.0008) [2023-12-28 02:05:42,528][106225] Updated weights for policy 1, policy_version 954059 (0.0009) [2023-12-28 02:05:42,528][106226] Updated weights for policy 0, policy_version 951683 (0.0009) [2023-12-28 02:05:42,592][106225] Updated weights for policy 1, policy_version 954069 (0.0008) [2023-12-28 02:05:42,593][106226] Updated weights for policy 0, policy_version 951693 (0.0008) [2023-12-28 02:05:42,652][106225] Updated weights for policy 1, policy_version 954079 (0.0007) [2023-12-28 02:05:42,654][106226] Updated weights for policy 0, policy_version 951703 (0.0006) [2023-12-28 02:05:43,314][106226] Updated weights for policy 0, policy_version 951713 (0.0008) [2023-12-28 02:05:43,341][106225] Updated weights for policy 1, policy_version 954089 (0.0005) [2023-12-28 02:05:43,367][106226] Updated weights for policy 0, policy_version 951723 (0.0008) [2023-12-28 02:05:43,402][106225] Updated weights for policy 1, policy_version 954099 (0.0006) [2023-12-28 02:05:43,420][106226] Updated weights for policy 0, policy_version 951733 (0.0008) [2023-12-28 02:05:43,454][106225] Updated weights for policy 1, policy_version 954109 (0.0007) [2023-12-28 02:05:43,479][106226] Updated weights for policy 0, policy_version 951743 (0.0006) [2023-12-28 02:05:44,161][106225] Updated weights for policy 1, policy_version 954119 (0.0007) [2023-12-28 02:05:44,202][106226] Updated weights for policy 0, policy_version 951753 (0.0007) [2023-12-28 02:05:44,212][106225] Updated weights for policy 1, policy_version 954129 (0.0006) [2023-12-28 02:05:44,251][106226] Updated weights for policy 0, policy_version 951763 (0.0005) [2023-12-28 02:05:44,269][106225] Updated weights for policy 1, policy_version 954139 (0.0007) [2023-12-28 02:05:44,310][106226] Updated weights for policy 0, policy_version 951773 (0.0008) [2023-12-28 02:05:45,019][106225] Updated weights for policy 1, policy_version 954149 (0.0007) [2023-12-28 02:05:45,054][106226] Updated weights for policy 0, policy_version 951783 (0.0008) [2023-12-28 02:05:45,076][106225] Updated weights for policy 1, policy_version 954159 (0.0008) [2023-12-28 02:05:45,115][106226] Updated weights for policy 0, policy_version 951793 (0.0006) [2023-12-28 02:05:45,140][106225] Updated weights for policy 1, policy_version 954169 (0.0007) [2023-12-28 02:05:45,183][106226] Updated weights for policy 0, policy_version 951803 (0.0006) [2023-12-28 02:05:45,762][106225] Updated weights for policy 1, policy_version 954179 (0.0008) [2023-12-28 02:05:45,817][106225] Updated weights for policy 1, policy_version 954189 (0.0006) [2023-12-28 02:05:45,867][106225] Updated weights for policy 1, policy_version 954199 (0.0006) [2023-12-28 02:05:45,868][106226] Updated weights for policy 0, policy_version 951813 (0.0008) [2023-12-28 02:05:45,924][106226] Updated weights for policy 0, policy_version 951823 (0.0007) [2023-12-28 02:05:45,989][106226] Updated weights for policy 0, policy_version 951833 (0.0005) [2023-12-28 02:05:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 488046592. Throughput: 0: 9821.0, 1: 9966.7. Samples: 488032528. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:46,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.845')] [2023-12-28 02:05:46,422][106225] Updated weights for policy 1, policy_version 954209 (0.0005) [2023-12-28 02:05:46,496][106225] Updated weights for policy 1, policy_version 954219 (0.0007) [2023-12-28 02:05:46,555][106226] Updated weights for policy 0, policy_version 951843 (0.0009) [2023-12-28 02:05:46,563][106225] Updated weights for policy 1, policy_version 954229 (0.0010) [2023-12-28 02:05:46,616][106226] Updated weights for policy 0, policy_version 951853 (0.0011) [2023-12-28 02:05:46,623][106225] Updated weights for policy 1, policy_version 954239 (0.0010) [2023-12-28 02:05:46,673][106226] Updated weights for policy 0, policy_version 951863 (0.0010) [2023-12-28 02:05:47,283][106226] Updated weights for policy 0, policy_version 951873 (0.0010) [2023-12-28 02:05:47,290][106225] Updated weights for policy 1, policy_version 954249 (0.0008) [2023-12-28 02:05:47,337][106225] Updated weights for policy 1, policy_version 954259 (0.0006) [2023-12-28 02:05:47,343][106226] Updated weights for policy 0, policy_version 951883 (0.0010) [2023-12-28 02:05:47,388][106225] Updated weights for policy 1, policy_version 954269 (0.0005) [2023-12-28 02:05:47,400][106226] Updated weights for policy 0, policy_version 951893 (0.0007) [2023-12-28 02:05:47,450][106226] Updated weights for policy 0, policy_version 951903 (0.0008) [2023-12-28 02:05:47,941][106225] Updated weights for policy 1, policy_version 954279 (0.0005) [2023-12-28 02:05:48,004][106225] Updated weights for policy 1, policy_version 954289 (0.0006) [2023-12-28 02:05:48,068][106225] Updated weights for policy 1, policy_version 954299 (0.0005) [2023-12-28 02:05:48,196][106226] Updated weights for policy 0, policy_version 951913 (0.0006) [2023-12-28 02:05:48,251][106226] Updated weights for policy 0, policy_version 951923 (0.0005) [2023-12-28 02:05:48,314][106226] Updated weights for policy 0, policy_version 951933 (0.0006) [2023-12-28 02:05:48,653][106225] Updated weights for policy 1, policy_version 954309 (0.0007) [2023-12-28 02:05:48,712][106225] Updated weights for policy 1, policy_version 954319 (0.0008) [2023-12-28 02:05:48,764][106225] Updated weights for policy 1, policy_version 954329 (0.0008) [2023-12-28 02:05:49,051][106226] Updated weights for policy 0, policy_version 951944 (0.0010) [2023-12-28 02:05:49,104][106226] Updated weights for policy 0, policy_version 951954 (0.0010) [2023-12-28 02:05:49,154][106226] Updated weights for policy 0, policy_version 951964 (0.0010) [2023-12-28 02:05:49,488][106225] Updated weights for policy 1, policy_version 954339 (0.0008) [2023-12-28 02:05:49,541][106225] Updated weights for policy 1, policy_version 954349 (0.0009) [2023-12-28 02:05:49,592][106225] Updated weights for policy 1, policy_version 954359 (0.0008) [2023-12-28 02:05:49,875][106226] Updated weights for policy 0, policy_version 951974 (0.0008) [2023-12-28 02:05:49,940][106226] Updated weights for policy 0, policy_version 951984 (0.0009) [2023-12-28 02:05:50,007][106226] Updated weights for policy 0, policy_version 951994 (0.0009) [2023-12-28 02:05:50,391][106225] Updated weights for policy 1, policy_version 954369 (0.0008) [2023-12-28 02:05:50,445][106225] Updated weights for policy 1, policy_version 954379 (0.0009) [2023-12-28 02:05:50,499][106225] Updated weights for policy 1, policy_version 954389 (0.0008) [2023-12-28 02:05:50,557][106225] Updated weights for policy 1, policy_version 954399 (0.0008) [2023-12-28 02:05:50,664][106226] Updated weights for policy 0, policy_version 952004 (0.0008) [2023-12-28 02:05:50,731][106226] Updated weights for policy 0, policy_version 952014 (0.0009) [2023-12-28 02:05:50,791][106226] Updated weights for policy 0, policy_version 952024 (0.0007) [2023-12-28 02:05:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 488144896. Throughput: 0: 9827.1, 1: 9914.8. Samples: 488155676. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:51,175][105115] Avg episode reward: [(0, '-4.926'), (1, '-4.920')] [2023-12-28 02:05:51,344][106225] Updated weights for policy 1, policy_version 954409 (0.0009) [2023-12-28 02:05:51,407][106225] Updated weights for policy 1, policy_version 954419 (0.0008) [2023-12-28 02:05:51,432][106226] Updated weights for policy 0, policy_version 952034 (0.0007) [2023-12-28 02:05:51,467][106225] Updated weights for policy 1, policy_version 954429 (0.0007) [2023-12-28 02:05:51,491][106226] Updated weights for policy 0, policy_version 952044 (0.0008) [2023-12-28 02:05:51,550][106226] Updated weights for policy 0, policy_version 952054 (0.0009) [2023-12-28 02:05:51,609][106226] Updated weights for policy 0, policy_version 952064 (0.0008) [2023-12-28 02:05:52,237][106225] Updated weights for policy 1, policy_version 954439 (0.0009) [2023-12-28 02:05:52,300][106225] Updated weights for policy 1, policy_version 954449 (0.0009) [2023-12-28 02:05:52,366][106225] Updated weights for policy 1, policy_version 954459 (0.0011) [2023-12-28 02:05:52,406][106226] Updated weights for policy 0, policy_version 952074 (0.0008) [2023-12-28 02:05:52,462][106226] Updated weights for policy 0, policy_version 952084 (0.0008) [2023-12-28 02:05:52,525][106226] Updated weights for policy 0, policy_version 952094 (0.0008) [2023-12-28 02:05:53,139][106225] Updated weights for policy 1, policy_version 954469 (0.0009) [2023-12-28 02:05:53,192][106225] Updated weights for policy 1, policy_version 954479 (0.0009) [2023-12-28 02:05:53,233][106226] Updated weights for policy 0, policy_version 952104 (0.0006) [2023-12-28 02:05:53,246][106225] Updated weights for policy 1, policy_version 954489 (0.0007) [2023-12-28 02:05:53,288][106226] Updated weights for policy 0, policy_version 952114 (0.0007) [2023-12-28 02:05:53,350][106226] Updated weights for policy 0, policy_version 952124 (0.0008) [2023-12-28 02:05:53,921][106226] Updated weights for policy 0, policy_version 952134 (0.0006) [2023-12-28 02:05:53,984][106225] Updated weights for policy 1, policy_version 954499 (0.0008) [2023-12-28 02:05:53,989][106226] Updated weights for policy 0, policy_version 952144 (0.0006) [2023-12-28 02:05:54,039][106226] Updated weights for policy 0, policy_version 952154 (0.0006) [2023-12-28 02:05:54,043][106225] Updated weights for policy 1, policy_version 954509 (0.0006) [2023-12-28 02:05:54,109][106225] Updated weights for policy 1, policy_version 954519 (0.0005) [2023-12-28 02:05:54,656][106225] Updated weights for policy 1, policy_version 954529 (0.0005) [2023-12-28 02:05:54,719][106225] Updated weights for policy 1, policy_version 954539 (0.0009) [2023-12-28 02:05:54,746][106226] Updated weights for policy 0, policy_version 952164 (0.0006) [2023-12-28 02:05:54,774][106225] Updated weights for policy 1, policy_version 954549 (0.0008) [2023-12-28 02:05:54,796][106226] Updated weights for policy 0, policy_version 952174 (0.0006) [2023-12-28 02:05:54,837][106225] Updated weights for policy 1, policy_version 954559 (0.0009) [2023-12-28 02:05:54,852][106226] Updated weights for policy 0, policy_version 952184 (0.0006) [2023-12-28 02:05:55,508][106226] Updated weights for policy 0, policy_version 952194 (0.0008) [2023-12-28 02:05:55,521][106225] Updated weights for policy 1, policy_version 954569 (0.0005) [2023-12-28 02:05:55,565][106226] Updated weights for policy 0, policy_version 952204 (0.0006) [2023-12-28 02:05:55,587][106225] Updated weights for policy 1, policy_version 954579 (0.0005) [2023-12-28 02:05:55,628][106226] Updated weights for policy 0, policy_version 952214 (0.0005) [2023-12-28 02:05:55,647][106225] Updated weights for policy 1, policy_version 954589 (0.0005) [2023-12-28 02:05:55,688][106226] Updated weights for policy 0, policy_version 952224 (0.0007) [2023-12-28 02:05:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 488243200. Throughput: 0: 9819.3, 1: 9907.5. Samples: 488214000. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:05:56,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.766')] [2023-12-28 02:05:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000952224_243826688.pth... [2023-12-28 02:05:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000951072_243531776.pth [2023-12-28 02:05:56,191][106225] Updated weights for policy 1, policy_version 954599 (0.0007) [2023-12-28 02:05:56,250][106225] Updated weights for policy 1, policy_version 954609 (0.0007) [2023-12-28 02:05:56,260][106226] Updated weights for policy 0, policy_version 952234 (0.0007) [2023-12-28 02:05:56,308][106225] Updated weights for policy 1, policy_version 954619 (0.0008) [2023-12-28 02:05:56,318][106226] Updated weights for policy 0, policy_version 952244 (0.0006) [2023-12-28 02:05:56,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000954624_244424704.pth... [2023-12-28 02:05:56,335][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000953440_244121600.pth [2023-12-28 02:05:56,370][106226] Updated weights for policy 0, policy_version 952254 (0.0005) [2023-12-28 02:05:56,948][106226] Updated weights for policy 0, policy_version 952264 (0.0009) [2023-12-28 02:05:57,009][106226] Updated weights for policy 0, policy_version 952274 (0.0010) [2023-12-28 02:05:57,061][106226] Updated weights for policy 0, policy_version 952284 (0.0009) [2023-12-28 02:05:57,082][106225] Updated weights for policy 1, policy_version 954629 (0.0007) [2023-12-28 02:05:57,137][106225] Updated weights for policy 1, policy_version 954639 (0.0007) [2023-12-28 02:05:57,195][106225] Updated weights for policy 1, policy_version 954649 (0.0009) [2023-12-28 02:05:57,709][106226] Updated weights for policy 0, policy_version 952294 (0.0007) [2023-12-28 02:05:57,765][106226] Updated weights for policy 0, policy_version 952304 (0.0005) [2023-12-28 02:05:57,817][106226] Updated weights for policy 0, policy_version 952314 (0.0007) [2023-12-28 02:05:57,895][106225] Updated weights for policy 1, policy_version 954659 (0.0008) [2023-12-28 02:05:57,944][106225] Updated weights for policy 1, policy_version 954669 (0.0007) [2023-12-28 02:05:58,004][106225] Updated weights for policy 1, policy_version 954679 (0.0006) [2023-12-28 02:05:58,531][106226] Updated weights for policy 0, policy_version 952324 (0.0007) [2023-12-28 02:05:58,602][106226] Updated weights for policy 0, policy_version 952334 (0.0009) [2023-12-28 02:05:58,670][106226] Updated weights for policy 0, policy_version 952344 (0.0008) [2023-12-28 02:05:58,797][106225] Updated weights for policy 1, policy_version 954689 (0.0008) [2023-12-28 02:05:58,867][106225] Updated weights for policy 1, policy_version 954699 (0.0008) [2023-12-28 02:05:58,925][106225] Updated weights for policy 1, policy_version 954709 (0.0008) [2023-12-28 02:05:58,987][106225] Updated weights for policy 1, policy_version 954719 (0.0009) [2023-12-28 02:05:59,472][106226] Updated weights for policy 0, policy_version 952354 (0.0007) [2023-12-28 02:05:59,541][106226] Updated weights for policy 0, policy_version 952364 (0.0007) [2023-12-28 02:05:59,604][106226] Updated weights for policy 0, policy_version 952374 (0.0008) [2023-12-28 02:05:59,670][106226] Updated weights for policy 0, policy_version 952384 (0.0008) [2023-12-28 02:05:59,768][106225] Updated weights for policy 1, policy_version 954729 (0.0007) [2023-12-28 02:05:59,834][106225] Updated weights for policy 1, policy_version 954739 (0.0008) [2023-12-28 02:05:59,905][106225] Updated weights for policy 1, policy_version 954749 (0.0008) [2023-12-28 02:06:00,290][106226] Updated weights for policy 0, policy_version 952394 (0.0007) [2023-12-28 02:06:00,338][106226] Updated weights for policy 0, policy_version 952404 (0.0008) [2023-12-28 02:06:00,398][106226] Updated weights for policy 0, policy_version 952414 (0.0008) [2023-12-28 02:06:00,638][106225] Updated weights for policy 1, policy_version 954759 (0.0008) [2023-12-28 02:06:00,699][106225] Updated weights for policy 1, policy_version 954769 (0.0010) [2023-12-28 02:06:00,764][106225] Updated weights for policy 1, policy_version 954779 (0.0007) [2023-12-28 02:06:00,983][106226] Updated weights for policy 0, policy_version 952424 (0.0006) [2023-12-28 02:06:01,040][106226] Updated weights for policy 0, policy_version 952434 (0.0006) [2023-12-28 02:06:01,103][106226] Updated weights for policy 0, policy_version 952444 (0.0007) [2023-12-28 02:06:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 488349696. Throughput: 0: 9943.0, 1: 9889.2. Samples: 488334796. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:01,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-5.083')] [2023-12-28 02:06:01,546][106225] Updated weights for policy 1, policy_version 954789 (0.0009) [2023-12-28 02:06:01,596][106225] Updated weights for policy 1, policy_version 954799 (0.0009) [2023-12-28 02:06:01,660][106225] Updated weights for policy 1, policy_version 954809 (0.0008) [2023-12-28 02:06:01,786][106226] Updated weights for policy 0, policy_version 952454 (0.0007) [2023-12-28 02:06:01,849][106226] Updated weights for policy 0, policy_version 952464 (0.0007) [2023-12-28 02:06:01,906][106226] Updated weights for policy 0, policy_version 952474 (0.0007) [2023-12-28 02:06:02,461][106225] Updated weights for policy 1, policy_version 954819 (0.0007) [2023-12-28 02:06:02,513][106225] Updated weights for policy 1, policy_version 954829 (0.0005) [2023-12-28 02:06:02,558][106226] Updated weights for policy 0, policy_version 952484 (0.0009) [2023-12-28 02:06:02,565][106225] Updated weights for policy 1, policy_version 954839 (0.0005) [2023-12-28 02:06:02,609][106226] Updated weights for policy 0, policy_version 952494 (0.0007) [2023-12-28 02:06:02,660][106226] Updated weights for policy 0, policy_version 952504 (0.0009) [2023-12-28 02:06:03,174][106225] Updated weights for policy 1, policy_version 954849 (0.0006) [2023-12-28 02:06:03,235][106225] Updated weights for policy 1, policy_version 954859 (0.0006) [2023-12-28 02:06:03,286][106225] Updated weights for policy 1, policy_version 954869 (0.0005) [2023-12-28 02:06:03,339][106225] Updated weights for policy 1, policy_version 954879 (0.0005) [2023-12-28 02:06:03,362][106226] Updated weights for policy 0, policy_version 952514 (0.0007) [2023-12-28 02:06:03,418][106226] Updated weights for policy 0, policy_version 952524 (0.0007) [2023-12-28 02:06:03,471][106226] Updated weights for policy 0, policy_version 952534 (0.0009) [2023-12-28 02:06:03,521][106226] Updated weights for policy 0, policy_version 952544 (0.0008) [2023-12-28 02:06:03,928][106225] Updated weights for policy 1, policy_version 954889 (0.0010) [2023-12-28 02:06:03,982][106225] Updated weights for policy 1, policy_version 954899 (0.0010) [2023-12-28 02:06:04,032][106225] Updated weights for policy 1, policy_version 954909 (0.0010) [2023-12-28 02:06:04,249][106226] Updated weights for policy 0, policy_version 952554 (0.0008) [2023-12-28 02:06:04,312][106226] Updated weights for policy 0, policy_version 952564 (0.0008) [2023-12-28 02:06:04,375][106226] Updated weights for policy 0, policy_version 952574 (0.0008) [2023-12-28 02:06:04,751][106225] Updated weights for policy 1, policy_version 954919 (0.0007) [2023-12-28 02:06:04,808][106225] Updated weights for policy 1, policy_version 954929 (0.0008) [2023-12-28 02:06:04,867][106225] Updated weights for policy 1, policy_version 954939 (0.0008) [2023-12-28 02:06:05,171][106226] Updated weights for policy 0, policy_version 952584 (0.0009) [2023-12-28 02:06:05,225][106226] Updated weights for policy 0, policy_version 952594 (0.0009) [2023-12-28 02:06:05,284][106226] Updated weights for policy 0, policy_version 952604 (0.0009) [2023-12-28 02:06:05,448][106225] Updated weights for policy 1, policy_version 954949 (0.0008) [2023-12-28 02:06:05,507][106225] Updated weights for policy 1, policy_version 954959 (0.0005) [2023-12-28 02:06:05,558][106225] Updated weights for policy 1, policy_version 954969 (0.0010) [2023-12-28 02:06:06,104][106226] Updated weights for policy 0, policy_version 952614 (0.0009) [2023-12-28 02:06:06,168][106226] Updated weights for policy 0, policy_version 952624 (0.0009) [2023-12-28 02:06:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 488439808. Throughput: 0: 9951.0, 1: 9876.7. Samples: 488454796. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:06,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-5.018')] [2023-12-28 02:06:06,190][106225] Updated weights for policy 1, policy_version 954979 (0.0009) [2023-12-28 02:06:06,225][106226] Updated weights for policy 0, policy_version 952634 (0.0007) [2023-12-28 02:06:06,254][106225] Updated weights for policy 1, policy_version 954989 (0.0010) [2023-12-28 02:06:06,309][106225] Updated weights for policy 1, policy_version 954999 (0.0010) [2023-12-28 02:06:07,004][106225] Updated weights for policy 1, policy_version 955009 (0.0010) [2023-12-28 02:06:07,008][106226] Updated weights for policy 0, policy_version 952644 (0.0007) [2023-12-28 02:06:07,060][106225] Updated weights for policy 1, policy_version 955019 (0.0010) [2023-12-28 02:06:07,078][106226] Updated weights for policy 0, policy_version 952654 (0.0006) [2023-12-28 02:06:07,115][106225] Updated weights for policy 1, policy_version 955029 (0.0010) [2023-12-28 02:06:07,126][106226] Updated weights for policy 0, policy_version 952664 (0.0006) [2023-12-28 02:06:07,173][106225] Updated weights for policy 1, policy_version 955039 (0.0010) [2023-12-28 02:06:07,862][106226] Updated weights for policy 0, policy_version 952674 (0.0009) [2023-12-28 02:06:07,876][106225] Updated weights for policy 1, policy_version 955049 (0.0010) [2023-12-28 02:06:07,911][106226] Updated weights for policy 0, policy_version 952684 (0.0008) [2023-12-28 02:06:07,926][106225] Updated weights for policy 1, policy_version 955059 (0.0010) [2023-12-28 02:06:07,967][106226] Updated weights for policy 0, policy_version 952694 (0.0009) [2023-12-28 02:06:07,969][106225] Updated weights for policy 1, policy_version 955069 (0.0005) [2023-12-28 02:06:08,016][106226] Updated weights for policy 0, policy_version 952704 (0.0010) [2023-12-28 02:06:08,572][106225] Updated weights for policy 1, policy_version 955079 (0.0009) [2023-12-28 02:06:08,636][106225] Updated weights for policy 1, policy_version 955089 (0.0010) [2023-12-28 02:06:08,694][106225] Updated weights for policy 1, policy_version 955099 (0.0010) [2023-12-28 02:06:08,816][106226] Updated weights for policy 0, policy_version 952714 (0.0011) [2023-12-28 02:06:08,885][106226] Updated weights for policy 0, policy_version 952724 (0.0011) [2023-12-28 02:06:08,947][106226] Updated weights for policy 0, policy_version 952734 (0.0011) [2023-12-28 02:06:09,400][106225] Updated weights for policy 1, policy_version 955109 (0.0009) [2023-12-28 02:06:09,469][106225] Updated weights for policy 1, policy_version 955119 (0.0009) [2023-12-28 02:06:09,535][106225] Updated weights for policy 1, policy_version 955129 (0.0011) [2023-12-28 02:06:09,721][106226] Updated weights for policy 0, policy_version 952744 (0.0008) [2023-12-28 02:06:09,787][106226] Updated weights for policy 0, policy_version 952754 (0.0007) [2023-12-28 02:06:09,854][106226] Updated weights for policy 0, policy_version 952764 (0.0008) [2023-12-28 02:06:10,325][106225] Updated weights for policy 1, policy_version 955139 (0.0009) [2023-12-28 02:06:10,388][106225] Updated weights for policy 1, policy_version 955149 (0.0009) [2023-12-28 02:06:10,452][106225] Updated weights for policy 1, policy_version 955159 (0.0008) [2023-12-28 02:06:10,576][106226] Updated weights for policy 0, policy_version 952774 (0.0008) [2023-12-28 02:06:10,632][106226] Updated weights for policy 0, policy_version 952784 (0.0006) [2023-12-28 02:06:10,696][106226] Updated weights for policy 0, policy_version 952794 (0.0006) [2023-12-28 02:06:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 488538112. Throughput: 0: 9929.4, 1: 9962.1. Samples: 488513508. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:11,175][105115] Avg episode reward: [(0, '-4.865'), (1, '-4.814')] [2023-12-28 02:06:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000955168_244563968.pth... [2023-12-28 02:06:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000952800_243974144.pth... [2023-12-28 02:06:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000951648_243679232.pth [2023-12-28 02:06:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000954016_244269056.pth [2023-12-28 02:06:11,209][106225] Updated weights for policy 1, policy_version 955169 (0.0009) [2023-12-28 02:06:11,281][106225] Updated weights for policy 1, policy_version 955179 (0.0007) [2023-12-28 02:06:11,344][106225] Updated weights for policy 1, policy_version 955189 (0.0008) [2023-12-28 02:06:11,408][106226] Updated weights for policy 0, policy_version 952804 (0.0008) [2023-12-28 02:06:11,419][106225] Updated weights for policy 1, policy_version 955199 (0.0007) [2023-12-28 02:06:11,470][106226] Updated weights for policy 0, policy_version 952814 (0.0008) [2023-12-28 02:06:11,534][106226] Updated weights for policy 0, policy_version 952824 (0.0008) [2023-12-28 02:06:12,232][106225] Updated weights for policy 1, policy_version 955209 (0.0008) [2023-12-28 02:06:12,269][106226] Updated weights for policy 0, policy_version 952834 (0.0009) [2023-12-28 02:06:12,296][106225] Updated weights for policy 1, policy_version 955219 (0.0009) [2023-12-28 02:06:12,331][106226] Updated weights for policy 0, policy_version 952844 (0.0007) [2023-12-28 02:06:12,359][106225] Updated weights for policy 1, policy_version 955229 (0.0007) [2023-12-28 02:06:12,400][106226] Updated weights for policy 0, policy_version 952854 (0.0008) [2023-12-28 02:06:12,464][106226] Updated weights for policy 0, policy_version 952864 (0.0006) [2023-12-28 02:06:13,043][106225] Updated weights for policy 1, policy_version 955239 (0.0008) [2023-12-28 02:06:13,097][106225] Updated weights for policy 1, policy_version 955249 (0.0008) [2023-12-28 02:06:13,152][106225] Updated weights for policy 1, policy_version 955259 (0.0007) [2023-12-28 02:06:13,176][106226] Updated weights for policy 0, policy_version 952874 (0.0011) [2023-12-28 02:06:13,229][106226] Updated weights for policy 0, policy_version 952884 (0.0010) [2023-12-28 02:06:13,286][106226] Updated weights for policy 0, policy_version 952894 (0.0011) [2023-12-28 02:06:13,877][106225] Updated weights for policy 1, policy_version 955269 (0.0005) [2023-12-28 02:06:13,941][106225] Updated weights for policy 1, policy_version 955279 (0.0005) [2023-12-28 02:06:14,003][106226] Updated weights for policy 0, policy_version 952904 (0.0010) [2023-12-28 02:06:14,005][106225] Updated weights for policy 1, policy_version 955289 (0.0005) [2023-12-28 02:06:14,061][106226] Updated weights for policy 0, policy_version 952914 (0.0011) [2023-12-28 02:06:14,121][106226] Updated weights for policy 0, policy_version 952924 (0.0010) [2023-12-28 02:06:14,606][106225] Updated weights for policy 1, policy_version 955299 (0.0006) [2023-12-28 02:06:14,665][106225] Updated weights for policy 1, policy_version 955309 (0.0005) [2023-12-28 02:06:14,724][106225] Updated weights for policy 1, policy_version 955319 (0.0005) [2023-12-28 02:06:14,827][106226] Updated weights for policy 0, policy_version 952934 (0.0011) [2023-12-28 02:06:14,883][106226] Updated weights for policy 0, policy_version 952944 (0.0010) [2023-12-28 02:06:14,952][106226] Updated weights for policy 0, policy_version 952954 (0.0010) [2023-12-28 02:06:15,402][106225] Updated weights for policy 1, policy_version 955329 (0.0006) [2023-12-28 02:06:15,464][106225] Updated weights for policy 1, policy_version 955339 (0.0009) [2023-12-28 02:06:15,527][106225] Updated weights for policy 1, policy_version 955349 (0.0008) [2023-12-28 02:06:15,589][106225] Updated weights for policy 1, policy_version 955359 (0.0008) [2023-12-28 02:06:15,655][106226] Updated weights for policy 0, policy_version 952964 (0.0007) [2023-12-28 02:06:15,709][106226] Updated weights for policy 0, policy_version 952974 (0.0008) [2023-12-28 02:06:15,761][106226] Updated weights for policy 0, policy_version 952984 (0.0008) [2023-12-28 02:06:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 488636416. Throughput: 0: 9855.0, 1: 9859.7. Samples: 488627504. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:16,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-5.050')] [2023-12-28 02:06:16,292][106225] Updated weights for policy 1, policy_version 955369 (0.0006) [2023-12-28 02:06:16,343][106225] Updated weights for policy 1, policy_version 955379 (0.0005) [2023-12-28 02:06:16,409][106225] Updated weights for policy 1, policy_version 955389 (0.0007) [2023-12-28 02:06:16,457][106226] Updated weights for policy 0, policy_version 952994 (0.0008) [2023-12-28 02:06:16,523][106226] Updated weights for policy 0, policy_version 953004 (0.0009) [2023-12-28 02:06:16,586][106226] Updated weights for policy 0, policy_version 953014 (0.0009) [2023-12-28 02:06:16,649][106226] Updated weights for policy 0, policy_version 953024 (0.0008) [2023-12-28 02:06:17,074][106225] Updated weights for policy 1, policy_version 955399 (0.0009) [2023-12-28 02:06:17,129][106225] Updated weights for policy 1, policy_version 955409 (0.0009) [2023-12-28 02:06:17,180][106225] Updated weights for policy 1, policy_version 955419 (0.0008) [2023-12-28 02:06:17,294][106226] Updated weights for policy 0, policy_version 953034 (0.0008) [2023-12-28 02:06:17,350][106226] Updated weights for policy 0, policy_version 953044 (0.0009) [2023-12-28 02:06:17,403][106226] Updated weights for policy 0, policy_version 953054 (0.0008) [2023-12-28 02:06:17,890][106225] Updated weights for policy 1, policy_version 955429 (0.0009) [2023-12-28 02:06:17,952][106225] Updated weights for policy 1, policy_version 955439 (0.0009) [2023-12-28 02:06:18,003][106225] Updated weights for policy 1, policy_version 955449 (0.0009) [2023-12-28 02:06:18,131][106226] Updated weights for policy 0, policy_version 953064 (0.0009) [2023-12-28 02:06:18,193][106226] Updated weights for policy 0, policy_version 953074 (0.0009) [2023-12-28 02:06:18,258][106226] Updated weights for policy 0, policy_version 953084 (0.0009) [2023-12-28 02:06:18,749][106225] Updated weights for policy 1, policy_version 955459 (0.0010) [2023-12-28 02:06:18,808][106225] Updated weights for policy 1, policy_version 955469 (0.0009) [2023-12-28 02:06:18,870][106225] Updated weights for policy 1, policy_version 955479 (0.0009) [2023-12-28 02:06:18,931][106226] Updated weights for policy 0, policy_version 953094 (0.0008) [2023-12-28 02:06:18,990][106226] Updated weights for policy 0, policy_version 953104 (0.0009) [2023-12-28 02:06:19,047][106226] Updated weights for policy 0, policy_version 953114 (0.0008) [2023-12-28 02:06:19,646][106225] Updated weights for policy 1, policy_version 955489 (0.0008) [2023-12-28 02:06:19,701][106225] Updated weights for policy 1, policy_version 955499 (0.0008) [2023-12-28 02:06:19,758][106225] Updated weights for policy 1, policy_version 955509 (0.0008) [2023-12-28 02:06:19,816][106225] Updated weights for policy 1, policy_version 955519 (0.0009) [2023-12-28 02:06:19,841][106226] Updated weights for policy 0, policy_version 953124 (0.0009) [2023-12-28 02:06:19,905][106226] Updated weights for policy 0, policy_version 953134 (0.0008) [2023-12-28 02:06:19,975][106226] Updated weights for policy 0, policy_version 953144 (0.0008) [2023-12-28 02:06:20,570][106225] Updated weights for policy 1, policy_version 955529 (0.0009) [2023-12-28 02:06:20,630][106225] Updated weights for policy 1, policy_version 955539 (0.0009) [2023-12-28 02:06:20,687][106225] Updated weights for policy 1, policy_version 955549 (0.0009) [2023-12-28 02:06:20,706][106226] Updated weights for policy 0, policy_version 953154 (0.0008) [2023-12-28 02:06:20,771][106226] Updated weights for policy 0, policy_version 953164 (0.0010) [2023-12-28 02:06:20,833][106226] Updated weights for policy 0, policy_version 953174 (0.0009) [2023-12-28 02:06:20,892][106226] Updated weights for policy 0, policy_version 953184 (0.0009) [2023-12-28 02:06:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 488734720. Throughput: 0: 9768.1, 1: 9830.5. Samples: 488742312. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:21,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-4.705')] [2023-12-28 02:06:21,354][106225] Updated weights for policy 1, policy_version 955559 (0.0008) [2023-12-28 02:06:21,427][106225] Updated weights for policy 1, policy_version 955569 (0.0008) [2023-12-28 02:06:21,488][106225] Updated weights for policy 1, policy_version 955579 (0.0006) [2023-12-28 02:06:21,758][106226] Updated weights for policy 0, policy_version 953194 (0.0008) [2023-12-28 02:06:21,817][106226] Updated weights for policy 0, policy_version 953204 (0.0008) [2023-12-28 02:06:21,887][106226] Updated weights for policy 0, policy_version 953214 (0.0008) [2023-12-28 02:06:22,138][106225] Updated weights for policy 1, policy_version 955589 (0.0006) [2023-12-28 02:06:22,202][106225] Updated weights for policy 1, policy_version 955599 (0.0008) [2023-12-28 02:06:22,268][106225] Updated weights for policy 1, policy_version 955609 (0.0008) [2023-12-28 02:06:22,656][106226] Updated weights for policy 0, policy_version 953224 (0.0009) [2023-12-28 02:06:22,716][106226] Updated weights for policy 0, policy_version 953234 (0.0010) [2023-12-28 02:06:22,775][106226] Updated weights for policy 0, policy_version 953244 (0.0009) [2023-12-28 02:06:23,035][106225] Updated weights for policy 1, policy_version 955619 (0.0008) [2023-12-28 02:06:23,100][106225] Updated weights for policy 1, policy_version 955629 (0.0009) [2023-12-28 02:06:23,156][106225] Updated weights for policy 1, policy_version 955639 (0.0008) [2023-12-28 02:06:23,490][106226] Updated weights for policy 0, policy_version 953254 (0.0009) [2023-12-28 02:06:23,536][106226] Updated weights for policy 0, policy_version 953264 (0.0005) [2023-12-28 02:06:23,583][106226] Updated weights for policy 0, policy_version 953274 (0.0005) [2023-12-28 02:06:23,887][106225] Updated weights for policy 1, policy_version 955649 (0.0007) [2023-12-28 02:06:23,945][106225] Updated weights for policy 1, policy_version 955659 (0.0008) [2023-12-28 02:06:23,995][106225] Updated weights for policy 1, policy_version 955669 (0.0008) [2023-12-28 02:06:24,045][106225] Updated weights for policy 1, policy_version 955679 (0.0008) [2023-12-28 02:06:24,152][106226] Updated weights for policy 0, policy_version 953284 (0.0005) [2023-12-28 02:06:24,219][106226] Updated weights for policy 0, policy_version 953294 (0.0005) [2023-12-28 02:06:24,286][106226] Updated weights for policy 0, policy_version 953304 (0.0005) [2023-12-28 02:06:24,796][106226] Updated weights for policy 0, policy_version 953314 (0.0007) [2023-12-28 02:06:24,849][106226] Updated weights for policy 0, policy_version 953324 (0.0011) [2023-12-28 02:06:24,889][106225] Updated weights for policy 1, policy_version 955689 (0.0007) [2023-12-28 02:06:24,899][106226] Updated weights for policy 0, policy_version 953334 (0.0007) [2023-12-28 02:06:24,939][106225] Updated weights for policy 1, policy_version 955699 (0.0009) [2023-12-28 02:06:24,954][106226] Updated weights for policy 0, policy_version 953344 (0.0005) [2023-12-28 02:06:24,991][106225] Updated weights for policy 1, policy_version 955709 (0.0008) [2023-12-28 02:06:25,495][106226] Updated weights for policy 0, policy_version 953354 (0.0010) [2023-12-28 02:06:25,549][106226] Updated weights for policy 0, policy_version 953364 (0.0011) [2023-12-28 02:06:25,603][106226] Updated weights for policy 0, policy_version 953374 (0.0011) [2023-12-28 02:06:25,793][106225] Updated weights for policy 1, policy_version 955719 (0.0007) [2023-12-28 02:06:25,847][106225] Updated weights for policy 1, policy_version 955729 (0.0008) [2023-12-28 02:06:25,913][106225] Updated weights for policy 1, policy_version 955739 (0.0008) [2023-12-28 02:06:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 488833024. Throughput: 0: 9778.7, 1: 9836.9. Samples: 488800596. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:26,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-4.788')] [2023-12-28 02:06:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000955744_244711424.pth... [2023-12-28 02:06:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000953376_244121600.pth... [2023-12-28 02:06:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000954624_244424704.pth [2023-12-28 02:06:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000952224_243826688.pth [2023-12-28 02:06:26,255][106226] Updated weights for policy 0, policy_version 953384 (0.0006) [2023-12-28 02:06:26,322][106226] Updated weights for policy 0, policy_version 953394 (0.0010) [2023-12-28 02:06:26,387][106226] Updated weights for policy 0, policy_version 953404 (0.0008) [2023-12-28 02:06:26,631][106225] Updated weights for policy 1, policy_version 955749 (0.0007) [2023-12-28 02:06:26,698][106225] Updated weights for policy 1, policy_version 955759 (0.0005) [2023-12-28 02:06:26,763][106225] Updated weights for policy 1, policy_version 955769 (0.0005) [2023-12-28 02:06:26,969][106226] Updated weights for policy 0, policy_version 953414 (0.0006) [2023-12-28 02:06:27,018][106226] Updated weights for policy 0, policy_version 953424 (0.0010) [2023-12-28 02:06:27,072][106226] Updated weights for policy 0, policy_version 953434 (0.0010) [2023-12-28 02:06:27,332][106225] Updated weights for policy 1, policy_version 955779 (0.0006) [2023-12-28 02:06:27,378][106225] Updated weights for policy 1, policy_version 955789 (0.0007) [2023-12-28 02:06:27,423][106225] Updated weights for policy 1, policy_version 955799 (0.0007) [2023-12-28 02:06:27,702][106226] Updated weights for policy 0, policy_version 953444 (0.0008) [2023-12-28 02:06:27,754][106226] Updated weights for policy 0, policy_version 953454 (0.0005) [2023-12-28 02:06:27,805][106226] Updated weights for policy 0, policy_version 953464 (0.0005) [2023-12-28 02:06:28,237][106225] Updated weights for policy 1, policy_version 955809 (0.0008) [2023-12-28 02:06:28,286][106225] Updated weights for policy 1, policy_version 955819 (0.0007) [2023-12-28 02:06:28,352][106225] Updated weights for policy 1, policy_version 955829 (0.0006) [2023-12-28 02:06:28,415][106225] Updated weights for policy 1, policy_version 955839 (0.0007) [2023-12-28 02:06:28,426][106226] Updated weights for policy 0, policy_version 953474 (0.0006) [2023-12-28 02:06:28,479][106226] Updated weights for policy 0, policy_version 953484 (0.0010) [2023-12-28 02:06:28,531][106226] Updated weights for policy 0, policy_version 953494 (0.0010) [2023-12-28 02:06:28,586][106226] Updated weights for policy 0, policy_version 953504 (0.0010) [2023-12-28 02:06:29,145][106225] Updated weights for policy 1, policy_version 955849 (0.0008) [2023-12-28 02:06:29,194][106225] Updated weights for policy 1, policy_version 955859 (0.0008) [2023-12-28 02:06:29,261][106225] Updated weights for policy 1, policy_version 955869 (0.0008) [2023-12-28 02:06:29,263][106226] Updated weights for policy 0, policy_version 953514 (0.0007) [2023-12-28 02:06:29,326][106226] Updated weights for policy 0, policy_version 953524 (0.0008) [2023-12-28 02:06:29,391][106226] Updated weights for policy 0, policy_version 953534 (0.0010) [2023-12-28 02:06:29,993][106225] Updated weights for policy 1, policy_version 955879 (0.0007) [2023-12-28 02:06:30,055][106225] Updated weights for policy 1, policy_version 955889 (0.0007) [2023-12-28 02:06:30,120][106226] Updated weights for policy 0, policy_version 953544 (0.0011) [2023-12-28 02:06:30,121][106225] Updated weights for policy 1, policy_version 955899 (0.0008) [2023-12-28 02:06:30,180][106226] Updated weights for policy 0, policy_version 953554 (0.0010) [2023-12-28 02:06:30,240][106226] Updated weights for policy 0, policy_version 953564 (0.0010) [2023-12-28 02:06:30,853][106226] Updated weights for policy 0, policy_version 953574 (0.0010) [2023-12-28 02:06:30,883][106225] Updated weights for policy 1, policy_version 955909 (0.0006) [2023-12-28 02:06:30,914][106226] Updated weights for policy 0, policy_version 953584 (0.0010) [2023-12-28 02:06:30,944][106225] Updated weights for policy 1, policy_version 955919 (0.0005) [2023-12-28 02:06:30,968][106226] Updated weights for policy 0, policy_version 953594 (0.0010) [2023-12-28 02:06:31,015][106225] Updated weights for policy 1, policy_version 955929 (0.0005) [2023-12-28 02:06:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 488939520. Throughput: 0: 9993.3, 1: 9823.7. Samples: 488924292. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:31,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.829')] [2023-12-28 02:06:31,632][106226] Updated weights for policy 0, policy_version 953604 (0.0009) [2023-12-28 02:06:31,688][106226] Updated weights for policy 0, policy_version 953614 (0.0007) [2023-12-28 02:06:31,756][106226] Updated weights for policy 0, policy_version 953624 (0.0010) [2023-12-28 02:06:31,765][106225] Updated weights for policy 1, policy_version 955939 (0.0007) [2023-12-28 02:06:31,830][106225] Updated weights for policy 1, policy_version 955949 (0.0006) [2023-12-28 02:06:31,902][106225] Updated weights for policy 1, policy_version 955959 (0.0006) [2023-12-28 02:06:32,440][106226] Updated weights for policy 0, policy_version 953634 (0.0009) [2023-12-28 02:06:32,496][106226] Updated weights for policy 0, policy_version 953644 (0.0010) [2023-12-28 02:06:32,557][106226] Updated weights for policy 0, policy_version 953654 (0.0009) [2023-12-28 02:06:32,594][106225] Updated weights for policy 1, policy_version 955969 (0.0008) [2023-12-28 02:06:32,619][106226] Updated weights for policy 0, policy_version 953664 (0.0005) [2023-12-28 02:06:32,658][106225] Updated weights for policy 1, policy_version 955979 (0.0008) [2023-12-28 02:06:32,720][106225] Updated weights for policy 1, policy_version 955989 (0.0008) [2023-12-28 02:06:32,770][106225] Updated weights for policy 1, policy_version 955999 (0.0008) [2023-12-28 02:06:33,225][106226] Updated weights for policy 0, policy_version 953674 (0.0005) [2023-12-28 02:06:33,283][106226] Updated weights for policy 0, policy_version 953684 (0.0005) [2023-12-28 02:06:33,340][106226] Updated weights for policy 0, policy_version 953694 (0.0005) [2023-12-28 02:06:33,493][106225] Updated weights for policy 1, policy_version 956009 (0.0008) [2023-12-28 02:06:33,552][106225] Updated weights for policy 1, policy_version 956019 (0.0007) [2023-12-28 02:06:33,610][106225] Updated weights for policy 1, policy_version 956029 (0.0008) [2023-12-28 02:06:33,904][106226] Updated weights for policy 0, policy_version 953704 (0.0008) [2023-12-28 02:06:33,949][106226] Updated weights for policy 0, policy_version 953714 (0.0008) [2023-12-28 02:06:33,998][106226] Updated weights for policy 0, policy_version 953724 (0.0008) [2023-12-28 02:06:34,342][106225] Updated weights for policy 1, policy_version 956039 (0.0009) [2023-12-28 02:06:34,402][106225] Updated weights for policy 1, policy_version 956049 (0.0009) [2023-12-28 02:06:34,467][106225] Updated weights for policy 1, policy_version 956059 (0.0007) [2023-12-28 02:06:34,715][106226] Updated weights for policy 0, policy_version 953734 (0.0007) [2023-12-28 02:06:34,770][106226] Updated weights for policy 0, policy_version 953744 (0.0006) [2023-12-28 02:06:34,834][106226] Updated weights for policy 0, policy_version 953754 (0.0006) [2023-12-28 02:06:35,257][106225] Updated weights for policy 1, policy_version 956069 (0.0008) [2023-12-28 02:06:35,312][106225] Updated weights for policy 1, policy_version 956079 (0.0009) [2023-12-28 02:06:35,378][106225] Updated weights for policy 1, policy_version 956089 (0.0008) [2023-12-28 02:06:35,404][106226] Updated weights for policy 0, policy_version 953764 (0.0007) [2023-12-28 02:06:35,463][106226] Updated weights for policy 0, policy_version 953774 (0.0006) [2023-12-28 02:06:35,514][106226] Updated weights for policy 0, policy_version 953784 (0.0008) [2023-12-28 02:06:36,138][106225] Updated weights for policy 1, policy_version 956099 (0.0008) [2023-12-28 02:06:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 489029632. Throughput: 0: 10073.1, 1: 9678.7. Samples: 489044504. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:36,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.794')] [2023-12-28 02:06:36,185][106226] Updated weights for policy 0, policy_version 953794 (0.0010) [2023-12-28 02:06:36,197][106225] Updated weights for policy 1, policy_version 956109 (0.0007) [2023-12-28 02:06:36,250][106226] Updated weights for policy 0, policy_version 953804 (0.0009) [2023-12-28 02:06:36,263][106225] Updated weights for policy 1, policy_version 956119 (0.0006) [2023-12-28 02:06:36,306][106226] Updated weights for policy 0, policy_version 953814 (0.0011) [2023-12-28 02:06:36,365][106226] Updated weights for policy 0, policy_version 953824 (0.0011) [2023-12-28 02:06:37,016][106225] Updated weights for policy 1, policy_version 956129 (0.0006) [2023-12-28 02:06:37,074][106225] Updated weights for policy 1, policy_version 956139 (0.0008) [2023-12-28 02:06:37,077][106226] Updated weights for policy 0, policy_version 953834 (0.0005) [2023-12-28 02:06:37,134][106226] Updated weights for policy 0, policy_version 953844 (0.0009) [2023-12-28 02:06:37,139][106225] Updated weights for policy 1, policy_version 956149 (0.0008) [2023-12-28 02:06:37,192][106226] Updated weights for policy 0, policy_version 953854 (0.0010) [2023-12-28 02:06:37,200][106225] Updated weights for policy 1, policy_version 956159 (0.0006) [2023-12-28 02:06:37,745][106226] Updated weights for policy 0, policy_version 953864 (0.0007) [2023-12-28 02:06:37,807][106226] Updated weights for policy 0, policy_version 953874 (0.0009) [2023-12-28 02:06:37,866][106226] Updated weights for policy 0, policy_version 953884 (0.0007) [2023-12-28 02:06:38,016][106225] Updated weights for policy 1, policy_version 956169 (0.0008) [2023-12-28 02:06:38,086][106225] Updated weights for policy 1, policy_version 956179 (0.0010) [2023-12-28 02:06:38,142][106225] Updated weights for policy 1, policy_version 956189 (0.0008) [2023-12-28 02:06:38,470][106226] Updated weights for policy 0, policy_version 953894 (0.0008) [2023-12-28 02:06:38,524][106226] Updated weights for policy 0, policy_version 953904 (0.0010) [2023-12-28 02:06:38,575][106226] Updated weights for policy 0, policy_version 953914 (0.0010) [2023-12-28 02:06:38,919][106225] Updated weights for policy 1, policy_version 956199 (0.0007) [2023-12-28 02:06:38,976][106225] Updated weights for policy 1, policy_version 956209 (0.0007) [2023-12-28 02:06:39,033][106225] Updated weights for policy 1, policy_version 956219 (0.0007) [2023-12-28 02:06:39,317][106226] Updated weights for policy 0, policy_version 953924 (0.0010) [2023-12-28 02:06:39,385][106226] Updated weights for policy 0, policy_version 953934 (0.0008) [2023-12-28 02:06:39,449][106226] Updated weights for policy 0, policy_version 953944 (0.0008) [2023-12-28 02:06:39,832][106225] Updated weights for policy 1, policy_version 956229 (0.0008) [2023-12-28 02:06:39,894][106225] Updated weights for policy 1, policy_version 956239 (0.0009) [2023-12-28 02:06:39,963][106225] Updated weights for policy 1, policy_version 956249 (0.0008) [2023-12-28 02:06:40,083][106226] Updated weights for policy 0, policy_version 953954 (0.0006) [2023-12-28 02:06:40,139][106226] Updated weights for policy 0, policy_version 953964 (0.0008) [2023-12-28 02:06:40,196][106226] Updated weights for policy 0, policy_version 953974 (0.0006) [2023-12-28 02:06:40,254][106226] Updated weights for policy 0, policy_version 953984 (0.0006) [2023-12-28 02:06:40,804][106225] Updated weights for policy 1, policy_version 956259 (0.0008) [2023-12-28 02:06:40,838][106226] Updated weights for policy 0, policy_version 953994 (0.0006) [2023-12-28 02:06:40,866][106225] Updated weights for policy 1, policy_version 956269 (0.0007) [2023-12-28 02:06:40,896][106226] Updated weights for policy 0, policy_version 954004 (0.0006) [2023-12-28 02:06:40,925][106225] Updated weights for policy 1, policy_version 956279 (0.0009) [2023-12-28 02:06:40,962][106226] Updated weights for policy 0, policy_version 954014 (0.0006) [2023-12-28 02:06:41,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 489136128. Throughput: 0: 10099.3, 1: 9653.9. Samples: 489102900. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:41,176][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.953')] [2023-12-28 02:06:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000956288_244850688.pth... [2023-12-28 02:06:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000954016_244285440.pth... [2023-12-28 02:06:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000955168_244563968.pth [2023-12-28 02:06:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000952800_243974144.pth [2023-12-28 02:06:41,743][106225] Updated weights for policy 1, policy_version 956289 (0.0008) [2023-12-28 02:06:41,770][106226] Updated weights for policy 0, policy_version 954024 (0.0008) [2023-12-28 02:06:41,813][106225] Updated weights for policy 1, policy_version 956299 (0.0009) [2023-12-28 02:06:41,827][106226] Updated weights for policy 0, policy_version 954034 (0.0008) [2023-12-28 02:06:41,872][106225] Updated weights for policy 1, policy_version 956309 (0.0010) [2023-12-28 02:06:41,889][106226] Updated weights for policy 0, policy_version 954044 (0.0007) [2023-12-28 02:06:41,930][106225] Updated weights for policy 1, policy_version 956319 (0.0010) [2023-12-28 02:06:42,558][106226] Updated weights for policy 0, policy_version 954054 (0.0006) [2023-12-28 02:06:42,615][106226] Updated weights for policy 0, policy_version 954064 (0.0005) [2023-12-28 02:06:42,667][106225] Updated weights for policy 1, policy_version 956329 (0.0010) [2023-12-28 02:06:42,674][106226] Updated weights for policy 0, policy_version 954074 (0.0008) [2023-12-28 02:06:42,728][106225] Updated weights for policy 1, policy_version 956339 (0.0010) [2023-12-28 02:06:42,789][106225] Updated weights for policy 1, policy_version 956349 (0.0010) [2023-12-28 02:06:43,315][106226] Updated weights for policy 0, policy_version 954084 (0.0009) [2023-12-28 02:06:43,365][106226] Updated weights for policy 0, policy_version 954094 (0.0007) [2023-12-28 02:06:43,414][106226] Updated weights for policy 0, policy_version 954104 (0.0008) [2023-12-28 02:06:43,511][106225] Updated weights for policy 1, policy_version 956359 (0.0010) [2023-12-28 02:06:43,564][106225] Updated weights for policy 1, policy_version 956369 (0.0010) [2023-12-28 02:06:43,620][106225] Updated weights for policy 1, policy_version 956379 (0.0010) [2023-12-28 02:06:44,163][106226] Updated weights for policy 0, policy_version 954114 (0.0008) [2023-12-28 02:06:44,215][106226] Updated weights for policy 0, policy_version 954124 (0.0010) [2023-12-28 02:06:44,263][106226] Updated weights for policy 0, policy_version 954134 (0.0008) [2023-12-28 02:06:44,305][106225] Updated weights for policy 1, policy_version 956389 (0.0008) [2023-12-28 02:06:44,317][106226] Updated weights for policy 0, policy_version 954144 (0.0008) [2023-12-28 02:06:44,357][106225] Updated weights for policy 1, policy_version 956399 (0.0008) [2023-12-28 02:06:44,406][106225] Updated weights for policy 1, policy_version 956409 (0.0007) [2023-12-28 02:06:44,975][106225] Updated weights for policy 1, policy_version 956419 (0.0006) [2023-12-28 02:06:45,037][106225] Updated weights for policy 1, policy_version 956429 (0.0007) [2023-12-28 02:06:45,084][106226] Updated weights for policy 0, policy_version 954154 (0.0010) [2023-12-28 02:06:45,095][106225] Updated weights for policy 1, policy_version 956439 (0.0010) [2023-12-28 02:06:45,146][106226] Updated weights for policy 0, policy_version 954164 (0.0011) [2023-12-28 02:06:45,212][106226] Updated weights for policy 0, policy_version 954174 (0.0011) [2023-12-28 02:06:45,677][106225] Updated weights for policy 1, policy_version 956449 (0.0011) [2023-12-28 02:06:45,728][106225] Updated weights for policy 1, policy_version 956459 (0.0010) [2023-12-28 02:06:45,787][106225] Updated weights for policy 1, policy_version 956469 (0.0010) [2023-12-28 02:06:45,846][106225] Updated weights for policy 1, policy_version 956479 (0.0010) [2023-12-28 02:06:45,949][106226] Updated weights for policy 0, policy_version 954184 (0.0011) [2023-12-28 02:06:46,002][106226] Updated weights for policy 0, policy_version 954194 (0.0010) [2023-12-28 02:06:46,055][106226] Updated weights for policy 0, policy_version 954204 (0.0010) [2023-12-28 02:06:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 489234432. Throughput: 0: 10070.3, 1: 9584.3. Samples: 489219252. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:46,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-4.994')] [2023-12-28 02:06:46,504][106225] Updated weights for policy 1, policy_version 956489 (0.0005) [2023-12-28 02:06:46,551][106225] Updated weights for policy 1, policy_version 956499 (0.0005) [2023-12-28 02:06:46,609][106225] Updated weights for policy 1, policy_version 956509 (0.0005) [2023-12-28 02:06:46,781][106226] Updated weights for policy 0, policy_version 954214 (0.0009) [2023-12-28 02:06:46,838][106226] Updated weights for policy 0, policy_version 954224 (0.0010) [2023-12-28 02:06:46,886][106226] Updated weights for policy 0, policy_version 954234 (0.0011) [2023-12-28 02:06:47,228][106225] Updated weights for policy 1, policy_version 956519 (0.0007) [2023-12-28 02:06:47,285][106225] Updated weights for policy 1, policy_version 956529 (0.0007) [2023-12-28 02:06:47,346][106225] Updated weights for policy 1, policy_version 956539 (0.0008) [2023-12-28 02:06:47,579][106226] Updated weights for policy 0, policy_version 954244 (0.0010) [2023-12-28 02:06:47,628][106226] Updated weights for policy 0, policy_version 954254 (0.0010) [2023-12-28 02:06:47,686][106226] Updated weights for policy 0, policy_version 954264 (0.0011) [2023-12-28 02:06:48,072][106225] Updated weights for policy 1, policy_version 956549 (0.0007) [2023-12-28 02:06:48,125][106225] Updated weights for policy 1, policy_version 956559 (0.0008) [2023-12-28 02:06:48,175][106225] Updated weights for policy 1, policy_version 956569 (0.0007) [2023-12-28 02:06:48,397][106226] Updated weights for policy 0, policy_version 954274 (0.0011) [2023-12-28 02:06:48,465][106226] Updated weights for policy 0, policy_version 954284 (0.0011) [2023-12-28 02:06:48,525][106226] Updated weights for policy 0, policy_version 954294 (0.0011) [2023-12-28 02:06:48,586][106226] Updated weights for policy 0, policy_version 954304 (0.0011) [2023-12-28 02:06:48,918][106225] Updated weights for policy 1, policy_version 956579 (0.0007) [2023-12-28 02:06:48,982][106225] Updated weights for policy 1, policy_version 956589 (0.0009) [2023-12-28 02:06:49,048][106225] Updated weights for policy 1, policy_version 956599 (0.0006) [2023-12-28 02:06:49,241][106226] Updated weights for policy 0, policy_version 954314 (0.0010) [2023-12-28 02:06:49,300][106226] Updated weights for policy 0, policy_version 954324 (0.0009) [2023-12-28 02:06:49,363][106226] Updated weights for policy 0, policy_version 954334 (0.0010) [2023-12-28 02:06:49,747][106225] Updated weights for policy 1, policy_version 956609 (0.0006) [2023-12-28 02:06:49,798][106225] Updated weights for policy 1, policy_version 956619 (0.0008) [2023-12-28 02:06:49,859][106225] Updated weights for policy 1, policy_version 956629 (0.0008) [2023-12-28 02:06:49,922][106225] Updated weights for policy 1, policy_version 956639 (0.0010) [2023-12-28 02:06:50,004][106226] Updated weights for policy 0, policy_version 954344 (0.0010) [2023-12-28 02:06:50,061][106226] Updated weights for policy 0, policy_version 954354 (0.0006) [2023-12-28 02:06:50,127][106226] Updated weights for policy 0, policy_version 954364 (0.0006) [2023-12-28 02:06:50,739][106225] Updated weights for policy 1, policy_version 956649 (0.0009) [2023-12-28 02:06:50,765][106226] Updated weights for policy 0, policy_version 954374 (0.0008) [2023-12-28 02:06:50,799][106225] Updated weights for policy 1, policy_version 956659 (0.0008) [2023-12-28 02:06:50,824][106226] Updated weights for policy 0, policy_version 954384 (0.0007) [2023-12-28 02:06:50,857][106225] Updated weights for policy 1, policy_version 956669 (0.0008) [2023-12-28 02:06:50,879][106226] Updated weights for policy 0, policy_version 954394 (0.0006) [2023-12-28 02:06:51,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 489332736. Throughput: 0: 10089.6, 1: 9577.7. Samples: 489339824. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:51,175][105115] Avg episode reward: [(0, '-4.859'), (1, '-5.134')] [2023-12-28 02:06:51,527][106226] Updated weights for policy 0, policy_version 954404 (0.0006) [2023-12-28 02:06:51,597][106226] Updated weights for policy 0, policy_version 954414 (0.0007) [2023-12-28 02:06:51,655][106225] Updated weights for policy 1, policy_version 956679 (0.0008) [2023-12-28 02:06:51,670][106226] Updated weights for policy 0, policy_version 954424 (0.0009) [2023-12-28 02:06:51,715][106225] Updated weights for policy 1, policy_version 956689 (0.0007) [2023-12-28 02:06:51,777][106225] Updated weights for policy 1, policy_version 956699 (0.0008) [2023-12-28 02:06:52,420][106226] Updated weights for policy 0, policy_version 954434 (0.0008) [2023-12-28 02:06:52,485][106226] Updated weights for policy 0, policy_version 954444 (0.0008) [2023-12-28 02:06:52,505][106225] Updated weights for policy 1, policy_version 956709 (0.0008) [2023-12-28 02:06:52,546][106226] Updated weights for policy 0, policy_version 954454 (0.0008) [2023-12-28 02:06:52,565][106225] Updated weights for policy 1, policy_version 956719 (0.0010) [2023-12-28 02:06:52,604][106226] Updated weights for policy 0, policy_version 954464 (0.0007) [2023-12-28 02:06:52,624][106225] Updated weights for policy 1, policy_version 956729 (0.0009) [2023-12-28 02:06:53,307][106226] Updated weights for policy 0, policy_version 954474 (0.0006) [2023-12-28 02:06:53,334][106225] Updated weights for policy 1, policy_version 956739 (0.0008) [2023-12-28 02:06:53,375][106226] Updated weights for policy 0, policy_version 954484 (0.0005) [2023-12-28 02:06:53,398][106225] Updated weights for policy 1, policy_version 956749 (0.0009) [2023-12-28 02:06:53,435][106226] Updated weights for policy 0, policy_version 954494 (0.0008) [2023-12-28 02:06:53,462][106225] Updated weights for policy 1, policy_version 956759 (0.0008) [2023-12-28 02:06:54,048][106226] Updated weights for policy 0, policy_version 954504 (0.0007) [2023-12-28 02:06:54,106][106226] Updated weights for policy 0, policy_version 954514 (0.0007) [2023-12-28 02:06:54,137][106225] Updated weights for policy 1, policy_version 956769 (0.0006) [2023-12-28 02:06:54,168][106226] Updated weights for policy 0, policy_version 954524 (0.0008) [2023-12-28 02:06:54,193][106225] Updated weights for policy 1, policy_version 956779 (0.0006) [2023-12-28 02:06:54,243][106225] Updated weights for policy 1, policy_version 956789 (0.0007) [2023-12-28 02:06:54,308][106225] Updated weights for policy 1, policy_version 956799 (0.0008) [2023-12-28 02:06:54,799][106226] Updated weights for policy 0, policy_version 954534 (0.0006) [2023-12-28 02:06:54,855][106226] Updated weights for policy 0, policy_version 954544 (0.0005) [2023-12-28 02:06:54,911][106226] Updated weights for policy 0, policy_version 954554 (0.0005) [2023-12-28 02:06:55,092][106225] Updated weights for policy 1, policy_version 956809 (0.0006) [2023-12-28 02:06:55,146][106225] Updated weights for policy 1, policy_version 956819 (0.0007) [2023-12-28 02:06:55,202][106225] Updated weights for policy 1, policy_version 956829 (0.0009) [2023-12-28 02:06:55,502][106226] Updated weights for policy 0, policy_version 954564 (0.0006) [2023-12-28 02:06:55,558][106226] Updated weights for policy 0, policy_version 954574 (0.0009) [2023-12-28 02:06:55,610][106226] Updated weights for policy 0, policy_version 954584 (0.0007) [2023-12-28 02:06:55,852][106225] Updated weights for policy 1, policy_version 956839 (0.0009) [2023-12-28 02:06:55,902][106225] Updated weights for policy 1, policy_version 956849 (0.0009) [2023-12-28 02:06:55,950][106225] Updated weights for policy 1, policy_version 956859 (0.0008) [2023-12-28 02:06:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 489431040. Throughput: 0: 10142.1, 1: 9509.7. Samples: 489397840. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:06:56,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.853')] [2023-12-28 02:06:56,177][106226] Updated weights for policy 0, policy_version 954594 (0.0009) [2023-12-28 02:06:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000956864_244998144.pth... [2023-12-28 02:06:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000955744_244711424.pth [2023-12-28 02:06:56,227][106226] Updated weights for policy 0, policy_version 954604 (0.0008) [2023-12-28 02:06:56,290][106226] Updated weights for policy 0, policy_version 954614 (0.0008) [2023-12-28 02:06:56,343][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000954624_244441088.pth... [2023-12-28 02:06:56,344][106226] Updated weights for policy 0, policy_version 954624 (0.0005) [2023-12-28 02:06:56,346][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000953376_244121600.pth [2023-12-28 02:06:56,574][106225] Updated weights for policy 1, policy_version 956869 (0.0008) [2023-12-28 02:06:56,629][106225] Updated weights for policy 1, policy_version 956879 (0.0006) [2023-12-28 02:06:56,689][106225] Updated weights for policy 1, policy_version 956889 (0.0006) [2023-12-28 02:06:57,076][106226] Updated weights for policy 0, policy_version 954634 (0.0009) [2023-12-28 02:06:57,121][106226] Updated weights for policy 0, policy_version 954644 (0.0009) [2023-12-28 02:06:57,171][106226] Updated weights for policy 0, policy_version 954654 (0.0005) [2023-12-28 02:06:57,334][106225] Updated weights for policy 1, policy_version 956899 (0.0005) [2023-12-28 02:06:57,388][106225] Updated weights for policy 1, policy_version 956909 (0.0010) [2023-12-28 02:06:57,438][106225] Updated weights for policy 1, policy_version 956920 (0.0007) [2023-12-28 02:06:57,886][106226] Updated weights for policy 0, policy_version 954664 (0.0008) [2023-12-28 02:06:57,941][106226] Updated weights for policy 0, policy_version 954674 (0.0008) [2023-12-28 02:06:57,993][106226] Updated weights for policy 0, policy_version 954684 (0.0008) [2023-12-28 02:06:58,156][106225] Updated weights for policy 1, policy_version 956930 (0.0008) [2023-12-28 02:06:58,203][106225] Updated weights for policy 1, policy_version 956940 (0.0008) [2023-12-28 02:06:58,267][106225] Updated weights for policy 1, policy_version 956950 (0.0008) [2023-12-28 02:06:58,328][106225] Updated weights for policy 1, policy_version 956960 (0.0006) [2023-12-28 02:06:58,750][106226] Updated weights for policy 0, policy_version 954694 (0.0009) [2023-12-28 02:06:58,824][106226] Updated weights for policy 0, policy_version 954704 (0.0010) [2023-12-28 02:06:58,893][106226] Updated weights for policy 0, policy_version 954714 (0.0009) [2023-12-28 02:06:59,145][106225] Updated weights for policy 1, policy_version 956970 (0.0009) [2023-12-28 02:06:59,208][106225] Updated weights for policy 1, policy_version 956980 (0.0008) [2023-12-28 02:06:59,275][106225] Updated weights for policy 1, policy_version 956990 (0.0010) [2023-12-28 02:06:59,653][106226] Updated weights for policy 0, policy_version 954724 (0.0008) [2023-12-28 02:06:59,702][106226] Updated weights for policy 0, policy_version 954734 (0.0009) [2023-12-28 02:06:59,759][106226] Updated weights for policy 0, policy_version 954744 (0.0005) [2023-12-28 02:07:00,051][106225] Updated weights for policy 1, policy_version 957000 (0.0009) [2023-12-28 02:07:00,101][106225] Updated weights for policy 1, policy_version 957010 (0.0009) [2023-12-28 02:07:00,151][106225] Updated weights for policy 1, policy_version 957020 (0.0008) [2023-12-28 02:07:00,391][106226] Updated weights for policy 0, policy_version 954754 (0.0008) [2023-12-28 02:07:00,448][106226] Updated weights for policy 0, policy_version 954764 (0.0006) [2023-12-28 02:07:00,503][106226] Updated weights for policy 0, policy_version 954774 (0.0005) [2023-12-28 02:07:00,568][106226] Updated weights for policy 0, policy_version 954784 (0.0008) [2023-12-28 02:07:01,011][106225] Updated weights for policy 1, policy_version 957030 (0.0008) [2023-12-28 02:07:01,079][106225] Updated weights for policy 1, policy_version 957040 (0.0009) [2023-12-28 02:07:01,126][106226] Updated weights for policy 0, policy_version 954794 (0.0009) [2023-12-28 02:07:01,135][106225] Updated weights for policy 1, policy_version 957050 (0.0006) [2023-12-28 02:07:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 489529344. Throughput: 0: 10236.8, 1: 9548.4. Samples: 489517836. Policy #0 lag: (min: 11.0, avg: 17.8, max: 43.0) [2023-12-28 02:07:01,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.887')] [2023-12-28 02:07:01,187][106226] Updated weights for policy 0, policy_version 954804 (0.0010) [2023-12-28 02:07:01,246][106226] Updated weights for policy 0, policy_version 954814 (0.0011) [2023-12-28 02:07:01,840][106225] Updated weights for policy 1, policy_version 957060 (0.0009) [2023-12-28 02:07:01,907][106225] Updated weights for policy 1, policy_version 957070 (0.0007) [2023-12-28 02:07:01,935][106226] Updated weights for policy 0, policy_version 954824 (0.0006) [2023-12-28 02:07:01,966][106225] Updated weights for policy 1, policy_version 957080 (0.0008) [2023-12-28 02:07:01,991][106226] Updated weights for policy 0, policy_version 954834 (0.0009) [2023-12-28 02:07:02,049][106226] Updated weights for policy 0, policy_version 954844 (0.0008) [2023-12-28 02:07:02,617][106225] Updated weights for policy 1, policy_version 957090 (0.0007) [2023-12-28 02:07:02,690][106225] Updated weights for policy 1, policy_version 957100 (0.0008) [2023-12-28 02:07:02,757][106225] Updated weights for policy 1, policy_version 957110 (0.0008) [2023-12-28 02:07:02,793][106226] Updated weights for policy 0, policy_version 954854 (0.0006) [2023-12-28 02:07:02,824][106225] Updated weights for policy 1, policy_version 957120 (0.0008) [2023-12-28 02:07:02,855][106226] Updated weights for policy 0, policy_version 954864 (0.0008) [2023-12-28 02:07:02,929][106226] Updated weights for policy 0, policy_version 954874 (0.0009) [2023-12-28 02:07:03,472][106225] Updated weights for policy 1, policy_version 957130 (0.0008) [2023-12-28 02:07:03,533][106225] Updated weights for policy 1, policy_version 957140 (0.0008) [2023-12-28 02:07:03,583][106225] Updated weights for policy 1, policy_version 957150 (0.0008) [2023-12-28 02:07:03,633][106226] Updated weights for policy 0, policy_version 954884 (0.0009) [2023-12-28 02:07:03,677][106226] Updated weights for policy 0, policy_version 954894 (0.0006) [2023-12-28 02:07:03,732][106226] Updated weights for policy 0, policy_version 954904 (0.0007) [2023-12-28 02:07:04,237][106225] Updated weights for policy 1, policy_version 957160 (0.0006) [2023-12-28 02:07:04,306][106225] Updated weights for policy 1, policy_version 957170 (0.0008) [2023-12-28 02:07:04,360][106225] Updated weights for policy 1, policy_version 957180 (0.0010) [2023-12-28 02:07:04,474][106226] Updated weights for policy 0, policy_version 954914 (0.0006) [2023-12-28 02:07:04,535][106226] Updated weights for policy 0, policy_version 954924 (0.0010) [2023-12-28 02:07:04,600][106226] Updated weights for policy 0, policy_version 954934 (0.0011) [2023-12-28 02:07:04,651][106226] Updated weights for policy 0, policy_version 954944 (0.0007) [2023-12-28 02:07:05,056][106225] Updated weights for policy 1, policy_version 957190 (0.0010) [2023-12-28 02:07:05,107][106225] Updated weights for policy 1, policy_version 957201 (0.0009) [2023-12-28 02:07:05,159][106225] Updated weights for policy 1, policy_version 957211 (0.0009) [2023-12-28 02:07:05,186][106226] Updated weights for policy 0, policy_version 954954 (0.0005) [2023-12-28 02:07:05,241][106226] Updated weights for policy 0, policy_version 954964 (0.0008) [2023-12-28 02:07:05,301][106226] Updated weights for policy 0, policy_version 954974 (0.0011) [2023-12-28 02:07:05,897][106226] Updated weights for policy 0, policy_version 954984 (0.0006) [2023-12-28 02:07:05,927][106225] Updated weights for policy 1, policy_version 957221 (0.0008) [2023-12-28 02:07:05,952][106226] Updated weights for policy 0, policy_version 954994 (0.0005) [2023-12-28 02:07:05,980][106225] Updated weights for policy 1, policy_version 957231 (0.0008) [2023-12-28 02:07:06,006][106226] Updated weights for policy 0, policy_version 955004 (0.0005) [2023-12-28 02:07:06,026][106225] Updated weights for policy 1, policy_version 957241 (0.0008) [2023-12-28 02:07:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 489635840. Throughput: 0: 10366.1, 1: 9565.2. Samples: 489639224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:06,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.873')] [2023-12-28 02:07:06,638][106226] Updated weights for policy 0, policy_version 955014 (0.0007) [2023-12-28 02:07:06,693][106226] Updated weights for policy 0, policy_version 955024 (0.0008) [2023-12-28 02:07:06,756][106226] Updated weights for policy 0, policy_version 955034 (0.0008) [2023-12-28 02:07:06,839][106225] Updated weights for policy 1, policy_version 957251 (0.0009) [2023-12-28 02:07:06,888][106225] Updated weights for policy 1, policy_version 957261 (0.0009) [2023-12-28 02:07:06,934][106225] Updated weights for policy 1, policy_version 957271 (0.0008) [2023-12-28 02:07:07,470][106226] Updated weights for policy 0, policy_version 955044 (0.0008) [2023-12-28 02:07:07,523][106226] Updated weights for policy 0, policy_version 955054 (0.0009) [2023-12-28 02:07:07,586][106226] Updated weights for policy 0, policy_version 955064 (0.0009) [2023-12-28 02:07:07,659][106225] Updated weights for policy 1, policy_version 957281 (0.0008) [2023-12-28 02:07:07,724][106225] Updated weights for policy 1, policy_version 957291 (0.0009) [2023-12-28 02:07:07,794][106225] Updated weights for policy 1, policy_version 957301 (0.0006) [2023-12-28 02:07:07,851][106225] Updated weights for policy 1, policy_version 957311 (0.0009) [2023-12-28 02:07:08,152][106226] Updated weights for policy 0, policy_version 955074 (0.0005) [2023-12-28 02:07:08,214][106226] Updated weights for policy 0, policy_version 955084 (0.0006) [2023-12-28 02:07:08,268][106226] Updated weights for policy 0, policy_version 955094 (0.0007) [2023-12-28 02:07:08,319][106226] Updated weights for policy 0, policy_version 955104 (0.0006) [2023-12-28 02:07:08,656][106225] Updated weights for policy 1, policy_version 957321 (0.0010) [2023-12-28 02:07:08,717][106225] Updated weights for policy 1, policy_version 957332 (0.0008) [2023-12-28 02:07:08,774][106225] Updated weights for policy 1, policy_version 957342 (0.0008) [2023-12-28 02:07:09,031][106226] Updated weights for policy 0, policy_version 955114 (0.0005) [2023-12-28 02:07:09,094][106226] Updated weights for policy 0, policy_version 955124 (0.0009) [2023-12-28 02:07:09,155][106226] Updated weights for policy 0, policy_version 955134 (0.0009) [2023-12-28 02:07:09,499][106225] Updated weights for policy 1, policy_version 957352 (0.0008) [2023-12-28 02:07:09,558][106225] Updated weights for policy 1, policy_version 957362 (0.0008) [2023-12-28 02:07:09,621][106225] Updated weights for policy 1, policy_version 957372 (0.0008) [2023-12-28 02:07:09,890][106226] Updated weights for policy 0, policy_version 955144 (0.0009) [2023-12-28 02:07:09,967][106226] Updated weights for policy 0, policy_version 955154 (0.0009) [2023-12-28 02:07:10,033][106226] Updated weights for policy 0, policy_version 955164 (0.0008) [2023-12-28 02:07:10,425][106225] Updated weights for policy 1, policy_version 957382 (0.0008) [2023-12-28 02:07:10,483][106225] Updated weights for policy 1, policy_version 957392 (0.0008) [2023-12-28 02:07:10,538][106225] Updated weights for policy 1, policy_version 957402 (0.0007) [2023-12-28 02:07:10,781][106226] Updated weights for policy 0, policy_version 955174 (0.0007) [2023-12-28 02:07:10,840][106226] Updated weights for policy 0, policy_version 955184 (0.0008) [2023-12-28 02:07:10,895][106226] Updated weights for policy 0, policy_version 955194 (0.0008) [2023-12-28 02:07:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 489725952. Throughput: 0: 10417.9, 1: 9527.7. Samples: 489698144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:11,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-5.180')] [2023-12-28 02:07:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000957408_245137408.pth... [2023-12-28 02:07:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000955200_244588544.pth... [2023-12-28 02:07:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000954016_244285440.pth [2023-12-28 02:07:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000956288_244850688.pth [2023-12-28 02:07:11,298][106225] Updated weights for policy 1, policy_version 957412 (0.0009) [2023-12-28 02:07:11,364][106225] Updated weights for policy 1, policy_version 957422 (0.0011) [2023-12-28 02:07:11,437][106225] Updated weights for policy 1, policy_version 957432 (0.0010) [2023-12-28 02:07:11,689][106226] Updated weights for policy 0, policy_version 955204 (0.0008) [2023-12-28 02:07:11,761][106226] Updated weights for policy 0, policy_version 955214 (0.0008) [2023-12-28 02:07:11,829][106226] Updated weights for policy 0, policy_version 955224 (0.0008) [2023-12-28 02:07:12,172][106225] Updated weights for policy 1, policy_version 957442 (0.0010) [2023-12-28 02:07:12,234][106225] Updated weights for policy 1, policy_version 957452 (0.0006) [2023-12-28 02:07:12,300][106225] Updated weights for policy 1, policy_version 957462 (0.0008) [2023-12-28 02:07:12,382][106225] Updated weights for policy 1, policy_version 957472 (0.0009) [2023-12-28 02:07:12,635][106226] Updated weights for policy 0, policy_version 955234 (0.0009) [2023-12-28 02:07:12,698][106226] Updated weights for policy 0, policy_version 955244 (0.0008) [2023-12-28 02:07:12,772][106226] Updated weights for policy 0, policy_version 955254 (0.0006) [2023-12-28 02:07:12,834][106226] Updated weights for policy 0, policy_version 955264 (0.0011) [2023-12-28 02:07:13,010][106225] Updated weights for policy 1, policy_version 957482 (0.0008) [2023-12-28 02:07:13,068][106225] Updated weights for policy 1, policy_version 957492 (0.0008) [2023-12-28 02:07:13,126][106225] Updated weights for policy 1, policy_version 957502 (0.0008) [2023-12-28 02:07:13,504][106226] Updated weights for policy 0, policy_version 955274 (0.0010) [2023-12-28 02:07:13,562][106226] Updated weights for policy 0, policy_version 955284 (0.0006) [2023-12-28 02:07:13,633][106226] Updated weights for policy 0, policy_version 955294 (0.0005) [2023-12-28 02:07:13,746][106225] Updated weights for policy 1, policy_version 957512 (0.0008) [2023-12-28 02:07:13,807][106225] Updated weights for policy 1, policy_version 957522 (0.0006) [2023-12-28 02:07:13,858][106225] Updated weights for policy 1, policy_version 957532 (0.0005) [2023-12-28 02:07:14,175][106226] Updated weights for policy 0, policy_version 955304 (0.0005) [2023-12-28 02:07:14,231][106226] Updated weights for policy 0, policy_version 955314 (0.0005) [2023-12-28 02:07:14,285][106226] Updated weights for policy 0, policy_version 955324 (0.0007) [2023-12-28 02:07:14,448][106225] Updated weights for policy 1, policy_version 957542 (0.0006) [2023-12-28 02:07:14,498][106225] Updated weights for policy 1, policy_version 957552 (0.0010) [2023-12-28 02:07:14,545][106225] Updated weights for policy 1, policy_version 957562 (0.0010) [2023-12-28 02:07:14,940][106226] Updated weights for policy 0, policy_version 955334 (0.0010) [2023-12-28 02:07:15,008][106226] Updated weights for policy 0, policy_version 955344 (0.0009) [2023-12-28 02:07:15,081][106226] Updated weights for policy 0, policy_version 955354 (0.0011) [2023-12-28 02:07:15,285][106225] Updated weights for policy 1, policy_version 957572 (0.0009) [2023-12-28 02:07:15,348][106225] Updated weights for policy 1, policy_version 957582 (0.0009) [2023-12-28 02:07:15,402][106225] Updated weights for policy 1, policy_version 957592 (0.0009) [2023-12-28 02:07:15,735][106226] Updated weights for policy 0, policy_version 955364 (0.0011) [2023-12-28 02:07:15,800][106226] Updated weights for policy 0, policy_version 955374 (0.0011) [2023-12-28 02:07:15,864][106226] Updated weights for policy 0, policy_version 955384 (0.0011) [2023-12-28 02:07:16,134][106225] Updated weights for policy 1, policy_version 957602 (0.0007) [2023-12-28 02:07:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 489824256. Throughput: 0: 10222.8, 1: 9588.2. Samples: 489815784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:16,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-5.162')] [2023-12-28 02:07:16,195][106225] Updated weights for policy 1, policy_version 957612 (0.0006) [2023-12-28 02:07:16,252][106225] Updated weights for policy 1, policy_version 957622 (0.0006) [2023-12-28 02:07:16,304][106225] Updated weights for policy 1, policy_version 957632 (0.0007) [2023-12-28 02:07:16,563][106226] Updated weights for policy 0, policy_version 955394 (0.0010) [2023-12-28 02:07:16,609][106226] Updated weights for policy 0, policy_version 955404 (0.0010) [2023-12-28 02:07:16,662][106226] Updated weights for policy 0, policy_version 955414 (0.0010) [2023-12-28 02:07:16,715][106226] Updated weights for policy 0, policy_version 955424 (0.0010) [2023-12-28 02:07:16,935][106225] Updated weights for policy 1, policy_version 957642 (0.0010) [2023-12-28 02:07:16,982][106225] Updated weights for policy 1, policy_version 957652 (0.0010) [2023-12-28 02:07:17,025][106225] Updated weights for policy 1, policy_version 957662 (0.0010) [2023-12-28 02:07:17,442][106226] Updated weights for policy 0, policy_version 955434 (0.0006) [2023-12-28 02:07:17,492][106226] Updated weights for policy 0, policy_version 955444 (0.0010) [2023-12-28 02:07:17,550][106226] Updated weights for policy 0, policy_version 955454 (0.0008) [2023-12-28 02:07:17,715][106225] Updated weights for policy 1, policy_version 957672 (0.0006) [2023-12-28 02:07:17,777][106225] Updated weights for policy 1, policy_version 957682 (0.0006) [2023-12-28 02:07:17,840][106225] Updated weights for policy 1, policy_version 957692 (0.0010) [2023-12-28 02:07:18,221][106226] Updated weights for policy 0, policy_version 955464 (0.0009) [2023-12-28 02:07:18,268][106226] Updated weights for policy 0, policy_version 955474 (0.0010) [2023-12-28 02:07:18,319][106226] Updated weights for policy 0, policy_version 955484 (0.0008) [2023-12-28 02:07:18,481][106225] Updated weights for policy 1, policy_version 957702 (0.0009) [2023-12-28 02:07:18,541][106225] Updated weights for policy 1, policy_version 957712 (0.0008) [2023-12-28 02:07:18,593][106225] Updated weights for policy 1, policy_version 957722 (0.0008) [2023-12-28 02:07:19,149][106226] Updated weights for policy 0, policy_version 955494 (0.0007) [2023-12-28 02:07:19,206][106226] Updated weights for policy 0, policy_version 955504 (0.0008) [2023-12-28 02:07:19,259][106225] Updated weights for policy 1, policy_version 957732 (0.0010) [2023-12-28 02:07:19,279][106226] Updated weights for policy 0, policy_version 955514 (0.0009) [2023-12-28 02:07:19,317][106225] Updated weights for policy 1, policy_version 957742 (0.0010) [2023-12-28 02:07:19,387][106225] Updated weights for policy 1, policy_version 957752 (0.0009) [2023-12-28 02:07:20,081][106225] Updated weights for policy 1, policy_version 957762 (0.0007) [2023-12-28 02:07:20,098][106226] Updated weights for policy 0, policy_version 955524 (0.0010) [2023-12-28 02:07:20,152][106225] Updated weights for policy 1, policy_version 957772 (0.0006) [2023-12-28 02:07:20,161][106226] Updated weights for policy 0, policy_version 955534 (0.0008) [2023-12-28 02:07:20,216][106226] Updated weights for policy 0, policy_version 955544 (0.0011) [2023-12-28 02:07:20,217][106225] Updated weights for policy 1, policy_version 957782 (0.0011) [2023-12-28 02:07:20,279][106225] Updated weights for policy 1, policy_version 957792 (0.0010) [2023-12-28 02:07:20,891][106226] Updated weights for policy 0, policy_version 955554 (0.0008) [2023-12-28 02:07:20,952][106226] Updated weights for policy 0, policy_version 955564 (0.0006) [2023-12-28 02:07:20,954][106225] Updated weights for policy 1, policy_version 957802 (0.0011) [2023-12-28 02:07:21,013][106226] Updated weights for policy 0, policy_version 955574 (0.0006) [2023-12-28 02:07:21,015][106225] Updated weights for policy 1, policy_version 957812 (0.0011) [2023-12-28 02:07:21,087][106225] Updated weights for policy 1, policy_version 957822 (0.0008) [2023-12-28 02:07:21,093][106226] Updated weights for policy 0, policy_version 955584 (0.0008) [2023-12-28 02:07:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 489930752. Throughput: 0: 10078.8, 1: 9686.7. Samples: 489933952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:21,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-5.245')] [2023-12-28 02:07:21,897][106226] Updated weights for policy 0, policy_version 955594 (0.0007) [2023-12-28 02:07:21,923][106225] Updated weights for policy 1, policy_version 957832 (0.0006) [2023-12-28 02:07:21,955][106226] Updated weights for policy 0, policy_version 955604 (0.0009) [2023-12-28 02:07:21,979][106225] Updated weights for policy 1, policy_version 957842 (0.0008) [2023-12-28 02:07:22,021][106226] Updated weights for policy 0, policy_version 955614 (0.0008) [2023-12-28 02:07:22,029][106225] Updated weights for policy 1, policy_version 957852 (0.0008) [2023-12-28 02:07:22,728][106226] Updated weights for policy 0, policy_version 955624 (0.0009) [2023-12-28 02:07:22,787][106226] Updated weights for policy 0, policy_version 955634 (0.0008) [2023-12-28 02:07:22,809][106225] Updated weights for policy 1, policy_version 957862 (0.0007) [2023-12-28 02:07:22,841][106226] Updated weights for policy 0, policy_version 955644 (0.0007) [2023-12-28 02:07:22,874][106225] Updated weights for policy 1, policy_version 957872 (0.0006) [2023-12-28 02:07:22,924][106225] Updated weights for policy 1, policy_version 957882 (0.0008) [2023-12-28 02:07:23,429][106226] Updated weights for policy 0, policy_version 955654 (0.0006) [2023-12-28 02:07:23,480][106226] Updated weights for policy 0, policy_version 955664 (0.0008) [2023-12-28 02:07:23,533][106226] Updated weights for policy 0, policy_version 955674 (0.0009) [2023-12-28 02:07:23,723][106225] Updated weights for policy 1, policy_version 957892 (0.0008) [2023-12-28 02:07:23,779][106225] Updated weights for policy 1, policy_version 957902 (0.0009) [2023-12-28 02:07:23,844][106225] Updated weights for policy 1, policy_version 957912 (0.0010) [2023-12-28 02:07:24,131][106226] Updated weights for policy 0, policy_version 955684 (0.0009) [2023-12-28 02:07:24,194][106226] Updated weights for policy 0, policy_version 955694 (0.0009) [2023-12-28 02:07:24,257][106226] Updated weights for policy 0, policy_version 955704 (0.0009) [2023-12-28 02:07:24,649][106225] Updated weights for policy 1, policy_version 957922 (0.0009) [2023-12-28 02:07:24,704][106225] Updated weights for policy 1, policy_version 957932 (0.0008) [2023-12-28 02:07:24,757][106225] Updated weights for policy 1, policy_version 957942 (0.0006) [2023-12-28 02:07:24,817][106225] Updated weights for policy 1, policy_version 957952 (0.0005) [2023-12-28 02:07:24,904][106226] Updated weights for policy 0, policy_version 955714 (0.0008) [2023-12-28 02:07:24,960][106226] Updated weights for policy 0, policy_version 955724 (0.0005) [2023-12-28 02:07:25,026][106226] Updated weights for policy 0, policy_version 955734 (0.0005) [2023-12-28 02:07:25,090][106226] Updated weights for policy 0, policy_version 955744 (0.0009) [2023-12-28 02:07:25,371][106225] Updated weights for policy 1, policy_version 957962 (0.0005) [2023-12-28 02:07:25,431][106225] Updated weights for policy 1, policy_version 957972 (0.0005) [2023-12-28 02:07:25,490][106225] Updated weights for policy 1, policy_version 957982 (0.0005) [2023-12-28 02:07:25,767][106226] Updated weights for policy 0, policy_version 955754 (0.0005) [2023-12-28 02:07:25,818][106226] Updated weights for policy 0, policy_version 955764 (0.0005) [2023-12-28 02:07:25,873][106226] Updated weights for policy 0, policy_version 955774 (0.0005) [2023-12-28 02:07:26,154][106225] Updated weights for policy 1, policy_version 957992 (0.0008) [2023-12-28 02:07:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 490020864. Throughput: 0: 10068.4, 1: 9683.5. Samples: 489991728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:26,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.146')] [2023-12-28 02:07:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000955776_244736000.pth... [2023-12-28 02:07:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000954624_244441088.pth [2023-12-28 02:07:26,212][106225] Updated weights for policy 1, policy_version 958002 (0.0008) [2023-12-28 02:07:26,269][106225] Updated weights for policy 1, policy_version 958012 (0.0008) [2023-12-28 02:07:26,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000958016_245293056.pth... [2023-12-28 02:07:26,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000956864_244998144.pth [2023-12-28 02:07:26,452][106226] Updated weights for policy 0, policy_version 955784 (0.0007) [2023-12-28 02:07:26,511][106226] Updated weights for policy 0, policy_version 955794 (0.0005) [2023-12-28 02:07:26,564][106226] Updated weights for policy 0, policy_version 955804 (0.0005) [2023-12-28 02:07:26,929][106225] Updated weights for policy 1, policy_version 958022 (0.0006) [2023-12-28 02:07:26,992][106225] Updated weights for policy 1, policy_version 958032 (0.0008) [2023-12-28 02:07:27,052][106225] Updated weights for policy 1, policy_version 958042 (0.0008) [2023-12-28 02:07:27,131][106226] Updated weights for policy 0, policy_version 955814 (0.0007) [2023-12-28 02:07:27,185][106226] Updated weights for policy 0, policy_version 955824 (0.0009) [2023-12-28 02:07:27,229][106226] Updated weights for policy 0, policy_version 955834 (0.0009) [2023-12-28 02:07:27,616][106225] Updated weights for policy 1, policy_version 958052 (0.0008) [2023-12-28 02:07:27,671][106225] Updated weights for policy 1, policy_version 958062 (0.0005) [2023-12-28 02:07:27,735][106225] Updated weights for policy 1, policy_version 958072 (0.0005) [2023-12-28 02:07:28,021][106226] Updated weights for policy 0, policy_version 955844 (0.0007) [2023-12-28 02:07:28,080][106226] Updated weights for policy 0, policy_version 955854 (0.0005) [2023-12-28 02:07:28,147][106226] Updated weights for policy 0, policy_version 955864 (0.0005) [2023-12-28 02:07:28,380][106225] Updated weights for policy 1, policy_version 958082 (0.0007) [2023-12-28 02:07:28,432][106225] Updated weights for policy 1, policy_version 958092 (0.0008) [2023-12-28 02:07:28,484][106225] Updated weights for policy 1, policy_version 958102 (0.0008) [2023-12-28 02:07:28,546][106225] Updated weights for policy 1, policy_version 958112 (0.0009) [2023-12-28 02:07:28,753][106226] Updated weights for policy 0, policy_version 955874 (0.0006) [2023-12-28 02:07:28,806][106226] Updated weights for policy 0, policy_version 955884 (0.0008) [2023-12-28 02:07:28,863][106226] Updated weights for policy 0, policy_version 955894 (0.0009) [2023-12-28 02:07:28,919][106226] Updated weights for policy 0, policy_version 955904 (0.0008) [2023-12-28 02:07:29,288][106225] Updated weights for policy 1, policy_version 958122 (0.0008) [2023-12-28 02:07:29,339][106225] Updated weights for policy 1, policy_version 958132 (0.0009) [2023-12-28 02:07:29,400][106225] Updated weights for policy 1, policy_version 958142 (0.0008) [2023-12-28 02:07:29,570][106226] Updated weights for policy 0, policy_version 955914 (0.0008) [2023-12-28 02:07:29,628][106226] Updated weights for policy 0, policy_version 955924 (0.0009) [2023-12-28 02:07:29,684][106226] Updated weights for policy 0, policy_version 955934 (0.0006) [2023-12-28 02:07:30,058][106225] Updated weights for policy 1, policy_version 958152 (0.0008) [2023-12-28 02:07:30,118][106225] Updated weights for policy 1, policy_version 958162 (0.0008) [2023-12-28 02:07:30,177][106225] Updated weights for policy 1, policy_version 958172 (0.0006) [2023-12-28 02:07:30,451][106226] Updated weights for policy 0, policy_version 955944 (0.0008) [2023-12-28 02:07:30,495][106226] Updated weights for policy 0, policy_version 955954 (0.0008) [2023-12-28 02:07:30,543][106226] Updated weights for policy 0, policy_version 955964 (0.0008) [2023-12-28 02:07:30,871][106225] Updated weights for policy 1, policy_version 958182 (0.0009) [2023-12-28 02:07:30,930][106225] Updated weights for policy 1, policy_version 958192 (0.0007) [2023-12-28 02:07:30,995][106225] Updated weights for policy 1, policy_version 958202 (0.0008) [2023-12-28 02:07:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 490127360. Throughput: 0: 10121.9, 1: 9807.5. Samples: 490116076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:31,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-5.185')] [2023-12-28 02:07:31,294][106226] Updated weights for policy 0, policy_version 955974 (0.0008) [2023-12-28 02:07:31,363][106226] Updated weights for policy 0, policy_version 955984 (0.0008) [2023-12-28 02:07:31,425][106226] Updated weights for policy 0, policy_version 955994 (0.0008) [2023-12-28 02:07:31,746][106225] Updated weights for policy 1, policy_version 958212 (0.0009) [2023-12-28 02:07:31,799][106225] Updated weights for policy 1, policy_version 958222 (0.0007) [2023-12-28 02:07:31,852][106225] Updated weights for policy 1, policy_version 958232 (0.0006) [2023-12-28 02:07:32,196][106226] Updated weights for policy 0, policy_version 956004 (0.0009) [2023-12-28 02:07:32,247][106226] Updated weights for policy 0, policy_version 956014 (0.0007) [2023-12-28 02:07:32,307][106226] Updated weights for policy 0, policy_version 956024 (0.0008) [2023-12-28 02:07:32,532][106225] Updated weights for policy 1, policy_version 958242 (0.0007) [2023-12-28 02:07:32,595][106225] Updated weights for policy 1, policy_version 958252 (0.0005) [2023-12-28 02:07:32,658][106225] Updated weights for policy 1, policy_version 958262 (0.0007) [2023-12-28 02:07:32,716][106225] Updated weights for policy 1, policy_version 958272 (0.0008) [2023-12-28 02:07:33,025][106226] Updated weights for policy 0, policy_version 956034 (0.0009) [2023-12-28 02:07:33,079][106226] Updated weights for policy 0, policy_version 956044 (0.0008) [2023-12-28 02:07:33,123][106226] Updated weights for policy 0, policy_version 956054 (0.0009) [2023-12-28 02:07:33,168][106226] Updated weights for policy 0, policy_version 956064 (0.0007) [2023-12-28 02:07:33,362][106225] Updated weights for policy 1, policy_version 958282 (0.0008) [2023-12-28 02:07:33,411][106225] Updated weights for policy 1, policy_version 958292 (0.0009) [2023-12-28 02:07:33,462][106225] Updated weights for policy 1, policy_version 958302 (0.0008) [2023-12-28 02:07:33,835][106226] Updated weights for policy 0, policy_version 956074 (0.0009) [2023-12-28 02:07:33,893][106226] Updated weights for policy 0, policy_version 956084 (0.0008) [2023-12-28 02:07:33,948][106226] Updated weights for policy 0, policy_version 956094 (0.0008) [2023-12-28 02:07:34,214][106225] Updated weights for policy 1, policy_version 958312 (0.0007) [2023-12-28 02:07:34,276][106225] Updated weights for policy 1, policy_version 958322 (0.0007) [2023-12-28 02:07:34,342][106225] Updated weights for policy 1, policy_version 958332 (0.0008) [2023-12-28 02:07:34,710][106226] Updated weights for policy 0, policy_version 956104 (0.0008) [2023-12-28 02:07:34,762][106226] Updated weights for policy 0, policy_version 956114 (0.0008) [2023-12-28 02:07:34,821][106226] Updated weights for policy 0, policy_version 956124 (0.0008) [2023-12-28 02:07:34,984][106225] Updated weights for policy 1, policy_version 958342 (0.0008) [2023-12-28 02:07:35,050][106225] Updated weights for policy 1, policy_version 958352 (0.0006) [2023-12-28 02:07:35,105][106225] Updated weights for policy 1, policy_version 958362 (0.0005) [2023-12-28 02:07:35,548][106226] Updated weights for policy 0, policy_version 956134 (0.0010) [2023-12-28 02:07:35,595][106226] Updated weights for policy 0, policy_version 956144 (0.0010) [2023-12-28 02:07:35,646][106226] Updated weights for policy 0, policy_version 956154 (0.0010) [2023-12-28 02:07:35,749][106225] Updated weights for policy 1, policy_version 958372 (0.0006) [2023-12-28 02:07:35,806][106225] Updated weights for policy 1, policy_version 958382 (0.0005) [2023-12-28 02:07:35,871][106225] Updated weights for policy 1, policy_version 958392 (0.0006) [2023-12-28 02:07:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 490225664. Throughput: 0: 10091.8, 1: 9811.6. Samples: 490235476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:36,175][105115] Avg episode reward: [(0, '-4.677'), (1, '-5.314')] [2023-12-28 02:07:36,273][106226] Updated weights for policy 0, policy_version 956164 (0.0011) [2023-12-28 02:07:36,325][106226] Updated weights for policy 0, policy_version 956174 (0.0011) [2023-12-28 02:07:36,387][106226] Updated weights for policy 0, policy_version 956184 (0.0011) [2023-12-28 02:07:36,534][106225] Updated weights for policy 1, policy_version 958402 (0.0005) [2023-12-28 02:07:36,602][106225] Updated weights for policy 1, policy_version 958412 (0.0008) [2023-12-28 02:07:36,665][106225] Updated weights for policy 1, policy_version 958422 (0.0008) [2023-12-28 02:07:36,730][106225] Updated weights for policy 1, policy_version 958432 (0.0009) [2023-12-28 02:07:37,089][106226] Updated weights for policy 0, policy_version 956194 (0.0011) [2023-12-28 02:07:37,173][106226] Updated weights for policy 0, policy_version 956204 (0.0011) [2023-12-28 02:07:37,223][106226] Updated weights for policy 0, policy_version 956214 (0.0010) [2023-12-28 02:07:37,283][106226] Updated weights for policy 0, policy_version 956224 (0.0011) [2023-12-28 02:07:37,511][106225] Updated weights for policy 1, policy_version 958442 (0.0008) [2023-12-28 02:07:37,562][106225] Updated weights for policy 1, policy_version 958452 (0.0008) [2023-12-28 02:07:37,616][106225] Updated weights for policy 1, policy_version 958462 (0.0008) [2023-12-28 02:07:37,989][106226] Updated weights for policy 0, policy_version 956234 (0.0010) [2023-12-28 02:07:38,042][106226] Updated weights for policy 0, policy_version 956244 (0.0010) [2023-12-28 02:07:38,096][106226] Updated weights for policy 0, policy_version 956254 (0.0011) [2023-12-28 02:07:38,267][106225] Updated weights for policy 1, policy_version 958472 (0.0007) [2023-12-28 02:07:38,337][106225] Updated weights for policy 1, policy_version 958482 (0.0006) [2023-12-28 02:07:38,405][106225] Updated weights for policy 1, policy_version 958492 (0.0008) [2023-12-28 02:07:38,734][106226] Updated weights for policy 0, policy_version 956264 (0.0006) [2023-12-28 02:07:38,795][106226] Updated weights for policy 0, policy_version 956274 (0.0006) [2023-12-28 02:07:38,856][106226] Updated weights for policy 0, policy_version 956284 (0.0006) [2023-12-28 02:07:39,167][106225] Updated weights for policy 1, policy_version 958502 (0.0008) [2023-12-28 02:07:39,222][106225] Updated weights for policy 1, policy_version 958512 (0.0008) [2023-12-28 02:07:39,288][106225] Updated weights for policy 1, policy_version 958522 (0.0007) [2023-12-28 02:07:39,437][106226] Updated weights for policy 0, policy_version 956294 (0.0007) [2023-12-28 02:07:39,503][106226] Updated weights for policy 0, policy_version 956304 (0.0008) [2023-12-28 02:07:39,569][106226] Updated weights for policy 0, policy_version 956314 (0.0009) [2023-12-28 02:07:40,065][106225] Updated weights for policy 1, policy_version 958532 (0.0007) [2023-12-28 02:07:40,129][106225] Updated weights for policy 1, policy_version 958542 (0.0006) [2023-12-28 02:07:40,188][106225] Updated weights for policy 1, policy_version 958552 (0.0006) [2023-12-28 02:07:40,363][106226] Updated weights for policy 0, policy_version 956324 (0.0008) [2023-12-28 02:07:40,424][106226] Updated weights for policy 0, policy_version 956334 (0.0010) [2023-12-28 02:07:40,482][106226] Updated weights for policy 0, policy_version 956344 (0.0008) [2023-12-28 02:07:40,744][106225] Updated weights for policy 1, policy_version 958562 (0.0006) [2023-12-28 02:07:40,791][106225] Updated weights for policy 1, policy_version 958572 (0.0005) [2023-12-28 02:07:40,848][106225] Updated weights for policy 1, policy_version 958582 (0.0005) [2023-12-28 02:07:40,912][106225] Updated weights for policy 1, policy_version 958592 (0.0005) [2023-12-28 02:07:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 490323968. Throughput: 0: 10113.4, 1: 9836.6. Samples: 490295592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:41,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.872')] [2023-12-28 02:07:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000956352_244883456.pth... [2023-12-28 02:07:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000958592_245440512.pth... [2023-12-28 02:07:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000955200_244588544.pth [2023-12-28 02:07:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000957408_245137408.pth [2023-12-28 02:07:41,250][106226] Updated weights for policy 0, policy_version 956354 (0.0009) [2023-12-28 02:07:41,311][106226] Updated weights for policy 0, policy_version 956364 (0.0007) [2023-12-28 02:07:41,380][106226] Updated weights for policy 0, policy_version 956374 (0.0008) [2023-12-28 02:07:41,448][106226] Updated weights for policy 0, policy_version 956384 (0.0008) [2023-12-28 02:07:41,651][106225] Updated weights for policy 1, policy_version 958602 (0.0008) [2023-12-28 02:07:41,703][106225] Updated weights for policy 1, policy_version 958612 (0.0008) [2023-12-28 02:07:41,771][106225] Updated weights for policy 1, policy_version 958622 (0.0011) [2023-12-28 02:07:42,131][106226] Updated weights for policy 0, policy_version 956394 (0.0008) [2023-12-28 02:07:42,181][106226] Updated weights for policy 0, policy_version 956404 (0.0009) [2023-12-28 02:07:42,241][106226] Updated weights for policy 0, policy_version 956414 (0.0009) [2023-12-28 02:07:42,423][106225] Updated weights for policy 1, policy_version 958632 (0.0006) [2023-12-28 02:07:42,478][106225] Updated weights for policy 1, policy_version 958642 (0.0005) [2023-12-28 02:07:42,533][106225] Updated weights for policy 1, policy_version 958652 (0.0006) [2023-12-28 02:07:42,949][106226] Updated weights for policy 0, policy_version 956424 (0.0008) [2023-12-28 02:07:43,012][106226] Updated weights for policy 0, policy_version 956434 (0.0008) [2023-12-28 02:07:43,074][106226] Updated weights for policy 0, policy_version 956444 (0.0009) [2023-12-28 02:07:43,234][106225] Updated weights for policy 1, policy_version 958662 (0.0008) [2023-12-28 02:07:43,283][106225] Updated weights for policy 1, policy_version 958672 (0.0009) [2023-12-28 02:07:43,339][106225] Updated weights for policy 1, policy_version 958682 (0.0008) [2023-12-28 02:07:43,743][106226] Updated weights for policy 0, policy_version 956454 (0.0007) [2023-12-28 02:07:43,805][106226] Updated weights for policy 0, policy_version 956464 (0.0005) [2023-12-28 02:07:43,871][106226] Updated weights for policy 0, policy_version 956474 (0.0005) [2023-12-28 02:07:44,125][106225] Updated weights for policy 1, policy_version 958692 (0.0008) [2023-12-28 02:07:44,175][106225] Updated weights for policy 1, policy_version 958702 (0.0008) [2023-12-28 02:07:44,226][106225] Updated weights for policy 1, policy_version 958712 (0.0006) [2023-12-28 02:07:44,527][106226] Updated weights for policy 0, policy_version 956484 (0.0008) [2023-12-28 02:07:44,588][106226] Updated weights for policy 0, policy_version 956494 (0.0011) [2023-12-28 02:07:44,643][106226] Updated weights for policy 0, policy_version 956504 (0.0008) [2023-12-28 02:07:44,797][106225] Updated weights for policy 1, policy_version 958722 (0.0005) [2023-12-28 02:07:44,863][106225] Updated weights for policy 1, policy_version 958732 (0.0009) [2023-12-28 02:07:44,925][106225] Updated weights for policy 1, policy_version 958742 (0.0009) [2023-12-28 02:07:44,987][106225] Updated weights for policy 1, policy_version 958752 (0.0009) [2023-12-28 02:07:45,420][106226] Updated weights for policy 0, policy_version 956514 (0.0005) [2023-12-28 02:07:45,477][106226] Updated weights for policy 0, policy_version 956524 (0.0005) [2023-12-28 02:07:45,529][106226] Updated weights for policy 0, policy_version 956534 (0.0010) [2023-12-28 02:07:45,584][106226] Updated weights for policy 0, policy_version 956544 (0.0010) [2023-12-28 02:07:45,819][106225] Updated weights for policy 1, policy_version 958762 (0.0008) [2023-12-28 02:07:45,889][106225] Updated weights for policy 1, policy_version 958772 (0.0010) [2023-12-28 02:07:45,953][106225] Updated weights for policy 1, policy_version 958782 (0.0007) [2023-12-28 02:07:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 490422272. Throughput: 0: 10045.4, 1: 9867.7. Samples: 490413928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:46,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-4.866')] [2023-12-28 02:07:46,197][106226] Updated weights for policy 0, policy_version 956554 (0.0010) [2023-12-28 02:07:46,248][106226] Updated weights for policy 0, policy_version 956564 (0.0010) [2023-12-28 02:07:46,299][106226] Updated weights for policy 0, policy_version 956574 (0.0010) [2023-12-28 02:07:46,638][106225] Updated weights for policy 1, policy_version 958792 (0.0008) [2023-12-28 02:07:46,697][106225] Updated weights for policy 1, policy_version 958802 (0.0007) [2023-12-28 02:07:46,757][106225] Updated weights for policy 1, policy_version 958812 (0.0005) [2023-12-28 02:07:47,058][106226] Updated weights for policy 0, policy_version 956584 (0.0006) [2023-12-28 02:07:47,126][106226] Updated weights for policy 0, policy_version 956594 (0.0005) [2023-12-28 02:07:47,202][106226] Updated weights for policy 0, policy_version 956604 (0.0006) [2023-12-28 02:07:47,419][106225] Updated weights for policy 1, policy_version 958822 (0.0005) [2023-12-28 02:07:47,473][106225] Updated weights for policy 1, policy_version 958832 (0.0008) [2023-12-28 02:07:47,520][106225] Updated weights for policy 1, policy_version 958842 (0.0007) [2023-12-28 02:07:47,719][106226] Updated weights for policy 0, policy_version 956614 (0.0005) [2023-12-28 02:07:47,785][106226] Updated weights for policy 0, policy_version 956624 (0.0005) [2023-12-28 02:07:47,850][106226] Updated weights for policy 0, policy_version 956634 (0.0008) [2023-12-28 02:07:48,285][106225] Updated weights for policy 1, policy_version 958852 (0.0007) [2023-12-28 02:07:48,345][106225] Updated weights for policy 1, policy_version 958862 (0.0008) [2023-12-28 02:07:48,403][106225] Updated weights for policy 1, policy_version 958872 (0.0009) [2023-12-28 02:07:48,410][106226] Updated weights for policy 0, policy_version 956644 (0.0006) [2023-12-28 02:07:48,476][106226] Updated weights for policy 0, policy_version 956654 (0.0008) [2023-12-28 02:07:48,540][106226] Updated weights for policy 0, policy_version 956664 (0.0008) [2023-12-28 02:07:49,038][106225] Updated weights for policy 1, policy_version 958882 (0.0007) [2023-12-28 02:07:49,099][106225] Updated weights for policy 1, policy_version 958892 (0.0008) [2023-12-28 02:07:49,145][106225] Updated weights for policy 1, policy_version 958902 (0.0007) [2023-12-28 02:07:49,192][106226] Updated weights for policy 0, policy_version 956674 (0.0007) [2023-12-28 02:07:49,198][106225] Updated weights for policy 1, policy_version 958912 (0.0007) [2023-12-28 02:07:49,255][106226] Updated weights for policy 0, policy_version 956684 (0.0009) [2023-12-28 02:07:49,324][106226] Updated weights for policy 0, policy_version 956694 (0.0008) [2023-12-28 02:07:49,396][106226] Updated weights for policy 0, policy_version 956704 (0.0009) [2023-12-28 02:07:49,966][106225] Updated weights for policy 1, policy_version 958922 (0.0008) [2023-12-28 02:07:50,024][106225] Updated weights for policy 1, policy_version 958932 (0.0008) [2023-12-28 02:07:50,084][106225] Updated weights for policy 1, policy_version 958942 (0.0007) [2023-12-28 02:07:50,154][106226] Updated weights for policy 0, policy_version 956714 (0.0011) [2023-12-28 02:07:50,216][106226] Updated weights for policy 0, policy_version 956724 (0.0011) [2023-12-28 02:07:50,275][106226] Updated weights for policy 0, policy_version 956734 (0.0011) [2023-12-28 02:07:50,860][106225] Updated weights for policy 1, policy_version 958952 (0.0008) [2023-12-28 02:07:50,914][106225] Updated weights for policy 1, policy_version 958962 (0.0008) [2023-12-28 02:07:50,970][106225] Updated weights for policy 1, policy_version 958972 (0.0007) [2023-12-28 02:07:51,001][106226] Updated weights for policy 0, policy_version 956744 (0.0011) [2023-12-28 02:07:51,067][106226] Updated weights for policy 0, policy_version 956754 (0.0009) [2023-12-28 02:07:51,136][106226] Updated weights for policy 0, policy_version 956764 (0.0011) [2023-12-28 02:07:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 490528768. Throughput: 0: 10007.0, 1: 9844.5. Samples: 490532540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:51,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.827')] [2023-12-28 02:07:51,753][106225] Updated weights for policy 1, policy_version 958982 (0.0008) [2023-12-28 02:07:51,820][106225] Updated weights for policy 1, policy_version 958992 (0.0008) [2023-12-28 02:07:51,827][106226] Updated weights for policy 0, policy_version 956774 (0.0009) [2023-12-28 02:07:51,874][106226] Updated weights for policy 0, policy_version 956784 (0.0006) [2023-12-28 02:07:51,883][106225] Updated weights for policy 1, policy_version 959002 (0.0008) [2023-12-28 02:07:51,921][106226] Updated weights for policy 0, policy_version 956794 (0.0006) [2023-12-28 02:07:52,632][106226] Updated weights for policy 0, policy_version 956804 (0.0008) [2023-12-28 02:07:52,635][106225] Updated weights for policy 1, policy_version 959012 (0.0007) [2023-12-28 02:07:52,700][106225] Updated weights for policy 1, policy_version 959022 (0.0007) [2023-12-28 02:07:52,704][106226] Updated weights for policy 0, policy_version 956814 (0.0009) [2023-12-28 02:07:52,757][106225] Updated weights for policy 1, policy_version 959032 (0.0009) [2023-12-28 02:07:52,773][106226] Updated weights for policy 0, policy_version 956824 (0.0007) [2023-12-28 02:07:53,400][106226] Updated weights for policy 0, policy_version 956834 (0.0007) [2023-12-28 02:07:53,462][106226] Updated weights for policy 0, policy_version 956844 (0.0008) [2023-12-28 02:07:53,520][106225] Updated weights for policy 1, policy_version 959042 (0.0008) [2023-12-28 02:07:53,529][106226] Updated weights for policy 0, policy_version 956854 (0.0009) [2023-12-28 02:07:53,577][106225] Updated weights for policy 1, policy_version 959052 (0.0007) [2023-12-28 02:07:53,588][106226] Updated weights for policy 0, policy_version 956864 (0.0006) [2023-12-28 02:07:53,630][106225] Updated weights for policy 1, policy_version 959062 (0.0009) [2023-12-28 02:07:54,241][106226] Updated weights for policy 0, policy_version 956874 (0.0008) [2023-12-28 02:07:54,291][106226] Updated weights for policy 0, policy_version 956884 (0.0009) [2023-12-28 02:07:54,337][106226] Updated weights for policy 0, policy_version 956894 (0.0008) [2023-12-28 02:07:54,372][106225] Updated weights for policy 1, policy_version 959073 (0.0009) [2023-12-28 02:07:54,433][106225] Updated weights for policy 1, policy_version 959083 (0.0009) [2023-12-28 02:07:54,491][106225] Updated weights for policy 1, policy_version 959093 (0.0008) [2023-12-28 02:07:54,548][106225] Updated weights for policy 1, policy_version 959103 (0.0008) [2023-12-28 02:07:55,090][106226] Updated weights for policy 0, policy_version 956904 (0.0007) [2023-12-28 02:07:55,149][106226] Updated weights for policy 0, policy_version 956914 (0.0008) [2023-12-28 02:07:55,208][106226] Updated weights for policy 0, policy_version 956924 (0.0008) [2023-12-28 02:07:55,306][106225] Updated weights for policy 1, policy_version 959113 (0.0008) [2023-12-28 02:07:55,364][106225] Updated weights for policy 1, policy_version 959123 (0.0008) [2023-12-28 02:07:55,426][106225] Updated weights for policy 1, policy_version 959133 (0.0009) [2023-12-28 02:07:55,945][106226] Updated weights for policy 0, policy_version 956934 (0.0009) [2023-12-28 02:07:55,996][106226] Updated weights for policy 0, policy_version 956944 (0.0008) [2023-12-28 02:07:56,041][106226] Updated weights for policy 0, policy_version 956954 (0.0009) [2023-12-28 02:07:56,105][106225] Updated weights for policy 1, policy_version 959143 (0.0008) [2023-12-28 02:07:56,156][106225] Updated weights for policy 1, policy_version 959153 (0.0008) [2023-12-28 02:07:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 490618880. Throughput: 0: 9985.5, 1: 9834.0. Samples: 490590024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:07:56,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-4.905')] [2023-12-28 02:07:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000956960_245039104.pth... [2023-12-28 02:07:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000955776_244736000.pth [2023-12-28 02:07:56,204][106225] Updated weights for policy 1, policy_version 959163 (0.0009) [2023-12-28 02:07:56,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000959168_245587968.pth... [2023-12-28 02:07:56,231][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000958016_245293056.pth [2023-12-28 02:07:56,747][106226] Updated weights for policy 0, policy_version 956964 (0.0007) [2023-12-28 02:07:56,796][106226] Updated weights for policy 0, policy_version 956974 (0.0005) [2023-12-28 02:07:56,851][106226] Updated weights for policy 0, policy_version 956984 (0.0005) [2023-12-28 02:07:56,972][106225] Updated weights for policy 1, policy_version 959173 (0.0006) [2023-12-28 02:07:57,033][106225] Updated weights for policy 1, policy_version 959183 (0.0008) [2023-12-28 02:07:57,077][106225] Updated weights for policy 1, policy_version 959193 (0.0009) [2023-12-28 02:07:57,531][106226] Updated weights for policy 0, policy_version 956994 (0.0009) [2023-12-28 02:07:57,587][106226] Updated weights for policy 0, policy_version 957004 (0.0008) [2023-12-28 02:07:57,645][106226] Updated weights for policy 0, policy_version 957014 (0.0009) [2023-12-28 02:07:57,695][106226] Updated weights for policy 0, policy_version 957024 (0.0008) [2023-12-28 02:07:57,697][106225] Updated weights for policy 1, policy_version 959203 (0.0007) [2023-12-28 02:07:57,756][106225] Updated weights for policy 1, policy_version 959213 (0.0007) [2023-12-28 02:07:57,808][106225] Updated weights for policy 1, policy_version 959223 (0.0008) [2023-12-28 02:07:58,409][106226] Updated weights for policy 0, policy_version 957034 (0.0007) [2023-12-28 02:07:58,462][106225] Updated weights for policy 1, policy_version 959233 (0.0007) [2023-12-28 02:07:58,471][106226] Updated weights for policy 0, policy_version 957044 (0.0007) [2023-12-28 02:07:58,520][106225] Updated weights for policy 1, policy_version 959243 (0.0008) [2023-12-28 02:07:58,534][106226] Updated weights for policy 0, policy_version 957054 (0.0008) [2023-12-28 02:07:58,579][106225] Updated weights for policy 1, policy_version 959253 (0.0008) [2023-12-28 02:07:58,644][106225] Updated weights for policy 1, policy_version 959263 (0.0008) [2023-12-28 02:07:59,325][106226] Updated weights for policy 0, policy_version 957064 (0.0008) [2023-12-28 02:07:59,408][106226] Updated weights for policy 0, policy_version 957074 (0.0008) [2023-12-28 02:07:59,459][106226] Updated weights for policy 0, policy_version 957084 (0.0007) [2023-12-28 02:07:59,479][106225] Updated weights for policy 1, policy_version 959273 (0.0008) [2023-12-28 02:07:59,535][106225] Updated weights for policy 1, policy_version 959283 (0.0008) [2023-12-28 02:07:59,595][106225] Updated weights for policy 1, policy_version 959293 (0.0009) [2023-12-28 02:08:00,186][106226] Updated weights for policy 0, policy_version 957094 (0.0008) [2023-12-28 02:08:00,240][106226] Updated weights for policy 0, policy_version 957104 (0.0008) [2023-12-28 02:08:00,296][106226] Updated weights for policy 0, policy_version 957114 (0.0009) [2023-12-28 02:08:00,359][106225] Updated weights for policy 1, policy_version 959303 (0.0008) [2023-12-28 02:08:00,412][106225] Updated weights for policy 1, policy_version 959313 (0.0007) [2023-12-28 02:08:00,463][106225] Updated weights for policy 1, policy_version 959323 (0.0009) [2023-12-28 02:08:00,984][106226] Updated weights for policy 0, policy_version 957124 (0.0009) [2023-12-28 02:08:01,052][106226] Updated weights for policy 0, policy_version 957134 (0.0011) [2023-12-28 02:08:01,110][106226] Updated weights for policy 0, policy_version 957144 (0.0011) [2023-12-28 02:08:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 490717184. Throughput: 0: 9981.5, 1: 9796.0. Samples: 490705772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:01,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-4.902')] [2023-12-28 02:08:01,267][106225] Updated weights for policy 1, policy_version 959333 (0.0008) [2023-12-28 02:08:01,328][106225] Updated weights for policy 1, policy_version 959343 (0.0008) [2023-12-28 02:08:01,390][106225] Updated weights for policy 1, policy_version 959353 (0.0007) [2023-12-28 02:08:01,867][106226] Updated weights for policy 0, policy_version 957154 (0.0009) [2023-12-28 02:08:01,922][106226] Updated weights for policy 0, policy_version 957164 (0.0010) [2023-12-28 02:08:01,984][106226] Updated weights for policy 0, policy_version 957174 (0.0010) [2023-12-28 02:08:02,044][106226] Updated weights for policy 0, policy_version 957184 (0.0011) [2023-12-28 02:08:02,153][106225] Updated weights for policy 1, policy_version 959363 (0.0008) [2023-12-28 02:08:02,197][106225] Updated weights for policy 1, policy_version 959373 (0.0007) [2023-12-28 02:08:02,247][106225] Updated weights for policy 1, policy_version 959383 (0.0008) [2023-12-28 02:08:02,692][106226] Updated weights for policy 0, policy_version 957194 (0.0011) [2023-12-28 02:08:02,749][106226] Updated weights for policy 0, policy_version 957204 (0.0010) [2023-12-28 02:08:02,812][106226] Updated weights for policy 0, policy_version 957214 (0.0010) [2023-12-28 02:08:03,059][106225] Updated weights for policy 1, policy_version 959393 (0.0008) [2023-12-28 02:08:03,122][106225] Updated weights for policy 1, policy_version 959403 (0.0008) [2023-12-28 02:08:03,178][106225] Updated weights for policy 1, policy_version 959413 (0.0008) [2023-12-28 02:08:03,239][106225] Updated weights for policy 1, policy_version 959423 (0.0008) [2023-12-28 02:08:03,487][106226] Updated weights for policy 0, policy_version 957224 (0.0010) [2023-12-28 02:08:03,545][106226] Updated weights for policy 0, policy_version 957234 (0.0010) [2023-12-28 02:08:03,597][106226] Updated weights for policy 0, policy_version 957244 (0.0010) [2023-12-28 02:08:03,989][106225] Updated weights for policy 1, policy_version 959433 (0.0007) [2023-12-28 02:08:04,055][106225] Updated weights for policy 1, policy_version 959443 (0.0006) [2023-12-28 02:08:04,122][106225] Updated weights for policy 1, policy_version 959453 (0.0006) [2023-12-28 02:08:04,240][106226] Updated weights for policy 0, policy_version 957254 (0.0009) [2023-12-28 02:08:04,302][106226] Updated weights for policy 0, policy_version 957264 (0.0011) [2023-12-28 02:08:04,367][106226] Updated weights for policy 0, policy_version 957274 (0.0011) [2023-12-28 02:08:04,781][106225] Updated weights for policy 1, policy_version 959463 (0.0006) [2023-12-28 02:08:04,830][106225] Updated weights for policy 1, policy_version 959473 (0.0006) [2023-12-28 02:08:04,890][106225] Updated weights for policy 1, policy_version 959483 (0.0008) [2023-12-28 02:08:04,910][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000006 [2023-12-28 02:08:05,082][106226] Updated weights for policy 0, policy_version 957284 (0.0011) [2023-12-28 02:08:05,135][106226] Updated weights for policy 0, policy_version 957294 (0.0011) [2023-12-28 02:08:05,191][106226] Updated weights for policy 0, policy_version 957304 (0.0010) [2023-12-28 02:08:05,558][106225] Updated weights for policy 1, policy_version 959493 (0.0008) [2023-12-28 02:08:05,610][106225] Updated weights for policy 1, policy_version 959503 (0.0009) [2023-12-28 02:08:05,661][106225] Updated weights for policy 1, policy_version 959513 (0.0008) [2023-12-28 02:08:05,824][106226] Updated weights for policy 0, policy_version 957314 (0.0011) [2023-12-28 02:08:05,874][106226] Updated weights for policy 0, policy_version 957324 (0.0010) [2023-12-28 02:08:05,926][106226] Updated weights for policy 0, policy_version 957334 (0.0010) [2023-12-28 02:08:05,975][106226] Updated weights for policy 0, policy_version 957344 (0.0010) [2023-12-28 02:08:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 490815488. Throughput: 0: 10043.0, 1: 9710.0. Samples: 490822832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:06,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.064')] [2023-12-28 02:08:06,437][106225] Updated weights for policy 1, policy_version 959524 (0.0010) [2023-12-28 02:08:06,501][106225] Updated weights for policy 1, policy_version 959534 (0.0011) [2023-12-28 02:08:06,554][106225] Updated weights for policy 1, policy_version 959544 (0.0010) [2023-12-28 02:08:06,689][106226] Updated weights for policy 0, policy_version 957354 (0.0011) [2023-12-28 02:08:06,755][106226] Updated weights for policy 0, policy_version 957364 (0.0011) [2023-12-28 02:08:06,813][106226] Updated weights for policy 0, policy_version 957374 (0.0011) [2023-12-28 02:08:07,286][106225] Updated weights for policy 1, policy_version 959554 (0.0009) [2023-12-28 02:08:07,347][106225] Updated weights for policy 1, policy_version 959564 (0.0009) [2023-12-28 02:08:07,396][106225] Updated weights for policy 1, policy_version 959574 (0.0007) [2023-12-28 02:08:07,431][106226] Updated weights for policy 0, policy_version 957384 (0.0010) [2023-12-28 02:08:07,447][106225] Updated weights for policy 1, policy_version 959584 (0.0008) [2023-12-28 02:08:07,478][106226] Updated weights for policy 0, policy_version 957394 (0.0010) [2023-12-28 02:08:07,525][106226] Updated weights for policy 0, policy_version 957404 (0.0010) [2023-12-28 02:08:08,064][106225] Updated weights for policy 1, policy_version 959594 (0.0011) [2023-12-28 02:08:08,128][106225] Updated weights for policy 1, policy_version 959604 (0.0010) [2023-12-28 02:08:08,184][106225] Updated weights for policy 1, policy_version 959614 (0.0010) [2023-12-28 02:08:08,249][106226] Updated weights for policy 0, policy_version 957414 (0.0009) [2023-12-28 02:08:08,307][106226] Updated weights for policy 0, policy_version 957424 (0.0007) [2023-12-28 02:08:08,372][106226] Updated weights for policy 0, policy_version 957434 (0.0008) [2023-12-28 02:08:08,902][106225] Updated weights for policy 1, policy_version 959624 (0.0010) [2023-12-28 02:08:08,962][106225] Updated weights for policy 1, policy_version 959634 (0.0010) [2023-12-28 02:08:09,025][106225] Updated weights for policy 1, policy_version 959644 (0.0010) [2023-12-28 02:08:09,084][106226] Updated weights for policy 0, policy_version 957444 (0.0008) [2023-12-28 02:08:09,148][106226] Updated weights for policy 0, policy_version 957454 (0.0008) [2023-12-28 02:08:09,198][106226] Updated weights for policy 0, policy_version 957464 (0.0008) [2023-12-28 02:08:09,738][106225] Updated weights for policy 1, policy_version 959654 (0.0009) [2023-12-28 02:08:09,799][106225] Updated weights for policy 1, policy_version 959664 (0.0006) [2023-12-28 02:08:09,870][106225] Updated weights for policy 1, policy_version 959674 (0.0008) [2023-12-28 02:08:09,981][106226] Updated weights for policy 0, policy_version 957474 (0.0009) [2023-12-28 02:08:10,050][106226] Updated weights for policy 0, policy_version 957484 (0.0009) [2023-12-28 02:08:10,112][106226] Updated weights for policy 0, policy_version 957494 (0.0009) [2023-12-28 02:08:10,181][106226] Updated weights for policy 0, policy_version 957504 (0.0008) [2023-12-28 02:08:10,502][106225] Updated weights for policy 1, policy_version 959684 (0.0008) [2023-12-28 02:08:10,561][106225] Updated weights for policy 1, policy_version 959694 (0.0008) [2023-12-28 02:08:10,623][106225] Updated weights for policy 1, policy_version 959704 (0.0008) [2023-12-28 02:08:10,915][106226] Updated weights for policy 0, policy_version 957514 (0.0007) [2023-12-28 02:08:10,961][106226] Updated weights for policy 0, policy_version 957524 (0.0007) [2023-12-28 02:08:11,023][106226] Updated weights for policy 0, policy_version 957534 (0.0008) [2023-12-28 02:08:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 490913792. Throughput: 0: 10028.6, 1: 9786.9. Samples: 490883428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:11,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.997')] [2023-12-28 02:08:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000959712_245727232.pth... [2023-12-28 02:08:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000957536_245186560.pth... [2023-12-28 02:08:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000956352_244883456.pth [2023-12-28 02:08:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000958592_245440512.pth [2023-12-28 02:08:11,344][106225] Updated weights for policy 1, policy_version 959714 (0.0008) [2023-12-28 02:08:11,418][106225] Updated weights for policy 1, policy_version 959724 (0.0009) [2023-12-28 02:08:11,482][106225] Updated weights for policy 1, policy_version 959734 (0.0009) [2023-12-28 02:08:11,545][106225] Updated weights for policy 1, policy_version 959744 (0.0008) [2023-12-28 02:08:11,832][106226] Updated weights for policy 0, policy_version 957544 (0.0006) [2023-12-28 02:08:11,891][106226] Updated weights for policy 0, policy_version 957554 (0.0007) [2023-12-28 02:08:11,950][106226] Updated weights for policy 0, policy_version 957564 (0.0007) [2023-12-28 02:08:12,260][106225] Updated weights for policy 1, policy_version 959754 (0.0007) [2023-12-28 02:08:12,325][106225] Updated weights for policy 1, policy_version 959764 (0.0007) [2023-12-28 02:08:12,392][106225] Updated weights for policy 1, policy_version 959774 (0.0008) [2023-12-28 02:08:12,628][106226] Updated weights for policy 0, policy_version 957574 (0.0009) [2023-12-28 02:08:12,698][106226] Updated weights for policy 0, policy_version 957584 (0.0007) [2023-12-28 02:08:12,768][106226] Updated weights for policy 0, policy_version 957594 (0.0009) [2023-12-28 02:08:13,124][106225] Updated weights for policy 1, policy_version 959784 (0.0008) [2023-12-28 02:08:13,178][106225] Updated weights for policy 1, policy_version 959794 (0.0010) [2023-12-28 02:08:13,236][106225] Updated weights for policy 1, policy_version 959804 (0.0008) [2023-12-28 02:08:13,421][106226] Updated weights for policy 0, policy_version 957604 (0.0010) [2023-12-28 02:08:13,476][106226] Updated weights for policy 0, policy_version 957614 (0.0007) [2023-12-28 02:08:13,536][106226] Updated weights for policy 0, policy_version 957624 (0.0005) [2023-12-28 02:08:13,999][106225] Updated weights for policy 1, policy_version 959814 (0.0008) [2023-12-28 02:08:14,048][106225] Updated weights for policy 1, policy_version 959824 (0.0008) [2023-12-28 02:08:14,086][106226] Updated weights for policy 0, policy_version 957634 (0.0006) [2023-12-28 02:08:14,105][106225] Updated weights for policy 1, policy_version 959834 (0.0008) [2023-12-28 02:08:14,144][106226] Updated weights for policy 0, policy_version 957644 (0.0007) [2023-12-28 02:08:14,210][106226] Updated weights for policy 0, policy_version 957654 (0.0008) [2023-12-28 02:08:14,260][106226] Updated weights for policy 0, policy_version 957664 (0.0005) [2023-12-28 02:08:14,859][106226] Updated weights for policy 0, policy_version 957674 (0.0010) [2023-12-28 02:08:14,903][106225] Updated weights for policy 1, policy_version 959844 (0.0007) [2023-12-28 02:08:14,924][106226] Updated weights for policy 0, policy_version 957684 (0.0007) [2023-12-28 02:08:14,967][106225] Updated weights for policy 1, policy_version 959854 (0.0007) [2023-12-28 02:08:14,993][106226] Updated weights for policy 0, policy_version 957694 (0.0007) [2023-12-28 02:08:15,030][106225] Updated weights for policy 1, policy_version 959864 (0.0007) [2023-12-28 02:08:15,695][106225] Updated weights for policy 1, policy_version 959874 (0.0008) [2023-12-28 02:08:15,716][106226] Updated weights for policy 0, policy_version 957704 (0.0008) [2023-12-28 02:08:15,753][106225] Updated weights for policy 1, policy_version 959884 (0.0006) [2023-12-28 02:08:15,779][106226] Updated weights for policy 0, policy_version 957714 (0.0008) [2023-12-28 02:08:15,814][106225] Updated weights for policy 1, policy_version 959894 (0.0006) [2023-12-28 02:08:15,838][106226] Updated weights for policy 0, policy_version 957724 (0.0008) [2023-12-28 02:08:15,868][106225] Updated weights for policy 1, policy_version 959904 (0.0005) [2023-12-28 02:08:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 491012096. Throughput: 0: 9969.8, 1: 9685.9. Samples: 491000588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:16,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-5.073')] [2023-12-28 02:08:16,527][106226] Updated weights for policy 0, policy_version 957734 (0.0009) [2023-12-28 02:08:16,586][106226] Updated weights for policy 0, policy_version 957744 (0.0009) [2023-12-28 02:08:16,587][106225] Updated weights for policy 1, policy_version 959914 (0.0008) [2023-12-28 02:08:16,647][106225] Updated weights for policy 1, policy_version 959924 (0.0010) [2023-12-28 02:08:16,648][106226] Updated weights for policy 0, policy_version 957754 (0.0009) [2023-12-28 02:08:16,711][106225] Updated weights for policy 1, policy_version 959934 (0.0009) [2023-12-28 02:08:17,306][106226] Updated weights for policy 0, policy_version 957764 (0.0009) [2023-12-28 02:08:17,341][106225] Updated weights for policy 1, policy_version 959944 (0.0009) [2023-12-28 02:08:17,354][106226] Updated weights for policy 0, policy_version 957774 (0.0005) [2023-12-28 02:08:17,403][106225] Updated weights for policy 1, policy_version 959954 (0.0008) [2023-12-28 02:08:17,417][106226] Updated weights for policy 0, policy_version 957784 (0.0005) [2023-12-28 02:08:17,466][106225] Updated weights for policy 1, policy_version 959964 (0.0008) [2023-12-28 02:08:18,013][106225] Updated weights for policy 1, policy_version 959974 (0.0007) [2023-12-28 02:08:18,075][106225] Updated weights for policy 1, policy_version 959984 (0.0008) [2023-12-28 02:08:18,142][106225] Updated weights for policy 1, policy_version 959994 (0.0009) [2023-12-28 02:08:18,159][106226] Updated weights for policy 0, policy_version 957794 (0.0006) [2023-12-28 02:08:18,220][106226] Updated weights for policy 0, policy_version 957804 (0.0007) [2023-12-28 02:08:18,283][106226] Updated weights for policy 0, policy_version 957814 (0.0006) [2023-12-28 02:08:18,343][106226] Updated weights for policy 0, policy_version 957824 (0.0009) [2023-12-28 02:08:18,812][106225] Updated weights for policy 1, policy_version 960004 (0.0009) [2023-12-28 02:08:18,869][106225] Updated weights for policy 1, policy_version 960014 (0.0011) [2023-12-28 02:08:18,920][106225] Updated weights for policy 1, policy_version 960024 (0.0010) [2023-12-28 02:08:19,023][106226] Updated weights for policy 0, policy_version 957834 (0.0008) [2023-12-28 02:08:19,083][106226] Updated weights for policy 0, policy_version 957844 (0.0008) [2023-12-28 02:08:19,138][106226] Updated weights for policy 0, policy_version 957854 (0.0007) [2023-12-28 02:08:19,699][106225] Updated weights for policy 1, policy_version 960034 (0.0010) [2023-12-28 02:08:19,770][106225] Updated weights for policy 1, policy_version 960044 (0.0007) [2023-12-28 02:08:19,841][106225] Updated weights for policy 1, policy_version 960054 (0.0009) [2023-12-28 02:08:19,863][106226] Updated weights for policy 0, policy_version 957864 (0.0008) [2023-12-28 02:08:19,904][106225] Updated weights for policy 1, policy_version 960064 (0.0006) [2023-12-28 02:08:19,939][106226] Updated weights for policy 0, policy_version 957874 (0.0009) [2023-12-28 02:08:20,014][106226] Updated weights for policy 0, policy_version 957884 (0.0008) [2023-12-28 02:08:20,537][106225] Updated weights for policy 1, policy_version 960074 (0.0010) [2023-12-28 02:08:20,617][106225] Updated weights for policy 1, policy_version 960084 (0.0010) [2023-12-28 02:08:20,683][106225] Updated weights for policy 1, policy_version 960094 (0.0007) [2023-12-28 02:08:20,741][106226] Updated weights for policy 0, policy_version 957894 (0.0008) [2023-12-28 02:08:20,805][106226] Updated weights for policy 0, policy_version 957904 (0.0008) [2023-12-28 02:08:20,864][106226] Updated weights for policy 0, policy_version 957914 (0.0008) [2023-12-28 02:08:21,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 491110400. Throughput: 0: 9927.7, 1: 9704.4. Samples: 491118924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:21,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.157')] [2023-12-28 02:08:21,399][106225] Updated weights for policy 1, policy_version 960104 (0.0009) [2023-12-28 02:08:21,449][106225] Updated weights for policy 1, policy_version 960114 (0.0009) [2023-12-28 02:08:21,509][106225] Updated weights for policy 1, policy_version 960124 (0.0009) [2023-12-28 02:08:21,627][106226] Updated weights for policy 0, policy_version 957924 (0.0008) [2023-12-28 02:08:21,690][106226] Updated weights for policy 0, policy_version 957934 (0.0009) [2023-12-28 02:08:21,771][106226] Updated weights for policy 0, policy_version 957944 (0.0008) [2023-12-28 02:08:22,287][106225] Updated weights for policy 1, policy_version 960134 (0.0009) [2023-12-28 02:08:22,353][106225] Updated weights for policy 1, policy_version 960144 (0.0009) [2023-12-28 02:08:22,422][106225] Updated weights for policy 1, policy_version 960154 (0.0009) [2023-12-28 02:08:22,536][106226] Updated weights for policy 0, policy_version 957954 (0.0009) [2023-12-28 02:08:22,602][106226] Updated weights for policy 0, policy_version 957964 (0.0008) [2023-12-28 02:08:22,670][106226] Updated weights for policy 0, policy_version 957974 (0.0008) [2023-12-28 02:08:22,735][106226] Updated weights for policy 0, policy_version 957984 (0.0008) [2023-12-28 02:08:23,166][106225] Updated weights for policy 1, policy_version 960164 (0.0010) [2023-12-28 02:08:23,224][106225] Updated weights for policy 1, policy_version 960174 (0.0008) [2023-12-28 02:08:23,279][106225] Updated weights for policy 1, policy_version 960184 (0.0008) [2023-12-28 02:08:23,430][106226] Updated weights for policy 0, policy_version 957994 (0.0008) [2023-12-28 02:08:23,478][106226] Updated weights for policy 0, policy_version 958004 (0.0008) [2023-12-28 02:08:23,538][106226] Updated weights for policy 0, policy_version 958014 (0.0009) [2023-12-28 02:08:24,046][106225] Updated weights for policy 1, policy_version 960194 (0.0009) [2023-12-28 02:08:24,108][106225] Updated weights for policy 1, policy_version 960204 (0.0008) [2023-12-28 02:08:24,164][106225] Updated weights for policy 1, policy_version 960214 (0.0007) [2023-12-28 02:08:24,177][106226] Updated weights for policy 0, policy_version 958024 (0.0008) [2023-12-28 02:08:24,221][106225] Updated weights for policy 1, policy_version 960224 (0.0007) [2023-12-28 02:08:24,234][106226] Updated weights for policy 0, policy_version 958034 (0.0005) [2023-12-28 02:08:24,293][106226] Updated weights for policy 0, policy_version 958044 (0.0008) [2023-12-28 02:08:24,942][106226] Updated weights for policy 0, policy_version 958054 (0.0008) [2023-12-28 02:08:24,979][106225] Updated weights for policy 1, policy_version 960234 (0.0007) [2023-12-28 02:08:25,001][106226] Updated weights for policy 0, policy_version 958064 (0.0007) [2023-12-28 02:08:25,027][106225] Updated weights for policy 1, policy_version 960244 (0.0006) [2023-12-28 02:08:25,058][106226] Updated weights for policy 0, policy_version 958074 (0.0006) [2023-12-28 02:08:25,072][106225] Updated weights for policy 1, policy_version 960254 (0.0006) [2023-12-28 02:08:25,795][106225] Updated weights for policy 1, policy_version 960264 (0.0007) [2023-12-28 02:08:25,812][106226] Updated weights for policy 0, policy_version 958084 (0.0008) [2023-12-28 02:08:25,856][106225] Updated weights for policy 1, policy_version 960274 (0.0007) [2023-12-28 02:08:25,862][106226] Updated weights for policy 0, policy_version 958094 (0.0006) [2023-12-28 02:08:25,916][106225] Updated weights for policy 1, policy_version 960284 (0.0010) [2023-12-28 02:08:25,916][106226] Updated weights for policy 0, policy_version 958104 (0.0009) [2023-12-28 02:08:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 491208704. Throughput: 0: 9895.0, 1: 9669.9. Samples: 491176012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:26,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-4.736')] [2023-12-28 02:08:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000960288_245874688.pth... [2023-12-28 02:08:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000958112_245334016.pth... [2023-12-28 02:08:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000959168_245587968.pth [2023-12-28 02:08:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000956960_245039104.pth [2023-12-28 02:08:26,574][106225] Updated weights for policy 1, policy_version 960294 (0.0007) [2023-12-28 02:08:26,618][106225] Updated weights for policy 1, policy_version 960304 (0.0008) [2023-12-28 02:08:26,664][106226] Updated weights for policy 0, policy_version 958114 (0.0009) [2023-12-28 02:08:26,666][106225] Updated weights for policy 1, policy_version 960314 (0.0007) [2023-12-28 02:08:26,718][106226] Updated weights for policy 0, policy_version 958124 (0.0007) [2023-12-28 02:08:26,775][106226] Updated weights for policy 0, policy_version 958134 (0.0009) [2023-12-28 02:08:26,823][106226] Updated weights for policy 0, policy_version 958144 (0.0007) [2023-12-28 02:08:27,258][106225] Updated weights for policy 1, policy_version 960324 (0.0005) [2023-12-28 02:08:27,319][106225] Updated weights for policy 1, policy_version 960334 (0.0006) [2023-12-28 02:08:27,368][106225] Updated weights for policy 1, policy_version 960344 (0.0008) [2023-12-28 02:08:27,627][106226] Updated weights for policy 0, policy_version 958154 (0.0008) [2023-12-28 02:08:27,675][106226] Updated weights for policy 0, policy_version 958164 (0.0008) [2023-12-28 02:08:27,725][106226] Updated weights for policy 0, policy_version 958174 (0.0008) [2023-12-28 02:08:28,087][106225] Updated weights for policy 1, policy_version 960354 (0.0009) [2023-12-28 02:08:28,139][106225] Updated weights for policy 1, policy_version 960364 (0.0008) [2023-12-28 02:08:28,202][106225] Updated weights for policy 1, policy_version 960374 (0.0006) [2023-12-28 02:08:28,253][106225] Updated weights for policy 1, policy_version 960384 (0.0005) [2023-12-28 02:08:28,395][106226] Updated weights for policy 0, policy_version 958184 (0.0006) [2023-12-28 02:08:28,459][106226] Updated weights for policy 0, policy_version 958194 (0.0007) [2023-12-28 02:08:28,523][106226] Updated weights for policy 0, policy_version 958204 (0.0008) [2023-12-28 02:08:28,981][106225] Updated weights for policy 1, policy_version 960394 (0.0006) [2023-12-28 02:08:29,047][106225] Updated weights for policy 1, policy_version 960404 (0.0005) [2023-12-28 02:08:29,118][106225] Updated weights for policy 1, policy_version 960414 (0.0006) [2023-12-28 02:08:29,166][106226] Updated weights for policy 0, policy_version 958214 (0.0009) [2023-12-28 02:08:29,220][106226] Updated weights for policy 0, policy_version 958224 (0.0008) [2023-12-28 02:08:29,278][106226] Updated weights for policy 0, policy_version 958234 (0.0007) [2023-12-28 02:08:29,698][106225] Updated weights for policy 1, policy_version 960424 (0.0008) [2023-12-28 02:08:29,752][106225] Updated weights for policy 1, policy_version 960434 (0.0008) [2023-12-28 02:08:29,801][106225] Updated weights for policy 1, policy_version 960444 (0.0008) [2023-12-28 02:08:30,079][106226] Updated weights for policy 0, policy_version 958244 (0.0008) [2023-12-28 02:08:30,140][106226] Updated weights for policy 0, policy_version 958254 (0.0009) [2023-12-28 02:08:30,192][106226] Updated weights for policy 0, policy_version 958264 (0.0008) [2023-12-28 02:08:30,491][106225] Updated weights for policy 1, policy_version 960454 (0.0008) [2023-12-28 02:08:30,544][106225] Updated weights for policy 1, policy_version 960464 (0.0008) [2023-12-28 02:08:30,602][106225] Updated weights for policy 1, policy_version 960474 (0.0008) [2023-12-28 02:08:30,936][106226] Updated weights for policy 0, policy_version 958274 (0.0009) [2023-12-28 02:08:30,994][106226] Updated weights for policy 0, policy_version 958284 (0.0009) [2023-12-28 02:08:31,063][106226] Updated weights for policy 0, policy_version 958294 (0.0008) [2023-12-28 02:08:31,130][106226] Updated weights for policy 0, policy_version 958304 (0.0006) [2023-12-28 02:08:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 491307008. Throughput: 0: 9901.2, 1: 9680.5. Samples: 491295108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:31,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-5.375')] [2023-12-28 02:08:31,217][106225] Updated weights for policy 1, policy_version 960484 (0.0007) [2023-12-28 02:08:31,280][106225] Updated weights for policy 1, policy_version 960494 (0.0007) [2023-12-28 02:08:31,335][106225] Updated weights for policy 1, policy_version 960504 (0.0008) [2023-12-28 02:08:31,828][106226] Updated weights for policy 0, policy_version 958314 (0.0008) [2023-12-28 02:08:31,874][106226] Updated weights for policy 0, policy_version 958324 (0.0008) [2023-12-28 02:08:31,919][106226] Updated weights for policy 0, policy_version 958334 (0.0007) [2023-12-28 02:08:32,140][106225] Updated weights for policy 1, policy_version 960514 (0.0009) [2023-12-28 02:08:32,192][106225] Updated weights for policy 1, policy_version 960524 (0.0008) [2023-12-28 02:08:32,247][106225] Updated weights for policy 1, policy_version 960534 (0.0008) [2023-12-28 02:08:32,307][106225] Updated weights for policy 1, policy_version 960544 (0.0008) [2023-12-28 02:08:32,683][106226] Updated weights for policy 0, policy_version 958344 (0.0007) [2023-12-28 02:08:32,742][106226] Updated weights for policy 0, policy_version 958354 (0.0009) [2023-12-28 02:08:32,794][106226] Updated weights for policy 0, policy_version 958364 (0.0009) [2023-12-28 02:08:33,038][106225] Updated weights for policy 1, policy_version 960554 (0.0008) [2023-12-28 02:08:33,091][106225] Updated weights for policy 1, policy_version 960564 (0.0007) [2023-12-28 02:08:33,143][106225] Updated weights for policy 1, policy_version 960574 (0.0008) [2023-12-28 02:08:33,508][106226] Updated weights for policy 0, policy_version 958374 (0.0008) [2023-12-28 02:08:33,566][106226] Updated weights for policy 0, policy_version 958384 (0.0008) [2023-12-28 02:08:33,628][106226] Updated weights for policy 0, policy_version 958394 (0.0008) [2023-12-28 02:08:33,854][106225] Updated weights for policy 1, policy_version 960584 (0.0006) [2023-12-28 02:08:33,907][106225] Updated weights for policy 1, policy_version 960594 (0.0005) [2023-12-28 02:08:33,951][106225] Updated weights for policy 1, policy_version 960604 (0.0005) [2023-12-28 02:08:34,284][106226] Updated weights for policy 0, policy_version 958404 (0.0008) [2023-12-28 02:08:34,345][106226] Updated weights for policy 0, policy_version 958414 (0.0008) [2023-12-28 02:08:34,392][106226] Updated weights for policy 0, policy_version 958424 (0.0008) [2023-12-28 02:08:34,578][106225] Updated weights for policy 1, policy_version 960614 (0.0010) [2023-12-28 02:08:34,635][106225] Updated weights for policy 1, policy_version 960624 (0.0009) [2023-12-28 02:08:34,697][106225] Updated weights for policy 1, policy_version 960634 (0.0010) [2023-12-28 02:08:35,128][106226] Updated weights for policy 0, policy_version 958434 (0.0008) [2023-12-28 02:08:35,181][106226] Updated weights for policy 0, policy_version 958444 (0.0010) [2023-12-28 02:08:35,236][106226] Updated weights for policy 0, policy_version 958454 (0.0007) [2023-12-28 02:08:35,286][106226] Updated weights for policy 0, policy_version 958464 (0.0008) [2023-12-28 02:08:35,364][106225] Updated weights for policy 1, policy_version 960644 (0.0008) [2023-12-28 02:08:35,431][106225] Updated weights for policy 1, policy_version 960654 (0.0005) [2023-12-28 02:08:35,492][106225] Updated weights for policy 1, policy_version 960664 (0.0005) [2023-12-28 02:08:36,074][106226] Updated weights for policy 0, policy_version 958474 (0.0008) [2023-12-28 02:08:36,075][106225] Updated weights for policy 1, policy_version 960674 (0.0005) [2023-12-28 02:08:36,136][106226] Updated weights for policy 0, policy_version 958484 (0.0008) [2023-12-28 02:08:36,141][106225] Updated weights for policy 1, policy_version 960684 (0.0007) [2023-12-28 02:08:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 491397120. Throughput: 0: 9811.7, 1: 9771.8. Samples: 491413796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:36,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.028')] [2023-12-28 02:08:36,195][106226] Updated weights for policy 0, policy_version 958494 (0.0006) [2023-12-28 02:08:36,200][106225] Updated weights for policy 1, policy_version 960694 (0.0008) [2023-12-28 02:08:36,260][106225] Updated weights for policy 1, policy_version 960704 (0.0009) [2023-12-28 02:08:36,930][106226] Updated weights for policy 0, policy_version 958504 (0.0007) [2023-12-28 02:08:36,992][106226] Updated weights for policy 0, policy_version 958514 (0.0007) [2023-12-28 02:08:37,036][106225] Updated weights for policy 1, policy_version 960714 (0.0010) [2023-12-28 02:08:37,056][106226] Updated weights for policy 0, policy_version 958524 (0.0009) [2023-12-28 02:08:37,091][106225] Updated weights for policy 1, policy_version 960724 (0.0009) [2023-12-28 02:08:37,150][106225] Updated weights for policy 1, policy_version 960734 (0.0009) [2023-12-28 02:08:37,755][106226] Updated weights for policy 0, policy_version 958534 (0.0009) [2023-12-28 02:08:37,809][106226] Updated weights for policy 0, policy_version 958544 (0.0007) [2023-12-28 02:08:37,827][106225] Updated weights for policy 1, policy_version 960744 (0.0010) [2023-12-28 02:08:37,857][106226] Updated weights for policy 0, policy_version 958554 (0.0006) [2023-12-28 02:08:37,882][106225] Updated weights for policy 1, policy_version 960754 (0.0010) [2023-12-28 02:08:37,942][106225] Updated weights for policy 1, policy_version 960764 (0.0010) [2023-12-28 02:08:38,595][106225] Updated weights for policy 1, policy_version 960774 (0.0010) [2023-12-28 02:08:38,659][106225] Updated weights for policy 1, policy_version 960784 (0.0010) [2023-12-28 02:08:38,661][106226] Updated weights for policy 0, policy_version 958564 (0.0005) [2023-12-28 02:08:38,720][106226] Updated weights for policy 0, policy_version 958574 (0.0008) [2023-12-28 02:08:38,725][106225] Updated weights for policy 1, policy_version 960794 (0.0010) [2023-12-28 02:08:38,781][106226] Updated weights for policy 0, policy_version 958584 (0.0009) [2023-12-28 02:08:39,344][106225] Updated weights for policy 1, policy_version 960804 (0.0010) [2023-12-28 02:08:39,413][106225] Updated weights for policy 1, policy_version 960814 (0.0009) [2023-12-28 02:08:39,472][106225] Updated weights for policy 1, policy_version 960824 (0.0007) [2023-12-28 02:08:39,623][106226] Updated weights for policy 0, policy_version 958594 (0.0007) [2023-12-28 02:08:39,684][106226] Updated weights for policy 0, policy_version 958604 (0.0006) [2023-12-28 02:08:39,747][106226] Updated weights for policy 0, policy_version 958614 (0.0008) [2023-12-28 02:08:39,811][106226] Updated weights for policy 0, policy_version 958624 (0.0008) [2023-12-28 02:08:40,189][106225] Updated weights for policy 1, policy_version 960834 (0.0006) [2023-12-28 02:08:40,250][106225] Updated weights for policy 1, policy_version 960844 (0.0007) [2023-12-28 02:08:40,309][106225] Updated weights for policy 1, policy_version 960854 (0.0005) [2023-12-28 02:08:40,368][106225] Updated weights for policy 1, policy_version 960864 (0.0005) [2023-12-28 02:08:40,596][106226] Updated weights for policy 0, policy_version 958634 (0.0008) [2023-12-28 02:08:40,651][106226] Updated weights for policy 0, policy_version 958644 (0.0006) [2023-12-28 02:08:40,720][106226] Updated weights for policy 0, policy_version 958654 (0.0005) [2023-12-28 02:08:41,063][106225] Updated weights for policy 1, policy_version 960874 (0.0008) [2023-12-28 02:08:41,125][106225] Updated weights for policy 1, policy_version 960884 (0.0009) [2023-12-28 02:08:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 491495424. Throughput: 0: 9751.8, 1: 9834.5. Samples: 491471408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:41,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.360')] [2023-12-28 02:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000958656_245473280.pth... [2023-12-28 02:08:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000957536_245186560.pth [2023-12-28 02:08:41,189][106225] Updated weights for policy 1, policy_version 960894 (0.0007) [2023-12-28 02:08:41,201][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000960896_246030336.pth... [2023-12-28 02:08:41,205][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000959712_245727232.pth [2023-12-28 02:08:41,467][106226] Updated weights for policy 0, policy_version 958664 (0.0008) [2023-12-28 02:08:41,532][106226] Updated weights for policy 0, policy_version 958674 (0.0008) [2023-12-28 02:08:41,591][106226] Updated weights for policy 0, policy_version 958684 (0.0007) [2023-12-28 02:08:41,894][106225] Updated weights for policy 1, policy_version 960904 (0.0008) [2023-12-28 02:08:41,957][106225] Updated weights for policy 1, policy_version 960914 (0.0007) [2023-12-28 02:08:42,021][106225] Updated weights for policy 1, policy_version 960924 (0.0008) [2023-12-28 02:08:42,392][106226] Updated weights for policy 0, policy_version 958694 (0.0009) [2023-12-28 02:08:42,458][106226] Updated weights for policy 0, policy_version 958704 (0.0008) [2023-12-28 02:08:42,528][106226] Updated weights for policy 0, policy_version 958714 (0.0008) [2023-12-28 02:08:42,784][106225] Updated weights for policy 1, policy_version 960934 (0.0009) [2023-12-28 02:08:42,843][106225] Updated weights for policy 1, policy_version 960944 (0.0008) [2023-12-28 02:08:42,903][106225] Updated weights for policy 1, policy_version 960954 (0.0009) [2023-12-28 02:08:43,173][106226] Updated weights for policy 0, policy_version 958724 (0.0008) [2023-12-28 02:08:43,232][106226] Updated weights for policy 0, policy_version 958734 (0.0009) [2023-12-28 02:08:43,290][106226] Updated weights for policy 0, policy_version 958744 (0.0009) [2023-12-28 02:08:43,612][106225] Updated weights for policy 1, policy_version 960964 (0.0008) [2023-12-28 02:08:43,669][106225] Updated weights for policy 1, policy_version 960974 (0.0008) [2023-12-28 02:08:43,729][106225] Updated weights for policy 1, policy_version 960984 (0.0008) [2023-12-28 02:08:44,026][106226] Updated weights for policy 0, policy_version 958754 (0.0009) [2023-12-28 02:08:44,085][106226] Updated weights for policy 0, policy_version 958764 (0.0008) [2023-12-28 02:08:44,152][106226] Updated weights for policy 0, policy_version 958774 (0.0009) [2023-12-28 02:08:44,214][106226] Updated weights for policy 0, policy_version 958784 (0.0009) [2023-12-28 02:08:44,389][106225] Updated weights for policy 1, policy_version 960994 (0.0008) [2023-12-28 02:08:44,441][106225] Updated weights for policy 1, policy_version 961004 (0.0007) [2023-12-28 02:08:44,492][106225] Updated weights for policy 1, policy_version 961014 (0.0007) [2023-12-28 02:08:44,547][106225] Updated weights for policy 1, policy_version 961024 (0.0008) [2023-12-28 02:08:44,985][106226] Updated weights for policy 0, policy_version 958794 (0.0009) [2023-12-28 02:08:45,054][106226] Updated weights for policy 0, policy_version 958804 (0.0008) [2023-12-28 02:08:45,122][106226] Updated weights for policy 0, policy_version 958814 (0.0009) [2023-12-28 02:08:45,231][106225] Updated weights for policy 1, policy_version 961034 (0.0008) [2023-12-28 02:08:45,290][106225] Updated weights for policy 1, policy_version 961044 (0.0008) [2023-12-28 02:08:45,350][106225] Updated weights for policy 1, policy_version 961054 (0.0009) [2023-12-28 02:08:45,811][106226] Updated weights for policy 0, policy_version 958824 (0.0009) [2023-12-28 02:08:45,867][106226] Updated weights for policy 0, policy_version 958834 (0.0008) [2023-12-28 02:08:45,919][106226] Updated weights for policy 0, policy_version 958844 (0.0008) [2023-12-28 02:08:46,068][106225] Updated weights for policy 1, policy_version 961064 (0.0008) [2023-12-28 02:08:46,120][106225] Updated weights for policy 1, policy_version 961074 (0.0009) [2023-12-28 02:08:46,168][106225] Updated weights for policy 1, policy_version 961084 (0.0008) [2023-12-28 02:08:46,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 491593728. Throughput: 0: 9692.9, 1: 9870.0. Samples: 491586104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:46,176][105115] Avg episode reward: [(0, '-4.788'), (1, '-5.250')] [2023-12-28 02:08:46,619][106226] Updated weights for policy 0, policy_version 958854 (0.0007) [2023-12-28 02:08:46,683][106226] Updated weights for policy 0, policy_version 958864 (0.0007) [2023-12-28 02:08:46,744][106226] Updated weights for policy 0, policy_version 958874 (0.0006) [2023-12-28 02:08:46,935][106225] Updated weights for policy 1, policy_version 961094 (0.0010) [2023-12-28 02:08:46,996][106225] Updated weights for policy 1, policy_version 961104 (0.0010) [2023-12-28 02:08:47,053][106225] Updated weights for policy 1, policy_version 961114 (0.0010) [2023-12-28 02:08:47,341][106226] Updated weights for policy 0, policy_version 958884 (0.0006) [2023-12-28 02:08:47,387][106226] Updated weights for policy 0, policy_version 958894 (0.0005) [2023-12-28 02:08:47,455][106226] Updated weights for policy 0, policy_version 958904 (0.0005) [2023-12-28 02:08:47,739][106225] Updated weights for policy 1, policy_version 961124 (0.0008) [2023-12-28 02:08:47,799][106225] Updated weights for policy 1, policy_version 961134 (0.0005) [2023-12-28 02:08:47,871][106225] Updated weights for policy 1, policy_version 961144 (0.0006) [2023-12-28 02:08:48,033][106226] Updated weights for policy 0, policy_version 958914 (0.0006) [2023-12-28 02:08:48,088][106226] Updated weights for policy 0, policy_version 958924 (0.0009) [2023-12-28 02:08:48,150][106226] Updated weights for policy 0, policy_version 958934 (0.0007) [2023-12-28 02:08:48,216][106226] Updated weights for policy 0, policy_version 958944 (0.0007) [2023-12-28 02:08:48,503][106225] Updated weights for policy 1, policy_version 961154 (0.0006) [2023-12-28 02:08:48,565][106225] Updated weights for policy 1, policy_version 961164 (0.0008) [2023-12-28 02:08:48,613][106225] Updated weights for policy 1, policy_version 961174 (0.0008) [2023-12-28 02:08:48,675][106225] Updated weights for policy 1, policy_version 961184 (0.0008) [2023-12-28 02:08:48,899][106226] Updated weights for policy 0, policy_version 958954 (0.0011) [2023-12-28 02:08:48,962][106226] Updated weights for policy 0, policy_version 958964 (0.0011) [2023-12-28 02:08:49,021][106226] Updated weights for policy 0, policy_version 958974 (0.0010) [2023-12-28 02:08:49,411][106225] Updated weights for policy 1, policy_version 961194 (0.0010) [2023-12-28 02:08:49,474][106225] Updated weights for policy 1, policy_version 961204 (0.0009) [2023-12-28 02:08:49,533][106225] Updated weights for policy 1, policy_version 961214 (0.0009) [2023-12-28 02:08:49,707][106226] Updated weights for policy 0, policy_version 958984 (0.0009) [2023-12-28 02:08:49,765][106226] Updated weights for policy 0, policy_version 958994 (0.0007) [2023-12-28 02:08:49,834][106226] Updated weights for policy 0, policy_version 959004 (0.0009) [2023-12-28 02:08:50,274][106225] Updated weights for policy 1, policy_version 961224 (0.0008) [2023-12-28 02:08:50,337][106225] Updated weights for policy 1, policy_version 961234 (0.0008) [2023-12-28 02:08:50,399][106225] Updated weights for policy 1, policy_version 961244 (0.0008) [2023-12-28 02:08:50,580][106226] Updated weights for policy 0, policy_version 959014 (0.0008) [2023-12-28 02:08:50,638][106226] Updated weights for policy 0, policy_version 959024 (0.0008) [2023-12-28 02:08:50,700][106226] Updated weights for policy 0, policy_version 959034 (0.0008) [2023-12-28 02:08:51,091][106225] Updated weights for policy 1, policy_version 961254 (0.0008) [2023-12-28 02:08:51,152][106225] Updated weights for policy 1, policy_version 961264 (0.0009) [2023-12-28 02:08:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 491692032. Throughput: 0: 9691.9, 1: 9913.8. Samples: 491705092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:51,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-4.994')] [2023-12-28 02:08:51,213][106225] Updated weights for policy 1, policy_version 961274 (0.0009) [2023-12-28 02:08:51,475][106226] Updated weights for policy 0, policy_version 959044 (0.0008) [2023-12-28 02:08:51,529][106226] Updated weights for policy 0, policy_version 959054 (0.0008) [2023-12-28 02:08:51,587][106226] Updated weights for policy 0, policy_version 959064 (0.0006) [2023-12-28 02:08:51,982][106225] Updated weights for policy 1, policy_version 961284 (0.0009) [2023-12-28 02:08:52,032][106225] Updated weights for policy 1, policy_version 961294 (0.0010) [2023-12-28 02:08:52,089][106225] Updated weights for policy 1, policy_version 961304 (0.0010) [2023-12-28 02:08:52,318][106226] Updated weights for policy 0, policy_version 959074 (0.0008) [2023-12-28 02:08:52,381][106226] Updated weights for policy 0, policy_version 959084 (0.0007) [2023-12-28 02:08:52,435][106226] Updated weights for policy 0, policy_version 959094 (0.0008) [2023-12-28 02:08:52,492][106226] Updated weights for policy 0, policy_version 959104 (0.0008) [2023-12-28 02:08:52,846][106225] Updated weights for policy 1, policy_version 961314 (0.0010) [2023-12-28 02:08:52,905][106225] Updated weights for policy 1, policy_version 961324 (0.0010) [2023-12-28 02:08:52,968][106225] Updated weights for policy 1, policy_version 961334 (0.0008) [2023-12-28 02:08:53,029][106225] Updated weights for policy 1, policy_version 961344 (0.0009) [2023-12-28 02:08:53,260][106226] Updated weights for policy 0, policy_version 959114 (0.0009) [2023-12-28 02:08:53,313][106226] Updated weights for policy 0, policy_version 959124 (0.0009) [2023-12-28 02:08:53,362][106226] Updated weights for policy 0, policy_version 959134 (0.0009) [2023-12-28 02:08:53,591][106225] Updated weights for policy 1, policy_version 961354 (0.0005) [2023-12-28 02:08:53,648][106225] Updated weights for policy 1, policy_version 961364 (0.0005) [2023-12-28 02:08:53,703][106225] Updated weights for policy 1, policy_version 961374 (0.0005) [2023-12-28 02:08:54,201][106226] Updated weights for policy 0, policy_version 959144 (0.0008) [2023-12-28 02:08:54,260][106226] Updated weights for policy 0, policy_version 959154 (0.0009) [2023-12-28 02:08:54,307][106225] Updated weights for policy 1, policy_version 961384 (0.0010) [2023-12-28 02:08:54,321][106226] Updated weights for policy 0, policy_version 959164 (0.0005) [2023-12-28 02:08:54,367][106225] Updated weights for policy 1, policy_version 961394 (0.0010) [2023-12-28 02:08:54,432][106225] Updated weights for policy 1, policy_version 961404 (0.0007) [2023-12-28 02:08:55,039][106226] Updated weights for policy 0, policy_version 959174 (0.0007) [2023-12-28 02:08:55,101][106226] Updated weights for policy 0, policy_version 959184 (0.0007) [2023-12-28 02:08:55,131][106225] Updated weights for policy 1, policy_version 961414 (0.0010) [2023-12-28 02:08:55,153][106226] Updated weights for policy 0, policy_version 959194 (0.0006) [2023-12-28 02:08:55,186][106225] Updated weights for policy 1, policy_version 961424 (0.0010) [2023-12-28 02:08:55,243][106225] Updated weights for policy 1, policy_version 961434 (0.0010) [2023-12-28 02:08:55,887][106225] Updated weights for policy 1, policy_version 961444 (0.0008) [2023-12-28 02:08:55,928][106226] Updated weights for policy 0, policy_version 959204 (0.0006) [2023-12-28 02:08:55,945][106225] Updated weights for policy 1, policy_version 961454 (0.0006) [2023-12-28 02:08:55,986][106226] Updated weights for policy 0, policy_version 959214 (0.0008) [2023-12-28 02:08:56,005][106225] Updated weights for policy 1, policy_version 961464 (0.0008) [2023-12-28 02:08:56,041][106226] Updated weights for policy 0, policy_version 959224 (0.0007) [2023-12-28 02:08:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 491798528. Throughput: 0: 9620.9, 1: 9930.2. Samples: 491763232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:08:56,176][105115] Avg episode reward: [(0, '-4.865'), (1, '-4.938')] [2023-12-28 02:08:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000959232_245620736.pth... [2023-12-28 02:08:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000961472_246177792.pth... [2023-12-28 02:08:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000958112_245334016.pth [2023-12-28 02:08:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000960288_245874688.pth [2023-12-28 02:08:56,603][106225] Updated weights for policy 1, policy_version 961474 (0.0007) [2023-12-28 02:08:56,660][106225] Updated weights for policy 1, policy_version 961484 (0.0005) [2023-12-28 02:08:56,728][106225] Updated weights for policy 1, policy_version 961494 (0.0005) [2023-12-28 02:08:56,774][106226] Updated weights for policy 0, policy_version 959234 (0.0009) [2023-12-28 02:08:56,788][106225] Updated weights for policy 1, policy_version 961504 (0.0005) [2023-12-28 02:08:56,830][106226] Updated weights for policy 0, policy_version 959244 (0.0010) [2023-12-28 02:08:56,883][106226] Updated weights for policy 0, policy_version 959254 (0.0010) [2023-12-28 02:08:56,945][106226] Updated weights for policy 0, policy_version 959264 (0.0010) [2023-12-28 02:08:57,340][106225] Updated weights for policy 1, policy_version 961514 (0.0007) [2023-12-28 02:08:57,400][106225] Updated weights for policy 1, policy_version 961524 (0.0008) [2023-12-28 02:08:57,451][106225] Updated weights for policy 1, policy_version 961534 (0.0007) [2023-12-28 02:08:57,618][106226] Updated weights for policy 0, policy_version 959274 (0.0010) [2023-12-28 02:08:57,671][106226] Updated weights for policy 0, policy_version 959284 (0.0010) [2023-12-28 02:08:57,717][106226] Updated weights for policy 0, policy_version 959294 (0.0010) [2023-12-28 02:08:58,131][106225] Updated weights for policy 1, policy_version 961544 (0.0008) [2023-12-28 02:08:58,191][106225] Updated weights for policy 1, policy_version 961554 (0.0008) [2023-12-28 02:08:58,257][106225] Updated weights for policy 1, policy_version 961564 (0.0008) [2023-12-28 02:08:58,452][106226] Updated weights for policy 0, policy_version 959304 (0.0008) [2023-12-28 02:08:58,518][106226] Updated weights for policy 0, policy_version 959314 (0.0008) [2023-12-28 02:08:58,585][106226] Updated weights for policy 0, policy_version 959324 (0.0009) [2023-12-28 02:08:59,084][106225] Updated weights for policy 1, policy_version 961574 (0.0007) [2023-12-28 02:08:59,146][106225] Updated weights for policy 1, policy_version 961584 (0.0008) [2023-12-28 02:08:59,205][106225] Updated weights for policy 1, policy_version 961594 (0.0008) [2023-12-28 02:08:59,423][106226] Updated weights for policy 0, policy_version 959334 (0.0009) [2023-12-28 02:08:59,478][106226] Updated weights for policy 0, policy_version 959344 (0.0006) [2023-12-28 02:08:59,536][106226] Updated weights for policy 0, policy_version 959354 (0.0007) [2023-12-28 02:08:59,958][106225] Updated weights for policy 1, policy_version 961604 (0.0008) [2023-12-28 02:09:00,023][106225] Updated weights for policy 1, policy_version 961614 (0.0007) [2023-12-28 02:09:00,084][106225] Updated weights for policy 1, policy_version 961624 (0.0006) [2023-12-28 02:09:00,219][106226] Updated weights for policy 0, policy_version 959364 (0.0008) [2023-12-28 02:09:00,271][106226] Updated weights for policy 0, policy_version 959374 (0.0008) [2023-12-28 02:09:00,325][106226] Updated weights for policy 0, policy_version 959384 (0.0008) [2023-12-28 02:09:00,720][106225] Updated weights for policy 1, policy_version 961634 (0.0006) [2023-12-28 02:09:00,777][106225] Updated weights for policy 1, policy_version 961644 (0.0005) [2023-12-28 02:09:00,839][106225] Updated weights for policy 1, policy_version 961654 (0.0005) [2023-12-28 02:09:00,905][106225] Updated weights for policy 1, policy_version 961664 (0.0005) [2023-12-28 02:09:01,083][106226] Updated weights for policy 0, policy_version 959394 (0.0009) [2023-12-28 02:09:01,137][106226] Updated weights for policy 0, policy_version 959404 (0.0008) [2023-12-28 02:09:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 491888640. Throughput: 0: 9566.0, 1: 10013.9. Samples: 491881680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:01,175][105115] Avg episode reward: [(0, '-4.850'), (1, '-5.013')] [2023-12-28 02:09:01,201][106226] Updated weights for policy 0, policy_version 959414 (0.0008) [2023-12-28 02:09:01,268][106226] Updated weights for policy 0, policy_version 959424 (0.0008) [2023-12-28 02:09:01,586][106225] Updated weights for policy 1, policy_version 961674 (0.0006) [2023-12-28 02:09:01,660][106225] Updated weights for policy 1, policy_version 961684 (0.0007) [2023-12-28 02:09:01,723][106225] Updated weights for policy 1, policy_version 961694 (0.0008) [2023-12-28 02:09:02,044][106226] Updated weights for policy 0, policy_version 959434 (0.0008) [2023-12-28 02:09:02,096][106226] Updated weights for policy 0, policy_version 959444 (0.0008) [2023-12-28 02:09:02,161][106226] Updated weights for policy 0, policy_version 959454 (0.0009) [2023-12-28 02:09:02,387][106225] Updated weights for policy 1, policy_version 961704 (0.0008) [2023-12-28 02:09:02,444][106225] Updated weights for policy 1, policy_version 961714 (0.0007) [2023-12-28 02:09:02,499][106225] Updated weights for policy 1, policy_version 961724 (0.0006) [2023-12-28 02:09:02,951][106226] Updated weights for policy 0, policy_version 959464 (0.0008) [2023-12-28 02:09:03,005][106226] Updated weights for policy 0, policy_version 959474 (0.0008) [2023-12-28 02:09:03,059][106226] Updated weights for policy 0, policy_version 959484 (0.0008) [2023-12-28 02:09:03,118][106225] Updated weights for policy 1, policy_version 961734 (0.0007) [2023-12-28 02:09:03,165][106225] Updated weights for policy 1, policy_version 961744 (0.0008) [2023-12-28 02:09:03,220][106225] Updated weights for policy 1, policy_version 961754 (0.0008) [2023-12-28 02:09:03,827][106225] Updated weights for policy 1, policy_version 961764 (0.0007) [2023-12-28 02:09:03,830][106226] Updated weights for policy 0, policy_version 959494 (0.0008) [2023-12-28 02:09:03,895][106225] Updated weights for policy 1, policy_version 961774 (0.0008) [2023-12-28 02:09:03,899][106226] Updated weights for policy 0, policy_version 959504 (0.0007) [2023-12-28 02:09:03,951][106225] Updated weights for policy 1, policy_version 961784 (0.0007) [2023-12-28 02:09:03,965][106226] Updated weights for policy 0, policy_version 959514 (0.0008) [2023-12-28 02:09:04,604][106226] Updated weights for policy 0, policy_version 959524 (0.0006) [2023-12-28 02:09:04,651][106225] Updated weights for policy 1, policy_version 961794 (0.0007) [2023-12-28 02:09:04,658][106226] Updated weights for policy 0, policy_version 959534 (0.0008) [2023-12-28 02:09:04,708][106225] Updated weights for policy 1, policy_version 961804 (0.0006) [2023-12-28 02:09:04,709][106226] Updated weights for policy 0, policy_version 959544 (0.0007) [2023-12-28 02:09:04,767][106225] Updated weights for policy 1, policy_version 961814 (0.0007) [2023-12-28 02:09:04,822][106225] Updated weights for policy 1, policy_version 961824 (0.0009) [2023-12-28 02:09:05,292][106226] Updated weights for policy 0, policy_version 959554 (0.0005) [2023-12-28 02:09:05,349][106226] Updated weights for policy 0, policy_version 959564 (0.0006) [2023-12-28 02:09:05,402][106226] Updated weights for policy 0, policy_version 959574 (0.0005) [2023-12-28 02:09:05,448][106226] Updated weights for policy 0, policy_version 959584 (0.0006) [2023-12-28 02:09:05,646][106225] Updated weights for policy 1, policy_version 961834 (0.0008) [2023-12-28 02:09:05,695][106225] Updated weights for policy 1, policy_version 961844 (0.0009) [2023-12-28 02:09:05,758][106225] Updated weights for policy 1, policy_version 961854 (0.0008) [2023-12-28 02:09:06,007][106226] Updated weights for policy 0, policy_version 959594 (0.0007) [2023-12-28 02:09:06,067][106226] Updated weights for policy 0, policy_version 959604 (0.0008) [2023-12-28 02:09:06,145][106226] Updated weights for policy 0, policy_version 959614 (0.0009) [2023-12-28 02:09:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 491995136. Throughput: 0: 9617.5, 1: 9998.4. Samples: 492001632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:06,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-5.156')] [2023-12-28 02:09:06,530][106225] Updated weights for policy 1, policy_version 961864 (0.0008) [2023-12-28 02:09:06,589][106225] Updated weights for policy 1, policy_version 961874 (0.0008) [2023-12-28 02:09:06,652][106225] Updated weights for policy 1, policy_version 961884 (0.0008) [2023-12-28 02:09:06,879][106226] Updated weights for policy 0, policy_version 959624 (0.0009) [2023-12-28 02:09:06,942][106226] Updated weights for policy 0, policy_version 959634 (0.0008) [2023-12-28 02:09:07,000][106226] Updated weights for policy 0, policy_version 959644 (0.0009) [2023-12-28 02:09:07,356][106225] Updated weights for policy 1, policy_version 961894 (0.0007) [2023-12-28 02:09:07,425][106225] Updated weights for policy 1, policy_version 961904 (0.0009) [2023-12-28 02:09:07,488][106225] Updated weights for policy 1, policy_version 961914 (0.0008) [2023-12-28 02:09:07,678][106226] Updated weights for policy 0, policy_version 959654 (0.0007) [2023-12-28 02:09:07,741][106226] Updated weights for policy 0, policy_version 959664 (0.0008) [2023-12-28 02:09:07,802][106226] Updated weights for policy 0, policy_version 959674 (0.0009) [2023-12-28 02:09:08,198][106225] Updated weights for policy 1, policy_version 961924 (0.0008) [2023-12-28 02:09:08,245][106225] Updated weights for policy 1, policy_version 961934 (0.0007) [2023-12-28 02:09:08,294][106225] Updated weights for policy 1, policy_version 961944 (0.0008) [2023-12-28 02:09:08,551][106226] Updated weights for policy 0, policy_version 959684 (0.0008) [2023-12-28 02:09:08,611][106226] Updated weights for policy 0, policy_version 959694 (0.0010) [2023-12-28 02:09:08,662][106226] Updated weights for policy 0, policy_version 959704 (0.0008) [2023-12-28 02:09:08,971][106225] Updated weights for policy 1, policy_version 961954 (0.0008) [2023-12-28 02:09:09,021][106225] Updated weights for policy 1, policy_version 961964 (0.0008) [2023-12-28 02:09:09,071][106225] Updated weights for policy 1, policy_version 961974 (0.0009) [2023-12-28 02:09:09,117][106225] Updated weights for policy 1, policy_version 961984 (0.0008) [2023-12-28 02:09:09,436][106226] Updated weights for policy 0, policy_version 959714 (0.0009) [2023-12-28 02:09:09,503][106226] Updated weights for policy 0, policy_version 959724 (0.0009) [2023-12-28 02:09:09,565][106226] Updated weights for policy 0, policy_version 959734 (0.0010) [2023-12-28 02:09:09,631][106226] Updated weights for policy 0, policy_version 959744 (0.0010) [2023-12-28 02:09:09,866][106225] Updated weights for policy 1, policy_version 961994 (0.0008) [2023-12-28 02:09:09,937][106225] Updated weights for policy 1, policy_version 962004 (0.0009) [2023-12-28 02:09:10,001][106225] Updated weights for policy 1, policy_version 962014 (0.0009) [2023-12-28 02:09:10,437][106226] Updated weights for policy 0, policy_version 959754 (0.0011) [2023-12-28 02:09:10,491][106226] Updated weights for policy 0, policy_version 959764 (0.0011) [2023-12-28 02:09:10,541][106226] Updated weights for policy 0, policy_version 959774 (0.0010) [2023-12-28 02:09:10,791][106225] Updated weights for policy 1, policy_version 962024 (0.0009) [2023-12-28 02:09:10,854][106225] Updated weights for policy 1, policy_version 962034 (0.0009) [2023-12-28 02:09:10,921][106225] Updated weights for policy 1, policy_version 962044 (0.0009) [2023-12-28 02:09:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 492085248. Throughput: 0: 9590.9, 1: 10033.2. Samples: 492059100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:11,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-5.083')] [2023-12-28 02:09:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000962048_246325248.pth... [2023-12-28 02:09:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000960896_246030336.pth [2023-12-28 02:09:11,201][106226] Updated weights for policy 0, policy_version 959784 (0.0009) [2023-12-28 02:09:11,266][106226] Updated weights for policy 0, policy_version 959794 (0.0007) [2023-12-28 02:09:11,333][106226] Updated weights for policy 0, policy_version 959804 (0.0008) [2023-12-28 02:09:11,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000959808_245768192.pth... [2023-12-28 02:09:11,361][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000958656_245473280.pth [2023-12-28 02:09:11,723][106225] Updated weights for policy 1, policy_version 962054 (0.0009) [2023-12-28 02:09:11,783][106225] Updated weights for policy 1, policy_version 962064 (0.0008) [2023-12-28 02:09:11,839][106225] Updated weights for policy 1, policy_version 962074 (0.0009) [2023-12-28 02:09:12,070][106226] Updated weights for policy 0, policy_version 959814 (0.0008) [2023-12-28 02:09:12,123][106226] Updated weights for policy 0, policy_version 959824 (0.0009) [2023-12-28 02:09:12,175][106226] Updated weights for policy 0, policy_version 959834 (0.0009) [2023-12-28 02:09:12,605][106225] Updated weights for policy 1, policy_version 962084 (0.0008) [2023-12-28 02:09:12,662][106225] Updated weights for policy 1, policy_version 962094 (0.0009) [2023-12-28 02:09:12,726][106225] Updated weights for policy 1, policy_version 962104 (0.0009) [2023-12-28 02:09:12,914][106226] Updated weights for policy 0, policy_version 959844 (0.0009) [2023-12-28 02:09:12,962][106226] Updated weights for policy 0, policy_version 959854 (0.0009) [2023-12-28 02:09:13,016][106226] Updated weights for policy 0, policy_version 959864 (0.0008) [2023-12-28 02:09:13,440][106225] Updated weights for policy 1, policy_version 962114 (0.0009) [2023-12-28 02:09:13,491][106225] Updated weights for policy 1, policy_version 962124 (0.0008) [2023-12-28 02:09:13,544][106225] Updated weights for policy 1, policy_version 962134 (0.0007) [2023-12-28 02:09:13,593][106225] Updated weights for policy 1, policy_version 962144 (0.0005) [2023-12-28 02:09:13,731][106226] Updated weights for policy 0, policy_version 959874 (0.0008) [2023-12-28 02:09:13,786][106226] Updated weights for policy 0, policy_version 959884 (0.0008) [2023-12-28 02:09:13,837][106226] Updated weights for policy 0, policy_version 959894 (0.0008) [2023-12-28 02:09:13,889][106226] Updated weights for policy 0, policy_version 959904 (0.0008) [2023-12-28 02:09:14,284][106225] Updated weights for policy 1, policy_version 962154 (0.0008) [2023-12-28 02:09:14,343][106225] Updated weights for policy 1, policy_version 962164 (0.0008) [2023-12-28 02:09:14,404][106225] Updated weights for policy 1, policy_version 962174 (0.0006) [2023-12-28 02:09:14,630][106226] Updated weights for policy 0, policy_version 959914 (0.0008) [2023-12-28 02:09:14,686][106226] Updated weights for policy 0, policy_version 959924 (0.0008) [2023-12-28 02:09:14,748][106226] Updated weights for policy 0, policy_version 959934 (0.0008) [2023-12-28 02:09:15,055][106225] Updated weights for policy 1, policy_version 962184 (0.0005) [2023-12-28 02:09:15,112][106225] Updated weights for policy 1, policy_version 962194 (0.0006) [2023-12-28 02:09:15,167][106225] Updated weights for policy 1, policy_version 962204 (0.0008) [2023-12-28 02:09:15,539][106226] Updated weights for policy 0, policy_version 959944 (0.0008) [2023-12-28 02:09:15,605][106226] Updated weights for policy 0, policy_version 959954 (0.0008) [2023-12-28 02:09:15,659][106226] Updated weights for policy 0, policy_version 959964 (0.0009) [2023-12-28 02:09:15,764][106225] Updated weights for policy 1, policy_version 962214 (0.0006) [2023-12-28 02:09:15,824][106225] Updated weights for policy 1, policy_version 962224 (0.0005) [2023-12-28 02:09:15,880][106225] Updated weights for policy 1, policy_version 962234 (0.0005) [2023-12-28 02:09:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 492183552. Throughput: 0: 9559.0, 1: 9927.3. Samples: 492171992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:16,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.968')] [2023-12-28 02:09:16,422][106226] Updated weights for policy 0, policy_version 959974 (0.0010) [2023-12-28 02:09:16,485][106226] Updated weights for policy 0, policy_version 959984 (0.0011) [2023-12-28 02:09:16,544][106226] Updated weights for policy 0, policy_version 959994 (0.0011) [2023-12-28 02:09:16,558][106225] Updated weights for policy 1, policy_version 962244 (0.0005) [2023-12-28 02:09:16,618][106225] Updated weights for policy 1, policy_version 962254 (0.0007) [2023-12-28 02:09:16,684][106225] Updated weights for policy 1, policy_version 962264 (0.0008) [2023-12-28 02:09:17,277][106226] Updated weights for policy 0, policy_version 960004 (0.0011) [2023-12-28 02:09:17,328][106226] Updated weights for policy 0, policy_version 960014 (0.0010) [2023-12-28 02:09:17,381][106226] Updated weights for policy 0, policy_version 960024 (0.0010) [2023-12-28 02:09:17,402][106225] Updated weights for policy 1, policy_version 962274 (0.0008) [2023-12-28 02:09:17,447][106225] Updated weights for policy 1, policy_version 962284 (0.0008) [2023-12-28 02:09:17,498][106225] Updated weights for policy 1, policy_version 962294 (0.0005) [2023-12-28 02:09:17,555][106225] Updated weights for policy 1, policy_version 962304 (0.0007) [2023-12-28 02:09:18,025][106226] Updated weights for policy 0, policy_version 960034 (0.0007) [2023-12-28 02:09:18,077][106226] Updated weights for policy 0, policy_version 960044 (0.0005) [2023-12-28 02:09:18,136][106226] Updated weights for policy 0, policy_version 960054 (0.0006) [2023-12-28 02:09:18,187][106226] Updated weights for policy 0, policy_version 960064 (0.0008) [2023-12-28 02:09:18,196][106225] Updated weights for policy 1, policy_version 962314 (0.0011) [2023-12-28 02:09:18,259][106225] Updated weights for policy 1, policy_version 962324 (0.0010) [2023-12-28 02:09:18,337][106225] Updated weights for policy 1, policy_version 962334 (0.0009) [2023-12-28 02:09:18,897][106226] Updated weights for policy 0, policy_version 960074 (0.0006) [2023-12-28 02:09:18,963][106226] Updated weights for policy 0, policy_version 960084 (0.0005) [2023-12-28 02:09:19,024][106226] Updated weights for policy 0, policy_version 960094 (0.0006) [2023-12-28 02:09:19,070][106225] Updated weights for policy 1, policy_version 962344 (0.0008) [2023-12-28 02:09:19,126][106225] Updated weights for policy 1, policy_version 962354 (0.0008) [2023-12-28 02:09:19,187][106225] Updated weights for policy 1, policy_version 962364 (0.0007) [2023-12-28 02:09:19,671][106226] Updated weights for policy 0, policy_version 960104 (0.0008) [2023-12-28 02:09:19,739][106226] Updated weights for policy 0, policy_version 960114 (0.0006) [2023-12-28 02:09:19,805][106226] Updated weights for policy 0, policy_version 960124 (0.0007) [2023-12-28 02:09:19,920][106225] Updated weights for policy 1, policy_version 962374 (0.0010) [2023-12-28 02:09:19,985][106225] Updated weights for policy 1, policy_version 962384 (0.0011) [2023-12-28 02:09:20,047][106225] Updated weights for policy 1, policy_version 962394 (0.0010) [2023-12-28 02:09:20,527][106226] Updated weights for policy 0, policy_version 960134 (0.0008) [2023-12-28 02:09:20,601][106226] Updated weights for policy 0, policy_version 960144 (0.0009) [2023-12-28 02:09:20,670][106226] Updated weights for policy 0, policy_version 960154 (0.0009) [2023-12-28 02:09:20,755][106225] Updated weights for policy 1, policy_version 962404 (0.0009) [2023-12-28 02:09:20,824][106225] Updated weights for policy 1, policy_version 962414 (0.0011) [2023-12-28 02:09:20,890][106225] Updated weights for policy 1, policy_version 962424 (0.0010) [2023-12-28 02:09:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 492281856. Throughput: 0: 9585.7, 1: 9901.9. Samples: 492290740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:21,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.919')] [2023-12-28 02:09:21,289][106226] Updated weights for policy 0, policy_version 960164 (0.0009) [2023-12-28 02:09:21,355][106226] Updated weights for policy 0, policy_version 960174 (0.0008) [2023-12-28 02:09:21,423][106226] Updated weights for policy 0, policy_version 960184 (0.0006) [2023-12-28 02:09:21,725][106225] Updated weights for policy 1, policy_version 962434 (0.0008) [2023-12-28 02:09:21,787][106225] Updated weights for policy 1, policy_version 962444 (0.0008) [2023-12-28 02:09:21,853][106225] Updated weights for policy 1, policy_version 962454 (0.0009) [2023-12-28 02:09:21,915][106225] Updated weights for policy 1, policy_version 962464 (0.0010) [2023-12-28 02:09:22,127][106226] Updated weights for policy 0, policy_version 960194 (0.0005) [2023-12-28 02:09:22,191][106226] Updated weights for policy 0, policy_version 960204 (0.0009) [2023-12-28 02:09:22,248][106226] Updated weights for policy 0, policy_version 960214 (0.0011) [2023-12-28 02:09:22,314][106226] Updated weights for policy 0, policy_version 960224 (0.0011) [2023-12-28 02:09:22,643][106225] Updated weights for policy 1, policy_version 962474 (0.0009) [2023-12-28 02:09:22,702][106225] Updated weights for policy 1, policy_version 962484 (0.0008) [2023-12-28 02:09:22,767][106225] Updated weights for policy 1, policy_version 962494 (0.0009) [2023-12-28 02:09:23,078][106226] Updated weights for policy 0, policy_version 960234 (0.0008) [2023-12-28 02:09:23,134][106226] Updated weights for policy 0, policy_version 960244 (0.0006) [2023-12-28 02:09:23,193][106226] Updated weights for policy 0, policy_version 960254 (0.0006) [2023-12-28 02:09:23,486][106225] Updated weights for policy 1, policy_version 962504 (0.0006) [2023-12-28 02:09:23,541][106225] Updated weights for policy 1, policy_version 962514 (0.0006) [2023-12-28 02:09:23,595][106225] Updated weights for policy 1, policy_version 962524 (0.0008) [2023-12-28 02:09:23,825][106226] Updated weights for policy 0, policy_version 960264 (0.0006) [2023-12-28 02:09:23,882][106226] Updated weights for policy 0, policy_version 960274 (0.0008) [2023-12-28 02:09:23,943][106226] Updated weights for policy 0, policy_version 960284 (0.0007) [2023-12-28 02:09:24,258][106225] Updated weights for policy 1, policy_version 962534 (0.0008) [2023-12-28 02:09:24,305][106225] Updated weights for policy 1, policy_version 962544 (0.0008) [2023-12-28 02:09:24,360][106225] Updated weights for policy 1, policy_version 962554 (0.0008) [2023-12-28 02:09:24,538][106226] Updated weights for policy 0, policy_version 960294 (0.0007) [2023-12-28 02:09:24,595][106226] Updated weights for policy 0, policy_version 960304 (0.0006) [2023-12-28 02:09:24,653][106226] Updated weights for policy 0, policy_version 960314 (0.0007) [2023-12-28 02:09:25,182][106225] Updated weights for policy 1, policy_version 962564 (0.0010) [2023-12-28 02:09:25,234][106225] Updated weights for policy 1, policy_version 962574 (0.0009) [2023-12-28 02:09:25,246][106226] Updated weights for policy 0, policy_version 960324 (0.0007) [2023-12-28 02:09:25,292][106225] Updated weights for policy 1, policy_version 962584 (0.0007) [2023-12-28 02:09:25,310][106226] Updated weights for policy 0, policy_version 960334 (0.0006) [2023-12-28 02:09:25,371][106226] Updated weights for policy 0, policy_version 960344 (0.0011) [2023-12-28 02:09:25,949][106226] Updated weights for policy 0, policy_version 960354 (0.0011) [2023-12-28 02:09:26,006][106226] Updated weights for policy 0, policy_version 960364 (0.0011) [2023-12-28 02:09:26,057][106226] Updated weights for policy 0, policy_version 960374 (0.0010) [2023-12-28 02:09:26,075][106225] Updated weights for policy 1, policy_version 962594 (0.0007) [2023-12-28 02:09:26,105][106226] Updated weights for policy 0, policy_version 960384 (0.0010) [2023-12-28 02:09:26,131][106225] Updated weights for policy 1, policy_version 962604 (0.0007) [2023-12-28 02:09:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 492380160. Throughput: 0: 9634.7, 1: 9857.9. Samples: 492348572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:26,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.134')] [2023-12-28 02:09:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000960384_245915648.pth... [2023-12-28 02:09:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000959232_245620736.pth [2023-12-28 02:09:26,189][106225] Updated weights for policy 1, policy_version 962614 (0.0008) [2023-12-28 02:09:26,244][106225] Updated weights for policy 1, policy_version 962624 (0.0008) [2023-12-28 02:09:26,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000962624_246472704.pth... [2023-12-28 02:09:26,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000961472_246177792.pth [2023-12-28 02:09:26,833][106226] Updated weights for policy 0, policy_version 960394 (0.0010) [2023-12-28 02:09:26,897][106226] Updated weights for policy 0, policy_version 960404 (0.0006) [2023-12-28 02:09:26,966][106226] Updated weights for policy 0, policy_version 960414 (0.0007) [2023-12-28 02:09:27,010][106225] Updated weights for policy 1, policy_version 962634 (0.0007) [2023-12-28 02:09:27,077][106225] Updated weights for policy 1, policy_version 962644 (0.0008) [2023-12-28 02:09:27,137][106225] Updated weights for policy 1, policy_version 962654 (0.0007) [2023-12-28 02:09:27,636][106226] Updated weights for policy 0, policy_version 960424 (0.0011) [2023-12-28 02:09:27,664][106225] Updated weights for policy 1, policy_version 962664 (0.0006) [2023-12-28 02:09:27,686][106226] Updated weights for policy 0, policy_version 960434 (0.0010) [2023-12-28 02:09:27,718][106225] Updated weights for policy 1, policy_version 962674 (0.0005) [2023-12-28 02:09:27,739][106226] Updated weights for policy 0, policy_version 960444 (0.0010) [2023-12-28 02:09:27,759][106225] Updated weights for policy 1, policy_version 962684 (0.0006) [2023-12-28 02:09:28,426][106225] Updated weights for policy 1, policy_version 962694 (0.0007) [2023-12-28 02:09:28,482][106226] Updated weights for policy 0, policy_version 960454 (0.0007) [2023-12-28 02:09:28,483][106225] Updated weights for policy 1, policy_version 962704 (0.0007) [2023-12-28 02:09:28,542][106226] Updated weights for policy 0, policy_version 960464 (0.0009) [2023-12-28 02:09:28,552][106225] Updated weights for policy 1, policy_version 962714 (0.0006) [2023-12-28 02:09:28,593][106226] Updated weights for policy 0, policy_version 960474 (0.0010) [2023-12-28 02:09:29,174][106225] Updated weights for policy 1, policy_version 962724 (0.0008) [2023-12-28 02:09:29,235][106225] Updated weights for policy 1, policy_version 962734 (0.0009) [2023-12-28 02:09:29,262][106226] Updated weights for policy 0, policy_version 960484 (0.0009) [2023-12-28 02:09:29,301][106225] Updated weights for policy 1, policy_version 962744 (0.0007) [2023-12-28 02:09:29,324][106226] Updated weights for policy 0, policy_version 960494 (0.0006) [2023-12-28 02:09:29,393][106226] Updated weights for policy 0, policy_version 960504 (0.0009) [2023-12-28 02:09:30,000][106225] Updated weights for policy 1, policy_version 962754 (0.0008) [2023-12-28 02:09:30,057][106225] Updated weights for policy 1, policy_version 962764 (0.0009) [2023-12-28 02:09:30,112][106226] Updated weights for policy 0, policy_version 960514 (0.0008) [2023-12-28 02:09:30,114][106225] Updated weights for policy 1, policy_version 962774 (0.0008) [2023-12-28 02:09:30,174][106225] Updated weights for policy 1, policy_version 962784 (0.0007) [2023-12-28 02:09:30,179][106226] Updated weights for policy 0, policy_version 960524 (0.0007) [2023-12-28 02:09:30,244][106226] Updated weights for policy 0, policy_version 960534 (0.0010) [2023-12-28 02:09:30,314][106226] Updated weights for policy 0, policy_version 960544 (0.0008) [2023-12-28 02:09:30,868][106226] Updated weights for policy 0, policy_version 960554 (0.0009) [2023-12-28 02:09:30,920][106226] Updated weights for policy 0, policy_version 960564 (0.0007) [2023-12-28 02:09:30,926][106225] Updated weights for policy 1, policy_version 962794 (0.0006) [2023-12-28 02:09:30,974][106226] Updated weights for policy 0, policy_version 960574 (0.0007) [2023-12-28 02:09:30,983][106225] Updated weights for policy 1, policy_version 962804 (0.0006) [2023-12-28 02:09:31,039][106225] Updated weights for policy 1, policy_version 962814 (0.0008) [2023-12-28 02:09:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 492486656. Throughput: 0: 9787.3, 1: 9863.9. Samples: 492470408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:31,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.971')] [2023-12-28 02:09:31,738][106226] Updated weights for policy 0, policy_version 960584 (0.0007) [2023-12-28 02:09:31,752][106225] Updated weights for policy 1, policy_version 962824 (0.0007) [2023-12-28 02:09:31,794][106226] Updated weights for policy 0, policy_version 960594 (0.0006) [2023-12-28 02:09:31,803][106225] Updated weights for policy 1, policy_version 962834 (0.0007) [2023-12-28 02:09:31,851][106226] Updated weights for policy 0, policy_version 960604 (0.0007) [2023-12-28 02:09:31,854][106225] Updated weights for policy 1, policy_version 962844 (0.0005) [2023-12-28 02:09:32,526][106226] Updated weights for policy 0, policy_version 960614 (0.0008) [2023-12-28 02:09:32,584][106226] Updated weights for policy 0, policy_version 960624 (0.0007) [2023-12-28 02:09:32,616][106225] Updated weights for policy 1, policy_version 962854 (0.0007) [2023-12-28 02:09:32,641][106226] Updated weights for policy 0, policy_version 960634 (0.0006) [2023-12-28 02:09:32,681][106225] Updated weights for policy 1, policy_version 962864 (0.0008) [2023-12-28 02:09:32,739][106225] Updated weights for policy 1, policy_version 962874 (0.0008) [2023-12-28 02:09:33,355][106226] Updated weights for policy 0, policy_version 960644 (0.0007) [2023-12-28 02:09:33,395][106225] Updated weights for policy 1, policy_version 962884 (0.0008) [2023-12-28 02:09:33,412][106226] Updated weights for policy 0, policy_version 960654 (0.0008) [2023-12-28 02:09:33,455][106225] Updated weights for policy 1, policy_version 962894 (0.0008) [2023-12-28 02:09:33,466][106226] Updated weights for policy 0, policy_version 960664 (0.0008) [2023-12-28 02:09:33,514][106225] Updated weights for policy 1, policy_version 962904 (0.0007) [2023-12-28 02:09:34,081][106226] Updated weights for policy 0, policy_version 960674 (0.0009) [2023-12-28 02:09:34,130][106226] Updated weights for policy 0, policy_version 960684 (0.0010) [2023-12-28 02:09:34,201][106226] Updated weights for policy 0, policy_version 960695 (0.0007) [2023-12-28 02:09:34,270][106225] Updated weights for policy 1, policy_version 962914 (0.0008) [2023-12-28 02:09:34,331][106225] Updated weights for policy 1, policy_version 962924 (0.0008) [2023-12-28 02:09:34,389][106225] Updated weights for policy 1, policy_version 962934 (0.0007) [2023-12-28 02:09:34,452][106225] Updated weights for policy 1, policy_version 962944 (0.0006) [2023-12-28 02:09:34,928][106226] Updated weights for policy 0, policy_version 960705 (0.0008) [2023-12-28 02:09:34,989][106226] Updated weights for policy 0, policy_version 960715 (0.0009) [2023-12-28 02:09:35,049][106226] Updated weights for policy 0, policy_version 960725 (0.0011) [2023-12-28 02:09:35,109][106226] Updated weights for policy 0, policy_version 960735 (0.0010) [2023-12-28 02:09:35,168][106225] Updated weights for policy 1, policy_version 962954 (0.0007) [2023-12-28 02:09:35,217][106225] Updated weights for policy 1, policy_version 962964 (0.0007) [2023-12-28 02:09:35,260][106225] Updated weights for policy 1, policy_version 962974 (0.0008) [2023-12-28 02:09:35,787][106226] Updated weights for policy 0, policy_version 960745 (0.0011) [2023-12-28 02:09:35,841][106226] Updated weights for policy 0, policy_version 960755 (0.0011) [2023-12-28 02:09:35,902][106226] Updated weights for policy 0, policy_version 960765 (0.0011) [2023-12-28 02:09:36,017][106225] Updated weights for policy 1, policy_version 962984 (0.0007) [2023-12-28 02:09:36,067][106225] Updated weights for policy 1, policy_version 962994 (0.0007) [2023-12-28 02:09:36,147][106225] Updated weights for policy 1, policy_version 963004 (0.0007) [2023-12-28 02:09:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 492584960. Throughput: 0: 9790.8, 1: 9838.2. Samples: 492588392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:36,175][105115] Avg episode reward: [(0, '-4.853'), (1, '-5.326')] [2023-12-28 02:09:36,622][106226] Updated weights for policy 0, policy_version 960775 (0.0011) [2023-12-28 02:09:36,688][106226] Updated weights for policy 0, policy_version 960785 (0.0011) [2023-12-28 02:09:36,753][106226] Updated weights for policy 0, policy_version 960795 (0.0011) [2023-12-28 02:09:36,844][106225] Updated weights for policy 1, policy_version 963014 (0.0007) [2023-12-28 02:09:36,900][106225] Updated weights for policy 1, policy_version 963024 (0.0005) [2023-12-28 02:09:36,959][106225] Updated weights for policy 1, policy_version 963034 (0.0008) [2023-12-28 02:09:37,461][106226] Updated weights for policy 0, policy_version 960805 (0.0011) [2023-12-28 02:09:37,508][106226] Updated weights for policy 0, policy_version 960815 (0.0010) [2023-12-28 02:09:37,521][106225] Updated weights for policy 1, policy_version 963044 (0.0007) [2023-12-28 02:09:37,562][106226] Updated weights for policy 0, policy_version 960825 (0.0010) [2023-12-28 02:09:37,576][106225] Updated weights for policy 1, policy_version 963054 (0.0005) [2023-12-28 02:09:37,629][106225] Updated weights for policy 1, policy_version 963064 (0.0005) [2023-12-28 02:09:38,197][106225] Updated weights for policy 1, policy_version 963074 (0.0006) [2023-12-28 02:09:38,266][106225] Updated weights for policy 1, policy_version 963084 (0.0009) [2023-12-28 02:09:38,283][106226] Updated weights for policy 0, policy_version 960835 (0.0009) [2023-12-28 02:09:38,329][106225] Updated weights for policy 1, policy_version 963094 (0.0009) [2023-12-28 02:09:38,354][106226] Updated weights for policy 0, policy_version 960845 (0.0007) [2023-12-28 02:09:38,400][106225] Updated weights for policy 1, policy_version 963104 (0.0007) [2023-12-28 02:09:38,427][106226] Updated weights for policy 0, policy_version 960855 (0.0008) [2023-12-28 02:09:39,031][106226] Updated weights for policy 0, policy_version 960865 (0.0009) [2023-12-28 02:09:39,082][106226] Updated weights for policy 0, policy_version 960875 (0.0009) [2023-12-28 02:09:39,130][106225] Updated weights for policy 1, policy_version 963114 (0.0006) [2023-12-28 02:09:39,135][106226] Updated weights for policy 0, policy_version 960885 (0.0009) [2023-12-28 02:09:39,177][106225] Updated weights for policy 1, policy_version 963124 (0.0005) [2023-12-28 02:09:39,183][106226] Updated weights for policy 0, policy_version 960895 (0.0009) [2023-12-28 02:09:39,255][106225] Updated weights for policy 1, policy_version 963134 (0.0007) [2023-12-28 02:09:39,995][106225] Updated weights for policy 1, policy_version 963144 (0.0007) [2023-12-28 02:09:40,000][106226] Updated weights for policy 0, policy_version 960905 (0.0008) [2023-12-28 02:09:40,061][106225] Updated weights for policy 1, policy_version 963154 (0.0008) [2023-12-28 02:09:40,063][106226] Updated weights for policy 0, policy_version 960915 (0.0006) [2023-12-28 02:09:40,123][106226] Updated weights for policy 0, policy_version 960925 (0.0009) [2023-12-28 02:09:40,126][106225] Updated weights for policy 1, policy_version 963164 (0.0009) [2023-12-28 02:09:40,843][106225] Updated weights for policy 1, policy_version 963174 (0.0008) [2023-12-28 02:09:40,845][106226] Updated weights for policy 0, policy_version 960935 (0.0007) [2023-12-28 02:09:40,904][106226] Updated weights for policy 0, policy_version 960945 (0.0008) [2023-12-28 02:09:40,906][106225] Updated weights for policy 1, policy_version 963184 (0.0006) [2023-12-28 02:09:40,960][106225] Updated weights for policy 1, policy_version 963194 (0.0006) [2023-12-28 02:09:40,961][106226] Updated weights for policy 0, policy_version 960955 (0.0008) [2023-12-28 02:09:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 492683264. Throughput: 0: 9851.5, 1: 9869.0. Samples: 492650652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:41,176][105115] Avg episode reward: [(0, '-5.065'), (1, '-4.922')] [2023-12-28 02:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000963200_246620160.pth... [2023-12-28 02:09:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000960960_246063104.pth... [2023-12-28 02:09:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000959808_245768192.pth [2023-12-28 02:09:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000962048_246325248.pth [2023-12-28 02:09:41,721][106226] Updated weights for policy 0, policy_version 960965 (0.0008) [2023-12-28 02:09:41,792][106226] Updated weights for policy 0, policy_version 960975 (0.0010) [2023-12-28 02:09:41,812][106225] Updated weights for policy 1, policy_version 963204 (0.0006) [2023-12-28 02:09:41,848][106226] Updated weights for policy 0, policy_version 960985 (0.0008) [2023-12-28 02:09:41,871][106225] Updated weights for policy 1, policy_version 963214 (0.0007) [2023-12-28 02:09:41,929][106225] Updated weights for policy 1, policy_version 963224 (0.0008) [2023-12-28 02:09:42,628][106226] Updated weights for policy 0, policy_version 960995 (0.0007) [2023-12-28 02:09:42,654][106225] Updated weights for policy 1, policy_version 963234 (0.0008) [2023-12-28 02:09:42,688][106226] Updated weights for policy 0, policy_version 961005 (0.0008) [2023-12-28 02:09:42,714][106225] Updated weights for policy 1, policy_version 963244 (0.0007) [2023-12-28 02:09:42,740][106226] Updated weights for policy 0, policy_version 961015 (0.0006) [2023-12-28 02:09:42,771][106225] Updated weights for policy 1, policy_version 963254 (0.0006) [2023-12-28 02:09:42,831][106225] Updated weights for policy 1, policy_version 963264 (0.0008) [2023-12-28 02:09:43,470][106226] Updated weights for policy 0, policy_version 961025 (0.0007) [2023-12-28 02:09:43,517][106226] Updated weights for policy 0, policy_version 961035 (0.0008) [2023-12-28 02:09:43,573][106226] Updated weights for policy 0, policy_version 961045 (0.0008) [2023-12-28 02:09:43,581][106225] Updated weights for policy 1, policy_version 963274 (0.0010) [2023-12-28 02:09:43,627][106226] Updated weights for policy 0, policy_version 961055 (0.0006) [2023-12-28 02:09:43,640][106225] Updated weights for policy 1, policy_version 963284 (0.0010) [2023-12-28 02:09:43,701][106225] Updated weights for policy 1, policy_version 963294 (0.0010) [2023-12-28 02:09:44,313][106225] Updated weights for policy 1, policy_version 963304 (0.0010) [2023-12-28 02:09:44,372][106225] Updated weights for policy 1, policy_version 963314 (0.0010) [2023-12-28 02:09:44,401][106226] Updated weights for policy 0, policy_version 961065 (0.0006) [2023-12-28 02:09:44,418][106225] Updated weights for policy 1, policy_version 963324 (0.0008) [2023-12-28 02:09:44,453][106226] Updated weights for policy 0, policy_version 961075 (0.0007) [2023-12-28 02:09:44,503][106226] Updated weights for policy 0, policy_version 961085 (0.0005) [2023-12-28 02:09:45,161][106225] Updated weights for policy 1, policy_version 963334 (0.0006) [2023-12-28 02:09:45,168][106226] Updated weights for policy 0, policy_version 961095 (0.0008) [2023-12-28 02:09:45,219][106225] Updated weights for policy 1, policy_version 963344 (0.0007) [2023-12-28 02:09:45,234][106226] Updated weights for policy 0, policy_version 961105 (0.0011) [2023-12-28 02:09:45,285][106225] Updated weights for policy 1, policy_version 963354 (0.0011) [2023-12-28 02:09:45,286][106226] Updated weights for policy 0, policy_version 961115 (0.0011) [2023-12-28 02:09:45,930][106225] Updated weights for policy 1, policy_version 963364 (0.0010) [2023-12-28 02:09:45,939][106226] Updated weights for policy 0, policy_version 961125 (0.0009) [2023-12-28 02:09:45,986][106225] Updated weights for policy 1, policy_version 963374 (0.0007) [2023-12-28 02:09:45,988][106226] Updated weights for policy 0, policy_version 961135 (0.0006) [2023-12-28 02:09:46,037][106226] Updated weights for policy 0, policy_version 961145 (0.0005) [2023-12-28 02:09:46,043][106225] Updated weights for policy 1, policy_version 963384 (0.0010) [2023-12-28 02:09:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 492781568. Throughput: 0: 9832.3, 1: 9784.1. Samples: 492764416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:46,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-4.844')] [2023-12-28 02:09:46,629][106225] Updated weights for policy 1, policy_version 963394 (0.0009) [2023-12-28 02:09:46,696][106225] Updated weights for policy 1, policy_version 963404 (0.0008) [2023-12-28 02:09:46,736][106226] Updated weights for policy 0, policy_version 961155 (0.0006) [2023-12-28 02:09:46,763][106225] Updated weights for policy 1, policy_version 963414 (0.0010) [2023-12-28 02:09:46,797][106226] Updated weights for policy 0, policy_version 961165 (0.0007) [2023-12-28 02:09:46,830][106225] Updated weights for policy 1, policy_version 963424 (0.0010) [2023-12-28 02:09:46,854][106226] Updated weights for policy 0, policy_version 961175 (0.0006) [2023-12-28 02:09:47,452][106225] Updated weights for policy 1, policy_version 963434 (0.0008) [2023-12-28 02:09:47,454][106226] Updated weights for policy 0, policy_version 961185 (0.0008) [2023-12-28 02:09:47,502][106225] Updated weights for policy 1, policy_version 963444 (0.0010) [2023-12-28 02:09:47,512][106226] Updated weights for policy 0, policy_version 961195 (0.0005) [2023-12-28 02:09:47,559][106225] Updated weights for policy 1, policy_version 963454 (0.0010) [2023-12-28 02:09:47,571][106226] Updated weights for policy 0, policy_version 961205 (0.0005) [2023-12-28 02:09:47,632][106226] Updated weights for policy 0, policy_version 961215 (0.0005) [2023-12-28 02:09:48,213][106225] Updated weights for policy 1, policy_version 963464 (0.0007) [2023-12-28 02:09:48,223][106226] Updated weights for policy 0, policy_version 961225 (0.0005) [2023-12-28 02:09:48,263][106225] Updated weights for policy 1, policy_version 963474 (0.0008) [2023-12-28 02:09:48,281][106226] Updated weights for policy 0, policy_version 961235 (0.0007) [2023-12-28 02:09:48,316][106225] Updated weights for policy 1, policy_version 963484 (0.0006) [2023-12-28 02:09:48,343][106226] Updated weights for policy 0, policy_version 961245 (0.0007) [2023-12-28 02:09:49,034][106226] Updated weights for policy 0, policy_version 961255 (0.0010) [2023-12-28 02:09:49,063][106225] Updated weights for policy 1, policy_version 963494 (0.0007) [2023-12-28 02:09:49,092][106226] Updated weights for policy 0, policy_version 961265 (0.0011) [2023-12-28 02:09:49,123][106225] Updated weights for policy 1, policy_version 963504 (0.0007) [2023-12-28 02:09:49,144][106226] Updated weights for policy 0, policy_version 961275 (0.0006) [2023-12-28 02:09:49,182][106225] Updated weights for policy 1, policy_version 963514 (0.0008) [2023-12-28 02:09:49,822][106226] Updated weights for policy 0, policy_version 961285 (0.0007) [2023-12-28 02:09:49,890][106226] Updated weights for policy 0, policy_version 961295 (0.0008) [2023-12-28 02:09:49,959][106226] Updated weights for policy 0, policy_version 961305 (0.0008) [2023-12-28 02:09:49,968][106225] Updated weights for policy 1, policy_version 963524 (0.0009) [2023-12-28 02:09:50,030][106225] Updated weights for policy 1, policy_version 963534 (0.0008) [2023-12-28 02:09:50,093][106225] Updated weights for policy 1, policy_version 963544 (0.0008) [2023-12-28 02:09:50,719][106226] Updated weights for policy 0, policy_version 961315 (0.0006) [2023-12-28 02:09:50,791][106225] Updated weights for policy 1, policy_version 963554 (0.0008) [2023-12-28 02:09:50,792][106226] Updated weights for policy 0, policy_version 961325 (0.0008) [2023-12-28 02:09:50,849][106225] Updated weights for policy 1, policy_version 963564 (0.0007) [2023-12-28 02:09:50,854][106226] Updated weights for policy 0, policy_version 961335 (0.0007) [2023-12-28 02:09:50,913][106225] Updated weights for policy 1, policy_version 963574 (0.0008) [2023-12-28 02:09:50,981][106225] Updated weights for policy 1, policy_version 963584 (0.0010) [2023-12-28 02:09:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 492879872. Throughput: 0: 9871.6, 1: 9784.4. Samples: 492886148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:51,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.277')] [2023-12-28 02:09:51,535][106226] Updated weights for policy 0, policy_version 961345 (0.0006) [2023-12-28 02:09:51,590][106226] Updated weights for policy 0, policy_version 961355 (0.0005) [2023-12-28 02:09:51,657][106226] Updated weights for policy 0, policy_version 961365 (0.0007) [2023-12-28 02:09:51,716][106226] Updated weights for policy 0, policy_version 961375 (0.0007) [2023-12-28 02:09:51,758][106225] Updated weights for policy 1, policy_version 963594 (0.0009) [2023-12-28 02:09:51,819][106225] Updated weights for policy 1, policy_version 963604 (0.0009) [2023-12-28 02:09:51,885][106225] Updated weights for policy 1, policy_version 963614 (0.0011) [2023-12-28 02:09:52,452][106226] Updated weights for policy 0, policy_version 961385 (0.0008) [2023-12-28 02:09:52,509][106226] Updated weights for policy 0, policy_version 961395 (0.0008) [2023-12-28 02:09:52,569][106226] Updated weights for policy 0, policy_version 961405 (0.0008) [2023-12-28 02:09:52,610][106225] Updated weights for policy 1, policy_version 963624 (0.0010) [2023-12-28 02:09:52,671][106225] Updated weights for policy 1, policy_version 963634 (0.0010) [2023-12-28 02:09:52,726][106225] Updated weights for policy 1, policy_version 963644 (0.0010) [2023-12-28 02:09:53,293][106226] Updated weights for policy 0, policy_version 961415 (0.0007) [2023-12-28 02:09:53,336][106226] Updated weights for policy 0, policy_version 961425 (0.0007) [2023-12-28 02:09:53,392][106226] Updated weights for policy 0, policy_version 961435 (0.0007) [2023-12-28 02:09:53,455][106225] Updated weights for policy 1, policy_version 963654 (0.0010) [2023-12-28 02:09:53,514][106225] Updated weights for policy 1, policy_version 963664 (0.0010) [2023-12-28 02:09:53,567][106225] Updated weights for policy 1, policy_version 963674 (0.0010) [2023-12-28 02:09:54,145][106226] Updated weights for policy 0, policy_version 961445 (0.0008) [2023-12-28 02:09:54,201][106226] Updated weights for policy 0, policy_version 961455 (0.0008) [2023-12-28 02:09:54,262][106226] Updated weights for policy 0, policy_version 961465 (0.0007) [2023-12-28 02:09:54,283][106225] Updated weights for policy 1, policy_version 963684 (0.0010) [2023-12-28 02:09:54,341][106225] Updated weights for policy 1, policy_version 963694 (0.0010) [2023-12-28 02:09:54,403][106225] Updated weights for policy 1, policy_version 963704 (0.0007) [2023-12-28 02:09:54,933][106226] Updated weights for policy 0, policy_version 961475 (0.0006) [2023-12-28 02:09:54,994][106226] Updated weights for policy 0, policy_version 961485 (0.0007) [2023-12-28 02:09:55,048][106226] Updated weights for policy 0, policy_version 961495 (0.0007) [2023-12-28 02:09:55,117][106225] Updated weights for policy 1, policy_version 963714 (0.0007) [2023-12-28 02:09:55,174][106225] Updated weights for policy 1, policy_version 963724 (0.0010) [2023-12-28 02:09:55,224][106225] Updated weights for policy 1, policy_version 963734 (0.0010) [2023-12-28 02:09:55,280][106225] Updated weights for policy 1, policy_version 963744 (0.0010) [2023-12-28 02:09:55,669][106226] Updated weights for policy 0, policy_version 961505 (0.0007) [2023-12-28 02:09:55,731][106226] Updated weights for policy 0, policy_version 961515 (0.0005) [2023-12-28 02:09:55,789][106226] Updated weights for policy 0, policy_version 961525 (0.0005) [2023-12-28 02:09:55,858][106226] Updated weights for policy 0, policy_version 961535 (0.0005) [2023-12-28 02:09:56,009][106225] Updated weights for policy 1, policy_version 963754 (0.0010) [2023-12-28 02:09:56,056][106225] Updated weights for policy 1, policy_version 963764 (0.0010) [2023-12-28 02:09:56,106][106225] Updated weights for policy 1, policy_version 963774 (0.0010) [2023-12-28 02:09:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 492978176. Throughput: 0: 9886.9, 1: 9757.7. Samples: 492943104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:09:56,175][105115] Avg episode reward: [(0, '-4.843'), (1, '-5.574')] [2023-12-28 02:09:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000963776_246767616.pth... [2023-12-28 02:09:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000961536_246210560.pth... [2023-12-28 02:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000960384_245915648.pth [2023-12-28 02:09:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000962624_246472704.pth [2023-12-28 02:09:56,477][106226] Updated weights for policy 0, policy_version 961545 (0.0009) [2023-12-28 02:09:56,530][106226] Updated weights for policy 0, policy_version 961555 (0.0005) [2023-12-28 02:09:56,581][106226] Updated weights for policy 0, policy_version 961565 (0.0005) [2023-12-28 02:09:56,851][106225] Updated weights for policy 1, policy_version 963784 (0.0010) [2023-12-28 02:09:56,916][106225] Updated weights for policy 1, policy_version 963794 (0.0010) [2023-12-28 02:09:56,980][106225] Updated weights for policy 1, policy_version 963804 (0.0010) [2023-12-28 02:09:57,143][106226] Updated weights for policy 0, policy_version 961575 (0.0009) [2023-12-28 02:09:57,195][106226] Updated weights for policy 0, policy_version 961585 (0.0011) [2023-12-28 02:09:57,256][106226] Updated weights for policy 0, policy_version 961595 (0.0008) [2023-12-28 02:09:57,694][106225] Updated weights for policy 1, policy_version 963814 (0.0009) [2023-12-28 02:09:57,750][106225] Updated weights for policy 1, policy_version 963824 (0.0008) [2023-12-28 02:09:57,807][106225] Updated weights for policy 1, policy_version 963834 (0.0006) [2023-12-28 02:09:57,988][106226] Updated weights for policy 0, policy_version 961605 (0.0010) [2023-12-28 02:09:58,046][106226] Updated weights for policy 0, policy_version 961615 (0.0008) [2023-12-28 02:09:58,102][106226] Updated weights for policy 0, policy_version 961625 (0.0009) [2023-12-28 02:09:58,469][106225] Updated weights for policy 1, policy_version 963844 (0.0006) [2023-12-28 02:09:58,532][106225] Updated weights for policy 1, policy_version 963854 (0.0008) [2023-12-28 02:09:58,595][106225] Updated weights for policy 1, policy_version 963864 (0.0008) [2023-12-28 02:09:58,948][106226] Updated weights for policy 0, policy_version 961635 (0.0009) [2023-12-28 02:09:59,015][106226] Updated weights for policy 0, policy_version 961645 (0.0007) [2023-12-28 02:09:59,081][106226] Updated weights for policy 0, policy_version 961655 (0.0008) [2023-12-28 02:09:59,423][106225] Updated weights for policy 1, policy_version 963874 (0.0006) [2023-12-28 02:09:59,487][106225] Updated weights for policy 1, policy_version 963884 (0.0008) [2023-12-28 02:09:59,547][106225] Updated weights for policy 1, policy_version 963894 (0.0007) [2023-12-28 02:09:59,606][106225] Updated weights for policy 1, policy_version 963904 (0.0005) [2023-12-28 02:09:59,826][106226] Updated weights for policy 0, policy_version 961665 (0.0008) [2023-12-28 02:09:59,895][106226] Updated weights for policy 0, policy_version 961676 (0.0009) [2023-12-28 02:09:59,959][106226] Updated weights for policy 0, policy_version 961686 (0.0008) [2023-12-28 02:10:00,024][106226] Updated weights for policy 0, policy_version 961696 (0.0008) [2023-12-28 02:10:00,252][106225] Updated weights for policy 1, policy_version 963914 (0.0007) [2023-12-28 02:10:00,312][106225] Updated weights for policy 1, policy_version 963924 (0.0010) [2023-12-28 02:10:00,369][106225] Updated weights for policy 1, policy_version 963934 (0.0010) [2023-12-28 02:10:00,725][106226] Updated weights for policy 0, policy_version 961706 (0.0006) [2023-12-28 02:10:00,790][106226] Updated weights for policy 0, policy_version 961716 (0.0009) [2023-12-28 02:10:00,852][106226] Updated weights for policy 0, policy_version 961726 (0.0010) [2023-12-28 02:10:01,013][106225] Updated weights for policy 1, policy_version 963944 (0.0010) [2023-12-28 02:10:01,069][106225] Updated weights for policy 1, policy_version 963954 (0.0008) [2023-12-28 02:10:01,122][106225] Updated weights for policy 1, policy_version 963964 (0.0008) [2023-12-28 02:10:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 493076480. Throughput: 0: 9946.3, 1: 9801.9. Samples: 493060660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:01,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.176')] [2023-12-28 02:10:01,544][106226] Updated weights for policy 0, policy_version 961736 (0.0011) [2023-12-28 02:10:01,611][106226] Updated weights for policy 0, policy_version 961746 (0.0011) [2023-12-28 02:10:01,672][106226] Updated weights for policy 0, policy_version 961756 (0.0010) [2023-12-28 02:10:01,861][106225] Updated weights for policy 1, policy_version 963974 (0.0008) [2023-12-28 02:10:01,926][106225] Updated weights for policy 1, policy_version 963984 (0.0008) [2023-12-28 02:10:01,992][106225] Updated weights for policy 1, policy_version 963994 (0.0006) [2023-12-28 02:10:02,433][106226] Updated weights for policy 0, policy_version 961766 (0.0006) [2023-12-28 02:10:02,491][106226] Updated weights for policy 0, policy_version 961776 (0.0009) [2023-12-28 02:10:02,549][106226] Updated weights for policy 0, policy_version 961786 (0.0008) [2023-12-28 02:10:02,659][106225] Updated weights for policy 1, policy_version 964004 (0.0005) [2023-12-28 02:10:02,714][106225] Updated weights for policy 1, policy_version 964014 (0.0007) [2023-12-28 02:10:02,758][106225] Updated weights for policy 1, policy_version 964024 (0.0008) [2023-12-28 02:10:03,242][106226] Updated weights for policy 0, policy_version 961796 (0.0009) [2023-12-28 02:10:03,305][106226] Updated weights for policy 0, policy_version 961806 (0.0011) [2023-12-28 02:10:03,365][106226] Updated weights for policy 0, policy_version 961816 (0.0011) [2023-12-28 02:10:03,409][106225] Updated weights for policy 1, policy_version 964034 (0.0008) [2023-12-28 02:10:03,461][106225] Updated weights for policy 1, policy_version 964044 (0.0007) [2023-12-28 02:10:03,524][106225] Updated weights for policy 1, policy_version 964054 (0.0008) [2023-12-28 02:10:03,580][106225] Updated weights for policy 1, policy_version 964064 (0.0007) [2023-12-28 02:10:04,085][106226] Updated weights for policy 0, policy_version 961826 (0.0010) [2023-12-28 02:10:04,153][106226] Updated weights for policy 0, policy_version 961836 (0.0011) [2023-12-28 02:10:04,220][106226] Updated weights for policy 0, policy_version 961846 (0.0007) [2023-12-28 02:10:04,282][106226] Updated weights for policy 0, policy_version 961856 (0.0011) [2023-12-28 02:10:04,306][106225] Updated weights for policy 1, policy_version 964074 (0.0008) [2023-12-28 02:10:04,370][106225] Updated weights for policy 1, policy_version 964084 (0.0006) [2023-12-28 02:10:04,426][106225] Updated weights for policy 1, policy_version 964094 (0.0006) [2023-12-28 02:10:04,928][106226] Updated weights for policy 0, policy_version 961866 (0.0010) [2023-12-28 02:10:04,981][106226] Updated weights for policy 0, policy_version 961876 (0.0005) [2023-12-28 02:10:04,997][106225] Updated weights for policy 1, policy_version 964104 (0.0007) [2023-12-28 02:10:05,043][106226] Updated weights for policy 0, policy_version 961886 (0.0005) [2023-12-28 02:10:05,057][106225] Updated weights for policy 1, policy_version 964114 (0.0008) [2023-12-28 02:10:05,108][106225] Updated weights for policy 1, policy_version 964124 (0.0007) [2023-12-28 02:10:05,627][106226] Updated weights for policy 0, policy_version 961896 (0.0005) [2023-12-28 02:10:05,678][106226] Updated weights for policy 0, policy_version 961906 (0.0005) [2023-12-28 02:10:05,731][106226] Updated weights for policy 0, policy_version 961916 (0.0005) [2023-12-28 02:10:05,926][106225] Updated weights for policy 1, policy_version 964134 (0.0008) [2023-12-28 02:10:05,991][106225] Updated weights for policy 1, policy_version 964144 (0.0007) [2023-12-28 02:10:06,047][106225] Updated weights for policy 1, policy_version 964154 (0.0009) [2023-12-28 02:10:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 493174784. Throughput: 0: 10011.8, 1: 9825.4. Samples: 493183408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:06,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-5.060')] [2023-12-28 02:10:06,285][106226] Updated weights for policy 0, policy_version 961926 (0.0006) [2023-12-28 02:10:06,346][106226] Updated weights for policy 0, policy_version 961936 (0.0007) [2023-12-28 02:10:06,404][106226] Updated weights for policy 0, policy_version 961946 (0.0007) [2023-12-28 02:10:06,773][106225] Updated weights for policy 1, policy_version 964164 (0.0008) [2023-12-28 02:10:06,832][106225] Updated weights for policy 1, policy_version 964174 (0.0010) [2023-12-28 02:10:06,881][106225] Updated weights for policy 1, policy_version 964184 (0.0008) [2023-12-28 02:10:06,981][106226] Updated weights for policy 0, policy_version 961956 (0.0006) [2023-12-28 02:10:07,035][106226] Updated weights for policy 0, policy_version 961966 (0.0005) [2023-12-28 02:10:07,090][106226] Updated weights for policy 0, policy_version 961976 (0.0008) [2023-12-28 02:10:07,659][106225] Updated weights for policy 1, policy_version 964194 (0.0007) [2023-12-28 02:10:07,714][106225] Updated weights for policy 1, policy_version 964204 (0.0006) [2023-12-28 02:10:07,756][106226] Updated weights for policy 0, policy_version 961986 (0.0008) [2023-12-28 02:10:07,770][106225] Updated weights for policy 1, policy_version 964214 (0.0006) [2023-12-28 02:10:07,811][106226] Updated weights for policy 0, policy_version 961996 (0.0005) [2023-12-28 02:10:07,825][106225] Updated weights for policy 1, policy_version 964224 (0.0007) [2023-12-28 02:10:07,867][106226] Updated weights for policy 0, policy_version 962006 (0.0007) [2023-12-28 02:10:07,917][106226] Updated weights for policy 0, policy_version 962016 (0.0009) [2023-12-28 02:10:08,542][106225] Updated weights for policy 1, policy_version 964234 (0.0007) [2023-12-28 02:10:08,609][106225] Updated weights for policy 1, policy_version 964244 (0.0006) [2023-12-28 02:10:08,656][106226] Updated weights for policy 0, policy_version 962026 (0.0009) [2023-12-28 02:10:08,674][106225] Updated weights for policy 1, policy_version 964254 (0.0006) [2023-12-28 02:10:08,721][106226] Updated weights for policy 0, policy_version 962036 (0.0009) [2023-12-28 02:10:08,787][106226] Updated weights for policy 0, policy_version 962046 (0.0008) [2023-12-28 02:10:09,395][106225] Updated weights for policy 1, policy_version 964264 (0.0008) [2023-12-28 02:10:09,457][106225] Updated weights for policy 1, policy_version 964274 (0.0008) [2023-12-28 02:10:09,512][106225] Updated weights for policy 1, policy_version 964284 (0.0007) [2023-12-28 02:10:09,537][106226] Updated weights for policy 0, policy_version 962056 (0.0009) [2023-12-28 02:10:09,599][106226] Updated weights for policy 0, policy_version 962066 (0.0009) [2023-12-28 02:10:09,662][106226] Updated weights for policy 0, policy_version 962076 (0.0009) [2023-12-28 02:10:10,269][106225] Updated weights for policy 1, policy_version 964294 (0.0007) [2023-12-28 02:10:10,328][106225] Updated weights for policy 1, policy_version 964304 (0.0008) [2023-12-28 02:10:10,387][106225] Updated weights for policy 1, policy_version 964314 (0.0008) [2023-12-28 02:10:10,433][106226] Updated weights for policy 0, policy_version 962086 (0.0009) [2023-12-28 02:10:10,491][106226] Updated weights for policy 0, policy_version 962096 (0.0008) [2023-12-28 02:10:10,557][106226] Updated weights for policy 0, policy_version 962106 (0.0008) [2023-12-28 02:10:11,113][106225] Updated weights for policy 1, policy_version 964324 (0.0009) [2023-12-28 02:10:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 493264896. Throughput: 0: 10033.0, 1: 9827.8. Samples: 493242312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:11,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.176')] [2023-12-28 02:10:11,177][106225] Updated weights for policy 1, policy_version 964334 (0.0010) [2023-12-28 02:10:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000962112_246358016.pth... [2023-12-28 02:10:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000960960_246063104.pth [2023-12-28 02:10:11,244][106225] Updated weights for policy 1, policy_version 964344 (0.0006) [2023-12-28 02:10:11,294][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000964352_246915072.pth... [2023-12-28 02:10:11,299][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000963200_246620160.pth [2023-12-28 02:10:11,322][106226] Updated weights for policy 0, policy_version 962116 (0.0009) [2023-12-28 02:10:11,397][106226] Updated weights for policy 0, policy_version 962126 (0.0008) [2023-12-28 02:10:11,456][106226] Updated weights for policy 0, policy_version 962136 (0.0006) [2023-12-28 02:10:11,972][106225] Updated weights for policy 1, policy_version 964354 (0.0007) [2023-12-28 02:10:12,034][106225] Updated weights for policy 1, policy_version 964364 (0.0008) [2023-12-28 02:10:12,090][106225] Updated weights for policy 1, policy_version 964374 (0.0008) [2023-12-28 02:10:12,148][106225] Updated weights for policy 1, policy_version 964384 (0.0008) [2023-12-28 02:10:12,241][106226] Updated weights for policy 0, policy_version 962146 (0.0006) [2023-12-28 02:10:12,309][106226] Updated weights for policy 0, policy_version 962156 (0.0008) [2023-12-28 02:10:12,375][106226] Updated weights for policy 0, policy_version 962166 (0.0008) [2023-12-28 02:10:12,442][106226] Updated weights for policy 0, policy_version 962176 (0.0008) [2023-12-28 02:10:12,887][106225] Updated weights for policy 1, policy_version 964394 (0.0009) [2023-12-28 02:10:12,949][106225] Updated weights for policy 1, policy_version 964404 (0.0008) [2023-12-28 02:10:13,006][106225] Updated weights for policy 1, policy_version 964414 (0.0009) [2023-12-28 02:10:13,238][106226] Updated weights for policy 0, policy_version 962186 (0.0009) [2023-12-28 02:10:13,294][106226] Updated weights for policy 0, policy_version 962196 (0.0006) [2023-12-28 02:10:13,353][106226] Updated weights for policy 0, policy_version 962206 (0.0005) [2023-12-28 02:10:13,726][106225] Updated weights for policy 1, policy_version 964424 (0.0009) [2023-12-28 02:10:13,788][106225] Updated weights for policy 1, policy_version 964434 (0.0008) [2023-12-28 02:10:13,835][106225] Updated weights for policy 1, policy_version 964444 (0.0008) [2023-12-28 02:10:13,935][106226] Updated weights for policy 0, policy_version 962216 (0.0006) [2023-12-28 02:10:13,996][106226] Updated weights for policy 0, policy_version 962226 (0.0005) [2023-12-28 02:10:14,047][106226] Updated weights for policy 0, policy_version 962236 (0.0005) [2023-12-28 02:10:14,483][106225] Updated weights for policy 1, policy_version 964454 (0.0009) [2023-12-28 02:10:14,543][106225] Updated weights for policy 1, policy_version 964464 (0.0008) [2023-12-28 02:10:14,601][106225] Updated weights for policy 1, policy_version 964474 (0.0005) [2023-12-28 02:10:14,741][106226] Updated weights for policy 0, policy_version 962246 (0.0008) [2023-12-28 02:10:14,813][106226] Updated weights for policy 0, policy_version 962256 (0.0008) [2023-12-28 02:10:14,874][106226] Updated weights for policy 0, policy_version 962266 (0.0010) [2023-12-28 02:10:15,272][106225] Updated weights for policy 1, policy_version 964484 (0.0007) [2023-12-28 02:10:15,337][106225] Updated weights for policy 1, policy_version 964494 (0.0010) [2023-12-28 02:10:15,393][106225] Updated weights for policy 1, policy_version 964504 (0.0010) [2023-12-28 02:10:15,597][106226] Updated weights for policy 0, policy_version 962276 (0.0011) [2023-12-28 02:10:15,663][106226] Updated weights for policy 0, policy_version 962286 (0.0010) [2023-12-28 02:10:15,736][106226] Updated weights for policy 0, policy_version 962296 (0.0011) [2023-12-28 02:10:16,039][106225] Updated weights for policy 1, policy_version 964514 (0.0010) [2023-12-28 02:10:16,086][106225] Updated weights for policy 1, policy_version 964524 (0.0010) [2023-12-28 02:10:16,136][106225] Updated weights for policy 1, policy_version 964534 (0.0010) [2023-12-28 02:10:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 493363200. Throughput: 0: 9910.2, 1: 9784.1. Samples: 493356648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:16,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.753')] [2023-12-28 02:10:16,186][106225] Updated weights for policy 1, policy_version 964544 (0.0010) [2023-12-28 02:10:16,406][106226] Updated weights for policy 0, policy_version 962306 (0.0010) [2023-12-28 02:10:16,471][106226] Updated weights for policy 0, policy_version 962316 (0.0005) [2023-12-28 02:10:16,526][106226] Updated weights for policy 0, policy_version 962326 (0.0005) [2023-12-28 02:10:16,587][106226] Updated weights for policy 0, policy_version 962336 (0.0006) [2023-12-28 02:10:16,905][106225] Updated weights for policy 1, policy_version 964554 (0.0007) [2023-12-28 02:10:16,972][106225] Updated weights for policy 1, policy_version 964564 (0.0008) [2023-12-28 02:10:17,035][106225] Updated weights for policy 1, policy_version 964574 (0.0010) [2023-12-28 02:10:17,233][106226] Updated weights for policy 0, policy_version 962346 (0.0009) [2023-12-28 02:10:17,292][106226] Updated weights for policy 0, policy_version 962356 (0.0009) [2023-12-28 02:10:17,354][106226] Updated weights for policy 0, policy_version 962366 (0.0007) [2023-12-28 02:10:17,758][106225] Updated weights for policy 1, policy_version 964584 (0.0008) [2023-12-28 02:10:17,815][106225] Updated weights for policy 1, policy_version 964594 (0.0009) [2023-12-28 02:10:17,870][106225] Updated weights for policy 1, policy_version 964604 (0.0009) [2023-12-28 02:10:18,098][106226] Updated weights for policy 0, policy_version 962376 (0.0009) [2023-12-28 02:10:18,161][106226] Updated weights for policy 0, policy_version 962386 (0.0009) [2023-12-28 02:10:18,217][106226] Updated weights for policy 0, policy_version 962396 (0.0008) [2023-12-28 02:10:18,610][106225] Updated weights for policy 1, policy_version 964614 (0.0008) [2023-12-28 02:10:18,674][106225] Updated weights for policy 1, policy_version 964624 (0.0008) [2023-12-28 02:10:18,726][106225] Updated weights for policy 1, policy_version 964634 (0.0008) [2023-12-28 02:10:18,930][106226] Updated weights for policy 0, policy_version 962406 (0.0009) [2023-12-28 02:10:18,987][106226] Updated weights for policy 0, policy_version 962416 (0.0011) [2023-12-28 02:10:19,044][106226] Updated weights for policy 0, policy_version 962426 (0.0010) [2023-12-28 02:10:19,498][106225] Updated weights for policy 1, policy_version 964644 (0.0008) [2023-12-28 02:10:19,557][106225] Updated weights for policy 1, policy_version 964654 (0.0008) [2023-12-28 02:10:19,606][106225] Updated weights for policy 1, policy_version 964664 (0.0008) [2023-12-28 02:10:19,772][106226] Updated weights for policy 0, policy_version 962436 (0.0008) [2023-12-28 02:10:19,835][106226] Updated weights for policy 0, policy_version 962446 (0.0008) [2023-12-28 02:10:19,905][106226] Updated weights for policy 0, policy_version 962456 (0.0011) [2023-12-28 02:10:20,347][106225] Updated weights for policy 1, policy_version 964674 (0.0008) [2023-12-28 02:10:20,407][106225] Updated weights for policy 1, policy_version 964684 (0.0007) [2023-12-28 02:10:20,461][106225] Updated weights for policy 1, policy_version 964694 (0.0007) [2023-12-28 02:10:20,516][106225] Updated weights for policy 1, policy_version 964704 (0.0008) [2023-12-28 02:10:20,597][106226] Updated weights for policy 0, policy_version 962466 (0.0012) [2023-12-28 02:10:20,659][106226] Updated weights for policy 0, policy_version 962476 (0.0007) [2023-12-28 02:10:20,733][106226] Updated weights for policy 0, policy_version 962486 (0.0008) [2023-12-28 02:10:20,792][106226] Updated weights for policy 0, policy_version 962496 (0.0011) [2023-12-28 02:10:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 493461504. Throughput: 0: 9866.3, 1: 9795.8. Samples: 493473188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:21,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-5.232')] [2023-12-28 02:10:21,330][106225] Updated weights for policy 1, policy_version 964714 (0.0008) [2023-12-28 02:10:21,395][106225] Updated weights for policy 1, policy_version 964724 (0.0009) [2023-12-28 02:10:21,450][106225] Updated weights for policy 1, policy_version 964734 (0.0008) [2023-12-28 02:10:21,504][106226] Updated weights for policy 0, policy_version 962506 (0.0009) [2023-12-28 02:10:21,568][106226] Updated weights for policy 0, policy_version 962516 (0.0010) [2023-12-28 02:10:21,639][106226] Updated weights for policy 0, policy_version 962526 (0.0010) [2023-12-28 02:10:22,269][106225] Updated weights for policy 1, policy_version 964744 (0.0008) [2023-12-28 02:10:22,333][106225] Updated weights for policy 1, policy_version 964754 (0.0010) [2023-12-28 02:10:22,379][106226] Updated weights for policy 0, policy_version 962536 (0.0008) [2023-12-28 02:10:22,401][106225] Updated weights for policy 1, policy_version 964764 (0.0007) [2023-12-28 02:10:22,449][106226] Updated weights for policy 0, policy_version 962546 (0.0009) [2023-12-28 02:10:22,519][106226] Updated weights for policy 0, policy_version 962556 (0.0009) [2023-12-28 02:10:23,153][106225] Updated weights for policy 1, policy_version 964774 (0.0006) [2023-12-28 02:10:23,218][106225] Updated weights for policy 1, policy_version 964784 (0.0006) [2023-12-28 02:10:23,240][106226] Updated weights for policy 0, policy_version 962566 (0.0007) [2023-12-28 02:10:23,280][106225] Updated weights for policy 1, policy_version 964794 (0.0007) [2023-12-28 02:10:23,302][106226] Updated weights for policy 0, policy_version 962576 (0.0007) [2023-12-28 02:10:23,358][106226] Updated weights for policy 0, policy_version 962586 (0.0008) [2023-12-28 02:10:23,947][106225] Updated weights for policy 1, policy_version 964804 (0.0010) [2023-12-28 02:10:24,005][106225] Updated weights for policy 1, policy_version 964814 (0.0009) [2023-12-28 02:10:24,059][106226] Updated weights for policy 0, policy_version 962596 (0.0008) [2023-12-28 02:10:24,065][106225] Updated weights for policy 1, policy_version 964824 (0.0008) [2023-12-28 02:10:24,110][106226] Updated weights for policy 0, policy_version 962606 (0.0008) [2023-12-28 02:10:24,174][106226] Updated weights for policy 0, policy_version 962616 (0.0009) [2023-12-28 02:10:24,794][106225] Updated weights for policy 1, policy_version 964834 (0.0006) [2023-12-28 02:10:24,856][106225] Updated weights for policy 1, policy_version 964844 (0.0009) [2023-12-28 02:10:24,885][106226] Updated weights for policy 0, policy_version 962626 (0.0009) [2023-12-28 02:10:24,914][106225] Updated weights for policy 1, policy_version 964854 (0.0007) [2023-12-28 02:10:24,928][106226] Updated weights for policy 0, policy_version 962636 (0.0006) [2023-12-28 02:10:24,966][106225] Updated weights for policy 1, policy_version 964864 (0.0007) [2023-12-28 02:10:24,983][106226] Updated weights for policy 0, policy_version 962646 (0.0008) [2023-12-28 02:10:25,040][106226] Updated weights for policy 0, policy_version 962656 (0.0008) [2023-12-28 02:10:25,614][106225] Updated weights for policy 1, policy_version 964874 (0.0010) [2023-12-28 02:10:25,670][106225] Updated weights for policy 1, policy_version 964884 (0.0010) [2023-12-28 02:10:25,729][106225] Updated weights for policy 1, policy_version 964894 (0.0010) [2023-12-28 02:10:25,809][106226] Updated weights for policy 0, policy_version 962666 (0.0008) [2023-12-28 02:10:25,865][106226] Updated weights for policy 0, policy_version 962676 (0.0008) [2023-12-28 02:10:25,921][106226] Updated weights for policy 0, policy_version 962686 (0.0008) [2023-12-28 02:10:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 493559808. Throughput: 0: 9830.5, 1: 9691.7. Samples: 493529152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:26,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.968')] [2023-12-28 02:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000962688_246505472.pth... [2023-12-28 02:10:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000964896_247054336.pth... [2023-12-28 02:10:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000961536_246210560.pth [2023-12-28 02:10:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000963776_246767616.pth [2023-12-28 02:10:26,368][106225] Updated weights for policy 1, policy_version 964904 (0.0006) [2023-12-28 02:10:26,420][106225] Updated weights for policy 1, policy_version 964914 (0.0006) [2023-12-28 02:10:26,469][106225] Updated weights for policy 1, policy_version 964924 (0.0010) [2023-12-28 02:10:26,604][106226] Updated weights for policy 0, policy_version 962696 (0.0005) [2023-12-28 02:10:26,648][106226] Updated weights for policy 0, policy_version 962706 (0.0005) [2023-12-28 02:10:26,701][106226] Updated weights for policy 0, policy_version 962716 (0.0006) [2023-12-28 02:10:27,097][106225] Updated weights for policy 1, policy_version 964934 (0.0008) [2023-12-28 02:10:27,151][106225] Updated weights for policy 1, policy_version 964944 (0.0010) [2023-12-28 02:10:27,200][106225] Updated weights for policy 1, policy_version 964954 (0.0010) [2023-12-28 02:10:27,258][106226] Updated weights for policy 0, policy_version 962726 (0.0008) [2023-12-28 02:10:27,325][106226] Updated weights for policy 0, policy_version 962736 (0.0008) [2023-12-28 02:10:27,389][106226] Updated weights for policy 0, policy_version 962746 (0.0005) [2023-12-28 02:10:27,858][106225] Updated weights for policy 1, policy_version 964964 (0.0010) [2023-12-28 02:10:27,912][106225] Updated weights for policy 1, policy_version 964974 (0.0006) [2023-12-28 02:10:27,969][106225] Updated weights for policy 1, policy_version 964984 (0.0006) [2023-12-28 02:10:28,044][106226] Updated weights for policy 0, policy_version 962756 (0.0008) [2023-12-28 02:10:28,106][106226] Updated weights for policy 0, policy_version 962766 (0.0009) [2023-12-28 02:10:28,165][106226] Updated weights for policy 0, policy_version 962776 (0.0009) [2023-12-28 02:10:28,610][106225] Updated weights for policy 1, policy_version 964994 (0.0006) [2023-12-28 02:10:28,669][106225] Updated weights for policy 1, policy_version 965004 (0.0009) [2023-12-28 02:10:28,731][106225] Updated weights for policy 1, policy_version 965014 (0.0008) [2023-12-28 02:10:28,796][106225] Updated weights for policy 1, policy_version 965024 (0.0009) [2023-12-28 02:10:28,886][106226] Updated weights for policy 0, policy_version 962786 (0.0008) [2023-12-28 02:10:28,948][106226] Updated weights for policy 0, policy_version 962796 (0.0006) [2023-12-28 02:10:29,012][106226] Updated weights for policy 0, policy_version 962806 (0.0006) [2023-12-28 02:10:29,076][106226] Updated weights for policy 0, policy_version 962816 (0.0005) [2023-12-28 02:10:29,505][106225] Updated weights for policy 1, policy_version 965034 (0.0007) [2023-12-28 02:10:29,564][106225] Updated weights for policy 1, policy_version 965044 (0.0009) [2023-12-28 02:10:29,609][106225] Updated weights for policy 1, policy_version 965054 (0.0008) [2023-12-28 02:10:29,690][106226] Updated weights for policy 0, policy_version 962826 (0.0008) [2023-12-28 02:10:29,750][106226] Updated weights for policy 0, policy_version 962836 (0.0010) [2023-12-28 02:10:29,812][106226] Updated weights for policy 0, policy_version 962846 (0.0008) [2023-12-28 02:10:30,306][106225] Updated weights for policy 1, policy_version 965064 (0.0008) [2023-12-28 02:10:30,363][106225] Updated weights for policy 1, policy_version 965074 (0.0007) [2023-12-28 02:10:30,416][106225] Updated weights for policy 1, policy_version 965084 (0.0009) [2023-12-28 02:10:30,471][106226] Updated weights for policy 0, policy_version 962856 (0.0005) [2023-12-28 02:10:30,530][106226] Updated weights for policy 0, policy_version 962866 (0.0005) [2023-12-28 02:10:30,592][106226] Updated weights for policy 0, policy_version 962876 (0.0005) [2023-12-28 02:10:31,128][106226] Updated weights for policy 0, policy_version 962886 (0.0007) [2023-12-28 02:10:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 493658112. Throughput: 0: 9919.3, 1: 9785.9. Samples: 493651152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:31,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-5.324')] [2023-12-28 02:10:31,196][106226] Updated weights for policy 0, policy_version 962896 (0.0011) [2023-12-28 02:10:31,238][106225] Updated weights for policy 1, policy_version 965094 (0.0007) [2023-12-28 02:10:31,263][106226] Updated weights for policy 0, policy_version 962906 (0.0011) [2023-12-28 02:10:31,303][106225] Updated weights for policy 1, policy_version 965104 (0.0007) [2023-12-28 02:10:31,367][106225] Updated weights for policy 1, policy_version 965114 (0.0008) [2023-12-28 02:10:31,966][106226] Updated weights for policy 0, policy_version 962916 (0.0011) [2023-12-28 02:10:32,023][106226] Updated weights for policy 0, policy_version 962926 (0.0010) [2023-12-28 02:10:32,029][106225] Updated weights for policy 1, policy_version 965124 (0.0007) [2023-12-28 02:10:32,080][106226] Updated weights for policy 0, policy_version 962936 (0.0011) [2023-12-28 02:10:32,090][106225] Updated weights for policy 1, policy_version 965134 (0.0006) [2023-12-28 02:10:32,153][106225] Updated weights for policy 1, policy_version 965144 (0.0007) [2023-12-28 02:10:32,743][106226] Updated weights for policy 0, policy_version 962946 (0.0011) [2023-12-28 02:10:32,806][106226] Updated weights for policy 0, policy_version 962956 (0.0010) [2023-12-28 02:10:32,861][106225] Updated weights for policy 1, policy_version 965154 (0.0008) [2023-12-28 02:10:32,869][106226] Updated weights for policy 0, policy_version 962966 (0.0007) [2023-12-28 02:10:32,920][106226] Updated weights for policy 0, policy_version 962976 (0.0006) [2023-12-28 02:10:32,920][106225] Updated weights for policy 1, policy_version 965164 (0.0008) [2023-12-28 02:10:32,980][106225] Updated weights for policy 1, policy_version 965174 (0.0008) [2023-12-28 02:10:33,036][106225] Updated weights for policy 1, policy_version 965184 (0.0008) [2023-12-28 02:10:33,581][106226] Updated weights for policy 0, policy_version 962986 (0.0010) [2023-12-28 02:10:33,633][106226] Updated weights for policy 0, policy_version 962996 (0.0010) [2023-12-28 02:10:33,679][106226] Updated weights for policy 0, policy_version 963006 (0.0010) [2023-12-28 02:10:33,774][106225] Updated weights for policy 1, policy_version 965194 (0.0007) [2023-12-28 02:10:33,819][106225] Updated weights for policy 1, policy_version 965204 (0.0007) [2023-12-28 02:10:33,877][106225] Updated weights for policy 1, policy_version 965214 (0.0008) [2023-12-28 02:10:34,400][106226] Updated weights for policy 0, policy_version 963016 (0.0011) [2023-12-28 02:10:34,461][106226] Updated weights for policy 0, policy_version 963026 (0.0011) [2023-12-28 02:10:34,523][106226] Updated weights for policy 0, policy_version 963036 (0.0011) [2023-12-28 02:10:34,579][106225] Updated weights for policy 1, policy_version 965224 (0.0009) [2023-12-28 02:10:34,641][106225] Updated weights for policy 1, policy_version 965234 (0.0007) [2023-12-28 02:10:34,692][106225] Updated weights for policy 1, policy_version 965244 (0.0008) [2023-12-28 02:10:35,196][106226] Updated weights for policy 0, policy_version 963046 (0.0007) [2023-12-28 02:10:35,258][106226] Updated weights for policy 0, policy_version 963056 (0.0005) [2023-12-28 02:10:35,322][106226] Updated weights for policy 0, policy_version 963066 (0.0007) [2023-12-28 02:10:35,400][106225] Updated weights for policy 1, policy_version 965254 (0.0007) [2023-12-28 02:10:35,456][106225] Updated weights for policy 1, policy_version 965264 (0.0005) [2023-12-28 02:10:35,512][106225] Updated weights for policy 1, policy_version 965274 (0.0005) [2023-12-28 02:10:35,922][106226] Updated weights for policy 0, policy_version 963076 (0.0007) [2023-12-28 02:10:35,971][106226] Updated weights for policy 0, policy_version 963086 (0.0005) [2023-12-28 02:10:36,018][106226] Updated weights for policy 0, policy_version 963096 (0.0005) [2023-12-28 02:10:36,031][106225] Updated weights for policy 1, policy_version 965284 (0.0005) [2023-12-28 02:10:36,094][106225] Updated weights for policy 1, policy_version 965294 (0.0006) [2023-12-28 02:10:36,164][106225] Updated weights for policy 1, policy_version 965304 (0.0008) [2023-12-28 02:10:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 493764608. Throughput: 0: 9973.2, 1: 9758.7. Samples: 493774088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:36,177][105115] Avg episode reward: [(0, '-4.672'), (1, '-5.125')] [2023-12-28 02:10:36,710][106226] Updated weights for policy 0, policy_version 963106 (0.0008) [2023-12-28 02:10:36,736][106225] Updated weights for policy 1, policy_version 965314 (0.0008) [2023-12-28 02:10:36,775][106226] Updated weights for policy 0, policy_version 963116 (0.0011) [2023-12-28 02:10:36,792][106225] Updated weights for policy 1, policy_version 965324 (0.0006) [2023-12-28 02:10:36,828][106226] Updated weights for policy 0, policy_version 963126 (0.0011) [2023-12-28 02:10:36,847][106225] Updated weights for policy 1, policy_version 965334 (0.0006) [2023-12-28 02:10:36,885][106226] Updated weights for policy 0, policy_version 963136 (0.0010) [2023-12-28 02:10:36,900][106225] Updated weights for policy 1, policy_version 965344 (0.0007) [2023-12-28 02:10:37,599][106225] Updated weights for policy 1, policy_version 965354 (0.0010) [2023-12-28 02:10:37,615][106226] Updated weights for policy 0, policy_version 963146 (0.0011) [2023-12-28 02:10:37,653][106225] Updated weights for policy 1, policy_version 965364 (0.0010) [2023-12-28 02:10:37,675][106226] Updated weights for policy 0, policy_version 963156 (0.0011) [2023-12-28 02:10:37,702][106225] Updated weights for policy 1, policy_version 965374 (0.0009) [2023-12-28 02:10:37,736][106226] Updated weights for policy 0, policy_version 963166 (0.0008) [2023-12-28 02:10:38,433][106226] Updated weights for policy 0, policy_version 963176 (0.0009) [2023-12-28 02:10:38,471][106225] Updated weights for policy 1, policy_version 965384 (0.0009) [2023-12-28 02:10:38,495][106226] Updated weights for policy 0, policy_version 963186 (0.0006) [2023-12-28 02:10:38,534][106225] Updated weights for policy 1, policy_version 965394 (0.0010) [2023-12-28 02:10:38,549][106226] Updated weights for policy 0, policy_version 963196 (0.0006) [2023-12-28 02:10:38,599][106225] Updated weights for policy 1, policy_version 965404 (0.0008) [2023-12-28 02:10:39,229][106226] Updated weights for policy 0, policy_version 963206 (0.0010) [2023-12-28 02:10:39,289][106225] Updated weights for policy 1, policy_version 965414 (0.0006) [2023-12-28 02:10:39,296][106226] Updated weights for policy 0, policy_version 963216 (0.0008) [2023-12-28 02:10:39,358][106226] Updated weights for policy 0, policy_version 963226 (0.0008) [2023-12-28 02:10:39,365][106225] Updated weights for policy 1, policy_version 965424 (0.0008) [2023-12-28 02:10:39,442][106225] Updated weights for policy 1, policy_version 965434 (0.0009) [2023-12-28 02:10:40,164][106226] Updated weights for policy 0, policy_version 963236 (0.0008) [2023-12-28 02:10:40,192][106225] Updated weights for policy 1, policy_version 965444 (0.0009) [2023-12-28 02:10:40,225][106226] Updated weights for policy 0, policy_version 963246 (0.0008) [2023-12-28 02:10:40,253][106225] Updated weights for policy 1, policy_version 965454 (0.0008) [2023-12-28 02:10:40,277][106226] Updated weights for policy 0, policy_version 963256 (0.0007) [2023-12-28 02:10:40,315][106225] Updated weights for policy 1, policy_version 965464 (0.0008) [2023-12-28 02:10:40,977][106226] Updated weights for policy 0, policy_version 963266 (0.0007) [2023-12-28 02:10:41,034][106226] Updated weights for policy 0, policy_version 963276 (0.0011) [2023-12-28 02:10:41,063][106225] Updated weights for policy 1, policy_version 965474 (0.0008) [2023-12-28 02:10:41,100][106226] Updated weights for policy 0, policy_version 963286 (0.0010) [2023-12-28 02:10:41,126][106225] Updated weights for policy 1, policy_version 965484 (0.0006) [2023-12-28 02:10:41,165][106226] Updated weights for policy 0, policy_version 963296 (0.0010) [2023-12-28 02:10:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 493862912. Throughput: 0: 9982.9, 1: 9821.9. Samples: 493834324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:41,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-5.165')] [2023-12-28 02:10:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000963296_246661120.pth... [2023-12-28 02:10:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000962112_246358016.pth [2023-12-28 02:10:41,194][106225] Updated weights for policy 1, policy_version 965494 (0.0008) [2023-12-28 02:10:41,252][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000965504_247209984.pth... [2023-12-28 02:10:41,253][106225] Updated weights for policy 1, policy_version 965504 (0.0008) [2023-12-28 02:10:41,255][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000964352_246915072.pth [2023-12-28 02:10:41,916][106226] Updated weights for policy 0, policy_version 963306 (0.0008) [2023-12-28 02:10:41,982][106226] Updated weights for policy 0, policy_version 963316 (0.0008) [2023-12-28 02:10:42,053][106226] Updated weights for policy 0, policy_version 963326 (0.0006) [2023-12-28 02:10:42,104][106225] Updated weights for policy 1, policy_version 965514 (0.0008) [2023-12-28 02:10:42,153][106225] Updated weights for policy 1, policy_version 965524 (0.0008) [2023-12-28 02:10:42,218][106225] Updated weights for policy 1, policy_version 965534 (0.0009) [2023-12-28 02:10:42,626][106226] Updated weights for policy 0, policy_version 963336 (0.0007) [2023-12-28 02:10:42,690][106226] Updated weights for policy 0, policy_version 963346 (0.0010) [2023-12-28 02:10:42,758][106226] Updated weights for policy 0, policy_version 963356 (0.0011) [2023-12-28 02:10:42,931][106225] Updated weights for policy 1, policy_version 965544 (0.0011) [2023-12-28 02:10:42,997][106225] Updated weights for policy 1, policy_version 965554 (0.0011) [2023-12-28 02:10:43,060][106225] Updated weights for policy 1, policy_version 965564 (0.0010) [2023-12-28 02:10:43,478][106226] Updated weights for policy 0, policy_version 963366 (0.0009) [2023-12-28 02:10:43,536][106226] Updated weights for policy 0, policy_version 963376 (0.0007) [2023-12-28 02:10:43,594][106226] Updated weights for policy 0, policy_version 963386 (0.0009) [2023-12-28 02:10:43,707][106225] Updated weights for policy 1, policy_version 965574 (0.0005) [2023-12-28 02:10:43,769][106225] Updated weights for policy 1, policy_version 965584 (0.0006) [2023-12-28 02:10:43,824][106225] Updated weights for policy 1, policy_version 965594 (0.0007) [2023-12-28 02:10:44,283][106226] Updated weights for policy 0, policy_version 963396 (0.0006) [2023-12-28 02:10:44,345][106226] Updated weights for policy 0, policy_version 963406 (0.0006) [2023-12-28 02:10:44,417][106226] Updated weights for policy 0, policy_version 963416 (0.0009) [2023-12-28 02:10:44,443][106225] Updated weights for policy 1, policy_version 965604 (0.0005) [2023-12-28 02:10:44,500][106225] Updated weights for policy 1, policy_version 965614 (0.0005) [2023-12-28 02:10:44,556][106225] Updated weights for policy 1, policy_version 965624 (0.0005) [2023-12-28 02:10:45,040][106226] Updated weights for policy 0, policy_version 963426 (0.0009) [2023-12-28 02:10:45,104][106226] Updated weights for policy 0, policy_version 963436 (0.0009) [2023-12-28 02:10:45,168][106226] Updated weights for policy 0, policy_version 963446 (0.0008) [2023-12-28 02:10:45,209][106225] Updated weights for policy 1, policy_version 965634 (0.0006) [2023-12-28 02:10:45,224][106226] Updated weights for policy 0, policy_version 963456 (0.0007) [2023-12-28 02:10:45,267][106225] Updated weights for policy 1, policy_version 965644 (0.0007) [2023-12-28 02:10:45,327][106225] Updated weights for policy 1, policy_version 965654 (0.0009) [2023-12-28 02:10:45,375][106225] Updated weights for policy 1, policy_version 965664 (0.0008) [2023-12-28 02:10:45,942][106226] Updated weights for policy 0, policy_version 963466 (0.0008) [2023-12-28 02:10:46,003][106226] Updated weights for policy 0, policy_version 963476 (0.0007) [2023-12-28 02:10:46,063][106226] Updated weights for policy 0, policy_version 963486 (0.0009) [2023-12-28 02:10:46,113][106225] Updated weights for policy 1, policy_version 965674 (0.0005) [2023-12-28 02:10:46,173][106225] Updated weights for policy 1, policy_version 965684 (0.0005) [2023-12-28 02:10:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 493961216. Throughput: 0: 9968.2, 1: 9829.2. Samples: 493951544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:46,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-5.216')] [2023-12-28 02:10:46,234][106225] Updated weights for policy 1, policy_version 965694 (0.0007) [2023-12-28 02:10:46,687][106226] Updated weights for policy 0, policy_version 963496 (0.0006) [2023-12-28 02:10:46,737][106226] Updated weights for policy 0, policy_version 963506 (0.0009) [2023-12-28 02:10:46,786][106226] Updated weights for policy 0, policy_version 963516 (0.0008) [2023-12-28 02:10:46,916][106225] Updated weights for policy 1, policy_version 965704 (0.0008) [2023-12-28 02:10:46,974][106225] Updated weights for policy 1, policy_version 965714 (0.0008) [2023-12-28 02:10:47,031][106225] Updated weights for policy 1, policy_version 965724 (0.0009) [2023-12-28 02:10:47,473][106226] Updated weights for policy 0, policy_version 963526 (0.0006) [2023-12-28 02:10:47,536][106226] Updated weights for policy 0, policy_version 963536 (0.0011) [2023-12-28 02:10:47,599][106226] Updated weights for policy 0, policy_version 963546 (0.0006) [2023-12-28 02:10:47,787][106225] Updated weights for policy 1, policy_version 965734 (0.0009) [2023-12-28 02:10:47,851][106225] Updated weights for policy 1, policy_version 965744 (0.0008) [2023-12-28 02:10:47,907][106225] Updated weights for policy 1, policy_version 965754 (0.0006) [2023-12-28 02:10:48,150][106226] Updated weights for policy 0, policy_version 963556 (0.0007) [2023-12-28 02:10:48,205][106226] Updated weights for policy 0, policy_version 963566 (0.0008) [2023-12-28 02:10:48,263][106226] Updated weights for policy 0, policy_version 963576 (0.0008) [2023-12-28 02:10:48,518][106225] Updated weights for policy 1, policy_version 965764 (0.0005) [2023-12-28 02:10:48,588][106225] Updated weights for policy 1, policy_version 965774 (0.0007) [2023-12-28 02:10:48,649][106225] Updated weights for policy 1, policy_version 965784 (0.0008) [2023-12-28 02:10:49,017][106226] Updated weights for policy 0, policy_version 963586 (0.0008) [2023-12-28 02:10:49,066][106226] Updated weights for policy 0, policy_version 963596 (0.0009) [2023-12-28 02:10:49,122][106226] Updated weights for policy 0, policy_version 963606 (0.0009) [2023-12-28 02:10:49,180][106226] Updated weights for policy 0, policy_version 963616 (0.0008) [2023-12-28 02:10:49,355][106225] Updated weights for policy 1, policy_version 965794 (0.0008) [2023-12-28 02:10:49,414][106225] Updated weights for policy 1, policy_version 965804 (0.0008) [2023-12-28 02:10:49,466][106225] Updated weights for policy 1, policy_version 965814 (0.0008) [2023-12-28 02:10:49,521][106225] Updated weights for policy 1, policy_version 965824 (0.0008) [2023-12-28 02:10:49,896][106226] Updated weights for policy 0, policy_version 963626 (0.0008) [2023-12-28 02:10:49,960][106226] Updated weights for policy 0, policy_version 963636 (0.0008) [2023-12-28 02:10:50,032][106226] Updated weights for policy 0, policy_version 963646 (0.0009) [2023-12-28 02:10:50,340][106225] Updated weights for policy 1, policy_version 965834 (0.0008) [2023-12-28 02:10:50,402][106225] Updated weights for policy 1, policy_version 965844 (0.0009) [2023-12-28 02:10:50,470][106225] Updated weights for policy 1, policy_version 965854 (0.0009) [2023-12-28 02:10:50,759][106226] Updated weights for policy 0, policy_version 963656 (0.0008) [2023-12-28 02:10:50,818][106226] Updated weights for policy 0, policy_version 963666 (0.0006) [2023-12-28 02:10:50,878][106226] Updated weights for policy 0, policy_version 963676 (0.0005) [2023-12-28 02:10:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 494059520. Throughput: 0: 9944.3, 1: 9744.4. Samples: 494069400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:51,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-5.150')] [2023-12-28 02:10:51,251][106225] Updated weights for policy 1, policy_version 965864 (0.0009) [2023-12-28 02:10:51,307][106225] Updated weights for policy 1, policy_version 965874 (0.0008) [2023-12-28 02:10:51,364][106225] Updated weights for policy 1, policy_version 965884 (0.0009) [2023-12-28 02:10:51,580][106226] Updated weights for policy 0, policy_version 963686 (0.0007) [2023-12-28 02:10:51,645][106226] Updated weights for policy 0, policy_version 963696 (0.0008) [2023-12-28 02:10:51,716][106226] Updated weights for policy 0, policy_version 963706 (0.0008) [2023-12-28 02:10:52,135][106225] Updated weights for policy 1, policy_version 965894 (0.0009) [2023-12-28 02:10:52,182][106225] Updated weights for policy 1, policy_version 965904 (0.0008) [2023-12-28 02:10:52,240][106225] Updated weights for policy 1, policy_version 965914 (0.0007) [2023-12-28 02:10:52,504][106226] Updated weights for policy 0, policy_version 963716 (0.0009) [2023-12-28 02:10:52,575][106226] Updated weights for policy 0, policy_version 963726 (0.0009) [2023-12-28 02:10:52,647][106226] Updated weights for policy 0, policy_version 963736 (0.0011) [2023-12-28 02:10:53,016][106225] Updated weights for policy 1, policy_version 965924 (0.0009) [2023-12-28 02:10:53,071][106225] Updated weights for policy 1, policy_version 965934 (0.0007) [2023-12-28 02:10:53,125][106225] Updated weights for policy 1, policy_version 965944 (0.0008) [2023-12-28 02:10:53,265][106226] Updated weights for policy 0, policy_version 963746 (0.0011) [2023-12-28 02:10:53,326][106226] Updated weights for policy 0, policy_version 963756 (0.0010) [2023-12-28 02:10:53,390][106226] Updated weights for policy 0, policy_version 963766 (0.0011) [2023-12-28 02:10:53,452][106226] Updated weights for policy 0, policy_version 963776 (0.0011) [2023-12-28 02:10:53,921][106225] Updated weights for policy 1, policy_version 965954 (0.0007) [2023-12-28 02:10:53,967][106225] Updated weights for policy 1, policy_version 965964 (0.0007) [2023-12-28 02:10:54,016][106225] Updated weights for policy 1, policy_version 965974 (0.0007) [2023-12-28 02:10:54,056][106226] Updated weights for policy 0, policy_version 963786 (0.0010) [2023-12-28 02:10:54,069][106225] Updated weights for policy 1, policy_version 965984 (0.0006) [2023-12-28 02:10:54,122][106226] Updated weights for policy 0, policy_version 963796 (0.0011) [2023-12-28 02:10:54,168][106226] Updated weights for policy 0, policy_version 963806 (0.0010) [2023-12-28 02:10:54,809][106225] Updated weights for policy 1, policy_version 965994 (0.0007) [2023-12-28 02:10:54,858][106225] Updated weights for policy 1, policy_version 966004 (0.0007) [2023-12-28 02:10:54,901][106226] Updated weights for policy 0, policy_version 963816 (0.0008) [2023-12-28 02:10:54,914][106225] Updated weights for policy 1, policy_version 966014 (0.0006) [2023-12-28 02:10:54,969][106226] Updated weights for policy 0, policy_version 963826 (0.0009) [2023-12-28 02:10:55,040][106226] Updated weights for policy 0, policy_version 963836 (0.0006) [2023-12-28 02:10:55,567][106226] Updated weights for policy 0, policy_version 963846 (0.0005) [2023-12-28 02:10:55,618][106226] Updated weights for policy 0, policy_version 963856 (0.0005) [2023-12-28 02:10:55,676][106226] Updated weights for policy 0, policy_version 963866 (0.0008) [2023-12-28 02:10:55,697][106225] Updated weights for policy 1, policy_version 966024 (0.0006) [2023-12-28 02:10:55,743][106225] Updated weights for policy 1, policy_version 966034 (0.0008) [2023-12-28 02:10:55,790][106225] Updated weights for policy 1, policy_version 966044 (0.0008) [2023-12-28 02:10:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 494157824. Throughput: 0: 9919.8, 1: 9732.5. Samples: 494126660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:10:56,175][105115] Avg episode reward: [(0, '-4.830'), (1, '-5.224')] [2023-12-28 02:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000966048_247349248.pth... [2023-12-28 02:10:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000963872_246808576.pth... [2023-12-28 02:10:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000962688_246505472.pth [2023-12-28 02:10:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000964896_247054336.pth [2023-12-28 02:10:56,339][106226] Updated weights for policy 0, policy_version 963876 (0.0011) [2023-12-28 02:10:56,392][106226] Updated weights for policy 0, policy_version 963886 (0.0010) [2023-12-28 02:10:56,441][106226] Updated weights for policy 0, policy_version 963896 (0.0009) [2023-12-28 02:10:56,534][106225] Updated weights for policy 1, policy_version 966054 (0.0007) [2023-12-28 02:10:56,579][106225] Updated weights for policy 1, policy_version 966064 (0.0007) [2023-12-28 02:10:56,624][106225] Updated weights for policy 1, policy_version 966074 (0.0008) [2023-12-28 02:10:57,155][106226] Updated weights for policy 0, policy_version 963906 (0.0009) [2023-12-28 02:10:57,221][106226] Updated weights for policy 0, policy_version 963916 (0.0005) [2023-12-28 02:10:57,286][106226] Updated weights for policy 0, policy_version 963926 (0.0005) [2023-12-28 02:10:57,340][106226] Updated weights for policy 0, policy_version 963936 (0.0007) [2023-12-28 02:10:57,394][106225] Updated weights for policy 1, policy_version 966084 (0.0007) [2023-12-28 02:10:57,453][106225] Updated weights for policy 1, policy_version 966094 (0.0008) [2023-12-28 02:10:57,497][106225] Updated weights for policy 1, policy_version 966104 (0.0009) [2023-12-28 02:10:57,956][106226] Updated weights for policy 0, policy_version 963946 (0.0009) [2023-12-28 02:10:58,011][106226] Updated weights for policy 0, policy_version 963956 (0.0006) [2023-12-28 02:10:58,075][106226] Updated weights for policy 0, policy_version 963966 (0.0005) [2023-12-28 02:10:58,282][106225] Updated weights for policy 1, policy_version 966114 (0.0008) [2023-12-28 02:10:58,358][106225] Updated weights for policy 1, policy_version 966124 (0.0011) [2023-12-28 02:10:58,420][106225] Updated weights for policy 1, policy_version 966134 (0.0010) [2023-12-28 02:10:58,480][106225] Updated weights for policy 1, policy_version 966144 (0.0008) [2023-12-28 02:10:58,843][106226] Updated weights for policy 0, policy_version 963976 (0.0007) [2023-12-28 02:10:58,915][106226] Updated weights for policy 0, policy_version 963986 (0.0008) [2023-12-28 02:10:58,986][106226] Updated weights for policy 0, policy_version 963996 (0.0009) [2023-12-28 02:10:59,440][106225] Updated weights for policy 1, policy_version 966154 (0.0008) [2023-12-28 02:10:59,496][106225] Updated weights for policy 1, policy_version 966164 (0.0009) [2023-12-28 02:10:59,558][106225] Updated weights for policy 1, policy_version 966174 (0.0006) [2023-12-28 02:10:59,850][106226] Updated weights for policy 0, policy_version 964006 (0.0009) [2023-12-28 02:10:59,911][106226] Updated weights for policy 0, policy_version 964016 (0.0008) [2023-12-28 02:10:59,977][106226] Updated weights for policy 0, policy_version 964026 (0.0008) [2023-12-28 02:11:00,278][106225] Updated weights for policy 1, policy_version 966184 (0.0010) [2023-12-28 02:11:00,339][106225] Updated weights for policy 1, policy_version 966194 (0.0010) [2023-12-28 02:11:00,407][106225] Updated weights for policy 1, policy_version 966204 (0.0010) [2023-12-28 02:11:00,637][106226] Updated weights for policy 0, policy_version 964036 (0.0007) [2023-12-28 02:11:00,705][106226] Updated weights for policy 0, policy_version 964046 (0.0007) [2023-12-28 02:11:00,754][106226] Updated weights for policy 0, policy_version 964056 (0.0009) [2023-12-28 02:11:01,138][106225] Updated weights for policy 1, policy_version 966214 (0.0009) [2023-12-28 02:11:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 494247936. Throughput: 0: 9974.6, 1: 9655.0. Samples: 494239980. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:01,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.139')] [2023-12-28 02:11:01,197][106225] Updated weights for policy 1, policy_version 966224 (0.0006) [2023-12-28 02:11:01,256][106225] Updated weights for policy 1, policy_version 966234 (0.0006) [2023-12-28 02:11:01,510][106226] Updated weights for policy 0, policy_version 964066 (0.0008) [2023-12-28 02:11:01,568][106226] Updated weights for policy 0, policy_version 964076 (0.0009) [2023-12-28 02:11:01,637][106226] Updated weights for policy 0, policy_version 964086 (0.0010) [2023-12-28 02:11:01,692][106226] Updated weights for policy 0, policy_version 964096 (0.0009) [2023-12-28 02:11:01,948][106225] Updated weights for policy 1, policy_version 966244 (0.0007) [2023-12-28 02:11:01,997][106225] Updated weights for policy 1, policy_version 966254 (0.0008) [2023-12-28 02:11:02,046][106225] Updated weights for policy 1, policy_version 966264 (0.0008) [2023-12-28 02:11:02,462][106226] Updated weights for policy 0, policy_version 964106 (0.0008) [2023-12-28 02:11:02,530][106226] Updated weights for policy 0, policy_version 964116 (0.0008) [2023-12-28 02:11:02,596][106226] Updated weights for policy 0, policy_version 964126 (0.0008) [2023-12-28 02:11:02,725][106225] Updated weights for policy 1, policy_version 966274 (0.0008) [2023-12-28 02:11:02,790][106225] Updated weights for policy 1, policy_version 966284 (0.0006) [2023-12-28 02:11:02,847][106225] Updated weights for policy 1, policy_version 966294 (0.0005) [2023-12-28 02:11:02,906][106225] Updated weights for policy 1, policy_version 966304 (0.0008) [2023-12-28 02:11:03,282][106226] Updated weights for policy 0, policy_version 964136 (0.0009) [2023-12-28 02:11:03,349][106226] Updated weights for policy 0, policy_version 964146 (0.0010) [2023-12-28 02:11:03,407][106226] Updated weights for policy 0, policy_version 964156 (0.0009) [2023-12-28 02:11:03,427][106225] Updated weights for policy 1, policy_version 966314 (0.0006) [2023-12-28 02:11:03,479][106225] Updated weights for policy 1, policy_version 966324 (0.0006) [2023-12-28 02:11:03,526][106225] Updated weights for policy 1, policy_version 966334 (0.0005) [2023-12-28 02:11:04,089][106226] Updated weights for policy 0, policy_version 964166 (0.0008) [2023-12-28 02:11:04,153][106226] Updated weights for policy 0, policy_version 964176 (0.0008) [2023-12-28 02:11:04,209][106225] Updated weights for policy 1, policy_version 966344 (0.0007) [2023-12-28 02:11:04,215][106226] Updated weights for policy 0, policy_version 964186 (0.0007) [2023-12-28 02:11:04,267][106225] Updated weights for policy 1, policy_version 966354 (0.0006) [2023-12-28 02:11:04,332][106225] Updated weights for policy 1, policy_version 966364 (0.0007) [2023-12-28 02:11:04,933][106226] Updated weights for policy 0, policy_version 964196 (0.0008) [2023-12-28 02:11:04,991][106226] Updated weights for policy 0, policy_version 964206 (0.0008) [2023-12-28 02:11:05,042][106225] Updated weights for policy 1, policy_version 966374 (0.0007) [2023-12-28 02:11:05,048][106226] Updated weights for policy 0, policy_version 964216 (0.0007) [2023-12-28 02:11:05,096][106225] Updated weights for policy 1, policy_version 966384 (0.0006) [2023-12-28 02:11:05,161][106225] Updated weights for policy 1, policy_version 966394 (0.0008) [2023-12-28 02:11:05,773][106226] Updated weights for policy 0, policy_version 964226 (0.0009) [2023-12-28 02:11:05,822][106226] Updated weights for policy 0, policy_version 964236 (0.0010) [2023-12-28 02:11:05,844][106225] Updated weights for policy 1, policy_version 966404 (0.0007) [2023-12-28 02:11:05,892][106226] Updated weights for policy 0, policy_version 964246 (0.0009) [2023-12-28 02:11:05,899][106225] Updated weights for policy 1, policy_version 966414 (0.0005) [2023-12-28 02:11:05,955][106226] Updated weights for policy 0, policy_version 964256 (0.0008) [2023-12-28 02:11:05,957][106225] Updated weights for policy 1, policy_version 966424 (0.0006) [2023-12-28 02:11:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 494354432. Throughput: 0: 9960.7, 1: 9726.0. Samples: 494359088. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:06,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.161')] [2023-12-28 02:11:06,612][106225] Updated weights for policy 1, policy_version 966434 (0.0007) [2023-12-28 02:11:06,676][106225] Updated weights for policy 1, policy_version 966444 (0.0009) [2023-12-28 02:11:06,725][106226] Updated weights for policy 0, policy_version 964266 (0.0007) [2023-12-28 02:11:06,735][106225] Updated weights for policy 1, policy_version 966454 (0.0006) [2023-12-28 02:11:06,783][106226] Updated weights for policy 0, policy_version 964276 (0.0007) [2023-12-28 02:11:06,793][106225] Updated weights for policy 1, policy_version 966464 (0.0005) [2023-12-28 02:11:06,845][106226] Updated weights for policy 0, policy_version 964286 (0.0008) [2023-12-28 02:11:07,384][106225] Updated weights for policy 1, policy_version 966474 (0.0005) [2023-12-28 02:11:07,436][106225] Updated weights for policy 1, policy_version 966484 (0.0006) [2023-12-28 02:11:07,482][106225] Updated weights for policy 1, policy_version 966494 (0.0005) [2023-12-28 02:11:07,634][106226] Updated weights for policy 0, policy_version 964296 (0.0006) [2023-12-28 02:11:07,700][106226] Updated weights for policy 0, policy_version 964306 (0.0005) [2023-12-28 02:11:07,761][106226] Updated weights for policy 0, policy_version 964316 (0.0005) [2023-12-28 02:11:08,098][106225] Updated weights for policy 1, policy_version 966504 (0.0005) [2023-12-28 02:11:08,152][106225] Updated weights for policy 1, policy_version 966514 (0.0005) [2023-12-28 02:11:08,198][106225] Updated weights for policy 1, policy_version 966524 (0.0007) [2023-12-28 02:11:08,412][106226] Updated weights for policy 0, policy_version 964326 (0.0009) [2023-12-28 02:11:08,476][106226] Updated weights for policy 0, policy_version 964336 (0.0008) [2023-12-28 02:11:08,525][106226] Updated weights for policy 0, policy_version 964346 (0.0008) [2023-12-28 02:11:08,827][106225] Updated weights for policy 1, policy_version 966534 (0.0006) [2023-12-28 02:11:08,888][106225] Updated weights for policy 1, policy_version 966544 (0.0006) [2023-12-28 02:11:08,944][106225] Updated weights for policy 1, policy_version 966554 (0.0007) [2023-12-28 02:11:09,326][106226] Updated weights for policy 0, policy_version 964356 (0.0008) [2023-12-28 02:11:09,401][106226] Updated weights for policy 0, policy_version 964366 (0.0008) [2023-12-28 02:11:09,463][106226] Updated weights for policy 0, policy_version 964376 (0.0007) [2023-12-28 02:11:09,611][106225] Updated weights for policy 1, policy_version 966564 (0.0009) [2023-12-28 02:11:09,663][106225] Updated weights for policy 1, policy_version 966574 (0.0008) [2023-12-28 02:11:09,718][106225] Updated weights for policy 1, policy_version 966584 (0.0009) [2023-12-28 02:11:10,177][106226] Updated weights for policy 0, policy_version 964386 (0.0007) [2023-12-28 02:11:10,245][106226] Updated weights for policy 0, policy_version 964396 (0.0007) [2023-12-28 02:11:10,317][106226] Updated weights for policy 0, policy_version 964406 (0.0008) [2023-12-28 02:11:10,390][106226] Updated weights for policy 0, policy_version 964416 (0.0007) [2023-12-28 02:11:10,520][106225] Updated weights for policy 1, policy_version 966594 (0.0007) [2023-12-28 02:11:10,586][106225] Updated weights for policy 1, policy_version 966604 (0.0009) [2023-12-28 02:11:10,647][106225] Updated weights for policy 1, policy_version 966614 (0.0010) [2023-12-28 02:11:10,707][106225] Updated weights for policy 1, policy_version 966624 (0.0010) [2023-12-28 02:11:10,942][106226] Updated weights for policy 0, policy_version 964426 (0.0006) [2023-12-28 02:11:11,002][106226] Updated weights for policy 0, policy_version 964436 (0.0007) [2023-12-28 02:11:11,073][106226] Updated weights for policy 0, policy_version 964446 (0.0008) [2023-12-28 02:11:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 494452736. Throughput: 0: 9958.7, 1: 9848.7. Samples: 494420484. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:11,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.785')] [2023-12-28 02:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000964448_246956032.pth... [2023-12-28 02:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000966624_247496704.pth... [2023-12-28 02:11:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000965504_247209984.pth [2023-12-28 02:11:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000963296_246661120.pth [2023-12-28 02:11:11,414][106225] Updated weights for policy 1, policy_version 966634 (0.0009) [2023-12-28 02:11:11,481][106225] Updated weights for policy 1, policy_version 966644 (0.0008) [2023-12-28 02:11:11,548][106225] Updated weights for policy 1, policy_version 966654 (0.0010) [2023-12-28 02:11:11,774][106226] Updated weights for policy 0, policy_version 964456 (0.0007) [2023-12-28 02:11:11,835][106226] Updated weights for policy 0, policy_version 964466 (0.0009) [2023-12-28 02:11:11,906][106226] Updated weights for policy 0, policy_version 964476 (0.0006) [2023-12-28 02:11:12,342][106225] Updated weights for policy 1, policy_version 966664 (0.0008) [2023-12-28 02:11:12,405][106225] Updated weights for policy 1, policy_version 966674 (0.0008) [2023-12-28 02:11:12,470][106225] Updated weights for policy 1, policy_version 966684 (0.0008) [2023-12-28 02:11:12,607][106226] Updated weights for policy 0, policy_version 964486 (0.0008) [2023-12-28 02:11:12,668][106226] Updated weights for policy 0, policy_version 964496 (0.0009) [2023-12-28 02:11:12,734][106226] Updated weights for policy 0, policy_version 964506 (0.0008) [2023-12-28 02:11:13,206][106225] Updated weights for policy 1, policy_version 966694 (0.0009) [2023-12-28 02:11:13,265][106225] Updated weights for policy 1, policy_version 966705 (0.0009) [2023-12-28 02:11:13,327][106225] Updated weights for policy 1, policy_version 966715 (0.0008) [2023-12-28 02:11:13,439][106226] Updated weights for policy 0, policy_version 964516 (0.0007) [2023-12-28 02:11:13,496][106226] Updated weights for policy 0, policy_version 964526 (0.0005) [2023-12-28 02:11:13,559][106226] Updated weights for policy 0, policy_version 964536 (0.0005) [2023-12-28 02:11:14,121][106225] Updated weights for policy 1, policy_version 966725 (0.0008) [2023-12-28 02:11:14,144][106226] Updated weights for policy 0, policy_version 964546 (0.0005) [2023-12-28 02:11:14,177][106225] Updated weights for policy 1, policy_version 966735 (0.0008) [2023-12-28 02:11:14,198][106226] Updated weights for policy 0, policy_version 964556 (0.0005) [2023-12-28 02:11:14,235][106225] Updated weights for policy 1, policy_version 966745 (0.0006) [2023-12-28 02:11:14,260][106226] Updated weights for policy 0, policy_version 964566 (0.0007) [2023-12-28 02:11:14,313][106226] Updated weights for policy 0, policy_version 964576 (0.0007) [2023-12-28 02:11:14,959][106225] Updated weights for policy 1, policy_version 966755 (0.0007) [2023-12-28 02:11:15,014][106225] Updated weights for policy 1, policy_version 966765 (0.0008) [2023-12-28 02:11:15,062][106226] Updated weights for policy 0, policy_version 964586 (0.0006) [2023-12-28 02:11:15,076][106225] Updated weights for policy 1, policy_version 966775 (0.0007) [2023-12-28 02:11:15,119][106226] Updated weights for policy 0, policy_version 964596 (0.0007) [2023-12-28 02:11:15,179][106226] Updated weights for policy 0, policy_version 964606 (0.0008) [2023-12-28 02:11:15,803][106225] Updated weights for policy 1, policy_version 966785 (0.0010) [2023-12-28 02:11:15,861][106225] Updated weights for policy 1, policy_version 966795 (0.0009) [2023-12-28 02:11:15,890][106226] Updated weights for policy 0, policy_version 964616 (0.0006) [2023-12-28 02:11:15,918][106225] Updated weights for policy 1, policy_version 966805 (0.0008) [2023-12-28 02:11:15,951][106226] Updated weights for policy 0, policy_version 964626 (0.0007) [2023-12-28 02:11:15,980][106225] Updated weights for policy 1, policy_version 966815 (0.0007) [2023-12-28 02:11:16,007][106226] Updated weights for policy 0, policy_version 964636 (0.0007) [2023-12-28 02:11:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 494551040. Throughput: 0: 9950.0, 1: 9729.3. Samples: 494536724. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:16,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.089')] [2023-12-28 02:11:16,635][106225] Updated weights for policy 1, policy_version 966825 (0.0005) [2023-12-28 02:11:16,679][106225] Updated weights for policy 1, policy_version 966835 (0.0005) [2023-12-28 02:11:16,730][106225] Updated weights for policy 1, policy_version 966845 (0.0006) [2023-12-28 02:11:16,773][106226] Updated weights for policy 0, policy_version 964646 (0.0008) [2023-12-28 02:11:16,822][106226] Updated weights for policy 0, policy_version 964656 (0.0009) [2023-12-28 02:11:16,872][106226] Updated weights for policy 0, policy_version 964666 (0.0009) [2023-12-28 02:11:17,272][106225] Updated weights for policy 1, policy_version 966855 (0.0007) [2023-12-28 02:11:17,319][106225] Updated weights for policy 1, policy_version 966865 (0.0008) [2023-12-28 02:11:17,375][106225] Updated weights for policy 1, policy_version 966875 (0.0008) [2023-12-28 02:11:17,653][106226] Updated weights for policy 0, policy_version 964676 (0.0010) [2023-12-28 02:11:17,719][106226] Updated weights for policy 0, policy_version 964686 (0.0009) [2023-12-28 02:11:17,782][106226] Updated weights for policy 0, policy_version 964696 (0.0008) [2023-12-28 02:11:18,146][106225] Updated weights for policy 1, policy_version 966885 (0.0007) [2023-12-28 02:11:18,200][106225] Updated weights for policy 1, policy_version 966895 (0.0005) [2023-12-28 02:11:18,252][106225] Updated weights for policy 1, policy_version 966905 (0.0005) [2023-12-28 02:11:18,405][106226] Updated weights for policy 0, policy_version 964706 (0.0008) [2023-12-28 02:11:18,471][106226] Updated weights for policy 0, policy_version 964716 (0.0006) [2023-12-28 02:11:18,546][106226] Updated weights for policy 0, policy_version 964726 (0.0006) [2023-12-28 02:11:18,617][106226] Updated weights for policy 0, policy_version 964736 (0.0010) [2023-12-28 02:11:18,858][106225] Updated weights for policy 1, policy_version 966915 (0.0007) [2023-12-28 02:11:18,916][106225] Updated weights for policy 1, policy_version 966925 (0.0010) [2023-12-28 02:11:18,974][106225] Updated weights for policy 1, policy_version 966935 (0.0007) [2023-12-28 02:11:19,181][106226] Updated weights for policy 0, policy_version 964746 (0.0006) [2023-12-28 02:11:19,246][106226] Updated weights for policy 0, policy_version 964756 (0.0008) [2023-12-28 02:11:19,310][106226] Updated weights for policy 0, policy_version 964766 (0.0009) [2023-12-28 02:11:19,650][106225] Updated weights for policy 1, policy_version 966945 (0.0007) [2023-12-28 02:11:19,710][106225] Updated weights for policy 1, policy_version 966955 (0.0008) [2023-12-28 02:11:19,766][106225] Updated weights for policy 1, policy_version 966965 (0.0006) [2023-12-28 02:11:19,826][106225] Updated weights for policy 1, policy_version 966975 (0.0006) [2023-12-28 02:11:20,094][106226] Updated weights for policy 0, policy_version 964776 (0.0008) [2023-12-28 02:11:20,145][106226] Updated weights for policy 0, policy_version 964786 (0.0009) [2023-12-28 02:11:20,203][106226] Updated weights for policy 0, policy_version 964796 (0.0008) [2023-12-28 02:11:20,515][106225] Updated weights for policy 1, policy_version 966985 (0.0009) [2023-12-28 02:11:20,562][106225] Updated weights for policy 1, policy_version 966995 (0.0008) [2023-12-28 02:11:20,627][106225] Updated weights for policy 1, policy_version 967005 (0.0009) [2023-12-28 02:11:20,977][106226] Updated weights for policy 0, policy_version 964806 (0.0009) [2023-12-28 02:11:21,040][106226] Updated weights for policy 0, policy_version 964816 (0.0008) [2023-12-28 02:11:21,115][106226] Updated weights for policy 0, policy_version 964826 (0.0006) [2023-12-28 02:11:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 494649344. Throughput: 0: 9816.0, 1: 9775.4. Samples: 494655700. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:21,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-5.190')] [2023-12-28 02:11:21,472][106225] Updated weights for policy 1, policy_version 967015 (0.0008) [2023-12-28 02:11:21,534][106225] Updated weights for policy 1, policy_version 967025 (0.0006) [2023-12-28 02:11:21,591][106225] Updated weights for policy 1, policy_version 967035 (0.0005) [2023-12-28 02:11:21,878][106226] Updated weights for policy 0, policy_version 964836 (0.0008) [2023-12-28 02:11:21,946][106226] Updated weights for policy 0, policy_version 964846 (0.0008) [2023-12-28 02:11:22,008][106226] Updated weights for policy 0, policy_version 964856 (0.0008) [2023-12-28 02:11:22,325][106225] Updated weights for policy 1, policy_version 967045 (0.0009) [2023-12-28 02:11:22,409][106225] Updated weights for policy 1, policy_version 967055 (0.0007) [2023-12-28 02:11:22,478][106225] Updated weights for policy 1, policy_version 967065 (0.0008) [2023-12-28 02:11:22,807][106226] Updated weights for policy 0, policy_version 964866 (0.0009) [2023-12-28 02:11:22,870][106226] Updated weights for policy 0, policy_version 964876 (0.0009) [2023-12-28 02:11:22,937][106226] Updated weights for policy 0, policy_version 964886 (0.0009) [2023-12-28 02:11:22,992][106226] Updated weights for policy 0, policy_version 964896 (0.0009) [2023-12-28 02:11:23,140][106225] Updated weights for policy 1, policy_version 967075 (0.0009) [2023-12-28 02:11:23,203][106225] Updated weights for policy 1, policy_version 967085 (0.0009) [2023-12-28 02:11:23,260][106225] Updated weights for policy 1, policy_version 967095 (0.0008) [2023-12-28 02:11:23,754][106226] Updated weights for policy 0, policy_version 964906 (0.0009) [2023-12-28 02:11:23,807][106226] Updated weights for policy 0, policy_version 964916 (0.0008) [2023-12-28 02:11:23,866][106226] Updated weights for policy 0, policy_version 964926 (0.0008) [2023-12-28 02:11:23,927][106225] Updated weights for policy 1, policy_version 967105 (0.0009) [2023-12-28 02:11:23,989][106225] Updated weights for policy 1, policy_version 967115 (0.0008) [2023-12-28 02:11:24,048][106225] Updated weights for policy 1, policy_version 967125 (0.0008) [2023-12-28 02:11:24,114][106225] Updated weights for policy 1, policy_version 967135 (0.0009) [2023-12-28 02:11:24,592][106226] Updated weights for policy 0, policy_version 964936 (0.0010) [2023-12-28 02:11:24,653][106226] Updated weights for policy 0, policy_version 964946 (0.0011) [2023-12-28 02:11:24,721][106226] Updated weights for policy 0, policy_version 964956 (0.0009) [2023-12-28 02:11:24,818][106225] Updated weights for policy 1, policy_version 967145 (0.0005) [2023-12-28 02:11:24,878][106225] Updated weights for policy 1, policy_version 967155 (0.0007) [2023-12-28 02:11:24,944][106225] Updated weights for policy 1, policy_version 967165 (0.0010) [2023-12-28 02:11:25,289][106226] Updated weights for policy 0, policy_version 964966 (0.0008) [2023-12-28 02:11:25,350][106226] Updated weights for policy 0, policy_version 964976 (0.0008) [2023-12-28 02:11:25,397][106226] Updated weights for policy 0, policy_version 964986 (0.0005) [2023-12-28 02:11:25,522][106225] Updated weights for policy 1, policy_version 967175 (0.0007) [2023-12-28 02:11:25,567][106225] Updated weights for policy 1, policy_version 967185 (0.0007) [2023-12-28 02:11:25,617][106225] Updated weights for policy 1, policy_version 967195 (0.0005) [2023-12-28 02:11:26,062][106226] Updated weights for policy 0, policy_version 964996 (0.0007) [2023-12-28 02:11:26,116][106226] Updated weights for policy 0, policy_version 965006 (0.0011) [2023-12-28 02:11:26,163][106226] Updated weights for policy 0, policy_version 965016 (0.0011) [2023-12-28 02:11:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 494739456. Throughput: 0: 9764.2, 1: 9725.8. Samples: 494711372. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:26,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-5.034')] [2023-12-28 02:11:26,202][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000965024_247103488.pth... [2023-12-28 02:11:26,205][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000963872_246808576.pth [2023-12-28 02:11:26,207][106225] Updated weights for policy 1, policy_version 967205 (0.0005) [2023-12-28 02:11:26,265][106225] Updated weights for policy 1, policy_version 967215 (0.0007) [2023-12-28 02:11:26,322][106225] Updated weights for policy 1, policy_version 967225 (0.0007) [2023-12-28 02:11:26,357][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000967232_247652352.pth... [2023-12-28 02:11:26,361][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000966048_247349248.pth [2023-12-28 02:11:26,888][106226] Updated weights for policy 0, policy_version 965026 (0.0010) [2023-12-28 02:11:26,939][106225] Updated weights for policy 1, policy_version 967235 (0.0007) [2023-12-28 02:11:26,941][106226] Updated weights for policy 0, policy_version 965036 (0.0005) [2023-12-28 02:11:26,990][106226] Updated weights for policy 0, policy_version 965046 (0.0006) [2023-12-28 02:11:26,992][106225] Updated weights for policy 1, policy_version 967245 (0.0006) [2023-12-28 02:11:27,041][106226] Updated weights for policy 0, policy_version 965056 (0.0007) [2023-12-28 02:11:27,047][106225] Updated weights for policy 1, policy_version 967255 (0.0008) [2023-12-28 02:11:27,607][106225] Updated weights for policy 1, policy_version 967265 (0.0007) [2023-12-28 02:11:27,665][106225] Updated weights for policy 1, policy_version 967275 (0.0007) [2023-12-28 02:11:27,724][106225] Updated weights for policy 1, policy_version 967285 (0.0007) [2023-12-28 02:11:27,776][106225] Updated weights for policy 1, policy_version 967295 (0.0005) [2023-12-28 02:11:27,789][106226] Updated weights for policy 0, policy_version 965066 (0.0010) [2023-12-28 02:11:27,842][106226] Updated weights for policy 0, policy_version 965076 (0.0010) [2023-12-28 02:11:27,895][106226] Updated weights for policy 0, policy_version 965086 (0.0010) [2023-12-28 02:11:28,445][106225] Updated weights for policy 1, policy_version 967305 (0.0008) [2023-12-28 02:11:28,496][106225] Updated weights for policy 1, policy_version 967315 (0.0008) [2023-12-28 02:11:28,539][106225] Updated weights for policy 1, policy_version 967325 (0.0008) [2023-12-28 02:11:28,656][106226] Updated weights for policy 0, policy_version 965096 (0.0009) [2023-12-28 02:11:28,706][106226] Updated weights for policy 0, policy_version 965106 (0.0010) [2023-12-28 02:11:28,753][106226] Updated weights for policy 0, policy_version 965116 (0.0010) [2023-12-28 02:11:29,189][106225] Updated weights for policy 1, policy_version 967335 (0.0010) [2023-12-28 02:11:29,255][106225] Updated weights for policy 1, policy_version 967345 (0.0010) [2023-12-28 02:11:29,317][106225] Updated weights for policy 1, policy_version 967355 (0.0011) [2023-12-28 02:11:29,401][106226] Updated weights for policy 0, policy_version 965126 (0.0009) [2023-12-28 02:11:29,467][106226] Updated weights for policy 0, policy_version 965136 (0.0009) [2023-12-28 02:11:29,523][106226] Updated weights for policy 0, policy_version 965146 (0.0010) [2023-12-28 02:11:30,092][106225] Updated weights for policy 1, policy_version 967365 (0.0011) [2023-12-28 02:11:30,154][106225] Updated weights for policy 1, policy_version 967375 (0.0010) [2023-12-28 02:11:30,215][106225] Updated weights for policy 1, policy_version 967385 (0.0010) [2023-12-28 02:11:30,263][106226] Updated weights for policy 0, policy_version 965156 (0.0010) [2023-12-28 02:11:30,329][106226] Updated weights for policy 0, policy_version 965166 (0.0008) [2023-12-28 02:11:30,392][106226] Updated weights for policy 0, policy_version 965176 (0.0009) [2023-12-28 02:11:30,837][106225] Updated weights for policy 1, policy_version 967395 (0.0009) [2023-12-28 02:11:30,895][106225] Updated weights for policy 1, policy_version 967405 (0.0005) [2023-12-28 02:11:30,945][106225] Updated weights for policy 1, policy_version 967415 (0.0005) [2023-12-28 02:11:31,069][106226] Updated weights for policy 0, policy_version 965186 (0.0009) [2023-12-28 02:11:31,139][106226] Updated weights for policy 0, policy_version 965196 (0.0011) [2023-12-28 02:11:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 494845952. Throughput: 0: 9801.1, 1: 9868.0. Samples: 494836652. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:31,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-5.227')] [2023-12-28 02:11:31,192][106226] Updated weights for policy 0, policy_version 965206 (0.0011) [2023-12-28 02:11:31,250][106226] Updated weights for policy 0, policy_version 965216 (0.0011) [2023-12-28 02:11:31,640][106225] Updated weights for policy 1, policy_version 967425 (0.0006) [2023-12-28 02:11:31,708][106225] Updated weights for policy 1, policy_version 967435 (0.0008) [2023-12-28 02:11:31,768][106225] Updated weights for policy 1, policy_version 967445 (0.0009) [2023-12-28 02:11:31,824][106225] Updated weights for policy 1, policy_version 967455 (0.0008) [2023-12-28 02:11:31,955][106226] Updated weights for policy 0, policy_version 965226 (0.0008) [2023-12-28 02:11:32,016][106226] Updated weights for policy 0, policy_version 965236 (0.0006) [2023-12-28 02:11:32,074][106226] Updated weights for policy 0, policy_version 965246 (0.0008) [2023-12-28 02:11:32,541][106225] Updated weights for policy 1, policy_version 967465 (0.0010) [2023-12-28 02:11:32,608][106225] Updated weights for policy 1, policy_version 967475 (0.0011) [2023-12-28 02:11:32,662][106225] Updated weights for policy 1, policy_version 967485 (0.0010) [2023-12-28 02:11:32,794][106226] Updated weights for policy 0, policy_version 965256 (0.0009) [2023-12-28 02:11:32,842][106226] Updated weights for policy 0, policy_version 965266 (0.0008) [2023-12-28 02:11:32,896][106226] Updated weights for policy 0, policy_version 965276 (0.0008) [2023-12-28 02:11:33,381][106225] Updated weights for policy 1, policy_version 967495 (0.0010) [2023-12-28 02:11:33,440][106225] Updated weights for policy 1, policy_version 967505 (0.0010) [2023-12-28 02:11:33,505][106225] Updated weights for policy 1, policy_version 967515 (0.0010) [2023-12-28 02:11:33,604][106226] Updated weights for policy 0, policy_version 965286 (0.0006) [2023-12-28 02:11:33,666][106226] Updated weights for policy 0, policy_version 965296 (0.0006) [2023-12-28 02:11:33,720][106226] Updated weights for policy 0, policy_version 965306 (0.0006) [2023-12-28 02:11:34,054][106225] Updated weights for policy 1, policy_version 967525 (0.0005) [2023-12-28 02:11:34,099][106225] Updated weights for policy 1, policy_version 967535 (0.0006) [2023-12-28 02:11:34,155][106225] Updated weights for policy 1, policy_version 967545 (0.0008) [2023-12-28 02:11:34,265][106226] Updated weights for policy 0, policy_version 965316 (0.0006) [2023-12-28 02:11:34,329][106226] Updated weights for policy 0, policy_version 965326 (0.0007) [2023-12-28 02:11:34,394][106226] Updated weights for policy 0, policy_version 965336 (0.0008) [2023-12-28 02:11:34,818][106225] Updated weights for policy 1, policy_version 967555 (0.0009) [2023-12-28 02:11:34,877][106225] Updated weights for policy 1, policy_version 967565 (0.0005) [2023-12-28 02:11:34,940][106225] Updated weights for policy 1, policy_version 967575 (0.0005) [2023-12-28 02:11:35,152][106226] Updated weights for policy 0, policy_version 965346 (0.0007) [2023-12-28 02:11:35,211][106226] Updated weights for policy 0, policy_version 965356 (0.0008) [2023-12-28 02:11:35,265][106226] Updated weights for policy 0, policy_version 965366 (0.0008) [2023-12-28 02:11:35,315][106226] Updated weights for policy 0, policy_version 965376 (0.0007) [2023-12-28 02:11:35,529][106225] Updated weights for policy 1, policy_version 967585 (0.0006) [2023-12-28 02:11:35,594][106225] Updated weights for policy 1, policy_version 967595 (0.0005) [2023-12-28 02:11:35,644][106225] Updated weights for policy 1, policy_version 967605 (0.0010) [2023-12-28 02:11:35,697][106225] Updated weights for policy 1, policy_version 967615 (0.0010) [2023-12-28 02:11:35,899][106226] Updated weights for policy 0, policy_version 965386 (0.0005) [2023-12-28 02:11:35,959][106226] Updated weights for policy 0, policy_version 965396 (0.0005) [2023-12-28 02:11:36,019][106226] Updated weights for policy 0, policy_version 965406 (0.0005) [2023-12-28 02:11:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 494952448. Throughput: 0: 9828.4, 1: 9977.2. Samples: 494960652. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:36,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.996')] [2023-12-28 02:11:36,333][106225] Updated weights for policy 1, policy_version 967625 (0.0010) [2023-12-28 02:11:36,404][106225] Updated weights for policy 1, policy_version 967635 (0.0011) [2023-12-28 02:11:36,466][106225] Updated weights for policy 1, policy_version 967645 (0.0007) [2023-12-28 02:11:36,690][106226] Updated weights for policy 0, policy_version 965416 (0.0006) [2023-12-28 02:11:36,761][106226] Updated weights for policy 0, policy_version 965426 (0.0006) [2023-12-28 02:11:36,829][106226] Updated weights for policy 0, policy_version 965436 (0.0006) [2023-12-28 02:11:37,036][106225] Updated weights for policy 1, policy_version 967655 (0.0007) [2023-12-28 02:11:37,090][106225] Updated weights for policy 1, policy_version 967665 (0.0005) [2023-12-28 02:11:37,143][106225] Updated weights for policy 1, policy_version 967675 (0.0005) [2023-12-28 02:11:37,366][106226] Updated weights for policy 0, policy_version 965446 (0.0006) [2023-12-28 02:11:37,430][106226] Updated weights for policy 0, policy_version 965456 (0.0006) [2023-12-28 02:11:37,491][106226] Updated weights for policy 0, policy_version 965466 (0.0006) [2023-12-28 02:11:37,719][106225] Updated weights for policy 1, policy_version 967685 (0.0005) [2023-12-28 02:11:37,789][106225] Updated weights for policy 1, policy_version 967695 (0.0005) [2023-12-28 02:11:37,842][106225] Updated weights for policy 1, policy_version 967705 (0.0005) [2023-12-28 02:11:38,142][106226] Updated weights for policy 0, policy_version 965476 (0.0006) [2023-12-28 02:11:38,193][106226] Updated weights for policy 0, policy_version 965486 (0.0005) [2023-12-28 02:11:38,253][106226] Updated weights for policy 0, policy_version 965496 (0.0005) [2023-12-28 02:11:38,482][106225] Updated weights for policy 1, policy_version 967715 (0.0009) [2023-12-28 02:11:38,547][106225] Updated weights for policy 1, policy_version 967725 (0.0011) [2023-12-28 02:11:38,601][106225] Updated weights for policy 1, policy_version 967735 (0.0010) [2023-12-28 02:11:38,897][106226] Updated weights for policy 0, policy_version 965506 (0.0006) [2023-12-28 02:11:38,957][106226] Updated weights for policy 0, policy_version 965516 (0.0008) [2023-12-28 02:11:39,014][106226] Updated weights for policy 0, policy_version 965526 (0.0008) [2023-12-28 02:11:39,060][106226] Updated weights for policy 0, policy_version 965536 (0.0007) [2023-12-28 02:11:39,260][106225] Updated weights for policy 1, policy_version 967745 (0.0010) [2023-12-28 02:11:39,323][106225] Updated weights for policy 1, policy_version 967755 (0.0010) [2023-12-28 02:11:39,394][106225] Updated weights for policy 1, policy_version 967765 (0.0009) [2023-12-28 02:11:39,463][106225] Updated weights for policy 1, policy_version 967775 (0.0009) [2023-12-28 02:11:39,869][106226] Updated weights for policy 0, policy_version 965546 (0.0008) [2023-12-28 02:11:39,927][106226] Updated weights for policy 0, policy_version 965556 (0.0006) [2023-12-28 02:11:39,995][106226] Updated weights for policy 0, policy_version 965566 (0.0007) [2023-12-28 02:11:40,247][106225] Updated weights for policy 1, policy_version 967785 (0.0009) [2023-12-28 02:11:40,309][106225] Updated weights for policy 1, policy_version 967795 (0.0008) [2023-12-28 02:11:40,370][106225] Updated weights for policy 1, policy_version 967805 (0.0008) [2023-12-28 02:11:40,689][106226] Updated weights for policy 0, policy_version 965576 (0.0008) [2023-12-28 02:11:40,749][106226] Updated weights for policy 0, policy_version 965586 (0.0009) [2023-12-28 02:11:40,805][106226] Updated weights for policy 0, policy_version 965596 (0.0008) [2023-12-28 02:11:41,041][106225] Updated weights for policy 1, policy_version 967815 (0.0008) [2023-12-28 02:11:41,102][106225] Updated weights for policy 1, policy_version 967825 (0.0009) [2023-12-28 02:11:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 495050752. Throughput: 0: 9867.2, 1: 10096.0. Samples: 495025004. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:41,175][105115] Avg episode reward: [(0, '-4.835'), (1, '-5.268')] [2023-12-28 02:11:41,179][106225] Updated weights for policy 1, policy_version 967835 (0.0010) [2023-12-28 02:11:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000965600_247250944.pth... [2023-12-28 02:11:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000964448_246956032.pth [2023-12-28 02:11:41,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000967840_247808000.pth... [2023-12-28 02:11:41,212][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000966624_247496704.pth [2023-12-28 02:11:41,623][106226] Updated weights for policy 0, policy_version 965606 (0.0009) [2023-12-28 02:11:41,687][106226] Updated weights for policy 0, policy_version 965616 (0.0008) [2023-12-28 02:11:41,761][106226] Updated weights for policy 0, policy_version 965626 (0.0008) [2023-12-28 02:11:41,934][106225] Updated weights for policy 1, policy_version 967845 (0.0008) [2023-12-28 02:11:41,994][106225] Updated weights for policy 1, policy_version 967855 (0.0009) [2023-12-28 02:11:42,045][106225] Updated weights for policy 1, policy_version 967865 (0.0008) [2023-12-28 02:11:42,399][106226] Updated weights for policy 0, policy_version 965636 (0.0007) [2023-12-28 02:11:42,460][106226] Updated weights for policy 0, policy_version 965646 (0.0008) [2023-12-28 02:11:42,528][106226] Updated weights for policy 0, policy_version 965656 (0.0007) [2023-12-28 02:11:42,864][106225] Updated weights for policy 1, policy_version 967875 (0.0009) [2023-12-28 02:11:42,921][106225] Updated weights for policy 1, policy_version 967885 (0.0010) [2023-12-28 02:11:42,984][106225] Updated weights for policy 1, policy_version 967895 (0.0008) [2023-12-28 02:11:43,151][106226] Updated weights for policy 0, policy_version 965666 (0.0008) [2023-12-28 02:11:43,202][106226] Updated weights for policy 0, policy_version 965676 (0.0006) [2023-12-28 02:11:43,255][106226] Updated weights for policy 0, policy_version 965686 (0.0005) [2023-12-28 02:11:43,306][106226] Updated weights for policy 0, policy_version 965696 (0.0005) [2023-12-28 02:11:43,776][106225] Updated weights for policy 1, policy_version 967905 (0.0007) [2023-12-28 02:11:43,835][106225] Updated weights for policy 1, policy_version 967915 (0.0005) [2023-12-28 02:11:43,897][106225] Updated weights for policy 1, policy_version 967925 (0.0005) [2023-12-28 02:11:43,951][106225] Updated weights for policy 1, policy_version 967935 (0.0005) [2023-12-28 02:11:43,951][106226] Updated weights for policy 0, policy_version 965706 (0.0009) [2023-12-28 02:11:44,000][106226] Updated weights for policy 0, policy_version 965716 (0.0009) [2023-12-28 02:11:44,050][106226] Updated weights for policy 0, policy_version 965726 (0.0009) [2023-12-28 02:11:44,450][106225] Updated weights for policy 1, policy_version 967945 (0.0005) [2023-12-28 02:11:44,515][106225] Updated weights for policy 1, policy_version 967955 (0.0005) [2023-12-28 02:11:44,578][106225] Updated weights for policy 1, policy_version 967965 (0.0008) [2023-12-28 02:11:44,864][106226] Updated weights for policy 0, policy_version 965736 (0.0008) [2023-12-28 02:11:44,928][106226] Updated weights for policy 0, policy_version 965746 (0.0008) [2023-12-28 02:11:44,998][106226] Updated weights for policy 0, policy_version 965756 (0.0009) [2023-12-28 02:11:45,272][106225] Updated weights for policy 1, policy_version 967975 (0.0010) [2023-12-28 02:11:45,338][106225] Updated weights for policy 1, policy_version 967985 (0.0011) [2023-12-28 02:11:45,398][106225] Updated weights for policy 1, policy_version 967995 (0.0010) [2023-12-28 02:11:45,733][106226] Updated weights for policy 0, policy_version 965766 (0.0008) [2023-12-28 02:11:45,786][106226] Updated weights for policy 0, policy_version 965776 (0.0008) [2023-12-28 02:11:45,836][106226] Updated weights for policy 0, policy_version 965786 (0.0008) [2023-12-28 02:11:46,100][106225] Updated weights for policy 1, policy_version 968005 (0.0010) [2023-12-28 02:11:46,149][106225] Updated weights for policy 1, policy_version 968015 (0.0010) [2023-12-28 02:11:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 495149056. Throughput: 0: 9840.1, 1: 10195.4. Samples: 495141576. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:46,176][105115] Avg episode reward: [(0, '-4.873'), (1, '-4.985')] [2023-12-28 02:11:46,199][106225] Updated weights for policy 1, policy_version 968025 (0.0010) [2023-12-28 02:11:46,580][106226] Updated weights for policy 0, policy_version 965796 (0.0008) [2023-12-28 02:11:46,638][106226] Updated weights for policy 0, policy_version 965806 (0.0008) [2023-12-28 02:11:46,691][106226] Updated weights for policy 0, policy_version 965816 (0.0008) [2023-12-28 02:11:46,918][106225] Updated weights for policy 1, policy_version 968035 (0.0010) [2023-12-28 02:11:46,968][106225] Updated weights for policy 1, policy_version 968045 (0.0010) [2023-12-28 02:11:47,024][106225] Updated weights for policy 1, policy_version 968055 (0.0010) [2023-12-28 02:11:47,422][106226] Updated weights for policy 0, policy_version 965826 (0.0008) [2023-12-28 02:11:47,495][106226] Updated weights for policy 0, policy_version 965836 (0.0008) [2023-12-28 02:11:47,551][106226] Updated weights for policy 0, policy_version 965846 (0.0008) [2023-12-28 02:11:47,605][106226] Updated weights for policy 0, policy_version 965856 (0.0008) [2023-12-28 02:11:47,748][106225] Updated weights for policy 1, policy_version 968065 (0.0010) [2023-12-28 02:11:47,805][106225] Updated weights for policy 1, policy_version 968075 (0.0009) [2023-12-28 02:11:47,870][106225] Updated weights for policy 1, policy_version 968085 (0.0009) [2023-12-28 02:11:47,926][106225] Updated weights for policy 1, policy_version 968095 (0.0010) [2023-12-28 02:11:48,342][106226] Updated weights for policy 0, policy_version 965866 (0.0009) [2023-12-28 02:11:48,399][106226] Updated weights for policy 0, policy_version 965876 (0.0008) [2023-12-28 02:11:48,450][106226] Updated weights for policy 0, policy_version 965886 (0.0008) [2023-12-28 02:11:48,688][106225] Updated weights for policy 1, policy_version 968105 (0.0010) [2023-12-28 02:11:48,746][106225] Updated weights for policy 1, policy_version 968115 (0.0010) [2023-12-28 02:11:48,813][106225] Updated weights for policy 1, policy_version 968125 (0.0010) [2023-12-28 02:11:49,196][106226] Updated weights for policy 0, policy_version 965896 (0.0007) [2023-12-28 02:11:49,258][106226] Updated weights for policy 0, policy_version 965906 (0.0010) [2023-12-28 02:11:49,311][106226] Updated weights for policy 0, policy_version 965916 (0.0009) [2023-12-28 02:11:49,527][106225] Updated weights for policy 1, policy_version 968135 (0.0010) [2023-12-28 02:11:49,587][106225] Updated weights for policy 1, policy_version 968145 (0.0010) [2023-12-28 02:11:49,648][106225] Updated weights for policy 1, policy_version 968155 (0.0011) [2023-12-28 02:11:50,092][106226] Updated weights for policy 0, policy_version 965926 (0.0008) [2023-12-28 02:11:50,157][106226] Updated weights for policy 0, policy_version 965936 (0.0008) [2023-12-28 02:11:50,219][106226] Updated weights for policy 0, policy_version 965946 (0.0008) [2023-12-28 02:11:50,398][106225] Updated weights for policy 1, policy_version 968165 (0.0010) [2023-12-28 02:11:50,459][106225] Updated weights for policy 1, policy_version 968175 (0.0010) [2023-12-28 02:11:50,522][106225] Updated weights for policy 1, policy_version 968185 (0.0010) [2023-12-28 02:11:50,969][106226] Updated weights for policy 0, policy_version 965956 (0.0008) [2023-12-28 02:11:51,024][106226] Updated weights for policy 0, policy_version 965966 (0.0008) [2023-12-28 02:11:51,085][106226] Updated weights for policy 0, policy_version 965976 (0.0008) [2023-12-28 02:11:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 495247360. Throughput: 0: 9795.7, 1: 10114.0. Samples: 495255028. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:51,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-4.988')] [2023-12-28 02:11:51,276][106225] Updated weights for policy 1, policy_version 968195 (0.0009) [2023-12-28 02:11:51,332][106225] Updated weights for policy 1, policy_version 968205 (0.0010) [2023-12-28 02:11:51,405][106225] Updated weights for policy 1, policy_version 968215 (0.0010) [2023-12-28 02:11:51,860][106226] Updated weights for policy 0, policy_version 965986 (0.0008) [2023-12-28 02:11:51,920][106226] Updated weights for policy 0, policy_version 965996 (0.0008) [2023-12-28 02:11:51,983][106226] Updated weights for policy 0, policy_version 966006 (0.0008) [2023-12-28 02:11:52,049][106226] Updated weights for policy 0, policy_version 966016 (0.0007) [2023-12-28 02:11:52,127][106225] Updated weights for policy 1, policy_version 968225 (0.0011) [2023-12-28 02:11:52,190][106225] Updated weights for policy 1, policy_version 968235 (0.0011) [2023-12-28 02:11:52,257][106225] Updated weights for policy 1, policy_version 968245 (0.0010) [2023-12-28 02:11:52,324][106225] Updated weights for policy 1, policy_version 968255 (0.0009) [2023-12-28 02:11:52,808][106226] Updated weights for policy 0, policy_version 966026 (0.0009) [2023-12-28 02:11:52,867][106226] Updated weights for policy 0, policy_version 966036 (0.0008) [2023-12-28 02:11:52,925][106226] Updated weights for policy 0, policy_version 966046 (0.0006) [2023-12-28 02:11:53,016][106225] Updated weights for policy 1, policy_version 968265 (0.0009) [2023-12-28 02:11:53,079][106225] Updated weights for policy 1, policy_version 968275 (0.0008) [2023-12-28 02:11:53,147][106225] Updated weights for policy 1, policy_version 968285 (0.0008) [2023-12-28 02:11:53,574][106226] Updated weights for policy 0, policy_version 966056 (0.0008) [2023-12-28 02:11:53,630][106226] Updated weights for policy 0, policy_version 966066 (0.0008) [2023-12-28 02:11:53,677][106226] Updated weights for policy 0, policy_version 966076 (0.0008) [2023-12-28 02:11:53,815][106225] Updated weights for policy 1, policy_version 968295 (0.0008) [2023-12-28 02:11:53,873][106225] Updated weights for policy 1, policy_version 968305 (0.0009) [2023-12-28 02:11:53,928][106225] Updated weights for policy 1, policy_version 968315 (0.0008) [2023-12-28 02:11:54,388][106226] Updated weights for policy 0, policy_version 966086 (0.0008) [2023-12-28 02:11:54,435][106226] Updated weights for policy 0, policy_version 966096 (0.0008) [2023-12-28 02:11:54,490][106226] Updated weights for policy 0, policy_version 966106 (0.0008) [2023-12-28 02:11:54,686][106225] Updated weights for policy 1, policy_version 968325 (0.0008) [2023-12-28 02:11:54,743][106225] Updated weights for policy 1, policy_version 968335 (0.0009) [2023-12-28 02:11:54,818][106225] Updated weights for policy 1, policy_version 968345 (0.0008) [2023-12-28 02:11:55,231][106226] Updated weights for policy 0, policy_version 966116 (0.0009) [2023-12-28 02:11:55,291][106226] Updated weights for policy 0, policy_version 966126 (0.0010) [2023-12-28 02:11:55,354][106226] Updated weights for policy 0, policy_version 966136 (0.0011) [2023-12-28 02:11:55,454][106225] Updated weights for policy 1, policy_version 968355 (0.0007) [2023-12-28 02:11:55,504][106225] Updated weights for policy 1, policy_version 968365 (0.0005) [2023-12-28 02:11:55,557][106225] Updated weights for policy 1, policy_version 968375 (0.0005) [2023-12-28 02:11:56,069][106226] Updated weights for policy 0, policy_version 966146 (0.0011) [2023-12-28 02:11:56,128][106226] Updated weights for policy 0, policy_version 966156 (0.0010) [2023-12-28 02:11:56,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 495337472. Throughput: 0: 9799.8, 1: 10021.6. Samples: 495312448. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:11:56,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-5.494')] [2023-12-28 02:11:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000968384_247947264.pth... [2023-12-28 02:11:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000967232_247652352.pth [2023-12-28 02:11:56,186][106226] Updated weights for policy 0, policy_version 966166 (0.0011) [2023-12-28 02:11:56,247][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000966176_247398400.pth... [2023-12-28 02:11:56,250][106226] Updated weights for policy 0, policy_version 966176 (0.0010) [2023-12-28 02:11:56,251][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000965024_247103488.pth [2023-12-28 02:11:56,267][106225] Updated weights for policy 1, policy_version 968385 (0.0008) [2023-12-28 02:11:56,316][106225] Updated weights for policy 1, policy_version 968395 (0.0007) [2023-12-28 02:11:56,363][106225] Updated weights for policy 1, policy_version 968405 (0.0007) [2023-12-28 02:11:56,418][106225] Updated weights for policy 1, policy_version 968415 (0.0008) [2023-12-28 02:11:56,825][106226] Updated weights for policy 0, policy_version 966186 (0.0005) [2023-12-28 02:11:56,877][106226] Updated weights for policy 0, policy_version 966196 (0.0005) [2023-12-28 02:11:56,923][106226] Updated weights for policy 0, policy_version 966206 (0.0006) [2023-12-28 02:11:57,288][106225] Updated weights for policy 1, policy_version 968425 (0.0009) [2023-12-28 02:11:57,339][106225] Updated weights for policy 1, policy_version 968435 (0.0008) [2023-12-28 02:11:57,391][106225] Updated weights for policy 1, policy_version 968445 (0.0007) [2023-12-28 02:11:57,461][106226] Updated weights for policy 0, policy_version 966216 (0.0009) [2023-12-28 02:11:57,524][106226] Updated weights for policy 0, policy_version 966226 (0.0010) [2023-12-28 02:11:57,580][106226] Updated weights for policy 0, policy_version 966236 (0.0010) [2023-12-28 02:11:58,121][106225] Updated weights for policy 1, policy_version 968455 (0.0005) [2023-12-28 02:11:58,180][106225] Updated weights for policy 1, policy_version 968465 (0.0005) [2023-12-28 02:11:58,253][106225] Updated weights for policy 1, policy_version 968475 (0.0006) [2023-12-28 02:11:58,287][106226] Updated weights for policy 0, policy_version 966246 (0.0009) [2023-12-28 02:11:58,352][106226] Updated weights for policy 0, policy_version 966256 (0.0007) [2023-12-28 02:11:58,435][106226] Updated weights for policy 0, policy_version 966266 (0.0008) [2023-12-28 02:11:59,079][106225] Updated weights for policy 1, policy_version 968485 (0.0006) [2023-12-28 02:11:59,145][106225] Updated weights for policy 1, policy_version 968495 (0.0007) [2023-12-28 02:11:59,206][106225] Updated weights for policy 1, policy_version 968505 (0.0009) [2023-12-28 02:11:59,257][106226] Updated weights for policy 0, policy_version 966276 (0.0009) [2023-12-28 02:11:59,322][106226] Updated weights for policy 0, policy_version 966286 (0.0009) [2023-12-28 02:11:59,387][106226] Updated weights for policy 0, policy_version 966296 (0.0009) [2023-12-28 02:11:59,944][106225] Updated weights for policy 1, policy_version 968515 (0.0008) [2023-12-28 02:12:00,004][106225] Updated weights for policy 1, policy_version 968525 (0.0008) [2023-12-28 02:12:00,064][106225] Updated weights for policy 1, policy_version 968535 (0.0008) [2023-12-28 02:12:00,105][106226] Updated weights for policy 0, policy_version 966306 (0.0006) [2023-12-28 02:12:00,167][106226] Updated weights for policy 0, policy_version 966316 (0.0008) [2023-12-28 02:12:00,218][106226] Updated weights for policy 0, policy_version 966326 (0.0009) [2023-12-28 02:12:00,271][106226] Updated weights for policy 0, policy_version 966336 (0.0009) [2023-12-28 02:12:00,791][106225] Updated weights for policy 1, policy_version 968545 (0.0008) [2023-12-28 02:12:00,853][106225] Updated weights for policy 1, policy_version 968555 (0.0008) [2023-12-28 02:12:00,909][106225] Updated weights for policy 1, policy_version 968565 (0.0008) [2023-12-28 02:12:00,965][106225] Updated weights for policy 1, policy_version 968575 (0.0007) [2023-12-28 02:12:00,992][106226] Updated weights for policy 0, policy_version 966346 (0.0007) [2023-12-28 02:12:01,064][106226] Updated weights for policy 0, policy_version 966356 (0.0008) [2023-12-28 02:12:01,131][106226] Updated weights for policy 0, policy_version 966366 (0.0007) [2023-12-28 02:12:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 495443968. Throughput: 0: 9805.0, 1: 10020.7. Samples: 495428880. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:01,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.157')] [2023-12-28 02:12:01,746][106225] Updated weights for policy 1, policy_version 968585 (0.0008) [2023-12-28 02:12:01,804][106225] Updated weights for policy 1, policy_version 968595 (0.0008) [2023-12-28 02:12:01,861][106225] Updated weights for policy 1, policy_version 968605 (0.0008) [2023-12-28 02:12:01,900][106226] Updated weights for policy 0, policy_version 966376 (0.0010) [2023-12-28 02:12:01,955][106226] Updated weights for policy 0, policy_version 966386 (0.0008) [2023-12-28 02:12:02,020][106226] Updated weights for policy 0, policy_version 966396 (0.0010) [2023-12-28 02:12:02,611][106225] Updated weights for policy 1, policy_version 968615 (0.0008) [2023-12-28 02:12:02,670][106225] Updated weights for policy 1, policy_version 968625 (0.0008) [2023-12-28 02:12:02,728][106225] Updated weights for policy 1, policy_version 968635 (0.0007) [2023-12-28 02:12:02,749][106226] Updated weights for policy 0, policy_version 966406 (0.0009) [2023-12-28 02:12:02,795][106226] Updated weights for policy 0, policy_version 966416 (0.0010) [2023-12-28 02:12:02,842][106226] Updated weights for policy 0, policy_version 966426 (0.0010) [2023-12-28 02:12:03,358][106225] Updated weights for policy 1, policy_version 968645 (0.0008) [2023-12-28 02:12:03,421][106225] Updated weights for policy 1, policy_version 968655 (0.0010) [2023-12-28 02:12:03,484][106225] Updated weights for policy 1, policy_version 968665 (0.0010) [2023-12-28 02:12:03,580][106226] Updated weights for policy 0, policy_version 966436 (0.0011) [2023-12-28 02:12:03,637][106226] Updated weights for policy 0, policy_version 966446 (0.0010) [2023-12-28 02:12:03,696][106226] Updated weights for policy 0, policy_version 966456 (0.0010) [2023-12-28 02:12:04,129][106225] Updated weights for policy 1, policy_version 968675 (0.0010) [2023-12-28 02:12:04,196][106225] Updated weights for policy 1, policy_version 968685 (0.0011) [2023-12-28 02:12:04,260][106225] Updated weights for policy 1, policy_version 968695 (0.0010) [2023-12-28 02:12:04,447][106226] Updated weights for policy 0, policy_version 966466 (0.0010) [2023-12-28 02:12:04,507][106226] Updated weights for policy 0, policy_version 966476 (0.0011) [2023-12-28 02:12:04,567][106226] Updated weights for policy 0, policy_version 966486 (0.0010) [2023-12-28 02:12:04,628][106226] Updated weights for policy 0, policy_version 966496 (0.0010) [2023-12-28 02:12:04,978][106225] Updated weights for policy 1, policy_version 968705 (0.0011) [2023-12-28 02:12:05,027][106225] Updated weights for policy 1, policy_version 968715 (0.0007) [2023-12-28 02:12:05,078][106225] Updated weights for policy 1, policy_version 968725 (0.0010) [2023-12-28 02:12:05,124][106225] Updated weights for policy 1, policy_version 968735 (0.0010) [2023-12-28 02:12:05,213][106226] Updated weights for policy 0, policy_version 966506 (0.0010) [2023-12-28 02:12:05,272][106226] Updated weights for policy 0, policy_version 966516 (0.0010) [2023-12-28 02:12:05,328][106226] Updated weights for policy 0, policy_version 966526 (0.0010) [2023-12-28 02:12:05,873][106225] Updated weights for policy 1, policy_version 968745 (0.0010) [2023-12-28 02:12:05,939][106225] Updated weights for policy 1, policy_version 968755 (0.0010) [2023-12-28 02:12:05,996][106225] Updated weights for policy 1, policy_version 968765 (0.0010) [2023-12-28 02:12:06,038][106226] Updated weights for policy 0, policy_version 966536 (0.0010) [2023-12-28 02:12:06,102][106226] Updated weights for policy 0, policy_version 966546 (0.0009) [2023-12-28 02:12:06,166][106226] Updated weights for policy 0, policy_version 966556 (0.0008) [2023-12-28 02:12:06,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 495534080. Throughput: 0: 9819.4, 1: 9955.9. Samples: 495545592. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:06,177][105115] Avg episode reward: [(0, '-4.563'), (1, '-5.145')] [2023-12-28 02:12:06,712][106225] Updated weights for policy 1, policy_version 968775 (0.0009) [2023-12-28 02:12:06,778][106225] Updated weights for policy 1, policy_version 968785 (0.0009) [2023-12-28 02:12:06,830][106225] Updated weights for policy 1, policy_version 968795 (0.0008) [2023-12-28 02:12:06,898][106226] Updated weights for policy 0, policy_version 966566 (0.0007) [2023-12-28 02:12:06,948][106226] Updated weights for policy 0, policy_version 966576 (0.0008) [2023-12-28 02:12:07,000][106226] Updated weights for policy 0, policy_version 966586 (0.0005) [2023-12-28 02:12:07,526][106225] Updated weights for policy 1, policy_version 968805 (0.0007) [2023-12-28 02:12:07,589][106225] Updated weights for policy 1, policy_version 968815 (0.0005) [2023-12-28 02:12:07,652][106225] Updated weights for policy 1, policy_version 968825 (0.0006) [2023-12-28 02:12:07,678][106226] Updated weights for policy 0, policy_version 966596 (0.0006) [2023-12-28 02:12:07,738][106226] Updated weights for policy 0, policy_version 966606 (0.0009) [2023-12-28 02:12:07,786][106226] Updated weights for policy 0, policy_version 966616 (0.0008) [2023-12-28 02:12:08,233][106225] Updated weights for policy 1, policy_version 968835 (0.0006) [2023-12-28 02:12:08,293][106225] Updated weights for policy 1, policy_version 968845 (0.0008) [2023-12-28 02:12:08,357][106225] Updated weights for policy 1, policy_version 968855 (0.0008) [2023-12-28 02:12:08,583][106226] Updated weights for policy 0, policy_version 966626 (0.0009) [2023-12-28 02:12:08,644][106226] Updated weights for policy 0, policy_version 966636 (0.0009) [2023-12-28 02:12:08,706][106226] Updated weights for policy 0, policy_version 966646 (0.0007) [2023-12-28 02:12:08,756][106226] Updated weights for policy 0, policy_version 966656 (0.0008) [2023-12-28 02:12:08,979][106225] Updated weights for policy 1, policy_version 968865 (0.0006) [2023-12-28 02:12:09,032][106225] Updated weights for policy 1, policy_version 968875 (0.0006) [2023-12-28 02:12:09,083][106225] Updated weights for policy 1, policy_version 968885 (0.0005) [2023-12-28 02:12:09,132][106225] Updated weights for policy 1, policy_version 968895 (0.0005) [2023-12-28 02:12:09,591][106226] Updated weights for policy 0, policy_version 966666 (0.0008) [2023-12-28 02:12:09,652][106226] Updated weights for policy 0, policy_version 966676 (0.0007) [2023-12-28 02:12:09,717][106226] Updated weights for policy 0, policy_version 966686 (0.0008) [2023-12-28 02:12:09,857][106225] Updated weights for policy 1, policy_version 968905 (0.0010) [2023-12-28 02:12:09,916][106225] Updated weights for policy 1, policy_version 968915 (0.0010) [2023-12-28 02:12:09,986][106225] Updated weights for policy 1, policy_version 968925 (0.0008) [2023-12-28 02:12:10,512][106226] Updated weights for policy 0, policy_version 966696 (0.0008) [2023-12-28 02:12:10,553][106225] Updated weights for policy 1, policy_version 968935 (0.0006) [2023-12-28 02:12:10,567][106226] Updated weights for policy 0, policy_version 966706 (0.0007) [2023-12-28 02:12:10,610][106225] Updated weights for policy 1, policy_version 968945 (0.0006) [2023-12-28 02:12:10,615][106226] Updated weights for policy 0, policy_version 966716 (0.0007) [2023-12-28 02:12:10,671][106225] Updated weights for policy 1, policy_version 968955 (0.0008) [2023-12-28 02:12:11,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 495632384. Throughput: 0: 9841.6, 1: 10000.3. Samples: 495604260. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:11,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.990')] [2023-12-28 02:12:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000968960_248094720.pth... [2023-12-28 02:12:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000966720_247537664.pth... [2023-12-28 02:12:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000965600_247250944.pth [2023-12-28 02:12:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000967840_247808000.pth [2023-12-28 02:12:11,409][106225] Updated weights for policy 1, policy_version 968965 (0.0009) [2023-12-28 02:12:11,423][106226] Updated weights for policy 0, policy_version 966726 (0.0007) [2023-12-28 02:12:11,474][106225] Updated weights for policy 1, policy_version 968975 (0.0007) [2023-12-28 02:12:11,483][106226] Updated weights for policy 0, policy_version 966736 (0.0009) [2023-12-28 02:12:11,529][106225] Updated weights for policy 1, policy_version 968985 (0.0006) [2023-12-28 02:12:11,539][106226] Updated weights for policy 0, policy_version 966746 (0.0008) [2023-12-28 02:12:12,242][106225] Updated weights for policy 1, policy_version 968995 (0.0007) [2023-12-28 02:12:12,281][106226] Updated weights for policy 0, policy_version 966756 (0.0008) [2023-12-28 02:12:12,306][106225] Updated weights for policy 1, policy_version 969005 (0.0007) [2023-12-28 02:12:12,340][106226] Updated weights for policy 0, policy_version 966766 (0.0009) [2023-12-28 02:12:12,370][106225] Updated weights for policy 1, policy_version 969015 (0.0007) [2023-12-28 02:12:12,407][106226] Updated weights for policy 0, policy_version 966776 (0.0008) [2023-12-28 02:12:13,075][106226] Updated weights for policy 0, policy_version 966786 (0.0007) [2023-12-28 02:12:13,121][106226] Updated weights for policy 0, policy_version 966796 (0.0008) [2023-12-28 02:12:13,128][106225] Updated weights for policy 1, policy_version 969025 (0.0007) [2023-12-28 02:12:13,176][106226] Updated weights for policy 0, policy_version 966806 (0.0006) [2023-12-28 02:12:13,185][106225] Updated weights for policy 1, policy_version 969035 (0.0010) [2023-12-28 02:12:13,225][106226] Updated weights for policy 0, policy_version 966816 (0.0006) [2023-12-28 02:12:13,241][106225] Updated weights for policy 1, policy_version 969045 (0.0010) [2023-12-28 02:12:13,296][106225] Updated weights for policy 1, policy_version 969055 (0.0010) [2023-12-28 02:12:13,867][106225] Updated weights for policy 1, policy_version 969065 (0.0005) [2023-12-28 02:12:13,886][106226] Updated weights for policy 0, policy_version 966826 (0.0011) [2023-12-28 02:12:13,923][106225] Updated weights for policy 1, policy_version 969075 (0.0005) [2023-12-28 02:12:13,944][106226] Updated weights for policy 0, policy_version 966836 (0.0011) [2023-12-28 02:12:13,977][106225] Updated weights for policy 1, policy_version 969085 (0.0005) [2023-12-28 02:12:14,005][106226] Updated weights for policy 0, policy_version 966846 (0.0011) [2023-12-28 02:12:14,520][106225] Updated weights for policy 1, policy_version 969095 (0.0007) [2023-12-28 02:12:14,572][106225] Updated weights for policy 1, policy_version 969105 (0.0009) [2023-12-28 02:12:14,628][106225] Updated weights for policy 1, policy_version 969115 (0.0008) [2023-12-28 02:12:14,682][106226] Updated weights for policy 0, policy_version 966856 (0.0008) [2023-12-28 02:12:14,739][106226] Updated weights for policy 0, policy_version 966866 (0.0008) [2023-12-28 02:12:14,807][106226] Updated weights for policy 0, policy_version 966876 (0.0008) [2023-12-28 02:12:15,419][106225] Updated weights for policy 1, policy_version 969125 (0.0007) [2023-12-28 02:12:15,472][106225] Updated weights for policy 1, policy_version 969135 (0.0009) [2023-12-28 02:12:15,484][106226] Updated weights for policy 0, policy_version 966886 (0.0005) [2023-12-28 02:12:15,523][106225] Updated weights for policy 1, policy_version 969145 (0.0007) [2023-12-28 02:12:15,537][106226] Updated weights for policy 0, policy_version 966896 (0.0006) [2023-12-28 02:12:15,587][106226] Updated weights for policy 0, policy_version 966906 (0.0008) [2023-12-28 02:12:16,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 495730688. Throughput: 0: 9779.1, 1: 9929.7. Samples: 495723548. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:16,175][105115] Avg episode reward: [(0, '-5.067'), (1, '-4.986')] [2023-12-28 02:12:16,189][106225] Updated weights for policy 1, policy_version 969155 (0.0007) [2023-12-28 02:12:16,250][106225] Updated weights for policy 1, policy_version 969165 (0.0009) [2023-12-28 02:12:16,310][106225] Updated weights for policy 1, policy_version 969175 (0.0006) [2023-12-28 02:12:16,345][106226] Updated weights for policy 0, policy_version 966916 (0.0008) [2023-12-28 02:12:16,404][106226] Updated weights for policy 0, policy_version 966926 (0.0009) [2023-12-28 02:12:16,459][106226] Updated weights for policy 0, policy_version 966936 (0.0008) [2023-12-28 02:12:16,975][106225] Updated weights for policy 1, policy_version 969185 (0.0006) [2023-12-28 02:12:17,030][106225] Updated weights for policy 1, policy_version 969195 (0.0008) [2023-12-28 02:12:17,086][106225] Updated weights for policy 1, policy_version 969205 (0.0009) [2023-12-28 02:12:17,144][106225] Updated weights for policy 1, policy_version 969215 (0.0008) [2023-12-28 02:12:17,199][106226] Updated weights for policy 0, policy_version 966946 (0.0009) [2023-12-28 02:12:17,254][106226] Updated weights for policy 0, policy_version 966956 (0.0008) [2023-12-28 02:12:17,315][106226] Updated weights for policy 0, policy_version 966966 (0.0009) [2023-12-28 02:12:17,374][106226] Updated weights for policy 0, policy_version 966976 (0.0007) [2023-12-28 02:12:17,786][106225] Updated weights for policy 1, policy_version 969225 (0.0007) [2023-12-28 02:12:17,845][106225] Updated weights for policy 1, policy_version 969235 (0.0005) [2023-12-28 02:12:17,893][106225] Updated weights for policy 1, policy_version 969245 (0.0005) [2023-12-28 02:12:18,166][106226] Updated weights for policy 0, policy_version 966986 (0.0008) [2023-12-28 02:12:18,227][106226] Updated weights for policy 0, policy_version 966996 (0.0009) [2023-12-28 02:12:18,291][106226] Updated weights for policy 0, policy_version 967006 (0.0008) [2023-12-28 02:12:18,562][106225] Updated weights for policy 1, policy_version 969255 (0.0007) [2023-12-28 02:12:18,625][106225] Updated weights for policy 1, policy_version 969265 (0.0009) [2023-12-28 02:12:18,684][106225] Updated weights for policy 1, policy_version 969275 (0.0008) [2023-12-28 02:12:19,043][106226] Updated weights for policy 0, policy_version 967016 (0.0009) [2023-12-28 02:12:19,104][106226] Updated weights for policy 0, policy_version 967026 (0.0009) [2023-12-28 02:12:19,163][106226] Updated weights for policy 0, policy_version 967036 (0.0009) [2023-12-28 02:12:19,378][106225] Updated weights for policy 1, policy_version 969285 (0.0009) [2023-12-28 02:12:19,438][106225] Updated weights for policy 1, policy_version 969295 (0.0009) [2023-12-28 02:12:19,499][106225] Updated weights for policy 1, policy_version 969305 (0.0009) [2023-12-28 02:12:19,942][106226] Updated weights for policy 0, policy_version 967046 (0.0008) [2023-12-28 02:12:20,012][106226] Updated weights for policy 0, policy_version 967056 (0.0007) [2023-12-28 02:12:20,078][106226] Updated weights for policy 0, policy_version 967066 (0.0008) [2023-12-28 02:12:20,298][106225] Updated weights for policy 1, policy_version 969315 (0.0008) [2023-12-28 02:12:20,359][106225] Updated weights for policy 1, policy_version 969325 (0.0009) [2023-12-28 02:12:20,424][106225] Updated weights for policy 1, policy_version 969335 (0.0010) [2023-12-28 02:12:20,816][106226] Updated weights for policy 0, policy_version 967076 (0.0007) [2023-12-28 02:12:20,888][106226] Updated weights for policy 0, policy_version 967086 (0.0006) [2023-12-28 02:12:20,951][106226] Updated weights for policy 0, policy_version 967096 (0.0008) [2023-12-28 02:12:21,113][106225] Updated weights for policy 1, policy_version 969345 (0.0010) [2023-12-28 02:12:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 495828992. Throughput: 0: 9637.9, 1: 9870.2. Samples: 495838516. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:21,175][105115] Avg episode reward: [(0, '-4.938'), (1, '-5.163')] [2023-12-28 02:12:21,182][106225] Updated weights for policy 1, policy_version 969355 (0.0011) [2023-12-28 02:12:21,246][106225] Updated weights for policy 1, policy_version 969365 (0.0011) [2023-12-28 02:12:21,314][106225] Updated weights for policy 1, policy_version 969375 (0.0008) [2023-12-28 02:12:21,631][106226] Updated weights for policy 0, policy_version 967106 (0.0007) [2023-12-28 02:12:21,692][106226] Updated weights for policy 0, policy_version 967116 (0.0010) [2023-12-28 02:12:21,765][106226] Updated weights for policy 0, policy_version 967126 (0.0009) [2023-12-28 02:12:21,833][106226] Updated weights for policy 0, policy_version 967136 (0.0009) [2023-12-28 02:12:22,006][106225] Updated weights for policy 1, policy_version 969385 (0.0007) [2023-12-28 02:12:22,071][106225] Updated weights for policy 1, policy_version 969395 (0.0011) [2023-12-28 02:12:22,133][106225] Updated weights for policy 1, policy_version 969405 (0.0011) [2023-12-28 02:12:22,594][106226] Updated weights for policy 0, policy_version 967146 (0.0008) [2023-12-28 02:12:22,657][106226] Updated weights for policy 0, policy_version 967156 (0.0009) [2023-12-28 02:12:22,716][106226] Updated weights for policy 0, policy_version 967166 (0.0008) [2023-12-28 02:12:22,858][106225] Updated weights for policy 1, policy_version 969415 (0.0010) [2023-12-28 02:12:22,916][106225] Updated weights for policy 1, policy_version 969425 (0.0009) [2023-12-28 02:12:22,975][106225] Updated weights for policy 1, policy_version 969435 (0.0005) [2023-12-28 02:12:23,473][106226] Updated weights for policy 0, policy_version 967176 (0.0008) [2023-12-28 02:12:23,531][106226] Updated weights for policy 0, policy_version 967186 (0.0008) [2023-12-28 02:12:23,585][106226] Updated weights for policy 0, policy_version 967196 (0.0009) [2023-12-28 02:12:23,642][106225] Updated weights for policy 1, policy_version 969445 (0.0007) [2023-12-28 02:12:23,688][106225] Updated weights for policy 1, policy_version 969455 (0.0005) [2023-12-28 02:12:23,736][106225] Updated weights for policy 1, policy_version 969465 (0.0005) [2023-12-28 02:12:24,337][106225] Updated weights for policy 1, policy_version 969475 (0.0006) [2023-12-28 02:12:24,347][106226] Updated weights for policy 0, policy_version 967206 (0.0007) [2023-12-28 02:12:24,395][106225] Updated weights for policy 1, policy_version 969485 (0.0007) [2023-12-28 02:12:24,405][106226] Updated weights for policy 0, policy_version 967216 (0.0006) [2023-12-28 02:12:24,457][106225] Updated weights for policy 1, policy_version 969495 (0.0010) [2023-12-28 02:12:24,467][106226] Updated weights for policy 0, policy_version 967226 (0.0005) [2023-12-28 02:12:25,088][106225] Updated weights for policy 1, policy_version 969505 (0.0010) [2023-12-28 02:12:25,150][106225] Updated weights for policy 1, policy_version 969515 (0.0005) [2023-12-28 02:12:25,205][106225] Updated weights for policy 1, policy_version 969525 (0.0008) [2023-12-28 02:12:25,234][106226] Updated weights for policy 0, policy_version 967236 (0.0007) [2023-12-28 02:12:25,256][106225] Updated weights for policy 1, policy_version 969535 (0.0009) [2023-12-28 02:12:25,285][106226] Updated weights for policy 0, policy_version 967246 (0.0007) [2023-12-28 02:12:25,332][106226] Updated weights for policy 0, policy_version 967256 (0.0009) [2023-12-28 02:12:25,906][106225] Updated weights for policy 1, policy_version 969545 (0.0008) [2023-12-28 02:12:25,954][106225] Updated weights for policy 1, policy_version 969555 (0.0008) [2023-12-28 02:12:26,009][106225] Updated weights for policy 1, policy_version 969565 (0.0008) [2023-12-28 02:12:26,070][106226] Updated weights for policy 0, policy_version 967266 (0.0009) [2023-12-28 02:12:26,124][106226] Updated weights for policy 0, policy_version 967276 (0.0009) [2023-12-28 02:12:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 495927296. Throughput: 0: 9545.3, 1: 9793.4. Samples: 495895248. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:26,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.307')] [2023-12-28 02:12:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000969568_248250368.pth... [2023-12-28 02:12:26,184][106226] Updated weights for policy 0, policy_version 967286 (0.0009) [2023-12-28 02:12:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000968384_247947264.pth [2023-12-28 02:12:26,244][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000967296_247685120.pth... [2023-12-28 02:12:26,247][106226] Updated weights for policy 0, policy_version 967296 (0.0009) [2023-12-28 02:12:26,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000966176_247398400.pth [2023-12-28 02:12:26,637][106225] Updated weights for policy 1, policy_version 969575 (0.0006) [2023-12-28 02:12:26,705][106225] Updated weights for policy 1, policy_version 969585 (0.0005) [2023-12-28 02:12:26,753][106225] Updated weights for policy 1, policy_version 969595 (0.0008) [2023-12-28 02:12:27,092][106226] Updated weights for policy 0, policy_version 967306 (0.0008) [2023-12-28 02:12:27,149][106226] Updated weights for policy 0, policy_version 967316 (0.0010) [2023-12-28 02:12:27,208][106226] Updated weights for policy 0, policy_version 967326 (0.0009) [2023-12-28 02:12:27,350][106225] Updated weights for policy 1, policy_version 969605 (0.0007) [2023-12-28 02:12:27,405][106225] Updated weights for policy 1, policy_version 969615 (0.0007) [2023-12-28 02:12:27,460][106225] Updated weights for policy 1, policy_version 969625 (0.0006) [2023-12-28 02:12:27,900][106226] Updated weights for policy 0, policy_version 967336 (0.0007) [2023-12-28 02:12:27,947][106226] Updated weights for policy 0, policy_version 967346 (0.0005) [2023-12-28 02:12:27,998][106226] Updated weights for policy 0, policy_version 967356 (0.0005) [2023-12-28 02:12:28,095][106225] Updated weights for policy 1, policy_version 969635 (0.0006) [2023-12-28 02:12:28,156][106225] Updated weights for policy 1, policy_version 969645 (0.0005) [2023-12-28 02:12:28,207][106225] Updated weights for policy 1, policy_version 969655 (0.0005) [2023-12-28 02:12:28,602][106226] Updated weights for policy 0, policy_version 967366 (0.0007) [2023-12-28 02:12:28,663][106226] Updated weights for policy 0, policy_version 967376 (0.0008) [2023-12-28 02:12:28,719][106226] Updated weights for policy 0, policy_version 967386 (0.0006) [2023-12-28 02:12:28,795][106225] Updated weights for policy 1, policy_version 969665 (0.0006) [2023-12-28 02:12:28,858][106225] Updated weights for policy 1, policy_version 969675 (0.0010) [2023-12-28 02:12:28,915][106225] Updated weights for policy 1, policy_version 969685 (0.0010) [2023-12-28 02:12:28,975][106225] Updated weights for policy 1, policy_version 969695 (0.0010) [2023-12-28 02:12:29,402][106226] Updated weights for policy 0, policy_version 967396 (0.0006) [2023-12-28 02:12:29,455][106226] Updated weights for policy 0, policy_version 967406 (0.0006) [2023-12-28 02:12:29,512][106226] Updated weights for policy 0, policy_version 967416 (0.0009) [2023-12-28 02:12:29,601][106225] Updated weights for policy 1, policy_version 969705 (0.0007) [2023-12-28 02:12:29,672][106225] Updated weights for policy 1, policy_version 969715 (0.0008) [2023-12-28 02:12:29,735][106225] Updated weights for policy 1, policy_version 969725 (0.0008) [2023-12-28 02:12:30,254][106226] Updated weights for policy 0, policy_version 967426 (0.0009) [2023-12-28 02:12:30,321][106226] Updated weights for policy 0, policy_version 967436 (0.0011) [2023-12-28 02:12:30,383][106226] Updated weights for policy 0, policy_version 967446 (0.0007) [2023-12-28 02:12:30,397][106225] Updated weights for policy 1, policy_version 969735 (0.0005) [2023-12-28 02:12:30,436][106226] Updated weights for policy 0, policy_version 967456 (0.0005) [2023-12-28 02:12:30,452][106225] Updated weights for policy 1, policy_version 969745 (0.0008) [2023-12-28 02:12:30,509][106225] Updated weights for policy 1, policy_version 969755 (0.0010) [2023-12-28 02:12:31,139][106226] Updated weights for policy 0, policy_version 967466 (0.0008) [2023-12-28 02:12:31,166][106225] Updated weights for policy 1, policy_version 969765 (0.0010) [2023-12-28 02:12:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 496025600. Throughput: 0: 9556.0, 1: 9953.8. Samples: 496019516. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:31,175][105115] Avg episode reward: [(0, '-4.954'), (1, '-4.865')] [2023-12-28 02:12:31,204][106226] Updated weights for policy 0, policy_version 967476 (0.0007) [2023-12-28 02:12:31,236][106225] Updated weights for policy 1, policy_version 969775 (0.0007) [2023-12-28 02:12:31,270][106226] Updated weights for policy 0, policy_version 967486 (0.0007) [2023-12-28 02:12:31,309][106225] Updated weights for policy 1, policy_version 969785 (0.0009) [2023-12-28 02:12:31,985][106226] Updated weights for policy 0, policy_version 967496 (0.0008) [2023-12-28 02:12:32,049][106226] Updated weights for policy 0, policy_version 967506 (0.0008) [2023-12-28 02:12:32,051][106225] Updated weights for policy 1, policy_version 969795 (0.0008) [2023-12-28 02:12:32,110][106225] Updated weights for policy 1, policy_version 969805 (0.0008) [2023-12-28 02:12:32,117][106226] Updated weights for policy 0, policy_version 967516 (0.0007) [2023-12-28 02:12:32,172][106225] Updated weights for policy 1, policy_version 969815 (0.0005) [2023-12-28 02:12:32,793][106226] Updated weights for policy 0, policy_version 967526 (0.0008) [2023-12-28 02:12:32,846][106226] Updated weights for policy 0, policy_version 967536 (0.0009) [2023-12-28 02:12:32,874][106225] Updated weights for policy 1, policy_version 969825 (0.0006) [2023-12-28 02:12:32,901][106226] Updated weights for policy 0, policy_version 967546 (0.0007) [2023-12-28 02:12:32,935][106225] Updated weights for policy 1, policy_version 969835 (0.0007) [2023-12-28 02:12:32,995][106225] Updated weights for policy 1, policy_version 969845 (0.0005) [2023-12-28 02:12:33,052][106225] Updated weights for policy 1, policy_version 969855 (0.0005) [2023-12-28 02:12:33,565][106226] Updated weights for policy 0, policy_version 967556 (0.0007) [2023-12-28 02:12:33,626][106226] Updated weights for policy 0, policy_version 967566 (0.0007) [2023-12-28 02:12:33,684][106226] Updated weights for policy 0, policy_version 967576 (0.0008) [2023-12-28 02:12:33,712][106225] Updated weights for policy 1, policy_version 969865 (0.0005) [2023-12-28 02:12:33,758][106225] Updated weights for policy 1, policy_version 969875 (0.0005) [2023-12-28 02:12:33,807][106225] Updated weights for policy 1, policy_version 969885 (0.0005) [2023-12-28 02:12:34,380][106226] Updated weights for policy 0, policy_version 967586 (0.0007) [2023-12-28 02:12:34,402][106225] Updated weights for policy 1, policy_version 969895 (0.0007) [2023-12-28 02:12:34,440][106226] Updated weights for policy 0, policy_version 967596 (0.0007) [2023-12-28 02:12:34,469][106225] Updated weights for policy 1, policy_version 969905 (0.0011) [2023-12-28 02:12:34,499][106226] Updated weights for policy 0, policy_version 967606 (0.0006) [2023-12-28 02:12:34,531][106225] Updated weights for policy 1, policy_version 969915 (0.0010) [2023-12-28 02:12:34,564][106226] Updated weights for policy 0, policy_version 967616 (0.0006) [2023-12-28 02:12:35,188][106225] Updated weights for policy 1, policy_version 969925 (0.0007) [2023-12-28 02:12:35,231][106226] Updated weights for policy 0, policy_version 967626 (0.0008) [2023-12-28 02:12:35,236][106225] Updated weights for policy 1, policy_version 969935 (0.0005) [2023-12-28 02:12:35,282][106225] Updated weights for policy 1, policy_version 969945 (0.0005) [2023-12-28 02:12:35,290][106226] Updated weights for policy 0, policy_version 967636 (0.0008) [2023-12-28 02:12:35,355][106226] Updated weights for policy 0, policy_version 967646 (0.0008) [2023-12-28 02:12:35,851][106225] Updated weights for policy 1, policy_version 969955 (0.0006) [2023-12-28 02:12:35,911][106225] Updated weights for policy 1, policy_version 969965 (0.0006) [2023-12-28 02:12:35,978][106225] Updated weights for policy 1, policy_version 969975 (0.0005) [2023-12-28 02:12:36,115][106226] Updated weights for policy 0, policy_version 967656 (0.0006) [2023-12-28 02:12:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 496132096. Throughput: 0: 9621.2, 1: 10065.2. Samples: 496140920. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:36,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.184')] [2023-12-28 02:12:36,176][106226] Updated weights for policy 0, policy_version 967666 (0.0008) [2023-12-28 02:12:36,224][106226] Updated weights for policy 0, policy_version 967676 (0.0008) [2023-12-28 02:12:36,618][106225] Updated weights for policy 1, policy_version 969985 (0.0007) [2023-12-28 02:12:36,683][106225] Updated weights for policy 1, policy_version 969995 (0.0009) [2023-12-28 02:12:36,739][106225] Updated weights for policy 1, policy_version 970005 (0.0009) [2023-12-28 02:12:36,804][106225] Updated weights for policy 1, policy_version 970015 (0.0008) [2023-12-28 02:12:36,976][106226] Updated weights for policy 0, policy_version 967686 (0.0008) [2023-12-28 02:12:37,023][106226] Updated weights for policy 0, policy_version 967696 (0.0008) [2023-12-28 02:12:37,080][106226] Updated weights for policy 0, policy_version 967706 (0.0008) [2023-12-28 02:12:37,503][106225] Updated weights for policy 1, policy_version 970025 (0.0007) [2023-12-28 02:12:37,559][106225] Updated weights for policy 1, policy_version 970035 (0.0007) [2023-12-28 02:12:37,605][106225] Updated weights for policy 1, policy_version 970045 (0.0005) [2023-12-28 02:12:37,818][106226] Updated weights for policy 0, policy_version 967716 (0.0007) [2023-12-28 02:12:37,865][106226] Updated weights for policy 0, policy_version 967726 (0.0005) [2023-12-28 02:12:37,914][106226] Updated weights for policy 0, policy_version 967736 (0.0005) [2023-12-28 02:12:38,205][106225] Updated weights for policy 1, policy_version 970055 (0.0006) [2023-12-28 02:12:38,269][106225] Updated weights for policy 1, policy_version 970065 (0.0005) [2023-12-28 02:12:38,357][106225] Updated weights for policy 1, policy_version 970075 (0.0006) [2023-12-28 02:12:38,573][106226] Updated weights for policy 0, policy_version 967746 (0.0009) [2023-12-28 02:12:38,641][106226] Updated weights for policy 0, policy_version 967756 (0.0011) [2023-12-28 02:12:38,709][106226] Updated weights for policy 0, policy_version 967766 (0.0011) [2023-12-28 02:12:38,776][106226] Updated weights for policy 0, policy_version 967776 (0.0010) [2023-12-28 02:12:38,952][106225] Updated weights for policy 1, policy_version 970085 (0.0006) [2023-12-28 02:12:39,014][106225] Updated weights for policy 1, policy_version 970095 (0.0007) [2023-12-28 02:12:39,062][106225] Updated weights for policy 1, policy_version 970105 (0.0005) [2023-12-28 02:12:39,480][106226] Updated weights for policy 0, policy_version 967786 (0.0007) [2023-12-28 02:12:39,545][106226] Updated weights for policy 0, policy_version 967796 (0.0008) [2023-12-28 02:12:39,608][106226] Updated weights for policy 0, policy_version 967806 (0.0008) [2023-12-28 02:12:39,734][106225] Updated weights for policy 1, policy_version 970115 (0.0006) [2023-12-28 02:12:39,786][106225] Updated weights for policy 1, policy_version 970125 (0.0008) [2023-12-28 02:12:39,850][106225] Updated weights for policy 1, policy_version 970135 (0.0007) [2023-12-28 02:12:40,393][106226] Updated weights for policy 0, policy_version 967816 (0.0008) [2023-12-28 02:12:40,461][106226] Updated weights for policy 0, policy_version 967826 (0.0007) [2023-12-28 02:12:40,532][106226] Updated weights for policy 0, policy_version 967836 (0.0005) [2023-12-28 02:12:40,587][106225] Updated weights for policy 1, policy_version 970145 (0.0007) [2023-12-28 02:12:40,648][106225] Updated weights for policy 1, policy_version 970155 (0.0008) [2023-12-28 02:12:40,707][106225] Updated weights for policy 1, policy_version 970165 (0.0008) [2023-12-28 02:12:40,774][106225] Updated weights for policy 1, policy_version 970175 (0.0006) [2023-12-28 02:12:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 496230400. Throughput: 0: 9632.4, 1: 10146.6. Samples: 496202500. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:41,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-5.250')] [2023-12-28 02:12:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000970176_248406016.pth... [2023-12-28 02:12:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000968960_248094720.pth [2023-12-28 02:12:41,226][106226] Updated weights for policy 0, policy_version 967846 (0.0007) [2023-12-28 02:12:41,290][106226] Updated weights for policy 0, policy_version 967856 (0.0008) [2023-12-28 02:12:41,352][106226] Updated weights for policy 0, policy_version 967866 (0.0009) [2023-12-28 02:12:41,386][106225] Updated weights for policy 1, policy_version 970185 (0.0008) [2023-12-28 02:12:41,391][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000967872_247832576.pth... [2023-12-28 02:12:41,395][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000966720_247537664.pth [2023-12-28 02:12:41,449][106225] Updated weights for policy 1, policy_version 970195 (0.0009) [2023-12-28 02:12:41,501][106225] Updated weights for policy 1, policy_version 970205 (0.0008) [2023-12-28 02:12:42,092][106226] Updated weights for policy 0, policy_version 967876 (0.0009) [2023-12-28 02:12:42,165][106226] Updated weights for policy 0, policy_version 967886 (0.0008) [2023-12-28 02:12:42,231][106226] Updated weights for policy 0, policy_version 967896 (0.0009) [2023-12-28 02:12:42,331][106225] Updated weights for policy 1, policy_version 970215 (0.0010) [2023-12-28 02:12:42,402][106225] Updated weights for policy 1, policy_version 970225 (0.0011) [2023-12-28 02:12:42,465][106225] Updated weights for policy 1, policy_version 970235 (0.0010) [2023-12-28 02:12:42,990][106226] Updated weights for policy 0, policy_version 967906 (0.0007) [2023-12-28 02:12:43,046][106226] Updated weights for policy 0, policy_version 967916 (0.0006) [2023-12-28 02:12:43,103][106226] Updated weights for policy 0, policy_version 967926 (0.0010) [2023-12-28 02:12:43,156][106226] Updated weights for policy 0, policy_version 967936 (0.0010) [2023-12-28 02:12:43,188][106225] Updated weights for policy 1, policy_version 970245 (0.0010) [2023-12-28 02:12:43,248][106225] Updated weights for policy 1, policy_version 970255 (0.0010) [2023-12-28 02:12:43,308][106225] Updated weights for policy 1, policy_version 970265 (0.0010) [2023-12-28 02:12:43,853][106226] Updated weights for policy 0, policy_version 967946 (0.0011) [2023-12-28 02:12:43,896][106226] Updated weights for policy 0, policy_version 967956 (0.0010) [2023-12-28 02:12:43,953][106226] Updated weights for policy 0, policy_version 967966 (0.0010) [2023-12-28 02:12:43,958][106225] Updated weights for policy 1, policy_version 970275 (0.0010) [2023-12-28 02:12:44,002][106225] Updated weights for policy 1, policy_version 970285 (0.0007) [2023-12-28 02:12:44,056][106225] Updated weights for policy 1, policy_version 970295 (0.0005) [2023-12-28 02:12:44,618][106226] Updated weights for policy 0, policy_version 967976 (0.0009) [2023-12-28 02:12:44,665][106225] Updated weights for policy 1, policy_version 970305 (0.0005) [2023-12-28 02:12:44,666][106226] Updated weights for policy 0, policy_version 967986 (0.0009) [2023-12-28 02:12:44,714][106225] Updated weights for policy 1, policy_version 970315 (0.0005) [2023-12-28 02:12:44,717][106226] Updated weights for policy 0, policy_version 967996 (0.0005) [2023-12-28 02:12:44,765][106225] Updated weights for policy 1, policy_version 970325 (0.0006) [2023-12-28 02:12:44,834][106225] Updated weights for policy 1, policy_version 970335 (0.0007) [2023-12-28 02:12:45,422][106225] Updated weights for policy 1, policy_version 970345 (0.0010) [2023-12-28 02:12:45,482][106225] Updated weights for policy 1, policy_version 970355 (0.0010) [2023-12-28 02:12:45,512][106226] Updated weights for policy 0, policy_version 968006 (0.0006) [2023-12-28 02:12:45,539][106225] Updated weights for policy 1, policy_version 970365 (0.0010) [2023-12-28 02:12:45,559][106226] Updated weights for policy 0, policy_version 968016 (0.0008) [2023-12-28 02:12:45,606][106226] Updated weights for policy 0, policy_version 968026 (0.0008) [2023-12-28 02:12:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 496328704. Throughput: 0: 9572.2, 1: 10230.4. Samples: 496320000. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:46,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.029')] [2023-12-28 02:12:46,271][106225] Updated weights for policy 1, policy_version 970375 (0.0009) [2023-12-28 02:12:46,314][106226] Updated weights for policy 0, policy_version 968036 (0.0009) [2023-12-28 02:12:46,320][106225] Updated weights for policy 1, policy_version 970385 (0.0007) [2023-12-28 02:12:46,371][106225] Updated weights for policy 1, policy_version 970395 (0.0005) [2023-12-28 02:12:46,377][106226] Updated weights for policy 0, policy_version 968046 (0.0008) [2023-12-28 02:12:46,441][106226] Updated weights for policy 0, policy_version 968056 (0.0007) [2023-12-28 02:12:47,052][106225] Updated weights for policy 1, policy_version 970405 (0.0007) [2023-12-28 02:12:47,111][106225] Updated weights for policy 1, policy_version 970415 (0.0008) [2023-12-28 02:12:47,156][106226] Updated weights for policy 0, policy_version 968066 (0.0009) [2023-12-28 02:12:47,169][106225] Updated weights for policy 1, policy_version 970425 (0.0008) [2023-12-28 02:12:47,216][106226] Updated weights for policy 0, policy_version 968076 (0.0007) [2023-12-28 02:12:47,283][106226] Updated weights for policy 0, policy_version 968086 (0.0011) [2023-12-28 02:12:47,343][106226] Updated weights for policy 0, policy_version 968096 (0.0011) [2023-12-28 02:12:47,946][106225] Updated weights for policy 1, policy_version 970435 (0.0008) [2023-12-28 02:12:47,948][106226] Updated weights for policy 0, policy_version 968106 (0.0008) [2023-12-28 02:12:47,999][106225] Updated weights for policy 1, policy_version 970445 (0.0006) [2023-12-28 02:12:48,014][106226] Updated weights for policy 0, policy_version 968116 (0.0010) [2023-12-28 02:12:48,051][106225] Updated weights for policy 1, policy_version 970455 (0.0007) [2023-12-28 02:12:48,061][106226] Updated weights for policy 0, policy_version 968126 (0.0010) [2023-12-28 02:12:48,766][106226] Updated weights for policy 0, policy_version 968136 (0.0006) [2023-12-28 02:12:48,820][106225] Updated weights for policy 1, policy_version 970465 (0.0006) [2023-12-28 02:12:48,821][106226] Updated weights for policy 0, policy_version 968146 (0.0008) [2023-12-28 02:12:48,879][106226] Updated weights for policy 0, policy_version 968156 (0.0008) [2023-12-28 02:12:48,883][106225] Updated weights for policy 1, policy_version 970475 (0.0005) [2023-12-28 02:12:48,938][106225] Updated weights for policy 1, policy_version 970485 (0.0005) [2023-12-28 02:12:48,995][106225] Updated weights for policy 1, policy_version 970495 (0.0005) [2023-12-28 02:12:49,635][106226] Updated weights for policy 0, policy_version 968166 (0.0006) [2023-12-28 02:12:49,652][106225] Updated weights for policy 1, policy_version 970505 (0.0008) [2023-12-28 02:12:49,694][106226] Updated weights for policy 0, policy_version 968176 (0.0008) [2023-12-28 02:12:49,708][106225] Updated weights for policy 1, policy_version 970515 (0.0008) [2023-12-28 02:12:49,753][106226] Updated weights for policy 0, policy_version 968186 (0.0008) [2023-12-28 02:12:49,759][106225] Updated weights for policy 1, policy_version 970525 (0.0008) [2023-12-28 02:12:50,477][106225] Updated weights for policy 1, policy_version 970535 (0.0009) [2023-12-28 02:12:50,521][106226] Updated weights for policy 0, policy_version 968196 (0.0008) [2023-12-28 02:12:50,533][106225] Updated weights for policy 1, policy_version 970545 (0.0010) [2023-12-28 02:12:50,593][106226] Updated weights for policy 0, policy_version 968206 (0.0008) [2023-12-28 02:12:50,595][106225] Updated weights for policy 1, policy_version 970555 (0.0010) [2023-12-28 02:12:50,652][106226] Updated weights for policy 0, policy_version 968216 (0.0007) [2023-12-28 02:12:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 496427008. Throughput: 0: 9576.3, 1: 10247.1. Samples: 496437640. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:51,175][105115] Avg episode reward: [(0, '-4.861'), (1, '-4.812')] [2023-12-28 02:12:51,375][106225] Updated weights for policy 1, policy_version 970565 (0.0009) [2023-12-28 02:12:51,402][106226] Updated weights for policy 0, policy_version 968226 (0.0009) [2023-12-28 02:12:51,440][106225] Updated weights for policy 1, policy_version 970575 (0.0009) [2023-12-28 02:12:51,466][106226] Updated weights for policy 0, policy_version 968236 (0.0011) [2023-12-28 02:12:51,506][106225] Updated weights for policy 1, policy_version 970585 (0.0010) [2023-12-28 02:12:51,537][106226] Updated weights for policy 0, policy_version 968246 (0.0011) [2023-12-28 02:12:51,607][106226] Updated weights for policy 0, policy_version 968256 (0.0011) [2023-12-28 02:12:52,166][106225] Updated weights for policy 1, policy_version 970595 (0.0010) [2023-12-28 02:12:52,212][106225] Updated weights for policy 1, policy_version 970605 (0.0005) [2023-12-28 02:12:52,269][106225] Updated weights for policy 1, policy_version 970615 (0.0006) [2023-12-28 02:12:52,321][106226] Updated weights for policy 0, policy_version 968266 (0.0010) [2023-12-28 02:12:52,392][106226] Updated weights for policy 0, policy_version 968276 (0.0009) [2023-12-28 02:12:52,455][106226] Updated weights for policy 0, policy_version 968286 (0.0010) [2023-12-28 02:12:52,972][106225] Updated weights for policy 1, policy_version 970625 (0.0007) [2023-12-28 02:12:53,033][106225] Updated weights for policy 1, policy_version 970635 (0.0007) [2023-12-28 02:12:53,101][106225] Updated weights for policy 1, policy_version 970645 (0.0009) [2023-12-28 02:12:53,152][106225] Updated weights for policy 1, policy_version 970655 (0.0009) [2023-12-28 02:12:53,165][106226] Updated weights for policy 0, policy_version 968296 (0.0006) [2023-12-28 02:12:53,220][106226] Updated weights for policy 0, policy_version 968306 (0.0006) [2023-12-28 02:12:53,276][106226] Updated weights for policy 0, policy_version 968316 (0.0009) [2023-12-28 02:12:53,791][106225] Updated weights for policy 1, policy_version 970665 (0.0006) [2023-12-28 02:12:53,820][106226] Updated weights for policy 0, policy_version 968326 (0.0009) [2023-12-28 02:12:53,846][106225] Updated weights for policy 1, policy_version 970675 (0.0005) [2023-12-28 02:12:53,874][106226] Updated weights for policy 0, policy_version 968336 (0.0010) [2023-12-28 02:12:53,903][106225] Updated weights for policy 1, policy_version 970685 (0.0005) [2023-12-28 02:12:53,928][106226] Updated weights for policy 0, policy_version 968346 (0.0010) [2023-12-28 02:12:54,618][106225] Updated weights for policy 1, policy_version 970695 (0.0006) [2023-12-28 02:12:54,661][106226] Updated weights for policy 0, policy_version 968356 (0.0011) [2023-12-28 02:12:54,677][106225] Updated weights for policy 1, policy_version 970705 (0.0007) [2023-12-28 02:12:54,714][106226] Updated weights for policy 0, policy_version 968366 (0.0010) [2023-12-28 02:12:54,732][106225] Updated weights for policy 1, policy_version 970715 (0.0006) [2023-12-28 02:12:54,767][106226] Updated weights for policy 0, policy_version 968376 (0.0010) [2023-12-28 02:12:55,433][106225] Updated weights for policy 1, policy_version 970725 (0.0007) [2023-12-28 02:12:55,488][106226] Updated weights for policy 0, policy_version 968386 (0.0010) [2023-12-28 02:12:55,494][106225] Updated weights for policy 1, policy_version 970735 (0.0005) [2023-12-28 02:12:55,538][106226] Updated weights for policy 0, policy_version 968396 (0.0010) [2023-12-28 02:12:55,563][106225] Updated weights for policy 1, policy_version 970745 (0.0006) [2023-12-28 02:12:55,588][106226] Updated weights for policy 0, policy_version 968406 (0.0010) [2023-12-28 02:12:55,644][106226] Updated weights for policy 0, policy_version 968416 (0.0010) [2023-12-28 02:12:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 496525312. Throughput: 0: 9618.9, 1: 10235.9. Samples: 496497720. Policy #0 lag: (min: 9.0, avg: 23.5, max: 41.0) [2023-12-28 02:12:56,175][105115] Avg episode reward: [(0, '-4.975'), (1, '-5.219')] [2023-12-28 02:12:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000968416_247971840.pth... [2023-12-28 02:12:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000970752_248553472.pth... [2023-12-28 02:12:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000967296_247685120.pth [2023-12-28 02:12:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000969568_248250368.pth [2023-12-28 02:12:56,251][106225] Updated weights for policy 1, policy_version 970755 (0.0006) [2023-12-28 02:12:56,302][106225] Updated weights for policy 1, policy_version 970765 (0.0008) [2023-12-28 02:12:56,351][106225] Updated weights for policy 1, policy_version 970775 (0.0008) [2023-12-28 02:12:56,376][106226] Updated weights for policy 0, policy_version 968426 (0.0010) [2023-12-28 02:12:56,425][106226] Updated weights for policy 0, policy_version 968436 (0.0010) [2023-12-28 02:12:56,477][106226] Updated weights for policy 0, policy_version 968446 (0.0010) [2023-12-28 02:12:57,119][106226] Updated weights for policy 0, policy_version 968456 (0.0006) [2023-12-28 02:12:57,129][106225] Updated weights for policy 1, policy_version 970785 (0.0006) [2023-12-28 02:12:57,170][106226] Updated weights for policy 0, policy_version 968466 (0.0005) [2023-12-28 02:12:57,175][106225] Updated weights for policy 1, policy_version 970795 (0.0008) [2023-12-28 02:12:57,213][106226] Updated weights for policy 0, policy_version 968476 (0.0005) [2023-12-28 02:12:57,220][106225] Updated weights for policy 1, policy_version 970805 (0.0007) [2023-12-28 02:12:57,270][106225] Updated weights for policy 1, policy_version 970815 (0.0008) [2023-12-28 02:12:57,753][106226] Updated weights for policy 0, policy_version 968486 (0.0005) [2023-12-28 02:12:57,803][106226] Updated weights for policy 0, policy_version 968496 (0.0005) [2023-12-28 02:12:57,858][106226] Updated weights for policy 0, policy_version 968506 (0.0009) [2023-12-28 02:12:58,070][106225] Updated weights for policy 1, policy_version 970825 (0.0008) [2023-12-28 02:12:58,133][106225] Updated weights for policy 1, policy_version 970835 (0.0008) [2023-12-28 02:12:58,198][106225] Updated weights for policy 1, policy_version 970845 (0.0008) [2023-12-28 02:12:58,559][106226] Updated weights for policy 0, policy_version 968516 (0.0010) [2023-12-28 02:12:58,621][106226] Updated weights for policy 0, policy_version 968526 (0.0008) [2023-12-28 02:12:58,695][106226] Updated weights for policy 0, policy_version 968536 (0.0008) [2023-12-28 02:12:59,021][106225] Updated weights for policy 1, policy_version 970855 (0.0008) [2023-12-28 02:12:59,083][106225] Updated weights for policy 1, policy_version 970865 (0.0009) [2023-12-28 02:12:59,145][106225] Updated weights for policy 1, policy_version 970875 (0.0009) [2023-12-28 02:12:59,457][106226] Updated weights for policy 0, policy_version 968546 (0.0008) [2023-12-28 02:12:59,518][106226] Updated weights for policy 0, policy_version 968556 (0.0007) [2023-12-28 02:12:59,575][106226] Updated weights for policy 0, policy_version 968566 (0.0006) [2023-12-28 02:12:59,624][106226] Updated weights for policy 0, policy_version 968576 (0.0006) [2023-12-28 02:12:59,918][106225] Updated weights for policy 1, policy_version 970885 (0.0007) [2023-12-28 02:12:59,990][106225] Updated weights for policy 1, policy_version 970895 (0.0007) [2023-12-28 02:13:00,048][106225] Updated weights for policy 1, policy_version 970905 (0.0007) [2023-12-28 02:13:00,243][106226] Updated weights for policy 0, policy_version 968586 (0.0008) [2023-12-28 02:13:00,304][106226] Updated weights for policy 0, policy_version 968596 (0.0006) [2023-12-28 02:13:00,361][106226] Updated weights for policy 0, policy_version 968606 (0.0007) [2023-12-28 02:13:00,662][106225] Updated weights for policy 1, policy_version 970915 (0.0007) [2023-12-28 02:13:00,725][106225] Updated weights for policy 1, policy_version 970925 (0.0006) [2023-12-28 02:13:00,777][106225] Updated weights for policy 1, policy_version 970935 (0.0006) [2023-12-28 02:13:01,072][106226] Updated weights for policy 0, policy_version 968616 (0.0009) [2023-12-28 02:13:01,132][106226] Updated weights for policy 0, policy_version 968626 (0.0009) [2023-12-28 02:13:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 496623616. Throughput: 0: 9707.3, 1: 10106.0. Samples: 496615148. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:01,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.287')] [2023-12-28 02:13:01,198][106226] Updated weights for policy 0, policy_version 968636 (0.0006) [2023-12-28 02:13:01,494][106225] Updated weights for policy 1, policy_version 970945 (0.0009) [2023-12-28 02:13:01,551][106225] Updated weights for policy 1, policy_version 970955 (0.0007) [2023-12-28 02:13:01,610][106225] Updated weights for policy 1, policy_version 970965 (0.0008) [2023-12-28 02:13:01,672][106225] Updated weights for policy 1, policy_version 970975 (0.0007) [2023-12-28 02:13:02,026][106226] Updated weights for policy 0, policy_version 968646 (0.0009) [2023-12-28 02:13:02,093][106226] Updated weights for policy 0, policy_version 968656 (0.0008) [2023-12-28 02:13:02,162][106226] Updated weights for policy 0, policy_version 968666 (0.0008) [2023-12-28 02:13:02,403][106225] Updated weights for policy 1, policy_version 970985 (0.0008) [2023-12-28 02:13:02,471][106225] Updated weights for policy 1, policy_version 970995 (0.0008) [2023-12-28 02:13:02,528][106225] Updated weights for policy 1, policy_version 971005 (0.0009) [2023-12-28 02:13:02,916][106226] Updated weights for policy 0, policy_version 968676 (0.0008) [2023-12-28 02:13:02,972][106226] Updated weights for policy 0, policy_version 968686 (0.0009) [2023-12-28 02:13:03,025][106226] Updated weights for policy 0, policy_version 968696 (0.0008) [2023-12-28 02:13:03,229][106225] Updated weights for policy 1, policy_version 971015 (0.0008) [2023-12-28 02:13:03,279][106225] Updated weights for policy 1, policy_version 971025 (0.0009) [2023-12-28 02:13:03,325][106225] Updated weights for policy 1, policy_version 971035 (0.0007) [2023-12-28 02:13:03,673][106226] Updated weights for policy 0, policy_version 968706 (0.0008) [2023-12-28 02:13:03,722][106226] Updated weights for policy 0, policy_version 968716 (0.0009) [2023-12-28 02:13:03,775][106226] Updated weights for policy 0, policy_version 968726 (0.0008) [2023-12-28 02:13:03,838][106226] Updated weights for policy 0, policy_version 968736 (0.0007) [2023-12-28 02:13:04,143][106225] Updated weights for policy 1, policy_version 971045 (0.0010) [2023-12-28 02:13:04,204][106225] Updated weights for policy 1, policy_version 971055 (0.0010) [2023-12-28 02:13:04,262][106225] Updated weights for policy 1, policy_version 971065 (0.0010) [2023-12-28 02:13:04,510][106226] Updated weights for policy 0, policy_version 968746 (0.0006) [2023-12-28 02:13:04,571][106226] Updated weights for policy 0, policy_version 968756 (0.0005) [2023-12-28 02:13:04,637][106226] Updated weights for policy 0, policy_version 968766 (0.0006) [2023-12-28 02:13:04,924][106225] Updated weights for policy 1, policy_version 971075 (0.0009) [2023-12-28 02:13:04,968][106225] Updated weights for policy 1, policy_version 971085 (0.0008) [2023-12-28 02:13:05,017][106225] Updated weights for policy 1, policy_version 971095 (0.0007) [2023-12-28 02:13:05,210][106226] Updated weights for policy 0, policy_version 968776 (0.0008) [2023-12-28 02:13:05,278][106226] Updated weights for policy 0, policy_version 968786 (0.0009) [2023-12-28 02:13:05,335][106226] Updated weights for policy 0, policy_version 968796 (0.0007) [2023-12-28 02:13:05,618][106225] Updated weights for policy 1, policy_version 971105 (0.0010) [2023-12-28 02:13:05,677][106225] Updated weights for policy 1, policy_version 971115 (0.0010) [2023-12-28 02:13:05,736][106225] Updated weights for policy 1, policy_version 971125 (0.0010) [2023-12-28 02:13:05,786][106225] Updated weights for policy 1, policy_version 971135 (0.0010) [2023-12-28 02:13:06,077][106226] Updated weights for policy 0, policy_version 968806 (0.0008) [2023-12-28 02:13:06,142][106226] Updated weights for policy 0, policy_version 968817 (0.0009) [2023-12-28 02:13:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 496721920. Throughput: 0: 9794.9, 1: 10123.9. Samples: 496734860. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:06,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-4.946')] [2023-12-28 02:13:06,207][106226] Updated weights for policy 0, policy_version 968827 (0.0005) [2023-12-28 02:13:06,545][106225] Updated weights for policy 1, policy_version 971145 (0.0011) [2023-12-28 02:13:06,602][106225] Updated weights for policy 1, policy_version 971155 (0.0010) [2023-12-28 02:13:06,668][106225] Updated weights for policy 1, policy_version 971165 (0.0011) [2023-12-28 02:13:06,768][106226] Updated weights for policy 0, policy_version 968837 (0.0006) [2023-12-28 02:13:06,831][106226] Updated weights for policy 0, policy_version 968847 (0.0006) [2023-12-28 02:13:06,885][106226] Updated weights for policy 0, policy_version 968857 (0.0008) [2023-12-28 02:13:07,345][106225] Updated weights for policy 1, policy_version 971175 (0.0007) [2023-12-28 02:13:07,389][106225] Updated weights for policy 1, policy_version 971185 (0.0010) [2023-12-28 02:13:07,441][106225] Updated weights for policy 1, policy_version 971195 (0.0010) [2023-12-28 02:13:07,588][106226] Updated weights for policy 0, policy_version 968867 (0.0008) [2023-12-28 02:13:07,648][106226] Updated weights for policy 0, policy_version 968877 (0.0007) [2023-12-28 02:13:07,699][106226] Updated weights for policy 0, policy_version 968887 (0.0005) [2023-12-28 02:13:08,167][106225] Updated weights for policy 1, policy_version 971205 (0.0010) [2023-12-28 02:13:08,228][106225] Updated weights for policy 1, policy_version 971215 (0.0010) [2023-12-28 02:13:08,280][106225] Updated weights for policy 1, policy_version 971225 (0.0010) [2023-12-28 02:13:08,317][106226] Updated weights for policy 0, policy_version 968897 (0.0005) [2023-12-28 02:13:08,381][106226] Updated weights for policy 0, policy_version 968907 (0.0008) [2023-12-28 02:13:08,449][106226] Updated weights for policy 0, policy_version 968917 (0.0010) [2023-12-28 02:13:08,502][106226] Updated weights for policy 0, policy_version 968927 (0.0008) [2023-12-28 02:13:08,979][106225] Updated weights for policy 1, policy_version 971235 (0.0009) [2023-12-28 02:13:09,028][106225] Updated weights for policy 1, policy_version 971245 (0.0010) [2023-12-28 02:13:09,081][106225] Updated weights for policy 1, policy_version 971255 (0.0010) [2023-12-28 02:13:09,148][106226] Updated weights for policy 0, policy_version 968937 (0.0008) [2023-12-28 02:13:09,199][106226] Updated weights for policy 0, policy_version 968947 (0.0008) [2023-12-28 02:13:09,262][106226] Updated weights for policy 0, policy_version 968957 (0.0008) [2023-12-28 02:13:09,820][106225] Updated weights for policy 1, policy_version 971265 (0.0010) [2023-12-28 02:13:09,892][106225] Updated weights for policy 1, policy_version 971275 (0.0009) [2023-12-28 02:13:09,964][106225] Updated weights for policy 1, policy_version 971285 (0.0010) [2023-12-28 02:13:10,025][106225] Updated weights for policy 1, policy_version 971295 (0.0009) [2023-12-28 02:13:10,043][106226] Updated weights for policy 0, policy_version 968967 (0.0006) [2023-12-28 02:13:10,104][106226] Updated weights for policy 0, policy_version 968977 (0.0008) [2023-12-28 02:13:10,165][106226] Updated weights for policy 0, policy_version 968987 (0.0008) [2023-12-28 02:13:10,759][106225] Updated weights for policy 1, policy_version 971305 (0.0006) [2023-12-28 02:13:10,813][106225] Updated weights for policy 1, policy_version 971315 (0.0005) [2023-12-28 02:13:10,864][106225] Updated weights for policy 1, policy_version 971325 (0.0006) [2023-12-28 02:13:10,935][106226] Updated weights for policy 0, policy_version 968997 (0.0009) [2023-12-28 02:13:10,999][106226] Updated weights for policy 0, policy_version 969007 (0.0006) [2023-12-28 02:13:11,067][106226] Updated weights for policy 0, policy_version 969017 (0.0007) [2023-12-28 02:13:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 496828416. Throughput: 0: 9899.5, 1: 10124.5. Samples: 496796324. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:11,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-5.110')] [2023-12-28 02:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000969024_248127488.pth... [2023-12-28 02:13:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000971328_248700928.pth... [2023-12-28 02:13:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000967872_247832576.pth [2023-12-28 02:13:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000970176_248406016.pth [2023-12-28 02:13:11,551][106225] Updated weights for policy 1, policy_version 971335 (0.0010) [2023-12-28 02:13:11,613][106225] Updated weights for policy 1, policy_version 971345 (0.0010) [2023-12-28 02:13:11,680][106225] Updated weights for policy 1, policy_version 971355 (0.0009) [2023-12-28 02:13:11,837][106226] Updated weights for policy 0, policy_version 969027 (0.0008) [2023-12-28 02:13:11,903][106226] Updated weights for policy 0, policy_version 969037 (0.0011) [2023-12-28 02:13:11,961][106226] Updated weights for policy 0, policy_version 969047 (0.0010) [2023-12-28 02:13:12,450][106225] Updated weights for policy 1, policy_version 971365 (0.0010) [2023-12-28 02:13:12,512][106225] Updated weights for policy 1, policy_version 971375 (0.0010) [2023-12-28 02:13:12,580][106225] Updated weights for policy 1, policy_version 971385 (0.0011) [2023-12-28 02:13:12,662][106226] Updated weights for policy 0, policy_version 969057 (0.0006) [2023-12-28 02:13:12,724][106226] Updated weights for policy 0, policy_version 969067 (0.0008) [2023-12-28 02:13:12,790][106226] Updated weights for policy 0, policy_version 969077 (0.0008) [2023-12-28 02:13:12,855][106226] Updated weights for policy 0, policy_version 969087 (0.0008) [2023-12-28 02:13:13,314][106225] Updated weights for policy 1, policy_version 971395 (0.0010) [2023-12-28 02:13:13,361][106225] Updated weights for policy 1, policy_version 971405 (0.0008) [2023-12-28 02:13:13,405][106225] Updated weights for policy 1, policy_version 971415 (0.0008) [2023-12-28 02:13:13,576][106226] Updated weights for policy 0, policy_version 969097 (0.0009) [2023-12-28 02:13:13,626][106226] Updated weights for policy 0, policy_version 969107 (0.0008) [2023-12-28 02:13:13,687][106226] Updated weights for policy 0, policy_version 969117 (0.0009) [2023-12-28 02:13:14,085][106225] Updated weights for policy 1, policy_version 971425 (0.0008) [2023-12-28 02:13:14,141][106225] Updated weights for policy 1, policy_version 971435 (0.0007) [2023-12-28 02:13:14,198][106225] Updated weights for policy 1, policy_version 971445 (0.0008) [2023-12-28 02:13:14,258][106225] Updated weights for policy 1, policy_version 971455 (0.0008) [2023-12-28 02:13:14,377][106226] Updated weights for policy 0, policy_version 969127 (0.0010) [2023-12-28 02:13:14,429][106226] Updated weights for policy 0, policy_version 969137 (0.0010) [2023-12-28 02:13:14,485][106226] Updated weights for policy 0, policy_version 969147 (0.0010) [2023-12-28 02:13:15,059][106225] Updated weights for policy 1, policy_version 971465 (0.0009) [2023-12-28 02:13:15,129][106225] Updated weights for policy 1, policy_version 971475 (0.0010) [2023-12-28 02:13:15,193][106225] Updated weights for policy 1, policy_version 971485 (0.0008) [2023-12-28 02:13:15,198][106226] Updated weights for policy 0, policy_version 969157 (0.0008) [2023-12-28 02:13:15,259][106226] Updated weights for policy 0, policy_version 969167 (0.0006) [2023-12-28 02:13:15,324][106226] Updated weights for policy 0, policy_version 969177 (0.0007) [2023-12-28 02:13:15,883][106225] Updated weights for policy 1, policy_version 971495 (0.0008) [2023-12-28 02:13:15,940][106225] Updated weights for policy 1, policy_version 971505 (0.0008) [2023-12-28 02:13:16,000][106225] Updated weights for policy 1, policy_version 971515 (0.0007) [2023-12-28 02:13:16,008][106226] Updated weights for policy 0, policy_version 969187 (0.0009) [2023-12-28 02:13:16,069][106226] Updated weights for policy 0, policy_version 969197 (0.0010) [2023-12-28 02:13:16,128][106226] Updated weights for policy 0, policy_version 969207 (0.0011) [2023-12-28 02:13:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 496926720. Throughput: 0: 9858.7, 1: 9929.3. Samples: 496909976. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:16,175][105115] Avg episode reward: [(0, '-4.792'), (1, '-5.296')] [2023-12-28 02:13:16,697][106225] Updated weights for policy 1, policy_version 971525 (0.0007) [2023-12-28 02:13:16,745][106225] Updated weights for policy 1, policy_version 971535 (0.0008) [2023-12-28 02:13:16,768][106226] Updated weights for policy 0, policy_version 969217 (0.0010) [2023-12-28 02:13:16,794][106225] Updated weights for policy 1, policy_version 971545 (0.0008) [2023-12-28 02:13:16,825][106226] Updated weights for policy 0, policy_version 969227 (0.0006) [2023-12-28 02:13:16,872][106226] Updated weights for policy 0, policy_version 969237 (0.0005) [2023-12-28 02:13:16,923][106226] Updated weights for policy 0, policy_version 969247 (0.0005) [2023-12-28 02:13:17,565][106226] Updated weights for policy 0, policy_version 969257 (0.0010) [2023-12-28 02:13:17,581][106225] Updated weights for policy 1, policy_version 971555 (0.0007) [2023-12-28 02:13:17,616][106226] Updated weights for policy 0, policy_version 969267 (0.0006) [2023-12-28 02:13:17,639][106225] Updated weights for policy 1, policy_version 971565 (0.0006) [2023-12-28 02:13:17,673][106226] Updated weights for policy 0, policy_version 969277 (0.0005) [2023-12-28 02:13:17,700][106225] Updated weights for policy 1, policy_version 971575 (0.0006) [2023-12-28 02:13:18,261][106226] Updated weights for policy 0, policy_version 969287 (0.0009) [2023-12-28 02:13:18,324][106226] Updated weights for policy 0, policy_version 969297 (0.0010) [2023-12-28 02:13:18,362][106225] Updated weights for policy 1, policy_version 971585 (0.0006) [2023-12-28 02:13:18,384][106226] Updated weights for policy 0, policy_version 969307 (0.0008) [2023-12-28 02:13:18,430][106225] Updated weights for policy 1, policy_version 971595 (0.0008) [2023-12-28 02:13:18,490][106225] Updated weights for policy 1, policy_version 971605 (0.0009) [2023-12-28 02:13:18,558][106225] Updated weights for policy 1, policy_version 971615 (0.0008) [2023-12-28 02:13:19,109][106226] Updated weights for policy 0, policy_version 969317 (0.0008) [2023-12-28 02:13:19,166][106226] Updated weights for policy 0, policy_version 969327 (0.0009) [2023-12-28 02:13:19,223][106226] Updated weights for policy 0, policy_version 969337 (0.0009) [2023-12-28 02:13:19,283][106225] Updated weights for policy 1, policy_version 971625 (0.0008) [2023-12-28 02:13:19,335][106225] Updated weights for policy 1, policy_version 971635 (0.0008) [2023-12-28 02:13:19,399][106225] Updated weights for policy 1, policy_version 971645 (0.0008) [2023-12-28 02:13:20,022][106226] Updated weights for policy 0, policy_version 969347 (0.0008) [2023-12-28 02:13:20,077][106226] Updated weights for policy 0, policy_version 969357 (0.0008) [2023-12-28 02:13:20,110][106225] Updated weights for policy 1, policy_version 971655 (0.0008) [2023-12-28 02:13:20,133][106226] Updated weights for policy 0, policy_version 969367 (0.0008) [2023-12-28 02:13:20,173][106225] Updated weights for policy 1, policy_version 971665 (0.0008) [2023-12-28 02:13:20,235][106225] Updated weights for policy 1, policy_version 971675 (0.0008) [2023-12-28 02:13:20,883][106226] Updated weights for policy 0, policy_version 969377 (0.0007) [2023-12-28 02:13:20,948][106226] Updated weights for policy 0, policy_version 969387 (0.0011) [2023-12-28 02:13:20,994][106225] Updated weights for policy 1, policy_version 971685 (0.0007) [2023-12-28 02:13:21,008][106226] Updated weights for policy 0, policy_version 969397 (0.0011) [2023-12-28 02:13:21,061][106225] Updated weights for policy 1, policy_version 971695 (0.0008) [2023-12-28 02:13:21,077][106226] Updated weights for policy 0, policy_version 969407 (0.0010) [2023-12-28 02:13:21,110][106225] Updated weights for policy 1, policy_version 971705 (0.0008) [2023-12-28 02:13:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 497025024. Throughput: 0: 9876.2, 1: 9819.7. Samples: 497027236. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:21,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-5.146')] [2023-12-28 02:13:21,841][106226] Updated weights for policy 0, policy_version 969417 (0.0006) [2023-12-28 02:13:21,904][106226] Updated weights for policy 0, policy_version 969427 (0.0006) [2023-12-28 02:13:21,911][106225] Updated weights for policy 1, policy_version 971715 (0.0007) [2023-12-28 02:13:21,963][106226] Updated weights for policy 0, policy_version 969437 (0.0006) [2023-12-28 02:13:21,973][106225] Updated weights for policy 1, policy_version 971725 (0.0008) [2023-12-28 02:13:22,038][106225] Updated weights for policy 1, policy_version 971735 (0.0010) [2023-12-28 02:13:22,563][106226] Updated weights for policy 0, policy_version 969447 (0.0006) [2023-12-28 02:13:22,623][106226] Updated weights for policy 0, policy_version 969457 (0.0007) [2023-12-28 02:13:22,684][106226] Updated weights for policy 0, policy_version 969467 (0.0008) [2023-12-28 02:13:22,833][106225] Updated weights for policy 1, policy_version 971745 (0.0009) [2023-12-28 02:13:22,896][106225] Updated weights for policy 1, policy_version 971755 (0.0009) [2023-12-28 02:13:22,951][106225] Updated weights for policy 1, policy_version 971765 (0.0006) [2023-12-28 02:13:22,999][106225] Updated weights for policy 1, policy_version 971775 (0.0008) [2023-12-28 02:13:23,352][106226] Updated weights for policy 0, policy_version 969477 (0.0009) [2023-12-28 02:13:23,418][106226] Updated weights for policy 0, policy_version 969487 (0.0009) [2023-12-28 02:13:23,483][106226] Updated weights for policy 0, policy_version 969497 (0.0008) [2023-12-28 02:13:23,722][106225] Updated weights for policy 1, policy_version 971785 (0.0010) [2023-12-28 02:13:23,786][106225] Updated weights for policy 1, policy_version 971795 (0.0009) [2023-12-28 02:13:23,844][106225] Updated weights for policy 1, policy_version 971805 (0.0009) [2023-12-28 02:13:24,148][106226] Updated weights for policy 0, policy_version 969507 (0.0008) [2023-12-28 02:13:24,216][106226] Updated weights for policy 0, policy_version 969517 (0.0008) [2023-12-28 02:13:24,279][106226] Updated weights for policy 0, policy_version 969527 (0.0008) [2023-12-28 02:13:24,538][106225] Updated weights for policy 1, policy_version 971815 (0.0008) [2023-12-28 02:13:24,584][106225] Updated weights for policy 1, policy_version 971825 (0.0008) [2023-12-28 02:13:24,635][106225] Updated weights for policy 1, policy_version 971835 (0.0008) [2023-12-28 02:13:24,922][106226] Updated weights for policy 0, policy_version 969537 (0.0009) [2023-12-28 02:13:24,970][106226] Updated weights for policy 0, policy_version 969547 (0.0009) [2023-12-28 02:13:25,033][106226] Updated weights for policy 0, policy_version 969557 (0.0008) [2023-12-28 02:13:25,082][106226] Updated weights for policy 0, policy_version 969567 (0.0009) [2023-12-28 02:13:25,410][106225] Updated weights for policy 1, policy_version 971845 (0.0008) [2023-12-28 02:13:25,458][106225] Updated weights for policy 1, policy_version 971855 (0.0008) [2023-12-28 02:13:25,503][106225] Updated weights for policy 1, policy_version 971865 (0.0008) [2023-12-28 02:13:25,792][106226] Updated weights for policy 0, policy_version 969577 (0.0009) [2023-12-28 02:13:25,846][106226] Updated weights for policy 0, policy_version 969587 (0.0009) [2023-12-28 02:13:25,893][106226] Updated weights for policy 0, policy_version 969597 (0.0006) [2023-12-28 02:13:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 497115136. Throughput: 0: 9912.1, 1: 9709.9. Samples: 497085492. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:26,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-5.374')] [2023-12-28 02:13:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000969600_248274944.pth... [2023-12-28 02:13:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000968416_247971840.pth [2023-12-28 02:13:26,198][106225] Updated weights for policy 1, policy_version 971875 (0.0008) [2023-12-28 02:13:26,256][106225] Updated weights for policy 1, policy_version 971885 (0.0008) [2023-12-28 02:13:26,314][106225] Updated weights for policy 1, policy_version 971895 (0.0008) [2023-12-28 02:13:26,365][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000971904_248848384.pth... [2023-12-28 02:13:26,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000970752_248553472.pth [2023-12-28 02:13:26,586][106226] Updated weights for policy 0, policy_version 969607 (0.0008) [2023-12-28 02:13:26,641][106226] Updated weights for policy 0, policy_version 969617 (0.0008) [2023-12-28 02:13:26,700][106226] Updated weights for policy 0, policy_version 969627 (0.0009) [2023-12-28 02:13:27,031][106225] Updated weights for policy 1, policy_version 971905 (0.0007) [2023-12-28 02:13:27,077][106225] Updated weights for policy 1, policy_version 971915 (0.0008) [2023-12-28 02:13:27,141][106225] Updated weights for policy 1, policy_version 971925 (0.0007) [2023-12-28 02:13:27,197][106225] Updated weights for policy 1, policy_version 971935 (0.0008) [2023-12-28 02:13:27,316][106226] Updated weights for policy 0, policy_version 969637 (0.0007) [2023-12-28 02:13:27,378][106226] Updated weights for policy 0, policy_version 969647 (0.0005) [2023-12-28 02:13:27,433][106226] Updated weights for policy 0, policy_version 969657 (0.0005) [2023-12-28 02:13:27,898][106225] Updated weights for policy 1, policy_version 971945 (0.0008) [2023-12-28 02:13:27,944][106225] Updated weights for policy 1, policy_version 971955 (0.0007) [2023-12-28 02:13:27,995][106225] Updated weights for policy 1, policy_version 971965 (0.0007) [2023-12-28 02:13:28,044][106226] Updated weights for policy 0, policy_version 969667 (0.0007) [2023-12-28 02:13:28,102][106226] Updated weights for policy 0, policy_version 969677 (0.0010) [2023-12-28 02:13:28,154][106226] Updated weights for policy 0, policy_version 969687 (0.0005) [2023-12-28 02:13:28,766][106226] Updated weights for policy 0, policy_version 969697 (0.0005) [2023-12-28 02:13:28,775][106225] Updated weights for policy 1, policy_version 971975 (0.0009) [2023-12-28 02:13:28,824][106226] Updated weights for policy 0, policy_version 969707 (0.0005) [2023-12-28 02:13:28,830][106225] Updated weights for policy 1, policy_version 971985 (0.0007) [2023-12-28 02:13:28,880][106226] Updated weights for policy 0, policy_version 969717 (0.0006) [2023-12-28 02:13:28,885][106225] Updated weights for policy 1, policy_version 971995 (0.0007) [2023-12-28 02:13:28,935][106226] Updated weights for policy 0, policy_version 969727 (0.0007) [2023-12-28 02:13:29,574][106225] Updated weights for policy 1, policy_version 972005 (0.0008) [2023-12-28 02:13:29,638][106225] Updated weights for policy 1, policy_version 972015 (0.0011) [2023-12-28 02:13:29,672][106226] Updated weights for policy 0, policy_version 969737 (0.0006) [2023-12-28 02:13:29,700][106225] Updated weights for policy 1, policy_version 972025 (0.0010) [2023-12-28 02:13:29,733][106226] Updated weights for policy 0, policy_version 969747 (0.0007) [2023-12-28 02:13:29,779][106226] Updated weights for policy 0, policy_version 969757 (0.0008) [2023-12-28 02:13:30,413][106225] Updated weights for policy 1, policy_version 972035 (0.0008) [2023-12-28 02:13:30,477][106225] Updated weights for policy 1, policy_version 972045 (0.0009) [2023-12-28 02:13:30,491][106226] Updated weights for policy 0, policy_version 969767 (0.0007) [2023-12-28 02:13:30,529][106225] Updated weights for policy 1, policy_version 972055 (0.0006) [2023-12-28 02:13:30,544][106226] Updated weights for policy 0, policy_version 969777 (0.0006) [2023-12-28 02:13:30,600][106226] Updated weights for policy 0, policy_version 969787 (0.0007) [2023-12-28 02:13:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 497213440. Throughput: 0: 10019.1, 1: 9673.7. Samples: 497206172. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:31,175][105115] Avg episode reward: [(0, '-5.006'), (1, '-5.008')] [2023-12-28 02:13:31,213][106226] Updated weights for policy 0, policy_version 969797 (0.0006) [2023-12-28 02:13:31,276][106226] Updated weights for policy 0, policy_version 969807 (0.0007) [2023-12-28 02:13:31,318][106225] Updated weights for policy 1, policy_version 972065 (0.0007) [2023-12-28 02:13:31,332][106226] Updated weights for policy 0, policy_version 969817 (0.0008) [2023-12-28 02:13:31,378][106225] Updated weights for policy 1, policy_version 972075 (0.0008) [2023-12-28 02:13:31,442][106225] Updated weights for policy 1, policy_version 972085 (0.0010) [2023-12-28 02:13:31,506][106225] Updated weights for policy 1, policy_version 972095 (0.0008) [2023-12-28 02:13:32,045][106226] Updated weights for policy 0, policy_version 969827 (0.0009) [2023-12-28 02:13:32,104][106226] Updated weights for policy 0, policy_version 969837 (0.0008) [2023-12-28 02:13:32,163][106226] Updated weights for policy 0, policy_version 969847 (0.0008) [2023-12-28 02:13:32,259][106225] Updated weights for policy 1, policy_version 972105 (0.0007) [2023-12-28 02:13:32,315][106225] Updated weights for policy 1, policy_version 972115 (0.0008) [2023-12-28 02:13:32,380][106225] Updated weights for policy 1, policy_version 972125 (0.0008) [2023-12-28 02:13:32,926][106226] Updated weights for policy 0, policy_version 969857 (0.0009) [2023-12-28 02:13:32,971][106226] Updated weights for policy 0, policy_version 969867 (0.0008) [2023-12-28 02:13:33,026][106226] Updated weights for policy 0, policy_version 969877 (0.0008) [2023-12-28 02:13:33,087][106226] Updated weights for policy 0, policy_version 969888 (0.0009) [2023-12-28 02:13:33,117][106225] Updated weights for policy 1, policy_version 972135 (0.0008) [2023-12-28 02:13:33,171][106225] Updated weights for policy 1, policy_version 972145 (0.0008) [2023-12-28 02:13:33,229][106225] Updated weights for policy 1, policy_version 972155 (0.0008) [2023-12-28 02:13:33,734][106226] Updated weights for policy 0, policy_version 969898 (0.0007) [2023-12-28 02:13:33,789][106226] Updated weights for policy 0, policy_version 969908 (0.0008) [2023-12-28 02:13:33,851][106226] Updated weights for policy 0, policy_version 969918 (0.0009) [2023-12-28 02:13:33,920][106225] Updated weights for policy 1, policy_version 972165 (0.0006) [2023-12-28 02:13:33,977][106225] Updated weights for policy 1, policy_version 972175 (0.0010) [2023-12-28 02:13:34,038][106225] Updated weights for policy 1, policy_version 972185 (0.0009) [2023-12-28 02:13:34,508][106226] Updated weights for policy 0, policy_version 969928 (0.0008) [2023-12-28 02:13:34,574][106226] Updated weights for policy 0, policy_version 969938 (0.0009) [2023-12-28 02:13:34,627][106226] Updated weights for policy 0, policy_version 969948 (0.0010) [2023-12-28 02:13:34,811][106225] Updated weights for policy 1, policy_version 972195 (0.0009) [2023-12-28 02:13:34,871][106225] Updated weights for policy 1, policy_version 972205 (0.0008) [2023-12-28 02:13:34,937][106225] Updated weights for policy 1, policy_version 972215 (0.0008) [2023-12-28 02:13:35,235][106226] Updated weights for policy 0, policy_version 969958 (0.0009) [2023-12-28 02:13:35,293][106226] Updated weights for policy 0, policy_version 969968 (0.0008) [2023-12-28 02:13:35,360][106226] Updated weights for policy 0, policy_version 969978 (0.0005) [2023-12-28 02:13:35,663][106225] Updated weights for policy 1, policy_version 972225 (0.0008) [2023-12-28 02:13:35,722][106225] Updated weights for policy 1, policy_version 972235 (0.0008) [2023-12-28 02:13:35,790][106225] Updated weights for policy 1, policy_version 972245 (0.0009) [2023-12-28 02:13:35,856][106225] Updated weights for policy 1, policy_version 972255 (0.0009) [2023-12-28 02:13:35,974][106226] Updated weights for policy 0, policy_version 969988 (0.0007) [2023-12-28 02:13:36,022][106226] Updated weights for policy 0, policy_version 969998 (0.0008) [2023-12-28 02:13:36,068][106226] Updated weights for policy 0, policy_version 970008 (0.0008) [2023-12-28 02:13:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 497319936. Throughput: 0: 10094.3, 1: 9607.0. Samples: 497324200. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:36,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.976')] [2023-12-28 02:13:36,566][106225] Updated weights for policy 1, policy_version 972265 (0.0007) [2023-12-28 02:13:36,615][106225] Updated weights for policy 1, policy_version 972275 (0.0008) [2023-12-28 02:13:36,668][106225] Updated weights for policy 1, policy_version 972285 (0.0008) [2023-12-28 02:13:36,859][106226] Updated weights for policy 0, policy_version 970018 (0.0008) [2023-12-28 02:13:36,916][106226] Updated weights for policy 0, policy_version 970028 (0.0008) [2023-12-28 02:13:36,978][106226] Updated weights for policy 0, policy_version 970038 (0.0008) [2023-12-28 02:13:37,039][106226] Updated weights for policy 0, policy_version 970048 (0.0010) [2023-12-28 02:13:37,384][106225] Updated weights for policy 1, policy_version 972295 (0.0008) [2023-12-28 02:13:37,438][106225] Updated weights for policy 1, policy_version 972305 (0.0009) [2023-12-28 02:13:37,494][106225] Updated weights for policy 1, policy_version 972315 (0.0008) [2023-12-28 02:13:37,725][106226] Updated weights for policy 0, policy_version 970058 (0.0007) [2023-12-28 02:13:37,778][106226] Updated weights for policy 0, policy_version 970068 (0.0008) [2023-12-28 02:13:37,831][106226] Updated weights for policy 0, policy_version 970078 (0.0010) [2023-12-28 02:13:38,251][106225] Updated weights for policy 1, policy_version 972325 (0.0008) [2023-12-28 02:13:38,316][106225] Updated weights for policy 1, policy_version 972335 (0.0009) [2023-12-28 02:13:38,380][106225] Updated weights for policy 1, policy_version 972345 (0.0008) [2023-12-28 02:13:38,490][106226] Updated weights for policy 0, policy_version 970088 (0.0011) [2023-12-28 02:13:38,554][106226] Updated weights for policy 0, policy_version 970098 (0.0010) [2023-12-28 02:13:38,607][106226] Updated weights for policy 0, policy_version 970108 (0.0010) [2023-12-28 02:13:39,156][106225] Updated weights for policy 1, policy_version 972355 (0.0008) [2023-12-28 02:13:39,216][106225] Updated weights for policy 1, policy_version 972365 (0.0008) [2023-12-28 02:13:39,258][106226] Updated weights for policy 0, policy_version 970118 (0.0013) [2023-12-28 02:13:39,281][106225] Updated weights for policy 1, policy_version 972375 (0.0008) [2023-12-28 02:13:39,320][106226] Updated weights for policy 0, policy_version 970128 (0.0007) [2023-12-28 02:13:39,386][106226] Updated weights for policy 0, policy_version 970138 (0.0008) [2023-12-28 02:13:40,075][106226] Updated weights for policy 0, policy_version 970148 (0.0008) [2023-12-28 02:13:40,096][106225] Updated weights for policy 1, policy_version 972385 (0.0008) [2023-12-28 02:13:40,145][106226] Updated weights for policy 0, policy_version 970158 (0.0007) [2023-12-28 02:13:40,161][106225] Updated weights for policy 1, policy_version 972395 (0.0009) [2023-12-28 02:13:40,208][106226] Updated weights for policy 0, policy_version 970168 (0.0007) [2023-12-28 02:13:40,225][106225] Updated weights for policy 1, policy_version 972405 (0.0006) [2023-12-28 02:13:40,291][106225] Updated weights for policy 1, policy_version 972415 (0.0006) [2023-12-28 02:13:40,944][106226] Updated weights for policy 0, policy_version 970178 (0.0007) [2023-12-28 02:13:40,965][106225] Updated weights for policy 1, policy_version 972425 (0.0007) [2023-12-28 02:13:41,006][106226] Updated weights for policy 0, policy_version 970188 (0.0007) [2023-12-28 02:13:41,030][106225] Updated weights for policy 1, policy_version 972435 (0.0006) [2023-12-28 02:13:41,072][106226] Updated weights for policy 0, policy_version 970198 (0.0008) [2023-12-28 02:13:41,098][106225] Updated weights for policy 1, policy_version 972445 (0.0008) [2023-12-28 02:13:41,139][106226] Updated weights for policy 0, policy_version 970208 (0.0007) [2023-12-28 02:13:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 497418240. Throughput: 0: 10095.6, 1: 9567.4. Samples: 497382552. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:41,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-5.175')] [2023-12-28 02:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000970208_248430592.pth... [2023-12-28 02:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000972448_248987648.pth... [2023-12-28 02:13:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000969024_248127488.pth [2023-12-28 02:13:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_000970208_248430592.pth [2023-12-28 02:13:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000971328_248700928.pth [2023-12-28 02:13:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_000972448_248987648.pth [2023-12-28 02:13:41,846][106225] Updated weights for policy 1, policy_version 972455 (0.0008) [2023-12-28 02:13:41,895][106225] Updated weights for policy 1, policy_version 972465 (0.0008) [2023-12-28 02:13:41,899][106226] Updated weights for policy 0, policy_version 970218 (0.0007) [2023-12-28 02:13:41,955][106225] Updated weights for policy 1, policy_version 972475 (0.0008) [2023-12-28 02:13:41,963][106226] Updated weights for policy 0, policy_version 970228 (0.0008) [2023-12-28 02:13:42,021][106226] Updated weights for policy 0, policy_version 970238 (0.0008) [2023-12-28 02:13:42,625][106225] Updated weights for policy 1, policy_version 972485 (0.0009) [2023-12-28 02:13:42,679][106225] Updated weights for policy 1, policy_version 972495 (0.0009) [2023-12-28 02:13:42,735][106225] Updated weights for policy 1, policy_version 972505 (0.0008) [2023-12-28 02:13:42,766][106226] Updated weights for policy 0, policy_version 970248 (0.0006) [2023-12-28 02:13:42,824][106226] Updated weights for policy 0, policy_version 970258 (0.0008) [2023-12-28 02:13:42,886][106226] Updated weights for policy 0, policy_version 970268 (0.0008) [2023-12-28 02:13:43,487][106225] Updated weights for policy 1, policy_version 972515 (0.0008) [2023-12-28 02:13:43,550][106225] Updated weights for policy 1, policy_version 972525 (0.0009) [2023-12-28 02:13:43,604][106226] Updated weights for policy 0, policy_version 970278 (0.0007) [2023-12-28 02:13:43,609][106225] Updated weights for policy 1, policy_version 972535 (0.0007) [2023-12-28 02:13:43,664][106226] Updated weights for policy 0, policy_version 970288 (0.0008) [2023-12-28 02:13:43,722][106226] Updated weights for policy 0, policy_version 970298 (0.0011) [2023-12-28 02:13:44,185][106225] Updated weights for policy 1, policy_version 972545 (0.0006) [2023-12-28 02:13:44,245][106225] Updated weights for policy 1, policy_version 972555 (0.0008) [2023-12-28 02:13:44,306][106225] Updated weights for policy 1, policy_version 972565 (0.0006) [2023-12-28 02:13:44,367][106225] Updated weights for policy 1, policy_version 972575 (0.0006) [2023-12-28 02:13:44,470][106226] Updated weights for policy 0, policy_version 970308 (0.0010) [2023-12-28 02:13:44,531][106226] Updated weights for policy 0, policy_version 970318 (0.0011) [2023-12-28 02:13:44,589][106226] Updated weights for policy 0, policy_version 970328 (0.0009) [2023-12-28 02:13:45,100][106225] Updated weights for policy 1, policy_version 972585 (0.0010) [2023-12-28 02:13:45,160][106225] Updated weights for policy 1, policy_version 972595 (0.0008) [2023-12-28 02:13:45,218][106225] Updated weights for policy 1, policy_version 972605 (0.0009) [2023-12-28 02:13:45,323][106226] Updated weights for policy 0, policy_version 970338 (0.0008) [2023-12-28 02:13:45,383][106226] Updated weights for policy 0, policy_version 970348 (0.0009) [2023-12-28 02:13:45,451][106226] Updated weights for policy 0, policy_version 970358 (0.0009) [2023-12-28 02:13:45,516][106226] Updated weights for policy 0, policy_version 970368 (0.0009) [2023-12-28 02:13:45,893][106225] Updated weights for policy 1, policy_version 972615 (0.0008) [2023-12-28 02:13:45,958][106225] Updated weights for policy 1, policy_version 972625 (0.0009) [2023-12-28 02:13:46,011][106225] Updated weights for policy 1, policy_version 972635 (0.0008) [2023-12-28 02:13:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 497508352. Throughput: 0: 9987.0, 1: 9621.3. Samples: 497497524. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:46,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.866')] [2023-12-28 02:13:46,247][106226] Updated weights for policy 0, policy_version 970378 (0.0009) [2023-12-28 02:13:46,309][106226] Updated weights for policy 0, policy_version 970388 (0.0009) [2023-12-28 02:13:46,361][106226] Updated weights for policy 0, policy_version 970398 (0.0008) [2023-12-28 02:13:46,637][106225] Updated weights for policy 1, policy_version 972645 (0.0009) [2023-12-28 02:13:46,688][106225] Updated weights for policy 1, policy_version 972655 (0.0008) [2023-12-28 02:13:46,740][106225] Updated weights for policy 1, policy_version 972665 (0.0008) [2023-12-28 02:13:47,075][106226] Updated weights for policy 0, policy_version 970408 (0.0006) [2023-12-28 02:13:47,126][106226] Updated weights for policy 0, policy_version 970418 (0.0005) [2023-12-28 02:13:47,182][106226] Updated weights for policy 0, policy_version 970428 (0.0005) [2023-12-28 02:13:47,525][106225] Updated weights for policy 1, policy_version 972675 (0.0008) [2023-12-28 02:13:47,576][106225] Updated weights for policy 1, policy_version 972685 (0.0008) [2023-12-28 02:13:47,635][106225] Updated weights for policy 1, policy_version 972695 (0.0009) [2023-12-28 02:13:47,727][106226] Updated weights for policy 0, policy_version 970438 (0.0007) [2023-12-28 02:13:47,783][106226] Updated weights for policy 0, policy_version 970448 (0.0008) [2023-12-28 02:13:47,840][106226] Updated weights for policy 0, policy_version 970458 (0.0007) [2023-12-28 02:13:48,379][106225] Updated weights for policy 1, policy_version 972705 (0.0009) [2023-12-28 02:13:48,434][106225] Updated weights for policy 1, policy_version 972715 (0.0008) [2023-12-28 02:13:48,494][106225] Updated weights for policy 1, policy_version 972725 (0.0008) [2023-12-28 02:13:48,545][106226] Updated weights for policy 0, policy_version 970468 (0.0007) [2023-12-28 02:13:48,553][106225] Updated weights for policy 1, policy_version 972735 (0.0008) [2023-12-28 02:13:48,609][106226] Updated weights for policy 0, policy_version 970478 (0.0007) [2023-12-28 02:13:48,679][106226] Updated weights for policy 0, policy_version 970488 (0.0010) [2023-12-28 02:13:49,300][106225] Updated weights for policy 1, policy_version 972745 (0.0007) [2023-12-28 02:13:49,371][106225] Updated weights for policy 1, policy_version 972755 (0.0009) [2023-12-28 02:13:49,396][106226] Updated weights for policy 0, policy_version 970498 (0.0008) [2023-12-28 02:13:49,437][106225] Updated weights for policy 1, policy_version 972765 (0.0008) [2023-12-28 02:13:49,457][106226] Updated weights for policy 0, policy_version 970508 (0.0006) [2023-12-28 02:13:49,517][106226] Updated weights for policy 0, policy_version 970518 (0.0008) [2023-12-28 02:13:49,579][106226] Updated weights for policy 0, policy_version 970528 (0.0008) [2023-12-28 02:13:50,250][106226] Updated weights for policy 0, policy_version 970538 (0.0007) [2023-12-28 02:13:50,258][106225] Updated weights for policy 1, policy_version 972775 (0.0008) [2023-12-28 02:13:50,311][106226] Updated weights for policy 0, policy_version 970548 (0.0007) [2023-12-28 02:13:50,317][106225] Updated weights for policy 1, policy_version 972785 (0.0009) [2023-12-28 02:13:50,375][106225] Updated weights for policy 1, policy_version 972795 (0.0006) [2023-12-28 02:13:50,377][106226] Updated weights for policy 0, policy_version 970558 (0.0007) [2023-12-28 02:13:51,019][106226] Updated weights for policy 0, policy_version 970568 (0.0010) [2023-12-28 02:13:51,088][106226] Updated weights for policy 0, policy_version 970578 (0.0009) [2023-12-28 02:13:51,154][106226] Updated weights for policy 0, policy_version 970588 (0.0008) [2023-12-28 02:13:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 497606656. Throughput: 0: 10007.1, 1: 9536.9. Samples: 497614340. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:51,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-4.921')] [2023-12-28 02:13:51,239][106225] Updated weights for policy 1, policy_version 972805 (0.0007) [2023-12-28 02:13:51,305][106225] Updated weights for policy 1, policy_version 972815 (0.0006) [2023-12-28 02:13:51,370][106225] Updated weights for policy 1, policy_version 972825 (0.0007) [2023-12-28 02:13:51,945][106226] Updated weights for policy 0, policy_version 970598 (0.0010) [2023-12-28 02:13:52,011][106226] Updated weights for policy 0, policy_version 970608 (0.0011) [2023-12-28 02:13:52,016][106225] Updated weights for policy 1, policy_version 972835 (0.0006) [2023-12-28 02:13:52,064][106225] Updated weights for policy 1, policy_version 972845 (0.0007) [2023-12-28 02:13:52,075][106226] Updated weights for policy 0, policy_version 970618 (0.0011) [2023-12-28 02:13:52,118][106225] Updated weights for policy 1, policy_version 972855 (0.0007) [2023-12-28 02:13:52,750][106226] Updated weights for policy 0, policy_version 970628 (0.0009) [2023-12-28 02:13:52,807][106226] Updated weights for policy 0, policy_version 970638 (0.0006) [2023-12-28 02:13:52,853][106225] Updated weights for policy 1, policy_version 972865 (0.0007) [2023-12-28 02:13:52,867][106226] Updated weights for policy 0, policy_version 970648 (0.0007) [2023-12-28 02:13:52,906][106225] Updated weights for policy 1, policy_version 972875 (0.0006) [2023-12-28 02:13:52,957][106225] Updated weights for policy 1, policy_version 972885 (0.0005) [2023-12-28 02:13:53,004][106225] Updated weights for policy 1, policy_version 972895 (0.0005) [2023-12-28 02:13:53,429][106226] Updated weights for policy 0, policy_version 970658 (0.0006) [2023-12-28 02:13:53,475][106226] Updated weights for policy 0, policy_version 970668 (0.0005) [2023-12-28 02:13:53,525][106226] Updated weights for policy 0, policy_version 970678 (0.0006) [2023-12-28 02:13:53,570][106225] Updated weights for policy 1, policy_version 972905 (0.0008) [2023-12-28 02:13:53,576][106226] Updated weights for policy 0, policy_version 970688 (0.0006) [2023-12-28 02:13:53,618][106225] Updated weights for policy 1, policy_version 972915 (0.0008) [2023-12-28 02:13:53,674][106225] Updated weights for policy 1, policy_version 972925 (0.0008) [2023-12-28 02:13:54,220][106226] Updated weights for policy 0, policy_version 970698 (0.0009) [2023-12-28 02:13:54,266][106226] Updated weights for policy 0, policy_version 970708 (0.0008) [2023-12-28 02:13:54,314][106226] Updated weights for policy 0, policy_version 970718 (0.0008) [2023-12-28 02:13:54,447][106225] Updated weights for policy 1, policy_version 972935 (0.0009) [2023-12-28 02:13:54,504][106225] Updated weights for policy 1, policy_version 972945 (0.0008) [2023-12-28 02:13:54,556][106225] Updated weights for policy 1, policy_version 972955 (0.0008) [2023-12-28 02:13:55,043][106226] Updated weights for policy 0, policy_version 970728 (0.0009) [2023-12-28 02:13:55,111][106226] Updated weights for policy 0, policy_version 970738 (0.0007) [2023-12-28 02:13:55,166][106226] Updated weights for policy 0, policy_version 970748 (0.0006) [2023-12-28 02:13:55,312][106225] Updated weights for policy 1, policy_version 972965 (0.0008) [2023-12-28 02:13:55,367][106225] Updated weights for policy 1, policy_version 972975 (0.0005) [2023-12-28 02:13:55,423][106225] Updated weights for policy 1, policy_version 972985 (0.0005) [2023-12-28 02:13:55,718][106226] Updated weights for policy 0, policy_version 970758 (0.0007) [2023-12-28 02:13:55,777][106226] Updated weights for policy 0, policy_version 970768 (0.0009) [2023-12-28 02:13:55,828][106226] Updated weights for policy 0, policy_version 970778 (0.0008) [2023-12-28 02:13:56,090][106225] Updated weights for policy 1, policy_version 972995 (0.0006) [2023-12-28 02:13:56,161][106225] Updated weights for policy 1, policy_version 973005 (0.0009) [2023-12-28 02:13:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 497704960. Throughput: 0: 9987.6, 1: 9562.4. Samples: 497676076. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:13:56,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-4.931')] [2023-12-28 02:13:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000970784_248578048.pth... [2023-12-28 02:13:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000969600_248274944.pth [2023-12-28 02:13:56,230][106225] Updated weights for policy 1, policy_version 973015 (0.0009) [2023-12-28 02:13:56,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000973024_249135104.pth... [2023-12-28 02:13:56,284][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000971904_248848384.pth [2023-12-28 02:13:56,526][106226] Updated weights for policy 0, policy_version 970788 (0.0009) [2023-12-28 02:13:56,585][106226] Updated weights for policy 0, policy_version 970798 (0.0008) [2023-12-28 02:13:56,632][106226] Updated weights for policy 0, policy_version 970808 (0.0008) [2023-12-28 02:13:56,964][106225] Updated weights for policy 1, policy_version 973025 (0.0008) [2023-12-28 02:13:57,011][106225] Updated weights for policy 1, policy_version 973035 (0.0008) [2023-12-28 02:13:57,077][106225] Updated weights for policy 1, policy_version 973045 (0.0009) [2023-12-28 02:13:57,128][106225] Updated weights for policy 1, policy_version 973055 (0.0008) [2023-12-28 02:13:57,325][106226] Updated weights for policy 0, policy_version 970818 (0.0009) [2023-12-28 02:13:57,376][106226] Updated weights for policy 0, policy_version 970828 (0.0008) [2023-12-28 02:13:57,423][106226] Updated weights for policy 0, policy_version 970838 (0.0008) [2023-12-28 02:13:57,466][106226] Updated weights for policy 0, policy_version 970848 (0.0008) [2023-12-28 02:13:57,845][106225] Updated weights for policy 1, policy_version 973065 (0.0008) [2023-12-28 02:13:57,906][106225] Updated weights for policy 1, policy_version 973075 (0.0008) [2023-12-28 02:13:57,967][106225] Updated weights for policy 1, policy_version 973085 (0.0008) [2023-12-28 02:13:58,192][106226] Updated weights for policy 0, policy_version 970858 (0.0008) [2023-12-28 02:13:58,255][106226] Updated weights for policy 0, policy_version 970868 (0.0009) [2023-12-28 02:13:58,308][106226] Updated weights for policy 0, policy_version 970878 (0.0008) [2023-12-28 02:13:58,692][106225] Updated weights for policy 1, policy_version 973095 (0.0009) [2023-12-28 02:13:58,757][106225] Updated weights for policy 1, policy_version 973105 (0.0008) [2023-12-28 02:13:58,823][106225] Updated weights for policy 1, policy_version 973115 (0.0009) [2023-12-28 02:13:59,159][106226] Updated weights for policy 0, policy_version 970888 (0.0010) [2023-12-28 02:13:59,227][106226] Updated weights for policy 0, policy_version 970898 (0.0011) [2023-12-28 02:13:59,292][106226] Updated weights for policy 0, policy_version 970908 (0.0010) [2023-12-28 02:13:59,618][106225] Updated weights for policy 1, policy_version 973125 (0.0008) [2023-12-28 02:13:59,677][106225] Updated weights for policy 1, policy_version 973135 (0.0006) [2023-12-28 02:13:59,736][106225] Updated weights for policy 1, policy_version 973145 (0.0005) [2023-12-28 02:14:00,050][106226] Updated weights for policy 0, policy_version 970918 (0.0010) [2023-12-28 02:14:00,112][106226] Updated weights for policy 0, policy_version 970928 (0.0009) [2023-12-28 02:14:00,169][106226] Updated weights for policy 0, policy_version 970938 (0.0008) [2023-12-28 02:14:00,371][106225] Updated weights for policy 1, policy_version 973155 (0.0007) [2023-12-28 02:14:00,433][106225] Updated weights for policy 1, policy_version 973165 (0.0010) [2023-12-28 02:14:00,498][106225] Updated weights for policy 1, policy_version 973175 (0.0009) [2023-12-28 02:14:00,790][106226] Updated weights for policy 0, policy_version 970948 (0.0007) [2023-12-28 02:14:00,847][106226] Updated weights for policy 0, policy_version 970958 (0.0006) [2023-12-28 02:14:00,904][106226] Updated weights for policy 0, policy_version 970968 (0.0006) [2023-12-28 02:14:01,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 497803264. Throughput: 0: 10041.6, 1: 9555.6. Samples: 497791852. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:01,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-5.046')] [2023-12-28 02:14:01,301][106225] Updated weights for policy 1, policy_version 973185 (0.0010) [2023-12-28 02:14:01,371][106225] Updated weights for policy 1, policy_version 973195 (0.0008) [2023-12-28 02:14:01,433][106225] Updated weights for policy 1, policy_version 973205 (0.0008) [2023-12-28 02:14:01,484][106225] Updated weights for policy 1, policy_version 973215 (0.0008) [2023-12-28 02:14:01,564][106226] Updated weights for policy 0, policy_version 970978 (0.0005) [2023-12-28 02:14:01,629][106226] Updated weights for policy 0, policy_version 970988 (0.0007) [2023-12-28 02:14:01,696][106226] Updated weights for policy 0, policy_version 970998 (0.0007) [2023-12-28 02:14:01,767][106226] Updated weights for policy 0, policy_version 971008 (0.0011) [2023-12-28 02:14:02,281][106225] Updated weights for policy 1, policy_version 973225 (0.0008) [2023-12-28 02:14:02,346][106225] Updated weights for policy 1, policy_version 973235 (0.0007) [2023-12-28 02:14:02,408][106225] Updated weights for policy 1, policy_version 973245 (0.0007) [2023-12-28 02:14:02,433][106226] Updated weights for policy 0, policy_version 971018 (0.0008) [2023-12-28 02:14:02,496][106226] Updated weights for policy 0, policy_version 971028 (0.0007) [2023-12-28 02:14:02,553][106226] Updated weights for policy 0, policy_version 971038 (0.0009) [2023-12-28 02:14:03,109][106225] Updated weights for policy 1, policy_version 973255 (0.0010) [2023-12-28 02:14:03,162][106225] Updated weights for policy 1, policy_version 973265 (0.0010) [2023-12-28 02:14:03,218][106225] Updated weights for policy 1, policy_version 973275 (0.0011) [2023-12-28 02:14:03,232][106226] Updated weights for policy 0, policy_version 971048 (0.0008) [2023-12-28 02:14:03,286][106226] Updated weights for policy 0, policy_version 971058 (0.0010) [2023-12-28 02:14:03,340][106226] Updated weights for policy 0, policy_version 971068 (0.0007) [2023-12-28 02:14:03,884][106226] Updated weights for policy 0, policy_version 971078 (0.0007) [2023-12-28 02:14:03,952][106226] Updated weights for policy 0, policy_version 971088 (0.0010) [2023-12-28 02:14:03,965][106225] Updated weights for policy 1, policy_version 973285 (0.0010) [2023-12-28 02:14:04,015][106226] Updated weights for policy 0, policy_version 971098 (0.0010) [2023-12-28 02:14:04,038][106225] Updated weights for policy 1, policy_version 973295 (0.0009) [2023-12-28 02:14:04,100][106225] Updated weights for policy 1, policy_version 973305 (0.0007) [2023-12-28 02:14:04,725][106226] Updated weights for policy 0, policy_version 971108 (0.0011) [2023-12-28 02:14:04,783][106226] Updated weights for policy 0, policy_version 971118 (0.0010) [2023-12-28 02:14:04,830][106225] Updated weights for policy 1, policy_version 973315 (0.0007) [2023-12-28 02:14:04,832][106226] Updated weights for policy 0, policy_version 971128 (0.0010) [2023-12-28 02:14:04,885][106225] Updated weights for policy 1, policy_version 973325 (0.0006) [2023-12-28 02:14:04,945][106225] Updated weights for policy 1, policy_version 973335 (0.0007) [2023-12-28 02:14:05,568][106226] Updated weights for policy 0, policy_version 971138 (0.0010) [2023-12-28 02:14:05,596][106225] Updated weights for policy 1, policy_version 973345 (0.0007) [2023-12-28 02:14:05,634][106226] Updated weights for policy 0, policy_version 971148 (0.0010) [2023-12-28 02:14:05,645][106225] Updated weights for policy 1, policy_version 973355 (0.0010) [2023-12-28 02:14:05,695][106226] Updated weights for policy 0, policy_version 971158 (0.0010) [2023-12-28 02:14:05,703][106225] Updated weights for policy 1, policy_version 973365 (0.0010) [2023-12-28 02:14:05,746][106226] Updated weights for policy 0, policy_version 971168 (0.0010) [2023-12-28 02:14:05,763][106225] Updated weights for policy 1, policy_version 973375 (0.0010) [2023-12-28 02:14:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 497901568. Throughput: 0: 10096.4, 1: 9560.4. Samples: 497911796. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:06,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-5.081')] [2023-12-28 02:14:06,425][106226] Updated weights for policy 0, policy_version 971178 (0.0008) [2023-12-28 02:14:06,465][106225] Updated weights for policy 1, policy_version 973385 (0.0008) [2023-12-28 02:14:06,488][106226] Updated weights for policy 0, policy_version 971188 (0.0008) [2023-12-28 02:14:06,524][106225] Updated weights for policy 1, policy_version 973395 (0.0008) [2023-12-28 02:14:06,554][106226] Updated weights for policy 0, policy_version 971198 (0.0008) [2023-12-28 02:14:06,579][106225] Updated weights for policy 1, policy_version 973405 (0.0008) [2023-12-28 02:14:07,186][106226] Updated weights for policy 0, policy_version 971208 (0.0006) [2023-12-28 02:14:07,237][106225] Updated weights for policy 1, policy_version 973415 (0.0008) [2023-12-28 02:14:07,241][106226] Updated weights for policy 0, policy_version 971218 (0.0009) [2023-12-28 02:14:07,288][106225] Updated weights for policy 1, policy_version 973425 (0.0010) [2023-12-28 02:14:07,292][106226] Updated weights for policy 0, policy_version 971228 (0.0010) [2023-12-28 02:14:07,343][106225] Updated weights for policy 1, policy_version 973435 (0.0010) [2023-12-28 02:14:07,978][106226] Updated weights for policy 0, policy_version 971238 (0.0010) [2023-12-28 02:14:08,038][106226] Updated weights for policy 0, policy_version 971248 (0.0010) [2023-12-28 02:14:08,055][106225] Updated weights for policy 1, policy_version 973445 (0.0009) [2023-12-28 02:14:08,098][106226] Updated weights for policy 0, policy_version 971258 (0.0010) [2023-12-28 02:14:08,112][106225] Updated weights for policy 1, policy_version 973455 (0.0008) [2023-12-28 02:14:08,172][106225] Updated weights for policy 1, policy_version 973465 (0.0007) [2023-12-28 02:14:08,784][106226] Updated weights for policy 0, policy_version 971268 (0.0010) [2023-12-28 02:14:08,844][106226] Updated weights for policy 0, policy_version 971278 (0.0010) [2023-12-28 02:14:08,898][106226] Updated weights for policy 0, policy_version 971288 (0.0010) [2023-12-28 02:14:08,934][106225] Updated weights for policy 1, policy_version 973475 (0.0007) [2023-12-28 02:14:08,994][106225] Updated weights for policy 1, policy_version 973485 (0.0008) [2023-12-28 02:14:09,058][106225] Updated weights for policy 1, policy_version 973495 (0.0008) [2023-12-28 02:14:09,653][106226] Updated weights for policy 0, policy_version 971298 (0.0010) [2023-12-28 02:14:09,719][106226] Updated weights for policy 0, policy_version 971308 (0.0010) [2023-12-28 02:14:09,757][106225] Updated weights for policy 1, policy_version 973505 (0.0008) [2023-12-28 02:14:09,792][106226] Updated weights for policy 0, policy_version 971318 (0.0006) [2023-12-28 02:14:09,825][106225] Updated weights for policy 1, policy_version 973515 (0.0007) [2023-12-28 02:14:09,868][106226] Updated weights for policy 0, policy_version 971328 (0.0007) [2023-12-28 02:14:09,891][106225] Updated weights for policy 1, policy_version 973525 (0.0008) [2023-12-28 02:14:09,952][106225] Updated weights for policy 1, policy_version 973535 (0.0008) [2023-12-28 02:14:10,525][106226] Updated weights for policy 0, policy_version 971338 (0.0009) [2023-12-28 02:14:10,594][106226] Updated weights for policy 0, policy_version 971348 (0.0009) [2023-12-28 02:14:10,636][106225] Updated weights for policy 1, policy_version 973545 (0.0006) [2023-12-28 02:14:10,643][106226] Updated weights for policy 0, policy_version 971358 (0.0008) [2023-12-28 02:14:10,691][106225] Updated weights for policy 1, policy_version 973555 (0.0005) [2023-12-28 02:14:10,738][106225] Updated weights for policy 1, policy_version 973565 (0.0007) [2023-12-28 02:14:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 497999872. Throughput: 0: 10084.0, 1: 9611.5. Samples: 497971788. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:11,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.850')] [2023-12-28 02:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000973568_249274368.pth... [2023-12-28 02:14:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000971360_248725504.pth... [2023-12-28 02:14:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000972448_248987648.pth [2023-12-28 02:14:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000970208_248430592.pth [2023-12-28 02:14:11,428][106226] Updated weights for policy 0, policy_version 971368 (0.0008) [2023-12-28 02:14:11,445][106225] Updated weights for policy 1, policy_version 973575 (0.0009) [2023-12-28 02:14:11,487][106226] Updated weights for policy 0, policy_version 971378 (0.0008) [2023-12-28 02:14:11,503][106225] Updated weights for policy 1, policy_version 973585 (0.0007) [2023-12-28 02:14:11,543][106226] Updated weights for policy 0, policy_version 971388 (0.0008) [2023-12-28 02:14:11,564][106225] Updated weights for policy 1, policy_version 973595 (0.0007) [2023-12-28 02:14:12,282][106226] Updated weights for policy 0, policy_version 971398 (0.0008) [2023-12-28 02:14:12,348][106226] Updated weights for policy 0, policy_version 971408 (0.0007) [2023-12-28 02:14:12,410][106226] Updated weights for policy 0, policy_version 971418 (0.0008) [2023-12-28 02:14:12,420][106225] Updated weights for policy 1, policy_version 973605 (0.0008) [2023-12-28 02:14:12,480][106225] Updated weights for policy 1, policy_version 973615 (0.0007) [2023-12-28 02:14:12,538][106225] Updated weights for policy 1, policy_version 973625 (0.0008) [2023-12-28 02:14:13,099][106226] Updated weights for policy 0, policy_version 971428 (0.0006) [2023-12-28 02:14:13,157][106226] Updated weights for policy 0, policy_version 971438 (0.0009) [2023-12-28 02:14:13,214][106226] Updated weights for policy 0, policy_version 971448 (0.0011) [2023-12-28 02:14:13,285][106225] Updated weights for policy 1, policy_version 973635 (0.0008) [2023-12-28 02:14:13,331][106225] Updated weights for policy 1, policy_version 973645 (0.0008) [2023-12-28 02:14:13,380][106225] Updated weights for policy 1, policy_version 973655 (0.0008) [2023-12-28 02:14:13,862][106226] Updated weights for policy 0, policy_version 971458 (0.0010) [2023-12-28 02:14:13,921][106226] Updated weights for policy 0, policy_version 971468 (0.0010) [2023-12-28 02:14:13,963][106225] Updated weights for policy 1, policy_version 973665 (0.0007) [2023-12-28 02:14:13,984][106226] Updated weights for policy 0, policy_version 971478 (0.0009) [2023-12-28 02:14:14,019][106225] Updated weights for policy 1, policy_version 973675 (0.0006) [2023-12-28 02:14:14,048][106226] Updated weights for policy 0, policy_version 971488 (0.0006) [2023-12-28 02:14:14,082][106225] Updated weights for policy 1, policy_version 973685 (0.0008) [2023-12-28 02:14:14,145][106225] Updated weights for policy 1, policy_version 973695 (0.0011) [2023-12-28 02:14:14,777][106226] Updated weights for policy 0, policy_version 971498 (0.0007) [2023-12-28 02:14:14,844][106226] Updated weights for policy 0, policy_version 971508 (0.0009) [2023-12-28 02:14:14,861][106225] Updated weights for policy 1, policy_version 973705 (0.0008) [2023-12-28 02:14:14,910][106226] Updated weights for policy 0, policy_version 971518 (0.0011) [2023-12-28 02:14:14,917][106225] Updated weights for policy 1, policy_version 973715 (0.0007) [2023-12-28 02:14:14,971][106225] Updated weights for policy 1, policy_version 973725 (0.0009) [2023-12-28 02:14:15,584][106226] Updated weights for policy 0, policy_version 971528 (0.0006) [2023-12-28 02:14:15,632][106226] Updated weights for policy 0, policy_version 971538 (0.0005) [2023-12-28 02:14:15,683][106226] Updated weights for policy 0, policy_version 971548 (0.0005) [2023-12-28 02:14:15,692][106225] Updated weights for policy 1, policy_version 973735 (0.0010) [2023-12-28 02:14:15,739][106225] Updated weights for policy 1, policy_version 973745 (0.0010) [2023-12-28 02:14:15,784][106225] Updated weights for policy 1, policy_version 973755 (0.0010) [2023-12-28 02:14:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 498098176. Throughput: 0: 9991.3, 1: 9618.0. Samples: 498088588. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:16,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-5.238')] [2023-12-28 02:14:16,317][106226] Updated weights for policy 0, policy_version 971558 (0.0005) [2023-12-28 02:14:16,368][106226] Updated weights for policy 0, policy_version 971568 (0.0005) [2023-12-28 02:14:16,425][106226] Updated weights for policy 0, policy_version 971578 (0.0006) [2023-12-28 02:14:16,469][106225] Updated weights for policy 1, policy_version 973765 (0.0010) [2023-12-28 02:14:16,522][106225] Updated weights for policy 1, policy_version 973775 (0.0010) [2023-12-28 02:14:16,585][106225] Updated weights for policy 1, policy_version 973785 (0.0010) [2023-12-28 02:14:17,166][106225] Updated weights for policy 1, policy_version 973795 (0.0006) [2023-12-28 02:14:17,167][106226] Updated weights for policy 0, policy_version 971588 (0.0010) [2023-12-28 02:14:17,219][106225] Updated weights for policy 1, policy_version 973805 (0.0006) [2023-12-28 02:14:17,224][106226] Updated weights for policy 0, policy_version 971598 (0.0009) [2023-12-28 02:14:17,269][106226] Updated weights for policy 0, policy_version 971608 (0.0008) [2023-12-28 02:14:17,282][106225] Updated weights for policy 1, policy_version 973815 (0.0005) [2023-12-28 02:14:17,868][106226] Updated weights for policy 0, policy_version 971618 (0.0008) [2023-12-28 02:14:17,903][106225] Updated weights for policy 1, policy_version 973825 (0.0005) [2023-12-28 02:14:17,928][106226] Updated weights for policy 0, policy_version 971628 (0.0009) [2023-12-28 02:14:17,956][106225] Updated weights for policy 1, policy_version 973835 (0.0005) [2023-12-28 02:14:17,974][106226] Updated weights for policy 0, policy_version 971638 (0.0009) [2023-12-28 02:14:18,012][106225] Updated weights for policy 1, policy_version 973845 (0.0005) [2023-12-28 02:14:18,028][106226] Updated weights for policy 0, policy_version 971648 (0.0010) [2023-12-28 02:14:18,075][106225] Updated weights for policy 1, policy_version 973855 (0.0005) [2023-12-28 02:14:18,673][106225] Updated weights for policy 1, policy_version 973865 (0.0010) [2023-12-28 02:14:18,727][106225] Updated weights for policy 1, policy_version 973875 (0.0010) [2023-12-28 02:14:18,730][106226] Updated weights for policy 0, policy_version 971658 (0.0008) [2023-12-28 02:14:18,788][106225] Updated weights for policy 1, policy_version 973885 (0.0010) [2023-12-28 02:14:18,794][106226] Updated weights for policy 0, policy_version 971668 (0.0006) [2023-12-28 02:14:18,855][106226] Updated weights for policy 0, policy_version 971678 (0.0007) [2023-12-28 02:14:19,514][106226] Updated weights for policy 0, policy_version 971688 (0.0009) [2023-12-28 02:14:19,557][106225] Updated weights for policy 1, policy_version 973895 (0.0010) [2023-12-28 02:14:19,576][106226] Updated weights for policy 0, policy_version 971698 (0.0007) [2023-12-28 02:14:19,619][106225] Updated weights for policy 1, policy_version 973905 (0.0010) [2023-12-28 02:14:19,633][106226] Updated weights for policy 0, policy_version 971708 (0.0010) [2023-12-28 02:14:19,676][106225] Updated weights for policy 1, policy_version 973915 (0.0008) [2023-12-28 02:14:20,331][106225] Updated weights for policy 1, policy_version 973925 (0.0006) [2023-12-28 02:14:20,396][106225] Updated weights for policy 1, policy_version 973935 (0.0011) [2023-12-28 02:14:20,419][106226] Updated weights for policy 0, policy_version 971718 (0.0009) [2023-12-28 02:14:20,457][106225] Updated weights for policy 1, policy_version 973945 (0.0010) [2023-12-28 02:14:20,470][106226] Updated weights for policy 0, policy_version 971728 (0.0010) [2023-12-28 02:14:20,528][106226] Updated weights for policy 0, policy_version 971738 (0.0010) [2023-12-28 02:14:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 498196480. Throughput: 0: 9956.5, 1: 9751.2. Samples: 498211048. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:21,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.163')] [2023-12-28 02:14:21,254][106225] Updated weights for policy 1, policy_version 973955 (0.0010) [2023-12-28 02:14:21,283][106226] Updated weights for policy 0, policy_version 971748 (0.0011) [2023-12-28 02:14:21,318][106225] Updated weights for policy 1, policy_version 973965 (0.0009) [2023-12-28 02:14:21,355][106226] Updated weights for policy 0, policy_version 971758 (0.0010) [2023-12-28 02:14:21,408][106225] Updated weights for policy 1, policy_version 973975 (0.0009) [2023-12-28 02:14:21,421][106226] Updated weights for policy 0, policy_version 971768 (0.0009) [2023-12-28 02:14:22,135][106225] Updated weights for policy 1, policy_version 973985 (0.0009) [2023-12-28 02:14:22,184][106226] Updated weights for policy 0, policy_version 971778 (0.0009) [2023-12-28 02:14:22,192][106225] Updated weights for policy 1, policy_version 973995 (0.0009) [2023-12-28 02:14:22,236][106226] Updated weights for policy 0, policy_version 971788 (0.0006) [2023-12-28 02:14:22,242][106225] Updated weights for policy 1, policy_version 974005 (0.0005) [2023-12-28 02:14:22,303][106226] Updated weights for policy 0, policy_version 971798 (0.0007) [2023-12-28 02:14:22,307][106225] Updated weights for policy 1, policy_version 974015 (0.0007) [2023-12-28 02:14:22,375][106226] Updated weights for policy 0, policy_version 971808 (0.0008) [2023-12-28 02:14:22,954][106225] Updated weights for policy 1, policy_version 974025 (0.0010) [2023-12-28 02:14:23,013][106225] Updated weights for policy 1, policy_version 974035 (0.0010) [2023-12-28 02:14:23,074][106225] Updated weights for policy 1, policy_version 974045 (0.0010) [2023-12-28 02:14:23,161][106226] Updated weights for policy 0, policy_version 971818 (0.0008) [2023-12-28 02:14:23,219][106226] Updated weights for policy 0, policy_version 971828 (0.0008) [2023-12-28 02:14:23,270][106226] Updated weights for policy 0, policy_version 971838 (0.0008) [2023-12-28 02:14:23,735][106225] Updated weights for policy 1, policy_version 974055 (0.0007) [2023-12-28 02:14:23,793][106225] Updated weights for policy 1, policy_version 974065 (0.0006) [2023-12-28 02:14:23,846][106225] Updated weights for policy 1, policy_version 974075 (0.0007) [2023-12-28 02:14:24,069][106226] Updated weights for policy 0, policy_version 971848 (0.0008) [2023-12-28 02:14:24,117][106226] Updated weights for policy 0, policy_version 971858 (0.0008) [2023-12-28 02:14:24,167][106226] Updated weights for policy 0, policy_version 971868 (0.0008) [2023-12-28 02:14:24,486][106225] Updated weights for policy 1, policy_version 974085 (0.0007) [2023-12-28 02:14:24,549][106225] Updated weights for policy 1, policy_version 974095 (0.0007) [2023-12-28 02:14:24,615][106225] Updated weights for policy 1, policy_version 974105 (0.0005) [2023-12-28 02:14:24,970][106226] Updated weights for policy 0, policy_version 971878 (0.0009) [2023-12-28 02:14:25,032][106226] Updated weights for policy 0, policy_version 971888 (0.0009) [2023-12-28 02:14:25,078][106226] Updated weights for policy 0, policy_version 971898 (0.0008) [2023-12-28 02:14:25,244][106225] Updated weights for policy 1, policy_version 974115 (0.0008) [2023-12-28 02:14:25,295][106225] Updated weights for policy 1, policy_version 974125 (0.0008) [2023-12-28 02:14:25,340][106225] Updated weights for policy 1, policy_version 974135 (0.0008) [2023-12-28 02:14:25,837][106226] Updated weights for policy 0, policy_version 971908 (0.0008) [2023-12-28 02:14:25,892][106226] Updated weights for policy 0, policy_version 971918 (0.0005) [2023-12-28 02:14:25,948][106226] Updated weights for policy 0, policy_version 971928 (0.0005) [2023-12-28 02:14:26,049][106225] Updated weights for policy 1, policy_version 974145 (0.0008) [2023-12-28 02:14:26,114][106225] Updated weights for policy 1, policy_version 974155 (0.0007) [2023-12-28 02:14:26,165][106225] Updated weights for policy 1, policy_version 974165 (0.0009) [2023-12-28 02:14:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 498294784. Throughput: 0: 9896.2, 1: 9776.1. Samples: 498267804. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:26,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-5.239')] [2023-12-28 02:14:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000971936_248872960.pth... [2023-12-28 02:14:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000970784_248578048.pth [2023-12-28 02:14:26,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000974176_249430016.pth... [2023-12-28 02:14:26,224][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000973024_249135104.pth [2023-12-28 02:14:26,225][106225] Updated weights for policy 1, policy_version 974176 (0.0010) [2023-12-28 02:14:26,567][106226] Updated weights for policy 0, policy_version 971938 (0.0006) [2023-12-28 02:14:26,630][106226] Updated weights for policy 0, policy_version 971948 (0.0007) [2023-12-28 02:14:26,682][106226] Updated weights for policy 0, policy_version 971958 (0.0005) [2023-12-28 02:14:26,736][106226] Updated weights for policy 0, policy_version 971968 (0.0006) [2023-12-28 02:14:26,883][106225] Updated weights for policy 1, policy_version 974186 (0.0005) [2023-12-28 02:14:26,928][106225] Updated weights for policy 1, policy_version 974196 (0.0005) [2023-12-28 02:14:26,973][106225] Updated weights for policy 1, policy_version 974206 (0.0006) [2023-12-28 02:14:27,366][106226] Updated weights for policy 0, policy_version 971978 (0.0009) [2023-12-28 02:14:27,424][106226] Updated weights for policy 0, policy_version 971988 (0.0008) [2023-12-28 02:14:27,474][106226] Updated weights for policy 0, policy_version 971998 (0.0008) [2023-12-28 02:14:27,680][106225] Updated weights for policy 1, policy_version 974216 (0.0007) [2023-12-28 02:14:27,728][106225] Updated weights for policy 1, policy_version 974226 (0.0005) [2023-12-28 02:14:27,783][106225] Updated weights for policy 1, policy_version 974236 (0.0005) [2023-12-28 02:14:28,208][106226] Updated weights for policy 0, policy_version 972008 (0.0006) [2023-12-28 02:14:28,273][106226] Updated weights for policy 0, policy_version 972018 (0.0006) [2023-12-28 02:14:28,313][106225] Updated weights for policy 1, policy_version 974246 (0.0005) [2023-12-28 02:14:28,323][106226] Updated weights for policy 0, policy_version 972028 (0.0006) [2023-12-28 02:14:28,380][106225] Updated weights for policy 1, policy_version 974256 (0.0008) [2023-12-28 02:14:28,443][106225] Updated weights for policy 1, policy_version 974266 (0.0008) [2023-12-28 02:14:29,018][106225] Updated weights for policy 1, policy_version 974276 (0.0007) [2023-12-28 02:14:29,023][106226] Updated weights for policy 0, policy_version 972038 (0.0009) [2023-12-28 02:14:29,074][106226] Updated weights for policy 0, policy_version 972048 (0.0008) [2023-12-28 02:14:29,075][106225] Updated weights for policy 1, policy_version 974286 (0.0006) [2023-12-28 02:14:29,125][106225] Updated weights for policy 1, policy_version 974296 (0.0005) [2023-12-28 02:14:29,139][106226] Updated weights for policy 0, policy_version 972058 (0.0010) [2023-12-28 02:14:29,836][106226] Updated weights for policy 0, policy_version 972068 (0.0009) [2023-12-28 02:14:29,837][106225] Updated weights for policy 1, policy_version 974306 (0.0006) [2023-12-28 02:14:29,897][106225] Updated weights for policy 1, policy_version 974316 (0.0006) [2023-12-28 02:14:29,899][106226] Updated weights for policy 0, policy_version 972078 (0.0008) [2023-12-28 02:14:29,961][106225] Updated weights for policy 1, policy_version 974326 (0.0008) [2023-12-28 02:14:29,962][106226] Updated weights for policy 0, policy_version 972088 (0.0007) [2023-12-28 02:14:30,015][106225] Updated weights for policy 1, policy_version 974336 (0.0009) [2023-12-28 02:14:30,584][106226] Updated weights for policy 0, policy_version 972098 (0.0006) [2023-12-28 02:14:30,641][106226] Updated weights for policy 0, policy_version 972108 (0.0007) [2023-12-28 02:14:30,699][106226] Updated weights for policy 0, policy_version 972118 (0.0006) [2023-12-28 02:14:30,751][106226] Updated weights for policy 0, policy_version 972128 (0.0009) [2023-12-28 02:14:30,771][106225] Updated weights for policy 1, policy_version 974346 (0.0006) [2023-12-28 02:14:30,840][106225] Updated weights for policy 1, policy_version 974356 (0.0008) [2023-12-28 02:14:30,931][106225] Updated weights for policy 1, policy_version 974366 (0.0008) [2023-12-28 02:14:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 498401280. Throughput: 0: 9953.8, 1: 9911.2. Samples: 498391448. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:31,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.032')] [2023-12-28 02:14:31,358][106226] Updated weights for policy 0, policy_version 972138 (0.0010) [2023-12-28 02:14:31,420][106226] Updated weights for policy 0, policy_version 972148 (0.0008) [2023-12-28 02:14:31,475][106226] Updated weights for policy 0, policy_version 972158 (0.0008) [2023-12-28 02:14:31,662][106225] Updated weights for policy 1, policy_version 974376 (0.0008) [2023-12-28 02:14:31,720][106225] Updated weights for policy 1, policy_version 974386 (0.0008) [2023-12-28 02:14:31,774][106225] Updated weights for policy 1, policy_version 974396 (0.0008) [2023-12-28 02:14:32,153][106226] Updated weights for policy 0, policy_version 972168 (0.0006) [2023-12-28 02:14:32,219][106226] Updated weights for policy 0, policy_version 972178 (0.0006) [2023-12-28 02:14:32,287][106226] Updated weights for policy 0, policy_version 972188 (0.0007) [2023-12-28 02:14:32,510][106225] Updated weights for policy 1, policy_version 974406 (0.0008) [2023-12-28 02:14:32,562][106225] Updated weights for policy 1, policy_version 974416 (0.0009) [2023-12-28 02:14:32,616][106225] Updated weights for policy 1, policy_version 974426 (0.0008) [2023-12-28 02:14:32,974][106226] Updated weights for policy 0, policy_version 972198 (0.0009) [2023-12-28 02:14:33,041][106226] Updated weights for policy 0, policy_version 972208 (0.0009) [2023-12-28 02:14:33,099][106226] Updated weights for policy 0, policy_version 972218 (0.0010) [2023-12-28 02:14:33,286][106225] Updated weights for policy 1, policy_version 974436 (0.0007) [2023-12-28 02:14:33,345][106225] Updated weights for policy 1, policy_version 974446 (0.0008) [2023-12-28 02:14:33,406][106225] Updated weights for policy 1, policy_version 974456 (0.0008) [2023-12-28 02:14:33,799][106226] Updated weights for policy 0, policy_version 972228 (0.0008) [2023-12-28 02:14:33,860][106226] Updated weights for policy 0, policy_version 972238 (0.0007) [2023-12-28 02:14:33,922][106226] Updated weights for policy 0, policy_version 972248 (0.0006) [2023-12-28 02:14:34,106][106225] Updated weights for policy 1, policy_version 974466 (0.0007) [2023-12-28 02:14:34,174][106225] Updated weights for policy 1, policy_version 974476 (0.0007) [2023-12-28 02:14:34,237][106225] Updated weights for policy 1, policy_version 974486 (0.0008) [2023-12-28 02:14:34,309][106225] Updated weights for policy 1, policy_version 974496 (0.0008) [2023-12-28 02:14:34,658][106226] Updated weights for policy 0, policy_version 972258 (0.0009) [2023-12-28 02:14:34,723][106226] Updated weights for policy 0, policy_version 972268 (0.0009) [2023-12-28 02:14:34,784][106226] Updated weights for policy 0, policy_version 972278 (0.0009) [2023-12-28 02:14:34,849][106226] Updated weights for policy 0, policy_version 972288 (0.0009) [2023-12-28 02:14:35,015][106225] Updated weights for policy 1, policy_version 974506 (0.0005) [2023-12-28 02:14:35,067][106225] Updated weights for policy 1, policy_version 974516 (0.0007) [2023-12-28 02:14:35,112][106225] Updated weights for policy 1, policy_version 974526 (0.0008) [2023-12-28 02:14:35,583][106226] Updated weights for policy 0, policy_version 972298 (0.0010) [2023-12-28 02:14:35,640][106226] Updated weights for policy 0, policy_version 972308 (0.0010) [2023-12-28 02:14:35,701][106226] Updated weights for policy 0, policy_version 972318 (0.0010) [2023-12-28 02:14:35,826][106225] Updated weights for policy 1, policy_version 974536 (0.0008) [2023-12-28 02:14:35,888][106225] Updated weights for policy 1, policy_version 974546 (0.0008) [2023-12-28 02:14:35,945][106225] Updated weights for policy 1, policy_version 974556 (0.0008) [2023-12-28 02:14:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 498499584. Throughput: 0: 9932.2, 1: 9940.4. Samples: 498508608. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:36,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-5.000')] [2023-12-28 02:14:36,421][106226] Updated weights for policy 0, policy_version 972328 (0.0007) [2023-12-28 02:14:36,484][106226] Updated weights for policy 0, policy_version 972338 (0.0006) [2023-12-28 02:14:36,542][106226] Updated weights for policy 0, policy_version 972348 (0.0009) [2023-12-28 02:14:36,695][106225] Updated weights for policy 1, policy_version 974566 (0.0009) [2023-12-28 02:14:36,766][106225] Updated weights for policy 1, policy_version 974576 (0.0010) [2023-12-28 02:14:36,833][106225] Updated weights for policy 1, policy_version 974586 (0.0010) [2023-12-28 02:14:37,127][106226] Updated weights for policy 0, policy_version 972358 (0.0010) [2023-12-28 02:14:37,186][106226] Updated weights for policy 0, policy_version 972368 (0.0010) [2023-12-28 02:14:37,252][106226] Updated weights for policy 0, policy_version 972378 (0.0011) [2023-12-28 02:14:37,496][106225] Updated weights for policy 1, policy_version 974596 (0.0008) [2023-12-28 02:14:37,559][106225] Updated weights for policy 1, policy_version 974606 (0.0005) [2023-12-28 02:14:37,620][106225] Updated weights for policy 1, policy_version 974616 (0.0005) [2023-12-28 02:14:37,885][106226] Updated weights for policy 0, policy_version 972388 (0.0010) [2023-12-28 02:14:37,945][106226] Updated weights for policy 0, policy_version 972398 (0.0008) [2023-12-28 02:14:38,003][106226] Updated weights for policy 0, policy_version 972408 (0.0008) [2023-12-28 02:14:38,252][106225] Updated weights for policy 1, policy_version 974626 (0.0008) [2023-12-28 02:14:38,312][106225] Updated weights for policy 1, policy_version 974636 (0.0007) [2023-12-28 02:14:38,374][106225] Updated weights for policy 1, policy_version 974646 (0.0009) [2023-12-28 02:14:38,433][106225] Updated weights for policy 1, policy_version 974656 (0.0008) [2023-12-28 02:14:38,663][106226] Updated weights for policy 0, policy_version 972418 (0.0007) [2023-12-28 02:14:38,717][106226] Updated weights for policy 0, policy_version 972428 (0.0010) [2023-12-28 02:14:38,771][106226] Updated weights for policy 0, policy_version 972438 (0.0010) [2023-12-28 02:14:38,826][106226] Updated weights for policy 0, policy_version 972448 (0.0010) [2023-12-28 02:14:39,065][106225] Updated weights for policy 1, policy_version 974666 (0.0005) [2023-12-28 02:14:39,121][106225] Updated weights for policy 1, policy_version 974676 (0.0005) [2023-12-28 02:14:39,184][106225] Updated weights for policy 1, policy_version 974686 (0.0005) [2023-12-28 02:14:39,558][106226] Updated weights for policy 0, policy_version 972458 (0.0006) [2023-12-28 02:14:39,623][106226] Updated weights for policy 0, policy_version 972468 (0.0011) [2023-12-28 02:14:39,688][106226] Updated weights for policy 0, policy_version 972478 (0.0011) [2023-12-28 02:14:39,858][106225] Updated weights for policy 1, policy_version 974696 (0.0009) [2023-12-28 02:14:39,922][106225] Updated weights for policy 1, policy_version 974706 (0.0008) [2023-12-28 02:14:39,985][106225] Updated weights for policy 1, policy_version 974716 (0.0009) [2023-12-28 02:14:40,382][106226] Updated weights for policy 0, policy_version 972488 (0.0010) [2023-12-28 02:14:40,436][106226] Updated weights for policy 0, policy_version 972498 (0.0010) [2023-12-28 02:14:40,490][106226] Updated weights for policy 0, policy_version 972508 (0.0010) [2023-12-28 02:14:40,751][106225] Updated weights for policy 1, policy_version 974726 (0.0009) [2023-12-28 02:14:40,815][106225] Updated weights for policy 1, policy_version 974736 (0.0010) [2023-12-28 02:14:40,872][106225] Updated weights for policy 1, policy_version 974746 (0.0010) [2023-12-28 02:14:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 498597888. Throughput: 0: 9935.7, 1: 9923.3. Samples: 498569728. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:41,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-4.941')] [2023-12-28 02:14:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000974752_249577472.pth... [2023-12-28 02:14:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000972512_249020416.pth... [2023-12-28 02:14:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000973568_249274368.pth [2023-12-28 02:14:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000971360_248725504.pth [2023-12-28 02:14:41,257][106226] Updated weights for policy 0, policy_version 972518 (0.0010) [2023-12-28 02:14:41,321][106226] Updated weights for policy 0, policy_version 972528 (0.0009) [2023-12-28 02:14:41,397][106226] Updated weights for policy 0, policy_version 972538 (0.0009) [2023-12-28 02:14:41,602][106225] Updated weights for policy 1, policy_version 974756 (0.0009) [2023-12-28 02:14:41,676][106225] Updated weights for policy 1, policy_version 974766 (0.0007) [2023-12-28 02:14:41,748][106225] Updated weights for policy 1, policy_version 974776 (0.0007) [2023-12-28 02:14:42,139][106226] Updated weights for policy 0, policy_version 972548 (0.0011) [2023-12-28 02:14:42,186][106226] Updated weights for policy 0, policy_version 972558 (0.0011) [2023-12-28 02:14:42,234][106226] Updated weights for policy 0, policy_version 972568 (0.0011) [2023-12-28 02:14:42,435][106225] Updated weights for policy 1, policy_version 974786 (0.0007) [2023-12-28 02:14:42,501][106225] Updated weights for policy 1, policy_version 974796 (0.0006) [2023-12-28 02:14:42,565][106225] Updated weights for policy 1, policy_version 974806 (0.0007) [2023-12-28 02:14:42,620][106225] Updated weights for policy 1, policy_version 974816 (0.0009) [2023-12-28 02:14:42,961][106226] Updated weights for policy 0, policy_version 972578 (0.0008) [2023-12-28 02:14:43,024][106226] Updated weights for policy 0, policy_version 972588 (0.0006) [2023-12-28 02:14:43,074][106226] Updated weights for policy 0, policy_version 972598 (0.0008) [2023-12-28 02:14:43,127][106226] Updated weights for policy 0, policy_version 972608 (0.0009) [2023-12-28 02:14:43,291][106225] Updated weights for policy 1, policy_version 974826 (0.0006) [2023-12-28 02:14:43,345][106225] Updated weights for policy 1, policy_version 974836 (0.0010) [2023-12-28 02:14:43,398][106225] Updated weights for policy 1, policy_version 974846 (0.0010) [2023-12-28 02:14:43,786][106226] Updated weights for policy 0, policy_version 972618 (0.0006) [2023-12-28 02:14:43,839][106226] Updated weights for policy 0, policy_version 972628 (0.0007) [2023-12-28 02:14:43,889][106226] Updated weights for policy 0, policy_version 972638 (0.0008) [2023-12-28 02:14:44,097][106225] Updated weights for policy 1, policy_version 974856 (0.0010) [2023-12-28 02:14:44,155][106225] Updated weights for policy 1, policy_version 974866 (0.0010) [2023-12-28 02:14:44,207][106225] Updated weights for policy 1, policy_version 974876 (0.0010) [2023-12-28 02:14:44,557][106226] Updated weights for policy 0, policy_version 972648 (0.0006) [2023-12-28 02:14:44,614][106226] Updated weights for policy 0, policy_version 972658 (0.0008) [2023-12-28 02:14:44,671][106226] Updated weights for policy 0, policy_version 972668 (0.0010) [2023-12-28 02:14:44,965][106225] Updated weights for policy 1, policy_version 974886 (0.0010) [2023-12-28 02:14:45,026][106225] Updated weights for policy 1, policy_version 974896 (0.0007) [2023-12-28 02:14:45,078][106225] Updated weights for policy 1, policy_version 974906 (0.0010) [2023-12-28 02:14:45,428][106226] Updated weights for policy 0, policy_version 972678 (0.0009) [2023-12-28 02:14:45,486][106226] Updated weights for policy 0, policy_version 972688 (0.0007) [2023-12-28 02:14:45,540][106226] Updated weights for policy 0, policy_version 972698 (0.0008) [2023-12-28 02:14:45,799][106225] Updated weights for policy 1, policy_version 974916 (0.0009) [2023-12-28 02:14:45,856][106225] Updated weights for policy 1, policy_version 974926 (0.0006) [2023-12-28 02:14:45,920][106225] Updated weights for policy 1, policy_version 974936 (0.0005) [2023-12-28 02:14:46,172][106226] Updated weights for policy 0, policy_version 972709 (0.0009) [2023-12-28 02:14:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 498696192. Throughput: 0: 9931.8, 1: 9955.8. Samples: 498686796. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:46,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-5.366')] [2023-12-28 02:14:46,230][106226] Updated weights for policy 0, policy_version 972719 (0.0009) [2023-12-28 02:14:46,286][106226] Updated weights for policy 0, policy_version 972729 (0.0006) [2023-12-28 02:14:46,473][106225] Updated weights for policy 1, policy_version 974946 (0.0006) [2023-12-28 02:14:46,537][106225] Updated weights for policy 1, policy_version 974956 (0.0010) [2023-12-28 02:14:46,585][106225] Updated weights for policy 1, policy_version 974966 (0.0008) [2023-12-28 02:14:46,652][106225] Updated weights for policy 1, policy_version 974976 (0.0005) [2023-12-28 02:14:46,847][106226] Updated weights for policy 0, policy_version 972739 (0.0005) [2023-12-28 02:14:46,901][106226] Updated weights for policy 0, policy_version 972749 (0.0006) [2023-12-28 02:14:46,945][106226] Updated weights for policy 0, policy_version 972759 (0.0009) [2023-12-28 02:14:47,255][106225] Updated weights for policy 1, policy_version 974986 (0.0009) [2023-12-28 02:14:47,318][106225] Updated weights for policy 1, policy_version 974996 (0.0008) [2023-12-28 02:14:47,373][106225] Updated weights for policy 1, policy_version 975006 (0.0010) [2023-12-28 02:14:47,608][106226] Updated weights for policy 0, policy_version 972769 (0.0008) [2023-12-28 02:14:47,672][106226] Updated weights for policy 0, policy_version 972779 (0.0006) [2023-12-28 02:14:47,742][106226] Updated weights for policy 0, policy_version 972789 (0.0005) [2023-12-28 02:14:47,808][106226] Updated weights for policy 0, policy_version 972799 (0.0005) [2023-12-28 02:14:48,019][106225] Updated weights for policy 1, policy_version 975016 (0.0007) [2023-12-28 02:14:48,076][106225] Updated weights for policy 1, policy_version 975026 (0.0005) [2023-12-28 02:14:48,143][106225] Updated weights for policy 1, policy_version 975036 (0.0005) [2023-12-28 02:14:48,303][106226] Updated weights for policy 0, policy_version 972809 (0.0008) [2023-12-28 02:14:48,370][106226] Updated weights for policy 0, policy_version 972819 (0.0008) [2023-12-28 02:14:48,440][106226] Updated weights for policy 0, policy_version 972829 (0.0009) [2023-12-28 02:14:48,744][106225] Updated weights for policy 1, policy_version 975046 (0.0007) [2023-12-28 02:14:48,809][106225] Updated weights for policy 1, policy_version 975056 (0.0008) [2023-12-28 02:14:48,864][106225] Updated weights for policy 1, policy_version 975066 (0.0008) [2023-12-28 02:14:49,236][106226] Updated weights for policy 0, policy_version 972839 (0.0010) [2023-12-28 02:14:49,305][106226] Updated weights for policy 0, policy_version 972849 (0.0009) [2023-12-28 02:14:49,372][106226] Updated weights for policy 0, policy_version 972859 (0.0008) [2023-12-28 02:14:49,549][106225] Updated weights for policy 1, policy_version 975076 (0.0008) [2023-12-28 02:14:49,613][106225] Updated weights for policy 1, policy_version 975086 (0.0008) [2023-12-28 02:14:49,668][106225] Updated weights for policy 1, policy_version 975096 (0.0008) [2023-12-28 02:14:50,085][106226] Updated weights for policy 0, policy_version 972869 (0.0009) [2023-12-28 02:14:50,154][106226] Updated weights for policy 0, policy_version 972879 (0.0008) [2023-12-28 02:14:50,222][106226] Updated weights for policy 0, policy_version 972889 (0.0009) [2023-12-28 02:14:50,367][106225] Updated weights for policy 1, policy_version 975106 (0.0009) [2023-12-28 02:14:50,426][106225] Updated weights for policy 1, policy_version 975116 (0.0008) [2023-12-28 02:14:50,493][106225] Updated weights for policy 1, policy_version 975126 (0.0007) [2023-12-28 02:14:50,554][106225] Updated weights for policy 1, policy_version 975136 (0.0008) [2023-12-28 02:14:50,985][106226] Updated weights for policy 0, policy_version 972899 (0.0009) [2023-12-28 02:14:51,046][106226] Updated weights for policy 0, policy_version 972909 (0.0009) [2023-12-28 02:14:51,116][106226] Updated weights for policy 0, policy_version 972919 (0.0007) [2023-12-28 02:14:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 498802688. Throughput: 0: 9912.9, 1: 10057.7. Samples: 498810472. Policy #0 lag: (min: 4.0, avg: 4.8, max: 27.0) [2023-12-28 02:14:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.905')] [2023-12-28 02:14:51,321][106225] Updated weights for policy 1, policy_version 975146 (0.0009) [2023-12-28 02:14:51,380][106225] Updated weights for policy 1, policy_version 975156 (0.0009) [2023-12-28 02:14:51,456][106225] Updated weights for policy 1, policy_version 975166 (0.0009) [2023-12-28 02:14:51,837][106226] Updated weights for policy 0, policy_version 972929 (0.0007) [2023-12-28 02:14:51,902][106226] Updated weights for policy 0, policy_version 972939 (0.0011) [2023-12-28 02:14:51,950][106226] Updated weights for policy 0, policy_version 972949 (0.0011) [2023-12-28 02:14:52,008][106226] Updated weights for policy 0, policy_version 972959 (0.0011) [2023-12-28 02:14:52,166][106225] Updated weights for policy 1, policy_version 975176 (0.0007) [2023-12-28 02:14:52,213][106225] Updated weights for policy 1, policy_version 975186 (0.0007) [2023-12-28 02:14:52,280][106225] Updated weights for policy 1, policy_version 975196 (0.0007) [2023-12-28 02:14:52,742][106226] Updated weights for policy 0, policy_version 972969 (0.0011) [2023-12-28 02:14:52,803][106226] Updated weights for policy 0, policy_version 972979 (0.0011) [2023-12-28 02:14:52,864][106226] Updated weights for policy 0, policy_version 972989 (0.0011) [2023-12-28 02:14:53,003][106225] Updated weights for policy 1, policy_version 975206 (0.0008) [2023-12-28 02:14:53,059][106225] Updated weights for policy 1, policy_version 975216 (0.0008) [2023-12-28 02:14:53,124][106225] Updated weights for policy 1, policy_version 975226 (0.0008) [2023-12-28 02:14:53,542][106226] Updated weights for policy 0, policy_version 972999 (0.0007) [2023-12-28 02:14:53,587][106226] Updated weights for policy 0, policy_version 973009 (0.0005) [2023-12-28 02:14:53,643][106226] Updated weights for policy 0, policy_version 973019 (0.0007) [2023-12-28 02:14:53,876][106225] Updated weights for policy 1, policy_version 975236 (0.0009) [2023-12-28 02:14:53,929][106225] Updated weights for policy 1, policy_version 975246 (0.0010) [2023-12-28 02:14:53,976][106225] Updated weights for policy 1, policy_version 975256 (0.0010) [2023-12-28 02:14:54,268][106226] Updated weights for policy 0, policy_version 973029 (0.0010) [2023-12-28 02:14:54,329][106226] Updated weights for policy 0, policy_version 973039 (0.0010) [2023-12-28 02:14:54,387][106226] Updated weights for policy 0, policy_version 973049 (0.0010) [2023-12-28 02:14:54,619][106225] Updated weights for policy 1, policy_version 975266 (0.0010) [2023-12-28 02:14:54,675][106225] Updated weights for policy 1, policy_version 975276 (0.0010) [2023-12-28 02:14:54,731][106225] Updated weights for policy 1, policy_version 975286 (0.0010) [2023-12-28 02:14:54,791][106225] Updated weights for policy 1, policy_version 975296 (0.0010) [2023-12-28 02:14:55,057][106226] Updated weights for policy 0, policy_version 973059 (0.0009) [2023-12-28 02:14:55,129][106226] Updated weights for policy 0, policy_version 973069 (0.0011) [2023-12-28 02:14:55,195][106226] Updated weights for policy 0, policy_version 973079 (0.0011) [2023-12-28 02:14:55,489][106225] Updated weights for policy 1, policy_version 975306 (0.0010) [2023-12-28 02:14:55,539][106225] Updated weights for policy 1, policy_version 975316 (0.0010) [2023-12-28 02:14:55,594][106225] Updated weights for policy 1, policy_version 975326 (0.0010) [2023-12-28 02:14:55,874][106226] Updated weights for policy 0, policy_version 973089 (0.0011) [2023-12-28 02:14:55,928][106226] Updated weights for policy 0, policy_version 973099 (0.0010) [2023-12-28 02:14:55,981][106226] Updated weights for policy 0, policy_version 973109 (0.0010) [2023-12-28 02:14:56,039][106226] Updated weights for policy 0, policy_version 973119 (0.0011) [2023-12-28 02:14:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 498900992. Throughput: 0: 9912.6, 1: 10021.9. Samples: 498868840. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:14:56,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.787')] [2023-12-28 02:14:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000973120_249176064.pth... [2023-12-28 02:14:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000975328_249724928.pth... [2023-12-28 02:14:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000971936_248872960.pth [2023-12-28 02:14:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000974176_249430016.pth [2023-12-28 02:14:56,301][106225] Updated weights for policy 1, policy_version 975336 (0.0010) [2023-12-28 02:14:56,350][106225] Updated weights for policy 1, policy_version 975346 (0.0010) [2023-12-28 02:14:56,410][106225] Updated weights for policy 1, policy_version 975356 (0.0010) [2023-12-28 02:14:56,734][106226] Updated weights for policy 0, policy_version 973129 (0.0006) [2023-12-28 02:14:56,788][106226] Updated weights for policy 0, policy_version 973139 (0.0005) [2023-12-28 02:14:56,841][106226] Updated weights for policy 0, policy_version 973149 (0.0007) [2023-12-28 02:14:57,141][106225] Updated weights for policy 1, policy_version 975366 (0.0010) [2023-12-28 02:14:57,200][106225] Updated weights for policy 1, policy_version 975376 (0.0010) [2023-12-28 02:14:57,262][106225] Updated weights for policy 1, policy_version 975386 (0.0010) [2023-12-28 02:14:57,445][106226] Updated weights for policy 0, policy_version 973159 (0.0007) [2023-12-28 02:14:57,506][106226] Updated weights for policy 0, policy_version 973169 (0.0010) [2023-12-28 02:14:57,561][106226] Updated weights for policy 0, policy_version 973179 (0.0005) [2023-12-28 02:14:57,958][106225] Updated weights for policy 1, policy_version 975396 (0.0010) [2023-12-28 02:14:58,012][106225] Updated weights for policy 1, policy_version 975406 (0.0007) [2023-12-28 02:14:58,068][106225] Updated weights for policy 1, policy_version 975416 (0.0010) [2023-12-28 02:14:58,127][106226] Updated weights for policy 0, policy_version 973189 (0.0005) [2023-12-28 02:14:58,179][106226] Updated weights for policy 0, policy_version 973199 (0.0007) [2023-12-28 02:14:58,239][106226] Updated weights for policy 0, policy_version 973209 (0.0009) [2023-12-28 02:14:58,869][106225] Updated weights for policy 1, policy_version 975426 (0.0010) [2023-12-28 02:14:58,942][106225] Updated weights for policy 1, policy_version 975436 (0.0008) [2023-12-28 02:14:59,009][106225] Updated weights for policy 1, policy_version 975446 (0.0006) [2023-12-28 02:14:59,043][106226] Updated weights for policy 0, policy_version 973219 (0.0007) [2023-12-28 02:14:59,077][106225] Updated weights for policy 1, policy_version 975456 (0.0007) [2023-12-28 02:14:59,103][106226] Updated weights for policy 0, policy_version 973229 (0.0009) [2023-12-28 02:14:59,165][106226] Updated weights for policy 0, policy_version 973239 (0.0008) [2023-12-28 02:14:59,882][106225] Updated weights for policy 1, policy_version 975466 (0.0009) [2023-12-28 02:14:59,924][106226] Updated weights for policy 0, policy_version 973249 (0.0009) [2023-12-28 02:14:59,947][106225] Updated weights for policy 1, policy_version 975476 (0.0009) [2023-12-28 02:14:59,989][106226] Updated weights for policy 0, policy_version 973259 (0.0008) [2023-12-28 02:15:00,013][106225] Updated weights for policy 1, policy_version 975486 (0.0006) [2023-12-28 02:15:00,048][106226] Updated weights for policy 0, policy_version 973269 (0.0008) [2023-12-28 02:15:00,104][106226] Updated weights for policy 0, policy_version 973279 (0.0007) [2023-12-28 02:15:00,648][106225] Updated weights for policy 1, policy_version 975496 (0.0007) [2023-12-28 02:15:00,693][106225] Updated weights for policy 1, policy_version 975506 (0.0007) [2023-12-28 02:15:00,740][106225] Updated weights for policy 1, policy_version 975516 (0.0007) [2023-12-28 02:15:00,814][106226] Updated weights for policy 0, policy_version 973289 (0.0010) [2023-12-28 02:15:00,871][106226] Updated weights for policy 0, policy_version 973299 (0.0009) [2023-12-28 02:15:00,935][106226] Updated weights for policy 0, policy_version 973309 (0.0011) [2023-12-28 02:15:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 498999296. Throughput: 0: 9956.2, 1: 10014.4. Samples: 498987264. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:01,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.922')] [2023-12-28 02:15:01,377][106225] Updated weights for policy 1, policy_version 975526 (0.0007) [2023-12-28 02:15:01,446][106225] Updated weights for policy 1, policy_version 975536 (0.0009) [2023-12-28 02:15:01,494][106225] Updated weights for policy 1, policy_version 975546 (0.0007) [2023-12-28 02:15:01,625][106226] Updated weights for policy 0, policy_version 973319 (0.0011) [2023-12-28 02:15:01,686][106226] Updated weights for policy 0, policy_version 973329 (0.0011) [2023-12-28 02:15:01,750][106226] Updated weights for policy 0, policy_version 973339 (0.0011) [2023-12-28 02:15:02,199][106225] Updated weights for policy 1, policy_version 975556 (0.0007) [2023-12-28 02:15:02,256][106225] Updated weights for policy 1, policy_version 975566 (0.0007) [2023-12-28 02:15:02,315][106225] Updated weights for policy 1, policy_version 975576 (0.0009) [2023-12-28 02:15:02,399][106226] Updated weights for policy 0, policy_version 973349 (0.0009) [2023-12-28 02:15:02,454][106226] Updated weights for policy 0, policy_version 973359 (0.0008) [2023-12-28 02:15:02,507][106226] Updated weights for policy 0, policy_version 973369 (0.0009) [2023-12-28 02:15:03,028][106225] Updated weights for policy 1, policy_version 975586 (0.0008) [2023-12-28 02:15:03,071][106225] Updated weights for policy 1, policy_version 975596 (0.0008) [2023-12-28 02:15:03,119][106225] Updated weights for policy 1, policy_version 975606 (0.0008) [2023-12-28 02:15:03,142][106226] Updated weights for policy 0, policy_version 973379 (0.0007) [2023-12-28 02:15:03,171][106225] Updated weights for policy 1, policy_version 975616 (0.0008) [2023-12-28 02:15:03,198][106226] Updated weights for policy 0, policy_version 973389 (0.0007) [2023-12-28 02:15:03,258][106226] Updated weights for policy 0, policy_version 973399 (0.0008) [2023-12-28 02:15:03,932][106225] Updated weights for policy 1, policy_version 975626 (0.0008) [2023-12-28 02:15:03,981][106226] Updated weights for policy 0, policy_version 973409 (0.0009) [2023-12-28 02:15:03,995][106225] Updated weights for policy 1, policy_version 975636 (0.0007) [2023-12-28 02:15:04,032][106226] Updated weights for policy 0, policy_version 973419 (0.0007) [2023-12-28 02:15:04,058][106225] Updated weights for policy 1, policy_version 975646 (0.0008) [2023-12-28 02:15:04,094][106226] Updated weights for policy 0, policy_version 973429 (0.0008) [2023-12-28 02:15:04,157][106226] Updated weights for policy 0, policy_version 973439 (0.0009) [2023-12-28 02:15:04,770][106225] Updated weights for policy 1, policy_version 975656 (0.0006) [2023-12-28 02:15:04,820][106225] Updated weights for policy 1, policy_version 975666 (0.0006) [2023-12-28 02:15:04,880][106225] Updated weights for policy 1, policy_version 975676 (0.0006) [2023-12-28 02:15:04,969][106226] Updated weights for policy 0, policy_version 973449 (0.0008) [2023-12-28 02:15:05,023][106226] Updated weights for policy 0, policy_version 973459 (0.0008) [2023-12-28 02:15:05,076][106226] Updated weights for policy 0, policy_version 973469 (0.0007) [2023-12-28 02:15:05,477][106225] Updated weights for policy 1, policy_version 975686 (0.0006) [2023-12-28 02:15:05,539][106225] Updated weights for policy 1, policy_version 975696 (0.0006) [2023-12-28 02:15:05,597][106225] Updated weights for policy 1, policy_version 975706 (0.0008) [2023-12-28 02:15:05,823][106226] Updated weights for policy 0, policy_version 973479 (0.0005) [2023-12-28 02:15:05,882][106226] Updated weights for policy 0, policy_version 973489 (0.0005) [2023-12-28 02:15:05,935][106226] Updated weights for policy 0, policy_version 973499 (0.0006) [2023-12-28 02:15:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 499097600. Throughput: 0: 9925.9, 1: 9994.6. Samples: 499107468. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:06,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.941')] [2023-12-28 02:15:06,343][106225] Updated weights for policy 1, policy_version 975716 (0.0008) [2023-12-28 02:15:06,409][106225] Updated weights for policy 1, policy_version 975726 (0.0008) [2023-12-28 02:15:06,467][106225] Updated weights for policy 1, policy_version 975736 (0.0008) [2023-12-28 02:15:06,611][106226] Updated weights for policy 0, policy_version 973509 (0.0009) [2023-12-28 02:15:06,675][106226] Updated weights for policy 0, policy_version 973519 (0.0009) [2023-12-28 02:15:06,737][106226] Updated weights for policy 0, policy_version 973529 (0.0009) [2023-12-28 02:15:07,096][106225] Updated weights for policy 1, policy_version 975746 (0.0007) [2023-12-28 02:15:07,150][106225] Updated weights for policy 1, policy_version 975756 (0.0006) [2023-12-28 02:15:07,210][106225] Updated weights for policy 1, policy_version 975766 (0.0005) [2023-12-28 02:15:07,260][106225] Updated weights for policy 1, policy_version 975776 (0.0005) [2023-12-28 02:15:07,486][106226] Updated weights for policy 0, policy_version 973539 (0.0009) [2023-12-28 02:15:07,539][106226] Updated weights for policy 0, policy_version 973549 (0.0007) [2023-12-28 02:15:07,583][106226] Updated weights for policy 0, policy_version 973559 (0.0008) [2023-12-28 02:15:07,852][106225] Updated weights for policy 1, policy_version 975786 (0.0009) [2023-12-28 02:15:07,906][106225] Updated weights for policy 1, policy_version 975796 (0.0010) [2023-12-28 02:15:07,962][106225] Updated weights for policy 1, policy_version 975806 (0.0010) [2023-12-28 02:15:08,328][106226] Updated weights for policy 0, policy_version 973569 (0.0009) [2023-12-28 02:15:08,396][106226] Updated weights for policy 0, policy_version 973579 (0.0008) [2023-12-28 02:15:08,450][106226] Updated weights for policy 0, policy_version 973589 (0.0008) [2023-12-28 02:15:08,507][106226] Updated weights for policy 0, policy_version 973599 (0.0008) [2023-12-28 02:15:08,708][106225] Updated weights for policy 1, policy_version 975816 (0.0009) [2023-12-28 02:15:08,771][106225] Updated weights for policy 1, policy_version 975826 (0.0010) [2023-12-28 02:15:08,837][106225] Updated weights for policy 1, policy_version 975836 (0.0009) [2023-12-28 02:15:09,256][106226] Updated weights for policy 0, policy_version 973609 (0.0008) [2023-12-28 02:15:09,312][106226] Updated weights for policy 0, policy_version 973619 (0.0008) [2023-12-28 02:15:09,376][106226] Updated weights for policy 0, policy_version 973629 (0.0009) [2023-12-28 02:15:09,592][106225] Updated weights for policy 1, policy_version 975846 (0.0010) [2023-12-28 02:15:09,648][106225] Updated weights for policy 1, policy_version 975856 (0.0008) [2023-12-28 02:15:09,709][106225] Updated weights for policy 1, policy_version 975866 (0.0008) [2023-12-28 02:15:10,224][106226] Updated weights for policy 0, policy_version 973639 (0.0009) [2023-12-28 02:15:10,275][106226] Updated weights for policy 0, policy_version 973649 (0.0009) [2023-12-28 02:15:10,324][106226] Updated weights for policy 0, policy_version 973659 (0.0008) [2023-12-28 02:15:10,334][106225] Updated weights for policy 1, policy_version 975876 (0.0007) [2023-12-28 02:15:10,388][106225] Updated weights for policy 1, policy_version 975886 (0.0006) [2023-12-28 02:15:10,445][106225] Updated weights for policy 1, policy_version 975896 (0.0005) [2023-12-28 02:15:11,055][106226] Updated weights for policy 0, policy_version 973669 (0.0008) [2023-12-28 02:15:11,119][106226] Updated weights for policy 0, policy_version 973679 (0.0009) [2023-12-28 02:15:11,152][106225] Updated weights for policy 1, policy_version 975906 (0.0006) [2023-12-28 02:15:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 499187712. Throughput: 0: 9951.5, 1: 10019.5. Samples: 499166500. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:11,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-5.335')] [2023-12-28 02:15:11,186][106226] Updated weights for policy 0, policy_version 973689 (0.0009) [2023-12-28 02:15:11,223][106225] Updated weights for policy 1, policy_version 975916 (0.0006) [2023-12-28 02:15:11,227][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000973696_249323520.pth... [2023-12-28 02:15:11,230][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000972512_249020416.pth [2023-12-28 02:15:11,285][106225] Updated weights for policy 1, policy_version 975926 (0.0009) [2023-12-28 02:15:11,342][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000975936_249880576.pth... [2023-12-28 02:15:11,342][106225] Updated weights for policy 1, policy_version 975936 (0.0008) [2023-12-28 02:15:11,346][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000974752_249577472.pth [2023-12-28 02:15:11,942][106226] Updated weights for policy 0, policy_version 973699 (0.0007) [2023-12-28 02:15:12,002][106226] Updated weights for policy 0, policy_version 973709 (0.0008) [2023-12-28 02:15:12,057][106225] Updated weights for policy 1, policy_version 975946 (0.0006) [2023-12-28 02:15:12,060][106226] Updated weights for policy 0, policy_version 973719 (0.0007) [2023-12-28 02:15:12,118][106225] Updated weights for policy 1, policy_version 975956 (0.0008) [2023-12-28 02:15:12,181][106225] Updated weights for policy 1, policy_version 975966 (0.0009) [2023-12-28 02:15:12,780][106226] Updated weights for policy 0, policy_version 973729 (0.0008) [2023-12-28 02:15:12,844][106226] Updated weights for policy 0, policy_version 973739 (0.0011) [2023-12-28 02:15:12,869][106225] Updated weights for policy 1, policy_version 975976 (0.0006) [2023-12-28 02:15:12,905][106226] Updated weights for policy 0, policy_version 973749 (0.0011) [2023-12-28 02:15:12,930][106225] Updated weights for policy 1, policy_version 975986 (0.0007) [2023-12-28 02:15:12,955][106226] Updated weights for policy 0, policy_version 973759 (0.0010) [2023-12-28 02:15:12,984][106225] Updated weights for policy 1, policy_version 975996 (0.0007) [2023-12-28 02:15:13,551][106226] Updated weights for policy 0, policy_version 973769 (0.0005) [2023-12-28 02:15:13,601][106226] Updated weights for policy 0, policy_version 973779 (0.0005) [2023-12-28 02:15:13,660][106226] Updated weights for policy 0, policy_version 973789 (0.0005) [2023-12-28 02:15:13,669][106225] Updated weights for policy 1, policy_version 976006 (0.0008) [2023-12-28 02:15:13,723][106225] Updated weights for policy 1, policy_version 976016 (0.0008) [2023-12-28 02:15:13,784][106225] Updated weights for policy 1, policy_version 976026 (0.0009) [2023-12-28 02:15:14,321][106226] Updated weights for policy 0, policy_version 973799 (0.0008) [2023-12-28 02:15:14,379][106226] Updated weights for policy 0, policy_version 973809 (0.0008) [2023-12-28 02:15:14,438][106226] Updated weights for policy 0, policy_version 973819 (0.0007) [2023-12-28 02:15:14,440][106225] Updated weights for policy 1, policy_version 976036 (0.0007) [2023-12-28 02:15:14,496][106225] Updated weights for policy 1, policy_version 976046 (0.0006) [2023-12-28 02:15:14,551][106225] Updated weights for policy 1, policy_version 976056 (0.0005) [2023-12-28 02:15:15,094][106226] Updated weights for policy 0, policy_version 973829 (0.0009) [2023-12-28 02:15:15,163][106226] Updated weights for policy 0, policy_version 973839 (0.0009) [2023-12-28 02:15:15,231][106226] Updated weights for policy 0, policy_version 973849 (0.0009) [2023-12-28 02:15:15,267][106225] Updated weights for policy 1, policy_version 976066 (0.0007) [2023-12-28 02:15:15,319][106225] Updated weights for policy 1, policy_version 976076 (0.0009) [2023-12-28 02:15:15,373][106225] Updated weights for policy 1, policy_version 976086 (0.0009) [2023-12-28 02:15:15,429][106225] Updated weights for policy 1, policy_version 976096 (0.0008) [2023-12-28 02:15:15,915][106226] Updated weights for policy 0, policy_version 973859 (0.0006) [2023-12-28 02:15:15,982][106226] Updated weights for policy 0, policy_version 973869 (0.0005) [2023-12-28 02:15:16,037][106226] Updated weights for policy 0, policy_version 973879 (0.0007) [2023-12-28 02:15:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 499294208. Throughput: 0: 9940.0, 1: 9907.5. Samples: 499284592. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:16,176][105115] Avg episode reward: [(0, '-4.816'), (1, '-5.236')] [2023-12-28 02:15:16,180][106225] Updated weights for policy 1, policy_version 976106 (0.0009) [2023-12-28 02:15:16,229][106225] Updated weights for policy 1, policy_version 976116 (0.0008) [2023-12-28 02:15:16,278][106225] Updated weights for policy 1, policy_version 976126 (0.0008) [2023-12-28 02:15:16,596][106226] Updated weights for policy 0, policy_version 973889 (0.0006) [2023-12-28 02:15:16,652][106226] Updated weights for policy 0, policy_version 973900 (0.0010) [2023-12-28 02:15:16,702][106226] Updated weights for policy 0, policy_version 973911 (0.0009) [2023-12-28 02:15:16,992][106225] Updated weights for policy 1, policy_version 976136 (0.0006) [2023-12-28 02:15:17,040][106225] Updated weights for policy 1, policy_version 976146 (0.0006) [2023-12-28 02:15:17,096][106225] Updated weights for policy 1, policy_version 976156 (0.0008) [2023-12-28 02:15:17,400][106226] Updated weights for policy 0, policy_version 973921 (0.0009) [2023-12-28 02:15:17,450][106226] Updated weights for policy 0, policy_version 973931 (0.0005) [2023-12-28 02:15:17,518][106226] Updated weights for policy 0, policy_version 973941 (0.0005) [2023-12-28 02:15:17,581][106226] Updated weights for policy 0, policy_version 973951 (0.0005) [2023-12-28 02:15:17,876][106225] Updated weights for policy 1, policy_version 976166 (0.0008) [2023-12-28 02:15:17,925][106225] Updated weights for policy 1, policy_version 976176 (0.0009) [2023-12-28 02:15:17,973][106225] Updated weights for policy 1, policy_version 976186 (0.0008) [2023-12-28 02:15:18,211][106226] Updated weights for policy 0, policy_version 973961 (0.0008) [2023-12-28 02:15:18,269][106226] Updated weights for policy 0, policy_version 973971 (0.0008) [2023-12-28 02:15:18,323][106226] Updated weights for policy 0, policy_version 973981 (0.0009) [2023-12-28 02:15:18,689][106225] Updated weights for policy 1, policy_version 976196 (0.0008) [2023-12-28 02:15:18,745][106225] Updated weights for policy 1, policy_version 976206 (0.0009) [2023-12-28 02:15:18,808][106225] Updated weights for policy 1, policy_version 976216 (0.0008) [2023-12-28 02:15:19,071][106226] Updated weights for policy 0, policy_version 973991 (0.0008) [2023-12-28 02:15:19,132][106226] Updated weights for policy 0, policy_version 974001 (0.0008) [2023-12-28 02:15:19,192][106226] Updated weights for policy 0, policy_version 974011 (0.0008) [2023-12-28 02:15:19,546][106225] Updated weights for policy 1, policy_version 976226 (0.0009) [2023-12-28 02:15:19,603][106225] Updated weights for policy 1, policy_version 976236 (0.0009) [2023-12-28 02:15:19,667][106225] Updated weights for policy 1, policy_version 976246 (0.0009) [2023-12-28 02:15:19,720][106225] Updated weights for policy 1, policy_version 976256 (0.0009) [2023-12-28 02:15:20,025][106226] Updated weights for policy 0, policy_version 974021 (0.0009) [2023-12-28 02:15:20,083][106226] Updated weights for policy 0, policy_version 974031 (0.0009) [2023-12-28 02:15:20,140][106226] Updated weights for policy 0, policy_version 974041 (0.0009) [2023-12-28 02:15:20,527][106225] Updated weights for policy 1, policy_version 976266 (0.0009) [2023-12-28 02:15:20,580][106225] Updated weights for policy 1, policy_version 976276 (0.0008) [2023-12-28 02:15:20,647][106225] Updated weights for policy 1, policy_version 976286 (0.0009) [2023-12-28 02:15:20,921][106226] Updated weights for policy 0, policy_version 974051 (0.0009) [2023-12-28 02:15:20,988][106226] Updated weights for policy 0, policy_version 974061 (0.0008) [2023-12-28 02:15:21,052][106226] Updated weights for policy 0, policy_version 974071 (0.0008) [2023-12-28 02:15:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 499392512. Throughput: 0: 9924.5, 1: 9887.1. Samples: 499400132. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:21,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-4.879')] [2023-12-28 02:15:21,474][106225] Updated weights for policy 1, policy_version 976296 (0.0008) [2023-12-28 02:15:21,539][106225] Updated weights for policy 1, policy_version 976306 (0.0008) [2023-12-28 02:15:21,598][106225] Updated weights for policy 1, policy_version 976316 (0.0008) [2023-12-28 02:15:21,818][106226] Updated weights for policy 0, policy_version 974081 (0.0008) [2023-12-28 02:15:21,881][106226] Updated weights for policy 0, policy_version 974091 (0.0008) [2023-12-28 02:15:21,951][106226] Updated weights for policy 0, policy_version 974101 (0.0006) [2023-12-28 02:15:22,013][106226] Updated weights for policy 0, policy_version 974111 (0.0008) [2023-12-28 02:15:22,368][106225] Updated weights for policy 1, policy_version 976326 (0.0008) [2023-12-28 02:15:22,428][106225] Updated weights for policy 1, policy_version 976336 (0.0008) [2023-12-28 02:15:22,488][106225] Updated weights for policy 1, policy_version 976346 (0.0008) [2023-12-28 02:15:22,732][106226] Updated weights for policy 0, policy_version 974121 (0.0008) [2023-12-28 02:15:22,799][106226] Updated weights for policy 0, policy_version 974131 (0.0009) [2023-12-28 02:15:22,861][106226] Updated weights for policy 0, policy_version 974141 (0.0008) [2023-12-28 02:15:23,242][106225] Updated weights for policy 1, policy_version 976356 (0.0008) [2023-12-28 02:15:23,295][106225] Updated weights for policy 1, policy_version 976366 (0.0009) [2023-12-28 02:15:23,349][106225] Updated weights for policy 1, policy_version 976376 (0.0009) [2023-12-28 02:15:23,509][106226] Updated weights for policy 0, policy_version 974151 (0.0009) [2023-12-28 02:15:23,569][106226] Updated weights for policy 0, policy_version 974161 (0.0008) [2023-12-28 02:15:23,618][106226] Updated weights for policy 0, policy_version 974171 (0.0009) [2023-12-28 02:15:24,062][106225] Updated weights for policy 1, policy_version 976386 (0.0008) [2023-12-28 02:15:24,129][106225] Updated weights for policy 1, policy_version 976396 (0.0005) [2023-12-28 02:15:24,187][106225] Updated weights for policy 1, policy_version 976406 (0.0007) [2023-12-28 02:15:24,239][106225] Updated weights for policy 1, policy_version 976416 (0.0006) [2023-12-28 02:15:24,339][106226] Updated weights for policy 0, policy_version 974181 (0.0009) [2023-12-28 02:15:24,397][106226] Updated weights for policy 0, policy_version 974191 (0.0008) [2023-12-28 02:15:24,454][106226] Updated weights for policy 0, policy_version 974202 (0.0009) [2023-12-28 02:15:24,857][106225] Updated weights for policy 1, policy_version 976426 (0.0008) [2023-12-28 02:15:24,919][106225] Updated weights for policy 1, policy_version 976436 (0.0006) [2023-12-28 02:15:24,977][106225] Updated weights for policy 1, policy_version 976446 (0.0007) [2023-12-28 02:15:25,269][106226] Updated weights for policy 0, policy_version 974212 (0.0010) [2023-12-28 02:15:25,313][106226] Updated weights for policy 0, policy_version 974222 (0.0008) [2023-12-28 02:15:25,362][106226] Updated weights for policy 0, policy_version 974232 (0.0008) [2023-12-28 02:15:25,593][106225] Updated weights for policy 1, policy_version 976456 (0.0008) [2023-12-28 02:15:25,648][106225] Updated weights for policy 1, policy_version 976466 (0.0009) [2023-12-28 02:15:25,713][106225] Updated weights for policy 1, policy_version 976476 (0.0008) [2023-12-28 02:15:26,087][106226] Updated weights for policy 0, policy_version 974242 (0.0008) [2023-12-28 02:15:26,149][106226] Updated weights for policy 0, policy_version 974252 (0.0010) [2023-12-28 02:15:26,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 499482624. Throughput: 0: 9876.0, 1: 9823.0. Samples: 499456184. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:26,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.942')] [2023-12-28 02:15:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000976480_250019840.pth... [2023-12-28 02:15:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000975328_249724928.pth [2023-12-28 02:15:26,209][106226] Updated weights for policy 0, policy_version 974262 (0.0010) [2023-12-28 02:15:26,275][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000974272_249470976.pth... [2023-12-28 02:15:26,275][106226] Updated weights for policy 0, policy_version 974272 (0.0007) [2023-12-28 02:15:26,279][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000973120_249176064.pth [2023-12-28 02:15:26,470][106225] Updated weights for policy 1, policy_version 976486 (0.0009) [2023-12-28 02:15:26,532][106225] Updated weights for policy 1, policy_version 976496 (0.0008) [2023-12-28 02:15:26,593][106225] Updated weights for policy 1, policy_version 976506 (0.0008) [2023-12-28 02:15:26,834][106226] Updated weights for policy 0, policy_version 974282 (0.0005) [2023-12-28 02:15:26,893][106226] Updated weights for policy 0, policy_version 974292 (0.0005) [2023-12-28 02:15:26,939][106226] Updated weights for policy 0, policy_version 974302 (0.0005) [2023-12-28 02:15:27,347][106225] Updated weights for policy 1, policy_version 976516 (0.0008) [2023-12-28 02:15:27,405][106225] Updated weights for policy 1, policy_version 976526 (0.0008) [2023-12-28 02:15:27,465][106225] Updated weights for policy 1, policy_version 976536 (0.0008) [2023-12-28 02:15:27,501][106226] Updated weights for policy 0, policy_version 974312 (0.0005) [2023-12-28 02:15:27,556][106226] Updated weights for policy 0, policy_version 974322 (0.0005) [2023-12-28 02:15:27,612][106226] Updated weights for policy 0, policy_version 974332 (0.0009) [2023-12-28 02:15:28,233][106225] Updated weights for policy 1, policy_version 976546 (0.0008) [2023-12-28 02:15:28,240][106226] Updated weights for policy 0, policy_version 974342 (0.0008) [2023-12-28 02:15:28,281][106225] Updated weights for policy 1, policy_version 976556 (0.0006) [2023-12-28 02:15:28,298][106226] Updated weights for policy 0, policy_version 974352 (0.0007) [2023-12-28 02:15:28,333][106225] Updated weights for policy 1, policy_version 976566 (0.0006) [2023-12-28 02:15:28,358][106226] Updated weights for policy 0, policy_version 974362 (0.0009) [2023-12-28 02:15:28,400][106225] Updated weights for policy 1, policy_version 976576 (0.0007) [2023-12-28 02:15:29,009][106226] Updated weights for policy 0, policy_version 974372 (0.0007) [2023-12-28 02:15:29,071][106226] Updated weights for policy 0, policy_version 974382 (0.0009) [2023-12-28 02:15:29,123][106226] Updated weights for policy 0, policy_version 974392 (0.0006) [2023-12-28 02:15:29,145][106225] Updated weights for policy 1, policy_version 976586 (0.0007) [2023-12-28 02:15:29,206][106225] Updated weights for policy 1, policy_version 976596 (0.0009) [2023-12-28 02:15:29,266][106225] Updated weights for policy 1, policy_version 976606 (0.0009) [2023-12-28 02:15:29,888][106226] Updated weights for policy 0, policy_version 974402 (0.0007) [2023-12-28 02:15:29,940][106226] Updated weights for policy 0, policy_version 974412 (0.0009) [2023-12-28 02:15:30,011][106226] Updated weights for policy 0, policy_version 974422 (0.0008) [2023-12-28 02:15:30,024][106225] Updated weights for policy 1, policy_version 976616 (0.0007) [2023-12-28 02:15:30,076][106226] Updated weights for policy 0, policy_version 974432 (0.0008) [2023-12-28 02:15:30,086][106225] Updated weights for policy 1, policy_version 976626 (0.0006) [2023-12-28 02:15:30,142][106225] Updated weights for policy 1, policy_version 976636 (0.0008) [2023-12-28 02:15:30,790][106226] Updated weights for policy 0, policy_version 974442 (0.0008) [2023-12-28 02:15:30,841][106226] Updated weights for policy 0, policy_version 974452 (0.0008) [2023-12-28 02:15:30,851][106225] Updated weights for policy 1, policy_version 976646 (0.0007) [2023-12-28 02:15:30,891][106226] Updated weights for policy 0, policy_version 974462 (0.0008) [2023-12-28 02:15:30,897][106225] Updated weights for policy 1, policy_version 976656 (0.0006) [2023-12-28 02:15:30,945][106225] Updated weights for policy 1, policy_version 976666 (0.0008) [2023-12-28 02:15:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 499589120. Throughput: 0: 9927.7, 1: 9832.9. Samples: 499576024. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:31,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.261')] [2023-12-28 02:15:31,636][106226] Updated weights for policy 0, policy_version 974472 (0.0008) [2023-12-28 02:15:31,706][106226] Updated weights for policy 0, policy_version 974482 (0.0009) [2023-12-28 02:15:31,756][106225] Updated weights for policy 1, policy_version 976676 (0.0008) [2023-12-28 02:15:31,771][106226] Updated weights for policy 0, policy_version 974492 (0.0008) [2023-12-28 02:15:31,814][106225] Updated weights for policy 1, policy_version 976686 (0.0007) [2023-12-28 02:15:31,874][106225] Updated weights for policy 1, policy_version 976696 (0.0008) [2023-12-28 02:15:32,496][106226] Updated weights for policy 0, policy_version 974502 (0.0006) [2023-12-28 02:15:32,557][106226] Updated weights for policy 0, policy_version 974512 (0.0007) [2023-12-28 02:15:32,616][106226] Updated weights for policy 0, policy_version 974522 (0.0008) [2023-12-28 02:15:32,631][106225] Updated weights for policy 1, policy_version 976706 (0.0007) [2023-12-28 02:15:32,693][106225] Updated weights for policy 1, policy_version 976716 (0.0007) [2023-12-28 02:15:32,757][106225] Updated weights for policy 1, policy_version 976726 (0.0005) [2023-12-28 02:15:32,811][106225] Updated weights for policy 1, policy_version 976736 (0.0005) [2023-12-28 02:15:33,326][106226] Updated weights for policy 0, policy_version 974532 (0.0008) [2023-12-28 02:15:33,380][106226] Updated weights for policy 0, policy_version 974542 (0.0007) [2023-12-28 02:15:33,385][106225] Updated weights for policy 1, policy_version 976746 (0.0007) [2023-12-28 02:15:33,435][106225] Updated weights for policy 1, policy_version 976756 (0.0006) [2023-12-28 02:15:33,440][106226] Updated weights for policy 0, policy_version 974552 (0.0007) [2023-12-28 02:15:33,490][106225] Updated weights for policy 1, policy_version 976766 (0.0008) [2023-12-28 02:15:33,991][106226] Updated weights for policy 0, policy_version 974562 (0.0007) [2023-12-28 02:15:34,045][106226] Updated weights for policy 0, policy_version 974572 (0.0005) [2023-12-28 02:15:34,101][106226] Updated weights for policy 0, policy_version 974582 (0.0010) [2023-12-28 02:15:34,155][106226] Updated weights for policy 0, policy_version 974592 (0.0010) [2023-12-28 02:15:34,225][106225] Updated weights for policy 1, policy_version 976776 (0.0007) [2023-12-28 02:15:34,278][106225] Updated weights for policy 1, policy_version 976786 (0.0008) [2023-12-28 02:15:34,326][106225] Updated weights for policy 1, policy_version 976796 (0.0008) [2023-12-28 02:15:34,918][106226] Updated weights for policy 0, policy_version 974602 (0.0010) [2023-12-28 02:15:34,980][106226] Updated weights for policy 0, policy_version 974612 (0.0011) [2023-12-28 02:15:35,042][106226] Updated weights for policy 0, policy_version 974622 (0.0011) [2023-12-28 02:15:35,086][106225] Updated weights for policy 1, policy_version 976806 (0.0009) [2023-12-28 02:15:35,147][106225] Updated weights for policy 1, policy_version 976816 (0.0010) [2023-12-28 02:15:35,205][106225] Updated weights for policy 1, policy_version 976826 (0.0010) [2023-12-28 02:15:35,712][106226] Updated weights for policy 0, policy_version 974632 (0.0009) [2023-12-28 02:15:35,768][106226] Updated weights for policy 0, policy_version 974642 (0.0008) [2023-12-28 02:15:35,806][106225] Updated weights for policy 1, policy_version 976836 (0.0009) [2023-12-28 02:15:35,825][106226] Updated weights for policy 0, policy_version 974652 (0.0005) [2023-12-28 02:15:35,865][106225] Updated weights for policy 1, policy_version 976846 (0.0006) [2023-12-28 02:15:35,926][106225] Updated weights for policy 1, policy_version 976856 (0.0010) [2023-12-28 02:15:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 499687424. Throughput: 0: 9901.5, 1: 9760.3. Samples: 499695252. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:36,175][105115] Avg episode reward: [(0, '-5.043'), (1, '-5.359')] [2023-12-28 02:15:36,535][106226] Updated weights for policy 0, policy_version 974662 (0.0007) [2023-12-28 02:15:36,602][106226] Updated weights for policy 0, policy_version 974672 (0.0008) [2023-12-28 02:15:36,642][106225] Updated weights for policy 1, policy_version 976866 (0.0010) [2023-12-28 02:15:36,666][106226] Updated weights for policy 0, policy_version 974682 (0.0006) [2023-12-28 02:15:36,704][106225] Updated weights for policy 1, policy_version 976876 (0.0010) [2023-12-28 02:15:36,765][106225] Updated weights for policy 1, policy_version 976886 (0.0009) [2023-12-28 02:15:36,833][106225] Updated weights for policy 1, policy_version 976896 (0.0008) [2023-12-28 02:15:37,362][106226] Updated weights for policy 0, policy_version 974692 (0.0007) [2023-12-28 02:15:37,413][106226] Updated weights for policy 0, policy_version 974702 (0.0008) [2023-12-28 02:15:37,468][106226] Updated weights for policy 0, policy_version 974712 (0.0008) [2023-12-28 02:15:37,520][106225] Updated weights for policy 1, policy_version 976906 (0.0005) [2023-12-28 02:15:37,566][106225] Updated weights for policy 1, policy_version 976916 (0.0005) [2023-12-28 02:15:37,613][106225] Updated weights for policy 1, policy_version 976926 (0.0005) [2023-12-28 02:15:38,209][106225] Updated weights for policy 1, policy_version 976936 (0.0009) [2023-12-28 02:15:38,259][106225] Updated weights for policy 1, policy_version 976946 (0.0010) [2023-12-28 02:15:38,279][106226] Updated weights for policy 0, policy_version 974722 (0.0009) [2023-12-28 02:15:38,308][106225] Updated weights for policy 1, policy_version 976956 (0.0008) [2023-12-28 02:15:38,336][106226] Updated weights for policy 0, policy_version 974732 (0.0008) [2023-12-28 02:15:38,399][106226] Updated weights for policy 0, policy_version 974742 (0.0007) [2023-12-28 02:15:38,461][106226] Updated weights for policy 0, policy_version 974752 (0.0005) [2023-12-28 02:15:39,045][106225] Updated weights for policy 1, policy_version 976966 (0.0009) [2023-12-28 02:15:39,065][106226] Updated weights for policy 0, policy_version 974762 (0.0005) [2023-12-28 02:15:39,096][106225] Updated weights for policy 1, policy_version 976976 (0.0010) [2023-12-28 02:15:39,124][106226] Updated weights for policy 0, policy_version 974772 (0.0008) [2023-12-28 02:15:39,150][106225] Updated weights for policy 1, policy_version 976986 (0.0010) [2023-12-28 02:15:39,173][106226] Updated weights for policy 0, policy_version 974782 (0.0007) [2023-12-28 02:15:39,883][106225] Updated weights for policy 1, policy_version 976996 (0.0011) [2023-12-28 02:15:39,944][106225] Updated weights for policy 1, policy_version 977006 (0.0010) [2023-12-28 02:15:39,949][106226] Updated weights for policy 0, policy_version 974792 (0.0007) [2023-12-28 02:15:40,010][106226] Updated weights for policy 0, policy_version 974802 (0.0006) [2023-12-28 02:15:40,013][106225] Updated weights for policy 1, policy_version 977016 (0.0010) [2023-12-28 02:15:40,066][106226] Updated weights for policy 0, policy_version 974812 (0.0006) [2023-12-28 02:15:40,663][106226] Updated weights for policy 0, policy_version 974822 (0.0007) [2023-12-28 02:15:40,720][106226] Updated weights for policy 0, policy_version 974832 (0.0009) [2023-12-28 02:15:40,735][106225] Updated weights for policy 1, policy_version 977026 (0.0010) [2023-12-28 02:15:40,777][106226] Updated weights for policy 0, policy_version 974842 (0.0010) [2023-12-28 02:15:40,784][106225] Updated weights for policy 1, policy_version 977036 (0.0007) [2023-12-28 02:15:40,843][106225] Updated weights for policy 1, policy_version 977046 (0.0005) [2023-12-28 02:15:40,895][106225] Updated weights for policy 1, policy_version 977056 (0.0005) [2023-12-28 02:15:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 499785728. Throughput: 0: 9890.8, 1: 9811.2. Samples: 499755432. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:41,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-4.939')] [2023-12-28 02:15:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000977056_250167296.pth... [2023-12-28 02:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000974848_249618432.pth... [2023-12-28 02:15:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000973696_249323520.pth [2023-12-28 02:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000975936_249880576.pth [2023-12-28 02:15:41,545][106225] Updated weights for policy 1, policy_version 977066 (0.0010) [2023-12-28 02:15:41,551][106226] Updated weights for policy 0, policy_version 974852 (0.0011) [2023-12-28 02:15:41,608][106225] Updated weights for policy 1, policy_version 977076 (0.0009) [2023-12-28 02:15:41,615][106226] Updated weights for policy 0, policy_version 974862 (0.0011) [2023-12-28 02:15:41,670][106225] Updated weights for policy 1, policy_version 977086 (0.0009) [2023-12-28 02:15:41,676][106226] Updated weights for policy 0, policy_version 974872 (0.0009) [2023-12-28 02:15:42,378][106225] Updated weights for policy 1, policy_version 977096 (0.0009) [2023-12-28 02:15:42,425][106226] Updated weights for policy 0, policy_version 974882 (0.0008) [2023-12-28 02:15:42,436][106225] Updated weights for policy 1, policy_version 977106 (0.0007) [2023-12-28 02:15:42,486][106226] Updated weights for policy 0, policy_version 974892 (0.0008) [2023-12-28 02:15:42,488][106225] Updated weights for policy 1, policy_version 977116 (0.0007) [2023-12-28 02:15:42,543][106226] Updated weights for policy 0, policy_version 974902 (0.0007) [2023-12-28 02:15:42,603][106226] Updated weights for policy 0, policy_version 974912 (0.0009) [2023-12-28 02:15:43,218][106225] Updated weights for policy 1, policy_version 977126 (0.0007) [2023-12-28 02:15:43,271][106225] Updated weights for policy 1, policy_version 977136 (0.0006) [2023-12-28 02:15:43,327][106225] Updated weights for policy 1, policy_version 977146 (0.0005) [2023-12-28 02:15:43,337][106226] Updated weights for policy 0, policy_version 974922 (0.0008) [2023-12-28 02:15:43,389][106226] Updated weights for policy 0, policy_version 974932 (0.0008) [2023-12-28 02:15:43,447][106226] Updated weights for policy 0, policy_version 974942 (0.0009) [2023-12-28 02:15:43,950][106225] Updated weights for policy 1, policy_version 977156 (0.0007) [2023-12-28 02:15:44,002][106225] Updated weights for policy 1, policy_version 977166 (0.0007) [2023-12-28 02:15:44,056][106225] Updated weights for policy 1, policy_version 977176 (0.0006) [2023-12-28 02:15:44,206][106226] Updated weights for policy 0, policy_version 974952 (0.0008) [2023-12-28 02:15:44,265][106226] Updated weights for policy 0, policy_version 974962 (0.0007) [2023-12-28 02:15:44,311][106226] Updated weights for policy 0, policy_version 974972 (0.0005) [2023-12-28 02:15:44,763][106225] Updated weights for policy 1, policy_version 977186 (0.0010) [2023-12-28 02:15:44,832][106225] Updated weights for policy 1, policy_version 977196 (0.0007) [2023-12-28 02:15:44,899][106225] Updated weights for policy 1, policy_version 977206 (0.0006) [2023-12-28 02:15:44,955][106226] Updated weights for policy 0, policy_version 974982 (0.0009) [2023-12-28 02:15:44,967][106225] Updated weights for policy 1, policy_version 977216 (0.0006) [2023-12-28 02:15:45,021][106226] Updated weights for policy 0, policy_version 974992 (0.0011) [2023-12-28 02:15:45,087][106226] Updated weights for policy 0, policy_version 975002 (0.0011) [2023-12-28 02:15:45,673][106225] Updated weights for policy 1, policy_version 977226 (0.0008) [2023-12-28 02:15:45,735][106225] Updated weights for policy 1, policy_version 977236 (0.0008) [2023-12-28 02:15:45,787][106225] Updated weights for policy 1, policy_version 977246 (0.0007) [2023-12-28 02:15:45,797][106226] Updated weights for policy 0, policy_version 975012 (0.0011) [2023-12-28 02:15:45,848][106226] Updated weights for policy 0, policy_version 975022 (0.0010) [2023-12-28 02:15:45,912][106226] Updated weights for policy 0, policy_version 975032 (0.0011) [2023-12-28 02:15:46,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 499884032. Throughput: 0: 9835.8, 1: 9838.7. Samples: 499872624. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:46,176][105115] Avg episode reward: [(0, '-4.837'), (1, '-5.236')] [2023-12-28 02:15:46,522][106225] Updated weights for policy 1, policy_version 977256 (0.0007) [2023-12-28 02:15:46,578][106225] Updated weights for policy 1, policy_version 977266 (0.0007) [2023-12-28 02:15:46,629][106226] Updated weights for policy 0, policy_version 975042 (0.0011) [2023-12-28 02:15:46,643][106225] Updated weights for policy 1, policy_version 977276 (0.0008) [2023-12-28 02:15:46,682][106226] Updated weights for policy 0, policy_version 975052 (0.0010) [2023-12-28 02:15:46,748][106226] Updated weights for policy 0, policy_version 975062 (0.0011) [2023-12-28 02:15:46,804][106226] Updated weights for policy 0, policy_version 975072 (0.0010) [2023-12-28 02:15:47,339][106225] Updated weights for policy 1, policy_version 977286 (0.0007) [2023-12-28 02:15:47,394][106225] Updated weights for policy 1, policy_version 977296 (0.0005) [2023-12-28 02:15:47,411][106226] Updated weights for policy 0, policy_version 975082 (0.0010) [2023-12-28 02:15:47,448][106225] Updated weights for policy 1, policy_version 977306 (0.0005) [2023-12-28 02:15:47,457][106226] Updated weights for policy 0, policy_version 975092 (0.0010) [2023-12-28 02:15:47,504][106226] Updated weights for policy 0, policy_version 975102 (0.0010) [2023-12-28 02:15:48,032][106225] Updated weights for policy 1, policy_version 977316 (0.0005) [2023-12-28 02:15:48,081][106225] Updated weights for policy 1, policy_version 977326 (0.0006) [2023-12-28 02:15:48,128][106225] Updated weights for policy 1, policy_version 977336 (0.0008) [2023-12-28 02:15:48,268][106226] Updated weights for policy 0, policy_version 975112 (0.0011) [2023-12-28 02:15:48,335][106226] Updated weights for policy 0, policy_version 975122 (0.0011) [2023-12-28 02:15:48,394][106226] Updated weights for policy 0, policy_version 975132 (0.0009) [2023-12-28 02:15:48,816][106225] Updated weights for policy 1, policy_version 977346 (0.0008) [2023-12-28 02:15:48,872][106225] Updated weights for policy 1, policy_version 977356 (0.0008) [2023-12-28 02:15:48,933][106225] Updated weights for policy 1, policy_version 977366 (0.0008) [2023-12-28 02:15:48,991][106225] Updated weights for policy 1, policy_version 977376 (0.0009) [2023-12-28 02:15:49,063][106226] Updated weights for policy 0, policy_version 975142 (0.0008) [2023-12-28 02:15:49,119][106226] Updated weights for policy 0, policy_version 975152 (0.0007) [2023-12-28 02:15:49,172][106226] Updated weights for policy 0, policy_version 975162 (0.0005) [2023-12-28 02:15:49,790][106225] Updated weights for policy 1, policy_version 977386 (0.0011) [2023-12-28 02:15:49,858][106225] Updated weights for policy 1, policy_version 977396 (0.0009) [2023-12-28 02:15:49,859][106226] Updated weights for policy 0, policy_version 975172 (0.0007) [2023-12-28 02:15:49,922][106225] Updated weights for policy 1, policy_version 977406 (0.0007) [2023-12-28 02:15:49,924][106226] Updated weights for policy 0, policy_version 975182 (0.0009) [2023-12-28 02:15:49,992][106226] Updated weights for policy 0, policy_version 975192 (0.0008) [2023-12-28 02:15:50,674][106225] Updated weights for policy 1, policy_version 977416 (0.0008) [2023-12-28 02:15:50,686][106226] Updated weights for policy 0, policy_version 975202 (0.0006) [2023-12-28 02:15:50,737][106225] Updated weights for policy 1, policy_version 977426 (0.0008) [2023-12-28 02:15:50,747][106226] Updated weights for policy 0, policy_version 975212 (0.0011) [2023-12-28 02:15:50,802][106225] Updated weights for policy 1, policy_version 977436 (0.0005) [2023-12-28 02:15:50,808][106226] Updated weights for policy 0, policy_version 975222 (0.0011) [2023-12-28 02:15:50,865][106226] Updated weights for policy 0, policy_version 975232 (0.0010) [2023-12-28 02:15:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 499982336. Throughput: 0: 9840.7, 1: 9778.8. Samples: 499990348. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:51,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-5.122')] [2023-12-28 02:15:51,557][106225] Updated weights for policy 1, policy_version 977446 (0.0006) [2023-12-28 02:15:51,564][106226] Updated weights for policy 0, policy_version 975242 (0.0008) [2023-12-28 02:15:51,617][106225] Updated weights for policy 1, policy_version 977456 (0.0006) [2023-12-28 02:15:51,619][106226] Updated weights for policy 0, policy_version 975252 (0.0007) [2023-12-28 02:15:51,682][106225] Updated weights for policy 1, policy_version 977466 (0.0007) [2023-12-28 02:15:51,687][106226] Updated weights for policy 0, policy_version 975262 (0.0007) [2023-12-28 02:15:52,308][106225] Updated weights for policy 1, policy_version 977476 (0.0007) [2023-12-28 02:15:52,370][106225] Updated weights for policy 1, policy_version 977486 (0.0007) [2023-12-28 02:15:52,425][106226] Updated weights for policy 0, policy_version 975272 (0.0008) [2023-12-28 02:15:52,438][106225] Updated weights for policy 1, policy_version 977496 (0.0007) [2023-12-28 02:15:52,480][106226] Updated weights for policy 0, policy_version 975282 (0.0008) [2023-12-28 02:15:52,532][106226] Updated weights for policy 0, policy_version 975292 (0.0008) [2023-12-28 02:15:53,095][106225] Updated weights for policy 1, policy_version 977506 (0.0008) [2023-12-28 02:15:53,149][106225] Updated weights for policy 1, policy_version 977516 (0.0009) [2023-12-28 02:15:53,188][106226] Updated weights for policy 0, policy_version 975302 (0.0007) [2023-12-28 02:15:53,210][106225] Updated weights for policy 1, policy_version 977526 (0.0008) [2023-12-28 02:15:53,247][106226] Updated weights for policy 0, policy_version 975312 (0.0007) [2023-12-28 02:15:53,276][106225] Updated weights for policy 1, policy_version 977536 (0.0009) [2023-12-28 02:15:53,300][106226] Updated weights for policy 0, policy_version 975322 (0.0007) [2023-12-28 02:15:53,972][106226] Updated weights for policy 0, policy_version 975332 (0.0007) [2023-12-28 02:15:54,016][106225] Updated weights for policy 1, policy_version 977546 (0.0006) [2023-12-28 02:15:54,022][106226] Updated weights for policy 0, policy_version 975342 (0.0006) [2023-12-28 02:15:54,062][106225] Updated weights for policy 1, policy_version 977556 (0.0006) [2023-12-28 02:15:54,088][106226] Updated weights for policy 0, policy_version 975352 (0.0007) [2023-12-28 02:15:54,113][106225] Updated weights for policy 1, policy_version 977566 (0.0008) [2023-12-28 02:15:54,793][106226] Updated weights for policy 0, policy_version 975362 (0.0007) [2023-12-28 02:15:54,839][106225] Updated weights for policy 1, policy_version 977576 (0.0006) [2023-12-28 02:15:54,853][106226] Updated weights for policy 0, policy_version 975372 (0.0008) [2023-12-28 02:15:54,899][106225] Updated weights for policy 1, policy_version 977586 (0.0006) [2023-12-28 02:15:54,919][106226] Updated weights for policy 0, policy_version 975382 (0.0008) [2023-12-28 02:15:54,954][106225] Updated weights for policy 1, policy_version 977596 (0.0006) [2023-12-28 02:15:54,978][106226] Updated weights for policy 0, policy_version 975392 (0.0008) [2023-12-28 02:15:55,650][106225] Updated weights for policy 1, policy_version 977606 (0.0009) [2023-12-28 02:15:55,661][106226] Updated weights for policy 0, policy_version 975402 (0.0006) [2023-12-28 02:15:55,706][106225] Updated weights for policy 1, policy_version 977616 (0.0010) [2023-12-28 02:15:55,709][106226] Updated weights for policy 0, policy_version 975412 (0.0008) [2023-12-28 02:15:55,762][106226] Updated weights for policy 0, policy_version 975422 (0.0008) [2023-12-28 02:15:55,767][106225] Updated weights for policy 1, policy_version 977626 (0.0005) [2023-12-28 02:15:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 500080640. Throughput: 0: 9888.2, 1: 9753.5. Samples: 500050376. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:15:56,176][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.392')] [2023-12-28 02:15:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000975424_249765888.pth... [2023-12-28 02:15:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000977632_250314752.pth... [2023-12-28 02:15:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000974272_249470976.pth [2023-12-28 02:15:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000976480_250019840.pth [2023-12-28 02:15:56,386][106225] Updated weights for policy 1, policy_version 977636 (0.0006) [2023-12-28 02:15:56,444][106225] Updated weights for policy 1, policy_version 977646 (0.0008) [2023-12-28 02:15:56,501][106225] Updated weights for policy 1, policy_version 977656 (0.0005) [2023-12-28 02:15:56,553][106226] Updated weights for policy 0, policy_version 975432 (0.0010) [2023-12-28 02:15:56,613][106226] Updated weights for policy 0, policy_version 975442 (0.0009) [2023-12-28 02:15:56,673][106226] Updated weights for policy 0, policy_version 975452 (0.0008) [2023-12-28 02:15:57,251][106226] Updated weights for policy 0, policy_version 975462 (0.0007) [2023-12-28 02:15:57,260][106225] Updated weights for policy 1, policy_version 977666 (0.0008) [2023-12-28 02:15:57,312][106226] Updated weights for policy 0, policy_version 975472 (0.0006) [2023-12-28 02:15:57,319][106225] Updated weights for policy 1, policy_version 977676 (0.0007) [2023-12-28 02:15:57,366][106226] Updated weights for policy 0, policy_version 975482 (0.0008) [2023-12-28 02:15:57,371][106225] Updated weights for policy 1, policy_version 977686 (0.0007) [2023-12-28 02:15:57,426][106225] Updated weights for policy 1, policy_version 977696 (0.0009) [2023-12-28 02:15:57,987][106226] Updated weights for policy 0, policy_version 975492 (0.0007) [2023-12-28 02:15:58,044][106226] Updated weights for policy 0, policy_version 975502 (0.0010) [2023-12-28 02:15:58,099][106226] Updated weights for policy 0, policy_version 975512 (0.0010) [2023-12-28 02:15:58,188][106225] Updated weights for policy 1, policy_version 977706 (0.0007) [2023-12-28 02:15:58,256][106225] Updated weights for policy 1, policy_version 977716 (0.0009) [2023-12-28 02:15:58,310][106225] Updated weights for policy 1, policy_version 977726 (0.0009) [2023-12-28 02:15:58,924][106226] Updated weights for policy 0, policy_version 975522 (0.0010) [2023-12-28 02:15:58,993][106226] Updated weights for policy 0, policy_version 975532 (0.0008) [2023-12-28 02:15:59,056][106226] Updated weights for policy 0, policy_version 975542 (0.0008) [2023-12-28 02:15:59,110][106225] Updated weights for policy 1, policy_version 977736 (0.0009) [2023-12-28 02:15:59,121][106226] Updated weights for policy 0, policy_version 975552 (0.0007) [2023-12-28 02:15:59,174][106225] Updated weights for policy 1, policy_version 977746 (0.0008) [2023-12-28 02:15:59,245][106225] Updated weights for policy 1, policy_version 977756 (0.0009) [2023-12-28 02:15:59,880][106226] Updated weights for policy 0, policy_version 975562 (0.0008) [2023-12-28 02:15:59,946][106226] Updated weights for policy 0, policy_version 975572 (0.0008) [2023-12-28 02:15:59,979][106225] Updated weights for policy 1, policy_version 977766 (0.0007) [2023-12-28 02:16:00,011][106226] Updated weights for policy 0, policy_version 975582 (0.0007) [2023-12-28 02:16:00,036][106225] Updated weights for policy 1, policy_version 977776 (0.0009) [2023-12-28 02:16:00,097][106225] Updated weights for policy 1, policy_version 977786 (0.0007) [2023-12-28 02:16:00,709][106226] Updated weights for policy 0, policy_version 975592 (0.0007) [2023-12-28 02:16:00,764][106226] Updated weights for policy 0, policy_version 975602 (0.0008) [2023-12-28 02:16:00,820][106226] Updated weights for policy 0, policy_version 975612 (0.0008) [2023-12-28 02:16:00,829][106225] Updated weights for policy 1, policy_version 977796 (0.0007) [2023-12-28 02:16:00,894][106225] Updated weights for policy 1, policy_version 977806 (0.0005) [2023-12-28 02:16:00,952][106225] Updated weights for policy 1, policy_version 977816 (0.0005) [2023-12-28 02:16:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 500178944. Throughput: 0: 9882.4, 1: 9721.0. Samples: 500166740. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:01,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-5.083')] [2023-12-28 02:16:01,601][106226] Updated weights for policy 0, policy_version 975622 (0.0010) [2023-12-28 02:16:01,614][106225] Updated weights for policy 1, policy_version 977826 (0.0008) [2023-12-28 02:16:01,671][106226] Updated weights for policy 0, policy_version 975632 (0.0010) [2023-12-28 02:16:01,681][106225] Updated weights for policy 1, policy_version 977836 (0.0007) [2023-12-28 02:16:01,744][106226] Updated weights for policy 0, policy_version 975642 (0.0010) [2023-12-28 02:16:01,749][106225] Updated weights for policy 1, policy_version 977846 (0.0008) [2023-12-28 02:16:01,809][106225] Updated weights for policy 1, policy_version 977856 (0.0008) [2023-12-28 02:16:02,431][106226] Updated weights for policy 0, policy_version 975652 (0.0010) [2023-12-28 02:16:02,485][106226] Updated weights for policy 0, policy_version 975662 (0.0008) [2023-12-28 02:16:02,544][106226] Updated weights for policy 0, policy_version 975672 (0.0008) [2023-12-28 02:16:02,571][106225] Updated weights for policy 1, policy_version 977866 (0.0006) [2023-12-28 02:16:02,634][106225] Updated weights for policy 1, policy_version 977876 (0.0008) [2023-12-28 02:16:02,694][106225] Updated weights for policy 1, policy_version 977886 (0.0008) [2023-12-28 02:16:03,323][106226] Updated weights for policy 0, policy_version 975682 (0.0008) [2023-12-28 02:16:03,360][106225] Updated weights for policy 1, policy_version 977896 (0.0006) [2023-12-28 02:16:03,387][106226] Updated weights for policy 0, policy_version 975692 (0.0007) [2023-12-28 02:16:03,413][106225] Updated weights for policy 1, policy_version 977906 (0.0006) [2023-12-28 02:16:03,447][106226] Updated weights for policy 0, policy_version 975702 (0.0007) [2023-12-28 02:16:03,476][106225] Updated weights for policy 1, policy_version 977916 (0.0006) [2023-12-28 02:16:03,502][106226] Updated weights for policy 0, policy_version 975712 (0.0009) [2023-12-28 02:16:04,174][106225] Updated weights for policy 1, policy_version 977926 (0.0008) [2023-12-28 02:16:04,236][106225] Updated weights for policy 1, policy_version 977936 (0.0010) [2023-12-28 02:16:04,252][106226] Updated weights for policy 0, policy_version 975722 (0.0008) [2023-12-28 02:16:04,291][106225] Updated weights for policy 1, policy_version 977946 (0.0010) [2023-12-28 02:16:04,315][106226] Updated weights for policy 0, policy_version 975732 (0.0008) [2023-12-28 02:16:04,371][106226] Updated weights for policy 0, policy_version 975742 (0.0008) [2023-12-28 02:16:05,033][106225] Updated weights for policy 1, policy_version 977957 (0.0010) [2023-12-28 02:16:05,047][106226] Updated weights for policy 0, policy_version 975752 (0.0008) [2023-12-28 02:16:05,087][106225] Updated weights for policy 1, policy_version 977967 (0.0007) [2023-12-28 02:16:05,109][106226] Updated weights for policy 0, policy_version 975762 (0.0008) [2023-12-28 02:16:05,147][106225] Updated weights for policy 1, policy_version 977977 (0.0007) [2023-12-28 02:16:05,174][106226] Updated weights for policy 0, policy_version 975772 (0.0007) [2023-12-28 02:16:05,840][106225] Updated weights for policy 1, policy_version 977987 (0.0008) [2023-12-28 02:16:05,896][106225] Updated weights for policy 1, policy_version 977997 (0.0010) [2023-12-28 02:16:05,955][106225] Updated weights for policy 1, policy_version 978007 (0.0008) [2023-12-28 02:16:05,963][106226] Updated weights for policy 0, policy_version 975782 (0.0009) [2023-12-28 02:16:06,031][106226] Updated weights for policy 0, policy_version 975792 (0.0010) [2023-12-28 02:16:06,103][106226] Updated weights for policy 0, policy_version 975802 (0.0008) [2023-12-28 02:16:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 500277248. Throughput: 0: 9837.8, 1: 9756.1. Samples: 500281860. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:06,175][105115] Avg episode reward: [(0, '-5.107'), (1, '-5.169')] [2023-12-28 02:16:06,690][106225] Updated weights for policy 1, policy_version 978017 (0.0010) [2023-12-28 02:16:06,753][106226] Updated weights for policy 0, policy_version 975812 (0.0008) [2023-12-28 02:16:06,756][106225] Updated weights for policy 1, policy_version 978027 (0.0011) [2023-12-28 02:16:06,814][106226] Updated weights for policy 0, policy_version 975822 (0.0007) [2023-12-28 02:16:06,817][106225] Updated weights for policy 1, policy_version 978037 (0.0009) [2023-12-28 02:16:06,876][106226] Updated weights for policy 0, policy_version 975832 (0.0008) [2023-12-28 02:16:06,883][106225] Updated weights for policy 1, policy_version 978047 (0.0009) [2023-12-28 02:16:07,563][106225] Updated weights for policy 1, policy_version 978057 (0.0009) [2023-12-28 02:16:07,623][106225] Updated weights for policy 1, policy_version 978067 (0.0008) [2023-12-28 02:16:07,628][106226] Updated weights for policy 0, policy_version 975842 (0.0007) [2023-12-28 02:16:07,684][106225] Updated weights for policy 1, policy_version 978077 (0.0006) [2023-12-28 02:16:07,699][106226] Updated weights for policy 0, policy_version 975852 (0.0007) [2023-12-28 02:16:07,766][106226] Updated weights for policy 0, policy_version 975862 (0.0009) [2023-12-28 02:16:07,821][106226] Updated weights for policy 0, policy_version 975872 (0.0008) [2023-12-28 02:16:08,341][106225] Updated weights for policy 1, policy_version 978087 (0.0007) [2023-12-28 02:16:08,403][106225] Updated weights for policy 1, policy_version 978097 (0.0009) [2023-12-28 02:16:08,469][106225] Updated weights for policy 1, policy_version 978107 (0.0009) [2023-12-28 02:16:08,571][106226] Updated weights for policy 0, policy_version 975882 (0.0008) [2023-12-28 02:16:08,644][106226] Updated weights for policy 0, policy_version 975892 (0.0010) [2023-12-28 02:16:08,710][106226] Updated weights for policy 0, policy_version 975902 (0.0009) [2023-12-28 02:16:09,166][106225] Updated weights for policy 1, policy_version 978117 (0.0007) [2023-12-28 02:16:09,235][106225] Updated weights for policy 1, policy_version 978127 (0.0007) [2023-12-28 02:16:09,300][106225] Updated weights for policy 1, policy_version 978137 (0.0007) [2023-12-28 02:16:09,386][106226] Updated weights for policy 0, policy_version 975912 (0.0009) [2023-12-28 02:16:09,457][106226] Updated weights for policy 0, policy_version 975922 (0.0011) [2023-12-28 02:16:09,523][106226] Updated weights for policy 0, policy_version 975932 (0.0010) [2023-12-28 02:16:09,983][106225] Updated weights for policy 1, policy_version 978147 (0.0007) [2023-12-28 02:16:10,054][106225] Updated weights for policy 1, policy_version 978157 (0.0007) [2023-12-28 02:16:10,127][106225] Updated weights for policy 1, policy_version 978168 (0.0007) [2023-12-28 02:16:10,281][106226] Updated weights for policy 0, policy_version 975942 (0.0009) [2023-12-28 02:16:10,344][106226] Updated weights for policy 0, policy_version 975952 (0.0008) [2023-12-28 02:16:10,395][106226] Updated weights for policy 0, policy_version 975962 (0.0008) [2023-12-28 02:16:10,822][106225] Updated weights for policy 1, policy_version 978178 (0.0009) [2023-12-28 02:16:10,884][106225] Updated weights for policy 1, policy_version 978188 (0.0010) [2023-12-28 02:16:10,947][106225] Updated weights for policy 1, policy_version 978198 (0.0010) [2023-12-28 02:16:11,011][106225] Updated weights for policy 1, policy_version 978208 (0.0010) [2023-12-28 02:16:11,088][106226] Updated weights for policy 0, policy_version 975972 (0.0007) [2023-12-28 02:16:11,154][106226] Updated weights for policy 0, policy_version 975982 (0.0007) [2023-12-28 02:16:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 500367360. Throughput: 0: 9835.0, 1: 9804.5. Samples: 500339964. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:11,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-5.293')] [2023-12-28 02:16:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000978208_250462208.pth... [2023-12-28 02:16:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000977056_250167296.pth [2023-12-28 02:16:11,221][106226] Updated weights for policy 0, policy_version 975992 (0.0009) [2023-12-28 02:16:11,279][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000976000_249913344.pth... [2023-12-28 02:16:11,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000974848_249618432.pth [2023-12-28 02:16:11,685][106225] Updated weights for policy 1, policy_version 978218 (0.0010) [2023-12-28 02:16:11,752][106225] Updated weights for policy 1, policy_version 978228 (0.0010) [2023-12-28 02:16:11,826][106225] Updated weights for policy 1, policy_version 978238 (0.0012) [2023-12-28 02:16:12,000][106226] Updated weights for policy 0, policy_version 976002 (0.0008) [2023-12-28 02:16:12,067][106226] Updated weights for policy 0, policy_version 976012 (0.0007) [2023-12-28 02:16:12,130][106226] Updated weights for policy 0, policy_version 976022 (0.0007) [2023-12-28 02:16:12,198][106226] Updated weights for policy 0, policy_version 976032 (0.0007) [2023-12-28 02:16:12,589][106225] Updated weights for policy 1, policy_version 978248 (0.0010) [2023-12-28 02:16:12,653][106225] Updated weights for policy 1, policy_version 978258 (0.0009) [2023-12-28 02:16:12,714][106225] Updated weights for policy 1, policy_version 978268 (0.0007) [2023-12-28 02:16:12,949][106226] Updated weights for policy 0, policy_version 976042 (0.0007) [2023-12-28 02:16:13,003][106226] Updated weights for policy 0, policy_version 976052 (0.0010) [2023-12-28 02:16:13,050][106226] Updated weights for policy 0, policy_version 976062 (0.0010) [2023-12-28 02:16:13,363][106225] Updated weights for policy 1, policy_version 978278 (0.0008) [2023-12-28 02:16:13,423][106225] Updated weights for policy 1, policy_version 978288 (0.0010) [2023-12-28 02:16:13,482][106225] Updated weights for policy 1, policy_version 978298 (0.0010) [2023-12-28 02:16:13,710][106226] Updated weights for policy 0, policy_version 976072 (0.0011) [2023-12-28 02:16:13,772][106226] Updated weights for policy 0, policy_version 976082 (0.0010) [2023-12-28 02:16:13,831][106226] Updated weights for policy 0, policy_version 976092 (0.0010) [2023-12-28 02:16:14,113][106225] Updated weights for policy 1, policy_version 978308 (0.0009) [2023-12-28 02:16:14,179][106225] Updated weights for policy 1, policy_version 978318 (0.0008) [2023-12-28 02:16:14,242][106225] Updated weights for policy 1, policy_version 978328 (0.0008) [2023-12-28 02:16:14,545][106226] Updated weights for policy 0, policy_version 976102 (0.0011) [2023-12-28 02:16:14,608][106226] Updated weights for policy 0, policy_version 976112 (0.0010) [2023-12-28 02:16:14,663][106226] Updated weights for policy 0, policy_version 976122 (0.0008) [2023-12-28 02:16:14,946][106225] Updated weights for policy 1, policy_version 978338 (0.0007) [2023-12-28 02:16:15,016][106225] Updated weights for policy 1, policy_version 978348 (0.0008) [2023-12-28 02:16:15,079][106225] Updated weights for policy 1, policy_version 978358 (0.0009) [2023-12-28 02:16:15,144][106225] Updated weights for policy 1, policy_version 978368 (0.0009) [2023-12-28 02:16:15,335][106226] Updated weights for policy 0, policy_version 976132 (0.0008) [2023-12-28 02:16:15,399][106226] Updated weights for policy 0, policy_version 976142 (0.0011) [2023-12-28 02:16:15,458][106226] Updated weights for policy 0, policy_version 976152 (0.0010) [2023-12-28 02:16:15,884][106225] Updated weights for policy 1, policy_version 978378 (0.0006) [2023-12-28 02:16:15,944][106225] Updated weights for policy 1, policy_version 978388 (0.0009) [2023-12-28 02:16:15,991][106225] Updated weights for policy 1, policy_version 978398 (0.0009) [2023-12-28 02:16:16,098][106226] Updated weights for policy 0, policy_version 976162 (0.0010) [2023-12-28 02:16:16,158][106226] Updated weights for policy 0, policy_version 976172 (0.0006) [2023-12-28 02:16:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 500465664. Throughput: 0: 9748.9, 1: 9807.6. Samples: 500456064. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:16,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-4.816')] [2023-12-28 02:16:16,224][106226] Updated weights for policy 0, policy_version 976182 (0.0007) [2023-12-28 02:16:16,290][106226] Updated weights for policy 0, policy_version 976192 (0.0006) [2023-12-28 02:16:16,767][106225] Updated weights for policy 1, policy_version 978408 (0.0009) [2023-12-28 02:16:16,825][106225] Updated weights for policy 1, policy_version 978418 (0.0008) [2023-12-28 02:16:16,827][106226] Updated weights for policy 0, policy_version 976202 (0.0009) [2023-12-28 02:16:16,886][106226] Updated weights for policy 0, policy_version 976212 (0.0006) [2023-12-28 02:16:16,887][106225] Updated weights for policy 1, policy_version 978428 (0.0006) [2023-12-28 02:16:16,948][106226] Updated weights for policy 0, policy_version 976222 (0.0007) [2023-12-28 02:16:17,590][106225] Updated weights for policy 1, policy_version 978438 (0.0008) [2023-12-28 02:16:17,648][106225] Updated weights for policy 1, policy_version 978448 (0.0009) [2023-12-28 02:16:17,665][106226] Updated weights for policy 0, policy_version 976232 (0.0008) [2023-12-28 02:16:17,709][106225] Updated weights for policy 1, policy_version 978458 (0.0006) [2023-12-28 02:16:17,726][106226] Updated weights for policy 0, policy_version 976242 (0.0009) [2023-12-28 02:16:17,784][106226] Updated weights for policy 0, policy_version 976252 (0.0008) [2023-12-28 02:16:18,442][106225] Updated weights for policy 1, policy_version 978468 (0.0007) [2023-12-28 02:16:18,492][106226] Updated weights for policy 0, policy_version 976262 (0.0007) [2023-12-28 02:16:18,501][106225] Updated weights for policy 1, policy_version 978478 (0.0007) [2023-12-28 02:16:18,556][106226] Updated weights for policy 0, policy_version 976272 (0.0006) [2023-12-28 02:16:18,560][106225] Updated weights for policy 1, policy_version 978488 (0.0008) [2023-12-28 02:16:18,621][106226] Updated weights for policy 0, policy_version 976282 (0.0008) [2023-12-28 02:16:19,291][106225] Updated weights for policy 1, policy_version 978498 (0.0008) [2023-12-28 02:16:19,333][106226] Updated weights for policy 0, policy_version 976292 (0.0009) [2023-12-28 02:16:19,354][106225] Updated weights for policy 1, policy_version 978508 (0.0008) [2023-12-28 02:16:19,400][106226] Updated weights for policy 0, policy_version 976302 (0.0008) [2023-12-28 02:16:19,412][106225] Updated weights for policy 1, policy_version 978518 (0.0006) [2023-12-28 02:16:19,461][106226] Updated weights for policy 0, policy_version 976312 (0.0008) [2023-12-28 02:16:19,472][106225] Updated weights for policy 1, policy_version 978528 (0.0005) [2023-12-28 02:16:20,180][106225] Updated weights for policy 1, policy_version 978538 (0.0008) [2023-12-28 02:16:20,210][106226] Updated weights for policy 0, policy_version 976322 (0.0010) [2023-12-28 02:16:20,239][106225] Updated weights for policy 1, policy_version 978548 (0.0008) [2023-12-28 02:16:20,273][106226] Updated weights for policy 0, policy_version 976332 (0.0007) [2023-12-28 02:16:20,299][106225] Updated weights for policy 1, policy_version 978558 (0.0009) [2023-12-28 02:16:20,341][106226] Updated weights for policy 0, policy_version 976342 (0.0006) [2023-12-28 02:16:20,396][106226] Updated weights for policy 0, policy_version 976352 (0.0009) [2023-12-28 02:16:21,014][106225] Updated weights for policy 1, policy_version 978568 (0.0009) [2023-12-28 02:16:21,078][106225] Updated weights for policy 1, policy_version 978578 (0.0008) [2023-12-28 02:16:21,140][106225] Updated weights for policy 1, policy_version 978588 (0.0008) [2023-12-28 02:16:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 500563968. Throughput: 0: 9727.9, 1: 9762.9. Samples: 500572340. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:21,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-5.080')] [2023-12-28 02:16:21,200][106226] Updated weights for policy 0, policy_version 976362 (0.0008) [2023-12-28 02:16:21,259][106226] Updated weights for policy 0, policy_version 976372 (0.0008) [2023-12-28 02:16:21,332][106226] Updated weights for policy 0, policy_version 976382 (0.0008) [2023-12-28 02:16:21,958][106225] Updated weights for policy 1, policy_version 978598 (0.0008) [2023-12-28 02:16:22,018][106225] Updated weights for policy 1, policy_version 978608 (0.0009) [2023-12-28 02:16:22,049][106226] Updated weights for policy 0, policy_version 976392 (0.0008) [2023-12-28 02:16:22,075][106225] Updated weights for policy 1, policy_version 978618 (0.0006) [2023-12-28 02:16:22,109][106226] Updated weights for policy 0, policy_version 976402 (0.0006) [2023-12-28 02:16:22,178][106226] Updated weights for policy 0, policy_version 976412 (0.0009) [2023-12-28 02:16:22,799][106225] Updated weights for policy 1, policy_version 978628 (0.0009) [2023-12-28 02:16:22,860][106225] Updated weights for policy 1, policy_version 978638 (0.0009) [2023-12-28 02:16:22,923][106225] Updated weights for policy 1, policy_version 978648 (0.0008) [2023-12-28 02:16:22,962][106226] Updated weights for policy 0, policy_version 976422 (0.0007) [2023-12-28 02:16:23,017][106226] Updated weights for policy 0, policy_version 976432 (0.0009) [2023-12-28 02:16:23,077][106226] Updated weights for policy 0, policy_version 976442 (0.0009) [2023-12-28 02:16:23,653][106225] Updated weights for policy 1, policy_version 978658 (0.0008) [2023-12-28 02:16:23,708][106225] Updated weights for policy 1, policy_version 978668 (0.0008) [2023-12-28 02:16:23,730][106226] Updated weights for policy 0, policy_version 976452 (0.0008) [2023-12-28 02:16:23,762][106225] Updated weights for policy 1, policy_version 978678 (0.0009) [2023-12-28 02:16:23,789][106226] Updated weights for policy 0, policy_version 976462 (0.0006) [2023-12-28 02:16:23,823][106225] Updated weights for policy 1, policy_version 978688 (0.0008) [2023-12-28 02:16:23,842][106226] Updated weights for policy 0, policy_version 976472 (0.0007) [2023-12-28 02:16:24,516][106226] Updated weights for policy 0, policy_version 976482 (0.0009) [2023-12-28 02:16:24,549][106225] Updated weights for policy 1, policy_version 978698 (0.0005) [2023-12-28 02:16:24,573][106226] Updated weights for policy 0, policy_version 976492 (0.0010) [2023-12-28 02:16:24,597][106225] Updated weights for policy 1, policy_version 978708 (0.0007) [2023-12-28 02:16:24,630][106226] Updated weights for policy 0, policy_version 976502 (0.0005) [2023-12-28 02:16:24,646][106225] Updated weights for policy 1, policy_version 978718 (0.0006) [2023-12-28 02:16:24,678][106226] Updated weights for policy 0, policy_version 976512 (0.0006) [2023-12-28 02:16:25,219][106225] Updated weights for policy 1, policy_version 978728 (0.0006) [2023-12-28 02:16:25,264][106225] Updated weights for policy 1, policy_version 978738 (0.0008) [2023-12-28 02:16:25,316][106225] Updated weights for policy 1, policy_version 978748 (0.0008) [2023-12-28 02:16:25,335][106226] Updated weights for policy 0, policy_version 976522 (0.0010) [2023-12-28 02:16:25,391][106226] Updated weights for policy 0, policy_version 976532 (0.0010) [2023-12-28 02:16:25,454][106226] Updated weights for policy 0, policy_version 976542 (0.0010) [2023-12-28 02:16:26,053][106225] Updated weights for policy 1, policy_version 978758 (0.0007) [2023-12-28 02:16:26,106][106225] Updated weights for policy 1, policy_version 978768 (0.0008) [2023-12-28 02:16:26,119][106226] Updated weights for policy 0, policy_version 976552 (0.0010) [2023-12-28 02:16:26,151][106225] Updated weights for policy 1, policy_version 978778 (0.0007) [2023-12-28 02:16:26,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 500654080. Throughput: 0: 9716.0, 1: 9708.6. Samples: 500629540. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:26,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-4.968')] [2023-12-28 02:16:26,180][106226] Updated weights for policy 0, policy_version 976562 (0.0011) [2023-12-28 02:16:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000978784_250609664.pth... [2023-12-28 02:16:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000977632_250314752.pth [2023-12-28 02:16:26,241][106226] Updated weights for policy 0, policy_version 976572 (0.0011) [2023-12-28 02:16:26,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000976576_250060800.pth... [2023-12-28 02:16:26,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000975424_249765888.pth [2023-12-28 02:16:26,829][106226] Updated weights for policy 0, policy_version 976582 (0.0010) [2023-12-28 02:16:26,883][106226] Updated weights for policy 0, policy_version 976592 (0.0010) [2023-12-28 02:16:26,927][106225] Updated weights for policy 1, policy_version 978788 (0.0007) [2023-12-28 02:16:26,932][106226] Updated weights for policy 0, policy_version 976602 (0.0010) [2023-12-28 02:16:26,977][106225] Updated weights for policy 1, policy_version 978798 (0.0008) [2023-12-28 02:16:27,024][106225] Updated weights for policy 1, policy_version 978808 (0.0008) [2023-12-28 02:16:27,553][106226] Updated weights for policy 0, policy_version 976612 (0.0008) [2023-12-28 02:16:27,619][106226] Updated weights for policy 0, policy_version 976622 (0.0005) [2023-12-28 02:16:27,683][106226] Updated weights for policy 0, policy_version 976632 (0.0005) [2023-12-28 02:16:27,763][106225] Updated weights for policy 1, policy_version 978818 (0.0008) [2023-12-28 02:16:27,813][106225] Updated weights for policy 1, policy_version 978828 (0.0008) [2023-12-28 02:16:27,860][106225] Updated weights for policy 1, policy_version 978838 (0.0007) [2023-12-28 02:16:27,911][106225] Updated weights for policy 1, policy_version 978848 (0.0008) [2023-12-28 02:16:28,295][106226] Updated weights for policy 0, policy_version 976642 (0.0005) [2023-12-28 02:16:28,359][106226] Updated weights for policy 0, policy_version 976652 (0.0007) [2023-12-28 02:16:28,413][106226] Updated weights for policy 0, policy_version 976662 (0.0008) [2023-12-28 02:16:28,470][106226] Updated weights for policy 0, policy_version 976672 (0.0008) [2023-12-28 02:16:28,670][106225] Updated weights for policy 1, policy_version 978858 (0.0008) [2023-12-28 02:16:28,726][106225] Updated weights for policy 1, policy_version 978868 (0.0008) [2023-12-28 02:16:28,787][106225] Updated weights for policy 1, policy_version 978878 (0.0008) [2023-12-28 02:16:29,179][106226] Updated weights for policy 0, policy_version 976682 (0.0009) [2023-12-28 02:16:29,247][106226] Updated weights for policy 0, policy_version 976692 (0.0008) [2023-12-28 02:16:29,310][106226] Updated weights for policy 0, policy_version 976702 (0.0008) [2023-12-28 02:16:29,579][106225] Updated weights for policy 1, policy_version 978888 (0.0008) [2023-12-28 02:16:29,642][106225] Updated weights for policy 1, policy_version 978898 (0.0008) [2023-12-28 02:16:29,698][106225] Updated weights for policy 1, policy_version 978908 (0.0007) [2023-12-28 02:16:30,064][106226] Updated weights for policy 0, policy_version 976712 (0.0006) [2023-12-28 02:16:30,135][106226] Updated weights for policy 0, policy_version 976722 (0.0007) [2023-12-28 02:16:30,195][106226] Updated weights for policy 0, policy_version 976732 (0.0010) [2023-12-28 02:16:30,432][106225] Updated weights for policy 1, policy_version 978918 (0.0008) [2023-12-28 02:16:30,476][106225] Updated weights for policy 1, policy_version 978928 (0.0007) [2023-12-28 02:16:30,530][106225] Updated weights for policy 1, policy_version 978938 (0.0006) [2023-12-28 02:16:30,862][106226] Updated weights for policy 0, policy_version 976742 (0.0010) [2023-12-28 02:16:30,921][106226] Updated weights for policy 0, policy_version 976752 (0.0010) [2023-12-28 02:16:30,974][106226] Updated weights for policy 0, policy_version 976762 (0.0010) [2023-12-28 02:16:31,129][106225] Updated weights for policy 1, policy_version 978948 (0.0006) [2023-12-28 02:16:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 500760576. Throughput: 0: 9839.9, 1: 9683.7. Samples: 500751180. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:31,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-5.294')] [2023-12-28 02:16:31,196][106225] Updated weights for policy 1, policy_version 978958 (0.0007) [2023-12-28 02:16:31,256][106225] Updated weights for policy 1, policy_version 978968 (0.0008) [2023-12-28 02:16:31,745][106226] Updated weights for policy 0, policy_version 976772 (0.0010) [2023-12-28 02:16:31,802][106226] Updated weights for policy 0, policy_version 976782 (0.0011) [2023-12-28 02:16:31,852][106226] Updated weights for policy 0, policy_version 976792 (0.0011) [2023-12-28 02:16:31,978][106225] Updated weights for policy 1, policy_version 978978 (0.0008) [2023-12-28 02:16:32,035][106225] Updated weights for policy 1, policy_version 978988 (0.0008) [2023-12-28 02:16:32,088][106225] Updated weights for policy 1, policy_version 978998 (0.0007) [2023-12-28 02:16:32,153][106225] Updated weights for policy 1, policy_version 979008 (0.0007) [2023-12-28 02:16:32,543][106226] Updated weights for policy 0, policy_version 976802 (0.0011) [2023-12-28 02:16:32,603][106226] Updated weights for policy 0, policy_version 976812 (0.0011) [2023-12-28 02:16:32,658][106226] Updated weights for policy 0, policy_version 976822 (0.0010) [2023-12-28 02:16:32,719][106226] Updated weights for policy 0, policy_version 976832 (0.0010) [2023-12-28 02:16:32,846][106225] Updated weights for policy 1, policy_version 979018 (0.0007) [2023-12-28 02:16:32,900][106225] Updated weights for policy 1, policy_version 979028 (0.0006) [2023-12-28 02:16:32,957][106225] Updated weights for policy 1, policy_version 979038 (0.0007) [2023-12-28 02:16:33,442][106226] Updated weights for policy 0, policy_version 976842 (0.0011) [2023-12-28 02:16:33,508][106226] Updated weights for policy 0, policy_version 976852 (0.0011) [2023-12-28 02:16:33,571][106226] Updated weights for policy 0, policy_version 976862 (0.0010) [2023-12-28 02:16:33,605][106225] Updated weights for policy 1, policy_version 979048 (0.0007) [2023-12-28 02:16:33,672][106225] Updated weights for policy 1, policy_version 979058 (0.0007) [2023-12-28 02:16:33,725][106225] Updated weights for policy 1, policy_version 979068 (0.0008) [2023-12-28 02:16:34,255][106226] Updated weights for policy 0, policy_version 976872 (0.0010) [2023-12-28 02:16:34,311][106226] Updated weights for policy 0, policy_version 976882 (0.0008) [2023-12-28 02:16:34,372][106226] Updated weights for policy 0, policy_version 976892 (0.0008) [2023-12-28 02:16:34,409][106225] Updated weights for policy 1, policy_version 979078 (0.0009) [2023-12-28 02:16:34,468][106225] Updated weights for policy 1, policy_version 979088 (0.0010) [2023-12-28 02:16:34,533][106225] Updated weights for policy 1, policy_version 979098 (0.0010) [2023-12-28 02:16:35,061][106226] Updated weights for policy 0, policy_version 976902 (0.0010) [2023-12-28 02:16:35,110][106226] Updated weights for policy 0, policy_version 976912 (0.0010) [2023-12-28 02:16:35,167][106226] Updated weights for policy 0, policy_version 976922 (0.0008) [2023-12-28 02:16:35,270][106225] Updated weights for policy 1, policy_version 979108 (0.0009) [2023-12-28 02:16:35,339][106225] Updated weights for policy 1, policy_version 979118 (0.0009) [2023-12-28 02:16:35,396][106225] Updated weights for policy 1, policy_version 979128 (0.0009) [2023-12-28 02:16:35,837][106226] Updated weights for policy 0, policy_version 976932 (0.0008) [2023-12-28 02:16:35,904][106226] Updated weights for policy 0, policy_version 976942 (0.0006) [2023-12-28 02:16:35,969][106226] Updated weights for policy 0, policy_version 976952 (0.0005) [2023-12-28 02:16:36,164][106225] Updated weights for policy 1, policy_version 979138 (0.0007) [2023-12-28 02:16:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 500858880. Throughput: 0: 9839.5, 1: 9706.6. Samples: 500869924. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:36,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.078')] [2023-12-28 02:16:36,225][106225] Updated weights for policy 1, policy_version 979148 (0.0007) [2023-12-28 02:16:36,283][106225] Updated weights for policy 1, policy_version 979158 (0.0008) [2023-12-28 02:16:36,347][106225] Updated weights for policy 1, policy_version 979168 (0.0007) [2023-12-28 02:16:36,669][106226] Updated weights for policy 0, policy_version 976962 (0.0007) [2023-12-28 02:16:36,729][106226] Updated weights for policy 0, policy_version 976972 (0.0009) [2023-12-28 02:16:36,783][106226] Updated weights for policy 0, policy_version 976982 (0.0008) [2023-12-28 02:16:36,833][106226] Updated weights for policy 0, policy_version 976992 (0.0009) [2023-12-28 02:16:36,922][106225] Updated weights for policy 1, policy_version 979178 (0.0009) [2023-12-28 02:16:36,972][106225] Updated weights for policy 1, policy_version 979188 (0.0008) [2023-12-28 02:16:37,026][106225] Updated weights for policy 1, policy_version 979198 (0.0009) [2023-12-28 02:16:37,430][106226] Updated weights for policy 0, policy_version 977002 (0.0008) [2023-12-28 02:16:37,485][106226] Updated weights for policy 0, policy_version 977012 (0.0008) [2023-12-28 02:16:37,540][106226] Updated weights for policy 0, policy_version 977022 (0.0009) [2023-12-28 02:16:37,809][106225] Updated weights for policy 1, policy_version 979208 (0.0009) [2023-12-28 02:16:37,868][106225] Updated weights for policy 1, policy_version 979218 (0.0010) [2023-12-28 02:16:37,924][106225] Updated weights for policy 1, policy_version 979228 (0.0010) [2023-12-28 02:16:38,249][106226] Updated weights for policy 0, policy_version 977032 (0.0006) [2023-12-28 02:16:38,298][106226] Updated weights for policy 0, policy_version 977042 (0.0005) [2023-12-28 02:16:38,367][106226] Updated weights for policy 0, policy_version 977052 (0.0006) [2023-12-28 02:16:38,649][106225] Updated weights for policy 1, policy_version 979238 (0.0011) [2023-12-28 02:16:38,711][106225] Updated weights for policy 1, policy_version 979248 (0.0010) [2023-12-28 02:16:38,773][106225] Updated weights for policy 1, policy_version 979258 (0.0010) [2023-12-28 02:16:38,994][106226] Updated weights for policy 0, policy_version 977062 (0.0007) [2023-12-28 02:16:39,046][106226] Updated weights for policy 0, policy_version 977072 (0.0005) [2023-12-28 02:16:39,102][106226] Updated weights for policy 0, policy_version 977082 (0.0006) [2023-12-28 02:16:39,533][106225] Updated weights for policy 1, policy_version 979268 (0.0010) [2023-12-28 02:16:39,599][106225] Updated weights for policy 1, policy_version 979278 (0.0011) [2023-12-28 02:16:39,664][106225] Updated weights for policy 1, policy_version 979288 (0.0008) [2023-12-28 02:16:39,842][106226] Updated weights for policy 0, policy_version 977092 (0.0007) [2023-12-28 02:16:39,920][106226] Updated weights for policy 0, policy_version 977102 (0.0007) [2023-12-28 02:16:39,989][106226] Updated weights for policy 0, policy_version 977112 (0.0008) [2023-12-28 02:16:40,421][106225] Updated weights for policy 1, policy_version 979298 (0.0010) [2023-12-28 02:16:40,481][106225] Updated weights for policy 1, policy_version 979308 (0.0008) [2023-12-28 02:16:40,543][106225] Updated weights for policy 1, policy_version 979318 (0.0008) [2023-12-28 02:16:40,598][106225] Updated weights for policy 1, policy_version 979328 (0.0006) [2023-12-28 02:16:40,730][106226] Updated weights for policy 0, policy_version 977122 (0.0009) [2023-12-28 02:16:40,800][106226] Updated weights for policy 0, policy_version 977132 (0.0011) [2023-12-28 02:16:40,856][106226] Updated weights for policy 0, policy_version 977142 (0.0010) [2023-12-28 02:16:40,917][106226] Updated weights for policy 0, policy_version 977152 (0.0010) [2023-12-28 02:16:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 500957184. Throughput: 0: 9849.5, 1: 9704.1. Samples: 500930288. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:41,176][105115] Avg episode reward: [(0, '-4.729'), (1, '-4.922')] [2023-12-28 02:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000977152_250208256.pth... [2023-12-28 02:16:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000976000_249913344.pth [2023-12-28 02:16:41,235][106225] Updated weights for policy 1, policy_version 979338 (0.0009) [2023-12-28 02:16:41,300][106225] Updated weights for policy 1, policy_version 979348 (0.0008) [2023-12-28 02:16:41,364][106225] Updated weights for policy 1, policy_version 979358 (0.0009) [2023-12-28 02:16:41,384][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000979360_250757120.pth... [2023-12-28 02:16:41,389][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000978208_250462208.pth [2023-12-28 02:16:41,611][106226] Updated weights for policy 0, policy_version 977162 (0.0006) [2023-12-28 02:16:41,676][106226] Updated weights for policy 0, policy_version 977172 (0.0007) [2023-12-28 02:16:41,748][106226] Updated weights for policy 0, policy_version 977182 (0.0007) [2023-12-28 02:16:42,200][106225] Updated weights for policy 1, policy_version 979368 (0.0008) [2023-12-28 02:16:42,263][106225] Updated weights for policy 1, policy_version 979378 (0.0008) [2023-12-28 02:16:42,327][106225] Updated weights for policy 1, policy_version 979388 (0.0008) [2023-12-28 02:16:42,386][106226] Updated weights for policy 0, policy_version 977192 (0.0009) [2023-12-28 02:16:42,450][106226] Updated weights for policy 0, policy_version 977202 (0.0007) [2023-12-28 02:16:42,514][106226] Updated weights for policy 0, policy_version 977212 (0.0008) [2023-12-28 02:16:43,048][106225] Updated weights for policy 1, policy_version 979398 (0.0007) [2023-12-28 02:16:43,109][106225] Updated weights for policy 1, policy_version 979408 (0.0008) [2023-12-28 02:16:43,174][106225] Updated weights for policy 1, policy_version 979418 (0.0009) [2023-12-28 02:16:43,215][106226] Updated weights for policy 0, policy_version 977222 (0.0007) [2023-12-28 02:16:43,279][106226] Updated weights for policy 0, policy_version 977232 (0.0006) [2023-12-28 02:16:43,334][106226] Updated weights for policy 0, policy_version 977242 (0.0007) [2023-12-28 02:16:43,862][106225] Updated weights for policy 1, policy_version 979428 (0.0010) [2023-12-28 02:16:43,919][106225] Updated weights for policy 1, policy_version 979438 (0.0010) [2023-12-28 02:16:43,972][106225] Updated weights for policy 1, policy_version 979448 (0.0010) [2023-12-28 02:16:43,992][106226] Updated weights for policy 0, policy_version 977252 (0.0009) [2023-12-28 02:16:44,043][106226] Updated weights for policy 0, policy_version 977262 (0.0011) [2023-12-28 02:16:44,094][106226] Updated weights for policy 0, policy_version 977272 (0.0011) [2023-12-28 02:16:44,669][106225] Updated weights for policy 1, policy_version 979458 (0.0010) [2023-12-28 02:16:44,723][106225] Updated weights for policy 1, policy_version 979468 (0.0010) [2023-12-28 02:16:44,781][106225] Updated weights for policy 1, policy_version 979478 (0.0009) [2023-12-28 02:16:44,819][106226] Updated weights for policy 0, policy_version 977282 (0.0009) [2023-12-28 02:16:44,852][106225] Updated weights for policy 1, policy_version 979488 (0.0008) [2023-12-28 02:16:44,882][106226] Updated weights for policy 0, policy_version 977292 (0.0006) [2023-12-28 02:16:44,940][106226] Updated weights for policy 0, policy_version 977302 (0.0008) [2023-12-28 02:16:45,003][106226] Updated weights for policy 0, policy_version 977312 (0.0008) [2023-12-28 02:16:45,604][106225] Updated weights for policy 1, policy_version 979498 (0.0009) [2023-12-28 02:16:45,656][106225] Updated weights for policy 1, policy_version 979508 (0.0009) [2023-12-28 02:16:45,685][106226] Updated weights for policy 0, policy_version 977322 (0.0005) [2023-12-28 02:16:45,711][106225] Updated weights for policy 1, policy_version 979518 (0.0009) [2023-12-28 02:16:45,736][106226] Updated weights for policy 0, policy_version 977332 (0.0006) [2023-12-28 02:16:45,786][106226] Updated weights for policy 0, policy_version 977342 (0.0008) [2023-12-28 02:16:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.4, 300 sec: 19688.6). Total num frames: 501055488. Throughput: 0: 9842.6, 1: 9691.2. Samples: 501045760. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:46,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-5.085')] [2023-12-28 02:16:46,441][106225] Updated weights for policy 1, policy_version 979528 (0.0010) [2023-12-28 02:16:46,492][106225] Updated weights for policy 1, policy_version 979538 (0.0010) [2023-12-28 02:16:46,514][106226] Updated weights for policy 0, policy_version 977352 (0.0007) [2023-12-28 02:16:46,548][106225] Updated weights for policy 1, policy_version 979548 (0.0010) [2023-12-28 02:16:46,571][106226] Updated weights for policy 0, policy_version 977362 (0.0005) [2023-12-28 02:16:46,634][106226] Updated weights for policy 0, policy_version 977372 (0.0005) [2023-12-28 02:16:47,238][106225] Updated weights for policy 1, policy_version 979558 (0.0007) [2023-12-28 02:16:47,279][106226] Updated weights for policy 0, policy_version 977382 (0.0007) [2023-12-28 02:16:47,298][106225] Updated weights for policy 1, policy_version 979568 (0.0009) [2023-12-28 02:16:47,339][106226] Updated weights for policy 0, policy_version 977392 (0.0007) [2023-12-28 02:16:47,357][106225] Updated weights for policy 1, policy_version 979578 (0.0007) [2023-12-28 02:16:47,400][106226] Updated weights for policy 0, policy_version 977402 (0.0008) [2023-12-28 02:16:48,026][106225] Updated weights for policy 1, policy_version 979588 (0.0008) [2023-12-28 02:16:48,058][106226] Updated weights for policy 0, policy_version 977412 (0.0009) [2023-12-28 02:16:48,083][106225] Updated weights for policy 1, policy_version 979598 (0.0007) [2023-12-28 02:16:48,107][106226] Updated weights for policy 0, policy_version 977422 (0.0010) [2023-12-28 02:16:48,140][106225] Updated weights for policy 1, policy_version 979608 (0.0005) [2023-12-28 02:16:48,151][106226] Updated weights for policy 0, policy_version 977432 (0.0010) [2023-12-28 02:16:48,819][106225] Updated weights for policy 1, policy_version 979618 (0.0007) [2023-12-28 02:16:48,859][106226] Updated weights for policy 0, policy_version 977442 (0.0010) [2023-12-28 02:16:48,877][106225] Updated weights for policy 1, policy_version 979628 (0.0008) [2023-12-28 02:16:48,922][106226] Updated weights for policy 0, policy_version 977452 (0.0008) [2023-12-28 02:16:48,937][106225] Updated weights for policy 1, policy_version 979638 (0.0006) [2023-12-28 02:16:48,983][106226] Updated weights for policy 0, policy_version 977462 (0.0007) [2023-12-28 02:16:49,000][106225] Updated weights for policy 1, policy_version 979648 (0.0007) [2023-12-28 02:16:49,044][106226] Updated weights for policy 0, policy_version 977472 (0.0007) [2023-12-28 02:16:49,702][106225] Updated weights for policy 1, policy_version 979658 (0.0009) [2023-12-28 02:16:49,738][106226] Updated weights for policy 0, policy_version 977482 (0.0006) [2023-12-28 02:16:49,769][106225] Updated weights for policy 1, policy_version 979668 (0.0007) [2023-12-28 02:16:49,795][106226] Updated weights for policy 0, policy_version 977492 (0.0006) [2023-12-28 02:16:49,830][106225] Updated weights for policy 1, policy_version 979678 (0.0008) [2023-12-28 02:16:49,861][106226] Updated weights for policy 0, policy_version 977502 (0.0007) [2023-12-28 02:16:50,563][106226] Updated weights for policy 0, policy_version 977512 (0.0010) [2023-12-28 02:16:50,629][106226] Updated weights for policy 0, policy_version 977522 (0.0008) [2023-12-28 02:16:50,647][106225] Updated weights for policy 1, policy_version 979688 (0.0007) [2023-12-28 02:16:50,684][106226] Updated weights for policy 0, policy_version 977532 (0.0007) [2023-12-28 02:16:50,703][106225] Updated weights for policy 1, policy_version 979698 (0.0006) [2023-12-28 02:16:50,764][106225] Updated weights for policy 1, policy_version 979708 (0.0008) [2023-12-28 02:16:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 501153792. Throughput: 0: 9907.9, 1: 9677.5. Samples: 501163204. Policy #0 lag: (min: 16.0, avg: 38.8, max: 40.0) [2023-12-28 02:16:51,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-5.119')] [2023-12-28 02:16:51,434][106226] Updated weights for policy 0, policy_version 977542 (0.0008) [2023-12-28 02:16:51,471][106225] Updated weights for policy 1, policy_version 979718 (0.0010) [2023-12-28 02:16:51,489][106226] Updated weights for policy 0, policy_version 977552 (0.0008) [2023-12-28 02:16:51,526][106225] Updated weights for policy 1, policy_version 979728 (0.0010) [2023-12-28 02:16:51,548][106226] Updated weights for policy 0, policy_version 977562 (0.0008) [2023-12-28 02:16:51,584][106225] Updated weights for policy 1, policy_version 979738 (0.0011) [2023-12-28 02:16:52,296][106226] Updated weights for policy 0, policy_version 977572 (0.0008) [2023-12-28 02:16:52,364][106226] Updated weights for policy 0, policy_version 977582 (0.0007) [2023-12-28 02:16:52,366][106225] Updated weights for policy 1, policy_version 979748 (0.0008) [2023-12-28 02:16:52,418][106225] Updated weights for policy 1, policy_version 979758 (0.0007) [2023-12-28 02:16:52,420][106226] Updated weights for policy 0, policy_version 977592 (0.0006) [2023-12-28 02:16:52,478][106225] Updated weights for policy 1, policy_version 979768 (0.0008) [2023-12-28 02:16:53,112][106226] Updated weights for policy 0, policy_version 977602 (0.0006) [2023-12-28 02:16:53,158][106226] Updated weights for policy 0, policy_version 977612 (0.0010) [2023-12-28 02:16:53,182][106225] Updated weights for policy 1, policy_version 979778 (0.0006) [2023-12-28 02:16:53,211][106226] Updated weights for policy 0, policy_version 977622 (0.0011) [2023-12-28 02:16:53,240][106225] Updated weights for policy 1, policy_version 979788 (0.0005) [2023-12-28 02:16:53,269][106226] Updated weights for policy 0, policy_version 977632 (0.0011) [2023-12-28 02:16:53,298][106225] Updated weights for policy 1, policy_version 979798 (0.0007) [2023-12-28 02:16:53,345][106225] Updated weights for policy 1, policy_version 979808 (0.0008) [2023-12-28 02:16:53,991][106226] Updated weights for policy 0, policy_version 977642 (0.0011) [2023-12-28 02:16:54,056][106226] Updated weights for policy 0, policy_version 977652 (0.0010) [2023-12-28 02:16:54,078][106225] Updated weights for policy 1, policy_version 979818 (0.0010) [2023-12-28 02:16:54,116][106226] Updated weights for policy 0, policy_version 977662 (0.0011) [2023-12-28 02:16:54,125][106225] Updated weights for policy 1, policy_version 979828 (0.0010) [2023-12-28 02:16:54,178][106225] Updated weights for policy 1, policy_version 979838 (0.0010) [2023-12-28 02:16:54,805][106226] Updated weights for policy 0, policy_version 977672 (0.0010) [2023-12-28 02:16:54,813][106225] Updated weights for policy 1, policy_version 979848 (0.0006) [2023-12-28 02:16:54,862][106226] Updated weights for policy 0, policy_version 977682 (0.0010) [2023-12-28 02:16:54,870][106225] Updated weights for policy 1, policy_version 979858 (0.0005) [2023-12-28 02:16:54,922][106226] Updated weights for policy 0, policy_version 977692 (0.0010) [2023-12-28 02:16:54,930][106225] Updated weights for policy 1, policy_version 979868 (0.0005) [2023-12-28 02:16:55,551][106225] Updated weights for policy 1, policy_version 979878 (0.0006) [2023-12-28 02:16:55,602][106225] Updated weights for policy 1, policy_version 979888 (0.0008) [2023-12-28 02:16:55,625][106226] Updated weights for policy 0, policy_version 977702 (0.0011) [2023-12-28 02:16:55,648][106225] Updated weights for policy 1, policy_version 979898 (0.0010) [2023-12-28 02:16:55,679][106226] Updated weights for policy 0, policy_version 977712 (0.0010) [2023-12-28 02:16:55,736][106226] Updated weights for policy 0, policy_version 977722 (0.0010) [2023-12-28 02:16:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 501252096. Throughput: 0: 9913.5, 1: 9660.6. Samples: 501220800. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:16:56,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-5.315')] [2023-12-28 02:16:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000979904_250896384.pth... [2023-12-28 02:16:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000977728_250355712.pth... [2023-12-28 02:16:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000978784_250609664.pth [2023-12-28 02:16:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000976576_250060800.pth [2023-12-28 02:16:56,279][106225] Updated weights for policy 1, policy_version 979908 (0.0008) [2023-12-28 02:16:56,337][106225] Updated weights for policy 1, policy_version 979918 (0.0007) [2023-12-28 02:16:56,384][106226] Updated weights for policy 0, policy_version 977732 (0.0009) [2023-12-28 02:16:56,409][106225] Updated weights for policy 1, policy_version 979928 (0.0008) [2023-12-28 02:16:56,445][106226] Updated weights for policy 0, policy_version 977742 (0.0005) [2023-12-28 02:16:56,511][106226] Updated weights for policy 0, policy_version 977752 (0.0011) [2023-12-28 02:16:56,991][106225] Updated weights for policy 1, policy_version 979938 (0.0008) [2023-12-28 02:16:57,050][106225] Updated weights for policy 1, policy_version 979948 (0.0009) [2023-12-28 02:16:57,115][106225] Updated weights for policy 1, policy_version 979958 (0.0010) [2023-12-28 02:16:57,164][106226] Updated weights for policy 0, policy_version 977762 (0.0011) [2023-12-28 02:16:57,171][106225] Updated weights for policy 1, policy_version 979968 (0.0010) [2023-12-28 02:16:57,219][106226] Updated weights for policy 0, policy_version 977772 (0.0010) [2023-12-28 02:16:57,272][106226] Updated weights for policy 0, policy_version 977782 (0.0010) [2023-12-28 02:16:57,322][106226] Updated weights for policy 0, policy_version 977792 (0.0010) [2023-12-28 02:16:57,777][106225] Updated weights for policy 1, policy_version 979978 (0.0005) [2023-12-28 02:16:57,828][106225] Updated weights for policy 1, policy_version 979988 (0.0005) [2023-12-28 02:16:57,886][106225] Updated weights for policy 1, policy_version 979998 (0.0005) [2023-12-28 02:16:57,915][106226] Updated weights for policy 0, policy_version 977802 (0.0008) [2023-12-28 02:16:57,972][106226] Updated weights for policy 0, policy_version 977812 (0.0005) [2023-12-28 02:16:58,029][106226] Updated weights for policy 0, policy_version 977822 (0.0010) [2023-12-28 02:16:58,526][106225] Updated weights for policy 1, policy_version 980008 (0.0008) [2023-12-28 02:16:58,589][106225] Updated weights for policy 1, policy_version 980018 (0.0008) [2023-12-28 02:16:58,656][106225] Updated weights for policy 1, policy_version 980028 (0.0008) [2023-12-28 02:16:58,702][106226] Updated weights for policy 0, policy_version 977832 (0.0009) [2023-12-28 02:16:58,771][106226] Updated weights for policy 0, policy_version 977842 (0.0008) [2023-12-28 02:16:58,842][106226] Updated weights for policy 0, policy_version 977852 (0.0008) [2023-12-28 02:16:59,491][106225] Updated weights for policy 1, policy_version 980038 (0.0009) [2023-12-28 02:16:59,546][106225] Updated weights for policy 1, policy_version 980048 (0.0010) [2023-12-28 02:16:59,606][106225] Updated weights for policy 1, policy_version 980058 (0.0010) [2023-12-28 02:16:59,624][106226] Updated weights for policy 0, policy_version 977862 (0.0006) [2023-12-28 02:16:59,685][106226] Updated weights for policy 0, policy_version 977872 (0.0007) [2023-12-28 02:16:59,749][106226] Updated weights for policy 0, policy_version 977882 (0.0007) [2023-12-28 02:17:00,379][106225] Updated weights for policy 1, policy_version 980068 (0.0010) [2023-12-28 02:17:00,432][106225] Updated weights for policy 1, policy_version 980078 (0.0010) [2023-12-28 02:17:00,481][106225] Updated weights for policy 1, policy_version 980088 (0.0010) [2023-12-28 02:17:00,504][106226] Updated weights for policy 0, policy_version 977892 (0.0009) [2023-12-28 02:17:00,549][106226] Updated weights for policy 0, policy_version 977902 (0.0007) [2023-12-28 02:17:00,595][106226] Updated weights for policy 0, policy_version 977912 (0.0007) [2023-12-28 02:17:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 501350400. Throughput: 0: 9974.1, 1: 9745.9. Samples: 501343460. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:01,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.299')] [2023-12-28 02:17:01,212][106225] Updated weights for policy 1, policy_version 980098 (0.0009) [2023-12-28 02:17:01,272][106225] Updated weights for policy 1, policy_version 980108 (0.0008) [2023-12-28 02:17:01,337][106225] Updated weights for policy 1, policy_version 980118 (0.0010) [2023-12-28 02:17:01,363][106226] Updated weights for policy 0, policy_version 977923 (0.0008) [2023-12-28 02:17:01,403][106225] Updated weights for policy 1, policy_version 980128 (0.0008) [2023-12-28 02:17:01,427][106226] Updated weights for policy 0, policy_version 977933 (0.0008) [2023-12-28 02:17:01,486][106226] Updated weights for policy 0, policy_version 977943 (0.0009) [2023-12-28 02:17:02,036][106225] Updated weights for policy 1, policy_version 980138 (0.0005) [2023-12-28 02:17:02,084][106225] Updated weights for policy 1, policy_version 980148 (0.0008) [2023-12-28 02:17:02,142][106225] Updated weights for policy 1, policy_version 980158 (0.0008) [2023-12-28 02:17:02,311][106226] Updated weights for policy 0, policy_version 977953 (0.0009) [2023-12-28 02:17:02,378][106226] Updated weights for policy 0, policy_version 977963 (0.0008) [2023-12-28 02:17:02,444][106226] Updated weights for policy 0, policy_version 977973 (0.0009) [2023-12-28 02:17:02,503][106226] Updated weights for policy 0, policy_version 977983 (0.0008) [2023-12-28 02:17:02,832][106225] Updated weights for policy 1, policy_version 980168 (0.0007) [2023-12-28 02:17:02,885][106225] Updated weights for policy 1, policy_version 980178 (0.0008) [2023-12-28 02:17:02,944][106225] Updated weights for policy 1, policy_version 980188 (0.0007) [2023-12-28 02:17:03,242][106226] Updated weights for policy 0, policy_version 977993 (0.0010) [2023-12-28 02:17:03,301][106226] Updated weights for policy 0, policy_version 978003 (0.0010) [2023-12-28 02:17:03,362][106226] Updated weights for policy 0, policy_version 978013 (0.0010) [2023-12-28 02:17:03,680][106225] Updated weights for policy 1, policy_version 980198 (0.0009) [2023-12-28 02:17:03,739][106225] Updated weights for policy 1, policy_version 980208 (0.0010) [2023-12-28 02:17:03,795][106225] Updated weights for policy 1, policy_version 980218 (0.0010) [2023-12-28 02:17:04,052][106226] Updated weights for policy 0, policy_version 978023 (0.0010) [2023-12-28 02:17:04,102][106226] Updated weights for policy 0, policy_version 978033 (0.0010) [2023-12-28 02:17:04,157][106226] Updated weights for policy 0, policy_version 978043 (0.0011) [2023-12-28 02:17:04,455][106225] Updated weights for policy 1, policy_version 980228 (0.0010) [2023-12-28 02:17:04,511][106225] Updated weights for policy 1, policy_version 980238 (0.0010) [2023-12-28 02:17:04,574][106225] Updated weights for policy 1, policy_version 980248 (0.0010) [2023-12-28 02:17:04,890][106226] Updated weights for policy 0, policy_version 978053 (0.0010) [2023-12-28 02:17:04,940][106226] Updated weights for policy 0, policy_version 978063 (0.0009) [2023-12-28 02:17:04,997][106226] Updated weights for policy 0, policy_version 978073 (0.0009) [2023-12-28 02:17:05,298][106225] Updated weights for policy 1, policy_version 980258 (0.0010) [2023-12-28 02:17:05,347][106225] Updated weights for policy 1, policy_version 980268 (0.0010) [2023-12-28 02:17:05,399][106225] Updated weights for policy 1, policy_version 980278 (0.0010) [2023-12-28 02:17:05,453][106225] Updated weights for policy 1, policy_version 980288 (0.0010) [2023-12-28 02:17:05,716][106226] Updated weights for policy 0, policy_version 978083 (0.0010) [2023-12-28 02:17:05,780][106226] Updated weights for policy 0, policy_version 978093 (0.0009) [2023-12-28 02:17:05,844][106226] Updated weights for policy 0, policy_version 978103 (0.0010) [2023-12-28 02:17:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19716.4). Total num frames: 501448704. Throughput: 0: 9926.1, 1: 9790.9. Samples: 501459608. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:06,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.868')] [2023-12-28 02:17:06,207][106225] Updated weights for policy 1, policy_version 980298 (0.0007) [2023-12-28 02:17:06,271][106225] Updated weights for policy 1, policy_version 980308 (0.0008) [2023-12-28 02:17:06,333][106225] Updated weights for policy 1, policy_version 980318 (0.0007) [2023-12-28 02:17:06,539][106226] Updated weights for policy 0, policy_version 978113 (0.0006) [2023-12-28 02:17:06,590][106226] Updated weights for policy 0, policy_version 978123 (0.0011) [2023-12-28 02:17:06,645][106226] Updated weights for policy 0, policy_version 978133 (0.0011) [2023-12-28 02:17:06,710][106226] Updated weights for policy 0, policy_version 978143 (0.0011) [2023-12-28 02:17:07,073][106225] Updated weights for policy 1, policy_version 980328 (0.0008) [2023-12-28 02:17:07,132][106225] Updated weights for policy 1, policy_version 980338 (0.0007) [2023-12-28 02:17:07,183][106225] Updated weights for policy 1, policy_version 980348 (0.0008) [2023-12-28 02:17:07,454][106226] Updated weights for policy 0, policy_version 978153 (0.0011) [2023-12-28 02:17:07,510][106226] Updated weights for policy 0, policy_version 978163 (0.0011) [2023-12-28 02:17:07,576][106226] Updated weights for policy 0, policy_version 978173 (0.0009) [2023-12-28 02:17:07,901][106225] Updated weights for policy 1, policy_version 980358 (0.0006) [2023-12-28 02:17:07,954][106225] Updated weights for policy 1, policy_version 980368 (0.0005) [2023-12-28 02:17:08,007][106225] Updated weights for policy 1, policy_version 980378 (0.0010) [2023-12-28 02:17:08,230][106226] Updated weights for policy 0, policy_version 978183 (0.0009) [2023-12-28 02:17:08,287][106226] Updated weights for policy 0, policy_version 978193 (0.0011) [2023-12-28 02:17:08,358][106226] Updated weights for policy 0, policy_version 978203 (0.0011) [2023-12-28 02:17:08,727][106225] Updated weights for policy 1, policy_version 980388 (0.0010) [2023-12-28 02:17:08,789][106225] Updated weights for policy 1, policy_version 980398 (0.0010) [2023-12-28 02:17:08,847][106225] Updated weights for policy 1, policy_version 980408 (0.0010) [2023-12-28 02:17:09,043][106226] Updated weights for policy 0, policy_version 978213 (0.0010) [2023-12-28 02:17:09,107][106226] Updated weights for policy 0, policy_version 978223 (0.0005) [2023-12-28 02:17:09,166][106226] Updated weights for policy 0, policy_version 978233 (0.0005) [2023-12-28 02:17:09,623][106225] Updated weights for policy 1, policy_version 980418 (0.0009) [2023-12-28 02:17:09,677][106225] Updated weights for policy 1, policy_version 980428 (0.0008) [2023-12-28 02:17:09,737][106225] Updated weights for policy 1, policy_version 980438 (0.0008) [2023-12-28 02:17:09,793][106225] Updated weights for policy 1, policy_version 980448 (0.0008) [2023-12-28 02:17:09,835][106226] Updated weights for policy 0, policy_version 978243 (0.0007) [2023-12-28 02:17:09,895][106226] Updated weights for policy 0, policy_version 978253 (0.0009) [2023-12-28 02:17:09,963][106226] Updated weights for policy 0, policy_version 978263 (0.0010) [2023-12-28 02:17:10,573][106225] Updated weights for policy 1, policy_version 980458 (0.0010) [2023-12-28 02:17:10,624][106226] Updated weights for policy 0, policy_version 978273 (0.0006) [2023-12-28 02:17:10,635][106225] Updated weights for policy 1, policy_version 980468 (0.0008) [2023-12-28 02:17:10,701][106226] Updated weights for policy 0, policy_version 978283 (0.0007) [2023-12-28 02:17:10,705][106225] Updated weights for policy 1, policy_version 980478 (0.0008) [2023-12-28 02:17:10,773][106226] Updated weights for policy 0, policy_version 978293 (0.0007) [2023-12-28 02:17:10,847][106226] Updated weights for policy 0, policy_version 978303 (0.0008) [2023-12-28 02:17:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 501547008. Throughput: 0: 9942.4, 1: 9807.9. Samples: 501518304. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:11,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-4.886')] [2023-12-28 02:17:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000980480_251043840.pth... [2023-12-28 02:17:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000978304_250503168.pth... [2023-12-28 02:17:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000977152_250208256.pth [2023-12-28 02:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000979360_250757120.pth [2023-12-28 02:17:11,453][106225] Updated weights for policy 1, policy_version 980488 (0.0009) [2023-12-28 02:17:11,511][106225] Updated weights for policy 1, policy_version 980498 (0.0007) [2023-12-28 02:17:11,573][106225] Updated weights for policy 1, policy_version 980508 (0.0011) [2023-12-28 02:17:11,589][106226] Updated weights for policy 0, policy_version 978313 (0.0008) [2023-12-28 02:17:11,660][106226] Updated weights for policy 0, policy_version 978323 (0.0008) [2023-12-28 02:17:11,724][106226] Updated weights for policy 0, policy_version 978333 (0.0008) [2023-12-28 02:17:12,322][106225] Updated weights for policy 1, policy_version 980518 (0.0010) [2023-12-28 02:17:12,394][106225] Updated weights for policy 1, policy_version 980528 (0.0009) [2023-12-28 02:17:12,418][106226] Updated weights for policy 0, policy_version 978343 (0.0008) [2023-12-28 02:17:12,448][106225] Updated weights for policy 1, policy_version 980538 (0.0010) [2023-12-28 02:17:12,477][106226] Updated weights for policy 0, policy_version 978353 (0.0008) [2023-12-28 02:17:12,535][106226] Updated weights for policy 0, policy_version 978363 (0.0008) [2023-12-28 02:17:13,174][106225] Updated weights for policy 1, policy_version 980548 (0.0010) [2023-12-28 02:17:13,186][106226] Updated weights for policy 0, policy_version 978373 (0.0007) [2023-12-28 02:17:13,220][106225] Updated weights for policy 1, policy_version 980558 (0.0010) [2023-12-28 02:17:13,241][106226] Updated weights for policy 0, policy_version 978383 (0.0006) [2023-12-28 02:17:13,275][106225] Updated weights for policy 1, policy_version 980568 (0.0006) [2023-12-28 02:17:13,297][106226] Updated weights for policy 0, policy_version 978393 (0.0005) [2023-12-28 02:17:13,927][106225] Updated weights for policy 1, policy_version 980578 (0.0010) [2023-12-28 02:17:13,980][106225] Updated weights for policy 1, policy_version 980588 (0.0010) [2023-12-28 02:17:14,000][106226] Updated weights for policy 0, policy_version 978403 (0.0006) [2023-12-28 02:17:14,031][106225] Updated weights for policy 1, policy_version 980598 (0.0010) [2023-12-28 02:17:14,053][106226] Updated weights for policy 0, policy_version 978413 (0.0008) [2023-12-28 02:17:14,083][106225] Updated weights for policy 1, policy_version 980608 (0.0006) [2023-12-28 02:17:14,109][106226] Updated weights for policy 0, policy_version 978423 (0.0008) [2023-12-28 02:17:14,707][106225] Updated weights for policy 1, policy_version 980618 (0.0005) [2023-12-28 02:17:14,758][106225] Updated weights for policy 1, policy_version 980628 (0.0007) [2023-12-28 02:17:14,764][106226] Updated weights for policy 0, policy_version 978433 (0.0007) [2023-12-28 02:17:14,822][106225] Updated weights for policy 1, policy_version 980638 (0.0010) [2023-12-28 02:17:14,828][106226] Updated weights for policy 0, policy_version 978443 (0.0009) [2023-12-28 02:17:14,890][106226] Updated weights for policy 0, policy_version 978453 (0.0011) [2023-12-28 02:17:14,958][106226] Updated weights for policy 0, policy_version 978463 (0.0011) [2023-12-28 02:17:15,485][106225] Updated weights for policy 1, policy_version 980648 (0.0007) [2023-12-28 02:17:15,545][106225] Updated weights for policy 1, policy_version 980658 (0.0008) [2023-12-28 02:17:15,607][106225] Updated weights for policy 1, policy_version 980668 (0.0008) [2023-12-28 02:17:15,678][106226] Updated weights for policy 0, policy_version 978473 (0.0011) [2023-12-28 02:17:15,728][106226] Updated weights for policy 0, policy_version 978483 (0.0010) [2023-12-28 02:17:15,775][106226] Updated weights for policy 0, policy_version 978493 (0.0010) [2023-12-28 02:17:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 501645312. Throughput: 0: 9850.6, 1: 9795.1. Samples: 501635236. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:16,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.114')] [2023-12-28 02:17:16,306][106225] Updated weights for policy 1, policy_version 980678 (0.0007) [2023-12-28 02:17:16,353][106225] Updated weights for policy 1, policy_version 980688 (0.0007) [2023-12-28 02:17:16,407][106225] Updated weights for policy 1, policy_version 980698 (0.0007) [2023-12-28 02:17:16,516][106226] Updated weights for policy 0, policy_version 978503 (0.0010) [2023-12-28 02:17:16,568][106226] Updated weights for policy 0, policy_version 978513 (0.0010) [2023-12-28 02:17:16,622][106226] Updated weights for policy 0, policy_version 978523 (0.0010) [2023-12-28 02:17:17,136][106225] Updated weights for policy 1, policy_version 980708 (0.0010) [2023-12-28 02:17:17,192][106225] Updated weights for policy 1, policy_version 980718 (0.0005) [2023-12-28 02:17:17,246][106225] Updated weights for policy 1, policy_version 980728 (0.0006) [2023-12-28 02:17:17,291][106226] Updated weights for policy 0, policy_version 978533 (0.0010) [2023-12-28 02:17:17,350][106226] Updated weights for policy 0, policy_version 978543 (0.0010) [2023-12-28 02:17:17,410][106226] Updated weights for policy 0, policy_version 978553 (0.0010) [2023-12-28 02:17:17,799][106225] Updated weights for policy 1, policy_version 980738 (0.0007) [2023-12-28 02:17:17,854][106225] Updated weights for policy 1, policy_version 980748 (0.0010) [2023-12-28 02:17:17,909][106225] Updated weights for policy 1, policy_version 980758 (0.0010) [2023-12-28 02:17:17,961][106225] Updated weights for policy 1, policy_version 980768 (0.0010) [2023-12-28 02:17:18,053][106226] Updated weights for policy 0, policy_version 978563 (0.0010) [2023-12-28 02:17:18,110][106226] Updated weights for policy 0, policy_version 978573 (0.0011) [2023-12-28 02:17:18,165][106226] Updated weights for policy 0, policy_version 978583 (0.0011) [2023-12-28 02:17:18,736][106225] Updated weights for policy 1, policy_version 980778 (0.0009) [2023-12-28 02:17:18,805][106225] Updated weights for policy 1, policy_version 980788 (0.0007) [2023-12-28 02:17:18,865][106225] Updated weights for policy 1, policy_version 980798 (0.0010) [2023-12-28 02:17:18,889][106226] Updated weights for policy 0, policy_version 978593 (0.0010) [2023-12-28 02:17:18,956][106226] Updated weights for policy 0, policy_version 978603 (0.0011) [2023-12-28 02:17:19,018][106226] Updated weights for policy 0, policy_version 978613 (0.0010) [2023-12-28 02:17:19,073][106226] Updated weights for policy 0, policy_version 978623 (0.0010) [2023-12-28 02:17:19,525][106225] Updated weights for policy 1, policy_version 980808 (0.0010) [2023-12-28 02:17:19,579][106225] Updated weights for policy 1, policy_version 980818 (0.0010) [2023-12-28 02:17:19,635][106225] Updated weights for policy 1, policy_version 980828 (0.0007) [2023-12-28 02:17:19,784][106226] Updated weights for policy 0, policy_version 978633 (0.0009) [2023-12-28 02:17:19,851][106226] Updated weights for policy 0, policy_version 978643 (0.0009) [2023-12-28 02:17:19,917][106226] Updated weights for policy 0, policy_version 978653 (0.0008) [2023-12-28 02:17:20,406][106225] Updated weights for policy 1, policy_version 980838 (0.0009) [2023-12-28 02:17:20,455][106225] Updated weights for policy 1, policy_version 980848 (0.0009) [2023-12-28 02:17:20,513][106225] Updated weights for policy 1, policy_version 980858 (0.0007) [2023-12-28 02:17:20,670][106226] Updated weights for policy 0, policy_version 978663 (0.0008) [2023-12-28 02:17:20,741][106226] Updated weights for policy 0, policy_version 978673 (0.0008) [2023-12-28 02:17:20,811][106226] Updated weights for policy 0, policy_version 978683 (0.0008) [2023-12-28 02:17:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 501743616. Throughput: 0: 9840.7, 1: 9803.7. Samples: 501753924. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:21,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.035')] [2023-12-28 02:17:21,330][106225] Updated weights for policy 1, policy_version 980868 (0.0008) [2023-12-28 02:17:21,401][106225] Updated weights for policy 1, policy_version 980878 (0.0008) [2023-12-28 02:17:21,460][106225] Updated weights for policy 1, policy_version 980888 (0.0008) [2023-12-28 02:17:21,504][106226] Updated weights for policy 0, policy_version 978693 (0.0007) [2023-12-28 02:17:21,572][106226] Updated weights for policy 0, policy_version 978703 (0.0007) [2023-12-28 02:17:21,640][106226] Updated weights for policy 0, policy_version 978713 (0.0008) [2023-12-28 02:17:22,210][106225] Updated weights for policy 1, policy_version 980898 (0.0008) [2023-12-28 02:17:22,274][106225] Updated weights for policy 1, policy_version 980908 (0.0008) [2023-12-28 02:17:22,337][106225] Updated weights for policy 1, policy_version 980918 (0.0009) [2023-12-28 02:17:22,401][106226] Updated weights for policy 0, policy_version 978723 (0.0007) [2023-12-28 02:17:22,406][106225] Updated weights for policy 1, policy_version 980928 (0.0008) [2023-12-28 02:17:22,467][106226] Updated weights for policy 0, policy_version 978733 (0.0008) [2023-12-28 02:17:22,530][106226] Updated weights for policy 0, policy_version 978743 (0.0008) [2023-12-28 02:17:23,167][106226] Updated weights for policy 0, policy_version 978753 (0.0008) [2023-12-28 02:17:23,187][106225] Updated weights for policy 1, policy_version 980938 (0.0009) [2023-12-28 02:17:23,223][106226] Updated weights for policy 0, policy_version 978763 (0.0005) [2023-12-28 02:17:23,244][106225] Updated weights for policy 1, policy_version 980948 (0.0008) [2023-12-28 02:17:23,269][106226] Updated weights for policy 0, policy_version 978773 (0.0005) [2023-12-28 02:17:23,303][106225] Updated weights for policy 1, policy_version 980958 (0.0008) [2023-12-28 02:17:23,318][106226] Updated weights for policy 0, policy_version 978783 (0.0005) [2023-12-28 02:17:23,887][106225] Updated weights for policy 1, policy_version 980968 (0.0005) [2023-12-28 02:17:23,944][106225] Updated weights for policy 1, policy_version 980978 (0.0005) [2023-12-28 02:17:24,010][106225] Updated weights for policy 1, policy_version 980988 (0.0005) [2023-12-28 02:17:24,052][106226] Updated weights for policy 0, policy_version 978793 (0.0010) [2023-12-28 02:17:24,098][106226] Updated weights for policy 0, policy_version 978803 (0.0010) [2023-12-28 02:17:24,151][106226] Updated weights for policy 0, policy_version 978813 (0.0010) [2023-12-28 02:17:24,624][106225] Updated weights for policy 1, policy_version 980998 (0.0008) [2023-12-28 02:17:24,683][106225] Updated weights for policy 1, policy_version 981008 (0.0010) [2023-12-28 02:17:24,740][106225] Updated weights for policy 1, policy_version 981018 (0.0010) [2023-12-28 02:17:24,883][106226] Updated weights for policy 0, policy_version 978823 (0.0010) [2023-12-28 02:17:24,949][106226] Updated weights for policy 0, policy_version 978833 (0.0010) [2023-12-28 02:17:25,005][106226] Updated weights for policy 0, policy_version 978843 (0.0010) [2023-12-28 02:17:25,291][106225] Updated weights for policy 1, policy_version 981028 (0.0008) [2023-12-28 02:17:25,339][106225] Updated weights for policy 1, policy_version 981038 (0.0009) [2023-12-28 02:17:25,389][106225] Updated weights for policy 1, policy_version 981048 (0.0010) [2023-12-28 02:17:25,614][106226] Updated weights for policy 0, policy_version 978853 (0.0008) [2023-12-28 02:17:25,667][106226] Updated weights for policy 0, policy_version 978863 (0.0005) [2023-12-28 02:17:25,724][106226] Updated weights for policy 0, policy_version 978873 (0.0005) [2023-12-28 02:17:26,104][106225] Updated weights for policy 1, policy_version 981058 (0.0010) [2023-12-28 02:17:26,171][106225] Updated weights for policy 1, policy_version 981068 (0.0010) [2023-12-28 02:17:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.2, 300 sec: 19716.3). Total num frames: 501841920. Throughput: 0: 9803.1, 1: 9767.6. Samples: 501810972. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:26,176][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.973')] [2023-12-28 02:17:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000978880_250650624.pth... [2023-12-28 02:17:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000977728_250355712.pth [2023-12-28 02:17:26,231][106225] Updated weights for policy 1, policy_version 981078 (0.0010) [2023-12-28 02:17:26,268][106226] Updated weights for policy 0, policy_version 978883 (0.0005) [2023-12-28 02:17:26,285][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000981088_251199488.pth... [2023-12-28 02:17:26,287][106225] Updated weights for policy 1, policy_version 981088 (0.0010) [2023-12-28 02:17:26,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000979904_250896384.pth [2023-12-28 02:17:26,321][106226] Updated weights for policy 0, policy_version 978893 (0.0008) [2023-12-28 02:17:26,380][106226] Updated weights for policy 0, policy_version 978903 (0.0006) [2023-12-28 02:17:26,977][106225] Updated weights for policy 1, policy_version 981098 (0.0006) [2023-12-28 02:17:26,992][106226] Updated weights for policy 0, policy_version 978913 (0.0006) [2023-12-28 02:17:27,026][106225] Updated weights for policy 1, policy_version 981108 (0.0005) [2023-12-28 02:17:27,053][106226] Updated weights for policy 0, policy_version 978923 (0.0010) [2023-12-28 02:17:27,076][106225] Updated weights for policy 1, policy_version 981118 (0.0005) [2023-12-28 02:17:27,109][106226] Updated weights for policy 0, policy_version 978933 (0.0010) [2023-12-28 02:17:27,164][106226] Updated weights for policy 0, policy_version 978943 (0.0010) [2023-12-28 02:17:27,669][106225] Updated weights for policy 1, policy_version 981128 (0.0009) [2023-12-28 02:17:27,731][106225] Updated weights for policy 1, policy_version 981138 (0.0007) [2023-12-28 02:17:27,795][106225] Updated weights for policy 1, policy_version 981148 (0.0008) [2023-12-28 02:17:27,887][106226] Updated weights for policy 0, policy_version 978953 (0.0007) [2023-12-28 02:17:27,940][106226] Updated weights for policy 0, policy_version 978963 (0.0009) [2023-12-28 02:17:28,002][106226] Updated weights for policy 0, policy_version 978973 (0.0009) [2023-12-28 02:17:28,350][106225] Updated weights for policy 1, policy_version 981158 (0.0008) [2023-12-28 02:17:28,414][106225] Updated weights for policy 1, policy_version 981168 (0.0005) [2023-12-28 02:17:28,474][106225] Updated weights for policy 1, policy_version 981178 (0.0008) [2023-12-28 02:17:28,756][106226] Updated weights for policy 0, policy_version 978983 (0.0007) [2023-12-28 02:17:28,813][106226] Updated weights for policy 0, policy_version 978993 (0.0007) [2023-12-28 02:17:28,862][106226] Updated weights for policy 0, policy_version 979003 (0.0010) [2023-12-28 02:17:29,117][106225] Updated weights for policy 1, policy_version 981188 (0.0008) [2023-12-28 02:17:29,178][106225] Updated weights for policy 1, policy_version 981198 (0.0008) [2023-12-28 02:17:29,243][106225] Updated weights for policy 1, policy_version 981208 (0.0008) [2023-12-28 02:17:29,559][106226] Updated weights for policy 0, policy_version 979013 (0.0011) [2023-12-28 02:17:29,621][106226] Updated weights for policy 0, policy_version 979023 (0.0011) [2023-12-28 02:17:29,667][106226] Updated weights for policy 0, policy_version 979033 (0.0009) [2023-12-28 02:17:29,943][106225] Updated weights for policy 1, policy_version 981218 (0.0010) [2023-12-28 02:17:30,002][106225] Updated weights for policy 1, policy_version 981228 (0.0007) [2023-12-28 02:17:30,050][106225] Updated weights for policy 1, policy_version 981238 (0.0007) [2023-12-28 02:17:30,112][106225] Updated weights for policy 1, policy_version 981248 (0.0005) [2023-12-28 02:17:30,418][106226] Updated weights for policy 0, policy_version 979043 (0.0008) [2023-12-28 02:17:30,470][106226] Updated weights for policy 0, policy_version 979053 (0.0007) [2023-12-28 02:17:30,527][106226] Updated weights for policy 0, policy_version 979063 (0.0007) [2023-12-28 02:17:30,759][106225] Updated weights for policy 1, policy_version 981258 (0.0010) [2023-12-28 02:17:30,804][106225] Updated weights for policy 1, policy_version 981268 (0.0010) [2023-12-28 02:17:30,854][106225] Updated weights for policy 1, policy_version 981278 (0.0010) [2023-12-28 02:17:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 501948416. Throughput: 0: 9873.4, 1: 9949.9. Samples: 501937808. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:31,175][105115] Avg episode reward: [(0, '-5.058'), (1, '-5.212')] [2023-12-28 02:17:31,245][106226] Updated weights for policy 0, policy_version 979073 (0.0008) [2023-12-28 02:17:31,308][106226] Updated weights for policy 0, policy_version 979083 (0.0009) [2023-12-28 02:17:31,383][106226] Updated weights for policy 0, policy_version 979093 (0.0009) [2023-12-28 02:17:31,453][106226] Updated weights for policy 0, policy_version 979103 (0.0007) [2023-12-28 02:17:31,618][106225] Updated weights for policy 1, policy_version 981288 (0.0009) [2023-12-28 02:17:31,685][106225] Updated weights for policy 1, policy_version 981298 (0.0008) [2023-12-28 02:17:31,757][106225] Updated weights for policy 1, policy_version 981308 (0.0008) [2023-12-28 02:17:32,125][106226] Updated weights for policy 0, policy_version 979113 (0.0005) [2023-12-28 02:17:32,179][106226] Updated weights for policy 0, policy_version 979123 (0.0005) [2023-12-28 02:17:32,240][106226] Updated weights for policy 0, policy_version 979133 (0.0007) [2023-12-28 02:17:32,431][106225] Updated weights for policy 1, policy_version 981318 (0.0007) [2023-12-28 02:17:32,499][106225] Updated weights for policy 1, policy_version 981328 (0.0006) [2023-12-28 02:17:32,560][106225] Updated weights for policy 1, policy_version 981338 (0.0008) [2023-12-28 02:17:32,926][106226] Updated weights for policy 0, policy_version 979143 (0.0006) [2023-12-28 02:17:32,987][106226] Updated weights for policy 0, policy_version 979153 (0.0005) [2023-12-28 02:17:33,045][106226] Updated weights for policy 0, policy_version 979163 (0.0005) [2023-12-28 02:17:33,248][106225] Updated weights for policy 1, policy_version 981348 (0.0007) [2023-12-28 02:17:33,303][106225] Updated weights for policy 1, policy_version 981358 (0.0008) [2023-12-28 02:17:33,359][106225] Updated weights for policy 1, policy_version 981368 (0.0008) [2023-12-28 02:17:33,624][106226] Updated weights for policy 0, policy_version 979173 (0.0007) [2023-12-28 02:17:33,678][106226] Updated weights for policy 0, policy_version 979183 (0.0008) [2023-12-28 02:17:33,727][106226] Updated weights for policy 0, policy_version 979193 (0.0008) [2023-12-28 02:17:34,115][106225] Updated weights for policy 1, policy_version 981378 (0.0008) [2023-12-28 02:17:34,176][106225] Updated weights for policy 1, policy_version 981388 (0.0008) [2023-12-28 02:17:34,242][106225] Updated weights for policy 1, policy_version 981398 (0.0008) [2023-12-28 02:17:34,302][106225] Updated weights for policy 1, policy_version 981408 (0.0008) [2023-12-28 02:17:34,439][106226] Updated weights for policy 0, policy_version 979203 (0.0009) [2023-12-28 02:17:34,507][106226] Updated weights for policy 0, policy_version 979213 (0.0010) [2023-12-28 02:17:34,565][106226] Updated weights for policy 0, policy_version 979223 (0.0009) [2023-12-28 02:17:34,930][106225] Updated weights for policy 1, policy_version 981418 (0.0009) [2023-12-28 02:17:34,999][106225] Updated weights for policy 1, policy_version 981428 (0.0008) [2023-12-28 02:17:35,059][106225] Updated weights for policy 1, policy_version 981438 (0.0007) [2023-12-28 02:17:35,199][106226] Updated weights for policy 0, policy_version 979233 (0.0008) [2023-12-28 02:17:35,255][106226] Updated weights for policy 0, policy_version 979243 (0.0010) [2023-12-28 02:17:35,310][106226] Updated weights for policy 0, policy_version 979253 (0.0008) [2023-12-28 02:17:35,375][106226] Updated weights for policy 0, policy_version 979263 (0.0005) [2023-12-28 02:17:35,692][106225] Updated weights for policy 1, policy_version 981448 (0.0008) [2023-12-28 02:17:35,740][106225] Updated weights for policy 1, policy_version 981458 (0.0008) [2023-12-28 02:17:35,788][106225] Updated weights for policy 1, policy_version 981468 (0.0008) [2023-12-28 02:17:36,039][106226] Updated weights for policy 0, policy_version 979273 (0.0008) [2023-12-28 02:17:36,109][106226] Updated weights for policy 0, policy_version 979283 (0.0007) [2023-12-28 02:17:36,175][106226] Updated weights for policy 0, policy_version 979293 (0.0007) [2023-12-28 02:17:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 502046720. Throughput: 0: 9921.7, 1: 9994.6. Samples: 502059444. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:36,175][105115] Avg episode reward: [(0, '-4.975'), (1, '-5.113')] [2023-12-28 02:17:36,654][106225] Updated weights for policy 1, policy_version 981478 (0.0008) [2023-12-28 02:17:36,723][106225] Updated weights for policy 1, policy_version 981488 (0.0009) [2023-12-28 02:17:36,727][106226] Updated weights for policy 0, policy_version 979303 (0.0006) [2023-12-28 02:17:36,783][106225] Updated weights for policy 1, policy_version 981498 (0.0009) [2023-12-28 02:17:36,788][106226] Updated weights for policy 0, policy_version 979313 (0.0006) [2023-12-28 02:17:36,859][106226] Updated weights for policy 0, policy_version 979323 (0.0006) [2023-12-28 02:17:37,492][106226] Updated weights for policy 0, policy_version 979333 (0.0008) [2023-12-28 02:17:37,550][106225] Updated weights for policy 1, policy_version 981508 (0.0009) [2023-12-28 02:17:37,555][106226] Updated weights for policy 0, policy_version 979343 (0.0008) [2023-12-28 02:17:37,612][106225] Updated weights for policy 1, policy_version 981518 (0.0006) [2023-12-28 02:17:37,614][106226] Updated weights for policy 0, policy_version 979353 (0.0010) [2023-12-28 02:17:37,669][106225] Updated weights for policy 1, policy_version 981528 (0.0008) [2023-12-28 02:17:38,277][106226] Updated weights for policy 0, policy_version 979363 (0.0010) [2023-12-28 02:17:38,362][106226] Updated weights for policy 0, policy_version 979373 (0.0008) [2023-12-28 02:17:38,411][106225] Updated weights for policy 1, policy_version 981538 (0.0008) [2023-12-28 02:17:38,431][106226] Updated weights for policy 0, policy_version 979383 (0.0008) [2023-12-28 02:17:38,476][106225] Updated weights for policy 1, policy_version 981548 (0.0008) [2023-12-28 02:17:38,541][106225] Updated weights for policy 1, policy_version 981558 (0.0006) [2023-12-28 02:17:38,606][106225] Updated weights for policy 1, policy_version 981568 (0.0006) [2023-12-28 02:17:39,098][106226] Updated weights for policy 0, policy_version 979393 (0.0009) [2023-12-28 02:17:39,160][106226] Updated weights for policy 0, policy_version 979403 (0.0011) [2023-12-28 02:17:39,183][106225] Updated weights for policy 1, policy_version 981578 (0.0006) [2023-12-28 02:17:39,244][106226] Updated weights for policy 0, policy_version 979413 (0.0011) [2023-12-28 02:17:39,274][106225] Updated weights for policy 1, policy_version 981588 (0.0007) [2023-12-28 02:17:39,307][106226] Updated weights for policy 0, policy_version 979423 (0.0009) [2023-12-28 02:17:39,339][106225] Updated weights for policy 1, policy_version 981598 (0.0008) [2023-12-28 02:17:40,021][106226] Updated weights for policy 0, policy_version 979433 (0.0008) [2023-12-28 02:17:40,051][106225] Updated weights for policy 1, policy_version 981608 (0.0006) [2023-12-28 02:17:40,087][106226] Updated weights for policy 0, policy_version 979443 (0.0008) [2023-12-28 02:17:40,102][106225] Updated weights for policy 1, policy_version 981618 (0.0008) [2023-12-28 02:17:40,140][106226] Updated weights for policy 0, policy_version 979453 (0.0007) [2023-12-28 02:17:40,159][106225] Updated weights for policy 1, policy_version 981628 (0.0007) [2023-12-28 02:17:40,804][106226] Updated weights for policy 0, policy_version 979463 (0.0006) [2023-12-28 02:17:40,863][106226] Updated weights for policy 0, policy_version 979473 (0.0009) [2023-12-28 02:17:40,884][106225] Updated weights for policy 1, policy_version 981638 (0.0010) [2023-12-28 02:17:40,919][106226] Updated weights for policy 0, policy_version 979483 (0.0009) [2023-12-28 02:17:40,941][106225] Updated weights for policy 1, policy_version 981648 (0.0010) [2023-12-28 02:17:41,002][106225] Updated weights for policy 1, policy_version 981658 (0.0010) [2023-12-28 02:17:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 502153216. Throughput: 0: 9975.5, 1: 9979.1. Samples: 502118756. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:41,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-5.250')] [2023-12-28 02:17:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000981664_251346944.pth... [2023-12-28 02:17:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000979488_250806272.pth... [2023-12-28 02:17:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000978304_250503168.pth [2023-12-28 02:17:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000980480_251043840.pth [2023-12-28 02:17:41,659][106226] Updated weights for policy 0, policy_version 979493 (0.0009) [2023-12-28 02:17:41,735][106226] Updated weights for policy 0, policy_version 979503 (0.0011) [2023-12-28 02:17:41,749][106225] Updated weights for policy 1, policy_version 981668 (0.0010) [2023-12-28 02:17:41,806][106226] Updated weights for policy 0, policy_version 979513 (0.0009) [2023-12-28 02:17:41,811][106225] Updated weights for policy 1, policy_version 981678 (0.0007) [2023-12-28 02:17:41,876][106225] Updated weights for policy 1, policy_version 981688 (0.0007) [2023-12-28 02:17:42,572][106226] Updated weights for policy 0, policy_version 979523 (0.0011) [2023-12-28 02:17:42,631][106225] Updated weights for policy 1, policy_version 981698 (0.0007) [2023-12-28 02:17:42,639][106226] Updated weights for policy 0, policy_version 979533 (0.0010) [2023-12-28 02:17:42,695][106225] Updated weights for policy 1, policy_version 981708 (0.0008) [2023-12-28 02:17:42,707][106226] Updated weights for policy 0, policy_version 979543 (0.0010) [2023-12-28 02:17:42,756][106225] Updated weights for policy 1, policy_version 981718 (0.0008) [2023-12-28 02:17:42,809][106225] Updated weights for policy 1, policy_version 981728 (0.0008) [2023-12-28 02:17:43,361][106226] Updated weights for policy 0, policy_version 979553 (0.0006) [2023-12-28 02:17:43,415][106225] Updated weights for policy 1, policy_version 981738 (0.0007) [2023-12-28 02:17:43,421][106226] Updated weights for policy 0, policy_version 979563 (0.0009) [2023-12-28 02:17:43,470][106225] Updated weights for policy 1, policy_version 981748 (0.0006) [2023-12-28 02:17:43,486][106226] Updated weights for policy 0, policy_version 979573 (0.0010) [2023-12-28 02:17:43,519][106225] Updated weights for policy 1, policy_version 981758 (0.0008) [2023-12-28 02:17:43,547][106226] Updated weights for policy 0, policy_version 979583 (0.0011) [2023-12-28 02:17:44,217][106225] Updated weights for policy 1, policy_version 981768 (0.0009) [2023-12-28 02:17:44,248][106226] Updated weights for policy 0, policy_version 979593 (0.0010) [2023-12-28 02:17:44,274][106225] Updated weights for policy 1, policy_version 981778 (0.0010) [2023-12-28 02:17:44,308][106226] Updated weights for policy 0, policy_version 979603 (0.0010) [2023-12-28 02:17:44,331][106225] Updated weights for policy 1, policy_version 981788 (0.0010) [2023-12-28 02:17:44,367][106226] Updated weights for policy 0, policy_version 979613 (0.0010) [2023-12-28 02:17:45,001][106226] Updated weights for policy 0, policy_version 979623 (0.0009) [2023-12-28 02:17:45,027][106225] Updated weights for policy 1, policy_version 981798 (0.0008) [2023-12-28 02:17:45,061][106226] Updated weights for policy 0, policy_version 979633 (0.0010) [2023-12-28 02:17:45,082][106225] Updated weights for policy 1, policy_version 981808 (0.0006) [2023-12-28 02:17:45,125][106226] Updated weights for policy 0, policy_version 979643 (0.0011) [2023-12-28 02:17:45,146][106225] Updated weights for policy 1, policy_version 981818 (0.0006) [2023-12-28 02:17:45,849][106226] Updated weights for policy 0, policy_version 979653 (0.0011) [2023-12-28 02:17:45,871][106225] Updated weights for policy 1, policy_version 981828 (0.0006) [2023-12-28 02:17:45,903][106226] Updated weights for policy 0, policy_version 979663 (0.0010) [2023-12-28 02:17:45,928][106225] Updated weights for policy 1, policy_version 981838 (0.0007) [2023-12-28 02:17:45,953][106226] Updated weights for policy 0, policy_version 979673 (0.0011) [2023-12-28 02:17:45,990][106225] Updated weights for policy 1, policy_version 981848 (0.0005) [2023-12-28 02:17:46,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 502251520. Throughput: 0: 9949.0, 1: 9908.5. Samples: 502237044. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:46,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.209')] [2023-12-28 02:17:46,677][106226] Updated weights for policy 0, policy_version 979683 (0.0010) [2023-12-28 02:17:46,728][106225] Updated weights for policy 1, policy_version 981858 (0.0009) [2023-12-28 02:17:46,733][106226] Updated weights for policy 0, policy_version 979693 (0.0010) [2023-12-28 02:17:46,778][106225] Updated weights for policy 1, policy_version 981868 (0.0008) [2023-12-28 02:17:46,786][106226] Updated weights for policy 0, policy_version 979703 (0.0011) [2023-12-28 02:17:46,826][106225] Updated weights for policy 1, policy_version 981878 (0.0009) [2023-12-28 02:17:46,877][106225] Updated weights for policy 1, policy_version 981888 (0.0010) [2023-12-28 02:17:47,387][106226] Updated weights for policy 0, policy_version 979713 (0.0010) [2023-12-28 02:17:47,439][106226] Updated weights for policy 0, policy_version 979723 (0.0006) [2023-12-28 02:17:47,488][106226] Updated weights for policy 0, policy_version 979733 (0.0010) [2023-12-28 02:17:47,539][106226] Updated weights for policy 0, policy_version 979743 (0.0010) [2023-12-28 02:17:47,573][106225] Updated weights for policy 1, policy_version 981898 (0.0005) [2023-12-28 02:17:47,633][106225] Updated weights for policy 1, policy_version 981908 (0.0006) [2023-12-28 02:17:47,683][106225] Updated weights for policy 1, policy_version 981918 (0.0010) [2023-12-28 02:17:48,254][106226] Updated weights for policy 0, policy_version 979753 (0.0011) [2023-12-28 02:17:48,315][106226] Updated weights for policy 0, policy_version 979763 (0.0011) [2023-12-28 02:17:48,370][106225] Updated weights for policy 1, policy_version 981928 (0.0007) [2023-12-28 02:17:48,378][106226] Updated weights for policy 0, policy_version 979773 (0.0008) [2023-12-28 02:17:48,431][106225] Updated weights for policy 1, policy_version 981938 (0.0008) [2023-12-28 02:17:48,492][106225] Updated weights for policy 1, policy_version 981948 (0.0008) [2023-12-28 02:17:49,140][106226] Updated weights for policy 0, policy_version 979783 (0.0009) [2023-12-28 02:17:49,196][106226] Updated weights for policy 0, policy_version 979793 (0.0009) [2023-12-28 02:17:49,231][106225] Updated weights for policy 1, policy_version 981958 (0.0008) [2023-12-28 02:17:49,266][106226] Updated weights for policy 0, policy_version 979803 (0.0008) [2023-12-28 02:17:49,289][106225] Updated weights for policy 1, policy_version 981968 (0.0006) [2023-12-28 02:17:49,344][106225] Updated weights for policy 1, policy_version 981978 (0.0009) [2023-12-28 02:17:50,050][106226] Updated weights for policy 0, policy_version 979813 (0.0010) [2023-12-28 02:17:50,109][106226] Updated weights for policy 0, policy_version 979823 (0.0011) [2023-12-28 02:17:50,125][106225] Updated weights for policy 1, policy_version 981988 (0.0008) [2023-12-28 02:17:50,170][106226] Updated weights for policy 0, policy_version 979833 (0.0008) [2023-12-28 02:17:50,186][106225] Updated weights for policy 1, policy_version 981998 (0.0009) [2023-12-28 02:17:50,249][106225] Updated weights for policy 1, policy_version 982008 (0.0007) [2023-12-28 02:17:50,787][106226] Updated weights for policy 0, policy_version 979843 (0.0008) [2023-12-28 02:17:50,847][106226] Updated weights for policy 0, policy_version 979853 (0.0008) [2023-12-28 02:17:50,906][106226] Updated weights for policy 0, policy_version 979863 (0.0009) [2023-12-28 02:17:51,055][106225] Updated weights for policy 1, policy_version 982018 (0.0007) [2023-12-28 02:17:51,122][106225] Updated weights for policy 1, policy_version 982028 (0.0009) [2023-12-28 02:17:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 502341632. Throughput: 0: 10001.5, 1: 9872.6. Samples: 502353940. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:51,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-5.178')] [2023-12-28 02:17:51,182][106225] Updated weights for policy 1, policy_version 982038 (0.0008) [2023-12-28 02:17:51,231][106225] Updated weights for policy 1, policy_version 982048 (0.0009) [2023-12-28 02:17:51,625][106226] Updated weights for policy 0, policy_version 979873 (0.0006) [2023-12-28 02:17:51,681][106226] Updated weights for policy 0, policy_version 979883 (0.0008) [2023-12-28 02:17:51,759][106226] Updated weights for policy 0, policy_version 979893 (0.0008) [2023-12-28 02:17:51,814][106226] Updated weights for policy 0, policy_version 979903 (0.0008) [2023-12-28 02:17:52,038][106225] Updated weights for policy 1, policy_version 982058 (0.0008) [2023-12-28 02:17:52,099][106225] Updated weights for policy 1, policy_version 982068 (0.0007) [2023-12-28 02:17:52,166][106225] Updated weights for policy 1, policy_version 982078 (0.0008) [2023-12-28 02:17:52,587][106226] Updated weights for policy 0, policy_version 979913 (0.0009) [2023-12-28 02:17:52,653][106226] Updated weights for policy 0, policy_version 979923 (0.0010) [2023-12-28 02:17:52,711][106226] Updated weights for policy 0, policy_version 979933 (0.0009) [2023-12-28 02:17:52,841][106225] Updated weights for policy 1, policy_version 982088 (0.0007) [2023-12-28 02:17:52,902][106225] Updated weights for policy 1, policy_version 982098 (0.0008) [2023-12-28 02:17:52,967][106225] Updated weights for policy 1, policy_version 982108 (0.0006) [2023-12-28 02:17:53,497][106226] Updated weights for policy 0, policy_version 979943 (0.0009) [2023-12-28 02:17:53,551][106226] Updated weights for policy 0, policy_version 979953 (0.0009) [2023-12-28 02:17:53,571][106225] Updated weights for policy 1, policy_version 982118 (0.0006) [2023-12-28 02:17:53,598][106226] Updated weights for policy 0, policy_version 979963 (0.0009) [2023-12-28 02:17:53,631][106225] Updated weights for policy 1, policy_version 982128 (0.0005) [2023-12-28 02:17:53,689][106225] Updated weights for policy 1, policy_version 982138 (0.0005) [2023-12-28 02:17:54,208][106225] Updated weights for policy 1, policy_version 982148 (0.0007) [2023-12-28 02:17:54,263][106225] Updated weights for policy 1, policy_version 982158 (0.0008) [2023-12-28 02:17:54,321][106225] Updated weights for policy 1, policy_version 982168 (0.0006) [2023-12-28 02:17:54,404][106226] Updated weights for policy 0, policy_version 979973 (0.0008) [2023-12-28 02:17:54,453][106226] Updated weights for policy 0, policy_version 979983 (0.0008) [2023-12-28 02:17:54,506][106226] Updated weights for policy 0, policy_version 979993 (0.0009) [2023-12-28 02:17:54,960][106225] Updated weights for policy 1, policy_version 982178 (0.0006) [2023-12-28 02:17:55,024][106225] Updated weights for policy 1, policy_version 982188 (0.0009) [2023-12-28 02:17:55,088][106225] Updated weights for policy 1, policy_version 982198 (0.0005) [2023-12-28 02:17:55,151][106226] Updated weights for policy 0, policy_version 980003 (0.0008) [2023-12-28 02:17:55,155][106225] Updated weights for policy 1, policy_version 982208 (0.0007) [2023-12-28 02:17:55,216][106226] Updated weights for policy 0, policy_version 980013 (0.0009) [2023-12-28 02:17:55,271][106226] Updated weights for policy 0, policy_version 980023 (0.0008) [2023-12-28 02:17:55,708][106225] Updated weights for policy 1, policy_version 982218 (0.0005) [2023-12-28 02:17:55,754][106225] Updated weights for policy 1, policy_version 982228 (0.0005) [2023-12-28 02:17:55,810][106225] Updated weights for policy 1, policy_version 982238 (0.0005) [2023-12-28 02:17:56,108][106226] Updated weights for policy 0, policy_version 980033 (0.0009) [2023-12-28 02:17:56,162][106226] Updated weights for policy 0, policy_version 980043 (0.0009) [2023-12-28 02:17:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 502439936. Throughput: 0: 9936.6, 1: 9893.9. Samples: 502410676. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:17:56,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-5.271')] [2023-12-28 02:17:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000982240_251494400.pth... [2023-12-28 02:17:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000981088_251199488.pth [2023-12-28 02:17:56,218][106226] Updated weights for policy 0, policy_version 980053 (0.0009) [2023-12-28 02:17:56,270][106226] Updated weights for policy 0, policy_version 980063 (0.0008) [2023-12-28 02:17:56,272][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000980064_250953728.pth... [2023-12-28 02:17:56,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000978880_250650624.pth [2023-12-28 02:17:56,340][106225] Updated weights for policy 1, policy_version 982248 (0.0009) [2023-12-28 02:17:56,401][106225] Updated weights for policy 1, policy_version 982258 (0.0010) [2023-12-28 02:17:56,461][106225] Updated weights for policy 1, policy_version 982268 (0.0010) [2023-12-28 02:17:57,030][106226] Updated weights for policy 0, policy_version 980073 (0.0007) [2023-12-28 02:17:57,084][106226] Updated weights for policy 0, policy_version 980083 (0.0007) [2023-12-28 02:17:57,121][106225] Updated weights for policy 1, policy_version 982278 (0.0010) [2023-12-28 02:17:57,131][106226] Updated weights for policy 0, policy_version 980093 (0.0006) [2023-12-28 02:17:57,177][106225] Updated weights for policy 1, policy_version 982288 (0.0010) [2023-12-28 02:17:57,226][106225] Updated weights for policy 1, policy_version 982298 (0.0010) [2023-12-28 02:17:57,900][106226] Updated weights for policy 0, policy_version 980103 (0.0008) [2023-12-28 02:17:57,912][106225] Updated weights for policy 1, policy_version 982308 (0.0010) [2023-12-28 02:17:57,956][106226] Updated weights for policy 0, policy_version 980113 (0.0006) [2023-12-28 02:17:57,972][106225] Updated weights for policy 1, policy_version 982318 (0.0010) [2023-12-28 02:17:58,015][106226] Updated weights for policy 0, policy_version 980123 (0.0007) [2023-12-28 02:17:58,031][106225] Updated weights for policy 1, policy_version 982328 (0.0010) [2023-12-28 02:17:58,840][106226] Updated weights for policy 0, policy_version 980133 (0.0007) [2023-12-28 02:17:58,875][106225] Updated weights for policy 1, policy_version 982338 (0.0010) [2023-12-28 02:17:58,907][106226] Updated weights for policy 0, policy_version 980143 (0.0009) [2023-12-28 02:17:58,941][106225] Updated weights for policy 1, policy_version 982348 (0.0009) [2023-12-28 02:17:58,974][106226] Updated weights for policy 0, policy_version 980153 (0.0010) [2023-12-28 02:17:58,987][106225] Updated weights for policy 1, policy_version 982358 (0.0009) [2023-12-28 02:17:59,042][106225] Updated weights for policy 1, policy_version 982368 (0.0008) [2023-12-28 02:17:59,722][106226] Updated weights for policy 0, policy_version 980163 (0.0008) [2023-12-28 02:17:59,779][106226] Updated weights for policy 0, policy_version 980173 (0.0010) [2023-12-28 02:17:59,808][106225] Updated weights for policy 1, policy_version 982378 (0.0006) [2023-12-28 02:17:59,838][106226] Updated weights for policy 0, policy_version 980183 (0.0010) [2023-12-28 02:17:59,873][106225] Updated weights for policy 1, policy_version 982388 (0.0007) [2023-12-28 02:17:59,936][106225] Updated weights for policy 1, policy_version 982398 (0.0008) [2023-12-28 02:18:00,571][106226] Updated weights for policy 0, policy_version 980193 (0.0008) [2023-12-28 02:18:00,634][106226] Updated weights for policy 0, policy_version 980203 (0.0008) [2023-12-28 02:18:00,674][106225] Updated weights for policy 1, policy_version 982408 (0.0008) [2023-12-28 02:18:00,692][106226] Updated weights for policy 0, policy_version 980213 (0.0006) [2023-12-28 02:18:00,733][106225] Updated weights for policy 1, policy_version 982418 (0.0009) [2023-12-28 02:18:00,743][106226] Updated weights for policy 0, policy_version 980223 (0.0005) [2023-12-28 02:18:00,788][106225] Updated weights for policy 1, policy_version 982428 (0.0008) [2023-12-28 02:18:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 502538240. Throughput: 0: 9846.8, 1: 10016.1. Samples: 502529068. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:01,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-5.223')] [2023-12-28 02:18:01,333][106226] Updated weights for policy 0, policy_version 980233 (0.0009) [2023-12-28 02:18:01,406][106226] Updated weights for policy 0, policy_version 980243 (0.0008) [2023-12-28 02:18:01,469][106226] Updated weights for policy 0, policy_version 980253 (0.0007) [2023-12-28 02:18:01,592][106225] Updated weights for policy 1, policy_version 982438 (0.0008) [2023-12-28 02:18:01,654][106225] Updated weights for policy 1, policy_version 982448 (0.0006) [2023-12-28 02:18:01,718][106225] Updated weights for policy 1, policy_version 982458 (0.0010) [2023-12-28 02:18:02,188][106226] Updated weights for policy 0, policy_version 980263 (0.0008) [2023-12-28 02:18:02,248][106226] Updated weights for policy 0, policy_version 980273 (0.0007) [2023-12-28 02:18:02,313][106226] Updated weights for policy 0, policy_version 980283 (0.0008) [2023-12-28 02:18:02,433][106225] Updated weights for policy 1, policy_version 982468 (0.0008) [2023-12-28 02:18:02,485][106225] Updated weights for policy 1, policy_version 982478 (0.0007) [2023-12-28 02:18:02,534][106225] Updated weights for policy 1, policy_version 982488 (0.0007) [2023-12-28 02:18:03,049][106226] Updated weights for policy 0, policy_version 980293 (0.0008) [2023-12-28 02:18:03,117][106226] Updated weights for policy 0, policy_version 980303 (0.0005) [2023-12-28 02:18:03,181][106226] Updated weights for policy 0, policy_version 980313 (0.0005) [2023-12-28 02:18:03,186][106225] Updated weights for policy 1, policy_version 982498 (0.0006) [2023-12-28 02:18:03,242][106225] Updated weights for policy 1, policy_version 982508 (0.0008) [2023-12-28 02:18:03,296][106225] Updated weights for policy 1, policy_version 982518 (0.0005) [2023-12-28 02:18:03,354][106225] Updated weights for policy 1, policy_version 982528 (0.0005) [2023-12-28 02:18:03,732][106226] Updated weights for policy 0, policy_version 980323 (0.0005) [2023-12-28 02:18:03,787][106226] Updated weights for policy 0, policy_version 980333 (0.0006) [2023-12-28 02:18:03,845][106226] Updated weights for policy 0, policy_version 980343 (0.0007) [2023-12-28 02:18:04,024][106225] Updated weights for policy 1, policy_version 982538 (0.0010) [2023-12-28 02:18:04,087][106225] Updated weights for policy 1, policy_version 982548 (0.0010) [2023-12-28 02:18:04,149][106225] Updated weights for policy 1, policy_version 982558 (0.0010) [2023-12-28 02:18:04,578][106226] Updated weights for policy 0, policy_version 980353 (0.0008) [2023-12-28 02:18:04,631][106226] Updated weights for policy 0, policy_version 980363 (0.0007) [2023-12-28 02:18:04,684][106226] Updated weights for policy 0, policy_version 980373 (0.0007) [2023-12-28 02:18:04,740][106226] Updated weights for policy 0, policy_version 980383 (0.0007) [2023-12-28 02:18:04,890][106225] Updated weights for policy 1, policy_version 982568 (0.0008) [2023-12-28 02:18:04,937][106225] Updated weights for policy 1, policy_version 982578 (0.0008) [2023-12-28 02:18:04,994][106225] Updated weights for policy 1, policy_version 982588 (0.0008) [2023-12-28 02:18:05,465][106226] Updated weights for policy 0, policy_version 980393 (0.0010) [2023-12-28 02:18:05,523][106226] Updated weights for policy 0, policy_version 980403 (0.0009) [2023-12-28 02:18:05,579][106226] Updated weights for policy 0, policy_version 980413 (0.0009) [2023-12-28 02:18:05,714][106225] Updated weights for policy 1, policy_version 982598 (0.0006) [2023-12-28 02:18:05,773][106225] Updated weights for policy 1, policy_version 982608 (0.0006) [2023-12-28 02:18:05,828][106225] Updated weights for policy 1, policy_version 982618 (0.0008) [2023-12-28 02:18:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 502636544. Throughput: 0: 9875.2, 1: 9978.0. Samples: 502647320. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:06,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-5.049')] [2023-12-28 02:18:06,321][106226] Updated weights for policy 0, policy_version 980423 (0.0007) [2023-12-28 02:18:06,387][106226] Updated weights for policy 0, policy_version 980433 (0.0006) [2023-12-28 02:18:06,459][106226] Updated weights for policy 0, policy_version 980443 (0.0006) [2023-12-28 02:18:06,481][106225] Updated weights for policy 1, policy_version 982628 (0.0006) [2023-12-28 02:18:06,554][106225] Updated weights for policy 1, policy_version 982638 (0.0006) [2023-12-28 02:18:06,626][106225] Updated weights for policy 1, policy_version 982648 (0.0009) [2023-12-28 02:18:07,024][106226] Updated weights for policy 0, policy_version 980453 (0.0007) [2023-12-28 02:18:07,071][106226] Updated weights for policy 0, policy_version 980463 (0.0005) [2023-12-28 02:18:07,118][106226] Updated weights for policy 0, policy_version 980473 (0.0005) [2023-12-28 02:18:07,270][106225] Updated weights for policy 1, policy_version 982658 (0.0006) [2023-12-28 02:18:07,326][106225] Updated weights for policy 1, policy_version 982668 (0.0008) [2023-12-28 02:18:07,384][106225] Updated weights for policy 1, policy_version 982678 (0.0008) [2023-12-28 02:18:07,433][106225] Updated weights for policy 1, policy_version 982688 (0.0007) [2023-12-28 02:18:07,766][106226] Updated weights for policy 0, policy_version 980483 (0.0007) [2023-12-28 02:18:07,830][106226] Updated weights for policy 0, policy_version 980493 (0.0009) [2023-12-28 02:18:07,891][106226] Updated weights for policy 0, policy_version 980503 (0.0009) [2023-12-28 02:18:08,172][106225] Updated weights for policy 1, policy_version 982698 (0.0008) [2023-12-28 02:18:08,233][106225] Updated weights for policy 1, policy_version 982708 (0.0009) [2023-12-28 02:18:08,286][106225] Updated weights for policy 1, policy_version 982718 (0.0009) [2023-12-28 02:18:08,644][106226] Updated weights for policy 0, policy_version 980513 (0.0008) [2023-12-28 02:18:08,698][106226] Updated weights for policy 0, policy_version 980523 (0.0009) [2023-12-28 02:18:08,755][106226] Updated weights for policy 0, policy_version 980533 (0.0008) [2023-12-28 02:18:08,813][106226] Updated weights for policy 0, policy_version 980543 (0.0008) [2023-12-28 02:18:09,039][106225] Updated weights for policy 1, policy_version 982728 (0.0008) [2023-12-28 02:18:09,088][106225] Updated weights for policy 1, policy_version 982738 (0.0010) [2023-12-28 02:18:09,138][106225] Updated weights for policy 1, policy_version 982748 (0.0010) [2023-12-28 02:18:09,564][106226] Updated weights for policy 0, policy_version 980553 (0.0007) [2023-12-28 02:18:09,629][106226] Updated weights for policy 0, policy_version 980563 (0.0008) [2023-12-28 02:18:09,697][106226] Updated weights for policy 0, policy_version 980573 (0.0009) [2023-12-28 02:18:09,954][106225] Updated weights for policy 1, policy_version 982758 (0.0008) [2023-12-28 02:18:10,015][106225] Updated weights for policy 1, policy_version 982768 (0.0010) [2023-12-28 02:18:10,077][106225] Updated weights for policy 1, policy_version 982778 (0.0010) [2023-12-28 02:18:10,472][106226] Updated weights for policy 0, policy_version 980583 (0.0007) [2023-12-28 02:18:10,520][106226] Updated weights for policy 0, policy_version 980593 (0.0008) [2023-12-28 02:18:10,569][106226] Updated weights for policy 0, policy_version 980603 (0.0008) [2023-12-28 02:18:10,786][106225] Updated weights for policy 1, policy_version 982788 (0.0011) [2023-12-28 02:18:10,833][106225] Updated weights for policy 1, policy_version 982798 (0.0010) [2023-12-28 02:18:10,886][106225] Updated weights for policy 1, policy_version 982808 (0.0010) [2023-12-28 02:18:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 502734848. Throughput: 0: 9907.7, 1: 10010.8. Samples: 502707300. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:11,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.425')] [2023-12-28 02:18:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000982816_251641856.pth... [2023-12-28 02:18:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000980608_251092992.pth... [2023-12-28 02:18:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000979488_250806272.pth [2023-12-28 02:18:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000981664_251346944.pth [2023-12-28 02:18:11,317][106226] Updated weights for policy 0, policy_version 980613 (0.0008) [2023-12-28 02:18:11,384][106226] Updated weights for policy 0, policy_version 980623 (0.0008) [2023-12-28 02:18:11,456][106226] Updated weights for policy 0, policy_version 980633 (0.0007) [2023-12-28 02:18:11,633][106225] Updated weights for policy 1, policy_version 982818 (0.0010) [2023-12-28 02:18:11,704][106225] Updated weights for policy 1, policy_version 982828 (0.0008) [2023-12-28 02:18:11,778][106225] Updated weights for policy 1, policy_version 982838 (0.0008) [2023-12-28 02:18:11,845][106225] Updated weights for policy 1, policy_version 982848 (0.0008) [2023-12-28 02:18:12,159][106226] Updated weights for policy 0, policy_version 980643 (0.0007) [2023-12-28 02:18:12,215][106226] Updated weights for policy 0, policy_version 980653 (0.0010) [2023-12-28 02:18:12,280][106226] Updated weights for policy 0, policy_version 980663 (0.0009) [2023-12-28 02:18:12,552][106225] Updated weights for policy 1, policy_version 982858 (0.0008) [2023-12-28 02:18:12,614][106225] Updated weights for policy 1, policy_version 982868 (0.0010) [2023-12-28 02:18:12,671][106225] Updated weights for policy 1, policy_version 982878 (0.0008) [2023-12-28 02:18:12,929][106226] Updated weights for policy 0, policy_version 980673 (0.0008) [2023-12-28 02:18:12,994][106226] Updated weights for policy 0, policy_version 980683 (0.0006) [2023-12-28 02:18:13,063][106226] Updated weights for policy 0, policy_version 980693 (0.0007) [2023-12-28 02:18:13,128][106226] Updated weights for policy 0, policy_version 980703 (0.0008) [2023-12-28 02:18:13,411][106225] Updated weights for policy 1, policy_version 982888 (0.0008) [2023-12-28 02:18:13,459][106225] Updated weights for policy 1, policy_version 982898 (0.0008) [2023-12-28 02:18:13,512][106225] Updated weights for policy 1, policy_version 982908 (0.0009) [2023-12-28 02:18:13,814][106226] Updated weights for policy 0, policy_version 980713 (0.0008) [2023-12-28 02:18:13,864][106226] Updated weights for policy 0, policy_version 980723 (0.0008) [2023-12-28 02:18:13,922][106226] Updated weights for policy 0, policy_version 980733 (0.0009) [2023-12-28 02:18:14,106][106225] Updated weights for policy 1, policy_version 982918 (0.0007) [2023-12-28 02:18:14,159][106225] Updated weights for policy 1, policy_version 982928 (0.0007) [2023-12-28 02:18:14,223][106225] Updated weights for policy 1, policy_version 982938 (0.0009) [2023-12-28 02:18:14,699][106226] Updated weights for policy 0, policy_version 980743 (0.0010) [2023-12-28 02:18:14,756][106226] Updated weights for policy 0, policy_version 980753 (0.0008) [2023-12-28 02:18:14,825][106226] Updated weights for policy 0, policy_version 980763 (0.0009) [2023-12-28 02:18:14,960][106225] Updated weights for policy 1, policy_version 982948 (0.0009) [2023-12-28 02:18:15,024][106225] Updated weights for policy 1, policy_version 982958 (0.0008) [2023-12-28 02:18:15,084][106225] Updated weights for policy 1, policy_version 982968 (0.0008) [2023-12-28 02:18:15,603][106226] Updated weights for policy 0, policy_version 980773 (0.0009) [2023-12-28 02:18:15,652][106226] Updated weights for policy 0, policy_version 980783 (0.0009) [2023-12-28 02:18:15,709][106226] Updated weights for policy 0, policy_version 980793 (0.0008) [2023-12-28 02:18:15,723][106225] Updated weights for policy 1, policy_version 982978 (0.0008) [2023-12-28 02:18:15,781][106225] Updated weights for policy 1, policy_version 982988 (0.0007) [2023-12-28 02:18:15,843][106225] Updated weights for policy 1, policy_version 982998 (0.0009) [2023-12-28 02:18:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 502833152. Throughput: 0: 9813.3, 1: 9844.8. Samples: 502822424. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:16,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-5.062')] [2023-12-28 02:18:16,381][106226] Updated weights for policy 0, policy_version 980803 (0.0008) [2023-12-28 02:18:16,427][106226] Updated weights for policy 0, policy_version 980813 (0.0005) [2023-12-28 02:18:16,487][106226] Updated weights for policy 0, policy_version 980823 (0.0006) [2023-12-28 02:18:16,603][106225] Updated weights for policy 1, policy_version 983009 (0.0009) [2023-12-28 02:18:16,664][106225] Updated weights for policy 1, policy_version 983019 (0.0009) [2023-12-28 02:18:16,718][106225] Updated weights for policy 1, policy_version 983029 (0.0008) [2023-12-28 02:18:16,776][106225] Updated weights for policy 1, policy_version 983039 (0.0009) [2023-12-28 02:18:17,030][106226] Updated weights for policy 0, policy_version 980833 (0.0006) [2023-12-28 02:18:17,094][106226] Updated weights for policy 0, policy_version 980843 (0.0005) [2023-12-28 02:18:17,157][106226] Updated weights for policy 0, policy_version 980853 (0.0010) [2023-12-28 02:18:17,218][106226] Updated weights for policy 0, policy_version 980863 (0.0010) [2023-12-28 02:18:17,526][106225] Updated weights for policy 1, policy_version 983049 (0.0007) [2023-12-28 02:18:17,579][106225] Updated weights for policy 1, policy_version 983059 (0.0009) [2023-12-28 02:18:17,632][106225] Updated weights for policy 1, policy_version 983069 (0.0009) [2023-12-28 02:18:17,834][106226] Updated weights for policy 0, policy_version 980873 (0.0006) [2023-12-28 02:18:17,887][106226] Updated weights for policy 0, policy_version 980883 (0.0005) [2023-12-28 02:18:17,948][106226] Updated weights for policy 0, policy_version 980893 (0.0008) [2023-12-28 02:18:18,448][106225] Updated weights for policy 1, policy_version 983079 (0.0006) [2023-12-28 02:18:18,499][106225] Updated weights for policy 1, policy_version 983089 (0.0007) [2023-12-28 02:18:18,565][106225] Updated weights for policy 1, policy_version 983099 (0.0008) [2023-12-28 02:18:18,574][106226] Updated weights for policy 0, policy_version 980903 (0.0008) [2023-12-28 02:18:18,640][106226] Updated weights for policy 0, policy_version 980913 (0.0007) [2023-12-28 02:18:18,700][106226] Updated weights for policy 0, policy_version 980923 (0.0008) [2023-12-28 02:18:19,226][106225] Updated weights for policy 1, policy_version 983109 (0.0007) [2023-12-28 02:18:19,287][106225] Updated weights for policy 1, policy_version 983119 (0.0008) [2023-12-28 02:18:19,353][106225] Updated weights for policy 1, policy_version 983129 (0.0008) [2023-12-28 02:18:19,480][106226] Updated weights for policy 0, policy_version 980933 (0.0008) [2023-12-28 02:18:19,551][106226] Updated weights for policy 0, policy_version 980943 (0.0008) [2023-12-28 02:18:19,607][106226] Updated weights for policy 0, policy_version 980953 (0.0007) [2023-12-28 02:18:20,088][106225] Updated weights for policy 1, policy_version 983139 (0.0008) [2023-12-28 02:18:20,139][106225] Updated weights for policy 1, policy_version 983149 (0.0007) [2023-12-28 02:18:20,194][106225] Updated weights for policy 1, policy_version 983159 (0.0009) [2023-12-28 02:18:20,360][106226] Updated weights for policy 0, policy_version 980963 (0.0006) [2023-12-28 02:18:20,419][106226] Updated weights for policy 0, policy_version 980973 (0.0011) [2023-12-28 02:18:20,477][106226] Updated weights for policy 0, policy_version 980983 (0.0010) [2023-12-28 02:18:20,821][106225] Updated weights for policy 1, policy_version 983169 (0.0007) [2023-12-28 02:18:20,883][106225] Updated weights for policy 1, policy_version 983179 (0.0010) [2023-12-28 02:18:20,944][106225] Updated weights for policy 1, policy_version 983189 (0.0011) [2023-12-28 02:18:20,996][106225] Updated weights for policy 1, policy_version 983199 (0.0010) [2023-12-28 02:18:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 502931456. Throughput: 0: 9765.6, 1: 9806.0. Samples: 502940164. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:21,175][105115] Avg episode reward: [(0, '-4.873'), (1, '-5.307')] [2023-12-28 02:18:21,304][106226] Updated weights for policy 0, policy_version 980993 (0.0008) [2023-12-28 02:18:21,376][106226] Updated weights for policy 0, policy_version 981003 (0.0007) [2023-12-28 02:18:21,446][106226] Updated weights for policy 0, policy_version 981013 (0.0010) [2023-12-28 02:18:21,513][106226] Updated weights for policy 0, policy_version 981023 (0.0008) [2023-12-28 02:18:21,790][106225] Updated weights for policy 1, policy_version 983209 (0.0009) [2023-12-28 02:18:21,854][106225] Updated weights for policy 1, policy_version 983219 (0.0008) [2023-12-28 02:18:21,914][106225] Updated weights for policy 1, policy_version 983229 (0.0008) [2023-12-28 02:18:22,211][106226] Updated weights for policy 0, policy_version 981033 (0.0009) [2023-12-28 02:18:22,279][106226] Updated weights for policy 0, policy_version 981043 (0.0009) [2023-12-28 02:18:22,342][106226] Updated weights for policy 0, policy_version 981053 (0.0009) [2023-12-28 02:18:22,698][106225] Updated weights for policy 1, policy_version 983239 (0.0009) [2023-12-28 02:18:22,756][106225] Updated weights for policy 1, policy_version 983249 (0.0009) [2023-12-28 02:18:22,824][106225] Updated weights for policy 1, policy_version 983259 (0.0010) [2023-12-28 02:18:23,022][106226] Updated weights for policy 0, policy_version 981063 (0.0008) [2023-12-28 02:18:23,077][106226] Updated weights for policy 0, policy_version 981073 (0.0008) [2023-12-28 02:18:23,132][106226] Updated weights for policy 0, policy_version 981083 (0.0008) [2023-12-28 02:18:23,589][106225] Updated weights for policy 1, policy_version 983269 (0.0009) [2023-12-28 02:18:23,659][106225] Updated weights for policy 1, policy_version 983279 (0.0009) [2023-12-28 02:18:23,715][106225] Updated weights for policy 1, policy_version 983289 (0.0008) [2023-12-28 02:18:23,843][106226] Updated weights for policy 0, policy_version 981093 (0.0008) [2023-12-28 02:18:23,891][106226] Updated weights for policy 0, policy_version 981103 (0.0008) [2023-12-28 02:18:23,953][106226] Updated weights for policy 0, policy_version 981113 (0.0008) [2023-12-28 02:18:24,362][106225] Updated weights for policy 1, policy_version 983299 (0.0008) [2023-12-28 02:18:24,422][106225] Updated weights for policy 1, policy_version 983309 (0.0008) [2023-12-28 02:18:24,480][106225] Updated weights for policy 1, policy_version 983319 (0.0008) [2023-12-28 02:18:24,711][106226] Updated weights for policy 0, policy_version 981123 (0.0010) [2023-12-28 02:18:24,763][106226] Updated weights for policy 0, policy_version 981133 (0.0009) [2023-12-28 02:18:24,822][106226] Updated weights for policy 0, policy_version 981143 (0.0008) [2023-12-28 02:18:25,156][106225] Updated weights for policy 1, policy_version 983329 (0.0008) [2023-12-28 02:18:25,214][106225] Updated weights for policy 1, policy_version 983339 (0.0008) [2023-12-28 02:18:25,268][106225] Updated weights for policy 1, policy_version 983349 (0.0009) [2023-12-28 02:18:25,324][106225] Updated weights for policy 1, policy_version 983359 (0.0008) [2023-12-28 02:18:25,583][106226] Updated weights for policy 0, policy_version 981153 (0.0010) [2023-12-28 02:18:25,644][106226] Updated weights for policy 0, policy_version 981163 (0.0009) [2023-12-28 02:18:25,704][106226] Updated weights for policy 0, policy_version 981173 (0.0009) [2023-12-28 02:18:25,771][106226] Updated weights for policy 0, policy_version 981183 (0.0009) [2023-12-28 02:18:25,909][106225] Updated weights for policy 1, policy_version 983369 (0.0006) [2023-12-28 02:18:25,968][106225] Updated weights for policy 1, policy_version 983379 (0.0005) [2023-12-28 02:18:26,017][106225] Updated weights for policy 1, policy_version 983389 (0.0007) [2023-12-28 02:18:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 503029760. Throughput: 0: 9688.7, 1: 9801.2. Samples: 502995800. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:26,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.352')] [2023-12-28 02:18:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000983392_251789312.pth... [2023-12-28 02:18:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000981184_251240448.pth... [2023-12-28 02:18:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000982240_251494400.pth [2023-12-28 02:18:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000980064_250953728.pth [2023-12-28 02:18:26,562][106225] Updated weights for policy 1, policy_version 983399 (0.0006) [2023-12-28 02:18:26,600][106226] Updated weights for policy 0, policy_version 981193 (0.0008) [2023-12-28 02:18:26,612][106225] Updated weights for policy 1, policy_version 983409 (0.0005) [2023-12-28 02:18:26,654][106226] Updated weights for policy 0, policy_version 981203 (0.0008) [2023-12-28 02:18:26,657][106225] Updated weights for policy 1, policy_version 983419 (0.0005) [2023-12-28 02:18:26,702][106226] Updated weights for policy 0, policy_version 981213 (0.0008) [2023-12-28 02:18:27,209][106225] Updated weights for policy 1, policy_version 983429 (0.0006) [2023-12-28 02:18:27,265][106225] Updated weights for policy 1, policy_version 983439 (0.0005) [2023-12-28 02:18:27,323][106225] Updated weights for policy 1, policy_version 983449 (0.0007) [2023-12-28 02:18:27,514][106226] Updated weights for policy 0, policy_version 981223 (0.0008) [2023-12-28 02:18:27,558][106226] Updated weights for policy 0, policy_version 981233 (0.0009) [2023-12-28 02:18:27,602][106226] Updated weights for policy 0, policy_version 981243 (0.0008) [2023-12-28 02:18:27,925][106225] Updated weights for policy 1, policy_version 983459 (0.0009) [2023-12-28 02:18:27,980][106225] Updated weights for policy 1, policy_version 983469 (0.0008) [2023-12-28 02:18:28,025][106225] Updated weights for policy 1, policy_version 983479 (0.0007) [2023-12-28 02:18:28,426][106226] Updated weights for policy 0, policy_version 981253 (0.0008) [2023-12-28 02:18:28,488][106226] Updated weights for policy 0, policy_version 981263 (0.0009) [2023-12-28 02:18:28,547][106226] Updated weights for policy 0, policy_version 981273 (0.0009) [2023-12-28 02:18:28,626][106225] Updated weights for policy 1, policy_version 983489 (0.0006) [2023-12-28 02:18:28,682][106225] Updated weights for policy 1, policy_version 983499 (0.0008) [2023-12-28 02:18:28,743][106225] Updated weights for policy 1, policy_version 983509 (0.0008) [2023-12-28 02:18:28,801][106225] Updated weights for policy 1, policy_version 983519 (0.0009) [2023-12-28 02:18:29,149][106226] Updated weights for policy 0, policy_version 981283 (0.0008) [2023-12-28 02:18:29,207][106226] Updated weights for policy 0, policy_version 981293 (0.0005) [2023-12-28 02:18:29,277][106226] Updated weights for policy 0, policy_version 981303 (0.0007) [2023-12-28 02:18:29,603][106225] Updated weights for policy 1, policy_version 983529 (0.0006) [2023-12-28 02:18:29,656][106225] Updated weights for policy 1, policy_version 983539 (0.0005) [2023-12-28 02:18:29,712][106225] Updated weights for policy 1, policy_version 983549 (0.0005) [2023-12-28 02:18:29,950][106226] Updated weights for policy 0, policy_version 981313 (0.0008) [2023-12-28 02:18:30,011][106226] Updated weights for policy 0, policy_version 981323 (0.0007) [2023-12-28 02:18:30,075][106226] Updated weights for policy 0, policy_version 981333 (0.0007) [2023-12-28 02:18:30,135][106226] Updated weights for policy 0, policy_version 981343 (0.0008) [2023-12-28 02:18:30,367][106225] Updated weights for policy 1, policy_version 983559 (0.0009) [2023-12-28 02:18:30,420][106225] Updated weights for policy 1, policy_version 983569 (0.0010) [2023-12-28 02:18:30,471][106225] Updated weights for policy 1, policy_version 983579 (0.0008) [2023-12-28 02:18:30,765][106226] Updated weights for policy 0, policy_version 981353 (0.0006) [2023-12-28 02:18:30,824][106226] Updated weights for policy 0, policy_version 981363 (0.0007) [2023-12-28 02:18:30,881][106226] Updated weights for policy 0, policy_version 981373 (0.0008) [2023-12-28 02:18:31,063][106225] Updated weights for policy 1, policy_version 983589 (0.0007) [2023-12-28 02:18:31,109][106225] Updated weights for policy 1, policy_version 983599 (0.0010) [2023-12-28 02:18:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 503128064. Throughput: 0: 9641.6, 1: 9935.9. Samples: 503118032. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:31,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-4.796')] [2023-12-28 02:18:31,180][106225] Updated weights for policy 1, policy_version 983609 (0.0010) [2023-12-28 02:18:31,591][106226] Updated weights for policy 0, policy_version 981383 (0.0009) [2023-12-28 02:18:31,655][106226] Updated weights for policy 0, policy_version 981393 (0.0008) [2023-12-28 02:18:31,708][106226] Updated weights for policy 0, policy_version 981403 (0.0006) [2023-12-28 02:18:31,878][106225] Updated weights for policy 1, policy_version 983619 (0.0010) [2023-12-28 02:18:31,944][106225] Updated weights for policy 1, policy_version 983629 (0.0010) [2023-12-28 02:18:32,005][106225] Updated weights for policy 1, policy_version 983639 (0.0011) [2023-12-28 02:18:32,380][106226] Updated weights for policy 0, policy_version 981413 (0.0008) [2023-12-28 02:18:32,439][106226] Updated weights for policy 0, policy_version 981423 (0.0007) [2023-12-28 02:18:32,493][106226] Updated weights for policy 0, policy_version 981433 (0.0008) [2023-12-28 02:18:32,721][106225] Updated weights for policy 1, policy_version 983649 (0.0010) [2023-12-28 02:18:32,784][106225] Updated weights for policy 1, policy_version 983659 (0.0010) [2023-12-28 02:18:32,837][106225] Updated weights for policy 1, policy_version 983669 (0.0010) [2023-12-28 02:18:32,894][106225] Updated weights for policy 1, policy_version 983679 (0.0010) [2023-12-28 02:18:33,179][106226] Updated weights for policy 0, policy_version 981443 (0.0006) [2023-12-28 02:18:33,230][106226] Updated weights for policy 0, policy_version 981453 (0.0008) [2023-12-28 02:18:33,287][106226] Updated weights for policy 0, policy_version 981463 (0.0009) [2023-12-28 02:18:33,509][106225] Updated weights for policy 1, policy_version 983689 (0.0006) [2023-12-28 02:18:33,554][106225] Updated weights for policy 1, policy_version 983699 (0.0005) [2023-12-28 02:18:33,599][106225] Updated weights for policy 1, policy_version 983709 (0.0005) [2023-12-28 02:18:34,072][106226] Updated weights for policy 0, policy_version 981473 (0.0008) [2023-12-28 02:18:34,143][106226] Updated weights for policy 0, policy_version 981483 (0.0007) [2023-12-28 02:18:34,212][106226] Updated weights for policy 0, policy_version 981494 (0.0008) [2023-12-28 02:18:34,235][106225] Updated weights for policy 1, policy_version 983719 (0.0007) [2023-12-28 02:18:34,269][106226] Updated weights for policy 0, policy_version 981504 (0.0006) [2023-12-28 02:18:34,298][106225] Updated weights for policy 1, policy_version 983729 (0.0010) [2023-12-28 02:18:34,359][106225] Updated weights for policy 1, policy_version 983739 (0.0009) [2023-12-28 02:18:34,956][106226] Updated weights for policy 0, policy_version 981514 (0.0009) [2023-12-28 02:18:35,008][106226] Updated weights for policy 0, policy_version 981524 (0.0010) [2023-12-28 02:18:35,033][106225] Updated weights for policy 1, policy_version 983749 (0.0007) [2023-12-28 02:18:35,058][106226] Updated weights for policy 0, policy_version 981534 (0.0010) [2023-12-28 02:18:35,088][106225] Updated weights for policy 1, policy_version 983759 (0.0006) [2023-12-28 02:18:35,146][106225] Updated weights for policy 1, policy_version 983769 (0.0008) [2023-12-28 02:18:35,723][106226] Updated weights for policy 0, policy_version 981544 (0.0006) [2023-12-28 02:18:35,787][106226] Updated weights for policy 0, policy_version 981554 (0.0007) [2023-12-28 02:18:35,846][106226] Updated weights for policy 0, policy_version 981564 (0.0008) [2023-12-28 02:18:35,925][106225] Updated weights for policy 1, policy_version 983779 (0.0008) [2023-12-28 02:18:35,975][106225] Updated weights for policy 1, policy_version 983789 (0.0009) [2023-12-28 02:18:36,034][106225] Updated weights for policy 1, policy_version 983799 (0.0008) [2023-12-28 02:18:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 503234560. Throughput: 0: 9664.1, 1: 10034.4. Samples: 503240372. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:36,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.820')] [2023-12-28 02:18:36,506][106226] Updated weights for policy 0, policy_version 981574 (0.0008) [2023-12-28 02:18:36,562][106226] Updated weights for policy 0, policy_version 981584 (0.0009) [2023-12-28 02:18:36,623][106226] Updated weights for policy 0, policy_version 981594 (0.0011) [2023-12-28 02:18:36,773][106225] Updated weights for policy 1, policy_version 983809 (0.0009) [2023-12-28 02:18:36,829][106225] Updated weights for policy 1, policy_version 983819 (0.0007) [2023-12-28 02:18:36,886][106225] Updated weights for policy 1, policy_version 983829 (0.0010) [2023-12-28 02:18:36,951][106225] Updated weights for policy 1, policy_version 983839 (0.0007) [2023-12-28 02:18:37,306][106226] Updated weights for policy 0, policy_version 981604 (0.0010) [2023-12-28 02:18:37,352][106226] Updated weights for policy 0, policy_version 981614 (0.0005) [2023-12-28 02:18:37,409][106226] Updated weights for policy 0, policy_version 981624 (0.0007) [2023-12-28 02:18:37,482][106225] Updated weights for policy 1, policy_version 983849 (0.0007) [2023-12-28 02:18:37,531][106225] Updated weights for policy 1, policy_version 983859 (0.0008) [2023-12-28 02:18:37,584][106225] Updated weights for policy 1, policy_version 983869 (0.0008) [2023-12-28 02:18:38,127][106226] Updated weights for policy 0, policy_version 981634 (0.0008) [2023-12-28 02:18:38,182][106226] Updated weights for policy 0, policy_version 981644 (0.0005) [2023-12-28 02:18:38,185][106225] Updated weights for policy 1, policy_version 983879 (0.0009) [2023-12-28 02:18:38,238][106226] Updated weights for policy 0, policy_version 981654 (0.0005) [2023-12-28 02:18:38,249][106225] Updated weights for policy 1, policy_version 983889 (0.0010) [2023-12-28 02:18:38,301][106226] Updated weights for policy 0, policy_version 981664 (0.0006) [2023-12-28 02:18:38,303][106225] Updated weights for policy 1, policy_version 983899 (0.0010) [2023-12-28 02:18:39,025][106226] Updated weights for policy 0, policy_version 981674 (0.0006) [2023-12-28 02:18:39,048][106225] Updated weights for policy 1, policy_version 983909 (0.0009) [2023-12-28 02:18:39,081][106226] Updated weights for policy 0, policy_version 981684 (0.0005) [2023-12-28 02:18:39,100][106225] Updated weights for policy 1, policy_version 983919 (0.0007) [2023-12-28 02:18:39,135][106226] Updated weights for policy 0, policy_version 981694 (0.0005) [2023-12-28 02:18:39,161][106225] Updated weights for policy 1, policy_version 983929 (0.0008) [2023-12-28 02:18:39,896][106226] Updated weights for policy 0, policy_version 981705 (0.0008) [2023-12-28 02:18:39,898][106225] Updated weights for policy 1, policy_version 983939 (0.0009) [2023-12-28 02:18:39,969][106226] Updated weights for policy 0, policy_version 981715 (0.0008) [2023-12-28 02:18:39,982][106225] Updated weights for policy 1, policy_version 983949 (0.0008) [2023-12-28 02:18:40,045][106226] Updated weights for policy 0, policy_version 981725 (0.0008) [2023-12-28 02:18:40,051][106225] Updated weights for policy 1, policy_version 983959 (0.0006) [2023-12-28 02:18:40,700][106225] Updated weights for policy 1, policy_version 983969 (0.0007) [2023-12-28 02:18:40,748][106226] Updated weights for policy 0, policy_version 981735 (0.0006) [2023-12-28 02:18:40,763][106225] Updated weights for policy 1, policy_version 983979 (0.0008) [2023-12-28 02:18:40,799][106226] Updated weights for policy 0, policy_version 981745 (0.0005) [2023-12-28 02:18:40,812][106225] Updated weights for policy 1, policy_version 983989 (0.0008) [2023-12-28 02:18:40,853][106226] Updated weights for policy 0, policy_version 981755 (0.0005) [2023-12-28 02:18:40,868][106225] Updated weights for policy 1, policy_version 983999 (0.0007) [2023-12-28 02:18:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 503332864. Throughput: 0: 9721.8, 1: 10067.9. Samples: 503301212. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:41,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.697')] [2023-12-28 02:18:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000984000_251944960.pth... [2023-12-28 02:18:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000981760_251387904.pth... [2023-12-28 02:18:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000980608_251092992.pth [2023-12-28 02:18:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000982816_251641856.pth [2023-12-28 02:18:41,541][106226] Updated weights for policy 0, policy_version 981765 (0.0008) [2023-12-28 02:18:41,607][106226] Updated weights for policy 0, policy_version 981775 (0.0011) [2023-12-28 02:18:41,660][106225] Updated weights for policy 1, policy_version 984009 (0.0008) [2023-12-28 02:18:41,675][106226] Updated weights for policy 0, policy_version 981785 (0.0009) [2023-12-28 02:18:41,724][106225] Updated weights for policy 1, policy_version 984020 (0.0009) [2023-12-28 02:18:41,793][106225] Updated weights for policy 1, policy_version 984030 (0.0008) [2023-12-28 02:18:42,397][106226] Updated weights for policy 0, policy_version 981795 (0.0009) [2023-12-28 02:18:42,458][106226] Updated weights for policy 0, policy_version 981805 (0.0010) [2023-12-28 02:18:42,524][106226] Updated weights for policy 0, policy_version 981815 (0.0010) [2023-12-28 02:18:42,558][106225] Updated weights for policy 1, policy_version 984040 (0.0008) [2023-12-28 02:18:42,619][106225] Updated weights for policy 1, policy_version 984050 (0.0009) [2023-12-28 02:18:42,685][106225] Updated weights for policy 1, policy_version 984060 (0.0005) [2023-12-28 02:18:43,206][106226] Updated weights for policy 0, policy_version 981825 (0.0009) [2023-12-28 02:18:43,265][106226] Updated weights for policy 0, policy_version 981835 (0.0009) [2023-12-28 02:18:43,311][106226] Updated weights for policy 0, policy_version 981845 (0.0010) [2023-12-28 02:18:43,342][106225] Updated weights for policy 1, policy_version 984070 (0.0008) [2023-12-28 02:18:43,371][106226] Updated weights for policy 0, policy_version 981855 (0.0010) [2023-12-28 02:18:43,396][106225] Updated weights for policy 1, policy_version 984080 (0.0010) [2023-12-28 02:18:43,449][106225] Updated weights for policy 1, policy_version 984090 (0.0006) [2023-12-28 02:18:44,026][106226] Updated weights for policy 0, policy_version 981865 (0.0011) [2023-12-28 02:18:44,088][106225] Updated weights for policy 1, policy_version 984100 (0.0009) [2023-12-28 02:18:44,090][106226] Updated weights for policy 0, policy_version 981875 (0.0011) [2023-12-28 02:18:44,144][106225] Updated weights for policy 1, policy_version 984110 (0.0007) [2023-12-28 02:18:44,153][106226] Updated weights for policy 0, policy_version 981885 (0.0010) [2023-12-28 02:18:44,198][106225] Updated weights for policy 1, policy_version 984120 (0.0008) [2023-12-28 02:18:44,794][106225] Updated weights for policy 1, policy_version 984130 (0.0010) [2023-12-28 02:18:44,859][106225] Updated weights for policy 1, policy_version 984140 (0.0010) [2023-12-28 02:18:44,871][106226] Updated weights for policy 0, policy_version 981895 (0.0007) [2023-12-28 02:18:44,921][106225] Updated weights for policy 1, policy_version 984150 (0.0010) [2023-12-28 02:18:44,928][106226] Updated weights for policy 0, policy_version 981905 (0.0007) [2023-12-28 02:18:44,984][106225] Updated weights for policy 1, policy_version 984160 (0.0010) [2023-12-28 02:18:44,992][106226] Updated weights for policy 0, policy_version 981915 (0.0007) [2023-12-28 02:18:45,652][106225] Updated weights for policy 1, policy_version 984170 (0.0006) [2023-12-28 02:18:45,719][106225] Updated weights for policy 1, policy_version 984180 (0.0007) [2023-12-28 02:18:45,749][106226] Updated weights for policy 0, policy_version 981925 (0.0007) [2023-12-28 02:18:45,774][106225] Updated weights for policy 1, policy_version 984190 (0.0007) [2023-12-28 02:18:45,802][106226] Updated weights for policy 0, policy_version 981935 (0.0007) [2023-12-28 02:18:45,847][106226] Updated weights for policy 0, policy_version 981945 (0.0008) [2023-12-28 02:18:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 503431168. Throughput: 0: 9795.6, 1: 9993.2. Samples: 503419560. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:46,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.883')] [2023-12-28 02:18:46,448][106225] Updated weights for policy 1, policy_version 984200 (0.0007) [2023-12-28 02:18:46,499][106225] Updated weights for policy 1, policy_version 984210 (0.0010) [2023-12-28 02:18:46,556][106225] Updated weights for policy 1, policy_version 984220 (0.0010) [2023-12-28 02:18:46,603][106226] Updated weights for policy 0, policy_version 981955 (0.0008) [2023-12-28 02:18:46,653][106226] Updated weights for policy 0, policy_version 981965 (0.0008) [2023-12-28 02:18:46,703][106226] Updated weights for policy 0, policy_version 981975 (0.0007) [2023-12-28 02:18:47,268][106225] Updated weights for policy 1, policy_version 984230 (0.0010) [2023-12-28 02:18:47,321][106225] Updated weights for policy 1, policy_version 984240 (0.0010) [2023-12-28 02:18:47,369][106225] Updated weights for policy 1, policy_version 984250 (0.0010) [2023-12-28 02:18:47,446][106226] Updated weights for policy 0, policy_version 981985 (0.0008) [2023-12-28 02:18:47,495][106226] Updated weights for policy 0, policy_version 981995 (0.0008) [2023-12-28 02:18:47,540][106226] Updated weights for policy 0, policy_version 982005 (0.0008) [2023-12-28 02:18:47,586][106226] Updated weights for policy 0, policy_version 982015 (0.0009) [2023-12-28 02:18:48,023][106225] Updated weights for policy 1, policy_version 984260 (0.0008) [2023-12-28 02:18:48,070][106225] Updated weights for policy 1, policy_version 984270 (0.0005) [2023-12-28 02:18:48,116][106225] Updated weights for policy 1, policy_version 984280 (0.0005) [2023-12-28 02:18:48,372][106226] Updated weights for policy 0, policy_version 982025 (0.0008) [2023-12-28 02:18:48,435][106226] Updated weights for policy 0, policy_version 982035 (0.0009) [2023-12-28 02:18:48,495][106226] Updated weights for policy 0, policy_version 982045 (0.0009) [2023-12-28 02:18:48,684][106225] Updated weights for policy 1, policy_version 984290 (0.0006) [2023-12-28 02:18:48,749][106225] Updated weights for policy 1, policy_version 984300 (0.0008) [2023-12-28 02:18:48,817][106225] Updated weights for policy 1, policy_version 984310 (0.0008) [2023-12-28 02:18:48,881][106225] Updated weights for policy 1, policy_version 984320 (0.0008) [2023-12-28 02:18:49,309][106226] Updated weights for policy 0, policy_version 982055 (0.0008) [2023-12-28 02:18:49,381][106226] Updated weights for policy 0, policy_version 982065 (0.0009) [2023-12-28 02:18:49,443][106226] Updated weights for policy 0, policy_version 982075 (0.0009) [2023-12-28 02:18:49,575][106225] Updated weights for policy 1, policy_version 984330 (0.0009) [2023-12-28 02:18:49,640][106225] Updated weights for policy 1, policy_version 984340 (0.0009) [2023-12-28 02:18:49,705][106225] Updated weights for policy 1, policy_version 984350 (0.0009) [2023-12-28 02:18:50,168][106226] Updated weights for policy 0, policy_version 982085 (0.0007) [2023-12-28 02:18:50,223][106226] Updated weights for policy 0, policy_version 982095 (0.0006) [2023-12-28 02:18:50,278][106226] Updated weights for policy 0, policy_version 982105 (0.0008) [2023-12-28 02:18:50,467][106225] Updated weights for policy 1, policy_version 984360 (0.0008) [2023-12-28 02:18:50,520][106225] Updated weights for policy 1, policy_version 984370 (0.0009) [2023-12-28 02:18:50,577][106225] Updated weights for policy 1, policy_version 984380 (0.0008) [2023-12-28 02:18:51,011][106226] Updated weights for policy 0, policy_version 982115 (0.0008) [2023-12-28 02:18:51,076][106226] Updated weights for policy 0, policy_version 982125 (0.0010) [2023-12-28 02:18:51,133][106226] Updated weights for policy 0, policy_version 982135 (0.0009) [2023-12-28 02:18:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 503521280. Throughput: 0: 9707.4, 1: 10052.8. Samples: 503536528. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-28 02:18:51,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-5.370')] [2023-12-28 02:18:51,371][106225] Updated weights for policy 1, policy_version 984390 (0.0009) [2023-12-28 02:18:51,435][106225] Updated weights for policy 1, policy_version 984400 (0.0009) [2023-12-28 02:18:51,493][106225] Updated weights for policy 1, policy_version 984410 (0.0007) [2023-12-28 02:18:51,889][106226] Updated weights for policy 0, policy_version 982145 (0.0009) [2023-12-28 02:18:51,947][106226] Updated weights for policy 0, policy_version 982155 (0.0011) [2023-12-28 02:18:52,008][106226] Updated weights for policy 0, policy_version 982165 (0.0011) [2023-12-28 02:18:52,069][106226] Updated weights for policy 0, policy_version 982175 (0.0008) [2023-12-28 02:18:52,266][106225] Updated weights for policy 1, policy_version 984420 (0.0007) [2023-12-28 02:18:52,326][106225] Updated weights for policy 1, policy_version 984430 (0.0006) [2023-12-28 02:18:52,395][106225] Updated weights for policy 1, policy_version 984440 (0.0009) [2023-12-28 02:18:52,731][106226] Updated weights for policy 0, policy_version 982185 (0.0011) [2023-12-28 02:18:52,786][106226] Updated weights for policy 0, policy_version 982195 (0.0010) [2023-12-28 02:18:52,836][106226] Updated weights for policy 0, policy_version 982205 (0.0011) [2023-12-28 02:18:53,041][106225] Updated weights for policy 1, policy_version 984450 (0.0009) [2023-12-28 02:18:53,102][106225] Updated weights for policy 1, policy_version 984460 (0.0010) [2023-12-28 02:18:53,165][106225] Updated weights for policy 1, policy_version 984470 (0.0010) [2023-12-28 02:18:53,224][106225] Updated weights for policy 1, policy_version 984480 (0.0010) [2023-12-28 02:18:53,542][106226] Updated weights for policy 0, policy_version 982215 (0.0009) [2023-12-28 02:18:53,602][106226] Updated weights for policy 0, policy_version 982225 (0.0008) [2023-12-28 02:18:53,669][106226] Updated weights for policy 0, policy_version 982235 (0.0008) [2023-12-28 02:18:53,892][106225] Updated weights for policy 1, policy_version 984490 (0.0005) [2023-12-28 02:18:53,939][106225] Updated weights for policy 1, policy_version 984500 (0.0007) [2023-12-28 02:18:53,988][106225] Updated weights for policy 1, policy_version 984510 (0.0008) [2023-12-28 02:18:54,355][106226] Updated weights for policy 0, policy_version 982245 (0.0007) [2023-12-28 02:18:54,405][106226] Updated weights for policy 0, policy_version 982255 (0.0008) [2023-12-28 02:18:54,462][106226] Updated weights for policy 0, policy_version 982265 (0.0009) [2023-12-28 02:18:54,579][106225] Updated weights for policy 1, policy_version 984520 (0.0006) [2023-12-28 02:18:54,638][106225] Updated weights for policy 1, policy_version 984530 (0.0007) [2023-12-28 02:18:54,690][106225] Updated weights for policy 1, policy_version 984540 (0.0008) [2023-12-28 02:18:55,135][106226] Updated weights for policy 0, policy_version 982275 (0.0009) [2023-12-28 02:18:55,179][106226] Updated weights for policy 0, policy_version 982285 (0.0008) [2023-12-28 02:18:55,230][106226] Updated weights for policy 0, policy_version 982295 (0.0008) [2023-12-28 02:18:55,269][106225] Updated weights for policy 1, policy_version 984550 (0.0007) [2023-12-28 02:18:55,324][106225] Updated weights for policy 1, policy_version 984560 (0.0006) [2023-12-28 02:18:55,386][106225] Updated weights for policy 1, policy_version 984570 (0.0005) [2023-12-28 02:18:55,879][106226] Updated weights for policy 0, policy_version 982305 (0.0008) [2023-12-28 02:18:55,926][106226] Updated weights for policy 0, policy_version 982315 (0.0011) [2023-12-28 02:18:55,973][106226] Updated weights for policy 0, policy_version 982325 (0.0010) [2023-12-28 02:18:56,024][106226] Updated weights for policy 0, policy_version 982335 (0.0010) [2023-12-28 02:18:56,099][106225] Updated weights for policy 1, policy_version 984580 (0.0006) [2023-12-28 02:18:56,162][106225] Updated weights for policy 1, policy_version 984590 (0.0008) [2023-12-28 02:18:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 503627776. Throughput: 0: 9670.7, 1: 10036.3. Samples: 503594112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:18:56,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-5.110')] [2023-12-28 02:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000982336_251535360.pth... [2023-12-28 02:18:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000981184_251240448.pth [2023-12-28 02:18:56,221][106225] Updated weights for policy 1, policy_version 984600 (0.0008) [2023-12-28 02:18:56,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000984608_252100608.pth... [2023-12-28 02:18:56,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000983392_251789312.pth [2023-12-28 02:18:56,770][106226] Updated weights for policy 0, policy_version 982345 (0.0006) [2023-12-28 02:18:56,828][106226] Updated weights for policy 0, policy_version 982355 (0.0005) [2023-12-28 02:18:56,885][106226] Updated weights for policy 0, policy_version 982365 (0.0005) [2023-12-28 02:18:56,899][106225] Updated weights for policy 1, policy_version 984610 (0.0007) [2023-12-28 02:18:56,949][106225] Updated weights for policy 1, policy_version 984620 (0.0005) [2023-12-28 02:18:57,000][106225] Updated weights for policy 1, policy_version 984630 (0.0005) [2023-12-28 02:18:57,054][106225] Updated weights for policy 1, policy_version 984640 (0.0005) [2023-12-28 02:18:57,468][106226] Updated weights for policy 0, policy_version 982375 (0.0009) [2023-12-28 02:18:57,523][106226] Updated weights for policy 0, policy_version 982385 (0.0010) [2023-12-28 02:18:57,568][106226] Updated weights for policy 0, policy_version 982395 (0.0010) [2023-12-28 02:18:57,647][106225] Updated weights for policy 1, policy_version 984650 (0.0010) [2023-12-28 02:18:57,703][106225] Updated weights for policy 1, policy_version 984660 (0.0010) [2023-12-28 02:18:57,761][106225] Updated weights for policy 1, policy_version 984670 (0.0010) [2023-12-28 02:18:58,271][106226] Updated weights for policy 0, policy_version 982405 (0.0010) [2023-12-28 02:18:58,325][106226] Updated weights for policy 0, policy_version 982415 (0.0011) [2023-12-28 02:18:58,392][106226] Updated weights for policy 0, policy_version 982425 (0.0008) [2023-12-28 02:18:58,523][106225] Updated weights for policy 1, policy_version 984680 (0.0010) [2023-12-28 02:18:58,584][106225] Updated weights for policy 1, policy_version 984690 (0.0011) [2023-12-28 02:18:58,653][106225] Updated weights for policy 1, policy_version 984700 (0.0009) [2023-12-28 02:18:59,216][106226] Updated weights for policy 0, policy_version 982435 (0.0008) [2023-12-28 02:18:59,285][106226] Updated weights for policy 0, policy_version 982445 (0.0007) [2023-12-28 02:18:59,346][106226] Updated weights for policy 0, policy_version 982455 (0.0008) [2023-12-28 02:18:59,440][106225] Updated weights for policy 1, policy_version 984710 (0.0006) [2023-12-28 02:18:59,493][106225] Updated weights for policy 1, policy_version 984720 (0.0005) [2023-12-28 02:18:59,552][106225] Updated weights for policy 1, policy_version 984730 (0.0005) [2023-12-28 02:19:00,152][106226] Updated weights for policy 0, policy_version 982465 (0.0008) [2023-12-28 02:19:00,208][106226] Updated weights for policy 0, policy_version 982475 (0.0009) [2023-12-28 02:19:00,244][106225] Updated weights for policy 1, policy_version 984740 (0.0008) [2023-12-28 02:19:00,265][106226] Updated weights for policy 0, policy_version 982485 (0.0008) [2023-12-28 02:19:00,302][106225] Updated weights for policy 1, policy_version 984750 (0.0008) [2023-12-28 02:19:00,324][106226] Updated weights for policy 0, policy_version 982495 (0.0006) [2023-12-28 02:19:00,356][106225] Updated weights for policy 1, policy_version 984760 (0.0005) [2023-12-28 02:19:00,893][106226] Updated weights for policy 0, policy_version 982505 (0.0006) [2023-12-28 02:19:00,908][106225] Updated weights for policy 1, policy_version 984770 (0.0006) [2023-12-28 02:19:00,943][106226] Updated weights for policy 0, policy_version 982515 (0.0008) [2023-12-28 02:19:00,964][106225] Updated weights for policy 1, policy_version 984780 (0.0005) [2023-12-28 02:19:00,989][106226] Updated weights for policy 0, policy_version 982525 (0.0008) [2023-12-28 02:19:01,023][106225] Updated weights for policy 1, policy_version 984790 (0.0006) [2023-12-28 02:19:01,089][106225] Updated weights for policy 1, policy_version 984800 (0.0008) [2023-12-28 02:19:01,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 503734272. Throughput: 0: 9726.0, 1: 10128.1. Samples: 503715860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:01,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.916')] [2023-12-28 02:19:01,766][106226] Updated weights for policy 0, policy_version 982535 (0.0007) [2023-12-28 02:19:01,813][106225] Updated weights for policy 1, policy_version 984810 (0.0008) [2023-12-28 02:19:01,820][106226] Updated weights for policy 0, policy_version 982545 (0.0006) [2023-12-28 02:19:01,870][106225] Updated weights for policy 1, policy_version 984820 (0.0008) [2023-12-28 02:19:01,872][106226] Updated weights for policy 0, policy_version 982555 (0.0008) [2023-12-28 02:19:01,927][106225] Updated weights for policy 1, policy_version 984830 (0.0009) [2023-12-28 02:19:02,576][106226] Updated weights for policy 0, policy_version 982565 (0.0009) [2023-12-28 02:19:02,636][106226] Updated weights for policy 0, policy_version 982575 (0.0009) [2023-12-28 02:19:02,654][106225] Updated weights for policy 1, policy_version 984840 (0.0007) [2023-12-28 02:19:02,686][106226] Updated weights for policy 0, policy_version 982585 (0.0006) [2023-12-28 02:19:02,703][106225] Updated weights for policy 1, policy_version 984850 (0.0006) [2023-12-28 02:19:02,756][106225] Updated weights for policy 1, policy_version 984860 (0.0008) [2023-12-28 02:19:03,360][106225] Updated weights for policy 1, policy_version 984870 (0.0008) [2023-12-28 02:19:03,410][106225] Updated weights for policy 1, policy_version 984880 (0.0008) [2023-12-28 02:19:03,421][106226] Updated weights for policy 0, policy_version 982595 (0.0006) [2023-12-28 02:19:03,468][106225] Updated weights for policy 1, policy_version 984890 (0.0008) [2023-12-28 02:19:03,473][106226] Updated weights for policy 0, policy_version 982605 (0.0005) [2023-12-28 02:19:03,523][106226] Updated weights for policy 0, policy_version 982615 (0.0007) [2023-12-28 02:19:04,161][106225] Updated weights for policy 1, policy_version 984900 (0.0006) [2023-12-28 02:19:04,224][106225] Updated weights for policy 1, policy_version 984910 (0.0008) [2023-12-28 02:19:04,284][106225] Updated weights for policy 1, policy_version 984920 (0.0008) [2023-12-28 02:19:04,296][106226] Updated weights for policy 0, policy_version 982625 (0.0008) [2023-12-28 02:19:04,357][106226] Updated weights for policy 0, policy_version 982635 (0.0008) [2023-12-28 02:19:04,417][106226] Updated weights for policy 0, policy_version 982645 (0.0009) [2023-12-28 02:19:04,481][106226] Updated weights for policy 0, policy_version 982655 (0.0009) [2023-12-28 02:19:05,009][106225] Updated weights for policy 1, policy_version 984930 (0.0007) [2023-12-28 02:19:05,066][106225] Updated weights for policy 1, policy_version 984940 (0.0009) [2023-12-28 02:19:05,130][106225] Updated weights for policy 1, policy_version 984950 (0.0008) [2023-12-28 02:19:05,178][106226] Updated weights for policy 0, policy_version 982665 (0.0008) [2023-12-28 02:19:05,192][106225] Updated weights for policy 1, policy_version 984960 (0.0007) [2023-12-28 02:19:05,236][106226] Updated weights for policy 0, policy_version 982675 (0.0008) [2023-12-28 02:19:05,286][106226] Updated weights for policy 0, policy_version 982685 (0.0008) [2023-12-28 02:19:05,905][106225] Updated weights for policy 1, policy_version 984970 (0.0009) [2023-12-28 02:19:05,944][106226] Updated weights for policy 0, policy_version 982695 (0.0007) [2023-12-28 02:19:05,961][106225] Updated weights for policy 1, policy_version 984980 (0.0007) [2023-12-28 02:19:06,000][106226] Updated weights for policy 0, policy_version 982705 (0.0006) [2023-12-28 02:19:06,021][106225] Updated weights for policy 1, policy_version 984990 (0.0008) [2023-12-28 02:19:06,057][106226] Updated weights for policy 0, policy_version 982715 (0.0005) [2023-12-28 02:19:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 503832576. Throughput: 0: 9716.4, 1: 10192.0. Samples: 503836044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:06,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-5.183')] [2023-12-28 02:19:06,743][106225] Updated weights for policy 1, policy_version 985000 (0.0007) [2023-12-28 02:19:06,802][106225] Updated weights for policy 1, policy_version 985010 (0.0009) [2023-12-28 02:19:06,820][106226] Updated weights for policy 0, policy_version 982725 (0.0007) [2023-12-28 02:19:06,859][106225] Updated weights for policy 1, policy_version 985020 (0.0007) [2023-12-28 02:19:06,884][106226] Updated weights for policy 0, policy_version 982735 (0.0007) [2023-12-28 02:19:06,951][106226] Updated weights for policy 0, policy_version 982745 (0.0008) [2023-12-28 02:19:07,611][106225] Updated weights for policy 1, policy_version 985030 (0.0007) [2023-12-28 02:19:07,630][106226] Updated weights for policy 0, policy_version 982755 (0.0008) [2023-12-28 02:19:07,659][106225] Updated weights for policy 1, policy_version 985040 (0.0006) [2023-12-28 02:19:07,685][106226] Updated weights for policy 0, policy_version 982765 (0.0006) [2023-12-28 02:19:07,712][106225] Updated weights for policy 1, policy_version 985050 (0.0007) [2023-12-28 02:19:07,736][106226] Updated weights for policy 0, policy_version 982775 (0.0008) [2023-12-28 02:19:08,450][106225] Updated weights for policy 1, policy_version 985060 (0.0009) [2023-12-28 02:19:08,462][106226] Updated weights for policy 0, policy_version 982785 (0.0008) [2023-12-28 02:19:08,506][106225] Updated weights for policy 1, policy_version 985070 (0.0010) [2023-12-28 02:19:08,520][106226] Updated weights for policy 0, policy_version 982795 (0.0007) [2023-12-28 02:19:08,569][106225] Updated weights for policy 1, policy_version 985080 (0.0009) [2023-12-28 02:19:08,579][106226] Updated weights for policy 0, policy_version 982805 (0.0006) [2023-12-28 02:19:08,631][106226] Updated weights for policy 0, policy_version 982815 (0.0009) [2023-12-28 02:19:09,285][106225] Updated weights for policy 1, policy_version 985090 (0.0008) [2023-12-28 02:19:09,351][106225] Updated weights for policy 1, policy_version 985100 (0.0010) [2023-12-28 02:19:09,359][106226] Updated weights for policy 0, policy_version 982825 (0.0008) [2023-12-28 02:19:09,422][106225] Updated weights for policy 1, policy_version 985110 (0.0008) [2023-12-28 02:19:09,427][106226] Updated weights for policy 0, policy_version 982835 (0.0009) [2023-12-28 02:19:09,487][106225] Updated weights for policy 1, policy_version 985120 (0.0007) [2023-12-28 02:19:09,495][106226] Updated weights for policy 0, policy_version 982845 (0.0010) [2023-12-28 02:19:10,218][106225] Updated weights for policy 1, policy_version 985130 (0.0006) [2023-12-28 02:19:10,286][106225] Updated weights for policy 1, policy_version 985140 (0.0005) [2023-12-28 02:19:10,302][106226] Updated weights for policy 0, policy_version 982855 (0.0010) [2023-12-28 02:19:10,350][106225] Updated weights for policy 1, policy_version 985150 (0.0006) [2023-12-28 02:19:10,367][106226] Updated weights for policy 0, policy_version 982865 (0.0007) [2023-12-28 02:19:10,425][106226] Updated weights for policy 0, policy_version 982875 (0.0009) [2023-12-28 02:19:11,013][106225] Updated weights for policy 1, policy_version 985160 (0.0007) [2023-12-28 02:19:11,078][106225] Updated weights for policy 1, policy_version 985170 (0.0007) [2023-12-28 02:19:11,151][106225] Updated weights for policy 1, policy_version 985180 (0.0007) [2023-12-28 02:19:11,174][105115] Fps is (10 sec: 18022.4, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 503914496. Throughput: 0: 9730.4, 1: 10213.3. Samples: 503893268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:11,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.220')] [2023-12-28 02:19:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000985184_252248064.pth... [2023-12-28 02:19:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000984000_251944960.pth [2023-12-28 02:19:11,224][106226] Updated weights for policy 0, policy_version 982885 (0.0008) [2023-12-28 02:19:11,289][106226] Updated weights for policy 0, policy_version 982895 (0.0008) [2023-12-28 02:19:11,352][106226] Updated weights for policy 0, policy_version 982905 (0.0008) [2023-12-28 02:19:11,401][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000982912_251682816.pth... [2023-12-28 02:19:11,405][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000981760_251387904.pth [2023-12-28 02:19:11,889][106225] Updated weights for policy 1, policy_version 985190 (0.0007) [2023-12-28 02:19:11,958][106225] Updated weights for policy 1, policy_version 985200 (0.0007) [2023-12-28 02:19:12,021][106225] Updated weights for policy 1, policy_version 985210 (0.0009) [2023-12-28 02:19:12,121][106226] Updated weights for policy 0, policy_version 982915 (0.0008) [2023-12-28 02:19:12,180][106226] Updated weights for policy 0, policy_version 982925 (0.0008) [2023-12-28 02:19:12,243][106226] Updated weights for policy 0, policy_version 982935 (0.0008) [2023-12-28 02:19:12,737][106225] Updated weights for policy 1, policy_version 985220 (0.0010) [2023-12-28 02:19:12,797][106225] Updated weights for policy 1, policy_version 985230 (0.0006) [2023-12-28 02:19:12,854][106225] Updated weights for policy 1, policy_version 985240 (0.0007) [2023-12-28 02:19:13,067][106226] Updated weights for policy 0, policy_version 982945 (0.0008) [2023-12-28 02:19:13,112][106226] Updated weights for policy 0, policy_version 982955 (0.0007) [2023-12-28 02:19:13,169][106226] Updated weights for policy 0, policy_version 982965 (0.0008) [2023-12-28 02:19:13,227][106226] Updated weights for policy 0, policy_version 982975 (0.0008) [2023-12-28 02:19:13,480][106225] Updated weights for policy 1, policy_version 985250 (0.0008) [2023-12-28 02:19:13,533][106225] Updated weights for policy 1, policy_version 985260 (0.0006) [2023-12-28 02:19:13,595][106225] Updated weights for policy 1, policy_version 985270 (0.0008) [2023-12-28 02:19:13,653][106225] Updated weights for policy 1, policy_version 985280 (0.0005) [2023-12-28 02:19:13,999][106226] Updated weights for policy 0, policy_version 982985 (0.0008) [2023-12-28 02:19:14,044][106226] Updated weights for policy 0, policy_version 982995 (0.0008) [2023-12-28 02:19:14,100][106226] Updated weights for policy 0, policy_version 983005 (0.0008) [2023-12-28 02:19:14,322][106225] Updated weights for policy 1, policy_version 985290 (0.0008) [2023-12-28 02:19:14,386][106225] Updated weights for policy 1, policy_version 985300 (0.0008) [2023-12-28 02:19:14,448][106225] Updated weights for policy 1, policy_version 985310 (0.0008) [2023-12-28 02:19:14,831][106226] Updated weights for policy 0, policy_version 983015 (0.0008) [2023-12-28 02:19:14,888][106226] Updated weights for policy 0, policy_version 983025 (0.0008) [2023-12-28 02:19:14,946][106226] Updated weights for policy 0, policy_version 983035 (0.0009) [2023-12-28 02:19:15,243][106225] Updated weights for policy 1, policy_version 985320 (0.0008) [2023-12-28 02:19:15,304][106225] Updated weights for policy 1, policy_version 985330 (0.0008) [2023-12-28 02:19:15,365][106225] Updated weights for policy 1, policy_version 985340 (0.0007) [2023-12-28 02:19:15,672][106226] Updated weights for policy 0, policy_version 983045 (0.0009) [2023-12-28 02:19:15,734][106226] Updated weights for policy 0, policy_version 983055 (0.0006) [2023-12-28 02:19:15,787][106226] Updated weights for policy 0, policy_version 983065 (0.0009) [2023-12-28 02:19:15,958][106225] Updated weights for policy 1, policy_version 985350 (0.0005) [2023-12-28 02:19:16,018][106225] Updated weights for policy 1, policy_version 985360 (0.0007) [2023-12-28 02:19:16,067][106225] Updated weights for policy 1, policy_version 985370 (0.0007) [2023-12-28 02:19:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 504020992. Throughput: 0: 9663.4, 1: 10047.8. Samples: 504005032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:16,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-4.881')] [2023-12-28 02:19:16,452][106226] Updated weights for policy 0, policy_version 983075 (0.0009) [2023-12-28 02:19:16,502][106226] Updated weights for policy 0, policy_version 983085 (0.0005) [2023-12-28 02:19:16,550][106226] Updated weights for policy 0, policy_version 983095 (0.0005) [2023-12-28 02:19:16,836][106225] Updated weights for policy 1, policy_version 985380 (0.0009) [2023-12-28 02:19:16,885][106225] Updated weights for policy 1, policy_version 985390 (0.0008) [2023-12-28 02:19:16,944][106225] Updated weights for policy 1, policy_version 985400 (0.0009) [2023-12-28 02:19:17,115][106226] Updated weights for policy 0, policy_version 983105 (0.0005) [2023-12-28 02:19:17,181][106226] Updated weights for policy 0, policy_version 983115 (0.0005) [2023-12-28 02:19:17,249][106226] Updated weights for policy 0, policy_version 983125 (0.0005) [2023-12-28 02:19:17,307][106226] Updated weights for policy 0, policy_version 983135 (0.0005) [2023-12-28 02:19:17,713][106225] Updated weights for policy 1, policy_version 985410 (0.0008) [2023-12-28 02:19:17,764][106225] Updated weights for policy 1, policy_version 985420 (0.0007) [2023-12-28 02:19:17,815][106225] Updated weights for policy 1, policy_version 985430 (0.0007) [2023-12-28 02:19:17,872][106225] Updated weights for policy 1, policy_version 985440 (0.0008) [2023-12-28 02:19:17,897][106226] Updated weights for policy 0, policy_version 983145 (0.0008) [2023-12-28 02:19:17,948][106226] Updated weights for policy 0, policy_version 983155 (0.0006) [2023-12-28 02:19:17,998][106226] Updated weights for policy 0, policy_version 983165 (0.0010) [2023-12-28 02:19:18,493][106225] Updated weights for policy 1, policy_version 985450 (0.0006) [2023-12-28 02:19:18,559][106225] Updated weights for policy 1, policy_version 985460 (0.0007) [2023-12-28 02:19:18,622][106225] Updated weights for policy 1, policy_version 985470 (0.0010) [2023-12-28 02:19:18,706][106226] Updated weights for policy 0, policy_version 983175 (0.0007) [2023-12-28 02:19:18,777][106226] Updated weights for policy 0, policy_version 983185 (0.0010) [2023-12-28 02:19:18,835][106226] Updated weights for policy 0, policy_version 983195 (0.0006) [2023-12-28 02:19:19,391][106225] Updated weights for policy 1, policy_version 985480 (0.0008) [2023-12-28 02:19:19,445][106225] Updated weights for policy 1, policy_version 985490 (0.0005) [2023-12-28 02:19:19,508][106225] Updated weights for policy 1, policy_version 985500 (0.0007) [2023-12-28 02:19:19,521][106226] Updated weights for policy 0, policy_version 983205 (0.0006) [2023-12-28 02:19:19,584][106226] Updated weights for policy 0, policy_version 983215 (0.0007) [2023-12-28 02:19:19,638][106226] Updated weights for policy 0, policy_version 983225 (0.0006) [2023-12-28 02:19:20,285][106225] Updated weights for policy 1, policy_version 985510 (0.0008) [2023-12-28 02:19:20,351][106225] Updated weights for policy 1, policy_version 985520 (0.0008) [2023-12-28 02:19:20,361][106226] Updated weights for policy 0, policy_version 983235 (0.0007) [2023-12-28 02:19:20,411][106226] Updated weights for policy 0, policy_version 983245 (0.0007) [2023-12-28 02:19:20,413][106225] Updated weights for policy 1, policy_version 985530 (0.0008) [2023-12-28 02:19:20,458][106226] Updated weights for policy 0, policy_version 983255 (0.0008) [2023-12-28 02:19:21,124][106225] Updated weights for policy 1, policy_version 985540 (0.0008) [2023-12-28 02:19:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 504111104. Throughput: 0: 9680.5, 1: 9968.5. Samples: 504124572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:21,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.727')] [2023-12-28 02:19:21,194][106225] Updated weights for policy 1, policy_version 985550 (0.0009) [2023-12-28 02:19:21,247][106226] Updated weights for policy 0, policy_version 983265 (0.0008) [2023-12-28 02:19:21,261][106225] Updated weights for policy 1, policy_version 985560 (0.0008) [2023-12-28 02:19:21,314][106226] Updated weights for policy 0, policy_version 983275 (0.0009) [2023-12-28 02:19:21,383][106226] Updated weights for policy 0, policy_version 983285 (0.0008) [2023-12-28 02:19:21,455][106226] Updated weights for policy 0, policy_version 983295 (0.0007) [2023-12-28 02:19:21,929][106225] Updated weights for policy 1, policy_version 985570 (0.0009) [2023-12-28 02:19:21,991][106225] Updated weights for policy 1, policy_version 985580 (0.0009) [2023-12-28 02:19:22,059][106225] Updated weights for policy 1, policy_version 985590 (0.0009) [2023-12-28 02:19:22,132][106225] Updated weights for policy 1, policy_version 985600 (0.0008) [2023-12-28 02:19:22,203][106226] Updated weights for policy 0, policy_version 983305 (0.0007) [2023-12-28 02:19:22,272][106226] Updated weights for policy 0, policy_version 983315 (0.0009) [2023-12-28 02:19:22,330][106226] Updated weights for policy 0, policy_version 983325 (0.0008) [2023-12-28 02:19:22,895][106225] Updated weights for policy 1, policy_version 985610 (0.0010) [2023-12-28 02:19:22,961][106225] Updated weights for policy 1, policy_version 985620 (0.0011) [2023-12-28 02:19:23,029][106225] Updated weights for policy 1, policy_version 985630 (0.0010) [2023-12-28 02:19:23,100][106226] Updated weights for policy 0, policy_version 983335 (0.0009) [2023-12-28 02:19:23,156][106226] Updated weights for policy 0, policy_version 983345 (0.0007) [2023-12-28 02:19:23,207][106226] Updated weights for policy 0, policy_version 983355 (0.0008) [2023-12-28 02:19:23,732][106225] Updated weights for policy 1, policy_version 985640 (0.0010) [2023-12-28 02:19:23,782][106225] Updated weights for policy 1, policy_version 985650 (0.0010) [2023-12-28 02:19:23,835][106225] Updated weights for policy 1, policy_version 985660 (0.0010) [2023-12-28 02:19:23,942][106226] Updated weights for policy 0, policy_version 983365 (0.0008) [2023-12-28 02:19:24,002][106226] Updated weights for policy 0, policy_version 983375 (0.0008) [2023-12-28 02:19:24,060][106226] Updated weights for policy 0, policy_version 983385 (0.0008) [2023-12-28 02:19:24,584][106225] Updated weights for policy 1, policy_version 985670 (0.0010) [2023-12-28 02:19:24,632][106225] Updated weights for policy 1, policy_version 985680 (0.0005) [2023-12-28 02:19:24,681][106225] Updated weights for policy 1, policy_version 985690 (0.0005) [2023-12-28 02:19:24,819][106226] Updated weights for policy 0, policy_version 983395 (0.0009) [2023-12-28 02:19:24,867][106226] Updated weights for policy 0, policy_version 983405 (0.0007) [2023-12-28 02:19:24,919][106226] Updated weights for policy 0, policy_version 983415 (0.0006) [2023-12-28 02:19:25,229][106225] Updated weights for policy 1, policy_version 985700 (0.0005) [2023-12-28 02:19:25,283][106225] Updated weights for policy 1, policy_version 985710 (0.0006) [2023-12-28 02:19:25,342][106225] Updated weights for policy 1, policy_version 985720 (0.0009) [2023-12-28 02:19:25,480][106226] Updated weights for policy 0, policy_version 983425 (0.0005) [2023-12-28 02:19:25,527][106226] Updated weights for policy 0, policy_version 983435 (0.0005) [2023-12-28 02:19:25,576][106226] Updated weights for policy 0, policy_version 983445 (0.0005) [2023-12-28 02:19:25,626][106226] Updated weights for policy 0, policy_version 983455 (0.0005) [2023-12-28 02:19:25,904][106225] Updated weights for policy 1, policy_version 985730 (0.0008) [2023-12-28 02:19:25,952][106225] Updated weights for policy 1, policy_version 985740 (0.0006) [2023-12-28 02:19:26,004][106225] Updated weights for policy 1, policy_version 985750 (0.0006) [2023-12-28 02:19:26,054][106225] Updated weights for policy 1, policy_version 985760 (0.0009) [2023-12-28 02:19:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 504217600. Throughput: 0: 9642.2, 1: 9905.7. Samples: 504180872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:26,176][105115] Avg episode reward: [(0, '-4.916'), (1, '-4.864')] [2023-12-28 02:19:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000985760_252395520.pth... [2023-12-28 02:19:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000983456_251822080.pth... [2023-12-28 02:19:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000984608_252100608.pth [2023-12-28 02:19:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000982336_251535360.pth [2023-12-28 02:19:26,286][106226] Updated weights for policy 0, policy_version 983465 (0.0008) [2023-12-28 02:19:26,335][106226] Updated weights for policy 0, policy_version 983475 (0.0008) [2023-12-28 02:19:26,388][106226] Updated weights for policy 0, policy_version 983485 (0.0009) [2023-12-28 02:19:26,737][106225] Updated weights for policy 1, policy_version 985770 (0.0008) [2023-12-28 02:19:26,792][106225] Updated weights for policy 1, policy_version 985780 (0.0008) [2023-12-28 02:19:26,844][106225] Updated weights for policy 1, policy_version 985790 (0.0008) [2023-12-28 02:19:27,124][106226] Updated weights for policy 0, policy_version 983495 (0.0008) [2023-12-28 02:19:27,173][106226] Updated weights for policy 0, policy_version 983505 (0.0008) [2023-12-28 02:19:27,230][106226] Updated weights for policy 0, policy_version 983515 (0.0008) [2023-12-28 02:19:27,510][106225] Updated weights for policy 1, policy_version 985800 (0.0010) [2023-12-28 02:19:27,561][106225] Updated weights for policy 1, policy_version 985810 (0.0010) [2023-12-28 02:19:27,609][106225] Updated weights for policy 1, policy_version 985820 (0.0010) [2023-12-28 02:19:27,926][106226] Updated weights for policy 0, policy_version 983525 (0.0008) [2023-12-28 02:19:27,981][106226] Updated weights for policy 0, policy_version 983535 (0.0008) [2023-12-28 02:19:28,026][106226] Updated weights for policy 0, policy_version 983545 (0.0008) [2023-12-28 02:19:28,348][106225] Updated weights for policy 1, policy_version 985830 (0.0011) [2023-12-28 02:19:28,407][106225] Updated weights for policy 1, policy_version 985840 (0.0006) [2023-12-28 02:19:28,466][106225] Updated weights for policy 1, policy_version 985850 (0.0008) [2023-12-28 02:19:28,793][106226] Updated weights for policy 0, policy_version 983555 (0.0007) [2023-12-28 02:19:28,843][106226] Updated weights for policy 0, policy_version 983565 (0.0010) [2023-12-28 02:19:28,896][106226] Updated weights for policy 0, policy_version 983575 (0.0009) [2023-12-28 02:19:29,056][106225] Updated weights for policy 1, policy_version 985860 (0.0009) [2023-12-28 02:19:29,113][106225] Updated weights for policy 1, policy_version 985870 (0.0006) [2023-12-28 02:19:29,176][106225] Updated weights for policy 1, policy_version 985880 (0.0008) [2023-12-28 02:19:29,630][106226] Updated weights for policy 0, policy_version 983585 (0.0008) [2023-12-28 02:19:29,699][106226] Updated weights for policy 0, policy_version 983595 (0.0008) [2023-12-28 02:19:29,759][106226] Updated weights for policy 0, policy_version 983605 (0.0011) [2023-12-28 02:19:29,811][106225] Updated weights for policy 1, policy_version 985890 (0.0010) [2023-12-28 02:19:29,820][106226] Updated weights for policy 0, policy_version 983615 (0.0010) [2023-12-28 02:19:29,883][106225] Updated weights for policy 1, policy_version 985900 (0.0010) [2023-12-28 02:19:29,952][106225] Updated weights for policy 1, policy_version 985910 (0.0007) [2023-12-28 02:19:30,012][106225] Updated weights for policy 1, policy_version 985920 (0.0010) [2023-12-28 02:19:30,488][106226] Updated weights for policy 0, policy_version 983625 (0.0006) [2023-12-28 02:19:30,541][106226] Updated weights for policy 0, policy_version 983635 (0.0007) [2023-12-28 02:19:30,594][106226] Updated weights for policy 0, policy_version 983645 (0.0008) [2023-12-28 02:19:30,741][106225] Updated weights for policy 1, policy_version 985930 (0.0010) [2023-12-28 02:19:30,802][106225] Updated weights for policy 1, policy_version 985940 (0.0009) [2023-12-28 02:19:30,864][106225] Updated weights for policy 1, policy_version 985950 (0.0005) [2023-12-28 02:19:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 504315904. Throughput: 0: 9685.9, 1: 10007.6. Samples: 504305764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:31,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-5.161')] [2023-12-28 02:19:31,263][106226] Updated weights for policy 0, policy_version 983655 (0.0006) [2023-12-28 02:19:31,317][106226] Updated weights for policy 0, policy_version 983665 (0.0006) [2023-12-28 02:19:31,376][106226] Updated weights for policy 0, policy_version 983675 (0.0008) [2023-12-28 02:19:31,500][106225] Updated weights for policy 1, policy_version 985960 (0.0008) [2023-12-28 02:19:31,558][106225] Updated weights for policy 1, policy_version 985970 (0.0008) [2023-12-28 02:19:31,603][106225] Updated weights for policy 1, policy_version 985980 (0.0009) [2023-12-28 02:19:32,061][106226] Updated weights for policy 0, policy_version 983685 (0.0008) [2023-12-28 02:19:32,120][106226] Updated weights for policy 0, policy_version 983695 (0.0009) [2023-12-28 02:19:32,178][106226] Updated weights for policy 0, policy_version 983705 (0.0009) [2023-12-28 02:19:32,370][106225] Updated weights for policy 1, policy_version 985990 (0.0009) [2023-12-28 02:19:32,428][106225] Updated weights for policy 1, policy_version 986000 (0.0009) [2023-12-28 02:19:32,493][106225] Updated weights for policy 1, policy_version 986010 (0.0008) [2023-12-28 02:19:32,887][106226] Updated weights for policy 0, policy_version 983715 (0.0008) [2023-12-28 02:19:32,946][106226] Updated weights for policy 0, policy_version 983725 (0.0008) [2023-12-28 02:19:33,008][106226] Updated weights for policy 0, policy_version 983735 (0.0008) [2023-12-28 02:19:33,227][106225] Updated weights for policy 1, policy_version 986020 (0.0008) [2023-12-28 02:19:33,288][106225] Updated weights for policy 1, policy_version 986030 (0.0008) [2023-12-28 02:19:33,341][106225] Updated weights for policy 1, policy_version 986040 (0.0005) [2023-12-28 02:19:33,676][106226] Updated weights for policy 0, policy_version 983745 (0.0008) [2023-12-28 02:19:33,731][106226] Updated weights for policy 0, policy_version 983755 (0.0005) [2023-12-28 02:19:33,784][106226] Updated weights for policy 0, policy_version 983765 (0.0005) [2023-12-28 02:19:33,837][106226] Updated weights for policy 0, policy_version 983775 (0.0006) [2023-12-28 02:19:34,036][106225] Updated weights for policy 1, policy_version 986050 (0.0006) [2023-12-28 02:19:34,086][106225] Updated weights for policy 1, policy_version 986060 (0.0005) [2023-12-28 02:19:34,149][106225] Updated weights for policy 1, policy_version 986070 (0.0008) [2023-12-28 02:19:34,213][106225] Updated weights for policy 1, policy_version 986080 (0.0008) [2023-12-28 02:19:34,526][106226] Updated weights for policy 0, policy_version 983785 (0.0010) [2023-12-28 02:19:34,595][106226] Updated weights for policy 0, policy_version 983795 (0.0007) [2023-12-28 02:19:34,666][106226] Updated weights for policy 0, policy_version 983805 (0.0008) [2023-12-28 02:19:34,891][106225] Updated weights for policy 1, policy_version 986090 (0.0008) [2023-12-28 02:19:34,938][106225] Updated weights for policy 1, policy_version 986100 (0.0008) [2023-12-28 02:19:34,987][106225] Updated weights for policy 1, policy_version 986110 (0.0008) [2023-12-28 02:19:35,380][106226] Updated weights for policy 0, policy_version 983815 (0.0008) [2023-12-28 02:19:35,430][106226] Updated weights for policy 0, policy_version 983825 (0.0008) [2023-12-28 02:19:35,480][106226] Updated weights for policy 0, policy_version 983835 (0.0008) [2023-12-28 02:19:35,719][106225] Updated weights for policy 1, policy_version 986120 (0.0010) [2023-12-28 02:19:35,788][106225] Updated weights for policy 1, policy_version 986130 (0.0010) [2023-12-28 02:19:35,851][106225] Updated weights for policy 1, policy_version 986140 (0.0010) [2023-12-28 02:19:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 504414208. Throughput: 0: 9786.8, 1: 9965.0. Samples: 504425356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:36,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.921')] [2023-12-28 02:19:36,192][106226] Updated weights for policy 0, policy_version 983845 (0.0008) [2023-12-28 02:19:36,254][106226] Updated weights for policy 0, policy_version 983855 (0.0007) [2023-12-28 02:19:36,319][106226] Updated weights for policy 0, policy_version 983865 (0.0007) [2023-12-28 02:19:36,546][106225] Updated weights for policy 1, policy_version 986150 (0.0010) [2023-12-28 02:19:36,606][106225] Updated weights for policy 1, policy_version 986160 (0.0011) [2023-12-28 02:19:36,667][106225] Updated weights for policy 1, policy_version 986170 (0.0010) [2023-12-28 02:19:37,102][106226] Updated weights for policy 0, policy_version 983875 (0.0008) [2023-12-28 02:19:37,154][106226] Updated weights for policy 0, policy_version 983885 (0.0008) [2023-12-28 02:19:37,216][106226] Updated weights for policy 0, policy_version 983895 (0.0008) [2023-12-28 02:19:37,371][106225] Updated weights for policy 1, policy_version 986180 (0.0010) [2023-12-28 02:19:37,429][106225] Updated weights for policy 1, policy_version 986190 (0.0010) [2023-12-28 02:19:37,484][106225] Updated weights for policy 1, policy_version 986200 (0.0011) [2023-12-28 02:19:37,993][106226] Updated weights for policy 0, policy_version 983905 (0.0008) [2023-12-28 02:19:38,053][106226] Updated weights for policy 0, policy_version 983915 (0.0008) [2023-12-28 02:19:38,122][106226] Updated weights for policy 0, policy_version 983925 (0.0008) [2023-12-28 02:19:38,164][106225] Updated weights for policy 1, policy_version 986210 (0.0010) [2023-12-28 02:19:38,182][106226] Updated weights for policy 0, policy_version 983935 (0.0007) [2023-12-28 02:19:38,222][106225] Updated weights for policy 1, policy_version 986220 (0.0007) [2023-12-28 02:19:38,279][106225] Updated weights for policy 1, policy_version 986230 (0.0008) [2023-12-28 02:19:38,353][106225] Updated weights for policy 1, policy_version 986240 (0.0010) [2023-12-28 02:19:38,957][106225] Updated weights for policy 1, policy_version 986250 (0.0005) [2023-12-28 02:19:38,967][106226] Updated weights for policy 0, policy_version 983945 (0.0008) [2023-12-28 02:19:39,018][106225] Updated weights for policy 1, policy_version 986260 (0.0006) [2023-12-28 02:19:39,030][106226] Updated weights for policy 0, policy_version 983955 (0.0009) [2023-12-28 02:19:39,076][106225] Updated weights for policy 1, policy_version 986270 (0.0010) [2023-12-28 02:19:39,090][106226] Updated weights for policy 0, policy_version 983965 (0.0006) [2023-12-28 02:19:39,731][106225] Updated weights for policy 1, policy_version 986280 (0.0008) [2023-12-28 02:19:39,798][106225] Updated weights for policy 1, policy_version 986290 (0.0010) [2023-12-28 02:19:39,872][106225] Updated weights for policy 1, policy_version 986300 (0.0008) [2023-12-28 02:19:39,912][106226] Updated weights for policy 0, policy_version 983975 (0.0007) [2023-12-28 02:19:39,980][106226] Updated weights for policy 0, policy_version 983985 (0.0010) [2023-12-28 02:19:40,039][106226] Updated weights for policy 0, policy_version 983995 (0.0007) [2023-12-28 02:19:40,550][106225] Updated weights for policy 1, policy_version 986310 (0.0008) [2023-12-28 02:19:40,620][106225] Updated weights for policy 1, policy_version 986320 (0.0005) [2023-12-28 02:19:40,667][106225] Updated weights for policy 1, policy_version 986330 (0.0005) [2023-12-28 02:19:40,827][106226] Updated weights for policy 0, policy_version 984005 (0.0009) [2023-12-28 02:19:40,880][106226] Updated weights for policy 0, policy_version 984015 (0.0008) [2023-12-28 02:19:40,931][106226] Updated weights for policy 0, policy_version 984025 (0.0008) [2023-12-28 02:19:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 504512512. Throughput: 0: 9736.2, 1: 10000.2. Samples: 504482256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:41,175][105115] Avg episode reward: [(0, '-4.448'), (1, '-4.849')] [2023-12-28 02:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000986336_252542976.pth... [2023-12-28 02:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000984032_251969536.pth... [2023-12-28 02:19:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000985184_252248064.pth [2023-12-28 02:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000982912_251682816.pth [2023-12-28 02:19:41,344][106225] Updated weights for policy 1, policy_version 986340 (0.0007) [2023-12-28 02:19:41,423][106225] Updated weights for policy 1, policy_version 986350 (0.0009) [2023-12-28 02:19:41,486][106225] Updated weights for policy 1, policy_version 986360 (0.0008) [2023-12-28 02:19:41,709][106226] Updated weights for policy 0, policy_version 984035 (0.0007) [2023-12-28 02:19:41,782][106226] Updated weights for policy 0, policy_version 984045 (0.0008) [2023-12-28 02:19:41,845][106226] Updated weights for policy 0, policy_version 984055 (0.0009) [2023-12-28 02:19:42,222][106225] Updated weights for policy 1, policy_version 986370 (0.0009) [2023-12-28 02:19:42,278][106225] Updated weights for policy 1, policy_version 986380 (0.0010) [2023-12-28 02:19:42,344][106225] Updated weights for policy 1, policy_version 986390 (0.0010) [2023-12-28 02:19:42,653][106226] Updated weights for policy 0, policy_version 984065 (0.0009) [2023-12-28 02:19:42,714][106226] Updated weights for policy 0, policy_version 984075 (0.0008) [2023-12-28 02:19:42,774][106226] Updated weights for policy 0, policy_version 984085 (0.0007) [2023-12-28 02:19:42,832][106226] Updated weights for policy 0, policy_version 984095 (0.0008) [2023-12-28 02:19:43,046][106225] Updated weights for policy 1, policy_version 986401 (0.0010) [2023-12-28 02:19:43,103][106225] Updated weights for policy 1, policy_version 986411 (0.0010) [2023-12-28 02:19:43,156][106225] Updated weights for policy 1, policy_version 986421 (0.0010) [2023-12-28 02:19:43,212][106225] Updated weights for policy 1, policy_version 986431 (0.0010) [2023-12-28 02:19:43,528][106226] Updated weights for policy 0, policy_version 984105 (0.0009) [2023-12-28 02:19:43,577][106226] Updated weights for policy 0, policy_version 984115 (0.0008) [2023-12-28 02:19:43,627][106226] Updated weights for policy 0, policy_version 984125 (0.0007) [2023-12-28 02:19:43,809][106225] Updated weights for policy 1, policy_version 986441 (0.0010) [2023-12-28 02:19:43,858][106225] Updated weights for policy 1, policy_version 986451 (0.0010) [2023-12-28 02:19:43,911][106225] Updated weights for policy 1, policy_version 986461 (0.0010) [2023-12-28 02:19:44,360][106226] Updated weights for policy 0, policy_version 984135 (0.0009) [2023-12-28 02:19:44,417][106226] Updated weights for policy 0, policy_version 984145 (0.0010) [2023-12-28 02:19:44,474][106226] Updated weights for policy 0, policy_version 984155 (0.0009) [2023-12-28 02:19:44,652][106225] Updated weights for policy 1, policy_version 986471 (0.0009) [2023-12-28 02:19:44,704][106225] Updated weights for policy 1, policy_version 986481 (0.0007) [2023-12-28 02:19:44,787][106225] Updated weights for policy 1, policy_version 986494 (0.0009) [2023-12-28 02:19:45,112][106226] Updated weights for policy 0, policy_version 984165 (0.0009) [2023-12-28 02:19:45,173][106226] Updated weights for policy 0, policy_version 984175 (0.0009) [2023-12-28 02:19:45,258][106226] Updated weights for policy 0, policy_version 984185 (0.0009) [2023-12-28 02:19:45,492][106225] Updated weights for policy 1, policy_version 986504 (0.0006) [2023-12-28 02:19:45,559][106225] Updated weights for policy 1, policy_version 986514 (0.0005) [2023-12-28 02:19:45,616][106225] Updated weights for policy 1, policy_version 986524 (0.0005) [2023-12-28 02:19:45,982][106226] Updated weights for policy 0, policy_version 984195 (0.0008) [2023-12-28 02:19:46,035][106226] Updated weights for policy 0, policy_version 984205 (0.0008) [2023-12-28 02:19:46,081][106226] Updated weights for policy 0, policy_version 984215 (0.0008) [2023-12-28 02:19:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 504610816. Throughput: 0: 9651.4, 1: 9953.6. Samples: 504598092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:46,176][105115] Avg episode reward: [(0, '-4.724'), (1, '-5.176')] [2023-12-28 02:19:46,188][106225] Updated weights for policy 1, policy_version 986534 (0.0007) [2023-12-28 02:19:46,243][106225] Updated weights for policy 1, policy_version 986544 (0.0009) [2023-12-28 02:19:46,295][106225] Updated weights for policy 1, policy_version 986554 (0.0008) [2023-12-28 02:19:46,858][106226] Updated weights for policy 0, policy_version 984225 (0.0009) [2023-12-28 02:19:46,927][106226] Updated weights for policy 0, policy_version 984235 (0.0009) [2023-12-28 02:19:46,963][106225] Updated weights for policy 1, policy_version 986564 (0.0007) [2023-12-28 02:19:46,985][106226] Updated weights for policy 0, policy_version 984245 (0.0009) [2023-12-28 02:19:47,018][106225] Updated weights for policy 1, policy_version 986574 (0.0007) [2023-12-28 02:19:47,044][106226] Updated weights for policy 0, policy_version 984255 (0.0008) [2023-12-28 02:19:47,087][106225] Updated weights for policy 1, policy_version 986584 (0.0009) [2023-12-28 02:19:47,669][106225] Updated weights for policy 1, policy_version 986594 (0.0010) [2023-12-28 02:19:47,727][106225] Updated weights for policy 1, policy_version 986604 (0.0010) [2023-12-28 02:19:47,779][106225] Updated weights for policy 1, policy_version 986614 (0.0010) [2023-12-28 02:19:47,782][106226] Updated weights for policy 0, policy_version 984265 (0.0010) [2023-12-28 02:19:47,832][106225] Updated weights for policy 1, policy_version 986624 (0.0010) [2023-12-28 02:19:47,832][106226] Updated weights for policy 0, policy_version 984275 (0.0010) [2023-12-28 02:19:47,881][106226] Updated weights for policy 0, policy_version 984285 (0.0010) [2023-12-28 02:19:48,563][106225] Updated weights for policy 1, policy_version 986634 (0.0008) [2023-12-28 02:19:48,573][106226] Updated weights for policy 0, policy_version 984295 (0.0007) [2023-12-28 02:19:48,627][106225] Updated weights for policy 1, policy_version 986644 (0.0008) [2023-12-28 02:19:48,630][106226] Updated weights for policy 0, policy_version 984305 (0.0008) [2023-12-28 02:19:48,690][106225] Updated weights for policy 1, policy_version 986654 (0.0008) [2023-12-28 02:19:48,691][106226] Updated weights for policy 0, policy_version 984315 (0.0006) [2023-12-28 02:19:49,320][106226] Updated weights for policy 0, policy_version 984325 (0.0007) [2023-12-28 02:19:49,388][106226] Updated weights for policy 0, policy_version 984335 (0.0009) [2023-12-28 02:19:49,451][106226] Updated weights for policy 0, policy_version 984345 (0.0009) [2023-12-28 02:19:49,490][106225] Updated weights for policy 1, policy_version 986664 (0.0007) [2023-12-28 02:19:49,546][106225] Updated weights for policy 1, policy_version 986674 (0.0008) [2023-12-28 02:19:49,600][106225] Updated weights for policy 1, policy_version 986684 (0.0008) [2023-12-28 02:19:50,263][106226] Updated weights for policy 0, policy_version 984355 (0.0007) [2023-12-28 02:19:50,319][106226] Updated weights for policy 0, policy_version 984365 (0.0008) [2023-12-28 02:19:50,339][106225] Updated weights for policy 1, policy_version 986694 (0.0007) [2023-12-28 02:19:50,381][106226] Updated weights for policy 0, policy_version 984375 (0.0009) [2023-12-28 02:19:50,390][106225] Updated weights for policy 1, policy_version 986704 (0.0007) [2023-12-28 02:19:50,449][106225] Updated weights for policy 1, policy_version 986714 (0.0006) [2023-12-28 02:19:51,077][106226] Updated weights for policy 0, policy_version 984385 (0.0011) [2023-12-28 02:19:51,142][106226] Updated weights for policy 0, policy_version 984395 (0.0008) [2023-12-28 02:19:51,155][106225] Updated weights for policy 1, policy_version 986724 (0.0006) [2023-12-28 02:19:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 504700928. Throughput: 0: 9615.0, 1: 9946.5. Samples: 504716312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:51,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.677')] [2023-12-28 02:19:51,208][106226] Updated weights for policy 0, policy_version 984405 (0.0008) [2023-12-28 02:19:51,219][106225] Updated weights for policy 1, policy_version 986734 (0.0006) [2023-12-28 02:19:51,275][106226] Updated weights for policy 0, policy_version 984415 (0.0009) [2023-12-28 02:19:51,289][106225] Updated weights for policy 1, policy_version 986744 (0.0006) [2023-12-28 02:19:52,007][106226] Updated weights for policy 0, policy_version 984425 (0.0006) [2023-12-28 02:19:52,018][106225] Updated weights for policy 1, policy_version 986754 (0.0007) [2023-12-28 02:19:52,074][106226] Updated weights for policy 0, policy_version 984435 (0.0007) [2023-12-28 02:19:52,083][106225] Updated weights for policy 1, policy_version 986764 (0.0008) [2023-12-28 02:19:52,137][106226] Updated weights for policy 0, policy_version 984445 (0.0008) [2023-12-28 02:19:52,139][106225] Updated weights for policy 1, policy_version 986774 (0.0006) [2023-12-28 02:19:52,198][106225] Updated weights for policy 1, policy_version 986784 (0.0008) [2023-12-28 02:19:52,821][106226] Updated weights for policy 0, policy_version 984455 (0.0008) [2023-12-28 02:19:52,875][106226] Updated weights for policy 0, policy_version 984465 (0.0008) [2023-12-28 02:19:52,923][106226] Updated weights for policy 0, policy_version 984475 (0.0006) [2023-12-28 02:19:52,949][106225] Updated weights for policy 1, policy_version 986794 (0.0007) [2023-12-28 02:19:53,002][106225] Updated weights for policy 1, policy_version 986804 (0.0007) [2023-12-28 02:19:53,064][106225] Updated weights for policy 1, policy_version 986814 (0.0009) [2023-12-28 02:19:53,619][106226] Updated weights for policy 0, policy_version 984485 (0.0007) [2023-12-28 02:19:53,685][106226] Updated weights for policy 0, policy_version 984495 (0.0007) [2023-12-28 02:19:53,717][106225] Updated weights for policy 1, policy_version 986824 (0.0007) [2023-12-28 02:19:53,734][106226] Updated weights for policy 0, policy_version 984505 (0.0005) [2023-12-28 02:19:53,777][106225] Updated weights for policy 1, policy_version 986834 (0.0005) [2023-12-28 02:19:53,844][106225] Updated weights for policy 1, policy_version 986844 (0.0007) [2023-12-28 02:19:54,353][106226] Updated weights for policy 0, policy_version 984515 (0.0006) [2023-12-28 02:19:54,401][106226] Updated weights for policy 0, policy_version 984525 (0.0005) [2023-12-28 02:19:54,454][106226] Updated weights for policy 0, policy_version 984535 (0.0006) [2023-12-28 02:19:54,535][106225] Updated weights for policy 1, policy_version 986854 (0.0008) [2023-12-28 02:19:54,581][106225] Updated weights for policy 1, policy_version 986864 (0.0008) [2023-12-28 02:19:54,638][106225] Updated weights for policy 1, policy_version 986874 (0.0006) [2023-12-28 02:19:55,153][106226] Updated weights for policy 0, policy_version 984545 (0.0005) [2023-12-28 02:19:55,205][106226] Updated weights for policy 0, policy_version 984555 (0.0008) [2023-12-28 02:19:55,260][106226] Updated weights for policy 0, policy_version 984565 (0.0008) [2023-12-28 02:19:55,306][106226] Updated weights for policy 0, policy_version 984575 (0.0008) [2023-12-28 02:19:55,308][106225] Updated weights for policy 1, policy_version 986884 (0.0007) [2023-12-28 02:19:55,363][106225] Updated weights for policy 1, policy_version 986894 (0.0008) [2023-12-28 02:19:55,406][106225] Updated weights for policy 1, policy_version 986904 (0.0008) [2023-12-28 02:19:56,024][106225] Updated weights for policy 1, policy_version 986914 (0.0008) [2023-12-28 02:19:56,077][106225] Updated weights for policy 1, policy_version 986924 (0.0007) [2023-12-28 02:19:56,095][106226] Updated weights for policy 0, policy_version 984585 (0.0007) [2023-12-28 02:19:56,125][106225] Updated weights for policy 1, policy_version 986934 (0.0005) [2023-12-28 02:19:56,141][106226] Updated weights for policy 0, policy_version 984595 (0.0008) [2023-12-28 02:19:56,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 504799232. Throughput: 0: 9632.6, 1: 9969.1. Samples: 504775348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:19:56,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-5.266')] [2023-12-28 02:19:56,178][106225] Updated weights for policy 1, policy_version 986944 (0.0006) [2023-12-28 02:19:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000986944_252698624.pth... [2023-12-28 02:19:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000985760_252395520.pth [2023-12-28 02:19:56,194][106226] Updated weights for policy 0, policy_version 984605 (0.0005) [2023-12-28 02:19:56,209][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000984608_252116992.pth... [2023-12-28 02:19:56,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000983456_251822080.pth [2023-12-28 02:19:56,836][106226] Updated weights for policy 0, policy_version 984615 (0.0009) [2023-12-28 02:19:56,889][106226] Updated weights for policy 0, policy_version 984625 (0.0010) [2023-12-28 02:19:56,890][106225] Updated weights for policy 1, policy_version 986954 (0.0005) [2023-12-28 02:19:56,935][106226] Updated weights for policy 0, policy_version 984635 (0.0010) [2023-12-28 02:19:56,948][106225] Updated weights for policy 1, policy_version 986964 (0.0006) [2023-12-28 02:19:56,997][106225] Updated weights for policy 1, policy_version 986974 (0.0007) [2023-12-28 02:19:57,674][106226] Updated weights for policy 0, policy_version 984645 (0.0010) [2023-12-28 02:19:57,710][106225] Updated weights for policy 1, policy_version 986984 (0.0005) [2023-12-28 02:19:57,727][106226] Updated weights for policy 0, policy_version 984655 (0.0010) [2023-12-28 02:19:57,760][106225] Updated weights for policy 1, policy_version 986994 (0.0005) [2023-12-28 02:19:57,779][106226] Updated weights for policy 0, policy_version 984665 (0.0010) [2023-12-28 02:19:57,818][106225] Updated weights for policy 1, policy_version 987004 (0.0005) [2023-12-28 02:19:58,517][106225] Updated weights for policy 1, policy_version 987014 (0.0007) [2023-12-28 02:19:58,525][106226] Updated weights for policy 0, policy_version 984675 (0.0010) [2023-12-28 02:19:58,580][106225] Updated weights for policy 1, policy_version 987024 (0.0007) [2023-12-28 02:19:58,591][106226] Updated weights for policy 0, policy_version 984685 (0.0008) [2023-12-28 02:19:58,641][106225] Updated weights for policy 1, policy_version 987034 (0.0007) [2023-12-28 02:19:58,657][106226] Updated weights for policy 0, policy_version 984695 (0.0007) [2023-12-28 02:19:59,470][106226] Updated weights for policy 0, policy_version 984705 (0.0010) [2023-12-28 02:19:59,495][106225] Updated weights for policy 1, policy_version 987044 (0.0006) [2023-12-28 02:19:59,531][106226] Updated weights for policy 0, policy_version 984715 (0.0008) [2023-12-28 02:19:59,556][106225] Updated weights for policy 1, policy_version 987054 (0.0006) [2023-12-28 02:19:59,591][106226] Updated weights for policy 0, policy_version 984725 (0.0007) [2023-12-28 02:19:59,614][106225] Updated weights for policy 1, policy_version 987064 (0.0006) [2023-12-28 02:19:59,644][106226] Updated weights for policy 0, policy_version 984735 (0.0006) [2023-12-28 02:20:00,290][106225] Updated weights for policy 1, policy_version 987074 (0.0008) [2023-12-28 02:20:00,300][106226] Updated weights for policy 0, policy_version 984745 (0.0007) [2023-12-28 02:20:00,351][106225] Updated weights for policy 1, policy_version 987084 (0.0010) [2023-12-28 02:20:00,353][106226] Updated weights for policy 0, policy_version 984755 (0.0005) [2023-12-28 02:20:00,405][106226] Updated weights for policy 0, policy_version 984765 (0.0006) [2023-12-28 02:20:00,414][106225] Updated weights for policy 1, policy_version 987094 (0.0010) [2023-12-28 02:20:00,463][106225] Updated weights for policy 1, policy_version 987104 (0.0006) [2023-12-28 02:20:01,142][106225] Updated weights for policy 1, policy_version 987114 (0.0010) [2023-12-28 02:20:01,153][106226] Updated weights for policy 0, policy_version 984775 (0.0007) [2023-12-28 02:20:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 504897536. Throughput: 0: 9744.3, 1: 9990.1. Samples: 504893084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:01,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-5.100')] [2023-12-28 02:20:01,204][106225] Updated weights for policy 1, policy_version 987124 (0.0008) [2023-12-28 02:20:01,213][106226] Updated weights for policy 0, policy_version 984785 (0.0006) [2023-12-28 02:20:01,264][106225] Updated weights for policy 1, policy_version 987134 (0.0008) [2023-12-28 02:20:01,267][106226] Updated weights for policy 0, policy_version 984795 (0.0007) [2023-12-28 02:20:01,906][106226] Updated weights for policy 0, policy_version 984805 (0.0008) [2023-12-28 02:20:01,963][106226] Updated weights for policy 0, policy_version 984815 (0.0009) [2023-12-28 02:20:01,997][106225] Updated weights for policy 1, policy_version 987144 (0.0007) [2023-12-28 02:20:02,022][106226] Updated weights for policy 0, policy_version 984825 (0.0006) [2023-12-28 02:20:02,055][106225] Updated weights for policy 1, policy_version 987154 (0.0007) [2023-12-28 02:20:02,108][106225] Updated weights for policy 1, policy_version 987164 (0.0008) [2023-12-28 02:20:02,745][106226] Updated weights for policy 0, policy_version 984835 (0.0007) [2023-12-28 02:20:02,804][106226] Updated weights for policy 0, policy_version 984845 (0.0008) [2023-12-28 02:20:02,864][106226] Updated weights for policy 0, policy_version 984855 (0.0007) [2023-12-28 02:20:02,866][106225] Updated weights for policy 1, policy_version 987174 (0.0008) [2023-12-28 02:20:02,914][106225] Updated weights for policy 1, policy_version 987184 (0.0006) [2023-12-28 02:20:02,965][106225] Updated weights for policy 1, policy_version 987194 (0.0008) [2023-12-28 02:20:03,485][106226] Updated weights for policy 0, policy_version 984865 (0.0007) [2023-12-28 02:20:03,545][106226] Updated weights for policy 0, policy_version 984875 (0.0008) [2023-12-28 02:20:03,603][106226] Updated weights for policy 0, policy_version 984885 (0.0008) [2023-12-28 02:20:03,661][106226] Updated weights for policy 0, policy_version 984895 (0.0007) [2023-12-28 02:20:03,687][106225] Updated weights for policy 1, policy_version 987204 (0.0008) [2023-12-28 02:20:03,743][106225] Updated weights for policy 1, policy_version 987214 (0.0009) [2023-12-28 02:20:03,791][106225] Updated weights for policy 1, policy_version 987224 (0.0009) [2023-12-28 02:20:04,344][106226] Updated weights for policy 0, policy_version 984905 (0.0010) [2023-12-28 02:20:04,410][106226] Updated weights for policy 0, policy_version 984915 (0.0011) [2023-12-28 02:20:04,466][106226] Updated weights for policy 0, policy_version 984925 (0.0011) [2023-12-28 02:20:04,578][106225] Updated weights for policy 1, policy_version 987234 (0.0008) [2023-12-28 02:20:04,643][106225] Updated weights for policy 1, policy_version 987244 (0.0007) [2023-12-28 02:20:04,696][106225] Updated weights for policy 1, policy_version 987254 (0.0008) [2023-12-28 02:20:04,748][106225] Updated weights for policy 1, policy_version 987264 (0.0009) [2023-12-28 02:20:05,089][106226] Updated weights for policy 0, policy_version 984935 (0.0009) [2023-12-28 02:20:05,162][106226] Updated weights for policy 0, policy_version 984945 (0.0007) [2023-12-28 02:20:05,230][106226] Updated weights for policy 0, policy_version 984955 (0.0008) [2023-12-28 02:20:05,451][106225] Updated weights for policy 1, policy_version 987274 (0.0005) [2023-12-28 02:20:05,510][106225] Updated weights for policy 1, policy_version 987284 (0.0008) [2023-12-28 02:20:05,556][106225] Updated weights for policy 1, policy_version 987294 (0.0008) [2023-12-28 02:20:05,976][106226] Updated weights for policy 0, policy_version 984965 (0.0008) [2023-12-28 02:20:06,038][106226] Updated weights for policy 0, policy_version 984975 (0.0008) [2023-12-28 02:20:06,104][106226] Updated weights for policy 0, policy_version 984985 (0.0008) [2023-12-28 02:20:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 505004032. Throughput: 0: 9723.6, 1: 9981.9. Samples: 505011324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:06,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.723')] [2023-12-28 02:20:06,266][106225] Updated weights for policy 1, policy_version 987304 (0.0006) [2023-12-28 02:20:06,320][106225] Updated weights for policy 1, policy_version 987314 (0.0005) [2023-12-28 02:20:06,373][106225] Updated weights for policy 1, policy_version 987324 (0.0005) [2023-12-28 02:20:06,811][106226] Updated weights for policy 0, policy_version 984995 (0.0008) [2023-12-28 02:20:06,871][106226] Updated weights for policy 0, policy_version 985005 (0.0007) [2023-12-28 02:20:06,928][106226] Updated weights for policy 0, policy_version 985015 (0.0009) [2023-12-28 02:20:07,028][106225] Updated weights for policy 1, policy_version 987334 (0.0006) [2023-12-28 02:20:07,087][106225] Updated weights for policy 1, policy_version 987344 (0.0005) [2023-12-28 02:20:07,157][106225] Updated weights for policy 1, policy_version 987354 (0.0005) [2023-12-28 02:20:07,753][106226] Updated weights for policy 0, policy_version 985025 (0.0008) [2023-12-28 02:20:07,759][106225] Updated weights for policy 1, policy_version 987364 (0.0006) [2023-12-28 02:20:07,817][106225] Updated weights for policy 1, policy_version 987374 (0.0005) [2023-12-28 02:20:07,821][106226] Updated weights for policy 0, policy_version 985035 (0.0008) [2023-12-28 02:20:07,877][106225] Updated weights for policy 1, policy_version 987384 (0.0006) [2023-12-28 02:20:07,886][106226] Updated weights for policy 0, policy_version 985045 (0.0008) [2023-12-28 02:20:07,958][106226] Updated weights for policy 0, policy_version 985055 (0.0009) [2023-12-28 02:20:08,536][106225] Updated weights for policy 1, policy_version 987394 (0.0006) [2023-12-28 02:20:08,602][106225] Updated weights for policy 1, policy_version 987404 (0.0007) [2023-12-28 02:20:08,661][106225] Updated weights for policy 1, policy_version 987414 (0.0007) [2023-12-28 02:20:08,675][106226] Updated weights for policy 0, policy_version 985065 (0.0009) [2023-12-28 02:20:08,715][106225] Updated weights for policy 1, policy_version 987424 (0.0006) [2023-12-28 02:20:08,741][106226] Updated weights for policy 0, policy_version 985075 (0.0009) [2023-12-28 02:20:08,804][106226] Updated weights for policy 0, policy_version 985085 (0.0009) [2023-12-28 02:20:09,455][106226] Updated weights for policy 0, policy_version 985095 (0.0007) [2023-12-28 02:20:09,484][106225] Updated weights for policy 1, policy_version 987434 (0.0009) [2023-12-28 02:20:09,511][106226] Updated weights for policy 0, policy_version 985105 (0.0006) [2023-12-28 02:20:09,546][106225] Updated weights for policy 1, policy_version 987444 (0.0008) [2023-12-28 02:20:09,571][106226] Updated weights for policy 0, policy_version 985115 (0.0009) [2023-12-28 02:20:09,607][106225] Updated weights for policy 1, policy_version 987454 (0.0006) [2023-12-28 02:20:10,257][106226] Updated weights for policy 0, policy_version 985125 (0.0007) [2023-12-28 02:20:10,327][106226] Updated weights for policy 0, policy_version 985135 (0.0009) [2023-12-28 02:20:10,369][106225] Updated weights for policy 1, policy_version 987464 (0.0007) [2023-12-28 02:20:10,389][106226] Updated weights for policy 0, policy_version 985145 (0.0008) [2023-12-28 02:20:10,434][106225] Updated weights for policy 1, policy_version 987474 (0.0006) [2023-12-28 02:20:10,497][106225] Updated weights for policy 1, policy_version 987484 (0.0007) [2023-12-28 02:20:11,103][106225] Updated weights for policy 1, policy_version 987494 (0.0009) [2023-12-28 02:20:11,146][106226] Updated weights for policy 0, policy_version 985155 (0.0008) [2023-12-28 02:20:11,171][106225] Updated weights for policy 1, policy_version 987504 (0.0008) [2023-12-28 02:20:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 505094144. Throughput: 0: 9745.5, 1: 10038.9. Samples: 505071164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:11,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-4.898')] [2023-12-28 02:20:11,211][106226] Updated weights for policy 0, policy_version 985165 (0.0007) [2023-12-28 02:20:11,230][106225] Updated weights for policy 1, policy_version 987514 (0.0007) [2023-12-28 02:20:11,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000987520_252846080.pth... [2023-12-28 02:20:11,272][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000986336_252542976.pth [2023-12-28 02:20:11,273][106226] Updated weights for policy 0, policy_version 985175 (0.0008) [2023-12-28 02:20:11,329][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000985184_252264448.pth... [2023-12-28 02:20:11,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000984032_251969536.pth [2023-12-28 02:20:11,993][106225] Updated weights for policy 1, policy_version 987524 (0.0007) [2023-12-28 02:20:12,055][106225] Updated weights for policy 1, policy_version 987534 (0.0009) [2023-12-28 02:20:12,060][106226] Updated weights for policy 0, policy_version 985185 (0.0009) [2023-12-28 02:20:12,120][106226] Updated weights for policy 0, policy_version 985195 (0.0009) [2023-12-28 02:20:12,123][106225] Updated weights for policy 1, policy_version 987544 (0.0008) [2023-12-28 02:20:12,176][106226] Updated weights for policy 0, policy_version 985205 (0.0006) [2023-12-28 02:20:12,241][106226] Updated weights for policy 0, policy_version 985215 (0.0008) [2023-12-28 02:20:12,882][106225] Updated weights for policy 1, policy_version 987554 (0.0007) [2023-12-28 02:20:12,936][106225] Updated weights for policy 1, policy_version 987564 (0.0009) [2023-12-28 02:20:12,962][106226] Updated weights for policy 0, policy_version 985225 (0.0008) [2023-12-28 02:20:12,988][106225] Updated weights for policy 1, policy_version 987574 (0.0007) [2023-12-28 02:20:13,013][106226] Updated weights for policy 0, policy_version 985235 (0.0007) [2023-12-28 02:20:13,039][106225] Updated weights for policy 1, policy_version 987584 (0.0005) [2023-12-28 02:20:13,065][106226] Updated weights for policy 0, policy_version 985245 (0.0006) [2023-12-28 02:20:13,638][106226] Updated weights for policy 0, policy_version 985255 (0.0007) [2023-12-28 02:20:13,691][106226] Updated weights for policy 0, policy_version 985265 (0.0008) [2023-12-28 02:20:13,748][106226] Updated weights for policy 0, policy_version 985275 (0.0007) [2023-12-28 02:20:13,752][106225] Updated weights for policy 1, policy_version 987594 (0.0006) [2023-12-28 02:20:13,806][106225] Updated weights for policy 1, policy_version 987604 (0.0007) [2023-12-28 02:20:13,860][106225] Updated weights for policy 1, policy_version 987614 (0.0006) [2023-12-28 02:20:14,387][106226] Updated weights for policy 0, policy_version 985285 (0.0008) [2023-12-28 02:20:14,448][106226] Updated weights for policy 0, policy_version 985295 (0.0008) [2023-12-28 02:20:14,509][106226] Updated weights for policy 0, policy_version 985305 (0.0008) [2023-12-28 02:20:14,563][106225] Updated weights for policy 1, policy_version 987624 (0.0007) [2023-12-28 02:20:14,616][106225] Updated weights for policy 1, policy_version 987634 (0.0010) [2023-12-28 02:20:14,667][106225] Updated weights for policy 1, policy_version 987644 (0.0008) [2023-12-28 02:20:15,277][106226] Updated weights for policy 0, policy_version 985315 (0.0009) [2023-12-28 02:20:15,311][106225] Updated weights for policy 1, policy_version 987654 (0.0005) [2023-12-28 02:20:15,334][106226] Updated weights for policy 0, policy_version 985325 (0.0008) [2023-12-28 02:20:15,373][106225] Updated weights for policy 1, policy_version 987664 (0.0007) [2023-12-28 02:20:15,398][106226] Updated weights for policy 0, policy_version 985335 (0.0007) [2023-12-28 02:20:15,431][106225] Updated weights for policy 1, policy_version 987674 (0.0010) [2023-12-28 02:20:15,951][106225] Updated weights for policy 1, policy_version 987684 (0.0006) [2023-12-28 02:20:16,007][106225] Updated weights for policy 1, policy_version 987694 (0.0005) [2023-12-28 02:20:16,052][106225] Updated weights for policy 1, policy_version 987704 (0.0005) [2023-12-28 02:20:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 505200640. Throughput: 0: 9718.8, 1: 9889.0. Samples: 505188116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:16,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-5.285')] [2023-12-28 02:20:16,223][106226] Updated weights for policy 0, policy_version 985345 (0.0006) [2023-12-28 02:20:16,281][106226] Updated weights for policy 0, policy_version 985355 (0.0010) [2023-12-28 02:20:16,339][106226] Updated weights for policy 0, policy_version 985365 (0.0010) [2023-12-28 02:20:16,390][106226] Updated weights for policy 0, policy_version 985375 (0.0008) [2023-12-28 02:20:16,639][106225] Updated weights for policy 1, policy_version 987714 (0.0005) [2023-12-28 02:20:16,692][106225] Updated weights for policy 1, policy_version 987724 (0.0005) [2023-12-28 02:20:16,752][106225] Updated weights for policy 1, policy_version 987734 (0.0005) [2023-12-28 02:20:16,812][106225] Updated weights for policy 1, policy_version 987744 (0.0005) [2023-12-28 02:20:17,186][106226] Updated weights for policy 0, policy_version 985385 (0.0008) [2023-12-28 02:20:17,240][106226] Updated weights for policy 0, policy_version 985395 (0.0007) [2023-12-28 02:20:17,291][106226] Updated weights for policy 0, policy_version 985405 (0.0008) [2023-12-28 02:20:17,428][106225] Updated weights for policy 1, policy_version 987754 (0.0010) [2023-12-28 02:20:17,477][106225] Updated weights for policy 1, policy_version 987764 (0.0007) [2023-12-28 02:20:17,536][106225] Updated weights for policy 1, policy_version 987774 (0.0005) [2023-12-28 02:20:18,064][106226] Updated weights for policy 0, policy_version 985415 (0.0009) [2023-12-28 02:20:18,112][106225] Updated weights for policy 1, policy_version 987784 (0.0007) [2023-12-28 02:20:18,124][106226] Updated weights for policy 0, policy_version 985425 (0.0008) [2023-12-28 02:20:18,162][106225] Updated weights for policy 1, policy_version 987794 (0.0006) [2023-12-28 02:20:18,183][106226] Updated weights for policy 0, policy_version 985435 (0.0007) [2023-12-28 02:20:18,225][106225] Updated weights for policy 1, policy_version 987804 (0.0006) [2023-12-28 02:20:18,888][106226] Updated weights for policy 0, policy_version 985445 (0.0007) [2023-12-28 02:20:18,939][106225] Updated weights for policy 1, policy_version 987814 (0.0006) [2023-12-28 02:20:18,954][106226] Updated weights for policy 0, policy_version 985455 (0.0006) [2023-12-28 02:20:18,994][106225] Updated weights for policy 1, policy_version 987824 (0.0007) [2023-12-28 02:20:19,011][106226] Updated weights for policy 0, policy_version 985465 (0.0011) [2023-12-28 02:20:19,048][106225] Updated weights for policy 1, policy_version 987834 (0.0005) [2023-12-28 02:20:19,755][106226] Updated weights for policy 0, policy_version 985475 (0.0009) [2023-12-28 02:20:19,768][106225] Updated weights for policy 1, policy_version 987844 (0.0008) [2023-12-28 02:20:19,815][106226] Updated weights for policy 0, policy_version 985485 (0.0006) [2023-12-28 02:20:19,826][106225] Updated weights for policy 1, policy_version 987854 (0.0006) [2023-12-28 02:20:19,878][106226] Updated weights for policy 0, policy_version 985495 (0.0008) [2023-12-28 02:20:19,879][106225] Updated weights for policy 1, policy_version 987864 (0.0009) [2023-12-28 02:20:20,631][106226] Updated weights for policy 0, policy_version 985505 (0.0007) [2023-12-28 02:20:20,695][106225] Updated weights for policy 1, policy_version 987874 (0.0009) [2023-12-28 02:20:20,696][106226] Updated weights for policy 0, policy_version 985515 (0.0009) [2023-12-28 02:20:20,759][106226] Updated weights for policy 0, policy_version 985525 (0.0007) [2023-12-28 02:20:20,761][106225] Updated weights for policy 1, policy_version 987884 (0.0006) [2023-12-28 02:20:20,826][106226] Updated weights for policy 0, policy_version 985535 (0.0008) [2023-12-28 02:20:20,827][106225] Updated weights for policy 1, policy_version 987894 (0.0008) [2023-12-28 02:20:20,892][106225] Updated weights for policy 1, policy_version 987904 (0.0008) [2023-12-28 02:20:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 505298944. Throughput: 0: 9586.7, 1: 9995.7. Samples: 505306564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:21,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.092')] [2023-12-28 02:20:21,636][106226] Updated weights for policy 0, policy_version 985545 (0.0009) [2023-12-28 02:20:21,697][106226] Updated weights for policy 0, policy_version 985555 (0.0007) [2023-12-28 02:20:21,759][106225] Updated weights for policy 1, policy_version 987914 (0.0008) [2023-12-28 02:20:21,766][106226] Updated weights for policy 0, policy_version 985565 (0.0008) [2023-12-28 02:20:21,816][106225] Updated weights for policy 1, policy_version 987924 (0.0008) [2023-12-28 02:20:21,878][106225] Updated weights for policy 1, policy_version 987934 (0.0008) [2023-12-28 02:20:22,514][106226] Updated weights for policy 0, policy_version 985575 (0.0007) [2023-12-28 02:20:22,582][106226] Updated weights for policy 0, policy_version 985585 (0.0008) [2023-12-28 02:20:22,626][106225] Updated weights for policy 1, policy_version 987944 (0.0008) [2023-12-28 02:20:22,651][106226] Updated weights for policy 0, policy_version 985595 (0.0007) [2023-12-28 02:20:22,688][106225] Updated weights for policy 1, policy_version 987954 (0.0007) [2023-12-28 02:20:22,741][106225] Updated weights for policy 1, policy_version 987964 (0.0005) [2023-12-28 02:20:23,275][106226] Updated weights for policy 0, policy_version 985605 (0.0007) [2023-12-28 02:20:23,327][106226] Updated weights for policy 0, policy_version 985615 (0.0007) [2023-12-28 02:20:23,374][106226] Updated weights for policy 0, policy_version 985625 (0.0007) [2023-12-28 02:20:23,395][106225] Updated weights for policy 1, policy_version 987974 (0.0006) [2023-12-28 02:20:23,459][106225] Updated weights for policy 1, policy_version 987984 (0.0007) [2023-12-28 02:20:23,518][106225] Updated weights for policy 1, policy_version 987994 (0.0008) [2023-12-28 02:20:24,101][106226] Updated weights for policy 0, policy_version 985635 (0.0008) [2023-12-28 02:20:24,106][106225] Updated weights for policy 1, policy_version 988004 (0.0009) [2023-12-28 02:20:24,155][106225] Updated weights for policy 1, policy_version 988014 (0.0009) [2023-12-28 02:20:24,157][106226] Updated weights for policy 0, policy_version 985645 (0.0007) [2023-12-28 02:20:24,211][106225] Updated weights for policy 1, policy_version 988024 (0.0010) [2023-12-28 02:20:24,221][106226] Updated weights for policy 0, policy_version 985655 (0.0006) [2023-12-28 02:20:24,915][106226] Updated weights for policy 0, policy_version 985665 (0.0007) [2023-12-28 02:20:24,958][106225] Updated weights for policy 1, policy_version 988034 (0.0010) [2023-12-28 02:20:24,968][106226] Updated weights for policy 0, policy_version 985675 (0.0007) [2023-12-28 02:20:25,012][106225] Updated weights for policy 1, policy_version 988044 (0.0010) [2023-12-28 02:20:25,019][106226] Updated weights for policy 0, policy_version 985685 (0.0005) [2023-12-28 02:20:25,055][106225] Updated weights for policy 1, policy_version 988054 (0.0010) [2023-12-28 02:20:25,067][106226] Updated weights for policy 0, policy_version 985695 (0.0005) [2023-12-28 02:20:25,118][106225] Updated weights for policy 1, policy_version 988064 (0.0010) [2023-12-28 02:20:25,728][106226] Updated weights for policy 0, policy_version 985705 (0.0010) [2023-12-28 02:20:25,784][106226] Updated weights for policy 0, policy_version 985715 (0.0010) [2023-12-28 02:20:25,819][106225] Updated weights for policy 1, policy_version 988074 (0.0010) [2023-12-28 02:20:25,841][106226] Updated weights for policy 0, policy_version 985725 (0.0010) [2023-12-28 02:20:25,871][106225] Updated weights for policy 1, policy_version 988084 (0.0010) [2023-12-28 02:20:25,936][106225] Updated weights for policy 1, policy_version 988094 (0.0010) [2023-12-28 02:20:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 505397248. Throughput: 0: 9627.0, 1: 9942.3. Samples: 505362876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:26,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.787')] [2023-12-28 02:20:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000988096_252993536.pth... [2023-12-28 02:20:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000985728_252403712.pth... [2023-12-28 02:20:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000986944_252698624.pth [2023-12-28 02:20:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000984608_252116992.pth [2023-12-28 02:20:26,501][106226] Updated weights for policy 0, policy_version 985735 (0.0011) [2023-12-28 02:20:26,521][106225] Updated weights for policy 1, policy_version 988104 (0.0006) [2023-12-28 02:20:26,558][106226] Updated weights for policy 0, policy_version 985745 (0.0010) [2023-12-28 02:20:26,572][106225] Updated weights for policy 1, policy_version 988114 (0.0007) [2023-12-28 02:20:26,603][106226] Updated weights for policy 0, policy_version 985755 (0.0010) [2023-12-28 02:20:26,627][106225] Updated weights for policy 1, policy_version 988124 (0.0006) [2023-12-28 02:20:27,146][106226] Updated weights for policy 0, policy_version 985765 (0.0005) [2023-12-28 02:20:27,194][106226] Updated weights for policy 0, policy_version 985775 (0.0005) [2023-12-28 02:20:27,243][106226] Updated weights for policy 0, policy_version 985785 (0.0008) [2023-12-28 02:20:27,317][106225] Updated weights for policy 1, policy_version 988134 (0.0007) [2023-12-28 02:20:27,373][106225] Updated weights for policy 1, policy_version 988144 (0.0005) [2023-12-28 02:20:27,431][106225] Updated weights for policy 1, policy_version 988154 (0.0005) [2023-12-28 02:20:27,925][106226] Updated weights for policy 0, policy_version 985795 (0.0010) [2023-12-28 02:20:27,991][106226] Updated weights for policy 0, policy_version 985805 (0.0010) [2023-12-28 02:20:28,011][106225] Updated weights for policy 1, policy_version 988164 (0.0005) [2023-12-28 02:20:28,046][106226] Updated weights for policy 0, policy_version 985815 (0.0010) [2023-12-28 02:20:28,064][106225] Updated weights for policy 1, policy_version 988174 (0.0005) [2023-12-28 02:20:28,122][106225] Updated weights for policy 1, policy_version 988184 (0.0008) [2023-12-28 02:20:28,711][106226] Updated weights for policy 0, policy_version 985825 (0.0010) [2023-12-28 02:20:28,751][106225] Updated weights for policy 1, policy_version 988194 (0.0008) [2023-12-28 02:20:28,758][106226] Updated weights for policy 0, policy_version 985835 (0.0010) [2023-12-28 02:20:28,799][106225] Updated weights for policy 1, policy_version 988204 (0.0005) [2023-12-28 02:20:28,811][106226] Updated weights for policy 0, policy_version 985845 (0.0010) [2023-12-28 02:20:28,847][106225] Updated weights for policy 1, policy_version 988214 (0.0007) [2023-12-28 02:20:28,861][106226] Updated weights for policy 0, policy_version 985855 (0.0008) [2023-12-28 02:20:28,901][106225] Updated weights for policy 1, policy_version 988224 (0.0008) [2023-12-28 02:20:29,641][106225] Updated weights for policy 1, policy_version 988234 (0.0008) [2023-12-28 02:20:29,646][106226] Updated weights for policy 0, policy_version 985865 (0.0008) [2023-12-28 02:20:29,697][106226] Updated weights for policy 0, policy_version 985875 (0.0007) [2023-12-28 02:20:29,699][106225] Updated weights for policy 1, policy_version 988244 (0.0006) [2023-12-28 02:20:29,750][106225] Updated weights for policy 1, policy_version 988254 (0.0005) [2023-12-28 02:20:29,756][106226] Updated weights for policy 0, policy_version 985885 (0.0008) [2023-12-28 02:20:30,422][106226] Updated weights for policy 0, policy_version 985895 (0.0009) [2023-12-28 02:20:30,478][106226] Updated weights for policy 0, policy_version 985905 (0.0008) [2023-12-28 02:20:30,484][106225] Updated weights for policy 1, policy_version 988264 (0.0006) [2023-12-28 02:20:30,531][106226] Updated weights for policy 0, policy_version 985915 (0.0005) [2023-12-28 02:20:30,539][106225] Updated weights for policy 1, policy_version 988274 (0.0008) [2023-12-28 02:20:30,599][106225] Updated weights for policy 1, policy_version 988284 (0.0010) [2023-12-28 02:20:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 505495552. Throughput: 0: 9758.2, 1: 10025.2. Samples: 505488340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:31,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-5.095')] [2023-12-28 02:20:31,217][106226] Updated weights for policy 0, policy_version 985925 (0.0007) [2023-12-28 02:20:31,282][106226] Updated weights for policy 0, policy_version 985935 (0.0008) [2023-12-28 02:20:31,329][106226] Updated weights for policy 0, policy_version 985945 (0.0008) [2023-12-28 02:20:31,362][106225] Updated weights for policy 1, policy_version 988294 (0.0008) [2023-12-28 02:20:31,423][106225] Updated weights for policy 1, policy_version 988304 (0.0008) [2023-12-28 02:20:31,481][106225] Updated weights for policy 1, policy_version 988314 (0.0008) [2023-12-28 02:20:32,161][106226] Updated weights for policy 0, policy_version 985955 (0.0009) [2023-12-28 02:20:32,205][106225] Updated weights for policy 1, policy_version 988324 (0.0007) [2023-12-28 02:20:32,227][106226] Updated weights for policy 0, policy_version 985965 (0.0009) [2023-12-28 02:20:32,260][106225] Updated weights for policy 1, policy_version 988334 (0.0007) [2023-12-28 02:20:32,288][106226] Updated weights for policy 0, policy_version 985975 (0.0007) [2023-12-28 02:20:32,320][106225] Updated weights for policy 1, policy_version 988344 (0.0006) [2023-12-28 02:20:32,985][106226] Updated weights for policy 0, policy_version 985985 (0.0007) [2023-12-28 02:20:33,038][106226] Updated weights for policy 0, policy_version 985995 (0.0005) [2023-12-28 02:20:33,053][106225] Updated weights for policy 1, policy_version 988354 (0.0007) [2023-12-28 02:20:33,088][106226] Updated weights for policy 0, policy_version 986005 (0.0005) [2023-12-28 02:20:33,112][106225] Updated weights for policy 1, policy_version 988364 (0.0008) [2023-12-28 02:20:33,137][106226] Updated weights for policy 0, policy_version 986015 (0.0005) [2023-12-28 02:20:33,161][106225] Updated weights for policy 1, policy_version 988374 (0.0009) [2023-12-28 02:20:33,209][106225] Updated weights for policy 1, policy_version 988384 (0.0009) [2023-12-28 02:20:33,662][106226] Updated weights for policy 0, policy_version 986025 (0.0006) [2023-12-28 02:20:33,710][106226] Updated weights for policy 0, policy_version 986035 (0.0005) [2023-12-28 02:20:33,766][106226] Updated weights for policy 0, policy_version 986045 (0.0005) [2023-12-28 02:20:33,937][106225] Updated weights for policy 1, policy_version 988394 (0.0008) [2023-12-28 02:20:33,981][106225] Updated weights for policy 1, policy_version 988404 (0.0008) [2023-12-28 02:20:34,024][106225] Updated weights for policy 1, policy_version 988414 (0.0008) [2023-12-28 02:20:34,429][106226] Updated weights for policy 0, policy_version 986055 (0.0008) [2023-12-28 02:20:34,490][106226] Updated weights for policy 0, policy_version 986065 (0.0009) [2023-12-28 02:20:34,552][106226] Updated weights for policy 0, policy_version 986075 (0.0009) [2023-12-28 02:20:34,741][106225] Updated weights for policy 1, policy_version 988424 (0.0008) [2023-12-28 02:20:34,806][106225] Updated weights for policy 1, policy_version 988434 (0.0008) [2023-12-28 02:20:34,865][106225] Updated weights for policy 1, policy_version 988444 (0.0008) [2023-12-28 02:20:35,269][106226] Updated weights for policy 0, policy_version 986085 (0.0009) [2023-12-28 02:20:35,327][106226] Updated weights for policy 0, policy_version 986095 (0.0009) [2023-12-28 02:20:35,382][106226] Updated weights for policy 0, policy_version 986105 (0.0009) [2023-12-28 02:20:35,555][106225] Updated weights for policy 1, policy_version 988454 (0.0008) [2023-12-28 02:20:35,616][106225] Updated weights for policy 1, policy_version 988464 (0.0007) [2023-12-28 02:20:35,665][106225] Updated weights for policy 1, policy_version 988474 (0.0008) [2023-12-28 02:20:36,087][106226] Updated weights for policy 0, policy_version 986115 (0.0010) [2023-12-28 02:20:36,156][106226] Updated weights for policy 0, policy_version 986125 (0.0009) [2023-12-28 02:20:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 505593856. Throughput: 0: 9841.8, 1: 9956.6. Samples: 505607240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:36,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.873')] [2023-12-28 02:20:36,216][106226] Updated weights for policy 0, policy_version 986135 (0.0006) [2023-12-28 02:20:36,431][106225] Updated weights for policy 1, policy_version 988484 (0.0009) [2023-12-28 02:20:36,495][106225] Updated weights for policy 1, policy_version 988494 (0.0009) [2023-12-28 02:20:36,553][106225] Updated weights for policy 1, policy_version 988504 (0.0010) [2023-12-28 02:20:36,851][106226] Updated weights for policy 0, policy_version 986145 (0.0008) [2023-12-28 02:20:36,918][106226] Updated weights for policy 0, policy_version 986155 (0.0008) [2023-12-28 02:20:36,988][106226] Updated weights for policy 0, policy_version 986165 (0.0008) [2023-12-28 02:20:37,055][106226] Updated weights for policy 0, policy_version 986175 (0.0008) [2023-12-28 02:20:37,277][106225] Updated weights for policy 1, policy_version 988514 (0.0008) [2023-12-28 02:20:37,331][106225] Updated weights for policy 1, policy_version 988524 (0.0005) [2023-12-28 02:20:37,385][106225] Updated weights for policy 1, policy_version 988534 (0.0007) [2023-12-28 02:20:37,459][106225] Updated weights for policy 1, policy_version 988544 (0.0008) [2023-12-28 02:20:37,757][106226] Updated weights for policy 0, policy_version 986185 (0.0008) [2023-12-28 02:20:37,815][106226] Updated weights for policy 0, policy_version 986195 (0.0008) [2023-12-28 02:20:37,875][106226] Updated weights for policy 0, policy_version 986205 (0.0009) [2023-12-28 02:20:38,127][106225] Updated weights for policy 1, policy_version 988554 (0.0009) [2023-12-28 02:20:38,184][106225] Updated weights for policy 1, policy_version 988564 (0.0005) [2023-12-28 02:20:38,253][106225] Updated weights for policy 1, policy_version 988574 (0.0010) [2023-12-28 02:20:38,559][106226] Updated weights for policy 0, policy_version 986215 (0.0008) [2023-12-28 02:20:38,614][106226] Updated weights for policy 0, policy_version 986225 (0.0008) [2023-12-28 02:20:38,672][106226] Updated weights for policy 0, policy_version 986235 (0.0008) [2023-12-28 02:20:38,969][106225] Updated weights for policy 1, policy_version 988584 (0.0010) [2023-12-28 02:20:39,035][106225] Updated weights for policy 1, policy_version 988594 (0.0006) [2023-12-28 02:20:39,093][106225] Updated weights for policy 1, policy_version 988604 (0.0005) [2023-12-28 02:20:39,378][106226] Updated weights for policy 0, policy_version 986245 (0.0008) [2023-12-28 02:20:39,446][106226] Updated weights for policy 0, policy_version 986255 (0.0008) [2023-12-28 02:20:39,511][106226] Updated weights for policy 0, policy_version 986265 (0.0008) [2023-12-28 02:20:39,739][106225] Updated weights for policy 1, policy_version 988614 (0.0008) [2023-12-28 02:20:39,798][106225] Updated weights for policy 1, policy_version 988624 (0.0010) [2023-12-28 02:20:39,860][106225] Updated weights for policy 1, policy_version 988634 (0.0010) [2023-12-28 02:20:40,222][106226] Updated weights for policy 0, policy_version 986275 (0.0009) [2023-12-28 02:20:40,289][106226] Updated weights for policy 0, policy_version 986285 (0.0009) [2023-12-28 02:20:40,354][106226] Updated weights for policy 0, policy_version 986295 (0.0008) [2023-12-28 02:20:40,656][106225] Updated weights for policy 1, policy_version 988644 (0.0008) [2023-12-28 02:20:40,710][106225] Updated weights for policy 1, policy_version 988654 (0.0006) [2023-12-28 02:20:40,768][106225] Updated weights for policy 1, policy_version 988664 (0.0006) [2023-12-28 02:20:40,976][106226] Updated weights for policy 0, policy_version 986305 (0.0006) [2023-12-28 02:20:41,038][106226] Updated weights for policy 0, policy_version 986315 (0.0009) [2023-12-28 02:20:41,116][106226] Updated weights for policy 0, policy_version 986325 (0.0008) [2023-12-28 02:20:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 505692160. Throughput: 0: 9848.8, 1: 9956.3. Samples: 505666580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:41,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-4.961')] [2023-12-28 02:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000988672_253140992.pth... [2023-12-28 02:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000987520_252846080.pth [2023-12-28 02:20:41,186][106226] Updated weights for policy 0, policy_version 986335 (0.0008) [2023-12-28 02:20:41,193][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000986336_252559360.pth... [2023-12-28 02:20:41,197][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000985184_252264448.pth [2023-12-28 02:20:41,528][106225] Updated weights for policy 1, policy_version 988674 (0.0006) [2023-12-28 02:20:41,593][106225] Updated weights for policy 1, policy_version 988684 (0.0008) [2023-12-28 02:20:41,663][106225] Updated weights for policy 1, policy_version 988694 (0.0010) [2023-12-28 02:20:41,720][106225] Updated weights for policy 1, policy_version 988704 (0.0008) [2023-12-28 02:20:41,968][106226] Updated weights for policy 0, policy_version 986345 (0.0009) [2023-12-28 02:20:42,024][106226] Updated weights for policy 0, policy_version 986355 (0.0007) [2023-12-28 02:20:42,091][106226] Updated weights for policy 0, policy_version 986365 (0.0008) [2023-12-28 02:20:42,479][106225] Updated weights for policy 1, policy_version 988714 (0.0007) [2023-12-28 02:20:42,546][106225] Updated weights for policy 1, policy_version 988724 (0.0008) [2023-12-28 02:20:42,606][106225] Updated weights for policy 1, policy_version 988734 (0.0008) [2023-12-28 02:20:42,874][106226] Updated weights for policy 0, policy_version 986375 (0.0009) [2023-12-28 02:20:42,922][106226] Updated weights for policy 0, policy_version 986385 (0.0009) [2023-12-28 02:20:42,971][106226] Updated weights for policy 0, policy_version 986395 (0.0007) [2023-12-28 02:20:43,219][106225] Updated weights for policy 1, policy_version 988744 (0.0006) [2023-12-28 02:20:43,264][106225] Updated weights for policy 1, policy_version 988754 (0.0005) [2023-12-28 02:20:43,312][106225] Updated weights for policy 1, policy_version 988764 (0.0006) [2023-12-28 02:20:43,776][106226] Updated weights for policy 0, policy_version 986405 (0.0009) [2023-12-28 02:20:43,830][106226] Updated weights for policy 0, policy_version 986415 (0.0008) [2023-12-28 02:20:43,880][106226] Updated weights for policy 0, policy_version 986425 (0.0009) [2023-12-28 02:20:43,928][106225] Updated weights for policy 1, policy_version 988774 (0.0007) [2023-12-28 02:20:43,978][106225] Updated weights for policy 1, policy_version 988784 (0.0005) [2023-12-28 02:20:44,040][106225] Updated weights for policy 1, policy_version 988794 (0.0007) [2023-12-28 02:20:44,580][106226] Updated weights for policy 0, policy_version 986435 (0.0008) [2023-12-28 02:20:44,622][106225] Updated weights for policy 1, policy_version 988804 (0.0007) [2023-12-28 02:20:44,640][106226] Updated weights for policy 0, policy_version 986445 (0.0007) [2023-12-28 02:20:44,673][106225] Updated weights for policy 1, policy_version 988814 (0.0007) [2023-12-28 02:20:44,705][106226] Updated weights for policy 0, policy_version 986455 (0.0007) [2023-12-28 02:20:44,718][106225] Updated weights for policy 1, policy_version 988824 (0.0008) [2023-12-28 02:20:45,422][106225] Updated weights for policy 1, policy_version 988834 (0.0007) [2023-12-28 02:20:45,486][106225] Updated weights for policy 1, policy_version 988844 (0.0010) [2023-12-28 02:20:45,494][106226] Updated weights for policy 0, policy_version 986465 (0.0008) [2023-12-28 02:20:45,542][106225] Updated weights for policy 1, policy_version 988854 (0.0010) [2023-12-28 02:20:45,556][106226] Updated weights for policy 0, policy_version 986475 (0.0006) [2023-12-28 02:20:45,600][106225] Updated weights for policy 1, policy_version 988864 (0.0010) [2023-12-28 02:20:45,616][106226] Updated weights for policy 0, policy_version 986485 (0.0005) [2023-12-28 02:20:45,681][106226] Updated weights for policy 0, policy_version 986495 (0.0006) [2023-12-28 02:20:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 505790464. Throughput: 0: 9789.5, 1: 9978.9. Samples: 505782660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:46,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-5.154')] [2023-12-28 02:20:46,244][106226] Updated weights for policy 0, policy_version 986505 (0.0006) [2023-12-28 02:20:46,280][106225] Updated weights for policy 1, policy_version 988874 (0.0009) [2023-12-28 02:20:46,299][106226] Updated weights for policy 0, policy_version 986515 (0.0005) [2023-12-28 02:20:46,340][106225] Updated weights for policy 1, policy_version 988884 (0.0010) [2023-12-28 02:20:46,359][106226] Updated weights for policy 0, policy_version 986525 (0.0005) [2023-12-28 02:20:46,396][106225] Updated weights for policy 1, policy_version 988894 (0.0010) [2023-12-28 02:20:46,943][106225] Updated weights for policy 1, policy_version 988904 (0.0006) [2023-12-28 02:20:46,957][106226] Updated weights for policy 0, policy_version 986535 (0.0007) [2023-12-28 02:20:47,000][106225] Updated weights for policy 1, policy_version 988914 (0.0005) [2023-12-28 02:20:47,013][106226] Updated weights for policy 0, policy_version 986545 (0.0008) [2023-12-28 02:20:47,057][106225] Updated weights for policy 1, policy_version 988924 (0.0005) [2023-12-28 02:20:47,066][106226] Updated weights for policy 0, policy_version 986555 (0.0008) [2023-12-28 02:20:47,629][106225] Updated weights for policy 1, policy_version 988934 (0.0008) [2023-12-28 02:20:47,679][106225] Updated weights for policy 1, policy_version 988944 (0.0010) [2023-12-28 02:20:47,734][106225] Updated weights for policy 1, policy_version 988954 (0.0010) [2023-12-28 02:20:47,834][106226] Updated weights for policy 0, policy_version 986565 (0.0008) [2023-12-28 02:20:47,892][106226] Updated weights for policy 0, policy_version 986575 (0.0008) [2023-12-28 02:20:47,939][106226] Updated weights for policy 0, policy_version 986585 (0.0007) [2023-12-28 02:20:48,434][106225] Updated weights for policy 1, policy_version 988964 (0.0008) [2023-12-28 02:20:48,482][106225] Updated weights for policy 1, policy_version 988974 (0.0007) [2023-12-28 02:20:48,530][106225] Updated weights for policy 1, policy_version 988984 (0.0010) [2023-12-28 02:20:48,735][106226] Updated weights for policy 0, policy_version 986595 (0.0008) [2023-12-28 02:20:48,797][106226] Updated weights for policy 0, policy_version 986605 (0.0008) [2023-12-28 02:20:48,852][106226] Updated weights for policy 0, policy_version 986615 (0.0008) [2023-12-28 02:20:49,260][106225] Updated weights for policy 1, policy_version 988994 (0.0010) [2023-12-28 02:20:49,321][106225] Updated weights for policy 1, policy_version 989004 (0.0007) [2023-12-28 02:20:49,387][106225] Updated weights for policy 1, policy_version 989014 (0.0008) [2023-12-28 02:20:49,437][106225] Updated weights for policy 1, policy_version 989024 (0.0008) [2023-12-28 02:20:49,602][106226] Updated weights for policy 0, policy_version 986625 (0.0009) [2023-12-28 02:20:49,673][106226] Updated weights for policy 0, policy_version 986635 (0.0010) [2023-12-28 02:20:49,725][106226] Updated weights for policy 0, policy_version 986645 (0.0009) [2023-12-28 02:20:49,774][106226] Updated weights for policy 0, policy_version 986655 (0.0009) [2023-12-28 02:20:50,144][106225] Updated weights for policy 1, policy_version 989034 (0.0009) [2023-12-28 02:20:50,203][106225] Updated weights for policy 1, policy_version 989044 (0.0009) [2023-12-28 02:20:50,256][106225] Updated weights for policy 1, policy_version 989054 (0.0009) [2023-12-28 02:20:50,546][106226] Updated weights for policy 0, policy_version 986665 (0.0008) [2023-12-28 02:20:50,605][106226] Updated weights for policy 0, policy_version 986675 (0.0008) [2023-12-28 02:20:50,668][106226] Updated weights for policy 0, policy_version 986685 (0.0005) [2023-12-28 02:20:51,047][106225] Updated weights for policy 1, policy_version 989064 (0.0008) [2023-12-28 02:20:51,119][106225] Updated weights for policy 1, policy_version 989074 (0.0007) [2023-12-28 02:20:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 505888768. Throughput: 0: 9746.4, 1: 10074.1. Samples: 505903244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:20:51,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.860')] [2023-12-28 02:20:51,187][106225] Updated weights for policy 1, policy_version 989084 (0.0006) [2023-12-28 02:20:51,380][106226] Updated weights for policy 0, policy_version 986695 (0.0009) [2023-12-28 02:20:51,443][106226] Updated weights for policy 0, policy_version 986705 (0.0009) [2023-12-28 02:20:51,517][106226] Updated weights for policy 0, policy_version 986715 (0.0009) [2023-12-28 02:20:51,866][106225] Updated weights for policy 1, policy_version 989094 (0.0008) [2023-12-28 02:20:51,931][106225] Updated weights for policy 1, policy_version 989104 (0.0009) [2023-12-28 02:20:51,991][106225] Updated weights for policy 1, policy_version 989114 (0.0008) [2023-12-28 02:20:52,301][106226] Updated weights for policy 0, policy_version 986725 (0.0007) [2023-12-28 02:20:52,378][106226] Updated weights for policy 0, policy_version 986735 (0.0008) [2023-12-28 02:20:52,441][106226] Updated weights for policy 0, policy_version 986745 (0.0008) [2023-12-28 02:20:52,785][106225] Updated weights for policy 1, policy_version 989124 (0.0009) [2023-12-28 02:20:52,850][106225] Updated weights for policy 1, policy_version 989134 (0.0011) [2023-12-28 02:20:52,933][106225] Updated weights for policy 1, policy_version 989144 (0.0011) [2023-12-28 02:20:53,181][106226] Updated weights for policy 0, policy_version 986755 (0.0008) [2023-12-28 02:20:53,237][106226] Updated weights for policy 0, policy_version 986765 (0.0008) [2023-12-28 02:20:53,294][106226] Updated weights for policy 0, policy_version 986775 (0.0008) [2023-12-28 02:20:53,624][106225] Updated weights for policy 1, policy_version 989154 (0.0010) [2023-12-28 02:20:53,670][106225] Updated weights for policy 1, policy_version 989164 (0.0010) [2023-12-28 02:20:53,718][106225] Updated weights for policy 1, policy_version 989174 (0.0010) [2023-12-28 02:20:53,777][106225] Updated weights for policy 1, policy_version 989184 (0.0010) [2023-12-28 02:20:54,060][106226] Updated weights for policy 0, policy_version 986786 (0.0008) [2023-12-28 02:20:54,117][106226] Updated weights for policy 0, policy_version 986796 (0.0008) [2023-12-28 02:20:54,176][106226] Updated weights for policy 0, policy_version 986806 (0.0007) [2023-12-28 02:20:54,244][106226] Updated weights for policy 0, policy_version 986816 (0.0008) [2023-12-28 02:20:54,513][106225] Updated weights for policy 1, policy_version 989194 (0.0010) [2023-12-28 02:20:54,563][106225] Updated weights for policy 1, policy_version 989204 (0.0010) [2023-12-28 02:20:54,619][106225] Updated weights for policy 1, policy_version 989214 (0.0010) [2023-12-28 02:20:54,890][106226] Updated weights for policy 0, policy_version 986826 (0.0005) [2023-12-28 02:20:54,945][106226] Updated weights for policy 0, policy_version 986836 (0.0005) [2023-12-28 02:20:55,001][106226] Updated weights for policy 0, policy_version 986846 (0.0006) [2023-12-28 02:20:55,342][106225] Updated weights for policy 1, policy_version 989224 (0.0010) [2023-12-28 02:20:55,389][106225] Updated weights for policy 1, policy_version 989234 (0.0010) [2023-12-28 02:20:55,441][106225] Updated weights for policy 1, policy_version 989244 (0.0008) [2023-12-28 02:20:55,587][106226] Updated weights for policy 0, policy_version 986856 (0.0007) [2023-12-28 02:20:55,635][106226] Updated weights for policy 0, policy_version 986866 (0.0008) [2023-12-28 02:20:55,680][106226] Updated weights for policy 0, policy_version 986876 (0.0008) [2023-12-28 02:20:56,144][106225] Updated weights for policy 1, policy_version 989254 (0.0007) [2023-12-28 02:20:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 505987072. Throughput: 0: 9712.0, 1: 10010.5. Samples: 505958684. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:20:56,176][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.978')] [2023-12-28 02:20:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000986880_252698624.pth... [2023-12-28 02:20:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000985728_252403712.pth [2023-12-28 02:20:56,192][106225] Updated weights for policy 1, policy_version 989264 (0.0005) [2023-12-28 02:20:56,248][106225] Updated weights for policy 1, policy_version 989274 (0.0005) [2023-12-28 02:20:56,283][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000989280_253296640.pth... [2023-12-28 02:20:56,287][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000988096_252993536.pth [2023-12-28 02:20:56,458][106226] Updated weights for policy 0, policy_version 986886 (0.0008) [2023-12-28 02:20:56,513][106226] Updated weights for policy 0, policy_version 986896 (0.0008) [2023-12-28 02:20:56,572][106226] Updated weights for policy 0, policy_version 986906 (0.0007) [2023-12-28 02:20:56,784][106225] Updated weights for policy 1, policy_version 989284 (0.0005) [2023-12-28 02:20:56,839][106225] Updated weights for policy 1, policy_version 989294 (0.0008) [2023-12-28 02:20:56,898][106225] Updated weights for policy 1, policy_version 989304 (0.0005) [2023-12-28 02:20:57,253][106226] Updated weights for policy 0, policy_version 986916 (0.0010) [2023-12-28 02:20:57,313][106226] Updated weights for policy 0, policy_version 986926 (0.0011) [2023-12-28 02:20:57,377][106226] Updated weights for policy 0, policy_version 986936 (0.0006) [2023-12-28 02:20:57,513][106225] Updated weights for policy 1, policy_version 989314 (0.0007) [2023-12-28 02:20:57,567][106225] Updated weights for policy 1, policy_version 989324 (0.0008) [2023-12-28 02:20:57,618][106225] Updated weights for policy 1, policy_version 989334 (0.0008) [2023-12-28 02:20:57,665][106225] Updated weights for policy 1, policy_version 989344 (0.0008) [2023-12-28 02:20:57,950][106226] Updated weights for policy 0, policy_version 986946 (0.0005) [2023-12-28 02:20:58,012][106226] Updated weights for policy 0, policy_version 986956 (0.0007) [2023-12-28 02:20:58,067][106226] Updated weights for policy 0, policy_version 986966 (0.0007) [2023-12-28 02:20:58,124][106226] Updated weights for policy 0, policy_version 986976 (0.0008) [2023-12-28 02:20:58,457][106225] Updated weights for policy 1, policy_version 989354 (0.0010) [2023-12-28 02:20:58,521][106225] Updated weights for policy 1, policy_version 989364 (0.0010) [2023-12-28 02:20:58,584][106225] Updated weights for policy 1, policy_version 989374 (0.0010) [2023-12-28 02:20:58,920][106226] Updated weights for policy 0, policy_version 986986 (0.0007) [2023-12-28 02:20:58,982][106226] Updated weights for policy 0, policy_version 986996 (0.0010) [2023-12-28 02:20:59,056][106226] Updated weights for policy 0, policy_version 987006 (0.0009) [2023-12-28 02:20:59,321][106225] Updated weights for policy 1, policy_version 989384 (0.0009) [2023-12-28 02:20:59,379][106225] Updated weights for policy 1, policy_version 989394 (0.0009) [2023-12-28 02:20:59,437][106225] Updated weights for policy 1, policy_version 989404 (0.0008) [2023-12-28 02:20:59,812][106226] Updated weights for policy 0, policy_version 987016 (0.0007) [2023-12-28 02:20:59,879][106226] Updated weights for policy 0, policy_version 987026 (0.0007) [2023-12-28 02:20:59,947][106226] Updated weights for policy 0, policy_version 987036 (0.0009) [2023-12-28 02:21:00,147][106225] Updated weights for policy 1, policy_version 989414 (0.0009) [2023-12-28 02:21:00,212][106225] Updated weights for policy 1, policy_version 989424 (0.0010) [2023-12-28 02:21:00,270][106225] Updated weights for policy 1, policy_version 989434 (0.0008) [2023-12-28 02:21:00,632][106226] Updated weights for policy 0, policy_version 987046 (0.0008) [2023-12-28 02:21:00,689][106226] Updated weights for policy 0, policy_version 987056 (0.0008) [2023-12-28 02:21:00,743][106226] Updated weights for policy 0, policy_version 987066 (0.0008) [2023-12-28 02:21:00,930][106225] Updated weights for policy 1, policy_version 989444 (0.0008) [2023-12-28 02:21:00,993][106225] Updated weights for policy 1, policy_version 989454 (0.0006) [2023-12-28 02:21:01,057][106225] Updated weights for policy 1, policy_version 989464 (0.0007) [2023-12-28 02:21:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 506093568. Throughput: 0: 9717.8, 1: 10077.9. Samples: 506078928. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:01,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.974')] [2023-12-28 02:21:01,557][106226] Updated weights for policy 0, policy_version 987076 (0.0010) [2023-12-28 02:21:01,625][106226] Updated weights for policy 0, policy_version 987086 (0.0009) [2023-12-28 02:21:01,687][106226] Updated weights for policy 0, policy_version 987096 (0.0008) [2023-12-28 02:21:01,691][106225] Updated weights for policy 1, policy_version 989474 (0.0008) [2023-12-28 02:21:01,757][106225] Updated weights for policy 1, policy_version 989484 (0.0008) [2023-12-28 02:21:01,819][106225] Updated weights for policy 1, policy_version 989494 (0.0008) [2023-12-28 02:21:01,879][106225] Updated weights for policy 1, policy_version 989504 (0.0007) [2023-12-28 02:21:02,470][106226] Updated weights for policy 0, policy_version 987106 (0.0008) [2023-12-28 02:21:02,533][106226] Updated weights for policy 0, policy_version 987116 (0.0009) [2023-12-28 02:21:02,584][106226] Updated weights for policy 0, policy_version 987126 (0.0009) [2023-12-28 02:21:02,606][106225] Updated weights for policy 1, policy_version 989514 (0.0008) [2023-12-28 02:21:02,640][106226] Updated weights for policy 0, policy_version 987136 (0.0007) [2023-12-28 02:21:02,663][106225] Updated weights for policy 1, policy_version 989524 (0.0007) [2023-12-28 02:21:02,725][106225] Updated weights for policy 1, policy_version 989534 (0.0008) [2023-12-28 02:21:03,375][106225] Updated weights for policy 1, policy_version 989544 (0.0009) [2023-12-28 02:21:03,420][106226] Updated weights for policy 0, policy_version 987146 (0.0007) [2023-12-28 02:21:03,426][106225] Updated weights for policy 1, policy_version 989554 (0.0010) [2023-12-28 02:21:03,474][106226] Updated weights for policy 0, policy_version 987156 (0.0005) [2023-12-28 02:21:03,483][106225] Updated weights for policy 1, policy_version 989564 (0.0010) [2023-12-28 02:21:03,531][106226] Updated weights for policy 0, policy_version 987166 (0.0006) [2023-12-28 02:21:04,183][106225] Updated weights for policy 1, policy_version 989574 (0.0009) [2023-12-28 02:21:04,214][106226] Updated weights for policy 0, policy_version 987176 (0.0010) [2023-12-28 02:21:04,245][106225] Updated weights for policy 1, policy_version 989584 (0.0010) [2023-12-28 02:21:04,280][106226] Updated weights for policy 0, policy_version 987186 (0.0011) [2023-12-28 02:21:04,310][106225] Updated weights for policy 1, policy_version 989594 (0.0007) [2023-12-28 02:21:04,336][106226] Updated weights for policy 0, policy_version 987196 (0.0010) [2023-12-28 02:21:05,008][106225] Updated weights for policy 1, policy_version 989604 (0.0007) [2023-12-28 02:21:05,022][106226] Updated weights for policy 0, policy_version 987206 (0.0009) [2023-12-28 02:21:05,060][106225] Updated weights for policy 1, policy_version 989614 (0.0008) [2023-12-28 02:21:05,082][106226] Updated weights for policy 0, policy_version 987216 (0.0006) [2023-12-28 02:21:05,109][106225] Updated weights for policy 1, policy_version 989624 (0.0008) [2023-12-28 02:21:05,133][106226] Updated weights for policy 0, policy_version 987226 (0.0005) [2023-12-28 02:21:05,713][106225] Updated weights for policy 1, policy_version 989634 (0.0007) [2023-12-28 02:21:05,777][106225] Updated weights for policy 1, policy_version 989644 (0.0006) [2023-12-28 02:21:05,811][106226] Updated weights for policy 0, policy_version 987236 (0.0007) [2023-12-28 02:21:05,836][106225] Updated weights for policy 1, policy_version 989654 (0.0006) [2023-12-28 02:21:05,862][106226] Updated weights for policy 0, policy_version 987246 (0.0006) [2023-12-28 02:21:05,888][106225] Updated weights for policy 1, policy_version 989664 (0.0006) [2023-12-28 02:21:05,923][106226] Updated weights for policy 0, policy_version 987256 (0.0007) [2023-12-28 02:21:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506191872. Throughput: 0: 9773.8, 1: 10021.4. Samples: 506197348. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:06,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.961')] [2023-12-28 02:21:06,508][106225] Updated weights for policy 1, policy_version 989674 (0.0008) [2023-12-28 02:21:06,564][106225] Updated weights for policy 1, policy_version 989684 (0.0008) [2023-12-28 02:21:06,596][106226] Updated weights for policy 0, policy_version 987266 (0.0009) [2023-12-28 02:21:06,621][106225] Updated weights for policy 1, policy_version 989694 (0.0008) [2023-12-28 02:21:06,653][106226] Updated weights for policy 0, policy_version 987276 (0.0008) [2023-12-28 02:21:06,716][106226] Updated weights for policy 0, policy_version 987286 (0.0008) [2023-12-28 02:21:06,766][106226] Updated weights for policy 0, policy_version 987296 (0.0007) [2023-12-28 02:21:07,353][106225] Updated weights for policy 1, policy_version 989704 (0.0008) [2023-12-28 02:21:07,410][106225] Updated weights for policy 1, policy_version 989714 (0.0008) [2023-12-28 02:21:07,468][106226] Updated weights for policy 0, policy_version 987306 (0.0006) [2023-12-28 02:21:07,470][106225] Updated weights for policy 1, policy_version 989724 (0.0008) [2023-12-28 02:21:07,517][106226] Updated weights for policy 0, policy_version 987316 (0.0007) [2023-12-28 02:21:07,566][106226] Updated weights for policy 0, policy_version 987326 (0.0009) [2023-12-28 02:21:08,177][106225] Updated weights for policy 1, policy_version 989734 (0.0008) [2023-12-28 02:21:08,226][106225] Updated weights for policy 1, policy_version 989744 (0.0008) [2023-12-28 02:21:08,273][106225] Updated weights for policy 1, policy_version 989754 (0.0008) [2023-12-28 02:21:08,356][106226] Updated weights for policy 0, policy_version 987336 (0.0009) [2023-12-28 02:21:08,417][106226] Updated weights for policy 0, policy_version 987346 (0.0008) [2023-12-28 02:21:08,477][106226] Updated weights for policy 0, policy_version 987356 (0.0009) [2023-12-28 02:21:08,991][106225] Updated weights for policy 1, policy_version 989764 (0.0007) [2023-12-28 02:21:09,043][106225] Updated weights for policy 1, policy_version 989774 (0.0008) [2023-12-28 02:21:09,087][106225] Updated weights for policy 1, policy_version 989784 (0.0008) [2023-12-28 02:21:09,243][106226] Updated weights for policy 0, policy_version 987366 (0.0010) [2023-12-28 02:21:09,303][106226] Updated weights for policy 0, policy_version 987376 (0.0008) [2023-12-28 02:21:09,366][106226] Updated weights for policy 0, policy_version 987386 (0.0008) [2023-12-28 02:21:09,848][106225] Updated weights for policy 1, policy_version 989794 (0.0006) [2023-12-28 02:21:09,915][106225] Updated weights for policy 1, policy_version 989804 (0.0008) [2023-12-28 02:21:09,981][106225] Updated weights for policy 1, policy_version 989814 (0.0007) [2023-12-28 02:21:10,046][106225] Updated weights for policy 1, policy_version 989824 (0.0008) [2023-12-28 02:21:10,140][106226] Updated weights for policy 0, policy_version 987396 (0.0008) [2023-12-28 02:21:10,206][106226] Updated weights for policy 0, policy_version 987406 (0.0009) [2023-12-28 02:21:10,269][106226] Updated weights for policy 0, policy_version 987416 (0.0006) [2023-12-28 02:21:10,778][106225] Updated weights for policy 1, policy_version 989834 (0.0009) [2023-12-28 02:21:10,828][106225] Updated weights for policy 1, policy_version 989844 (0.0007) [2023-12-28 02:21:10,888][106225] Updated weights for policy 1, policy_version 989854 (0.0006) [2023-12-28 02:21:10,983][106226] Updated weights for policy 0, policy_version 987426 (0.0008) [2023-12-28 02:21:11,045][106226] Updated weights for policy 0, policy_version 987436 (0.0009) [2023-12-28 02:21:11,112][106226] Updated weights for policy 0, policy_version 987446 (0.0009) [2023-12-28 02:21:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 506281984. Throughput: 0: 9784.9, 1: 10066.7. Samples: 506256204. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:11,176][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.951')] [2023-12-28 02:21:11,179][106226] Updated weights for policy 0, policy_version 987456 (0.0010) [2023-12-28 02:21:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000987456_252846080.pth... [2023-12-28 02:21:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000989856_253444096.pth... [2023-12-28 02:21:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000986336_252559360.pth [2023-12-28 02:21:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000988672_253140992.pth [2023-12-28 02:21:11,712][106225] Updated weights for policy 1, policy_version 989864 (0.0008) [2023-12-28 02:21:11,764][106225] Updated weights for policy 1, policy_version 989874 (0.0008) [2023-12-28 02:21:11,812][106225] Updated weights for policy 1, policy_version 989884 (0.0008) [2023-12-28 02:21:11,972][106226] Updated weights for policy 0, policy_version 987466 (0.0008) [2023-12-28 02:21:12,038][106226] Updated weights for policy 0, policy_version 987476 (0.0007) [2023-12-28 02:21:12,097][106226] Updated weights for policy 0, policy_version 987486 (0.0008) [2023-12-28 02:21:12,590][106225] Updated weights for policy 1, policy_version 989894 (0.0010) [2023-12-28 02:21:12,658][106225] Updated weights for policy 1, policy_version 989904 (0.0010) [2023-12-28 02:21:12,717][106225] Updated weights for policy 1, policy_version 989914 (0.0011) [2023-12-28 02:21:12,802][106226] Updated weights for policy 0, policy_version 987496 (0.0009) [2023-12-28 02:21:12,864][106226] Updated weights for policy 0, policy_version 987506 (0.0008) [2023-12-28 02:21:12,927][106226] Updated weights for policy 0, policy_version 987516 (0.0008) [2023-12-28 02:21:13,453][106225] Updated weights for policy 1, policy_version 989924 (0.0009) [2023-12-28 02:21:13,503][106225] Updated weights for policy 1, policy_version 989934 (0.0009) [2023-12-28 02:21:13,551][106225] Updated weights for policy 1, policy_version 989944 (0.0009) [2023-12-28 02:21:13,650][106226] Updated weights for policy 0, policy_version 987526 (0.0007) [2023-12-28 02:21:13,712][106226] Updated weights for policy 0, policy_version 987536 (0.0005) [2023-12-28 02:21:13,773][106226] Updated weights for policy 0, policy_version 987546 (0.0005) [2023-12-28 02:21:14,278][106225] Updated weights for policy 1, policy_version 989954 (0.0007) [2023-12-28 02:21:14,305][106226] Updated weights for policy 0, policy_version 987556 (0.0006) [2023-12-28 02:21:14,332][106225] Updated weights for policy 1, policy_version 989964 (0.0006) [2023-12-28 02:21:14,361][106226] Updated weights for policy 0, policy_version 987566 (0.0005) [2023-12-28 02:21:14,395][106225] Updated weights for policy 1, policy_version 989974 (0.0007) [2023-12-28 02:21:14,423][106226] Updated weights for policy 0, policy_version 987576 (0.0005) [2023-12-28 02:21:14,440][106225] Updated weights for policy 1, policy_version 989984 (0.0006) [2023-12-28 02:21:15,042][106226] Updated weights for policy 0, policy_version 987586 (0.0007) [2023-12-28 02:21:15,077][106225] Updated weights for policy 1, policy_version 989994 (0.0011) [2023-12-28 02:21:15,095][106226] Updated weights for policy 0, policy_version 987596 (0.0006) [2023-12-28 02:21:15,140][106225] Updated weights for policy 1, policy_version 990004 (0.0010) [2023-12-28 02:21:15,146][106226] Updated weights for policy 0, policy_version 987606 (0.0006) [2023-12-28 02:21:15,199][106225] Updated weights for policy 1, policy_version 990014 (0.0011) [2023-12-28 02:21:15,205][106226] Updated weights for policy 0, policy_version 987616 (0.0006) [2023-12-28 02:21:15,798][106226] Updated weights for policy 0, policy_version 987626 (0.0006) [2023-12-28 02:21:15,840][106225] Updated weights for policy 1, policy_version 990024 (0.0010) [2023-12-28 02:21:15,850][106226] Updated weights for policy 0, policy_version 987636 (0.0005) [2023-12-28 02:21:15,902][106226] Updated weights for policy 0, policy_version 987646 (0.0005) [2023-12-28 02:21:15,904][106225] Updated weights for policy 1, policy_version 990034 (0.0011) [2023-12-28 02:21:15,971][106225] Updated weights for policy 1, policy_version 990044 (0.0010) [2023-12-28 02:21:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506388480. Throughput: 0: 9724.0, 1: 9912.6. Samples: 506371984. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:16,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.779')] [2023-12-28 02:21:16,562][106226] Updated weights for policy 0, policy_version 987656 (0.0010) [2023-12-28 02:21:16,565][106225] Updated weights for policy 1, policy_version 990054 (0.0010) [2023-12-28 02:21:16,612][106226] Updated weights for policy 0, policy_version 987666 (0.0010) [2023-12-28 02:21:16,618][106225] Updated weights for policy 1, policy_version 990064 (0.0010) [2023-12-28 02:21:16,665][106226] Updated weights for policy 0, policy_version 987676 (0.0010) [2023-12-28 02:21:16,677][106225] Updated weights for policy 1, policy_version 990074 (0.0010) [2023-12-28 02:21:17,348][106225] Updated weights for policy 1, policy_version 990084 (0.0008) [2023-12-28 02:21:17,359][106226] Updated weights for policy 0, policy_version 987686 (0.0010) [2023-12-28 02:21:17,404][106226] Updated weights for policy 0, policy_version 987696 (0.0007) [2023-12-28 02:21:17,407][106225] Updated weights for policy 1, policy_version 990094 (0.0007) [2023-12-28 02:21:17,450][106226] Updated weights for policy 0, policy_version 987706 (0.0006) [2023-12-28 02:21:17,461][106225] Updated weights for policy 1, policy_version 990104 (0.0006) [2023-12-28 02:21:18,026][106225] Updated weights for policy 1, policy_version 990114 (0.0007) [2023-12-28 02:21:18,081][106225] Updated weights for policy 1, policy_version 990124 (0.0005) [2023-12-28 02:21:18,131][106225] Updated weights for policy 1, policy_version 990134 (0.0005) [2023-12-28 02:21:18,189][106225] Updated weights for policy 1, policy_version 990144 (0.0005) [2023-12-28 02:21:18,269][106226] Updated weights for policy 0, policy_version 987716 (0.0008) [2023-12-28 02:21:18,337][106226] Updated weights for policy 0, policy_version 987726 (0.0009) [2023-12-28 02:21:18,396][106226] Updated weights for policy 0, policy_version 987736 (0.0009) [2023-12-28 02:21:18,886][106225] Updated weights for policy 1, policy_version 990154 (0.0008) [2023-12-28 02:21:18,949][106225] Updated weights for policy 1, policy_version 990164 (0.0008) [2023-12-28 02:21:19,009][106225] Updated weights for policy 1, policy_version 990174 (0.0007) [2023-12-28 02:21:19,094][106226] Updated weights for policy 0, policy_version 987746 (0.0009) [2023-12-28 02:21:19,142][106226] Updated weights for policy 0, policy_version 987756 (0.0008) [2023-12-28 02:21:19,194][106226] Updated weights for policy 0, policy_version 987766 (0.0008) [2023-12-28 02:21:19,261][106226] Updated weights for policy 0, policy_version 987776 (0.0008) [2023-12-28 02:21:19,789][106225] Updated weights for policy 1, policy_version 990184 (0.0007) [2023-12-28 02:21:19,849][106225] Updated weights for policy 1, policy_version 990194 (0.0007) [2023-12-28 02:21:19,920][106225] Updated weights for policy 1, policy_version 990204 (0.0006) [2023-12-28 02:21:20,036][106226] Updated weights for policy 0, policy_version 987786 (0.0007) [2023-12-28 02:21:20,092][106226] Updated weights for policy 0, policy_version 987796 (0.0006) [2023-12-28 02:21:20,157][106226] Updated weights for policy 0, policy_version 987806 (0.0006) [2023-12-28 02:21:20,653][106225] Updated weights for policy 1, policy_version 990214 (0.0007) [2023-12-28 02:21:20,719][106225] Updated weights for policy 1, policy_version 990224 (0.0007) [2023-12-28 02:21:20,786][106225] Updated weights for policy 1, policy_version 990234 (0.0007) [2023-12-28 02:21:20,788][106226] Updated weights for policy 0, policy_version 987816 (0.0007) [2023-12-28 02:21:20,856][106226] Updated weights for policy 0, policy_version 987826 (0.0006) [2023-12-28 02:21:20,919][106226] Updated weights for policy 0, policy_version 987836 (0.0006) [2023-12-28 02:21:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 506486784. Throughput: 0: 9703.3, 1: 10008.3. Samples: 506494260. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:21,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.170')] [2023-12-28 02:21:21,547][106225] Updated weights for policy 1, policy_version 990244 (0.0006) [2023-12-28 02:21:21,609][106225] Updated weights for policy 1, policy_version 990254 (0.0008) [2023-12-28 02:21:21,622][106226] Updated weights for policy 0, policy_version 987846 (0.0007) [2023-12-28 02:21:21,674][106225] Updated weights for policy 1, policy_version 990264 (0.0007) [2023-12-28 02:21:21,693][106226] Updated weights for policy 0, policy_version 987856 (0.0008) [2023-12-28 02:21:21,761][106226] Updated weights for policy 0, policy_version 987866 (0.0008) [2023-12-28 02:21:22,331][106225] Updated weights for policy 1, policy_version 990274 (0.0008) [2023-12-28 02:21:22,406][106225] Updated weights for policy 1, policy_version 990284 (0.0008) [2023-12-28 02:21:22,474][106225] Updated weights for policy 1, policy_version 990294 (0.0009) [2023-12-28 02:21:22,534][106225] Updated weights for policy 1, policy_version 990304 (0.0008) [2023-12-28 02:21:22,555][106226] Updated weights for policy 0, policy_version 987876 (0.0008) [2023-12-28 02:21:22,614][106226] Updated weights for policy 0, policy_version 987886 (0.0006) [2023-12-28 02:21:22,678][106226] Updated weights for policy 0, policy_version 987896 (0.0006) [2023-12-28 02:21:23,285][106225] Updated weights for policy 1, policy_version 990314 (0.0009) [2023-12-28 02:21:23,349][106225] Updated weights for policy 1, policy_version 990324 (0.0007) [2023-12-28 02:21:23,353][106226] Updated weights for policy 0, policy_version 987906 (0.0006) [2023-12-28 02:21:23,407][106225] Updated weights for policy 1, policy_version 990334 (0.0009) [2023-12-28 02:21:23,413][106226] Updated weights for policy 0, policy_version 987916 (0.0006) [2023-12-28 02:21:23,475][106226] Updated weights for policy 0, policy_version 987926 (0.0007) [2023-12-28 02:21:23,540][106226] Updated weights for policy 0, policy_version 987936 (0.0009) [2023-12-28 02:21:24,171][106225] Updated weights for policy 1, policy_version 990344 (0.0007) [2023-12-28 02:21:24,201][106226] Updated weights for policy 0, policy_version 987946 (0.0006) [2023-12-28 02:21:24,231][106225] Updated weights for policy 1, policy_version 990354 (0.0006) [2023-12-28 02:21:24,264][106226] Updated weights for policy 0, policy_version 987956 (0.0007) [2023-12-28 02:21:24,299][106225] Updated weights for policy 1, policy_version 990364 (0.0008) [2023-12-28 02:21:24,326][106226] Updated weights for policy 0, policy_version 987966 (0.0006) [2023-12-28 02:21:25,016][106225] Updated weights for policy 1, policy_version 990374 (0.0009) [2023-12-28 02:21:25,019][106226] Updated weights for policy 0, policy_version 987976 (0.0009) [2023-12-28 02:21:25,067][106225] Updated weights for policy 1, policy_version 990384 (0.0007) [2023-12-28 02:21:25,068][106226] Updated weights for policy 0, policy_version 987986 (0.0009) [2023-12-28 02:21:25,114][106226] Updated weights for policy 0, policy_version 987996 (0.0008) [2023-12-28 02:21:25,134][106225] Updated weights for policy 1, policy_version 990394 (0.0005) [2023-12-28 02:21:25,822][106226] Updated weights for policy 0, policy_version 988006 (0.0010) [2023-12-28 02:21:25,837][106225] Updated weights for policy 1, policy_version 990404 (0.0007) [2023-12-28 02:21:25,875][106226] Updated weights for policy 0, policy_version 988016 (0.0010) [2023-12-28 02:21:25,888][106225] Updated weights for policy 1, policy_version 990414 (0.0007) [2023-12-28 02:21:25,933][106226] Updated weights for policy 0, policy_version 988026 (0.0011) [2023-12-28 02:21:25,943][106225] Updated weights for policy 1, policy_version 990424 (0.0006) [2023-12-28 02:21:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506585088. Throughput: 0: 9681.4, 1: 9960.3. Samples: 506550456. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:26,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.584')] [2023-12-28 02:21:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000990432_253591552.pth... [2023-12-28 02:21:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000988032_252993536.pth... [2023-12-28 02:21:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000986880_252698624.pth [2023-12-28 02:21:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000989280_253296640.pth [2023-12-28 02:21:26,588][106226] Updated weights for policy 0, policy_version 988036 (0.0007) [2023-12-28 02:21:26,644][106226] Updated weights for policy 0, policy_version 988046 (0.0009) [2023-12-28 02:21:26,648][106225] Updated weights for policy 1, policy_version 990434 (0.0008) [2023-12-28 02:21:26,700][106226] Updated weights for policy 0, policy_version 988056 (0.0006) [2023-12-28 02:21:26,707][106225] Updated weights for policy 1, policy_version 990444 (0.0007) [2023-12-28 02:21:26,765][106225] Updated weights for policy 1, policy_version 990454 (0.0007) [2023-12-28 02:21:26,832][106225] Updated weights for policy 1, policy_version 990464 (0.0009) [2023-12-28 02:21:27,343][106226] Updated weights for policy 0, policy_version 988066 (0.0007) [2023-12-28 02:21:27,398][106226] Updated weights for policy 0, policy_version 988076 (0.0006) [2023-12-28 02:21:27,446][106226] Updated weights for policy 0, policy_version 988086 (0.0005) [2023-12-28 02:21:27,496][106226] Updated weights for policy 0, policy_version 988096 (0.0005) [2023-12-28 02:21:27,555][106225] Updated weights for policy 1, policy_version 990474 (0.0008) [2023-12-28 02:21:27,603][106225] Updated weights for policy 1, policy_version 990484 (0.0008) [2023-12-28 02:21:27,657][106225] Updated weights for policy 1, policy_version 990494 (0.0008) [2023-12-28 02:21:28,092][106226] Updated weights for policy 0, policy_version 988106 (0.0009) [2023-12-28 02:21:28,147][106226] Updated weights for policy 0, policy_version 988116 (0.0008) [2023-12-28 02:21:28,218][106226] Updated weights for policy 0, policy_version 988126 (0.0008) [2023-12-28 02:21:28,380][106225] Updated weights for policy 1, policy_version 990504 (0.0008) [2023-12-28 02:21:28,442][106225] Updated weights for policy 1, policy_version 990514 (0.0009) [2023-12-28 02:21:28,500][106225] Updated weights for policy 1, policy_version 990524 (0.0010) [2023-12-28 02:21:28,951][106226] Updated weights for policy 0, policy_version 988136 (0.0009) [2023-12-28 02:21:29,015][106226] Updated weights for policy 0, policy_version 988146 (0.0008) [2023-12-28 02:21:29,076][106226] Updated weights for policy 0, policy_version 988156 (0.0009) [2023-12-28 02:21:29,158][106225] Updated weights for policy 1, policy_version 990534 (0.0009) [2023-12-28 02:21:29,220][106225] Updated weights for policy 1, policy_version 990544 (0.0009) [2023-12-28 02:21:29,282][106225] Updated weights for policy 1, policy_version 990554 (0.0008) [2023-12-28 02:21:29,836][106226] Updated weights for policy 0, policy_version 988166 (0.0008) [2023-12-28 02:21:29,901][106226] Updated weights for policy 0, policy_version 988176 (0.0009) [2023-12-28 02:21:29,968][106226] Updated weights for policy 0, policy_version 988186 (0.0009) [2023-12-28 02:21:29,974][106225] Updated weights for policy 1, policy_version 990564 (0.0007) [2023-12-28 02:21:30,036][106225] Updated weights for policy 1, policy_version 990574 (0.0007) [2023-12-28 02:21:30,092][106225] Updated weights for policy 1, policy_version 990584 (0.0008) [2023-12-28 02:21:30,709][106226] Updated weights for policy 0, policy_version 988196 (0.0009) [2023-12-28 02:21:30,754][106225] Updated weights for policy 1, policy_version 990594 (0.0007) [2023-12-28 02:21:30,768][106226] Updated weights for policy 0, policy_version 988206 (0.0009) [2023-12-28 02:21:30,810][106225] Updated weights for policy 1, policy_version 990604 (0.0005) [2023-12-28 02:21:30,831][106226] Updated weights for policy 0, policy_version 988216 (0.0008) [2023-12-28 02:21:30,868][106225] Updated weights for policy 1, policy_version 990614 (0.0005) [2023-12-28 02:21:30,926][106225] Updated weights for policy 1, policy_version 990624 (0.0005) [2023-12-28 02:21:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 506683392. Throughput: 0: 9784.7, 1: 9924.7. Samples: 506669584. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:31,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.955')] [2023-12-28 02:21:31,565][106226] Updated weights for policy 0, policy_version 988226 (0.0008) [2023-12-28 02:21:31,576][106225] Updated weights for policy 1, policy_version 990634 (0.0008) [2023-12-28 02:21:31,625][106226] Updated weights for policy 0, policy_version 988236 (0.0007) [2023-12-28 02:21:31,642][106225] Updated weights for policy 1, policy_version 990644 (0.0014) [2023-12-28 02:21:31,687][106226] Updated weights for policy 0, policy_version 988246 (0.0007) [2023-12-28 02:21:31,707][106225] Updated weights for policy 1, policy_version 990654 (0.0007) [2023-12-28 02:21:31,754][106226] Updated weights for policy 0, policy_version 988256 (0.0009) [2023-12-28 02:21:32,442][106226] Updated weights for policy 0, policy_version 988266 (0.0011) [2023-12-28 02:21:32,448][106225] Updated weights for policy 1, policy_version 990664 (0.0007) [2023-12-28 02:21:32,500][106225] Updated weights for policy 1, policy_version 990674 (0.0007) [2023-12-28 02:21:32,503][106226] Updated weights for policy 0, policy_version 988276 (0.0011) [2023-12-28 02:21:32,555][106225] Updated weights for policy 1, policy_version 990684 (0.0006) [2023-12-28 02:21:32,564][106226] Updated weights for policy 0, policy_version 988286 (0.0010) [2023-12-28 02:21:33,255][106226] Updated weights for policy 0, policy_version 988296 (0.0010) [2023-12-28 02:21:33,302][106225] Updated weights for policy 1, policy_version 990694 (0.0006) [2023-12-28 02:21:33,308][106226] Updated weights for policy 0, policy_version 988306 (0.0008) [2023-12-28 02:21:33,359][106226] Updated weights for policy 0, policy_version 988316 (0.0005) [2023-12-28 02:21:33,360][106225] Updated weights for policy 1, policy_version 990704 (0.0008) [2023-12-28 02:21:33,410][106225] Updated weights for policy 1, policy_version 990714 (0.0007) [2023-12-28 02:21:33,896][106226] Updated weights for policy 0, policy_version 988326 (0.0008) [2023-12-28 02:21:33,953][106226] Updated weights for policy 0, policy_version 988336 (0.0010) [2023-12-28 02:21:33,982][106225] Updated weights for policy 1, policy_version 990724 (0.0008) [2023-12-28 02:21:34,000][106226] Updated weights for policy 0, policy_version 988346 (0.0010) [2023-12-28 02:21:34,042][106225] Updated weights for policy 1, policy_version 990734 (0.0007) [2023-12-28 02:21:34,104][106225] Updated weights for policy 1, policy_version 990744 (0.0007) [2023-12-28 02:21:34,744][106226] Updated weights for policy 0, policy_version 988356 (0.0009) [2023-12-28 02:21:34,809][106226] Updated weights for policy 0, policy_version 988366 (0.0008) [2023-12-28 02:21:34,866][106225] Updated weights for policy 1, policy_version 990754 (0.0008) [2023-12-28 02:21:34,870][106226] Updated weights for policy 0, policy_version 988376 (0.0009) [2023-12-28 02:21:34,913][106225] Updated weights for policy 1, policy_version 990764 (0.0010) [2023-12-28 02:21:34,963][106225] Updated weights for policy 1, policy_version 990774 (0.0010) [2023-12-28 02:21:35,012][106225] Updated weights for policy 1, policy_version 990784 (0.0010) [2023-12-28 02:21:35,600][106226] Updated weights for policy 0, policy_version 988386 (0.0009) [2023-12-28 02:21:35,649][106226] Updated weights for policy 0, policy_version 988396 (0.0007) [2023-12-28 02:21:35,702][106226] Updated weights for policy 0, policy_version 988406 (0.0009) [2023-12-28 02:21:35,732][106225] Updated weights for policy 1, policy_version 990794 (0.0010) [2023-12-28 02:21:35,754][106226] Updated weights for policy 0, policy_version 988416 (0.0006) [2023-12-28 02:21:35,788][106225] Updated weights for policy 1, policy_version 990804 (0.0010) [2023-12-28 02:21:35,844][106225] Updated weights for policy 1, policy_version 990814 (0.0010) [2023-12-28 02:21:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506781696. Throughput: 0: 9805.1, 1: 9881.2. Samples: 506789132. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:36,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.412')] [2023-12-28 02:21:36,520][106226] Updated weights for policy 0, policy_version 988426 (0.0008) [2023-12-28 02:21:36,579][106225] Updated weights for policy 1, policy_version 990824 (0.0010) [2023-12-28 02:21:36,581][106226] Updated weights for policy 0, policy_version 988436 (0.0007) [2023-12-28 02:21:36,643][106225] Updated weights for policy 1, policy_version 990834 (0.0010) [2023-12-28 02:21:36,646][106226] Updated weights for policy 0, policy_version 988446 (0.0007) [2023-12-28 02:21:36,710][106225] Updated weights for policy 1, policy_version 990844 (0.0010) [2023-12-28 02:21:37,229][106226] Updated weights for policy 0, policy_version 988456 (0.0007) [2023-12-28 02:21:37,284][106226] Updated weights for policy 0, policy_version 988466 (0.0008) [2023-12-28 02:21:37,335][106226] Updated weights for policy 0, policy_version 988476 (0.0007) [2023-12-28 02:21:37,359][106225] Updated weights for policy 1, policy_version 990854 (0.0010) [2023-12-28 02:21:37,419][106225] Updated weights for policy 1, policy_version 990864 (0.0008) [2023-12-28 02:21:37,469][106225] Updated weights for policy 1, policy_version 990874 (0.0009) [2023-12-28 02:21:38,001][106226] Updated weights for policy 0, policy_version 988486 (0.0006) [2023-12-28 02:21:38,064][106226] Updated weights for policy 0, policy_version 988496 (0.0006) [2023-12-28 02:21:38,126][106226] Updated weights for policy 0, policy_version 988506 (0.0006) [2023-12-28 02:21:38,241][106225] Updated weights for policy 1, policy_version 990884 (0.0010) [2023-12-28 02:21:38,302][106225] Updated weights for policy 1, policy_version 990894 (0.0009) [2023-12-28 02:21:38,370][106225] Updated weights for policy 1, policy_version 990904 (0.0008) [2023-12-28 02:21:38,731][106226] Updated weights for policy 0, policy_version 988516 (0.0006) [2023-12-28 02:21:38,788][106226] Updated weights for policy 0, policy_version 988526 (0.0008) [2023-12-28 02:21:38,846][106226] Updated weights for policy 0, policy_version 988536 (0.0010) [2023-12-28 02:21:39,017][106225] Updated weights for policy 1, policy_version 990914 (0.0010) [2023-12-28 02:21:39,075][106225] Updated weights for policy 1, policy_version 990924 (0.0008) [2023-12-28 02:21:39,133][106225] Updated weights for policy 1, policy_version 990934 (0.0005) [2023-12-28 02:21:39,186][106225] Updated weights for policy 1, policy_version 990944 (0.0005) [2023-12-28 02:21:39,709][106226] Updated weights for policy 0, policy_version 988546 (0.0009) [2023-12-28 02:21:39,775][106226] Updated weights for policy 0, policy_version 988556 (0.0009) [2023-12-28 02:21:39,839][106226] Updated weights for policy 0, policy_version 988566 (0.0008) [2023-12-28 02:21:39,899][106225] Updated weights for policy 1, policy_version 990954 (0.0007) [2023-12-28 02:21:39,900][106226] Updated weights for policy 0, policy_version 988576 (0.0009) [2023-12-28 02:21:39,962][106225] Updated weights for policy 1, policy_version 990964 (0.0008) [2023-12-28 02:21:40,025][106225] Updated weights for policy 1, policy_version 990974 (0.0008) [2023-12-28 02:21:40,513][106226] Updated weights for policy 0, policy_version 988586 (0.0009) [2023-12-28 02:21:40,576][106226] Updated weights for policy 0, policy_version 988596 (0.0007) [2023-12-28 02:21:40,637][106226] Updated weights for policy 0, policy_version 988606 (0.0007) [2023-12-28 02:21:40,696][106225] Updated weights for policy 1, policy_version 990984 (0.0009) [2023-12-28 02:21:40,749][106225] Updated weights for policy 1, policy_version 990994 (0.0009) [2023-12-28 02:21:40,809][106225] Updated weights for policy 1, policy_version 991004 (0.0008) [2023-12-28 02:21:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506880000. Throughput: 0: 9894.8, 1: 9904.9. Samples: 506849668. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:41,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.143')] [2023-12-28 02:21:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000991008_253739008.pth... [2023-12-28 02:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000988608_253140992.pth... [2023-12-28 02:21:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000987456_252846080.pth [2023-12-28 02:21:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000989856_253444096.pth [2023-12-28 02:21:41,260][106226] Updated weights for policy 0, policy_version 988616 (0.0007) [2023-12-28 02:21:41,328][106226] Updated weights for policy 0, policy_version 988626 (0.0008) [2023-12-28 02:21:41,400][106226] Updated weights for policy 0, policy_version 988636 (0.0007) [2023-12-28 02:21:41,644][106225] Updated weights for policy 1, policy_version 991014 (0.0009) [2023-12-28 02:21:41,709][106225] Updated weights for policy 1, policy_version 991024 (0.0010) [2023-12-28 02:21:41,774][106225] Updated weights for policy 1, policy_version 991034 (0.0010) [2023-12-28 02:21:42,129][106226] Updated weights for policy 0, policy_version 988646 (0.0007) [2023-12-28 02:21:42,185][106226] Updated weights for policy 0, policy_version 988656 (0.0008) [2023-12-28 02:21:42,250][106226] Updated weights for policy 0, policy_version 988666 (0.0009) [2023-12-28 02:21:42,528][106225] Updated weights for policy 1, policy_version 991044 (0.0009) [2023-12-28 02:21:42,592][106225] Updated weights for policy 1, policy_version 991054 (0.0010) [2023-12-28 02:21:42,653][106225] Updated weights for policy 1, policy_version 991064 (0.0011) [2023-12-28 02:21:43,062][106226] Updated weights for policy 0, policy_version 988676 (0.0009) [2023-12-28 02:21:43,120][106226] Updated weights for policy 0, policy_version 988686 (0.0008) [2023-12-28 02:21:43,174][106226] Updated weights for policy 0, policy_version 988696 (0.0008) [2023-12-28 02:21:43,324][106225] Updated weights for policy 1, policy_version 991074 (0.0010) [2023-12-28 02:21:43,384][106225] Updated weights for policy 1, policy_version 991084 (0.0008) [2023-12-28 02:21:43,442][106225] Updated weights for policy 1, policy_version 991094 (0.0006) [2023-12-28 02:21:43,497][106225] Updated weights for policy 1, policy_version 991104 (0.0005) [2023-12-28 02:21:43,951][106226] Updated weights for policy 0, policy_version 988706 (0.0009) [2023-12-28 02:21:44,007][106226] Updated weights for policy 0, policy_version 988716 (0.0008) [2023-12-28 02:21:44,061][106226] Updated weights for policy 0, policy_version 988726 (0.0008) [2023-12-28 02:21:44,123][106226] Updated weights for policy 0, policy_version 988736 (0.0008) [2023-12-28 02:21:44,148][106225] Updated weights for policy 1, policy_version 991114 (0.0007) [2023-12-28 02:21:44,216][106225] Updated weights for policy 1, policy_version 991124 (0.0005) [2023-12-28 02:21:44,278][106225] Updated weights for policy 1, policy_version 991134 (0.0005) [2023-12-28 02:21:44,840][106225] Updated weights for policy 1, policy_version 991144 (0.0009) [2023-12-28 02:21:44,902][106225] Updated weights for policy 1, policy_version 991154 (0.0008) [2023-12-28 02:21:44,944][106226] Updated weights for policy 0, policy_version 988746 (0.0006) [2023-12-28 02:21:44,964][106225] Updated weights for policy 1, policy_version 991164 (0.0008) [2023-12-28 02:21:44,999][106226] Updated weights for policy 0, policy_version 988756 (0.0007) [2023-12-28 02:21:45,065][106226] Updated weights for policy 0, policy_version 988766 (0.0009) [2023-12-28 02:21:45,676][106225] Updated weights for policy 1, policy_version 991174 (0.0007) [2023-12-28 02:21:45,727][106225] Updated weights for policy 1, policy_version 991184 (0.0008) [2023-12-28 02:21:45,771][106225] Updated weights for policy 1, policy_version 991194 (0.0007) [2023-12-28 02:21:45,796][106226] Updated weights for policy 0, policy_version 988776 (0.0008) [2023-12-28 02:21:45,845][106226] Updated weights for policy 0, policy_version 988786 (0.0008) [2023-12-28 02:21:45,900][106226] Updated weights for policy 0, policy_version 988796 (0.0009) [2023-12-28 02:21:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 506978304. Throughput: 0: 9829.4, 1: 9898.6. Samples: 506966688. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:46,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-4.910')] [2023-12-28 02:21:46,512][106225] Updated weights for policy 1, policy_version 991204 (0.0008) [2023-12-28 02:21:46,578][106225] Updated weights for policy 1, policy_version 991214 (0.0010) [2023-12-28 02:21:46,583][106226] Updated weights for policy 0, policy_version 988806 (0.0008) [2023-12-28 02:21:46,627][106226] Updated weights for policy 0, policy_version 988816 (0.0005) [2023-12-28 02:21:46,635][106225] Updated weights for policy 1, policy_version 991224 (0.0007) [2023-12-28 02:21:46,677][106226] Updated weights for policy 0, policy_version 988826 (0.0005) [2023-12-28 02:21:47,269][106225] Updated weights for policy 1, policy_version 991234 (0.0007) [2023-12-28 02:21:47,292][106226] Updated weights for policy 0, policy_version 988836 (0.0005) [2023-12-28 02:21:47,325][106225] Updated weights for policy 1, policy_version 991244 (0.0005) [2023-12-28 02:21:47,357][106226] Updated weights for policy 0, policy_version 988846 (0.0005) [2023-12-28 02:21:47,394][106225] Updated weights for policy 1, policy_version 991254 (0.0007) [2023-12-28 02:21:47,423][106226] Updated weights for policy 0, policy_version 988856 (0.0006) [2023-12-28 02:21:47,456][106225] Updated weights for policy 1, policy_version 991264 (0.0007) [2023-12-28 02:21:48,080][106225] Updated weights for policy 1, policy_version 991274 (0.0010) [2023-12-28 02:21:48,100][106226] Updated weights for policy 0, policy_version 988866 (0.0006) [2023-12-28 02:21:48,132][106225] Updated weights for policy 1, policy_version 991284 (0.0010) [2023-12-28 02:21:48,153][106226] Updated weights for policy 0, policy_version 988876 (0.0005) [2023-12-28 02:21:48,182][106225] Updated weights for policy 1, policy_version 991294 (0.0010) [2023-12-28 02:21:48,200][106226] Updated weights for policy 0, policy_version 988886 (0.0006) [2023-12-28 02:21:48,256][106226] Updated weights for policy 0, policy_version 988896 (0.0008) [2023-12-28 02:21:48,920][106225] Updated weights for policy 1, policy_version 991304 (0.0010) [2023-12-28 02:21:48,978][106225] Updated weights for policy 1, policy_version 991314 (0.0010) [2023-12-28 02:21:49,013][106226] Updated weights for policy 0, policy_version 988906 (0.0008) [2023-12-28 02:21:49,029][106225] Updated weights for policy 1, policy_version 991324 (0.0010) [2023-12-28 02:21:49,072][106226] Updated weights for policy 0, policy_version 988916 (0.0009) [2023-12-28 02:21:49,131][106226] Updated weights for policy 0, policy_version 988926 (0.0008) [2023-12-28 02:21:49,768][106225] Updated weights for policy 1, policy_version 991334 (0.0009) [2023-12-28 02:21:49,830][106225] Updated weights for policy 1, policy_version 991344 (0.0008) [2023-12-28 02:21:49,906][106225] Updated weights for policy 1, policy_version 991354 (0.0010) [2023-12-28 02:21:49,913][106226] Updated weights for policy 0, policy_version 988936 (0.0010) [2023-12-28 02:21:49,987][106226] Updated weights for policy 0, policy_version 988946 (0.0008) [2023-12-28 02:21:50,053][106226] Updated weights for policy 0, policy_version 988956 (0.0010) [2023-12-28 02:21:50,565][106225] Updated weights for policy 1, policy_version 991364 (0.0008) [2023-12-28 02:21:50,628][106225] Updated weights for policy 1, policy_version 991374 (0.0008) [2023-12-28 02:21:50,689][106225] Updated weights for policy 1, policy_version 991384 (0.0006) [2023-12-28 02:21:50,829][106226] Updated weights for policy 0, policy_version 988966 (0.0008) [2023-12-28 02:21:50,890][106226] Updated weights for policy 0, policy_version 988976 (0.0009) [2023-12-28 02:21:50,949][106226] Updated weights for policy 0, policy_version 988986 (0.0008) [2023-12-28 02:21:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 507076608. Throughput: 0: 9849.7, 1: 9859.3. Samples: 507084252. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:51,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-5.240')] [2023-12-28 02:21:51,325][106225] Updated weights for policy 1, policy_version 991394 (0.0006) [2023-12-28 02:21:51,399][106225] Updated weights for policy 1, policy_version 991404 (0.0007) [2023-12-28 02:21:51,464][106225] Updated weights for policy 1, policy_version 991414 (0.0007) [2023-12-28 02:21:51,530][106225] Updated weights for policy 1, policy_version 991424 (0.0007) [2023-12-28 02:21:51,715][106226] Updated weights for policy 0, policy_version 988996 (0.0009) [2023-12-28 02:21:51,779][106226] Updated weights for policy 0, policy_version 989006 (0.0009) [2023-12-28 02:21:51,833][106226] Updated weights for policy 0, policy_version 989016 (0.0009) [2023-12-28 02:21:52,219][106225] Updated weights for policy 1, policy_version 991434 (0.0009) [2023-12-28 02:21:52,268][106225] Updated weights for policy 1, policy_version 991444 (0.0008) [2023-12-28 02:21:52,330][106225] Updated weights for policy 1, policy_version 991454 (0.0008) [2023-12-28 02:21:52,499][106226] Updated weights for policy 0, policy_version 989026 (0.0008) [2023-12-28 02:21:52,558][106226] Updated weights for policy 0, policy_version 989036 (0.0006) [2023-12-28 02:21:52,620][106226] Updated weights for policy 0, policy_version 989046 (0.0007) [2023-12-28 02:21:52,680][106226] Updated weights for policy 0, policy_version 989056 (0.0006) [2023-12-28 02:21:53,143][106225] Updated weights for policy 1, policy_version 991464 (0.0008) [2023-12-28 02:21:53,205][106225] Updated weights for policy 1, policy_version 991474 (0.0008) [2023-12-28 02:21:53,268][106225] Updated weights for policy 1, policy_version 991484 (0.0006) [2023-12-28 02:21:53,299][106226] Updated weights for policy 0, policy_version 989066 (0.0007) [2023-12-28 02:21:53,363][106226] Updated weights for policy 0, policy_version 989076 (0.0006) [2023-12-28 02:21:53,422][106226] Updated weights for policy 0, policy_version 989086 (0.0006) [2023-12-28 02:21:53,846][106225] Updated weights for policy 1, policy_version 991494 (0.0008) [2023-12-28 02:21:53,918][106225] Updated weights for policy 1, policy_version 991504 (0.0009) [2023-12-28 02:21:53,987][106225] Updated weights for policy 1, policy_version 991514 (0.0006) [2023-12-28 02:21:54,047][106226] Updated weights for policy 0, policy_version 989096 (0.0008) [2023-12-28 02:21:54,111][106226] Updated weights for policy 0, policy_version 989106 (0.0008) [2023-12-28 02:21:54,183][106226] Updated weights for policy 0, policy_version 989116 (0.0008) [2023-12-28 02:21:54,663][106225] Updated weights for policy 1, policy_version 991524 (0.0008) [2023-12-28 02:21:54,709][106225] Updated weights for policy 1, policy_version 991534 (0.0010) [2023-12-28 02:21:54,755][106225] Updated weights for policy 1, policy_version 991544 (0.0010) [2023-12-28 02:21:54,812][106226] Updated weights for policy 0, policy_version 989126 (0.0006) [2023-12-28 02:21:54,866][106226] Updated weights for policy 0, policy_version 989136 (0.0008) [2023-12-28 02:21:54,923][106226] Updated weights for policy 0, policy_version 989146 (0.0008) [2023-12-28 02:21:55,399][106225] Updated weights for policy 1, policy_version 991554 (0.0010) [2023-12-28 02:21:55,447][106225] Updated weights for policy 1, policy_version 991564 (0.0010) [2023-12-28 02:21:55,510][106225] Updated weights for policy 1, policy_version 991574 (0.0010) [2023-12-28 02:21:55,567][106225] Updated weights for policy 1, policy_version 991584 (0.0010) [2023-12-28 02:21:55,623][106226] Updated weights for policy 0, policy_version 989156 (0.0007) [2023-12-28 02:21:55,678][106226] Updated weights for policy 0, policy_version 989166 (0.0007) [2023-12-28 02:21:55,734][106226] Updated weights for policy 0, policy_version 989176 (0.0009) [2023-12-28 02:21:56,168][106225] Updated weights for policy 1, policy_version 991594 (0.0006) [2023-12-28 02:21:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 507174912. Throughput: 0: 9887.0, 1: 9862.6. Samples: 507144936. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:21:56,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-5.084')] [2023-12-28 02:21:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000989184_253288448.pth... [2023-12-28 02:21:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000988032_252993536.pth [2023-12-28 02:21:56,217][106225] Updated weights for policy 1, policy_version 991604 (0.0006) [2023-12-28 02:21:56,269][106225] Updated weights for policy 1, policy_version 991614 (0.0005) [2023-12-28 02:21:56,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000991616_253894656.pth... [2023-12-28 02:21:56,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000990432_253591552.pth [2023-12-28 02:21:56,499][106226] Updated weights for policy 0, policy_version 989186 (0.0008) [2023-12-28 02:21:56,558][106226] Updated weights for policy 0, policy_version 989196 (0.0007) [2023-12-28 02:21:56,621][106226] Updated weights for policy 0, policy_version 989206 (0.0007) [2023-12-28 02:21:56,671][106226] Updated weights for policy 0, policy_version 989216 (0.0007) [2023-12-28 02:21:56,919][106225] Updated weights for policy 1, policy_version 991624 (0.0009) [2023-12-28 02:21:56,968][106225] Updated weights for policy 1, policy_version 991634 (0.0006) [2023-12-28 02:21:57,028][106225] Updated weights for policy 1, policy_version 991644 (0.0007) [2023-12-28 02:21:57,357][106226] Updated weights for policy 0, policy_version 989226 (0.0008) [2023-12-28 02:21:57,405][106226] Updated weights for policy 0, policy_version 989236 (0.0007) [2023-12-28 02:21:57,457][106226] Updated weights for policy 0, policy_version 989246 (0.0008) [2023-12-28 02:21:57,737][106225] Updated weights for policy 1, policy_version 991654 (0.0009) [2023-12-28 02:21:57,790][106225] Updated weights for policy 1, policy_version 991664 (0.0010) [2023-12-28 02:21:57,839][106225] Updated weights for policy 1, policy_version 991674 (0.0010) [2023-12-28 02:21:58,189][106226] Updated weights for policy 0, policy_version 989256 (0.0008) [2023-12-28 02:21:58,254][106226] Updated weights for policy 0, policy_version 989266 (0.0009) [2023-12-28 02:21:58,319][106226] Updated weights for policy 0, policy_version 989276 (0.0008) [2023-12-28 02:21:58,591][106225] Updated weights for policy 1, policy_version 991684 (0.0010) [2023-12-28 02:21:58,648][106225] Updated weights for policy 1, policy_version 991694 (0.0010) [2023-12-28 02:21:58,713][106225] Updated weights for policy 1, policy_version 991704 (0.0009) [2023-12-28 02:21:59,199][106226] Updated weights for policy 0, policy_version 989286 (0.0008) [2023-12-28 02:21:59,272][106226] Updated weights for policy 0, policy_version 989296 (0.0009) [2023-12-28 02:21:59,334][106226] Updated weights for policy 0, policy_version 989306 (0.0007) [2023-12-28 02:21:59,491][106225] Updated weights for policy 1, policy_version 991714 (0.0008) [2023-12-28 02:21:59,547][106225] Updated weights for policy 1, policy_version 991724 (0.0008) [2023-12-28 02:21:59,606][106225] Updated weights for policy 1, policy_version 991734 (0.0008) [2023-12-28 02:21:59,673][106225] Updated weights for policy 1, policy_version 991744 (0.0008) [2023-12-28 02:22:00,055][106226] Updated weights for policy 0, policy_version 989316 (0.0009) [2023-12-28 02:22:00,130][106226] Updated weights for policy 0, policy_version 989326 (0.0009) [2023-12-28 02:22:00,196][106226] Updated weights for policy 0, policy_version 989336 (0.0010) [2023-12-28 02:22:00,327][106225] Updated weights for policy 1, policy_version 991754 (0.0005) [2023-12-28 02:22:00,391][106225] Updated weights for policy 1, policy_version 991764 (0.0006) [2023-12-28 02:22:00,436][106225] Updated weights for policy 1, policy_version 991774 (0.0006) [2023-12-28 02:22:00,833][106226] Updated weights for policy 0, policy_version 989346 (0.0007) [2023-12-28 02:22:00,895][106226] Updated weights for policy 0, policy_version 989356 (0.0005) [2023-12-28 02:22:00,950][106226] Updated weights for policy 0, policy_version 989366 (0.0009) [2023-12-28 02:22:01,010][106226] Updated weights for policy 0, policy_version 989376 (0.0011) [2023-12-28 02:22:01,016][106225] Updated weights for policy 1, policy_version 991784 (0.0005) [2023-12-28 02:22:01,079][106225] Updated weights for policy 1, policy_version 991794 (0.0007) [2023-12-28 02:22:01,139][106225] Updated weights for policy 1, policy_version 991804 (0.0010) [2023-12-28 02:22:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 507281408. Throughput: 0: 9860.1, 1: 9939.1. Samples: 507262952. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:01,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.943')] [2023-12-28 02:22:01,691][106226] Updated weights for policy 0, policy_version 989386 (0.0008) [2023-12-28 02:22:01,763][106226] Updated weights for policy 0, policy_version 989396 (0.0010) [2023-12-28 02:22:01,829][106226] Updated weights for policy 0, policy_version 989406 (0.0009) [2023-12-28 02:22:01,862][106225] Updated weights for policy 1, policy_version 991814 (0.0008) [2023-12-28 02:22:01,925][106225] Updated weights for policy 1, policy_version 991824 (0.0007) [2023-12-28 02:22:01,993][106225] Updated weights for policy 1, policy_version 991834 (0.0006) [2023-12-28 02:22:02,518][106226] Updated weights for policy 0, policy_version 989416 (0.0009) [2023-12-28 02:22:02,573][106226] Updated weights for policy 0, policy_version 989426 (0.0009) [2023-12-28 02:22:02,626][106226] Updated weights for policy 0, policy_version 989436 (0.0007) [2023-12-28 02:22:02,716][106225] Updated weights for policy 1, policy_version 991844 (0.0007) [2023-12-28 02:22:02,782][106225] Updated weights for policy 1, policy_version 991854 (0.0009) [2023-12-28 02:22:02,835][106225] Updated weights for policy 1, policy_version 991864 (0.0009) [2023-12-28 02:22:03,302][106226] Updated weights for policy 0, policy_version 989446 (0.0006) [2023-12-28 02:22:03,354][106226] Updated weights for policy 0, policy_version 989456 (0.0005) [2023-12-28 02:22:03,408][106226] Updated weights for policy 0, policy_version 989466 (0.0005) [2023-12-28 02:22:03,604][106225] Updated weights for policy 1, policy_version 991874 (0.0010) [2023-12-28 02:22:03,656][106225] Updated weights for policy 1, policy_version 991884 (0.0008) [2023-12-28 02:22:03,710][106225] Updated weights for policy 1, policy_version 991894 (0.0008) [2023-12-28 02:22:03,760][106225] Updated weights for policy 1, policy_version 991904 (0.0008) [2023-12-28 02:22:03,971][106226] Updated weights for policy 0, policy_version 989476 (0.0006) [2023-12-28 02:22:04,029][106226] Updated weights for policy 0, policy_version 989486 (0.0009) [2023-12-28 02:22:04,082][106226] Updated weights for policy 0, policy_version 989496 (0.0009) [2023-12-28 02:22:04,549][106225] Updated weights for policy 1, policy_version 991914 (0.0010) [2023-12-28 02:22:04,619][106225] Updated weights for policy 1, policy_version 991924 (0.0009) [2023-12-28 02:22:04,681][106225] Updated weights for policy 1, policy_version 991934 (0.0009) [2023-12-28 02:22:04,725][106226] Updated weights for policy 0, policy_version 989506 (0.0008) [2023-12-28 02:22:04,785][106226] Updated weights for policy 0, policy_version 989516 (0.0005) [2023-12-28 02:22:04,836][106226] Updated weights for policy 0, policy_version 989526 (0.0005) [2023-12-28 02:22:04,890][106226] Updated weights for policy 0, policy_version 989536 (0.0005) [2023-12-28 02:22:05,442][106225] Updated weights for policy 1, policy_version 991944 (0.0008) [2023-12-28 02:22:05,492][106225] Updated weights for policy 1, policy_version 991954 (0.0008) [2023-12-28 02:22:05,550][106225] Updated weights for policy 1, policy_version 991964 (0.0007) [2023-12-28 02:22:05,560][106226] Updated weights for policy 0, policy_version 989546 (0.0007) [2023-12-28 02:22:05,621][106226] Updated weights for policy 0, policy_version 989556 (0.0007) [2023-12-28 02:22:05,676][106226] Updated weights for policy 0, policy_version 989566 (0.0009) [2023-12-28 02:22:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 507371520. Throughput: 0: 9897.5, 1: 9855.4. Samples: 507383140. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:06,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.972')] [2023-12-28 02:22:06,261][106225] Updated weights for policy 1, policy_version 991974 (0.0007) [2023-12-28 02:22:06,312][106225] Updated weights for policy 1, policy_version 991984 (0.0008) [2023-12-28 02:22:06,364][106225] Updated weights for policy 1, policy_version 991994 (0.0008) [2023-12-28 02:22:06,409][106226] Updated weights for policy 0, policy_version 989576 (0.0010) [2023-12-28 02:22:06,467][106226] Updated weights for policy 0, policy_version 989586 (0.0010) [2023-12-28 02:22:06,528][106226] Updated weights for policy 0, policy_version 989596 (0.0011) [2023-12-28 02:22:07,117][106225] Updated weights for policy 1, policy_version 992004 (0.0007) [2023-12-28 02:22:07,180][106225] Updated weights for policy 1, policy_version 992014 (0.0009) [2023-12-28 02:22:07,228][106226] Updated weights for policy 0, policy_version 989606 (0.0009) [2023-12-28 02:22:07,240][106225] Updated weights for policy 1, policy_version 992024 (0.0010) [2023-12-28 02:22:07,284][106226] Updated weights for policy 0, policy_version 989616 (0.0006) [2023-12-28 02:22:07,343][106226] Updated weights for policy 0, policy_version 989626 (0.0009) [2023-12-28 02:22:07,829][106225] Updated weights for policy 1, policy_version 992034 (0.0008) [2023-12-28 02:22:07,881][106225] Updated weights for policy 1, policy_version 992044 (0.0007) [2023-12-28 02:22:07,932][106225] Updated weights for policy 1, policy_version 992054 (0.0008) [2023-12-28 02:22:07,959][106226] Updated weights for policy 0, policy_version 989636 (0.0009) [2023-12-28 02:22:07,997][106225] Updated weights for policy 1, policy_version 992064 (0.0007) [2023-12-28 02:22:08,019][106226] Updated weights for policy 0, policy_version 989646 (0.0007) [2023-12-28 02:22:08,084][106226] Updated weights for policy 0, policy_version 989656 (0.0009) [2023-12-28 02:22:08,651][106225] Updated weights for policy 1, policy_version 992074 (0.0008) [2023-12-28 02:22:08,716][106225] Updated weights for policy 1, policy_version 992084 (0.0007) [2023-12-28 02:22:08,783][106225] Updated weights for policy 1, policy_version 992094 (0.0011) [2023-12-28 02:22:08,825][106226] Updated weights for policy 0, policy_version 989666 (0.0007) [2023-12-28 02:22:08,891][106226] Updated weights for policy 0, policy_version 989676 (0.0007) [2023-12-28 02:22:08,949][106226] Updated weights for policy 0, policy_version 989686 (0.0007) [2023-12-28 02:22:09,010][106226] Updated weights for policy 0, policy_version 989696 (0.0005) [2023-12-28 02:22:09,556][106225] Updated weights for policy 1, policy_version 992104 (0.0009) [2023-12-28 02:22:09,619][106225] Updated weights for policy 1, policy_version 992114 (0.0008) [2023-12-28 02:22:09,679][106226] Updated weights for policy 0, policy_version 989706 (0.0009) [2023-12-28 02:22:09,685][106225] Updated weights for policy 1, policy_version 992124 (0.0006) [2023-12-28 02:22:09,742][106226] Updated weights for policy 0, policy_version 989716 (0.0010) [2023-12-28 02:22:09,795][106226] Updated weights for policy 0, policy_version 989726 (0.0007) [2023-12-28 02:22:10,428][106225] Updated weights for policy 1, policy_version 992134 (0.0007) [2023-12-28 02:22:10,489][106225] Updated weights for policy 1, policy_version 992144 (0.0008) [2023-12-28 02:22:10,537][106226] Updated weights for policy 0, policy_version 989736 (0.0010) [2023-12-28 02:22:10,547][106225] Updated weights for policy 1, policy_version 992154 (0.0005) [2023-12-28 02:22:10,597][106226] Updated weights for policy 0, policy_version 989746 (0.0011) [2023-12-28 02:22:10,658][106226] Updated weights for policy 0, policy_version 989756 (0.0011) [2023-12-28 02:22:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 507469824. Throughput: 0: 9928.0, 1: 9940.2. Samples: 507444528. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:11,175][105115] Avg episode reward: [(0, '-4.824'), (1, '-4.898')] [2023-12-28 02:22:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000992160_254033920.pth... [2023-12-28 02:22:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000989760_253435904.pth... [2023-12-28 02:22:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000991008_253739008.pth [2023-12-28 02:22:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000988608_253140992.pth [2023-12-28 02:22:11,321][106225] Updated weights for policy 1, policy_version 992164 (0.0007) [2023-12-28 02:22:11,378][106226] Updated weights for policy 0, policy_version 989766 (0.0009) [2023-12-28 02:22:11,400][106225] Updated weights for policy 1, policy_version 992174 (0.0009) [2023-12-28 02:22:11,448][106226] Updated weights for policy 0, policy_version 989776 (0.0008) [2023-12-28 02:22:11,463][106225] Updated weights for policy 1, policy_version 992184 (0.0010) [2023-12-28 02:22:11,508][106226] Updated weights for policy 0, policy_version 989786 (0.0008) [2023-12-28 02:22:12,164][106225] Updated weights for policy 1, policy_version 992194 (0.0010) [2023-12-28 02:22:12,221][106225] Updated weights for policy 1, policy_version 992204 (0.0006) [2023-12-28 02:22:12,223][106226] Updated weights for policy 0, policy_version 989796 (0.0007) [2023-12-28 02:22:12,292][106226] Updated weights for policy 0, policy_version 989806 (0.0008) [2023-12-28 02:22:12,303][106225] Updated weights for policy 1, policy_version 992214 (0.0007) [2023-12-28 02:22:12,352][106226] Updated weights for policy 0, policy_version 989816 (0.0009) [2023-12-28 02:22:12,364][106225] Updated weights for policy 1, policy_version 992224 (0.0008) [2023-12-28 02:22:13,060][106225] Updated weights for policy 1, policy_version 992234 (0.0008) [2023-12-28 02:22:13,115][106225] Updated weights for policy 1, policy_version 992244 (0.0008) [2023-12-28 02:22:13,161][106226] Updated weights for policy 0, policy_version 989826 (0.0009) [2023-12-28 02:22:13,165][106225] Updated weights for policy 1, policy_version 992254 (0.0006) [2023-12-28 02:22:13,224][106226] Updated weights for policy 0, policy_version 989836 (0.0008) [2023-12-28 02:22:13,285][106226] Updated weights for policy 0, policy_version 989846 (0.0009) [2023-12-28 02:22:13,355][106226] Updated weights for policy 0, policy_version 989856 (0.0009) [2023-12-28 02:22:13,823][106225] Updated weights for policy 1, policy_version 992264 (0.0008) [2023-12-28 02:22:13,881][106225] Updated weights for policy 1, policy_version 992274 (0.0009) [2023-12-28 02:22:13,933][106225] Updated weights for policy 1, policy_version 992284 (0.0009) [2023-12-28 02:22:13,967][106226] Updated weights for policy 0, policy_version 989866 (0.0007) [2023-12-28 02:22:14,023][106226] Updated weights for policy 0, policy_version 989876 (0.0007) [2023-12-28 02:22:14,081][106226] Updated weights for policy 0, policy_version 989886 (0.0011) [2023-12-28 02:22:14,640][106225] Updated weights for policy 1, policy_version 992294 (0.0006) [2023-12-28 02:22:14,701][106225] Updated weights for policy 1, policy_version 992304 (0.0007) [2023-12-28 02:22:14,761][106225] Updated weights for policy 1, policy_version 992314 (0.0006) [2023-12-28 02:22:14,780][106226] Updated weights for policy 0, policy_version 989896 (0.0010) [2023-12-28 02:22:14,853][106226] Updated weights for policy 0, policy_version 989906 (0.0009) [2023-12-28 02:22:14,921][106226] Updated weights for policy 0, policy_version 989916 (0.0009) [2023-12-28 02:22:15,416][106225] Updated weights for policy 1, policy_version 992324 (0.0009) [2023-12-28 02:22:15,472][106225] Updated weights for policy 1, policy_version 992334 (0.0009) [2023-12-28 02:22:15,524][106225] Updated weights for policy 1, policy_version 992344 (0.0008) [2023-12-28 02:22:15,675][106226] Updated weights for policy 0, policy_version 989926 (0.0007) [2023-12-28 02:22:15,741][106226] Updated weights for policy 0, policy_version 989936 (0.0005) [2023-12-28 02:22:15,812][106226] Updated weights for policy 0, policy_version 989946 (0.0006) [2023-12-28 02:22:16,124][106225] Updated weights for policy 1, policy_version 992354 (0.0008) [2023-12-28 02:22:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 507568128. Throughput: 0: 9852.5, 1: 9940.5. Samples: 507560268. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:16,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-5.030')] [2023-12-28 02:22:16,194][106225] Updated weights for policy 1, policy_version 992364 (0.0010) [2023-12-28 02:22:16,254][106225] Updated weights for policy 1, policy_version 992374 (0.0010) [2023-12-28 02:22:16,300][106225] Updated weights for policy 1, policy_version 992384 (0.0010) [2023-12-28 02:22:16,397][106226] Updated weights for policy 0, policy_version 989956 (0.0007) [2023-12-28 02:22:16,458][106226] Updated weights for policy 0, policy_version 989966 (0.0007) [2023-12-28 02:22:16,521][106226] Updated weights for policy 0, policy_version 989976 (0.0007) [2023-12-28 02:22:16,901][106225] Updated weights for policy 1, policy_version 992394 (0.0007) [2023-12-28 02:22:16,953][106225] Updated weights for policy 1, policy_version 992404 (0.0005) [2023-12-28 02:22:16,997][106225] Updated weights for policy 1, policy_version 992414 (0.0005) [2023-12-28 02:22:17,053][106226] Updated weights for policy 0, policy_version 989986 (0.0006) [2023-12-28 02:22:17,112][106226] Updated weights for policy 0, policy_version 989996 (0.0008) [2023-12-28 02:22:17,179][106226] Updated weights for policy 0, policy_version 990006 (0.0007) [2023-12-28 02:22:17,237][106226] Updated weights for policy 0, policy_version 990016 (0.0009) [2023-12-28 02:22:17,620][106225] Updated weights for policy 1, policy_version 992424 (0.0005) [2023-12-28 02:22:17,668][106225] Updated weights for policy 1, policy_version 992434 (0.0005) [2023-12-28 02:22:17,733][106225] Updated weights for policy 1, policy_version 992444 (0.0007) [2023-12-28 02:22:17,858][106226] Updated weights for policy 0, policy_version 990026 (0.0008) [2023-12-28 02:22:17,913][106226] Updated weights for policy 0, policy_version 990036 (0.0007) [2023-12-28 02:22:17,973][106226] Updated weights for policy 0, policy_version 990046 (0.0008) [2023-12-28 02:22:18,382][106225] Updated weights for policy 1, policy_version 992454 (0.0008) [2023-12-28 02:22:18,434][106225] Updated weights for policy 1, policy_version 992464 (0.0008) [2023-12-28 02:22:18,488][106225] Updated weights for policy 1, policy_version 992474 (0.0007) [2023-12-28 02:22:18,698][106226] Updated weights for policy 0, policy_version 990056 (0.0008) [2023-12-28 02:22:18,767][106226] Updated weights for policy 0, policy_version 990066 (0.0008) [2023-12-28 02:22:18,833][106226] Updated weights for policy 0, policy_version 990076 (0.0008) [2023-12-28 02:22:19,239][106225] Updated weights for policy 1, policy_version 992484 (0.0010) [2023-12-28 02:22:19,305][106225] Updated weights for policy 1, policy_version 992494 (0.0010) [2023-12-28 02:22:19,374][106225] Updated weights for policy 1, policy_version 992504 (0.0011) [2023-12-28 02:22:19,523][106226] Updated weights for policy 0, policy_version 990086 (0.0008) [2023-12-28 02:22:19,584][106226] Updated weights for policy 0, policy_version 990096 (0.0008) [2023-12-28 02:22:19,652][106226] Updated weights for policy 0, policy_version 990106 (0.0008) [2023-12-28 02:22:20,077][106225] Updated weights for policy 1, policy_version 992514 (0.0010) [2023-12-28 02:22:20,130][106225] Updated weights for policy 1, policy_version 992524 (0.0008) [2023-12-28 02:22:20,193][106225] Updated weights for policy 1, policy_version 992534 (0.0005) [2023-12-28 02:22:20,247][106225] Updated weights for policy 1, policy_version 992544 (0.0009) [2023-12-28 02:22:20,381][106226] Updated weights for policy 0, policy_version 990116 (0.0009) [2023-12-28 02:22:20,444][106226] Updated weights for policy 0, policy_version 990126 (0.0011) [2023-12-28 02:22:20,501][106226] Updated weights for policy 0, policy_version 990136 (0.0007) [2023-12-28 02:22:20,936][106225] Updated weights for policy 1, policy_version 992554 (0.0008) [2023-12-28 02:22:20,999][106225] Updated weights for policy 1, policy_version 992564 (0.0011) [2023-12-28 02:22:21,067][106225] Updated weights for policy 1, policy_version 992574 (0.0009) [2023-12-28 02:22:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 507674624. Throughput: 0: 9910.0, 1: 9985.8. Samples: 507684444. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:21,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-5.269')] [2023-12-28 02:22:21,236][106226] Updated weights for policy 0, policy_version 990146 (0.0006) [2023-12-28 02:22:21,295][106226] Updated weights for policy 0, policy_version 990156 (0.0009) [2023-12-28 02:22:21,362][106226] Updated weights for policy 0, policy_version 990166 (0.0009) [2023-12-28 02:22:21,434][106226] Updated weights for policy 0, policy_version 990176 (0.0007) [2023-12-28 02:22:21,814][106225] Updated weights for policy 1, policy_version 992584 (0.0007) [2023-12-28 02:22:21,882][106225] Updated weights for policy 1, policy_version 992594 (0.0006) [2023-12-28 02:22:21,943][106225] Updated weights for policy 1, policy_version 992604 (0.0007) [2023-12-28 02:22:22,162][106226] Updated weights for policy 0, policy_version 990186 (0.0008) [2023-12-28 02:22:22,231][106226] Updated weights for policy 0, policy_version 990196 (0.0008) [2023-12-28 02:22:22,299][106226] Updated weights for policy 0, policy_version 990206 (0.0008) [2023-12-28 02:22:22,566][106225] Updated weights for policy 1, policy_version 992614 (0.0008) [2023-12-28 02:22:22,624][106225] Updated weights for policy 1, policy_version 992624 (0.0010) [2023-12-28 02:22:22,679][106225] Updated weights for policy 1, policy_version 992634 (0.0010) [2023-12-28 02:22:22,998][106226] Updated weights for policy 0, policy_version 990216 (0.0011) [2023-12-28 02:22:23,049][106226] Updated weights for policy 0, policy_version 990226 (0.0011) [2023-12-28 02:22:23,116][106226] Updated weights for policy 0, policy_version 990236 (0.0010) [2023-12-28 02:22:23,375][106225] Updated weights for policy 1, policy_version 992644 (0.0009) [2023-12-28 02:22:23,444][106225] Updated weights for policy 1, policy_version 992654 (0.0011) [2023-12-28 02:22:23,508][106225] Updated weights for policy 1, policy_version 992664 (0.0011) [2023-12-28 02:22:23,930][106226] Updated weights for policy 0, policy_version 990246 (0.0009) [2023-12-28 02:22:23,989][106226] Updated weights for policy 0, policy_version 990256 (0.0008) [2023-12-28 02:22:24,039][106226] Updated weights for policy 0, policy_version 990266 (0.0007) [2023-12-28 02:22:24,243][106225] Updated weights for policy 1, policy_version 992674 (0.0011) [2023-12-28 02:22:24,297][106225] Updated weights for policy 1, policy_version 992684 (0.0010) [2023-12-28 02:22:24,357][106225] Updated weights for policy 1, policy_version 992694 (0.0010) [2023-12-28 02:22:24,413][106225] Updated weights for policy 1, policy_version 992704 (0.0010) [2023-12-28 02:22:24,784][106226] Updated weights for policy 0, policy_version 990276 (0.0008) [2023-12-28 02:22:24,833][106226] Updated weights for policy 0, policy_version 990286 (0.0006) [2023-12-28 02:22:24,882][106226] Updated weights for policy 0, policy_version 990296 (0.0007) [2023-12-28 02:22:25,092][106225] Updated weights for policy 1, policy_version 992714 (0.0005) [2023-12-28 02:22:25,152][106225] Updated weights for policy 1, policy_version 992724 (0.0005) [2023-12-28 02:22:25,214][106225] Updated weights for policy 1, policy_version 992734 (0.0007) [2023-12-28 02:22:25,613][106226] Updated weights for policy 0, policy_version 990306 (0.0007) [2023-12-28 02:22:25,679][106226] Updated weights for policy 0, policy_version 990316 (0.0005) [2023-12-28 02:22:25,737][106226] Updated weights for policy 0, policy_version 990326 (0.0006) [2023-12-28 02:22:25,763][106225] Updated weights for policy 1, policy_version 992744 (0.0010) [2023-12-28 02:22:25,796][106226] Updated weights for policy 0, policy_version 990336 (0.0006) [2023-12-28 02:22:25,830][106225] Updated weights for policy 1, policy_version 992754 (0.0010) [2023-12-28 02:22:25,898][106225] Updated weights for policy 1, policy_version 992764 (0.0010) [2023-12-28 02:22:26,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 507772928. Throughput: 0: 9830.2, 1: 9982.5. Samples: 507741236. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:26,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.946')] [2023-12-28 02:22:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000992768_254189568.pth... [2023-12-28 02:22:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000990336_253583360.pth... [2023-12-28 02:22:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000989184_253288448.pth [2023-12-28 02:22:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000991616_253894656.pth [2023-12-28 02:22:26,345][106226] Updated weights for policy 0, policy_version 990346 (0.0007) [2023-12-28 02:22:26,398][106226] Updated weights for policy 0, policy_version 990356 (0.0008) [2023-12-28 02:22:26,444][106226] Updated weights for policy 0, policy_version 990366 (0.0008) [2023-12-28 02:22:26,608][106225] Updated weights for policy 1, policy_version 992774 (0.0010) [2023-12-28 02:22:26,664][106225] Updated weights for policy 1, policy_version 992784 (0.0010) [2023-12-28 02:22:26,727][106225] Updated weights for policy 1, policy_version 992794 (0.0010) [2023-12-28 02:22:27,194][106226] Updated weights for policy 0, policy_version 990376 (0.0006) [2023-12-28 02:22:27,247][106226] Updated weights for policy 0, policy_version 990386 (0.0005) [2023-12-28 02:22:27,303][106226] Updated weights for policy 0, policy_version 990396 (0.0006) [2023-12-28 02:22:27,348][106225] Updated weights for policy 1, policy_version 992804 (0.0010) [2023-12-28 02:22:27,414][106225] Updated weights for policy 1, policy_version 992814 (0.0007) [2023-12-28 02:22:27,469][106225] Updated weights for policy 1, policy_version 992824 (0.0005) [2023-12-28 02:22:27,875][106226] Updated weights for policy 0, policy_version 990406 (0.0006) [2023-12-28 02:22:27,930][106226] Updated weights for policy 0, policy_version 990416 (0.0007) [2023-12-28 02:22:27,989][106226] Updated weights for policy 0, policy_version 990426 (0.0010) [2023-12-28 02:22:28,099][106225] Updated weights for policy 1, policy_version 992834 (0.0005) [2023-12-28 02:22:28,166][106225] Updated weights for policy 1, policy_version 992844 (0.0005) [2023-12-28 02:22:28,214][106225] Updated weights for policy 1, policy_version 992854 (0.0005) [2023-12-28 02:22:28,280][106225] Updated weights for policy 1, policy_version 992864 (0.0006) [2023-12-28 02:22:28,662][106226] Updated weights for policy 0, policy_version 990436 (0.0008) [2023-12-28 02:22:28,718][106226] Updated weights for policy 0, policy_version 990446 (0.0011) [2023-12-28 02:22:28,782][106226] Updated weights for policy 0, policy_version 990456 (0.0009) [2023-12-28 02:22:28,931][106225] Updated weights for policy 1, policy_version 992874 (0.0008) [2023-12-28 02:22:28,985][106225] Updated weights for policy 1, policy_version 992884 (0.0009) [2023-12-28 02:22:29,038][106225] Updated weights for policy 1, policy_version 992894 (0.0009) [2023-12-28 02:22:29,374][106226] Updated weights for policy 0, policy_version 990466 (0.0007) [2023-12-28 02:22:29,435][106226] Updated weights for policy 0, policy_version 990476 (0.0009) [2023-12-28 02:22:29,488][106226] Updated weights for policy 0, policy_version 990486 (0.0009) [2023-12-28 02:22:29,549][106226] Updated weights for policy 0, policy_version 990496 (0.0006) [2023-12-28 02:22:29,922][106225] Updated weights for policy 1, policy_version 992904 (0.0009) [2023-12-28 02:22:29,991][106225] Updated weights for policy 1, policy_version 992914 (0.0006) [2023-12-28 02:22:30,058][106225] Updated weights for policy 1, policy_version 992924 (0.0007) [2023-12-28 02:22:30,192][106226] Updated weights for policy 0, policy_version 990506 (0.0010) [2023-12-28 02:22:30,246][106226] Updated weights for policy 0, policy_version 990516 (0.0011) [2023-12-28 02:22:30,307][106226] Updated weights for policy 0, policy_version 990526 (0.0011) [2023-12-28 02:22:30,745][106225] Updated weights for policy 1, policy_version 992934 (0.0006) [2023-12-28 02:22:30,794][106225] Updated weights for policy 1, policy_version 992944 (0.0007) [2023-12-28 02:22:30,846][106225] Updated weights for policy 1, policy_version 992954 (0.0007) [2023-12-28 02:22:30,948][106226] Updated weights for policy 0, policy_version 990536 (0.0010) [2023-12-28 02:22:31,007][106226] Updated weights for policy 0, policy_version 990546 (0.0010) [2023-12-28 02:22:31,066][106226] Updated weights for policy 0, policy_version 990556 (0.0010) [2023-12-28 02:22:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 507879424. Throughput: 0: 9979.6, 1: 10002.8. Samples: 507865896. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:31,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-5.347')] [2023-12-28 02:22:31,554][106225] Updated weights for policy 1, policy_version 992964 (0.0008) [2023-12-28 02:22:31,620][106225] Updated weights for policy 1, policy_version 992974 (0.0010) [2023-12-28 02:22:31,684][106225] Updated weights for policy 1, policy_version 992984 (0.0010) [2023-12-28 02:22:31,752][106226] Updated weights for policy 0, policy_version 990566 (0.0010) [2023-12-28 02:22:31,814][106226] Updated weights for policy 0, policy_version 990576 (0.0007) [2023-12-28 02:22:31,875][106226] Updated weights for policy 0, policy_version 990586 (0.0008) [2023-12-28 02:22:32,376][106225] Updated weights for policy 1, policy_version 992994 (0.0010) [2023-12-28 02:22:32,442][106225] Updated weights for policy 1, policy_version 993004 (0.0007) [2023-12-28 02:22:32,491][106225] Updated weights for policy 1, policy_version 993014 (0.0008) [2023-12-28 02:22:32,546][106225] Updated weights for policy 1, policy_version 993024 (0.0005) [2023-12-28 02:22:32,596][106226] Updated weights for policy 0, policy_version 990596 (0.0009) [2023-12-28 02:22:32,643][106226] Updated weights for policy 0, policy_version 990606 (0.0007) [2023-12-28 02:22:32,698][106226] Updated weights for policy 0, policy_version 990616 (0.0007) [2023-12-28 02:22:33,249][106225] Updated weights for policy 1, policy_version 993034 (0.0010) [2023-12-28 02:22:33,304][106225] Updated weights for policy 1, policy_version 993044 (0.0006) [2023-12-28 02:22:33,370][106225] Updated weights for policy 1, policy_version 993054 (0.0005) [2023-12-28 02:22:33,381][106226] Updated weights for policy 0, policy_version 990626 (0.0008) [2023-12-28 02:22:33,437][106226] Updated weights for policy 0, policy_version 990636 (0.0010) [2023-12-28 02:22:33,500][106226] Updated weights for policy 0, policy_version 990646 (0.0011) [2023-12-28 02:22:33,562][106226] Updated weights for policy 0, policy_version 990656 (0.0010) [2023-12-28 02:22:33,947][106225] Updated weights for policy 1, policy_version 993064 (0.0005) [2023-12-28 02:22:34,010][106225] Updated weights for policy 1, policy_version 993074 (0.0005) [2023-12-28 02:22:34,078][106225] Updated weights for policy 1, policy_version 993084 (0.0008) [2023-12-28 02:22:34,278][106226] Updated weights for policy 0, policy_version 990666 (0.0009) [2023-12-28 02:22:34,343][106226] Updated weights for policy 0, policy_version 990676 (0.0007) [2023-12-28 02:22:34,407][106226] Updated weights for policy 0, policy_version 990686 (0.0008) [2023-12-28 02:22:34,723][106225] Updated weights for policy 1, policy_version 993094 (0.0010) [2023-12-28 02:22:34,788][106225] Updated weights for policy 1, policy_version 993104 (0.0010) [2023-12-28 02:22:34,844][106225] Updated weights for policy 1, policy_version 993114 (0.0010) [2023-12-28 02:22:35,021][106226] Updated weights for policy 0, policy_version 990696 (0.0007) [2023-12-28 02:22:35,074][106226] Updated weights for policy 0, policy_version 990706 (0.0005) [2023-12-28 02:22:35,128][106226] Updated weights for policy 0, policy_version 990716 (0.0010) [2023-12-28 02:22:35,408][106225] Updated weights for policy 1, policy_version 993124 (0.0006) [2023-12-28 02:22:35,466][106225] Updated weights for policy 1, policy_version 993134 (0.0005) [2023-12-28 02:22:35,544][106225] Updated weights for policy 1, policy_version 993144 (0.0005) [2023-12-28 02:22:35,822][106226] Updated weights for policy 0, policy_version 990726 (0.0008) [2023-12-28 02:22:35,879][106226] Updated weights for policy 0, policy_version 990736 (0.0010) [2023-12-28 02:22:35,948][106226] Updated weights for policy 0, policy_version 990746 (0.0008) [2023-12-28 02:22:36,143][106225] Updated weights for policy 1, policy_version 993154 (0.0005) [2023-12-28 02:22:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 507977728. Throughput: 0: 10035.7, 1: 10077.9. Samples: 507989368. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:36,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.795')] [2023-12-28 02:22:36,211][106225] Updated weights for policy 1, policy_version 993164 (0.0008) [2023-12-28 02:22:36,274][106225] Updated weights for policy 1, policy_version 993174 (0.0010) [2023-12-28 02:22:36,339][106225] Updated weights for policy 1, policy_version 993184 (0.0010) [2023-12-28 02:22:36,637][106226] Updated weights for policy 0, policy_version 990756 (0.0010) [2023-12-28 02:22:36,704][106226] Updated weights for policy 0, policy_version 990766 (0.0011) [2023-12-28 02:22:36,772][106226] Updated weights for policy 0, policy_version 990776 (0.0011) [2023-12-28 02:22:37,014][106225] Updated weights for policy 1, policy_version 993194 (0.0011) [2023-12-28 02:22:37,072][106225] Updated weights for policy 1, policy_version 993204 (0.0009) [2023-12-28 02:22:37,134][106225] Updated weights for policy 1, policy_version 993214 (0.0006) [2023-12-28 02:22:37,492][106226] Updated weights for policy 0, policy_version 990786 (0.0011) [2023-12-28 02:22:37,554][106226] Updated weights for policy 0, policy_version 990796 (0.0011) [2023-12-28 02:22:37,608][106226] Updated weights for policy 0, policy_version 990806 (0.0011) [2023-12-28 02:22:37,670][106226] Updated weights for policy 0, policy_version 990816 (0.0011) [2023-12-28 02:22:37,689][106225] Updated weights for policy 1, policy_version 993224 (0.0010) [2023-12-28 02:22:37,754][106225] Updated weights for policy 1, policy_version 993234 (0.0011) [2023-12-28 02:22:37,815][106225] Updated weights for policy 1, policy_version 993244 (0.0010) [2023-12-28 02:22:38,395][106226] Updated weights for policy 0, policy_version 990826 (0.0011) [2023-12-28 02:22:38,459][106226] Updated weights for policy 0, policy_version 990836 (0.0009) [2023-12-28 02:22:38,510][106225] Updated weights for policy 1, policy_version 993254 (0.0008) [2023-12-28 02:22:38,528][106226] Updated weights for policy 0, policy_version 990846 (0.0007) [2023-12-28 02:22:38,579][106225] Updated weights for policy 1, policy_version 993264 (0.0008) [2023-12-28 02:22:38,639][106225] Updated weights for policy 1, policy_version 993274 (0.0008) [2023-12-28 02:22:39,174][106226] Updated weights for policy 0, policy_version 990856 (0.0006) [2023-12-28 02:22:39,248][106226] Updated weights for policy 0, policy_version 990866 (0.0007) [2023-12-28 02:22:39,308][106225] Updated weights for policy 1, policy_version 993284 (0.0008) [2023-12-28 02:22:39,309][106226] Updated weights for policy 0, policy_version 990876 (0.0008) [2023-12-28 02:22:39,378][106225] Updated weights for policy 1, policy_version 993294 (0.0008) [2023-12-28 02:22:39,454][106225] Updated weights for policy 1, policy_version 993304 (0.0009) [2023-12-28 02:22:39,941][106226] Updated weights for policy 0, policy_version 990886 (0.0008) [2023-12-28 02:22:40,007][106226] Updated weights for policy 0, policy_version 990896 (0.0008) [2023-12-28 02:22:40,076][106226] Updated weights for policy 0, policy_version 990906 (0.0008) [2023-12-28 02:22:40,227][106225] Updated weights for policy 1, policy_version 993314 (0.0009) [2023-12-28 02:22:40,291][106225] Updated weights for policy 1, policy_version 993324 (0.0008) [2023-12-28 02:22:40,360][106225] Updated weights for policy 1, policy_version 993334 (0.0010) [2023-12-28 02:22:40,420][106225] Updated weights for policy 1, policy_version 993344 (0.0009) [2023-12-28 02:22:40,763][106226] Updated weights for policy 0, policy_version 990916 (0.0007) [2023-12-28 02:22:40,818][106226] Updated weights for policy 0, policy_version 990926 (0.0005) [2023-12-28 02:22:40,870][106226] Updated weights for policy 0, policy_version 990936 (0.0008) [2023-12-28 02:22:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 508076032. Throughput: 0: 10004.2, 1: 10102.6. Samples: 508049740. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:41,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.971')] [2023-12-28 02:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000990944_253739008.pth... [2023-12-28 02:22:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000989760_253435904.pth [2023-12-28 02:22:41,213][106225] Updated weights for policy 1, policy_version 993354 (0.0007) [2023-12-28 02:22:41,280][106225] Updated weights for policy 1, policy_version 993364 (0.0009) [2023-12-28 02:22:41,339][106225] Updated weights for policy 1, policy_version 993374 (0.0010) [2023-12-28 02:22:41,348][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000993376_254345216.pth... [2023-12-28 02:22:41,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000992160_254033920.pth [2023-12-28 02:22:41,546][106226] Updated weights for policy 0, policy_version 990946 (0.0008) [2023-12-28 02:22:41,611][106226] Updated weights for policy 0, policy_version 990956 (0.0006) [2023-12-28 02:22:41,685][106226] Updated weights for policy 0, policy_version 990966 (0.0007) [2023-12-28 02:22:41,754][106226] Updated weights for policy 0, policy_version 990976 (0.0007) [2023-12-28 02:22:42,083][106225] Updated weights for policy 1, policy_version 993384 (0.0008) [2023-12-28 02:22:42,141][106225] Updated weights for policy 1, policy_version 993394 (0.0007) [2023-12-28 02:22:42,207][106225] Updated weights for policy 1, policy_version 993404 (0.0008) [2023-12-28 02:22:42,446][106226] Updated weights for policy 0, policy_version 990986 (0.0009) [2023-12-28 02:22:42,515][106226] Updated weights for policy 0, policy_version 990996 (0.0009) [2023-12-28 02:22:42,582][106226] Updated weights for policy 0, policy_version 991006 (0.0009) [2023-12-28 02:22:42,924][106225] Updated weights for policy 1, policy_version 993414 (0.0008) [2023-12-28 02:22:42,981][106225] Updated weights for policy 1, policy_version 993424 (0.0007) [2023-12-28 02:22:43,043][106225] Updated weights for policy 1, policy_version 993434 (0.0005) [2023-12-28 02:22:43,313][106226] Updated weights for policy 0, policy_version 991016 (0.0006) [2023-12-28 02:22:43,360][106226] Updated weights for policy 0, policy_version 991026 (0.0009) [2023-12-28 02:22:43,410][106226] Updated weights for policy 0, policy_version 991036 (0.0010) [2023-12-28 02:22:43,662][106225] Updated weights for policy 1, policy_version 993444 (0.0006) [2023-12-28 02:22:43,715][106225] Updated weights for policy 1, policy_version 993454 (0.0008) [2023-12-28 02:22:43,783][106225] Updated weights for policy 1, policy_version 993464 (0.0008) [2023-12-28 02:22:44,120][106226] Updated weights for policy 0, policy_version 991046 (0.0008) [2023-12-28 02:22:44,186][106226] Updated weights for policy 0, policy_version 991056 (0.0007) [2023-12-28 02:22:44,247][106226] Updated weights for policy 0, policy_version 991066 (0.0011) [2023-12-28 02:22:44,516][106225] Updated weights for policy 1, policy_version 993474 (0.0008) [2023-12-28 02:22:44,571][106225] Updated weights for policy 1, policy_version 993484 (0.0009) [2023-12-28 02:22:44,630][106225] Updated weights for policy 1, policy_version 993494 (0.0007) [2023-12-28 02:22:44,680][106225] Updated weights for policy 1, policy_version 993504 (0.0006) [2023-12-28 02:22:44,875][106226] Updated weights for policy 0, policy_version 991076 (0.0009) [2023-12-28 02:22:44,939][106226] Updated weights for policy 0, policy_version 991086 (0.0010) [2023-12-28 02:22:45,012][106226] Updated weights for policy 0, policy_version 991096 (0.0009) [2023-12-28 02:22:45,400][106225] Updated weights for policy 1, policy_version 993514 (0.0008) [2023-12-28 02:22:45,461][106225] Updated weights for policy 1, policy_version 993524 (0.0009) [2023-12-28 02:22:45,519][106225] Updated weights for policy 1, policy_version 993534 (0.0007) [2023-12-28 02:22:45,773][106226] Updated weights for policy 0, policy_version 991106 (0.0010) [2023-12-28 02:22:45,828][106226] Updated weights for policy 0, policy_version 991116 (0.0009) [2023-12-28 02:22:45,875][106226] Updated weights for policy 0, policy_version 991126 (0.0008) [2023-12-28 02:22:45,927][106226] Updated weights for policy 0, policy_version 991136 (0.0008) [2023-12-28 02:22:46,155][106225] Updated weights for policy 1, policy_version 993544 (0.0007) [2023-12-28 02:22:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 508174336. Throughput: 0: 10037.3, 1: 10032.0. Samples: 508166068. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:46,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-4.995')] [2023-12-28 02:22:46,217][106225] Updated weights for policy 1, policy_version 993554 (0.0008) [2023-12-28 02:22:46,275][106225] Updated weights for policy 1, policy_version 993564 (0.0008) [2023-12-28 02:22:46,650][106226] Updated weights for policy 0, policy_version 991146 (0.0008) [2023-12-28 02:22:46,698][106226] Updated weights for policy 0, policy_version 991156 (0.0008) [2023-12-28 02:22:46,746][106226] Updated weights for policy 0, policy_version 991166 (0.0005) [2023-12-28 02:22:47,010][106225] Updated weights for policy 1, policy_version 993574 (0.0010) [2023-12-28 02:22:47,064][106225] Updated weights for policy 1, policy_version 993584 (0.0010) [2023-12-28 02:22:47,116][106225] Updated weights for policy 1, policy_version 993594 (0.0009) [2023-12-28 02:22:47,390][106226] Updated weights for policy 0, policy_version 991176 (0.0009) [2023-12-28 02:22:47,457][106226] Updated weights for policy 0, policy_version 991186 (0.0011) [2023-12-28 02:22:47,521][106226] Updated weights for policy 0, policy_version 991196 (0.0010) [2023-12-28 02:22:47,716][106225] Updated weights for policy 1, policy_version 993604 (0.0007) [2023-12-28 02:22:47,779][106225] Updated weights for policy 1, policy_version 993614 (0.0010) [2023-12-28 02:22:47,839][106225] Updated weights for policy 1, policy_version 993624 (0.0009) [2023-12-28 02:22:48,217][106226] Updated weights for policy 0, policy_version 991206 (0.0009) [2023-12-28 02:22:48,271][106226] Updated weights for policy 0, policy_version 991216 (0.0010) [2023-12-28 02:22:48,333][106226] Updated weights for policy 0, policy_version 991226 (0.0011) [2023-12-28 02:22:48,531][106225] Updated weights for policy 1, policy_version 993634 (0.0006) [2023-12-28 02:22:48,596][106225] Updated weights for policy 1, policy_version 993644 (0.0005) [2023-12-28 02:22:48,662][106225] Updated weights for policy 1, policy_version 993654 (0.0005) [2023-12-28 02:22:48,732][106225] Updated weights for policy 1, policy_version 993664 (0.0006) [2023-12-28 02:22:49,049][106226] Updated weights for policy 0, policy_version 991236 (0.0009) [2023-12-28 02:22:49,115][106226] Updated weights for policy 0, policy_version 991246 (0.0005) [2023-12-28 02:22:49,186][106226] Updated weights for policy 0, policy_version 991256 (0.0006) [2023-12-28 02:22:49,268][106225] Updated weights for policy 1, policy_version 993674 (0.0010) [2023-12-28 02:22:49,329][106225] Updated weights for policy 1, policy_version 993684 (0.0010) [2023-12-28 02:22:49,412][106225] Updated weights for policy 1, policy_version 993694 (0.0011) [2023-12-28 02:22:49,901][106226] Updated weights for policy 0, policy_version 991266 (0.0007) [2023-12-28 02:22:49,974][106226] Updated weights for policy 0, policy_version 991276 (0.0006) [2023-12-28 02:22:50,040][106226] Updated weights for policy 0, policy_version 991286 (0.0006) [2023-12-28 02:22:50,102][106226] Updated weights for policy 0, policy_version 991296 (0.0005) [2023-12-28 02:22:50,151][106225] Updated weights for policy 1, policy_version 993704 (0.0006) [2023-12-28 02:22:50,211][106225] Updated weights for policy 1, policy_version 993714 (0.0006) [2023-12-28 02:22:50,266][106225] Updated weights for policy 1, policy_version 993724 (0.0005) [2023-12-28 02:22:50,812][106226] Updated weights for policy 0, policy_version 991306 (0.0009) [2023-12-28 02:22:50,846][106225] Updated weights for policy 1, policy_version 993734 (0.0007) [2023-12-28 02:22:50,875][106226] Updated weights for policy 0, policy_version 991316 (0.0007) [2023-12-28 02:22:50,903][106225] Updated weights for policy 1, policy_version 993744 (0.0006) [2023-12-28 02:22:50,934][106226] Updated weights for policy 0, policy_version 991326 (0.0007) [2023-12-28 02:22:50,956][106225] Updated weights for policy 1, policy_version 993754 (0.0008) [2023-12-28 02:22:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 508280832. Throughput: 0: 9960.1, 1: 10139.8. Samples: 508287636. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-28 02:22:51,175][105115] Avg episode reward: [(0, '-4.956'), (1, '-4.966')] [2023-12-28 02:22:51,675][106225] Updated weights for policy 1, policy_version 993764 (0.0007) [2023-12-28 02:22:51,687][106226] Updated weights for policy 0, policy_version 991336 (0.0009) [2023-12-28 02:22:51,750][106225] Updated weights for policy 1, policy_version 993774 (0.0008) [2023-12-28 02:22:51,755][106226] Updated weights for policy 0, policy_version 991346 (0.0008) [2023-12-28 02:22:51,807][106225] Updated weights for policy 1, policy_version 993784 (0.0006) [2023-12-28 02:22:51,810][106226] Updated weights for policy 0, policy_version 991356 (0.0008) [2023-12-28 02:22:52,532][106225] Updated weights for policy 1, policy_version 993794 (0.0008) [2023-12-28 02:22:52,556][106226] Updated weights for policy 0, policy_version 991366 (0.0009) [2023-12-28 02:22:52,601][106225] Updated weights for policy 1, policy_version 993804 (0.0008) [2023-12-28 02:22:52,608][106226] Updated weights for policy 0, policy_version 991376 (0.0006) [2023-12-28 02:22:52,661][106225] Updated weights for policy 1, policy_version 993814 (0.0008) [2023-12-28 02:22:52,664][106226] Updated weights for policy 0, policy_version 991386 (0.0005) [2023-12-28 02:22:52,725][106225] Updated weights for policy 1, policy_version 993824 (0.0008) [2023-12-28 02:22:53,374][106226] Updated weights for policy 0, policy_version 991396 (0.0005) [2023-12-28 02:22:53,436][106226] Updated weights for policy 0, policy_version 991406 (0.0007) [2023-12-28 02:22:53,458][106225] Updated weights for policy 1, policy_version 993834 (0.0006) [2023-12-28 02:22:53,499][106226] Updated weights for policy 0, policy_version 991416 (0.0008) [2023-12-28 02:22:53,525][106225] Updated weights for policy 1, policy_version 993844 (0.0006) [2023-12-28 02:22:53,588][106225] Updated weights for policy 1, policy_version 993854 (0.0008) [2023-12-28 02:22:54,160][106226] Updated weights for policy 0, policy_version 991426 (0.0007) [2023-12-28 02:22:54,215][106226] Updated weights for policy 0, policy_version 991436 (0.0009) [2023-12-28 02:22:54,267][106226] Updated weights for policy 0, policy_version 991446 (0.0009) [2023-12-28 02:22:54,322][106226] Updated weights for policy 0, policy_version 991456 (0.0008) [2023-12-28 02:22:54,343][106225] Updated weights for policy 1, policy_version 993864 (0.0009) [2023-12-28 02:22:54,397][106225] Updated weights for policy 1, policy_version 993874 (0.0009) [2023-12-28 02:22:54,450][106225] Updated weights for policy 1, policy_version 993884 (0.0008) [2023-12-28 02:22:54,953][106226] Updated weights for policy 0, policy_version 991466 (0.0007) [2023-12-28 02:22:55,010][106226] Updated weights for policy 0, policy_version 991476 (0.0009) [2023-12-28 02:22:55,061][106226] Updated weights for policy 0, policy_version 991486 (0.0009) [2023-12-28 02:22:55,138][106225] Updated weights for policy 1, policy_version 993894 (0.0006) [2023-12-28 02:22:55,190][106225] Updated weights for policy 1, policy_version 993904 (0.0008) [2023-12-28 02:22:55,234][106225] Updated weights for policy 1, policy_version 993914 (0.0008) [2023-12-28 02:22:55,786][106226] Updated weights for policy 0, policy_version 991496 (0.0009) [2023-12-28 02:22:55,843][106226] Updated weights for policy 0, policy_version 991506 (0.0008) [2023-12-28 02:22:55,891][106225] Updated weights for policy 1, policy_version 993924 (0.0006) [2023-12-28 02:22:55,891][106226] Updated weights for policy 0, policy_version 991516 (0.0007) [2023-12-28 02:22:55,942][106225] Updated weights for policy 1, policy_version 993934 (0.0008) [2023-12-28 02:22:55,991][106225] Updated weights for policy 1, policy_version 993944 (0.0008) [2023-12-28 02:22:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 508379136. Throughput: 0: 9931.4, 1: 10069.9. Samples: 508344584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:22:56,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.985')] [2023-12-28 02:22:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000993952_254492672.pth... [2023-12-28 02:22:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000991520_253886464.pth... [2023-12-28 02:22:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000990336_253583360.pth [2023-12-28 02:22:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000992768_254189568.pth [2023-12-28 02:22:56,579][106226] Updated weights for policy 0, policy_version 991526 (0.0006) [2023-12-28 02:22:56,623][106226] Updated weights for policy 0, policy_version 991536 (0.0008) [2023-12-28 02:22:56,673][106226] Updated weights for policy 0, policy_version 991546 (0.0009) [2023-12-28 02:22:56,719][106225] Updated weights for policy 1, policy_version 993954 (0.0008) [2023-12-28 02:22:56,771][106225] Updated weights for policy 1, policy_version 993964 (0.0008) [2023-12-28 02:22:56,826][106225] Updated weights for policy 1, policy_version 993974 (0.0008) [2023-12-28 02:22:56,894][106225] Updated weights for policy 1, policy_version 993984 (0.0005) [2023-12-28 02:22:57,408][106226] Updated weights for policy 0, policy_version 991556 (0.0007) [2023-12-28 02:22:57,455][106226] Updated weights for policy 0, policy_version 991566 (0.0008) [2023-12-28 02:22:57,502][106226] Updated weights for policy 0, policy_version 991576 (0.0008) [2023-12-28 02:22:57,562][106225] Updated weights for policy 1, policy_version 993994 (0.0010) [2023-12-28 02:22:57,608][106225] Updated weights for policy 1, policy_version 994004 (0.0010) [2023-12-28 02:22:57,660][106225] Updated weights for policy 1, policy_version 994014 (0.0010) [2023-12-28 02:22:58,277][106226] Updated weights for policy 0, policy_version 991586 (0.0007) [2023-12-28 02:22:58,313][106225] Updated weights for policy 1, policy_version 994024 (0.0007) [2023-12-28 02:22:58,342][106226] Updated weights for policy 0, policy_version 991596 (0.0007) [2023-12-28 02:22:58,392][106225] Updated weights for policy 1, policy_version 994034 (0.0008) [2023-12-28 02:22:58,416][106226] Updated weights for policy 0, policy_version 991606 (0.0008) [2023-12-28 02:22:58,462][106225] Updated weights for policy 1, policy_version 994044 (0.0007) [2023-12-28 02:22:58,480][106226] Updated weights for policy 0, policy_version 991616 (0.0008) [2023-12-28 02:22:59,259][106225] Updated weights for policy 1, policy_version 994054 (0.0010) [2023-12-28 02:22:59,315][106226] Updated weights for policy 0, policy_version 991626 (0.0008) [2023-12-28 02:22:59,326][106225] Updated weights for policy 1, policy_version 994064 (0.0009) [2023-12-28 02:22:59,383][106226] Updated weights for policy 0, policy_version 991636 (0.0008) [2023-12-28 02:22:59,395][106225] Updated weights for policy 1, policy_version 994074 (0.0009) [2023-12-28 02:22:59,447][106226] Updated weights for policy 0, policy_version 991646 (0.0008) [2023-12-28 02:23:00,103][106225] Updated weights for policy 1, policy_version 994084 (0.0009) [2023-12-28 02:23:00,135][106226] Updated weights for policy 0, policy_version 991656 (0.0007) [2023-12-28 02:23:00,166][106225] Updated weights for policy 1, policy_version 994094 (0.0007) [2023-12-28 02:23:00,184][106226] Updated weights for policy 0, policy_version 991666 (0.0006) [2023-12-28 02:23:00,231][106225] Updated weights for policy 1, policy_version 994104 (0.0007) [2023-12-28 02:23:00,237][106226] Updated weights for policy 0, policy_version 991676 (0.0006) [2023-12-28 02:23:00,855][106226] Updated weights for policy 0, policy_version 991686 (0.0006) [2023-12-28 02:23:00,923][106226] Updated weights for policy 0, policy_version 991696 (0.0005) [2023-12-28 02:23:00,963][106225] Updated weights for policy 1, policy_version 994114 (0.0008) [2023-12-28 02:23:00,976][106226] Updated weights for policy 0, policy_version 991706 (0.0010) [2023-12-28 02:23:01,017][106225] Updated weights for policy 1, policy_version 994124 (0.0005) [2023-12-28 02:23:01,080][106225] Updated weights for policy 1, policy_version 994134 (0.0007) [2023-12-28 02:23:01,138][106225] Updated weights for policy 1, policy_version 994144 (0.0007) [2023-12-28 02:23:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 508477440. Throughput: 0: 9936.8, 1: 10076.0. Samples: 508460848. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:01,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.033')] [2023-12-28 02:23:01,664][106226] Updated weights for policy 0, policy_version 991716 (0.0013) [2023-12-28 02:23:01,729][106226] Updated weights for policy 0, policy_version 991726 (0.0008) [2023-12-28 02:23:01,786][106226] Updated weights for policy 0, policy_version 991736 (0.0007) [2023-12-28 02:23:01,908][106225] Updated weights for policy 1, policy_version 994154 (0.0009) [2023-12-28 02:23:01,956][106225] Updated weights for policy 1, policy_version 994164 (0.0007) [2023-12-28 02:23:02,013][106225] Updated weights for policy 1, policy_version 994174 (0.0008) [2023-12-28 02:23:02,396][106226] Updated weights for policy 0, policy_version 991746 (0.0008) [2023-12-28 02:23:02,447][106226] Updated weights for policy 0, policy_version 991756 (0.0005) [2023-12-28 02:23:02,511][106226] Updated weights for policy 0, policy_version 991766 (0.0007) [2023-12-28 02:23:02,566][106226] Updated weights for policy 0, policy_version 991776 (0.0008) [2023-12-28 02:23:02,802][106225] Updated weights for policy 1, policy_version 994184 (0.0009) [2023-12-28 02:23:02,859][106225] Updated weights for policy 1, policy_version 994194 (0.0008) [2023-12-28 02:23:02,919][106225] Updated weights for policy 1, policy_version 994204 (0.0009) [2023-12-28 02:23:03,252][106226] Updated weights for policy 0, policy_version 991786 (0.0005) [2023-12-28 02:23:03,319][106226] Updated weights for policy 0, policy_version 991796 (0.0005) [2023-12-28 02:23:03,377][106226] Updated weights for policy 0, policy_version 991806 (0.0005) [2023-12-28 02:23:03,525][106225] Updated weights for policy 1, policy_version 994214 (0.0006) [2023-12-28 02:23:03,587][106225] Updated weights for policy 1, policy_version 994224 (0.0005) [2023-12-28 02:23:03,641][106225] Updated weights for policy 1, policy_version 994234 (0.0005) [2023-12-28 02:23:04,043][106226] Updated weights for policy 0, policy_version 991816 (0.0005) [2023-12-28 02:23:04,107][106226] Updated weights for policy 0, policy_version 991826 (0.0006) [2023-12-28 02:23:04,176][106226] Updated weights for policy 0, policy_version 991836 (0.0009) [2023-12-28 02:23:04,260][106225] Updated weights for policy 1, policy_version 994244 (0.0006) [2023-12-28 02:23:04,323][106225] Updated weights for policy 1, policy_version 994254 (0.0008) [2023-12-28 02:23:04,382][106225] Updated weights for policy 1, policy_version 994264 (0.0009) [2023-12-28 02:23:04,855][106226] Updated weights for policy 0, policy_version 991846 (0.0008) [2023-12-28 02:23:04,913][106226] Updated weights for policy 0, policy_version 991856 (0.0008) [2023-12-28 02:23:04,976][106226] Updated weights for policy 0, policy_version 991866 (0.0009) [2023-12-28 02:23:05,082][106225] Updated weights for policy 1, policy_version 994274 (0.0008) [2023-12-28 02:23:05,128][106225] Updated weights for policy 1, policy_version 994284 (0.0005) [2023-12-28 02:23:05,173][106225] Updated weights for policy 1, policy_version 994294 (0.0005) [2023-12-28 02:23:05,224][106225] Updated weights for policy 1, policy_version 994304 (0.0005) [2023-12-28 02:23:05,741][106226] Updated weights for policy 0, policy_version 991876 (0.0009) [2023-12-28 02:23:05,807][106226] Updated weights for policy 0, policy_version 991886 (0.0009) [2023-12-28 02:23:05,871][106226] Updated weights for policy 0, policy_version 991896 (0.0008) [2023-12-28 02:23:05,902][106225] Updated weights for policy 1, policy_version 994314 (0.0007) [2023-12-28 02:23:05,959][106225] Updated weights for policy 1, policy_version 994324 (0.0008) [2023-12-28 02:23:06,017][106225] Updated weights for policy 1, policy_version 994334 (0.0008) [2023-12-28 02:23:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 508575744. Throughput: 0: 9924.2, 1: 10022.1. Samples: 508582028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:06,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-5.373')] [2023-12-28 02:23:06,606][106226] Updated weights for policy 0, policy_version 991906 (0.0008) [2023-12-28 02:23:06,662][106226] Updated weights for policy 0, policy_version 991916 (0.0009) [2023-12-28 02:23:06,717][106226] Updated weights for policy 0, policy_version 991926 (0.0007) [2023-12-28 02:23:06,734][106225] Updated weights for policy 1, policy_version 994344 (0.0007) [2023-12-28 02:23:06,764][106226] Updated weights for policy 0, policy_version 991936 (0.0005) [2023-12-28 02:23:06,791][106225] Updated weights for policy 1, policy_version 994354 (0.0008) [2023-12-28 02:23:06,848][106225] Updated weights for policy 1, policy_version 994364 (0.0009) [2023-12-28 02:23:07,407][106226] Updated weights for policy 0, policy_version 991946 (0.0007) [2023-12-28 02:23:07,455][106226] Updated weights for policy 0, policy_version 991956 (0.0005) [2023-12-28 02:23:07,507][106226] Updated weights for policy 0, policy_version 991966 (0.0006) [2023-12-28 02:23:07,632][106225] Updated weights for policy 1, policy_version 994374 (0.0008) [2023-12-28 02:23:07,694][106225] Updated weights for policy 1, policy_version 994384 (0.0008) [2023-12-28 02:23:07,757][106225] Updated weights for policy 1, policy_version 994394 (0.0009) [2023-12-28 02:23:08,197][106226] Updated weights for policy 0, policy_version 991976 (0.0006) [2023-12-28 02:23:08,250][106226] Updated weights for policy 0, policy_version 991986 (0.0007) [2023-12-28 02:23:08,296][106226] Updated weights for policy 0, policy_version 991996 (0.0006) [2023-12-28 02:23:08,414][106225] Updated weights for policy 1, policy_version 994404 (0.0008) [2023-12-28 02:23:08,479][106225] Updated weights for policy 1, policy_version 994414 (0.0008) [2023-12-28 02:23:08,532][106225] Updated weights for policy 1, policy_version 994424 (0.0008) [2023-12-28 02:23:09,028][106226] Updated weights for policy 0, policy_version 992006 (0.0009) [2023-12-28 02:23:09,092][106226] Updated weights for policy 0, policy_version 992016 (0.0010) [2023-12-28 02:23:09,153][106226] Updated weights for policy 0, policy_version 992026 (0.0011) [2023-12-28 02:23:09,225][106225] Updated weights for policy 1, policy_version 994434 (0.0009) [2023-12-28 02:23:09,285][106225] Updated weights for policy 1, policy_version 994444 (0.0007) [2023-12-28 02:23:09,348][106225] Updated weights for policy 1, policy_version 994454 (0.0008) [2023-12-28 02:23:09,419][106225] Updated weights for policy 1, policy_version 994464 (0.0008) [2023-12-28 02:23:09,948][106226] Updated weights for policy 0, policy_version 992036 (0.0011) [2023-12-28 02:23:10,017][106226] Updated weights for policy 0, policy_version 992046 (0.0011) [2023-12-28 02:23:10,081][106226] Updated weights for policy 0, policy_version 992056 (0.0011) [2023-12-28 02:23:10,200][106225] Updated weights for policy 1, policy_version 994474 (0.0008) [2023-12-28 02:23:10,260][106225] Updated weights for policy 1, policy_version 994484 (0.0008) [2023-12-28 02:23:10,319][106225] Updated weights for policy 1, policy_version 994494 (0.0008) [2023-12-28 02:23:10,774][106226] Updated weights for policy 0, policy_version 992066 (0.0011) [2023-12-28 02:23:10,827][106226] Updated weights for policy 0, policy_version 992076 (0.0010) [2023-12-28 02:23:10,887][106226] Updated weights for policy 0, policy_version 992086 (0.0005) [2023-12-28 02:23:10,957][106226] Updated weights for policy 0, policy_version 992096 (0.0009) [2023-12-28 02:23:10,991][106225] Updated weights for policy 1, policy_version 994504 (0.0006) [2023-12-28 02:23:11,062][106225] Updated weights for policy 1, policy_version 994514 (0.0008) [2023-12-28 02:23:11,117][106225] Updated weights for policy 1, policy_version 994524 (0.0008) [2023-12-28 02:23:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 508674048. Throughput: 0: 9977.2, 1: 10017.7. Samples: 508641008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:11,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-5.007')] [2023-12-28 02:23:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000992096_254033920.pth... [2023-12-28 02:23:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000994528_254640128.pth... [2023-12-28 02:23:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000990944_253739008.pth [2023-12-28 02:23:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000993376_254345216.pth [2023-12-28 02:23:11,714][106226] Updated weights for policy 0, policy_version 992106 (0.0009) [2023-12-28 02:23:11,777][106226] Updated weights for policy 0, policy_version 992116 (0.0009) [2023-12-28 02:23:11,838][106226] Updated weights for policy 0, policy_version 992126 (0.0007) [2023-12-28 02:23:11,892][106225] Updated weights for policy 1, policy_version 994534 (0.0008) [2023-12-28 02:23:11,945][106225] Updated weights for policy 1, policy_version 994544 (0.0008) [2023-12-28 02:23:12,004][106225] Updated weights for policy 1, policy_version 994554 (0.0008) [2023-12-28 02:23:12,506][106226] Updated weights for policy 0, policy_version 992136 (0.0008) [2023-12-28 02:23:12,569][106226] Updated weights for policy 0, policy_version 992146 (0.0008) [2023-12-28 02:23:12,632][106226] Updated weights for policy 0, policy_version 992156 (0.0007) [2023-12-28 02:23:12,728][106225] Updated weights for policy 1, policy_version 994564 (0.0009) [2023-12-28 02:23:12,797][106225] Updated weights for policy 1, policy_version 994574 (0.0006) [2023-12-28 02:23:12,866][106225] Updated weights for policy 1, policy_version 994584 (0.0007) [2023-12-28 02:23:13,253][106226] Updated weights for policy 0, policy_version 992166 (0.0006) [2023-12-28 02:23:13,317][106226] Updated weights for policy 0, policy_version 992176 (0.0005) [2023-12-28 02:23:13,380][106226] Updated weights for policy 0, policy_version 992186 (0.0007) [2023-12-28 02:23:13,655][106225] Updated weights for policy 1, policy_version 994594 (0.0008) [2023-12-28 02:23:13,710][106225] Updated weights for policy 1, policy_version 994604 (0.0008) [2023-12-28 02:23:13,767][106225] Updated weights for policy 1, policy_version 994614 (0.0006) [2023-12-28 02:23:13,826][106225] Updated weights for policy 1, policy_version 994624 (0.0008) [2023-12-28 02:23:13,937][106226] Updated weights for policy 0, policy_version 992196 (0.0006) [2023-12-28 02:23:13,994][106226] Updated weights for policy 0, policy_version 992206 (0.0010) [2023-12-28 02:23:14,044][106226] Updated weights for policy 0, policy_version 992216 (0.0010) [2023-12-28 02:23:14,448][106225] Updated weights for policy 1, policy_version 994634 (0.0009) [2023-12-28 02:23:14,513][106225] Updated weights for policy 1, policy_version 994644 (0.0010) [2023-12-28 02:23:14,577][106225] Updated weights for policy 1, policy_version 994654 (0.0011) [2023-12-28 02:23:14,635][106226] Updated weights for policy 0, policy_version 992226 (0.0010) [2023-12-28 02:23:14,697][106226] Updated weights for policy 0, policy_version 992236 (0.0010) [2023-12-28 02:23:14,760][106226] Updated weights for policy 0, policy_version 992246 (0.0010) [2023-12-28 02:23:14,828][106226] Updated weights for policy 0, policy_version 992256 (0.0009) [2023-12-28 02:23:15,323][106225] Updated weights for policy 1, policy_version 994664 (0.0009) [2023-12-28 02:23:15,382][106225] Updated weights for policy 1, policy_version 994674 (0.0008) [2023-12-28 02:23:15,436][106225] Updated weights for policy 1, policy_version 994684 (0.0008) [2023-12-28 02:23:15,538][106226] Updated weights for policy 0, policy_version 992266 (0.0011) [2023-12-28 02:23:15,595][106226] Updated weights for policy 0, policy_version 992276 (0.0010) [2023-12-28 02:23:15,655][106226] Updated weights for policy 0, policy_version 992286 (0.0008) [2023-12-28 02:23:16,145][106225] Updated weights for policy 1, policy_version 994694 (0.0006) [2023-12-28 02:23:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 508764160. Throughput: 0: 9921.5, 1: 9925.8. Samples: 508759024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:16,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-4.761')] [2023-12-28 02:23:16,196][106225] Updated weights for policy 1, policy_version 994704 (0.0005) [2023-12-28 02:23:16,247][106225] Updated weights for policy 1, policy_version 994714 (0.0008) [2023-12-28 02:23:16,344][106226] Updated weights for policy 0, policy_version 992296 (0.0011) [2023-12-28 02:23:16,407][106226] Updated weights for policy 0, policy_version 992306 (0.0011) [2023-12-28 02:23:16,463][106226] Updated weights for policy 0, policy_version 992316 (0.0010) [2023-12-28 02:23:16,951][106225] Updated weights for policy 1, policy_version 994724 (0.0008) [2023-12-28 02:23:17,010][106225] Updated weights for policy 1, policy_version 994734 (0.0008) [2023-12-28 02:23:17,065][106225] Updated weights for policy 1, policy_version 994744 (0.0009) [2023-12-28 02:23:17,147][106226] Updated weights for policy 0, policy_version 992326 (0.0007) [2023-12-28 02:23:17,200][106226] Updated weights for policy 0, policy_version 992336 (0.0006) [2023-12-28 02:23:17,254][106226] Updated weights for policy 0, policy_version 992346 (0.0005) [2023-12-28 02:23:17,729][106225] Updated weights for policy 1, policy_version 994754 (0.0008) [2023-12-28 02:23:17,793][106225] Updated weights for policy 1, policy_version 994764 (0.0007) [2023-12-28 02:23:17,817][106226] Updated weights for policy 0, policy_version 992356 (0.0009) [2023-12-28 02:23:17,854][106225] Updated weights for policy 1, policy_version 994774 (0.0007) [2023-12-28 02:23:17,868][106226] Updated weights for policy 0, policy_version 992366 (0.0010) [2023-12-28 02:23:17,913][106225] Updated weights for policy 1, policy_version 994784 (0.0006) [2023-12-28 02:23:17,928][106226] Updated weights for policy 0, policy_version 992376 (0.0011) [2023-12-28 02:23:18,582][106225] Updated weights for policy 1, policy_version 994794 (0.0005) [2023-12-28 02:23:18,639][106225] Updated weights for policy 1, policy_version 994804 (0.0010) [2023-12-28 02:23:18,677][106226] Updated weights for policy 0, policy_version 992386 (0.0007) [2023-12-28 02:23:18,697][106225] Updated weights for policy 1, policy_version 994814 (0.0007) [2023-12-28 02:23:18,737][106226] Updated weights for policy 0, policy_version 992396 (0.0008) [2023-12-28 02:23:18,798][106226] Updated weights for policy 0, policy_version 992406 (0.0008) [2023-12-28 02:23:18,849][106226] Updated weights for policy 0, policy_version 992416 (0.0008) [2023-12-28 02:23:19,381][106225] Updated weights for policy 1, policy_version 994824 (0.0008) [2023-12-28 02:23:19,447][106225] Updated weights for policy 1, policy_version 994834 (0.0008) [2023-12-28 02:23:19,512][106225] Updated weights for policy 1, policy_version 994844 (0.0009) [2023-12-28 02:23:19,619][106226] Updated weights for policy 0, policy_version 992426 (0.0008) [2023-12-28 02:23:19,678][106226] Updated weights for policy 0, policy_version 992436 (0.0006) [2023-12-28 02:23:19,739][106226] Updated weights for policy 0, policy_version 992446 (0.0008) [2023-12-28 02:23:20,195][106225] Updated weights for policy 1, policy_version 994854 (0.0010) [2023-12-28 02:23:20,257][106225] Updated weights for policy 1, policy_version 994864 (0.0011) [2023-12-28 02:23:20,319][106225] Updated weights for policy 1, policy_version 994874 (0.0009) [2023-12-28 02:23:20,455][106226] Updated weights for policy 0, policy_version 992456 (0.0009) [2023-12-28 02:23:20,506][106226] Updated weights for policy 0, policy_version 992466 (0.0008) [2023-12-28 02:23:20,557][106226] Updated weights for policy 0, policy_version 992476 (0.0008) [2023-12-28 02:23:21,024][106225] Updated weights for policy 1, policy_version 994884 (0.0010) [2023-12-28 02:23:21,093][106225] Updated weights for policy 1, policy_version 994894 (0.0011) [2023-12-28 02:23:21,158][106225] Updated weights for policy 1, policy_version 994904 (0.0011) [2023-12-28 02:23:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 508862464. Throughput: 0: 9882.5, 1: 9851.4. Samples: 508877392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:21,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-5.143')] [2023-12-28 02:23:21,369][106226] Updated weights for policy 0, policy_version 992486 (0.0009) [2023-12-28 02:23:21,430][106226] Updated weights for policy 0, policy_version 992496 (0.0008) [2023-12-28 02:23:21,492][106226] Updated weights for policy 0, policy_version 992506 (0.0009) [2023-12-28 02:23:21,912][106225] Updated weights for policy 1, policy_version 994914 (0.0011) [2023-12-28 02:23:21,977][106225] Updated weights for policy 1, policy_version 994924 (0.0010) [2023-12-28 02:23:22,037][106225] Updated weights for policy 1, policy_version 994934 (0.0007) [2023-12-28 02:23:22,101][106225] Updated weights for policy 1, policy_version 994944 (0.0007) [2023-12-28 02:23:22,225][106226] Updated weights for policy 0, policy_version 992516 (0.0009) [2023-12-28 02:23:22,304][106226] Updated weights for policy 0, policy_version 992526 (0.0007) [2023-12-28 02:23:22,379][106226] Updated weights for policy 0, policy_version 992536 (0.0007) [2023-12-28 02:23:22,865][106225] Updated weights for policy 1, policy_version 994954 (0.0008) [2023-12-28 02:23:22,925][106225] Updated weights for policy 1, policy_version 994964 (0.0008) [2023-12-28 02:23:22,984][106226] Updated weights for policy 0, policy_version 992546 (0.0009) [2023-12-28 02:23:22,990][106225] Updated weights for policy 1, policy_version 994974 (0.0008) [2023-12-28 02:23:23,039][106226] Updated weights for policy 0, policy_version 992556 (0.0006) [2023-12-28 02:23:23,085][106226] Updated weights for policy 0, policy_version 992566 (0.0007) [2023-12-28 02:23:23,145][106226] Updated weights for policy 0, policy_version 992576 (0.0006) [2023-12-28 02:23:23,620][106225] Updated weights for policy 1, policy_version 994984 (0.0008) [2023-12-28 02:23:23,685][106225] Updated weights for policy 1, policy_version 994994 (0.0005) [2023-12-28 02:23:23,734][106226] Updated weights for policy 0, policy_version 992586 (0.0006) [2023-12-28 02:23:23,748][106225] Updated weights for policy 1, policy_version 995004 (0.0008) [2023-12-28 02:23:23,790][106226] Updated weights for policy 0, policy_version 992596 (0.0007) [2023-12-28 02:23:23,842][106226] Updated weights for policy 0, policy_version 992606 (0.0005) [2023-12-28 02:23:24,339][106225] Updated weights for policy 1, policy_version 995014 (0.0007) [2023-12-28 02:23:24,395][106225] Updated weights for policy 1, policy_version 995024 (0.0008) [2023-12-28 02:23:24,453][106225] Updated weights for policy 1, policy_version 995034 (0.0009) [2023-12-28 02:23:24,589][106226] Updated weights for policy 0, policy_version 992616 (0.0008) [2023-12-28 02:23:24,639][106226] Updated weights for policy 0, policy_version 992626 (0.0008) [2023-12-28 02:23:24,684][106226] Updated weights for policy 0, policy_version 992636 (0.0008) [2023-12-28 02:23:25,202][106225] Updated weights for policy 1, policy_version 995044 (0.0007) [2023-12-28 02:23:25,256][106225] Updated weights for policy 1, policy_version 995054 (0.0008) [2023-12-28 02:23:25,305][106225] Updated weights for policy 1, policy_version 995064 (0.0005) [2023-12-28 02:23:25,400][106226] Updated weights for policy 0, policy_version 992646 (0.0008) [2023-12-28 02:23:25,462][106226] Updated weights for policy 0, policy_version 992656 (0.0010) [2023-12-28 02:23:25,519][106226] Updated weights for policy 0, policy_version 992666 (0.0006) [2023-12-28 02:23:25,862][106225] Updated weights for policy 1, policy_version 995074 (0.0006) [2023-12-28 02:23:25,916][106225] Updated weights for policy 1, policy_version 995084 (0.0006) [2023-12-28 02:23:25,978][106225] Updated weights for policy 1, policy_version 995094 (0.0009) [2023-12-28 02:23:26,044][106225] Updated weights for policy 1, policy_version 995104 (0.0008) [2023-12-28 02:23:26,047][106226] Updated weights for policy 0, policy_version 992676 (0.0006) [2023-12-28 02:23:26,115][106226] Updated weights for policy 0, policy_version 992686 (0.0006) [2023-12-28 02:23:26,161][106226] Updated weights for policy 0, policy_version 992696 (0.0008) [2023-12-28 02:23:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 508968960. Throughput: 0: 9905.9, 1: 9805.9. Samples: 508936768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:26,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.782')] [2023-12-28 02:23:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000995104_254787584.pth... [2023-12-28 02:23:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000993952_254492672.pth [2023-12-28 02:23:26,203][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000992704_254189568.pth... [2023-12-28 02:23:26,207][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000991520_253886464.pth [2023-12-28 02:23:26,783][106225] Updated weights for policy 1, policy_version 995114 (0.0008) [2023-12-28 02:23:26,839][106225] Updated weights for policy 1, policy_version 995124 (0.0008) [2023-12-28 02:23:26,842][106226] Updated weights for policy 0, policy_version 992706 (0.0009) [2023-12-28 02:23:26,890][106225] Updated weights for policy 1, policy_version 995134 (0.0005) [2023-12-28 02:23:26,892][106226] Updated weights for policy 0, policy_version 992716 (0.0010) [2023-12-28 02:23:26,951][106226] Updated weights for policy 0, policy_version 992726 (0.0010) [2023-12-28 02:23:27,010][106226] Updated weights for policy 0, policy_version 992736 (0.0010) [2023-12-28 02:23:27,575][106225] Updated weights for policy 1, policy_version 995144 (0.0005) [2023-12-28 02:23:27,638][106225] Updated weights for policy 1, policy_version 995154 (0.0005) [2023-12-28 02:23:27,644][106226] Updated weights for policy 0, policy_version 992746 (0.0005) [2023-12-28 02:23:27,692][106225] Updated weights for policy 1, policy_version 995164 (0.0008) [2023-12-28 02:23:27,699][106226] Updated weights for policy 0, policy_version 992756 (0.0007) [2023-12-28 02:23:27,761][106226] Updated weights for policy 0, policy_version 992766 (0.0011) [2023-12-28 02:23:28,391][106225] Updated weights for policy 1, policy_version 995174 (0.0007) [2023-12-28 02:23:28,417][106226] Updated weights for policy 0, policy_version 992776 (0.0009) [2023-12-28 02:23:28,447][106225] Updated weights for policy 1, policy_version 995184 (0.0007) [2023-12-28 02:23:28,485][106226] Updated weights for policy 0, policy_version 992786 (0.0008) [2023-12-28 02:23:28,512][106225] Updated weights for policy 1, policy_version 995194 (0.0007) [2023-12-28 02:23:28,550][106226] Updated weights for policy 0, policy_version 992796 (0.0008) [2023-12-28 02:23:29,195][106225] Updated weights for policy 1, policy_version 995204 (0.0008) [2023-12-28 02:23:29,253][106226] Updated weights for policy 0, policy_version 992806 (0.0008) [2023-12-28 02:23:29,267][106225] Updated weights for policy 1, policy_version 995214 (0.0007) [2023-12-28 02:23:29,311][106226] Updated weights for policy 0, policy_version 992816 (0.0010) [2023-12-28 02:23:29,328][106225] Updated weights for policy 1, policy_version 995224 (0.0006) [2023-12-28 02:23:29,376][106226] Updated weights for policy 0, policy_version 992826 (0.0010) [2023-12-28 02:23:30,077][106226] Updated weights for policy 0, policy_version 992836 (0.0008) [2023-12-28 02:23:30,080][106225] Updated weights for policy 1, policy_version 995234 (0.0007) [2023-12-28 02:23:30,137][106226] Updated weights for policy 0, policy_version 992846 (0.0011) [2023-12-28 02:23:30,138][106225] Updated weights for policy 1, policy_version 995244 (0.0006) [2023-12-28 02:23:30,188][106226] Updated weights for policy 0, policy_version 992856 (0.0011) [2023-12-28 02:23:30,202][106225] Updated weights for policy 1, policy_version 995254 (0.0007) [2023-12-28 02:23:30,266][106225] Updated weights for policy 1, policy_version 995264 (0.0007) [2023-12-28 02:23:30,866][106225] Updated weights for policy 1, policy_version 995274 (0.0007) [2023-12-28 02:23:30,918][106226] Updated weights for policy 0, policy_version 992866 (0.0011) [2023-12-28 02:23:30,928][106225] Updated weights for policy 1, policy_version 995284 (0.0007) [2023-12-28 02:23:30,968][106226] Updated weights for policy 0, policy_version 992876 (0.0010) [2023-12-28 02:23:30,990][106225] Updated weights for policy 1, policy_version 995294 (0.0006) [2023-12-28 02:23:31,035][106226] Updated weights for policy 0, policy_version 992886 (0.0006) [2023-12-28 02:23:31,097][106226] Updated weights for policy 0, policy_version 992896 (0.0010) [2023-12-28 02:23:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 509075456. Throughput: 0: 9966.0, 1: 9880.0. Samples: 509059136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:31,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.953')] [2023-12-28 02:23:31,669][106225] Updated weights for policy 1, policy_version 995304 (0.0008) [2023-12-28 02:23:31,752][106225] Updated weights for policy 1, policy_version 995316 (0.0009) [2023-12-28 02:23:31,815][106225] Updated weights for policy 1, policy_version 995326 (0.0008) [2023-12-28 02:23:31,833][106226] Updated weights for policy 0, policy_version 992906 (0.0007) [2023-12-28 02:23:31,895][106226] Updated weights for policy 0, policy_version 992916 (0.0005) [2023-12-28 02:23:31,967][106226] Updated weights for policy 0, policy_version 992926 (0.0008) [2023-12-28 02:23:32,537][106225] Updated weights for policy 1, policy_version 995336 (0.0009) [2023-12-28 02:23:32,567][106226] Updated weights for policy 0, policy_version 992936 (0.0010) [2023-12-28 02:23:32,598][106225] Updated weights for policy 1, policy_version 995346 (0.0008) [2023-12-28 02:23:32,631][106226] Updated weights for policy 0, policy_version 992946 (0.0011) [2023-12-28 02:23:32,655][106225] Updated weights for policy 1, policy_version 995356 (0.0010) [2023-12-28 02:23:32,690][106226] Updated weights for policy 0, policy_version 992956 (0.0010) [2023-12-28 02:23:33,295][106225] Updated weights for policy 1, policy_version 995366 (0.0007) [2023-12-28 02:23:33,345][106225] Updated weights for policy 1, policy_version 995376 (0.0005) [2023-12-28 02:23:33,360][106226] Updated weights for policy 0, policy_version 992966 (0.0008) [2023-12-28 02:23:33,392][106225] Updated weights for policy 1, policy_version 995386 (0.0005) [2023-12-28 02:23:33,417][106226] Updated weights for policy 0, policy_version 992976 (0.0007) [2023-12-28 02:23:33,473][106226] Updated weights for policy 0, policy_version 992986 (0.0005) [2023-12-28 02:23:33,928][106225] Updated weights for policy 1, policy_version 995396 (0.0005) [2023-12-28 02:23:33,984][106225] Updated weights for policy 1, policy_version 995406 (0.0010) [2023-12-28 02:23:34,019][106226] Updated weights for policy 0, policy_version 992996 (0.0007) [2023-12-28 02:23:34,039][106225] Updated weights for policy 1, policy_version 995416 (0.0009) [2023-12-28 02:23:34,068][106226] Updated weights for policy 0, policy_version 993006 (0.0010) [2023-12-28 02:23:34,120][106226] Updated weights for policy 0, policy_version 993016 (0.0010) [2023-12-28 02:23:34,708][106225] Updated weights for policy 1, policy_version 995426 (0.0009) [2023-12-28 02:23:34,768][106225] Updated weights for policy 1, policy_version 995436 (0.0005) [2023-12-28 02:23:34,813][106225] Updated weights for policy 1, policy_version 995446 (0.0007) [2023-12-28 02:23:34,867][106225] Updated weights for policy 1, policy_version 995456 (0.0010) [2023-12-28 02:23:34,876][106226] Updated weights for policy 0, policy_version 993026 (0.0010) [2023-12-28 02:23:34,925][106226] Updated weights for policy 0, policy_version 993036 (0.0010) [2023-12-28 02:23:34,971][106226] Updated weights for policy 0, policy_version 993046 (0.0010) [2023-12-28 02:23:35,028][106226] Updated weights for policy 0, policy_version 993056 (0.0011) [2023-12-28 02:23:35,537][106225] Updated weights for policy 1, policy_version 995466 (0.0007) [2023-12-28 02:23:35,586][106225] Updated weights for policy 1, policy_version 995476 (0.0008) [2023-12-28 02:23:35,635][106225] Updated weights for policy 1, policy_version 995486 (0.0007) [2023-12-28 02:23:35,764][106226] Updated weights for policy 0, policy_version 993066 (0.0011) [2023-12-28 02:23:35,821][106226] Updated weights for policy 0, policy_version 993076 (0.0011) [2023-12-28 02:23:35,875][106226] Updated weights for policy 0, policy_version 993086 (0.0011) [2023-12-28 02:23:36,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19933.7, 300 sec: 19799.6). Total num frames: 509173760. Throughput: 0: 10017.7, 1: 9881.2. Samples: 509183088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:36,176][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.181')] [2023-12-28 02:23:36,406][106225] Updated weights for policy 1, policy_version 995496 (0.0008) [2023-12-28 02:23:36,465][106225] Updated weights for policy 1, policy_version 995506 (0.0009) [2023-12-28 02:23:36,527][106225] Updated weights for policy 1, policy_version 995516 (0.0008) [2023-12-28 02:23:36,590][106226] Updated weights for policy 0, policy_version 993096 (0.0009) [2023-12-28 02:23:36,655][106226] Updated weights for policy 0, policy_version 993106 (0.0009) [2023-12-28 02:23:36,712][106226] Updated weights for policy 0, policy_version 993116 (0.0010) [2023-12-28 02:23:37,245][106225] Updated weights for policy 1, policy_version 995526 (0.0008) [2023-12-28 02:23:37,298][106225] Updated weights for policy 1, policy_version 995536 (0.0008) [2023-12-28 02:23:37,345][106225] Updated weights for policy 1, policy_version 995546 (0.0007) [2023-12-28 02:23:37,434][106226] Updated weights for policy 0, policy_version 993126 (0.0011) [2023-12-28 02:23:37,503][106226] Updated weights for policy 0, policy_version 993136 (0.0011) [2023-12-28 02:23:37,556][106226] Updated weights for policy 0, policy_version 993146 (0.0011) [2023-12-28 02:23:38,106][106225] Updated weights for policy 1, policy_version 995556 (0.0008) [2023-12-28 02:23:38,165][106225] Updated weights for policy 1, policy_version 995566 (0.0008) [2023-12-28 02:23:38,225][106225] Updated weights for policy 1, policy_version 995576 (0.0008) [2023-12-28 02:23:38,273][106226] Updated weights for policy 0, policy_version 993156 (0.0010) [2023-12-28 02:23:38,331][106226] Updated weights for policy 0, policy_version 993166 (0.0010) [2023-12-28 02:23:38,396][106226] Updated weights for policy 0, policy_version 993176 (0.0008) [2023-12-28 02:23:39,013][106225] Updated weights for policy 1, policy_version 995586 (0.0009) [2023-12-28 02:23:39,014][106226] Updated weights for policy 0, policy_version 993186 (0.0007) [2023-12-28 02:23:39,078][106225] Updated weights for policy 1, policy_version 995596 (0.0007) [2023-12-28 02:23:39,080][106226] Updated weights for policy 0, policy_version 993196 (0.0014) [2023-12-28 02:23:39,138][106225] Updated weights for policy 1, policy_version 995606 (0.0008) [2023-12-28 02:23:39,146][106226] Updated weights for policy 0, policy_version 993206 (0.0008) [2023-12-28 02:23:39,203][106225] Updated weights for policy 1, policy_version 995616 (0.0008) [2023-12-28 02:23:39,217][106226] Updated weights for policy 0, policy_version 993216 (0.0007) [2023-12-28 02:23:39,902][106226] Updated weights for policy 0, policy_version 993226 (0.0007) [2023-12-28 02:23:39,954][106225] Updated weights for policy 1, policy_version 995626 (0.0008) [2023-12-28 02:23:39,968][106226] Updated weights for policy 0, policy_version 993236 (0.0008) [2023-12-28 02:23:40,011][106225] Updated weights for policy 1, policy_version 995636 (0.0007) [2023-12-28 02:23:40,029][106226] Updated weights for policy 0, policy_version 993246 (0.0006) [2023-12-28 02:23:40,061][106225] Updated weights for policy 1, policy_version 995646 (0.0007) [2023-12-28 02:23:40,621][106226] Updated weights for policy 0, policy_version 993256 (0.0005) [2023-12-28 02:23:40,671][106226] Updated weights for policy 0, policy_version 993266 (0.0008) [2023-12-28 02:23:40,732][106226] Updated weights for policy 0, policy_version 993276 (0.0009) [2023-12-28 02:23:40,837][106225] Updated weights for policy 1, policy_version 995656 (0.0008) [2023-12-28 02:23:40,893][106225] Updated weights for policy 1, policy_version 995666 (0.0009) [2023-12-28 02:23:40,961][106225] Updated weights for policy 1, policy_version 995676 (0.0009) [2023-12-28 02:23:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 509272064. Throughput: 0: 10037.0, 1: 9894.5. Samples: 509241504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:41,175][105115] Avg episode reward: [(0, '-4.910'), (1, '-4.919')] [2023-12-28 02:23:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000995680_254935040.pth... [2023-12-28 02:23:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000993280_254337024.pth... [2023-12-28 02:23:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000992096_254033920.pth [2023-12-28 02:23:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000994528_254640128.pth [2023-12-28 02:23:41,494][106226] Updated weights for policy 0, policy_version 993286 (0.0008) [2023-12-28 02:23:41,555][106226] Updated weights for policy 0, policy_version 993296 (0.0009) [2023-12-28 02:23:41,625][106226] Updated weights for policy 0, policy_version 993306 (0.0008) [2023-12-28 02:23:41,712][106225] Updated weights for policy 1, policy_version 995686 (0.0008) [2023-12-28 02:23:41,781][106225] Updated weights for policy 1, policy_version 995696 (0.0010) [2023-12-28 02:23:41,835][106225] Updated weights for policy 1, policy_version 995706 (0.0008) [2023-12-28 02:23:42,421][106226] Updated weights for policy 0, policy_version 993316 (0.0010) [2023-12-28 02:23:42,481][106226] Updated weights for policy 0, policy_version 993326 (0.0006) [2023-12-28 02:23:42,540][106226] Updated weights for policy 0, policy_version 993336 (0.0006) [2023-12-28 02:23:42,578][106225] Updated weights for policy 1, policy_version 995716 (0.0005) [2023-12-28 02:23:42,629][106225] Updated weights for policy 1, policy_version 995726 (0.0008) [2023-12-28 02:23:42,682][106225] Updated weights for policy 1, policy_version 995736 (0.0009) [2023-12-28 02:23:43,165][106226] Updated weights for policy 0, policy_version 993346 (0.0008) [2023-12-28 02:23:43,228][106226] Updated weights for policy 0, policy_version 993356 (0.0005) [2023-12-28 02:23:43,280][106226] Updated weights for policy 0, policy_version 993366 (0.0005) [2023-12-28 02:23:43,335][106226] Updated weights for policy 0, policy_version 993376 (0.0006) [2023-12-28 02:23:43,452][106225] Updated weights for policy 1, policy_version 995746 (0.0008) [2023-12-28 02:23:43,506][106225] Updated weights for policy 1, policy_version 995756 (0.0006) [2023-12-28 02:23:43,557][106225] Updated weights for policy 1, policy_version 995766 (0.0005) [2023-12-28 02:23:43,602][106225] Updated weights for policy 1, policy_version 995776 (0.0007) [2023-12-28 02:23:43,999][106226] Updated weights for policy 0, policy_version 993386 (0.0005) [2023-12-28 02:23:44,071][106226] Updated weights for policy 0, policy_version 993396 (0.0005) [2023-12-28 02:23:44,125][106226] Updated weights for policy 0, policy_version 993406 (0.0005) [2023-12-28 02:23:44,231][106225] Updated weights for policy 1, policy_version 995786 (0.0010) [2023-12-28 02:23:44,278][106225] Updated weights for policy 1, policy_version 995796 (0.0010) [2023-12-28 02:23:44,325][106225] Updated weights for policy 1, policy_version 995806 (0.0010) [2023-12-28 02:23:44,732][106226] Updated weights for policy 0, policy_version 993416 (0.0006) [2023-12-28 02:23:44,796][106226] Updated weights for policy 0, policy_version 993426 (0.0008) [2023-12-28 02:23:44,855][106226] Updated weights for policy 0, policy_version 993436 (0.0008) [2023-12-28 02:23:45,081][106225] Updated weights for policy 1, policy_version 995816 (0.0009) [2023-12-28 02:23:45,142][106225] Updated weights for policy 1, policy_version 995826 (0.0008) [2023-12-28 02:23:45,201][106225] Updated weights for policy 1, policy_version 995836 (0.0005) [2023-12-28 02:23:45,569][106226] Updated weights for policy 0, policy_version 993446 (0.0008) [2023-12-28 02:23:45,627][106226] Updated weights for policy 0, policy_version 993456 (0.0009) [2023-12-28 02:23:45,690][106226] Updated weights for policy 0, policy_version 993466 (0.0008) [2023-12-28 02:23:45,920][106225] Updated weights for policy 1, policy_version 995846 (0.0008) [2023-12-28 02:23:45,973][106225] Updated weights for policy 1, policy_version 995856 (0.0008) [2023-12-28 02:23:46,026][106225] Updated weights for policy 1, policy_version 995866 (0.0008) [2023-12-28 02:23:46,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 509370368. Throughput: 0: 10100.5, 1: 9839.7. Samples: 509358152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:46,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.922')] [2023-12-28 02:23:46,401][106226] Updated weights for policy 0, policy_version 993476 (0.0008) [2023-12-28 02:23:46,458][106226] Updated weights for policy 0, policy_version 993486 (0.0006) [2023-12-28 02:23:46,519][106226] Updated weights for policy 0, policy_version 993496 (0.0006) [2023-12-28 02:23:46,857][106225] Updated weights for policy 1, policy_version 995876 (0.0009) [2023-12-28 02:23:46,906][106225] Updated weights for policy 1, policy_version 995886 (0.0008) [2023-12-28 02:23:46,958][106225] Updated weights for policy 1, policy_version 995896 (0.0008) [2023-12-28 02:23:47,071][106226] Updated weights for policy 0, policy_version 993506 (0.0006) [2023-12-28 02:23:47,136][106226] Updated weights for policy 0, policy_version 993516 (0.0008) [2023-12-28 02:23:47,198][106226] Updated weights for policy 0, policy_version 993526 (0.0008) [2023-12-28 02:23:47,246][106226] Updated weights for policy 0, policy_version 993536 (0.0008) [2023-12-28 02:23:47,703][106225] Updated weights for policy 1, policy_version 995906 (0.0008) [2023-12-28 02:23:47,764][106225] Updated weights for policy 1, policy_version 995916 (0.0008) [2023-12-28 02:23:47,824][106225] Updated weights for policy 1, policy_version 995926 (0.0009) [2023-12-28 02:23:47,851][106226] Updated weights for policy 0, policy_version 993546 (0.0006) [2023-12-28 02:23:47,881][106225] Updated weights for policy 1, policy_version 995936 (0.0007) [2023-12-28 02:23:47,897][106226] Updated weights for policy 0, policy_version 993556 (0.0007) [2023-12-28 02:23:47,957][106226] Updated weights for policy 0, policy_version 993566 (0.0008) [2023-12-28 02:23:48,518][106225] Updated weights for policy 1, policy_version 995946 (0.0008) [2023-12-28 02:23:48,584][106225] Updated weights for policy 1, policy_version 995956 (0.0008) [2023-12-28 02:23:48,647][106225] Updated weights for policy 1, policy_version 995966 (0.0008) [2023-12-28 02:23:48,766][106226] Updated weights for policy 0, policy_version 993576 (0.0011) [2023-12-28 02:23:48,820][106226] Updated weights for policy 0, policy_version 993586 (0.0010) [2023-12-28 02:23:48,870][106226] Updated weights for policy 0, policy_version 993596 (0.0010) [2023-12-28 02:23:49,366][106225] Updated weights for policy 1, policy_version 995976 (0.0010) [2023-12-28 02:23:49,429][106225] Updated weights for policy 1, policy_version 995986 (0.0010) [2023-12-28 02:23:49,485][106225] Updated weights for policy 1, policy_version 995996 (0.0007) [2023-12-28 02:23:49,610][106226] Updated weights for policy 0, policy_version 993606 (0.0009) [2023-12-28 02:23:49,664][106226] Updated weights for policy 0, policy_version 993616 (0.0008) [2023-12-28 02:23:49,719][106226] Updated weights for policy 0, policy_version 993626 (0.0008) [2023-12-28 02:23:50,250][106225] Updated weights for policy 1, policy_version 996006 (0.0008) [2023-12-28 02:23:50,308][106225] Updated weights for policy 1, policy_version 996016 (0.0010) [2023-12-28 02:23:50,355][106226] Updated weights for policy 0, policy_version 993636 (0.0007) [2023-12-28 02:23:50,361][106225] Updated weights for policy 1, policy_version 996026 (0.0007) [2023-12-28 02:23:50,413][106226] Updated weights for policy 0, policy_version 993646 (0.0006) [2023-12-28 02:23:50,465][106226] Updated weights for policy 0, policy_version 993656 (0.0006) [2023-12-28 02:23:51,054][106226] Updated weights for policy 0, policy_version 993666 (0.0006) [2023-12-28 02:23:51,116][106226] Updated weights for policy 0, policy_version 993676 (0.0008) [2023-12-28 02:23:51,124][106225] Updated weights for policy 1, policy_version 996036 (0.0007) [2023-12-28 02:23:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 509460480. Throughput: 0: 10112.6, 1: 9769.1. Samples: 509476700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:51,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.988')] [2023-12-28 02:23:51,185][106226] Updated weights for policy 0, policy_version 993686 (0.0008) [2023-12-28 02:23:51,186][106225] Updated weights for policy 1, policy_version 996046 (0.0007) [2023-12-28 02:23:51,244][106226] Updated weights for policy 0, policy_version 993696 (0.0009) [2023-12-28 02:23:51,246][106225] Updated weights for policy 1, policy_version 996056 (0.0007) [2023-12-28 02:23:51,983][106225] Updated weights for policy 1, policy_version 996066 (0.0006) [2023-12-28 02:23:52,028][106226] Updated weights for policy 0, policy_version 993706 (0.0008) [2023-12-28 02:23:52,046][106225] Updated weights for policy 1, policy_version 996076 (0.0007) [2023-12-28 02:23:52,095][106226] Updated weights for policy 0, policy_version 993716 (0.0007) [2023-12-28 02:23:52,103][106225] Updated weights for policy 1, policy_version 996086 (0.0008) [2023-12-28 02:23:52,163][106226] Updated weights for policy 0, policy_version 993726 (0.0005) [2023-12-28 02:23:52,166][106225] Updated weights for policy 1, policy_version 996096 (0.0008) [2023-12-28 02:23:52,838][106225] Updated weights for policy 1, policy_version 996106 (0.0005) [2023-12-28 02:23:52,900][106225] Updated weights for policy 1, policy_version 996116 (0.0006) [2023-12-28 02:23:52,940][106226] Updated weights for policy 0, policy_version 993736 (0.0006) [2023-12-28 02:23:52,960][106225] Updated weights for policy 1, policy_version 996126 (0.0010) [2023-12-28 02:23:53,001][106226] Updated weights for policy 0, policy_version 993746 (0.0007) [2023-12-28 02:23:53,058][106226] Updated weights for policy 0, policy_version 993756 (0.0007) [2023-12-28 02:23:53,609][106225] Updated weights for policy 1, policy_version 996136 (0.0010) [2023-12-28 02:23:53,640][106226] Updated weights for policy 0, policy_version 993766 (0.0007) [2023-12-28 02:23:53,673][106225] Updated weights for policy 1, policy_version 996146 (0.0010) [2023-12-28 02:23:53,688][106226] Updated weights for policy 0, policy_version 993776 (0.0007) [2023-12-28 02:23:53,730][106225] Updated weights for policy 1, policy_version 996156 (0.0006) [2023-12-28 02:23:53,734][106226] Updated weights for policy 0, policy_version 993786 (0.0005) [2023-12-28 02:23:54,399][106225] Updated weights for policy 1, policy_version 996166 (0.0007) [2023-12-28 02:23:54,436][106226] Updated weights for policy 0, policy_version 993796 (0.0006) [2023-12-28 02:23:54,464][106225] Updated weights for policy 1, policy_version 996176 (0.0010) [2023-12-28 02:23:54,501][106226] Updated weights for policy 0, policy_version 993806 (0.0006) [2023-12-28 02:23:54,524][106225] Updated weights for policy 1, policy_version 996186 (0.0011) [2023-12-28 02:23:54,559][106226] Updated weights for policy 0, policy_version 993816 (0.0007) [2023-12-28 02:23:55,164][106225] Updated weights for policy 1, policy_version 996196 (0.0006) [2023-12-28 02:23:55,226][106225] Updated weights for policy 1, policy_version 996206 (0.0008) [2023-12-28 02:23:55,240][106226] Updated weights for policy 0, policy_version 993826 (0.0008) [2023-12-28 02:23:55,283][106225] Updated weights for policy 1, policy_version 996216 (0.0005) [2023-12-28 02:23:55,289][106226] Updated weights for policy 0, policy_version 993836 (0.0008) [2023-12-28 02:23:55,337][106226] Updated weights for policy 0, policy_version 993846 (0.0006) [2023-12-28 02:23:55,409][106226] Updated weights for policy 0, policy_version 993856 (0.0005) [2023-12-28 02:23:55,900][106225] Updated weights for policy 1, policy_version 996226 (0.0006) [2023-12-28 02:23:55,958][106225] Updated weights for policy 1, policy_version 996236 (0.0008) [2023-12-28 02:23:56,015][106225] Updated weights for policy 1, policy_version 996246 (0.0007) [2023-12-28 02:23:56,028][106226] Updated weights for policy 0, policy_version 993866 (0.0010) [2023-12-28 02:23:56,076][106225] Updated weights for policy 1, policy_version 996256 (0.0005) [2023-12-28 02:23:56,078][106226] Updated weights for policy 0, policy_version 993876 (0.0010) [2023-12-28 02:23:56,131][106226] Updated weights for policy 0, policy_version 993886 (0.0010) [2023-12-28 02:23:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 509575168. Throughput: 0: 10100.5, 1: 9784.1. Samples: 509535816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:23:56,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.708')] [2023-12-28 02:23:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000996256_255082496.pth... [2023-12-28 02:23:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000993888_254492672.pth... [2023-12-28 02:23:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000995104_254787584.pth [2023-12-28 02:23:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000992704_254189568.pth [2023-12-28 02:23:56,786][106225] Updated weights for policy 1, policy_version 996266 (0.0007) [2023-12-28 02:23:56,810][106226] Updated weights for policy 0, policy_version 993896 (0.0010) [2023-12-28 02:23:56,839][106225] Updated weights for policy 1, policy_version 996276 (0.0005) [2023-12-28 02:23:56,860][106226] Updated weights for policy 0, policy_version 993906 (0.0010) [2023-12-28 02:23:56,891][106225] Updated weights for policy 1, policy_version 996286 (0.0006) [2023-12-28 02:23:56,908][106226] Updated weights for policy 0, policy_version 993916 (0.0009) [2023-12-28 02:23:57,592][106226] Updated weights for policy 0, policy_version 993926 (0.0010) [2023-12-28 02:23:57,626][106225] Updated weights for policy 1, policy_version 996296 (0.0006) [2023-12-28 02:23:57,647][106226] Updated weights for policy 0, policy_version 993936 (0.0010) [2023-12-28 02:23:57,677][106225] Updated weights for policy 1, policy_version 996306 (0.0005) [2023-12-28 02:23:57,710][106226] Updated weights for policy 0, policy_version 993946 (0.0010) [2023-12-28 02:23:57,737][106225] Updated weights for policy 1, policy_version 996316 (0.0008) [2023-12-28 02:23:58,315][106225] Updated weights for policy 1, policy_version 996326 (0.0009) [2023-12-28 02:23:58,384][106225] Updated weights for policy 1, policy_version 996336 (0.0009) [2023-12-28 02:23:58,452][106225] Updated weights for policy 1, policy_version 996346 (0.0008) [2023-12-28 02:23:58,479][106226] Updated weights for policy 0, policy_version 993956 (0.0011) [2023-12-28 02:23:58,544][106226] Updated weights for policy 0, policy_version 993966 (0.0011) [2023-12-28 02:23:58,612][106226] Updated weights for policy 0, policy_version 993976 (0.0011) [2023-12-28 02:23:59,269][106225] Updated weights for policy 1, policy_version 996356 (0.0008) [2023-12-28 02:23:59,338][106225] Updated weights for policy 1, policy_version 996366 (0.0009) [2023-12-28 02:23:59,373][106226] Updated weights for policy 0, policy_version 993986 (0.0008) [2023-12-28 02:23:59,400][106225] Updated weights for policy 1, policy_version 996376 (0.0008) [2023-12-28 02:23:59,427][106226] Updated weights for policy 0, policy_version 993996 (0.0008) [2023-12-28 02:23:59,494][106226] Updated weights for policy 0, policy_version 994006 (0.0008) [2023-12-28 02:23:59,563][106226] Updated weights for policy 0, policy_version 994016 (0.0009) [2023-12-28 02:24:00,104][106225] Updated weights for policy 1, policy_version 996386 (0.0007) [2023-12-28 02:24:00,167][106225] Updated weights for policy 1, policy_version 996396 (0.0010) [2023-12-28 02:24:00,228][106225] Updated weights for policy 1, policy_version 996406 (0.0010) [2023-12-28 02:24:00,281][106226] Updated weights for policy 0, policy_version 994026 (0.0008) [2023-12-28 02:24:00,284][106225] Updated weights for policy 1, policy_version 996416 (0.0005) [2023-12-28 02:24:00,338][106226] Updated weights for policy 0, policy_version 994036 (0.0009) [2023-12-28 02:24:00,403][106226] Updated weights for policy 0, policy_version 994046 (0.0009) [2023-12-28 02:24:00,836][106225] Updated weights for policy 1, policy_version 996426 (0.0006) [2023-12-28 02:24:00,894][106225] Updated weights for policy 1, policy_version 996436 (0.0007) [2023-12-28 02:24:00,944][106225] Updated weights for policy 1, policy_version 996446 (0.0007) [2023-12-28 02:24:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 509665280. Throughput: 0: 10059.7, 1: 9854.1. Samples: 509655144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:01,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.948')] [2023-12-28 02:24:01,212][106226] Updated weights for policy 0, policy_version 994056 (0.0008) [2023-12-28 02:24:01,275][106226] Updated weights for policy 0, policy_version 994066 (0.0008) [2023-12-28 02:24:01,342][106226] Updated weights for policy 0, policy_version 994076 (0.0007) [2023-12-28 02:24:01,693][106225] Updated weights for policy 1, policy_version 996456 (0.0010) [2023-12-28 02:24:01,761][106225] Updated weights for policy 1, policy_version 996466 (0.0008) [2023-12-28 02:24:01,822][106225] Updated weights for policy 1, policy_version 996476 (0.0011) [2023-12-28 02:24:02,110][106226] Updated weights for policy 0, policy_version 994086 (0.0008) [2023-12-28 02:24:02,161][106226] Updated weights for policy 0, policy_version 994096 (0.0009) [2023-12-28 02:24:02,211][106226] Updated weights for policy 0, policy_version 994106 (0.0008) [2023-12-28 02:24:02,570][106225] Updated weights for policy 1, policy_version 996486 (0.0009) [2023-12-28 02:24:02,633][106225] Updated weights for policy 1, policy_version 996496 (0.0007) [2023-12-28 02:24:02,698][106225] Updated weights for policy 1, policy_version 996506 (0.0007) [2023-12-28 02:24:03,000][106226] Updated weights for policy 0, policy_version 994116 (0.0008) [2023-12-28 02:24:03,062][106226] Updated weights for policy 0, policy_version 994126 (0.0009) [2023-12-28 02:24:03,120][106226] Updated weights for policy 0, policy_version 994136 (0.0008) [2023-12-28 02:24:03,283][106225] Updated weights for policy 1, policy_version 996516 (0.0008) [2023-12-28 02:24:03,334][106225] Updated weights for policy 1, policy_version 996526 (0.0008) [2023-12-28 02:24:03,384][106225] Updated weights for policy 1, policy_version 996536 (0.0009) [2023-12-28 02:24:03,900][106226] Updated weights for policy 0, policy_version 994146 (0.0008) [2023-12-28 02:24:03,956][106226] Updated weights for policy 0, policy_version 994156 (0.0009) [2023-12-28 02:24:04,015][106226] Updated weights for policy 0, policy_version 994166 (0.0008) [2023-12-28 02:24:04,054][106225] Updated weights for policy 1, policy_version 996546 (0.0009) [2023-12-28 02:24:04,076][106226] Updated weights for policy 0, policy_version 994176 (0.0007) [2023-12-28 02:24:04,115][106225] Updated weights for policy 1, policy_version 996556 (0.0007) [2023-12-28 02:24:04,179][106225] Updated weights for policy 1, policy_version 996566 (0.0008) [2023-12-28 02:24:04,239][106225] Updated weights for policy 1, policy_version 996576 (0.0009) [2023-12-28 02:24:04,824][106226] Updated weights for policy 0, policy_version 994186 (0.0010) [2023-12-28 02:24:04,879][106226] Updated weights for policy 0, policy_version 994196 (0.0009) [2023-12-28 02:24:04,907][106225] Updated weights for policy 1, policy_version 996586 (0.0005) [2023-12-28 02:24:04,934][106226] Updated weights for policy 0, policy_version 994206 (0.0008) [2023-12-28 02:24:04,967][106225] Updated weights for policy 1, policy_version 996596 (0.0008) [2023-12-28 02:24:05,028][106225] Updated weights for policy 1, policy_version 996606 (0.0008) [2023-12-28 02:24:05,631][106225] Updated weights for policy 1, policy_version 996616 (0.0008) [2023-12-28 02:24:05,692][106225] Updated weights for policy 1, policy_version 996626 (0.0007) [2023-12-28 02:24:05,703][106226] Updated weights for policy 0, policy_version 994216 (0.0007) [2023-12-28 02:24:05,749][106225] Updated weights for policy 1, policy_version 996636 (0.0005) [2023-12-28 02:24:05,762][106226] Updated weights for policy 0, policy_version 994226 (0.0008) [2023-12-28 02:24:05,813][106226] Updated weights for policy 0, policy_version 994236 (0.0009) [2023-12-28 02:24:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 509763584. Throughput: 0: 9961.9, 1: 9917.2. Samples: 509771956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:06,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.910')] [2023-12-28 02:24:06,417][106225] Updated weights for policy 1, policy_version 996646 (0.0007) [2023-12-28 02:24:06,475][106225] Updated weights for policy 1, policy_version 996656 (0.0007) [2023-12-28 02:24:06,533][106225] Updated weights for policy 1, policy_version 996666 (0.0008) [2023-12-28 02:24:06,564][106226] Updated weights for policy 0, policy_version 994246 (0.0008) [2023-12-28 02:24:06,614][106226] Updated weights for policy 0, policy_version 994256 (0.0008) [2023-12-28 02:24:06,672][106226] Updated weights for policy 0, policy_version 994266 (0.0007) [2023-12-28 02:24:07,230][106225] Updated weights for policy 1, policy_version 996676 (0.0006) [2023-12-28 02:24:07,297][106225] Updated weights for policy 1, policy_version 996686 (0.0005) [2023-12-28 02:24:07,329][106226] Updated weights for policy 0, policy_version 994276 (0.0009) [2023-12-28 02:24:07,354][106225] Updated weights for policy 1, policy_version 996696 (0.0007) [2023-12-28 02:24:07,388][106226] Updated weights for policy 0, policy_version 994286 (0.0007) [2023-12-28 02:24:07,448][106226] Updated weights for policy 0, policy_version 994296 (0.0007) [2023-12-28 02:24:07,911][106225] Updated weights for policy 1, policy_version 996706 (0.0009) [2023-12-28 02:24:07,979][106225] Updated weights for policy 1, policy_version 996716 (0.0010) [2023-12-28 02:24:08,033][106225] Updated weights for policy 1, policy_version 996726 (0.0010) [2023-12-28 02:24:08,043][106226] Updated weights for policy 0, policy_version 994306 (0.0007) [2023-12-28 02:24:08,080][106225] Updated weights for policy 1, policy_version 996736 (0.0008) [2023-12-28 02:24:08,098][106226] Updated weights for policy 0, policy_version 994316 (0.0005) [2023-12-28 02:24:08,161][106226] Updated weights for policy 0, policy_version 994326 (0.0005) [2023-12-28 02:24:08,222][106226] Updated weights for policy 0, policy_version 994336 (0.0005) [2023-12-28 02:24:08,825][106225] Updated weights for policy 1, policy_version 996746 (0.0007) [2023-12-28 02:24:08,830][106226] Updated weights for policy 0, policy_version 994346 (0.0011) [2023-12-28 02:24:08,882][106225] Updated weights for policy 1, policy_version 996756 (0.0009) [2023-12-28 02:24:08,891][106226] Updated weights for policy 0, policy_version 994356 (0.0009) [2023-12-28 02:24:08,938][106225] Updated weights for policy 1, policy_version 996766 (0.0006) [2023-12-28 02:24:08,951][106226] Updated weights for policy 0, policy_version 994366 (0.0011) [2023-12-28 02:24:09,693][106226] Updated weights for policy 0, policy_version 994376 (0.0007) [2023-12-28 02:24:09,740][106225] Updated weights for policy 1, policy_version 996776 (0.0007) [2023-12-28 02:24:09,755][106226] Updated weights for policy 0, policy_version 994386 (0.0007) [2023-12-28 02:24:09,802][106225] Updated weights for policy 1, policy_version 996786 (0.0008) [2023-12-28 02:24:09,818][106226] Updated weights for policy 0, policy_version 994396 (0.0009) [2023-12-28 02:24:09,871][106225] Updated weights for policy 1, policy_version 996796 (0.0009) [2023-12-28 02:24:10,528][106226] Updated weights for policy 0, policy_version 994406 (0.0009) [2023-12-28 02:24:10,587][106226] Updated weights for policy 0, policy_version 994416 (0.0005) [2023-12-28 02:24:10,647][106226] Updated weights for policy 0, policy_version 994426 (0.0006) [2023-12-28 02:24:10,678][106225] Updated weights for policy 1, policy_version 996806 (0.0009) [2023-12-28 02:24:10,740][106225] Updated weights for policy 1, policy_version 996816 (0.0009) [2023-12-28 02:24:10,797][106225] Updated weights for policy 1, policy_version 996826 (0.0008) [2023-12-28 02:24:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 509861888. Throughput: 0: 9994.4, 1: 9962.5. Samples: 509834828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:11,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.901')] [2023-12-28 02:24:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000996832_255229952.pth... [2023-12-28 02:24:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000994432_254631936.pth... [2023-12-28 02:24:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000995680_254935040.pth [2023-12-28 02:24:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000993280_254337024.pth [2023-12-28 02:24:11,236][106226] Updated weights for policy 0, policy_version 994436 (0.0006) [2023-12-28 02:24:11,301][106226] Updated weights for policy 0, policy_version 994446 (0.0006) [2023-12-28 02:24:11,373][106226] Updated weights for policy 0, policy_version 994456 (0.0007) [2023-12-28 02:24:11,575][106225] Updated weights for policy 1, policy_version 996836 (0.0007) [2023-12-28 02:24:11,640][106225] Updated weights for policy 1, policy_version 996846 (0.0008) [2023-12-28 02:24:11,699][106225] Updated weights for policy 1, policy_version 996856 (0.0009) [2023-12-28 02:24:12,031][106226] Updated weights for policy 0, policy_version 994466 (0.0010) [2023-12-28 02:24:12,091][106226] Updated weights for policy 0, policy_version 994476 (0.0009) [2023-12-28 02:24:12,152][106226] Updated weights for policy 0, policy_version 994486 (0.0009) [2023-12-28 02:24:12,212][106226] Updated weights for policy 0, policy_version 994496 (0.0008) [2023-12-28 02:24:12,487][106225] Updated weights for policy 1, policy_version 996866 (0.0008) [2023-12-28 02:24:12,554][106225] Updated weights for policy 1, policy_version 996876 (0.0008) [2023-12-28 02:24:12,608][106225] Updated weights for policy 1, policy_version 996886 (0.0008) [2023-12-28 02:24:12,663][106225] Updated weights for policy 1, policy_version 996896 (0.0008) [2023-12-28 02:24:12,901][106226] Updated weights for policy 0, policy_version 994506 (0.0008) [2023-12-28 02:24:12,963][106226] Updated weights for policy 0, policy_version 994516 (0.0009) [2023-12-28 02:24:13,032][106226] Updated weights for policy 0, policy_version 994526 (0.0005) [2023-12-28 02:24:13,438][106225] Updated weights for policy 1, policy_version 996906 (0.0009) [2023-12-28 02:24:13,491][106225] Updated weights for policy 1, policy_version 996916 (0.0008) [2023-12-28 02:24:13,530][106226] Updated weights for policy 0, policy_version 994536 (0.0009) [2023-12-28 02:24:13,539][106225] Updated weights for policy 1, policy_version 996926 (0.0009) [2023-12-28 02:24:13,596][106226] Updated weights for policy 0, policy_version 994546 (0.0010) [2023-12-28 02:24:13,658][106226] Updated weights for policy 0, policy_version 994556 (0.0010) [2023-12-28 02:24:14,213][106225] Updated weights for policy 1, policy_version 996936 (0.0007) [2023-12-28 02:24:14,267][106225] Updated weights for policy 1, policy_version 996946 (0.0006) [2023-12-28 02:24:14,332][106225] Updated weights for policy 1, policy_version 996956 (0.0007) [2023-12-28 02:24:14,334][106226] Updated weights for policy 0, policy_version 994566 (0.0008) [2023-12-28 02:24:14,392][106226] Updated weights for policy 0, policy_version 994576 (0.0005) [2023-12-28 02:24:14,452][106226] Updated weights for policy 0, policy_version 994586 (0.0009) [2023-12-28 02:24:15,058][106225] Updated weights for policy 1, policy_version 996966 (0.0008) [2023-12-28 02:24:15,061][106226] Updated weights for policy 0, policy_version 994596 (0.0005) [2023-12-28 02:24:15,113][106226] Updated weights for policy 0, policy_version 994606 (0.0005) [2023-12-28 02:24:15,129][106225] Updated weights for policy 1, policy_version 996976 (0.0007) [2023-12-28 02:24:15,170][106226] Updated weights for policy 0, policy_version 994616 (0.0008) [2023-12-28 02:24:15,201][106225] Updated weights for policy 1, policy_version 996986 (0.0006) [2023-12-28 02:24:15,801][106225] Updated weights for policy 1, policy_version 996996 (0.0006) [2023-12-28 02:24:15,855][106225] Updated weights for policy 1, policy_version 997006 (0.0006) [2023-12-28 02:24:15,869][106226] Updated weights for policy 0, policy_version 994626 (0.0011) [2023-12-28 02:24:15,905][106225] Updated weights for policy 1, policy_version 997016 (0.0010) [2023-12-28 02:24:15,918][106226] Updated weights for policy 0, policy_version 994636 (0.0010) [2023-12-28 02:24:15,975][106226] Updated weights for policy 0, policy_version 994646 (0.0010) [2023-12-28 02:24:16,036][106226] Updated weights for policy 0, policy_version 994656 (0.0011) [2023-12-28 02:24:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 509968384. Throughput: 0: 10020.7, 1: 9853.4. Samples: 509953472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:16,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.715')] [2023-12-28 02:24:16,617][106225] Updated weights for policy 1, policy_version 997026 (0.0009) [2023-12-28 02:24:16,682][106225] Updated weights for policy 1, policy_version 997036 (0.0006) [2023-12-28 02:24:16,736][106225] Updated weights for policy 1, policy_version 997046 (0.0007) [2023-12-28 02:24:16,749][106226] Updated weights for policy 0, policy_version 994666 (0.0006) [2023-12-28 02:24:16,790][106225] Updated weights for policy 1, policy_version 997056 (0.0007) [2023-12-28 02:24:16,812][106226] Updated weights for policy 0, policy_version 994676 (0.0006) [2023-12-28 02:24:16,872][106226] Updated weights for policy 0, policy_version 994686 (0.0006) [2023-12-28 02:24:17,443][106225] Updated weights for policy 1, policy_version 997066 (0.0005) [2023-12-28 02:24:17,506][106225] Updated weights for policy 1, policy_version 997076 (0.0005) [2023-12-28 02:24:17,539][106226] Updated weights for policy 0, policy_version 994696 (0.0007) [2023-12-28 02:24:17,561][106225] Updated weights for policy 1, policy_version 997086 (0.0005) [2023-12-28 02:24:17,589][106226] Updated weights for policy 0, policy_version 994706 (0.0008) [2023-12-28 02:24:17,643][106226] Updated weights for policy 0, policy_version 994716 (0.0010) [2023-12-28 02:24:18,114][106225] Updated weights for policy 1, policy_version 997096 (0.0008) [2023-12-28 02:24:18,168][106225] Updated weights for policy 1, policy_version 997106 (0.0009) [2023-12-28 02:24:18,216][106225] Updated weights for policy 1, policy_version 997116 (0.0010) [2023-12-28 02:24:18,419][106226] Updated weights for policy 0, policy_version 994726 (0.0008) [2023-12-28 02:24:18,478][106226] Updated weights for policy 0, policy_version 994736 (0.0008) [2023-12-28 02:24:18,529][106226] Updated weights for policy 0, policy_version 994746 (0.0008) [2023-12-28 02:24:19,024][106225] Updated weights for policy 1, policy_version 997126 (0.0007) [2023-12-28 02:24:19,075][106225] Updated weights for policy 1, policy_version 997136 (0.0005) [2023-12-28 02:24:19,120][106225] Updated weights for policy 1, policy_version 997146 (0.0005) [2023-12-28 02:24:19,285][106226] Updated weights for policy 0, policy_version 994756 (0.0009) [2023-12-28 02:24:19,356][106226] Updated weights for policy 0, policy_version 994766 (0.0010) [2023-12-28 02:24:19,421][106226] Updated weights for policy 0, policy_version 994776 (0.0011) [2023-12-28 02:24:19,783][106225] Updated weights for policy 1, policy_version 997156 (0.0007) [2023-12-28 02:24:19,842][106225] Updated weights for policy 1, policy_version 997166 (0.0010) [2023-12-28 02:24:19,915][106225] Updated weights for policy 1, policy_version 997176 (0.0009) [2023-12-28 02:24:20,163][106226] Updated weights for policy 0, policy_version 994786 (0.0010) [2023-12-28 02:24:20,231][106226] Updated weights for policy 0, policy_version 994796 (0.0011) [2023-12-28 02:24:20,285][106226] Updated weights for policy 0, policy_version 994806 (0.0011) [2023-12-28 02:24:20,341][106226] Updated weights for policy 0, policy_version 994816 (0.0011) [2023-12-28 02:24:20,602][106225] Updated weights for policy 1, policy_version 997186 (0.0008) [2023-12-28 02:24:20,663][106225] Updated weights for policy 1, policy_version 997196 (0.0007) [2023-12-28 02:24:20,721][106225] Updated weights for policy 1, policy_version 997206 (0.0008) [2023-12-28 02:24:20,786][106225] Updated weights for policy 1, policy_version 997216 (0.0007) [2023-12-28 02:24:21,058][106226] Updated weights for policy 0, policy_version 994826 (0.0008) [2023-12-28 02:24:21,119][106226] Updated weights for policy 0, policy_version 994836 (0.0008) [2023-12-28 02:24:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 510058496. Throughput: 0: 9938.7, 1: 9808.8. Samples: 510071720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:21,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-4.841')] [2023-12-28 02:24:21,194][106226] Updated weights for policy 0, policy_version 994846 (0.0007) [2023-12-28 02:24:21,524][106225] Updated weights for policy 1, policy_version 997226 (0.0009) [2023-12-28 02:24:21,579][106225] Updated weights for policy 1, policy_version 997236 (0.0008) [2023-12-28 02:24:21,650][106225] Updated weights for policy 1, policy_version 997246 (0.0009) [2023-12-28 02:24:21,938][106226] Updated weights for policy 0, policy_version 994856 (0.0006) [2023-12-28 02:24:22,000][106226] Updated weights for policy 0, policy_version 994866 (0.0006) [2023-12-28 02:24:22,064][106226] Updated weights for policy 0, policy_version 994876 (0.0007) [2023-12-28 02:24:22,447][106225] Updated weights for policy 1, policy_version 997256 (0.0009) [2023-12-28 02:24:22,522][106225] Updated weights for policy 1, policy_version 997266 (0.0010) [2023-12-28 02:24:22,593][106225] Updated weights for policy 1, policy_version 997276 (0.0010) [2023-12-28 02:24:22,668][106226] Updated weights for policy 0, policy_version 994886 (0.0009) [2023-12-28 02:24:22,729][106226] Updated weights for policy 0, policy_version 994896 (0.0007) [2023-12-28 02:24:22,787][106226] Updated weights for policy 0, policy_version 994906 (0.0010) [2023-12-28 02:24:23,289][106225] Updated weights for policy 1, policy_version 997286 (0.0009) [2023-12-28 02:24:23,346][106225] Updated weights for policy 1, policy_version 997296 (0.0008) [2023-12-28 02:24:23,390][106225] Updated weights for policy 1, policy_version 997306 (0.0007) [2023-12-28 02:24:23,431][106226] Updated weights for policy 0, policy_version 994916 (0.0009) [2023-12-28 02:24:23,486][106226] Updated weights for policy 0, policy_version 994926 (0.0010) [2023-12-28 02:24:23,543][106226] Updated weights for policy 0, policy_version 994936 (0.0010) [2023-12-28 02:24:24,151][106225] Updated weights for policy 1, policy_version 997316 (0.0007) [2023-12-28 02:24:24,199][106225] Updated weights for policy 1, policy_version 997326 (0.0005) [2023-12-28 02:24:24,256][106225] Updated weights for policy 1, policy_version 997336 (0.0005) [2023-12-28 02:24:24,265][106226] Updated weights for policy 0, policy_version 994946 (0.0011) [2023-12-28 02:24:24,325][106226] Updated weights for policy 0, policy_version 994956 (0.0010) [2023-12-28 02:24:24,391][106226] Updated weights for policy 0, policy_version 994966 (0.0009) [2023-12-28 02:24:24,450][106226] Updated weights for policy 0, policy_version 994976 (0.0008) [2023-12-28 02:24:24,880][106225] Updated weights for policy 1, policy_version 997346 (0.0005) [2023-12-28 02:24:24,940][106225] Updated weights for policy 1, policy_version 997356 (0.0005) [2023-12-28 02:24:25,005][106225] Updated weights for policy 1, policy_version 997366 (0.0008) [2023-12-28 02:24:25,062][106225] Updated weights for policy 1, policy_version 997376 (0.0009) [2023-12-28 02:24:25,161][106226] Updated weights for policy 0, policy_version 994986 (0.0009) [2023-12-28 02:24:25,213][106226] Updated weights for policy 0, policy_version 994996 (0.0008) [2023-12-28 02:24:25,263][106226] Updated weights for policy 0, policy_version 995006 (0.0008) [2023-12-28 02:24:25,726][106225] Updated weights for policy 1, policy_version 997386 (0.0011) [2023-12-28 02:24:25,777][106225] Updated weights for policy 1, policy_version 997396 (0.0009) [2023-12-28 02:24:25,843][106225] Updated weights for policy 1, policy_version 997406 (0.0006) [2023-12-28 02:24:25,921][106226] Updated weights for policy 0, policy_version 995016 (0.0006) [2023-12-28 02:24:25,982][106226] Updated weights for policy 0, policy_version 995026 (0.0008) [2023-12-28 02:24:26,036][106226] Updated weights for policy 0, policy_version 995036 (0.0008) [2023-12-28 02:24:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 510164992. Throughput: 0: 9953.1, 1: 9786.6. Samples: 510129792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:26,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.038')] [2023-12-28 02:24:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000995040_254787584.pth... [2023-12-28 02:24:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000997408_255377408.pth... [2023-12-28 02:24:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000993888_254492672.pth [2023-12-28 02:24:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000996256_255082496.pth [2023-12-28 02:24:26,457][106225] Updated weights for policy 1, policy_version 997416 (0.0009) [2023-12-28 02:24:26,520][106225] Updated weights for policy 1, policy_version 997426 (0.0010) [2023-12-28 02:24:26,594][106225] Updated weights for policy 1, policy_version 997436 (0.0010) [2023-12-28 02:24:26,686][106226] Updated weights for policy 0, policy_version 995046 (0.0009) [2023-12-28 02:24:26,738][106226] Updated weights for policy 0, policy_version 995056 (0.0010) [2023-12-28 02:24:26,783][106226] Updated weights for policy 0, policy_version 995066 (0.0010) [2023-12-28 02:24:27,284][106225] Updated weights for policy 1, policy_version 997446 (0.0010) [2023-12-28 02:24:27,340][106225] Updated weights for policy 1, policy_version 997456 (0.0010) [2023-12-28 02:24:27,389][106225] Updated weights for policy 1, policy_version 997466 (0.0010) [2023-12-28 02:24:27,500][106226] Updated weights for policy 0, policy_version 995076 (0.0009) [2023-12-28 02:24:27,554][106226] Updated weights for policy 0, policy_version 995086 (0.0009) [2023-12-28 02:24:27,608][106226] Updated weights for policy 0, policy_version 995096 (0.0009) [2023-12-28 02:24:28,028][106225] Updated weights for policy 1, policy_version 997476 (0.0008) [2023-12-28 02:24:28,082][106225] Updated weights for policy 1, policy_version 997486 (0.0008) [2023-12-28 02:24:28,151][106225] Updated weights for policy 1, policy_version 997496 (0.0008) [2023-12-28 02:24:28,351][106226] Updated weights for policy 0, policy_version 995107 (0.0008) [2023-12-28 02:24:28,406][106226] Updated weights for policy 0, policy_version 995117 (0.0010) [2023-12-28 02:24:28,474][106226] Updated weights for policy 0, policy_version 995127 (0.0011) [2023-12-28 02:24:28,728][106225] Updated weights for policy 1, policy_version 997506 (0.0008) [2023-12-28 02:24:28,788][106225] Updated weights for policy 1, policy_version 997516 (0.0006) [2023-12-28 02:24:28,842][106225] Updated weights for policy 1, policy_version 997526 (0.0010) [2023-12-28 02:24:28,896][106225] Updated weights for policy 1, policy_version 997536 (0.0010) [2023-12-28 02:24:29,179][106226] Updated weights for policy 0, policy_version 995137 (0.0010) [2023-12-28 02:24:29,240][106226] Updated weights for policy 0, policy_version 995147 (0.0010) [2023-12-28 02:24:29,305][106226] Updated weights for policy 0, policy_version 995157 (0.0009) [2023-12-28 02:24:29,371][106226] Updated weights for policy 0, policy_version 995167 (0.0010) [2023-12-28 02:24:29,604][106225] Updated weights for policy 1, policy_version 997546 (0.0009) [2023-12-28 02:24:29,655][106225] Updated weights for policy 1, policy_version 997556 (0.0009) [2023-12-28 02:24:29,709][106225] Updated weights for policy 1, policy_version 997566 (0.0010) [2023-12-28 02:24:30,100][106226] Updated weights for policy 0, policy_version 995177 (0.0010) [2023-12-28 02:24:30,153][106226] Updated weights for policy 0, policy_version 995187 (0.0010) [2023-12-28 02:24:30,213][106226] Updated weights for policy 0, policy_version 995197 (0.0011) [2023-12-28 02:24:30,404][106225] Updated weights for policy 1, policy_version 997576 (0.0006) [2023-12-28 02:24:30,463][106225] Updated weights for policy 1, policy_version 997586 (0.0005) [2023-12-28 02:24:30,511][106225] Updated weights for policy 1, policy_version 997596 (0.0005) [2023-12-28 02:24:30,789][106226] Updated weights for policy 0, policy_version 995207 (0.0007) [2023-12-28 02:24:30,842][106226] Updated weights for policy 0, policy_version 995217 (0.0005) [2023-12-28 02:24:30,911][106226] Updated weights for policy 0, policy_version 995227 (0.0008) [2023-12-28 02:24:31,153][106225] Updated weights for policy 1, policy_version 997606 (0.0007) [2023-12-28 02:24:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 510263296. Throughput: 0: 9929.8, 1: 9930.0. Samples: 510251844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:31,175][105115] Avg episode reward: [(0, '-4.786'), (1, '-5.050')] [2023-12-28 02:24:31,210][106225] Updated weights for policy 1, policy_version 997616 (0.0008) [2023-12-28 02:24:31,275][106225] Updated weights for policy 1, policy_version 997626 (0.0008) [2023-12-28 02:24:31,595][106226] Updated weights for policy 0, policy_version 995237 (0.0008) [2023-12-28 02:24:31,653][106226] Updated weights for policy 0, policy_version 995247 (0.0008) [2023-12-28 02:24:31,714][106226] Updated weights for policy 0, policy_version 995257 (0.0006) [2023-12-28 02:24:31,975][106225] Updated weights for policy 1, policy_version 997636 (0.0008) [2023-12-28 02:24:32,045][106225] Updated weights for policy 1, policy_version 997646 (0.0009) [2023-12-28 02:24:32,113][106225] Updated weights for policy 1, policy_version 997656 (0.0008) [2023-12-28 02:24:32,327][106226] Updated weights for policy 0, policy_version 995268 (0.0009) [2023-12-28 02:24:32,392][106226] Updated weights for policy 0, policy_version 995278 (0.0010) [2023-12-28 02:24:32,454][106226] Updated weights for policy 0, policy_version 995288 (0.0008) [2023-12-28 02:24:32,871][106225] Updated weights for policy 1, policy_version 997666 (0.0008) [2023-12-28 02:24:32,931][106225] Updated weights for policy 1, policy_version 997676 (0.0010) [2023-12-28 02:24:32,986][106225] Updated weights for policy 1, policy_version 997686 (0.0007) [2023-12-28 02:24:33,043][106225] Updated weights for policy 1, policy_version 997696 (0.0005) [2023-12-28 02:24:33,162][106226] Updated weights for policy 0, policy_version 995298 (0.0011) [2023-12-28 02:24:33,218][106226] Updated weights for policy 0, policy_version 995308 (0.0010) [2023-12-28 02:24:33,275][106226] Updated weights for policy 0, policy_version 995318 (0.0010) [2023-12-28 02:24:33,334][106226] Updated weights for policy 0, policy_version 995328 (0.0011) [2023-12-28 02:24:33,708][106225] Updated weights for policy 1, policy_version 997706 (0.0010) [2023-12-28 02:24:33,768][106225] Updated weights for policy 1, policy_version 997716 (0.0010) [2023-12-28 02:24:33,837][106225] Updated weights for policy 1, policy_version 997726 (0.0010) [2023-12-28 02:24:33,926][106226] Updated weights for policy 0, policy_version 995338 (0.0010) [2023-12-28 02:24:33,987][106226] Updated weights for policy 0, policy_version 995348 (0.0011) [2023-12-28 02:24:34,041][106226] Updated weights for policy 0, policy_version 995358 (0.0011) [2023-12-28 02:24:34,536][106225] Updated weights for policy 1, policy_version 997736 (0.0011) [2023-12-28 02:24:34,602][106225] Updated weights for policy 1, policy_version 997746 (0.0008) [2023-12-28 02:24:34,663][106225] Updated weights for policy 1, policy_version 997756 (0.0008) [2023-12-28 02:24:34,776][106226] Updated weights for policy 0, policy_version 995368 (0.0011) [2023-12-28 02:24:34,835][106226] Updated weights for policy 0, policy_version 995378 (0.0010) [2023-12-28 02:24:34,888][106226] Updated weights for policy 0, policy_version 995388 (0.0010) [2023-12-28 02:24:35,312][106225] Updated weights for policy 1, policy_version 997766 (0.0007) [2023-12-28 02:24:35,367][106225] Updated weights for policy 1, policy_version 997776 (0.0005) [2023-12-28 02:24:35,418][106225] Updated weights for policy 1, policy_version 997786 (0.0005) [2023-12-28 02:24:35,613][106226] Updated weights for policy 0, policy_version 995398 (0.0010) [2023-12-28 02:24:35,676][106226] Updated weights for policy 0, policy_version 995408 (0.0011) [2023-12-28 02:24:35,738][106226] Updated weights for policy 0, policy_version 995418 (0.0009) [2023-12-28 02:24:35,982][106225] Updated weights for policy 1, policy_version 997796 (0.0007) [2023-12-28 02:24:36,036][106225] Updated weights for policy 1, policy_version 997806 (0.0010) [2023-12-28 02:24:36,092][106225] Updated weights for policy 1, policy_version 997816 (0.0010) [2023-12-28 02:24:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 510369792. Throughput: 0: 9932.9, 1: 10029.7. Samples: 510375020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:36,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-5.021')] [2023-12-28 02:24:36,417][106226] Updated weights for policy 0, policy_version 995428 (0.0010) [2023-12-28 02:24:36,472][106226] Updated weights for policy 0, policy_version 995438 (0.0011) [2023-12-28 02:24:36,536][106226] Updated weights for policy 0, policy_version 995448 (0.0011) [2023-12-28 02:24:36,824][106225] Updated weights for policy 1, policy_version 997826 (0.0009) [2023-12-28 02:24:36,880][106225] Updated weights for policy 1, policy_version 997836 (0.0005) [2023-12-28 02:24:36,929][106225] Updated weights for policy 1, policy_version 997846 (0.0006) [2023-12-28 02:24:36,975][106225] Updated weights for policy 1, policy_version 997856 (0.0010) [2023-12-28 02:24:37,260][106226] Updated weights for policy 0, policy_version 995458 (0.0011) [2023-12-28 02:24:37,321][106226] Updated weights for policy 0, policy_version 995468 (0.0011) [2023-12-28 02:24:37,378][106226] Updated weights for policy 0, policy_version 995478 (0.0011) [2023-12-28 02:24:37,426][106226] Updated weights for policy 0, policy_version 995488 (0.0010) [2023-12-28 02:24:37,652][106225] Updated weights for policy 1, policy_version 997866 (0.0008) [2023-12-28 02:24:37,718][106225] Updated weights for policy 1, policy_version 997876 (0.0008) [2023-12-28 02:24:37,780][106225] Updated weights for policy 1, policy_version 997886 (0.0006) [2023-12-28 02:24:38,170][106226] Updated weights for policy 0, policy_version 995498 (0.0005) [2023-12-28 02:24:38,239][106226] Updated weights for policy 0, policy_version 995508 (0.0009) [2023-12-28 02:24:38,301][106226] Updated weights for policy 0, policy_version 995518 (0.0010) [2023-12-28 02:24:38,375][106225] Updated weights for policy 1, policy_version 997896 (0.0007) [2023-12-28 02:24:38,431][106225] Updated weights for policy 1, policy_version 997906 (0.0007) [2023-12-28 02:24:38,488][106225] Updated weights for policy 1, policy_version 997916 (0.0008) [2023-12-28 02:24:38,996][106226] Updated weights for policy 0, policy_version 995528 (0.0010) [2023-12-28 02:24:39,057][106226] Updated weights for policy 0, policy_version 995538 (0.0010) [2023-12-28 02:24:39,129][106226] Updated weights for policy 0, policy_version 995548 (0.0011) [2023-12-28 02:24:39,189][106225] Updated weights for policy 1, policy_version 997926 (0.0007) [2023-12-28 02:24:39,260][106225] Updated weights for policy 1, policy_version 997936 (0.0008) [2023-12-28 02:24:39,329][106225] Updated weights for policy 1, policy_version 997946 (0.0008) [2023-12-28 02:24:39,898][106226] Updated weights for policy 0, policy_version 995558 (0.0010) [2023-12-28 02:24:39,963][106226] Updated weights for policy 0, policy_version 995568 (0.0010) [2023-12-28 02:24:40,026][106226] Updated weights for policy 0, policy_version 995578 (0.0008) [2023-12-28 02:24:40,147][106225] Updated weights for policy 1, policy_version 997956 (0.0009) [2023-12-28 02:24:40,212][106225] Updated weights for policy 1, policy_version 997966 (0.0011) [2023-12-28 02:24:40,273][106225] Updated weights for policy 1, policy_version 997976 (0.0010) [2023-12-28 02:24:40,801][106226] Updated weights for policy 0, policy_version 995588 (0.0009) [2023-12-28 02:24:40,854][106226] Updated weights for policy 0, policy_version 995598 (0.0010) [2023-12-28 02:24:40,917][106226] Updated weights for policy 0, policy_version 995608 (0.0010) [2023-12-28 02:24:40,960][106225] Updated weights for policy 1, policy_version 997986 (0.0010) [2023-12-28 02:24:41,024][106225] Updated weights for policy 1, policy_version 997996 (0.0010) [2023-12-28 02:24:41,092][106225] Updated weights for policy 1, policy_version 998006 (0.0006) [2023-12-28 02:24:41,163][106225] Updated weights for policy 1, policy_version 998016 (0.0008) [2023-12-28 02:24:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 510468096. Throughput: 0: 9920.5, 1: 10055.6. Samples: 510434740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:41,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-5.076')] [2023-12-28 02:24:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000998016_255533056.pth... [2023-12-28 02:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000995616_254935040.pth... [2023-12-28 02:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000994432_254631936.pth [2023-12-28 02:24:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000996832_255229952.pth [2023-12-28 02:24:41,696][106226] Updated weights for policy 0, policy_version 995618 (0.0008) [2023-12-28 02:24:41,759][106226] Updated weights for policy 0, policy_version 995628 (0.0008) [2023-12-28 02:24:41,821][106226] Updated weights for policy 0, policy_version 995638 (0.0010) [2023-12-28 02:24:41,878][106226] Updated weights for policy 0, policy_version 995648 (0.0011) [2023-12-28 02:24:41,903][106225] Updated weights for policy 1, policy_version 998026 (0.0010) [2023-12-28 02:24:41,964][106225] Updated weights for policy 1, policy_version 998036 (0.0011) [2023-12-28 02:24:42,025][106225] Updated weights for policy 1, policy_version 998046 (0.0011) [2023-12-28 02:24:42,575][106226] Updated weights for policy 0, policy_version 995658 (0.0010) [2023-12-28 02:24:42,630][106226] Updated weights for policy 0, policy_version 995668 (0.0006) [2023-12-28 02:24:42,691][106226] Updated weights for policy 0, policy_version 995678 (0.0006) [2023-12-28 02:24:42,760][106225] Updated weights for policy 1, policy_version 998056 (0.0011) [2023-12-28 02:24:42,822][106225] Updated weights for policy 1, policy_version 998066 (0.0011) [2023-12-28 02:24:42,869][106225] Updated weights for policy 1, policy_version 998076 (0.0010) [2023-12-28 02:24:43,354][106226] Updated weights for policy 0, policy_version 995688 (0.0009) [2023-12-28 02:24:43,417][106226] Updated weights for policy 0, policy_version 995698 (0.0011) [2023-12-28 02:24:43,477][106226] Updated weights for policy 0, policy_version 995708 (0.0011) [2023-12-28 02:24:43,497][106225] Updated weights for policy 1, policy_version 998086 (0.0007) [2023-12-28 02:24:43,549][106225] Updated weights for policy 1, policy_version 998096 (0.0005) [2023-12-28 02:24:43,612][106225] Updated weights for policy 1, policy_version 998106 (0.0005) [2023-12-28 02:24:44,150][106226] Updated weights for policy 0, policy_version 995718 (0.0008) [2023-12-28 02:24:44,167][106225] Updated weights for policy 1, policy_version 998116 (0.0005) [2023-12-28 02:24:44,202][106226] Updated weights for policy 0, policy_version 995728 (0.0007) [2023-12-28 02:24:44,221][106225] Updated weights for policy 1, policy_version 998126 (0.0010) [2023-12-28 02:24:44,258][106226] Updated weights for policy 0, policy_version 995738 (0.0007) [2023-12-28 02:24:44,272][106225] Updated weights for policy 1, policy_version 998136 (0.0010) [2023-12-28 02:24:44,934][106226] Updated weights for policy 0, policy_version 995748 (0.0007) [2023-12-28 02:24:44,978][106225] Updated weights for policy 1, policy_version 998146 (0.0009) [2023-12-28 02:24:45,003][106226] Updated weights for policy 0, policy_version 995758 (0.0007) [2023-12-28 02:24:45,045][106225] Updated weights for policy 1, policy_version 998156 (0.0011) [2023-12-28 02:24:45,066][106226] Updated weights for policy 0, policy_version 995768 (0.0005) [2023-12-28 02:24:45,110][106225] Updated weights for policy 1, policy_version 998166 (0.0010) [2023-12-28 02:24:45,174][106225] Updated weights for policy 1, policy_version 998176 (0.0010) [2023-12-28 02:24:45,748][106226] Updated weights for policy 0, policy_version 995778 (0.0006) [2023-12-28 02:24:45,798][106226] Updated weights for policy 0, policy_version 995788 (0.0005) [2023-12-28 02:24:45,864][106226] Updated weights for policy 0, policy_version 995798 (0.0005) [2023-12-28 02:24:45,880][106225] Updated weights for policy 1, policy_version 998186 (0.0010) [2023-12-28 02:24:45,920][106226] Updated weights for policy 0, policy_version 995808 (0.0005) [2023-12-28 02:24:45,937][106225] Updated weights for policy 1, policy_version 998196 (0.0010) [2023-12-28 02:24:45,986][106225] Updated weights for policy 1, policy_version 998206 (0.0010) [2023-12-28 02:24:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 510566400. Throughput: 0: 9900.8, 1: 10043.4. Samples: 510552632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:46,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.882')] [2023-12-28 02:24:46,602][106226] Updated weights for policy 0, policy_version 995818 (0.0009) [2023-12-28 02:24:46,648][106225] Updated weights for policy 1, policy_version 998216 (0.0010) [2023-12-28 02:24:46,657][106226] Updated weights for policy 0, policy_version 995828 (0.0009) [2023-12-28 02:24:46,708][106226] Updated weights for policy 0, policy_version 995838 (0.0007) [2023-12-28 02:24:46,715][106225] Updated weights for policy 1, policy_version 998226 (0.0010) [2023-12-28 02:24:46,775][106225] Updated weights for policy 1, policy_version 998236 (0.0010) [2023-12-28 02:24:47,402][106225] Updated weights for policy 1, policy_version 998246 (0.0007) [2023-12-28 02:24:47,465][106225] Updated weights for policy 1, policy_version 998256 (0.0005) [2023-12-28 02:24:47,513][106226] Updated weights for policy 0, policy_version 995848 (0.0007) [2023-12-28 02:24:47,516][106225] Updated weights for policy 1, policy_version 998266 (0.0009) [2023-12-28 02:24:47,577][106226] Updated weights for policy 0, policy_version 995858 (0.0007) [2023-12-28 02:24:47,638][106226] Updated weights for policy 0, policy_version 995868 (0.0009) [2023-12-28 02:24:48,166][106225] Updated weights for policy 1, policy_version 998276 (0.0010) [2023-12-28 02:24:48,225][106225] Updated weights for policy 1, policy_version 998286 (0.0010) [2023-12-28 02:24:48,271][106226] Updated weights for policy 0, policy_version 995878 (0.0009) [2023-12-28 02:24:48,279][106225] Updated weights for policy 1, policy_version 998296 (0.0009) [2023-12-28 02:24:48,340][106226] Updated weights for policy 0, policy_version 995888 (0.0008) [2023-12-28 02:24:48,411][106226] Updated weights for policy 0, policy_version 995898 (0.0008) [2023-12-28 02:24:49,046][106225] Updated weights for policy 1, policy_version 998306 (0.0010) [2023-12-28 02:24:49,095][106225] Updated weights for policy 1, policy_version 998316 (0.0007) [2023-12-28 02:24:49,112][106226] Updated weights for policy 0, policy_version 995908 (0.0009) [2023-12-28 02:24:49,153][106225] Updated weights for policy 1, policy_version 998326 (0.0007) [2023-12-28 02:24:49,167][106226] Updated weights for policy 0, policy_version 995918 (0.0006) [2023-12-28 02:24:49,208][106225] Updated weights for policy 1, policy_version 998336 (0.0006) [2023-12-28 02:24:49,229][106226] Updated weights for policy 0, policy_version 995928 (0.0007) [2023-12-28 02:24:49,879][106225] Updated weights for policy 1, policy_version 998346 (0.0011) [2023-12-28 02:24:49,946][106225] Updated weights for policy 1, policy_version 998356 (0.0010) [2023-12-28 02:24:50,009][106225] Updated weights for policy 1, policy_version 998366 (0.0007) [2023-12-28 02:24:50,066][106226] Updated weights for policy 0, policy_version 995938 (0.0008) [2023-12-28 02:24:50,128][106226] Updated weights for policy 0, policy_version 995948 (0.0006) [2023-12-28 02:24:50,185][106226] Updated weights for policy 0, policy_version 995958 (0.0006) [2023-12-28 02:24:50,243][106226] Updated weights for policy 0, policy_version 995968 (0.0008) [2023-12-28 02:24:50,696][106225] Updated weights for policy 1, policy_version 998376 (0.0009) [2023-12-28 02:24:50,760][106225] Updated weights for policy 1, policy_version 998386 (0.0010) [2023-12-28 02:24:50,825][106225] Updated weights for policy 1, policy_version 998396 (0.0011) [2023-12-28 02:24:50,982][106226] Updated weights for policy 0, policy_version 995978 (0.0008) [2023-12-28 02:24:51,044][106226] Updated weights for policy 0, policy_version 995988 (0.0007) [2023-12-28 02:24:51,111][106226] Updated weights for policy 0, policy_version 995998 (0.0008) [2023-12-28 02:24:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 510664704. Throughput: 0: 9959.7, 1: 9999.7. Samples: 510670124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:24:51,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.067')] [2023-12-28 02:24:51,652][106225] Updated weights for policy 1, policy_version 998406 (0.0010) [2023-12-28 02:24:51,722][106225] Updated weights for policy 1, policy_version 998416 (0.0009) [2023-12-28 02:24:51,791][106225] Updated weights for policy 1, policy_version 998426 (0.0008) [2023-12-28 02:24:51,839][106226] Updated weights for policy 0, policy_version 996008 (0.0008) [2023-12-28 02:24:51,905][106226] Updated weights for policy 0, policy_version 996018 (0.0008) [2023-12-28 02:24:51,966][106226] Updated weights for policy 0, policy_version 996028 (0.0009) [2023-12-28 02:24:52,447][106225] Updated weights for policy 1, policy_version 998436 (0.0007) [2023-12-28 02:24:52,505][106225] Updated weights for policy 1, policy_version 998446 (0.0007) [2023-12-28 02:24:52,561][106225] Updated weights for policy 1, policy_version 998456 (0.0008) [2023-12-28 02:24:52,731][106226] Updated weights for policy 0, policy_version 996038 (0.0009) [2023-12-28 02:24:52,789][106226] Updated weights for policy 0, policy_version 996048 (0.0009) [2023-12-28 02:24:52,840][106226] Updated weights for policy 0, policy_version 996058 (0.0009) [2023-12-28 02:24:53,179][106225] Updated weights for policy 1, policy_version 998466 (0.0009) [2023-12-28 02:24:53,228][106225] Updated weights for policy 1, policy_version 998476 (0.0009) [2023-12-28 02:24:53,273][106225] Updated weights for policy 1, policy_version 998486 (0.0009) [2023-12-28 02:24:53,332][106225] Updated weights for policy 1, policy_version 998496 (0.0009) [2023-12-28 02:24:53,578][106226] Updated weights for policy 0, policy_version 996068 (0.0008) [2023-12-28 02:24:53,631][106226] Updated weights for policy 0, policy_version 996078 (0.0008) [2023-12-28 02:24:53,694][106226] Updated weights for policy 0, policy_version 996088 (0.0009) [2023-12-28 02:24:54,004][106225] Updated weights for policy 1, policy_version 998506 (0.0006) [2023-12-28 02:24:54,060][106225] Updated weights for policy 1, policy_version 998516 (0.0005) [2023-12-28 02:24:54,119][106225] Updated weights for policy 1, policy_version 998526 (0.0005) [2023-12-28 02:24:54,535][106226] Updated weights for policy 0, policy_version 996098 (0.0009) [2023-12-28 02:24:54,603][106226] Updated weights for policy 0, policy_version 996108 (0.0010) [2023-12-28 02:24:54,652][106226] Updated weights for policy 0, policy_version 996118 (0.0008) [2023-12-28 02:24:54,656][106225] Updated weights for policy 1, policy_version 998536 (0.0006) [2023-12-28 02:24:54,715][106226] Updated weights for policy 0, policy_version 996128 (0.0006) [2023-12-28 02:24:54,718][106225] Updated weights for policy 1, policy_version 998546 (0.0008) [2023-12-28 02:24:54,768][106225] Updated weights for policy 1, policy_version 998556 (0.0009) [2023-12-28 02:24:55,379][106226] Updated weights for policy 0, policy_version 996138 (0.0009) [2023-12-28 02:24:55,436][106226] Updated weights for policy 0, policy_version 996148 (0.0009) [2023-12-28 02:24:55,488][106226] Updated weights for policy 0, policy_version 996158 (0.0008) [2023-12-28 02:24:55,552][106225] Updated weights for policy 1, policy_version 998566 (0.0009) [2023-12-28 02:24:55,610][106225] Updated weights for policy 1, policy_version 998576 (0.0007) [2023-12-28 02:24:55,664][106225] Updated weights for policy 1, policy_version 998586 (0.0005) [2023-12-28 02:24:56,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 510754816. Throughput: 0: 9867.9, 1: 9963.5. Samples: 510727244. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:24:56,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.968')] [2023-12-28 02:24:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000996160_255074304.pth... [2023-12-28 02:24:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000998592_255680512.pth... [2023-12-28 02:24:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000995040_254787584.pth [2023-12-28 02:24:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000997408_255377408.pth [2023-12-28 02:24:56,258][106226] Updated weights for policy 0, policy_version 996168 (0.0006) [2023-12-28 02:24:56,285][106225] Updated weights for policy 1, policy_version 998596 (0.0006) [2023-12-28 02:24:56,309][106226] Updated weights for policy 0, policy_version 996178 (0.0005) [2023-12-28 02:24:56,342][106225] Updated weights for policy 1, policy_version 998606 (0.0009) [2023-12-28 02:24:56,361][106226] Updated weights for policy 0, policy_version 996188 (0.0005) [2023-12-28 02:24:56,395][106225] Updated weights for policy 1, policy_version 998616 (0.0006) [2023-12-28 02:24:56,911][106226] Updated weights for policy 0, policy_version 996198 (0.0007) [2023-12-28 02:24:56,970][106226] Updated weights for policy 0, policy_version 996208 (0.0006) [2023-12-28 02:24:57,031][106226] Updated weights for policy 0, policy_version 996218 (0.0006) [2023-12-28 02:24:57,142][106225] Updated weights for policy 1, policy_version 998626 (0.0005) [2023-12-28 02:24:57,193][106225] Updated weights for policy 1, policy_version 998636 (0.0005) [2023-12-28 02:24:57,240][106225] Updated weights for policy 1, policy_version 998646 (0.0005) [2023-12-28 02:24:57,295][106225] Updated weights for policy 1, policy_version 998656 (0.0005) [2023-12-28 02:24:57,648][106226] Updated weights for policy 0, policy_version 996228 (0.0007) [2023-12-28 02:24:57,697][106226] Updated weights for policy 0, policy_version 996238 (0.0009) [2023-12-28 02:24:57,753][106226] Updated weights for policy 0, policy_version 996248 (0.0008) [2023-12-28 02:24:57,962][106225] Updated weights for policy 1, policy_version 998666 (0.0007) [2023-12-28 02:24:58,012][106225] Updated weights for policy 1, policy_version 998676 (0.0007) [2023-12-28 02:24:58,062][106225] Updated weights for policy 1, policy_version 998686 (0.0005) [2023-12-28 02:24:58,463][106226] Updated weights for policy 0, policy_version 996258 (0.0006) [2023-12-28 02:24:58,530][106226] Updated weights for policy 0, policy_version 996268 (0.0010) [2023-12-28 02:24:58,592][106226] Updated weights for policy 0, policy_version 996278 (0.0011) [2023-12-28 02:24:58,656][106226] Updated weights for policy 0, policy_version 996288 (0.0008) [2023-12-28 02:24:58,839][106225] Updated weights for policy 1, policy_version 998696 (0.0009) [2023-12-28 02:24:58,907][106225] Updated weights for policy 1, policy_version 998706 (0.0010) [2023-12-28 02:24:58,971][106225] Updated weights for policy 1, policy_version 998716 (0.0008) [2023-12-28 02:24:59,453][106226] Updated weights for policy 0, policy_version 996298 (0.0005) [2023-12-28 02:24:59,511][106226] Updated weights for policy 0, policy_version 996308 (0.0007) [2023-12-28 02:24:59,568][106226] Updated weights for policy 0, policy_version 996318 (0.0008) [2023-12-28 02:24:59,742][106225] Updated weights for policy 1, policy_version 998726 (0.0008) [2023-12-28 02:24:59,797][106225] Updated weights for policy 1, policy_version 998736 (0.0009) [2023-12-28 02:24:59,862][106225] Updated weights for policy 1, policy_version 998746 (0.0008) [2023-12-28 02:25:00,292][106226] Updated weights for policy 0, policy_version 996328 (0.0006) [2023-12-28 02:25:00,348][106226] Updated weights for policy 0, policy_version 996338 (0.0007) [2023-12-28 02:25:00,397][106226] Updated weights for policy 0, policy_version 996348 (0.0009) [2023-12-28 02:25:00,631][106225] Updated weights for policy 1, policy_version 998756 (0.0008) [2023-12-28 02:25:00,689][106225] Updated weights for policy 1, policy_version 998766 (0.0008) [2023-12-28 02:25:00,738][106225] Updated weights for policy 1, policy_version 998776 (0.0008) [2023-12-28 02:25:01,098][106226] Updated weights for policy 0, policy_version 996358 (0.0008) [2023-12-28 02:25:01,163][106226] Updated weights for policy 0, policy_version 996368 (0.0009) [2023-12-28 02:25:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 510853120. Throughput: 0: 9792.5, 1: 10071.3. Samples: 510847340. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:01,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.226')] [2023-12-28 02:25:01,222][106226] Updated weights for policy 0, policy_version 996378 (0.0005) [2023-12-28 02:25:01,511][106225] Updated weights for policy 1, policy_version 998786 (0.0008) [2023-12-28 02:25:01,567][106225] Updated weights for policy 1, policy_version 998796 (0.0009) [2023-12-28 02:25:01,621][106225] Updated weights for policy 1, policy_version 998806 (0.0008) [2023-12-28 02:25:01,685][106225] Updated weights for policy 1, policy_version 998816 (0.0008) [2023-12-28 02:25:01,948][106226] Updated weights for policy 0, policy_version 996388 (0.0008) [2023-12-28 02:25:02,007][106226] Updated weights for policy 0, policy_version 996398 (0.0009) [2023-12-28 02:25:02,067][106226] Updated weights for policy 0, policy_version 996408 (0.0009) [2023-12-28 02:25:02,435][106225] Updated weights for policy 1, policy_version 998826 (0.0007) [2023-12-28 02:25:02,501][106225] Updated weights for policy 1, policy_version 998836 (0.0009) [2023-12-28 02:25:02,563][106225] Updated weights for policy 1, policy_version 998846 (0.0008) [2023-12-28 02:25:02,801][106226] Updated weights for policy 0, policy_version 996418 (0.0008) [2023-12-28 02:25:02,867][106226] Updated weights for policy 0, policy_version 996428 (0.0006) [2023-12-28 02:25:02,930][106226] Updated weights for policy 0, policy_version 996438 (0.0008) [2023-12-28 02:25:02,990][106226] Updated weights for policy 0, policy_version 996448 (0.0007) [2023-12-28 02:25:03,185][106225] Updated weights for policy 1, policy_version 998856 (0.0006) [2023-12-28 02:25:03,251][106225] Updated weights for policy 1, policy_version 998866 (0.0005) [2023-12-28 02:25:03,296][106225] Updated weights for policy 1, policy_version 998876 (0.0005) [2023-12-28 02:25:03,635][106226] Updated weights for policy 0, policy_version 996458 (0.0008) [2023-12-28 02:25:03,691][106226] Updated weights for policy 0, policy_version 996468 (0.0009) [2023-12-28 02:25:03,753][106226] Updated weights for policy 0, policy_version 996478 (0.0006) [2023-12-28 02:25:03,940][106225] Updated weights for policy 1, policy_version 998886 (0.0006) [2023-12-28 02:25:04,008][106225] Updated weights for policy 1, policy_version 998896 (0.0008) [2023-12-28 02:25:04,076][106225] Updated weights for policy 1, policy_version 998906 (0.0005) [2023-12-28 02:25:04,349][106226] Updated weights for policy 0, policy_version 996488 (0.0006) [2023-12-28 02:25:04,415][106226] Updated weights for policy 0, policy_version 996498 (0.0009) [2023-12-28 02:25:04,480][106226] Updated weights for policy 0, policy_version 996508 (0.0011) [2023-12-28 02:25:04,770][106225] Updated weights for policy 1, policy_version 998916 (0.0006) [2023-12-28 02:25:04,831][106225] Updated weights for policy 1, policy_version 998926 (0.0008) [2023-12-28 02:25:04,896][106225] Updated weights for policy 1, policy_version 998936 (0.0008) [2023-12-28 02:25:05,155][106226] Updated weights for policy 0, policy_version 996518 (0.0011) [2023-12-28 02:25:05,212][106226] Updated weights for policy 0, policy_version 996528 (0.0008) [2023-12-28 02:25:05,268][106226] Updated weights for policy 0, policy_version 996538 (0.0005) [2023-12-28 02:25:05,671][106225] Updated weights for policy 1, policy_version 998946 (0.0009) [2023-12-28 02:25:05,729][106225] Updated weights for policy 1, policy_version 998956 (0.0008) [2023-12-28 02:25:05,793][106225] Updated weights for policy 1, policy_version 998966 (0.0008) [2023-12-28 02:25:05,838][106226] Updated weights for policy 0, policy_version 996548 (0.0007) [2023-12-28 02:25:05,843][106225] Updated weights for policy 1, policy_version 998976 (0.0007) [2023-12-28 02:25:05,894][106226] Updated weights for policy 0, policy_version 996558 (0.0008) [2023-12-28 02:25:05,952][106226] Updated weights for policy 0, policy_version 996568 (0.0011) [2023-12-28 02:25:06,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 510959616. Throughput: 0: 9877.8, 1: 9997.1. Samples: 510966088. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:06,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.893')] [2023-12-28 02:25:06,569][106225] Updated weights for policy 1, policy_version 998986 (0.0008) [2023-12-28 02:25:06,631][106225] Updated weights for policy 1, policy_version 998996 (0.0007) [2023-12-28 02:25:06,674][106226] Updated weights for policy 0, policy_version 996578 (0.0011) [2023-12-28 02:25:06,687][106225] Updated weights for policy 1, policy_version 999006 (0.0008) [2023-12-28 02:25:06,720][106226] Updated weights for policy 0, policy_version 996588 (0.0010) [2023-12-28 02:25:06,769][106226] Updated weights for policy 0, policy_version 996598 (0.0011) [2023-12-28 02:25:06,820][106226] Updated weights for policy 0, policy_version 996608 (0.0010) [2023-12-28 02:25:07,332][106225] Updated weights for policy 1, policy_version 999016 (0.0009) [2023-12-28 02:25:07,391][106225] Updated weights for policy 1, policy_version 999026 (0.0008) [2023-12-28 02:25:07,447][106225] Updated weights for policy 1, policy_version 999036 (0.0008) [2023-12-28 02:25:07,603][106226] Updated weights for policy 0, policy_version 996618 (0.0008) [2023-12-28 02:25:07,654][106226] Updated weights for policy 0, policy_version 996628 (0.0010) [2023-12-28 02:25:07,715][106226] Updated weights for policy 0, policy_version 996638 (0.0010) [2023-12-28 02:25:08,069][106225] Updated weights for policy 1, policy_version 999046 (0.0005) [2023-12-28 02:25:08,128][106225] Updated weights for policy 1, policy_version 999056 (0.0005) [2023-12-28 02:25:08,179][106225] Updated weights for policy 1, policy_version 999066 (0.0005) [2023-12-28 02:25:08,402][106226] Updated weights for policy 0, policy_version 996648 (0.0009) [2023-12-28 02:25:08,461][106226] Updated weights for policy 0, policy_version 996658 (0.0010) [2023-12-28 02:25:08,528][106226] Updated weights for policy 0, policy_version 996668 (0.0011) [2023-12-28 02:25:08,796][106225] Updated weights for policy 1, policy_version 999076 (0.0007) [2023-12-28 02:25:08,853][106225] Updated weights for policy 1, policy_version 999086 (0.0008) [2023-12-28 02:25:08,914][106225] Updated weights for policy 1, policy_version 999096 (0.0008) [2023-12-28 02:25:09,249][106226] Updated weights for policy 0, policy_version 996678 (0.0011) [2023-12-28 02:25:09,321][106226] Updated weights for policy 0, policy_version 996688 (0.0011) [2023-12-28 02:25:09,388][106226] Updated weights for policy 0, policy_version 996698 (0.0009) [2023-12-28 02:25:09,615][106225] Updated weights for policy 1, policy_version 999106 (0.0008) [2023-12-28 02:25:09,699][106225] Updated weights for policy 1, policy_version 999116 (0.0007) [2023-12-28 02:25:09,766][106225] Updated weights for policy 1, policy_version 999126 (0.0007) [2023-12-28 02:25:09,837][106225] Updated weights for policy 1, policy_version 999136 (0.0008) [2023-12-28 02:25:10,157][106226] Updated weights for policy 0, policy_version 996708 (0.0008) [2023-12-28 02:25:10,217][106226] Updated weights for policy 0, policy_version 996718 (0.0007) [2023-12-28 02:25:10,282][106226] Updated weights for policy 0, policy_version 996728 (0.0009) [2023-12-28 02:25:10,551][106225] Updated weights for policy 1, policy_version 999146 (0.0009) [2023-12-28 02:25:10,615][106225] Updated weights for policy 1, policy_version 999156 (0.0008) [2023-12-28 02:25:10,664][106225] Updated weights for policy 1, policy_version 999166 (0.0006) [2023-12-28 02:25:10,993][106226] Updated weights for policy 0, policy_version 996738 (0.0008) [2023-12-28 02:25:11,058][106226] Updated weights for policy 0, policy_version 996748 (0.0010) [2023-12-28 02:25:11,115][106226] Updated weights for policy 0, policy_version 996758 (0.0008) [2023-12-28 02:25:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 511049728. Throughput: 0: 9843.2, 1: 10088.0. Samples: 511026696. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:11,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.774')] [2023-12-28 02:25:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000996768_255229952.pth... [2023-12-28 02:25:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000999168_255827968.pth... [2023-12-28 02:25:11,184][106226] Updated weights for policy 0, policy_version 996768 (0.0008) [2023-12-28 02:25:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000995616_254935040.pth [2023-12-28 02:25:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000998016_255533056.pth [2023-12-28 02:25:11,434][106225] Updated weights for policy 1, policy_version 999176 (0.0008) [2023-12-28 02:25:11,497][106225] Updated weights for policy 1, policy_version 999186 (0.0009) [2023-12-28 02:25:11,563][106225] Updated weights for policy 1, policy_version 999196 (0.0008) [2023-12-28 02:25:11,920][106226] Updated weights for policy 0, policy_version 996778 (0.0011) [2023-12-28 02:25:11,987][106226] Updated weights for policy 0, policy_version 996788 (0.0011) [2023-12-28 02:25:12,057][106226] Updated weights for policy 0, policy_version 996798 (0.0010) [2023-12-28 02:25:12,347][106225] Updated weights for policy 1, policy_version 999206 (0.0009) [2023-12-28 02:25:12,418][106225] Updated weights for policy 1, policy_version 999216 (0.0009) [2023-12-28 02:25:12,472][106225] Updated weights for policy 1, policy_version 999226 (0.0009) [2023-12-28 02:25:12,738][106226] Updated weights for policy 0, policy_version 996808 (0.0008) [2023-12-28 02:25:12,793][106226] Updated weights for policy 0, policy_version 996818 (0.0005) [2023-12-28 02:25:12,848][106226] Updated weights for policy 0, policy_version 996828 (0.0010) [2023-12-28 02:25:13,278][106225] Updated weights for policy 1, policy_version 999236 (0.0008) [2023-12-28 02:25:13,336][106225] Updated weights for policy 1, policy_version 999246 (0.0008) [2023-12-28 02:25:13,393][106225] Updated weights for policy 1, policy_version 999256 (0.0008) [2023-12-28 02:25:13,441][106226] Updated weights for policy 0, policy_version 996838 (0.0011) [2023-12-28 02:25:13,486][106226] Updated weights for policy 0, policy_version 996848 (0.0009) [2023-12-28 02:25:13,545][106226] Updated weights for policy 0, policy_version 996858 (0.0008) [2023-12-28 02:25:14,166][106225] Updated weights for policy 1, policy_version 999266 (0.0007) [2023-12-28 02:25:14,212][106226] Updated weights for policy 0, policy_version 996868 (0.0010) [2023-12-28 02:25:14,225][106225] Updated weights for policy 1, policy_version 999276 (0.0006) [2023-12-28 02:25:14,266][106226] Updated weights for policy 0, policy_version 996878 (0.0010) [2023-12-28 02:25:14,288][106225] Updated weights for policy 1, policy_version 999286 (0.0006) [2023-12-28 02:25:14,322][106226] Updated weights for policy 0, policy_version 996888 (0.0010) [2023-12-28 02:25:14,348][106225] Updated weights for policy 1, policy_version 999296 (0.0009) [2023-12-28 02:25:14,981][106226] Updated weights for policy 0, policy_version 996898 (0.0011) [2023-12-28 02:25:15,046][106226] Updated weights for policy 0, policy_version 996908 (0.0011) [2023-12-28 02:25:15,048][106225] Updated weights for policy 1, policy_version 999306 (0.0007) [2023-12-28 02:25:15,111][106226] Updated weights for policy 0, policy_version 996918 (0.0008) [2023-12-28 02:25:15,111][106225] Updated weights for policy 1, policy_version 999316 (0.0007) [2023-12-28 02:25:15,167][106225] Updated weights for policy 1, policy_version 999326 (0.0008) [2023-12-28 02:25:15,179][106226] Updated weights for policy 0, policy_version 996928 (0.0006) [2023-12-28 02:25:15,743][106226] Updated weights for policy 0, policy_version 996938 (0.0005) [2023-12-28 02:25:15,790][106226] Updated weights for policy 0, policy_version 996948 (0.0005) [2023-12-28 02:25:15,842][106226] Updated weights for policy 0, policy_version 996958 (0.0005) [2023-12-28 02:25:15,896][106225] Updated weights for policy 1, policy_version 999336 (0.0010) [2023-12-28 02:25:15,947][106225] Updated weights for policy 1, policy_version 999346 (0.0010) [2023-12-28 02:25:16,010][106225] Updated weights for policy 1, policy_version 999356 (0.0010) [2023-12-28 02:25:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 511156224. Throughput: 0: 9859.5, 1: 9921.4. Samples: 511141984. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:16,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-5.145')] [2023-12-28 02:25:16,474][106226] Updated weights for policy 0, policy_version 996968 (0.0010) [2023-12-28 02:25:16,524][106226] Updated weights for policy 0, policy_version 996978 (0.0010) [2023-12-28 02:25:16,584][106226] Updated weights for policy 0, policy_version 996988 (0.0010) [2023-12-28 02:25:16,711][106225] Updated weights for policy 1, policy_version 999366 (0.0010) [2023-12-28 02:25:16,767][106225] Updated weights for policy 1, policy_version 999376 (0.0010) [2023-12-28 02:25:16,820][106225] Updated weights for policy 1, policy_version 999386 (0.0010) [2023-12-28 02:25:17,218][106226] Updated weights for policy 0, policy_version 996998 (0.0007) [2023-12-28 02:25:17,288][106226] Updated weights for policy 0, policy_version 997008 (0.0010) [2023-12-28 02:25:17,350][106226] Updated weights for policy 0, policy_version 997018 (0.0010) [2023-12-28 02:25:17,552][106225] Updated weights for policy 1, policy_version 999396 (0.0010) [2023-12-28 02:25:17,603][106225] Updated weights for policy 1, policy_version 999406 (0.0010) [2023-12-28 02:25:17,662][106225] Updated weights for policy 1, policy_version 999416 (0.0010) [2023-12-28 02:25:17,947][106226] Updated weights for policy 0, policy_version 997028 (0.0008) [2023-12-28 02:25:18,013][106226] Updated weights for policy 0, policy_version 997038 (0.0006) [2023-12-28 02:25:18,080][106226] Updated weights for policy 0, policy_version 997048 (0.0008) [2023-12-28 02:25:18,334][106225] Updated weights for policy 1, policy_version 999426 (0.0009) [2023-12-28 02:25:18,401][106225] Updated weights for policy 1, policy_version 999436 (0.0011) [2023-12-28 02:25:18,461][106225] Updated weights for policy 1, policy_version 999446 (0.0010) [2023-12-28 02:25:18,520][106225] Updated weights for policy 1, policy_version 999456 (0.0007) [2023-12-28 02:25:18,789][106226] Updated weights for policy 0, policy_version 997058 (0.0008) [2023-12-28 02:25:18,848][106226] Updated weights for policy 0, policy_version 997068 (0.0008) [2023-12-28 02:25:18,903][106226] Updated weights for policy 0, policy_version 997078 (0.0008) [2023-12-28 02:25:18,962][106226] Updated weights for policy 0, policy_version 997088 (0.0007) [2023-12-28 02:25:19,170][106225] Updated weights for policy 1, policy_version 999466 (0.0011) [2023-12-28 02:25:19,247][106225] Updated weights for policy 1, policy_version 999476 (0.0010) [2023-12-28 02:25:19,309][106225] Updated weights for policy 1, policy_version 999486 (0.0009) [2023-12-28 02:25:19,758][106226] Updated weights for policy 0, policy_version 997098 (0.0010) [2023-12-28 02:25:19,813][106226] Updated weights for policy 0, policy_version 997108 (0.0009) [2023-12-28 02:25:19,895][106226] Updated weights for policy 0, policy_version 997118 (0.0009) [2023-12-28 02:25:20,017][106225] Updated weights for policy 1, policy_version 999496 (0.0008) [2023-12-28 02:25:20,083][106225] Updated weights for policy 1, policy_version 999506 (0.0006) [2023-12-28 02:25:20,139][106225] Updated weights for policy 1, policy_version 999516 (0.0008) [2023-12-28 02:25:20,593][106226] Updated weights for policy 0, policy_version 997128 (0.0009) [2023-12-28 02:25:20,653][106226] Updated weights for policy 0, policy_version 997138 (0.0008) [2023-12-28 02:25:20,715][106226] Updated weights for policy 0, policy_version 997148 (0.0010) [2023-12-28 02:25:20,862][106225] Updated weights for policy 1, policy_version 999526 (0.0008) [2023-12-28 02:25:20,922][106225] Updated weights for policy 1, policy_version 999536 (0.0009) [2023-12-28 02:25:20,979][106225] Updated weights for policy 1, policy_version 999546 (0.0008) [2023-12-28 02:25:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 511254528. Throughput: 0: 9852.4, 1: 9866.8. Samples: 511262388. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:21,175][105115] Avg episode reward: [(0, '-4.940'), (1, '-4.982')] [2023-12-28 02:25:21,486][106226] Updated weights for policy 0, policy_version 997158 (0.0009) [2023-12-28 02:25:21,545][106226] Updated weights for policy 0, policy_version 997168 (0.0009) [2023-12-28 02:25:21,601][106226] Updated weights for policy 0, policy_version 997178 (0.0008) [2023-12-28 02:25:21,732][106225] Updated weights for policy 1, policy_version 999556 (0.0009) [2023-12-28 02:25:21,800][106225] Updated weights for policy 1, policy_version 999566 (0.0009) [2023-12-28 02:25:21,873][106225] Updated weights for policy 1, policy_version 999576 (0.0008) [2023-12-28 02:25:22,387][106226] Updated weights for policy 0, policy_version 997188 (0.0008) [2023-12-28 02:25:22,454][106226] Updated weights for policy 0, policy_version 997198 (0.0008) [2023-12-28 02:25:22,519][106226] Updated weights for policy 0, policy_version 997208 (0.0009) [2023-12-28 02:25:22,571][106225] Updated weights for policy 1, policy_version 999586 (0.0009) [2023-12-28 02:25:22,628][106225] Updated weights for policy 1, policy_version 999596 (0.0008) [2023-12-28 02:25:22,684][106225] Updated weights for policy 1, policy_version 999606 (0.0009) [2023-12-28 02:25:22,746][106225] Updated weights for policy 1, policy_version 999616 (0.0008) [2023-12-28 02:25:23,233][106226] Updated weights for policy 0, policy_version 997218 (0.0007) [2023-12-28 02:25:23,282][106226] Updated weights for policy 0, policy_version 997228 (0.0005) [2023-12-28 02:25:23,346][106226] Updated weights for policy 0, policy_version 997238 (0.0006) [2023-12-28 02:25:23,403][106226] Updated weights for policy 0, policy_version 997248 (0.0009) [2023-12-28 02:25:23,471][106225] Updated weights for policy 1, policy_version 999626 (0.0007) [2023-12-28 02:25:23,517][106225] Updated weights for policy 1, policy_version 999636 (0.0005) [2023-12-28 02:25:23,576][106225] Updated weights for policy 1, policy_version 999646 (0.0007) [2023-12-28 02:25:24,059][106226] Updated weights for policy 0, policy_version 997258 (0.0009) [2023-12-28 02:25:24,120][106226] Updated weights for policy 0, policy_version 997268 (0.0008) [2023-12-28 02:25:24,184][106226] Updated weights for policy 0, policy_version 997278 (0.0008) [2023-12-28 02:25:24,267][106225] Updated weights for policy 1, policy_version 999656 (0.0008) [2023-12-28 02:25:24,330][106225] Updated weights for policy 1, policy_version 999666 (0.0006) [2023-12-28 02:25:24,378][106225] Updated weights for policy 1, policy_version 999676 (0.0005) [2023-12-28 02:25:24,935][106225] Updated weights for policy 1, policy_version 999686 (0.0006) [2023-12-28 02:25:24,979][106226] Updated weights for policy 0, policy_version 997288 (0.0009) [2023-12-28 02:25:25,002][106225] Updated weights for policy 1, policy_version 999696 (0.0008) [2023-12-28 02:25:25,040][106226] Updated weights for policy 0, policy_version 997298 (0.0009) [2023-12-28 02:25:25,066][106225] Updated weights for policy 1, policy_version 999706 (0.0009) [2023-12-28 02:25:25,097][106226] Updated weights for policy 0, policy_version 997308 (0.0008) [2023-12-28 02:25:25,686][106225] Updated weights for policy 1, policy_version 999716 (0.0007) [2023-12-28 02:25:25,743][106225] Updated weights for policy 1, policy_version 999726 (0.0006) [2023-12-28 02:25:25,794][106225] Updated weights for policy 1, policy_version 999736 (0.0008) [2023-12-28 02:25:25,878][106226] Updated weights for policy 0, policy_version 997318 (0.0007) [2023-12-28 02:25:25,935][106226] Updated weights for policy 0, policy_version 997328 (0.0005) [2023-12-28 02:25:25,990][106226] Updated weights for policy 0, policy_version 997338 (0.0005) [2023-12-28 02:25:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 511352832. Throughput: 0: 9848.4, 1: 9817.7. Samples: 511319720. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:26,176][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.822')] [2023-12-28 02:25:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000999744_255975424.pth... [2023-12-28 02:25:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000997344_255377408.pth... [2023-12-28 02:25:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000998592_255680512.pth [2023-12-28 02:25:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000996160_255074304.pth [2023-12-28 02:25:26,517][106225] Updated weights for policy 1, policy_version 999746 (0.0008) [2023-12-28 02:25:26,566][106225] Updated weights for policy 1, policy_version 999756 (0.0009) [2023-12-28 02:25:26,610][106225] Updated weights for policy 1, policy_version 999766 (0.0008) [2023-12-28 02:25:26,658][106225] Updated weights for policy 1, policy_version 999776 (0.0008) [2023-12-28 02:25:26,664][106226] Updated weights for policy 0, policy_version 997348 (0.0008) [2023-12-28 02:25:26,721][106226] Updated weights for policy 0, policy_version 997358 (0.0008) [2023-12-28 02:25:26,785][106226] Updated weights for policy 0, policy_version 997368 (0.0008) [2023-12-28 02:25:27,392][106225] Updated weights for policy 1, policy_version 999786 (0.0010) [2023-12-28 02:25:27,451][106225] Updated weights for policy 1, policy_version 999796 (0.0010) [2023-12-28 02:25:27,485][106226] Updated weights for policy 0, policy_version 997378 (0.0008) [2023-12-28 02:25:27,509][106225] Updated weights for policy 1, policy_version 999806 (0.0011) [2023-12-28 02:25:27,550][106226] Updated weights for policy 0, policy_version 997388 (0.0005) [2023-12-28 02:25:27,616][106226] Updated weights for policy 0, policy_version 997398 (0.0006) [2023-12-28 02:25:27,672][106226] Updated weights for policy 0, policy_version 997408 (0.0010) [2023-12-28 02:25:28,233][106225] Updated weights for policy 1, policy_version 999816 (0.0010) [2023-12-28 02:25:28,268][106226] Updated weights for policy 0, policy_version 997418 (0.0007) [2023-12-28 02:25:28,287][106225] Updated weights for policy 1, policy_version 999826 (0.0010) [2023-12-28 02:25:28,317][106226] Updated weights for policy 0, policy_version 997428 (0.0006) [2023-12-28 02:25:28,342][106225] Updated weights for policy 1, policy_version 999836 (0.0009) [2023-12-28 02:25:28,377][106226] Updated weights for policy 0, policy_version 997438 (0.0008) [2023-12-28 02:25:29,076][106225] Updated weights for policy 1, policy_version 999846 (0.0009) [2023-12-28 02:25:29,083][106226] Updated weights for policy 0, policy_version 997448 (0.0007) [2023-12-28 02:25:29,127][106225] Updated weights for policy 1, policy_version 999856 (0.0009) [2023-12-28 02:25:29,145][106226] Updated weights for policy 0, policy_version 997458 (0.0006) [2023-12-28 02:25:29,179][106225] Updated weights for policy 1, policy_version 999866 (0.0010) [2023-12-28 02:25:29,201][106226] Updated weights for policy 0, policy_version 997468 (0.0006) [2023-12-28 02:25:29,886][106226] Updated weights for policy 0, policy_version 997478 (0.0009) [2023-12-28 02:25:29,899][106225] Updated weights for policy 1, policy_version 999876 (0.0010) [2023-12-28 02:25:29,953][106226] Updated weights for policy 0, policy_version 997488 (0.0008) [2023-12-28 02:25:29,962][106225] Updated weights for policy 1, policy_version 999886 (0.0008) [2023-12-28 02:25:30,015][106226] Updated weights for policy 0, policy_version 997498 (0.0008) [2023-12-28 02:25:30,025][106225] Updated weights for policy 1, policy_version 999896 (0.0006) [2023-12-28 02:25:30,640][106225] Updated weights for policy 1, policy_version 999906 (0.0005) [2023-12-28 02:25:30,700][106225] Updated weights for policy 1, policy_version 999916 (0.0008) [2023-12-28 02:25:30,758][106225] Updated weights for policy 1, policy_version 999926 (0.0008) [2023-12-28 02:25:30,771][106226] Updated weights for policy 0, policy_version 997508 (0.0008) [2023-12-28 02:25:30,817][106225] Updated weights for policy 1, policy_version 999936 (0.0006) [2023-12-28 02:25:30,827][106226] Updated weights for policy 0, policy_version 997518 (0.0006) [2023-12-28 02:25:30,882][106226] Updated weights for policy 0, policy_version 997528 (0.0005) [2023-12-28 02:25:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 511451136. Throughput: 0: 9858.1, 1: 9837.3. Samples: 511438928. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:31,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.909')] [2023-12-28 02:25:31,558][106226] Updated weights for policy 0, policy_version 997538 (0.0006) [2023-12-28 02:25:31,560][106225] Updated weights for policy 1, policy_version 999946 (0.0008) [2023-12-28 02:25:31,622][106226] Updated weights for policy 0, policy_version 997548 (0.0007) [2023-12-28 02:25:31,624][106225] Updated weights for policy 1, policy_version 999956 (0.0006) [2023-12-28 02:25:31,680][106225] Updated weights for policy 1, policy_version 999966 (0.0007) [2023-12-28 02:25:31,681][106226] Updated weights for policy 0, policy_version 997558 (0.0010) [2023-12-28 02:25:31,747][106226] Updated weights for policy 0, policy_version 997568 (0.0010) [2023-12-28 02:25:32,364][106225] Updated weights for policy 1, policy_version 999976 (0.0008) [2023-12-28 02:25:32,431][106225] Updated weights for policy 1, policy_version 999986 (0.0008) [2023-12-28 02:25:32,490][106225] Updated weights for policy 1, policy_version 999996 (0.0009) [2023-12-28 02:25:32,501][106226] Updated weights for policy 0, policy_version 997578 (0.0008) [2023-12-28 02:25:32,564][106226] Updated weights for policy 0, policy_version 997588 (0.0008) [2023-12-28 02:25:32,626][106226] Updated weights for policy 0, policy_version 997598 (0.0009) [2023-12-28 02:25:33,135][106225] Updated weights for policy 1, policy_version 1000006 (0.0007) [2023-12-28 02:25:33,185][106225] Updated weights for policy 1, policy_version 1000016 (0.0007) [2023-12-28 02:25:33,242][106225] Updated weights for policy 1, policy_version 1000026 (0.0008) [2023-12-28 02:25:33,267][106226] Updated weights for policy 0, policy_version 997608 (0.0009) [2023-12-28 02:25:33,320][106226] Updated weights for policy 0, policy_version 997618 (0.0008) [2023-12-28 02:25:33,372][106226] Updated weights for policy 0, policy_version 997628 (0.0008) [2023-12-28 02:25:33,910][106225] Updated weights for policy 1, policy_version 1000036 (0.0006) [2023-12-28 02:25:33,964][106225] Updated weights for policy 1, policy_version 1000046 (0.0010) [2023-12-28 02:25:34,018][106225] Updated weights for policy 1, policy_version 1000056 (0.0005) [2023-12-28 02:25:34,058][106226] Updated weights for policy 0, policy_version 997638 (0.0007) [2023-12-28 02:25:34,121][106226] Updated weights for policy 0, policy_version 997648 (0.0006) [2023-12-28 02:25:34,196][106226] Updated weights for policy 0, policy_version 997658 (0.0008) [2023-12-28 02:25:34,752][106225] Updated weights for policy 1, policy_version 1000066 (0.0010) [2023-12-28 02:25:34,819][106225] Updated weights for policy 1, policy_version 1000076 (0.0010) [2023-12-28 02:25:34,885][106225] Updated weights for policy 1, policy_version 1000086 (0.0010) [2023-12-28 02:25:34,904][106226] Updated weights for policy 0, policy_version 997668 (0.0006) [2023-12-28 02:25:34,946][106225] Updated weights for policy 1, policy_version 1000096 (0.0010) [2023-12-28 02:25:34,957][106226] Updated weights for policy 0, policy_version 997678 (0.0005) [2023-12-28 02:25:35,008][106226] Updated weights for policy 0, policy_version 997688 (0.0006) [2023-12-28 02:25:35,571][106226] Updated weights for policy 0, policy_version 997698 (0.0007) [2023-12-28 02:25:35,623][106225] Updated weights for policy 1, policy_version 1000106 (0.0010) [2023-12-28 02:25:35,634][106226] Updated weights for policy 0, policy_version 997708 (0.0005) [2023-12-28 02:25:35,676][106225] Updated weights for policy 1, policy_version 1000116 (0.0010) [2023-12-28 02:25:35,696][106226] Updated weights for policy 0, policy_version 997718 (0.0005) [2023-12-28 02:25:35,734][106225] Updated weights for policy 1, policy_version 1000126 (0.0007) [2023-12-28 02:25:35,758][106226] Updated weights for policy 0, policy_version 997728 (0.0006) [2023-12-28 02:25:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 511549440. Throughput: 0: 9939.1, 1: 9839.4. Samples: 511560160. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:36,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-5.102')] [2023-12-28 02:25:36,345][106225] Updated weights for policy 1, policy_version 1000136 (0.0007) [2023-12-28 02:25:36,374][106226] Updated weights for policy 0, policy_version 997738 (0.0008) [2023-12-28 02:25:36,412][106225] Updated weights for policy 1, policy_version 1000146 (0.0007) [2023-12-28 02:25:36,441][106226] Updated weights for policy 0, policy_version 997748 (0.0009) [2023-12-28 02:25:36,474][106225] Updated weights for policy 1, policy_version 1000156 (0.0009) [2023-12-28 02:25:36,503][106226] Updated weights for policy 0, policy_version 997758 (0.0008) [2023-12-28 02:25:37,188][106225] Updated weights for policy 1, policy_version 1000166 (0.0010) [2023-12-28 02:25:37,233][106226] Updated weights for policy 0, policy_version 997768 (0.0007) [2023-12-28 02:25:37,248][106225] Updated weights for policy 1, policy_version 1000176 (0.0008) [2023-12-28 02:25:37,295][106226] Updated weights for policy 0, policy_version 997778 (0.0008) [2023-12-28 02:25:37,297][106225] Updated weights for policy 1, policy_version 1000186 (0.0010) [2023-12-28 02:25:37,358][106226] Updated weights for policy 0, policy_version 997788 (0.0007) [2023-12-28 02:25:38,041][106225] Updated weights for policy 1, policy_version 1000196 (0.0010) [2023-12-28 02:25:38,080][106226] Updated weights for policy 0, policy_version 997798 (0.0009) [2023-12-28 02:25:38,095][106225] Updated weights for policy 1, policy_version 1000206 (0.0010) [2023-12-28 02:25:38,141][106226] Updated weights for policy 0, policy_version 997808 (0.0005) [2023-12-28 02:25:38,153][106225] Updated weights for policy 1, policy_version 1000216 (0.0009) [2023-12-28 02:25:38,195][106226] Updated weights for policy 0, policy_version 997818 (0.0005) [2023-12-28 02:25:38,848][106226] Updated weights for policy 0, policy_version 997828 (0.0007) [2023-12-28 02:25:38,867][106225] Updated weights for policy 1, policy_version 1000226 (0.0010) [2023-12-28 02:25:38,899][106226] Updated weights for policy 0, policy_version 997838 (0.0011) [2023-12-28 02:25:38,929][106225] Updated weights for policy 1, policy_version 1000236 (0.0010) [2023-12-28 02:25:38,946][106226] Updated weights for policy 0, policy_version 997848 (0.0010) [2023-12-28 02:25:38,985][106225] Updated weights for policy 1, policy_version 1000246 (0.0010) [2023-12-28 02:25:39,047][106225] Updated weights for policy 1, policy_version 1000256 (0.0010) [2023-12-28 02:25:39,723][106226] Updated weights for policy 0, policy_version 997858 (0.0010) [2023-12-28 02:25:39,780][106225] Updated weights for policy 1, policy_version 1000266 (0.0011) [2023-12-28 02:25:39,786][106226] Updated weights for policy 0, policy_version 997868 (0.0006) [2023-12-28 02:25:39,840][106225] Updated weights for policy 1, policy_version 1000276 (0.0010) [2023-12-28 02:25:39,855][106226] Updated weights for policy 0, policy_version 997878 (0.0008) [2023-12-28 02:25:39,908][106225] Updated weights for policy 1, policy_version 1000286 (0.0010) [2023-12-28 02:25:39,919][106226] Updated weights for policy 0, policy_version 997888 (0.0007) [2023-12-28 02:25:40,600][106225] Updated weights for policy 1, policy_version 1000296 (0.0006) [2023-12-28 02:25:40,651][106225] Updated weights for policy 1, policy_version 1000306 (0.0009) [2023-12-28 02:25:40,677][106226] Updated weights for policy 0, policy_version 997898 (0.0011) [2023-12-28 02:25:40,701][106225] Updated weights for policy 1, policy_version 1000316 (0.0010) [2023-12-28 02:25:40,737][106226] Updated weights for policy 0, policy_version 997908 (0.0010) [2023-12-28 02:25:40,796][106226] Updated weights for policy 0, policy_version 997918 (0.0010) [2023-12-28 02:25:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 511647744. Throughput: 0: 9965.7, 1: 9851.2. Samples: 511619004. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:41,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-5.042')] [2023-12-28 02:25:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001000320_256122880.pth... [2023-12-28 02:25:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000997920_255524864.pth... [2023-12-28 02:25:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000999168_255827968.pth [2023-12-28 02:25:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000996768_255229952.pth [2023-12-28 02:25:41,455][106225] Updated weights for policy 1, policy_version 1000326 (0.0009) [2023-12-28 02:25:41,516][106225] Updated weights for policy 1, policy_version 1000336 (0.0008) [2023-12-28 02:25:41,539][106226] Updated weights for policy 0, policy_version 997928 (0.0011) [2023-12-28 02:25:41,576][106225] Updated weights for policy 1, policy_version 1000346 (0.0007) [2023-12-28 02:25:41,610][106226] Updated weights for policy 0, policy_version 997938 (0.0011) [2023-12-28 02:25:41,677][106226] Updated weights for policy 0, policy_version 997948 (0.0010) [2023-12-28 02:25:42,260][106225] Updated weights for policy 1, policy_version 1000356 (0.0009) [2023-12-28 02:25:42,323][106225] Updated weights for policy 1, policy_version 1000366 (0.0008) [2023-12-28 02:25:42,393][106225] Updated weights for policy 1, policy_version 1000376 (0.0009) [2023-12-28 02:25:42,444][106226] Updated weights for policy 0, policy_version 997958 (0.0010) [2023-12-28 02:25:42,505][106226] Updated weights for policy 0, policy_version 997968 (0.0009) [2023-12-28 02:25:42,556][106226] Updated weights for policy 0, policy_version 997978 (0.0010) [2023-12-28 02:25:43,134][106225] Updated weights for policy 1, policy_version 1000386 (0.0009) [2023-12-28 02:25:43,188][106225] Updated weights for policy 1, policy_version 1000396 (0.0007) [2023-12-28 02:25:43,250][106225] Updated weights for policy 1, policy_version 1000406 (0.0008) [2023-12-28 02:25:43,288][106226] Updated weights for policy 0, policy_version 997988 (0.0010) [2023-12-28 02:25:43,309][106225] Updated weights for policy 1, policy_version 1000416 (0.0006) [2023-12-28 02:25:43,345][106226] Updated weights for policy 0, policy_version 997998 (0.0011) [2023-12-28 02:25:43,405][106226] Updated weights for policy 0, policy_version 998008 (0.0010) [2023-12-28 02:25:44,050][106225] Updated weights for policy 1, policy_version 1000426 (0.0008) [2023-12-28 02:25:44,105][106225] Updated weights for policy 1, policy_version 1000436 (0.0009) [2023-12-28 02:25:44,114][106226] Updated weights for policy 0, policy_version 998018 (0.0009) [2023-12-28 02:25:44,165][106225] Updated weights for policy 1, policy_version 1000446 (0.0007) [2023-12-28 02:25:44,166][106226] Updated weights for policy 0, policy_version 998028 (0.0006) [2023-12-28 02:25:44,219][106226] Updated weights for policy 0, policy_version 998038 (0.0006) [2023-12-28 02:25:44,281][106226] Updated weights for policy 0, policy_version 998048 (0.0005) [2023-12-28 02:25:44,843][106226] Updated weights for policy 0, policy_version 998058 (0.0006) [2023-12-28 02:25:44,900][106226] Updated weights for policy 0, policy_version 998068 (0.0005) [2023-12-28 02:25:44,966][106226] Updated weights for policy 0, policy_version 998078 (0.0008) [2023-12-28 02:25:44,981][106225] Updated weights for policy 1, policy_version 1000456 (0.0007) [2023-12-28 02:25:45,038][106225] Updated weights for policy 1, policy_version 1000466 (0.0008) [2023-12-28 02:25:45,098][106225] Updated weights for policy 1, policy_version 1000476 (0.0009) [2023-12-28 02:25:45,702][106226] Updated weights for policy 0, policy_version 998088 (0.0008) [2023-12-28 02:25:45,743][106225] Updated weights for policy 1, policy_version 1000486 (0.0009) [2023-12-28 02:25:45,768][106226] Updated weights for policy 0, policy_version 998098 (0.0006) [2023-12-28 02:25:45,797][106225] Updated weights for policy 1, policy_version 1000496 (0.0008) [2023-12-28 02:25:45,832][106226] Updated weights for policy 0, policy_version 998108 (0.0006) [2023-12-28 02:25:45,844][106225] Updated weights for policy 1, policy_version 1000506 (0.0008) [2023-12-28 02:25:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 511746048. Throughput: 0: 9922.9, 1: 9763.6. Samples: 511733232. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:46,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.240')] [2023-12-28 02:25:46,397][106226] Updated weights for policy 0, policy_version 998118 (0.0009) [2023-12-28 02:25:46,454][106226] Updated weights for policy 0, policy_version 998128 (0.0010) [2023-12-28 02:25:46,514][106226] Updated weights for policy 0, policy_version 998138 (0.0010) [2023-12-28 02:25:46,645][106225] Updated weights for policy 1, policy_version 1000516 (0.0007) [2023-12-28 02:25:46,704][106225] Updated weights for policy 1, policy_version 1000526 (0.0009) [2023-12-28 02:25:46,773][106225] Updated weights for policy 1, policy_version 1000536 (0.0007) [2023-12-28 02:25:47,108][106226] Updated weights for policy 0, policy_version 998148 (0.0010) [2023-12-28 02:25:47,167][106226] Updated weights for policy 0, policy_version 998158 (0.0005) [2023-12-28 02:25:47,224][106226] Updated weights for policy 0, policy_version 998168 (0.0005) [2023-12-28 02:25:47,374][106225] Updated weights for policy 1, policy_version 1000546 (0.0006) [2023-12-28 02:25:47,431][106225] Updated weights for policy 1, policy_version 1000556 (0.0010) [2023-12-28 02:25:47,487][106225] Updated weights for policy 1, policy_version 1000566 (0.0006) [2023-12-28 02:25:47,543][106225] Updated weights for policy 1, policy_version 1000576 (0.0005) [2023-12-28 02:25:47,788][106226] Updated weights for policy 0, policy_version 998178 (0.0006) [2023-12-28 02:25:47,850][106226] Updated weights for policy 0, policy_version 998188 (0.0008) [2023-12-28 02:25:47,910][106226] Updated weights for policy 0, policy_version 998198 (0.0008) [2023-12-28 02:25:47,971][106226] Updated weights for policy 0, policy_version 998208 (0.0011) [2023-12-28 02:25:48,105][106225] Updated weights for policy 1, policy_version 1000586 (0.0008) [2023-12-28 02:25:48,171][106225] Updated weights for policy 1, policy_version 1000596 (0.0005) [2023-12-28 02:25:48,227][106225] Updated weights for policy 1, policy_version 1000606 (0.0010) [2023-12-28 02:25:48,638][106226] Updated weights for policy 0, policy_version 998218 (0.0011) [2023-12-28 02:25:48,699][106226] Updated weights for policy 0, policy_version 998228 (0.0011) [2023-12-28 02:25:48,759][106226] Updated weights for policy 0, policy_version 998238 (0.0011) [2023-12-28 02:25:48,962][106225] Updated weights for policy 1, policy_version 1000616 (0.0009) [2023-12-28 02:25:49,021][106225] Updated weights for policy 1, policy_version 1000626 (0.0010) [2023-12-28 02:25:49,077][106225] Updated weights for policy 1, policy_version 1000636 (0.0010) [2023-12-28 02:25:49,446][106226] Updated weights for policy 0, policy_version 998248 (0.0011) [2023-12-28 02:25:49,497][106226] Updated weights for policy 0, policy_version 998258 (0.0010) [2023-12-28 02:25:49,552][106226] Updated weights for policy 0, policy_version 998268 (0.0011) [2023-12-28 02:25:49,771][106225] Updated weights for policy 1, policy_version 1000646 (0.0010) [2023-12-28 02:25:49,841][106225] Updated weights for policy 1, policy_version 1000656 (0.0010) [2023-12-28 02:25:49,909][106225] Updated weights for policy 1, policy_version 1000666 (0.0010) [2023-12-28 02:25:50,273][106226] Updated weights for policy 0, policy_version 998278 (0.0009) [2023-12-28 02:25:50,339][106226] Updated weights for policy 0, policy_version 998288 (0.0007) [2023-12-28 02:25:50,399][106226] Updated weights for policy 0, policy_version 998298 (0.0008) [2023-12-28 02:25:50,696][106225] Updated weights for policy 1, policy_version 1000676 (0.0010) [2023-12-28 02:25:50,760][106225] Updated weights for policy 1, policy_version 1000686 (0.0009) [2023-12-28 02:25:50,825][106225] Updated weights for policy 1, policy_version 1000696 (0.0009) [2023-12-28 02:25:51,047][106226] Updated weights for policy 0, policy_version 998308 (0.0008) [2023-12-28 02:25:51,104][106226] Updated weights for policy 0, policy_version 998318 (0.0006) [2023-12-28 02:25:51,172][106226] Updated weights for policy 0, policy_version 998328 (0.0009) [2023-12-28 02:25:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 511844352. Throughput: 0: 9968.1, 1: 9811.8. Samples: 511856184. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:51,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-5.041')] [2023-12-28 02:25:51,661][106225] Updated weights for policy 1, policy_version 1000706 (0.0008) [2023-12-28 02:25:51,726][106225] Updated weights for policy 1, policy_version 1000716 (0.0009) [2023-12-28 02:25:51,786][106225] Updated weights for policy 1, policy_version 1000726 (0.0006) [2023-12-28 02:25:51,851][106225] Updated weights for policy 1, policy_version 1000736 (0.0009) [2023-12-28 02:25:51,972][106226] Updated weights for policy 0, policy_version 998338 (0.0009) [2023-12-28 02:25:52,028][106226] Updated weights for policy 0, policy_version 998348 (0.0008) [2023-12-28 02:25:52,082][106226] Updated weights for policy 0, policy_version 998358 (0.0009) [2023-12-28 02:25:52,138][106226] Updated weights for policy 0, policy_version 998368 (0.0009) [2023-12-28 02:25:52,594][106225] Updated weights for policy 1, policy_version 1000746 (0.0008) [2023-12-28 02:25:52,667][106225] Updated weights for policy 1, policy_version 1000756 (0.0008) [2023-12-28 02:25:52,736][106225] Updated weights for policy 1, policy_version 1000766 (0.0008) [2023-12-28 02:25:52,846][106226] Updated weights for policy 0, policy_version 998378 (0.0005) [2023-12-28 02:25:52,917][106226] Updated weights for policy 0, policy_version 998388 (0.0006) [2023-12-28 02:25:52,976][106226] Updated weights for policy 0, policy_version 998398 (0.0008) [2023-12-28 02:25:53,382][106225] Updated weights for policy 1, policy_version 1000776 (0.0010) [2023-12-28 02:25:53,435][106225] Updated weights for policy 1, policy_version 1000786 (0.0010) [2023-12-28 02:25:53,492][106225] Updated weights for policy 1, policy_version 1000796 (0.0010) [2023-12-28 02:25:53,602][106226] Updated weights for policy 0, policy_version 998408 (0.0009) [2023-12-28 02:25:53,664][106226] Updated weights for policy 0, policy_version 998418 (0.0008) [2023-12-28 02:25:53,720][106226] Updated weights for policy 0, policy_version 998428 (0.0007) [2023-12-28 02:25:54,222][106225] Updated weights for policy 1, policy_version 1000806 (0.0010) [2023-12-28 02:25:54,272][106225] Updated weights for policy 1, policy_version 1000816 (0.0010) [2023-12-28 02:25:54,314][106226] Updated weights for policy 0, policy_version 998438 (0.0010) [2023-12-28 02:25:54,326][106225] Updated weights for policy 1, policy_version 1000826 (0.0010) [2023-12-28 02:25:54,375][106226] Updated weights for policy 0, policy_version 998448 (0.0011) [2023-12-28 02:25:54,433][106226] Updated weights for policy 0, policy_version 998458 (0.0008) [2023-12-28 02:25:54,931][106225] Updated weights for policy 1, policy_version 1000836 (0.0007) [2023-12-28 02:25:54,988][106225] Updated weights for policy 1, policy_version 1000846 (0.0005) [2023-12-28 02:25:55,014][106226] Updated weights for policy 0, policy_version 998468 (0.0009) [2023-12-28 02:25:55,043][106225] Updated weights for policy 1, policy_version 1000856 (0.0005) [2023-12-28 02:25:55,071][106226] Updated weights for policy 0, policy_version 998478 (0.0009) [2023-12-28 02:25:55,131][106226] Updated weights for policy 0, policy_version 998488 (0.0005) [2023-12-28 02:25:55,658][106225] Updated weights for policy 1, policy_version 1000866 (0.0007) [2023-12-28 02:25:55,719][106225] Updated weights for policy 1, policy_version 1000876 (0.0010) [2023-12-28 02:25:55,775][106225] Updated weights for policy 1, policy_version 1000886 (0.0010) [2023-12-28 02:25:55,811][106226] Updated weights for policy 0, policy_version 998498 (0.0008) [2023-12-28 02:25:55,836][106225] Updated weights for policy 1, policy_version 1000896 (0.0010) [2023-12-28 02:25:55,867][106226] Updated weights for policy 0, policy_version 998508 (0.0006) [2023-12-28 02:25:55,915][106226] Updated weights for policy 0, policy_version 998518 (0.0005) [2023-12-28 02:25:55,979][106226] Updated weights for policy 0, policy_version 998528 (0.0005) [2023-12-28 02:25:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 511950848. Throughput: 0: 9985.5, 1: 9722.6. Samples: 511913560. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:25:56,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.281')] [2023-12-28 02:25:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001000896_256270336.pth... [2023-12-28 02:25:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000998528_255680512.pth... [2023-12-28 02:25:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_000999744_255975424.pth [2023-12-28 02:25:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000997344_255377408.pth [2023-12-28 02:25:56,515][106226] Updated weights for policy 0, policy_version 998538 (0.0006) [2023-12-28 02:25:56,565][106225] Updated weights for policy 1, policy_version 1000906 (0.0007) [2023-12-28 02:25:56,583][106226] Updated weights for policy 0, policy_version 998548 (0.0008) [2023-12-28 02:25:56,626][106225] Updated weights for policy 1, policy_version 1000916 (0.0005) [2023-12-28 02:25:56,630][106226] Updated weights for policy 0, policy_version 998558 (0.0010) [2023-12-28 02:25:56,673][106225] Updated weights for policy 1, policy_version 1000926 (0.0005) [2023-12-28 02:25:57,237][106225] Updated weights for policy 1, policy_version 1000936 (0.0009) [2023-12-28 02:25:57,266][106226] Updated weights for policy 0, policy_version 998568 (0.0006) [2023-12-28 02:25:57,286][106225] Updated weights for policy 1, policy_version 1000946 (0.0010) [2023-12-28 02:25:57,322][106226] Updated weights for policy 0, policy_version 998578 (0.0005) [2023-12-28 02:25:57,344][106225] Updated weights for policy 1, policy_version 1000956 (0.0010) [2023-12-28 02:25:57,381][106226] Updated weights for policy 0, policy_version 998588 (0.0005) [2023-12-28 02:25:57,896][106226] Updated weights for policy 0, policy_version 998598 (0.0005) [2023-12-28 02:25:57,949][106226] Updated weights for policy 0, policy_version 998608 (0.0005) [2023-12-28 02:25:57,999][106226] Updated weights for policy 0, policy_version 998618 (0.0010) [2023-12-28 02:25:58,056][106225] Updated weights for policy 1, policy_version 1000966 (0.0010) [2023-12-28 02:25:58,108][106225] Updated weights for policy 1, policy_version 1000976 (0.0009) [2023-12-28 02:25:58,162][106225] Updated weights for policy 1, policy_version 1000986 (0.0005) [2023-12-28 02:25:58,740][106226] Updated weights for policy 0, policy_version 998628 (0.0011) [2023-12-28 02:25:58,817][106226] Updated weights for policy 0, policy_version 998638 (0.0009) [2023-12-28 02:25:58,895][106226] Updated weights for policy 0, policy_version 998649 (0.0010) [2023-12-28 02:25:59,023][106225] Updated weights for policy 1, policy_version 1000996 (0.0009) [2023-12-28 02:25:59,079][106225] Updated weights for policy 1, policy_version 1001006 (0.0008) [2023-12-28 02:25:59,137][106225] Updated weights for policy 1, policy_version 1001016 (0.0006) [2023-12-28 02:25:59,698][106226] Updated weights for policy 0, policy_version 998659 (0.0008) [2023-12-28 02:25:59,756][106226] Updated weights for policy 0, policy_version 998669 (0.0009) [2023-12-28 02:25:59,800][106226] Updated weights for policy 0, policy_version 998679 (0.0009) [2023-12-28 02:25:59,921][106225] Updated weights for policy 1, policy_version 1001026 (0.0006) [2023-12-28 02:25:59,992][106225] Updated weights for policy 1, policy_version 1001036 (0.0008) [2023-12-28 02:26:00,053][106225] Updated weights for policy 1, policy_version 1001046 (0.0009) [2023-12-28 02:26:00,110][106225] Updated weights for policy 1, policy_version 1001056 (0.0009) [2023-12-28 02:26:00,549][106226] Updated weights for policy 0, policy_version 998689 (0.0008) [2023-12-28 02:26:00,608][106226] Updated weights for policy 0, policy_version 998699 (0.0005) [2023-12-28 02:26:00,667][106226] Updated weights for policy 0, policy_version 998709 (0.0005) [2023-12-28 02:26:00,721][106226] Updated weights for policy 0, policy_version 998719 (0.0006) [2023-12-28 02:26:00,830][106225] Updated weights for policy 1, policy_version 1001066 (0.0010) [2023-12-28 02:26:00,882][106225] Updated weights for policy 1, policy_version 1001076 (0.0010) [2023-12-28 02:26:00,928][106225] Updated weights for policy 1, policy_version 1001086 (0.0010) [2023-12-28 02:26:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 512049152. Throughput: 0: 10078.4, 1: 9834.1. Samples: 512038048. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:01,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-4.992')] [2023-12-28 02:26:01,314][106226] Updated weights for policy 0, policy_version 998729 (0.0007) [2023-12-28 02:26:01,379][106226] Updated weights for policy 0, policy_version 998739 (0.0008) [2023-12-28 02:26:01,435][106226] Updated weights for policy 0, policy_version 998749 (0.0006) [2023-12-28 02:26:01,723][106225] Updated weights for policy 1, policy_version 1001096 (0.0009) [2023-12-28 02:26:01,790][106225] Updated weights for policy 1, policy_version 1001106 (0.0007) [2023-12-28 02:26:01,853][106225] Updated weights for policy 1, policy_version 1001116 (0.0007) [2023-12-28 02:26:02,119][106226] Updated weights for policy 0, policy_version 998759 (0.0006) [2023-12-28 02:26:02,175][106226] Updated weights for policy 0, policy_version 998769 (0.0005) [2023-12-28 02:26:02,235][106226] Updated weights for policy 0, policy_version 998779 (0.0006) [2023-12-28 02:26:02,610][106225] Updated weights for policy 1, policy_version 1001126 (0.0008) [2023-12-28 02:26:02,665][106225] Updated weights for policy 1, policy_version 1001136 (0.0008) [2023-12-28 02:26:02,719][106225] Updated weights for policy 1, policy_version 1001146 (0.0006) [2023-12-28 02:26:02,880][106226] Updated weights for policy 0, policy_version 998789 (0.0009) [2023-12-28 02:26:02,940][106226] Updated weights for policy 0, policy_version 998799 (0.0009) [2023-12-28 02:26:02,996][106226] Updated weights for policy 0, policy_version 998809 (0.0006) [2023-12-28 02:26:03,385][106225] Updated weights for policy 1, policy_version 1001156 (0.0007) [2023-12-28 02:26:03,449][106225] Updated weights for policy 1, policy_version 1001166 (0.0008) [2023-12-28 02:26:03,510][106225] Updated weights for policy 1, policy_version 1001176 (0.0008) [2023-12-28 02:26:03,638][106226] Updated weights for policy 0, policy_version 998819 (0.0006) [2023-12-28 02:26:03,691][106226] Updated weights for policy 0, policy_version 998829 (0.0008) [2023-12-28 02:26:03,748][106226] Updated weights for policy 0, policy_version 998839 (0.0005) [2023-12-28 02:26:04,223][106225] Updated weights for policy 1, policy_version 1001186 (0.0008) [2023-12-28 02:26:04,277][106225] Updated weights for policy 1, policy_version 1001196 (0.0009) [2023-12-28 02:26:04,333][106225] Updated weights for policy 1, policy_version 1001206 (0.0007) [2023-12-28 02:26:04,389][106225] Updated weights for policy 1, policy_version 1001216 (0.0008) [2023-12-28 02:26:04,480][106226] Updated weights for policy 0, policy_version 998849 (0.0006) [2023-12-28 02:26:04,544][106226] Updated weights for policy 0, policy_version 998859 (0.0007) [2023-12-28 02:26:04,618][106226] Updated weights for policy 0, policy_version 998869 (0.0007) [2023-12-28 02:26:04,677][106226] Updated weights for policy 0, policy_version 998879 (0.0011) [2023-12-28 02:26:05,063][106225] Updated weights for policy 1, policy_version 1001226 (0.0008) [2023-12-28 02:26:05,124][106225] Updated weights for policy 1, policy_version 1001236 (0.0008) [2023-12-28 02:26:05,178][106225] Updated weights for policy 1, policy_version 1001246 (0.0009) [2023-12-28 02:26:05,276][106226] Updated weights for policy 0, policy_version 998889 (0.0010) [2023-12-28 02:26:05,322][106226] Updated weights for policy 0, policy_version 998899 (0.0010) [2023-12-28 02:26:05,369][106226] Updated weights for policy 0, policy_version 998909 (0.0010) [2023-12-28 02:26:05,850][106225] Updated weights for policy 1, policy_version 1001256 (0.0008) [2023-12-28 02:26:05,906][106225] Updated weights for policy 1, policy_version 1001266 (0.0008) [2023-12-28 02:26:05,960][106225] Updated weights for policy 1, policy_version 1001276 (0.0008) [2023-12-28 02:26:06,140][106226] Updated weights for policy 0, policy_version 998919 (0.0010) [2023-12-28 02:26:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 512147456. Throughput: 0: 10091.9, 1: 9830.7. Samples: 512158904. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:06,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.026')] [2023-12-28 02:26:06,198][106226] Updated weights for policy 0, policy_version 998929 (0.0011) [2023-12-28 02:26:06,257][106226] Updated weights for policy 0, policy_version 998939 (0.0011) [2023-12-28 02:26:06,711][106225] Updated weights for policy 1, policy_version 1001286 (0.0008) [2023-12-28 02:26:06,775][106225] Updated weights for policy 1, policy_version 1001296 (0.0007) [2023-12-28 02:26:06,839][106225] Updated weights for policy 1, policy_version 1001306 (0.0005) [2023-12-28 02:26:06,992][106226] Updated weights for policy 0, policy_version 998949 (0.0011) [2023-12-28 02:26:07,042][106226] Updated weights for policy 0, policy_version 998959 (0.0010) [2023-12-28 02:26:07,089][106226] Updated weights for policy 0, policy_version 998969 (0.0011) [2023-12-28 02:26:07,514][106225] Updated weights for policy 1, policy_version 1001316 (0.0007) [2023-12-28 02:26:07,574][106225] Updated weights for policy 1, policy_version 1001326 (0.0008) [2023-12-28 02:26:07,630][106225] Updated weights for policy 1, policy_version 1001336 (0.0007) [2023-12-28 02:26:07,794][106226] Updated weights for policy 0, policy_version 998979 (0.0010) [2023-12-28 02:26:07,848][106226] Updated weights for policy 0, policy_version 998989 (0.0011) [2023-12-28 02:26:07,899][106226] Updated weights for policy 0, policy_version 998999 (0.0010) [2023-12-28 02:26:08,241][106225] Updated weights for policy 1, policy_version 1001346 (0.0008) [2023-12-28 02:26:08,297][106225] Updated weights for policy 1, policy_version 1001356 (0.0007) [2023-12-28 02:26:08,357][106225] Updated weights for policy 1, policy_version 1001366 (0.0008) [2023-12-28 02:26:08,411][106225] Updated weights for policy 1, policy_version 1001376 (0.0008) [2023-12-28 02:26:08,622][106226] Updated weights for policy 0, policy_version 999009 (0.0010) [2023-12-28 02:26:08,687][106226] Updated weights for policy 0, policy_version 999019 (0.0011) [2023-12-28 02:26:08,752][106226] Updated weights for policy 0, policy_version 999029 (0.0007) [2023-12-28 02:26:08,824][106226] Updated weights for policy 0, policy_version 999039 (0.0009) [2023-12-28 02:26:09,079][106225] Updated weights for policy 1, policy_version 1001386 (0.0008) [2023-12-28 02:26:09,132][106225] Updated weights for policy 1, policy_version 1001396 (0.0008) [2023-12-28 02:26:09,186][106225] Updated weights for policy 1, policy_version 1001406 (0.0009) [2023-12-28 02:26:09,522][106226] Updated weights for policy 0, policy_version 999049 (0.0011) [2023-12-28 02:26:09,588][106226] Updated weights for policy 0, policy_version 999059 (0.0011) [2023-12-28 02:26:09,650][106226] Updated weights for policy 0, policy_version 999069 (0.0009) [2023-12-28 02:26:10,057][106225] Updated weights for policy 1, policy_version 1001416 (0.0008) [2023-12-28 02:26:10,121][106225] Updated weights for policy 1, policy_version 1001426 (0.0008) [2023-12-28 02:26:10,181][106225] Updated weights for policy 1, policy_version 1001436 (0.0008) [2023-12-28 02:26:10,424][106226] Updated weights for policy 0, policy_version 999079 (0.0007) [2023-12-28 02:26:10,487][106226] Updated weights for policy 0, policy_version 999089 (0.0008) [2023-12-28 02:26:10,548][106226] Updated weights for policy 0, policy_version 999099 (0.0008) [2023-12-28 02:26:10,915][106225] Updated weights for policy 1, policy_version 1001446 (0.0008) [2023-12-28 02:26:10,984][106225] Updated weights for policy 1, policy_version 1001456 (0.0009) [2023-12-28 02:26:11,058][106225] Updated weights for policy 1, policy_version 1001466 (0.0009) [2023-12-28 02:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 512245760. Throughput: 0: 10089.9, 1: 9871.0. Samples: 512217956. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:11,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-4.577')] [2023-12-28 02:26:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001001472_256417792.pth... [2023-12-28 02:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000999104_255827968.pth... [2023-12-28 02:26:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001000320_256122880.pth [2023-12-28 02:26:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000997920_255524864.pth [2023-12-28 02:26:11,384][106226] Updated weights for policy 0, policy_version 999109 (0.0009) [2023-12-28 02:26:11,457][106226] Updated weights for policy 0, policy_version 999119 (0.0008) [2023-12-28 02:26:11,520][106226] Updated weights for policy 0, policy_version 999129 (0.0009) [2023-12-28 02:26:11,902][106225] Updated weights for policy 1, policy_version 1001476 (0.0007) [2023-12-28 02:26:11,964][106225] Updated weights for policy 1, policy_version 1001486 (0.0008) [2023-12-28 02:26:12,019][106225] Updated weights for policy 1, policy_version 1001496 (0.0009) [2023-12-28 02:26:12,343][106226] Updated weights for policy 0, policy_version 999139 (0.0009) [2023-12-28 02:26:12,422][106226] Updated weights for policy 0, policy_version 999149 (0.0009) [2023-12-28 02:26:12,491][106226] Updated weights for policy 0, policy_version 999159 (0.0007) [2023-12-28 02:26:12,860][106225] Updated weights for policy 1, policy_version 1001506 (0.0007) [2023-12-28 02:26:12,934][106225] Updated weights for policy 1, policy_version 1001516 (0.0008) [2023-12-28 02:26:13,012][106225] Updated weights for policy 1, policy_version 1001526 (0.0008) [2023-12-28 02:26:13,084][106225] Updated weights for policy 1, policy_version 1001536 (0.0008) [2023-12-28 02:26:13,316][106226] Updated weights for policy 0, policy_version 999169 (0.0007) [2023-12-28 02:26:13,375][106226] Updated weights for policy 0, policy_version 999179 (0.0008) [2023-12-28 02:26:13,432][106226] Updated weights for policy 0, policy_version 999189 (0.0008) [2023-12-28 02:26:13,501][106226] Updated weights for policy 0, policy_version 999199 (0.0008) [2023-12-28 02:26:13,798][106225] Updated weights for policy 1, policy_version 1001546 (0.0009) [2023-12-28 02:26:13,866][106225] Updated weights for policy 1, policy_version 1001556 (0.0009) [2023-12-28 02:26:13,930][106225] Updated weights for policy 1, policy_version 1001566 (0.0008) [2023-12-28 02:26:14,330][106226] Updated weights for policy 0, policy_version 999209 (0.0008) [2023-12-28 02:26:14,402][106226] Updated weights for policy 0, policy_version 999219 (0.0008) [2023-12-28 02:26:14,478][106226] Updated weights for policy 0, policy_version 999229 (0.0009) [2023-12-28 02:26:14,748][106225] Updated weights for policy 1, policy_version 1001576 (0.0008) [2023-12-28 02:26:14,817][106225] Updated weights for policy 1, policy_version 1001586 (0.0009) [2023-12-28 02:26:14,882][106225] Updated weights for policy 1, policy_version 1001596 (0.0010) [2023-12-28 02:26:15,246][106226] Updated weights for policy 0, policy_version 999239 (0.0009) [2023-12-28 02:26:15,307][106226] Updated weights for policy 0, policy_version 999249 (0.0009) [2023-12-28 02:26:15,368][106226] Updated weights for policy 0, policy_version 999259 (0.0009) [2023-12-28 02:26:15,584][106225] Updated weights for policy 1, policy_version 1001606 (0.0006) [2023-12-28 02:26:15,647][106225] Updated weights for policy 1, policy_version 1001616 (0.0008) [2023-12-28 02:26:15,714][106225] Updated weights for policy 1, policy_version 1001626 (0.0010) [2023-12-28 02:26:16,043][106226] Updated weights for policy 0, policy_version 999269 (0.0008) [2023-12-28 02:26:16,101][106226] Updated weights for policy 0, policy_version 999279 (0.0008) [2023-12-28 02:26:16,156][106226] Updated weights for policy 0, policy_version 999289 (0.0008) [2023-12-28 02:26:16,174][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 512327680. Throughput: 0: 9928.3, 1: 9695.4. Samples: 512321992. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:16,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.829')] [2023-12-28 02:26:16,406][106225] Updated weights for policy 1, policy_version 1001636 (0.0011) [2023-12-28 02:26:16,454][106225] Updated weights for policy 1, policy_version 1001646 (0.0011) [2023-12-28 02:26:16,514][106225] Updated weights for policy 1, policy_version 1001656 (0.0010) [2023-12-28 02:26:16,885][106226] Updated weights for policy 0, policy_version 999299 (0.0007) [2023-12-28 02:26:16,938][106226] Updated weights for policy 0, policy_version 999309 (0.0008) [2023-12-28 02:26:16,993][106226] Updated weights for policy 0, policy_version 999319 (0.0005) [2023-12-28 02:26:17,220][106225] Updated weights for policy 1, policy_version 1001666 (0.0010) [2023-12-28 02:26:17,277][106225] Updated weights for policy 1, policy_version 1001676 (0.0010) [2023-12-28 02:26:17,331][106225] Updated weights for policy 1, policy_version 1001686 (0.0010) [2023-12-28 02:26:17,393][106225] Updated weights for policy 1, policy_version 1001696 (0.0011) [2023-12-28 02:26:17,660][106226] Updated weights for policy 0, policy_version 999329 (0.0006) [2023-12-28 02:26:17,715][106226] Updated weights for policy 0, policy_version 999339 (0.0010) [2023-12-28 02:26:17,780][106226] Updated weights for policy 0, policy_version 999349 (0.0009) [2023-12-28 02:26:17,847][106226] Updated weights for policy 0, policy_version 999359 (0.0009) [2023-12-28 02:26:18,094][106225] Updated weights for policy 1, policy_version 1001706 (0.0007) [2023-12-28 02:26:18,148][106225] Updated weights for policy 1, policy_version 1001716 (0.0008) [2023-12-28 02:26:18,203][106225] Updated weights for policy 1, policy_version 1001726 (0.0008) [2023-12-28 02:26:18,674][106226] Updated weights for policy 0, policy_version 999369 (0.0008) [2023-12-28 02:26:18,737][106226] Updated weights for policy 0, policy_version 999379 (0.0009) [2023-12-28 02:26:18,806][106226] Updated weights for policy 0, policy_version 999389 (0.0009) [2023-12-28 02:26:18,981][106225] Updated weights for policy 1, policy_version 1001736 (0.0009) [2023-12-28 02:26:19,050][106225] Updated weights for policy 1, policy_version 1001746 (0.0009) [2023-12-28 02:26:19,114][106225] Updated weights for policy 1, policy_version 1001756 (0.0009) [2023-12-28 02:26:19,521][106226] Updated weights for policy 0, policy_version 999399 (0.0009) [2023-12-28 02:26:19,587][106226] Updated weights for policy 0, policy_version 999409 (0.0009) [2023-12-28 02:26:19,656][106226] Updated weights for policy 0, policy_version 999419 (0.0009) [2023-12-28 02:26:19,981][106225] Updated weights for policy 1, policy_version 1001766 (0.0009) [2023-12-28 02:26:20,047][106225] Updated weights for policy 1, policy_version 1001776 (0.0010) [2023-12-28 02:26:20,114][106225] Updated weights for policy 1, policy_version 1001786 (0.0011) [2023-12-28 02:26:20,476][106226] Updated weights for policy 0, policy_version 999429 (0.0008) [2023-12-28 02:26:20,542][106226] Updated weights for policy 0, policy_version 999439 (0.0009) [2023-12-28 02:26:20,618][106226] Updated weights for policy 0, policy_version 999449 (0.0009) [2023-12-28 02:26:20,927][106225] Updated weights for policy 1, policy_version 1001796 (0.0010) [2023-12-28 02:26:20,998][106225] Updated weights for policy 1, policy_version 1001806 (0.0008) [2023-12-28 02:26:21,071][106225] Updated weights for policy 1, policy_version 1001816 (0.0009) [2023-12-28 02:26:21,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 512425984. Throughput: 0: 9814.7, 1: 9582.1. Samples: 512433016. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:21,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.997')] [2023-12-28 02:26:21,486][106226] Updated weights for policy 0, policy_version 999459 (0.0009) [2023-12-28 02:26:21,554][106226] Updated weights for policy 0, policy_version 999469 (0.0008) [2023-12-28 02:26:21,638][106226] Updated weights for policy 0, policy_version 999479 (0.0007) [2023-12-28 02:26:21,946][106225] Updated weights for policy 1, policy_version 1001826 (0.0008) [2023-12-28 02:26:22,012][106225] Updated weights for policy 1, policy_version 1001836 (0.0010) [2023-12-28 02:26:22,068][106225] Updated weights for policy 1, policy_version 1001846 (0.0010) [2023-12-28 02:26:22,131][106225] Updated weights for policy 1, policy_version 1001856 (0.0009) [2023-12-28 02:26:22,408][106226] Updated weights for policy 0, policy_version 999489 (0.0009) [2023-12-28 02:26:22,475][106226] Updated weights for policy 0, policy_version 999499 (0.0008) [2023-12-28 02:26:22,549][106226] Updated weights for policy 0, policy_version 999509 (0.0007) [2023-12-28 02:26:22,614][106226] Updated weights for policy 0, policy_version 999519 (0.0008) [2023-12-28 02:26:22,931][106225] Updated weights for policy 1, policy_version 1001866 (0.0008) [2023-12-28 02:26:22,986][106225] Updated weights for policy 1, policy_version 1001876 (0.0009) [2023-12-28 02:26:23,046][106225] Updated weights for policy 1, policy_version 1001886 (0.0009) [2023-12-28 02:26:23,346][106226] Updated weights for policy 0, policy_version 999529 (0.0009) [2023-12-28 02:26:23,406][106226] Updated weights for policy 0, policy_version 999539 (0.0009) [2023-12-28 02:26:23,473][106226] Updated weights for policy 0, policy_version 999549 (0.0010) [2023-12-28 02:26:23,825][106225] Updated weights for policy 1, policy_version 1001896 (0.0009) [2023-12-28 02:26:23,886][106225] Updated weights for policy 1, policy_version 1001906 (0.0009) [2023-12-28 02:26:23,946][106225] Updated weights for policy 1, policy_version 1001916 (0.0008) [2023-12-28 02:26:24,192][106226] Updated weights for policy 0, policy_version 999559 (0.0008) [2023-12-28 02:26:24,258][106226] Updated weights for policy 0, policy_version 999569 (0.0008) [2023-12-28 02:26:24,327][106226] Updated weights for policy 0, policy_version 999579 (0.0009) [2023-12-28 02:26:24,792][106225] Updated weights for policy 1, policy_version 1001926 (0.0009) [2023-12-28 02:26:24,854][106225] Updated weights for policy 1, policy_version 1001936 (0.0008) [2023-12-28 02:26:24,920][106225] Updated weights for policy 1, policy_version 1001946 (0.0008) [2023-12-28 02:26:25,134][106226] Updated weights for policy 0, policy_version 999589 (0.0009) [2023-12-28 02:26:25,203][106226] Updated weights for policy 0, policy_version 999599 (0.0008) [2023-12-28 02:26:25,274][106226] Updated weights for policy 0, policy_version 999609 (0.0009) [2023-12-28 02:26:25,712][106225] Updated weights for policy 1, policy_version 1001956 (0.0008) [2023-12-28 02:26:25,776][106225] Updated weights for policy 1, policy_version 1001966 (0.0006) [2023-12-28 02:26:25,837][106225] Updated weights for policy 1, policy_version 1001976 (0.0008) [2023-12-28 02:26:26,067][106226] Updated weights for policy 0, policy_version 999619 (0.0010) [2023-12-28 02:26:26,133][106226] Updated weights for policy 0, policy_version 999629 (0.0011) [2023-12-28 02:26:26,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19251.2, 300 sec: 19744.1). Total num frames: 512507904. Throughput: 0: 9759.5, 1: 9479.9. Samples: 512484776. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:26,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.891')] [2023-12-28 02:26:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001001984_256548864.pth... [2023-12-28 02:26:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001000896_256270336.pth [2023-12-28 02:26:26,197][106226] Updated weights for policy 0, policy_version 999639 (0.0008) [2023-12-28 02:26:26,259][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000999648_255967232.pth... [2023-12-28 02:26:26,264][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000998528_255680512.pth [2023-12-28 02:26:26,664][106225] Updated weights for policy 1, policy_version 1001986 (0.0009) [2023-12-28 02:26:26,736][106225] Updated weights for policy 1, policy_version 1001996 (0.0008) [2023-12-28 02:26:26,798][106225] Updated weights for policy 1, policy_version 1002006 (0.0008) [2023-12-28 02:26:26,850][106225] Updated weights for policy 1, policy_version 1002016 (0.0007) [2023-12-28 02:26:26,943][106226] Updated weights for policy 0, policy_version 999649 (0.0009) [2023-12-28 02:26:27,010][106226] Updated weights for policy 0, policy_version 999659 (0.0011) [2023-12-28 02:26:27,073][106226] Updated weights for policy 0, policy_version 999669 (0.0010) [2023-12-28 02:26:27,133][106226] Updated weights for policy 0, policy_version 999679 (0.0010) [2023-12-28 02:26:27,639][106225] Updated weights for policy 1, policy_version 1002026 (0.0008) [2023-12-28 02:26:27,698][106225] Updated weights for policy 1, policy_version 1002036 (0.0006) [2023-12-28 02:26:27,761][106225] Updated weights for policy 1, policy_version 1002046 (0.0007) [2023-12-28 02:26:27,787][106226] Updated weights for policy 0, policy_version 999689 (0.0011) [2023-12-28 02:26:27,857][106226] Updated weights for policy 0, policy_version 999699 (0.0011) [2023-12-28 02:26:27,906][106226] Updated weights for policy 0, policy_version 999709 (0.0010) [2023-12-28 02:26:28,479][106225] Updated weights for policy 1, policy_version 1002056 (0.0008) [2023-12-28 02:26:28,547][106225] Updated weights for policy 1, policy_version 1002066 (0.0008) [2023-12-28 02:26:28,614][106225] Updated weights for policy 1, policy_version 1002076 (0.0008) [2023-12-28 02:26:28,713][106226] Updated weights for policy 0, policy_version 999719 (0.0011) [2023-12-28 02:26:28,779][106226] Updated weights for policy 0, policy_version 999729 (0.0010) [2023-12-28 02:26:28,854][106226] Updated weights for policy 0, policy_version 999739 (0.0008) [2023-12-28 02:26:29,597][106225] Updated weights for policy 1, policy_version 1002086 (0.0010) [2023-12-28 02:26:29,671][106225] Updated weights for policy 1, policy_version 1002096 (0.0010) [2023-12-28 02:26:29,744][106225] Updated weights for policy 1, policy_version 1002106 (0.0011) [2023-12-28 02:26:29,782][106226] Updated weights for policy 0, policy_version 999749 (0.0008) [2023-12-28 02:26:29,863][106226] Updated weights for policy 0, policy_version 999759 (0.0009) [2023-12-28 02:26:29,937][106226] Updated weights for policy 0, policy_version 999769 (0.0008) [2023-12-28 02:26:30,502][106225] Updated weights for policy 1, policy_version 1002116 (0.0008) [2023-12-28 02:26:30,562][106225] Updated weights for policy 1, policy_version 1002126 (0.0008) [2023-12-28 02:26:30,624][106225] Updated weights for policy 1, policy_version 1002136 (0.0008) [2023-12-28 02:26:30,763][106226] Updated weights for policy 0, policy_version 999779 (0.0009) [2023-12-28 02:26:30,824][106226] Updated weights for policy 0, policy_version 999789 (0.0008) [2023-12-28 02:26:30,891][106226] Updated weights for policy 0, policy_version 999799 (0.0009) [2023-12-28 02:26:31,174][105115] Fps is (10 sec: 17203.4, 60 sec: 19114.7, 300 sec: 19716.3). Total num frames: 512598016. Throughput: 0: 9625.8, 1: 9372.8. Samples: 512588168. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:31,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.915')] [2023-12-28 02:26:31,526][106225] Updated weights for policy 1, policy_version 1002146 (0.0009) [2023-12-28 02:26:31,594][106225] Updated weights for policy 1, policy_version 1002156 (0.0008) [2023-12-28 02:26:31,670][106225] Updated weights for policy 1, policy_version 1002166 (0.0008) [2023-12-28 02:26:31,741][106225] Updated weights for policy 1, policy_version 1002176 (0.0008) [2023-12-28 02:26:31,849][106226] Updated weights for policy 0, policy_version 999809 (0.0009) [2023-12-28 02:26:31,920][106226] Updated weights for policy 0, policy_version 999819 (0.0009) [2023-12-28 02:26:32,021][106226] Updated weights for policy 0, policy_version 999829 (0.0008) [2023-12-28 02:26:32,092][106226] Updated weights for policy 0, policy_version 999839 (0.0009) [2023-12-28 02:26:32,573][106225] Updated weights for policy 1, policy_version 1002186 (0.0008) [2023-12-28 02:26:32,623][106225] Updated weights for policy 1, policy_version 1002196 (0.0008) [2023-12-28 02:26:32,692][106225] Updated weights for policy 1, policy_version 1002206 (0.0009) [2023-12-28 02:26:32,780][106226] Updated weights for policy 0, policy_version 999849 (0.0006) [2023-12-28 02:26:32,842][106226] Updated weights for policy 0, policy_version 999859 (0.0006) [2023-12-28 02:26:32,911][106226] Updated weights for policy 0, policy_version 999869 (0.0008) [2023-12-28 02:26:33,460][106225] Updated weights for policy 1, policy_version 1002216 (0.0010) [2023-12-28 02:26:33,526][106225] Updated weights for policy 1, policy_version 1002226 (0.0011) [2023-12-28 02:26:33,530][106226] Updated weights for policy 0, policy_version 999879 (0.0007) [2023-12-28 02:26:33,587][106226] Updated weights for policy 0, policy_version 999889 (0.0007) [2023-12-28 02:26:33,590][106225] Updated weights for policy 1, policy_version 1002236 (0.0010) [2023-12-28 02:26:33,650][106226] Updated weights for policy 0, policy_version 999899 (0.0007) [2023-12-28 02:26:34,323][106225] Updated weights for policy 1, policy_version 1002246 (0.0008) [2023-12-28 02:26:34,391][106225] Updated weights for policy 1, policy_version 1002256 (0.0008) [2023-12-28 02:26:34,455][106225] Updated weights for policy 1, policy_version 1002266 (0.0008) [2023-12-28 02:26:34,458][106226] Updated weights for policy 0, policy_version 999909 (0.0008) [2023-12-28 02:26:34,524][106226] Updated weights for policy 0, policy_version 999919 (0.0008) [2023-12-28 02:26:34,586][106226] Updated weights for policy 0, policy_version 999929 (0.0008) [2023-12-28 02:26:35,303][106225] Updated weights for policy 1, policy_version 1002276 (0.0008) [2023-12-28 02:26:35,338][106226] Updated weights for policy 0, policy_version 999939 (0.0008) [2023-12-28 02:26:35,364][106225] Updated weights for policy 1, policy_version 1002286 (0.0006) [2023-12-28 02:26:35,403][106226] Updated weights for policy 0, policy_version 999949 (0.0006) [2023-12-28 02:26:35,420][106225] Updated weights for policy 1, policy_version 1002296 (0.0008) [2023-12-28 02:26:35,471][106226] Updated weights for policy 0, policy_version 999959 (0.0006) [2023-12-28 02:26:36,105][106226] Updated weights for policy 0, policy_version 999969 (0.0006) [2023-12-28 02:26:36,175][105115] Fps is (10 sec: 17203.2, 60 sec: 18841.6, 300 sec: 19660.8). Total num frames: 512679936. Throughput: 0: 9448.3, 1: 9185.8. Samples: 512694720. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:36,175][106226] Updated weights for policy 0, policy_version 999979 (0.0008) [2023-12-28 02:26:36,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-4.902')] [2023-12-28 02:26:36,230][106226] Updated weights for policy 0, policy_version 999989 (0.0008) [2023-12-28 02:26:36,291][106225] Updated weights for policy 1, policy_version 1002306 (0.0007) [2023-12-28 02:26:36,292][106226] Updated weights for policy 0, policy_version 999999 (0.0008) [2023-12-28 02:26:36,359][106225] Updated weights for policy 1, policy_version 1002316 (0.0008) [2023-12-28 02:26:36,420][106225] Updated weights for policy 1, policy_version 1002326 (0.0008) [2023-12-28 02:26:36,493][106225] Updated weights for policy 1, policy_version 1002336 (0.0008) [2023-12-28 02:26:37,108][106226] Updated weights for policy 0, policy_version 1000009 (0.0009) [2023-12-28 02:26:37,171][106226] Updated weights for policy 0, policy_version 1000019 (0.0009) [2023-12-28 02:26:37,235][106226] Updated weights for policy 0, policy_version 1000029 (0.0009) [2023-12-28 02:26:37,278][106225] Updated weights for policy 1, policy_version 1002346 (0.0006) [2023-12-28 02:26:37,339][106225] Updated weights for policy 1, policy_version 1002356 (0.0008) [2023-12-28 02:26:37,405][106225] Updated weights for policy 1, policy_version 1002366 (0.0008) [2023-12-28 02:26:37,943][106226] Updated weights for policy 0, policy_version 1000039 (0.0009) [2023-12-28 02:26:38,005][106226] Updated weights for policy 0, policy_version 1000049 (0.0008) [2023-12-28 02:26:38,070][106226] Updated weights for policy 0, policy_version 1000059 (0.0009) [2023-12-28 02:26:38,207][106225] Updated weights for policy 1, policy_version 1002376 (0.0008) [2023-12-28 02:26:38,269][106225] Updated weights for policy 1, policy_version 1002386 (0.0008) [2023-12-28 02:26:38,346][106225] Updated weights for policy 1, policy_version 1002396 (0.0008) [2023-12-28 02:26:38,887][106226] Updated weights for policy 0, policy_version 1000069 (0.0009) [2023-12-28 02:26:38,949][106226] Updated weights for policy 0, policy_version 1000079 (0.0008) [2023-12-28 02:26:39,012][106226] Updated weights for policy 0, policy_version 1000089 (0.0008) [2023-12-28 02:26:39,125][106225] Updated weights for policy 1, policy_version 1002406 (0.0009) [2023-12-28 02:26:39,179][106225] Updated weights for policy 1, policy_version 1002416 (0.0009) [2023-12-28 02:26:39,246][106225] Updated weights for policy 1, policy_version 1002426 (0.0008) [2023-12-28 02:26:39,934][106226] Updated weights for policy 0, policy_version 1000099 (0.0008) [2023-12-28 02:26:40,011][106226] Updated weights for policy 0, policy_version 1000109 (0.0007) [2023-12-28 02:26:40,071][106226] Updated weights for policy 0, policy_version 1000119 (0.0008) [2023-12-28 02:26:40,160][106225] Updated weights for policy 1, policy_version 1002436 (0.0007) [2023-12-28 02:26:40,226][106225] Updated weights for policy 1, policy_version 1002446 (0.0007) [2023-12-28 02:26:40,296][106225] Updated weights for policy 1, policy_version 1002456 (0.0007) [2023-12-28 02:26:40,930][106226] Updated weights for policy 0, policy_version 1000129 (0.0009) [2023-12-28 02:26:41,015][106226] Updated weights for policy 0, policy_version 1000139 (0.0010) [2023-12-28 02:26:41,074][106225] Updated weights for policy 1, policy_version 1002466 (0.0009) [2023-12-28 02:26:41,098][106226] Updated weights for policy 0, policy_version 1000149 (0.0008) [2023-12-28 02:26:41,139][106225] Updated weights for policy 1, policy_version 1002476 (0.0008) [2023-12-28 02:26:41,166][106226] Updated weights for policy 0, policy_version 1000159 (0.0007) [2023-12-28 02:26:41,175][105115] Fps is (10 sec: 17202.7, 60 sec: 18705.0, 300 sec: 19633.0). Total num frames: 512770048. Throughput: 0: 9368.6, 1: 9153.0. Samples: 512747036. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:41,176][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.762')] [2023-12-28 02:26:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001000160_256098304.pth... [2023-12-28 02:26:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000999104_255827968.pth [2023-12-28 02:26:41,208][106225] Updated weights for policy 1, policy_version 1002486 (0.0010) [2023-12-28 02:26:41,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001002496_256679936.pth... [2023-12-28 02:26:41,274][106225] Updated weights for policy 1, policy_version 1002496 (0.0010) [2023-12-28 02:26:41,278][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001001472_256417792.pth [2023-12-28 02:26:42,036][106226] Updated weights for policy 0, policy_version 1000169 (0.0008) [2023-12-28 02:26:42,081][106225] Updated weights for policy 1, policy_version 1002506 (0.0010) [2023-12-28 02:26:42,098][106226] Updated weights for policy 0, policy_version 1000179 (0.0006) [2023-12-28 02:26:42,133][106225] Updated weights for policy 1, policy_version 1002516 (0.0010) [2023-12-28 02:26:42,164][106226] Updated weights for policy 0, policy_version 1000189 (0.0006) [2023-12-28 02:26:42,195][106225] Updated weights for policy 1, policy_version 1002526 (0.0010) [2023-12-28 02:26:42,942][106226] Updated weights for policy 0, policy_version 1000199 (0.0007) [2023-12-28 02:26:42,997][106225] Updated weights for policy 1, policy_version 1002536 (0.0009) [2023-12-28 02:26:43,007][106226] Updated weights for policy 0, policy_version 1000209 (0.0006) [2023-12-28 02:26:43,055][106225] Updated weights for policy 1, policy_version 1002546 (0.0008) [2023-12-28 02:26:43,074][106226] Updated weights for policy 0, policy_version 1000219 (0.0008) [2023-12-28 02:26:43,112][106225] Updated weights for policy 1, policy_version 1002556 (0.0007) [2023-12-28 02:26:43,670][106226] Updated weights for policy 0, policy_version 1000229 (0.0006) [2023-12-28 02:26:43,726][106226] Updated weights for policy 0, policy_version 1000239 (0.0005) [2023-12-28 02:26:43,778][106226] Updated weights for policy 0, policy_version 1000249 (0.0005) [2023-12-28 02:26:43,847][106225] Updated weights for policy 1, policy_version 1002566 (0.0006) [2023-12-28 02:26:43,916][106225] Updated weights for policy 1, policy_version 1002576 (0.0008) [2023-12-28 02:26:43,979][106225] Updated weights for policy 1, policy_version 1002586 (0.0008) [2023-12-28 02:26:44,459][106226] Updated weights for policy 0, policy_version 1000259 (0.0008) [2023-12-28 02:26:44,526][106226] Updated weights for policy 0, policy_version 1000269 (0.0009) [2023-12-28 02:26:44,580][106226] Updated weights for policy 0, policy_version 1000279 (0.0008) [2023-12-28 02:26:44,782][106225] Updated weights for policy 1, policy_version 1002596 (0.0009) [2023-12-28 02:26:44,853][106225] Updated weights for policy 1, policy_version 1002606 (0.0008) [2023-12-28 02:26:44,916][106225] Updated weights for policy 1, policy_version 1002616 (0.0008) [2023-12-28 02:26:45,345][106226] Updated weights for policy 0, policy_version 1000289 (0.0009) [2023-12-28 02:26:45,419][106226] Updated weights for policy 0, policy_version 1000299 (0.0008) [2023-12-28 02:26:45,489][106226] Updated weights for policy 0, policy_version 1000309 (0.0009) [2023-12-28 02:26:45,563][106226] Updated weights for policy 0, policy_version 1000319 (0.0010) [2023-12-28 02:26:45,718][106225] Updated weights for policy 1, policy_version 1002626 (0.0008) [2023-12-28 02:26:45,779][106225] Updated weights for policy 1, policy_version 1002636 (0.0005) [2023-12-28 02:26:45,845][106225] Updated weights for policy 1, policy_version 1002646 (0.0006) [2023-12-28 02:26:45,904][106225] Updated weights for policy 1, policy_version 1002656 (0.0008) [2023-12-28 02:26:46,175][105115] Fps is (10 sec: 18022.5, 60 sec: 18568.5, 300 sec: 19605.3). Total num frames: 512860160. Throughput: 0: 9126.7, 1: 8970.0. Samples: 512852400. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:46,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.785')] [2023-12-28 02:26:46,371][106226] Updated weights for policy 0, policy_version 1000329 (0.0008) [2023-12-28 02:26:46,435][106226] Updated weights for policy 0, policy_version 1000339 (0.0008) [2023-12-28 02:26:46,499][106226] Updated weights for policy 0, policy_version 1000349 (0.0007) [2023-12-28 02:26:46,513][106225] Updated weights for policy 1, policy_version 1002666 (0.0008) [2023-12-28 02:26:46,562][106225] Updated weights for policy 1, policy_version 1002676 (0.0009) [2023-12-28 02:26:46,616][106225] Updated weights for policy 1, policy_version 1002686 (0.0008) [2023-12-28 02:26:47,106][106226] Updated weights for policy 0, policy_version 1000359 (0.0006) [2023-12-28 02:26:47,168][106226] Updated weights for policy 0, policy_version 1000369 (0.0009) [2023-12-28 02:26:47,227][106226] Updated weights for policy 0, policy_version 1000379 (0.0008) [2023-12-28 02:26:47,420][106225] Updated weights for policy 1, policy_version 1002696 (0.0008) [2023-12-28 02:26:47,479][106225] Updated weights for policy 1, policy_version 1002706 (0.0008) [2023-12-28 02:26:47,547][106225] Updated weights for policy 1, policy_version 1002716 (0.0009) [2023-12-28 02:26:47,920][106226] Updated weights for policy 0, policy_version 1000389 (0.0007) [2023-12-28 02:26:47,977][106226] Updated weights for policy 0, policy_version 1000399 (0.0007) [2023-12-28 02:26:48,038][106226] Updated weights for policy 0, policy_version 1000409 (0.0009) [2023-12-28 02:26:48,310][106225] Updated weights for policy 1, policy_version 1002726 (0.0009) [2023-12-28 02:26:48,380][106225] Updated weights for policy 1, policy_version 1002736 (0.0009) [2023-12-28 02:26:48,451][106225] Updated weights for policy 1, policy_version 1002746 (0.0008) [2023-12-28 02:26:48,870][106226] Updated weights for policy 0, policy_version 1000419 (0.0009) [2023-12-28 02:26:48,935][106226] Updated weights for policy 0, policy_version 1000429 (0.0007) [2023-12-28 02:26:49,006][106226] Updated weights for policy 0, policy_version 1000439 (0.0008) [2023-12-28 02:26:49,203][106225] Updated weights for policy 1, policy_version 1002756 (0.0009) [2023-12-28 02:26:49,279][106225] Updated weights for policy 1, policy_version 1002766 (0.0008) [2023-12-28 02:26:49,344][106225] Updated weights for policy 1, policy_version 1002776 (0.0009) [2023-12-28 02:26:49,978][106226] Updated weights for policy 0, policy_version 1000449 (0.0010) [2023-12-28 02:26:50,052][106226] Updated weights for policy 0, policy_version 1000459 (0.0010) [2023-12-28 02:26:50,122][106226] Updated weights for policy 0, policy_version 1000469 (0.0011) [2023-12-28 02:26:50,187][106226] Updated weights for policy 0, policy_version 1000479 (0.0012) [2023-12-28 02:26:50,256][106225] Updated weights for policy 1, policy_version 1002786 (0.0009) [2023-12-28 02:26:50,309][106225] Updated weights for policy 1, policy_version 1002796 (0.0010) [2023-12-28 02:26:50,378][106225] Updated weights for policy 1, policy_version 1002806 (0.0008) [2023-12-28 02:26:50,436][106225] Updated weights for policy 1, policy_version 1002816 (0.0009) [2023-12-28 02:26:51,169][106226] Updated weights for policy 0, policy_version 1000489 (0.0008) [2023-12-28 02:26:51,175][105115] Fps is (10 sec: 17203.4, 60 sec: 18295.4, 300 sec: 19549.7). Total num frames: 512942080. Throughput: 0: 8902.6, 1: 8847.4. Samples: 512957656. Policy #0 lag: (min: 31.0, avg: 31.1, max: 39.0) [2023-12-28 02:26:51,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.886')] [2023-12-28 02:26:51,238][106226] Updated weights for policy 0, policy_version 1000499 (0.0009) [2023-12-28 02:26:51,309][106226] Updated weights for policy 0, policy_version 1000509 (0.0008) [2023-12-28 02:26:51,418][106225] Updated weights for policy 1, policy_version 1002826 (0.0009) [2023-12-28 02:26:51,488][106225] Updated weights for policy 1, policy_version 1002836 (0.0008) [2023-12-28 02:26:51,564][106225] Updated weights for policy 1, policy_version 1002846 (0.0009) [2023-12-28 02:26:52,246][106226] Updated weights for policy 0, policy_version 1000519 (0.0008) [2023-12-28 02:26:52,310][106226] Updated weights for policy 0, policy_version 1000529 (0.0007) [2023-12-28 02:26:52,383][106226] Updated weights for policy 0, policy_version 1000539 (0.0008) [2023-12-28 02:26:52,422][106225] Updated weights for policy 1, policy_version 1002856 (0.0006) [2023-12-28 02:26:52,486][106225] Updated weights for policy 1, policy_version 1002866 (0.0008) [2023-12-28 02:26:52,556][106225] Updated weights for policy 1, policy_version 1002876 (0.0006) [2023-12-28 02:26:53,141][106226] Updated weights for policy 0, policy_version 1000549 (0.0008) [2023-12-28 02:26:53,171][106225] Updated weights for policy 1, policy_version 1002886 (0.0007) [2023-12-28 02:26:53,195][106226] Updated weights for policy 0, policy_version 1000559 (0.0008) [2023-12-28 02:26:53,225][106225] Updated weights for policy 1, policy_version 1002896 (0.0007) [2023-12-28 02:26:53,256][106226] Updated weights for policy 0, policy_version 1000569 (0.0008) [2023-12-28 02:26:53,285][106225] Updated weights for policy 1, policy_version 1002906 (0.0007) [2023-12-28 02:26:53,929][106226] Updated weights for policy 0, policy_version 1000579 (0.0009) [2023-12-28 02:26:53,967][106225] Updated weights for policy 1, policy_version 1002916 (0.0008) [2023-12-28 02:26:53,987][106226] Updated weights for policy 0, policy_version 1000589 (0.0010) [2023-12-28 02:26:54,035][106225] Updated weights for policy 1, policy_version 1002926 (0.0005) [2023-12-28 02:26:54,043][106226] Updated weights for policy 0, policy_version 1000599 (0.0010) [2023-12-28 02:26:54,096][106225] Updated weights for policy 1, policy_version 1002936 (0.0006) [2023-12-28 02:26:54,686][106226] Updated weights for policy 0, policy_version 1000609 (0.0010) [2023-12-28 02:26:54,755][106226] Updated weights for policy 0, policy_version 1000619 (0.0011) [2023-12-28 02:26:54,809][106226] Updated weights for policy 0, policy_version 1000629 (0.0010) [2023-12-28 02:26:54,813][106225] Updated weights for policy 1, policy_version 1002946 (0.0008) [2023-12-28 02:26:54,859][106226] Updated weights for policy 0, policy_version 1000639 (0.0010) [2023-12-28 02:26:54,861][106225] Updated weights for policy 1, policy_version 1002956 (0.0005) [2023-12-28 02:26:54,917][106225] Updated weights for policy 1, policy_version 1002966 (0.0008) [2023-12-28 02:26:54,982][106225] Updated weights for policy 1, policy_version 1002976 (0.0007) [2023-12-28 02:26:55,440][106226] Updated weights for policy 0, policy_version 1000649 (0.0009) [2023-12-28 02:26:55,494][106226] Updated weights for policy 0, policy_version 1000659 (0.0011) [2023-12-28 02:26:55,546][106226] Updated weights for policy 0, policy_version 1000669 (0.0010) [2023-12-28 02:26:55,760][106225] Updated weights for policy 1, policy_version 1002986 (0.0005) [2023-12-28 02:26:55,831][106225] Updated weights for policy 1, policy_version 1002996 (0.0006) [2023-12-28 02:26:55,894][106225] Updated weights for policy 1, policy_version 1003006 (0.0008) [2023-12-28 02:26:56,154][106226] Updated weights for policy 0, policy_version 1000679 (0.0009) [2023-12-28 02:26:56,175][105115] Fps is (10 sec: 18022.4, 60 sec: 18159.0, 300 sec: 19522.0). Total num frames: 513040384. Throughput: 0: 8849.6, 1: 8779.7. Samples: 513011272. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:26:56,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.922')] [2023-12-28 02:26:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001003008_256811008.pth... [2023-12-28 02:26:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001001984_256548864.pth [2023-12-28 02:26:56,217][106226] Updated weights for policy 0, policy_version 1000689 (0.0006) [2023-12-28 02:26:56,281][106226] Updated weights for policy 0, policy_version 1000699 (0.0011) [2023-12-28 02:26:56,306][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001000704_256237568.pth... [2023-12-28 02:26:56,310][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_000999648_255967232.pth [2023-12-28 02:26:56,601][106225] Updated weights for policy 1, policy_version 1003017 (0.0009) [2023-12-28 02:26:56,649][106225] Updated weights for policy 1, policy_version 1003027 (0.0008) [2023-12-28 02:26:56,694][106225] Updated weights for policy 1, policy_version 1003037 (0.0009) [2023-12-28 02:26:56,919][106226] Updated weights for policy 0, policy_version 1000709 (0.0010) [2023-12-28 02:26:56,967][106226] Updated weights for policy 0, policy_version 1000719 (0.0008) [2023-12-28 02:26:57,032][106226] Updated weights for policy 0, policy_version 1000729 (0.0009) [2023-12-28 02:26:57,377][106225] Updated weights for policy 1, policy_version 1003047 (0.0009) [2023-12-28 02:26:57,433][106225] Updated weights for policy 1, policy_version 1003057 (0.0009) [2023-12-28 02:26:57,488][106225] Updated weights for policy 1, policy_version 1003067 (0.0008) [2023-12-28 02:26:57,810][106226] Updated weights for policy 0, policy_version 1000739 (0.0010) [2023-12-28 02:26:57,861][106226] Updated weights for policy 0, policy_version 1000749 (0.0008) [2023-12-28 02:26:57,921][106226] Updated weights for policy 0, policy_version 1000759 (0.0009) [2023-12-28 02:26:58,156][106225] Updated weights for policy 1, policy_version 1003077 (0.0008) [2023-12-28 02:26:58,213][106225] Updated weights for policy 1, policy_version 1003087 (0.0009) [2023-12-28 02:26:58,283][106225] Updated weights for policy 1, policy_version 1003097 (0.0008) [2023-12-28 02:26:58,640][106226] Updated weights for policy 0, policy_version 1000769 (0.0008) [2023-12-28 02:26:58,708][106226] Updated weights for policy 0, policy_version 1000779 (0.0011) [2023-12-28 02:26:58,779][106226] Updated weights for policy 0, policy_version 1000789 (0.0008) [2023-12-28 02:26:58,840][106226] Updated weights for policy 0, policy_version 1000799 (0.0009) [2023-12-28 02:26:59,111][106225] Updated weights for policy 1, policy_version 1003107 (0.0008) [2023-12-28 02:26:59,176][106225] Updated weights for policy 1, policy_version 1003117 (0.0008) [2023-12-28 02:26:59,247][106225] Updated weights for policy 1, policy_version 1003127 (0.0007) [2023-12-28 02:26:59,691][106226] Updated weights for policy 0, policy_version 1000809 (0.0010) [2023-12-28 02:26:59,748][106226] Updated weights for policy 0, policy_version 1000819 (0.0010) [2023-12-28 02:26:59,820][106226] Updated weights for policy 0, policy_version 1000829 (0.0011) [2023-12-28 02:26:59,906][106225] Updated weights for policy 1, policy_version 1003137 (0.0008) [2023-12-28 02:26:59,971][106225] Updated weights for policy 1, policy_version 1003147 (0.0007) [2023-12-28 02:27:00,029][106225] Updated weights for policy 1, policy_version 1003157 (0.0005) [2023-12-28 02:27:00,095][106225] Updated weights for policy 1, policy_version 1003167 (0.0007) [2023-12-28 02:27:00,517][106226] Updated weights for policy 0, policy_version 1000839 (0.0010) [2023-12-28 02:27:00,573][106226] Updated weights for policy 0, policy_version 1000849 (0.0008) [2023-12-28 02:27:00,629][106226] Updated weights for policy 0, policy_version 1000859 (0.0008) [2023-12-28 02:27:00,630][106225] Updated weights for policy 1, policy_version 1003177 (0.0007) [2023-12-28 02:27:00,672][106225] Updated weights for policy 1, policy_version 1003187 (0.0005) [2023-12-28 02:27:00,717][106225] Updated weights for policy 1, policy_version 1003197 (0.0005) [2023-12-28 02:27:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 18158.9, 300 sec: 19549.7). Total num frames: 513138688. Throughput: 0: 9047.4, 1: 8885.5. Samples: 513128976. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:01,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-4.557')] [2023-12-28 02:27:01,372][106225] Updated weights for policy 1, policy_version 1003207 (0.0007) [2023-12-28 02:27:01,380][106226] Updated weights for policy 0, policy_version 1000869 (0.0008) [2023-12-28 02:27:01,428][106225] Updated weights for policy 1, policy_version 1003217 (0.0008) [2023-12-28 02:27:01,443][106226] Updated weights for policy 0, policy_version 1000879 (0.0008) [2023-12-28 02:27:01,472][106225] Updated weights for policy 1, policy_version 1003227 (0.0008) [2023-12-28 02:27:01,501][106226] Updated weights for policy 0, policy_version 1000889 (0.0009) [2023-12-28 02:27:02,149][106226] Updated weights for policy 0, policy_version 1000899 (0.0009) [2023-12-28 02:27:02,210][106226] Updated weights for policy 0, policy_version 1000909 (0.0008) [2023-12-28 02:27:02,244][106225] Updated weights for policy 1, policy_version 1003237 (0.0006) [2023-12-28 02:27:02,273][106226] Updated weights for policy 0, policy_version 1000919 (0.0007) [2023-12-28 02:27:02,299][106225] Updated weights for policy 1, policy_version 1003247 (0.0007) [2023-12-28 02:27:02,370][106225] Updated weights for policy 1, policy_version 1003257 (0.0008) [2023-12-28 02:27:02,977][106226] Updated weights for policy 0, policy_version 1000929 (0.0006) [2023-12-28 02:27:03,039][106226] Updated weights for policy 0, policy_version 1000939 (0.0009) [2023-12-28 02:27:03,099][106226] Updated weights for policy 0, policy_version 1000949 (0.0008) [2023-12-28 02:27:03,111][106225] Updated weights for policy 1, policy_version 1003267 (0.0008) [2023-12-28 02:27:03,156][106226] Updated weights for policy 0, policy_version 1000959 (0.0007) [2023-12-28 02:27:03,162][106225] Updated weights for policy 1, policy_version 1003277 (0.0006) [2023-12-28 02:27:03,221][106225] Updated weights for policy 1, policy_version 1003287 (0.0008) [2023-12-28 02:27:03,833][106226] Updated weights for policy 0, policy_version 1000969 (0.0009) [2023-12-28 02:27:03,899][106226] Updated weights for policy 0, policy_version 1000980 (0.0007) [2023-12-28 02:27:03,959][106226] Updated weights for policy 0, policy_version 1000990 (0.0006) [2023-12-28 02:27:03,960][106225] Updated weights for policy 1, policy_version 1003297 (0.0008) [2023-12-28 02:27:04,015][106225] Updated weights for policy 1, policy_version 1003307 (0.0008) [2023-12-28 02:27:04,067][106225] Updated weights for policy 1, policy_version 1003317 (0.0008) [2023-12-28 02:27:04,126][106225] Updated weights for policy 1, policy_version 1003327 (0.0007) [2023-12-28 02:27:04,713][106226] Updated weights for policy 0, policy_version 1001000 (0.0006) [2023-12-28 02:27:04,779][106226] Updated weights for policy 0, policy_version 1001010 (0.0006) [2023-12-28 02:27:04,831][106225] Updated weights for policy 1, policy_version 1003337 (0.0008) [2023-12-28 02:27:04,837][106226] Updated weights for policy 0, policy_version 1001020 (0.0007) [2023-12-28 02:27:04,880][106225] Updated weights for policy 1, policy_version 1003347 (0.0005) [2023-12-28 02:27:04,931][106225] Updated weights for policy 1, policy_version 1003357 (0.0009) [2023-12-28 02:27:05,488][106226] Updated weights for policy 0, policy_version 1001030 (0.0009) [2023-12-28 02:27:05,554][106226] Updated weights for policy 0, policy_version 1001040 (0.0009) [2023-12-28 02:27:05,585][106225] Updated weights for policy 1, policy_version 1003367 (0.0010) [2023-12-28 02:27:05,611][106226] Updated weights for policy 0, policy_version 1001050 (0.0010) [2023-12-28 02:27:05,645][106225] Updated weights for policy 1, policy_version 1003377 (0.0010) [2023-12-28 02:27:05,695][106225] Updated weights for policy 1, policy_version 1003387 (0.0005) [2023-12-28 02:27:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 18158.9, 300 sec: 19549.7). Total num frames: 513236992. Throughput: 0: 9152.7, 1: 9013.2. Samples: 513250484. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:06,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.994')] [2023-12-28 02:27:06,184][106226] Updated weights for policy 0, policy_version 1001060 (0.0010) [2023-12-28 02:27:06,255][106226] Updated weights for policy 0, policy_version 1001070 (0.0008) [2023-12-28 02:27:06,324][106226] Updated weights for policy 0, policy_version 1001080 (0.0009) [2023-12-28 02:27:06,369][106225] Updated weights for policy 1, policy_version 1003397 (0.0006) [2023-12-28 02:27:06,434][106225] Updated weights for policy 1, policy_version 1003407 (0.0008) [2023-12-28 02:27:06,498][106225] Updated weights for policy 1, policy_version 1003417 (0.0007) [2023-12-28 02:27:07,121][106225] Updated weights for policy 1, policy_version 1003427 (0.0008) [2023-12-28 02:27:07,121][106226] Updated weights for policy 0, policy_version 1001090 (0.0007) [2023-12-28 02:27:07,181][106226] Updated weights for policy 0, policy_version 1001100 (0.0008) [2023-12-28 02:27:07,185][106225] Updated weights for policy 1, policy_version 1003437 (0.0009) [2023-12-28 02:27:07,243][106226] Updated weights for policy 0, policy_version 1001110 (0.0007) [2023-12-28 02:27:07,255][106225] Updated weights for policy 1, policy_version 1003447 (0.0008) [2023-12-28 02:27:07,296][106226] Updated weights for policy 0, policy_version 1001120 (0.0008) [2023-12-28 02:27:07,802][106225] Updated weights for policy 1, policy_version 1003457 (0.0006) [2023-12-28 02:27:07,867][106225] Updated weights for policy 1, policy_version 1003467 (0.0008) [2023-12-28 02:27:07,882][106226] Updated weights for policy 0, policy_version 1001130 (0.0006) [2023-12-28 02:27:07,921][106225] Updated weights for policy 1, policy_version 1003477 (0.0008) [2023-12-28 02:27:07,943][106226] Updated weights for policy 0, policy_version 1001140 (0.0008) [2023-12-28 02:27:07,982][106225] Updated weights for policy 1, policy_version 1003487 (0.0006) [2023-12-28 02:27:07,999][106226] Updated weights for policy 0, policy_version 1001150 (0.0008) [2023-12-28 02:27:08,626][106225] Updated weights for policy 1, policy_version 1003497 (0.0005) [2023-12-28 02:27:08,684][106225] Updated weights for policy 1, policy_version 1003507 (0.0006) [2023-12-28 02:27:08,700][106226] Updated weights for policy 0, policy_version 1001160 (0.0010) [2023-12-28 02:27:08,745][106225] Updated weights for policy 1, policy_version 1003517 (0.0006) [2023-12-28 02:27:08,761][106226] Updated weights for policy 0, policy_version 1001170 (0.0011) [2023-12-28 02:27:08,816][106226] Updated weights for policy 0, policy_version 1001180 (0.0007) [2023-12-28 02:27:09,406][106226] Updated weights for policy 0, policy_version 1001190 (0.0009) [2023-12-28 02:27:09,471][106226] Updated weights for policy 0, policy_version 1001200 (0.0008) [2023-12-28 02:27:09,507][106225] Updated weights for policy 1, policy_version 1003527 (0.0009) [2023-12-28 02:27:09,530][106226] Updated weights for policy 0, policy_version 1001210 (0.0010) [2023-12-28 02:27:09,569][106225] Updated weights for policy 1, policy_version 1003537 (0.0009) [2023-12-28 02:27:09,624][106225] Updated weights for policy 1, policy_version 1003547 (0.0008) [2023-12-28 02:27:10,301][106226] Updated weights for policy 0, policy_version 1001220 (0.0010) [2023-12-28 02:27:10,316][106225] Updated weights for policy 1, policy_version 1003557 (0.0008) [2023-12-28 02:27:10,361][106226] Updated weights for policy 0, policy_version 1001230 (0.0009) [2023-12-28 02:27:10,374][106225] Updated weights for policy 1, policy_version 1003567 (0.0006) [2023-12-28 02:27:10,419][106226] Updated weights for policy 0, policy_version 1001240 (0.0007) [2023-12-28 02:27:10,433][106225] Updated weights for policy 1, policy_version 1003577 (0.0008) [2023-12-28 02:27:11,150][106226] Updated weights for policy 0, policy_version 1001250 (0.0007) [2023-12-28 02:27:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 18158.9, 300 sec: 19549.7). Total num frames: 513335296. Throughput: 0: 9237.3, 1: 9182.9. Samples: 513313680. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:11,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-4.929')] [2023-12-28 02:27:11,185][106225] Updated weights for policy 1, policy_version 1003587 (0.0007) [2023-12-28 02:27:11,219][106226] Updated weights for policy 0, policy_version 1001260 (0.0008) [2023-12-28 02:27:11,256][106225] Updated weights for policy 1, policy_version 1003597 (0.0007) [2023-12-28 02:27:11,286][106226] Updated weights for policy 0, policy_version 1001270 (0.0008) [2023-12-28 02:27:11,312][106225] Updated weights for policy 1, policy_version 1003607 (0.0007) [2023-12-28 02:27:11,349][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001001280_256385024.pth... [2023-12-28 02:27:11,351][106226] Updated weights for policy 0, policy_version 1001280 (0.0006) [2023-12-28 02:27:11,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001000160_256098304.pth [2023-12-28 02:27:11,368][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001003616_256966656.pth... [2023-12-28 02:27:11,373][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001002496_256679936.pth [2023-12-28 02:27:12,043][106225] Updated weights for policy 1, policy_version 1003617 (0.0008) [2023-12-28 02:27:12,097][106225] Updated weights for policy 1, policy_version 1003627 (0.0006) [2023-12-28 02:27:12,119][106226] Updated weights for policy 0, policy_version 1001290 (0.0008) [2023-12-28 02:27:12,151][106225] Updated weights for policy 1, policy_version 1003637 (0.0006) [2023-12-28 02:27:12,185][106226] Updated weights for policy 0, policy_version 1001300 (0.0006) [2023-12-28 02:27:12,206][106225] Updated weights for policy 1, policy_version 1003647 (0.0007) [2023-12-28 02:27:12,250][106226] Updated weights for policy 0, policy_version 1001310 (0.0007) [2023-12-28 02:27:12,920][106226] Updated weights for policy 0, policy_version 1001320 (0.0010) [2023-12-28 02:27:12,981][106225] Updated weights for policy 1, policy_version 1003657 (0.0009) [2023-12-28 02:27:12,982][106226] Updated weights for policy 0, policy_version 1001330 (0.0010) [2023-12-28 02:27:13,036][106226] Updated weights for policy 0, policy_version 1001340 (0.0010) [2023-12-28 02:27:13,042][106225] Updated weights for policy 1, policy_version 1003667 (0.0006) [2023-12-28 02:27:13,102][106225] Updated weights for policy 1, policy_version 1003677 (0.0007) [2023-12-28 02:27:13,749][106226] Updated weights for policy 0, policy_version 1001350 (0.0007) [2023-12-28 02:27:13,805][106226] Updated weights for policy 0, policy_version 1001360 (0.0007) [2023-12-28 02:27:13,812][106225] Updated weights for policy 1, policy_version 1003687 (0.0008) [2023-12-28 02:27:13,855][106226] Updated weights for policy 0, policy_version 1001370 (0.0007) [2023-12-28 02:27:13,868][106225] Updated weights for policy 1, policy_version 1003697 (0.0007) [2023-12-28 02:27:13,922][106225] Updated weights for policy 1, policy_version 1003707 (0.0007) [2023-12-28 02:27:14,581][106226] Updated weights for policy 0, policy_version 1001380 (0.0005) [2023-12-28 02:27:14,584][106225] Updated weights for policy 1, policy_version 1003717 (0.0006) [2023-12-28 02:27:14,637][106225] Updated weights for policy 1, policy_version 1003727 (0.0007) [2023-12-28 02:27:14,643][106226] Updated weights for policy 0, policy_version 1001390 (0.0006) [2023-12-28 02:27:14,694][106225] Updated weights for policy 1, policy_version 1003737 (0.0005) [2023-12-28 02:27:14,702][106226] Updated weights for policy 0, policy_version 1001400 (0.0005) [2023-12-28 02:27:15,380][106226] Updated weights for policy 0, policy_version 1001410 (0.0008) [2023-12-28 02:27:15,415][106225] Updated weights for policy 1, policy_version 1003747 (0.0006) [2023-12-28 02:27:15,438][106226] Updated weights for policy 0, policy_version 1001420 (0.0007) [2023-12-28 02:27:15,468][106225] Updated weights for policy 1, policy_version 1003757 (0.0006) [2023-12-28 02:27:15,495][106226] Updated weights for policy 0, policy_version 1001430 (0.0005) [2023-12-28 02:27:15,520][106225] Updated weights for policy 1, policy_version 1003767 (0.0008) [2023-12-28 02:27:15,550][106226] Updated weights for policy 0, policy_version 1001440 (0.0005) [2023-12-28 02:27:16,137][106225] Updated weights for policy 1, policy_version 1003777 (0.0006) [2023-12-28 02:27:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 18432.0, 300 sec: 19522.0). Total num frames: 513433600. Throughput: 0: 9364.9, 1: 9311.6. Samples: 513428608. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:16,175][105115] Avg episode reward: [(0, '-4.668'), (1, '-4.843')] [2023-12-28 02:27:16,192][106225] Updated weights for policy 1, policy_version 1003787 (0.0006) [2023-12-28 02:27:16,205][106226] Updated weights for policy 0, policy_version 1001450 (0.0007) [2023-12-28 02:27:16,240][106225] Updated weights for policy 1, policy_version 1003797 (0.0008) [2023-12-28 02:27:16,253][106226] Updated weights for policy 0, policy_version 1001460 (0.0005) [2023-12-28 02:27:16,288][106225] Updated weights for policy 1, policy_version 1003807 (0.0009) [2023-12-28 02:27:16,303][106226] Updated weights for policy 0, policy_version 1001470 (0.0006) [2023-12-28 02:27:16,968][106225] Updated weights for policy 1, policy_version 1003817 (0.0007) [2023-12-28 02:27:17,017][106225] Updated weights for policy 1, policy_version 1003827 (0.0007) [2023-12-28 02:27:17,058][106226] Updated weights for policy 0, policy_version 1001480 (0.0008) [2023-12-28 02:27:17,064][106225] Updated weights for policy 1, policy_version 1003837 (0.0005) [2023-12-28 02:27:17,109][106226] Updated weights for policy 0, policy_version 1001490 (0.0007) [2023-12-28 02:27:17,157][106226] Updated weights for policy 0, policy_version 1001500 (0.0008) [2023-12-28 02:27:17,675][106225] Updated weights for policy 1, policy_version 1003847 (0.0009) [2023-12-28 02:27:17,726][106225] Updated weights for policy 1, policy_version 1003857 (0.0009) [2023-12-28 02:27:17,777][106225] Updated weights for policy 1, policy_version 1003867 (0.0005) [2023-12-28 02:27:17,976][106226] Updated weights for policy 0, policy_version 1001510 (0.0009) [2023-12-28 02:27:18,047][106226] Updated weights for policy 0, policy_version 1001520 (0.0008) [2023-12-28 02:27:18,116][106226] Updated weights for policy 0, policy_version 1001530 (0.0009) [2023-12-28 02:27:18,391][106225] Updated weights for policy 1, policy_version 1003877 (0.0007) [2023-12-28 02:27:18,450][106225] Updated weights for policy 1, policy_version 1003887 (0.0008) [2023-12-28 02:27:18,509][106225] Updated weights for policy 1, policy_version 1003897 (0.0008) [2023-12-28 02:27:18,849][106226] Updated weights for policy 0, policy_version 1001540 (0.0009) [2023-12-28 02:27:18,906][106226] Updated weights for policy 0, policy_version 1001550 (0.0008) [2023-12-28 02:27:18,968][106226] Updated weights for policy 0, policy_version 1001560 (0.0009) [2023-12-28 02:27:19,223][106225] Updated weights for policy 1, policy_version 1003907 (0.0008) [2023-12-28 02:27:19,286][106225] Updated weights for policy 1, policy_version 1003917 (0.0008) [2023-12-28 02:27:19,353][106225] Updated weights for policy 1, policy_version 1003927 (0.0010) [2023-12-28 02:27:19,771][106226] Updated weights for policy 0, policy_version 1001570 (0.0008) [2023-12-28 02:27:19,835][106226] Updated weights for policy 0, policy_version 1001580 (0.0009) [2023-12-28 02:27:19,903][106226] Updated weights for policy 0, policy_version 1001590 (0.0009) [2023-12-28 02:27:19,967][106226] Updated weights for policy 0, policy_version 1001600 (0.0008) [2023-12-28 02:27:20,039][106225] Updated weights for policy 1, policy_version 1003937 (0.0008) [2023-12-28 02:27:20,102][106225] Updated weights for policy 1, policy_version 1003947 (0.0008) [2023-12-28 02:27:20,162][106225] Updated weights for policy 1, policy_version 1003957 (0.0008) [2023-12-28 02:27:20,225][106225] Updated weights for policy 1, policy_version 1003967 (0.0009) [2023-12-28 02:27:20,800][106226] Updated weights for policy 0, policy_version 1001610 (0.0009) [2023-12-28 02:27:20,872][106226] Updated weights for policy 0, policy_version 1001620 (0.0009) [2023-12-28 02:27:20,932][106225] Updated weights for policy 1, policy_version 1003977 (0.0007) [2023-12-28 02:27:20,934][106226] Updated weights for policy 0, policy_version 1001630 (0.0008) [2023-12-28 02:27:20,992][106225] Updated weights for policy 1, policy_version 1003987 (0.0007) [2023-12-28 02:27:21,058][106225] Updated weights for policy 1, policy_version 1003997 (0.0009) [2023-12-28 02:27:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 18568.5, 300 sec: 19549.7). Total num frames: 513540096. Throughput: 0: 9363.4, 1: 9555.9. Samples: 513546088. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:21,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-5.114')] [2023-12-28 02:27:21,679][106226] Updated weights for policy 0, policy_version 1001640 (0.0008) [2023-12-28 02:27:21,739][106226] Updated weights for policy 0, policy_version 1001650 (0.0009) [2023-12-28 02:27:21,808][106226] Updated weights for policy 0, policy_version 1001660 (0.0008) [2023-12-28 02:27:21,856][106225] Updated weights for policy 1, policy_version 1004007 (0.0007) [2023-12-28 02:27:21,917][106225] Updated weights for policy 1, policy_version 1004017 (0.0007) [2023-12-28 02:27:21,982][106225] Updated weights for policy 1, policy_version 1004027 (0.0007) [2023-12-28 02:27:22,562][106225] Updated weights for policy 1, policy_version 1004037 (0.0007) [2023-12-28 02:27:22,599][106226] Updated weights for policy 0, policy_version 1001670 (0.0007) [2023-12-28 02:27:22,624][106225] Updated weights for policy 1, policy_version 1004047 (0.0007) [2023-12-28 02:27:22,651][106226] Updated weights for policy 0, policy_version 1001680 (0.0008) [2023-12-28 02:27:22,687][106225] Updated weights for policy 1, policy_version 1004057 (0.0006) [2023-12-28 02:27:22,713][106226] Updated weights for policy 0, policy_version 1001690 (0.0009) [2023-12-28 02:27:23,369][106225] Updated weights for policy 1, policy_version 1004067 (0.0008) [2023-12-28 02:27:23,427][106225] Updated weights for policy 1, policy_version 1004077 (0.0009) [2023-12-28 02:27:23,457][106226] Updated weights for policy 0, policy_version 1001700 (0.0007) [2023-12-28 02:27:23,492][106225] Updated weights for policy 1, policy_version 1004087 (0.0006) [2023-12-28 02:27:23,515][106226] Updated weights for policy 0, policy_version 1001710 (0.0007) [2023-12-28 02:27:23,562][106226] Updated weights for policy 0, policy_version 1001720 (0.0007) [2023-12-28 02:27:24,201][106226] Updated weights for policy 0, policy_version 1001730 (0.0008) [2023-12-28 02:27:24,217][106225] Updated weights for policy 1, policy_version 1004097 (0.0008) [2023-12-28 02:27:24,253][106226] Updated weights for policy 0, policy_version 1001740 (0.0006) [2023-12-28 02:27:24,282][106225] Updated weights for policy 1, policy_version 1004107 (0.0007) [2023-12-28 02:27:24,310][106226] Updated weights for policy 0, policy_version 1001750 (0.0005) [2023-12-28 02:27:24,346][106225] Updated weights for policy 1, policy_version 1004117 (0.0008) [2023-12-28 02:27:24,373][106226] Updated weights for policy 0, policy_version 1001760 (0.0006) [2023-12-28 02:27:24,402][106225] Updated weights for policy 1, policy_version 1004127 (0.0010) [2023-12-28 02:27:24,932][106226] Updated weights for policy 0, policy_version 1001770 (0.0005) [2023-12-28 02:27:24,969][106225] Updated weights for policy 1, policy_version 1004137 (0.0006) [2023-12-28 02:27:24,997][106226] Updated weights for policy 0, policy_version 1001780 (0.0006) [2023-12-28 02:27:25,022][106225] Updated weights for policy 1, policy_version 1004147 (0.0010) [2023-12-28 02:27:25,058][106226] Updated weights for policy 0, policy_version 1001790 (0.0005) [2023-12-28 02:27:25,076][106225] Updated weights for policy 1, policy_version 1004157 (0.0010) [2023-12-28 02:27:25,680][106226] Updated weights for policy 0, policy_version 1001800 (0.0007) [2023-12-28 02:27:25,742][106226] Updated weights for policy 0, policy_version 1001810 (0.0008) [2023-12-28 02:27:25,760][106225] Updated weights for policy 1, policy_version 1004167 (0.0010) [2023-12-28 02:27:25,799][106226] Updated weights for policy 0, policy_version 1001820 (0.0007) [2023-12-28 02:27:25,820][106225] Updated weights for policy 1, policy_version 1004177 (0.0010) [2023-12-28 02:27:25,876][106225] Updated weights for policy 1, policy_version 1004187 (0.0010) [2023-12-28 02:27:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 18841.6, 300 sec: 19522.0). Total num frames: 513638400. Throughput: 0: 9419.3, 1: 9620.6. Samples: 513603828. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:26,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.960')] [2023-12-28 02:27:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001004192_257114112.pth... [2023-12-28 02:27:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001001824_256524288.pth... [2023-12-28 02:27:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001000704_256237568.pth [2023-12-28 02:27:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001003008_256811008.pth [2023-12-28 02:27:26,392][106226] Updated weights for policy 0, policy_version 1001830 (0.0007) [2023-12-28 02:27:26,462][106226] Updated weights for policy 0, policy_version 1001840 (0.0008) [2023-12-28 02:27:26,526][106226] Updated weights for policy 0, policy_version 1001850 (0.0008) [2023-12-28 02:27:26,610][106225] Updated weights for policy 1, policy_version 1004197 (0.0009) [2023-12-28 02:27:26,672][106225] Updated weights for policy 1, policy_version 1004207 (0.0006) [2023-12-28 02:27:26,732][106225] Updated weights for policy 1, policy_version 1004217 (0.0010) [2023-12-28 02:27:27,251][106226] Updated weights for policy 0, policy_version 1001860 (0.0008) [2023-12-28 02:27:27,303][106226] Updated weights for policy 0, policy_version 1001870 (0.0008) [2023-12-28 02:27:27,361][106226] Updated weights for policy 0, policy_version 1001880 (0.0009) [2023-12-28 02:27:27,377][106225] Updated weights for policy 1, policy_version 1004227 (0.0009) [2023-12-28 02:27:27,427][106225] Updated weights for policy 1, policy_version 1004237 (0.0005) [2023-12-28 02:27:27,479][106225] Updated weights for policy 1, policy_version 1004247 (0.0005) [2023-12-28 02:27:28,094][106225] Updated weights for policy 1, policy_version 1004257 (0.0006) [2023-12-28 02:27:28,147][106226] Updated weights for policy 0, policy_version 1001890 (0.0008) [2023-12-28 02:27:28,156][106225] Updated weights for policy 1, policy_version 1004267 (0.0010) [2023-12-28 02:27:28,200][106226] Updated weights for policy 0, policy_version 1001900 (0.0005) [2023-12-28 02:27:28,202][106225] Updated weights for policy 1, policy_version 1004277 (0.0010) [2023-12-28 02:27:28,247][106226] Updated weights for policy 0, policy_version 1001910 (0.0005) [2023-12-28 02:27:28,248][106225] Updated weights for policy 1, policy_version 1004287 (0.0010) [2023-12-28 02:27:28,292][106226] Updated weights for policy 0, policy_version 1001920 (0.0007) [2023-12-28 02:27:28,985][106225] Updated weights for policy 1, policy_version 1004297 (0.0010) [2023-12-28 02:27:28,991][106226] Updated weights for policy 0, policy_version 1001930 (0.0006) [2023-12-28 02:27:29,039][106225] Updated weights for policy 1, policy_version 1004307 (0.0010) [2023-12-28 02:27:29,045][106226] Updated weights for policy 0, policy_version 1001940 (0.0006) [2023-12-28 02:27:29,097][106225] Updated weights for policy 1, policy_version 1004317 (0.0010) [2023-12-28 02:27:29,098][106226] Updated weights for policy 0, policy_version 1001950 (0.0007) [2023-12-28 02:27:29,757][106225] Updated weights for policy 1, policy_version 1004327 (0.0007) [2023-12-28 02:27:29,811][106225] Updated weights for policy 1, policy_version 1004337 (0.0009) [2023-12-28 02:27:29,875][106225] Updated weights for policy 1, policy_version 1004347 (0.0009) [2023-12-28 02:27:29,918][106226] Updated weights for policy 0, policy_version 1001960 (0.0008) [2023-12-28 02:27:29,981][106226] Updated weights for policy 0, policy_version 1001970 (0.0008) [2023-12-28 02:27:30,042][106226] Updated weights for policy 0, policy_version 1001980 (0.0008) [2023-12-28 02:27:30,616][106225] Updated weights for policy 1, policy_version 1004357 (0.0008) [2023-12-28 02:27:30,671][106225] Updated weights for policy 1, policy_version 1004367 (0.0008) [2023-12-28 02:27:30,685][106226] Updated weights for policy 0, policy_version 1001990 (0.0007) [2023-12-28 02:27:30,727][106225] Updated weights for policy 1, policy_version 1004377 (0.0006) [2023-12-28 02:27:30,748][106226] Updated weights for policy 0, policy_version 1002000 (0.0007) [2023-12-28 02:27:30,813][106226] Updated weights for policy 0, policy_version 1002010 (0.0009) [2023-12-28 02:27:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 18978.1, 300 sec: 19522.0). Total num frames: 513736704. Throughput: 0: 9579.8, 1: 9848.2. Samples: 513726660. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:31,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.872')] [2023-12-28 02:27:31,472][106225] Updated weights for policy 1, policy_version 1004387 (0.0007) [2023-12-28 02:27:31,523][106225] Updated weights for policy 1, policy_version 1004397 (0.0008) [2023-12-28 02:27:31,532][106226] Updated weights for policy 0, policy_version 1002020 (0.0008) [2023-12-28 02:27:31,577][106225] Updated weights for policy 1, policy_version 1004407 (0.0006) [2023-12-28 02:27:31,587][106226] Updated weights for policy 0, policy_version 1002030 (0.0008) [2023-12-28 02:27:31,656][106226] Updated weights for policy 0, policy_version 1002040 (0.0008) [2023-12-28 02:27:32,221][106225] Updated weights for policy 1, policy_version 1004417 (0.0007) [2023-12-28 02:27:32,286][106225] Updated weights for policy 1, policy_version 1004427 (0.0006) [2023-12-28 02:27:32,345][106225] Updated weights for policy 1, policy_version 1004437 (0.0005) [2023-12-28 02:27:32,396][106226] Updated weights for policy 0, policy_version 1002050 (0.0007) [2023-12-28 02:27:32,416][106225] Updated weights for policy 1, policy_version 1004447 (0.0008) [2023-12-28 02:27:32,461][106226] Updated weights for policy 0, policy_version 1002060 (0.0005) [2023-12-28 02:27:32,529][106226] Updated weights for policy 0, policy_version 1002070 (0.0005) [2023-12-28 02:27:32,588][106226] Updated weights for policy 0, policy_version 1002080 (0.0007) [2023-12-28 02:27:33,125][106225] Updated weights for policy 1, policy_version 1004457 (0.0008) [2023-12-28 02:27:33,183][106225] Updated weights for policy 1, policy_version 1004467 (0.0006) [2023-12-28 02:27:33,204][106226] Updated weights for policy 0, policy_version 1002090 (0.0009) [2023-12-28 02:27:33,241][106225] Updated weights for policy 1, policy_version 1004477 (0.0007) [2023-12-28 02:27:33,251][106226] Updated weights for policy 0, policy_version 1002100 (0.0005) [2023-12-28 02:27:33,306][106226] Updated weights for policy 0, policy_version 1002110 (0.0008) [2023-12-28 02:27:33,895][106225] Updated weights for policy 1, policy_version 1004487 (0.0008) [2023-12-28 02:27:33,952][106225] Updated weights for policy 1, policy_version 1004497 (0.0008) [2023-12-28 02:27:34,011][106225] Updated weights for policy 1, policy_version 1004507 (0.0007) [2023-12-28 02:27:34,051][106226] Updated weights for policy 0, policy_version 1002120 (0.0009) [2023-12-28 02:27:34,105][106226] Updated weights for policy 0, policy_version 1002130 (0.0009) [2023-12-28 02:27:34,166][106226] Updated weights for policy 0, policy_version 1002140 (0.0009) [2023-12-28 02:27:34,768][106225] Updated weights for policy 1, policy_version 1004517 (0.0007) [2023-12-28 02:27:34,822][106225] Updated weights for policy 1, policy_version 1004527 (0.0010) [2023-12-28 02:27:34,854][106226] Updated weights for policy 0, policy_version 1002150 (0.0009) [2023-12-28 02:27:34,879][106225] Updated weights for policy 1, policy_version 1004537 (0.0010) [2023-12-28 02:27:34,911][106226] Updated weights for policy 0, policy_version 1002160 (0.0011) [2023-12-28 02:27:34,975][106226] Updated weights for policy 0, policy_version 1002170 (0.0011) [2023-12-28 02:27:35,562][106225] Updated weights for policy 1, policy_version 1004547 (0.0007) [2023-12-28 02:27:35,604][106225] Updated weights for policy 1, policy_version 1004557 (0.0007) [2023-12-28 02:27:35,651][106225] Updated weights for policy 1, policy_version 1004567 (0.0007) [2023-12-28 02:27:35,688][106226] Updated weights for policy 0, policy_version 1002180 (0.0011) [2023-12-28 02:27:35,744][106226] Updated weights for policy 0, policy_version 1002190 (0.0011) [2023-12-28 02:27:35,804][106226] Updated weights for policy 0, policy_version 1002200 (0.0010) [2023-12-28 02:27:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19251.2, 300 sec: 19522.0). Total num frames: 513835008. Throughput: 0: 9739.1, 1: 9968.5. Samples: 513844496. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:36,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.850')] [2023-12-28 02:27:36,401][106225] Updated weights for policy 1, policy_version 1004577 (0.0008) [2023-12-28 02:27:36,465][106225] Updated weights for policy 1, policy_version 1004587 (0.0008) [2023-12-28 02:27:36,519][106226] Updated weights for policy 0, policy_version 1002210 (0.0011) [2023-12-28 02:27:36,528][106225] Updated weights for policy 1, policy_version 1004597 (0.0007) [2023-12-28 02:27:36,577][106226] Updated weights for policy 0, policy_version 1002220 (0.0010) [2023-12-28 02:27:36,587][106225] Updated weights for policy 1, policy_version 1004607 (0.0006) [2023-12-28 02:27:36,643][106226] Updated weights for policy 0, policy_version 1002230 (0.0008) [2023-12-28 02:27:36,711][106226] Updated weights for policy 0, policy_version 1002240 (0.0011) [2023-12-28 02:27:37,300][106225] Updated weights for policy 1, policy_version 1004617 (0.0008) [2023-12-28 02:27:37,361][106226] Updated weights for policy 0, policy_version 1002250 (0.0011) [2023-12-28 02:27:37,363][106225] Updated weights for policy 1, policy_version 1004627 (0.0006) [2023-12-28 02:27:37,415][106225] Updated weights for policy 1, policy_version 1004637 (0.0009) [2023-12-28 02:27:37,421][106226] Updated weights for policy 0, policy_version 1002260 (0.0010) [2023-12-28 02:27:37,488][106226] Updated weights for policy 0, policy_version 1002270 (0.0005) [2023-12-28 02:27:38,037][106226] Updated weights for policy 0, policy_version 1002280 (0.0008) [2023-12-28 02:27:38,094][106226] Updated weights for policy 0, policy_version 1002290 (0.0008) [2023-12-28 02:27:38,152][106226] Updated weights for policy 0, policy_version 1002300 (0.0008) [2023-12-28 02:27:38,225][106225] Updated weights for policy 1, policy_version 1004647 (0.0008) [2023-12-28 02:27:38,284][106225] Updated weights for policy 1, policy_version 1004657 (0.0009) [2023-12-28 02:27:38,338][106225] Updated weights for policy 1, policy_version 1004667 (0.0008) [2023-12-28 02:27:38,901][106226] Updated weights for policy 0, policy_version 1002310 (0.0008) [2023-12-28 02:27:38,953][106226] Updated weights for policy 0, policy_version 1002320 (0.0009) [2023-12-28 02:27:39,004][106226] Updated weights for policy 0, policy_version 1002330 (0.0008) [2023-12-28 02:27:39,014][106225] Updated weights for policy 1, policy_version 1004677 (0.0006) [2023-12-28 02:27:39,072][106225] Updated weights for policy 1, policy_version 1004687 (0.0009) [2023-12-28 02:27:39,119][106225] Updated weights for policy 1, policy_version 1004697 (0.0010) [2023-12-28 02:27:39,782][106226] Updated weights for policy 0, policy_version 1002340 (0.0008) [2023-12-28 02:27:39,843][106226] Updated weights for policy 0, policy_version 1002350 (0.0008) [2023-12-28 02:27:39,907][106226] Updated weights for policy 0, policy_version 1002360 (0.0007) [2023-12-28 02:27:39,938][106225] Updated weights for policy 1, policy_version 1004707 (0.0010) [2023-12-28 02:27:39,995][106225] Updated weights for policy 1, policy_version 1004717 (0.0009) [2023-12-28 02:27:40,045][106225] Updated weights for policy 1, policy_version 1004727 (0.0009) [2023-12-28 02:27:40,601][106226] Updated weights for policy 0, policy_version 1002370 (0.0009) [2023-12-28 02:27:40,671][106226] Updated weights for policy 0, policy_version 1002380 (0.0011) [2023-12-28 02:27:40,734][106225] Updated weights for policy 1, policy_version 1004737 (0.0007) [2023-12-28 02:27:40,738][106226] Updated weights for policy 0, policy_version 1002390 (0.0011) [2023-12-28 02:27:40,788][106225] Updated weights for policy 1, policy_version 1004747 (0.0006) [2023-12-28 02:27:40,794][106226] Updated weights for policy 0, policy_version 1002400 (0.0009) [2023-12-28 02:27:40,840][106225] Updated weights for policy 1, policy_version 1004757 (0.0007) [2023-12-28 02:27:40,896][106225] Updated weights for policy 1, policy_version 1004767 (0.0007) [2023-12-28 02:27:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19387.7, 300 sec: 19521.9). Total num frames: 513933312. Throughput: 0: 9828.5, 1: 9991.1. Samples: 513903156. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:41,176][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.781')] [2023-12-28 02:27:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001002400_256671744.pth... [2023-12-28 02:27:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001004768_257261568.pth... [2023-12-28 02:27:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001003616_256966656.pth [2023-12-28 02:27:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001001280_256385024.pth [2023-12-28 02:27:41,568][106226] Updated weights for policy 0, policy_version 1002410 (0.0010) [2023-12-28 02:27:41,627][106226] Updated weights for policy 0, policy_version 1002420 (0.0010) [2023-12-28 02:27:41,657][106225] Updated weights for policy 1, policy_version 1004777 (0.0010) [2023-12-28 02:27:41,692][106226] Updated weights for policy 0, policy_version 1002430 (0.0009) [2023-12-28 02:27:41,730][106225] Updated weights for policy 1, policy_version 1004787 (0.0015) [2023-12-28 02:27:41,787][106225] Updated weights for policy 1, policy_version 1004797 (0.0007) [2023-12-28 02:27:42,408][106226] Updated weights for policy 0, policy_version 1002440 (0.0008) [2023-12-28 02:27:42,471][106226] Updated weights for policy 0, policy_version 1002450 (0.0008) [2023-12-28 02:27:42,534][106226] Updated weights for policy 0, policy_version 1002460 (0.0007) [2023-12-28 02:27:42,556][106225] Updated weights for policy 1, policy_version 1004807 (0.0009) [2023-12-28 02:27:42,615][106225] Updated weights for policy 1, policy_version 1004817 (0.0009) [2023-12-28 02:27:42,666][106225] Updated weights for policy 1, policy_version 1004827 (0.0009) [2023-12-28 02:27:43,089][106226] Updated weights for policy 0, policy_version 1002470 (0.0005) [2023-12-28 02:27:43,135][106226] Updated weights for policy 0, policy_version 1002480 (0.0005) [2023-12-28 02:27:43,182][106226] Updated weights for policy 0, policy_version 1002490 (0.0005) [2023-12-28 02:27:43,369][106225] Updated weights for policy 1, policy_version 1004837 (0.0010) [2023-12-28 02:27:43,435][106225] Updated weights for policy 1, policy_version 1004847 (0.0010) [2023-12-28 02:27:43,488][106225] Updated weights for policy 1, policy_version 1004857 (0.0008) [2023-12-28 02:27:43,779][106226] Updated weights for policy 0, policy_version 1002500 (0.0008) [2023-12-28 02:27:43,840][106226] Updated weights for policy 0, policy_version 1002510 (0.0009) [2023-12-28 02:27:43,906][106226] Updated weights for policy 0, policy_version 1002520 (0.0010) [2023-12-28 02:27:44,080][106225] Updated weights for policy 1, policy_version 1004867 (0.0008) [2023-12-28 02:27:44,140][106225] Updated weights for policy 1, policy_version 1004877 (0.0008) [2023-12-28 02:27:44,204][106225] Updated weights for policy 1, policy_version 1004887 (0.0009) [2023-12-28 02:27:44,552][106226] Updated weights for policy 0, policy_version 1002530 (0.0007) [2023-12-28 02:27:44,612][106226] Updated weights for policy 0, policy_version 1002540 (0.0010) [2023-12-28 02:27:44,667][106226] Updated weights for policy 0, policy_version 1002550 (0.0006) [2023-12-28 02:27:44,724][106226] Updated weights for policy 0, policy_version 1002560 (0.0010) [2023-12-28 02:27:44,962][106225] Updated weights for policy 1, policy_version 1004897 (0.0009) [2023-12-28 02:27:45,031][106225] Updated weights for policy 1, policy_version 1004907 (0.0007) [2023-12-28 02:27:45,089][106225] Updated weights for policy 1, policy_version 1004917 (0.0011) [2023-12-28 02:27:45,147][106225] Updated weights for policy 1, policy_version 1004927 (0.0010) [2023-12-28 02:27:45,435][106226] Updated weights for policy 0, policy_version 1002570 (0.0005) [2023-12-28 02:27:45,493][106226] Updated weights for policy 0, policy_version 1002580 (0.0005) [2023-12-28 02:27:45,548][106226] Updated weights for policy 0, policy_version 1002590 (0.0007) [2023-12-28 02:27:45,838][106225] Updated weights for policy 1, policy_version 1004937 (0.0009) [2023-12-28 02:27:45,899][106225] Updated weights for policy 1, policy_version 1004947 (0.0009) [2023-12-28 02:27:45,948][106225] Updated weights for policy 1, policy_version 1004957 (0.0010) [2023-12-28 02:27:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19494.2). Total num frames: 514031616. Throughput: 0: 9844.5, 1: 10002.3. Samples: 514022076. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:46,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.106')] [2023-12-28 02:27:46,188][106226] Updated weights for policy 0, policy_version 1002600 (0.0010) [2023-12-28 02:27:46,248][106226] Updated weights for policy 0, policy_version 1002610 (0.0010) [2023-12-28 02:27:46,308][106226] Updated weights for policy 0, policy_version 1002620 (0.0006) [2023-12-28 02:27:46,576][106225] Updated weights for policy 1, policy_version 1004967 (0.0007) [2023-12-28 02:27:46,642][106225] Updated weights for policy 1, policy_version 1004977 (0.0006) [2023-12-28 02:27:46,703][106225] Updated weights for policy 1, policy_version 1004987 (0.0006) [2023-12-28 02:27:46,910][106226] Updated weights for policy 0, policy_version 1002630 (0.0009) [2023-12-28 02:27:46,965][106226] Updated weights for policy 0, policy_version 1002640 (0.0005) [2023-12-28 02:27:47,023][106226] Updated weights for policy 0, policy_version 1002650 (0.0006) [2023-12-28 02:27:47,232][106225] Updated weights for policy 1, policy_version 1004997 (0.0006) [2023-12-28 02:27:47,283][106225] Updated weights for policy 1, policy_version 1005007 (0.0005) [2023-12-28 02:27:47,347][106225] Updated weights for policy 1, policy_version 1005017 (0.0005) [2023-12-28 02:27:47,674][106226] Updated weights for policy 0, policy_version 1002660 (0.0007) [2023-12-28 02:27:47,739][106226] Updated weights for policy 0, policy_version 1002670 (0.0008) [2023-12-28 02:27:47,803][106226] Updated weights for policy 0, policy_version 1002680 (0.0008) [2023-12-28 02:27:47,857][106225] Updated weights for policy 1, policy_version 1005027 (0.0005) [2023-12-28 02:27:47,924][106225] Updated weights for policy 1, policy_version 1005037 (0.0005) [2023-12-28 02:27:47,983][106225] Updated weights for policy 1, policy_version 1005047 (0.0005) [2023-12-28 02:27:48,453][106226] Updated weights for policy 0, policy_version 1002690 (0.0008) [2023-12-28 02:27:48,517][106226] Updated weights for policy 0, policy_version 1002700 (0.0007) [2023-12-28 02:27:48,562][106225] Updated weights for policy 1, policy_version 1005057 (0.0006) [2023-12-28 02:27:48,578][106226] Updated weights for policy 0, policy_version 1002710 (0.0006) [2023-12-28 02:27:48,630][106225] Updated weights for policy 1, policy_version 1005067 (0.0011) [2023-12-28 02:27:48,642][106226] Updated weights for policy 0, policy_version 1002720 (0.0008) [2023-12-28 02:27:48,693][106225] Updated weights for policy 1, policy_version 1005077 (0.0010) [2023-12-28 02:27:48,783][106225] Updated weights for policy 1, policy_version 1005087 (0.0010) [2023-12-28 02:27:49,245][106226] Updated weights for policy 0, policy_version 1002730 (0.0006) [2023-12-28 02:27:49,311][106226] Updated weights for policy 0, policy_version 1002740 (0.0006) [2023-12-28 02:27:49,382][106226] Updated weights for policy 0, policy_version 1002750 (0.0008) [2023-12-28 02:27:49,436][106225] Updated weights for policy 1, policy_version 1005097 (0.0009) [2023-12-28 02:27:49,496][106225] Updated weights for policy 1, policy_version 1005107 (0.0008) [2023-12-28 02:27:49,545][106225] Updated weights for policy 1, policy_version 1005117 (0.0008) [2023-12-28 02:27:50,106][106226] Updated weights for policy 0, policy_version 1002760 (0.0006) [2023-12-28 02:27:50,169][106226] Updated weights for policy 0, policy_version 1002770 (0.0008) [2023-12-28 02:27:50,234][106226] Updated weights for policy 0, policy_version 1002780 (0.0008) [2023-12-28 02:27:50,278][106225] Updated weights for policy 1, policy_version 1005127 (0.0008) [2023-12-28 02:27:50,337][106225] Updated weights for policy 1, policy_version 1005137 (0.0008) [2023-12-28 02:27:50,400][106225] Updated weights for policy 1, policy_version 1005147 (0.0008) [2023-12-28 02:27:50,865][106226] Updated weights for policy 0, policy_version 1002790 (0.0008) [2023-12-28 02:27:50,926][106226] Updated weights for policy 0, policy_version 1002800 (0.0009) [2023-12-28 02:27:50,996][106226] Updated weights for policy 0, policy_version 1002810 (0.0009) [2023-12-28 02:27:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19522.0). Total num frames: 514138112. Throughput: 0: 9888.8, 1: 10049.8. Samples: 514147720. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:51,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.833')] [2023-12-28 02:27:51,188][106225] Updated weights for policy 1, policy_version 1005157 (0.0009) [2023-12-28 02:27:51,250][106225] Updated weights for policy 1, policy_version 1005167 (0.0009) [2023-12-28 02:27:51,319][106225] Updated weights for policy 1, policy_version 1005177 (0.0008) [2023-12-28 02:27:51,762][106226] Updated weights for policy 0, policy_version 1002820 (0.0009) [2023-12-28 02:27:51,828][106226] Updated weights for policy 0, policy_version 1002830 (0.0008) [2023-12-28 02:27:51,891][106226] Updated weights for policy 0, policy_version 1002840 (0.0010) [2023-12-28 02:27:52,033][106225] Updated weights for policy 1, policy_version 1005187 (0.0007) [2023-12-28 02:27:52,088][106225] Updated weights for policy 1, policy_version 1005197 (0.0006) [2023-12-28 02:27:52,142][106225] Updated weights for policy 1, policy_version 1005207 (0.0008) [2023-12-28 02:27:52,641][106226] Updated weights for policy 0, policy_version 1002850 (0.0010) [2023-12-28 02:27:52,707][106226] Updated weights for policy 0, policy_version 1002860 (0.0010) [2023-12-28 02:27:52,777][106226] Updated weights for policy 0, policy_version 1002870 (0.0010) [2023-12-28 02:27:52,785][106225] Updated weights for policy 1, policy_version 1005217 (0.0007) [2023-12-28 02:27:52,839][106225] Updated weights for policy 1, policy_version 1005227 (0.0008) [2023-12-28 02:27:52,845][106226] Updated weights for policy 0, policy_version 1002880 (0.0008) [2023-12-28 02:27:52,904][106225] Updated weights for policy 1, policy_version 1005237 (0.0011) [2023-12-28 02:27:52,970][106225] Updated weights for policy 1, policy_version 1005247 (0.0010) [2023-12-28 02:27:53,494][106226] Updated weights for policy 0, policy_version 1002890 (0.0008) [2023-12-28 02:27:53,548][106226] Updated weights for policy 0, policy_version 1002900 (0.0007) [2023-12-28 02:27:53,605][106226] Updated weights for policy 0, policy_version 1002910 (0.0006) [2023-12-28 02:27:53,610][106225] Updated weights for policy 1, policy_version 1005257 (0.0010) [2023-12-28 02:27:53,661][106225] Updated weights for policy 1, policy_version 1005267 (0.0010) [2023-12-28 02:27:53,718][106225] Updated weights for policy 1, policy_version 1005277 (0.0010) [2023-12-28 02:27:54,194][106226] Updated weights for policy 0, policy_version 1002920 (0.0007) [2023-12-28 02:27:54,252][106226] Updated weights for policy 0, policy_version 1002930 (0.0008) [2023-12-28 02:27:54,299][106226] Updated weights for policy 0, policy_version 1002940 (0.0008) [2023-12-28 02:27:54,412][106225] Updated weights for policy 1, policy_version 1005287 (0.0010) [2023-12-28 02:27:54,475][106225] Updated weights for policy 1, policy_version 1005297 (0.0009) [2023-12-28 02:27:54,535][106225] Updated weights for policy 1, policy_version 1005307 (0.0010) [2023-12-28 02:27:54,994][106226] Updated weights for policy 0, policy_version 1002950 (0.0007) [2023-12-28 02:27:55,045][106226] Updated weights for policy 0, policy_version 1002960 (0.0008) [2023-12-28 02:27:55,099][106226] Updated weights for policy 0, policy_version 1002970 (0.0008) [2023-12-28 02:27:55,240][106225] Updated weights for policy 1, policy_version 1005317 (0.0010) [2023-12-28 02:27:55,300][106225] Updated weights for policy 1, policy_version 1005327 (0.0008) [2023-12-28 02:27:55,358][106225] Updated weights for policy 1, policy_version 1005337 (0.0009) [2023-12-28 02:27:55,777][106226] Updated weights for policy 0, policy_version 1002980 (0.0007) [2023-12-28 02:27:55,831][106226] Updated weights for policy 0, policy_version 1002990 (0.0005) [2023-12-28 02:27:55,890][106226] Updated weights for policy 0, policy_version 1003000 (0.0005) [2023-12-28 02:27:56,015][106225] Updated weights for policy 1, policy_version 1005347 (0.0009) [2023-12-28 02:27:56,068][106225] Updated weights for policy 1, policy_version 1005357 (0.0008) [2023-12-28 02:27:56,115][106225] Updated weights for policy 1, policy_version 1005367 (0.0006) [2023-12-28 02:27:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 514244608. Throughput: 0: 9873.2, 1: 9982.7. Samples: 514207192. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:27:56,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-5.079')] [2023-12-28 02:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001005376_257417216.pth... [2023-12-28 02:27:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001003008_256827392.pth... [2023-12-28 02:27:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001001824_256524288.pth [2023-12-28 02:27:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001004192_257114112.pth [2023-12-28 02:27:56,415][106226] Updated weights for policy 0, policy_version 1003010 (0.0006) [2023-12-28 02:27:56,480][106226] Updated weights for policy 0, policy_version 1003020 (0.0011) [2023-12-28 02:27:56,546][106226] Updated weights for policy 0, policy_version 1003030 (0.0011) [2023-12-28 02:27:56,614][106226] Updated weights for policy 0, policy_version 1003040 (0.0011) [2023-12-28 02:27:56,871][106225] Updated weights for policy 1, policy_version 1005377 (0.0008) [2023-12-28 02:27:56,934][106225] Updated weights for policy 1, policy_version 1005387 (0.0005) [2023-12-28 02:27:56,999][106225] Updated weights for policy 1, policy_version 1005397 (0.0006) [2023-12-28 02:27:57,058][106225] Updated weights for policy 1, policy_version 1005407 (0.0005) [2023-12-28 02:27:57,295][106226] Updated weights for policy 0, policy_version 1003050 (0.0006) [2023-12-28 02:27:57,351][106226] Updated weights for policy 0, policy_version 1003060 (0.0010) [2023-12-28 02:27:57,401][106226] Updated weights for policy 0, policy_version 1003070 (0.0010) [2023-12-28 02:27:57,622][106225] Updated weights for policy 1, policy_version 1005417 (0.0005) [2023-12-28 02:27:57,669][106225] Updated weights for policy 1, policy_version 1005427 (0.0005) [2023-12-28 02:27:57,727][106225] Updated weights for policy 1, policy_version 1005437 (0.0005) [2023-12-28 02:27:58,005][106226] Updated weights for policy 0, policy_version 1003080 (0.0010) [2023-12-28 02:27:58,052][106226] Updated weights for policy 0, policy_version 1003090 (0.0010) [2023-12-28 02:27:58,098][106226] Updated weights for policy 0, policy_version 1003100 (0.0010) [2023-12-28 02:27:58,424][106225] Updated weights for policy 1, policy_version 1005447 (0.0007) [2023-12-28 02:27:58,491][106225] Updated weights for policy 1, policy_version 1005457 (0.0010) [2023-12-28 02:27:58,556][106225] Updated weights for policy 1, policy_version 1005467 (0.0007) [2023-12-28 02:27:58,900][106226] Updated weights for policy 0, policy_version 1003110 (0.0010) [2023-12-28 02:27:58,953][106226] Updated weights for policy 0, policy_version 1003120 (0.0007) [2023-12-28 02:27:59,019][106226] Updated weights for policy 0, policy_version 1003130 (0.0008) [2023-12-28 02:27:59,418][106225] Updated weights for policy 1, policy_version 1005477 (0.0008) [2023-12-28 02:27:59,469][106225] Updated weights for policy 1, policy_version 1005487 (0.0008) [2023-12-28 02:27:59,519][106225] Updated weights for policy 1, policy_version 1005497 (0.0007) [2023-12-28 02:27:59,799][106226] Updated weights for policy 0, policy_version 1003140 (0.0009) [2023-12-28 02:27:59,874][106226] Updated weights for policy 0, policy_version 1003150 (0.0008) [2023-12-28 02:27:59,936][106226] Updated weights for policy 0, policy_version 1003160 (0.0008) [2023-12-28 02:28:00,256][106225] Updated weights for policy 1, policy_version 1005507 (0.0008) [2023-12-28 02:28:00,307][106225] Updated weights for policy 1, policy_version 1005517 (0.0009) [2023-12-28 02:28:00,356][106225] Updated weights for policy 1, policy_version 1005527 (0.0008) [2023-12-28 02:28:00,647][106226] Updated weights for policy 0, policy_version 1003170 (0.0008) [2023-12-28 02:28:00,701][106226] Updated weights for policy 0, policy_version 1003180 (0.0009) [2023-12-28 02:28:00,760][106226] Updated weights for policy 0, policy_version 1003190 (0.0008) [2023-12-28 02:28:00,816][106226] Updated weights for policy 0, policy_version 1003200 (0.0008) [2023-12-28 02:28:01,158][106225] Updated weights for policy 1, policy_version 1005537 (0.0008) [2023-12-28 02:28:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19522.0). Total num frames: 514334720. Throughput: 0: 9935.9, 1: 10028.1. Samples: 514326992. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:01,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-5.037')] [2023-12-28 02:28:01,219][106225] Updated weights for policy 1, policy_version 1005547 (0.0008) [2023-12-28 02:28:01,279][106225] Updated weights for policy 1, policy_version 1005557 (0.0008) [2023-12-28 02:28:01,337][106225] Updated weights for policy 1, policy_version 1005567 (0.0008) [2023-12-28 02:28:01,581][106226] Updated weights for policy 0, policy_version 1003210 (0.0009) [2023-12-28 02:28:01,640][106226] Updated weights for policy 0, policy_version 1003220 (0.0010) [2023-12-28 02:28:01,701][106226] Updated weights for policy 0, policy_version 1003230 (0.0011) [2023-12-28 02:28:02,068][106225] Updated weights for policy 1, policy_version 1005577 (0.0008) [2023-12-28 02:28:02,124][106225] Updated weights for policy 1, policy_version 1005587 (0.0007) [2023-12-28 02:28:02,183][106225] Updated weights for policy 1, policy_version 1005597 (0.0008) [2023-12-28 02:28:02,363][106226] Updated weights for policy 0, policy_version 1003240 (0.0010) [2023-12-28 02:28:02,429][106226] Updated weights for policy 0, policy_version 1003250 (0.0011) [2023-12-28 02:28:02,497][106226] Updated weights for policy 0, policy_version 1003260 (0.0010) [2023-12-28 02:28:02,916][106225] Updated weights for policy 1, policy_version 1005607 (0.0007) [2023-12-28 02:28:02,980][106225] Updated weights for policy 1, policy_version 1005617 (0.0007) [2023-12-28 02:28:03,041][106225] Updated weights for policy 1, policy_version 1005627 (0.0008) [2023-12-28 02:28:03,180][106226] Updated weights for policy 0, policy_version 1003270 (0.0008) [2023-12-28 02:28:03,242][106226] Updated weights for policy 0, policy_version 1003280 (0.0007) [2023-12-28 02:28:03,297][106226] Updated weights for policy 0, policy_version 1003290 (0.0009) [2023-12-28 02:28:03,752][106225] Updated weights for policy 1, policy_version 1005637 (0.0007) [2023-12-28 02:28:03,824][106225] Updated weights for policy 1, policy_version 1005647 (0.0005) [2023-12-28 02:28:03,879][106226] Updated weights for policy 0, policy_version 1003300 (0.0008) [2023-12-28 02:28:03,893][106225] Updated weights for policy 1, policy_version 1005657 (0.0008) [2023-12-28 02:28:03,934][106226] Updated weights for policy 0, policy_version 1003310 (0.0005) [2023-12-28 02:28:03,992][106226] Updated weights for policy 0, policy_version 1003320 (0.0006) [2023-12-28 02:28:04,589][106225] Updated weights for policy 1, policy_version 1005667 (0.0008) [2023-12-28 02:28:04,640][106225] Updated weights for policy 1, policy_version 1005677 (0.0010) [2023-12-28 02:28:04,671][106226] Updated weights for policy 0, policy_version 1003330 (0.0007) [2023-12-28 02:28:04,686][106225] Updated weights for policy 1, policy_version 1005687 (0.0010) [2023-12-28 02:28:04,724][106226] Updated weights for policy 0, policy_version 1003340 (0.0011) [2023-12-28 02:28:04,783][106226] Updated weights for policy 0, policy_version 1003350 (0.0007) [2023-12-28 02:28:04,842][106226] Updated weights for policy 0, policy_version 1003360 (0.0006) [2023-12-28 02:28:05,413][106225] Updated weights for policy 1, policy_version 1005697 (0.0010) [2023-12-28 02:28:05,428][106226] Updated weights for policy 0, policy_version 1003370 (0.0005) [2023-12-28 02:28:05,470][106225] Updated weights for policy 1, policy_version 1005707 (0.0010) [2023-12-28 02:28:05,490][106226] Updated weights for policy 0, policy_version 1003380 (0.0006) [2023-12-28 02:28:05,523][106225] Updated weights for policy 1, policy_version 1005717 (0.0010) [2023-12-28 02:28:05,553][106226] Updated weights for policy 0, policy_version 1003390 (0.0005) [2023-12-28 02:28:05,580][106225] Updated weights for policy 1, policy_version 1005727 (0.0010) [2023-12-28 02:28:06,118][106226] Updated weights for policy 0, policy_version 1003400 (0.0006) [2023-12-28 02:28:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19522.0). Total num frames: 514433024. Throughput: 0: 10114.6, 1: 9929.1. Samples: 514448052. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:06,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.874')] [2023-12-28 02:28:06,186][106226] Updated weights for policy 0, policy_version 1003410 (0.0008) [2023-12-28 02:28:06,239][106225] Updated weights for policy 1, policy_version 1005737 (0.0006) [2023-12-28 02:28:06,242][106226] Updated weights for policy 0, policy_version 1003420 (0.0008) [2023-12-28 02:28:06,301][106225] Updated weights for policy 1, policy_version 1005747 (0.0007) [2023-12-28 02:28:06,366][106225] Updated weights for policy 1, policy_version 1005757 (0.0008) [2023-12-28 02:28:06,870][106226] Updated weights for policy 0, policy_version 1003430 (0.0010) [2023-12-28 02:28:06,934][106226] Updated weights for policy 0, policy_version 1003440 (0.0008) [2023-12-28 02:28:06,984][106226] Updated weights for policy 0, policy_version 1003450 (0.0005) [2023-12-28 02:28:07,067][106225] Updated weights for policy 1, policy_version 1005767 (0.0006) [2023-12-28 02:28:07,135][106225] Updated weights for policy 1, policy_version 1005777 (0.0006) [2023-12-28 02:28:07,208][106225] Updated weights for policy 1, policy_version 1005787 (0.0006) [2023-12-28 02:28:07,604][106226] Updated weights for policy 0, policy_version 1003460 (0.0007) [2023-12-28 02:28:07,667][106226] Updated weights for policy 0, policy_version 1003470 (0.0010) [2023-12-28 02:28:07,727][106226] Updated weights for policy 0, policy_version 1003480 (0.0008) [2023-12-28 02:28:07,830][106225] Updated weights for policy 1, policy_version 1005797 (0.0007) [2023-12-28 02:28:07,890][106225] Updated weights for policy 1, policy_version 1005807 (0.0008) [2023-12-28 02:28:07,954][106225] Updated weights for policy 1, policy_version 1005817 (0.0009) [2023-12-28 02:28:08,413][106226] Updated weights for policy 0, policy_version 1003490 (0.0010) [2023-12-28 02:28:08,461][106226] Updated weights for policy 0, policy_version 1003500 (0.0008) [2023-12-28 02:28:08,523][106226] Updated weights for policy 0, policy_version 1003510 (0.0007) [2023-12-28 02:28:08,585][106226] Updated weights for policy 0, policy_version 1003520 (0.0008) [2023-12-28 02:28:08,680][106225] Updated weights for policy 1, policy_version 1005827 (0.0008) [2023-12-28 02:28:08,739][106225] Updated weights for policy 1, policy_version 1005837 (0.0009) [2023-12-28 02:28:08,803][106225] Updated weights for policy 1, policy_version 1005847 (0.0009) [2023-12-28 02:28:09,288][106226] Updated weights for policy 0, policy_version 1003530 (0.0008) [2023-12-28 02:28:09,356][106226] Updated weights for policy 0, policy_version 1003540 (0.0008) [2023-12-28 02:28:09,436][106226] Updated weights for policy 0, policy_version 1003550 (0.0009) [2023-12-28 02:28:09,539][106225] Updated weights for policy 1, policy_version 1005857 (0.0009) [2023-12-28 02:28:09,600][106225] Updated weights for policy 1, policy_version 1005867 (0.0006) [2023-12-28 02:28:09,662][106225] Updated weights for policy 1, policy_version 1005877 (0.0008) [2023-12-28 02:28:09,726][106225] Updated weights for policy 1, policy_version 1005887 (0.0009) [2023-12-28 02:28:10,194][106226] Updated weights for policy 0, policy_version 1003560 (0.0007) [2023-12-28 02:28:10,254][106226] Updated weights for policy 0, policy_version 1003570 (0.0008) [2023-12-28 02:28:10,314][106226] Updated weights for policy 0, policy_version 1003580 (0.0008) [2023-12-28 02:28:10,449][106225] Updated weights for policy 1, policy_version 1005897 (0.0009) [2023-12-28 02:28:10,508][106225] Updated weights for policy 1, policy_version 1005907 (0.0008) [2023-12-28 02:28:10,574][106225] Updated weights for policy 1, policy_version 1005917 (0.0007) [2023-12-28 02:28:11,059][106226] Updated weights for policy 0, policy_version 1003590 (0.0009) [2023-12-28 02:28:11,130][106226] Updated weights for policy 0, policy_version 1003600 (0.0007) [2023-12-28 02:28:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19549.7). Total num frames: 514531328. Throughput: 0: 10167.3, 1: 9954.5. Samples: 514509308. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:11,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-5.295')] [2023-12-28 02:28:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001005920_257556480.pth... [2023-12-28 02:28:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001004768_257261568.pth [2023-12-28 02:28:11,202][106226] Updated weights for policy 0, policy_version 1003610 (0.0012) [2023-12-28 02:28:11,241][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001003616_256983040.pth... [2023-12-28 02:28:11,246][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001002400_256671744.pth [2023-12-28 02:28:11,255][106225] Updated weights for policy 1, policy_version 1005927 (0.0007) [2023-12-28 02:28:11,319][106225] Updated weights for policy 1, policy_version 1005937 (0.0007) [2023-12-28 02:28:11,391][106225] Updated weights for policy 1, policy_version 1005947 (0.0008) [2023-12-28 02:28:12,011][106226] Updated weights for policy 0, policy_version 1003620 (0.0010) [2023-12-28 02:28:12,063][106226] Updated weights for policy 0, policy_version 1003630 (0.0007) [2023-12-28 02:28:12,098][106225] Updated weights for policy 1, policy_version 1005957 (0.0008) [2023-12-28 02:28:12,131][106226] Updated weights for policy 0, policy_version 1003640 (0.0005) [2023-12-28 02:28:12,152][106225] Updated weights for policy 1, policy_version 1005967 (0.0008) [2023-12-28 02:28:12,200][106225] Updated weights for policy 1, policy_version 1005977 (0.0010) [2023-12-28 02:28:12,747][106226] Updated weights for policy 0, policy_version 1003650 (0.0006) [2023-12-28 02:28:12,815][106226] Updated weights for policy 0, policy_version 1003660 (0.0009) [2023-12-28 02:28:12,828][106225] Updated weights for policy 1, policy_version 1005987 (0.0008) [2023-12-28 02:28:12,881][106225] Updated weights for policy 1, policy_version 1005997 (0.0009) [2023-12-28 02:28:12,883][106226] Updated weights for policy 0, policy_version 1003670 (0.0008) [2023-12-28 02:28:12,939][106225] Updated weights for policy 1, policy_version 1006007 (0.0006) [2023-12-28 02:28:12,957][106226] Updated weights for policy 0, policy_version 1003680 (0.0009) [2023-12-28 02:28:13,515][106225] Updated weights for policy 1, policy_version 1006017 (0.0006) [2023-12-28 02:28:13,558][106226] Updated weights for policy 0, policy_version 1003690 (0.0006) [2023-12-28 02:28:13,566][106225] Updated weights for policy 1, policy_version 1006027 (0.0010) [2023-12-28 02:28:13,610][106226] Updated weights for policy 0, policy_version 1003700 (0.0005) [2023-12-28 02:28:13,614][106225] Updated weights for policy 1, policy_version 1006037 (0.0009) [2023-12-28 02:28:13,665][106225] Updated weights for policy 1, policy_version 1006047 (0.0007) [2023-12-28 02:28:13,674][106226] Updated weights for policy 0, policy_version 1003710 (0.0006) [2023-12-28 02:28:14,326][106226] Updated weights for policy 0, policy_version 1003720 (0.0008) [2023-12-28 02:28:14,338][106225] Updated weights for policy 1, policy_version 1006057 (0.0005) [2023-12-28 02:28:14,386][106226] Updated weights for policy 0, policy_version 1003730 (0.0007) [2023-12-28 02:28:14,393][106225] Updated weights for policy 1, policy_version 1006067 (0.0006) [2023-12-28 02:28:14,435][106226] Updated weights for policy 0, policy_version 1003740 (0.0007) [2023-12-28 02:28:14,449][106225] Updated weights for policy 1, policy_version 1006077 (0.0006) [2023-12-28 02:28:15,185][106226] Updated weights for policy 0, policy_version 1003750 (0.0009) [2023-12-28 02:28:15,207][106225] Updated weights for policy 1, policy_version 1006087 (0.0007) [2023-12-28 02:28:15,247][106226] Updated weights for policy 0, policy_version 1003760 (0.0010) [2023-12-28 02:28:15,272][106225] Updated weights for policy 1, policy_version 1006097 (0.0006) [2023-12-28 02:28:15,307][106226] Updated weights for policy 0, policy_version 1003770 (0.0010) [2023-12-28 02:28:15,333][106225] Updated weights for policy 1, policy_version 1006107 (0.0006) [2023-12-28 02:28:16,038][106226] Updated weights for policy 0, policy_version 1003780 (0.0011) [2023-12-28 02:28:16,067][106225] Updated weights for policy 1, policy_version 1006117 (0.0006) [2023-12-28 02:28:16,088][106226] Updated weights for policy 0, policy_version 1003790 (0.0010) [2023-12-28 02:28:16,120][106225] Updated weights for policy 1, policy_version 1006127 (0.0005) [2023-12-28 02:28:16,145][106226] Updated weights for policy 0, policy_version 1003800 (0.0010) [2023-12-28 02:28:16,170][106225] Updated weights for policy 1, policy_version 1006137 (0.0006) [2023-12-28 02:28:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19549.7). Total num frames: 514629632. Throughput: 0: 10119.8, 1: 9920.4. Samples: 514628472. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:16,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.873')] [2023-12-28 02:28:16,869][106226] Updated weights for policy 0, policy_version 1003810 (0.0010) [2023-12-28 02:28:16,893][106225] Updated weights for policy 1, policy_version 1006147 (0.0007) [2023-12-28 02:28:16,919][106226] Updated weights for policy 0, policy_version 1003820 (0.0010) [2023-12-28 02:28:16,948][106225] Updated weights for policy 1, policy_version 1006157 (0.0006) [2023-12-28 02:28:16,966][106226] Updated weights for policy 0, policy_version 1003830 (0.0010) [2023-12-28 02:28:17,001][106225] Updated weights for policy 1, policy_version 1006167 (0.0007) [2023-12-28 02:28:17,030][106226] Updated weights for policy 0, policy_version 1003840 (0.0010) [2023-12-28 02:28:17,726][106225] Updated weights for policy 1, policy_version 1006177 (0.0007) [2023-12-28 02:28:17,756][106226] Updated weights for policy 0, policy_version 1003850 (0.0011) [2023-12-28 02:28:17,770][106225] Updated weights for policy 1, policy_version 1006187 (0.0006) [2023-12-28 02:28:17,819][106226] Updated weights for policy 0, policy_version 1003860 (0.0010) [2023-12-28 02:28:17,821][106225] Updated weights for policy 1, policy_version 1006197 (0.0007) [2023-12-28 02:28:17,866][106226] Updated weights for policy 0, policy_version 1003870 (0.0010) [2023-12-28 02:28:17,874][106225] Updated weights for policy 1, policy_version 1006207 (0.0007) [2023-12-28 02:28:18,483][106226] Updated weights for policy 0, policy_version 1003880 (0.0009) [2023-12-28 02:28:18,544][106226] Updated weights for policy 0, policy_version 1003890 (0.0009) [2023-12-28 02:28:18,604][106226] Updated weights for policy 0, policy_version 1003900 (0.0009) [2023-12-28 02:28:18,684][106225] Updated weights for policy 1, policy_version 1006217 (0.0009) [2023-12-28 02:28:18,750][106225] Updated weights for policy 1, policy_version 1006227 (0.0007) [2023-12-28 02:28:18,812][106225] Updated weights for policy 1, policy_version 1006237 (0.0008) [2023-12-28 02:28:19,314][106226] Updated weights for policy 0, policy_version 1003910 (0.0010) [2023-12-28 02:28:19,384][106226] Updated weights for policy 0, policy_version 1003920 (0.0011) [2023-12-28 02:28:19,437][106226] Updated weights for policy 0, policy_version 1003930 (0.0009) [2023-12-28 02:28:19,579][106225] Updated weights for policy 1, policy_version 1006247 (0.0007) [2023-12-28 02:28:19,649][106225] Updated weights for policy 1, policy_version 1006257 (0.0008) [2023-12-28 02:28:19,714][106225] Updated weights for policy 1, policy_version 1006267 (0.0008) [2023-12-28 02:28:20,224][106226] Updated weights for policy 0, policy_version 1003940 (0.0011) [2023-12-28 02:28:20,280][106226] Updated weights for policy 0, policy_version 1003950 (0.0011) [2023-12-28 02:28:20,343][106226] Updated weights for policy 0, policy_version 1003960 (0.0010) [2023-12-28 02:28:20,456][106225] Updated weights for policy 1, policy_version 1006277 (0.0008) [2023-12-28 02:28:20,514][106225] Updated weights for policy 1, policy_version 1006287 (0.0008) [2023-12-28 02:28:20,576][106225] Updated weights for policy 1, policy_version 1006297 (0.0007) [2023-12-28 02:28:21,045][106226] Updated weights for policy 0, policy_version 1003970 (0.0009) [2023-12-28 02:28:21,105][106226] Updated weights for policy 0, policy_version 1003980 (0.0008) [2023-12-28 02:28:21,172][106226] Updated weights for policy 0, policy_version 1003990 (0.0008) [2023-12-28 02:28:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19522.0). Total num frames: 514727936. Throughput: 0: 10110.5, 1: 9868.8. Samples: 514743564. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:21,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-5.026')] [2023-12-28 02:28:21,242][106226] Updated weights for policy 0, policy_version 1004000 (0.0009) [2023-12-28 02:28:21,296][106225] Updated weights for policy 1, policy_version 1006307 (0.0007) [2023-12-28 02:28:21,355][106225] Updated weights for policy 1, policy_version 1006317 (0.0008) [2023-12-28 02:28:21,424][106225] Updated weights for policy 1, policy_version 1006327 (0.0009) [2023-12-28 02:28:22,084][106226] Updated weights for policy 0, policy_version 1004010 (0.0007) [2023-12-28 02:28:22,131][106225] Updated weights for policy 1, policy_version 1006337 (0.0007) [2023-12-28 02:28:22,150][106226] Updated weights for policy 0, policy_version 1004020 (0.0008) [2023-12-28 02:28:22,192][106225] Updated weights for policy 1, policy_version 1006347 (0.0005) [2023-12-28 02:28:22,209][106226] Updated weights for policy 0, policy_version 1004030 (0.0009) [2023-12-28 02:28:22,253][106225] Updated weights for policy 1, policy_version 1006357 (0.0006) [2023-12-28 02:28:22,318][106225] Updated weights for policy 1, policy_version 1006367 (0.0007) [2023-12-28 02:28:22,916][106226] Updated weights for policy 0, policy_version 1004040 (0.0008) [2023-12-28 02:28:22,972][106226] Updated weights for policy 0, policy_version 1004050 (0.0009) [2023-12-28 02:28:22,998][106225] Updated weights for policy 1, policy_version 1006377 (0.0006) [2023-12-28 02:28:23,028][106226] Updated weights for policy 0, policy_version 1004060 (0.0007) [2023-12-28 02:28:23,053][106225] Updated weights for policy 1, policy_version 1006387 (0.0005) [2023-12-28 02:28:23,099][106225] Updated weights for policy 1, policy_version 1006397 (0.0005) [2023-12-28 02:28:23,733][106225] Updated weights for policy 1, policy_version 1006408 (0.0007) [2023-12-28 02:28:23,777][106226] Updated weights for policy 0, policy_version 1004070 (0.0008) [2023-12-28 02:28:23,784][106225] Updated weights for policy 1, policy_version 1006418 (0.0005) [2023-12-28 02:28:23,838][106226] Updated weights for policy 0, policy_version 1004080 (0.0007) [2023-12-28 02:28:23,844][106225] Updated weights for policy 1, policy_version 1006428 (0.0008) [2023-12-28 02:28:23,898][106226] Updated weights for policy 0, policy_version 1004090 (0.0009) [2023-12-28 02:28:24,473][106225] Updated weights for policy 1, policy_version 1006438 (0.0007) [2023-12-28 02:28:24,538][106225] Updated weights for policy 1, policy_version 1006448 (0.0005) [2023-12-28 02:28:24,599][106225] Updated weights for policy 1, policy_version 1006458 (0.0007) [2023-12-28 02:28:24,657][106226] Updated weights for policy 0, policy_version 1004100 (0.0008) [2023-12-28 02:28:24,706][106226] Updated weights for policy 0, policy_version 1004110 (0.0009) [2023-12-28 02:28:24,760][106226] Updated weights for policy 0, policy_version 1004120 (0.0009) [2023-12-28 02:28:25,122][106225] Updated weights for policy 1, policy_version 1006468 (0.0008) [2023-12-28 02:28:25,169][106225] Updated weights for policy 1, policy_version 1006478 (0.0010) [2023-12-28 02:28:25,228][106225] Updated weights for policy 1, policy_version 1006488 (0.0009) [2023-12-28 02:28:25,551][106226] Updated weights for policy 0, policy_version 1004130 (0.0009) [2023-12-28 02:28:25,615][106226] Updated weights for policy 0, policy_version 1004140 (0.0005) [2023-12-28 02:28:25,673][106226] Updated weights for policy 0, policy_version 1004150 (0.0007) [2023-12-28 02:28:25,723][106226] Updated weights for policy 0, policy_version 1004160 (0.0008) [2023-12-28 02:28:25,909][106225] Updated weights for policy 1, policy_version 1006498 (0.0007) [2023-12-28 02:28:25,966][106225] Updated weights for policy 1, policy_version 1006508 (0.0005) [2023-12-28 02:28:26,017][106225] Updated weights for policy 1, policy_version 1006518 (0.0005) [2023-12-28 02:28:26,071][106225] Updated weights for policy 1, policy_version 1006528 (0.0007) [2023-12-28 02:28:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19521.9). Total num frames: 514834432. Throughput: 0: 10037.5, 1: 9901.9. Samples: 514800428. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:26,176][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.791')] [2023-12-28 02:28:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001006528_257712128.pth... [2023-12-28 02:28:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001004160_257122304.pth... [2023-12-28 02:28:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001005376_257417216.pth [2023-12-28 02:28:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001003008_256827392.pth [2023-12-28 02:28:26,376][106226] Updated weights for policy 0, policy_version 1004170 (0.0011) [2023-12-28 02:28:26,426][106226] Updated weights for policy 0, policy_version 1004180 (0.0011) [2023-12-28 02:28:26,472][106226] Updated weights for policy 0, policy_version 1004190 (0.0008) [2023-12-28 02:28:26,687][106225] Updated weights for policy 1, policy_version 1006538 (0.0005) [2023-12-28 02:28:26,757][106225] Updated weights for policy 1, policy_version 1006548 (0.0007) [2023-12-28 02:28:26,821][106225] Updated weights for policy 1, policy_version 1006558 (0.0006) [2023-12-28 02:28:27,122][106226] Updated weights for policy 0, policy_version 1004200 (0.0006) [2023-12-28 02:28:27,184][106226] Updated weights for policy 0, policy_version 1004210 (0.0006) [2023-12-28 02:28:27,252][106226] Updated weights for policy 0, policy_version 1004220 (0.0006) [2023-12-28 02:28:27,534][106225] Updated weights for policy 1, policy_version 1006568 (0.0008) [2023-12-28 02:28:27,593][106225] Updated weights for policy 1, policy_version 1006578 (0.0008) [2023-12-28 02:28:27,646][106225] Updated weights for policy 1, policy_version 1006588 (0.0010) [2023-12-28 02:28:27,878][106226] Updated weights for policy 0, policy_version 1004230 (0.0006) [2023-12-28 02:28:27,946][106226] Updated weights for policy 0, policy_version 1004240 (0.0011) [2023-12-28 02:28:28,002][106226] Updated weights for policy 0, policy_version 1004250 (0.0010) [2023-12-28 02:28:28,319][106225] Updated weights for policy 1, policy_version 1006598 (0.0010) [2023-12-28 02:28:28,382][106225] Updated weights for policy 1, policy_version 1006608 (0.0010) [2023-12-28 02:28:28,443][106225] Updated weights for policy 1, policy_version 1006618 (0.0010) [2023-12-28 02:28:28,620][106226] Updated weights for policy 0, policy_version 1004260 (0.0008) [2023-12-28 02:28:28,680][106226] Updated weights for policy 0, policy_version 1004270 (0.0005) [2023-12-28 02:28:28,740][106226] Updated weights for policy 0, policy_version 1004280 (0.0005) [2023-12-28 02:28:29,134][106225] Updated weights for policy 1, policy_version 1006628 (0.0010) [2023-12-28 02:28:29,186][106225] Updated weights for policy 1, policy_version 1006638 (0.0010) [2023-12-28 02:28:29,237][106225] Updated weights for policy 1, policy_version 1006648 (0.0009) [2023-12-28 02:28:29,371][106226] Updated weights for policy 0, policy_version 1004290 (0.0006) [2023-12-28 02:28:29,429][106226] Updated weights for policy 0, policy_version 1004300 (0.0006) [2023-12-28 02:28:29,489][106226] Updated weights for policy 0, policy_version 1004310 (0.0007) [2023-12-28 02:28:29,548][106226] Updated weights for policy 0, policy_version 1004320 (0.0006) [2023-12-28 02:28:29,910][106225] Updated weights for policy 1, policy_version 1006658 (0.0008) [2023-12-28 02:28:29,978][106225] Updated weights for policy 1, policy_version 1006668 (0.0010) [2023-12-28 02:28:30,038][106225] Updated weights for policy 1, policy_version 1006678 (0.0010) [2023-12-28 02:28:30,101][106225] Updated weights for policy 1, policy_version 1006688 (0.0010) [2023-12-28 02:28:30,167][106226] Updated weights for policy 0, policy_version 1004330 (0.0008) [2023-12-28 02:28:30,222][106226] Updated weights for policy 0, policy_version 1004340 (0.0008) [2023-12-28 02:28:30,281][106226] Updated weights for policy 0, policy_version 1004350 (0.0009) [2023-12-28 02:28:30,754][106225] Updated weights for policy 1, policy_version 1006698 (0.0010) [2023-12-28 02:28:30,806][106225] Updated weights for policy 1, policy_version 1006708 (0.0010) [2023-12-28 02:28:30,862][106225] Updated weights for policy 1, policy_version 1006718 (0.0006) [2023-12-28 02:28:30,936][106226] Updated weights for policy 0, policy_version 1004360 (0.0009) [2023-12-28 02:28:30,996][106226] Updated weights for policy 0, policy_version 1004370 (0.0006) [2023-12-28 02:28:31,060][106226] Updated weights for policy 0, policy_version 1004380 (0.0008) [2023-12-28 02:28:31,174][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 514940928. Throughput: 0: 10078.9, 1: 10022.7. Samples: 514926648. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:31,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-5.107')] [2023-12-28 02:28:31,531][106225] Updated weights for policy 1, policy_version 1006728 (0.0009) [2023-12-28 02:28:31,585][106225] Updated weights for policy 1, policy_version 1006738 (0.0010) [2023-12-28 02:28:31,644][106225] Updated weights for policy 1, policy_version 1006748 (0.0009) [2023-12-28 02:28:31,711][106226] Updated weights for policy 0, policy_version 1004390 (0.0009) [2023-12-28 02:28:31,772][106226] Updated weights for policy 0, policy_version 1004400 (0.0008) [2023-12-28 02:28:31,833][106226] Updated weights for policy 0, policy_version 1004410 (0.0008) [2023-12-28 02:28:32,438][106225] Updated weights for policy 1, policy_version 1006758 (0.0008) [2023-12-28 02:28:32,501][106225] Updated weights for policy 1, policy_version 1006768 (0.0008) [2023-12-28 02:28:32,556][106225] Updated weights for policy 1, policy_version 1006778 (0.0007) [2023-12-28 02:28:32,607][106226] Updated weights for policy 0, policy_version 1004420 (0.0009) [2023-12-28 02:28:32,661][106226] Updated weights for policy 0, policy_version 1004430 (0.0010) [2023-12-28 02:28:32,723][106226] Updated weights for policy 0, policy_version 1004440 (0.0010) [2023-12-28 02:28:33,192][106225] Updated weights for policy 1, policy_version 1006788 (0.0007) [2023-12-28 02:28:33,244][106225] Updated weights for policy 1, policy_version 1006798 (0.0005) [2023-12-28 02:28:33,291][106225] Updated weights for policy 1, policy_version 1006808 (0.0005) [2023-12-28 02:28:33,513][106226] Updated weights for policy 0, policy_version 1004450 (0.0009) [2023-12-28 02:28:33,560][106226] Updated weights for policy 0, policy_version 1004460 (0.0008) [2023-12-28 02:28:33,620][106226] Updated weights for policy 0, policy_version 1004470 (0.0008) [2023-12-28 02:28:33,674][106226] Updated weights for policy 0, policy_version 1004480 (0.0006) [2023-12-28 02:28:33,927][106225] Updated weights for policy 1, policy_version 1006818 (0.0006) [2023-12-28 02:28:33,979][106225] Updated weights for policy 1, policy_version 1006828 (0.0007) [2023-12-28 02:28:34,024][106225] Updated weights for policy 1, policy_version 1006838 (0.0008) [2023-12-28 02:28:34,069][106225] Updated weights for policy 1, policy_version 1006848 (0.0008) [2023-12-28 02:28:34,415][106226] Updated weights for policy 0, policy_version 1004490 (0.0008) [2023-12-28 02:28:34,483][106226] Updated weights for policy 0, policy_version 1004500 (0.0009) [2023-12-28 02:28:34,544][106226] Updated weights for policy 0, policy_version 1004510 (0.0008) [2023-12-28 02:28:34,775][106225] Updated weights for policy 1, policy_version 1006858 (0.0008) [2023-12-28 02:28:34,829][106225] Updated weights for policy 1, policy_version 1006868 (0.0010) [2023-12-28 02:28:34,872][106225] Updated weights for policy 1, policy_version 1006878 (0.0010) [2023-12-28 02:28:35,276][106226] Updated weights for policy 0, policy_version 1004520 (0.0007) [2023-12-28 02:28:35,334][106226] Updated weights for policy 0, policy_version 1004530 (0.0005) [2023-12-28 02:28:35,391][106226] Updated weights for policy 0, policy_version 1004540 (0.0006) [2023-12-28 02:28:35,539][106225] Updated weights for policy 1, policy_version 1006888 (0.0006) [2023-12-28 02:28:35,594][106225] Updated weights for policy 1, policy_version 1006898 (0.0005) [2023-12-28 02:28:35,640][106225] Updated weights for policy 1, policy_version 1006908 (0.0005) [2023-12-28 02:28:36,008][106226] Updated weights for policy 0, policy_version 1004550 (0.0008) [2023-12-28 02:28:36,057][106226] Updated weights for policy 0, policy_version 1004560 (0.0005) [2023-12-28 02:28:36,114][106226] Updated weights for policy 0, policy_version 1004570 (0.0006) [2023-12-28 02:28:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 515039232. Throughput: 0: 9989.2, 1: 9989.2. Samples: 515046748. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:36,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.833')] [2023-12-28 02:28:36,248][106225] Updated weights for policy 1, policy_version 1006918 (0.0009) [2023-12-28 02:28:36,309][106225] Updated weights for policy 1, policy_version 1006928 (0.0008) [2023-12-28 02:28:36,376][106225] Updated weights for policy 1, policy_version 1006938 (0.0009) [2023-12-28 02:28:36,831][106226] Updated weights for policy 0, policy_version 1004580 (0.0009) [2023-12-28 02:28:36,878][106226] Updated weights for policy 0, policy_version 1004590 (0.0009) [2023-12-28 02:28:36,928][106226] Updated weights for policy 0, policy_version 1004600 (0.0005) [2023-12-28 02:28:37,051][106225] Updated weights for policy 1, policy_version 1006948 (0.0008) [2023-12-28 02:28:37,102][106225] Updated weights for policy 1, policy_version 1006958 (0.0009) [2023-12-28 02:28:37,160][106225] Updated weights for policy 1, policy_version 1006969 (0.0010) [2023-12-28 02:28:37,627][106226] Updated weights for policy 0, policy_version 1004610 (0.0007) [2023-12-28 02:28:37,685][106226] Updated weights for policy 0, policy_version 1004620 (0.0010) [2023-12-28 02:28:37,750][106226] Updated weights for policy 0, policy_version 1004630 (0.0011) [2023-12-28 02:28:37,812][106226] Updated weights for policy 0, policy_version 1004640 (0.0011) [2023-12-28 02:28:37,923][106225] Updated weights for policy 1, policy_version 1006979 (0.0006) [2023-12-28 02:28:37,975][106225] Updated weights for policy 1, policy_version 1006989 (0.0007) [2023-12-28 02:28:38,028][106225] Updated weights for policy 1, policy_version 1006999 (0.0007) [2023-12-28 02:28:38,563][106226] Updated weights for policy 0, policy_version 1004650 (0.0010) [2023-12-28 02:28:38,635][106226] Updated weights for policy 0, policy_version 1004660 (0.0010) [2023-12-28 02:28:38,692][106226] Updated weights for policy 0, policy_version 1004670 (0.0009) [2023-12-28 02:28:38,739][106225] Updated weights for policy 1, policy_version 1007009 (0.0007) [2023-12-28 02:28:38,803][106225] Updated weights for policy 1, policy_version 1007019 (0.0005) [2023-12-28 02:28:38,869][106225] Updated weights for policy 1, policy_version 1007029 (0.0008) [2023-12-28 02:28:38,938][106225] Updated weights for policy 1, policy_version 1007039 (0.0007) [2023-12-28 02:28:39,364][106226] Updated weights for policy 0, policy_version 1004680 (0.0011) [2023-12-28 02:28:39,432][106226] Updated weights for policy 0, policy_version 1004690 (0.0011) [2023-12-28 02:28:39,494][106226] Updated weights for policy 0, policy_version 1004700 (0.0011) [2023-12-28 02:28:39,655][106225] Updated weights for policy 1, policy_version 1007049 (0.0008) [2023-12-28 02:28:39,715][106225] Updated weights for policy 1, policy_version 1007059 (0.0010) [2023-12-28 02:28:39,774][106225] Updated weights for policy 1, policy_version 1007069 (0.0011) [2023-12-28 02:28:40,176][106226] Updated weights for policy 0, policy_version 1004710 (0.0008) [2023-12-28 02:28:40,239][106226] Updated weights for policy 0, policy_version 1004720 (0.0009) [2023-12-28 02:28:40,304][106226] Updated weights for policy 0, policy_version 1004730 (0.0007) [2023-12-28 02:28:40,504][106225] Updated weights for policy 1, policy_version 1007079 (0.0010) [2023-12-28 02:28:40,558][106225] Updated weights for policy 1, policy_version 1007089 (0.0010) [2023-12-28 02:28:40,608][106225] Updated weights for policy 1, policy_version 1007099 (0.0010) [2023-12-28 02:28:41,021][106226] Updated weights for policy 0, policy_version 1004740 (0.0007) [2023-12-28 02:28:41,099][106226] Updated weights for policy 0, policy_version 1004750 (0.0008) [2023-12-28 02:28:41,169][106226] Updated weights for policy 0, policy_version 1004760 (0.0009) [2023-12-28 02:28:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19521.9). Total num frames: 515129344. Throughput: 0: 9978.7, 1: 9996.7. Samples: 515106084. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:41,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-4.790')] [2023-12-28 02:28:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001007104_257859584.pth... [2023-12-28 02:28:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001005920_257556480.pth [2023-12-28 02:28:41,214][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001004768_257277952.pth... [2023-12-28 02:28:41,217][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001003616_256983040.pth [2023-12-28 02:28:41,282][106225] Updated weights for policy 1, policy_version 1007109 (0.0009) [2023-12-28 02:28:41,352][106225] Updated weights for policy 1, policy_version 1007119 (0.0009) [2023-12-28 02:28:41,420][106225] Updated weights for policy 1, policy_version 1007129 (0.0009) [2023-12-28 02:28:41,974][106226] Updated weights for policy 0, policy_version 1004770 (0.0008) [2023-12-28 02:28:42,035][106226] Updated weights for policy 0, policy_version 1004780 (0.0006) [2023-12-28 02:28:42,101][106226] Updated weights for policy 0, policy_version 1004790 (0.0006) [2023-12-28 02:28:42,163][106226] Updated weights for policy 0, policy_version 1004800 (0.0007) [2023-12-28 02:28:42,192][106225] Updated weights for policy 1, policy_version 1007139 (0.0008) [2023-12-28 02:28:42,255][106225] Updated weights for policy 1, policy_version 1007149 (0.0008) [2023-12-28 02:28:42,316][106225] Updated weights for policy 1, policy_version 1007159 (0.0008) [2023-12-28 02:28:42,789][106226] Updated weights for policy 0, policy_version 1004810 (0.0008) [2023-12-28 02:28:42,842][106226] Updated weights for policy 0, policy_version 1004820 (0.0008) [2023-12-28 02:28:42,903][106226] Updated weights for policy 0, policy_version 1004830 (0.0009) [2023-12-28 02:28:43,034][106225] Updated weights for policy 1, policy_version 1007169 (0.0008) [2023-12-28 02:28:43,083][106225] Updated weights for policy 1, policy_version 1007179 (0.0008) [2023-12-28 02:28:43,134][106225] Updated weights for policy 1, policy_version 1007189 (0.0006) [2023-12-28 02:28:43,188][106225] Updated weights for policy 1, policy_version 1007199 (0.0006) [2023-12-28 02:28:43,674][106226] Updated weights for policy 0, policy_version 1004840 (0.0009) [2023-12-28 02:28:43,733][106226] Updated weights for policy 0, policy_version 1004850 (0.0008) [2023-12-28 02:28:43,785][106226] Updated weights for policy 0, policy_version 1004860 (0.0009) [2023-12-28 02:28:43,898][106225] Updated weights for policy 1, policy_version 1007209 (0.0009) [2023-12-28 02:28:43,945][106225] Updated weights for policy 1, policy_version 1007219 (0.0008) [2023-12-28 02:28:43,992][106225] Updated weights for policy 1, policy_version 1007229 (0.0008) [2023-12-28 02:28:44,537][106226] Updated weights for policy 0, policy_version 1004870 (0.0010) [2023-12-28 02:28:44,596][106226] Updated weights for policy 0, policy_version 1004880 (0.0008) [2023-12-28 02:28:44,646][106226] Updated weights for policy 0, policy_version 1004890 (0.0007) [2023-12-28 02:28:44,647][106225] Updated weights for policy 1, policy_version 1007239 (0.0007) [2023-12-28 02:28:44,695][106225] Updated weights for policy 1, policy_version 1007249 (0.0007) [2023-12-28 02:28:44,747][106225] Updated weights for policy 1, policy_version 1007259 (0.0007) [2023-12-28 02:28:45,431][106225] Updated weights for policy 1, policy_version 1007269 (0.0009) [2023-12-28 02:28:45,433][106226] Updated weights for policy 0, policy_version 1004900 (0.0006) [2023-12-28 02:28:45,482][106225] Updated weights for policy 1, policy_version 1007279 (0.0010) [2023-12-28 02:28:45,488][106226] Updated weights for policy 0, policy_version 1004910 (0.0006) [2023-12-28 02:28:45,536][106225] Updated weights for policy 1, policy_version 1007289 (0.0010) [2023-12-28 02:28:45,550][106226] Updated weights for policy 0, policy_version 1004920 (0.0006) [2023-12-28 02:28:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19549.7). Total num frames: 515227648. Throughput: 0: 9894.9, 1: 9960.0. Samples: 515220460. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:46,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-4.902')] [2023-12-28 02:28:46,182][106225] Updated weights for policy 1, policy_version 1007299 (0.0010) [2023-12-28 02:28:46,212][106226] Updated weights for policy 0, policy_version 1004930 (0.0006) [2023-12-28 02:28:46,249][106225] Updated weights for policy 1, policy_version 1007309 (0.0011) [2023-12-28 02:28:46,268][106226] Updated weights for policy 0, policy_version 1004940 (0.0006) [2023-12-28 02:28:46,301][106225] Updated weights for policy 1, policy_version 1007319 (0.0010) [2023-12-28 02:28:46,328][106226] Updated weights for policy 0, policy_version 1004950 (0.0006) [2023-12-28 02:28:46,391][106226] Updated weights for policy 0, policy_version 1004960 (0.0005) [2023-12-28 02:28:46,967][106225] Updated weights for policy 1, policy_version 1007329 (0.0010) [2023-12-28 02:28:47,020][106225] Updated weights for policy 1, policy_version 1007339 (0.0007) [2023-12-28 02:28:47,081][106226] Updated weights for policy 0, policy_version 1004970 (0.0011) [2023-12-28 02:28:47,092][106225] Updated weights for policy 1, policy_version 1007349 (0.0006) [2023-12-28 02:28:47,135][106226] Updated weights for policy 0, policy_version 1004980 (0.0010) [2023-12-28 02:28:47,152][106225] Updated weights for policy 1, policy_version 1007359 (0.0006) [2023-12-28 02:28:47,185][106226] Updated weights for policy 0, policy_version 1004990 (0.0010) [2023-12-28 02:28:47,711][106225] Updated weights for policy 1, policy_version 1007369 (0.0006) [2023-12-28 02:28:47,778][106225] Updated weights for policy 1, policy_version 1007379 (0.0008) [2023-12-28 02:28:47,826][106226] Updated weights for policy 0, policy_version 1005000 (0.0009) [2023-12-28 02:28:47,835][106225] Updated weights for policy 1, policy_version 1007389 (0.0005) [2023-12-28 02:28:47,875][106226] Updated weights for policy 0, policy_version 1005010 (0.0008) [2023-12-28 02:28:47,927][106226] Updated weights for policy 0, policy_version 1005020 (0.0010) [2023-12-28 02:28:48,384][106225] Updated weights for policy 1, policy_version 1007399 (0.0007) [2023-12-28 02:28:48,446][106225] Updated weights for policy 1, policy_version 1007409 (0.0008) [2023-12-28 02:28:48,511][106225] Updated weights for policy 1, policy_version 1007419 (0.0007) [2023-12-28 02:28:48,658][106226] Updated weights for policy 0, policy_version 1005030 (0.0008) [2023-12-28 02:28:48,711][106226] Updated weights for policy 0, policy_version 1005040 (0.0009) [2023-12-28 02:28:48,779][106226] Updated weights for policy 0, policy_version 1005050 (0.0006) [2023-12-28 02:28:49,361][106225] Updated weights for policy 1, policy_version 1007429 (0.0011) [2023-12-28 02:28:49,379][106226] Updated weights for policy 0, policy_version 1005060 (0.0007) [2023-12-28 02:28:49,413][106225] Updated weights for policy 1, policy_version 1007439 (0.0007) [2023-12-28 02:28:49,450][106226] Updated weights for policy 0, policy_version 1005070 (0.0008) [2023-12-28 02:28:49,469][106225] Updated weights for policy 1, policy_version 1007449 (0.0006) [2023-12-28 02:28:49,510][106226] Updated weights for policy 0, policy_version 1005080 (0.0008) [2023-12-28 02:28:50,230][106225] Updated weights for policy 1, policy_version 1007459 (0.0009) [2023-12-28 02:28:50,256][106226] Updated weights for policy 0, policy_version 1005090 (0.0008) [2023-12-28 02:28:50,292][106225] Updated weights for policy 1, policy_version 1007469 (0.0010) [2023-12-28 02:28:50,317][106226] Updated weights for policy 0, policy_version 1005100 (0.0008) [2023-12-28 02:28:50,349][106225] Updated weights for policy 1, policy_version 1007479 (0.0010) [2023-12-28 02:28:50,379][106226] Updated weights for policy 0, policy_version 1005110 (0.0006) [2023-12-28 02:28:50,433][106226] Updated weights for policy 0, policy_version 1005120 (0.0008) [2023-12-28 02:28:50,985][106225] Updated weights for policy 1, policy_version 1007489 (0.0010) [2023-12-28 02:28:51,047][106225] Updated weights for policy 1, policy_version 1007499 (0.0007) [2023-12-28 02:28:51,111][106225] Updated weights for policy 1, policy_version 1007509 (0.0010) [2023-12-28 02:28:51,174][106225] Updated weights for policy 1, policy_version 1007519 (0.0008) [2023-12-28 02:28:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 515325952. Throughput: 0: 9824.8, 1: 10035.8. Samples: 515341780. Policy #0 lag: (min: 15.0, avg: 17.3, max: 47.0) [2023-12-28 02:28:51,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.765')] [2023-12-28 02:28:51,179][106226] Updated weights for policy 0, policy_version 1005130 (0.0009) [2023-12-28 02:28:51,245][106226] Updated weights for policy 0, policy_version 1005140 (0.0008) [2023-12-28 02:28:51,300][106226] Updated weights for policy 0, policy_version 1005150 (0.0008) [2023-12-28 02:28:51,914][106225] Updated weights for policy 1, policy_version 1007529 (0.0010) [2023-12-28 02:28:51,965][106225] Updated weights for policy 1, policy_version 1007539 (0.0010) [2023-12-28 02:28:52,026][106225] Updated weights for policy 1, policy_version 1007549 (0.0010) [2023-12-28 02:28:52,080][106226] Updated weights for policy 0, policy_version 1005160 (0.0007) [2023-12-28 02:28:52,130][106226] Updated weights for policy 0, policy_version 1005170 (0.0008) [2023-12-28 02:28:52,192][106226] Updated weights for policy 0, policy_version 1005180 (0.0008) [2023-12-28 02:28:52,750][106225] Updated weights for policy 1, policy_version 1007559 (0.0008) [2023-12-28 02:28:52,819][106225] Updated weights for policy 1, policy_version 1007569 (0.0006) [2023-12-28 02:28:52,884][106225] Updated weights for policy 1, policy_version 1007579 (0.0005) [2023-12-28 02:28:52,981][106226] Updated weights for policy 0, policy_version 1005190 (0.0008) [2023-12-28 02:28:53,042][106226] Updated weights for policy 0, policy_version 1005200 (0.0009) [2023-12-28 02:28:53,103][106226] Updated weights for policy 0, policy_version 1005210 (0.0009) [2023-12-28 02:28:53,542][106225] Updated weights for policy 1, policy_version 1007589 (0.0006) [2023-12-28 02:28:53,593][106225] Updated weights for policy 1, policy_version 1007599 (0.0006) [2023-12-28 02:28:53,645][106225] Updated weights for policy 1, policy_version 1007609 (0.0005) [2023-12-28 02:28:53,841][106226] Updated weights for policy 0, policy_version 1005220 (0.0008) [2023-12-28 02:28:53,899][106226] Updated weights for policy 0, policy_version 1005230 (0.0005) [2023-12-28 02:28:53,958][106226] Updated weights for policy 0, policy_version 1005240 (0.0006) [2023-12-28 02:28:54,299][106225] Updated weights for policy 1, policy_version 1007619 (0.0006) [2023-12-28 02:28:54,353][106225] Updated weights for policy 1, policy_version 1007629 (0.0006) [2023-12-28 02:28:54,413][106225] Updated weights for policy 1, policy_version 1007639 (0.0005) [2023-12-28 02:28:54,707][106226] Updated weights for policy 0, policy_version 1005250 (0.0009) [2023-12-28 02:28:54,762][106226] Updated weights for policy 0, policy_version 1005260 (0.0009) [2023-12-28 02:28:54,825][106226] Updated weights for policy 0, policy_version 1005270 (0.0009) [2023-12-28 02:28:54,888][106226] Updated weights for policy 0, policy_version 1005280 (0.0009) [2023-12-28 02:28:54,979][106225] Updated weights for policy 1, policy_version 1007649 (0.0005) [2023-12-28 02:28:55,039][106225] Updated weights for policy 1, policy_version 1007659 (0.0008) [2023-12-28 02:28:55,094][106225] Updated weights for policy 1, policy_version 1007669 (0.0009) [2023-12-28 02:28:55,144][106225] Updated weights for policy 1, policy_version 1007679 (0.0008) [2023-12-28 02:28:55,573][106226] Updated weights for policy 0, policy_version 1005290 (0.0008) [2023-12-28 02:28:55,627][106226] Updated weights for policy 0, policy_version 1005300 (0.0009) [2023-12-28 02:28:55,686][106226] Updated weights for policy 0, policy_version 1005310 (0.0009) [2023-12-28 02:28:55,822][106225] Updated weights for policy 1, policy_version 1007689 (0.0005) [2023-12-28 02:28:55,883][106225] Updated weights for policy 1, policy_version 1007699 (0.0006) [2023-12-28 02:28:55,939][106225] Updated weights for policy 1, policy_version 1007709 (0.0005) [2023-12-28 02:28:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 515432448. Throughput: 0: 9757.0, 1: 10033.5. Samples: 515399880. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:28:56,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.833')] [2023-12-28 02:28:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001005312_257417216.pth... [2023-12-28 02:28:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001007712_258015232.pth... [2023-12-28 02:28:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001004160_257122304.pth [2023-12-28 02:28:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001006528_257712128.pth [2023-12-28 02:28:56,470][106226] Updated weights for policy 0, policy_version 1005320 (0.0005) [2023-12-28 02:28:56,489][106225] Updated weights for policy 1, policy_version 1007719 (0.0007) [2023-12-28 02:28:56,523][106226] Updated weights for policy 0, policy_version 1005330 (0.0005) [2023-12-28 02:28:56,544][106225] Updated weights for policy 1, policy_version 1007729 (0.0005) [2023-12-28 02:28:56,589][106226] Updated weights for policy 0, policy_version 1005340 (0.0005) [2023-12-28 02:28:56,607][106225] Updated weights for policy 1, policy_version 1007739 (0.0005) [2023-12-28 02:28:57,227][106225] Updated weights for policy 1, policy_version 1007749 (0.0008) [2023-12-28 02:28:57,245][106226] Updated weights for policy 0, policy_version 1005350 (0.0006) [2023-12-28 02:28:57,278][106225] Updated weights for policy 1, policy_version 1007759 (0.0010) [2023-12-28 02:28:57,306][106226] Updated weights for policy 0, policy_version 1005360 (0.0007) [2023-12-28 02:28:57,339][106225] Updated weights for policy 1, policy_version 1007769 (0.0010) [2023-12-28 02:28:57,372][106226] Updated weights for policy 0, policy_version 1005370 (0.0007) [2023-12-28 02:28:58,016][106225] Updated weights for policy 1, policy_version 1007779 (0.0010) [2023-12-28 02:28:58,073][106225] Updated weights for policy 1, policy_version 1007789 (0.0010) [2023-12-28 02:28:58,104][106226] Updated weights for policy 0, policy_version 1005380 (0.0008) [2023-12-28 02:28:58,127][106225] Updated weights for policy 1, policy_version 1007799 (0.0010) [2023-12-28 02:28:58,156][106226] Updated weights for policy 0, policy_version 1005390 (0.0005) [2023-12-28 02:28:58,225][106226] Updated weights for policy 0, policy_version 1005400 (0.0007) [2023-12-28 02:28:58,974][106226] Updated weights for policy 0, policy_version 1005410 (0.0010) [2023-12-28 02:28:58,981][106225] Updated weights for policy 1, policy_version 1007809 (0.0010) [2023-12-28 02:28:59,028][106226] Updated weights for policy 0, policy_version 1005420 (0.0007) [2023-12-28 02:28:59,045][106225] Updated weights for policy 1, policy_version 1007819 (0.0008) [2023-12-28 02:28:59,091][106226] Updated weights for policy 0, policy_version 1005430 (0.0006) [2023-12-28 02:28:59,104][106225] Updated weights for policy 1, policy_version 1007829 (0.0008) [2023-12-28 02:28:59,153][106226] Updated weights for policy 0, policy_version 1005440 (0.0008) [2023-12-28 02:28:59,160][106225] Updated weights for policy 1, policy_version 1007839 (0.0008) [2023-12-28 02:28:59,857][106225] Updated weights for policy 1, policy_version 1007849 (0.0008) [2023-12-28 02:28:59,921][106225] Updated weights for policy 1, policy_version 1007859 (0.0009) [2023-12-28 02:28:59,962][106226] Updated weights for policy 0, policy_version 1005450 (0.0007) [2023-12-28 02:28:59,987][106225] Updated weights for policy 1, policy_version 1007869 (0.0007) [2023-12-28 02:29:00,028][106226] Updated weights for policy 0, policy_version 1005460 (0.0008) [2023-12-28 02:29:00,079][106226] Updated weights for policy 0, policy_version 1005470 (0.0009) [2023-12-28 02:29:00,642][106225] Updated weights for policy 1, policy_version 1007879 (0.0006) [2023-12-28 02:29:00,706][106225] Updated weights for policy 1, policy_version 1007889 (0.0005) [2023-12-28 02:29:00,764][106225] Updated weights for policy 1, policy_version 1007899 (0.0005) [2023-12-28 02:29:00,771][106226] Updated weights for policy 0, policy_version 1005480 (0.0006) [2023-12-28 02:29:00,821][106226] Updated weights for policy 0, policy_version 1005490 (0.0005) [2023-12-28 02:29:00,875][106226] Updated weights for policy 0, policy_version 1005500 (0.0006) [2023-12-28 02:29:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19549.7). Total num frames: 515530752. Throughput: 0: 9710.4, 1: 10075.6. Samples: 515518840. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:01,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-5.013')] [2023-12-28 02:29:01,324][106225] Updated weights for policy 1, policy_version 1007909 (0.0006) [2023-12-28 02:29:01,388][106225] Updated weights for policy 1, policy_version 1007919 (0.0008) [2023-12-28 02:29:01,458][106225] Updated weights for policy 1, policy_version 1007929 (0.0007) [2023-12-28 02:29:01,574][106226] Updated weights for policy 0, policy_version 1005510 (0.0007) [2023-12-28 02:29:01,636][106226] Updated weights for policy 0, policy_version 1005520 (0.0007) [2023-12-28 02:29:01,706][106226] Updated weights for policy 0, policy_version 1005530 (0.0007) [2023-12-28 02:29:02,062][106225] Updated weights for policy 1, policy_version 1007939 (0.0005) [2023-12-28 02:29:02,108][106225] Updated weights for policy 1, policy_version 1007949 (0.0005) [2023-12-28 02:29:02,155][106225] Updated weights for policy 1, policy_version 1007959 (0.0006) [2023-12-28 02:29:02,452][106226] Updated weights for policy 0, policy_version 1005540 (0.0009) [2023-12-28 02:29:02,506][106226] Updated weights for policy 0, policy_version 1005550 (0.0006) [2023-12-28 02:29:02,571][106226] Updated weights for policy 0, policy_version 1005560 (0.0006) [2023-12-28 02:29:02,898][106225] Updated weights for policy 1, policy_version 1007969 (0.0008) [2023-12-28 02:29:02,952][106225] Updated weights for policy 1, policy_version 1007979 (0.0006) [2023-12-28 02:29:03,002][106225] Updated weights for policy 1, policy_version 1007989 (0.0010) [2023-12-28 02:29:03,045][106225] Updated weights for policy 1, policy_version 1007999 (0.0010) [2023-12-28 02:29:03,190][106226] Updated weights for policy 0, policy_version 1005570 (0.0007) [2023-12-28 02:29:03,247][106226] Updated weights for policy 0, policy_version 1005580 (0.0005) [2023-12-28 02:29:03,296][106226] Updated weights for policy 0, policy_version 1005590 (0.0005) [2023-12-28 02:29:03,359][106226] Updated weights for policy 0, policy_version 1005600 (0.0005) [2023-12-28 02:29:03,739][106225] Updated weights for policy 1, policy_version 1008009 (0.0007) [2023-12-28 02:29:03,796][106225] Updated weights for policy 1, policy_version 1008019 (0.0006) [2023-12-28 02:29:03,849][106225] Updated weights for policy 1, policy_version 1008029 (0.0007) [2023-12-28 02:29:03,885][106226] Updated weights for policy 0, policy_version 1005610 (0.0008) [2023-12-28 02:29:03,946][106226] Updated weights for policy 0, policy_version 1005620 (0.0008) [2023-12-28 02:29:04,018][106226] Updated weights for policy 0, policy_version 1005630 (0.0009) [2023-12-28 02:29:04,493][106225] Updated weights for policy 1, policy_version 1008039 (0.0007) [2023-12-28 02:29:04,556][106225] Updated weights for policy 1, policy_version 1008049 (0.0008) [2023-12-28 02:29:04,610][106225] Updated weights for policy 1, policy_version 1008059 (0.0010) [2023-12-28 02:29:04,673][106226] Updated weights for policy 0, policy_version 1005640 (0.0006) [2023-12-28 02:29:04,723][106226] Updated weights for policy 0, policy_version 1005650 (0.0005) [2023-12-28 02:29:04,771][106226] Updated weights for policy 0, policy_version 1005660 (0.0005) [2023-12-28 02:29:05,324][106225] Updated weights for policy 1, policy_version 1008069 (0.0007) [2023-12-28 02:29:05,383][106225] Updated weights for policy 1, policy_version 1008079 (0.0007) [2023-12-28 02:29:05,422][106226] Updated weights for policy 0, policy_version 1005670 (0.0008) [2023-12-28 02:29:05,436][106225] Updated weights for policy 1, policy_version 1008089 (0.0008) [2023-12-28 02:29:05,472][106226] Updated weights for policy 0, policy_version 1005680 (0.0011) [2023-12-28 02:29:05,522][106226] Updated weights for policy 0, policy_version 1005690 (0.0010) [2023-12-28 02:29:06,115][106225] Updated weights for policy 1, policy_version 1008099 (0.0006) [2023-12-28 02:29:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19549.7). Total num frames: 515629056. Throughput: 0: 9786.7, 1: 10203.9. Samples: 515643144. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:06,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-5.055')] [2023-12-28 02:29:06,179][106225] Updated weights for policy 1, policy_version 1008109 (0.0010) [2023-12-28 02:29:06,234][106226] Updated weights for policy 0, policy_version 1005700 (0.0010) [2023-12-28 02:29:06,244][106225] Updated weights for policy 1, policy_version 1008119 (0.0007) [2023-12-28 02:29:06,285][106226] Updated weights for policy 0, policy_version 1005710 (0.0011) [2023-12-28 02:29:06,342][106226] Updated weights for policy 0, policy_version 1005720 (0.0009) [2023-12-28 02:29:06,944][106226] Updated weights for policy 0, policy_version 1005730 (0.0008) [2023-12-28 02:29:06,997][106226] Updated weights for policy 0, policy_version 1005740 (0.0009) [2023-12-28 02:29:07,025][106225] Updated weights for policy 1, policy_version 1008129 (0.0006) [2023-12-28 02:29:07,049][106226] Updated weights for policy 0, policy_version 1005750 (0.0008) [2023-12-28 02:29:07,086][106225] Updated weights for policy 1, policy_version 1008139 (0.0007) [2023-12-28 02:29:07,109][106226] Updated weights for policy 0, policy_version 1005760 (0.0007) [2023-12-28 02:29:07,149][106225] Updated weights for policy 1, policy_version 1008149 (0.0008) [2023-12-28 02:29:07,203][106225] Updated weights for policy 1, policy_version 1008159 (0.0010) [2023-12-28 02:29:07,766][106225] Updated weights for policy 1, policy_version 1008169 (0.0006) [2023-12-28 02:29:07,771][106226] Updated weights for policy 0, policy_version 1005770 (0.0008) [2023-12-28 02:29:07,826][106226] Updated weights for policy 0, policy_version 1005780 (0.0008) [2023-12-28 02:29:07,827][106225] Updated weights for policy 1, policy_version 1008179 (0.0008) [2023-12-28 02:29:07,886][106225] Updated weights for policy 1, policy_version 1008189 (0.0006) [2023-12-28 02:29:07,893][106226] Updated weights for policy 0, policy_version 1005790 (0.0005) [2023-12-28 02:29:08,501][106226] Updated weights for policy 0, policy_version 1005800 (0.0007) [2023-12-28 02:29:08,519][106225] Updated weights for policy 1, policy_version 1008199 (0.0006) [2023-12-28 02:29:08,565][106226] Updated weights for policy 0, policy_version 1005810 (0.0009) [2023-12-28 02:29:08,578][106225] Updated weights for policy 1, policy_version 1008209 (0.0005) [2023-12-28 02:29:08,621][106226] Updated weights for policy 0, policy_version 1005820 (0.0008) [2023-12-28 02:29:08,636][106225] Updated weights for policy 1, policy_version 1008219 (0.0005) [2023-12-28 02:29:09,230][106225] Updated weights for policy 1, policy_version 1008229 (0.0008) [2023-12-28 02:29:09,295][106225] Updated weights for policy 1, policy_version 1008239 (0.0010) [2023-12-28 02:29:09,362][106225] Updated weights for policy 1, policy_version 1008249 (0.0010) [2023-12-28 02:29:09,383][106226] Updated weights for policy 0, policy_version 1005830 (0.0012) [2023-12-28 02:29:09,459][106226] Updated weights for policy 0, policy_version 1005841 (0.0010) [2023-12-28 02:29:09,528][106226] Updated weights for policy 0, policy_version 1005851 (0.0011) [2023-12-28 02:29:10,152][106225] Updated weights for policy 1, policy_version 1008259 (0.0009) [2023-12-28 02:29:10,207][106225] Updated weights for policy 1, policy_version 1008269 (0.0010) [2023-12-28 02:29:10,266][106225] Updated weights for policy 1, policy_version 1008279 (0.0010) [2023-12-28 02:29:10,281][106226] Updated weights for policy 0, policy_version 1005861 (0.0009) [2023-12-28 02:29:10,334][106226] Updated weights for policy 0, policy_version 1005871 (0.0007) [2023-12-28 02:29:10,394][106226] Updated weights for policy 0, policy_version 1005881 (0.0008) [2023-12-28 02:29:10,931][106225] Updated weights for policy 1, policy_version 1008289 (0.0011) [2023-12-28 02:29:10,998][106225] Updated weights for policy 1, policy_version 1008299 (0.0010) [2023-12-28 02:29:11,065][106225] Updated weights for policy 1, policy_version 1008309 (0.0010) [2023-12-28 02:29:11,122][106225] Updated weights for policy 1, policy_version 1008319 (0.0009) [2023-12-28 02:29:11,132][106226] Updated weights for policy 0, policy_version 1005891 (0.0007) [2023-12-28 02:29:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 515735552. Throughput: 0: 9886.9, 1: 10238.2. Samples: 515706052. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:11,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.820')] [2023-12-28 02:29:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001008320_258170880.pth... [2023-12-28 02:29:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001007104_257859584.pth [2023-12-28 02:29:11,196][106226] Updated weights for policy 0, policy_version 1005901 (0.0009) [2023-12-28 02:29:11,253][106226] Updated weights for policy 0, policy_version 1005911 (0.0009) [2023-12-28 02:29:11,315][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001005920_257572864.pth... [2023-12-28 02:29:11,318][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001004768_257277952.pth [2023-12-28 02:29:11,995][106225] Updated weights for policy 1, policy_version 1008329 (0.0009) [2023-12-28 02:29:12,047][106225] Updated weights for policy 1, policy_version 1008339 (0.0009) [2023-12-28 02:29:12,100][106225] Updated weights for policy 1, policy_version 1008349 (0.0009) [2023-12-28 02:29:12,147][106226] Updated weights for policy 0, policy_version 1005921 (0.0009) [2023-12-28 02:29:12,217][106226] Updated weights for policy 0, policy_version 1005931 (0.0008) [2023-12-28 02:29:12,288][106226] Updated weights for policy 0, policy_version 1005941 (0.0008) [2023-12-28 02:29:12,355][106226] Updated weights for policy 0, policy_version 1005951 (0.0007) [2023-12-28 02:29:12,835][106225] Updated weights for policy 1, policy_version 1008359 (0.0009) [2023-12-28 02:29:12,899][106225] Updated weights for policy 1, policy_version 1008369 (0.0007) [2023-12-28 02:29:12,960][106225] Updated weights for policy 1, policy_version 1008379 (0.0005) [2023-12-28 02:29:13,080][106226] Updated weights for policy 0, policy_version 1005961 (0.0009) [2023-12-28 02:29:13,138][106226] Updated weights for policy 0, policy_version 1005971 (0.0008) [2023-12-28 02:29:13,205][106226] Updated weights for policy 0, policy_version 1005981 (0.0009) [2023-12-28 02:29:13,474][106225] Updated weights for policy 1, policy_version 1008389 (0.0008) [2023-12-28 02:29:13,537][106225] Updated weights for policy 1, policy_version 1008399 (0.0010) [2023-12-28 02:29:13,597][106225] Updated weights for policy 1, policy_version 1008409 (0.0010) [2023-12-28 02:29:13,946][106226] Updated weights for policy 0, policy_version 1005991 (0.0009) [2023-12-28 02:29:13,998][106226] Updated weights for policy 0, policy_version 1006001 (0.0008) [2023-12-28 02:29:14,056][106226] Updated weights for policy 0, policy_version 1006011 (0.0008) [2023-12-28 02:29:14,283][106225] Updated weights for policy 1, policy_version 1008419 (0.0010) [2023-12-28 02:29:14,335][106225] Updated weights for policy 1, policy_version 1008429 (0.0008) [2023-12-28 02:29:14,399][106225] Updated weights for policy 1, policy_version 1008439 (0.0009) [2023-12-28 02:29:14,804][106226] Updated weights for policy 0, policy_version 1006021 (0.0009) [2023-12-28 02:29:14,872][106226] Updated weights for policy 0, policy_version 1006031 (0.0009) [2023-12-28 02:29:14,927][106226] Updated weights for policy 0, policy_version 1006041 (0.0009) [2023-12-28 02:29:15,069][106225] Updated weights for policy 1, policy_version 1008449 (0.0010) [2023-12-28 02:29:15,141][106225] Updated weights for policy 1, policy_version 1008459 (0.0006) [2023-12-28 02:29:15,210][106225] Updated weights for policy 1, policy_version 1008469 (0.0007) [2023-12-28 02:29:15,278][106225] Updated weights for policy 1, policy_version 1008479 (0.0008) [2023-12-28 02:29:15,715][106226] Updated weights for policy 0, policy_version 1006051 (0.0009) [2023-12-28 02:29:15,763][106226] Updated weights for policy 0, policy_version 1006061 (0.0009) [2023-12-28 02:29:15,813][106226] Updated weights for policy 0, policy_version 1006071 (0.0009) [2023-12-28 02:29:15,901][106225] Updated weights for policy 1, policy_version 1008489 (0.0006) [2023-12-28 02:29:15,946][106225] Updated weights for policy 1, policy_version 1008499 (0.0005) [2023-12-28 02:29:16,002][106225] Updated weights for policy 1, policy_version 1008509 (0.0005) [2023-12-28 02:29:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19577.5). Total num frames: 515833856. Throughput: 0: 9693.6, 1: 10137.1. Samples: 515819032. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:16,176][105115] Avg episode reward: [(0, '-4.677'), (1, '-4.929')] [2023-12-28 02:29:16,569][106225] Updated weights for policy 1, policy_version 1008519 (0.0007) [2023-12-28 02:29:16,616][106226] Updated weights for policy 0, policy_version 1006081 (0.0008) [2023-12-28 02:29:16,629][106225] Updated weights for policy 1, policy_version 1008529 (0.0008) [2023-12-28 02:29:16,673][106226] Updated weights for policy 0, policy_version 1006091 (0.0007) [2023-12-28 02:29:16,689][106225] Updated weights for policy 1, policy_version 1008539 (0.0006) [2023-12-28 02:29:16,724][106226] Updated weights for policy 0, policy_version 1006101 (0.0006) [2023-12-28 02:29:16,789][106226] Updated weights for policy 0, policy_version 1006111 (0.0009) [2023-12-28 02:29:17,272][106225] Updated weights for policy 1, policy_version 1008549 (0.0006) [2023-12-28 02:29:17,334][106225] Updated weights for policy 1, policy_version 1008559 (0.0005) [2023-12-28 02:29:17,389][106225] Updated weights for policy 1, policy_version 1008569 (0.0005) [2023-12-28 02:29:17,592][106226] Updated weights for policy 0, policy_version 1006121 (0.0009) [2023-12-28 02:29:17,658][106226] Updated weights for policy 0, policy_version 1006131 (0.0010) [2023-12-28 02:29:17,725][106226] Updated weights for policy 0, policy_version 1006141 (0.0009) [2023-12-28 02:29:17,956][106225] Updated weights for policy 1, policy_version 1008579 (0.0006) [2023-12-28 02:29:18,010][106225] Updated weights for policy 1, policy_version 1008589 (0.0009) [2023-12-28 02:29:18,064][106225] Updated weights for policy 1, policy_version 1008599 (0.0008) [2023-12-28 02:29:18,499][106226] Updated weights for policy 0, policy_version 1006151 (0.0008) [2023-12-28 02:29:18,555][106226] Updated weights for policy 0, policy_version 1006161 (0.0009) [2023-12-28 02:29:18,614][106226] Updated weights for policy 0, policy_version 1006171 (0.0008) [2023-12-28 02:29:18,783][106225] Updated weights for policy 1, policy_version 1008609 (0.0007) [2023-12-28 02:29:18,841][106225] Updated weights for policy 1, policy_version 1008619 (0.0005) [2023-12-28 02:29:18,900][106225] Updated weights for policy 1, policy_version 1008629 (0.0006) [2023-12-28 02:29:18,958][106225] Updated weights for policy 1, policy_version 1008639 (0.0008) [2023-12-28 02:29:19,373][106226] Updated weights for policy 0, policy_version 1006181 (0.0009) [2023-12-28 02:29:19,454][106226] Updated weights for policy 0, policy_version 1006191 (0.0008) [2023-12-28 02:29:19,538][106226] Updated weights for policy 0, policy_version 1006201 (0.0007) [2023-12-28 02:29:19,644][106225] Updated weights for policy 1, policy_version 1008649 (0.0008) [2023-12-28 02:29:19,700][106225] Updated weights for policy 1, policy_version 1008659 (0.0007) [2023-12-28 02:29:19,755][106225] Updated weights for policy 1, policy_version 1008669 (0.0008) [2023-12-28 02:29:20,216][106226] Updated weights for policy 0, policy_version 1006211 (0.0007) [2023-12-28 02:29:20,281][106226] Updated weights for policy 0, policy_version 1006221 (0.0008) [2023-12-28 02:29:20,350][106226] Updated weights for policy 0, policy_version 1006231 (0.0008) [2023-12-28 02:29:20,584][106225] Updated weights for policy 1, policy_version 1008679 (0.0009) [2023-12-28 02:29:20,641][106225] Updated weights for policy 1, policy_version 1008689 (0.0008) [2023-12-28 02:29:20,698][106225] Updated weights for policy 1, policy_version 1008699 (0.0009) [2023-12-28 02:29:21,103][106226] Updated weights for policy 0, policy_version 1006241 (0.0008) [2023-12-28 02:29:21,170][106226] Updated weights for policy 0, policy_version 1006251 (0.0008) [2023-12-28 02:29:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19522.0). Total num frames: 515923968. Throughput: 0: 9631.8, 1: 10158.0. Samples: 515937288. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:21,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-4.563')] [2023-12-28 02:29:21,238][106226] Updated weights for policy 0, policy_version 1006261 (0.0008) [2023-12-28 02:29:21,302][106226] Updated weights for policy 0, policy_version 1006271 (0.0010) [2023-12-28 02:29:21,460][106225] Updated weights for policy 1, policy_version 1008709 (0.0007) [2023-12-28 02:29:21,525][106225] Updated weights for policy 1, policy_version 1008719 (0.0008) [2023-12-28 02:29:21,580][106225] Updated weights for policy 1, policy_version 1008729 (0.0008) [2023-12-28 02:29:22,050][106226] Updated weights for policy 0, policy_version 1006281 (0.0006) [2023-12-28 02:29:22,120][106226] Updated weights for policy 0, policy_version 1006291 (0.0008) [2023-12-28 02:29:22,184][106226] Updated weights for policy 0, policy_version 1006301 (0.0011) [2023-12-28 02:29:22,345][106225] Updated weights for policy 1, policy_version 1008739 (0.0008) [2023-12-28 02:29:22,407][106225] Updated weights for policy 1, policy_version 1008749 (0.0007) [2023-12-28 02:29:22,467][106225] Updated weights for policy 1, policy_version 1008759 (0.0006) [2023-12-28 02:29:22,852][106226] Updated weights for policy 0, policy_version 1006311 (0.0011) [2023-12-28 02:29:22,914][106226] Updated weights for policy 0, policy_version 1006321 (0.0010) [2023-12-28 02:29:22,982][106226] Updated weights for policy 0, policy_version 1006331 (0.0005) [2023-12-28 02:29:23,189][106225] Updated weights for policy 1, policy_version 1008769 (0.0009) [2023-12-28 02:29:23,250][106225] Updated weights for policy 1, policy_version 1008779 (0.0010) [2023-12-28 02:29:23,303][106225] Updated weights for policy 1, policy_version 1008789 (0.0010) [2023-12-28 02:29:23,349][106225] Updated weights for policy 1, policy_version 1008799 (0.0010) [2023-12-28 02:29:23,580][106226] Updated weights for policy 0, policy_version 1006341 (0.0006) [2023-12-28 02:29:23,635][106226] Updated weights for policy 0, policy_version 1006351 (0.0005) [2023-12-28 02:29:23,683][106226] Updated weights for policy 0, policy_version 1006361 (0.0005) [2023-12-28 02:29:24,068][106225] Updated weights for policy 1, policy_version 1008809 (0.0010) [2023-12-28 02:29:24,118][106225] Updated weights for policy 1, policy_version 1008819 (0.0007) [2023-12-28 02:29:24,170][106225] Updated weights for policy 1, policy_version 1008829 (0.0005) [2023-12-28 02:29:24,296][106226] Updated weights for policy 0, policy_version 1006371 (0.0007) [2023-12-28 02:29:24,361][106226] Updated weights for policy 0, policy_version 1006381 (0.0011) [2023-12-28 02:29:24,427][106226] Updated weights for policy 0, policy_version 1006391 (0.0011) [2023-12-28 02:29:24,824][106225] Updated weights for policy 1, policy_version 1008839 (0.0009) [2023-12-28 02:29:24,886][106225] Updated weights for policy 1, policy_version 1008849 (0.0010) [2023-12-28 02:29:24,940][106225] Updated weights for policy 1, policy_version 1008859 (0.0010) [2023-12-28 02:29:25,132][106226] Updated weights for policy 0, policy_version 1006401 (0.0011) [2023-12-28 02:29:25,197][106226] Updated weights for policy 0, policy_version 1006411 (0.0011) [2023-12-28 02:29:25,259][106226] Updated weights for policy 0, policy_version 1006421 (0.0011) [2023-12-28 02:29:25,318][106226] Updated weights for policy 0, policy_version 1006431 (0.0010) [2023-12-28 02:29:25,597][106225] Updated weights for policy 1, policy_version 1008869 (0.0008) [2023-12-28 02:29:25,646][106225] Updated weights for policy 1, policy_version 1008879 (0.0008) [2023-12-28 02:29:25,690][106225] Updated weights for policy 1, policy_version 1008889 (0.0009) [2023-12-28 02:29:25,992][106226] Updated weights for policy 0, policy_version 1006441 (0.0009) [2023-12-28 02:29:26,041][106226] Updated weights for policy 0, policy_version 1006451 (0.0008) [2023-12-28 02:29:26,102][106226] Updated weights for policy 0, policy_version 1006461 (0.0009) [2023-12-28 02:29:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19933.8, 300 sec: 19549.7). Total num frames: 516030464. Throughput: 0: 9670.5, 1: 10115.7. Samples: 515996472. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:26,176][105115] Avg episode reward: [(0, '-4.821'), (1, '-4.958')] [2023-12-28 02:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001006464_257712128.pth... [2023-12-28 02:29:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001008896_258318336.pth... [2023-12-28 02:29:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001005312_257417216.pth [2023-12-28 02:29:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001007712_258015232.pth [2023-12-28 02:29:26,254][106225] Updated weights for policy 1, policy_version 1008899 (0.0005) [2023-12-28 02:29:26,309][106225] Updated weights for policy 1, policy_version 1008909 (0.0005) [2023-12-28 02:29:26,363][106225] Updated weights for policy 1, policy_version 1008919 (0.0005) [2023-12-28 02:29:26,889][106225] Updated weights for policy 1, policy_version 1008929 (0.0006) [2023-12-28 02:29:26,933][106226] Updated weights for policy 0, policy_version 1006471 (0.0006) [2023-12-28 02:29:26,935][106225] Updated weights for policy 1, policy_version 1008939 (0.0010) [2023-12-28 02:29:26,982][106225] Updated weights for policy 1, policy_version 1008949 (0.0010) [2023-12-28 02:29:26,983][106226] Updated weights for policy 0, policy_version 1006481 (0.0006) [2023-12-28 02:29:27,028][106225] Updated weights for policy 1, policy_version 1008959 (0.0010) [2023-12-28 02:29:27,033][106226] Updated weights for policy 0, policy_version 1006491 (0.0005) [2023-12-28 02:29:27,699][106225] Updated weights for policy 1, policy_version 1008969 (0.0009) [2023-12-28 02:29:27,756][106225] Updated weights for policy 1, policy_version 1008979 (0.0009) [2023-12-28 02:29:27,799][106226] Updated weights for policy 0, policy_version 1006501 (0.0008) [2023-12-28 02:29:27,821][106225] Updated weights for policy 1, policy_version 1008989 (0.0007) [2023-12-28 02:29:27,859][106226] Updated weights for policy 0, policy_version 1006511 (0.0009) [2023-12-28 02:29:27,916][106226] Updated weights for policy 0, policy_version 1006521 (0.0009) [2023-12-28 02:29:28,421][106225] Updated weights for policy 1, policy_version 1008999 (0.0008) [2023-12-28 02:29:28,481][106225] Updated weights for policy 1, policy_version 1009009 (0.0008) [2023-12-28 02:29:28,543][106225] Updated weights for policy 1, policy_version 1009019 (0.0005) [2023-12-28 02:29:28,618][106226] Updated weights for policy 0, policy_version 1006531 (0.0009) [2023-12-28 02:29:28,666][106226] Updated weights for policy 0, policy_version 1006541 (0.0009) [2023-12-28 02:29:28,718][106226] Updated weights for policy 0, policy_version 1006551 (0.0008) [2023-12-28 02:29:29,138][106225] Updated weights for policy 1, policy_version 1009029 (0.0005) [2023-12-28 02:29:29,186][106225] Updated weights for policy 1, policy_version 1009039 (0.0005) [2023-12-28 02:29:29,261][106225] Updated weights for policy 1, policy_version 1009049 (0.0007) [2023-12-28 02:29:29,417][106226] Updated weights for policy 0, policy_version 1006561 (0.0008) [2023-12-28 02:29:29,476][106226] Updated weights for policy 0, policy_version 1006571 (0.0006) [2023-12-28 02:29:29,565][106226] Updated weights for policy 0, policy_version 1006581 (0.0005) [2023-12-28 02:29:29,627][106226] Updated weights for policy 0, policy_version 1006591 (0.0005) [2023-12-28 02:29:29,965][106225] Updated weights for policy 1, policy_version 1009059 (0.0007) [2023-12-28 02:29:30,018][106225] Updated weights for policy 1, policy_version 1009069 (0.0008) [2023-12-28 02:29:30,073][106225] Updated weights for policy 1, policy_version 1009079 (0.0008) [2023-12-28 02:29:30,178][106226] Updated weights for policy 0, policy_version 1006601 (0.0008) [2023-12-28 02:29:30,238][106226] Updated weights for policy 0, policy_version 1006611 (0.0011) [2023-12-28 02:29:30,301][106226] Updated weights for policy 0, policy_version 1006621 (0.0011) [2023-12-28 02:29:30,777][106225] Updated weights for policy 1, policy_version 1009089 (0.0008) [2023-12-28 02:29:30,840][106225] Updated weights for policy 1, policy_version 1009099 (0.0005) [2023-12-28 02:29:30,903][106225] Updated weights for policy 1, policy_version 1009109 (0.0005) [2023-12-28 02:29:30,957][106225] Updated weights for policy 1, policy_version 1009119 (0.0005) [2023-12-28 02:29:30,995][106226] Updated weights for policy 0, policy_version 1006631 (0.0009) [2023-12-28 02:29:31,063][106226] Updated weights for policy 0, policy_version 1006641 (0.0008) [2023-12-28 02:29:31,126][106226] Updated weights for policy 0, policy_version 1006651 (0.0008) [2023-12-28 02:29:31,174][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19549.7). Total num frames: 516136960. Throughput: 0: 9717.2, 1: 10306.5. Samples: 516121528. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:31,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-5.013')] [2023-12-28 02:29:31,648][106225] Updated weights for policy 1, policy_version 1009129 (0.0007) [2023-12-28 02:29:31,712][106225] Updated weights for policy 1, policy_version 1009139 (0.0007) [2023-12-28 02:29:31,781][106225] Updated weights for policy 1, policy_version 1009149 (0.0007) [2023-12-28 02:29:31,909][106226] Updated weights for policy 0, policy_version 1006661 (0.0009) [2023-12-28 02:29:31,978][106226] Updated weights for policy 0, policy_version 1006671 (0.0009) [2023-12-28 02:29:32,045][106226] Updated weights for policy 0, policy_version 1006681 (0.0008) [2023-12-28 02:29:32,410][106225] Updated weights for policy 1, policy_version 1009159 (0.0008) [2023-12-28 02:29:32,477][106225] Updated weights for policy 1, policy_version 1009169 (0.0008) [2023-12-28 02:29:32,541][106225] Updated weights for policy 1, policy_version 1009179 (0.0008) [2023-12-28 02:29:32,858][106226] Updated weights for policy 0, policy_version 1006691 (0.0009) [2023-12-28 02:29:32,915][106226] Updated weights for policy 0, policy_version 1006701 (0.0009) [2023-12-28 02:29:32,972][106226] Updated weights for policy 0, policy_version 1006711 (0.0008) [2023-12-28 02:29:33,129][106225] Updated weights for policy 1, policy_version 1009189 (0.0008) [2023-12-28 02:29:33,178][106225] Updated weights for policy 1, policy_version 1009199 (0.0006) [2023-12-28 02:29:33,235][106225] Updated weights for policy 1, policy_version 1009209 (0.0005) [2023-12-28 02:29:33,685][106226] Updated weights for policy 0, policy_version 1006721 (0.0010) [2023-12-28 02:29:33,748][106226] Updated weights for policy 0, policy_version 1006731 (0.0009) [2023-12-28 02:29:33,809][106226] Updated weights for policy 0, policy_version 1006741 (0.0009) [2023-12-28 02:29:33,866][106226] Updated weights for policy 0, policy_version 1006751 (0.0008) [2023-12-28 02:29:33,883][106225] Updated weights for policy 1, policy_version 1009219 (0.0006) [2023-12-28 02:29:33,938][106225] Updated weights for policy 1, policy_version 1009229 (0.0008) [2023-12-28 02:29:33,989][106225] Updated weights for policy 1, policy_version 1009239 (0.0008) [2023-12-28 02:29:34,636][106226] Updated weights for policy 0, policy_version 1006761 (0.0008) [2023-12-28 02:29:34,691][106226] Updated weights for policy 0, policy_version 1006771 (0.0008) [2023-12-28 02:29:34,712][106225] Updated weights for policy 1, policy_version 1009249 (0.0006) [2023-12-28 02:29:34,748][106226] Updated weights for policy 0, policy_version 1006781 (0.0006) [2023-12-28 02:29:34,768][106225] Updated weights for policy 1, policy_version 1009259 (0.0006) [2023-12-28 02:29:34,822][106225] Updated weights for policy 1, policy_version 1009269 (0.0005) [2023-12-28 02:29:34,882][106225] Updated weights for policy 1, policy_version 1009279 (0.0006) [2023-12-28 02:29:35,434][106226] Updated weights for policy 0, policy_version 1006791 (0.0006) [2023-12-28 02:29:35,451][106225] Updated weights for policy 1, policy_version 1009289 (0.0005) [2023-12-28 02:29:35,486][106226] Updated weights for policy 0, policy_version 1006801 (0.0005) [2023-12-28 02:29:35,502][106225] Updated weights for policy 1, policy_version 1009299 (0.0005) [2023-12-28 02:29:35,541][106226] Updated weights for policy 0, policy_version 1006811 (0.0005) [2023-12-28 02:29:35,560][106225] Updated weights for policy 1, policy_version 1009309 (0.0005) [2023-12-28 02:29:36,110][106225] Updated weights for policy 1, policy_version 1009319 (0.0007) [2023-12-28 02:29:36,175][106225] Updated weights for policy 1, policy_version 1009329 (0.0007) [2023-12-28 02:29:36,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.3, 300 sec: 19522.0). Total num frames: 516227072. Throughput: 0: 9654.9, 1: 10355.3. Samples: 516242240. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:36,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.571')] [2023-12-28 02:29:36,242][106226] Updated weights for policy 0, policy_version 1006821 (0.0006) [2023-12-28 02:29:36,242][106225] Updated weights for policy 1, policy_version 1009339 (0.0010) [2023-12-28 02:29:36,305][106226] Updated weights for policy 0, policy_version 1006831 (0.0006) [2023-12-28 02:29:36,376][106226] Updated weights for policy 0, policy_version 1006841 (0.0006) [2023-12-28 02:29:36,854][106225] Updated weights for policy 1, policy_version 1009349 (0.0007) [2023-12-28 02:29:36,916][106225] Updated weights for policy 1, policy_version 1009359 (0.0005) [2023-12-28 02:29:36,968][106225] Updated weights for policy 1, policy_version 1009369 (0.0008) [2023-12-28 02:29:37,023][106226] Updated weights for policy 0, policy_version 1006851 (0.0006) [2023-12-28 02:29:37,084][106226] Updated weights for policy 0, policy_version 1006861 (0.0005) [2023-12-28 02:29:37,134][106226] Updated weights for policy 0, policy_version 1006871 (0.0006) [2023-12-28 02:29:37,706][106226] Updated weights for policy 0, policy_version 1006881 (0.0005) [2023-12-28 02:29:37,728][106225] Updated weights for policy 1, policy_version 1009379 (0.0009) [2023-12-28 02:29:37,774][106226] Updated weights for policy 0, policy_version 1006891 (0.0005) [2023-12-28 02:29:37,789][106225] Updated weights for policy 1, policy_version 1009389 (0.0008) [2023-12-28 02:29:37,839][106226] Updated weights for policy 0, policy_version 1006901 (0.0006) [2023-12-28 02:29:37,839][106225] Updated weights for policy 1, policy_version 1009399 (0.0007) [2023-12-28 02:29:37,901][106226] Updated weights for policy 0, policy_version 1006911 (0.0006) [2023-12-28 02:29:38,446][106225] Updated weights for policy 1, policy_version 1009409 (0.0005) [2023-12-28 02:29:38,507][106225] Updated weights for policy 1, policy_version 1009419 (0.0006) [2023-12-28 02:29:38,512][106226] Updated weights for policy 0, policy_version 1006921 (0.0010) [2023-12-28 02:29:38,562][106225] Updated weights for policy 1, policy_version 1009429 (0.0007) [2023-12-28 02:29:38,572][106226] Updated weights for policy 0, policy_version 1006931 (0.0010) [2023-12-28 02:29:38,613][106225] Updated weights for policy 1, policy_version 1009439 (0.0005) [2023-12-28 02:29:38,633][106226] Updated weights for policy 0, policy_version 1006941 (0.0010) [2023-12-28 02:29:39,294][106225] Updated weights for policy 1, policy_version 1009449 (0.0007) [2023-12-28 02:29:39,336][106226] Updated weights for policy 0, policy_version 1006951 (0.0009) [2023-12-28 02:29:39,360][106225] Updated weights for policy 1, policy_version 1009459 (0.0008) [2023-12-28 02:29:39,414][106226] Updated weights for policy 0, policy_version 1006961 (0.0009) [2023-12-28 02:29:39,431][106225] Updated weights for policy 1, policy_version 1009469 (0.0008) [2023-12-28 02:29:39,481][106226] Updated weights for policy 0, policy_version 1006971 (0.0007) [2023-12-28 02:29:40,151][106226] Updated weights for policy 0, policy_version 1006981 (0.0007) [2023-12-28 02:29:40,210][106225] Updated weights for policy 1, policy_version 1009479 (0.0007) [2023-12-28 02:29:40,212][106226] Updated weights for policy 0, policy_version 1006991 (0.0009) [2023-12-28 02:29:40,273][106226] Updated weights for policy 0, policy_version 1007001 (0.0011) [2023-12-28 02:29:40,275][106225] Updated weights for policy 1, policy_version 1009489 (0.0006) [2023-12-28 02:29:40,335][106225] Updated weights for policy 1, policy_version 1009499 (0.0007) [2023-12-28 02:29:40,906][106226] Updated weights for policy 0, policy_version 1007011 (0.0009) [2023-12-28 02:29:40,960][106226] Updated weights for policy 0, policy_version 1007021 (0.0005) [2023-12-28 02:29:41,009][106225] Updated weights for policy 1, policy_version 1009509 (0.0008) [2023-12-28 02:29:41,015][106226] Updated weights for policy 0, policy_version 1007031 (0.0006) [2023-12-28 02:29:41,074][106225] Updated weights for policy 1, policy_version 1009519 (0.0008) [2023-12-28 02:29:41,140][106225] Updated weights for policy 1, policy_version 1009529 (0.0009) [2023-12-28 02:29:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19549.7). Total num frames: 516333568. Throughput: 0: 9737.8, 1: 10391.7. Samples: 516305704. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:41,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.993')] [2023-12-28 02:29:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001007040_257859584.pth... [2023-12-28 02:29:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001005920_257572864.pth [2023-12-28 02:29:41,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001009536_258482176.pth... [2023-12-28 02:29:41,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001008320_258170880.pth [2023-12-28 02:29:41,781][106226] Updated weights for policy 0, policy_version 1007041 (0.0007) [2023-12-28 02:29:41,851][106226] Updated weights for policy 0, policy_version 1007051 (0.0008) [2023-12-28 02:29:41,914][106226] Updated weights for policy 0, policy_version 1007061 (0.0008) [2023-12-28 02:29:41,933][106225] Updated weights for policy 1, policy_version 1009539 (0.0007) [2023-12-28 02:29:41,972][106226] Updated weights for policy 0, policy_version 1007071 (0.0007) [2023-12-28 02:29:41,993][106225] Updated weights for policy 1, policy_version 1009549 (0.0008) [2023-12-28 02:29:42,054][106225] Updated weights for policy 1, policy_version 1009559 (0.0007) [2023-12-28 02:29:42,682][106226] Updated weights for policy 0, policy_version 1007081 (0.0006) [2023-12-28 02:29:42,745][106226] Updated weights for policy 0, policy_version 1007091 (0.0008) [2023-12-28 02:29:42,809][106226] Updated weights for policy 0, policy_version 1007101 (0.0008) [2023-12-28 02:29:42,810][106225] Updated weights for policy 1, policy_version 1009569 (0.0009) [2023-12-28 02:29:42,867][106225] Updated weights for policy 1, policy_version 1009579 (0.0008) [2023-12-28 02:29:42,924][106225] Updated weights for policy 1, policy_version 1009589 (0.0009) [2023-12-28 02:29:42,984][106225] Updated weights for policy 1, policy_version 1009599 (0.0006) [2023-12-28 02:29:43,455][106226] Updated weights for policy 0, policy_version 1007111 (0.0005) [2023-12-28 02:29:43,510][106226] Updated weights for policy 0, policy_version 1007121 (0.0008) [2023-12-28 02:29:43,571][106226] Updated weights for policy 0, policy_version 1007131 (0.0010) [2023-12-28 02:29:43,616][106225] Updated weights for policy 1, policy_version 1009609 (0.0009) [2023-12-28 02:29:43,675][106225] Updated weights for policy 1, policy_version 1009619 (0.0010) [2023-12-28 02:29:43,722][106225] Updated weights for policy 1, policy_version 1009629 (0.0010) [2023-12-28 02:29:44,207][106226] Updated weights for policy 0, policy_version 1007141 (0.0008) [2023-12-28 02:29:44,258][106226] Updated weights for policy 0, policy_version 1007151 (0.0008) [2023-12-28 02:29:44,302][106226] Updated weights for policy 0, policy_version 1007161 (0.0007) [2023-12-28 02:29:44,318][106225] Updated weights for policy 1, policy_version 1009639 (0.0010) [2023-12-28 02:29:44,375][106225] Updated weights for policy 1, policy_version 1009649 (0.0010) [2023-12-28 02:29:44,435][106225] Updated weights for policy 1, policy_version 1009659 (0.0010) [2023-12-28 02:29:45,034][106226] Updated weights for policy 0, policy_version 1007171 (0.0006) [2023-12-28 02:29:45,096][106225] Updated weights for policy 1, policy_version 1009669 (0.0010) [2023-12-28 02:29:45,101][106226] Updated weights for policy 0, policy_version 1007181 (0.0008) [2023-12-28 02:29:45,148][106225] Updated weights for policy 1, policy_version 1009679 (0.0010) [2023-12-28 02:29:45,161][106226] Updated weights for policy 0, policy_version 1007191 (0.0007) [2023-12-28 02:29:45,213][106225] Updated weights for policy 1, policy_version 1009689 (0.0010) [2023-12-28 02:29:45,888][106226] Updated weights for policy 0, policy_version 1007201 (0.0006) [2023-12-28 02:29:45,924][106225] Updated weights for policy 1, policy_version 1009699 (0.0009) [2023-12-28 02:29:45,952][106226] Updated weights for policy 0, policy_version 1007211 (0.0008) [2023-12-28 02:29:45,982][106225] Updated weights for policy 1, policy_version 1009709 (0.0010) [2023-12-28 02:29:46,012][106226] Updated weights for policy 0, policy_version 1007221 (0.0010) [2023-12-28 02:29:46,039][106225] Updated weights for policy 1, policy_version 1009719 (0.0010) [2023-12-28 02:29:46,069][106226] Updated weights for policy 0, policy_version 1007231 (0.0011) [2023-12-28 02:29:46,174][105115] Fps is (10 sec: 21299.6, 60 sec: 20206.9, 300 sec: 19577.5). Total num frames: 516440064. Throughput: 0: 9817.5, 1: 10306.3. Samples: 516424412. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:46,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.901')] [2023-12-28 02:29:46,708][106226] Updated weights for policy 0, policy_version 1007241 (0.0010) [2023-12-28 02:29:46,738][106225] Updated weights for policy 1, policy_version 1009729 (0.0010) [2023-12-28 02:29:46,765][106226] Updated weights for policy 0, policy_version 1007251 (0.0010) [2023-12-28 02:29:46,788][106225] Updated weights for policy 1, policy_version 1009739 (0.0005) [2023-12-28 02:29:46,825][106226] Updated weights for policy 0, policy_version 1007261 (0.0010) [2023-12-28 02:29:46,849][106225] Updated weights for policy 1, policy_version 1009749 (0.0008) [2023-12-28 02:29:46,908][106225] Updated weights for policy 1, policy_version 1009759 (0.0007) [2023-12-28 02:29:47,483][106226] Updated weights for policy 0, policy_version 1007271 (0.0007) [2023-12-28 02:29:47,532][106225] Updated weights for policy 1, policy_version 1009769 (0.0006) [2023-12-28 02:29:47,540][106226] Updated weights for policy 0, policy_version 1007281 (0.0006) [2023-12-28 02:29:47,589][106226] Updated weights for policy 0, policy_version 1007291 (0.0005) [2023-12-28 02:29:47,593][106225] Updated weights for policy 1, policy_version 1009779 (0.0005) [2023-12-28 02:29:47,661][106225] Updated weights for policy 1, policy_version 1009789 (0.0005) [2023-12-28 02:29:48,131][106226] Updated weights for policy 0, policy_version 1007301 (0.0008) [2023-12-28 02:29:48,178][106226] Updated weights for policy 0, policy_version 1007311 (0.0010) [2023-12-28 02:29:48,235][106226] Updated weights for policy 0, policy_version 1007321 (0.0010) [2023-12-28 02:29:48,292][106225] Updated weights for policy 1, policy_version 1009799 (0.0006) [2023-12-28 02:29:48,350][106225] Updated weights for policy 1, policy_version 1009809 (0.0008) [2023-12-28 02:29:48,405][106225] Updated weights for policy 1, policy_version 1009819 (0.0008) [2023-12-28 02:29:48,977][106226] Updated weights for policy 0, policy_version 1007331 (0.0010) [2023-12-28 02:29:49,033][106226] Updated weights for policy 0, policy_version 1007341 (0.0010) [2023-12-28 02:29:49,086][106226] Updated weights for policy 0, policy_version 1007351 (0.0010) [2023-12-28 02:29:49,160][106225] Updated weights for policy 1, policy_version 1009829 (0.0009) [2023-12-28 02:29:49,218][106225] Updated weights for policy 1, policy_version 1009839 (0.0010) [2023-12-28 02:29:49,281][106225] Updated weights for policy 1, policy_version 1009849 (0.0008) [2023-12-28 02:29:49,863][106226] Updated weights for policy 0, policy_version 1007361 (0.0010) [2023-12-28 02:29:49,935][106226] Updated weights for policy 0, policy_version 1007371 (0.0009) [2023-12-28 02:29:50,001][106226] Updated weights for policy 0, policy_version 1007381 (0.0008) [2023-12-28 02:29:50,064][106226] Updated weights for policy 0, policy_version 1007391 (0.0009) [2023-12-28 02:29:50,075][106225] Updated weights for policy 1, policy_version 1009859 (0.0008) [2023-12-28 02:29:50,134][106225] Updated weights for policy 1, policy_version 1009869 (0.0008) [2023-12-28 02:29:50,186][106225] Updated weights for policy 1, policy_version 1009879 (0.0008) [2023-12-28 02:29:50,795][106226] Updated weights for policy 0, policy_version 1007401 (0.0008) [2023-12-28 02:29:50,855][106226] Updated weights for policy 0, policy_version 1007411 (0.0010) [2023-12-28 02:29:50,909][106226] Updated weights for policy 0, policy_version 1007421 (0.0009) [2023-12-28 02:29:50,927][106225] Updated weights for policy 1, policy_version 1009889 (0.0009) [2023-12-28 02:29:50,995][106225] Updated weights for policy 1, policy_version 1009899 (0.0007) [2023-12-28 02:29:51,064][106225] Updated weights for policy 1, policy_version 1009909 (0.0009) [2023-12-28 02:29:51,131][106225] Updated weights for policy 1, policy_version 1009919 (0.0008) [2023-12-28 02:29:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20207.0, 300 sec: 19605.3). Total num frames: 516538368. Throughput: 0: 9754.3, 1: 10243.4. Samples: 516543040. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:51,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-5.328')] [2023-12-28 02:29:51,723][106226] Updated weights for policy 0, policy_version 1007431 (0.0008) [2023-12-28 02:29:51,794][106226] Updated weights for policy 0, policy_version 1007441 (0.0010) [2023-12-28 02:29:51,862][106226] Updated weights for policy 0, policy_version 1007451 (0.0006) [2023-12-28 02:29:51,913][106225] Updated weights for policy 1, policy_version 1009929 (0.0007) [2023-12-28 02:29:51,977][106225] Updated weights for policy 1, policy_version 1009939 (0.0009) [2023-12-28 02:29:52,042][106225] Updated weights for policy 1, policy_version 1009949 (0.0010) [2023-12-28 02:29:52,575][106226] Updated weights for policy 0, policy_version 1007461 (0.0009) [2023-12-28 02:29:52,632][106226] Updated weights for policy 0, policy_version 1007471 (0.0011) [2023-12-28 02:29:52,700][106226] Updated weights for policy 0, policy_version 1007481 (0.0011) [2023-12-28 02:29:52,720][106225] Updated weights for policy 1, policy_version 1009959 (0.0007) [2023-12-28 02:29:52,774][106225] Updated weights for policy 1, policy_version 1009969 (0.0005) [2023-12-28 02:29:52,846][106225] Updated weights for policy 1, policy_version 1009979 (0.0008) [2023-12-28 02:29:53,335][106226] Updated weights for policy 0, policy_version 1007491 (0.0011) [2023-12-28 02:29:53,394][106226] Updated weights for policy 0, policy_version 1007501 (0.0010) [2023-12-28 02:29:53,411][106225] Updated weights for policy 1, policy_version 1009989 (0.0008) [2023-12-28 02:29:53,448][106226] Updated weights for policy 0, policy_version 1007511 (0.0008) [2023-12-28 02:29:53,469][106225] Updated weights for policy 1, policy_version 1009999 (0.0005) [2023-12-28 02:29:53,523][106225] Updated weights for policy 1, policy_version 1010009 (0.0005) [2023-12-28 02:29:54,138][106225] Updated weights for policy 1, policy_version 1010019 (0.0007) [2023-12-28 02:29:54,169][106226] Updated weights for policy 0, policy_version 1007521 (0.0007) [2023-12-28 02:29:54,204][106225] Updated weights for policy 1, policy_version 1010029 (0.0010) [2023-12-28 02:29:54,231][106226] Updated weights for policy 0, policy_version 1007531 (0.0008) [2023-12-28 02:29:54,253][106225] Updated weights for policy 1, policy_version 1010039 (0.0007) [2023-12-28 02:29:54,288][106226] Updated weights for policy 0, policy_version 1007541 (0.0009) [2023-12-28 02:29:54,340][106226] Updated weights for policy 0, policy_version 1007551 (0.0008) [2023-12-28 02:29:54,783][106225] Updated weights for policy 1, policy_version 1010049 (0.0005) [2023-12-28 02:29:54,839][106225] Updated weights for policy 1, policy_version 1010059 (0.0005) [2023-12-28 02:29:54,895][106225] Updated weights for policy 1, policy_version 1010069 (0.0008) [2023-12-28 02:29:54,952][106225] Updated weights for policy 1, policy_version 1010079 (0.0009) [2023-12-28 02:29:55,127][106226] Updated weights for policy 0, policy_version 1007561 (0.0010) [2023-12-28 02:29:55,183][106226] Updated weights for policy 0, policy_version 1007571 (0.0011) [2023-12-28 02:29:55,245][106226] Updated weights for policy 0, policy_version 1007581 (0.0009) [2023-12-28 02:29:55,654][106225] Updated weights for policy 1, policy_version 1010089 (0.0010) [2023-12-28 02:29:55,705][106225] Updated weights for policy 1, policy_version 1010099 (0.0010) [2023-12-28 02:29:55,766][106225] Updated weights for policy 1, policy_version 1010109 (0.0009) [2023-12-28 02:29:55,860][106226] Updated weights for policy 0, policy_version 1007591 (0.0007) [2023-12-28 02:29:55,916][106226] Updated weights for policy 0, policy_version 1007601 (0.0011) [2023-12-28 02:29:55,981][106226] Updated weights for policy 0, policy_version 1007611 (0.0011) [2023-12-28 02:29:56,174][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19605.3). Total num frames: 516636672. Throughput: 0: 9704.3, 1: 10236.3. Samples: 516603376. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:29:56,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-5.169')] [2023-12-28 02:29:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001007616_258007040.pth... [2023-12-28 02:29:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001010112_258629632.pth... [2023-12-28 02:29:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001006464_257712128.pth [2023-12-28 02:29:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001008896_258318336.pth [2023-12-28 02:29:56,445][106225] Updated weights for policy 1, policy_version 1010119 (0.0008) [2023-12-28 02:29:56,497][106225] Updated weights for policy 1, policy_version 1010129 (0.0007) [2023-12-28 02:29:56,557][106225] Updated weights for policy 1, policy_version 1010139 (0.0006) [2023-12-28 02:29:56,644][106226] Updated weights for policy 0, policy_version 1007621 (0.0007) [2023-12-28 02:29:56,702][106226] Updated weights for policy 0, policy_version 1007631 (0.0005) [2023-12-28 02:29:56,756][106226] Updated weights for policy 0, policy_version 1007641 (0.0005) [2023-12-28 02:29:57,232][106225] Updated weights for policy 1, policy_version 1010149 (0.0008) [2023-12-28 02:29:57,289][106225] Updated weights for policy 1, policy_version 1010159 (0.0005) [2023-12-28 02:29:57,345][106225] Updated weights for policy 1, policy_version 1010169 (0.0006) [2023-12-28 02:29:57,389][106226] Updated weights for policy 0, policy_version 1007651 (0.0007) [2023-12-28 02:29:57,447][106226] Updated weights for policy 0, policy_version 1007661 (0.0010) [2023-12-28 02:29:57,496][106226] Updated weights for policy 0, policy_version 1007671 (0.0010) [2023-12-28 02:29:57,992][106225] Updated weights for policy 1, policy_version 1010179 (0.0006) [2023-12-28 02:29:58,056][106225] Updated weights for policy 1, policy_version 1010189 (0.0008) [2023-12-28 02:29:58,122][106225] Updated weights for policy 1, policy_version 1010199 (0.0009) [2023-12-28 02:29:58,194][106226] Updated weights for policy 0, policy_version 1007681 (0.0010) [2023-12-28 02:29:58,258][106226] Updated weights for policy 0, policy_version 1007691 (0.0008) [2023-12-28 02:29:58,335][106226] Updated weights for policy 0, policy_version 1007701 (0.0006) [2023-12-28 02:29:58,411][106226] Updated weights for policy 0, policy_version 1007711 (0.0008) [2023-12-28 02:29:58,987][106225] Updated weights for policy 1, policy_version 1010209 (0.0008) [2023-12-28 02:29:59,047][106225] Updated weights for policy 1, policy_version 1010219 (0.0008) [2023-12-28 02:29:59,105][106225] Updated weights for policy 1, policy_version 1010229 (0.0006) [2023-12-28 02:29:59,157][106226] Updated weights for policy 0, policy_version 1007721 (0.0008) [2023-12-28 02:29:59,162][106225] Updated weights for policy 1, policy_version 1010239 (0.0006) [2023-12-28 02:29:59,224][106226] Updated weights for policy 0, policy_version 1007731 (0.0008) [2023-12-28 02:29:59,296][106226] Updated weights for policy 0, policy_version 1007741 (0.0009) [2023-12-28 02:29:59,882][106225] Updated weights for policy 1, policy_version 1010249 (0.0010) [2023-12-28 02:29:59,948][106225] Updated weights for policy 1, policy_version 1010259 (0.0010) [2023-12-28 02:29:59,980][106226] Updated weights for policy 0, policy_version 1007751 (0.0008) [2023-12-28 02:30:00,006][106225] Updated weights for policy 1, policy_version 1010269 (0.0010) [2023-12-28 02:30:00,044][106226] Updated weights for policy 0, policy_version 1007761 (0.0007) [2023-12-28 02:30:00,099][106226] Updated weights for policy 0, policy_version 1007771 (0.0009) [2023-12-28 02:30:00,629][106225] Updated weights for policy 1, policy_version 1010279 (0.0010) [2023-12-28 02:30:00,688][106225] Updated weights for policy 1, policy_version 1010289 (0.0009) [2023-12-28 02:30:00,753][106225] Updated weights for policy 1, policy_version 1010299 (0.0010) [2023-12-28 02:30:00,845][106226] Updated weights for policy 0, policy_version 1007782 (0.0009) [2023-12-28 02:30:00,891][106226] Updated weights for policy 0, policy_version 1007792 (0.0007) [2023-12-28 02:30:00,940][106226] Updated weights for policy 0, policy_version 1007802 (0.0007) [2023-12-28 02:30:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19577.5). Total num frames: 516734976. Throughput: 0: 9822.8, 1: 10262.6. Samples: 516722872. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:01,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.922')] [2023-12-28 02:30:01,426][106225] Updated weights for policy 1, policy_version 1010309 (0.0010) [2023-12-28 02:30:01,489][106225] Updated weights for policy 1, policy_version 1010319 (0.0010) [2023-12-28 02:30:01,556][106225] Updated weights for policy 1, policy_version 1010329 (0.0010) [2023-12-28 02:30:01,788][106226] Updated weights for policy 0, policy_version 1007812 (0.0007) [2023-12-28 02:30:01,847][106226] Updated weights for policy 0, policy_version 1007822 (0.0005) [2023-12-28 02:30:01,899][106226] Updated weights for policy 0, policy_version 1007832 (0.0005) [2023-12-28 02:30:02,272][106225] Updated weights for policy 1, policy_version 1010339 (0.0010) [2023-12-28 02:30:02,340][106225] Updated weights for policy 1, policy_version 1010349 (0.0011) [2023-12-28 02:30:02,412][106225] Updated weights for policy 1, policy_version 1010359 (0.0009) [2023-12-28 02:30:02,489][106226] Updated weights for policy 0, policy_version 1007842 (0.0007) [2023-12-28 02:30:02,540][106226] Updated weights for policy 0, policy_version 1007852 (0.0009) [2023-12-28 02:30:02,598][106226] Updated weights for policy 0, policy_version 1007862 (0.0009) [2023-12-28 02:30:02,658][106226] Updated weights for policy 0, policy_version 1007872 (0.0008) [2023-12-28 02:30:02,983][106225] Updated weights for policy 1, policy_version 1010369 (0.0007) [2023-12-28 02:30:03,029][106225] Updated weights for policy 1, policy_version 1010379 (0.0010) [2023-12-28 02:30:03,085][106225] Updated weights for policy 1, policy_version 1010389 (0.0010) [2023-12-28 02:30:03,141][106225] Updated weights for policy 1, policy_version 1010399 (0.0010) [2023-12-28 02:30:03,450][106226] Updated weights for policy 0, policy_version 1007882 (0.0007) [2023-12-28 02:30:03,502][106226] Updated weights for policy 0, policy_version 1007892 (0.0008) [2023-12-28 02:30:03,548][106226] Updated weights for policy 0, policy_version 1007902 (0.0007) [2023-12-28 02:30:03,877][106225] Updated weights for policy 1, policy_version 1010409 (0.0011) [2023-12-28 02:30:03,946][106225] Updated weights for policy 1, policy_version 1010419 (0.0011) [2023-12-28 02:30:04,008][106225] Updated weights for policy 1, policy_version 1010429 (0.0010) [2023-12-28 02:30:04,369][106226] Updated weights for policy 0, policy_version 1007912 (0.0009) [2023-12-28 02:30:04,428][106226] Updated weights for policy 0, policy_version 1007922 (0.0008) [2023-12-28 02:30:04,489][106226] Updated weights for policy 0, policy_version 1007932 (0.0008) [2023-12-28 02:30:04,718][106225] Updated weights for policy 1, policy_version 1010439 (0.0010) [2023-12-28 02:30:04,774][106225] Updated weights for policy 1, policy_version 1010449 (0.0010) [2023-12-28 02:30:04,830][106225] Updated weights for policy 1, policy_version 1010459 (0.0010) [2023-12-28 02:30:05,237][106226] Updated weights for policy 0, policy_version 1007942 (0.0007) [2023-12-28 02:30:05,303][106226] Updated weights for policy 0, policy_version 1007952 (0.0005) [2023-12-28 02:30:05,369][106226] Updated weights for policy 0, policy_version 1007962 (0.0008) [2023-12-28 02:30:05,488][106225] Updated weights for policy 1, policy_version 1010469 (0.0010) [2023-12-28 02:30:05,541][106225] Updated weights for policy 1, policy_version 1010479 (0.0010) [2023-12-28 02:30:05,600][106225] Updated weights for policy 1, policy_version 1010489 (0.0010) [2023-12-28 02:30:06,047][106226] Updated weights for policy 0, policy_version 1007972 (0.0008) [2023-12-28 02:30:06,112][106226] Updated weights for policy 0, policy_version 1007982 (0.0008) [2023-12-28 02:30:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19577.5). Total num frames: 516825088. Throughput: 0: 9856.4, 1: 10217.9. Samples: 516840632. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:06,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-5.254')] [2023-12-28 02:30:06,180][106226] Updated weights for policy 0, policy_version 1007992 (0.0008) [2023-12-28 02:30:06,334][106225] Updated weights for policy 1, policy_version 1010499 (0.0009) [2023-12-28 02:30:06,398][106225] Updated weights for policy 1, policy_version 1010509 (0.0008) [2023-12-28 02:30:06,457][106225] Updated weights for policy 1, policy_version 1010519 (0.0008) [2023-12-28 02:30:06,825][106226] Updated weights for policy 0, policy_version 1008002 (0.0009) [2023-12-28 02:30:06,879][106226] Updated weights for policy 0, policy_version 1008012 (0.0008) [2023-12-28 02:30:06,932][106226] Updated weights for policy 0, policy_version 1008022 (0.0009) [2023-12-28 02:30:06,982][106226] Updated weights for policy 0, policy_version 1008032 (0.0009) [2023-12-28 02:30:07,213][106225] Updated weights for policy 1, policy_version 1010529 (0.0009) [2023-12-28 02:30:07,269][106225] Updated weights for policy 1, policy_version 1010539 (0.0009) [2023-12-28 02:30:07,318][106225] Updated weights for policy 1, policy_version 1010549 (0.0008) [2023-12-28 02:30:07,367][106225] Updated weights for policy 1, policy_version 1010559 (0.0009) [2023-12-28 02:30:07,733][106226] Updated weights for policy 0, policy_version 1008042 (0.0009) [2023-12-28 02:30:07,783][106226] Updated weights for policy 0, policy_version 1008052 (0.0008) [2023-12-28 02:30:07,833][106226] Updated weights for policy 0, policy_version 1008062 (0.0008) [2023-12-28 02:30:08,103][106225] Updated weights for policy 1, policy_version 1010569 (0.0007) [2023-12-28 02:30:08,156][106225] Updated weights for policy 1, policy_version 1010579 (0.0007) [2023-12-28 02:30:08,202][106225] Updated weights for policy 1, policy_version 1010589 (0.0005) [2023-12-28 02:30:08,542][106226] Updated weights for policy 0, policy_version 1008072 (0.0007) [2023-12-28 02:30:08,610][106226] Updated weights for policy 0, policy_version 1008082 (0.0005) [2023-12-28 02:30:08,678][106226] Updated weights for policy 0, policy_version 1008092 (0.0007) [2023-12-28 02:30:09,016][106225] Updated weights for policy 1, policy_version 1010599 (0.0008) [2023-12-28 02:30:09,067][106225] Updated weights for policy 1, policy_version 1010609 (0.0008) [2023-12-28 02:30:09,119][106225] Updated weights for policy 1, policy_version 1010619 (0.0008) [2023-12-28 02:30:09,306][106226] Updated weights for policy 0, policy_version 1008102 (0.0007) [2023-12-28 02:30:09,397][106226] Updated weights for policy 0, policy_version 1008112 (0.0008) [2023-12-28 02:30:09,465][106226] Updated weights for policy 0, policy_version 1008122 (0.0008) [2023-12-28 02:30:09,916][106225] Updated weights for policy 1, policy_version 1010629 (0.0007) [2023-12-28 02:30:09,983][106225] Updated weights for policy 1, policy_version 1010639 (0.0008) [2023-12-28 02:30:10,043][106225] Updated weights for policy 1, policy_version 1010649 (0.0008) [2023-12-28 02:30:10,202][106226] Updated weights for policy 0, policy_version 1008132 (0.0008) [2023-12-28 02:30:10,263][106226] Updated weights for policy 0, policy_version 1008142 (0.0008) [2023-12-28 02:30:10,323][106226] Updated weights for policy 0, policy_version 1008152 (0.0008) [2023-12-28 02:30:10,716][106225] Updated weights for policy 1, policy_version 1010659 (0.0006) [2023-12-28 02:30:10,772][106225] Updated weights for policy 1, policy_version 1010669 (0.0008) [2023-12-28 02:30:10,829][106225] Updated weights for policy 1, policy_version 1010679 (0.0010) [2023-12-28 02:30:11,014][106226] Updated weights for policy 0, policy_version 1008162 (0.0009) [2023-12-28 02:30:11,086][106226] Updated weights for policy 0, policy_version 1008172 (0.0009) [2023-12-28 02:30:11,152][106226] Updated weights for policy 0, policy_version 1008182 (0.0008) [2023-12-28 02:30:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 516923392. Throughput: 0: 9840.7, 1: 10208.2. Samples: 516898664. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:11,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.701')] [2023-12-28 02:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001010688_258777088.pth... [2023-12-28 02:30:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001009536_258482176.pth [2023-12-28 02:30:11,218][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001008192_258154496.pth... [2023-12-28 02:30:11,220][106226] Updated weights for policy 0, policy_version 1008192 (0.0009) [2023-12-28 02:30:11,224][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001007040_257859584.pth [2023-12-28 02:30:11,656][106225] Updated weights for policy 1, policy_version 1010689 (0.0010) [2023-12-28 02:30:11,714][106225] Updated weights for policy 1, policy_version 1010699 (0.0009) [2023-12-28 02:30:11,783][106225] Updated weights for policy 1, policy_version 1010709 (0.0009) [2023-12-28 02:30:11,840][106225] Updated weights for policy 1, policy_version 1010719 (0.0008) [2023-12-28 02:30:11,917][106226] Updated weights for policy 0, policy_version 1008202 (0.0009) [2023-12-28 02:30:11,974][106226] Updated weights for policy 0, policy_version 1008212 (0.0008) [2023-12-28 02:30:12,028][106226] Updated weights for policy 0, policy_version 1008222 (0.0010) [2023-12-28 02:30:12,528][106225] Updated weights for policy 1, policy_version 1010729 (0.0008) [2023-12-28 02:30:12,574][106225] Updated weights for policy 1, policy_version 1010739 (0.0007) [2023-12-28 02:30:12,620][106225] Updated weights for policy 1, policy_version 1010749 (0.0007) [2023-12-28 02:30:12,793][106226] Updated weights for policy 0, policy_version 1008232 (0.0009) [2023-12-28 02:30:12,856][106226] Updated weights for policy 0, policy_version 1008242 (0.0009) [2023-12-28 02:30:12,918][106226] Updated weights for policy 0, policy_version 1008252 (0.0009) [2023-12-28 02:30:13,402][106225] Updated weights for policy 1, policy_version 1010759 (0.0008) [2023-12-28 02:30:13,454][106225] Updated weights for policy 1, policy_version 1010769 (0.0008) [2023-12-28 02:30:13,498][106225] Updated weights for policy 1, policy_version 1010779 (0.0009) [2023-12-28 02:30:13,589][106226] Updated weights for policy 0, policy_version 1008262 (0.0006) [2023-12-28 02:30:13,643][106226] Updated weights for policy 0, policy_version 1008272 (0.0005) [2023-12-28 02:30:13,705][106226] Updated weights for policy 0, policy_version 1008282 (0.0005) [2023-12-28 02:30:14,296][106225] Updated weights for policy 1, policy_version 1010789 (0.0009) [2023-12-28 02:30:14,325][106226] Updated weights for policy 0, policy_version 1008292 (0.0006) [2023-12-28 02:30:14,359][106225] Updated weights for policy 1, policy_version 1010799 (0.0007) [2023-12-28 02:30:14,381][106226] Updated weights for policy 0, policy_version 1008302 (0.0006) [2023-12-28 02:30:14,418][106225] Updated weights for policy 1, policy_version 1010809 (0.0008) [2023-12-28 02:30:14,433][106226] Updated weights for policy 0, policy_version 1008312 (0.0006) [2023-12-28 02:30:15,154][106226] Updated weights for policy 0, policy_version 1008322 (0.0007) [2023-12-28 02:30:15,166][106225] Updated weights for policy 1, policy_version 1010819 (0.0008) [2023-12-28 02:30:15,217][106226] Updated weights for policy 0, policy_version 1008332 (0.0006) [2023-12-28 02:30:15,226][106225] Updated weights for policy 1, policy_version 1010829 (0.0008) [2023-12-28 02:30:15,272][106226] Updated weights for policy 0, policy_version 1008342 (0.0007) [2023-12-28 02:30:15,287][106225] Updated weights for policy 1, policy_version 1010839 (0.0008) [2023-12-28 02:30:15,334][106226] Updated weights for policy 0, policy_version 1008352 (0.0006) [2023-12-28 02:30:16,002][106226] Updated weights for policy 0, policy_version 1008362 (0.0010) [2023-12-28 02:30:16,004][106225] Updated weights for policy 1, policy_version 1010849 (0.0006) [2023-12-28 02:30:16,058][106225] Updated weights for policy 1, policy_version 1010859 (0.0005) [2023-12-28 02:30:16,064][106226] Updated weights for policy 0, policy_version 1008372 (0.0010) [2023-12-28 02:30:16,117][106225] Updated weights for policy 1, policy_version 1010869 (0.0005) [2023-12-28 02:30:16,124][106226] Updated weights for policy 0, policy_version 1008382 (0.0010) [2023-12-28 02:30:16,166][106225] Updated weights for policy 1, policy_version 1010879 (0.0005) [2023-12-28 02:30:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19577.5). Total num frames: 517029888. Throughput: 0: 9835.7, 1: 9980.8. Samples: 517013268. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:16,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-5.046')] [2023-12-28 02:30:16,683][106225] Updated weights for policy 1, policy_version 1010889 (0.0007) [2023-12-28 02:30:16,742][106225] Updated weights for policy 1, policy_version 1010899 (0.0008) [2023-12-28 02:30:16,788][106225] Updated weights for policy 1, policy_version 1010909 (0.0008) [2023-12-28 02:30:16,878][106226] Updated weights for policy 0, policy_version 1008392 (0.0010) [2023-12-28 02:30:16,926][106226] Updated weights for policy 0, policy_version 1008402 (0.0008) [2023-12-28 02:30:16,980][106226] Updated weights for policy 0, policy_version 1008412 (0.0008) [2023-12-28 02:30:17,505][106225] Updated weights for policy 1, policy_version 1010919 (0.0006) [2023-12-28 02:30:17,566][106225] Updated weights for policy 1, policy_version 1010929 (0.0005) [2023-12-28 02:30:17,623][106225] Updated weights for policy 1, policy_version 1010939 (0.0005) [2023-12-28 02:30:17,702][106226] Updated weights for policy 0, policy_version 1008422 (0.0007) [2023-12-28 02:30:17,759][106226] Updated weights for policy 0, policy_version 1008432 (0.0005) [2023-12-28 02:30:17,818][106226] Updated weights for policy 0, policy_version 1008442 (0.0005) [2023-12-28 02:30:18,274][106225] Updated weights for policy 1, policy_version 1010949 (0.0007) [2023-12-28 02:30:18,345][106225] Updated weights for policy 1, policy_version 1010959 (0.0009) [2023-12-28 02:30:18,409][106225] Updated weights for policy 1, policy_version 1010969 (0.0009) [2023-12-28 02:30:18,416][106226] Updated weights for policy 0, policy_version 1008452 (0.0006) [2023-12-28 02:30:18,480][106226] Updated weights for policy 0, policy_version 1008462 (0.0008) [2023-12-28 02:30:18,536][106226] Updated weights for policy 0, policy_version 1008472 (0.0009) [2023-12-28 02:30:19,057][106225] Updated weights for policy 1, policy_version 1010979 (0.0006) [2023-12-28 02:30:19,110][106225] Updated weights for policy 1, policy_version 1010989 (0.0007) [2023-12-28 02:30:19,161][106225] Updated weights for policy 1, policy_version 1010999 (0.0007) [2023-12-28 02:30:19,291][106226] Updated weights for policy 0, policy_version 1008482 (0.0008) [2023-12-28 02:30:19,362][106226] Updated weights for policy 0, policy_version 1008492 (0.0007) [2023-12-28 02:30:19,431][106226] Updated weights for policy 0, policy_version 1008502 (0.0007) [2023-12-28 02:30:19,498][106226] Updated weights for policy 0, policy_version 1008512 (0.0008) [2023-12-28 02:30:19,922][106225] Updated weights for policy 1, policy_version 1011009 (0.0008) [2023-12-28 02:30:19,988][106225] Updated weights for policy 1, policy_version 1011019 (0.0010) [2023-12-28 02:30:20,055][106225] Updated weights for policy 1, policy_version 1011029 (0.0009) [2023-12-28 02:30:20,119][106225] Updated weights for policy 1, policy_version 1011039 (0.0007) [2023-12-28 02:30:20,152][106226] Updated weights for policy 0, policy_version 1008522 (0.0011) [2023-12-28 02:30:20,209][106226] Updated weights for policy 0, policy_version 1008532 (0.0010) [2023-12-28 02:30:20,266][106226] Updated weights for policy 0, policy_version 1008542 (0.0006) [2023-12-28 02:30:20,934][106225] Updated weights for policy 1, policy_version 1011049 (0.0011) [2023-12-28 02:30:20,980][106226] Updated weights for policy 0, policy_version 1008552 (0.0006) [2023-12-28 02:30:21,018][106225] Updated weights for policy 1, policy_version 1011059 (0.0011) [2023-12-28 02:30:21,052][106226] Updated weights for policy 0, policy_version 1008562 (0.0008) [2023-12-28 02:30:21,083][106225] Updated weights for policy 1, policy_version 1011069 (0.0010) [2023-12-28 02:30:21,117][106226] Updated weights for policy 0, policy_version 1008572 (0.0008) [2023-12-28 02:30:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19577.5). Total num frames: 517128192. Throughput: 0: 9887.1, 1: 9889.3. Samples: 517132180. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:21,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.793')] [2023-12-28 02:30:21,884][106226] Updated weights for policy 0, policy_version 1008582 (0.0010) [2023-12-28 02:30:21,906][106225] Updated weights for policy 1, policy_version 1011079 (0.0007) [2023-12-28 02:30:21,943][106226] Updated weights for policy 0, policy_version 1008592 (0.0008) [2023-12-28 02:30:21,965][106225] Updated weights for policy 1, policy_version 1011089 (0.0008) [2023-12-28 02:30:22,003][106226] Updated weights for policy 0, policy_version 1008602 (0.0007) [2023-12-28 02:30:22,022][106225] Updated weights for policy 1, policy_version 1011099 (0.0008) [2023-12-28 02:30:22,663][106226] Updated weights for policy 0, policy_version 1008612 (0.0007) [2023-12-28 02:30:22,729][106226] Updated weights for policy 0, policy_version 1008622 (0.0011) [2023-12-28 02:30:22,792][106226] Updated weights for policy 0, policy_version 1008632 (0.0011) [2023-12-28 02:30:22,795][106225] Updated weights for policy 1, policy_version 1011109 (0.0008) [2023-12-28 02:30:22,850][106225] Updated weights for policy 1, policy_version 1011119 (0.0008) [2023-12-28 02:30:22,898][106225] Updated weights for policy 1, policy_version 1011129 (0.0008) [2023-12-28 02:30:23,489][106226] Updated weights for policy 0, policy_version 1008642 (0.0010) [2023-12-28 02:30:23,536][106225] Updated weights for policy 1, policy_version 1011139 (0.0008) [2023-12-28 02:30:23,547][106226] Updated weights for policy 0, policy_version 1008652 (0.0008) [2023-12-28 02:30:23,595][106225] Updated weights for policy 1, policy_version 1011149 (0.0009) [2023-12-28 02:30:23,604][106226] Updated weights for policy 0, policy_version 1008662 (0.0005) [2023-12-28 02:30:23,655][106225] Updated weights for policy 1, policy_version 1011159 (0.0008) [2023-12-28 02:30:23,672][106226] Updated weights for policy 0, policy_version 1008672 (0.0006) [2023-12-28 02:30:24,241][106225] Updated weights for policy 1, policy_version 1011169 (0.0007) [2023-12-28 02:30:24,296][106225] Updated weights for policy 1, policy_version 1011179 (0.0010) [2023-12-28 02:30:24,354][106225] Updated weights for policy 1, policy_version 1011189 (0.0007) [2023-12-28 02:30:24,365][106226] Updated weights for policy 0, policy_version 1008682 (0.0005) [2023-12-28 02:30:24,411][106225] Updated weights for policy 1, policy_version 1011199 (0.0009) [2023-12-28 02:30:24,429][106226] Updated weights for policy 0, policy_version 1008692 (0.0006) [2023-12-28 02:30:24,484][106226] Updated weights for policy 0, policy_version 1008702 (0.0009) [2023-12-28 02:30:24,990][106225] Updated weights for policy 1, policy_version 1011209 (0.0006) [2023-12-28 02:30:25,041][106225] Updated weights for policy 1, policy_version 1011219 (0.0009) [2023-12-28 02:30:25,102][106225] Updated weights for policy 1, policy_version 1011229 (0.0010) [2023-12-28 02:30:25,128][106226] Updated weights for policy 0, policy_version 1008712 (0.0006) [2023-12-28 02:30:25,187][106226] Updated weights for policy 0, policy_version 1008722 (0.0010) [2023-12-28 02:30:25,243][106226] Updated weights for policy 0, policy_version 1008732 (0.0010) [2023-12-28 02:30:25,817][106225] Updated weights for policy 1, policy_version 1011239 (0.0008) [2023-12-28 02:30:25,881][106225] Updated weights for policy 1, policy_version 1011249 (0.0009) [2023-12-28 02:30:25,940][106225] Updated weights for policy 1, policy_version 1011259 (0.0010) [2023-12-28 02:30:25,945][106226] Updated weights for policy 0, policy_version 1008742 (0.0009) [2023-12-28 02:30:26,002][106226] Updated weights for policy 0, policy_version 1008752 (0.0007) [2023-12-28 02:30:26,048][106226] Updated weights for policy 0, policy_version 1008762 (0.0010) [2023-12-28 02:30:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19934.0, 300 sec: 19577.5). Total num frames: 517226496. Throughput: 0: 9828.2, 1: 9806.9. Samples: 517189288. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:26,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.591')] [2023-12-28 02:30:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001011264_258924544.pth... [2023-12-28 02:30:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001008768_258301952.pth... [2023-12-28 02:30:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001010112_258629632.pth [2023-12-28 02:30:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001007616_258007040.pth [2023-12-28 02:30:26,588][106225] Updated weights for policy 1, policy_version 1011269 (0.0008) [2023-12-28 02:30:26,639][106225] Updated weights for policy 1, policy_version 1011279 (0.0005) [2023-12-28 02:30:26,696][106225] Updated weights for policy 1, policy_version 1011289 (0.0006) [2023-12-28 02:30:26,779][106226] Updated weights for policy 0, policy_version 1008772 (0.0010) [2023-12-28 02:30:26,835][106226] Updated weights for policy 0, policy_version 1008782 (0.0007) [2023-12-28 02:30:26,891][106226] Updated weights for policy 0, policy_version 1008792 (0.0009) [2023-12-28 02:30:27,334][106225] Updated weights for policy 1, policy_version 1011299 (0.0009) [2023-12-28 02:30:27,400][106225] Updated weights for policy 1, policy_version 1011309 (0.0010) [2023-12-28 02:30:27,438][106226] Updated weights for policy 0, policy_version 1008802 (0.0007) [2023-12-28 02:30:27,455][106225] Updated weights for policy 1, policy_version 1011319 (0.0009) [2023-12-28 02:30:27,490][106226] Updated weights for policy 0, policy_version 1008812 (0.0005) [2023-12-28 02:30:27,535][106226] Updated weights for policy 0, policy_version 1008822 (0.0005) [2023-12-28 02:30:27,580][106226] Updated weights for policy 0, policy_version 1008832 (0.0005) [2023-12-28 02:30:28,083][106225] Updated weights for policy 1, policy_version 1011329 (0.0006) [2023-12-28 02:30:28,144][106225] Updated weights for policy 1, policy_version 1011339 (0.0009) [2023-12-28 02:30:28,159][106226] Updated weights for policy 0, policy_version 1008842 (0.0010) [2023-12-28 02:30:28,194][106225] Updated weights for policy 1, policy_version 1011349 (0.0010) [2023-12-28 02:30:28,219][106226] Updated weights for policy 0, policy_version 1008852 (0.0010) [2023-12-28 02:30:28,241][106225] Updated weights for policy 1, policy_version 1011359 (0.0010) [2023-12-28 02:30:28,280][106226] Updated weights for policy 0, policy_version 1008862 (0.0010) [2023-12-28 02:30:28,956][106226] Updated weights for policy 0, policy_version 1008872 (0.0010) [2023-12-28 02:30:28,984][106225] Updated weights for policy 1, policy_version 1011369 (0.0007) [2023-12-28 02:30:29,019][106226] Updated weights for policy 0, policy_version 1008882 (0.0010) [2023-12-28 02:30:29,037][106225] Updated weights for policy 1, policy_version 1011379 (0.0006) [2023-12-28 02:30:29,068][106226] Updated weights for policy 0, policy_version 1008892 (0.0010) [2023-12-28 02:30:29,089][106225] Updated weights for policy 1, policy_version 1011389 (0.0005) [2023-12-28 02:30:29,768][106226] Updated weights for policy 0, policy_version 1008902 (0.0009) [2023-12-28 02:30:29,788][106225] Updated weights for policy 1, policy_version 1011399 (0.0006) [2023-12-28 02:30:29,825][106226] Updated weights for policy 0, policy_version 1008912 (0.0008) [2023-12-28 02:30:29,854][106225] Updated weights for policy 1, policy_version 1011409 (0.0007) [2023-12-28 02:30:29,886][106226] Updated weights for policy 0, policy_version 1008922 (0.0008) [2023-12-28 02:30:29,909][106225] Updated weights for policy 1, policy_version 1011419 (0.0007) [2023-12-28 02:30:30,617][106226] Updated weights for policy 0, policy_version 1008932 (0.0008) [2023-12-28 02:30:30,642][106225] Updated weights for policy 1, policy_version 1011429 (0.0007) [2023-12-28 02:30:30,671][106226] Updated weights for policy 0, policy_version 1008942 (0.0007) [2023-12-28 02:30:30,692][106225] Updated weights for policy 1, policy_version 1011439 (0.0006) [2023-12-28 02:30:30,726][106226] Updated weights for policy 0, policy_version 1008952 (0.0008) [2023-12-28 02:30:30,745][106225] Updated weights for policy 1, policy_version 1011449 (0.0007) [2023-12-28 02:30:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19577.5). Total num frames: 517324800. Throughput: 0: 9884.5, 1: 9910.5. Samples: 517315192. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:31,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.807')] [2023-12-28 02:30:31,472][106226] Updated weights for policy 0, policy_version 1008962 (0.0009) [2023-12-28 02:30:31,510][106225] Updated weights for policy 1, policy_version 1011459 (0.0007) [2023-12-28 02:30:31,529][106226] Updated weights for policy 0, policy_version 1008972 (0.0008) [2023-12-28 02:30:31,573][106225] Updated weights for policy 1, policy_version 1011469 (0.0008) [2023-12-28 02:30:31,592][106226] Updated weights for policy 0, policy_version 1008982 (0.0008) [2023-12-28 02:30:31,636][106225] Updated weights for policy 1, policy_version 1011479 (0.0008) [2023-12-28 02:30:31,658][106226] Updated weights for policy 0, policy_version 1008992 (0.0008) [2023-12-28 02:30:32,339][106226] Updated weights for policy 0, policy_version 1009002 (0.0007) [2023-12-28 02:30:32,403][106226] Updated weights for policy 0, policy_version 1009012 (0.0006) [2023-12-28 02:30:32,415][106225] Updated weights for policy 1, policy_version 1011489 (0.0009) [2023-12-28 02:30:32,448][106226] Updated weights for policy 0, policy_version 1009022 (0.0005) [2023-12-28 02:30:32,474][106225] Updated weights for policy 1, policy_version 1011499 (0.0008) [2023-12-28 02:30:32,542][106225] Updated weights for policy 1, policy_version 1011509 (0.0009) [2023-12-28 02:30:32,605][106225] Updated weights for policy 1, policy_version 1011519 (0.0008) [2023-12-28 02:30:33,030][106226] Updated weights for policy 0, policy_version 1009032 (0.0008) [2023-12-28 02:30:33,089][106226] Updated weights for policy 0, policy_version 1009042 (0.0008) [2023-12-28 02:30:33,148][106226] Updated weights for policy 0, policy_version 1009052 (0.0008) [2023-12-28 02:30:33,355][106225] Updated weights for policy 1, policy_version 1011529 (0.0008) [2023-12-28 02:30:33,416][106225] Updated weights for policy 1, policy_version 1011539 (0.0009) [2023-12-28 02:30:33,473][106225] Updated weights for policy 1, policy_version 1011549 (0.0008) [2023-12-28 02:30:33,848][106226] Updated weights for policy 0, policy_version 1009062 (0.0008) [2023-12-28 02:30:33,896][106226] Updated weights for policy 0, policy_version 1009072 (0.0009) [2023-12-28 02:30:33,953][106226] Updated weights for policy 0, policy_version 1009082 (0.0008) [2023-12-28 02:30:34,189][106225] Updated weights for policy 1, policy_version 1011559 (0.0008) [2023-12-28 02:30:34,252][106225] Updated weights for policy 1, policy_version 1011569 (0.0008) [2023-12-28 02:30:34,310][106225] Updated weights for policy 1, policy_version 1011579 (0.0009) [2023-12-28 02:30:34,716][106226] Updated weights for policy 0, policy_version 1009092 (0.0008) [2023-12-28 02:30:34,777][106226] Updated weights for policy 0, policy_version 1009102 (0.0009) [2023-12-28 02:30:34,837][106226] Updated weights for policy 0, policy_version 1009112 (0.0009) [2023-12-28 02:30:35,055][106225] Updated weights for policy 1, policy_version 1011589 (0.0009) [2023-12-28 02:30:35,118][106225] Updated weights for policy 1, policy_version 1011599 (0.0009) [2023-12-28 02:30:35,172][106225] Updated weights for policy 1, policy_version 1011609 (0.0008) [2023-12-28 02:30:35,574][106226] Updated weights for policy 0, policy_version 1009122 (0.0009) [2023-12-28 02:30:35,629][106226] Updated weights for policy 0, policy_version 1009132 (0.0008) [2023-12-28 02:30:35,684][106226] Updated weights for policy 0, policy_version 1009142 (0.0008) [2023-12-28 02:30:35,739][106226] Updated weights for policy 0, policy_version 1009152 (0.0008) [2023-12-28 02:30:35,892][106225] Updated weights for policy 1, policy_version 1011619 (0.0008) [2023-12-28 02:30:35,943][106225] Updated weights for policy 1, policy_version 1011629 (0.0008) [2023-12-28 02:30:36,004][106225] Updated weights for policy 1, policy_version 1011639 (0.0007) [2023-12-28 02:30:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19577.5). Total num frames: 517423104. Throughput: 0: 9881.3, 1: 9852.8. Samples: 517431076. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:36,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.654')] [2023-12-28 02:30:36,488][106226] Updated weights for policy 0, policy_version 1009162 (0.0008) [2023-12-28 02:30:36,534][106226] Updated weights for policy 0, policy_version 1009172 (0.0008) [2023-12-28 02:30:36,581][106226] Updated weights for policy 0, policy_version 1009182 (0.0009) [2023-12-28 02:30:36,739][106225] Updated weights for policy 1, policy_version 1011649 (0.0008) [2023-12-28 02:30:36,795][106225] Updated weights for policy 1, policy_version 1011659 (0.0008) [2023-12-28 02:30:36,847][106225] Updated weights for policy 1, policy_version 1011669 (0.0008) [2023-12-28 02:30:36,913][106225] Updated weights for policy 1, policy_version 1011679 (0.0008) [2023-12-28 02:30:37,273][106226] Updated weights for policy 0, policy_version 1009192 (0.0009) [2023-12-28 02:30:37,322][106226] Updated weights for policy 0, policy_version 1009202 (0.0009) [2023-12-28 02:30:37,368][106226] Updated weights for policy 0, policy_version 1009212 (0.0008) [2023-12-28 02:30:37,609][106225] Updated weights for policy 1, policy_version 1011689 (0.0005) [2023-12-28 02:30:37,660][106225] Updated weights for policy 1, policy_version 1011699 (0.0008) [2023-12-28 02:30:37,708][106225] Updated weights for policy 1, policy_version 1011709 (0.0008) [2023-12-28 02:30:38,047][106226] Updated weights for policy 0, policy_version 1009222 (0.0007) [2023-12-28 02:30:38,100][106226] Updated weights for policy 0, policy_version 1009232 (0.0006) [2023-12-28 02:30:38,153][106226] Updated weights for policy 0, policy_version 1009242 (0.0005) [2023-12-28 02:30:38,492][106225] Updated weights for policy 1, policy_version 1011719 (0.0008) [2023-12-28 02:30:38,557][106225] Updated weights for policy 1, policy_version 1011729 (0.0007) [2023-12-28 02:30:38,621][106225] Updated weights for policy 1, policy_version 1011739 (0.0008) [2023-12-28 02:30:38,779][106226] Updated weights for policy 0, policy_version 1009252 (0.0005) [2023-12-28 02:30:38,854][106226] Updated weights for policy 0, policy_version 1009262 (0.0009) [2023-12-28 02:30:38,916][106226] Updated weights for policy 0, policy_version 1009272 (0.0008) [2023-12-28 02:30:39,390][106225] Updated weights for policy 1, policy_version 1011749 (0.0008) [2023-12-28 02:30:39,458][106225] Updated weights for policy 1, policy_version 1011759 (0.0008) [2023-12-28 02:30:39,513][106225] Updated weights for policy 1, policy_version 1011769 (0.0008) [2023-12-28 02:30:39,600][106226] Updated weights for policy 0, policy_version 1009282 (0.0008) [2023-12-28 02:30:39,665][106226] Updated weights for policy 0, policy_version 1009292 (0.0007) [2023-12-28 02:30:39,719][106226] Updated weights for policy 0, policy_version 1009302 (0.0009) [2023-12-28 02:30:39,780][106226] Updated weights for policy 0, policy_version 1009312 (0.0007) [2023-12-28 02:30:40,297][106225] Updated weights for policy 1, policy_version 1011779 (0.0010) [2023-12-28 02:30:40,354][106225] Updated weights for policy 1, policy_version 1011789 (0.0008) [2023-12-28 02:30:40,414][106225] Updated weights for policy 1, policy_version 1011799 (0.0008) [2023-12-28 02:30:40,504][106226] Updated weights for policy 0, policy_version 1009322 (0.0008) [2023-12-28 02:30:40,567][106226] Updated weights for policy 0, policy_version 1009332 (0.0009) [2023-12-28 02:30:40,627][106226] Updated weights for policy 0, policy_version 1009342 (0.0010) [2023-12-28 02:30:41,116][106225] Updated weights for policy 1, policy_version 1011809 (0.0008) [2023-12-28 02:30:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19549.7). Total num frames: 517513216. Throughput: 0: 9916.1, 1: 9788.9. Samples: 517490108. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:41,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.958')] [2023-12-28 02:30:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001009344_258449408.pth... [2023-12-28 02:30:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001008192_258154496.pth [2023-12-28 02:30:41,199][106225] Updated weights for policy 1, policy_version 1011819 (0.0008) [2023-12-28 02:30:41,255][106225] Updated weights for policy 1, policy_version 1011829 (0.0007) [2023-12-28 02:30:41,318][106225] Updated weights for policy 1, policy_version 1011839 (0.0007) [2023-12-28 02:30:41,325][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001011840_259072000.pth... [2023-12-28 02:30:41,329][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001010688_258777088.pth [2023-12-28 02:30:41,354][106226] Updated weights for policy 0, policy_version 1009352 (0.0010) [2023-12-28 02:30:41,430][106226] Updated weights for policy 0, policy_version 1009362 (0.0011) [2023-12-28 02:30:41,488][106226] Updated weights for policy 0, policy_version 1009372 (0.0011) [2023-12-28 02:30:42,086][106225] Updated weights for policy 1, policy_version 1011849 (0.0010) [2023-12-28 02:30:42,147][106225] Updated weights for policy 1, policy_version 1011859 (0.0011) [2023-12-28 02:30:42,208][106225] Updated weights for policy 1, policy_version 1011869 (0.0010) [2023-12-28 02:30:42,276][106226] Updated weights for policy 0, policy_version 1009382 (0.0009) [2023-12-28 02:30:42,342][106226] Updated weights for policy 0, policy_version 1009392 (0.0008) [2023-12-28 02:30:42,409][106226] Updated weights for policy 0, policy_version 1009402 (0.0008) [2023-12-28 02:30:42,894][106225] Updated weights for policy 1, policy_version 1011879 (0.0010) [2023-12-28 02:30:42,948][106225] Updated weights for policy 1, policy_version 1011889 (0.0010) [2023-12-28 02:30:43,009][106225] Updated weights for policy 1, policy_version 1011899 (0.0007) [2023-12-28 02:30:43,134][106226] Updated weights for policy 0, policy_version 1009412 (0.0008) [2023-12-28 02:30:43,201][106226] Updated weights for policy 0, policy_version 1009422 (0.0010) [2023-12-28 02:30:43,266][106226] Updated weights for policy 0, policy_version 1009432 (0.0009) [2023-12-28 02:30:43,626][106225] Updated weights for policy 1, policy_version 1011909 (0.0006) [2023-12-28 02:30:43,682][106225] Updated weights for policy 1, policy_version 1011919 (0.0007) [2023-12-28 02:30:43,730][106225] Updated weights for policy 1, policy_version 1011929 (0.0008) [2023-12-28 02:30:43,985][106226] Updated weights for policy 0, policy_version 1009442 (0.0008) [2023-12-28 02:30:44,054][106226] Updated weights for policy 0, policy_version 1009452 (0.0005) [2023-12-28 02:30:44,124][106226] Updated weights for policy 0, policy_version 1009462 (0.0005) [2023-12-28 02:30:44,189][106226] Updated weights for policy 0, policy_version 1009472 (0.0005) [2023-12-28 02:30:44,388][106225] Updated weights for policy 1, policy_version 1011939 (0.0007) [2023-12-28 02:30:44,449][106225] Updated weights for policy 1, policy_version 1011949 (0.0005) [2023-12-28 02:30:44,506][106225] Updated weights for policy 1, policy_version 1011959 (0.0006) [2023-12-28 02:30:44,751][106226] Updated weights for policy 0, policy_version 1009482 (0.0009) [2023-12-28 02:30:44,814][106226] Updated weights for policy 0, policy_version 1009492 (0.0008) [2023-12-28 02:30:44,874][106226] Updated weights for policy 0, policy_version 1009502 (0.0009) [2023-12-28 02:30:45,170][106225] Updated weights for policy 1, policy_version 1011969 (0.0010) [2023-12-28 02:30:45,234][106225] Updated weights for policy 1, policy_version 1011979 (0.0009) [2023-12-28 02:30:45,299][106225] Updated weights for policy 1, policy_version 1011989 (0.0009) [2023-12-28 02:30:45,361][106225] Updated weights for policy 1, policy_version 1011999 (0.0009) [2023-12-28 02:30:45,624][106226] Updated weights for policy 0, policy_version 1009512 (0.0009) [2023-12-28 02:30:45,680][106226] Updated weights for policy 0, policy_version 1009522 (0.0009) [2023-12-28 02:30:45,739][106226] Updated weights for policy 0, policy_version 1009532 (0.0008) [2023-12-28 02:30:46,103][106225] Updated weights for policy 1, policy_version 1012009 (0.0009) [2023-12-28 02:30:46,160][106225] Updated weights for policy 1, policy_version 1012019 (0.0008) [2023-12-28 02:30:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19549.7). Total num frames: 517611520. Throughput: 0: 9889.2, 1: 9765.0. Samples: 517607308. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:46,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.763')] [2023-12-28 02:30:46,221][106225] Updated weights for policy 1, policy_version 1012029 (0.0005) [2023-12-28 02:30:46,411][106226] Updated weights for policy 0, policy_version 1009542 (0.0007) [2023-12-28 02:30:46,474][106226] Updated weights for policy 0, policy_version 1009553 (0.0009) [2023-12-28 02:30:46,531][106226] Updated weights for policy 0, policy_version 1009563 (0.0008) [2023-12-28 02:30:46,810][106225] Updated weights for policy 1, policy_version 1012039 (0.0009) [2023-12-28 02:30:46,869][106225] Updated weights for policy 1, policy_version 1012049 (0.0010) [2023-12-28 02:30:46,923][106225] Updated weights for policy 1, policy_version 1012059 (0.0008) [2023-12-28 02:30:47,252][106226] Updated weights for policy 0, policy_version 1009573 (0.0007) [2023-12-28 02:30:47,296][106226] Updated weights for policy 0, policy_version 1009583 (0.0005) [2023-12-28 02:30:47,343][106226] Updated weights for policy 0, policy_version 1009593 (0.0006) [2023-12-28 02:30:47,529][106225] Updated weights for policy 1, policy_version 1012069 (0.0005) [2023-12-28 02:30:47,592][106225] Updated weights for policy 1, policy_version 1012079 (0.0006) [2023-12-28 02:30:47,652][106225] Updated weights for policy 1, policy_version 1012089 (0.0005) [2023-12-28 02:30:48,036][106226] Updated weights for policy 0, policy_version 1009603 (0.0007) [2023-12-28 02:30:48,087][106226] Updated weights for policy 0, policy_version 1009614 (0.0009) [2023-12-28 02:30:48,145][106226] Updated weights for policy 0, policy_version 1009624 (0.0007) [2023-12-28 02:30:48,251][106225] Updated weights for policy 1, policy_version 1012099 (0.0008) [2023-12-28 02:30:48,302][106225] Updated weights for policy 1, policy_version 1012109 (0.0005) [2023-12-28 02:30:48,363][106225] Updated weights for policy 1, policy_version 1012119 (0.0009) [2023-12-28 02:30:48,819][106226] Updated weights for policy 0, policy_version 1009634 (0.0005) [2023-12-28 02:30:48,886][106226] Updated weights for policy 0, policy_version 1009644 (0.0009) [2023-12-28 02:30:48,943][106226] Updated weights for policy 0, policy_version 1009654 (0.0010) [2023-12-28 02:30:48,974][106225] Updated weights for policy 1, policy_version 1012129 (0.0008) [2023-12-28 02:30:49,000][106226] Updated weights for policy 0, policy_version 1009664 (0.0008) [2023-12-28 02:30:49,028][106225] Updated weights for policy 1, policy_version 1012139 (0.0007) [2023-12-28 02:30:49,074][106225] Updated weights for policy 1, policy_version 1012149 (0.0008) [2023-12-28 02:30:49,132][106225] Updated weights for policy 1, policy_version 1012159 (0.0006) [2023-12-28 02:30:49,697][106226] Updated weights for policy 0, policy_version 1009674 (0.0006) [2023-12-28 02:30:49,767][106226] Updated weights for policy 0, policy_version 1009684 (0.0006) [2023-12-28 02:30:49,838][106226] Updated weights for policy 0, policy_version 1009694 (0.0007) [2023-12-28 02:30:49,868][106225] Updated weights for policy 1, policy_version 1012169 (0.0007) [2023-12-28 02:30:49,945][106225] Updated weights for policy 1, policy_version 1012179 (0.0007) [2023-12-28 02:30:50,005][106225] Updated weights for policy 1, policy_version 1012189 (0.0008) [2023-12-28 02:30:50,529][106226] Updated weights for policy 0, policy_version 1009704 (0.0008) [2023-12-28 02:30:50,590][106226] Updated weights for policy 0, policy_version 1009714 (0.0008) [2023-12-28 02:30:50,661][106226] Updated weights for policy 0, policy_version 1009724 (0.0008) [2023-12-28 02:30:50,710][106225] Updated weights for policy 1, policy_version 1012199 (0.0008) [2023-12-28 02:30:50,773][106225] Updated weights for policy 1, policy_version 1012209 (0.0009) [2023-12-28 02:30:50,831][106225] Updated weights for policy 1, policy_version 1012219 (0.0008) [2023-12-28 02:30:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 517718016. Throughput: 0: 9933.6, 1: 9794.1. Samples: 517728380. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-28 02:30:51,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.290')] [2023-12-28 02:30:51,401][106226] Updated weights for policy 0, policy_version 1009734 (0.0009) [2023-12-28 02:30:51,455][106226] Updated weights for policy 0, policy_version 1009744 (0.0008) [2023-12-28 02:30:51,503][106226] Updated weights for policy 0, policy_version 1009754 (0.0008) [2023-12-28 02:30:51,585][106225] Updated weights for policy 1, policy_version 1012229 (0.0009) [2023-12-28 02:30:51,659][106225] Updated weights for policy 1, policy_version 1012239 (0.0009) [2023-12-28 02:30:51,715][106225] Updated weights for policy 1, policy_version 1012249 (0.0009) [2023-12-28 02:30:52,251][106226] Updated weights for policy 0, policy_version 1009764 (0.0009) [2023-12-28 02:30:52,319][106226] Updated weights for policy 0, policy_version 1009774 (0.0008) [2023-12-28 02:30:52,390][106226] Updated weights for policy 0, policy_version 1009784 (0.0007) [2023-12-28 02:30:52,494][106225] Updated weights for policy 1, policy_version 1012259 (0.0008) [2023-12-28 02:30:52,555][106225] Updated weights for policy 1, policy_version 1012269 (0.0008) [2023-12-28 02:30:52,621][106225] Updated weights for policy 1, policy_version 1012279 (0.0010) [2023-12-28 02:30:53,199][106226] Updated weights for policy 0, policy_version 1009794 (0.0010) [2023-12-28 02:30:53,231][106225] Updated weights for policy 1, policy_version 1012289 (0.0010) [2023-12-28 02:30:53,264][106226] Updated weights for policy 0, policy_version 1009804 (0.0008) [2023-12-28 02:30:53,282][106225] Updated weights for policy 1, policy_version 1012299 (0.0005) [2023-12-28 02:30:53,328][106226] Updated weights for policy 0, policy_version 1009814 (0.0009) [2023-12-28 02:30:53,329][106225] Updated weights for policy 1, policy_version 1012309 (0.0005) [2023-12-28 02:30:53,379][106225] Updated weights for policy 1, policy_version 1012319 (0.0005) [2023-12-28 02:30:53,388][106226] Updated weights for policy 0, policy_version 1009824 (0.0008) [2023-12-28 02:30:54,005][106225] Updated weights for policy 1, policy_version 1012329 (0.0010) [2023-12-28 02:30:54,055][106225] Updated weights for policy 1, policy_version 1012339 (0.0010) [2023-12-28 02:30:54,108][106225] Updated weights for policy 1, policy_version 1012349 (0.0009) [2023-12-28 02:30:54,132][106226] Updated weights for policy 0, policy_version 1009834 (0.0008) [2023-12-28 02:30:54,186][106226] Updated weights for policy 0, policy_version 1009844 (0.0008) [2023-12-28 02:30:54,250][106226] Updated weights for policy 0, policy_version 1009854 (0.0006) [2023-12-28 02:30:54,756][106225] Updated weights for policy 1, policy_version 1012359 (0.0009) [2023-12-28 02:30:54,806][106225] Updated weights for policy 1, policy_version 1012369 (0.0010) [2023-12-28 02:30:54,858][106225] Updated weights for policy 1, policy_version 1012379 (0.0010) [2023-12-28 02:30:54,930][106226] Updated weights for policy 0, policy_version 1009864 (0.0010) [2023-12-28 02:30:54,993][106226] Updated weights for policy 0, policy_version 1009874 (0.0011) [2023-12-28 02:30:55,044][106226] Updated weights for policy 0, policy_version 1009884 (0.0011) [2023-12-28 02:30:55,508][106225] Updated weights for policy 1, policy_version 1012389 (0.0005) [2023-12-28 02:30:55,565][106225] Updated weights for policy 1, policy_version 1012399 (0.0005) [2023-12-28 02:30:55,630][106225] Updated weights for policy 1, policy_version 1012409 (0.0006) [2023-12-28 02:30:55,701][106226] Updated weights for policy 0, policy_version 1009894 (0.0011) [2023-12-28 02:30:55,761][106226] Updated weights for policy 0, policy_version 1009904 (0.0011) [2023-12-28 02:30:55,823][106226] Updated weights for policy 0, policy_version 1009914 (0.0010) [2023-12-28 02:30:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 517816320. Throughput: 0: 9876.5, 1: 9842.9. Samples: 517786036. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:30:56,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.547')] [2023-12-28 02:30:56,176][106225] Updated weights for policy 1, policy_version 1012419 (0.0009) [2023-12-28 02:30:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001009920_258596864.pth... [2023-12-28 02:30:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001008768_258301952.pth [2023-12-28 02:30:56,229][106225] Updated weights for policy 1, policy_version 1012429 (0.0008) [2023-12-28 02:30:56,282][106225] Updated weights for policy 1, policy_version 1012439 (0.0008) [2023-12-28 02:30:56,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001012448_259227648.pth... [2023-12-28 02:30:56,335][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001011264_258924544.pth [2023-12-28 02:30:56,450][106226] Updated weights for policy 0, policy_version 1009924 (0.0008) [2023-12-28 02:30:56,506][106226] Updated weights for policy 0, policy_version 1009934 (0.0006) [2023-12-28 02:30:56,559][106226] Updated weights for policy 0, policy_version 1009944 (0.0009) [2023-12-28 02:30:56,914][106225] Updated weights for policy 1, policy_version 1012449 (0.0007) [2023-12-28 02:30:56,966][106225] Updated weights for policy 1, policy_version 1012459 (0.0005) [2023-12-28 02:30:57,020][106225] Updated weights for policy 1, policy_version 1012469 (0.0006) [2023-12-28 02:30:57,083][106225] Updated weights for policy 1, policy_version 1012479 (0.0006) [2023-12-28 02:30:57,280][106226] Updated weights for policy 0, policy_version 1009954 (0.0008) [2023-12-28 02:30:57,333][106226] Updated weights for policy 0, policy_version 1009964 (0.0010) [2023-12-28 02:30:57,379][106226] Updated weights for policy 0, policy_version 1009974 (0.0010) [2023-12-28 02:30:57,435][106226] Updated weights for policy 0, policy_version 1009984 (0.0008) [2023-12-28 02:30:57,712][106225] Updated weights for policy 1, policy_version 1012489 (0.0008) [2023-12-28 02:30:57,757][106225] Updated weights for policy 1, policy_version 1012499 (0.0008) [2023-12-28 02:30:57,803][106225] Updated weights for policy 1, policy_version 1012509 (0.0008) [2023-12-28 02:30:58,101][106226] Updated weights for policy 0, policy_version 1009994 (0.0009) [2023-12-28 02:30:58,168][106226] Updated weights for policy 0, policy_version 1010004 (0.0008) [2023-12-28 02:30:58,234][106226] Updated weights for policy 0, policy_version 1010014 (0.0007) [2023-12-28 02:30:58,501][106225] Updated weights for policy 1, policy_version 1012519 (0.0008) [2023-12-28 02:30:58,568][106225] Updated weights for policy 1, policy_version 1012529 (0.0009) [2023-12-28 02:30:58,632][106225] Updated weights for policy 1, policy_version 1012539 (0.0008) [2023-12-28 02:30:59,066][106226] Updated weights for policy 0, policy_version 1010024 (0.0009) [2023-12-28 02:30:59,133][106226] Updated weights for policy 0, policy_version 1010034 (0.0008) [2023-12-28 02:30:59,197][106226] Updated weights for policy 0, policy_version 1010044 (0.0007) [2023-12-28 02:30:59,398][106225] Updated weights for policy 1, policy_version 1012549 (0.0007) [2023-12-28 02:30:59,459][106225] Updated weights for policy 1, policy_version 1012559 (0.0010) [2023-12-28 02:30:59,506][106225] Updated weights for policy 1, policy_version 1012569 (0.0010) [2023-12-28 02:31:00,000][106226] Updated weights for policy 0, policy_version 1010054 (0.0007) [2023-12-28 02:31:00,061][106226] Updated weights for policy 0, policy_version 1010064 (0.0005) [2023-12-28 02:31:00,126][106226] Updated weights for policy 0, policy_version 1010074 (0.0006) [2023-12-28 02:31:00,255][106225] Updated weights for policy 1, policy_version 1012579 (0.0010) [2023-12-28 02:31:00,311][106225] Updated weights for policy 1, policy_version 1012589 (0.0008) [2023-12-28 02:31:00,364][106225] Updated weights for policy 1, policy_version 1012599 (0.0009) [2023-12-28 02:31:00,813][106226] Updated weights for policy 0, policy_version 1010084 (0.0007) [2023-12-28 02:31:00,884][106226] Updated weights for policy 0, policy_version 1010094 (0.0009) [2023-12-28 02:31:00,945][106226] Updated weights for policy 0, policy_version 1010104 (0.0009) [2023-12-28 02:31:01,012][106225] Updated weights for policy 1, policy_version 1012609 (0.0008) [2023-12-28 02:31:01,081][106225] Updated weights for policy 1, policy_version 1012619 (0.0009) [2023-12-28 02:31:01,143][106225] Updated weights for policy 1, policy_version 1012629 (0.0008) [2023-12-28 02:31:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19549.7). Total num frames: 517914624. Throughput: 0: 9877.1, 1: 9980.2. Samples: 517906848. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:01,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-5.007')] [2023-12-28 02:31:01,201][106225] Updated weights for policy 1, policy_version 1012639 (0.0009) [2023-12-28 02:31:01,702][106226] Updated weights for policy 0, policy_version 1010114 (0.0009) [2023-12-28 02:31:01,771][106226] Updated weights for policy 0, policy_version 1010124 (0.0009) [2023-12-28 02:31:01,837][106226] Updated weights for policy 0, policy_version 1010134 (0.0009) [2023-12-28 02:31:01,895][106226] Updated weights for policy 0, policy_version 1010144 (0.0008) [2023-12-28 02:31:02,010][106225] Updated weights for policy 1, policy_version 1012649 (0.0009) [2023-12-28 02:31:02,070][106225] Updated weights for policy 1, policy_version 1012659 (0.0009) [2023-12-28 02:31:02,139][106225] Updated weights for policy 1, policy_version 1012669 (0.0009) [2023-12-28 02:31:02,586][106226] Updated weights for policy 0, policy_version 1010154 (0.0009) [2023-12-28 02:31:02,647][106226] Updated weights for policy 0, policy_version 1010164 (0.0009) [2023-12-28 02:31:02,706][106226] Updated weights for policy 0, policy_version 1010174 (0.0008) [2023-12-28 02:31:02,919][106225] Updated weights for policy 1, policy_version 1012679 (0.0008) [2023-12-28 02:31:02,982][106225] Updated weights for policy 1, policy_version 1012689 (0.0008) [2023-12-28 02:31:03,045][106225] Updated weights for policy 1, policy_version 1012699 (0.0007) [2023-12-28 02:31:03,450][106226] Updated weights for policy 0, policy_version 1010184 (0.0008) [2023-12-28 02:31:03,514][106226] Updated weights for policy 0, policy_version 1010194 (0.0008) [2023-12-28 02:31:03,571][106226] Updated weights for policy 0, policy_version 1010204 (0.0008) [2023-12-28 02:31:03,758][106225] Updated weights for policy 1, policy_version 1012709 (0.0008) [2023-12-28 02:31:03,813][106225] Updated weights for policy 1, policy_version 1012719 (0.0007) [2023-12-28 02:31:03,880][106225] Updated weights for policy 1, policy_version 1012729 (0.0009) [2023-12-28 02:31:04,321][106226] Updated weights for policy 0, policy_version 1010214 (0.0008) [2023-12-28 02:31:04,391][106226] Updated weights for policy 0, policy_version 1010224 (0.0008) [2023-12-28 02:31:04,454][106226] Updated weights for policy 0, policy_version 1010234 (0.0008) [2023-12-28 02:31:04,637][106225] Updated weights for policy 1, policy_version 1012739 (0.0009) [2023-12-28 02:31:04,693][106225] Updated weights for policy 1, policy_version 1012749 (0.0010) [2023-12-28 02:31:04,756][106225] Updated weights for policy 1, policy_version 1012759 (0.0010) [2023-12-28 02:31:05,189][106226] Updated weights for policy 0, policy_version 1010244 (0.0008) [2023-12-28 02:31:05,243][106226] Updated weights for policy 0, policy_version 1010254 (0.0007) [2023-12-28 02:31:05,308][106226] Updated weights for policy 0, policy_version 1010264 (0.0008) [2023-12-28 02:31:05,476][106225] Updated weights for policy 1, policy_version 1012769 (0.0010) [2023-12-28 02:31:05,537][106225] Updated weights for policy 1, policy_version 1012779 (0.0011) [2023-12-28 02:31:05,595][106225] Updated weights for policy 1, policy_version 1012789 (0.0010) [2023-12-28 02:31:05,653][106225] Updated weights for policy 1, policy_version 1012799 (0.0010) [2023-12-28 02:31:06,057][106226] Updated weights for policy 0, policy_version 1010274 (0.0008) [2023-12-28 02:31:06,122][106226] Updated weights for policy 0, policy_version 1010284 (0.0008) [2023-12-28 02:31:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19522.0). Total num frames: 518004736. Throughput: 0: 9808.7, 1: 9923.2. Samples: 518020116. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:06,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.116')] [2023-12-28 02:31:06,185][106226] Updated weights for policy 0, policy_version 1010294 (0.0008) [2023-12-28 02:31:06,248][106226] Updated weights for policy 0, policy_version 1010304 (0.0008) [2023-12-28 02:31:06,388][106225] Updated weights for policy 1, policy_version 1012809 (0.0011) [2023-12-28 02:31:06,451][106225] Updated weights for policy 1, policy_version 1012819 (0.0010) [2023-12-28 02:31:06,508][106225] Updated weights for policy 1, policy_version 1012829 (0.0010) [2023-12-28 02:31:07,003][106226] Updated weights for policy 0, policy_version 1010314 (0.0008) [2023-12-28 02:31:07,063][106226] Updated weights for policy 0, policy_version 1010324 (0.0008) [2023-12-28 02:31:07,121][106226] Updated weights for policy 0, policy_version 1010334 (0.0008) [2023-12-28 02:31:07,236][106225] Updated weights for policy 1, policy_version 1012839 (0.0011) [2023-12-28 02:31:07,301][106225] Updated weights for policy 1, policy_version 1012849 (0.0011) [2023-12-28 02:31:07,362][106225] Updated weights for policy 1, policy_version 1012859 (0.0010) [2023-12-28 02:31:07,790][106226] Updated weights for policy 0, policy_version 1010344 (0.0006) [2023-12-28 02:31:07,841][106226] Updated weights for policy 0, policy_version 1010354 (0.0005) [2023-12-28 02:31:07,902][106226] Updated weights for policy 0, policy_version 1010364 (0.0005) [2023-12-28 02:31:08,080][106225] Updated weights for policy 1, policy_version 1012869 (0.0011) [2023-12-28 02:31:08,147][106225] Updated weights for policy 1, policy_version 1012879 (0.0005) [2023-12-28 02:31:08,212][106225] Updated weights for policy 1, policy_version 1012889 (0.0005) [2023-12-28 02:31:08,522][106226] Updated weights for policy 0, policy_version 1010374 (0.0006) [2023-12-28 02:31:08,590][106226] Updated weights for policy 0, policy_version 1010384 (0.0006) [2023-12-28 02:31:08,658][106226] Updated weights for policy 0, policy_version 1010394 (0.0006) [2023-12-28 02:31:08,918][106225] Updated weights for policy 1, policy_version 1012899 (0.0007) [2023-12-28 02:31:08,977][106225] Updated weights for policy 1, policy_version 1012909 (0.0011) [2023-12-28 02:31:09,038][106225] Updated weights for policy 1, policy_version 1012919 (0.0011) [2023-12-28 02:31:09,261][106226] Updated weights for policy 0, policy_version 1010404 (0.0007) [2023-12-28 02:31:09,320][106226] Updated weights for policy 0, policy_version 1010414 (0.0008) [2023-12-28 02:31:09,398][106226] Updated weights for policy 0, policy_version 1010424 (0.0009) [2023-12-28 02:31:09,812][106225] Updated weights for policy 1, policy_version 1012929 (0.0010) [2023-12-28 02:31:09,884][106225] Updated weights for policy 1, policy_version 1012939 (0.0008) [2023-12-28 02:31:09,950][106225] Updated weights for policy 1, policy_version 1012949 (0.0008) [2023-12-28 02:31:10,013][106225] Updated weights for policy 1, policy_version 1012959 (0.0008) [2023-12-28 02:31:10,126][106226] Updated weights for policy 0, policy_version 1010434 (0.0008) [2023-12-28 02:31:10,195][106226] Updated weights for policy 0, policy_version 1010444 (0.0008) [2023-12-28 02:31:10,253][106226] Updated weights for policy 0, policy_version 1010454 (0.0009) [2023-12-28 02:31:10,314][106226] Updated weights for policy 0, policy_version 1010464 (0.0008) [2023-12-28 02:31:10,778][106225] Updated weights for policy 1, policy_version 1012969 (0.0006) [2023-12-28 02:31:10,837][106225] Updated weights for policy 1, policy_version 1012979 (0.0005) [2023-12-28 02:31:10,890][106226] Updated weights for policy 0, policy_version 1010474 (0.0007) [2023-12-28 02:31:10,898][106225] Updated weights for policy 1, policy_version 1012989 (0.0006) [2023-12-28 02:31:10,953][106226] Updated weights for policy 0, policy_version 1010484 (0.0006) [2023-12-28 02:31:11,012][106226] Updated weights for policy 0, policy_version 1010494 (0.0006) [2023-12-28 02:31:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19605.2). Total num frames: 518111232. Throughput: 0: 9838.1, 1: 9939.3. Samples: 518079272. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:11,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.762')] [2023-12-28 02:31:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001012992_259366912.pth... [2023-12-28 02:31:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001010496_258744320.pth... [2023-12-28 02:31:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001011840_259072000.pth [2023-12-28 02:31:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001009344_258449408.pth [2023-12-28 02:31:11,559][106225] Updated weights for policy 1, policy_version 1012999 (0.0008) [2023-12-28 02:31:11,625][106225] Updated weights for policy 1, policy_version 1013009 (0.0008) [2023-12-28 02:31:11,689][106225] Updated weights for policy 1, policy_version 1013019 (0.0008) [2023-12-28 02:31:11,785][106226] Updated weights for policy 0, policy_version 1010504 (0.0008) [2023-12-28 02:31:11,836][106226] Updated weights for policy 0, policy_version 1010514 (0.0009) [2023-12-28 02:31:11,884][106226] Updated weights for policy 0, policy_version 1010524 (0.0008) [2023-12-28 02:31:12,384][106225] Updated weights for policy 1, policy_version 1013029 (0.0010) [2023-12-28 02:31:12,443][106225] Updated weights for policy 1, policy_version 1013039 (0.0010) [2023-12-28 02:31:12,497][106225] Updated weights for policy 1, policy_version 1013049 (0.0010) [2023-12-28 02:31:12,570][106226] Updated weights for policy 0, policy_version 1010534 (0.0007) [2023-12-28 02:31:12,631][106226] Updated weights for policy 0, policy_version 1010544 (0.0006) [2023-12-28 02:31:12,693][106226] Updated weights for policy 0, policy_version 1010554 (0.0008) [2023-12-28 02:31:13,203][106225] Updated weights for policy 1, policy_version 1013059 (0.0011) [2023-12-28 02:31:13,257][106225] Updated weights for policy 1, policy_version 1013069 (0.0010) [2023-12-28 02:31:13,295][106226] Updated weights for policy 0, policy_version 1010564 (0.0007) [2023-12-28 02:31:13,320][106225] Updated weights for policy 1, policy_version 1013079 (0.0007) [2023-12-28 02:31:13,353][106226] Updated weights for policy 0, policy_version 1010574 (0.0008) [2023-12-28 02:31:13,413][106226] Updated weights for policy 0, policy_version 1010584 (0.0007) [2023-12-28 02:31:14,013][106225] Updated weights for policy 1, policy_version 1013089 (0.0008) [2023-12-28 02:31:14,042][106226] Updated weights for policy 0, policy_version 1010594 (0.0006) [2023-12-28 02:31:14,074][106225] Updated weights for policy 1, policy_version 1013099 (0.0010) [2023-12-28 02:31:14,099][106226] Updated weights for policy 0, policy_version 1010604 (0.0006) [2023-12-28 02:31:14,132][106225] Updated weights for policy 1, policy_version 1013109 (0.0010) [2023-12-28 02:31:14,146][106226] Updated weights for policy 0, policy_version 1010614 (0.0005) [2023-12-28 02:31:14,189][106225] Updated weights for policy 1, policy_version 1013119 (0.0010) [2023-12-28 02:31:14,199][106226] Updated weights for policy 0, policy_version 1010624 (0.0006) [2023-12-28 02:31:14,915][106225] Updated weights for policy 1, policy_version 1013129 (0.0011) [2023-12-28 02:31:14,922][106226] Updated weights for policy 0, policy_version 1010634 (0.0011) [2023-12-28 02:31:14,978][106225] Updated weights for policy 1, policy_version 1013139 (0.0010) [2023-12-28 02:31:14,988][106226] Updated weights for policy 0, policy_version 1010644 (0.0011) [2023-12-28 02:31:15,042][106225] Updated weights for policy 1, policy_version 1013149 (0.0011) [2023-12-28 02:31:15,049][106226] Updated weights for policy 0, policy_version 1010654 (0.0010) [2023-12-28 02:31:15,751][106226] Updated weights for policy 0, policy_version 1010664 (0.0010) [2023-12-28 02:31:15,765][106225] Updated weights for policy 1, policy_version 1013159 (0.0010) [2023-12-28 02:31:15,798][106226] Updated weights for policy 0, policy_version 1010674 (0.0010) [2023-12-28 02:31:15,817][106225] Updated weights for policy 1, policy_version 1013169 (0.0006) [2023-12-28 02:31:15,845][106226] Updated weights for policy 0, policy_version 1010684 (0.0010) [2023-12-28 02:31:15,871][106225] Updated weights for policy 1, policy_version 1013179 (0.0010) [2023-12-28 02:31:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 518209536. Throughput: 0: 9811.7, 1: 9804.0. Samples: 518197896. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:16,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.904')] [2023-12-28 02:31:16,525][106226] Updated weights for policy 0, policy_version 1010694 (0.0010) [2023-12-28 02:31:16,586][106225] Updated weights for policy 1, policy_version 1013189 (0.0010) [2023-12-28 02:31:16,591][106226] Updated weights for policy 0, policy_version 1010704 (0.0007) [2023-12-28 02:31:16,648][106225] Updated weights for policy 1, policy_version 1013199 (0.0010) [2023-12-28 02:31:16,648][106226] Updated weights for policy 0, policy_version 1010714 (0.0010) [2023-12-28 02:31:16,702][106225] Updated weights for policy 1, policy_version 1013209 (0.0010) [2023-12-28 02:31:17,239][106226] Updated weights for policy 0, policy_version 1010724 (0.0009) [2023-12-28 02:31:17,299][106226] Updated weights for policy 0, policy_version 1010734 (0.0010) [2023-12-28 02:31:17,355][106226] Updated weights for policy 0, policy_version 1010744 (0.0010) [2023-12-28 02:31:17,387][106225] Updated weights for policy 1, policy_version 1013219 (0.0009) [2023-12-28 02:31:17,436][106225] Updated weights for policy 1, policy_version 1013229 (0.0007) [2023-12-28 02:31:17,501][106225] Updated weights for policy 1, policy_version 1013239 (0.0007) [2023-12-28 02:31:18,068][106226] Updated weights for policy 0, policy_version 1010754 (0.0010) [2023-12-28 02:31:18,118][106226] Updated weights for policy 0, policy_version 1010764 (0.0010) [2023-12-28 02:31:18,165][106226] Updated weights for policy 0, policy_version 1010774 (0.0010) [2023-12-28 02:31:18,195][106225] Updated weights for policy 1, policy_version 1013249 (0.0006) [2023-12-28 02:31:18,219][106226] Updated weights for policy 0, policy_version 1010784 (0.0010) [2023-12-28 02:31:18,246][106225] Updated weights for policy 1, policy_version 1013259 (0.0007) [2023-12-28 02:31:18,298][106225] Updated weights for policy 1, policy_version 1013269 (0.0005) [2023-12-28 02:31:18,367][106225] Updated weights for policy 1, policy_version 1013279 (0.0008) [2023-12-28 02:31:19,002][106225] Updated weights for policy 1, policy_version 1013289 (0.0008) [2023-12-28 02:31:19,004][106226] Updated weights for policy 0, policy_version 1010794 (0.0007) [2023-12-28 02:31:19,053][106225] Updated weights for policy 1, policy_version 1013299 (0.0006) [2023-12-28 02:31:19,061][106226] Updated weights for policy 0, policy_version 1010804 (0.0007) [2023-12-28 02:31:19,101][106225] Updated weights for policy 1, policy_version 1013309 (0.0007) [2023-12-28 02:31:19,111][106226] Updated weights for policy 0, policy_version 1010814 (0.0006) [2023-12-28 02:31:19,839][106226] Updated weights for policy 0, policy_version 1010824 (0.0007) [2023-12-28 02:31:19,872][106225] Updated weights for policy 1, policy_version 1013319 (0.0008) [2023-12-28 02:31:19,902][106226] Updated weights for policy 0, policy_version 1010834 (0.0008) [2023-12-28 02:31:19,939][106225] Updated weights for policy 1, policy_version 1013329 (0.0010) [2023-12-28 02:31:19,969][106226] Updated weights for policy 0, policy_version 1010844 (0.0008) [2023-12-28 02:31:19,998][106225] Updated weights for policy 1, policy_version 1013339 (0.0010) [2023-12-28 02:31:20,751][106225] Updated weights for policy 1, policy_version 1013349 (0.0009) [2023-12-28 02:31:20,754][106226] Updated weights for policy 0, policy_version 1010854 (0.0007) [2023-12-28 02:31:20,813][106225] Updated weights for policy 1, policy_version 1013359 (0.0007) [2023-12-28 02:31:20,818][106226] Updated weights for policy 0, policy_version 1010864 (0.0008) [2023-12-28 02:31:20,873][106225] Updated weights for policy 1, policy_version 1013369 (0.0007) [2023-12-28 02:31:20,876][106226] Updated weights for policy 0, policy_version 1010874 (0.0009) [2023-12-28 02:31:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 518307840. Throughput: 0: 9793.9, 1: 9852.9. Samples: 518315180. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:21,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.899')] [2023-12-28 02:31:21,644][106225] Updated weights for policy 1, policy_version 1013379 (0.0009) [2023-12-28 02:31:21,713][106225] Updated weights for policy 1, policy_version 1013389 (0.0008) [2023-12-28 02:31:21,769][106226] Updated weights for policy 0, policy_version 1010884 (0.0008) [2023-12-28 02:31:21,787][106225] Updated weights for policy 1, policy_version 1013399 (0.0009) [2023-12-28 02:31:21,837][106226] Updated weights for policy 0, policy_version 1010894 (0.0008) [2023-12-28 02:31:21,905][106226] Updated weights for policy 0, policy_version 1010904 (0.0008) [2023-12-28 02:31:22,477][106225] Updated weights for policy 1, policy_version 1013409 (0.0009) [2023-12-28 02:31:22,543][106225] Updated weights for policy 1, policy_version 1013419 (0.0008) [2023-12-28 02:31:22,603][106225] Updated weights for policy 1, policy_version 1013429 (0.0009) [2023-12-28 02:31:22,636][106226] Updated weights for policy 0, policy_version 1010914 (0.0009) [2023-12-28 02:31:22,662][106225] Updated weights for policy 1, policy_version 1013439 (0.0009) [2023-12-28 02:31:22,699][106226] Updated weights for policy 0, policy_version 1010924 (0.0007) [2023-12-28 02:31:22,759][106226] Updated weights for policy 0, policy_version 1010934 (0.0008) [2023-12-28 02:31:22,823][106226] Updated weights for policy 0, policy_version 1010944 (0.0009) [2023-12-28 02:31:23,396][106225] Updated weights for policy 1, policy_version 1013449 (0.0008) [2023-12-28 02:31:23,454][106225] Updated weights for policy 1, policy_version 1013459 (0.0008) [2023-12-28 02:31:23,512][106225] Updated weights for policy 1, policy_version 1013469 (0.0007) [2023-12-28 02:31:23,551][106226] Updated weights for policy 0, policy_version 1010954 (0.0011) [2023-12-28 02:31:23,598][106226] Updated weights for policy 0, policy_version 1010964 (0.0010) [2023-12-28 02:31:23,649][106226] Updated weights for policy 0, policy_version 1010974 (0.0009) [2023-12-28 02:31:24,259][106225] Updated weights for policy 1, policy_version 1013479 (0.0008) [2023-12-28 02:31:24,312][106225] Updated weights for policy 1, policy_version 1013489 (0.0008) [2023-12-28 02:31:24,366][106225] Updated weights for policy 1, policy_version 1013499 (0.0007) [2023-12-28 02:31:24,368][106226] Updated weights for policy 0, policy_version 1010984 (0.0008) [2023-12-28 02:31:24,430][106226] Updated weights for policy 0, policy_version 1010994 (0.0007) [2023-12-28 02:31:24,492][106226] Updated weights for policy 0, policy_version 1011004 (0.0007) [2023-12-28 02:31:25,091][106225] Updated weights for policy 1, policy_version 1013509 (0.0006) [2023-12-28 02:31:25,128][106226] Updated weights for policy 0, policy_version 1011014 (0.0006) [2023-12-28 02:31:25,149][106225] Updated weights for policy 1, policy_version 1013519 (0.0009) [2023-12-28 02:31:25,179][106226] Updated weights for policy 0, policy_version 1011024 (0.0005) [2023-12-28 02:31:25,206][106225] Updated weights for policy 1, policy_version 1013529 (0.0009) [2023-12-28 02:31:25,231][106226] Updated weights for policy 0, policy_version 1011034 (0.0005) [2023-12-28 02:31:25,876][106226] Updated weights for policy 0, policy_version 1011044 (0.0007) [2023-12-28 02:31:25,887][106225] Updated weights for policy 1, policy_version 1013539 (0.0007) [2023-12-28 02:31:25,929][106226] Updated weights for policy 0, policy_version 1011054 (0.0008) [2023-12-28 02:31:25,942][106225] Updated weights for policy 1, policy_version 1013549 (0.0006) [2023-12-28 02:31:25,984][106226] Updated weights for policy 0, policy_version 1011064 (0.0005) [2023-12-28 02:31:25,994][106225] Updated weights for policy 1, policy_version 1013559 (0.0005) [2023-12-28 02:31:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 518406144. Throughput: 0: 9712.1, 1: 9839.5. Samples: 518369928. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:26,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-4.811')] [2023-12-28 02:31:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001013568_259514368.pth... [2023-12-28 02:31:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001011072_258891776.pth... [2023-12-28 02:31:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001009920_258596864.pth [2023-12-28 02:31:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001012448_259227648.pth [2023-12-28 02:31:26,534][106226] Updated weights for policy 0, policy_version 1011074 (0.0005) [2023-12-28 02:31:26,583][106226] Updated weights for policy 0, policy_version 1011084 (0.0006) [2023-12-28 02:31:26,628][106226] Updated weights for policy 0, policy_version 1011094 (0.0008) [2023-12-28 02:31:26,688][106226] Updated weights for policy 0, policy_version 1011104 (0.0010) [2023-12-28 02:31:26,702][106225] Updated weights for policy 1, policy_version 1013569 (0.0006) [2023-12-28 02:31:26,766][106225] Updated weights for policy 1, policy_version 1013579 (0.0010) [2023-12-28 02:31:26,822][106225] Updated weights for policy 1, policy_version 1013589 (0.0010) [2023-12-28 02:31:26,879][106225] Updated weights for policy 1, policy_version 1013599 (0.0008) [2023-12-28 02:31:27,409][106226] Updated weights for policy 0, policy_version 1011114 (0.0005) [2023-12-28 02:31:27,465][106225] Updated weights for policy 1, policy_version 1013609 (0.0010) [2023-12-28 02:31:27,469][106226] Updated weights for policy 0, policy_version 1011124 (0.0009) [2023-12-28 02:31:27,527][106226] Updated weights for policy 0, policy_version 1011134 (0.0011) [2023-12-28 02:31:27,529][106225] Updated weights for policy 1, policy_version 1013619 (0.0011) [2023-12-28 02:31:27,589][106225] Updated weights for policy 1, policy_version 1013629 (0.0010) [2023-12-28 02:31:28,165][106226] Updated weights for policy 0, policy_version 1011144 (0.0011) [2023-12-28 02:31:28,232][106226] Updated weights for policy 0, policy_version 1011154 (0.0009) [2023-12-28 02:31:28,274][106225] Updated weights for policy 1, policy_version 1013639 (0.0010) [2023-12-28 02:31:28,287][106226] Updated weights for policy 0, policy_version 1011164 (0.0010) [2023-12-28 02:31:28,324][106225] Updated weights for policy 1, policy_version 1013649 (0.0008) [2023-12-28 02:31:28,392][106225] Updated weights for policy 1, policy_version 1013659 (0.0008) [2023-12-28 02:31:28,948][106226] Updated weights for policy 0, policy_version 1011174 (0.0008) [2023-12-28 02:31:29,003][106226] Updated weights for policy 0, policy_version 1011184 (0.0008) [2023-12-28 02:31:29,059][106226] Updated weights for policy 0, policy_version 1011194 (0.0007) [2023-12-28 02:31:29,113][106225] Updated weights for policy 1, policy_version 1013669 (0.0010) [2023-12-28 02:31:29,167][106225] Updated weights for policy 1, policy_version 1013679 (0.0010) [2023-12-28 02:31:29,217][106225] Updated weights for policy 1, policy_version 1013689 (0.0010) [2023-12-28 02:31:29,781][106226] Updated weights for policy 0, policy_version 1011204 (0.0008) [2023-12-28 02:31:29,844][106226] Updated weights for policy 0, policy_version 1011214 (0.0009) [2023-12-28 02:31:29,900][106226] Updated weights for policy 0, policy_version 1011224 (0.0008) [2023-12-28 02:31:29,987][106225] Updated weights for policy 1, policy_version 1013699 (0.0009) [2023-12-28 02:31:30,050][106225] Updated weights for policy 1, policy_version 1013709 (0.0010) [2023-12-28 02:31:30,117][106225] Updated weights for policy 1, policy_version 1013719 (0.0005) [2023-12-28 02:31:30,687][106226] Updated weights for policy 0, policy_version 1011234 (0.0008) [2023-12-28 02:31:30,730][106225] Updated weights for policy 1, policy_version 1013729 (0.0006) [2023-12-28 02:31:30,743][106226] Updated weights for policy 0, policy_version 1011244 (0.0008) [2023-12-28 02:31:30,788][106225] Updated weights for policy 1, policy_version 1013739 (0.0005) [2023-12-28 02:31:30,801][106226] Updated weights for policy 0, policy_version 1011254 (0.0007) [2023-12-28 02:31:30,837][106225] Updated weights for policy 1, policy_version 1013749 (0.0005) [2023-12-28 02:31:30,856][106226] Updated weights for policy 0, policy_version 1011264 (0.0008) [2023-12-28 02:31:30,881][106225] Updated weights for policy 1, policy_version 1013759 (0.0005) [2023-12-28 02:31:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 518504448. Throughput: 0: 9813.1, 1: 9863.0. Samples: 518492732. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:31,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-4.581')] [2023-12-28 02:31:31,513][106225] Updated weights for policy 1, policy_version 1013769 (0.0008) [2023-12-28 02:31:31,573][106225] Updated weights for policy 1, policy_version 1013779 (0.0008) [2023-12-28 02:31:31,583][106226] Updated weights for policy 0, policy_version 1011274 (0.0007) [2023-12-28 02:31:31,642][106225] Updated weights for policy 1, policy_version 1013789 (0.0007) [2023-12-28 02:31:31,653][106226] Updated weights for policy 0, policy_version 1011284 (0.0006) [2023-12-28 02:31:31,723][106226] Updated weights for policy 0, policy_version 1011294 (0.0007) [2023-12-28 02:31:32,374][106226] Updated weights for policy 0, policy_version 1011304 (0.0007) [2023-12-28 02:31:32,391][106225] Updated weights for policy 1, policy_version 1013799 (0.0008) [2023-12-28 02:31:32,441][106226] Updated weights for policy 0, policy_version 1011314 (0.0008) [2023-12-28 02:31:32,454][106225] Updated weights for policy 1, policy_version 1013809 (0.0008) [2023-12-28 02:31:32,507][106225] Updated weights for policy 1, policy_version 1013819 (0.0006) [2023-12-28 02:31:32,510][106226] Updated weights for policy 0, policy_version 1011324 (0.0006) [2023-12-28 02:31:33,142][106225] Updated weights for policy 1, policy_version 1013829 (0.0007) [2023-12-28 02:31:33,191][106225] Updated weights for policy 1, policy_version 1013839 (0.0008) [2023-12-28 02:31:33,237][106226] Updated weights for policy 0, policy_version 1011334 (0.0007) [2023-12-28 02:31:33,247][106225] Updated weights for policy 1, policy_version 1013849 (0.0007) [2023-12-28 02:31:33,289][106226] Updated weights for policy 0, policy_version 1011344 (0.0007) [2023-12-28 02:31:33,336][106226] Updated weights for policy 0, policy_version 1011354 (0.0007) [2023-12-28 02:31:33,957][106225] Updated weights for policy 1, policy_version 1013859 (0.0005) [2023-12-28 02:31:33,966][106226] Updated weights for policy 0, policy_version 1011364 (0.0007) [2023-12-28 02:31:34,011][106225] Updated weights for policy 1, policy_version 1013869 (0.0006) [2023-12-28 02:31:34,017][106226] Updated weights for policy 0, policy_version 1011374 (0.0006) [2023-12-28 02:31:34,062][106226] Updated weights for policy 0, policy_version 1011384 (0.0005) [2023-12-28 02:31:34,065][106225] Updated weights for policy 1, policy_version 1013879 (0.0006) [2023-12-28 02:31:34,789][106226] Updated weights for policy 0, policy_version 1011394 (0.0006) [2023-12-28 02:31:34,813][106225] Updated weights for policy 1, policy_version 1013889 (0.0009) [2023-12-28 02:31:34,851][106226] Updated weights for policy 0, policy_version 1011404 (0.0006) [2023-12-28 02:31:34,865][106225] Updated weights for policy 1, policy_version 1013899 (0.0007) [2023-12-28 02:31:34,911][106226] Updated weights for policy 0, policy_version 1011414 (0.0007) [2023-12-28 02:31:34,917][106225] Updated weights for policy 1, policy_version 1013909 (0.0007) [2023-12-28 02:31:34,965][106225] Updated weights for policy 1, policy_version 1013919 (0.0007) [2023-12-28 02:31:34,971][106226] Updated weights for policy 0, policy_version 1011424 (0.0008) [2023-12-28 02:31:35,676][106226] Updated weights for policy 0, policy_version 1011434 (0.0008) [2023-12-28 02:31:35,699][106225] Updated weights for policy 1, policy_version 1013929 (0.0008) [2023-12-28 02:31:35,730][106226] Updated weights for policy 0, policy_version 1011444 (0.0008) [2023-12-28 02:31:35,748][106225] Updated weights for policy 1, policy_version 1013940 (0.0006) [2023-12-28 02:31:35,781][106226] Updated weights for policy 0, policy_version 1011454 (0.0006) [2023-12-28 02:31:35,802][106225] Updated weights for policy 1, policy_version 1013951 (0.0008) [2023-12-28 02:31:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 518602752. Throughput: 0: 9827.2, 1: 9823.2. Samples: 518612648. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:36,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-4.907')] [2023-12-28 02:31:36,455][106226] Updated weights for policy 0, policy_version 1011464 (0.0008) [2023-12-28 02:31:36,514][106226] Updated weights for policy 0, policy_version 1011474 (0.0008) [2023-12-28 02:31:36,579][106226] Updated weights for policy 0, policy_version 1011484 (0.0010) [2023-12-28 02:31:36,605][106225] Updated weights for policy 1, policy_version 1013961 (0.0008) [2023-12-28 02:31:36,664][106225] Updated weights for policy 1, policy_version 1013971 (0.0008) [2023-12-28 02:31:36,729][106225] Updated weights for policy 1, policy_version 1013981 (0.0008) [2023-12-28 02:31:37,314][106226] Updated weights for policy 0, policy_version 1011494 (0.0011) [2023-12-28 02:31:37,368][106226] Updated weights for policy 0, policy_version 1011504 (0.0010) [2023-12-28 02:31:37,422][106226] Updated weights for policy 0, policy_version 1011514 (0.0011) [2023-12-28 02:31:37,448][106225] Updated weights for policy 1, policy_version 1013991 (0.0006) [2023-12-28 02:31:37,498][106225] Updated weights for policy 1, policy_version 1014001 (0.0007) [2023-12-28 02:31:37,548][106225] Updated weights for policy 1, policy_version 1014011 (0.0008) [2023-12-28 02:31:38,167][106226] Updated weights for policy 0, policy_version 1011524 (0.0011) [2023-12-28 02:31:38,233][106226] Updated weights for policy 0, policy_version 1011534 (0.0010) [2023-12-28 02:31:38,290][106226] Updated weights for policy 0, policy_version 1011544 (0.0011) [2023-12-28 02:31:38,308][106225] Updated weights for policy 1, policy_version 1014021 (0.0006) [2023-12-28 02:31:38,367][106225] Updated weights for policy 1, policy_version 1014031 (0.0008) [2023-12-28 02:31:38,424][106225] Updated weights for policy 1, policy_version 1014041 (0.0008) [2023-12-28 02:31:39,028][106226] Updated weights for policy 0, policy_version 1011554 (0.0010) [2023-12-28 02:31:39,083][106226] Updated weights for policy 0, policy_version 1011564 (0.0010) [2023-12-28 02:31:39,139][106226] Updated weights for policy 0, policy_version 1011574 (0.0010) [2023-12-28 02:31:39,167][106225] Updated weights for policy 1, policy_version 1014051 (0.0007) [2023-12-28 02:31:39,192][106226] Updated weights for policy 0, policy_version 1011584 (0.0010) [2023-12-28 02:31:39,223][106225] Updated weights for policy 1, policy_version 1014061 (0.0006) [2023-12-28 02:31:39,277][106225] Updated weights for policy 1, policy_version 1014071 (0.0008) [2023-12-28 02:31:39,953][106226] Updated weights for policy 0, policy_version 1011594 (0.0011) [2023-12-28 02:31:40,015][106226] Updated weights for policy 0, policy_version 1011604 (0.0010) [2023-12-28 02:31:40,057][106225] Updated weights for policy 1, policy_version 1014081 (0.0008) [2023-12-28 02:31:40,077][106226] Updated weights for policy 0, policy_version 1011614 (0.0011) [2023-12-28 02:31:40,117][106225] Updated weights for policy 1, policy_version 1014091 (0.0008) [2023-12-28 02:31:40,186][106225] Updated weights for policy 1, policy_version 1014101 (0.0008) [2023-12-28 02:31:40,251][106225] Updated weights for policy 1, policy_version 1014111 (0.0008) [2023-12-28 02:31:40,820][106226] Updated weights for policy 0, policy_version 1011624 (0.0011) [2023-12-28 02:31:40,887][106226] Updated weights for policy 0, policy_version 1011634 (0.0011) [2023-12-28 02:31:40,945][106226] Updated weights for policy 0, policy_version 1011644 (0.0011) [2023-12-28 02:31:40,949][106225] Updated weights for policy 1, policy_version 1014121 (0.0008) [2023-12-28 02:31:41,003][106225] Updated weights for policy 1, policy_version 1014131 (0.0009) [2023-12-28 02:31:41,060][106225] Updated weights for policy 1, policy_version 1014141 (0.0010) [2023-12-28 02:31:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 518701056. Throughput: 0: 9842.7, 1: 9773.2. Samples: 518668748. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:41,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-5.021')] [2023-12-28 02:31:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001014144_259661824.pth... [2023-12-28 02:31:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001011648_259039232.pth... [2023-12-28 02:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001010496_258744320.pth [2023-12-28 02:31:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001012992_259366912.pth [2023-12-28 02:31:41,686][106226] Updated weights for policy 0, policy_version 1011654 (0.0010) [2023-12-28 02:31:41,760][106226] Updated weights for policy 0, policy_version 1011664 (0.0011) [2023-12-28 02:31:41,807][106225] Updated weights for policy 1, policy_version 1014151 (0.0009) [2023-12-28 02:31:41,824][106226] Updated weights for policy 0, policy_version 1011674 (0.0010) [2023-12-28 02:31:41,863][106225] Updated weights for policy 1, policy_version 1014161 (0.0008) [2023-12-28 02:31:41,914][106225] Updated weights for policy 1, policy_version 1014171 (0.0008) [2023-12-28 02:31:42,481][106226] Updated weights for policy 0, policy_version 1011684 (0.0010) [2023-12-28 02:31:42,545][106226] Updated weights for policy 0, policy_version 1011694 (0.0011) [2023-12-28 02:31:42,602][106226] Updated weights for policy 0, policy_version 1011704 (0.0011) [2023-12-28 02:31:42,658][106225] Updated weights for policy 1, policy_version 1014181 (0.0007) [2023-12-28 02:31:42,717][106225] Updated weights for policy 1, policy_version 1014191 (0.0005) [2023-12-28 02:31:42,770][106225] Updated weights for policy 1, policy_version 1014201 (0.0006) [2023-12-28 02:31:43,285][106226] Updated weights for policy 0, policy_version 1011714 (0.0011) [2023-12-28 02:31:43,332][106226] Updated weights for policy 0, policy_version 1011724 (0.0010) [2023-12-28 02:31:43,389][106226] Updated weights for policy 0, policy_version 1011734 (0.0010) [2023-12-28 02:31:43,394][106225] Updated weights for policy 1, policy_version 1014211 (0.0009) [2023-12-28 02:31:43,435][106226] Updated weights for policy 0, policy_version 1011744 (0.0010) [2023-12-28 02:31:43,447][106225] Updated weights for policy 1, policy_version 1014221 (0.0006) [2023-12-28 02:31:43,503][106225] Updated weights for policy 1, policy_version 1014231 (0.0006) [2023-12-28 02:31:44,121][106226] Updated weights for policy 0, policy_version 1011754 (0.0005) [2023-12-28 02:31:44,174][106226] Updated weights for policy 0, policy_version 1011764 (0.0005) [2023-12-28 02:31:44,229][106226] Updated weights for policy 0, policy_version 1011774 (0.0005) [2023-12-28 02:31:44,258][106225] Updated weights for policy 1, policy_version 1014241 (0.0009) [2023-12-28 02:31:44,305][106225] Updated weights for policy 1, policy_version 1014251 (0.0009) [2023-12-28 02:31:44,352][106225] Updated weights for policy 1, policy_version 1014261 (0.0007) [2023-12-28 02:31:44,405][106225] Updated weights for policy 1, policy_version 1014271 (0.0007) [2023-12-28 02:31:44,833][106226] Updated weights for policy 0, policy_version 1011784 (0.0010) [2023-12-28 02:31:44,899][106226] Updated weights for policy 0, policy_version 1011794 (0.0009) [2023-12-28 02:31:44,963][106226] Updated weights for policy 0, policy_version 1011804 (0.0008) [2023-12-28 02:31:45,136][106225] Updated weights for policy 1, policy_version 1014281 (0.0008) [2023-12-28 02:31:45,199][106225] Updated weights for policy 1, policy_version 1014291 (0.0008) [2023-12-28 02:31:45,262][106225] Updated weights for policy 1, policy_version 1014301 (0.0008) [2023-12-28 02:31:45,687][106226] Updated weights for policy 0, policy_version 1011814 (0.0011) [2023-12-28 02:31:45,743][106226] Updated weights for policy 0, policy_version 1011824 (0.0010) [2023-12-28 02:31:45,799][106226] Updated weights for policy 0, policy_version 1011834 (0.0011) [2023-12-28 02:31:46,002][106225] Updated weights for policy 1, policy_version 1014311 (0.0008) [2023-12-28 02:31:46,057][106225] Updated weights for policy 1, policy_version 1014321 (0.0008) [2023-12-28 02:31:46,113][106225] Updated weights for policy 1, policy_version 1014331 (0.0008) [2023-12-28 02:31:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 518799360. Throughput: 0: 9842.4, 1: 9681.1. Samples: 518785404. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:46,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-4.956')] [2023-12-28 02:31:46,455][106226] Updated weights for policy 0, policy_version 1011844 (0.0006) [2023-12-28 02:31:46,509][106226] Updated weights for policy 0, policy_version 1011854 (0.0007) [2023-12-28 02:31:46,562][106226] Updated weights for policy 0, policy_version 1011864 (0.0007) [2023-12-28 02:31:46,868][106225] Updated weights for policy 1, policy_version 1014341 (0.0007) [2023-12-28 02:31:46,918][106225] Updated weights for policy 1, policy_version 1014351 (0.0007) [2023-12-28 02:31:46,968][106225] Updated weights for policy 1, policy_version 1014361 (0.0007) [2023-12-28 02:31:47,276][106226] Updated weights for policy 0, policy_version 1011874 (0.0008) [2023-12-28 02:31:47,336][106226] Updated weights for policy 0, policy_version 1011884 (0.0011) [2023-12-28 02:31:47,386][106226] Updated weights for policy 0, policy_version 1011894 (0.0010) [2023-12-28 02:31:47,440][106226] Updated weights for policy 0, policy_version 1011904 (0.0011) [2023-12-28 02:31:47,716][106225] Updated weights for policy 1, policy_version 1014371 (0.0007) [2023-12-28 02:31:47,777][106225] Updated weights for policy 1, policy_version 1014381 (0.0005) [2023-12-28 02:31:47,828][106225] Updated weights for policy 1, policy_version 1014391 (0.0005) [2023-12-28 02:31:48,181][106226] Updated weights for policy 0, policy_version 1011914 (0.0011) [2023-12-28 02:31:48,242][106226] Updated weights for policy 0, policy_version 1011924 (0.0011) [2023-12-28 02:31:48,310][106226] Updated weights for policy 0, policy_version 1011934 (0.0011) [2023-12-28 02:31:48,379][106225] Updated weights for policy 1, policy_version 1014401 (0.0005) [2023-12-28 02:31:48,438][106225] Updated weights for policy 1, policy_version 1014411 (0.0008) [2023-12-28 02:31:48,498][106225] Updated weights for policy 1, policy_version 1014421 (0.0007) [2023-12-28 02:31:48,560][106225] Updated weights for policy 1, policy_version 1014431 (0.0008) [2023-12-28 02:31:49,011][106226] Updated weights for policy 0, policy_version 1011944 (0.0006) [2023-12-28 02:31:49,069][106226] Updated weights for policy 0, policy_version 1011954 (0.0005) [2023-12-28 02:31:49,123][106226] Updated weights for policy 0, policy_version 1011964 (0.0005) [2023-12-28 02:31:49,268][106225] Updated weights for policy 1, policy_version 1014441 (0.0008) [2023-12-28 02:31:49,326][106225] Updated weights for policy 1, policy_version 1014451 (0.0006) [2023-12-28 02:31:49,386][106225] Updated weights for policy 1, policy_version 1014461 (0.0010) [2023-12-28 02:31:49,810][106226] Updated weights for policy 0, policy_version 1011974 (0.0009) [2023-12-28 02:31:49,883][106226] Updated weights for policy 0, policy_version 1011984 (0.0010) [2023-12-28 02:31:49,957][106226] Updated weights for policy 0, policy_version 1011994 (0.0011) [2023-12-28 02:31:50,087][106225] Updated weights for policy 1, policy_version 1014471 (0.0007) [2023-12-28 02:31:50,137][106225] Updated weights for policy 1, policy_version 1014481 (0.0007) [2023-12-28 02:31:50,195][106225] Updated weights for policy 1, policy_version 1014491 (0.0007) [2023-12-28 02:31:50,680][106226] Updated weights for policy 0, policy_version 1012004 (0.0010) [2023-12-28 02:31:50,739][106226] Updated weights for policy 0, policy_version 1012014 (0.0011) [2023-12-28 02:31:50,807][106226] Updated weights for policy 0, policy_version 1012024 (0.0011) [2023-12-28 02:31:50,885][106225] Updated weights for policy 1, policy_version 1014501 (0.0007) [2023-12-28 02:31:50,948][106225] Updated weights for policy 1, policy_version 1014511 (0.0007) [2023-12-28 02:31:51,016][106225] Updated weights for policy 1, policy_version 1014521 (0.0006) [2023-12-28 02:31:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 518897664. Throughput: 0: 9891.8, 1: 9738.3. Samples: 518903472. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:51,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.813')] [2023-12-28 02:31:51,563][106226] Updated weights for policy 0, policy_version 1012034 (0.0011) [2023-12-28 02:31:51,619][106226] Updated weights for policy 0, policy_version 1012044 (0.0011) [2023-12-28 02:31:51,684][106226] Updated weights for policy 0, policy_version 1012054 (0.0012) [2023-12-28 02:31:51,730][106225] Updated weights for policy 1, policy_version 1014531 (0.0008) [2023-12-28 02:31:51,749][106226] Updated weights for policy 0, policy_version 1012064 (0.0010) [2023-12-28 02:31:51,800][106225] Updated weights for policy 1, policy_version 1014541 (0.0008) [2023-12-28 02:31:51,861][106225] Updated weights for policy 1, policy_version 1014551 (0.0008) [2023-12-28 02:31:52,441][106226] Updated weights for policy 0, policy_version 1012074 (0.0008) [2023-12-28 02:31:52,471][106225] Updated weights for policy 1, policy_version 1014561 (0.0006) [2023-12-28 02:31:52,499][106226] Updated weights for policy 0, policy_version 1012084 (0.0007) [2023-12-28 02:31:52,530][106225] Updated weights for policy 1, policy_version 1014571 (0.0006) [2023-12-28 02:31:52,556][106226] Updated weights for policy 0, policy_version 1012094 (0.0009) [2023-12-28 02:31:52,587][106225] Updated weights for policy 1, policy_version 1014581 (0.0005) [2023-12-28 02:31:52,642][106225] Updated weights for policy 1, policy_version 1014591 (0.0008) [2023-12-28 02:31:53,245][106225] Updated weights for policy 1, policy_version 1014601 (0.0006) [2023-12-28 02:31:53,292][106225] Updated weights for policy 1, policy_version 1014611 (0.0008) [2023-12-28 02:31:53,335][106226] Updated weights for policy 0, policy_version 1012104 (0.0006) [2023-12-28 02:31:53,337][106225] Updated weights for policy 1, policy_version 1014621 (0.0006) [2023-12-28 02:31:53,381][106226] Updated weights for policy 0, policy_version 1012114 (0.0007) [2023-12-28 02:31:53,433][106226] Updated weights for policy 0, policy_version 1012124 (0.0008) [2023-12-28 02:31:54,081][106225] Updated weights for policy 1, policy_version 1014631 (0.0005) [2023-12-28 02:31:54,117][106226] Updated weights for policy 0, policy_version 1012134 (0.0007) [2023-12-28 02:31:54,138][106225] Updated weights for policy 1, policy_version 1014641 (0.0006) [2023-12-28 02:31:54,187][106226] Updated weights for policy 0, policy_version 1012144 (0.0005) [2023-12-28 02:31:54,190][106225] Updated weights for policy 1, policy_version 1014651 (0.0008) [2023-12-28 02:31:54,249][106226] Updated weights for policy 0, policy_version 1012154 (0.0005) [2023-12-28 02:31:54,885][106226] Updated weights for policy 0, policy_version 1012164 (0.0007) [2023-12-28 02:31:54,889][106225] Updated weights for policy 1, policy_version 1014661 (0.0008) [2023-12-28 02:31:54,941][106225] Updated weights for policy 1, policy_version 1014671 (0.0007) [2023-12-28 02:31:54,944][106226] Updated weights for policy 0, policy_version 1012174 (0.0006) [2023-12-28 02:31:54,991][106225] Updated weights for policy 1, policy_version 1014681 (0.0006) [2023-12-28 02:31:55,006][106226] Updated weights for policy 0, policy_version 1012184 (0.0008) [2023-12-28 02:31:55,582][106226] Updated weights for policy 0, policy_version 1012194 (0.0011) [2023-12-28 02:31:55,640][106226] Updated weights for policy 0, policy_version 1012204 (0.0008) [2023-12-28 02:31:55,693][106226] Updated weights for policy 0, policy_version 1012214 (0.0008) [2023-12-28 02:31:55,759][106226] Updated weights for policy 0, policy_version 1012224 (0.0011) [2023-12-28 02:31:55,783][106225] Updated weights for policy 1, policy_version 1014691 (0.0007) [2023-12-28 02:31:55,837][106225] Updated weights for policy 1, policy_version 1014701 (0.0009) [2023-12-28 02:31:55,887][106225] Updated weights for policy 1, policy_version 1014711 (0.0009) [2023-12-28 02:31:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 518995968. Throughput: 0: 9861.8, 1: 9793.2. Samples: 518963748. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:31:56,176][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.537')] [2023-12-28 02:31:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001014720_259809280.pth... [2023-12-28 02:31:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001012224_259186688.pth... [2023-12-28 02:31:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001013568_259514368.pth [2023-12-28 02:31:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001011072_258891776.pth [2023-12-28 02:31:56,482][106226] Updated weights for policy 0, policy_version 1012234 (0.0009) [2023-12-28 02:31:56,507][106225] Updated weights for policy 1, policy_version 1014721 (0.0009) [2023-12-28 02:31:56,536][106226] Updated weights for policy 0, policy_version 1012244 (0.0007) [2023-12-28 02:31:56,562][106225] Updated weights for policy 1, policy_version 1014731 (0.0009) [2023-12-28 02:31:56,588][106226] Updated weights for policy 0, policy_version 1012254 (0.0008) [2023-12-28 02:31:56,616][106225] Updated weights for policy 1, policy_version 1014741 (0.0010) [2023-12-28 02:31:56,665][106225] Updated weights for policy 1, policy_version 1014751 (0.0008) [2023-12-28 02:31:57,236][106226] Updated weights for policy 0, policy_version 1012264 (0.0010) [2023-12-28 02:31:57,294][106226] Updated weights for policy 0, policy_version 1012274 (0.0010) [2023-12-28 02:31:57,351][106226] Updated weights for policy 0, policy_version 1012284 (0.0010) [2023-12-28 02:31:57,401][106225] Updated weights for policy 1, policy_version 1014761 (0.0006) [2023-12-28 02:31:57,463][106225] Updated weights for policy 1, policy_version 1014771 (0.0005) [2023-12-28 02:31:57,519][106225] Updated weights for policy 1, policy_version 1014781 (0.0005) [2023-12-28 02:31:58,038][106225] Updated weights for policy 1, policy_version 1014791 (0.0006) [2023-12-28 02:31:58,044][106226] Updated weights for policy 0, policy_version 1012294 (0.0010) [2023-12-28 02:31:58,093][106225] Updated weights for policy 1, policy_version 1014801 (0.0008) [2023-12-28 02:31:58,097][106226] Updated weights for policy 0, policy_version 1012304 (0.0009) [2023-12-28 02:31:58,146][106225] Updated weights for policy 1, policy_version 1014811 (0.0008) [2023-12-28 02:31:58,154][106226] Updated weights for policy 0, policy_version 1012314 (0.0010) [2023-12-28 02:31:58,997][106225] Updated weights for policy 1, policy_version 1014821 (0.0007) [2023-12-28 02:31:59,033][106226] Updated weights for policy 0, policy_version 1012324 (0.0011) [2023-12-28 02:31:59,066][106225] Updated weights for policy 1, policy_version 1014831 (0.0008) [2023-12-28 02:31:59,101][106226] Updated weights for policy 0, policy_version 1012334 (0.0008) [2023-12-28 02:31:59,130][106225] Updated weights for policy 1, policy_version 1014841 (0.0008) [2023-12-28 02:31:59,163][106226] Updated weights for policy 0, policy_version 1012344 (0.0007) [2023-12-28 02:31:59,814][106226] Updated weights for policy 0, policy_version 1012354 (0.0009) [2023-12-28 02:31:59,879][106226] Updated weights for policy 0, policy_version 1012364 (0.0008) [2023-12-28 02:31:59,907][106225] Updated weights for policy 1, policy_version 1014851 (0.0007) [2023-12-28 02:31:59,942][106226] Updated weights for policy 0, policy_version 1012374 (0.0009) [2023-12-28 02:31:59,971][106225] Updated weights for policy 1, policy_version 1014861 (0.0007) [2023-12-28 02:32:00,008][106226] Updated weights for policy 0, policy_version 1012384 (0.0007) [2023-12-28 02:32:00,025][106225] Updated weights for policy 1, policy_version 1014871 (0.0007) [2023-12-28 02:32:00,706][106225] Updated weights for policy 1, policy_version 1014881 (0.0008) [2023-12-28 02:32:00,742][106226] Updated weights for policy 0, policy_version 1012394 (0.0005) [2023-12-28 02:32:00,762][106225] Updated weights for policy 1, policy_version 1014891 (0.0008) [2023-12-28 02:32:00,802][106226] Updated weights for policy 0, policy_version 1012404 (0.0007) [2023-12-28 02:32:00,819][106225] Updated weights for policy 1, policy_version 1014901 (0.0008) [2023-12-28 02:32:00,856][106226] Updated weights for policy 0, policy_version 1012414 (0.0007) [2023-12-28 02:32:00,866][106225] Updated weights for policy 1, policy_version 1014911 (0.0006) [2023-12-28 02:32:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 519094272. Throughput: 0: 9824.7, 1: 9814.0. Samples: 519081640. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:01,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.870')] [2023-12-28 02:32:01,570][106225] Updated weights for policy 1, policy_version 1014921 (0.0006) [2023-12-28 02:32:01,620][106226] Updated weights for policy 0, policy_version 1012424 (0.0007) [2023-12-28 02:32:01,627][106225] Updated weights for policy 1, policy_version 1014931 (0.0008) [2023-12-28 02:32:01,685][106226] Updated weights for policy 0, policy_version 1012434 (0.0008) [2023-12-28 02:32:01,690][106225] Updated weights for policy 1, policy_version 1014941 (0.0007) [2023-12-28 02:32:01,745][106226] Updated weights for policy 0, policy_version 1012444 (0.0008) [2023-12-28 02:32:02,313][106225] Updated weights for policy 1, policy_version 1014951 (0.0010) [2023-12-28 02:32:02,378][106225] Updated weights for policy 1, policy_version 1014961 (0.0010) [2023-12-28 02:32:02,447][106225] Updated weights for policy 1, policy_version 1014971 (0.0008) [2023-12-28 02:32:02,488][106226] Updated weights for policy 0, policy_version 1012454 (0.0007) [2023-12-28 02:32:02,550][106226] Updated weights for policy 0, policy_version 1012464 (0.0008) [2023-12-28 02:32:02,611][106226] Updated weights for policy 0, policy_version 1012474 (0.0007) [2023-12-28 02:32:03,058][106225] Updated weights for policy 1, policy_version 1014981 (0.0010) [2023-12-28 02:32:03,114][106225] Updated weights for policy 1, policy_version 1014991 (0.0010) [2023-12-28 02:32:03,174][106225] Updated weights for policy 1, policy_version 1015001 (0.0010) [2023-12-28 02:32:03,319][106226] Updated weights for policy 0, policy_version 1012484 (0.0009) [2023-12-28 02:32:03,365][106226] Updated weights for policy 0, policy_version 1012494 (0.0007) [2023-12-28 02:32:03,410][106226] Updated weights for policy 0, policy_version 1012504 (0.0008) [2023-12-28 02:32:03,893][106225] Updated weights for policy 1, policy_version 1015011 (0.0010) [2023-12-28 02:32:03,947][106225] Updated weights for policy 1, policy_version 1015021 (0.0010) [2023-12-28 02:32:04,001][106225] Updated weights for policy 1, policy_version 1015031 (0.0010) [2023-12-28 02:32:04,137][106226] Updated weights for policy 0, policy_version 1012514 (0.0007) [2023-12-28 02:32:04,201][106226] Updated weights for policy 0, policy_version 1012524 (0.0007) [2023-12-28 02:32:04,270][106226] Updated weights for policy 0, policy_version 1012534 (0.0009) [2023-12-28 02:32:04,323][106226] Updated weights for policy 0, policy_version 1012544 (0.0008) [2023-12-28 02:32:04,757][106225] Updated weights for policy 1, policy_version 1015041 (0.0010) [2023-12-28 02:32:04,814][106225] Updated weights for policy 1, policy_version 1015051 (0.0010) [2023-12-28 02:32:04,877][106225] Updated weights for policy 1, policy_version 1015061 (0.0010) [2023-12-28 02:32:04,944][106225] Updated weights for policy 1, policy_version 1015071 (0.0010) [2023-12-28 02:32:04,973][106226] Updated weights for policy 0, policy_version 1012554 (0.0006) [2023-12-28 02:32:05,055][106226] Updated weights for policy 0, policy_version 1012564 (0.0008) [2023-12-28 02:32:05,101][106226] Updated weights for policy 0, policy_version 1012574 (0.0007) [2023-12-28 02:32:05,561][106225] Updated weights for policy 1, policy_version 1015081 (0.0006) [2023-12-28 02:32:05,614][106225] Updated weights for policy 1, policy_version 1015091 (0.0005) [2023-12-28 02:32:05,663][106225] Updated weights for policy 1, policy_version 1015101 (0.0009) [2023-12-28 02:32:05,830][106226] Updated weights for policy 0, policy_version 1012584 (0.0006) [2023-12-28 02:32:05,884][106226] Updated weights for policy 0, policy_version 1012594 (0.0005) [2023-12-28 02:32:05,940][106226] Updated weights for policy 0, policy_version 1012604 (0.0006) [2023-12-28 02:32:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 519192576. Throughput: 0: 9803.0, 1: 9873.8. Samples: 519200640. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:06,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.751')] [2023-12-28 02:32:06,308][106225] Updated weights for policy 1, policy_version 1015111 (0.0009) [2023-12-28 02:32:06,370][106225] Updated weights for policy 1, policy_version 1015121 (0.0008) [2023-12-28 02:32:06,433][106225] Updated weights for policy 1, policy_version 1015131 (0.0009) [2023-12-28 02:32:06,616][106226] Updated weights for policy 0, policy_version 1012614 (0.0009) [2023-12-28 02:32:06,684][106226] Updated weights for policy 0, policy_version 1012624 (0.0009) [2023-12-28 02:32:06,744][106226] Updated weights for policy 0, policy_version 1012634 (0.0006) [2023-12-28 02:32:07,213][106225] Updated weights for policy 1, policy_version 1015141 (0.0009) [2023-12-28 02:32:07,263][106225] Updated weights for policy 1, policy_version 1015151 (0.0009) [2023-12-28 02:32:07,312][106225] Updated weights for policy 1, policy_version 1015161 (0.0006) [2023-12-28 02:32:07,366][106226] Updated weights for policy 0, policy_version 1012644 (0.0007) [2023-12-28 02:32:07,431][106226] Updated weights for policy 0, policy_version 1012654 (0.0009) [2023-12-28 02:32:07,496][106226] Updated weights for policy 0, policy_version 1012664 (0.0008) [2023-12-28 02:32:07,969][106225] Updated weights for policy 1, policy_version 1015171 (0.0005) [2023-12-28 02:32:08,026][106225] Updated weights for policy 1, policy_version 1015181 (0.0005) [2023-12-28 02:32:08,091][106225] Updated weights for policy 1, policy_version 1015191 (0.0005) [2023-12-28 02:32:08,129][106226] Updated weights for policy 0, policy_version 1012674 (0.0007) [2023-12-28 02:32:08,203][106226] Updated weights for policy 0, policy_version 1012684 (0.0008) [2023-12-28 02:32:08,269][106226] Updated weights for policy 0, policy_version 1012694 (0.0007) [2023-12-28 02:32:08,325][106226] Updated weights for policy 0, policy_version 1012704 (0.0006) [2023-12-28 02:32:08,727][106225] Updated weights for policy 1, policy_version 1015201 (0.0006) [2023-12-28 02:32:08,780][106225] Updated weights for policy 1, policy_version 1015211 (0.0010) [2023-12-28 02:32:08,831][106225] Updated weights for policy 1, policy_version 1015221 (0.0010) [2023-12-28 02:32:08,882][106225] Updated weights for policy 1, policy_version 1015231 (0.0010) [2023-12-28 02:32:08,966][106226] Updated weights for policy 0, policy_version 1012714 (0.0008) [2023-12-28 02:32:09,019][106226] Updated weights for policy 0, policy_version 1012724 (0.0008) [2023-12-28 02:32:09,066][106226] Updated weights for policy 0, policy_version 1012734 (0.0007) [2023-12-28 02:32:09,684][106225] Updated weights for policy 1, policy_version 1015241 (0.0008) [2023-12-28 02:32:09,745][106225] Updated weights for policy 1, policy_version 1015251 (0.0009) [2023-12-28 02:32:09,810][106225] Updated weights for policy 1, policy_version 1015261 (0.0008) [2023-12-28 02:32:09,842][106226] Updated weights for policy 0, policy_version 1012744 (0.0008) [2023-12-28 02:32:09,908][106226] Updated weights for policy 0, policy_version 1012754 (0.0008) [2023-12-28 02:32:09,974][106226] Updated weights for policy 0, policy_version 1012764 (0.0010) [2023-12-28 02:32:10,561][106225] Updated weights for policy 1, policy_version 1015271 (0.0008) [2023-12-28 02:32:10,615][106225] Updated weights for policy 1, policy_version 1015281 (0.0008) [2023-12-28 02:32:10,676][106225] Updated weights for policy 1, policy_version 1015291 (0.0009) [2023-12-28 02:32:10,711][106226] Updated weights for policy 0, policy_version 1012774 (0.0010) [2023-12-28 02:32:10,769][106226] Updated weights for policy 0, policy_version 1012784 (0.0011) [2023-12-28 02:32:10,828][106226] Updated weights for policy 0, policy_version 1012794 (0.0008) [2023-12-28 02:32:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 519290880. Throughput: 0: 9891.6, 1: 9931.6. Samples: 519261976. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:11,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.749')] [2023-12-28 02:32:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001015296_259956736.pth... [2023-12-28 02:32:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001012800_259334144.pth... [2023-12-28 02:32:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001014144_259661824.pth [2023-12-28 02:32:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001011648_259039232.pth [2023-12-28 02:32:11,398][106225] Updated weights for policy 1, policy_version 1015301 (0.0010) [2023-12-28 02:32:11,462][106225] Updated weights for policy 1, policy_version 1015311 (0.0010) [2023-12-28 02:32:11,520][106225] Updated weights for policy 1, policy_version 1015321 (0.0010) [2023-12-28 02:32:11,590][106226] Updated weights for policy 0, policy_version 1012804 (0.0008) [2023-12-28 02:32:11,653][106226] Updated weights for policy 0, policy_version 1012814 (0.0008) [2023-12-28 02:32:11,717][106226] Updated weights for policy 0, policy_version 1012824 (0.0009) [2023-12-28 02:32:12,257][106225] Updated weights for policy 1, policy_version 1015331 (0.0010) [2023-12-28 02:32:12,314][106225] Updated weights for policy 1, policy_version 1015341 (0.0007) [2023-12-28 02:32:12,385][106225] Updated weights for policy 1, policy_version 1015351 (0.0008) [2023-12-28 02:32:12,506][106226] Updated weights for policy 0, policy_version 1012834 (0.0008) [2023-12-28 02:32:12,558][106226] Updated weights for policy 0, policy_version 1012844 (0.0005) [2023-12-28 02:32:12,614][106226] Updated weights for policy 0, policy_version 1012854 (0.0005) [2023-12-28 02:32:12,672][106226] Updated weights for policy 0, policy_version 1012864 (0.0007) [2023-12-28 02:32:13,059][106225] Updated weights for policy 1, policy_version 1015361 (0.0007) [2023-12-28 02:32:13,107][106225] Updated weights for policy 1, policy_version 1015371 (0.0006) [2023-12-28 02:32:13,155][106225] Updated weights for policy 1, policy_version 1015381 (0.0005) [2023-12-28 02:32:13,210][106225] Updated weights for policy 1, policy_version 1015391 (0.0005) [2023-12-28 02:32:13,387][106226] Updated weights for policy 0, policy_version 1012874 (0.0009) [2023-12-28 02:32:13,455][106226] Updated weights for policy 0, policy_version 1012884 (0.0009) [2023-12-28 02:32:13,517][106226] Updated weights for policy 0, policy_version 1012894 (0.0010) [2023-12-28 02:32:13,809][106225] Updated weights for policy 1, policy_version 1015401 (0.0010) [2023-12-28 02:32:13,873][106225] Updated weights for policy 1, policy_version 1015411 (0.0010) [2023-12-28 02:32:13,928][106225] Updated weights for policy 1, policy_version 1015421 (0.0010) [2023-12-28 02:32:14,299][106226] Updated weights for policy 0, policy_version 1012904 (0.0008) [2023-12-28 02:32:14,356][106226] Updated weights for policy 0, policy_version 1012914 (0.0008) [2023-12-28 02:32:14,417][106226] Updated weights for policy 0, policy_version 1012924 (0.0008) [2023-12-28 02:32:14,645][106225] Updated weights for policy 1, policy_version 1015431 (0.0010) [2023-12-28 02:32:14,707][106225] Updated weights for policy 1, policy_version 1015441 (0.0006) [2023-12-28 02:32:14,765][106225] Updated weights for policy 1, policy_version 1015451 (0.0006) [2023-12-28 02:32:15,182][106226] Updated weights for policy 0, policy_version 1012934 (0.0008) [2023-12-28 02:32:15,254][106226] Updated weights for policy 0, policy_version 1012944 (0.0006) [2023-12-28 02:32:15,321][106226] Updated weights for policy 0, policy_version 1012954 (0.0006) [2023-12-28 02:32:15,481][106225] Updated weights for policy 1, policy_version 1015461 (0.0008) [2023-12-28 02:32:15,546][106225] Updated weights for policy 1, policy_version 1015471 (0.0005) [2023-12-28 02:32:15,613][106225] Updated weights for policy 1, policy_version 1015481 (0.0005) [2023-12-28 02:32:15,890][106226] Updated weights for policy 0, policy_version 1012964 (0.0008) [2023-12-28 02:32:15,950][106226] Updated weights for policy 0, policy_version 1012974 (0.0011) [2023-12-28 02:32:16,015][106226] Updated weights for policy 0, policy_version 1012984 (0.0010) [2023-12-28 02:32:16,131][106225] Updated weights for policy 1, policy_version 1015491 (0.0005) [2023-12-28 02:32:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 519389184. Throughput: 0: 9738.1, 1: 9902.5. Samples: 519376556. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:16,176][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.775')] [2023-12-28 02:32:16,187][106225] Updated weights for policy 1, policy_version 1015501 (0.0005) [2023-12-28 02:32:16,251][106225] Updated weights for policy 1, policy_version 1015511 (0.0005) [2023-12-28 02:32:16,709][106226] Updated weights for policy 0, policy_version 1012994 (0.0011) [2023-12-28 02:32:16,751][106225] Updated weights for policy 1, policy_version 1015521 (0.0005) [2023-12-28 02:32:16,769][106226] Updated weights for policy 0, policy_version 1013004 (0.0010) [2023-12-28 02:32:16,801][106225] Updated weights for policy 1, policy_version 1015531 (0.0005) [2023-12-28 02:32:16,819][106226] Updated weights for policy 0, policy_version 1013014 (0.0010) [2023-12-28 02:32:16,847][106225] Updated weights for policy 1, policy_version 1015541 (0.0005) [2023-12-28 02:32:16,869][106226] Updated weights for policy 0, policy_version 1013024 (0.0010) [2023-12-28 02:32:16,906][106225] Updated weights for policy 1, policy_version 1015551 (0.0010) [2023-12-28 02:32:17,515][106225] Updated weights for policy 1, policy_version 1015561 (0.0006) [2023-12-28 02:32:17,565][106225] Updated weights for policy 1, policy_version 1015571 (0.0007) [2023-12-28 02:32:17,574][106226] Updated weights for policy 0, policy_version 1013034 (0.0010) [2023-12-28 02:32:17,622][106225] Updated weights for policy 1, policy_version 1015581 (0.0005) [2023-12-28 02:32:17,624][106226] Updated weights for policy 0, policy_version 1013044 (0.0011) [2023-12-28 02:32:17,670][106226] Updated weights for policy 0, policy_version 1013054 (0.0010) [2023-12-28 02:32:18,210][106225] Updated weights for policy 1, policy_version 1015591 (0.0007) [2023-12-28 02:32:18,264][106225] Updated weights for policy 1, policy_version 1015601 (0.0010) [2023-12-28 02:32:18,318][106225] Updated weights for policy 1, policy_version 1015611 (0.0010) [2023-12-28 02:32:18,417][106226] Updated weights for policy 0, policy_version 1013064 (0.0007) [2023-12-28 02:32:18,479][106226] Updated weights for policy 0, policy_version 1013074 (0.0008) [2023-12-28 02:32:18,543][106226] Updated weights for policy 0, policy_version 1013084 (0.0008) [2023-12-28 02:32:19,063][106225] Updated weights for policy 1, policy_version 1015621 (0.0008) [2023-12-28 02:32:19,124][106225] Updated weights for policy 1, policy_version 1015631 (0.0008) [2023-12-28 02:32:19,188][106225] Updated weights for policy 1, policy_version 1015641 (0.0007) [2023-12-28 02:32:19,267][106226] Updated weights for policy 0, policy_version 1013094 (0.0011) [2023-12-28 02:32:19,331][106226] Updated weights for policy 0, policy_version 1013104 (0.0011) [2023-12-28 02:32:19,397][106226] Updated weights for policy 0, policy_version 1013114 (0.0011) [2023-12-28 02:32:19,975][106225] Updated weights for policy 1, policy_version 1015651 (0.0008) [2023-12-28 02:32:20,036][106225] Updated weights for policy 1, policy_version 1015661 (0.0008) [2023-12-28 02:32:20,096][106226] Updated weights for policy 0, policy_version 1013124 (0.0011) [2023-12-28 02:32:20,099][106225] Updated weights for policy 1, policy_version 1015671 (0.0008) [2023-12-28 02:32:20,158][106226] Updated weights for policy 0, policy_version 1013134 (0.0011) [2023-12-28 02:32:20,214][106226] Updated weights for policy 0, policy_version 1013144 (0.0010) [2023-12-28 02:32:20,838][106225] Updated weights for policy 1, policy_version 1015681 (0.0006) [2023-12-28 02:32:20,884][106226] Updated weights for policy 0, policy_version 1013154 (0.0007) [2023-12-28 02:32:20,898][106225] Updated weights for policy 1, policy_version 1015691 (0.0006) [2023-12-28 02:32:20,942][106226] Updated weights for policy 0, policy_version 1013164 (0.0009) [2023-12-28 02:32:20,956][106225] Updated weights for policy 1, policy_version 1015701 (0.0008) [2023-12-28 02:32:20,994][106226] Updated weights for policy 0, policy_version 1013174 (0.0010) [2023-12-28 02:32:21,020][106225] Updated weights for policy 1, policy_version 1015711 (0.0006) [2023-12-28 02:32:21,068][106226] Updated weights for policy 0, policy_version 1013184 (0.0010) [2023-12-28 02:32:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 519495680. Throughput: 0: 9727.7, 1: 9959.9. Samples: 519498592. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:21,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-4.905')] [2023-12-28 02:32:21,857][106225] Updated weights for policy 1, policy_version 1015721 (0.0008) [2023-12-28 02:32:21,904][106226] Updated weights for policy 0, policy_version 1013194 (0.0008) [2023-12-28 02:32:21,915][106225] Updated weights for policy 1, policy_version 1015731 (0.0007) [2023-12-28 02:32:21,966][106226] Updated weights for policy 0, policy_version 1013204 (0.0008) [2023-12-28 02:32:21,977][106225] Updated weights for policy 1, policy_version 1015741 (0.0007) [2023-12-28 02:32:22,027][106226] Updated weights for policy 0, policy_version 1013214 (0.0009) [2023-12-28 02:32:22,750][106226] Updated weights for policy 0, policy_version 1013224 (0.0009) [2023-12-28 02:32:22,806][106225] Updated weights for policy 1, policy_version 1015751 (0.0008) [2023-12-28 02:32:22,812][106226] Updated weights for policy 0, policy_version 1013234 (0.0007) [2023-12-28 02:32:22,866][106225] Updated weights for policy 1, policy_version 1015761 (0.0008) [2023-12-28 02:32:22,868][106226] Updated weights for policy 0, policy_version 1013244 (0.0006) [2023-12-28 02:32:22,923][106225] Updated weights for policy 1, policy_version 1015771 (0.0008) [2023-12-28 02:32:23,505][106226] Updated weights for policy 0, policy_version 1013254 (0.0009) [2023-12-28 02:32:23,565][106226] Updated weights for policy 0, policy_version 1013264 (0.0010) [2023-12-28 02:32:23,594][106225] Updated weights for policy 1, policy_version 1015781 (0.0007) [2023-12-28 02:32:23,624][106226] Updated weights for policy 0, policy_version 1013274 (0.0010) [2023-12-28 02:32:23,644][106225] Updated weights for policy 1, policy_version 1015791 (0.0005) [2023-12-28 02:32:23,695][106225] Updated weights for policy 1, policy_version 1015801 (0.0005) [2023-12-28 02:32:24,229][106225] Updated weights for policy 1, policy_version 1015811 (0.0006) [2023-12-28 02:32:24,287][106225] Updated weights for policy 1, policy_version 1015821 (0.0008) [2023-12-28 02:32:24,331][106226] Updated weights for policy 0, policy_version 1013284 (0.0010) [2023-12-28 02:32:24,335][106225] Updated weights for policy 1, policy_version 1015831 (0.0007) [2023-12-28 02:32:24,387][106226] Updated weights for policy 0, policy_version 1013294 (0.0010) [2023-12-28 02:32:24,443][106226] Updated weights for policy 0, policy_version 1013304 (0.0010) [2023-12-28 02:32:24,920][106225] Updated weights for policy 1, policy_version 1015842 (0.0009) [2023-12-28 02:32:24,972][106225] Updated weights for policy 1, policy_version 1015852 (0.0010) [2023-12-28 02:32:25,023][106225] Updated weights for policy 1, policy_version 1015862 (0.0010) [2023-12-28 02:32:25,075][106225] Updated weights for policy 1, policy_version 1015872 (0.0010) [2023-12-28 02:32:25,157][106226] Updated weights for policy 0, policy_version 1013314 (0.0010) [2023-12-28 02:32:25,210][106226] Updated weights for policy 0, policy_version 1013324 (0.0010) [2023-12-28 02:32:25,278][106226] Updated weights for policy 0, policy_version 1013334 (0.0011) [2023-12-28 02:32:25,327][106226] Updated weights for policy 0, policy_version 1013344 (0.0010) [2023-12-28 02:32:25,746][106225] Updated weights for policy 1, policy_version 1015882 (0.0008) [2023-12-28 02:32:25,806][106225] Updated weights for policy 1, policy_version 1015892 (0.0005) [2023-12-28 02:32:25,872][106225] Updated weights for policy 1, policy_version 1015902 (0.0006) [2023-12-28 02:32:26,043][106226] Updated weights for policy 0, policy_version 1013354 (0.0010) [2023-12-28 02:32:26,093][106226] Updated weights for policy 0, policy_version 1013364 (0.0010) [2023-12-28 02:32:26,147][106226] Updated weights for policy 0, policy_version 1013374 (0.0010) [2023-12-28 02:32:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 519593984. Throughput: 0: 9743.9, 1: 9968.6. Samples: 519555812. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:26,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-5.136')] [2023-12-28 02:32:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001015904_260112384.pth... [2023-12-28 02:32:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001013376_259481600.pth... [2023-12-28 02:32:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001012224_259186688.pth [2023-12-28 02:32:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001014720_259809280.pth [2023-12-28 02:32:26,477][106225] Updated weights for policy 1, policy_version 1015912 (0.0007) [2023-12-28 02:32:26,528][106225] Updated weights for policy 1, policy_version 1015923 (0.0008) [2023-12-28 02:32:26,580][106225] Updated weights for policy 1, policy_version 1015933 (0.0006) [2023-12-28 02:32:26,864][106226] Updated weights for policy 0, policy_version 1013384 (0.0010) [2023-12-28 02:32:26,917][106226] Updated weights for policy 0, policy_version 1013394 (0.0010) [2023-12-28 02:32:26,963][106226] Updated weights for policy 0, policy_version 1013404 (0.0010) [2023-12-28 02:32:27,332][106225] Updated weights for policy 1, policy_version 1015943 (0.0008) [2023-12-28 02:32:27,390][106225] Updated weights for policy 1, policy_version 1015953 (0.0009) [2023-12-28 02:32:27,456][106225] Updated weights for policy 1, policy_version 1015963 (0.0008) [2023-12-28 02:32:27,583][106226] Updated weights for policy 0, policy_version 1013414 (0.0007) [2023-12-28 02:32:27,630][106226] Updated weights for policy 0, policy_version 1013424 (0.0005) [2023-12-28 02:32:27,682][106226] Updated weights for policy 0, policy_version 1013434 (0.0009) [2023-12-28 02:32:28,196][106225] Updated weights for policy 1, policy_version 1015973 (0.0009) [2023-12-28 02:32:28,250][106225] Updated weights for policy 1, policy_version 1015983 (0.0005) [2023-12-28 02:32:28,303][106225] Updated weights for policy 1, policy_version 1015993 (0.0008) [2023-12-28 02:32:28,382][106226] Updated weights for policy 0, policy_version 1013444 (0.0010) [2023-12-28 02:32:28,447][106226] Updated weights for policy 0, policy_version 1013454 (0.0009) [2023-12-28 02:32:28,503][106226] Updated weights for policy 0, policy_version 1013464 (0.0008) [2023-12-28 02:32:28,986][106225] Updated weights for policy 1, policy_version 1016003 (0.0006) [2023-12-28 02:32:29,054][106225] Updated weights for policy 1, policy_version 1016013 (0.0007) [2023-12-28 02:32:29,115][106225] Updated weights for policy 1, policy_version 1016023 (0.0010) [2023-12-28 02:32:29,208][106226] Updated weights for policy 0, policy_version 1013474 (0.0010) [2023-12-28 02:32:29,273][106226] Updated weights for policy 0, policy_version 1013484 (0.0008) [2023-12-28 02:32:29,338][106226] Updated weights for policy 0, policy_version 1013494 (0.0007) [2023-12-28 02:32:29,408][106226] Updated weights for policy 0, policy_version 1013504 (0.0006) [2023-12-28 02:32:29,826][106225] Updated weights for policy 1, policy_version 1016033 (0.0010) [2023-12-28 02:32:29,891][106225] Updated weights for policy 1, policy_version 1016043 (0.0007) [2023-12-28 02:32:29,956][106225] Updated weights for policy 1, policy_version 1016053 (0.0008) [2023-12-28 02:32:30,013][106225] Updated weights for policy 1, policy_version 1016063 (0.0008) [2023-12-28 02:32:30,132][106226] Updated weights for policy 0, policy_version 1013514 (0.0009) [2023-12-28 02:32:30,192][106226] Updated weights for policy 0, policy_version 1013524 (0.0010) [2023-12-28 02:32:30,249][106226] Updated weights for policy 0, policy_version 1013534 (0.0010) [2023-12-28 02:32:30,645][106225] Updated weights for policy 1, policy_version 1016073 (0.0009) [2023-12-28 02:32:30,705][106225] Updated weights for policy 1, policy_version 1016083 (0.0005) [2023-12-28 02:32:30,762][106225] Updated weights for policy 1, policy_version 1016093 (0.0005) [2023-12-28 02:32:30,862][106226] Updated weights for policy 0, policy_version 1013544 (0.0008) [2023-12-28 02:32:30,924][106226] Updated weights for policy 0, policy_version 1013554 (0.0011) [2023-12-28 02:32:30,986][106226] Updated weights for policy 0, policy_version 1013564 (0.0009) [2023-12-28 02:32:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 519692288. Throughput: 0: 9773.6, 1: 10079.5. Samples: 519678792. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:31,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.781')] [2023-12-28 02:32:31,318][106225] Updated weights for policy 1, policy_version 1016103 (0.0009) [2023-12-28 02:32:31,391][106225] Updated weights for policy 1, policy_version 1016113 (0.0009) [2023-12-28 02:32:31,452][106225] Updated weights for policy 1, policy_version 1016123 (0.0010) [2023-12-28 02:32:31,648][106226] Updated weights for policy 0, policy_version 1013574 (0.0008) [2023-12-28 02:32:31,705][106226] Updated weights for policy 0, policy_version 1013584 (0.0008) [2023-12-28 02:32:31,771][106226] Updated weights for policy 0, policy_version 1013594 (0.0008) [2023-12-28 02:32:32,146][106225] Updated weights for policy 1, policy_version 1016133 (0.0010) [2023-12-28 02:32:32,210][106225] Updated weights for policy 1, policy_version 1016143 (0.0010) [2023-12-28 02:32:32,268][106225] Updated weights for policy 1, policy_version 1016153 (0.0010) [2023-12-28 02:32:32,538][106226] Updated weights for policy 0, policy_version 1013604 (0.0008) [2023-12-28 02:32:32,606][106226] Updated weights for policy 0, policy_version 1013614 (0.0010) [2023-12-28 02:32:32,664][106226] Updated weights for policy 0, policy_version 1013624 (0.0010) [2023-12-28 02:32:32,947][106225] Updated weights for policy 1, policy_version 1016163 (0.0010) [2023-12-28 02:32:33,002][106225] Updated weights for policy 1, policy_version 1016173 (0.0009) [2023-12-28 02:32:33,059][106225] Updated weights for policy 1, policy_version 1016183 (0.0008) [2023-12-28 02:32:33,313][106226] Updated weights for policy 0, policy_version 1013634 (0.0007) [2023-12-28 02:32:33,373][106226] Updated weights for policy 0, policy_version 1013644 (0.0009) [2023-12-28 02:32:33,430][106226] Updated weights for policy 0, policy_version 1013654 (0.0008) [2023-12-28 02:32:33,492][106226] Updated weights for policy 0, policy_version 1013664 (0.0008) [2023-12-28 02:32:33,781][106225] Updated weights for policy 1, policy_version 1016193 (0.0008) [2023-12-28 02:32:33,839][106225] Updated weights for policy 1, policy_version 1016203 (0.0008) [2023-12-28 02:32:33,901][106225] Updated weights for policy 1, policy_version 1016213 (0.0009) [2023-12-28 02:32:33,955][106225] Updated weights for policy 1, policy_version 1016223 (0.0008) [2023-12-28 02:32:34,180][106226] Updated weights for policy 0, policy_version 1013674 (0.0007) [2023-12-28 02:32:34,239][106226] Updated weights for policy 0, policy_version 1013684 (0.0007) [2023-12-28 02:32:34,301][106226] Updated weights for policy 0, policy_version 1013694 (0.0009) [2023-12-28 02:32:34,671][106225] Updated weights for policy 1, policy_version 1016233 (0.0008) [2023-12-28 02:32:34,733][106225] Updated weights for policy 1, policy_version 1016243 (0.0009) [2023-12-28 02:32:34,790][106225] Updated weights for policy 1, policy_version 1016253 (0.0008) [2023-12-28 02:32:34,986][106226] Updated weights for policy 0, policy_version 1013704 (0.0006) [2023-12-28 02:32:35,043][106226] Updated weights for policy 0, policy_version 1013714 (0.0006) [2023-12-28 02:32:35,111][106226] Updated weights for policy 0, policy_version 1013724 (0.0008) [2023-12-28 02:32:35,535][106225] Updated weights for policy 1, policy_version 1016263 (0.0008) [2023-12-28 02:32:35,585][106225] Updated weights for policy 1, policy_version 1016273 (0.0008) [2023-12-28 02:32:35,642][106225] Updated weights for policy 1, policy_version 1016283 (0.0008) [2023-12-28 02:32:35,787][106226] Updated weights for policy 0, policy_version 1013734 (0.0008) [2023-12-28 02:32:35,839][106226] Updated weights for policy 0, policy_version 1013744 (0.0008) [2023-12-28 02:32:35,888][106226] Updated weights for policy 0, policy_version 1013754 (0.0009) [2023-12-28 02:32:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 519790592. Throughput: 0: 9805.5, 1: 10088.7. Samples: 519798712. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:36,176][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.985')] [2023-12-28 02:32:36,360][106225] Updated weights for policy 1, policy_version 1016293 (0.0008) [2023-12-28 02:32:36,423][106225] Updated weights for policy 1, policy_version 1016303 (0.0007) [2023-12-28 02:32:36,483][106225] Updated weights for policy 1, policy_version 1016313 (0.0007) [2023-12-28 02:32:36,676][106226] Updated weights for policy 0, policy_version 1013764 (0.0007) [2023-12-28 02:32:36,734][106226] Updated weights for policy 0, policy_version 1013774 (0.0009) [2023-12-28 02:32:36,789][106226] Updated weights for policy 0, policy_version 1013784 (0.0009) [2023-12-28 02:32:37,204][106225] Updated weights for policy 1, policy_version 1016323 (0.0009) [2023-12-28 02:32:37,266][106225] Updated weights for policy 1, policy_version 1016333 (0.0009) [2023-12-28 02:32:37,332][106225] Updated weights for policy 1, policy_version 1016343 (0.0010) [2023-12-28 02:32:37,403][106226] Updated weights for policy 0, policy_version 1013794 (0.0008) [2023-12-28 02:32:37,462][106226] Updated weights for policy 0, policy_version 1013804 (0.0006) [2023-12-28 02:32:37,518][106226] Updated weights for policy 0, policy_version 1013814 (0.0006) [2023-12-28 02:32:37,576][106226] Updated weights for policy 0, policy_version 1013824 (0.0006) [2023-12-28 02:32:38,003][106225] Updated weights for policy 1, policy_version 1016353 (0.0008) [2023-12-28 02:32:38,063][106225] Updated weights for policy 1, policy_version 1016363 (0.0009) [2023-12-28 02:32:38,119][106225] Updated weights for policy 1, policy_version 1016373 (0.0008) [2023-12-28 02:32:38,175][106225] Updated weights for policy 1, policy_version 1016383 (0.0008) [2023-12-28 02:32:38,216][106226] Updated weights for policy 0, policy_version 1013834 (0.0009) [2023-12-28 02:32:38,272][106226] Updated weights for policy 0, policy_version 1013844 (0.0009) [2023-12-28 02:32:38,335][106226] Updated weights for policy 0, policy_version 1013854 (0.0011) [2023-12-28 02:32:38,816][106225] Updated weights for policy 1, policy_version 1016393 (0.0007) [2023-12-28 02:32:38,877][106225] Updated weights for policy 1, policy_version 1016403 (0.0005) [2023-12-28 02:32:38,936][106225] Updated weights for policy 1, policy_version 1016413 (0.0010) [2023-12-28 02:32:39,131][106226] Updated weights for policy 0, policy_version 1013864 (0.0008) [2023-12-28 02:32:39,191][106226] Updated weights for policy 0, policy_version 1013874 (0.0007) [2023-12-28 02:32:39,260][106226] Updated weights for policy 0, policy_version 1013884 (0.0009) [2023-12-28 02:32:39,646][106225] Updated weights for policy 1, policy_version 1016423 (0.0009) [2023-12-28 02:32:39,705][106225] Updated weights for policy 1, policy_version 1016433 (0.0008) [2023-12-28 02:32:39,769][106225] Updated weights for policy 1, policy_version 1016443 (0.0008) [2023-12-28 02:32:39,991][106226] Updated weights for policy 0, policy_version 1013894 (0.0009) [2023-12-28 02:32:40,058][106226] Updated weights for policy 0, policy_version 1013904 (0.0011) [2023-12-28 02:32:40,123][106226] Updated weights for policy 0, policy_version 1013914 (0.0011) [2023-12-28 02:32:40,450][106225] Updated weights for policy 1, policy_version 1016453 (0.0008) [2023-12-28 02:32:40,514][106225] Updated weights for policy 1, policy_version 1016463 (0.0007) [2023-12-28 02:32:40,575][106225] Updated weights for policy 1, policy_version 1016473 (0.0008) [2023-12-28 02:32:40,855][106226] Updated weights for policy 0, policy_version 1013924 (0.0011) [2023-12-28 02:32:40,915][106226] Updated weights for policy 0, policy_version 1013934 (0.0010) [2023-12-28 02:32:40,981][106226] Updated weights for policy 0, policy_version 1013944 (0.0010) [2023-12-28 02:32:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 519888896. Throughput: 0: 9822.7, 1: 10076.8. Samples: 519859220. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:41,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.934')] [2023-12-28 02:32:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001016480_260259840.pth... [2023-12-28 02:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001013952_259629056.pth... [2023-12-28 02:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001012800_259334144.pth [2023-12-28 02:32:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001015296_259956736.pth [2023-12-28 02:32:41,313][106225] Updated weights for policy 1, policy_version 1016483 (0.0008) [2023-12-28 02:32:41,382][106225] Updated weights for policy 1, policy_version 1016493 (0.0009) [2023-12-28 02:32:41,436][106225] Updated weights for policy 1, policy_version 1016503 (0.0008) [2023-12-28 02:32:41,695][106226] Updated weights for policy 0, policy_version 1013954 (0.0009) [2023-12-28 02:32:41,765][106226] Updated weights for policy 0, policy_version 1013964 (0.0008) [2023-12-28 02:32:41,828][106226] Updated weights for policy 0, policy_version 1013974 (0.0008) [2023-12-28 02:32:41,885][106226] Updated weights for policy 0, policy_version 1013984 (0.0009) [2023-12-28 02:32:42,108][106225] Updated weights for policy 1, policy_version 1016513 (0.0006) [2023-12-28 02:32:42,168][106225] Updated weights for policy 1, policy_version 1016523 (0.0008) [2023-12-28 02:32:42,220][106225] Updated weights for policy 1, policy_version 1016533 (0.0008) [2023-12-28 02:32:42,292][106225] Updated weights for policy 1, policy_version 1016543 (0.0008) [2023-12-28 02:32:42,686][106226] Updated weights for policy 0, policy_version 1013994 (0.0008) [2023-12-28 02:32:42,751][106226] Updated weights for policy 0, policy_version 1014004 (0.0008) [2023-12-28 02:32:42,824][106226] Updated weights for policy 0, policy_version 1014014 (0.0007) [2023-12-28 02:32:43,012][106225] Updated weights for policy 1, policy_version 1016553 (0.0008) [2023-12-28 02:32:43,062][106225] Updated weights for policy 1, policy_version 1016563 (0.0008) [2023-12-28 02:32:43,107][106225] Updated weights for policy 1, policy_version 1016573 (0.0007) [2023-12-28 02:32:43,528][106226] Updated weights for policy 0, policy_version 1014024 (0.0011) [2023-12-28 02:32:43,591][106226] Updated weights for policy 0, policy_version 1014034 (0.0010) [2023-12-28 02:32:43,644][106226] Updated weights for policy 0, policy_version 1014044 (0.0011) [2023-12-28 02:32:43,786][106225] Updated weights for policy 1, policy_version 1016583 (0.0007) [2023-12-28 02:32:43,838][106225] Updated weights for policy 1, policy_version 1016593 (0.0005) [2023-12-28 02:32:43,884][106225] Updated weights for policy 1, policy_version 1016603 (0.0005) [2023-12-28 02:32:44,369][106226] Updated weights for policy 0, policy_version 1014054 (0.0007) [2023-12-28 02:32:44,427][106226] Updated weights for policy 0, policy_version 1014064 (0.0008) [2023-12-28 02:32:44,486][106226] Updated weights for policy 0, policy_version 1014074 (0.0009) [2023-12-28 02:32:44,634][106225] Updated weights for policy 1, policy_version 1016613 (0.0007) [2023-12-28 02:32:44,694][106225] Updated weights for policy 1, policy_version 1016623 (0.0008) [2023-12-28 02:32:44,757][106225] Updated weights for policy 1, policy_version 1016633 (0.0008) [2023-12-28 02:32:45,220][106226] Updated weights for policy 0, policy_version 1014084 (0.0008) [2023-12-28 02:32:45,278][106226] Updated weights for policy 0, policy_version 1014094 (0.0009) [2023-12-28 02:32:45,343][106226] Updated weights for policy 0, policy_version 1014104 (0.0011) [2023-12-28 02:32:45,496][106225] Updated weights for policy 1, policy_version 1016643 (0.0009) [2023-12-28 02:32:45,550][106225] Updated weights for policy 1, policy_version 1016653 (0.0007) [2023-12-28 02:32:45,603][106225] Updated weights for policy 1, policy_version 1016663 (0.0008) [2023-12-28 02:32:46,058][106226] Updated weights for policy 0, policy_version 1014114 (0.0011) [2023-12-28 02:32:46,115][106226] Updated weights for policy 0, policy_version 1014124 (0.0011) [2023-12-28 02:32:46,169][106226] Updated weights for policy 0, policy_version 1014134 (0.0011) [2023-12-28 02:32:46,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 519979008. Throughput: 0: 9764.9, 1: 10074.0. Samples: 519974388. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:46,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.849')] [2023-12-28 02:32:46,216][106226] Updated weights for policy 0, policy_version 1014144 (0.0010) [2023-12-28 02:32:46,331][106225] Updated weights for policy 1, policy_version 1016673 (0.0007) [2023-12-28 02:32:46,379][106225] Updated weights for policy 1, policy_version 1016683 (0.0008) [2023-12-28 02:32:46,436][106225] Updated weights for policy 1, policy_version 1016693 (0.0007) [2023-12-28 02:32:46,495][106225] Updated weights for policy 1, policy_version 1016703 (0.0008) [2023-12-28 02:32:46,917][106226] Updated weights for policy 0, policy_version 1014154 (0.0005) [2023-12-28 02:32:46,964][106226] Updated weights for policy 0, policy_version 1014164 (0.0005) [2023-12-28 02:32:47,011][106226] Updated weights for policy 0, policy_version 1014174 (0.0008) [2023-12-28 02:32:47,146][106225] Updated weights for policy 1, policy_version 1016713 (0.0007) [2023-12-28 02:32:47,199][106225] Updated weights for policy 1, policy_version 1016723 (0.0007) [2023-12-28 02:32:47,250][106225] Updated weights for policy 1, policy_version 1016733 (0.0008) [2023-12-28 02:32:47,708][106226] Updated weights for policy 0, policy_version 1014184 (0.0010) [2023-12-28 02:32:47,758][106226] Updated weights for policy 0, policy_version 1014194 (0.0005) [2023-12-28 02:32:47,810][106226] Updated weights for policy 0, policy_version 1014204 (0.0005) [2023-12-28 02:32:47,869][106225] Updated weights for policy 1, policy_version 1016743 (0.0008) [2023-12-28 02:32:47,930][106225] Updated weights for policy 1, policy_version 1016753 (0.0008) [2023-12-28 02:32:47,993][106225] Updated weights for policy 1, policy_version 1016763 (0.0007) [2023-12-28 02:32:48,428][106226] Updated weights for policy 0, policy_version 1014214 (0.0008) [2023-12-28 02:32:48,494][106226] Updated weights for policy 0, policy_version 1014224 (0.0007) [2023-12-28 02:32:48,557][106226] Updated weights for policy 0, policy_version 1014234 (0.0007) [2023-12-28 02:32:48,792][106225] Updated weights for policy 1, policy_version 1016773 (0.0008) [2023-12-28 02:32:48,850][106225] Updated weights for policy 1, policy_version 1016783 (0.0009) [2023-12-28 02:32:48,903][106225] Updated weights for policy 1, policy_version 1016793 (0.0009) [2023-12-28 02:32:49,195][106226] Updated weights for policy 0, policy_version 1014244 (0.0009) [2023-12-28 02:32:49,262][106226] Updated weights for policy 0, policy_version 1014254 (0.0008) [2023-12-28 02:32:49,318][106226] Updated weights for policy 0, policy_version 1014264 (0.0009) [2023-12-28 02:32:49,680][106225] Updated weights for policy 1, policy_version 1016803 (0.0009) [2023-12-28 02:32:49,746][106225] Updated weights for policy 1, policy_version 1016813 (0.0009) [2023-12-28 02:32:49,806][106225] Updated weights for policy 1, policy_version 1016823 (0.0009) [2023-12-28 02:32:50,102][106226] Updated weights for policy 0, policy_version 1014274 (0.0009) [2023-12-28 02:32:50,173][106226] Updated weights for policy 0, policy_version 1014284 (0.0010) [2023-12-28 02:32:50,239][106226] Updated weights for policy 0, policy_version 1014294 (0.0008) [2023-12-28 02:32:50,297][106226] Updated weights for policy 0, policy_version 1014304 (0.0008) [2023-12-28 02:32:50,453][106225] Updated weights for policy 1, policy_version 1016833 (0.0010) [2023-12-28 02:32:50,518][106225] Updated weights for policy 1, policy_version 1016843 (0.0010) [2023-12-28 02:32:50,581][106225] Updated weights for policy 1, policy_version 1016853 (0.0007) [2023-12-28 02:32:50,648][106225] Updated weights for policy 1, policy_version 1016863 (0.0006) [2023-12-28 02:32:51,129][106226] Updated weights for policy 0, policy_version 1014314 (0.0009) [2023-12-28 02:32:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 520077312. Throughput: 0: 9786.5, 1: 10021.2. Samples: 520091984. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.915')] [2023-12-28 02:32:51,197][106226] Updated weights for policy 0, policy_version 1014324 (0.0008) [2023-12-28 02:32:51,262][106226] Updated weights for policy 0, policy_version 1014334 (0.0010) [2023-12-28 02:32:51,345][106225] Updated weights for policy 1, policy_version 1016873 (0.0007) [2023-12-28 02:32:51,414][106225] Updated weights for policy 1, policy_version 1016883 (0.0009) [2023-12-28 02:32:51,478][106225] Updated weights for policy 1, policy_version 1016893 (0.0009) [2023-12-28 02:32:51,998][106226] Updated weights for policy 0, policy_version 1014344 (0.0009) [2023-12-28 02:32:52,062][106226] Updated weights for policy 0, policy_version 1014354 (0.0009) [2023-12-28 02:32:52,120][106226] Updated weights for policy 0, policy_version 1014364 (0.0009) [2023-12-28 02:32:52,256][106225] Updated weights for policy 1, policy_version 1016903 (0.0008) [2023-12-28 02:32:52,317][106225] Updated weights for policy 1, policy_version 1016913 (0.0007) [2023-12-28 02:32:52,385][106225] Updated weights for policy 1, policy_version 1016923 (0.0008) [2023-12-28 02:32:52,834][106226] Updated weights for policy 0, policy_version 1014374 (0.0007) [2023-12-28 02:32:52,902][106226] Updated weights for policy 0, policy_version 1014384 (0.0006) [2023-12-28 02:32:52,966][106226] Updated weights for policy 0, policy_version 1014394 (0.0009) [2023-12-28 02:32:53,172][106225] Updated weights for policy 1, policy_version 1016933 (0.0009) [2023-12-28 02:32:53,229][106225] Updated weights for policy 1, policy_version 1016943 (0.0009) [2023-12-28 02:32:53,283][106225] Updated weights for policy 1, policy_version 1016953 (0.0009) [2023-12-28 02:32:53,597][106226] Updated weights for policy 0, policy_version 1014404 (0.0007) [2023-12-28 02:32:53,651][106226] Updated weights for policy 0, policy_version 1014414 (0.0005) [2023-12-28 02:32:53,701][106226] Updated weights for policy 0, policy_version 1014424 (0.0006) [2023-12-28 02:32:54,040][106225] Updated weights for policy 1, policy_version 1016963 (0.0009) [2023-12-28 02:32:54,093][106225] Updated weights for policy 1, policy_version 1016973 (0.0010) [2023-12-28 02:32:54,148][106225] Updated weights for policy 1, policy_version 1016983 (0.0010) [2023-12-28 02:32:54,416][106226] Updated weights for policy 0, policy_version 1014434 (0.0008) [2023-12-28 02:32:54,473][106226] Updated weights for policy 0, policy_version 1014444 (0.0008) [2023-12-28 02:32:54,531][106226] Updated weights for policy 0, policy_version 1014454 (0.0008) [2023-12-28 02:32:54,578][106226] Updated weights for policy 0, policy_version 1014464 (0.0007) [2023-12-28 02:32:54,872][106225] Updated weights for policy 1, policy_version 1016993 (0.0010) [2023-12-28 02:32:54,925][106225] Updated weights for policy 1, policy_version 1017003 (0.0010) [2023-12-28 02:32:54,975][106225] Updated weights for policy 1, policy_version 1017013 (0.0010) [2023-12-28 02:32:55,033][106225] Updated weights for policy 1, policy_version 1017023 (0.0011) [2023-12-28 02:32:55,319][106226] Updated weights for policy 0, policy_version 1014474 (0.0007) [2023-12-28 02:32:55,373][106226] Updated weights for policy 0, policy_version 1014484 (0.0008) [2023-12-28 02:32:55,423][106226] Updated weights for policy 0, policy_version 1014494 (0.0008) [2023-12-28 02:32:55,759][106225] Updated weights for policy 1, policy_version 1017033 (0.0010) [2023-12-28 02:32:55,844][106225] Updated weights for policy 1, policy_version 1017043 (0.0010) [2023-12-28 02:32:55,903][106225] Updated weights for policy 1, policy_version 1017053 (0.0010) [2023-12-28 02:32:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 520175616. Throughput: 0: 9755.1, 1: 9958.2. Samples: 520149076. Policy #0 lag: (min: 31.0, avg: 31.8, max: 54.0) [2023-12-28 02:32:56,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.836')] [2023-12-28 02:32:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001017056_260407296.pth... [2023-12-28 02:32:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001015904_260112384.pth [2023-12-28 02:32:56,189][106226] Updated weights for policy 0, policy_version 1014504 (0.0010) [2023-12-28 02:32:56,257][106226] Updated weights for policy 0, policy_version 1014514 (0.0011) [2023-12-28 02:32:56,327][106226] Updated weights for policy 0, policy_version 1014524 (0.0011) [2023-12-28 02:32:56,359][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001014528_259776512.pth... [2023-12-28 02:32:56,364][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001013376_259481600.pth [2023-12-28 02:32:56,452][106225] Updated weights for policy 1, policy_version 1017063 (0.0009) [2023-12-28 02:32:56,499][106225] Updated weights for policy 1, policy_version 1017073 (0.0008) [2023-12-28 02:32:56,549][106225] Updated weights for policy 1, policy_version 1017083 (0.0007) [2023-12-28 02:32:56,930][106226] Updated weights for policy 0, policy_version 1014534 (0.0009) [2023-12-28 02:32:56,991][106226] Updated weights for policy 0, policy_version 1014544 (0.0010) [2023-12-28 02:32:57,048][106226] Updated weights for policy 0, policy_version 1014554 (0.0010) [2023-12-28 02:32:57,290][106225] Updated weights for policy 1, policy_version 1017093 (0.0009) [2023-12-28 02:32:57,348][106225] Updated weights for policy 1, policy_version 1017103 (0.0009) [2023-12-28 02:32:57,401][106225] Updated weights for policy 1, policy_version 1017113 (0.0010) [2023-12-28 02:32:57,690][106226] Updated weights for policy 0, policy_version 1014564 (0.0008) [2023-12-28 02:32:57,742][106226] Updated weights for policy 0, policy_version 1014574 (0.0007) [2023-12-28 02:32:57,794][106226] Updated weights for policy 0, policy_version 1014584 (0.0010) [2023-12-28 02:32:58,024][106225] Updated weights for policy 1, policy_version 1017123 (0.0008) [2023-12-28 02:32:58,084][106225] Updated weights for policy 1, policy_version 1017133 (0.0010) [2023-12-28 02:32:58,139][106225] Updated weights for policy 1, policy_version 1017143 (0.0010) [2023-12-28 02:32:58,523][106226] Updated weights for policy 0, policy_version 1014594 (0.0010) [2023-12-28 02:32:58,587][106226] Updated weights for policy 0, policy_version 1014604 (0.0008) [2023-12-28 02:32:58,653][106226] Updated weights for policy 0, policy_version 1014614 (0.0008) [2023-12-28 02:32:58,721][106226] Updated weights for policy 0, policy_version 1014624 (0.0008) [2023-12-28 02:32:59,044][106225] Updated weights for policy 1, policy_version 1017153 (0.0010) [2023-12-28 02:32:59,108][106225] Updated weights for policy 1, policy_version 1017163 (0.0008) [2023-12-28 02:32:59,173][106225] Updated weights for policy 1, policy_version 1017173 (0.0006) [2023-12-28 02:32:59,245][106225] Updated weights for policy 1, policy_version 1017183 (0.0008) [2023-12-28 02:32:59,578][106226] Updated weights for policy 0, policy_version 1014634 (0.0007) [2023-12-28 02:32:59,643][106226] Updated weights for policy 0, policy_version 1014644 (0.0007) [2023-12-28 02:32:59,705][106226] Updated weights for policy 0, policy_version 1014654 (0.0008) [2023-12-28 02:33:00,044][106225] Updated weights for policy 1, policy_version 1017193 (0.0006) [2023-12-28 02:33:00,095][106225] Updated weights for policy 1, policy_version 1017203 (0.0009) [2023-12-28 02:33:00,161][106225] Updated weights for policy 1, policy_version 1017213 (0.0009) [2023-12-28 02:33:00,390][106226] Updated weights for policy 0, policy_version 1014664 (0.0008) [2023-12-28 02:33:00,456][106226] Updated weights for policy 0, policy_version 1014674 (0.0011) [2023-12-28 02:33:00,520][106226] Updated weights for policy 0, policy_version 1014684 (0.0009) [2023-12-28 02:33:00,735][106225] Updated weights for policy 1, policy_version 1017223 (0.0007) [2023-12-28 02:33:00,786][106225] Updated weights for policy 1, policy_version 1017233 (0.0007) [2023-12-28 02:33:00,838][106225] Updated weights for policy 1, policy_version 1017243 (0.0010) [2023-12-28 02:33:01,174][106226] Updated weights for policy 0, policy_version 1014694 (0.0008) [2023-12-28 02:33:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 520273920. Throughput: 0: 9792.1, 1: 9946.1. Samples: 520264776. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:01,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.787')] [2023-12-28 02:33:01,243][106226] Updated weights for policy 0, policy_version 1014704 (0.0008) [2023-12-28 02:33:01,308][106226] Updated weights for policy 0, policy_version 1014714 (0.0008) [2023-12-28 02:33:01,527][106225] Updated weights for policy 1, policy_version 1017253 (0.0009) [2023-12-28 02:33:01,576][106225] Updated weights for policy 1, policy_version 1017263 (0.0008) [2023-12-28 02:33:01,629][106225] Updated weights for policy 1, policy_version 1017273 (0.0007) [2023-12-28 02:33:02,082][106226] Updated weights for policy 0, policy_version 1014724 (0.0008) [2023-12-28 02:33:02,146][106226] Updated weights for policy 0, policy_version 1014734 (0.0007) [2023-12-28 02:33:02,214][106226] Updated weights for policy 0, policy_version 1014744 (0.0007) [2023-12-28 02:33:02,385][106225] Updated weights for policy 1, policy_version 1017283 (0.0007) [2023-12-28 02:33:02,444][106225] Updated weights for policy 1, policy_version 1017293 (0.0009) [2023-12-28 02:33:02,504][106225] Updated weights for policy 1, policy_version 1017303 (0.0008) [2023-12-28 02:33:02,898][106226] Updated weights for policy 0, policy_version 1014754 (0.0008) [2023-12-28 02:33:02,946][106226] Updated weights for policy 0, policy_version 1014764 (0.0007) [2023-12-28 02:33:02,993][106226] Updated weights for policy 0, policy_version 1014774 (0.0008) [2023-12-28 02:33:03,052][106226] Updated weights for policy 0, policy_version 1014784 (0.0008) [2023-12-28 02:33:03,248][106225] Updated weights for policy 1, policy_version 1017313 (0.0008) [2023-12-28 02:33:03,304][106225] Updated weights for policy 1, policy_version 1017323 (0.0010) [2023-12-28 02:33:03,353][106225] Updated weights for policy 1, policy_version 1017333 (0.0010) [2023-12-28 02:33:03,402][106225] Updated weights for policy 1, policy_version 1017343 (0.0010) [2023-12-28 02:33:03,833][106226] Updated weights for policy 0, policy_version 1014794 (0.0008) [2023-12-28 02:33:03,904][106226] Updated weights for policy 0, policy_version 1014804 (0.0008) [2023-12-28 02:33:03,961][106226] Updated weights for policy 0, policy_version 1014814 (0.0009) [2023-12-28 02:33:03,993][106225] Updated weights for policy 1, policy_version 1017353 (0.0009) [2023-12-28 02:33:04,062][106225] Updated weights for policy 1, policy_version 1017363 (0.0010) [2023-12-28 02:33:04,123][106225] Updated weights for policy 1, policy_version 1017373 (0.0010) [2023-12-28 02:33:04,698][106226] Updated weights for policy 0, policy_version 1014824 (0.0007) [2023-12-28 02:33:04,752][106226] Updated weights for policy 0, policy_version 1014834 (0.0008) [2023-12-28 02:33:04,809][106226] Updated weights for policy 0, policy_version 1014844 (0.0007) [2023-12-28 02:33:04,811][106225] Updated weights for policy 1, policy_version 1017383 (0.0010) [2023-12-28 02:33:04,871][106225] Updated weights for policy 1, policy_version 1017393 (0.0010) [2023-12-28 02:33:04,930][106225] Updated weights for policy 1, policy_version 1017403 (0.0009) [2023-12-28 02:33:05,542][106225] Updated weights for policy 1, policy_version 1017413 (0.0005) [2023-12-28 02:33:05,595][106226] Updated weights for policy 0, policy_version 1014854 (0.0007) [2023-12-28 02:33:05,607][106225] Updated weights for policy 1, policy_version 1017423 (0.0006) [2023-12-28 02:33:05,641][106226] Updated weights for policy 0, policy_version 1014864 (0.0009) [2023-12-28 02:33:05,663][106225] Updated weights for policy 1, policy_version 1017433 (0.0006) [2023-12-28 02:33:05,688][106226] Updated weights for policy 0, policy_version 1014874 (0.0006) [2023-12-28 02:33:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 520372224. Throughput: 0: 9734.8, 1: 9934.8. Samples: 520383720. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:06,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.791')] [2023-12-28 02:33:06,269][106225] Updated weights for policy 1, policy_version 1017443 (0.0006) [2023-12-28 02:33:06,335][106225] Updated weights for policy 1, policy_version 1017453 (0.0009) [2023-12-28 02:33:06,400][106225] Updated weights for policy 1, policy_version 1017463 (0.0010) [2023-12-28 02:33:06,502][106226] Updated weights for policy 0, policy_version 1014884 (0.0007) [2023-12-28 02:33:06,558][106226] Updated weights for policy 0, policy_version 1014894 (0.0008) [2023-12-28 02:33:06,609][106226] Updated weights for policy 0, policy_version 1014904 (0.0007) [2023-12-28 02:33:07,077][106225] Updated weights for policy 1, policy_version 1017473 (0.0006) [2023-12-28 02:33:07,141][106225] Updated weights for policy 1, policy_version 1017483 (0.0010) [2023-12-28 02:33:07,188][106225] Updated weights for policy 1, policy_version 1017493 (0.0010) [2023-12-28 02:33:07,239][106225] Updated weights for policy 1, policy_version 1017503 (0.0010) [2023-12-28 02:33:07,358][106226] Updated weights for policy 0, policy_version 1014914 (0.0007) [2023-12-28 02:33:07,418][106226] Updated weights for policy 0, policy_version 1014924 (0.0008) [2023-12-28 02:33:07,475][106226] Updated weights for policy 0, policy_version 1014934 (0.0007) [2023-12-28 02:33:07,520][106226] Updated weights for policy 0, policy_version 1014944 (0.0008) [2023-12-28 02:33:07,942][106225] Updated weights for policy 1, policy_version 1017513 (0.0010) [2023-12-28 02:33:07,996][106225] Updated weights for policy 1, policy_version 1017523 (0.0010) [2023-12-28 02:33:08,054][106225] Updated weights for policy 1, policy_version 1017533 (0.0010) [2023-12-28 02:33:08,271][106226] Updated weights for policy 0, policy_version 1014954 (0.0007) [2023-12-28 02:33:08,328][106226] Updated weights for policy 0, policy_version 1014964 (0.0006) [2023-12-28 02:33:08,390][106226] Updated weights for policy 0, policy_version 1014974 (0.0007) [2023-12-28 02:33:08,785][106225] Updated weights for policy 1, policy_version 1017543 (0.0010) [2023-12-28 02:33:08,849][106225] Updated weights for policy 1, policy_version 1017553 (0.0011) [2023-12-28 02:33:08,907][106225] Updated weights for policy 1, policy_version 1017563 (0.0010) [2023-12-28 02:33:08,996][106226] Updated weights for policy 0, policy_version 1014984 (0.0007) [2023-12-28 02:33:09,056][106226] Updated weights for policy 0, policy_version 1014994 (0.0007) [2023-12-28 02:33:09,110][106226] Updated weights for policy 0, policy_version 1015004 (0.0005) [2023-12-28 02:33:09,633][106225] Updated weights for policy 1, policy_version 1017573 (0.0009) [2023-12-28 02:33:09,700][106225] Updated weights for policy 1, policy_version 1017583 (0.0008) [2023-12-28 02:33:09,765][106225] Updated weights for policy 1, policy_version 1017593 (0.0011) [2023-12-28 02:33:09,895][106226] Updated weights for policy 0, policy_version 1015014 (0.0008) [2023-12-28 02:33:09,961][106226] Updated weights for policy 0, policy_version 1015024 (0.0008) [2023-12-28 02:33:10,018][106226] Updated weights for policy 0, policy_version 1015034 (0.0008) [2023-12-28 02:33:10,441][106225] Updated weights for policy 1, policy_version 1017603 (0.0010) [2023-12-28 02:33:10,509][106225] Updated weights for policy 1, policy_version 1017613 (0.0009) [2023-12-28 02:33:10,577][106225] Updated weights for policy 1, policy_version 1017623 (0.0009) [2023-12-28 02:33:10,717][106226] Updated weights for policy 0, policy_version 1015044 (0.0009) [2023-12-28 02:33:10,782][106226] Updated weights for policy 0, policy_version 1015054 (0.0009) [2023-12-28 02:33:10,841][106226] Updated weights for policy 0, policy_version 1015064 (0.0007) [2023-12-28 02:33:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 520470528. Throughput: 0: 9742.9, 1: 9982.8. Samples: 520443472. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:11,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-4.950')] [2023-12-28 02:33:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001017632_260554752.pth... [2023-12-28 02:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001015072_259915776.pth... [2023-12-28 02:33:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001016480_260259840.pth [2023-12-28 02:33:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001013952_259629056.pth [2023-12-28 02:33:11,313][106225] Updated weights for policy 1, policy_version 1017633 (0.0009) [2023-12-28 02:33:11,377][106225] Updated weights for policy 1, policy_version 1017643 (0.0009) [2023-12-28 02:33:11,460][106225] Updated weights for policy 1, policy_version 1017653 (0.0007) [2023-12-28 02:33:11,523][106225] Updated weights for policy 1, policy_version 1017663 (0.0008) [2023-12-28 02:33:11,609][106226] Updated weights for policy 0, policy_version 1015074 (0.0009) [2023-12-28 02:33:11,677][106226] Updated weights for policy 0, policy_version 1015084 (0.0009) [2023-12-28 02:33:11,749][106226] Updated weights for policy 0, policy_version 1015094 (0.0011) [2023-12-28 02:33:11,824][106226] Updated weights for policy 0, policy_version 1015104 (0.0008) [2023-12-28 02:33:12,251][106225] Updated weights for policy 1, policy_version 1017673 (0.0009) [2023-12-28 02:33:12,317][106225] Updated weights for policy 1, policy_version 1017683 (0.0008) [2023-12-28 02:33:12,386][106225] Updated weights for policy 1, policy_version 1017693 (0.0007) [2023-12-28 02:33:12,476][106226] Updated weights for policy 0, policy_version 1015114 (0.0009) [2023-12-28 02:33:12,537][106226] Updated weights for policy 0, policy_version 1015124 (0.0009) [2023-12-28 02:33:12,601][106226] Updated weights for policy 0, policy_version 1015134 (0.0011) [2023-12-28 02:33:13,034][106225] Updated weights for policy 1, policy_version 1017703 (0.0007) [2023-12-28 02:33:13,096][106225] Updated weights for policy 1, policy_version 1017713 (0.0007) [2023-12-28 02:33:13,147][106225] Updated weights for policy 1, policy_version 1017723 (0.0008) [2023-12-28 02:33:13,285][106226] Updated weights for policy 0, policy_version 1015144 (0.0010) [2023-12-28 02:33:13,345][106226] Updated weights for policy 0, policy_version 1015154 (0.0010) [2023-12-28 02:33:13,407][106226] Updated weights for policy 0, policy_version 1015164 (0.0008) [2023-12-28 02:33:13,737][106225] Updated weights for policy 1, policy_version 1017733 (0.0006) [2023-12-28 02:33:13,787][106225] Updated weights for policy 1, policy_version 1017743 (0.0008) [2023-12-28 02:33:13,839][106225] Updated weights for policy 1, policy_version 1017753 (0.0007) [2023-12-28 02:33:14,002][106226] Updated weights for policy 0, policy_version 1015174 (0.0007) [2023-12-28 02:33:14,059][106226] Updated weights for policy 0, policy_version 1015184 (0.0008) [2023-12-28 02:33:14,114][106226] Updated weights for policy 0, policy_version 1015194 (0.0008) [2023-12-28 02:33:14,648][106225] Updated weights for policy 1, policy_version 1017763 (0.0008) [2023-12-28 02:33:14,713][106225] Updated weights for policy 1, policy_version 1017773 (0.0008) [2023-12-28 02:33:14,784][106225] Updated weights for policy 1, policy_version 1017783 (0.0008) [2023-12-28 02:33:14,804][106226] Updated weights for policy 0, policy_version 1015204 (0.0008) [2023-12-28 02:33:14,868][106226] Updated weights for policy 0, policy_version 1015214 (0.0007) [2023-12-28 02:33:14,924][106226] Updated weights for policy 0, policy_version 1015224 (0.0008) [2023-12-28 02:33:15,400][106225] Updated weights for policy 1, policy_version 1017793 (0.0006) [2023-12-28 02:33:15,455][106225] Updated weights for policy 1, policy_version 1017803 (0.0005) [2023-12-28 02:33:15,517][106225] Updated weights for policy 1, policy_version 1017813 (0.0005) [2023-12-28 02:33:15,565][106225] Updated weights for policy 1, policy_version 1017823 (0.0005) [2023-12-28 02:33:15,691][106226] Updated weights for policy 0, policy_version 1015234 (0.0009) [2023-12-28 02:33:15,748][106226] Updated weights for policy 0, policy_version 1015244 (0.0008) [2023-12-28 02:33:15,798][106226] Updated weights for policy 0, policy_version 1015254 (0.0009) [2023-12-28 02:33:15,853][106226] Updated weights for policy 0, policy_version 1015264 (0.0009) [2023-12-28 02:33:16,103][106225] Updated weights for policy 1, policy_version 1017833 (0.0009) [2023-12-28 02:33:16,166][106225] Updated weights for policy 1, policy_version 1017843 (0.0008) [2023-12-28 02:33:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 520568832. Throughput: 0: 9704.3, 1: 9861.9. Samples: 520559272. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:16,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-5.073')] [2023-12-28 02:33:16,229][106225] Updated weights for policy 1, policy_version 1017853 (0.0008) [2023-12-28 02:33:16,616][106226] Updated weights for policy 0, policy_version 1015274 (0.0006) [2023-12-28 02:33:16,673][106226] Updated weights for policy 0, policy_version 1015284 (0.0009) [2023-12-28 02:33:16,724][106226] Updated weights for policy 0, policy_version 1015294 (0.0005) [2023-12-28 02:33:16,863][106225] Updated weights for policy 1, policy_version 1017863 (0.0007) [2023-12-28 02:33:16,930][106225] Updated weights for policy 1, policy_version 1017873 (0.0006) [2023-12-28 02:33:16,986][106225] Updated weights for policy 1, policy_version 1017883 (0.0009) [2023-12-28 02:33:17,509][106225] Updated weights for policy 1, policy_version 1017893 (0.0007) [2023-12-28 02:33:17,512][106226] Updated weights for policy 0, policy_version 1015304 (0.0007) [2023-12-28 02:33:17,570][106226] Updated weights for policy 0, policy_version 1015314 (0.0008) [2023-12-28 02:33:17,574][106225] Updated weights for policy 1, policy_version 1017903 (0.0007) [2023-12-28 02:33:17,630][106226] Updated weights for policy 0, policy_version 1015324 (0.0008) [2023-12-28 02:33:17,634][106225] Updated weights for policy 1, policy_version 1017913 (0.0006) [2023-12-28 02:33:18,192][106225] Updated weights for policy 1, policy_version 1017923 (0.0006) [2023-12-28 02:33:18,245][106225] Updated weights for policy 1, policy_version 1017933 (0.0008) [2023-12-28 02:33:18,315][106225] Updated weights for policy 1, policy_version 1017943 (0.0009) [2023-12-28 02:33:18,422][106226] Updated weights for policy 0, policy_version 1015334 (0.0009) [2023-12-28 02:33:18,484][106226] Updated weights for policy 0, policy_version 1015344 (0.0009) [2023-12-28 02:33:18,537][106226] Updated weights for policy 0, policy_version 1015354 (0.0008) [2023-12-28 02:33:18,988][106225] Updated weights for policy 1, policy_version 1017953 (0.0009) [2023-12-28 02:33:19,059][106225] Updated weights for policy 1, policy_version 1017963 (0.0005) [2023-12-28 02:33:19,123][106225] Updated weights for policy 1, policy_version 1017973 (0.0005) [2023-12-28 02:33:19,172][106225] Updated weights for policy 1, policy_version 1017983 (0.0008) [2023-12-28 02:33:19,301][106226] Updated weights for policy 0, policy_version 1015364 (0.0009) [2023-12-28 02:33:19,366][106226] Updated weights for policy 0, policy_version 1015374 (0.0007) [2023-12-28 02:33:19,435][106226] Updated weights for policy 0, policy_version 1015384 (0.0008) [2023-12-28 02:33:19,878][106225] Updated weights for policy 1, policy_version 1017993 (0.0008) [2023-12-28 02:33:19,944][106225] Updated weights for policy 1, policy_version 1018003 (0.0008) [2023-12-28 02:33:20,007][106225] Updated weights for policy 1, policy_version 1018013 (0.0009) [2023-12-28 02:33:20,141][106226] Updated weights for policy 0, policy_version 1015394 (0.0008) [2023-12-28 02:33:20,204][106226] Updated weights for policy 0, policy_version 1015404 (0.0008) [2023-12-28 02:33:20,264][106226] Updated weights for policy 0, policy_version 1015414 (0.0007) [2023-12-28 02:33:20,326][106226] Updated weights for policy 0, policy_version 1015424 (0.0008) [2023-12-28 02:33:20,784][106225] Updated weights for policy 1, policy_version 1018023 (0.0006) [2023-12-28 02:33:20,846][106225] Updated weights for policy 1, policy_version 1018033 (0.0008) [2023-12-28 02:33:20,911][106225] Updated weights for policy 1, policy_version 1018043 (0.0010) [2023-12-28 02:33:21,084][106226] Updated weights for policy 0, policy_version 1015434 (0.0009) [2023-12-28 02:33:21,151][106226] Updated weights for policy 0, policy_version 1015444 (0.0008) [2023-12-28 02:33:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 520667136. Throughput: 0: 9607.9, 1: 9965.5. Samples: 520679516. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:21,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.897')] [2023-12-28 02:33:21,208][106226] Updated weights for policy 0, policy_version 1015454 (0.0006) [2023-12-28 02:33:21,652][106225] Updated weights for policy 1, policy_version 1018053 (0.0009) [2023-12-28 02:33:21,720][106225] Updated weights for policy 1, policy_version 1018063 (0.0011) [2023-12-28 02:33:21,790][106225] Updated weights for policy 1, policy_version 1018073 (0.0009) [2023-12-28 02:33:21,926][106226] Updated weights for policy 0, policy_version 1015464 (0.0006) [2023-12-28 02:33:21,993][106226] Updated weights for policy 0, policy_version 1015474 (0.0005) [2023-12-28 02:33:22,066][106226] Updated weights for policy 0, policy_version 1015484 (0.0010) [2023-12-28 02:33:22,513][106225] Updated weights for policy 1, policy_version 1018083 (0.0009) [2023-12-28 02:33:22,562][106225] Updated weights for policy 1, policy_version 1018093 (0.0009) [2023-12-28 02:33:22,611][106225] Updated weights for policy 1, policy_version 1018103 (0.0009) [2023-12-28 02:33:22,751][106226] Updated weights for policy 0, policy_version 1015494 (0.0007) [2023-12-28 02:33:22,809][106226] Updated weights for policy 0, policy_version 1015504 (0.0011) [2023-12-28 02:33:22,878][106226] Updated weights for policy 0, policy_version 1015514 (0.0006) [2023-12-28 02:33:23,293][106225] Updated weights for policy 1, policy_version 1018113 (0.0008) [2023-12-28 02:33:23,348][106225] Updated weights for policy 1, policy_version 1018123 (0.0009) [2023-12-28 02:33:23,403][106225] Updated weights for policy 1, policy_version 1018133 (0.0008) [2023-12-28 02:33:23,464][106225] Updated weights for policy 1, policy_version 1018143 (0.0008) [2023-12-28 02:33:23,520][106226] Updated weights for policy 0, policy_version 1015524 (0.0008) [2023-12-28 02:33:23,573][106226] Updated weights for policy 0, policy_version 1015534 (0.0010) [2023-12-28 02:33:23,639][106226] Updated weights for policy 0, policy_version 1015544 (0.0010) [2023-12-28 02:33:24,233][106225] Updated weights for policy 1, policy_version 1018153 (0.0008) [2023-12-28 02:33:24,287][106226] Updated weights for policy 0, policy_version 1015554 (0.0009) [2023-12-28 02:33:24,303][106225] Updated weights for policy 1, policy_version 1018163 (0.0008) [2023-12-28 02:33:24,345][106226] Updated weights for policy 0, policy_version 1015564 (0.0007) [2023-12-28 02:33:24,360][106225] Updated weights for policy 1, policy_version 1018173 (0.0007) [2023-12-28 02:33:24,406][106226] Updated weights for policy 0, policy_version 1015574 (0.0006) [2023-12-28 02:33:24,478][106226] Updated weights for policy 0, policy_version 1015584 (0.0006) [2023-12-28 02:33:25,038][106226] Updated weights for policy 0, policy_version 1015594 (0.0009) [2023-12-28 02:33:25,048][106225] Updated weights for policy 1, policy_version 1018183 (0.0006) [2023-12-28 02:33:25,085][106226] Updated weights for policy 0, policy_version 1015604 (0.0006) [2023-12-28 02:33:25,101][106225] Updated weights for policy 1, policy_version 1018193 (0.0005) [2023-12-28 02:33:25,133][106226] Updated weights for policy 0, policy_version 1015614 (0.0006) [2023-12-28 02:33:25,162][106225] Updated weights for policy 1, policy_version 1018203 (0.0006) [2023-12-28 02:33:25,818][106226] Updated weights for policy 0, policy_version 1015624 (0.0008) [2023-12-28 02:33:25,862][106225] Updated weights for policy 1, policy_version 1018213 (0.0008) [2023-12-28 02:33:25,873][106226] Updated weights for policy 0, policy_version 1015634 (0.0007) [2023-12-28 02:33:25,922][106225] Updated weights for policy 1, policy_version 1018223 (0.0010) [2023-12-28 02:33:25,932][106226] Updated weights for policy 0, policy_version 1015644 (0.0008) [2023-12-28 02:33:25,991][106225] Updated weights for policy 1, policy_version 1018233 (0.0010) [2023-12-28 02:33:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 520773632. Throughput: 0: 9620.9, 1: 9920.4. Samples: 520738576. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:26,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-5.036')] [2023-12-28 02:33:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001018240_260710400.pth... [2023-12-28 02:33:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001015648_260063232.pth... [2023-12-28 02:33:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001017056_260407296.pth [2023-12-28 02:33:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001014528_259776512.pth [2023-12-28 02:33:26,553][106226] Updated weights for policy 0, policy_version 1015654 (0.0007) [2023-12-28 02:33:26,611][106226] Updated weights for policy 0, policy_version 1015664 (0.0007) [2023-12-28 02:33:26,680][106226] Updated weights for policy 0, policy_version 1015674 (0.0008) [2023-12-28 02:33:26,685][106225] Updated weights for policy 1, policy_version 1018243 (0.0010) [2023-12-28 02:33:26,751][106225] Updated weights for policy 1, policy_version 1018253 (0.0007) [2023-12-28 02:33:26,803][106225] Updated weights for policy 1, policy_version 1018263 (0.0005) [2023-12-28 02:33:27,223][106226] Updated weights for policy 0, policy_version 1015684 (0.0005) [2023-12-28 02:33:27,274][106226] Updated weights for policy 0, policy_version 1015694 (0.0008) [2023-12-28 02:33:27,321][106226] Updated weights for policy 0, policy_version 1015704 (0.0007) [2023-12-28 02:33:27,485][106225] Updated weights for policy 1, policy_version 1018273 (0.0007) [2023-12-28 02:33:27,541][106225] Updated weights for policy 1, policy_version 1018283 (0.0007) [2023-12-28 02:33:27,600][106225] Updated weights for policy 1, policy_version 1018293 (0.0008) [2023-12-28 02:33:27,653][106225] Updated weights for policy 1, policy_version 1018303 (0.0009) [2023-12-28 02:33:27,944][106226] Updated weights for policy 0, policy_version 1015714 (0.0006) [2023-12-28 02:33:27,995][106226] Updated weights for policy 0, policy_version 1015724 (0.0008) [2023-12-28 02:33:28,046][106226] Updated weights for policy 0, policy_version 1015734 (0.0008) [2023-12-28 02:33:28,097][106226] Updated weights for policy 0, policy_version 1015744 (0.0008) [2023-12-28 02:33:28,375][106225] Updated weights for policy 1, policy_version 1018313 (0.0009) [2023-12-28 02:33:28,442][106225] Updated weights for policy 1, policy_version 1018323 (0.0006) [2023-12-28 02:33:28,503][106225] Updated weights for policy 1, policy_version 1018333 (0.0009) [2023-12-28 02:33:28,787][106226] Updated weights for policy 0, policy_version 1015754 (0.0007) [2023-12-28 02:33:28,853][106226] Updated weights for policy 0, policy_version 1015764 (0.0006) [2023-12-28 02:33:28,916][106226] Updated weights for policy 0, policy_version 1015774 (0.0005) [2023-12-28 02:33:29,251][106225] Updated weights for policy 1, policy_version 1018343 (0.0008) [2023-12-28 02:33:29,319][106225] Updated weights for policy 1, policy_version 1018353 (0.0009) [2023-12-28 02:33:29,382][106225] Updated weights for policy 1, policy_version 1018363 (0.0011) [2023-12-28 02:33:29,514][106226] Updated weights for policy 0, policy_version 1015784 (0.0008) [2023-12-28 02:33:29,581][106226] Updated weights for policy 0, policy_version 1015794 (0.0008) [2023-12-28 02:33:29,644][106226] Updated weights for policy 0, policy_version 1015804 (0.0008) [2023-12-28 02:33:30,145][106225] Updated weights for policy 1, policy_version 1018373 (0.0010) [2023-12-28 02:33:30,199][106225] Updated weights for policy 1, policy_version 1018383 (0.0010) [2023-12-28 02:33:30,257][106225] Updated weights for policy 1, policy_version 1018393 (0.0011) [2023-12-28 02:33:30,324][106226] Updated weights for policy 0, policy_version 1015814 (0.0006) [2023-12-28 02:33:30,389][106226] Updated weights for policy 0, policy_version 1015824 (0.0007) [2023-12-28 02:33:30,449][106226] Updated weights for policy 0, policy_version 1015834 (0.0008) [2023-12-28 02:33:30,951][106225] Updated weights for policy 1, policy_version 1018403 (0.0011) [2023-12-28 02:33:31,002][106226] Updated weights for policy 0, policy_version 1015844 (0.0006) [2023-12-28 02:33:31,003][106225] Updated weights for policy 1, policy_version 1018413 (0.0010) [2023-12-28 02:33:31,070][106225] Updated weights for policy 1, policy_version 1018423 (0.0008) [2023-12-28 02:33:31,074][106226] Updated weights for policy 0, policy_version 1015854 (0.0008) [2023-12-28 02:33:31,140][106226] Updated weights for policy 0, policy_version 1015864 (0.0006) [2023-12-28 02:33:31,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 520871936. Throughput: 0: 9804.4, 1: 9913.2. Samples: 520861684. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:31,176][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.875')] [2023-12-28 02:33:31,773][106226] Updated weights for policy 0, policy_version 1015874 (0.0009) [2023-12-28 02:33:31,833][106226] Updated weights for policy 0, policy_version 1015884 (0.0007) [2023-12-28 02:33:31,858][106225] Updated weights for policy 1, policy_version 1018433 (0.0009) [2023-12-28 02:33:31,893][106226] Updated weights for policy 0, policy_version 1015894 (0.0006) [2023-12-28 02:33:31,905][106225] Updated weights for policy 1, policy_version 1018443 (0.0008) [2023-12-28 02:33:31,950][106226] Updated weights for policy 0, policy_version 1015904 (0.0009) [2023-12-28 02:33:31,957][106225] Updated weights for policy 1, policy_version 1018453 (0.0006) [2023-12-28 02:33:32,019][106225] Updated weights for policy 1, policy_version 1018463 (0.0006) [2023-12-28 02:33:32,642][106226] Updated weights for policy 0, policy_version 1015914 (0.0008) [2023-12-28 02:33:32,647][106225] Updated weights for policy 1, policy_version 1018473 (0.0010) [2023-12-28 02:33:32,699][106226] Updated weights for policy 0, policy_version 1015924 (0.0009) [2023-12-28 02:33:32,708][106225] Updated weights for policy 1, policy_version 1018483 (0.0010) [2023-12-28 02:33:32,759][106226] Updated weights for policy 0, policy_version 1015934 (0.0006) [2023-12-28 02:33:32,767][106225] Updated weights for policy 1, policy_version 1018493 (0.0010) [2023-12-28 02:33:33,394][106226] Updated weights for policy 0, policy_version 1015944 (0.0007) [2023-12-28 02:33:33,439][106226] Updated weights for policy 0, policy_version 1015954 (0.0008) [2023-12-28 02:33:33,487][106225] Updated weights for policy 1, policy_version 1018503 (0.0010) [2023-12-28 02:33:33,493][106226] Updated weights for policy 0, policy_version 1015964 (0.0007) [2023-12-28 02:33:33,543][106225] Updated weights for policy 1, policy_version 1018513 (0.0010) [2023-12-28 02:33:33,589][106225] Updated weights for policy 1, policy_version 1018523 (0.0010) [2023-12-28 02:33:34,054][106226] Updated weights for policy 0, policy_version 1015974 (0.0007) [2023-12-28 02:33:34,107][106226] Updated weights for policy 0, policy_version 1015984 (0.0008) [2023-12-28 02:33:34,171][106226] Updated weights for policy 0, policy_version 1015994 (0.0008) [2023-12-28 02:33:34,292][106225] Updated weights for policy 1, policy_version 1018533 (0.0009) [2023-12-28 02:33:34,341][106225] Updated weights for policy 1, policy_version 1018543 (0.0008) [2023-12-28 02:33:34,399][106225] Updated weights for policy 1, policy_version 1018553 (0.0007) [2023-12-28 02:33:34,888][106226] Updated weights for policy 0, policy_version 1016004 (0.0007) [2023-12-28 02:33:34,943][106226] Updated weights for policy 0, policy_version 1016014 (0.0009) [2023-12-28 02:33:34,996][106226] Updated weights for policy 0, policy_version 1016024 (0.0007) [2023-12-28 02:33:35,111][106225] Updated weights for policy 1, policy_version 1018563 (0.0008) [2023-12-28 02:33:35,163][106225] Updated weights for policy 1, policy_version 1018573 (0.0007) [2023-12-28 02:33:35,216][106225] Updated weights for policy 1, policy_version 1018583 (0.0005) [2023-12-28 02:33:35,768][106225] Updated weights for policy 1, policy_version 1018593 (0.0006) [2023-12-28 02:33:35,828][106225] Updated weights for policy 1, policy_version 1018603 (0.0006) [2023-12-28 02:33:35,832][106226] Updated weights for policy 0, policy_version 1016034 (0.0008) [2023-12-28 02:33:35,883][106225] Updated weights for policy 1, policy_version 1018613 (0.0007) [2023-12-28 02:33:35,901][106226] Updated weights for policy 0, policy_version 1016044 (0.0006) [2023-12-28 02:33:35,940][106225] Updated weights for policy 1, policy_version 1018623 (0.0008) [2023-12-28 02:33:35,962][106226] Updated weights for policy 0, policy_version 1016054 (0.0006) [2023-12-28 02:33:36,025][106226] Updated weights for policy 0, policy_version 1016064 (0.0008) [2023-12-28 02:33:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 520978432. Throughput: 0: 9878.0, 1: 9954.9. Samples: 520984464. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:36,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-4.969')] [2023-12-28 02:33:36,656][106226] Updated weights for policy 0, policy_version 1016074 (0.0006) [2023-12-28 02:33:36,685][106225] Updated weights for policy 1, policy_version 1018633 (0.0008) [2023-12-28 02:33:36,715][106226] Updated weights for policy 0, policy_version 1016084 (0.0008) [2023-12-28 02:33:36,743][106225] Updated weights for policy 1, policy_version 1018643 (0.0008) [2023-12-28 02:33:36,771][106226] Updated weights for policy 0, policy_version 1016094 (0.0006) [2023-12-28 02:33:36,800][106225] Updated weights for policy 1, policy_version 1018653 (0.0008) [2023-12-28 02:33:37,404][106225] Updated weights for policy 1, policy_version 1018663 (0.0006) [2023-12-28 02:33:37,466][106225] Updated weights for policy 1, policy_version 1018673 (0.0005) [2023-12-28 02:33:37,520][106226] Updated weights for policy 0, policy_version 1016104 (0.0007) [2023-12-28 02:33:37,526][106225] Updated weights for policy 1, policy_version 1018683 (0.0008) [2023-12-28 02:33:37,582][106226] Updated weights for policy 0, policy_version 1016114 (0.0006) [2023-12-28 02:33:37,643][106226] Updated weights for policy 0, policy_version 1016124 (0.0006) [2023-12-28 02:33:38,085][106225] Updated weights for policy 1, policy_version 1018693 (0.0010) [2023-12-28 02:33:38,132][106225] Updated weights for policy 1, policy_version 1018703 (0.0010) [2023-12-28 02:33:38,185][106225] Updated weights for policy 1, policy_version 1018713 (0.0010) [2023-12-28 02:33:38,196][106226] Updated weights for policy 0, policy_version 1016134 (0.0007) [2023-12-28 02:33:38,249][106226] Updated weights for policy 0, policy_version 1016144 (0.0006) [2023-12-28 02:33:38,300][106226] Updated weights for policy 0, policy_version 1016154 (0.0005) [2023-12-28 02:33:38,944][106225] Updated weights for policy 1, policy_version 1018723 (0.0010) [2023-12-28 02:33:38,982][106226] Updated weights for policy 0, policy_version 1016164 (0.0007) [2023-12-28 02:33:39,007][106225] Updated weights for policy 1, policy_version 1018733 (0.0007) [2023-12-28 02:33:39,033][106226] Updated weights for policy 0, policy_version 1016174 (0.0006) [2023-12-28 02:33:39,069][106225] Updated weights for policy 1, policy_version 1018743 (0.0007) [2023-12-28 02:33:39,091][106226] Updated weights for policy 0, policy_version 1016184 (0.0008) [2023-12-28 02:33:39,798][106225] Updated weights for policy 1, policy_version 1018753 (0.0007) [2023-12-28 02:33:39,862][106225] Updated weights for policy 1, policy_version 1018763 (0.0008) [2023-12-28 02:33:39,909][106226] Updated weights for policy 0, policy_version 1016194 (0.0008) [2023-12-28 02:33:39,912][106225] Updated weights for policy 1, policy_version 1018773 (0.0007) [2023-12-28 02:33:39,964][106225] Updated weights for policy 1, policy_version 1018783 (0.0006) [2023-12-28 02:33:39,964][106226] Updated weights for policy 0, policy_version 1016204 (0.0008) [2023-12-28 02:33:40,025][106226] Updated weights for policy 0, policy_version 1016214 (0.0011) [2023-12-28 02:33:40,090][106226] Updated weights for policy 0, policy_version 1016224 (0.0011) [2023-12-28 02:33:40,724][106225] Updated weights for policy 1, policy_version 1018793 (0.0010) [2023-12-28 02:33:40,786][106225] Updated weights for policy 1, policy_version 1018803 (0.0010) [2023-12-28 02:33:40,819][106226] Updated weights for policy 0, policy_version 1016234 (0.0010) [2023-12-28 02:33:40,844][106225] Updated weights for policy 1, policy_version 1018813 (0.0010) [2023-12-28 02:33:40,872][106226] Updated weights for policy 0, policy_version 1016244 (0.0010) [2023-12-28 02:33:40,925][106226] Updated weights for policy 0, policy_version 1016254 (0.0010) [2023-12-28 02:33:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 521076736. Throughput: 0: 9904.1, 1: 10037.6. Samples: 521046456. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:41,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.753')] [2023-12-28 02:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001018816_260857856.pth... [2023-12-28 02:33:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001016256_260218880.pth... [2023-12-28 02:33:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001017632_260554752.pth [2023-12-28 02:33:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001015072_259915776.pth [2023-12-28 02:33:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001016256_260218880.pth [2023-12-28 02:33:41,186][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001018816_260857856.pth [2023-12-28 02:33:41,589][106225] Updated weights for policy 1, policy_version 1018823 (0.0009) [2023-12-28 02:33:41,651][106225] Updated weights for policy 1, policy_version 1018833 (0.0008) [2023-12-28 02:33:41,711][106225] Updated weights for policy 1, policy_version 1018843 (0.0007) [2023-12-28 02:33:41,728][106226] Updated weights for policy 0, policy_version 1016264 (0.0009) [2023-12-28 02:33:41,797][106226] Updated weights for policy 0, policy_version 1016274 (0.0009) [2023-12-28 02:33:41,856][106226] Updated weights for policy 0, policy_version 1016284 (0.0008) [2023-12-28 02:33:42,446][106225] Updated weights for policy 1, policy_version 1018853 (0.0007) [2023-12-28 02:33:42,499][106225] Updated weights for policy 1, policy_version 1018863 (0.0005) [2023-12-28 02:33:42,560][106225] Updated weights for policy 1, policy_version 1018873 (0.0008) [2023-12-28 02:33:42,581][106226] Updated weights for policy 0, policy_version 1016294 (0.0008) [2023-12-28 02:33:42,634][106226] Updated weights for policy 0, policy_version 1016304 (0.0009) [2023-12-28 02:33:42,690][106226] Updated weights for policy 0, policy_version 1016314 (0.0008) [2023-12-28 02:33:43,267][106225] Updated weights for policy 1, policy_version 1018883 (0.0008) [2023-12-28 02:33:43,320][106225] Updated weights for policy 1, policy_version 1018893 (0.0008) [2023-12-28 02:33:43,372][106225] Updated weights for policy 1, policy_version 1018903 (0.0008) [2023-12-28 02:33:43,429][106226] Updated weights for policy 0, policy_version 1016324 (0.0008) [2023-12-28 02:33:43,487][106226] Updated weights for policy 0, policy_version 1016334 (0.0009) [2023-12-28 02:33:43,543][106226] Updated weights for policy 0, policy_version 1016344 (0.0009) [2023-12-28 02:33:44,119][106226] Updated weights for policy 0, policy_version 1016355 (0.0007) [2023-12-28 02:33:44,140][106225] Updated weights for policy 1, policy_version 1018914 (0.0010) [2023-12-28 02:33:44,178][106226] Updated weights for policy 0, policy_version 1016365 (0.0005) [2023-12-28 02:33:44,191][106225] Updated weights for policy 1, policy_version 1018924 (0.0007) [2023-12-28 02:33:44,237][106226] Updated weights for policy 0, policy_version 1016375 (0.0006) [2023-12-28 02:33:44,247][106225] Updated weights for policy 1, policy_version 1018934 (0.0006) [2023-12-28 02:33:44,301][106225] Updated weights for policy 1, policy_version 1018944 (0.0008) [2023-12-28 02:33:44,941][106226] Updated weights for policy 0, policy_version 1016385 (0.0006) [2023-12-28 02:33:44,998][106226] Updated weights for policy 0, policy_version 1016395 (0.0006) [2023-12-28 02:33:45,015][106225] Updated weights for policy 1, policy_version 1018954 (0.0008) [2023-12-28 02:33:45,065][106226] Updated weights for policy 0, policy_version 1016405 (0.0006) [2023-12-28 02:33:45,067][106225] Updated weights for policy 1, policy_version 1018964 (0.0008) [2023-12-28 02:33:45,128][106225] Updated weights for policy 1, policy_version 1018974 (0.0006) [2023-12-28 02:33:45,130][106226] Updated weights for policy 0, policy_version 1016415 (0.0006) [2023-12-28 02:33:45,808][106226] Updated weights for policy 0, policy_version 1016425 (0.0007) [2023-12-28 02:33:45,865][106226] Updated weights for policy 0, policy_version 1016435 (0.0005) [2023-12-28 02:33:45,886][106225] Updated weights for policy 1, policy_version 1018984 (0.0007) [2023-12-28 02:33:45,916][106226] Updated weights for policy 0, policy_version 1016445 (0.0005) [2023-12-28 02:33:45,945][106225] Updated weights for policy 1, policy_version 1018994 (0.0008) [2023-12-28 02:33:46,002][106225] Updated weights for policy 1, policy_version 1019004 (0.0008) [2023-12-28 02:33:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 521175040. Throughput: 0: 9914.6, 1: 10007.8. Samples: 521161280. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:46,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-4.852')] [2023-12-28 02:33:46,469][106226] Updated weights for policy 0, policy_version 1016455 (0.0006) [2023-12-28 02:33:46,518][106226] Updated weights for policy 0, policy_version 1016465 (0.0006) [2023-12-28 02:33:46,571][106226] Updated weights for policy 0, policy_version 1016475 (0.0005) [2023-12-28 02:33:46,836][106225] Updated weights for policy 1, policy_version 1019014 (0.0008) [2023-12-28 02:33:46,889][106225] Updated weights for policy 1, policy_version 1019024 (0.0008) [2023-12-28 02:33:46,948][106225] Updated weights for policy 1, policy_version 1019034 (0.0008) [2023-12-28 02:33:47,168][106226] Updated weights for policy 0, policy_version 1016485 (0.0006) [2023-12-28 02:33:47,235][106226] Updated weights for policy 0, policy_version 1016495 (0.0010) [2023-12-28 02:33:47,293][106226] Updated weights for policy 0, policy_version 1016505 (0.0009) [2023-12-28 02:33:47,695][106225] Updated weights for policy 1, policy_version 1019044 (0.0008) [2023-12-28 02:33:47,753][106225] Updated weights for policy 1, policy_version 1019054 (0.0007) [2023-12-28 02:33:47,821][106225] Updated weights for policy 1, policy_version 1019064 (0.0009) [2023-12-28 02:33:47,872][106226] Updated weights for policy 0, policy_version 1016515 (0.0008) [2023-12-28 02:33:47,929][106226] Updated weights for policy 0, policy_version 1016525 (0.0007) [2023-12-28 02:33:47,987][106226] Updated weights for policy 0, policy_version 1016535 (0.0006) [2023-12-28 02:33:48,528][106225] Updated weights for policy 1, policy_version 1019074 (0.0007) [2023-12-28 02:33:48,589][106225] Updated weights for policy 1, policy_version 1019084 (0.0006) [2023-12-28 02:33:48,650][106226] Updated weights for policy 0, policy_version 1016545 (0.0006) [2023-12-28 02:33:48,658][106225] Updated weights for policy 1, policy_version 1019094 (0.0007) [2023-12-28 02:33:48,710][106226] Updated weights for policy 0, policy_version 1016555 (0.0011) [2023-12-28 02:33:48,716][106225] Updated weights for policy 1, policy_version 1019104 (0.0006) [2023-12-28 02:33:48,758][106226] Updated weights for policy 0, policy_version 1016565 (0.0011) [2023-12-28 02:33:48,812][106226] Updated weights for policy 0, policy_version 1016575 (0.0010) [2023-12-28 02:33:49,433][106225] Updated weights for policy 1, policy_version 1019114 (0.0008) [2023-12-28 02:33:49,497][106225] Updated weights for policy 1, policy_version 1019124 (0.0008) [2023-12-28 02:33:49,553][106225] Updated weights for policy 1, policy_version 1019134 (0.0008) [2023-12-28 02:33:49,575][106226] Updated weights for policy 0, policy_version 1016585 (0.0009) [2023-12-28 02:33:49,634][106226] Updated weights for policy 0, policy_version 1016595 (0.0007) [2023-12-28 02:33:49,700][106226] Updated weights for policy 0, policy_version 1016605 (0.0007) [2023-12-28 02:33:50,352][106226] Updated weights for policy 0, policy_version 1016615 (0.0006) [2023-12-28 02:33:50,369][106225] Updated weights for policy 1, policy_version 1019144 (0.0007) [2023-12-28 02:33:50,411][106226] Updated weights for policy 0, policy_version 1016625 (0.0005) [2023-12-28 02:33:50,433][106225] Updated weights for policy 1, policy_version 1019154 (0.0008) [2023-12-28 02:33:50,464][106226] Updated weights for policy 0, policy_version 1016635 (0.0005) [2023-12-28 02:33:50,492][106225] Updated weights for policy 1, policy_version 1019164 (0.0008) [2023-12-28 02:33:51,131][106226] Updated weights for policy 0, policy_version 1016645 (0.0007) [2023-12-28 02:33:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 521265152. Throughput: 0: 10076.6, 1: 9846.4. Samples: 521280256. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:51,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.712')] [2023-12-28 02:33:51,197][106226] Updated weights for policy 0, policy_version 1016655 (0.0008) [2023-12-28 02:33:51,256][106225] Updated weights for policy 1, policy_version 1019174 (0.0009) [2023-12-28 02:33:51,262][106226] Updated weights for policy 0, policy_version 1016665 (0.0007) [2023-12-28 02:33:51,320][106225] Updated weights for policy 1, policy_version 1019184 (0.0008) [2023-12-28 02:33:51,398][106225] Updated weights for policy 1, policy_version 1019194 (0.0009) [2023-12-28 02:33:51,993][106226] Updated weights for policy 0, policy_version 1016675 (0.0007) [2023-12-28 02:33:52,062][106226] Updated weights for policy 0, policy_version 1016685 (0.0009) [2023-12-28 02:33:52,113][106225] Updated weights for policy 1, policy_version 1019204 (0.0007) [2023-12-28 02:33:52,131][106226] Updated weights for policy 0, policy_version 1016695 (0.0006) [2023-12-28 02:33:52,179][106225] Updated weights for policy 1, policy_version 1019214 (0.0007) [2023-12-28 02:33:52,233][106225] Updated weights for policy 1, policy_version 1019224 (0.0008) [2023-12-28 02:33:52,819][106226] Updated weights for policy 0, policy_version 1016705 (0.0006) [2023-12-28 02:33:52,882][106226] Updated weights for policy 0, policy_version 1016715 (0.0008) [2023-12-28 02:33:52,933][106226] Updated weights for policy 0, policy_version 1016725 (0.0009) [2023-12-28 02:33:52,969][106225] Updated weights for policy 1, policy_version 1019234 (0.0008) [2023-12-28 02:33:52,984][106226] Updated weights for policy 0, policy_version 1016735 (0.0008) [2023-12-28 02:33:53,028][106225] Updated weights for policy 1, policy_version 1019244 (0.0007) [2023-12-28 02:33:53,083][106225] Updated weights for policy 1, policy_version 1019254 (0.0008) [2023-12-28 02:33:53,141][106225] Updated weights for policy 1, policy_version 1019264 (0.0008) [2023-12-28 02:33:53,769][106226] Updated weights for policy 0, policy_version 1016745 (0.0006) [2023-12-28 02:33:53,779][106225] Updated weights for policy 1, policy_version 1019274 (0.0005) [2023-12-28 02:33:53,825][106226] Updated weights for policy 0, policy_version 1016755 (0.0005) [2023-12-28 02:33:53,843][106225] Updated weights for policy 1, policy_version 1019284 (0.0005) [2023-12-28 02:33:53,874][106226] Updated weights for policy 0, policy_version 1016765 (0.0006) [2023-12-28 02:33:53,894][106225] Updated weights for policy 1, policy_version 1019294 (0.0005) [2023-12-28 02:33:54,497][106225] Updated weights for policy 1, policy_version 1019304 (0.0006) [2023-12-28 02:33:54,547][106225] Updated weights for policy 1, policy_version 1019314 (0.0009) [2023-12-28 02:33:54,597][106225] Updated weights for policy 1, policy_version 1019324 (0.0008) [2023-12-28 02:33:54,616][106226] Updated weights for policy 0, policy_version 1016775 (0.0007) [2023-12-28 02:33:54,661][106226] Updated weights for policy 0, policy_version 1016785 (0.0008) [2023-12-28 02:33:54,724][106226] Updated weights for policy 0, policy_version 1016795 (0.0008) [2023-12-28 02:33:55,238][106225] Updated weights for policy 1, policy_version 1019334 (0.0007) [2023-12-28 02:33:55,293][106225] Updated weights for policy 1, policy_version 1019344 (0.0006) [2023-12-28 02:33:55,345][106225] Updated weights for policy 1, policy_version 1019354 (0.0005) [2023-12-28 02:33:55,539][106226] Updated weights for policy 0, policy_version 1016805 (0.0009) [2023-12-28 02:33:55,606][106226] Updated weights for policy 0, policy_version 1016815 (0.0009) [2023-12-28 02:33:55,665][106226] Updated weights for policy 0, policy_version 1016825 (0.0009) [2023-12-28 02:33:55,901][106225] Updated weights for policy 1, policy_version 1019364 (0.0007) [2023-12-28 02:33:55,946][106225] Updated weights for policy 1, policy_version 1019374 (0.0008) [2023-12-28 02:33:55,992][106225] Updated weights for policy 1, policy_version 1019384 (0.0009) [2023-12-28 02:33:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 521371648. Throughput: 0: 10047.0, 1: 9825.4. Samples: 521337732. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:33:56,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.858')] [2023-12-28 02:33:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001016832_260366336.pth... [2023-12-28 02:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001019392_261005312.pth... [2023-12-28 02:33:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001015648_260063232.pth [2023-12-28 02:33:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001018240_260710400.pth [2023-12-28 02:33:56,410][106226] Updated weights for policy 0, policy_version 1016835 (0.0009) [2023-12-28 02:33:56,459][106226] Updated weights for policy 0, policy_version 1016845 (0.0008) [2023-12-28 02:33:56,506][106226] Updated weights for policy 0, policy_version 1016855 (0.0008) [2023-12-28 02:33:56,710][106225] Updated weights for policy 1, policy_version 1019394 (0.0007) [2023-12-28 02:33:56,774][106225] Updated weights for policy 1, policy_version 1019404 (0.0005) [2023-12-28 02:33:56,838][106225] Updated weights for policy 1, policy_version 1019414 (0.0005) [2023-12-28 02:33:56,890][106225] Updated weights for policy 1, policy_version 1019424 (0.0005) [2023-12-28 02:33:57,359][106226] Updated weights for policy 0, policy_version 1016865 (0.0008) [2023-12-28 02:33:57,377][106225] Updated weights for policy 1, policy_version 1019434 (0.0006) [2023-12-28 02:33:57,420][106225] Updated weights for policy 1, policy_version 1019444 (0.0005) [2023-12-28 02:33:57,422][106226] Updated weights for policy 0, policy_version 1016875 (0.0007) [2023-12-28 02:33:57,465][106225] Updated weights for policy 1, policy_version 1019454 (0.0005) [2023-12-28 02:33:57,482][106226] Updated weights for policy 0, policy_version 1016885 (0.0008) [2023-12-28 02:33:57,544][106226] Updated weights for policy 0, policy_version 1016895 (0.0008) [2023-12-28 02:33:58,100][106225] Updated weights for policy 1, policy_version 1019464 (0.0006) [2023-12-28 02:33:58,147][106225] Updated weights for policy 1, policy_version 1019474 (0.0007) [2023-12-28 02:33:58,198][106225] Updated weights for policy 1, policy_version 1019484 (0.0010) [2023-12-28 02:33:58,312][106226] Updated weights for policy 0, policy_version 1016905 (0.0008) [2023-12-28 02:33:58,380][106226] Updated weights for policy 0, policy_version 1016915 (0.0008) [2023-12-28 02:33:58,447][106226] Updated weights for policy 0, policy_version 1016925 (0.0007) [2023-12-28 02:33:59,037][106225] Updated weights for policy 1, policy_version 1019494 (0.0010) [2023-12-28 02:33:59,105][106225] Updated weights for policy 1, policy_version 1019504 (0.0011) [2023-12-28 02:33:59,173][106225] Updated weights for policy 1, policy_version 1019514 (0.0010) [2023-12-28 02:33:59,250][106226] Updated weights for policy 0, policy_version 1016935 (0.0007) [2023-12-28 02:33:59,312][106226] Updated weights for policy 0, policy_version 1016945 (0.0009) [2023-12-28 02:33:59,372][106226] Updated weights for policy 0, policy_version 1016955 (0.0009) [2023-12-28 02:33:59,842][106225] Updated weights for policy 1, policy_version 1019524 (0.0009) [2023-12-28 02:33:59,898][106225] Updated weights for policy 1, policy_version 1019534 (0.0008) [2023-12-28 02:33:59,959][106225] Updated weights for policy 1, policy_version 1019544 (0.0008) [2023-12-28 02:34:00,166][106226] Updated weights for policy 0, policy_version 1016965 (0.0008) [2023-12-28 02:34:00,231][106226] Updated weights for policy 0, policy_version 1016975 (0.0009) [2023-12-28 02:34:00,299][106226] Updated weights for policy 0, policy_version 1016985 (0.0008) [2023-12-28 02:34:00,741][106225] Updated weights for policy 1, policy_version 1019554 (0.0009) [2023-12-28 02:34:00,794][106225] Updated weights for policy 1, policy_version 1019564 (0.0009) [2023-12-28 02:34:00,851][106225] Updated weights for policy 1, policy_version 1019574 (0.0008) [2023-12-28 02:34:00,897][106225] Updated weights for policy 1, policy_version 1019584 (0.0007) [2023-12-28 02:34:01,007][106226] Updated weights for policy 0, policy_version 1016995 (0.0009) [2023-12-28 02:34:01,068][106226] Updated weights for policy 0, policy_version 1017005 (0.0008) [2023-12-28 02:34:01,118][106226] Updated weights for policy 0, policy_version 1017015 (0.0008) [2023-12-28 02:34:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 521461760. Throughput: 0: 9938.4, 1: 9974.9. Samples: 521455372. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:01,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.022')] [2023-12-28 02:34:01,703][106225] Updated weights for policy 1, policy_version 1019594 (0.0008) [2023-12-28 02:34:01,776][106225] Updated weights for policy 1, policy_version 1019604 (0.0008) [2023-12-28 02:34:01,836][106225] Updated weights for policy 1, policy_version 1019614 (0.0008) [2023-12-28 02:34:01,944][106226] Updated weights for policy 0, policy_version 1017025 (0.0008) [2023-12-28 02:34:02,010][106226] Updated weights for policy 0, policy_version 1017035 (0.0008) [2023-12-28 02:34:02,064][106226] Updated weights for policy 0, policy_version 1017045 (0.0008) [2023-12-28 02:34:02,123][106226] Updated weights for policy 0, policy_version 1017055 (0.0008) [2023-12-28 02:34:02,613][106225] Updated weights for policy 1, policy_version 1019624 (0.0007) [2023-12-28 02:34:02,678][106225] Updated weights for policy 1, policy_version 1019634 (0.0005) [2023-12-28 02:34:02,743][106225] Updated weights for policy 1, policy_version 1019644 (0.0007) [2023-12-28 02:34:02,829][106226] Updated weights for policy 0, policy_version 1017065 (0.0006) [2023-12-28 02:34:02,889][106226] Updated weights for policy 0, policy_version 1017075 (0.0008) [2023-12-28 02:34:02,949][106226] Updated weights for policy 0, policy_version 1017085 (0.0008) [2023-12-28 02:34:03,416][106225] Updated weights for policy 1, policy_version 1019654 (0.0007) [2023-12-28 02:34:03,471][106225] Updated weights for policy 1, policy_version 1019664 (0.0005) [2023-12-28 02:34:03,527][106225] Updated weights for policy 1, policy_version 1019674 (0.0005) [2023-12-28 02:34:03,650][106226] Updated weights for policy 0, policy_version 1017095 (0.0009) [2023-12-28 02:34:03,695][106226] Updated weights for policy 0, policy_version 1017105 (0.0007) [2023-12-28 02:34:03,738][106226] Updated weights for policy 0, policy_version 1017115 (0.0008) [2023-12-28 02:34:04,170][106225] Updated weights for policy 1, policy_version 1019684 (0.0007) [2023-12-28 02:34:04,233][106225] Updated weights for policy 1, policy_version 1019694 (0.0009) [2023-12-28 02:34:04,299][106225] Updated weights for policy 1, policy_version 1019704 (0.0009) [2023-12-28 02:34:04,411][106226] Updated weights for policy 0, policy_version 1017125 (0.0008) [2023-12-28 02:34:04,473][106226] Updated weights for policy 0, policy_version 1017135 (0.0008) [2023-12-28 02:34:04,541][106226] Updated weights for policy 0, policy_version 1017145 (0.0006) [2023-12-28 02:34:04,923][106225] Updated weights for policy 1, policy_version 1019714 (0.0009) [2023-12-28 02:34:04,981][106225] Updated weights for policy 1, policy_version 1019724 (0.0009) [2023-12-28 02:34:05,034][106225] Updated weights for policy 1, policy_version 1019734 (0.0008) [2023-12-28 02:34:05,068][106226] Updated weights for policy 0, policy_version 1017155 (0.0007) [2023-12-28 02:34:05,095][106225] Updated weights for policy 1, policy_version 1019744 (0.0008) [2023-12-28 02:34:05,128][106226] Updated weights for policy 0, policy_version 1017165 (0.0010) [2023-12-28 02:34:05,184][106226] Updated weights for policy 0, policy_version 1017175 (0.0011) [2023-12-28 02:34:05,823][106225] Updated weights for policy 1, policy_version 1019754 (0.0009) [2023-12-28 02:34:05,855][106226] Updated weights for policy 0, policy_version 1017185 (0.0010) [2023-12-28 02:34:05,879][106225] Updated weights for policy 1, policy_version 1019764 (0.0008) [2023-12-28 02:34:05,916][106226] Updated weights for policy 0, policy_version 1017195 (0.0009) [2023-12-28 02:34:05,926][106225] Updated weights for policy 1, policy_version 1019774 (0.0007) [2023-12-28 02:34:05,982][106226] Updated weights for policy 0, policy_version 1017205 (0.0006) [2023-12-28 02:34:06,040][106226] Updated weights for policy 0, policy_version 1017215 (0.0006) [2023-12-28 02:34:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 521568256. Throughput: 0: 10039.6, 1: 9842.9. Samples: 521574228. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:06,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.791')] [2023-12-28 02:34:06,673][106226] Updated weights for policy 0, policy_version 1017225 (0.0007) [2023-12-28 02:34:06,687][106225] Updated weights for policy 1, policy_version 1019784 (0.0007) [2023-12-28 02:34:06,734][106226] Updated weights for policy 0, policy_version 1017235 (0.0006) [2023-12-28 02:34:06,749][106225] Updated weights for policy 1, policy_version 1019794 (0.0007) [2023-12-28 02:34:06,797][106226] Updated weights for policy 0, policy_version 1017245 (0.0007) [2023-12-28 02:34:06,805][106225] Updated weights for policy 1, policy_version 1019804 (0.0009) [2023-12-28 02:34:07,456][106225] Updated weights for policy 1, policy_version 1019814 (0.0007) [2023-12-28 02:34:07,513][106226] Updated weights for policy 0, policy_version 1017255 (0.0010) [2023-12-28 02:34:07,519][106225] Updated weights for policy 1, policy_version 1019824 (0.0007) [2023-12-28 02:34:07,563][106226] Updated weights for policy 0, policy_version 1017265 (0.0010) [2023-12-28 02:34:07,579][106225] Updated weights for policy 1, policy_version 1019834 (0.0007) [2023-12-28 02:34:07,617][106226] Updated weights for policy 0, policy_version 1017275 (0.0009) [2023-12-28 02:34:08,190][106225] Updated weights for policy 1, policy_version 1019844 (0.0005) [2023-12-28 02:34:08,214][106226] Updated weights for policy 0, policy_version 1017285 (0.0007) [2023-12-28 02:34:08,251][106225] Updated weights for policy 1, policy_version 1019854 (0.0010) [2023-12-28 02:34:08,272][106226] Updated weights for policy 0, policy_version 1017295 (0.0006) [2023-12-28 02:34:08,311][106225] Updated weights for policy 1, policy_version 1019864 (0.0010) [2023-12-28 02:34:08,337][106226] Updated weights for policy 0, policy_version 1017305 (0.0007) [2023-12-28 02:34:08,954][106226] Updated weights for policy 0, policy_version 1017315 (0.0006) [2023-12-28 02:34:09,016][106226] Updated weights for policy 0, policy_version 1017325 (0.0006) [2023-12-28 02:34:09,016][106225] Updated weights for policy 1, policy_version 1019874 (0.0011) [2023-12-28 02:34:09,068][106226] Updated weights for policy 0, policy_version 1017335 (0.0007) [2023-12-28 02:34:09,075][106225] Updated weights for policy 1, policy_version 1019884 (0.0010) [2023-12-28 02:34:09,131][106225] Updated weights for policy 1, policy_version 1019894 (0.0010) [2023-12-28 02:34:09,196][106225] Updated weights for policy 1, policy_version 1019904 (0.0010) [2023-12-28 02:34:09,799][106226] Updated weights for policy 0, policy_version 1017345 (0.0007) [2023-12-28 02:34:09,872][106226] Updated weights for policy 0, policy_version 1017356 (0.0012) [2023-12-28 02:34:09,910][106225] Updated weights for policy 1, policy_version 1019914 (0.0009) [2023-12-28 02:34:09,952][106226] Updated weights for policy 0, policy_version 1017366 (0.0009) [2023-12-28 02:34:09,981][106225] Updated weights for policy 1, policy_version 1019924 (0.0010) [2023-12-28 02:34:10,016][106226] Updated weights for policy 0, policy_version 1017376 (0.0006) [2023-12-28 02:34:10,048][106225] Updated weights for policy 1, policy_version 1019934 (0.0008) [2023-12-28 02:34:10,710][106225] Updated weights for policy 1, policy_version 1019944 (0.0008) [2023-12-28 02:34:10,766][106225] Updated weights for policy 1, policy_version 1019954 (0.0008) [2023-12-28 02:34:10,797][106226] Updated weights for policy 0, policy_version 1017386 (0.0006) [2023-12-28 02:34:10,823][106225] Updated weights for policy 1, policy_version 1019964 (0.0006) [2023-12-28 02:34:10,852][106226] Updated weights for policy 0, policy_version 1017396 (0.0011) [2023-12-28 02:34:10,911][106226] Updated weights for policy 0, policy_version 1017406 (0.0011) [2023-12-28 02:34:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 521666560. Throughput: 0: 10073.5, 1: 9880.3. Samples: 521636500. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:11,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.932')] [2023-12-28 02:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001017408_260513792.pth... [2023-12-28 02:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001019968_261152768.pth... [2023-12-28 02:34:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001018816_260857856.pth [2023-12-28 02:34:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001016256_260218880.pth [2023-12-28 02:34:11,599][106225] Updated weights for policy 1, policy_version 1019974 (0.0007) [2023-12-28 02:34:11,670][106225] Updated weights for policy 1, policy_version 1019984 (0.0008) [2023-12-28 02:34:11,677][106226] Updated weights for policy 0, policy_version 1017416 (0.0008) [2023-12-28 02:34:11,736][106225] Updated weights for policy 1, policy_version 1019994 (0.0008) [2023-12-28 02:34:11,748][106226] Updated weights for policy 0, policy_version 1017426 (0.0008) [2023-12-28 02:34:11,813][106226] Updated weights for policy 0, policy_version 1017436 (0.0009) [2023-12-28 02:34:12,524][106226] Updated weights for policy 0, policy_version 1017446 (0.0008) [2023-12-28 02:34:12,538][106225] Updated weights for policy 1, policy_version 1020004 (0.0007) [2023-12-28 02:34:12,580][106226] Updated weights for policy 0, policy_version 1017456 (0.0009) [2023-12-28 02:34:12,595][106225] Updated weights for policy 1, policy_version 1020014 (0.0007) [2023-12-28 02:34:12,625][106226] Updated weights for policy 0, policy_version 1017466 (0.0006) [2023-12-28 02:34:12,651][106225] Updated weights for policy 1, policy_version 1020024 (0.0007) [2023-12-28 02:34:13,304][106225] Updated weights for policy 1, policy_version 1020034 (0.0008) [2023-12-28 02:34:13,357][106225] Updated weights for policy 1, policy_version 1020044 (0.0008) [2023-12-28 02:34:13,393][106226] Updated weights for policy 0, policy_version 1017476 (0.0006) [2023-12-28 02:34:13,406][106225] Updated weights for policy 1, policy_version 1020054 (0.0007) [2023-12-28 02:34:13,445][106226] Updated weights for policy 0, policy_version 1017486 (0.0009) [2023-12-28 02:34:13,459][106225] Updated weights for policy 1, policy_version 1020064 (0.0005) [2023-12-28 02:34:13,495][106226] Updated weights for policy 0, policy_version 1017496 (0.0009) [2023-12-28 02:34:14,118][106225] Updated weights for policy 1, policy_version 1020074 (0.0010) [2023-12-28 02:34:14,172][106225] Updated weights for policy 1, policy_version 1020084 (0.0010) [2023-12-28 02:34:14,222][106226] Updated weights for policy 0, policy_version 1017506 (0.0008) [2023-12-28 02:34:14,232][106225] Updated weights for policy 1, policy_version 1020094 (0.0009) [2023-12-28 02:34:14,289][106226] Updated weights for policy 0, policy_version 1017516 (0.0009) [2023-12-28 02:34:14,352][106226] Updated weights for policy 0, policy_version 1017526 (0.0006) [2023-12-28 02:34:14,442][106226] Updated weights for policy 0, policy_version 1017536 (0.0009) [2023-12-28 02:34:14,952][106225] Updated weights for policy 1, policy_version 1020104 (0.0009) [2023-12-28 02:34:15,019][106225] Updated weights for policy 1, policy_version 1020114 (0.0011) [2023-12-28 02:34:15,088][106225] Updated weights for policy 1, policy_version 1020124 (0.0008) [2023-12-28 02:34:15,168][106226] Updated weights for policy 0, policy_version 1017546 (0.0008) [2023-12-28 02:34:15,227][106226] Updated weights for policy 0, policy_version 1017556 (0.0010) [2023-12-28 02:34:15,281][106226] Updated weights for policy 0, policy_version 1017566 (0.0010) [2023-12-28 02:34:15,664][106225] Updated weights for policy 1, policy_version 1020134 (0.0007) [2023-12-28 02:34:15,728][106225] Updated weights for policy 1, policy_version 1020144 (0.0009) [2023-12-28 02:34:15,798][106225] Updated weights for policy 1, policy_version 1020154 (0.0008) [2023-12-28 02:34:16,081][106226] Updated weights for policy 0, policy_version 1017576 (0.0008) [2023-12-28 02:34:16,135][106226] Updated weights for policy 0, policy_version 1017586 (0.0008) [2023-12-28 02:34:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 521756672. Throughput: 0: 9868.0, 1: 9883.7. Samples: 521750508. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:16,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.038')] [2023-12-28 02:34:16,203][106226] Updated weights for policy 0, policy_version 1017596 (0.0007) [2023-12-28 02:34:16,441][106225] Updated weights for policy 1, policy_version 1020164 (0.0007) [2023-12-28 02:34:16,494][106225] Updated weights for policy 1, policy_version 1020174 (0.0010) [2023-12-28 02:34:16,540][106225] Updated weights for policy 1, policy_version 1020184 (0.0010) [2023-12-28 02:34:16,876][106226] Updated weights for policy 0, policy_version 1017606 (0.0007) [2023-12-28 02:34:16,933][106226] Updated weights for policy 0, policy_version 1017616 (0.0005) [2023-12-28 02:34:16,985][106226] Updated weights for policy 0, policy_version 1017626 (0.0005) [2023-12-28 02:34:17,236][106225] Updated weights for policy 1, policy_version 1020194 (0.0007) [2023-12-28 02:34:17,304][106225] Updated weights for policy 1, policy_version 1020204 (0.0008) [2023-12-28 02:34:17,366][106225] Updated weights for policy 1, policy_version 1020214 (0.0009) [2023-12-28 02:34:17,425][106225] Updated weights for policy 1, policy_version 1020224 (0.0010) [2023-12-28 02:34:17,633][106226] Updated weights for policy 0, policy_version 1017636 (0.0005) [2023-12-28 02:34:17,694][106226] Updated weights for policy 0, policy_version 1017646 (0.0005) [2023-12-28 02:34:17,754][106226] Updated weights for policy 0, policy_version 1017656 (0.0009) [2023-12-28 02:34:18,120][106225] Updated weights for policy 1, policy_version 1020234 (0.0010) [2023-12-28 02:34:18,183][106225] Updated weights for policy 1, policy_version 1020244 (0.0007) [2023-12-28 02:34:18,232][106225] Updated weights for policy 1, policy_version 1020254 (0.0010) [2023-12-28 02:34:18,305][106226] Updated weights for policy 0, policy_version 1017666 (0.0007) [2023-12-28 02:34:18,369][106226] Updated weights for policy 0, policy_version 1017676 (0.0011) [2023-12-28 02:34:18,420][106226] Updated weights for policy 0, policy_version 1017686 (0.0010) [2023-12-28 02:34:18,466][106226] Updated weights for policy 0, policy_version 1017696 (0.0010) [2023-12-28 02:34:18,839][106225] Updated weights for policy 1, policy_version 1020264 (0.0006) [2023-12-28 02:34:18,894][106225] Updated weights for policy 1, policy_version 1020274 (0.0009) [2023-12-28 02:34:18,949][106225] Updated weights for policy 1, policy_version 1020284 (0.0010) [2023-12-28 02:34:19,226][106226] Updated weights for policy 0, policy_version 1017706 (0.0009) [2023-12-28 02:34:19,293][106226] Updated weights for policy 0, policy_version 1017716 (0.0011) [2023-12-28 02:34:19,367][106226] Updated weights for policy 0, policy_version 1017726 (0.0009) [2023-12-28 02:34:19,663][106225] Updated weights for policy 1, policy_version 1020294 (0.0010) [2023-12-28 02:34:19,722][106225] Updated weights for policy 1, policy_version 1020304 (0.0010) [2023-12-28 02:34:19,779][106225] Updated weights for policy 1, policy_version 1020314 (0.0009) [2023-12-28 02:34:19,996][106226] Updated weights for policy 0, policy_version 1017736 (0.0006) [2023-12-28 02:34:20,060][106226] Updated weights for policy 0, policy_version 1017746 (0.0008) [2023-12-28 02:34:20,129][106226] Updated weights for policy 0, policy_version 1017756 (0.0009) [2023-12-28 02:34:20,599][106225] Updated weights for policy 1, policy_version 1020324 (0.0009) [2023-12-28 02:34:20,663][106225] Updated weights for policy 1, policy_version 1020334 (0.0007) [2023-12-28 02:34:20,735][106225] Updated weights for policy 1, policy_version 1020344 (0.0008) [2023-12-28 02:34:20,813][106226] Updated weights for policy 0, policy_version 1017766 (0.0009) [2023-12-28 02:34:20,874][106226] Updated weights for policy 0, policy_version 1017776 (0.0008) [2023-12-28 02:34:20,941][106226] Updated weights for policy 0, policy_version 1017786 (0.0009) [2023-12-28 02:34:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 521863168. Throughput: 0: 9813.5, 1: 9864.3. Samples: 521869968. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:21,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-5.094')] [2023-12-28 02:34:21,525][106225] Updated weights for policy 1, policy_version 1020354 (0.0009) [2023-12-28 02:34:21,584][106225] Updated weights for policy 1, policy_version 1020364 (0.0007) [2023-12-28 02:34:21,654][106225] Updated weights for policy 1, policy_version 1020374 (0.0009) [2023-12-28 02:34:21,713][106225] Updated weights for policy 1, policy_version 1020384 (0.0007) [2023-12-28 02:34:21,799][106226] Updated weights for policy 0, policy_version 1017796 (0.0009) [2023-12-28 02:34:21,865][106226] Updated weights for policy 0, policy_version 1017806 (0.0008) [2023-12-28 02:34:21,935][106226] Updated weights for policy 0, policy_version 1017816 (0.0009) [2023-12-28 02:34:22,396][106225] Updated weights for policy 1, policy_version 1020394 (0.0008) [2023-12-28 02:34:22,453][106225] Updated weights for policy 1, policy_version 1020404 (0.0008) [2023-12-28 02:34:22,512][106225] Updated weights for policy 1, policy_version 1020414 (0.0008) [2023-12-28 02:34:22,652][106226] Updated weights for policy 0, policy_version 1017826 (0.0009) [2023-12-28 02:34:22,710][106226] Updated weights for policy 0, policy_version 1017836 (0.0009) [2023-12-28 02:34:22,765][106226] Updated weights for policy 0, policy_version 1017846 (0.0008) [2023-12-28 02:34:22,831][106226] Updated weights for policy 0, policy_version 1017856 (0.0009) [2023-12-28 02:34:23,252][106225] Updated weights for policy 1, policy_version 1020424 (0.0006) [2023-12-28 02:34:23,302][106225] Updated weights for policy 1, policy_version 1020434 (0.0008) [2023-12-28 02:34:23,353][106225] Updated weights for policy 1, policy_version 1020444 (0.0007) [2023-12-28 02:34:23,524][106226] Updated weights for policy 0, policy_version 1017866 (0.0011) [2023-12-28 02:34:23,589][106226] Updated weights for policy 0, policy_version 1017876 (0.0005) [2023-12-28 02:34:23,647][106226] Updated weights for policy 0, policy_version 1017886 (0.0005) [2023-12-28 02:34:24,090][106225] Updated weights for policy 1, policy_version 1020454 (0.0009) [2023-12-28 02:34:24,141][106225] Updated weights for policy 1, policy_version 1020464 (0.0006) [2023-12-28 02:34:24,178][106226] Updated weights for policy 0, policy_version 1017896 (0.0006) [2023-12-28 02:34:24,209][106225] Updated weights for policy 1, policy_version 1020474 (0.0007) [2023-12-28 02:34:24,231][106226] Updated weights for policy 0, policy_version 1017906 (0.0008) [2023-12-28 02:34:24,283][106226] Updated weights for policy 0, policy_version 1017916 (0.0009) [2023-12-28 02:34:24,831][106225] Updated weights for policy 1, policy_version 1020484 (0.0006) [2023-12-28 02:34:24,891][106225] Updated weights for policy 1, policy_version 1020494 (0.0006) [2023-12-28 02:34:24,947][106225] Updated weights for policy 1, policy_version 1020504 (0.0008) [2023-12-28 02:34:25,024][106226] Updated weights for policy 0, policy_version 1017926 (0.0009) [2023-12-28 02:34:25,073][106226] Updated weights for policy 0, policy_version 1017936 (0.0008) [2023-12-28 02:34:25,127][106226] Updated weights for policy 0, policy_version 1017946 (0.0009) [2023-12-28 02:34:25,556][106225] Updated weights for policy 1, policy_version 1020514 (0.0008) [2023-12-28 02:34:25,618][106225] Updated weights for policy 1, policy_version 1020524 (0.0008) [2023-12-28 02:34:25,684][106225] Updated weights for policy 1, policy_version 1020534 (0.0009) [2023-12-28 02:34:25,744][106225] Updated weights for policy 1, policy_version 1020544 (0.0007) [2023-12-28 02:34:25,832][106226] Updated weights for policy 0, policy_version 1017956 (0.0007) [2023-12-28 02:34:25,887][106226] Updated weights for policy 0, policy_version 1017966 (0.0005) [2023-12-28 02:34:25,941][106226] Updated weights for policy 0, policy_version 1017976 (0.0005) [2023-12-28 02:34:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 521961472. Throughput: 0: 9803.1, 1: 9805.2. Samples: 521928828. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:26,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-4.958')] [2023-12-28 02:34:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001020544_261300224.pth... [2023-12-28 02:34:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001017984_260661248.pth... [2023-12-28 02:34:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001019392_261005312.pth [2023-12-28 02:34:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001016832_260366336.pth [2023-12-28 02:34:26,486][106225] Updated weights for policy 1, policy_version 1020554 (0.0006) [2023-12-28 02:34:26,515][106226] Updated weights for policy 0, policy_version 1017986 (0.0006) [2023-12-28 02:34:26,536][106225] Updated weights for policy 1, policy_version 1020564 (0.0006) [2023-12-28 02:34:26,565][106226] Updated weights for policy 0, policy_version 1017996 (0.0006) [2023-12-28 02:34:26,586][106225] Updated weights for policy 1, policy_version 1020574 (0.0006) [2023-12-28 02:34:26,626][106226] Updated weights for policy 0, policy_version 1018006 (0.0007) [2023-12-28 02:34:26,690][106226] Updated weights for policy 0, policy_version 1018016 (0.0009) [2023-12-28 02:34:27,294][106225] Updated weights for policy 1, policy_version 1020584 (0.0007) [2023-12-28 02:34:27,349][106225] Updated weights for policy 1, policy_version 1020594 (0.0009) [2023-12-28 02:34:27,394][106226] Updated weights for policy 0, policy_version 1018026 (0.0008) [2023-12-28 02:34:27,405][106225] Updated weights for policy 1, policy_version 1020604 (0.0007) [2023-12-28 02:34:27,452][106226] Updated weights for policy 0, policy_version 1018037 (0.0008) [2023-12-28 02:34:27,513][106226] Updated weights for policy 0, policy_version 1018047 (0.0005) [2023-12-28 02:34:28,089][106226] Updated weights for policy 0, policy_version 1018057 (0.0006) [2023-12-28 02:34:28,142][106226] Updated weights for policy 0, policy_version 1018067 (0.0009) [2023-12-28 02:34:28,183][106225] Updated weights for policy 1, policy_version 1020614 (0.0005) [2023-12-28 02:34:28,193][106226] Updated weights for policy 0, policy_version 1018077 (0.0007) [2023-12-28 02:34:28,237][106225] Updated weights for policy 1, policy_version 1020624 (0.0005) [2023-12-28 02:34:28,285][106225] Updated weights for policy 1, policy_version 1020634 (0.0005) [2023-12-28 02:34:28,871][106226] Updated weights for policy 0, policy_version 1018087 (0.0008) [2023-12-28 02:34:28,923][106226] Updated weights for policy 0, policy_version 1018097 (0.0008) [2023-12-28 02:34:28,979][106226] Updated weights for policy 0, policy_version 1018107 (0.0008) [2023-12-28 02:34:28,984][106225] Updated weights for policy 1, policy_version 1020644 (0.0007) [2023-12-28 02:34:29,047][106225] Updated weights for policy 1, policy_version 1020654 (0.0006) [2023-12-28 02:34:29,103][106225] Updated weights for policy 1, policy_version 1020664 (0.0008) [2023-12-28 02:34:29,658][106226] Updated weights for policy 0, policy_version 1018117 (0.0006) [2023-12-28 02:34:29,723][106226] Updated weights for policy 0, policy_version 1018127 (0.0008) [2023-12-28 02:34:29,789][106226] Updated weights for policy 0, policy_version 1018137 (0.0008) [2023-12-28 02:34:29,886][106225] Updated weights for policy 1, policy_version 1020674 (0.0008) [2023-12-28 02:34:29,955][106225] Updated weights for policy 1, policy_version 1020684 (0.0008) [2023-12-28 02:34:30,017][106225] Updated weights for policy 1, policy_version 1020694 (0.0008) [2023-12-28 02:34:30,086][106225] Updated weights for policy 1, policy_version 1020704 (0.0009) [2023-12-28 02:34:30,457][106226] Updated weights for policy 0, policy_version 1018147 (0.0008) [2023-12-28 02:34:30,515][106226] Updated weights for policy 0, policy_version 1018157 (0.0008) [2023-12-28 02:34:30,573][106226] Updated weights for policy 0, policy_version 1018167 (0.0009) [2023-12-28 02:34:30,763][106225] Updated weights for policy 1, policy_version 1020714 (0.0009) [2023-12-28 02:34:30,820][106225] Updated weights for policy 1, policy_version 1020724 (0.0007) [2023-12-28 02:34:30,871][106225] Updated weights for policy 1, policy_version 1020734 (0.0008) [2023-12-28 02:34:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 522059776. Throughput: 0: 9898.1, 1: 9856.2. Samples: 522050228. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:31,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.903')] [2023-12-28 02:34:31,325][106226] Updated weights for policy 0, policy_version 1018177 (0.0007) [2023-12-28 02:34:31,402][106226] Updated weights for policy 0, policy_version 1018187 (0.0008) [2023-12-28 02:34:31,471][106226] Updated weights for policy 0, policy_version 1018197 (0.0010) [2023-12-28 02:34:31,537][106226] Updated weights for policy 0, policy_version 1018207 (0.0009) [2023-12-28 02:34:31,679][106225] Updated weights for policy 1, policy_version 1020744 (0.0008) [2023-12-28 02:34:31,752][106225] Updated weights for policy 1, policy_version 1020754 (0.0008) [2023-12-28 02:34:31,803][106225] Updated weights for policy 1, policy_version 1020764 (0.0008) [2023-12-28 02:34:32,303][106226] Updated weights for policy 0, policy_version 1018217 (0.0009) [2023-12-28 02:34:32,373][106226] Updated weights for policy 0, policy_version 1018227 (0.0009) [2023-12-28 02:34:32,438][106226] Updated weights for policy 0, policy_version 1018237 (0.0009) [2023-12-28 02:34:32,537][106225] Updated weights for policy 1, policy_version 1020774 (0.0008) [2023-12-28 02:34:32,601][106225] Updated weights for policy 1, policy_version 1020784 (0.0009) [2023-12-28 02:34:32,661][106225] Updated weights for policy 1, policy_version 1020794 (0.0007) [2023-12-28 02:34:33,168][106226] Updated weights for policy 0, policy_version 1018247 (0.0006) [2023-12-28 02:34:33,233][106226] Updated weights for policy 0, policy_version 1018257 (0.0005) [2023-12-28 02:34:33,244][106225] Updated weights for policy 1, policy_version 1020804 (0.0007) [2023-12-28 02:34:33,293][106226] Updated weights for policy 0, policy_version 1018267 (0.0006) [2023-12-28 02:34:33,295][106225] Updated weights for policy 1, policy_version 1020814 (0.0006) [2023-12-28 02:34:33,342][106225] Updated weights for policy 1, policy_version 1020824 (0.0006) [2023-12-28 02:34:33,991][106226] Updated weights for policy 0, policy_version 1018277 (0.0008) [2023-12-28 02:34:34,005][106225] Updated weights for policy 1, policy_version 1020834 (0.0006) [2023-12-28 02:34:34,047][106226] Updated weights for policy 0, policy_version 1018287 (0.0006) [2023-12-28 02:34:34,062][106225] Updated weights for policy 1, policy_version 1020844 (0.0006) [2023-12-28 02:34:34,108][106226] Updated weights for policy 0, policy_version 1018297 (0.0007) [2023-12-28 02:34:34,114][106225] Updated weights for policy 1, policy_version 1020854 (0.0006) [2023-12-28 02:34:34,199][106225] Updated weights for policy 1, policy_version 1020864 (0.0008) [2023-12-28 02:34:34,825][106225] Updated weights for policy 1, policy_version 1020874 (0.0008) [2023-12-28 02:34:34,885][106225] Updated weights for policy 1, policy_version 1020884 (0.0008) [2023-12-28 02:34:34,903][106226] Updated weights for policy 0, policy_version 1018307 (0.0006) [2023-12-28 02:34:34,944][106225] Updated weights for policy 1, policy_version 1020894 (0.0007) [2023-12-28 02:34:34,950][106226] Updated weights for policy 0, policy_version 1018317 (0.0007) [2023-12-28 02:34:34,998][106226] Updated weights for policy 0, policy_version 1018327 (0.0008) [2023-12-28 02:34:35,652][106226] Updated weights for policy 0, policy_version 1018337 (0.0009) [2023-12-28 02:34:35,708][106226] Updated weights for policy 0, policy_version 1018347 (0.0008) [2023-12-28 02:34:35,710][106225] Updated weights for policy 1, policy_version 1020904 (0.0008) [2023-12-28 02:34:35,758][106226] Updated weights for policy 0, policy_version 1018357 (0.0008) [2023-12-28 02:34:35,764][106225] Updated weights for policy 1, policy_version 1020914 (0.0007) [2023-12-28 02:34:35,809][106226] Updated weights for policy 0, policy_version 1018367 (0.0007) [2023-12-28 02:34:35,820][106225] Updated weights for policy 1, policy_version 1020924 (0.0008) [2023-12-28 02:34:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 522158080. Throughput: 0: 9750.2, 1: 9950.3. Samples: 522166780. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:36,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.787')] [2023-12-28 02:34:36,482][106225] Updated weights for policy 1, policy_version 1020934 (0.0008) [2023-12-28 02:34:36,549][106225] Updated weights for policy 1, policy_version 1020944 (0.0009) [2023-12-28 02:34:36,607][106225] Updated weights for policy 1, policy_version 1020954 (0.0007) [2023-12-28 02:34:36,608][106226] Updated weights for policy 0, policy_version 1018377 (0.0009) [2023-12-28 02:34:36,672][106226] Updated weights for policy 0, policy_version 1018387 (0.0009) [2023-12-28 02:34:36,734][106226] Updated weights for policy 0, policy_version 1018397 (0.0009) [2023-12-28 02:34:37,270][106225] Updated weights for policy 1, policy_version 1020964 (0.0007) [2023-12-28 02:34:37,331][106225] Updated weights for policy 1, policy_version 1020974 (0.0006) [2023-12-28 02:34:37,382][106225] Updated weights for policy 1, policy_version 1020984 (0.0006) [2023-12-28 02:34:37,489][106226] Updated weights for policy 0, policy_version 1018407 (0.0008) [2023-12-28 02:34:37,550][106226] Updated weights for policy 0, policy_version 1018417 (0.0008) [2023-12-28 02:34:37,610][106226] Updated weights for policy 0, policy_version 1018427 (0.0009) [2023-12-28 02:34:38,101][106225] Updated weights for policy 1, policy_version 1020994 (0.0008) [2023-12-28 02:34:38,158][106225] Updated weights for policy 1, policy_version 1021004 (0.0005) [2023-12-28 02:34:38,210][106225] Updated weights for policy 1, policy_version 1021014 (0.0005) [2023-12-28 02:34:38,265][106225] Updated weights for policy 1, policy_version 1021024 (0.0006) [2023-12-28 02:34:38,350][106226] Updated weights for policy 0, policy_version 1018437 (0.0008) [2023-12-28 02:34:38,404][106226] Updated weights for policy 0, policy_version 1018447 (0.0008) [2023-12-28 02:34:38,462][106226] Updated weights for policy 0, policy_version 1018457 (0.0008) [2023-12-28 02:34:38,904][106225] Updated weights for policy 1, policy_version 1021034 (0.0008) [2023-12-28 02:34:38,960][106225] Updated weights for policy 1, policy_version 1021044 (0.0007) [2023-12-28 02:34:39,017][106225] Updated weights for policy 1, policy_version 1021054 (0.0005) [2023-12-28 02:34:39,278][106226] Updated weights for policy 0, policy_version 1018467 (0.0008) [2023-12-28 02:34:39,345][106226] Updated weights for policy 0, policy_version 1018477 (0.0008) [2023-12-28 02:34:39,417][106226] Updated weights for policy 0, policy_version 1018487 (0.0009) [2023-12-28 02:34:39,661][106225] Updated weights for policy 1, policy_version 1021064 (0.0008) [2023-12-28 02:34:39,728][106225] Updated weights for policy 1, policy_version 1021074 (0.0007) [2023-12-28 02:34:39,792][106225] Updated weights for policy 1, policy_version 1021084 (0.0009) [2023-12-28 02:34:40,214][106226] Updated weights for policy 0, policy_version 1018497 (0.0009) [2023-12-28 02:34:40,286][106226] Updated weights for policy 0, policy_version 1018507 (0.0009) [2023-12-28 02:34:40,340][106226] Updated weights for policy 0, policy_version 1018517 (0.0009) [2023-12-28 02:34:40,404][106226] Updated weights for policy 0, policy_version 1018527 (0.0009) [2023-12-28 02:34:40,560][106225] Updated weights for policy 1, policy_version 1021094 (0.0009) [2023-12-28 02:34:40,628][106225] Updated weights for policy 1, policy_version 1021104 (0.0007) [2023-12-28 02:34:40,689][106225] Updated weights for policy 1, policy_version 1021114 (0.0007) [2023-12-28 02:34:41,161][106226] Updated weights for policy 0, policy_version 1018537 (0.0009) [2023-12-28 02:34:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 522248192. Throughput: 0: 9727.7, 1: 9982.1. Samples: 522224676. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:41,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.275')] [2023-12-28 02:34:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001021120_261447680.pth... [2023-12-28 02:34:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001019968_261152768.pth [2023-12-28 02:34:41,221][106226] Updated weights for policy 0, policy_version 1018547 (0.0010) [2023-12-28 02:34:41,288][106226] Updated weights for policy 0, policy_version 1018557 (0.0009) [2023-12-28 02:34:41,304][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001018560_260808704.pth... [2023-12-28 02:34:41,308][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001017408_260513792.pth [2023-12-28 02:34:41,453][106225] Updated weights for policy 1, policy_version 1021124 (0.0008) [2023-12-28 02:34:41,508][106225] Updated weights for policy 1, policy_version 1021134 (0.0009) [2023-12-28 02:34:41,575][106225] Updated weights for policy 1, policy_version 1021144 (0.0006) [2023-12-28 02:34:42,075][106226] Updated weights for policy 0, policy_version 1018567 (0.0008) [2023-12-28 02:34:42,136][106226] Updated weights for policy 0, policy_version 1018577 (0.0009) [2023-12-28 02:34:42,205][106226] Updated weights for policy 0, policy_version 1018587 (0.0006) [2023-12-28 02:34:42,293][106225] Updated weights for policy 1, policy_version 1021154 (0.0008) [2023-12-28 02:34:42,364][106225] Updated weights for policy 1, policy_version 1021165 (0.0008) [2023-12-28 02:34:42,431][106225] Updated weights for policy 1, policy_version 1021175 (0.0008) [2023-12-28 02:34:42,880][106226] Updated weights for policy 0, policy_version 1018597 (0.0006) [2023-12-28 02:34:42,932][106226] Updated weights for policy 0, policy_version 1018607 (0.0005) [2023-12-28 02:34:42,982][106226] Updated weights for policy 0, policy_version 1018617 (0.0005) [2023-12-28 02:34:43,207][106225] Updated weights for policy 1, policy_version 1021185 (0.0007) [2023-12-28 02:34:43,269][106225] Updated weights for policy 1, policy_version 1021195 (0.0010) [2023-12-28 02:34:43,318][106225] Updated weights for policy 1, policy_version 1021205 (0.0009) [2023-12-28 02:34:43,375][106225] Updated weights for policy 1, policy_version 1021215 (0.0009) [2023-12-28 02:34:43,542][106226] Updated weights for policy 0, policy_version 1018627 (0.0008) [2023-12-28 02:34:43,598][106226] Updated weights for policy 0, policy_version 1018637 (0.0005) [2023-12-28 02:34:43,655][106226] Updated weights for policy 0, policy_version 1018647 (0.0008) [2023-12-28 02:34:44,171][106225] Updated weights for policy 1, policy_version 1021225 (0.0007) [2023-12-28 02:34:44,233][106225] Updated weights for policy 1, policy_version 1021235 (0.0008) [2023-12-28 02:34:44,287][106225] Updated weights for policy 1, policy_version 1021245 (0.0008) [2023-12-28 02:34:44,290][106226] Updated weights for policy 0, policy_version 1018657 (0.0008) [2023-12-28 02:34:44,350][106226] Updated weights for policy 0, policy_version 1018667 (0.0007) [2023-12-28 02:34:44,406][106226] Updated weights for policy 0, policy_version 1018677 (0.0008) [2023-12-28 02:34:44,462][106226] Updated weights for policy 0, policy_version 1018687 (0.0009) [2023-12-28 02:34:44,985][106225] Updated weights for policy 1, policy_version 1021255 (0.0007) [2023-12-28 02:34:45,044][106225] Updated weights for policy 1, policy_version 1021265 (0.0008) [2023-12-28 02:34:45,109][106225] Updated weights for policy 1, policy_version 1021275 (0.0008) [2023-12-28 02:34:45,224][106226] Updated weights for policy 0, policy_version 1018697 (0.0010) [2023-12-28 02:34:45,288][106226] Updated weights for policy 0, policy_version 1018707 (0.0009) [2023-12-28 02:34:45,352][106226] Updated weights for policy 0, policy_version 1018717 (0.0009) [2023-12-28 02:34:45,820][106225] Updated weights for policy 1, policy_version 1021285 (0.0008) [2023-12-28 02:34:45,885][106225] Updated weights for policy 1, policy_version 1021295 (0.0006) [2023-12-28 02:34:45,950][106225] Updated weights for policy 1, policy_version 1021305 (0.0005) [2023-12-28 02:34:46,125][106226] Updated weights for policy 0, policy_version 1018727 (0.0010) [2023-12-28 02:34:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 522346496. Throughput: 0: 9834.2, 1: 9809.0. Samples: 522339312. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:46,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.525')] [2023-12-28 02:34:46,181][106226] Updated weights for policy 0, policy_version 1018737 (0.0008) [2023-12-28 02:34:46,242][106226] Updated weights for policy 0, policy_version 1018747 (0.0008) [2023-12-28 02:34:46,514][106225] Updated weights for policy 1, policy_version 1021315 (0.0006) [2023-12-28 02:34:46,575][106225] Updated weights for policy 1, policy_version 1021325 (0.0006) [2023-12-28 02:34:46,637][106225] Updated weights for policy 1, policy_version 1021335 (0.0007) [2023-12-28 02:34:47,097][106226] Updated weights for policy 0, policy_version 1018757 (0.0009) [2023-12-28 02:34:47,159][106226] Updated weights for policy 0, policy_version 1018767 (0.0008) [2023-12-28 02:34:47,221][106226] Updated weights for policy 0, policy_version 1018777 (0.0008) [2023-12-28 02:34:47,228][106225] Updated weights for policy 1, policy_version 1021345 (0.0008) [2023-12-28 02:34:47,278][106225] Updated weights for policy 1, policy_version 1021355 (0.0007) [2023-12-28 02:34:47,333][106225] Updated weights for policy 1, policy_version 1021365 (0.0008) [2023-12-28 02:34:47,389][106225] Updated weights for policy 1, policy_version 1021375 (0.0008) [2023-12-28 02:34:47,987][106226] Updated weights for policy 0, policy_version 1018787 (0.0008) [2023-12-28 02:34:48,016][106225] Updated weights for policy 1, policy_version 1021385 (0.0008) [2023-12-28 02:34:48,042][106226] Updated weights for policy 0, policy_version 1018797 (0.0007) [2023-12-28 02:34:48,065][106225] Updated weights for policy 1, policy_version 1021395 (0.0006) [2023-12-28 02:34:48,102][106226] Updated weights for policy 0, policy_version 1018807 (0.0006) [2023-12-28 02:34:48,126][106225] Updated weights for policy 1, policy_version 1021405 (0.0007) [2023-12-28 02:34:48,827][106226] Updated weights for policy 0, policy_version 1018817 (0.0007) [2023-12-28 02:34:48,849][106225] Updated weights for policy 1, policy_version 1021415 (0.0007) [2023-12-28 02:34:48,889][106226] Updated weights for policy 0, policy_version 1018827 (0.0007) [2023-12-28 02:34:48,908][106225] Updated weights for policy 1, policy_version 1021425 (0.0006) [2023-12-28 02:34:48,945][106226] Updated weights for policy 0, policy_version 1018837 (0.0007) [2023-12-28 02:34:48,963][106225] Updated weights for policy 1, policy_version 1021435 (0.0007) [2023-12-28 02:34:48,999][106226] Updated weights for policy 0, policy_version 1018847 (0.0006) [2023-12-28 02:34:49,702][106226] Updated weights for policy 0, policy_version 1018857 (0.0009) [2023-12-28 02:34:49,739][106225] Updated weights for policy 1, policy_version 1021445 (0.0008) [2023-12-28 02:34:49,764][106226] Updated weights for policy 0, policy_version 1018867 (0.0007) [2023-12-28 02:34:49,794][106225] Updated weights for policy 1, policy_version 1021455 (0.0006) [2023-12-28 02:34:49,824][106226] Updated weights for policy 0, policy_version 1018877 (0.0007) [2023-12-28 02:34:49,866][106225] Updated weights for policy 1, policy_version 1021465 (0.0009) [2023-12-28 02:34:50,491][106226] Updated weights for policy 0, policy_version 1018887 (0.0008) [2023-12-28 02:34:50,554][106226] Updated weights for policy 0, policy_version 1018897 (0.0009) [2023-12-28 02:34:50,631][106226] Updated weights for policy 0, policy_version 1018907 (0.0008) [2023-12-28 02:34:50,649][106225] Updated weights for policy 1, policy_version 1021475 (0.0009) [2023-12-28 02:34:50,717][106225] Updated weights for policy 1, policy_version 1021485 (0.0008) [2023-12-28 02:34:50,784][106225] Updated weights for policy 1, policy_version 1021495 (0.0010) [2023-12-28 02:34:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 522444800. Throughput: 0: 9727.3, 1: 9842.8. Samples: 522454880. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:51,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.815')] [2023-12-28 02:34:51,342][106226] Updated weights for policy 0, policy_version 1018917 (0.0008) [2023-12-28 02:34:51,415][106226] Updated weights for policy 0, policy_version 1018927 (0.0008) [2023-12-28 02:34:51,481][106226] Updated weights for policy 0, policy_version 1018937 (0.0009) [2023-12-28 02:34:51,558][106225] Updated weights for policy 1, policy_version 1021505 (0.0006) [2023-12-28 02:34:51,619][106225] Updated weights for policy 1, policy_version 1021515 (0.0008) [2023-12-28 02:34:51,682][106225] Updated weights for policy 1, policy_version 1021525 (0.0009) [2023-12-28 02:34:51,745][106225] Updated weights for policy 1, policy_version 1021535 (0.0008) [2023-12-28 02:34:52,236][106226] Updated weights for policy 0, policy_version 1018947 (0.0009) [2023-12-28 02:34:52,299][106226] Updated weights for policy 0, policy_version 1018957 (0.0007) [2023-12-28 02:34:52,364][106226] Updated weights for policy 0, policy_version 1018967 (0.0009) [2023-12-28 02:34:52,504][106225] Updated weights for policy 1, policy_version 1021545 (0.0009) [2023-12-28 02:34:52,561][106225] Updated weights for policy 1, policy_version 1021555 (0.0006) [2023-12-28 02:34:52,620][106225] Updated weights for policy 1, policy_version 1021565 (0.0007) [2023-12-28 02:34:53,101][106226] Updated weights for policy 0, policy_version 1018977 (0.0008) [2023-12-28 02:34:53,152][106226] Updated weights for policy 0, policy_version 1018987 (0.0009) [2023-12-28 02:34:53,205][106226] Updated weights for policy 0, policy_version 1018997 (0.0010) [2023-12-28 02:34:53,266][106226] Updated weights for policy 0, policy_version 1019007 (0.0010) [2023-12-28 02:34:53,363][106225] Updated weights for policy 1, policy_version 1021575 (0.0007) [2023-12-28 02:34:53,409][106225] Updated weights for policy 1, policy_version 1021585 (0.0008) [2023-12-28 02:34:53,464][106225] Updated weights for policy 1, policy_version 1021595 (0.0009) [2023-12-28 02:34:53,919][106226] Updated weights for policy 0, policy_version 1019017 (0.0009) [2023-12-28 02:34:53,976][106226] Updated weights for policy 0, policy_version 1019027 (0.0008) [2023-12-28 02:34:54,036][106226] Updated weights for policy 0, policy_version 1019037 (0.0009) [2023-12-28 02:34:54,203][106225] Updated weights for policy 1, policy_version 1021605 (0.0008) [2023-12-28 02:34:54,259][106225] Updated weights for policy 1, policy_version 1021615 (0.0008) [2023-12-28 02:34:54,312][106225] Updated weights for policy 1, policy_version 1021625 (0.0008) [2023-12-28 02:34:54,728][106226] Updated weights for policy 0, policy_version 1019047 (0.0007) [2023-12-28 02:34:54,787][106226] Updated weights for policy 0, policy_version 1019057 (0.0008) [2023-12-28 02:34:54,850][106226] Updated weights for policy 0, policy_version 1019067 (0.0008) [2023-12-28 02:34:55,048][106225] Updated weights for policy 1, policy_version 1021635 (0.0009) [2023-12-28 02:34:55,104][106225] Updated weights for policy 1, policy_version 1021645 (0.0008) [2023-12-28 02:34:55,164][106225] Updated weights for policy 1, policy_version 1021655 (0.0009) [2023-12-28 02:34:55,517][106226] Updated weights for policy 0, policy_version 1019077 (0.0007) [2023-12-28 02:34:55,570][106226] Updated weights for policy 0, policy_version 1019087 (0.0007) [2023-12-28 02:34:55,626][106226] Updated weights for policy 0, policy_version 1019097 (0.0008) [2023-12-28 02:34:55,912][106225] Updated weights for policy 1, policy_version 1021665 (0.0009) [2023-12-28 02:34:55,969][106225] Updated weights for policy 1, policy_version 1021675 (0.0010) [2023-12-28 02:34:56,026][106225] Updated weights for policy 1, policy_version 1021685 (0.0010) [2023-12-28 02:34:56,081][106225] Updated weights for policy 1, policy_version 1021695 (0.0011) [2023-12-28 02:34:56,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 522543104. Throughput: 0: 9658.6, 1: 9778.2. Samples: 522511152. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 02:34:56,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.855')] [2023-12-28 02:34:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001021696_261595136.pth... [2023-12-28 02:34:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001019104_260947968.pth... [2023-12-28 02:34:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001020544_261300224.pth [2023-12-28 02:34:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001017984_260661248.pth [2023-12-28 02:34:56,355][106226] Updated weights for policy 0, policy_version 1019107 (0.0007) [2023-12-28 02:34:56,410][106226] Updated weights for policy 0, policy_version 1019117 (0.0008) [2023-12-28 02:34:56,462][106226] Updated weights for policy 0, policy_version 1019127 (0.0008) [2023-12-28 02:34:56,734][106225] Updated weights for policy 1, policy_version 1021705 (0.0008) [2023-12-28 02:34:56,783][106225] Updated weights for policy 1, policy_version 1021715 (0.0009) [2023-12-28 02:34:56,834][106225] Updated weights for policy 1, policy_version 1021725 (0.0008) [2023-12-28 02:34:57,217][106226] Updated weights for policy 0, policy_version 1019137 (0.0009) [2023-12-28 02:34:57,272][106226] Updated weights for policy 0, policy_version 1019147 (0.0008) [2023-12-28 02:34:57,325][106226] Updated weights for policy 0, policy_version 1019157 (0.0008) [2023-12-28 02:34:57,387][106226] Updated weights for policy 0, policy_version 1019167 (0.0008) [2023-12-28 02:34:57,513][106225] Updated weights for policy 1, policy_version 1021735 (0.0005) [2023-12-28 02:34:57,568][106225] Updated weights for policy 1, policy_version 1021745 (0.0005) [2023-12-28 02:34:57,627][106225] Updated weights for policy 1, policy_version 1021755 (0.0009) [2023-12-28 02:34:58,170][106226] Updated weights for policy 0, policy_version 1019177 (0.0009) [2023-12-28 02:34:58,203][106225] Updated weights for policy 1, policy_version 1021765 (0.0010) [2023-12-28 02:34:58,235][106226] Updated weights for policy 0, policy_version 1019187 (0.0009) [2023-12-28 02:34:58,266][106225] Updated weights for policy 1, policy_version 1021775 (0.0008) [2023-12-28 02:34:58,296][106226] Updated weights for policy 0, policy_version 1019197 (0.0008) [2023-12-28 02:34:58,326][106225] Updated weights for policy 1, policy_version 1021785 (0.0008) [2023-12-28 02:34:59,086][106225] Updated weights for policy 1, policy_version 1021795 (0.0007) [2023-12-28 02:34:59,115][106226] Updated weights for policy 0, policy_version 1019207 (0.0008) [2023-12-28 02:34:59,148][106225] Updated weights for policy 1, policy_version 1021805 (0.0008) [2023-12-28 02:34:59,178][106226] Updated weights for policy 0, policy_version 1019217 (0.0006) [2023-12-28 02:34:59,228][106225] Updated weights for policy 1, policy_version 1021815 (0.0008) [2023-12-28 02:34:59,241][106226] Updated weights for policy 0, policy_version 1019227 (0.0008) [2023-12-28 02:34:59,958][106225] Updated weights for policy 1, policy_version 1021825 (0.0008) [2023-12-28 02:34:59,999][106226] Updated weights for policy 0, policy_version 1019237 (0.0008) [2023-12-28 02:35:00,021][106225] Updated weights for policy 1, policy_version 1021835 (0.0006) [2023-12-28 02:35:00,062][106226] Updated weights for policy 0, policy_version 1019247 (0.0007) [2023-12-28 02:35:00,078][106225] Updated weights for policy 1, policy_version 1021845 (0.0008) [2023-12-28 02:35:00,127][106226] Updated weights for policy 0, policy_version 1019257 (0.0006) [2023-12-28 02:35:00,136][106225] Updated weights for policy 1, policy_version 1021855 (0.0008) [2023-12-28 02:35:00,804][106226] Updated weights for policy 0, policy_version 1019267 (0.0009) [2023-12-28 02:35:00,863][106226] Updated weights for policy 0, policy_version 1019277 (0.0007) [2023-12-28 02:35:00,875][106225] Updated weights for policy 1, policy_version 1021865 (0.0007) [2023-12-28 02:35:00,925][106226] Updated weights for policy 0, policy_version 1019287 (0.0005) [2023-12-28 02:35:00,927][106225] Updated weights for policy 1, policy_version 1021875 (0.0008) [2023-12-28 02:35:00,983][106225] Updated weights for policy 1, policy_version 1021885 (0.0008) [2023-12-28 02:35:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 522641408. Throughput: 0: 9675.7, 1: 9809.2. Samples: 522627328. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:01,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.775')] [2023-12-28 02:35:01,618][106226] Updated weights for policy 0, policy_version 1019297 (0.0006) [2023-12-28 02:35:01,683][106226] Updated weights for policy 0, policy_version 1019307 (0.0008) [2023-12-28 02:35:01,758][106226] Updated weights for policy 0, policy_version 1019317 (0.0009) [2023-12-28 02:35:01,798][106225] Updated weights for policy 1, policy_version 1021895 (0.0008) [2023-12-28 02:35:01,830][106226] Updated weights for policy 0, policy_version 1019327 (0.0009) [2023-12-28 02:35:01,853][106225] Updated weights for policy 1, policy_version 1021905 (0.0007) [2023-12-28 02:35:01,919][106225] Updated weights for policy 1, policy_version 1021915 (0.0008) [2023-12-28 02:35:02,546][106226] Updated weights for policy 0, policy_version 1019337 (0.0009) [2023-12-28 02:35:02,609][106225] Updated weights for policy 1, policy_version 1021925 (0.0009) [2023-12-28 02:35:02,611][106226] Updated weights for policy 0, policy_version 1019347 (0.0008) [2023-12-28 02:35:02,667][106225] Updated weights for policy 1, policy_version 1021935 (0.0006) [2023-12-28 02:35:02,675][106226] Updated weights for policy 0, policy_version 1019357 (0.0008) [2023-12-28 02:35:02,721][106225] Updated weights for policy 1, policy_version 1021945 (0.0007) [2023-12-28 02:35:03,364][106226] Updated weights for policy 0, policy_version 1019367 (0.0008) [2023-12-28 02:35:03,384][106225] Updated weights for policy 1, policy_version 1021955 (0.0008) [2023-12-28 02:35:03,415][106226] Updated weights for policy 0, policy_version 1019377 (0.0006) [2023-12-28 02:35:03,437][106225] Updated weights for policy 1, policy_version 1021965 (0.0007) [2023-12-28 02:35:03,466][106226] Updated weights for policy 0, policy_version 1019387 (0.0007) [2023-12-28 02:35:03,491][106225] Updated weights for policy 1, policy_version 1021975 (0.0007) [2023-12-28 02:35:04,180][106225] Updated weights for policy 1, policy_version 1021985 (0.0008) [2023-12-28 02:35:04,246][106225] Updated weights for policy 1, policy_version 1021995 (0.0007) [2023-12-28 02:35:04,250][106226] Updated weights for policy 0, policy_version 1019397 (0.0006) [2023-12-28 02:35:04,306][106225] Updated weights for policy 1, policy_version 1022005 (0.0008) [2023-12-28 02:35:04,312][106226] Updated weights for policy 0, policy_version 1019407 (0.0006) [2023-12-28 02:35:04,362][106225] Updated weights for policy 1, policy_version 1022015 (0.0007) [2023-12-28 02:35:04,372][106226] Updated weights for policy 0, policy_version 1019417 (0.0006) [2023-12-28 02:35:05,057][106225] Updated weights for policy 1, policy_version 1022025 (0.0007) [2023-12-28 02:35:05,082][106226] Updated weights for policy 0, policy_version 1019427 (0.0008) [2023-12-28 02:35:05,115][106225] Updated weights for policy 1, policy_version 1022035 (0.0005) [2023-12-28 02:35:05,148][106226] Updated weights for policy 0, policy_version 1019437 (0.0007) [2023-12-28 02:35:05,159][106225] Updated weights for policy 1, policy_version 1022045 (0.0005) [2023-12-28 02:35:05,209][106226] Updated weights for policy 0, policy_version 1019447 (0.0008) [2023-12-28 02:35:05,710][106225] Updated weights for policy 1, policy_version 1022055 (0.0009) [2023-12-28 02:35:05,763][106225] Updated weights for policy 1, policy_version 1022065 (0.0009) [2023-12-28 02:35:05,821][106225] Updated weights for policy 1, policy_version 1022075 (0.0007) [2023-12-28 02:35:05,965][106226] Updated weights for policy 0, policy_version 1019457 (0.0008) [2023-12-28 02:35:06,025][106226] Updated weights for policy 0, policy_version 1019467 (0.0005) [2023-12-28 02:35:06,087][106226] Updated weights for policy 0, policy_version 1019477 (0.0006) [2023-12-28 02:35:06,159][106226] Updated weights for policy 0, policy_version 1019487 (0.0009) [2023-12-28 02:35:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 522739712. Throughput: 0: 9639.3, 1: 9816.7. Samples: 522745484. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:06,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.307')] [2023-12-28 02:35:06,485][106225] Updated weights for policy 1, policy_version 1022085 (0.0005) [2023-12-28 02:35:06,546][106225] Updated weights for policy 1, policy_version 1022095 (0.0008) [2023-12-28 02:35:06,609][106225] Updated weights for policy 1, policy_version 1022105 (0.0008) [2023-12-28 02:35:06,805][106226] Updated weights for policy 0, policy_version 1019497 (0.0008) [2023-12-28 02:35:06,862][106226] Updated weights for policy 0, policy_version 1019507 (0.0008) [2023-12-28 02:35:06,916][106226] Updated weights for policy 0, policy_version 1019517 (0.0008) [2023-12-28 02:35:07,237][106225] Updated weights for policy 1, policy_version 1022115 (0.0010) [2023-12-28 02:35:07,293][106225] Updated weights for policy 1, policy_version 1022125 (0.0008) [2023-12-28 02:35:07,356][106225] Updated weights for policy 1, policy_version 1022135 (0.0008) [2023-12-28 02:35:07,680][106226] Updated weights for policy 0, policy_version 1019527 (0.0008) [2023-12-28 02:35:07,743][106226] Updated weights for policy 0, policy_version 1019537 (0.0009) [2023-12-28 02:35:07,792][106226] Updated weights for policy 0, policy_version 1019547 (0.0008) [2023-12-28 02:35:08,075][106225] Updated weights for policy 1, policy_version 1022145 (0.0008) [2023-12-28 02:35:08,128][106225] Updated weights for policy 1, policy_version 1022155 (0.0009) [2023-12-28 02:35:08,180][106225] Updated weights for policy 1, policy_version 1022165 (0.0009) [2023-12-28 02:35:08,232][106225] Updated weights for policy 1, policy_version 1022175 (0.0008) [2023-12-28 02:35:08,479][106226] Updated weights for policy 0, policy_version 1019557 (0.0008) [2023-12-28 02:35:08,541][106226] Updated weights for policy 0, policy_version 1019567 (0.0009) [2023-12-28 02:35:08,604][106226] Updated weights for policy 0, policy_version 1019577 (0.0008) [2023-12-28 02:35:08,995][106225] Updated weights for policy 1, policy_version 1022185 (0.0010) [2023-12-28 02:35:09,055][106225] Updated weights for policy 1, policy_version 1022195 (0.0010) [2023-12-28 02:35:09,112][106225] Updated weights for policy 1, policy_version 1022205 (0.0010) [2023-12-28 02:35:09,361][106226] Updated weights for policy 0, policy_version 1019587 (0.0009) [2023-12-28 02:35:09,434][106226] Updated weights for policy 0, policy_version 1019597 (0.0008) [2023-12-28 02:35:09,496][106226] Updated weights for policy 0, policy_version 1019607 (0.0005) [2023-12-28 02:35:09,872][106225] Updated weights for policy 1, policy_version 1022215 (0.0010) [2023-12-28 02:35:09,925][106225] Updated weights for policy 1, policy_version 1022225 (0.0008) [2023-12-28 02:35:09,985][106225] Updated weights for policy 1, policy_version 1022235 (0.0007) [2023-12-28 02:35:10,188][106226] Updated weights for policy 0, policy_version 1019617 (0.0007) [2023-12-28 02:35:10,250][106226] Updated weights for policy 0, policy_version 1019627 (0.0009) [2023-12-28 02:35:10,317][106226] Updated weights for policy 0, policy_version 1019637 (0.0008) [2023-12-28 02:35:10,377][106226] Updated weights for policy 0, policy_version 1019647 (0.0007) [2023-12-28 02:35:10,652][106225] Updated weights for policy 1, policy_version 1022245 (0.0007) [2023-12-28 02:35:10,705][106225] Updated weights for policy 1, policy_version 1022255 (0.0007) [2023-12-28 02:35:10,760][106225] Updated weights for policy 1, policy_version 1022265 (0.0010) [2023-12-28 02:35:11,048][106226] Updated weights for policy 0, policy_version 1019657 (0.0008) [2023-12-28 02:35:11,114][106226] Updated weights for policy 0, policy_version 1019667 (0.0008) [2023-12-28 02:35:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 522829824. Throughput: 0: 9605.2, 1: 9854.9. Samples: 522804536. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:11,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.616')] [2023-12-28 02:35:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001022272_261742592.pth... [2023-12-28 02:35:11,186][106226] Updated weights for policy 0, policy_version 1019677 (0.0008) [2023-12-28 02:35:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001021120_261447680.pth [2023-12-28 02:35:11,204][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001019680_261095424.pth... [2023-12-28 02:35:11,207][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001018560_260808704.pth [2023-12-28 02:35:11,529][106225] Updated weights for policy 1, policy_version 1022275 (0.0010) [2023-12-28 02:35:11,596][106225] Updated weights for policy 1, policy_version 1022285 (0.0007) [2023-12-28 02:35:11,666][106225] Updated weights for policy 1, policy_version 1022295 (0.0010) [2023-12-28 02:35:11,983][106226] Updated weights for policy 0, policy_version 1019687 (0.0010) [2023-12-28 02:35:12,044][106226] Updated weights for policy 0, policy_version 1019697 (0.0011) [2023-12-28 02:35:12,106][106226] Updated weights for policy 0, policy_version 1019707 (0.0010) [2023-12-28 02:35:12,357][106225] Updated weights for policy 1, policy_version 1022305 (0.0008) [2023-12-28 02:35:12,424][106225] Updated weights for policy 1, policy_version 1022315 (0.0006) [2023-12-28 02:35:12,489][106225] Updated weights for policy 1, policy_version 1022325 (0.0008) [2023-12-28 02:35:12,557][106225] Updated weights for policy 1, policy_version 1022335 (0.0010) [2023-12-28 02:35:12,833][106226] Updated weights for policy 0, policy_version 1019717 (0.0010) [2023-12-28 02:35:12,903][106226] Updated weights for policy 0, policy_version 1019727 (0.0010) [2023-12-28 02:35:12,967][106226] Updated weights for policy 0, policy_version 1019737 (0.0011) [2023-12-28 02:35:13,202][106225] Updated weights for policy 1, policy_version 1022345 (0.0006) [2023-12-28 02:35:13,254][106225] Updated weights for policy 1, policy_version 1022355 (0.0006) [2023-12-28 02:35:13,306][106225] Updated weights for policy 1, policy_version 1022365 (0.0006) [2023-12-28 02:35:13,542][106226] Updated weights for policy 0, policy_version 1019747 (0.0009) [2023-12-28 02:35:13,589][106226] Updated weights for policy 0, policy_version 1019757 (0.0005) [2023-12-28 02:35:13,635][106226] Updated weights for policy 0, policy_version 1019767 (0.0005) [2023-12-28 02:35:13,939][106225] Updated weights for policy 1, policy_version 1022375 (0.0005) [2023-12-28 02:35:13,991][106225] Updated weights for policy 1, policy_version 1022385 (0.0006) [2023-12-28 02:35:14,047][106225] Updated weights for policy 1, policy_version 1022395 (0.0006) [2023-12-28 02:35:14,302][106226] Updated weights for policy 0, policy_version 1019777 (0.0006) [2023-12-28 02:35:14,353][106226] Updated weights for policy 0, policy_version 1019787 (0.0008) [2023-12-28 02:35:14,404][106226] Updated weights for policy 0, policy_version 1019797 (0.0006) [2023-12-28 02:35:14,468][106226] Updated weights for policy 0, policy_version 1019808 (0.0007) [2023-12-28 02:35:14,645][106225] Updated weights for policy 1, policy_version 1022405 (0.0006) [2023-12-28 02:35:14,709][106225] Updated weights for policy 1, policy_version 1022415 (0.0008) [2023-12-28 02:35:14,767][106225] Updated weights for policy 1, policy_version 1022425 (0.0008) [2023-12-28 02:35:15,205][106226] Updated weights for policy 0, policy_version 1019818 (0.0009) [2023-12-28 02:35:15,261][106226] Updated weights for policy 0, policy_version 1019828 (0.0011) [2023-12-28 02:35:15,327][106226] Updated weights for policy 0, policy_version 1019838 (0.0011) [2023-12-28 02:35:15,489][106225] Updated weights for policy 1, policy_version 1022435 (0.0008) [2023-12-28 02:35:15,558][106225] Updated weights for policy 1, policy_version 1022445 (0.0007) [2023-12-28 02:35:15,612][106225] Updated weights for policy 1, policy_version 1022455 (0.0008) [2023-12-28 02:35:16,040][106226] Updated weights for policy 0, policy_version 1019848 (0.0010) [2023-12-28 02:35:16,093][106226] Updated weights for policy 0, policy_version 1019858 (0.0010) [2023-12-28 02:35:16,146][106226] Updated weights for policy 0, policy_version 1019868 (0.0010) [2023-12-28 02:35:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 522936320. Throughput: 0: 9533.2, 1: 9877.5. Samples: 522923708. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:16,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-4.942')] [2023-12-28 02:35:16,272][106225] Updated weights for policy 1, policy_version 1022465 (0.0006) [2023-12-28 02:35:16,329][106225] Updated weights for policy 1, policy_version 1022475 (0.0005) [2023-12-28 02:35:16,380][106225] Updated weights for policy 1, policy_version 1022485 (0.0005) [2023-12-28 02:35:16,437][106225] Updated weights for policy 1, policy_version 1022495 (0.0005) [2023-12-28 02:35:16,884][106226] Updated weights for policy 0, policy_version 1019878 (0.0010) [2023-12-28 02:35:16,942][106226] Updated weights for policy 0, policy_version 1019888 (0.0010) [2023-12-28 02:35:16,998][106226] Updated weights for policy 0, policy_version 1019898 (0.0005) [2023-12-28 02:35:17,020][106225] Updated weights for policy 1, policy_version 1022505 (0.0010) [2023-12-28 02:35:17,077][106225] Updated weights for policy 1, policy_version 1022515 (0.0010) [2023-12-28 02:35:17,136][106225] Updated weights for policy 1, policy_version 1022525 (0.0010) [2023-12-28 02:35:17,596][106226] Updated weights for policy 0, policy_version 1019908 (0.0009) [2023-12-28 02:35:17,658][106226] Updated weights for policy 0, policy_version 1019918 (0.0008) [2023-12-28 02:35:17,716][106226] Updated weights for policy 0, policy_version 1019928 (0.0008) [2023-12-28 02:35:17,863][106225] Updated weights for policy 1, policy_version 1022535 (0.0010) [2023-12-28 02:35:17,924][106225] Updated weights for policy 1, policy_version 1022545 (0.0010) [2023-12-28 02:35:17,982][106225] Updated weights for policy 1, policy_version 1022555 (0.0010) [2023-12-28 02:35:18,424][106226] Updated weights for policy 0, policy_version 1019938 (0.0008) [2023-12-28 02:35:18,483][106226] Updated weights for policy 0, policy_version 1019948 (0.0011) [2023-12-28 02:35:18,547][106226] Updated weights for policy 0, policy_version 1019958 (0.0008) [2023-12-28 02:35:18,614][106226] Updated weights for policy 0, policy_version 1019968 (0.0006) [2023-12-28 02:35:18,684][106225] Updated weights for policy 1, policy_version 1022565 (0.0008) [2023-12-28 02:35:18,750][106225] Updated weights for policy 1, policy_version 1022575 (0.0008) [2023-12-28 02:35:18,811][106225] Updated weights for policy 1, policy_version 1022585 (0.0009) [2023-12-28 02:35:19,262][106226] Updated weights for policy 0, policy_version 1019978 (0.0009) [2023-12-28 02:35:19,330][106226] Updated weights for policy 0, policy_version 1019988 (0.0007) [2023-12-28 02:35:19,397][106226] Updated weights for policy 0, policy_version 1019998 (0.0011) [2023-12-28 02:35:19,476][106225] Updated weights for policy 1, policy_version 1022595 (0.0010) [2023-12-28 02:35:19,547][106225] Updated weights for policy 1, policy_version 1022605 (0.0008) [2023-12-28 02:35:19,610][106225] Updated weights for policy 1, policy_version 1022615 (0.0008) [2023-12-28 02:35:20,119][106226] Updated weights for policy 0, policy_version 1020008 (0.0007) [2023-12-28 02:35:20,179][106226] Updated weights for policy 0, policy_version 1020018 (0.0009) [2023-12-28 02:35:20,243][106226] Updated weights for policy 0, policy_version 1020028 (0.0010) [2023-12-28 02:35:20,273][106225] Updated weights for policy 1, policy_version 1022625 (0.0007) [2023-12-28 02:35:20,335][106225] Updated weights for policy 1, policy_version 1022635 (0.0007) [2023-12-28 02:35:20,396][106225] Updated weights for policy 1, policy_version 1022645 (0.0008) [2023-12-28 02:35:20,448][106225] Updated weights for policy 1, policy_version 1022655 (0.0008) [2023-12-28 02:35:21,040][106226] Updated weights for policy 0, policy_version 1020038 (0.0010) [2023-12-28 02:35:21,109][106226] Updated weights for policy 0, policy_version 1020048 (0.0006) [2023-12-28 02:35:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 523026432. Throughput: 0: 9558.3, 1: 9904.2. Samples: 523042592. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:21,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-4.976')] [2023-12-28 02:35:21,177][106226] Updated weights for policy 0, policy_version 1020058 (0.0007) [2023-12-28 02:35:21,217][106225] Updated weights for policy 1, policy_version 1022665 (0.0008) [2023-12-28 02:35:21,291][106225] Updated weights for policy 1, policy_version 1022675 (0.0008) [2023-12-28 02:35:21,364][106225] Updated weights for policy 1, policy_version 1022685 (0.0008) [2023-12-28 02:35:21,960][106226] Updated weights for policy 0, policy_version 1020068 (0.0008) [2023-12-28 02:35:22,028][106226] Updated weights for policy 0, policy_version 1020078 (0.0011) [2023-12-28 02:35:22,095][106226] Updated weights for policy 0, policy_version 1020088 (0.0011) [2023-12-28 02:35:22,133][106225] Updated weights for policy 1, policy_version 1022695 (0.0009) [2023-12-28 02:35:22,192][106225] Updated weights for policy 1, policy_version 1022705 (0.0007) [2023-12-28 02:35:22,260][106225] Updated weights for policy 1, policy_version 1022715 (0.0009) [2023-12-28 02:35:22,810][106226] Updated weights for policy 0, policy_version 1020098 (0.0011) [2023-12-28 02:35:22,874][106226] Updated weights for policy 0, policy_version 1020108 (0.0011) [2023-12-28 02:35:22,925][106226] Updated weights for policy 0, policy_version 1020118 (0.0011) [2023-12-28 02:35:22,987][106226] Updated weights for policy 0, policy_version 1020128 (0.0011) [2023-12-28 02:35:22,989][106225] Updated weights for policy 1, policy_version 1022725 (0.0007) [2023-12-28 02:35:23,048][106225] Updated weights for policy 1, policy_version 1022735 (0.0008) [2023-12-28 02:35:23,112][106225] Updated weights for policy 1, policy_version 1022745 (0.0008) [2023-12-28 02:35:23,707][106226] Updated weights for policy 0, policy_version 1020138 (0.0010) [2023-12-28 02:35:23,766][106226] Updated weights for policy 0, policy_version 1020148 (0.0011) [2023-12-28 02:35:23,832][106226] Updated weights for policy 0, policy_version 1020158 (0.0010) [2023-12-28 02:35:23,837][106225] Updated weights for policy 1, policy_version 1022755 (0.0007) [2023-12-28 02:35:23,897][106225] Updated weights for policy 1, policy_version 1022765 (0.0006) [2023-12-28 02:35:23,962][106225] Updated weights for policy 1, policy_version 1022775 (0.0005) [2023-12-28 02:35:24,525][106226] Updated weights for policy 0, policy_version 1020168 (0.0010) [2023-12-28 02:35:24,572][106226] Updated weights for policy 0, policy_version 1020178 (0.0010) [2023-12-28 02:35:24,591][106225] Updated weights for policy 1, policy_version 1022785 (0.0005) [2023-12-28 02:35:24,619][106226] Updated weights for policy 0, policy_version 1020188 (0.0010) [2023-12-28 02:35:24,644][106225] Updated weights for policy 1, policy_version 1022795 (0.0006) [2023-12-28 02:35:24,703][106225] Updated weights for policy 1, policy_version 1022805 (0.0007) [2023-12-28 02:35:24,764][106225] Updated weights for policy 1, policy_version 1022815 (0.0008) [2023-12-28 02:35:25,364][106226] Updated weights for policy 0, policy_version 1020198 (0.0011) [2023-12-28 02:35:25,421][106226] Updated weights for policy 0, policy_version 1020208 (0.0010) [2023-12-28 02:35:25,466][106225] Updated weights for policy 1, policy_version 1022825 (0.0007) [2023-12-28 02:35:25,475][106226] Updated weights for policy 0, policy_version 1020218 (0.0010) [2023-12-28 02:35:25,523][106225] Updated weights for policy 1, policy_version 1022835 (0.0006) [2023-12-28 02:35:25,576][106225] Updated weights for policy 1, policy_version 1022845 (0.0007) [2023-12-28 02:35:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 523124736. Throughput: 0: 9579.4, 1: 9834.5. Samples: 523098300. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:26,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-5.017')] [2023-12-28 02:35:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001022848_261890048.pth... [2023-12-28 02:35:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001021696_261595136.pth [2023-12-28 02:35:26,202][106226] Updated weights for policy 0, policy_version 1020228 (0.0010) [2023-12-28 02:35:26,256][106226] Updated weights for policy 0, policy_version 1020238 (0.0010) [2023-12-28 02:35:26,287][106225] Updated weights for policy 1, policy_version 1022855 (0.0009) [2023-12-28 02:35:26,306][106226] Updated weights for policy 0, policy_version 1020248 (0.0010) [2023-12-28 02:35:26,334][106225] Updated weights for policy 1, policy_version 1022865 (0.0007) [2023-12-28 02:35:26,344][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001020256_261242880.pth... [2023-12-28 02:35:26,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001019104_260947968.pth [2023-12-28 02:35:26,380][106225] Updated weights for policy 1, policy_version 1022875 (0.0008) [2023-12-28 02:35:26,920][106226] Updated weights for policy 0, policy_version 1020258 (0.0009) [2023-12-28 02:35:26,978][106226] Updated weights for policy 0, policy_version 1020268 (0.0005) [2023-12-28 02:35:27,037][106226] Updated weights for policy 0, policy_version 1020278 (0.0005) [2023-12-28 02:35:27,102][106226] Updated weights for policy 0, policy_version 1020288 (0.0009) [2023-12-28 02:35:27,144][106225] Updated weights for policy 1, policy_version 1022885 (0.0007) [2023-12-28 02:35:27,194][106225] Updated weights for policy 1, policy_version 1022895 (0.0005) [2023-12-28 02:35:27,245][106225] Updated weights for policy 1, policy_version 1022905 (0.0005) [2023-12-28 02:35:27,756][106226] Updated weights for policy 0, policy_version 1020298 (0.0009) [2023-12-28 02:35:27,810][106226] Updated weights for policy 0, policy_version 1020308 (0.0005) [2023-12-28 02:35:27,864][106226] Updated weights for policy 0, policy_version 1020318 (0.0005) [2023-12-28 02:35:27,925][106225] Updated weights for policy 1, policy_version 1022915 (0.0006) [2023-12-28 02:35:27,974][106225] Updated weights for policy 1, policy_version 1022925 (0.0009) [2023-12-28 02:35:28,027][106225] Updated weights for policy 1, policy_version 1022935 (0.0008) [2023-12-28 02:35:28,456][106226] Updated weights for policy 0, policy_version 1020328 (0.0005) [2023-12-28 02:35:28,517][106226] Updated weights for policy 0, policy_version 1020338 (0.0005) [2023-12-28 02:35:28,581][106226] Updated weights for policy 0, policy_version 1020348 (0.0006) [2023-12-28 02:35:28,829][106225] Updated weights for policy 1, policy_version 1022945 (0.0008) [2023-12-28 02:35:28,890][106225] Updated weights for policy 1, policy_version 1022955 (0.0007) [2023-12-28 02:35:28,950][106225] Updated weights for policy 1, policy_version 1022965 (0.0009) [2023-12-28 02:35:28,994][106225] Updated weights for policy 1, policy_version 1022975 (0.0008) [2023-12-28 02:35:29,138][106226] Updated weights for policy 0, policy_version 1020358 (0.0005) [2023-12-28 02:35:29,187][106226] Updated weights for policy 0, policy_version 1020368 (0.0005) [2023-12-28 02:35:29,245][106226] Updated weights for policy 0, policy_version 1020378 (0.0006) [2023-12-28 02:35:29,685][106225] Updated weights for policy 1, policy_version 1022985 (0.0006) [2023-12-28 02:35:29,749][106225] Updated weights for policy 1, policy_version 1022995 (0.0007) [2023-12-28 02:35:29,806][106225] Updated weights for policy 1, policy_version 1023005 (0.0008) [2023-12-28 02:35:30,009][106226] Updated weights for policy 0, policy_version 1020388 (0.0009) [2023-12-28 02:35:30,071][106226] Updated weights for policy 0, policy_version 1020398 (0.0007) [2023-12-28 02:35:30,131][106226] Updated weights for policy 0, policy_version 1020408 (0.0009) [2023-12-28 02:35:30,521][106225] Updated weights for policy 1, policy_version 1023015 (0.0008) [2023-12-28 02:35:30,570][106225] Updated weights for policy 1, policy_version 1023025 (0.0007) [2023-12-28 02:35:30,627][106225] Updated weights for policy 1, policy_version 1023035 (0.0006) [2023-12-28 02:35:30,871][106226] Updated weights for policy 0, policy_version 1020418 (0.0009) [2023-12-28 02:35:30,931][106226] Updated weights for policy 0, policy_version 1020428 (0.0011) [2023-12-28 02:35:30,989][106226] Updated weights for policy 0, policy_version 1020438 (0.0010) [2023-12-28 02:35:31,057][106226] Updated weights for policy 0, policy_version 1020448 (0.0011) [2023-12-28 02:35:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 523231232. Throughput: 0: 9679.5, 1: 9898.2. Samples: 523220312. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:31,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.625')] [2023-12-28 02:35:31,357][106225] Updated weights for policy 1, policy_version 1023045 (0.0007) [2023-12-28 02:35:31,420][106225] Updated weights for policy 1, policy_version 1023055 (0.0008) [2023-12-28 02:35:31,464][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000008 [2023-12-28 02:35:31,766][106226] Updated weights for policy 0, policy_version 1020458 (0.0008) [2023-12-28 02:35:31,832][106226] Updated weights for policy 0, policy_version 1020468 (0.0008) [2023-12-28 02:35:31,898][106226] Updated weights for policy 0, policy_version 1020478 (0.0006) [2023-12-28 02:35:32,200][106225] Updated weights for policy 1, policy_version 1023065 (0.0008) [2023-12-28 02:35:32,256][106225] Updated weights for policy 1, policy_version 1023075 (0.0008) [2023-12-28 02:35:32,311][106225] Updated weights for policy 1, policy_version 1023085 (0.0008) [2023-12-28 02:35:32,374][106225] Updated weights for policy 1, policy_version 1023095 (0.0008) [2023-12-28 02:35:32,526][106226] Updated weights for policy 0, policy_version 1020488 (0.0008) [2023-12-28 02:35:32,576][106226] Updated weights for policy 0, policy_version 1020498 (0.0008) [2023-12-28 02:35:32,631][106226] Updated weights for policy 0, policy_version 1020508 (0.0009) [2023-12-28 02:35:33,154][106225] Updated weights for policy 1, policy_version 1023105 (0.0006) [2023-12-28 02:35:33,204][106225] Updated weights for policy 1, policy_version 1023115 (0.0005) [2023-12-28 02:35:33,256][106225] Updated weights for policy 1, policy_version 1023125 (0.0005) [2023-12-28 02:35:33,329][106226] Updated weights for policy 0, policy_version 1020518 (0.0009) [2023-12-28 02:35:33,377][106226] Updated weights for policy 0, policy_version 1020528 (0.0007) [2023-12-28 02:35:33,430][106226] Updated weights for policy 0, policy_version 1020538 (0.0008) [2023-12-28 02:35:33,941][106225] Updated weights for policy 1, policy_version 1023135 (0.0008) [2023-12-28 02:35:34,005][106225] Updated weights for policy 1, policy_version 1023145 (0.0007) [2023-12-28 02:35:34,030][106226] Updated weights for policy 0, policy_version 1020548 (0.0006) [2023-12-28 02:35:34,059][106225] Updated weights for policy 1, policy_version 1023155 (0.0006) [2023-12-28 02:35:34,094][106226] Updated weights for policy 0, policy_version 1020558 (0.0008) [2023-12-28 02:35:34,150][106226] Updated weights for policy 0, policy_version 1020568 (0.0008) [2023-12-28 02:35:34,793][106226] Updated weights for policy 0, policy_version 1020578 (0.0007) [2023-12-28 02:35:34,847][106225] Updated weights for policy 1, policy_version 1023165 (0.0007) [2023-12-28 02:35:34,849][106226] Updated weights for policy 0, policy_version 1020588 (0.0009) [2023-12-28 02:35:34,902][106225] Updated weights for policy 1, policy_version 1023175 (0.0006) [2023-12-28 02:35:34,908][106226] Updated weights for policy 0, policy_version 1020598 (0.0006) [2023-12-28 02:35:34,954][106225] Updated weights for policy 1, policy_version 1023185 (0.0006) [2023-12-28 02:35:34,960][106226] Updated weights for policy 0, policy_version 1020608 (0.0005) [2023-12-28 02:35:35,568][106225] Updated weights for policy 1, policy_version 1023195 (0.0007) [2023-12-28 02:35:35,626][106225] Updated weights for policy 1, policy_version 1023205 (0.0007) [2023-12-28 02:35:35,637][106226] Updated weights for policy 0, policy_version 1020618 (0.0006) [2023-12-28 02:35:35,682][106225] Updated weights for policy 1, policy_version 1023215 (0.0005) [2023-12-28 02:35:35,694][106226] Updated weights for policy 0, policy_version 1020628 (0.0008) [2023-12-28 02:35:35,760][106226] Updated weights for policy 0, policy_version 1020638 (0.0009) [2023-12-28 02:35:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 523329536. Throughput: 0: 9793.4, 1: 9851.2. Samples: 523338888. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:36,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.689')] [2023-12-28 02:35:36,249][106225] Updated weights for policy 1, policy_version 1023225 (0.0006) [2023-12-28 02:35:36,312][106225] Updated weights for policy 1, policy_version 1023235 (0.0008) [2023-12-28 02:35:36,379][106225] Updated weights for policy 1, policy_version 1023245 (0.0008) [2023-12-28 02:35:36,446][106225] Updated weights for policy 1, policy_version 1023255 (0.0008) [2023-12-28 02:35:36,576][106226] Updated weights for policy 0, policy_version 1020648 (0.0008) [2023-12-28 02:35:36,637][106226] Updated weights for policy 0, policy_version 1020658 (0.0009) [2023-12-28 02:35:36,704][106226] Updated weights for policy 0, policy_version 1020668 (0.0008) [2023-12-28 02:35:37,144][106225] Updated weights for policy 1, policy_version 1023265 (0.0006) [2023-12-28 02:35:37,201][106225] Updated weights for policy 1, policy_version 1023275 (0.0005) [2023-12-28 02:35:37,258][106225] Updated weights for policy 1, policy_version 1023285 (0.0006) [2023-12-28 02:35:37,488][106226] Updated weights for policy 0, policy_version 1020678 (0.0009) [2023-12-28 02:35:37,539][106226] Updated weights for policy 0, policy_version 1020688 (0.0008) [2023-12-28 02:35:37,596][106226] Updated weights for policy 0, policy_version 1020698 (0.0008) [2023-12-28 02:35:37,869][106225] Updated weights for policy 1, policy_version 1023295 (0.0007) [2023-12-28 02:35:37,925][106225] Updated weights for policy 1, policy_version 1023305 (0.0005) [2023-12-28 02:35:37,979][106225] Updated weights for policy 1, policy_version 1023315 (0.0005) [2023-12-28 02:35:38,351][106226] Updated weights for policy 0, policy_version 1020708 (0.0009) [2023-12-28 02:35:38,407][106226] Updated weights for policy 0, policy_version 1020718 (0.0007) [2023-12-28 02:35:38,463][106226] Updated weights for policy 0, policy_version 1020728 (0.0007) [2023-12-28 02:35:38,664][106225] Updated weights for policy 1, policy_version 1023325 (0.0010) [2023-12-28 02:35:38,726][106225] Updated weights for policy 1, policy_version 1023335 (0.0005) [2023-12-28 02:35:38,782][106225] Updated weights for policy 1, policy_version 1023345 (0.0006) [2023-12-28 02:35:39,222][106226] Updated weights for policy 0, policy_version 1020738 (0.0008) [2023-12-28 02:35:39,293][106226] Updated weights for policy 0, policy_version 1020748 (0.0009) [2023-12-28 02:35:39,353][106226] Updated weights for policy 0, policy_version 1020758 (0.0008) [2023-12-28 02:35:39,368][106225] Updated weights for policy 1, policy_version 1023355 (0.0008) [2023-12-28 02:35:39,427][106226] Updated weights for policy 0, policy_version 1020768 (0.0008) [2023-12-28 02:35:39,436][106225] Updated weights for policy 1, policy_version 1023365 (0.0007) [2023-12-28 02:35:39,503][106225] Updated weights for policy 1, policy_version 1023375 (0.0008) [2023-12-28 02:35:40,188][106225] Updated weights for policy 1, policy_version 1023385 (0.0006) [2023-12-28 02:35:40,231][106226] Updated weights for policy 0, policy_version 1020778 (0.0007) [2023-12-28 02:35:40,241][106225] Updated weights for policy 1, policy_version 1023395 (0.0006) [2023-12-28 02:35:40,294][106226] Updated weights for policy 0, policy_version 1020788 (0.0007) [2023-12-28 02:35:40,296][106225] Updated weights for policy 1, policy_version 1023405 (0.0006) [2023-12-28 02:35:40,355][106225] Updated weights for policy 1, policy_version 1023415 (0.0007) [2023-12-28 02:35:40,357][106226] Updated weights for policy 0, policy_version 1020798 (0.0007) [2023-12-28 02:35:41,068][106225] Updated weights for policy 1, policy_version 1023425 (0.0008) [2023-12-28 02:35:41,098][106226] Updated weights for policy 0, policy_version 1020808 (0.0007) [2023-12-28 02:35:41,132][106225] Updated weights for policy 1, policy_version 1023435 (0.0008) [2023-12-28 02:35:41,163][106226] Updated weights for policy 0, policy_version 1020818 (0.0009) [2023-12-28 02:35:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 523419648. Throughput: 0: 9768.7, 1: 9952.4. Samples: 523398604. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:41,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.851')] [2023-12-28 02:35:41,203][106225] Updated weights for policy 1, policy_version 1023445 (0.0008) [2023-12-28 02:35:41,219][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001023448_262045696.pth... [2023-12-28 02:35:41,223][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001022272_261742592.pth [2023-12-28 02:35:41,230][106226] Updated weights for policy 0, policy_version 1020828 (0.0007) [2023-12-28 02:35:41,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001020832_261390336.pth... [2023-12-28 02:35:41,258][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001019680_261095424.pth [2023-12-28 02:35:41,976][106226] Updated weights for policy 0, policy_version 1020838 (0.0008) [2023-12-28 02:35:42,010][106225] Updated weights for policy 1, policy_version 1023455 (0.0009) [2023-12-28 02:35:42,037][106226] Updated weights for policy 0, policy_version 1020848 (0.0006) [2023-12-28 02:35:42,071][106225] Updated weights for policy 1, policy_version 1023465 (0.0008) [2023-12-28 02:35:42,098][106226] Updated weights for policy 0, policy_version 1020858 (0.0006) [2023-12-28 02:35:42,126][106225] Updated weights for policy 1, policy_version 1023475 (0.0007) [2023-12-28 02:35:42,728][106226] Updated weights for policy 0, policy_version 1020868 (0.0008) [2023-12-28 02:35:42,786][106226] Updated weights for policy 0, policy_version 1020878 (0.0006) [2023-12-28 02:35:42,837][106226] Updated weights for policy 0, policy_version 1020888 (0.0005) [2023-12-28 02:35:42,915][106225] Updated weights for policy 1, policy_version 1023485 (0.0008) [2023-12-28 02:35:42,988][106225] Updated weights for policy 1, policy_version 1023495 (0.0009) [2023-12-28 02:35:43,060][106225] Updated weights for policy 1, policy_version 1023505 (0.0009) [2023-12-28 02:35:43,400][106226] Updated weights for policy 0, policy_version 1020898 (0.0007) [2023-12-28 02:35:43,455][106226] Updated weights for policy 0, policy_version 1020908 (0.0008) [2023-12-28 02:35:43,506][106226] Updated weights for policy 0, policy_version 1020919 (0.0009) [2023-12-28 02:35:43,669][106225] Updated weights for policy 1, policy_version 1023515 (0.0008) [2023-12-28 02:35:43,729][106225] Updated weights for policy 1, policy_version 1023525 (0.0005) [2023-12-28 02:35:43,792][106225] Updated weights for policy 1, policy_version 1023535 (0.0008) [2023-12-28 02:35:44,280][106226] Updated weights for policy 0, policy_version 1020929 (0.0009) [2023-12-28 02:35:44,339][106226] Updated weights for policy 0, policy_version 1020939 (0.0009) [2023-12-28 02:35:44,392][106226] Updated weights for policy 0, policy_version 1020949 (0.0008) [2023-12-28 02:35:44,436][106226] Updated weights for policy 0, policy_version 1020959 (0.0008) [2023-12-28 02:35:44,466][106225] Updated weights for policy 1, policy_version 1023545 (0.0008) [2023-12-28 02:35:44,514][106225] Updated weights for policy 1, policy_version 1023555 (0.0008) [2023-12-28 02:35:44,569][106225] Updated weights for policy 1, policy_version 1023565 (0.0008) [2023-12-28 02:35:44,613][106225] Updated weights for policy 1, policy_version 1023575 (0.0008) [2023-12-28 02:35:45,199][106226] Updated weights for policy 0, policy_version 1020969 (0.0009) [2023-12-28 02:35:45,265][106226] Updated weights for policy 0, policy_version 1020979 (0.0008) [2023-12-28 02:35:45,333][106226] Updated weights for policy 0, policy_version 1020989 (0.0009) [2023-12-28 02:35:45,376][106225] Updated weights for policy 1, policy_version 1023585 (0.0008) [2023-12-28 02:35:45,428][106225] Updated weights for policy 1, policy_version 1023595 (0.0008) [2023-12-28 02:35:45,476][106225] Updated weights for policy 1, policy_version 1023605 (0.0008) [2023-12-28 02:35:46,073][106226] Updated weights for policy 0, policy_version 1020999 (0.0009) [2023-12-28 02:35:46,143][106226] Updated weights for policy 0, policy_version 1021009 (0.0010) [2023-12-28 02:35:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 523517952. Throughput: 0: 9795.4, 1: 9927.2. Samples: 523514844. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:46,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-5.039')] [2023-12-28 02:35:46,194][106226] Updated weights for policy 0, policy_version 1021019 (0.0009) [2023-12-28 02:35:46,221][106225] Updated weights for policy 1, policy_version 1023615 (0.0008) [2023-12-28 02:35:46,282][106225] Updated weights for policy 1, policy_version 1023625 (0.0009) [2023-12-28 02:35:46,346][106225] Updated weights for policy 1, policy_version 1023635 (0.0009) [2023-12-28 02:35:46,960][106226] Updated weights for policy 0, policy_version 1021029 (0.0008) [2023-12-28 02:35:47,010][106226] Updated weights for policy 0, policy_version 1021039 (0.0009) [2023-12-28 02:35:47,024][106225] Updated weights for policy 1, policy_version 1023645 (0.0008) [2023-12-28 02:35:47,068][106226] Updated weights for policy 0, policy_version 1021049 (0.0008) [2023-12-28 02:35:47,081][106225] Updated weights for policy 1, policy_version 1023655 (0.0005) [2023-12-28 02:35:47,137][106225] Updated weights for policy 1, policy_version 1023665 (0.0007) [2023-12-28 02:35:47,805][106225] Updated weights for policy 1, policy_version 1023675 (0.0007) [2023-12-28 02:35:47,834][106226] Updated weights for policy 0, policy_version 1021059 (0.0007) [2023-12-28 02:35:47,871][106225] Updated weights for policy 1, policy_version 1023685 (0.0006) [2023-12-28 02:35:47,893][106226] Updated weights for policy 0, policy_version 1021069 (0.0008) [2023-12-28 02:35:47,934][106225] Updated weights for policy 1, policy_version 1023695 (0.0005) [2023-12-28 02:35:47,951][106226] Updated weights for policy 0, policy_version 1021079 (0.0008) [2023-12-28 02:35:48,542][106225] Updated weights for policy 1, policy_version 1023705 (0.0006) [2023-12-28 02:35:48,602][106225] Updated weights for policy 1, policy_version 1023715 (0.0008) [2023-12-28 02:35:48,664][106225] Updated weights for policy 1, policy_version 1023725 (0.0008) [2023-12-28 02:35:48,703][106226] Updated weights for policy 0, policy_version 1021089 (0.0007) [2023-12-28 02:35:48,727][106225] Updated weights for policy 1, policy_version 1023735 (0.0011) [2023-12-28 02:35:48,760][106226] Updated weights for policy 0, policy_version 1021099 (0.0009) [2023-12-28 02:35:48,823][106226] Updated weights for policy 0, policy_version 1021109 (0.0009) [2023-12-28 02:35:48,887][106226] Updated weights for policy 0, policy_version 1021119 (0.0008) [2023-12-28 02:35:49,434][106225] Updated weights for policy 1, policy_version 1023745 (0.0008) [2023-12-28 02:35:49,483][106225] Updated weights for policy 1, policy_version 1023755 (0.0009) [2023-12-28 02:35:49,539][106225] Updated weights for policy 1, policy_version 1023765 (0.0008) [2023-12-28 02:35:49,637][106226] Updated weights for policy 0, policy_version 1021129 (0.0006) [2023-12-28 02:35:49,695][106226] Updated weights for policy 0, policy_version 1021139 (0.0008) [2023-12-28 02:35:49,763][106226] Updated weights for policy 0, policy_version 1021149 (0.0009) [2023-12-28 02:35:50,334][106225] Updated weights for policy 1, policy_version 1023775 (0.0009) [2023-12-28 02:35:50,390][106225] Updated weights for policy 1, policy_version 1023785 (0.0006) [2023-12-28 02:35:50,397][106226] Updated weights for policy 0, policy_version 1021159 (0.0008) [2023-12-28 02:35:50,440][106225] Updated weights for policy 1, policy_version 1023795 (0.0007) [2023-12-28 02:35:50,447][106226] Updated weights for policy 0, policy_version 1021169 (0.0008) [2023-12-28 02:35:50,490][106226] Updated weights for policy 0, policy_version 1021179 (0.0008) [2023-12-28 02:35:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 523616256. Throughput: 0: 9778.6, 1: 9891.1. Samples: 523630620. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:51,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.974')] [2023-12-28 02:35:51,176][106226] Updated weights for policy 0, policy_version 1021189 (0.0007) [2023-12-28 02:35:51,233][106225] Updated weights for policy 1, policy_version 1023805 (0.0007) [2023-12-28 02:35:51,237][106226] Updated weights for policy 0, policy_version 1021199 (0.0006) [2023-12-28 02:35:51,299][106225] Updated weights for policy 1, policy_version 1023815 (0.0009) [2023-12-28 02:35:51,302][106226] Updated weights for policy 0, policy_version 1021209 (0.0008) [2023-12-28 02:35:51,354][106225] Updated weights for policy 1, policy_version 1023825 (0.0008) [2023-12-28 02:35:52,038][106225] Updated weights for policy 1, policy_version 1023835 (0.0008) [2023-12-28 02:35:52,062][106226] Updated weights for policy 0, policy_version 1021219 (0.0007) [2023-12-28 02:35:52,101][106225] Updated weights for policy 1, policy_version 1023845 (0.0009) [2023-12-28 02:35:52,126][106226] Updated weights for policy 0, policy_version 1021229 (0.0007) [2023-12-28 02:35:52,160][106225] Updated weights for policy 1, policy_version 1023855 (0.0007) [2023-12-28 02:35:52,180][106226] Updated weights for policy 0, policy_version 1021239 (0.0011) [2023-12-28 02:35:52,856][106226] Updated weights for policy 0, policy_version 1021249 (0.0007) [2023-12-28 02:35:52,926][106226] Updated weights for policy 0, policy_version 1021259 (0.0011) [2023-12-28 02:35:52,955][106225] Updated weights for policy 1, policy_version 1023865 (0.0009) [2023-12-28 02:35:52,979][106226] Updated weights for policy 0, policy_version 1021269 (0.0010) [2023-12-28 02:35:53,008][106225] Updated weights for policy 1, policy_version 1023875 (0.0005) [2023-12-28 02:35:53,032][106226] Updated weights for policy 0, policy_version 1021279 (0.0010) [2023-12-28 02:35:53,060][106225] Updated weights for policy 1, policy_version 1023885 (0.0005) [2023-12-28 02:35:53,116][106225] Updated weights for policy 1, policy_version 1023895 (0.0005) [2023-12-28 02:35:53,741][106226] Updated weights for policy 0, policy_version 1021289 (0.0011) [2023-12-28 02:35:53,768][106225] Updated weights for policy 1, policy_version 1023905 (0.0005) [2023-12-28 02:35:53,794][106226] Updated weights for policy 0, policy_version 1021299 (0.0010) [2023-12-28 02:35:53,821][106225] Updated weights for policy 1, policy_version 1023915 (0.0005) [2023-12-28 02:35:53,850][106226] Updated weights for policy 0, policy_version 1021309 (0.0010) [2023-12-28 02:35:53,870][106225] Updated weights for policy 1, policy_version 1023925 (0.0005) [2023-12-28 02:35:54,473][106226] Updated weights for policy 0, policy_version 1021319 (0.0007) [2023-12-28 02:35:54,528][106225] Updated weights for policy 1, policy_version 1023935 (0.0006) [2023-12-28 02:35:54,530][106226] Updated weights for policy 0, policy_version 1021329 (0.0007) [2023-12-28 02:35:54,577][106225] Updated weights for policy 1, policy_version 1023945 (0.0005) [2023-12-28 02:35:54,598][106226] Updated weights for policy 0, policy_version 1021339 (0.0010) [2023-12-28 02:35:54,629][106225] Updated weights for policy 1, policy_version 1023955 (0.0006) [2023-12-28 02:35:55,215][106226] Updated weights for policy 0, policy_version 1021349 (0.0010) [2023-12-28 02:35:55,278][106225] Updated weights for policy 1, policy_version 1023965 (0.0006) [2023-12-28 02:35:55,278][106226] Updated weights for policy 0, policy_version 1021359 (0.0010) [2023-12-28 02:35:55,326][106225] Updated weights for policy 1, policy_version 1023975 (0.0005) [2023-12-28 02:35:55,343][106226] Updated weights for policy 0, policy_version 1021369 (0.0009) [2023-12-28 02:35:55,385][106225] Updated weights for policy 1, policy_version 1023985 (0.0005) [2023-12-28 02:35:55,908][106226] Updated weights for policy 0, policy_version 1021379 (0.0005) [2023-12-28 02:35:55,915][106225] Updated weights for policy 1, policy_version 1023995 (0.0006) [2023-12-28 02:35:55,968][106226] Updated weights for policy 0, policy_version 1021389 (0.0005) [2023-12-28 02:35:55,973][106225] Updated weights for policy 1, policy_version 1024005 (0.0010) [2023-12-28 02:35:56,017][106226] Updated weights for policy 0, policy_version 1021399 (0.0006) [2023-12-28 02:35:56,035][106225] Updated weights for policy 1, policy_version 1024015 (0.0007) [2023-12-28 02:35:56,175][105115] Fps is (10 sec: 21298.6, 60 sec: 19797.2, 300 sec: 19716.3). Total num frames: 523730944. Throughput: 0: 9783.7, 1: 9871.3. Samples: 523689012. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:35:56,176][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.883')] [2023-12-28 02:35:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001021408_261537792.pth... [2023-12-28 02:35:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001024024_262193152.pth... [2023-12-28 02:35:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001020256_261242880.pth [2023-12-28 02:35:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001022848_261890048.pth [2023-12-28 02:35:56,564][106226] Updated weights for policy 0, policy_version 1021409 (0.0006) [2023-12-28 02:35:56,603][106225] Updated weights for policy 1, policy_version 1024025 (0.0005) [2023-12-28 02:35:56,622][106226] Updated weights for policy 0, policy_version 1021419 (0.0011) [2023-12-28 02:35:56,655][106225] Updated weights for policy 1, policy_version 1024035 (0.0005) [2023-12-28 02:35:56,680][106226] Updated weights for policy 0, policy_version 1021429 (0.0011) [2023-12-28 02:35:56,720][106225] Updated weights for policy 1, policy_version 1024045 (0.0006) [2023-12-28 02:35:56,737][106226] Updated weights for policy 0, policy_version 1021439 (0.0010) [2023-12-28 02:35:56,788][106225] Updated weights for policy 1, policy_version 1024055 (0.0005) [2023-12-28 02:35:57,366][106225] Updated weights for policy 1, policy_version 1024065 (0.0009) [2023-12-28 02:35:57,400][106226] Updated weights for policy 0, policy_version 1021449 (0.0006) [2023-12-28 02:35:57,419][106225] Updated weights for policy 1, policy_version 1024075 (0.0006) [2023-12-28 02:35:57,458][106226] Updated weights for policy 0, policy_version 1021459 (0.0005) [2023-12-28 02:35:57,475][106225] Updated weights for policy 1, policy_version 1024085 (0.0007) [2023-12-28 02:35:57,511][106226] Updated weights for policy 0, policy_version 1021469 (0.0005) [2023-12-28 02:35:58,080][106226] Updated weights for policy 0, policy_version 1021479 (0.0006) [2023-12-28 02:35:58,084][106225] Updated weights for policy 1, policy_version 1024095 (0.0008) [2023-12-28 02:35:58,131][106226] Updated weights for policy 0, policy_version 1021489 (0.0005) [2023-12-28 02:35:58,134][106225] Updated weights for policy 1, policy_version 1024106 (0.0008) [2023-12-28 02:35:58,177][106226] Updated weights for policy 0, policy_version 1021499 (0.0005) [2023-12-28 02:35:58,189][106225] Updated weights for policy 1, policy_version 1024116 (0.0008) [2023-12-28 02:35:58,952][106226] Updated weights for policy 0, policy_version 1021509 (0.0007) [2023-12-28 02:35:59,014][106226] Updated weights for policy 0, policy_version 1021519 (0.0008) [2023-12-28 02:35:59,024][106225] Updated weights for policy 1, policy_version 1024126 (0.0007) [2023-12-28 02:35:59,071][106225] Updated weights for policy 1, policy_version 1024136 (0.0006) [2023-12-28 02:35:59,076][106226] Updated weights for policy 0, policy_version 1021529 (0.0008) [2023-12-28 02:35:59,122][106225] Updated weights for policy 1, policy_version 1024146 (0.0007) [2023-12-28 02:35:59,835][106226] Updated weights for policy 0, policy_version 1021539 (0.0007) [2023-12-28 02:35:59,892][106226] Updated weights for policy 0, policy_version 1021549 (0.0009) [2023-12-28 02:35:59,929][106225] Updated weights for policy 1, policy_version 1024156 (0.0008) [2023-12-28 02:35:59,966][106226] Updated weights for policy 0, policy_version 1021559 (0.0008) [2023-12-28 02:35:59,989][106225] Updated weights for policy 1, policy_version 1024166 (0.0006) [2023-12-28 02:36:00,045][106225] Updated weights for policy 1, policy_version 1024176 (0.0007) [2023-12-28 02:36:00,642][106226] Updated weights for policy 0, policy_version 1021569 (0.0007) [2023-12-28 02:36:00,697][106226] Updated weights for policy 0, policy_version 1021579 (0.0008) [2023-12-28 02:36:00,754][106226] Updated weights for policy 0, policy_version 1021589 (0.0007) [2023-12-28 02:36:00,790][106225] Updated weights for policy 1, policy_version 1024186 (0.0009) [2023-12-28 02:36:00,809][106226] Updated weights for policy 0, policy_version 1021599 (0.0005) [2023-12-28 02:36:00,847][106225] Updated weights for policy 1, policy_version 1024196 (0.0009) [2023-12-28 02:36:00,898][106225] Updated weights for policy 1, policy_version 1024206 (0.0009) [2023-12-28 02:36:00,960][106225] Updated weights for policy 1, policy_version 1024216 (0.0008) [2023-12-28 02:36:01,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 523829248. Throughput: 0: 9894.7, 1: 9949.2. Samples: 523816680. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:01,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.695')] [2023-12-28 02:36:01,451][106226] Updated weights for policy 0, policy_version 1021609 (0.0009) [2023-12-28 02:36:01,513][106226] Updated weights for policy 0, policy_version 1021619 (0.0009) [2023-12-28 02:36:01,571][106226] Updated weights for policy 0, policy_version 1021629 (0.0008) [2023-12-28 02:36:01,697][106225] Updated weights for policy 1, policy_version 1024226 (0.0008) [2023-12-28 02:36:01,766][106225] Updated weights for policy 1, policy_version 1024236 (0.0009) [2023-12-28 02:36:01,827][106225] Updated weights for policy 1, policy_version 1024246 (0.0009) [2023-12-28 02:36:02,296][106226] Updated weights for policy 0, policy_version 1021639 (0.0008) [2023-12-28 02:36:02,357][106226] Updated weights for policy 0, policy_version 1021649 (0.0009) [2023-12-28 02:36:02,417][106226] Updated weights for policy 0, policy_version 1021659 (0.0007) [2023-12-28 02:36:02,538][106225] Updated weights for policy 1, policy_version 1024256 (0.0008) [2023-12-28 02:36:02,592][106225] Updated weights for policy 1, policy_version 1024266 (0.0009) [2023-12-28 02:36:02,649][106225] Updated weights for policy 1, policy_version 1024276 (0.0009) [2023-12-28 02:36:03,123][106226] Updated weights for policy 0, policy_version 1021669 (0.0008) [2023-12-28 02:36:03,182][106226] Updated weights for policy 0, policy_version 1021679 (0.0009) [2023-12-28 02:36:03,237][106226] Updated weights for policy 0, policy_version 1021689 (0.0008) [2023-12-28 02:36:03,342][106225] Updated weights for policy 1, policy_version 1024286 (0.0008) [2023-12-28 02:36:03,397][106225] Updated weights for policy 1, policy_version 1024296 (0.0008) [2023-12-28 02:36:03,449][106225] Updated weights for policy 1, policy_version 1024306 (0.0008) [2023-12-28 02:36:04,000][106226] Updated weights for policy 0, policy_version 1021699 (0.0008) [2023-12-28 02:36:04,068][106226] Updated weights for policy 0, policy_version 1021709 (0.0009) [2023-12-28 02:36:04,127][106226] Updated weights for policy 0, policy_version 1021719 (0.0009) [2023-12-28 02:36:04,176][106225] Updated weights for policy 1, policy_version 1024316 (0.0008) [2023-12-28 02:36:04,233][106225] Updated weights for policy 1, policy_version 1024326 (0.0008) [2023-12-28 02:36:04,289][106225] Updated weights for policy 1, policy_version 1024336 (0.0009) [2023-12-28 02:36:04,855][106226] Updated weights for policy 0, policy_version 1021729 (0.0008) [2023-12-28 02:36:04,914][106226] Updated weights for policy 0, policy_version 1021739 (0.0008) [2023-12-28 02:36:04,967][106226] Updated weights for policy 0, policy_version 1021749 (0.0008) [2023-12-28 02:36:05,015][106226] Updated weights for policy 0, policy_version 1021759 (0.0008) [2023-12-28 02:36:05,037][106225] Updated weights for policy 1, policy_version 1024346 (0.0009) [2023-12-28 02:36:05,092][106225] Updated weights for policy 1, policy_version 1024356 (0.0008) [2023-12-28 02:36:05,153][106225] Updated weights for policy 1, policy_version 1024366 (0.0008) [2023-12-28 02:36:05,211][106225] Updated weights for policy 1, policy_version 1024376 (0.0008) [2023-12-28 02:36:05,690][106226] Updated weights for policy 0, policy_version 1021769 (0.0007) [2023-12-28 02:36:05,748][106226] Updated weights for policy 0, policy_version 1021779 (0.0005) [2023-12-28 02:36:05,802][106226] Updated weights for policy 0, policy_version 1021789 (0.0008) [2023-12-28 02:36:06,004][106225] Updated weights for policy 1, policy_version 1024386 (0.0009) [2023-12-28 02:36:06,073][106225] Updated weights for policy 1, policy_version 1024396 (0.0009) [2023-12-28 02:36:06,142][106225] Updated weights for policy 1, policy_version 1024406 (0.0009) [2023-12-28 02:36:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 523927552. Throughput: 0: 9939.3, 1: 9874.3. Samples: 523934204. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:06,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.082')] [2023-12-28 02:36:06,399][106226] Updated weights for policy 0, policy_version 1021799 (0.0008) [2023-12-28 02:36:06,463][106226] Updated weights for policy 0, policy_version 1021809 (0.0007) [2023-12-28 02:36:06,528][106226] Updated weights for policy 0, policy_version 1021819 (0.0010) [2023-12-28 02:36:06,919][106225] Updated weights for policy 1, policy_version 1024416 (0.0010) [2023-12-28 02:36:06,983][106225] Updated weights for policy 1, policy_version 1024426 (0.0010) [2023-12-28 02:36:07,048][106225] Updated weights for policy 1, policy_version 1024436 (0.0011) [2023-12-28 02:36:07,198][106226] Updated weights for policy 0, policy_version 1021829 (0.0011) [2023-12-28 02:36:07,256][106226] Updated weights for policy 0, policy_version 1021839 (0.0011) [2023-12-28 02:36:07,304][106226] Updated weights for policy 0, policy_version 1021849 (0.0007) [2023-12-28 02:36:07,773][106225] Updated weights for policy 1, policy_version 1024446 (0.0009) [2023-12-28 02:36:07,835][106225] Updated weights for policy 1, policy_version 1024456 (0.0008) [2023-12-28 02:36:07,892][106225] Updated weights for policy 1, policy_version 1024466 (0.0008) [2023-12-28 02:36:07,993][106226] Updated weights for policy 0, policy_version 1021859 (0.0006) [2023-12-28 02:36:08,052][106226] Updated weights for policy 0, policy_version 1021869 (0.0005) [2023-12-28 02:36:08,110][106226] Updated weights for policy 0, policy_version 1021879 (0.0006) [2023-12-28 02:36:08,586][106225] Updated weights for policy 1, policy_version 1024476 (0.0008) [2023-12-28 02:36:08,640][106225] Updated weights for policy 1, policy_version 1024486 (0.0009) [2023-12-28 02:36:08,695][106225] Updated weights for policy 1, policy_version 1024496 (0.0010) [2023-12-28 02:36:08,826][106226] Updated weights for policy 0, policy_version 1021889 (0.0010) [2023-12-28 02:36:08,886][106226] Updated weights for policy 0, policy_version 1021899 (0.0008) [2023-12-28 02:36:08,943][106226] Updated weights for policy 0, policy_version 1021909 (0.0008) [2023-12-28 02:36:09,003][106226] Updated weights for policy 0, policy_version 1021919 (0.0008) [2023-12-28 02:36:09,461][106225] Updated weights for policy 1, policy_version 1024506 (0.0010) [2023-12-28 02:36:09,516][106225] Updated weights for policy 1, policy_version 1024516 (0.0010) [2023-12-28 02:36:09,574][106225] Updated weights for policy 1, policy_version 1024526 (0.0009) [2023-12-28 02:36:09,642][106225] Updated weights for policy 1, policy_version 1024536 (0.0008) [2023-12-28 02:36:09,773][106226] Updated weights for policy 0, policy_version 1021929 (0.0011) [2023-12-28 02:36:09,844][106226] Updated weights for policy 0, policy_version 1021939 (0.0011) [2023-12-28 02:36:09,910][106226] Updated weights for policy 0, policy_version 1021949 (0.0010) [2023-12-28 02:36:10,450][106225] Updated weights for policy 1, policy_version 1024546 (0.0011) [2023-12-28 02:36:10,503][106225] Updated weights for policy 1, policy_version 1024556 (0.0008) [2023-12-28 02:36:10,562][106225] Updated weights for policy 1, policy_version 1024566 (0.0005) [2023-12-28 02:36:10,608][106226] Updated weights for policy 0, policy_version 1021959 (0.0009) [2023-12-28 02:36:10,659][106226] Updated weights for policy 0, policy_version 1021969 (0.0010) [2023-12-28 02:36:10,709][106226] Updated weights for policy 0, policy_version 1021979 (0.0011) [2023-12-28 02:36:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 524017664. Throughput: 0: 9975.0, 1: 9883.8. Samples: 523991944. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:11,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.765')] [2023-12-28 02:36:11,176][106225] Updated weights for policy 1, policy_version 1024576 (0.0007) [2023-12-28 02:36:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001021984_261685248.pth... [2023-12-28 02:36:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001020832_261390336.pth [2023-12-28 02:36:11,239][106225] Updated weights for policy 1, policy_version 1024586 (0.0007) [2023-12-28 02:36:11,314][106225] Updated weights for policy 1, policy_version 1024596 (0.0009) [2023-12-28 02:36:11,339][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001024600_262340608.pth... [2023-12-28 02:36:11,344][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001023448_262045696.pth [2023-12-28 02:36:11,478][106226] Updated weights for policy 0, policy_version 1021989 (0.0010) [2023-12-28 02:36:11,542][106226] Updated weights for policy 0, policy_version 1021999 (0.0009) [2023-12-28 02:36:11,607][106226] Updated weights for policy 0, policy_version 1022009 (0.0009) [2023-12-28 02:36:12,049][106225] Updated weights for policy 1, policy_version 1024606 (0.0007) [2023-12-28 02:36:12,116][106225] Updated weights for policy 1, policy_version 1024616 (0.0005) [2023-12-28 02:36:12,181][106225] Updated weights for policy 1, policy_version 1024626 (0.0009) [2023-12-28 02:36:12,409][106226] Updated weights for policy 0, policy_version 1022019 (0.0009) [2023-12-28 02:36:12,473][106226] Updated weights for policy 0, policy_version 1022029 (0.0009) [2023-12-28 02:36:12,527][106226] Updated weights for policy 0, policy_version 1022039 (0.0008) [2023-12-28 02:36:12,891][106225] Updated weights for policy 1, policy_version 1024636 (0.0008) [2023-12-28 02:36:12,952][106225] Updated weights for policy 1, policy_version 1024646 (0.0009) [2023-12-28 02:36:13,013][106225] Updated weights for policy 1, policy_version 1024656 (0.0009) [2023-12-28 02:36:13,211][106226] Updated weights for policy 0, policy_version 1022049 (0.0009) [2023-12-28 02:36:13,269][106226] Updated weights for policy 0, policy_version 1022059 (0.0006) [2023-12-28 02:36:13,324][106226] Updated weights for policy 0, policy_version 1022069 (0.0005) [2023-12-28 02:36:13,380][106226] Updated weights for policy 0, policy_version 1022079 (0.0005) [2023-12-28 02:36:13,714][106225] Updated weights for policy 1, policy_version 1024666 (0.0009) [2023-12-28 02:36:13,767][106225] Updated weights for policy 1, policy_version 1024676 (0.0010) [2023-12-28 02:36:13,823][106225] Updated weights for policy 1, policy_version 1024686 (0.0008) [2023-12-28 02:36:13,881][106225] Updated weights for policy 1, policy_version 1024696 (0.0005) [2023-12-28 02:36:14,029][106226] Updated weights for policy 0, policy_version 1022089 (0.0010) [2023-12-28 02:36:14,079][106226] Updated weights for policy 0, policy_version 1022099 (0.0010) [2023-12-28 02:36:14,132][106226] Updated weights for policy 0, policy_version 1022109 (0.0010) [2023-12-28 02:36:14,512][106225] Updated weights for policy 1, policy_version 1024706 (0.0010) [2023-12-28 02:36:14,572][106225] Updated weights for policy 1, policy_version 1024716 (0.0010) [2023-12-28 02:36:14,635][106225] Updated weights for policy 1, policy_version 1024726 (0.0010) [2023-12-28 02:36:14,837][106226] Updated weights for policy 0, policy_version 1022119 (0.0009) [2023-12-28 02:36:14,894][106226] Updated weights for policy 0, policy_version 1022129 (0.0009) [2023-12-28 02:36:14,958][106226] Updated weights for policy 0, policy_version 1022139 (0.0008) [2023-12-28 02:36:15,331][106225] Updated weights for policy 1, policy_version 1024736 (0.0011) [2023-12-28 02:36:15,385][106225] Updated weights for policy 1, policy_version 1024746 (0.0010) [2023-12-28 02:36:15,438][106225] Updated weights for policy 1, policy_version 1024756 (0.0010) [2023-12-28 02:36:15,717][106226] Updated weights for policy 0, policy_version 1022149 (0.0007) [2023-12-28 02:36:15,769][106226] Updated weights for policy 0, policy_version 1022159 (0.0005) [2023-12-28 02:36:15,820][106226] Updated weights for policy 0, policy_version 1022169 (0.0005) [2023-12-28 02:36:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 524115968. Throughput: 0: 9861.1, 1: 9864.4. Samples: 524107956. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:16,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.098')] [2023-12-28 02:36:16,187][106225] Updated weights for policy 1, policy_version 1024766 (0.0011) [2023-12-28 02:36:16,249][106225] Updated weights for policy 1, policy_version 1024776 (0.0010) [2023-12-28 02:36:16,314][106225] Updated weights for policy 1, policy_version 1024786 (0.0010) [2023-12-28 02:36:16,372][106226] Updated weights for policy 0, policy_version 1022179 (0.0006) [2023-12-28 02:36:16,442][106226] Updated weights for policy 0, policy_version 1022189 (0.0006) [2023-12-28 02:36:16,511][106226] Updated weights for policy 0, policy_version 1022199 (0.0006) [2023-12-28 02:36:17,057][106225] Updated weights for policy 1, policy_version 1024796 (0.0009) [2023-12-28 02:36:17,074][106226] Updated weights for policy 0, policy_version 1022209 (0.0006) [2023-12-28 02:36:17,111][106225] Updated weights for policy 1, policy_version 1024806 (0.0005) [2023-12-28 02:36:17,124][106226] Updated weights for policy 0, policy_version 1022219 (0.0010) [2023-12-28 02:36:17,156][106225] Updated weights for policy 1, policy_version 1024816 (0.0005) [2023-12-28 02:36:17,181][106226] Updated weights for policy 0, policy_version 1022229 (0.0011) [2023-12-28 02:36:17,235][106226] Updated weights for policy 0, policy_version 1022239 (0.0010) [2023-12-28 02:36:17,821][106225] Updated weights for policy 1, policy_version 1024826 (0.0006) [2023-12-28 02:36:17,877][106225] Updated weights for policy 1, policy_version 1024836 (0.0009) [2023-12-28 02:36:17,925][106225] Updated weights for policy 1, policy_version 1024846 (0.0007) [2023-12-28 02:36:17,943][106226] Updated weights for policy 0, policy_version 1022249 (0.0008) [2023-12-28 02:36:17,979][106225] Updated weights for policy 1, policy_version 1024856 (0.0007) [2023-12-28 02:36:18,007][106226] Updated weights for policy 0, policy_version 1022259 (0.0008) [2023-12-28 02:36:18,076][106226] Updated weights for policy 0, policy_version 1022269 (0.0007) [2023-12-28 02:36:18,603][106225] Updated weights for policy 1, policy_version 1024866 (0.0009) [2023-12-28 02:36:18,675][106225] Updated weights for policy 1, policy_version 1024876 (0.0007) [2023-12-28 02:36:18,739][106225] Updated weights for policy 1, policy_version 1024886 (0.0007) [2023-12-28 02:36:18,758][106226] Updated weights for policy 0, policy_version 1022279 (0.0006) [2023-12-28 02:36:18,817][106226] Updated weights for policy 0, policy_version 1022289 (0.0008) [2023-12-28 02:36:18,879][106226] Updated weights for policy 0, policy_version 1022299 (0.0008) [2023-12-28 02:36:19,309][106225] Updated weights for policy 1, policy_version 1024896 (0.0008) [2023-12-28 02:36:19,382][106225] Updated weights for policy 1, policy_version 1024906 (0.0008) [2023-12-28 02:36:19,443][106225] Updated weights for policy 1, policy_version 1024916 (0.0007) [2023-12-28 02:36:19,656][106226] Updated weights for policy 0, policy_version 1022309 (0.0010) [2023-12-28 02:36:19,707][106226] Updated weights for policy 0, policy_version 1022319 (0.0008) [2023-12-28 02:36:19,773][106226] Updated weights for policy 0, policy_version 1022329 (0.0007) [2023-12-28 02:36:20,120][106225] Updated weights for policy 1, policy_version 1024926 (0.0009) [2023-12-28 02:36:20,186][106225] Updated weights for policy 1, policy_version 1024936 (0.0008) [2023-12-28 02:36:20,244][106225] Updated weights for policy 1, policy_version 1024946 (0.0009) [2023-12-28 02:36:20,438][106226] Updated weights for policy 0, policy_version 1022339 (0.0010) [2023-12-28 02:36:20,497][106226] Updated weights for policy 0, policy_version 1022349 (0.0009) [2023-12-28 02:36:20,553][106226] Updated weights for policy 0, policy_version 1022359 (0.0008) [2023-12-28 02:36:20,985][106225] Updated weights for policy 1, policy_version 1024956 (0.0009) [2023-12-28 02:36:21,056][106225] Updated weights for policy 1, policy_version 1024966 (0.0008) [2023-12-28 02:36:21,125][106225] Updated weights for policy 1, policy_version 1024976 (0.0006) [2023-12-28 02:36:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 524214272. Throughput: 0: 9865.5, 1: 9921.3. Samples: 524229296. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:21,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-4.850')] [2023-12-28 02:36:21,295][106226] Updated weights for policy 0, policy_version 1022369 (0.0008) [2023-12-28 02:36:21,361][106226] Updated weights for policy 0, policy_version 1022379 (0.0007) [2023-12-28 02:36:21,427][106226] Updated weights for policy 0, policy_version 1022389 (0.0007) [2023-12-28 02:36:21,489][106226] Updated weights for policy 0, policy_version 1022399 (0.0008) [2023-12-28 02:36:21,903][106225] Updated weights for policy 1, policy_version 1024986 (0.0008) [2023-12-28 02:36:21,965][106225] Updated weights for policy 1, policy_version 1024996 (0.0011) [2023-12-28 02:36:22,027][106225] Updated weights for policy 1, policy_version 1025006 (0.0010) [2023-12-28 02:36:22,096][106225] Updated weights for policy 1, policy_version 1025016 (0.0010) [2023-12-28 02:36:22,216][106226] Updated weights for policy 0, policy_version 1022409 (0.0010) [2023-12-28 02:36:22,282][106226] Updated weights for policy 0, policy_version 1022419 (0.0011) [2023-12-28 02:36:22,354][106226] Updated weights for policy 0, policy_version 1022429 (0.0011) [2023-12-28 02:36:22,812][106225] Updated weights for policy 1, policy_version 1025026 (0.0010) [2023-12-28 02:36:22,870][106225] Updated weights for policy 1, policy_version 1025036 (0.0009) [2023-12-28 02:36:22,941][106225] Updated weights for policy 1, policy_version 1025046 (0.0008) [2023-12-28 02:36:23,068][106226] Updated weights for policy 0, policy_version 1022439 (0.0010) [2023-12-28 02:36:23,131][106226] Updated weights for policy 0, policy_version 1022449 (0.0008) [2023-12-28 02:36:23,192][106226] Updated weights for policy 0, policy_version 1022459 (0.0008) [2023-12-28 02:36:23,651][106225] Updated weights for policy 1, policy_version 1025056 (0.0010) [2023-12-28 02:36:23,709][106225] Updated weights for policy 1, policy_version 1025066 (0.0010) [2023-12-28 02:36:23,768][106225] Updated weights for policy 1, policy_version 1025076 (0.0010) [2023-12-28 02:36:23,889][106226] Updated weights for policy 0, policy_version 1022469 (0.0007) [2023-12-28 02:36:23,950][106226] Updated weights for policy 0, policy_version 1022479 (0.0005) [2023-12-28 02:36:24,005][106226] Updated weights for policy 0, policy_version 1022489 (0.0005) [2023-12-28 02:36:24,408][106225] Updated weights for policy 1, policy_version 1025086 (0.0007) [2023-12-28 02:36:24,472][106225] Updated weights for policy 1, policy_version 1025096 (0.0005) [2023-12-28 02:36:24,528][106225] Updated weights for policy 1, policy_version 1025106 (0.0008) [2023-12-28 02:36:24,714][106226] Updated weights for policy 0, policy_version 1022499 (0.0007) [2023-12-28 02:36:24,768][106226] Updated weights for policy 0, policy_version 1022509 (0.0008) [2023-12-28 02:36:24,820][106226] Updated weights for policy 0, policy_version 1022519 (0.0009) [2023-12-28 02:36:25,061][106225] Updated weights for policy 1, policy_version 1025116 (0.0008) [2023-12-28 02:36:25,122][106225] Updated weights for policy 1, policy_version 1025126 (0.0008) [2023-12-28 02:36:25,182][106225] Updated weights for policy 1, policy_version 1025136 (0.0010) [2023-12-28 02:36:25,572][106226] Updated weights for policy 0, policy_version 1022529 (0.0010) [2023-12-28 02:36:25,620][106226] Updated weights for policy 0, policy_version 1022539 (0.0011) [2023-12-28 02:36:25,670][106226] Updated weights for policy 0, policy_version 1022549 (0.0009) [2023-12-28 02:36:25,707][106225] Updated weights for policy 1, policy_version 1025146 (0.0007) [2023-12-28 02:36:25,727][106226] Updated weights for policy 0, policy_version 1022559 (0.0007) [2023-12-28 02:36:25,763][106225] Updated weights for policy 1, policy_version 1025156 (0.0005) [2023-12-28 02:36:25,813][106225] Updated weights for policy 1, policy_version 1025166 (0.0009) [2023-12-28 02:36:25,872][106225] Updated weights for policy 1, policy_version 1025176 (0.0008) [2023-12-28 02:36:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 524320768. Throughput: 0: 9901.1, 1: 9832.5. Samples: 524286620. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:26,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.742')] [2023-12-28 02:36:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001022560_261832704.pth... [2023-12-28 02:36:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001025176_262488064.pth... [2023-12-28 02:36:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001021408_261537792.pth [2023-12-28 02:36:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001024024_262193152.pth [2023-12-28 02:36:26,436][106226] Updated weights for policy 0, policy_version 1022569 (0.0011) [2023-12-28 02:36:26,495][106225] Updated weights for policy 1, policy_version 1025186 (0.0010) [2023-12-28 02:36:26,496][106226] Updated weights for policy 0, policy_version 1022579 (0.0010) [2023-12-28 02:36:26,544][106225] Updated weights for policy 1, policy_version 1025196 (0.0010) [2023-12-28 02:36:26,552][106226] Updated weights for policy 0, policy_version 1022589 (0.0008) [2023-12-28 02:36:26,593][106225] Updated weights for policy 1, policy_version 1025206 (0.0010) [2023-12-28 02:36:27,196][106226] Updated weights for policy 0, policy_version 1022599 (0.0010) [2023-12-28 02:36:27,253][106226] Updated weights for policy 0, policy_version 1022609 (0.0010) [2023-12-28 02:36:27,318][106226] Updated weights for policy 0, policy_version 1022619 (0.0011) [2023-12-28 02:36:27,325][106225] Updated weights for policy 1, policy_version 1025216 (0.0006) [2023-12-28 02:36:27,388][106225] Updated weights for policy 1, policy_version 1025226 (0.0010) [2023-12-28 02:36:27,445][106225] Updated weights for policy 1, policy_version 1025236 (0.0009) [2023-12-28 02:36:28,029][106226] Updated weights for policy 0, policy_version 1022629 (0.0010) [2023-12-28 02:36:28,071][106225] Updated weights for policy 1, policy_version 1025246 (0.0005) [2023-12-28 02:36:28,079][106226] Updated weights for policy 0, policy_version 1022639 (0.0010) [2023-12-28 02:36:28,121][106225] Updated weights for policy 1, policy_version 1025256 (0.0009) [2023-12-28 02:36:28,136][106226] Updated weights for policy 0, policy_version 1022649 (0.0011) [2023-12-28 02:36:28,173][106225] Updated weights for policy 1, policy_version 1025266 (0.0006) [2023-12-28 02:36:28,851][106226] Updated weights for policy 0, policy_version 1022659 (0.0011) [2023-12-28 02:36:28,903][106226] Updated weights for policy 0, policy_version 1022669 (0.0010) [2023-12-28 02:36:28,918][106225] Updated weights for policy 1, policy_version 1025276 (0.0007) [2023-12-28 02:36:28,958][106226] Updated weights for policy 0, policy_version 1022679 (0.0011) [2023-12-28 02:36:28,975][106225] Updated weights for policy 1, policy_version 1025286 (0.0006) [2023-12-28 02:36:29,026][106225] Updated weights for policy 1, policy_version 1025296 (0.0007) [2023-12-28 02:36:29,637][106226] Updated weights for policy 0, policy_version 1022689 (0.0008) [2023-12-28 02:36:29,694][106226] Updated weights for policy 0, policy_version 1022699 (0.0010) [2023-12-28 02:36:29,745][106226] Updated weights for policy 0, policy_version 1022709 (0.0009) [2023-12-28 02:36:29,780][106225] Updated weights for policy 1, policy_version 1025306 (0.0007) [2023-12-28 02:36:29,797][106226] Updated weights for policy 0, policy_version 1022719 (0.0007) [2023-12-28 02:36:29,846][106225] Updated weights for policy 1, policy_version 1025316 (0.0009) [2023-12-28 02:36:29,907][106225] Updated weights for policy 1, policy_version 1025326 (0.0008) [2023-12-28 02:36:29,969][106225] Updated weights for policy 1, policy_version 1025336 (0.0009) [2023-12-28 02:36:30,591][106226] Updated weights for policy 0, policy_version 1022729 (0.0008) [2023-12-28 02:36:30,647][106226] Updated weights for policy 0, policy_version 1022739 (0.0009) [2023-12-28 02:36:30,685][106225] Updated weights for policy 1, policy_version 1025346 (0.0006) [2023-12-28 02:36:30,690][106226] Updated weights for policy 0, policy_version 1022749 (0.0008) [2023-12-28 02:36:30,733][106225] Updated weights for policy 1, policy_version 1025356 (0.0007) [2023-12-28 02:36:30,784][106225] Updated weights for policy 1, policy_version 1025366 (0.0008) [2023-12-28 02:36:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 524419072. Throughput: 0: 9922.2, 1: 9950.6. Samples: 524409124. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:31,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-5.019')] [2023-12-28 02:36:31,342][106226] Updated weights for policy 0, policy_version 1022759 (0.0008) [2023-12-28 02:36:31,396][106226] Updated weights for policy 0, policy_version 1022769 (0.0006) [2023-12-28 02:36:31,459][106226] Updated weights for policy 0, policy_version 1022779 (0.0007) [2023-12-28 02:36:31,576][106225] Updated weights for policy 1, policy_version 1025376 (0.0006) [2023-12-28 02:36:31,648][106225] Updated weights for policy 1, policy_version 1025386 (0.0008) [2023-12-28 02:36:31,711][106225] Updated weights for policy 1, policy_version 1025396 (0.0007) [2023-12-28 02:36:32,041][106226] Updated weights for policy 0, policy_version 1022789 (0.0006) [2023-12-28 02:36:32,094][106226] Updated weights for policy 0, policy_version 1022799 (0.0005) [2023-12-28 02:36:32,153][106226] Updated weights for policy 0, policy_version 1022809 (0.0005) [2023-12-28 02:36:32,486][106225] Updated weights for policy 1, policy_version 1025406 (0.0009) [2023-12-28 02:36:32,555][106225] Updated weights for policy 1, policy_version 1025416 (0.0009) [2023-12-28 02:36:32,615][106225] Updated weights for policy 1, policy_version 1025426 (0.0008) [2023-12-28 02:36:32,798][106226] Updated weights for policy 0, policy_version 1022819 (0.0006) [2023-12-28 02:36:32,847][106226] Updated weights for policy 0, policy_version 1022829 (0.0005) [2023-12-28 02:36:32,897][106226] Updated weights for policy 0, policy_version 1022839 (0.0005) [2023-12-28 02:36:33,419][106226] Updated weights for policy 0, policy_version 1022849 (0.0006) [2023-12-28 02:36:33,429][106225] Updated weights for policy 1, policy_version 1025436 (0.0008) [2023-12-28 02:36:33,475][106226] Updated weights for policy 0, policy_version 1022859 (0.0006) [2023-12-28 02:36:33,488][106225] Updated weights for policy 1, policy_version 1025446 (0.0008) [2023-12-28 02:36:33,529][106226] Updated weights for policy 0, policy_version 1022869 (0.0008) [2023-12-28 02:36:33,546][106225] Updated weights for policy 1, policy_version 1025456 (0.0008) [2023-12-28 02:36:33,579][106226] Updated weights for policy 0, policy_version 1022879 (0.0006) [2023-12-28 02:36:34,193][106225] Updated weights for policy 1, policy_version 1025466 (0.0007) [2023-12-28 02:36:34,204][106226] Updated weights for policy 0, policy_version 1022889 (0.0007) [2023-12-28 02:36:34,257][106225] Updated weights for policy 1, policy_version 1025476 (0.0006) [2023-12-28 02:36:34,269][106226] Updated weights for policy 0, policy_version 1022899 (0.0008) [2023-12-28 02:36:34,323][106225] Updated weights for policy 1, policy_version 1025486 (0.0008) [2023-12-28 02:36:34,336][106226] Updated weights for policy 0, policy_version 1022909 (0.0007) [2023-12-28 02:36:34,386][106225] Updated weights for policy 1, policy_version 1025496 (0.0006) [2023-12-28 02:36:35,018][106225] Updated weights for policy 1, policy_version 1025506 (0.0006) [2023-12-28 02:36:35,036][106226] Updated weights for policy 0, policy_version 1022919 (0.0008) [2023-12-28 02:36:35,068][106225] Updated weights for policy 1, policy_version 1025516 (0.0008) [2023-12-28 02:36:35,098][106226] Updated weights for policy 0, policy_version 1022929 (0.0008) [2023-12-28 02:36:35,114][106225] Updated weights for policy 1, policy_version 1025526 (0.0008) [2023-12-28 02:36:35,157][106226] Updated weights for policy 0, policy_version 1022939 (0.0007) [2023-12-28 02:36:35,770][106226] Updated weights for policy 0, policy_version 1022949 (0.0007) [2023-12-28 02:36:35,829][106226] Updated weights for policy 0, policy_version 1022959 (0.0009) [2023-12-28 02:36:35,886][106226] Updated weights for policy 0, policy_version 1022969 (0.0008) [2023-12-28 02:36:35,904][106225] Updated weights for policy 1, policy_version 1025536 (0.0008) [2023-12-28 02:36:35,959][106225] Updated weights for policy 1, policy_version 1025546 (0.0007) [2023-12-28 02:36:36,012][106225] Updated weights for policy 1, policy_version 1025556 (0.0008) [2023-12-28 02:36:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 524525568. Throughput: 0: 10084.3, 1: 9910.8. Samples: 524530396. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:36,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.841')] [2023-12-28 02:36:36,667][106225] Updated weights for policy 1, policy_version 1025566 (0.0008) [2023-12-28 02:36:36,687][106226] Updated weights for policy 0, policy_version 1022979 (0.0008) [2023-12-28 02:36:36,726][106225] Updated weights for policy 1, policy_version 1025576 (0.0006) [2023-12-28 02:36:36,748][106226] Updated weights for policy 0, policy_version 1022989 (0.0008) [2023-12-28 02:36:36,792][106225] Updated weights for policy 1, policy_version 1025586 (0.0005) [2023-12-28 02:36:36,805][106226] Updated weights for policy 0, policy_version 1022999 (0.0008) [2023-12-28 02:36:37,415][106225] Updated weights for policy 1, policy_version 1025596 (0.0005) [2023-12-28 02:36:37,429][106226] Updated weights for policy 0, policy_version 1023009 (0.0007) [2023-12-28 02:36:37,484][106225] Updated weights for policy 1, policy_version 1025606 (0.0006) [2023-12-28 02:36:37,490][106226] Updated weights for policy 0, policy_version 1023019 (0.0006) [2023-12-28 02:36:37,532][106225] Updated weights for policy 1, policy_version 1025616 (0.0005) [2023-12-28 02:36:37,546][106226] Updated weights for policy 0, policy_version 1023029 (0.0007) [2023-12-28 02:36:37,603][106226] Updated weights for policy 0, policy_version 1023039 (0.0007) [2023-12-28 02:36:38,161][106225] Updated weights for policy 1, policy_version 1025626 (0.0006) [2023-12-28 02:36:38,219][106225] Updated weights for policy 1, policy_version 1025636 (0.0006) [2023-12-28 02:36:38,280][106225] Updated weights for policy 1, policy_version 1025646 (0.0005) [2023-12-28 02:36:38,303][106226] Updated weights for policy 0, policy_version 1023049 (0.0007) [2023-12-28 02:36:38,347][106225] Updated weights for policy 1, policy_version 1025656 (0.0008) [2023-12-28 02:36:38,366][106226] Updated weights for policy 0, policy_version 1023059 (0.0008) [2023-12-28 02:36:38,425][106226] Updated weights for policy 0, policy_version 1023069 (0.0006) [2023-12-28 02:36:39,032][106225] Updated weights for policy 1, policy_version 1025666 (0.0009) [2023-12-28 02:36:39,095][106225] Updated weights for policy 1, policy_version 1025676 (0.0009) [2023-12-28 02:36:39,130][106226] Updated weights for policy 0, policy_version 1023079 (0.0006) [2023-12-28 02:36:39,149][106225] Updated weights for policy 1, policy_version 1025686 (0.0009) [2023-12-28 02:36:39,197][106226] Updated weights for policy 0, policy_version 1023089 (0.0006) [2023-12-28 02:36:39,262][106226] Updated weights for policy 0, policy_version 1023099 (0.0008) [2023-12-28 02:36:39,964][106225] Updated weights for policy 1, policy_version 1025696 (0.0008) [2023-12-28 02:36:39,978][106226] Updated weights for policy 0, policy_version 1023109 (0.0008) [2023-12-28 02:36:40,023][106225] Updated weights for policy 1, policy_version 1025706 (0.0006) [2023-12-28 02:36:40,043][106226] Updated weights for policy 0, policy_version 1023119 (0.0007) [2023-12-28 02:36:40,083][106225] Updated weights for policy 1, policy_version 1025716 (0.0010) [2023-12-28 02:36:40,102][106226] Updated weights for policy 0, policy_version 1023129 (0.0009) [2023-12-28 02:36:40,755][106225] Updated weights for policy 1, policy_version 1025726 (0.0007) [2023-12-28 02:36:40,792][106226] Updated weights for policy 0, policy_version 1023139 (0.0007) [2023-12-28 02:36:40,823][106225] Updated weights for policy 1, policy_version 1025736 (0.0007) [2023-12-28 02:36:40,850][106226] Updated weights for policy 0, policy_version 1023149 (0.0007) [2023-12-28 02:36:40,873][106225] Updated weights for policy 1, policy_version 1025746 (0.0006) [2023-12-28 02:36:40,904][106226] Updated weights for policy 0, policy_version 1023159 (0.0010) [2023-12-28 02:36:41,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 524623872. Throughput: 0: 10098.2, 1: 9963.3. Samples: 524591776. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:41,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.608')] [2023-12-28 02:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001025752_262635520.pth... [2023-12-28 02:36:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001023168_261988352.pth... [2023-12-28 02:36:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001021984_261685248.pth [2023-12-28 02:36:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001024600_262340608.pth [2023-12-28 02:36:41,588][106226] Updated weights for policy 0, policy_version 1023169 (0.0006) [2023-12-28 02:36:41,607][106225] Updated weights for policy 1, policy_version 1025756 (0.0007) [2023-12-28 02:36:41,658][106226] Updated weights for policy 0, policy_version 1023179 (0.0008) [2023-12-28 02:36:41,679][106225] Updated weights for policy 1, policy_version 1025766 (0.0013) [2023-12-28 02:36:41,718][106226] Updated weights for policy 0, policy_version 1023189 (0.0008) [2023-12-28 02:36:41,751][106225] Updated weights for policy 1, policy_version 1025776 (0.0010) [2023-12-28 02:36:41,782][106226] Updated weights for policy 0, policy_version 1023199 (0.0008) [2023-12-28 02:36:42,391][106225] Updated weights for policy 1, policy_version 1025786 (0.0010) [2023-12-28 02:36:42,457][106225] Updated weights for policy 1, policy_version 1025796 (0.0006) [2023-12-28 02:36:42,515][106225] Updated weights for policy 1, policy_version 1025806 (0.0006) [2023-12-28 02:36:42,567][106225] Updated weights for policy 1, policy_version 1025816 (0.0009) [2023-12-28 02:36:42,629][106226] Updated weights for policy 0, policy_version 1023209 (0.0007) [2023-12-28 02:36:42,689][106226] Updated weights for policy 0, policy_version 1023219 (0.0009) [2023-12-28 02:36:42,756][106226] Updated weights for policy 0, policy_version 1023229 (0.0009) [2023-12-28 02:36:43,203][106225] Updated weights for policy 1, policy_version 1025826 (0.0008) [2023-12-28 02:36:43,255][106225] Updated weights for policy 1, policy_version 1025836 (0.0009) [2023-12-28 02:36:43,309][106225] Updated weights for policy 1, policy_version 1025846 (0.0009) [2023-12-28 02:36:43,485][106226] Updated weights for policy 0, policy_version 1023239 (0.0008) [2023-12-28 02:36:43,542][106226] Updated weights for policy 0, policy_version 1023249 (0.0009) [2023-12-28 02:36:43,589][106226] Updated weights for policy 0, policy_version 1023259 (0.0008) [2023-12-28 02:36:44,092][106225] Updated weights for policy 1, policy_version 1025856 (0.0008) [2023-12-28 02:36:44,152][106225] Updated weights for policy 1, policy_version 1025866 (0.0008) [2023-12-28 02:36:44,204][106225] Updated weights for policy 1, policy_version 1025876 (0.0007) [2023-12-28 02:36:44,264][106226] Updated weights for policy 0, policy_version 1023269 (0.0010) [2023-12-28 02:36:44,310][106226] Updated weights for policy 0, policy_version 1023279 (0.0010) [2023-12-28 02:36:44,362][106226] Updated weights for policy 0, policy_version 1023289 (0.0010) [2023-12-28 02:36:45,014][106225] Updated weights for policy 1, policy_version 1025886 (0.0008) [2023-12-28 02:36:45,020][106226] Updated weights for policy 0, policy_version 1023299 (0.0010) [2023-12-28 02:36:45,076][106225] Updated weights for policy 1, policy_version 1025896 (0.0007) [2023-12-28 02:36:45,088][106226] Updated weights for policy 0, policy_version 1023309 (0.0008) [2023-12-28 02:36:45,137][106225] Updated weights for policy 1, policy_version 1025906 (0.0007) [2023-12-28 02:36:45,147][106226] Updated weights for policy 0, policy_version 1023319 (0.0008) [2023-12-28 02:36:45,859][106225] Updated weights for policy 1, policy_version 1025916 (0.0008) [2023-12-28 02:36:45,868][106226] Updated weights for policy 0, policy_version 1023329 (0.0008) [2023-12-28 02:36:45,916][106225] Updated weights for policy 1, policy_version 1025926 (0.0006) [2023-12-28 02:36:45,928][106226] Updated weights for policy 0, policy_version 1023339 (0.0010) [2023-12-28 02:36:45,970][106225] Updated weights for policy 1, policy_version 1025936 (0.0007) [2023-12-28 02:36:45,987][106226] Updated weights for policy 0, policy_version 1023349 (0.0010) [2023-12-28 02:36:46,047][106226] Updated weights for policy 0, policy_version 1023359 (0.0011) [2023-12-28 02:36:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 524722176. Throughput: 0: 9980.6, 1: 9829.0. Samples: 524708116. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:46,176][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.082')] [2023-12-28 02:36:46,722][106225] Updated weights for policy 1, policy_version 1025946 (0.0007) [2023-12-28 02:36:46,769][106226] Updated weights for policy 0, policy_version 1023369 (0.0011) [2023-12-28 02:36:46,775][106225] Updated weights for policy 1, policy_version 1025956 (0.0006) [2023-12-28 02:36:46,827][106226] Updated weights for policy 0, policy_version 1023379 (0.0011) [2023-12-28 02:36:46,841][106225] Updated weights for policy 1, policy_version 1025966 (0.0006) [2023-12-28 02:36:46,887][106226] Updated weights for policy 0, policy_version 1023389 (0.0011) [2023-12-28 02:36:46,905][106225] Updated weights for policy 1, policy_version 1025976 (0.0006) [2023-12-28 02:36:47,594][106226] Updated weights for policy 0, policy_version 1023399 (0.0010) [2023-12-28 02:36:47,630][106225] Updated weights for policy 1, policy_version 1025986 (0.0006) [2023-12-28 02:36:47,650][106226] Updated weights for policy 0, policy_version 1023409 (0.0010) [2023-12-28 02:36:47,686][106225] Updated weights for policy 1, policy_version 1025996 (0.0006) [2023-12-28 02:36:47,713][106226] Updated weights for policy 0, policy_version 1023419 (0.0010) [2023-12-28 02:36:47,746][106225] Updated weights for policy 1, policy_version 1026006 (0.0008) [2023-12-28 02:36:48,418][106226] Updated weights for policy 0, policy_version 1023429 (0.0010) [2023-12-28 02:36:48,463][106225] Updated weights for policy 1, policy_version 1026016 (0.0006) [2023-12-28 02:36:48,473][106226] Updated weights for policy 0, policy_version 1023439 (0.0011) [2023-12-28 02:36:48,512][106225] Updated weights for policy 1, policy_version 1026026 (0.0007) [2023-12-28 02:36:48,533][106226] Updated weights for policy 0, policy_version 1023449 (0.0010) [2023-12-28 02:36:48,559][106225] Updated weights for policy 1, policy_version 1026036 (0.0006) [2023-12-28 02:36:49,264][106226] Updated weights for policy 0, policy_version 1023459 (0.0010) [2023-12-28 02:36:49,294][106225] Updated weights for policy 1, policy_version 1026046 (0.0007) [2023-12-28 02:36:49,323][106226] Updated weights for policy 0, policy_version 1023469 (0.0008) [2023-12-28 02:36:49,360][106225] Updated weights for policy 1, policy_version 1026056 (0.0009) [2023-12-28 02:36:49,398][106226] Updated weights for policy 0, policy_version 1023479 (0.0009) [2023-12-28 02:36:49,428][106225] Updated weights for policy 1, policy_version 1026066 (0.0009) [2023-12-28 02:36:50,116][106226] Updated weights for policy 0, policy_version 1023489 (0.0007) [2023-12-28 02:36:50,176][106226] Updated weights for policy 0, policy_version 1023499 (0.0009) [2023-12-28 02:36:50,186][106225] Updated weights for policy 1, policy_version 1026076 (0.0007) [2023-12-28 02:36:50,235][106226] Updated weights for policy 0, policy_version 1023509 (0.0009) [2023-12-28 02:36:50,237][106225] Updated weights for policy 1, policy_version 1026086 (0.0009) [2023-12-28 02:36:50,291][106225] Updated weights for policy 1, policy_version 1026096 (0.0008) [2023-12-28 02:36:50,300][106226] Updated weights for policy 0, policy_version 1023519 (0.0008) [2023-12-28 02:36:50,972][106225] Updated weights for policy 1, policy_version 1026106 (0.0008) [2023-12-28 02:36:51,039][106225] Updated weights for policy 1, policy_version 1026116 (0.0012) [2023-12-28 02:36:51,081][106226] Updated weights for policy 0, policy_version 1023529 (0.0007) [2023-12-28 02:36:51,107][106225] Updated weights for policy 1, policy_version 1026126 (0.0009) [2023-12-28 02:36:51,146][106226] Updated weights for policy 0, policy_version 1023539 (0.0008) [2023-12-28 02:36:51,173][106225] Updated weights for policy 1, policy_version 1026136 (0.0009) [2023-12-28 02:36:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 524812288. Throughput: 0: 9908.7, 1: 9810.5. Samples: 524821568. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:51,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.891')] [2023-12-28 02:36:51,215][106226] Updated weights for policy 0, policy_version 1023549 (0.0009) [2023-12-28 02:36:51,886][106226] Updated weights for policy 0, policy_version 1023559 (0.0006) [2023-12-28 02:36:51,910][106225] Updated weights for policy 1, policy_version 1026146 (0.0006) [2023-12-28 02:36:51,946][106226] Updated weights for policy 0, policy_version 1023569 (0.0010) [2023-12-28 02:36:51,971][106225] Updated weights for policy 1, policy_version 1026156 (0.0010) [2023-12-28 02:36:52,005][106226] Updated weights for policy 0, policy_version 1023579 (0.0007) [2023-12-28 02:36:52,035][106225] Updated weights for policy 1, policy_version 1026166 (0.0010) [2023-12-28 02:36:52,603][106226] Updated weights for policy 0, policy_version 1023589 (0.0006) [2023-12-28 02:36:52,661][106226] Updated weights for policy 0, policy_version 1023599 (0.0011) [2023-12-28 02:36:52,722][106226] Updated weights for policy 0, policy_version 1023609 (0.0011) [2023-12-28 02:36:52,769][106225] Updated weights for policy 1, policy_version 1026176 (0.0006) [2023-12-28 02:36:52,825][106225] Updated weights for policy 1, policy_version 1026186 (0.0005) [2023-12-28 02:36:52,884][106225] Updated weights for policy 1, policy_version 1026196 (0.0005) [2023-12-28 02:36:53,342][106226] Updated weights for policy 0, policy_version 1023619 (0.0007) [2023-12-28 02:36:53,402][106226] Updated weights for policy 0, policy_version 1023629 (0.0005) [2023-12-28 02:36:53,463][106226] Updated weights for policy 0, policy_version 1023639 (0.0005) [2023-12-28 02:36:53,489][106225] Updated weights for policy 1, policy_version 1026206 (0.0006) [2023-12-28 02:36:53,548][106225] Updated weights for policy 1, policy_version 1026216 (0.0007) [2023-12-28 02:36:53,599][106225] Updated weights for policy 1, policy_version 1026226 (0.0010) [2023-12-28 02:36:53,982][106226] Updated weights for policy 0, policy_version 1023649 (0.0010) [2023-12-28 02:36:54,038][106226] Updated weights for policy 0, policy_version 1023659 (0.0010) [2023-12-28 02:36:54,086][106226] Updated weights for policy 0, policy_version 1023669 (0.0010) [2023-12-28 02:36:54,139][106226] Updated weights for policy 0, policy_version 1023679 (0.0006) [2023-12-28 02:36:54,163][106225] Updated weights for policy 1, policy_version 1026236 (0.0008) [2023-12-28 02:36:54,234][106225] Updated weights for policy 1, policy_version 1026246 (0.0007) [2023-12-28 02:36:54,284][106225] Updated weights for policy 1, policy_version 1026256 (0.0010) [2023-12-28 02:36:54,740][106226] Updated weights for policy 0, policy_version 1023689 (0.0008) [2023-12-28 02:36:54,798][106226] Updated weights for policy 0, policy_version 1023699 (0.0008) [2023-12-28 02:36:54,857][106226] Updated weights for policy 0, policy_version 1023709 (0.0006) [2023-12-28 02:36:54,981][106225] Updated weights for policy 1, policy_version 1026266 (0.0010) [2023-12-28 02:36:55,051][106225] Updated weights for policy 1, policy_version 1026276 (0.0010) [2023-12-28 02:36:55,101][106225] Updated weights for policy 1, policy_version 1026286 (0.0010) [2023-12-28 02:36:55,161][106225] Updated weights for policy 1, policy_version 1026296 (0.0011) [2023-12-28 02:36:55,495][106226] Updated weights for policy 0, policy_version 1023719 (0.0007) [2023-12-28 02:36:55,545][106226] Updated weights for policy 0, policy_version 1023729 (0.0007) [2023-12-28 02:36:55,597][106226] Updated weights for policy 0, policy_version 1023739 (0.0005) [2023-12-28 02:36:55,884][106225] Updated weights for policy 1, policy_version 1026306 (0.0010) [2023-12-28 02:36:55,946][106225] Updated weights for policy 1, policy_version 1026316 (0.0010) [2023-12-28 02:36:56,009][106225] Updated weights for policy 1, policy_version 1026326 (0.0010) [2023-12-28 02:36:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 524918784. Throughput: 0: 9985.0, 1: 9856.1. Samples: 524884800. Policy #0 lag: (min: 26.0, avg: 42.9, max: 58.0) [2023-12-28 02:36:56,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-4.876')] [2023-12-28 02:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001026328_262782976.pth... [2023-12-28 02:36:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001023744_262135808.pth... [2023-12-28 02:36:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001025176_262488064.pth [2023-12-28 02:36:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001022560_261832704.pth [2023-12-28 02:36:56,253][106226] Updated weights for policy 0, policy_version 1023749 (0.0005) [2023-12-28 02:36:56,314][106226] Updated weights for policy 0, policy_version 1023759 (0.0005) [2023-12-28 02:36:56,370][106226] Updated weights for policy 0, policy_version 1023769 (0.0005) [2023-12-28 02:36:56,677][106225] Updated weights for policy 1, policy_version 1026336 (0.0010) [2023-12-28 02:36:56,731][106225] Updated weights for policy 1, policy_version 1026346 (0.0010) [2023-12-28 02:36:56,793][106225] Updated weights for policy 1, policy_version 1026356 (0.0010) [2023-12-28 02:36:56,953][106226] Updated weights for policy 0, policy_version 1023779 (0.0007) [2023-12-28 02:36:57,002][106226] Updated weights for policy 0, policy_version 1023789 (0.0010) [2023-12-28 02:36:57,058][106226] Updated weights for policy 0, policy_version 1023799 (0.0010) [2023-12-28 02:36:57,504][106225] Updated weights for policy 1, policy_version 1026366 (0.0010) [2023-12-28 02:36:57,560][106225] Updated weights for policy 1, policy_version 1026376 (0.0010) [2023-12-28 02:36:57,620][106225] Updated weights for policy 1, policy_version 1026386 (0.0010) [2023-12-28 02:36:57,771][106226] Updated weights for policy 0, policy_version 1023809 (0.0010) [2023-12-28 02:36:57,827][106226] Updated weights for policy 0, policy_version 1023819 (0.0010) [2023-12-28 02:36:57,878][106226] Updated weights for policy 0, policy_version 1023829 (0.0010) [2023-12-28 02:36:57,937][106226] Updated weights for policy 0, policy_version 1023839 (0.0010) [2023-12-28 02:36:58,346][106225] Updated weights for policy 1, policy_version 1026396 (0.0009) [2023-12-28 02:36:58,411][106225] Updated weights for policy 1, policy_version 1026406 (0.0008) [2023-12-28 02:36:58,479][106225] Updated weights for policy 1, policy_version 1026416 (0.0007) [2023-12-28 02:36:58,683][106226] Updated weights for policy 0, policy_version 1023849 (0.0010) [2023-12-28 02:36:58,748][106226] Updated weights for policy 0, policy_version 1023859 (0.0011) [2023-12-28 02:36:58,810][106226] Updated weights for policy 0, policy_version 1023869 (0.0009) [2023-12-28 02:36:59,293][106225] Updated weights for policy 1, policy_version 1026426 (0.0008) [2023-12-28 02:36:59,360][106225] Updated weights for policy 1, policy_version 1026437 (0.0008) [2023-12-28 02:36:59,425][106225] Updated weights for policy 1, policy_version 1026447 (0.0008) [2023-12-28 02:36:59,620][106226] Updated weights for policy 0, policy_version 1023879 (0.0007) [2023-12-28 02:36:59,692][106226] Updated weights for policy 0, policy_version 1023889 (0.0007) [2023-12-28 02:36:59,759][106226] Updated weights for policy 0, policy_version 1023899 (0.0007) [2023-12-28 02:37:00,189][106225] Updated weights for policy 1, policy_version 1026457 (0.0008) [2023-12-28 02:37:00,249][106225] Updated weights for policy 1, policy_version 1026467 (0.0010) [2023-12-28 02:37:00,313][106225] Updated weights for policy 1, policy_version 1026477 (0.0010) [2023-12-28 02:37:00,374][106225] Updated weights for policy 1, policy_version 1026487 (0.0010) [2023-12-28 02:37:00,458][106226] Updated weights for policy 0, policy_version 1023909 (0.0008) [2023-12-28 02:37:00,514][106226] Updated weights for policy 0, policy_version 1023919 (0.0006) [2023-12-28 02:37:00,566][106226] Updated weights for policy 0, policy_version 1023929 (0.0006) [2023-12-28 02:37:01,017][106225] Updated weights for policy 1, policy_version 1026497 (0.0007) [2023-12-28 02:37:01,081][106225] Updated weights for policy 1, policy_version 1026507 (0.0010) [2023-12-28 02:37:01,149][106225] Updated weights for policy 1, policy_version 1026517 (0.0008) [2023-12-28 02:37:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 525017088. Throughput: 0: 10071.4, 1: 9857.7. Samples: 525004764. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:01,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.069')] [2023-12-28 02:37:01,201][106226] Updated weights for policy 0, policy_version 1023939 (0.0008) [2023-12-28 02:37:01,262][106226] Updated weights for policy 0, policy_version 1023949 (0.0011) [2023-12-28 02:37:01,318][106226] Updated weights for policy 0, policy_version 1023959 (0.0011) [2023-12-28 02:37:01,805][106225] Updated weights for policy 1, policy_version 1026527 (0.0009) [2023-12-28 02:37:01,864][106225] Updated weights for policy 1, policy_version 1026537 (0.0010) [2023-12-28 02:37:01,917][106225] Updated weights for policy 1, policy_version 1026547 (0.0010) [2023-12-28 02:37:02,027][106226] Updated weights for policy 0, policy_version 1023969 (0.0010) [2023-12-28 02:37:02,088][106226] Updated weights for policy 0, policy_version 1023979 (0.0009) [2023-12-28 02:37:02,147][106226] Updated weights for policy 0, policy_version 1023989 (0.0008) [2023-12-28 02:37:02,211][106226] Updated weights for policy 0, policy_version 1023999 (0.0006) [2023-12-28 02:37:02,627][106225] Updated weights for policy 1, policy_version 1026557 (0.0010) [2023-12-28 02:37:02,684][106225] Updated weights for policy 1, policy_version 1026567 (0.0005) [2023-12-28 02:37:02,744][106225] Updated weights for policy 1, policy_version 1026577 (0.0009) [2023-12-28 02:37:02,826][106226] Updated weights for policy 0, policy_version 1024009 (0.0007) [2023-12-28 02:37:02,877][106226] Updated weights for policy 0, policy_version 1024019 (0.0008) [2023-12-28 02:37:02,934][106226] Updated weights for policy 0, policy_version 1024029 (0.0008) [2023-12-28 02:37:03,417][106225] Updated weights for policy 1, policy_version 1026587 (0.0010) [2023-12-28 02:37:03,472][106225] Updated weights for policy 1, policy_version 1026597 (0.0010) [2023-12-28 02:37:03,518][106225] Updated weights for policy 1, policy_version 1026607 (0.0010) [2023-12-28 02:37:03,682][106226] Updated weights for policy 0, policy_version 1024039 (0.0008) [2023-12-28 02:37:03,735][106226] Updated weights for policy 0, policy_version 1024049 (0.0007) [2023-12-28 02:37:03,788][106226] Updated weights for policy 0, policy_version 1024059 (0.0007) [2023-12-28 02:37:04,237][106225] Updated weights for policy 1, policy_version 1026617 (0.0010) [2023-12-28 02:37:04,301][106225] Updated weights for policy 1, policy_version 1026627 (0.0011) [2023-12-28 02:37:04,355][106225] Updated weights for policy 1, policy_version 1026637 (0.0010) [2023-12-28 02:37:04,409][106225] Updated weights for policy 1, policy_version 1026647 (0.0010) [2023-12-28 02:37:04,559][106226] Updated weights for policy 0, policy_version 1024069 (0.0007) [2023-12-28 02:37:04,621][106226] Updated weights for policy 0, policy_version 1024079 (0.0006) [2023-12-28 02:37:04,673][106226] Updated weights for policy 0, policy_version 1024089 (0.0008) [2023-12-28 02:37:05,127][106225] Updated weights for policy 1, policy_version 1026657 (0.0012) [2023-12-28 02:37:05,181][106225] Updated weights for policy 1, policy_version 1026667 (0.0010) [2023-12-28 02:37:05,242][106225] Updated weights for policy 1, policy_version 1026677 (0.0011) [2023-12-28 02:37:05,409][106226] Updated weights for policy 0, policy_version 1024099 (0.0008) [2023-12-28 02:37:05,466][106226] Updated weights for policy 0, policy_version 1024109 (0.0008) [2023-12-28 02:37:05,538][106226] Updated weights for policy 0, policy_version 1024119 (0.0008) [2023-12-28 02:37:05,978][106225] Updated weights for policy 1, policy_version 1026687 (0.0011) [2023-12-28 02:37:06,041][106225] Updated weights for policy 1, policy_version 1026697 (0.0011) [2023-12-28 02:37:06,092][106225] Updated weights for policy 1, policy_version 1026707 (0.0010) [2023-12-28 02:37:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 525115392. Throughput: 0: 10024.1, 1: 9835.2. Samples: 525122964. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:06,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.012')] [2023-12-28 02:37:06,277][106226] Updated weights for policy 0, policy_version 1024129 (0.0008) [2023-12-28 02:37:06,341][106226] Updated weights for policy 0, policy_version 1024139 (0.0008) [2023-12-28 02:37:06,406][106226] Updated weights for policy 0, policy_version 1024149 (0.0009) [2023-12-28 02:37:06,475][106226] Updated weights for policy 0, policy_version 1024159 (0.0011) [2023-12-28 02:37:06,814][106225] Updated weights for policy 1, policy_version 1026717 (0.0007) [2023-12-28 02:37:06,875][106225] Updated weights for policy 1, policy_version 1026727 (0.0005) [2023-12-28 02:37:06,937][106225] Updated weights for policy 1, policy_version 1026737 (0.0005) [2023-12-28 02:37:07,178][106226] Updated weights for policy 0, policy_version 1024169 (0.0006) [2023-12-28 02:37:07,238][106226] Updated weights for policy 0, policy_version 1024179 (0.0005) [2023-12-28 02:37:07,299][106226] Updated weights for policy 0, policy_version 1024189 (0.0005) [2023-12-28 02:37:07,606][106225] Updated weights for policy 1, policy_version 1026747 (0.0006) [2023-12-28 02:37:07,659][106225] Updated weights for policy 1, policy_version 1026757 (0.0007) [2023-12-28 02:37:07,718][106225] Updated weights for policy 1, policy_version 1026767 (0.0008) [2023-12-28 02:37:07,910][106226] Updated weights for policy 0, policy_version 1024199 (0.0009) [2023-12-28 02:37:07,977][106226] Updated weights for policy 0, policy_version 1024209 (0.0011) [2023-12-28 02:37:08,039][106226] Updated weights for policy 0, policy_version 1024219 (0.0010) [2023-12-28 02:37:08,379][106225] Updated weights for policy 1, policy_version 1026777 (0.0008) [2023-12-28 02:37:08,435][106225] Updated weights for policy 1, policy_version 1026787 (0.0009) [2023-12-28 02:37:08,497][106225] Updated weights for policy 1, policy_version 1026797 (0.0008) [2023-12-28 02:37:08,551][106225] Updated weights for policy 1, policy_version 1026807 (0.0008) [2023-12-28 02:37:08,684][106226] Updated weights for policy 0, policy_version 1024229 (0.0006) [2023-12-28 02:37:08,742][106226] Updated weights for policy 0, policy_version 1024239 (0.0006) [2023-12-28 02:37:08,797][106226] Updated weights for policy 0, policy_version 1024249 (0.0010) [2023-12-28 02:37:09,204][106225] Updated weights for policy 1, policy_version 1026817 (0.0006) [2023-12-28 02:37:09,269][106225] Updated weights for policy 1, policy_version 1026827 (0.0007) [2023-12-28 02:37:09,336][106225] Updated weights for policy 1, policy_version 1026837 (0.0006) [2023-12-28 02:37:09,490][106226] Updated weights for policy 0, policy_version 1024259 (0.0011) [2023-12-28 02:37:09,555][106226] Updated weights for policy 0, policy_version 1024269 (0.0011) [2023-12-28 02:37:09,623][106226] Updated weights for policy 0, policy_version 1024279 (0.0011) [2023-12-28 02:37:09,997][106225] Updated weights for policy 1, policy_version 1026847 (0.0010) [2023-12-28 02:37:10,068][106225] Updated weights for policy 1, policy_version 1026857 (0.0010) [2023-12-28 02:37:10,135][106225] Updated weights for policy 1, policy_version 1026867 (0.0010) [2023-12-28 02:37:10,318][106226] Updated weights for policy 0, policy_version 1024289 (0.0008) [2023-12-28 02:37:10,383][106226] Updated weights for policy 0, policy_version 1024299 (0.0011) [2023-12-28 02:37:10,443][106226] Updated weights for policy 0, policy_version 1024309 (0.0010) [2023-12-28 02:37:10,497][106226] Updated weights for policy 0, policy_version 1024319 (0.0010) [2023-12-28 02:37:10,813][106225] Updated weights for policy 1, policy_version 1026877 (0.0009) [2023-12-28 02:37:10,873][106225] Updated weights for policy 1, policy_version 1026887 (0.0008) [2023-12-28 02:37:10,932][106225] Updated weights for policy 1, policy_version 1026897 (0.0009) [2023-12-28 02:37:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 525213696. Throughput: 0: 10054.9, 1: 9873.7. Samples: 525183408. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:11,175][105115] Avg episode reward: [(0, '-4.781'), (1, '-4.988')] [2023-12-28 02:37:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001026904_262930432.pth... [2023-12-28 02:37:11,184][106226] Updated weights for policy 0, policy_version 1024329 (0.0010) [2023-12-28 02:37:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001025752_262635520.pth [2023-12-28 02:37:11,244][106226] Updated weights for policy 0, policy_version 1024339 (0.0011) [2023-12-28 02:37:11,310][106226] Updated weights for policy 0, policy_version 1024349 (0.0009) [2023-12-28 02:37:11,326][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001024352_262291456.pth... [2023-12-28 02:37:11,329][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001023168_261988352.pth [2023-12-28 02:37:11,812][106225] Updated weights for policy 1, policy_version 1026907 (0.0008) [2023-12-28 02:37:11,868][106225] Updated weights for policy 1, policy_version 1026917 (0.0010) [2023-12-28 02:37:11,927][106225] Updated weights for policy 1, policy_version 1026927 (0.0008) [2023-12-28 02:37:12,114][106226] Updated weights for policy 0, policy_version 1024359 (0.0008) [2023-12-28 02:37:12,176][106226] Updated weights for policy 0, policy_version 1024369 (0.0006) [2023-12-28 02:37:12,240][106226] Updated weights for policy 0, policy_version 1024379 (0.0007) [2023-12-28 02:37:12,730][106225] Updated weights for policy 1, policy_version 1026937 (0.0008) [2023-12-28 02:37:12,791][106225] Updated weights for policy 1, policy_version 1026947 (0.0009) [2023-12-28 02:37:12,853][106225] Updated weights for policy 1, policy_version 1026957 (0.0007) [2023-12-28 02:37:12,879][106226] Updated weights for policy 0, policy_version 1024389 (0.0007) [2023-12-28 02:37:12,918][106225] Updated weights for policy 1, policy_version 1026967 (0.0008) [2023-12-28 02:37:12,938][106226] Updated weights for policy 0, policy_version 1024399 (0.0005) [2023-12-28 02:37:12,988][106226] Updated weights for policy 0, policy_version 1024409 (0.0005) [2023-12-28 02:37:13,577][106226] Updated weights for policy 0, policy_version 1024419 (0.0007) [2023-12-28 02:37:13,584][106225] Updated weights for policy 1, policy_version 1026977 (0.0006) [2023-12-28 02:37:13,632][106226] Updated weights for policy 0, policy_version 1024429 (0.0011) [2023-12-28 02:37:13,648][106225] Updated weights for policy 1, policy_version 1026987 (0.0005) [2023-12-28 02:37:13,682][106226] Updated weights for policy 0, policy_version 1024439 (0.0010) [2023-12-28 02:37:13,704][106225] Updated weights for policy 1, policy_version 1026997 (0.0005) [2023-12-28 02:37:14,290][106225] Updated weights for policy 1, policy_version 1027007 (0.0007) [2023-12-28 02:37:14,336][106225] Updated weights for policy 1, policy_version 1027017 (0.0007) [2023-12-28 02:37:14,386][106225] Updated weights for policy 1, policy_version 1027027 (0.0008) [2023-12-28 02:37:14,442][106226] Updated weights for policy 0, policy_version 1024449 (0.0011) [2023-12-28 02:37:14,498][106226] Updated weights for policy 0, policy_version 1024459 (0.0010) [2023-12-28 02:37:14,551][106226] Updated weights for policy 0, policy_version 1024469 (0.0010) [2023-12-28 02:37:14,602][106226] Updated weights for policy 0, policy_version 1024479 (0.0006) [2023-12-28 02:37:15,108][106225] Updated weights for policy 1, policy_version 1027037 (0.0008) [2023-12-28 02:37:15,173][106225] Updated weights for policy 1, policy_version 1027047 (0.0008) [2023-12-28 02:37:15,235][106225] Updated weights for policy 1, policy_version 1027057 (0.0010) [2023-12-28 02:37:15,392][106226] Updated weights for policy 0, policy_version 1024489 (0.0010) [2023-12-28 02:37:15,455][106226] Updated weights for policy 0, policy_version 1024499 (0.0011) [2023-12-28 02:37:15,522][106226] Updated weights for policy 0, policy_version 1024509 (0.0011) [2023-12-28 02:37:15,920][106225] Updated weights for policy 1, policy_version 1027067 (0.0011) [2023-12-28 02:37:15,976][106225] Updated weights for policy 1, policy_version 1027077 (0.0010) [2023-12-28 02:37:16,031][106225] Updated weights for policy 1, policy_version 1027087 (0.0007) [2023-12-28 02:37:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 525312000. Throughput: 0: 10060.5, 1: 9769.8. Samples: 525301488. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:16,176][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.759')] [2023-12-28 02:37:16,249][106226] Updated weights for policy 0, policy_version 1024519 (0.0007) [2023-12-28 02:37:16,298][106226] Updated weights for policy 0, policy_version 1024529 (0.0008) [2023-12-28 02:37:16,351][106226] Updated weights for policy 0, policy_version 1024539 (0.0009) [2023-12-28 02:37:16,670][106225] Updated weights for policy 1, policy_version 1027097 (0.0007) [2023-12-28 02:37:16,728][106225] Updated weights for policy 1, policy_version 1027107 (0.0006) [2023-12-28 02:37:16,787][106225] Updated weights for policy 1, policy_version 1027117 (0.0005) [2023-12-28 02:37:16,849][106225] Updated weights for policy 1, policy_version 1027127 (0.0007) [2023-12-28 02:37:17,020][106226] Updated weights for policy 0, policy_version 1024549 (0.0011) [2023-12-28 02:37:17,084][106226] Updated weights for policy 0, policy_version 1024559 (0.0011) [2023-12-28 02:37:17,139][106226] Updated weights for policy 0, policy_version 1024569 (0.0011) [2023-12-28 02:37:17,441][106225] Updated weights for policy 1, policy_version 1027137 (0.0008) [2023-12-28 02:37:17,498][106225] Updated weights for policy 1, policy_version 1027147 (0.0009) [2023-12-28 02:37:17,558][106225] Updated weights for policy 1, policy_version 1027157 (0.0008) [2023-12-28 02:37:17,737][106226] Updated weights for policy 0, policy_version 1024579 (0.0009) [2023-12-28 02:37:17,798][106226] Updated weights for policy 0, policy_version 1024589 (0.0009) [2023-12-28 02:37:17,843][106226] Updated weights for policy 0, policy_version 1024599 (0.0009) [2023-12-28 02:37:18,266][106225] Updated weights for policy 1, policy_version 1027167 (0.0005) [2023-12-28 02:37:18,325][106225] Updated weights for policy 1, policy_version 1027177 (0.0007) [2023-12-28 02:37:18,390][106225] Updated weights for policy 1, policy_version 1027187 (0.0007) [2023-12-28 02:37:18,426][106226] Updated weights for policy 0, policy_version 1024609 (0.0010) [2023-12-28 02:37:18,493][106226] Updated weights for policy 0, policy_version 1024619 (0.0010) [2023-12-28 02:37:18,556][106226] Updated weights for policy 0, policy_version 1024629 (0.0011) [2023-12-28 02:37:18,621][106226] Updated weights for policy 0, policy_version 1024639 (0.0010) [2023-12-28 02:37:19,082][106225] Updated weights for policy 1, policy_version 1027197 (0.0007) [2023-12-28 02:37:19,135][106225] Updated weights for policy 1, policy_version 1027207 (0.0008) [2023-12-28 02:37:19,195][106225] Updated weights for policy 1, policy_version 1027217 (0.0008) [2023-12-28 02:37:19,358][106226] Updated weights for policy 0, policy_version 1024649 (0.0011) [2023-12-28 02:37:19,423][106226] Updated weights for policy 0, policy_version 1024659 (0.0011) [2023-12-28 02:37:19,493][106226] Updated weights for policy 0, policy_version 1024669 (0.0011) [2023-12-28 02:37:20,028][106225] Updated weights for policy 1, policy_version 1027227 (0.0007) [2023-12-28 02:37:20,076][106225] Updated weights for policy 1, policy_version 1027237 (0.0008) [2023-12-28 02:37:20,132][106225] Updated weights for policy 1, policy_version 1027247 (0.0008) [2023-12-28 02:37:20,209][106226] Updated weights for policy 0, policy_version 1024679 (0.0011) [2023-12-28 02:37:20,277][106226] Updated weights for policy 0, policy_version 1024689 (0.0011) [2023-12-28 02:37:20,346][106226] Updated weights for policy 0, policy_version 1024699 (0.0011) [2023-12-28 02:37:20,847][106225] Updated weights for policy 1, policy_version 1027257 (0.0007) [2023-12-28 02:37:20,906][106225] Updated weights for policy 1, policy_version 1027267 (0.0008) [2023-12-28 02:37:20,972][106225] Updated weights for policy 1, policy_version 1027277 (0.0008) [2023-12-28 02:37:21,030][106225] Updated weights for policy 1, policy_version 1027287 (0.0009) [2023-12-28 02:37:21,065][106226] Updated weights for policy 0, policy_version 1024709 (0.0010) [2023-12-28 02:37:21,128][106226] Updated weights for policy 0, policy_version 1024719 (0.0008) [2023-12-28 02:37:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 525410304. Throughput: 0: 9956.1, 1: 9829.5. Samples: 525420748. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:21,175][105115] Avg episode reward: [(0, '-4.860'), (1, '-4.904')] [2023-12-28 02:37:21,197][106226] Updated weights for policy 0, policy_version 1024729 (0.0009) [2023-12-28 02:37:21,792][106225] Updated weights for policy 1, policy_version 1027297 (0.0009) [2023-12-28 02:37:21,859][106225] Updated weights for policy 1, policy_version 1027307 (0.0008) [2023-12-28 02:37:21,927][106225] Updated weights for policy 1, policy_version 1027317 (0.0009) [2023-12-28 02:37:21,998][106226] Updated weights for policy 0, policy_version 1024739 (0.0008) [2023-12-28 02:37:22,063][106226] Updated weights for policy 0, policy_version 1024749 (0.0009) [2023-12-28 02:37:22,131][106226] Updated weights for policy 0, policy_version 1024759 (0.0009) [2023-12-28 02:37:22,659][106225] Updated weights for policy 1, policy_version 1027327 (0.0009) [2023-12-28 02:37:22,718][106225] Updated weights for policy 1, policy_version 1027337 (0.0008) [2023-12-28 02:37:22,772][106225] Updated weights for policy 1, policy_version 1027347 (0.0007) [2023-12-28 02:37:22,869][106226] Updated weights for policy 0, policy_version 1024769 (0.0010) [2023-12-28 02:37:22,922][106226] Updated weights for policy 0, policy_version 1024779 (0.0008) [2023-12-28 02:37:22,973][106226] Updated weights for policy 0, policy_version 1024789 (0.0010) [2023-12-28 02:37:23,024][106226] Updated weights for policy 0, policy_version 1024799 (0.0009) [2023-12-28 02:37:23,513][106225] Updated weights for policy 1, policy_version 1027357 (0.0008) [2023-12-28 02:37:23,570][106225] Updated weights for policy 1, policy_version 1027367 (0.0008) [2023-12-28 02:37:23,620][106225] Updated weights for policy 1, policy_version 1027377 (0.0008) [2023-12-28 02:37:23,724][106226] Updated weights for policy 0, policy_version 1024809 (0.0010) [2023-12-28 02:37:23,773][106226] Updated weights for policy 0, policy_version 1024819 (0.0010) [2023-12-28 02:37:23,827][106226] Updated weights for policy 0, policy_version 1024829 (0.0010) [2023-12-28 02:37:24,358][106225] Updated weights for policy 1, policy_version 1027387 (0.0007) [2023-12-28 02:37:24,417][106225] Updated weights for policy 1, policy_version 1027397 (0.0008) [2023-12-28 02:37:24,480][106225] Updated weights for policy 1, policy_version 1027407 (0.0008) [2023-12-28 02:37:24,568][106226] Updated weights for policy 0, policy_version 1024839 (0.0007) [2023-12-28 02:37:24,621][106226] Updated weights for policy 0, policy_version 1024849 (0.0009) [2023-12-28 02:37:24,678][106226] Updated weights for policy 0, policy_version 1024859 (0.0006) [2023-12-28 02:37:25,237][106225] Updated weights for policy 1, policy_version 1027417 (0.0008) [2023-12-28 02:37:25,288][106225] Updated weights for policy 1, policy_version 1027427 (0.0008) [2023-12-28 02:37:25,319][106226] Updated weights for policy 0, policy_version 1024869 (0.0006) [2023-12-28 02:37:25,337][106225] Updated weights for policy 1, policy_version 1027437 (0.0006) [2023-12-28 02:37:25,374][106226] Updated weights for policy 0, policy_version 1024879 (0.0006) [2023-12-28 02:37:25,398][106225] Updated weights for policy 1, policy_version 1027447 (0.0008) [2023-12-28 02:37:25,431][106226] Updated weights for policy 0, policy_version 1024889 (0.0007) [2023-12-28 02:37:26,016][106226] Updated weights for policy 0, policy_version 1024899 (0.0007) [2023-12-28 02:37:26,071][106226] Updated weights for policy 0, policy_version 1024909 (0.0008) [2023-12-28 02:37:26,120][106226] Updated weights for policy 0, policy_version 1024919 (0.0008) [2023-12-28 02:37:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 525508608. Throughput: 0: 9921.2, 1: 9741.7. Samples: 525476608. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:26,176][105115] Avg episode reward: [(0, '-4.590'), (1, '-5.090')] [2023-12-28 02:37:26,177][106225] Updated weights for policy 1, policy_version 1027457 (0.0007) [2023-12-28 02:37:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001024928_262438912.pth... [2023-12-28 02:37:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001023744_262135808.pth [2023-12-28 02:37:26,222][106225] Updated weights for policy 1, policy_version 1027467 (0.0008) [2023-12-28 02:37:26,275][106225] Updated weights for policy 1, policy_version 1027477 (0.0009) [2023-12-28 02:37:26,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001027480_263077888.pth... [2023-12-28 02:37:26,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001026328_262782976.pth [2023-12-28 02:37:26,806][106226] Updated weights for policy 0, policy_version 1024929 (0.0008) [2023-12-28 02:37:26,864][106226] Updated weights for policy 0, policy_version 1024939 (0.0009) [2023-12-28 02:37:26,918][106226] Updated weights for policy 0, policy_version 1024949 (0.0009) [2023-12-28 02:37:26,979][106226] Updated weights for policy 0, policy_version 1024959 (0.0009) [2023-12-28 02:37:26,981][106225] Updated weights for policy 1, policy_version 1027487 (0.0006) [2023-12-28 02:37:27,032][106225] Updated weights for policy 1, policy_version 1027497 (0.0005) [2023-12-28 02:37:27,085][106225] Updated weights for policy 1, policy_version 1027507 (0.0005) [2023-12-28 02:37:27,663][106225] Updated weights for policy 1, policy_version 1027517 (0.0005) [2023-12-28 02:37:27,714][106225] Updated weights for policy 1, policy_version 1027527 (0.0005) [2023-12-28 02:37:27,738][106226] Updated weights for policy 0, policy_version 1024969 (0.0008) [2023-12-28 02:37:27,763][106225] Updated weights for policy 1, policy_version 1027537 (0.0005) [2023-12-28 02:37:27,794][106226] Updated weights for policy 0, policy_version 1024979 (0.0009) [2023-12-28 02:37:27,847][106226] Updated weights for policy 0, policy_version 1024989 (0.0007) [2023-12-28 02:37:28,365][106225] Updated weights for policy 1, policy_version 1027547 (0.0007) [2023-12-28 02:37:28,424][106225] Updated weights for policy 1, policy_version 1027557 (0.0009) [2023-12-28 02:37:28,475][106225] Updated weights for policy 1, policy_version 1027567 (0.0008) [2023-12-28 02:37:28,588][106226] Updated weights for policy 0, policy_version 1024999 (0.0008) [2023-12-28 02:37:28,652][106226] Updated weights for policy 0, policy_version 1025009 (0.0010) [2023-12-28 02:37:28,714][106226] Updated weights for policy 0, policy_version 1025019 (0.0008) [2023-12-28 02:37:29,127][106225] Updated weights for policy 1, policy_version 1027577 (0.0009) [2023-12-28 02:37:29,181][106225] Updated weights for policy 1, policy_version 1027587 (0.0008) [2023-12-28 02:37:29,252][106225] Updated weights for policy 1, policy_version 1027597 (0.0009) [2023-12-28 02:37:29,310][106225] Updated weights for policy 1, policy_version 1027607 (0.0008) [2023-12-28 02:37:29,494][106226] Updated weights for policy 0, policy_version 1025029 (0.0009) [2023-12-28 02:37:29,557][106226] Updated weights for policy 0, policy_version 1025039 (0.0008) [2023-12-28 02:37:29,622][106226] Updated weights for policy 0, policy_version 1025049 (0.0008) [2023-12-28 02:37:30,081][106225] Updated weights for policy 1, policy_version 1027617 (0.0008) [2023-12-28 02:37:30,134][106225] Updated weights for policy 1, policy_version 1027627 (0.0009) [2023-12-28 02:37:30,181][106225] Updated weights for policy 1, policy_version 1027637 (0.0008) [2023-12-28 02:37:30,231][106226] Updated weights for policy 0, policy_version 1025059 (0.0006) [2023-12-28 02:37:30,291][106226] Updated weights for policy 0, policy_version 1025069 (0.0006) [2023-12-28 02:37:30,353][106226] Updated weights for policy 0, policy_version 1025079 (0.0008) [2023-12-28 02:37:30,916][106225] Updated weights for policy 1, policy_version 1027647 (0.0009) [2023-12-28 02:37:30,987][106225] Updated weights for policy 1, policy_version 1027657 (0.0009) [2023-12-28 02:37:31,027][106226] Updated weights for policy 0, policy_version 1025089 (0.0009) [2023-12-28 02:37:31,037][106225] Updated weights for policy 1, policy_version 1027667 (0.0009) [2023-12-28 02:37:31,090][106226] Updated weights for policy 0, policy_version 1025099 (0.0007) [2023-12-28 02:37:31,151][106226] Updated weights for policy 0, policy_version 1025109 (0.0009) [2023-12-28 02:37:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 525606912. Throughput: 0: 9955.4, 1: 9803.8. Samples: 525597280. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:31,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-4.913')] [2023-12-28 02:37:31,225][106226] Updated weights for policy 0, policy_version 1025119 (0.0009) [2023-12-28 02:37:31,768][106225] Updated weights for policy 1, policy_version 1027677 (0.0008) [2023-12-28 02:37:31,819][106225] Updated weights for policy 1, policy_version 1027687 (0.0008) [2023-12-28 02:37:31,880][106225] Updated weights for policy 1, policy_version 1027697 (0.0009) [2023-12-28 02:37:31,904][106226] Updated weights for policy 0, policy_version 1025129 (0.0006) [2023-12-28 02:37:31,952][106226] Updated weights for policy 0, policy_version 1025139 (0.0007) [2023-12-28 02:37:32,003][106226] Updated weights for policy 0, policy_version 1025149 (0.0009) [2023-12-28 02:37:32,478][106225] Updated weights for policy 1, policy_version 1027707 (0.0008) [2023-12-28 02:37:32,536][106225] Updated weights for policy 1, policy_version 1027717 (0.0008) [2023-12-28 02:37:32,598][106225] Updated weights for policy 1, policy_version 1027727 (0.0008) [2023-12-28 02:37:32,781][106226] Updated weights for policy 0, policy_version 1025159 (0.0009) [2023-12-28 02:37:32,837][106226] Updated weights for policy 0, policy_version 1025169 (0.0008) [2023-12-28 02:37:32,892][106226] Updated weights for policy 0, policy_version 1025179 (0.0008) [2023-12-28 02:37:33,306][106225] Updated weights for policy 1, policy_version 1027737 (0.0009) [2023-12-28 02:37:33,368][106225] Updated weights for policy 1, policy_version 1027747 (0.0009) [2023-12-28 02:37:33,426][106225] Updated weights for policy 1, policy_version 1027757 (0.0008) [2023-12-28 02:37:33,479][106225] Updated weights for policy 1, policy_version 1027767 (0.0008) [2023-12-28 02:37:33,614][106226] Updated weights for policy 0, policy_version 1025189 (0.0009) [2023-12-28 02:37:33,663][106226] Updated weights for policy 0, policy_version 1025199 (0.0008) [2023-12-28 02:37:33,716][106226] Updated weights for policy 0, policy_version 1025209 (0.0006) [2023-12-28 02:37:34,184][106225] Updated weights for policy 1, policy_version 1027777 (0.0008) [2023-12-28 02:37:34,239][106225] Updated weights for policy 1, policy_version 1027787 (0.0008) [2023-12-28 02:37:34,305][106225] Updated weights for policy 1, policy_version 1027797 (0.0007) [2023-12-28 02:37:34,458][106226] Updated weights for policy 0, policy_version 1025219 (0.0008) [2023-12-28 02:37:34,513][106226] Updated weights for policy 0, policy_version 1025229 (0.0008) [2023-12-28 02:37:34,565][106226] Updated weights for policy 0, policy_version 1025239 (0.0008) [2023-12-28 02:37:35,000][106225] Updated weights for policy 1, policy_version 1027807 (0.0009) [2023-12-28 02:37:35,068][106225] Updated weights for policy 1, policy_version 1027817 (0.0009) [2023-12-28 02:37:35,132][106225] Updated weights for policy 1, policy_version 1027827 (0.0008) [2023-12-28 02:37:35,283][106226] Updated weights for policy 0, policy_version 1025249 (0.0008) [2023-12-28 02:37:35,342][106226] Updated weights for policy 0, policy_version 1025259 (0.0008) [2023-12-28 02:37:35,410][106226] Updated weights for policy 0, policy_version 1025269 (0.0008) [2023-12-28 02:37:35,473][106226] Updated weights for policy 0, policy_version 1025279 (0.0008) [2023-12-28 02:37:35,782][106225] Updated weights for policy 1, policy_version 1027837 (0.0008) [2023-12-28 02:37:35,851][106225] Updated weights for policy 1, policy_version 1027847 (0.0009) [2023-12-28 02:37:35,913][106225] Updated weights for policy 1, policy_version 1027857 (0.0008) [2023-12-28 02:37:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 525705216. Throughput: 0: 9954.9, 1: 9875.6. Samples: 525713944. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:36,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.723')] [2023-12-28 02:37:36,264][106226] Updated weights for policy 0, policy_version 1025289 (0.0008) [2023-12-28 02:37:36,327][106226] Updated weights for policy 0, policy_version 1025299 (0.0009) [2023-12-28 02:37:36,382][106226] Updated weights for policy 0, policy_version 1025309 (0.0009) [2023-12-28 02:37:36,578][106225] Updated weights for policy 1, policy_version 1027867 (0.0009) [2023-12-28 02:37:36,642][106225] Updated weights for policy 1, policy_version 1027877 (0.0006) [2023-12-28 02:37:36,703][106225] Updated weights for policy 1, policy_version 1027887 (0.0010) [2023-12-28 02:37:37,186][106226] Updated weights for policy 0, policy_version 1025319 (0.0008) [2023-12-28 02:37:37,240][106226] Updated weights for policy 0, policy_version 1025329 (0.0008) [2023-12-28 02:37:37,305][106226] Updated weights for policy 0, policy_version 1025339 (0.0008) [2023-12-28 02:37:37,407][106225] Updated weights for policy 1, policy_version 1027897 (0.0010) [2023-12-28 02:37:37,458][106225] Updated weights for policy 1, policy_version 1027907 (0.0011) [2023-12-28 02:37:37,520][106225] Updated weights for policy 1, policy_version 1027917 (0.0011) [2023-12-28 02:37:37,571][106225] Updated weights for policy 1, policy_version 1027927 (0.0010) [2023-12-28 02:37:37,987][106226] Updated weights for policy 0, policy_version 1025349 (0.0007) [2023-12-28 02:37:38,040][106226] Updated weights for policy 0, policy_version 1025359 (0.0006) [2023-12-28 02:37:38,092][106226] Updated weights for policy 0, policy_version 1025369 (0.0007) [2023-12-28 02:37:38,286][106225] Updated weights for policy 1, policy_version 1027937 (0.0008) [2023-12-28 02:37:38,351][106225] Updated weights for policy 1, policy_version 1027947 (0.0008) [2023-12-28 02:37:38,418][106225] Updated weights for policy 1, policy_version 1027957 (0.0007) [2023-12-28 02:37:38,705][106226] Updated weights for policy 0, policy_version 1025379 (0.0006) [2023-12-28 02:37:38,768][106226] Updated weights for policy 0, policy_version 1025389 (0.0006) [2023-12-28 02:37:38,838][106226] Updated weights for policy 0, policy_version 1025399 (0.0006) [2023-12-28 02:37:39,022][106225] Updated weights for policy 1, policy_version 1027967 (0.0010) [2023-12-28 02:37:39,066][106225] Updated weights for policy 1, policy_version 1027977 (0.0010) [2023-12-28 02:37:39,116][106225] Updated weights for policy 1, policy_version 1027987 (0.0010) [2023-12-28 02:37:39,442][106226] Updated weights for policy 0, policy_version 1025409 (0.0006) [2023-12-28 02:37:39,501][106226] Updated weights for policy 0, policy_version 1025419 (0.0008) [2023-12-28 02:37:39,560][106226] Updated weights for policy 0, policy_version 1025429 (0.0008) [2023-12-28 02:37:39,619][106226] Updated weights for policy 0, policy_version 1025439 (0.0008) [2023-12-28 02:37:39,965][106225] Updated weights for policy 1, policy_version 1027997 (0.0008) [2023-12-28 02:37:40,025][106225] Updated weights for policy 1, policy_version 1028007 (0.0007) [2023-12-28 02:37:40,092][106225] Updated weights for policy 1, policy_version 1028017 (0.0007) [2023-12-28 02:37:40,401][106226] Updated weights for policy 0, policy_version 1025449 (0.0009) [2023-12-28 02:37:40,463][106226] Updated weights for policy 0, policy_version 1025459 (0.0009) [2023-12-28 02:37:40,524][106226] Updated weights for policy 0, policy_version 1025469 (0.0009) [2023-12-28 02:37:40,749][106225] Updated weights for policy 1, policy_version 1028027 (0.0006) [2023-12-28 02:37:40,807][106225] Updated weights for policy 1, policy_version 1028037 (0.0005) [2023-12-28 02:37:40,863][106225] Updated weights for policy 1, policy_version 1028047 (0.0005) [2023-12-28 02:37:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 525803520. Throughput: 0: 9892.6, 1: 9878.1. Samples: 525774484. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:41,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.913')] [2023-12-28 02:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001028056_263225344.pth... [2023-12-28 02:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001025472_262578176.pth... [2023-12-28 02:37:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001026904_262930432.pth [2023-12-28 02:37:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001024352_262291456.pth [2023-12-28 02:37:41,301][106226] Updated weights for policy 0, policy_version 1025479 (0.0008) [2023-12-28 02:37:41,370][106226] Updated weights for policy 0, policy_version 1025489 (0.0008) [2023-12-28 02:37:41,434][106226] Updated weights for policy 0, policy_version 1025499 (0.0009) [2023-12-28 02:37:41,525][106225] Updated weights for policy 1, policy_version 1028057 (0.0005) [2023-12-28 02:37:41,577][106225] Updated weights for policy 1, policy_version 1028067 (0.0007) [2023-12-28 02:37:41,639][106225] Updated weights for policy 1, policy_version 1028077 (0.0008) [2023-12-28 02:37:41,711][106225] Updated weights for policy 1, policy_version 1028087 (0.0007) [2023-12-28 02:37:42,222][106226] Updated weights for policy 0, policy_version 1025509 (0.0008) [2023-12-28 02:37:42,289][106226] Updated weights for policy 0, policy_version 1025519 (0.0009) [2023-12-28 02:37:42,357][106226] Updated weights for policy 0, policy_version 1025529 (0.0008) [2023-12-28 02:37:42,389][106225] Updated weights for policy 1, policy_version 1028097 (0.0008) [2023-12-28 02:37:42,454][106225] Updated weights for policy 1, policy_version 1028107 (0.0006) [2023-12-28 02:37:42,514][106225] Updated weights for policy 1, policy_version 1028117 (0.0008) [2023-12-28 02:37:42,998][106226] Updated weights for policy 0, policy_version 1025539 (0.0007) [2023-12-28 02:37:43,059][106226] Updated weights for policy 0, policy_version 1025549 (0.0010) [2023-12-28 02:37:43,116][106226] Updated weights for policy 0, policy_version 1025559 (0.0010) [2023-12-28 02:37:43,180][106225] Updated weights for policy 1, policy_version 1028127 (0.0006) [2023-12-28 02:37:43,240][106225] Updated weights for policy 1, policy_version 1028137 (0.0005) [2023-12-28 02:37:43,297][106225] Updated weights for policy 1, policy_version 1028147 (0.0006) [2023-12-28 02:37:43,785][106226] Updated weights for policy 0, policy_version 1025569 (0.0010) [2023-12-28 02:37:43,850][106226] Updated weights for policy 0, policy_version 1025579 (0.0005) [2023-12-28 02:37:43,885][106225] Updated weights for policy 1, policy_version 1028157 (0.0007) [2023-12-28 02:37:43,909][106226] Updated weights for policy 0, policy_version 1025589 (0.0005) [2023-12-28 02:37:43,932][106225] Updated weights for policy 1, policy_version 1028167 (0.0008) [2023-12-28 02:37:43,962][106226] Updated weights for policy 0, policy_version 1025599 (0.0005) [2023-12-28 02:37:43,982][106225] Updated weights for policy 1, policy_version 1028177 (0.0008) [2023-12-28 02:37:44,596][106226] Updated weights for policy 0, policy_version 1025609 (0.0010) [2023-12-28 02:37:44,662][106226] Updated weights for policy 0, policy_version 1025619 (0.0010) [2023-12-28 02:37:44,711][106226] Updated weights for policy 0, policy_version 1025629 (0.0006) [2023-12-28 02:37:44,717][106225] Updated weights for policy 1, policy_version 1028187 (0.0009) [2023-12-28 02:37:44,789][106225] Updated weights for policy 1, policy_version 1028197 (0.0008) [2023-12-28 02:37:44,858][106225] Updated weights for policy 1, policy_version 1028207 (0.0008) [2023-12-28 02:37:45,391][106226] Updated weights for policy 0, policy_version 1025639 (0.0007) [2023-12-28 02:37:45,455][106226] Updated weights for policy 0, policy_version 1025649 (0.0010) [2023-12-28 02:37:45,529][106226] Updated weights for policy 0, policy_version 1025659 (0.0008) [2023-12-28 02:37:45,590][106225] Updated weights for policy 1, policy_version 1028217 (0.0008) [2023-12-28 02:37:45,660][106225] Updated weights for policy 1, policy_version 1028227 (0.0009) [2023-12-28 02:37:45,722][106225] Updated weights for policy 1, policy_version 1028237 (0.0009) [2023-12-28 02:37:45,776][106225] Updated weights for policy 1, policy_version 1028247 (0.0007) [2023-12-28 02:37:46,093][106226] Updated weights for policy 0, policy_version 1025669 (0.0007) [2023-12-28 02:37:46,142][106226] Updated weights for policy 0, policy_version 1025679 (0.0005) [2023-12-28 02:37:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 525901824. Throughput: 0: 9838.5, 1: 9926.7. Samples: 525894200. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:46,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-5.179')] [2023-12-28 02:37:46,205][106226] Updated weights for policy 0, policy_version 1025689 (0.0005) [2023-12-28 02:37:46,479][106225] Updated weights for policy 1, policy_version 1028257 (0.0008) [2023-12-28 02:37:46,544][106225] Updated weights for policy 1, policy_version 1028267 (0.0005) [2023-12-28 02:37:46,592][106225] Updated weights for policy 1, policy_version 1028277 (0.0005) [2023-12-28 02:37:46,791][106226] Updated weights for policy 0, policy_version 1025699 (0.0006) [2023-12-28 02:37:46,861][106226] Updated weights for policy 0, policy_version 1025709 (0.0010) [2023-12-28 02:37:46,925][106226] Updated weights for policy 0, policy_version 1025719 (0.0011) [2023-12-28 02:37:47,244][106225] Updated weights for policy 1, policy_version 1028287 (0.0007) [2023-12-28 02:37:47,295][106225] Updated weights for policy 1, policy_version 1028297 (0.0008) [2023-12-28 02:37:47,353][106225] Updated weights for policy 1, policy_version 1028307 (0.0008) [2023-12-28 02:37:47,622][106226] Updated weights for policy 0, policy_version 1025729 (0.0011) [2023-12-28 02:37:47,672][106226] Updated weights for policy 0, policy_version 1025739 (0.0010) [2023-12-28 02:37:47,719][106226] Updated weights for policy 0, policy_version 1025749 (0.0010) [2023-12-28 02:37:47,776][106226] Updated weights for policy 0, policy_version 1025759 (0.0010) [2023-12-28 02:37:48,076][106225] Updated weights for policy 1, policy_version 1028317 (0.0006) [2023-12-28 02:37:48,126][106225] Updated weights for policy 1, policy_version 1028327 (0.0005) [2023-12-28 02:37:48,181][106225] Updated weights for policy 1, policy_version 1028337 (0.0005) [2023-12-28 02:37:48,534][106226] Updated weights for policy 0, policy_version 1025769 (0.0010) [2023-12-28 02:37:48,595][106226] Updated weights for policy 0, policy_version 1025779 (0.0011) [2023-12-28 02:37:48,656][106226] Updated weights for policy 0, policy_version 1025789 (0.0010) [2023-12-28 02:37:48,778][106225] Updated weights for policy 1, policy_version 1028347 (0.0007) [2023-12-28 02:37:48,836][106225] Updated weights for policy 1, policy_version 1028357 (0.0009) [2023-12-28 02:37:48,888][106225] Updated weights for policy 1, policy_version 1028367 (0.0009) [2023-12-28 02:37:49,254][106226] Updated weights for policy 0, policy_version 1025799 (0.0008) [2023-12-28 02:37:49,320][106226] Updated weights for policy 0, policy_version 1025809 (0.0007) [2023-12-28 02:37:49,390][106226] Updated weights for policy 0, policy_version 1025819 (0.0009) [2023-12-28 02:37:49,564][106225] Updated weights for policy 1, policy_version 1028377 (0.0009) [2023-12-28 02:37:49,621][106225] Updated weights for policy 1, policy_version 1028387 (0.0007) [2023-12-28 02:37:49,681][106225] Updated weights for policy 1, policy_version 1028397 (0.0007) [2023-12-28 02:37:49,744][106225] Updated weights for policy 1, policy_version 1028407 (0.0008) [2023-12-28 02:37:50,115][106226] Updated weights for policy 0, policy_version 1025829 (0.0010) [2023-12-28 02:37:50,179][106226] Updated weights for policy 0, policy_version 1025839 (0.0010) [2023-12-28 02:37:50,251][106226] Updated weights for policy 0, policy_version 1025849 (0.0010) [2023-12-28 02:37:50,482][106225] Updated weights for policy 1, policy_version 1028417 (0.0008) [2023-12-28 02:37:50,528][106225] Updated weights for policy 1, policy_version 1028427 (0.0007) [2023-12-28 02:37:50,590][106225] Updated weights for policy 1, policy_version 1028437 (0.0007) [2023-12-28 02:37:50,983][106226] Updated weights for policy 0, policy_version 1025859 (0.0011) [2023-12-28 02:37:51,065][106226] Updated weights for policy 0, policy_version 1025869 (0.0010) [2023-12-28 02:37:51,123][106226] Updated weights for policy 0, policy_version 1025880 (0.0009) [2023-12-28 02:37:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 526008320. Throughput: 0: 9899.9, 1: 9939.3. Samples: 526015728. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:51,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.043')] [2023-12-28 02:37:51,237][106225] Updated weights for policy 1, policy_version 1028447 (0.0009) [2023-12-28 02:37:51,304][106225] Updated weights for policy 1, policy_version 1028457 (0.0009) [2023-12-28 02:37:51,366][106225] Updated weights for policy 1, policy_version 1028467 (0.0007) [2023-12-28 02:37:51,742][106226] Updated weights for policy 0, policy_version 1025890 (0.0009) [2023-12-28 02:37:51,805][106226] Updated weights for policy 0, policy_version 1025900 (0.0006) [2023-12-28 02:37:51,871][106226] Updated weights for policy 0, policy_version 1025910 (0.0006) [2023-12-28 02:37:51,937][106226] Updated weights for policy 0, policy_version 1025920 (0.0006) [2023-12-28 02:37:52,195][106225] Updated weights for policy 1, policy_version 1028477 (0.0008) [2023-12-28 02:37:52,243][106225] Updated weights for policy 1, policy_version 1028487 (0.0008) [2023-12-28 02:37:52,306][106225] Updated weights for policy 1, policy_version 1028497 (0.0007) [2023-12-28 02:37:52,562][106226] Updated weights for policy 0, policy_version 1025930 (0.0008) [2023-12-28 02:37:52,619][106226] Updated weights for policy 0, policy_version 1025940 (0.0008) [2023-12-28 02:37:52,683][106226] Updated weights for policy 0, policy_version 1025950 (0.0008) [2023-12-28 02:37:53,021][106225] Updated weights for policy 1, policy_version 1028507 (0.0008) [2023-12-28 02:37:53,086][106225] Updated weights for policy 1, policy_version 1028517 (0.0009) [2023-12-28 02:37:53,149][106225] Updated weights for policy 1, policy_version 1028527 (0.0008) [2023-12-28 02:37:53,433][106226] Updated weights for policy 0, policy_version 1025960 (0.0008) [2023-12-28 02:37:53,496][106226] Updated weights for policy 0, policy_version 1025970 (0.0008) [2023-12-28 02:37:53,554][106226] Updated weights for policy 0, policy_version 1025980 (0.0009) [2023-12-28 02:37:53,760][106225] Updated weights for policy 1, policy_version 1028537 (0.0007) [2023-12-28 02:37:53,810][106225] Updated weights for policy 1, policy_version 1028547 (0.0005) [2023-12-28 02:37:53,871][106225] Updated weights for policy 1, policy_version 1028557 (0.0005) [2023-12-28 02:37:53,937][106225] Updated weights for policy 1, policy_version 1028567 (0.0005) [2023-12-28 02:37:54,283][106226] Updated weights for policy 0, policy_version 1025990 (0.0007) [2023-12-28 02:37:54,332][106226] Updated weights for policy 0, policy_version 1026000 (0.0006) [2023-12-28 02:37:54,389][106226] Updated weights for policy 0, policy_version 1026010 (0.0006) [2023-12-28 02:37:54,484][106225] Updated weights for policy 1, policy_version 1028577 (0.0008) [2023-12-28 02:37:54,541][106225] Updated weights for policy 1, policy_version 1028587 (0.0007) [2023-12-28 02:37:54,600][106225] Updated weights for policy 1, policy_version 1028597 (0.0009) [2023-12-28 02:37:54,965][106226] Updated weights for policy 0, policy_version 1026020 (0.0005) [2023-12-28 02:37:55,021][106226] Updated weights for policy 0, policy_version 1026030 (0.0006) [2023-12-28 02:37:55,069][106226] Updated weights for policy 0, policy_version 1026040 (0.0005) [2023-12-28 02:37:55,360][106225] Updated weights for policy 1, policy_version 1028607 (0.0008) [2023-12-28 02:37:55,414][106225] Updated weights for policy 1, policy_version 1028617 (0.0008) [2023-12-28 02:37:55,460][106225] Updated weights for policy 1, policy_version 1028627 (0.0007) [2023-12-28 02:37:55,647][106226] Updated weights for policy 0, policy_version 1026050 (0.0006) [2023-12-28 02:37:55,719][106226] Updated weights for policy 0, policy_version 1026060 (0.0007) [2023-12-28 02:37:55,779][106226] Updated weights for policy 0, policy_version 1026070 (0.0006) [2023-12-28 02:37:55,827][106226] Updated weights for policy 0, policy_version 1026080 (0.0005) [2023-12-28 02:37:56,125][106225] Updated weights for policy 1, policy_version 1028637 (0.0005) [2023-12-28 02:37:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 526106624. Throughput: 0: 9871.1, 1: 9935.5. Samples: 526074704. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:37:56,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.169')] [2023-12-28 02:37:56,178][106225] Updated weights for policy 1, policy_version 1028647 (0.0006) [2023-12-28 02:37:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001026080_262733824.pth... [2023-12-28 02:37:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001024928_262438912.pth [2023-12-28 02:37:56,227][106225] Updated weights for policy 1, policy_version 1028657 (0.0008) [2023-12-28 02:37:56,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001028664_263380992.pth... [2023-12-28 02:37:56,270][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001027480_263077888.pth [2023-12-28 02:37:56,536][106226] Updated weights for policy 0, policy_version 1026090 (0.0007) [2023-12-28 02:37:56,593][106226] Updated weights for policy 0, policy_version 1026100 (0.0005) [2023-12-28 02:37:56,648][106226] Updated weights for policy 0, policy_version 1026110 (0.0005) [2023-12-28 02:37:56,928][106225] Updated weights for policy 1, policy_version 1028667 (0.0007) [2023-12-28 02:37:56,978][106225] Updated weights for policy 1, policy_version 1028677 (0.0005) [2023-12-28 02:37:57,022][106225] Updated weights for policy 1, policy_version 1028687 (0.0005) [2023-12-28 02:37:57,338][106226] Updated weights for policy 0, policy_version 1026120 (0.0006) [2023-12-28 02:37:57,387][106226] Updated weights for policy 0, policy_version 1026130 (0.0005) [2023-12-28 02:37:57,448][106226] Updated weights for policy 0, policy_version 1026140 (0.0005) [2023-12-28 02:37:57,579][106225] Updated weights for policy 1, policy_version 1028697 (0.0005) [2023-12-28 02:37:57,644][106225] Updated weights for policy 1, policy_version 1028707 (0.0005) [2023-12-28 02:37:57,694][106225] Updated weights for policy 1, policy_version 1028717 (0.0005) [2023-12-28 02:37:57,740][106225] Updated weights for policy 1, policy_version 1028727 (0.0007) [2023-12-28 02:37:58,094][106226] Updated weights for policy 0, policy_version 1026150 (0.0006) [2023-12-28 02:37:58,161][106226] Updated weights for policy 0, policy_version 1026160 (0.0006) [2023-12-28 02:37:58,222][106226] Updated weights for policy 0, policy_version 1026170 (0.0009) [2023-12-28 02:37:58,454][106225] Updated weights for policy 1, policy_version 1028737 (0.0009) [2023-12-28 02:37:58,523][106225] Updated weights for policy 1, policy_version 1028747 (0.0011) [2023-12-28 02:37:58,584][106225] Updated weights for policy 1, policy_version 1028757 (0.0010) [2023-12-28 02:37:58,991][106226] Updated weights for policy 0, policy_version 1026180 (0.0009) [2023-12-28 02:37:59,049][106226] Updated weights for policy 0, policy_version 1026190 (0.0010) [2023-12-28 02:37:59,114][106226] Updated weights for policy 0, policy_version 1026200 (0.0011) [2023-12-28 02:37:59,361][106225] Updated weights for policy 1, policy_version 1028767 (0.0008) [2023-12-28 02:37:59,428][106225] Updated weights for policy 1, policy_version 1028777 (0.0010) [2023-12-28 02:37:59,483][106225] Updated weights for policy 1, policy_version 1028787 (0.0009) [2023-12-28 02:37:59,873][106226] Updated weights for policy 0, policy_version 1026210 (0.0010) [2023-12-28 02:37:59,937][106226] Updated weights for policy 0, policy_version 1026220 (0.0011) [2023-12-28 02:37:59,994][106226] Updated weights for policy 0, policy_version 1026230 (0.0008) [2023-12-28 02:38:00,046][106226] Updated weights for policy 0, policy_version 1026240 (0.0008) [2023-12-28 02:38:00,241][106225] Updated weights for policy 1, policy_version 1028797 (0.0009) [2023-12-28 02:38:00,301][106225] Updated weights for policy 1, policy_version 1028807 (0.0011) [2023-12-28 02:38:00,361][106225] Updated weights for policy 1, policy_version 1028817 (0.0010) [2023-12-28 02:38:00,719][106226] Updated weights for policy 0, policy_version 1026250 (0.0006) [2023-12-28 02:38:00,784][106226] Updated weights for policy 0, policy_version 1026260 (0.0009) [2023-12-28 02:38:00,842][106226] Updated weights for policy 0, policy_version 1026270 (0.0006) [2023-12-28 02:38:00,992][106225] Updated weights for policy 1, policy_version 1028827 (0.0009) [2023-12-28 02:38:01,056][106225] Updated weights for policy 1, policy_version 1028837 (0.0010) [2023-12-28 02:38:01,108][106225] Updated weights for policy 1, policy_version 1028847 (0.0009) [2023-12-28 02:38:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 526213120. Throughput: 0: 9908.5, 1: 9985.3. Samples: 526196704. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:01,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.918')] [2023-12-28 02:38:01,511][106226] Updated weights for policy 0, policy_version 1026280 (0.0009) [2023-12-28 02:38:01,565][106226] Updated weights for policy 0, policy_version 1026290 (0.0011) [2023-12-28 02:38:01,621][106226] Updated weights for policy 0, policy_version 1026300 (0.0010) [2023-12-28 02:38:01,890][106225] Updated weights for policy 1, policy_version 1028857 (0.0008) [2023-12-28 02:38:01,950][106225] Updated weights for policy 1, policy_version 1028867 (0.0007) [2023-12-28 02:38:02,007][106225] Updated weights for policy 1, policy_version 1028877 (0.0006) [2023-12-28 02:38:02,068][106225] Updated weights for policy 1, policy_version 1028887 (0.0005) [2023-12-28 02:38:02,378][106226] Updated weights for policy 0, policy_version 1026310 (0.0010) [2023-12-28 02:38:02,428][106226] Updated weights for policy 0, policy_version 1026320 (0.0010) [2023-12-28 02:38:02,491][106226] Updated weights for policy 0, policy_version 1026330 (0.0006) [2023-12-28 02:38:02,724][106225] Updated weights for policy 1, policy_version 1028897 (0.0009) [2023-12-28 02:38:02,795][106225] Updated weights for policy 1, policy_version 1028907 (0.0010) [2023-12-28 02:38:02,859][106225] Updated weights for policy 1, policy_version 1028917 (0.0009) [2023-12-28 02:38:03,076][106226] Updated weights for policy 0, policy_version 1026340 (0.0007) [2023-12-28 02:38:03,138][106226] Updated weights for policy 0, policy_version 1026350 (0.0008) [2023-12-28 02:38:03,197][106226] Updated weights for policy 0, policy_version 1026360 (0.0006) [2023-12-28 02:38:03,560][106225] Updated weights for policy 1, policy_version 1028927 (0.0009) [2023-12-28 02:38:03,610][106225] Updated weights for policy 1, policy_version 1028937 (0.0010) [2023-12-28 02:38:03,666][106225] Updated weights for policy 1, policy_version 1028947 (0.0010) [2023-12-28 02:38:03,895][106226] Updated weights for policy 0, policy_version 1026370 (0.0010) [2023-12-28 02:38:03,948][106226] Updated weights for policy 0, policy_version 1026380 (0.0010) [2023-12-28 02:38:04,007][106226] Updated weights for policy 0, policy_version 1026390 (0.0005) [2023-12-28 02:38:04,071][106226] Updated weights for policy 0, policy_version 1026400 (0.0011) [2023-12-28 02:38:04,373][106225] Updated weights for policy 1, policy_version 1028957 (0.0010) [2023-12-28 02:38:04,439][106225] Updated weights for policy 1, policy_version 1028967 (0.0010) [2023-12-28 02:38:04,496][106225] Updated weights for policy 1, policy_version 1028977 (0.0010) [2023-12-28 02:38:04,821][106226] Updated weights for policy 0, policy_version 1026410 (0.0008) [2023-12-28 02:38:04,869][106226] Updated weights for policy 0, policy_version 1026420 (0.0007) [2023-12-28 02:38:04,919][106226] Updated weights for policy 0, policy_version 1026430 (0.0008) [2023-12-28 02:38:05,227][106225] Updated weights for policy 1, policy_version 1028987 (0.0010) [2023-12-28 02:38:05,306][106225] Updated weights for policy 1, policy_version 1028997 (0.0010) [2023-12-28 02:38:05,362][106225] Updated weights for policy 1, policy_version 1029007 (0.0010) [2023-12-28 02:38:05,572][106226] Updated weights for policy 0, policy_version 1026440 (0.0006) [2023-12-28 02:38:05,624][106226] Updated weights for policy 0, policy_version 1026450 (0.0005) [2023-12-28 02:38:05,673][106226] Updated weights for policy 0, policy_version 1026460 (0.0005) [2023-12-28 02:38:05,999][106225] Updated weights for policy 1, policy_version 1029017 (0.0006) [2023-12-28 02:38:06,058][106225] Updated weights for policy 1, policy_version 1029027 (0.0008) [2023-12-28 02:38:06,132][106225] Updated weights for policy 1, policy_version 1029037 (0.0008) [2023-12-28 02:38:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 526303232. Throughput: 0: 9974.7, 1: 9973.8. Samples: 526318428. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:06,175][105115] Avg episode reward: [(0, '-4.863'), (1, '-5.088')] [2023-12-28 02:38:06,203][106225] Updated weights for policy 1, policy_version 1029047 (0.0009) [2023-12-28 02:38:06,281][106226] Updated weights for policy 0, policy_version 1026470 (0.0008) [2023-12-28 02:38:06,348][106226] Updated weights for policy 0, policy_version 1026480 (0.0011) [2023-12-28 02:38:06,411][106226] Updated weights for policy 0, policy_version 1026490 (0.0011) [2023-12-28 02:38:06,964][106225] Updated weights for policy 1, policy_version 1029057 (0.0008) [2023-12-28 02:38:07,017][106225] Updated weights for policy 1, policy_version 1029067 (0.0008) [2023-12-28 02:38:07,071][106225] Updated weights for policy 1, policy_version 1029077 (0.0008) [2023-12-28 02:38:07,090][106226] Updated weights for policy 0, policy_version 1026500 (0.0011) [2023-12-28 02:38:07,157][106226] Updated weights for policy 0, policy_version 1026510 (0.0011) [2023-12-28 02:38:07,215][106226] Updated weights for policy 0, policy_version 1026520 (0.0010) [2023-12-28 02:38:07,807][106225] Updated weights for policy 1, policy_version 1029087 (0.0007) [2023-12-28 02:38:07,857][106225] Updated weights for policy 1, policy_version 1029097 (0.0008) [2023-12-28 02:38:07,868][106226] Updated weights for policy 0, policy_version 1026530 (0.0007) [2023-12-28 02:38:07,908][106225] Updated weights for policy 1, policy_version 1029107 (0.0006) [2023-12-28 02:38:07,925][106226] Updated weights for policy 0, policy_version 1026540 (0.0011) [2023-12-28 02:38:07,986][106226] Updated weights for policy 0, policy_version 1026550 (0.0010) [2023-12-28 02:38:08,042][106226] Updated weights for policy 0, policy_version 1026560 (0.0010) [2023-12-28 02:38:08,664][106225] Updated weights for policy 1, policy_version 1029117 (0.0008) [2023-12-28 02:38:08,727][106225] Updated weights for policy 1, policy_version 1029127 (0.0008) [2023-12-28 02:38:08,756][106226] Updated weights for policy 0, policy_version 1026570 (0.0009) [2023-12-28 02:38:08,783][106225] Updated weights for policy 1, policy_version 1029137 (0.0007) [2023-12-28 02:38:08,829][106226] Updated weights for policy 0, policy_version 1026580 (0.0008) [2023-12-28 02:38:08,895][106226] Updated weights for policy 0, policy_version 1026590 (0.0010) [2023-12-28 02:38:09,525][106225] Updated weights for policy 1, policy_version 1029147 (0.0007) [2023-12-28 02:38:09,565][106226] Updated weights for policy 0, policy_version 1026600 (0.0007) [2023-12-28 02:38:09,591][106225] Updated weights for policy 1, policy_version 1029157 (0.0008) [2023-12-28 02:38:09,627][106226] Updated weights for policy 0, policy_version 1026610 (0.0006) [2023-12-28 02:38:09,658][106225] Updated weights for policy 1, policy_version 1029167 (0.0008) [2023-12-28 02:38:09,690][106226] Updated weights for policy 0, policy_version 1026620 (0.0006) [2023-12-28 02:38:10,363][106226] Updated weights for policy 0, policy_version 1026630 (0.0007) [2023-12-28 02:38:10,413][106225] Updated weights for policy 1, policy_version 1029177 (0.0008) [2023-12-28 02:38:10,427][106226] Updated weights for policy 0, policy_version 1026640 (0.0007) [2023-12-28 02:38:10,471][106225] Updated weights for policy 1, policy_version 1029187 (0.0008) [2023-12-28 02:38:10,487][106226] Updated weights for policy 0, policy_version 1026650 (0.0006) [2023-12-28 02:38:10,524][106225] Updated weights for policy 1, policy_version 1029197 (0.0008) [2023-12-28 02:38:10,580][106225] Updated weights for policy 1, policy_version 1029207 (0.0008) [2023-12-28 02:38:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 526401536. Throughput: 0: 10010.8, 1: 9987.9. Samples: 526376544. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:11,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-4.867')] [2023-12-28 02:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001026656_262881280.pth... [2023-12-28 02:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001029208_263520256.pth... [2023-12-28 02:38:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001025472_262578176.pth [2023-12-28 02:38:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001028056_263225344.pth [2023-12-28 02:38:11,239][106226] Updated weights for policy 0, policy_version 1026660 (0.0007) [2023-12-28 02:38:11,280][106225] Updated weights for policy 1, policy_version 1029217 (0.0006) [2023-12-28 02:38:11,307][106226] Updated weights for policy 0, policy_version 1026670 (0.0007) [2023-12-28 02:38:11,344][106225] Updated weights for policy 1, policy_version 1029227 (0.0006) [2023-12-28 02:38:11,378][106226] Updated weights for policy 0, policy_version 1026680 (0.0009) [2023-12-28 02:38:11,419][106225] Updated weights for policy 1, policy_version 1029237 (0.0007) [2023-12-28 02:38:12,066][106225] Updated weights for policy 1, policy_version 1029247 (0.0006) [2023-12-28 02:38:12,115][106226] Updated weights for policy 0, policy_version 1026690 (0.0008) [2023-12-28 02:38:12,135][106225] Updated weights for policy 1, policy_version 1029257 (0.0006) [2023-12-28 02:38:12,176][106226] Updated weights for policy 0, policy_version 1026700 (0.0006) [2023-12-28 02:38:12,201][106225] Updated weights for policy 1, policy_version 1029267 (0.0005) [2023-12-28 02:38:12,238][106226] Updated weights for policy 0, policy_version 1026710 (0.0006) [2023-12-28 02:38:12,305][106226] Updated weights for policy 0, policy_version 1026720 (0.0008) [2023-12-28 02:38:12,902][106225] Updated weights for policy 1, policy_version 1029277 (0.0007) [2023-12-28 02:38:12,944][106226] Updated weights for policy 0, policy_version 1026730 (0.0006) [2023-12-28 02:38:12,962][106225] Updated weights for policy 1, policy_version 1029287 (0.0006) [2023-12-28 02:38:13,002][106226] Updated weights for policy 0, policy_version 1026740 (0.0006) [2023-12-28 02:38:13,016][106225] Updated weights for policy 1, policy_version 1029297 (0.0005) [2023-12-28 02:38:13,060][106226] Updated weights for policy 0, policy_version 1026750 (0.0006) [2023-12-28 02:38:13,651][106225] Updated weights for policy 1, policy_version 1029307 (0.0006) [2023-12-28 02:38:13,692][106226] Updated weights for policy 0, policy_version 1026760 (0.0010) [2023-12-28 02:38:13,706][106225] Updated weights for policy 1, policy_version 1029317 (0.0007) [2023-12-28 02:38:13,742][106226] Updated weights for policy 0, policy_version 1026770 (0.0010) [2023-12-28 02:38:13,768][106225] Updated weights for policy 1, policy_version 1029327 (0.0008) [2023-12-28 02:38:13,804][106226] Updated weights for policy 0, policy_version 1026780 (0.0008) [2023-12-28 02:38:14,497][106225] Updated weights for policy 1, policy_version 1029337 (0.0010) [2023-12-28 02:38:14,514][106226] Updated weights for policy 0, policy_version 1026790 (0.0008) [2023-12-28 02:38:14,561][106225] Updated weights for policy 1, policy_version 1029347 (0.0007) [2023-12-28 02:38:14,567][106226] Updated weights for policy 0, policy_version 1026800 (0.0008) [2023-12-28 02:38:14,622][106225] Updated weights for policy 1, policy_version 1029357 (0.0008) [2023-12-28 02:38:14,625][106226] Updated weights for policy 0, policy_version 1026810 (0.0008) [2023-12-28 02:38:14,683][106225] Updated weights for policy 1, policy_version 1029367 (0.0010) [2023-12-28 02:38:15,383][106226] Updated weights for policy 0, policy_version 1026820 (0.0007) [2023-12-28 02:38:15,403][106225] Updated weights for policy 1, policy_version 1029377 (0.0007) [2023-12-28 02:38:15,447][106226] Updated weights for policy 0, policy_version 1026830 (0.0008) [2023-12-28 02:38:15,462][106225] Updated weights for policy 1, policy_version 1029387 (0.0005) [2023-12-28 02:38:15,515][106226] Updated weights for policy 0, policy_version 1026840 (0.0008) [2023-12-28 02:38:15,522][106225] Updated weights for policy 1, policy_version 1029397 (0.0005) [2023-12-28 02:38:16,100][106225] Updated weights for policy 1, policy_version 1029407 (0.0007) [2023-12-28 02:38:16,160][106225] Updated weights for policy 1, policy_version 1029417 (0.0009) [2023-12-28 02:38:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 526499840. Throughput: 0: 9983.7, 1: 9945.0. Samples: 526494072. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:16,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.927')] [2023-12-28 02:38:16,216][106225] Updated weights for policy 1, policy_version 1029427 (0.0008) [2023-12-28 02:38:16,292][106226] Updated weights for policy 0, policy_version 1026850 (0.0008) [2023-12-28 02:38:16,342][106226] Updated weights for policy 0, policy_version 1026860 (0.0005) [2023-12-28 02:38:16,392][106226] Updated weights for policy 0, policy_version 1026870 (0.0008) [2023-12-28 02:38:16,455][106226] Updated weights for policy 0, policy_version 1026880 (0.0010) [2023-12-28 02:38:16,910][106225] Updated weights for policy 1, policy_version 1029437 (0.0008) [2023-12-28 02:38:16,966][106225] Updated weights for policy 1, policy_version 1029447 (0.0007) [2023-12-28 02:38:17,017][106225] Updated weights for policy 1, policy_version 1029457 (0.0008) [2023-12-28 02:38:17,106][106226] Updated weights for policy 0, policy_version 1026890 (0.0009) [2023-12-28 02:38:17,164][106226] Updated weights for policy 0, policy_version 1026900 (0.0006) [2023-12-28 02:38:17,234][106226] Updated weights for policy 0, policy_version 1026910 (0.0007) [2023-12-28 02:38:17,778][106225] Updated weights for policy 1, policy_version 1029467 (0.0010) [2023-12-28 02:38:17,834][106225] Updated weights for policy 1, policy_version 1029477 (0.0010) [2023-12-28 02:38:17,878][106226] Updated weights for policy 0, policy_version 1026920 (0.0006) [2023-12-28 02:38:17,895][106225] Updated weights for policy 1, policy_version 1029487 (0.0009) [2023-12-28 02:38:17,939][106226] Updated weights for policy 0, policy_version 1026930 (0.0006) [2023-12-28 02:38:17,997][106226] Updated weights for policy 0, policy_version 1026940 (0.0010) [2023-12-28 02:38:18,572][106225] Updated weights for policy 1, policy_version 1029497 (0.0005) [2023-12-28 02:38:18,638][106225] Updated weights for policy 1, policy_version 1029507 (0.0009) [2023-12-28 02:38:18,666][106226] Updated weights for policy 0, policy_version 1026950 (0.0010) [2023-12-28 02:38:18,696][106225] Updated weights for policy 1, policy_version 1029517 (0.0010) [2023-12-28 02:38:18,721][106226] Updated weights for policy 0, policy_version 1026960 (0.0006) [2023-12-28 02:38:18,753][106225] Updated weights for policy 1, policy_version 1029527 (0.0010) [2023-12-28 02:38:18,772][106226] Updated weights for policy 0, policy_version 1026970 (0.0006) [2023-12-28 02:38:19,426][106226] Updated weights for policy 0, policy_version 1026980 (0.0008) [2023-12-28 02:38:19,458][106225] Updated weights for policy 1, policy_version 1029537 (0.0006) [2023-12-28 02:38:19,478][106226] Updated weights for policy 0, policy_version 1026990 (0.0008) [2023-12-28 02:38:19,523][106225] Updated weights for policy 1, policy_version 1029547 (0.0007) [2023-12-28 02:38:19,543][106226] Updated weights for policy 0, policy_version 1027000 (0.0008) [2023-12-28 02:38:19,589][106225] Updated weights for policy 1, policy_version 1029557 (0.0010) [2023-12-28 02:38:20,264][106225] Updated weights for policy 1, policy_version 1029567 (0.0007) [2023-12-28 02:38:20,320][106225] Updated weights for policy 1, policy_version 1029577 (0.0008) [2023-12-28 02:38:20,361][106226] Updated weights for policy 0, policy_version 1027010 (0.0007) [2023-12-28 02:38:20,382][106225] Updated weights for policy 1, policy_version 1029587 (0.0010) [2023-12-28 02:38:20,425][106226] Updated weights for policy 0, policy_version 1027020 (0.0006) [2023-12-28 02:38:20,487][106226] Updated weights for policy 0, policy_version 1027030 (0.0008) [2023-12-28 02:38:20,549][106226] Updated weights for policy 0, policy_version 1027040 (0.0008) [2023-12-28 02:38:21,049][106225] Updated weights for policy 1, policy_version 1029597 (0.0011) [2023-12-28 02:38:21,111][106225] Updated weights for policy 1, policy_version 1029607 (0.0006) [2023-12-28 02:38:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 526598144. Throughput: 0: 10003.0, 1: 9970.7. Samples: 526612756. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:21,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.963')] [2023-12-28 02:38:21,176][106225] Updated weights for policy 1, policy_version 1029617 (0.0010) [2023-12-28 02:38:21,389][106226] Updated weights for policy 0, policy_version 1027050 (0.0007) [2023-12-28 02:38:21,442][106226] Updated weights for policy 0, policy_version 1027060 (0.0006) [2023-12-28 02:38:21,503][106226] Updated weights for policy 0, policy_version 1027070 (0.0007) [2023-12-28 02:38:22,001][106225] Updated weights for policy 1, policy_version 1029627 (0.0010) [2023-12-28 02:38:22,067][106225] Updated weights for policy 1, policy_version 1029637 (0.0009) [2023-12-28 02:38:22,125][106225] Updated weights for policy 1, policy_version 1029647 (0.0009) [2023-12-28 02:38:22,164][106226] Updated weights for policy 0, policy_version 1027080 (0.0006) [2023-12-28 02:38:22,223][106226] Updated weights for policy 0, policy_version 1027090 (0.0008) [2023-12-28 02:38:22,296][106226] Updated weights for policy 0, policy_version 1027100 (0.0010) [2023-12-28 02:38:22,807][106225] Updated weights for policy 1, policy_version 1029657 (0.0008) [2023-12-28 02:38:22,862][106225] Updated weights for policy 1, policy_version 1029667 (0.0008) [2023-12-28 02:38:22,916][106225] Updated weights for policy 1, policy_version 1029677 (0.0007) [2023-12-28 02:38:22,969][106225] Updated weights for policy 1, policy_version 1029687 (0.0007) [2023-12-28 02:38:23,104][106226] Updated weights for policy 0, policy_version 1027110 (0.0009) [2023-12-28 02:38:23,164][106226] Updated weights for policy 0, policy_version 1027120 (0.0009) [2023-12-28 02:38:23,221][106226] Updated weights for policy 0, policy_version 1027130 (0.0009) [2023-12-28 02:38:23,627][106225] Updated weights for policy 1, policy_version 1029697 (0.0006) [2023-12-28 02:38:23,687][106225] Updated weights for policy 1, policy_version 1029707 (0.0006) [2023-12-28 02:38:23,753][106225] Updated weights for policy 1, policy_version 1029717 (0.0009) [2023-12-28 02:38:23,994][106226] Updated weights for policy 0, policy_version 1027140 (0.0009) [2023-12-28 02:38:24,058][106226] Updated weights for policy 0, policy_version 1027150 (0.0008) [2023-12-28 02:38:24,119][106226] Updated weights for policy 0, policy_version 1027160 (0.0008) [2023-12-28 02:38:24,387][106225] Updated weights for policy 1, policy_version 1029727 (0.0008) [2023-12-28 02:38:24,440][106225] Updated weights for policy 1, policy_version 1029737 (0.0008) [2023-12-28 02:38:24,499][106225] Updated weights for policy 1, policy_version 1029747 (0.0009) [2023-12-28 02:38:24,896][106226] Updated weights for policy 0, policy_version 1027170 (0.0008) [2023-12-28 02:38:24,953][106226] Updated weights for policy 0, policy_version 1027180 (0.0009) [2023-12-28 02:38:25,003][106226] Updated weights for policy 0, policy_version 1027190 (0.0007) [2023-12-28 02:38:25,061][106226] Updated weights for policy 0, policy_version 1027200 (0.0009) [2023-12-28 02:38:25,088][106225] Updated weights for policy 1, policy_version 1029757 (0.0007) [2023-12-28 02:38:25,138][106225] Updated weights for policy 1, policy_version 1029767 (0.0006) [2023-12-28 02:38:25,189][106225] Updated weights for policy 1, policy_version 1029777 (0.0005) [2023-12-28 02:38:25,838][106226] Updated weights for policy 0, policy_version 1027210 (0.0009) [2023-12-28 02:38:25,871][106225] Updated weights for policy 1, policy_version 1029787 (0.0006) [2023-12-28 02:38:25,892][106226] Updated weights for policy 0, policy_version 1027220 (0.0007) [2023-12-28 02:38:25,922][106225] Updated weights for policy 1, policy_version 1029797 (0.0006) [2023-12-28 02:38:25,952][106226] Updated weights for policy 0, policy_version 1027230 (0.0007) [2023-12-28 02:38:25,974][106225] Updated weights for policy 1, policy_version 1029807 (0.0007) [2023-12-28 02:38:26,175][105115] Fps is (10 sec: 20478.7, 60 sec: 19933.7, 300 sec: 19771.9). Total num frames: 526704640. Throughput: 0: 9946.5, 1: 9965.2. Samples: 526670516. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:26,176][105115] Avg episode reward: [(0, '-4.695'), (1, '-5.290')] [2023-12-28 02:38:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001029816_263675904.pth... [2023-12-28 02:38:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001027232_263028736.pth... [2023-12-28 02:38:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001026080_262733824.pth [2023-12-28 02:38:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001028664_263380992.pth [2023-12-28 02:38:26,658][106226] Updated weights for policy 0, policy_version 1027240 (0.0008) [2023-12-28 02:38:26,708][106226] Updated weights for policy 0, policy_version 1027250 (0.0008) [2023-12-28 02:38:26,710][106225] Updated weights for policy 1, policy_version 1029817 (0.0007) [2023-12-28 02:38:26,758][106226] Updated weights for policy 0, policy_version 1027260 (0.0006) [2023-12-28 02:38:26,763][106225] Updated weights for policy 1, policy_version 1029827 (0.0006) [2023-12-28 02:38:26,823][106225] Updated weights for policy 1, policy_version 1029837 (0.0008) [2023-12-28 02:38:26,877][106225] Updated weights for policy 1, policy_version 1029847 (0.0008) [2023-12-28 02:38:27,506][106225] Updated weights for policy 1, policy_version 1029857 (0.0008) [2023-12-28 02:38:27,523][106226] Updated weights for policy 0, policy_version 1027270 (0.0006) [2023-12-28 02:38:27,554][106225] Updated weights for policy 1, policy_version 1029867 (0.0009) [2023-12-28 02:38:27,576][106226] Updated weights for policy 0, policy_version 1027280 (0.0007) [2023-12-28 02:38:27,605][106225] Updated weights for policy 1, policy_version 1029877 (0.0010) [2023-12-28 02:38:27,637][106226] Updated weights for policy 0, policy_version 1027290 (0.0006) [2023-12-28 02:38:28,338][106225] Updated weights for policy 1, policy_version 1029887 (0.0007) [2023-12-28 02:38:28,370][106226] Updated weights for policy 0, policy_version 1027300 (0.0009) [2023-12-28 02:38:28,399][106225] Updated weights for policy 1, policy_version 1029897 (0.0006) [2023-12-28 02:38:28,425][106226] Updated weights for policy 0, policy_version 1027310 (0.0007) [2023-12-28 02:38:28,456][106225] Updated weights for policy 1, policy_version 1029907 (0.0010) [2023-12-28 02:38:28,485][106226] Updated weights for policy 0, policy_version 1027320 (0.0005) [2023-12-28 02:38:29,122][106225] Updated weights for policy 1, policy_version 1029917 (0.0008) [2023-12-28 02:38:29,180][106225] Updated weights for policy 1, policy_version 1029927 (0.0010) [2023-12-28 02:38:29,233][106226] Updated weights for policy 0, policy_version 1027330 (0.0007) [2023-12-28 02:38:29,251][106225] Updated weights for policy 1, policy_version 1029937 (0.0010) [2023-12-28 02:38:29,295][106226] Updated weights for policy 0, policy_version 1027340 (0.0008) [2023-12-28 02:38:29,360][106226] Updated weights for policy 0, policy_version 1027350 (0.0009) [2023-12-28 02:38:29,424][106226] Updated weights for policy 0, policy_version 1027360 (0.0009) [2023-12-28 02:38:29,922][106225] Updated weights for policy 1, policy_version 1029947 (0.0006) [2023-12-28 02:38:29,981][106225] Updated weights for policy 1, policy_version 1029957 (0.0010) [2023-12-28 02:38:30,035][106225] Updated weights for policy 1, policy_version 1029967 (0.0010) [2023-12-28 02:38:30,178][106226] Updated weights for policy 0, policy_version 1027370 (0.0006) [2023-12-28 02:38:30,231][106226] Updated weights for policy 0, policy_version 1027380 (0.0005) [2023-12-28 02:38:30,289][106226] Updated weights for policy 0, policy_version 1027390 (0.0006) [2023-12-28 02:38:30,706][106225] Updated weights for policy 1, policy_version 1029977 (0.0010) [2023-12-28 02:38:30,766][106225] Updated weights for policy 1, policy_version 1029987 (0.0008) [2023-12-28 02:38:30,819][106225] Updated weights for policy 1, policy_version 1029997 (0.0008) [2023-12-28 02:38:30,877][106225] Updated weights for policy 1, policy_version 1030007 (0.0008) [2023-12-28 02:38:30,986][106226] Updated weights for policy 0, policy_version 1027400 (0.0008) [2023-12-28 02:38:31,053][106226] Updated weights for policy 0, policy_version 1027410 (0.0010) [2023-12-28 02:38:31,113][106226] Updated weights for policy 0, policy_version 1027420 (0.0008) [2023-12-28 02:38:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 526802944. Throughput: 0: 9885.7, 1: 9978.3. Samples: 526788080. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:31,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-5.103')] [2023-12-28 02:38:31,647][106225] Updated weights for policy 1, policy_version 1030017 (0.0008) [2023-12-28 02:38:31,705][106225] Updated weights for policy 1, policy_version 1030027 (0.0008) [2023-12-28 02:38:31,769][106225] Updated weights for policy 1, policy_version 1030037 (0.0008) [2023-12-28 02:38:31,853][106226] Updated weights for policy 0, policy_version 1027430 (0.0009) [2023-12-28 02:38:31,898][106226] Updated weights for policy 0, policy_version 1027440 (0.0008) [2023-12-28 02:38:31,948][106226] Updated weights for policy 0, policy_version 1027450 (0.0008) [2023-12-28 02:38:32,505][106225] Updated weights for policy 1, policy_version 1030047 (0.0010) [2023-12-28 02:38:32,569][106225] Updated weights for policy 1, policy_version 1030057 (0.0008) [2023-12-28 02:38:32,625][106225] Updated weights for policy 1, policy_version 1030067 (0.0007) [2023-12-28 02:38:32,743][106226] Updated weights for policy 0, policy_version 1027460 (0.0008) [2023-12-28 02:38:32,800][106226] Updated weights for policy 0, policy_version 1027470 (0.0005) [2023-12-28 02:38:32,856][106226] Updated weights for policy 0, policy_version 1027480 (0.0009) [2023-12-28 02:38:33,361][106225] Updated weights for policy 1, policy_version 1030077 (0.0007) [2023-12-28 02:38:33,407][106225] Updated weights for policy 1, policy_version 1030087 (0.0008) [2023-12-28 02:38:33,460][106225] Updated weights for policy 1, policy_version 1030097 (0.0008) [2023-12-28 02:38:33,520][106226] Updated weights for policy 0, policy_version 1027490 (0.0010) [2023-12-28 02:38:33,575][106226] Updated weights for policy 0, policy_version 1027500 (0.0010) [2023-12-28 02:38:33,627][106226] Updated weights for policy 0, policy_version 1027510 (0.0010) [2023-12-28 02:38:33,682][106226] Updated weights for policy 0, policy_version 1027520 (0.0010) [2023-12-28 02:38:34,227][106225] Updated weights for policy 1, policy_version 1030107 (0.0008) [2023-12-28 02:38:34,290][106225] Updated weights for policy 1, policy_version 1030117 (0.0008) [2023-12-28 02:38:34,346][106225] Updated weights for policy 1, policy_version 1030127 (0.0009) [2023-12-28 02:38:34,351][106226] Updated weights for policy 0, policy_version 1027530 (0.0006) [2023-12-28 02:38:34,413][106226] Updated weights for policy 0, policy_version 1027540 (0.0008) [2023-12-28 02:38:34,478][106226] Updated weights for policy 0, policy_version 1027550 (0.0010) [2023-12-28 02:38:35,103][106225] Updated weights for policy 1, policy_version 1030137 (0.0007) [2023-12-28 02:38:35,158][106226] Updated weights for policy 0, policy_version 1027560 (0.0010) [2023-12-28 02:38:35,164][106225] Updated weights for policy 1, policy_version 1030147 (0.0006) [2023-12-28 02:38:35,215][106226] Updated weights for policy 0, policy_version 1027570 (0.0011) [2023-12-28 02:38:35,218][106225] Updated weights for policy 1, policy_version 1030157 (0.0008) [2023-12-28 02:38:35,274][106226] Updated weights for policy 0, policy_version 1027580 (0.0010) [2023-12-28 02:38:35,288][106225] Updated weights for policy 1, policy_version 1030167 (0.0006) [2023-12-28 02:38:35,966][106225] Updated weights for policy 1, policy_version 1030177 (0.0007) [2023-12-28 02:38:35,979][106226] Updated weights for policy 0, policy_version 1027590 (0.0011) [2023-12-28 02:38:36,012][106225] Updated weights for policy 1, policy_version 1030187 (0.0005) [2023-12-28 02:38:36,029][106226] Updated weights for policy 0, policy_version 1027600 (0.0011) [2023-12-28 02:38:36,062][106225] Updated weights for policy 1, policy_version 1030197 (0.0005) [2023-12-28 02:38:36,079][106226] Updated weights for policy 0, policy_version 1027610 (0.0010) [2023-12-28 02:38:36,174][105115] Fps is (10 sec: 19662.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 526901248. Throughput: 0: 9838.3, 1: 9912.8. Samples: 526904528. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:36,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.064')] [2023-12-28 02:38:36,806][106225] Updated weights for policy 1, policy_version 1030207 (0.0007) [2023-12-28 02:38:36,857][106225] Updated weights for policy 1, policy_version 1030217 (0.0007) [2023-12-28 02:38:36,858][106226] Updated weights for policy 0, policy_version 1027620 (0.0011) [2023-12-28 02:38:36,911][106225] Updated weights for policy 1, policy_version 1030227 (0.0007) [2023-12-28 02:38:36,923][106226] Updated weights for policy 0, policy_version 1027630 (0.0011) [2023-12-28 02:38:36,980][106226] Updated weights for policy 0, policy_version 1027640 (0.0011) [2023-12-28 02:38:37,651][106225] Updated weights for policy 1, policy_version 1030237 (0.0009) [2023-12-28 02:38:37,680][106226] Updated weights for policy 0, policy_version 1027650 (0.0011) [2023-12-28 02:38:37,713][106225] Updated weights for policy 1, policy_version 1030247 (0.0008) [2023-12-28 02:38:37,743][106226] Updated weights for policy 0, policy_version 1027660 (0.0011) [2023-12-28 02:38:37,772][106225] Updated weights for policy 1, policy_version 1030257 (0.0006) [2023-12-28 02:38:37,801][106226] Updated weights for policy 0, policy_version 1027670 (0.0011) [2023-12-28 02:38:37,865][106226] Updated weights for policy 0, policy_version 1027680 (0.0011) [2023-12-28 02:38:38,454][106225] Updated weights for policy 1, policy_version 1030267 (0.0006) [2023-12-28 02:38:38,521][106225] Updated weights for policy 1, policy_version 1030277 (0.0006) [2023-12-28 02:38:38,579][106225] Updated weights for policy 1, policy_version 1030287 (0.0009) [2023-12-28 02:38:38,606][106226] Updated weights for policy 0, policy_version 1027690 (0.0009) [2023-12-28 02:38:38,664][106226] Updated weights for policy 0, policy_version 1027700 (0.0010) [2023-12-28 02:38:38,725][106226] Updated weights for policy 0, policy_version 1027710 (0.0011) [2023-12-28 02:38:39,221][106225] Updated weights for policy 1, policy_version 1030297 (0.0010) [2023-12-28 02:38:39,286][106225] Updated weights for policy 1, policy_version 1030307 (0.0008) [2023-12-28 02:38:39,356][106225] Updated weights for policy 1, policy_version 1030317 (0.0009) [2023-12-28 02:38:39,429][106225] Updated weights for policy 1, policy_version 1030327 (0.0008) [2023-12-28 02:38:39,489][106226] Updated weights for policy 0, policy_version 1027720 (0.0009) [2023-12-28 02:38:39,560][106226] Updated weights for policy 0, policy_version 1027730 (0.0007) [2023-12-28 02:38:39,623][106226] Updated weights for policy 0, policy_version 1027740 (0.0010) [2023-12-28 02:38:40,055][106225] Updated weights for policy 1, policy_version 1030337 (0.0007) [2023-12-28 02:38:40,117][106225] Updated weights for policy 1, policy_version 1030347 (0.0007) [2023-12-28 02:38:40,171][106225] Updated weights for policy 1, policy_version 1030357 (0.0008) [2023-12-28 02:38:40,400][106226] Updated weights for policy 0, policy_version 1027750 (0.0009) [2023-12-28 02:38:40,454][106226] Updated weights for policy 0, policy_version 1027760 (0.0009) [2023-12-28 02:38:40,519][106226] Updated weights for policy 0, policy_version 1027770 (0.0009) [2023-12-28 02:38:40,882][106225] Updated weights for policy 1, policy_version 1030367 (0.0008) [2023-12-28 02:38:40,930][106225] Updated weights for policy 1, policy_version 1030377 (0.0008) [2023-12-28 02:38:40,975][106225] Updated weights for policy 1, policy_version 1030387 (0.0009) [2023-12-28 02:38:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 526991360. Throughput: 0: 9820.3, 1: 9924.5. Samples: 526963216. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:41,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.953')] [2023-12-28 02:38:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001030392_263823360.pth... [2023-12-28 02:38:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001029208_263520256.pth [2023-12-28 02:38:41,210][106226] Updated weights for policy 0, policy_version 1027780 (0.0009) [2023-12-28 02:38:41,283][106226] Updated weights for policy 0, policy_version 1027790 (0.0008) [2023-12-28 02:38:41,344][106226] Updated weights for policy 0, policy_version 1027800 (0.0009) [2023-12-28 02:38:41,400][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001027808_263176192.pth... [2023-12-28 02:38:41,405][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001026656_262881280.pth [2023-12-28 02:38:41,835][106225] Updated weights for policy 1, policy_version 1030397 (0.0008) [2023-12-28 02:38:41,893][106225] Updated weights for policy 1, policy_version 1030407 (0.0008) [2023-12-28 02:38:41,940][106225] Updated weights for policy 1, policy_version 1030417 (0.0008) [2023-12-28 02:38:42,113][106226] Updated weights for policy 0, policy_version 1027810 (0.0009) [2023-12-28 02:38:42,184][106226] Updated weights for policy 0, policy_version 1027820 (0.0009) [2023-12-28 02:38:42,253][106226] Updated weights for policy 0, policy_version 1027830 (0.0009) [2023-12-28 02:38:42,318][106226] Updated weights for policy 0, policy_version 1027840 (0.0010) [2023-12-28 02:38:42,664][106225] Updated weights for policy 1, policy_version 1030427 (0.0008) [2023-12-28 02:38:42,720][106225] Updated weights for policy 1, policy_version 1030437 (0.0009) [2023-12-28 02:38:42,781][106225] Updated weights for policy 1, policy_version 1030447 (0.0009) [2023-12-28 02:38:43,027][106226] Updated weights for policy 0, policy_version 1027850 (0.0009) [2023-12-28 02:38:43,087][106226] Updated weights for policy 0, policy_version 1027860 (0.0009) [2023-12-28 02:38:43,146][106226] Updated weights for policy 0, policy_version 1027870 (0.0009) [2023-12-28 02:38:43,522][106225] Updated weights for policy 1, policy_version 1030457 (0.0008) [2023-12-28 02:38:43,578][106225] Updated weights for policy 1, policy_version 1030467 (0.0008) [2023-12-28 02:38:43,633][106225] Updated weights for policy 1, policy_version 1030477 (0.0008) [2023-12-28 02:38:43,684][106225] Updated weights for policy 1, policy_version 1030487 (0.0008) [2023-12-28 02:38:43,843][106226] Updated weights for policy 0, policy_version 1027880 (0.0008) [2023-12-28 02:38:43,895][106226] Updated weights for policy 0, policy_version 1027890 (0.0008) [2023-12-28 02:38:43,944][106226] Updated weights for policy 0, policy_version 1027900 (0.0008) [2023-12-28 02:38:44,420][106225] Updated weights for policy 1, policy_version 1030497 (0.0009) [2023-12-28 02:38:44,478][106225] Updated weights for policy 1, policy_version 1030507 (0.0009) [2023-12-28 02:38:44,527][106225] Updated weights for policy 1, policy_version 1030517 (0.0008) [2023-12-28 02:38:44,658][106226] Updated weights for policy 0, policy_version 1027910 (0.0009) [2023-12-28 02:38:44,706][106226] Updated weights for policy 0, policy_version 1027920 (0.0009) [2023-12-28 02:38:44,750][106226] Updated weights for policy 0, policy_version 1027930 (0.0008) [2023-12-28 02:38:45,299][106225] Updated weights for policy 1, policy_version 1030527 (0.0008) [2023-12-28 02:38:45,366][106225] Updated weights for policy 1, policy_version 1030537 (0.0009) [2023-12-28 02:38:45,430][106225] Updated weights for policy 1, policy_version 1030547 (0.0010) [2023-12-28 02:38:45,522][106226] Updated weights for policy 0, policy_version 1027940 (0.0008) [2023-12-28 02:38:45,573][106226] Updated weights for policy 0, policy_version 1027950 (0.0008) [2023-12-28 02:38:45,635][106226] Updated weights for policy 0, policy_version 1027960 (0.0009) [2023-12-28 02:38:46,159][106225] Updated weights for policy 1, policy_version 1030557 (0.0010) [2023-12-28 02:38:46,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 527081472. Throughput: 0: 9729.6, 1: 9832.9. Samples: 527077020. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:46,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.988')] [2023-12-28 02:38:46,207][106225] Updated weights for policy 1, policy_version 1030567 (0.0010) [2023-12-28 02:38:46,254][106225] Updated weights for policy 1, policy_version 1030577 (0.0010) [2023-12-28 02:38:46,392][106226] Updated weights for policy 0, policy_version 1027970 (0.0008) [2023-12-28 02:38:46,448][106226] Updated weights for policy 0, policy_version 1027980 (0.0008) [2023-12-28 02:38:46,508][106226] Updated weights for policy 0, policy_version 1027990 (0.0008) [2023-12-28 02:38:46,572][106226] Updated weights for policy 0, policy_version 1028000 (0.0008) [2023-12-28 02:38:47,002][106225] Updated weights for policy 1, policy_version 1030587 (0.0010) [2023-12-28 02:38:47,049][106225] Updated weights for policy 1, policy_version 1030597 (0.0010) [2023-12-28 02:38:47,107][106225] Updated weights for policy 1, policy_version 1030607 (0.0010) [2023-12-28 02:38:47,215][106226] Updated weights for policy 0, policy_version 1028010 (0.0010) [2023-12-28 02:38:47,269][106226] Updated weights for policy 0, policy_version 1028020 (0.0005) [2023-12-28 02:38:47,319][106226] Updated weights for policy 0, policy_version 1028030 (0.0005) [2023-12-28 02:38:47,817][106225] Updated weights for policy 1, policy_version 1030617 (0.0010) [2023-12-28 02:38:47,863][106225] Updated weights for policy 1, policy_version 1030627 (0.0005) [2023-12-28 02:38:47,913][106225] Updated weights for policy 1, policy_version 1030637 (0.0009) [2023-12-28 02:38:47,915][106226] Updated weights for policy 0, policy_version 1028040 (0.0010) [2023-12-28 02:38:47,970][106225] Updated weights for policy 1, policy_version 1030647 (0.0010) [2023-12-28 02:38:47,972][106226] Updated weights for policy 0, policy_version 1028050 (0.0011) [2023-12-28 02:38:48,027][106226] Updated weights for policy 0, policy_version 1028060 (0.0010) [2023-12-28 02:38:48,697][106225] Updated weights for policy 1, policy_version 1030657 (0.0007) [2023-12-28 02:38:48,765][106225] Updated weights for policy 1, policy_version 1030667 (0.0007) [2023-12-28 02:38:48,767][106226] Updated weights for policy 0, policy_version 1028070 (0.0008) [2023-12-28 02:38:48,827][106225] Updated weights for policy 1, policy_version 1030677 (0.0006) [2023-12-28 02:38:48,834][106226] Updated weights for policy 0, policy_version 1028080 (0.0006) [2023-12-28 02:38:48,904][106226] Updated weights for policy 0, policy_version 1028090 (0.0006) [2023-12-28 02:38:49,479][106225] Updated weights for policy 1, policy_version 1030687 (0.0008) [2023-12-28 02:38:49,545][106225] Updated weights for policy 1, policy_version 1030697 (0.0009) [2023-12-28 02:38:49,606][106225] Updated weights for policy 1, policy_version 1030707 (0.0007) [2023-12-28 02:38:49,610][106226] Updated weights for policy 0, policy_version 1028100 (0.0006) [2023-12-28 02:38:49,674][106226] Updated weights for policy 0, policy_version 1028110 (0.0008) [2023-12-28 02:38:49,739][106226] Updated weights for policy 0, policy_version 1028120 (0.0008) [2023-12-28 02:38:50,266][106225] Updated weights for policy 1, policy_version 1030717 (0.0009) [2023-12-28 02:38:50,322][106225] Updated weights for policy 1, policy_version 1030727 (0.0010) [2023-12-28 02:38:50,379][106225] Updated weights for policy 1, policy_version 1030737 (0.0010) [2023-12-28 02:38:50,521][106226] Updated weights for policy 0, policy_version 1028130 (0.0008) [2023-12-28 02:38:50,581][106226] Updated weights for policy 0, policy_version 1028140 (0.0009) [2023-12-28 02:38:50,643][106226] Updated weights for policy 0, policy_version 1028150 (0.0008) [2023-12-28 02:38:50,695][106226] Updated weights for policy 0, policy_version 1028160 (0.0008) [2023-12-28 02:38:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 527179776. Throughput: 0: 9625.9, 1: 9816.2. Samples: 527193324. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:51,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.020')] [2023-12-28 02:38:51,187][106225] Updated weights for policy 1, policy_version 1030747 (0.0009) [2023-12-28 02:38:51,242][106225] Updated weights for policy 1, policy_version 1030757 (0.0008) [2023-12-28 02:38:51,307][106225] Updated weights for policy 1, policy_version 1030767 (0.0008) [2023-12-28 02:38:51,458][106226] Updated weights for policy 0, policy_version 1028170 (0.0010) [2023-12-28 02:38:51,510][106226] Updated weights for policy 0, policy_version 1028180 (0.0011) [2023-12-28 02:38:51,564][106226] Updated weights for policy 0, policy_version 1028190 (0.0011) [2023-12-28 02:38:52,063][106225] Updated weights for policy 1, policy_version 1030777 (0.0008) [2023-12-28 02:38:52,111][106225] Updated weights for policy 1, policy_version 1030787 (0.0008) [2023-12-28 02:38:52,170][106225] Updated weights for policy 1, policy_version 1030797 (0.0008) [2023-12-28 02:38:52,222][106226] Updated weights for policy 0, policy_version 1028200 (0.0008) [2023-12-28 02:38:52,231][106225] Updated weights for policy 1, policy_version 1030807 (0.0008) [2023-12-28 02:38:52,287][106226] Updated weights for policy 0, policy_version 1028210 (0.0007) [2023-12-28 02:38:52,352][106226] Updated weights for policy 0, policy_version 1028220 (0.0006) [2023-12-28 02:38:52,971][106225] Updated weights for policy 1, policy_version 1030817 (0.0009) [2023-12-28 02:38:53,021][106226] Updated weights for policy 0, policy_version 1028230 (0.0009) [2023-12-28 02:38:53,023][106225] Updated weights for policy 1, policy_version 1030827 (0.0006) [2023-12-28 02:38:53,073][106225] Updated weights for policy 1, policy_version 1030837 (0.0009) [2023-12-28 02:38:53,082][106226] Updated weights for policy 0, policy_version 1028240 (0.0007) [2023-12-28 02:38:53,147][106226] Updated weights for policy 0, policy_version 1028250 (0.0006) [2023-12-28 02:38:53,734][106226] Updated weights for policy 0, policy_version 1028260 (0.0007) [2023-12-28 02:38:53,793][106226] Updated weights for policy 0, policy_version 1028270 (0.0007) [2023-12-28 02:38:53,822][106225] Updated weights for policy 1, policy_version 1030847 (0.0007) [2023-12-28 02:38:53,854][106226] Updated weights for policy 0, policy_version 1028280 (0.0009) [2023-12-28 02:38:53,878][106225] Updated weights for policy 1, policy_version 1030857 (0.0005) [2023-12-28 02:38:53,933][106225] Updated weights for policy 1, policy_version 1030867 (0.0005) [2023-12-28 02:38:54,547][106225] Updated weights for policy 1, policy_version 1030877 (0.0008) [2023-12-28 02:38:54,582][106226] Updated weights for policy 0, policy_version 1028290 (0.0009) [2023-12-28 02:38:54,594][106225] Updated weights for policy 1, policy_version 1030887 (0.0010) [2023-12-28 02:38:54,637][106225] Updated weights for policy 1, policy_version 1030897 (0.0010) [2023-12-28 02:38:54,646][106226] Updated weights for policy 0, policy_version 1028300 (0.0007) [2023-12-28 02:38:54,709][106226] Updated weights for policy 0, policy_version 1028310 (0.0005) [2023-12-28 02:38:54,769][106226] Updated weights for policy 0, policy_version 1028320 (0.0008) [2023-12-28 02:38:55,354][106226] Updated weights for policy 0, policy_version 1028330 (0.0008) [2023-12-28 02:38:55,375][106225] Updated weights for policy 1, policy_version 1030907 (0.0010) [2023-12-28 02:38:55,412][106226] Updated weights for policy 0, policy_version 1028340 (0.0007) [2023-12-28 02:38:55,437][106225] Updated weights for policy 1, policy_version 1030917 (0.0006) [2023-12-28 02:38:55,465][106226] Updated weights for policy 0, policy_version 1028350 (0.0008) [2023-12-28 02:38:55,502][106225] Updated weights for policy 1, policy_version 1030927 (0.0005) [2023-12-28 02:38:56,069][106225] Updated weights for policy 1, policy_version 1030937 (0.0006) [2023-12-28 02:38:56,127][106225] Updated weights for policy 1, policy_version 1030947 (0.0007) [2023-12-28 02:38:56,151][106226] Updated weights for policy 0, policy_version 1028360 (0.0009) [2023-12-28 02:38:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 527278080. Throughput: 0: 9655.0, 1: 9812.3. Samples: 527252576. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-28 02:38:56,175][106225] Updated weights for policy 1, policy_version 1030957 (0.0010) [2023-12-28 02:38:56,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-5.097')] [2023-12-28 02:38:56,208][106226] Updated weights for policy 0, policy_version 1028370 (0.0008) [2023-12-28 02:38:56,228][106225] Updated weights for policy 1, policy_version 1030967 (0.0007) [2023-12-28 02:38:56,232][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001030968_263970816.pth... [2023-12-28 02:38:56,236][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001029816_263675904.pth [2023-12-28 02:38:56,269][106226] Updated weights for policy 0, policy_version 1028380 (0.0008) [2023-12-28 02:38:56,287][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001028384_263323648.pth... [2023-12-28 02:38:56,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001027232_263028736.pth [2023-12-28 02:38:56,908][106225] Updated weights for policy 1, policy_version 1030977 (0.0006) [2023-12-28 02:38:56,954][106226] Updated weights for policy 0, policy_version 1028390 (0.0007) [2023-12-28 02:38:56,964][106225] Updated weights for policy 1, policy_version 1030987 (0.0005) [2023-12-28 02:38:57,016][106226] Updated weights for policy 0, policy_version 1028400 (0.0005) [2023-12-28 02:38:57,022][106225] Updated weights for policy 1, policy_version 1030997 (0.0005) [2023-12-28 02:38:57,067][106226] Updated weights for policy 0, policy_version 1028410 (0.0006) [2023-12-28 02:38:57,594][106225] Updated weights for policy 1, policy_version 1031007 (0.0007) [2023-12-28 02:38:57,656][106225] Updated weights for policy 1, policy_version 1031017 (0.0008) [2023-12-28 02:38:57,700][106226] Updated weights for policy 0, policy_version 1028420 (0.0009) [2023-12-28 02:38:57,710][106225] Updated weights for policy 1, policy_version 1031027 (0.0006) [2023-12-28 02:38:57,765][106226] Updated weights for policy 0, policy_version 1028430 (0.0008) [2023-12-28 02:38:57,823][106226] Updated weights for policy 0, policy_version 1028440 (0.0008) [2023-12-28 02:38:58,250][106225] Updated weights for policy 1, policy_version 1031037 (0.0006) [2023-12-28 02:38:58,308][106225] Updated weights for policy 1, policy_version 1031047 (0.0008) [2023-12-28 02:38:58,376][106225] Updated weights for policy 1, policy_version 1031057 (0.0007) [2023-12-28 02:38:58,559][106226] Updated weights for policy 0, policy_version 1028450 (0.0006) [2023-12-28 02:38:58,639][106226] Updated weights for policy 0, policy_version 1028461 (0.0007) [2023-12-28 02:38:58,705][106226] Updated weights for policy 0, policy_version 1028471 (0.0007) [2023-12-28 02:38:59,118][106225] Updated weights for policy 1, policy_version 1031067 (0.0007) [2023-12-28 02:38:59,183][106225] Updated weights for policy 1, policy_version 1031077 (0.0007) [2023-12-28 02:38:59,262][106225] Updated weights for policy 1, policy_version 1031087 (0.0008) [2023-12-28 02:38:59,466][106226] Updated weights for policy 0, policy_version 1028481 (0.0007) [2023-12-28 02:38:59,526][106226] Updated weights for policy 0, policy_version 1028491 (0.0008) [2023-12-28 02:38:59,582][106226] Updated weights for policy 0, policy_version 1028501 (0.0006) [2023-12-28 02:38:59,638][106226] Updated weights for policy 0, policy_version 1028511 (0.0008) [2023-12-28 02:38:59,953][106225] Updated weights for policy 1, policy_version 1031097 (0.0008) [2023-12-28 02:39:00,004][106225] Updated weights for policy 1, policy_version 1031107 (0.0009) [2023-12-28 02:39:00,056][106225] Updated weights for policy 1, policy_version 1031117 (0.0008) [2023-12-28 02:39:00,105][106225] Updated weights for policy 1, policy_version 1031127 (0.0006) [2023-12-28 02:39:00,282][106226] Updated weights for policy 0, policy_version 1028521 (0.0006) [2023-12-28 02:39:00,332][106226] Updated weights for policy 0, policy_version 1028531 (0.0005) [2023-12-28 02:39:00,383][106226] Updated weights for policy 0, policy_version 1028541 (0.0007) [2023-12-28 02:39:00,772][106225] Updated weights for policy 1, policy_version 1031137 (0.0006) [2023-12-28 02:39:00,828][106225] Updated weights for policy 1, policy_version 1031147 (0.0005) [2023-12-28 02:39:00,881][106225] Updated weights for policy 1, policy_version 1031157 (0.0006) [2023-12-28 02:39:01,097][106226] Updated weights for policy 0, policy_version 1028551 (0.0009) [2023-12-28 02:39:01,159][106226] Updated weights for policy 0, policy_version 1028561 (0.0011) [2023-12-28 02:39:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 527384576. Throughput: 0: 9688.3, 1: 9913.0. Samples: 527376128. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:01,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.653')] [2023-12-28 02:39:01,225][106226] Updated weights for policy 0, policy_version 1028571 (0.0009) [2023-12-28 02:39:01,487][106225] Updated weights for policy 1, policy_version 1031167 (0.0006) [2023-12-28 02:39:01,545][106225] Updated weights for policy 1, policy_version 1031177 (0.0006) [2023-12-28 02:39:01,597][106225] Updated weights for policy 1, policy_version 1031187 (0.0006) [2023-12-28 02:39:01,914][106226] Updated weights for policy 0, policy_version 1028581 (0.0008) [2023-12-28 02:39:01,972][106226] Updated weights for policy 0, policy_version 1028591 (0.0009) [2023-12-28 02:39:02,038][106226] Updated weights for policy 0, policy_version 1028601 (0.0008) [2023-12-28 02:39:02,355][106225] Updated weights for policy 1, policy_version 1031197 (0.0009) [2023-12-28 02:39:02,413][106225] Updated weights for policy 1, policy_version 1031207 (0.0009) [2023-12-28 02:39:02,469][106225] Updated weights for policy 1, policy_version 1031217 (0.0008) [2023-12-28 02:39:02,794][106226] Updated weights for policy 0, policy_version 1028611 (0.0008) [2023-12-28 02:39:02,858][106226] Updated weights for policy 0, policy_version 1028621 (0.0006) [2023-12-28 02:39:02,916][106226] Updated weights for policy 0, policy_version 1028631 (0.0008) [2023-12-28 02:39:03,080][106225] Updated weights for policy 1, policy_version 1031227 (0.0007) [2023-12-28 02:39:03,133][106225] Updated weights for policy 1, policy_version 1031237 (0.0005) [2023-12-28 02:39:03,180][106225] Updated weights for policy 1, policy_version 1031247 (0.0005) [2023-12-28 02:39:03,536][106226] Updated weights for policy 0, policy_version 1028641 (0.0006) [2023-12-28 02:39:03,594][106226] Updated weights for policy 0, policy_version 1028651 (0.0008) [2023-12-28 02:39:03,653][106226] Updated weights for policy 0, policy_version 1028661 (0.0009) [2023-12-28 02:39:03,719][106226] Updated weights for policy 0, policy_version 1028671 (0.0007) [2023-12-28 02:39:03,905][106225] Updated weights for policy 1, policy_version 1031257 (0.0006) [2023-12-28 02:39:03,961][106225] Updated weights for policy 1, policy_version 1031267 (0.0008) [2023-12-28 02:39:04,024][106225] Updated weights for policy 1, policy_version 1031277 (0.0008) [2023-12-28 02:39:04,087][106225] Updated weights for policy 1, policy_version 1031287 (0.0008) [2023-12-28 02:39:04,356][106226] Updated weights for policy 0, policy_version 1028681 (0.0009) [2023-12-28 02:39:04,411][106226] Updated weights for policy 0, policy_version 1028691 (0.0010) [2023-12-28 02:39:04,470][106226] Updated weights for policy 0, policy_version 1028701 (0.0008) [2023-12-28 02:39:04,831][106225] Updated weights for policy 1, policy_version 1031297 (0.0008) [2023-12-28 02:39:04,895][106225] Updated weights for policy 1, policy_version 1031307 (0.0009) [2023-12-28 02:39:04,944][106225] Updated weights for policy 1, policy_version 1031317 (0.0008) [2023-12-28 02:39:05,088][106226] Updated weights for policy 0, policy_version 1028711 (0.0006) [2023-12-28 02:39:05,144][106226] Updated weights for policy 0, policy_version 1028721 (0.0005) [2023-12-28 02:39:05,201][106226] Updated weights for policy 0, policy_version 1028731 (0.0008) [2023-12-28 02:39:05,604][106225] Updated weights for policy 1, policy_version 1031327 (0.0007) [2023-12-28 02:39:05,654][106225] Updated weights for policy 1, policy_version 1031337 (0.0005) [2023-12-28 02:39:05,706][106225] Updated weights for policy 1, policy_version 1031347 (0.0005) [2023-12-28 02:39:05,937][106226] Updated weights for policy 0, policy_version 1028741 (0.0009) [2023-12-28 02:39:05,986][106226] Updated weights for policy 0, policy_version 1028751 (0.0006) [2023-12-28 02:39:06,047][106226] Updated weights for policy 0, policy_version 1028761 (0.0005) [2023-12-28 02:39:06,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 527491072. Throughput: 0: 9745.7, 1: 9938.7. Samples: 527498552. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:06,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.819')] [2023-12-28 02:39:06,326][106225] Updated weights for policy 1, policy_version 1031357 (0.0005) [2023-12-28 02:39:06,389][106225] Updated weights for policy 1, policy_version 1031367 (0.0005) [2023-12-28 02:39:06,459][106225] Updated weights for policy 1, policy_version 1031377 (0.0008) [2023-12-28 02:39:06,741][106226] Updated weights for policy 0, policy_version 1028771 (0.0006) [2023-12-28 02:39:06,802][106226] Updated weights for policy 0, policy_version 1028781 (0.0009) [2023-12-28 02:39:06,851][106226] Updated weights for policy 0, policy_version 1028791 (0.0008) [2023-12-28 02:39:07,113][106225] Updated weights for policy 1, policy_version 1031387 (0.0008) [2023-12-28 02:39:07,176][106225] Updated weights for policy 1, policy_version 1031397 (0.0007) [2023-12-28 02:39:07,230][106225] Updated weights for policy 1, policy_version 1031407 (0.0008) [2023-12-28 02:39:07,542][106226] Updated weights for policy 0, policy_version 1028801 (0.0009) [2023-12-28 02:39:07,596][106226] Updated weights for policy 0, policy_version 1028811 (0.0011) [2023-12-28 02:39:07,643][106226] Updated weights for policy 0, policy_version 1028821 (0.0010) [2023-12-28 02:39:07,689][106226] Updated weights for policy 0, policy_version 1028831 (0.0010) [2023-12-28 02:39:07,964][106225] Updated weights for policy 1, policy_version 1031417 (0.0008) [2023-12-28 02:39:08,021][106225] Updated weights for policy 1, policy_version 1031427 (0.0008) [2023-12-28 02:39:08,070][106225] Updated weights for policy 1, policy_version 1031437 (0.0007) [2023-12-28 02:39:08,120][106225] Updated weights for policy 1, policy_version 1031447 (0.0008) [2023-12-28 02:39:08,447][106226] Updated weights for policy 0, policy_version 1028841 (0.0011) [2023-12-28 02:39:08,508][106226] Updated weights for policy 0, policy_version 1028851 (0.0011) [2023-12-28 02:39:08,570][106226] Updated weights for policy 0, policy_version 1028861 (0.0011) [2023-12-28 02:39:08,891][106225] Updated weights for policy 1, policy_version 1031457 (0.0008) [2023-12-28 02:39:08,944][106225] Updated weights for policy 1, policy_version 1031467 (0.0007) [2023-12-28 02:39:08,998][106225] Updated weights for policy 1, policy_version 1031477 (0.0008) [2023-12-28 02:39:09,316][106226] Updated weights for policy 0, policy_version 1028871 (0.0011) [2023-12-28 02:39:09,389][106226] Updated weights for policy 0, policy_version 1028881 (0.0009) [2023-12-28 02:39:09,453][106226] Updated weights for policy 0, policy_version 1028891 (0.0008) [2023-12-28 02:39:09,784][106225] Updated weights for policy 1, policy_version 1031487 (0.0009) [2023-12-28 02:39:09,836][106225] Updated weights for policy 1, policy_version 1031497 (0.0008) [2023-12-28 02:39:09,904][106225] Updated weights for policy 1, policy_version 1031507 (0.0008) [2023-12-28 02:39:10,214][106226] Updated weights for policy 0, policy_version 1028901 (0.0009) [2023-12-28 02:39:10,281][106226] Updated weights for policy 0, policy_version 1028911 (0.0010) [2023-12-28 02:39:10,350][106226] Updated weights for policy 0, policy_version 1028921 (0.0010) [2023-12-28 02:39:10,601][106225] Updated weights for policy 1, policy_version 1031517 (0.0007) [2023-12-28 02:39:10,666][106225] Updated weights for policy 1, policy_version 1031527 (0.0009) [2023-12-28 02:39:10,739][106225] Updated weights for policy 1, policy_version 1031537 (0.0008) [2023-12-28 02:39:11,070][106226] Updated weights for policy 0, policy_version 1028931 (0.0008) [2023-12-28 02:39:11,131][106226] Updated weights for policy 0, policy_version 1028941 (0.0009) [2023-12-28 02:39:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 527581184. Throughput: 0: 9784.7, 1: 9929.5. Samples: 527557648. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:11,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-4.530')] [2023-12-28 02:39:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001031544_264118272.pth... [2023-12-28 02:39:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001030392_263823360.pth [2023-12-28 02:39:11,205][106226] Updated weights for policy 0, policy_version 1028951 (0.0008) [2023-12-28 02:39:11,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001028960_263471104.pth... [2023-12-28 02:39:11,275][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001027808_263176192.pth [2023-12-28 02:39:11,495][106225] Updated weights for policy 1, policy_version 1031547 (0.0007) [2023-12-28 02:39:11,557][106225] Updated weights for policy 1, policy_version 1031557 (0.0008) [2023-12-28 02:39:11,619][106225] Updated weights for policy 1, policy_version 1031567 (0.0008) [2023-12-28 02:39:11,970][106226] Updated weights for policy 0, policy_version 1028961 (0.0009) [2023-12-28 02:39:12,035][106226] Updated weights for policy 0, policy_version 1028971 (0.0008) [2023-12-28 02:39:12,100][106226] Updated weights for policy 0, policy_version 1028981 (0.0008) [2023-12-28 02:39:12,164][106226] Updated weights for policy 0, policy_version 1028991 (0.0008) [2023-12-28 02:39:12,458][106225] Updated weights for policy 1, policy_version 1031577 (0.0009) [2023-12-28 02:39:12,512][106225] Updated weights for policy 1, policy_version 1031587 (0.0008) [2023-12-28 02:39:12,565][106225] Updated weights for policy 1, policy_version 1031597 (0.0009) [2023-12-28 02:39:12,633][106225] Updated weights for policy 1, policy_version 1031607 (0.0009) [2023-12-28 02:39:12,797][106226] Updated weights for policy 0, policy_version 1029001 (0.0007) [2023-12-28 02:39:12,859][106226] Updated weights for policy 0, policy_version 1029011 (0.0009) [2023-12-28 02:39:12,914][106226] Updated weights for policy 0, policy_version 1029021 (0.0007) [2023-12-28 02:39:13,399][106225] Updated weights for policy 1, policy_version 1031617 (0.0009) [2023-12-28 02:39:13,456][106225] Updated weights for policy 1, policy_version 1031627 (0.0008) [2023-12-28 02:39:13,500][106225] Updated weights for policy 1, policy_version 1031637 (0.0008) [2023-12-28 02:39:13,590][106226] Updated weights for policy 0, policy_version 1029031 (0.0008) [2023-12-28 02:39:13,645][106226] Updated weights for policy 0, policy_version 1029041 (0.0009) [2023-12-28 02:39:13,704][106226] Updated weights for policy 0, policy_version 1029051 (0.0008) [2023-12-28 02:39:14,178][106225] Updated weights for policy 1, policy_version 1031647 (0.0008) [2023-12-28 02:39:14,229][106225] Updated weights for policy 1, policy_version 1031657 (0.0008) [2023-12-28 02:39:14,282][106225] Updated weights for policy 1, policy_version 1031667 (0.0008) [2023-12-28 02:39:14,434][106226] Updated weights for policy 0, policy_version 1029061 (0.0009) [2023-12-28 02:39:14,493][106226] Updated weights for policy 0, policy_version 1029071 (0.0010) [2023-12-28 02:39:14,560][106226] Updated weights for policy 0, policy_version 1029081 (0.0010) [2023-12-28 02:39:14,869][106225] Updated weights for policy 1, policy_version 1031677 (0.0006) [2023-12-28 02:39:14,931][106225] Updated weights for policy 1, policy_version 1031687 (0.0008) [2023-12-28 02:39:14,999][106225] Updated weights for policy 1, policy_version 1031697 (0.0006) [2023-12-28 02:39:15,254][106226] Updated weights for policy 0, policy_version 1029091 (0.0011) [2023-12-28 02:39:15,316][106226] Updated weights for policy 0, policy_version 1029101 (0.0011) [2023-12-28 02:39:15,382][106226] Updated weights for policy 0, policy_version 1029111 (0.0011) [2023-12-28 02:39:15,630][106225] Updated weights for policy 1, policy_version 1031707 (0.0006) [2023-12-28 02:39:15,692][106225] Updated weights for policy 1, policy_version 1031717 (0.0005) [2023-12-28 02:39:15,758][106225] Updated weights for policy 1, policy_version 1031727 (0.0007) [2023-12-28 02:39:15,954][106226] Updated weights for policy 0, policy_version 1029121 (0.0010) [2023-12-28 02:39:16,017][106226] Updated weights for policy 0, policy_version 1029131 (0.0009) [2023-12-28 02:39:16,070][106226] Updated weights for policy 0, policy_version 1029141 (0.0010) [2023-12-28 02:39:16,116][106226] Updated weights for policy 0, policy_version 1029151 (0.0010) [2023-12-28 02:39:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 527687680. Throughput: 0: 9808.0, 1: 9846.6. Samples: 527672536. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:16,175][105115] Avg episode reward: [(0, '-4.711'), (1, '-4.862')] [2023-12-28 02:39:16,334][106225] Updated weights for policy 1, policy_version 1031737 (0.0006) [2023-12-28 02:39:16,396][106225] Updated weights for policy 1, policy_version 1031747 (0.0009) [2023-12-28 02:39:16,450][106225] Updated weights for policy 1, policy_version 1031757 (0.0010) [2023-12-28 02:39:16,514][106225] Updated weights for policy 1, policy_version 1031767 (0.0010) [2023-12-28 02:39:16,769][106226] Updated weights for policy 0, policy_version 1029161 (0.0010) [2023-12-28 02:39:16,827][106226] Updated weights for policy 0, policy_version 1029171 (0.0006) [2023-12-28 02:39:16,891][106226] Updated weights for policy 0, policy_version 1029181 (0.0006) [2023-12-28 02:39:17,177][106225] Updated weights for policy 1, policy_version 1031777 (0.0010) [2023-12-28 02:39:17,235][106225] Updated weights for policy 1, policy_version 1031787 (0.0010) [2023-12-28 02:39:17,293][106225] Updated weights for policy 1, policy_version 1031797 (0.0008) [2023-12-28 02:39:17,581][106226] Updated weights for policy 0, policy_version 1029191 (0.0010) [2023-12-28 02:39:17,638][106226] Updated weights for policy 0, policy_version 1029201 (0.0010) [2023-12-28 02:39:17,721][106226] Updated weights for policy 0, policy_version 1029211 (0.0009) [2023-12-28 02:39:18,023][106225] Updated weights for policy 1, policy_version 1031807 (0.0010) [2023-12-28 02:39:18,086][106225] Updated weights for policy 1, policy_version 1031817 (0.0009) [2023-12-28 02:39:18,151][106225] Updated weights for policy 1, policy_version 1031827 (0.0010) [2023-12-28 02:39:18,466][106226] Updated weights for policy 0, policy_version 1029221 (0.0008) [2023-12-28 02:39:18,528][106226] Updated weights for policy 0, policy_version 1029231 (0.0008) [2023-12-28 02:39:18,595][106226] Updated weights for policy 0, policy_version 1029241 (0.0009) [2023-12-28 02:39:18,800][106225] Updated weights for policy 1, policy_version 1031837 (0.0006) [2023-12-28 02:39:18,863][106225] Updated weights for policy 1, policy_version 1031847 (0.0005) [2023-12-28 02:39:18,930][106225] Updated weights for policy 1, policy_version 1031857 (0.0005) [2023-12-28 02:39:19,317][106226] Updated weights for policy 0, policy_version 1029251 (0.0011) [2023-12-28 02:39:19,392][106226] Updated weights for policy 0, policy_version 1029261 (0.0010) [2023-12-28 02:39:19,451][106226] Updated weights for policy 0, policy_version 1029271 (0.0006) [2023-12-28 02:39:19,547][106225] Updated weights for policy 1, policy_version 1031867 (0.0006) [2023-12-28 02:39:19,605][106225] Updated weights for policy 1, policy_version 1031877 (0.0008) [2023-12-28 02:39:19,673][106225] Updated weights for policy 1, policy_version 1031887 (0.0007) [2023-12-28 02:39:20,214][106226] Updated weights for policy 0, policy_version 1029281 (0.0009) [2023-12-28 02:39:20,278][106226] Updated weights for policy 0, policy_version 1029291 (0.0008) [2023-12-28 02:39:20,341][106226] Updated weights for policy 0, policy_version 1029301 (0.0008) [2023-12-28 02:39:20,374][106225] Updated weights for policy 1, policy_version 1031897 (0.0008) [2023-12-28 02:39:20,402][106226] Updated weights for policy 0, policy_version 1029311 (0.0006) [2023-12-28 02:39:20,439][106225] Updated weights for policy 1, policy_version 1031907 (0.0008) [2023-12-28 02:39:20,508][106225] Updated weights for policy 1, policy_version 1031917 (0.0006) [2023-12-28 02:39:20,581][106225] Updated weights for policy 1, policy_version 1031927 (0.0006) [2023-12-28 02:39:21,038][106226] Updated weights for policy 0, policy_version 1029321 (0.0008) [2023-12-28 02:39:21,100][106226] Updated weights for policy 0, policy_version 1029331 (0.0008) [2023-12-28 02:39:21,168][106226] Updated weights for policy 0, policy_version 1029341 (0.0009) [2023-12-28 02:39:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 527777792. Throughput: 0: 9832.2, 1: 9951.5. Samples: 527794792. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:21,175][105115] Avg episode reward: [(0, '-4.858'), (1, '-4.707')] [2023-12-28 02:39:21,339][106225] Updated weights for policy 1, policy_version 1031937 (0.0008) [2023-12-28 02:39:21,408][106225] Updated weights for policy 1, policy_version 1031947 (0.0008) [2023-12-28 02:39:21,474][106225] Updated weights for policy 1, policy_version 1031957 (0.0007) [2023-12-28 02:39:21,941][106226] Updated weights for policy 0, policy_version 1029351 (0.0009) [2023-12-28 02:39:22,000][106226] Updated weights for policy 0, policy_version 1029361 (0.0009) [2023-12-28 02:39:22,066][106226] Updated weights for policy 0, policy_version 1029371 (0.0009) [2023-12-28 02:39:22,142][106225] Updated weights for policy 1, policy_version 1031967 (0.0007) [2023-12-28 02:39:22,200][106225] Updated weights for policy 1, policy_version 1031977 (0.0008) [2023-12-28 02:39:22,273][106225] Updated weights for policy 1, policy_version 1031987 (0.0008) [2023-12-28 02:39:22,789][106226] Updated weights for policy 0, policy_version 1029381 (0.0009) [2023-12-28 02:39:22,857][106226] Updated weights for policy 0, policy_version 1029391 (0.0010) [2023-12-28 02:39:22,915][106226] Updated weights for policy 0, policy_version 1029401 (0.0011) [2023-12-28 02:39:23,030][106225] Updated weights for policy 1, policy_version 1031997 (0.0009) [2023-12-28 02:39:23,094][106225] Updated weights for policy 1, policy_version 1032007 (0.0010) [2023-12-28 02:39:23,154][106225] Updated weights for policy 1, policy_version 1032017 (0.0008) [2023-12-28 02:39:23,558][106226] Updated weights for policy 0, policy_version 1029411 (0.0011) [2023-12-28 02:39:23,612][106226] Updated weights for policy 0, policy_version 1029421 (0.0011) [2023-12-28 02:39:23,668][106226] Updated weights for policy 0, policy_version 1029431 (0.0010) [2023-12-28 02:39:23,849][106225] Updated weights for policy 1, policy_version 1032027 (0.0008) [2023-12-28 02:39:23,902][106225] Updated weights for policy 1, policy_version 1032037 (0.0010) [2023-12-28 02:39:23,948][106225] Updated weights for policy 1, policy_version 1032047 (0.0010) [2023-12-28 02:39:24,216][106226] Updated weights for policy 0, policy_version 1029441 (0.0010) [2023-12-28 02:39:24,274][106226] Updated weights for policy 0, policy_version 1029451 (0.0005) [2023-12-28 02:39:24,342][106226] Updated weights for policy 0, policy_version 1029461 (0.0005) [2023-12-28 02:39:24,402][106226] Updated weights for policy 0, policy_version 1029471 (0.0006) [2023-12-28 02:39:24,682][106225] Updated weights for policy 1, policy_version 1032057 (0.0010) [2023-12-28 02:39:24,735][106225] Updated weights for policy 1, policy_version 1032067 (0.0010) [2023-12-28 02:39:24,798][106225] Updated weights for policy 1, policy_version 1032077 (0.0010) [2023-12-28 02:39:24,851][106225] Updated weights for policy 1, policy_version 1032087 (0.0010) [2023-12-28 02:39:25,020][106226] Updated weights for policy 0, policy_version 1029481 (0.0010) [2023-12-28 02:39:25,084][106226] Updated weights for policy 0, policy_version 1029491 (0.0010) [2023-12-28 02:39:25,134][106226] Updated weights for policy 0, policy_version 1029501 (0.0010) [2023-12-28 02:39:25,573][106225] Updated weights for policy 1, policy_version 1032097 (0.0010) [2023-12-28 02:39:25,626][106225] Updated weights for policy 1, policy_version 1032107 (0.0010) [2023-12-28 02:39:25,675][106225] Updated weights for policy 1, policy_version 1032117 (0.0010) [2023-12-28 02:39:25,774][106226] Updated weights for policy 0, policy_version 1029511 (0.0007) [2023-12-28 02:39:25,826][106226] Updated weights for policy 0, policy_version 1029521 (0.0005) [2023-12-28 02:39:25,884][106226] Updated weights for policy 0, policy_version 1029531 (0.0006) [2023-12-28 02:39:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19661.0, 300 sec: 19744.1). Total num frames: 527884288. Throughput: 0: 9858.2, 1: 9914.3. Samples: 527852980. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:26,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-5.011')] [2023-12-28 02:39:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001032120_264265728.pth... [2023-12-28 02:39:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001029536_263618560.pth... [2023-12-28 02:39:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001028384_263323648.pth [2023-12-28 02:39:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001030968_263970816.pth [2023-12-28 02:39:26,409][106225] Updated weights for policy 1, policy_version 1032127 (0.0010) [2023-12-28 02:39:26,468][106225] Updated weights for policy 1, policy_version 1032137 (0.0010) [2023-12-28 02:39:26,518][106225] Updated weights for policy 1, policy_version 1032147 (0.0010) [2023-12-28 02:39:26,592][106226] Updated weights for policy 0, policy_version 1029541 (0.0008) [2023-12-28 02:39:26,652][106226] Updated weights for policy 0, policy_version 1029551 (0.0007) [2023-12-28 02:39:26,704][106226] Updated weights for policy 0, policy_version 1029561 (0.0007) [2023-12-28 02:39:27,236][106225] Updated weights for policy 1, policy_version 1032157 (0.0010) [2023-12-28 02:39:27,294][106225] Updated weights for policy 1, policy_version 1032167 (0.0010) [2023-12-28 02:39:27,355][106225] Updated weights for policy 1, policy_version 1032177 (0.0007) [2023-12-28 02:39:27,419][106226] Updated weights for policy 0, policy_version 1029571 (0.0007) [2023-12-28 02:39:27,468][106226] Updated weights for policy 0, policy_version 1029581 (0.0007) [2023-12-28 02:39:27,526][106226] Updated weights for policy 0, policy_version 1029591 (0.0010) [2023-12-28 02:39:27,928][106225] Updated weights for policy 1, policy_version 1032187 (0.0008) [2023-12-28 02:39:27,980][106225] Updated weights for policy 1, policy_version 1032197 (0.0005) [2023-12-28 02:39:28,037][106225] Updated weights for policy 1, policy_version 1032207 (0.0006) [2023-12-28 02:39:28,174][106226] Updated weights for policy 0, policy_version 1029601 (0.0006) [2023-12-28 02:39:28,241][106226] Updated weights for policy 0, policy_version 1029611 (0.0006) [2023-12-28 02:39:28,305][106226] Updated weights for policy 0, policy_version 1029621 (0.0009) [2023-12-28 02:39:28,366][106226] Updated weights for policy 0, policy_version 1029631 (0.0007) [2023-12-28 02:39:28,623][106225] Updated weights for policy 1, policy_version 1032217 (0.0005) [2023-12-28 02:39:28,683][106225] Updated weights for policy 1, policy_version 1032227 (0.0005) [2023-12-28 02:39:28,743][106225] Updated weights for policy 1, policy_version 1032237 (0.0005) [2023-12-28 02:39:28,792][106225] Updated weights for policy 1, policy_version 1032247 (0.0005) [2023-12-28 02:39:29,138][106226] Updated weights for policy 0, policy_version 1029641 (0.0008) [2023-12-28 02:39:29,190][106226] Updated weights for policy 0, policy_version 1029651 (0.0009) [2023-12-28 02:39:29,254][106226] Updated weights for policy 0, policy_version 1029661 (0.0009) [2023-12-28 02:39:29,420][106225] Updated weights for policy 1, policy_version 1032257 (0.0008) [2023-12-28 02:39:29,482][106225] Updated weights for policy 1, policy_version 1032267 (0.0007) [2023-12-28 02:39:29,550][106225] Updated weights for policy 1, policy_version 1032277 (0.0008) [2023-12-28 02:39:29,973][106226] Updated weights for policy 0, policy_version 1029671 (0.0008) [2023-12-28 02:39:30,037][106226] Updated weights for policy 0, policy_version 1029681 (0.0007) [2023-12-28 02:39:30,109][106226] Updated weights for policy 0, policy_version 1029691 (0.0005) [2023-12-28 02:39:30,274][106225] Updated weights for policy 1, policy_version 1032287 (0.0008) [2023-12-28 02:39:30,333][106225] Updated weights for policy 1, policy_version 1032297 (0.0009) [2023-12-28 02:39:30,395][106225] Updated weights for policy 1, policy_version 1032307 (0.0010) [2023-12-28 02:39:30,628][106226] Updated weights for policy 0, policy_version 1029701 (0.0006) [2023-12-28 02:39:30,673][106226] Updated weights for policy 0, policy_version 1029711 (0.0005) [2023-12-28 02:39:30,726][106226] Updated weights for policy 0, policy_version 1029721 (0.0005) [2023-12-28 02:39:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 527982592. Throughput: 0: 9944.9, 1: 10010.8. Samples: 527975024. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:31,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-4.729')] [2023-12-28 02:39:31,206][106225] Updated weights for policy 1, policy_version 1032317 (0.0009) [2023-12-28 02:39:31,278][106225] Updated weights for policy 1, policy_version 1032327 (0.0008) [2023-12-28 02:39:31,316][106226] Updated weights for policy 0, policy_version 1029731 (0.0005) [2023-12-28 02:39:31,344][106225] Updated weights for policy 1, policy_version 1032337 (0.0008) [2023-12-28 02:39:31,383][106226] Updated weights for policy 0, policy_version 1029741 (0.0007) [2023-12-28 02:39:31,442][106226] Updated weights for policy 0, policy_version 1029751 (0.0008) [2023-12-28 02:39:32,064][106225] Updated weights for policy 1, policy_version 1032347 (0.0009) [2023-12-28 02:39:32,125][106225] Updated weights for policy 1, policy_version 1032357 (0.0009) [2023-12-28 02:39:32,155][106226] Updated weights for policy 0, policy_version 1029761 (0.0008) [2023-12-28 02:39:32,176][106225] Updated weights for policy 1, policy_version 1032367 (0.0008) [2023-12-28 02:39:32,214][106226] Updated weights for policy 0, policy_version 1029771 (0.0006) [2023-12-28 02:39:32,280][106226] Updated weights for policy 0, policy_version 1029781 (0.0008) [2023-12-28 02:39:32,338][106226] Updated weights for policy 0, policy_version 1029791 (0.0009) [2023-12-28 02:39:32,865][106225] Updated weights for policy 1, policy_version 1032377 (0.0010) [2023-12-28 02:39:32,925][106225] Updated weights for policy 1, policy_version 1032387 (0.0010) [2023-12-28 02:39:32,990][106225] Updated weights for policy 1, policy_version 1032397 (0.0011) [2023-12-28 02:39:33,052][106225] Updated weights for policy 1, policy_version 1032407 (0.0010) [2023-12-28 02:39:33,073][106226] Updated weights for policy 0, policy_version 1029801 (0.0007) [2023-12-28 02:39:33,132][106226] Updated weights for policy 0, policy_version 1029811 (0.0008) [2023-12-28 02:39:33,186][106226] Updated weights for policy 0, policy_version 1029821 (0.0008) [2023-12-28 02:39:33,733][106225] Updated weights for policy 1, policy_version 1032417 (0.0008) [2023-12-28 02:39:33,780][106225] Updated weights for policy 1, policy_version 1032427 (0.0006) [2023-12-28 02:39:33,837][106225] Updated weights for policy 1, policy_version 1032437 (0.0005) [2023-12-28 02:39:33,850][106226] Updated weights for policy 0, policy_version 1029831 (0.0009) [2023-12-28 02:39:33,898][106226] Updated weights for policy 0, policy_version 1029841 (0.0008) [2023-12-28 02:39:33,948][106226] Updated weights for policy 0, policy_version 1029851 (0.0009) [2023-12-28 02:39:34,414][106225] Updated weights for policy 1, policy_version 1032447 (0.0006) [2023-12-28 02:39:34,481][106225] Updated weights for policy 1, policy_version 1032457 (0.0006) [2023-12-28 02:39:34,542][106225] Updated weights for policy 1, policy_version 1032467 (0.0006) [2023-12-28 02:39:34,748][106226] Updated weights for policy 0, policy_version 1029861 (0.0008) [2023-12-28 02:39:34,799][106226] Updated weights for policy 0, policy_version 1029871 (0.0008) [2023-12-28 02:39:34,859][106226] Updated weights for policy 0, policy_version 1029881 (0.0009) [2023-12-28 02:39:35,140][106225] Updated weights for policy 1, policy_version 1032477 (0.0005) [2023-12-28 02:39:35,195][106225] Updated weights for policy 1, policy_version 1032487 (0.0005) [2023-12-28 02:39:35,246][106225] Updated weights for policy 1, policy_version 1032497 (0.0005) [2023-12-28 02:39:35,697][106226] Updated weights for policy 0, policy_version 1029891 (0.0008) [2023-12-28 02:39:35,751][106226] Updated weights for policy 0, policy_version 1029901 (0.0010) [2023-12-28 02:39:35,764][106225] Updated weights for policy 1, policy_version 1032507 (0.0005) [2023-12-28 02:39:35,808][106226] Updated weights for policy 0, policy_version 1029911 (0.0007) [2023-12-28 02:39:35,817][106225] Updated weights for policy 1, policy_version 1032517 (0.0006) [2023-12-28 02:39:35,869][106225] Updated weights for policy 1, policy_version 1032527 (0.0007) [2023-12-28 02:39:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 528089088. Throughput: 0: 9968.0, 1: 10095.3. Samples: 528096172. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:36,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.780')] [2023-12-28 02:39:36,562][106225] Updated weights for policy 1, policy_version 1032537 (0.0008) [2023-12-28 02:39:36,602][106226] Updated weights for policy 0, policy_version 1029921 (0.0008) [2023-12-28 02:39:36,622][106225] Updated weights for policy 1, policy_version 1032547 (0.0006) [2023-12-28 02:39:36,664][106226] Updated weights for policy 0, policy_version 1029931 (0.0008) [2023-12-28 02:39:36,678][106225] Updated weights for policy 1, policy_version 1032557 (0.0007) [2023-12-28 02:39:36,728][106226] Updated weights for policy 0, policy_version 1029941 (0.0006) [2023-12-28 02:39:36,738][106225] Updated weights for policy 1, policy_version 1032567 (0.0007) [2023-12-28 02:39:36,789][106226] Updated weights for policy 0, policy_version 1029951 (0.0008) [2023-12-28 02:39:37,329][106225] Updated weights for policy 1, policy_version 1032577 (0.0007) [2023-12-28 02:39:37,377][106225] Updated weights for policy 1, policy_version 1032587 (0.0006) [2023-12-28 02:39:37,428][106225] Updated weights for policy 1, policy_version 1032597 (0.0008) [2023-12-28 02:39:37,589][106226] Updated weights for policy 0, policy_version 1029961 (0.0009) [2023-12-28 02:39:37,649][106226] Updated weights for policy 0, policy_version 1029971 (0.0009) [2023-12-28 02:39:37,713][106226] Updated weights for policy 0, policy_version 1029981 (0.0009) [2023-12-28 02:39:38,039][106225] Updated weights for policy 1, policy_version 1032607 (0.0009) [2023-12-28 02:39:38,102][106225] Updated weights for policy 1, policy_version 1032617 (0.0009) [2023-12-28 02:39:38,166][106225] Updated weights for policy 1, policy_version 1032627 (0.0009) [2023-12-28 02:39:38,501][106226] Updated weights for policy 0, policy_version 1029991 (0.0008) [2023-12-28 02:39:38,557][106226] Updated weights for policy 0, policy_version 1030001 (0.0009) [2023-12-28 02:39:38,611][106226] Updated weights for policy 0, policy_version 1030011 (0.0009) [2023-12-28 02:39:38,908][106225] Updated weights for policy 1, policy_version 1032637 (0.0008) [2023-12-28 02:39:38,967][106225] Updated weights for policy 1, policy_version 1032647 (0.0008) [2023-12-28 02:39:39,026][106225] Updated weights for policy 1, policy_version 1032657 (0.0008) [2023-12-28 02:39:39,391][106226] Updated weights for policy 0, policy_version 1030021 (0.0008) [2023-12-28 02:39:39,463][106226] Updated weights for policy 0, policy_version 1030031 (0.0009) [2023-12-28 02:39:39,528][106226] Updated weights for policy 0, policy_version 1030041 (0.0008) [2023-12-28 02:39:39,766][106225] Updated weights for policy 1, policy_version 1032667 (0.0009) [2023-12-28 02:39:39,831][106225] Updated weights for policy 1, policy_version 1032677 (0.0008) [2023-12-28 02:39:39,900][106225] Updated weights for policy 1, policy_version 1032687 (0.0008) [2023-12-28 02:39:40,231][106226] Updated weights for policy 0, policy_version 1030051 (0.0009) [2023-12-28 02:39:40,277][106226] Updated weights for policy 0, policy_version 1030061 (0.0009) [2023-12-28 02:39:40,332][106226] Updated weights for policy 0, policy_version 1030071 (0.0009) [2023-12-28 02:39:40,648][106225] Updated weights for policy 1, policy_version 1032697 (0.0008) [2023-12-28 02:39:40,696][106225] Updated weights for policy 1, policy_version 1032707 (0.0008) [2023-12-28 02:39:40,751][106225] Updated weights for policy 1, policy_version 1032717 (0.0007) [2023-12-28 02:39:40,804][106225] Updated weights for policy 1, policy_version 1032727 (0.0008) [2023-12-28 02:39:41,082][106226] Updated weights for policy 0, policy_version 1030081 (0.0009) [2023-12-28 02:39:41,159][106226] Updated weights for policy 0, policy_version 1030091 (0.0009) [2023-12-28 02:39:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 528179200. Throughput: 0: 9875.8, 1: 10175.1. Samples: 528154868. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:41,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.956')] [2023-12-28 02:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001032728_264421376.pth... [2023-12-28 02:39:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001031544_264118272.pth [2023-12-28 02:39:41,219][106226] Updated weights for policy 0, policy_version 1030101 (0.0006) [2023-12-28 02:39:41,284][106226] Updated weights for policy 0, policy_version 1030111 (0.0008) [2023-12-28 02:39:41,289][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001030112_263766016.pth... [2023-12-28 02:39:41,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001028960_263471104.pth [2023-12-28 02:39:41,612][106225] Updated weights for policy 1, policy_version 1032737 (0.0009) [2023-12-28 02:39:41,679][106225] Updated weights for policy 1, policy_version 1032747 (0.0008) [2023-12-28 02:39:41,741][106225] Updated weights for policy 1, policy_version 1032757 (0.0008) [2023-12-28 02:39:42,102][106226] Updated weights for policy 0, policy_version 1030121 (0.0006) [2023-12-28 02:39:42,172][106226] Updated weights for policy 0, policy_version 1030131 (0.0006) [2023-12-28 02:39:42,243][106226] Updated weights for policy 0, policy_version 1030141 (0.0006) [2023-12-28 02:39:42,499][106225] Updated weights for policy 1, policy_version 1032767 (0.0007) [2023-12-28 02:39:42,569][106225] Updated weights for policy 1, policy_version 1032777 (0.0006) [2023-12-28 02:39:42,634][106225] Updated weights for policy 1, policy_version 1032787 (0.0006) [2023-12-28 02:39:42,956][106226] Updated weights for policy 0, policy_version 1030151 (0.0006) [2023-12-28 02:39:43,018][106226] Updated weights for policy 0, policy_version 1030161 (0.0005) [2023-12-28 02:39:43,079][106226] Updated weights for policy 0, policy_version 1030171 (0.0005) [2023-12-28 02:39:43,226][106225] Updated weights for policy 1, policy_version 1032797 (0.0005) [2023-12-28 02:39:43,286][106225] Updated weights for policy 1, policy_version 1032807 (0.0005) [2023-12-28 02:39:43,351][106225] Updated weights for policy 1, policy_version 1032817 (0.0009) [2023-12-28 02:39:43,722][106226] Updated weights for policy 0, policy_version 1030181 (0.0008) [2023-12-28 02:39:43,782][106226] Updated weights for policy 0, policy_version 1030191 (0.0010) [2023-12-28 02:39:43,849][106226] Updated weights for policy 0, policy_version 1030201 (0.0010) [2023-12-28 02:39:43,927][106225] Updated weights for policy 1, policy_version 1032827 (0.0007) [2023-12-28 02:39:43,977][106225] Updated weights for policy 1, policy_version 1032837 (0.0010) [2023-12-28 02:39:44,024][106225] Updated weights for policy 1, policy_version 1032847 (0.0010) [2023-12-28 02:39:44,448][106226] Updated weights for policy 0, policy_version 1030211 (0.0010) [2023-12-28 02:39:44,509][106226] Updated weights for policy 0, policy_version 1030221 (0.0010) [2023-12-28 02:39:44,575][106226] Updated weights for policy 0, policy_version 1030231 (0.0010) [2023-12-28 02:39:44,612][106225] Updated weights for policy 1, policy_version 1032857 (0.0010) [2023-12-28 02:39:44,676][106225] Updated weights for policy 1, policy_version 1032867 (0.0007) [2023-12-28 02:39:44,726][106225] Updated weights for policy 1, policy_version 1032877 (0.0010) [2023-12-28 02:39:44,784][106225] Updated weights for policy 1, policy_version 1032887 (0.0009) [2023-12-28 02:39:45,278][106226] Updated weights for policy 0, policy_version 1030241 (0.0010) [2023-12-28 02:39:45,335][106226] Updated weights for policy 0, policy_version 1030251 (0.0008) [2023-12-28 02:39:45,400][106226] Updated weights for policy 0, policy_version 1030261 (0.0008) [2023-12-28 02:39:45,465][106226] Updated weights for policy 0, policy_version 1030271 (0.0008) [2023-12-28 02:39:45,495][106225] Updated weights for policy 1, policy_version 1032897 (0.0010) [2023-12-28 02:39:45,554][106225] Updated weights for policy 1, policy_version 1032907 (0.0010) [2023-12-28 02:39:45,610][106225] Updated weights for policy 1, policy_version 1032917 (0.0005) [2023-12-28 02:39:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 528277504. Throughput: 0: 9826.0, 1: 10098.5. Samples: 528272736. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:46,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.768')] [2023-12-28 02:39:46,229][106226] Updated weights for policy 0, policy_version 1030281 (0.0007) [2023-12-28 02:39:46,245][106225] Updated weights for policy 1, policy_version 1032927 (0.0009) [2023-12-28 02:39:46,280][106226] Updated weights for policy 0, policy_version 1030291 (0.0008) [2023-12-28 02:39:46,302][106225] Updated weights for policy 1, policy_version 1032937 (0.0010) [2023-12-28 02:39:46,331][106226] Updated weights for policy 0, policy_version 1030301 (0.0006) [2023-12-28 02:39:46,351][106225] Updated weights for policy 1, policy_version 1032947 (0.0010) [2023-12-28 02:39:47,055][106225] Updated weights for policy 1, policy_version 1032957 (0.0008) [2023-12-28 02:39:47,096][106226] Updated weights for policy 0, policy_version 1030311 (0.0008) [2023-12-28 02:39:47,106][106225] Updated weights for policy 1, policy_version 1032967 (0.0005) [2023-12-28 02:39:47,156][106226] Updated weights for policy 0, policy_version 1030321 (0.0007) [2023-12-28 02:39:47,161][106225] Updated weights for policy 1, policy_version 1032977 (0.0006) [2023-12-28 02:39:47,209][106226] Updated weights for policy 0, policy_version 1030331 (0.0008) [2023-12-28 02:39:47,882][106225] Updated weights for policy 1, policy_version 1032987 (0.0007) [2023-12-28 02:39:47,908][106226] Updated weights for policy 0, policy_version 1030341 (0.0008) [2023-12-28 02:39:47,926][106225] Updated weights for policy 1, policy_version 1032997 (0.0006) [2023-12-28 02:39:47,975][106226] Updated weights for policy 0, policy_version 1030351 (0.0008) [2023-12-28 02:39:47,990][106225] Updated weights for policy 1, policy_version 1033007 (0.0007) [2023-12-28 02:39:48,036][106226] Updated weights for policy 0, policy_version 1030361 (0.0007) [2023-12-28 02:39:48,744][106226] Updated weights for policy 0, policy_version 1030371 (0.0009) [2023-12-28 02:39:48,745][106225] Updated weights for policy 1, policy_version 1033017 (0.0007) [2023-12-28 02:39:48,805][106225] Updated weights for policy 1, policy_version 1033027 (0.0006) [2023-12-28 02:39:48,806][106226] Updated weights for policy 0, policy_version 1030381 (0.0011) [2023-12-28 02:39:48,866][106225] Updated weights for policy 1, policy_version 1033037 (0.0006) [2023-12-28 02:39:48,872][106226] Updated weights for policy 0, policy_version 1030391 (0.0007) [2023-12-28 02:39:48,925][106225] Updated weights for policy 1, policy_version 1033047 (0.0008) [2023-12-28 02:39:49,581][106226] Updated weights for policy 0, policy_version 1030401 (0.0010) [2023-12-28 02:39:49,639][106226] Updated weights for policy 0, policy_version 1030411 (0.0007) [2023-12-28 02:39:49,648][106225] Updated weights for policy 1, policy_version 1033057 (0.0008) [2023-12-28 02:39:49,698][106226] Updated weights for policy 0, policy_version 1030421 (0.0006) [2023-12-28 02:39:49,713][106225] Updated weights for policy 1, policy_version 1033067 (0.0008) [2023-12-28 02:39:49,756][106226] Updated weights for policy 0, policy_version 1030431 (0.0008) [2023-12-28 02:39:49,780][106225] Updated weights for policy 1, policy_version 1033077 (0.0008) [2023-12-28 02:39:50,462][106225] Updated weights for policy 1, policy_version 1033087 (0.0010) [2023-12-28 02:39:50,479][106226] Updated weights for policy 0, policy_version 1030441 (0.0010) [2023-12-28 02:39:50,527][106225] Updated weights for policy 1, policy_version 1033097 (0.0010) [2023-12-28 02:39:50,540][106226] Updated weights for policy 0, policy_version 1030451 (0.0010) [2023-12-28 02:39:50,586][106225] Updated weights for policy 1, policy_version 1033107 (0.0009) [2023-12-28 02:39:50,602][106226] Updated weights for policy 0, policy_version 1030461 (0.0011) [2023-12-28 02:39:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 528375808. Throughput: 0: 9748.3, 1: 10025.6. Samples: 528388376. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:51,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.191')] [2023-12-28 02:39:51,302][106226] Updated weights for policy 0, policy_version 1030471 (0.0008) [2023-12-28 02:39:51,328][106225] Updated weights for policy 1, policy_version 1033117 (0.0009) [2023-12-28 02:39:51,373][106226] Updated weights for policy 0, policy_version 1030481 (0.0007) [2023-12-28 02:39:51,398][106225] Updated weights for policy 1, policy_version 1033127 (0.0009) [2023-12-28 02:39:51,436][106226] Updated weights for policy 0, policy_version 1030491 (0.0008) [2023-12-28 02:39:51,460][106225] Updated weights for policy 1, policy_version 1033137 (0.0008) [2023-12-28 02:39:52,217][106226] Updated weights for policy 0, policy_version 1030501 (0.0009) [2023-12-28 02:39:52,221][106225] Updated weights for policy 1, policy_version 1033147 (0.0007) [2023-12-28 02:39:52,284][106226] Updated weights for policy 0, policy_version 1030511 (0.0008) [2023-12-28 02:39:52,290][106225] Updated weights for policy 1, policy_version 1033157 (0.0008) [2023-12-28 02:39:52,341][106225] Updated weights for policy 1, policy_version 1033167 (0.0007) [2023-12-28 02:39:52,344][106226] Updated weights for policy 0, policy_version 1030521 (0.0007) [2023-12-28 02:39:52,997][106225] Updated weights for policy 1, policy_version 1033177 (0.0007) [2023-12-28 02:39:53,048][106225] Updated weights for policy 1, policy_version 1033187 (0.0005) [2023-12-28 02:39:53,073][106226] Updated weights for policy 0, policy_version 1030531 (0.0008) [2023-12-28 02:39:53,107][106225] Updated weights for policy 1, policy_version 1033197 (0.0005) [2023-12-28 02:39:53,134][106226] Updated weights for policy 0, policy_version 1030541 (0.0009) [2023-12-28 02:39:53,159][106225] Updated weights for policy 1, policy_version 1033207 (0.0005) [2023-12-28 02:39:53,190][106226] Updated weights for policy 0, policy_version 1030551 (0.0009) [2023-12-28 02:39:53,779][106225] Updated weights for policy 1, policy_version 1033217 (0.0006) [2023-12-28 02:39:53,843][106225] Updated weights for policy 1, policy_version 1033227 (0.0005) [2023-12-28 02:39:53,912][106225] Updated weights for policy 1, policy_version 1033237 (0.0009) [2023-12-28 02:39:53,936][106226] Updated weights for policy 0, policy_version 1030561 (0.0009) [2023-12-28 02:39:53,996][106226] Updated weights for policy 0, policy_version 1030571 (0.0005) [2023-12-28 02:39:54,054][106226] Updated weights for policy 0, policy_version 1030581 (0.0005) [2023-12-28 02:39:54,107][106226] Updated weights for policy 0, policy_version 1030591 (0.0005) [2023-12-28 02:39:54,591][106225] Updated weights for policy 1, policy_version 1033247 (0.0008) [2023-12-28 02:39:54,635][106225] Updated weights for policy 1, policy_version 1033257 (0.0008) [2023-12-28 02:39:54,687][106225] Updated weights for policy 1, policy_version 1033267 (0.0008) [2023-12-28 02:39:54,751][106226] Updated weights for policy 0, policy_version 1030601 (0.0007) [2023-12-28 02:39:54,814][106226] Updated weights for policy 0, policy_version 1030611 (0.0009) [2023-12-28 02:39:54,875][106226] Updated weights for policy 0, policy_version 1030621 (0.0008) [2023-12-28 02:39:55,436][106225] Updated weights for policy 1, policy_version 1033277 (0.0008) [2023-12-28 02:39:55,491][106225] Updated weights for policy 1, policy_version 1033287 (0.0008) [2023-12-28 02:39:55,540][106225] Updated weights for policy 1, policy_version 1033297 (0.0008) [2023-12-28 02:39:55,601][106226] Updated weights for policy 0, policy_version 1030631 (0.0009) [2023-12-28 02:39:55,647][106226] Updated weights for policy 0, policy_version 1030641 (0.0008) [2023-12-28 02:39:55,706][106226] Updated weights for policy 0, policy_version 1030651 (0.0007) [2023-12-28 02:39:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 528474112. Throughput: 0: 9722.6, 1: 10039.9. Samples: 528446960. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:39:56,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-5.055')] [2023-12-28 02:39:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001030656_263905280.pth... [2023-12-28 02:39:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001029536_263618560.pth [2023-12-28 02:39:56,204][106225] Updated weights for policy 1, policy_version 1033307 (0.0007) [2023-12-28 02:39:56,262][106225] Updated weights for policy 1, policy_version 1033317 (0.0008) [2023-12-28 02:39:56,319][106225] Updated weights for policy 1, policy_version 1033327 (0.0009) [2023-12-28 02:39:56,381][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001033336_264577024.pth... [2023-12-28 02:39:56,384][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001032120_264265728.pth [2023-12-28 02:39:56,413][106226] Updated weights for policy 0, policy_version 1030661 (0.0007) [2023-12-28 02:39:56,475][106226] Updated weights for policy 0, policy_version 1030671 (0.0005) [2023-12-28 02:39:56,526][106226] Updated weights for policy 0, policy_version 1030681 (0.0006) [2023-12-28 02:39:57,040][106226] Updated weights for policy 0, policy_version 1030691 (0.0008) [2023-12-28 02:39:57,107][106226] Updated weights for policy 0, policy_version 1030701 (0.0009) [2023-12-28 02:39:57,156][106225] Updated weights for policy 1, policy_version 1033337 (0.0007) [2023-12-28 02:39:57,166][106226] Updated weights for policy 0, policy_version 1030711 (0.0008) [2023-12-28 02:39:57,214][106225] Updated weights for policy 1, policy_version 1033347 (0.0007) [2023-12-28 02:39:57,273][106225] Updated weights for policy 1, policy_version 1033357 (0.0008) [2023-12-28 02:39:57,328][106225] Updated weights for policy 1, policy_version 1033367 (0.0008) [2023-12-28 02:39:57,886][106226] Updated weights for policy 0, policy_version 1030721 (0.0006) [2023-12-28 02:39:57,943][106226] Updated weights for policy 0, policy_version 1030731 (0.0008) [2023-12-28 02:39:57,993][106226] Updated weights for policy 0, policy_version 1030741 (0.0006) [2023-12-28 02:39:58,042][106226] Updated weights for policy 0, policy_version 1030751 (0.0005) [2023-12-28 02:39:58,050][106225] Updated weights for policy 1, policy_version 1033377 (0.0008) [2023-12-28 02:39:58,103][106225] Updated weights for policy 1, policy_version 1033387 (0.0009) [2023-12-28 02:39:58,152][106225] Updated weights for policy 1, policy_version 1033397 (0.0008) [2023-12-28 02:39:58,743][106226] Updated weights for policy 0, policy_version 1030761 (0.0007) [2023-12-28 02:39:58,811][106226] Updated weights for policy 0, policy_version 1030771 (0.0010) [2023-12-28 02:39:58,882][106226] Updated weights for policy 0, policy_version 1030781 (0.0009) [2023-12-28 02:39:59,022][106225] Updated weights for policy 1, policy_version 1033407 (0.0008) [2023-12-28 02:39:59,081][106225] Updated weights for policy 1, policy_version 1033417 (0.0008) [2023-12-28 02:39:59,145][106225] Updated weights for policy 1, policy_version 1033427 (0.0008) [2023-12-28 02:39:59,631][106226] Updated weights for policy 0, policy_version 1030791 (0.0007) [2023-12-28 02:39:59,683][106226] Updated weights for policy 0, policy_version 1030801 (0.0010) [2023-12-28 02:39:59,751][106226] Updated weights for policy 0, policy_version 1030811 (0.0009) [2023-12-28 02:39:59,885][106225] Updated weights for policy 1, policy_version 1033437 (0.0008) [2023-12-28 02:39:59,953][106225] Updated weights for policy 1, policy_version 1033447 (0.0009) [2023-12-28 02:40:00,004][106225] Updated weights for policy 1, policy_version 1033457 (0.0009) [2023-12-28 02:40:00,416][106226] Updated weights for policy 0, policy_version 1030821 (0.0008) [2023-12-28 02:40:00,466][106226] Updated weights for policy 0, policy_version 1030831 (0.0008) [2023-12-28 02:40:00,530][106226] Updated weights for policy 0, policy_version 1030841 (0.0010) [2023-12-28 02:40:00,665][106225] Updated weights for policy 1, policy_version 1033467 (0.0009) [2023-12-28 02:40:00,718][106225] Updated weights for policy 1, policy_version 1033477 (0.0009) [2023-12-28 02:40:00,772][106225] Updated weights for policy 1, policy_version 1033487 (0.0009) [2023-12-28 02:40:01,139][106226] Updated weights for policy 0, policy_version 1030851 (0.0009) [2023-12-28 02:40:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 528572416. Throughput: 0: 9802.4, 1: 10005.6. Samples: 528563896. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:01,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.842')] [2023-12-28 02:40:01,210][106226] Updated weights for policy 0, policy_version 1030861 (0.0009) [2023-12-28 02:40:01,268][106226] Updated weights for policy 0, policy_version 1030871 (0.0010) [2023-12-28 02:40:01,552][106225] Updated weights for policy 1, policy_version 1033497 (0.0009) [2023-12-28 02:40:01,619][106225] Updated weights for policy 1, policy_version 1033507 (0.0008) [2023-12-28 02:40:01,692][106225] Updated weights for policy 1, policy_version 1033517 (0.0008) [2023-12-28 02:40:01,760][106225] Updated weights for policy 1, policy_version 1033527 (0.0006) [2023-12-28 02:40:02,055][106226] Updated weights for policy 0, policy_version 1030881 (0.0009) [2023-12-28 02:40:02,117][106226] Updated weights for policy 0, policy_version 1030891 (0.0008) [2023-12-28 02:40:02,165][106226] Updated weights for policy 0, policy_version 1030901 (0.0009) [2023-12-28 02:40:02,224][106226] Updated weights for policy 0, policy_version 1030911 (0.0008) [2023-12-28 02:40:02,379][106225] Updated weights for policy 1, policy_version 1033537 (0.0008) [2023-12-28 02:40:02,439][106225] Updated weights for policy 1, policy_version 1033547 (0.0009) [2023-12-28 02:40:02,506][106225] Updated weights for policy 1, policy_version 1033557 (0.0008) [2023-12-28 02:40:02,837][106226] Updated weights for policy 0, policy_version 1030921 (0.0005) [2023-12-28 02:40:02,889][106226] Updated weights for policy 0, policy_version 1030931 (0.0006) [2023-12-28 02:40:02,940][106226] Updated weights for policy 0, policy_version 1030941 (0.0005) [2023-12-28 02:40:03,315][106225] Updated weights for policy 1, policy_version 1033567 (0.0009) [2023-12-28 02:40:03,365][106225] Updated weights for policy 1, policy_version 1033577 (0.0008) [2023-12-28 02:40:03,414][106225] Updated weights for policy 1, policy_version 1033587 (0.0007) [2023-12-28 02:40:03,552][106226] Updated weights for policy 0, policy_version 1030951 (0.0007) [2023-12-28 02:40:03,618][106226] Updated weights for policy 0, policy_version 1030961 (0.0005) [2023-12-28 02:40:03,680][106226] Updated weights for policy 0, policy_version 1030971 (0.0005) [2023-12-28 02:40:04,087][106225] Updated weights for policy 1, policy_version 1033597 (0.0007) [2023-12-28 02:40:04,151][106225] Updated weights for policy 1, policy_version 1033607 (0.0006) [2023-12-28 02:40:04,219][106225] Updated weights for policy 1, policy_version 1033617 (0.0007) [2023-12-28 02:40:04,310][106226] Updated weights for policy 0, policy_version 1030981 (0.0008) [2023-12-28 02:40:04,377][106226] Updated weights for policy 0, policy_version 1030991 (0.0011) [2023-12-28 02:40:04,439][106226] Updated weights for policy 0, policy_version 1031001 (0.0011) [2023-12-28 02:40:04,816][106225] Updated weights for policy 1, policy_version 1033627 (0.0010) [2023-12-28 02:40:04,862][106225] Updated weights for policy 1, policy_version 1033637 (0.0010) [2023-12-28 02:40:04,916][106225] Updated weights for policy 1, policy_version 1033647 (0.0010) [2023-12-28 02:40:05,084][106226] Updated weights for policy 0, policy_version 1031011 (0.0005) [2023-12-28 02:40:05,134][106226] Updated weights for policy 0, policy_version 1031021 (0.0009) [2023-12-28 02:40:05,184][106226] Updated weights for policy 0, policy_version 1031031 (0.0010) [2023-12-28 02:40:05,581][106225] Updated weights for policy 1, policy_version 1033657 (0.0010) [2023-12-28 02:40:05,642][106225] Updated weights for policy 1, policy_version 1033667 (0.0005) [2023-12-28 02:40:05,690][106225] Updated weights for policy 1, policy_version 1033677 (0.0008) [2023-12-28 02:40:05,744][106225] Updated weights for policy 1, policy_version 1033687 (0.0010) [2023-12-28 02:40:05,881][106226] Updated weights for policy 0, policy_version 1031041 (0.0010) [2023-12-28 02:40:05,951][106226] Updated weights for policy 0, policy_version 1031051 (0.0011) [2023-12-28 02:40:06,004][106226] Updated weights for policy 0, policy_version 1031061 (0.0010) [2023-12-28 02:40:06,062][106226] Updated weights for policy 0, policy_version 1031071 (0.0011) [2023-12-28 02:40:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 528678912. Throughput: 0: 9849.1, 1: 9972.7. Samples: 528686772. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:06,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-5.184')] [2023-12-28 02:40:06,439][106225] Updated weights for policy 1, policy_version 1033697 (0.0010) [2023-12-28 02:40:06,500][106225] Updated weights for policy 1, policy_version 1033707 (0.0010) [2023-12-28 02:40:06,551][106225] Updated weights for policy 1, policy_version 1033717 (0.0010) [2023-12-28 02:40:06,775][106226] Updated weights for policy 0, policy_version 1031081 (0.0011) [2023-12-28 02:40:06,829][106226] Updated weights for policy 0, policy_version 1031091 (0.0010) [2023-12-28 02:40:06,881][106226] Updated weights for policy 0, policy_version 1031101 (0.0008) [2023-12-28 02:40:07,290][106225] Updated weights for policy 1, policy_version 1033727 (0.0009) [2023-12-28 02:40:07,350][106225] Updated weights for policy 1, policy_version 1033737 (0.0010) [2023-12-28 02:40:07,411][106225] Updated weights for policy 1, policy_version 1033747 (0.0010) [2023-12-28 02:40:07,515][106226] Updated weights for policy 0, policy_version 1031111 (0.0009) [2023-12-28 02:40:07,567][106226] Updated weights for policy 0, policy_version 1031121 (0.0010) [2023-12-28 02:40:07,632][106226] Updated weights for policy 0, policy_version 1031131 (0.0010) [2023-12-28 02:40:08,094][106225] Updated weights for policy 1, policy_version 1033757 (0.0008) [2023-12-28 02:40:08,147][106225] Updated weights for policy 1, policy_version 1033767 (0.0005) [2023-12-28 02:40:08,199][106225] Updated weights for policy 1, policy_version 1033777 (0.0006) [2023-12-28 02:40:08,206][106226] Updated weights for policy 0, policy_version 1031141 (0.0007) [2023-12-28 02:40:08,270][106226] Updated weights for policy 0, policy_version 1031151 (0.0005) [2023-12-28 02:40:08,321][106226] Updated weights for policy 0, policy_version 1031161 (0.0007) [2023-12-28 02:40:08,918][106225] Updated weights for policy 1, policy_version 1033787 (0.0009) [2023-12-28 02:40:08,940][106226] Updated weights for policy 0, policy_version 1031171 (0.0008) [2023-12-28 02:40:08,987][106225] Updated weights for policy 1, policy_version 1033797 (0.0010) [2023-12-28 02:40:09,001][106226] Updated weights for policy 0, policy_version 1031181 (0.0010) [2023-12-28 02:40:09,047][106225] Updated weights for policy 1, policy_version 1033807 (0.0010) [2023-12-28 02:40:09,064][106226] Updated weights for policy 0, policy_version 1031191 (0.0010) [2023-12-28 02:40:09,777][106225] Updated weights for policy 1, policy_version 1033817 (0.0009) [2023-12-28 02:40:09,816][106226] Updated weights for policy 0, policy_version 1031201 (0.0011) [2023-12-28 02:40:09,844][106225] Updated weights for policy 1, policy_version 1033827 (0.0009) [2023-12-28 02:40:09,887][106226] Updated weights for policy 0, policy_version 1031211 (0.0010) [2023-12-28 02:40:09,903][106225] Updated weights for policy 1, policy_version 1033837 (0.0008) [2023-12-28 02:40:09,958][106226] Updated weights for policy 0, policy_version 1031221 (0.0011) [2023-12-28 02:40:09,975][106225] Updated weights for policy 1, policy_version 1033847 (0.0009) [2023-12-28 02:40:10,028][106226] Updated weights for policy 0, policy_version 1031231 (0.0007) [2023-12-28 02:40:10,711][106225] Updated weights for policy 1, policy_version 1033857 (0.0009) [2023-12-28 02:40:10,753][106226] Updated weights for policy 0, policy_version 1031241 (0.0007) [2023-12-28 02:40:10,767][106225] Updated weights for policy 1, policy_version 1033867 (0.0006) [2023-12-28 02:40:10,814][106226] Updated weights for policy 0, policy_version 1031251 (0.0009) [2023-12-28 02:40:10,828][106225] Updated weights for policy 1, policy_version 1033877 (0.0006) [2023-12-28 02:40:10,876][106226] Updated weights for policy 0, policy_version 1031261 (0.0008) [2023-12-28 02:40:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 528777216. Throughput: 0: 9899.7, 1: 9994.0. Samples: 528748200. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:11,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.952')] [2023-12-28 02:40:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001031264_264060928.pth... [2023-12-28 02:40:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001033880_264716288.pth... [2023-12-28 02:40:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001032728_264421376.pth [2023-12-28 02:40:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001030112_263766016.pth [2023-12-28 02:40:11,601][106225] Updated weights for policy 1, policy_version 1033887 (0.0007) [2023-12-28 02:40:11,665][106226] Updated weights for policy 0, policy_version 1031271 (0.0009) [2023-12-28 02:40:11,673][106225] Updated weights for policy 1, policy_version 1033897 (0.0008) [2023-12-28 02:40:11,732][106226] Updated weights for policy 0, policy_version 1031281 (0.0010) [2023-12-28 02:40:11,741][106225] Updated weights for policy 1, policy_version 1033907 (0.0008) [2023-12-28 02:40:11,796][106226] Updated weights for policy 0, policy_version 1031291 (0.0008) [2023-12-28 02:40:12,510][106226] Updated weights for policy 0, policy_version 1031301 (0.0008) [2023-12-28 02:40:12,512][106225] Updated weights for policy 1, policy_version 1033917 (0.0007) [2023-12-28 02:40:12,567][106225] Updated weights for policy 1, policy_version 1033927 (0.0006) [2023-12-28 02:40:12,569][106226] Updated weights for policy 0, policy_version 1031311 (0.0007) [2023-12-28 02:40:12,619][106226] Updated weights for policy 0, policy_version 1031321 (0.0006) [2023-12-28 02:40:12,625][106225] Updated weights for policy 1, policy_version 1033937 (0.0007) [2023-12-28 02:40:13,263][106225] Updated weights for policy 1, policy_version 1033947 (0.0007) [2023-12-28 02:40:13,264][106226] Updated weights for policy 0, policy_version 1031331 (0.0007) [2023-12-28 02:40:13,314][106225] Updated weights for policy 1, policy_version 1033957 (0.0008) [2023-12-28 02:40:13,330][106226] Updated weights for policy 0, policy_version 1031341 (0.0011) [2023-12-28 02:40:13,366][106225] Updated weights for policy 1, policy_version 1033967 (0.0005) [2023-12-28 02:40:13,387][106226] Updated weights for policy 0, policy_version 1031351 (0.0010) [2023-12-28 02:40:14,035][106225] Updated weights for policy 1, policy_version 1033977 (0.0005) [2023-12-28 02:40:14,063][106226] Updated weights for policy 0, policy_version 1031361 (0.0010) [2023-12-28 02:40:14,093][106225] Updated weights for policy 1, policy_version 1033987 (0.0005) [2023-12-28 02:40:14,124][106226] Updated weights for policy 0, policy_version 1031371 (0.0005) [2023-12-28 02:40:14,146][106225] Updated weights for policy 1, policy_version 1033997 (0.0008) [2023-12-28 02:40:14,179][106226] Updated weights for policy 0, policy_version 1031381 (0.0006) [2023-12-28 02:40:14,205][106225] Updated weights for policy 1, policy_version 1034007 (0.0008) [2023-12-28 02:40:14,232][106226] Updated weights for policy 0, policy_version 1031391 (0.0006) [2023-12-28 02:40:14,904][106225] Updated weights for policy 1, policy_version 1034017 (0.0009) [2023-12-28 02:40:14,911][106226] Updated weights for policy 0, policy_version 1031401 (0.0007) [2023-12-28 02:40:14,957][106225] Updated weights for policy 1, policy_version 1034027 (0.0007) [2023-12-28 02:40:14,980][106226] Updated weights for policy 0, policy_version 1031411 (0.0009) [2023-12-28 02:40:15,007][106225] Updated weights for policy 1, policy_version 1034037 (0.0006) [2023-12-28 02:40:15,046][106226] Updated weights for policy 0, policy_version 1031421 (0.0008) [2023-12-28 02:40:15,647][106225] Updated weights for policy 1, policy_version 1034047 (0.0006) [2023-12-28 02:40:15,692][106225] Updated weights for policy 1, policy_version 1034057 (0.0005) [2023-12-28 02:40:15,712][106226] Updated weights for policy 0, policy_version 1031431 (0.0010) [2023-12-28 02:40:15,738][106225] Updated weights for policy 1, policy_version 1034067 (0.0005) [2023-12-28 02:40:15,759][106226] Updated weights for policy 0, policy_version 1031441 (0.0010) [2023-12-28 02:40:15,819][106226] Updated weights for policy 0, policy_version 1031451 (0.0009) [2023-12-28 02:40:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 528875520. Throughput: 0: 9846.9, 1: 9912.5. Samples: 528864196. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:16,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.054')] [2023-12-28 02:40:16,464][106226] Updated weights for policy 0, policy_version 1031461 (0.0008) [2023-12-28 02:40:16,469][106225] Updated weights for policy 1, policy_version 1034077 (0.0005) [2023-12-28 02:40:16,527][106225] Updated weights for policy 1, policy_version 1034087 (0.0008) [2023-12-28 02:40:16,529][106226] Updated weights for policy 0, policy_version 1031471 (0.0008) [2023-12-28 02:40:16,583][106225] Updated weights for policy 1, policy_version 1034097 (0.0010) [2023-12-28 02:40:16,599][106226] Updated weights for policy 0, policy_version 1031481 (0.0007) [2023-12-28 02:40:17,152][106226] Updated weights for policy 0, policy_version 1031491 (0.0006) [2023-12-28 02:40:17,215][106226] Updated weights for policy 0, policy_version 1031501 (0.0007) [2023-12-28 02:40:17,261][106225] Updated weights for policy 1, policy_version 1034107 (0.0010) [2023-12-28 02:40:17,266][106226] Updated weights for policy 0, policy_version 1031511 (0.0005) [2023-12-28 02:40:17,319][106225] Updated weights for policy 1, policy_version 1034117 (0.0007) [2023-12-28 02:40:17,385][106225] Updated weights for policy 1, policy_version 1034127 (0.0006) [2023-12-28 02:40:17,836][106226] Updated weights for policy 0, policy_version 1031521 (0.0005) [2023-12-28 02:40:17,889][106226] Updated weights for policy 0, policy_version 1031531 (0.0005) [2023-12-28 02:40:17,943][106226] Updated weights for policy 0, policy_version 1031541 (0.0008) [2023-12-28 02:40:18,003][106226] Updated weights for policy 0, policy_version 1031551 (0.0006) [2023-12-28 02:40:18,066][106225] Updated weights for policy 1, policy_version 1034137 (0.0010) [2023-12-28 02:40:18,119][106225] Updated weights for policy 1, policy_version 1034147 (0.0010) [2023-12-28 02:40:18,184][106225] Updated weights for policy 1, policy_version 1034157 (0.0010) [2023-12-28 02:40:18,250][106225] Updated weights for policy 1, policy_version 1034167 (0.0010) [2023-12-28 02:40:18,714][106226] Updated weights for policy 0, policy_version 1031561 (0.0009) [2023-12-28 02:40:18,770][106226] Updated weights for policy 0, policy_version 1031571 (0.0009) [2023-12-28 02:40:18,823][106226] Updated weights for policy 0, policy_version 1031581 (0.0008) [2023-12-28 02:40:18,987][106225] Updated weights for policy 1, policy_version 1034177 (0.0008) [2023-12-28 02:40:19,047][106225] Updated weights for policy 1, policy_version 1034187 (0.0010) [2023-12-28 02:40:19,109][106225] Updated weights for policy 1, policy_version 1034197 (0.0011) [2023-12-28 02:40:19,605][106226] Updated weights for policy 0, policy_version 1031591 (0.0009) [2023-12-28 02:40:19,674][106226] Updated weights for policy 0, policy_version 1031601 (0.0009) [2023-12-28 02:40:19,733][106226] Updated weights for policy 0, policy_version 1031611 (0.0008) [2023-12-28 02:40:19,868][106225] Updated weights for policy 1, policy_version 1034207 (0.0009) [2023-12-28 02:40:19,934][106225] Updated weights for policy 1, policy_version 1034217 (0.0009) [2023-12-28 02:40:20,004][106225] Updated weights for policy 1, policy_version 1034227 (0.0006) [2023-12-28 02:40:20,547][106226] Updated weights for policy 0, policy_version 1031621 (0.0009) [2023-12-28 02:40:20,615][106226] Updated weights for policy 0, policy_version 1031631 (0.0009) [2023-12-28 02:40:20,675][106226] Updated weights for policy 0, policy_version 1031641 (0.0009) [2023-12-28 02:40:20,706][106225] Updated weights for policy 1, policy_version 1034237 (0.0007) [2023-12-28 02:40:20,776][106225] Updated weights for policy 1, policy_version 1034247 (0.0008) [2023-12-28 02:40:20,851][106225] Updated weights for policy 1, policy_version 1034257 (0.0008) [2023-12-28 02:40:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 528973824. Throughput: 0: 9869.6, 1: 9840.2. Samples: 528983112. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:21,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-5.042')] [2023-12-28 02:40:21,458][106226] Updated weights for policy 0, policy_version 1031651 (0.0008) [2023-12-28 02:40:21,521][106226] Updated weights for policy 0, policy_version 1031661 (0.0011) [2023-12-28 02:40:21,575][106226] Updated weights for policy 0, policy_version 1031671 (0.0011) [2023-12-28 02:40:21,621][106225] Updated weights for policy 1, policy_version 1034267 (0.0008) [2023-12-28 02:40:21,687][106225] Updated weights for policy 1, policy_version 1034277 (0.0009) [2023-12-28 02:40:21,756][106225] Updated weights for policy 1, policy_version 1034287 (0.0008) [2023-12-28 02:40:22,278][106226] Updated weights for policy 0, policy_version 1031681 (0.0010) [2023-12-28 02:40:22,340][106226] Updated weights for policy 0, policy_version 1031691 (0.0011) [2023-12-28 02:40:22,422][106226] Updated weights for policy 0, policy_version 1031701 (0.0008) [2023-12-28 02:40:22,472][106226] Updated weights for policy 0, policy_version 1031711 (0.0009) [2023-12-28 02:40:22,498][106225] Updated weights for policy 1, policy_version 1034297 (0.0007) [2023-12-28 02:40:22,550][106225] Updated weights for policy 1, policy_version 1034307 (0.0009) [2023-12-28 02:40:22,613][106225] Updated weights for policy 1, policy_version 1034317 (0.0007) [2023-12-28 02:40:22,672][106225] Updated weights for policy 1, policy_version 1034327 (0.0007) [2023-12-28 02:40:23,061][106226] Updated weights for policy 0, policy_version 1031721 (0.0009) [2023-12-28 02:40:23,125][106226] Updated weights for policy 0, policy_version 1031731 (0.0008) [2023-12-28 02:40:23,191][106226] Updated weights for policy 0, policy_version 1031741 (0.0008) [2023-12-28 02:40:23,469][106225] Updated weights for policy 1, policy_version 1034337 (0.0010) [2023-12-28 02:40:23,523][106225] Updated weights for policy 1, policy_version 1034347 (0.0010) [2023-12-28 02:40:23,576][106225] Updated weights for policy 1, policy_version 1034357 (0.0010) [2023-12-28 02:40:23,891][106226] Updated weights for policy 0, policy_version 1031751 (0.0008) [2023-12-28 02:40:23,947][106226] Updated weights for policy 0, policy_version 1031761 (0.0008) [2023-12-28 02:40:23,991][106226] Updated weights for policy 0, policy_version 1031771 (0.0007) [2023-12-28 02:40:24,242][106225] Updated weights for policy 1, policy_version 1034367 (0.0007) [2023-12-28 02:40:24,302][106225] Updated weights for policy 1, policy_version 1034377 (0.0009) [2023-12-28 02:40:24,353][106225] Updated weights for policy 1, policy_version 1034387 (0.0010) [2023-12-28 02:40:24,646][106226] Updated weights for policy 0, policy_version 1031781 (0.0007) [2023-12-28 02:40:24,709][106226] Updated weights for policy 0, policy_version 1031791 (0.0005) [2023-12-28 02:40:24,764][106226] Updated weights for policy 0, policy_version 1031801 (0.0008) [2023-12-28 02:40:25,043][106225] Updated weights for policy 1, policy_version 1034397 (0.0010) [2023-12-28 02:40:25,089][106225] Updated weights for policy 1, policy_version 1034407 (0.0007) [2023-12-28 02:40:25,145][106225] Updated weights for policy 1, policy_version 1034417 (0.0005) [2023-12-28 02:40:25,389][106226] Updated weights for policy 0, policy_version 1031811 (0.0008) [2023-12-28 02:40:25,452][106226] Updated weights for policy 0, policy_version 1031821 (0.0010) [2023-12-28 02:40:25,512][106226] Updated weights for policy 0, policy_version 1031831 (0.0009) [2023-12-28 02:40:25,703][106225] Updated weights for policy 1, policy_version 1034427 (0.0006) [2023-12-28 02:40:25,766][106225] Updated weights for policy 1, policy_version 1034437 (0.0009) [2023-12-28 02:40:25,823][106225] Updated weights for policy 1, policy_version 1034447 (0.0008) [2023-12-28 02:40:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 529072128. Throughput: 0: 9926.1, 1: 9733.9. Samples: 529039568. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:26,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.132')] [2023-12-28 02:40:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001034456_264863744.pth... [2023-12-28 02:40:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001033336_264577024.pth [2023-12-28 02:40:26,195][106226] Updated weights for policy 0, policy_version 1031841 (0.0008) [2023-12-28 02:40:26,251][106226] Updated weights for policy 0, policy_version 1031851 (0.0011) [2023-12-28 02:40:26,318][106226] Updated weights for policy 0, policy_version 1031861 (0.0011) [2023-12-28 02:40:26,377][106226] Updated weights for policy 0, policy_version 1031871 (0.0010) [2023-12-28 02:40:26,379][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001031872_264216576.pth... [2023-12-28 02:40:26,382][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001030656_263905280.pth [2023-12-28 02:40:26,439][106225] Updated weights for policy 1, policy_version 1034457 (0.0009) [2023-12-28 02:40:26,489][106225] Updated weights for policy 1, policy_version 1034467 (0.0006) [2023-12-28 02:40:26,553][106225] Updated weights for policy 1, policy_version 1034477 (0.0005) [2023-12-28 02:40:26,602][106225] Updated weights for policy 1, policy_version 1034487 (0.0005) [2023-12-28 02:40:26,989][106226] Updated weights for policy 0, policy_version 1031881 (0.0010) [2023-12-28 02:40:27,038][106226] Updated weights for policy 0, policy_version 1031891 (0.0007) [2023-12-28 02:40:27,091][106226] Updated weights for policy 0, policy_version 1031901 (0.0005) [2023-12-28 02:40:27,255][106225] Updated weights for policy 1, policy_version 1034497 (0.0005) [2023-12-28 02:40:27,309][106225] Updated weights for policy 1, policy_version 1034507 (0.0005) [2023-12-28 02:40:27,372][106225] Updated weights for policy 1, policy_version 1034517 (0.0005) [2023-12-28 02:40:27,681][106226] Updated weights for policy 0, policy_version 1031911 (0.0005) [2023-12-28 02:40:27,733][106226] Updated weights for policy 0, policy_version 1031921 (0.0008) [2023-12-28 02:40:27,779][106226] Updated weights for policy 0, policy_version 1031931 (0.0010) [2023-12-28 02:40:27,916][106225] Updated weights for policy 1, policy_version 1034527 (0.0009) [2023-12-28 02:40:27,960][106225] Updated weights for policy 1, policy_version 1034537 (0.0008) [2023-12-28 02:40:28,019][106225] Updated weights for policy 1, policy_version 1034547 (0.0007) [2023-12-28 02:40:28,478][106226] Updated weights for policy 0, policy_version 1031941 (0.0010) [2023-12-28 02:40:28,528][106226] Updated weights for policy 0, policy_version 1031951 (0.0008) [2023-12-28 02:40:28,579][106226] Updated weights for policy 0, policy_version 1031961 (0.0008) [2023-12-28 02:40:28,730][106225] Updated weights for policy 1, policy_version 1034557 (0.0009) [2023-12-28 02:40:28,777][106225] Updated weights for policy 1, policy_version 1034567 (0.0010) [2023-12-28 02:40:28,834][106225] Updated weights for policy 1, policy_version 1034577 (0.0010) [2023-12-28 02:40:29,311][106226] Updated weights for policy 0, policy_version 1031971 (0.0008) [2023-12-28 02:40:29,379][106226] Updated weights for policy 0, policy_version 1031981 (0.0008) [2023-12-28 02:40:29,442][106226] Updated weights for policy 0, policy_version 1031991 (0.0008) [2023-12-28 02:40:29,591][106225] Updated weights for policy 1, policy_version 1034587 (0.0010) [2023-12-28 02:40:29,658][106225] Updated weights for policy 1, policy_version 1034597 (0.0010) [2023-12-28 02:40:29,709][106225] Updated weights for policy 1, policy_version 1034607 (0.0010) [2023-12-28 02:40:30,094][106226] Updated weights for policy 0, policy_version 1032001 (0.0007) [2023-12-28 02:40:30,161][106226] Updated weights for policy 0, policy_version 1032011 (0.0006) [2023-12-28 02:40:30,219][106226] Updated weights for policy 0, policy_version 1032021 (0.0006) [2023-12-28 02:40:30,285][106226] Updated weights for policy 0, policy_version 1032031 (0.0006) [2023-12-28 02:40:30,378][106225] Updated weights for policy 1, policy_version 1034617 (0.0010) [2023-12-28 02:40:30,428][106225] Updated weights for policy 1, policy_version 1034627 (0.0010) [2023-12-28 02:40:30,477][106225] Updated weights for policy 1, policy_version 1034637 (0.0010) [2023-12-28 02:40:30,527][106225] Updated weights for policy 1, policy_version 1034647 (0.0010) [2023-12-28 02:40:30,971][106226] Updated weights for policy 0, policy_version 1032041 (0.0008) [2023-12-28 02:40:31,049][106226] Updated weights for policy 0, policy_version 1032051 (0.0009) [2023-12-28 02:40:31,094][106225] Updated weights for policy 1, policy_version 1034657 (0.0010) [2023-12-28 02:40:31,109][106226] Updated weights for policy 0, policy_version 1032061 (0.0008) [2023-12-28 02:40:31,160][106225] Updated weights for policy 1, policy_version 1034667 (0.0010) [2023-12-28 02:40:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 529178624. Throughput: 0: 10038.6, 1: 9827.8. Samples: 529166724. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:31,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.028')] [2023-12-28 02:40:31,224][106225] Updated weights for policy 1, policy_version 1034677 (0.0011) [2023-12-28 02:40:31,865][106226] Updated weights for policy 0, policy_version 1032071 (0.0008) [2023-12-28 02:40:31,925][106226] Updated weights for policy 0, policy_version 1032081 (0.0007) [2023-12-28 02:40:31,958][106225] Updated weights for policy 1, policy_version 1034687 (0.0010) [2023-12-28 02:40:31,983][106226] Updated weights for policy 0, policy_version 1032091 (0.0006) [2023-12-28 02:40:32,009][106225] Updated weights for policy 1, policy_version 1034697 (0.0010) [2023-12-28 02:40:32,070][106225] Updated weights for policy 1, policy_version 1034707 (0.0010) [2023-12-28 02:40:32,637][106226] Updated weights for policy 0, policy_version 1032101 (0.0006) [2023-12-28 02:40:32,696][106226] Updated weights for policy 0, policy_version 1032111 (0.0007) [2023-12-28 02:40:32,760][106226] Updated weights for policy 0, policy_version 1032121 (0.0005) [2023-12-28 02:40:32,790][106225] Updated weights for policy 1, policy_version 1034717 (0.0010) [2023-12-28 02:40:32,837][106225] Updated weights for policy 1, policy_version 1034727 (0.0010) [2023-12-28 02:40:32,903][106225] Updated weights for policy 1, policy_version 1034737 (0.0010) [2023-12-28 02:40:33,443][106226] Updated weights for policy 0, policy_version 1032131 (0.0006) [2023-12-28 02:40:33,497][106226] Updated weights for policy 0, policy_version 1032141 (0.0008) [2023-12-28 02:40:33,557][106226] Updated weights for policy 0, policy_version 1032151 (0.0009) [2023-12-28 02:40:33,593][106225] Updated weights for policy 1, policy_version 1034747 (0.0007) [2023-12-28 02:40:33,653][106225] Updated weights for policy 1, policy_version 1034757 (0.0010) [2023-12-28 02:40:33,718][106225] Updated weights for policy 1, policy_version 1034767 (0.0010) [2023-12-28 02:40:34,236][106226] Updated weights for policy 0, policy_version 1032161 (0.0010) [2023-12-28 02:40:34,303][106226] Updated weights for policy 0, policy_version 1032171 (0.0010) [2023-12-28 02:40:34,362][106225] Updated weights for policy 1, policy_version 1034777 (0.0010) [2023-12-28 02:40:34,371][106226] Updated weights for policy 0, policy_version 1032181 (0.0011) [2023-12-28 02:40:34,423][106225] Updated weights for policy 1, policy_version 1034787 (0.0007) [2023-12-28 02:40:34,439][106226] Updated weights for policy 0, policy_version 1032191 (0.0011) [2023-12-28 02:40:34,484][106225] Updated weights for policy 1, policy_version 1034797 (0.0006) [2023-12-28 02:40:34,553][106225] Updated weights for policy 1, policy_version 1034807 (0.0008) [2023-12-28 02:40:35,123][106226] Updated weights for policy 0, policy_version 1032201 (0.0006) [2023-12-28 02:40:35,182][106226] Updated weights for policy 0, policy_version 1032211 (0.0005) [2023-12-28 02:40:35,183][106225] Updated weights for policy 1, policy_version 1034817 (0.0007) [2023-12-28 02:40:35,231][106225] Updated weights for policy 1, policy_version 1034827 (0.0006) [2023-12-28 02:40:35,239][106226] Updated weights for policy 0, policy_version 1032221 (0.0008) [2023-12-28 02:40:35,277][106225] Updated weights for policy 1, policy_version 1034837 (0.0005) [2023-12-28 02:40:35,900][106225] Updated weights for policy 1, policy_version 1034847 (0.0009) [2023-12-28 02:40:35,932][106226] Updated weights for policy 0, policy_version 1032231 (0.0006) [2023-12-28 02:40:35,957][106225] Updated weights for policy 1, policy_version 1034857 (0.0010) [2023-12-28 02:40:35,986][106226] Updated weights for policy 0, policy_version 1032241 (0.0005) [2023-12-28 02:40:36,007][106225] Updated weights for policy 1, policy_version 1034867 (0.0010) [2023-12-28 02:40:36,037][106226] Updated weights for policy 0, policy_version 1032251 (0.0005) [2023-12-28 02:40:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 529285120. Throughput: 0: 10080.5, 1: 9919.0. Samples: 529288352. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:36,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-5.121')] [2023-12-28 02:40:36,761][106226] Updated weights for policy 0, policy_version 1032261 (0.0006) [2023-12-28 02:40:36,775][106225] Updated weights for policy 1, policy_version 1034877 (0.0008) [2023-12-28 02:40:36,823][106226] Updated weights for policy 0, policy_version 1032271 (0.0006) [2023-12-28 02:40:36,833][106225] Updated weights for policy 1, policy_version 1034887 (0.0008) [2023-12-28 02:40:36,883][106226] Updated weights for policy 0, policy_version 1032281 (0.0006) [2023-12-28 02:40:36,893][106225] Updated weights for policy 1, policy_version 1034897 (0.0006) [2023-12-28 02:40:37,541][106225] Updated weights for policy 1, policy_version 1034907 (0.0006) [2023-12-28 02:40:37,607][106225] Updated weights for policy 1, policy_version 1034917 (0.0005) [2023-12-28 02:40:37,620][106226] Updated weights for policy 0, policy_version 1032291 (0.0008) [2023-12-28 02:40:37,665][106225] Updated weights for policy 1, policy_version 1034927 (0.0006) [2023-12-28 02:40:37,675][106226] Updated weights for policy 0, policy_version 1032301 (0.0011) [2023-12-28 02:40:37,726][106226] Updated weights for policy 0, policy_version 1032311 (0.0010) [2023-12-28 02:40:38,298][106225] Updated weights for policy 1, policy_version 1034937 (0.0006) [2023-12-28 02:40:38,341][106226] Updated weights for policy 0, policy_version 1032321 (0.0006) [2023-12-28 02:40:38,367][106225] Updated weights for policy 1, policy_version 1034947 (0.0008) [2023-12-28 02:40:38,402][106226] Updated weights for policy 0, policy_version 1032331 (0.0011) [2023-12-28 02:40:38,425][106225] Updated weights for policy 1, policy_version 1034957 (0.0008) [2023-12-28 02:40:38,461][106226] Updated weights for policy 0, policy_version 1032341 (0.0011) [2023-12-28 02:40:38,480][106225] Updated weights for policy 1, policy_version 1034967 (0.0009) [2023-12-28 02:40:38,524][106226] Updated weights for policy 0, policy_version 1032351 (0.0010) [2023-12-28 02:40:39,175][106225] Updated weights for policy 1, policy_version 1034977 (0.0006) [2023-12-28 02:40:39,239][106225] Updated weights for policy 1, policy_version 1034987 (0.0007) [2023-12-28 02:40:39,289][106226] Updated weights for policy 0, policy_version 1032361 (0.0007) [2023-12-28 02:40:39,303][106225] Updated weights for policy 1, policy_version 1034997 (0.0007) [2023-12-28 02:40:39,356][106226] Updated weights for policy 0, policy_version 1032371 (0.0007) [2023-12-28 02:40:39,427][106226] Updated weights for policy 0, policy_version 1032381 (0.0009) [2023-12-28 02:40:40,031][106225] Updated weights for policy 1, policy_version 1035007 (0.0007) [2023-12-28 02:40:40,094][106225] Updated weights for policy 1, policy_version 1035017 (0.0006) [2023-12-28 02:40:40,157][106225] Updated weights for policy 1, policy_version 1035027 (0.0007) [2023-12-28 02:40:40,275][106226] Updated weights for policy 0, policy_version 1032391 (0.0010) [2023-12-28 02:40:40,326][106226] Updated weights for policy 0, policy_version 1032401 (0.0011) [2023-12-28 02:40:40,386][106226] Updated weights for policy 0, policy_version 1032411 (0.0006) [2023-12-28 02:40:40,874][106225] Updated weights for policy 1, policy_version 1035037 (0.0008) [2023-12-28 02:40:40,932][106225] Updated weights for policy 1, policy_version 1035047 (0.0008) [2023-12-28 02:40:40,987][106225] Updated weights for policy 1, policy_version 1035057 (0.0007) [2023-12-28 02:40:41,152][106226] Updated weights for policy 0, policy_version 1032421 (0.0007) [2023-12-28 02:40:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 529375232. Throughput: 0: 10105.9, 1: 9910.7. Samples: 529347712. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:41,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-4.965')] [2023-12-28 02:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001035064_265019392.pth... [2023-12-28 02:40:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001033880_264716288.pth [2023-12-28 02:40:41,215][106226] Updated weights for policy 0, policy_version 1032431 (0.0006) [2023-12-28 02:40:41,281][106226] Updated weights for policy 0, policy_version 1032441 (0.0010) [2023-12-28 02:40:41,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001032448_264364032.pth... [2023-12-28 02:40:41,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001031264_264060928.pth [2023-12-28 02:40:41,810][106225] Updated weights for policy 1, policy_version 1035067 (0.0009) [2023-12-28 02:40:41,872][106225] Updated weights for policy 1, policy_version 1035077 (0.0011) [2023-12-28 02:40:41,937][106226] Updated weights for policy 0, policy_version 1032451 (0.0010) [2023-12-28 02:40:41,938][106225] Updated weights for policy 1, policy_version 1035087 (0.0011) [2023-12-28 02:40:42,000][106226] Updated weights for policy 0, policy_version 1032461 (0.0008) [2023-12-28 02:40:42,068][106226] Updated weights for policy 0, policy_version 1032471 (0.0007) [2023-12-28 02:40:42,684][106225] Updated weights for policy 1, policy_version 1035097 (0.0010) [2023-12-28 02:40:42,743][106225] Updated weights for policy 1, policy_version 1035107 (0.0008) [2023-12-28 02:40:42,794][106226] Updated weights for policy 0, policy_version 1032481 (0.0007) [2023-12-28 02:40:42,805][106225] Updated weights for policy 1, policy_version 1035117 (0.0008) [2023-12-28 02:40:42,857][106226] Updated weights for policy 0, policy_version 1032491 (0.0007) [2023-12-28 02:40:42,859][106225] Updated weights for policy 1, policy_version 1035127 (0.0007) [2023-12-28 02:40:42,915][106226] Updated weights for policy 0, policy_version 1032501 (0.0007) [2023-12-28 02:40:42,972][106226] Updated weights for policy 0, policy_version 1032511 (0.0009) [2023-12-28 02:40:43,571][106225] Updated weights for policy 1, policy_version 1035137 (0.0010) [2023-12-28 02:40:43,624][106225] Updated weights for policy 1, policy_version 1035147 (0.0010) [2023-12-28 02:40:43,653][106226] Updated weights for policy 0, policy_version 1032521 (0.0010) [2023-12-28 02:40:43,689][106225] Updated weights for policy 1, policy_version 1035157 (0.0010) [2023-12-28 02:40:43,708][106226] Updated weights for policy 0, policy_version 1032531 (0.0007) [2023-12-28 02:40:43,767][106226] Updated weights for policy 0, policy_version 1032541 (0.0006) [2023-12-28 02:40:44,355][106226] Updated weights for policy 0, policy_version 1032551 (0.0007) [2023-12-28 02:40:44,411][106226] Updated weights for policy 0, policy_version 1032561 (0.0007) [2023-12-28 02:40:44,435][106225] Updated weights for policy 1, policy_version 1035167 (0.0007) [2023-12-28 02:40:44,468][106226] Updated weights for policy 0, policy_version 1032571 (0.0006) [2023-12-28 02:40:44,486][106225] Updated weights for policy 1, policy_version 1035177 (0.0005) [2023-12-28 02:40:44,541][106225] Updated weights for policy 1, policy_version 1035187 (0.0006) [2023-12-28 02:40:45,112][106226] Updated weights for policy 0, policy_version 1032581 (0.0008) [2023-12-28 02:40:45,179][106225] Updated weights for policy 1, policy_version 1035197 (0.0008) [2023-12-28 02:40:45,181][106226] Updated weights for policy 0, policy_version 1032591 (0.0007) [2023-12-28 02:40:45,239][106225] Updated weights for policy 1, policy_version 1035207 (0.0006) [2023-12-28 02:40:45,247][106226] Updated weights for policy 0, policy_version 1032601 (0.0009) [2023-12-28 02:40:45,306][106225] Updated weights for policy 1, policy_version 1035217 (0.0005) [2023-12-28 02:40:45,953][106226] Updated weights for policy 0, policy_version 1032611 (0.0009) [2023-12-28 02:40:45,972][106225] Updated weights for policy 1, policy_version 1035227 (0.0006) [2023-12-28 02:40:46,013][106226] Updated weights for policy 0, policy_version 1032621 (0.0011) [2023-12-28 02:40:46,030][106225] Updated weights for policy 1, policy_version 1035237 (0.0005) [2023-12-28 02:40:46,068][106226] Updated weights for policy 0, policy_version 1032631 (0.0010) [2023-12-28 02:40:46,086][106225] Updated weights for policy 1, policy_version 1035247 (0.0007) [2023-12-28 02:40:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 529481728. Throughput: 0: 10076.7, 1: 9938.4. Samples: 529464576. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:46,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.716')] [2023-12-28 02:40:46,780][106226] Updated weights for policy 0, policy_version 1032641 (0.0010) [2023-12-28 02:40:46,790][106225] Updated weights for policy 1, policy_version 1035257 (0.0008) [2023-12-28 02:40:46,837][106226] Updated weights for policy 0, policy_version 1032651 (0.0010) [2023-12-28 02:40:46,839][106225] Updated weights for policy 1, policy_version 1035267 (0.0006) [2023-12-28 02:40:46,886][106225] Updated weights for policy 1, policy_version 1035277 (0.0007) [2023-12-28 02:40:46,887][106226] Updated weights for policy 0, policy_version 1032661 (0.0010) [2023-12-28 02:40:46,935][106225] Updated weights for policy 1, policy_version 1035287 (0.0005) [2023-12-28 02:40:46,944][106226] Updated weights for policy 0, policy_version 1032671 (0.0010) [2023-12-28 02:40:47,543][106225] Updated weights for policy 1, policy_version 1035297 (0.0008) [2023-12-28 02:40:47,548][106226] Updated weights for policy 0, policy_version 1032681 (0.0007) [2023-12-28 02:40:47,595][106225] Updated weights for policy 1, policy_version 1035307 (0.0005) [2023-12-28 02:40:47,636][106226] Updated weights for policy 0, policy_version 1032691 (0.0008) [2023-12-28 02:40:47,645][106225] Updated weights for policy 1, policy_version 1035317 (0.0005) [2023-12-28 02:40:47,706][106226] Updated weights for policy 0, policy_version 1032701 (0.0007) [2023-12-28 02:40:48,264][106226] Updated weights for policy 0, policy_version 1032711 (0.0008) [2023-12-28 02:40:48,327][106225] Updated weights for policy 1, policy_version 1035327 (0.0006) [2023-12-28 02:40:48,327][106226] Updated weights for policy 0, policy_version 1032721 (0.0008) [2023-12-28 02:40:48,391][106225] Updated weights for policy 1, policy_version 1035337 (0.0007) [2023-12-28 02:40:48,396][106226] Updated weights for policy 0, policy_version 1032731 (0.0007) [2023-12-28 02:40:48,455][106225] Updated weights for policy 1, policy_version 1035347 (0.0008) [2023-12-28 02:40:49,123][106226] Updated weights for policy 0, policy_version 1032741 (0.0007) [2023-12-28 02:40:49,179][106226] Updated weights for policy 0, policy_version 1032751 (0.0008) [2023-12-28 02:40:49,199][106225] Updated weights for policy 1, policy_version 1035357 (0.0009) [2023-12-28 02:40:49,248][106226] Updated weights for policy 0, policy_version 1032761 (0.0009) [2023-12-28 02:40:49,269][106225] Updated weights for policy 1, policy_version 1035367 (0.0009) [2023-12-28 02:40:49,327][106225] Updated weights for policy 1, policy_version 1035377 (0.0008) [2023-12-28 02:40:49,845][106226] Updated weights for policy 0, policy_version 1032771 (0.0007) [2023-12-28 02:40:49,925][106226] Updated weights for policy 0, policy_version 1032781 (0.0007) [2023-12-28 02:40:49,987][106226] Updated weights for policy 0, policy_version 1032791 (0.0009) [2023-12-28 02:40:50,155][106225] Updated weights for policy 1, policy_version 1035387 (0.0009) [2023-12-28 02:40:50,221][106225] Updated weights for policy 1, policy_version 1035397 (0.0008) [2023-12-28 02:40:50,286][106225] Updated weights for policy 1, policy_version 1035407 (0.0007) [2023-12-28 02:40:50,729][106226] Updated weights for policy 0, policy_version 1032801 (0.0009) [2023-12-28 02:40:50,784][106226] Updated weights for policy 0, policy_version 1032811 (0.0009) [2023-12-28 02:40:50,837][106226] Updated weights for policy 0, policy_version 1032821 (0.0009) [2023-12-28 02:40:50,894][106226] Updated weights for policy 0, policy_version 1032831 (0.0009) [2023-12-28 02:40:50,896][106225] Updated weights for policy 1, policy_version 1035417 (0.0006) [2023-12-28 02:40:50,967][106225] Updated weights for policy 1, policy_version 1035427 (0.0009) [2023-12-28 02:40:51,027][106225] Updated weights for policy 1, policy_version 1035437 (0.0008) [2023-12-28 02:40:51,095][106225] Updated weights for policy 1, policy_version 1035447 (0.0008) [2023-12-28 02:40:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 529580032. Throughput: 0: 10027.9, 1: 9928.3. Samples: 529584804. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:51,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-5.219')] [2023-12-28 02:40:51,710][106226] Updated weights for policy 0, policy_version 1032841 (0.0007) [2023-12-28 02:40:51,785][106226] Updated weights for policy 0, policy_version 1032851 (0.0009) [2023-12-28 02:40:51,828][106225] Updated weights for policy 1, policy_version 1035457 (0.0006) [2023-12-28 02:40:51,846][106226] Updated weights for policy 0, policy_version 1032861 (0.0007) [2023-12-28 02:40:51,882][106225] Updated weights for policy 1, policy_version 1035467 (0.0007) [2023-12-28 02:40:51,936][106225] Updated weights for policy 1, policy_version 1035477 (0.0008) [2023-12-28 02:40:52,574][106226] Updated weights for policy 0, policy_version 1032871 (0.0008) [2023-12-28 02:40:52,634][106226] Updated weights for policy 0, policy_version 1032881 (0.0009) [2023-12-28 02:40:52,697][106226] Updated weights for policy 0, policy_version 1032891 (0.0007) [2023-12-28 02:40:52,705][106225] Updated weights for policy 1, policy_version 1035487 (0.0008) [2023-12-28 02:40:52,760][106225] Updated weights for policy 1, policy_version 1035497 (0.0008) [2023-12-28 02:40:52,827][106225] Updated weights for policy 1, policy_version 1035507 (0.0009) [2023-12-28 02:40:53,428][106226] Updated weights for policy 0, policy_version 1032901 (0.0007) [2023-12-28 02:40:53,486][106226] Updated weights for policy 0, policy_version 1032911 (0.0005) [2023-12-28 02:40:53,531][106225] Updated weights for policy 1, policy_version 1035517 (0.0008) [2023-12-28 02:40:53,544][106226] Updated weights for policy 0, policy_version 1032921 (0.0006) [2023-12-28 02:40:53,575][106225] Updated weights for policy 1, policy_version 1035527 (0.0010) [2023-12-28 02:40:53,622][106225] Updated weights for policy 1, policy_version 1035537 (0.0010) [2023-12-28 02:40:54,244][106226] Updated weights for policy 0, policy_version 1032931 (0.0007) [2023-12-28 02:40:54,307][106226] Updated weights for policy 0, policy_version 1032941 (0.0005) [2023-12-28 02:40:54,310][106225] Updated weights for policy 1, policy_version 1035547 (0.0010) [2023-12-28 02:40:54,367][106226] Updated weights for policy 0, policy_version 1032951 (0.0005) [2023-12-28 02:40:54,369][106225] Updated weights for policy 1, policy_version 1035557 (0.0011) [2023-12-28 02:40:54,422][106225] Updated weights for policy 1, policy_version 1035567 (0.0010) [2023-12-28 02:40:55,059][106226] Updated weights for policy 0, policy_version 1032961 (0.0006) [2023-12-28 02:40:55,098][106225] Updated weights for policy 1, policy_version 1035577 (0.0010) [2023-12-28 02:40:55,111][106226] Updated weights for policy 0, policy_version 1032971 (0.0009) [2023-12-28 02:40:55,147][106225] Updated weights for policy 1, policy_version 1035587 (0.0005) [2023-12-28 02:40:55,169][106226] Updated weights for policy 0, policy_version 1032981 (0.0008) [2023-12-28 02:40:55,199][106225] Updated weights for policy 1, policy_version 1035597 (0.0005) [2023-12-28 02:40:55,233][106226] Updated weights for policy 0, policy_version 1032991 (0.0007) [2023-12-28 02:40:55,252][106225] Updated weights for policy 1, policy_version 1035607 (0.0005) [2023-12-28 02:40:55,913][106225] Updated weights for policy 1, policy_version 1035617 (0.0005) [2023-12-28 02:40:55,926][106226] Updated weights for policy 0, policy_version 1033001 (0.0006) [2023-12-28 02:40:55,965][106225] Updated weights for policy 1, policy_version 1035627 (0.0005) [2023-12-28 02:40:55,978][106226] Updated weights for policy 0, policy_version 1033011 (0.0007) [2023-12-28 02:40:56,018][106225] Updated weights for policy 1, policy_version 1035637 (0.0005) [2023-12-28 02:40:56,028][106226] Updated weights for policy 0, policy_version 1033021 (0.0007) [2023-12-28 02:40:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 529678336. Throughput: 0: 9940.8, 1: 9896.6. Samples: 529640880. Policy #0 lag: (min: 47.0, avg: 55.8, max: 56.0) [2023-12-28 02:40:56,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.890')] [2023-12-28 02:40:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001035640_265166848.pth... [2023-12-28 02:40:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001033024_264511488.pth... [2023-12-28 02:40:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001034456_264863744.pth [2023-12-28 02:40:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001031872_264216576.pth [2023-12-28 02:40:56,623][106225] Updated weights for policy 1, policy_version 1035647 (0.0005) [2023-12-28 02:40:56,671][106225] Updated weights for policy 1, policy_version 1035657 (0.0007) [2023-12-28 02:40:56,708][106226] Updated weights for policy 0, policy_version 1033031 (0.0007) [2023-12-28 02:40:56,715][106225] Updated weights for policy 1, policy_version 1035667 (0.0006) [2023-12-28 02:40:56,766][106226] Updated weights for policy 0, policy_version 1033041 (0.0008) [2023-12-28 02:40:56,824][106226] Updated weights for policy 0, policy_version 1033051 (0.0007) [2023-12-28 02:40:57,424][106225] Updated weights for policy 1, policy_version 1035677 (0.0006) [2023-12-28 02:40:57,430][106226] Updated weights for policy 0, policy_version 1033061 (0.0007) [2023-12-28 02:40:57,473][106225] Updated weights for policy 1, policy_version 1035687 (0.0005) [2023-12-28 02:40:57,475][106226] Updated weights for policy 0, policy_version 1033071 (0.0007) [2023-12-28 02:40:57,527][106226] Updated weights for policy 0, policy_version 1033081 (0.0008) [2023-12-28 02:40:57,530][106225] Updated weights for policy 1, policy_version 1035697 (0.0006) [2023-12-28 02:40:58,166][106226] Updated weights for policy 0, policy_version 1033091 (0.0006) [2023-12-28 02:40:58,232][106226] Updated weights for policy 0, policy_version 1033101 (0.0007) [2023-12-28 02:40:58,279][106225] Updated weights for policy 1, policy_version 1035707 (0.0008) [2023-12-28 02:40:58,295][106226] Updated weights for policy 0, policy_version 1033111 (0.0008) [2023-12-28 02:40:58,347][106225] Updated weights for policy 1, policy_version 1035717 (0.0008) [2023-12-28 02:40:58,404][106225] Updated weights for policy 1, policy_version 1035727 (0.0008) [2023-12-28 02:40:59,133][106226] Updated weights for policy 0, policy_version 1033121 (0.0009) [2023-12-28 02:40:59,197][106226] Updated weights for policy 0, policy_version 1033131 (0.0007) [2023-12-28 02:40:59,231][106225] Updated weights for policy 1, policy_version 1035737 (0.0008) [2023-12-28 02:40:59,272][106226] Updated weights for policy 0, policy_version 1033141 (0.0008) [2023-12-28 02:40:59,299][106225] Updated weights for policy 1, policy_version 1035747 (0.0008) [2023-12-28 02:40:59,337][106226] Updated weights for policy 0, policy_version 1033151 (0.0009) [2023-12-28 02:40:59,364][106225] Updated weights for policy 1, policy_version 1035757 (0.0008) [2023-12-28 02:40:59,433][106225] Updated weights for policy 1, policy_version 1035767 (0.0008) [2023-12-28 02:41:00,009][106226] Updated weights for policy 0, policy_version 1033161 (0.0009) [2023-12-28 02:41:00,082][106226] Updated weights for policy 0, policy_version 1033171 (0.0010) [2023-12-28 02:41:00,156][106226] Updated weights for policy 0, policy_version 1033181 (0.0008) [2023-12-28 02:41:00,231][106225] Updated weights for policy 1, policy_version 1035777 (0.0008) [2023-12-28 02:41:00,285][106225] Updated weights for policy 1, policy_version 1035787 (0.0009) [2023-12-28 02:41:00,340][106225] Updated weights for policy 1, policy_version 1035797 (0.0008) [2023-12-28 02:41:00,850][106226] Updated weights for policy 0, policy_version 1033191 (0.0007) [2023-12-28 02:41:00,905][106226] Updated weights for policy 0, policy_version 1033201 (0.0007) [2023-12-28 02:41:00,959][106226] Updated weights for policy 0, policy_version 1033211 (0.0009) [2023-12-28 02:41:01,016][106225] Updated weights for policy 1, policy_version 1035807 (0.0007) [2023-12-28 02:41:01,082][106225] Updated weights for policy 1, policy_version 1035817 (0.0007) [2023-12-28 02:41:01,150][106225] Updated weights for policy 1, policy_version 1035827 (0.0007) [2023-12-28 02:41:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 529776640. Throughput: 0: 9988.8, 1: 9936.4. Samples: 529760832. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:01,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.136')] [2023-12-28 02:41:01,698][106226] Updated weights for policy 0, policy_version 1033221 (0.0008) [2023-12-28 02:41:01,791][106226] Updated weights for policy 0, policy_version 1033231 (0.0008) [2023-12-28 02:41:01,859][106226] Updated weights for policy 0, policy_version 1033241 (0.0009) [2023-12-28 02:41:01,873][106225] Updated weights for policy 1, policy_version 1035837 (0.0007) [2023-12-28 02:41:01,929][106225] Updated weights for policy 1, policy_version 1035847 (0.0006) [2023-12-28 02:41:01,980][106225] Updated weights for policy 1, policy_version 1035857 (0.0007) [2023-12-28 02:41:02,580][106226] Updated weights for policy 0, policy_version 1033251 (0.0007) [2023-12-28 02:41:02,642][106226] Updated weights for policy 0, policy_version 1033261 (0.0009) [2023-12-28 02:41:02,679][106225] Updated weights for policy 1, policy_version 1035867 (0.0008) [2023-12-28 02:41:02,701][106226] Updated weights for policy 0, policy_version 1033271 (0.0008) [2023-12-28 02:41:02,731][106225] Updated weights for policy 1, policy_version 1035877 (0.0007) [2023-12-28 02:41:02,778][106225] Updated weights for policy 1, policy_version 1035887 (0.0008) [2023-12-28 02:41:03,406][106226] Updated weights for policy 0, policy_version 1033281 (0.0007) [2023-12-28 02:41:03,459][106226] Updated weights for policy 0, policy_version 1033291 (0.0005) [2023-12-28 02:41:03,508][106226] Updated weights for policy 0, policy_version 1033301 (0.0005) [2023-12-28 02:41:03,546][106225] Updated weights for policy 1, policy_version 1035897 (0.0008) [2023-12-28 02:41:03,561][106226] Updated weights for policy 0, policy_version 1033311 (0.0005) [2023-12-28 02:41:03,602][106225] Updated weights for policy 1, policy_version 1035907 (0.0009) [2023-12-28 02:41:03,655][106225] Updated weights for policy 1, policy_version 1035917 (0.0009) [2023-12-28 02:41:03,716][106225] Updated weights for policy 1, policy_version 1035927 (0.0006) [2023-12-28 02:41:04,216][106226] Updated weights for policy 0, policy_version 1033321 (0.0008) [2023-12-28 02:41:04,275][106226] Updated weights for policy 0, policy_version 1033331 (0.0008) [2023-12-28 02:41:04,332][106226] Updated weights for policy 0, policy_version 1033341 (0.0009) [2023-12-28 02:41:04,419][106225] Updated weights for policy 1, policy_version 1035937 (0.0009) [2023-12-28 02:41:04,480][106225] Updated weights for policy 1, policy_version 1035947 (0.0007) [2023-12-28 02:41:04,540][106225] Updated weights for policy 1, policy_version 1035957 (0.0005) [2023-12-28 02:41:05,102][106225] Updated weights for policy 1, policy_version 1035967 (0.0007) [2023-12-28 02:41:05,153][106225] Updated weights for policy 1, policy_version 1035977 (0.0005) [2023-12-28 02:41:05,164][106226] Updated weights for policy 0, policy_version 1033351 (0.0008) [2023-12-28 02:41:05,203][106225] Updated weights for policy 1, policy_version 1035987 (0.0006) [2023-12-28 02:41:05,224][106226] Updated weights for policy 0, policy_version 1033361 (0.0008) [2023-12-28 02:41:05,285][106226] Updated weights for policy 0, policy_version 1033371 (0.0008) [2023-12-28 02:41:05,760][106225] Updated weights for policy 1, policy_version 1035997 (0.0006) [2023-12-28 02:41:05,827][106225] Updated weights for policy 1, policy_version 1036007 (0.0005) [2023-12-28 02:41:05,875][106225] Updated weights for policy 1, policy_version 1036017 (0.0005) [2023-12-28 02:41:06,087][106226] Updated weights for policy 0, policy_version 1033381 (0.0009) [2023-12-28 02:41:06,152][106226] Updated weights for policy 0, policy_version 1033391 (0.0008) [2023-12-28 02:41:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 529866752. Throughput: 0: 9896.6, 1: 10003.2. Samples: 529878600. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:06,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.051')] [2023-12-28 02:41:06,209][106226] Updated weights for policy 0, policy_version 1033401 (0.0009) [2023-12-28 02:41:06,434][106225] Updated weights for policy 1, policy_version 1036027 (0.0006) [2023-12-28 02:41:06,499][106225] Updated weights for policy 1, policy_version 1036037 (0.0008) [2023-12-28 02:41:06,566][106225] Updated weights for policy 1, policy_version 1036047 (0.0009) [2023-12-28 02:41:06,983][106226] Updated weights for policy 0, policy_version 1033411 (0.0009) [2023-12-28 02:41:07,041][106226] Updated weights for policy 0, policy_version 1033421 (0.0008) [2023-12-28 02:41:07,096][106226] Updated weights for policy 0, policy_version 1033431 (0.0008) [2023-12-28 02:41:07,291][106225] Updated weights for policy 1, policy_version 1036057 (0.0009) [2023-12-28 02:41:07,344][106225] Updated weights for policy 1, policy_version 1036067 (0.0010) [2023-12-28 02:41:07,398][106225] Updated weights for policy 1, policy_version 1036077 (0.0008) [2023-12-28 02:41:07,448][106225] Updated weights for policy 1, policy_version 1036087 (0.0006) [2023-12-28 02:41:07,860][106226] Updated weights for policy 0, policy_version 1033441 (0.0008) [2023-12-28 02:41:07,924][106226] Updated weights for policy 0, policy_version 1033451 (0.0007) [2023-12-28 02:41:07,981][106226] Updated weights for policy 0, policy_version 1033461 (0.0008) [2023-12-28 02:41:08,043][106226] Updated weights for policy 0, policy_version 1033471 (0.0008) [2023-12-28 02:41:08,131][106225] Updated weights for policy 1, policy_version 1036097 (0.0010) [2023-12-28 02:41:08,188][106225] Updated weights for policy 1, policy_version 1036107 (0.0010) [2023-12-28 02:41:08,238][106225] Updated weights for policy 1, policy_version 1036117 (0.0010) [2023-12-28 02:41:08,814][106226] Updated weights for policy 0, policy_version 1033481 (0.0009) [2023-12-28 02:41:08,873][106226] Updated weights for policy 0, policy_version 1033491 (0.0008) [2023-12-28 02:41:08,877][106225] Updated weights for policy 1, policy_version 1036127 (0.0007) [2023-12-28 02:41:08,927][106226] Updated weights for policy 0, policy_version 1033501 (0.0008) [2023-12-28 02:41:08,937][106225] Updated weights for policy 1, policy_version 1036137 (0.0009) [2023-12-28 02:41:08,998][106225] Updated weights for policy 1, policy_version 1036147 (0.0010) [2023-12-28 02:41:09,655][106226] Updated weights for policy 0, policy_version 1033511 (0.0008) [2023-12-28 02:41:09,661][106225] Updated weights for policy 1, policy_version 1036157 (0.0008) [2023-12-28 02:41:09,715][106226] Updated weights for policy 0, policy_version 1033521 (0.0008) [2023-12-28 02:41:09,720][106225] Updated weights for policy 1, policy_version 1036167 (0.0007) [2023-12-28 02:41:09,779][106226] Updated weights for policy 0, policy_version 1033531 (0.0008) [2023-12-28 02:41:09,784][106225] Updated weights for policy 1, policy_version 1036177 (0.0006) [2023-12-28 02:41:10,508][106226] Updated weights for policy 0, policy_version 1033541 (0.0008) [2023-12-28 02:41:10,564][106225] Updated weights for policy 1, policy_version 1036187 (0.0007) [2023-12-28 02:41:10,570][106226] Updated weights for policy 0, policy_version 1033551 (0.0008) [2023-12-28 02:41:10,623][106225] Updated weights for policy 1, policy_version 1036197 (0.0007) [2023-12-28 02:41:10,629][106226] Updated weights for policy 0, policy_version 1033561 (0.0006) [2023-12-28 02:41:10,686][106225] Updated weights for policy 1, policy_version 1036207 (0.0007) [2023-12-28 02:41:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 529965056. Throughput: 0: 9833.8, 1: 10098.3. Samples: 529936512. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:11,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-5.096')] [2023-12-28 02:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001033568_264650752.pth... [2023-12-28 02:41:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001036216_265314304.pth... [2023-12-28 02:41:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001035064_265019392.pth [2023-12-28 02:41:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001032448_264364032.pth [2023-12-28 02:41:11,444][106226] Updated weights for policy 0, policy_version 1033571 (0.0007) [2023-12-28 02:41:11,456][106225] Updated weights for policy 1, policy_version 1036217 (0.0008) [2023-12-28 02:41:11,506][106226] Updated weights for policy 0, policy_version 1033581 (0.0010) [2023-12-28 02:41:11,518][106225] Updated weights for policy 1, policy_version 1036227 (0.0011) [2023-12-28 02:41:11,564][106226] Updated weights for policy 0, policy_version 1033591 (0.0007) [2023-12-28 02:41:11,582][106225] Updated weights for policy 1, policy_version 1036237 (0.0011) [2023-12-28 02:41:11,647][106225] Updated weights for policy 1, policy_version 1036247 (0.0009) [2023-12-28 02:41:12,327][106226] Updated weights for policy 0, policy_version 1033601 (0.0008) [2023-12-28 02:41:12,393][106226] Updated weights for policy 0, policy_version 1033611 (0.0007) [2023-12-28 02:41:12,399][106225] Updated weights for policy 1, policy_version 1036257 (0.0008) [2023-12-28 02:41:12,459][106225] Updated weights for policy 1, policy_version 1036267 (0.0008) [2023-12-28 02:41:12,463][106226] Updated weights for policy 0, policy_version 1033621 (0.0006) [2023-12-28 02:41:12,524][106225] Updated weights for policy 1, policy_version 1036277 (0.0009) [2023-12-28 02:41:12,530][106226] Updated weights for policy 0, policy_version 1033631 (0.0006) [2023-12-28 02:41:13,175][106226] Updated weights for policy 0, policy_version 1033641 (0.0008) [2023-12-28 02:41:13,232][106225] Updated weights for policy 1, policy_version 1036287 (0.0006) [2023-12-28 02:41:13,232][106226] Updated weights for policy 0, policy_version 1033651 (0.0008) [2023-12-28 02:41:13,283][106226] Updated weights for policy 0, policy_version 1033661 (0.0005) [2023-12-28 02:41:13,290][106225] Updated weights for policy 1, policy_version 1036297 (0.0007) [2023-12-28 02:41:13,343][106225] Updated weights for policy 1, policy_version 1036307 (0.0009) [2023-12-28 02:41:13,978][106226] Updated weights for policy 0, policy_version 1033671 (0.0009) [2023-12-28 02:41:14,028][106226] Updated weights for policy 0, policy_version 1033681 (0.0008) [2023-12-28 02:41:14,083][106226] Updated weights for policy 0, policy_version 1033691 (0.0005) [2023-12-28 02:41:14,094][106225] Updated weights for policy 1, policy_version 1036317 (0.0008) [2023-12-28 02:41:14,154][106225] Updated weights for policy 1, policy_version 1036327 (0.0009) [2023-12-28 02:41:14,215][106225] Updated weights for policy 1, policy_version 1036337 (0.0008) [2023-12-28 02:41:14,647][106226] Updated weights for policy 0, policy_version 1033701 (0.0005) [2023-12-28 02:41:14,715][106226] Updated weights for policy 0, policy_version 1033711 (0.0009) [2023-12-28 02:41:14,786][106226] Updated weights for policy 0, policy_version 1033721 (0.0010) [2023-12-28 02:41:15,050][106225] Updated weights for policy 1, policy_version 1036347 (0.0008) [2023-12-28 02:41:15,119][106225] Updated weights for policy 1, policy_version 1036357 (0.0006) [2023-12-28 02:41:15,180][106225] Updated weights for policy 1, policy_version 1036367 (0.0007) [2023-12-28 02:41:15,470][106226] Updated weights for policy 0, policy_version 1033731 (0.0008) [2023-12-28 02:41:15,530][106226] Updated weights for policy 0, policy_version 1033741 (0.0010) [2023-12-28 02:41:15,597][106226] Updated weights for policy 0, policy_version 1033751 (0.0008) [2023-12-28 02:41:15,859][106225] Updated weights for policy 1, policy_version 1036377 (0.0007) [2023-12-28 02:41:15,916][106225] Updated weights for policy 1, policy_version 1036387 (0.0008) [2023-12-28 02:41:15,967][106225] Updated weights for policy 1, policy_version 1036397 (0.0008) [2023-12-28 02:41:16,023][106225] Updated weights for policy 1, policy_version 1036407 (0.0007) [2023-12-28 02:41:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 530063360. Throughput: 0: 9743.0, 1: 9922.4. Samples: 530051664. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:16,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-5.135')] [2023-12-28 02:41:16,225][106226] Updated weights for policy 0, policy_version 1033761 (0.0009) [2023-12-28 02:41:16,285][106226] Updated weights for policy 0, policy_version 1033771 (0.0006) [2023-12-28 02:41:16,331][106226] Updated weights for policy 0, policy_version 1033781 (0.0009) [2023-12-28 02:41:16,379][106226] Updated weights for policy 0, policy_version 1033791 (0.0006) [2023-12-28 02:41:16,765][106225] Updated weights for policy 1, policy_version 1036417 (0.0009) [2023-12-28 02:41:16,823][106225] Updated weights for policy 1, policy_version 1036427 (0.0008) [2023-12-28 02:41:16,886][106225] Updated weights for policy 1, policy_version 1036437 (0.0008) [2023-12-28 02:41:16,980][106226] Updated weights for policy 0, policy_version 1033801 (0.0010) [2023-12-28 02:41:17,036][106226] Updated weights for policy 0, policy_version 1033811 (0.0010) [2023-12-28 02:41:17,089][106226] Updated weights for policy 0, policy_version 1033821 (0.0010) [2023-12-28 02:41:17,551][106225] Updated weights for policy 1, policy_version 1036447 (0.0009) [2023-12-28 02:41:17,612][106225] Updated weights for policy 1, policy_version 1036457 (0.0007) [2023-12-28 02:41:17,662][106225] Updated weights for policy 1, policy_version 1036467 (0.0005) [2023-12-28 02:41:17,730][106226] Updated weights for policy 0, policy_version 1033831 (0.0009) [2023-12-28 02:41:17,801][106226] Updated weights for policy 0, policy_version 1033841 (0.0006) [2023-12-28 02:41:17,860][106226] Updated weights for policy 0, policy_version 1033851 (0.0005) [2023-12-28 02:41:18,317][106225] Updated weights for policy 1, policy_version 1036477 (0.0008) [2023-12-28 02:41:18,385][106225] Updated weights for policy 1, policy_version 1036487 (0.0010) [2023-12-28 02:41:18,401][106226] Updated weights for policy 0, policy_version 1033861 (0.0006) [2023-12-28 02:41:18,452][106225] Updated weights for policy 1, policy_version 1036497 (0.0010) [2023-12-28 02:41:18,462][106226] Updated weights for policy 0, policy_version 1033871 (0.0008) [2023-12-28 02:41:18,514][106226] Updated weights for policy 0, policy_version 1033881 (0.0007) [2023-12-28 02:41:19,185][106225] Updated weights for policy 1, policy_version 1036507 (0.0008) [2023-12-28 02:41:19,212][106226] Updated weights for policy 0, policy_version 1033891 (0.0007) [2023-12-28 02:41:19,250][106225] Updated weights for policy 1, policy_version 1036517 (0.0008) [2023-12-28 02:41:19,276][106226] Updated weights for policy 0, policy_version 1033901 (0.0009) [2023-12-28 02:41:19,313][106225] Updated weights for policy 1, policy_version 1036527 (0.0008) [2023-12-28 02:41:19,340][106226] Updated weights for policy 0, policy_version 1033911 (0.0008) [2023-12-28 02:41:20,129][106225] Updated weights for policy 1, policy_version 1036537 (0.0008) [2023-12-28 02:41:20,147][106226] Updated weights for policy 0, policy_version 1033921 (0.0008) [2023-12-28 02:41:20,189][106225] Updated weights for policy 1, policy_version 1036547 (0.0008) [2023-12-28 02:41:20,204][106226] Updated weights for policy 0, policy_version 1033931 (0.0007) [2023-12-28 02:41:20,242][106225] Updated weights for policy 1, policy_version 1036557 (0.0008) [2023-12-28 02:41:20,257][106226] Updated weights for policy 0, policy_version 1033941 (0.0008) [2023-12-28 02:41:20,290][106225] Updated weights for policy 1, policy_version 1036567 (0.0008) [2023-12-28 02:41:20,321][106226] Updated weights for policy 0, policy_version 1033951 (0.0007) [2023-12-28 02:41:21,005][106226] Updated weights for policy 0, policy_version 1033961 (0.0006) [2023-12-28 02:41:21,077][106226] Updated weights for policy 0, policy_version 1033971 (0.0007) [2023-12-28 02:41:21,085][106225] Updated weights for policy 1, policy_version 1036577 (0.0008) [2023-12-28 02:41:21,145][106226] Updated weights for policy 0, policy_version 1033981 (0.0008) [2023-12-28 02:41:21,152][106225] Updated weights for policy 1, policy_version 1036587 (0.0008) [2023-12-28 02:41:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 530161664. Throughput: 0: 9817.5, 1: 9802.2. Samples: 530171240. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:21,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.722')] [2023-12-28 02:41:21,211][106225] Updated weights for policy 1, policy_version 1036597 (0.0008) [2023-12-28 02:41:21,920][106226] Updated weights for policy 0, policy_version 1033991 (0.0008) [2023-12-28 02:41:21,964][106225] Updated weights for policy 1, policy_version 1036607 (0.0007) [2023-12-28 02:41:21,984][106226] Updated weights for policy 0, policy_version 1034001 (0.0008) [2023-12-28 02:41:22,023][106225] Updated weights for policy 1, policy_version 1036617 (0.0006) [2023-12-28 02:41:22,049][106226] Updated weights for policy 0, policy_version 1034011 (0.0008) [2023-12-28 02:41:22,078][106225] Updated weights for policy 1, policy_version 1036627 (0.0006) [2023-12-28 02:41:22,716][106225] Updated weights for policy 1, policy_version 1036637 (0.0007) [2023-12-28 02:41:22,773][106225] Updated weights for policy 1, policy_version 1036647 (0.0008) [2023-12-28 02:41:22,827][106225] Updated weights for policy 1, policy_version 1036657 (0.0006) [2023-12-28 02:41:22,882][106226] Updated weights for policy 0, policy_version 1034021 (0.0009) [2023-12-28 02:41:22,941][106226] Updated weights for policy 0, policy_version 1034031 (0.0011) [2023-12-28 02:41:22,989][106226] Updated weights for policy 0, policy_version 1034041 (0.0010) [2023-12-28 02:41:23,473][106225] Updated weights for policy 1, policy_version 1036667 (0.0007) [2023-12-28 02:41:23,527][106225] Updated weights for policy 1, policy_version 1036677 (0.0008) [2023-12-28 02:41:23,573][106225] Updated weights for policy 1, policy_version 1036687 (0.0008) [2023-12-28 02:41:23,701][106226] Updated weights for policy 0, policy_version 1034051 (0.0010) [2023-12-28 02:41:23,761][106226] Updated weights for policy 0, policy_version 1034061 (0.0008) [2023-12-28 02:41:23,827][106226] Updated weights for policy 0, policy_version 1034071 (0.0006) [2023-12-28 02:41:24,378][106225] Updated weights for policy 1, policy_version 1036697 (0.0009) [2023-12-28 02:41:24,431][106226] Updated weights for policy 0, policy_version 1034081 (0.0006) [2023-12-28 02:41:24,440][106225] Updated weights for policy 1, policy_version 1036707 (0.0008) [2023-12-28 02:41:24,485][106225] Updated weights for policy 1, policy_version 1036717 (0.0005) [2023-12-28 02:41:24,491][106226] Updated weights for policy 0, policy_version 1034091 (0.0008) [2023-12-28 02:41:24,542][106225] Updated weights for policy 1, policy_version 1036727 (0.0005) [2023-12-28 02:41:24,551][106226] Updated weights for policy 0, policy_version 1034101 (0.0008) [2023-12-28 02:41:24,612][106226] Updated weights for policy 0, policy_version 1034111 (0.0007) [2023-12-28 02:41:25,116][106225] Updated weights for policy 1, policy_version 1036737 (0.0010) [2023-12-28 02:41:25,149][106226] Updated weights for policy 0, policy_version 1034121 (0.0005) [2023-12-28 02:41:25,162][106225] Updated weights for policy 1, policy_version 1036747 (0.0010) [2023-12-28 02:41:25,201][106226] Updated weights for policy 0, policy_version 1034131 (0.0005) [2023-12-28 02:41:25,213][106225] Updated weights for policy 1, policy_version 1036757 (0.0010) [2023-12-28 02:41:25,249][106226] Updated weights for policy 0, policy_version 1034141 (0.0007) [2023-12-28 02:41:25,935][106226] Updated weights for policy 0, policy_version 1034151 (0.0008) [2023-12-28 02:41:25,949][106225] Updated weights for policy 1, policy_version 1036767 (0.0010) [2023-12-28 02:41:25,986][106226] Updated weights for policy 0, policy_version 1034161 (0.0005) [2023-12-28 02:41:26,003][106225] Updated weights for policy 1, policy_version 1036777 (0.0010) [2023-12-28 02:41:26,033][106226] Updated weights for policy 0, policy_version 1034171 (0.0006) [2023-12-28 02:41:26,056][106225] Updated weights for policy 1, policy_version 1036787 (0.0007) [2023-12-28 02:41:26,175][105115] Fps is (10 sec: 20479.1, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 530268160. Throughput: 0: 9777.2, 1: 9800.8. Samples: 530228728. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:26,176][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.049')] [2023-12-28 02:41:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001034176_264806400.pth... [2023-12-28 02:41:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001036792_265461760.pth... [2023-12-28 02:41:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001033024_264511488.pth [2023-12-28 02:41:26,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001035640_265166848.pth [2023-12-28 02:41:26,624][106225] Updated weights for policy 1, policy_version 1036797 (0.0008) [2023-12-28 02:41:26,632][106226] Updated weights for policy 0, policy_version 1034181 (0.0008) [2023-12-28 02:41:26,672][106225] Updated weights for policy 1, policy_version 1036807 (0.0009) [2023-12-28 02:41:26,691][106226] Updated weights for policy 0, policy_version 1034191 (0.0010) [2023-12-28 02:41:26,718][106225] Updated weights for policy 1, policy_version 1036817 (0.0007) [2023-12-28 02:41:26,749][106226] Updated weights for policy 0, policy_version 1034201 (0.0008) [2023-12-28 02:41:27,341][106225] Updated weights for policy 1, policy_version 1036827 (0.0009) [2023-12-28 02:41:27,374][106226] Updated weights for policy 0, policy_version 1034211 (0.0007) [2023-12-28 02:41:27,396][106225] Updated weights for policy 1, policy_version 1036837 (0.0005) [2023-12-28 02:41:27,428][106226] Updated weights for policy 0, policy_version 1034221 (0.0011) [2023-12-28 02:41:27,445][106225] Updated weights for policy 1, policy_version 1036847 (0.0005) [2023-12-28 02:41:27,476][106226] Updated weights for policy 0, policy_version 1034231 (0.0010) [2023-12-28 02:41:27,973][106225] Updated weights for policy 1, policy_version 1036857 (0.0006) [2023-12-28 02:41:28,022][106225] Updated weights for policy 1, policy_version 1036867 (0.0008) [2023-12-28 02:41:28,058][106226] Updated weights for policy 0, policy_version 1034241 (0.0010) [2023-12-28 02:41:28,070][106225] Updated weights for policy 1, policy_version 1036877 (0.0008) [2023-12-28 02:41:28,113][106226] Updated weights for policy 0, policy_version 1034251 (0.0005) [2023-12-28 02:41:28,114][106225] Updated weights for policy 1, policy_version 1036887 (0.0006) [2023-12-28 02:41:28,168][106226] Updated weights for policy 0, policy_version 1034261 (0.0005) [2023-12-28 02:41:28,216][106226] Updated weights for policy 0, policy_version 1034271 (0.0007) [2023-12-28 02:41:28,828][106226] Updated weights for policy 0, policy_version 1034281 (0.0006) [2023-12-28 02:41:28,894][106226] Updated weights for policy 0, policy_version 1034291 (0.0005) [2023-12-28 02:41:28,928][106225] Updated weights for policy 1, policy_version 1036897 (0.0008) [2023-12-28 02:41:28,957][106226] Updated weights for policy 0, policy_version 1034301 (0.0005) [2023-12-28 02:41:28,981][106225] Updated weights for policy 1, policy_version 1036907 (0.0008) [2023-12-28 02:41:29,034][106225] Updated weights for policy 1, policy_version 1036917 (0.0007) [2023-12-28 02:41:29,538][106226] Updated weights for policy 0, policy_version 1034311 (0.0009) [2023-12-28 02:41:29,588][106226] Updated weights for policy 0, policy_version 1034321 (0.0010) [2023-12-28 02:41:29,644][106226] Updated weights for policy 0, policy_version 1034331 (0.0010) [2023-12-28 02:41:29,774][106225] Updated weights for policy 1, policy_version 1036927 (0.0007) [2023-12-28 02:41:29,832][106225] Updated weights for policy 1, policy_version 1036937 (0.0006) [2023-12-28 02:41:29,890][106225] Updated weights for policy 1, policy_version 1036947 (0.0008) [2023-12-28 02:41:30,415][106226] Updated weights for policy 0, policy_version 1034341 (0.0010) [2023-12-28 02:41:30,469][106226] Updated weights for policy 0, policy_version 1034351 (0.0011) [2023-12-28 02:41:30,522][106226] Updated weights for policy 0, policy_version 1034361 (0.0010) [2023-12-28 02:41:30,606][106225] Updated weights for policy 1, policy_version 1036957 (0.0008) [2023-12-28 02:41:30,652][106225] Updated weights for policy 1, policy_version 1036967 (0.0008) [2023-12-28 02:41:30,706][106225] Updated weights for policy 1, policy_version 1036977 (0.0008) [2023-12-28 02:41:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 530366464. Throughput: 0: 9943.1, 1: 9918.5. Samples: 530358344. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:31,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.937')] [2023-12-28 02:41:31,265][106226] Updated weights for policy 0, policy_version 1034371 (0.0010) [2023-12-28 02:41:31,340][106226] Updated weights for policy 0, policy_version 1034381 (0.0011) [2023-12-28 02:41:31,410][106226] Updated weights for policy 0, policy_version 1034392 (0.0010) [2023-12-28 02:41:31,489][106225] Updated weights for policy 1, policy_version 1036987 (0.0007) [2023-12-28 02:41:31,549][106225] Updated weights for policy 1, policy_version 1036997 (0.0005) [2023-12-28 02:41:31,603][106225] Updated weights for policy 1, policy_version 1037007 (0.0006) [2023-12-28 02:41:32,096][106226] Updated weights for policy 0, policy_version 1034402 (0.0010) [2023-12-28 02:41:32,150][106226] Updated weights for policy 0, policy_version 1034412 (0.0010) [2023-12-28 02:41:32,209][106226] Updated weights for policy 0, policy_version 1034422 (0.0008) [2023-12-28 02:41:32,278][106226] Updated weights for policy 0, policy_version 1034432 (0.0010) [2023-12-28 02:41:32,343][106225] Updated weights for policy 1, policy_version 1037017 (0.0008) [2023-12-28 02:41:32,413][106225] Updated weights for policy 1, policy_version 1037027 (0.0010) [2023-12-28 02:41:32,481][106225] Updated weights for policy 1, policy_version 1037037 (0.0008) [2023-12-28 02:41:32,544][106225] Updated weights for policy 1, policy_version 1037047 (0.0007) [2023-12-28 02:41:32,948][106226] Updated weights for policy 0, policy_version 1034442 (0.0005) [2023-12-28 02:41:32,996][106226] Updated weights for policy 0, policy_version 1034452 (0.0005) [2023-12-28 02:41:33,046][106226] Updated weights for policy 0, policy_version 1034462 (0.0005) [2023-12-28 02:41:33,117][106225] Updated weights for policy 1, policy_version 1037057 (0.0006) [2023-12-28 02:41:33,171][106225] Updated weights for policy 1, policy_version 1037067 (0.0006) [2023-12-28 02:41:33,242][106225] Updated weights for policy 1, policy_version 1037077 (0.0008) [2023-12-28 02:41:33,587][106226] Updated weights for policy 0, policy_version 1034472 (0.0008) [2023-12-28 02:41:33,633][106226] Updated weights for policy 0, policy_version 1034482 (0.0005) [2023-12-28 02:41:33,692][106226] Updated weights for policy 0, policy_version 1034492 (0.0007) [2023-12-28 02:41:33,809][106225] Updated weights for policy 1, policy_version 1037087 (0.0008) [2023-12-28 02:41:33,863][106225] Updated weights for policy 1, policy_version 1037097 (0.0006) [2023-12-28 02:41:33,923][106225] Updated weights for policy 1, policy_version 1037107 (0.0006) [2023-12-28 02:41:34,418][106226] Updated weights for policy 0, policy_version 1034502 (0.0009) [2023-12-28 02:41:34,482][106226] Updated weights for policy 0, policy_version 1034512 (0.0009) [2023-12-28 02:41:34,545][106226] Updated weights for policy 0, policy_version 1034522 (0.0008) [2023-12-28 02:41:34,643][106225] Updated weights for policy 1, policy_version 1037117 (0.0008) [2023-12-28 02:41:34,708][106225] Updated weights for policy 1, policy_version 1037127 (0.0007) [2023-12-28 02:41:34,765][106225] Updated weights for policy 1, policy_version 1037137 (0.0008) [2023-12-28 02:41:35,235][106226] Updated weights for policy 0, policy_version 1034532 (0.0007) [2023-12-28 02:41:35,288][106226] Updated weights for policy 0, policy_version 1034542 (0.0010) [2023-12-28 02:41:35,352][106226] Updated weights for policy 0, policy_version 1034552 (0.0009) [2023-12-28 02:41:35,487][106225] Updated weights for policy 1, policy_version 1037147 (0.0008) [2023-12-28 02:41:35,541][106225] Updated weights for policy 1, policy_version 1037157 (0.0008) [2023-12-28 02:41:35,592][106225] Updated weights for policy 1, policy_version 1037167 (0.0008) [2023-12-28 02:41:36,006][106226] Updated weights for policy 0, policy_version 1034562 (0.0007) [2023-12-28 02:41:36,075][106226] Updated weights for policy 0, policy_version 1034572 (0.0005) [2023-12-28 02:41:36,142][106226] Updated weights for policy 0, policy_version 1034582 (0.0007) [2023-12-28 02:41:36,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 530464768. Throughput: 0: 9974.0, 1: 9912.0. Samples: 530479672. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:36,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.940')] [2023-12-28 02:41:36,190][106226] Updated weights for policy 0, policy_version 1034592 (0.0008) [2023-12-28 02:41:36,348][106225] Updated weights for policy 1, policy_version 1037177 (0.0010) [2023-12-28 02:41:36,405][106225] Updated weights for policy 1, policy_version 1037187 (0.0008) [2023-12-28 02:41:36,465][106225] Updated weights for policy 1, policy_version 1037197 (0.0009) [2023-12-28 02:41:36,531][106225] Updated weights for policy 1, policy_version 1037207 (0.0008) [2023-12-28 02:41:36,925][106226] Updated weights for policy 0, policy_version 1034602 (0.0006) [2023-12-28 02:41:36,987][106226] Updated weights for policy 0, policy_version 1034612 (0.0005) [2023-12-28 02:41:37,048][106226] Updated weights for policy 0, policy_version 1034622 (0.0005) [2023-12-28 02:41:37,263][106225] Updated weights for policy 1, policy_version 1037217 (0.0009) [2023-12-28 02:41:37,312][106225] Updated weights for policy 1, policy_version 1037228 (0.0008) [2023-12-28 02:41:37,374][106225] Updated weights for policy 1, policy_version 1037238 (0.0009) [2023-12-28 02:41:37,555][106226] Updated weights for policy 0, policy_version 1034632 (0.0005) [2023-12-28 02:41:37,623][106226] Updated weights for policy 0, policy_version 1034642 (0.0008) [2023-12-28 02:41:37,687][106226] Updated weights for policy 0, policy_version 1034652 (0.0009) [2023-12-28 02:41:38,109][106225] Updated weights for policy 1, policy_version 1037248 (0.0009) [2023-12-28 02:41:38,157][106225] Updated weights for policy 1, policy_version 1037258 (0.0008) [2023-12-28 02:41:38,215][106225] Updated weights for policy 1, policy_version 1037268 (0.0008) [2023-12-28 02:41:38,413][106226] Updated weights for policy 0, policy_version 1034662 (0.0008) [2023-12-28 02:41:38,474][106226] Updated weights for policy 0, policy_version 1034672 (0.0007) [2023-12-28 02:41:38,535][106226] Updated weights for policy 0, policy_version 1034682 (0.0007) [2023-12-28 02:41:38,949][106225] Updated weights for policy 1, policy_version 1037278 (0.0007) [2023-12-28 02:41:39,018][106225] Updated weights for policy 1, policy_version 1037288 (0.0005) [2023-12-28 02:41:39,082][106225] Updated weights for policy 1, policy_version 1037298 (0.0005) [2023-12-28 02:41:39,260][106226] Updated weights for policy 0, policy_version 1034692 (0.0008) [2023-12-28 02:41:39,312][106226] Updated weights for policy 0, policy_version 1034702 (0.0008) [2023-12-28 02:41:39,367][106226] Updated weights for policy 0, policy_version 1034712 (0.0008) [2023-12-28 02:41:39,758][106225] Updated weights for policy 1, policy_version 1037308 (0.0007) [2023-12-28 02:41:39,818][106225] Updated weights for policy 1, policy_version 1037318 (0.0011) [2023-12-28 02:41:39,888][106225] Updated weights for policy 1, policy_version 1037328 (0.0010) [2023-12-28 02:41:40,092][106226] Updated weights for policy 0, policy_version 1034722 (0.0009) [2023-12-28 02:41:40,156][106226] Updated weights for policy 0, policy_version 1034732 (0.0008) [2023-12-28 02:41:40,216][106226] Updated weights for policy 0, policy_version 1034742 (0.0009) [2023-12-28 02:41:40,267][106226] Updated weights for policy 0, policy_version 1034752 (0.0007) [2023-12-28 02:41:40,602][106225] Updated weights for policy 1, policy_version 1037338 (0.0011) [2023-12-28 02:41:40,653][106225] Updated weights for policy 1, policy_version 1037348 (0.0010) [2023-12-28 02:41:40,703][106225] Updated weights for policy 1, policy_version 1037358 (0.0010) [2023-12-28 02:41:40,763][106225] Updated weights for policy 1, policy_version 1037368 (0.0009) [2023-12-28 02:41:40,997][106226] Updated weights for policy 0, policy_version 1034762 (0.0011) [2023-12-28 02:41:41,068][106226] Updated weights for policy 0, policy_version 1034772 (0.0009) [2023-12-28 02:41:41,129][106226] Updated weights for policy 0, policy_version 1034782 (0.0008) [2023-12-28 02:41:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 530571264. Throughput: 0: 10020.4, 1: 9928.2. Samples: 530538568. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:41,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-4.853')] [2023-12-28 02:41:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001037368_265609216.pth... [2023-12-28 02:41:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001034784_264962048.pth... [2023-12-28 02:41:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001036216_265314304.pth [2023-12-28 02:41:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001033568_264650752.pth [2023-12-28 02:41:41,443][106225] Updated weights for policy 1, policy_version 1037378 (0.0006) [2023-12-28 02:41:41,506][106225] Updated weights for policy 1, policy_version 1037388 (0.0006) [2023-12-28 02:41:41,572][106225] Updated weights for policy 1, policy_version 1037398 (0.0007) [2023-12-28 02:41:41,957][106226] Updated weights for policy 0, policy_version 1034792 (0.0008) [2023-12-28 02:41:42,024][106226] Updated weights for policy 0, policy_version 1034802 (0.0008) [2023-12-28 02:41:42,087][106226] Updated weights for policy 0, policy_version 1034812 (0.0007) [2023-12-28 02:41:42,342][106225] Updated weights for policy 1, policy_version 1037408 (0.0010) [2023-12-28 02:41:42,405][106225] Updated weights for policy 1, policy_version 1037418 (0.0011) [2023-12-28 02:41:42,463][106225] Updated weights for policy 1, policy_version 1037428 (0.0011) [2023-12-28 02:41:42,854][106226] Updated weights for policy 0, policy_version 1034822 (0.0008) [2023-12-28 02:41:42,916][106226] Updated weights for policy 0, policy_version 1034832 (0.0008) [2023-12-28 02:41:42,973][106226] Updated weights for policy 0, policy_version 1034842 (0.0008) [2023-12-28 02:41:43,174][106225] Updated weights for policy 1, policy_version 1037438 (0.0007) [2023-12-28 02:41:43,219][106225] Updated weights for policy 1, policy_version 1037448 (0.0005) [2023-12-28 02:41:43,279][106225] Updated weights for policy 1, policy_version 1037458 (0.0005) [2023-12-28 02:41:43,625][106226] Updated weights for policy 0, policy_version 1034852 (0.0007) [2023-12-28 02:41:43,685][106226] Updated weights for policy 0, policy_version 1034862 (0.0005) [2023-12-28 02:41:43,739][106226] Updated weights for policy 0, policy_version 1034872 (0.0005) [2023-12-28 02:41:43,893][106225] Updated weights for policy 1, policy_version 1037468 (0.0007) [2023-12-28 02:41:43,938][106225] Updated weights for policy 1, policy_version 1037478 (0.0008) [2023-12-28 02:41:43,982][106225] Updated weights for policy 1, policy_version 1037488 (0.0008) [2023-12-28 02:41:44,419][106226] Updated weights for policy 0, policy_version 1034882 (0.0008) [2023-12-28 02:41:44,478][106226] Updated weights for policy 0, policy_version 1034892 (0.0009) [2023-12-28 02:41:44,534][106226] Updated weights for policy 0, policy_version 1034902 (0.0008) [2023-12-28 02:41:44,602][106226] Updated weights for policy 0, policy_version 1034912 (0.0005) [2023-12-28 02:41:44,645][106225] Updated weights for policy 1, policy_version 1037498 (0.0007) [2023-12-28 02:41:44,702][106225] Updated weights for policy 1, policy_version 1037508 (0.0005) [2023-12-28 02:41:44,757][106225] Updated weights for policy 1, policy_version 1037518 (0.0005) [2023-12-28 02:41:44,818][106225] Updated weights for policy 1, policy_version 1037528 (0.0008) [2023-12-28 02:41:45,374][106226] Updated weights for policy 0, policy_version 1034922 (0.0008) [2023-12-28 02:41:45,425][106226] Updated weights for policy 0, policy_version 1034932 (0.0005) [2023-12-28 02:41:45,426][106225] Updated weights for policy 1, policy_version 1037538 (0.0007) [2023-12-28 02:41:45,474][106225] Updated weights for policy 1, policy_version 1037548 (0.0006) [2023-12-28 02:41:45,481][106226] Updated weights for policy 0, policy_version 1034942 (0.0007) [2023-12-28 02:41:45,522][106225] Updated weights for policy 1, policy_version 1037558 (0.0005) [2023-12-28 02:41:46,118][106225] Updated weights for policy 1, policy_version 1037568 (0.0007) [2023-12-28 02:41:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 530661376. Throughput: 0: 9945.6, 1: 9944.5. Samples: 530655888. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:46,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-4.682')] [2023-12-28 02:41:46,181][106225] Updated weights for policy 1, policy_version 1037578 (0.0010) [2023-12-28 02:41:46,238][106226] Updated weights for policy 0, policy_version 1034952 (0.0006) [2023-12-28 02:41:46,239][106225] Updated weights for policy 1, policy_version 1037588 (0.0010) [2023-12-28 02:41:46,305][106226] Updated weights for policy 0, policy_version 1034962 (0.0006) [2023-12-28 02:41:46,361][106226] Updated weights for policy 0, policy_version 1034972 (0.0007) [2023-12-28 02:41:46,848][106225] Updated weights for policy 1, policy_version 1037598 (0.0010) [2023-12-28 02:41:46,904][106225] Updated weights for policy 1, policy_version 1037608 (0.0009) [2023-12-28 02:41:46,936][106226] Updated weights for policy 0, policy_version 1034982 (0.0006) [2023-12-28 02:41:46,954][106225] Updated weights for policy 1, policy_version 1037618 (0.0008) [2023-12-28 02:41:46,995][106226] Updated weights for policy 0, policy_version 1034992 (0.0007) [2023-12-28 02:41:47,053][106226] Updated weights for policy 0, policy_version 1035002 (0.0009) [2023-12-28 02:41:47,609][106226] Updated weights for policy 0, policy_version 1035012 (0.0006) [2023-12-28 02:41:47,667][106225] Updated weights for policy 1, policy_version 1037628 (0.0006) [2023-12-28 02:41:47,670][106226] Updated weights for policy 0, policy_version 1035022 (0.0005) [2023-12-28 02:41:47,717][106225] Updated weights for policy 1, policy_version 1037638 (0.0006) [2023-12-28 02:41:47,738][106226] Updated weights for policy 0, policy_version 1035032 (0.0008) [2023-12-28 02:41:47,763][106225] Updated weights for policy 1, policy_version 1037648 (0.0006) [2023-12-28 02:41:48,323][106226] Updated weights for policy 0, policy_version 1035042 (0.0008) [2023-12-28 02:41:48,391][106226] Updated weights for policy 0, policy_version 1035052 (0.0009) [2023-12-28 02:41:48,448][106226] Updated weights for policy 0, policy_version 1035062 (0.0008) [2023-12-28 02:41:48,451][106225] Updated weights for policy 1, policy_version 1037658 (0.0006) [2023-12-28 02:41:48,507][106226] Updated weights for policy 0, policy_version 1035072 (0.0007) [2023-12-28 02:41:48,512][106225] Updated weights for policy 1, policy_version 1037668 (0.0010) [2023-12-28 02:41:48,572][106225] Updated weights for policy 1, policy_version 1037678 (0.0010) [2023-12-28 02:41:48,627][106225] Updated weights for policy 1, policy_version 1037688 (0.0010) [2023-12-28 02:41:49,177][106226] Updated weights for policy 0, policy_version 1035082 (0.0008) [2023-12-28 02:41:49,243][106226] Updated weights for policy 0, policy_version 1035092 (0.0008) [2023-12-28 02:41:49,311][106226] Updated weights for policy 0, policy_version 1035102 (0.0008) [2023-12-28 02:41:49,384][106225] Updated weights for policy 1, policy_version 1037698 (0.0009) [2023-12-28 02:41:49,440][106225] Updated weights for policy 1, policy_version 1037708 (0.0010) [2023-12-28 02:41:49,501][106225] Updated weights for policy 1, policy_version 1037718 (0.0010) [2023-12-28 02:41:50,051][106226] Updated weights for policy 0, policy_version 1035112 (0.0008) [2023-12-28 02:41:50,116][106226] Updated weights for policy 0, policy_version 1035122 (0.0007) [2023-12-28 02:41:50,188][106226] Updated weights for policy 0, policy_version 1035132 (0.0005) [2023-12-28 02:41:50,240][106225] Updated weights for policy 1, policy_version 1037728 (0.0007) [2023-12-28 02:41:50,308][106225] Updated weights for policy 1, policy_version 1037738 (0.0009) [2023-12-28 02:41:50,376][106225] Updated weights for policy 1, policy_version 1037748 (0.0009) [2023-12-28 02:41:50,850][106226] Updated weights for policy 0, policy_version 1035142 (0.0007) [2023-12-28 02:41:50,918][106226] Updated weights for policy 0, policy_version 1035152 (0.0008) [2023-12-28 02:41:50,989][106226] Updated weights for policy 0, policy_version 1035162 (0.0008) [2023-12-28 02:41:51,077][106225] Updated weights for policy 1, policy_version 1037758 (0.0010) [2023-12-28 02:41:51,143][106225] Updated weights for policy 1, policy_version 1037768 (0.0008) [2023-12-28 02:41:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 530767872. Throughput: 0: 10069.2, 1: 9932.5. Samples: 530778676. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:51,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-5.047')] [2023-12-28 02:41:51,202][106225] Updated weights for policy 1, policy_version 1037778 (0.0007) [2023-12-28 02:41:51,743][106226] Updated weights for policy 0, policy_version 1035172 (0.0009) [2023-12-28 02:41:51,808][106226] Updated weights for policy 0, policy_version 1035182 (0.0009) [2023-12-28 02:41:51,870][106226] Updated weights for policy 0, policy_version 1035192 (0.0009) [2023-12-28 02:41:51,992][106225] Updated weights for policy 1, policy_version 1037788 (0.0008) [2023-12-28 02:41:52,045][106225] Updated weights for policy 1, policy_version 1037798 (0.0008) [2023-12-28 02:41:52,096][106225] Updated weights for policy 1, policy_version 1037808 (0.0008) [2023-12-28 02:41:52,587][106226] Updated weights for policy 0, policy_version 1035202 (0.0008) [2023-12-28 02:41:52,657][106226] Updated weights for policy 0, policy_version 1035212 (0.0008) [2023-12-28 02:41:52,724][106226] Updated weights for policy 0, policy_version 1035222 (0.0009) [2023-12-28 02:41:52,788][106226] Updated weights for policy 0, policy_version 1035232 (0.0011) [2023-12-28 02:41:52,843][106225] Updated weights for policy 1, policy_version 1037818 (0.0008) [2023-12-28 02:41:52,886][106225] Updated weights for policy 1, policy_version 1037828 (0.0007) [2023-12-28 02:41:52,931][106225] Updated weights for policy 1, policy_version 1037838 (0.0007) [2023-12-28 02:41:52,981][106225] Updated weights for policy 1, policy_version 1037848 (0.0006) [2023-12-28 02:41:53,409][106226] Updated weights for policy 0, policy_version 1035242 (0.0011) [2023-12-28 02:41:53,464][106226] Updated weights for policy 0, policy_version 1035252 (0.0009) [2023-12-28 02:41:53,524][106226] Updated weights for policy 0, policy_version 1035262 (0.0007) [2023-12-28 02:41:53,608][106225] Updated weights for policy 1, policy_version 1037858 (0.0005) [2023-12-28 02:41:53,660][106225] Updated weights for policy 1, policy_version 1037868 (0.0005) [2023-12-28 02:41:53,707][106225] Updated weights for policy 1, policy_version 1037878 (0.0005) [2023-12-28 02:41:54,239][106226] Updated weights for policy 0, policy_version 1035272 (0.0011) [2023-12-28 02:41:54,290][106226] Updated weights for policy 0, policy_version 1035282 (0.0011) [2023-12-28 02:41:54,315][106225] Updated weights for policy 1, policy_version 1037888 (0.0006) [2023-12-28 02:41:54,344][106226] Updated weights for policy 0, policy_version 1035292 (0.0010) [2023-12-28 02:41:54,364][106225] Updated weights for policy 1, policy_version 1037898 (0.0005) [2023-12-28 02:41:54,422][106225] Updated weights for policy 1, policy_version 1037908 (0.0006) [2023-12-28 02:41:54,996][106225] Updated weights for policy 1, policy_version 1037918 (0.0006) [2023-12-28 02:41:55,061][106225] Updated weights for policy 1, policy_version 1037928 (0.0007) [2023-12-28 02:41:55,061][106226] Updated weights for policy 0, policy_version 1035302 (0.0011) [2023-12-28 02:41:55,116][106226] Updated weights for policy 0, policy_version 1035312 (0.0011) [2023-12-28 02:41:55,124][106225] Updated weights for policy 1, policy_version 1037938 (0.0006) [2023-12-28 02:41:55,174][106226] Updated weights for policy 0, policy_version 1035322 (0.0007) [2023-12-28 02:41:55,782][106226] Updated weights for policy 0, policy_version 1035332 (0.0005) [2023-12-28 02:41:55,841][106226] Updated weights for policy 0, policy_version 1035342 (0.0005) [2023-12-28 02:41:55,873][106225] Updated weights for policy 1, policy_version 1037948 (0.0009) [2023-12-28 02:41:55,899][106226] Updated weights for policy 0, policy_version 1035352 (0.0007) [2023-12-28 02:41:55,925][106225] Updated weights for policy 1, policy_version 1037958 (0.0006) [2023-12-28 02:41:55,976][106225] Updated weights for policy 1, policy_version 1037968 (0.0006) [2023-12-28 02:41:56,175][105115] Fps is (10 sec: 21298.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 530874368. Throughput: 0: 10128.5, 1: 9903.3. Samples: 530837948. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:41:56,176][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.954')] [2023-12-28 02:41:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001037976_265764864.pth... [2023-12-28 02:41:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001035360_265109504.pth... [2023-12-28 02:41:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001034176_264806400.pth [2023-12-28 02:41:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001036792_265461760.pth [2023-12-28 02:41:56,527][106226] Updated weights for policy 0, policy_version 1035362 (0.0006) [2023-12-28 02:41:56,571][106225] Updated weights for policy 1, policy_version 1037978 (0.0007) [2023-12-28 02:41:56,578][106226] Updated weights for policy 0, policy_version 1035372 (0.0005) [2023-12-28 02:41:56,624][106226] Updated weights for policy 0, policy_version 1035382 (0.0006) [2023-12-28 02:41:56,634][106225] Updated weights for policy 1, policy_version 1037988 (0.0010) [2023-12-28 02:41:56,679][106226] Updated weights for policy 0, policy_version 1035392 (0.0007) [2023-12-28 02:41:56,696][106225] Updated weights for policy 1, policy_version 1037998 (0.0010) [2023-12-28 02:41:56,749][106225] Updated weights for policy 1, policy_version 1038008 (0.0010) [2023-12-28 02:41:57,276][106226] Updated weights for policy 0, policy_version 1035402 (0.0005) [2023-12-28 02:41:57,340][106226] Updated weights for policy 0, policy_version 1035412 (0.0008) [2023-12-28 02:41:57,390][106226] Updated weights for policy 0, policy_version 1035422 (0.0010) [2023-12-28 02:41:57,427][106225] Updated weights for policy 1, policy_version 1038018 (0.0005) [2023-12-28 02:41:57,470][106225] Updated weights for policy 1, policy_version 1038028 (0.0005) [2023-12-28 02:41:57,521][106225] Updated weights for policy 1, policy_version 1038038 (0.0005) [2023-12-28 02:41:57,986][106226] Updated weights for policy 0, policy_version 1035432 (0.0011) [2023-12-28 02:41:58,048][106226] Updated weights for policy 0, policy_version 1035442 (0.0010) [2023-12-28 02:41:58,100][106226] Updated weights for policy 0, policy_version 1035452 (0.0005) [2023-12-28 02:41:58,181][106225] Updated weights for policy 1, policy_version 1038048 (0.0009) [2023-12-28 02:41:58,246][106225] Updated weights for policy 1, policy_version 1038058 (0.0008) [2023-12-28 02:41:58,335][106225] Updated weights for policy 1, policy_version 1038068 (0.0008) [2023-12-28 02:41:58,802][106226] Updated weights for policy 0, policy_version 1035462 (0.0006) [2023-12-28 02:41:58,876][106226] Updated weights for policy 0, policy_version 1035472 (0.0009) [2023-12-28 02:41:58,940][106226] Updated weights for policy 0, policy_version 1035482 (0.0008) [2023-12-28 02:41:59,141][106225] Updated weights for policy 1, policy_version 1038078 (0.0007) [2023-12-28 02:41:59,203][106225] Updated weights for policy 1, policy_version 1038088 (0.0008) [2023-12-28 02:41:59,272][106225] Updated weights for policy 1, policy_version 1038098 (0.0008) [2023-12-28 02:41:59,685][106226] Updated weights for policy 0, policy_version 1035492 (0.0009) [2023-12-28 02:41:59,746][106226] Updated weights for policy 0, policy_version 1035502 (0.0007) [2023-12-28 02:41:59,810][106226] Updated weights for policy 0, policy_version 1035512 (0.0011) [2023-12-28 02:42:00,047][106225] Updated weights for policy 1, policy_version 1038108 (0.0008) [2023-12-28 02:42:00,108][106225] Updated weights for policy 1, policy_version 1038118 (0.0008) [2023-12-28 02:42:00,165][106225] Updated weights for policy 1, policy_version 1038128 (0.0009) [2023-12-28 02:42:00,464][106226] Updated weights for policy 0, policy_version 1035522 (0.0010) [2023-12-28 02:42:00,521][106226] Updated weights for policy 0, policy_version 1035532 (0.0010) [2023-12-28 02:42:00,578][106226] Updated weights for policy 0, policy_version 1035542 (0.0005) [2023-12-28 02:42:00,625][106226] Updated weights for policy 0, policy_version 1035552 (0.0005) [2023-12-28 02:42:00,945][106225] Updated weights for policy 1, policy_version 1038138 (0.0007) [2023-12-28 02:42:01,007][106225] Updated weights for policy 1, policy_version 1038148 (0.0005) [2023-12-28 02:42:01,089][106225] Updated weights for policy 1, policy_version 1038158 (0.0007) [2023-12-28 02:42:01,160][106225] Updated weights for policy 1, policy_version 1038168 (0.0008) [2023-12-28 02:42:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 530972672. Throughput: 0: 10200.0, 1: 10014.4. Samples: 530961312. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:01,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-5.004')] [2023-12-28 02:42:01,213][106226] Updated weights for policy 0, policy_version 1035562 (0.0008) [2023-12-28 02:42:01,275][106226] Updated weights for policy 0, policy_version 1035572 (0.0008) [2023-12-28 02:42:01,340][106226] Updated weights for policy 0, policy_version 1035582 (0.0008) [2023-12-28 02:42:01,831][106225] Updated weights for policy 1, policy_version 1038178 (0.0007) [2023-12-28 02:42:01,898][106225] Updated weights for policy 1, policy_version 1038188 (0.0007) [2023-12-28 02:42:01,974][106225] Updated weights for policy 1, policy_version 1038198 (0.0006) [2023-12-28 02:42:02,031][106226] Updated weights for policy 0, policy_version 1035592 (0.0008) [2023-12-28 02:42:02,079][106226] Updated weights for policy 0, policy_version 1035602 (0.0009) [2023-12-28 02:42:02,131][106226] Updated weights for policy 0, policy_version 1035612 (0.0009) [2023-12-28 02:42:02,600][106225] Updated weights for policy 1, policy_version 1038208 (0.0005) [2023-12-28 02:42:02,665][106225] Updated weights for policy 1, policy_version 1038218 (0.0010) [2023-12-28 02:42:02,727][106225] Updated weights for policy 1, policy_version 1038228 (0.0010) [2023-12-28 02:42:02,912][106226] Updated weights for policy 0, policy_version 1035622 (0.0007) [2023-12-28 02:42:02,965][106226] Updated weights for policy 0, policy_version 1035632 (0.0005) [2023-12-28 02:42:03,018][106226] Updated weights for policy 0, policy_version 1035642 (0.0005) [2023-12-28 02:42:03,264][106225] Updated weights for policy 1, policy_version 1038238 (0.0010) [2023-12-28 02:42:03,314][106225] Updated weights for policy 1, policy_version 1038248 (0.0010) [2023-12-28 02:42:03,360][106225] Updated weights for policy 1, policy_version 1038258 (0.0010) [2023-12-28 02:42:03,668][106226] Updated weights for policy 0, policy_version 1035652 (0.0008) [2023-12-28 02:42:03,721][106226] Updated weights for policy 0, policy_version 1035662 (0.0010) [2023-12-28 02:42:03,770][106226] Updated weights for policy 0, policy_version 1035672 (0.0010) [2023-12-28 02:42:03,960][106225] Updated weights for policy 1, policy_version 1038268 (0.0010) [2023-12-28 02:42:04,019][106225] Updated weights for policy 1, policy_version 1038278 (0.0009) [2023-12-28 02:42:04,066][106225] Updated weights for policy 1, policy_version 1038288 (0.0008) [2023-12-28 02:42:04,457][106226] Updated weights for policy 0, policy_version 1035682 (0.0010) [2023-12-28 02:42:04,524][106226] Updated weights for policy 0, policy_version 1035692 (0.0008) [2023-12-28 02:42:04,592][106226] Updated weights for policy 0, policy_version 1035702 (0.0008) [2023-12-28 02:42:04,659][106226] Updated weights for policy 0, policy_version 1035712 (0.0008) [2023-12-28 02:42:04,820][106225] Updated weights for policy 1, policy_version 1038298 (0.0007) [2023-12-28 02:42:04,889][106225] Updated weights for policy 1, policy_version 1038308 (0.0006) [2023-12-28 02:42:04,956][106225] Updated weights for policy 1, policy_version 1038318 (0.0005) [2023-12-28 02:42:05,025][106225] Updated weights for policy 1, policy_version 1038328 (0.0006) [2023-12-28 02:42:05,270][106226] Updated weights for policy 0, policy_version 1035722 (0.0007) [2023-12-28 02:42:05,322][106226] Updated weights for policy 0, policy_version 1035732 (0.0007) [2023-12-28 02:42:05,376][106226] Updated weights for policy 0, policy_version 1035742 (0.0009) [2023-12-28 02:42:05,586][106225] Updated weights for policy 1, policy_version 1038338 (0.0010) [2023-12-28 02:42:05,649][106225] Updated weights for policy 1, policy_version 1038348 (0.0007) [2023-12-28 02:42:05,720][106225] Updated weights for policy 1, policy_version 1038358 (0.0005) [2023-12-28 02:42:05,945][106226] Updated weights for policy 0, policy_version 1035752 (0.0006) [2023-12-28 02:42:05,996][106226] Updated weights for policy 0, policy_version 1035762 (0.0005) [2023-12-28 02:42:06,052][106226] Updated weights for policy 0, policy_version 1035772 (0.0006) [2023-12-28 02:42:06,175][105115] Fps is (10 sec: 20480.6, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 531079168. Throughput: 0: 10219.8, 1: 10122.0. Samples: 531086620. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:06,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.832')] [2023-12-28 02:42:06,242][106225] Updated weights for policy 1, policy_version 1038368 (0.0008) [2023-12-28 02:42:06,302][106225] Updated weights for policy 1, policy_version 1038378 (0.0007) [2023-12-28 02:42:06,369][106225] Updated weights for policy 1, policy_version 1038388 (0.0009) [2023-12-28 02:42:06,719][106226] Updated weights for policy 0, policy_version 1035782 (0.0008) [2023-12-28 02:42:06,782][106226] Updated weights for policy 0, policy_version 1035792 (0.0011) [2023-12-28 02:42:06,836][106226] Updated weights for policy 0, policy_version 1035802 (0.0010) [2023-12-28 02:42:07,114][106225] Updated weights for policy 1, policy_version 1038398 (0.0009) [2023-12-28 02:42:07,168][106225] Updated weights for policy 1, policy_version 1038408 (0.0010) [2023-12-28 02:42:07,227][106225] Updated weights for policy 1, policy_version 1038418 (0.0009) [2023-12-28 02:42:07,554][106226] Updated weights for policy 0, policy_version 1035812 (0.0011) [2023-12-28 02:42:07,620][106226] Updated weights for policy 0, policy_version 1035822 (0.0011) [2023-12-28 02:42:07,679][106226] Updated weights for policy 0, policy_version 1035832 (0.0010) [2023-12-28 02:42:07,915][106225] Updated weights for policy 1, policy_version 1038428 (0.0008) [2023-12-28 02:42:07,975][106225] Updated weights for policy 1, policy_version 1038438 (0.0010) [2023-12-28 02:42:08,032][106225] Updated weights for policy 1, policy_version 1038448 (0.0010) [2023-12-28 02:42:08,369][106226] Updated weights for policy 0, policy_version 1035842 (0.0010) [2023-12-28 02:42:08,433][106226] Updated weights for policy 0, policy_version 1035852 (0.0010) [2023-12-28 02:42:08,494][106226] Updated weights for policy 0, policy_version 1035862 (0.0010) [2023-12-28 02:42:08,561][106226] Updated weights for policy 0, policy_version 1035872 (0.0005) [2023-12-28 02:42:08,725][106225] Updated weights for policy 1, policy_version 1038458 (0.0009) [2023-12-28 02:42:08,795][106225] Updated weights for policy 1, policy_version 1038468 (0.0006) [2023-12-28 02:42:08,854][106225] Updated weights for policy 1, policy_version 1038478 (0.0009) [2023-12-28 02:42:08,914][106225] Updated weights for policy 1, policy_version 1038488 (0.0006) [2023-12-28 02:42:09,162][106226] Updated weights for policy 0, policy_version 1035882 (0.0005) [2023-12-28 02:42:09,217][106226] Updated weights for policy 0, policy_version 1035892 (0.0006) [2023-12-28 02:42:09,288][106226] Updated weights for policy 0, policy_version 1035902 (0.0009) [2023-12-28 02:42:09,555][106225] Updated weights for policy 1, policy_version 1038498 (0.0007) [2023-12-28 02:42:09,615][106225] Updated weights for policy 1, policy_version 1038508 (0.0006) [2023-12-28 02:42:09,675][106225] Updated weights for policy 1, policy_version 1038518 (0.0008) [2023-12-28 02:42:09,994][106226] Updated weights for policy 0, policy_version 1035912 (0.0009) [2023-12-28 02:42:10,050][106226] Updated weights for policy 0, policy_version 1035922 (0.0008) [2023-12-28 02:42:10,108][106226] Updated weights for policy 0, policy_version 1035932 (0.0008) [2023-12-28 02:42:10,393][106225] Updated weights for policy 1, policy_version 1038528 (0.0009) [2023-12-28 02:42:10,455][106225] Updated weights for policy 1, policy_version 1038538 (0.0009) [2023-12-28 02:42:10,518][106225] Updated weights for policy 1, policy_version 1038548 (0.0009) [2023-12-28 02:42:10,787][106226] Updated weights for policy 0, policy_version 1035942 (0.0008) [2023-12-28 02:42:10,854][106226] Updated weights for policy 0, policy_version 1035952 (0.0008) [2023-12-28 02:42:10,918][106226] Updated weights for policy 0, policy_version 1035962 (0.0008) [2023-12-28 02:42:11,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 531177472. Throughput: 0: 10283.8, 1: 10143.0. Samples: 531147924. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:11,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-5.297')] [2023-12-28 02:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001038552_265912320.pth... [2023-12-28 02:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001035968_265265152.pth... [2023-12-28 02:42:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001037368_265609216.pth [2023-12-28 02:42:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001034784_264962048.pth [2023-12-28 02:42:11,276][106225] Updated weights for policy 1, policy_version 1038558 (0.0008) [2023-12-28 02:42:11,335][106225] Updated weights for policy 1, policy_version 1038568 (0.0009) [2023-12-28 02:42:11,407][106225] Updated weights for policy 1, policy_version 1038578 (0.0009) [2023-12-28 02:42:11,673][106226] Updated weights for policy 0, policy_version 1035972 (0.0008) [2023-12-28 02:42:11,741][106226] Updated weights for policy 0, policy_version 1035982 (0.0009) [2023-12-28 02:42:11,795][106226] Updated weights for policy 0, policy_version 1035992 (0.0008) [2023-12-28 02:42:12,222][106225] Updated weights for policy 1, policy_version 1038588 (0.0008) [2023-12-28 02:42:12,294][106225] Updated weights for policy 1, policy_version 1038598 (0.0007) [2023-12-28 02:42:12,357][106225] Updated weights for policy 1, policy_version 1038608 (0.0007) [2023-12-28 02:42:12,583][106226] Updated weights for policy 0, policy_version 1036002 (0.0008) [2023-12-28 02:42:12,642][106226] Updated weights for policy 0, policy_version 1036012 (0.0010) [2023-12-28 02:42:12,705][106226] Updated weights for policy 0, policy_version 1036022 (0.0006) [2023-12-28 02:42:12,767][106226] Updated weights for policy 0, policy_version 1036032 (0.0010) [2023-12-28 02:42:13,130][106225] Updated weights for policy 1, policy_version 1038618 (0.0008) [2023-12-28 02:42:13,191][106225] Updated weights for policy 1, policy_version 1038628 (0.0007) [2023-12-28 02:42:13,248][106225] Updated weights for policy 1, policy_version 1038638 (0.0007) [2023-12-28 02:42:13,311][106225] Updated weights for policy 1, policy_version 1038648 (0.0007) [2023-12-28 02:42:13,435][106226] Updated weights for policy 0, policy_version 1036042 (0.0009) [2023-12-28 02:42:13,496][106226] Updated weights for policy 0, policy_version 1036052 (0.0009) [2023-12-28 02:42:13,554][106226] Updated weights for policy 0, policy_version 1036062 (0.0007) [2023-12-28 02:42:13,974][106225] Updated weights for policy 1, policy_version 1038658 (0.0008) [2023-12-28 02:42:14,037][106225] Updated weights for policy 1, policy_version 1038668 (0.0007) [2023-12-28 02:42:14,095][106225] Updated weights for policy 1, policy_version 1038678 (0.0006) [2023-12-28 02:42:14,156][106226] Updated weights for policy 0, policy_version 1036072 (0.0009) [2023-12-28 02:42:14,213][106226] Updated weights for policy 0, policy_version 1036082 (0.0010) [2023-12-28 02:42:14,267][106226] Updated weights for policy 0, policy_version 1036092 (0.0005) [2023-12-28 02:42:14,742][106225] Updated weights for policy 1, policy_version 1038688 (0.0009) [2023-12-28 02:42:14,804][106225] Updated weights for policy 1, policy_version 1038698 (0.0009) [2023-12-28 02:42:14,862][106225] Updated weights for policy 1, policy_version 1038708 (0.0008) [2023-12-28 02:42:14,874][106226] Updated weights for policy 0, policy_version 1036102 (0.0007) [2023-12-28 02:42:14,925][106226] Updated weights for policy 0, policy_version 1036112 (0.0007) [2023-12-28 02:42:14,976][106226] Updated weights for policy 0, policy_version 1036122 (0.0007) [2023-12-28 02:42:15,605][106225] Updated weights for policy 1, policy_version 1038718 (0.0009) [2023-12-28 02:42:15,651][106225] Updated weights for policy 1, policy_version 1038728 (0.0010) [2023-12-28 02:42:15,680][106226] Updated weights for policy 0, policy_version 1036132 (0.0008) [2023-12-28 02:42:15,701][106225] Updated weights for policy 1, policy_version 1038738 (0.0010) [2023-12-28 02:42:15,738][106226] Updated weights for policy 0, policy_version 1036142 (0.0010) [2023-12-28 02:42:15,795][106226] Updated weights for policy 0, policy_version 1036152 (0.0008) [2023-12-28 02:42:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 531275776. Throughput: 0: 10125.7, 1: 10015.9. Samples: 531264716. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:16,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-5.014')] [2023-12-28 02:42:16,402][106225] Updated weights for policy 1, policy_version 1038748 (0.0010) [2023-12-28 02:42:16,437][106226] Updated weights for policy 0, policy_version 1036162 (0.0007) [2023-12-28 02:42:16,458][106225] Updated weights for policy 1, policy_version 1038758 (0.0010) [2023-12-28 02:42:16,490][106226] Updated weights for policy 0, policy_version 1036172 (0.0010) [2023-12-28 02:42:16,508][106225] Updated weights for policy 1, policy_version 1038768 (0.0010) [2023-12-28 02:42:16,543][106226] Updated weights for policy 0, policy_version 1036182 (0.0010) [2023-12-28 02:42:16,599][106226] Updated weights for policy 0, policy_version 1036192 (0.0010) [2023-12-28 02:42:17,210][106225] Updated weights for policy 1, policy_version 1038778 (0.0009) [2023-12-28 02:42:17,269][106225] Updated weights for policy 1, policy_version 1038788 (0.0006) [2023-12-28 02:42:17,269][106226] Updated weights for policy 0, policy_version 1036202 (0.0011) [2023-12-28 02:42:17,329][106225] Updated weights for policy 1, policy_version 1038798 (0.0006) [2023-12-28 02:42:17,334][106226] Updated weights for policy 0, policy_version 1036212 (0.0011) [2023-12-28 02:42:17,383][106225] Updated weights for policy 1, policy_version 1038808 (0.0006) [2023-12-28 02:42:17,392][106226] Updated weights for policy 0, policy_version 1036222 (0.0011) [2023-12-28 02:42:18,060][106226] Updated weights for policy 0, policy_version 1036232 (0.0009) [2023-12-28 02:42:18,063][106225] Updated weights for policy 1, policy_version 1038818 (0.0006) [2023-12-28 02:42:18,112][106226] Updated weights for policy 0, policy_version 1036242 (0.0006) [2023-12-28 02:42:18,117][106225] Updated weights for policy 1, policy_version 1038828 (0.0007) [2023-12-28 02:42:18,164][106226] Updated weights for policy 0, policy_version 1036252 (0.0006) [2023-12-28 02:42:18,170][106225] Updated weights for policy 1, policy_version 1038838 (0.0006) [2023-12-28 02:42:18,830][106226] Updated weights for policy 0, policy_version 1036262 (0.0010) [2023-12-28 02:42:18,898][106226] Updated weights for policy 0, policy_version 1036272 (0.0011) [2023-12-28 02:42:18,955][106226] Updated weights for policy 0, policy_version 1036282 (0.0010) [2023-12-28 02:42:18,964][106225] Updated weights for policy 1, policy_version 1038848 (0.0006) [2023-12-28 02:42:19,034][106225] Updated weights for policy 1, policy_version 1038858 (0.0006) [2023-12-28 02:42:19,085][106225] Updated weights for policy 1, policy_version 1038868 (0.0009) [2023-12-28 02:42:19,777][106226] Updated weights for policy 0, policy_version 1036292 (0.0010) [2023-12-28 02:42:19,832][106226] Updated weights for policy 0, policy_version 1036302 (0.0008) [2023-12-28 02:42:19,844][106225] Updated weights for policy 1, policy_version 1038878 (0.0008) [2023-12-28 02:42:19,891][106226] Updated weights for policy 0, policy_version 1036312 (0.0008) [2023-12-28 02:42:19,907][106225] Updated weights for policy 1, policy_version 1038888 (0.0010) [2023-12-28 02:42:19,975][106225] Updated weights for policy 1, policy_version 1038898 (0.0008) [2023-12-28 02:42:20,667][106225] Updated weights for policy 1, policy_version 1038908 (0.0009) [2023-12-28 02:42:20,728][106225] Updated weights for policy 1, policy_version 1038918 (0.0006) [2023-12-28 02:42:20,741][106226] Updated weights for policy 0, policy_version 1036322 (0.0008) [2023-12-28 02:42:20,796][106225] Updated weights for policy 1, policy_version 1038928 (0.0007) [2023-12-28 02:42:20,809][106226] Updated weights for policy 0, policy_version 1036332 (0.0008) [2023-12-28 02:42:20,876][106226] Updated weights for policy 0, policy_version 1036342 (0.0006) [2023-12-28 02:42:20,943][106226] Updated weights for policy 0, policy_version 1036352 (0.0008) [2023-12-28 02:42:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 531374080. Throughput: 0: 10062.3, 1: 9978.4. Samples: 531381504. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:21,175][105115] Avg episode reward: [(0, '-4.930'), (1, '-5.074')] [2023-12-28 02:42:21,540][106225] Updated weights for policy 1, policy_version 1038938 (0.0008) [2023-12-28 02:42:21,595][106225] Updated weights for policy 1, policy_version 1038948 (0.0008) [2023-12-28 02:42:21,665][106225] Updated weights for policy 1, policy_version 1038958 (0.0012) [2023-12-28 02:42:21,671][106226] Updated weights for policy 0, policy_version 1036362 (0.0008) [2023-12-28 02:42:21,723][106225] Updated weights for policy 1, policy_version 1038968 (0.0007) [2023-12-28 02:42:21,739][106226] Updated weights for policy 0, policy_version 1036372 (0.0010) [2023-12-28 02:42:21,803][106226] Updated weights for policy 0, policy_version 1036382 (0.0009) [2023-12-28 02:42:22,426][106225] Updated weights for policy 1, policy_version 1038978 (0.0008) [2023-12-28 02:42:22,485][106225] Updated weights for policy 1, policy_version 1038988 (0.0007) [2023-12-28 02:42:22,551][106225] Updated weights for policy 1, policy_version 1038998 (0.0008) [2023-12-28 02:42:22,602][106226] Updated weights for policy 0, policy_version 1036392 (0.0009) [2023-12-28 02:42:22,669][106226] Updated weights for policy 0, policy_version 1036402 (0.0009) [2023-12-28 02:42:22,737][106226] Updated weights for policy 0, policy_version 1036412 (0.0006) [2023-12-28 02:42:23,295][106225] Updated weights for policy 1, policy_version 1039008 (0.0008) [2023-12-28 02:42:23,347][106225] Updated weights for policy 1, policy_version 1039018 (0.0009) [2023-12-28 02:42:23,402][106225] Updated weights for policy 1, policy_version 1039028 (0.0008) [2023-12-28 02:42:23,404][106226] Updated weights for policy 0, policy_version 1036422 (0.0006) [2023-12-28 02:42:23,463][106226] Updated weights for policy 0, policy_version 1036432 (0.0008) [2023-12-28 02:42:23,510][106226] Updated weights for policy 0, policy_version 1036442 (0.0008) [2023-12-28 02:42:24,044][106225] Updated weights for policy 1, policy_version 1039038 (0.0006) [2023-12-28 02:42:24,093][106225] Updated weights for policy 1, policy_version 1039048 (0.0008) [2023-12-28 02:42:24,128][106226] Updated weights for policy 0, policy_version 1036452 (0.0007) [2023-12-28 02:42:24,143][106225] Updated weights for policy 1, policy_version 1039058 (0.0009) [2023-12-28 02:42:24,184][106226] Updated weights for policy 0, policy_version 1036462 (0.0006) [2023-12-28 02:42:24,242][106226] Updated weights for policy 0, policy_version 1036472 (0.0008) [2023-12-28 02:42:24,851][106225] Updated weights for policy 1, policy_version 1039068 (0.0009) [2023-12-28 02:42:24,893][106226] Updated weights for policy 0, policy_version 1036482 (0.0009) [2023-12-28 02:42:24,912][106225] Updated weights for policy 1, policy_version 1039078 (0.0010) [2023-12-28 02:42:24,938][106226] Updated weights for policy 0, policy_version 1036492 (0.0007) [2023-12-28 02:42:24,966][106225] Updated weights for policy 1, policy_version 1039088 (0.0010) [2023-12-28 02:42:24,991][106226] Updated weights for policy 0, policy_version 1036502 (0.0006) [2023-12-28 02:42:25,041][106226] Updated weights for policy 0, policy_version 1036512 (0.0005) [2023-12-28 02:42:25,599][106226] Updated weights for policy 0, policy_version 1036522 (0.0008) [2023-12-28 02:42:25,656][106225] Updated weights for policy 1, policy_version 1039098 (0.0008) [2023-12-28 02:42:25,665][106226] Updated weights for policy 0, policy_version 1036532 (0.0007) [2023-12-28 02:42:25,706][106225] Updated weights for policy 1, policy_version 1039108 (0.0010) [2023-12-28 02:42:25,725][106226] Updated weights for policy 0, policy_version 1036542 (0.0008) [2023-12-28 02:42:25,752][106225] Updated weights for policy 1, policy_version 1039118 (0.0010) [2023-12-28 02:42:25,808][106225] Updated weights for policy 1, policy_version 1039128 (0.0010) [2023-12-28 02:42:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.5, 300 sec: 19883.0). Total num frames: 531472384. Throughput: 0: 10035.4, 1: 9967.4. Samples: 531438692. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:26,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.957')] [2023-12-28 02:42:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001039128_266059776.pth... [2023-12-28 02:42:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001036544_265412608.pth... [2023-12-28 02:42:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001037976_265764864.pth [2023-12-28 02:42:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001035360_265109504.pth [2023-12-28 02:42:26,323][106226] Updated weights for policy 0, policy_version 1036552 (0.0006) [2023-12-28 02:42:26,378][106226] Updated weights for policy 0, policy_version 1036562 (0.0006) [2023-12-28 02:42:26,431][106226] Updated weights for policy 0, policy_version 1036572 (0.0006) [2023-12-28 02:42:26,453][106225] Updated weights for policy 1, policy_version 1039138 (0.0005) [2023-12-28 02:42:26,505][106225] Updated weights for policy 1, policy_version 1039148 (0.0005) [2023-12-28 02:42:26,559][106225] Updated weights for policy 1, policy_version 1039158 (0.0008) [2023-12-28 02:42:26,978][106226] Updated weights for policy 0, policy_version 1036582 (0.0006) [2023-12-28 02:42:27,030][106226] Updated weights for policy 0, policy_version 1036592 (0.0011) [2023-12-28 02:42:27,081][106226] Updated weights for policy 0, policy_version 1036602 (0.0011) [2023-12-28 02:42:27,173][106225] Updated weights for policy 1, policy_version 1039168 (0.0009) [2023-12-28 02:42:27,239][106225] Updated weights for policy 1, policy_version 1039178 (0.0009) [2023-12-28 02:42:27,318][106225] Updated weights for policy 1, policy_version 1039188 (0.0010) [2023-12-28 02:42:27,746][106226] Updated weights for policy 0, policy_version 1036612 (0.0008) [2023-12-28 02:42:27,799][106226] Updated weights for policy 0, policy_version 1036622 (0.0005) [2023-12-28 02:42:27,854][106226] Updated weights for policy 0, policy_version 1036632 (0.0007) [2023-12-28 02:42:27,978][106225] Updated weights for policy 1, policy_version 1039198 (0.0007) [2023-12-28 02:42:28,030][106225] Updated weights for policy 1, policy_version 1039208 (0.0006) [2023-12-28 02:42:28,084][106225] Updated weights for policy 1, policy_version 1039218 (0.0005) [2023-12-28 02:42:28,535][106226] Updated weights for policy 0, policy_version 1036642 (0.0010) [2023-12-28 02:42:28,587][106226] Updated weights for policy 0, policy_version 1036652 (0.0007) [2023-12-28 02:42:28,645][106226] Updated weights for policy 0, policy_version 1036662 (0.0007) [2023-12-28 02:42:28,711][106226] Updated weights for policy 0, policy_version 1036672 (0.0005) [2023-12-28 02:42:28,713][106225] Updated weights for policy 1, policy_version 1039228 (0.0007) [2023-12-28 02:42:28,776][106225] Updated weights for policy 1, policy_version 1039238 (0.0010) [2023-12-28 02:42:28,849][106225] Updated weights for policy 1, policy_version 1039248 (0.0010) [2023-12-28 02:42:29,362][106226] Updated weights for policy 0, policy_version 1036682 (0.0008) [2023-12-28 02:42:29,423][106226] Updated weights for policy 0, policy_version 1036692 (0.0008) [2023-12-28 02:42:29,482][106226] Updated weights for policy 0, policy_version 1036702 (0.0007) [2023-12-28 02:42:29,585][106225] Updated weights for policy 1, policy_version 1039258 (0.0009) [2023-12-28 02:42:29,647][106225] Updated weights for policy 1, policy_version 1039268 (0.0005) [2023-12-28 02:42:29,705][106225] Updated weights for policy 1, policy_version 1039278 (0.0006) [2023-12-28 02:42:29,753][106225] Updated weights for policy 1, policy_version 1039288 (0.0010) [2023-12-28 02:42:30,157][106226] Updated weights for policy 0, policy_version 1036712 (0.0006) [2023-12-28 02:42:30,206][106226] Updated weights for policy 0, policy_version 1036722 (0.0005) [2023-12-28 02:42:30,261][106226] Updated weights for policy 0, policy_version 1036732 (0.0008) [2023-12-28 02:42:30,434][106225] Updated weights for policy 1, policy_version 1039298 (0.0010) [2023-12-28 02:42:30,484][106225] Updated weights for policy 1, policy_version 1039308 (0.0008) [2023-12-28 02:42:30,528][106225] Updated weights for policy 1, policy_version 1039318 (0.0008) [2023-12-28 02:42:30,890][106226] Updated weights for policy 0, policy_version 1036742 (0.0007) [2023-12-28 02:42:30,954][106226] Updated weights for policy 0, policy_version 1036752 (0.0006) [2023-12-28 02:42:31,007][106226] Updated weights for policy 0, policy_version 1036762 (0.0008) [2023-12-28 02:42:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 531578880. Throughput: 0: 10217.9, 1: 10027.3. Samples: 531566920. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:31,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-5.261')] [2023-12-28 02:42:31,270][106225] Updated weights for policy 1, policy_version 1039328 (0.0008) [2023-12-28 02:42:31,323][106225] Updated weights for policy 1, policy_version 1039338 (0.0009) [2023-12-28 02:42:31,386][106225] Updated weights for policy 1, policy_version 1039348 (0.0008) [2023-12-28 02:42:31,683][106226] Updated weights for policy 0, policy_version 1036772 (0.0007) [2023-12-28 02:42:31,751][106226] Updated weights for policy 0, policy_version 1036782 (0.0007) [2023-12-28 02:42:31,808][106226] Updated weights for policy 0, policy_version 1036792 (0.0005) [2023-12-28 02:42:32,124][106225] Updated weights for policy 1, policy_version 1039358 (0.0008) [2023-12-28 02:42:32,175][106225] Updated weights for policy 1, policy_version 1039368 (0.0008) [2023-12-28 02:42:32,224][106225] Updated weights for policy 1, policy_version 1039378 (0.0008) [2023-12-28 02:42:32,444][106226] Updated weights for policy 0, policy_version 1036802 (0.0006) [2023-12-28 02:42:32,502][106226] Updated weights for policy 0, policy_version 1036812 (0.0008) [2023-12-28 02:42:32,566][106226] Updated weights for policy 0, policy_version 1036822 (0.0008) [2023-12-28 02:42:32,629][106226] Updated weights for policy 0, policy_version 1036832 (0.0009) [2023-12-28 02:42:33,021][106225] Updated weights for policy 1, policy_version 1039388 (0.0008) [2023-12-28 02:42:33,075][106225] Updated weights for policy 1, policy_version 1039398 (0.0008) [2023-12-28 02:42:33,122][106225] Updated weights for policy 1, policy_version 1039408 (0.0008) [2023-12-28 02:42:33,315][106226] Updated weights for policy 0, policy_version 1036842 (0.0006) [2023-12-28 02:42:33,369][106226] Updated weights for policy 0, policy_version 1036852 (0.0005) [2023-12-28 02:42:33,435][106226] Updated weights for policy 0, policy_version 1036862 (0.0005) [2023-12-28 02:42:33,911][106225] Updated weights for policy 1, policy_version 1039419 (0.0009) [2023-12-28 02:42:33,963][106225] Updated weights for policy 1, policy_version 1039429 (0.0008) [2023-12-28 02:42:34,022][106225] Updated weights for policy 1, policy_version 1039439 (0.0008) [2023-12-28 02:42:34,036][106226] Updated weights for policy 0, policy_version 1036872 (0.0006) [2023-12-28 02:42:34,088][106226] Updated weights for policy 0, policy_version 1036882 (0.0007) [2023-12-28 02:42:34,145][106226] Updated weights for policy 0, policy_version 1036892 (0.0007) [2023-12-28 02:42:34,761][106225] Updated weights for policy 1, policy_version 1039449 (0.0007) [2023-12-28 02:42:34,825][106225] Updated weights for policy 1, policy_version 1039459 (0.0008) [2023-12-28 02:42:34,846][106226] Updated weights for policy 0, policy_version 1036902 (0.0008) [2023-12-28 02:42:34,889][106225] Updated weights for policy 1, policy_version 1039469 (0.0008) [2023-12-28 02:42:34,895][106226] Updated weights for policy 0, policy_version 1036912 (0.0010) [2023-12-28 02:42:34,948][106226] Updated weights for policy 0, policy_version 1036922 (0.0008) [2023-12-28 02:42:34,955][106225] Updated weights for policy 1, policy_version 1039479 (0.0007) [2023-12-28 02:42:35,501][106225] Updated weights for policy 1, policy_version 1039489 (0.0008) [2023-12-28 02:42:35,560][106225] Updated weights for policy 1, policy_version 1039499 (0.0008) [2023-12-28 02:42:35,594][106226] Updated weights for policy 0, policy_version 1036932 (0.0011) [2023-12-28 02:42:35,612][106225] Updated weights for policy 1, policy_version 1039509 (0.0006) [2023-12-28 02:42:35,658][106226] Updated weights for policy 0, policy_version 1036942 (0.0011) [2023-12-28 02:42:35,717][106226] Updated weights for policy 0, policy_version 1036952 (0.0011) [2023-12-28 02:42:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 531677184. Throughput: 0: 10248.5, 1: 9966.0. Samples: 531688328. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:36,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.815')] [2023-12-28 02:42:36,289][106225] Updated weights for policy 1, policy_version 1039519 (0.0008) [2023-12-28 02:42:36,339][106225] Updated weights for policy 1, policy_version 1039529 (0.0009) [2023-12-28 02:42:36,394][106225] Updated weights for policy 1, policy_version 1039539 (0.0009) [2023-12-28 02:42:36,428][106226] Updated weights for policy 0, policy_version 1036962 (0.0011) [2023-12-28 02:42:36,480][106226] Updated weights for policy 0, policy_version 1036972 (0.0008) [2023-12-28 02:42:36,539][106226] Updated weights for policy 0, policy_version 1036982 (0.0008) [2023-12-28 02:42:36,602][106226] Updated weights for policy 0, policy_version 1036992 (0.0008) [2023-12-28 02:42:37,102][106225] Updated weights for policy 1, policy_version 1039549 (0.0006) [2023-12-28 02:42:37,157][106225] Updated weights for policy 1, policy_version 1039559 (0.0008) [2023-12-28 02:42:37,204][106225] Updated weights for policy 1, policy_version 1039569 (0.0007) [2023-12-28 02:42:37,388][106226] Updated weights for policy 0, policy_version 1037002 (0.0011) [2023-12-28 02:42:37,438][106226] Updated weights for policy 0, policy_version 1037012 (0.0010) [2023-12-28 02:42:37,489][106226] Updated weights for policy 0, policy_version 1037022 (0.0010) [2023-12-28 02:42:37,947][106225] Updated weights for policy 1, policy_version 1039579 (0.0008) [2023-12-28 02:42:37,999][106225] Updated weights for policy 1, policy_version 1039589 (0.0008) [2023-12-28 02:42:38,061][106225] Updated weights for policy 1, policy_version 1039599 (0.0008) [2023-12-28 02:42:38,206][106226] Updated weights for policy 0, policy_version 1037032 (0.0009) [2023-12-28 02:42:38,273][106226] Updated weights for policy 0, policy_version 1037042 (0.0010) [2023-12-28 02:42:38,335][106226] Updated weights for policy 0, policy_version 1037052 (0.0011) [2023-12-28 02:42:38,829][106225] Updated weights for policy 1, policy_version 1039609 (0.0008) [2023-12-28 02:42:38,880][106225] Updated weights for policy 1, policy_version 1039619 (0.0008) [2023-12-28 02:42:38,935][106225] Updated weights for policy 1, policy_version 1039629 (0.0008) [2023-12-28 02:42:38,987][106225] Updated weights for policy 1, policy_version 1039639 (0.0007) [2023-12-28 02:42:39,065][106226] Updated weights for policy 0, policy_version 1037062 (0.0007) [2023-12-28 02:42:39,121][106226] Updated weights for policy 0, policy_version 1037072 (0.0008) [2023-12-28 02:42:39,181][106226] Updated weights for policy 0, policy_version 1037082 (0.0006) [2023-12-28 02:42:39,752][106225] Updated weights for policy 1, policy_version 1039649 (0.0010) [2023-12-28 02:42:39,817][106225] Updated weights for policy 1, policy_version 1039659 (0.0011) [2023-12-28 02:42:39,887][106225] Updated weights for policy 1, policy_version 1039669 (0.0010) [2023-12-28 02:42:39,933][106226] Updated weights for policy 0, policy_version 1037092 (0.0008) [2023-12-28 02:42:40,010][106226] Updated weights for policy 0, policy_version 1037102 (0.0011) [2023-12-28 02:42:40,069][106226] Updated weights for policy 0, policy_version 1037112 (0.0011) [2023-12-28 02:42:40,582][106225] Updated weights for policy 1, policy_version 1039679 (0.0007) [2023-12-28 02:42:40,632][106225] Updated weights for policy 1, policy_version 1039689 (0.0005) [2023-12-28 02:42:40,684][106225] Updated weights for policy 1, policy_version 1039699 (0.0005) [2023-12-28 02:42:40,817][106226] Updated weights for policy 0, policy_version 1037122 (0.0011) [2023-12-28 02:42:40,875][106226] Updated weights for policy 0, policy_version 1037132 (0.0011) [2023-12-28 02:42:40,922][106226] Updated weights for policy 0, policy_version 1037142 (0.0010) [2023-12-28 02:42:40,981][106226] Updated weights for policy 0, policy_version 1037152 (0.0010) [2023-12-28 02:42:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 531775488. Throughput: 0: 10235.5, 1: 9941.9. Samples: 531745928. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:41,176][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.079')] [2023-12-28 02:42:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001039704_266207232.pth... [2023-12-28 02:42:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001037152_265568256.pth... [2023-12-28 02:42:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001038552_265912320.pth [2023-12-28 02:42:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001035968_265265152.pth [2023-12-28 02:42:41,382][106225] Updated weights for policy 1, policy_version 1039709 (0.0007) [2023-12-28 02:42:41,447][106225] Updated weights for policy 1, policy_version 1039719 (0.0010) [2023-12-28 02:42:41,500][106225] Updated weights for policy 1, policy_version 1039729 (0.0009) [2023-12-28 02:42:41,767][106226] Updated weights for policy 0, policy_version 1037162 (0.0009) [2023-12-28 02:42:41,831][106226] Updated weights for policy 0, policy_version 1037172 (0.0008) [2023-12-28 02:42:41,899][106226] Updated weights for policy 0, policy_version 1037182 (0.0007) [2023-12-28 02:42:42,273][106225] Updated weights for policy 1, policy_version 1039739 (0.0009) [2023-12-28 02:42:42,327][106225] Updated weights for policy 1, policy_version 1039749 (0.0009) [2023-12-28 02:42:42,393][106225] Updated weights for policy 1, policy_version 1039759 (0.0008) [2023-12-28 02:42:42,587][106226] Updated weights for policy 0, policy_version 1037192 (0.0006) [2023-12-28 02:42:42,652][106226] Updated weights for policy 0, policy_version 1037202 (0.0006) [2023-12-28 02:42:42,721][106226] Updated weights for policy 0, policy_version 1037212 (0.0010) [2023-12-28 02:42:43,085][106225] Updated weights for policy 1, policy_version 1039769 (0.0009) [2023-12-28 02:42:43,143][106225] Updated weights for policy 1, policy_version 1039779 (0.0009) [2023-12-28 02:42:43,203][106225] Updated weights for policy 1, policy_version 1039789 (0.0009) [2023-12-28 02:42:43,272][106225] Updated weights for policy 1, policy_version 1039799 (0.0009) [2023-12-28 02:42:43,443][106226] Updated weights for policy 0, policy_version 1037222 (0.0008) [2023-12-28 02:42:43,504][106226] Updated weights for policy 0, policy_version 1037232 (0.0009) [2023-12-28 02:42:43,559][106226] Updated weights for policy 0, policy_version 1037242 (0.0008) [2023-12-28 02:42:44,000][106225] Updated weights for policy 1, policy_version 1039809 (0.0009) [2023-12-28 02:42:44,062][106225] Updated weights for policy 1, policy_version 1039819 (0.0008) [2023-12-28 02:42:44,126][106225] Updated weights for policy 1, policy_version 1039829 (0.0008) [2023-12-28 02:42:44,278][106226] Updated weights for policy 0, policy_version 1037252 (0.0008) [2023-12-28 02:42:44,337][106226] Updated weights for policy 0, policy_version 1037262 (0.0007) [2023-12-28 02:42:44,395][106226] Updated weights for policy 0, policy_version 1037272 (0.0007) [2023-12-28 02:42:44,884][106225] Updated weights for policy 1, policy_version 1039839 (0.0008) [2023-12-28 02:42:44,944][106225] Updated weights for policy 1, policy_version 1039849 (0.0008) [2023-12-28 02:42:45,001][106225] Updated weights for policy 1, policy_version 1039859 (0.0008) [2023-12-28 02:42:45,095][106226] Updated weights for policy 0, policy_version 1037282 (0.0009) [2023-12-28 02:42:45,161][106226] Updated weights for policy 0, policy_version 1037292 (0.0008) [2023-12-28 02:42:45,221][106226] Updated weights for policy 0, policy_version 1037302 (0.0008) [2023-12-28 02:42:45,282][106226] Updated weights for policy 0, policy_version 1037312 (0.0009) [2023-12-28 02:42:45,739][106225] Updated weights for policy 1, policy_version 1039869 (0.0009) [2023-12-28 02:42:45,789][106225] Updated weights for policy 1, policy_version 1039879 (0.0009) [2023-12-28 02:42:45,844][106225] Updated weights for policy 1, policy_version 1039889 (0.0008) [2023-12-28 02:42:45,898][106226] Updated weights for policy 0, policy_version 1037322 (0.0008) [2023-12-28 02:42:45,958][106226] Updated weights for policy 0, policy_version 1037332 (0.0009) [2023-12-28 02:42:46,024][106226] Updated weights for policy 0, policy_version 1037342 (0.0008) [2023-12-28 02:42:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20206.8, 300 sec: 19882.9). Total num frames: 531873792. Throughput: 0: 10110.1, 1: 9858.2. Samples: 531859888. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:46,176][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.998')] [2023-12-28 02:42:46,592][106225] Updated weights for policy 1, policy_version 1039899 (0.0008) [2023-12-28 02:42:46,640][106225] Updated weights for policy 1, policy_version 1039909 (0.0007) [2023-12-28 02:42:46,697][106225] Updated weights for policy 1, policy_version 1039919 (0.0008) [2023-12-28 02:42:46,711][106226] Updated weights for policy 0, policy_version 1037352 (0.0006) [2023-12-28 02:42:46,754][106226] Updated weights for policy 0, policy_version 1037362 (0.0006) [2023-12-28 02:42:46,799][106226] Updated weights for policy 0, policy_version 1037372 (0.0008) [2023-12-28 02:42:47,421][106225] Updated weights for policy 1, policy_version 1039929 (0.0007) [2023-12-28 02:42:47,478][106225] Updated weights for policy 1, policy_version 1039939 (0.0008) [2023-12-28 02:42:47,536][106225] Updated weights for policy 1, policy_version 1039949 (0.0008) [2023-12-28 02:42:47,546][106226] Updated weights for policy 0, policy_version 1037382 (0.0007) [2023-12-28 02:42:47,594][106226] Updated weights for policy 0, policy_version 1037392 (0.0006) [2023-12-28 02:42:47,597][106225] Updated weights for policy 1, policy_version 1039959 (0.0007) [2023-12-28 02:42:47,652][106226] Updated weights for policy 0, policy_version 1037402 (0.0009) [2023-12-28 02:42:48,292][106225] Updated weights for policy 1, policy_version 1039969 (0.0005) [2023-12-28 02:42:48,355][106225] Updated weights for policy 1, policy_version 1039979 (0.0007) [2023-12-28 02:42:48,415][106225] Updated weights for policy 1, policy_version 1039989 (0.0009) [2023-12-28 02:42:48,442][106226] Updated weights for policy 0, policy_version 1037412 (0.0007) [2023-12-28 02:42:48,508][106226] Updated weights for policy 0, policy_version 1037422 (0.0006) [2023-12-28 02:42:48,571][106226] Updated weights for policy 0, policy_version 1037432 (0.0008) [2023-12-28 02:42:49,067][106225] Updated weights for policy 1, policy_version 1039999 (0.0008) [2023-12-28 02:42:49,115][106225] Updated weights for policy 1, policy_version 1040009 (0.0006) [2023-12-28 02:42:49,168][106225] Updated weights for policy 1, policy_version 1040019 (0.0005) [2023-12-28 02:42:49,364][106226] Updated weights for policy 0, policy_version 1037442 (0.0009) [2023-12-28 02:42:49,432][106226] Updated weights for policy 0, policy_version 1037452 (0.0006) [2023-12-28 02:42:49,494][106226] Updated weights for policy 0, policy_version 1037462 (0.0005) [2023-12-28 02:42:49,557][106226] Updated weights for policy 0, policy_version 1037472 (0.0007) [2023-12-28 02:42:49,934][106225] Updated weights for policy 1, policy_version 1040029 (0.0006) [2023-12-28 02:42:49,999][106225] Updated weights for policy 1, policy_version 1040039 (0.0006) [2023-12-28 02:42:50,055][106225] Updated weights for policy 1, policy_version 1040049 (0.0007) [2023-12-28 02:42:50,200][106226] Updated weights for policy 0, policy_version 1037482 (0.0008) [2023-12-28 02:42:50,262][106226] Updated weights for policy 0, policy_version 1037492 (0.0011) [2023-12-28 02:42:50,321][106226] Updated weights for policy 0, policy_version 1037502 (0.0011) [2023-12-28 02:42:50,731][106225] Updated weights for policy 1, policy_version 1040059 (0.0008) [2023-12-28 02:42:50,790][106225] Updated weights for policy 1, policy_version 1040069 (0.0008) [2023-12-28 02:42:50,847][106225] Updated weights for policy 1, policy_version 1040079 (0.0009) [2023-12-28 02:42:51,053][106226] Updated weights for policy 0, policy_version 1037512 (0.0010) [2023-12-28 02:42:51,119][106226] Updated weights for policy 0, policy_version 1037522 (0.0011) [2023-12-28 02:42:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 531963904. Throughput: 0: 10000.8, 1: 9791.4. Samples: 531977268. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:51,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-5.147')] [2023-12-28 02:42:51,189][106226] Updated weights for policy 0, policy_version 1037532 (0.0010) [2023-12-28 02:42:51,617][106225] Updated weights for policy 1, policy_version 1040089 (0.0008) [2023-12-28 02:42:51,691][106225] Updated weights for policy 1, policy_version 1040099 (0.0008) [2023-12-28 02:42:51,764][106225] Updated weights for policy 1, policy_version 1040109 (0.0009) [2023-12-28 02:42:51,826][106225] Updated weights for policy 1, policy_version 1040119 (0.0009) [2023-12-28 02:42:51,906][106226] Updated weights for policy 0, policy_version 1037542 (0.0009) [2023-12-28 02:42:51,969][106226] Updated weights for policy 0, policy_version 1037552 (0.0009) [2023-12-28 02:42:52,040][106226] Updated weights for policy 0, policy_version 1037562 (0.0008) [2023-12-28 02:42:52,457][106225] Updated weights for policy 1, policy_version 1040129 (0.0006) [2023-12-28 02:42:52,504][106225] Updated weights for policy 1, policy_version 1040139 (0.0006) [2023-12-28 02:42:52,557][106225] Updated weights for policy 1, policy_version 1040149 (0.0007) [2023-12-28 02:42:52,816][106226] Updated weights for policy 0, policy_version 1037572 (0.0009) [2023-12-28 02:42:52,875][106226] Updated weights for policy 0, policy_version 1037582 (0.0009) [2023-12-28 02:42:52,934][106226] Updated weights for policy 0, policy_version 1037592 (0.0009) [2023-12-28 02:42:53,188][106225] Updated weights for policy 1, policy_version 1040159 (0.0006) [2023-12-28 02:42:53,237][106225] Updated weights for policy 1, policy_version 1040169 (0.0006) [2023-12-28 02:42:53,286][106225] Updated weights for policy 1, policy_version 1040179 (0.0008) [2023-12-28 02:42:53,523][106226] Updated weights for policy 0, policy_version 1037602 (0.0008) [2023-12-28 02:42:53,576][106226] Updated weights for policy 0, policy_version 1037612 (0.0005) [2023-12-28 02:42:53,639][106226] Updated weights for policy 0, policy_version 1037622 (0.0006) [2023-12-28 02:42:53,693][106226] Updated weights for policy 0, policy_version 1037632 (0.0005) [2023-12-28 02:42:54,027][106225] Updated weights for policy 1, policy_version 1040189 (0.0009) [2023-12-28 02:42:54,083][106225] Updated weights for policy 1, policy_version 1040199 (0.0008) [2023-12-28 02:42:54,152][106225] Updated weights for policy 1, policy_version 1040209 (0.0009) [2023-12-28 02:42:54,287][106226] Updated weights for policy 0, policy_version 1037642 (0.0005) [2023-12-28 02:42:54,351][106226] Updated weights for policy 0, policy_version 1037652 (0.0006) [2023-12-28 02:42:54,411][106226] Updated weights for policy 0, policy_version 1037662 (0.0009) [2023-12-28 02:42:54,816][106225] Updated weights for policy 1, policy_version 1040219 (0.0010) [2023-12-28 02:42:54,866][106225] Updated weights for policy 1, policy_version 1040229 (0.0010) [2023-12-28 02:42:54,923][106225] Updated weights for policy 1, policy_version 1040239 (0.0010) [2023-12-28 02:42:54,939][106226] Updated weights for policy 0, policy_version 1037672 (0.0005) [2023-12-28 02:42:54,990][106226] Updated weights for policy 0, policy_version 1037682 (0.0011) [2023-12-28 02:42:55,039][106226] Updated weights for policy 0, policy_version 1037692 (0.0011) [2023-12-28 02:42:55,616][106225] Updated weights for policy 1, policy_version 1040249 (0.0010) [2023-12-28 02:42:55,679][106225] Updated weights for policy 1, policy_version 1040259 (0.0007) [2023-12-28 02:42:55,736][106225] Updated weights for policy 1, policy_version 1040269 (0.0005) [2023-12-28 02:42:55,744][106226] Updated weights for policy 0, policy_version 1037702 (0.0007) [2023-12-28 02:42:55,791][106225] Updated weights for policy 1, policy_version 1040279 (0.0007) [2023-12-28 02:42:55,803][106226] Updated weights for policy 0, policy_version 1037712 (0.0005) [2023-12-28 02:42:55,856][106226] Updated weights for policy 0, policy_version 1037722 (0.0005) [2023-12-28 02:42:56,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 532070400. Throughput: 0: 9988.8, 1: 9771.1. Samples: 532037120. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-28 02:42:56,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.076')] [2023-12-28 02:42:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001040280_266354688.pth... [2023-12-28 02:42:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001037728_265715712.pth... [2023-12-28 02:42:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001039128_266059776.pth [2023-12-28 02:42:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001036544_265412608.pth [2023-12-28 02:42:56,443][106226] Updated weights for policy 0, policy_version 1037732 (0.0007) [2023-12-28 02:42:56,464][106225] Updated weights for policy 1, policy_version 1040289 (0.0007) [2023-12-28 02:42:56,490][106226] Updated weights for policy 0, policy_version 1037742 (0.0010) [2023-12-28 02:42:56,522][106225] Updated weights for policy 1, policy_version 1040299 (0.0007) [2023-12-28 02:42:56,540][106226] Updated weights for policy 0, policy_version 1037752 (0.0006) [2023-12-28 02:42:56,567][106225] Updated weights for policy 1, policy_version 1040309 (0.0005) [2023-12-28 02:42:57,108][106225] Updated weights for policy 1, policy_version 1040319 (0.0006) [2023-12-28 02:42:57,154][106225] Updated weights for policy 1, policy_version 1040329 (0.0008) [2023-12-28 02:42:57,180][106226] Updated weights for policy 0, policy_version 1037762 (0.0008) [2023-12-28 02:42:57,214][106225] Updated weights for policy 1, policy_version 1040339 (0.0007) [2023-12-28 02:42:57,231][106226] Updated weights for policy 0, policy_version 1037772 (0.0006) [2023-12-28 02:42:57,287][106226] Updated weights for policy 0, policy_version 1037782 (0.0005) [2023-12-28 02:42:57,340][106226] Updated weights for policy 0, policy_version 1037792 (0.0010) [2023-12-28 02:42:57,904][106225] Updated weights for policy 1, policy_version 1040349 (0.0008) [2023-12-28 02:42:57,967][106225] Updated weights for policy 1, policy_version 1040359 (0.0008) [2023-12-28 02:42:58,005][106226] Updated weights for policy 0, policy_version 1037802 (0.0006) [2023-12-28 02:42:58,020][106225] Updated weights for policy 1, policy_version 1040369 (0.0007) [2023-12-28 02:42:58,066][106226] Updated weights for policy 0, policy_version 1037812 (0.0006) [2023-12-28 02:42:58,138][106226] Updated weights for policy 0, policy_version 1037822 (0.0007) [2023-12-28 02:42:58,769][106225] Updated weights for policy 1, policy_version 1040379 (0.0007) [2023-12-28 02:42:58,836][106226] Updated weights for policy 0, policy_version 1037832 (0.0008) [2023-12-28 02:42:58,837][106225] Updated weights for policy 1, policy_version 1040389 (0.0007) [2023-12-28 02:42:58,914][106226] Updated weights for policy 0, policy_version 1037842 (0.0010) [2023-12-28 02:42:58,914][106225] Updated weights for policy 1, policy_version 1040399 (0.0007) [2023-12-28 02:42:58,985][106226] Updated weights for policy 0, policy_version 1037852 (0.0010) [2023-12-28 02:42:59,740][106225] Updated weights for policy 1, policy_version 1040409 (0.0007) [2023-12-28 02:42:59,766][106226] Updated weights for policy 0, policy_version 1037862 (0.0008) [2023-12-28 02:42:59,803][106225] Updated weights for policy 1, policy_version 1040419 (0.0006) [2023-12-28 02:42:59,829][106226] Updated weights for policy 0, policy_version 1037872 (0.0007) [2023-12-28 02:42:59,868][106225] Updated weights for policy 1, policy_version 1040429 (0.0008) [2023-12-28 02:42:59,886][106226] Updated weights for policy 0, policy_version 1037882 (0.0007) [2023-12-28 02:42:59,921][106225] Updated weights for policy 1, policy_version 1040439 (0.0009) [2023-12-28 02:43:00,552][106226] Updated weights for policy 0, policy_version 1037892 (0.0007) [2023-12-28 02:43:00,607][106226] Updated weights for policy 0, policy_version 1037902 (0.0005) [2023-12-28 02:43:00,661][106226] Updated weights for policy 0, policy_version 1037912 (0.0005) [2023-12-28 02:43:00,681][106225] Updated weights for policy 1, policy_version 1040449 (0.0009) [2023-12-28 02:43:00,732][106225] Updated weights for policy 1, policy_version 1040459 (0.0008) [2023-12-28 02:43:00,786][106225] Updated weights for policy 1, policy_version 1040469 (0.0007) [2023-12-28 02:43:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 532168704. Throughput: 0: 10029.1, 1: 9840.7. Samples: 532158856. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:01,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.099')] [2023-12-28 02:43:01,272][106226] Updated weights for policy 0, policy_version 1037922 (0.0006) [2023-12-28 02:43:01,337][106226] Updated weights for policy 0, policy_version 1037932 (0.0011) [2023-12-28 02:43:01,403][106226] Updated weights for policy 0, policy_version 1037942 (0.0009) [2023-12-28 02:43:01,475][106226] Updated weights for policy 0, policy_version 1037952 (0.0011) [2023-12-28 02:43:01,544][106225] Updated weights for policy 1, policy_version 1040479 (0.0007) [2023-12-28 02:43:01,600][106225] Updated weights for policy 1, policy_version 1040489 (0.0007) [2023-12-28 02:43:01,665][106225] Updated weights for policy 1, policy_version 1040499 (0.0008) [2023-12-28 02:43:02,201][106226] Updated weights for policy 0, policy_version 1037962 (0.0005) [2023-12-28 02:43:02,266][106226] Updated weights for policy 0, policy_version 1037972 (0.0006) [2023-12-28 02:43:02,336][106226] Updated weights for policy 0, policy_version 1037982 (0.0006) [2023-12-28 02:43:02,374][106225] Updated weights for policy 1, policy_version 1040509 (0.0008) [2023-12-28 02:43:02,434][106225] Updated weights for policy 1, policy_version 1040519 (0.0007) [2023-12-28 02:43:02,481][106225] Updated weights for policy 1, policy_version 1040529 (0.0010) [2023-12-28 02:43:02,980][106226] Updated weights for policy 0, policy_version 1037992 (0.0010) [2023-12-28 02:43:03,043][106226] Updated weights for policy 0, policy_version 1038002 (0.0010) [2023-12-28 02:43:03,089][106226] Updated weights for policy 0, policy_version 1038012 (0.0010) [2023-12-28 02:43:03,139][106225] Updated weights for policy 1, policy_version 1040539 (0.0009) [2023-12-28 02:43:03,198][106225] Updated weights for policy 1, policy_version 1040549 (0.0005) [2023-12-28 02:43:03,255][106225] Updated weights for policy 1, policy_version 1040559 (0.0005) [2023-12-28 02:43:03,796][106226] Updated weights for policy 0, policy_version 1038022 (0.0011) [2023-12-28 02:43:03,848][106226] Updated weights for policy 0, policy_version 1038032 (0.0010) [2023-12-28 02:43:03,887][106225] Updated weights for policy 1, policy_version 1040569 (0.0005) [2023-12-28 02:43:03,912][106226] Updated weights for policy 0, policy_version 1038042 (0.0011) [2023-12-28 02:43:03,947][106225] Updated weights for policy 1, policy_version 1040579 (0.0009) [2023-12-28 02:43:04,005][106225] Updated weights for policy 1, policy_version 1040589 (0.0010) [2023-12-28 02:43:04,065][106225] Updated weights for policy 1, policy_version 1040599 (0.0010) [2023-12-28 02:43:04,656][106226] Updated weights for policy 0, policy_version 1038052 (0.0010) [2023-12-28 02:43:04,723][106226] Updated weights for policy 0, policy_version 1038062 (0.0009) [2023-12-28 02:43:04,777][106225] Updated weights for policy 1, policy_version 1040609 (0.0008) [2023-12-28 02:43:04,788][106226] Updated weights for policy 0, policy_version 1038072 (0.0007) [2023-12-28 02:43:04,836][106225] Updated weights for policy 1, policy_version 1040619 (0.0008) [2023-12-28 02:43:04,898][106225] Updated weights for policy 1, policy_version 1040629 (0.0008) [2023-12-28 02:43:05,413][106226] Updated weights for policy 0, policy_version 1038082 (0.0007) [2023-12-28 02:43:05,461][106226] Updated weights for policy 0, policy_version 1038092 (0.0005) [2023-12-28 02:43:05,507][106226] Updated weights for policy 0, policy_version 1038102 (0.0005) [2023-12-28 02:43:05,557][106226] Updated weights for policy 0, policy_version 1038112 (0.0005) [2023-12-28 02:43:05,616][106225] Updated weights for policy 1, policy_version 1040639 (0.0009) [2023-12-28 02:43:05,660][106225] Updated weights for policy 1, policy_version 1040649 (0.0006) [2023-12-28 02:43:05,708][106225] Updated weights for policy 1, policy_version 1040659 (0.0005) [2023-12-28 02:43:06,131][106226] Updated weights for policy 0, policy_version 1038122 (0.0007) [2023-12-28 02:43:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 532267008. Throughput: 0: 10131.8, 1: 9862.9. Samples: 532281268. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:06,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.702')] [2023-12-28 02:43:06,185][106226] Updated weights for policy 0, policy_version 1038132 (0.0008) [2023-12-28 02:43:06,248][106226] Updated weights for policy 0, policy_version 1038142 (0.0008) [2023-12-28 02:43:06,465][106225] Updated weights for policy 1, policy_version 1040669 (0.0007) [2023-12-28 02:43:06,527][106225] Updated weights for policy 1, policy_version 1040679 (0.0008) [2023-12-28 02:43:06,591][106225] Updated weights for policy 1, policy_version 1040689 (0.0007) [2023-12-28 02:43:06,942][106226] Updated weights for policy 0, policy_version 1038152 (0.0009) [2023-12-28 02:43:06,993][106226] Updated weights for policy 0, policy_version 1038162 (0.0009) [2023-12-28 02:43:07,041][106226] Updated weights for policy 0, policy_version 1038172 (0.0008) [2023-12-28 02:43:07,319][106225] Updated weights for policy 1, policy_version 1040699 (0.0009) [2023-12-28 02:43:07,390][106225] Updated weights for policy 1, policy_version 1040709 (0.0009) [2023-12-28 02:43:07,458][106225] Updated weights for policy 1, policy_version 1040719 (0.0007) [2023-12-28 02:43:07,706][106226] Updated weights for policy 0, policy_version 1038182 (0.0008) [2023-12-28 02:43:07,763][106226] Updated weights for policy 0, policy_version 1038192 (0.0008) [2023-12-28 02:43:07,830][106226] Updated weights for policy 0, policy_version 1038202 (0.0008) [2023-12-28 02:43:08,165][106225] Updated weights for policy 1, policy_version 1040729 (0.0008) [2023-12-28 02:43:08,218][106225] Updated weights for policy 1, policy_version 1040739 (0.0007) [2023-12-28 02:43:08,282][106225] Updated weights for policy 1, policy_version 1040749 (0.0005) [2023-12-28 02:43:08,348][106225] Updated weights for policy 1, policy_version 1040759 (0.0007) [2023-12-28 02:43:08,495][106226] Updated weights for policy 0, policy_version 1038212 (0.0007) [2023-12-28 02:43:08,561][106226] Updated weights for policy 0, policy_version 1038222 (0.0006) [2023-12-28 02:43:08,628][106226] Updated weights for policy 0, policy_version 1038232 (0.0005) [2023-12-28 02:43:09,005][106225] Updated weights for policy 1, policy_version 1040769 (0.0010) [2023-12-28 02:43:09,064][106225] Updated weights for policy 1, policy_version 1040779 (0.0010) [2023-12-28 02:43:09,124][106225] Updated weights for policy 1, policy_version 1040789 (0.0010) [2023-12-28 02:43:09,279][106226] Updated weights for policy 0, policy_version 1038242 (0.0005) [2023-12-28 02:43:09,336][106226] Updated weights for policy 0, policy_version 1038252 (0.0008) [2023-12-28 02:43:09,405][106226] Updated weights for policy 0, policy_version 1038262 (0.0009) [2023-12-28 02:43:09,468][106226] Updated weights for policy 0, policy_version 1038272 (0.0007) [2023-12-28 02:43:09,892][106225] Updated weights for policy 1, policy_version 1040799 (0.0010) [2023-12-28 02:43:09,964][106225] Updated weights for policy 1, policy_version 1040809 (0.0007) [2023-12-28 02:43:10,029][106225] Updated weights for policy 1, policy_version 1040819 (0.0008) [2023-12-28 02:43:10,147][106226] Updated weights for policy 0, policy_version 1038282 (0.0008) [2023-12-28 02:43:10,211][106226] Updated weights for policy 0, policy_version 1038292 (0.0008) [2023-12-28 02:43:10,279][106226] Updated weights for policy 0, policy_version 1038302 (0.0008) [2023-12-28 02:43:10,652][106225] Updated weights for policy 1, policy_version 1040829 (0.0007) [2023-12-28 02:43:10,703][106225] Updated weights for policy 1, policy_version 1040839 (0.0005) [2023-12-28 02:43:10,766][106225] Updated weights for policy 1, policy_version 1040849 (0.0005) [2023-12-28 02:43:11,098][106226] Updated weights for policy 0, policy_version 1038312 (0.0009) [2023-12-28 02:43:11,170][106226] Updated weights for policy 0, policy_version 1038322 (0.0009) [2023-12-28 02:43:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 532365312. Throughput: 0: 10168.6, 1: 9881.5. Samples: 532340948. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:11,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-5.060')] [2023-12-28 02:43:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001040856_266502144.pth... [2023-12-28 02:43:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001039704_266207232.pth [2023-12-28 02:43:11,237][106226] Updated weights for policy 0, policy_version 1038332 (0.0009) [2023-12-28 02:43:11,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001038336_265871360.pth... [2023-12-28 02:43:11,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001037152_265568256.pth [2023-12-28 02:43:11,475][106225] Updated weights for policy 1, policy_version 1040859 (0.0006) [2023-12-28 02:43:11,541][106225] Updated weights for policy 1, policy_version 1040869 (0.0009) [2023-12-28 02:43:11,603][106225] Updated weights for policy 1, policy_version 1040879 (0.0008) [2023-12-28 02:43:12,026][106226] Updated weights for policy 0, policy_version 1038342 (0.0010) [2023-12-28 02:43:12,087][106226] Updated weights for policy 0, policy_version 1038352 (0.0009) [2023-12-28 02:43:12,147][106226] Updated weights for policy 0, policy_version 1038362 (0.0009) [2023-12-28 02:43:12,306][106225] Updated weights for policy 1, policy_version 1040889 (0.0009) [2023-12-28 02:43:12,374][106225] Updated weights for policy 1, policy_version 1040899 (0.0008) [2023-12-28 02:43:12,428][106225] Updated weights for policy 1, policy_version 1040909 (0.0009) [2023-12-28 02:43:12,482][106225] Updated weights for policy 1, policy_version 1040919 (0.0008) [2023-12-28 02:43:12,881][106226] Updated weights for policy 0, policy_version 1038372 (0.0009) [2023-12-28 02:43:12,938][106226] Updated weights for policy 0, policy_version 1038382 (0.0010) [2023-12-28 02:43:12,992][106226] Updated weights for policy 0, policy_version 1038392 (0.0010) [2023-12-28 02:43:13,233][106225] Updated weights for policy 1, policy_version 1040929 (0.0008) [2023-12-28 02:43:13,280][106225] Updated weights for policy 1, policy_version 1040939 (0.0009) [2023-12-28 02:43:13,335][106225] Updated weights for policy 1, policy_version 1040949 (0.0007) [2023-12-28 02:43:13,582][106226] Updated weights for policy 0, policy_version 1038402 (0.0009) [2023-12-28 02:43:13,647][106226] Updated weights for policy 0, policy_version 1038412 (0.0005) [2023-12-28 02:43:13,704][106226] Updated weights for policy 0, policy_version 1038422 (0.0007) [2023-12-28 02:43:13,761][106226] Updated weights for policy 0, policy_version 1038432 (0.0010) [2023-12-28 02:43:14,153][106225] Updated weights for policy 1, policy_version 1040959 (0.0008) [2023-12-28 02:43:14,215][106225] Updated weights for policy 1, policy_version 1040969 (0.0007) [2023-12-28 02:43:14,278][106225] Updated weights for policy 1, policy_version 1040979 (0.0006) [2023-12-28 02:43:14,384][106226] Updated weights for policy 0, policy_version 1038442 (0.0011) [2023-12-28 02:43:14,442][106226] Updated weights for policy 0, policy_version 1038452 (0.0010) [2023-12-28 02:43:14,504][106226] Updated weights for policy 0, policy_version 1038462 (0.0008) [2023-12-28 02:43:14,869][106225] Updated weights for policy 1, policy_version 1040989 (0.0007) [2023-12-28 02:43:14,934][106225] Updated weights for policy 1, policy_version 1040999 (0.0007) [2023-12-28 02:43:14,997][106225] Updated weights for policy 1, policy_version 1041009 (0.0006) [2023-12-28 02:43:15,211][106226] Updated weights for policy 0, policy_version 1038472 (0.0009) [2023-12-28 02:43:15,281][106226] Updated weights for policy 0, policy_version 1038482 (0.0009) [2023-12-28 02:43:15,349][106226] Updated weights for policy 0, policy_version 1038492 (0.0008) [2023-12-28 02:43:15,610][106225] Updated weights for policy 1, policy_version 1041019 (0.0007) [2023-12-28 02:43:15,661][106225] Updated weights for policy 1, policy_version 1041029 (0.0005) [2023-12-28 02:43:15,708][106225] Updated weights for policy 1, policy_version 1041039 (0.0005) [2023-12-28 02:43:16,100][106226] Updated weights for policy 0, policy_version 1038502 (0.0007) [2023-12-28 02:43:16,156][106226] Updated weights for policy 0, policy_version 1038512 (0.0005) [2023-12-28 02:43:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 532463616. Throughput: 0: 10018.3, 1: 9785.7. Samples: 532458100. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:16,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-5.077')] [2023-12-28 02:43:16,209][106226] Updated weights for policy 0, policy_version 1038522 (0.0005) [2023-12-28 02:43:16,305][106225] Updated weights for policy 1, policy_version 1041049 (0.0005) [2023-12-28 02:43:16,361][106225] Updated weights for policy 1, policy_version 1041059 (0.0008) [2023-12-28 02:43:16,421][106225] Updated weights for policy 1, policy_version 1041069 (0.0008) [2023-12-28 02:43:16,473][106225] Updated weights for policy 1, policy_version 1041079 (0.0008) [2023-12-28 02:43:16,768][106226] Updated weights for policy 0, policy_version 1038532 (0.0006) [2023-12-28 02:43:16,813][106226] Updated weights for policy 0, policy_version 1038542 (0.0005) [2023-12-28 02:43:16,867][106226] Updated weights for policy 0, policy_version 1038552 (0.0005) [2023-12-28 02:43:17,157][106225] Updated weights for policy 1, policy_version 1041089 (0.0008) [2023-12-28 02:43:17,209][106225] Updated weights for policy 1, policy_version 1041099 (0.0008) [2023-12-28 02:43:17,261][106225] Updated weights for policy 1, policy_version 1041109 (0.0005) [2023-12-28 02:43:17,534][106226] Updated weights for policy 0, policy_version 1038562 (0.0007) [2023-12-28 02:43:17,584][106226] Updated weights for policy 0, policy_version 1038572 (0.0009) [2023-12-28 02:43:17,643][106226] Updated weights for policy 0, policy_version 1038582 (0.0008) [2023-12-28 02:43:17,701][106226] Updated weights for policy 0, policy_version 1038592 (0.0005) [2023-12-28 02:43:18,012][106225] Updated weights for policy 1, policy_version 1041119 (0.0005) [2023-12-28 02:43:18,073][106225] Updated weights for policy 1, policy_version 1041129 (0.0008) [2023-12-28 02:43:18,121][106225] Updated weights for policy 1, policy_version 1041139 (0.0008) [2023-12-28 02:43:18,305][106226] Updated weights for policy 0, policy_version 1038602 (0.0009) [2023-12-28 02:43:18,371][106226] Updated weights for policy 0, policy_version 1038612 (0.0009) [2023-12-28 02:43:18,427][106226] Updated weights for policy 0, policy_version 1038622 (0.0009) [2023-12-28 02:43:18,792][106225] Updated weights for policy 1, policy_version 1041149 (0.0007) [2023-12-28 02:43:18,848][106225] Updated weights for policy 1, policy_version 1041159 (0.0005) [2023-12-28 02:43:18,906][106225] Updated weights for policy 1, policy_version 1041169 (0.0005) [2023-12-28 02:43:19,216][106226] Updated weights for policy 0, policy_version 1038632 (0.0009) [2023-12-28 02:43:19,284][106226] Updated weights for policy 0, policy_version 1038642 (0.0009) [2023-12-28 02:43:19,355][106226] Updated weights for policy 0, policy_version 1038652 (0.0009) [2023-12-28 02:43:19,566][106225] Updated weights for policy 1, policy_version 1041179 (0.0005) [2023-12-28 02:43:19,635][106225] Updated weights for policy 1, policy_version 1041189 (0.0006) [2023-12-28 02:43:19,698][106225] Updated weights for policy 1, policy_version 1041199 (0.0008) [2023-12-28 02:43:20,063][106226] Updated weights for policy 0, policy_version 1038662 (0.0007) [2023-12-28 02:43:20,112][106226] Updated weights for policy 0, policy_version 1038672 (0.0008) [2023-12-28 02:43:20,174][106226] Updated weights for policy 0, policy_version 1038682 (0.0006) [2023-12-28 02:43:20,458][106225] Updated weights for policy 1, policy_version 1041209 (0.0010) [2023-12-28 02:43:20,522][106225] Updated weights for policy 1, policy_version 1041219 (0.0009) [2023-12-28 02:43:20,588][106225] Updated weights for policy 1, policy_version 1041229 (0.0008) [2023-12-28 02:43:20,645][106225] Updated weights for policy 1, policy_version 1041239 (0.0008) [2023-12-28 02:43:20,861][106226] Updated weights for policy 0, policy_version 1038692 (0.0007) [2023-12-28 02:43:20,921][106226] Updated weights for policy 0, policy_version 1038702 (0.0006) [2023-12-28 02:43:20,984][106226] Updated weights for policy 0, policy_version 1038712 (0.0007) [2023-12-28 02:43:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 532570112. Throughput: 0: 9950.1, 1: 9817.8. Samples: 532577884. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:21,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.801')] [2023-12-28 02:43:21,427][106225] Updated weights for policy 1, policy_version 1041249 (0.0008) [2023-12-28 02:43:21,482][106225] Updated weights for policy 1, policy_version 1041259 (0.0008) [2023-12-28 02:43:21,543][106225] Updated weights for policy 1, policy_version 1041269 (0.0008) [2023-12-28 02:43:21,692][106226] Updated weights for policy 0, policy_version 1038722 (0.0008) [2023-12-28 02:43:21,763][106226] Updated weights for policy 0, policy_version 1038732 (0.0009) [2023-12-28 02:43:21,825][106226] Updated weights for policy 0, policy_version 1038742 (0.0009) [2023-12-28 02:43:21,890][106226] Updated weights for policy 0, policy_version 1038752 (0.0011) [2023-12-28 02:43:22,296][106225] Updated weights for policy 1, policy_version 1041279 (0.0007) [2023-12-28 02:43:22,364][106225] Updated weights for policy 1, policy_version 1041289 (0.0008) [2023-12-28 02:43:22,432][106225] Updated weights for policy 1, policy_version 1041299 (0.0008) [2023-12-28 02:43:22,620][106226] Updated weights for policy 0, policy_version 1038762 (0.0010) [2023-12-28 02:43:22,680][106226] Updated weights for policy 0, policy_version 1038772 (0.0007) [2023-12-28 02:43:22,745][106226] Updated weights for policy 0, policy_version 1038782 (0.0008) [2023-12-28 02:43:23,143][106225] Updated weights for policy 1, policy_version 1041309 (0.0009) [2023-12-28 02:43:23,208][106225] Updated weights for policy 1, policy_version 1041319 (0.0011) [2023-12-28 02:43:23,273][106225] Updated weights for policy 1, policy_version 1041329 (0.0006) [2023-12-28 02:43:23,451][106226] Updated weights for policy 0, policy_version 1038792 (0.0009) [2023-12-28 02:43:23,502][106226] Updated weights for policy 0, policy_version 1038802 (0.0009) [2023-12-28 02:43:23,555][106226] Updated weights for policy 0, policy_version 1038812 (0.0007) [2023-12-28 02:43:23,912][106225] Updated weights for policy 1, policy_version 1041339 (0.0007) [2023-12-28 02:43:23,971][106225] Updated weights for policy 1, policy_version 1041349 (0.0009) [2023-12-28 02:43:24,026][106225] Updated weights for policy 1, policy_version 1041359 (0.0008) [2023-12-28 02:43:24,217][106226] Updated weights for policy 0, policy_version 1038822 (0.0006) [2023-12-28 02:43:24,282][106226] Updated weights for policy 0, policy_version 1038832 (0.0008) [2023-12-28 02:43:24,335][106226] Updated weights for policy 0, policy_version 1038842 (0.0009) [2023-12-28 02:43:24,687][106225] Updated weights for policy 1, policy_version 1041369 (0.0009) [2023-12-28 02:43:24,744][106225] Updated weights for policy 1, policy_version 1041379 (0.0005) [2023-12-28 02:43:24,799][106225] Updated weights for policy 1, policy_version 1041389 (0.0005) [2023-12-28 02:43:24,850][106225] Updated weights for policy 1, policy_version 1041399 (0.0005) [2023-12-28 02:43:25,126][106226] Updated weights for policy 0, policy_version 1038852 (0.0008) [2023-12-28 02:43:25,192][106226] Updated weights for policy 0, policy_version 1038862 (0.0009) [2023-12-28 02:43:25,247][106226] Updated weights for policy 0, policy_version 1038872 (0.0008) [2023-12-28 02:43:25,454][106225] Updated weights for policy 1, policy_version 1041409 (0.0008) [2023-12-28 02:43:25,508][106225] Updated weights for policy 1, policy_version 1041419 (0.0008) [2023-12-28 02:43:25,571][106225] Updated weights for policy 1, policy_version 1041429 (0.0009) [2023-12-28 02:43:25,997][106226] Updated weights for policy 0, policy_version 1038882 (0.0008) [2023-12-28 02:43:26,054][106226] Updated weights for policy 0, policy_version 1038892 (0.0006) [2023-12-28 02:43:26,109][106226] Updated weights for policy 0, policy_version 1038902 (0.0009) [2023-12-28 02:43:26,163][106226] Updated weights for policy 0, policy_version 1038912 (0.0009) [2023-12-28 02:43:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 532668416. Throughput: 0: 9949.2, 1: 9819.6. Samples: 532635520. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:26,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-5.136')] [2023-12-28 02:43:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001038912_266018816.pth... [2023-12-28 02:43:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001037728_265715712.pth [2023-12-28 02:43:26,209][106225] Updated weights for policy 1, policy_version 1041439 (0.0008) [2023-12-28 02:43:26,270][106225] Updated weights for policy 1, policy_version 1041449 (0.0006) [2023-12-28 02:43:26,335][106225] Updated weights for policy 1, policy_version 1041459 (0.0005) [2023-12-28 02:43:26,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001041464_266657792.pth... [2023-12-28 02:43:26,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001040280_266354688.pth [2023-12-28 02:43:26,832][106226] Updated weights for policy 0, policy_version 1038922 (0.0006) [2023-12-28 02:43:26,885][106226] Updated weights for policy 0, policy_version 1038932 (0.0008) [2023-12-28 02:43:26,943][106226] Updated weights for policy 0, policy_version 1038942 (0.0010) [2023-12-28 02:43:27,010][106225] Updated weights for policy 1, policy_version 1041469 (0.0007) [2023-12-28 02:43:27,069][106225] Updated weights for policy 1, policy_version 1041479 (0.0008) [2023-12-28 02:43:27,129][106225] Updated weights for policy 1, policy_version 1041489 (0.0007) [2023-12-28 02:43:27,629][106226] Updated weights for policy 0, policy_version 1038952 (0.0010) [2023-12-28 02:43:27,685][106226] Updated weights for policy 0, policy_version 1038962 (0.0005) [2023-12-28 02:43:27,737][106226] Updated weights for policy 0, policy_version 1038972 (0.0008) [2023-12-28 02:43:27,855][106225] Updated weights for policy 1, policy_version 1041499 (0.0007) [2023-12-28 02:43:27,912][106225] Updated weights for policy 1, policy_version 1041509 (0.0005) [2023-12-28 02:43:27,968][106225] Updated weights for policy 1, policy_version 1041519 (0.0007) [2023-12-28 02:43:28,478][106226] Updated weights for policy 0, policy_version 1038982 (0.0008) [2023-12-28 02:43:28,531][106226] Updated weights for policy 0, policy_version 1038992 (0.0007) [2023-12-28 02:43:28,584][106226] Updated weights for policy 0, policy_version 1039002 (0.0007) [2023-12-28 02:43:28,597][106225] Updated weights for policy 1, policy_version 1041529 (0.0006) [2023-12-28 02:43:28,646][106225] Updated weights for policy 1, policy_version 1041539 (0.0008) [2023-12-28 02:43:28,691][106225] Updated weights for policy 1, policy_version 1041549 (0.0007) [2023-12-28 02:43:28,738][106225] Updated weights for policy 1, policy_version 1041559 (0.0008) [2023-12-28 02:43:29,224][106226] Updated weights for policy 0, policy_version 1039012 (0.0009) [2023-12-28 02:43:29,281][106226] Updated weights for policy 0, policy_version 1039022 (0.0008) [2023-12-28 02:43:29,346][106226] Updated weights for policy 0, policy_version 1039032 (0.0008) [2023-12-28 02:43:29,490][106225] Updated weights for policy 1, policy_version 1041569 (0.0008) [2023-12-28 02:43:29,546][106225] Updated weights for policy 1, policy_version 1041579 (0.0007) [2023-12-28 02:43:29,600][106225] Updated weights for policy 1, policy_version 1041589 (0.0009) [2023-12-28 02:43:30,030][106226] Updated weights for policy 0, policy_version 1039042 (0.0010) [2023-12-28 02:43:30,098][106226] Updated weights for policy 0, policy_version 1039052 (0.0006) [2023-12-28 02:43:30,157][106226] Updated weights for policy 0, policy_version 1039062 (0.0009) [2023-12-28 02:43:30,215][106226] Updated weights for policy 0, policy_version 1039072 (0.0008) [2023-12-28 02:43:30,396][106225] Updated weights for policy 1, policy_version 1041599 (0.0009) [2023-12-28 02:43:30,450][106225] Updated weights for policy 1, policy_version 1041609 (0.0009) [2023-12-28 02:43:30,505][106225] Updated weights for policy 1, policy_version 1041620 (0.0009) [2023-12-28 02:43:30,854][106226] Updated weights for policy 0, policy_version 1039082 (0.0009) [2023-12-28 02:43:30,904][106226] Updated weights for policy 0, policy_version 1039092 (0.0006) [2023-12-28 02:43:30,953][106226] Updated weights for policy 0, policy_version 1039102 (0.0005) [2023-12-28 02:43:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 532766720. Throughput: 0: 10008.3, 1: 9903.5. Samples: 532755916. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:31,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-5.099')] [2023-12-28 02:43:31,209][106225] Updated weights for policy 1, policy_version 1041630 (0.0010) [2023-12-28 02:43:31,262][106225] Updated weights for policy 1, policy_version 1041640 (0.0008) [2023-12-28 02:43:31,313][106225] Updated weights for policy 1, policy_version 1041650 (0.0010) [2023-12-28 02:43:31,713][106226] Updated weights for policy 0, policy_version 1039112 (0.0010) [2023-12-28 02:43:31,785][106226] Updated weights for policy 0, policy_version 1039122 (0.0011) [2023-12-28 02:43:31,845][106226] Updated weights for policy 0, policy_version 1039132 (0.0010) [2023-12-28 02:43:32,054][106225] Updated weights for policy 1, policy_version 1041660 (0.0010) [2023-12-28 02:43:32,109][106225] Updated weights for policy 1, policy_version 1041670 (0.0007) [2023-12-28 02:43:32,166][106225] Updated weights for policy 1, policy_version 1041680 (0.0008) [2023-12-28 02:43:32,566][106226] Updated weights for policy 0, policy_version 1039142 (0.0011) [2023-12-28 02:43:32,630][106226] Updated weights for policy 0, policy_version 1039152 (0.0010) [2023-12-28 02:43:32,692][106226] Updated weights for policy 0, policy_version 1039162 (0.0010) [2023-12-28 02:43:32,897][106225] Updated weights for policy 1, policy_version 1041690 (0.0009) [2023-12-28 02:43:32,961][106225] Updated weights for policy 1, policy_version 1041700 (0.0010) [2023-12-28 02:43:33,005][106225] Updated weights for policy 1, policy_version 1041710 (0.0010) [2023-12-28 02:43:33,055][106225] Updated weights for policy 1, policy_version 1041720 (0.0010) [2023-12-28 02:43:33,338][106226] Updated weights for policy 0, policy_version 1039172 (0.0008) [2023-12-28 02:43:33,388][106226] Updated weights for policy 0, policy_version 1039182 (0.0008) [2023-12-28 02:43:33,443][106226] Updated weights for policy 0, policy_version 1039192 (0.0005) [2023-12-28 02:43:33,766][106225] Updated weights for policy 1, policy_version 1041730 (0.0010) [2023-12-28 02:43:33,808][106225] Updated weights for policy 1, policy_version 1041740 (0.0010) [2023-12-28 02:43:33,858][106225] Updated weights for policy 1, policy_version 1041750 (0.0010) [2023-12-28 02:43:33,968][106226] Updated weights for policy 0, policy_version 1039202 (0.0005) [2023-12-28 02:43:34,025][106226] Updated weights for policy 0, policy_version 1039212 (0.0005) [2023-12-28 02:43:34,082][106226] Updated weights for policy 0, policy_version 1039222 (0.0005) [2023-12-28 02:43:34,143][106226] Updated weights for policy 0, policy_version 1039232 (0.0006) [2023-12-28 02:43:34,564][106225] Updated weights for policy 1, policy_version 1041760 (0.0011) [2023-12-28 02:43:34,630][106225] Updated weights for policy 1, policy_version 1041770 (0.0011) [2023-12-28 02:43:34,691][106225] Updated weights for policy 1, policy_version 1041780 (0.0010) [2023-12-28 02:43:34,821][106226] Updated weights for policy 0, policy_version 1039242 (0.0010) [2023-12-28 02:43:34,871][106226] Updated weights for policy 0, policy_version 1039252 (0.0010) [2023-12-28 02:43:34,920][106226] Updated weights for policy 0, policy_version 1039262 (0.0009) [2023-12-28 02:43:35,414][106225] Updated weights for policy 1, policy_version 1041790 (0.0007) [2023-12-28 02:43:35,476][106225] Updated weights for policy 1, policy_version 1041800 (0.0007) [2023-12-28 02:43:35,536][106225] Updated weights for policy 1, policy_version 1041810 (0.0010) [2023-12-28 02:43:35,660][106226] Updated weights for policy 0, policy_version 1039272 (0.0010) [2023-12-28 02:43:35,716][106226] Updated weights for policy 0, policy_version 1039282 (0.0010) [2023-12-28 02:43:35,782][106226] Updated weights for policy 0, policy_version 1039292 (0.0010) [2023-12-28 02:43:36,131][106225] Updated weights for policy 1, policy_version 1041820 (0.0009) [2023-12-28 02:43:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 532865024. Throughput: 0: 10076.9, 1: 9890.3. Samples: 532875792. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:36,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.803')] [2023-12-28 02:43:36,183][106225] Updated weights for policy 1, policy_version 1041830 (0.0009) [2023-12-28 02:43:36,238][106225] Updated weights for policy 1, policy_version 1041840 (0.0009) [2023-12-28 02:43:36,392][106226] Updated weights for policy 0, policy_version 1039302 (0.0008) [2023-12-28 02:43:36,457][106226] Updated weights for policy 0, policy_version 1039312 (0.0008) [2023-12-28 02:43:36,527][106226] Updated weights for policy 0, policy_version 1039322 (0.0009) [2023-12-28 02:43:36,922][106225] Updated weights for policy 1, policy_version 1041850 (0.0008) [2023-12-28 02:43:36,984][106225] Updated weights for policy 1, policy_version 1041860 (0.0009) [2023-12-28 02:43:37,045][106225] Updated weights for policy 1, policy_version 1041870 (0.0010) [2023-12-28 02:43:37,099][106225] Updated weights for policy 1, policy_version 1041880 (0.0008) [2023-12-28 02:43:37,193][106226] Updated weights for policy 0, policy_version 1039332 (0.0007) [2023-12-28 02:43:37,251][106226] Updated weights for policy 0, policy_version 1039342 (0.0006) [2023-12-28 02:43:37,309][106226] Updated weights for policy 0, policy_version 1039352 (0.0006) [2023-12-28 02:43:37,828][106225] Updated weights for policy 1, policy_version 1041890 (0.0009) [2023-12-28 02:43:37,891][106225] Updated weights for policy 1, policy_version 1041900 (0.0008) [2023-12-28 02:43:37,953][106225] Updated weights for policy 1, policy_version 1041910 (0.0008) [2023-12-28 02:43:37,991][106226] Updated weights for policy 0, policy_version 1039362 (0.0009) [2023-12-28 02:43:38,044][106226] Updated weights for policy 0, policy_version 1039372 (0.0009) [2023-12-28 02:43:38,109][106226] Updated weights for policy 0, policy_version 1039382 (0.0009) [2023-12-28 02:43:38,174][106226] Updated weights for policy 0, policy_version 1039392 (0.0009) [2023-12-28 02:43:38,654][106225] Updated weights for policy 1, policy_version 1041920 (0.0007) [2023-12-28 02:43:38,702][106225] Updated weights for policy 1, policy_version 1041930 (0.0008) [2023-12-28 02:43:38,752][106225] Updated weights for policy 1, policy_version 1041940 (0.0007) [2023-12-28 02:43:38,916][106226] Updated weights for policy 0, policy_version 1039402 (0.0006) [2023-12-28 02:43:38,963][106226] Updated weights for policy 0, policy_version 1039412 (0.0009) [2023-12-28 02:43:39,018][106226] Updated weights for policy 0, policy_version 1039422 (0.0008) [2023-12-28 02:43:39,532][106225] Updated weights for policy 1, policy_version 1041950 (0.0009) [2023-12-28 02:43:39,585][106225] Updated weights for policy 1, policy_version 1041960 (0.0008) [2023-12-28 02:43:39,647][106225] Updated weights for policy 1, policy_version 1041970 (0.0007) [2023-12-28 02:43:39,759][106226] Updated weights for policy 0, policy_version 1039432 (0.0007) [2023-12-28 02:43:39,818][106226] Updated weights for policy 0, policy_version 1039442 (0.0008) [2023-12-28 02:43:39,884][106226] Updated weights for policy 0, policy_version 1039452 (0.0009) [2023-12-28 02:43:40,454][106225] Updated weights for policy 1, policy_version 1041980 (0.0007) [2023-12-28 02:43:40,509][106225] Updated weights for policy 1, policy_version 1041990 (0.0005) [2023-12-28 02:43:40,575][106225] Updated weights for policy 1, policy_version 1042000 (0.0005) [2023-12-28 02:43:40,584][106226] Updated weights for policy 0, policy_version 1039462 (0.0008) [2023-12-28 02:43:40,631][106226] Updated weights for policy 0, policy_version 1039472 (0.0008) [2023-12-28 02:43:40,676][106226] Updated weights for policy 0, policy_version 1039482 (0.0007) [2023-12-28 02:43:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 532963328. Throughput: 0: 10061.6, 1: 9905.1. Samples: 532935624. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:41,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-5.093')] [2023-12-28 02:43:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001042008_266797056.pth... [2023-12-28 02:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001039488_266166272.pth... [2023-12-28 02:43:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001038336_265871360.pth [2023-12-28 02:43:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001040856_266502144.pth [2023-12-28 02:43:41,261][106225] Updated weights for policy 1, policy_version 1042010 (0.0006) [2023-12-28 02:43:41,323][106225] Updated weights for policy 1, policy_version 1042020 (0.0009) [2023-12-28 02:43:41,397][106225] Updated weights for policy 1, policy_version 1042030 (0.0008) [2023-12-28 02:43:41,451][106226] Updated weights for policy 0, policy_version 1039492 (0.0008) [2023-12-28 02:43:41,460][106225] Updated weights for policy 1, policy_version 1042040 (0.0006) [2023-12-28 02:43:41,516][106226] Updated weights for policy 0, policy_version 1039502 (0.0009) [2023-12-28 02:43:41,576][106226] Updated weights for policy 0, policy_version 1039512 (0.0008) [2023-12-28 02:43:42,238][106225] Updated weights for policy 1, policy_version 1042050 (0.0009) [2023-12-28 02:43:42,299][106225] Updated weights for policy 1, policy_version 1042060 (0.0008) [2023-12-28 02:43:42,327][106226] Updated weights for policy 0, policy_version 1039522 (0.0008) [2023-12-28 02:43:42,365][106225] Updated weights for policy 1, policy_version 1042070 (0.0008) [2023-12-28 02:43:42,394][106226] Updated weights for policy 0, policy_version 1039532 (0.0009) [2023-12-28 02:43:42,457][106226] Updated weights for policy 0, policy_version 1039542 (0.0008) [2023-12-28 02:43:42,515][106226] Updated weights for policy 0, policy_version 1039552 (0.0006) [2023-12-28 02:43:42,994][106225] Updated weights for policy 1, policy_version 1042080 (0.0010) [2023-12-28 02:43:43,055][106225] Updated weights for policy 1, policy_version 1042090 (0.0010) [2023-12-28 02:43:43,103][106225] Updated weights for policy 1, policy_version 1042100 (0.0010) [2023-12-28 02:43:43,220][106226] Updated weights for policy 0, policy_version 1039562 (0.0008) [2023-12-28 02:43:43,283][106226] Updated weights for policy 0, policy_version 1039572 (0.0006) [2023-12-28 02:43:43,342][106226] Updated weights for policy 0, policy_version 1039582 (0.0006) [2023-12-28 02:43:43,790][106225] Updated weights for policy 1, policy_version 1042110 (0.0010) [2023-12-28 02:43:43,843][106225] Updated weights for policy 1, policy_version 1042120 (0.0010) [2023-12-28 02:43:43,895][106225] Updated weights for policy 1, policy_version 1042130 (0.0009) [2023-12-28 02:43:44,037][106226] Updated weights for policy 0, policy_version 1039592 (0.0006) [2023-12-28 02:43:44,085][106226] Updated weights for policy 0, policy_version 1039602 (0.0006) [2023-12-28 02:43:44,134][106226] Updated weights for policy 0, policy_version 1039612 (0.0008) [2023-12-28 02:43:44,653][106225] Updated weights for policy 1, policy_version 1042140 (0.0009) [2023-12-28 02:43:44,713][106225] Updated weights for policy 1, policy_version 1042150 (0.0010) [2023-12-28 02:43:44,771][106225] Updated weights for policy 1, policy_version 1042161 (0.0010) [2023-12-28 02:43:44,774][106226] Updated weights for policy 0, policy_version 1039622 (0.0010) [2023-12-28 02:43:44,844][106226] Updated weights for policy 0, policy_version 1039632 (0.0011) [2023-12-28 02:43:44,903][106226] Updated weights for policy 0, policy_version 1039642 (0.0011) [2023-12-28 02:43:45,563][106225] Updated weights for policy 1, policy_version 1042171 (0.0006) [2023-12-28 02:43:45,602][106226] Updated weights for policy 0, policy_version 1039652 (0.0011) [2023-12-28 02:43:45,626][106225] Updated weights for policy 1, policy_version 1042181 (0.0005) [2023-12-28 02:43:45,659][106226] Updated weights for policy 0, policy_version 1039662 (0.0010) [2023-12-28 02:43:45,680][106225] Updated weights for policy 1, policy_version 1042191 (0.0005) [2023-12-28 02:43:45,709][106226] Updated weights for policy 0, policy_version 1039672 (0.0010) [2023-12-28 02:43:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 533061632. Throughput: 0: 10002.0, 1: 9840.0. Samples: 533051744. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:46,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-4.966')] [2023-12-28 02:43:46,317][106225] Updated weights for policy 1, policy_version 1042201 (0.0006) [2023-12-28 02:43:46,371][106225] Updated weights for policy 1, policy_version 1042211 (0.0007) [2023-12-28 02:43:46,422][106226] Updated weights for policy 0, policy_version 1039682 (0.0010) [2023-12-28 02:43:46,431][106225] Updated weights for policy 1, policy_version 1042221 (0.0006) [2023-12-28 02:43:46,476][106226] Updated weights for policy 0, policy_version 1039692 (0.0011) [2023-12-28 02:43:46,492][106225] Updated weights for policy 1, policy_version 1042231 (0.0005) [2023-12-28 02:43:46,537][106226] Updated weights for policy 0, policy_version 1039702 (0.0008) [2023-12-28 02:43:46,601][106226] Updated weights for policy 0, policy_version 1039712 (0.0005) [2023-12-28 02:43:47,025][106225] Updated weights for policy 1, policy_version 1042241 (0.0005) [2023-12-28 02:43:47,075][106225] Updated weights for policy 1, policy_version 1042251 (0.0007) [2023-12-28 02:43:47,126][106225] Updated weights for policy 1, policy_version 1042261 (0.0009) [2023-12-28 02:43:47,235][106226] Updated weights for policy 0, policy_version 1039722 (0.0008) [2023-12-28 02:43:47,294][106226] Updated weights for policy 0, policy_version 1039732 (0.0008) [2023-12-28 02:43:47,348][106226] Updated weights for policy 0, policy_version 1039742 (0.0009) [2023-12-28 02:43:47,744][106225] Updated weights for policy 1, policy_version 1042271 (0.0007) [2023-12-28 02:43:47,801][106225] Updated weights for policy 1, policy_version 1042281 (0.0005) [2023-12-28 02:43:47,859][106225] Updated weights for policy 1, policy_version 1042291 (0.0005) [2023-12-28 02:43:48,065][106226] Updated weights for policy 0, policy_version 1039752 (0.0010) [2023-12-28 02:43:48,125][106226] Updated weights for policy 0, policy_version 1039762 (0.0010) [2023-12-28 02:43:48,192][106226] Updated weights for policy 0, policy_version 1039772 (0.0006) [2023-12-28 02:43:48,495][106225] Updated weights for policy 1, policy_version 1042301 (0.0007) [2023-12-28 02:43:48,547][106225] Updated weights for policy 1, policy_version 1042311 (0.0008) [2023-12-28 02:43:48,600][106225] Updated weights for policy 1, policy_version 1042321 (0.0009) [2023-12-28 02:43:48,876][106226] Updated weights for policy 0, policy_version 1039782 (0.0008) [2023-12-28 02:43:48,924][106226] Updated weights for policy 0, policy_version 1039792 (0.0008) [2023-12-28 02:43:48,973][106226] Updated weights for policy 0, policy_version 1039802 (0.0008) [2023-12-28 02:43:49,332][106225] Updated weights for policy 1, policy_version 1042331 (0.0007) [2023-12-28 02:43:49,402][106225] Updated weights for policy 1, policy_version 1042341 (0.0007) [2023-12-28 02:43:49,463][106225] Updated weights for policy 1, policy_version 1042351 (0.0008) [2023-12-28 02:43:49,732][106226] Updated weights for policy 0, policy_version 1039812 (0.0006) [2023-12-28 02:43:49,785][106226] Updated weights for policy 0, policy_version 1039822 (0.0006) [2023-12-28 02:43:49,854][106226] Updated weights for policy 0, policy_version 1039832 (0.0007) [2023-12-28 02:43:50,194][106225] Updated weights for policy 1, policy_version 1042361 (0.0008) [2023-12-28 02:43:50,255][106225] Updated weights for policy 1, policy_version 1042371 (0.0009) [2023-12-28 02:43:50,317][106225] Updated weights for policy 1, policy_version 1042381 (0.0009) [2023-12-28 02:43:50,373][106225] Updated weights for policy 1, policy_version 1042391 (0.0008) [2023-12-28 02:43:50,583][106226] Updated weights for policy 0, policy_version 1039842 (0.0009) [2023-12-28 02:43:50,646][106226] Updated weights for policy 0, policy_version 1039852 (0.0007) [2023-12-28 02:43:50,717][106226] Updated weights for policy 0, policy_version 1039862 (0.0006) [2023-12-28 02:43:50,782][106226] Updated weights for policy 0, policy_version 1039872 (0.0006) [2023-12-28 02:43:51,162][106225] Updated weights for policy 1, policy_version 1042401 (0.0008) [2023-12-28 02:43:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 533159936. Throughput: 0: 9930.1, 1: 9896.8. Samples: 533173476. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:51,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.077')] [2023-12-28 02:43:51,223][106225] Updated weights for policy 1, policy_version 1042411 (0.0009) [2023-12-28 02:43:51,283][106225] Updated weights for policy 1, policy_version 1042421 (0.0008) [2023-12-28 02:43:51,461][106226] Updated weights for policy 0, policy_version 1039882 (0.0011) [2023-12-28 02:43:51,516][106226] Updated weights for policy 0, policy_version 1039892 (0.0011) [2023-12-28 02:43:51,586][106226] Updated weights for policy 0, policy_version 1039902 (0.0011) [2023-12-28 02:43:52,047][106225] Updated weights for policy 1, policy_version 1042431 (0.0008) [2023-12-28 02:43:52,100][106225] Updated weights for policy 1, policy_version 1042441 (0.0008) [2023-12-28 02:43:52,158][106225] Updated weights for policy 1, policy_version 1042451 (0.0009) [2023-12-28 02:43:52,295][106226] Updated weights for policy 0, policy_version 1039912 (0.0009) [2023-12-28 02:43:52,355][106226] Updated weights for policy 0, policy_version 1039922 (0.0008) [2023-12-28 02:43:52,419][106226] Updated weights for policy 0, policy_version 1039932 (0.0008) [2023-12-28 02:43:52,934][106225] Updated weights for policy 1, policy_version 1042461 (0.0009) [2023-12-28 02:43:52,984][106225] Updated weights for policy 1, policy_version 1042471 (0.0008) [2023-12-28 02:43:53,045][106225] Updated weights for policy 1, policy_version 1042481 (0.0005) [2023-12-28 02:43:53,147][106226] Updated weights for policy 0, policy_version 1039942 (0.0006) [2023-12-28 02:43:53,209][106226] Updated weights for policy 0, policy_version 1039952 (0.0005) [2023-12-28 02:43:53,258][106226] Updated weights for policy 0, policy_version 1039962 (0.0005) [2023-12-28 02:43:53,769][106225] Updated weights for policy 1, policy_version 1042491 (0.0008) [2023-12-28 02:43:53,826][106226] Updated weights for policy 0, policy_version 1039972 (0.0005) [2023-12-28 02:43:53,831][106225] Updated weights for policy 1, policy_version 1042501 (0.0008) [2023-12-28 02:43:53,877][106225] Updated weights for policy 1, policy_version 1042511 (0.0009) [2023-12-28 02:43:53,888][106226] Updated weights for policy 0, policy_version 1039982 (0.0006) [2023-12-28 02:43:53,954][106226] Updated weights for policy 0, policy_version 1039992 (0.0008) [2023-12-28 02:43:54,554][106225] Updated weights for policy 1, policy_version 1042521 (0.0005) [2023-12-28 02:43:54,614][106225] Updated weights for policy 1, policy_version 1042531 (0.0005) [2023-12-28 02:43:54,638][106226] Updated weights for policy 0, policy_version 1040002 (0.0009) [2023-12-28 02:43:54,668][106225] Updated weights for policy 1, policy_version 1042541 (0.0006) [2023-12-28 02:43:54,697][106226] Updated weights for policy 0, policy_version 1040012 (0.0008) [2023-12-28 02:43:54,718][106225] Updated weights for policy 1, policy_version 1042551 (0.0008) [2023-12-28 02:43:54,757][106226] Updated weights for policy 0, policy_version 1040022 (0.0008) [2023-12-28 02:43:54,816][106226] Updated weights for policy 0, policy_version 1040032 (0.0009) [2023-12-28 02:43:55,273][106225] Updated weights for policy 1, policy_version 1042561 (0.0006) [2023-12-28 02:43:55,336][106225] Updated weights for policy 1, policy_version 1042571 (0.0005) [2023-12-28 02:43:55,404][106225] Updated weights for policy 1, policy_version 1042581 (0.0005) [2023-12-28 02:43:55,450][106226] Updated weights for policy 0, policy_version 1040042 (0.0005) [2023-12-28 02:43:55,512][106226] Updated weights for policy 0, policy_version 1040052 (0.0008) [2023-12-28 02:43:55,573][106226] Updated weights for policy 0, policy_version 1040062 (0.0009) [2023-12-28 02:43:55,974][106225] Updated weights for policy 1, policy_version 1042591 (0.0008) [2023-12-28 02:43:56,029][106225] Updated weights for policy 1, policy_version 1042601 (0.0008) [2023-12-28 02:43:56,096][106225] Updated weights for policy 1, policy_version 1042611 (0.0005) [2023-12-28 02:43:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 533266432. Throughput: 0: 9917.6, 1: 9867.2. Samples: 533231264. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:43:56,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-5.075')] [2023-12-28 02:43:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001042616_266952704.pth... [2023-12-28 02:43:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001040064_266313728.pth... [2023-12-28 02:43:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001041464_266657792.pth [2023-12-28 02:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001038912_266018816.pth [2023-12-28 02:43:56,307][106226] Updated weights for policy 0, policy_version 1040072 (0.0009) [2023-12-28 02:43:56,363][106226] Updated weights for policy 0, policy_version 1040082 (0.0007) [2023-12-28 02:43:56,416][106226] Updated weights for policy 0, policy_version 1040092 (0.0008) [2023-12-28 02:43:56,648][106225] Updated weights for policy 1, policy_version 1042621 (0.0007) [2023-12-28 02:43:56,710][106225] Updated weights for policy 1, policy_version 1042631 (0.0010) [2023-12-28 02:43:56,769][106225] Updated weights for policy 1, policy_version 1042641 (0.0009) [2023-12-28 02:43:57,184][106226] Updated weights for policy 0, policy_version 1040102 (0.0008) [2023-12-28 02:43:57,243][106226] Updated weights for policy 0, policy_version 1040112 (0.0007) [2023-12-28 02:43:57,311][106226] Updated weights for policy 0, policy_version 1040122 (0.0008) [2023-12-28 02:43:57,471][106225] Updated weights for policy 1, policy_version 1042651 (0.0009) [2023-12-28 02:43:57,522][106225] Updated weights for policy 1, policy_version 1042661 (0.0005) [2023-12-28 02:43:57,583][106225] Updated weights for policy 1, policy_version 1042671 (0.0010) [2023-12-28 02:43:58,071][106226] Updated weights for policy 0, policy_version 1040132 (0.0008) [2023-12-28 02:43:58,114][106226] Updated weights for policy 0, policy_version 1040142 (0.0008) [2023-12-28 02:43:58,164][106226] Updated weights for policy 0, policy_version 1040153 (0.0008) [2023-12-28 02:43:58,233][106225] Updated weights for policy 1, policy_version 1042681 (0.0010) [2023-12-28 02:43:58,290][106225] Updated weights for policy 1, policy_version 1042691 (0.0007) [2023-12-28 02:43:58,354][106225] Updated weights for policy 1, policy_version 1042701 (0.0008) [2023-12-28 02:43:58,422][106225] Updated weights for policy 1, policy_version 1042711 (0.0009) [2023-12-28 02:43:59,002][106226] Updated weights for policy 0, policy_version 1040163 (0.0008) [2023-12-28 02:43:59,063][106226] Updated weights for policy 0, policy_version 1040173 (0.0008) [2023-12-28 02:43:59,120][106226] Updated weights for policy 0, policy_version 1040183 (0.0009) [2023-12-28 02:43:59,216][106225] Updated weights for policy 1, policy_version 1042721 (0.0010) [2023-12-28 02:43:59,285][106225] Updated weights for policy 1, policy_version 1042731 (0.0008) [2023-12-28 02:43:59,351][106225] Updated weights for policy 1, policy_version 1042741 (0.0008) [2023-12-28 02:43:59,918][106226] Updated weights for policy 0, policy_version 1040193 (0.0008) [2023-12-28 02:43:59,975][106226] Updated weights for policy 0, policy_version 1040203 (0.0008) [2023-12-28 02:44:00,030][106226] Updated weights for policy 0, policy_version 1040213 (0.0009) [2023-12-28 02:44:00,080][106226] Updated weights for policy 0, policy_version 1040223 (0.0006) [2023-12-28 02:44:00,170][106225] Updated weights for policy 1, policy_version 1042751 (0.0006) [2023-12-28 02:44:00,228][106225] Updated weights for policy 1, policy_version 1042761 (0.0006) [2023-12-28 02:44:00,282][106225] Updated weights for policy 1, policy_version 1042771 (0.0005) [2023-12-28 02:44:00,700][106226] Updated weights for policy 0, policy_version 1040233 (0.0008) [2023-12-28 02:44:00,752][106226] Updated weights for policy 0, policy_version 1040243 (0.0008) [2023-12-28 02:44:00,804][106226] Updated weights for policy 0, policy_version 1040253 (0.0007) [2023-12-28 02:44:01,011][106225] Updated weights for policy 1, policy_version 1042781 (0.0007) [2023-12-28 02:44:01,077][106225] Updated weights for policy 1, policy_version 1042791 (0.0008) [2023-12-28 02:44:01,151][106225] Updated weights for policy 1, policy_version 1042801 (0.0009) [2023-12-28 02:44:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 533356544. Throughput: 0: 9863.8, 1: 9946.4. Samples: 533349560. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:01,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.734')] [2023-12-28 02:44:01,522][106226] Updated weights for policy 0, policy_version 1040263 (0.0007) [2023-12-28 02:44:01,582][106226] Updated weights for policy 0, policy_version 1040273 (0.0009) [2023-12-28 02:44:01,650][106226] Updated weights for policy 0, policy_version 1040283 (0.0009) [2023-12-28 02:44:01,850][106225] Updated weights for policy 1, policy_version 1042811 (0.0008) [2023-12-28 02:44:01,911][106225] Updated weights for policy 1, policy_version 1042821 (0.0009) [2023-12-28 02:44:01,973][106225] Updated weights for policy 1, policy_version 1042831 (0.0011) [2023-12-28 02:44:02,391][106226] Updated weights for policy 0, policy_version 1040293 (0.0008) [2023-12-28 02:44:02,441][106226] Updated weights for policy 0, policy_version 1040303 (0.0008) [2023-12-28 02:44:02,493][106226] Updated weights for policy 0, policy_version 1040313 (0.0007) [2023-12-28 02:44:02,686][106225] Updated weights for policy 1, policy_version 1042841 (0.0011) [2023-12-28 02:44:02,742][106225] Updated weights for policy 1, policy_version 1042851 (0.0010) [2023-12-28 02:44:02,793][106225] Updated weights for policy 1, policy_version 1042861 (0.0010) [2023-12-28 02:44:02,859][106225] Updated weights for policy 1, policy_version 1042871 (0.0007) [2023-12-28 02:44:03,225][106226] Updated weights for policy 0, policy_version 1040323 (0.0007) [2023-12-28 02:44:03,283][106226] Updated weights for policy 0, policy_version 1040333 (0.0006) [2023-12-28 02:44:03,340][106226] Updated weights for policy 0, policy_version 1040343 (0.0007) [2023-12-28 02:44:03,547][106225] Updated weights for policy 1, policy_version 1042881 (0.0008) [2023-12-28 02:44:03,605][106225] Updated weights for policy 1, policy_version 1042891 (0.0006) [2023-12-28 02:44:03,656][106225] Updated weights for policy 1, policy_version 1042901 (0.0005) [2023-12-28 02:44:04,045][106226] Updated weights for policy 0, policy_version 1040353 (0.0007) [2023-12-28 02:44:04,106][106226] Updated weights for policy 0, policy_version 1040363 (0.0006) [2023-12-28 02:44:04,169][106226] Updated weights for policy 0, policy_version 1040373 (0.0009) [2023-12-28 02:44:04,254][106226] Updated weights for policy 0, policy_version 1040383 (0.0009) [2023-12-28 02:44:04,362][106225] Updated weights for policy 1, policy_version 1042911 (0.0005) [2023-12-28 02:44:04,418][106225] Updated weights for policy 1, policy_version 1042921 (0.0005) [2023-12-28 02:44:04,474][106225] Updated weights for policy 1, policy_version 1042931 (0.0008) [2023-12-28 02:44:04,984][106226] Updated weights for policy 0, policy_version 1040393 (0.0008) [2023-12-28 02:44:05,038][106226] Updated weights for policy 0, policy_version 1040403 (0.0008) [2023-12-28 02:44:05,093][106226] Updated weights for policy 0, policy_version 1040413 (0.0008) [2023-12-28 02:44:05,161][106225] Updated weights for policy 1, policy_version 1042941 (0.0009) [2023-12-28 02:44:05,225][106225] Updated weights for policy 1, policy_version 1042951 (0.0007) [2023-12-28 02:44:05,291][106225] Updated weights for policy 1, policy_version 1042961 (0.0008) [2023-12-28 02:44:05,847][106226] Updated weights for policy 0, policy_version 1040423 (0.0009) [2023-12-28 02:44:05,904][106226] Updated weights for policy 0, policy_version 1040433 (0.0007) [2023-12-28 02:44:05,926][106225] Updated weights for policy 1, policy_version 1042971 (0.0007) [2023-12-28 02:44:05,962][106226] Updated weights for policy 0, policy_version 1040443 (0.0007) [2023-12-28 02:44:05,973][106225] Updated weights for policy 1, policy_version 1042981 (0.0006) [2023-12-28 02:44:06,023][106225] Updated weights for policy 1, policy_version 1042991 (0.0008) [2023-12-28 02:44:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 533463040. Throughput: 0: 9829.1, 1: 9928.4. Samples: 533466968. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:06,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.783')] [2023-12-28 02:44:06,691][106225] Updated weights for policy 1, policy_version 1043001 (0.0007) [2023-12-28 02:44:06,692][106226] Updated weights for policy 0, policy_version 1040453 (0.0008) [2023-12-28 02:44:06,744][106225] Updated weights for policy 1, policy_version 1043011 (0.0005) [2023-12-28 02:44:06,757][106226] Updated weights for policy 0, policy_version 1040463 (0.0008) [2023-12-28 02:44:06,801][106225] Updated weights for policy 1, policy_version 1043021 (0.0006) [2023-12-28 02:44:06,822][106226] Updated weights for policy 0, policy_version 1040473 (0.0007) [2023-12-28 02:44:06,859][106225] Updated weights for policy 1, policy_version 1043031 (0.0009) [2023-12-28 02:44:07,539][106225] Updated weights for policy 1, policy_version 1043041 (0.0008) [2023-12-28 02:44:07,562][106226] Updated weights for policy 0, policy_version 1040483 (0.0007) [2023-12-28 02:44:07,599][106225] Updated weights for policy 1, policy_version 1043051 (0.0010) [2023-12-28 02:44:07,616][106226] Updated weights for policy 0, policy_version 1040493 (0.0006) [2023-12-28 02:44:07,652][106225] Updated weights for policy 1, policy_version 1043061 (0.0010) [2023-12-28 02:44:07,674][106226] Updated weights for policy 0, policy_version 1040503 (0.0006) [2023-12-28 02:44:08,374][106225] Updated weights for policy 1, policy_version 1043071 (0.0010) [2023-12-28 02:44:08,426][106226] Updated weights for policy 0, policy_version 1040513 (0.0007) [2023-12-28 02:44:08,430][106225] Updated weights for policy 1, policy_version 1043081 (0.0010) [2023-12-28 02:44:08,488][106225] Updated weights for policy 1, policy_version 1043091 (0.0010) [2023-12-28 02:44:08,489][106226] Updated weights for policy 0, policy_version 1040523 (0.0008) [2023-12-28 02:44:08,545][106226] Updated weights for policy 0, policy_version 1040533 (0.0009) [2023-12-28 02:44:08,609][106226] Updated weights for policy 0, policy_version 1040543 (0.0008) [2023-12-28 02:44:09,137][106225] Updated weights for policy 1, policy_version 1043101 (0.0009) [2023-12-28 02:44:09,186][106225] Updated weights for policy 1, policy_version 1043111 (0.0010) [2023-12-28 02:44:09,250][106225] Updated weights for policy 1, policy_version 1043121 (0.0010) [2023-12-28 02:44:09,365][106226] Updated weights for policy 0, policy_version 1040553 (0.0008) [2023-12-28 02:44:09,433][106226] Updated weights for policy 0, policy_version 1040563 (0.0008) [2023-12-28 02:44:09,499][106226] Updated weights for policy 0, policy_version 1040573 (0.0008) [2023-12-28 02:44:09,948][106225] Updated weights for policy 1, policy_version 1043131 (0.0009) [2023-12-28 02:44:10,009][106225] Updated weights for policy 1, policy_version 1043141 (0.0006) [2023-12-28 02:44:10,068][106225] Updated weights for policy 1, policy_version 1043151 (0.0007) [2023-12-28 02:44:10,317][106226] Updated weights for policy 0, policy_version 1040583 (0.0010) [2023-12-28 02:44:10,371][106226] Updated weights for policy 0, policy_version 1040593 (0.0011) [2023-12-28 02:44:10,439][106226] Updated weights for policy 0, policy_version 1040603 (0.0011) [2023-12-28 02:44:10,777][106225] Updated weights for policy 1, policy_version 1043161 (0.0007) [2023-12-28 02:44:10,836][106225] Updated weights for policy 1, policy_version 1043171 (0.0005) [2023-12-28 02:44:10,897][106225] Updated weights for policy 1, policy_version 1043181 (0.0006) [2023-12-28 02:44:10,959][106225] Updated weights for policy 1, policy_version 1043191 (0.0005) [2023-12-28 02:44:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 533553152. Throughput: 0: 9814.2, 1: 9955.1. Samples: 533525140. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:11,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-4.796')] [2023-12-28 02:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001043192_267100160.pth... [2023-12-28 02:44:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001040608_266452992.pth... [2023-12-28 02:44:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001042008_266797056.pth [2023-12-28 02:44:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001039488_266166272.pth [2023-12-28 02:44:11,257][106226] Updated weights for policy 0, policy_version 1040613 (0.0009) [2023-12-28 02:44:11,319][106226] Updated weights for policy 0, policy_version 1040623 (0.0008) [2023-12-28 02:44:11,395][106226] Updated weights for policy 0, policy_version 1040633 (0.0008) [2023-12-28 02:44:11,599][106225] Updated weights for policy 1, policy_version 1043201 (0.0008) [2023-12-28 02:44:11,663][106225] Updated weights for policy 1, policy_version 1043211 (0.0007) [2023-12-28 02:44:11,727][106225] Updated weights for policy 1, policy_version 1043221 (0.0008) [2023-12-28 02:44:12,139][106226] Updated weights for policy 0, policy_version 1040643 (0.0008) [2023-12-28 02:44:12,189][106226] Updated weights for policy 0, policy_version 1040653 (0.0008) [2023-12-28 02:44:12,250][106226] Updated weights for policy 0, policy_version 1040663 (0.0008) [2023-12-28 02:44:12,498][106225] Updated weights for policy 1, policy_version 1043231 (0.0008) [2023-12-28 02:44:12,560][106225] Updated weights for policy 1, policy_version 1043241 (0.0008) [2023-12-28 02:44:12,620][106225] Updated weights for policy 1, policy_version 1043251 (0.0009) [2023-12-28 02:44:13,027][106226] Updated weights for policy 0, policy_version 1040673 (0.0009) [2023-12-28 02:44:13,079][106226] Updated weights for policy 0, policy_version 1040683 (0.0009) [2023-12-28 02:44:13,135][106226] Updated weights for policy 0, policy_version 1040693 (0.0008) [2023-12-28 02:44:13,200][106226] Updated weights for policy 0, policy_version 1040703 (0.0008) [2023-12-28 02:44:13,337][106225] Updated weights for policy 1, policy_version 1043261 (0.0007) [2023-12-28 02:44:13,398][106225] Updated weights for policy 1, policy_version 1043271 (0.0007) [2023-12-28 02:44:13,456][106225] Updated weights for policy 1, policy_version 1043281 (0.0008) [2023-12-28 02:44:13,954][106226] Updated weights for policy 0, policy_version 1040713 (0.0009) [2023-12-28 02:44:14,005][106226] Updated weights for policy 0, policy_version 1040723 (0.0008) [2023-12-28 02:44:14,053][106226] Updated weights for policy 0, policy_version 1040733 (0.0008) [2023-12-28 02:44:14,153][106225] Updated weights for policy 1, policy_version 1043291 (0.0007) [2023-12-28 02:44:14,214][106225] Updated weights for policy 1, policy_version 1043301 (0.0006) [2023-12-28 02:44:14,260][106225] Updated weights for policy 1, policy_version 1043311 (0.0009) [2023-12-28 02:44:14,796][106226] Updated weights for policy 0, policy_version 1040743 (0.0008) [2023-12-28 02:44:14,859][106226] Updated weights for policy 0, policy_version 1040753 (0.0008) [2023-12-28 02:44:14,914][106225] Updated weights for policy 1, policy_version 1043321 (0.0009) [2023-12-28 02:44:14,922][106226] Updated weights for policy 0, policy_version 1040763 (0.0008) [2023-12-28 02:44:14,979][106225] Updated weights for policy 1, policy_version 1043331 (0.0007) [2023-12-28 02:44:15,047][106225] Updated weights for policy 1, policy_version 1043341 (0.0008) [2023-12-28 02:44:15,108][106225] Updated weights for policy 1, policy_version 1043351 (0.0008) [2023-12-28 02:44:15,725][106226] Updated weights for policy 0, policy_version 1040773 (0.0008) [2023-12-28 02:44:15,785][106226] Updated weights for policy 0, policy_version 1040783 (0.0008) [2023-12-28 02:44:15,831][106225] Updated weights for policy 1, policy_version 1043361 (0.0010) [2023-12-28 02:44:15,847][106226] Updated weights for policy 0, policy_version 1040793 (0.0007) [2023-12-28 02:44:15,889][106225] Updated weights for policy 1, policy_version 1043371 (0.0010) [2023-12-28 02:44:15,947][106225] Updated weights for policy 1, policy_version 1043381 (0.0010) [2023-12-28 02:44:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 533651456. Throughput: 0: 9708.0, 1: 9936.9. Samples: 533639936. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:16,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.012')] [2023-12-28 02:44:16,503][106226] Updated weights for policy 0, policy_version 1040803 (0.0008) [2023-12-28 02:44:16,564][106226] Updated weights for policy 0, policy_version 1040813 (0.0005) [2023-12-28 02:44:16,608][106225] Updated weights for policy 1, policy_version 1043391 (0.0009) [2023-12-28 02:44:16,622][106226] Updated weights for policy 0, policy_version 1040823 (0.0009) [2023-12-28 02:44:16,674][106225] Updated weights for policy 1, policy_version 1043401 (0.0010) [2023-12-28 02:44:16,720][106225] Updated weights for policy 1, policy_version 1043411 (0.0010) [2023-12-28 02:44:17,284][106225] Updated weights for policy 1, policy_version 1043421 (0.0008) [2023-12-28 02:44:17,309][106226] Updated weights for policy 0, policy_version 1040833 (0.0010) [2023-12-28 02:44:17,341][106225] Updated weights for policy 1, policy_version 1043431 (0.0007) [2023-12-28 02:44:17,356][106226] Updated weights for policy 0, policy_version 1040843 (0.0010) [2023-12-28 02:44:17,395][106225] Updated weights for policy 1, policy_version 1043441 (0.0007) [2023-12-28 02:44:17,409][106226] Updated weights for policy 0, policy_version 1040853 (0.0010) [2023-12-28 02:44:17,466][106226] Updated weights for policy 0, policy_version 1040863 (0.0010) [2023-12-28 02:44:17,961][106225] Updated weights for policy 1, policy_version 1043451 (0.0007) [2023-12-28 02:44:18,019][106225] Updated weights for policy 1, policy_version 1043461 (0.0010) [2023-12-28 02:44:18,075][106225] Updated weights for policy 1, policy_version 1043471 (0.0010) [2023-12-28 02:44:18,177][106226] Updated weights for policy 0, policy_version 1040873 (0.0008) [2023-12-28 02:44:18,248][106226] Updated weights for policy 0, policy_version 1040883 (0.0008) [2023-12-28 02:44:18,296][106226] Updated weights for policy 0, policy_version 1040893 (0.0007) [2023-12-28 02:44:18,802][106225] Updated weights for policy 1, policy_version 1043481 (0.0010) [2023-12-28 02:44:18,854][106225] Updated weights for policy 1, policy_version 1043491 (0.0010) [2023-12-28 02:44:18,919][106225] Updated weights for policy 1, policy_version 1043501 (0.0011) [2023-12-28 02:44:18,971][106225] Updated weights for policy 1, policy_version 1043511 (0.0010) [2023-12-28 02:44:19,023][106226] Updated weights for policy 0, policy_version 1040903 (0.0006) [2023-12-28 02:44:19,086][106226] Updated weights for policy 0, policy_version 1040913 (0.0006) [2023-12-28 02:44:19,147][106226] Updated weights for policy 0, policy_version 1040923 (0.0006) [2023-12-28 02:44:19,709][106225] Updated weights for policy 1, policy_version 1043521 (0.0010) [2023-12-28 02:44:19,722][106226] Updated weights for policy 0, policy_version 1040933 (0.0006) [2023-12-28 02:44:19,776][106225] Updated weights for policy 1, policy_version 1043531 (0.0008) [2023-12-28 02:44:19,779][106226] Updated weights for policy 0, policy_version 1040943 (0.0006) [2023-12-28 02:44:19,844][106225] Updated weights for policy 1, policy_version 1043541 (0.0008) [2023-12-28 02:44:19,845][106226] Updated weights for policy 0, policy_version 1040953 (0.0008) [2023-12-28 02:44:20,564][106225] Updated weights for policy 1, policy_version 1043551 (0.0007) [2023-12-28 02:44:20,621][106226] Updated weights for policy 0, policy_version 1040963 (0.0009) [2023-12-28 02:44:20,623][106225] Updated weights for policy 1, policy_version 1043561 (0.0006) [2023-12-28 02:44:20,681][106225] Updated weights for policy 1, policy_version 1043571 (0.0006) [2023-12-28 02:44:20,687][106226] Updated weights for policy 0, policy_version 1040973 (0.0011) [2023-12-28 02:44:20,744][106226] Updated weights for policy 0, policy_version 1040983 (0.0011) [2023-12-28 02:44:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 533749760. Throughput: 0: 9656.6, 1: 9989.3. Samples: 533759856. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:21,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.764')] [2023-12-28 02:44:21,466][106226] Updated weights for policy 0, policy_version 1040993 (0.0010) [2023-12-28 02:44:21,502][106225] Updated weights for policy 1, policy_version 1043581 (0.0009) [2023-12-28 02:44:21,529][106226] Updated weights for policy 0, policy_version 1041003 (0.0008) [2023-12-28 02:44:21,570][106225] Updated weights for policy 1, policy_version 1043591 (0.0011) [2023-12-28 02:44:21,582][106226] Updated weights for policy 0, policy_version 1041013 (0.0007) [2023-12-28 02:44:21,638][106225] Updated weights for policy 1, policy_version 1043601 (0.0010) [2023-12-28 02:44:21,640][106226] Updated weights for policy 0, policy_version 1041023 (0.0008) [2023-12-28 02:44:22,375][106226] Updated weights for policy 0, policy_version 1041033 (0.0009) [2023-12-28 02:44:22,409][106225] Updated weights for policy 1, policy_version 1043611 (0.0009) [2023-12-28 02:44:22,434][106226] Updated weights for policy 0, policy_version 1041043 (0.0008) [2023-12-28 02:44:22,460][106225] Updated weights for policy 1, policy_version 1043621 (0.0008) [2023-12-28 02:44:22,499][106226] Updated weights for policy 0, policy_version 1041053 (0.0006) [2023-12-28 02:44:22,521][106225] Updated weights for policy 1, policy_version 1043631 (0.0008) [2023-12-28 02:44:23,195][106225] Updated weights for policy 1, policy_version 1043641 (0.0009) [2023-12-28 02:44:23,223][106226] Updated weights for policy 0, policy_version 1041063 (0.0007) [2023-12-28 02:44:23,248][106225] Updated weights for policy 1, policy_version 1043651 (0.0008) [2023-12-28 02:44:23,277][106226] Updated weights for policy 0, policy_version 1041073 (0.0006) [2023-12-28 02:44:23,305][106225] Updated weights for policy 1, policy_version 1043661 (0.0007) [2023-12-28 02:44:23,334][106226] Updated weights for policy 0, policy_version 1041083 (0.0007) [2023-12-28 02:44:23,363][106225] Updated weights for policy 1, policy_version 1043671 (0.0008) [2023-12-28 02:44:24,059][106226] Updated weights for policy 0, policy_version 1041093 (0.0007) [2023-12-28 02:44:24,094][106225] Updated weights for policy 1, policy_version 1043681 (0.0008) [2023-12-28 02:44:24,119][106226] Updated weights for policy 0, policy_version 1041103 (0.0009) [2023-12-28 02:44:24,156][106225] Updated weights for policy 1, policy_version 1043691 (0.0007) [2023-12-28 02:44:24,178][106226] Updated weights for policy 0, policy_version 1041113 (0.0008) [2023-12-28 02:44:24,217][106225] Updated weights for policy 1, policy_version 1043701 (0.0007) [2023-12-28 02:44:24,894][106225] Updated weights for policy 1, policy_version 1043711 (0.0008) [2023-12-28 02:44:24,914][106226] Updated weights for policy 0, policy_version 1041123 (0.0009) [2023-12-28 02:44:24,948][106225] Updated weights for policy 1, policy_version 1043721 (0.0006) [2023-12-28 02:44:24,968][106226] Updated weights for policy 0, policy_version 1041133 (0.0008) [2023-12-28 02:44:25,006][106225] Updated weights for policy 1, policy_version 1043731 (0.0008) [2023-12-28 02:44:25,019][106226] Updated weights for policy 0, policy_version 1041143 (0.0006) [2023-12-28 02:44:25,663][106226] Updated weights for policy 0, policy_version 1041153 (0.0007) [2023-12-28 02:44:25,699][106225] Updated weights for policy 1, policy_version 1043741 (0.0005) [2023-12-28 02:44:25,723][106226] Updated weights for policy 0, policy_version 1041163 (0.0010) [2023-12-28 02:44:25,753][106225] Updated weights for policy 1, policy_version 1043751 (0.0007) [2023-12-28 02:44:25,770][106226] Updated weights for policy 0, policy_version 1041173 (0.0010) [2023-12-28 02:44:25,809][106225] Updated weights for policy 1, policy_version 1043761 (0.0005) [2023-12-28 02:44:25,819][106226] Updated weights for policy 0, policy_version 1041183 (0.0010) [2023-12-28 02:44:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 533848064. Throughput: 0: 9643.1, 1: 9935.4. Samples: 533816660. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:26,176][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.957')] [2023-12-28 02:44:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001041184_266600448.pth... [2023-12-28 02:44:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001043768_267247616.pth... [2023-12-28 02:44:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001040064_266313728.pth [2023-12-28 02:44:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001042616_266952704.pth [2023-12-28 02:44:26,479][106226] Updated weights for policy 0, policy_version 1041193 (0.0007) [2023-12-28 02:44:26,529][106225] Updated weights for policy 1, policy_version 1043771 (0.0007) [2023-12-28 02:44:26,539][106226] Updated weights for policy 0, policy_version 1041203 (0.0006) [2023-12-28 02:44:26,578][106225] Updated weights for policy 1, policy_version 1043781 (0.0008) [2023-12-28 02:44:26,606][106226] Updated weights for policy 0, policy_version 1041213 (0.0005) [2023-12-28 02:44:26,631][106225] Updated weights for policy 1, policy_version 1043791 (0.0007) [2023-12-28 02:44:27,183][106226] Updated weights for policy 0, policy_version 1041223 (0.0009) [2023-12-28 02:44:27,233][106226] Updated weights for policy 0, policy_version 1041233 (0.0006) [2023-12-28 02:44:27,288][106226] Updated weights for policy 0, policy_version 1041243 (0.0005) [2023-12-28 02:44:27,354][106225] Updated weights for policy 1, policy_version 1043801 (0.0009) [2023-12-28 02:44:27,402][106225] Updated weights for policy 1, policy_version 1043811 (0.0008) [2023-12-28 02:44:27,458][106225] Updated weights for policy 1, policy_version 1043821 (0.0007) [2023-12-28 02:44:27,515][106225] Updated weights for policy 1, policy_version 1043831 (0.0008) [2023-12-28 02:44:27,922][106226] Updated weights for policy 0, policy_version 1041253 (0.0008) [2023-12-28 02:44:27,970][106226] Updated weights for policy 0, policy_version 1041263 (0.0005) [2023-12-28 02:44:28,028][106226] Updated weights for policy 0, policy_version 1041273 (0.0007) [2023-12-28 02:44:28,259][106225] Updated weights for policy 1, policy_version 1043841 (0.0008) [2023-12-28 02:44:28,314][106225] Updated weights for policy 1, policy_version 1043851 (0.0008) [2023-12-28 02:44:28,378][106225] Updated weights for policy 1, policy_version 1043861 (0.0007) [2023-12-28 02:44:28,653][106226] Updated weights for policy 0, policy_version 1041283 (0.0009) [2023-12-28 02:44:28,706][106226] Updated weights for policy 0, policy_version 1041293 (0.0005) [2023-12-28 02:44:28,766][106226] Updated weights for policy 0, policy_version 1041303 (0.0005) [2023-12-28 02:44:29,119][106225] Updated weights for policy 1, policy_version 1043871 (0.0007) [2023-12-28 02:44:29,173][106225] Updated weights for policy 1, policy_version 1043881 (0.0010) [2023-12-28 02:44:29,231][106225] Updated weights for policy 1, policy_version 1043891 (0.0010) [2023-12-28 02:44:29,467][106226] Updated weights for policy 0, policy_version 1041313 (0.0008) [2023-12-28 02:44:29,513][106226] Updated weights for policy 0, policy_version 1041323 (0.0007) [2023-12-28 02:44:29,563][106226] Updated weights for policy 0, policy_version 1041333 (0.0008) [2023-12-28 02:44:29,613][106226] Updated weights for policy 0, policy_version 1041343 (0.0008) [2023-12-28 02:44:29,996][106225] Updated weights for policy 1, policy_version 1043901 (0.0008) [2023-12-28 02:44:30,063][106225] Updated weights for policy 1, policy_version 1043911 (0.0006) [2023-12-28 02:44:30,125][106225] Updated weights for policy 1, policy_version 1043921 (0.0008) [2023-12-28 02:44:30,384][106226] Updated weights for policy 0, policy_version 1041353 (0.0007) [2023-12-28 02:44:30,444][106226] Updated weights for policy 0, policy_version 1041363 (0.0005) [2023-12-28 02:44:30,509][106226] Updated weights for policy 0, policy_version 1041373 (0.0005) [2023-12-28 02:44:30,788][106225] Updated weights for policy 1, policy_version 1043931 (0.0006) [2023-12-28 02:44:30,843][106225] Updated weights for policy 1, policy_version 1043941 (0.0005) [2023-12-28 02:44:30,897][106225] Updated weights for policy 1, policy_version 1043951 (0.0005) [2023-12-28 02:44:31,061][106226] Updated weights for policy 0, policy_version 1041383 (0.0007) [2023-12-28 02:44:31,121][106226] Updated weights for policy 0, policy_version 1041393 (0.0007) [2023-12-28 02:44:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 533946368. Throughput: 0: 9717.1, 1: 9953.1. Samples: 533936908. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:31,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.029')] [2023-12-28 02:44:31,191][106226] Updated weights for policy 0, policy_version 1041403 (0.0009) [2023-12-28 02:44:31,548][106225] Updated weights for policy 1, policy_version 1043961 (0.0005) [2023-12-28 02:44:31,606][106225] Updated weights for policy 1, policy_version 1043971 (0.0008) [2023-12-28 02:44:31,667][106225] Updated weights for policy 1, policy_version 1043981 (0.0009) [2023-12-28 02:44:31,731][106225] Updated weights for policy 1, policy_version 1043991 (0.0008) [2023-12-28 02:44:31,988][106226] Updated weights for policy 0, policy_version 1041413 (0.0009) [2023-12-28 02:44:32,048][106226] Updated weights for policy 0, policy_version 1041423 (0.0009) [2023-12-28 02:44:32,102][106226] Updated weights for policy 0, policy_version 1041433 (0.0009) [2023-12-28 02:44:32,462][106225] Updated weights for policy 1, policy_version 1044001 (0.0008) [2023-12-28 02:44:32,520][106225] Updated weights for policy 1, policy_version 1044011 (0.0007) [2023-12-28 02:44:32,577][106225] Updated weights for policy 1, policy_version 1044021 (0.0009) [2023-12-28 02:44:32,862][106226] Updated weights for policy 0, policy_version 1041443 (0.0008) [2023-12-28 02:44:32,918][106226] Updated weights for policy 0, policy_version 1041453 (0.0005) [2023-12-28 02:44:32,967][106226] Updated weights for policy 0, policy_version 1041463 (0.0008) [2023-12-28 02:44:33,310][106225] Updated weights for policy 1, policy_version 1044031 (0.0009) [2023-12-28 02:44:33,365][106225] Updated weights for policy 1, policy_version 1044041 (0.0008) [2023-12-28 02:44:33,446][106225] Updated weights for policy 1, policy_version 1044051 (0.0008) [2023-12-28 02:44:33,681][106226] Updated weights for policy 0, policy_version 1041473 (0.0008) [2023-12-28 02:44:33,736][106226] Updated weights for policy 0, policy_version 1041483 (0.0007) [2023-12-28 02:44:33,788][106226] Updated weights for policy 0, policy_version 1041493 (0.0009) [2023-12-28 02:44:33,842][106226] Updated weights for policy 0, policy_version 1041503 (0.0008) [2023-12-28 02:44:34,064][106225] Updated weights for policy 1, policy_version 1044061 (0.0007) [2023-12-28 02:44:34,119][106225] Updated weights for policy 1, policy_version 1044071 (0.0008) [2023-12-28 02:44:34,196][106225] Updated weights for policy 1, policy_version 1044081 (0.0008) [2023-12-28 02:44:34,592][106226] Updated weights for policy 0, policy_version 1041513 (0.0006) [2023-12-28 02:44:34,642][106226] Updated weights for policy 0, policy_version 1041523 (0.0008) [2023-12-28 02:44:34,703][106226] Updated weights for policy 0, policy_version 1041533 (0.0008) [2023-12-28 02:44:34,933][106225] Updated weights for policy 1, policy_version 1044091 (0.0008) [2023-12-28 02:44:34,986][106225] Updated weights for policy 1, policy_version 1044101 (0.0008) [2023-12-28 02:44:35,032][106225] Updated weights for policy 1, policy_version 1044111 (0.0008) [2023-12-28 02:44:35,377][106226] Updated weights for policy 0, policy_version 1041543 (0.0008) [2023-12-28 02:44:35,427][106226] Updated weights for policy 0, policy_version 1041553 (0.0006) [2023-12-28 02:44:35,473][106226] Updated weights for policy 0, policy_version 1041563 (0.0005) [2023-12-28 02:44:35,771][106225] Updated weights for policy 1, policy_version 1044121 (0.0008) [2023-12-28 02:44:35,833][106225] Updated weights for policy 1, policy_version 1044131 (0.0008) [2023-12-28 02:44:35,895][106225] Updated weights for policy 1, policy_version 1044141 (0.0008) [2023-12-28 02:44:35,955][106225] Updated weights for policy 1, policy_version 1044151 (0.0008) [2023-12-28 02:44:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 534044672. Throughput: 0: 9706.4, 1: 9897.5. Samples: 534055652. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:36,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.782')] [2023-12-28 02:44:36,186][106226] Updated weights for policy 0, policy_version 1041573 (0.0007) [2023-12-28 02:44:36,257][106226] Updated weights for policy 0, policy_version 1041583 (0.0006) [2023-12-28 02:44:36,324][106226] Updated weights for policy 0, policy_version 1041593 (0.0011) [2023-12-28 02:44:36,665][106225] Updated weights for policy 1, policy_version 1044161 (0.0008) [2023-12-28 02:44:36,712][106225] Updated weights for policy 1, policy_version 1044171 (0.0008) [2023-12-28 02:44:36,761][106225] Updated weights for policy 1, policy_version 1044181 (0.0008) [2023-12-28 02:44:37,015][106226] Updated weights for policy 0, policy_version 1041603 (0.0011) [2023-12-28 02:44:37,074][106226] Updated weights for policy 0, policy_version 1041613 (0.0011) [2023-12-28 02:44:37,131][106226] Updated weights for policy 0, policy_version 1041623 (0.0008) [2023-12-28 02:44:37,479][106225] Updated weights for policy 1, policy_version 1044191 (0.0006) [2023-12-28 02:44:37,533][106225] Updated weights for policy 1, policy_version 1044201 (0.0005) [2023-12-28 02:44:37,589][106225] Updated weights for policy 1, policy_version 1044211 (0.0007) [2023-12-28 02:44:37,857][106226] Updated weights for policy 0, policy_version 1041633 (0.0006) [2023-12-28 02:44:37,914][106226] Updated weights for policy 0, policy_version 1041643 (0.0005) [2023-12-28 02:44:37,974][106226] Updated weights for policy 0, policy_version 1041653 (0.0007) [2023-12-28 02:44:38,026][106226] Updated weights for policy 0, policy_version 1041663 (0.0008) [2023-12-28 02:44:38,214][106225] Updated weights for policy 1, policy_version 1044221 (0.0007) [2023-12-28 02:44:38,268][106225] Updated weights for policy 1, policy_version 1044231 (0.0008) [2023-12-28 02:44:38,324][106225] Updated weights for policy 1, policy_version 1044241 (0.0009) [2023-12-28 02:44:38,735][106226] Updated weights for policy 0, policy_version 1041673 (0.0008) [2023-12-28 02:44:38,798][106226] Updated weights for policy 0, policy_version 1041683 (0.0008) [2023-12-28 02:44:38,859][106226] Updated weights for policy 0, policy_version 1041693 (0.0009) [2023-12-28 02:44:39,014][106225] Updated weights for policy 1, policy_version 1044251 (0.0007) [2023-12-28 02:44:39,077][106225] Updated weights for policy 1, policy_version 1044261 (0.0006) [2023-12-28 02:44:39,135][106225] Updated weights for policy 1, policy_version 1044271 (0.0009) [2023-12-28 02:44:39,563][106226] Updated weights for policy 0, policy_version 1041703 (0.0009) [2023-12-28 02:44:39,626][106226] Updated weights for policy 0, policy_version 1041713 (0.0008) [2023-12-28 02:44:39,683][106226] Updated weights for policy 0, policy_version 1041723 (0.0008) [2023-12-28 02:44:39,859][106225] Updated weights for policy 1, policy_version 1044281 (0.0008) [2023-12-28 02:44:39,925][106225] Updated weights for policy 1, policy_version 1044291 (0.0011) [2023-12-28 02:44:39,992][106225] Updated weights for policy 1, policy_version 1044301 (0.0011) [2023-12-28 02:44:40,048][106225] Updated weights for policy 1, policy_version 1044311 (0.0010) [2023-12-28 02:44:40,453][106226] Updated weights for policy 0, policy_version 1041733 (0.0006) [2023-12-28 02:44:40,514][106226] Updated weights for policy 0, policy_version 1041743 (0.0006) [2023-12-28 02:44:40,576][106226] Updated weights for policy 0, policy_version 1041753 (0.0006) [2023-12-28 02:44:40,801][106225] Updated weights for policy 1, policy_version 1044321 (0.0010) [2023-12-28 02:44:40,857][106225] Updated weights for policy 1, policy_version 1044331 (0.0009) [2023-12-28 02:44:40,908][106225] Updated weights for policy 1, policy_version 1044341 (0.0005) [2023-12-28 02:44:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 534142976. Throughput: 0: 9679.8, 1: 9949.6. Samples: 534114588. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:41,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.669')] [2023-12-28 02:44:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001044344_267395072.pth... [2023-12-28 02:44:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001041760_266747904.pth... [2023-12-28 02:44:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001040608_266452992.pth [2023-12-28 02:44:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001043192_267100160.pth [2023-12-28 02:44:41,226][106226] Updated weights for policy 0, policy_version 1041763 (0.0009) [2023-12-28 02:44:41,288][106226] Updated weights for policy 0, policy_version 1041773 (0.0008) [2023-12-28 02:44:41,336][106226] Updated weights for policy 0, policy_version 1041783 (0.0009) [2023-12-28 02:44:41,620][106225] Updated weights for policy 1, policy_version 1044351 (0.0009) [2023-12-28 02:44:41,685][106225] Updated weights for policy 1, policy_version 1044361 (0.0007) [2023-12-28 02:44:41,760][106225] Updated weights for policy 1, policy_version 1044371 (0.0008) [2023-12-28 02:44:42,166][106226] Updated weights for policy 0, policy_version 1041793 (0.0008) [2023-12-28 02:44:42,232][106226] Updated weights for policy 0, policy_version 1041803 (0.0009) [2023-12-28 02:44:42,298][106226] Updated weights for policy 0, policy_version 1041813 (0.0009) [2023-12-28 02:44:42,369][106226] Updated weights for policy 0, policy_version 1041823 (0.0009) [2023-12-28 02:44:42,379][106225] Updated weights for policy 1, policy_version 1044381 (0.0008) [2023-12-28 02:44:42,445][106225] Updated weights for policy 1, policy_version 1044391 (0.0009) [2023-12-28 02:44:42,513][106225] Updated weights for policy 1, policy_version 1044401 (0.0010) [2023-12-28 02:44:43,117][106226] Updated weights for policy 0, policy_version 1041833 (0.0008) [2023-12-28 02:44:43,188][106226] Updated weights for policy 0, policy_version 1041843 (0.0008) [2023-12-28 02:44:43,215][106225] Updated weights for policy 1, policy_version 1044411 (0.0010) [2023-12-28 02:44:43,235][106226] Updated weights for policy 0, policy_version 1041853 (0.0007) [2023-12-28 02:44:43,265][106225] Updated weights for policy 1, policy_version 1044421 (0.0010) [2023-12-28 02:44:43,312][106225] Updated weights for policy 1, policy_version 1044431 (0.0010) [2023-12-28 02:44:43,912][106226] Updated weights for policy 0, policy_version 1041863 (0.0009) [2023-12-28 02:44:43,962][106226] Updated weights for policy 0, policy_version 1041873 (0.0009) [2023-12-28 02:44:44,012][106226] Updated weights for policy 0, policy_version 1041883 (0.0009) [2023-12-28 02:44:44,038][106225] Updated weights for policy 1, policy_version 1044441 (0.0010) [2023-12-28 02:44:44,099][106225] Updated weights for policy 1, policy_version 1044451 (0.0008) [2023-12-28 02:44:44,154][106225] Updated weights for policy 1, policy_version 1044461 (0.0008) [2023-12-28 02:44:44,213][106225] Updated weights for policy 1, policy_version 1044471 (0.0009) [2023-12-28 02:44:44,747][106226] Updated weights for policy 0, policy_version 1041893 (0.0008) [2023-12-28 02:44:44,810][106226] Updated weights for policy 0, policy_version 1041903 (0.0010) [2023-12-28 02:44:44,870][106226] Updated weights for policy 0, policy_version 1041913 (0.0007) [2023-12-28 02:44:44,955][106225] Updated weights for policy 1, policy_version 1044481 (0.0008) [2023-12-28 02:44:45,019][106225] Updated weights for policy 1, policy_version 1044491 (0.0008) [2023-12-28 02:44:45,077][106225] Updated weights for policy 1, policy_version 1044501 (0.0008) [2023-12-28 02:44:45,598][106226] Updated weights for policy 0, policy_version 1041923 (0.0009) [2023-12-28 02:44:45,661][106226] Updated weights for policy 0, policy_version 1041933 (0.0009) [2023-12-28 02:44:45,722][106226] Updated weights for policy 0, policy_version 1041943 (0.0011) [2023-12-28 02:44:45,804][106225] Updated weights for policy 1, policy_version 1044511 (0.0006) [2023-12-28 02:44:45,865][106225] Updated weights for policy 1, policy_version 1044521 (0.0008) [2023-12-28 02:44:45,931][106225] Updated weights for policy 1, policy_version 1044531 (0.0008) [2023-12-28 02:44:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 534241280. Throughput: 0: 9696.1, 1: 9862.1. Samples: 534229684. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:46,176][105115] Avg episode reward: [(0, '-4.635'), (1, '-5.040')] [2023-12-28 02:44:46,362][106226] Updated weights for policy 0, policy_version 1041953 (0.0010) [2023-12-28 02:44:46,433][106226] Updated weights for policy 0, policy_version 1041963 (0.0009) [2023-12-28 02:44:46,494][106226] Updated weights for policy 0, policy_version 1041973 (0.0011) [2023-12-28 02:44:46,564][106226] Updated weights for policy 0, policy_version 1041983 (0.0011) [2023-12-28 02:44:46,657][106225] Updated weights for policy 1, policy_version 1044541 (0.0008) [2023-12-28 02:44:46,716][106225] Updated weights for policy 1, policy_version 1044551 (0.0007) [2023-12-28 02:44:46,773][106225] Updated weights for policy 1, policy_version 1044561 (0.0005) [2023-12-28 02:44:47,129][106226] Updated weights for policy 0, policy_version 1041993 (0.0010) [2023-12-28 02:44:47,199][106226] Updated weights for policy 0, policy_version 1042003 (0.0006) [2023-12-28 02:44:47,262][106226] Updated weights for policy 0, policy_version 1042013 (0.0007) [2023-12-28 02:44:47,360][106225] Updated weights for policy 1, policy_version 1044571 (0.0005) [2023-12-28 02:44:47,414][106225] Updated weights for policy 1, policy_version 1044581 (0.0005) [2023-12-28 02:44:47,464][106225] Updated weights for policy 1, policy_version 1044591 (0.0005) [2023-12-28 02:44:47,910][106226] Updated weights for policy 0, policy_version 1042023 (0.0011) [2023-12-28 02:44:47,971][106226] Updated weights for policy 0, policy_version 1042033 (0.0011) [2023-12-28 02:44:47,999][106225] Updated weights for policy 1, policy_version 1044601 (0.0005) [2023-12-28 02:44:48,025][106226] Updated weights for policy 0, policy_version 1042043 (0.0011) [2023-12-28 02:44:48,063][106225] Updated weights for policy 1, policy_version 1044611 (0.0005) [2023-12-28 02:44:48,131][106225] Updated weights for policy 1, policy_version 1044621 (0.0006) [2023-12-28 02:44:48,186][106225] Updated weights for policy 1, policy_version 1044631 (0.0009) [2023-12-28 02:44:48,711][106226] Updated weights for policy 0, policy_version 1042053 (0.0010) [2023-12-28 02:44:48,775][106226] Updated weights for policy 0, policy_version 1042063 (0.0011) [2023-12-28 02:44:48,841][106226] Updated weights for policy 0, policy_version 1042073 (0.0011) [2023-12-28 02:44:48,889][106225] Updated weights for policy 1, policy_version 1044641 (0.0008) [2023-12-28 02:44:48,946][106225] Updated weights for policy 1, policy_version 1044651 (0.0008) [2023-12-28 02:44:49,014][106225] Updated weights for policy 1, policy_version 1044661 (0.0007) [2023-12-28 02:44:49,531][106226] Updated weights for policy 0, policy_version 1042083 (0.0011) [2023-12-28 02:44:49,585][106226] Updated weights for policy 0, policy_version 1042093 (0.0011) [2023-12-28 02:44:49,645][106226] Updated weights for policy 0, policy_version 1042103 (0.0011) [2023-12-28 02:44:49,700][106225] Updated weights for policy 1, policy_version 1044671 (0.0009) [2023-12-28 02:44:49,751][106225] Updated weights for policy 1, policy_version 1044681 (0.0010) [2023-12-28 02:44:49,810][106225] Updated weights for policy 1, policy_version 1044691 (0.0010) [2023-12-28 02:44:50,356][106226] Updated weights for policy 0, policy_version 1042113 (0.0010) [2023-12-28 02:44:50,415][106226] Updated weights for policy 0, policy_version 1042123 (0.0010) [2023-12-28 02:44:50,472][106226] Updated weights for policy 0, policy_version 1042133 (0.0011) [2023-12-28 02:44:50,517][106226] Updated weights for policy 0, policy_version 1042143 (0.0010) [2023-12-28 02:44:50,536][106225] Updated weights for policy 1, policy_version 1044701 (0.0007) [2023-12-28 02:44:50,603][106225] Updated weights for policy 1, policy_version 1044711 (0.0006) [2023-12-28 02:44:50,657][106225] Updated weights for policy 1, policy_version 1044721 (0.0010) [2023-12-28 02:44:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 534339584. Throughput: 0: 9758.4, 1: 9904.5. Samples: 534351800. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:51,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-4.913')] [2023-12-28 02:44:51,255][106226] Updated weights for policy 0, policy_version 1042153 (0.0011) [2023-12-28 02:44:51,317][106226] Updated weights for policy 0, policy_version 1042163 (0.0010) [2023-12-28 02:44:51,341][106225] Updated weights for policy 1, policy_version 1044731 (0.0010) [2023-12-28 02:44:51,379][106226] Updated weights for policy 0, policy_version 1042173 (0.0011) [2023-12-28 02:44:51,415][106225] Updated weights for policy 1, policy_version 1044741 (0.0008) [2023-12-28 02:44:51,478][106225] Updated weights for policy 1, policy_version 1044751 (0.0006) [2023-12-28 02:44:52,101][106226] Updated weights for policy 0, policy_version 1042183 (0.0010) [2023-12-28 02:44:52,165][106226] Updated weights for policy 0, policy_version 1042193 (0.0010) [2023-12-28 02:44:52,171][106225] Updated weights for policy 1, policy_version 1044761 (0.0006) [2023-12-28 02:44:52,220][106226] Updated weights for policy 0, policy_version 1042203 (0.0009) [2023-12-28 02:44:52,234][106225] Updated weights for policy 1, policy_version 1044771 (0.0007) [2023-12-28 02:44:52,300][106225] Updated weights for policy 1, policy_version 1044781 (0.0007) [2023-12-28 02:44:52,367][106225] Updated weights for policy 1, policy_version 1044791 (0.0008) [2023-12-28 02:44:52,937][106226] Updated weights for policy 0, policy_version 1042213 (0.0008) [2023-12-28 02:44:53,005][106226] Updated weights for policy 0, policy_version 1042223 (0.0005) [2023-12-28 02:44:53,041][106225] Updated weights for policy 1, policy_version 1044801 (0.0008) [2023-12-28 02:44:53,061][106226] Updated weights for policy 0, policy_version 1042233 (0.0005) [2023-12-28 02:44:53,089][106225] Updated weights for policy 1, policy_version 1044811 (0.0008) [2023-12-28 02:44:53,135][106225] Updated weights for policy 1, policy_version 1044821 (0.0007) [2023-12-28 02:44:53,707][106226] Updated weights for policy 0, policy_version 1042243 (0.0010) [2023-12-28 02:44:53,769][106226] Updated weights for policy 0, policy_version 1042253 (0.0011) [2023-12-28 02:44:53,822][106226] Updated weights for policy 0, policy_version 1042263 (0.0010) [2023-12-28 02:44:53,872][106225] Updated weights for policy 1, policy_version 1044831 (0.0006) [2023-12-28 02:44:53,924][106225] Updated weights for policy 1, policy_version 1044841 (0.0006) [2023-12-28 02:44:53,982][106225] Updated weights for policy 1, policy_version 1044851 (0.0006) [2023-12-28 02:44:54,401][106226] Updated weights for policy 0, policy_version 1042273 (0.0008) [2023-12-28 02:44:54,460][106226] Updated weights for policy 0, policy_version 1042283 (0.0010) [2023-12-28 02:44:54,528][106226] Updated weights for policy 0, policy_version 1042293 (0.0011) [2023-12-28 02:44:54,556][106225] Updated weights for policy 1, policy_version 1044861 (0.0005) [2023-12-28 02:44:54,582][106226] Updated weights for policy 0, policy_version 1042303 (0.0011) [2023-12-28 02:44:54,606][106225] Updated weights for policy 1, policy_version 1044871 (0.0006) [2023-12-28 02:44:54,652][106225] Updated weights for policy 1, policy_version 1044881 (0.0007) [2023-12-28 02:44:55,197][106226] Updated weights for policy 0, policy_version 1042313 (0.0008) [2023-12-28 02:44:55,256][106226] Updated weights for policy 0, policy_version 1042323 (0.0010) [2023-12-28 02:44:55,323][106226] Updated weights for policy 0, policy_version 1042333 (0.0011) [2023-12-28 02:44:55,423][106225] Updated weights for policy 1, policy_version 1044891 (0.0007) [2023-12-28 02:44:55,485][106225] Updated weights for policy 1, policy_version 1044901 (0.0009) [2023-12-28 02:44:55,544][106225] Updated weights for policy 1, policy_version 1044911 (0.0010) [2023-12-28 02:44:56,037][106226] Updated weights for policy 0, policy_version 1042343 (0.0011) [2023-12-28 02:44:56,097][106226] Updated weights for policy 0, policy_version 1042353 (0.0010) [2023-12-28 02:44:56,151][106226] Updated weights for policy 0, policy_version 1042363 (0.0005) [2023-12-28 02:44:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19883.0). Total num frames: 534437888. Throughput: 0: 9799.8, 1: 9890.5. Samples: 534411204. Policy #0 lag: (min: 26.0, avg: 39.5, max: 58.0) [2023-12-28 02:44:56,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.581')] [2023-12-28 02:44:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001042368_266903552.pth... [2023-12-28 02:44:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001044920_267542528.pth... [2023-12-28 02:44:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001041184_266600448.pth [2023-12-28 02:44:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001043768_267247616.pth [2023-12-28 02:44:56,224][106225] Updated weights for policy 1, policy_version 1044921 (0.0010) [2023-12-28 02:44:56,273][106225] Updated weights for policy 1, policy_version 1044931 (0.0010) [2023-12-28 02:44:56,337][106225] Updated weights for policy 1, policy_version 1044941 (0.0008) [2023-12-28 02:44:56,391][106225] Updated weights for policy 1, policy_version 1044951 (0.0010) [2023-12-28 02:44:56,714][106226] Updated weights for policy 0, policy_version 1042373 (0.0007) [2023-12-28 02:44:56,776][106226] Updated weights for policy 0, policy_version 1042383 (0.0008) [2023-12-28 02:44:56,824][106226] Updated weights for policy 0, policy_version 1042393 (0.0008) [2023-12-28 02:44:57,111][106225] Updated weights for policy 1, policy_version 1044961 (0.0008) [2023-12-28 02:44:57,163][106225] Updated weights for policy 1, policy_version 1044971 (0.0008) [2023-12-28 02:44:57,214][106225] Updated weights for policy 1, policy_version 1044981 (0.0008) [2023-12-28 02:44:57,547][106226] Updated weights for policy 0, policy_version 1042403 (0.0008) [2023-12-28 02:44:57,596][106226] Updated weights for policy 0, policy_version 1042413 (0.0009) [2023-12-28 02:44:57,644][106226] Updated weights for policy 0, policy_version 1042423 (0.0008) [2023-12-28 02:44:57,962][106225] Updated weights for policy 1, policy_version 1044991 (0.0009) [2023-12-28 02:44:58,019][106225] Updated weights for policy 1, policy_version 1045001 (0.0009) [2023-12-28 02:44:58,072][106225] Updated weights for policy 1, policy_version 1045011 (0.0005) [2023-12-28 02:44:58,263][106226] Updated weights for policy 0, policy_version 1042433 (0.0008) [2023-12-28 02:44:58,341][106226] Updated weights for policy 0, policy_version 1042443 (0.0008) [2023-12-28 02:44:58,405][106226] Updated weights for policy 0, policy_version 1042453 (0.0009) [2023-12-28 02:44:58,501][106226] Updated weights for policy 0, policy_version 1042463 (0.0010) [2023-12-28 02:44:58,817][106225] Updated weights for policy 1, policy_version 1045021 (0.0007) [2023-12-28 02:44:58,883][106225] Updated weights for policy 1, policy_version 1045031 (0.0008) [2023-12-28 02:44:58,952][106225] Updated weights for policy 1, policy_version 1045041 (0.0007) [2023-12-28 02:44:59,269][106226] Updated weights for policy 0, policy_version 1042473 (0.0009) [2023-12-28 02:44:59,335][106226] Updated weights for policy 0, policy_version 1042483 (0.0009) [2023-12-28 02:44:59,409][106226] Updated weights for policy 0, policy_version 1042494 (0.0010) [2023-12-28 02:44:59,696][106225] Updated weights for policy 1, policy_version 1045051 (0.0007) [2023-12-28 02:44:59,747][106225] Updated weights for policy 1, policy_version 1045061 (0.0009) [2023-12-28 02:44:59,797][106225] Updated weights for policy 1, policy_version 1045071 (0.0008) [2023-12-28 02:45:00,085][106226] Updated weights for policy 0, policy_version 1042504 (0.0009) [2023-12-28 02:45:00,137][106226] Updated weights for policy 0, policy_version 1042514 (0.0007) [2023-12-28 02:45:00,198][106226] Updated weights for policy 0, policy_version 1042524 (0.0006) [2023-12-28 02:45:00,542][106225] Updated weights for policy 1, policy_version 1045081 (0.0009) [2023-12-28 02:45:00,610][106225] Updated weights for policy 1, policy_version 1045091 (0.0009) [2023-12-28 02:45:00,656][106225] Updated weights for policy 1, policy_version 1045101 (0.0005) [2023-12-28 02:45:00,711][106225] Updated weights for policy 1, policy_version 1045111 (0.0009) [2023-12-28 02:45:00,878][106226] Updated weights for policy 0, policy_version 1042534 (0.0007) [2023-12-28 02:45:00,926][106226] Updated weights for policy 0, policy_version 1042544 (0.0008) [2023-12-28 02:45:00,974][106226] Updated weights for policy 0, policy_version 1042554 (0.0007) [2023-12-28 02:45:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 534544384. Throughput: 0: 9957.5, 1: 9872.0. Samples: 534532264. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:01,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-5.110')] [2023-12-28 02:45:01,401][106225] Updated weights for policy 1, policy_version 1045121 (0.0008) [2023-12-28 02:45:01,450][106225] Updated weights for policy 1, policy_version 1045131 (0.0007) [2023-12-28 02:45:01,502][106225] Updated weights for policy 1, policy_version 1045141 (0.0005) [2023-12-28 02:45:01,754][106226] Updated weights for policy 0, policy_version 1042564 (0.0007) [2023-12-28 02:45:01,811][106226] Updated weights for policy 0, policy_version 1042574 (0.0008) [2023-12-28 02:45:01,881][106226] Updated weights for policy 0, policy_version 1042584 (0.0007) [2023-12-28 02:45:02,191][106225] Updated weights for policy 1, policy_version 1045151 (0.0007) [2023-12-28 02:45:02,248][106225] Updated weights for policy 1, policy_version 1045161 (0.0007) [2023-12-28 02:45:02,299][106225] Updated weights for policy 1, policy_version 1045171 (0.0008) [2023-12-28 02:45:02,529][106226] Updated weights for policy 0, policy_version 1042594 (0.0009) [2023-12-28 02:45:02,585][106226] Updated weights for policy 0, policy_version 1042604 (0.0009) [2023-12-28 02:45:02,630][106226] Updated weights for policy 0, policy_version 1042614 (0.0008) [2023-12-28 02:45:02,676][106226] Updated weights for policy 0, policy_version 1042624 (0.0008) [2023-12-28 02:45:03,036][106225] Updated weights for policy 1, policy_version 1045181 (0.0008) [2023-12-28 02:45:03,081][106225] Updated weights for policy 1, policy_version 1045191 (0.0008) [2023-12-28 02:45:03,129][106225] Updated weights for policy 1, policy_version 1045201 (0.0008) [2023-12-28 02:45:03,404][106226] Updated weights for policy 0, policy_version 1042634 (0.0008) [2023-12-28 02:45:03,453][106226] Updated weights for policy 0, policy_version 1042644 (0.0008) [2023-12-28 02:45:03,504][106226] Updated weights for policy 0, policy_version 1042654 (0.0008) [2023-12-28 02:45:03,862][106225] Updated weights for policy 1, policy_version 1045211 (0.0007) [2023-12-28 02:45:03,925][106225] Updated weights for policy 1, policy_version 1045221 (0.0007) [2023-12-28 02:45:03,988][106225] Updated weights for policy 1, policy_version 1045231 (0.0008) [2023-12-28 02:45:04,297][106226] Updated weights for policy 0, policy_version 1042664 (0.0009) [2023-12-28 02:45:04,359][106226] Updated weights for policy 0, policy_version 1042674 (0.0009) [2023-12-28 02:45:04,419][106226] Updated weights for policy 0, policy_version 1042684 (0.0010) [2023-12-28 02:45:04,675][106225] Updated weights for policy 1, policy_version 1045241 (0.0009) [2023-12-28 02:45:04,727][106225] Updated weights for policy 1, policy_version 1045251 (0.0008) [2023-12-28 02:45:04,781][106225] Updated weights for policy 1, policy_version 1045261 (0.0006) [2023-12-28 02:45:04,836][106225] Updated weights for policy 1, policy_version 1045271 (0.0006) [2023-12-28 02:45:05,190][106226] Updated weights for policy 0, policy_version 1042694 (0.0007) [2023-12-28 02:45:05,247][106226] Updated weights for policy 0, policy_version 1042704 (0.0008) [2023-12-28 02:45:05,304][106226] Updated weights for policy 0, policy_version 1042714 (0.0008) [2023-12-28 02:45:05,481][106225] Updated weights for policy 1, policy_version 1045281 (0.0005) [2023-12-28 02:45:05,527][106225] Updated weights for policy 1, policy_version 1045291 (0.0005) [2023-12-28 02:45:05,581][106225] Updated weights for policy 1, policy_version 1045301 (0.0008) [2023-12-28 02:45:05,885][106226] Updated weights for policy 0, policy_version 1042724 (0.0008) [2023-12-28 02:45:05,949][106226] Updated weights for policy 0, policy_version 1042734 (0.0009) [2023-12-28 02:45:06,018][106226] Updated weights for policy 0, policy_version 1042744 (0.0010) [2023-12-28 02:45:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 534642688. Throughput: 0: 9953.6, 1: 9850.7. Samples: 534651052. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:06,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.202')] [2023-12-28 02:45:06,297][106225] Updated weights for policy 1, policy_version 1045311 (0.0008) [2023-12-28 02:45:06,367][106225] Updated weights for policy 1, policy_version 1045321 (0.0009) [2023-12-28 02:45:06,428][106225] Updated weights for policy 1, policy_version 1045331 (0.0007) [2023-12-28 02:45:06,722][106226] Updated weights for policy 0, policy_version 1042754 (0.0011) [2023-12-28 02:45:06,791][106226] Updated weights for policy 0, policy_version 1042764 (0.0011) [2023-12-28 02:45:06,861][106226] Updated weights for policy 0, policy_version 1042774 (0.0011) [2023-12-28 02:45:06,925][106226] Updated weights for policy 0, policy_version 1042784 (0.0011) [2023-12-28 02:45:07,055][106225] Updated weights for policy 1, policy_version 1045341 (0.0008) [2023-12-28 02:45:07,120][106225] Updated weights for policy 1, policy_version 1045351 (0.0009) [2023-12-28 02:45:07,175][106225] Updated weights for policy 1, policy_version 1045361 (0.0009) [2023-12-28 02:45:07,477][106226] Updated weights for policy 0, policy_version 1042794 (0.0009) [2023-12-28 02:45:07,528][106226] Updated weights for policy 0, policy_version 1042804 (0.0011) [2023-12-28 02:45:07,580][106226] Updated weights for policy 0, policy_version 1042814 (0.0011) [2023-12-28 02:45:07,935][106225] Updated weights for policy 1, policy_version 1045371 (0.0007) [2023-12-28 02:45:07,987][106225] Updated weights for policy 1, policy_version 1045381 (0.0006) [2023-12-28 02:45:08,043][106225] Updated weights for policy 1, policy_version 1045391 (0.0006) [2023-12-28 02:45:08,295][106226] Updated weights for policy 0, policy_version 1042824 (0.0007) [2023-12-28 02:45:08,377][106226] Updated weights for policy 0, policy_version 1042837 (0.0007) [2023-12-28 02:45:08,440][106226] Updated weights for policy 0, policy_version 1042847 (0.0008) [2023-12-28 02:45:08,714][106225] Updated weights for policy 1, policy_version 1045401 (0.0006) [2023-12-28 02:45:08,763][106225] Updated weights for policy 1, policy_version 1045411 (0.0007) [2023-12-28 02:45:08,826][106225] Updated weights for policy 1, policy_version 1045421 (0.0009) [2023-12-28 02:45:08,892][106225] Updated weights for policy 1, policy_version 1045431 (0.0008) [2023-12-28 02:45:09,114][106226] Updated weights for policy 0, policy_version 1042857 (0.0006) [2023-12-28 02:45:09,183][106226] Updated weights for policy 0, policy_version 1042867 (0.0005) [2023-12-28 02:45:09,251][106226] Updated weights for policy 0, policy_version 1042877 (0.0007) [2023-12-28 02:45:09,560][106225] Updated weights for policy 1, policy_version 1045441 (0.0010) [2023-12-28 02:45:09,628][106225] Updated weights for policy 1, policy_version 1045451 (0.0011) [2023-12-28 02:45:09,684][106225] Updated weights for policy 1, policy_version 1045461 (0.0010) [2023-12-28 02:45:09,929][106226] Updated weights for policy 0, policy_version 1042887 (0.0010) [2023-12-28 02:45:09,984][106226] Updated weights for policy 0, policy_version 1042897 (0.0007) [2023-12-28 02:45:10,042][106226] Updated weights for policy 0, policy_version 1042907 (0.0010) [2023-12-28 02:45:10,374][106225] Updated weights for policy 1, policy_version 1045471 (0.0009) [2023-12-28 02:45:10,443][106225] Updated weights for policy 1, policy_version 1045481 (0.0009) [2023-12-28 02:45:10,506][106225] Updated weights for policy 1, policy_version 1045491 (0.0008) [2023-12-28 02:45:10,802][106226] Updated weights for policy 0, policy_version 1042917 (0.0009) [2023-12-28 02:45:10,858][106226] Updated weights for policy 0, policy_version 1042927 (0.0008) [2023-12-28 02:45:10,913][106226] Updated weights for policy 0, policy_version 1042937 (0.0008) [2023-12-28 02:45:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 534740992. Throughput: 0: 10005.3, 1: 9887.3. Samples: 534711820. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:11,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.985')] [2023-12-28 02:45:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001042944_267051008.pth... [2023-12-28 02:45:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001045496_267689984.pth... [2023-12-28 02:45:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001044344_267395072.pth [2023-12-28 02:45:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001041760_266747904.pth [2023-12-28 02:45:11,256][106225] Updated weights for policy 1, policy_version 1045501 (0.0007) [2023-12-28 02:45:11,326][106225] Updated weights for policy 1, policy_version 1045511 (0.0009) [2023-12-28 02:45:11,397][106225] Updated weights for policy 1, policy_version 1045521 (0.0009) [2023-12-28 02:45:11,623][106226] Updated weights for policy 0, policy_version 1042947 (0.0009) [2023-12-28 02:45:11,692][106226] Updated weights for policy 0, policy_version 1042957 (0.0008) [2023-12-28 02:45:11,760][106226] Updated weights for policy 0, policy_version 1042967 (0.0008) [2023-12-28 02:45:12,262][106225] Updated weights for policy 1, policy_version 1045531 (0.0008) [2023-12-28 02:45:12,321][106225] Updated weights for policy 1, policy_version 1045541 (0.0008) [2023-12-28 02:45:12,387][106225] Updated weights for policy 1, policy_version 1045551 (0.0009) [2023-12-28 02:45:12,448][106226] Updated weights for policy 0, policy_version 1042977 (0.0007) [2023-12-28 02:45:12,516][106226] Updated weights for policy 0, policy_version 1042987 (0.0009) [2023-12-28 02:45:12,579][106226] Updated weights for policy 0, policy_version 1042997 (0.0008) [2023-12-28 02:45:12,645][106226] Updated weights for policy 0, policy_version 1043007 (0.0008) [2023-12-28 02:45:13,072][106225] Updated weights for policy 1, policy_version 1045561 (0.0008) [2023-12-28 02:45:13,136][106225] Updated weights for policy 1, policy_version 1045571 (0.0005) [2023-12-28 02:45:13,194][106225] Updated weights for policy 1, policy_version 1045581 (0.0005) [2023-12-28 02:45:13,253][106225] Updated weights for policy 1, policy_version 1045591 (0.0005) [2023-12-28 02:45:13,408][106226] Updated weights for policy 0, policy_version 1043017 (0.0008) [2023-12-28 02:45:13,456][106226] Updated weights for policy 0, policy_version 1043027 (0.0008) [2023-12-28 02:45:13,506][106226] Updated weights for policy 0, policy_version 1043037 (0.0008) [2023-12-28 02:45:13,751][106225] Updated weights for policy 1, policy_version 1045601 (0.0005) [2023-12-28 02:45:13,807][106225] Updated weights for policy 1, policy_version 1045611 (0.0005) [2023-12-28 02:45:13,861][106225] Updated weights for policy 1, policy_version 1045621 (0.0005) [2023-12-28 02:45:14,316][106226] Updated weights for policy 0, policy_version 1043047 (0.0008) [2023-12-28 02:45:14,363][106226] Updated weights for policy 0, policy_version 1043057 (0.0008) [2023-12-28 02:45:14,405][106226] Updated weights for policy 0, policy_version 1043067 (0.0005) [2023-12-28 02:45:14,484][106225] Updated weights for policy 1, policy_version 1045631 (0.0006) [2023-12-28 02:45:14,528][106225] Updated weights for policy 1, policy_version 1045641 (0.0006) [2023-12-28 02:45:14,583][106225] Updated weights for policy 1, policy_version 1045651 (0.0005) [2023-12-28 02:45:15,151][106226] Updated weights for policy 0, policy_version 1043077 (0.0007) [2023-12-28 02:45:15,217][106226] Updated weights for policy 0, policy_version 1043087 (0.0009) [2023-12-28 02:45:15,272][106226] Updated weights for policy 0, policy_version 1043097 (0.0008) [2023-12-28 02:45:15,278][106225] Updated weights for policy 1, policy_version 1045661 (0.0007) [2023-12-28 02:45:15,338][106225] Updated weights for policy 1, policy_version 1045671 (0.0008) [2023-12-28 02:45:15,398][106225] Updated weights for policy 1, policy_version 1045681 (0.0008) [2023-12-28 02:45:15,874][106226] Updated weights for policy 0, policy_version 1043107 (0.0009) [2023-12-28 02:45:15,934][106226] Updated weights for policy 0, policy_version 1043117 (0.0010) [2023-12-28 02:45:15,989][106226] Updated weights for policy 0, policy_version 1043127 (0.0008) [2023-12-28 02:45:16,103][106225] Updated weights for policy 1, policy_version 1045691 (0.0008) [2023-12-28 02:45:16,151][106225] Updated weights for policy 1, policy_version 1045701 (0.0008) [2023-12-28 02:45:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 534839296. Throughput: 0: 9877.9, 1: 9942.3. Samples: 534828816. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:16,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-4.814')] [2023-12-28 02:45:16,216][106225] Updated weights for policy 1, policy_version 1045711 (0.0008) [2023-12-28 02:45:16,715][106226] Updated weights for policy 0, policy_version 1043137 (0.0008) [2023-12-28 02:45:16,781][106226] Updated weights for policy 0, policy_version 1043147 (0.0009) [2023-12-28 02:45:16,843][106226] Updated weights for policy 0, policy_version 1043157 (0.0008) [2023-12-28 02:45:16,896][106226] Updated weights for policy 0, policy_version 1043167 (0.0007) [2023-12-28 02:45:16,965][106225] Updated weights for policy 1, policy_version 1045721 (0.0009) [2023-12-28 02:45:17,024][106225] Updated weights for policy 1, policy_version 1045731 (0.0006) [2023-12-28 02:45:17,072][106225] Updated weights for policy 1, policy_version 1045741 (0.0008) [2023-12-28 02:45:17,124][106225] Updated weights for policy 1, policy_version 1045751 (0.0008) [2023-12-28 02:45:17,572][106226] Updated weights for policy 0, policy_version 1043177 (0.0011) [2023-12-28 02:45:17,629][106226] Updated weights for policy 0, policy_version 1043187 (0.0010) [2023-12-28 02:45:17,686][106226] Updated weights for policy 0, policy_version 1043197 (0.0010) [2023-12-28 02:45:17,797][106225] Updated weights for policy 1, policy_version 1045761 (0.0008) [2023-12-28 02:45:17,857][106225] Updated weights for policy 1, policy_version 1045771 (0.0008) [2023-12-28 02:45:17,919][106225] Updated weights for policy 1, policy_version 1045781 (0.0008) [2023-12-28 02:45:18,366][106226] Updated weights for policy 0, policy_version 1043207 (0.0009) [2023-12-28 02:45:18,425][106226] Updated weights for policy 0, policy_version 1043217 (0.0008) [2023-12-28 02:45:18,480][106226] Updated weights for policy 0, policy_version 1043227 (0.0009) [2023-12-28 02:45:18,647][106225] Updated weights for policy 1, policy_version 1045791 (0.0009) [2023-12-28 02:45:18,702][106225] Updated weights for policy 1, policy_version 1045801 (0.0008) [2023-12-28 02:45:18,764][106225] Updated weights for policy 1, policy_version 1045811 (0.0008) [2023-12-28 02:45:19,214][106226] Updated weights for policy 0, policy_version 1043237 (0.0011) [2023-12-28 02:45:19,281][106226] Updated weights for policy 0, policy_version 1043247 (0.0010) [2023-12-28 02:45:19,357][106226] Updated weights for policy 0, policy_version 1043257 (0.0010) [2023-12-28 02:45:19,524][106225] Updated weights for policy 1, policy_version 1045821 (0.0008) [2023-12-28 02:45:19,582][106225] Updated weights for policy 1, policy_version 1045831 (0.0008) [2023-12-28 02:45:19,639][106225] Updated weights for policy 1, policy_version 1045841 (0.0008) [2023-12-28 02:45:20,074][106226] Updated weights for policy 0, policy_version 1043267 (0.0009) [2023-12-28 02:45:20,140][106226] Updated weights for policy 0, policy_version 1043277 (0.0011) [2023-12-28 02:45:20,207][106226] Updated weights for policy 0, policy_version 1043287 (0.0011) [2023-12-28 02:45:20,382][106225] Updated weights for policy 1, policy_version 1045851 (0.0010) [2023-12-28 02:45:20,432][106225] Updated weights for policy 1, policy_version 1045861 (0.0009) [2023-12-28 02:45:20,499][106225] Updated weights for policy 1, policy_version 1045871 (0.0005) [2023-12-28 02:45:20,927][106226] Updated weights for policy 0, policy_version 1043297 (0.0010) [2023-12-28 02:45:20,991][106226] Updated weights for policy 0, policy_version 1043307 (0.0006) [2023-12-28 02:45:21,078][106226] Updated weights for policy 0, policy_version 1043317 (0.0007) [2023-12-28 02:45:21,141][106226] Updated weights for policy 0, policy_version 1043327 (0.0007) [2023-12-28 02:45:21,157][106225] Updated weights for policy 1, policy_version 1045881 (0.0006) [2023-12-28 02:45:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 534937600. Throughput: 0: 9871.7, 1: 9937.7. Samples: 534947072. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:21,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-5.029')] [2023-12-28 02:45:21,211][106225] Updated weights for policy 1, policy_version 1045891 (0.0009) [2023-12-28 02:45:21,269][106225] Updated weights for policy 1, policy_version 1045901 (0.0009) [2023-12-28 02:45:21,323][106225] Updated weights for policy 1, policy_version 1045911 (0.0009) [2023-12-28 02:45:21,911][106226] Updated weights for policy 0, policy_version 1043337 (0.0008) [2023-12-28 02:45:21,976][106226] Updated weights for policy 0, policy_version 1043347 (0.0008) [2023-12-28 02:45:22,039][106226] Updated weights for policy 0, policy_version 1043357 (0.0008) [2023-12-28 02:45:22,170][106225] Updated weights for policy 1, policy_version 1045921 (0.0008) [2023-12-28 02:45:22,231][106225] Updated weights for policy 1, policy_version 1045931 (0.0010) [2023-12-28 02:45:22,293][106225] Updated weights for policy 1, policy_version 1045941 (0.0009) [2023-12-28 02:45:22,786][106226] Updated weights for policy 0, policy_version 1043367 (0.0009) [2023-12-28 02:45:22,844][106226] Updated weights for policy 0, policy_version 1043377 (0.0008) [2023-12-28 02:45:22,908][106226] Updated weights for policy 0, policy_version 1043387 (0.0009) [2023-12-28 02:45:23,025][106225] Updated weights for policy 1, policy_version 1045951 (0.0007) [2023-12-28 02:45:23,091][106225] Updated weights for policy 1, policy_version 1045961 (0.0009) [2023-12-28 02:45:23,153][106225] Updated weights for policy 1, policy_version 1045971 (0.0008) [2023-12-28 02:45:23,647][106226] Updated weights for policy 0, policy_version 1043397 (0.0007) [2023-12-28 02:45:23,715][106226] Updated weights for policy 0, policy_version 1043407 (0.0005) [2023-12-28 02:45:23,738][106225] Updated weights for policy 1, policy_version 1045981 (0.0008) [2023-12-28 02:45:23,771][106226] Updated weights for policy 0, policy_version 1043417 (0.0005) [2023-12-28 02:45:23,800][106225] Updated weights for policy 1, policy_version 1045991 (0.0009) [2023-12-28 02:45:23,865][106225] Updated weights for policy 1, policy_version 1046001 (0.0008) [2023-12-28 02:45:24,299][106226] Updated weights for policy 0, policy_version 1043427 (0.0007) [2023-12-28 02:45:24,354][106226] Updated weights for policy 0, policy_version 1043437 (0.0008) [2023-12-28 02:45:24,402][106226] Updated weights for policy 0, policy_version 1043447 (0.0005) [2023-12-28 02:45:24,513][106225] Updated weights for policy 1, policy_version 1046011 (0.0008) [2023-12-28 02:45:24,571][106225] Updated weights for policy 1, policy_version 1046021 (0.0010) [2023-12-28 02:45:24,620][106225] Updated weights for policy 1, policy_version 1046031 (0.0010) [2023-12-28 02:45:24,964][106226] Updated weights for policy 0, policy_version 1043457 (0.0006) [2023-12-28 02:45:25,015][106226] Updated weights for policy 0, policy_version 1043467 (0.0006) [2023-12-28 02:45:25,060][106226] Updated weights for policy 0, policy_version 1043477 (0.0005) [2023-12-28 02:45:25,110][106226] Updated weights for policy 0, policy_version 1043487 (0.0005) [2023-12-28 02:45:25,347][106225] Updated weights for policy 1, policy_version 1046041 (0.0010) [2023-12-28 02:45:25,411][106225] Updated weights for policy 1, policy_version 1046051 (0.0010) [2023-12-28 02:45:25,467][106225] Updated weights for policy 1, policy_version 1046061 (0.0010) [2023-12-28 02:45:25,523][106225] Updated weights for policy 1, policy_version 1046071 (0.0010) [2023-12-28 02:45:25,673][106226] Updated weights for policy 0, policy_version 1043497 (0.0010) [2023-12-28 02:45:25,727][106226] Updated weights for policy 0, policy_version 1043507 (0.0011) [2023-12-28 02:45:25,778][106226] Updated weights for policy 0, policy_version 1043517 (0.0010) [2023-12-28 02:45:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 535035904. Throughput: 0: 9866.6, 1: 9922.1. Samples: 535005080. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:26,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-5.100')] [2023-12-28 02:45:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001043520_267198464.pth... [2023-12-28 02:45:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001042368_266903552.pth [2023-12-28 02:45:26,190][106225] Updated weights for policy 1, policy_version 1046081 (0.0007) [2023-12-28 02:45:26,240][106225] Updated weights for policy 1, policy_version 1046091 (0.0008) [2023-12-28 02:45:26,296][106225] Updated weights for policy 1, policy_version 1046101 (0.0008) [2023-12-28 02:45:26,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001046104_267845632.pth... [2023-12-28 02:45:26,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001044920_267542528.pth [2023-12-28 02:45:26,482][106226] Updated weights for policy 0, policy_version 1043527 (0.0010) [2023-12-28 02:45:26,541][106226] Updated weights for policy 0, policy_version 1043537 (0.0007) [2023-12-28 02:45:26,590][106226] Updated weights for policy 0, policy_version 1043547 (0.0005) [2023-12-28 02:45:27,000][106225] Updated weights for policy 1, policy_version 1046111 (0.0010) [2023-12-28 02:45:27,050][106225] Updated weights for policy 1, policy_version 1046121 (0.0010) [2023-12-28 02:45:27,105][106225] Updated weights for policy 1, policy_version 1046131 (0.0010) [2023-12-28 02:45:27,253][106226] Updated weights for policy 0, policy_version 1043557 (0.0008) [2023-12-28 02:45:27,317][106226] Updated weights for policy 0, policy_version 1043567 (0.0011) [2023-12-28 02:45:27,381][106226] Updated weights for policy 0, policy_version 1043577 (0.0011) [2023-12-28 02:45:27,823][106225] Updated weights for policy 1, policy_version 1046141 (0.0010) [2023-12-28 02:45:27,885][106225] Updated weights for policy 1, policy_version 1046151 (0.0010) [2023-12-28 02:45:27,941][106225] Updated weights for policy 1, policy_version 1046161 (0.0010) [2023-12-28 02:45:28,024][106226] Updated weights for policy 0, policy_version 1043587 (0.0010) [2023-12-28 02:45:28,080][106226] Updated weights for policy 0, policy_version 1043597 (0.0010) [2023-12-28 02:45:28,132][106226] Updated weights for policy 0, policy_version 1043607 (0.0010) [2023-12-28 02:45:28,636][106225] Updated weights for policy 1, policy_version 1046171 (0.0010) [2023-12-28 02:45:28,697][106225] Updated weights for policy 1, policy_version 1046181 (0.0010) [2023-12-28 02:45:28,768][106225] Updated weights for policy 1, policy_version 1046191 (0.0010) [2023-12-28 02:45:28,796][106226] Updated weights for policy 0, policy_version 1043617 (0.0010) [2023-12-28 02:45:28,858][106226] Updated weights for policy 0, policy_version 1043627 (0.0006) [2023-12-28 02:45:28,918][106226] Updated weights for policy 0, policy_version 1043637 (0.0008) [2023-12-28 02:45:28,974][106226] Updated weights for policy 0, policy_version 1043647 (0.0007) [2023-12-28 02:45:29,387][106225] Updated weights for policy 1, policy_version 1046201 (0.0010) [2023-12-28 02:45:29,450][106225] Updated weights for policy 1, policy_version 1046211 (0.0006) [2023-12-28 02:45:29,515][106225] Updated weights for policy 1, policy_version 1046221 (0.0009) [2023-12-28 02:45:29,575][106225] Updated weights for policy 1, policy_version 1046231 (0.0010) [2023-12-28 02:45:29,644][106226] Updated weights for policy 0, policy_version 1043657 (0.0006) [2023-12-28 02:45:29,698][106226] Updated weights for policy 0, policy_version 1043667 (0.0006) [2023-12-28 02:45:29,760][106226] Updated weights for policy 0, policy_version 1043677 (0.0007) [2023-12-28 02:45:30,251][106225] Updated weights for policy 1, policy_version 1046241 (0.0011) [2023-12-28 02:45:30,305][106225] Updated weights for policy 1, policy_version 1046251 (0.0010) [2023-12-28 02:45:30,359][106225] Updated weights for policy 1, policy_version 1046261 (0.0010) [2023-12-28 02:45:30,395][106226] Updated weights for policy 0, policy_version 1043687 (0.0007) [2023-12-28 02:45:30,452][106226] Updated weights for policy 0, policy_version 1043697 (0.0007) [2023-12-28 02:45:30,500][106226] Updated weights for policy 0, policy_version 1043707 (0.0008) [2023-12-28 02:45:31,071][106225] Updated weights for policy 1, policy_version 1046271 (0.0010) [2023-12-28 02:45:31,125][106225] Updated weights for policy 1, policy_version 1046281 (0.0010) [2023-12-28 02:45:31,152][106226] Updated weights for policy 0, policy_version 1043717 (0.0008) [2023-12-28 02:45:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 535134208. Throughput: 0: 10040.5, 1: 9961.6. Samples: 535129776. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:31,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-5.049')] [2023-12-28 02:45:31,194][106225] Updated weights for policy 1, policy_version 1046291 (0.0010) [2023-12-28 02:45:31,216][106226] Updated weights for policy 0, policy_version 1043727 (0.0006) [2023-12-28 02:45:31,283][106226] Updated weights for policy 0, policy_version 1043737 (0.0008) [2023-12-28 02:45:31,957][106225] Updated weights for policy 1, policy_version 1046301 (0.0009) [2023-12-28 02:45:31,967][106226] Updated weights for policy 0, policy_version 1043747 (0.0007) [2023-12-28 02:45:32,018][106225] Updated weights for policy 1, policy_version 1046311 (0.0007) [2023-12-28 02:45:32,023][106226] Updated weights for policy 0, policy_version 1043757 (0.0007) [2023-12-28 02:45:32,070][106225] Updated weights for policy 1, policy_version 1046321 (0.0006) [2023-12-28 02:45:32,088][106226] Updated weights for policy 0, policy_version 1043767 (0.0008) [2023-12-28 02:45:32,748][106226] Updated weights for policy 0, policy_version 1043777 (0.0009) [2023-12-28 02:45:32,808][106226] Updated weights for policy 0, policy_version 1043787 (0.0006) [2023-12-28 02:45:32,810][106225] Updated weights for policy 1, policy_version 1046331 (0.0006) [2023-12-28 02:45:32,864][106226] Updated weights for policy 0, policy_version 1043797 (0.0010) [2023-12-28 02:45:32,866][106225] Updated weights for policy 1, policy_version 1046341 (0.0007) [2023-12-28 02:45:32,924][106225] Updated weights for policy 1, policy_version 1046351 (0.0006) [2023-12-28 02:45:32,924][106226] Updated weights for policy 0, policy_version 1043807 (0.0010) [2023-12-28 02:45:33,499][106225] Updated weights for policy 1, policy_version 1046361 (0.0006) [2023-12-28 02:45:33,515][106226] Updated weights for policy 0, policy_version 1043817 (0.0006) [2023-12-28 02:45:33,548][106225] Updated weights for policy 1, policy_version 1046371 (0.0008) [2023-12-28 02:45:33,573][106226] Updated weights for policy 0, policy_version 1043827 (0.0007) [2023-12-28 02:45:33,594][106225] Updated weights for policy 1, policy_version 1046381 (0.0006) [2023-12-28 02:45:33,629][106226] Updated weights for policy 0, policy_version 1043837 (0.0008) [2023-12-28 02:45:33,640][106225] Updated weights for policy 1, policy_version 1046391 (0.0008) [2023-12-28 02:45:34,316][106226] Updated weights for policy 0, policy_version 1043847 (0.0010) [2023-12-28 02:45:34,384][106226] Updated weights for policy 0, policy_version 1043857 (0.0011) [2023-12-28 02:45:34,408][106225] Updated weights for policy 1, policy_version 1046401 (0.0008) [2023-12-28 02:45:34,441][106226] Updated weights for policy 0, policy_version 1043867 (0.0007) [2023-12-28 02:45:34,460][106225] Updated weights for policy 1, policy_version 1046411 (0.0008) [2023-12-28 02:45:34,513][106225] Updated weights for policy 1, policy_version 1046421 (0.0007) [2023-12-28 02:45:35,177][106226] Updated weights for policy 0, policy_version 1043877 (0.0010) [2023-12-28 02:45:35,230][106226] Updated weights for policy 0, policy_version 1043887 (0.0010) [2023-12-28 02:45:35,275][106225] Updated weights for policy 1, policy_version 1046431 (0.0006) [2023-12-28 02:45:35,281][106226] Updated weights for policy 0, policy_version 1043897 (0.0010) [2023-12-28 02:45:35,341][106225] Updated weights for policy 1, policy_version 1046441 (0.0006) [2023-12-28 02:45:35,405][106225] Updated weights for policy 1, policy_version 1046451 (0.0008) [2023-12-28 02:45:36,006][106226] Updated weights for policy 0, policy_version 1043907 (0.0011) [2023-12-28 02:45:36,064][106226] Updated weights for policy 0, policy_version 1043917 (0.0010) [2023-12-28 02:45:36,136][106226] Updated weights for policy 0, policy_version 1043927 (0.0010) [2023-12-28 02:45:36,147][106225] Updated weights for policy 1, policy_version 1046461 (0.0008) [2023-12-28 02:45:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 535232512. Throughput: 0: 10045.2, 1: 9894.2. Samples: 535249072. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:36,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.594')] [2023-12-28 02:45:36,214][106225] Updated weights for policy 1, policy_version 1046471 (0.0008) [2023-12-28 02:45:36,278][106225] Updated weights for policy 1, policy_version 1046481 (0.0009) [2023-12-28 02:45:36,916][106226] Updated weights for policy 0, policy_version 1043937 (0.0010) [2023-12-28 02:45:36,976][106226] Updated weights for policy 0, policy_version 1043947 (0.0011) [2023-12-28 02:45:37,025][106226] Updated weights for policy 0, policy_version 1043957 (0.0010) [2023-12-28 02:45:37,034][106225] Updated weights for policy 1, policy_version 1046491 (0.0008) [2023-12-28 02:45:37,082][106226] Updated weights for policy 0, policy_version 1043967 (0.0010) [2023-12-28 02:45:37,088][106225] Updated weights for policy 1, policy_version 1046501 (0.0006) [2023-12-28 02:45:37,139][106225] Updated weights for policy 1, policy_version 1046511 (0.0008) [2023-12-28 02:45:37,802][106226] Updated weights for policy 0, policy_version 1043977 (0.0011) [2023-12-28 02:45:37,854][106226] Updated weights for policy 0, policy_version 1043987 (0.0011) [2023-12-28 02:45:37,901][106225] Updated weights for policy 1, policy_version 1046521 (0.0007) [2023-12-28 02:45:37,915][106226] Updated weights for policy 0, policy_version 1043997 (0.0011) [2023-12-28 02:45:37,961][106225] Updated weights for policy 1, policy_version 1046531 (0.0007) [2023-12-28 02:45:38,021][106225] Updated weights for policy 1, policy_version 1046541 (0.0007) [2023-12-28 02:45:38,067][106225] Updated weights for policy 1, policy_version 1046551 (0.0007) [2023-12-28 02:45:38,667][106226] Updated weights for policy 0, policy_version 1044007 (0.0007) [2023-12-28 02:45:38,729][106226] Updated weights for policy 0, policy_version 1044017 (0.0007) [2023-12-28 02:45:38,774][106225] Updated weights for policy 1, policy_version 1046561 (0.0008) [2023-12-28 02:45:38,791][106226] Updated weights for policy 0, policy_version 1044027 (0.0008) [2023-12-28 02:45:38,821][106225] Updated weights for policy 1, policy_version 1046571 (0.0006) [2023-12-28 02:45:38,870][106225] Updated weights for policy 1, policy_version 1046581 (0.0006) [2023-12-28 02:45:39,513][106226] Updated weights for policy 0, policy_version 1044037 (0.0008) [2023-12-28 02:45:39,578][106226] Updated weights for policy 0, policy_version 1044047 (0.0010) [2023-12-28 02:45:39,578][106225] Updated weights for policy 1, policy_version 1046591 (0.0009) [2023-12-28 02:45:39,634][106226] Updated weights for policy 0, policy_version 1044057 (0.0008) [2023-12-28 02:45:39,639][106225] Updated weights for policy 1, policy_version 1046601 (0.0008) [2023-12-28 02:45:39,698][106225] Updated weights for policy 1, policy_version 1046611 (0.0010) [2023-12-28 02:45:40,386][106225] Updated weights for policy 1, policy_version 1046621 (0.0009) [2023-12-28 02:45:40,410][106226] Updated weights for policy 0, policy_version 1044067 (0.0007) [2023-12-28 02:45:40,448][106225] Updated weights for policy 1, policy_version 1046631 (0.0008) [2023-12-28 02:45:40,475][106226] Updated weights for policy 0, policy_version 1044077 (0.0009) [2023-12-28 02:45:40,507][106225] Updated weights for policy 1, policy_version 1046641 (0.0009) [2023-12-28 02:45:40,531][106226] Updated weights for policy 0, policy_version 1044087 (0.0007) [2023-12-28 02:45:41,125][106225] Updated weights for policy 1, policy_version 1046651 (0.0009) [2023-12-28 02:45:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 535330816. Throughput: 0: 10015.6, 1: 9868.2. Samples: 535305976. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:41,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-5.233')] [2023-12-28 02:45:41,191][106226] Updated weights for policy 0, policy_version 1044097 (0.0009) [2023-12-28 02:45:41,198][106225] Updated weights for policy 1, policy_version 1046661 (0.0009) [2023-12-28 02:45:41,253][106226] Updated weights for policy 0, policy_version 1044107 (0.0007) [2023-12-28 02:45:41,258][106225] Updated weights for policy 1, policy_version 1046671 (0.0008) [2023-12-28 02:45:41,315][106226] Updated weights for policy 0, policy_version 1044117 (0.0009) [2023-12-28 02:45:41,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001046680_267993088.pth... [2023-12-28 02:45:41,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001045496_267689984.pth [2023-12-28 02:45:41,384][106226] Updated weights for policy 0, policy_version 1044127 (0.0008) [2023-12-28 02:45:41,389][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001044128_267354112.pth... [2023-12-28 02:45:41,393][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001042944_267051008.pth [2023-12-28 02:45:42,058][106225] Updated weights for policy 1, policy_version 1046681 (0.0007) [2023-12-28 02:45:42,119][106225] Updated weights for policy 1, policy_version 1046691 (0.0009) [2023-12-28 02:45:42,129][106226] Updated weights for policy 0, policy_version 1044137 (0.0007) [2023-12-28 02:45:42,175][106225] Updated weights for policy 1, policy_version 1046701 (0.0008) [2023-12-28 02:45:42,189][106226] Updated weights for policy 0, policy_version 1044147 (0.0006) [2023-12-28 02:45:42,234][106225] Updated weights for policy 1, policy_version 1046711 (0.0008) [2023-12-28 02:45:42,252][106226] Updated weights for policy 0, policy_version 1044157 (0.0007) [2023-12-28 02:45:42,924][106225] Updated weights for policy 1, policy_version 1046721 (0.0008) [2023-12-28 02:45:42,985][106225] Updated weights for policy 1, policy_version 1046731 (0.0008) [2023-12-28 02:45:43,013][106226] Updated weights for policy 0, policy_version 1044167 (0.0010) [2023-12-28 02:45:43,047][106225] Updated weights for policy 1, policy_version 1046741 (0.0008) [2023-12-28 02:45:43,070][106226] Updated weights for policy 0, policy_version 1044177 (0.0007) [2023-12-28 02:45:43,133][106226] Updated weights for policy 0, policy_version 1044187 (0.0007) [2023-12-28 02:45:43,711][106225] Updated weights for policy 1, policy_version 1046751 (0.0008) [2023-12-28 02:45:43,760][106225] Updated weights for policy 1, policy_version 1046761 (0.0008) [2023-12-28 02:45:43,784][106226] Updated weights for policy 0, policy_version 1044197 (0.0007) [2023-12-28 02:45:43,814][106225] Updated weights for policy 1, policy_version 1046771 (0.0005) [2023-12-28 02:45:43,839][106226] Updated weights for policy 0, policy_version 1044207 (0.0008) [2023-12-28 02:45:43,897][106226] Updated weights for policy 0, policy_version 1044217 (0.0008) [2023-12-28 02:45:44,550][106226] Updated weights for policy 0, policy_version 1044227 (0.0009) [2023-12-28 02:45:44,590][106225] Updated weights for policy 1, policy_version 1046781 (0.0008) [2023-12-28 02:45:44,614][106226] Updated weights for policy 0, policy_version 1044237 (0.0006) [2023-12-28 02:45:44,650][106225] Updated weights for policy 1, policy_version 1046791 (0.0007) [2023-12-28 02:45:44,679][106226] Updated weights for policy 0, policy_version 1044247 (0.0006) [2023-12-28 02:45:44,707][106225] Updated weights for policy 1, policy_version 1046801 (0.0008) [2023-12-28 02:45:45,399][106226] Updated weights for policy 0, policy_version 1044257 (0.0006) [2023-12-28 02:45:45,435][106225] Updated weights for policy 1, policy_version 1046811 (0.0007) [2023-12-28 02:45:45,458][106226] Updated weights for policy 0, policy_version 1044267 (0.0007) [2023-12-28 02:45:45,488][106225] Updated weights for policy 1, policy_version 1046821 (0.0007) [2023-12-28 02:45:45,511][106226] Updated weights for policy 0, policy_version 1044277 (0.0006) [2023-12-28 02:45:45,552][106225] Updated weights for policy 1, policy_version 1046831 (0.0008) [2023-12-28 02:45:45,559][106226] Updated weights for policy 0, policy_version 1044287 (0.0005) [2023-12-28 02:45:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 535429120. Throughput: 0: 9935.6, 1: 9856.3. Samples: 535422896. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:46,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.934')] [2023-12-28 02:45:46,184][106226] Updated weights for policy 0, policy_version 1044297 (0.0005) [2023-12-28 02:45:46,247][106226] Updated weights for policy 0, policy_version 1044307 (0.0005) [2023-12-28 02:45:46,303][106226] Updated weights for policy 0, policy_version 1044317 (0.0007) [2023-12-28 02:45:46,338][106225] Updated weights for policy 1, policy_version 1046841 (0.0009) [2023-12-28 02:45:46,387][106225] Updated weights for policy 1, policy_version 1046851 (0.0009) [2023-12-28 02:45:46,434][106225] Updated weights for policy 1, policy_version 1046861 (0.0008) [2023-12-28 02:45:46,483][106225] Updated weights for policy 1, policy_version 1046871 (0.0008) [2023-12-28 02:45:46,896][106226] Updated weights for policy 0, policy_version 1044327 (0.0008) [2023-12-28 02:45:46,955][106226] Updated weights for policy 0, policy_version 1044337 (0.0009) [2023-12-28 02:45:47,006][106226] Updated weights for policy 0, policy_version 1044347 (0.0009) [2023-12-28 02:45:47,218][106225] Updated weights for policy 1, policy_version 1046881 (0.0008) [2023-12-28 02:45:47,275][106225] Updated weights for policy 1, policy_version 1046891 (0.0009) [2023-12-28 02:45:47,324][106225] Updated weights for policy 1, policy_version 1046901 (0.0008) [2023-12-28 02:45:47,779][106226] Updated weights for policy 0, policy_version 1044357 (0.0006) [2023-12-28 02:45:47,838][106226] Updated weights for policy 0, policy_version 1044367 (0.0006) [2023-12-28 02:45:47,899][106226] Updated weights for policy 0, policy_version 1044377 (0.0009) [2023-12-28 02:45:47,988][106225] Updated weights for policy 1, policy_version 1046911 (0.0009) [2023-12-28 02:45:48,040][106225] Updated weights for policy 1, policy_version 1046921 (0.0007) [2023-12-28 02:45:48,090][106225] Updated weights for policy 1, policy_version 1046931 (0.0008) [2023-12-28 02:45:48,596][106226] Updated weights for policy 0, policy_version 1044387 (0.0009) [2023-12-28 02:45:48,664][106226] Updated weights for policy 0, policy_version 1044397 (0.0007) [2023-12-28 02:45:48,724][106226] Updated weights for policy 0, policy_version 1044407 (0.0010) [2023-12-28 02:45:48,841][106225] Updated weights for policy 1, policy_version 1046941 (0.0008) [2023-12-28 02:45:48,903][106225] Updated weights for policy 1, policy_version 1046951 (0.0007) [2023-12-28 02:45:48,965][106225] Updated weights for policy 1, policy_version 1046961 (0.0007) [2023-12-28 02:45:49,446][106226] Updated weights for policy 0, policy_version 1044417 (0.0010) [2023-12-28 02:45:49,510][106226] Updated weights for policy 0, policy_version 1044427 (0.0007) [2023-12-28 02:45:49,572][106226] Updated weights for policy 0, policy_version 1044437 (0.0006) [2023-12-28 02:45:49,627][106226] Updated weights for policy 0, policy_version 1044447 (0.0005) [2023-12-28 02:45:49,725][106225] Updated weights for policy 1, policy_version 1046971 (0.0008) [2023-12-28 02:45:49,787][106225] Updated weights for policy 1, policy_version 1046981 (0.0008) [2023-12-28 02:45:49,860][106225] Updated weights for policy 1, policy_version 1046991 (0.0008) [2023-12-28 02:45:50,323][106226] Updated weights for policy 0, policy_version 1044457 (0.0005) [2023-12-28 02:45:50,395][106226] Updated weights for policy 0, policy_version 1044467 (0.0006) [2023-12-28 02:45:50,456][106226] Updated weights for policy 0, policy_version 1044477 (0.0006) [2023-12-28 02:45:50,592][106225] Updated weights for policy 1, policy_version 1047001 (0.0008) [2023-12-28 02:45:50,654][106225] Updated weights for policy 1, policy_version 1047011 (0.0010) [2023-12-28 02:45:50,716][106225] Updated weights for policy 1, policy_version 1047021 (0.0010) [2023-12-28 02:45:50,780][106225] Updated weights for policy 1, policy_version 1047031 (0.0010) [2023-12-28 02:45:51,040][106226] Updated weights for policy 0, policy_version 1044487 (0.0007) [2023-12-28 02:45:51,107][106226] Updated weights for policy 0, policy_version 1044497 (0.0008) [2023-12-28 02:45:51,167][106226] Updated weights for policy 0, policy_version 1044507 (0.0008) [2023-12-28 02:45:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 535527424. Throughput: 0: 9986.1, 1: 9789.8. Samples: 535540964. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:51,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.995')] [2023-12-28 02:45:51,512][106225] Updated weights for policy 1, policy_version 1047041 (0.0010) [2023-12-28 02:45:51,563][106225] Updated weights for policy 1, policy_version 1047051 (0.0010) [2023-12-28 02:45:51,625][106225] Updated weights for policy 1, policy_version 1047061 (0.0010) [2023-12-28 02:45:51,889][106226] Updated weights for policy 0, policy_version 1044517 (0.0006) [2023-12-28 02:45:51,943][106226] Updated weights for policy 0, policy_version 1044527 (0.0008) [2023-12-28 02:45:52,007][106226] Updated weights for policy 0, policy_version 1044537 (0.0008) [2023-12-28 02:45:52,363][106225] Updated weights for policy 1, policy_version 1047071 (0.0009) [2023-12-28 02:45:52,428][106225] Updated weights for policy 1, policy_version 1047081 (0.0008) [2023-12-28 02:45:52,485][106225] Updated weights for policy 1, policy_version 1047091 (0.0009) [2023-12-28 02:45:52,729][106226] Updated weights for policy 0, policy_version 1044547 (0.0007) [2023-12-28 02:45:52,792][106226] Updated weights for policy 0, policy_version 1044557 (0.0008) [2023-12-28 02:45:52,840][106226] Updated weights for policy 0, policy_version 1044567 (0.0008) [2023-12-28 02:45:53,119][106225] Updated weights for policy 1, policy_version 1047101 (0.0009) [2023-12-28 02:45:53,170][106225] Updated weights for policy 1, policy_version 1047112 (0.0009) [2023-12-28 02:45:53,227][106225] Updated weights for policy 1, policy_version 1047122 (0.0007) [2023-12-28 02:45:53,445][106226] Updated weights for policy 0, policy_version 1044577 (0.0008) [2023-12-28 02:45:53,513][106226] Updated weights for policy 0, policy_version 1044587 (0.0007) [2023-12-28 02:45:53,572][106226] Updated weights for policy 0, policy_version 1044597 (0.0008) [2023-12-28 02:45:53,634][106226] Updated weights for policy 0, policy_version 1044607 (0.0009) [2023-12-28 02:45:53,995][106225] Updated weights for policy 1, policy_version 1047132 (0.0010) [2023-12-28 02:45:54,041][106225] Updated weights for policy 1, policy_version 1047142 (0.0008) [2023-12-28 02:45:54,090][106225] Updated weights for policy 1, policy_version 1047152 (0.0009) [2023-12-28 02:45:54,353][106226] Updated weights for policy 0, policy_version 1044617 (0.0009) [2023-12-28 02:45:54,410][106226] Updated weights for policy 0, policy_version 1044627 (0.0008) [2023-12-28 02:45:54,469][106226] Updated weights for policy 0, policy_version 1044637 (0.0009) [2023-12-28 02:45:54,779][106225] Updated weights for policy 1, policy_version 1047162 (0.0006) [2023-12-28 02:45:54,840][106225] Updated weights for policy 1, policy_version 1047172 (0.0007) [2023-12-28 02:45:54,903][106225] Updated weights for policy 1, policy_version 1047182 (0.0007) [2023-12-28 02:45:54,965][106225] Updated weights for policy 1, policy_version 1047192 (0.0008) [2023-12-28 02:45:55,224][106226] Updated weights for policy 0, policy_version 1044647 (0.0009) [2023-12-28 02:45:55,273][106226] Updated weights for policy 0, policy_version 1044657 (0.0010) [2023-12-28 02:45:55,320][106226] Updated weights for policy 0, policy_version 1044667 (0.0008) [2023-12-28 02:45:55,557][106225] Updated weights for policy 1, policy_version 1047202 (0.0005) [2023-12-28 02:45:55,602][106225] Updated weights for policy 1, policy_version 1047212 (0.0005) [2023-12-28 02:45:55,650][106225] Updated weights for policy 1, policy_version 1047222 (0.0005) [2023-12-28 02:45:55,967][106226] Updated weights for policy 0, policy_version 1044677 (0.0009) [2023-12-28 02:45:56,025][106226] Updated weights for policy 0, policy_version 1044687 (0.0009) [2023-12-28 02:45:56,089][106226] Updated weights for policy 0, policy_version 1044697 (0.0010) [2023-12-28 02:45:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 535633920. Throughput: 0: 9967.9, 1: 9766.1. Samples: 535599852. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:45:56,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.865')] [2023-12-28 02:45:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001044704_267501568.pth... [2023-12-28 02:45:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001043520_267198464.pth [2023-12-28 02:45:56,233][106225] Updated weights for policy 1, policy_version 1047232 (0.0006) [2023-12-28 02:45:56,291][106225] Updated weights for policy 1, policy_version 1047242 (0.0007) [2023-12-28 02:45:56,349][106225] Updated weights for policy 1, policy_version 1047252 (0.0011) [2023-12-28 02:45:56,365][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001047256_268140544.pth... [2023-12-28 02:45:56,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001046104_267845632.pth [2023-12-28 02:45:56,742][106226] Updated weights for policy 0, policy_version 1044707 (0.0011) [2023-12-28 02:45:56,794][106226] Updated weights for policy 0, policy_version 1044717 (0.0010) [2023-12-28 02:45:56,853][106226] Updated weights for policy 0, policy_version 1044727 (0.0010) [2023-12-28 02:45:56,987][106225] Updated weights for policy 1, policy_version 1047262 (0.0007) [2023-12-28 02:45:57,033][106225] Updated weights for policy 1, policy_version 1047272 (0.0005) [2023-12-28 02:45:57,081][106225] Updated weights for policy 1, policy_version 1047282 (0.0005) [2023-12-28 02:45:57,486][106226] Updated weights for policy 0, policy_version 1044737 (0.0010) [2023-12-28 02:45:57,542][106226] Updated weights for policy 0, policy_version 1044747 (0.0005) [2023-12-28 02:45:57,604][106226] Updated weights for policy 0, policy_version 1044757 (0.0005) [2023-12-28 02:45:57,614][106225] Updated weights for policy 1, policy_version 1047292 (0.0006) [2023-12-28 02:45:57,665][106226] Updated weights for policy 0, policy_version 1044767 (0.0005) [2023-12-28 02:45:57,676][106225] Updated weights for policy 1, policy_version 1047302 (0.0005) [2023-12-28 02:45:57,736][106225] Updated weights for policy 1, policy_version 1047312 (0.0005) [2023-12-28 02:45:58,159][106226] Updated weights for policy 0, policy_version 1044777 (0.0005) [2023-12-28 02:45:58,214][106226] Updated weights for policy 0, policy_version 1044787 (0.0006) [2023-12-28 02:45:58,275][106226] Updated weights for policy 0, policy_version 1044797 (0.0009) [2023-12-28 02:45:58,336][106225] Updated weights for policy 1, policy_version 1047323 (0.0006) [2023-12-28 02:45:58,392][106225] Updated weights for policy 1, policy_version 1047333 (0.0008) [2023-12-28 02:45:58,461][106225] Updated weights for policy 1, policy_version 1047343 (0.0008) [2023-12-28 02:45:59,090][106226] Updated weights for policy 0, policy_version 1044807 (0.0008) [2023-12-28 02:45:59,153][106226] Updated weights for policy 0, policy_version 1044817 (0.0007) [2023-12-28 02:45:59,216][106226] Updated weights for policy 0, policy_version 1044827 (0.0007) [2023-12-28 02:45:59,235][106225] Updated weights for policy 1, policy_version 1047353 (0.0010) [2023-12-28 02:45:59,298][106225] Updated weights for policy 1, policy_version 1047363 (0.0008) [2023-12-28 02:45:59,357][106225] Updated weights for policy 1, policy_version 1047373 (0.0008) [2023-12-28 02:45:59,417][106225] Updated weights for policy 1, policy_version 1047383 (0.0007) [2023-12-28 02:45:59,931][106226] Updated weights for policy 0, policy_version 1044837 (0.0007) [2023-12-28 02:45:59,991][106226] Updated weights for policy 0, policy_version 1044847 (0.0009) [2023-12-28 02:46:00,058][106226] Updated weights for policy 0, policy_version 1044857 (0.0007) [2023-12-28 02:46:00,123][106225] Updated weights for policy 1, policy_version 1047393 (0.0007) [2023-12-28 02:46:00,180][106225] Updated weights for policy 1, policy_version 1047403 (0.0009) [2023-12-28 02:46:00,237][106225] Updated weights for policy 1, policy_version 1047413 (0.0009) [2023-12-28 02:46:00,770][106226] Updated weights for policy 0, policy_version 1044867 (0.0006) [2023-12-28 02:46:00,835][106226] Updated weights for policy 0, policy_version 1044877 (0.0005) [2023-12-28 02:46:00,881][106225] Updated weights for policy 1, policy_version 1047423 (0.0007) [2023-12-28 02:46:00,891][106226] Updated weights for policy 0, policy_version 1044887 (0.0005) [2023-12-28 02:46:00,934][106225] Updated weights for policy 1, policy_version 1047433 (0.0007) [2023-12-28 02:46:00,983][106225] Updated weights for policy 1, policy_version 1047443 (0.0008) [2023-12-28 02:46:01,174][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 535740416. Throughput: 0: 10055.8, 1: 9864.9. Samples: 535725248. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:01,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.761')] [2023-12-28 02:46:01,531][106226] Updated weights for policy 0, policy_version 1044897 (0.0006) [2023-12-28 02:46:01,587][106226] Updated weights for policy 0, policy_version 1044907 (0.0009) [2023-12-28 02:46:01,651][106226] Updated weights for policy 0, policy_version 1044917 (0.0008) [2023-12-28 02:46:01,716][106226] Updated weights for policy 0, policy_version 1044927 (0.0008) [2023-12-28 02:46:01,800][106225] Updated weights for policy 1, policy_version 1047454 (0.0010) [2023-12-28 02:46:01,865][106225] Updated weights for policy 1, policy_version 1047464 (0.0009) [2023-12-28 02:46:01,926][106225] Updated weights for policy 1, policy_version 1047474 (0.0009) [2023-12-28 02:46:02,501][106226] Updated weights for policy 0, policy_version 1044937 (0.0008) [2023-12-28 02:46:02,555][106226] Updated weights for policy 0, policy_version 1044947 (0.0008) [2023-12-28 02:46:02,604][106225] Updated weights for policy 1, policy_version 1047484 (0.0007) [2023-12-28 02:46:02,606][106226] Updated weights for policy 0, policy_version 1044957 (0.0008) [2023-12-28 02:46:02,660][106225] Updated weights for policy 1, policy_version 1047494 (0.0007) [2023-12-28 02:46:02,713][106225] Updated weights for policy 1, policy_version 1047504 (0.0008) [2023-12-28 02:46:03,357][106226] Updated weights for policy 0, policy_version 1044967 (0.0008) [2023-12-28 02:46:03,413][106226] Updated weights for policy 0, policy_version 1044977 (0.0008) [2023-12-28 02:46:03,430][106225] Updated weights for policy 1, policy_version 1047514 (0.0006) [2023-12-28 02:46:03,472][106226] Updated weights for policy 0, policy_version 1044987 (0.0005) [2023-12-28 02:46:03,494][106225] Updated weights for policy 1, policy_version 1047524 (0.0008) [2023-12-28 02:46:03,547][106225] Updated weights for policy 1, policy_version 1047534 (0.0009) [2023-12-28 02:46:03,599][106225] Updated weights for policy 1, policy_version 1047544 (0.0007) [2023-12-28 02:46:04,219][106226] Updated weights for policy 0, policy_version 1044997 (0.0006) [2023-12-28 02:46:04,289][106226] Updated weights for policy 0, policy_version 1045007 (0.0007) [2023-12-28 02:46:04,338][106225] Updated weights for policy 1, policy_version 1047554 (0.0007) [2023-12-28 02:46:04,354][106226] Updated weights for policy 0, policy_version 1045017 (0.0007) [2023-12-28 02:46:04,405][106225] Updated weights for policy 1, policy_version 1047564 (0.0008) [2023-12-28 02:46:04,469][106225] Updated weights for policy 1, policy_version 1047574 (0.0009) [2023-12-28 02:46:05,068][106226] Updated weights for policy 0, policy_version 1045027 (0.0008) [2023-12-28 02:46:05,088][106225] Updated weights for policy 1, policy_version 1047584 (0.0006) [2023-12-28 02:46:05,113][106226] Updated weights for policy 0, policy_version 1045037 (0.0008) [2023-12-28 02:46:05,144][106225] Updated weights for policy 1, policy_version 1047594 (0.0006) [2023-12-28 02:46:05,155][106226] Updated weights for policy 0, policy_version 1045047 (0.0007) [2023-12-28 02:46:05,192][106225] Updated weights for policy 1, policy_version 1047604 (0.0006) [2023-12-28 02:46:05,893][106225] Updated weights for policy 1, policy_version 1047614 (0.0007) [2023-12-28 02:46:05,893][106226] Updated weights for policy 0, policy_version 1045057 (0.0007) [2023-12-28 02:46:05,943][106225] Updated weights for policy 1, policy_version 1047624 (0.0006) [2023-12-28 02:46:05,953][106226] Updated weights for policy 0, policy_version 1045067 (0.0008) [2023-12-28 02:46:05,993][106225] Updated weights for policy 1, policy_version 1047634 (0.0007) [2023-12-28 02:46:06,015][106226] Updated weights for policy 0, policy_version 1045077 (0.0009) [2023-12-28 02:46:06,073][106226] Updated weights for policy 0, policy_version 1045087 (0.0008) [2023-12-28 02:46:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 535838720. Throughput: 0: 10007.8, 1: 9871.7. Samples: 535841648. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:06,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-4.709')] [2023-12-28 02:46:06,748][106225] Updated weights for policy 1, policy_version 1047644 (0.0007) [2023-12-28 02:46:06,803][106225] Updated weights for policy 1, policy_version 1047654 (0.0008) [2023-12-28 02:46:06,868][106225] Updated weights for policy 1, policy_version 1047664 (0.0007) [2023-12-28 02:46:06,883][106226] Updated weights for policy 0, policy_version 1045097 (0.0008) [2023-12-28 02:46:06,950][106226] Updated weights for policy 0, policy_version 1045107 (0.0008) [2023-12-28 02:46:07,017][106226] Updated weights for policy 0, policy_version 1045117 (0.0008) [2023-12-28 02:46:07,655][106225] Updated weights for policy 1, policy_version 1047674 (0.0008) [2023-12-28 02:46:07,719][106225] Updated weights for policy 1, policy_version 1047684 (0.0009) [2023-12-28 02:46:07,748][106226] Updated weights for policy 0, policy_version 1045127 (0.0006) [2023-12-28 02:46:07,779][106225] Updated weights for policy 1, policy_version 1047694 (0.0009) [2023-12-28 02:46:07,813][106226] Updated weights for policy 0, policy_version 1045137 (0.0006) [2023-12-28 02:46:07,838][106225] Updated weights for policy 1, policy_version 1047704 (0.0005) [2023-12-28 02:46:07,877][106226] Updated weights for policy 0, policy_version 1045147 (0.0008) [2023-12-28 02:46:08,599][106226] Updated weights for policy 0, policy_version 1045157 (0.0008) [2023-12-28 02:46:08,604][106225] Updated weights for policy 1, policy_version 1047714 (0.0006) [2023-12-28 02:46:08,664][106226] Updated weights for policy 0, policy_version 1045167 (0.0008) [2023-12-28 02:46:08,664][106225] Updated weights for policy 1, policy_version 1047724 (0.0008) [2023-12-28 02:46:08,731][106226] Updated weights for policy 0, policy_version 1045177 (0.0007) [2023-12-28 02:46:08,732][106225] Updated weights for policy 1, policy_version 1047734 (0.0007) [2023-12-28 02:46:09,446][106225] Updated weights for policy 1, policy_version 1047744 (0.0009) [2023-12-28 02:46:09,463][106226] Updated weights for policy 0, policy_version 1045187 (0.0007) [2023-12-28 02:46:09,514][106225] Updated weights for policy 1, policy_version 1047754 (0.0007) [2023-12-28 02:46:09,534][106226] Updated weights for policy 0, policy_version 1045197 (0.0007) [2023-12-28 02:46:09,585][106225] Updated weights for policy 1, policy_version 1047764 (0.0006) [2023-12-28 02:46:09,602][106226] Updated weights for policy 0, policy_version 1045207 (0.0008) [2023-12-28 02:46:10,343][106225] Updated weights for policy 1, policy_version 1047774 (0.0008) [2023-12-28 02:46:10,375][106226] Updated weights for policy 0, policy_version 1045217 (0.0009) [2023-12-28 02:46:10,412][106225] Updated weights for policy 1, policy_version 1047784 (0.0008) [2023-12-28 02:46:10,442][106226] Updated weights for policy 0, policy_version 1045227 (0.0009) [2023-12-28 02:46:10,474][106225] Updated weights for policy 1, policy_version 1047794 (0.0007) [2023-12-28 02:46:10,502][106226] Updated weights for policy 0, policy_version 1045237 (0.0009) [2023-12-28 02:46:10,554][106226] Updated weights for policy 0, policy_version 1045247 (0.0009) [2023-12-28 02:46:11,175][105115] Fps is (10 sec: 18021.9, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 535920640. Throughput: 0: 9989.6, 1: 9862.5. Samples: 535898428. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:11,178][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.802')] [2023-12-28 02:46:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001047800_268279808.pth... [2023-12-28 02:46:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001046680_267993088.pth [2023-12-28 02:46:11,244][106226] Updated weights for policy 0, policy_version 1045257 (0.0007) [2023-12-28 02:46:11,265][106225] Updated weights for policy 1, policy_version 1047804 (0.0008) [2023-12-28 02:46:11,311][106226] Updated weights for policy 0, policy_version 1045267 (0.0008) [2023-12-28 02:46:11,326][106225] Updated weights for policy 1, policy_version 1047814 (0.0006) [2023-12-28 02:46:11,384][106226] Updated weights for policy 0, policy_version 1045277 (0.0008) [2023-12-28 02:46:11,396][106225] Updated weights for policy 1, policy_version 1047824 (0.0008) [2023-12-28 02:46:11,402][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001045280_267649024.pth... [2023-12-28 02:46:11,405][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001044128_267354112.pth [2023-12-28 02:46:12,123][106226] Updated weights for policy 0, policy_version 1045287 (0.0008) [2023-12-28 02:46:12,153][106225] Updated weights for policy 1, policy_version 1047834 (0.0009) [2023-12-28 02:46:12,184][106226] Updated weights for policy 0, policy_version 1045297 (0.0007) [2023-12-28 02:46:12,221][106225] Updated weights for policy 1, policy_version 1047844 (0.0008) [2023-12-28 02:46:12,251][106226] Updated weights for policy 0, policy_version 1045307 (0.0008) [2023-12-28 02:46:12,283][106225] Updated weights for policy 1, policy_version 1047854 (0.0008) [2023-12-28 02:46:12,349][106225] Updated weights for policy 1, policy_version 1047864 (0.0008) [2023-12-28 02:46:12,988][106226] Updated weights for policy 0, policy_version 1045317 (0.0008) [2023-12-28 02:46:13,048][106226] Updated weights for policy 0, policy_version 1045327 (0.0006) [2023-12-28 02:46:13,100][106226] Updated weights for policy 0, policy_version 1045337 (0.0005) [2023-12-28 02:46:13,103][106225] Updated weights for policy 1, policy_version 1047874 (0.0010) [2023-12-28 02:46:13,163][106225] Updated weights for policy 1, policy_version 1047884 (0.0010) [2023-12-28 02:46:13,220][106225] Updated weights for policy 1, policy_version 1047894 (0.0010) [2023-12-28 02:46:13,780][106226] Updated weights for policy 0, policy_version 1045347 (0.0006) [2023-12-28 02:46:13,825][106225] Updated weights for policy 1, policy_version 1047904 (0.0010) [2023-12-28 02:46:13,825][106226] Updated weights for policy 0, policy_version 1045357 (0.0009) [2023-12-28 02:46:13,883][106226] Updated weights for policy 0, policy_version 1045367 (0.0006) [2023-12-28 02:46:13,885][106225] Updated weights for policy 1, policy_version 1047914 (0.0010) [2023-12-28 02:46:13,941][106225] Updated weights for policy 1, policy_version 1047924 (0.0010) [2023-12-28 02:46:14,480][106226] Updated weights for policy 0, policy_version 1045377 (0.0006) [2023-12-28 02:46:14,530][106226] Updated weights for policy 0, policy_version 1045387 (0.0008) [2023-12-28 02:46:14,585][106226] Updated weights for policy 0, policy_version 1045397 (0.0008) [2023-12-28 02:46:14,641][106226] Updated weights for policy 0, policy_version 1045407 (0.0007) [2023-12-28 02:46:14,659][106225] Updated weights for policy 1, policy_version 1047934 (0.0010) [2023-12-28 02:46:14,721][106225] Updated weights for policy 1, policy_version 1047944 (0.0009) [2023-12-28 02:46:14,781][106225] Updated weights for policy 1, policy_version 1047954 (0.0009) [2023-12-28 02:46:15,377][106226] Updated weights for policy 0, policy_version 1045417 (0.0008) [2023-12-28 02:46:15,443][106226] Updated weights for policy 0, policy_version 1045427 (0.0008) [2023-12-28 02:46:15,494][106226] Updated weights for policy 0, policy_version 1045437 (0.0009) [2023-12-28 02:46:15,499][106225] Updated weights for policy 1, policy_version 1047964 (0.0010) [2023-12-28 02:46:15,557][106225] Updated weights for policy 1, policy_version 1047974 (0.0010) [2023-12-28 02:46:15,611][106225] Updated weights for policy 1, policy_version 1047984 (0.0010) [2023-12-28 02:46:16,156][106226] Updated weights for policy 0, policy_version 1045447 (0.0008) [2023-12-28 02:46:16,175][105115] Fps is (10 sec: 18021.8, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 536018944. Throughput: 0: 9847.1, 1: 9769.0. Samples: 536012504. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:16,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.979')] [2023-12-28 02:46:16,219][106226] Updated weights for policy 0, policy_version 1045457 (0.0008) [2023-12-28 02:46:16,278][106226] Updated weights for policy 0, policy_version 1045467 (0.0008) [2023-12-28 02:46:16,303][106225] Updated weights for policy 1, policy_version 1047994 (0.0010) [2023-12-28 02:46:16,349][106225] Updated weights for policy 1, policy_version 1048004 (0.0010) [2023-12-28 02:46:16,395][106225] Updated weights for policy 1, policy_version 1048014 (0.0010) [2023-12-28 02:46:16,451][106225] Updated weights for policy 1, policy_version 1048024 (0.0010) [2023-12-28 02:46:17,012][106226] Updated weights for policy 0, policy_version 1045477 (0.0007) [2023-12-28 02:46:17,077][106226] Updated weights for policy 0, policy_version 1045487 (0.0008) [2023-12-28 02:46:17,143][106226] Updated weights for policy 0, policy_version 1045497 (0.0009) [2023-12-28 02:46:17,166][106225] Updated weights for policy 1, policy_version 1048034 (0.0006) [2023-12-28 02:46:17,223][106225] Updated weights for policy 1, policy_version 1048044 (0.0007) [2023-12-28 02:46:17,272][106225] Updated weights for policy 1, policy_version 1048054 (0.0008) [2023-12-28 02:46:17,831][106226] Updated weights for policy 0, policy_version 1045507 (0.0007) [2023-12-28 02:46:17,889][106226] Updated weights for policy 0, policy_version 1045517 (0.0008) [2023-12-28 02:46:17,941][106226] Updated weights for policy 0, policy_version 1045527 (0.0009) [2023-12-28 02:46:18,013][106225] Updated weights for policy 1, policy_version 1048064 (0.0007) [2023-12-28 02:46:18,067][106225] Updated weights for policy 1, policy_version 1048074 (0.0008) [2023-12-28 02:46:18,126][106225] Updated weights for policy 1, policy_version 1048084 (0.0009) [2023-12-28 02:46:18,699][106226] Updated weights for policy 0, policy_version 1045537 (0.0008) [2023-12-28 02:46:18,759][106226] Updated weights for policy 0, policy_version 1045547 (0.0008) [2023-12-28 02:46:18,815][106226] Updated weights for policy 0, policy_version 1045557 (0.0008) [2023-12-28 02:46:18,877][106226] Updated weights for policy 0, policy_version 1045567 (0.0007) [2023-12-28 02:46:18,879][106225] Updated weights for policy 1, policy_version 1048094 (0.0010) [2023-12-28 02:46:18,950][106225] Updated weights for policy 1, policy_version 1048104 (0.0010) [2023-12-28 02:46:19,010][106225] Updated weights for policy 1, policy_version 1048114 (0.0010) [2023-12-28 02:46:19,563][106226] Updated weights for policy 0, policy_version 1045577 (0.0006) [2023-12-28 02:46:19,632][106226] Updated weights for policy 0, policy_version 1045587 (0.0009) [2023-12-28 02:46:19,693][106226] Updated weights for policy 0, policy_version 1045597 (0.0009) [2023-12-28 02:46:19,758][106225] Updated weights for policy 1, policy_version 1048124 (0.0009) [2023-12-28 02:46:19,819][106225] Updated weights for policy 1, policy_version 1048134 (0.0009) [2023-12-28 02:46:19,886][106225] Updated weights for policy 1, policy_version 1048144 (0.0008) [2023-12-28 02:46:20,452][106226] Updated weights for policy 0, policy_version 1045607 (0.0007) [2023-12-28 02:46:20,498][106226] Updated weights for policy 0, policy_version 1045617 (0.0005) [2023-12-28 02:46:20,543][106226] Updated weights for policy 0, policy_version 1045627 (0.0005) [2023-12-28 02:46:20,675][106225] Updated weights for policy 1, policy_version 1048154 (0.0009) [2023-12-28 02:46:20,745][106225] Updated weights for policy 1, policy_version 1048164 (0.0008) [2023-12-28 02:46:20,810][106225] Updated weights for policy 1, policy_version 1048174 (0.0008) [2023-12-28 02:46:20,874][106225] Updated weights for policy 1, policy_version 1048184 (0.0008) [2023-12-28 02:46:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 536117248. Throughput: 0: 9784.1, 1: 9748.5. Samples: 536128036. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:21,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.936')] [2023-12-28 02:46:21,238][106226] Updated weights for policy 0, policy_version 1045637 (0.0009) [2023-12-28 02:46:21,305][106226] Updated weights for policy 0, policy_version 1045647 (0.0009) [2023-12-28 02:46:21,371][106226] Updated weights for policy 0, policy_version 1045657 (0.0008) [2023-12-28 02:46:21,609][106225] Updated weights for policy 1, policy_version 1048194 (0.0009) [2023-12-28 02:46:21,687][106225] Updated weights for policy 1, policy_version 1048204 (0.0008) [2023-12-28 02:46:21,749][106225] Updated weights for policy 1, policy_version 1048214 (0.0006) [2023-12-28 02:46:22,194][106226] Updated weights for policy 0, policy_version 1045667 (0.0009) [2023-12-28 02:46:22,269][106226] Updated weights for policy 0, policy_version 1045677 (0.0008) [2023-12-28 02:46:22,321][106226] Updated weights for policy 0, policy_version 1045687 (0.0006) [2023-12-28 02:46:22,466][106225] Updated weights for policy 1, policy_version 1048224 (0.0008) [2023-12-28 02:46:22,535][106225] Updated weights for policy 1, policy_version 1048234 (0.0009) [2023-12-28 02:46:22,593][106225] Updated weights for policy 1, policy_version 1048244 (0.0009) [2023-12-28 02:46:23,033][106226] Updated weights for policy 0, policy_version 1045697 (0.0009) [2023-12-28 02:46:23,102][106226] Updated weights for policy 0, policy_version 1045707 (0.0008) [2023-12-28 02:46:23,160][106226] Updated weights for policy 0, policy_version 1045717 (0.0008) [2023-12-28 02:46:23,223][106226] Updated weights for policy 0, policy_version 1045727 (0.0008) [2023-12-28 02:46:23,339][106225] Updated weights for policy 1, policy_version 1048254 (0.0006) [2023-12-28 02:46:23,403][106225] Updated weights for policy 1, policy_version 1048264 (0.0010) [2023-12-28 02:46:23,459][106225] Updated weights for policy 1, policy_version 1048274 (0.0010) [2023-12-28 02:46:23,893][106226] Updated weights for policy 0, policy_version 1045737 (0.0010) [2023-12-28 02:46:23,937][106226] Updated weights for policy 0, policy_version 1045747 (0.0011) [2023-12-28 02:46:23,984][106226] Updated weights for policy 0, policy_version 1045757 (0.0010) [2023-12-28 02:46:24,064][106225] Updated weights for policy 1, policy_version 1048284 (0.0008) [2023-12-28 02:46:24,121][106225] Updated weights for policy 1, policy_version 1048294 (0.0005) [2023-12-28 02:46:24,173][106225] Updated weights for policy 1, policy_version 1048304 (0.0005) [2023-12-28 02:46:24,729][106226] Updated weights for policy 0, policy_version 1045767 (0.0010) [2023-12-28 02:46:24,757][106225] Updated weights for policy 1, policy_version 1048314 (0.0006) [2023-12-28 02:46:24,782][106226] Updated weights for policy 0, policy_version 1045777 (0.0010) [2023-12-28 02:46:24,804][106225] Updated weights for policy 1, policy_version 1048324 (0.0006) [2023-12-28 02:46:24,842][106226] Updated weights for policy 0, policy_version 1045787 (0.0010) [2023-12-28 02:46:24,855][106225] Updated weights for policy 1, policy_version 1048334 (0.0007) [2023-12-28 02:46:24,921][106225] Updated weights for policy 1, policy_version 1048344 (0.0008) [2023-12-28 02:46:25,514][106226] Updated weights for policy 0, policy_version 1045797 (0.0006) [2023-12-28 02:46:25,549][106225] Updated weights for policy 1, policy_version 1048354 (0.0009) [2023-12-28 02:46:25,574][106226] Updated weights for policy 0, policy_version 1045807 (0.0009) [2023-12-28 02:46:25,609][106225] Updated weights for policy 1, policy_version 1048364 (0.0007) [2023-12-28 02:46:25,633][106226] Updated weights for policy 0, policy_version 1045817 (0.0009) [2023-12-28 02:46:25,672][106225] Updated weights for policy 1, policy_version 1048374 (0.0008) [2023-12-28 02:46:26,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 536215552. Throughput: 0: 9776.8, 1: 9747.6. Samples: 536184572. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:26,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-5.025')] [2023-12-28 02:46:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001048376_268427264.pth... [2023-12-28 02:46:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001045824_267788288.pth... [2023-12-28 02:46:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001047256_268140544.pth [2023-12-28 02:46:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001044704_267501568.pth [2023-12-28 02:46:26,297][106225] Updated weights for policy 1, policy_version 1048384 (0.0008) [2023-12-28 02:46:26,349][106225] Updated weights for policy 1, policy_version 1048394 (0.0008) [2023-12-28 02:46:26,381][106226] Updated weights for policy 0, policy_version 1045827 (0.0007) [2023-12-28 02:46:26,407][106225] Updated weights for policy 1, policy_version 1048404 (0.0008) [2023-12-28 02:46:26,449][106226] Updated weights for policy 0, policy_version 1045837 (0.0005) [2023-12-28 02:46:26,509][106226] Updated weights for policy 0, policy_version 1045847 (0.0005) [2023-12-28 02:46:27,067][106226] Updated weights for policy 0, policy_version 1045857 (0.0006) [2023-12-28 02:46:27,123][106226] Updated weights for policy 0, policy_version 1045867 (0.0007) [2023-12-28 02:46:27,164][106225] Updated weights for policy 1, policy_version 1048414 (0.0006) [2023-12-28 02:46:27,191][106226] Updated weights for policy 0, policy_version 1045877 (0.0006) [2023-12-28 02:46:27,226][106225] Updated weights for policy 1, policy_version 1048424 (0.0008) [2023-12-28 02:46:27,247][106226] Updated weights for policy 0, policy_version 1045887 (0.0007) [2023-12-28 02:46:27,276][106225] Updated weights for policy 1, policy_version 1048434 (0.0008) [2023-12-28 02:46:27,779][106226] Updated weights for policy 0, policy_version 1045897 (0.0010) [2023-12-28 02:46:27,828][106226] Updated weights for policy 0, policy_version 1045907 (0.0005) [2023-12-28 02:46:27,891][106226] Updated weights for policy 0, policy_version 1045917 (0.0005) [2023-12-28 02:46:28,060][106225] Updated weights for policy 1, policy_version 1048444 (0.0009) [2023-12-28 02:46:28,108][106225] Updated weights for policy 1, policy_version 1048454 (0.0008) [2023-12-28 02:46:28,159][106225] Updated weights for policy 1, policy_version 1048464 (0.0006) [2023-12-28 02:46:28,442][106226] Updated weights for policy 0, policy_version 1045927 (0.0006) [2023-12-28 02:46:28,503][106226] Updated weights for policy 0, policy_version 1045937 (0.0007) [2023-12-28 02:46:28,573][106226] Updated weights for policy 0, policy_version 1045947 (0.0005) [2023-12-28 02:46:28,932][106225] Updated weights for policy 1, policy_version 1048474 (0.0007) [2023-12-28 02:46:28,985][106225] Updated weights for policy 1, policy_version 1048484 (0.0005) [2023-12-28 02:46:29,044][106225] Updated weights for policy 1, policy_version 1048494 (0.0005) [2023-12-28 02:46:29,103][106225] Updated weights for policy 1, policy_version 1048504 (0.0007) [2023-12-28 02:46:29,199][106226] Updated weights for policy 0, policy_version 1045957 (0.0008) [2023-12-28 02:46:29,266][106226] Updated weights for policy 0, policy_version 1045967 (0.0008) [2023-12-28 02:46:29,332][106226] Updated weights for policy 0, policy_version 1045977 (0.0010) [2023-12-28 02:46:29,727][106225] Updated weights for policy 1, policy_version 1048514 (0.0011) [2023-12-28 02:46:29,779][106225] Updated weights for policy 1, policy_version 1048525 (0.0006) [2023-12-28 02:46:29,854][106225] Updated weights for policy 1, policy_version 1048535 (0.0008) [2023-12-28 02:46:30,023][106226] Updated weights for policy 0, policy_version 1045987 (0.0009) [2023-12-28 02:46:30,085][106226] Updated weights for policy 0, policy_version 1045997 (0.0009) [2023-12-28 02:46:30,146][106226] Updated weights for policy 0, policy_version 1046007 (0.0007) [2023-12-28 02:46:30,621][106225] Updated weights for policy 1, policy_version 1048545 (0.0007) [2023-12-28 02:46:30,684][106225] Updated weights for policy 1, policy_version 1048555 (0.0008) [2023-12-28 02:46:30,721][106226] Updated weights for policy 0, policy_version 1046017 (0.0005) [2023-12-28 02:46:30,747][106225] Updated weights for policy 1, policy_version 1048565 (0.0008) [2023-12-28 02:46:30,773][106226] Updated weights for policy 0, policy_version 1046027 (0.0005) [2023-12-28 02:46:30,838][106226] Updated weights for policy 0, policy_version 1046037 (0.0008) [2023-12-28 02:46:30,898][106226] Updated weights for policy 0, policy_version 1046047 (0.0009) [2023-12-28 02:46:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 536322048. Throughput: 0: 9912.0, 1: 9817.2. Samples: 536310708. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:31,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.900')] [2023-12-28 02:46:31,486][106225] Updated weights for policy 1, policy_version 1048575 (0.0008) [2023-12-28 02:46:31,551][106225] Updated weights for policy 1, policy_version 1048585 (0.0008) [2023-12-28 02:46:31,610][106225] Updated weights for policy 1, policy_version 1048595 (0.0008) [2023-12-28 02:46:31,614][106226] Updated weights for policy 0, policy_version 1046057 (0.0007) [2023-12-28 02:46:31,678][106226] Updated weights for policy 0, policy_version 1046067 (0.0009) [2023-12-28 02:46:31,746][106226] Updated weights for policy 0, policy_version 1046077 (0.0008) [2023-12-28 02:46:32,266][106225] Updated weights for policy 1, policy_version 1048605 (0.0009) [2023-12-28 02:46:32,327][106225] Updated weights for policy 1, policy_version 1048615 (0.0010) [2023-12-28 02:46:32,395][106225] Updated weights for policy 1, policy_version 1048625 (0.0010) [2023-12-28 02:46:32,587][106226] Updated weights for policy 0, policy_version 1046087 (0.0009) [2023-12-28 02:46:32,646][106226] Updated weights for policy 0, policy_version 1046097 (0.0007) [2023-12-28 02:46:32,700][106226] Updated weights for policy 0, policy_version 1046107 (0.0010) [2023-12-28 02:46:33,178][106225] Updated weights for policy 1, policy_version 1048635 (0.0008) [2023-12-28 02:46:33,234][106225] Updated weights for policy 1, policy_version 1048645 (0.0007) [2023-12-28 02:46:33,286][106225] Updated weights for policy 1, policy_version 1048655 (0.0007) [2023-12-28 02:46:33,303][106226] Updated weights for policy 0, policy_version 1046117 (0.0011) [2023-12-28 02:46:33,352][106226] Updated weights for policy 0, policy_version 1046127 (0.0010) [2023-12-28 02:46:33,402][106226] Updated weights for policy 0, policy_version 1046137 (0.0010) [2023-12-28 02:46:34,028][106226] Updated weights for policy 0, policy_version 1046147 (0.0010) [2023-12-28 02:46:34,034][106225] Updated weights for policy 1, policy_version 1048665 (0.0006) [2023-12-28 02:46:34,087][106226] Updated weights for policy 0, policy_version 1046157 (0.0010) [2023-12-28 02:46:34,089][106225] Updated weights for policy 1, policy_version 1048675 (0.0005) [2023-12-28 02:46:34,153][106226] Updated weights for policy 0, policy_version 1046167 (0.0010) [2023-12-28 02:46:34,156][106225] Updated weights for policy 1, policy_version 1048685 (0.0007) [2023-12-28 02:46:34,218][106225] Updated weights for policy 1, policy_version 1048695 (0.0009) [2023-12-28 02:46:34,836][106226] Updated weights for policy 0, policy_version 1046177 (0.0010) [2023-12-28 02:46:34,896][106226] Updated weights for policy 0, policy_version 1046187 (0.0010) [2023-12-28 02:46:34,907][106225] Updated weights for policy 1, policy_version 1048705 (0.0011) [2023-12-28 02:46:34,953][106226] Updated weights for policy 0, policy_version 1046197 (0.0010) [2023-12-28 02:46:34,966][106225] Updated weights for policy 1, policy_version 1048715 (0.0010) [2023-12-28 02:46:35,011][106226] Updated weights for policy 0, policy_version 1046207 (0.0010) [2023-12-28 02:46:35,026][106225] Updated weights for policy 1, policy_version 1048725 (0.0007) [2023-12-28 02:46:35,694][106226] Updated weights for policy 0, policy_version 1046217 (0.0007) [2023-12-28 02:46:35,737][106225] Updated weights for policy 1, policy_version 1048735 (0.0010) [2023-12-28 02:46:35,757][106226] Updated weights for policy 0, policy_version 1046227 (0.0007) [2023-12-28 02:46:35,798][106225] Updated weights for policy 1, policy_version 1048745 (0.0010) [2023-12-28 02:46:35,819][106226] Updated weights for policy 0, policy_version 1046237 (0.0006) [2023-12-28 02:46:35,858][106225] Updated weights for policy 1, policy_version 1048755 (0.0010) [2023-12-28 02:46:36,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 536420352. Throughput: 0: 9915.7, 1: 9829.8. Samples: 536429516. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:36,176][105115] Avg episode reward: [(0, '-4.637'), (1, '-5.306')] [2023-12-28 02:46:36,502][106226] Updated weights for policy 0, policy_version 1046247 (0.0008) [2023-12-28 02:46:36,555][106225] Updated weights for policy 1, policy_version 1048765 (0.0007) [2023-12-28 02:46:36,561][106226] Updated weights for policy 0, policy_version 1046257 (0.0006) [2023-12-28 02:46:36,616][106225] Updated weights for policy 1, policy_version 1048775 (0.0007) [2023-12-28 02:46:36,621][106226] Updated weights for policy 0, policy_version 1046267 (0.0007) [2023-12-28 02:46:36,674][106225] Updated weights for policy 1, policy_version 1048785 (0.0010) [2023-12-28 02:46:37,315][106225] Updated weights for policy 1, policy_version 1048795 (0.0008) [2023-12-28 02:46:37,317][106226] Updated weights for policy 0, policy_version 1046277 (0.0008) [2023-12-28 02:46:37,369][106225] Updated weights for policy 1, policy_version 1048805 (0.0005) [2023-12-28 02:46:37,371][106226] Updated weights for policy 0, policy_version 1046287 (0.0007) [2023-12-28 02:46:37,421][106226] Updated weights for policy 0, policy_version 1046297 (0.0006) [2023-12-28 02:46:37,427][106225] Updated weights for policy 1, policy_version 1048815 (0.0007) [2023-12-28 02:46:38,036][106225] Updated weights for policy 1, policy_version 1048825 (0.0008) [2023-12-28 02:46:38,075][106226] Updated weights for policy 0, policy_version 1046307 (0.0006) [2023-12-28 02:46:38,099][106225] Updated weights for policy 1, policy_version 1048835 (0.0008) [2023-12-28 02:46:38,135][106226] Updated weights for policy 0, policy_version 1046317 (0.0007) [2023-12-28 02:46:38,158][106225] Updated weights for policy 1, policy_version 1048845 (0.0006) [2023-12-28 02:46:38,189][106226] Updated weights for policy 0, policy_version 1046327 (0.0006) [2023-12-28 02:46:38,223][106225] Updated weights for policy 1, policy_version 1048855 (0.0005) [2023-12-28 02:46:38,842][106225] Updated weights for policy 1, policy_version 1048865 (0.0006) [2023-12-28 02:46:38,905][106225] Updated weights for policy 1, policy_version 1048875 (0.0007) [2023-12-28 02:46:38,916][106226] Updated weights for policy 0, policy_version 1046337 (0.0006) [2023-12-28 02:46:38,962][106225] Updated weights for policy 1, policy_version 1048885 (0.0008) [2023-12-28 02:46:38,979][106226] Updated weights for policy 0, policy_version 1046347 (0.0006) [2023-12-28 02:46:39,040][106226] Updated weights for policy 0, policy_version 1046357 (0.0009) [2023-12-28 02:46:39,099][106226] Updated weights for policy 0, policy_version 1046367 (0.0007) [2023-12-28 02:46:39,625][106225] Updated weights for policy 1, policy_version 1048895 (0.0007) [2023-12-28 02:46:39,688][106225] Updated weights for policy 1, policy_version 1048905 (0.0008) [2023-12-28 02:46:39,754][106225] Updated weights for policy 1, policy_version 1048915 (0.0009) [2023-12-28 02:46:39,853][106226] Updated weights for policy 0, policy_version 1046377 (0.0008) [2023-12-28 02:46:39,916][106226] Updated weights for policy 0, policy_version 1046387 (0.0009) [2023-12-28 02:46:39,984][106226] Updated weights for policy 0, policy_version 1046397 (0.0008) [2023-12-28 02:46:40,519][106225] Updated weights for policy 1, policy_version 1048925 (0.0008) [2023-12-28 02:46:40,579][106225] Updated weights for policy 1, policy_version 1048935 (0.0008) [2023-12-28 02:46:40,639][106225] Updated weights for policy 1, policy_version 1048945 (0.0008) [2023-12-28 02:46:40,719][106226] Updated weights for policy 0, policy_version 1046407 (0.0006) [2023-12-28 02:46:40,781][106226] Updated weights for policy 0, policy_version 1046417 (0.0009) [2023-12-28 02:46:40,847][106226] Updated weights for policy 0, policy_version 1046427 (0.0009) [2023-12-28 02:46:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 536518656. Throughput: 0: 9897.1, 1: 9890.8. Samples: 536490312. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:41,176][105115] Avg episode reward: [(0, '-4.631'), (1, '-5.043')] [2023-12-28 02:46:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001046432_267943936.pth... [2023-12-28 02:46:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001048952_268574720.pth... [2023-12-28 02:46:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001045280_267649024.pth [2023-12-28 02:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001047800_268279808.pth [2023-12-28 02:46:41,440][106225] Updated weights for policy 1, policy_version 1048955 (0.0009) [2023-12-28 02:46:41,492][106225] Updated weights for policy 1, policy_version 1048965 (0.0008) [2023-12-28 02:46:41,536][106226] Updated weights for policy 0, policy_version 1046437 (0.0007) [2023-12-28 02:46:41,548][106225] Updated weights for policy 1, policy_version 1048975 (0.0008) [2023-12-28 02:46:41,600][106226] Updated weights for policy 0, policy_version 1046447 (0.0007) [2023-12-28 02:46:41,665][106226] Updated weights for policy 0, policy_version 1046457 (0.0007) [2023-12-28 02:46:42,260][106225] Updated weights for policy 1, policy_version 1048985 (0.0007) [2023-12-28 02:46:42,324][106225] Updated weights for policy 1, policy_version 1048995 (0.0008) [2023-12-28 02:46:42,393][106225] Updated weights for policy 1, policy_version 1049005 (0.0009) [2023-12-28 02:46:42,457][106225] Updated weights for policy 1, policy_version 1049015 (0.0008) [2023-12-28 02:46:42,492][106226] Updated weights for policy 0, policy_version 1046467 (0.0009) [2023-12-28 02:46:42,554][106226] Updated weights for policy 0, policy_version 1046477 (0.0009) [2023-12-28 02:46:42,626][106226] Updated weights for policy 0, policy_version 1046487 (0.0008) [2023-12-28 02:46:43,064][106225] Updated weights for policy 1, policy_version 1049025 (0.0006) [2023-12-28 02:46:43,130][106225] Updated weights for policy 1, policy_version 1049035 (0.0006) [2023-12-28 02:46:43,190][106225] Updated weights for policy 1, policy_version 1049045 (0.0006) [2023-12-28 02:46:43,347][106226] Updated weights for policy 0, policy_version 1046497 (0.0006) [2023-12-28 02:46:43,402][106226] Updated weights for policy 0, policy_version 1046507 (0.0005) [2023-12-28 02:46:43,451][106226] Updated weights for policy 0, policy_version 1046517 (0.0005) [2023-12-28 02:46:43,503][106226] Updated weights for policy 0, policy_version 1046527 (0.0005) [2023-12-28 02:46:43,889][106225] Updated weights for policy 1, policy_version 1049055 (0.0006) [2023-12-28 02:46:43,943][106225] Updated weights for policy 1, policy_version 1049065 (0.0005) [2023-12-28 02:46:44,007][106225] Updated weights for policy 1, policy_version 1049075 (0.0005) [2023-12-28 02:46:44,116][106226] Updated weights for policy 0, policy_version 1046537 (0.0010) [2023-12-28 02:46:44,166][106226] Updated weights for policy 0, policy_version 1046547 (0.0010) [2023-12-28 02:46:44,222][106226] Updated weights for policy 0, policy_version 1046557 (0.0010) [2023-12-28 02:46:44,632][106225] Updated weights for policy 1, policy_version 1049085 (0.0005) [2023-12-28 02:46:44,683][106225] Updated weights for policy 1, policy_version 1049095 (0.0008) [2023-12-28 02:46:44,734][106225] Updated weights for policy 1, policy_version 1049106 (0.0008) [2023-12-28 02:46:44,845][106226] Updated weights for policy 0, policy_version 1046567 (0.0009) [2023-12-28 02:46:44,904][106226] Updated weights for policy 0, policy_version 1046577 (0.0008) [2023-12-28 02:46:44,967][106226] Updated weights for policy 0, policy_version 1046587 (0.0008) [2023-12-28 02:46:45,469][106225] Updated weights for policy 1, policy_version 1049116 (0.0009) [2023-12-28 02:46:45,527][106225] Updated weights for policy 1, policy_version 1049126 (0.0009) [2023-12-28 02:46:45,584][106225] Updated weights for policy 1, policy_version 1049136 (0.0010) [2023-12-28 02:46:45,609][106226] Updated weights for policy 0, policy_version 1046597 (0.0008) [2023-12-28 02:46:45,674][106226] Updated weights for policy 0, policy_version 1046607 (0.0007) [2023-12-28 02:46:45,721][106226] Updated weights for policy 0, policy_version 1046617 (0.0008) [2023-12-28 02:46:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 536616960. Throughput: 0: 9858.3, 1: 9772.9. Samples: 536608656. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:46,176][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.049')] [2023-12-28 02:46:46,211][106225] Updated weights for policy 1, policy_version 1049146 (0.0010) [2023-12-28 02:46:46,266][106225] Updated weights for policy 1, policy_version 1049156 (0.0010) [2023-12-28 02:46:46,312][106225] Updated weights for policy 1, policy_version 1049166 (0.0010) [2023-12-28 02:46:46,358][106225] Updated weights for policy 1, policy_version 1049176 (0.0010) [2023-12-28 02:46:46,477][106226] Updated weights for policy 0, policy_version 1046627 (0.0010) [2023-12-28 02:46:46,534][106226] Updated weights for policy 0, policy_version 1046637 (0.0008) [2023-12-28 02:46:46,582][106226] Updated weights for policy 0, policy_version 1046647 (0.0005) [2023-12-28 02:46:47,097][106225] Updated weights for policy 1, policy_version 1049186 (0.0010) [2023-12-28 02:46:47,154][106225] Updated weights for policy 1, policy_version 1049196 (0.0010) [2023-12-28 02:46:47,177][106226] Updated weights for policy 0, policy_version 1046657 (0.0010) [2023-12-28 02:46:47,214][106225] Updated weights for policy 1, policy_version 1049206 (0.0010) [2023-12-28 02:46:47,228][106226] Updated weights for policy 0, policy_version 1046667 (0.0005) [2023-12-28 02:46:47,275][106226] Updated weights for policy 0, policy_version 1046677 (0.0009) [2023-12-28 02:46:47,333][106226] Updated weights for policy 0, policy_version 1046687 (0.0005) [2023-12-28 02:46:47,935][106226] Updated weights for policy 0, policy_version 1046697 (0.0010) [2023-12-28 02:46:47,941][106225] Updated weights for policy 1, policy_version 1049216 (0.0011) [2023-12-28 02:46:47,989][106226] Updated weights for policy 0, policy_version 1046707 (0.0011) [2023-12-28 02:46:48,003][106225] Updated weights for policy 1, policy_version 1049226 (0.0011) [2023-12-28 02:46:48,055][106225] Updated weights for policy 1, policy_version 1049236 (0.0010) [2023-12-28 02:46:48,057][106226] Updated weights for policy 0, policy_version 1046717 (0.0011) [2023-12-28 02:46:48,792][106225] Updated weights for policy 1, policy_version 1049246 (0.0011) [2023-12-28 02:46:48,817][106226] Updated weights for policy 0, policy_version 1046727 (0.0011) [2023-12-28 02:46:48,851][106225] Updated weights for policy 1, policy_version 1049256 (0.0010) [2023-12-28 02:46:48,878][106226] Updated weights for policy 0, policy_version 1046737 (0.0011) [2023-12-28 02:46:48,905][106225] Updated weights for policy 1, policy_version 1049266 (0.0010) [2023-12-28 02:46:48,940][106226] Updated weights for policy 0, policy_version 1046747 (0.0011) [2023-12-28 02:46:49,637][106225] Updated weights for policy 1, policy_version 1049276 (0.0010) [2023-12-28 02:46:49,672][106226] Updated weights for policy 0, policy_version 1046757 (0.0008) [2023-12-28 02:46:49,693][106225] Updated weights for policy 1, policy_version 1049286 (0.0008) [2023-12-28 02:46:49,731][106226] Updated weights for policy 0, policy_version 1046767 (0.0007) [2023-12-28 02:46:49,749][106225] Updated weights for policy 1, policy_version 1049296 (0.0007) [2023-12-28 02:46:49,790][106226] Updated weights for policy 0, policy_version 1046777 (0.0006) [2023-12-28 02:46:50,456][106225] Updated weights for policy 1, policy_version 1049306 (0.0008) [2023-12-28 02:46:50,516][106225] Updated weights for policy 1, policy_version 1049316 (0.0006) [2023-12-28 02:46:50,521][106226] Updated weights for policy 0, policy_version 1046787 (0.0007) [2023-12-28 02:46:50,580][106225] Updated weights for policy 1, policy_version 1049326 (0.0007) [2023-12-28 02:46:50,598][106226] Updated weights for policy 0, policy_version 1046797 (0.0007) [2023-12-28 02:46:50,643][106225] Updated weights for policy 1, policy_version 1049336 (0.0006) [2023-12-28 02:46:50,669][106226] Updated weights for policy 0, policy_version 1046807 (0.0008) [2023-12-28 02:46:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 536715264. Throughput: 0: 9929.4, 1: 9763.3. Samples: 536727824. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:51,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-5.294')] [2023-12-28 02:46:51,349][106225] Updated weights for policy 1, policy_version 1049346 (0.0008) [2023-12-28 02:46:51,397][106226] Updated weights for policy 0, policy_version 1046817 (0.0008) [2023-12-28 02:46:51,419][106225] Updated weights for policy 1, policy_version 1049356 (0.0007) [2023-12-28 02:46:51,460][106226] Updated weights for policy 0, policy_version 1046827 (0.0008) [2023-12-28 02:46:51,470][106225] Updated weights for policy 1, policy_version 1049366 (0.0006) [2023-12-28 02:46:51,518][106226] Updated weights for policy 0, policy_version 1046837 (0.0007) [2023-12-28 02:46:51,576][106226] Updated weights for policy 0, policy_version 1046847 (0.0008) [2023-12-28 02:46:52,215][106225] Updated weights for policy 1, policy_version 1049376 (0.0005) [2023-12-28 02:46:52,271][106225] Updated weights for policy 1, policy_version 1049386 (0.0007) [2023-12-28 02:46:52,330][106225] Updated weights for policy 1, policy_version 1049396 (0.0007) [2023-12-28 02:46:52,372][106226] Updated weights for policy 0, policy_version 1046857 (0.0008) [2023-12-28 02:46:52,429][106226] Updated weights for policy 0, policy_version 1046867 (0.0008) [2023-12-28 02:46:52,488][106226] Updated weights for policy 0, policy_version 1046877 (0.0009) [2023-12-28 02:46:52,978][106225] Updated weights for policy 1, policy_version 1049406 (0.0006) [2023-12-28 02:46:53,032][106225] Updated weights for policy 1, policy_version 1049416 (0.0005) [2023-12-28 02:46:53,088][106225] Updated weights for policy 1, policy_version 1049426 (0.0008) [2023-12-28 02:46:53,248][106226] Updated weights for policy 0, policy_version 1046887 (0.0008) [2023-12-28 02:46:53,296][106226] Updated weights for policy 0, policy_version 1046897 (0.0008) [2023-12-28 02:46:53,351][106226] Updated weights for policy 0, policy_version 1046907 (0.0009) [2023-12-28 02:46:53,813][106225] Updated weights for policy 1, policy_version 1049436 (0.0009) [2023-12-28 02:46:53,873][106225] Updated weights for policy 1, policy_version 1049446 (0.0007) [2023-12-28 02:46:53,933][106225] Updated weights for policy 1, policy_version 1049456 (0.0009) [2023-12-28 02:46:53,992][106226] Updated weights for policy 0, policy_version 1046917 (0.0008) [2023-12-28 02:46:54,042][106226] Updated weights for policy 0, policy_version 1046927 (0.0009) [2023-12-28 02:46:54,096][106226] Updated weights for policy 0, policy_version 1046937 (0.0009) [2023-12-28 02:46:54,541][106225] Updated weights for policy 1, policy_version 1049466 (0.0006) [2023-12-28 02:46:54,602][106225] Updated weights for policy 1, policy_version 1049476 (0.0009) [2023-12-28 02:46:54,655][106225] Updated weights for policy 1, policy_version 1049486 (0.0006) [2023-12-28 02:46:54,715][106225] Updated weights for policy 1, policy_version 1049496 (0.0005) [2023-12-28 02:46:54,908][106226] Updated weights for policy 0, policy_version 1046947 (0.0009) [2023-12-28 02:46:54,966][106226] Updated weights for policy 0, policy_version 1046957 (0.0008) [2023-12-28 02:46:55,022][106226] Updated weights for policy 0, policy_version 1046967 (0.0009) [2023-12-28 02:46:55,334][106225] Updated weights for policy 1, policy_version 1049506 (0.0008) [2023-12-28 02:46:55,386][106225] Updated weights for policy 1, policy_version 1049516 (0.0005) [2023-12-28 02:46:55,441][106225] Updated weights for policy 1, policy_version 1049526 (0.0005) [2023-12-28 02:46:55,789][106226] Updated weights for policy 0, policy_version 1046977 (0.0009) [2023-12-28 02:46:55,839][106226] Updated weights for policy 0, policy_version 1046987 (0.0009) [2023-12-28 02:46:55,887][106226] Updated weights for policy 0, policy_version 1046997 (0.0008) [2023-12-28 02:46:55,942][106226] Updated weights for policy 0, policy_version 1047007 (0.0009) [2023-12-28 02:46:56,091][106225] Updated weights for policy 1, policy_version 1049536 (0.0008) [2023-12-28 02:46:56,145][106225] Updated weights for policy 1, policy_version 1049546 (0.0008) [2023-12-28 02:46:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 536813568. Throughput: 0: 9934.0, 1: 9765.9. Samples: 536784920. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-28 02:46:56,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.792')] [2023-12-28 02:46:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001047008_268091392.pth... [2023-12-28 02:46:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001045824_267788288.pth [2023-12-28 02:46:56,212][106225] Updated weights for policy 1, policy_version 1049556 (0.0009) [2023-12-28 02:46:56,233][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001049560_268730368.pth... [2023-12-28 02:46:56,236][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001048376_268427264.pth [2023-12-28 02:46:56,658][106226] Updated weights for policy 0, policy_version 1047017 (0.0008) [2023-12-28 02:46:56,720][106226] Updated weights for policy 0, policy_version 1047027 (0.0005) [2023-12-28 02:46:56,777][106226] Updated weights for policy 0, policy_version 1047037 (0.0005) [2023-12-28 02:46:56,996][106225] Updated weights for policy 1, policy_version 1049566 (0.0008) [2023-12-28 02:46:57,050][106225] Updated weights for policy 1, policy_version 1049576 (0.0009) [2023-12-28 02:46:57,111][106225] Updated weights for policy 1, policy_version 1049586 (0.0008) [2023-12-28 02:46:57,378][106226] Updated weights for policy 0, policy_version 1047047 (0.0008) [2023-12-28 02:46:57,432][106226] Updated weights for policy 0, policy_version 1047057 (0.0009) [2023-12-28 02:46:57,491][106226] Updated weights for policy 0, policy_version 1047067 (0.0009) [2023-12-28 02:46:57,726][106225] Updated weights for policy 1, policy_version 1049596 (0.0007) [2023-12-28 02:46:57,775][106225] Updated weights for policy 1, policy_version 1049606 (0.0008) [2023-12-28 02:46:57,824][106225] Updated weights for policy 1, policy_version 1049616 (0.0007) [2023-12-28 02:46:58,309][106226] Updated weights for policy 0, policy_version 1047077 (0.0009) [2023-12-28 02:46:58,394][106226] Updated weights for policy 0, policy_version 1047087 (0.0010) [2023-12-28 02:46:58,467][106226] Updated weights for policy 0, policy_version 1047097 (0.0009) [2023-12-28 02:46:58,526][106225] Updated weights for policy 1, policy_version 1049626 (0.0006) [2023-12-28 02:46:58,595][106225] Updated weights for policy 1, policy_version 1049636 (0.0008) [2023-12-28 02:46:58,659][106225] Updated weights for policy 1, policy_version 1049646 (0.0007) [2023-12-28 02:46:58,720][106225] Updated weights for policy 1, policy_version 1049656 (0.0007) [2023-12-28 02:46:59,356][106226] Updated weights for policy 0, policy_version 1047107 (0.0009) [2023-12-28 02:46:59,417][106226] Updated weights for policy 0, policy_version 1047117 (0.0008) [2023-12-28 02:46:59,473][106226] Updated weights for policy 0, policy_version 1047127 (0.0006) [2023-12-28 02:46:59,489][106225] Updated weights for policy 1, policy_version 1049666 (0.0008) [2023-12-28 02:46:59,537][106225] Updated weights for policy 1, policy_version 1049676 (0.0007) [2023-12-28 02:46:59,585][106225] Updated weights for policy 1, policy_version 1049686 (0.0008) [2023-12-28 02:47:00,238][106225] Updated weights for policy 1, policy_version 1049696 (0.0007) [2023-12-28 02:47:00,253][106226] Updated weights for policy 0, policy_version 1047137 (0.0006) [2023-12-28 02:47:00,296][106225] Updated weights for policy 1, policy_version 1049706 (0.0008) [2023-12-28 02:47:00,305][106226] Updated weights for policy 0, policy_version 1047147 (0.0009) [2023-12-28 02:47:00,355][106225] Updated weights for policy 1, policy_version 1049716 (0.0007) [2023-12-28 02:47:00,368][106226] Updated weights for policy 0, policy_version 1047157 (0.0006) [2023-12-28 02:47:00,419][106226] Updated weights for policy 0, policy_version 1047167 (0.0008) [2023-12-28 02:47:01,056][106225] Updated weights for policy 1, policy_version 1049726 (0.0007) [2023-12-28 02:47:01,114][106225] Updated weights for policy 1, policy_version 1049736 (0.0008) [2023-12-28 02:47:01,151][106226] Updated weights for policy 0, policy_version 1047177 (0.0009) [2023-12-28 02:47:01,174][106225] Updated weights for policy 1, policy_version 1049746 (0.0008) [2023-12-28 02:47:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 536903680. Throughput: 0: 9876.3, 1: 9881.9. Samples: 536901620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:01,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.241')] [2023-12-28 02:47:01,213][106226] Updated weights for policy 0, policy_version 1047187 (0.0006) [2023-12-28 02:47:01,276][106226] Updated weights for policy 0, policy_version 1047197 (0.0008) [2023-12-28 02:47:01,963][106225] Updated weights for policy 1, policy_version 1049756 (0.0008) [2023-12-28 02:47:02,019][106225] Updated weights for policy 1, policy_version 1049766 (0.0008) [2023-12-28 02:47:02,034][106226] Updated weights for policy 0, policy_version 1047207 (0.0008) [2023-12-28 02:47:02,071][106225] Updated weights for policy 1, policy_version 1049776 (0.0006) [2023-12-28 02:47:02,092][106226] Updated weights for policy 0, policy_version 1047217 (0.0008) [2023-12-28 02:47:02,152][106226] Updated weights for policy 0, policy_version 1047227 (0.0009) [2023-12-28 02:47:02,775][106225] Updated weights for policy 1, policy_version 1049786 (0.0008) [2023-12-28 02:47:02,834][106225] Updated weights for policy 1, policy_version 1049796 (0.0008) [2023-12-28 02:47:02,893][106226] Updated weights for policy 0, policy_version 1047237 (0.0008) [2023-12-28 02:47:02,894][106225] Updated weights for policy 1, policy_version 1049806 (0.0007) [2023-12-28 02:47:02,945][106226] Updated weights for policy 0, policy_version 1047247 (0.0005) [2023-12-28 02:47:02,954][106225] Updated weights for policy 1, policy_version 1049816 (0.0007) [2023-12-28 02:47:02,999][106226] Updated weights for policy 0, policy_version 1047257 (0.0005) [2023-12-28 02:47:03,627][106226] Updated weights for policy 0, policy_version 1047267 (0.0008) [2023-12-28 02:47:03,683][106226] Updated weights for policy 0, policy_version 1047277 (0.0007) [2023-12-28 02:47:03,701][106225] Updated weights for policy 1, policy_version 1049826 (0.0006) [2023-12-28 02:47:03,741][106226] Updated weights for policy 0, policy_version 1047287 (0.0011) [2023-12-28 02:47:03,755][106225] Updated weights for policy 1, policy_version 1049836 (0.0006) [2023-12-28 02:47:03,802][106225] Updated weights for policy 1, policy_version 1049846 (0.0006) [2023-12-28 02:47:04,483][106226] Updated weights for policy 0, policy_version 1047297 (0.0010) [2023-12-28 02:47:04,513][106225] Updated weights for policy 1, policy_version 1049856 (0.0006) [2023-12-28 02:47:04,531][106226] Updated weights for policy 0, policy_version 1047307 (0.0006) [2023-12-28 02:47:04,561][106225] Updated weights for policy 1, policy_version 1049866 (0.0006) [2023-12-28 02:47:04,587][106226] Updated weights for policy 0, policy_version 1047317 (0.0006) [2023-12-28 02:47:04,618][106225] Updated weights for policy 1, policy_version 1049876 (0.0008) [2023-12-28 02:47:04,651][106226] Updated weights for policy 0, policy_version 1047327 (0.0005) [2023-12-28 02:47:05,336][106226] Updated weights for policy 0, policy_version 1047337 (0.0009) [2023-12-28 02:47:05,373][106225] Updated weights for policy 1, policy_version 1049886 (0.0007) [2023-12-28 02:47:05,392][106226] Updated weights for policy 0, policy_version 1047347 (0.0008) [2023-12-28 02:47:05,423][106225] Updated weights for policy 1, policy_version 1049896 (0.0005) [2023-12-28 02:47:05,446][106226] Updated weights for policy 0, policy_version 1047357 (0.0008) [2023-12-28 02:47:05,473][106225] Updated weights for policy 1, policy_version 1049906 (0.0007) [2023-12-28 02:47:06,092][106225] Updated weights for policy 1, policy_version 1049916 (0.0007) [2023-12-28 02:47:06,143][106226] Updated weights for policy 0, policy_version 1047369 (0.0009) [2023-12-28 02:47:06,158][106225] Updated weights for policy 1, policy_version 1049926 (0.0008) [2023-12-28 02:47:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 537001984. Throughput: 0: 9878.1, 1: 9911.7. Samples: 537018580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:06,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.210')] [2023-12-28 02:47:06,206][106226] Updated weights for policy 0, policy_version 1047379 (0.0006) [2023-12-28 02:47:06,225][106225] Updated weights for policy 1, policy_version 1049936 (0.0008) [2023-12-28 02:47:06,273][106226] Updated weights for policy 0, policy_version 1047389 (0.0006) [2023-12-28 02:47:06,798][106225] Updated weights for policy 1, policy_version 1049946 (0.0006) [2023-12-28 02:47:06,846][106225] Updated weights for policy 1, policy_version 1049956 (0.0007) [2023-12-28 02:47:06,905][106225] Updated weights for policy 1, policy_version 1049966 (0.0009) [2023-12-28 02:47:06,955][106225] Updated weights for policy 1, policy_version 1049976 (0.0007) [2023-12-28 02:47:06,957][106226] Updated weights for policy 0, policy_version 1047399 (0.0007) [2023-12-28 02:47:07,029][106226] Updated weights for policy 0, policy_version 1047409 (0.0008) [2023-12-28 02:47:07,094][106226] Updated weights for policy 0, policy_version 1047419 (0.0006) [2023-12-28 02:47:07,639][106225] Updated weights for policy 1, policy_version 1049986 (0.0005) [2023-12-28 02:47:07,705][106225] Updated weights for policy 1, policy_version 1049996 (0.0008) [2023-12-28 02:47:07,759][106225] Updated weights for policy 1, policy_version 1050006 (0.0010) [2023-12-28 02:47:07,788][106226] Updated weights for policy 0, policy_version 1047429 (0.0007) [2023-12-28 02:47:07,854][106226] Updated weights for policy 0, policy_version 1047439 (0.0005) [2023-12-28 02:47:07,908][106226] Updated weights for policy 0, policy_version 1047449 (0.0005) [2023-12-28 02:47:08,440][106225] Updated weights for policy 1, policy_version 1050016 (0.0006) [2023-12-28 02:47:08,503][106225] Updated weights for policy 1, policy_version 1050026 (0.0005) [2023-12-28 02:47:08,527][106226] Updated weights for policy 0, policy_version 1047459 (0.0007) [2023-12-28 02:47:08,568][106225] Updated weights for policy 1, policy_version 1050036 (0.0008) [2023-12-28 02:47:08,590][106226] Updated weights for policy 0, policy_version 1047469 (0.0011) [2023-12-28 02:47:08,657][106226] Updated weights for policy 0, policy_version 1047479 (0.0011) [2023-12-28 02:47:09,212][106225] Updated weights for policy 1, policy_version 1050046 (0.0007) [2023-12-28 02:47:09,283][106225] Updated weights for policy 1, policy_version 1050056 (0.0008) [2023-12-28 02:47:09,352][106225] Updated weights for policy 1, policy_version 1050066 (0.0008) [2023-12-28 02:47:09,379][106226] Updated weights for policy 0, policy_version 1047489 (0.0009) [2023-12-28 02:47:09,446][106226] Updated weights for policy 0, policy_version 1047499 (0.0007) [2023-12-28 02:47:09,506][106226] Updated weights for policy 0, policy_version 1047509 (0.0007) [2023-12-28 02:47:09,564][106226] Updated weights for policy 0, policy_version 1047519 (0.0009) [2023-12-28 02:47:10,189][106225] Updated weights for policy 1, policy_version 1050076 (0.0008) [2023-12-28 02:47:10,245][106226] Updated weights for policy 0, policy_version 1047529 (0.0008) [2023-12-28 02:47:10,254][106225] Updated weights for policy 1, policy_version 1050086 (0.0007) [2023-12-28 02:47:10,306][106226] Updated weights for policy 0, policy_version 1047539 (0.0006) [2023-12-28 02:47:10,319][106225] Updated weights for policy 1, policy_version 1050096 (0.0008) [2023-12-28 02:47:10,373][106226] Updated weights for policy 0, policy_version 1047549 (0.0006) [2023-12-28 02:47:10,975][106226] Updated weights for policy 0, policy_version 1047559 (0.0008) [2023-12-28 02:47:11,062][106226] Updated weights for policy 0, policy_version 1047569 (0.0007) [2023-12-28 02:47:11,071][106225] Updated weights for policy 1, policy_version 1050106 (0.0008) [2023-12-28 02:47:11,126][106226] Updated weights for policy 0, policy_version 1047579 (0.0008) [2023-12-28 02:47:11,131][106225] Updated weights for policy 1, policy_version 1050116 (0.0007) [2023-12-28 02:47:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 537108480. Throughput: 0: 9918.4, 1: 10003.3. Samples: 537081048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:11,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.032')] [2023-12-28 02:47:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001047584_268238848.pth... [2023-12-28 02:47:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001046432_267943936.pth [2023-12-28 02:47:11,188][106225] Updated weights for policy 1, policy_version 1050126 (0.0007) [2023-12-28 02:47:11,249][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001050136_268877824.pth... [2023-12-28 02:47:11,252][106225] Updated weights for policy 1, policy_version 1050136 (0.0008) [2023-12-28 02:47:11,253][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001048952_268574720.pth [2023-12-28 02:47:11,926][106226] Updated weights for policy 0, policy_version 1047589 (0.0007) [2023-12-28 02:47:11,996][106226] Updated weights for policy 0, policy_version 1047599 (0.0007) [2023-12-28 02:47:12,049][106226] Updated weights for policy 0, policy_version 1047609 (0.0007) [2023-12-28 02:47:12,052][106225] Updated weights for policy 1, policy_version 1050146 (0.0007) [2023-12-28 02:47:12,118][106225] Updated weights for policy 1, policy_version 1050156 (0.0009) [2023-12-28 02:47:12,179][106225] Updated weights for policy 1, policy_version 1050166 (0.0009) [2023-12-28 02:47:12,732][106226] Updated weights for policy 0, policy_version 1047619 (0.0006) [2023-12-28 02:47:12,796][106226] Updated weights for policy 0, policy_version 1047629 (0.0008) [2023-12-28 02:47:12,860][106226] Updated weights for policy 0, policy_version 1047639 (0.0008) [2023-12-28 02:47:12,885][106225] Updated weights for policy 1, policy_version 1050176 (0.0007) [2023-12-28 02:47:12,948][106225] Updated weights for policy 1, policy_version 1050186 (0.0008) [2023-12-28 02:47:13,008][106225] Updated weights for policy 1, policy_version 1050196 (0.0007) [2023-12-28 02:47:13,431][106226] Updated weights for policy 0, policy_version 1047649 (0.0008) [2023-12-28 02:47:13,498][106226] Updated weights for policy 0, policy_version 1047659 (0.0009) [2023-12-28 02:47:13,561][106226] Updated weights for policy 0, policy_version 1047669 (0.0007) [2023-12-28 02:47:13,612][106226] Updated weights for policy 0, policy_version 1047679 (0.0005) [2023-12-28 02:47:13,718][106225] Updated weights for policy 1, policy_version 1050206 (0.0007) [2023-12-28 02:47:13,773][106225] Updated weights for policy 1, policy_version 1050216 (0.0005) [2023-12-28 02:47:13,826][106225] Updated weights for policy 1, policy_version 1050226 (0.0005) [2023-12-28 02:47:14,301][106226] Updated weights for policy 0, policy_version 1047689 (0.0008) [2023-12-28 02:47:14,349][106226] Updated weights for policy 0, policy_version 1047699 (0.0009) [2023-12-28 02:47:14,377][106225] Updated weights for policy 1, policy_version 1050236 (0.0005) [2023-12-28 02:47:14,403][106226] Updated weights for policy 0, policy_version 1047709 (0.0006) [2023-12-28 02:47:14,429][106225] Updated weights for policy 1, policy_version 1050246 (0.0006) [2023-12-28 02:47:14,484][106225] Updated weights for policy 1, policy_version 1050256 (0.0005) [2023-12-28 02:47:15,075][106226] Updated weights for policy 0, policy_version 1047719 (0.0007) [2023-12-28 02:47:15,095][106225] Updated weights for policy 1, policy_version 1050266 (0.0006) [2023-12-28 02:47:15,138][106226] Updated weights for policy 0, policy_version 1047729 (0.0008) [2023-12-28 02:47:15,157][106225] Updated weights for policy 1, policy_version 1050276 (0.0007) [2023-12-28 02:47:15,202][106226] Updated weights for policy 0, policy_version 1047739 (0.0006) [2023-12-28 02:47:15,220][106225] Updated weights for policy 1, policy_version 1050286 (0.0008) [2023-12-28 02:47:15,289][106225] Updated weights for policy 1, policy_version 1050296 (0.0006) [2023-12-28 02:47:15,878][106225] Updated weights for policy 1, policy_version 1050306 (0.0005) [2023-12-28 02:47:15,915][106226] Updated weights for policy 0, policy_version 1047749 (0.0009) [2023-12-28 02:47:15,934][106225] Updated weights for policy 1, policy_version 1050316 (0.0005) [2023-12-28 02:47:15,973][106226] Updated weights for policy 0, policy_version 1047759 (0.0010) [2023-12-28 02:47:15,989][106225] Updated weights for policy 1, policy_version 1050326 (0.0005) [2023-12-28 02:47:16,037][106226] Updated weights for policy 0, policy_version 1047769 (0.0010) [2023-12-28 02:47:16,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19934.0, 300 sec: 19799.7). Total num frames: 537214976. Throughput: 0: 9835.6, 1: 9930.3. Samples: 537200172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:16,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-5.129')] [2023-12-28 02:47:16,506][106225] Updated weights for policy 1, policy_version 1050336 (0.0005) [2023-12-28 02:47:16,565][106225] Updated weights for policy 1, policy_version 1050346 (0.0007) [2023-12-28 02:47:16,615][106225] Updated weights for policy 1, policy_version 1050356 (0.0008) [2023-12-28 02:47:16,749][106226] Updated weights for policy 0, policy_version 1047779 (0.0010) [2023-12-28 02:47:16,807][106226] Updated weights for policy 0, policy_version 1047789 (0.0005) [2023-12-28 02:47:16,876][106226] Updated weights for policy 0, policy_version 1047799 (0.0006) [2023-12-28 02:47:17,253][106225] Updated weights for policy 1, policy_version 1050366 (0.0009) [2023-12-28 02:47:17,319][106225] Updated weights for policy 1, policy_version 1050376 (0.0010) [2023-12-28 02:47:17,373][106225] Updated weights for policy 1, policy_version 1050386 (0.0009) [2023-12-28 02:47:17,496][106226] Updated weights for policy 0, policy_version 1047809 (0.0009) [2023-12-28 02:47:17,542][106226] Updated weights for policy 0, policy_version 1047819 (0.0008) [2023-12-28 02:47:17,606][106226] Updated weights for policy 0, policy_version 1047829 (0.0008) [2023-12-28 02:47:17,669][106226] Updated weights for policy 0, policy_version 1047839 (0.0009) [2023-12-28 02:47:17,977][106225] Updated weights for policy 1, policy_version 1050396 (0.0007) [2023-12-28 02:47:18,026][106225] Updated weights for policy 1, policy_version 1050406 (0.0005) [2023-12-28 02:47:18,085][106225] Updated weights for policy 1, policy_version 1050416 (0.0005) [2023-12-28 02:47:18,504][106226] Updated weights for policy 0, policy_version 1047849 (0.0007) [2023-12-28 02:47:18,567][106226] Updated weights for policy 0, policy_version 1047859 (0.0009) [2023-12-28 02:47:18,626][106226] Updated weights for policy 0, policy_version 1047869 (0.0009) [2023-12-28 02:47:18,697][106225] Updated weights for policy 1, policy_version 1050426 (0.0006) [2023-12-28 02:47:18,751][106225] Updated weights for policy 1, policy_version 1050436 (0.0008) [2023-12-28 02:47:18,806][106225] Updated weights for policy 1, policy_version 1050446 (0.0008) [2023-12-28 02:47:18,865][106225] Updated weights for policy 1, policy_version 1050456 (0.0008) [2023-12-28 02:47:19,370][106226] Updated weights for policy 0, policy_version 1047879 (0.0009) [2023-12-28 02:47:19,437][106226] Updated weights for policy 0, policy_version 1047889 (0.0009) [2023-12-28 02:47:19,506][106226] Updated weights for policy 0, policy_version 1047899 (0.0010) [2023-12-28 02:47:19,716][106225] Updated weights for policy 1, policy_version 1050466 (0.0008) [2023-12-28 02:47:19,775][106225] Updated weights for policy 1, policy_version 1050476 (0.0008) [2023-12-28 02:47:19,838][106225] Updated weights for policy 1, policy_version 1050486 (0.0008) [2023-12-28 02:47:20,307][106226] Updated weights for policy 0, policy_version 1047909 (0.0010) [2023-12-28 02:47:20,372][106226] Updated weights for policy 0, policy_version 1047919 (0.0009) [2023-12-28 02:47:20,438][106226] Updated weights for policy 0, policy_version 1047929 (0.0010) [2023-12-28 02:47:20,607][106225] Updated weights for policy 1, policy_version 1050496 (0.0009) [2023-12-28 02:47:20,667][106225] Updated weights for policy 1, policy_version 1050506 (0.0008) [2023-12-28 02:47:20,732][106225] Updated weights for policy 1, policy_version 1050516 (0.0008) [2023-12-28 02:47:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 537305088. Throughput: 0: 9716.8, 1: 10048.8. Samples: 537318968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:21,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-4.813')] [2023-12-28 02:47:21,227][106226] Updated weights for policy 0, policy_version 1047939 (0.0008) [2023-12-28 02:47:21,290][106226] Updated weights for policy 0, policy_version 1047949 (0.0008) [2023-12-28 02:47:21,351][106226] Updated weights for policy 0, policy_version 1047959 (0.0008) [2023-12-28 02:47:21,495][106225] Updated weights for policy 1, policy_version 1050526 (0.0008) [2023-12-28 02:47:21,551][106225] Updated weights for policy 1, policy_version 1050536 (0.0008) [2023-12-28 02:47:21,614][106225] Updated weights for policy 1, policy_version 1050546 (0.0008) [2023-12-28 02:47:22,136][106226] Updated weights for policy 0, policy_version 1047969 (0.0009) [2023-12-28 02:47:22,189][106226] Updated weights for policy 0, policy_version 1047979 (0.0009) [2023-12-28 02:47:22,259][106226] Updated weights for policy 0, policy_version 1047989 (0.0008) [2023-12-28 02:47:22,327][106226] Updated weights for policy 0, policy_version 1047999 (0.0009) [2023-12-28 02:47:22,345][106225] Updated weights for policy 1, policy_version 1050556 (0.0008) [2023-12-28 02:47:22,411][106225] Updated weights for policy 1, policy_version 1050566 (0.0010) [2023-12-28 02:47:22,470][106225] Updated weights for policy 1, policy_version 1050576 (0.0010) [2023-12-28 02:47:23,115][106226] Updated weights for policy 0, policy_version 1048009 (0.0008) [2023-12-28 02:47:23,163][106225] Updated weights for policy 1, policy_version 1050586 (0.0010) [2023-12-28 02:47:23,171][106226] Updated weights for policy 0, policy_version 1048019 (0.0010) [2023-12-28 02:47:23,213][106225] Updated weights for policy 1, policy_version 1050596 (0.0005) [2023-12-28 02:47:23,235][106226] Updated weights for policy 0, policy_version 1048029 (0.0008) [2023-12-28 02:47:23,270][106225] Updated weights for policy 1, policy_version 1050606 (0.0005) [2023-12-28 02:47:23,325][106225] Updated weights for policy 1, policy_version 1050616 (0.0005) [2023-12-28 02:47:23,906][106225] Updated weights for policy 1, policy_version 1050626 (0.0010) [2023-12-28 02:47:23,967][106225] Updated weights for policy 1, policy_version 1050636 (0.0010) [2023-12-28 02:47:24,020][106225] Updated weights for policy 1, policy_version 1050646 (0.0008) [2023-12-28 02:47:24,029][106226] Updated weights for policy 0, policy_version 1048039 (0.0009) [2023-12-28 02:47:24,080][106226] Updated weights for policy 0, policy_version 1048049 (0.0009) [2023-12-28 02:47:24,130][106226] Updated weights for policy 0, policy_version 1048059 (0.0008) [2023-12-28 02:47:24,734][106225] Updated weights for policy 1, policy_version 1050656 (0.0009) [2023-12-28 02:47:24,791][106225] Updated weights for policy 1, policy_version 1050666 (0.0005) [2023-12-28 02:47:24,841][106225] Updated weights for policy 1, policy_version 1050676 (0.0005) [2023-12-28 02:47:24,903][106226] Updated weights for policy 0, policy_version 1048069 (0.0009) [2023-12-28 02:47:24,956][106226] Updated weights for policy 0, policy_version 1048079 (0.0007) [2023-12-28 02:47:25,011][106226] Updated weights for policy 0, policy_version 1048089 (0.0009) [2023-12-28 02:47:25,400][106225] Updated weights for policy 1, policy_version 1050686 (0.0008) [2023-12-28 02:47:25,456][106225] Updated weights for policy 1, policy_version 1050696 (0.0007) [2023-12-28 02:47:25,516][106225] Updated weights for policy 1, policy_version 1050706 (0.0005) [2023-12-28 02:47:25,837][106226] Updated weights for policy 0, policy_version 1048099 (0.0009) [2023-12-28 02:47:25,903][106226] Updated weights for policy 0, policy_version 1048109 (0.0009) [2023-12-28 02:47:25,964][106226] Updated weights for policy 0, policy_version 1048119 (0.0009) [2023-12-28 02:47:26,042][106225] Updated weights for policy 1, policy_version 1050716 (0.0006) [2023-12-28 02:47:26,101][106225] Updated weights for policy 1, policy_version 1050726 (0.0007) [2023-12-28 02:47:26,156][106225] Updated weights for policy 1, policy_version 1050736 (0.0005) [2023-12-28 02:47:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 537403392. Throughput: 0: 9652.6, 1: 10003.0. Samples: 537374808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:26,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.735')] [2023-12-28 02:47:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001048128_268378112.pth... [2023-12-28 02:47:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001047008_268091392.pth [2023-12-28 02:47:26,194][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001050744_269033472.pth... [2023-12-28 02:47:26,197][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001049560_268730368.pth [2023-12-28 02:47:26,719][106225] Updated weights for policy 1, policy_version 1050746 (0.0006) [2023-12-28 02:47:26,765][106225] Updated weights for policy 1, policy_version 1050756 (0.0010) [2023-12-28 02:47:26,767][106226] Updated weights for policy 0, policy_version 1048129 (0.0008) [2023-12-28 02:47:26,818][106225] Updated weights for policy 1, policy_version 1050766 (0.0010) [2023-12-28 02:47:26,828][106226] Updated weights for policy 0, policy_version 1048139 (0.0005) [2023-12-28 02:47:26,875][106225] Updated weights for policy 1, policy_version 1050776 (0.0010) [2023-12-28 02:47:26,884][106226] Updated weights for policy 0, policy_version 1048149 (0.0006) [2023-12-28 02:47:26,948][106226] Updated weights for policy 0, policy_version 1048159 (0.0008) [2023-12-28 02:47:27,610][106225] Updated weights for policy 1, policy_version 1050786 (0.0011) [2023-12-28 02:47:27,618][106226] Updated weights for policy 0, policy_version 1048169 (0.0007) [2023-12-28 02:47:27,664][106225] Updated weights for policy 1, policy_version 1050796 (0.0010) [2023-12-28 02:47:27,672][106226] Updated weights for policy 0, policy_version 1048179 (0.0011) [2023-12-28 02:47:27,721][106225] Updated weights for policy 1, policy_version 1050806 (0.0010) [2023-12-28 02:47:27,722][106226] Updated weights for policy 0, policy_version 1048189 (0.0010) [2023-12-28 02:47:28,315][106226] Updated weights for policy 0, policy_version 1048199 (0.0007) [2023-12-28 02:47:28,382][106226] Updated weights for policy 0, policy_version 1048209 (0.0009) [2023-12-28 02:47:28,424][106225] Updated weights for policy 1, policy_version 1050816 (0.0010) [2023-12-28 02:47:28,446][106226] Updated weights for policy 0, policy_version 1048219 (0.0011) [2023-12-28 02:47:28,479][106225] Updated weights for policy 1, policy_version 1050826 (0.0010) [2023-12-28 02:47:28,530][106225] Updated weights for policy 1, policy_version 1050836 (0.0010) [2023-12-28 02:47:29,116][106226] Updated weights for policy 0, policy_version 1048229 (0.0009) [2023-12-28 02:47:29,172][106226] Updated weights for policy 0, policy_version 1048239 (0.0007) [2023-12-28 02:47:29,231][106226] Updated weights for policy 0, policy_version 1048249 (0.0007) [2023-12-28 02:47:29,278][106225] Updated weights for policy 1, policy_version 1050846 (0.0010) [2023-12-28 02:47:29,334][106225] Updated weights for policy 1, policy_version 1050856 (0.0008) [2023-12-28 02:47:29,396][106225] Updated weights for policy 1, policy_version 1050866 (0.0008) [2023-12-28 02:47:29,939][106226] Updated weights for policy 0, policy_version 1048259 (0.0011) [2023-12-28 02:47:29,998][106226] Updated weights for policy 0, policy_version 1048269 (0.0011) [2023-12-28 02:47:30,046][106226] Updated weights for policy 0, policy_version 1048279 (0.0010) [2023-12-28 02:47:30,114][106225] Updated weights for policy 1, policy_version 1050876 (0.0008) [2023-12-28 02:47:30,176][106225] Updated weights for policy 1, policy_version 1050886 (0.0010) [2023-12-28 02:47:30,235][106225] Updated weights for policy 1, policy_version 1050896 (0.0010) [2023-12-28 02:47:30,725][106226] Updated weights for policy 0, policy_version 1048289 (0.0010) [2023-12-28 02:47:30,771][106226] Updated weights for policy 0, policy_version 1048299 (0.0007) [2023-12-28 02:47:30,838][106226] Updated weights for policy 0, policy_version 1048309 (0.0006) [2023-12-28 02:47:30,899][106226] Updated weights for policy 0, policy_version 1048319 (0.0005) [2023-12-28 02:47:30,901][106225] Updated weights for policy 1, policy_version 1050906 (0.0010) [2023-12-28 02:47:30,957][106225] Updated weights for policy 1, policy_version 1050916 (0.0005) [2023-12-28 02:47:31,015][106225] Updated weights for policy 1, policy_version 1050926 (0.0008) [2023-12-28 02:47:31,085][106225] Updated weights for policy 1, policy_version 1050936 (0.0008) [2023-12-28 02:47:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 537509888. Throughput: 0: 9631.5, 1: 10078.5. Samples: 537495604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:31,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-5.162')] [2023-12-28 02:47:31,613][106226] Updated weights for policy 0, policy_version 1048329 (0.0006) [2023-12-28 02:47:31,683][106226] Updated weights for policy 0, policy_version 1048339 (0.0008) [2023-12-28 02:47:31,758][106226] Updated weights for policy 0, policy_version 1048349 (0.0013) [2023-12-28 02:47:31,775][106225] Updated weights for policy 1, policy_version 1050946 (0.0007) [2023-12-28 02:47:31,834][106225] Updated weights for policy 1, policy_version 1050956 (0.0007) [2023-12-28 02:47:31,886][106225] Updated weights for policy 1, policy_version 1050966 (0.0005) [2023-12-28 02:47:32,438][106226] Updated weights for policy 0, policy_version 1048359 (0.0007) [2023-12-28 02:47:32,499][106226] Updated weights for policy 0, policy_version 1048369 (0.0010) [2023-12-28 02:47:32,542][106225] Updated weights for policy 1, policy_version 1050976 (0.0009) [2023-12-28 02:47:32,551][106226] Updated weights for policy 0, policy_version 1048379 (0.0010) [2023-12-28 02:47:32,588][106225] Updated weights for policy 1, policy_version 1050986 (0.0010) [2023-12-28 02:47:32,648][106225] Updated weights for policy 1, policy_version 1050996 (0.0010) [2023-12-28 02:47:33,245][106226] Updated weights for policy 0, policy_version 1048389 (0.0010) [2023-12-28 02:47:33,290][106226] Updated weights for policy 0, policy_version 1048399 (0.0010) [2023-12-28 02:47:33,339][106226] Updated weights for policy 0, policy_version 1048409 (0.0010) [2023-12-28 02:47:33,366][106225] Updated weights for policy 1, policy_version 1051006 (0.0010) [2023-12-28 02:47:33,420][106225] Updated weights for policy 1, policy_version 1051016 (0.0009) [2023-12-28 02:47:33,483][106225] Updated weights for policy 1, policy_version 1051026 (0.0005) [2023-12-28 02:47:34,049][106226] Updated weights for policy 0, policy_version 1048419 (0.0010) [2023-12-28 02:47:34,083][106225] Updated weights for policy 1, policy_version 1051036 (0.0006) [2023-12-28 02:47:34,113][106226] Updated weights for policy 0, policy_version 1048429 (0.0011) [2023-12-28 02:47:34,173][106225] Updated weights for policy 1, policy_version 1051046 (0.0008) [2023-12-28 02:47:34,184][106226] Updated weights for policy 0, policy_version 1048439 (0.0010) [2023-12-28 02:47:34,230][106225] Updated weights for policy 1, policy_version 1051056 (0.0009) [2023-12-28 02:47:34,959][106226] Updated weights for policy 0, policy_version 1048449 (0.0009) [2023-12-28 02:47:34,973][106225] Updated weights for policy 1, policy_version 1051066 (0.0009) [2023-12-28 02:47:35,017][106226] Updated weights for policy 0, policy_version 1048459 (0.0010) [2023-12-28 02:47:35,032][106225] Updated weights for policy 1, policy_version 1051076 (0.0006) [2023-12-28 02:47:35,067][106226] Updated weights for policy 0, policy_version 1048469 (0.0010) [2023-12-28 02:47:35,089][106225] Updated weights for policy 1, policy_version 1051086 (0.0007) [2023-12-28 02:47:35,117][106226] Updated weights for policy 0, policy_version 1048479 (0.0010) [2023-12-28 02:47:35,147][106225] Updated weights for policy 1, policy_version 1051096 (0.0007) [2023-12-28 02:47:35,840][106226] Updated weights for policy 0, policy_version 1048489 (0.0008) [2023-12-28 02:47:35,882][106225] Updated weights for policy 1, policy_version 1051106 (0.0007) [2023-12-28 02:47:35,891][106226] Updated weights for policy 0, policy_version 1048499 (0.0008) [2023-12-28 02:47:35,930][106225] Updated weights for policy 1, policy_version 1051116 (0.0006) [2023-12-28 02:47:35,939][106226] Updated weights for policy 0, policy_version 1048509 (0.0007) [2023-12-28 02:47:35,979][106225] Updated weights for policy 1, policy_version 1051126 (0.0008) [2023-12-28 02:47:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 537608192. Throughput: 0: 9583.9, 1: 10111.1. Samples: 537614092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:36,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.797')] [2023-12-28 02:47:36,707][106226] Updated weights for policy 0, policy_version 1048519 (0.0008) [2023-12-28 02:47:36,728][106225] Updated weights for policy 1, policy_version 1051136 (0.0006) [2023-12-28 02:47:36,762][106226] Updated weights for policy 0, policy_version 1048529 (0.0007) [2023-12-28 02:47:36,784][106225] Updated weights for policy 1, policy_version 1051146 (0.0006) [2023-12-28 02:47:36,822][106226] Updated weights for policy 0, policy_version 1048539 (0.0008) [2023-12-28 02:47:36,840][106225] Updated weights for policy 1, policy_version 1051156 (0.0006) [2023-12-28 02:47:37,539][106226] Updated weights for policy 0, policy_version 1048549 (0.0006) [2023-12-28 02:47:37,592][106225] Updated weights for policy 1, policy_version 1051166 (0.0007) [2023-12-28 02:47:37,606][106226] Updated weights for policy 0, policy_version 1048559 (0.0008) [2023-12-28 02:47:37,654][106225] Updated weights for policy 1, policy_version 1051176 (0.0008) [2023-12-28 02:47:37,664][106226] Updated weights for policy 0, policy_version 1048569 (0.0010) [2023-12-28 02:47:37,720][106225] Updated weights for policy 1, policy_version 1051186 (0.0006) [2023-12-28 02:47:38,350][106226] Updated weights for policy 0, policy_version 1048579 (0.0008) [2023-12-28 02:47:38,381][106225] Updated weights for policy 1, policy_version 1051196 (0.0007) [2023-12-28 02:47:38,408][106226] Updated weights for policy 0, policy_version 1048589 (0.0008) [2023-12-28 02:47:38,433][106225] Updated weights for policy 1, policy_version 1051206 (0.0006) [2023-12-28 02:47:38,471][106226] Updated weights for policy 0, policy_version 1048599 (0.0008) [2023-12-28 02:47:38,504][106225] Updated weights for policy 1, policy_version 1051216 (0.0006) [2023-12-28 02:47:39,204][106226] Updated weights for policy 0, policy_version 1048609 (0.0008) [2023-12-28 02:47:39,241][106225] Updated weights for policy 1, policy_version 1051226 (0.0006) [2023-12-28 02:47:39,273][106226] Updated weights for policy 0, policy_version 1048619 (0.0008) [2023-12-28 02:47:39,296][106225] Updated weights for policy 1, policy_version 1051236 (0.0007) [2023-12-28 02:47:39,333][106226] Updated weights for policy 0, policy_version 1048629 (0.0006) [2023-12-28 02:47:39,358][106225] Updated weights for policy 1, policy_version 1051246 (0.0007) [2023-12-28 02:47:39,407][106226] Updated weights for policy 0, policy_version 1048639 (0.0010) [2023-12-28 02:47:39,428][106225] Updated weights for policy 1, policy_version 1051256 (0.0008) [2023-12-28 02:47:40,157][106226] Updated weights for policy 0, policy_version 1048649 (0.0009) [2023-12-28 02:47:40,182][106225] Updated weights for policy 1, policy_version 1051266 (0.0006) [2023-12-28 02:47:40,212][106226] Updated weights for policy 0, policy_version 1048659 (0.0008) [2023-12-28 02:47:40,251][106225] Updated weights for policy 1, policy_version 1051276 (0.0008) [2023-12-28 02:47:40,272][106226] Updated weights for policy 0, policy_version 1048669 (0.0006) [2023-12-28 02:47:40,315][106225] Updated weights for policy 1, policy_version 1051286 (0.0009) [2023-12-28 02:47:40,946][106225] Updated weights for policy 1, policy_version 1051296 (0.0010) [2023-12-28 02:47:41,007][106225] Updated weights for policy 1, policy_version 1051306 (0.0010) [2023-12-28 02:47:41,046][106226] Updated weights for policy 0, policy_version 1048679 (0.0007) [2023-12-28 02:47:41,067][106225] Updated weights for policy 1, policy_version 1051316 (0.0009) [2023-12-28 02:47:41,109][106226] Updated weights for policy 0, policy_version 1048689 (0.0007) [2023-12-28 02:47:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 537698304. Throughput: 0: 9595.9, 1: 10102.2. Samples: 537671336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:41,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.714')] [2023-12-28 02:47:41,178][106226] Updated weights for policy 0, policy_version 1048699 (0.0008) [2023-12-28 02:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001051320_269180928.pth... [2023-12-28 02:47:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001050136_268877824.pth [2023-12-28 02:47:41,208][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001048704_268525568.pth... [2023-12-28 02:47:41,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001047584_268238848.pth [2023-12-28 02:47:41,835][106225] Updated weights for policy 1, policy_version 1051326 (0.0010) [2023-12-28 02:47:41,889][106225] Updated weights for policy 1, policy_version 1051336 (0.0009) [2023-12-28 02:47:41,947][106225] Updated weights for policy 1, policy_version 1051346 (0.0008) [2023-12-28 02:47:41,980][106226] Updated weights for policy 0, policy_version 1048709 (0.0007) [2023-12-28 02:47:42,034][106226] Updated weights for policy 0, policy_version 1048719 (0.0009) [2023-12-28 02:47:42,086][106226] Updated weights for policy 0, policy_version 1048729 (0.0009) [2023-12-28 02:47:42,643][106225] Updated weights for policy 1, policy_version 1051356 (0.0008) [2023-12-28 02:47:42,695][106225] Updated weights for policy 1, policy_version 1051366 (0.0009) [2023-12-28 02:47:42,752][106225] Updated weights for policy 1, policy_version 1051376 (0.0011) [2023-12-28 02:47:42,941][106226] Updated weights for policy 0, policy_version 1048739 (0.0009) [2023-12-28 02:47:42,994][106226] Updated weights for policy 0, policy_version 1048749 (0.0008) [2023-12-28 02:47:43,055][106226] Updated weights for policy 0, policy_version 1048759 (0.0008) [2023-12-28 02:47:43,428][106225] Updated weights for policy 1, policy_version 1051386 (0.0008) [2023-12-28 02:47:43,478][106225] Updated weights for policy 1, policy_version 1051396 (0.0007) [2023-12-28 02:47:43,528][106225] Updated weights for policy 1, policy_version 1051406 (0.0007) [2023-12-28 02:47:43,583][106225] Updated weights for policy 1, policy_version 1051416 (0.0009) [2023-12-28 02:47:43,771][106226] Updated weights for policy 0, policy_version 1048769 (0.0006) [2023-12-28 02:47:43,825][106226] Updated weights for policy 0, policy_version 1048779 (0.0009) [2023-12-28 02:47:43,880][106226] Updated weights for policy 0, policy_version 1048789 (0.0009) [2023-12-28 02:47:43,940][106226] Updated weights for policy 0, policy_version 1048799 (0.0008) [2023-12-28 02:47:44,248][106225] Updated weights for policy 1, policy_version 1051426 (0.0010) [2023-12-28 02:47:44,298][106225] Updated weights for policy 1, policy_version 1051436 (0.0007) [2023-12-28 02:47:44,353][106225] Updated weights for policy 1, policy_version 1051446 (0.0010) [2023-12-28 02:47:44,690][106226] Updated weights for policy 0, policy_version 1048809 (0.0010) [2023-12-28 02:47:44,750][106226] Updated weights for policy 0, policy_version 1048819 (0.0008) [2023-12-28 02:47:44,819][106226] Updated weights for policy 0, policy_version 1048829 (0.0009) [2023-12-28 02:47:45,056][106225] Updated weights for policy 1, policy_version 1051456 (0.0008) [2023-12-28 02:47:45,108][106225] Updated weights for policy 1, policy_version 1051466 (0.0008) [2023-12-28 02:47:45,169][106225] Updated weights for policy 1, policy_version 1051476 (0.0005) [2023-12-28 02:47:45,536][106226] Updated weights for policy 0, policy_version 1048839 (0.0010) [2023-12-28 02:47:45,586][106226] Updated weights for policy 0, policy_version 1048849 (0.0010) [2023-12-28 02:47:45,645][106226] Updated weights for policy 0, policy_version 1048859 (0.0010) [2023-12-28 02:47:45,838][106225] Updated weights for policy 1, policy_version 1051486 (0.0005) [2023-12-28 02:47:45,887][106225] Updated weights for policy 1, policy_version 1051496 (0.0007) [2023-12-28 02:47:45,939][106225] Updated weights for policy 1, policy_version 1051506 (0.0006) [2023-12-28 02:47:46,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 537796608. Throughput: 0: 9583.3, 1: 10063.1. Samples: 537785712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:46,176][105115] Avg episode reward: [(0, '-4.553'), (1, '-5.022')] [2023-12-28 02:47:46,362][106226] Updated weights for policy 0, policy_version 1048869 (0.0010) [2023-12-28 02:47:46,424][106226] Updated weights for policy 0, policy_version 1048879 (0.0008) [2023-12-28 02:47:46,481][106226] Updated weights for policy 0, policy_version 1048889 (0.0008) [2023-12-28 02:47:46,643][106225] Updated weights for policy 1, policy_version 1051516 (0.0007) [2023-12-28 02:47:46,698][106225] Updated weights for policy 1, policy_version 1051526 (0.0008) [2023-12-28 02:47:46,754][106225] Updated weights for policy 1, policy_version 1051536 (0.0008) [2023-12-28 02:47:47,167][106226] Updated weights for policy 0, policy_version 1048899 (0.0008) [2023-12-28 02:47:47,217][106226] Updated weights for policy 0, policy_version 1048909 (0.0009) [2023-12-28 02:47:47,266][106226] Updated weights for policy 0, policy_version 1048919 (0.0008) [2023-12-28 02:47:47,386][106225] Updated weights for policy 1, policy_version 1051546 (0.0008) [2023-12-28 02:47:47,454][106225] Updated weights for policy 1, policy_version 1051556 (0.0006) [2023-12-28 02:47:47,512][106225] Updated weights for policy 1, policy_version 1051566 (0.0008) [2023-12-28 02:47:47,560][106225] Updated weights for policy 1, policy_version 1051576 (0.0008) [2023-12-28 02:47:47,987][106226] Updated weights for policy 0, policy_version 1048929 (0.0007) [2023-12-28 02:47:48,044][106226] Updated weights for policy 0, policy_version 1048939 (0.0010) [2023-12-28 02:47:48,107][106226] Updated weights for policy 0, policy_version 1048949 (0.0009) [2023-12-28 02:47:48,135][106225] Updated weights for policy 1, policy_version 1051586 (0.0005) [2023-12-28 02:47:48,166][106226] Updated weights for policy 0, policy_version 1048959 (0.0008) [2023-12-28 02:47:48,179][106225] Updated weights for policy 1, policy_version 1051596 (0.0005) [2023-12-28 02:47:48,224][106225] Updated weights for policy 1, policy_version 1051606 (0.0007) [2023-12-28 02:47:48,883][106225] Updated weights for policy 1, policy_version 1051616 (0.0007) [2023-12-28 02:47:48,947][106225] Updated weights for policy 1, policy_version 1051626 (0.0007) [2023-12-28 02:47:48,960][106226] Updated weights for policy 0, policy_version 1048969 (0.0007) [2023-12-28 02:47:49,002][106225] Updated weights for policy 1, policy_version 1051636 (0.0006) [2023-12-28 02:47:49,020][106226] Updated weights for policy 0, policy_version 1048979 (0.0008) [2023-12-28 02:47:49,077][106226] Updated weights for policy 0, policy_version 1048989 (0.0008) [2023-12-28 02:47:49,640][106225] Updated weights for policy 1, policy_version 1051646 (0.0006) [2023-12-28 02:47:49,703][106225] Updated weights for policy 1, policy_version 1051656 (0.0005) [2023-12-28 02:47:49,755][106225] Updated weights for policy 1, policy_version 1051666 (0.0006) [2023-12-28 02:47:49,823][106226] Updated weights for policy 0, policy_version 1048999 (0.0010) [2023-12-28 02:47:49,885][106226] Updated weights for policy 0, policy_version 1049009 (0.0010) [2023-12-28 02:47:49,953][106226] Updated weights for policy 0, policy_version 1049019 (0.0009) [2023-12-28 02:47:50,467][106225] Updated weights for policy 1, policy_version 1051676 (0.0008) [2023-12-28 02:47:50,524][106225] Updated weights for policy 1, policy_version 1051686 (0.0008) [2023-12-28 02:47:50,583][106225] Updated weights for policy 1, policy_version 1051696 (0.0008) [2023-12-28 02:47:50,735][106226] Updated weights for policy 0, policy_version 1049029 (0.0007) [2023-12-28 02:47:50,796][106226] Updated weights for policy 0, policy_version 1049039 (0.0009) [2023-12-28 02:47:50,852][106226] Updated weights for policy 0, policy_version 1049049 (0.0008) [2023-12-28 02:47:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 537894912. Throughput: 0: 9530.4, 1: 10152.8. Samples: 537904324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:51,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.051')] [2023-12-28 02:47:51,312][106225] Updated weights for policy 1, policy_version 1051706 (0.0007) [2023-12-28 02:47:51,376][106225] Updated weights for policy 1, policy_version 1051716 (0.0008) [2023-12-28 02:47:51,433][106225] Updated weights for policy 1, policy_version 1051726 (0.0009) [2023-12-28 02:47:51,495][106225] Updated weights for policy 1, policy_version 1051736 (0.0009) [2023-12-28 02:47:51,598][106226] Updated weights for policy 0, policy_version 1049059 (0.0008) [2023-12-28 02:47:51,664][106226] Updated weights for policy 0, policy_version 1049069 (0.0009) [2023-12-28 02:47:51,721][106226] Updated weights for policy 0, policy_version 1049079 (0.0008) [2023-12-28 02:47:52,318][106225] Updated weights for policy 1, policy_version 1051746 (0.0010) [2023-12-28 02:47:52,356][106226] Updated weights for policy 0, policy_version 1049089 (0.0010) [2023-12-28 02:47:52,383][106225] Updated weights for policy 1, policy_version 1051756 (0.0008) [2023-12-28 02:47:52,424][106226] Updated weights for policy 0, policy_version 1049099 (0.0009) [2023-12-28 02:47:52,443][106225] Updated weights for policy 1, policy_version 1051766 (0.0005) [2023-12-28 02:47:52,491][106226] Updated weights for policy 0, policy_version 1049109 (0.0009) [2023-12-28 02:47:52,560][106226] Updated weights for policy 0, policy_version 1049119 (0.0008) [2023-12-28 02:47:53,187][106226] Updated weights for policy 0, policy_version 1049129 (0.0008) [2023-12-28 02:47:53,221][106225] Updated weights for policy 1, policy_version 1051776 (0.0007) [2023-12-28 02:47:53,238][106226] Updated weights for policy 0, policy_version 1049139 (0.0006) [2023-12-28 02:47:53,272][106225] Updated weights for policy 1, policy_version 1051786 (0.0006) [2023-12-28 02:47:53,290][106226] Updated weights for policy 0, policy_version 1049149 (0.0005) [2023-12-28 02:47:53,328][106225] Updated weights for policy 1, policy_version 1051796 (0.0006) [2023-12-28 02:47:53,897][106226] Updated weights for policy 0, policy_version 1049159 (0.0006) [2023-12-28 02:47:53,958][106226] Updated weights for policy 0, policy_version 1049169 (0.0005) [2023-12-28 02:47:54,030][106226] Updated weights for policy 0, policy_version 1049179 (0.0005) [2023-12-28 02:47:54,097][106225] Updated weights for policy 1, policy_version 1051806 (0.0008) [2023-12-28 02:47:54,145][106225] Updated weights for policy 1, policy_version 1051816 (0.0008) [2023-12-28 02:47:54,194][106225] Updated weights for policy 1, policy_version 1051826 (0.0008) [2023-12-28 02:47:54,670][106226] Updated weights for policy 0, policy_version 1049189 (0.0007) [2023-12-28 02:47:54,729][106226] Updated weights for policy 0, policy_version 1049199 (0.0008) [2023-12-28 02:47:54,783][106226] Updated weights for policy 0, policy_version 1049209 (0.0009) [2023-12-28 02:47:54,871][106225] Updated weights for policy 1, policy_version 1051836 (0.0007) [2023-12-28 02:47:54,941][106225] Updated weights for policy 1, policy_version 1051846 (0.0006) [2023-12-28 02:47:54,999][106225] Updated weights for policy 1, policy_version 1051856 (0.0008) [2023-12-28 02:47:55,573][106226] Updated weights for policy 0, policy_version 1049219 (0.0009) [2023-12-28 02:47:55,618][106225] Updated weights for policy 1, policy_version 1051866 (0.0008) [2023-12-28 02:47:55,639][106226] Updated weights for policy 0, policy_version 1049229 (0.0008) [2023-12-28 02:47:55,673][106225] Updated weights for policy 1, policy_version 1051876 (0.0005) [2023-12-28 02:47:55,706][106226] Updated weights for policy 0, policy_version 1049239 (0.0008) [2023-12-28 02:47:55,720][106225] Updated weights for policy 1, policy_version 1051886 (0.0005) [2023-12-28 02:47:55,768][106225] Updated weights for policy 1, policy_version 1051896 (0.0006) [2023-12-28 02:47:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 537993216. Throughput: 0: 9577.5, 1: 10026.8. Samples: 537963244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:47:56,176][105115] Avg episode reward: [(0, '-4.847'), (1, '-4.839')] [2023-12-28 02:47:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001051896_269328384.pth... [2023-12-28 02:47:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001049248_268664832.pth... [2023-12-28 02:47:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001050744_269033472.pth [2023-12-28 02:47:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001048128_268378112.pth [2023-12-28 02:47:56,387][106226] Updated weights for policy 0, policy_version 1049249 (0.0006) [2023-12-28 02:47:56,434][106225] Updated weights for policy 1, policy_version 1051906 (0.0006) [2023-12-28 02:47:56,451][106226] Updated weights for policy 0, policy_version 1049259 (0.0007) [2023-12-28 02:47:56,492][106225] Updated weights for policy 1, policy_version 1051916 (0.0006) [2023-12-28 02:47:56,507][106226] Updated weights for policy 0, policy_version 1049269 (0.0006) [2023-12-28 02:47:56,544][106225] Updated weights for policy 1, policy_version 1051926 (0.0006) [2023-12-28 02:47:56,561][106226] Updated weights for policy 0, policy_version 1049279 (0.0007) [2023-12-28 02:47:57,107][106226] Updated weights for policy 0, policy_version 1049289 (0.0006) [2023-12-28 02:47:57,164][106226] Updated weights for policy 0, policy_version 1049299 (0.0005) [2023-12-28 02:47:57,226][106226] Updated weights for policy 0, policy_version 1049309 (0.0005) [2023-12-28 02:47:57,246][106225] Updated weights for policy 1, policy_version 1051936 (0.0006) [2023-12-28 02:47:57,300][106225] Updated weights for policy 1, policy_version 1051946 (0.0006) [2023-12-28 02:47:57,353][106225] Updated weights for policy 1, policy_version 1051956 (0.0007) [2023-12-28 02:47:57,803][106226] Updated weights for policy 0, policy_version 1049319 (0.0005) [2023-12-28 02:47:57,863][106226] Updated weights for policy 0, policy_version 1049329 (0.0005) [2023-12-28 02:47:57,918][106226] Updated weights for policy 0, policy_version 1049339 (0.0010) [2023-12-28 02:47:58,001][106225] Updated weights for policy 1, policy_version 1051966 (0.0008) [2023-12-28 02:47:58,064][106225] Updated weights for policy 1, policy_version 1051976 (0.0010) [2023-12-28 02:47:58,123][106225] Updated weights for policy 1, policy_version 1051986 (0.0010) [2023-12-28 02:47:58,638][106226] Updated weights for policy 0, policy_version 1049349 (0.0011) [2023-12-28 02:47:58,704][106226] Updated weights for policy 0, policy_version 1049359 (0.0011) [2023-12-28 02:47:58,777][106226] Updated weights for policy 0, policy_version 1049369 (0.0009) [2023-12-28 02:47:58,966][106225] Updated weights for policy 1, policy_version 1051996 (0.0009) [2023-12-28 02:47:59,026][106225] Updated weights for policy 1, policy_version 1052006 (0.0008) [2023-12-28 02:47:59,088][106225] Updated weights for policy 1, policy_version 1052016 (0.0009) [2023-12-28 02:47:59,566][106226] Updated weights for policy 0, policy_version 1049379 (0.0009) [2023-12-28 02:47:59,628][106226] Updated weights for policy 0, policy_version 1049389 (0.0011) [2023-12-28 02:47:59,686][106226] Updated weights for policy 0, policy_version 1049399 (0.0011) [2023-12-28 02:47:59,878][106225] Updated weights for policy 1, policy_version 1052026 (0.0009) [2023-12-28 02:47:59,942][106225] Updated weights for policy 1, policy_version 1052036 (0.0009) [2023-12-28 02:47:59,992][106225] Updated weights for policy 1, policy_version 1052046 (0.0007) [2023-12-28 02:48:00,045][106225] Updated weights for policy 1, policy_version 1052056 (0.0008) [2023-12-28 02:48:00,318][106226] Updated weights for policy 0, policy_version 1049409 (0.0010) [2023-12-28 02:48:00,378][106226] Updated weights for policy 0, policy_version 1049419 (0.0008) [2023-12-28 02:48:00,436][106226] Updated weights for policy 0, policy_version 1049429 (0.0010) [2023-12-28 02:48:00,496][106226] Updated weights for policy 0, policy_version 1049439 (0.0010) [2023-12-28 02:48:00,898][106225] Updated weights for policy 1, policy_version 1052066 (0.0010) [2023-12-28 02:48:00,956][106225] Updated weights for policy 1, policy_version 1052076 (0.0010) [2023-12-28 02:48:01,018][106225] Updated weights for policy 1, policy_version 1052086 (0.0006) [2023-12-28 02:48:01,066][106226] Updated weights for policy 0, policy_version 1049449 (0.0008) [2023-12-28 02:48:01,120][106226] Updated weights for policy 0, policy_version 1049459 (0.0007) [2023-12-28 02:48:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 538091520. Throughput: 0: 9560.5, 1: 10053.4. Samples: 538082800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:01,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.955')] [2023-12-28 02:48:01,187][106226] Updated weights for policy 0, policy_version 1049469 (0.0008) [2023-12-28 02:48:01,747][106225] Updated weights for policy 1, policy_version 1052096 (0.0008) [2023-12-28 02:48:01,794][106225] Updated weights for policy 1, policy_version 1052106 (0.0008) [2023-12-28 02:48:01,848][106225] Updated weights for policy 1, policy_version 1052116 (0.0008) [2023-12-28 02:48:01,967][106226] Updated weights for policy 0, policy_version 1049479 (0.0008) [2023-12-28 02:48:02,019][106226] Updated weights for policy 0, policy_version 1049489 (0.0007) [2023-12-28 02:48:02,070][106226] Updated weights for policy 0, policy_version 1049499 (0.0008) [2023-12-28 02:48:02,551][106225] Updated weights for policy 1, policy_version 1052126 (0.0008) [2023-12-28 02:48:02,611][106225] Updated weights for policy 1, policy_version 1052136 (0.0008) [2023-12-28 02:48:02,674][106225] Updated weights for policy 1, policy_version 1052146 (0.0008) [2023-12-28 02:48:02,818][106226] Updated weights for policy 0, policy_version 1049509 (0.0009) [2023-12-28 02:48:02,874][106226] Updated weights for policy 0, policy_version 1049519 (0.0008) [2023-12-28 02:48:02,924][106226] Updated weights for policy 0, policy_version 1049529 (0.0008) [2023-12-28 02:48:03,304][106225] Updated weights for policy 1, policy_version 1052156 (0.0007) [2023-12-28 02:48:03,365][106225] Updated weights for policy 1, policy_version 1052166 (0.0005) [2023-12-28 02:48:03,428][106225] Updated weights for policy 1, policy_version 1052176 (0.0010) [2023-12-28 02:48:03,607][106226] Updated weights for policy 0, policy_version 1049539 (0.0010) [2023-12-28 02:48:03,677][106226] Updated weights for policy 0, policy_version 1049549 (0.0011) [2023-12-28 02:48:03,740][106226] Updated weights for policy 0, policy_version 1049559 (0.0006) [2023-12-28 02:48:04,056][106225] Updated weights for policy 1, policy_version 1052186 (0.0010) [2023-12-28 02:48:04,114][106225] Updated weights for policy 1, policy_version 1052196 (0.0008) [2023-12-28 02:48:04,172][106225] Updated weights for policy 1, policy_version 1052206 (0.0008) [2023-12-28 02:48:04,231][106225] Updated weights for policy 1, policy_version 1052216 (0.0008) [2023-12-28 02:48:04,442][106226] Updated weights for policy 0, policy_version 1049569 (0.0006) [2023-12-28 02:48:04,498][106226] Updated weights for policy 0, policy_version 1049579 (0.0009) [2023-12-28 02:48:04,557][106226] Updated weights for policy 0, policy_version 1049589 (0.0006) [2023-12-28 02:48:04,620][106226] Updated weights for policy 0, policy_version 1049599 (0.0005) [2023-12-28 02:48:04,966][106225] Updated weights for policy 1, policy_version 1052226 (0.0010) [2023-12-28 02:48:05,026][106225] Updated weights for policy 1, policy_version 1052236 (0.0010) [2023-12-28 02:48:05,093][106225] Updated weights for policy 1, policy_version 1052246 (0.0008) [2023-12-28 02:48:05,272][106226] Updated weights for policy 0, policy_version 1049609 (0.0005) [2023-12-28 02:48:05,320][106226] Updated weights for policy 0, policy_version 1049619 (0.0005) [2023-12-28 02:48:05,368][106226] Updated weights for policy 0, policy_version 1049629 (0.0007) [2023-12-28 02:48:05,686][106225] Updated weights for policy 1, policy_version 1052256 (0.0007) [2023-12-28 02:48:05,737][106225] Updated weights for policy 1, policy_version 1052266 (0.0009) [2023-12-28 02:48:05,788][106225] Updated weights for policy 1, policy_version 1052276 (0.0009) [2023-12-28 02:48:05,970][106226] Updated weights for policy 0, policy_version 1049639 (0.0009) [2023-12-28 02:48:06,022][106226] Updated weights for policy 0, policy_version 1049649 (0.0009) [2023-12-28 02:48:06,074][106226] Updated weights for policy 0, policy_version 1049659 (0.0008) [2023-12-28 02:48:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 538198016. Throughput: 0: 9691.5, 1: 9977.1. Samples: 538204052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:06,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.755')] [2023-12-28 02:48:06,513][106225] Updated weights for policy 1, policy_version 1052286 (0.0010) [2023-12-28 02:48:06,576][106225] Updated weights for policy 1, policy_version 1052296 (0.0010) [2023-12-28 02:48:06,637][106225] Updated weights for policy 1, policy_version 1052306 (0.0010) [2023-12-28 02:48:06,837][106226] Updated weights for policy 0, policy_version 1049669 (0.0006) [2023-12-28 02:48:06,907][106226] Updated weights for policy 0, policy_version 1049679 (0.0006) [2023-12-28 02:48:06,976][106226] Updated weights for policy 0, policy_version 1049689 (0.0006) [2023-12-28 02:48:07,283][106225] Updated weights for policy 1, policy_version 1052316 (0.0008) [2023-12-28 02:48:07,347][106225] Updated weights for policy 1, policy_version 1052326 (0.0005) [2023-12-28 02:48:07,418][106225] Updated weights for policy 1, policy_version 1052336 (0.0007) [2023-12-28 02:48:07,690][106226] Updated weights for policy 0, policy_version 1049699 (0.0009) [2023-12-28 02:48:07,756][106226] Updated weights for policy 0, policy_version 1049709 (0.0007) [2023-12-28 02:48:07,824][106226] Updated weights for policy 0, policy_version 1049719 (0.0008) [2023-12-28 02:48:08,129][106225] Updated weights for policy 1, policy_version 1052346 (0.0010) [2023-12-28 02:48:08,198][106225] Updated weights for policy 1, policy_version 1052356 (0.0008) [2023-12-28 02:48:08,266][106225] Updated weights for policy 1, policy_version 1052366 (0.0008) [2023-12-28 02:48:08,336][106225] Updated weights for policy 1, policy_version 1052376 (0.0008) [2023-12-28 02:48:08,474][106226] Updated weights for policy 0, policy_version 1049729 (0.0007) [2023-12-28 02:48:08,539][106226] Updated weights for policy 0, policy_version 1049739 (0.0007) [2023-12-28 02:48:08,596][106226] Updated weights for policy 0, policy_version 1049749 (0.0009) [2023-12-28 02:48:08,656][106226] Updated weights for policy 0, policy_version 1049759 (0.0009) [2023-12-28 02:48:09,008][106225] Updated weights for policy 1, policy_version 1052386 (0.0008) [2023-12-28 02:48:09,058][106225] Updated weights for policy 1, policy_version 1052396 (0.0008) [2023-12-28 02:48:09,108][106225] Updated weights for policy 1, policy_version 1052406 (0.0008) [2023-12-28 02:48:09,408][106226] Updated weights for policy 0, policy_version 1049769 (0.0007) [2023-12-28 02:48:09,466][106226] Updated weights for policy 0, policy_version 1049779 (0.0009) [2023-12-28 02:48:09,529][106226] Updated weights for policy 0, policy_version 1049789 (0.0008) [2023-12-28 02:48:09,854][106225] Updated weights for policy 1, policy_version 1052416 (0.0008) [2023-12-28 02:48:09,924][106225] Updated weights for policy 1, policy_version 1052426 (0.0008) [2023-12-28 02:48:10,003][106225] Updated weights for policy 1, policy_version 1052436 (0.0008) [2023-12-28 02:48:10,340][106226] Updated weights for policy 0, policy_version 1049799 (0.0009) [2023-12-28 02:48:10,401][106226] Updated weights for policy 0, policy_version 1049809 (0.0009) [2023-12-28 02:48:10,470][106226] Updated weights for policy 0, policy_version 1049819 (0.0008) [2023-12-28 02:48:10,678][106225] Updated weights for policy 1, policy_version 1052446 (0.0008) [2023-12-28 02:48:10,730][106225] Updated weights for policy 1, policy_version 1052456 (0.0008) [2023-12-28 02:48:10,788][106225] Updated weights for policy 1, policy_version 1052466 (0.0008) [2023-12-28 02:48:11,155][106226] Updated weights for policy 0, policy_version 1049829 (0.0009) [2023-12-28 02:48:11,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 538288128. Throughput: 0: 9751.5, 1: 9989.1. Samples: 538263132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:11,175][105115] Avg episode reward: [(0, '-4.782'), (1, '-4.935')] [2023-12-28 02:48:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001052472_269475840.pth... [2023-12-28 02:48:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001051320_269180928.pth [2023-12-28 02:48:11,220][106226] Updated weights for policy 0, policy_version 1049839 (0.0008) [2023-12-28 02:48:11,293][106226] Updated weights for policy 0, policy_version 1049849 (0.0009) [2023-12-28 02:48:11,332][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001049856_268820480.pth... [2023-12-28 02:48:11,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001048704_268525568.pth [2023-12-28 02:48:11,595][106225] Updated weights for policy 1, policy_version 1052476 (0.0007) [2023-12-28 02:48:11,666][106225] Updated weights for policy 1, policy_version 1052486 (0.0008) [2023-12-28 02:48:11,739][106225] Updated weights for policy 1, policy_version 1052496 (0.0009) [2023-12-28 02:48:12,044][106226] Updated weights for policy 0, policy_version 1049859 (0.0007) [2023-12-28 02:48:12,111][106226] Updated weights for policy 0, policy_version 1049869 (0.0008) [2023-12-28 02:48:12,177][106226] Updated weights for policy 0, policy_version 1049879 (0.0009) [2023-12-28 02:48:12,482][106225] Updated weights for policy 1, policy_version 1052506 (0.0008) [2023-12-28 02:48:12,530][106225] Updated weights for policy 1, policy_version 1052516 (0.0010) [2023-12-28 02:48:12,595][106225] Updated weights for policy 1, policy_version 1052526 (0.0010) [2023-12-28 02:48:12,660][106225] Updated weights for policy 1, policy_version 1052536 (0.0010) [2023-12-28 02:48:12,842][106226] Updated weights for policy 0, policy_version 1049889 (0.0008) [2023-12-28 02:48:12,913][106226] Updated weights for policy 0, policy_version 1049899 (0.0005) [2023-12-28 02:48:12,977][106226] Updated weights for policy 0, policy_version 1049909 (0.0006) [2023-12-28 02:48:13,036][106226] Updated weights for policy 0, policy_version 1049919 (0.0008) [2023-12-28 02:48:13,318][106225] Updated weights for policy 1, policy_version 1052546 (0.0010) [2023-12-28 02:48:13,372][106225] Updated weights for policy 1, policy_version 1052556 (0.0010) [2023-12-28 02:48:13,422][106225] Updated weights for policy 1, policy_version 1052566 (0.0010) [2023-12-28 02:48:13,654][106226] Updated weights for policy 0, policy_version 1049929 (0.0005) [2023-12-28 02:48:13,711][106226] Updated weights for policy 0, policy_version 1049939 (0.0005) [2023-12-28 02:48:13,780][106226] Updated weights for policy 0, policy_version 1049949 (0.0005) [2023-12-28 02:48:14,137][106225] Updated weights for policy 1, policy_version 1052576 (0.0010) [2023-12-28 02:48:14,190][106225] Updated weights for policy 1, policy_version 1052586 (0.0008) [2023-12-28 02:48:14,248][106225] Updated weights for policy 1, policy_version 1052596 (0.0008) [2023-12-28 02:48:14,290][106226] Updated weights for policy 0, policy_version 1049959 (0.0009) [2023-12-28 02:48:14,338][106226] Updated weights for policy 0, policy_version 1049969 (0.0011) [2023-12-28 02:48:14,392][106226] Updated weights for policy 0, policy_version 1049979 (0.0011) [2023-12-28 02:48:14,999][106225] Updated weights for policy 1, policy_version 1052606 (0.0007) [2023-12-28 02:48:15,033][106226] Updated weights for policy 0, policy_version 1049989 (0.0009) [2023-12-28 02:48:15,060][106225] Updated weights for policy 1, policy_version 1052616 (0.0007) [2023-12-28 02:48:15,092][106226] Updated weights for policy 0, policy_version 1049999 (0.0006) [2023-12-28 02:48:15,121][106225] Updated weights for policy 1, policy_version 1052626 (0.0007) [2023-12-28 02:48:15,153][106226] Updated weights for policy 0, policy_version 1050009 (0.0007) [2023-12-28 02:48:15,760][106226] Updated weights for policy 0, policy_version 1050019 (0.0007) [2023-12-28 02:48:15,826][106226] Updated weights for policy 0, policy_version 1050029 (0.0011) [2023-12-28 02:48:15,888][106225] Updated weights for policy 1, policy_version 1052636 (0.0007) [2023-12-28 02:48:15,889][106226] Updated weights for policy 0, policy_version 1050039 (0.0011) [2023-12-28 02:48:15,943][106225] Updated weights for policy 1, policy_version 1052646 (0.0007) [2023-12-28 02:48:15,995][106225] Updated weights for policy 1, policy_version 1052656 (0.0009) [2023-12-28 02:48:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 538394624. Throughput: 0: 9818.3, 1: 9855.0. Samples: 538380904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:16,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.852')] [2023-12-28 02:48:16,580][106226] Updated weights for policy 0, policy_version 1050049 (0.0010) [2023-12-28 02:48:16,644][106226] Updated weights for policy 0, policy_version 1050059 (0.0011) [2023-12-28 02:48:16,697][106226] Updated weights for policy 0, policy_version 1050069 (0.0011) [2023-12-28 02:48:16,698][106225] Updated weights for policy 1, policy_version 1052666 (0.0006) [2023-12-28 02:48:16,756][106226] Updated weights for policy 0, policy_version 1050080 (0.0008) [2023-12-28 02:48:16,756][106225] Updated weights for policy 1, policy_version 1052676 (0.0008) [2023-12-28 02:48:16,805][106225] Updated weights for policy 1, policy_version 1052686 (0.0009) [2023-12-28 02:48:16,855][106225] Updated weights for policy 1, policy_version 1052696 (0.0008) [2023-12-28 02:48:17,327][106226] Updated weights for policy 0, policy_version 1050090 (0.0005) [2023-12-28 02:48:17,378][106226] Updated weights for policy 0, policy_version 1050100 (0.0005) [2023-12-28 02:48:17,430][106226] Updated weights for policy 0, policy_version 1050110 (0.0005) [2023-12-28 02:48:17,648][106225] Updated weights for policy 1, policy_version 1052706 (0.0010) [2023-12-28 02:48:17,702][106225] Updated weights for policy 1, policy_version 1052716 (0.0010) [2023-12-28 02:48:17,750][106225] Updated weights for policy 1, policy_version 1052726 (0.0010) [2023-12-28 02:48:17,963][106226] Updated weights for policy 0, policy_version 1050120 (0.0005) [2023-12-28 02:48:18,019][106226] Updated weights for policy 0, policy_version 1050130 (0.0008) [2023-12-28 02:48:18,073][106226] Updated weights for policy 0, policy_version 1050140 (0.0011) [2023-12-28 02:48:18,327][106225] Updated weights for policy 1, policy_version 1052736 (0.0007) [2023-12-28 02:48:18,390][106225] Updated weights for policy 1, policy_version 1052746 (0.0009) [2023-12-28 02:48:18,449][106225] Updated weights for policy 1, policy_version 1052756 (0.0011) [2023-12-28 02:48:18,778][106226] Updated weights for policy 0, policy_version 1050150 (0.0010) [2023-12-28 02:48:18,841][106226] Updated weights for policy 0, policy_version 1050160 (0.0011) [2023-12-28 02:48:18,905][106226] Updated weights for policy 0, policy_version 1050170 (0.0009) [2023-12-28 02:48:19,186][106225] Updated weights for policy 1, policy_version 1052766 (0.0008) [2023-12-28 02:48:19,244][106225] Updated weights for policy 1, policy_version 1052776 (0.0009) [2023-12-28 02:48:19,310][106225] Updated weights for policy 1, policy_version 1052786 (0.0010) [2023-12-28 02:48:19,582][106226] Updated weights for policy 0, policy_version 1050180 (0.0009) [2023-12-28 02:48:19,644][106226] Updated weights for policy 0, policy_version 1050190 (0.0007) [2023-12-28 02:48:19,698][106226] Updated weights for policy 0, policy_version 1050200 (0.0010) [2023-12-28 02:48:20,071][106225] Updated weights for policy 1, policy_version 1052796 (0.0008) [2023-12-28 02:48:20,132][106225] Updated weights for policy 1, policy_version 1052806 (0.0005) [2023-12-28 02:48:20,197][106225] Updated weights for policy 1, policy_version 1052816 (0.0005) [2023-12-28 02:48:20,465][106226] Updated weights for policy 0, policy_version 1050210 (0.0010) [2023-12-28 02:48:20,522][106226] Updated weights for policy 0, policy_version 1050220 (0.0008) [2023-12-28 02:48:20,574][106226] Updated weights for policy 0, policy_version 1050230 (0.0008) [2023-12-28 02:48:20,642][106226] Updated weights for policy 0, policy_version 1050240 (0.0009) [2023-12-28 02:48:20,894][106225] Updated weights for policy 1, policy_version 1052826 (0.0008) [2023-12-28 02:48:20,960][106225] Updated weights for policy 1, policy_version 1052836 (0.0007) [2023-12-28 02:48:21,031][106225] Updated weights for policy 1, policy_version 1052846 (0.0011) [2023-12-28 02:48:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 538492928. Throughput: 0: 9911.8, 1: 9822.6. Samples: 538502140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:21,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.928')] [2023-12-28 02:48:21,425][106226] Updated weights for policy 0, policy_version 1050250 (0.0009) [2023-12-28 02:48:21,493][106226] Updated weights for policy 0, policy_version 1050260 (0.0008) [2023-12-28 02:48:21,564][106226] Updated weights for policy 0, policy_version 1050270 (0.0008) [2023-12-28 02:48:21,814][106225] Updated weights for policy 1, policy_version 1052857 (0.0007) [2023-12-28 02:48:21,877][106225] Updated weights for policy 1, policy_version 1052867 (0.0008) [2023-12-28 02:48:21,943][106225] Updated weights for policy 1, policy_version 1052877 (0.0008) [2023-12-28 02:48:22,010][106225] Updated weights for policy 1, policy_version 1052887 (0.0008) [2023-12-28 02:48:22,377][106226] Updated weights for policy 0, policy_version 1050280 (0.0008) [2023-12-28 02:48:22,438][106226] Updated weights for policy 0, policy_version 1050290 (0.0009) [2023-12-28 02:48:22,498][106226] Updated weights for policy 0, policy_version 1050300 (0.0008) [2023-12-28 02:48:22,738][106225] Updated weights for policy 1, policy_version 1052897 (0.0008) [2023-12-28 02:48:22,800][106225] Updated weights for policy 1, policy_version 1052907 (0.0008) [2023-12-28 02:48:22,869][106225] Updated weights for policy 1, policy_version 1052917 (0.0007) [2023-12-28 02:48:23,174][106226] Updated weights for policy 0, policy_version 1050310 (0.0006) [2023-12-28 02:48:23,241][106226] Updated weights for policy 0, policy_version 1050320 (0.0006) [2023-12-28 02:48:23,305][106226] Updated weights for policy 0, policy_version 1050330 (0.0006) [2023-12-28 02:48:23,491][106225] Updated weights for policy 1, policy_version 1052927 (0.0006) [2023-12-28 02:48:23,537][106225] Updated weights for policy 1, policy_version 1052937 (0.0005) [2023-12-28 02:48:23,587][106225] Updated weights for policy 1, policy_version 1052947 (0.0005) [2023-12-28 02:48:23,869][106226] Updated weights for policy 0, policy_version 1050340 (0.0005) [2023-12-28 02:48:23,917][106226] Updated weights for policy 0, policy_version 1050350 (0.0005) [2023-12-28 02:48:23,968][106226] Updated weights for policy 0, policy_version 1050360 (0.0006) [2023-12-28 02:48:24,211][106225] Updated weights for policy 1, policy_version 1052957 (0.0007) [2023-12-28 02:48:24,271][106225] Updated weights for policy 1, policy_version 1052967 (0.0008) [2023-12-28 02:48:24,336][106225] Updated weights for policy 1, policy_version 1052977 (0.0006) [2023-12-28 02:48:24,596][106226] Updated weights for policy 0, policy_version 1050370 (0.0011) [2023-12-28 02:48:24,658][106226] Updated weights for policy 0, policy_version 1050380 (0.0010) [2023-12-28 02:48:24,721][106226] Updated weights for policy 0, policy_version 1050390 (0.0010) [2023-12-28 02:48:24,783][106226] Updated weights for policy 0, policy_version 1050400 (0.0010) [2023-12-28 02:48:25,035][106225] Updated weights for policy 1, policy_version 1052987 (0.0005) [2023-12-28 02:48:25,086][106225] Updated weights for policy 1, policy_version 1052997 (0.0005) [2023-12-28 02:48:25,137][106225] Updated weights for policy 1, policy_version 1053007 (0.0005) [2023-12-28 02:48:25,479][106226] Updated weights for policy 0, policy_version 1050410 (0.0009) [2023-12-28 02:48:25,540][106226] Updated weights for policy 0, policy_version 1050420 (0.0009) [2023-12-28 02:48:25,598][106226] Updated weights for policy 0, policy_version 1050430 (0.0007) [2023-12-28 02:48:25,699][106225] Updated weights for policy 1, policy_version 1053017 (0.0006) [2023-12-28 02:48:25,764][106225] Updated weights for policy 1, policy_version 1053027 (0.0007) [2023-12-28 02:48:25,825][106225] Updated weights for policy 1, policy_version 1053037 (0.0007) [2023-12-28 02:48:25,890][106225] Updated weights for policy 1, policy_version 1053047 (0.0009) [2023-12-28 02:48:26,149][106226] Updated weights for policy 0, policy_version 1050440 (0.0009) [2023-12-28 02:48:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 538591232. Throughput: 0: 9919.2, 1: 9831.7. Samples: 538560124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:26,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.750')] [2023-12-28 02:48:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001053048_269623296.pth... [2023-12-28 02:48:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001051896_269328384.pth [2023-12-28 02:48:26,208][106226] Updated weights for policy 0, policy_version 1050450 (0.0008) [2023-12-28 02:48:26,253][106226] Updated weights for policy 0, policy_version 1050460 (0.0008) [2023-12-28 02:48:26,277][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001050464_268976128.pth... [2023-12-28 02:48:26,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001049248_268664832.pth [2023-12-28 02:48:26,594][106225] Updated weights for policy 1, policy_version 1053057 (0.0009) [2023-12-28 02:48:26,648][106225] Updated weights for policy 1, policy_version 1053067 (0.0006) [2023-12-28 02:48:26,699][106225] Updated weights for policy 1, policy_version 1053077 (0.0005) [2023-12-28 02:48:26,991][106226] Updated weights for policy 0, policy_version 1050470 (0.0007) [2023-12-28 02:48:27,048][106226] Updated weights for policy 0, policy_version 1050480 (0.0008) [2023-12-28 02:48:27,112][106226] Updated weights for policy 0, policy_version 1050490 (0.0008) [2023-12-28 02:48:27,363][106225] Updated weights for policy 1, policy_version 1053087 (0.0008) [2023-12-28 02:48:27,415][106225] Updated weights for policy 1, policy_version 1053097 (0.0008) [2023-12-28 02:48:27,469][106225] Updated weights for policy 1, policy_version 1053107 (0.0008) [2023-12-28 02:48:27,799][106226] Updated weights for policy 0, policy_version 1050500 (0.0007) [2023-12-28 02:48:27,849][106226] Updated weights for policy 0, policy_version 1050510 (0.0005) [2023-12-28 02:48:27,903][106226] Updated weights for policy 0, policy_version 1050520 (0.0007) [2023-12-28 02:48:28,060][106225] Updated weights for policy 1, policy_version 1053117 (0.0008) [2023-12-28 02:48:28,113][106225] Updated weights for policy 1, policy_version 1053127 (0.0008) [2023-12-28 02:48:28,176][106225] Updated weights for policy 1, policy_version 1053137 (0.0009) [2023-12-28 02:48:28,546][106226] Updated weights for policy 0, policy_version 1050530 (0.0009) [2023-12-28 02:48:28,605][106226] Updated weights for policy 0, policy_version 1050540 (0.0006) [2023-12-28 02:48:28,665][106226] Updated weights for policy 0, policy_version 1050550 (0.0008) [2023-12-28 02:48:28,723][106226] Updated weights for policy 0, policy_version 1050560 (0.0009) [2023-12-28 02:48:28,948][106225] Updated weights for policy 1, policy_version 1053147 (0.0008) [2023-12-28 02:48:29,005][106225] Updated weights for policy 1, policy_version 1053157 (0.0008) [2023-12-28 02:48:29,064][106225] Updated weights for policy 1, policy_version 1053167 (0.0007) [2023-12-28 02:48:29,415][106226] Updated weights for policy 0, policy_version 1050570 (0.0014) [2023-12-28 02:48:29,473][106226] Updated weights for policy 0, policy_version 1050580 (0.0011) [2023-12-28 02:48:29,529][106226] Updated weights for policy 0, policy_version 1050590 (0.0007) [2023-12-28 02:48:29,833][106225] Updated weights for policy 1, policy_version 1053177 (0.0008) [2023-12-28 02:48:29,893][106225] Updated weights for policy 1, policy_version 1053187 (0.0006) [2023-12-28 02:48:29,953][106225] Updated weights for policy 1, policy_version 1053197 (0.0010) [2023-12-28 02:48:30,013][106225] Updated weights for policy 1, policy_version 1053207 (0.0007) [2023-12-28 02:48:30,196][106226] Updated weights for policy 0, policy_version 1050600 (0.0007) [2023-12-28 02:48:30,264][106226] Updated weights for policy 0, policy_version 1050610 (0.0008) [2023-12-28 02:48:30,325][106226] Updated weights for policy 0, policy_version 1050620 (0.0008) [2023-12-28 02:48:30,696][106225] Updated weights for policy 1, policy_version 1053217 (0.0010) [2023-12-28 02:48:30,749][106225] Updated weights for policy 1, policy_version 1053227 (0.0010) [2023-12-28 02:48:30,805][106225] Updated weights for policy 1, policy_version 1053237 (0.0010) [2023-12-28 02:48:31,014][106226] Updated weights for policy 0, policy_version 1050630 (0.0008) [2023-12-28 02:48:31,074][106226] Updated weights for policy 0, policy_version 1050640 (0.0009) [2023-12-28 02:48:31,142][106226] Updated weights for policy 0, policy_version 1050650 (0.0008) [2023-12-28 02:48:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 538689536. Throughput: 0: 10083.4, 1: 9881.6. Samples: 538684132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:31,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.791')] [2023-12-28 02:48:31,490][106225] Updated weights for policy 1, policy_version 1053247 (0.0007) [2023-12-28 02:48:31,545][106225] Updated weights for policy 1, policy_version 1053257 (0.0005) [2023-12-28 02:48:31,602][106225] Updated weights for policy 1, policy_version 1053267 (0.0006) [2023-12-28 02:48:31,949][106226] Updated weights for policy 0, policy_version 1050660 (0.0009) [2023-12-28 02:48:32,014][106226] Updated weights for policy 0, policy_version 1050670 (0.0008) [2023-12-28 02:48:32,074][106226] Updated weights for policy 0, policy_version 1050680 (0.0005) [2023-12-28 02:48:32,267][106225] Updated weights for policy 1, policy_version 1053277 (0.0008) [2023-12-28 02:48:32,333][106225] Updated weights for policy 1, policy_version 1053287 (0.0009) [2023-12-28 02:48:32,393][106225] Updated weights for policy 1, policy_version 1053297 (0.0010) [2023-12-28 02:48:32,779][106226] Updated weights for policy 0, policy_version 1050690 (0.0007) [2023-12-28 02:48:32,833][106226] Updated weights for policy 0, policy_version 1050700 (0.0008) [2023-12-28 02:48:32,876][106226] Updated weights for policy 0, policy_version 1050710 (0.0007) [2023-12-28 02:48:32,922][106226] Updated weights for policy 0, policy_version 1050720 (0.0006) [2023-12-28 02:48:33,141][106225] Updated weights for policy 1, policy_version 1053307 (0.0006) [2023-12-28 02:48:33,193][106225] Updated weights for policy 1, policy_version 1053317 (0.0009) [2023-12-28 02:48:33,236][106225] Updated weights for policy 1, policy_version 1053327 (0.0010) [2023-12-28 02:48:33,579][106226] Updated weights for policy 0, policy_version 1050730 (0.0008) [2023-12-28 02:48:33,625][106226] Updated weights for policy 0, policy_version 1050740 (0.0007) [2023-12-28 02:48:33,676][106226] Updated weights for policy 0, policy_version 1050750 (0.0008) [2023-12-28 02:48:33,939][106225] Updated weights for policy 1, policy_version 1053337 (0.0010) [2023-12-28 02:48:33,992][106225] Updated weights for policy 1, policy_version 1053347 (0.0010) [2023-12-28 02:48:34,037][106225] Updated weights for policy 1, policy_version 1053357 (0.0010) [2023-12-28 02:48:34,087][106225] Updated weights for policy 1, policy_version 1053367 (0.0010) [2023-12-28 02:48:34,371][106226] Updated weights for policy 0, policy_version 1050760 (0.0008) [2023-12-28 02:48:34,432][106226] Updated weights for policy 0, policy_version 1050770 (0.0008) [2023-12-28 02:48:34,499][106226] Updated weights for policy 0, policy_version 1050780 (0.0010) [2023-12-28 02:48:34,796][106225] Updated weights for policy 1, policy_version 1053377 (0.0009) [2023-12-28 02:48:34,854][106225] Updated weights for policy 1, policy_version 1053387 (0.0008) [2023-12-28 02:48:34,910][106225] Updated weights for policy 1, policy_version 1053397 (0.0008) [2023-12-28 02:48:35,183][106226] Updated weights for policy 0, policy_version 1050790 (0.0010) [2023-12-28 02:48:35,232][106226] Updated weights for policy 0, policy_version 1050800 (0.0010) [2023-12-28 02:48:35,291][106226] Updated weights for policy 0, policy_version 1050810 (0.0010) [2023-12-28 02:48:35,638][106225] Updated weights for policy 1, policy_version 1053407 (0.0007) [2023-12-28 02:48:35,685][106225] Updated weights for policy 1, policy_version 1053417 (0.0008) [2023-12-28 02:48:35,732][106225] Updated weights for policy 1, policy_version 1053427 (0.0008) [2023-12-28 02:48:36,004][106226] Updated weights for policy 0, policy_version 1050820 (0.0010) [2023-12-28 02:48:36,054][106226] Updated weights for policy 0, policy_version 1050830 (0.0010) [2023-12-28 02:48:36,107][106226] Updated weights for policy 0, policy_version 1050840 (0.0010) [2023-12-28 02:48:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 538796032. Throughput: 0: 10142.0, 1: 9807.3. Samples: 538802040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:36,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.554')] [2023-12-28 02:48:36,529][106225] Updated weights for policy 1, policy_version 1053437 (0.0008) [2023-12-28 02:48:36,593][106225] Updated weights for policy 1, policy_version 1053447 (0.0009) [2023-12-28 02:48:36,654][106225] Updated weights for policy 1, policy_version 1053457 (0.0009) [2023-12-28 02:48:36,831][106226] Updated weights for policy 0, policy_version 1050850 (0.0008) [2023-12-28 02:48:36,888][106226] Updated weights for policy 0, policy_version 1050860 (0.0008) [2023-12-28 02:48:36,937][106226] Updated weights for policy 0, policy_version 1050870 (0.0008) [2023-12-28 02:48:36,994][106226] Updated weights for policy 0, policy_version 1050880 (0.0009) [2023-12-28 02:48:37,422][106225] Updated weights for policy 1, policy_version 1053467 (0.0009) [2023-12-28 02:48:37,473][106225] Updated weights for policy 1, policy_version 1053477 (0.0008) [2023-12-28 02:48:37,524][106225] Updated weights for policy 1, policy_version 1053487 (0.0008) [2023-12-28 02:48:37,648][106226] Updated weights for policy 0, policy_version 1050890 (0.0006) [2023-12-28 02:48:37,723][106226] Updated weights for policy 0, policy_version 1050900 (0.0010) [2023-12-28 02:48:37,791][106226] Updated weights for policy 0, policy_version 1050910 (0.0011) [2023-12-28 02:48:38,310][106225] Updated weights for policy 1, policy_version 1053497 (0.0008) [2023-12-28 02:48:38,376][106225] Updated weights for policy 1, policy_version 1053507 (0.0008) [2023-12-28 02:48:38,435][106225] Updated weights for policy 1, policy_version 1053517 (0.0007) [2023-12-28 02:48:38,460][106226] Updated weights for policy 0, policy_version 1050920 (0.0008) [2023-12-28 02:48:38,489][106225] Updated weights for policy 1, policy_version 1053527 (0.0007) [2023-12-28 02:48:38,525][106226] Updated weights for policy 0, policy_version 1050930 (0.0006) [2023-12-28 02:48:38,583][106226] Updated weights for policy 0, policy_version 1050940 (0.0006) [2023-12-28 02:48:39,196][106226] Updated weights for policy 0, policy_version 1050950 (0.0005) [2023-12-28 02:48:39,265][106226] Updated weights for policy 0, policy_version 1050960 (0.0008) [2023-12-28 02:48:39,291][106225] Updated weights for policy 1, policy_version 1053537 (0.0007) [2023-12-28 02:48:39,326][106226] Updated weights for policy 0, policy_version 1050970 (0.0009) [2023-12-28 02:48:39,352][106225] Updated weights for policy 1, policy_version 1053547 (0.0006) [2023-12-28 02:48:39,422][106225] Updated weights for policy 1, policy_version 1053557 (0.0008) [2023-12-28 02:48:40,091][106226] Updated weights for policy 0, policy_version 1050980 (0.0008) [2023-12-28 02:48:40,114][106225] Updated weights for policy 1, policy_version 1053567 (0.0009) [2023-12-28 02:48:40,158][106226] Updated weights for policy 0, policy_version 1050990 (0.0008) [2023-12-28 02:48:40,170][106225] Updated weights for policy 1, policy_version 1053577 (0.0006) [2023-12-28 02:48:40,220][106226] Updated weights for policy 0, policy_version 1051000 (0.0007) [2023-12-28 02:48:40,228][106225] Updated weights for policy 1, policy_version 1053587 (0.0010) [2023-12-28 02:48:40,934][106226] Updated weights for policy 0, policy_version 1051010 (0.0008) [2023-12-28 02:48:40,962][106225] Updated weights for policy 1, policy_version 1053597 (0.0010) [2023-12-28 02:48:40,997][106226] Updated weights for policy 0, policy_version 1051020 (0.0011) [2023-12-28 02:48:41,014][106225] Updated weights for policy 1, policy_version 1053607 (0.0010) [2023-12-28 02:48:41,062][106226] Updated weights for policy 0, policy_version 1051030 (0.0010) [2023-12-28 02:48:41,082][106225] Updated weights for policy 1, policy_version 1053617 (0.0009) [2023-12-28 02:48:41,128][106226] Updated weights for policy 0, policy_version 1051040 (0.0008) [2023-12-28 02:48:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 538894336. Throughput: 0: 10121.4, 1: 9819.2. Samples: 538860572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:41,176][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.849')] [2023-12-28 02:48:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001053624_269770752.pth... [2023-12-28 02:48:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001051040_269123584.pth... [2023-12-28 02:48:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001052472_269475840.pth [2023-12-28 02:48:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001049856_268820480.pth [2023-12-28 02:48:41,831][106226] Updated weights for policy 0, policy_version 1051050 (0.0008) [2023-12-28 02:48:41,887][106226] Updated weights for policy 0, policy_version 1051060 (0.0008) [2023-12-28 02:48:41,910][106225] Updated weights for policy 1, policy_version 1053627 (0.0009) [2023-12-28 02:48:41,950][106226] Updated weights for policy 0, policy_version 1051070 (0.0008) [2023-12-28 02:48:41,969][106225] Updated weights for policy 1, policy_version 1053637 (0.0007) [2023-12-28 02:48:42,033][106225] Updated weights for policy 1, policy_version 1053647 (0.0009) [2023-12-28 02:48:42,636][106226] Updated weights for policy 0, policy_version 1051080 (0.0008) [2023-12-28 02:48:42,693][106226] Updated weights for policy 0, policy_version 1051090 (0.0008) [2023-12-28 02:48:42,753][106226] Updated weights for policy 0, policy_version 1051100 (0.0008) [2023-12-28 02:48:42,809][106225] Updated weights for policy 1, policy_version 1053657 (0.0009) [2023-12-28 02:48:42,871][106225] Updated weights for policy 1, policy_version 1053667 (0.0009) [2023-12-28 02:48:42,933][106225] Updated weights for policy 1, policy_version 1053677 (0.0007) [2023-12-28 02:48:42,988][106225] Updated weights for policy 1, policy_version 1053687 (0.0008) [2023-12-28 02:48:43,489][106226] Updated weights for policy 0, policy_version 1051110 (0.0008) [2023-12-28 02:48:43,540][106226] Updated weights for policy 0, policy_version 1051120 (0.0009) [2023-12-28 02:48:43,591][106226] Updated weights for policy 0, policy_version 1051130 (0.0009) [2023-12-28 02:48:43,648][106225] Updated weights for policy 1, policy_version 1053697 (0.0006) [2023-12-28 02:48:43,703][106225] Updated weights for policy 1, policy_version 1053707 (0.0005) [2023-12-28 02:48:43,752][106225] Updated weights for policy 1, policy_version 1053717 (0.0007) [2023-12-28 02:48:44,367][106226] Updated weights for policy 0, policy_version 1051140 (0.0009) [2023-12-28 02:48:44,413][106226] Updated weights for policy 0, policy_version 1051150 (0.0008) [2023-12-28 02:48:44,437][106225] Updated weights for policy 1, policy_version 1053727 (0.0009) [2023-12-28 02:48:44,474][106226] Updated weights for policy 0, policy_version 1051160 (0.0007) [2023-12-28 02:48:44,492][106225] Updated weights for policy 1, policy_version 1053737 (0.0007) [2023-12-28 02:48:44,544][106225] Updated weights for policy 1, policy_version 1053747 (0.0008) [2023-12-28 02:48:45,234][106226] Updated weights for policy 0, policy_version 1051170 (0.0007) [2023-12-28 02:48:45,286][106225] Updated weights for policy 1, policy_version 1053757 (0.0007) [2023-12-28 02:48:45,297][106226] Updated weights for policy 0, policy_version 1051180 (0.0007) [2023-12-28 02:48:45,348][106225] Updated weights for policy 1, policy_version 1053767 (0.0009) [2023-12-28 02:48:45,361][106226] Updated weights for policy 0, policy_version 1051190 (0.0010) [2023-12-28 02:48:45,408][106225] Updated weights for policy 1, policy_version 1053777 (0.0006) [2023-12-28 02:48:45,417][106226] Updated weights for policy 0, policy_version 1051200 (0.0008) [2023-12-28 02:48:46,130][106225] Updated weights for policy 1, policy_version 1053787 (0.0008) [2023-12-28 02:48:46,163][106226] Updated weights for policy 0, policy_version 1051210 (0.0007) [2023-12-28 02:48:46,174][105115] Fps is (10 sec: 18022.5, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 538976256. Throughput: 0: 10060.7, 1: 9745.8. Samples: 538974092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:46,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.813')] [2023-12-28 02:48:46,181][106225] Updated weights for policy 1, policy_version 1053797 (0.0006) [2023-12-28 02:48:46,218][106226] Updated weights for policy 0, policy_version 1051220 (0.0006) [2023-12-28 02:48:46,236][106225] Updated weights for policy 1, policy_version 1053807 (0.0008) [2023-12-28 02:48:46,275][106226] Updated weights for policy 0, policy_version 1051230 (0.0007) [2023-12-28 02:48:46,877][106225] Updated weights for policy 1, policy_version 1053817 (0.0008) [2023-12-28 02:48:46,933][106225] Updated weights for policy 1, policy_version 1053827 (0.0006) [2023-12-28 02:48:46,983][106225] Updated weights for policy 1, policy_version 1053837 (0.0005) [2023-12-28 02:48:47,037][106225] Updated weights for policy 1, policy_version 1053847 (0.0008) [2023-12-28 02:48:47,063][106226] Updated weights for policy 0, policy_version 1051240 (0.0007) [2023-12-28 02:48:47,124][106226] Updated weights for policy 0, policy_version 1051250 (0.0009) [2023-12-28 02:48:47,178][106226] Updated weights for policy 0, policy_version 1051260 (0.0009) [2023-12-28 02:48:47,642][106225] Updated weights for policy 1, policy_version 1053857 (0.0006) [2023-12-28 02:48:47,690][106225] Updated weights for policy 1, policy_version 1053867 (0.0005) [2023-12-28 02:48:47,744][106225] Updated weights for policy 1, policy_version 1053877 (0.0008) [2023-12-28 02:48:48,007][106226] Updated weights for policy 0, policy_version 1051270 (0.0009) [2023-12-28 02:48:48,062][106226] Updated weights for policy 0, policy_version 1051280 (0.0008) [2023-12-28 02:48:48,109][106226] Updated weights for policy 0, policy_version 1051290 (0.0008) [2023-12-28 02:48:48,315][106225] Updated weights for policy 1, policy_version 1053887 (0.0007) [2023-12-28 02:48:48,381][106225] Updated weights for policy 1, policy_version 1053897 (0.0007) [2023-12-28 02:48:48,442][106225] Updated weights for policy 1, policy_version 1053907 (0.0007) [2023-12-28 02:48:48,894][106226] Updated weights for policy 0, policy_version 1051300 (0.0007) [2023-12-28 02:48:48,957][106226] Updated weights for policy 0, policy_version 1051310 (0.0005) [2023-12-28 02:48:49,017][106226] Updated weights for policy 0, policy_version 1051320 (0.0009) [2023-12-28 02:48:49,092][106225] Updated weights for policy 1, policy_version 1053917 (0.0010) [2023-12-28 02:48:49,159][106225] Updated weights for policy 1, policy_version 1053927 (0.0010) [2023-12-28 02:48:49,226][106225] Updated weights for policy 1, policy_version 1053937 (0.0010) [2023-12-28 02:48:49,647][106226] Updated weights for policy 0, policy_version 1051330 (0.0007) [2023-12-28 02:48:49,708][106226] Updated weights for policy 0, policy_version 1051340 (0.0007) [2023-12-28 02:48:49,776][106226] Updated weights for policy 0, policy_version 1051350 (0.0008) [2023-12-28 02:48:49,836][106226] Updated weights for policy 0, policy_version 1051360 (0.0008) [2023-12-28 02:48:49,907][106225] Updated weights for policy 1, policy_version 1053948 (0.0006) [2023-12-28 02:48:49,970][106225] Updated weights for policy 1, policy_version 1053958 (0.0006) [2023-12-28 02:48:50,038][106225] Updated weights for policy 1, policy_version 1053968 (0.0007) [2023-12-28 02:48:50,494][106226] Updated weights for policy 0, policy_version 1051370 (0.0005) [2023-12-28 02:48:50,543][106226] Updated weights for policy 0, policy_version 1051380 (0.0006) [2023-12-28 02:48:50,610][106226] Updated weights for policy 0, policy_version 1051390 (0.0008) [2023-12-28 02:48:50,775][106225] Updated weights for policy 1, policy_version 1053978 (0.0008) [2023-12-28 02:48:50,844][106225] Updated weights for policy 1, policy_version 1053988 (0.0008) [2023-12-28 02:48:50,906][106225] Updated weights for policy 1, policy_version 1053998 (0.0007) [2023-12-28 02:48:50,956][106225] Updated weights for policy 1, policy_version 1054008 (0.0009) [2023-12-28 02:48:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 539082752. Throughput: 0: 9949.5, 1: 9808.9. Samples: 539093180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:51,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.805')] [2023-12-28 02:48:51,291][106226] Updated weights for policy 0, policy_version 1051400 (0.0008) [2023-12-28 02:48:51,351][106226] Updated weights for policy 0, policy_version 1051410 (0.0006) [2023-12-28 02:48:51,423][106226] Updated weights for policy 0, policy_version 1051420 (0.0009) [2023-12-28 02:48:51,674][106225] Updated weights for policy 1, policy_version 1054018 (0.0008) [2023-12-28 02:48:51,737][106225] Updated weights for policy 1, policy_version 1054028 (0.0008) [2023-12-28 02:48:51,809][106225] Updated weights for policy 1, policy_version 1054038 (0.0008) [2023-12-28 02:48:52,163][106226] Updated weights for policy 0, policy_version 1051430 (0.0008) [2023-12-28 02:48:52,223][106226] Updated weights for policy 0, policy_version 1051440 (0.0009) [2023-12-28 02:48:52,292][106226] Updated weights for policy 0, policy_version 1051450 (0.0009) [2023-12-28 02:48:52,559][106225] Updated weights for policy 1, policy_version 1054048 (0.0007) [2023-12-28 02:48:52,627][106225] Updated weights for policy 1, policy_version 1054058 (0.0007) [2023-12-28 02:48:52,687][106225] Updated weights for policy 1, policy_version 1054068 (0.0008) [2023-12-28 02:48:52,947][106226] Updated weights for policy 0, policy_version 1051460 (0.0009) [2023-12-28 02:48:53,011][106226] Updated weights for policy 0, policy_version 1051470 (0.0008) [2023-12-28 02:48:53,069][106226] Updated weights for policy 0, policy_version 1051480 (0.0009) [2023-12-28 02:48:53,431][106225] Updated weights for policy 1, policy_version 1054078 (0.0006) [2023-12-28 02:48:53,487][106225] Updated weights for policy 1, policy_version 1054088 (0.0008) [2023-12-28 02:48:53,547][106225] Updated weights for policy 1, policy_version 1054098 (0.0008) [2023-12-28 02:48:53,745][106226] Updated weights for policy 0, policy_version 1051490 (0.0009) [2023-12-28 02:48:53,808][106226] Updated weights for policy 0, policy_version 1051500 (0.0008) [2023-12-28 02:48:53,864][106226] Updated weights for policy 0, policy_version 1051510 (0.0009) [2023-12-28 02:48:53,921][106226] Updated weights for policy 0, policy_version 1051520 (0.0008) [2023-12-28 02:48:54,208][106225] Updated weights for policy 1, policy_version 1054108 (0.0008) [2023-12-28 02:48:54,276][106225] Updated weights for policy 1, policy_version 1054118 (0.0008) [2023-12-28 02:48:54,349][106225] Updated weights for policy 1, policy_version 1054128 (0.0009) [2023-12-28 02:48:54,566][106226] Updated weights for policy 0, policy_version 1051530 (0.0005) [2023-12-28 02:48:54,622][106226] Updated weights for policy 0, policy_version 1051540 (0.0005) [2023-12-28 02:48:54,682][106226] Updated weights for policy 0, policy_version 1051550 (0.0005) [2023-12-28 02:48:55,105][106225] Updated weights for policy 1, policy_version 1054138 (0.0009) [2023-12-28 02:48:55,170][106225] Updated weights for policy 1, policy_version 1054148 (0.0008) [2023-12-28 02:48:55,227][106225] Updated weights for policy 1, policy_version 1054158 (0.0010) [2023-12-28 02:48:55,280][106225] Updated weights for policy 1, policy_version 1054168 (0.0010) [2023-12-28 02:48:55,346][106226] Updated weights for policy 0, policy_version 1051560 (0.0006) [2023-12-28 02:48:55,396][106226] Updated weights for policy 0, policy_version 1051570 (0.0008) [2023-12-28 02:48:55,459][106226] Updated weights for policy 0, policy_version 1051580 (0.0006) [2023-12-28 02:48:55,886][106225] Updated weights for policy 1, policy_version 1054178 (0.0010) [2023-12-28 02:48:55,940][106225] Updated weights for policy 1, policy_version 1054188 (0.0010) [2023-12-28 02:48:55,987][106225] Updated weights for policy 1, policy_version 1054198 (0.0010) [2023-12-28 02:48:56,111][106226] Updated weights for policy 0, policy_version 1051590 (0.0007) [2023-12-28 02:48:56,172][106226] Updated weights for policy 0, policy_version 1051600 (0.0008) [2023-12-28 02:48:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 539181056. Throughput: 0: 9939.8, 1: 9771.0. Samples: 539150120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:48:56,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-5.161')] [2023-12-28 02:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001054200_269918208.pth... [2023-12-28 02:48:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001053048_269623296.pth [2023-12-28 02:48:56,222][106226] Updated weights for policy 0, policy_version 1051610 (0.0008) [2023-12-28 02:48:56,252][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001051616_269271040.pth... [2023-12-28 02:48:56,255][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001050464_268976128.pth [2023-12-28 02:48:56,716][106225] Updated weights for policy 1, policy_version 1054208 (0.0010) [2023-12-28 02:48:56,761][106225] Updated weights for policy 1, policy_version 1054218 (0.0010) [2023-12-28 02:48:56,804][106225] Updated weights for policy 1, policy_version 1054228 (0.0010) [2023-12-28 02:48:56,956][106226] Updated weights for policy 0, policy_version 1051620 (0.0007) [2023-12-28 02:48:57,012][106226] Updated weights for policy 0, policy_version 1051630 (0.0007) [2023-12-28 02:48:57,066][106226] Updated weights for policy 0, policy_version 1051640 (0.0008) [2023-12-28 02:48:57,540][106225] Updated weights for policy 1, policy_version 1054238 (0.0010) [2023-12-28 02:48:57,608][106225] Updated weights for policy 1, policy_version 1054248 (0.0010) [2023-12-28 02:48:57,667][106225] Updated weights for policy 1, policy_version 1054258 (0.0010) [2023-12-28 02:48:57,775][106226] Updated weights for policy 0, policy_version 1051650 (0.0008) [2023-12-28 02:48:57,827][106226] Updated weights for policy 0, policy_version 1051660 (0.0008) [2023-12-28 02:48:57,896][106226] Updated weights for policy 0, policy_version 1051670 (0.0008) [2023-12-28 02:48:57,949][106226] Updated weights for policy 0, policy_version 1051680 (0.0008) [2023-12-28 02:48:58,373][106225] Updated weights for policy 1, policy_version 1054268 (0.0010) [2023-12-28 02:48:58,439][106225] Updated weights for policy 1, policy_version 1054278 (0.0010) [2023-12-28 02:48:58,503][106225] Updated weights for policy 1, policy_version 1054288 (0.0010) [2023-12-28 02:48:58,742][106226] Updated weights for policy 0, policy_version 1051690 (0.0009) [2023-12-28 02:48:58,814][106226] Updated weights for policy 0, policy_version 1051700 (0.0008) [2023-12-28 02:48:58,884][106226] Updated weights for policy 0, policy_version 1051710 (0.0008) [2023-12-28 02:48:59,293][106225] Updated weights for policy 1, policy_version 1054298 (0.0010) [2023-12-28 02:48:59,358][106225] Updated weights for policy 1, policy_version 1054308 (0.0008) [2023-12-28 02:48:59,429][106225] Updated weights for policy 1, policy_version 1054318 (0.0008) [2023-12-28 02:48:59,492][106225] Updated weights for policy 1, policy_version 1054328 (0.0008) [2023-12-28 02:48:59,751][106226] Updated weights for policy 0, policy_version 1051720 (0.0010) [2023-12-28 02:48:59,805][106226] Updated weights for policy 0, policy_version 1051730 (0.0011) [2023-12-28 02:48:59,868][106226] Updated weights for policy 0, policy_version 1051740 (0.0011) [2023-12-28 02:49:00,217][106225] Updated weights for policy 1, policy_version 1054338 (0.0008) [2023-12-28 02:49:00,273][106225] Updated weights for policy 1, policy_version 1054348 (0.0007) [2023-12-28 02:49:00,334][106225] Updated weights for policy 1, policy_version 1054358 (0.0005) [2023-12-28 02:49:00,574][106226] Updated weights for policy 0, policy_version 1051750 (0.0009) [2023-12-28 02:49:00,642][106226] Updated weights for policy 0, policy_version 1051760 (0.0011) [2023-12-28 02:49:00,705][106226] Updated weights for policy 0, policy_version 1051770 (0.0011) [2023-12-28 02:49:01,011][106225] Updated weights for policy 1, policy_version 1054368 (0.0009) [2023-12-28 02:49:01,075][106225] Updated weights for policy 1, policy_version 1054378 (0.0009) [2023-12-28 02:49:01,137][106225] Updated weights for policy 1, policy_version 1054388 (0.0008) [2023-12-28 02:49:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 539279360. Throughput: 0: 9885.3, 1: 9789.8. Samples: 539266284. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:01,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.821')] [2023-12-28 02:49:01,401][106226] Updated weights for policy 0, policy_version 1051780 (0.0009) [2023-12-28 02:49:01,462][106226] Updated weights for policy 0, policy_version 1051790 (0.0008) [2023-12-28 02:49:01,520][106226] Updated weights for policy 0, policy_version 1051800 (0.0008) [2023-12-28 02:49:01,886][106225] Updated weights for policy 1, policy_version 1054398 (0.0009) [2023-12-28 02:49:01,932][106225] Updated weights for policy 1, policy_version 1054408 (0.0010) [2023-12-28 02:49:01,983][106225] Updated weights for policy 1, policy_version 1054418 (0.0010) [2023-12-28 02:49:02,255][106226] Updated weights for policy 0, policy_version 1051810 (0.0008) [2023-12-28 02:49:02,318][106226] Updated weights for policy 0, policy_version 1051820 (0.0009) [2023-12-28 02:49:02,383][106226] Updated weights for policy 0, policy_version 1051830 (0.0009) [2023-12-28 02:49:02,444][106226] Updated weights for policy 0, policy_version 1051840 (0.0007) [2023-12-28 02:49:02,648][106225] Updated weights for policy 1, policy_version 1054428 (0.0007) [2023-12-28 02:49:02,699][106225] Updated weights for policy 1, policy_version 1054438 (0.0005) [2023-12-28 02:49:02,760][106225] Updated weights for policy 1, policy_version 1054448 (0.0008) [2023-12-28 02:49:03,112][106226] Updated weights for policy 0, policy_version 1051850 (0.0008) [2023-12-28 02:49:03,161][106226] Updated weights for policy 0, policy_version 1051860 (0.0008) [2023-12-28 02:49:03,210][106226] Updated weights for policy 0, policy_version 1051870 (0.0007) [2023-12-28 02:49:03,302][106225] Updated weights for policy 1, policy_version 1054458 (0.0008) [2023-12-28 02:49:03,362][106225] Updated weights for policy 1, policy_version 1054468 (0.0005) [2023-12-28 02:49:03,412][106225] Updated weights for policy 1, policy_version 1054478 (0.0005) [2023-12-28 02:49:03,462][106225] Updated weights for policy 1, policy_version 1054488 (0.0005) [2023-12-28 02:49:04,024][106226] Updated weights for policy 0, policy_version 1051880 (0.0008) [2023-12-28 02:49:04,092][106226] Updated weights for policy 0, policy_version 1051890 (0.0007) [2023-12-28 02:49:04,095][106225] Updated weights for policy 1, policy_version 1054498 (0.0007) [2023-12-28 02:49:04,158][106225] Updated weights for policy 1, policy_version 1054508 (0.0006) [2023-12-28 02:49:04,159][106226] Updated weights for policy 0, policy_version 1051900 (0.0009) [2023-12-28 02:49:04,224][106225] Updated weights for policy 1, policy_version 1054518 (0.0008) [2023-12-28 02:49:04,878][106226] Updated weights for policy 0, policy_version 1051910 (0.0009) [2023-12-28 02:49:04,929][106225] Updated weights for policy 1, policy_version 1054528 (0.0008) [2023-12-28 02:49:04,931][106226] Updated weights for policy 0, policy_version 1051920 (0.0006) [2023-12-28 02:49:04,986][106226] Updated weights for policy 0, policy_version 1051930 (0.0006) [2023-12-28 02:49:04,988][106225] Updated weights for policy 1, policy_version 1054538 (0.0006) [2023-12-28 02:49:05,040][106225] Updated weights for policy 1, policy_version 1054548 (0.0005) [2023-12-28 02:49:05,694][106225] Updated weights for policy 1, policy_version 1054558 (0.0006) [2023-12-28 02:49:05,746][106226] Updated weights for policy 0, policy_version 1051940 (0.0009) [2023-12-28 02:49:05,747][106225] Updated weights for policy 1, policy_version 1054568 (0.0008) [2023-12-28 02:49:05,799][106225] Updated weights for policy 1, policy_version 1054578 (0.0007) [2023-12-28 02:49:05,803][106226] Updated weights for policy 0, policy_version 1051950 (0.0008) [2023-12-28 02:49:05,861][106226] Updated weights for policy 0, policy_version 1051960 (0.0009) [2023-12-28 02:49:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 539377664. Throughput: 0: 9761.9, 1: 9871.8. Samples: 539385656. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:06,175][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.716')] [2023-12-28 02:49:06,447][106225] Updated weights for policy 1, policy_version 1054588 (0.0007) [2023-12-28 02:49:06,514][106225] Updated weights for policy 1, policy_version 1054598 (0.0007) [2023-12-28 02:49:06,551][106226] Updated weights for policy 0, policy_version 1051970 (0.0008) [2023-12-28 02:49:06,572][106225] Updated weights for policy 1, policy_version 1054608 (0.0007) [2023-12-28 02:49:06,615][106226] Updated weights for policy 0, policy_version 1051980 (0.0008) [2023-12-28 02:49:06,676][106226] Updated weights for policy 0, policy_version 1051990 (0.0006) [2023-12-28 02:49:06,734][106226] Updated weights for policy 0, policy_version 1052000 (0.0006) [2023-12-28 02:49:07,247][106225] Updated weights for policy 1, policy_version 1054618 (0.0006) [2023-12-28 02:49:07,294][106225] Updated weights for policy 1, policy_version 1054628 (0.0005) [2023-12-28 02:49:07,341][106225] Updated weights for policy 1, policy_version 1054638 (0.0005) [2023-12-28 02:49:07,395][106225] Updated weights for policy 1, policy_version 1054648 (0.0006) [2023-12-28 02:49:07,423][106226] Updated weights for policy 0, policy_version 1052010 (0.0009) [2023-12-28 02:49:07,471][106226] Updated weights for policy 0, policy_version 1052020 (0.0008) [2023-12-28 02:49:07,520][106226] Updated weights for policy 0, policy_version 1052030 (0.0007) [2023-12-28 02:49:08,084][106225] Updated weights for policy 1, policy_version 1054658 (0.0008) [2023-12-28 02:49:08,151][106225] Updated weights for policy 1, policy_version 1054668 (0.0008) [2023-12-28 02:49:08,220][106225] Updated weights for policy 1, policy_version 1054678 (0.0007) [2023-12-28 02:49:08,270][106226] Updated weights for policy 0, policy_version 1052040 (0.0009) [2023-12-28 02:49:08,331][106226] Updated weights for policy 0, policy_version 1052050 (0.0008) [2023-12-28 02:49:08,394][106226] Updated weights for policy 0, policy_version 1052060 (0.0008) [2023-12-28 02:49:08,906][106225] Updated weights for policy 1, policy_version 1054688 (0.0008) [2023-12-28 02:49:08,972][106225] Updated weights for policy 1, policy_version 1054698 (0.0005) [2023-12-28 02:49:09,033][106225] Updated weights for policy 1, policy_version 1054708 (0.0005) [2023-12-28 02:49:09,163][106226] Updated weights for policy 0, policy_version 1052070 (0.0009) [2023-12-28 02:49:09,229][106226] Updated weights for policy 0, policy_version 1052080 (0.0009) [2023-12-28 02:49:09,300][106226] Updated weights for policy 0, policy_version 1052090 (0.0009) [2023-12-28 02:49:09,803][106225] Updated weights for policy 1, policy_version 1054718 (0.0007) [2023-12-28 02:49:09,874][106225] Updated weights for policy 1, policy_version 1054728 (0.0008) [2023-12-28 02:49:09,947][106225] Updated weights for policy 1, policy_version 1054738 (0.0007) [2023-12-28 02:49:10,024][106226] Updated weights for policy 0, policy_version 1052100 (0.0010) [2023-12-28 02:49:10,083][106226] Updated weights for policy 0, policy_version 1052110 (0.0008) [2023-12-28 02:49:10,142][106226] Updated weights for policy 0, policy_version 1052120 (0.0008) [2023-12-28 02:49:10,685][106225] Updated weights for policy 1, policy_version 1054748 (0.0008) [2023-12-28 02:49:10,736][106225] Updated weights for policy 1, policy_version 1054758 (0.0008) [2023-12-28 02:49:10,789][106225] Updated weights for policy 1, policy_version 1054768 (0.0009) [2023-12-28 02:49:10,852][106226] Updated weights for policy 0, policy_version 1052130 (0.0008) [2023-12-28 02:49:10,905][106226] Updated weights for policy 0, policy_version 1052140 (0.0005) [2023-12-28 02:49:10,958][106226] Updated weights for policy 0, policy_version 1052150 (0.0005) [2023-12-28 02:49:11,012][106226] Updated weights for policy 0, policy_version 1052160 (0.0006) [2023-12-28 02:49:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 539475968. Throughput: 0: 9758.6, 1: 9910.8. Samples: 539445244. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:11,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-4.989')] [2023-12-28 02:49:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001054776_270065664.pth... [2023-12-28 02:49:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001052160_269410304.pth... [2023-12-28 02:49:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001053624_269770752.pth [2023-12-28 02:49:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001051040_269123584.pth [2023-12-28 02:49:11,626][106225] Updated weights for policy 1, policy_version 1054778 (0.0009) [2023-12-28 02:49:11,699][106225] Updated weights for policy 1, policy_version 1054788 (0.0009) [2023-12-28 02:49:11,727][106226] Updated weights for policy 0, policy_version 1052170 (0.0008) [2023-12-28 02:49:11,767][106225] Updated weights for policy 1, policy_version 1054798 (0.0008) [2023-12-28 02:49:11,789][106226] Updated weights for policy 0, policy_version 1052180 (0.0009) [2023-12-28 02:49:11,826][106225] Updated weights for policy 1, policy_version 1054808 (0.0006) [2023-12-28 02:49:11,850][106226] Updated weights for policy 0, policy_version 1052190 (0.0008) [2023-12-28 02:49:12,538][106225] Updated weights for policy 1, policy_version 1054818 (0.0006) [2023-12-28 02:49:12,583][106226] Updated weights for policy 0, policy_version 1052200 (0.0008) [2023-12-28 02:49:12,595][106225] Updated weights for policy 1, policy_version 1054828 (0.0006) [2023-12-28 02:49:12,646][106226] Updated weights for policy 0, policy_version 1052210 (0.0006) [2023-12-28 02:49:12,652][106225] Updated weights for policy 1, policy_version 1054838 (0.0007) [2023-12-28 02:49:12,718][106226] Updated weights for policy 0, policy_version 1052220 (0.0007) [2023-12-28 02:49:13,347][106225] Updated weights for policy 1, policy_version 1054848 (0.0007) [2023-12-28 02:49:13,394][106225] Updated weights for policy 1, policy_version 1054858 (0.0008) [2023-12-28 02:49:13,423][106226] Updated weights for policy 0, policy_version 1052230 (0.0009) [2023-12-28 02:49:13,437][106225] Updated weights for policy 1, policy_version 1054868 (0.0005) [2023-12-28 02:49:13,466][106226] Updated weights for policy 0, policy_version 1052240 (0.0010) [2023-12-28 02:49:13,517][106226] Updated weights for policy 0, policy_version 1052250 (0.0010) [2023-12-28 02:49:14,084][106225] Updated weights for policy 1, policy_version 1054878 (0.0006) [2023-12-28 02:49:14,135][106225] Updated weights for policy 1, policy_version 1054888 (0.0006) [2023-12-28 02:49:14,189][106225] Updated weights for policy 1, policy_version 1054898 (0.0005) [2023-12-28 02:49:14,252][106226] Updated weights for policy 0, policy_version 1052260 (0.0011) [2023-12-28 02:49:14,313][106226] Updated weights for policy 0, policy_version 1052270 (0.0009) [2023-12-28 02:49:14,373][106226] Updated weights for policy 0, policy_version 1052280 (0.0011) [2023-12-28 02:49:14,836][106225] Updated weights for policy 1, policy_version 1054908 (0.0006) [2023-12-28 02:49:14,895][106225] Updated weights for policy 1, policy_version 1054918 (0.0008) [2023-12-28 02:49:14,948][106225] Updated weights for policy 1, policy_version 1054928 (0.0007) [2023-12-28 02:49:15,093][106226] Updated weights for policy 0, policy_version 1052290 (0.0010) [2023-12-28 02:49:15,145][106226] Updated weights for policy 0, policy_version 1052300 (0.0011) [2023-12-28 02:49:15,213][106226] Updated weights for policy 0, policy_version 1052310 (0.0011) [2023-12-28 02:49:15,281][106226] Updated weights for policy 0, policy_version 1052320 (0.0010) [2023-12-28 02:49:15,537][106225] Updated weights for policy 1, policy_version 1054938 (0.0006) [2023-12-28 02:49:15,587][106225] Updated weights for policy 1, policy_version 1054948 (0.0009) [2023-12-28 02:49:15,646][106225] Updated weights for policy 1, policy_version 1054958 (0.0008) [2023-12-28 02:49:15,699][106225] Updated weights for policy 1, policy_version 1054968 (0.0008) [2023-12-28 02:49:15,880][106226] Updated weights for policy 0, policy_version 1052330 (0.0005) [2023-12-28 02:49:15,935][106226] Updated weights for policy 0, policy_version 1052340 (0.0005) [2023-12-28 02:49:15,987][106226] Updated weights for policy 0, policy_version 1052350 (0.0009) [2023-12-28 02:49:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 539574272. Throughput: 0: 9652.0, 1: 9829.5. Samples: 539560800. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:16,176][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.024')] [2023-12-28 02:49:16,345][106225] Updated weights for policy 1, policy_version 1054978 (0.0010) [2023-12-28 02:49:16,409][106225] Updated weights for policy 1, policy_version 1054988 (0.0007) [2023-12-28 02:49:16,463][106225] Updated weights for policy 1, policy_version 1054998 (0.0006) [2023-12-28 02:49:16,604][106226] Updated weights for policy 0, policy_version 1052360 (0.0008) [2023-12-28 02:49:16,654][106226] Updated weights for policy 0, policy_version 1052370 (0.0008) [2023-12-28 02:49:16,704][106226] Updated weights for policy 0, policy_version 1052380 (0.0008) [2023-12-28 02:49:17,157][106225] Updated weights for policy 1, policy_version 1055008 (0.0009) [2023-12-28 02:49:17,205][106225] Updated weights for policy 1, policy_version 1055018 (0.0010) [2023-12-28 02:49:17,253][106225] Updated weights for policy 1, policy_version 1055028 (0.0010) [2023-12-28 02:49:17,462][106226] Updated weights for policy 0, policy_version 1052390 (0.0007) [2023-12-28 02:49:17,528][106226] Updated weights for policy 0, policy_version 1052400 (0.0008) [2023-12-28 02:49:17,580][106226] Updated weights for policy 0, policy_version 1052410 (0.0007) [2023-12-28 02:49:17,998][106225] Updated weights for policy 1, policy_version 1055038 (0.0007) [2023-12-28 02:49:18,065][106225] Updated weights for policy 1, policy_version 1055048 (0.0006) [2023-12-28 02:49:18,126][106225] Updated weights for policy 1, policy_version 1055058 (0.0008) [2023-12-28 02:49:18,166][106226] Updated weights for policy 0, policy_version 1052420 (0.0007) [2023-12-28 02:49:18,233][106226] Updated weights for policy 0, policy_version 1052430 (0.0007) [2023-12-28 02:49:18,293][106226] Updated weights for policy 0, policy_version 1052440 (0.0008) [2023-12-28 02:49:18,709][106225] Updated weights for policy 1, policy_version 1055068 (0.0008) [2023-12-28 02:49:18,772][106225] Updated weights for policy 1, policy_version 1055078 (0.0009) [2023-12-28 02:49:18,834][106225] Updated weights for policy 1, policy_version 1055088 (0.0008) [2023-12-28 02:49:19,048][106226] Updated weights for policy 0, policy_version 1052450 (0.0009) [2023-12-28 02:49:19,096][106226] Updated weights for policy 0, policy_version 1052460 (0.0006) [2023-12-28 02:49:19,151][106226] Updated weights for policy 0, policy_version 1052470 (0.0007) [2023-12-28 02:49:19,204][106226] Updated weights for policy 0, policy_version 1052480 (0.0009) [2023-12-28 02:49:19,449][106225] Updated weights for policy 1, policy_version 1055098 (0.0007) [2023-12-28 02:49:19,517][106225] Updated weights for policy 1, policy_version 1055108 (0.0010) [2023-12-28 02:49:19,588][106225] Updated weights for policy 1, policy_version 1055118 (0.0011) [2023-12-28 02:49:19,653][106225] Updated weights for policy 1, policy_version 1055128 (0.0011) [2023-12-28 02:49:20,029][106226] Updated weights for policy 0, policy_version 1052490 (0.0008) [2023-12-28 02:49:20,096][106226] Updated weights for policy 0, policy_version 1052500 (0.0009) [2023-12-28 02:49:20,153][106226] Updated weights for policy 0, policy_version 1052510 (0.0008) [2023-12-28 02:49:20,387][106225] Updated weights for policy 1, policy_version 1055138 (0.0010) [2023-12-28 02:49:20,435][106225] Updated weights for policy 1, policy_version 1055148 (0.0010) [2023-12-28 02:49:20,483][106225] Updated weights for policy 1, policy_version 1055158 (0.0010) [2023-12-28 02:49:20,955][106226] Updated weights for policy 0, policy_version 1052520 (0.0008) [2023-12-28 02:49:21,020][106226] Updated weights for policy 0, policy_version 1052530 (0.0006) [2023-12-28 02:49:21,082][106226] Updated weights for policy 0, policy_version 1052540 (0.0008) [2023-12-28 02:49:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 539672576. Throughput: 0: 9665.2, 1: 9885.8. Samples: 539681832. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:21,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.975')] [2023-12-28 02:49:21,186][106225] Updated weights for policy 1, policy_version 1055168 (0.0007) [2023-12-28 02:49:21,260][106225] Updated weights for policy 1, policy_version 1055178 (0.0011) [2023-12-28 02:49:21,322][106225] Updated weights for policy 1, policy_version 1055188 (0.0009) [2023-12-28 02:49:21,854][106226] Updated weights for policy 0, policy_version 1052550 (0.0008) [2023-12-28 02:49:21,924][106226] Updated weights for policy 0, policy_version 1052560 (0.0009) [2023-12-28 02:49:21,994][106226] Updated weights for policy 0, policy_version 1052570 (0.0008) [2023-12-28 02:49:22,031][106225] Updated weights for policy 1, policy_version 1055198 (0.0007) [2023-12-28 02:49:22,092][106225] Updated weights for policy 1, policy_version 1055208 (0.0008) [2023-12-28 02:49:22,154][106225] Updated weights for policy 1, policy_version 1055218 (0.0008) [2023-12-28 02:49:22,765][106226] Updated weights for policy 0, policy_version 1052580 (0.0008) [2023-12-28 02:49:22,832][106226] Updated weights for policy 0, policy_version 1052590 (0.0008) [2023-12-28 02:49:22,900][106226] Updated weights for policy 0, policy_version 1052600 (0.0009) [2023-12-28 02:49:22,927][106225] Updated weights for policy 1, policy_version 1055228 (0.0008) [2023-12-28 02:49:22,990][106225] Updated weights for policy 1, policy_version 1055238 (0.0005) [2023-12-28 02:49:23,045][106225] Updated weights for policy 1, policy_version 1055248 (0.0006) [2023-12-28 02:49:23,662][106226] Updated weights for policy 0, policy_version 1052610 (0.0008) [2023-12-28 02:49:23,732][106226] Updated weights for policy 0, policy_version 1052620 (0.0008) [2023-12-28 02:49:23,780][106225] Updated weights for policy 1, policy_version 1055258 (0.0008) [2023-12-28 02:49:23,801][106226] Updated weights for policy 0, policy_version 1052630 (0.0008) [2023-12-28 02:49:23,840][106225] Updated weights for policy 1, policy_version 1055268 (0.0006) [2023-12-28 02:49:23,866][106226] Updated weights for policy 0, policy_version 1052640 (0.0008) [2023-12-28 02:49:23,902][106225] Updated weights for policy 1, policy_version 1055278 (0.0006) [2023-12-28 02:49:23,963][106225] Updated weights for policy 1, policy_version 1055288 (0.0005) [2023-12-28 02:49:24,500][106225] Updated weights for policy 1, policy_version 1055298 (0.0008) [2023-12-28 02:49:24,544][106225] Updated weights for policy 1, policy_version 1055308 (0.0008) [2023-12-28 02:49:24,586][106226] Updated weights for policy 0, policy_version 1052650 (0.0007) [2023-12-28 02:49:24,597][106225] Updated weights for policy 1, policy_version 1055318 (0.0006) [2023-12-28 02:49:24,632][106226] Updated weights for policy 0, policy_version 1052660 (0.0007) [2023-12-28 02:49:24,681][106226] Updated weights for policy 0, policy_version 1052670 (0.0009) [2023-12-28 02:49:25,328][106225] Updated weights for policy 1, policy_version 1055328 (0.0008) [2023-12-28 02:49:25,375][106225] Updated weights for policy 1, policy_version 1055338 (0.0007) [2023-12-28 02:49:25,376][106226] Updated weights for policy 0, policy_version 1052680 (0.0008) [2023-12-28 02:49:25,426][106226] Updated weights for policy 0, policy_version 1052690 (0.0007) [2023-12-28 02:49:25,436][106225] Updated weights for policy 1, policy_version 1055348 (0.0007) [2023-12-28 02:49:25,479][106226] Updated weights for policy 0, policy_version 1052700 (0.0008) [2023-12-28 02:49:26,101][106225] Updated weights for policy 1, policy_version 1055358 (0.0008) [2023-12-28 02:49:26,103][106226] Updated weights for policy 0, policy_version 1052710 (0.0008) [2023-12-28 02:49:26,152][106225] Updated weights for policy 1, policy_version 1055368 (0.0005) [2023-12-28 02:49:26,158][106226] Updated weights for policy 0, policy_version 1052720 (0.0008) [2023-12-28 02:49:26,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 539762688. Throughput: 0: 9567.3, 1: 9908.8. Samples: 539736996. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:26,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.691')] [2023-12-28 02:49:26,208][106225] Updated weights for policy 1, policy_version 1055378 (0.0008) [2023-12-28 02:49:26,216][106226] Updated weights for policy 0, policy_version 1052730 (0.0005) [2023-12-28 02:49:26,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001055384_270221312.pth... [2023-12-28 02:49:26,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001054200_269918208.pth [2023-12-28 02:49:26,249][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001052736_269557760.pth... [2023-12-28 02:49:26,252][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001051616_269271040.pth [2023-12-28 02:49:26,776][106226] Updated weights for policy 0, policy_version 1052740 (0.0006) [2023-12-28 02:49:26,824][106226] Updated weights for policy 0, policy_version 1052750 (0.0007) [2023-12-28 02:49:26,877][106226] Updated weights for policy 0, policy_version 1052760 (0.0008) [2023-12-28 02:49:26,999][106225] Updated weights for policy 1, policy_version 1055388 (0.0008) [2023-12-28 02:49:27,054][106225] Updated weights for policy 1, policy_version 1055398 (0.0010) [2023-12-28 02:49:27,111][106225] Updated weights for policy 1, policy_version 1055408 (0.0009) [2023-12-28 02:49:27,504][106226] Updated weights for policy 0, policy_version 1052770 (0.0008) [2023-12-28 02:49:27,568][106226] Updated weights for policy 0, policy_version 1052780 (0.0008) [2023-12-28 02:49:27,620][106226] Updated weights for policy 0, policy_version 1052790 (0.0006) [2023-12-28 02:49:27,672][106226] Updated weights for policy 0, policy_version 1052800 (0.0005) [2023-12-28 02:49:27,853][106225] Updated weights for policy 1, policy_version 1055418 (0.0008) [2023-12-28 02:49:27,910][106225] Updated weights for policy 1, policy_version 1055428 (0.0008) [2023-12-28 02:49:27,967][106225] Updated weights for policy 1, policy_version 1055438 (0.0010) [2023-12-28 02:49:28,021][106225] Updated weights for policy 1, policy_version 1055448 (0.0007) [2023-12-28 02:49:28,238][106226] Updated weights for policy 0, policy_version 1052810 (0.0006) [2023-12-28 02:49:28,291][106226] Updated weights for policy 0, policy_version 1052820 (0.0006) [2023-12-28 02:49:28,352][106226] Updated weights for policy 0, policy_version 1052830 (0.0008) [2023-12-28 02:49:28,786][106225] Updated weights for policy 1, policy_version 1055458 (0.0007) [2023-12-28 02:49:28,837][106225] Updated weights for policy 1, policy_version 1055468 (0.0008) [2023-12-28 02:49:28,891][106225] Updated weights for policy 1, policy_version 1055478 (0.0008) [2023-12-28 02:49:29,047][106226] Updated weights for policy 0, policy_version 1052840 (0.0008) [2023-12-28 02:49:29,094][106226] Updated weights for policy 0, policy_version 1052850 (0.0008) [2023-12-28 02:49:29,138][106226] Updated weights for policy 0, policy_version 1052860 (0.0008) [2023-12-28 02:49:29,690][106225] Updated weights for policy 1, policy_version 1055488 (0.0006) [2023-12-28 02:49:29,750][106225] Updated weights for policy 1, policy_version 1055498 (0.0006) [2023-12-28 02:49:29,815][106225] Updated weights for policy 1, policy_version 1055508 (0.0007) [2023-12-28 02:49:29,990][106226] Updated weights for policy 0, policy_version 1052870 (0.0009) [2023-12-28 02:49:30,060][106226] Updated weights for policy 0, policy_version 1052880 (0.0008) [2023-12-28 02:49:30,118][106226] Updated weights for policy 0, policy_version 1052890 (0.0006) [2023-12-28 02:49:30,449][106225] Updated weights for policy 1, policy_version 1055518 (0.0007) [2023-12-28 02:49:30,506][106225] Updated weights for policy 1, policy_version 1055528 (0.0006) [2023-12-28 02:49:30,567][106225] Updated weights for policy 1, policy_version 1055538 (0.0008) [2023-12-28 02:49:30,795][106226] Updated weights for policy 0, policy_version 1052900 (0.0009) [2023-12-28 02:49:30,860][106226] Updated weights for policy 0, policy_version 1052910 (0.0009) [2023-12-28 02:49:30,918][106226] Updated weights for policy 0, policy_version 1052920 (0.0006) [2023-12-28 02:49:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 539869184. Throughput: 0: 9697.7, 1: 9957.6. Samples: 539858580. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:31,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.891')] [2023-12-28 02:49:31,219][106225] Updated weights for policy 1, policy_version 1055548 (0.0008) [2023-12-28 02:49:31,282][106225] Updated weights for policy 1, policy_version 1055558 (0.0007) [2023-12-28 02:49:31,345][106225] Updated weights for policy 1, policy_version 1055568 (0.0008) [2023-12-28 02:49:31,745][106226] Updated weights for policy 0, policy_version 1052930 (0.0006) [2023-12-28 02:49:31,830][106226] Updated weights for policy 0, policy_version 1052940 (0.0010) [2023-12-28 02:49:31,915][106226] Updated weights for policy 0, policy_version 1052950 (0.0009) [2023-12-28 02:49:31,990][106226] Updated weights for policy 0, policy_version 1052960 (0.0007) [2023-12-28 02:49:32,049][106225] Updated weights for policy 1, policy_version 1055578 (0.0009) [2023-12-28 02:49:32,099][106225] Updated weights for policy 1, policy_version 1055588 (0.0010) [2023-12-28 02:49:32,155][106225] Updated weights for policy 1, policy_version 1055598 (0.0010) [2023-12-28 02:49:32,213][106225] Updated weights for policy 1, policy_version 1055608 (0.0010) [2023-12-28 02:49:32,656][106226] Updated weights for policy 0, policy_version 1052970 (0.0010) [2023-12-28 02:49:32,710][106226] Updated weights for policy 0, policy_version 1052980 (0.0010) [2023-12-28 02:49:32,766][106226] Updated weights for policy 0, policy_version 1052990 (0.0010) [2023-12-28 02:49:32,937][106225] Updated weights for policy 1, policy_version 1055618 (0.0010) [2023-12-28 02:49:32,995][106225] Updated weights for policy 1, policy_version 1055628 (0.0010) [2023-12-28 02:49:33,037][106225] Updated weights for policy 1, policy_version 1055638 (0.0010) [2023-12-28 02:49:33,383][106226] Updated weights for policy 0, policy_version 1053000 (0.0006) [2023-12-28 02:49:33,445][106226] Updated weights for policy 0, policy_version 1053010 (0.0005) [2023-12-28 02:49:33,500][106226] Updated weights for policy 0, policy_version 1053020 (0.0005) [2023-12-28 02:49:33,766][106225] Updated weights for policy 1, policy_version 1055648 (0.0010) [2023-12-28 02:49:33,816][106225] Updated weights for policy 1, policy_version 1055658 (0.0010) [2023-12-28 02:49:33,874][106225] Updated weights for policy 1, policy_version 1055668 (0.0010) [2023-12-28 02:49:34,004][106226] Updated weights for policy 0, policy_version 1053030 (0.0008) [2023-12-28 02:49:34,060][106226] Updated weights for policy 0, policy_version 1053040 (0.0010) [2023-12-28 02:49:34,116][106226] Updated weights for policy 0, policy_version 1053050 (0.0010) [2023-12-28 02:49:34,589][106225] Updated weights for policy 1, policy_version 1055678 (0.0010) [2023-12-28 02:49:34,650][106225] Updated weights for policy 1, policy_version 1055688 (0.0010) [2023-12-28 02:49:34,711][106225] Updated weights for policy 1, policy_version 1055698 (0.0010) [2023-12-28 02:49:34,837][106226] Updated weights for policy 0, policy_version 1053060 (0.0009) [2023-12-28 02:49:34,892][106226] Updated weights for policy 0, policy_version 1053070 (0.0005) [2023-12-28 02:49:34,938][106226] Updated weights for policy 0, policy_version 1053080 (0.0005) [2023-12-28 02:49:35,429][106225] Updated weights for policy 1, policy_version 1055708 (0.0010) [2023-12-28 02:49:35,485][106225] Updated weights for policy 1, policy_version 1055718 (0.0010) [2023-12-28 02:49:35,545][106225] Updated weights for policy 1, policy_version 1055728 (0.0010) [2023-12-28 02:49:35,548][106226] Updated weights for policy 0, policy_version 1053090 (0.0007) [2023-12-28 02:49:35,598][106226] Updated weights for policy 0, policy_version 1053100 (0.0010) [2023-12-28 02:49:35,656][106226] Updated weights for policy 0, policy_version 1053110 (0.0010) [2023-12-28 02:49:35,718][106226] Updated weights for policy 0, policy_version 1053120 (0.0010) [2023-12-28 02:49:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 539967488. Throughput: 0: 9804.1, 1: 9887.9. Samples: 539979320. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:36,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.107')] [2023-12-28 02:49:36,273][106225] Updated weights for policy 1, policy_version 1055738 (0.0010) [2023-12-28 02:49:36,342][106225] Updated weights for policy 1, policy_version 1055748 (0.0011) [2023-12-28 02:49:36,400][106225] Updated weights for policy 1, policy_version 1055758 (0.0010) [2023-12-28 02:49:36,406][106226] Updated weights for policy 0, policy_version 1053130 (0.0005) [2023-12-28 02:49:36,461][106225] Updated weights for policy 1, policy_version 1055768 (0.0010) [2023-12-28 02:49:36,469][106226] Updated weights for policy 0, policy_version 1053140 (0.0008) [2023-12-28 02:49:36,536][106226] Updated weights for policy 0, policy_version 1053150 (0.0009) [2023-12-28 02:49:37,044][106225] Updated weights for policy 1, policy_version 1055778 (0.0006) [2023-12-28 02:49:37,089][106225] Updated weights for policy 1, policy_version 1055788 (0.0009) [2023-12-28 02:49:37,143][106225] Updated weights for policy 1, policy_version 1055798 (0.0007) [2023-12-28 02:49:37,317][106226] Updated weights for policy 0, policy_version 1053160 (0.0008) [2023-12-28 02:49:37,367][106226] Updated weights for policy 0, policy_version 1053170 (0.0008) [2023-12-28 02:49:37,413][106226] Updated weights for policy 0, policy_version 1053180 (0.0008) [2023-12-28 02:49:37,777][106225] Updated weights for policy 1, policy_version 1055808 (0.0005) [2023-12-28 02:49:37,833][106225] Updated weights for policy 1, policy_version 1055818 (0.0005) [2023-12-28 02:49:37,889][106225] Updated weights for policy 1, policy_version 1055828 (0.0005) [2023-12-28 02:49:38,208][106226] Updated weights for policy 0, policy_version 1053190 (0.0008) [2023-12-28 02:49:38,277][106226] Updated weights for policy 0, policy_version 1053200 (0.0007) [2023-12-28 02:49:38,345][106226] Updated weights for policy 0, policy_version 1053210 (0.0008) [2023-12-28 02:49:38,553][106225] Updated weights for policy 1, policy_version 1055838 (0.0005) [2023-12-28 02:49:38,607][106225] Updated weights for policy 1, policy_version 1055848 (0.0006) [2023-12-28 02:49:38,663][106225] Updated weights for policy 1, policy_version 1055858 (0.0009) [2023-12-28 02:49:39,083][106226] Updated weights for policy 0, policy_version 1053220 (0.0008) [2023-12-28 02:49:39,144][106226] Updated weights for policy 0, policy_version 1053230 (0.0008) [2023-12-28 02:49:39,194][106226] Updated weights for policy 0, policy_version 1053240 (0.0008) [2023-12-28 02:49:39,396][106225] Updated weights for policy 1, policy_version 1055868 (0.0010) [2023-12-28 02:49:39,455][106225] Updated weights for policy 1, policy_version 1055878 (0.0008) [2023-12-28 02:49:39,524][106225] Updated weights for policy 1, policy_version 1055888 (0.0009) [2023-12-28 02:49:39,842][106226] Updated weights for policy 0, policy_version 1053250 (0.0008) [2023-12-28 02:49:39,909][106226] Updated weights for policy 0, policy_version 1053260 (0.0007) [2023-12-28 02:49:39,976][106226] Updated weights for policy 0, policy_version 1053270 (0.0008) [2023-12-28 02:49:40,041][106226] Updated weights for policy 0, policy_version 1053280 (0.0010) [2023-12-28 02:49:40,187][106225] Updated weights for policy 1, policy_version 1055898 (0.0010) [2023-12-28 02:49:40,250][106225] Updated weights for policy 1, policy_version 1055908 (0.0011) [2023-12-28 02:49:40,312][106225] Updated weights for policy 1, policy_version 1055918 (0.0010) [2023-12-28 02:49:40,373][106225] Updated weights for policy 1, policy_version 1055928 (0.0006) [2023-12-28 02:49:40,772][106226] Updated weights for policy 0, policy_version 1053290 (0.0008) [2023-12-28 02:49:40,820][106226] Updated weights for policy 0, policy_version 1053300 (0.0007) [2023-12-28 02:49:40,868][106226] Updated weights for policy 0, policy_version 1053310 (0.0009) [2023-12-28 02:49:40,997][106225] Updated weights for policy 1, policy_version 1055938 (0.0006) [2023-12-28 02:49:41,073][106225] Updated weights for policy 1, policy_version 1055949 (0.0008) [2023-12-28 02:49:41,143][106225] Updated weights for policy 1, policy_version 1055959 (0.0007) [2023-12-28 02:49:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 540073984. Throughput: 0: 9783.7, 1: 9964.2. Samples: 540038776. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:41,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.825')] [2023-12-28 02:49:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001055960_270368768.pth... [2023-12-28 02:49:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001053312_269705216.pth... [2023-12-28 02:49:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001052160_269410304.pth [2023-12-28 02:49:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001054776_270065664.pth [2023-12-28 02:49:41,682][106226] Updated weights for policy 0, policy_version 1053320 (0.0010) [2023-12-28 02:49:41,754][106226] Updated weights for policy 0, policy_version 1053330 (0.0009) [2023-12-28 02:49:41,817][106226] Updated weights for policy 0, policy_version 1053340 (0.0007) [2023-12-28 02:49:41,974][106225] Updated weights for policy 1, policy_version 1055969 (0.0007) [2023-12-28 02:49:42,037][106225] Updated weights for policy 1, policy_version 1055979 (0.0008) [2023-12-28 02:49:42,107][106225] Updated weights for policy 1, policy_version 1055989 (0.0006) [2023-12-28 02:49:42,503][106226] Updated weights for policy 0, policy_version 1053350 (0.0007) [2023-12-28 02:49:42,566][106226] Updated weights for policy 0, policy_version 1053360 (0.0009) [2023-12-28 02:49:42,633][106226] Updated weights for policy 0, policy_version 1053370 (0.0009) [2023-12-28 02:49:42,827][106225] Updated weights for policy 1, policy_version 1055999 (0.0007) [2023-12-28 02:49:42,895][106225] Updated weights for policy 1, policy_version 1056009 (0.0006) [2023-12-28 02:49:42,961][106225] Updated weights for policy 1, policy_version 1056019 (0.0005) [2023-12-28 02:49:43,399][106226] Updated weights for policy 0, policy_version 1053380 (0.0009) [2023-12-28 02:49:43,458][106226] Updated weights for policy 0, policy_version 1053390 (0.0009) [2023-12-28 02:49:43,516][106226] Updated weights for policy 0, policy_version 1053400 (0.0008) [2023-12-28 02:49:43,574][106225] Updated weights for policy 1, policy_version 1056029 (0.0005) [2023-12-28 02:49:43,634][106225] Updated weights for policy 1, policy_version 1056039 (0.0005) [2023-12-28 02:49:43,690][106225] Updated weights for policy 1, policy_version 1056049 (0.0005) [2023-12-28 02:49:44,268][106226] Updated weights for policy 0, policy_version 1053410 (0.0008) [2023-12-28 02:49:44,319][106226] Updated weights for policy 0, policy_version 1053420 (0.0008) [2023-12-28 02:49:44,321][106225] Updated weights for policy 1, policy_version 1056059 (0.0006) [2023-12-28 02:49:44,367][106226] Updated weights for policy 0, policy_version 1053430 (0.0008) [2023-12-28 02:49:44,377][106225] Updated weights for policy 1, policy_version 1056069 (0.0007) [2023-12-28 02:49:44,430][106226] Updated weights for policy 0, policy_version 1053440 (0.0007) [2023-12-28 02:49:44,435][106225] Updated weights for policy 1, policy_version 1056079 (0.0008) [2023-12-28 02:49:45,158][106225] Updated weights for policy 1, policy_version 1056089 (0.0008) [2023-12-28 02:49:45,177][106226] Updated weights for policy 0, policy_version 1053450 (0.0008) [2023-12-28 02:49:45,221][106225] Updated weights for policy 1, policy_version 1056099 (0.0008) [2023-12-28 02:49:45,230][106226] Updated weights for policy 0, policy_version 1053460 (0.0007) [2023-12-28 02:49:45,284][106225] Updated weights for policy 1, policy_version 1056109 (0.0006) [2023-12-28 02:49:45,292][106226] Updated weights for policy 0, policy_version 1053470 (0.0008) [2023-12-28 02:49:45,348][106225] Updated weights for policy 1, policy_version 1056119 (0.0007) [2023-12-28 02:49:46,011][106225] Updated weights for policy 1, policy_version 1056129 (0.0008) [2023-12-28 02:49:46,037][106226] Updated weights for policy 0, policy_version 1053480 (0.0007) [2023-12-28 02:49:46,062][106225] Updated weights for policy 1, policy_version 1056139 (0.0006) [2023-12-28 02:49:46,090][106226] Updated weights for policy 0, policy_version 1053490 (0.0006) [2023-12-28 02:49:46,119][106225] Updated weights for policy 1, policy_version 1056149 (0.0007) [2023-12-28 02:49:46,147][106226] Updated weights for policy 0, policy_version 1053500 (0.0007) [2023-12-28 02:49:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 540172288. Throughput: 0: 9748.9, 1: 10007.2. Samples: 540155312. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:46,176][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.969')] [2023-12-28 02:49:46,733][106225] Updated weights for policy 1, policy_version 1056159 (0.0008) [2023-12-28 02:49:46,785][106225] Updated weights for policy 1, policy_version 1056169 (0.0009) [2023-12-28 02:49:46,841][106225] Updated weights for policy 1, policy_version 1056179 (0.0008) [2023-12-28 02:49:46,894][106226] Updated weights for policy 0, policy_version 1053510 (0.0009) [2023-12-28 02:49:46,950][106226] Updated weights for policy 0, policy_version 1053520 (0.0009) [2023-12-28 02:49:47,016][106226] Updated weights for policy 0, policy_version 1053530 (0.0010) [2023-12-28 02:49:47,489][106225] Updated weights for policy 1, policy_version 1056189 (0.0006) [2023-12-28 02:49:47,546][106225] Updated weights for policy 1, policy_version 1056199 (0.0010) [2023-12-28 02:49:47,602][106225] Updated weights for policy 1, policy_version 1056209 (0.0010) [2023-12-28 02:49:47,793][106226] Updated weights for policy 0, policy_version 1053540 (0.0009) [2023-12-28 02:49:47,848][106226] Updated weights for policy 0, policy_version 1053550 (0.0009) [2023-12-28 02:49:47,907][106226] Updated weights for policy 0, policy_version 1053560 (0.0008) [2023-12-28 02:49:48,280][106225] Updated weights for policy 1, policy_version 1056219 (0.0010) [2023-12-28 02:49:48,337][106225] Updated weights for policy 1, policy_version 1056229 (0.0009) [2023-12-28 02:49:48,399][106225] Updated weights for policy 1, policy_version 1056239 (0.0009) [2023-12-28 02:49:48,621][106226] Updated weights for policy 0, policy_version 1053570 (0.0009) [2023-12-28 02:49:48,693][106226] Updated weights for policy 0, policy_version 1053580 (0.0010) [2023-12-28 02:49:48,762][106226] Updated weights for policy 0, policy_version 1053590 (0.0008) [2023-12-28 02:49:48,829][106226] Updated weights for policy 0, policy_version 1053600 (0.0008) [2023-12-28 02:49:49,112][106225] Updated weights for policy 1, policy_version 1056249 (0.0009) [2023-12-28 02:49:49,162][106225] Updated weights for policy 1, policy_version 1056259 (0.0008) [2023-12-28 02:49:49,210][106225] Updated weights for policy 1, policy_version 1056269 (0.0008) [2023-12-28 02:49:49,276][106225] Updated weights for policy 1, policy_version 1056279 (0.0008) [2023-12-28 02:49:49,577][106226] Updated weights for policy 0, policy_version 1053610 (0.0009) [2023-12-28 02:49:49,642][106226] Updated weights for policy 0, policy_version 1053620 (0.0010) [2023-12-28 02:49:49,712][106226] Updated weights for policy 0, policy_version 1053630 (0.0007) [2023-12-28 02:49:50,009][106225] Updated weights for policy 1, policy_version 1056289 (0.0008) [2023-12-28 02:49:50,066][106225] Updated weights for policy 1, policy_version 1056299 (0.0010) [2023-12-28 02:49:50,125][106225] Updated weights for policy 1, policy_version 1056309 (0.0009) [2023-12-28 02:49:50,389][106226] Updated weights for policy 0, policy_version 1053640 (0.0008) [2023-12-28 02:49:50,445][106226] Updated weights for policy 0, policy_version 1053650 (0.0006) [2023-12-28 02:49:50,494][106226] Updated weights for policy 0, policy_version 1053660 (0.0007) [2023-12-28 02:49:50,881][106225] Updated weights for policy 1, policy_version 1056319 (0.0008) [2023-12-28 02:49:50,941][106225] Updated weights for policy 1, policy_version 1056329 (0.0008) [2023-12-28 02:49:50,997][106225] Updated weights for policy 1, policy_version 1056339 (0.0008) [2023-12-28 02:49:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 540262400. Throughput: 0: 9741.0, 1: 9968.0. Samples: 540272560. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:51,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.767')] [2023-12-28 02:49:51,216][106226] Updated weights for policy 0, policy_version 1053670 (0.0007) [2023-12-28 02:49:51,284][106226] Updated weights for policy 0, policy_version 1053680 (0.0009) [2023-12-28 02:49:51,346][106226] Updated weights for policy 0, policy_version 1053690 (0.0009) [2023-12-28 02:49:51,784][106225] Updated weights for policy 1, policy_version 1056349 (0.0007) [2023-12-28 02:49:51,840][106225] Updated weights for policy 1, policy_version 1056359 (0.0006) [2023-12-28 02:49:51,900][106225] Updated weights for policy 1, policy_version 1056369 (0.0006) [2023-12-28 02:49:52,093][106226] Updated weights for policy 0, policy_version 1053700 (0.0007) [2023-12-28 02:49:52,157][106226] Updated weights for policy 0, policy_version 1053710 (0.0006) [2023-12-28 02:49:52,222][106226] Updated weights for policy 0, policy_version 1053720 (0.0005) [2023-12-28 02:49:52,611][106225] Updated weights for policy 1, policy_version 1056379 (0.0009) [2023-12-28 02:49:52,674][106225] Updated weights for policy 1, policy_version 1056389 (0.0008) [2023-12-28 02:49:52,737][106225] Updated weights for policy 1, policy_version 1056399 (0.0008) [2023-12-28 02:49:52,919][106226] Updated weights for policy 0, policy_version 1053730 (0.0008) [2023-12-28 02:49:52,977][106226] Updated weights for policy 0, policy_version 1053740 (0.0009) [2023-12-28 02:49:53,037][106226] Updated weights for policy 0, policy_version 1053750 (0.0009) [2023-12-28 02:49:53,097][106226] Updated weights for policy 0, policy_version 1053760 (0.0008) [2023-12-28 02:49:53,442][106225] Updated weights for policy 1, policy_version 1056409 (0.0009) [2023-12-28 02:49:53,505][106225] Updated weights for policy 1, policy_version 1056419 (0.0010) [2023-12-28 02:49:53,570][106225] Updated weights for policy 1, policy_version 1056429 (0.0009) [2023-12-28 02:49:53,630][106225] Updated weights for policy 1, policy_version 1056439 (0.0008) [2023-12-28 02:49:53,841][106226] Updated weights for policy 0, policy_version 1053770 (0.0005) [2023-12-28 02:49:53,895][106226] Updated weights for policy 0, policy_version 1053780 (0.0005) [2023-12-28 02:49:53,947][106226] Updated weights for policy 0, policy_version 1053790 (0.0007) [2023-12-28 02:49:54,262][106225] Updated weights for policy 1, policy_version 1056449 (0.0010) [2023-12-28 02:49:54,320][106225] Updated weights for policy 1, policy_version 1056459 (0.0010) [2023-12-28 02:49:54,381][106225] Updated weights for policy 1, policy_version 1056469 (0.0010) [2023-12-28 02:49:54,537][106226] Updated weights for policy 0, policy_version 1053800 (0.0011) [2023-12-28 02:49:54,604][106226] Updated weights for policy 0, policy_version 1053810 (0.0010) [2023-12-28 02:49:54,652][106226] Updated weights for policy 0, policy_version 1053820 (0.0010) [2023-12-28 02:49:55,117][106225] Updated weights for policy 1, policy_version 1056479 (0.0010) [2023-12-28 02:49:55,176][106225] Updated weights for policy 1, policy_version 1056489 (0.0010) [2023-12-28 02:49:55,240][106225] Updated weights for policy 1, policy_version 1056499 (0.0010) [2023-12-28 02:49:55,378][106226] Updated weights for policy 0, policy_version 1053830 (0.0010) [2023-12-28 02:49:55,439][106226] Updated weights for policy 0, policy_version 1053840 (0.0010) [2023-12-28 02:49:55,492][106226] Updated weights for policy 0, policy_version 1053850 (0.0010) [2023-12-28 02:49:55,946][106225] Updated weights for policy 1, policy_version 1056509 (0.0010) [2023-12-28 02:49:56,010][106225] Updated weights for policy 1, policy_version 1056519 (0.0010) [2023-12-28 02:49:56,066][106225] Updated weights for policy 1, policy_version 1056529 (0.0010) [2023-12-28 02:49:56,154][106226] Updated weights for policy 0, policy_version 1053860 (0.0008) [2023-12-28 02:49:56,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 540360704. Throughput: 0: 9726.9, 1: 9920.2. Samples: 540329364. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:49:56,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-4.796')] [2023-12-28 02:49:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001056536_270516224.pth... [2023-12-28 02:49:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001055384_270221312.pth [2023-12-28 02:49:56,214][106226] Updated weights for policy 0, policy_version 1053870 (0.0006) [2023-12-28 02:49:56,277][106226] Updated weights for policy 0, policy_version 1053880 (0.0009) [2023-12-28 02:49:56,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001053888_269852672.pth... [2023-12-28 02:49:56,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001052736_269557760.pth [2023-12-28 02:49:56,781][106225] Updated weights for policy 1, policy_version 1056539 (0.0010) [2023-12-28 02:49:56,834][106225] Updated weights for policy 1, policy_version 1056549 (0.0010) [2023-12-28 02:49:56,881][106225] Updated weights for policy 1, policy_version 1056559 (0.0010) [2023-12-28 02:49:56,906][106226] Updated weights for policy 0, policy_version 1053890 (0.0009) [2023-12-28 02:49:56,967][106226] Updated weights for policy 0, policy_version 1053900 (0.0005) [2023-12-28 02:49:57,025][106226] Updated weights for policy 0, policy_version 1053910 (0.0007) [2023-12-28 02:49:57,080][106226] Updated weights for policy 0, policy_version 1053920 (0.0008) [2023-12-28 02:49:57,609][106225] Updated weights for policy 1, policy_version 1056569 (0.0010) [2023-12-28 02:49:57,637][106226] Updated weights for policy 0, policy_version 1053930 (0.0006) [2023-12-28 02:49:57,667][106225] Updated weights for policy 1, policy_version 1056579 (0.0010) [2023-12-28 02:49:57,696][106226] Updated weights for policy 0, policy_version 1053940 (0.0005) [2023-12-28 02:49:57,722][106225] Updated weights for policy 1, policy_version 1056589 (0.0010) [2023-12-28 02:49:57,753][106226] Updated weights for policy 0, policy_version 1053950 (0.0005) [2023-12-28 02:49:57,768][106225] Updated weights for policy 1, policy_version 1056599 (0.0010) [2023-12-28 02:49:58,350][106226] Updated weights for policy 0, policy_version 1053960 (0.0008) [2023-12-28 02:49:58,415][106226] Updated weights for policy 0, policy_version 1053970 (0.0008) [2023-12-28 02:49:58,482][106226] Updated weights for policy 0, policy_version 1053980 (0.0008) [2023-12-28 02:49:58,501][106225] Updated weights for policy 1, policy_version 1056609 (0.0008) [2023-12-28 02:49:58,558][106225] Updated weights for policy 1, policy_version 1056619 (0.0008) [2023-12-28 02:49:58,616][106225] Updated weights for policy 1, policy_version 1056629 (0.0007) [2023-12-28 02:49:59,253][106226] Updated weights for policy 0, policy_version 1053990 (0.0008) [2023-12-28 02:49:59,322][106226] Updated weights for policy 0, policy_version 1054000 (0.0007) [2023-12-28 02:49:59,398][106226] Updated weights for policy 0, policy_version 1054010 (0.0008) [2023-12-28 02:49:59,477][106225] Updated weights for policy 1, policy_version 1056639 (0.0010) [2023-12-28 02:49:59,531][106225] Updated weights for policy 1, policy_version 1056649 (0.0006) [2023-12-28 02:49:59,586][106225] Updated weights for policy 1, policy_version 1056659 (0.0009) [2023-12-28 02:50:00,191][106226] Updated weights for policy 0, policy_version 1054020 (0.0007) [2023-12-28 02:50:00,252][106226] Updated weights for policy 0, policy_version 1054030 (0.0008) [2023-12-28 02:50:00,296][106225] Updated weights for policy 1, policy_version 1056669 (0.0010) [2023-12-28 02:50:00,312][106226] Updated weights for policy 0, policy_version 1054040 (0.0009) [2023-12-28 02:50:00,354][106225] Updated weights for policy 1, policy_version 1056679 (0.0010) [2023-12-28 02:50:00,414][106225] Updated weights for policy 1, policy_version 1056689 (0.0010) [2023-12-28 02:50:00,998][106226] Updated weights for policy 0, policy_version 1054050 (0.0008) [2023-12-28 02:50:01,060][106225] Updated weights for policy 1, policy_version 1056699 (0.0009) [2023-12-28 02:50:01,062][106226] Updated weights for policy 0, policy_version 1054060 (0.0007) [2023-12-28 02:50:01,116][106225] Updated weights for policy 1, policy_version 1056709 (0.0007) [2023-12-28 02:50:01,130][106226] Updated weights for policy 0, policy_version 1054070 (0.0008) [2023-12-28 02:50:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 540450816. Throughput: 0: 9821.5, 1: 9897.8. Samples: 540448168. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:01,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.960')] [2023-12-28 02:50:01,178][106225] Updated weights for policy 1, policy_version 1056719 (0.0008) [2023-12-28 02:50:01,195][106226] Updated weights for policy 0, policy_version 1054080 (0.0007) [2023-12-28 02:50:01,899][106225] Updated weights for policy 1, policy_version 1056729 (0.0007) [2023-12-28 02:50:01,904][106226] Updated weights for policy 0, policy_version 1054090 (0.0009) [2023-12-28 02:50:01,961][106225] Updated weights for policy 1, policy_version 1056739 (0.0008) [2023-12-28 02:50:01,962][106226] Updated weights for policy 0, policy_version 1054100 (0.0007) [2023-12-28 02:50:02,018][106226] Updated weights for policy 0, policy_version 1054110 (0.0008) [2023-12-28 02:50:02,021][106225] Updated weights for policy 1, policy_version 1056749 (0.0006) [2023-12-28 02:50:02,080][106225] Updated weights for policy 1, policy_version 1056759 (0.0008) [2023-12-28 02:50:02,710][106226] Updated weights for policy 0, policy_version 1054120 (0.0006) [2023-12-28 02:50:02,738][106225] Updated weights for policy 1, policy_version 1056769 (0.0006) [2023-12-28 02:50:02,771][106226] Updated weights for policy 0, policy_version 1054130 (0.0005) [2023-12-28 02:50:02,796][106225] Updated weights for policy 1, policy_version 1056779 (0.0006) [2023-12-28 02:50:02,827][106226] Updated weights for policy 0, policy_version 1054140 (0.0008) [2023-12-28 02:50:02,856][106225] Updated weights for policy 1, policy_version 1056789 (0.0005) [2023-12-28 02:50:03,423][106225] Updated weights for policy 1, policy_version 1056799 (0.0008) [2023-12-28 02:50:03,475][106225] Updated weights for policy 1, policy_version 1056809 (0.0008) [2023-12-28 02:50:03,520][106225] Updated weights for policy 1, policy_version 1056819 (0.0007) [2023-12-28 02:50:03,533][106226] Updated weights for policy 0, policy_version 1054150 (0.0008) [2023-12-28 02:50:03,590][106226] Updated weights for policy 0, policy_version 1054160 (0.0008) [2023-12-28 02:50:03,642][106226] Updated weights for policy 0, policy_version 1054170 (0.0008) [2023-12-28 02:50:04,208][106225] Updated weights for policy 1, policy_version 1056829 (0.0007) [2023-12-28 02:50:04,269][106225] Updated weights for policy 1, policy_version 1056839 (0.0008) [2023-12-28 02:50:04,333][106225] Updated weights for policy 1, policy_version 1056849 (0.0008) [2023-12-28 02:50:04,424][106226] Updated weights for policy 0, policy_version 1054180 (0.0008) [2023-12-28 02:50:04,489][106226] Updated weights for policy 0, policy_version 1054190 (0.0009) [2023-12-28 02:50:04,547][106226] Updated weights for policy 0, policy_version 1054200 (0.0008) [2023-12-28 02:50:04,994][106225] Updated weights for policy 1, policy_version 1056859 (0.0008) [2023-12-28 02:50:05,051][106225] Updated weights for policy 1, policy_version 1056869 (0.0010) [2023-12-28 02:50:05,139][106225] Updated weights for policy 1, policy_version 1056879 (0.0010) [2023-12-28 02:50:05,298][106226] Updated weights for policy 0, policy_version 1054210 (0.0007) [2023-12-28 02:50:05,344][106226] Updated weights for policy 0, policy_version 1054220 (0.0005) [2023-12-28 02:50:05,396][106226] Updated weights for policy 0, policy_version 1054230 (0.0007) [2023-12-28 02:50:05,450][106226] Updated weights for policy 0, policy_version 1054240 (0.0008) [2023-12-28 02:50:05,826][106225] Updated weights for policy 1, policy_version 1056889 (0.0010) [2023-12-28 02:50:05,879][106225] Updated weights for policy 1, policy_version 1056899 (0.0010) [2023-12-28 02:50:05,928][106225] Updated weights for policy 1, policy_version 1056909 (0.0010) [2023-12-28 02:50:05,977][106225] Updated weights for policy 1, policy_version 1056919 (0.0010) [2023-12-28 02:50:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 540557312. Throughput: 0: 9788.3, 1: 9898.7. Samples: 540567752. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:06,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.961')] [2023-12-28 02:50:06,190][106226] Updated weights for policy 0, policy_version 1054250 (0.0008) [2023-12-28 02:50:06,258][106226] Updated weights for policy 0, policy_version 1054260 (0.0009) [2023-12-28 02:50:06,323][106226] Updated weights for policy 0, policy_version 1054270 (0.0008) [2023-12-28 02:50:06,725][106225] Updated weights for policy 1, policy_version 1056929 (0.0010) [2023-12-28 02:50:06,778][106225] Updated weights for policy 1, policy_version 1056939 (0.0010) [2023-12-28 02:50:06,831][106225] Updated weights for policy 1, policy_version 1056949 (0.0010) [2023-12-28 02:50:07,062][106226] Updated weights for policy 0, policy_version 1054280 (0.0008) [2023-12-28 02:50:07,124][106226] Updated weights for policy 0, policy_version 1054290 (0.0008) [2023-12-28 02:50:07,181][106226] Updated weights for policy 0, policy_version 1054300 (0.0008) [2023-12-28 02:50:07,548][106225] Updated weights for policy 1, policy_version 1056959 (0.0008) [2023-12-28 02:50:07,600][106225] Updated weights for policy 1, policy_version 1056969 (0.0006) [2023-12-28 02:50:07,660][106225] Updated weights for policy 1, policy_version 1056979 (0.0010) [2023-12-28 02:50:07,885][106226] Updated weights for policy 0, policy_version 1054310 (0.0007) [2023-12-28 02:50:07,947][106226] Updated weights for policy 0, policy_version 1054320 (0.0006) [2023-12-28 02:50:08,014][106226] Updated weights for policy 0, policy_version 1054330 (0.0008) [2023-12-28 02:50:08,332][106225] Updated weights for policy 1, policy_version 1056989 (0.0010) [2023-12-28 02:50:08,396][106225] Updated weights for policy 1, policy_version 1056999 (0.0009) [2023-12-28 02:50:08,460][106225] Updated weights for policy 1, policy_version 1057009 (0.0006) [2023-12-28 02:50:08,733][106226] Updated weights for policy 0, policy_version 1054340 (0.0009) [2023-12-28 02:50:08,789][106226] Updated weights for policy 0, policy_version 1054350 (0.0007) [2023-12-28 02:50:08,850][106226] Updated weights for policy 0, policy_version 1054360 (0.0008) [2023-12-28 02:50:09,175][106225] Updated weights for policy 1, policy_version 1057019 (0.0006) [2023-12-28 02:50:09,249][106225] Updated weights for policy 1, policy_version 1057029 (0.0008) [2023-12-28 02:50:09,318][106225] Updated weights for policy 1, policy_version 1057039 (0.0008) [2023-12-28 02:50:09,473][106226] Updated weights for policy 0, policy_version 1054370 (0.0006) [2023-12-28 02:50:09,524][106226] Updated weights for policy 0, policy_version 1054380 (0.0008) [2023-12-28 02:50:09,581][106226] Updated weights for policy 0, policy_version 1054390 (0.0008) [2023-12-28 02:50:09,640][106226] Updated weights for policy 0, policy_version 1054400 (0.0008) [2023-12-28 02:50:09,996][106225] Updated weights for policy 1, policy_version 1057049 (0.0008) [2023-12-28 02:50:10,057][106225] Updated weights for policy 1, policy_version 1057059 (0.0008) [2023-12-28 02:50:10,118][106225] Updated weights for policy 1, policy_version 1057069 (0.0007) [2023-12-28 02:50:10,164][106225] Updated weights for policy 1, policy_version 1057079 (0.0006) [2023-12-28 02:50:10,400][106226] Updated weights for policy 0, policy_version 1054410 (0.0011) [2023-12-28 02:50:10,453][106226] Updated weights for policy 0, policy_version 1054420 (0.0009) [2023-12-28 02:50:10,516][106226] Updated weights for policy 0, policy_version 1054430 (0.0007) [2023-12-28 02:50:10,777][106225] Updated weights for policy 1, policy_version 1057089 (0.0008) [2023-12-28 02:50:10,832][106225] Updated weights for policy 1, policy_version 1057099 (0.0008) [2023-12-28 02:50:10,886][106225] Updated weights for policy 1, policy_version 1057109 (0.0008) [2023-12-28 02:50:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 540655616. Throughput: 0: 9833.0, 1: 9926.8. Samples: 540626192. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:11,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.950')] [2023-12-28 02:50:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001057112_270663680.pth... [2023-12-28 02:50:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001055960_270368768.pth [2023-12-28 02:50:11,210][106226] Updated weights for policy 0, policy_version 1054440 (0.0011) [2023-12-28 02:50:11,275][106226] Updated weights for policy 0, policy_version 1054450 (0.0009) [2023-12-28 02:50:11,340][106226] Updated weights for policy 0, policy_version 1054460 (0.0008) [2023-12-28 02:50:11,369][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001054464_270000128.pth... [2023-12-28 02:50:11,373][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001053312_269705216.pth [2023-12-28 02:50:11,685][106225] Updated weights for policy 1, policy_version 1057119 (0.0008) [2023-12-28 02:50:11,753][106225] Updated weights for policy 1, policy_version 1057129 (0.0010) [2023-12-28 02:50:11,818][106225] Updated weights for policy 1, policy_version 1057139 (0.0011) [2023-12-28 02:50:12,022][106226] Updated weights for policy 0, policy_version 1054470 (0.0008) [2023-12-28 02:50:12,085][106226] Updated weights for policy 0, policy_version 1054480 (0.0008) [2023-12-28 02:50:12,158][106226] Updated weights for policy 0, policy_version 1054490 (0.0008) [2023-12-28 02:50:12,558][106225] Updated weights for policy 1, policy_version 1057149 (0.0010) [2023-12-28 02:50:12,618][106225] Updated weights for policy 1, policy_version 1057159 (0.0010) [2023-12-28 02:50:12,690][106225] Updated weights for policy 1, policy_version 1057169 (0.0011) [2023-12-28 02:50:12,828][106226] Updated weights for policy 0, policy_version 1054500 (0.0007) [2023-12-28 02:50:12,884][106226] Updated weights for policy 0, policy_version 1054510 (0.0008) [2023-12-28 02:50:12,946][106226] Updated weights for policy 0, policy_version 1054520 (0.0008) [2023-12-28 02:50:13,295][106225] Updated weights for policy 1, policy_version 1057179 (0.0010) [2023-12-28 02:50:13,346][106225] Updated weights for policy 1, policy_version 1057189 (0.0010) [2023-12-28 02:50:13,400][106225] Updated weights for policy 1, policy_version 1057199 (0.0010) [2023-12-28 02:50:13,613][106226] Updated weights for policy 0, policy_version 1054530 (0.0009) [2023-12-28 02:50:13,669][106226] Updated weights for policy 0, policy_version 1054540 (0.0011) [2023-12-28 02:50:13,728][106226] Updated weights for policy 0, policy_version 1054550 (0.0010) [2023-12-28 02:50:13,780][106226] Updated weights for policy 0, policy_version 1054560 (0.0010) [2023-12-28 02:50:14,123][106225] Updated weights for policy 1, policy_version 1057209 (0.0011) [2023-12-28 02:50:14,180][106225] Updated weights for policy 1, policy_version 1057219 (0.0010) [2023-12-28 02:50:14,239][106225] Updated weights for policy 1, policy_version 1057229 (0.0006) [2023-12-28 02:50:14,294][106225] Updated weights for policy 1, policy_version 1057239 (0.0006) [2023-12-28 02:50:14,409][106226] Updated weights for policy 0, policy_version 1054570 (0.0010) [2023-12-28 02:50:14,472][106226] Updated weights for policy 0, policy_version 1054580 (0.0007) [2023-12-28 02:50:14,528][106226] Updated weights for policy 0, policy_version 1054590 (0.0010) [2023-12-28 02:50:14,841][106225] Updated weights for policy 1, policy_version 1057249 (0.0008) [2023-12-28 02:50:14,907][106225] Updated weights for policy 1, policy_version 1057259 (0.0008) [2023-12-28 02:50:14,967][106225] Updated weights for policy 1, policy_version 1057269 (0.0007) [2023-12-28 02:50:15,305][106226] Updated weights for policy 0, policy_version 1054600 (0.0010) [2023-12-28 02:50:15,363][106226] Updated weights for policy 0, policy_version 1054610 (0.0010) [2023-12-28 02:50:15,423][106226] Updated weights for policy 0, policy_version 1054620 (0.0011) [2023-12-28 02:50:15,728][106225] Updated weights for policy 1, policy_version 1057279 (0.0009) [2023-12-28 02:50:15,792][106225] Updated weights for policy 1, policy_version 1057289 (0.0008) [2023-12-28 02:50:15,844][106225] Updated weights for policy 1, policy_version 1057299 (0.0007) [2023-12-28 02:50:16,068][106226] Updated weights for policy 0, policy_version 1054630 (0.0010) [2023-12-28 02:50:16,131][106226] Updated weights for policy 0, policy_version 1054640 (0.0010) [2023-12-28 02:50:16,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 540753920. Throughput: 0: 9756.5, 1: 9960.2. Samples: 540745828. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:16,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-5.175')] [2023-12-28 02:50:16,198][106226] Updated weights for policy 0, policy_version 1054650 (0.0011) [2023-12-28 02:50:16,447][106225] Updated weights for policy 1, policy_version 1057309 (0.0006) [2023-12-28 02:50:16,509][106225] Updated weights for policy 1, policy_version 1057319 (0.0006) [2023-12-28 02:50:16,573][106225] Updated weights for policy 1, policy_version 1057329 (0.0006) [2023-12-28 02:50:16,870][106226] Updated weights for policy 0, policy_version 1054660 (0.0010) [2023-12-28 02:50:16,925][106226] Updated weights for policy 0, policy_version 1054670 (0.0009) [2023-12-28 02:50:16,982][106226] Updated weights for policy 0, policy_version 1054680 (0.0009) [2023-12-28 02:50:17,125][106225] Updated weights for policy 1, policy_version 1057339 (0.0006) [2023-12-28 02:50:17,191][106225] Updated weights for policy 1, policy_version 1057349 (0.0008) [2023-12-28 02:50:17,258][106225] Updated weights for policy 1, policy_version 1057359 (0.0010) [2023-12-28 02:50:17,606][106226] Updated weights for policy 0, policy_version 1054690 (0.0008) [2023-12-28 02:50:17,654][106226] Updated weights for policy 0, policy_version 1054700 (0.0005) [2023-12-28 02:50:17,708][106226] Updated weights for policy 0, policy_version 1054710 (0.0006) [2023-12-28 02:50:17,763][106226] Updated weights for policy 0, policy_version 1054720 (0.0006) [2023-12-28 02:50:18,072][106225] Updated weights for policy 1, policy_version 1057369 (0.0009) [2023-12-28 02:50:18,142][106225] Updated weights for policy 1, policy_version 1057379 (0.0009) [2023-12-28 02:50:18,208][106225] Updated weights for policy 1, policy_version 1057389 (0.0009) [2023-12-28 02:50:18,274][106225] Updated weights for policy 1, policy_version 1057399 (0.0009) [2023-12-28 02:50:18,293][106226] Updated weights for policy 0, policy_version 1054730 (0.0010) [2023-12-28 02:50:18,356][106226] Updated weights for policy 0, policy_version 1054740 (0.0008) [2023-12-28 02:50:18,422][106226] Updated weights for policy 0, policy_version 1054750 (0.0011) [2023-12-28 02:50:19,080][106225] Updated weights for policy 1, policy_version 1057409 (0.0006) [2023-12-28 02:50:19,085][106226] Updated weights for policy 0, policy_version 1054760 (0.0011) [2023-12-28 02:50:19,133][106225] Updated weights for policy 1, policy_version 1057419 (0.0005) [2023-12-28 02:50:19,142][106226] Updated weights for policy 0, policy_version 1054770 (0.0010) [2023-12-28 02:50:19,189][106225] Updated weights for policy 1, policy_version 1057429 (0.0006) [2023-12-28 02:50:19,199][106226] Updated weights for policy 0, policy_version 1054780 (0.0009) [2023-12-28 02:50:19,900][106226] Updated weights for policy 0, policy_version 1054790 (0.0009) [2023-12-28 02:50:19,968][106226] Updated weights for policy 0, policy_version 1054800 (0.0009) [2023-12-28 02:50:19,974][106225] Updated weights for policy 1, policy_version 1057439 (0.0010) [2023-12-28 02:50:20,024][106226] Updated weights for policy 0, policy_version 1054810 (0.0006) [2023-12-28 02:50:20,036][106225] Updated weights for policy 1, policy_version 1057449 (0.0010) [2023-12-28 02:50:20,092][106225] Updated weights for policy 1, policy_version 1057459 (0.0007) [2023-12-28 02:50:20,780][106226] Updated weights for policy 0, policy_version 1054820 (0.0006) [2023-12-28 02:50:20,840][106225] Updated weights for policy 1, policy_version 1057469 (0.0006) [2023-12-28 02:50:20,842][106226] Updated weights for policy 0, policy_version 1054830 (0.0006) [2023-12-28 02:50:20,903][106226] Updated weights for policy 0, policy_version 1054840 (0.0008) [2023-12-28 02:50:20,904][106225] Updated weights for policy 1, policy_version 1057479 (0.0007) [2023-12-28 02:50:20,971][106225] Updated weights for policy 1, policy_version 1057489 (0.0009) [2023-12-28 02:50:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 540860416. Throughput: 0: 9761.9, 1: 9923.6. Samples: 540865168. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:21,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.721')] [2023-12-28 02:50:21,677][106226] Updated weights for policy 0, policy_version 1054850 (0.0007) [2023-12-28 02:50:21,682][106225] Updated weights for policy 1, policy_version 1057499 (0.0008) [2023-12-28 02:50:21,747][106226] Updated weights for policy 0, policy_version 1054860 (0.0007) [2023-12-28 02:50:21,750][106225] Updated weights for policy 1, policy_version 1057509 (0.0008) [2023-12-28 02:50:21,811][106225] Updated weights for policy 1, policy_version 1057519 (0.0006) [2023-12-28 02:50:21,816][106226] Updated weights for policy 0, policy_version 1054870 (0.0006) [2023-12-28 02:50:21,887][106226] Updated weights for policy 0, policy_version 1054880 (0.0006) [2023-12-28 02:50:22,524][106226] Updated weights for policy 0, policy_version 1054890 (0.0008) [2023-12-28 02:50:22,579][106225] Updated weights for policy 1, policy_version 1057529 (0.0009) [2023-12-28 02:50:22,579][106226] Updated weights for policy 0, policy_version 1054900 (0.0008) [2023-12-28 02:50:22,632][106226] Updated weights for policy 0, policy_version 1054910 (0.0008) [2023-12-28 02:50:22,632][106225] Updated weights for policy 1, policy_version 1057539 (0.0009) [2023-12-28 02:50:22,695][106225] Updated weights for policy 1, policy_version 1057549 (0.0008) [2023-12-28 02:50:22,765][106225] Updated weights for policy 1, policy_version 1057559 (0.0008) [2023-12-28 02:50:23,327][106226] Updated weights for policy 0, policy_version 1054920 (0.0009) [2023-12-28 02:50:23,391][106226] Updated weights for policy 0, policy_version 1054930 (0.0008) [2023-12-28 02:50:23,451][106226] Updated weights for policy 0, policy_version 1054940 (0.0007) [2023-12-28 02:50:23,472][106225] Updated weights for policy 1, policy_version 1057569 (0.0008) [2023-12-28 02:50:23,537][106225] Updated weights for policy 1, policy_version 1057579 (0.0008) [2023-12-28 02:50:23,600][106225] Updated weights for policy 1, policy_version 1057589 (0.0009) [2023-12-28 02:50:24,244][106226] Updated weights for policy 0, policy_version 1054950 (0.0009) [2023-12-28 02:50:24,269][106225] Updated weights for policy 1, policy_version 1057599 (0.0006) [2023-12-28 02:50:24,298][106226] Updated weights for policy 0, policy_version 1054960 (0.0007) [2023-12-28 02:50:24,331][106225] Updated weights for policy 1, policy_version 1057609 (0.0007) [2023-12-28 02:50:24,352][106226] Updated weights for policy 0, policy_version 1054970 (0.0005) [2023-12-28 02:50:24,393][106225] Updated weights for policy 1, policy_version 1057619 (0.0008) [2023-12-28 02:50:25,063][106225] Updated weights for policy 1, policy_version 1057629 (0.0008) [2023-12-28 02:50:25,065][106226] Updated weights for policy 0, policy_version 1054980 (0.0006) [2023-12-28 02:50:25,123][106225] Updated weights for policy 1, policy_version 1057639 (0.0008) [2023-12-28 02:50:25,125][106226] Updated weights for policy 0, policy_version 1054990 (0.0006) [2023-12-28 02:50:25,182][106225] Updated weights for policy 1, policy_version 1057649 (0.0007) [2023-12-28 02:50:25,185][106226] Updated weights for policy 0, policy_version 1055000 (0.0005) [2023-12-28 02:50:25,701][106226] Updated weights for policy 0, policy_version 1055010 (0.0006) [2023-12-28 02:50:25,761][106226] Updated weights for policy 0, policy_version 1055020 (0.0005) [2023-12-28 02:50:25,832][106226] Updated weights for policy 0, policy_version 1055030 (0.0005) [2023-12-28 02:50:25,884][106226] Updated weights for policy 0, policy_version 1055040 (0.0008) [2023-12-28 02:50:25,954][106225] Updated weights for policy 1, policy_version 1057659 (0.0007) [2023-12-28 02:50:26,016][106225] Updated weights for policy 1, policy_version 1057669 (0.0007) [2023-12-28 02:50:26,071][106225] Updated weights for policy 1, policy_version 1057679 (0.0010) [2023-12-28 02:50:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 540958720. Throughput: 0: 9775.0, 1: 9843.6. Samples: 540921612. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:26,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.686')] [2023-12-28 02:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001057688_270811136.pth... [2023-12-28 02:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001055040_270147584.pth... [2023-12-28 02:50:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001056536_270516224.pth [2023-12-28 02:50:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001053888_269852672.pth [2023-12-28 02:50:26,422][106226] Updated weights for policy 0, policy_version 1055050 (0.0008) [2023-12-28 02:50:26,484][106226] Updated weights for policy 0, policy_version 1055060 (0.0009) [2023-12-28 02:50:26,551][106226] Updated weights for policy 0, policy_version 1055070 (0.0009) [2023-12-28 02:50:26,650][106225] Updated weights for policy 1, policy_version 1057689 (0.0010) [2023-12-28 02:50:26,702][106225] Updated weights for policy 1, policy_version 1057699 (0.0008) [2023-12-28 02:50:26,756][106225] Updated weights for policy 1, policy_version 1057709 (0.0007) [2023-12-28 02:50:26,810][106225] Updated weights for policy 1, policy_version 1057719 (0.0007) [2023-12-28 02:50:27,227][106226] Updated weights for policy 0, policy_version 1055080 (0.0006) [2023-12-28 02:50:27,278][106226] Updated weights for policy 0, policy_version 1055090 (0.0006) [2023-12-28 02:50:27,330][106226] Updated weights for policy 0, policy_version 1055100 (0.0006) [2023-12-28 02:50:27,478][106225] Updated weights for policy 1, policy_version 1057729 (0.0008) [2023-12-28 02:50:27,540][106225] Updated weights for policy 1, policy_version 1057739 (0.0008) [2023-12-28 02:50:27,601][106225] Updated weights for policy 1, policy_version 1057749 (0.0009) [2023-12-28 02:50:27,931][106226] Updated weights for policy 0, policy_version 1055110 (0.0007) [2023-12-28 02:50:27,992][106226] Updated weights for policy 0, policy_version 1055120 (0.0008) [2023-12-28 02:50:28,055][106226] Updated weights for policy 0, policy_version 1055130 (0.0009) [2023-12-28 02:50:28,282][106225] Updated weights for policy 1, policy_version 1057759 (0.0008) [2023-12-28 02:50:28,341][106225] Updated weights for policy 1, policy_version 1057769 (0.0008) [2023-12-28 02:50:28,393][106225] Updated weights for policy 1, policy_version 1057779 (0.0008) [2023-12-28 02:50:28,697][106226] Updated weights for policy 0, policy_version 1055140 (0.0007) [2023-12-28 02:50:28,752][106226] Updated weights for policy 0, policy_version 1055150 (0.0011) [2023-12-28 02:50:28,806][106226] Updated weights for policy 0, policy_version 1055160 (0.0010) [2023-12-28 02:50:29,111][106225] Updated weights for policy 1, policy_version 1057789 (0.0008) [2023-12-28 02:50:29,175][106225] Updated weights for policy 1, policy_version 1057799 (0.0010) [2023-12-28 02:50:29,237][106225] Updated weights for policy 1, policy_version 1057809 (0.0011) [2023-12-28 02:50:29,499][106226] Updated weights for policy 0, policy_version 1055170 (0.0011) [2023-12-28 02:50:29,557][106226] Updated weights for policy 0, policy_version 1055180 (0.0005) [2023-12-28 02:50:29,625][106226] Updated weights for policy 0, policy_version 1055190 (0.0006) [2023-12-28 02:50:29,694][106226] Updated weights for policy 0, policy_version 1055200 (0.0006) [2023-12-28 02:50:29,990][106225] Updated weights for policy 1, policy_version 1057819 (0.0009) [2023-12-28 02:50:30,051][106225] Updated weights for policy 1, policy_version 1057829 (0.0007) [2023-12-28 02:50:30,107][106225] Updated weights for policy 1, policy_version 1057839 (0.0010) [2023-12-28 02:50:30,299][106226] Updated weights for policy 0, policy_version 1055210 (0.0007) [2023-12-28 02:50:30,360][106226] Updated weights for policy 0, policy_version 1055220 (0.0008) [2023-12-28 02:50:30,423][106226] Updated weights for policy 0, policy_version 1055230 (0.0009) [2023-12-28 02:50:30,755][106225] Updated weights for policy 1, policy_version 1057849 (0.0009) [2023-12-28 02:50:30,823][106225] Updated weights for policy 1, policy_version 1057859 (0.0005) [2023-12-28 02:50:30,888][106225] Updated weights for policy 1, policy_version 1057869 (0.0005) [2023-12-28 02:50:30,950][106225] Updated weights for policy 1, policy_version 1057879 (0.0005) [2023-12-28 02:50:31,021][106226] Updated weights for policy 0, policy_version 1055240 (0.0010) [2023-12-28 02:50:31,084][106226] Updated weights for policy 0, policy_version 1055250 (0.0010) [2023-12-28 02:50:31,149][106226] Updated weights for policy 0, policy_version 1055260 (0.0010) [2023-12-28 02:50:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 541057024. Throughput: 0: 9956.2, 1: 9867.4. Samples: 541047372. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:31,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.017')] [2023-12-28 02:50:31,599][106225] Updated weights for policy 1, policy_version 1057889 (0.0007) [2023-12-28 02:50:31,669][106225] Updated weights for policy 1, policy_version 1057899 (0.0008) [2023-12-28 02:50:31,731][106225] Updated weights for policy 1, policy_version 1057909 (0.0008) [2023-12-28 02:50:31,942][106226] Updated weights for policy 0, policy_version 1055270 (0.0009) [2023-12-28 02:50:32,011][106226] Updated weights for policy 0, policy_version 1055280 (0.0011) [2023-12-28 02:50:32,078][106226] Updated weights for policy 0, policy_version 1055290 (0.0005) [2023-12-28 02:50:32,365][106225] Updated weights for policy 1, policy_version 1057919 (0.0009) [2023-12-28 02:50:32,429][106225] Updated weights for policy 1, policy_version 1057929 (0.0008) [2023-12-28 02:50:32,495][106225] Updated weights for policy 1, policy_version 1057939 (0.0009) [2023-12-28 02:50:32,696][106226] Updated weights for policy 0, policy_version 1055300 (0.0006) [2023-12-28 02:50:32,751][106226] Updated weights for policy 0, policy_version 1055310 (0.0005) [2023-12-28 02:50:32,805][106226] Updated weights for policy 0, policy_version 1055320 (0.0005) [2023-12-28 02:50:33,198][106225] Updated weights for policy 1, policy_version 1057949 (0.0006) [2023-12-28 02:50:33,250][106225] Updated weights for policy 1, policy_version 1057959 (0.0005) [2023-12-28 02:50:33,299][106225] Updated weights for policy 1, policy_version 1057969 (0.0005) [2023-12-28 02:50:33,396][106226] Updated weights for policy 0, policy_version 1055330 (0.0007) [2023-12-28 02:50:33,455][106226] Updated weights for policy 0, policy_version 1055340 (0.0009) [2023-12-28 02:50:33,517][106226] Updated weights for policy 0, policy_version 1055350 (0.0009) [2023-12-28 02:50:33,583][106226] Updated weights for policy 0, policy_version 1055360 (0.0007) [2023-12-28 02:50:33,857][106225] Updated weights for policy 1, policy_version 1057979 (0.0006) [2023-12-28 02:50:33,910][106225] Updated weights for policy 1, policy_version 1057989 (0.0009) [2023-12-28 02:50:33,957][106225] Updated weights for policy 1, policy_version 1057999 (0.0008) [2023-12-28 02:50:34,238][106226] Updated weights for policy 0, policy_version 1055370 (0.0008) [2023-12-28 02:50:34,303][106226] Updated weights for policy 0, policy_version 1055380 (0.0008) [2023-12-28 02:50:34,364][106226] Updated weights for policy 0, policy_version 1055390 (0.0009) [2023-12-28 02:50:34,774][106225] Updated weights for policy 1, policy_version 1058009 (0.0009) [2023-12-28 02:50:34,833][106225] Updated weights for policy 1, policy_version 1058019 (0.0010) [2023-12-28 02:50:34,896][106225] Updated weights for policy 1, policy_version 1058029 (0.0010) [2023-12-28 02:50:34,954][106225] Updated weights for policy 1, policy_version 1058039 (0.0008) [2023-12-28 02:50:35,075][106226] Updated weights for policy 0, policy_version 1055400 (0.0008) [2023-12-28 02:50:35,127][106226] Updated weights for policy 0, policy_version 1055410 (0.0008) [2023-12-28 02:50:35,187][106226] Updated weights for policy 0, policy_version 1055420 (0.0008) [2023-12-28 02:50:35,618][106225] Updated weights for policy 1, policy_version 1058049 (0.0010) [2023-12-28 02:50:35,667][106225] Updated weights for policy 1, policy_version 1058059 (0.0010) [2023-12-28 02:50:35,718][106225] Updated weights for policy 1, policy_version 1058069 (0.0010) [2023-12-28 02:50:35,884][106226] Updated weights for policy 0, policy_version 1055430 (0.0008) [2023-12-28 02:50:35,932][106226] Updated weights for policy 0, policy_version 1055440 (0.0007) [2023-12-28 02:50:35,985][106226] Updated weights for policy 0, policy_version 1055450 (0.0005) [2023-12-28 02:50:36,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.7, 300 sec: 19771.9). Total num frames: 541163520. Throughput: 0: 10071.0, 1: 9883.1. Samples: 541170504. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:36,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-5.195')] [2023-12-28 02:50:36,469][106225] Updated weights for policy 1, policy_version 1058079 (0.0009) [2023-12-28 02:50:36,527][106225] Updated weights for policy 1, policy_version 1058089 (0.0008) [2023-12-28 02:50:36,590][106225] Updated weights for policy 1, policy_version 1058099 (0.0010) [2023-12-28 02:50:36,677][106226] Updated weights for policy 0, policy_version 1055460 (0.0006) [2023-12-28 02:50:36,742][106226] Updated weights for policy 0, policy_version 1055470 (0.0009) [2023-12-28 02:50:36,807][106226] Updated weights for policy 0, policy_version 1055480 (0.0010) [2023-12-28 02:50:37,272][106225] Updated weights for policy 1, policy_version 1058109 (0.0007) [2023-12-28 02:50:37,329][106225] Updated weights for policy 1, policy_version 1058119 (0.0005) [2023-12-28 02:50:37,385][106225] Updated weights for policy 1, policy_version 1058129 (0.0005) [2023-12-28 02:50:37,565][106226] Updated weights for policy 0, policy_version 1055490 (0.0009) [2023-12-28 02:50:37,613][106226] Updated weights for policy 0, policy_version 1055500 (0.0008) [2023-12-28 02:50:37,663][106226] Updated weights for policy 0, policy_version 1055510 (0.0009) [2023-12-28 02:50:37,718][106226] Updated weights for policy 0, policy_version 1055520 (0.0009) [2023-12-28 02:50:37,907][106225] Updated weights for policy 1, policy_version 1058139 (0.0006) [2023-12-28 02:50:37,963][106225] Updated weights for policy 1, policy_version 1058149 (0.0008) [2023-12-28 02:50:38,014][106225] Updated weights for policy 1, policy_version 1058159 (0.0007) [2023-12-28 02:50:38,495][106226] Updated weights for policy 0, policy_version 1055530 (0.0006) [2023-12-28 02:50:38,554][106226] Updated weights for policy 0, policy_version 1055540 (0.0009) [2023-12-28 02:50:38,609][106226] Updated weights for policy 0, policy_version 1055550 (0.0005) [2023-12-28 02:50:38,750][106225] Updated weights for policy 1, policy_version 1058169 (0.0009) [2023-12-28 02:50:38,815][106225] Updated weights for policy 1, policy_version 1058179 (0.0008) [2023-12-28 02:50:38,865][106225] Updated weights for policy 1, policy_version 1058189 (0.0008) [2023-12-28 02:50:38,914][106225] Updated weights for policy 1, policy_version 1058199 (0.0008) [2023-12-28 02:50:39,320][106226] Updated weights for policy 0, policy_version 1055560 (0.0006) [2023-12-28 02:50:39,388][106226] Updated weights for policy 0, policy_version 1055570 (0.0007) [2023-12-28 02:50:39,450][106226] Updated weights for policy 0, policy_version 1055580 (0.0009) [2023-12-28 02:50:39,702][106225] Updated weights for policy 1, policy_version 1058209 (0.0008) [2023-12-28 02:50:39,769][106225] Updated weights for policy 1, policy_version 1058219 (0.0007) [2023-12-28 02:50:39,838][106225] Updated weights for policy 1, policy_version 1058229 (0.0009) [2023-12-28 02:50:40,179][106226] Updated weights for policy 0, policy_version 1055590 (0.0007) [2023-12-28 02:50:40,240][106226] Updated weights for policy 0, policy_version 1055600 (0.0008) [2023-12-28 02:50:40,291][106226] Updated weights for policy 0, policy_version 1055610 (0.0006) [2023-12-28 02:50:40,578][106225] Updated weights for policy 1, policy_version 1058239 (0.0009) [2023-12-28 02:50:40,633][106225] Updated weights for policy 1, policy_version 1058249 (0.0009) [2023-12-28 02:50:40,690][106225] Updated weights for policy 1, policy_version 1058259 (0.0008) [2023-12-28 02:50:40,923][106226] Updated weights for policy 0, policy_version 1055620 (0.0008) [2023-12-28 02:50:40,968][106226] Updated weights for policy 0, policy_version 1055630 (0.0009) [2023-12-28 02:50:41,020][106226] Updated weights for policy 0, policy_version 1055640 (0.0008) [2023-12-28 02:50:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 541261824. Throughput: 0: 10080.8, 1: 9940.6. Samples: 541230328. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:41,176][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.006')] [2023-12-28 02:50:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001055648_270303232.pth... [2023-12-28 02:50:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001058264_270958592.pth... [2023-12-28 02:50:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001054464_270000128.pth [2023-12-28 02:50:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001057112_270663680.pth [2023-12-28 02:50:41,481][106225] Updated weights for policy 1, policy_version 1058269 (0.0009) [2023-12-28 02:50:41,533][106225] Updated weights for policy 1, policy_version 1058279 (0.0011) [2023-12-28 02:50:41,587][106225] Updated weights for policy 1, policy_version 1058289 (0.0010) [2023-12-28 02:50:41,817][106226] Updated weights for policy 0, policy_version 1055650 (0.0009) [2023-12-28 02:50:41,875][106226] Updated weights for policy 0, policy_version 1055660 (0.0008) [2023-12-28 02:50:41,933][106226] Updated weights for policy 0, policy_version 1055670 (0.0009) [2023-12-28 02:50:41,997][106226] Updated weights for policy 0, policy_version 1055680 (0.0009) [2023-12-28 02:50:42,272][106225] Updated weights for policy 1, policy_version 1058299 (0.0009) [2023-12-28 02:50:42,340][106225] Updated weights for policy 1, policy_version 1058309 (0.0010) [2023-12-28 02:50:42,414][106225] Updated weights for policy 1, policy_version 1058319 (0.0012) [2023-12-28 02:50:42,688][106226] Updated weights for policy 0, policy_version 1055690 (0.0008) [2023-12-28 02:50:42,757][106226] Updated weights for policy 0, policy_version 1055700 (0.0007) [2023-12-28 02:50:42,813][106226] Updated weights for policy 0, policy_version 1055710 (0.0006) [2023-12-28 02:50:43,072][106225] Updated weights for policy 1, policy_version 1058329 (0.0010) [2023-12-28 02:50:43,144][106225] Updated weights for policy 1, policy_version 1058339 (0.0005) [2023-12-28 02:50:43,217][106225] Updated weights for policy 1, policy_version 1058349 (0.0009) [2023-12-28 02:50:43,277][106225] Updated weights for policy 1, policy_version 1058359 (0.0010) [2023-12-28 02:50:43,334][106226] Updated weights for policy 0, policy_version 1055720 (0.0009) [2023-12-28 02:50:43,392][106226] Updated weights for policy 0, policy_version 1055730 (0.0008) [2023-12-28 02:50:43,453][106226] Updated weights for policy 0, policy_version 1055740 (0.0010) [2023-12-28 02:50:43,898][106225] Updated weights for policy 1, policy_version 1058369 (0.0008) [2023-12-28 02:50:43,962][106225] Updated weights for policy 1, policy_version 1058379 (0.0006) [2023-12-28 02:50:44,029][106225] Updated weights for policy 1, policy_version 1058389 (0.0008) [2023-12-28 02:50:44,165][106226] Updated weights for policy 0, policy_version 1055750 (0.0010) [2023-12-28 02:50:44,234][106226] Updated weights for policy 0, policy_version 1055760 (0.0006) [2023-12-28 02:50:44,301][106226] Updated weights for policy 0, policy_version 1055770 (0.0010) [2023-12-28 02:50:44,562][106225] Updated weights for policy 1, policy_version 1058399 (0.0006) [2023-12-28 02:50:44,622][106225] Updated weights for policy 1, policy_version 1058409 (0.0005) [2023-12-28 02:50:44,681][106225] Updated weights for policy 1, policy_version 1058419 (0.0005) [2023-12-28 02:50:45,003][106226] Updated weights for policy 0, policy_version 1055780 (0.0010) [2023-12-28 02:50:45,066][106226] Updated weights for policy 0, policy_version 1055790 (0.0008) [2023-12-28 02:50:45,130][106226] Updated weights for policy 0, policy_version 1055800 (0.0008) [2023-12-28 02:50:45,342][106225] Updated weights for policy 1, policy_version 1058429 (0.0007) [2023-12-28 02:50:45,403][106225] Updated weights for policy 1, policy_version 1058439 (0.0008) [2023-12-28 02:50:45,465][106225] Updated weights for policy 1, policy_version 1058449 (0.0009) [2023-12-28 02:50:45,817][106226] Updated weights for policy 0, policy_version 1055810 (0.0008) [2023-12-28 02:50:45,873][106226] Updated weights for policy 0, policy_version 1055820 (0.0008) [2023-12-28 02:50:45,925][106226] Updated weights for policy 0, policy_version 1055830 (0.0008) [2023-12-28 02:50:45,985][106226] Updated weights for policy 0, policy_version 1055840 (0.0008) [2023-12-28 02:50:46,085][106225] Updated weights for policy 1, policy_version 1058459 (0.0008) [2023-12-28 02:50:46,142][106225] Updated weights for policy 1, policy_version 1058469 (0.0006) [2023-12-28 02:50:46,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 541360128. Throughput: 0: 10038.2, 1: 10002.3. Samples: 541349992. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:46,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-4.761')] [2023-12-28 02:50:46,203][106225] Updated weights for policy 1, policy_version 1058479 (0.0006) [2023-12-28 02:50:46,754][106226] Updated weights for policy 0, policy_version 1055850 (0.0007) [2023-12-28 02:50:46,783][106225] Updated weights for policy 1, policy_version 1058489 (0.0006) [2023-12-28 02:50:46,812][106226] Updated weights for policy 0, policy_version 1055860 (0.0007) [2023-12-28 02:50:46,834][106225] Updated weights for policy 1, policy_version 1058499 (0.0006) [2023-12-28 02:50:46,867][106226] Updated weights for policy 0, policy_version 1055870 (0.0007) [2023-12-28 02:50:46,881][106225] Updated weights for policy 1, policy_version 1058509 (0.0006) [2023-12-28 02:50:46,928][106225] Updated weights for policy 1, policy_version 1058519 (0.0008) [2023-12-28 02:50:47,539][106225] Updated weights for policy 1, policy_version 1058529 (0.0006) [2023-12-28 02:50:47,541][106226] Updated weights for policy 0, policy_version 1055880 (0.0007) [2023-12-28 02:50:47,589][106225] Updated weights for policy 1, policy_version 1058539 (0.0006) [2023-12-28 02:50:47,600][106226] Updated weights for policy 0, policy_version 1055890 (0.0007) [2023-12-28 02:50:47,652][106225] Updated weights for policy 1, policy_version 1058549 (0.0008) [2023-12-28 02:50:47,654][106226] Updated weights for policy 0, policy_version 1055900 (0.0007) [2023-12-28 02:50:48,250][106225] Updated weights for policy 1, policy_version 1058559 (0.0005) [2023-12-28 02:50:48,300][106225] Updated weights for policy 1, policy_version 1058569 (0.0005) [2023-12-28 02:50:48,387][106225] Updated weights for policy 1, policy_version 1058579 (0.0009) [2023-12-28 02:50:48,478][106226] Updated weights for policy 0, policy_version 1055910 (0.0008) [2023-12-28 02:50:48,545][106226] Updated weights for policy 0, policy_version 1055920 (0.0006) [2023-12-28 02:50:48,607][106226] Updated weights for policy 0, policy_version 1055930 (0.0007) [2023-12-28 02:50:49,095][106225] Updated weights for policy 1, policy_version 1058589 (0.0009) [2023-12-28 02:50:49,154][106225] Updated weights for policy 1, policy_version 1058599 (0.0008) [2023-12-28 02:50:49,219][106225] Updated weights for policy 1, policy_version 1058609 (0.0009) [2023-12-28 02:50:49,258][106226] Updated weights for policy 0, policy_version 1055940 (0.0007) [2023-12-28 02:50:49,324][106226] Updated weights for policy 0, policy_version 1055950 (0.0009) [2023-12-28 02:50:49,412][106226] Updated weights for policy 0, policy_version 1055960 (0.0006) [2023-12-28 02:50:49,942][106225] Updated weights for policy 1, policy_version 1058619 (0.0009) [2023-12-28 02:50:49,999][106225] Updated weights for policy 1, policy_version 1058629 (0.0009) [2023-12-28 02:50:50,067][106225] Updated weights for policy 1, policy_version 1058639 (0.0012) [2023-12-28 02:50:50,085][106226] Updated weights for policy 0, policy_version 1055970 (0.0006) [2023-12-28 02:50:50,145][106226] Updated weights for policy 0, policy_version 1055980 (0.0006) [2023-12-28 02:50:50,216][106226] Updated weights for policy 0, policy_version 1055990 (0.0009) [2023-12-28 02:50:50,286][106226] Updated weights for policy 0, policy_version 1056000 (0.0009) [2023-12-28 02:50:50,780][106225] Updated weights for policy 1, policy_version 1058649 (0.0010) [2023-12-28 02:50:50,843][106225] Updated weights for policy 1, policy_version 1058659 (0.0009) [2023-12-28 02:50:50,905][106225] Updated weights for policy 1, policy_version 1058669 (0.0008) [2023-12-28 02:50:50,967][106226] Updated weights for policy 0, policy_version 1056010 (0.0006) [2023-12-28 02:50:50,970][106225] Updated weights for policy 1, policy_version 1058679 (0.0008) [2023-12-28 02:50:51,034][106226] Updated weights for policy 0, policy_version 1056020 (0.0006) [2023-12-28 02:50:51,099][106226] Updated weights for policy 0, policy_version 1056030 (0.0007) [2023-12-28 02:50:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 541466624. Throughput: 0: 10044.7, 1: 10024.4. Samples: 541470860. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:51,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-5.032')] [2023-12-28 02:50:51,742][106225] Updated weights for policy 1, policy_version 1058689 (0.0009) [2023-12-28 02:50:51,795][106225] Updated weights for policy 1, policy_version 1058699 (0.0008) [2023-12-28 02:50:51,830][106226] Updated weights for policy 0, policy_version 1056040 (0.0007) [2023-12-28 02:50:51,859][106225] Updated weights for policy 1, policy_version 1058709 (0.0007) [2023-12-28 02:50:51,887][106226] Updated weights for policy 0, policy_version 1056050 (0.0006) [2023-12-28 02:50:51,946][106226] Updated weights for policy 0, policy_version 1056060 (0.0008) [2023-12-28 02:50:52,555][106225] Updated weights for policy 1, policy_version 1058719 (0.0008) [2023-12-28 02:50:52,608][106225] Updated weights for policy 1, policy_version 1058729 (0.0008) [2023-12-28 02:50:52,660][106225] Updated weights for policy 1, policy_version 1058739 (0.0007) [2023-12-28 02:50:52,720][106226] Updated weights for policy 0, policy_version 1056070 (0.0008) [2023-12-28 02:50:52,780][106226] Updated weights for policy 0, policy_version 1056080 (0.0008) [2023-12-28 02:50:52,841][106226] Updated weights for policy 0, policy_version 1056090 (0.0009) [2023-12-28 02:50:53,386][106225] Updated weights for policy 1, policy_version 1058749 (0.0007) [2023-12-28 02:50:53,442][106225] Updated weights for policy 1, policy_version 1058759 (0.0008) [2023-12-28 02:50:53,491][106225] Updated weights for policy 1, policy_version 1058769 (0.0008) [2023-12-28 02:50:53,536][106226] Updated weights for policy 0, policy_version 1056100 (0.0009) [2023-12-28 02:50:53,597][106226] Updated weights for policy 0, policy_version 1056110 (0.0009) [2023-12-28 02:50:53,662][106226] Updated weights for policy 0, policy_version 1056120 (0.0008) [2023-12-28 02:50:54,268][106225] Updated weights for policy 1, policy_version 1058779 (0.0009) [2023-12-28 02:50:54,329][106225] Updated weights for policy 1, policy_version 1058789 (0.0009) [2023-12-28 02:50:54,356][106226] Updated weights for policy 0, policy_version 1056130 (0.0008) [2023-12-28 02:50:54,393][106225] Updated weights for policy 1, policy_version 1058799 (0.0009) [2023-12-28 02:50:54,418][106226] Updated weights for policy 0, policy_version 1056140 (0.0006) [2023-12-28 02:50:54,483][106226] Updated weights for policy 0, policy_version 1056150 (0.0007) [2023-12-28 02:50:54,550][106226] Updated weights for policy 0, policy_version 1056160 (0.0009) [2023-12-28 02:50:55,125][106225] Updated weights for policy 1, policy_version 1058809 (0.0008) [2023-12-28 02:50:55,162][106226] Updated weights for policy 0, policy_version 1056170 (0.0011) [2023-12-28 02:50:55,182][106225] Updated weights for policy 1, policy_version 1058819 (0.0007) [2023-12-28 02:50:55,214][106226] Updated weights for policy 0, policy_version 1056180 (0.0010) [2023-12-28 02:50:55,239][106225] Updated weights for policy 1, policy_version 1058829 (0.0006) [2023-12-28 02:50:55,275][106226] Updated weights for policy 0, policy_version 1056190 (0.0011) [2023-12-28 02:50:55,297][106225] Updated weights for policy 1, policy_version 1058839 (0.0006) [2023-12-28 02:50:55,873][106226] Updated weights for policy 0, policy_version 1056200 (0.0011) [2023-12-28 02:50:55,937][106226] Updated weights for policy 0, policy_version 1056210 (0.0011) [2023-12-28 02:50:55,999][106226] Updated weights for policy 0, policy_version 1056220 (0.0011) [2023-12-28 02:50:56,068][106225] Updated weights for policy 1, policy_version 1058849 (0.0007) [2023-12-28 02:50:56,126][106225] Updated weights for policy 1, policy_version 1058859 (0.0008) [2023-12-28 02:50:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 541556736. Throughput: 0: 10026.1, 1: 10002.0. Samples: 541527452. Policy #0 lag: (min: 21.0, avg: 21.2, max: 32.0) [2023-12-28 02:50:56,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-4.935')] [2023-12-28 02:50:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001056224_270450688.pth... [2023-12-28 02:50:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001055040_270147584.pth [2023-12-28 02:50:56,187][106225] Updated weights for policy 1, policy_version 1058869 (0.0005) [2023-12-28 02:50:56,207][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001058872_271114240.pth... [2023-12-28 02:50:56,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001057688_270811136.pth [2023-12-28 02:50:56,631][106226] Updated weights for policy 0, policy_version 1056230 (0.0008) [2023-12-28 02:50:56,691][106226] Updated weights for policy 0, policy_version 1056240 (0.0008) [2023-12-28 02:50:56,743][106226] Updated weights for policy 0, policy_version 1056250 (0.0009) [2023-12-28 02:50:56,915][106225] Updated weights for policy 1, policy_version 1058879 (0.0007) [2023-12-28 02:50:56,972][106225] Updated weights for policy 1, policy_version 1058889 (0.0008) [2023-12-28 02:50:57,032][106225] Updated weights for policy 1, policy_version 1058899 (0.0008) [2023-12-28 02:50:57,428][106226] Updated weights for policy 0, policy_version 1056260 (0.0009) [2023-12-28 02:50:57,483][106226] Updated weights for policy 0, policy_version 1056270 (0.0009) [2023-12-28 02:50:57,532][106226] Updated weights for policy 0, policy_version 1056280 (0.0008) [2023-12-28 02:50:57,713][106225] Updated weights for policy 1, policy_version 1058909 (0.0006) [2023-12-28 02:50:57,775][106225] Updated weights for policy 1, policy_version 1058919 (0.0006) [2023-12-28 02:50:57,836][106225] Updated weights for policy 1, policy_version 1058929 (0.0006) [2023-12-28 02:50:58,269][106226] Updated weights for policy 0, policy_version 1056290 (0.0008) [2023-12-28 02:50:58,332][106226] Updated weights for policy 0, policy_version 1056300 (0.0008) [2023-12-28 02:50:58,396][106225] Updated weights for policy 1, policy_version 1058939 (0.0008) [2023-12-28 02:50:58,402][106226] Updated weights for policy 0, policy_version 1056310 (0.0008) [2023-12-28 02:50:58,457][106225] Updated weights for policy 1, policy_version 1058949 (0.0009) [2023-12-28 02:50:58,468][106226] Updated weights for policy 0, policy_version 1056320 (0.0007) [2023-12-28 02:50:58,525][106225] Updated weights for policy 1, policy_version 1058959 (0.0010) [2023-12-28 02:50:59,261][106226] Updated weights for policy 0, policy_version 1056330 (0.0010) [2023-12-28 02:50:59,318][106226] Updated weights for policy 0, policy_version 1056340 (0.0008) [2023-12-28 02:50:59,356][106225] Updated weights for policy 1, policy_version 1058969 (0.0011) [2023-12-28 02:50:59,406][106226] Updated weights for policy 0, policy_version 1056350 (0.0007) [2023-12-28 02:50:59,417][106225] Updated weights for policy 1, policy_version 1058979 (0.0009) [2023-12-28 02:50:59,472][106225] Updated weights for policy 1, policy_version 1058989 (0.0010) [2023-12-28 02:50:59,526][106225] Updated weights for policy 1, policy_version 1058999 (0.0010) [2023-12-28 02:51:00,078][106226] Updated weights for policy 0, policy_version 1056360 (0.0006) [2023-12-28 02:51:00,126][106226] Updated weights for policy 0, policy_version 1056370 (0.0009) [2023-12-28 02:51:00,176][106226] Updated weights for policy 0, policy_version 1056380 (0.0010) [2023-12-28 02:51:00,260][106225] Updated weights for policy 1, policy_version 1059009 (0.0010) [2023-12-28 02:51:00,316][106225] Updated weights for policy 1, policy_version 1059019 (0.0010) [2023-12-28 02:51:00,373][106225] Updated weights for policy 1, policy_version 1059029 (0.0010) [2023-12-28 02:51:00,908][106226] Updated weights for policy 0, policy_version 1056390 (0.0010) [2023-12-28 02:51:00,972][106226] Updated weights for policy 0, policy_version 1056400 (0.0010) [2023-12-28 02:51:01,040][106226] Updated weights for policy 0, policy_version 1056410 (0.0011) [2023-12-28 02:51:01,089][106225] Updated weights for policy 1, policy_version 1059039 (0.0010) [2023-12-28 02:51:01,153][106225] Updated weights for policy 1, policy_version 1059049 (0.0010) [2023-12-28 02:51:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 541655040. Throughput: 0: 10056.1, 1: 9923.8. Samples: 541644924. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:01,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.133')] [2023-12-28 02:51:01,217][106225] Updated weights for policy 1, policy_version 1059059 (0.0010) [2023-12-28 02:51:01,781][106226] Updated weights for policy 0, policy_version 1056420 (0.0008) [2023-12-28 02:51:01,840][106226] Updated weights for policy 0, policy_version 1056430 (0.0008) [2023-12-28 02:51:01,900][106226] Updated weights for policy 0, policy_version 1056440 (0.0008) [2023-12-28 02:51:01,960][106225] Updated weights for policy 1, policy_version 1059069 (0.0011) [2023-12-28 02:51:02,013][106225] Updated weights for policy 1, policy_version 1059079 (0.0008) [2023-12-28 02:51:02,074][106225] Updated weights for policy 1, policy_version 1059089 (0.0008) [2023-12-28 02:51:02,658][106226] Updated weights for policy 0, policy_version 1056450 (0.0008) [2023-12-28 02:51:02,718][106226] Updated weights for policy 0, policy_version 1056460 (0.0008) [2023-12-28 02:51:02,754][106225] Updated weights for policy 1, policy_version 1059099 (0.0008) [2023-12-28 02:51:02,777][106226] Updated weights for policy 0, policy_version 1056470 (0.0008) [2023-12-28 02:51:02,822][106225] Updated weights for policy 1, policy_version 1059109 (0.0008) [2023-12-28 02:51:02,840][106226] Updated weights for policy 0, policy_version 1056480 (0.0006) [2023-12-28 02:51:02,883][106225] Updated weights for policy 1, policy_version 1059119 (0.0007) [2023-12-28 02:51:03,519][106225] Updated weights for policy 1, policy_version 1059129 (0.0007) [2023-12-28 02:51:03,571][106225] Updated weights for policy 1, policy_version 1059139 (0.0007) [2023-12-28 02:51:03,590][106226] Updated weights for policy 0, policy_version 1056490 (0.0007) [2023-12-28 02:51:03,619][106225] Updated weights for policy 1, policy_version 1059149 (0.0006) [2023-12-28 02:51:03,641][106226] Updated weights for policy 0, policy_version 1056500 (0.0006) [2023-12-28 02:51:03,670][106225] Updated weights for policy 1, policy_version 1059159 (0.0007) [2023-12-28 02:51:03,692][106226] Updated weights for policy 0, policy_version 1056510 (0.0008) [2023-12-28 02:51:04,420][106225] Updated weights for policy 1, policy_version 1059169 (0.0006) [2023-12-28 02:51:04,459][106226] Updated weights for policy 0, policy_version 1056520 (0.0006) [2023-12-28 02:51:04,481][106225] Updated weights for policy 1, policy_version 1059179 (0.0006) [2023-12-28 02:51:04,520][106226] Updated weights for policy 0, policy_version 1056530 (0.0006) [2023-12-28 02:51:04,540][106225] Updated weights for policy 1, policy_version 1059189 (0.0005) [2023-12-28 02:51:04,578][106226] Updated weights for policy 0, policy_version 1056540 (0.0006) [2023-12-28 02:51:05,118][106225] Updated weights for policy 1, policy_version 1059199 (0.0005) [2023-12-28 02:51:05,179][106225] Updated weights for policy 1, policy_version 1059209 (0.0005) [2023-12-28 02:51:05,215][106226] Updated weights for policy 0, policy_version 1056550 (0.0008) [2023-12-28 02:51:05,233][106225] Updated weights for policy 1, policy_version 1059219 (0.0006) [2023-12-28 02:51:05,263][106226] Updated weights for policy 0, policy_version 1056560 (0.0006) [2023-12-28 02:51:05,318][106226] Updated weights for policy 0, policy_version 1056570 (0.0008) [2023-12-28 02:51:05,891][106225] Updated weights for policy 1, policy_version 1059229 (0.0008) [2023-12-28 02:51:05,951][106225] Updated weights for policy 1, policy_version 1059239 (0.0008) [2023-12-28 02:51:06,007][106225] Updated weights for policy 1, policy_version 1059249 (0.0008) [2023-12-28 02:51:06,053][106226] Updated weights for policy 0, policy_version 1056580 (0.0009) [2023-12-28 02:51:06,118][106226] Updated weights for policy 0, policy_version 1056590 (0.0009) [2023-12-28 02:51:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 541753344. Throughput: 0: 9954.0, 1: 9989.8. Samples: 541762636. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:06,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-5.013')] [2023-12-28 02:51:06,179][106226] Updated weights for policy 0, policy_version 1056600 (0.0008) [2023-12-28 02:51:06,767][106225] Updated weights for policy 1, policy_version 1059259 (0.0007) [2023-12-28 02:51:06,830][106225] Updated weights for policy 1, policy_version 1059269 (0.0008) [2023-12-28 02:51:06,901][106225] Updated weights for policy 1, policy_version 1059279 (0.0008) [2023-12-28 02:51:06,907][106226] Updated weights for policy 0, policy_version 1056610 (0.0007) [2023-12-28 02:51:06,963][106226] Updated weights for policy 0, policy_version 1056620 (0.0007) [2023-12-28 02:51:07,018][106226] Updated weights for policy 0, policy_version 1056630 (0.0009) [2023-12-28 02:51:07,077][106226] Updated weights for policy 0, policy_version 1056640 (0.0008) [2023-12-28 02:51:07,511][106225] Updated weights for policy 1, policy_version 1059289 (0.0008) [2023-12-28 02:51:07,561][106225] Updated weights for policy 1, policy_version 1059299 (0.0010) [2023-12-28 02:51:07,609][106225] Updated weights for policy 1, policy_version 1059309 (0.0010) [2023-12-28 02:51:07,679][106225] Updated weights for policy 1, policy_version 1059319 (0.0008) [2023-12-28 02:51:07,864][106226] Updated weights for policy 0, policy_version 1056650 (0.0008) [2023-12-28 02:51:07,923][106226] Updated weights for policy 0, policy_version 1056660 (0.0007) [2023-12-28 02:51:07,984][106226] Updated weights for policy 0, policy_version 1056670 (0.0008) [2023-12-28 02:51:08,383][106225] Updated weights for policy 1, policy_version 1059329 (0.0007) [2023-12-28 02:51:08,443][106225] Updated weights for policy 1, policy_version 1059339 (0.0006) [2023-12-28 02:51:08,491][106225] Updated weights for policy 1, policy_version 1059349 (0.0005) [2023-12-28 02:51:08,757][106226] Updated weights for policy 0, policy_version 1056680 (0.0008) [2023-12-28 02:51:08,811][106226] Updated weights for policy 0, policy_version 1056690 (0.0007) [2023-12-28 02:51:08,870][106226] Updated weights for policy 0, policy_version 1056700 (0.0008) [2023-12-28 02:51:09,135][106225] Updated weights for policy 1, policy_version 1059359 (0.0007) [2023-12-28 02:51:09,187][106225] Updated weights for policy 1, policy_version 1059369 (0.0009) [2023-12-28 02:51:09,252][106225] Updated weights for policy 1, policy_version 1059379 (0.0009) [2023-12-28 02:51:09,641][106226] Updated weights for policy 0, policy_version 1056710 (0.0006) [2023-12-28 02:51:09,707][106226] Updated weights for policy 0, policy_version 1056720 (0.0006) [2023-12-28 02:51:09,773][106226] Updated weights for policy 0, policy_version 1056730 (0.0008) [2023-12-28 02:51:10,038][106225] Updated weights for policy 1, policy_version 1059389 (0.0009) [2023-12-28 02:51:10,106][106225] Updated weights for policy 1, policy_version 1059399 (0.0010) [2023-12-28 02:51:10,169][106225] Updated weights for policy 1, policy_version 1059409 (0.0011) [2023-12-28 02:51:10,447][106226] Updated weights for policy 0, policy_version 1056740 (0.0009) [2023-12-28 02:51:10,501][106226] Updated weights for policy 0, policy_version 1056750 (0.0011) [2023-12-28 02:51:10,554][106226] Updated weights for policy 0, policy_version 1056760 (0.0007) [2023-12-28 02:51:10,758][106225] Updated weights for policy 1, policy_version 1059419 (0.0009) [2023-12-28 02:51:10,826][106225] Updated weights for policy 1, policy_version 1059429 (0.0005) [2023-12-28 02:51:10,888][106225] Updated weights for policy 1, policy_version 1059439 (0.0005) [2023-12-28 02:51:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 541851648. Throughput: 0: 9935.4, 1: 10049.9. Samples: 541820948. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:11,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.860')] [2023-12-28 02:51:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001059448_271261696.pth... [2023-12-28 02:51:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001056768_270589952.pth... [2023-12-28 02:51:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001058264_270958592.pth [2023-12-28 02:51:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001055648_270303232.pth [2023-12-28 02:51:11,335][106226] Updated weights for policy 0, policy_version 1056770 (0.0008) [2023-12-28 02:51:11,410][106226] Updated weights for policy 0, policy_version 1056780 (0.0008) [2023-12-28 02:51:11,475][106226] Updated weights for policy 0, policy_version 1056790 (0.0009) [2023-12-28 02:51:11,536][106226] Updated weights for policy 0, policy_version 1056800 (0.0009) [2023-12-28 02:51:11,588][106225] Updated weights for policy 1, policy_version 1059449 (0.0010) [2023-12-28 02:51:11,660][106225] Updated weights for policy 1, policy_version 1059459 (0.0010) [2023-12-28 02:51:11,725][106225] Updated weights for policy 1, policy_version 1059469 (0.0009) [2023-12-28 02:51:11,792][106225] Updated weights for policy 1, policy_version 1059479 (0.0008) [2023-12-28 02:51:12,305][106226] Updated weights for policy 0, policy_version 1056810 (0.0008) [2023-12-28 02:51:12,374][106226] Updated weights for policy 0, policy_version 1056820 (0.0009) [2023-12-28 02:51:12,439][106226] Updated weights for policy 0, policy_version 1056830 (0.0010) [2023-12-28 02:51:12,486][106225] Updated weights for policy 1, policy_version 1059489 (0.0008) [2023-12-28 02:51:12,550][106225] Updated weights for policy 1, policy_version 1059499 (0.0008) [2023-12-28 02:51:12,612][106225] Updated weights for policy 1, policy_version 1059509 (0.0009) [2023-12-28 02:51:13,098][106226] Updated weights for policy 0, policy_version 1056840 (0.0009) [2023-12-28 02:51:13,156][106226] Updated weights for policy 0, policy_version 1056850 (0.0008) [2023-12-28 02:51:13,213][106226] Updated weights for policy 0, policy_version 1056860 (0.0008) [2023-12-28 02:51:13,269][106225] Updated weights for policy 1, policy_version 1059519 (0.0010) [2023-12-28 02:51:13,316][106225] Updated weights for policy 1, policy_version 1059529 (0.0010) [2023-12-28 02:51:13,369][106225] Updated weights for policy 1, policy_version 1059539 (0.0010) [2023-12-28 02:51:13,927][106226] Updated weights for policy 0, policy_version 1056870 (0.0008) [2023-12-28 02:51:13,987][106226] Updated weights for policy 0, policy_version 1056880 (0.0008) [2023-12-28 02:51:14,045][106226] Updated weights for policy 0, policy_version 1056890 (0.0008) [2023-12-28 02:51:14,121][106225] Updated weights for policy 1, policy_version 1059549 (0.0010) [2023-12-28 02:51:14,177][106225] Updated weights for policy 1, policy_version 1059559 (0.0010) [2023-12-28 02:51:14,242][106225] Updated weights for policy 1, policy_version 1059569 (0.0009) [2023-12-28 02:51:14,705][106226] Updated weights for policy 0, policy_version 1056900 (0.0009) [2023-12-28 02:51:14,762][106226] Updated weights for policy 0, policy_version 1056910 (0.0007) [2023-12-28 02:51:14,831][106226] Updated weights for policy 0, policy_version 1056920 (0.0008) [2023-12-28 02:51:14,954][106225] Updated weights for policy 1, policy_version 1059579 (0.0010) [2023-12-28 02:51:15,023][106225] Updated weights for policy 1, policy_version 1059589 (0.0011) [2023-12-28 02:51:15,091][106225] Updated weights for policy 1, policy_version 1059599 (0.0010) [2023-12-28 02:51:15,475][106226] Updated weights for policy 0, policy_version 1056930 (0.0007) [2023-12-28 02:51:15,526][106226] Updated weights for policy 0, policy_version 1056940 (0.0007) [2023-12-28 02:51:15,579][106226] Updated weights for policy 0, policy_version 1056950 (0.0010) [2023-12-28 02:51:15,635][106226] Updated weights for policy 0, policy_version 1056960 (0.0010) [2023-12-28 02:51:15,799][106225] Updated weights for policy 1, policy_version 1059609 (0.0010) [2023-12-28 02:51:15,841][106225] Updated weights for policy 1, policy_version 1059619 (0.0007) [2023-12-28 02:51:15,898][106225] Updated weights for policy 1, policy_version 1059629 (0.0008) [2023-12-28 02:51:15,959][106225] Updated weights for policy 1, policy_version 1059639 (0.0007) [2023-12-28 02:51:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 541949952. Throughput: 0: 9802.2, 1: 10011.0. Samples: 541938968. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:16,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-4.824')] [2023-12-28 02:51:16,336][106226] Updated weights for policy 0, policy_version 1056970 (0.0011) [2023-12-28 02:51:16,389][106226] Updated weights for policy 0, policy_version 1056980 (0.0010) [2023-12-28 02:51:16,440][106226] Updated weights for policy 0, policy_version 1056990 (0.0008) [2023-12-28 02:51:16,686][106225] Updated weights for policy 1, policy_version 1059649 (0.0010) [2023-12-28 02:51:16,751][106225] Updated weights for policy 1, policy_version 1059659 (0.0010) [2023-12-28 02:51:16,813][106225] Updated weights for policy 1, policy_version 1059669 (0.0009) [2023-12-28 02:51:17,058][106226] Updated weights for policy 0, policy_version 1057000 (0.0010) [2023-12-28 02:51:17,111][106226] Updated weights for policy 0, policy_version 1057010 (0.0010) [2023-12-28 02:51:17,168][106226] Updated weights for policy 0, policy_version 1057020 (0.0010) [2023-12-28 02:51:17,492][106225] Updated weights for policy 1, policy_version 1059679 (0.0008) [2023-12-28 02:51:17,542][106225] Updated weights for policy 1, policy_version 1059689 (0.0007) [2023-12-28 02:51:17,595][106225] Updated weights for policy 1, policy_version 1059699 (0.0007) [2023-12-28 02:51:17,869][106226] Updated weights for policy 0, policy_version 1057030 (0.0007) [2023-12-28 02:51:17,934][106226] Updated weights for policy 0, policy_version 1057040 (0.0005) [2023-12-28 02:51:17,995][106226] Updated weights for policy 0, policy_version 1057050 (0.0005) [2023-12-28 02:51:18,224][106225] Updated weights for policy 1, policy_version 1059709 (0.0007) [2023-12-28 02:51:18,288][106225] Updated weights for policy 1, policy_version 1059719 (0.0006) [2023-12-28 02:51:18,355][106225] Updated weights for policy 1, policy_version 1059729 (0.0008) [2023-12-28 02:51:18,661][106226] Updated weights for policy 0, policy_version 1057060 (0.0008) [2023-12-28 02:51:18,722][106226] Updated weights for policy 0, policy_version 1057070 (0.0011) [2023-12-28 02:51:18,783][106226] Updated weights for policy 0, policy_version 1057080 (0.0011) [2023-12-28 02:51:19,069][106225] Updated weights for policy 1, policy_version 1059739 (0.0008) [2023-12-28 02:51:19,135][106225] Updated weights for policy 1, policy_version 1059749 (0.0010) [2023-12-28 02:51:19,191][106225] Updated weights for policy 1, policy_version 1059759 (0.0010) [2023-12-28 02:51:19,541][106226] Updated weights for policy 0, policy_version 1057090 (0.0011) [2023-12-28 02:51:19,610][106226] Updated weights for policy 0, policy_version 1057100 (0.0011) [2023-12-28 02:51:19,682][106226] Updated weights for policy 0, policy_version 1057110 (0.0011) [2023-12-28 02:51:19,748][106226] Updated weights for policy 0, policy_version 1057120 (0.0011) [2023-12-28 02:51:19,937][106225] Updated weights for policy 1, policy_version 1059769 (0.0010) [2023-12-28 02:51:20,002][106225] Updated weights for policy 1, policy_version 1059779 (0.0008) [2023-12-28 02:51:20,065][106225] Updated weights for policy 1, policy_version 1059789 (0.0008) [2023-12-28 02:51:20,119][106225] Updated weights for policy 1, policy_version 1059799 (0.0008) [2023-12-28 02:51:20,446][106226] Updated weights for policy 0, policy_version 1057130 (0.0011) [2023-12-28 02:51:20,502][106226] Updated weights for policy 0, policy_version 1057140 (0.0011) [2023-12-28 02:51:20,549][106226] Updated weights for policy 0, policy_version 1057150 (0.0010) [2023-12-28 02:51:20,909][106225] Updated weights for policy 1, policy_version 1059809 (0.0009) [2023-12-28 02:51:20,963][106225] Updated weights for policy 1, policy_version 1059819 (0.0007) [2023-12-28 02:51:21,020][106225] Updated weights for policy 1, policy_version 1059829 (0.0009) [2023-12-28 02:51:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 542048256. Throughput: 0: 9755.9, 1: 9940.7. Samples: 542056844. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:21,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-4.916')] [2023-12-28 02:51:21,248][106226] Updated weights for policy 0, policy_version 1057160 (0.0008) [2023-12-28 02:51:21,310][106226] Updated weights for policy 0, policy_version 1057170 (0.0007) [2023-12-28 02:51:21,376][106226] Updated weights for policy 0, policy_version 1057180 (0.0009) [2023-12-28 02:51:21,897][106225] Updated weights for policy 1, policy_version 1059839 (0.0007) [2023-12-28 02:51:21,964][106225] Updated weights for policy 1, policy_version 1059849 (0.0006) [2023-12-28 02:51:22,032][106225] Updated weights for policy 1, policy_version 1059859 (0.0007) [2023-12-28 02:51:22,098][106226] Updated weights for policy 0, policy_version 1057190 (0.0008) [2023-12-28 02:51:22,161][106226] Updated weights for policy 0, policy_version 1057200 (0.0009) [2023-12-28 02:51:22,214][106226] Updated weights for policy 0, policy_version 1057210 (0.0009) [2023-12-28 02:51:22,653][106225] Updated weights for policy 1, policy_version 1059869 (0.0006) [2023-12-28 02:51:22,724][106225] Updated weights for policy 1, policy_version 1059879 (0.0008) [2023-12-28 02:51:22,788][106225] Updated weights for policy 1, policy_version 1059889 (0.0009) [2023-12-28 02:51:23,013][106226] Updated weights for policy 0, policy_version 1057220 (0.0008) [2023-12-28 02:51:23,058][106226] Updated weights for policy 0, policy_version 1057230 (0.0008) [2023-12-28 02:51:23,126][106226] Updated weights for policy 0, policy_version 1057240 (0.0006) [2023-12-28 02:51:23,512][106225] Updated weights for policy 1, policy_version 1059899 (0.0008) [2023-12-28 02:51:23,572][106225] Updated weights for policy 1, policy_version 1059909 (0.0009) [2023-12-28 02:51:23,634][106225] Updated weights for policy 1, policy_version 1059919 (0.0009) [2023-12-28 02:51:23,830][106226] Updated weights for policy 0, policy_version 1057250 (0.0008) [2023-12-28 02:51:23,889][106226] Updated weights for policy 0, policy_version 1057260 (0.0009) [2023-12-28 02:51:23,948][106226] Updated weights for policy 0, policy_version 1057270 (0.0008) [2023-12-28 02:51:24,006][106226] Updated weights for policy 0, policy_version 1057280 (0.0009) [2023-12-28 02:51:24,342][106225] Updated weights for policy 1, policy_version 1059929 (0.0009) [2023-12-28 02:51:24,412][106225] Updated weights for policy 1, policy_version 1059939 (0.0011) [2023-12-28 02:51:24,478][106225] Updated weights for policy 1, policy_version 1059949 (0.0011) [2023-12-28 02:51:24,549][106225] Updated weights for policy 1, policy_version 1059959 (0.0010) [2023-12-28 02:51:24,753][106226] Updated weights for policy 0, policy_version 1057290 (0.0007) [2023-12-28 02:51:24,819][106226] Updated weights for policy 0, policy_version 1057300 (0.0007) [2023-12-28 02:51:24,880][106226] Updated weights for policy 0, policy_version 1057310 (0.0009) [2023-12-28 02:51:25,213][106225] Updated weights for policy 1, policy_version 1059969 (0.0010) [2023-12-28 02:51:25,273][106225] Updated weights for policy 1, policy_version 1059979 (0.0009) [2023-12-28 02:51:25,326][106225] Updated weights for policy 1, policy_version 1059989 (0.0005) [2023-12-28 02:51:25,606][106226] Updated weights for policy 0, policy_version 1057320 (0.0008) [2023-12-28 02:51:25,652][106226] Updated weights for policy 0, policy_version 1057330 (0.0008) [2023-12-28 02:51:25,698][106226] Updated weights for policy 0, policy_version 1057340 (0.0008) [2023-12-28 02:51:25,988][106225] Updated weights for policy 1, policy_version 1059999 (0.0009) [2023-12-28 02:51:26,044][106225] Updated weights for policy 1, policy_version 1060009 (0.0010) [2023-12-28 02:51:26,100][106225] Updated weights for policy 1, policy_version 1060019 (0.0010) [2023-12-28 02:51:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 542146560. Throughput: 0: 9752.7, 1: 9868.1. Samples: 542113260. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:26,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.069')] [2023-12-28 02:51:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001060024_271409152.pth... [2023-12-28 02:51:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001057344_270737408.pth... [2023-12-28 02:51:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001058872_271114240.pth [2023-12-28 02:51:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001056224_270450688.pth [2023-12-28 02:51:26,447][106226] Updated weights for policy 0, policy_version 1057350 (0.0006) [2023-12-28 02:51:26,501][106226] Updated weights for policy 0, policy_version 1057360 (0.0005) [2023-12-28 02:51:26,573][106226] Updated weights for policy 0, policy_version 1057370 (0.0008) [2023-12-28 02:51:26,829][106225] Updated weights for policy 1, policy_version 1060029 (0.0010) [2023-12-28 02:51:26,878][106225] Updated weights for policy 1, policy_version 1060039 (0.0010) [2023-12-28 02:51:26,940][106225] Updated weights for policy 1, policy_version 1060049 (0.0010) [2023-12-28 02:51:27,202][106226] Updated weights for policy 0, policy_version 1057380 (0.0007) [2023-12-28 02:51:27,249][106226] Updated weights for policy 0, policy_version 1057390 (0.0007) [2023-12-28 02:51:27,311][106226] Updated weights for policy 0, policy_version 1057400 (0.0005) [2023-12-28 02:51:27,663][106225] Updated weights for policy 1, policy_version 1060059 (0.0009) [2023-12-28 02:51:27,716][106225] Updated weights for policy 1, policy_version 1060069 (0.0005) [2023-12-28 02:51:27,772][106225] Updated weights for policy 1, policy_version 1060079 (0.0005) [2023-12-28 02:51:27,895][106226] Updated weights for policy 0, policy_version 1057410 (0.0006) [2023-12-28 02:51:27,943][106226] Updated weights for policy 0, policy_version 1057420 (0.0008) [2023-12-28 02:51:27,992][106226] Updated weights for policy 0, policy_version 1057430 (0.0008) [2023-12-28 02:51:28,041][106226] Updated weights for policy 0, policy_version 1057440 (0.0009) [2023-12-28 02:51:28,309][106225] Updated weights for policy 1, policy_version 1060089 (0.0005) [2023-12-28 02:51:28,376][106225] Updated weights for policy 1, policy_version 1060099 (0.0007) [2023-12-28 02:51:28,434][106225] Updated weights for policy 1, policy_version 1060109 (0.0005) [2023-12-28 02:51:28,500][106225] Updated weights for policy 1, policy_version 1060119 (0.0005) [2023-12-28 02:51:28,860][106226] Updated weights for policy 0, policy_version 1057450 (0.0009) [2023-12-28 02:51:28,915][106226] Updated weights for policy 0, policy_version 1057460 (0.0009) [2023-12-28 02:51:28,962][106226] Updated weights for policy 0, policy_version 1057470 (0.0008) [2023-12-28 02:51:29,011][106225] Updated weights for policy 1, policy_version 1060129 (0.0005) [2023-12-28 02:51:29,077][106225] Updated weights for policy 1, policy_version 1060139 (0.0005) [2023-12-28 02:51:29,144][106225] Updated weights for policy 1, policy_version 1060149 (0.0005) [2023-12-28 02:51:29,693][106225] Updated weights for policy 1, policy_version 1060159 (0.0007) [2023-12-28 02:51:29,755][106225] Updated weights for policy 1, policy_version 1060169 (0.0009) [2023-12-28 02:51:29,758][106226] Updated weights for policy 0, policy_version 1057480 (0.0006) [2023-12-28 02:51:29,814][106226] Updated weights for policy 0, policy_version 1057490 (0.0008) [2023-12-28 02:51:29,817][106225] Updated weights for policy 1, policy_version 1060179 (0.0010) [2023-12-28 02:51:29,878][106226] Updated weights for policy 0, policy_version 1057500 (0.0006) [2023-12-28 02:51:30,490][106226] Updated weights for policy 0, policy_version 1057510 (0.0007) [2023-12-28 02:51:30,516][106225] Updated weights for policy 1, policy_version 1060189 (0.0009) [2023-12-28 02:51:30,539][106226] Updated weights for policy 0, policy_version 1057520 (0.0005) [2023-12-28 02:51:30,567][106225] Updated weights for policy 1, policy_version 1060199 (0.0005) [2023-12-28 02:51:30,596][106226] Updated weights for policy 0, policy_version 1057530 (0.0005) [2023-12-28 02:51:30,612][106225] Updated weights for policy 1, policy_version 1060209 (0.0005) [2023-12-28 02:51:31,157][106226] Updated weights for policy 0, policy_version 1057540 (0.0006) [2023-12-28 02:51:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 542244864. Throughput: 0: 9723.6, 1: 9968.3. Samples: 542236124. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:31,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-4.844')] [2023-12-28 02:51:31,223][106226] Updated weights for policy 0, policy_version 1057550 (0.0008) [2023-12-28 02:51:31,289][106226] Updated weights for policy 0, policy_version 1057560 (0.0008) [2023-12-28 02:51:31,303][106225] Updated weights for policy 1, policy_version 1060219 (0.0006) [2023-12-28 02:51:31,360][106225] Updated weights for policy 1, policy_version 1060229 (0.0012) [2023-12-28 02:51:31,423][106225] Updated weights for policy 1, policy_version 1060239 (0.0009) [2023-12-28 02:51:31,946][106226] Updated weights for policy 0, policy_version 1057570 (0.0008) [2023-12-28 02:51:32,008][106226] Updated weights for policy 0, policy_version 1057580 (0.0008) [2023-12-28 02:51:32,072][106226] Updated weights for policy 0, policy_version 1057590 (0.0008) [2023-12-28 02:51:32,140][106226] Updated weights for policy 0, policy_version 1057600 (0.0009) [2023-12-28 02:51:32,180][106225] Updated weights for policy 1, policy_version 1060249 (0.0008) [2023-12-28 02:51:32,236][106225] Updated weights for policy 1, policy_version 1060259 (0.0006) [2023-12-28 02:51:32,303][106225] Updated weights for policy 1, policy_version 1060269 (0.0007) [2023-12-28 02:51:32,377][106225] Updated weights for policy 1, policy_version 1060279 (0.0007) [2023-12-28 02:51:32,908][106226] Updated weights for policy 0, policy_version 1057610 (0.0008) [2023-12-28 02:51:32,958][106226] Updated weights for policy 0, policy_version 1057620 (0.0008) [2023-12-28 02:51:32,988][106225] Updated weights for policy 1, policy_version 1060289 (0.0006) [2023-12-28 02:51:33,012][106226] Updated weights for policy 0, policy_version 1057630 (0.0006) [2023-12-28 02:51:33,042][106225] Updated weights for policy 1, policy_version 1060299 (0.0006) [2023-12-28 02:51:33,090][106225] Updated weights for policy 1, policy_version 1060309 (0.0007) [2023-12-28 02:51:33,735][106226] Updated weights for policy 0, policy_version 1057640 (0.0007) [2023-12-28 02:51:33,798][106225] Updated weights for policy 1, policy_version 1060319 (0.0006) [2023-12-28 02:51:33,801][106226] Updated weights for policy 0, policy_version 1057650 (0.0009) [2023-12-28 02:51:33,850][106225] Updated weights for policy 1, policy_version 1060329 (0.0005) [2023-12-28 02:51:33,856][106226] Updated weights for policy 0, policy_version 1057660 (0.0008) [2023-12-28 02:51:33,895][106225] Updated weights for policy 1, policy_version 1060339 (0.0005) [2023-12-28 02:51:34,469][106226] Updated weights for policy 0, policy_version 1057670 (0.0009) [2023-12-28 02:51:34,537][106226] Updated weights for policy 0, policy_version 1057680 (0.0011) [2023-12-28 02:51:34,581][106225] Updated weights for policy 1, policy_version 1060349 (0.0005) [2023-12-28 02:51:34,602][106226] Updated weights for policy 0, policy_version 1057690 (0.0011) [2023-12-28 02:51:34,639][106225] Updated weights for policy 1, policy_version 1060359 (0.0006) [2023-12-28 02:51:34,698][106225] Updated weights for policy 1, policy_version 1060369 (0.0008) [2023-12-28 02:51:35,300][106226] Updated weights for policy 0, policy_version 1057700 (0.0011) [2023-12-28 02:51:35,351][106226] Updated weights for policy 0, policy_version 1057710 (0.0010) [2023-12-28 02:51:35,379][106225] Updated weights for policy 1, policy_version 1060379 (0.0007) [2023-12-28 02:51:35,398][106226] Updated weights for policy 0, policy_version 1057720 (0.0010) [2023-12-28 02:51:35,428][106225] Updated weights for policy 1, policy_version 1060389 (0.0005) [2023-12-28 02:51:35,478][106225] Updated weights for policy 1, policy_version 1060399 (0.0005) [2023-12-28 02:51:36,127][106226] Updated weights for policy 0, policy_version 1057730 (0.0010) [2023-12-28 02:51:36,138][106225] Updated weights for policy 1, policy_version 1060409 (0.0005) [2023-12-28 02:51:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 542343168. Throughput: 0: 9799.2, 1: 9931.3. Samples: 542358732. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:36,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.936')] [2023-12-28 02:51:36,188][106225] Updated weights for policy 1, policy_version 1060419 (0.0009) [2023-12-28 02:51:36,195][106226] Updated weights for policy 0, policy_version 1057740 (0.0006) [2023-12-28 02:51:36,250][106225] Updated weights for policy 1, policy_version 1060429 (0.0008) [2023-12-28 02:51:36,255][106226] Updated weights for policy 0, policy_version 1057750 (0.0006) [2023-12-28 02:51:36,310][106225] Updated weights for policy 1, policy_version 1060439 (0.0007) [2023-12-28 02:51:36,317][106226] Updated weights for policy 0, policy_version 1057760 (0.0006) [2023-12-28 02:51:37,027][106226] Updated weights for policy 0, policy_version 1057770 (0.0007) [2023-12-28 02:51:37,033][106225] Updated weights for policy 1, policy_version 1060449 (0.0006) [2023-12-28 02:51:37,087][106226] Updated weights for policy 0, policy_version 1057780 (0.0005) [2023-12-28 02:51:37,098][106225] Updated weights for policy 1, policy_version 1060459 (0.0008) [2023-12-28 02:51:37,148][106226] Updated weights for policy 0, policy_version 1057790 (0.0007) [2023-12-28 02:51:37,157][106225] Updated weights for policy 1, policy_version 1060469 (0.0009) [2023-12-28 02:51:37,840][106226] Updated weights for policy 0, policy_version 1057800 (0.0009) [2023-12-28 02:51:37,887][106225] Updated weights for policy 1, policy_version 1060479 (0.0008) [2023-12-28 02:51:37,906][106226] Updated weights for policy 0, policy_version 1057810 (0.0006) [2023-12-28 02:51:37,936][106225] Updated weights for policy 1, policy_version 1060489 (0.0008) [2023-12-28 02:51:37,966][106226] Updated weights for policy 0, policy_version 1057820 (0.0006) [2023-12-28 02:51:37,988][106225] Updated weights for policy 1, policy_version 1060499 (0.0009) [2023-12-28 02:51:38,634][106226] Updated weights for policy 0, policy_version 1057830 (0.0008) [2023-12-28 02:51:38,695][106226] Updated weights for policy 0, policy_version 1057840 (0.0010) [2023-12-28 02:51:38,758][106226] Updated weights for policy 0, policy_version 1057850 (0.0011) [2023-12-28 02:51:38,802][106225] Updated weights for policy 1, policy_version 1060509 (0.0009) [2023-12-28 02:51:38,855][106225] Updated weights for policy 1, policy_version 1060519 (0.0007) [2023-12-28 02:51:38,913][106225] Updated weights for policy 1, policy_version 1060529 (0.0008) [2023-12-28 02:51:39,445][106226] Updated weights for policy 0, policy_version 1057860 (0.0009) [2023-12-28 02:51:39,515][106226] Updated weights for policy 0, policy_version 1057870 (0.0006) [2023-12-28 02:51:39,588][106226] Updated weights for policy 0, policy_version 1057880 (0.0006) [2023-12-28 02:51:39,661][106225] Updated weights for policy 1, policy_version 1060539 (0.0009) [2023-12-28 02:51:39,716][106225] Updated weights for policy 1, policy_version 1060549 (0.0009) [2023-12-28 02:51:39,776][106225] Updated weights for policy 1, policy_version 1060559 (0.0009) [2023-12-28 02:51:40,198][106226] Updated weights for policy 0, policy_version 1057890 (0.0008) [2023-12-28 02:51:40,258][106226] Updated weights for policy 0, policy_version 1057900 (0.0008) [2023-12-28 02:51:40,315][106226] Updated weights for policy 0, policy_version 1057910 (0.0008) [2023-12-28 02:51:40,367][106226] Updated weights for policy 0, policy_version 1057920 (0.0008) [2023-12-28 02:51:40,560][106225] Updated weights for policy 1, policy_version 1060569 (0.0008) [2023-12-28 02:51:40,611][106225] Updated weights for policy 1, policy_version 1060579 (0.0009) [2023-12-28 02:51:40,655][106225] Updated weights for policy 1, policy_version 1060589 (0.0007) [2023-12-28 02:51:40,702][106225] Updated weights for policy 1, policy_version 1060599 (0.0010) [2023-12-28 02:51:41,155][106226] Updated weights for policy 0, policy_version 1057930 (0.0007) [2023-12-28 02:51:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 542441472. Throughput: 0: 9833.2, 1: 9923.8. Samples: 542416520. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:41,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.045')] [2023-12-28 02:51:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001060600_271556608.pth... [2023-12-28 02:51:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001059448_271261696.pth [2023-12-28 02:51:41,219][106226] Updated weights for policy 0, policy_version 1057940 (0.0006) [2023-12-28 02:51:41,289][106226] Updated weights for policy 0, policy_version 1057950 (0.0008) [2023-12-28 02:51:41,297][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001057952_270893056.pth... [2023-12-28 02:51:41,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001056768_270589952.pth [2023-12-28 02:51:41,520][106225] Updated weights for policy 1, policy_version 1060609 (0.0011) [2023-12-28 02:51:41,587][106225] Updated weights for policy 1, policy_version 1060619 (0.0010) [2023-12-28 02:51:41,649][106225] Updated weights for policy 1, policy_version 1060629 (0.0010) [2023-12-28 02:51:42,053][106226] Updated weights for policy 0, policy_version 1057960 (0.0008) [2023-12-28 02:51:42,115][106226] Updated weights for policy 0, policy_version 1057970 (0.0008) [2023-12-28 02:51:42,174][106226] Updated weights for policy 0, policy_version 1057980 (0.0008) [2023-12-28 02:51:42,389][106225] Updated weights for policy 1, policy_version 1060639 (0.0008) [2023-12-28 02:51:42,461][106225] Updated weights for policy 1, policy_version 1060649 (0.0007) [2023-12-28 02:51:42,519][106225] Updated weights for policy 1, policy_version 1060661 (0.0010) [2023-12-28 02:51:42,847][106226] Updated weights for policy 0, policy_version 1057990 (0.0008) [2023-12-28 02:51:42,902][106226] Updated weights for policy 0, policy_version 1058000 (0.0009) [2023-12-28 02:51:42,983][106226] Updated weights for policy 0, policy_version 1058010 (0.0008) [2023-12-28 02:51:43,259][106225] Updated weights for policy 1, policy_version 1060671 (0.0009) [2023-12-28 02:51:43,318][106225] Updated weights for policy 1, policy_version 1060681 (0.0008) [2023-12-28 02:51:43,376][106225] Updated weights for policy 1, policy_version 1060691 (0.0008) [2023-12-28 02:51:43,717][106226] Updated weights for policy 0, policy_version 1058020 (0.0009) [2023-12-28 02:51:43,776][106226] Updated weights for policy 0, policy_version 1058030 (0.0008) [2023-12-28 02:51:43,837][106226] Updated weights for policy 0, policy_version 1058040 (0.0008) [2023-12-28 02:51:44,075][106225] Updated weights for policy 1, policy_version 1060701 (0.0008) [2023-12-28 02:51:44,134][106225] Updated weights for policy 1, policy_version 1060711 (0.0008) [2023-12-28 02:51:44,192][106225] Updated weights for policy 1, policy_version 1060721 (0.0008) [2023-12-28 02:51:44,585][106226] Updated weights for policy 0, policy_version 1058050 (0.0008) [2023-12-28 02:51:44,654][106226] Updated weights for policy 0, policy_version 1058060 (0.0008) [2023-12-28 02:51:44,710][106226] Updated weights for policy 0, policy_version 1058070 (0.0009) [2023-12-28 02:51:44,771][106226] Updated weights for policy 0, policy_version 1058080 (0.0007) [2023-12-28 02:51:44,830][106225] Updated weights for policy 1, policy_version 1060731 (0.0008) [2023-12-28 02:51:44,897][106225] Updated weights for policy 1, policy_version 1060741 (0.0006) [2023-12-28 02:51:44,967][106225] Updated weights for policy 1, policy_version 1060751 (0.0009) [2023-12-28 02:51:45,519][106226] Updated weights for policy 0, policy_version 1058090 (0.0008) [2023-12-28 02:51:45,568][106226] Updated weights for policy 0, policy_version 1058100 (0.0009) [2023-12-28 02:51:45,600][106225] Updated weights for policy 1, policy_version 1060761 (0.0008) [2023-12-28 02:51:45,623][106226] Updated weights for policy 0, policy_version 1058110 (0.0008) [2023-12-28 02:51:45,661][106225] Updated weights for policy 1, policy_version 1060771 (0.0008) [2023-12-28 02:51:45,721][106225] Updated weights for policy 1, policy_version 1060781 (0.0009) [2023-12-28 02:51:45,780][106225] Updated weights for policy 1, policy_version 1060791 (0.0008) [2023-12-28 02:51:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 542539776. Throughput: 0: 9758.0, 1: 9950.6. Samples: 542531812. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:46,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.543')] [2023-12-28 02:51:46,301][106226] Updated weights for policy 0, policy_version 1058120 (0.0006) [2023-12-28 02:51:46,350][106226] Updated weights for policy 0, policy_version 1058130 (0.0008) [2023-12-28 02:51:46,405][106226] Updated weights for policy 0, policy_version 1058140 (0.0007) [2023-12-28 02:51:46,509][106225] Updated weights for policy 1, policy_version 1060801 (0.0010) [2023-12-28 02:51:46,564][106225] Updated weights for policy 1, policy_version 1060811 (0.0010) [2023-12-28 02:51:46,617][106225] Updated weights for policy 1, policy_version 1060821 (0.0010) [2023-12-28 02:51:47,030][106226] Updated weights for policy 0, policy_version 1058150 (0.0010) [2023-12-28 02:51:47,096][106226] Updated weights for policy 0, policy_version 1058160 (0.0007) [2023-12-28 02:51:47,155][106226] Updated weights for policy 0, policy_version 1058170 (0.0011) [2023-12-28 02:51:47,247][106225] Updated weights for policy 1, policy_version 1060831 (0.0007) [2023-12-28 02:51:47,314][106225] Updated weights for policy 1, policy_version 1060841 (0.0005) [2023-12-28 02:51:47,373][106225] Updated weights for policy 1, policy_version 1060851 (0.0005) [2023-12-28 02:51:47,838][106226] Updated weights for policy 0, policy_version 1058180 (0.0011) [2023-12-28 02:51:47,855][106225] Updated weights for policy 1, policy_version 1060861 (0.0007) [2023-12-28 02:51:47,898][106226] Updated weights for policy 0, policy_version 1058190 (0.0010) [2023-12-28 02:51:47,913][106225] Updated weights for policy 1, policy_version 1060871 (0.0005) [2023-12-28 02:51:47,947][106226] Updated weights for policy 0, policy_version 1058200 (0.0010) [2023-12-28 02:51:47,968][106225] Updated weights for policy 1, policy_version 1060881 (0.0005) [2023-12-28 02:51:48,582][106225] Updated weights for policy 1, policy_version 1060891 (0.0006) [2023-12-28 02:51:48,638][106225] Updated weights for policy 1, policy_version 1060901 (0.0005) [2023-12-28 02:51:48,694][106225] Updated weights for policy 1, policy_version 1060911 (0.0006) [2023-12-28 02:51:48,738][106226] Updated weights for policy 0, policy_version 1058210 (0.0010) [2023-12-28 02:51:48,801][106226] Updated weights for policy 0, policy_version 1058220 (0.0008) [2023-12-28 02:51:48,864][106226] Updated weights for policy 0, policy_version 1058230 (0.0010) [2023-12-28 02:51:48,930][106226] Updated weights for policy 0, policy_version 1058240 (0.0009) [2023-12-28 02:51:49,246][106225] Updated weights for policy 1, policy_version 1060921 (0.0008) [2023-12-28 02:51:49,303][106225] Updated weights for policy 1, policy_version 1060931 (0.0008) [2023-12-28 02:51:49,371][106225] Updated weights for policy 1, policy_version 1060941 (0.0008) [2023-12-28 02:51:49,442][106225] Updated weights for policy 1, policy_version 1060951 (0.0008) [2023-12-28 02:51:49,692][106226] Updated weights for policy 0, policy_version 1058250 (0.0008) [2023-12-28 02:51:49,764][106226] Updated weights for policy 0, policy_version 1058260 (0.0007) [2023-12-28 02:51:49,837][106226] Updated weights for policy 0, policy_version 1058270 (0.0008) [2023-12-28 02:51:50,155][106225] Updated weights for policy 1, policy_version 1060961 (0.0008) [2023-12-28 02:51:50,214][106225] Updated weights for policy 1, policy_version 1060971 (0.0009) [2023-12-28 02:51:50,264][106225] Updated weights for policy 1, policy_version 1060981 (0.0009) [2023-12-28 02:51:50,452][106226] Updated weights for policy 0, policy_version 1058280 (0.0008) [2023-12-28 02:51:50,509][106226] Updated weights for policy 0, policy_version 1058290 (0.0008) [2023-12-28 02:51:50,562][106226] Updated weights for policy 0, policy_version 1058300 (0.0008) [2023-12-28 02:51:50,971][106225] Updated weights for policy 1, policy_version 1060991 (0.0007) [2023-12-28 02:51:51,026][106225] Updated weights for policy 1, policy_version 1061001 (0.0007) [2023-12-28 02:51:51,088][106225] Updated weights for policy 1, policy_version 1061011 (0.0006) [2023-12-28 02:51:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 542646272. Throughput: 0: 9777.2, 1: 10013.3. Samples: 542653212. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:51,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-4.866')] [2023-12-28 02:51:51,379][106226] Updated weights for policy 0, policy_version 1058310 (0.0009) [2023-12-28 02:51:51,445][106226] Updated weights for policy 0, policy_version 1058320 (0.0008) [2023-12-28 02:51:51,512][106226] Updated weights for policy 0, policy_version 1058330 (0.0008) [2023-12-28 02:51:51,824][106225] Updated weights for policy 1, policy_version 1061021 (0.0008) [2023-12-28 02:51:51,880][106225] Updated weights for policy 1, policy_version 1061031 (0.0008) [2023-12-28 02:51:51,937][106225] Updated weights for policy 1, policy_version 1061041 (0.0008) [2023-12-28 02:51:52,239][106226] Updated weights for policy 0, policy_version 1058340 (0.0009) [2023-12-28 02:51:52,304][106226] Updated weights for policy 0, policy_version 1058350 (0.0009) [2023-12-28 02:51:52,372][106226] Updated weights for policy 0, policy_version 1058360 (0.0009) [2023-12-28 02:51:52,709][106225] Updated weights for policy 1, policy_version 1061051 (0.0008) [2023-12-28 02:51:52,764][106225] Updated weights for policy 1, policy_version 1061061 (0.0008) [2023-12-28 02:51:52,816][106225] Updated weights for policy 1, policy_version 1061071 (0.0008) [2023-12-28 02:51:53,114][106226] Updated weights for policy 0, policy_version 1058370 (0.0008) [2023-12-28 02:51:53,174][106226] Updated weights for policy 0, policy_version 1058380 (0.0005) [2023-12-28 02:51:53,234][106226] Updated weights for policy 0, policy_version 1058390 (0.0005) [2023-12-28 02:51:53,294][106226] Updated weights for policy 0, policy_version 1058400 (0.0006) [2023-12-28 02:51:53,573][106225] Updated weights for policy 1, policy_version 1061081 (0.0008) [2023-12-28 02:51:53,641][106225] Updated weights for policy 1, policy_version 1061091 (0.0008) [2023-12-28 02:51:53,699][106225] Updated weights for policy 1, policy_version 1061101 (0.0008) [2023-12-28 02:51:53,756][106225] Updated weights for policy 1, policy_version 1061111 (0.0008) [2023-12-28 02:51:53,944][106226] Updated weights for policy 0, policy_version 1058410 (0.0008) [2023-12-28 02:51:53,993][106226] Updated weights for policy 0, policy_version 1058420 (0.0009) [2023-12-28 02:51:54,045][106226] Updated weights for policy 0, policy_version 1058430 (0.0009) [2023-12-28 02:51:54,526][106225] Updated weights for policy 1, policy_version 1061121 (0.0008) [2023-12-28 02:51:54,580][106225] Updated weights for policy 1, policy_version 1061131 (0.0007) [2023-12-28 02:51:54,640][106225] Updated weights for policy 1, policy_version 1061141 (0.0008) [2023-12-28 02:51:54,757][106226] Updated weights for policy 0, policy_version 1058440 (0.0008) [2023-12-28 02:51:54,821][106226] Updated weights for policy 0, policy_version 1058450 (0.0008) [2023-12-28 02:51:54,885][106226] Updated weights for policy 0, policy_version 1058460 (0.0010) [2023-12-28 02:51:55,393][106225] Updated weights for policy 1, policy_version 1061151 (0.0009) [2023-12-28 02:51:55,445][106225] Updated weights for policy 1, policy_version 1061161 (0.0008) [2023-12-28 02:51:55,491][106225] Updated weights for policy 1, policy_version 1061171 (0.0008) [2023-12-28 02:51:55,592][106226] Updated weights for policy 0, policy_version 1058470 (0.0009) [2023-12-28 02:51:55,653][106226] Updated weights for policy 0, policy_version 1058480 (0.0009) [2023-12-28 02:51:55,720][106226] Updated weights for policy 0, policy_version 1058490 (0.0010) [2023-12-28 02:51:56,138][106225] Updated weights for policy 1, policy_version 1061181 (0.0007) [2023-12-28 02:51:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 542736384. Throughput: 0: 9798.8, 1: 9966.0. Samples: 542710368. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:51:56,176][105115] Avg episode reward: [(0, '-4.423'), (1, '-4.870')] [2023-12-28 02:51:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001058496_271032320.pth... [2023-12-28 02:51:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001057344_270737408.pth [2023-12-28 02:51:56,199][106225] Updated weights for policy 1, policy_version 1061191 (0.0005) [2023-12-28 02:51:56,269][106225] Updated weights for policy 1, policy_version 1061201 (0.0007) [2023-12-28 02:51:56,303][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001061208_271712256.pth... [2023-12-28 02:51:56,308][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001060024_271409152.pth [2023-12-28 02:51:56,406][106226] Updated weights for policy 0, policy_version 1058500 (0.0010) [2023-12-28 02:51:56,452][106226] Updated weights for policy 0, policy_version 1058510 (0.0010) [2023-12-28 02:51:56,512][106226] Updated weights for policy 0, policy_version 1058520 (0.0010) [2023-12-28 02:51:56,813][106225] Updated weights for policy 1, policy_version 1061211 (0.0010) [2023-12-28 02:51:56,866][106225] Updated weights for policy 1, policy_version 1061221 (0.0010) [2023-12-28 02:51:56,914][106225] Updated weights for policy 1, policy_version 1061231 (0.0008) [2023-12-28 02:51:57,153][106226] Updated weights for policy 0, policy_version 1058530 (0.0009) [2023-12-28 02:51:57,209][106226] Updated weights for policy 0, policy_version 1058540 (0.0005) [2023-12-28 02:51:57,252][106226] Updated weights for policy 0, policy_version 1058550 (0.0005) [2023-12-28 02:51:57,307][106226] Updated weights for policy 0, policy_version 1058560 (0.0005) [2023-12-28 02:51:57,647][106225] Updated weights for policy 1, policy_version 1061241 (0.0008) [2023-12-28 02:51:57,696][106225] Updated weights for policy 1, policy_version 1061251 (0.0008) [2023-12-28 02:51:57,748][106225] Updated weights for policy 1, policy_version 1061261 (0.0008) [2023-12-28 02:51:57,809][106225] Updated weights for policy 1, policy_version 1061271 (0.0008) [2023-12-28 02:51:57,953][106226] Updated weights for policy 0, policy_version 1058570 (0.0008) [2023-12-28 02:51:58,010][106226] Updated weights for policy 0, policy_version 1058580 (0.0009) [2023-12-28 02:51:58,076][106226] Updated weights for policy 0, policy_version 1058590 (0.0008) [2023-12-28 02:51:58,479][106225] Updated weights for policy 1, policy_version 1061281 (0.0009) [2023-12-28 02:51:58,545][106225] Updated weights for policy 1, policy_version 1061291 (0.0009) [2023-12-28 02:51:58,618][106225] Updated weights for policy 1, policy_version 1061301 (0.0007) [2023-12-28 02:51:58,932][106226] Updated weights for policy 0, policy_version 1058600 (0.0008) [2023-12-28 02:51:59,000][106226] Updated weights for policy 0, policy_version 1058610 (0.0008) [2023-12-28 02:51:59,061][106226] Updated weights for policy 0, policy_version 1058620 (0.0008) [2023-12-28 02:51:59,433][106225] Updated weights for policy 1, policy_version 1061311 (0.0008) [2023-12-28 02:51:59,487][106225] Updated weights for policy 1, policy_version 1061321 (0.0008) [2023-12-28 02:51:59,538][106225] Updated weights for policy 1, policy_version 1061331 (0.0008) [2023-12-28 02:51:59,846][106226] Updated weights for policy 0, policy_version 1058630 (0.0008) [2023-12-28 02:51:59,907][106226] Updated weights for policy 0, policy_version 1058640 (0.0009) [2023-12-28 02:51:59,970][106226] Updated weights for policy 0, policy_version 1058650 (0.0008) [2023-12-28 02:52:00,276][106225] Updated weights for policy 1, policy_version 1061341 (0.0009) [2023-12-28 02:52:00,326][106225] Updated weights for policy 1, policy_version 1061351 (0.0010) [2023-12-28 02:52:00,382][106225] Updated weights for policy 1, policy_version 1061361 (0.0010) [2023-12-28 02:52:00,688][106226] Updated weights for policy 0, policy_version 1058660 (0.0008) [2023-12-28 02:52:00,742][106226] Updated weights for policy 0, policy_version 1058670 (0.0006) [2023-12-28 02:52:00,806][106226] Updated weights for policy 0, policy_version 1058680 (0.0005) [2023-12-28 02:52:00,959][106225] Updated weights for policy 1, policy_version 1061371 (0.0008) [2023-12-28 02:52:01,009][106225] Updated weights for policy 1, policy_version 1061381 (0.0007) [2023-12-28 02:52:01,074][106225] Updated weights for policy 1, policy_version 1061391 (0.0010) [2023-12-28 02:52:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 542842880. Throughput: 0: 9782.0, 1: 9966.0. Samples: 542827628. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:01,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.926')] [2023-12-28 02:52:01,514][106226] Updated weights for policy 0, policy_version 1058690 (0.0009) [2023-12-28 02:52:01,561][106226] Updated weights for policy 0, policy_version 1058700 (0.0007) [2023-12-28 02:52:01,612][106226] Updated weights for policy 0, policy_version 1058710 (0.0008) [2023-12-28 02:52:01,675][106226] Updated weights for policy 0, policy_version 1058720 (0.0008) [2023-12-28 02:52:01,813][106225] Updated weights for policy 1, policy_version 1061401 (0.0009) [2023-12-28 02:52:01,868][106225] Updated weights for policy 1, policy_version 1061411 (0.0007) [2023-12-28 02:52:01,927][106225] Updated weights for policy 1, policy_version 1061421 (0.0005) [2023-12-28 02:52:01,987][106225] Updated weights for policy 1, policy_version 1061431 (0.0005) [2023-12-28 02:52:02,498][106226] Updated weights for policy 0, policy_version 1058730 (0.0008) [2023-12-28 02:52:02,568][106226] Updated weights for policy 0, policy_version 1058740 (0.0008) [2023-12-28 02:52:02,634][106226] Updated weights for policy 0, policy_version 1058750 (0.0008) [2023-12-28 02:52:02,648][106225] Updated weights for policy 1, policy_version 1061441 (0.0007) [2023-12-28 02:52:02,715][106225] Updated weights for policy 1, policy_version 1061451 (0.0008) [2023-12-28 02:52:02,767][106225] Updated weights for policy 1, policy_version 1061461 (0.0008) [2023-12-28 02:52:03,310][106226] Updated weights for policy 0, policy_version 1058760 (0.0006) [2023-12-28 02:52:03,366][106226] Updated weights for policy 0, policy_version 1058770 (0.0005) [2023-12-28 02:52:03,417][106226] Updated weights for policy 0, policy_version 1058780 (0.0005) [2023-12-28 02:52:03,506][106225] Updated weights for policy 1, policy_version 1061471 (0.0008) [2023-12-28 02:52:03,563][106225] Updated weights for policy 1, policy_version 1061481 (0.0008) [2023-12-28 02:52:03,617][106225] Updated weights for policy 1, policy_version 1061491 (0.0008) [2023-12-28 02:52:03,994][106226] Updated weights for policy 0, policy_version 1058790 (0.0006) [2023-12-28 02:52:04,054][106226] Updated weights for policy 0, policy_version 1058800 (0.0009) [2023-12-28 02:52:04,111][106226] Updated weights for policy 0, policy_version 1058810 (0.0009) [2023-12-28 02:52:04,368][106225] Updated weights for policy 1, policy_version 1061501 (0.0007) [2023-12-28 02:52:04,427][106225] Updated weights for policy 1, policy_version 1061511 (0.0006) [2023-12-28 02:52:04,497][106225] Updated weights for policy 1, policy_version 1061521 (0.0006) [2023-12-28 02:52:04,944][106226] Updated weights for policy 0, policy_version 1058820 (0.0008) [2023-12-28 02:52:05,002][106226] Updated weights for policy 0, policy_version 1058830 (0.0008) [2023-12-28 02:52:05,049][106225] Updated weights for policy 1, policy_version 1061531 (0.0006) [2023-12-28 02:52:05,058][106226] Updated weights for policy 0, policy_version 1058840 (0.0009) [2023-12-28 02:52:05,104][106225] Updated weights for policy 1, policy_version 1061541 (0.0007) [2023-12-28 02:52:05,167][106225] Updated weights for policy 1, policy_version 1061551 (0.0007) [2023-12-28 02:52:05,694][106226] Updated weights for policy 0, policy_version 1058850 (0.0007) [2023-12-28 02:52:05,744][106226] Updated weights for policy 0, policy_version 1058860 (0.0008) [2023-12-28 02:52:05,792][106226] Updated weights for policy 0, policy_version 1058870 (0.0008) [2023-12-28 02:52:05,830][106225] Updated weights for policy 1, policy_version 1061561 (0.0007) [2023-12-28 02:52:05,851][106226] Updated weights for policy 0, policy_version 1058880 (0.0007) [2023-12-28 02:52:05,886][106225] Updated weights for policy 1, policy_version 1061571 (0.0007) [2023-12-28 02:52:05,934][106225] Updated weights for policy 1, policy_version 1061581 (0.0008) [2023-12-28 02:52:05,986][106225] Updated weights for policy 1, policy_version 1061591 (0.0008) [2023-12-28 02:52:06,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 542941184. Throughput: 0: 9763.8, 1: 10030.0. Samples: 542947564. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:06,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-4.853')] [2023-12-28 02:52:06,600][106226] Updated weights for policy 0, policy_version 1058890 (0.0009) [2023-12-28 02:52:06,660][106226] Updated weights for policy 0, policy_version 1058900 (0.0011) [2023-12-28 02:52:06,684][106225] Updated weights for policy 1, policy_version 1061601 (0.0010) [2023-12-28 02:52:06,719][106226] Updated weights for policy 0, policy_version 1058910 (0.0011) [2023-12-28 02:52:06,746][106225] Updated weights for policy 1, policy_version 1061611 (0.0009) [2023-12-28 02:52:06,809][106225] Updated weights for policy 1, policy_version 1061621 (0.0008) [2023-12-28 02:52:07,302][106226] Updated weights for policy 0, policy_version 1058920 (0.0006) [2023-12-28 02:52:07,359][106226] Updated weights for policy 0, policy_version 1058930 (0.0005) [2023-12-28 02:52:07,415][106226] Updated weights for policy 0, policy_version 1058940 (0.0005) [2023-12-28 02:52:07,565][106225] Updated weights for policy 1, policy_version 1061631 (0.0008) [2023-12-28 02:52:07,619][106225] Updated weights for policy 1, policy_version 1061641 (0.0008) [2023-12-28 02:52:07,672][106225] Updated weights for policy 1, policy_version 1061651 (0.0006) [2023-12-28 02:52:07,993][106226] Updated weights for policy 0, policy_version 1058950 (0.0008) [2023-12-28 02:52:08,043][106226] Updated weights for policy 0, policy_version 1058960 (0.0010) [2023-12-28 02:52:08,098][106226] Updated weights for policy 0, policy_version 1058970 (0.0009) [2023-12-28 02:52:08,324][106225] Updated weights for policy 1, policy_version 1061661 (0.0007) [2023-12-28 02:52:08,391][106225] Updated weights for policy 1, policy_version 1061671 (0.0006) [2023-12-28 02:52:08,447][106225] Updated weights for policy 1, policy_version 1061681 (0.0006) [2023-12-28 02:52:08,765][106226] Updated weights for policy 0, policy_version 1058980 (0.0008) [2023-12-28 02:52:08,820][106226] Updated weights for policy 0, policy_version 1058990 (0.0010) [2023-12-28 02:52:08,878][106226] Updated weights for policy 0, policy_version 1059000 (0.0011) [2023-12-28 02:52:09,029][106225] Updated weights for policy 1, policy_version 1061691 (0.0006) [2023-12-28 02:52:09,084][106225] Updated weights for policy 1, policy_version 1061701 (0.0007) [2023-12-28 02:52:09,143][106225] Updated weights for policy 1, policy_version 1061711 (0.0005) [2023-12-28 02:52:09,599][106226] Updated weights for policy 0, policy_version 1059010 (0.0010) [2023-12-28 02:52:09,663][106226] Updated weights for policy 0, policy_version 1059020 (0.0008) [2023-12-28 02:52:09,732][106226] Updated weights for policy 0, policy_version 1059030 (0.0010) [2023-12-28 02:52:09,790][106226] Updated weights for policy 0, policy_version 1059040 (0.0011) [2023-12-28 02:52:09,871][106225] Updated weights for policy 1, policy_version 1061721 (0.0006) [2023-12-28 02:52:09,943][106225] Updated weights for policy 1, policy_version 1061731 (0.0008) [2023-12-28 02:52:10,009][106225] Updated weights for policy 1, policy_version 1061741 (0.0008) [2023-12-28 02:52:10,079][106225] Updated weights for policy 1, policy_version 1061751 (0.0008) [2023-12-28 02:52:10,551][106226] Updated weights for policy 0, policy_version 1059050 (0.0009) [2023-12-28 02:52:10,608][106226] Updated weights for policy 0, policy_version 1059060 (0.0008) [2023-12-28 02:52:10,660][106226] Updated weights for policy 0, policy_version 1059070 (0.0008) [2023-12-28 02:52:10,720][106225] Updated weights for policy 1, policy_version 1061761 (0.0008) [2023-12-28 02:52:10,783][106225] Updated weights for policy 1, policy_version 1061771 (0.0008) [2023-12-28 02:52:10,843][106225] Updated weights for policy 1, policy_version 1061781 (0.0010) [2023-12-28 02:52:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 543039488. Throughput: 0: 9847.6, 1: 10093.9. Samples: 543010632. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:11,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.913')] [2023-12-28 02:52:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001061784_271859712.pth... [2023-12-28 02:52:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001059072_271179776.pth... [2023-12-28 02:52:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001060600_271556608.pth [2023-12-28 02:52:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001057952_270893056.pth [2023-12-28 02:52:11,435][106226] Updated weights for policy 0, policy_version 1059080 (0.0007) [2023-12-28 02:52:11,495][106226] Updated weights for policy 0, policy_version 1059090 (0.0008) [2023-12-28 02:52:11,561][106226] Updated weights for policy 0, policy_version 1059100 (0.0010) [2023-12-28 02:52:11,566][106225] Updated weights for policy 1, policy_version 1061791 (0.0007) [2023-12-28 02:52:11,639][106225] Updated weights for policy 1, policy_version 1061801 (0.0008) [2023-12-28 02:52:11,712][106225] Updated weights for policy 1, policy_version 1061811 (0.0008) [2023-12-28 02:52:12,309][106226] Updated weights for policy 0, policy_version 1059110 (0.0007) [2023-12-28 02:52:12,375][106226] Updated weights for policy 0, policy_version 1059120 (0.0008) [2023-12-28 02:52:12,432][106225] Updated weights for policy 1, policy_version 1061821 (0.0007) [2023-12-28 02:52:12,441][106226] Updated weights for policy 0, policy_version 1059130 (0.0007) [2023-12-28 02:52:12,481][106225] Updated weights for policy 1, policy_version 1061831 (0.0007) [2023-12-28 02:52:12,534][106225] Updated weights for policy 1, policy_version 1061841 (0.0008) [2023-12-28 02:52:13,132][106226] Updated weights for policy 0, policy_version 1059140 (0.0008) [2023-12-28 02:52:13,190][106226] Updated weights for policy 0, policy_version 1059150 (0.0005) [2023-12-28 02:52:13,235][106225] Updated weights for policy 1, policy_version 1061851 (0.0008) [2023-12-28 02:52:13,244][106226] Updated weights for policy 0, policy_version 1059160 (0.0006) [2023-12-28 02:52:13,285][106225] Updated weights for policy 1, policy_version 1061861 (0.0008) [2023-12-28 02:52:13,346][106225] Updated weights for policy 1, policy_version 1061871 (0.0007) [2023-12-28 02:52:13,837][106226] Updated weights for policy 0, policy_version 1059170 (0.0005) [2023-12-28 02:52:13,887][106226] Updated weights for policy 0, policy_version 1059180 (0.0005) [2023-12-28 02:52:13,939][106226] Updated weights for policy 0, policy_version 1059190 (0.0005) [2023-12-28 02:52:13,965][106225] Updated weights for policy 1, policy_version 1061881 (0.0010) [2023-12-28 02:52:13,995][106226] Updated weights for policy 0, policy_version 1059200 (0.0006) [2023-12-28 02:52:14,020][106225] Updated weights for policy 1, policy_version 1061891 (0.0008) [2023-12-28 02:52:14,077][106225] Updated weights for policy 1, policy_version 1061901 (0.0009) [2023-12-28 02:52:14,141][106225] Updated weights for policy 1, policy_version 1061911 (0.0010) [2023-12-28 02:52:14,616][106226] Updated weights for policy 0, policy_version 1059210 (0.0010) [2023-12-28 02:52:14,679][106226] Updated weights for policy 0, policy_version 1059220 (0.0010) [2023-12-28 02:52:14,741][106226] Updated weights for policy 0, policy_version 1059230 (0.0010) [2023-12-28 02:52:14,877][106225] Updated weights for policy 1, policy_version 1061921 (0.0008) [2023-12-28 02:52:14,939][106225] Updated weights for policy 1, policy_version 1061931 (0.0007) [2023-12-28 02:52:14,997][106225] Updated weights for policy 1, policy_version 1061941 (0.0009) [2023-12-28 02:52:15,353][106226] Updated weights for policy 0, policy_version 1059240 (0.0007) [2023-12-28 02:52:15,406][106226] Updated weights for policy 0, policy_version 1059250 (0.0005) [2023-12-28 02:52:15,455][106226] Updated weights for policy 0, policy_version 1059260 (0.0009) [2023-12-28 02:52:15,739][106225] Updated weights for policy 1, policy_version 1061951 (0.0008) [2023-12-28 02:52:15,794][106225] Updated weights for policy 1, policy_version 1061961 (0.0007) [2023-12-28 02:52:15,851][106225] Updated weights for policy 1, policy_version 1061971 (0.0008) [2023-12-28 02:52:16,135][106226] Updated weights for policy 0, policy_version 1059270 (0.0007) [2023-12-28 02:52:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 543137792. Throughput: 0: 9880.9, 1: 9972.1. Samples: 543129508. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:16,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.931')] [2023-12-28 02:52:16,195][106226] Updated weights for policy 0, policy_version 1059280 (0.0010) [2023-12-28 02:52:16,264][106226] Updated weights for policy 0, policy_version 1059290 (0.0007) [2023-12-28 02:52:16,589][106225] Updated weights for policy 1, policy_version 1061981 (0.0009) [2023-12-28 02:52:16,641][106225] Updated weights for policy 1, policy_version 1061991 (0.0010) [2023-12-28 02:52:16,697][106225] Updated weights for policy 1, policy_version 1062001 (0.0010) [2023-12-28 02:52:16,947][106226] Updated weights for policy 0, policy_version 1059300 (0.0010) [2023-12-28 02:52:17,007][106226] Updated weights for policy 0, policy_version 1059310 (0.0010) [2023-12-28 02:52:17,065][106226] Updated weights for policy 0, policy_version 1059320 (0.0010) [2023-12-28 02:52:17,406][106225] Updated weights for policy 1, policy_version 1062011 (0.0009) [2023-12-28 02:52:17,472][106225] Updated weights for policy 1, policy_version 1062021 (0.0010) [2023-12-28 02:52:17,529][106225] Updated weights for policy 1, policy_version 1062031 (0.0010) [2023-12-28 02:52:17,627][106226] Updated weights for policy 0, policy_version 1059330 (0.0009) [2023-12-28 02:52:17,683][106226] Updated weights for policy 0, policy_version 1059340 (0.0005) [2023-12-28 02:52:17,742][106226] Updated weights for policy 0, policy_version 1059350 (0.0005) [2023-12-28 02:52:17,805][106226] Updated weights for policy 0, policy_version 1059360 (0.0007) [2023-12-28 02:52:18,235][106225] Updated weights for policy 1, policy_version 1062041 (0.0011) [2023-12-28 02:52:18,289][106225] Updated weights for policy 1, policy_version 1062051 (0.0010) [2023-12-28 02:52:18,355][106225] Updated weights for policy 1, policy_version 1062061 (0.0010) [2023-12-28 02:52:18,420][106225] Updated weights for policy 1, policy_version 1062071 (0.0010) [2023-12-28 02:52:18,449][106226] Updated weights for policy 0, policy_version 1059370 (0.0010) [2023-12-28 02:52:18,513][106226] Updated weights for policy 0, policy_version 1059380 (0.0010) [2023-12-28 02:52:18,577][106226] Updated weights for policy 0, policy_version 1059390 (0.0010) [2023-12-28 02:52:19,176][106225] Updated weights for policy 1, policy_version 1062081 (0.0008) [2023-12-28 02:52:19,235][106225] Updated weights for policy 1, policy_version 1062091 (0.0008) [2023-12-28 02:52:19,297][106226] Updated weights for policy 0, policy_version 1059400 (0.0011) [2023-12-28 02:52:19,302][106225] Updated weights for policy 1, policy_version 1062101 (0.0008) [2023-12-28 02:52:19,360][106226] Updated weights for policy 0, policy_version 1059410 (0.0010) [2023-12-28 02:52:19,428][106226] Updated weights for policy 0, policy_version 1059420 (0.0009) [2023-12-28 02:52:19,975][106225] Updated weights for policy 1, policy_version 1062111 (0.0008) [2023-12-28 02:52:20,044][106225] Updated weights for policy 1, policy_version 1062121 (0.0008) [2023-12-28 02:52:20,111][106225] Updated weights for policy 1, policy_version 1062131 (0.0008) [2023-12-28 02:52:20,180][106226] Updated weights for policy 0, policy_version 1059430 (0.0009) [2023-12-28 02:52:20,250][106226] Updated weights for policy 0, policy_version 1059440 (0.0009) [2023-12-28 02:52:20,314][106226] Updated weights for policy 0, policy_version 1059450 (0.0009) [2023-12-28 02:52:20,810][106225] Updated weights for policy 1, policy_version 1062141 (0.0008) [2023-12-28 02:52:20,868][106225] Updated weights for policy 1, policy_version 1062151 (0.0006) [2023-12-28 02:52:20,931][106225] Updated weights for policy 1, policy_version 1062161 (0.0006) [2023-12-28 02:52:21,063][106226] Updated weights for policy 0, policy_version 1059460 (0.0009) [2023-12-28 02:52:21,126][106226] Updated weights for policy 0, policy_version 1059470 (0.0009) [2023-12-28 02:52:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 543236096. Throughput: 0: 9860.2, 1: 9904.2. Samples: 543248128. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:21,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.710')] [2023-12-28 02:52:21,194][106226] Updated weights for policy 0, policy_version 1059480 (0.0010) [2023-12-28 02:52:21,663][106225] Updated weights for policy 1, policy_version 1062171 (0.0007) [2023-12-28 02:52:21,726][106225] Updated weights for policy 1, policy_version 1062181 (0.0008) [2023-12-28 02:52:21,793][106225] Updated weights for policy 1, policy_version 1062191 (0.0008) [2023-12-28 02:52:22,002][106226] Updated weights for policy 0, policy_version 1059490 (0.0010) [2023-12-28 02:52:22,060][106226] Updated weights for policy 0, policy_version 1059500 (0.0009) [2023-12-28 02:52:22,115][106226] Updated weights for policy 0, policy_version 1059510 (0.0008) [2023-12-28 02:52:22,173][106226] Updated weights for policy 0, policy_version 1059520 (0.0009) [2023-12-28 02:52:22,520][106225] Updated weights for policy 1, policy_version 1062201 (0.0008) [2023-12-28 02:52:22,584][106225] Updated weights for policy 1, policy_version 1062211 (0.0006) [2023-12-28 02:52:22,655][106225] Updated weights for policy 1, policy_version 1062221 (0.0006) [2023-12-28 02:52:22,720][106225] Updated weights for policy 1, policy_version 1062231 (0.0006) [2023-12-28 02:52:22,889][106226] Updated weights for policy 0, policy_version 1059530 (0.0008) [2023-12-28 02:52:22,954][106226] Updated weights for policy 0, policy_version 1059540 (0.0008) [2023-12-28 02:52:23,013][106226] Updated weights for policy 0, policy_version 1059550 (0.0008) [2023-12-28 02:52:23,391][106225] Updated weights for policy 1, policy_version 1062241 (0.0010) [2023-12-28 02:52:23,454][106225] Updated weights for policy 1, policy_version 1062251 (0.0010) [2023-12-28 02:52:23,510][106225] Updated weights for policy 1, policy_version 1062261 (0.0010) [2023-12-28 02:52:23,733][106226] Updated weights for policy 0, policy_version 1059560 (0.0007) [2023-12-28 02:52:23,786][106226] Updated weights for policy 0, policy_version 1059570 (0.0008) [2023-12-28 02:52:23,835][106226] Updated weights for policy 0, policy_version 1059580 (0.0007) [2023-12-28 02:52:24,220][106225] Updated weights for policy 1, policy_version 1062271 (0.0010) [2023-12-28 02:52:24,280][106225] Updated weights for policy 1, policy_version 1062281 (0.0010) [2023-12-28 02:52:24,347][106225] Updated weights for policy 1, policy_version 1062291 (0.0010) [2023-12-28 02:52:24,574][106226] Updated weights for policy 0, policy_version 1059590 (0.0008) [2023-12-28 02:52:24,624][106226] Updated weights for policy 0, policy_version 1059600 (0.0008) [2023-12-28 02:52:24,674][106226] Updated weights for policy 0, policy_version 1059610 (0.0008) [2023-12-28 02:52:25,050][106225] Updated weights for policy 1, policy_version 1062301 (0.0010) [2023-12-28 02:52:25,107][106225] Updated weights for policy 1, policy_version 1062311 (0.0010) [2023-12-28 02:52:25,158][106225] Updated weights for policy 1, policy_version 1062321 (0.0010) [2023-12-28 02:52:25,430][106226] Updated weights for policy 0, policy_version 1059620 (0.0008) [2023-12-28 02:52:25,488][106226] Updated weights for policy 0, policy_version 1059630 (0.0008) [2023-12-28 02:52:25,546][106226] Updated weights for policy 0, policy_version 1059640 (0.0008) [2023-12-28 02:52:25,899][106225] Updated weights for policy 1, policy_version 1062331 (0.0010) [2023-12-28 02:52:25,956][106225] Updated weights for policy 1, policy_version 1062341 (0.0010) [2023-12-28 02:52:26,011][106225] Updated weights for policy 1, policy_version 1062351 (0.0010) [2023-12-28 02:52:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 543334400. Throughput: 0: 9816.8, 1: 9922.5. Samples: 543304788. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:26,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.922')] [2023-12-28 02:52:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001062360_272007168.pth... [2023-12-28 02:52:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001059648_271327232.pth... [2023-12-28 02:52:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001061208_271712256.pth [2023-12-28 02:52:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001058496_271032320.pth [2023-12-28 02:52:26,295][106226] Updated weights for policy 0, policy_version 1059650 (0.0008) [2023-12-28 02:52:26,356][106226] Updated weights for policy 0, policy_version 1059660 (0.0008) [2023-12-28 02:52:26,415][106226] Updated weights for policy 0, policy_version 1059670 (0.0008) [2023-12-28 02:52:26,478][106226] Updated weights for policy 0, policy_version 1059680 (0.0009) [2023-12-28 02:52:26,735][106225] Updated weights for policy 1, policy_version 1062361 (0.0010) [2023-12-28 02:52:26,782][106225] Updated weights for policy 1, policy_version 1062371 (0.0010) [2023-12-28 02:52:26,828][106225] Updated weights for policy 1, policy_version 1062381 (0.0010) [2023-12-28 02:52:26,877][106225] Updated weights for policy 1, policy_version 1062391 (0.0009) [2023-12-28 02:52:27,136][106226] Updated weights for policy 0, policy_version 1059690 (0.0008) [2023-12-28 02:52:27,195][106226] Updated weights for policy 0, policy_version 1059700 (0.0007) [2023-12-28 02:52:27,258][106226] Updated weights for policy 0, policy_version 1059710 (0.0008) [2023-12-28 02:52:27,601][106225] Updated weights for policy 1, policy_version 1062401 (0.0010) [2023-12-28 02:52:27,662][106225] Updated weights for policy 1, policy_version 1062411 (0.0009) [2023-12-28 02:52:27,709][106225] Updated weights for policy 1, policy_version 1062421 (0.0006) [2023-12-28 02:52:27,979][106226] Updated weights for policy 0, policy_version 1059720 (0.0007) [2023-12-28 02:52:28,048][106226] Updated weights for policy 0, policy_version 1059730 (0.0010) [2023-12-28 02:52:28,114][106226] Updated weights for policy 0, policy_version 1059740 (0.0011) [2023-12-28 02:52:28,263][106225] Updated weights for policy 1, policy_version 1062431 (0.0009) [2023-12-28 02:52:28,309][106225] Updated weights for policy 1, policy_version 1062441 (0.0010) [2023-12-28 02:52:28,374][106225] Updated weights for policy 1, policy_version 1062451 (0.0009) [2023-12-28 02:52:28,780][106226] Updated weights for policy 0, policy_version 1059750 (0.0010) [2023-12-28 02:52:28,839][106226] Updated weights for policy 0, policy_version 1059760 (0.0010) [2023-12-28 02:52:28,896][106226] Updated weights for policy 0, policy_version 1059770 (0.0011) [2023-12-28 02:52:29,105][106225] Updated weights for policy 1, policy_version 1062461 (0.0010) [2023-12-28 02:52:29,171][106225] Updated weights for policy 1, policy_version 1062471 (0.0011) [2023-12-28 02:52:29,241][106225] Updated weights for policy 1, policy_version 1062481 (0.0010) [2023-12-28 02:52:29,569][106226] Updated weights for policy 0, policy_version 1059780 (0.0007) [2023-12-28 02:52:29,619][106226] Updated weights for policy 0, policy_version 1059790 (0.0008) [2023-12-28 02:52:29,670][106226] Updated weights for policy 0, policy_version 1059800 (0.0008) [2023-12-28 02:52:29,973][106225] Updated weights for policy 1, policy_version 1062491 (0.0011) [2023-12-28 02:52:30,024][106225] Updated weights for policy 1, policy_version 1062501 (0.0009) [2023-12-28 02:52:30,082][106225] Updated weights for policy 1, policy_version 1062511 (0.0007) [2023-12-28 02:52:30,430][106226] Updated weights for policy 0, policy_version 1059810 (0.0008) [2023-12-28 02:52:30,482][106226] Updated weights for policy 0, policy_version 1059820 (0.0008) [2023-12-28 02:52:30,550][106226] Updated weights for policy 0, policy_version 1059830 (0.0008) [2023-12-28 02:52:30,610][106226] Updated weights for policy 0, policy_version 1059840 (0.0008) [2023-12-28 02:52:30,725][106225] Updated weights for policy 1, policy_version 1062521 (0.0009) [2023-12-28 02:52:30,774][106225] Updated weights for policy 1, policy_version 1062531 (0.0005) [2023-12-28 02:52:30,832][106225] Updated weights for policy 1, policy_version 1062541 (0.0010) [2023-12-28 02:52:30,888][106225] Updated weights for policy 1, policy_version 1062551 (0.0010) [2023-12-28 02:52:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 543432704. Throughput: 0: 9841.1, 1: 9960.0. Samples: 543422860. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:31,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-5.091')] [2023-12-28 02:52:31,269][106226] Updated weights for policy 0, policy_version 1059850 (0.0008) [2023-12-28 02:52:31,335][106226] Updated weights for policy 0, policy_version 1059860 (0.0006) [2023-12-28 02:52:31,402][106226] Updated weights for policy 0, policy_version 1059870 (0.0007) [2023-12-28 02:52:31,605][106225] Updated weights for policy 1, policy_version 1062561 (0.0008) [2023-12-28 02:52:31,672][106225] Updated weights for policy 1, policy_version 1062571 (0.0008) [2023-12-28 02:52:31,738][106225] Updated weights for policy 1, policy_version 1062581 (0.0008) [2023-12-28 02:52:32,059][106226] Updated weights for policy 0, policy_version 1059880 (0.0008) [2023-12-28 02:52:32,117][106226] Updated weights for policy 0, policy_version 1059890 (0.0007) [2023-12-28 02:52:32,169][106226] Updated weights for policy 0, policy_version 1059900 (0.0009) [2023-12-28 02:52:32,457][106225] Updated weights for policy 1, policy_version 1062591 (0.0009) [2023-12-28 02:52:32,510][106225] Updated weights for policy 1, policy_version 1062601 (0.0008) [2023-12-28 02:52:32,562][106225] Updated weights for policy 1, policy_version 1062611 (0.0010) [2023-12-28 02:52:32,871][106226] Updated weights for policy 0, policy_version 1059910 (0.0010) [2023-12-28 02:52:32,928][106226] Updated weights for policy 0, policy_version 1059920 (0.0010) [2023-12-28 02:52:32,977][106226] Updated weights for policy 0, policy_version 1059930 (0.0010) [2023-12-28 02:52:33,287][106225] Updated weights for policy 1, policy_version 1062621 (0.0008) [2023-12-28 02:52:33,337][106225] Updated weights for policy 1, policy_version 1062631 (0.0005) [2023-12-28 02:52:33,381][106225] Updated weights for policy 1, policy_version 1062641 (0.0005) [2023-12-28 02:52:33,678][106226] Updated weights for policy 0, policy_version 1059940 (0.0010) [2023-12-28 02:52:33,728][106226] Updated weights for policy 0, policy_version 1059950 (0.0010) [2023-12-28 02:52:33,790][106226] Updated weights for policy 0, policy_version 1059960 (0.0010) [2023-12-28 02:52:33,952][106225] Updated weights for policy 1, policy_version 1062651 (0.0006) [2023-12-28 02:52:33,999][106225] Updated weights for policy 1, policy_version 1062661 (0.0008) [2023-12-28 02:52:34,044][106225] Updated weights for policy 1, policy_version 1062671 (0.0007) [2023-12-28 02:52:34,494][106226] Updated weights for policy 0, policy_version 1059970 (0.0010) [2023-12-28 02:52:34,545][106226] Updated weights for policy 0, policy_version 1059980 (0.0008) [2023-12-28 02:52:34,602][106226] Updated weights for policy 0, policy_version 1059990 (0.0005) [2023-12-28 02:52:34,650][106226] Updated weights for policy 0, policy_version 1060000 (0.0005) [2023-12-28 02:52:34,781][106225] Updated weights for policy 1, policy_version 1062681 (0.0008) [2023-12-28 02:52:34,829][106225] Updated weights for policy 1, policy_version 1062691 (0.0008) [2023-12-28 02:52:34,881][106225] Updated weights for policy 1, policy_version 1062701 (0.0010) [2023-12-28 02:52:34,943][106225] Updated weights for policy 1, policy_version 1062711 (0.0010) [2023-12-28 02:52:35,208][106226] Updated weights for policy 0, policy_version 1060010 (0.0005) [2023-12-28 02:52:35,258][106226] Updated weights for policy 0, policy_version 1060020 (0.0005) [2023-12-28 02:52:35,312][106226] Updated weights for policy 0, policy_version 1060030 (0.0006) [2023-12-28 02:52:35,654][106225] Updated weights for policy 1, policy_version 1062721 (0.0010) [2023-12-28 02:52:35,711][106225] Updated weights for policy 1, policy_version 1062731 (0.0010) [2023-12-28 02:52:35,772][106225] Updated weights for policy 1, policy_version 1062741 (0.0010) [2023-12-28 02:52:35,910][106226] Updated weights for policy 0, policy_version 1060040 (0.0009) [2023-12-28 02:52:35,970][106226] Updated weights for policy 0, policy_version 1060050 (0.0010) [2023-12-28 02:52:36,033][106226] Updated weights for policy 0, policy_version 1060060 (0.0010) [2023-12-28 02:52:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 543539200. Throughput: 0: 9937.4, 1: 9895.0. Samples: 543545672. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:36,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.957')] [2023-12-28 02:52:36,534][106225] Updated weights for policy 1, policy_version 1062751 (0.0010) [2023-12-28 02:52:36,602][106225] Updated weights for policy 1, policy_version 1062761 (0.0010) [2023-12-28 02:52:36,669][106225] Updated weights for policy 1, policy_version 1062771 (0.0010) [2023-12-28 02:52:36,735][106226] Updated weights for policy 0, policy_version 1060070 (0.0009) [2023-12-28 02:52:36,789][106226] Updated weights for policy 0, policy_version 1060080 (0.0010) [2023-12-28 02:52:36,842][106226] Updated weights for policy 0, policy_version 1060090 (0.0009) [2023-12-28 02:52:37,229][106225] Updated weights for policy 1, policy_version 1062781 (0.0010) [2023-12-28 02:52:37,296][106225] Updated weights for policy 1, policy_version 1062791 (0.0011) [2023-12-28 02:52:37,342][106225] Updated weights for policy 1, policy_version 1062801 (0.0005) [2023-12-28 02:52:37,600][106226] Updated weights for policy 0, policy_version 1060100 (0.0009) [2023-12-28 02:52:37,648][106226] Updated weights for policy 0, policy_version 1060110 (0.0010) [2023-12-28 02:52:37,711][106226] Updated weights for policy 0, policy_version 1060120 (0.0011) [2023-12-28 02:52:38,005][106225] Updated weights for policy 1, policy_version 1062811 (0.0005) [2023-12-28 02:52:38,068][106225] Updated weights for policy 1, policy_version 1062821 (0.0006) [2023-12-28 02:52:38,117][106225] Updated weights for policy 1, policy_version 1062831 (0.0005) [2023-12-28 02:52:38,427][106226] Updated weights for policy 0, policy_version 1060130 (0.0010) [2023-12-28 02:52:38,492][106226] Updated weights for policy 0, policy_version 1060140 (0.0007) [2023-12-28 02:52:38,558][106226] Updated weights for policy 0, policy_version 1060150 (0.0007) [2023-12-28 02:52:38,616][106226] Updated weights for policy 0, policy_version 1060160 (0.0008) [2023-12-28 02:52:38,754][106225] Updated weights for policy 1, policy_version 1062841 (0.0010) [2023-12-28 02:52:38,823][106225] Updated weights for policy 1, policy_version 1062851 (0.0006) [2023-12-28 02:52:38,914][106225] Updated weights for policy 1, policy_version 1062861 (0.0010) [2023-12-28 02:52:38,967][106225] Updated weights for policy 1, policy_version 1062871 (0.0008) [2023-12-28 02:52:39,214][106226] Updated weights for policy 0, policy_version 1060170 (0.0008) [2023-12-28 02:52:39,282][106226] Updated weights for policy 0, policy_version 1060180 (0.0008) [2023-12-28 02:52:39,344][106226] Updated weights for policy 0, policy_version 1060190 (0.0008) [2023-12-28 02:52:39,658][106225] Updated weights for policy 1, policy_version 1062881 (0.0008) [2023-12-28 02:52:39,717][106225] Updated weights for policy 1, policy_version 1062891 (0.0008) [2023-12-28 02:52:39,776][106225] Updated weights for policy 1, policy_version 1062901 (0.0008) [2023-12-28 02:52:40,100][106226] Updated weights for policy 0, policy_version 1060200 (0.0008) [2023-12-28 02:52:40,157][106226] Updated weights for policy 0, policy_version 1060210 (0.0009) [2023-12-28 02:52:40,210][106226] Updated weights for policy 0, policy_version 1060220 (0.0009) [2023-12-28 02:52:40,441][106225] Updated weights for policy 1, policy_version 1062911 (0.0006) [2023-12-28 02:52:40,506][106225] Updated weights for policy 1, policy_version 1062921 (0.0005) [2023-12-28 02:52:40,569][106225] Updated weights for policy 1, policy_version 1062931 (0.0006) [2023-12-28 02:52:40,973][106226] Updated weights for policy 0, policy_version 1060230 (0.0010) [2023-12-28 02:52:41,041][106226] Updated weights for policy 0, policy_version 1060240 (0.0007) [2023-12-28 02:52:41,107][106226] Updated weights for policy 0, policy_version 1060250 (0.0007) [2023-12-28 02:52:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 543637504. Throughput: 0: 9969.8, 1: 9960.7. Samples: 543607236. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:41,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.937')] [2023-12-28 02:52:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001060256_271482880.pth... [2023-12-28 02:52:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001062936_272154624.pth... [2023-12-28 02:52:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001061784_271859712.pth [2023-12-28 02:52:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001059072_271179776.pth [2023-12-28 02:52:41,250][106225] Updated weights for policy 1, policy_version 1062941 (0.0007) [2023-12-28 02:52:41,319][106225] Updated weights for policy 1, policy_version 1062951 (0.0007) [2023-12-28 02:52:41,399][106225] Updated weights for policy 1, policy_version 1062961 (0.0008) [2023-12-28 02:52:41,830][106226] Updated weights for policy 0, policy_version 1060260 (0.0008) [2023-12-28 02:52:41,892][106226] Updated weights for policy 0, policy_version 1060270 (0.0008) [2023-12-28 02:52:41,959][106226] Updated weights for policy 0, policy_version 1060280 (0.0009) [2023-12-28 02:52:42,189][106225] Updated weights for policy 1, policy_version 1062971 (0.0008) [2023-12-28 02:52:42,245][106225] Updated weights for policy 1, policy_version 1062981 (0.0009) [2023-12-28 02:52:42,310][106225] Updated weights for policy 1, policy_version 1062991 (0.0008) [2023-12-28 02:52:42,704][106226] Updated weights for policy 0, policy_version 1060290 (0.0008) [2023-12-28 02:52:42,769][106226] Updated weights for policy 0, policy_version 1060300 (0.0008) [2023-12-28 02:52:42,830][106226] Updated weights for policy 0, policy_version 1060310 (0.0009) [2023-12-28 02:52:42,893][106226] Updated weights for policy 0, policy_version 1060320 (0.0009) [2023-12-28 02:52:43,055][106225] Updated weights for policy 1, policy_version 1063001 (0.0008) [2023-12-28 02:52:43,105][106225] Updated weights for policy 1, policy_version 1063011 (0.0008) [2023-12-28 02:52:43,161][106225] Updated weights for policy 1, policy_version 1063021 (0.0008) [2023-12-28 02:52:43,221][106225] Updated weights for policy 1, policy_version 1063031 (0.0008) [2023-12-28 02:52:43,570][106226] Updated weights for policy 0, policy_version 1060330 (0.0008) [2023-12-28 02:52:43,630][106226] Updated weights for policy 0, policy_version 1060340 (0.0008) [2023-12-28 02:52:43,679][106226] Updated weights for policy 0, policy_version 1060350 (0.0008) [2023-12-28 02:52:43,893][106225] Updated weights for policy 1, policy_version 1063041 (0.0007) [2023-12-28 02:52:43,947][106225] Updated weights for policy 1, policy_version 1063051 (0.0009) [2023-12-28 02:52:43,994][106225] Updated weights for policy 1, policy_version 1063061 (0.0008) [2023-12-28 02:52:44,458][106226] Updated weights for policy 0, policy_version 1060360 (0.0009) [2023-12-28 02:52:44,504][106226] Updated weights for policy 0, policy_version 1060370 (0.0008) [2023-12-28 02:52:44,562][106226] Updated weights for policy 0, policy_version 1060380 (0.0009) [2023-12-28 02:52:44,652][106225] Updated weights for policy 1, policy_version 1063071 (0.0005) [2023-12-28 02:52:44,711][106225] Updated weights for policy 1, policy_version 1063081 (0.0005) [2023-12-28 02:52:44,771][106225] Updated weights for policy 1, policy_version 1063091 (0.0006) [2023-12-28 02:52:45,362][106225] Updated weights for policy 1, policy_version 1063101 (0.0006) [2023-12-28 02:52:45,393][106226] Updated weights for policy 0, policy_version 1060390 (0.0008) [2023-12-28 02:52:45,423][106225] Updated weights for policy 1, policy_version 1063111 (0.0006) [2023-12-28 02:52:45,456][106226] Updated weights for policy 0, policy_version 1060400 (0.0008) [2023-12-28 02:52:45,487][106225] Updated weights for policy 1, policy_version 1063121 (0.0005) [2023-12-28 02:52:45,519][106226] Updated weights for policy 0, policy_version 1060410 (0.0008) [2023-12-28 02:52:46,084][106226] Updated weights for policy 0, policy_version 1060420 (0.0007) [2023-12-28 02:52:46,092][106225] Updated weights for policy 1, policy_version 1063131 (0.0006) [2023-12-28 02:52:46,141][106226] Updated weights for policy 0, policy_version 1060430 (0.0005) [2023-12-28 02:52:46,150][106225] Updated weights for policy 1, policy_version 1063141 (0.0006) [2023-12-28 02:52:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 543727616. Throughput: 0: 9913.3, 1: 9971.6. Samples: 543722452. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:46,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.883')] [2023-12-28 02:52:46,192][106226] Updated weights for policy 0, policy_version 1060440 (0.0005) [2023-12-28 02:52:46,209][106225] Updated weights for policy 1, policy_version 1063151 (0.0006) [2023-12-28 02:52:46,801][106226] Updated weights for policy 0, policy_version 1060450 (0.0006) [2023-12-28 02:52:46,858][106226] Updated weights for policy 0, policy_version 1060460 (0.0007) [2023-12-28 02:52:46,913][106225] Updated weights for policy 1, policy_version 1063161 (0.0006) [2023-12-28 02:52:46,920][106226] Updated weights for policy 0, policy_version 1060470 (0.0005) [2023-12-28 02:52:46,969][106225] Updated weights for policy 1, policy_version 1063171 (0.0008) [2023-12-28 02:52:46,971][106226] Updated weights for policy 0, policy_version 1060480 (0.0005) [2023-12-28 02:52:47,015][106225] Updated weights for policy 1, policy_version 1063181 (0.0007) [2023-12-28 02:52:47,073][106225] Updated weights for policy 1, policy_version 1063191 (0.0005) [2023-12-28 02:52:47,646][106226] Updated weights for policy 0, policy_version 1060490 (0.0008) [2023-12-28 02:52:47,695][106225] Updated weights for policy 1, policy_version 1063201 (0.0007) [2023-12-28 02:52:47,697][106226] Updated weights for policy 0, policy_version 1060500 (0.0006) [2023-12-28 02:52:47,744][106225] Updated weights for policy 1, policy_version 1063211 (0.0008) [2023-12-28 02:52:47,747][106226] Updated weights for policy 0, policy_version 1060510 (0.0008) [2023-12-28 02:52:47,794][106225] Updated weights for policy 1, policy_version 1063221 (0.0009) [2023-12-28 02:52:48,444][106226] Updated weights for policy 0, policy_version 1060520 (0.0010) [2023-12-28 02:52:48,516][106226] Updated weights for policy 0, policy_version 1060530 (0.0011) [2023-12-28 02:52:48,567][106225] Updated weights for policy 1, policy_version 1063231 (0.0006) [2023-12-28 02:52:48,576][106226] Updated weights for policy 0, policy_version 1060540 (0.0010) [2023-12-28 02:52:48,632][106225] Updated weights for policy 1, policy_version 1063241 (0.0007) [2023-12-28 02:52:48,694][106225] Updated weights for policy 1, policy_version 1063251 (0.0007) [2023-12-28 02:52:49,290][106226] Updated weights for policy 0, policy_version 1060550 (0.0008) [2023-12-28 02:52:49,357][106226] Updated weights for policy 0, policy_version 1060560 (0.0009) [2023-12-28 02:52:49,371][106225] Updated weights for policy 1, policy_version 1063261 (0.0008) [2023-12-28 02:52:49,424][106226] Updated weights for policy 0, policy_version 1060570 (0.0009) [2023-12-28 02:52:49,438][106225] Updated weights for policy 1, policy_version 1063271 (0.0007) [2023-12-28 02:52:49,493][106225] Updated weights for policy 1, policy_version 1063281 (0.0007) [2023-12-28 02:52:50,136][106225] Updated weights for policy 1, policy_version 1063291 (0.0009) [2023-12-28 02:52:50,195][106225] Updated weights for policy 1, policy_version 1063301 (0.0008) [2023-12-28 02:52:50,204][106226] Updated weights for policy 0, policy_version 1060580 (0.0007) [2023-12-28 02:52:50,260][106225] Updated weights for policy 1, policy_version 1063311 (0.0007) [2023-12-28 02:52:50,261][106226] Updated weights for policy 0, policy_version 1060590 (0.0008) [2023-12-28 02:52:50,322][106226] Updated weights for policy 0, policy_version 1060600 (0.0008) [2023-12-28 02:52:50,988][106226] Updated weights for policy 0, policy_version 1060610 (0.0009) [2023-12-28 02:52:51,009][106225] Updated weights for policy 1, policy_version 1063321 (0.0005) [2023-12-28 02:52:51,055][106226] Updated weights for policy 0, policy_version 1060620 (0.0007) [2023-12-28 02:52:51,079][106225] Updated weights for policy 1, policy_version 1063331 (0.0006) [2023-12-28 02:52:51,117][106226] Updated weights for policy 0, policy_version 1060630 (0.0008) [2023-12-28 02:52:51,146][106225] Updated weights for policy 1, policy_version 1063341 (0.0007) [2023-12-28 02:52:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 543825920. Throughput: 0: 9950.9, 1: 9978.6. Samples: 543844388. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:51,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.733')] [2023-12-28 02:52:51,183][106226] Updated weights for policy 0, policy_version 1060640 (0.0007) [2023-12-28 02:52:51,210][106225] Updated weights for policy 1, policy_version 1063351 (0.0007) [2023-12-28 02:52:51,907][106226] Updated weights for policy 0, policy_version 1060650 (0.0008) [2023-12-28 02:52:51,977][106226] Updated weights for policy 0, policy_version 1060660 (0.0008) [2023-12-28 02:52:51,983][106225] Updated weights for policy 1, policy_version 1063361 (0.0007) [2023-12-28 02:52:52,038][106226] Updated weights for policy 0, policy_version 1060670 (0.0008) [2023-12-28 02:52:52,051][106225] Updated weights for policy 1, policy_version 1063371 (0.0008) [2023-12-28 02:52:52,113][106225] Updated weights for policy 1, policy_version 1063381 (0.0009) [2023-12-28 02:52:52,677][106226] Updated weights for policy 0, policy_version 1060680 (0.0010) [2023-12-28 02:52:52,734][106226] Updated weights for policy 0, policy_version 1060690 (0.0010) [2023-12-28 02:52:52,795][106226] Updated weights for policy 0, policy_version 1060700 (0.0011) [2023-12-28 02:52:52,867][106225] Updated weights for policy 1, policy_version 1063391 (0.0008) [2023-12-28 02:52:52,924][106225] Updated weights for policy 1, policy_version 1063401 (0.0007) [2023-12-28 02:52:52,980][106225] Updated weights for policy 1, policy_version 1063411 (0.0008) [2023-12-28 02:52:53,478][106226] Updated weights for policy 0, policy_version 1060710 (0.0008) [2023-12-28 02:52:53,541][106226] Updated weights for policy 0, policy_version 1060720 (0.0008) [2023-12-28 02:52:53,595][106226] Updated weights for policy 0, policy_version 1060730 (0.0009) [2023-12-28 02:52:53,713][106225] Updated weights for policy 1, policy_version 1063421 (0.0008) [2023-12-28 02:52:53,770][106225] Updated weights for policy 1, policy_version 1063431 (0.0008) [2023-12-28 02:52:53,825][106225] Updated weights for policy 1, policy_version 1063441 (0.0008) [2023-12-28 02:52:54,278][106226] Updated weights for policy 0, policy_version 1060740 (0.0009) [2023-12-28 02:52:54,326][106226] Updated weights for policy 0, policy_version 1060750 (0.0009) [2023-12-28 02:52:54,387][106226] Updated weights for policy 0, policy_version 1060760 (0.0009) [2023-12-28 02:52:54,543][106225] Updated weights for policy 1, policy_version 1063451 (0.0008) [2023-12-28 02:52:54,593][106225] Updated weights for policy 1, policy_version 1063461 (0.0009) [2023-12-28 02:52:54,639][106225] Updated weights for policy 1, policy_version 1063471 (0.0009) [2023-12-28 02:52:55,043][106226] Updated weights for policy 0, policy_version 1060770 (0.0006) [2023-12-28 02:52:55,104][106226] Updated weights for policy 0, policy_version 1060780 (0.0009) [2023-12-28 02:52:55,160][106226] Updated weights for policy 0, policy_version 1060790 (0.0009) [2023-12-28 02:52:55,218][106226] Updated weights for policy 0, policy_version 1060800 (0.0009) [2023-12-28 02:52:55,380][106225] Updated weights for policy 1, policy_version 1063481 (0.0008) [2023-12-28 02:52:55,449][106225] Updated weights for policy 1, policy_version 1063491 (0.0006) [2023-12-28 02:52:55,500][106225] Updated weights for policy 1, policy_version 1063501 (0.0009) [2023-12-28 02:52:55,556][106225] Updated weights for policy 1, policy_version 1063511 (0.0008) [2023-12-28 02:52:55,958][106226] Updated weights for policy 0, policy_version 1060810 (0.0008) [2023-12-28 02:52:56,007][106226] Updated weights for policy 0, policy_version 1060820 (0.0009) [2023-12-28 02:52:56,067][106226] Updated weights for policy 0, policy_version 1060830 (0.0005) [2023-12-28 02:52:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 543932416. Throughput: 0: 9898.5, 1: 9904.9. Samples: 543901784. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:52:56,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-4.814')] [2023-12-28 02:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001060832_271630336.pth... [2023-12-28 02:52:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001063512_272302080.pth... [2023-12-28 02:52:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001059648_271327232.pth [2023-12-28 02:52:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001062360_272007168.pth [2023-12-28 02:52:56,245][106225] Updated weights for policy 1, policy_version 1063521 (0.0008) [2023-12-28 02:52:56,308][106225] Updated weights for policy 1, policy_version 1063531 (0.0009) [2023-12-28 02:52:56,368][106225] Updated weights for policy 1, policy_version 1063541 (0.0008) [2023-12-28 02:52:56,721][106226] Updated weights for policy 0, policy_version 1060840 (0.0008) [2023-12-28 02:52:56,783][106226] Updated weights for policy 0, policy_version 1060850 (0.0009) [2023-12-28 02:52:56,852][106226] Updated weights for policy 0, policy_version 1060860 (0.0009) [2023-12-28 02:52:57,111][106225] Updated weights for policy 1, policy_version 1063551 (0.0008) [2023-12-28 02:52:57,170][106225] Updated weights for policy 1, policy_version 1063561 (0.0009) [2023-12-28 02:52:57,234][106225] Updated weights for policy 1, policy_version 1063571 (0.0008) [2023-12-28 02:52:57,529][106226] Updated weights for policy 0, policy_version 1060870 (0.0008) [2023-12-28 02:52:57,594][106226] Updated weights for policy 0, policy_version 1060880 (0.0009) [2023-12-28 02:52:57,656][106226] Updated weights for policy 0, policy_version 1060890 (0.0008) [2023-12-28 02:52:57,975][106225] Updated weights for policy 1, policy_version 1063581 (0.0008) [2023-12-28 02:52:58,040][106225] Updated weights for policy 1, policy_version 1063591 (0.0007) [2023-12-28 02:52:58,104][106225] Updated weights for policy 1, policy_version 1063601 (0.0005) [2023-12-28 02:52:58,410][106226] Updated weights for policy 0, policy_version 1060900 (0.0008) [2023-12-28 02:52:58,473][106226] Updated weights for policy 0, policy_version 1060910 (0.0008) [2023-12-28 02:52:58,537][106226] Updated weights for policy 0, policy_version 1060920 (0.0008) [2023-12-28 02:52:58,847][106225] Updated weights for policy 1, policy_version 1063611 (0.0008) [2023-12-28 02:52:58,918][106225] Updated weights for policy 1, policy_version 1063621 (0.0008) [2023-12-28 02:52:58,976][106225] Updated weights for policy 1, policy_version 1063631 (0.0008) [2023-12-28 02:52:59,309][106226] Updated weights for policy 0, policy_version 1060930 (0.0008) [2023-12-28 02:52:59,374][106226] Updated weights for policy 0, policy_version 1060940 (0.0008) [2023-12-28 02:52:59,420][106226] Updated weights for policy 0, policy_version 1060950 (0.0008) [2023-12-28 02:52:59,473][106226] Updated weights for policy 0, policy_version 1060960 (0.0008) [2023-12-28 02:52:59,731][106225] Updated weights for policy 1, policy_version 1063641 (0.0008) [2023-12-28 02:52:59,791][106225] Updated weights for policy 1, policy_version 1063651 (0.0010) [2023-12-28 02:52:59,852][106225] Updated weights for policy 1, policy_version 1063661 (0.0011) [2023-12-28 02:52:59,918][106225] Updated weights for policy 1, policy_version 1063671 (0.0010) [2023-12-28 02:53:00,257][106226] Updated weights for policy 0, policy_version 1060970 (0.0009) [2023-12-28 02:53:00,320][106226] Updated weights for policy 0, policy_version 1060980 (0.0008) [2023-12-28 02:53:00,377][106226] Updated weights for policy 0, policy_version 1060990 (0.0008) [2023-12-28 02:53:00,648][106225] Updated weights for policy 1, policy_version 1063681 (0.0006) [2023-12-28 02:53:00,709][106225] Updated weights for policy 1, policy_version 1063691 (0.0005) [2023-12-28 02:53:00,777][106225] Updated weights for policy 1, policy_version 1063701 (0.0005) [2023-12-28 02:53:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 544022528. Throughput: 0: 9836.1, 1: 9866.6. Samples: 544016128. Policy #0 lag: (min: 19.0, avg: 25.8, max: 51.0) [2023-12-28 02:53:01,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-5.144')] [2023-12-28 02:53:01,197][106226] Updated weights for policy 0, policy_version 1061000 (0.0009) [2023-12-28 02:53:01,261][106226] Updated weights for policy 0, policy_version 1061010 (0.0008) [2023-12-28 02:53:01,330][106226] Updated weights for policy 0, policy_version 1061020 (0.0007) [2023-12-28 02:53:01,377][106225] Updated weights for policy 1, policy_version 1063711 (0.0008) [2023-12-28 02:53:01,442][106225] Updated weights for policy 1, policy_version 1063721 (0.0008) [2023-12-28 02:53:01,508][106225] Updated weights for policy 1, policy_version 1063731 (0.0010) [2023-12-28 02:53:02,004][106226] Updated weights for policy 0, policy_version 1061030 (0.0008) [2023-12-28 02:53:02,061][106226] Updated weights for policy 0, policy_version 1061040 (0.0008) [2023-12-28 02:53:02,121][106226] Updated weights for policy 0, policy_version 1061050 (0.0009) [2023-12-28 02:53:02,172][106225] Updated weights for policy 1, policy_version 1063741 (0.0007) [2023-12-28 02:53:02,234][106225] Updated weights for policy 1, policy_version 1063751 (0.0008) [2023-12-28 02:53:02,294][106225] Updated weights for policy 1, policy_version 1063761 (0.0008) [2023-12-28 02:53:02,842][106226] Updated weights for policy 0, policy_version 1061060 (0.0007) [2023-12-28 02:53:02,907][106226] Updated weights for policy 0, policy_version 1061070 (0.0005) [2023-12-28 02:53:02,968][106226] Updated weights for policy 0, policy_version 1061080 (0.0005) [2023-12-28 02:53:02,999][106225] Updated weights for policy 1, policy_version 1063771 (0.0009) [2023-12-28 02:53:03,057][106225] Updated weights for policy 1, policy_version 1063781 (0.0009) [2023-12-28 02:53:03,110][106225] Updated weights for policy 1, policy_version 1063791 (0.0008) [2023-12-28 02:53:03,469][106226] Updated weights for policy 0, policy_version 1061090 (0.0005) [2023-12-28 02:53:03,526][106226] Updated weights for policy 0, policy_version 1061100 (0.0005) [2023-12-28 02:53:03,574][106226] Updated weights for policy 0, policy_version 1061110 (0.0006) [2023-12-28 02:53:03,624][106226] Updated weights for policy 0, policy_version 1061120 (0.0008) [2023-12-28 02:53:03,910][106225] Updated weights for policy 1, policy_version 1063801 (0.0007) [2023-12-28 02:53:03,974][106225] Updated weights for policy 1, policy_version 1063811 (0.0008) [2023-12-28 02:53:04,033][106225] Updated weights for policy 1, policy_version 1063821 (0.0008) [2023-12-28 02:53:04,093][106225] Updated weights for policy 1, policy_version 1063831 (0.0008) [2023-12-28 02:53:04,259][106226] Updated weights for policy 0, policy_version 1061130 (0.0009) [2023-12-28 02:53:04,326][106226] Updated weights for policy 0, policy_version 1061140 (0.0009) [2023-12-28 02:53:04,381][106226] Updated weights for policy 0, policy_version 1061150 (0.0008) [2023-12-28 02:53:04,818][106225] Updated weights for policy 1, policy_version 1063841 (0.0010) [2023-12-28 02:53:04,870][106225] Updated weights for policy 1, policy_version 1063851 (0.0006) [2023-12-28 02:53:04,925][106225] Updated weights for policy 1, policy_version 1063861 (0.0006) [2023-12-28 02:53:05,114][106226] Updated weights for policy 0, policy_version 1061160 (0.0006) [2023-12-28 02:53:05,161][106226] Updated weights for policy 0, policy_version 1061170 (0.0008) [2023-12-28 02:53:05,216][106226] Updated weights for policy 0, policy_version 1061180 (0.0008) [2023-12-28 02:53:05,612][106225] Updated weights for policy 1, policy_version 1063871 (0.0009) [2023-12-28 02:53:05,665][106225] Updated weights for policy 1, policy_version 1063881 (0.0010) [2023-12-28 02:53:05,720][106225] Updated weights for policy 1, policy_version 1063891 (0.0010) [2023-12-28 02:53:05,941][106226] Updated weights for policy 0, policy_version 1061190 (0.0008) [2023-12-28 02:53:05,999][106226] Updated weights for policy 0, policy_version 1061200 (0.0009) [2023-12-28 02:53:06,057][106226] Updated weights for policy 0, policy_version 1061210 (0.0008) [2023-12-28 02:53:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 544129024. Throughput: 0: 9816.7, 1: 9874.7. Samples: 544134240. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:06,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.844')] [2023-12-28 02:53:06,478][106225] Updated weights for policy 1, policy_version 1063901 (0.0008) [2023-12-28 02:53:06,548][106225] Updated weights for policy 1, policy_version 1063911 (0.0006) [2023-12-28 02:53:06,609][106225] Updated weights for policy 1, policy_version 1063921 (0.0010) [2023-12-28 02:53:06,762][106226] Updated weights for policy 0, policy_version 1061220 (0.0008) [2023-12-28 02:53:06,827][106226] Updated weights for policy 0, policy_version 1061230 (0.0008) [2023-12-28 02:53:06,897][106226] Updated weights for policy 0, policy_version 1061240 (0.0009) [2023-12-28 02:53:07,281][106225] Updated weights for policy 1, policy_version 1063931 (0.0010) [2023-12-28 02:53:07,335][106225] Updated weights for policy 1, policy_version 1063941 (0.0010) [2023-12-28 02:53:07,384][106225] Updated weights for policy 1, policy_version 1063951 (0.0007) [2023-12-28 02:53:07,477][106226] Updated weights for policy 0, policy_version 1061250 (0.0007) [2023-12-28 02:53:07,526][106226] Updated weights for policy 0, policy_version 1061260 (0.0007) [2023-12-28 02:53:07,578][106226] Updated weights for policy 0, policy_version 1061270 (0.0008) [2023-12-28 02:53:07,637][106226] Updated weights for policy 0, policy_version 1061280 (0.0008) [2023-12-28 02:53:08,076][106225] Updated weights for policy 1, policy_version 1063961 (0.0008) [2023-12-28 02:53:08,133][106225] Updated weights for policy 1, policy_version 1063971 (0.0005) [2023-12-28 02:53:08,184][106225] Updated weights for policy 1, policy_version 1063981 (0.0005) [2023-12-28 02:53:08,236][106225] Updated weights for policy 1, policy_version 1063991 (0.0005) [2023-12-28 02:53:08,365][106226] Updated weights for policy 0, policy_version 1061290 (0.0007) [2023-12-28 02:53:08,414][106226] Updated weights for policy 0, policy_version 1061300 (0.0006) [2023-12-28 02:53:08,469][106226] Updated weights for policy 0, policy_version 1061310 (0.0008) [2023-12-28 02:53:08,945][106225] Updated weights for policy 1, policy_version 1064001 (0.0008) [2023-12-28 02:53:08,999][106225] Updated weights for policy 1, policy_version 1064011 (0.0009) [2023-12-28 02:53:09,051][106225] Updated weights for policy 1, policy_version 1064021 (0.0008) [2023-12-28 02:53:09,139][106226] Updated weights for policy 0, policy_version 1061320 (0.0009) [2023-12-28 02:53:09,197][106226] Updated weights for policy 0, policy_version 1061330 (0.0008) [2023-12-28 02:53:09,259][106226] Updated weights for policy 0, policy_version 1061340 (0.0008) [2023-12-28 02:53:09,848][106225] Updated weights for policy 1, policy_version 1064031 (0.0009) [2023-12-28 02:53:09,912][106225] Updated weights for policy 1, policy_version 1064041 (0.0008) [2023-12-28 02:53:09,979][106225] Updated weights for policy 1, policy_version 1064051 (0.0008) [2023-12-28 02:53:10,058][106226] Updated weights for policy 0, policy_version 1061350 (0.0009) [2023-12-28 02:53:10,126][106226] Updated weights for policy 0, policy_version 1061360 (0.0009) [2023-12-28 02:53:10,193][106226] Updated weights for policy 0, policy_version 1061370 (0.0009) [2023-12-28 02:53:10,677][106225] Updated weights for policy 1, policy_version 1064061 (0.0007) [2023-12-28 02:53:10,733][106225] Updated weights for policy 1, policy_version 1064071 (0.0009) [2023-12-28 02:53:10,796][106225] Updated weights for policy 1, policy_version 1064081 (0.0010) [2023-12-28 02:53:10,917][106226] Updated weights for policy 0, policy_version 1061380 (0.0010) [2023-12-28 02:53:10,983][106226] Updated weights for policy 0, policy_version 1061390 (0.0011) [2023-12-28 02:53:11,051][106226] Updated weights for policy 0, policy_version 1061400 (0.0011) [2023-12-28 02:53:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 544227328. Throughput: 0: 9892.3, 1: 9901.9. Samples: 544195532. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:11,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-5.071')] [2023-12-28 02:53:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001064088_272449536.pth... [2023-12-28 02:53:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001061408_271777792.pth... [2023-12-28 02:53:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001060256_271482880.pth [2023-12-28 02:53:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001062936_272154624.pth [2023-12-28 02:53:11,581][106225] Updated weights for policy 1, policy_version 1064091 (0.0010) [2023-12-28 02:53:11,651][106225] Updated weights for policy 1, policy_version 1064101 (0.0010) [2023-12-28 02:53:11,716][106225] Updated weights for policy 1, policy_version 1064111 (0.0010) [2023-12-28 02:53:11,783][106226] Updated weights for policy 0, policy_version 1061410 (0.0010) [2023-12-28 02:53:11,830][106226] Updated weights for policy 0, policy_version 1061420 (0.0011) [2023-12-28 02:53:11,889][106226] Updated weights for policy 0, policy_version 1061430 (0.0009) [2023-12-28 02:53:11,950][106226] Updated weights for policy 0, policy_version 1061440 (0.0011) [2023-12-28 02:53:12,460][106225] Updated weights for policy 1, policy_version 1064121 (0.0009) [2023-12-28 02:53:12,530][106225] Updated weights for policy 1, policy_version 1064131 (0.0008) [2023-12-28 02:53:12,591][106225] Updated weights for policy 1, policy_version 1064141 (0.0010) [2023-12-28 02:53:12,653][106225] Updated weights for policy 1, policy_version 1064151 (0.0009) [2023-12-28 02:53:12,719][106226] Updated weights for policy 0, policy_version 1061450 (0.0010) [2023-12-28 02:53:12,772][106226] Updated weights for policy 0, policy_version 1061460 (0.0009) [2023-12-28 02:53:12,836][106226] Updated weights for policy 0, policy_version 1061470 (0.0008) [2023-12-28 02:53:13,215][106225] Updated weights for policy 1, policy_version 1064161 (0.0005) [2023-12-28 02:53:13,277][106225] Updated weights for policy 1, policy_version 1064171 (0.0006) [2023-12-28 02:53:13,331][106225] Updated weights for policy 1, policy_version 1064181 (0.0005) [2023-12-28 02:53:13,673][106226] Updated weights for policy 0, policy_version 1061480 (0.0006) [2023-12-28 02:53:13,732][106226] Updated weights for policy 0, policy_version 1061490 (0.0008) [2023-12-28 02:53:13,791][106226] Updated weights for policy 0, policy_version 1061500 (0.0005) [2023-12-28 02:53:13,846][106225] Updated weights for policy 1, policy_version 1064191 (0.0005) [2023-12-28 02:53:13,896][106225] Updated weights for policy 1, policy_version 1064201 (0.0005) [2023-12-28 02:53:13,947][106225] Updated weights for policy 1, policy_version 1064211 (0.0007) [2023-12-28 02:53:14,343][106226] Updated weights for policy 0, policy_version 1061510 (0.0006) [2023-12-28 02:53:14,403][106226] Updated weights for policy 0, policy_version 1061520 (0.0005) [2023-12-28 02:53:14,463][106226] Updated weights for policy 0, policy_version 1061530 (0.0006) [2023-12-28 02:53:14,544][106225] Updated weights for policy 1, policy_version 1064221 (0.0006) [2023-12-28 02:53:14,592][106225] Updated weights for policy 1, policy_version 1064231 (0.0009) [2023-12-28 02:53:14,641][106225] Updated weights for policy 1, policy_version 1064241 (0.0008) [2023-12-28 02:53:15,126][106226] Updated weights for policy 0, policy_version 1061540 (0.0006) [2023-12-28 02:53:15,187][106226] Updated weights for policy 0, policy_version 1061550 (0.0006) [2023-12-28 02:53:15,255][106226] Updated weights for policy 0, policy_version 1061560 (0.0007) [2023-12-28 02:53:15,326][106225] Updated weights for policy 1, policy_version 1064251 (0.0009) [2023-12-28 02:53:15,376][106225] Updated weights for policy 1, policy_version 1064261 (0.0009) [2023-12-28 02:53:15,431][106225] Updated weights for policy 1, policy_version 1064271 (0.0005) [2023-12-28 02:53:15,910][106226] Updated weights for policy 0, policy_version 1061570 (0.0008) [2023-12-28 02:53:15,957][106226] Updated weights for policy 0, policy_version 1061580 (0.0008) [2023-12-28 02:53:16,013][106226] Updated weights for policy 0, policy_version 1061590 (0.0005) [2023-12-28 02:53:16,021][106225] Updated weights for policy 1, policy_version 1064281 (0.0005) [2023-12-28 02:53:16,072][106225] Updated weights for policy 1, policy_version 1064291 (0.0005) [2023-12-28 02:53:16,077][106226] Updated weights for policy 0, policy_version 1061600 (0.0007) [2023-12-28 02:53:16,121][106225] Updated weights for policy 1, policy_version 1064301 (0.0005) [2023-12-28 02:53:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 544325632. Throughput: 0: 9880.4, 1: 9919.3. Samples: 544313844. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:16,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.082')] [2023-12-28 02:53:16,179][106225] Updated weights for policy 1, policy_version 1064311 (0.0007) [2023-12-28 02:53:16,716][106226] Updated weights for policy 0, policy_version 1061610 (0.0005) [2023-12-28 02:53:16,768][106226] Updated weights for policy 0, policy_version 1061620 (0.0007) [2023-12-28 02:53:16,831][106226] Updated weights for policy 0, policy_version 1061630 (0.0007) [2023-12-28 02:53:16,843][106225] Updated weights for policy 1, policy_version 1064321 (0.0010) [2023-12-28 02:53:16,900][106225] Updated weights for policy 1, policy_version 1064331 (0.0010) [2023-12-28 02:53:16,959][106225] Updated weights for policy 1, policy_version 1064341 (0.0010) [2023-12-28 02:53:17,419][106226] Updated weights for policy 0, policy_version 1061640 (0.0009) [2023-12-28 02:53:17,465][106226] Updated weights for policy 0, policy_version 1061650 (0.0008) [2023-12-28 02:53:17,510][106226] Updated weights for policy 0, policy_version 1061660 (0.0007) [2023-12-28 02:53:17,663][106225] Updated weights for policy 1, policy_version 1064351 (0.0010) [2023-12-28 02:53:17,717][106225] Updated weights for policy 1, policy_version 1064361 (0.0010) [2023-12-28 02:53:17,772][106225] Updated weights for policy 1, policy_version 1064371 (0.0010) [2023-12-28 02:53:18,207][106226] Updated weights for policy 0, policy_version 1061670 (0.0009) [2023-12-28 02:53:18,261][106226] Updated weights for policy 0, policy_version 1061680 (0.0011) [2023-12-28 02:53:18,322][106226] Updated weights for policy 0, policy_version 1061690 (0.0010) [2023-12-28 02:53:18,463][106225] Updated weights for policy 1, policy_version 1064381 (0.0008) [2023-12-28 02:53:18,532][106225] Updated weights for policy 1, policy_version 1064391 (0.0010) [2023-12-28 02:53:18,589][106225] Updated weights for policy 1, policy_version 1064401 (0.0010) [2023-12-28 02:53:19,012][106226] Updated weights for policy 0, policy_version 1061701 (0.0008) [2023-12-28 02:53:19,058][106226] Updated weights for policy 0, policy_version 1061711 (0.0005) [2023-12-28 02:53:19,102][106226] Updated weights for policy 0, policy_version 1061721 (0.0005) [2023-12-28 02:53:19,237][106225] Updated weights for policy 1, policy_version 1064411 (0.0010) [2023-12-28 02:53:19,299][106225] Updated weights for policy 1, policy_version 1064422 (0.0008) [2023-12-28 02:53:19,365][106225] Updated weights for policy 1, policy_version 1064432 (0.0008) [2023-12-28 02:53:19,839][106226] Updated weights for policy 0, policy_version 1061731 (0.0007) [2023-12-28 02:53:19,904][106226] Updated weights for policy 0, policy_version 1061741 (0.0008) [2023-12-28 02:53:19,971][106226] Updated weights for policy 0, policy_version 1061751 (0.0008) [2023-12-28 02:53:20,089][106225] Updated weights for policy 1, policy_version 1064442 (0.0009) [2023-12-28 02:53:20,169][106225] Updated weights for policy 1, policy_version 1064452 (0.0007) [2023-12-28 02:53:20,233][106225] Updated weights for policy 1, policy_version 1064462 (0.0009) [2023-12-28 02:53:20,295][106225] Updated weights for policy 1, policy_version 1064472 (0.0009) [2023-12-28 02:53:20,738][106226] Updated weights for policy 0, policy_version 1061761 (0.0009) [2023-12-28 02:53:20,796][106226] Updated weights for policy 0, policy_version 1061771 (0.0009) [2023-12-28 02:53:20,849][106226] Updated weights for policy 0, policy_version 1061781 (0.0008) [2023-12-28 02:53:20,906][106226] Updated weights for policy 0, policy_version 1061791 (0.0008) [2023-12-28 02:53:21,050][106225] Updated weights for policy 1, policy_version 1064482 (0.0008) [2023-12-28 02:53:21,114][106225] Updated weights for policy 1, policy_version 1064492 (0.0006) [2023-12-28 02:53:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 544423936. Throughput: 0: 9830.3, 1: 9937.1. Samples: 544435204. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:21,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.642')] [2023-12-28 02:53:21,176][106225] Updated weights for policy 1, policy_version 1064502 (0.0008) [2023-12-28 02:53:21,778][106226] Updated weights for policy 0, policy_version 1061801 (0.0009) [2023-12-28 02:53:21,843][106226] Updated weights for policy 0, policy_version 1061811 (0.0007) [2023-12-28 02:53:21,905][106225] Updated weights for policy 1, policy_version 1064512 (0.0007) [2023-12-28 02:53:21,911][106226] Updated weights for policy 0, policy_version 1061821 (0.0008) [2023-12-28 02:53:21,959][106225] Updated weights for policy 1, policy_version 1064522 (0.0006) [2023-12-28 02:53:22,015][106225] Updated weights for policy 1, policy_version 1064532 (0.0006) [2023-12-28 02:53:22,672][106225] Updated weights for policy 1, policy_version 1064542 (0.0007) [2023-12-28 02:53:22,692][106226] Updated weights for policy 0, policy_version 1061831 (0.0008) [2023-12-28 02:53:22,736][106225] Updated weights for policy 1, policy_version 1064552 (0.0006) [2023-12-28 02:53:22,759][106226] Updated weights for policy 0, policy_version 1061841 (0.0008) [2023-12-28 02:53:22,797][106225] Updated weights for policy 1, policy_version 1064562 (0.0007) [2023-12-28 02:53:22,825][106226] Updated weights for policy 0, policy_version 1061851 (0.0007) [2023-12-28 02:53:23,431][106226] Updated weights for policy 0, policy_version 1061861 (0.0007) [2023-12-28 02:53:23,488][106226] Updated weights for policy 0, policy_version 1061871 (0.0005) [2023-12-28 02:53:23,498][106225] Updated weights for policy 1, policy_version 1064572 (0.0007) [2023-12-28 02:53:23,546][106225] Updated weights for policy 1, policy_version 1064582 (0.0007) [2023-12-28 02:53:23,551][106226] Updated weights for policy 0, policy_version 1061881 (0.0007) [2023-12-28 02:53:23,598][106225] Updated weights for policy 1, policy_version 1064592 (0.0006) [2023-12-28 02:53:24,255][106225] Updated weights for policy 1, policy_version 1064602 (0.0008) [2023-12-28 02:53:24,275][106226] Updated weights for policy 0, policy_version 1061891 (0.0007) [2023-12-28 02:53:24,305][106225] Updated weights for policy 1, policy_version 1064612 (0.0006) [2023-12-28 02:53:24,335][106226] Updated weights for policy 0, policy_version 1061901 (0.0008) [2023-12-28 02:53:24,354][106225] Updated weights for policy 1, policy_version 1064622 (0.0005) [2023-12-28 02:53:24,391][106226] Updated weights for policy 0, policy_version 1061911 (0.0007) [2023-12-28 02:53:24,412][106225] Updated weights for policy 1, policy_version 1064632 (0.0006) [2023-12-28 02:53:24,988][106226] Updated weights for policy 0, policy_version 1061921 (0.0006) [2023-12-28 02:53:25,040][106226] Updated weights for policy 0, policy_version 1061931 (0.0005) [2023-12-28 02:53:25,041][106225] Updated weights for policy 1, policy_version 1064642 (0.0009) [2023-12-28 02:53:25,085][106225] Updated weights for policy 1, policy_version 1064652 (0.0008) [2023-12-28 02:53:25,090][106226] Updated weights for policy 0, policy_version 1061941 (0.0007) [2023-12-28 02:53:25,135][106225] Updated weights for policy 1, policy_version 1064662 (0.0005) [2023-12-28 02:53:25,140][106226] Updated weights for policy 0, policy_version 1061951 (0.0008) [2023-12-28 02:53:25,833][106225] Updated weights for policy 1, policy_version 1064672 (0.0009) [2023-12-28 02:53:25,844][106226] Updated weights for policy 0, policy_version 1061961 (0.0006) [2023-12-28 02:53:25,883][106225] Updated weights for policy 1, policy_version 1064682 (0.0010) [2023-12-28 02:53:25,893][106226] Updated weights for policy 0, policy_version 1061971 (0.0007) [2023-12-28 02:53:25,941][106226] Updated weights for policy 0, policy_version 1061981 (0.0006) [2023-12-28 02:53:25,943][106225] Updated weights for policy 1, policy_version 1064692 (0.0010) [2023-12-28 02:53:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 544530432. Throughput: 0: 9802.0, 1: 9880.7. Samples: 544492956. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:26,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.720')] [2023-12-28 02:53:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001061984_271925248.pth... [2023-12-28 02:53:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001064696_272605184.pth... [2023-12-28 02:53:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001060832_271630336.pth [2023-12-28 02:53:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001063512_272302080.pth [2023-12-28 02:53:26,547][106226] Updated weights for policy 0, policy_version 1061991 (0.0005) [2023-12-28 02:53:26,598][106226] Updated weights for policy 0, policy_version 1062001 (0.0005) [2023-12-28 02:53:26,668][106226] Updated weights for policy 0, policy_version 1062011 (0.0008) [2023-12-28 02:53:26,670][106225] Updated weights for policy 1, policy_version 1064702 (0.0008) [2023-12-28 02:53:26,729][106225] Updated weights for policy 1, policy_version 1064712 (0.0009) [2023-12-28 02:53:26,788][106225] Updated weights for policy 1, policy_version 1064722 (0.0010) [2023-12-28 02:53:27,297][106226] Updated weights for policy 0, policy_version 1062021 (0.0009) [2023-12-28 02:53:27,352][106226] Updated weights for policy 0, policy_version 1062031 (0.0009) [2023-12-28 02:53:27,406][106226] Updated weights for policy 0, policy_version 1062041 (0.0008) [2023-12-28 02:53:27,426][106225] Updated weights for policy 1, policy_version 1064732 (0.0010) [2023-12-28 02:53:27,469][106225] Updated weights for policy 1, policy_version 1064742 (0.0010) [2023-12-28 02:53:27,526][106225] Updated weights for policy 1, policy_version 1064752 (0.0010) [2023-12-28 02:53:28,011][106226] Updated weights for policy 0, policy_version 1062051 (0.0009) [2023-12-28 02:53:28,061][106226] Updated weights for policy 0, policy_version 1062061 (0.0008) [2023-12-28 02:53:28,127][106226] Updated weights for policy 0, policy_version 1062071 (0.0007) [2023-12-28 02:53:28,213][106225] Updated weights for policy 1, policy_version 1064762 (0.0010) [2023-12-28 02:53:28,262][106225] Updated weights for policy 1, policy_version 1064772 (0.0010) [2023-12-28 02:53:28,307][106225] Updated weights for policy 1, policy_version 1064782 (0.0010) [2023-12-28 02:53:28,392][106225] Updated weights for policy 1, policy_version 1064792 (0.0010) [2023-12-28 02:53:28,785][106226] Updated weights for policy 0, policy_version 1062081 (0.0005) [2023-12-28 02:53:28,854][106226] Updated weights for policy 0, policy_version 1062091 (0.0008) [2023-12-28 02:53:28,921][106226] Updated weights for policy 0, policy_version 1062101 (0.0008) [2023-12-28 02:53:28,980][106226] Updated weights for policy 0, policy_version 1062111 (0.0008) [2023-12-28 02:53:29,137][106225] Updated weights for policy 1, policy_version 1064802 (0.0010) [2023-12-28 02:53:29,183][106225] Updated weights for policy 1, policy_version 1064812 (0.0010) [2023-12-28 02:53:29,247][106225] Updated weights for policy 1, policy_version 1064822 (0.0010) [2023-12-28 02:53:29,703][106226] Updated weights for policy 0, policy_version 1062121 (0.0009) [2023-12-28 02:53:29,764][106226] Updated weights for policy 0, policy_version 1062131 (0.0008) [2023-12-28 02:53:29,827][106226] Updated weights for policy 0, policy_version 1062141 (0.0007) [2023-12-28 02:53:29,874][106225] Updated weights for policy 1, policy_version 1064832 (0.0008) [2023-12-28 02:53:29,944][106225] Updated weights for policy 1, policy_version 1064842 (0.0008) [2023-12-28 02:53:30,014][106225] Updated weights for policy 1, policy_version 1064852 (0.0007) [2023-12-28 02:53:30,580][106226] Updated weights for policy 0, policy_version 1062151 (0.0008) [2023-12-28 02:53:30,630][106226] Updated weights for policy 0, policy_version 1062161 (0.0007) [2023-12-28 02:53:30,682][106225] Updated weights for policy 1, policy_version 1064862 (0.0010) [2023-12-28 02:53:30,691][106226] Updated weights for policy 0, policy_version 1062171 (0.0006) [2023-12-28 02:53:30,731][106225] Updated weights for policy 1, policy_version 1064872 (0.0010) [2023-12-28 02:53:30,783][106225] Updated weights for policy 1, policy_version 1064882 (0.0010) [2023-12-28 02:53:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 544628736. Throughput: 0: 9949.0, 1: 9944.7. Samples: 544617668. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:31,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.115')] [2023-12-28 02:53:31,435][106225] Updated weights for policy 1, policy_version 1064892 (0.0009) [2023-12-28 02:53:31,486][106225] Updated weights for policy 1, policy_version 1064902 (0.0008) [2023-12-28 02:53:31,492][106226] Updated weights for policy 0, policy_version 1062181 (0.0006) [2023-12-28 02:53:31,534][106225] Updated weights for policy 1, policy_version 1064912 (0.0007) [2023-12-28 02:53:31,551][106226] Updated weights for policy 0, policy_version 1062191 (0.0008) [2023-12-28 02:53:31,623][106226] Updated weights for policy 0, policy_version 1062201 (0.0007) [2023-12-28 02:53:32,271][106225] Updated weights for policy 1, policy_version 1064922 (0.0010) [2023-12-28 02:53:32,325][106225] Updated weights for policy 1, policy_version 1064932 (0.0009) [2023-12-28 02:53:32,357][106226] Updated weights for policy 0, policy_version 1062211 (0.0009) [2023-12-28 02:53:32,391][106225] Updated weights for policy 1, policy_version 1064942 (0.0008) [2023-12-28 02:53:32,429][106226] Updated weights for policy 0, policy_version 1062221 (0.0008) [2023-12-28 02:53:32,454][106225] Updated weights for policy 1, policy_version 1064952 (0.0008) [2023-12-28 02:53:32,482][106226] Updated weights for policy 0, policy_version 1062231 (0.0009) [2023-12-28 02:53:33,093][106225] Updated weights for policy 1, policy_version 1064962 (0.0008) [2023-12-28 02:53:33,136][106226] Updated weights for policy 0, policy_version 1062241 (0.0008) [2023-12-28 02:53:33,159][106225] Updated weights for policy 1, policy_version 1064972 (0.0007) [2023-12-28 02:53:33,199][106226] Updated weights for policy 0, policy_version 1062251 (0.0006) [2023-12-28 02:53:33,225][106225] Updated weights for policy 1, policy_version 1064982 (0.0005) [2023-12-28 02:53:33,264][106226] Updated weights for policy 0, policy_version 1062261 (0.0006) [2023-12-28 02:53:33,326][106226] Updated weights for policy 0, policy_version 1062271 (0.0007) [2023-12-28 02:53:33,813][106225] Updated weights for policy 1, policy_version 1064992 (0.0005) [2023-12-28 02:53:33,862][106225] Updated weights for policy 1, policy_version 1065002 (0.0006) [2023-12-28 02:53:33,916][106225] Updated weights for policy 1, policy_version 1065012 (0.0007) [2023-12-28 02:53:33,989][106226] Updated weights for policy 0, policy_version 1062281 (0.0010) [2023-12-28 02:53:34,039][106226] Updated weights for policy 0, policy_version 1062291 (0.0010) [2023-12-28 02:53:34,096][106226] Updated weights for policy 0, policy_version 1062301 (0.0010) [2023-12-28 02:53:34,663][106225] Updated weights for policy 1, policy_version 1065022 (0.0007) [2023-12-28 02:53:34,721][106225] Updated weights for policy 1, policy_version 1065032 (0.0008) [2023-12-28 02:53:34,776][106225] Updated weights for policy 1, policy_version 1065042 (0.0005) [2023-12-28 02:53:34,845][106226] Updated weights for policy 0, policy_version 1062311 (0.0011) [2023-12-28 02:53:34,908][106226] Updated weights for policy 0, policy_version 1062321 (0.0009) [2023-12-28 02:53:34,972][106226] Updated weights for policy 0, policy_version 1062331 (0.0010) [2023-12-28 02:53:35,459][106225] Updated weights for policy 1, policy_version 1065052 (0.0007) [2023-12-28 02:53:35,515][106225] Updated weights for policy 1, policy_version 1065062 (0.0010) [2023-12-28 02:53:35,557][106226] Updated weights for policy 0, policy_version 1062341 (0.0008) [2023-12-28 02:53:35,573][106225] Updated weights for policy 1, policy_version 1065072 (0.0010) [2023-12-28 02:53:35,620][106226] Updated weights for policy 0, policy_version 1062351 (0.0006) [2023-12-28 02:53:35,679][106226] Updated weights for policy 0, policy_version 1062361 (0.0005) [2023-12-28 02:53:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 544727040. Throughput: 0: 9936.6, 1: 9947.6. Samples: 544739180. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:36,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.093')] [2023-12-28 02:53:36,215][106225] Updated weights for policy 1, policy_version 1065082 (0.0010) [2023-12-28 02:53:36,281][106225] Updated weights for policy 1, policy_version 1065092 (0.0008) [2023-12-28 02:53:36,342][106225] Updated weights for policy 1, policy_version 1065102 (0.0006) [2023-12-28 02:53:36,356][106226] Updated weights for policy 0, policy_version 1062371 (0.0005) [2023-12-28 02:53:36,411][106225] Updated weights for policy 1, policy_version 1065112 (0.0007) [2023-12-28 02:53:36,424][106226] Updated weights for policy 0, policy_version 1062381 (0.0008) [2023-12-28 02:53:36,483][106226] Updated weights for policy 0, policy_version 1062391 (0.0008) [2023-12-28 02:53:37,115][106226] Updated weights for policy 0, policy_version 1062401 (0.0006) [2023-12-28 02:53:37,173][106225] Updated weights for policy 1, policy_version 1065122 (0.0009) [2023-12-28 02:53:37,181][106226] Updated weights for policy 0, policy_version 1062411 (0.0006) [2023-12-28 02:53:37,226][106225] Updated weights for policy 1, policy_version 1065132 (0.0007) [2023-12-28 02:53:37,239][106226] Updated weights for policy 0, policy_version 1062421 (0.0007) [2023-12-28 02:53:37,283][106225] Updated weights for policy 1, policy_version 1065142 (0.0007) [2023-12-28 02:53:37,301][106226] Updated weights for policy 0, policy_version 1062431 (0.0006) [2023-12-28 02:53:37,869][106226] Updated weights for policy 0, policy_version 1062441 (0.0005) [2023-12-28 02:53:37,932][106226] Updated weights for policy 0, policy_version 1062451 (0.0011) [2023-12-28 02:53:37,972][106225] Updated weights for policy 1, policy_version 1065152 (0.0006) [2023-12-28 02:53:37,982][106226] Updated weights for policy 0, policy_version 1062461 (0.0010) [2023-12-28 02:53:38,028][106225] Updated weights for policy 1, policy_version 1065162 (0.0006) [2023-12-28 02:53:38,082][106225] Updated weights for policy 1, policy_version 1065172 (0.0008) [2023-12-28 02:53:38,703][106226] Updated weights for policy 0, policy_version 1062471 (0.0010) [2023-12-28 02:53:38,761][106226] Updated weights for policy 0, policy_version 1062481 (0.0011) [2023-12-28 02:53:38,822][106226] Updated weights for policy 0, policy_version 1062491 (0.0011) [2023-12-28 02:53:38,850][106225] Updated weights for policy 1, policy_version 1065182 (0.0008) [2023-12-28 02:53:38,904][106225] Updated weights for policy 1, policy_version 1065192 (0.0010) [2023-12-28 02:53:38,964][106225] Updated weights for policy 1, policy_version 1065202 (0.0010) [2023-12-28 02:53:39,481][106226] Updated weights for policy 0, policy_version 1062501 (0.0010) [2023-12-28 02:53:39,543][106226] Updated weights for policy 0, policy_version 1062511 (0.0008) [2023-12-28 02:53:39,610][106226] Updated weights for policy 0, policy_version 1062521 (0.0009) [2023-12-28 02:53:39,687][106225] Updated weights for policy 1, policy_version 1065212 (0.0008) [2023-12-28 02:53:39,754][106225] Updated weights for policy 1, policy_version 1065222 (0.0006) [2023-12-28 02:53:39,822][106225] Updated weights for policy 1, policy_version 1065232 (0.0006) [2023-12-28 02:53:40,428][106226] Updated weights for policy 0, policy_version 1062531 (0.0009) [2023-12-28 02:53:40,496][106226] Updated weights for policy 0, policy_version 1062541 (0.0009) [2023-12-28 02:53:40,557][106226] Updated weights for policy 0, policy_version 1062551 (0.0010) [2023-12-28 02:53:40,584][106225] Updated weights for policy 1, policy_version 1065242 (0.0009) [2023-12-28 02:53:40,645][106225] Updated weights for policy 1, policy_version 1065252 (0.0008) [2023-12-28 02:53:40,702][106225] Updated weights for policy 1, policy_version 1065262 (0.0010) [2023-12-28 02:53:40,758][106225] Updated weights for policy 1, policy_version 1065272 (0.0008) [2023-12-28 02:53:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 544825344. Throughput: 0: 9967.5, 1: 9984.2. Samples: 544799608. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:41,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-5.322')] [2023-12-28 02:53:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001065272_272752640.pth... [2023-12-28 02:53:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001062560_272072704.pth... [2023-12-28 02:53:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001061408_271777792.pth [2023-12-28 02:53:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001062560_272072704.pth [2023-12-28 02:53:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001064088_272449536.pth [2023-12-28 02:53:41,189][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001065272_272752640.pth [2023-12-28 02:53:41,240][106226] Updated weights for policy 0, policy_version 1062561 (0.0011) [2023-12-28 02:53:41,305][106226] Updated weights for policy 0, policy_version 1062571 (0.0008) [2023-12-28 02:53:41,375][106226] Updated weights for policy 0, policy_version 1062581 (0.0008) [2023-12-28 02:53:41,442][106226] Updated weights for policy 0, policy_version 1062591 (0.0007) [2023-12-28 02:53:41,529][106225] Updated weights for policy 1, policy_version 1065282 (0.0011) [2023-12-28 02:53:41,590][106225] Updated weights for policy 1, policy_version 1065292 (0.0010) [2023-12-28 02:53:41,664][106225] Updated weights for policy 1, policy_version 1065302 (0.0012) [2023-12-28 02:53:42,143][106226] Updated weights for policy 0, policy_version 1062601 (0.0009) [2023-12-28 02:53:42,200][106226] Updated weights for policy 0, policy_version 1062611 (0.0009) [2023-12-28 02:53:42,261][106226] Updated weights for policy 0, policy_version 1062621 (0.0008) [2023-12-28 02:53:42,415][106225] Updated weights for policy 1, policy_version 1065312 (0.0008) [2023-12-28 02:53:42,481][106225] Updated weights for policy 1, policy_version 1065322 (0.0010) [2023-12-28 02:53:42,542][106225] Updated weights for policy 1, policy_version 1065332 (0.0010) [2023-12-28 02:53:43,002][106226] Updated weights for policy 0, policy_version 1062631 (0.0010) [2023-12-28 02:53:43,058][106226] Updated weights for policy 0, policy_version 1062641 (0.0010) [2023-12-28 02:53:43,115][106226] Updated weights for policy 0, policy_version 1062651 (0.0011) [2023-12-28 02:53:43,140][106225] Updated weights for policy 1, policy_version 1065342 (0.0010) [2023-12-28 02:53:43,204][106225] Updated weights for policy 1, policy_version 1065352 (0.0010) [2023-12-28 02:53:43,271][106225] Updated weights for policy 1, policy_version 1065362 (0.0010) [2023-12-28 02:53:43,752][106226] Updated weights for policy 0, policy_version 1062661 (0.0008) [2023-12-28 02:53:43,808][106226] Updated weights for policy 0, policy_version 1062671 (0.0005) [2023-12-28 02:53:43,861][106226] Updated weights for policy 0, policy_version 1062681 (0.0005) [2023-12-28 02:53:43,918][106225] Updated weights for policy 1, policy_version 1065372 (0.0008) [2023-12-28 02:53:43,977][106225] Updated weights for policy 1, policy_version 1065382 (0.0005) [2023-12-28 02:53:44,032][106225] Updated weights for policy 1, policy_version 1065392 (0.0005) [2023-12-28 02:53:44,392][106226] Updated weights for policy 0, policy_version 1062691 (0.0008) [2023-12-28 02:53:44,455][106226] Updated weights for policy 0, policy_version 1062701 (0.0008) [2023-12-28 02:53:44,509][106226] Updated weights for policy 0, policy_version 1062711 (0.0009) [2023-12-28 02:53:44,689][106225] Updated weights for policy 1, policy_version 1065402 (0.0009) [2023-12-28 02:53:44,745][106225] Updated weights for policy 1, policy_version 1065412 (0.0010) [2023-12-28 02:53:44,810][106225] Updated weights for policy 1, policy_version 1065422 (0.0009) [2023-12-28 02:53:44,869][106225] Updated weights for policy 1, policy_version 1065432 (0.0011) [2023-12-28 02:53:45,173][106226] Updated weights for policy 0, policy_version 1062721 (0.0008) [2023-12-28 02:53:45,238][106226] Updated weights for policy 0, policy_version 1062731 (0.0009) [2023-12-28 02:53:45,304][106226] Updated weights for policy 0, policy_version 1062741 (0.0009) [2023-12-28 02:53:45,367][106226] Updated weights for policy 0, policy_version 1062751 (0.0007) [2023-12-28 02:53:45,594][106225] Updated weights for policy 1, policy_version 1065442 (0.0006) [2023-12-28 02:53:45,641][106225] Updated weights for policy 1, policy_version 1065452 (0.0006) [2023-12-28 02:53:45,692][106225] Updated weights for policy 1, policy_version 1065462 (0.0005) [2023-12-28 02:53:45,980][106226] Updated weights for policy 0, policy_version 1062761 (0.0008) [2023-12-28 02:53:46,045][106226] Updated weights for policy 0, policy_version 1062771 (0.0008) [2023-12-28 02:53:46,107][106226] Updated weights for policy 0, policy_version 1062781 (0.0009) [2023-12-28 02:53:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 544931840. Throughput: 0: 10021.8, 1: 10018.8. Samples: 544917960. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:46,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.980')] [2023-12-28 02:53:46,289][106225] Updated weights for policy 1, policy_version 1065472 (0.0006) [2023-12-28 02:53:46,343][106225] Updated weights for policy 1, policy_version 1065482 (0.0005) [2023-12-28 02:53:46,395][106225] Updated weights for policy 1, policy_version 1065492 (0.0005) [2023-12-28 02:53:46,822][106226] Updated weights for policy 0, policy_version 1062791 (0.0006) [2023-12-28 02:53:46,876][106226] Updated weights for policy 0, policy_version 1062801 (0.0005) [2023-12-28 02:53:46,933][106226] Updated weights for policy 0, policy_version 1062811 (0.0008) [2023-12-28 02:53:47,050][106225] Updated weights for policy 1, policy_version 1065502 (0.0008) [2023-12-28 02:53:47,104][106225] Updated weights for policy 1, policy_version 1065512 (0.0009) [2023-12-28 02:53:47,152][106225] Updated weights for policy 1, policy_version 1065522 (0.0006) [2023-12-28 02:53:47,551][106226] Updated weights for policy 0, policy_version 1062821 (0.0008) [2023-12-28 02:53:47,610][106226] Updated weights for policy 0, policy_version 1062831 (0.0009) [2023-12-28 02:53:47,661][106226] Updated weights for policy 0, policy_version 1062841 (0.0007) [2023-12-28 02:53:47,865][106225] Updated weights for policy 1, policy_version 1065532 (0.0006) [2023-12-28 02:53:47,915][106225] Updated weights for policy 1, policy_version 1065542 (0.0009) [2023-12-28 02:53:47,968][106225] Updated weights for policy 1, policy_version 1065552 (0.0008) [2023-12-28 02:53:48,257][106226] Updated weights for policy 0, policy_version 1062851 (0.0006) [2023-12-28 02:53:48,311][106226] Updated weights for policy 0, policy_version 1062861 (0.0008) [2023-12-28 02:53:48,379][106226] Updated weights for policy 0, policy_version 1062871 (0.0008) [2023-12-28 02:53:48,748][106225] Updated weights for policy 1, policy_version 1065562 (0.0009) [2023-12-28 02:53:48,803][106225] Updated weights for policy 1, policy_version 1065572 (0.0008) [2023-12-28 02:53:48,865][106225] Updated weights for policy 1, policy_version 1065582 (0.0008) [2023-12-28 02:53:48,922][106225] Updated weights for policy 1, policy_version 1065592 (0.0008) [2023-12-28 02:53:49,062][106226] Updated weights for policy 0, policy_version 1062881 (0.0008) [2023-12-28 02:53:49,131][106226] Updated weights for policy 0, policy_version 1062891 (0.0005) [2023-12-28 02:53:49,196][106226] Updated weights for policy 0, policy_version 1062901 (0.0006) [2023-12-28 02:53:49,267][106226] Updated weights for policy 0, policy_version 1062911 (0.0008) [2023-12-28 02:53:49,758][106225] Updated weights for policy 1, policy_version 1065602 (0.0009) [2023-12-28 02:53:49,811][106225] Updated weights for policy 1, policy_version 1065612 (0.0008) [2023-12-28 02:53:49,880][106225] Updated weights for policy 1, policy_version 1065622 (0.0009) [2023-12-28 02:53:49,925][106226] Updated weights for policy 0, policy_version 1062921 (0.0007) [2023-12-28 02:53:49,991][106226] Updated weights for policy 0, policy_version 1062931 (0.0009) [2023-12-28 02:53:50,060][106226] Updated weights for policy 0, policy_version 1062941 (0.0009) [2023-12-28 02:53:50,585][106225] Updated weights for policy 1, policy_version 1065632 (0.0009) [2023-12-28 02:53:50,639][106225] Updated weights for policy 1, policy_version 1065642 (0.0008) [2023-12-28 02:53:50,688][106225] Updated weights for policy 1, policy_version 1065652 (0.0008) [2023-12-28 02:53:50,766][106226] Updated weights for policy 0, policy_version 1062951 (0.0009) [2023-12-28 02:53:50,820][106226] Updated weights for policy 0, policy_version 1062961 (0.0009) [2023-12-28 02:53:50,873][106226] Updated weights for policy 0, policy_version 1062971 (0.0008) [2023-12-28 02:53:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 545030144. Throughput: 0: 10062.1, 1: 10026.3. Samples: 545038220. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:51,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.787')] [2023-12-28 02:53:51,454][106225] Updated weights for policy 1, policy_version 1065662 (0.0009) [2023-12-28 02:53:51,513][106225] Updated weights for policy 1, policy_version 1065672 (0.0008) [2023-12-28 02:53:51,568][106225] Updated weights for policy 1, policy_version 1065682 (0.0008) [2023-12-28 02:53:51,670][106226] Updated weights for policy 0, policy_version 1062981 (0.0009) [2023-12-28 02:53:51,728][106226] Updated weights for policy 0, policy_version 1062991 (0.0009) [2023-12-28 02:53:51,797][106226] Updated weights for policy 0, policy_version 1063001 (0.0009) [2023-12-28 02:53:52,304][106225] Updated weights for policy 1, policy_version 1065692 (0.0009) [2023-12-28 02:53:52,365][106225] Updated weights for policy 1, policy_version 1065702 (0.0006) [2023-12-28 02:53:52,431][106225] Updated weights for policy 1, policy_version 1065712 (0.0009) [2023-12-28 02:53:52,524][106226] Updated weights for policy 0, policy_version 1063011 (0.0009) [2023-12-28 02:53:52,588][106226] Updated weights for policy 0, policy_version 1063021 (0.0009) [2023-12-28 02:53:52,641][106226] Updated weights for policy 0, policy_version 1063031 (0.0008) [2023-12-28 02:53:53,159][106225] Updated weights for policy 1, policy_version 1065722 (0.0009) [2023-12-28 02:53:53,214][106225] Updated weights for policy 1, policy_version 1065732 (0.0008) [2023-12-28 02:53:53,268][106225] Updated weights for policy 1, policy_version 1065742 (0.0008) [2023-12-28 02:53:53,318][106225] Updated weights for policy 1, policy_version 1065752 (0.0008) [2023-12-28 02:53:53,374][106226] Updated weights for policy 0, policy_version 1063041 (0.0008) [2023-12-28 02:53:53,426][106226] Updated weights for policy 0, policy_version 1063051 (0.0008) [2023-12-28 02:53:53,476][106226] Updated weights for policy 0, policy_version 1063061 (0.0010) [2023-12-28 02:53:53,535][106226] Updated weights for policy 0, policy_version 1063071 (0.0010) [2023-12-28 02:53:54,020][106225] Updated weights for policy 1, policy_version 1065762 (0.0011) [2023-12-28 02:53:54,081][106225] Updated weights for policy 1, policy_version 1065772 (0.0009) [2023-12-28 02:53:54,144][106225] Updated weights for policy 1, policy_version 1065782 (0.0005) [2023-12-28 02:53:54,263][106226] Updated weights for policy 0, policy_version 1063081 (0.0010) [2023-12-28 02:53:54,326][106226] Updated weights for policy 0, policy_version 1063091 (0.0010) [2023-12-28 02:53:54,384][106226] Updated weights for policy 0, policy_version 1063101 (0.0011) [2023-12-28 02:53:54,701][106225] Updated weights for policy 1, policy_version 1065792 (0.0006) [2023-12-28 02:53:54,759][106225] Updated weights for policy 1, policy_version 1065802 (0.0005) [2023-12-28 02:53:54,809][106225] Updated weights for policy 1, policy_version 1065812 (0.0006) [2023-12-28 02:53:54,965][106226] Updated weights for policy 0, policy_version 1063111 (0.0007) [2023-12-28 02:53:55,024][106226] Updated weights for policy 0, policy_version 1063121 (0.0010) [2023-12-28 02:53:55,081][106226] Updated weights for policy 0, policy_version 1063131 (0.0011) [2023-12-28 02:53:55,454][106225] Updated weights for policy 1, policy_version 1065822 (0.0008) [2023-12-28 02:53:55,518][106225] Updated weights for policy 1, policy_version 1065832 (0.0006) [2023-12-28 02:53:55,579][106225] Updated weights for policy 1, policy_version 1065842 (0.0008) [2023-12-28 02:53:55,740][106226] Updated weights for policy 0, policy_version 1063141 (0.0011) [2023-12-28 02:53:55,790][106226] Updated weights for policy 0, policy_version 1063151 (0.0011) [2023-12-28 02:53:55,844][106226] Updated weights for policy 0, policy_version 1063161 (0.0011) [2023-12-28 02:53:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 545128448. Throughput: 0: 10009.5, 1: 9989.3. Samples: 545095472. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:53:56,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-4.896')] [2023-12-28 02:53:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001065848_272900096.pth... [2023-12-28 02:53:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001063168_272228352.pth... [2023-12-28 02:53:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001064696_272605184.pth [2023-12-28 02:53:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001061984_271925248.pth [2023-12-28 02:53:56,293][106225] Updated weights for policy 1, policy_version 1065852 (0.0008) [2023-12-28 02:53:56,353][106225] Updated weights for policy 1, policy_version 1065862 (0.0008) [2023-12-28 02:53:56,404][106225] Updated weights for policy 1, policy_version 1065872 (0.0008) [2023-12-28 02:53:56,567][106226] Updated weights for policy 0, policy_version 1063171 (0.0011) [2023-12-28 02:53:56,629][106226] Updated weights for policy 0, policy_version 1063181 (0.0010) [2023-12-28 02:53:56,676][106226] Updated weights for policy 0, policy_version 1063191 (0.0009) [2023-12-28 02:53:57,189][106225] Updated weights for policy 1, policy_version 1065882 (0.0008) [2023-12-28 02:53:57,252][106225] Updated weights for policy 1, policy_version 1065892 (0.0008) [2023-12-28 02:53:57,281][106226] Updated weights for policy 0, policy_version 1063201 (0.0008) [2023-12-28 02:53:57,306][106225] Updated weights for policy 1, policy_version 1065902 (0.0007) [2023-12-28 02:53:57,334][106226] Updated weights for policy 0, policy_version 1063211 (0.0011) [2023-12-28 02:53:57,359][106225] Updated weights for policy 1, policy_version 1065912 (0.0005) [2023-12-28 02:53:57,387][106226] Updated weights for policy 0, policy_version 1063221 (0.0010) [2023-12-28 02:53:57,444][106226] Updated weights for policy 0, policy_version 1063231 (0.0011) [2023-12-28 02:53:58,073][106225] Updated weights for policy 1, policy_version 1065922 (0.0006) [2023-12-28 02:53:58,093][106226] Updated weights for policy 0, policy_version 1063241 (0.0010) [2023-12-28 02:53:58,129][106225] Updated weights for policy 1, policy_version 1065932 (0.0007) [2023-12-28 02:53:58,139][106226] Updated weights for policy 0, policy_version 1063251 (0.0010) [2023-12-28 02:53:58,186][106225] Updated weights for policy 1, policy_version 1065942 (0.0005) [2023-12-28 02:53:58,187][106226] Updated weights for policy 0, policy_version 1063261 (0.0008) [2023-12-28 02:53:59,039][106226] Updated weights for policy 0, policy_version 1063271 (0.0008) [2023-12-28 02:53:59,052][106225] Updated weights for policy 1, policy_version 1065952 (0.0008) [2023-12-28 02:53:59,092][106226] Updated weights for policy 0, policy_version 1063281 (0.0007) [2023-12-28 02:53:59,112][106225] Updated weights for policy 1, policy_version 1065962 (0.0008) [2023-12-28 02:53:59,157][106226] Updated weights for policy 0, policy_version 1063291 (0.0007) [2023-12-28 02:53:59,176][106225] Updated weights for policy 1, policy_version 1065972 (0.0006) [2023-12-28 02:53:59,862][106225] Updated weights for policy 1, policy_version 1065982 (0.0008) [2023-12-28 02:53:59,921][106225] Updated weights for policy 1, policy_version 1065992 (0.0008) [2023-12-28 02:53:59,972][106226] Updated weights for policy 0, policy_version 1063301 (0.0006) [2023-12-28 02:53:59,983][106225] Updated weights for policy 1, policy_version 1066002 (0.0008) [2023-12-28 02:54:00,032][106226] Updated weights for policy 0, policy_version 1063311 (0.0007) [2023-12-28 02:54:00,083][106226] Updated weights for policy 0, policy_version 1063321 (0.0008) [2023-12-28 02:54:00,706][106226] Updated weights for policy 0, policy_version 1063331 (0.0008) [2023-12-28 02:54:00,765][106226] Updated weights for policy 0, policy_version 1063341 (0.0006) [2023-12-28 02:54:00,776][106225] Updated weights for policy 1, policy_version 1066012 (0.0008) [2023-12-28 02:54:00,822][106226] Updated weights for policy 0, policy_version 1063351 (0.0005) [2023-12-28 02:54:00,830][106225] Updated weights for policy 1, policy_version 1066022 (0.0009) [2023-12-28 02:54:00,887][106225] Updated weights for policy 1, policy_version 1066032 (0.0010) [2023-12-28 02:54:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 545226752. Throughput: 0: 10050.2, 1: 9967.6. Samples: 545214644. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:01,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.914')] [2023-12-28 02:54:01,506][106226] Updated weights for policy 0, policy_version 1063361 (0.0006) [2023-12-28 02:54:01,560][106226] Updated weights for policy 0, policy_version 1063371 (0.0010) [2023-12-28 02:54:01,610][106226] Updated weights for policy 0, policy_version 1063381 (0.0008) [2023-12-28 02:54:01,669][106225] Updated weights for policy 1, policy_version 1066042 (0.0010) [2023-12-28 02:54:01,680][106226] Updated weights for policy 0, policy_version 1063391 (0.0008) [2023-12-28 02:54:01,728][106225] Updated weights for policy 1, policy_version 1066052 (0.0009) [2023-12-28 02:54:01,797][106225] Updated weights for policy 1, policy_version 1066062 (0.0008) [2023-12-28 02:54:01,859][106225] Updated weights for policy 1, policy_version 1066072 (0.0007) [2023-12-28 02:54:02,426][106226] Updated weights for policy 0, policy_version 1063401 (0.0010) [2023-12-28 02:54:02,477][106226] Updated weights for policy 0, policy_version 1063411 (0.0010) [2023-12-28 02:54:02,528][106226] Updated weights for policy 0, policy_version 1063421 (0.0010) [2023-12-28 02:54:02,579][106225] Updated weights for policy 1, policy_version 1066082 (0.0008) [2023-12-28 02:54:02,640][106225] Updated weights for policy 1, policy_version 1066092 (0.0008) [2023-12-28 02:54:02,702][106225] Updated weights for policy 1, policy_version 1066102 (0.0008) [2023-12-28 02:54:03,186][106226] Updated weights for policy 0, policy_version 1063431 (0.0008) [2023-12-28 02:54:03,245][106226] Updated weights for policy 0, policy_version 1063441 (0.0010) [2023-12-28 02:54:03,303][106226] Updated weights for policy 0, policy_version 1063451 (0.0010) [2023-12-28 02:54:03,461][106225] Updated weights for policy 1, policy_version 1066112 (0.0007) [2023-12-28 02:54:03,507][106225] Updated weights for policy 1, policy_version 1066122 (0.0008) [2023-12-28 02:54:03,553][106225] Updated weights for policy 1, policy_version 1066132 (0.0007) [2023-12-28 02:54:04,003][106226] Updated weights for policy 0, policy_version 1063461 (0.0011) [2023-12-28 02:54:04,064][106226] Updated weights for policy 0, policy_version 1063471 (0.0011) [2023-12-28 02:54:04,124][106226] Updated weights for policy 0, policy_version 1063481 (0.0011) [2023-12-28 02:54:04,290][106225] Updated weights for policy 1, policy_version 1066142 (0.0006) [2023-12-28 02:54:04,353][106225] Updated weights for policy 1, policy_version 1066152 (0.0006) [2023-12-28 02:54:04,418][106225] Updated weights for policy 1, policy_version 1066162 (0.0006) [2023-12-28 02:54:04,794][106226] Updated weights for policy 0, policy_version 1063491 (0.0009) [2023-12-28 02:54:04,850][106226] Updated weights for policy 0, policy_version 1063501 (0.0010) [2023-12-28 02:54:04,913][106226] Updated weights for policy 0, policy_version 1063511 (0.0011) [2023-12-28 02:54:05,056][106225] Updated weights for policy 1, policy_version 1066172 (0.0007) [2023-12-28 02:54:05,121][106225] Updated weights for policy 1, policy_version 1066182 (0.0008) [2023-12-28 02:54:05,182][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000004 [2023-12-28 02:54:05,185][106225] Updated weights for policy 1, policy_version 1066192 (0.0008) [2023-12-28 02:54:05,623][106226] Updated weights for policy 0, policy_version 1063521 (0.0010) [2023-12-28 02:54:05,679][106226] Updated weights for policy 0, policy_version 1063531 (0.0010) [2023-12-28 02:54:05,742][106226] Updated weights for policy 0, policy_version 1063541 (0.0010) [2023-12-28 02:54:05,803][106226] Updated weights for policy 0, policy_version 1063551 (0.0010) [2023-12-28 02:54:05,904][106225] Updated weights for policy 1, policy_version 1066202 (0.0006) [2023-12-28 02:54:05,962][106225] Updated weights for policy 1, policy_version 1066212 (0.0008) [2023-12-28 02:54:06,016][106225] Updated weights for policy 1, policy_version 1066222 (0.0009) [2023-12-28 02:54:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 545325056. Throughput: 0: 10067.2, 1: 9878.7. Samples: 545332772. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:06,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.932')] [2023-12-28 02:54:06,475][106226] Updated weights for policy 0, policy_version 1063561 (0.0010) [2023-12-28 02:54:06,534][106226] Updated weights for policy 0, policy_version 1063571 (0.0011) [2023-12-28 02:54:06,597][106226] Updated weights for policy 0, policy_version 1063581 (0.0011) [2023-12-28 02:54:06,756][106225] Updated weights for policy 1, policy_version 1066232 (0.0008) [2023-12-28 02:54:06,807][106225] Updated weights for policy 1, policy_version 1066242 (0.0008) [2023-12-28 02:54:06,861][106225] Updated weights for policy 1, policy_version 1066252 (0.0008) [2023-12-28 02:54:07,216][106226] Updated weights for policy 0, policy_version 1063591 (0.0011) [2023-12-28 02:54:07,267][106226] Updated weights for policy 0, policy_version 1063601 (0.0010) [2023-12-28 02:54:07,336][106226] Updated weights for policy 0, policy_version 1063611 (0.0009) [2023-12-28 02:54:07,647][106225] Updated weights for policy 1, policy_version 1066262 (0.0008) [2023-12-28 02:54:07,708][106225] Updated weights for policy 1, policy_version 1066272 (0.0007) [2023-12-28 02:54:07,762][106225] Updated weights for policy 1, policy_version 1066282 (0.0008) [2023-12-28 02:54:08,064][106226] Updated weights for policy 0, policy_version 1063621 (0.0011) [2023-12-28 02:54:08,127][106226] Updated weights for policy 0, policy_version 1063631 (0.0010) [2023-12-28 02:54:08,184][106226] Updated weights for policy 0, policy_version 1063641 (0.0010) [2023-12-28 02:54:08,433][106225] Updated weights for policy 1, policy_version 1066292 (0.0008) [2023-12-28 02:54:08,488][106225] Updated weights for policy 1, policy_version 1066302 (0.0009) [2023-12-28 02:54:08,545][106225] Updated weights for policy 1, policy_version 1066312 (0.0006) [2023-12-28 02:54:08,912][106226] Updated weights for policy 0, policy_version 1063651 (0.0010) [2023-12-28 02:54:08,966][106226] Updated weights for policy 0, policy_version 1063661 (0.0010) [2023-12-28 02:54:09,020][106226] Updated weights for policy 0, policy_version 1063671 (0.0010) [2023-12-28 02:54:09,235][106225] Updated weights for policy 1, policy_version 1066322 (0.0006) [2023-12-28 02:54:09,295][106225] Updated weights for policy 1, policy_version 1066332 (0.0008) [2023-12-28 02:54:09,354][106225] Updated weights for policy 1, policy_version 1066342 (0.0008) [2023-12-28 02:54:09,433][106225] Updated weights for policy 1, policy_version 1066352 (0.0008) [2023-12-28 02:54:09,721][106226] Updated weights for policy 0, policy_version 1063681 (0.0006) [2023-12-28 02:54:09,782][106226] Updated weights for policy 0, policy_version 1063691 (0.0008) [2023-12-28 02:54:09,846][106226] Updated weights for policy 0, policy_version 1063701 (0.0009) [2023-12-28 02:54:09,920][106226] Updated weights for policy 0, policy_version 1063711 (0.0008) [2023-12-28 02:54:10,180][106225] Updated weights for policy 1, policy_version 1066362 (0.0009) [2023-12-28 02:54:10,238][106225] Updated weights for policy 1, policy_version 1066372 (0.0010) [2023-12-28 02:54:10,285][106225] Updated weights for policy 1, policy_version 1066382 (0.0007) [2023-12-28 02:54:10,645][106226] Updated weights for policy 0, policy_version 1063721 (0.0009) [2023-12-28 02:54:10,710][106226] Updated weights for policy 0, policy_version 1063731 (0.0011) [2023-12-28 02:54:10,775][106226] Updated weights for policy 0, policy_version 1063741 (0.0011) [2023-12-28 02:54:10,961][106225] Updated weights for policy 1, policy_version 1066392 (0.0009) [2023-12-28 02:54:11,034][106225] Updated weights for policy 1, policy_version 1066402 (0.0008) [2023-12-28 02:54:11,106][106225] Updated weights for policy 1, policy_version 1066412 (0.0007) [2023-12-28 02:54:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 545423360. Throughput: 0: 10097.1, 1: 9885.2. Samples: 545392160. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:11,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-5.152')] [2023-12-28 02:54:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001066416_273047552.pth... [2023-12-28 02:54:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001063744_272375808.pth... [2023-12-28 02:54:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001062560_272072704.pth [2023-12-28 02:54:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001065272_272752640.pth [2023-12-28 02:54:11,498][106226] Updated weights for policy 0, policy_version 1063751 (0.0009) [2023-12-28 02:54:11,561][106226] Updated weights for policy 0, policy_version 1063761 (0.0009) [2023-12-28 02:54:11,625][106226] Updated weights for policy 0, policy_version 1063771 (0.0009) [2023-12-28 02:54:11,945][106225] Updated weights for policy 1, policy_version 1066422 (0.0008) [2023-12-28 02:54:12,003][106225] Updated weights for policy 1, policy_version 1066432 (0.0008) [2023-12-28 02:54:12,063][106225] Updated weights for policy 1, policy_version 1066442 (0.0008) [2023-12-28 02:54:12,373][106226] Updated weights for policy 0, policy_version 1063781 (0.0008) [2023-12-28 02:54:12,434][106226] Updated weights for policy 0, policy_version 1063791 (0.0006) [2023-12-28 02:54:12,494][106226] Updated weights for policy 0, policy_version 1063801 (0.0006) [2023-12-28 02:54:12,816][106225] Updated weights for policy 1, policy_version 1066452 (0.0008) [2023-12-28 02:54:12,883][106225] Updated weights for policy 1, policy_version 1066462 (0.0010) [2023-12-28 02:54:12,944][106225] Updated weights for policy 1, policy_version 1066472 (0.0008) [2023-12-28 02:54:13,027][106226] Updated weights for policy 0, policy_version 1063811 (0.0006) [2023-12-28 02:54:13,087][106226] Updated weights for policy 0, policy_version 1063821 (0.0007) [2023-12-28 02:54:13,144][106226] Updated weights for policy 0, policy_version 1063831 (0.0009) [2023-12-28 02:54:13,496][106225] Updated weights for policy 1, policy_version 1066482 (0.0005) [2023-12-28 02:54:13,547][106225] Updated weights for policy 1, policy_version 1066492 (0.0005) [2023-12-28 02:54:13,601][106225] Updated weights for policy 1, policy_version 1066502 (0.0007) [2023-12-28 02:54:13,662][106225] Updated weights for policy 1, policy_version 1066512 (0.0007) [2023-12-28 02:54:13,923][106226] Updated weights for policy 0, policy_version 1063841 (0.0007) [2023-12-28 02:54:13,977][106226] Updated weights for policy 0, policy_version 1063851 (0.0005) [2023-12-28 02:54:14,029][106226] Updated weights for policy 0, policy_version 1063861 (0.0006) [2023-12-28 02:54:14,077][106226] Updated weights for policy 0, policy_version 1063871 (0.0008) [2023-12-28 02:54:14,218][106225] Updated weights for policy 1, policy_version 1066522 (0.0006) [2023-12-28 02:54:14,287][106225] Updated weights for policy 1, policy_version 1066532 (0.0005) [2023-12-28 02:54:14,355][106225] Updated weights for policy 1, policy_version 1066542 (0.0005) [2023-12-28 02:54:14,792][106226] Updated weights for policy 0, policy_version 1063881 (0.0008) [2023-12-28 02:54:14,856][106226] Updated weights for policy 0, policy_version 1063891 (0.0012) [2023-12-28 02:54:14,895][106225] Updated weights for policy 1, policy_version 1066552 (0.0006) [2023-12-28 02:54:14,919][106226] Updated weights for policy 0, policy_version 1063901 (0.0008) [2023-12-28 02:54:14,951][106225] Updated weights for policy 1, policy_version 1066562 (0.0010) [2023-12-28 02:54:15,011][106225] Updated weights for policy 1, policy_version 1066572 (0.0010) [2023-12-28 02:54:15,623][106226] Updated weights for policy 0, policy_version 1063911 (0.0008) [2023-12-28 02:54:15,657][106225] Updated weights for policy 1, policy_version 1066582 (0.0007) [2023-12-28 02:54:15,688][106226] Updated weights for policy 0, policy_version 1063921 (0.0007) [2023-12-28 02:54:15,712][106225] Updated weights for policy 1, policy_version 1066592 (0.0007) [2023-12-28 02:54:15,749][106226] Updated weights for policy 0, policy_version 1063931 (0.0008) [2023-12-28 02:54:15,764][106225] Updated weights for policy 1, policy_version 1066602 (0.0009) [2023-12-28 02:54:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 545521664. Throughput: 0: 10017.1, 1: 9858.0. Samples: 545512052. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:16,176][105115] Avg episode reward: [(0, '-4.487'), (1, '-5.220')] [2023-12-28 02:54:16,365][106225] Updated weights for policy 1, policy_version 1066612 (0.0009) [2023-12-28 02:54:16,408][106226] Updated weights for policy 0, policy_version 1063941 (0.0009) [2023-12-28 02:54:16,419][106225] Updated weights for policy 1, policy_version 1066622 (0.0005) [2023-12-28 02:54:16,468][106226] Updated weights for policy 0, policy_version 1063951 (0.0010) [2023-12-28 02:54:16,475][106225] Updated weights for policy 1, policy_version 1066632 (0.0005) [2023-12-28 02:54:16,519][106226] Updated weights for policy 0, policy_version 1063961 (0.0007) [2023-12-28 02:54:17,174][106225] Updated weights for policy 1, policy_version 1066642 (0.0010) [2023-12-28 02:54:17,188][106226] Updated weights for policy 0, policy_version 1063971 (0.0010) [2023-12-28 02:54:17,232][106225] Updated weights for policy 1, policy_version 1066652 (0.0010) [2023-12-28 02:54:17,251][106226] Updated weights for policy 0, policy_version 1063981 (0.0010) [2023-12-28 02:54:17,293][106225] Updated weights for policy 1, policy_version 1066662 (0.0010) [2023-12-28 02:54:17,311][106226] Updated weights for policy 0, policy_version 1063991 (0.0010) [2023-12-28 02:54:17,351][106225] Updated weights for policy 1, policy_version 1066672 (0.0010) [2023-12-28 02:54:17,934][106226] Updated weights for policy 0, policy_version 1064001 (0.0010) [2023-12-28 02:54:17,994][106226] Updated weights for policy 0, policy_version 1064011 (0.0010) [2023-12-28 02:54:18,048][106226] Updated weights for policy 0, policy_version 1064021 (0.0011) [2023-12-28 02:54:18,058][106225] Updated weights for policy 1, policy_version 1066682 (0.0010) [2023-12-28 02:54:18,099][106226] Updated weights for policy 0, policy_version 1064031 (0.0010) [2023-12-28 02:54:18,112][106225] Updated weights for policy 1, policy_version 1066692 (0.0010) [2023-12-28 02:54:18,170][106225] Updated weights for policy 1, policy_version 1066702 (0.0010) [2023-12-28 02:54:18,776][106226] Updated weights for policy 0, policy_version 1064041 (0.0008) [2023-12-28 02:54:18,833][106226] Updated weights for policy 0, policy_version 1064051 (0.0008) [2023-12-28 02:54:18,890][106226] Updated weights for policy 0, policy_version 1064061 (0.0007) [2023-12-28 02:54:18,895][106225] Updated weights for policy 1, policy_version 1066712 (0.0010) [2023-12-28 02:54:18,964][106225] Updated weights for policy 1, policy_version 1066722 (0.0010) [2023-12-28 02:54:19,021][106225] Updated weights for policy 1, policy_version 1066732 (0.0007) [2023-12-28 02:54:19,625][106226] Updated weights for policy 0, policy_version 1064071 (0.0007) [2023-12-28 02:54:19,690][106226] Updated weights for policy 0, policy_version 1064081 (0.0008) [2023-12-28 02:54:19,751][106226] Updated weights for policy 0, policy_version 1064091 (0.0008) [2023-12-28 02:54:19,768][106225] Updated weights for policy 1, policy_version 1066742 (0.0008) [2023-12-28 02:54:19,821][106225] Updated weights for policy 1, policy_version 1066752 (0.0010) [2023-12-28 02:54:19,890][106225] Updated weights for policy 1, policy_version 1066762 (0.0006) [2023-12-28 02:54:20,519][106226] Updated weights for policy 0, policy_version 1064101 (0.0008) [2023-12-28 02:54:20,588][106226] Updated weights for policy 0, policy_version 1064111 (0.0010) [2023-12-28 02:54:20,600][106225] Updated weights for policy 1, policy_version 1066772 (0.0007) [2023-12-28 02:54:20,655][106226] Updated weights for policy 0, policy_version 1064121 (0.0008) [2023-12-28 02:54:20,661][106225] Updated weights for policy 1, policy_version 1066782 (0.0006) [2023-12-28 02:54:20,722][106225] Updated weights for policy 1, policy_version 1066792 (0.0009) [2023-12-28 02:54:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 545619968. Throughput: 0: 9995.8, 1: 9816.2. Samples: 545630724. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:21,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.866')] [2023-12-28 02:54:21,466][106225] Updated weights for policy 1, policy_version 1066802 (0.0011) [2023-12-28 02:54:21,466][106226] Updated weights for policy 0, policy_version 1064131 (0.0009) [2023-12-28 02:54:21,515][106225] Updated weights for policy 1, policy_version 1066812 (0.0010) [2023-12-28 02:54:21,517][106226] Updated weights for policy 0, policy_version 1064141 (0.0006) [2023-12-28 02:54:21,573][106226] Updated weights for policy 0, policy_version 1064151 (0.0006) [2023-12-28 02:54:21,574][106225] Updated weights for policy 1, policy_version 1066822 (0.0010) [2023-12-28 02:54:21,631][106225] Updated weights for policy 1, policy_version 1066832 (0.0010) [2023-12-28 02:54:22,339][106226] Updated weights for policy 0, policy_version 1064161 (0.0007) [2023-12-28 02:54:22,414][106226] Updated weights for policy 0, policy_version 1064171 (0.0007) [2023-12-28 02:54:22,428][106225] Updated weights for policy 1, policy_version 1066842 (0.0007) [2023-12-28 02:54:22,481][106226] Updated weights for policy 0, policy_version 1064181 (0.0007) [2023-12-28 02:54:22,491][106225] Updated weights for policy 1, policy_version 1066852 (0.0008) [2023-12-28 02:54:22,540][106226] Updated weights for policy 0, policy_version 1064191 (0.0006) [2023-12-28 02:54:22,549][106225] Updated weights for policy 1, policy_version 1066862 (0.0009) [2023-12-28 02:54:23,236][106226] Updated weights for policy 0, policy_version 1064201 (0.0007) [2023-12-28 02:54:23,284][106225] Updated weights for policy 1, policy_version 1066872 (0.0008) [2023-12-28 02:54:23,291][106226] Updated weights for policy 0, policy_version 1064211 (0.0005) [2023-12-28 02:54:23,343][106225] Updated weights for policy 1, policy_version 1066882 (0.0008) [2023-12-28 02:54:23,344][106226] Updated weights for policy 0, policy_version 1064221 (0.0005) [2023-12-28 02:54:23,397][106225] Updated weights for policy 1, policy_version 1066892 (0.0008) [2023-12-28 02:54:23,993][106226] Updated weights for policy 0, policy_version 1064231 (0.0007) [2023-12-28 02:54:23,998][106225] Updated weights for policy 1, policy_version 1066902 (0.0007) [2023-12-28 02:54:24,043][106226] Updated weights for policy 0, policy_version 1064241 (0.0008) [2023-12-28 02:54:24,061][106225] Updated weights for policy 1, policy_version 1066912 (0.0006) [2023-12-28 02:54:24,112][106226] Updated weights for policy 0, policy_version 1064251 (0.0008) [2023-12-28 02:54:24,116][106225] Updated weights for policy 1, policy_version 1066922 (0.0009) [2023-12-28 02:54:24,664][106225] Updated weights for policy 1, policy_version 1066932 (0.0005) [2023-12-28 02:54:24,714][106225] Updated weights for policy 1, policy_version 1066942 (0.0007) [2023-12-28 02:54:24,761][106225] Updated weights for policy 1, policy_version 1066952 (0.0008) [2023-12-28 02:54:24,905][106226] Updated weights for policy 0, policy_version 1064261 (0.0007) [2023-12-28 02:54:24,966][106226] Updated weights for policy 0, policy_version 1064271 (0.0007) [2023-12-28 02:54:25,024][106226] Updated weights for policy 0, policy_version 1064281 (0.0009) [2023-12-28 02:54:25,439][106225] Updated weights for policy 1, policy_version 1066962 (0.0007) [2023-12-28 02:54:25,497][106225] Updated weights for policy 1, policy_version 1066972 (0.0006) [2023-12-28 02:54:25,553][106225] Updated weights for policy 1, policy_version 1066982 (0.0006) [2023-12-28 02:54:25,617][106225] Updated weights for policy 1, policy_version 1066992 (0.0005) [2023-12-28 02:54:25,737][106226] Updated weights for policy 0, policy_version 1064291 (0.0008) [2023-12-28 02:54:25,802][106226] Updated weights for policy 0, policy_version 1064301 (0.0009) [2023-12-28 02:54:25,858][106226] Updated weights for policy 0, policy_version 1064311 (0.0008) [2023-12-28 02:54:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 545718272. Throughput: 0: 9935.6, 1: 9804.4. Samples: 545687912. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:26,176][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.009')] [2023-12-28 02:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001064320_272523264.pth... [2023-12-28 02:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001066992_273195008.pth... [2023-12-28 02:54:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001063168_272228352.pth [2023-12-28 02:54:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001065848_272900096.pth [2023-12-28 02:54:26,263][106225] Updated weights for policy 1, policy_version 1067002 (0.0008) [2023-12-28 02:54:26,331][106225] Updated weights for policy 1, policy_version 1067012 (0.0008) [2023-12-28 02:54:26,385][106225] Updated weights for policy 1, policy_version 1067022 (0.0008) [2023-12-28 02:54:26,583][106226] Updated weights for policy 0, policy_version 1064321 (0.0009) [2023-12-28 02:54:26,644][106226] Updated weights for policy 0, policy_version 1064331 (0.0008) [2023-12-28 02:54:26,702][106226] Updated weights for policy 0, policy_version 1064341 (0.0008) [2023-12-28 02:54:26,755][106226] Updated weights for policy 0, policy_version 1064351 (0.0008) [2023-12-28 02:54:27,035][106225] Updated weights for policy 1, policy_version 1067032 (0.0007) [2023-12-28 02:54:27,082][106225] Updated weights for policy 1, policy_version 1067042 (0.0010) [2023-12-28 02:54:27,139][106225] Updated weights for policy 1, policy_version 1067052 (0.0010) [2023-12-28 02:54:27,400][106226] Updated weights for policy 0, policy_version 1064361 (0.0007) [2023-12-28 02:54:27,454][106226] Updated weights for policy 0, policy_version 1064371 (0.0006) [2023-12-28 02:54:27,515][106226] Updated weights for policy 0, policy_version 1064381 (0.0005) [2023-12-28 02:54:27,918][106225] Updated weights for policy 1, policy_version 1067062 (0.0007) [2023-12-28 02:54:27,979][106225] Updated weights for policy 1, policy_version 1067072 (0.0005) [2023-12-28 02:54:28,037][106225] Updated weights for policy 1, policy_version 1067082 (0.0005) [2023-12-28 02:54:28,058][106226] Updated weights for policy 0, policy_version 1064391 (0.0009) [2023-12-28 02:54:28,121][106226] Updated weights for policy 0, policy_version 1064401 (0.0011) [2023-12-28 02:54:28,191][106226] Updated weights for policy 0, policy_version 1064411 (0.0011) [2023-12-28 02:54:28,655][106225] Updated weights for policy 1, policy_version 1067092 (0.0007) [2023-12-28 02:54:28,705][106225] Updated weights for policy 1, policy_version 1067102 (0.0008) [2023-12-28 02:54:28,758][106225] Updated weights for policy 1, policy_version 1067112 (0.0008) [2023-12-28 02:54:28,798][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000006 [2023-12-28 02:54:28,932][106226] Updated weights for policy 0, policy_version 1064421 (0.0010) [2023-12-28 02:54:28,982][106226] Updated weights for policy 0, policy_version 1064431 (0.0009) [2023-12-28 02:54:29,028][106226] Updated weights for policy 0, policy_version 1064441 (0.0008) [2023-12-28 02:54:29,449][106225] Updated weights for policy 1, policy_version 1067122 (0.0008) [2023-12-28 02:54:29,509][106225] Updated weights for policy 1, policy_version 1067132 (0.0006) [2023-12-28 02:54:29,570][106225] Updated weights for policy 1, policy_version 1067142 (0.0008) [2023-12-28 02:54:29,632][106225] Updated weights for policy 1, policy_version 1067152 (0.0009) [2023-12-28 02:54:29,781][106226] Updated weights for policy 0, policy_version 1064451 (0.0007) [2023-12-28 02:54:29,843][106226] Updated weights for policy 0, policy_version 1064461 (0.0007) [2023-12-28 02:54:29,904][106226] Updated weights for policy 0, policy_version 1064471 (0.0008) [2023-12-28 02:54:30,267][106225] Updated weights for policy 1, policy_version 1067162 (0.0006) [2023-12-28 02:54:30,336][106225] Updated weights for policy 1, policy_version 1067172 (0.0006) [2023-12-28 02:54:30,400][106225] Updated weights for policy 1, policy_version 1067182 (0.0008) [2023-12-28 02:54:30,626][106226] Updated weights for policy 0, policy_version 1064481 (0.0008) [2023-12-28 02:54:30,685][106226] Updated weights for policy 0, policy_version 1064491 (0.0005) [2023-12-28 02:54:30,735][106226] Updated weights for policy 0, policy_version 1064501 (0.0005) [2023-12-28 02:54:30,790][106226] Updated weights for policy 0, policy_version 1064511 (0.0005) [2023-12-28 02:54:31,055][106225] Updated weights for policy 1, policy_version 1067192 (0.0008) [2023-12-28 02:54:31,121][106225] Updated weights for policy 1, policy_version 1067202 (0.0006) [2023-12-28 02:54:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 545816576. Throughput: 0: 9917.4, 1: 9897.9. Samples: 545809644. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:31,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.754')] [2023-12-28 02:54:31,188][106225] Updated weights for policy 1, policy_version 1067212 (0.0009) [2023-12-28 02:54:31,526][106226] Updated weights for policy 0, policy_version 1064521 (0.0009) [2023-12-28 02:54:31,580][106226] Updated weights for policy 0, policy_version 1064531 (0.0009) [2023-12-28 02:54:31,642][106226] Updated weights for policy 0, policy_version 1064541 (0.0009) [2023-12-28 02:54:31,814][106225] Updated weights for policy 1, policy_version 1067222 (0.0008) [2023-12-28 02:54:31,887][106225] Updated weights for policy 1, policy_version 1067232 (0.0008) [2023-12-28 02:54:31,953][106225] Updated weights for policy 1, policy_version 1067242 (0.0008) [2023-12-28 02:54:32,332][106226] Updated weights for policy 0, policy_version 1064551 (0.0008) [2023-12-28 02:54:32,404][106226] Updated weights for policy 0, policy_version 1064561 (0.0009) [2023-12-28 02:54:32,466][106226] Updated weights for policy 0, policy_version 1064571 (0.0009) [2023-12-28 02:54:32,666][106225] Updated weights for policy 1, policy_version 1067252 (0.0008) [2023-12-28 02:54:32,720][106225] Updated weights for policy 1, policy_version 1067262 (0.0008) [2023-12-28 02:54:32,781][106225] Updated weights for policy 1, policy_version 1067272 (0.0006) [2023-12-28 02:54:33,193][106226] Updated weights for policy 0, policy_version 1064581 (0.0007) [2023-12-28 02:54:33,238][106226] Updated weights for policy 0, policy_version 1064591 (0.0006) [2023-12-28 02:54:33,282][106226] Updated weights for policy 0, policy_version 1064601 (0.0006) [2023-12-28 02:54:33,494][106225] Updated weights for policy 1, policy_version 1067282 (0.0008) [2023-12-28 02:54:33,539][106225] Updated weights for policy 1, policy_version 1067292 (0.0007) [2023-12-28 02:54:33,589][106225] Updated weights for policy 1, policy_version 1067302 (0.0007) [2023-12-28 02:54:33,651][106225] Updated weights for policy 1, policy_version 1067312 (0.0009) [2023-12-28 02:54:33,902][106226] Updated weights for policy 0, policy_version 1064611 (0.0009) [2023-12-28 02:54:33,963][106226] Updated weights for policy 0, policy_version 1064621 (0.0011) [2023-12-28 02:54:34,016][106226] Updated weights for policy 0, policy_version 1064631 (0.0010) [2023-12-28 02:54:34,387][106225] Updated weights for policy 1, policy_version 1067322 (0.0009) [2023-12-28 02:54:34,441][106225] Updated weights for policy 1, policy_version 1067332 (0.0008) [2023-12-28 02:54:34,510][106225] Updated weights for policy 1, policy_version 1067342 (0.0009) [2023-12-28 02:54:34,632][106226] Updated weights for policy 0, policy_version 1064641 (0.0010) [2023-12-28 02:54:34,700][106226] Updated weights for policy 0, policy_version 1064651 (0.0008) [2023-12-28 02:54:34,767][106226] Updated weights for policy 0, policy_version 1064661 (0.0011) [2023-12-28 02:54:34,862][106226] Updated weights for policy 0, policy_version 1064671 (0.0010) [2023-12-28 02:54:35,257][106225] Updated weights for policy 1, policy_version 1067352 (0.0006) [2023-12-28 02:54:35,313][106225] Updated weights for policy 1, policy_version 1067362 (0.0005) [2023-12-28 02:54:35,374][106225] Updated weights for policy 1, policy_version 1067372 (0.0005) [2023-12-28 02:54:35,437][106226] Updated weights for policy 0, policy_version 1064681 (0.0010) [2023-12-28 02:54:35,490][106226] Updated weights for policy 0, policy_version 1064691 (0.0010) [2023-12-28 02:54:35,546][106226] Updated weights for policy 0, policy_version 1064701 (0.0010) [2023-12-28 02:54:35,885][106225] Updated weights for policy 1, policy_version 1067382 (0.0007) [2023-12-28 02:54:35,935][106225] Updated weights for policy 1, policy_version 1067392 (0.0007) [2023-12-28 02:54:35,985][106225] Updated weights for policy 1, policy_version 1067402 (0.0007) [2023-12-28 02:54:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 545923072. Throughput: 0: 9919.5, 1: 9959.0. Samples: 545932752. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:36,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.839')] [2023-12-28 02:54:36,223][106226] Updated weights for policy 0, policy_version 1064711 (0.0007) [2023-12-28 02:54:36,283][106226] Updated weights for policy 0, policy_version 1064721 (0.0009) [2023-12-28 02:54:36,346][106226] Updated weights for policy 0, policy_version 1064731 (0.0011) [2023-12-28 02:54:36,690][106225] Updated weights for policy 1, policy_version 1067412 (0.0007) [2023-12-28 02:54:36,754][106225] Updated weights for policy 1, policy_version 1067422 (0.0005) [2023-12-28 02:54:36,820][106225] Updated weights for policy 1, policy_version 1067432 (0.0005) [2023-12-28 02:54:37,069][106226] Updated weights for policy 0, policy_version 1064741 (0.0008) [2023-12-28 02:54:37,129][106226] Updated weights for policy 0, policy_version 1064751 (0.0008) [2023-12-28 02:54:37,184][106226] Updated weights for policy 0, policy_version 1064761 (0.0010) [2023-12-28 02:54:37,398][106225] Updated weights for policy 1, policy_version 1067442 (0.0007) [2023-12-28 02:54:37,459][106225] Updated weights for policy 1, policy_version 1067452 (0.0008) [2023-12-28 02:54:37,509][106225] Updated weights for policy 1, policy_version 1067462 (0.0008) [2023-12-28 02:54:37,570][106225] Updated weights for policy 1, policy_version 1067472 (0.0008) [2023-12-28 02:54:37,915][106226] Updated weights for policy 0, policy_version 1064771 (0.0009) [2023-12-28 02:54:37,968][106226] Updated weights for policy 0, policy_version 1064781 (0.0006) [2023-12-28 02:54:38,034][106226] Updated weights for policy 0, policy_version 1064791 (0.0008) [2023-12-28 02:54:38,225][106225] Updated weights for policy 1, policy_version 1067482 (0.0008) [2023-12-28 02:54:38,285][106225] Updated weights for policy 1, policy_version 1067492 (0.0007) [2023-12-28 02:54:38,346][106225] Updated weights for policy 1, policy_version 1067502 (0.0006) [2023-12-28 02:54:38,693][106226] Updated weights for policy 0, policy_version 1064801 (0.0008) [2023-12-28 02:54:38,759][106226] Updated weights for policy 0, policy_version 1064811 (0.0009) [2023-12-28 02:54:38,825][106226] Updated weights for policy 0, policy_version 1064821 (0.0007) [2023-12-28 02:54:38,893][106226] Updated weights for policy 0, policy_version 1064831 (0.0009) [2023-12-28 02:54:39,068][106225] Updated weights for policy 1, policy_version 1067512 (0.0009) [2023-12-28 02:54:39,124][106225] Updated weights for policy 1, policy_version 1067522 (0.0008) [2023-12-28 02:54:39,173][106225] Updated weights for policy 1, policy_version 1067532 (0.0009) [2023-12-28 02:54:39,663][106226] Updated weights for policy 0, policy_version 1064841 (0.0010) [2023-12-28 02:54:39,725][106226] Updated weights for policy 0, policy_version 1064851 (0.0009) [2023-12-28 02:54:39,778][106226] Updated weights for policy 0, policy_version 1064861 (0.0008) [2023-12-28 02:54:39,959][106225] Updated weights for policy 1, policy_version 1067542 (0.0008) [2023-12-28 02:54:40,023][106225] Updated weights for policy 1, policy_version 1067552 (0.0009) [2023-12-28 02:54:40,084][106225] Updated weights for policy 1, policy_version 1067562 (0.0008) [2023-12-28 02:54:40,512][106226] Updated weights for policy 0, policy_version 1064871 (0.0007) [2023-12-28 02:54:40,561][106226] Updated weights for policy 0, policy_version 1064881 (0.0005) [2023-12-28 02:54:40,614][106226] Updated weights for policy 0, policy_version 1064891 (0.0006) [2023-12-28 02:54:40,798][106225] Updated weights for policy 1, policy_version 1067572 (0.0010) [2023-12-28 02:54:40,848][106225] Updated weights for policy 1, policy_version 1067582 (0.0008) [2023-12-28 02:54:40,899][106225] Updated weights for policy 1, policy_version 1067592 (0.0009) [2023-12-28 02:54:41,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 546021376. Throughput: 0: 9935.0, 1: 10009.5. Samples: 545992976. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:41,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.570')] [2023-12-28 02:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001064896_272670720.pth... [2023-12-28 02:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001067600_273350656.pth... [2023-12-28 02:54:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001063744_272375808.pth [2023-12-28 02:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001066416_273047552.pth [2023-12-28 02:54:41,270][106226] Updated weights for policy 0, policy_version 1064901 (0.0008) [2023-12-28 02:54:41,338][106226] Updated weights for policy 0, policy_version 1064911 (0.0007) [2023-12-28 02:54:41,404][106226] Updated weights for policy 0, policy_version 1064921 (0.0007) [2023-12-28 02:54:41,721][106225] Updated weights for policy 1, policy_version 1067602 (0.0009) [2023-12-28 02:54:41,793][106225] Updated weights for policy 1, policy_version 1067612 (0.0006) [2023-12-28 02:54:41,854][106225] Updated weights for policy 1, policy_version 1067622 (0.0005) [2023-12-28 02:54:41,919][106225] Updated weights for policy 1, policy_version 1067632 (0.0007) [2023-12-28 02:54:42,109][106226] Updated weights for policy 0, policy_version 1064931 (0.0008) [2023-12-28 02:54:42,172][106226] Updated weights for policy 0, policy_version 1064941 (0.0006) [2023-12-28 02:54:42,227][106226] Updated weights for policy 0, policy_version 1064951 (0.0007) [2023-12-28 02:54:42,597][106225] Updated weights for policy 1, policy_version 1067642 (0.0006) [2023-12-28 02:54:42,656][106225] Updated weights for policy 1, policy_version 1067652 (0.0005) [2023-12-28 02:54:42,717][106225] Updated weights for policy 1, policy_version 1067662 (0.0005) [2023-12-28 02:54:42,997][106226] Updated weights for policy 0, policy_version 1064961 (0.0008) [2023-12-28 02:54:43,058][106226] Updated weights for policy 0, policy_version 1064971 (0.0006) [2023-12-28 02:54:43,111][106226] Updated weights for policy 0, policy_version 1064981 (0.0007) [2023-12-28 02:54:43,165][106226] Updated weights for policy 0, policy_version 1064991 (0.0011) [2023-12-28 02:54:43,253][106225] Updated weights for policy 1, policy_version 1067672 (0.0008) [2023-12-28 02:54:43,309][106225] Updated weights for policy 1, policy_version 1067682 (0.0007) [2023-12-28 02:54:43,367][106225] Updated weights for policy 1, policy_version 1067692 (0.0008) [2023-12-28 02:54:43,810][106226] Updated weights for policy 0, policy_version 1065001 (0.0006) [2023-12-28 02:54:43,859][106226] Updated weights for policy 0, policy_version 1065011 (0.0007) [2023-12-28 02:54:43,915][106226] Updated weights for policy 0, policy_version 1065021 (0.0006) [2023-12-28 02:54:43,937][106225] Updated weights for policy 1, policy_version 1067702 (0.0005) [2023-12-28 02:54:43,992][106225] Updated weights for policy 1, policy_version 1067712 (0.0005) [2023-12-28 02:54:44,046][106225] Updated weights for policy 1, policy_version 1067722 (0.0008) [2023-12-28 02:54:44,557][106226] Updated weights for policy 0, policy_version 1065031 (0.0005) [2023-12-28 02:54:44,621][106226] Updated weights for policy 0, policy_version 1065041 (0.0005) [2023-12-28 02:54:44,626][106225] Updated weights for policy 1, policy_version 1067732 (0.0007) [2023-12-28 02:54:44,678][106225] Updated weights for policy 1, policy_version 1067742 (0.0005) [2023-12-28 02:54:44,678][106226] Updated weights for policy 0, policy_version 1065051 (0.0006) [2023-12-28 02:54:44,734][106225] Updated weights for policy 1, policy_version 1067752 (0.0006) [2023-12-28 02:54:45,323][106226] Updated weights for policy 0, policy_version 1065061 (0.0008) [2023-12-28 02:54:45,380][106226] Updated weights for policy 0, policy_version 1065071 (0.0005) [2023-12-28 02:54:45,388][106225] Updated weights for policy 1, policy_version 1067762 (0.0007) [2023-12-28 02:54:45,438][106226] Updated weights for policy 0, policy_version 1065081 (0.0006) [2023-12-28 02:54:45,455][106225] Updated weights for policy 1, policy_version 1067772 (0.0007) [2023-12-28 02:54:45,517][106225] Updated weights for policy 1, policy_version 1067782 (0.0007) [2023-12-28 02:54:45,584][106225] Updated weights for policy 1, policy_version 1067792 (0.0008) [2023-12-28 02:54:46,101][106226] Updated weights for policy 0, policy_version 1065091 (0.0011) [2023-12-28 02:54:46,164][106226] Updated weights for policy 0, policy_version 1065101 (0.0011) [2023-12-28 02:54:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 546119680. Throughput: 0: 9935.3, 1: 10056.8. Samples: 546114296. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:46,176][105115] Avg episode reward: [(0, '-4.674'), (1, '-4.933')] [2023-12-28 02:54:46,197][106225] Updated weights for policy 1, policy_version 1067802 (0.0007) [2023-12-28 02:54:46,220][106226] Updated weights for policy 0, policy_version 1065111 (0.0010) [2023-12-28 02:54:46,249][106225] Updated weights for policy 1, policy_version 1067812 (0.0009) [2023-12-28 02:54:46,304][106225] Updated weights for policy 1, policy_version 1067822 (0.0008) [2023-12-28 02:54:46,847][106226] Updated weights for policy 0, policy_version 1065121 (0.0005) [2023-12-28 02:54:46,903][106226] Updated weights for policy 0, policy_version 1065131 (0.0007) [2023-12-28 02:54:46,953][106226] Updated weights for policy 0, policy_version 1065141 (0.0007) [2023-12-28 02:54:47,013][106226] Updated weights for policy 0, policy_version 1065151 (0.0007) [2023-12-28 02:54:47,086][106225] Updated weights for policy 1, policy_version 1067832 (0.0009) [2023-12-28 02:54:47,146][106225] Updated weights for policy 1, policy_version 1067842 (0.0008) [2023-12-28 02:54:47,213][106225] Updated weights for policy 1, policy_version 1067852 (0.0006) [2023-12-28 02:54:47,612][106226] Updated weights for policy 0, policy_version 1065161 (0.0009) [2023-12-28 02:54:47,668][106226] Updated weights for policy 0, policy_version 1065171 (0.0007) [2023-12-28 02:54:47,722][106226] Updated weights for policy 0, policy_version 1065181 (0.0009) [2023-12-28 02:54:47,857][106225] Updated weights for policy 1, policy_version 1067862 (0.0009) [2023-12-28 02:54:47,912][106225] Updated weights for policy 1, policy_version 1067872 (0.0005) [2023-12-28 02:54:47,965][106225] Updated weights for policy 1, policy_version 1067882 (0.0005) [2023-12-28 02:54:48,471][106226] Updated weights for policy 0, policy_version 1065191 (0.0007) [2023-12-28 02:54:48,527][106226] Updated weights for policy 0, policy_version 1065201 (0.0008) [2023-12-28 02:54:48,580][106226] Updated weights for policy 0, policy_version 1065211 (0.0009) [2023-12-28 02:54:48,665][106225] Updated weights for policy 1, policy_version 1067892 (0.0005) [2023-12-28 02:54:48,731][106225] Updated weights for policy 1, policy_version 1067902 (0.0005) [2023-12-28 02:54:48,798][106225] Updated weights for policy 1, policy_version 1067912 (0.0006) [2023-12-28 02:54:49,395][106226] Updated weights for policy 0, policy_version 1065221 (0.0009) [2023-12-28 02:54:49,405][106225] Updated weights for policy 1, policy_version 1067922 (0.0006) [2023-12-28 02:54:49,461][106226] Updated weights for policy 0, policy_version 1065231 (0.0008) [2023-12-28 02:54:49,472][106225] Updated weights for policy 1, policy_version 1067932 (0.0006) [2023-12-28 02:54:49,517][106226] Updated weights for policy 0, policy_version 1065241 (0.0008) [2023-12-28 02:54:49,533][106225] Updated weights for policy 1, policy_version 1067942 (0.0008) [2023-12-28 02:54:49,584][106225] Updated weights for policy 1, policy_version 1067952 (0.0006) [2023-12-28 02:54:50,250][106226] Updated weights for policy 0, policy_version 1065251 (0.0009) [2023-12-28 02:54:50,282][106225] Updated weights for policy 1, policy_version 1067962 (0.0008) [2023-12-28 02:54:50,313][106226] Updated weights for policy 0, policy_version 1065261 (0.0011) [2023-12-28 02:54:50,342][106225] Updated weights for policy 1, policy_version 1067972 (0.0007) [2023-12-28 02:54:50,373][106226] Updated weights for policy 0, policy_version 1065271 (0.0011) [2023-12-28 02:54:50,395][106225] Updated weights for policy 1, policy_version 1067982 (0.0009) [2023-12-28 02:54:51,044][106226] Updated weights for policy 0, policy_version 1065281 (0.0011) [2023-12-28 02:54:51,106][106226] Updated weights for policy 0, policy_version 1065291 (0.0010) [2023-12-28 02:54:51,174][106226] Updated weights for policy 0, policy_version 1065301 (0.0008) [2023-12-28 02:54:51,175][106225] Updated weights for policy 1, policy_version 1067992 (0.0007) [2023-12-28 02:54:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 546217984. Throughput: 0: 9911.9, 1: 10133.5. Samples: 546234816. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:51,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-4.723')] [2023-12-28 02:54:51,237][106226] Updated weights for policy 0, policy_version 1065311 (0.0009) [2023-12-28 02:54:51,237][106225] Updated weights for policy 1, policy_version 1068002 (0.0008) [2023-12-28 02:54:51,310][106225] Updated weights for policy 1, policy_version 1068012 (0.0008) [2023-12-28 02:54:51,939][106226] Updated weights for policy 0, policy_version 1065321 (0.0009) [2023-12-28 02:54:52,007][106226] Updated weights for policy 0, policy_version 1065331 (0.0009) [2023-12-28 02:54:52,041][106225] Updated weights for policy 1, policy_version 1068022 (0.0008) [2023-12-28 02:54:52,067][106226] Updated weights for policy 0, policy_version 1065341 (0.0010) [2023-12-28 02:54:52,104][106225] Updated weights for policy 1, policy_version 1068032 (0.0008) [2023-12-28 02:54:52,157][106225] Updated weights for policy 1, policy_version 1068042 (0.0008) [2023-12-28 02:54:52,799][106225] Updated weights for policy 1, policy_version 1068052 (0.0007) [2023-12-28 02:54:52,802][106226] Updated weights for policy 0, policy_version 1065351 (0.0007) [2023-12-28 02:54:52,849][106225] Updated weights for policy 1, policy_version 1068062 (0.0008) [2023-12-28 02:54:52,871][106226] Updated weights for policy 0, policy_version 1065361 (0.0006) [2023-12-28 02:54:52,898][106225] Updated weights for policy 1, policy_version 1068072 (0.0008) [2023-12-28 02:54:52,925][106226] Updated weights for policy 0, policy_version 1065371 (0.0006) [2023-12-28 02:54:53,503][106226] Updated weights for policy 0, policy_version 1065381 (0.0006) [2023-12-28 02:54:53,554][106226] Updated weights for policy 0, policy_version 1065391 (0.0006) [2023-12-28 02:54:53,567][106225] Updated weights for policy 1, policy_version 1068082 (0.0007) [2023-12-28 02:54:53,619][106226] Updated weights for policy 0, policy_version 1065401 (0.0009) [2023-12-28 02:54:53,627][106225] Updated weights for policy 1, policy_version 1068092 (0.0009) [2023-12-28 02:54:53,681][106225] Updated weights for policy 1, policy_version 1068102 (0.0008) [2023-12-28 02:54:54,320][106226] Updated weights for policy 0, policy_version 1065411 (0.0007) [2023-12-28 02:54:54,378][106226] Updated weights for policy 0, policy_version 1065421 (0.0005) [2023-12-28 02:54:54,415][106225] Updated weights for policy 1, policy_version 1068113 (0.0008) [2023-12-28 02:54:54,438][106226] Updated weights for policy 0, policy_version 1065431 (0.0005) [2023-12-28 02:54:54,478][106225] Updated weights for policy 1, policy_version 1068123 (0.0008) [2023-12-28 02:54:54,544][106225] Updated weights for policy 1, policy_version 1068133 (0.0008) [2023-12-28 02:54:54,610][106225] Updated weights for policy 1, policy_version 1068143 (0.0008) [2023-12-28 02:54:55,152][106226] Updated weights for policy 0, policy_version 1065441 (0.0007) [2023-12-28 02:54:55,159][106225] Updated weights for policy 1, policy_version 1068153 (0.0006) [2023-12-28 02:54:55,202][106226] Updated weights for policy 0, policy_version 1065451 (0.0006) [2023-12-28 02:54:55,208][106225] Updated weights for policy 1, policy_version 1068163 (0.0006) [2023-12-28 02:54:55,254][106226] Updated weights for policy 0, policy_version 1065461 (0.0010) [2023-12-28 02:54:55,263][106225] Updated weights for policy 1, policy_version 1068173 (0.0005) [2023-12-28 02:54:55,307][106226] Updated weights for policy 0, policy_version 1065471 (0.0010) [2023-12-28 02:54:55,887][106225] Updated weights for policy 1, policy_version 1068183 (0.0006) [2023-12-28 02:54:55,947][106225] Updated weights for policy 1, policy_version 1068193 (0.0005) [2023-12-28 02:54:56,016][106225] Updated weights for policy 1, policy_version 1068203 (0.0005) [2023-12-28 02:54:56,031][106226] Updated weights for policy 0, policy_version 1065481 (0.0008) [2023-12-28 02:54:56,104][106226] Updated weights for policy 0, policy_version 1065491 (0.0008) [2023-12-28 02:54:56,172][106226] Updated weights for policy 0, policy_version 1065501 (0.0007) [2023-12-28 02:54:56,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 546324480. Throughput: 0: 9916.6, 1: 10132.9. Samples: 546294384. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:54:56,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-5.143')] [2023-12-28 02:54:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001068208_273506304.pth... [2023-12-28 02:54:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001066992_273195008.pth [2023-12-28 02:54:56,191][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001065504_272826368.pth... [2023-12-28 02:54:56,196][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001064320_272523264.pth [2023-12-28 02:54:56,694][106225] Updated weights for policy 1, policy_version 1068213 (0.0006) [2023-12-28 02:54:56,741][106226] Updated weights for policy 0, policy_version 1065511 (0.0006) [2023-12-28 02:54:56,745][106225] Updated weights for policy 1, policy_version 1068223 (0.0005) [2023-12-28 02:54:56,789][106226] Updated weights for policy 0, policy_version 1065521 (0.0005) [2023-12-28 02:54:56,793][106225] Updated weights for policy 1, policy_version 1068233 (0.0005) [2023-12-28 02:54:56,837][106226] Updated weights for policy 0, policy_version 1065531 (0.0005) [2023-12-28 02:54:57,328][106225] Updated weights for policy 1, policy_version 1068243 (0.0006) [2023-12-28 02:54:57,382][106225] Updated weights for policy 1, policy_version 1068253 (0.0006) [2023-12-28 02:54:57,384][106226] Updated weights for policy 0, policy_version 1065541 (0.0008) [2023-12-28 02:54:57,431][106226] Updated weights for policy 0, policy_version 1065551 (0.0009) [2023-12-28 02:54:57,436][106225] Updated weights for policy 1, policy_version 1068263 (0.0007) [2023-12-28 02:54:57,485][106226] Updated weights for policy 0, policy_version 1065561 (0.0006) [2023-12-28 02:54:58,084][106225] Updated weights for policy 1, policy_version 1068273 (0.0008) [2023-12-28 02:54:58,091][106226] Updated weights for policy 0, policy_version 1065571 (0.0005) [2023-12-28 02:54:58,136][106225] Updated weights for policy 1, policy_version 1068283 (0.0006) [2023-12-28 02:54:58,152][106226] Updated weights for policy 0, policy_version 1065581 (0.0005) [2023-12-28 02:54:58,194][106225] Updated weights for policy 1, policy_version 1068293 (0.0006) [2023-12-28 02:54:58,221][106226] Updated weights for policy 0, policy_version 1065591 (0.0009) [2023-12-28 02:54:58,257][106225] Updated weights for policy 1, policy_version 1068303 (0.0008) [2023-12-28 02:54:58,967][106226] Updated weights for policy 0, policy_version 1065601 (0.0010) [2023-12-28 02:54:59,031][106226] Updated weights for policy 0, policy_version 1065611 (0.0008) [2023-12-28 02:54:59,079][106225] Updated weights for policy 1, policy_version 1068313 (0.0010) [2023-12-28 02:54:59,097][106226] Updated weights for policy 0, policy_version 1065621 (0.0008) [2023-12-28 02:54:59,146][106225] Updated weights for policy 1, policy_version 1068323 (0.0009) [2023-12-28 02:54:59,166][106226] Updated weights for policy 0, policy_version 1065631 (0.0008) [2023-12-28 02:54:59,221][106225] Updated weights for policy 1, policy_version 1068333 (0.0009) [2023-12-28 02:54:59,969][106226] Updated weights for policy 0, policy_version 1065641 (0.0007) [2023-12-28 02:55:00,031][106226] Updated weights for policy 0, policy_version 1065651 (0.0007) [2023-12-28 02:55:00,041][106225] Updated weights for policy 1, policy_version 1068343 (0.0007) [2023-12-28 02:55:00,091][106226] Updated weights for policy 0, policy_version 1065661 (0.0009) [2023-12-28 02:55:00,097][106225] Updated weights for policy 1, policy_version 1068353 (0.0008) [2023-12-28 02:55:00,151][106225] Updated weights for policy 1, policy_version 1068363 (0.0008) [2023-12-28 02:55:00,762][106226] Updated weights for policy 0, policy_version 1065671 (0.0009) [2023-12-28 02:55:00,808][106226] Updated weights for policy 0, policy_version 1065681 (0.0010) [2023-12-28 02:55:00,842][106225] Updated weights for policy 1, policy_version 1068373 (0.0006) [2023-12-28 02:55:00,869][106226] Updated weights for policy 0, policy_version 1065691 (0.0010) [2023-12-28 02:55:00,884][106225] Updated weights for policy 1, policy_version 1068383 (0.0007) [2023-12-28 02:55:00,942][106225] Updated weights for policy 1, policy_version 1068393 (0.0008) [2023-12-28 02:55:01,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 546430976. Throughput: 0: 9966.4, 1: 10138.2. Samples: 546416760. Policy #0 lag: (min: 4.0, avg: 8.6, max: 36.0) [2023-12-28 02:55:01,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.132')] [2023-12-28 02:55:01,663][106226] Updated weights for policy 0, policy_version 1065701 (0.0008) [2023-12-28 02:55:01,702][106225] Updated weights for policy 1, policy_version 1068403 (0.0006) [2023-12-28 02:55:01,734][106226] Updated weights for policy 0, policy_version 1065711 (0.0006) [2023-12-28 02:55:01,764][106225] Updated weights for policy 1, policy_version 1068413 (0.0008) [2023-12-28 02:55:01,795][106226] Updated weights for policy 0, policy_version 1065721 (0.0006) [2023-12-28 02:55:01,821][106225] Updated weights for policy 1, policy_version 1068423 (0.0008) [2023-12-28 02:55:02,454][106226] Updated weights for policy 0, policy_version 1065731 (0.0005) [2023-12-28 02:55:02,485][106225] Updated weights for policy 1, policy_version 1068433 (0.0008) [2023-12-28 02:55:02,515][106226] Updated weights for policy 0, policy_version 1065741 (0.0007) [2023-12-28 02:55:02,548][106225] Updated weights for policy 1, policy_version 1068443 (0.0005) [2023-12-28 02:55:02,569][106226] Updated weights for policy 0, policy_version 1065751 (0.0008) [2023-12-28 02:55:02,612][106225] Updated weights for policy 1, policy_version 1068453 (0.0007) [2023-12-28 02:55:02,677][106225] Updated weights for policy 1, policy_version 1068463 (0.0008) [2023-12-28 02:55:03,198][106226] Updated weights for policy 0, policy_version 1065761 (0.0007) [2023-12-28 02:55:03,236][106225] Updated weights for policy 1, policy_version 1068473 (0.0007) [2023-12-28 02:55:03,248][106226] Updated weights for policy 0, policy_version 1065771 (0.0010) [2023-12-28 02:55:03,301][106226] Updated weights for policy 0, policy_version 1065781 (0.0008) [2023-12-28 02:55:03,301][106225] Updated weights for policy 1, policy_version 1068483 (0.0008) [2023-12-28 02:55:03,360][106226] Updated weights for policy 0, policy_version 1065791 (0.0005) [2023-12-28 02:55:03,368][106225] Updated weights for policy 1, policy_version 1068493 (0.0007) [2023-12-28 02:55:03,964][106225] Updated weights for policy 1, policy_version 1068503 (0.0009) [2023-12-28 02:55:03,987][106226] Updated weights for policy 0, policy_version 1065801 (0.0010) [2023-12-28 02:55:04,025][106225] Updated weights for policy 1, policy_version 1068513 (0.0010) [2023-12-28 02:55:04,054][106226] Updated weights for policy 0, policy_version 1065811 (0.0011) [2023-12-28 02:55:04,088][106225] Updated weights for policy 1, policy_version 1068523 (0.0011) [2023-12-28 02:55:04,115][106226] Updated weights for policy 0, policy_version 1065821 (0.0011) [2023-12-28 02:55:04,787][106225] Updated weights for policy 1, policy_version 1068533 (0.0007) [2023-12-28 02:55:04,840][106226] Updated weights for policy 0, policy_version 1065831 (0.0007) [2023-12-28 02:55:04,858][106225] Updated weights for policy 1, policy_version 1068543 (0.0007) [2023-12-28 02:55:04,891][106226] Updated weights for policy 0, policy_version 1065841 (0.0006) [2023-12-28 02:55:04,924][106225] Updated weights for policy 1, policy_version 1068553 (0.0008) [2023-12-28 02:55:04,951][106226] Updated weights for policy 0, policy_version 1065851 (0.0009) [2023-12-28 02:55:05,515][106226] Updated weights for policy 0, policy_version 1065861 (0.0008) [2023-12-28 02:55:05,549][106225] Updated weights for policy 1, policy_version 1068563 (0.0010) [2023-12-28 02:55:05,571][106226] Updated weights for policy 0, policy_version 1065871 (0.0005) [2023-12-28 02:55:05,612][106225] Updated weights for policy 1, policy_version 1068573 (0.0010) [2023-12-28 02:55:05,626][106226] Updated weights for policy 0, policy_version 1065881 (0.0005) [2023-12-28 02:55:05,666][106225] Updated weights for policy 1, policy_version 1068583 (0.0010) [2023-12-28 02:55:06,171][106226] Updated weights for policy 0, policy_version 1065891 (0.0007) [2023-12-28 02:55:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 546529280. Throughput: 0: 10059.3, 1: 10182.0. Samples: 546541580. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:06,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.991')] [2023-12-28 02:55:06,232][106226] Updated weights for policy 0, policy_version 1065901 (0.0011) [2023-12-28 02:55:06,260][106225] Updated weights for policy 1, policy_version 1068593 (0.0010) [2023-12-28 02:55:06,292][106226] Updated weights for policy 0, policy_version 1065911 (0.0011) [2023-12-28 02:55:06,309][106225] Updated weights for policy 1, policy_version 1068603 (0.0010) [2023-12-28 02:55:06,372][106225] Updated weights for policy 1, policy_version 1068613 (0.0010) [2023-12-28 02:55:06,434][106225] Updated weights for policy 1, policy_version 1068623 (0.0009) [2023-12-28 02:55:06,997][106226] Updated weights for policy 0, policy_version 1065921 (0.0010) [2023-12-28 02:55:07,060][106226] Updated weights for policy 0, policy_version 1065931 (0.0005) [2023-12-28 02:55:07,120][106226] Updated weights for policy 0, policy_version 1065941 (0.0009) [2023-12-28 02:55:07,165][106225] Updated weights for policy 1, policy_version 1068633 (0.0010) [2023-12-28 02:55:07,172][106226] Updated weights for policy 0, policy_version 1065951 (0.0009) [2023-12-28 02:55:07,220][106225] Updated weights for policy 1, policy_version 1068643 (0.0010) [2023-12-28 02:55:07,270][106225] Updated weights for policy 1, policy_version 1068653 (0.0010) [2023-12-28 02:55:07,824][106226] Updated weights for policy 0, policy_version 1065961 (0.0010) [2023-12-28 02:55:07,873][106226] Updated weights for policy 0, policy_version 1065971 (0.0010) [2023-12-28 02:55:07,927][106226] Updated weights for policy 0, policy_version 1065981 (0.0010) [2023-12-28 02:55:08,009][106225] Updated weights for policy 1, policy_version 1068663 (0.0010) [2023-12-28 02:55:08,065][106225] Updated weights for policy 1, policy_version 1068673 (0.0010) [2023-12-28 02:55:08,112][106225] Updated weights for policy 1, policy_version 1068683 (0.0010) [2023-12-28 02:55:08,672][106226] Updated weights for policy 0, policy_version 1065991 (0.0010) [2023-12-28 02:55:08,738][106226] Updated weights for policy 0, policy_version 1066001 (0.0011) [2023-12-28 02:55:08,802][106226] Updated weights for policy 0, policy_version 1066011 (0.0009) [2023-12-28 02:55:08,881][106225] Updated weights for policy 1, policy_version 1068693 (0.0010) [2023-12-28 02:55:08,943][106225] Updated weights for policy 1, policy_version 1068703 (0.0010) [2023-12-28 02:55:09,006][106225] Updated weights for policy 1, policy_version 1068713 (0.0009) [2023-12-28 02:55:09,535][106226] Updated weights for policy 0, policy_version 1066021 (0.0008) [2023-12-28 02:55:09,595][106226] Updated weights for policy 0, policy_version 1066031 (0.0011) [2023-12-28 02:55:09,650][106226] Updated weights for policy 0, policy_version 1066041 (0.0011) [2023-12-28 02:55:09,733][106225] Updated weights for policy 1, policy_version 1068723 (0.0009) [2023-12-28 02:55:09,792][106225] Updated weights for policy 1, policy_version 1068733 (0.0008) [2023-12-28 02:55:09,865][106225] Updated weights for policy 1, policy_version 1068743 (0.0008) [2023-12-28 02:55:10,447][106226] Updated weights for policy 0, policy_version 1066051 (0.0011) [2023-12-28 02:55:10,501][106226] Updated weights for policy 0, policy_version 1066061 (0.0011) [2023-12-28 02:55:10,551][106226] Updated weights for policy 0, policy_version 1066071 (0.0010) [2023-12-28 02:55:10,589][106225] Updated weights for policy 1, policy_version 1068753 (0.0007) [2023-12-28 02:55:10,652][106225] Updated weights for policy 1, policy_version 1068763 (0.0007) [2023-12-28 02:55:10,709][106225] Updated weights for policy 1, policy_version 1068773 (0.0008) [2023-12-28 02:55:10,769][106225] Updated weights for policy 1, policy_version 1068783 (0.0007) [2023-12-28 02:55:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 546627584. Throughput: 0: 10079.2, 1: 10215.4. Samples: 546601168. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:11,176][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.746')] [2023-12-28 02:55:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001068784_273653760.pth... [2023-12-28 02:55:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001066080_272973824.pth... [2023-12-28 02:55:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001064896_272670720.pth [2023-12-28 02:55:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001067600_273350656.pth [2023-12-28 02:55:11,347][106226] Updated weights for policy 0, policy_version 1066081 (0.0011) [2023-12-28 02:55:11,414][106226] Updated weights for policy 0, policy_version 1066091 (0.0011) [2023-12-28 02:55:11,475][106226] Updated weights for policy 0, policy_version 1066101 (0.0011) [2023-12-28 02:55:11,540][106226] Updated weights for policy 0, policy_version 1066111 (0.0011) [2023-12-28 02:55:11,546][106225] Updated weights for policy 1, policy_version 1068793 (0.0006) [2023-12-28 02:55:11,605][106225] Updated weights for policy 1, policy_version 1068803 (0.0008) [2023-12-28 02:55:11,674][106225] Updated weights for policy 1, policy_version 1068813 (0.0007) [2023-12-28 02:55:12,262][106226] Updated weights for policy 0, policy_version 1066121 (0.0013) [2023-12-28 02:55:12,321][106226] Updated weights for policy 0, policy_version 1066131 (0.0008) [2023-12-28 02:55:12,388][106225] Updated weights for policy 1, policy_version 1068823 (0.0008) [2023-12-28 02:55:12,391][106226] Updated weights for policy 0, policy_version 1066141 (0.0007) [2023-12-28 02:55:12,473][106225] Updated weights for policy 1, policy_version 1068833 (0.0008) [2023-12-28 02:55:12,521][106225] Updated weights for policy 1, policy_version 1068843 (0.0009) [2023-12-28 02:55:13,135][106226] Updated weights for policy 0, policy_version 1066151 (0.0008) [2023-12-28 02:55:13,181][106226] Updated weights for policy 0, policy_version 1066161 (0.0007) [2023-12-28 02:55:13,194][106225] Updated weights for policy 1, policy_version 1068853 (0.0009) [2023-12-28 02:55:13,233][106226] Updated weights for policy 0, policy_version 1066171 (0.0008) [2023-12-28 02:55:13,252][106225] Updated weights for policy 1, policy_version 1068863 (0.0010) [2023-12-28 02:55:13,320][106225] Updated weights for policy 1, policy_version 1068873 (0.0010) [2023-12-28 02:55:13,828][106226] Updated weights for policy 0, policy_version 1066181 (0.0007) [2023-12-28 02:55:13,878][106226] Updated weights for policy 0, policy_version 1066191 (0.0008) [2023-12-28 02:55:13,937][106226] Updated weights for policy 0, policy_version 1066201 (0.0008) [2023-12-28 02:55:14,027][106225] Updated weights for policy 1, policy_version 1068883 (0.0009) [2023-12-28 02:55:14,092][106225] Updated weights for policy 1, policy_version 1068893 (0.0006) [2023-12-28 02:55:14,154][106225] Updated weights for policy 1, policy_version 1068903 (0.0010) [2023-12-28 02:55:14,607][106226] Updated weights for policy 0, policy_version 1066211 (0.0008) [2023-12-28 02:55:14,671][106226] Updated weights for policy 0, policy_version 1066221 (0.0009) [2023-12-28 02:55:14,737][106226] Updated weights for policy 0, policy_version 1066231 (0.0008) [2023-12-28 02:55:14,782][106225] Updated weights for policy 1, policy_version 1068913 (0.0010) [2023-12-28 02:55:14,849][106225] Updated weights for policy 1, policy_version 1068923 (0.0007) [2023-12-28 02:55:14,919][106225] Updated weights for policy 1, policy_version 1068933 (0.0006) [2023-12-28 02:55:14,987][106225] Updated weights for policy 1, policy_version 1068943 (0.0006) [2023-12-28 02:55:15,394][106226] Updated weights for policy 0, policy_version 1066241 (0.0009) [2023-12-28 02:55:15,448][106226] Updated weights for policy 0, policy_version 1066251 (0.0009) [2023-12-28 02:55:15,498][106226] Updated weights for policy 0, policy_version 1066261 (0.0009) [2023-12-28 02:55:15,550][106226] Updated weights for policy 0, policy_version 1066272 (0.0010) [2023-12-28 02:55:15,681][106225] Updated weights for policy 1, policy_version 1068953 (0.0010) [2023-12-28 02:55:15,737][106225] Updated weights for policy 1, policy_version 1068963 (0.0008) [2023-12-28 02:55:15,800][106225] Updated weights for policy 1, policy_version 1068973 (0.0009) [2023-12-28 02:55:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.5, 300 sec: 19883.0). Total num frames: 546725888. Throughput: 0: 10048.2, 1: 10098.3. Samples: 546716236. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:16,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.975')] [2023-12-28 02:55:16,280][106226] Updated weights for policy 0, policy_version 1066282 (0.0006) [2023-12-28 02:55:16,346][106226] Updated weights for policy 0, policy_version 1066292 (0.0008) [2023-12-28 02:55:16,408][106226] Updated weights for policy 0, policy_version 1066302 (0.0008) [2023-12-28 02:55:16,519][106225] Updated weights for policy 1, policy_version 1068983 (0.0007) [2023-12-28 02:55:16,577][106225] Updated weights for policy 1, policy_version 1068993 (0.0006) [2023-12-28 02:55:16,639][106225] Updated weights for policy 1, policy_version 1069003 (0.0010) [2023-12-28 02:55:17,109][106226] Updated weights for policy 0, policy_version 1066312 (0.0010) [2023-12-28 02:55:17,174][106226] Updated weights for policy 0, policy_version 1066322 (0.0011) [2023-12-28 02:55:17,235][106226] Updated weights for policy 0, policy_version 1066332 (0.0010) [2023-12-28 02:55:17,277][106225] Updated weights for policy 1, policy_version 1069013 (0.0008) [2023-12-28 02:55:17,339][106225] Updated weights for policy 1, policy_version 1069023 (0.0010) [2023-12-28 02:55:17,404][106225] Updated weights for policy 1, policy_version 1069033 (0.0009) [2023-12-28 02:55:17,869][106226] Updated weights for policy 0, policy_version 1066342 (0.0007) [2023-12-28 02:55:17,918][106226] Updated weights for policy 0, policy_version 1066352 (0.0009) [2023-12-28 02:55:17,971][106226] Updated weights for policy 0, policy_version 1066362 (0.0009) [2023-12-28 02:55:18,076][106225] Updated weights for policy 1, policy_version 1069043 (0.0009) [2023-12-28 02:55:18,129][106225] Updated weights for policy 1, policy_version 1069053 (0.0005) [2023-12-28 02:55:18,183][106225] Updated weights for policy 1, policy_version 1069063 (0.0006) [2023-12-28 02:55:18,587][106226] Updated weights for policy 0, policy_version 1066372 (0.0009) [2023-12-28 02:55:18,641][106226] Updated weights for policy 0, policy_version 1066382 (0.0008) [2023-12-28 02:55:18,702][106226] Updated weights for policy 0, policy_version 1066392 (0.0009) [2023-12-28 02:55:18,882][106225] Updated weights for policy 1, policy_version 1069073 (0.0009) [2023-12-28 02:55:18,941][106225] Updated weights for policy 1, policy_version 1069083 (0.0008) [2023-12-28 02:55:19,003][106225] Updated weights for policy 1, policy_version 1069093 (0.0008) [2023-12-28 02:55:19,066][106225] Updated weights for policy 1, policy_version 1069103 (0.0006) [2023-12-28 02:55:19,506][106226] Updated weights for policy 0, policy_version 1066402 (0.0009) [2023-12-28 02:55:19,557][106226] Updated weights for policy 0, policy_version 1066412 (0.0008) [2023-12-28 02:55:19,607][106226] Updated weights for policy 0, policy_version 1066422 (0.0009) [2023-12-28 02:55:19,665][106226] Updated weights for policy 0, policy_version 1066432 (0.0009) [2023-12-28 02:55:19,783][106225] Updated weights for policy 1, policy_version 1069113 (0.0009) [2023-12-28 02:55:19,835][106225] Updated weights for policy 1, policy_version 1069123 (0.0009) [2023-12-28 02:55:19,898][106225] Updated weights for policy 1, policy_version 1069133 (0.0007) [2023-12-28 02:55:20,437][106226] Updated weights for policy 0, policy_version 1066442 (0.0006) [2023-12-28 02:55:20,495][106226] Updated weights for policy 0, policy_version 1066452 (0.0009) [2023-12-28 02:55:20,556][106226] Updated weights for policy 0, policy_version 1066462 (0.0008) [2023-12-28 02:55:20,658][106225] Updated weights for policy 1, policy_version 1069143 (0.0009) [2023-12-28 02:55:20,709][106225] Updated weights for policy 1, policy_version 1069153 (0.0008) [2023-12-28 02:55:20,765][106225] Updated weights for policy 1, policy_version 1069163 (0.0005) [2023-12-28 02:55:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 546824192. Throughput: 0: 10009.0, 1: 10041.1. Samples: 546835004. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:21,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-5.095')] [2023-12-28 02:55:21,273][106226] Updated weights for policy 0, policy_version 1066472 (0.0008) [2023-12-28 02:55:21,326][106226] Updated weights for policy 0, policy_version 1066482 (0.0008) [2023-12-28 02:55:21,396][106226] Updated weights for policy 0, policy_version 1066492 (0.0008) [2023-12-28 02:55:21,510][106225] Updated weights for policy 1, policy_version 1069173 (0.0008) [2023-12-28 02:55:21,567][106225] Updated weights for policy 1, policy_version 1069183 (0.0008) [2023-12-28 02:55:21,630][106225] Updated weights for policy 1, policy_version 1069193 (0.0008) [2023-12-28 02:55:22,189][106226] Updated weights for policy 0, policy_version 1066502 (0.0008) [2023-12-28 02:55:22,248][106226] Updated weights for policy 0, policy_version 1066512 (0.0008) [2023-12-28 02:55:22,321][106226] Updated weights for policy 0, policy_version 1066522 (0.0006) [2023-12-28 02:55:22,381][106225] Updated weights for policy 1, policy_version 1069203 (0.0008) [2023-12-28 02:55:22,438][106225] Updated weights for policy 1, policy_version 1069213 (0.0006) [2023-12-28 02:55:22,496][106225] Updated weights for policy 1, policy_version 1069223 (0.0007) [2023-12-28 02:55:23,090][106226] Updated weights for policy 0, policy_version 1066532 (0.0010) [2023-12-28 02:55:23,115][106225] Updated weights for policy 1, policy_version 1069233 (0.0008) [2023-12-28 02:55:23,153][106226] Updated weights for policy 0, policy_version 1066542 (0.0009) [2023-12-28 02:55:23,169][106225] Updated weights for policy 1, policy_version 1069243 (0.0005) [2023-12-28 02:55:23,215][106225] Updated weights for policy 1, policy_version 1069253 (0.0006) [2023-12-28 02:55:23,217][106226] Updated weights for policy 0, policy_version 1066552 (0.0008) [2023-12-28 02:55:23,262][106225] Updated weights for policy 1, policy_version 1069263 (0.0005) [2023-12-28 02:55:23,849][106225] Updated weights for policy 1, policy_version 1069273 (0.0005) [2023-12-28 02:55:23,894][106225] Updated weights for policy 1, policy_version 1069283 (0.0005) [2023-12-28 02:55:23,944][106225] Updated weights for policy 1, policy_version 1069293 (0.0007) [2023-12-28 02:55:24,011][106226] Updated weights for policy 0, policy_version 1066562 (0.0009) [2023-12-28 02:55:24,069][106226] Updated weights for policy 0, policy_version 1066572 (0.0008) [2023-12-28 02:55:24,131][106226] Updated weights for policy 0, policy_version 1066582 (0.0008) [2023-12-28 02:55:24,184][106226] Updated weights for policy 0, policy_version 1066592 (0.0008) [2023-12-28 02:55:24,647][106225] Updated weights for policy 1, policy_version 1069303 (0.0008) [2023-12-28 02:55:24,695][106225] Updated weights for policy 1, policy_version 1069313 (0.0008) [2023-12-28 02:55:24,746][106225] Updated weights for policy 1, policy_version 1069323 (0.0008) [2023-12-28 02:55:24,913][106226] Updated weights for policy 0, policy_version 1066602 (0.0008) [2023-12-28 02:55:24,961][106226] Updated weights for policy 0, policy_version 1066612 (0.0008) [2023-12-28 02:55:25,020][106226] Updated weights for policy 0, policy_version 1066622 (0.0009) [2023-12-28 02:55:25,474][106225] Updated weights for policy 1, policy_version 1069333 (0.0009) [2023-12-28 02:55:25,518][106225] Updated weights for policy 1, policy_version 1069343 (0.0008) [2023-12-28 02:55:25,563][106225] Updated weights for policy 1, policy_version 1069353 (0.0008) [2023-12-28 02:55:25,748][106226] Updated weights for policy 0, policy_version 1066632 (0.0009) [2023-12-28 02:55:25,797][106226] Updated weights for policy 0, policy_version 1066642 (0.0008) [2023-12-28 02:55:25,842][106226] Updated weights for policy 0, policy_version 1066652 (0.0007) [2023-12-28 02:55:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 546922496. Throughput: 0: 9948.2, 1: 10038.2. Samples: 546892368. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:26,175][106225] Updated weights for policy 1, policy_version 1069363 (0.0008) [2023-12-28 02:55:26,176][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.476')] [2023-12-28 02:55:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001066656_273121280.pth... [2023-12-28 02:55:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001065504_272826368.pth [2023-12-28 02:55:26,223][106225] Updated weights for policy 1, policy_version 1069373 (0.0010) [2023-12-28 02:55:26,281][106225] Updated weights for policy 1, policy_version 1069383 (0.0010) [2023-12-28 02:55:26,320][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001069392_273809408.pth... [2023-12-28 02:55:26,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001068208_273506304.pth [2023-12-28 02:55:26,323][106141] Saving new best policy, reward=-4.476! [2023-12-28 02:55:26,663][106226] Updated weights for policy 0, policy_version 1066662 (0.0008) [2023-12-28 02:55:26,720][106226] Updated weights for policy 0, policy_version 1066672 (0.0007) [2023-12-28 02:55:26,782][106226] Updated weights for policy 0, policy_version 1066682 (0.0008) [2023-12-28 02:55:27,014][106225] Updated weights for policy 1, policy_version 1069393 (0.0010) [2023-12-28 02:55:27,067][106225] Updated weights for policy 1, policy_version 1069403 (0.0010) [2023-12-28 02:55:27,113][106225] Updated weights for policy 1, policy_version 1069413 (0.0010) [2023-12-28 02:55:27,159][106225] Updated weights for policy 1, policy_version 1069423 (0.0009) [2023-12-28 02:55:27,556][106226] Updated weights for policy 0, policy_version 1066692 (0.0008) [2023-12-28 02:55:27,605][106226] Updated weights for policy 0, policy_version 1066702 (0.0009) [2023-12-28 02:55:27,656][106226] Updated weights for policy 0, policy_version 1066713 (0.0009) [2023-12-28 02:55:27,748][106225] Updated weights for policy 1, policy_version 1069433 (0.0008) [2023-12-28 02:55:27,802][106225] Updated weights for policy 1, policy_version 1069443 (0.0007) [2023-12-28 02:55:27,858][106225] Updated weights for policy 1, policy_version 1069453 (0.0005) [2023-12-28 02:55:28,462][106226] Updated weights for policy 0, policy_version 1066723 (0.0008) [2023-12-28 02:55:28,516][106226] Updated weights for policy 0, policy_version 1066733 (0.0009) [2023-12-28 02:55:28,527][106225] Updated weights for policy 1, policy_version 1069463 (0.0010) [2023-12-28 02:55:28,575][106226] Updated weights for policy 0, policy_version 1066743 (0.0006) [2023-12-28 02:55:28,588][106225] Updated weights for policy 1, policy_version 1069473 (0.0010) [2023-12-28 02:55:28,646][106225] Updated weights for policy 1, policy_version 1069483 (0.0010) [2023-12-28 02:55:29,272][106225] Updated weights for policy 1, policy_version 1069493 (0.0009) [2023-12-28 02:55:29,328][106225] Updated weights for policy 1, policy_version 1069503 (0.0006) [2023-12-28 02:55:29,366][106226] Updated weights for policy 0, policy_version 1066753 (0.0007) [2023-12-28 02:55:29,396][106225] Updated weights for policy 1, policy_version 1069513 (0.0009) [2023-12-28 02:55:29,430][106226] Updated weights for policy 0, policy_version 1066763 (0.0006) [2023-12-28 02:55:29,488][106226] Updated weights for policy 0, policy_version 1066773 (0.0007) [2023-12-28 02:55:29,547][106226] Updated weights for policy 0, policy_version 1066783 (0.0008) [2023-12-28 02:55:30,115][106225] Updated weights for policy 1, policy_version 1069523 (0.0007) [2023-12-28 02:55:30,178][106225] Updated weights for policy 1, policy_version 1069533 (0.0008) [2023-12-28 02:55:30,241][106225] Updated weights for policy 1, policy_version 1069543 (0.0008) [2023-12-28 02:55:30,309][106226] Updated weights for policy 0, policy_version 1066793 (0.0008) [2023-12-28 02:55:30,371][106226] Updated weights for policy 0, policy_version 1066803 (0.0009) [2023-12-28 02:55:30,436][106226] Updated weights for policy 0, policy_version 1066813 (0.0009) [2023-12-28 02:55:30,948][106225] Updated weights for policy 1, policy_version 1069553 (0.0007) [2023-12-28 02:55:31,009][106225] Updated weights for policy 1, policy_version 1069563 (0.0009) [2023-12-28 02:55:31,076][106225] Updated weights for policy 1, policy_version 1069573 (0.0010) [2023-12-28 02:55:31,139][106225] Updated weights for policy 1, policy_version 1069583 (0.0009) [2023-12-28 02:55:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 547020800. Throughput: 0: 9835.2, 1: 10064.1. Samples: 547009764. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:31,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.728')] [2023-12-28 02:55:31,175][106226] Updated weights for policy 0, policy_version 1066823 (0.0009) [2023-12-28 02:55:31,239][106226] Updated weights for policy 0, policy_version 1066833 (0.0008) [2023-12-28 02:55:31,301][106226] Updated weights for policy 0, policy_version 1066843 (0.0007) [2023-12-28 02:55:31,843][106225] Updated weights for policy 1, policy_version 1069593 (0.0006) [2023-12-28 02:55:31,901][106225] Updated weights for policy 1, policy_version 1069603 (0.0009) [2023-12-28 02:55:31,954][106225] Updated weights for policy 1, policy_version 1069613 (0.0009) [2023-12-28 02:55:32,037][106226] Updated weights for policy 0, policy_version 1066853 (0.0008) [2023-12-28 02:55:32,091][106226] Updated weights for policy 0, policy_version 1066863 (0.0008) [2023-12-28 02:55:32,144][106226] Updated weights for policy 0, policy_version 1066873 (0.0007) [2023-12-28 02:55:32,669][106225] Updated weights for policy 1, policy_version 1069623 (0.0007) [2023-12-28 02:55:32,726][106225] Updated weights for policy 1, policy_version 1069633 (0.0005) [2023-12-28 02:55:32,792][106225] Updated weights for policy 1, policy_version 1069643 (0.0005) [2023-12-28 02:55:32,929][106226] Updated weights for policy 0, policy_version 1066883 (0.0007) [2023-12-28 02:55:32,988][106226] Updated weights for policy 0, policy_version 1066893 (0.0008) [2023-12-28 02:55:33,053][106226] Updated weights for policy 0, policy_version 1066903 (0.0008) [2023-12-28 02:55:33,380][106225] Updated weights for policy 1, policy_version 1069653 (0.0007) [2023-12-28 02:55:33,434][106225] Updated weights for policy 1, policy_version 1069663 (0.0008) [2023-12-28 02:55:33,478][106225] Updated weights for policy 1, policy_version 1069673 (0.0008) [2023-12-28 02:55:33,743][106226] Updated weights for policy 0, policy_version 1066913 (0.0008) [2023-12-28 02:55:33,793][106226] Updated weights for policy 0, policy_version 1066923 (0.0005) [2023-12-28 02:55:33,836][106226] Updated weights for policy 0, policy_version 1066933 (0.0007) [2023-12-28 02:55:33,881][106226] Updated weights for policy 0, policy_version 1066943 (0.0008) [2023-12-28 02:55:34,148][106225] Updated weights for policy 1, policy_version 1069683 (0.0009) [2023-12-28 02:55:34,212][106225] Updated weights for policy 1, policy_version 1069693 (0.0011) [2023-12-28 02:55:34,278][106225] Updated weights for policy 1, policy_version 1069703 (0.0008) [2023-12-28 02:55:34,659][106226] Updated weights for policy 0, policy_version 1066953 (0.0008) [2023-12-28 02:55:34,727][106226] Updated weights for policy 0, policy_version 1066963 (0.0008) [2023-12-28 02:55:34,799][106226] Updated weights for policy 0, policy_version 1066973 (0.0008) [2023-12-28 02:55:35,028][106225] Updated weights for policy 1, policy_version 1069713 (0.0010) [2023-12-28 02:55:35,078][106225] Updated weights for policy 1, policy_version 1069723 (0.0010) [2023-12-28 02:55:35,129][106225] Updated weights for policy 1, policy_version 1069733 (0.0010) [2023-12-28 02:55:35,174][106225] Updated weights for policy 1, policy_version 1069743 (0.0007) [2023-12-28 02:55:35,575][106226] Updated weights for policy 0, policy_version 1066983 (0.0009) [2023-12-28 02:55:35,630][106226] Updated weights for policy 0, policy_version 1066993 (0.0009) [2023-12-28 02:55:35,694][106226] Updated weights for policy 0, policy_version 1067003 (0.0010) [2023-12-28 02:55:35,745][106225] Updated weights for policy 1, policy_version 1069753 (0.0006) [2023-12-28 02:55:35,810][106225] Updated weights for policy 1, policy_version 1069763 (0.0008) [2023-12-28 02:55:35,874][106225] Updated weights for policy 1, policy_version 1069773 (0.0007) [2023-12-28 02:55:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 547119104. Throughput: 0: 9742.4, 1: 10089.1. Samples: 547127232. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:36,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-5.093')] [2023-12-28 02:55:36,454][106225] Updated weights for policy 1, policy_version 1069783 (0.0007) [2023-12-28 02:55:36,499][106226] Updated weights for policy 0, policy_version 1067013 (0.0009) [2023-12-28 02:55:36,516][106225] Updated weights for policy 1, policy_version 1069793 (0.0006) [2023-12-28 02:55:36,562][106226] Updated weights for policy 0, policy_version 1067023 (0.0009) [2023-12-28 02:55:36,579][106225] Updated weights for policy 1, policy_version 1069803 (0.0010) [2023-12-28 02:55:36,629][106226] Updated weights for policy 0, policy_version 1067033 (0.0009) [2023-12-28 02:55:37,259][106225] Updated weights for policy 1, policy_version 1069813 (0.0007) [2023-12-28 02:55:37,321][106225] Updated weights for policy 1, policy_version 1069823 (0.0009) [2023-12-28 02:55:37,363][106226] Updated weights for policy 0, policy_version 1067043 (0.0008) [2023-12-28 02:55:37,376][106225] Updated weights for policy 1, policy_version 1069833 (0.0008) [2023-12-28 02:55:37,411][106226] Updated weights for policy 0, policy_version 1067053 (0.0006) [2023-12-28 02:55:37,464][106226] Updated weights for policy 0, policy_version 1067063 (0.0008) [2023-12-28 02:55:38,110][106225] Updated weights for policy 1, policy_version 1069843 (0.0008) [2023-12-28 02:55:38,165][106225] Updated weights for policy 1, policy_version 1069853 (0.0009) [2023-12-28 02:55:38,212][106226] Updated weights for policy 0, policy_version 1067073 (0.0009) [2023-12-28 02:55:38,229][106225] Updated weights for policy 1, policy_version 1069863 (0.0009) [2023-12-28 02:55:38,270][106226] Updated weights for policy 0, policy_version 1067083 (0.0006) [2023-12-28 02:55:38,327][106226] Updated weights for policy 0, policy_version 1067093 (0.0006) [2023-12-28 02:55:38,392][106226] Updated weights for policy 0, policy_version 1067103 (0.0008) [2023-12-28 02:55:38,958][106225] Updated weights for policy 1, policy_version 1069873 (0.0008) [2023-12-28 02:55:39,015][106225] Updated weights for policy 1, policy_version 1069883 (0.0005) [2023-12-28 02:55:39,039][106226] Updated weights for policy 0, policy_version 1067113 (0.0008) [2023-12-28 02:55:39,072][106225] Updated weights for policy 1, policy_version 1069893 (0.0005) [2023-12-28 02:55:39,094][106226] Updated weights for policy 0, policy_version 1067123 (0.0009) [2023-12-28 02:55:39,131][106225] Updated weights for policy 1, policy_version 1069903 (0.0007) [2023-12-28 02:55:39,150][106226] Updated weights for policy 0, policy_version 1067133 (0.0009) [2023-12-28 02:55:39,852][106225] Updated weights for policy 1, policy_version 1069913 (0.0009) [2023-12-28 02:55:39,916][106225] Updated weights for policy 1, policy_version 1069923 (0.0009) [2023-12-28 02:55:39,925][106226] Updated weights for policy 0, policy_version 1067143 (0.0008) [2023-12-28 02:55:39,983][106225] Updated weights for policy 1, policy_version 1069933 (0.0009) [2023-12-28 02:55:39,992][106226] Updated weights for policy 0, policy_version 1067153 (0.0009) [2023-12-28 02:55:40,052][106226] Updated weights for policy 0, policy_version 1067163 (0.0008) [2023-12-28 02:55:40,662][106225] Updated weights for policy 1, policy_version 1069943 (0.0006) [2023-12-28 02:55:40,722][106225] Updated weights for policy 1, policy_version 1069953 (0.0007) [2023-12-28 02:55:40,780][106225] Updated weights for policy 1, policy_version 1069963 (0.0007) [2023-12-28 02:55:40,859][106226] Updated weights for policy 0, policy_version 1067173 (0.0009) [2023-12-28 02:55:40,929][106226] Updated weights for policy 0, policy_version 1067183 (0.0010) [2023-12-28 02:55:40,994][106226] Updated weights for policy 0, policy_version 1067193 (0.0009) [2023-12-28 02:55:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 547217408. Throughput: 0: 9705.6, 1: 10107.1. Samples: 547185956. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:41,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-4.962')] [2023-12-28 02:55:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001067200_273260544.pth... [2023-12-28 02:55:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001069968_273956864.pth... [2023-12-28 02:55:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001066080_272973824.pth [2023-12-28 02:55:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001068784_273653760.pth [2023-12-28 02:55:41,477][106225] Updated weights for policy 1, policy_version 1069973 (0.0009) [2023-12-28 02:55:41,545][106225] Updated weights for policy 1, policy_version 1069983 (0.0009) [2023-12-28 02:55:41,610][106225] Updated weights for policy 1, policy_version 1069993 (0.0006) [2023-12-28 02:55:41,835][106226] Updated weights for policy 0, policy_version 1067203 (0.0009) [2023-12-28 02:55:41,895][106226] Updated weights for policy 0, policy_version 1067213 (0.0007) [2023-12-28 02:55:41,952][106226] Updated weights for policy 0, policy_version 1067223 (0.0009) [2023-12-28 02:55:42,402][106225] Updated weights for policy 1, policy_version 1070003 (0.0009) [2023-12-28 02:55:42,466][106225] Updated weights for policy 1, policy_version 1070013 (0.0007) [2023-12-28 02:55:42,528][106225] Updated weights for policy 1, policy_version 1070023 (0.0010) [2023-12-28 02:55:42,616][106226] Updated weights for policy 0, policy_version 1067233 (0.0010) [2023-12-28 02:55:42,670][106226] Updated weights for policy 0, policy_version 1067243 (0.0010) [2023-12-28 02:55:42,731][106226] Updated weights for policy 0, policy_version 1067253 (0.0011) [2023-12-28 02:55:42,796][106226] Updated weights for policy 0, policy_version 1067263 (0.0011) [2023-12-28 02:55:43,227][106225] Updated weights for policy 1, policy_version 1070033 (0.0009) [2023-12-28 02:55:43,283][106225] Updated weights for policy 1, policy_version 1070043 (0.0007) [2023-12-28 02:55:43,329][106225] Updated weights for policy 1, policy_version 1070053 (0.0007) [2023-12-28 02:55:43,375][106225] Updated weights for policy 1, policy_version 1070063 (0.0008) [2023-12-28 02:55:43,499][106226] Updated weights for policy 0, policy_version 1067273 (0.0010) [2023-12-28 02:55:43,550][106226] Updated weights for policy 0, policy_version 1067283 (0.0010) [2023-12-28 02:55:43,606][106226] Updated weights for policy 0, policy_version 1067293 (0.0010) [2023-12-28 02:55:44,089][106225] Updated weights for policy 1, policy_version 1070073 (0.0009) [2023-12-28 02:55:44,136][106225] Updated weights for policy 1, policy_version 1070083 (0.0010) [2023-12-28 02:55:44,194][106225] Updated weights for policy 1, policy_version 1070093 (0.0008) [2023-12-28 02:55:44,271][106226] Updated weights for policy 0, policy_version 1067303 (0.0010) [2023-12-28 02:55:44,331][106226] Updated weights for policy 0, policy_version 1067313 (0.0010) [2023-12-28 02:55:44,392][106226] Updated weights for policy 0, policy_version 1067323 (0.0010) [2023-12-28 02:55:44,889][106225] Updated weights for policy 1, policy_version 1070103 (0.0008) [2023-12-28 02:55:44,954][106225] Updated weights for policy 1, policy_version 1070113 (0.0007) [2023-12-28 02:55:45,013][106225] Updated weights for policy 1, policy_version 1070123 (0.0008) [2023-12-28 02:55:45,054][106226] Updated weights for policy 0, policy_version 1067333 (0.0010) [2023-12-28 02:55:45,119][106226] Updated weights for policy 0, policy_version 1067343 (0.0011) [2023-12-28 02:55:45,185][106226] Updated weights for policy 0, policy_version 1067353 (0.0011) [2023-12-28 02:55:45,726][106225] Updated weights for policy 1, policy_version 1070133 (0.0009) [2023-12-28 02:55:45,789][106225] Updated weights for policy 1, policy_version 1070143 (0.0010) [2023-12-28 02:55:45,852][106226] Updated weights for policy 0, policy_version 1067363 (0.0009) [2023-12-28 02:55:45,861][106225] Updated weights for policy 1, policy_version 1070153 (0.0010) [2023-12-28 02:55:45,908][106226] Updated weights for policy 0, policy_version 1067373 (0.0011) [2023-12-28 02:55:45,956][106226] Updated weights for policy 0, policy_version 1067383 (0.0007) [2023-12-28 02:55:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 547315712. Throughput: 0: 9621.7, 1: 10038.9. Samples: 547301484. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:46,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.728')] [2023-12-28 02:55:46,441][106225] Updated weights for policy 1, policy_version 1070163 (0.0009) [2023-12-28 02:55:46,504][106225] Updated weights for policy 1, policy_version 1070173 (0.0009) [2023-12-28 02:55:46,558][106225] Updated weights for policy 1, policy_version 1070183 (0.0010) [2023-12-28 02:55:46,586][106226] Updated weights for policy 0, policy_version 1067393 (0.0006) [2023-12-28 02:55:46,657][106226] Updated weights for policy 0, policy_version 1067403 (0.0005) [2023-12-28 02:55:46,717][106226] Updated weights for policy 0, policy_version 1067413 (0.0008) [2023-12-28 02:55:46,773][106226] Updated weights for policy 0, policy_version 1067423 (0.0005) [2023-12-28 02:55:47,141][106225] Updated weights for policy 1, policy_version 1070193 (0.0010) [2023-12-28 02:55:47,194][106225] Updated weights for policy 1, policy_version 1070203 (0.0010) [2023-12-28 02:55:47,253][106225] Updated weights for policy 1, policy_version 1070213 (0.0010) [2023-12-28 02:55:47,300][106226] Updated weights for policy 0, policy_version 1067433 (0.0010) [2023-12-28 02:55:47,310][106225] Updated weights for policy 1, policy_version 1070223 (0.0010) [2023-12-28 02:55:47,360][106226] Updated weights for policy 0, policy_version 1067443 (0.0010) [2023-12-28 02:55:47,418][106226] Updated weights for policy 0, policy_version 1067453 (0.0010) [2023-12-28 02:55:48,034][106225] Updated weights for policy 1, policy_version 1070233 (0.0010) [2023-12-28 02:55:48,067][106226] Updated weights for policy 0, policy_version 1067463 (0.0010) [2023-12-28 02:55:48,091][106225] Updated weights for policy 1, policy_version 1070243 (0.0009) [2023-12-28 02:55:48,125][106226] Updated weights for policy 0, policy_version 1067473 (0.0011) [2023-12-28 02:55:48,138][106225] Updated weights for policy 1, policy_version 1070253 (0.0009) [2023-12-28 02:55:48,178][106226] Updated weights for policy 0, policy_version 1067483 (0.0010) [2023-12-28 02:55:48,835][106225] Updated weights for policy 1, policy_version 1070263 (0.0008) [2023-12-28 02:55:48,889][106225] Updated weights for policy 1, policy_version 1070273 (0.0008) [2023-12-28 02:55:48,902][106226] Updated weights for policy 0, policy_version 1067493 (0.0010) [2023-12-28 02:55:48,947][106225] Updated weights for policy 1, policy_version 1070283 (0.0005) [2023-12-28 02:55:48,960][106226] Updated weights for policy 0, policy_version 1067503 (0.0008) [2023-12-28 02:55:49,011][106226] Updated weights for policy 0, policy_version 1067513 (0.0007) [2023-12-28 02:55:49,681][106225] Updated weights for policy 1, policy_version 1070293 (0.0007) [2023-12-28 02:55:49,741][106225] Updated weights for policy 1, policy_version 1070303 (0.0008) [2023-12-28 02:55:49,759][106226] Updated weights for policy 0, policy_version 1067523 (0.0008) [2023-12-28 02:55:49,800][106225] Updated weights for policy 1, policy_version 1070313 (0.0006) [2023-12-28 02:55:49,822][106226] Updated weights for policy 0, policy_version 1067533 (0.0007) [2023-12-28 02:55:49,885][106226] Updated weights for policy 0, policy_version 1067543 (0.0008) [2023-12-28 02:55:50,532][106226] Updated weights for policy 0, policy_version 1067553 (0.0009) [2023-12-28 02:55:50,588][106225] Updated weights for policy 1, policy_version 1070323 (0.0009) [2023-12-28 02:55:50,597][106226] Updated weights for policy 0, policy_version 1067563 (0.0008) [2023-12-28 02:55:50,647][106225] Updated weights for policy 1, policy_version 1070333 (0.0006) [2023-12-28 02:55:50,662][106226] Updated weights for policy 0, policy_version 1067573 (0.0009) [2023-12-28 02:55:50,714][106225] Updated weights for policy 1, policy_version 1070343 (0.0009) [2023-12-28 02:55:50,735][106226] Updated weights for policy 0, policy_version 1067583 (0.0006) [2023-12-28 02:55:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 547414016. Throughput: 0: 9620.6, 1: 10008.4. Samples: 547424884. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:51,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-5.065')] [2023-12-28 02:55:51,313][106226] Updated weights for policy 0, policy_version 1067593 (0.0007) [2023-12-28 02:55:51,382][106226] Updated weights for policy 0, policy_version 1067603 (0.0009) [2023-12-28 02:55:51,434][106226] Updated weights for policy 0, policy_version 1067613 (0.0010) [2023-12-28 02:55:51,502][106225] Updated weights for policy 1, policy_version 1070353 (0.0008) [2023-12-28 02:55:51,561][106225] Updated weights for policy 1, policy_version 1070363 (0.0009) [2023-12-28 02:55:51,624][106225] Updated weights for policy 1, policy_version 1070373 (0.0009) [2023-12-28 02:55:51,691][106225] Updated weights for policy 1, policy_version 1070383 (0.0007) [2023-12-28 02:55:52,166][106226] Updated weights for policy 0, policy_version 1067623 (0.0011) [2023-12-28 02:55:52,224][106226] Updated weights for policy 0, policy_version 1067633 (0.0010) [2023-12-28 02:55:52,288][106226] Updated weights for policy 0, policy_version 1067643 (0.0011) [2023-12-28 02:55:52,478][106225] Updated weights for policy 1, policy_version 1070393 (0.0008) [2023-12-28 02:55:52,543][106225] Updated weights for policy 1, policy_version 1070403 (0.0007) [2023-12-28 02:55:52,596][106225] Updated weights for policy 1, policy_version 1070413 (0.0008) [2023-12-28 02:55:53,050][106226] Updated weights for policy 0, policy_version 1067653 (0.0010) [2023-12-28 02:55:53,098][106226] Updated weights for policy 0, policy_version 1067663 (0.0008) [2023-12-28 02:55:53,154][106226] Updated weights for policy 0, policy_version 1067673 (0.0009) [2023-12-28 02:55:53,300][106225] Updated weights for policy 1, policy_version 1070423 (0.0006) [2023-12-28 02:55:53,348][106225] Updated weights for policy 1, policy_version 1070433 (0.0005) [2023-12-28 02:55:53,403][106225] Updated weights for policy 1, policy_version 1070443 (0.0005) [2023-12-28 02:55:53,810][106226] Updated weights for policy 0, policy_version 1067683 (0.0007) [2023-12-28 02:55:53,855][106226] Updated weights for policy 0, policy_version 1067693 (0.0005) [2023-12-28 02:55:53,901][106226] Updated weights for policy 0, policy_version 1067703 (0.0010) [2023-12-28 02:55:54,050][106225] Updated weights for policy 1, policy_version 1070453 (0.0008) [2023-12-28 02:55:54,103][106225] Updated weights for policy 1, policy_version 1070463 (0.0005) [2023-12-28 02:55:54,153][106225] Updated weights for policy 1, policy_version 1070473 (0.0005) [2023-12-28 02:55:54,550][106226] Updated weights for policy 0, policy_version 1067713 (0.0010) [2023-12-28 02:55:54,616][106226] Updated weights for policy 0, policy_version 1067723 (0.0010) [2023-12-28 02:55:54,676][106226] Updated weights for policy 0, policy_version 1067733 (0.0007) [2023-12-28 02:55:54,740][106226] Updated weights for policy 0, policy_version 1067743 (0.0005) [2023-12-28 02:55:54,837][106225] Updated weights for policy 1, policy_version 1070483 (0.0009) [2023-12-28 02:55:54,891][106225] Updated weights for policy 1, policy_version 1070493 (0.0010) [2023-12-28 02:55:54,938][106225] Updated weights for policy 1, policy_version 1070503 (0.0010) [2023-12-28 02:55:55,293][106226] Updated weights for policy 0, policy_version 1067753 (0.0007) [2023-12-28 02:55:55,340][106226] Updated weights for policy 0, policy_version 1067763 (0.0007) [2023-12-28 02:55:55,384][106226] Updated weights for policy 0, policy_version 1067773 (0.0008) [2023-12-28 02:55:55,670][106225] Updated weights for policy 1, policy_version 1070513 (0.0010) [2023-12-28 02:55:55,720][106225] Updated weights for policy 1, policy_version 1070523 (0.0010) [2023-12-28 02:55:55,766][106225] Updated weights for policy 1, policy_version 1070533 (0.0010) [2023-12-28 02:55:55,812][106225] Updated weights for policy 1, policy_version 1070543 (0.0010) [2023-12-28 02:55:56,140][106226] Updated weights for policy 0, policy_version 1067783 (0.0008) [2023-12-28 02:55:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 547512320. Throughput: 0: 9619.3, 1: 9981.4. Samples: 547483200. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:55:56,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.819')] [2023-12-28 02:55:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001070544_274104320.pth... [2023-12-28 02:55:56,183][106226] Updated weights for policy 0, policy_version 1067793 (0.0007) [2023-12-28 02:55:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001069392_273809408.pth [2023-12-28 02:55:56,244][106226] Updated weights for policy 0, policy_version 1067803 (0.0007) [2023-12-28 02:55:56,272][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001067808_273416192.pth... [2023-12-28 02:55:56,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001066656_273121280.pth [2023-12-28 02:55:56,552][106225] Updated weights for policy 1, policy_version 1070553 (0.0010) [2023-12-28 02:55:56,604][106225] Updated weights for policy 1, policy_version 1070563 (0.0010) [2023-12-28 02:55:56,670][106225] Updated weights for policy 1, policy_version 1070573 (0.0009) [2023-12-28 02:55:56,952][106226] Updated weights for policy 0, policy_version 1067813 (0.0006) [2023-12-28 02:55:57,008][106226] Updated weights for policy 0, policy_version 1067823 (0.0005) [2023-12-28 02:55:57,070][106226] Updated weights for policy 0, policy_version 1067833 (0.0007) [2023-12-28 02:55:57,401][106225] Updated weights for policy 1, policy_version 1070583 (0.0006) [2023-12-28 02:55:57,456][106225] Updated weights for policy 1, policy_version 1070593 (0.0005) [2023-12-28 02:55:57,510][106225] Updated weights for policy 1, policy_version 1070603 (0.0005) [2023-12-28 02:55:57,680][106226] Updated weights for policy 0, policy_version 1067843 (0.0009) [2023-12-28 02:55:57,739][106226] Updated weights for policy 0, policy_version 1067853 (0.0007) [2023-12-28 02:55:57,795][106226] Updated weights for policy 0, policy_version 1067863 (0.0005) [2023-12-28 02:55:58,224][106225] Updated weights for policy 1, policy_version 1070613 (0.0007) [2023-12-28 02:55:58,285][106225] Updated weights for policy 1, policy_version 1070623 (0.0008) [2023-12-28 02:55:58,347][106225] Updated weights for policy 1, policy_version 1070633 (0.0007) [2023-12-28 02:55:58,407][106226] Updated weights for policy 0, policy_version 1067873 (0.0005) [2023-12-28 02:55:58,471][106226] Updated weights for policy 0, policy_version 1067883 (0.0008) [2023-12-28 02:55:58,539][106226] Updated weights for policy 0, policy_version 1067893 (0.0008) [2023-12-28 02:55:58,603][106226] Updated weights for policy 0, policy_version 1067903 (0.0008) [2023-12-28 02:55:59,138][106225] Updated weights for policy 1, policy_version 1070643 (0.0009) [2023-12-28 02:55:59,189][106225] Updated weights for policy 1, policy_version 1070653 (0.0007) [2023-12-28 02:55:59,257][106225] Updated weights for policy 1, policy_version 1070663 (0.0008) [2023-12-28 02:55:59,405][106226] Updated weights for policy 0, policy_version 1067913 (0.0007) [2023-12-28 02:55:59,465][106226] Updated weights for policy 0, policy_version 1067923 (0.0006) [2023-12-28 02:55:59,518][106226] Updated weights for policy 0, policy_version 1067933 (0.0006) [2023-12-28 02:56:00,046][106225] Updated weights for policy 1, policy_version 1070673 (0.0007) [2023-12-28 02:56:00,107][106225] Updated weights for policy 1, policy_version 1070683 (0.0009) [2023-12-28 02:56:00,152][106225] Updated weights for policy 1, policy_version 1070693 (0.0008) [2023-12-28 02:56:00,204][106225] Updated weights for policy 1, policy_version 1070703 (0.0007) [2023-12-28 02:56:00,209][106226] Updated weights for policy 0, policy_version 1067943 (0.0006) [2023-12-28 02:56:00,262][106226] Updated weights for policy 0, policy_version 1067953 (0.0007) [2023-12-28 02:56:00,325][106226] Updated weights for policy 0, policy_version 1067963 (0.0005) [2023-12-28 02:56:00,970][106225] Updated weights for policy 1, policy_version 1070713 (0.0009) [2023-12-28 02:56:00,986][106226] Updated weights for policy 0, policy_version 1067973 (0.0008) [2023-12-28 02:56:01,031][106225] Updated weights for policy 1, policy_version 1070723 (0.0006) [2023-12-28 02:56:01,049][106226] Updated weights for policy 0, policy_version 1067983 (0.0008) [2023-12-28 02:56:01,099][106225] Updated weights for policy 1, policy_version 1070733 (0.0008) [2023-12-28 02:56:01,126][106226] Updated weights for policy 0, policy_version 1067993 (0.0008) [2023-12-28 02:56:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 547618816. Throughput: 0: 9712.5, 1: 9958.9. Samples: 547601452. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:01,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.033')] [2023-12-28 02:56:01,811][106226] Updated weights for policy 0, policy_version 1068003 (0.0007) [2023-12-28 02:56:01,847][106225] Updated weights for policy 1, policy_version 1070743 (0.0010) [2023-12-28 02:56:01,878][106226] Updated weights for policy 0, policy_version 1068013 (0.0005) [2023-12-28 02:56:01,902][106225] Updated weights for policy 1, policy_version 1070753 (0.0011) [2023-12-28 02:56:01,931][106226] Updated weights for policy 0, policy_version 1068023 (0.0006) [2023-12-28 02:56:01,956][106225] Updated weights for policy 1, policy_version 1070763 (0.0010) [2023-12-28 02:56:02,515][106226] Updated weights for policy 0, policy_version 1068033 (0.0005) [2023-12-28 02:56:02,578][106226] Updated weights for policy 0, policy_version 1068043 (0.0007) [2023-12-28 02:56:02,637][106226] Updated weights for policy 0, policy_version 1068053 (0.0008) [2023-12-28 02:56:02,694][106226] Updated weights for policy 0, policy_version 1068063 (0.0007) [2023-12-28 02:56:02,719][106225] Updated weights for policy 1, policy_version 1070773 (0.0009) [2023-12-28 02:56:02,774][106225] Updated weights for policy 1, policy_version 1070783 (0.0009) [2023-12-28 02:56:02,840][106225] Updated weights for policy 1, policy_version 1070793 (0.0008) [2023-12-28 02:56:03,382][106226] Updated weights for policy 0, policy_version 1068073 (0.0009) [2023-12-28 02:56:03,438][106226] Updated weights for policy 0, policy_version 1068083 (0.0010) [2023-12-28 02:56:03,467][106225] Updated weights for policy 1, policy_version 1070803 (0.0007) [2023-12-28 02:56:03,497][106226] Updated weights for policy 0, policy_version 1068093 (0.0010) [2023-12-28 02:56:03,522][106225] Updated weights for policy 1, policy_version 1070813 (0.0010) [2023-12-28 02:56:03,568][106225] Updated weights for policy 1, policy_version 1070823 (0.0010) [2023-12-28 02:56:04,173][106226] Updated weights for policy 0, policy_version 1068103 (0.0011) [2023-12-28 02:56:04,237][106226] Updated weights for policy 0, policy_version 1068113 (0.0010) [2023-12-28 02:56:04,262][106225] Updated weights for policy 1, policy_version 1070833 (0.0010) [2023-12-28 02:56:04,303][106226] Updated weights for policy 0, policy_version 1068123 (0.0011) [2023-12-28 02:56:04,317][106225] Updated weights for policy 1, policy_version 1070843 (0.0010) [2023-12-28 02:56:04,373][106225] Updated weights for policy 1, policy_version 1070853 (0.0006) [2023-12-28 02:56:04,438][106225] Updated weights for policy 1, policy_version 1070863 (0.0009) [2023-12-28 02:56:04,909][106226] Updated weights for policy 0, policy_version 1068133 (0.0011) [2023-12-28 02:56:04,972][106226] Updated weights for policy 0, policy_version 1068143 (0.0010) [2023-12-28 02:56:05,033][106226] Updated weights for policy 0, policy_version 1068153 (0.0011) [2023-12-28 02:56:05,118][106225] Updated weights for policy 1, policy_version 1070873 (0.0010) [2023-12-28 02:56:05,180][106225] Updated weights for policy 1, policy_version 1070883 (0.0010) [2023-12-28 02:56:05,237][106225] Updated weights for policy 1, policy_version 1070893 (0.0010) [2023-12-28 02:56:05,723][106226] Updated weights for policy 0, policy_version 1068163 (0.0011) [2023-12-28 02:56:05,772][106226] Updated weights for policy 0, policy_version 1068173 (0.0010) [2023-12-28 02:56:05,824][106226] Updated weights for policy 0, policy_version 1068183 (0.0010) [2023-12-28 02:56:05,953][106225] Updated weights for policy 1, policy_version 1070903 (0.0009) [2023-12-28 02:56:06,009][106225] Updated weights for policy 1, policy_version 1070913 (0.0007) [2023-12-28 02:56:06,062][106225] Updated weights for policy 1, policy_version 1070923 (0.0010) [2023-12-28 02:56:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 547717120. Throughput: 0: 9737.8, 1: 9951.5. Samples: 547721024. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:06,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.671')] [2023-12-28 02:56:06,512][106226] Updated weights for policy 0, policy_version 1068193 (0.0010) [2023-12-28 02:56:06,575][106226] Updated weights for policy 0, policy_version 1068203 (0.0008) [2023-12-28 02:56:06,638][106226] Updated weights for policy 0, policy_version 1068213 (0.0007) [2023-12-28 02:56:06,705][106226] Updated weights for policy 0, policy_version 1068223 (0.0006) [2023-12-28 02:56:06,795][106225] Updated weights for policy 1, policy_version 1070933 (0.0010) [2023-12-28 02:56:06,854][106225] Updated weights for policy 1, policy_version 1070943 (0.0010) [2023-12-28 02:56:06,916][106225] Updated weights for policy 1, policy_version 1070953 (0.0008) [2023-12-28 02:56:07,346][106226] Updated weights for policy 0, policy_version 1068233 (0.0006) [2023-12-28 02:56:07,405][106226] Updated weights for policy 0, policy_version 1068243 (0.0006) [2023-12-28 02:56:07,463][106226] Updated weights for policy 0, policy_version 1068253 (0.0008) [2023-12-28 02:56:07,588][106225] Updated weights for policy 1, policy_version 1070963 (0.0009) [2023-12-28 02:56:07,650][106225] Updated weights for policy 1, policy_version 1070973 (0.0009) [2023-12-28 02:56:07,705][106225] Updated weights for policy 1, policy_version 1070983 (0.0008) [2023-12-28 02:56:08,106][106226] Updated weights for policy 0, policy_version 1068263 (0.0010) [2023-12-28 02:56:08,163][106226] Updated weights for policy 0, policy_version 1068273 (0.0008) [2023-12-28 02:56:08,217][106226] Updated weights for policy 0, policy_version 1068283 (0.0009) [2023-12-28 02:56:08,440][106225] Updated weights for policy 1, policy_version 1070993 (0.0008) [2023-12-28 02:56:08,503][106225] Updated weights for policy 1, policy_version 1071003 (0.0008) [2023-12-28 02:56:08,568][106225] Updated weights for policy 1, policy_version 1071013 (0.0008) [2023-12-28 02:56:08,633][106225] Updated weights for policy 1, policy_version 1071023 (0.0008) [2023-12-28 02:56:08,967][106226] Updated weights for policy 0, policy_version 1068293 (0.0009) [2023-12-28 02:56:09,028][106226] Updated weights for policy 0, policy_version 1068303 (0.0007) [2023-12-28 02:56:09,086][106226] Updated weights for policy 0, policy_version 1068313 (0.0009) [2023-12-28 02:56:09,316][106225] Updated weights for policy 1, policy_version 1071033 (0.0009) [2023-12-28 02:56:09,385][106225] Updated weights for policy 1, policy_version 1071043 (0.0008) [2023-12-28 02:56:09,454][106225] Updated weights for policy 1, policy_version 1071053 (0.0007) [2023-12-28 02:56:09,831][106226] Updated weights for policy 0, policy_version 1068323 (0.0009) [2023-12-28 02:56:09,894][106226] Updated weights for policy 0, policy_version 1068333 (0.0009) [2023-12-28 02:56:09,967][106226] Updated weights for policy 0, policy_version 1068343 (0.0009) [2023-12-28 02:56:10,261][106225] Updated weights for policy 1, policy_version 1071063 (0.0008) [2023-12-28 02:56:10,327][106225] Updated weights for policy 1, policy_version 1071073 (0.0008) [2023-12-28 02:56:10,390][106225] Updated weights for policy 1, policy_version 1071083 (0.0008) [2023-12-28 02:56:10,731][106226] Updated weights for policy 0, policy_version 1068353 (0.0006) [2023-12-28 02:56:10,786][106226] Updated weights for policy 0, policy_version 1068363 (0.0008) [2023-12-28 02:56:10,848][106226] Updated weights for policy 0, policy_version 1068373 (0.0008) [2023-12-28 02:56:10,913][106226] Updated weights for policy 0, policy_version 1068383 (0.0009) [2023-12-28 02:56:11,006][106225] Updated weights for policy 1, policy_version 1071093 (0.0009) [2023-12-28 02:56:11,072][106225] Updated weights for policy 1, policy_version 1071103 (0.0010) [2023-12-28 02:56:11,138][106225] Updated weights for policy 1, policy_version 1071113 (0.0008) [2023-12-28 02:56:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 547807232. Throughput: 0: 9841.3, 1: 9912.9. Samples: 547781304. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:11,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-5.083')] [2023-12-28 02:56:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001068384_273563648.pth... [2023-12-28 02:56:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001067200_273260544.pth [2023-12-28 02:56:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001071120_274251776.pth... [2023-12-28 02:56:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001069968_273956864.pth [2023-12-28 02:56:11,656][106226] Updated weights for policy 0, policy_version 1068393 (0.0008) [2023-12-28 02:56:11,718][106226] Updated weights for policy 0, policy_version 1068403 (0.0009) [2023-12-28 02:56:11,776][106226] Updated weights for policy 0, policy_version 1068413 (0.0009) [2023-12-28 02:56:11,971][106225] Updated weights for policy 1, policy_version 1071123 (0.0007) [2023-12-28 02:56:12,033][106225] Updated weights for policy 1, policy_version 1071133 (0.0006) [2023-12-28 02:56:12,092][106225] Updated weights for policy 1, policy_version 1071143 (0.0008) [2023-12-28 02:56:12,548][106226] Updated weights for policy 0, policy_version 1068423 (0.0010) [2023-12-28 02:56:12,614][106226] Updated weights for policy 0, policy_version 1068433 (0.0010) [2023-12-28 02:56:12,682][106226] Updated weights for policy 0, policy_version 1068443 (0.0008) [2023-12-28 02:56:12,819][106225] Updated weights for policy 1, policy_version 1071153 (0.0008) [2023-12-28 02:56:12,886][106225] Updated weights for policy 1, policy_version 1071163 (0.0009) [2023-12-28 02:56:12,944][106225] Updated weights for policy 1, policy_version 1071173 (0.0008) [2023-12-28 02:56:13,004][106225] Updated weights for policy 1, policy_version 1071183 (0.0009) [2023-12-28 02:56:13,284][106226] Updated weights for policy 0, policy_version 1068453 (0.0005) [2023-12-28 02:56:13,338][106226] Updated weights for policy 0, policy_version 1068463 (0.0005) [2023-12-28 02:56:13,388][106226] Updated weights for policy 0, policy_version 1068473 (0.0005) [2023-12-28 02:56:13,772][106225] Updated weights for policy 1, policy_version 1071193 (0.0006) [2023-12-28 02:56:13,840][106225] Updated weights for policy 1, policy_version 1071203 (0.0005) [2023-12-28 02:56:13,908][106225] Updated weights for policy 1, policy_version 1071213 (0.0005) [2023-12-28 02:56:13,919][106226] Updated weights for policy 0, policy_version 1068483 (0.0007) [2023-12-28 02:56:13,972][106226] Updated weights for policy 0, policy_version 1068493 (0.0010) [2023-12-28 02:56:14,026][106226] Updated weights for policy 0, policy_version 1068503 (0.0010) [2023-12-28 02:56:14,533][106225] Updated weights for policy 1, policy_version 1071223 (0.0007) [2023-12-28 02:56:14,605][106225] Updated weights for policy 1, policy_version 1071233 (0.0007) [2023-12-28 02:56:14,649][106226] Updated weights for policy 0, policy_version 1068513 (0.0010) [2023-12-28 02:56:14,675][106225] Updated weights for policy 1, policy_version 1071243 (0.0010) [2023-12-28 02:56:14,707][106226] Updated weights for policy 0, policy_version 1068523 (0.0005) [2023-12-28 02:56:14,773][106226] Updated weights for policy 0, policy_version 1068533 (0.0006) [2023-12-28 02:56:14,826][106226] Updated weights for policy 0, policy_version 1068543 (0.0007) [2023-12-28 02:56:15,351][106225] Updated weights for policy 1, policy_version 1071253 (0.0010) [2023-12-28 02:56:15,413][106225] Updated weights for policy 1, policy_version 1071263 (0.0011) [2023-12-28 02:56:15,474][106225] Updated weights for policy 1, policy_version 1071273 (0.0010) [2023-12-28 02:56:15,526][106226] Updated weights for policy 0, policy_version 1068553 (0.0011) [2023-12-28 02:56:15,576][106226] Updated weights for policy 0, policy_version 1068563 (0.0010) [2023-12-28 02:56:15,626][106226] Updated weights for policy 0, policy_version 1068573 (0.0010) [2023-12-28 02:56:16,051][106225] Updated weights for policy 1, policy_version 1071283 (0.0010) [2023-12-28 02:56:16,114][106225] Updated weights for policy 1, policy_version 1071293 (0.0010) [2023-12-28 02:56:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 547905536. Throughput: 0: 9958.8, 1: 9800.1. Samples: 547898912. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:16,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.849')] [2023-12-28 02:56:16,176][106225] Updated weights for policy 1, policy_version 1071303 (0.0010) [2023-12-28 02:56:16,320][106226] Updated weights for policy 0, policy_version 1068583 (0.0010) [2023-12-28 02:56:16,372][106226] Updated weights for policy 0, policy_version 1068593 (0.0010) [2023-12-28 02:56:16,432][106226] Updated weights for policy 0, policy_version 1068603 (0.0010) [2023-12-28 02:56:16,883][106225] Updated weights for policy 1, policy_version 1071313 (0.0010) [2023-12-28 02:56:16,946][106225] Updated weights for policy 1, policy_version 1071323 (0.0010) [2023-12-28 02:56:17,006][106225] Updated weights for policy 1, policy_version 1071333 (0.0010) [2023-12-28 02:56:17,066][106225] Updated weights for policy 1, policy_version 1071343 (0.0010) [2023-12-28 02:56:17,161][106226] Updated weights for policy 0, policy_version 1068613 (0.0010) [2023-12-28 02:56:17,218][106226] Updated weights for policy 0, policy_version 1068623 (0.0010) [2023-12-28 02:56:17,268][106226] Updated weights for policy 0, policy_version 1068633 (0.0010) [2023-12-28 02:56:17,761][106225] Updated weights for policy 1, policy_version 1071353 (0.0010) [2023-12-28 02:56:17,810][106225] Updated weights for policy 1, policy_version 1071363 (0.0010) [2023-12-28 02:56:17,863][106225] Updated weights for policy 1, policy_version 1071373 (0.0010) [2023-12-28 02:56:17,968][106226] Updated weights for policy 0, policy_version 1068643 (0.0009) [2023-12-28 02:56:18,029][106226] Updated weights for policy 0, policy_version 1068653 (0.0008) [2023-12-28 02:56:18,076][106226] Updated weights for policy 0, policy_version 1068663 (0.0010) [2023-12-28 02:56:18,579][106225] Updated weights for policy 1, policy_version 1071383 (0.0010) [2023-12-28 02:56:18,637][106225] Updated weights for policy 1, policy_version 1071393 (0.0010) [2023-12-28 02:56:18,699][106225] Updated weights for policy 1, policy_version 1071403 (0.0010) [2023-12-28 02:56:18,756][106226] Updated weights for policy 0, policy_version 1068673 (0.0010) [2023-12-28 02:56:18,806][106226] Updated weights for policy 0, policy_version 1068683 (0.0005) [2023-12-28 02:56:18,858][106226] Updated weights for policy 0, policy_version 1068693 (0.0005) [2023-12-28 02:56:18,924][106226] Updated weights for policy 0, policy_version 1068703 (0.0009) [2023-12-28 02:56:19,428][106225] Updated weights for policy 1, policy_version 1071413 (0.0009) [2023-12-28 02:56:19,483][106225] Updated weights for policy 1, policy_version 1071423 (0.0007) [2023-12-28 02:56:19,541][106225] Updated weights for policy 1, policy_version 1071433 (0.0008) [2023-12-28 02:56:19,661][106226] Updated weights for policy 0, policy_version 1068713 (0.0011) [2023-12-28 02:56:19,717][106226] Updated weights for policy 0, policy_version 1068723 (0.0008) [2023-12-28 02:56:19,772][106226] Updated weights for policy 0, policy_version 1068733 (0.0010) [2023-12-28 02:56:20,323][106225] Updated weights for policy 1, policy_version 1071443 (0.0007) [2023-12-28 02:56:20,380][106225] Updated weights for policy 1, policy_version 1071453 (0.0006) [2023-12-28 02:56:20,437][106225] Updated weights for policy 1, policy_version 1071463 (0.0006) [2023-12-28 02:56:20,537][106226] Updated weights for policy 0, policy_version 1068743 (0.0011) [2023-12-28 02:56:20,598][106226] Updated weights for policy 0, policy_version 1068753 (0.0011) [2023-12-28 02:56:20,660][106226] Updated weights for policy 0, policy_version 1068763 (0.0011) [2023-12-28 02:56:21,087][106225] Updated weights for policy 1, policy_version 1071473 (0.0005) [2023-12-28 02:56:21,157][106225] Updated weights for policy 1, policy_version 1071483 (0.0008) [2023-12-28 02:56:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 548003840. Throughput: 0: 10032.4, 1: 9747.4. Samples: 548017324. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:21,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.962')] [2023-12-28 02:56:21,229][106225] Updated weights for policy 1, policy_version 1071493 (0.0008) [2023-12-28 02:56:21,293][106225] Updated weights for policy 1, policy_version 1071503 (0.0008) [2023-12-28 02:56:21,407][106226] Updated weights for policy 0, policy_version 1068773 (0.0011) [2023-12-28 02:56:21,470][106226] Updated weights for policy 0, policy_version 1068783 (0.0011) [2023-12-28 02:56:21,534][106226] Updated weights for policy 0, policy_version 1068793 (0.0010) [2023-12-28 02:56:22,061][106225] Updated weights for policy 1, policy_version 1071513 (0.0007) [2023-12-28 02:56:22,122][106225] Updated weights for policy 1, policy_version 1071523 (0.0006) [2023-12-28 02:56:22,178][106225] Updated weights for policy 1, policy_version 1071533 (0.0007) [2023-12-28 02:56:22,278][106226] Updated weights for policy 0, policy_version 1068803 (0.0010) [2023-12-28 02:56:22,343][106226] Updated weights for policy 0, policy_version 1068813 (0.0008) [2023-12-28 02:56:22,416][106226] Updated weights for policy 0, policy_version 1068823 (0.0008) [2023-12-28 02:56:22,931][106225] Updated weights for policy 1, policy_version 1071543 (0.0008) [2023-12-28 02:56:22,990][106225] Updated weights for policy 1, policy_version 1071554 (0.0011) [2023-12-28 02:56:23,040][106225] Updated weights for policy 1, policy_version 1071564 (0.0007) [2023-12-28 02:56:23,059][106226] Updated weights for policy 0, policy_version 1068833 (0.0008) [2023-12-28 02:56:23,118][106226] Updated weights for policy 0, policy_version 1068843 (0.0010) [2023-12-28 02:56:23,178][106226] Updated weights for policy 0, policy_version 1068853 (0.0010) [2023-12-28 02:56:23,235][106226] Updated weights for policy 0, policy_version 1068863 (0.0007) [2023-12-28 02:56:23,827][106225] Updated weights for policy 1, policy_version 1071574 (0.0008) [2023-12-28 02:56:23,876][106226] Updated weights for policy 0, policy_version 1068873 (0.0006) [2023-12-28 02:56:23,882][106225] Updated weights for policy 1, policy_version 1071584 (0.0008) [2023-12-28 02:56:23,938][106226] Updated weights for policy 0, policy_version 1068883 (0.0005) [2023-12-28 02:56:23,939][106225] Updated weights for policy 1, policy_version 1071594 (0.0009) [2023-12-28 02:56:24,002][106226] Updated weights for policy 0, policy_version 1068893 (0.0005) [2023-12-28 02:56:24,608][106226] Updated weights for policy 0, policy_version 1068903 (0.0005) [2023-12-28 02:56:24,661][106225] Updated weights for policy 1, policy_version 1071604 (0.0007) [2023-12-28 02:56:24,671][106226] Updated weights for policy 0, policy_version 1068913 (0.0008) [2023-12-28 02:56:24,708][106225] Updated weights for policy 1, policy_version 1071614 (0.0008) [2023-12-28 02:56:24,735][106226] Updated weights for policy 0, policy_version 1068923 (0.0009) [2023-12-28 02:56:24,767][106225] Updated weights for policy 1, policy_version 1071624 (0.0007) [2023-12-28 02:56:25,363][106226] Updated weights for policy 0, policy_version 1068933 (0.0008) [2023-12-28 02:56:25,420][106226] Updated weights for policy 0, policy_version 1068943 (0.0005) [2023-12-28 02:56:25,484][106226] Updated weights for policy 0, policy_version 1068953 (0.0007) [2023-12-28 02:56:25,515][106225] Updated weights for policy 1, policy_version 1071634 (0.0008) [2023-12-28 02:56:25,578][106225] Updated weights for policy 1, policy_version 1071644 (0.0005) [2023-12-28 02:56:25,641][106225] Updated weights for policy 1, policy_version 1071654 (0.0005) [2023-12-28 02:56:25,704][106225] Updated weights for policy 1, policy_version 1071664 (0.0005) [2023-12-28 02:56:26,079][106226] Updated weights for policy 0, policy_version 1068963 (0.0009) [2023-12-28 02:56:26,136][106226] Updated weights for policy 0, policy_version 1068973 (0.0007) [2023-12-28 02:56:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 548102144. Throughput: 0: 10056.2, 1: 9702.4. Samples: 548075092. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:26,176][105115] Avg episode reward: [(0, '-4.805'), (1, '-4.664')] [2023-12-28 02:56:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001071664_274391040.pth... [2023-12-28 02:56:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001070544_274104320.pth [2023-12-28 02:56:26,195][106226] Updated weights for policy 0, policy_version 1068983 (0.0010) [2023-12-28 02:56:26,238][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001068992_273719296.pth... [2023-12-28 02:56:26,241][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001067808_273416192.pth [2023-12-28 02:56:26,368][106225] Updated weights for policy 1, policy_version 1071674 (0.0005) [2023-12-28 02:56:26,418][106225] Updated weights for policy 1, policy_version 1071684 (0.0005) [2023-12-28 02:56:26,472][106225] Updated weights for policy 1, policy_version 1071694 (0.0005) [2023-12-28 02:56:26,884][106226] Updated weights for policy 0, policy_version 1068993 (0.0010) [2023-12-28 02:56:26,946][106226] Updated weights for policy 0, policy_version 1069003 (0.0010) [2023-12-28 02:56:27,005][106225] Updated weights for policy 1, policy_version 1071704 (0.0006) [2023-12-28 02:56:27,007][106226] Updated weights for policy 0, policy_version 1069013 (0.0011) [2023-12-28 02:56:27,065][106225] Updated weights for policy 1, policy_version 1071714 (0.0007) [2023-12-28 02:56:27,075][106226] Updated weights for policy 0, policy_version 1069023 (0.0010) [2023-12-28 02:56:27,113][106225] Updated weights for policy 1, policy_version 1071724 (0.0008) [2023-12-28 02:56:27,696][106225] Updated weights for policy 1, policy_version 1071734 (0.0006) [2023-12-28 02:56:27,737][106226] Updated weights for policy 0, policy_version 1069033 (0.0008) [2023-12-28 02:56:27,757][106225] Updated weights for policy 1, policy_version 1071744 (0.0005) [2023-12-28 02:56:27,785][106226] Updated weights for policy 0, policy_version 1069043 (0.0005) [2023-12-28 02:56:27,816][106225] Updated weights for policy 1, policy_version 1071754 (0.0005) [2023-12-28 02:56:27,833][106226] Updated weights for policy 0, policy_version 1069053 (0.0005) [2023-12-28 02:56:28,383][106225] Updated weights for policy 1, policy_version 1071764 (0.0006) [2023-12-28 02:56:28,388][106226] Updated weights for policy 0, policy_version 1069063 (0.0009) [2023-12-28 02:56:28,437][106225] Updated weights for policy 1, policy_version 1071774 (0.0006) [2023-12-28 02:56:28,451][106226] Updated weights for policy 0, policy_version 1069073 (0.0010) [2023-12-28 02:56:28,488][106225] Updated weights for policy 1, policy_version 1071784 (0.0005) [2023-12-28 02:56:28,515][106226] Updated weights for policy 0, policy_version 1069083 (0.0011) [2023-12-28 02:56:29,081][106226] Updated weights for policy 0, policy_version 1069093 (0.0008) [2023-12-28 02:56:29,133][106226] Updated weights for policy 0, policy_version 1069103 (0.0005) [2023-12-28 02:56:29,187][106226] Updated weights for policy 0, policy_version 1069113 (0.0005) [2023-12-28 02:56:29,264][106225] Updated weights for policy 1, policy_version 1071794 (0.0007) [2023-12-28 02:56:29,335][106225] Updated weights for policy 1, policy_version 1071804 (0.0009) [2023-12-28 02:56:29,402][106225] Updated weights for policy 1, policy_version 1071814 (0.0008) [2023-12-28 02:56:29,452][106225] Updated weights for policy 1, policy_version 1071824 (0.0009) [2023-12-28 02:56:29,832][106226] Updated weights for policy 0, policy_version 1069123 (0.0008) [2023-12-28 02:56:29,902][106226] Updated weights for policy 0, policy_version 1069133 (0.0011) [2023-12-28 02:56:29,972][106226] Updated weights for policy 0, policy_version 1069143 (0.0010) [2023-12-28 02:56:30,215][106225] Updated weights for policy 1, policy_version 1071834 (0.0008) [2023-12-28 02:56:30,280][106225] Updated weights for policy 1, policy_version 1071844 (0.0008) [2023-12-28 02:56:30,341][106225] Updated weights for policy 1, policy_version 1071854 (0.0008) [2023-12-28 02:56:30,697][106226] Updated weights for policy 0, policy_version 1069153 (0.0011) [2023-12-28 02:56:30,757][106226] Updated weights for policy 0, policy_version 1069163 (0.0011) [2023-12-28 02:56:30,808][106226] Updated weights for policy 0, policy_version 1069173 (0.0010) [2023-12-28 02:56:30,855][106226] Updated weights for policy 0, policy_version 1069183 (0.0010) [2023-12-28 02:56:30,952][106225] Updated weights for policy 1, policy_version 1071864 (0.0010) [2023-12-28 02:56:30,999][106225] Updated weights for policy 1, policy_version 1071874 (0.0010) [2023-12-28 02:56:31,062][106225] Updated weights for policy 1, policy_version 1071884 (0.0008) [2023-12-28 02:56:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 548216832. Throughput: 0: 10227.5, 1: 9776.1. Samples: 548201644. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:31,175][105115] Avg episode reward: [(0, '-4.677'), (1, '-4.823')] [2023-12-28 02:56:31,601][106226] Updated weights for policy 0, policy_version 1069193 (0.0008) [2023-12-28 02:56:31,670][106226] Updated weights for policy 0, policy_version 1069203 (0.0009) [2023-12-28 02:56:31,736][106226] Updated weights for policy 0, policy_version 1069213 (0.0009) [2023-12-28 02:56:31,862][106225] Updated weights for policy 1, policy_version 1071894 (0.0010) [2023-12-28 02:56:31,924][106225] Updated weights for policy 1, policy_version 1071904 (0.0008) [2023-12-28 02:56:31,983][106225] Updated weights for policy 1, policy_version 1071914 (0.0009) [2023-12-28 02:56:32,520][106226] Updated weights for policy 0, policy_version 1069223 (0.0008) [2023-12-28 02:56:32,584][106226] Updated weights for policy 0, policy_version 1069233 (0.0008) [2023-12-28 02:56:32,646][106226] Updated weights for policy 0, policy_version 1069243 (0.0009) [2023-12-28 02:56:32,657][106225] Updated weights for policy 1, policy_version 1071924 (0.0009) [2023-12-28 02:56:32,719][106225] Updated weights for policy 1, policy_version 1071934 (0.0008) [2023-12-28 02:56:32,777][106225] Updated weights for policy 1, policy_version 1071944 (0.0008) [2023-12-28 02:56:33,330][106226] Updated weights for policy 0, policy_version 1069253 (0.0009) [2023-12-28 02:56:33,384][106226] Updated weights for policy 0, policy_version 1069263 (0.0009) [2023-12-28 02:56:33,436][106226] Updated weights for policy 0, policy_version 1069273 (0.0009) [2023-12-28 02:56:33,499][106225] Updated weights for policy 1, policy_version 1071954 (0.0008) [2023-12-28 02:56:33,567][106225] Updated weights for policy 1, policy_version 1071964 (0.0005) [2023-12-28 02:56:33,630][106225] Updated weights for policy 1, policy_version 1071974 (0.0005) [2023-12-28 02:56:33,686][106225] Updated weights for policy 1, policy_version 1071984 (0.0006) [2023-12-28 02:56:34,150][106226] Updated weights for policy 0, policy_version 1069283 (0.0007) [2023-12-28 02:56:34,211][106226] Updated weights for policy 0, policy_version 1069293 (0.0008) [2023-12-28 02:56:34,269][106226] Updated weights for policy 0, policy_version 1069303 (0.0008) [2023-12-28 02:56:34,340][106225] Updated weights for policy 1, policy_version 1071994 (0.0007) [2023-12-28 02:56:34,389][106225] Updated weights for policy 1, policy_version 1072004 (0.0008) [2023-12-28 02:56:34,439][106225] Updated weights for policy 1, policy_version 1072014 (0.0008) [2023-12-28 02:56:35,010][106226] Updated weights for policy 0, policy_version 1069313 (0.0007) [2023-12-28 02:56:35,058][106226] Updated weights for policy 0, policy_version 1069323 (0.0008) [2023-12-28 02:56:35,102][106226] Updated weights for policy 0, policy_version 1069333 (0.0008) [2023-12-28 02:56:35,149][106226] Updated weights for policy 0, policy_version 1069343 (0.0009) [2023-12-28 02:56:35,215][106225] Updated weights for policy 1, policy_version 1072024 (0.0009) [2023-12-28 02:56:35,265][106225] Updated weights for policy 1, policy_version 1072034 (0.0008) [2023-12-28 02:56:35,310][106225] Updated weights for policy 1, policy_version 1072044 (0.0008) [2023-12-28 02:56:35,877][106225] Updated weights for policy 1, policy_version 1072054 (0.0006) [2023-12-28 02:56:35,939][106225] Updated weights for policy 1, policy_version 1072064 (0.0005) [2023-12-28 02:56:36,004][106225] Updated weights for policy 1, policy_version 1072074 (0.0007) [2023-12-28 02:56:36,005][106226] Updated weights for policy 0, policy_version 1069353 (0.0007) [2023-12-28 02:56:36,062][106226] Updated weights for policy 0, policy_version 1069363 (0.0008) [2023-12-28 02:56:36,127][106226] Updated weights for policy 0, policy_version 1069373 (0.0008) [2023-12-28 02:56:36,175][105115] Fps is (10 sec: 21299.5, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 548315136. Throughput: 0: 10074.6, 1: 9777.6. Samples: 548318232. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:36,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-4.954')] [2023-12-28 02:56:36,722][106225] Updated weights for policy 1, policy_version 1072084 (0.0007) [2023-12-28 02:56:36,765][106226] Updated weights for policy 0, policy_version 1069383 (0.0007) [2023-12-28 02:56:36,788][106225] Updated weights for policy 1, policy_version 1072094 (0.0007) [2023-12-28 02:56:36,819][106226] Updated weights for policy 0, policy_version 1069393 (0.0006) [2023-12-28 02:56:36,850][106225] Updated weights for policy 1, policy_version 1072104 (0.0010) [2023-12-28 02:56:36,870][106226] Updated weights for policy 0, policy_version 1069403 (0.0009) [2023-12-28 02:56:37,578][106225] Updated weights for policy 1, policy_version 1072114 (0.0006) [2023-12-28 02:56:37,627][106226] Updated weights for policy 0, policy_version 1069413 (0.0006) [2023-12-28 02:56:37,643][106225] Updated weights for policy 1, policy_version 1072124 (0.0007) [2023-12-28 02:56:37,679][106226] Updated weights for policy 0, policy_version 1069423 (0.0008) [2023-12-28 02:56:37,700][106225] Updated weights for policy 1, policy_version 1072134 (0.0007) [2023-12-28 02:56:37,734][106226] Updated weights for policy 0, policy_version 1069433 (0.0006) [2023-12-28 02:56:37,759][106225] Updated weights for policy 1, policy_version 1072144 (0.0006) [2023-12-28 02:56:38,485][106225] Updated weights for policy 1, policy_version 1072154 (0.0008) [2023-12-28 02:56:38,492][106226] Updated weights for policy 0, policy_version 1069443 (0.0008) [2023-12-28 02:56:38,543][106225] Updated weights for policy 1, policy_version 1072164 (0.0011) [2023-12-28 02:56:38,554][106226] Updated weights for policy 0, policy_version 1069453 (0.0011) [2023-12-28 02:56:38,602][106225] Updated weights for policy 1, policy_version 1072174 (0.0010) [2023-12-28 02:56:38,616][106226] Updated weights for policy 0, policy_version 1069463 (0.0011) [2023-12-28 02:56:39,246][106225] Updated weights for policy 1, policy_version 1072184 (0.0008) [2023-12-28 02:56:39,317][106225] Updated weights for policy 1, policy_version 1072194 (0.0006) [2023-12-28 02:56:39,329][106226] Updated weights for policy 0, policy_version 1069473 (0.0010) [2023-12-28 02:56:39,392][106225] Updated weights for policy 1, policy_version 1072204 (0.0009) [2023-12-28 02:56:39,403][106226] Updated weights for policy 0, policy_version 1069483 (0.0009) [2023-12-28 02:56:39,473][106226] Updated weights for policy 0, policy_version 1069493 (0.0008) [2023-12-28 02:56:39,538][106226] Updated weights for policy 0, policy_version 1069503 (0.0009) [2023-12-28 02:56:40,117][106225] Updated weights for policy 1, policy_version 1072214 (0.0007) [2023-12-28 02:56:40,179][106225] Updated weights for policy 1, policy_version 1072224 (0.0008) [2023-12-28 02:56:40,240][106226] Updated weights for policy 0, policy_version 1069513 (0.0008) [2023-12-28 02:56:40,241][106225] Updated weights for policy 1, policy_version 1072234 (0.0009) [2023-12-28 02:56:40,304][106226] Updated weights for policy 0, policy_version 1069523 (0.0008) [2023-12-28 02:56:40,372][106226] Updated weights for policy 0, policy_version 1069533 (0.0009) [2023-12-28 02:56:40,966][106225] Updated weights for policy 1, policy_version 1072244 (0.0007) [2023-12-28 02:56:41,030][106225] Updated weights for policy 1, policy_version 1072254 (0.0006) [2023-12-28 02:56:41,094][106225] Updated weights for policy 1, policy_version 1072264 (0.0006) [2023-12-28 02:56:41,152][106226] Updated weights for policy 0, policy_version 1069543 (0.0009) [2023-12-28 02:56:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 548405248. Throughput: 0: 10067.5, 1: 9779.9. Samples: 548376332. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:41,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-5.008')] [2023-12-28 02:56:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001072272_274546688.pth... [2023-12-28 02:56:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001071120_274251776.pth [2023-12-28 02:56:41,214][106226] Updated weights for policy 0, policy_version 1069553 (0.0008) [2023-12-28 02:56:41,268][106226] Updated weights for policy 0, policy_version 1069563 (0.0008) [2023-12-28 02:56:41,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001069568_273866752.pth... [2023-12-28 02:56:41,294][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001068384_273563648.pth [2023-12-28 02:56:41,868][106225] Updated weights for policy 1, policy_version 1072274 (0.0007) [2023-12-28 02:56:41,933][106225] Updated weights for policy 1, policy_version 1072284 (0.0007) [2023-12-28 02:56:42,001][106225] Updated weights for policy 1, policy_version 1072294 (0.0008) [2023-12-28 02:56:42,060][106226] Updated weights for policy 0, policy_version 1069573 (0.0009) [2023-12-28 02:56:42,069][106225] Updated weights for policy 1, policy_version 1072304 (0.0009) [2023-12-28 02:56:42,121][106226] Updated weights for policy 0, policy_version 1069583 (0.0007) [2023-12-28 02:56:42,183][106226] Updated weights for policy 0, policy_version 1069593 (0.0005) [2023-12-28 02:56:42,831][106225] Updated weights for policy 1, policy_version 1072314 (0.0006) [2023-12-28 02:56:42,888][106226] Updated weights for policy 0, policy_version 1069603 (0.0006) [2023-12-28 02:56:42,894][106225] Updated weights for policy 1, policy_version 1072324 (0.0006) [2023-12-28 02:56:42,947][106225] Updated weights for policy 1, policy_version 1072334 (0.0008) [2023-12-28 02:56:42,950][106226] Updated weights for policy 0, policy_version 1069613 (0.0006) [2023-12-28 02:56:43,006][106226] Updated weights for policy 0, policy_version 1069623 (0.0005) [2023-12-28 02:56:43,576][106226] Updated weights for policy 0, policy_version 1069633 (0.0006) [2023-12-28 02:56:43,583][106225] Updated weights for policy 1, policy_version 1072344 (0.0006) [2023-12-28 02:56:43,635][106226] Updated weights for policy 0, policy_version 1069643 (0.0008) [2023-12-28 02:56:43,639][106225] Updated weights for policy 1, policy_version 1072354 (0.0005) [2023-12-28 02:56:43,688][106226] Updated weights for policy 0, policy_version 1069653 (0.0007) [2023-12-28 02:56:43,695][106225] Updated weights for policy 1, policy_version 1072364 (0.0005) [2023-12-28 02:56:43,750][106226] Updated weights for policy 0, policy_version 1069663 (0.0005) [2023-12-28 02:56:44,284][106225] Updated weights for policy 1, policy_version 1072374 (0.0007) [2023-12-28 02:56:44,339][106225] Updated weights for policy 1, policy_version 1072384 (0.0009) [2023-12-28 02:56:44,397][106225] Updated weights for policy 1, policy_version 1072394 (0.0007) [2023-12-28 02:56:44,421][106226] Updated weights for policy 0, policy_version 1069673 (0.0005) [2023-12-28 02:56:44,478][106226] Updated weights for policy 0, policy_version 1069683 (0.0007) [2023-12-28 02:56:44,527][106226] Updated weights for policy 0, policy_version 1069693 (0.0006) [2023-12-28 02:56:45,126][106225] Updated weights for policy 1, policy_version 1072404 (0.0008) [2023-12-28 02:56:45,163][106226] Updated weights for policy 0, policy_version 1069703 (0.0006) [2023-12-28 02:56:45,184][106225] Updated weights for policy 1, policy_version 1072414 (0.0008) [2023-12-28 02:56:45,225][106226] Updated weights for policy 0, policy_version 1069713 (0.0007) [2023-12-28 02:56:45,248][106225] Updated weights for policy 1, policy_version 1072424 (0.0008) [2023-12-28 02:56:45,290][106226] Updated weights for policy 0, policy_version 1069723 (0.0008) [2023-12-28 02:56:45,939][106225] Updated weights for policy 1, policy_version 1072434 (0.0006) [2023-12-28 02:56:45,969][106226] Updated weights for policy 0, policy_version 1069733 (0.0008) [2023-12-28 02:56:45,990][106225] Updated weights for policy 1, policy_version 1072444 (0.0006) [2023-12-28 02:56:46,029][106226] Updated weights for policy 0, policy_version 1069743 (0.0008) [2023-12-28 02:56:46,040][106225] Updated weights for policy 1, policy_version 1072454 (0.0007) [2023-12-28 02:56:46,087][106225] Updated weights for policy 1, policy_version 1072464 (0.0006) [2023-12-28 02:56:46,088][106226] Updated weights for policy 0, policy_version 1069753 (0.0008) [2023-12-28 02:56:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 548511744. Throughput: 0: 10015.0, 1: 9828.0. Samples: 548494392. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:46,176][105115] Avg episode reward: [(0, '-4.613'), (1, '-5.063')] [2023-12-28 02:56:46,677][106225] Updated weights for policy 1, policy_version 1072474 (0.0005) [2023-12-28 02:56:46,728][106225] Updated weights for policy 1, policy_version 1072484 (0.0005) [2023-12-28 02:56:46,787][106225] Updated weights for policy 1, policy_version 1072494 (0.0005) [2023-12-28 02:56:46,846][106226] Updated weights for policy 0, policy_version 1069763 (0.0009) [2023-12-28 02:56:46,900][106226] Updated weights for policy 0, policy_version 1069773 (0.0009) [2023-12-28 02:56:46,971][106226] Updated weights for policy 0, policy_version 1069783 (0.0005) [2023-12-28 02:56:47,322][106225] Updated weights for policy 1, policy_version 1072504 (0.0009) [2023-12-28 02:56:47,379][106225] Updated weights for policy 1, policy_version 1072514 (0.0010) [2023-12-28 02:56:47,435][106225] Updated weights for policy 1, policy_version 1072524 (0.0010) [2023-12-28 02:56:47,524][106226] Updated weights for policy 0, policy_version 1069793 (0.0005) [2023-12-28 02:56:47,577][106226] Updated weights for policy 0, policy_version 1069803 (0.0009) [2023-12-28 02:56:47,628][106226] Updated weights for policy 0, policy_version 1069813 (0.0008) [2023-12-28 02:56:47,682][106226] Updated weights for policy 0, policy_version 1069823 (0.0006) [2023-12-28 02:56:48,057][106225] Updated weights for policy 1, policy_version 1072534 (0.0007) [2023-12-28 02:56:48,122][106225] Updated weights for policy 1, policy_version 1072544 (0.0005) [2023-12-28 02:56:48,187][106225] Updated weights for policy 1, policy_version 1072554 (0.0007) [2023-12-28 02:56:48,417][106226] Updated weights for policy 0, policy_version 1069833 (0.0006) [2023-12-28 02:56:48,484][106226] Updated weights for policy 0, policy_version 1069843 (0.0007) [2023-12-28 02:56:48,538][106226] Updated weights for policy 0, policy_version 1069853 (0.0008) [2023-12-28 02:56:48,828][106225] Updated weights for policy 1, policy_version 1072564 (0.0007) [2023-12-28 02:56:48,888][106225] Updated weights for policy 1, policy_version 1072574 (0.0006) [2023-12-28 02:56:48,938][106225] Updated weights for policy 1, policy_version 1072584 (0.0005) [2023-12-28 02:56:49,098][106226] Updated weights for policy 0, policy_version 1069863 (0.0006) [2023-12-28 02:56:49,167][106226] Updated weights for policy 0, policy_version 1069873 (0.0006) [2023-12-28 02:56:49,229][106226] Updated weights for policy 0, policy_version 1069883 (0.0006) [2023-12-28 02:56:49,545][106225] Updated weights for policy 1, policy_version 1072594 (0.0006) [2023-12-28 02:56:49,599][106225] Updated weights for policy 1, policy_version 1072604 (0.0008) [2023-12-28 02:56:49,660][106225] Updated weights for policy 1, policy_version 1072614 (0.0008) [2023-12-28 02:56:49,726][106225] Updated weights for policy 1, policy_version 1072624 (0.0006) [2023-12-28 02:56:49,958][106226] Updated weights for policy 0, policy_version 1069893 (0.0008) [2023-12-28 02:56:50,029][106226] Updated weights for policy 0, policy_version 1069903 (0.0009) [2023-12-28 02:56:50,095][106226] Updated weights for policy 0, policy_version 1069913 (0.0010) [2023-12-28 02:56:50,395][106225] Updated weights for policy 1, policy_version 1072634 (0.0007) [2023-12-28 02:56:50,459][106225] Updated weights for policy 1, policy_version 1072644 (0.0008) [2023-12-28 02:56:50,519][106225] Updated weights for policy 1, policy_version 1072654 (0.0008) [2023-12-28 02:56:50,851][106226] Updated weights for policy 0, policy_version 1069923 (0.0010) [2023-12-28 02:56:50,904][106226] Updated weights for policy 0, policy_version 1069933 (0.0008) [2023-12-28 02:56:50,950][106226] Updated weights for policy 0, policy_version 1069943 (0.0008) [2023-12-28 02:56:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 548610048. Throughput: 0: 9995.0, 1: 9966.1. Samples: 548619276. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:51,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-4.949')] [2023-12-28 02:56:51,262][106225] Updated weights for policy 1, policy_version 1072664 (0.0010) [2023-12-28 02:56:51,320][106225] Updated weights for policy 1, policy_version 1072674 (0.0010) [2023-12-28 02:56:51,389][106225] Updated weights for policy 1, policy_version 1072684 (0.0009) [2023-12-28 02:56:51,743][106226] Updated weights for policy 0, policy_version 1069953 (0.0009) [2023-12-28 02:56:51,809][106226] Updated weights for policy 0, policy_version 1069963 (0.0008) [2023-12-28 02:56:51,866][106226] Updated weights for policy 0, policy_version 1069973 (0.0008) [2023-12-28 02:56:51,933][106226] Updated weights for policy 0, policy_version 1069983 (0.0008) [2023-12-28 02:56:52,114][106225] Updated weights for policy 1, policy_version 1072694 (0.0010) [2023-12-28 02:56:52,180][106225] Updated weights for policy 1, policy_version 1072704 (0.0010) [2023-12-28 02:56:52,237][106225] Updated weights for policy 1, policy_version 1072714 (0.0010) [2023-12-28 02:56:52,679][106226] Updated weights for policy 0, policy_version 1069993 (0.0008) [2023-12-28 02:56:52,745][106226] Updated weights for policy 0, policy_version 1070003 (0.0009) [2023-12-28 02:56:52,810][106226] Updated weights for policy 0, policy_version 1070013 (0.0007) [2023-12-28 02:56:52,924][106225] Updated weights for policy 1, policy_version 1072724 (0.0008) [2023-12-28 02:56:52,984][106225] Updated weights for policy 1, policy_version 1072734 (0.0007) [2023-12-28 02:56:53,031][106225] Updated weights for policy 1, policy_version 1072744 (0.0008) [2023-12-28 02:56:53,494][106226] Updated weights for policy 0, policy_version 1070023 (0.0008) [2023-12-28 02:56:53,547][106226] Updated weights for policy 0, policy_version 1070033 (0.0007) [2023-12-28 02:56:53,597][106226] Updated weights for policy 0, policy_version 1070043 (0.0007) [2023-12-28 02:56:53,730][106225] Updated weights for policy 1, policy_version 1072754 (0.0010) [2023-12-28 02:56:53,788][106225] Updated weights for policy 1, policy_version 1072764 (0.0009) [2023-12-28 02:56:53,845][106225] Updated weights for policy 1, policy_version 1072774 (0.0010) [2023-12-28 02:56:53,900][106225] Updated weights for policy 1, policy_version 1072784 (0.0010) [2023-12-28 02:56:54,369][106226] Updated weights for policy 0, policy_version 1070053 (0.0008) [2023-12-28 02:56:54,425][106226] Updated weights for policy 0, policy_version 1070063 (0.0007) [2023-12-28 02:56:54,495][106226] Updated weights for policy 0, policy_version 1070073 (0.0008) [2023-12-28 02:56:54,578][106225] Updated weights for policy 1, policy_version 1072794 (0.0010) [2023-12-28 02:56:54,638][106225] Updated weights for policy 1, policy_version 1072804 (0.0010) [2023-12-28 02:56:54,694][106225] Updated weights for policy 1, policy_version 1072814 (0.0010) [2023-12-28 02:56:55,216][106226] Updated weights for policy 0, policy_version 1070083 (0.0007) [2023-12-28 02:56:55,275][106226] Updated weights for policy 0, policy_version 1070093 (0.0009) [2023-12-28 02:56:55,336][106226] Updated weights for policy 0, policy_version 1070103 (0.0007) [2023-12-28 02:56:55,381][106225] Updated weights for policy 1, policy_version 1072824 (0.0009) [2023-12-28 02:56:55,439][106225] Updated weights for policy 1, policy_version 1072834 (0.0005) [2023-12-28 02:56:55,499][106225] Updated weights for policy 1, policy_version 1072844 (0.0008) [2023-12-28 02:56:56,083][106226] Updated weights for policy 0, policy_version 1070113 (0.0007) [2023-12-28 02:56:56,134][106226] Updated weights for policy 0, policy_version 1070123 (0.0010) [2023-12-28 02:56:56,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 548700160. Throughput: 0: 9927.6, 1: 9969.1. Samples: 548676652. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:56:56,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-5.182')] [2023-12-28 02:56:56,177][106225] Updated weights for policy 1, policy_version 1072854 (0.0005) [2023-12-28 02:56:56,198][106226] Updated weights for policy 0, policy_version 1070133 (0.0011) [2023-12-28 02:56:56,238][106225] Updated weights for policy 1, policy_version 1072864 (0.0009) [2023-12-28 02:56:56,260][106226] Updated weights for policy 0, policy_version 1070143 (0.0009) [2023-12-28 02:56:56,263][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001070144_274014208.pth... [2023-12-28 02:56:56,267][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001068992_273719296.pth [2023-12-28 02:56:56,286][106225] Updated weights for policy 1, policy_version 1072874 (0.0009) [2023-12-28 02:56:56,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001072880_274702336.pth... [2023-12-28 02:56:56,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001071664_274391040.pth [2023-12-28 02:56:56,920][106226] Updated weights for policy 0, policy_version 1070153 (0.0010) [2023-12-28 02:56:56,970][106226] Updated weights for policy 0, policy_version 1070163 (0.0007) [2023-12-28 02:56:56,981][106225] Updated weights for policy 1, policy_version 1072885 (0.0010) [2023-12-28 02:56:57,024][106225] Updated weights for policy 1, policy_version 1072895 (0.0010) [2023-12-28 02:56:57,028][106226] Updated weights for policy 0, policy_version 1070173 (0.0005) [2023-12-28 02:56:57,069][106225] Updated weights for policy 1, policy_version 1072905 (0.0010) [2023-12-28 02:56:57,679][106226] Updated weights for policy 0, policy_version 1070183 (0.0009) [2023-12-28 02:56:57,739][106226] Updated weights for policy 0, policy_version 1070193 (0.0010) [2023-12-28 02:56:57,792][106226] Updated weights for policy 0, policy_version 1070203 (0.0010) [2023-12-28 02:56:57,795][106225] Updated weights for policy 1, policy_version 1072915 (0.0010) [2023-12-28 02:56:57,853][106225] Updated weights for policy 1, policy_version 1072925 (0.0010) [2023-12-28 02:56:57,915][106225] Updated weights for policy 1, policy_version 1072935 (0.0010) [2023-12-28 02:56:58,540][106226] Updated weights for policy 0, policy_version 1070213 (0.0011) [2023-12-28 02:56:58,569][106225] Updated weights for policy 1, policy_version 1072945 (0.0006) [2023-12-28 02:56:58,604][106226] Updated weights for policy 0, policy_version 1070223 (0.0009) [2023-12-28 02:56:58,632][106225] Updated weights for policy 1, policy_version 1072955 (0.0007) [2023-12-28 02:56:58,676][106226] Updated weights for policy 0, policy_version 1070233 (0.0009) [2023-12-28 02:56:58,696][106225] Updated weights for policy 1, policy_version 1072965 (0.0007) [2023-12-28 02:56:58,767][106225] Updated weights for policy 1, policy_version 1072975 (0.0008) [2023-12-28 02:56:59,475][106226] Updated weights for policy 0, policy_version 1070243 (0.0011) [2023-12-28 02:56:59,539][106226] Updated weights for policy 0, policy_version 1070253 (0.0010) [2023-12-28 02:56:59,553][106225] Updated weights for policy 1, policy_version 1072985 (0.0006) [2023-12-28 02:56:59,600][106226] Updated weights for policy 0, policy_version 1070263 (0.0010) [2023-12-28 02:56:59,604][106225] Updated weights for policy 1, policy_version 1072995 (0.0007) [2023-12-28 02:56:59,667][106225] Updated weights for policy 1, policy_version 1073005 (0.0006) [2023-12-28 02:57:00,313][106226] Updated weights for policy 0, policy_version 1070273 (0.0010) [2023-12-28 02:57:00,352][106225] Updated weights for policy 1, policy_version 1073015 (0.0006) [2023-12-28 02:57:00,366][106226] Updated weights for policy 0, policy_version 1070283 (0.0007) [2023-12-28 02:57:00,405][106225] Updated weights for policy 1, policy_version 1073025 (0.0006) [2023-12-28 02:57:00,425][106226] Updated weights for policy 0, policy_version 1070293 (0.0008) [2023-12-28 02:57:00,455][106225] Updated weights for policy 1, policy_version 1073035 (0.0008) [2023-12-28 02:57:00,488][106226] Updated weights for policy 0, policy_version 1070303 (0.0006) [2023-12-28 02:57:01,165][106226] Updated weights for policy 0, policy_version 1070313 (0.0007) [2023-12-28 02:57:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 548798464. Throughput: 0: 9870.9, 1: 9991.5. Samples: 548792720. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-28 02:57:01,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.948')] [2023-12-28 02:57:01,195][106225] Updated weights for policy 1, policy_version 1073045 (0.0008) [2023-12-28 02:57:01,232][106226] Updated weights for policy 0, policy_version 1070323 (0.0007) [2023-12-28 02:57:01,263][106225] Updated weights for policy 1, policy_version 1073055 (0.0008) [2023-12-28 02:57:01,298][106226] Updated weights for policy 0, policy_version 1070333 (0.0006) [2023-12-28 02:57:01,324][106225] Updated weights for policy 1, policy_version 1073065 (0.0007) [2023-12-28 02:57:01,976][106226] Updated weights for policy 0, policy_version 1070343 (0.0008) [2023-12-28 02:57:02,039][106226] Updated weights for policy 0, policy_version 1070353 (0.0006) [2023-12-28 02:57:02,099][106226] Updated weights for policy 0, policy_version 1070363 (0.0005) [2023-12-28 02:57:02,119][106225] Updated weights for policy 1, policy_version 1073075 (0.0008) [2023-12-28 02:57:02,179][106225] Updated weights for policy 1, policy_version 1073085 (0.0009) [2023-12-28 02:57:02,244][106225] Updated weights for policy 1, policy_version 1073095 (0.0009) [2023-12-28 02:57:02,758][106226] Updated weights for policy 0, policy_version 1070373 (0.0007) [2023-12-28 02:57:02,814][106226] Updated weights for policy 0, policy_version 1070383 (0.0009) [2023-12-28 02:57:02,880][106226] Updated weights for policy 0, policy_version 1070393 (0.0009) [2023-12-28 02:57:03,030][106225] Updated weights for policy 1, policy_version 1073105 (0.0008) [2023-12-28 02:57:03,080][106225] Updated weights for policy 1, policy_version 1073115 (0.0009) [2023-12-28 02:57:03,138][106225] Updated weights for policy 1, policy_version 1073125 (0.0005) [2023-12-28 02:57:03,196][106225] Updated weights for policy 1, policy_version 1073135 (0.0008) [2023-12-28 02:57:03,533][106226] Updated weights for policy 0, policy_version 1070403 (0.0007) [2023-12-28 02:57:03,587][106226] Updated weights for policy 0, policy_version 1070413 (0.0005) [2023-12-28 02:57:03,645][106226] Updated weights for policy 0, policy_version 1070423 (0.0005) [2023-12-28 02:57:03,970][106225] Updated weights for policy 1, policy_version 1073145 (0.0008) [2023-12-28 02:57:04,030][106225] Updated weights for policy 1, policy_version 1073155 (0.0008) [2023-12-28 02:57:04,085][106225] Updated weights for policy 1, policy_version 1073165 (0.0007) [2023-12-28 02:57:04,270][106226] Updated weights for policy 0, policy_version 1070433 (0.0006) [2023-12-28 02:57:04,339][106226] Updated weights for policy 0, policy_version 1070443 (0.0011) [2023-12-28 02:57:04,401][106226] Updated weights for policy 0, policy_version 1070453 (0.0008) [2023-12-28 02:57:04,459][106226] Updated weights for policy 0, policy_version 1070463 (0.0006) [2023-12-28 02:57:04,868][106225] Updated weights for policy 1, policy_version 1073175 (0.0008) [2023-12-28 02:57:04,925][106225] Updated weights for policy 1, policy_version 1073185 (0.0007) [2023-12-28 02:57:04,978][106225] Updated weights for policy 1, policy_version 1073195 (0.0008) [2023-12-28 02:57:05,134][106226] Updated weights for policy 0, policy_version 1070473 (0.0005) [2023-12-28 02:57:05,201][106226] Updated weights for policy 0, policy_version 1070483 (0.0006) [2023-12-28 02:57:05,257][106226] Updated weights for policy 0, policy_version 1070493 (0.0007) [2023-12-28 02:57:05,645][106225] Updated weights for policy 1, policy_version 1073205 (0.0007) [2023-12-28 02:57:05,692][106225] Updated weights for policy 1, policy_version 1073215 (0.0007) [2023-12-28 02:57:05,735][106225] Updated weights for policy 1, policy_version 1073225 (0.0008) [2023-12-28 02:57:05,935][106226] Updated weights for policy 0, policy_version 1070503 (0.0009) [2023-12-28 02:57:05,982][106226] Updated weights for policy 0, policy_version 1070513 (0.0010) [2023-12-28 02:57:06,037][106226] Updated weights for policy 0, policy_version 1070523 (0.0010) [2023-12-28 02:57:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 548904960. Throughput: 0: 9928.1, 1: 9925.6. Samples: 548910740. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:06,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.893')] [2023-12-28 02:57:06,423][106225] Updated weights for policy 1, policy_version 1073235 (0.0008) [2023-12-28 02:57:06,486][106225] Updated weights for policy 1, policy_version 1073245 (0.0006) [2023-12-28 02:57:06,547][106225] Updated weights for policy 1, policy_version 1073255 (0.0007) [2023-12-28 02:57:06,784][106226] Updated weights for policy 0, policy_version 1070533 (0.0010) [2023-12-28 02:57:06,838][106226] Updated weights for policy 0, policy_version 1070543 (0.0010) [2023-12-28 02:57:06,903][106226] Updated weights for policy 0, policy_version 1070553 (0.0010) [2023-12-28 02:57:07,198][106225] Updated weights for policy 1, policy_version 1073265 (0.0007) [2023-12-28 02:57:07,259][106225] Updated weights for policy 1, policy_version 1073275 (0.0006) [2023-12-28 02:57:07,323][106225] Updated weights for policy 1, policy_version 1073285 (0.0005) [2023-12-28 02:57:07,382][106225] Updated weights for policy 1, policy_version 1073295 (0.0005) [2023-12-28 02:57:07,620][106226] Updated weights for policy 0, policy_version 1070563 (0.0011) [2023-12-28 02:57:07,666][106226] Updated weights for policy 0, policy_version 1070573 (0.0010) [2023-12-28 02:57:07,712][106226] Updated weights for policy 0, policy_version 1070583 (0.0010) [2023-12-28 02:57:07,971][106225] Updated weights for policy 1, policy_version 1073305 (0.0010) [2023-12-28 02:57:08,022][106225] Updated weights for policy 1, policy_version 1073315 (0.0008) [2023-12-28 02:57:08,068][106225] Updated weights for policy 1, policy_version 1073325 (0.0005) [2023-12-28 02:57:08,479][106226] Updated weights for policy 0, policy_version 1070593 (0.0010) [2023-12-28 02:57:08,543][106226] Updated weights for policy 0, policy_version 1070603 (0.0011) [2023-12-28 02:57:08,611][106226] Updated weights for policy 0, policy_version 1070613 (0.0011) [2023-12-28 02:57:08,675][106226] Updated weights for policy 0, policy_version 1070623 (0.0011) [2023-12-28 02:57:08,696][106225] Updated weights for policy 1, policy_version 1073335 (0.0006) [2023-12-28 02:57:08,759][106225] Updated weights for policy 1, policy_version 1073345 (0.0007) [2023-12-28 02:57:08,825][106225] Updated weights for policy 1, policy_version 1073355 (0.0008) [2023-12-28 02:57:09,464][106226] Updated weights for policy 0, policy_version 1070633 (0.0011) [2023-12-28 02:57:09,510][106225] Updated weights for policy 1, policy_version 1073365 (0.0007) [2023-12-28 02:57:09,529][106226] Updated weights for policy 0, policy_version 1070643 (0.0011) [2023-12-28 02:57:09,568][106225] Updated weights for policy 1, policy_version 1073375 (0.0008) [2023-12-28 02:57:09,619][106226] Updated weights for policy 0, policy_version 1070653 (0.0011) [2023-12-28 02:57:09,624][106225] Updated weights for policy 1, policy_version 1073385 (0.0009) [2023-12-28 02:57:10,323][106225] Updated weights for policy 1, policy_version 1073395 (0.0007) [2023-12-28 02:57:10,332][106226] Updated weights for policy 0, policy_version 1070663 (0.0008) [2023-12-28 02:57:10,391][106225] Updated weights for policy 1, policy_version 1073405 (0.0006) [2023-12-28 02:57:10,402][106226] Updated weights for policy 0, policy_version 1070673 (0.0007) [2023-12-28 02:57:10,457][106225] Updated weights for policy 1, policy_version 1073415 (0.0006) [2023-12-28 02:57:10,466][106226] Updated weights for policy 0, policy_version 1070683 (0.0008) [2023-12-28 02:57:11,110][106225] Updated weights for policy 1, policy_version 1073425 (0.0006) [2023-12-28 02:57:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 548995072. Throughput: 0: 9904.9, 1: 10024.4. Samples: 548971908. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:11,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.835')] [2023-12-28 02:57:11,177][106225] Updated weights for policy 1, policy_version 1073435 (0.0009) [2023-12-28 02:57:11,197][106226] Updated weights for policy 0, policy_version 1070693 (0.0008) [2023-12-28 02:57:11,242][106225] Updated weights for policy 1, policy_version 1073445 (0.0007) [2023-12-28 02:57:11,264][106226] Updated weights for policy 0, policy_version 1070703 (0.0009) [2023-12-28 02:57:11,310][106225] Updated weights for policy 1, policy_version 1073455 (0.0008) [2023-12-28 02:57:11,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001073456_274849792.pth... [2023-12-28 02:57:11,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001072272_274546688.pth [2023-12-28 02:57:11,330][106226] Updated weights for policy 0, policy_version 1070713 (0.0007) [2023-12-28 02:57:11,383][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001070720_274161664.pth... [2023-12-28 02:57:11,389][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001069568_273866752.pth [2023-12-28 02:57:12,057][106226] Updated weights for policy 0, policy_version 1070723 (0.0008) [2023-12-28 02:57:12,121][106225] Updated weights for policy 1, policy_version 1073465 (0.0007) [2023-12-28 02:57:12,124][106226] Updated weights for policy 0, policy_version 1070733 (0.0006) [2023-12-28 02:57:12,182][106225] Updated weights for policy 1, policy_version 1073475 (0.0006) [2023-12-28 02:57:12,186][106226] Updated weights for policy 0, policy_version 1070743 (0.0007) [2023-12-28 02:57:12,248][106225] Updated weights for policy 1, policy_version 1073485 (0.0007) [2023-12-28 02:57:12,889][106225] Updated weights for policy 1, policy_version 1073495 (0.0007) [2023-12-28 02:57:12,943][106225] Updated weights for policy 1, policy_version 1073505 (0.0005) [2023-12-28 02:57:12,945][106226] Updated weights for policy 0, policy_version 1070753 (0.0009) [2023-12-28 02:57:12,997][106226] Updated weights for policy 0, policy_version 1070763 (0.0007) [2023-12-28 02:57:12,998][106225] Updated weights for policy 1, policy_version 1073515 (0.0006) [2023-12-28 02:57:13,051][106226] Updated weights for policy 0, policy_version 1070773 (0.0008) [2023-12-28 02:57:13,098][106226] Updated weights for policy 0, policy_version 1070783 (0.0010) [2023-12-28 02:57:13,539][106225] Updated weights for policy 1, policy_version 1073525 (0.0007) [2023-12-28 02:57:13,601][106225] Updated weights for policy 1, policy_version 1073535 (0.0005) [2023-12-28 02:57:13,665][106225] Updated weights for policy 1, policy_version 1073545 (0.0005) [2023-12-28 02:57:13,846][106226] Updated weights for policy 0, policy_version 1070793 (0.0011) [2023-12-28 02:57:13,912][106226] Updated weights for policy 0, policy_version 1070803 (0.0011) [2023-12-28 02:57:13,975][106226] Updated weights for policy 0, policy_version 1070813 (0.0011) [2023-12-28 02:57:14,265][106225] Updated weights for policy 1, policy_version 1073555 (0.0006) [2023-12-28 02:57:14,310][106225] Updated weights for policy 1, policy_version 1073565 (0.0009) [2023-12-28 02:57:14,362][106225] Updated weights for policy 1, policy_version 1073575 (0.0008) [2023-12-28 02:57:14,637][106226] Updated weights for policy 0, policy_version 1070823 (0.0008) [2023-12-28 02:57:14,690][106226] Updated weights for policy 0, policy_version 1070833 (0.0009) [2023-12-28 02:57:14,735][106226] Updated weights for policy 0, policy_version 1070843 (0.0008) [2023-12-28 02:57:14,989][106225] Updated weights for policy 1, policy_version 1073585 (0.0009) [2023-12-28 02:57:15,050][106225] Updated weights for policy 1, policy_version 1073595 (0.0008) [2023-12-28 02:57:15,110][106225] Updated weights for policy 1, policy_version 1073605 (0.0007) [2023-12-28 02:57:15,168][106225] Updated weights for policy 1, policy_version 1073615 (0.0008) [2023-12-28 02:57:15,538][106226] Updated weights for policy 0, policy_version 1070853 (0.0006) [2023-12-28 02:57:15,592][106226] Updated weights for policy 0, policy_version 1070863 (0.0005) [2023-12-28 02:57:15,648][106226] Updated weights for policy 0, policy_version 1070873 (0.0005) [2023-12-28 02:57:15,951][106225] Updated weights for policy 1, policy_version 1073625 (0.0008) [2023-12-28 02:57:15,999][106225] Updated weights for policy 1, policy_version 1073635 (0.0008) [2023-12-28 02:57:16,044][106225] Updated weights for policy 1, policy_version 1073645 (0.0008) [2023-12-28 02:57:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 549101568. Throughput: 0: 9704.0, 1: 10032.6. Samples: 549089792. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:16,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-4.664')] [2023-12-28 02:57:16,292][106226] Updated weights for policy 0, policy_version 1070883 (0.0006) [2023-12-28 02:57:16,358][106226] Updated weights for policy 0, policy_version 1070893 (0.0009) [2023-12-28 02:57:16,417][106226] Updated weights for policy 0, policy_version 1070903 (0.0009) [2023-12-28 02:57:16,823][106225] Updated weights for policy 1, policy_version 1073655 (0.0009) [2023-12-28 02:57:16,890][106225] Updated weights for policy 1, policy_version 1073665 (0.0010) [2023-12-28 02:57:16,956][106225] Updated weights for policy 1, policy_version 1073675 (0.0007) [2023-12-28 02:57:17,014][106226] Updated weights for policy 0, policy_version 1070913 (0.0008) [2023-12-28 02:57:17,068][106226] Updated weights for policy 0, policy_version 1070923 (0.0009) [2023-12-28 02:57:17,123][106226] Updated weights for policy 0, policy_version 1070933 (0.0009) [2023-12-28 02:57:17,184][106226] Updated weights for policy 0, policy_version 1070944 (0.0008) [2023-12-28 02:57:17,662][106225] Updated weights for policy 1, policy_version 1073685 (0.0009) [2023-12-28 02:57:17,713][106225] Updated weights for policy 1, policy_version 1073695 (0.0009) [2023-12-28 02:57:17,771][106225] Updated weights for policy 1, policy_version 1073705 (0.0008) [2023-12-28 02:57:17,788][106226] Updated weights for policy 0, policy_version 1070954 (0.0006) [2023-12-28 02:57:17,843][106226] Updated weights for policy 0, policy_version 1070964 (0.0007) [2023-12-28 02:57:17,900][106226] Updated weights for policy 0, policy_version 1070974 (0.0005) [2023-12-28 02:57:18,457][106226] Updated weights for policy 0, policy_version 1070984 (0.0010) [2023-12-28 02:57:18,519][106226] Updated weights for policy 0, policy_version 1070994 (0.0009) [2023-12-28 02:57:18,583][106226] Updated weights for policy 0, policy_version 1071004 (0.0011) [2023-12-28 02:57:18,607][106225] Updated weights for policy 1, policy_version 1073715 (0.0007) [2023-12-28 02:57:18,666][106225] Updated weights for policy 1, policy_version 1073725 (0.0009) [2023-12-28 02:57:18,721][106225] Updated weights for policy 1, policy_version 1073735 (0.0009) [2023-12-28 02:57:19,271][106226] Updated weights for policy 0, policy_version 1071014 (0.0010) [2023-12-28 02:57:19,324][106226] Updated weights for policy 0, policy_version 1071024 (0.0009) [2023-12-28 02:57:19,394][106226] Updated weights for policy 0, policy_version 1071034 (0.0008) [2023-12-28 02:57:19,511][106225] Updated weights for policy 1, policy_version 1073745 (0.0008) [2023-12-28 02:57:19,577][106225] Updated weights for policy 1, policy_version 1073755 (0.0009) [2023-12-28 02:57:19,645][106225] Updated weights for policy 1, policy_version 1073765 (0.0010) [2023-12-28 02:57:19,715][106225] Updated weights for policy 1, policy_version 1073775 (0.0007) [2023-12-28 02:57:20,136][106226] Updated weights for policy 0, policy_version 1071044 (0.0007) [2023-12-28 02:57:20,192][106226] Updated weights for policy 0, policy_version 1071054 (0.0006) [2023-12-28 02:57:20,253][106226] Updated weights for policy 0, policy_version 1071064 (0.0007) [2023-12-28 02:57:20,371][106225] Updated weights for policy 1, policy_version 1073785 (0.0008) [2023-12-28 02:57:20,428][106225] Updated weights for policy 1, policy_version 1073795 (0.0008) [2023-12-28 02:57:20,482][106225] Updated weights for policy 1, policy_version 1073805 (0.0008) [2023-12-28 02:57:20,939][106226] Updated weights for policy 0, policy_version 1071074 (0.0009) [2023-12-28 02:57:20,997][106226] Updated weights for policy 0, policy_version 1071084 (0.0009) [2023-12-28 02:57:21,062][106226] Updated weights for policy 0, policy_version 1071094 (0.0009) [2023-12-28 02:57:21,134][106226] Updated weights for policy 0, policy_version 1071104 (0.0008) [2023-12-28 02:57:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 549199872. Throughput: 0: 9839.5, 1: 9924.6. Samples: 549207616. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:21,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.777')] [2023-12-28 02:57:21,280][106225] Updated weights for policy 1, policy_version 1073815 (0.0008) [2023-12-28 02:57:21,340][106225] Updated weights for policy 1, policy_version 1073825 (0.0008) [2023-12-28 02:57:21,414][106225] Updated weights for policy 1, policy_version 1073835 (0.0008) [2023-12-28 02:57:21,868][106226] Updated weights for policy 0, policy_version 1071114 (0.0008) [2023-12-28 02:57:21,930][106226] Updated weights for policy 0, policy_version 1071124 (0.0009) [2023-12-28 02:57:21,991][106226] Updated weights for policy 0, policy_version 1071134 (0.0009) [2023-12-28 02:57:22,147][106225] Updated weights for policy 1, policy_version 1073845 (0.0008) [2023-12-28 02:57:22,195][106225] Updated weights for policy 1, policy_version 1073855 (0.0008) [2023-12-28 02:57:22,244][106225] Updated weights for policy 1, policy_version 1073865 (0.0009) [2023-12-28 02:57:22,775][106226] Updated weights for policy 0, policy_version 1071144 (0.0009) [2023-12-28 02:57:22,842][106226] Updated weights for policy 0, policy_version 1071154 (0.0009) [2023-12-28 02:57:22,897][106226] Updated weights for policy 0, policy_version 1071164 (0.0009) [2023-12-28 02:57:22,926][106225] Updated weights for policy 1, policy_version 1073875 (0.0007) [2023-12-28 02:57:22,981][106225] Updated weights for policy 1, policy_version 1073885 (0.0006) [2023-12-28 02:57:23,039][106225] Updated weights for policy 1, policy_version 1073895 (0.0005) [2023-12-28 02:57:23,639][106226] Updated weights for policy 0, policy_version 1071174 (0.0009) [2023-12-28 02:57:23,691][106226] Updated weights for policy 0, policy_version 1071184 (0.0008) [2023-12-28 02:57:23,712][106225] Updated weights for policy 1, policy_version 1073905 (0.0005) [2023-12-28 02:57:23,753][106226] Updated weights for policy 0, policy_version 1071194 (0.0009) [2023-12-28 02:57:23,764][106225] Updated weights for policy 1, policy_version 1073915 (0.0005) [2023-12-28 02:57:23,816][106225] Updated weights for policy 1, policy_version 1073925 (0.0008) [2023-12-28 02:57:23,866][106225] Updated weights for policy 1, policy_version 1073935 (0.0008) [2023-12-28 02:57:24,494][106226] Updated weights for policy 0, policy_version 1071204 (0.0010) [2023-12-28 02:57:24,538][106225] Updated weights for policy 1, policy_version 1073945 (0.0006) [2023-12-28 02:57:24,556][106226] Updated weights for policy 0, policy_version 1071214 (0.0010) [2023-12-28 02:57:24,604][106225] Updated weights for policy 1, policy_version 1073955 (0.0006) [2023-12-28 02:57:24,610][106226] Updated weights for policy 0, policy_version 1071224 (0.0011) [2023-12-28 02:57:24,665][106225] Updated weights for policy 1, policy_version 1073965 (0.0005) [2023-12-28 02:57:25,175][106225] Updated weights for policy 1, policy_version 1073975 (0.0005) [2023-12-28 02:57:25,241][106225] Updated weights for policy 1, policy_version 1073985 (0.0007) [2023-12-28 02:57:25,273][106226] Updated weights for policy 0, policy_version 1071234 (0.0009) [2023-12-28 02:57:25,308][106225] Updated weights for policy 1, policy_version 1073995 (0.0008) [2023-12-28 02:57:25,330][106226] Updated weights for policy 0, policy_version 1071244 (0.0010) [2023-12-28 02:57:25,386][106226] Updated weights for policy 0, policy_version 1071254 (0.0010) [2023-12-28 02:57:25,437][106226] Updated weights for policy 0, policy_version 1071264 (0.0011) [2023-12-28 02:57:25,953][106225] Updated weights for policy 1, policy_version 1074005 (0.0008) [2023-12-28 02:57:25,972][106226] Updated weights for policy 0, policy_version 1071274 (0.0005) [2023-12-28 02:57:26,007][106225] Updated weights for policy 1, policy_version 1074015 (0.0009) [2023-12-28 02:57:26,021][106226] Updated weights for policy 0, policy_version 1071284 (0.0008) [2023-12-28 02:57:26,061][106225] Updated weights for policy 1, policy_version 1074025 (0.0006) [2023-12-28 02:57:26,073][106226] Updated weights for policy 0, policy_version 1071294 (0.0005) [2023-12-28 02:57:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 549306368. Throughput: 0: 9802.1, 1: 9941.7. Samples: 549264804. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:26,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.844')] [2023-12-28 02:57:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001074032_274997248.pth... [2023-12-28 02:57:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001071296_274309120.pth... [2023-12-28 02:57:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001070144_274014208.pth [2023-12-28 02:57:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001072880_274702336.pth [2023-12-28 02:57:26,715][106226] Updated weights for policy 0, policy_version 1071304 (0.0009) [2023-12-28 02:57:26,763][106225] Updated weights for policy 1, policy_version 1074035 (0.0005) [2023-12-28 02:57:26,770][106226] Updated weights for policy 0, policy_version 1071314 (0.0010) [2023-12-28 02:57:26,826][106226] Updated weights for policy 0, policy_version 1071324 (0.0010) [2023-12-28 02:57:26,829][106225] Updated weights for policy 1, policy_version 1074045 (0.0005) [2023-12-28 02:57:26,888][106225] Updated weights for policy 1, policy_version 1074055 (0.0005) [2023-12-28 02:57:27,424][106226] Updated weights for policy 0, policy_version 1071334 (0.0009) [2023-12-28 02:57:27,482][106225] Updated weights for policy 1, policy_version 1074065 (0.0007) [2023-12-28 02:57:27,489][106226] Updated weights for policy 0, policy_version 1071344 (0.0010) [2023-12-28 02:57:27,542][106225] Updated weights for policy 1, policy_version 1074075 (0.0009) [2023-12-28 02:57:27,545][106226] Updated weights for policy 0, policy_version 1071354 (0.0009) [2023-12-28 02:57:27,590][106225] Updated weights for policy 1, policy_version 1074085 (0.0008) [2023-12-28 02:57:27,651][106225] Updated weights for policy 1, policy_version 1074095 (0.0008) [2023-12-28 02:57:28,139][106226] Updated weights for policy 0, policy_version 1071364 (0.0008) [2023-12-28 02:57:28,193][106226] Updated weights for policy 0, policy_version 1071374 (0.0006) [2023-12-28 02:57:28,240][106226] Updated weights for policy 0, policy_version 1071384 (0.0010) [2023-12-28 02:57:28,498][106225] Updated weights for policy 1, policy_version 1074105 (0.0007) [2023-12-28 02:57:28,562][106225] Updated weights for policy 1, policy_version 1074115 (0.0010) [2023-12-28 02:57:28,627][106225] Updated weights for policy 1, policy_version 1074125 (0.0011) [2023-12-28 02:57:28,890][106226] Updated weights for policy 0, policy_version 1071394 (0.0007) [2023-12-28 02:57:28,937][106226] Updated weights for policy 0, policy_version 1071404 (0.0008) [2023-12-28 02:57:28,992][106226] Updated weights for policy 0, policy_version 1071414 (0.0008) [2023-12-28 02:57:29,047][106226] Updated weights for policy 0, policy_version 1071424 (0.0008) [2023-12-28 02:57:29,311][106225] Updated weights for policy 1, policy_version 1074135 (0.0009) [2023-12-28 02:57:29,379][106225] Updated weights for policy 1, policy_version 1074145 (0.0008) [2023-12-28 02:57:29,445][106225] Updated weights for policy 1, policy_version 1074155 (0.0008) [2023-12-28 02:57:29,817][106226] Updated weights for policy 0, policy_version 1071434 (0.0007) [2023-12-28 02:57:29,874][106226] Updated weights for policy 0, policy_version 1071444 (0.0008) [2023-12-28 02:57:29,935][106226] Updated weights for policy 0, policy_version 1071454 (0.0008) [2023-12-28 02:57:30,167][106225] Updated weights for policy 1, policy_version 1074165 (0.0008) [2023-12-28 02:57:30,219][106225] Updated weights for policy 1, policy_version 1074175 (0.0008) [2023-12-28 02:57:30,271][106225] Updated weights for policy 1, policy_version 1074185 (0.0008) [2023-12-28 02:57:30,651][106226] Updated weights for policy 0, policy_version 1071464 (0.0009) [2023-12-28 02:57:30,713][106226] Updated weights for policy 0, policy_version 1071474 (0.0009) [2023-12-28 02:57:30,773][106226] Updated weights for policy 0, policy_version 1071484 (0.0008) [2023-12-28 02:57:31,002][106225] Updated weights for policy 1, policy_version 1074195 (0.0008) [2023-12-28 02:57:31,062][106225] Updated weights for policy 1, policy_version 1074205 (0.0008) [2023-12-28 02:57:31,120][106225] Updated weights for policy 1, policy_version 1074215 (0.0008) [2023-12-28 02:57:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 549396480. Throughput: 0: 9915.5, 1: 9996.2. Samples: 549390416. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:31,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.911')] [2023-12-28 02:57:31,559][106226] Updated weights for policy 0, policy_version 1071494 (0.0009) [2023-12-28 02:57:31,605][106226] Updated weights for policy 0, policy_version 1071504 (0.0009) [2023-12-28 02:57:31,671][106226] Updated weights for policy 0, policy_version 1071514 (0.0008) [2023-12-28 02:57:31,857][106225] Updated weights for policy 1, policy_version 1074225 (0.0009) [2023-12-28 02:57:31,917][106225] Updated weights for policy 1, policy_version 1074235 (0.0007) [2023-12-28 02:57:31,979][106225] Updated weights for policy 1, policy_version 1074245 (0.0008) [2023-12-28 02:57:32,044][106225] Updated weights for policy 1, policy_version 1074255 (0.0008) [2023-12-28 02:57:32,447][106226] Updated weights for policy 0, policy_version 1071524 (0.0007) [2023-12-28 02:57:32,508][106226] Updated weights for policy 0, policy_version 1071534 (0.0009) [2023-12-28 02:57:32,571][106226] Updated weights for policy 0, policy_version 1071544 (0.0009) [2023-12-28 02:57:32,795][106225] Updated weights for policy 1, policy_version 1074265 (0.0008) [2023-12-28 02:57:32,857][106225] Updated weights for policy 1, policy_version 1074275 (0.0008) [2023-12-28 02:57:32,922][106225] Updated weights for policy 1, policy_version 1074285 (0.0006) [2023-12-28 02:57:33,279][106226] Updated weights for policy 0, policy_version 1071554 (0.0008) [2023-12-28 02:57:33,344][106226] Updated weights for policy 0, policy_version 1071564 (0.0009) [2023-12-28 02:57:33,411][106226] Updated weights for policy 0, policy_version 1071574 (0.0009) [2023-12-28 02:57:33,463][106226] Updated weights for policy 0, policy_version 1071584 (0.0005) [2023-12-28 02:57:33,496][106225] Updated weights for policy 1, policy_version 1074295 (0.0008) [2023-12-28 02:57:33,547][106225] Updated weights for policy 1, policy_version 1074305 (0.0008) [2023-12-28 02:57:33,605][106225] Updated weights for policy 1, policy_version 1074315 (0.0010) [2023-12-28 02:57:34,120][106226] Updated weights for policy 0, policy_version 1071594 (0.0006) [2023-12-28 02:57:34,181][106226] Updated weights for policy 0, policy_version 1071604 (0.0007) [2023-12-28 02:57:34,248][106226] Updated weights for policy 0, policy_version 1071614 (0.0007) [2023-12-28 02:57:34,342][106225] Updated weights for policy 1, policy_version 1074325 (0.0010) [2023-12-28 02:57:34,406][106225] Updated weights for policy 1, policy_version 1074335 (0.0007) [2023-12-28 02:57:34,478][106225] Updated weights for policy 1, policy_version 1074345 (0.0010) [2023-12-28 02:57:34,912][106226] Updated weights for policy 0, policy_version 1071624 (0.0008) [2023-12-28 02:57:34,976][106226] Updated weights for policy 0, policy_version 1071634 (0.0008) [2023-12-28 02:57:35,039][106226] Updated weights for policy 0, policy_version 1071644 (0.0010) [2023-12-28 02:57:35,136][106225] Updated weights for policy 1, policy_version 1074355 (0.0009) [2023-12-28 02:57:35,200][106225] Updated weights for policy 1, policy_version 1074365 (0.0010) [2023-12-28 02:57:35,269][106225] Updated weights for policy 1, policy_version 1074375 (0.0010) [2023-12-28 02:57:35,748][106226] Updated weights for policy 0, policy_version 1071654 (0.0006) [2023-12-28 02:57:35,802][106226] Updated weights for policy 0, policy_version 1071664 (0.0006) [2023-12-28 02:57:35,861][106226] Updated weights for policy 0, policy_version 1071674 (0.0007) [2023-12-28 02:57:35,962][106225] Updated weights for policy 1, policy_version 1074385 (0.0010) [2023-12-28 02:57:36,012][106225] Updated weights for policy 1, policy_version 1074395 (0.0010) [2023-12-28 02:57:36,058][106225] Updated weights for policy 1, policy_version 1074405 (0.0010) [2023-12-28 02:57:36,110][106225] Updated weights for policy 1, policy_version 1074415 (0.0010) [2023-12-28 02:57:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 549502976. Throughput: 0: 9875.5, 1: 9868.6. Samples: 549507760. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:36,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.836')] [2023-12-28 02:57:36,521][106226] Updated weights for policy 0, policy_version 1071684 (0.0007) [2023-12-28 02:57:36,580][106226] Updated weights for policy 0, policy_version 1071694 (0.0006) [2023-12-28 02:57:36,634][106226] Updated weights for policy 0, policy_version 1071704 (0.0007) [2023-12-28 02:57:36,809][106225] Updated weights for policy 1, policy_version 1074425 (0.0010) [2023-12-28 02:57:36,872][106225] Updated weights for policy 1, policy_version 1074435 (0.0010) [2023-12-28 02:57:36,929][106225] Updated weights for policy 1, policy_version 1074445 (0.0010) [2023-12-28 02:57:37,241][106226] Updated weights for policy 0, policy_version 1071714 (0.0008) [2023-12-28 02:57:37,296][106226] Updated weights for policy 0, policy_version 1071724 (0.0006) [2023-12-28 02:57:37,353][106226] Updated weights for policy 0, policy_version 1071734 (0.0007) [2023-12-28 02:57:37,412][106226] Updated weights for policy 0, policy_version 1071744 (0.0008) [2023-12-28 02:57:37,566][106225] Updated weights for policy 1, policy_version 1074455 (0.0010) [2023-12-28 02:57:37,622][106225] Updated weights for policy 1, policy_version 1074465 (0.0010) [2023-12-28 02:57:37,674][106225] Updated weights for policy 1, policy_version 1074475 (0.0011) [2023-12-28 02:57:38,122][106226] Updated weights for policy 0, policy_version 1071754 (0.0008) [2023-12-28 02:57:38,165][106226] Updated weights for policy 0, policy_version 1071764 (0.0007) [2023-12-28 02:57:38,216][106226] Updated weights for policy 0, policy_version 1071774 (0.0008) [2023-12-28 02:57:38,448][106225] Updated weights for policy 1, policy_version 1074485 (0.0010) [2023-12-28 02:57:38,505][106225] Updated weights for policy 1, policy_version 1074495 (0.0010) [2023-12-28 02:57:38,566][106225] Updated weights for policy 1, policy_version 1074505 (0.0010) [2023-12-28 02:57:39,004][106226] Updated weights for policy 0, policy_version 1071784 (0.0008) [2023-12-28 02:57:39,073][106226] Updated weights for policy 0, policy_version 1071794 (0.0009) [2023-12-28 02:57:39,139][106226] Updated weights for policy 0, policy_version 1071804 (0.0008) [2023-12-28 02:57:39,218][106225] Updated weights for policy 1, policy_version 1074515 (0.0010) [2023-12-28 02:57:39,281][106225] Updated weights for policy 1, policy_version 1074525 (0.0010) [2023-12-28 02:57:39,365][106225] Updated weights for policy 1, policy_version 1074535 (0.0008) [2023-12-28 02:57:39,966][106226] Updated weights for policy 0, policy_version 1071814 (0.0009) [2023-12-28 02:57:40,029][106226] Updated weights for policy 0, policy_version 1071824 (0.0008) [2023-12-28 02:57:40,048][106225] Updated weights for policy 1, policy_version 1074545 (0.0009) [2023-12-28 02:57:40,096][106226] Updated weights for policy 0, policy_version 1071834 (0.0006) [2023-12-28 02:57:40,111][106225] Updated weights for policy 1, policy_version 1074555 (0.0010) [2023-12-28 02:57:40,176][106225] Updated weights for policy 1, policy_version 1074565 (0.0008) [2023-12-28 02:57:40,237][106225] Updated weights for policy 1, policy_version 1074575 (0.0009) [2023-12-28 02:57:40,778][106226] Updated weights for policy 0, policy_version 1071844 (0.0006) [2023-12-28 02:57:40,849][106226] Updated weights for policy 0, policy_version 1071854 (0.0006) [2023-12-28 02:57:40,915][106226] Updated weights for policy 0, policy_version 1071864 (0.0007) [2023-12-28 02:57:40,985][106225] Updated weights for policy 1, policy_version 1074585 (0.0007) [2023-12-28 02:57:41,061][106225] Updated weights for policy 1, policy_version 1074595 (0.0010) [2023-12-28 02:57:41,120][106225] Updated weights for policy 1, policy_version 1074605 (0.0010) [2023-12-28 02:57:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 549601280. Throughput: 0: 9916.2, 1: 9878.0. Samples: 549567392. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:41,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.789')] [2023-12-28 02:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001071872_274456576.pth... [2023-12-28 02:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001074608_275144704.pth... [2023-12-28 02:57:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001070720_274161664.pth [2023-12-28 02:57:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001073456_274849792.pth [2023-12-28 02:57:41,625][106226] Updated weights for policy 0, policy_version 1071874 (0.0007) [2023-12-28 02:57:41,694][106226] Updated weights for policy 0, policy_version 1071884 (0.0009) [2023-12-28 02:57:41,765][106226] Updated weights for policy 0, policy_version 1071894 (0.0007) [2023-12-28 02:57:41,829][106226] Updated weights for policy 0, policy_version 1071904 (0.0006) [2023-12-28 02:57:41,949][106225] Updated weights for policy 1, policy_version 1074615 (0.0008) [2023-12-28 02:57:42,011][106225] Updated weights for policy 1, policy_version 1074625 (0.0008) [2023-12-28 02:57:42,072][106225] Updated weights for policy 1, policy_version 1074635 (0.0009) [2023-12-28 02:57:42,578][106226] Updated weights for policy 0, policy_version 1071914 (0.0008) [2023-12-28 02:57:42,641][106226] Updated weights for policy 0, policy_version 1071924 (0.0007) [2023-12-28 02:57:42,704][106226] Updated weights for policy 0, policy_version 1071934 (0.0005) [2023-12-28 02:57:42,812][106225] Updated weights for policy 1, policy_version 1074645 (0.0007) [2023-12-28 02:57:42,879][106225] Updated weights for policy 1, policy_version 1074655 (0.0009) [2023-12-28 02:57:42,940][106225] Updated weights for policy 1, policy_version 1074665 (0.0007) [2023-12-28 02:57:43,351][106226] Updated weights for policy 0, policy_version 1071944 (0.0009) [2023-12-28 02:57:43,416][106226] Updated weights for policy 0, policy_version 1071954 (0.0010) [2023-12-28 02:57:43,466][106226] Updated weights for policy 0, policy_version 1071964 (0.0009) [2023-12-28 02:57:43,588][106225] Updated weights for policy 1, policy_version 1074675 (0.0007) [2023-12-28 02:57:43,636][106225] Updated weights for policy 1, policy_version 1074685 (0.0008) [2023-12-28 02:57:43,685][106225] Updated weights for policy 1, policy_version 1074695 (0.0008) [2023-12-28 02:57:44,226][106226] Updated weights for policy 0, policy_version 1071974 (0.0008) [2023-12-28 02:57:44,285][106226] Updated weights for policy 0, policy_version 1071984 (0.0009) [2023-12-28 02:57:44,344][106226] Updated weights for policy 0, policy_version 1071994 (0.0009) [2023-12-28 02:57:44,410][106225] Updated weights for policy 1, policy_version 1074705 (0.0009) [2023-12-28 02:57:44,469][106225] Updated weights for policy 1, policy_version 1074715 (0.0009) [2023-12-28 02:57:44,516][106225] Updated weights for policy 1, policy_version 1074725 (0.0008) [2023-12-28 02:57:44,575][106225] Updated weights for policy 1, policy_version 1074735 (0.0005) [2023-12-28 02:57:44,988][106226] Updated weights for policy 0, policy_version 1072004 (0.0009) [2023-12-28 02:57:45,054][106226] Updated weights for policy 0, policy_version 1072014 (0.0009) [2023-12-28 02:57:45,121][106226] Updated weights for policy 0, policy_version 1072024 (0.0009) [2023-12-28 02:57:45,246][106225] Updated weights for policy 1, policy_version 1074745 (0.0008) [2023-12-28 02:57:45,295][106225] Updated weights for policy 1, policy_version 1074755 (0.0008) [2023-12-28 02:57:45,352][106225] Updated weights for policy 1, policy_version 1074765 (0.0009) [2023-12-28 02:57:45,862][106226] Updated weights for policy 0, policy_version 1072034 (0.0009) [2023-12-28 02:57:45,912][106226] Updated weights for policy 0, policy_version 1072044 (0.0008) [2023-12-28 02:57:45,961][106226] Updated weights for policy 0, policy_version 1072054 (0.0008) [2023-12-28 02:57:46,009][106226] Updated weights for policy 0, policy_version 1072064 (0.0008) [2023-12-28 02:57:46,089][106225] Updated weights for policy 1, policy_version 1074775 (0.0008) [2023-12-28 02:57:46,140][106225] Updated weights for policy 1, policy_version 1074785 (0.0007) [2023-12-28 02:57:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19882.9). Total num frames: 549691392. Throughput: 0: 9918.7, 1: 9854.5. Samples: 549682512. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:46,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-5.157')] [2023-12-28 02:57:46,191][106225] Updated weights for policy 1, policy_version 1074795 (0.0008) [2023-12-28 02:57:46,757][106226] Updated weights for policy 0, policy_version 1072074 (0.0007) [2023-12-28 02:57:46,810][106226] Updated weights for policy 0, policy_version 1072084 (0.0007) [2023-12-28 02:57:46,860][106226] Updated weights for policy 0, policy_version 1072094 (0.0008) [2023-12-28 02:57:46,872][106225] Updated weights for policy 1, policy_version 1074805 (0.0008) [2023-12-28 02:57:46,967][106225] Updated weights for policy 1, policy_version 1074815 (0.0005) [2023-12-28 02:57:47,030][106225] Updated weights for policy 1, policy_version 1074825 (0.0005) [2023-12-28 02:57:47,571][106225] Updated weights for policy 1, policy_version 1074835 (0.0006) [2023-12-28 02:57:47,630][106225] Updated weights for policy 1, policy_version 1074845 (0.0005) [2023-12-28 02:57:47,656][106226] Updated weights for policy 0, policy_version 1072104 (0.0008) [2023-12-28 02:57:47,693][106225] Updated weights for policy 1, policy_version 1074855 (0.0006) [2023-12-28 02:57:47,716][106226] Updated weights for policy 0, policy_version 1072114 (0.0008) [2023-12-28 02:57:47,773][106226] Updated weights for policy 0, policy_version 1072124 (0.0008) [2023-12-28 02:57:48,383][106225] Updated weights for policy 1, policy_version 1074865 (0.0006) [2023-12-28 02:57:48,442][106225] Updated weights for policy 1, policy_version 1074875 (0.0009) [2023-12-28 02:57:48,503][106225] Updated weights for policy 1, policy_version 1074885 (0.0009) [2023-12-28 02:57:48,536][106226] Updated weights for policy 0, policy_version 1072134 (0.0007) [2023-12-28 02:57:48,566][106225] Updated weights for policy 1, policy_version 1074895 (0.0009) [2023-12-28 02:57:48,595][106226] Updated weights for policy 0, policy_version 1072144 (0.0007) [2023-12-28 02:57:48,656][106226] Updated weights for policy 0, policy_version 1072154 (0.0008) [2023-12-28 02:57:49,290][106225] Updated weights for policy 1, policy_version 1074905 (0.0010) [2023-12-28 02:57:49,354][106225] Updated weights for policy 1, policy_version 1074915 (0.0011) [2023-12-28 02:57:49,366][106226] Updated weights for policy 0, policy_version 1072164 (0.0007) [2023-12-28 02:57:49,419][106225] Updated weights for policy 1, policy_version 1074925 (0.0009) [2023-12-28 02:57:49,429][106226] Updated weights for policy 0, policy_version 1072174 (0.0007) [2023-12-28 02:57:49,491][106226] Updated weights for policy 0, policy_version 1072184 (0.0008) [2023-12-28 02:57:50,197][106225] Updated weights for policy 1, policy_version 1074935 (0.0008) [2023-12-28 02:57:50,225][106226] Updated weights for policy 0, policy_version 1072194 (0.0008) [2023-12-28 02:57:50,257][106225] Updated weights for policy 1, policy_version 1074945 (0.0007) [2023-12-28 02:57:50,288][106226] Updated weights for policy 0, policy_version 1072204 (0.0006) [2023-12-28 02:57:50,314][106225] Updated weights for policy 1, policy_version 1074955 (0.0009) [2023-12-28 02:57:50,349][106226] Updated weights for policy 0, policy_version 1072214 (0.0006) [2023-12-28 02:57:50,413][106226] Updated weights for policy 0, policy_version 1072224 (0.0008) [2023-12-28 02:57:51,060][106225] Updated weights for policy 1, policy_version 1074965 (0.0008) [2023-12-28 02:57:51,126][106225] Updated weights for policy 1, policy_version 1074975 (0.0008) [2023-12-28 02:57:51,143][106226] Updated weights for policy 0, policy_version 1072234 (0.0009) [2023-12-28 02:57:51,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 549781504. Throughput: 0: 9805.8, 1: 9922.6. Samples: 549798520. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:51,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.869')] [2023-12-28 02:57:51,184][106225] Updated weights for policy 1, policy_version 1074985 (0.0007) [2023-12-28 02:57:51,202][106226] Updated weights for policy 0, policy_version 1072244 (0.0007) [2023-12-28 02:57:51,256][106226] Updated weights for policy 0, policy_version 1072254 (0.0007) [2023-12-28 02:57:51,926][106225] Updated weights for policy 1, policy_version 1074995 (0.0006) [2023-12-28 02:57:51,959][106226] Updated weights for policy 0, policy_version 1072264 (0.0006) [2023-12-28 02:57:51,987][106225] Updated weights for policy 1, policy_version 1075005 (0.0006) [2023-12-28 02:57:52,016][106226] Updated weights for policy 0, policy_version 1072274 (0.0006) [2023-12-28 02:57:52,047][106225] Updated weights for policy 1, policy_version 1075015 (0.0006) [2023-12-28 02:57:52,070][106226] Updated weights for policy 0, policy_version 1072284 (0.0005) [2023-12-28 02:57:52,638][106226] Updated weights for policy 0, policy_version 1072294 (0.0006) [2023-12-28 02:57:52,706][106226] Updated weights for policy 0, policy_version 1072304 (0.0006) [2023-12-28 02:57:52,724][106225] Updated weights for policy 1, policy_version 1075025 (0.0007) [2023-12-28 02:57:52,774][106226] Updated weights for policy 0, policy_version 1072314 (0.0009) [2023-12-28 02:57:52,785][106225] Updated weights for policy 1, policy_version 1075035 (0.0010) [2023-12-28 02:57:52,846][106225] Updated weights for policy 1, policy_version 1075045 (0.0010) [2023-12-28 02:57:52,903][106225] Updated weights for policy 1, policy_version 1075055 (0.0009) [2023-12-28 02:57:53,423][106226] Updated weights for policy 0, policy_version 1072324 (0.0011) [2023-12-28 02:57:53,481][106226] Updated weights for policy 0, policy_version 1072334 (0.0011) [2023-12-28 02:57:53,526][106225] Updated weights for policy 1, policy_version 1075065 (0.0007) [2023-12-28 02:57:53,539][106226] Updated weights for policy 0, policy_version 1072344 (0.0011) [2023-12-28 02:57:53,574][106225] Updated weights for policy 1, policy_version 1075075 (0.0007) [2023-12-28 02:57:53,619][106225] Updated weights for policy 1, policy_version 1075085 (0.0008) [2023-12-28 02:57:54,190][106226] Updated weights for policy 0, policy_version 1072354 (0.0010) [2023-12-28 02:57:54,249][106225] Updated weights for policy 1, policy_version 1075095 (0.0007) [2023-12-28 02:57:54,252][106226] Updated weights for policy 0, policy_version 1072364 (0.0005) [2023-12-28 02:57:54,306][106225] Updated weights for policy 1, policy_version 1075105 (0.0008) [2023-12-28 02:57:54,311][106226] Updated weights for policy 0, policy_version 1072374 (0.0006) [2023-12-28 02:57:54,360][106225] Updated weights for policy 1, policy_version 1075115 (0.0009) [2023-12-28 02:57:54,370][106226] Updated weights for policy 0, policy_version 1072384 (0.0006) [2023-12-28 02:57:55,017][106225] Updated weights for policy 1, policy_version 1075125 (0.0007) [2023-12-28 02:57:55,051][106226] Updated weights for policy 0, policy_version 1072394 (0.0008) [2023-12-28 02:57:55,067][106225] Updated weights for policy 1, policy_version 1075135 (0.0006) [2023-12-28 02:57:55,110][106226] Updated weights for policy 0, policy_version 1072404 (0.0009) [2023-12-28 02:57:55,117][106225] Updated weights for policy 1, policy_version 1075145 (0.0006) [2023-12-28 02:57:55,163][106226] Updated weights for policy 0, policy_version 1072414 (0.0007) [2023-12-28 02:57:55,800][106225] Updated weights for policy 1, policy_version 1075155 (0.0008) [2023-12-28 02:57:55,855][106225] Updated weights for policy 1, policy_version 1075165 (0.0007) [2023-12-28 02:57:55,908][106226] Updated weights for policy 0, policy_version 1072424 (0.0008) [2023-12-28 02:57:55,912][106225] Updated weights for policy 1, policy_version 1075175 (0.0005) [2023-12-28 02:57:55,969][106226] Updated weights for policy 0, policy_version 1072434 (0.0009) [2023-12-28 02:57:56,032][106226] Updated weights for policy 0, policy_version 1072444 (0.0008) [2023-12-28 02:57:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 549896192. Throughput: 0: 9867.0, 1: 9871.7. Samples: 549860152. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:57:56,176][105115] Avg episode reward: [(0, '-4.768'), (1, '-4.904')] [2023-12-28 02:57:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001075184_275292160.pth... [2023-12-28 02:57:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001072448_274604032.pth... [2023-12-28 02:57:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001074032_274997248.pth [2023-12-28 02:57:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001071296_274309120.pth [2023-12-28 02:57:56,582][106225] Updated weights for policy 1, policy_version 1075185 (0.0005) [2023-12-28 02:57:56,647][106225] Updated weights for policy 1, policy_version 1075195 (0.0005) [2023-12-28 02:57:56,710][106225] Updated weights for policy 1, policy_version 1075205 (0.0005) [2023-12-28 02:57:56,770][106225] Updated weights for policy 1, policy_version 1075215 (0.0007) [2023-12-28 02:57:56,780][106226] Updated weights for policy 0, policy_version 1072454 (0.0008) [2023-12-28 02:57:56,840][106226] Updated weights for policy 0, policy_version 1072464 (0.0010) [2023-12-28 02:57:56,898][106226] Updated weights for policy 0, policy_version 1072474 (0.0006) [2023-12-28 02:57:57,361][106225] Updated weights for policy 1, policy_version 1075225 (0.0010) [2023-12-28 02:57:57,417][106225] Updated weights for policy 1, policy_version 1075235 (0.0010) [2023-12-28 02:57:57,473][106225] Updated weights for policy 1, policy_version 1075245 (0.0010) [2023-12-28 02:57:57,518][106226] Updated weights for policy 0, policy_version 1072484 (0.0005) [2023-12-28 02:57:57,573][106226] Updated weights for policy 0, policy_version 1072494 (0.0005) [2023-12-28 02:57:57,630][106226] Updated weights for policy 0, policy_version 1072504 (0.0007) [2023-12-28 02:57:58,181][106225] Updated weights for policy 1, policy_version 1075255 (0.0010) [2023-12-28 02:57:58,270][106225] Updated weights for policy 1, policy_version 1075265 (0.0008) [2023-12-28 02:57:58,303][106226] Updated weights for policy 0, policy_version 1072514 (0.0006) [2023-12-28 02:57:58,334][106225] Updated weights for policy 1, policy_version 1075275 (0.0008) [2023-12-28 02:57:58,371][106226] Updated weights for policy 0, policy_version 1072524 (0.0008) [2023-12-28 02:57:58,438][106226] Updated weights for policy 0, policy_version 1072534 (0.0009) [2023-12-28 02:57:58,504][106226] Updated weights for policy 0, policy_version 1072544 (0.0008) [2023-12-28 02:57:59,139][106225] Updated weights for policy 1, policy_version 1075285 (0.0008) [2023-12-28 02:57:59,196][106225] Updated weights for policy 1, policy_version 1075295 (0.0005) [2023-12-28 02:57:59,263][106225] Updated weights for policy 1, policy_version 1075305 (0.0008) [2023-12-28 02:57:59,345][106226] Updated weights for policy 0, policy_version 1072554 (0.0008) [2023-12-28 02:57:59,405][106226] Updated weights for policy 0, policy_version 1072564 (0.0008) [2023-12-28 02:57:59,457][106226] Updated weights for policy 0, policy_version 1072574 (0.0008) [2023-12-28 02:57:59,920][106225] Updated weights for policy 1, policy_version 1075315 (0.0008) [2023-12-28 02:57:59,977][106225] Updated weights for policy 1, policy_version 1075325 (0.0008) [2023-12-28 02:58:00,044][106225] Updated weights for policy 1, policy_version 1075335 (0.0007) [2023-12-28 02:58:00,223][106226] Updated weights for policy 0, policy_version 1072584 (0.0007) [2023-12-28 02:58:00,288][106226] Updated weights for policy 0, policy_version 1072594 (0.0005) [2023-12-28 02:58:00,344][106226] Updated weights for policy 0, policy_version 1072604 (0.0007) [2023-12-28 02:58:00,712][106225] Updated weights for policy 1, policy_version 1075345 (0.0008) [2023-12-28 02:58:00,767][106225] Updated weights for policy 1, policy_version 1075355 (0.0005) [2023-12-28 02:58:00,831][106225] Updated weights for policy 1, policy_version 1075365 (0.0005) [2023-12-28 02:58:00,870][106226] Updated weights for policy 0, policy_version 1072614 (0.0006) [2023-12-28 02:58:00,882][106225] Updated weights for policy 1, policy_version 1075375 (0.0005) [2023-12-28 02:58:00,930][106226] Updated weights for policy 0, policy_version 1072624 (0.0005) [2023-12-28 02:58:00,988][106226] Updated weights for policy 0, policy_version 1072634 (0.0009) [2023-12-28 02:58:01,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 549994496. Throughput: 0: 9906.4, 1: 9864.8. Samples: 549979496. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:01,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.983')] [2023-12-28 02:58:01,525][106225] Updated weights for policy 1, policy_version 1075385 (0.0008) [2023-12-28 02:58:01,578][106225] Updated weights for policy 1, policy_version 1075395 (0.0008) [2023-12-28 02:58:01,665][106225] Updated weights for policy 1, policy_version 1075405 (0.0008) [2023-12-28 02:58:01,683][106226] Updated weights for policy 0, policy_version 1072644 (0.0008) [2023-12-28 02:58:01,746][106226] Updated weights for policy 0, policy_version 1072654 (0.0008) [2023-12-28 02:58:01,800][106226] Updated weights for policy 0, policy_version 1072664 (0.0009) [2023-12-28 02:58:02,347][106225] Updated weights for policy 1, policy_version 1075415 (0.0008) [2023-12-28 02:58:02,414][106225] Updated weights for policy 1, policy_version 1075425 (0.0009) [2023-12-28 02:58:02,479][106225] Updated weights for policy 1, policy_version 1075435 (0.0008) [2023-12-28 02:58:02,564][106226] Updated weights for policy 0, policy_version 1072674 (0.0008) [2023-12-28 02:58:02,619][106226] Updated weights for policy 0, policy_version 1072684 (0.0008) [2023-12-28 02:58:02,674][106226] Updated weights for policy 0, policy_version 1072694 (0.0009) [2023-12-28 02:58:02,727][106226] Updated weights for policy 0, policy_version 1072704 (0.0009) [2023-12-28 02:58:03,202][106225] Updated weights for policy 1, policy_version 1075445 (0.0008) [2023-12-28 02:58:03,262][106225] Updated weights for policy 1, policy_version 1075455 (0.0008) [2023-12-28 02:58:03,314][106225] Updated weights for policy 1, policy_version 1075465 (0.0008) [2023-12-28 02:58:03,450][106226] Updated weights for policy 0, policy_version 1072714 (0.0008) [2023-12-28 02:58:03,504][106226] Updated weights for policy 0, policy_version 1072724 (0.0009) [2023-12-28 02:58:03,556][106226] Updated weights for policy 0, policy_version 1072734 (0.0008) [2023-12-28 02:58:04,043][106225] Updated weights for policy 1, policy_version 1075475 (0.0008) [2023-12-28 02:58:04,107][106225] Updated weights for policy 1, policy_version 1075485 (0.0009) [2023-12-28 02:58:04,171][106225] Updated weights for policy 1, policy_version 1075495 (0.0008) [2023-12-28 02:58:04,352][106226] Updated weights for policy 0, policy_version 1072744 (0.0009) [2023-12-28 02:58:04,416][106226] Updated weights for policy 0, policy_version 1072754 (0.0009) [2023-12-28 02:58:04,476][106226] Updated weights for policy 0, policy_version 1072764 (0.0009) [2023-12-28 02:58:04,921][106225] Updated weights for policy 1, policy_version 1075505 (0.0008) [2023-12-28 02:58:04,976][106225] Updated weights for policy 1, policy_version 1075515 (0.0008) [2023-12-28 02:58:05,027][106225] Updated weights for policy 1, policy_version 1075525 (0.0008) [2023-12-28 02:58:05,077][106225] Updated weights for policy 1, policy_version 1075536 (0.0010) [2023-12-28 02:58:05,148][106226] Updated weights for policy 0, policy_version 1072774 (0.0009) [2023-12-28 02:58:05,204][106226] Updated weights for policy 0, policy_version 1072784 (0.0009) [2023-12-28 02:58:05,263][106226] Updated weights for policy 0, policy_version 1072794 (0.0008) [2023-12-28 02:58:05,848][106225] Updated weights for policy 1, policy_version 1075546 (0.0008) [2023-12-28 02:58:05,898][106225] Updated weights for policy 1, policy_version 1075556 (0.0009) [2023-12-28 02:58:05,946][106225] Updated weights for policy 1, policy_version 1075566 (0.0008) [2023-12-28 02:58:05,953][106226] Updated weights for policy 0, policy_version 1072804 (0.0008) [2023-12-28 02:58:06,013][106226] Updated weights for policy 0, policy_version 1072814 (0.0008) [2023-12-28 02:58:06,072][106226] Updated weights for policy 0, policy_version 1072824 (0.0009) [2023-12-28 02:58:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 550092800. Throughput: 0: 9843.3, 1: 9917.9. Samples: 550096872. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:06,176][105115] Avg episode reward: [(0, '-4.737'), (1, '-4.827')] [2023-12-28 02:58:06,745][106225] Updated weights for policy 1, policy_version 1075576 (0.0008) [2023-12-28 02:58:06,764][106226] Updated weights for policy 0, policy_version 1072834 (0.0007) [2023-12-28 02:58:06,805][106225] Updated weights for policy 1, policy_version 1075586 (0.0008) [2023-12-28 02:58:06,822][106226] Updated weights for policy 0, policy_version 1072844 (0.0007) [2023-12-28 02:58:06,866][106225] Updated weights for policy 1, policy_version 1075596 (0.0006) [2023-12-28 02:58:06,885][106226] Updated weights for policy 0, policy_version 1072854 (0.0008) [2023-12-28 02:58:06,943][106226] Updated weights for policy 0, policy_version 1072864 (0.0007) [2023-12-28 02:58:07,583][106225] Updated weights for policy 1, policy_version 1075606 (0.0006) [2023-12-28 02:58:07,633][106225] Updated weights for policy 1, policy_version 1075616 (0.0005) [2023-12-28 02:58:07,648][106226] Updated weights for policy 0, policy_version 1072874 (0.0008) [2023-12-28 02:58:07,682][106225] Updated weights for policy 1, policy_version 1075626 (0.0006) [2023-12-28 02:58:07,698][106226] Updated weights for policy 0, policy_version 1072884 (0.0008) [2023-12-28 02:58:07,753][106226] Updated weights for policy 0, policy_version 1072894 (0.0006) [2023-12-28 02:58:08,258][106225] Updated weights for policy 1, policy_version 1075636 (0.0005) [2023-12-28 02:58:08,316][106225] Updated weights for policy 1, policy_version 1075646 (0.0005) [2023-12-28 02:58:08,389][106225] Updated weights for policy 1, policy_version 1075656 (0.0008) [2023-12-28 02:58:08,443][106226] Updated weights for policy 0, policy_version 1072904 (0.0009) [2023-12-28 02:58:08,507][106226] Updated weights for policy 0, policy_version 1072914 (0.0011) [2023-12-28 02:58:08,572][106226] Updated weights for policy 0, policy_version 1072924 (0.0010) [2023-12-28 02:58:08,970][106225] Updated weights for policy 1, policy_version 1075666 (0.0009) [2023-12-28 02:58:09,025][106225] Updated weights for policy 1, policy_version 1075676 (0.0006) [2023-12-28 02:58:09,085][106225] Updated weights for policy 1, policy_version 1075686 (0.0005) [2023-12-28 02:58:09,148][106225] Updated weights for policy 1, policy_version 1075696 (0.0006) [2023-12-28 02:58:09,248][106226] Updated weights for policy 0, policy_version 1072934 (0.0009) [2023-12-28 02:58:09,309][106226] Updated weights for policy 0, policy_version 1072944 (0.0010) [2023-12-28 02:58:09,382][106226] Updated weights for policy 0, policy_version 1072954 (0.0009) [2023-12-28 02:58:09,894][106225] Updated weights for policy 1, policy_version 1075706 (0.0008) [2023-12-28 02:58:09,958][106225] Updated weights for policy 1, policy_version 1075716 (0.0008) [2023-12-28 02:58:10,019][106225] Updated weights for policy 1, policy_version 1075726 (0.0008) [2023-12-28 02:58:10,165][106226] Updated weights for policy 0, policy_version 1072964 (0.0008) [2023-12-28 02:58:10,227][106226] Updated weights for policy 0, policy_version 1072974 (0.0009) [2023-12-28 02:58:10,290][106226] Updated weights for policy 0, policy_version 1072984 (0.0008) [2023-12-28 02:58:10,739][106225] Updated weights for policy 1, policy_version 1075736 (0.0006) [2023-12-28 02:58:10,798][106225] Updated weights for policy 1, policy_version 1075746 (0.0007) [2023-12-28 02:58:10,854][106225] Updated weights for policy 1, policy_version 1075756 (0.0010) [2023-12-28 02:58:11,008][106226] Updated weights for policy 0, policy_version 1072994 (0.0008) [2023-12-28 02:58:11,074][106226] Updated weights for policy 0, policy_version 1073004 (0.0011) [2023-12-28 02:58:11,135][106226] Updated weights for policy 0, policy_version 1073014 (0.0010) [2023-12-28 02:58:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 550182912. Throughput: 0: 9903.0, 1: 9941.9. Samples: 550157824. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:11,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-5.043')] [2023-12-28 02:58:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001075760_275439616.pth... [2023-12-28 02:58:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001074608_275144704.pth [2023-12-28 02:58:11,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001073024_274751488.pth... [2023-12-28 02:58:11,196][106226] Updated weights for policy 0, policy_version 1073024 (0.0009) [2023-12-28 02:58:11,203][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001071872_274456576.pth [2023-12-28 02:58:11,676][106225] Updated weights for policy 1, policy_version 1075766 (0.0009) [2023-12-28 02:58:11,746][106225] Updated weights for policy 1, policy_version 1075776 (0.0009) [2023-12-28 02:58:11,797][106225] Updated weights for policy 1, policy_version 1075786 (0.0009) [2023-12-28 02:58:11,889][106226] Updated weights for policy 0, policy_version 1073034 (0.0007) [2023-12-28 02:58:11,940][106226] Updated weights for policy 0, policy_version 1073044 (0.0006) [2023-12-28 02:58:12,007][106226] Updated weights for policy 0, policy_version 1073054 (0.0006) [2023-12-28 02:58:12,622][106225] Updated weights for policy 1, policy_version 1075796 (0.0009) [2023-12-28 02:58:12,686][106225] Updated weights for policy 1, policy_version 1075806 (0.0007) [2023-12-28 02:58:12,691][106226] Updated weights for policy 0, policy_version 1073064 (0.0008) [2023-12-28 02:58:12,757][106225] Updated weights for policy 1, policy_version 1075816 (0.0006) [2023-12-28 02:58:12,757][106226] Updated weights for policy 0, policy_version 1073074 (0.0007) [2023-12-28 02:58:12,819][106226] Updated weights for policy 0, policy_version 1073084 (0.0008) [2023-12-28 02:58:13,366][106225] Updated weights for policy 1, policy_version 1075826 (0.0007) [2023-12-28 02:58:13,425][106225] Updated weights for policy 1, policy_version 1075836 (0.0006) [2023-12-28 02:58:13,483][106225] Updated weights for policy 1, policy_version 1075846 (0.0005) [2023-12-28 02:58:13,539][106225] Updated weights for policy 1, policy_version 1075856 (0.0005) [2023-12-28 02:58:13,555][106226] Updated weights for policy 0, policy_version 1073094 (0.0008) [2023-12-28 02:58:13,608][106226] Updated weights for policy 0, policy_version 1073104 (0.0005) [2023-12-28 02:58:13,667][106226] Updated weights for policy 0, policy_version 1073114 (0.0006) [2023-12-28 02:58:14,178][106225] Updated weights for policy 1, policy_version 1075866 (0.0010) [2023-12-28 02:58:14,238][106225] Updated weights for policy 1, policy_version 1075876 (0.0010) [2023-12-28 02:58:14,286][106226] Updated weights for policy 0, policy_version 1073124 (0.0007) [2023-12-28 02:58:14,300][106225] Updated weights for policy 1, policy_version 1075886 (0.0011) [2023-12-28 02:58:14,346][106226] Updated weights for policy 0, policy_version 1073134 (0.0008) [2023-12-28 02:58:14,410][106226] Updated weights for policy 0, policy_version 1073144 (0.0008) [2023-12-28 02:58:14,964][106225] Updated weights for policy 1, policy_version 1075896 (0.0008) [2023-12-28 02:58:15,030][106225] Updated weights for policy 1, policy_version 1075906 (0.0008) [2023-12-28 02:58:15,030][106226] Updated weights for policy 0, policy_version 1073154 (0.0008) [2023-12-28 02:58:15,091][106226] Updated weights for policy 0, policy_version 1073164 (0.0005) [2023-12-28 02:58:15,092][106225] Updated weights for policy 1, policy_version 1075916 (0.0007) [2023-12-28 02:58:15,149][106226] Updated weights for policy 0, policy_version 1073174 (0.0006) [2023-12-28 02:58:15,204][106226] Updated weights for policy 0, policy_version 1073184 (0.0006) [2023-12-28 02:58:15,679][106225] Updated weights for policy 1, policy_version 1075926 (0.0008) [2023-12-28 02:58:15,738][106225] Updated weights for policy 1, policy_version 1075936 (0.0008) [2023-12-28 02:58:15,789][106225] Updated weights for policy 1, policy_version 1075946 (0.0008) [2023-12-28 02:58:15,924][106226] Updated weights for policy 0, policy_version 1073194 (0.0008) [2023-12-28 02:58:15,984][106226] Updated weights for policy 0, policy_version 1073204 (0.0007) [2023-12-28 02:58:16,034][106226] Updated weights for policy 0, policy_version 1073214 (0.0005) [2023-12-28 02:58:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 550289408. Throughput: 0: 9780.6, 1: 9868.9. Samples: 550274644. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:16,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-4.785')] [2023-12-28 02:58:16,496][106225] Updated weights for policy 1, policy_version 1075956 (0.0007) [2023-12-28 02:58:16,553][106225] Updated weights for policy 1, policy_version 1075966 (0.0005) [2023-12-28 02:58:16,618][106225] Updated weights for policy 1, policy_version 1075976 (0.0005) [2023-12-28 02:58:16,711][106226] Updated weights for policy 0, policy_version 1073224 (0.0005) [2023-12-28 02:58:16,755][106226] Updated weights for policy 0, policy_version 1073234 (0.0008) [2023-12-28 02:58:16,802][106226] Updated weights for policy 0, policy_version 1073244 (0.0007) [2023-12-28 02:58:17,252][106225] Updated weights for policy 1, policy_version 1075986 (0.0006) [2023-12-28 02:58:17,302][106225] Updated weights for policy 1, policy_version 1075996 (0.0010) [2023-12-28 02:58:17,372][106225] Updated weights for policy 1, policy_version 1076006 (0.0010) [2023-12-28 02:58:17,435][106225] Updated weights for policy 1, policy_version 1076016 (0.0010) [2023-12-28 02:58:17,498][106226] Updated weights for policy 0, policy_version 1073254 (0.0006) [2023-12-28 02:58:17,552][106226] Updated weights for policy 0, policy_version 1073264 (0.0007) [2023-12-28 02:58:17,609][106226] Updated weights for policy 0, policy_version 1073274 (0.0008) [2023-12-28 02:58:18,156][106225] Updated weights for policy 1, policy_version 1076026 (0.0008) [2023-12-28 02:58:18,203][106225] Updated weights for policy 1, policy_version 1076036 (0.0008) [2023-12-28 02:58:18,229][106226] Updated weights for policy 0, policy_version 1073284 (0.0007) [2023-12-28 02:58:18,248][106225] Updated weights for policy 1, policy_version 1076046 (0.0007) [2023-12-28 02:58:18,282][106226] Updated weights for policy 0, policy_version 1073294 (0.0008) [2023-12-28 02:58:18,344][106226] Updated weights for policy 0, policy_version 1073304 (0.0006) [2023-12-28 02:58:18,968][106226] Updated weights for policy 0, policy_version 1073314 (0.0006) [2023-12-28 02:58:19,036][106226] Updated weights for policy 0, policy_version 1073324 (0.0007) [2023-12-28 02:58:19,044][106225] Updated weights for policy 1, policy_version 1076056 (0.0008) [2023-12-28 02:58:19,093][106226] Updated weights for policy 0, policy_version 1073334 (0.0006) [2023-12-28 02:58:19,103][106225] Updated weights for policy 1, policy_version 1076066 (0.0008) [2023-12-28 02:58:19,147][106226] Updated weights for policy 0, policy_version 1073344 (0.0007) [2023-12-28 02:58:19,158][106225] Updated weights for policy 1, policy_version 1076076 (0.0009) [2023-12-28 02:58:19,945][106226] Updated weights for policy 0, policy_version 1073354 (0.0009) [2023-12-28 02:58:19,955][106225] Updated weights for policy 1, policy_version 1076086 (0.0008) [2023-12-28 02:58:20,013][106226] Updated weights for policy 0, policy_version 1073364 (0.0007) [2023-12-28 02:58:20,020][106225] Updated weights for policy 1, policy_version 1076096 (0.0007) [2023-12-28 02:58:20,072][106226] Updated weights for policy 0, policy_version 1073374 (0.0006) [2023-12-28 02:58:20,085][106225] Updated weights for policy 1, policy_version 1076106 (0.0009) [2023-12-28 02:58:20,649][106226] Updated weights for policy 0, policy_version 1073384 (0.0007) [2023-12-28 02:58:20,713][106226] Updated weights for policy 0, policy_version 1073394 (0.0008) [2023-12-28 02:58:20,770][106226] Updated weights for policy 0, policy_version 1073404 (0.0009) [2023-12-28 02:58:20,897][106225] Updated weights for policy 1, policy_version 1076116 (0.0008) [2023-12-28 02:58:20,954][106225] Updated weights for policy 1, policy_version 1076126 (0.0007) [2023-12-28 02:58:21,015][106225] Updated weights for policy 1, policy_version 1076136 (0.0009) [2023-12-28 02:58:21,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 550387712. Throughput: 0: 9838.6, 1: 9855.7. Samples: 550394004. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:21,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.853')] [2023-12-28 02:58:21,502][106226] Updated weights for policy 0, policy_version 1073414 (0.0008) [2023-12-28 02:58:21,574][106226] Updated weights for policy 0, policy_version 1073424 (0.0009) [2023-12-28 02:58:21,641][106226] Updated weights for policy 0, policy_version 1073434 (0.0009) [2023-12-28 02:58:21,728][106225] Updated weights for policy 1, policy_version 1076146 (0.0008) [2023-12-28 02:58:21,798][106225] Updated weights for policy 1, policy_version 1076156 (0.0008) [2023-12-28 02:58:21,854][106225] Updated weights for policy 1, policy_version 1076166 (0.0008) [2023-12-28 02:58:21,916][106225] Updated weights for policy 1, policy_version 1076176 (0.0008) [2023-12-28 02:58:22,386][106226] Updated weights for policy 0, policy_version 1073444 (0.0008) [2023-12-28 02:58:22,448][106226] Updated weights for policy 0, policy_version 1073454 (0.0008) [2023-12-28 02:58:22,507][106226] Updated weights for policy 0, policy_version 1073464 (0.0009) [2023-12-28 02:58:22,656][106225] Updated weights for policy 1, policy_version 1076186 (0.0009) [2023-12-28 02:58:22,720][106225] Updated weights for policy 1, policy_version 1076196 (0.0008) [2023-12-28 02:58:22,776][106225] Updated weights for policy 1, policy_version 1076206 (0.0008) [2023-12-28 02:58:23,265][106226] Updated weights for policy 0, policy_version 1073474 (0.0008) [2023-12-28 02:58:23,330][106226] Updated weights for policy 0, policy_version 1073484 (0.0007) [2023-12-28 02:58:23,392][106226] Updated weights for policy 0, policy_version 1073494 (0.0007) [2023-12-28 02:58:23,417][106225] Updated weights for policy 1, policy_version 1076216 (0.0006) [2023-12-28 02:58:23,456][106226] Updated weights for policy 0, policy_version 1073504 (0.0005) [2023-12-28 02:58:23,465][106225] Updated weights for policy 1, policy_version 1076226 (0.0008) [2023-12-28 02:58:23,516][106225] Updated weights for policy 1, policy_version 1076236 (0.0008) [2023-12-28 02:58:23,969][106226] Updated weights for policy 0, policy_version 1073514 (0.0005) [2023-12-28 02:58:24,028][106226] Updated weights for policy 0, policy_version 1073524 (0.0008) [2023-12-28 02:58:24,079][106226] Updated weights for policy 0, policy_version 1073534 (0.0010) [2023-12-28 02:58:24,138][106225] Updated weights for policy 1, policy_version 1076246 (0.0008) [2023-12-28 02:58:24,194][106225] Updated weights for policy 1, policy_version 1076256 (0.0010) [2023-12-28 02:58:24,250][106225] Updated weights for policy 1, policy_version 1076266 (0.0010) [2023-12-28 02:58:24,792][106226] Updated weights for policy 0, policy_version 1073544 (0.0009) [2023-12-28 02:58:24,849][106226] Updated weights for policy 0, policy_version 1073554 (0.0008) [2023-12-28 02:58:24,868][106225] Updated weights for policy 1, policy_version 1076276 (0.0009) [2023-12-28 02:58:24,897][106226] Updated weights for policy 0, policy_version 1073564 (0.0009) [2023-12-28 02:58:24,921][106225] Updated weights for policy 1, policy_version 1076286 (0.0010) [2023-12-28 02:58:24,987][106225] Updated weights for policy 1, policy_version 1076296 (0.0010) [2023-12-28 02:58:25,511][106226] Updated weights for policy 0, policy_version 1073574 (0.0005) [2023-12-28 02:58:25,540][106225] Updated weights for policy 1, policy_version 1076306 (0.0006) [2023-12-28 02:58:25,568][106226] Updated weights for policy 0, policy_version 1073584 (0.0006) [2023-12-28 02:58:25,593][106225] Updated weights for policy 1, policy_version 1076316 (0.0010) [2023-12-28 02:58:25,626][106226] Updated weights for policy 0, policy_version 1073594 (0.0005) [2023-12-28 02:58:25,644][106225] Updated weights for policy 1, policy_version 1076326 (0.0010) [2023-12-28 02:58:25,694][106225] Updated weights for policy 1, policy_version 1076336 (0.0010) [2023-12-28 02:58:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 550486016. Throughput: 0: 9831.9, 1: 9863.3. Samples: 550453676. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:26,176][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.003')] [2023-12-28 02:58:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001076336_275587072.pth... [2023-12-28 02:58:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001073600_274898944.pth... [2023-12-28 02:58:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001072448_274604032.pth [2023-12-28 02:58:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001075184_275292160.pth [2023-12-28 02:58:26,293][106226] Updated weights for policy 0, policy_version 1073604 (0.0006) [2023-12-28 02:58:26,353][106225] Updated weights for policy 1, policy_version 1076347 (0.0011) [2023-12-28 02:58:26,356][106226] Updated weights for policy 0, policy_version 1073614 (0.0005) [2023-12-28 02:58:26,411][106225] Updated weights for policy 1, policy_version 1076357 (0.0007) [2023-12-28 02:58:26,418][106226] Updated weights for policy 0, policy_version 1073624 (0.0008) [2023-12-28 02:58:26,467][106225] Updated weights for policy 1, policy_version 1076367 (0.0007) [2023-12-28 02:58:27,132][106225] Updated weights for policy 1, policy_version 1076377 (0.0010) [2023-12-28 02:58:27,146][106226] Updated weights for policy 0, policy_version 1073634 (0.0009) [2023-12-28 02:58:27,181][106225] Updated weights for policy 1, policy_version 1076387 (0.0010) [2023-12-28 02:58:27,191][106226] Updated weights for policy 0, policy_version 1073644 (0.0009) [2023-12-28 02:58:27,235][106226] Updated weights for policy 0, policy_version 1073654 (0.0009) [2023-12-28 02:58:27,239][106225] Updated weights for policy 1, policy_version 1076397 (0.0010) [2023-12-28 02:58:27,293][106226] Updated weights for policy 0, policy_version 1073664 (0.0005) [2023-12-28 02:58:27,949][106225] Updated weights for policy 1, policy_version 1076407 (0.0010) [2023-12-28 02:58:27,956][106226] Updated weights for policy 0, policy_version 1073674 (0.0006) [2023-12-28 02:58:28,009][106225] Updated weights for policy 1, policy_version 1076417 (0.0010) [2023-12-28 02:58:28,018][106226] Updated weights for policy 0, policy_version 1073684 (0.0008) [2023-12-28 02:58:28,067][106225] Updated weights for policy 1, policy_version 1076427 (0.0010) [2023-12-28 02:58:28,076][106226] Updated weights for policy 0, policy_version 1073694 (0.0008) [2023-12-28 02:58:28,739][106226] Updated weights for policy 0, policy_version 1073704 (0.0006) [2023-12-28 02:58:28,801][106225] Updated weights for policy 1, policy_version 1076437 (0.0010) [2023-12-28 02:58:28,803][106226] Updated weights for policy 0, policy_version 1073714 (0.0005) [2023-12-28 02:58:28,853][106225] Updated weights for policy 1, policy_version 1076447 (0.0009) [2023-12-28 02:58:28,857][106226] Updated weights for policy 0, policy_version 1073724 (0.0008) [2023-12-28 02:58:28,913][106225] Updated weights for policy 1, policy_version 1076457 (0.0008) [2023-12-28 02:58:29,633][106225] Updated weights for policy 1, policy_version 1076467 (0.0008) [2023-12-28 02:58:29,634][106226] Updated weights for policy 0, policy_version 1073734 (0.0008) [2023-12-28 02:58:29,693][106226] Updated weights for policy 0, policy_version 1073744 (0.0008) [2023-12-28 02:58:29,698][106225] Updated weights for policy 1, policy_version 1076477 (0.0007) [2023-12-28 02:58:29,752][106226] Updated weights for policy 0, policy_version 1073754 (0.0009) [2023-12-28 02:58:29,756][106225] Updated weights for policy 1, policy_version 1076487 (0.0007) [2023-12-28 02:58:30,447][106225] Updated weights for policy 1, policy_version 1076497 (0.0007) [2023-12-28 02:58:30,465][106226] Updated weights for policy 0, policy_version 1073764 (0.0007) [2023-12-28 02:58:30,511][106225] Updated weights for policy 1, policy_version 1076507 (0.0009) [2023-12-28 02:58:30,525][106226] Updated weights for policy 0, policy_version 1073774 (0.0006) [2023-12-28 02:58:30,566][106225] Updated weights for policy 1, policy_version 1076517 (0.0008) [2023-12-28 02:58:30,593][106226] Updated weights for policy 0, policy_version 1073784 (0.0006) [2023-12-28 02:58:30,615][106225] Updated weights for policy 1, policy_version 1076527 (0.0007) [2023-12-28 02:58:31,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 550584320. Throughput: 0: 9897.1, 1: 9968.5. Samples: 550576468. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:31,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.821')] [2023-12-28 02:58:31,284][106225] Updated weights for policy 1, policy_version 1076537 (0.0007) [2023-12-28 02:58:31,307][106226] Updated weights for policy 0, policy_version 1073794 (0.0009) [2023-12-28 02:58:31,346][106225] Updated weights for policy 1, policy_version 1076547 (0.0006) [2023-12-28 02:58:31,375][106226] Updated weights for policy 0, policy_version 1073804 (0.0008) [2023-12-28 02:58:31,417][106225] Updated weights for policy 1, policy_version 1076557 (0.0008) [2023-12-28 02:58:31,433][106226] Updated weights for policy 0, policy_version 1073814 (0.0006) [2023-12-28 02:58:31,484][106226] Updated weights for policy 0, policy_version 1073824 (0.0005) [2023-12-28 02:58:32,054][106225] Updated weights for policy 1, policy_version 1076567 (0.0006) [2023-12-28 02:58:32,111][106225] Updated weights for policy 1, policy_version 1076577 (0.0005) [2023-12-28 02:58:32,171][106225] Updated weights for policy 1, policy_version 1076587 (0.0006) [2023-12-28 02:58:32,181][106226] Updated weights for policy 0, policy_version 1073834 (0.0005) [2023-12-28 02:58:32,232][106226] Updated weights for policy 0, policy_version 1073844 (0.0005) [2023-12-28 02:58:32,292][106226] Updated weights for policy 0, policy_version 1073854 (0.0008) [2023-12-28 02:58:32,849][106225] Updated weights for policy 1, policy_version 1076597 (0.0008) [2023-12-28 02:58:32,866][106226] Updated weights for policy 0, policy_version 1073864 (0.0006) [2023-12-28 02:58:32,895][106225] Updated weights for policy 1, policy_version 1076607 (0.0007) [2023-12-28 02:58:32,921][106226] Updated weights for policy 0, policy_version 1073874 (0.0007) [2023-12-28 02:58:32,943][106225] Updated weights for policy 1, policy_version 1076617 (0.0006) [2023-12-28 02:58:32,977][106226] Updated weights for policy 0, policy_version 1073884 (0.0006) [2023-12-28 02:58:33,506][106226] Updated weights for policy 0, policy_version 1073894 (0.0007) [2023-12-28 02:58:33,551][106226] Updated weights for policy 0, policy_version 1073904 (0.0008) [2023-12-28 02:58:33,588][106225] Updated weights for policy 1, policy_version 1076627 (0.0007) [2023-12-28 02:58:33,602][106226] Updated weights for policy 0, policy_version 1073914 (0.0006) [2023-12-28 02:58:33,641][106225] Updated weights for policy 1, policy_version 1076637 (0.0010) [2023-12-28 02:58:33,690][106225] Updated weights for policy 1, policy_version 1076647 (0.0010) [2023-12-28 02:58:34,233][106226] Updated weights for policy 0, policy_version 1073924 (0.0006) [2023-12-28 02:58:34,294][106226] Updated weights for policy 0, policy_version 1073934 (0.0006) [2023-12-28 02:58:34,346][106225] Updated weights for policy 1, policy_version 1076657 (0.0010) [2023-12-28 02:58:34,361][106226] Updated weights for policy 0, policy_version 1073944 (0.0006) [2023-12-28 02:58:34,403][106225] Updated weights for policy 1, policy_version 1076667 (0.0009) [2023-12-28 02:58:34,459][106225] Updated weights for policy 1, policy_version 1076677 (0.0006) [2023-12-28 02:58:34,533][106225] Updated weights for policy 1, policy_version 1076687 (0.0009) [2023-12-28 02:58:35,015][106226] Updated weights for policy 0, policy_version 1073954 (0.0006) [2023-12-28 02:58:35,066][106226] Updated weights for policy 0, policy_version 1073964 (0.0007) [2023-12-28 02:58:35,116][106226] Updated weights for policy 0, policy_version 1073974 (0.0008) [2023-12-28 02:58:35,170][106226] Updated weights for policy 0, policy_version 1073984 (0.0008) [2023-12-28 02:58:35,275][106225] Updated weights for policy 1, policy_version 1076697 (0.0011) [2023-12-28 02:58:35,336][106225] Updated weights for policy 1, policy_version 1076707 (0.0010) [2023-12-28 02:58:35,396][106225] Updated weights for policy 1, policy_version 1076717 (0.0010) [2023-12-28 02:58:35,939][106226] Updated weights for policy 0, policy_version 1073994 (0.0009) [2023-12-28 02:58:35,986][106226] Updated weights for policy 0, policy_version 1074004 (0.0008) [2023-12-28 02:58:36,005][106225] Updated weights for policy 1, policy_version 1076727 (0.0007) [2023-12-28 02:58:36,038][106226] Updated weights for policy 0, policy_version 1074014 (0.0006) [2023-12-28 02:58:36,063][106225] Updated weights for policy 1, policy_version 1076737 (0.0006) [2023-12-28 02:58:36,124][106225] Updated weights for policy 1, policy_version 1076747 (0.0009) [2023-12-28 02:58:36,175][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 550699008. Throughput: 0: 10030.7, 1: 10026.4. Samples: 550701088. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:36,176][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.967')] [2023-12-28 02:58:36,797][106226] Updated weights for policy 0, policy_version 1074024 (0.0008) [2023-12-28 02:58:36,851][106226] Updated weights for policy 0, policy_version 1074034 (0.0009) [2023-12-28 02:58:36,890][106225] Updated weights for policy 1, policy_version 1076757 (0.0007) [2023-12-28 02:58:36,910][106226] Updated weights for policy 0, policy_version 1074044 (0.0006) [2023-12-28 02:58:36,947][106225] Updated weights for policy 1, policy_version 1076767 (0.0007) [2023-12-28 02:58:37,006][106225] Updated weights for policy 1, policy_version 1076777 (0.0009) [2023-12-28 02:58:37,639][106226] Updated weights for policy 0, policy_version 1074054 (0.0007) [2023-12-28 02:58:37,694][106226] Updated weights for policy 0, policy_version 1074064 (0.0008) [2023-12-28 02:58:37,734][106225] Updated weights for policy 1, policy_version 1076787 (0.0008) [2023-12-28 02:58:37,748][106226] Updated weights for policy 0, policy_version 1074074 (0.0008) [2023-12-28 02:58:37,794][106225] Updated weights for policy 1, policy_version 1076797 (0.0007) [2023-12-28 02:58:37,843][106225] Updated weights for policy 1, policy_version 1076807 (0.0008) [2023-12-28 02:58:38,496][106226] Updated weights for policy 0, policy_version 1074084 (0.0007) [2023-12-28 02:58:38,550][106226] Updated weights for policy 0, policy_version 1074094 (0.0009) [2023-12-28 02:58:38,576][106225] Updated weights for policy 1, policy_version 1076817 (0.0008) [2023-12-28 02:58:38,613][106226] Updated weights for policy 0, policy_version 1074104 (0.0008) [2023-12-28 02:58:38,637][106225] Updated weights for policy 1, policy_version 1076827 (0.0009) [2023-12-28 02:58:38,694][106225] Updated weights for policy 1, policy_version 1076837 (0.0009) [2023-12-28 02:58:38,755][106225] Updated weights for policy 1, policy_version 1076847 (0.0010) [2023-12-28 02:58:39,358][106226] Updated weights for policy 0, policy_version 1074114 (0.0008) [2023-12-28 02:58:39,436][106226] Updated weights for policy 0, policy_version 1074124 (0.0008) [2023-12-28 02:58:39,446][106225] Updated weights for policy 1, policy_version 1076857 (0.0010) [2023-12-28 02:58:39,496][106226] Updated weights for policy 0, policy_version 1074134 (0.0008) [2023-12-28 02:58:39,504][106225] Updated weights for policy 1, policy_version 1076867 (0.0011) [2023-12-28 02:58:39,555][106226] Updated weights for policy 0, policy_version 1074144 (0.0008) [2023-12-28 02:58:39,567][106225] Updated weights for policy 1, policy_version 1076877 (0.0009) [2023-12-28 02:58:40,281][106225] Updated weights for policy 1, policy_version 1076887 (0.0010) [2023-12-28 02:58:40,283][106226] Updated weights for policy 0, policy_version 1074154 (0.0006) [2023-12-28 02:58:40,347][106226] Updated weights for policy 0, policy_version 1074164 (0.0009) [2023-12-28 02:58:40,351][106225] Updated weights for policy 1, policy_version 1076897 (0.0010) [2023-12-28 02:58:40,412][106226] Updated weights for policy 0, policy_version 1074174 (0.0011) [2023-12-28 02:58:40,413][106225] Updated weights for policy 1, policy_version 1076907 (0.0010) [2023-12-28 02:58:41,041][106226] Updated weights for policy 0, policy_version 1074184 (0.0009) [2023-12-28 02:58:41,084][106225] Updated weights for policy 1, policy_version 1076917 (0.0011) [2023-12-28 02:58:41,109][106226] Updated weights for policy 0, policy_version 1074194 (0.0009) [2023-12-28 02:58:41,170][106225] Updated weights for policy 1, policy_version 1076927 (0.0010) [2023-12-28 02:58:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 550780928. Throughput: 0: 9964.9, 1: 9997.4. Samples: 550758456. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:41,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-5.044')] [2023-12-28 02:58:41,182][106226] Updated weights for policy 0, policy_version 1074204 (0.0008) [2023-12-28 02:58:41,205][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001074208_275054592.pth... [2023-12-28 02:58:41,209][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001073024_274751488.pth [2023-12-28 02:58:41,230][106225] Updated weights for policy 1, policy_version 1076937 (0.0011) [2023-12-28 02:58:41,270][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001076944_275742720.pth... [2023-12-28 02:58:41,273][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001075760_275439616.pth [2023-12-28 02:58:41,992][106226] Updated weights for policy 0, policy_version 1074214 (0.0010) [2023-12-28 02:58:42,010][106225] Updated weights for policy 1, policy_version 1076948 (0.0010) [2023-12-28 02:58:42,056][106226] Updated weights for policy 0, policy_version 1074224 (0.0008) [2023-12-28 02:58:42,067][106225] Updated weights for policy 1, policy_version 1076958 (0.0011) [2023-12-28 02:58:42,118][106226] Updated weights for policy 0, policy_version 1074234 (0.0011) [2023-12-28 02:58:42,123][106225] Updated weights for policy 1, policy_version 1076968 (0.0011) [2023-12-28 02:58:42,857][106226] Updated weights for policy 0, policy_version 1074244 (0.0011) [2023-12-28 02:58:42,910][106226] Updated weights for policy 0, policy_version 1074254 (0.0010) [2023-12-28 02:58:42,925][106225] Updated weights for policy 1, policy_version 1076978 (0.0010) [2023-12-28 02:58:42,967][106226] Updated weights for policy 0, policy_version 1074264 (0.0007) [2023-12-28 02:58:42,984][106225] Updated weights for policy 1, policy_version 1076988 (0.0007) [2023-12-28 02:58:43,034][106225] Updated weights for policy 1, policy_version 1076998 (0.0007) [2023-12-28 02:58:43,091][106225] Updated weights for policy 1, policy_version 1077008 (0.0009) [2023-12-28 02:58:43,630][106226] Updated weights for policy 0, policy_version 1074274 (0.0007) [2023-12-28 02:58:43,687][106226] Updated weights for policy 0, policy_version 1074284 (0.0007) [2023-12-28 02:58:43,740][106226] Updated weights for policy 0, policy_version 1074294 (0.0007) [2023-12-28 02:58:43,800][106226] Updated weights for policy 0, policy_version 1074304 (0.0006) [2023-12-28 02:58:43,802][106225] Updated weights for policy 1, policy_version 1077018 (0.0006) [2023-12-28 02:58:43,869][106225] Updated weights for policy 1, policy_version 1077028 (0.0005) [2023-12-28 02:58:43,926][106225] Updated weights for policy 1, policy_version 1077038 (0.0005) [2023-12-28 02:58:44,410][106226] Updated weights for policy 0, policy_version 1074314 (0.0006) [2023-12-28 02:58:44,471][106226] Updated weights for policy 0, policy_version 1074324 (0.0009) [2023-12-28 02:58:44,533][106226] Updated weights for policy 0, policy_version 1074334 (0.0008) [2023-12-28 02:58:44,542][106225] Updated weights for policy 1, policy_version 1077048 (0.0006) [2023-12-28 02:58:44,599][106225] Updated weights for policy 1, policy_version 1077058 (0.0007) [2023-12-28 02:58:44,663][106225] Updated weights for policy 1, policy_version 1077068 (0.0010) [2023-12-28 02:58:45,206][106226] Updated weights for policy 0, policy_version 1074344 (0.0008) [2023-12-28 02:58:45,279][106226] Updated weights for policy 0, policy_version 1074354 (0.0008) [2023-12-28 02:58:45,348][106226] Updated weights for policy 0, policy_version 1074364 (0.0009) [2023-12-28 02:58:45,378][106225] Updated weights for policy 1, policy_version 1077078 (0.0008) [2023-12-28 02:58:45,446][106225] Updated weights for policy 1, policy_version 1077088 (0.0008) [2023-12-28 02:58:45,504][106225] Updated weights for policy 1, policy_version 1077098 (0.0008) [2023-12-28 02:58:45,910][106226] Updated weights for policy 0, policy_version 1074374 (0.0008) [2023-12-28 02:58:45,967][106226] Updated weights for policy 0, policy_version 1074384 (0.0008) [2023-12-28 02:58:46,031][106226] Updated weights for policy 0, policy_version 1074394 (0.0006) [2023-12-28 02:58:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 550887424. Throughput: 0: 10023.2, 1: 9922.9. Samples: 550877072. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:46,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.626')] [2023-12-28 02:58:46,312][106225] Updated weights for policy 1, policy_version 1077108 (0.0009) [2023-12-28 02:58:46,364][106225] Updated weights for policy 1, policy_version 1077118 (0.0008) [2023-12-28 02:58:46,417][106225] Updated weights for policy 1, policy_version 1077128 (0.0009) [2023-12-28 02:58:46,636][106226] Updated weights for policy 0, policy_version 1074404 (0.0007) [2023-12-28 02:58:46,689][106226] Updated weights for policy 0, policy_version 1074414 (0.0008) [2023-12-28 02:58:46,741][106226] Updated weights for policy 0, policy_version 1074424 (0.0008) [2023-12-28 02:58:47,105][106225] Updated weights for policy 1, policy_version 1077138 (0.0008) [2023-12-28 02:58:47,153][106225] Updated weights for policy 1, policy_version 1077148 (0.0005) [2023-12-28 02:58:47,206][106225] Updated weights for policy 1, policy_version 1077158 (0.0005) [2023-12-28 02:58:47,254][106225] Updated weights for policy 1, policy_version 1077168 (0.0007) [2023-12-28 02:58:47,523][106226] Updated weights for policy 0, policy_version 1074434 (0.0009) [2023-12-28 02:58:47,572][106226] Updated weights for policy 0, policy_version 1074444 (0.0008) [2023-12-28 02:58:47,617][106226] Updated weights for policy 0, policy_version 1074454 (0.0008) [2023-12-28 02:58:47,628][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000004 [2023-12-28 02:58:47,946][106225] Updated weights for policy 1, policy_version 1077178 (0.0009) [2023-12-28 02:58:47,996][106225] Updated weights for policy 1, policy_version 1077188 (0.0008) [2023-12-28 02:58:48,058][106225] Updated weights for policy 1, policy_version 1077198 (0.0007) [2023-12-28 02:58:48,408][106226] Updated weights for policy 0, policy_version 1074464 (0.0007) [2023-12-28 02:58:48,458][106226] Updated weights for policy 0, policy_version 1074474 (0.0008) [2023-12-28 02:58:48,524][106226] Updated weights for policy 0, policy_version 1074484 (0.0009) [2023-12-28 02:58:48,680][106225] Updated weights for policy 1, policy_version 1077208 (0.0007) [2023-12-28 02:58:48,748][106225] Updated weights for policy 1, policy_version 1077218 (0.0005) [2023-12-28 02:58:48,806][106225] Updated weights for policy 1, policy_version 1077228 (0.0009) [2023-12-28 02:58:49,162][106226] Updated weights for policy 0, policy_version 1074494 (0.0006) [2023-12-28 02:58:49,223][106226] Updated weights for policy 0, policy_version 1074504 (0.0007) [2023-12-28 02:58:49,286][106226] Updated weights for policy 0, policy_version 1074514 (0.0011) [2023-12-28 02:58:49,450][106225] Updated weights for policy 1, policy_version 1077238 (0.0007) [2023-12-28 02:58:49,518][106225] Updated weights for policy 1, policy_version 1077248 (0.0006) [2023-12-28 02:58:49,587][106225] Updated weights for policy 1, policy_version 1077258 (0.0008) [2023-12-28 02:58:49,929][106226] Updated weights for policy 0, policy_version 1074524 (0.0009) [2023-12-28 02:58:49,995][106226] Updated weights for policy 0, policy_version 1074534 (0.0008) [2023-12-28 02:58:50,063][106226] Updated weights for policy 0, policy_version 1074544 (0.0008) [2023-12-28 02:58:50,292][106225] Updated weights for policy 1, policy_version 1077268 (0.0009) [2023-12-28 02:58:50,357][106225] Updated weights for policy 1, policy_version 1077278 (0.0010) [2023-12-28 02:58:50,420][106225] Updated weights for policy 1, policy_version 1077288 (0.0010) [2023-12-28 02:58:50,740][106226] Updated weights for policy 0, policy_version 1074554 (0.0007) [2023-12-28 02:58:50,798][106226] Updated weights for policy 0, policy_version 1074564 (0.0008) [2023-12-28 02:58:50,858][106226] Updated weights for policy 0, policy_version 1074574 (0.0007) [2023-12-28 02:58:50,913][106226] Updated weights for policy 0, policy_version 1074584 (0.0008) [2023-12-28 02:58:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 550985728. Throughput: 0: 10050.5, 1: 9943.6. Samples: 550996600. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:51,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-5.037')] [2023-12-28 02:58:51,189][106225] Updated weights for policy 1, policy_version 1077298 (0.0010) [2023-12-28 02:58:51,259][106225] Updated weights for policy 1, policy_version 1077308 (0.0010) [2023-12-28 02:58:51,311][106225] Updated weights for policy 1, policy_version 1077318 (0.0006) [2023-12-28 02:58:51,380][106225] Updated weights for policy 1, policy_version 1077328 (0.0010) [2023-12-28 02:58:51,615][106226] Updated weights for policy 0, policy_version 1074594 (0.0011) [2023-12-28 02:58:51,684][106226] Updated weights for policy 0, policy_version 1074604 (0.0009) [2023-12-28 02:58:51,751][106226] Updated weights for policy 0, policy_version 1074614 (0.0009) [2023-12-28 02:58:52,072][106225] Updated weights for policy 1, policy_version 1077338 (0.0006) [2023-12-28 02:58:52,135][106225] Updated weights for policy 1, policy_version 1077348 (0.0009) [2023-12-28 02:58:52,191][106225] Updated weights for policy 1, policy_version 1077358 (0.0010) [2023-12-28 02:58:52,508][106226] Updated weights for policy 0, policy_version 1074624 (0.0008) [2023-12-28 02:58:52,570][106226] Updated weights for policy 0, policy_version 1074634 (0.0006) [2023-12-28 02:58:52,632][106226] Updated weights for policy 0, policy_version 1074644 (0.0009) [2023-12-28 02:58:52,837][106225] Updated weights for policy 1, policy_version 1077368 (0.0006) [2023-12-28 02:58:52,900][106225] Updated weights for policy 1, policy_version 1077378 (0.0006) [2023-12-28 02:58:52,957][106225] Updated weights for policy 1, policy_version 1077388 (0.0005) [2023-12-28 02:58:53,308][106226] Updated weights for policy 0, policy_version 1074654 (0.0009) [2023-12-28 02:58:53,364][106226] Updated weights for policy 0, policy_version 1074664 (0.0007) [2023-12-28 02:58:53,425][106226] Updated weights for policy 0, policy_version 1074674 (0.0008) [2023-12-28 02:58:53,535][106225] Updated weights for policy 1, policy_version 1077398 (0.0008) [2023-12-28 02:58:53,591][106225] Updated weights for policy 1, policy_version 1077408 (0.0008) [2023-12-28 02:58:53,652][106225] Updated weights for policy 1, policy_version 1077418 (0.0008) [2023-12-28 02:58:54,077][106226] Updated weights for policy 0, policy_version 1074684 (0.0007) [2023-12-28 02:58:54,132][106226] Updated weights for policy 0, policy_version 1074694 (0.0005) [2023-12-28 02:58:54,185][106226] Updated weights for policy 0, policy_version 1074704 (0.0005) [2023-12-28 02:58:54,306][106225] Updated weights for policy 1, policy_version 1077428 (0.0008) [2023-12-28 02:58:54,371][106225] Updated weights for policy 1, policy_version 1077438 (0.0008) [2023-12-28 02:58:54,431][106225] Updated weights for policy 1, policy_version 1077448 (0.0006) [2023-12-28 02:58:54,744][106226] Updated weights for policy 0, policy_version 1074714 (0.0005) [2023-12-28 02:58:54,804][106226] Updated weights for policy 0, policy_version 1074724 (0.0005) [2023-12-28 02:58:54,869][106226] Updated weights for policy 0, policy_version 1074734 (0.0006) [2023-12-28 02:58:54,932][106226] Updated weights for policy 0, policy_version 1074744 (0.0009) [2023-12-28 02:58:55,093][106225] Updated weights for policy 1, policy_version 1077458 (0.0009) [2023-12-28 02:58:55,153][106225] Updated weights for policy 1, policy_version 1077468 (0.0010) [2023-12-28 02:58:55,206][106225] Updated weights for policy 1, policy_version 1077478 (0.0009) [2023-12-28 02:58:55,255][106225] Updated weights for policy 1, policy_version 1077488 (0.0010) [2023-12-28 02:58:55,637][106226] Updated weights for policy 0, policy_version 1074754 (0.0008) [2023-12-28 02:58:55,694][106226] Updated weights for policy 0, policy_version 1074764 (0.0007) [2023-12-28 02:58:55,756][106226] Updated weights for policy 0, policy_version 1074774 (0.0010) [2023-12-28 02:58:55,916][106225] Updated weights for policy 1, policy_version 1077498 (0.0008) [2023-12-28 02:58:55,974][106225] Updated weights for policy 1, policy_version 1077508 (0.0007) [2023-12-28 02:58:56,035][106225] Updated weights for policy 1, policy_version 1077518 (0.0007) [2023-12-28 02:58:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 551092224. Throughput: 0: 10039.3, 1: 9931.4. Samples: 551056512. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:58:56,176][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.741')] [2023-12-28 02:58:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001077520_275890176.pth... [2023-12-28 02:58:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001074776_275202048.pth... [2023-12-28 02:58:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001076336_275587072.pth [2023-12-28 02:58:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001073600_274898944.pth [2023-12-28 02:58:56,406][106226] Updated weights for policy 0, policy_version 1074784 (0.0006) [2023-12-28 02:58:56,456][106226] Updated weights for policy 0, policy_version 1074794 (0.0007) [2023-12-28 02:58:56,511][106226] Updated weights for policy 0, policy_version 1074804 (0.0009) [2023-12-28 02:58:56,820][106225] Updated weights for policy 1, policy_version 1077528 (0.0008) [2023-12-28 02:58:56,875][106225] Updated weights for policy 1, policy_version 1077538 (0.0008) [2023-12-28 02:58:56,928][106225] Updated weights for policy 1, policy_version 1077548 (0.0008) [2023-12-28 02:58:57,112][106226] Updated weights for policy 0, policy_version 1074814 (0.0009) [2023-12-28 02:58:57,163][106226] Updated weights for policy 0, policy_version 1074824 (0.0009) [2023-12-28 02:58:57,214][106226] Updated weights for policy 0, policy_version 1074834 (0.0009) [2023-12-28 02:58:57,572][106225] Updated weights for policy 1, policy_version 1077558 (0.0007) [2023-12-28 02:58:57,636][106225] Updated weights for policy 1, policy_version 1077568 (0.0008) [2023-12-28 02:58:57,686][106225] Updated weights for policy 1, policy_version 1077578 (0.0008) [2023-12-28 02:58:57,938][106226] Updated weights for policy 0, policy_version 1074844 (0.0009) [2023-12-28 02:58:57,991][106226] Updated weights for policy 0, policy_version 1074854 (0.0010) [2023-12-28 02:58:58,040][106226] Updated weights for policy 0, policy_version 1074864 (0.0010) [2023-12-28 02:58:58,311][106225] Updated weights for policy 1, policy_version 1077588 (0.0008) [2023-12-28 02:58:58,388][106225] Updated weights for policy 1, policy_version 1077598 (0.0009) [2023-12-28 02:58:58,455][106225] Updated weights for policy 1, policy_version 1077608 (0.0010) [2023-12-28 02:58:58,780][106226] Updated weights for policy 0, policy_version 1074874 (0.0010) [2023-12-28 02:58:58,847][106226] Updated weights for policy 0, policy_version 1074884 (0.0007) [2023-12-28 02:58:58,908][106226] Updated weights for policy 0, policy_version 1074894 (0.0007) [2023-12-28 02:58:58,978][106226] Updated weights for policy 0, policy_version 1074904 (0.0008) [2023-12-28 02:58:59,267][106225] Updated weights for policy 1, policy_version 1077618 (0.0010) [2023-12-28 02:58:59,337][106225] Updated weights for policy 1, policy_version 1077628 (0.0008) [2023-12-28 02:58:59,427][106225] Updated weights for policy 1, policy_version 1077638 (0.0007) [2023-12-28 02:58:59,477][106225] Updated weights for policy 1, policy_version 1077648 (0.0008) [2023-12-28 02:58:59,777][106226] Updated weights for policy 0, policy_version 1074914 (0.0011) [2023-12-28 02:58:59,831][106226] Updated weights for policy 0, policy_version 1074924 (0.0010) [2023-12-28 02:58:59,892][106226] Updated weights for policy 0, policy_version 1074934 (0.0010) [2023-12-28 02:59:00,216][106225] Updated weights for policy 1, policy_version 1077658 (0.0007) [2023-12-28 02:59:00,263][106225] Updated weights for policy 1, policy_version 1077668 (0.0007) [2023-12-28 02:59:00,316][106225] Updated weights for policy 1, policy_version 1077678 (0.0007) [2023-12-28 02:59:00,625][106226] Updated weights for policy 0, policy_version 1074944 (0.0011) [2023-12-28 02:59:00,674][106226] Updated weights for policy 0, policy_version 1074954 (0.0010) [2023-12-28 02:59:00,730][106226] Updated weights for policy 0, policy_version 1074964 (0.0010) [2023-12-28 02:59:01,038][106225] Updated weights for policy 1, policy_version 1077688 (0.0007) [2023-12-28 02:59:01,099][106225] Updated weights for policy 1, policy_version 1077698 (0.0008) [2023-12-28 02:59:01,160][106225] Updated weights for policy 1, policy_version 1077708 (0.0008) [2023-12-28 02:59:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 551182336. Throughput: 0: 10070.6, 1: 9973.3. Samples: 551176620. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 02:59:01,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.938')] [2023-12-28 02:59:01,463][106226] Updated weights for policy 0, policy_version 1074974 (0.0007) [2023-12-28 02:59:01,511][106226] Updated weights for policy 0, policy_version 1074984 (0.0005) [2023-12-28 02:59:01,559][106226] Updated weights for policy 0, policy_version 1074994 (0.0007) [2023-12-28 02:59:01,887][106225] Updated weights for policy 1, policy_version 1077718 (0.0007) [2023-12-28 02:59:01,949][106225] Updated weights for policy 1, policy_version 1077728 (0.0008) [2023-12-28 02:59:02,013][106225] Updated weights for policy 1, policy_version 1077738 (0.0007) [2023-12-28 02:59:02,250][106226] Updated weights for policy 0, policy_version 1075004 (0.0008) [2023-12-28 02:59:02,315][106226] Updated weights for policy 0, policy_version 1075014 (0.0009) [2023-12-28 02:59:02,376][106226] Updated weights for policy 0, policy_version 1075024 (0.0010) [2023-12-28 02:59:02,792][106225] Updated weights for policy 1, policy_version 1077748 (0.0008) [2023-12-28 02:59:02,849][106225] Updated weights for policy 1, policy_version 1077758 (0.0008) [2023-12-28 02:59:02,906][106225] Updated weights for policy 1, policy_version 1077768 (0.0008) [2023-12-28 02:59:03,077][106226] Updated weights for policy 0, policy_version 1075034 (0.0011) [2023-12-28 02:59:03,125][106226] Updated weights for policy 0, policy_version 1075044 (0.0010) [2023-12-28 02:59:03,168][106226] Updated weights for policy 0, policy_version 1075054 (0.0010) [2023-12-28 02:59:03,214][106226] Updated weights for policy 0, policy_version 1075064 (0.0010) [2023-12-28 02:59:03,612][106225] Updated weights for policy 1, policy_version 1077778 (0.0007) [2023-12-28 02:59:03,667][106225] Updated weights for policy 1, policy_version 1077788 (0.0005) [2023-12-28 02:59:03,725][106225] Updated weights for policy 1, policy_version 1077798 (0.0009) [2023-12-28 02:59:03,782][106225] Updated weights for policy 1, policy_version 1077808 (0.0010) [2023-12-28 02:59:03,886][106226] Updated weights for policy 0, policy_version 1075074 (0.0011) [2023-12-28 02:59:03,937][106226] Updated weights for policy 0, policy_version 1075084 (0.0011) [2023-12-28 02:59:03,995][106226] Updated weights for policy 0, policy_version 1075094 (0.0011) [2023-12-28 02:59:04,507][106225] Updated weights for policy 1, policy_version 1077818 (0.0005) [2023-12-28 02:59:04,564][106225] Updated weights for policy 1, policy_version 1077828 (0.0005) [2023-12-28 02:59:04,619][106225] Updated weights for policy 1, policy_version 1077838 (0.0007) [2023-12-28 02:59:04,733][106226] Updated weights for policy 0, policy_version 1075104 (0.0009) [2023-12-28 02:59:04,789][106226] Updated weights for policy 0, policy_version 1075114 (0.0009) [2023-12-28 02:59:04,851][106226] Updated weights for policy 0, policy_version 1075124 (0.0008) [2023-12-28 02:59:05,297][106225] Updated weights for policy 1, policy_version 1077848 (0.0006) [2023-12-28 02:59:05,345][106225] Updated weights for policy 1, policy_version 1077858 (0.0006) [2023-12-28 02:59:05,409][106225] Updated weights for policy 1, policy_version 1077868 (0.0009) [2023-12-28 02:59:05,516][106226] Updated weights for policy 0, policy_version 1075134 (0.0007) [2023-12-28 02:59:05,579][106226] Updated weights for policy 0, policy_version 1075144 (0.0005) [2023-12-28 02:59:05,637][106226] Updated weights for policy 0, policy_version 1075154 (0.0007) [2023-12-28 02:59:06,149][106225] Updated weights for policy 1, policy_version 1077878 (0.0009) [2023-12-28 02:59:06,174][105115] Fps is (10 sec: 18842.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 551280640. Throughput: 0: 10064.9, 1: 9961.6. Samples: 551295196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:06,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.848')] [2023-12-28 02:59:06,212][106225] Updated weights for policy 1, policy_version 1077888 (0.0009) [2023-12-28 02:59:06,241][106226] Updated weights for policy 0, policy_version 1075164 (0.0008) [2023-12-28 02:59:06,275][106225] Updated weights for policy 1, policy_version 1077898 (0.0007) [2023-12-28 02:59:06,309][106226] Updated weights for policy 0, policy_version 1075174 (0.0007) [2023-12-28 02:59:06,375][106226] Updated weights for policy 0, policy_version 1075184 (0.0008) [2023-12-28 02:59:06,936][106225] Updated weights for policy 1, policy_version 1077908 (0.0008) [2023-12-28 02:59:06,995][106225] Updated weights for policy 1, policy_version 1077918 (0.0008) [2023-12-28 02:59:07,053][106225] Updated weights for policy 1, policy_version 1077928 (0.0008) [2023-12-28 02:59:07,124][106226] Updated weights for policy 0, policy_version 1075194 (0.0009) [2023-12-28 02:59:07,186][106226] Updated weights for policy 0, policy_version 1075204 (0.0008) [2023-12-28 02:59:07,247][106226] Updated weights for policy 0, policy_version 1075214 (0.0008) [2023-12-28 02:59:07,314][106226] Updated weights for policy 0, policy_version 1075224 (0.0009) [2023-12-28 02:59:07,764][106225] Updated weights for policy 1, policy_version 1077938 (0.0009) [2023-12-28 02:59:07,814][106225] Updated weights for policy 1, policy_version 1077948 (0.0009) [2023-12-28 02:59:07,860][106225] Updated weights for policy 1, policy_version 1077958 (0.0008) [2023-12-28 02:59:07,919][106225] Updated weights for policy 1, policy_version 1077968 (0.0007) [2023-12-28 02:59:07,982][106226] Updated weights for policy 0, policy_version 1075234 (0.0010) [2023-12-28 02:59:08,042][106226] Updated weights for policy 0, policy_version 1075244 (0.0007) [2023-12-28 02:59:08,092][106226] Updated weights for policy 0, policy_version 1075254 (0.0010) [2023-12-28 02:59:08,626][106225] Updated weights for policy 1, policy_version 1077978 (0.0008) [2023-12-28 02:59:08,689][106225] Updated weights for policy 1, policy_version 1077988 (0.0008) [2023-12-28 02:59:08,741][106226] Updated weights for policy 0, policy_version 1075264 (0.0006) [2023-12-28 02:59:08,751][106225] Updated weights for policy 1, policy_version 1077998 (0.0008) [2023-12-28 02:59:08,799][106226] Updated weights for policy 0, policy_version 1075274 (0.0006) [2023-12-28 02:59:08,867][106226] Updated weights for policy 0, policy_version 1075284 (0.0010) [2023-12-28 02:59:09,510][106225] Updated weights for policy 1, policy_version 1078008 (0.0008) [2023-12-28 02:59:09,572][106225] Updated weights for policy 1, policy_version 1078018 (0.0008) [2023-12-28 02:59:09,580][106226] Updated weights for policy 0, policy_version 1075294 (0.0009) [2023-12-28 02:59:09,627][106225] Updated weights for policy 1, policy_version 1078028 (0.0008) [2023-12-28 02:59:09,634][106226] Updated weights for policy 0, policy_version 1075304 (0.0006) [2023-12-28 02:59:09,695][106226] Updated weights for policy 0, policy_version 1075314 (0.0008) [2023-12-28 02:59:10,356][106225] Updated weights for policy 1, policy_version 1078038 (0.0009) [2023-12-28 02:59:10,407][106225] Updated weights for policy 1, policy_version 1078048 (0.0008) [2023-12-28 02:59:10,468][106226] Updated weights for policy 0, policy_version 1075324 (0.0008) [2023-12-28 02:59:10,473][106225] Updated weights for policy 1, policy_version 1078058 (0.0006) [2023-12-28 02:59:10,529][106226] Updated weights for policy 0, policy_version 1075334 (0.0007) [2023-12-28 02:59:10,581][106226] Updated weights for policy 0, policy_version 1075344 (0.0007) [2023-12-28 02:59:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 551378944. Throughput: 0: 10067.9, 1: 9945.9. Samples: 551354296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:11,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-5.150')] [2023-12-28 02:59:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001075352_275349504.pth... [2023-12-28 02:59:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001078064_276029440.pth... [2023-12-28 02:59:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001076944_275742720.pth [2023-12-28 02:59:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001074208_275054592.pth [2023-12-28 02:59:11,267][106225] Updated weights for policy 1, policy_version 1078068 (0.0008) [2023-12-28 02:59:11,329][106225] Updated weights for policy 1, policy_version 1078078 (0.0008) [2023-12-28 02:59:11,331][106226] Updated weights for policy 0, policy_version 1075354 (0.0005) [2023-12-28 02:59:11,399][106226] Updated weights for policy 0, policy_version 1075364 (0.0008) [2023-12-28 02:59:11,406][106225] Updated weights for policy 1, policy_version 1078088 (0.0008) [2023-12-28 02:59:11,453][106226] Updated weights for policy 0, policy_version 1075374 (0.0007) [2023-12-28 02:59:11,503][106226] Updated weights for policy 0, policy_version 1075384 (0.0005) [2023-12-28 02:59:12,211][106226] Updated weights for policy 0, policy_version 1075394 (0.0008) [2023-12-28 02:59:12,217][106225] Updated weights for policy 1, policy_version 1078098 (0.0007) [2023-12-28 02:59:12,270][106226] Updated weights for policy 0, policy_version 1075404 (0.0008) [2023-12-28 02:59:12,276][106225] Updated weights for policy 1, policy_version 1078108 (0.0007) [2023-12-28 02:59:12,334][106226] Updated weights for policy 0, policy_version 1075414 (0.0007) [2023-12-28 02:59:12,336][106225] Updated weights for policy 1, policy_version 1078118 (0.0006) [2023-12-28 02:59:12,400][106225] Updated weights for policy 1, policy_version 1078128 (0.0009) [2023-12-28 02:59:12,966][106226] Updated weights for policy 0, policy_version 1075424 (0.0009) [2023-12-28 02:59:13,026][106226] Updated weights for policy 0, policy_version 1075434 (0.0008) [2023-12-28 02:59:13,082][106226] Updated weights for policy 0, policy_version 1075444 (0.0008) [2023-12-28 02:59:13,118][106225] Updated weights for policy 1, policy_version 1078138 (0.0007) [2023-12-28 02:59:13,174][106225] Updated weights for policy 1, policy_version 1078148 (0.0008) [2023-12-28 02:59:13,223][106225] Updated weights for policy 1, policy_version 1078158 (0.0006) [2023-12-28 02:59:13,808][106226] Updated weights for policy 0, policy_version 1075454 (0.0007) [2023-12-28 02:59:13,865][106226] Updated weights for policy 0, policy_version 1075464 (0.0009) [2023-12-28 02:59:13,926][106226] Updated weights for policy 0, policy_version 1075474 (0.0008) [2023-12-28 02:59:13,946][106225] Updated weights for policy 1, policy_version 1078168 (0.0009) [2023-12-28 02:59:13,996][106225] Updated weights for policy 1, policy_version 1078178 (0.0008) [2023-12-28 02:59:14,044][106225] Updated weights for policy 1, policy_version 1078188 (0.0008) [2023-12-28 02:59:14,617][106226] Updated weights for policy 0, policy_version 1075484 (0.0010) [2023-12-28 02:59:14,669][106226] Updated weights for policy 0, policy_version 1075494 (0.0008) [2023-12-28 02:59:14,721][106226] Updated weights for policy 0, policy_version 1075504 (0.0008) [2023-12-28 02:59:14,788][106225] Updated weights for policy 1, policy_version 1078198 (0.0008) [2023-12-28 02:59:14,851][106225] Updated weights for policy 1, policy_version 1078208 (0.0008) [2023-12-28 02:59:14,913][106225] Updated weights for policy 1, policy_version 1078218 (0.0006) [2023-12-28 02:59:15,530][106226] Updated weights for policy 0, policy_version 1075514 (0.0007) [2023-12-28 02:59:15,560][106225] Updated weights for policy 1, policy_version 1078228 (0.0008) [2023-12-28 02:59:15,586][106226] Updated weights for policy 0, policy_version 1075524 (0.0006) [2023-12-28 02:59:15,614][106225] Updated weights for policy 1, policy_version 1078238 (0.0010) [2023-12-28 02:59:15,636][106226] Updated weights for policy 0, policy_version 1075534 (0.0006) [2023-12-28 02:59:15,675][106225] Updated weights for policy 1, policy_version 1078248 (0.0010) [2023-12-28 02:59:15,685][106226] Updated weights for policy 0, policy_version 1075544 (0.0007) [2023-12-28 02:59:16,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 551477248. Throughput: 0: 10013.4, 1: 9817.6. Samples: 551468864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:16,176][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.864')] [2023-12-28 02:59:16,264][106225] Updated weights for policy 1, policy_version 1078258 (0.0011) [2023-12-28 02:59:16,325][106225] Updated weights for policy 1, policy_version 1078268 (0.0007) [2023-12-28 02:59:16,368][106226] Updated weights for policy 0, policy_version 1075554 (0.0005) [2023-12-28 02:59:16,387][106225] Updated weights for policy 1, policy_version 1078278 (0.0008) [2023-12-28 02:59:16,419][106226] Updated weights for policy 0, policy_version 1075564 (0.0005) [2023-12-28 02:59:16,451][106225] Updated weights for policy 1, policy_version 1078288 (0.0008) [2023-12-28 02:59:16,471][106226] Updated weights for policy 0, policy_version 1075574 (0.0005) [2023-12-28 02:59:17,147][106226] Updated weights for policy 0, policy_version 1075584 (0.0007) [2023-12-28 02:59:17,183][106225] Updated weights for policy 1, policy_version 1078298 (0.0008) [2023-12-28 02:59:17,201][106226] Updated weights for policy 0, policy_version 1075594 (0.0006) [2023-12-28 02:59:17,238][106225] Updated weights for policy 1, policy_version 1078308 (0.0006) [2023-12-28 02:59:17,261][106226] Updated weights for policy 0, policy_version 1075604 (0.0008) [2023-12-28 02:59:17,292][106225] Updated weights for policy 1, policy_version 1078318 (0.0009) [2023-12-28 02:59:17,893][106226] Updated weights for policy 0, policy_version 1075614 (0.0007) [2023-12-28 02:59:17,952][106226] Updated weights for policy 0, policy_version 1075624 (0.0007) [2023-12-28 02:59:17,973][106225] Updated weights for policy 1, policy_version 1078328 (0.0007) [2023-12-28 02:59:18,010][106226] Updated weights for policy 0, policy_version 1075634 (0.0006) [2023-12-28 02:59:18,020][106225] Updated weights for policy 1, policy_version 1078338 (0.0006) [2023-12-28 02:59:18,069][106225] Updated weights for policy 1, policy_version 1078348 (0.0007) [2023-12-28 02:59:18,749][106226] Updated weights for policy 0, policy_version 1075644 (0.0007) [2023-12-28 02:59:18,796][106226] Updated weights for policy 0, policy_version 1075654 (0.0008) [2023-12-28 02:59:18,843][106225] Updated weights for policy 1, policy_version 1078358 (0.0010) [2023-12-28 02:59:18,849][106226] Updated weights for policy 0, policy_version 1075664 (0.0008) [2023-12-28 02:59:18,908][106225] Updated weights for policy 1, policy_version 1078368 (0.0011) [2023-12-28 02:59:18,971][106225] Updated weights for policy 1, policy_version 1078378 (0.0010) [2023-12-28 02:59:19,627][106226] Updated weights for policy 0, policy_version 1075674 (0.0008) [2023-12-28 02:59:19,662][106225] Updated weights for policy 1, policy_version 1078388 (0.0009) [2023-12-28 02:59:19,694][106226] Updated weights for policy 0, policy_version 1075684 (0.0008) [2023-12-28 02:59:19,724][106225] Updated weights for policy 1, policy_version 1078398 (0.0007) [2023-12-28 02:59:19,758][106226] Updated weights for policy 0, policy_version 1075694 (0.0006) [2023-12-28 02:59:19,787][106225] Updated weights for policy 1, policy_version 1078408 (0.0008) [2023-12-28 02:59:19,829][106226] Updated weights for policy 0, policy_version 1075704 (0.0006) [2023-12-28 02:59:20,466][106225] Updated weights for policy 1, policy_version 1078418 (0.0008) [2023-12-28 02:59:20,526][106225] Updated weights for policy 1, policy_version 1078428 (0.0007) [2023-12-28 02:59:20,539][106226] Updated weights for policy 0, policy_version 1075714 (0.0007) [2023-12-28 02:59:20,592][106225] Updated weights for policy 1, policy_version 1078438 (0.0007) [2023-12-28 02:59:20,610][106226] Updated weights for policy 0, policy_version 1075724 (0.0007) [2023-12-28 02:59:20,651][106225] Updated weights for policy 1, policy_version 1078448 (0.0007) [2023-12-28 02:59:20,671][106226] Updated weights for policy 0, policy_version 1075734 (0.0007) [2023-12-28 02:59:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 551575552. Throughput: 0: 9918.1, 1: 9761.4. Samples: 551586668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:21,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.978')] [2023-12-28 02:59:21,417][106226] Updated weights for policy 0, policy_version 1075744 (0.0008) [2023-12-28 02:59:21,467][106225] Updated weights for policy 1, policy_version 1078458 (0.0007) [2023-12-28 02:59:21,481][106226] Updated weights for policy 0, policy_version 1075754 (0.0009) [2023-12-28 02:59:21,530][106225] Updated weights for policy 1, policy_version 1078468 (0.0007) [2023-12-28 02:59:21,550][106226] Updated weights for policy 0, policy_version 1075764 (0.0007) [2023-12-28 02:59:21,591][106225] Updated weights for policy 1, policy_version 1078478 (0.0009) [2023-12-28 02:59:22,314][106225] Updated weights for policy 1, policy_version 1078488 (0.0009) [2023-12-28 02:59:22,369][106226] Updated weights for policy 0, policy_version 1075774 (0.0010) [2023-12-28 02:59:22,383][106225] Updated weights for policy 1, policy_version 1078498 (0.0008) [2023-12-28 02:59:22,432][106226] Updated weights for policy 0, policy_version 1075784 (0.0007) [2023-12-28 02:59:22,444][106225] Updated weights for policy 1, policy_version 1078508 (0.0006) [2023-12-28 02:59:22,488][106226] Updated weights for policy 0, policy_version 1075794 (0.0008) [2023-12-28 02:59:23,171][106225] Updated weights for policy 1, policy_version 1078518 (0.0007) [2023-12-28 02:59:23,204][106226] Updated weights for policy 0, policy_version 1075804 (0.0009) [2023-12-28 02:59:23,226][106225] Updated weights for policy 1, policy_version 1078528 (0.0007) [2023-12-28 02:59:23,249][106226] Updated weights for policy 0, policy_version 1075814 (0.0007) [2023-12-28 02:59:23,271][106225] Updated weights for policy 1, policy_version 1078538 (0.0008) [2023-12-28 02:59:23,298][106226] Updated weights for policy 0, policy_version 1075824 (0.0006) [2023-12-28 02:59:23,955][106226] Updated weights for policy 0, policy_version 1075834 (0.0008) [2023-12-28 02:59:23,962][106225] Updated weights for policy 1, policy_version 1078548 (0.0007) [2023-12-28 02:59:24,016][106225] Updated weights for policy 1, policy_version 1078558 (0.0008) [2023-12-28 02:59:24,022][106226] Updated weights for policy 0, policy_version 1075844 (0.0005) [2023-12-28 02:59:24,077][106225] Updated weights for policy 1, policy_version 1078568 (0.0009) [2023-12-28 02:59:24,091][106226] Updated weights for policy 0, policy_version 1075854 (0.0005) [2023-12-28 02:59:24,158][106226] Updated weights for policy 0, policy_version 1075864 (0.0007) [2023-12-28 02:59:24,724][106225] Updated weights for policy 1, policy_version 1078578 (0.0009) [2023-12-28 02:59:24,771][106225] Updated weights for policy 1, policy_version 1078588 (0.0008) [2023-12-28 02:59:24,817][106225] Updated weights for policy 1, policy_version 1078598 (0.0007) [2023-12-28 02:59:24,842][106226] Updated weights for policy 0, policy_version 1075874 (0.0007) [2023-12-28 02:59:24,864][106225] Updated weights for policy 1, policy_version 1078608 (0.0006) [2023-12-28 02:59:24,894][106226] Updated weights for policy 0, policy_version 1075884 (0.0008) [2023-12-28 02:59:24,949][106226] Updated weights for policy 0, policy_version 1075894 (0.0009) [2023-12-28 02:59:25,586][106226] Updated weights for policy 0, policy_version 1075904 (0.0009) [2023-12-28 02:59:25,597][106225] Updated weights for policy 1, policy_version 1078618 (0.0006) [2023-12-28 02:59:25,644][106226] Updated weights for policy 0, policy_version 1075914 (0.0008) [2023-12-28 02:59:25,653][106225] Updated weights for policy 1, policy_version 1078628 (0.0005) [2023-12-28 02:59:25,708][106226] Updated weights for policy 0, policy_version 1075924 (0.0008) [2023-12-28 02:59:25,712][106225] Updated weights for policy 1, policy_version 1078638 (0.0005) [2023-12-28 02:59:26,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 551673856. Throughput: 0: 9934.4, 1: 9738.0. Samples: 551643712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:26,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.883')] [2023-12-28 02:59:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001078640_276176896.pth... [2023-12-28 02:59:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001075928_275496960.pth... [2023-12-28 02:59:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001077520_275890176.pth [2023-12-28 02:59:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001074776_275202048.pth [2023-12-28 02:59:26,286][106225] Updated weights for policy 1, policy_version 1078648 (0.0005) [2023-12-28 02:59:26,335][106225] Updated weights for policy 1, policy_version 1078658 (0.0005) [2023-12-28 02:59:26,392][106225] Updated weights for policy 1, policy_version 1078668 (0.0005) [2023-12-28 02:59:26,497][106226] Updated weights for policy 0, policy_version 1075934 (0.0008) [2023-12-28 02:59:26,562][106226] Updated weights for policy 0, policy_version 1075944 (0.0010) [2023-12-28 02:59:26,621][106226] Updated weights for policy 0, policy_version 1075954 (0.0009) [2023-12-28 02:59:26,970][106225] Updated weights for policy 1, policy_version 1078678 (0.0005) [2023-12-28 02:59:27,023][106225] Updated weights for policy 1, policy_version 1078688 (0.0005) [2023-12-28 02:59:27,074][106225] Updated weights for policy 1, policy_version 1078698 (0.0005) [2023-12-28 02:59:27,388][106226] Updated weights for policy 0, policy_version 1075964 (0.0007) [2023-12-28 02:59:27,445][106226] Updated weights for policy 0, policy_version 1075974 (0.0005) [2023-12-28 02:59:27,491][106226] Updated weights for policy 0, policy_version 1075984 (0.0005) [2023-12-28 02:59:27,680][106225] Updated weights for policy 1, policy_version 1078708 (0.0006) [2023-12-28 02:59:27,732][106225] Updated weights for policy 1, policy_version 1078718 (0.0009) [2023-12-28 02:59:27,784][106225] Updated weights for policy 1, policy_version 1078728 (0.0008) [2023-12-28 02:59:28,068][106226] Updated weights for policy 0, policy_version 1075994 (0.0005) [2023-12-28 02:59:28,121][106226] Updated weights for policy 0, policy_version 1076004 (0.0009) [2023-12-28 02:59:28,170][106226] Updated weights for policy 0, policy_version 1076014 (0.0008) [2023-12-28 02:59:28,227][106226] Updated weights for policy 0, policy_version 1076024 (0.0008) [2023-12-28 02:59:28,439][106225] Updated weights for policy 1, policy_version 1078738 (0.0008) [2023-12-28 02:59:28,494][106225] Updated weights for policy 1, policy_version 1078748 (0.0006) [2023-12-28 02:59:28,562][106225] Updated weights for policy 1, policy_version 1078758 (0.0006) [2023-12-28 02:59:28,628][106225] Updated weights for policy 1, policy_version 1078768 (0.0008) [2023-12-28 02:59:28,975][106226] Updated weights for policy 0, policy_version 1076034 (0.0008) [2023-12-28 02:59:29,022][106226] Updated weights for policy 0, policy_version 1076044 (0.0010) [2023-12-28 02:59:29,066][106226] Updated weights for policy 0, policy_version 1076054 (0.0008) [2023-12-28 02:59:29,281][106225] Updated weights for policy 1, policy_version 1078778 (0.0009) [2023-12-28 02:59:29,332][106225] Updated weights for policy 1, policy_version 1078788 (0.0008) [2023-12-28 02:59:29,398][106225] Updated weights for policy 1, policy_version 1078798 (0.0009) [2023-12-28 02:59:29,806][106226] Updated weights for policy 0, policy_version 1076064 (0.0007) [2023-12-28 02:59:29,874][106226] Updated weights for policy 0, policy_version 1076074 (0.0007) [2023-12-28 02:59:29,942][106226] Updated weights for policy 0, policy_version 1076084 (0.0007) [2023-12-28 02:59:30,148][106225] Updated weights for policy 1, policy_version 1078808 (0.0006) [2023-12-28 02:59:30,215][106225] Updated weights for policy 1, policy_version 1078818 (0.0008) [2023-12-28 02:59:30,279][106225] Updated weights for policy 1, policy_version 1078828 (0.0005) [2023-12-28 02:59:30,543][106226] Updated weights for policy 0, policy_version 1076094 (0.0006) [2023-12-28 02:59:30,591][106226] Updated weights for policy 0, policy_version 1076104 (0.0005) [2023-12-28 02:59:30,638][106226] Updated weights for policy 0, policy_version 1076114 (0.0008) [2023-12-28 02:59:31,000][106225] Updated weights for policy 1, policy_version 1078838 (0.0007) [2023-12-28 02:59:31,062][106225] Updated weights for policy 1, policy_version 1078848 (0.0007) [2023-12-28 02:59:31,129][106225] Updated weights for policy 1, policy_version 1078858 (0.0008) [2023-12-28 02:59:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 551780352. Throughput: 0: 9903.6, 1: 9869.5. Samples: 551766860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:31,176][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.812')] [2023-12-28 02:59:31,300][106226] Updated weights for policy 0, policy_version 1076124 (0.0008) [2023-12-28 02:59:31,351][106226] Updated weights for policy 0, policy_version 1076134 (0.0009) [2023-12-28 02:59:31,417][106226] Updated weights for policy 0, policy_version 1076144 (0.0009) [2023-12-28 02:59:31,819][106225] Updated weights for policy 1, policy_version 1078868 (0.0010) [2023-12-28 02:59:31,880][106225] Updated weights for policy 1, policy_version 1078878 (0.0008) [2023-12-28 02:59:31,941][106225] Updated weights for policy 1, policy_version 1078888 (0.0009) [2023-12-28 02:59:32,079][106226] Updated weights for policy 0, policy_version 1076154 (0.0009) [2023-12-28 02:59:32,145][106226] Updated weights for policy 0, policy_version 1076164 (0.0006) [2023-12-28 02:59:32,213][106226] Updated weights for policy 0, policy_version 1076174 (0.0005) [2023-12-28 02:59:32,279][106226] Updated weights for policy 0, policy_version 1076184 (0.0008) [2023-12-28 02:59:32,774][106225] Updated weights for policy 1, policy_version 1078898 (0.0008) [2023-12-28 02:59:32,828][106225] Updated weights for policy 1, policy_version 1078908 (0.0005) [2023-12-28 02:59:32,887][106225] Updated weights for policy 1, policy_version 1078918 (0.0006) [2023-12-28 02:59:32,923][106226] Updated weights for policy 0, policy_version 1076194 (0.0008) [2023-12-28 02:59:32,945][106225] Updated weights for policy 1, policy_version 1078928 (0.0007) [2023-12-28 02:59:32,987][106226] Updated weights for policy 0, policy_version 1076204 (0.0008) [2023-12-28 02:59:33,056][106226] Updated weights for policy 0, policy_version 1076214 (0.0008) [2023-12-28 02:59:33,487][106225] Updated weights for policy 1, policy_version 1078938 (0.0010) [2023-12-28 02:59:33,550][106225] Updated weights for policy 1, policy_version 1078948 (0.0007) [2023-12-28 02:59:33,610][106225] Updated weights for policy 1, policy_version 1078958 (0.0005) [2023-12-28 02:59:33,683][106226] Updated weights for policy 0, policy_version 1076224 (0.0008) [2023-12-28 02:59:33,732][106226] Updated weights for policy 0, policy_version 1076234 (0.0008) [2023-12-28 02:59:33,778][106226] Updated weights for policy 0, policy_version 1076244 (0.0008) [2023-12-28 02:59:34,170][106225] Updated weights for policy 1, policy_version 1078968 (0.0007) [2023-12-28 02:59:34,235][106225] Updated weights for policy 1, policy_version 1078978 (0.0006) [2023-12-28 02:59:34,289][106225] Updated weights for policy 1, policy_version 1078988 (0.0007) [2023-12-28 02:59:34,589][106226] Updated weights for policy 0, policy_version 1076254 (0.0008) [2023-12-28 02:59:34,648][106226] Updated weights for policy 0, policy_version 1076264 (0.0009) [2023-12-28 02:59:34,703][106226] Updated weights for policy 0, policy_version 1076274 (0.0009) [2023-12-28 02:59:34,980][106225] Updated weights for policy 1, policy_version 1078998 (0.0005) [2023-12-28 02:59:35,040][106225] Updated weights for policy 1, policy_version 1079008 (0.0005) [2023-12-28 02:59:35,093][106225] Updated weights for policy 1, policy_version 1079018 (0.0005) [2023-12-28 02:59:35,455][106226] Updated weights for policy 0, policy_version 1076284 (0.0008) [2023-12-28 02:59:35,510][106226] Updated weights for policy 0, policy_version 1076294 (0.0007) [2023-12-28 02:59:35,560][106226] Updated weights for policy 0, policy_version 1076304 (0.0005) [2023-12-28 02:59:35,704][106225] Updated weights for policy 1, policy_version 1079028 (0.0005) [2023-12-28 02:59:35,752][106225] Updated weights for policy 1, policy_version 1079038 (0.0006) [2023-12-28 02:59:35,800][106225] Updated weights for policy 1, policy_version 1079048 (0.0008) [2023-12-28 02:59:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 551878656. Throughput: 0: 9918.0, 1: 9930.5. Samples: 551889784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:36,175][105115] Avg episode reward: [(0, '-4.453'), (1, '-4.850')] [2023-12-28 02:59:36,250][106226] Updated weights for policy 0, policy_version 1076314 (0.0006) [2023-12-28 02:59:36,316][106226] Updated weights for policy 0, policy_version 1076324 (0.0008) [2023-12-28 02:59:36,380][106226] Updated weights for policy 0, policy_version 1076334 (0.0009) [2023-12-28 02:59:36,447][106226] Updated weights for policy 0, policy_version 1076344 (0.0009) [2023-12-28 02:59:36,510][106225] Updated weights for policy 1, policy_version 1079058 (0.0008) [2023-12-28 02:59:36,572][106225] Updated weights for policy 1, policy_version 1079068 (0.0009) [2023-12-28 02:59:36,629][106225] Updated weights for policy 1, policy_version 1079078 (0.0009) [2023-12-28 02:59:36,686][106225] Updated weights for policy 1, policy_version 1079088 (0.0008) [2023-12-28 02:59:37,143][106226] Updated weights for policy 0, policy_version 1076354 (0.0008) [2023-12-28 02:59:37,205][106226] Updated weights for policy 0, policy_version 1076364 (0.0008) [2023-12-28 02:59:37,261][106226] Updated weights for policy 0, policy_version 1076374 (0.0008) [2023-12-28 02:59:37,437][106225] Updated weights for policy 1, policy_version 1079098 (0.0009) [2023-12-28 02:59:37,490][106225] Updated weights for policy 1, policy_version 1079108 (0.0009) [2023-12-28 02:59:37,539][106225] Updated weights for policy 1, policy_version 1079118 (0.0008) [2023-12-28 02:59:37,976][106226] Updated weights for policy 0, policy_version 1076384 (0.0009) [2023-12-28 02:59:38,038][106226] Updated weights for policy 0, policy_version 1076394 (0.0009) [2023-12-28 02:59:38,107][106226] Updated weights for policy 0, policy_version 1076404 (0.0009) [2023-12-28 02:59:38,279][106225] Updated weights for policy 1, policy_version 1079128 (0.0009) [2023-12-28 02:59:38,344][106225] Updated weights for policy 1, policy_version 1079138 (0.0008) [2023-12-28 02:59:38,403][106225] Updated weights for policy 1, policy_version 1079148 (0.0007) [2023-12-28 02:59:38,789][106226] Updated weights for policy 0, policy_version 1076414 (0.0008) [2023-12-28 02:59:38,845][106226] Updated weights for policy 0, policy_version 1076424 (0.0008) [2023-12-28 02:59:38,912][106226] Updated weights for policy 0, policy_version 1076434 (0.0007) [2023-12-28 02:59:39,151][106225] Updated weights for policy 1, policy_version 1079158 (0.0007) [2023-12-28 02:59:39,211][106225] Updated weights for policy 1, policy_version 1079168 (0.0006) [2023-12-28 02:59:39,285][106225] Updated weights for policy 1, policy_version 1079178 (0.0008) [2023-12-28 02:59:39,665][106226] Updated weights for policy 0, policy_version 1076444 (0.0005) [2023-12-28 02:59:39,731][106226] Updated weights for policy 0, policy_version 1076454 (0.0006) [2023-12-28 02:59:39,795][106226] Updated weights for policy 0, policy_version 1076464 (0.0005) [2023-12-28 02:59:39,995][106225] Updated weights for policy 1, policy_version 1079188 (0.0009) [2023-12-28 02:59:40,058][106225] Updated weights for policy 1, policy_version 1079198 (0.0009) [2023-12-28 02:59:40,115][106225] Updated weights for policy 1, policy_version 1079208 (0.0008) [2023-12-28 02:59:40,458][106226] Updated weights for policy 0, policy_version 1076474 (0.0008) [2023-12-28 02:59:40,512][106226] Updated weights for policy 0, policy_version 1076484 (0.0009) [2023-12-28 02:59:40,568][106226] Updated weights for policy 0, policy_version 1076494 (0.0008) [2023-12-28 02:59:40,616][106226] Updated weights for policy 0, policy_version 1076504 (0.0009) [2023-12-28 02:59:40,758][106225] Updated weights for policy 1, policy_version 1079218 (0.0009) [2023-12-28 02:59:40,820][106225] Updated weights for policy 1, policy_version 1079228 (0.0010) [2023-12-28 02:59:40,874][106225] Updated weights for policy 1, policy_version 1079238 (0.0010) [2023-12-28 02:59:40,930][106225] Updated weights for policy 1, policy_version 1079248 (0.0010) [2023-12-28 02:59:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 551976960. Throughput: 0: 9898.4, 1: 9888.2. Samples: 551946908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:41,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-4.830')] [2023-12-28 02:59:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001076504_275644416.pth... [2023-12-28 02:59:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001079248_276332544.pth... [2023-12-28 02:59:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001075352_275349504.pth [2023-12-28 02:59:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001078064_276029440.pth [2023-12-28 02:59:41,387][106226] Updated weights for policy 0, policy_version 1076514 (0.0008) [2023-12-28 02:59:41,451][106226] Updated weights for policy 0, policy_version 1076524 (0.0008) [2023-12-28 02:59:41,511][106226] Updated weights for policy 0, policy_version 1076534 (0.0009) [2023-12-28 02:59:41,696][106225] Updated weights for policy 1, policy_version 1079258 (0.0008) [2023-12-28 02:59:41,775][106225] Updated weights for policy 1, policy_version 1079268 (0.0009) [2023-12-28 02:59:41,836][106225] Updated weights for policy 1, policy_version 1079278 (0.0006) [2023-12-28 02:59:42,292][106226] Updated weights for policy 0, policy_version 1076544 (0.0008) [2023-12-28 02:59:42,358][106226] Updated weights for policy 0, policy_version 1076554 (0.0008) [2023-12-28 02:59:42,425][106226] Updated weights for policy 0, policy_version 1076564 (0.0008) [2023-12-28 02:59:42,483][106225] Updated weights for policy 1, policy_version 1079288 (0.0006) [2023-12-28 02:59:42,537][106225] Updated weights for policy 1, policy_version 1079298 (0.0008) [2023-12-28 02:59:42,586][106225] Updated weights for policy 1, policy_version 1079308 (0.0008) [2023-12-28 02:59:43,105][106226] Updated weights for policy 0, policy_version 1076574 (0.0010) [2023-12-28 02:59:43,161][106226] Updated weights for policy 0, policy_version 1076584 (0.0010) [2023-12-28 02:59:43,208][106226] Updated weights for policy 0, policy_version 1076594 (0.0010) [2023-12-28 02:59:43,312][106225] Updated weights for policy 1, policy_version 1079318 (0.0008) [2023-12-28 02:59:43,371][106225] Updated weights for policy 1, policy_version 1079328 (0.0008) [2023-12-28 02:59:43,430][106225] Updated weights for policy 1, policy_version 1079338 (0.0007) [2023-12-28 02:59:43,858][106226] Updated weights for policy 0, policy_version 1076604 (0.0009) [2023-12-28 02:59:43,917][106226] Updated weights for policy 0, policy_version 1076614 (0.0008) [2023-12-28 02:59:43,974][106226] Updated weights for policy 0, policy_version 1076624 (0.0011) [2023-12-28 02:59:44,142][106225] Updated weights for policy 1, policy_version 1079348 (0.0009) [2023-12-28 02:59:44,197][106225] Updated weights for policy 1, policy_version 1079358 (0.0007) [2023-12-28 02:59:44,263][106225] Updated weights for policy 1, policy_version 1079368 (0.0006) [2023-12-28 02:59:44,685][106226] Updated weights for policy 0, policy_version 1076634 (0.0011) [2023-12-28 02:59:44,744][106226] Updated weights for policy 0, policy_version 1076644 (0.0010) [2023-12-28 02:59:44,808][106226] Updated weights for policy 0, policy_version 1076654 (0.0007) [2023-12-28 02:59:44,871][106226] Updated weights for policy 0, policy_version 1076664 (0.0008) [2023-12-28 02:59:44,945][106225] Updated weights for policy 1, policy_version 1079378 (0.0008) [2023-12-28 02:59:45,011][106225] Updated weights for policy 1, policy_version 1079388 (0.0008) [2023-12-28 02:59:45,075][106225] Updated weights for policy 1, policy_version 1079398 (0.0008) [2023-12-28 02:59:45,152][106225] Updated weights for policy 1, policy_version 1079408 (0.0008) [2023-12-28 02:59:45,514][106226] Updated weights for policy 0, policy_version 1076674 (0.0009) [2023-12-28 02:59:45,564][106226] Updated weights for policy 0, policy_version 1076684 (0.0007) [2023-12-28 02:59:45,609][106226] Updated weights for policy 0, policy_version 1076694 (0.0007) [2023-12-28 02:59:45,821][106225] Updated weights for policy 1, policy_version 1079418 (0.0005) [2023-12-28 02:59:45,881][106225] Updated weights for policy 1, policy_version 1079428 (0.0005) [2023-12-28 02:59:45,937][106225] Updated weights for policy 1, policy_version 1079438 (0.0005) [2023-12-28 02:59:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 552075264. Throughput: 0: 9846.2, 1: 9861.7. Samples: 552063476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:46,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.703')] [2023-12-28 02:59:46,312][106226] Updated weights for policy 0, policy_version 1076704 (0.0006) [2023-12-28 02:59:46,362][106226] Updated weights for policy 0, policy_version 1076714 (0.0005) [2023-12-28 02:59:46,412][106226] Updated weights for policy 0, policy_version 1076724 (0.0005) [2023-12-28 02:59:46,462][106225] Updated weights for policy 1, policy_version 1079448 (0.0008) [2023-12-28 02:59:46,517][106225] Updated weights for policy 1, policy_version 1079458 (0.0008) [2023-12-28 02:59:46,578][106225] Updated weights for policy 1, policy_version 1079468 (0.0008) [2023-12-28 02:59:47,096][106226] Updated weights for policy 0, policy_version 1076734 (0.0006) [2023-12-28 02:59:47,148][106226] Updated weights for policy 0, policy_version 1076744 (0.0008) [2023-12-28 02:59:47,201][106226] Updated weights for policy 0, policy_version 1076754 (0.0008) [2023-12-28 02:59:47,271][106225] Updated weights for policy 1, policy_version 1079478 (0.0008) [2023-12-28 02:59:47,328][106225] Updated weights for policy 1, policy_version 1079488 (0.0009) [2023-12-28 02:59:47,385][106225] Updated weights for policy 1, policy_version 1079498 (0.0008) [2023-12-28 02:59:47,893][106226] Updated weights for policy 0, policy_version 1076764 (0.0009) [2023-12-28 02:59:47,946][106226] Updated weights for policy 0, policy_version 1076774 (0.0010) [2023-12-28 02:59:48,003][106226] Updated weights for policy 0, policy_version 1076784 (0.0010) [2023-12-28 02:59:48,073][106225] Updated weights for policy 1, policy_version 1079508 (0.0009) [2023-12-28 02:59:48,132][106225] Updated weights for policy 1, policy_version 1079518 (0.0008) [2023-12-28 02:59:48,187][106225] Updated weights for policy 1, policy_version 1079528 (0.0008) [2023-12-28 02:59:48,746][106226] Updated weights for policy 0, policy_version 1076794 (0.0010) [2023-12-28 02:59:48,799][106226] Updated weights for policy 0, policy_version 1076804 (0.0008) [2023-12-28 02:59:48,861][106226] Updated weights for policy 0, policy_version 1076814 (0.0008) [2023-12-28 02:59:48,923][106225] Updated weights for policy 1, policy_version 1079538 (0.0007) [2023-12-28 02:59:48,925][106226] Updated weights for policy 0, policy_version 1076824 (0.0009) [2023-12-28 02:59:48,979][106225] Updated weights for policy 1, policy_version 1079548 (0.0009) [2023-12-28 02:59:49,036][106225] Updated weights for policy 1, policy_version 1079558 (0.0009) [2023-12-28 02:59:49,084][106225] Updated weights for policy 1, policy_version 1079568 (0.0009) [2023-12-28 02:59:49,657][106226] Updated weights for policy 0, policy_version 1076834 (0.0009) [2023-12-28 02:59:49,716][106226] Updated weights for policy 0, policy_version 1076844 (0.0008) [2023-12-28 02:59:49,773][106226] Updated weights for policy 0, policy_version 1076854 (0.0009) [2023-12-28 02:59:49,888][106225] Updated weights for policy 1, policy_version 1079578 (0.0009) [2023-12-28 02:59:49,955][106225] Updated weights for policy 1, policy_version 1079588 (0.0009) [2023-12-28 02:59:50,016][106225] Updated weights for policy 1, policy_version 1079598 (0.0009) [2023-12-28 02:59:50,477][106226] Updated weights for policy 0, policy_version 1076864 (0.0006) [2023-12-28 02:59:50,530][106226] Updated weights for policy 0, policy_version 1076874 (0.0007) [2023-12-28 02:59:50,594][106226] Updated weights for policy 0, policy_version 1076884 (0.0006) [2023-12-28 02:59:50,769][106225] Updated weights for policy 1, policy_version 1079608 (0.0011) [2023-12-28 02:59:50,831][106225] Updated weights for policy 1, policy_version 1079618 (0.0010) [2023-12-28 02:59:50,888][106225] Updated weights for policy 1, policy_version 1079628 (0.0010) [2023-12-28 02:59:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 552173568. Throughput: 0: 9816.9, 1: 9899.5. Samples: 552182436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:51,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.931')] [2023-12-28 02:59:51,345][106226] Updated weights for policy 0, policy_version 1076894 (0.0008) [2023-12-28 02:59:51,412][106226] Updated weights for policy 0, policy_version 1076904 (0.0008) [2023-12-28 02:59:51,464][106226] Updated weights for policy 0, policy_version 1076914 (0.0008) [2023-12-28 02:59:51,596][106225] Updated weights for policy 1, policy_version 1079638 (0.0010) [2023-12-28 02:59:51,652][106225] Updated weights for policy 1, policy_version 1079648 (0.0009) [2023-12-28 02:59:51,717][106225] Updated weights for policy 1, policy_version 1079658 (0.0010) [2023-12-28 02:59:52,275][106226] Updated weights for policy 0, policy_version 1076924 (0.0008) [2023-12-28 02:59:52,334][106226] Updated weights for policy 0, policy_version 1076934 (0.0010) [2023-12-28 02:59:52,404][106226] Updated weights for policy 0, policy_version 1076944 (0.0008) [2023-12-28 02:59:52,479][106225] Updated weights for policy 1, policy_version 1079668 (0.0008) [2023-12-28 02:59:52,548][106225] Updated weights for policy 1, policy_version 1079678 (0.0008) [2023-12-28 02:59:52,619][106225] Updated weights for policy 1, policy_version 1079688 (0.0011) [2023-12-28 02:59:53,136][106226] Updated weights for policy 0, policy_version 1076954 (0.0009) [2023-12-28 02:59:53,186][106226] Updated weights for policy 0, policy_version 1076964 (0.0007) [2023-12-28 02:59:53,243][106226] Updated weights for policy 0, policy_version 1076974 (0.0008) [2023-12-28 02:59:53,264][106225] Updated weights for policy 1, policy_version 1079698 (0.0011) [2023-12-28 02:59:53,297][106226] Updated weights for policy 0, policy_version 1076984 (0.0007) [2023-12-28 02:59:53,310][106225] Updated weights for policy 1, policy_version 1079708 (0.0010) [2023-12-28 02:59:53,357][106225] Updated weights for policy 1, policy_version 1079718 (0.0010) [2023-12-28 02:59:53,403][106225] Updated weights for policy 1, policy_version 1079728 (0.0010) [2023-12-28 02:59:53,942][106226] Updated weights for policy 0, policy_version 1076994 (0.0006) [2023-12-28 02:59:54,005][106226] Updated weights for policy 0, policy_version 1077004 (0.0008) [2023-12-28 02:59:54,056][106226] Updated weights for policy 0, policy_version 1077014 (0.0007) [2023-12-28 02:59:54,083][106225] Updated weights for policy 1, policy_version 1079738 (0.0007) [2023-12-28 02:59:54,147][106225] Updated weights for policy 1, policy_version 1079748 (0.0010) [2023-12-28 02:59:54,213][106225] Updated weights for policy 1, policy_version 1079758 (0.0010) [2023-12-28 02:59:54,670][106226] Updated weights for policy 0, policy_version 1077024 (0.0010) [2023-12-28 02:59:54,716][106226] Updated weights for policy 0, policy_version 1077034 (0.0010) [2023-12-28 02:59:54,773][106226] Updated weights for policy 0, policy_version 1077044 (0.0010) [2023-12-28 02:59:54,835][106225] Updated weights for policy 1, policy_version 1079768 (0.0006) [2023-12-28 02:59:54,886][106225] Updated weights for policy 1, policy_version 1079778 (0.0005) [2023-12-28 02:59:54,945][106225] Updated weights for policy 1, policy_version 1079788 (0.0009) [2023-12-28 02:59:55,489][106226] Updated weights for policy 0, policy_version 1077054 (0.0010) [2023-12-28 02:59:55,549][106225] Updated weights for policy 1, policy_version 1079798 (0.0007) [2023-12-28 02:59:55,556][106226] Updated weights for policy 0, policy_version 1077064 (0.0011) [2023-12-28 02:59:55,601][106225] Updated weights for policy 1, policy_version 1079808 (0.0006) [2023-12-28 02:59:55,607][106226] Updated weights for policy 0, policy_version 1077074 (0.0006) [2023-12-28 02:59:55,657][106225] Updated weights for policy 1, policy_version 1079818 (0.0005) [2023-12-28 02:59:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 552271872. Throughput: 0: 9792.9, 1: 9903.5. Samples: 552240632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 02:59:56,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.933')] [2023-12-28 02:59:56,177][106226] Updated weights for policy 0, policy_version 1077084 (0.0007) [2023-12-28 02:59:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001079824_276480000.pth... [2023-12-28 02:59:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001078640_276176896.pth [2023-12-28 02:59:56,237][106226] Updated weights for policy 0, policy_version 1077094 (0.0011) [2023-12-28 02:59:56,291][106226] Updated weights for policy 0, policy_version 1077104 (0.0010) [2023-12-28 02:59:56,313][106225] Updated weights for policy 1, policy_version 1079828 (0.0006) [2023-12-28 02:59:56,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001077112_275800064.pth... [2023-12-28 02:59:56,336][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001075928_275496960.pth [2023-12-28 02:59:56,365][106225] Updated weights for policy 1, policy_version 1079838 (0.0009) [2023-12-28 02:59:56,418][106225] Updated weights for policy 1, policy_version 1079848 (0.0007) [2023-12-28 02:59:57,010][106226] Updated weights for policy 0, policy_version 1077114 (0.0010) [2023-12-28 02:59:57,063][106226] Updated weights for policy 0, policy_version 1077124 (0.0010) [2023-12-28 02:59:57,119][106226] Updated weights for policy 0, policy_version 1077134 (0.0010) [2023-12-28 02:59:57,150][106225] Updated weights for policy 1, policy_version 1079858 (0.0007) [2023-12-28 02:59:57,174][106226] Updated weights for policy 0, policy_version 1077144 (0.0010) [2023-12-28 02:59:57,198][106225] Updated weights for policy 1, policy_version 1079868 (0.0007) [2023-12-28 02:59:57,251][106225] Updated weights for policy 1, policy_version 1079878 (0.0008) [2023-12-28 02:59:57,304][106225] Updated weights for policy 1, policy_version 1079888 (0.0007) [2023-12-28 02:59:57,887][106226] Updated weights for policy 0, policy_version 1077154 (0.0010) [2023-12-28 02:59:57,946][106226] Updated weights for policy 0, policy_version 1077164 (0.0010) [2023-12-28 02:59:58,007][106226] Updated weights for policy 0, policy_version 1077174 (0.0010) [2023-12-28 02:59:58,037][106225] Updated weights for policy 1, policy_version 1079898 (0.0006) [2023-12-28 02:59:58,098][106225] Updated weights for policy 1, policy_version 1079908 (0.0005) [2023-12-28 02:59:58,162][106225] Updated weights for policy 1, policy_version 1079918 (0.0005) [2023-12-28 02:59:58,741][106226] Updated weights for policy 0, policy_version 1077184 (0.0009) [2023-12-28 02:59:58,809][106226] Updated weights for policy 0, policy_version 1077194 (0.0008) [2023-12-28 02:59:58,911][106225] Updated weights for policy 1, policy_version 1079928 (0.0008) [2023-12-28 02:59:58,921][106226] Updated weights for policy 0, policy_version 1077205 (0.0009) [2023-12-28 02:59:58,974][106225] Updated weights for policy 1, policy_version 1079938 (0.0008) [2023-12-28 02:59:59,036][106225] Updated weights for policy 1, policy_version 1079948 (0.0009) [2023-12-28 02:59:59,759][106225] Updated weights for policy 1, policy_version 1079958 (0.0007) [2023-12-28 02:59:59,764][106226] Updated weights for policy 0, policy_version 1077215 (0.0008) [2023-12-28 02:59:59,814][106225] Updated weights for policy 1, policy_version 1079968 (0.0008) [2023-12-28 02:59:59,848][106226] Updated weights for policy 0, policy_version 1077228 (0.0007) [2023-12-28 02:59:59,876][106225] Updated weights for policy 1, policy_version 1079978 (0.0008) [2023-12-28 02:59:59,908][106226] Updated weights for policy 0, policy_version 1077238 (0.0008) [2023-12-28 03:00:00,543][106225] Updated weights for policy 1, policy_version 1079988 (0.0007) [2023-12-28 03:00:00,605][106225] Updated weights for policy 1, policy_version 1079998 (0.0006) [2023-12-28 03:00:00,651][106226] Updated weights for policy 0, policy_version 1077248 (0.0007) [2023-12-28 03:00:00,665][106225] Updated weights for policy 1, policy_version 1080008 (0.0007) [2023-12-28 03:00:00,711][106226] Updated weights for policy 0, policy_version 1077258 (0.0007) [2023-12-28 03:00:00,770][106226] Updated weights for policy 0, policy_version 1077268 (0.0009) [2023-12-28 03:00:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 552370176. Throughput: 0: 9800.3, 1: 10003.1. Samples: 552360016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:01,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.006')] [2023-12-28 03:00:01,450][106226] Updated weights for policy 0, policy_version 1077278 (0.0010) [2023-12-28 03:00:01,452][106225] Updated weights for policy 1, policy_version 1080018 (0.0007) [2023-12-28 03:00:01,513][106226] Updated weights for policy 0, policy_version 1077288 (0.0007) [2023-12-28 03:00:01,514][106225] Updated weights for policy 1, policy_version 1080028 (0.0009) [2023-12-28 03:00:01,567][106225] Updated weights for policy 1, policy_version 1080038 (0.0009) [2023-12-28 03:00:01,576][106226] Updated weights for policy 0, policy_version 1077298 (0.0008) [2023-12-28 03:00:01,628][106225] Updated weights for policy 1, policy_version 1080048 (0.0009) [2023-12-28 03:00:02,372][106226] Updated weights for policy 0, policy_version 1077308 (0.0009) [2023-12-28 03:00:02,404][106225] Updated weights for policy 1, policy_version 1080058 (0.0007) [2023-12-28 03:00:02,429][106226] Updated weights for policy 0, policy_version 1077318 (0.0010) [2023-12-28 03:00:02,461][106225] Updated weights for policy 1, policy_version 1080068 (0.0005) [2023-12-28 03:00:02,489][106226] Updated weights for policy 0, policy_version 1077328 (0.0011) [2023-12-28 03:00:02,519][106225] Updated weights for policy 1, policy_version 1080078 (0.0007) [2023-12-28 03:00:03,132][106226] Updated weights for policy 0, policy_version 1077338 (0.0009) [2023-12-28 03:00:03,190][106226] Updated weights for policy 0, policy_version 1077348 (0.0005) [2023-12-28 03:00:03,247][106226] Updated weights for policy 0, policy_version 1077358 (0.0005) [2023-12-28 03:00:03,297][106225] Updated weights for policy 1, policy_version 1080088 (0.0006) [2023-12-28 03:00:03,308][106226] Updated weights for policy 0, policy_version 1077368 (0.0006) [2023-12-28 03:00:03,357][106225] Updated weights for policy 1, policy_version 1080098 (0.0005) [2023-12-28 03:00:03,412][106225] Updated weights for policy 1, policy_version 1080108 (0.0005) [2023-12-28 03:00:03,912][106226] Updated weights for policy 0, policy_version 1077378 (0.0007) [2023-12-28 03:00:03,967][106226] Updated weights for policy 0, policy_version 1077388 (0.0006) [2023-12-28 03:00:04,006][106225] Updated weights for policy 1, policy_version 1080118 (0.0007) [2023-12-28 03:00:04,021][106226] Updated weights for policy 0, policy_version 1077398 (0.0006) [2023-12-28 03:00:04,058][106225] Updated weights for policy 1, policy_version 1080128 (0.0008) [2023-12-28 03:00:04,123][106225] Updated weights for policy 1, policy_version 1080138 (0.0008) [2023-12-28 03:00:04,644][106226] Updated weights for policy 0, policy_version 1077408 (0.0007) [2023-12-28 03:00:04,698][106226] Updated weights for policy 0, policy_version 1077418 (0.0008) [2023-12-28 03:00:04,751][106226] Updated weights for policy 0, policy_version 1077428 (0.0008) [2023-12-28 03:00:04,872][106225] Updated weights for policy 1, policy_version 1080148 (0.0009) [2023-12-28 03:00:04,919][106225] Updated weights for policy 1, policy_version 1080158 (0.0010) [2023-12-28 03:00:04,989][106225] Updated weights for policy 1, policy_version 1080169 (0.0011) [2023-12-28 03:00:05,354][106226] Updated weights for policy 0, policy_version 1077438 (0.0007) [2023-12-28 03:00:05,420][106226] Updated weights for policy 0, policy_version 1077448 (0.0010) [2023-12-28 03:00:05,483][106226] Updated weights for policy 0, policy_version 1077458 (0.0010) [2023-12-28 03:00:05,684][106225] Updated weights for policy 1, policy_version 1080179 (0.0010) [2023-12-28 03:00:05,741][106225] Updated weights for policy 1, policy_version 1080189 (0.0010) [2023-12-28 03:00:05,798][106225] Updated weights for policy 1, policy_version 1080199 (0.0010) [2023-12-28 03:00:06,130][106226] Updated weights for policy 0, policy_version 1077468 (0.0010) [2023-12-28 03:00:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 552468480. Throughput: 0: 9884.1, 1: 9970.2. Samples: 552480112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:06,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-5.029')] [2023-12-28 03:00:06,196][106226] Updated weights for policy 0, policy_version 1077478 (0.0007) [2023-12-28 03:00:06,252][106226] Updated weights for policy 0, policy_version 1077488 (0.0007) [2023-12-28 03:00:06,483][106225] Updated weights for policy 1, policy_version 1080209 (0.0010) [2023-12-28 03:00:06,549][106225] Updated weights for policy 1, policy_version 1080219 (0.0005) [2023-12-28 03:00:06,618][106225] Updated weights for policy 1, policy_version 1080229 (0.0006) [2023-12-28 03:00:06,691][106225] Updated weights for policy 1, policy_version 1080239 (0.0006) [2023-12-28 03:00:06,972][106226] Updated weights for policy 0, policy_version 1077498 (0.0008) [2023-12-28 03:00:07,029][106226] Updated weights for policy 0, policy_version 1077508 (0.0007) [2023-12-28 03:00:07,081][106226] Updated weights for policy 0, policy_version 1077518 (0.0007) [2023-12-28 03:00:07,139][106226] Updated weights for policy 0, policy_version 1077528 (0.0008) [2023-12-28 03:00:07,355][106225] Updated weights for policy 1, policy_version 1080249 (0.0010) [2023-12-28 03:00:07,416][106225] Updated weights for policy 1, policy_version 1080259 (0.0008) [2023-12-28 03:00:07,471][106225] Updated weights for policy 1, policy_version 1080269 (0.0010) [2023-12-28 03:00:07,801][106226] Updated weights for policy 0, policy_version 1077538 (0.0009) [2023-12-28 03:00:07,850][106226] Updated weights for policy 0, policy_version 1077548 (0.0009) [2023-12-28 03:00:07,902][106226] Updated weights for policy 0, policy_version 1077558 (0.0008) [2023-12-28 03:00:08,126][106225] Updated weights for policy 1, policy_version 1080279 (0.0007) [2023-12-28 03:00:08,182][106225] Updated weights for policy 1, policy_version 1080289 (0.0005) [2023-12-28 03:00:08,244][106225] Updated weights for policy 1, policy_version 1080299 (0.0007) [2023-12-28 03:00:08,652][106226] Updated weights for policy 0, policy_version 1077568 (0.0008) [2023-12-28 03:00:08,720][106226] Updated weights for policy 0, policy_version 1077578 (0.0009) [2023-12-28 03:00:08,789][106226] Updated weights for policy 0, policy_version 1077588 (0.0009) [2023-12-28 03:00:08,911][106225] Updated weights for policy 1, policy_version 1080309 (0.0007) [2023-12-28 03:00:08,965][106225] Updated weights for policy 1, policy_version 1080319 (0.0006) [2023-12-28 03:00:09,035][106225] Updated weights for policy 1, policy_version 1080329 (0.0006) [2023-12-28 03:00:09,558][106226] Updated weights for policy 0, policy_version 1077598 (0.0008) [2023-12-28 03:00:09,630][106226] Updated weights for policy 0, policy_version 1077608 (0.0006) [2023-12-28 03:00:09,697][106226] Updated weights for policy 0, policy_version 1077618 (0.0005) [2023-12-28 03:00:09,791][106225] Updated weights for policy 1, policy_version 1080339 (0.0009) [2023-12-28 03:00:09,859][106225] Updated weights for policy 1, policy_version 1080349 (0.0008) [2023-12-28 03:00:09,926][106225] Updated weights for policy 1, policy_version 1080359 (0.0009) [2023-12-28 03:00:10,317][106226] Updated weights for policy 0, policy_version 1077628 (0.0005) [2023-12-28 03:00:10,381][106226] Updated weights for policy 0, policy_version 1077638 (0.0006) [2023-12-28 03:00:10,446][106226] Updated weights for policy 0, policy_version 1077648 (0.0005) [2023-12-28 03:00:10,719][106225] Updated weights for policy 1, policy_version 1080369 (0.0008) [2023-12-28 03:00:10,793][106225] Updated weights for policy 1, policy_version 1080379 (0.0008) [2023-12-28 03:00:10,847][106225] Updated weights for policy 1, policy_version 1080389 (0.0008) [2023-12-28 03:00:10,907][106225] Updated weights for policy 1, policy_version 1080399 (0.0010) [2023-12-28 03:00:11,036][106226] Updated weights for policy 0, policy_version 1077658 (0.0007) [2023-12-28 03:00:11,101][106226] Updated weights for policy 0, policy_version 1077668 (0.0008) [2023-12-28 03:00:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 552566784. Throughput: 0: 9882.6, 1: 10020.4. Samples: 552539348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:11,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.089')] [2023-12-28 03:00:11,176][106226] Updated weights for policy 0, policy_version 1077678 (0.0009) [2023-12-28 03:00:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001080400_276627456.pth... [2023-12-28 03:00:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001079248_276332544.pth [2023-12-28 03:00:11,245][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001077688_275947520.pth... [2023-12-28 03:00:11,245][106226] Updated weights for policy 0, policy_version 1077688 (0.0011) [2023-12-28 03:00:11,249][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001076504_275644416.pth [2023-12-28 03:00:11,731][106225] Updated weights for policy 1, policy_version 1080409 (0.0009) [2023-12-28 03:00:11,798][106225] Updated weights for policy 1, policy_version 1080419 (0.0008) [2023-12-28 03:00:11,866][106225] Updated weights for policy 1, policy_version 1080429 (0.0008) [2023-12-28 03:00:11,949][106226] Updated weights for policy 0, policy_version 1077698 (0.0008) [2023-12-28 03:00:12,013][106226] Updated weights for policy 0, policy_version 1077708 (0.0007) [2023-12-28 03:00:12,079][106226] Updated weights for policy 0, policy_version 1077718 (0.0009) [2023-12-28 03:00:12,657][106225] Updated weights for policy 1, policy_version 1080439 (0.0008) [2023-12-28 03:00:12,703][106225] Updated weights for policy 1, policy_version 1080449 (0.0009) [2023-12-28 03:00:12,762][106225] Updated weights for policy 1, policy_version 1080459 (0.0008) [2023-12-28 03:00:12,795][106226] Updated weights for policy 0, policy_version 1077728 (0.0008) [2023-12-28 03:00:12,886][106226] Updated weights for policy 0, policy_version 1077738 (0.0008) [2023-12-28 03:00:12,934][106226] Updated weights for policy 0, policy_version 1077748 (0.0008) [2023-12-28 03:00:13,476][106225] Updated weights for policy 1, policy_version 1080469 (0.0006) [2023-12-28 03:00:13,531][106225] Updated weights for policy 1, policy_version 1080479 (0.0008) [2023-12-28 03:00:13,585][106225] Updated weights for policy 1, policy_version 1080489 (0.0009) [2023-12-28 03:00:13,637][106226] Updated weights for policy 0, policy_version 1077758 (0.0007) [2023-12-28 03:00:13,689][106226] Updated weights for policy 0, policy_version 1077768 (0.0005) [2023-12-28 03:00:13,748][106226] Updated weights for policy 0, policy_version 1077778 (0.0005) [2023-12-28 03:00:14,330][106226] Updated weights for policy 0, policy_version 1077788 (0.0007) [2023-12-28 03:00:14,371][106225] Updated weights for policy 1, policy_version 1080499 (0.0008) [2023-12-28 03:00:14,393][106226] Updated weights for policy 0, policy_version 1077798 (0.0008) [2023-12-28 03:00:14,428][106225] Updated weights for policy 1, policy_version 1080509 (0.0008) [2023-12-28 03:00:14,451][106226] Updated weights for policy 0, policy_version 1077808 (0.0005) [2023-12-28 03:00:14,489][106225] Updated weights for policy 1, policy_version 1080519 (0.0008) [2023-12-28 03:00:15,187][106226] Updated weights for policy 0, policy_version 1077818 (0.0007) [2023-12-28 03:00:15,246][106226] Updated weights for policy 0, policy_version 1077828 (0.0007) [2023-12-28 03:00:15,269][106225] Updated weights for policy 1, policy_version 1080529 (0.0008) [2023-12-28 03:00:15,315][106226] Updated weights for policy 0, policy_version 1077838 (0.0011) [2023-12-28 03:00:15,335][106225] Updated weights for policy 1, policy_version 1080539 (0.0009) [2023-12-28 03:00:15,368][106226] Updated weights for policy 0, policy_version 1077848 (0.0010) [2023-12-28 03:00:15,400][106225] Updated weights for policy 1, policy_version 1080549 (0.0010) [2023-12-28 03:00:15,463][106225] Updated weights for policy 1, policy_version 1080559 (0.0010) [2023-12-28 03:00:15,992][106226] Updated weights for policy 0, policy_version 1077858 (0.0010) [2023-12-28 03:00:16,048][106226] Updated weights for policy 0, policy_version 1077868 (0.0010) [2023-12-28 03:00:16,104][106226] Updated weights for policy 0, policy_version 1077878 (0.0010) [2023-12-28 03:00:16,165][106225] Updated weights for policy 1, policy_version 1080569 (0.0008) [2023-12-28 03:00:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 552665088. Throughput: 0: 9926.2, 1: 9796.2. Samples: 552654368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:16,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.821')] [2023-12-28 03:00:16,214][106225] Updated weights for policy 1, policy_version 1080579 (0.0007) [2023-12-28 03:00:16,275][106225] Updated weights for policy 1, policy_version 1080589 (0.0007) [2023-12-28 03:00:16,845][106226] Updated weights for policy 0, policy_version 1077888 (0.0006) [2023-12-28 03:00:16,903][106226] Updated weights for policy 0, policy_version 1077898 (0.0009) [2023-12-28 03:00:16,966][106226] Updated weights for policy 0, policy_version 1077908 (0.0010) [2023-12-28 03:00:17,020][106225] Updated weights for policy 1, policy_version 1080599 (0.0007) [2023-12-28 03:00:17,070][106225] Updated weights for policy 1, policy_version 1080609 (0.0008) [2023-12-28 03:00:17,116][106225] Updated weights for policy 1, policy_version 1080619 (0.0008) [2023-12-28 03:00:17,629][106226] Updated weights for policy 0, policy_version 1077918 (0.0011) [2023-12-28 03:00:17,675][106226] Updated weights for policy 0, policy_version 1077928 (0.0010) [2023-12-28 03:00:17,725][106226] Updated weights for policy 0, policy_version 1077938 (0.0010) [2023-12-28 03:00:17,883][106225] Updated weights for policy 1, policy_version 1080629 (0.0008) [2023-12-28 03:00:17,938][106225] Updated weights for policy 1, policy_version 1080639 (0.0008) [2023-12-28 03:00:17,995][106225] Updated weights for policy 1, policy_version 1080649 (0.0008) [2023-12-28 03:00:18,445][106226] Updated weights for policy 0, policy_version 1077948 (0.0010) [2023-12-28 03:00:18,514][106226] Updated weights for policy 0, policy_version 1077958 (0.0008) [2023-12-28 03:00:18,583][106226] Updated weights for policy 0, policy_version 1077968 (0.0007) [2023-12-28 03:00:18,724][106225] Updated weights for policy 1, policy_version 1080659 (0.0008) [2023-12-28 03:00:18,782][106225] Updated weights for policy 1, policy_version 1080669 (0.0006) [2023-12-28 03:00:18,848][106225] Updated weights for policy 1, policy_version 1080679 (0.0007) [2023-12-28 03:00:19,195][106226] Updated weights for policy 0, policy_version 1077978 (0.0010) [2023-12-28 03:00:19,267][106226] Updated weights for policy 0, policy_version 1077988 (0.0008) [2023-12-28 03:00:19,331][106226] Updated weights for policy 0, policy_version 1077998 (0.0008) [2023-12-28 03:00:19,404][106226] Updated weights for policy 0, policy_version 1078008 (0.0008) [2023-12-28 03:00:19,591][106225] Updated weights for policy 1, policy_version 1080689 (0.0008) [2023-12-28 03:00:19,649][106225] Updated weights for policy 1, policy_version 1080699 (0.0008) [2023-12-28 03:00:19,699][106225] Updated weights for policy 1, policy_version 1080709 (0.0008) [2023-12-28 03:00:19,759][106225] Updated weights for policy 1, policy_version 1080719 (0.0006) [2023-12-28 03:00:20,141][106226] Updated weights for policy 0, policy_version 1078018 (0.0009) [2023-12-28 03:00:20,206][106226] Updated weights for policy 0, policy_version 1078028 (0.0009) [2023-12-28 03:00:20,269][106226] Updated weights for policy 0, policy_version 1078038 (0.0008) [2023-12-28 03:00:20,499][106225] Updated weights for policy 1, policy_version 1080729 (0.0006) [2023-12-28 03:00:20,554][106225] Updated weights for policy 1, policy_version 1080739 (0.0005) [2023-12-28 03:00:20,621][106225] Updated weights for policy 1, policy_version 1080749 (0.0007) [2023-12-28 03:00:21,026][106226] Updated weights for policy 0, policy_version 1078048 (0.0009) [2023-12-28 03:00:21,094][106226] Updated weights for policy 0, policy_version 1078058 (0.0007) [2023-12-28 03:00:21,160][106226] Updated weights for policy 0, policy_version 1078068 (0.0008) [2023-12-28 03:00:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 552755200. Throughput: 0: 9853.3, 1: 9695.7. Samples: 552769484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:21,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.844')] [2023-12-28 03:00:21,316][106225] Updated weights for policy 1, policy_version 1080759 (0.0008) [2023-12-28 03:00:21,389][106225] Updated weights for policy 1, policy_version 1080769 (0.0007) [2023-12-28 03:00:21,450][106225] Updated weights for policy 1, policy_version 1080779 (0.0009) [2023-12-28 03:00:21,988][106226] Updated weights for policy 0, policy_version 1078078 (0.0008) [2023-12-28 03:00:22,045][106226] Updated weights for policy 0, policy_version 1078088 (0.0009) [2023-12-28 03:00:22,101][106226] Updated weights for policy 0, policy_version 1078098 (0.0008) [2023-12-28 03:00:22,162][106225] Updated weights for policy 1, policy_version 1080789 (0.0007) [2023-12-28 03:00:22,225][106225] Updated weights for policy 1, policy_version 1080799 (0.0009) [2023-12-28 03:00:22,288][106225] Updated weights for policy 1, policy_version 1080809 (0.0008) [2023-12-28 03:00:22,909][106226] Updated weights for policy 0, policy_version 1078108 (0.0007) [2023-12-28 03:00:22,958][106225] Updated weights for policy 1, policy_version 1080819 (0.0008) [2023-12-28 03:00:22,972][106226] Updated weights for policy 0, policy_version 1078118 (0.0007) [2023-12-28 03:00:23,017][106225] Updated weights for policy 1, policy_version 1080829 (0.0005) [2023-12-28 03:00:23,042][106226] Updated weights for policy 0, policy_version 1078128 (0.0005) [2023-12-28 03:00:23,078][106225] Updated weights for policy 1, policy_version 1080839 (0.0005) [2023-12-28 03:00:23,590][106226] Updated weights for policy 0, policy_version 1078138 (0.0006) [2023-12-28 03:00:23,647][106226] Updated weights for policy 0, policy_version 1078148 (0.0008) [2023-12-28 03:00:23,649][106225] Updated weights for policy 1, policy_version 1080849 (0.0005) [2023-12-28 03:00:23,703][106225] Updated weights for policy 1, policy_version 1080859 (0.0007) [2023-12-28 03:00:23,705][106226] Updated weights for policy 0, policy_version 1078158 (0.0006) [2023-12-28 03:00:23,756][106226] Updated weights for policy 0, policy_version 1078168 (0.0006) [2023-12-28 03:00:23,761][106225] Updated weights for policy 1, policy_version 1080869 (0.0009) [2023-12-28 03:00:23,819][106225] Updated weights for policy 1, policy_version 1080879 (0.0008) [2023-12-28 03:00:24,387][106226] Updated weights for policy 0, policy_version 1078178 (0.0007) [2023-12-28 03:00:24,443][106226] Updated weights for policy 0, policy_version 1078188 (0.0009) [2023-12-28 03:00:24,445][106225] Updated weights for policy 1, policy_version 1080889 (0.0006) [2023-12-28 03:00:24,489][106226] Updated weights for policy 0, policy_version 1078198 (0.0009) [2023-12-28 03:00:24,506][106225] Updated weights for policy 1, policy_version 1080899 (0.0008) [2023-12-28 03:00:24,564][106225] Updated weights for policy 1, policy_version 1080909 (0.0008) [2023-12-28 03:00:25,124][106226] Updated weights for policy 0, policy_version 1078208 (0.0005) [2023-12-28 03:00:25,173][106225] Updated weights for policy 1, policy_version 1080919 (0.0008) [2023-12-28 03:00:25,175][106226] Updated weights for policy 0, policy_version 1078218 (0.0005) [2023-12-28 03:00:25,228][106225] Updated weights for policy 1, policy_version 1080929 (0.0006) [2023-12-28 03:00:25,230][106226] Updated weights for policy 0, policy_version 1078228 (0.0005) [2023-12-28 03:00:25,278][106225] Updated weights for policy 1, policy_version 1080939 (0.0006) [2023-12-28 03:00:25,850][106226] Updated weights for policy 0, policy_version 1078238 (0.0008) [2023-12-28 03:00:25,854][106225] Updated weights for policy 1, policy_version 1080949 (0.0005) [2023-12-28 03:00:25,906][106225] Updated weights for policy 1, policy_version 1080959 (0.0005) [2023-12-28 03:00:25,907][106226] Updated weights for policy 0, policy_version 1078248 (0.0008) [2023-12-28 03:00:25,961][106225] Updated weights for policy 1, policy_version 1080969 (0.0009) [2023-12-28 03:00:25,963][106226] Updated weights for policy 0, policy_version 1078258 (0.0008) [2023-12-28 03:00:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 552869888. Throughput: 0: 9872.8, 1: 9745.3. Samples: 552829720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:26,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.199')] [2023-12-28 03:00:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001080976_276774912.pth... [2023-12-28 03:00:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001078264_276094976.pth... [2023-12-28 03:00:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001079824_276480000.pth [2023-12-28 03:00:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001077112_275800064.pth [2023-12-28 03:00:26,527][106226] Updated weights for policy 0, policy_version 1078268 (0.0006) [2023-12-28 03:00:26,577][106226] Updated weights for policy 0, policy_version 1078278 (0.0005) [2023-12-28 03:00:26,625][106225] Updated weights for policy 1, policy_version 1080979 (0.0010) [2023-12-28 03:00:26,629][106226] Updated weights for policy 0, policy_version 1078288 (0.0005) [2023-12-28 03:00:26,680][106225] Updated weights for policy 1, policy_version 1080989 (0.0007) [2023-12-28 03:00:26,735][106225] Updated weights for policy 1, policy_version 1081000 (0.0007) [2023-12-28 03:00:27,152][106226] Updated weights for policy 0, policy_version 1078298 (0.0006) [2023-12-28 03:00:27,216][106226] Updated weights for policy 0, policy_version 1078308 (0.0009) [2023-12-28 03:00:27,287][106226] Updated weights for policy 0, policy_version 1078318 (0.0009) [2023-12-28 03:00:27,347][106225] Updated weights for policy 1, policy_version 1081010 (0.0006) [2023-12-28 03:00:27,352][106226] Updated weights for policy 0, policy_version 1078328 (0.0009) [2023-12-28 03:00:27,398][106225] Updated weights for policy 1, policy_version 1081020 (0.0008) [2023-12-28 03:00:27,470][106225] Updated weights for policy 1, policy_version 1081030 (0.0008) [2023-12-28 03:00:27,535][106225] Updated weights for policy 1, policy_version 1081040 (0.0010) [2023-12-28 03:00:28,048][106226] Updated weights for policy 0, policy_version 1078338 (0.0008) [2023-12-28 03:00:28,097][106226] Updated weights for policy 0, policy_version 1078348 (0.0007) [2023-12-28 03:00:28,146][106226] Updated weights for policy 0, policy_version 1078358 (0.0008) [2023-12-28 03:00:28,206][106225] Updated weights for policy 1, policy_version 1081050 (0.0010) [2023-12-28 03:00:28,252][106225] Updated weights for policy 1, policy_version 1081060 (0.0010) [2023-12-28 03:00:28,297][106225] Updated weights for policy 1, policy_version 1081070 (0.0010) [2023-12-28 03:00:28,881][106226] Updated weights for policy 0, policy_version 1078368 (0.0007) [2023-12-28 03:00:28,930][106226] Updated weights for policy 0, policy_version 1078378 (0.0007) [2023-12-28 03:00:28,983][106226] Updated weights for policy 0, policy_version 1078388 (0.0008) [2023-12-28 03:00:29,035][106225] Updated weights for policy 1, policy_version 1081080 (0.0010) [2023-12-28 03:00:29,081][106225] Updated weights for policy 1, policy_version 1081090 (0.0010) [2023-12-28 03:00:29,123][106225] Updated weights for policy 1, policy_version 1081100 (0.0010) [2023-12-28 03:00:29,764][106226] Updated weights for policy 0, policy_version 1078398 (0.0008) [2023-12-28 03:00:29,816][106226] Updated weights for policy 0, policy_version 1078408 (0.0008) [2023-12-28 03:00:29,870][106225] Updated weights for policy 1, policy_version 1081110 (0.0008) [2023-12-28 03:00:29,880][106226] Updated weights for policy 0, policy_version 1078418 (0.0008) [2023-12-28 03:00:29,926][106225] Updated weights for policy 1, policy_version 1081120 (0.0006) [2023-12-28 03:00:29,986][106225] Updated weights for policy 1, policy_version 1081130 (0.0008) [2023-12-28 03:00:30,588][106226] Updated weights for policy 0, policy_version 1078428 (0.0008) [2023-12-28 03:00:30,645][106226] Updated weights for policy 0, policy_version 1078438 (0.0006) [2023-12-28 03:00:30,701][106226] Updated weights for policy 0, policy_version 1078448 (0.0009) [2023-12-28 03:00:30,706][106225] Updated weights for policy 1, policy_version 1081140 (0.0006) [2023-12-28 03:00:30,761][106225] Updated weights for policy 1, policy_version 1081150 (0.0006) [2023-12-28 03:00:30,813][106225] Updated weights for policy 1, policy_version 1081160 (0.0008) [2023-12-28 03:00:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 552968192. Throughput: 0: 9981.8, 1: 9858.6. Samples: 552956292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:31,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.812')] [2023-12-28 03:00:31,348][106226] Updated weights for policy 0, policy_version 1078458 (0.0010) [2023-12-28 03:00:31,418][106226] Updated weights for policy 0, policy_version 1078468 (0.0012) [2023-12-28 03:00:31,475][106226] Updated weights for policy 0, policy_version 1078478 (0.0011) [2023-12-28 03:00:31,532][106226] Updated weights for policy 0, policy_version 1078488 (0.0010) [2023-12-28 03:00:31,535][106225] Updated weights for policy 1, policy_version 1081170 (0.0007) [2023-12-28 03:00:31,587][106225] Updated weights for policy 1, policy_version 1081180 (0.0007) [2023-12-28 03:00:31,656][106225] Updated weights for policy 1, policy_version 1081190 (0.0008) [2023-12-28 03:00:31,717][106225] Updated weights for policy 1, policy_version 1081200 (0.0007) [2023-12-28 03:00:32,175][106226] Updated weights for policy 0, policy_version 1078498 (0.0005) [2023-12-28 03:00:32,231][106226] Updated weights for policy 0, policy_version 1078508 (0.0007) [2023-12-28 03:00:32,292][106226] Updated weights for policy 0, policy_version 1078518 (0.0009) [2023-12-28 03:00:32,458][106225] Updated weights for policy 1, policy_version 1081210 (0.0009) [2023-12-28 03:00:32,518][106225] Updated weights for policy 1, policy_version 1081220 (0.0009) [2023-12-28 03:00:32,577][106225] Updated weights for policy 1, policy_version 1081230 (0.0010) [2023-12-28 03:00:32,952][106226] Updated weights for policy 0, policy_version 1078528 (0.0009) [2023-12-28 03:00:33,009][106226] Updated weights for policy 0, policy_version 1078540 (0.0009) [2023-12-28 03:00:33,060][106226] Updated weights for policy 0, policy_version 1078550 (0.0009) [2023-12-28 03:00:33,199][106225] Updated weights for policy 1, policy_version 1081240 (0.0006) [2023-12-28 03:00:33,247][106225] Updated weights for policy 1, policy_version 1081250 (0.0005) [2023-12-28 03:00:33,292][106225] Updated weights for policy 1, policy_version 1081260 (0.0005) [2023-12-28 03:00:33,755][106226] Updated weights for policy 0, policy_version 1078560 (0.0010) [2023-12-28 03:00:33,811][106226] Updated weights for policy 0, policy_version 1078570 (0.0010) [2023-12-28 03:00:33,856][106226] Updated weights for policy 0, policy_version 1078580 (0.0010) [2023-12-28 03:00:33,930][106225] Updated weights for policy 1, policy_version 1081270 (0.0009) [2023-12-28 03:00:33,978][106225] Updated weights for policy 1, policy_version 1081280 (0.0010) [2023-12-28 03:00:34,027][106225] Updated weights for policy 1, policy_version 1081290 (0.0010) [2023-12-28 03:00:34,526][106226] Updated weights for policy 0, policy_version 1078590 (0.0009) [2023-12-28 03:00:34,588][106226] Updated weights for policy 0, policy_version 1078600 (0.0007) [2023-12-28 03:00:34,659][106226] Updated weights for policy 0, policy_version 1078610 (0.0006) [2023-12-28 03:00:34,726][106225] Updated weights for policy 1, policy_version 1081300 (0.0009) [2023-12-28 03:00:34,794][106225] Updated weights for policy 1, policy_version 1081310 (0.0010) [2023-12-28 03:00:34,867][106225] Updated weights for policy 1, policy_version 1081320 (0.0010) [2023-12-28 03:00:35,307][106226] Updated weights for policy 0, policy_version 1078620 (0.0007) [2023-12-28 03:00:35,366][106226] Updated weights for policy 0, policy_version 1078630 (0.0006) [2023-12-28 03:00:35,438][106226] Updated weights for policy 0, policy_version 1078640 (0.0005) [2023-12-28 03:00:35,531][106225] Updated weights for policy 1, policy_version 1081330 (0.0009) [2023-12-28 03:00:35,579][106225] Updated weights for policy 1, policy_version 1081340 (0.0005) [2023-12-28 03:00:35,626][106225] Updated weights for policy 1, policy_version 1081350 (0.0005) [2023-12-28 03:00:35,679][106225] Updated weights for policy 1, policy_version 1081360 (0.0005) [2023-12-28 03:00:36,122][106226] Updated weights for policy 0, policy_version 1078650 (0.0006) [2023-12-28 03:00:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 553066496. Throughput: 0: 10044.4, 1: 9886.0. Samples: 553079300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:36,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.975')] [2023-12-28 03:00:36,190][106226] Updated weights for policy 0, policy_version 1078660 (0.0010) [2023-12-28 03:00:36,231][106225] Updated weights for policy 1, policy_version 1081370 (0.0010) [2023-12-28 03:00:36,253][106226] Updated weights for policy 0, policy_version 1078670 (0.0010) [2023-12-28 03:00:36,294][106225] Updated weights for policy 1, policy_version 1081380 (0.0009) [2023-12-28 03:00:36,323][106226] Updated weights for policy 0, policy_version 1078680 (0.0008) [2023-12-28 03:00:36,358][106225] Updated weights for policy 1, policy_version 1081390 (0.0006) [2023-12-28 03:00:36,965][106225] Updated weights for policy 1, policy_version 1081400 (0.0009) [2023-12-28 03:00:36,984][106226] Updated weights for policy 0, policy_version 1078690 (0.0009) [2023-12-28 03:00:37,017][106225] Updated weights for policy 1, policy_version 1081410 (0.0009) [2023-12-28 03:00:37,048][106226] Updated weights for policy 0, policy_version 1078700 (0.0005) [2023-12-28 03:00:37,066][106225] Updated weights for policy 1, policy_version 1081420 (0.0008) [2023-12-28 03:00:37,102][106226] Updated weights for policy 0, policy_version 1078710 (0.0010) [2023-12-28 03:00:37,718][106225] Updated weights for policy 1, policy_version 1081430 (0.0009) [2023-12-28 03:00:37,773][106225] Updated weights for policy 1, policy_version 1081440 (0.0007) [2023-12-28 03:00:37,805][106226] Updated weights for policy 0, policy_version 1078720 (0.0010) [2023-12-28 03:00:37,832][106225] Updated weights for policy 1, policy_version 1081450 (0.0006) [2023-12-28 03:00:37,869][106226] Updated weights for policy 0, policy_version 1078730 (0.0010) [2023-12-28 03:00:37,927][106226] Updated weights for policy 0, policy_version 1078740 (0.0011) [2023-12-28 03:00:38,545][106226] Updated weights for policy 0, policy_version 1078750 (0.0007) [2023-12-28 03:00:38,600][106225] Updated weights for policy 1, policy_version 1081460 (0.0006) [2023-12-28 03:00:38,614][106226] Updated weights for policy 0, policy_version 1078760 (0.0007) [2023-12-28 03:00:38,659][106225] Updated weights for policy 1, policy_version 1081470 (0.0007) [2023-12-28 03:00:38,681][106226] Updated weights for policy 0, policy_version 1078770 (0.0009) [2023-12-28 03:00:38,717][106225] Updated weights for policy 1, policy_version 1081480 (0.0006) [2023-12-28 03:00:39,459][106226] Updated weights for policy 0, policy_version 1078780 (0.0009) [2023-12-28 03:00:39,508][106225] Updated weights for policy 1, policy_version 1081490 (0.0009) [2023-12-28 03:00:39,523][106226] Updated weights for policy 0, policy_version 1078790 (0.0008) [2023-12-28 03:00:39,579][106225] Updated weights for policy 1, policy_version 1081500 (0.0008) [2023-12-28 03:00:39,590][106226] Updated weights for policy 0, policy_version 1078800 (0.0007) [2023-12-28 03:00:39,649][106225] Updated weights for policy 1, policy_version 1081510 (0.0007) [2023-12-28 03:00:39,711][106225] Updated weights for policy 1, policy_version 1081520 (0.0007) [2023-12-28 03:00:40,373][106226] Updated weights for policy 0, policy_version 1078810 (0.0007) [2023-12-28 03:00:40,408][106225] Updated weights for policy 1, policy_version 1081530 (0.0008) [2023-12-28 03:00:40,427][106226] Updated weights for policy 0, policy_version 1078820 (0.0007) [2023-12-28 03:00:40,466][106225] Updated weights for policy 1, policy_version 1081540 (0.0008) [2023-12-28 03:00:40,484][106226] Updated weights for policy 0, policy_version 1078830 (0.0006) [2023-12-28 03:00:40,522][106225] Updated weights for policy 1, policy_version 1081550 (0.0006) [2023-12-28 03:00:40,544][106226] Updated weights for policy 0, policy_version 1078840 (0.0007) [2023-12-28 03:00:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 553164800. Throughput: 0: 10071.4, 1: 9940.1. Samples: 553141148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:41,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-5.039')] [2023-12-28 03:00:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001078840_276242432.pth... [2023-12-28 03:00:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001077688_275947520.pth [2023-12-28 03:00:41,195][106225] Updated weights for policy 1, policy_version 1081560 (0.0007) [2023-12-28 03:00:41,259][106225] Updated weights for policy 1, policy_version 1081570 (0.0008) [2023-12-28 03:00:41,324][106225] Updated weights for policy 1, policy_version 1081580 (0.0007) [2023-12-28 03:00:41,337][106226] Updated weights for policy 0, policy_version 1078850 (0.0007) [2023-12-28 03:00:41,361][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001081584_276930560.pth... [2023-12-28 03:00:41,366][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001080400_276627456.pth [2023-12-28 03:00:41,396][106226] Updated weights for policy 0, policy_version 1078860 (0.0010) [2023-12-28 03:00:41,456][106226] Updated weights for policy 0, policy_version 1078870 (0.0008) [2023-12-28 03:00:42,125][106225] Updated weights for policy 1, policy_version 1081590 (0.0008) [2023-12-28 03:00:42,188][106226] Updated weights for policy 0, policy_version 1078880 (0.0006) [2023-12-28 03:00:42,192][106225] Updated weights for policy 1, policy_version 1081600 (0.0009) [2023-12-28 03:00:42,242][106226] Updated weights for policy 0, policy_version 1078890 (0.0006) [2023-12-28 03:00:42,257][106225] Updated weights for policy 1, policy_version 1081610 (0.0007) [2023-12-28 03:00:42,306][106226] Updated weights for policy 0, policy_version 1078900 (0.0007) [2023-12-28 03:00:42,969][106225] Updated weights for policy 1, policy_version 1081620 (0.0009) [2023-12-28 03:00:43,030][106225] Updated weights for policy 1, policy_version 1081630 (0.0007) [2023-12-28 03:00:43,049][106226] Updated weights for policy 0, policy_version 1078910 (0.0009) [2023-12-28 03:00:43,095][106225] Updated weights for policy 1, policy_version 1081640 (0.0006) [2023-12-28 03:00:43,113][106226] Updated weights for policy 0, policy_version 1078920 (0.0009) [2023-12-28 03:00:43,178][106226] Updated weights for policy 0, policy_version 1078930 (0.0008) [2023-12-28 03:00:43,677][106225] Updated weights for policy 1, policy_version 1081650 (0.0007) [2023-12-28 03:00:43,733][106225] Updated weights for policy 1, policy_version 1081660 (0.0009) [2023-12-28 03:00:43,790][106225] Updated weights for policy 1, policy_version 1081670 (0.0008) [2023-12-28 03:00:43,843][106225] Updated weights for policy 1, policy_version 1081680 (0.0009) [2023-12-28 03:00:43,855][106226] Updated weights for policy 0, policy_version 1078940 (0.0007) [2023-12-28 03:00:43,901][106226] Updated weights for policy 0, policy_version 1078950 (0.0005) [2023-12-28 03:00:43,947][106226] Updated weights for policy 0, policy_version 1078960 (0.0005) [2023-12-28 03:00:44,598][106225] Updated weights for policy 1, policy_version 1081690 (0.0006) [2023-12-28 03:00:44,640][106226] Updated weights for policy 0, policy_version 1078970 (0.0005) [2023-12-28 03:00:44,658][106225] Updated weights for policy 1, policy_version 1081700 (0.0006) [2023-12-28 03:00:44,701][106226] Updated weights for policy 0, policy_version 1078980 (0.0007) [2023-12-28 03:00:44,717][106225] Updated weights for policy 1, policy_version 1081710 (0.0008) [2023-12-28 03:00:44,752][106226] Updated weights for policy 0, policy_version 1078990 (0.0007) [2023-12-28 03:00:44,814][106226] Updated weights for policy 0, policy_version 1079000 (0.0008) [2023-12-28 03:00:45,364][106225] Updated weights for policy 1, policy_version 1081720 (0.0006) [2023-12-28 03:00:45,412][106225] Updated weights for policy 1, policy_version 1081730 (0.0005) [2023-12-28 03:00:45,461][106225] Updated weights for policy 1, policy_version 1081740 (0.0005) [2023-12-28 03:00:45,610][106226] Updated weights for policy 0, policy_version 1079010 (0.0005) [2023-12-28 03:00:45,667][106226] Updated weights for policy 0, policy_version 1079020 (0.0005) [2023-12-28 03:00:45,729][106226] Updated weights for policy 0, policy_version 1079030 (0.0005) [2023-12-28 03:00:45,989][106225] Updated weights for policy 1, policy_version 1081750 (0.0005) [2023-12-28 03:00:46,041][106225] Updated weights for policy 1, policy_version 1081760 (0.0008) [2023-12-28 03:00:46,094][106225] Updated weights for policy 1, policy_version 1081770 (0.0007) [2023-12-28 03:00:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 553271296. Throughput: 0: 10037.2, 1: 9866.0. Samples: 553255664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:46,176][105115] Avg episode reward: [(0, '-4.892'), (1, '-4.735')] [2023-12-28 03:00:46,399][106226] Updated weights for policy 0, policy_version 1079040 (0.0007) [2023-12-28 03:00:46,457][106226] Updated weights for policy 0, policy_version 1079050 (0.0008) [2023-12-28 03:00:46,514][106226] Updated weights for policy 0, policy_version 1079060 (0.0008) [2023-12-28 03:00:46,793][106225] Updated weights for policy 1, policy_version 1081780 (0.0007) [2023-12-28 03:00:46,846][106225] Updated weights for policy 1, policy_version 1081790 (0.0010) [2023-12-28 03:00:46,899][106225] Updated weights for policy 1, policy_version 1081800 (0.0010) [2023-12-28 03:00:47,104][106226] Updated weights for policy 0, policy_version 1079070 (0.0008) [2023-12-28 03:00:47,151][106226] Updated weights for policy 0, policy_version 1079080 (0.0008) [2023-12-28 03:00:47,197][106226] Updated weights for policy 0, policy_version 1079090 (0.0008) [2023-12-28 03:00:47,620][106225] Updated weights for policy 1, policy_version 1081810 (0.0010) [2023-12-28 03:00:47,667][106225] Updated weights for policy 1, policy_version 1081820 (0.0005) [2023-12-28 03:00:47,727][106225] Updated weights for policy 1, policy_version 1081830 (0.0008) [2023-12-28 03:00:47,790][106225] Updated weights for policy 1, policy_version 1081840 (0.0010) [2023-12-28 03:00:47,957][106226] Updated weights for policy 0, policy_version 1079100 (0.0008) [2023-12-28 03:00:48,019][106226] Updated weights for policy 0, policy_version 1079110 (0.0008) [2023-12-28 03:00:48,074][106226] Updated weights for policy 0, policy_version 1079120 (0.0008) [2023-12-28 03:00:48,508][106225] Updated weights for policy 1, policy_version 1081850 (0.0011) [2023-12-28 03:00:48,567][106225] Updated weights for policy 1, policy_version 1081860 (0.0010) [2023-12-28 03:00:48,629][106225] Updated weights for policy 1, policy_version 1081870 (0.0011) [2023-12-28 03:00:48,841][106226] Updated weights for policy 0, policy_version 1079130 (0.0009) [2023-12-28 03:00:48,890][106226] Updated weights for policy 0, policy_version 1079140 (0.0007) [2023-12-28 03:00:48,937][106226] Updated weights for policy 0, policy_version 1079150 (0.0008) [2023-12-28 03:00:48,986][106226] Updated weights for policy 0, policy_version 1079160 (0.0007) [2023-12-28 03:00:49,354][106225] Updated weights for policy 1, policy_version 1081880 (0.0011) [2023-12-28 03:00:49,421][106225] Updated weights for policy 1, policy_version 1081890 (0.0010) [2023-12-28 03:00:49,471][106225] Updated weights for policy 1, policy_version 1081900 (0.0010) [2023-12-28 03:00:49,750][106226] Updated weights for policy 0, policy_version 1079170 (0.0008) [2023-12-28 03:00:49,811][106226] Updated weights for policy 0, policy_version 1079180 (0.0008) [2023-12-28 03:00:49,875][106226] Updated weights for policy 0, policy_version 1079190 (0.0007) [2023-12-28 03:00:50,212][106225] Updated weights for policy 1, policy_version 1081910 (0.0010) [2023-12-28 03:00:50,263][106225] Updated weights for policy 1, policy_version 1081920 (0.0010) [2023-12-28 03:00:50,318][106225] Updated weights for policy 1, policy_version 1081930 (0.0010) [2023-12-28 03:00:50,689][106226] Updated weights for policy 0, policy_version 1079200 (0.0008) [2023-12-28 03:00:50,750][106226] Updated weights for policy 0, policy_version 1079210 (0.0006) [2023-12-28 03:00:50,809][106226] Updated weights for policy 0, policy_version 1079220 (0.0007) [2023-12-28 03:00:50,951][106225] Updated weights for policy 1, policy_version 1081940 (0.0007) [2023-12-28 03:00:51,019][106225] Updated weights for policy 1, policy_version 1081950 (0.0008) [2023-12-28 03:00:51,087][106225] Updated weights for policy 1, policy_version 1081960 (0.0008) [2023-12-28 03:00:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 553369600. Throughput: 0: 9943.9, 1: 9946.4. Samples: 553375176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:51,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.994')] [2023-12-28 03:00:51,499][106226] Updated weights for policy 0, policy_version 1079230 (0.0007) [2023-12-28 03:00:51,563][106226] Updated weights for policy 0, policy_version 1079240 (0.0009) [2023-12-28 03:00:51,629][106226] Updated weights for policy 0, policy_version 1079250 (0.0008) [2023-12-28 03:00:51,834][106225] Updated weights for policy 1, policy_version 1081970 (0.0007) [2023-12-28 03:00:51,892][106225] Updated weights for policy 1, policy_version 1081980 (0.0009) [2023-12-28 03:00:51,946][106225] Updated weights for policy 1, policy_version 1081990 (0.0009) [2023-12-28 03:00:52,006][106225] Updated weights for policy 1, policy_version 1082000 (0.0008) [2023-12-28 03:00:52,338][106226] Updated weights for policy 0, policy_version 1079260 (0.0008) [2023-12-28 03:00:52,404][106226] Updated weights for policy 0, policy_version 1079270 (0.0008) [2023-12-28 03:00:52,465][106226] Updated weights for policy 0, policy_version 1079280 (0.0008) [2023-12-28 03:00:52,738][106225] Updated weights for policy 1, policy_version 1082010 (0.0010) [2023-12-28 03:00:52,789][106225] Updated weights for policy 1, policy_version 1082020 (0.0011) [2023-12-28 03:00:52,842][106225] Updated weights for policy 1, policy_version 1082030 (0.0008) [2023-12-28 03:00:53,279][106226] Updated weights for policy 0, policy_version 1079290 (0.0008) [2023-12-28 03:00:53,337][106226] Updated weights for policy 0, policy_version 1079300 (0.0008) [2023-12-28 03:00:53,394][106226] Updated weights for policy 0, policy_version 1079310 (0.0010) [2023-12-28 03:00:53,426][106225] Updated weights for policy 1, policy_version 1082040 (0.0005) [2023-12-28 03:00:53,451][106226] Updated weights for policy 0, policy_version 1079320 (0.0009) [2023-12-28 03:00:53,479][106225] Updated weights for policy 1, policy_version 1082050 (0.0006) [2023-12-28 03:00:53,539][106225] Updated weights for policy 1, policy_version 1082060 (0.0011) [2023-12-28 03:00:54,131][106226] Updated weights for policy 0, policy_version 1079330 (0.0005) [2023-12-28 03:00:54,135][106225] Updated weights for policy 1, policy_version 1082070 (0.0009) [2023-12-28 03:00:54,195][106226] Updated weights for policy 0, policy_version 1079340 (0.0006) [2023-12-28 03:00:54,199][106225] Updated weights for policy 1, policy_version 1082080 (0.0006) [2023-12-28 03:00:54,259][106226] Updated weights for policy 0, policy_version 1079350 (0.0006) [2023-12-28 03:00:54,264][106225] Updated weights for policy 1, policy_version 1082090 (0.0008) [2023-12-28 03:00:54,899][106226] Updated weights for policy 0, policy_version 1079360 (0.0008) [2023-12-28 03:00:54,953][106226] Updated weights for policy 0, policy_version 1079370 (0.0008) [2023-12-28 03:00:54,977][106225] Updated weights for policy 1, policy_version 1082100 (0.0009) [2023-12-28 03:00:55,015][106226] Updated weights for policy 0, policy_version 1079380 (0.0010) [2023-12-28 03:00:55,039][106225] Updated weights for policy 1, policy_version 1082110 (0.0009) [2023-12-28 03:00:55,099][106225] Updated weights for policy 1, policy_version 1082120 (0.0008) [2023-12-28 03:00:55,754][106226] Updated weights for policy 0, policy_version 1079390 (0.0009) [2023-12-28 03:00:55,816][106225] Updated weights for policy 1, policy_version 1082130 (0.0008) [2023-12-28 03:00:55,819][106226] Updated weights for policy 0, policy_version 1079400 (0.0008) [2023-12-28 03:00:55,869][106226] Updated weights for policy 0, policy_version 1079410 (0.0007) [2023-12-28 03:00:55,870][106225] Updated weights for policy 1, policy_version 1082140 (0.0009) [2023-12-28 03:00:55,934][106225] Updated weights for policy 1, policy_version 1082150 (0.0007) [2023-12-28 03:00:55,986][106225] Updated weights for policy 1, policy_version 1082160 (0.0008) [2023-12-28 03:00:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 553467904. Throughput: 0: 9929.1, 1: 9944.7. Samples: 553433672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:00:56,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.097')] [2023-12-28 03:00:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001079416_276389888.pth... [2023-12-28 03:00:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001082160_277078016.pth... [2023-12-28 03:00:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001078264_276094976.pth [2023-12-28 03:00:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001080976_276774912.pth [2023-12-28 03:00:56,599][106226] Updated weights for policy 0, policy_version 1079420 (0.0007) [2023-12-28 03:00:56,650][106226] Updated weights for policy 0, policy_version 1079430 (0.0006) [2023-12-28 03:00:56,696][106226] Updated weights for policy 0, policy_version 1079440 (0.0008) [2023-12-28 03:00:56,698][106225] Updated weights for policy 1, policy_version 1082170 (0.0005) [2023-12-28 03:00:56,757][106225] Updated weights for policy 1, policy_version 1082180 (0.0007) [2023-12-28 03:00:56,811][106225] Updated weights for policy 1, policy_version 1082190 (0.0009) [2023-12-28 03:00:57,420][106226] Updated weights for policy 0, policy_version 1079450 (0.0007) [2023-12-28 03:00:57,443][106225] Updated weights for policy 1, policy_version 1082200 (0.0008) [2023-12-28 03:00:57,468][106226] Updated weights for policy 0, policy_version 1079460 (0.0008) [2023-12-28 03:00:57,499][106225] Updated weights for policy 1, policy_version 1082210 (0.0008) [2023-12-28 03:00:57,528][106226] Updated weights for policy 0, policy_version 1079470 (0.0006) [2023-12-28 03:00:57,558][106225] Updated weights for policy 1, policy_version 1082220 (0.0007) [2023-12-28 03:00:57,591][106226] Updated weights for policy 0, policy_version 1079480 (0.0009) [2023-12-28 03:00:58,182][106226] Updated weights for policy 0, policy_version 1079490 (0.0010) [2023-12-28 03:00:58,248][106226] Updated weights for policy 0, policy_version 1079500 (0.0010) [2023-12-28 03:00:58,309][106226] Updated weights for policy 0, policy_version 1079510 (0.0010) [2023-12-28 03:00:58,345][106225] Updated weights for policy 1, policy_version 1082230 (0.0008) [2023-12-28 03:00:58,413][106225] Updated weights for policy 1, policy_version 1082240 (0.0008) [2023-12-28 03:00:58,475][106225] Updated weights for policy 1, policy_version 1082250 (0.0007) [2023-12-28 03:00:59,091][106226] Updated weights for policy 0, policy_version 1079520 (0.0011) [2023-12-28 03:00:59,147][106226] Updated weights for policy 0, policy_version 1079530 (0.0010) [2023-12-28 03:00:59,207][106226] Updated weights for policy 0, policy_version 1079540 (0.0009) [2023-12-28 03:00:59,281][106225] Updated weights for policy 1, policy_version 1082260 (0.0008) [2023-12-28 03:00:59,348][106225] Updated weights for policy 1, policy_version 1082270 (0.0008) [2023-12-28 03:00:59,409][106225] Updated weights for policy 1, policy_version 1082280 (0.0009) [2023-12-28 03:00:59,973][106226] Updated weights for policy 0, policy_version 1079551 (0.0008) [2023-12-28 03:01:00,049][106226] Updated weights for policy 0, policy_version 1079561 (0.0008) [2023-12-28 03:01:00,109][106226] Updated weights for policy 0, policy_version 1079571 (0.0009) [2023-12-28 03:01:00,149][106225] Updated weights for policy 1, policy_version 1082290 (0.0009) [2023-12-28 03:01:00,206][106225] Updated weights for policy 1, policy_version 1082300 (0.0009) [2023-12-28 03:01:00,256][106225] Updated weights for policy 1, policy_version 1082310 (0.0008) [2023-12-28 03:01:00,319][106225] Updated weights for policy 1, policy_version 1082320 (0.0009) [2023-12-28 03:01:00,817][106226] Updated weights for policy 0, policy_version 1079581 (0.0007) [2023-12-28 03:01:00,882][106226] Updated weights for policy 0, policy_version 1079591 (0.0006) [2023-12-28 03:01:00,951][106226] Updated weights for policy 0, policy_version 1079601 (0.0005) [2023-12-28 03:01:01,027][106225] Updated weights for policy 1, policy_version 1082330 (0.0007) [2023-12-28 03:01:01,096][106225] Updated weights for policy 1, policy_version 1082340 (0.0007) [2023-12-28 03:01:01,161][106225] Updated weights for policy 1, policy_version 1082350 (0.0008) [2023-12-28 03:01:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 553566208. Throughput: 0: 9871.6, 1: 10026.8. Samples: 553549792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:01,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.785')] [2023-12-28 03:01:01,623][106226] Updated weights for policy 0, policy_version 1079611 (0.0008) [2023-12-28 03:01:01,692][106226] Updated weights for policy 0, policy_version 1079621 (0.0008) [2023-12-28 03:01:01,759][106226] Updated weights for policy 0, policy_version 1079631 (0.0008) [2023-12-28 03:01:01,932][106225] Updated weights for policy 1, policy_version 1082360 (0.0008) [2023-12-28 03:01:01,993][106225] Updated weights for policy 1, policy_version 1082370 (0.0007) [2023-12-28 03:01:02,056][106225] Updated weights for policy 1, policy_version 1082380 (0.0008) [2023-12-28 03:01:02,584][106226] Updated weights for policy 0, policy_version 1079641 (0.0008) [2023-12-28 03:01:02,655][106226] Updated weights for policy 0, policy_version 1079651 (0.0007) [2023-12-28 03:01:02,723][106226] Updated weights for policy 0, policy_version 1079661 (0.0008) [2023-12-28 03:01:02,788][106225] Updated weights for policy 1, policy_version 1082390 (0.0007) [2023-12-28 03:01:02,789][106226] Updated weights for policy 0, policy_version 1079671 (0.0008) [2023-12-28 03:01:02,850][106225] Updated weights for policy 1, policy_version 1082400 (0.0006) [2023-12-28 03:01:02,916][106225] Updated weights for policy 1, policy_version 1082410 (0.0008) [2023-12-28 03:01:03,415][106226] Updated weights for policy 0, policy_version 1079681 (0.0010) [2023-12-28 03:01:03,474][106226] Updated weights for policy 0, policy_version 1079691 (0.0010) [2023-12-28 03:01:03,527][106226] Updated weights for policy 0, policy_version 1079701 (0.0010) [2023-12-28 03:01:03,534][106225] Updated weights for policy 1, policy_version 1082420 (0.0009) [2023-12-28 03:01:03,600][106225] Updated weights for policy 1, policy_version 1082430 (0.0010) [2023-12-28 03:01:03,662][106225] Updated weights for policy 1, policy_version 1082440 (0.0010) [2023-12-28 03:01:04,263][106226] Updated weights for policy 0, policy_version 1079711 (0.0010) [2023-12-28 03:01:04,329][106226] Updated weights for policy 0, policy_version 1079721 (0.0011) [2023-12-28 03:01:04,394][106226] Updated weights for policy 0, policy_version 1079731 (0.0011) [2023-12-28 03:01:04,405][106225] Updated weights for policy 1, policy_version 1082450 (0.0008) [2023-12-28 03:01:04,469][106225] Updated weights for policy 1, policy_version 1082460 (0.0009) [2023-12-28 03:01:04,528][106225] Updated weights for policy 1, policy_version 1082470 (0.0010) [2023-12-28 03:01:04,581][106225] Updated weights for policy 1, policy_version 1082480 (0.0010) [2023-12-28 03:01:05,068][106226] Updated weights for policy 0, policy_version 1079741 (0.0011) [2023-12-28 03:01:05,115][106226] Updated weights for policy 0, policy_version 1079751 (0.0010) [2023-12-28 03:01:05,166][106226] Updated weights for policy 0, policy_version 1079761 (0.0010) [2023-12-28 03:01:05,309][106225] Updated weights for policy 1, policy_version 1082490 (0.0010) [2023-12-28 03:01:05,359][106225] Updated weights for policy 1, policy_version 1082500 (0.0010) [2023-12-28 03:01:05,423][106225] Updated weights for policy 1, policy_version 1082510 (0.0011) [2023-12-28 03:01:05,884][106226] Updated weights for policy 0, policy_version 1079771 (0.0009) [2023-12-28 03:01:05,946][106226] Updated weights for policy 0, policy_version 1079781 (0.0008) [2023-12-28 03:01:05,999][106226] Updated weights for policy 0, policy_version 1079791 (0.0010) [2023-12-28 03:01:06,044][106225] Updated weights for policy 1, policy_version 1082520 (0.0010) [2023-12-28 03:01:06,105][106225] Updated weights for policy 1, policy_version 1082530 (0.0010) [2023-12-28 03:01:06,165][106225] Updated weights for policy 1, policy_version 1082540 (0.0009) [2023-12-28 03:01:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 553656320. Throughput: 0: 9875.0, 1: 10066.8. Samples: 553666864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:06,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-4.705')] [2023-12-28 03:01:06,772][106226] Updated weights for policy 0, policy_version 1079801 (0.0010) [2023-12-28 03:01:06,831][106226] Updated weights for policy 0, policy_version 1079811 (0.0009) [2023-12-28 03:01:06,880][106225] Updated weights for policy 1, policy_version 1082550 (0.0009) [2023-12-28 03:01:06,892][106226] Updated weights for policy 0, policy_version 1079821 (0.0006) [2023-12-28 03:01:06,937][106225] Updated weights for policy 1, policy_version 1082560 (0.0009) [2023-12-28 03:01:06,953][106226] Updated weights for policy 0, policy_version 1079831 (0.0008) [2023-12-28 03:01:07,002][106225] Updated weights for policy 1, policy_version 1082570 (0.0010) [2023-12-28 03:01:07,662][106226] Updated weights for policy 0, policy_version 1079841 (0.0006) [2023-12-28 03:01:07,706][106225] Updated weights for policy 1, policy_version 1082580 (0.0010) [2023-12-28 03:01:07,716][106226] Updated weights for policy 0, policy_version 1079851 (0.0007) [2023-12-28 03:01:07,766][106225] Updated weights for policy 1, policy_version 1082590 (0.0010) [2023-12-28 03:01:07,776][106226] Updated weights for policy 0, policy_version 1079861 (0.0005) [2023-12-28 03:01:07,827][106225] Updated weights for policy 1, policy_version 1082600 (0.0010) [2023-12-28 03:01:08,519][106226] Updated weights for policy 0, policy_version 1079871 (0.0007) [2023-12-28 03:01:08,577][106225] Updated weights for policy 1, policy_version 1082610 (0.0010) [2023-12-28 03:01:08,584][106226] Updated weights for policy 0, policy_version 1079881 (0.0008) [2023-12-28 03:01:08,642][106225] Updated weights for policy 1, policy_version 1082620 (0.0009) [2023-12-28 03:01:08,649][106226] Updated weights for policy 0, policy_version 1079891 (0.0009) [2023-12-28 03:01:08,710][106225] Updated weights for policy 1, policy_version 1082630 (0.0010) [2023-12-28 03:01:08,775][106225] Updated weights for policy 1, policy_version 1082640 (0.0011) [2023-12-28 03:01:09,365][106226] Updated weights for policy 0, policy_version 1079901 (0.0009) [2023-12-28 03:01:09,434][106226] Updated weights for policy 0, policy_version 1079911 (0.0012) [2023-12-28 03:01:09,495][106226] Updated weights for policy 0, policy_version 1079921 (0.0009) [2023-12-28 03:01:09,585][106225] Updated weights for policy 1, policy_version 1082650 (0.0007) [2023-12-28 03:01:09,650][106225] Updated weights for policy 1, policy_version 1082660 (0.0007) [2023-12-28 03:01:09,721][106225] Updated weights for policy 1, policy_version 1082670 (0.0009) [2023-12-28 03:01:10,357][106226] Updated weights for policy 0, policy_version 1079931 (0.0009) [2023-12-28 03:01:10,422][106226] Updated weights for policy 0, policy_version 1079941 (0.0009) [2023-12-28 03:01:10,487][106226] Updated weights for policy 0, policy_version 1079951 (0.0009) [2023-12-28 03:01:10,491][106225] Updated weights for policy 1, policy_version 1082680 (0.0008) [2023-12-28 03:01:10,553][106225] Updated weights for policy 1, policy_version 1082690 (0.0007) [2023-12-28 03:01:10,607][106225] Updated weights for policy 1, policy_version 1082700 (0.0007) [2023-12-28 03:01:11,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 553746432. Throughput: 0: 9843.2, 1: 10026.7. Samples: 553723864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:11,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.820')] [2023-12-28 03:01:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001079960_276529152.pth... [2023-12-28 03:01:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001082704_277217280.pth... [2023-12-28 03:01:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001081584_276930560.pth [2023-12-28 03:01:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001078840_276242432.pth [2023-12-28 03:01:11,319][106226] Updated weights for policy 0, policy_version 1079961 (0.0009) [2023-12-28 03:01:11,367][106225] Updated weights for policy 1, policy_version 1082710 (0.0009) [2023-12-28 03:01:11,393][106226] Updated weights for policy 0, policy_version 1079971 (0.0010) [2023-12-28 03:01:11,441][106225] Updated weights for policy 1, policy_version 1082720 (0.0008) [2023-12-28 03:01:11,461][106226] Updated weights for policy 0, policy_version 1079981 (0.0013) [2023-12-28 03:01:11,499][106225] Updated weights for policy 1, policy_version 1082730 (0.0008) [2023-12-28 03:01:11,518][106226] Updated weights for policy 0, policy_version 1079991 (0.0011) [2023-12-28 03:01:12,291][106226] Updated weights for policy 0, policy_version 1080001 (0.0011) [2023-12-28 03:01:12,309][106225] Updated weights for policy 1, policy_version 1082740 (0.0008) [2023-12-28 03:01:12,363][106226] Updated weights for policy 0, policy_version 1080011 (0.0012) [2023-12-28 03:01:12,377][106225] Updated weights for policy 1, policy_version 1082750 (0.0008) [2023-12-28 03:01:12,430][106226] Updated weights for policy 0, policy_version 1080021 (0.0007) [2023-12-28 03:01:12,437][106225] Updated weights for policy 1, policy_version 1082760 (0.0007) [2023-12-28 03:01:13,117][106225] Updated weights for policy 1, policy_version 1082770 (0.0008) [2023-12-28 03:01:13,127][106226] Updated weights for policy 0, policy_version 1080031 (0.0009) [2023-12-28 03:01:13,174][106225] Updated weights for policy 1, policy_version 1082780 (0.0008) [2023-12-28 03:01:13,182][106226] Updated weights for policy 0, policy_version 1080041 (0.0006) [2023-12-28 03:01:13,232][106225] Updated weights for policy 1, policy_version 1082790 (0.0008) [2023-12-28 03:01:13,242][106226] Updated weights for policy 0, policy_version 1080051 (0.0006) [2023-12-28 03:01:13,286][106225] Updated weights for policy 1, policy_version 1082800 (0.0007) [2023-12-28 03:01:13,944][106225] Updated weights for policy 1, policy_version 1082810 (0.0008) [2023-12-28 03:01:14,002][106225] Updated weights for policy 1, policy_version 1082820 (0.0008) [2023-12-28 03:01:14,004][106226] Updated weights for policy 0, policy_version 1080061 (0.0007) [2023-12-28 03:01:14,057][106225] Updated weights for policy 1, policy_version 1082830 (0.0005) [2023-12-28 03:01:14,062][106226] Updated weights for policy 0, policy_version 1080071 (0.0007) [2023-12-28 03:01:14,113][106226] Updated weights for policy 0, policy_version 1080081 (0.0005) [2023-12-28 03:01:14,799][106225] Updated weights for policy 1, policy_version 1082840 (0.0008) [2023-12-28 03:01:14,809][106226] Updated weights for policy 0, policy_version 1080091 (0.0005) [2023-12-28 03:01:14,857][106225] Updated weights for policy 1, policy_version 1082850 (0.0008) [2023-12-28 03:01:14,871][106226] Updated weights for policy 0, policy_version 1080101 (0.0007) [2023-12-28 03:01:14,925][106225] Updated weights for policy 1, policy_version 1082860 (0.0007) [2023-12-28 03:01:14,935][106226] Updated weights for policy 0, policy_version 1080111 (0.0007) [2023-12-28 03:01:15,638][106226] Updated weights for policy 0, policy_version 1080121 (0.0010) [2023-12-28 03:01:15,678][106225] Updated weights for policy 1, policy_version 1082870 (0.0009) [2023-12-28 03:01:15,701][106226] Updated weights for policy 0, policy_version 1080131 (0.0005) [2023-12-28 03:01:15,740][106225] Updated weights for policy 1, policy_version 1082880 (0.0010) [2023-12-28 03:01:15,762][106226] Updated weights for policy 0, policy_version 1080141 (0.0005) [2023-12-28 03:01:15,796][106225] Updated weights for policy 1, policy_version 1082890 (0.0010) [2023-12-28 03:01:15,823][106226] Updated weights for policy 0, policy_version 1080151 (0.0006) [2023-12-28 03:01:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 553844736. Throughput: 0: 9658.6, 1: 9858.2. Samples: 553834552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:16,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.865')] [2023-12-28 03:01:16,356][106226] Updated weights for policy 0, policy_version 1080161 (0.0005) [2023-12-28 03:01:16,402][106226] Updated weights for policy 0, policy_version 1080171 (0.0005) [2023-12-28 03:01:16,454][106226] Updated weights for policy 0, policy_version 1080181 (0.0009) [2023-12-28 03:01:16,501][106225] Updated weights for policy 1, policy_version 1082900 (0.0010) [2023-12-28 03:01:16,564][106225] Updated weights for policy 1, policy_version 1082910 (0.0009) [2023-12-28 03:01:16,625][106225] Updated weights for policy 1, policy_version 1082920 (0.0010) [2023-12-28 03:01:17,010][106226] Updated weights for policy 0, policy_version 1080191 (0.0006) [2023-12-28 03:01:17,068][106226] Updated weights for policy 0, policy_version 1080201 (0.0011) [2023-12-28 03:01:17,125][106226] Updated weights for policy 0, policy_version 1080211 (0.0011) [2023-12-28 03:01:17,409][106225] Updated weights for policy 1, policy_version 1082930 (0.0009) [2023-12-28 03:01:17,475][106225] Updated weights for policy 1, policy_version 1082940 (0.0007) [2023-12-28 03:01:17,535][106225] Updated weights for policy 1, policy_version 1082950 (0.0007) [2023-12-28 03:01:17,596][106225] Updated weights for policy 1, policy_version 1082960 (0.0008) [2023-12-28 03:01:17,800][106226] Updated weights for policy 0, policy_version 1080221 (0.0011) [2023-12-28 03:01:17,860][106226] Updated weights for policy 0, policy_version 1080231 (0.0011) [2023-12-28 03:01:17,918][106226] Updated weights for policy 0, policy_version 1080241 (0.0010) [2023-12-28 03:01:18,257][106225] Updated weights for policy 1, policy_version 1082970 (0.0008) [2023-12-28 03:01:18,311][106225] Updated weights for policy 1, policy_version 1082980 (0.0007) [2023-12-28 03:01:18,382][106225] Updated weights for policy 1, policy_version 1082990 (0.0008) [2023-12-28 03:01:18,615][106226] Updated weights for policy 0, policy_version 1080251 (0.0010) [2023-12-28 03:01:18,680][106226] Updated weights for policy 0, policy_version 1080261 (0.0011) [2023-12-28 03:01:18,744][106226] Updated weights for policy 0, policy_version 1080271 (0.0011) [2023-12-28 03:01:19,068][106225] Updated weights for policy 1, policy_version 1083000 (0.0008) [2023-12-28 03:01:19,120][106225] Updated weights for policy 1, policy_version 1083010 (0.0008) [2023-12-28 03:01:19,170][106225] Updated weights for policy 1, policy_version 1083020 (0.0008) [2023-12-28 03:01:19,493][106226] Updated weights for policy 0, policy_version 1080281 (0.0011) [2023-12-28 03:01:19,557][106226] Updated weights for policy 0, policy_version 1080291 (0.0011) [2023-12-28 03:01:19,621][106226] Updated weights for policy 0, policy_version 1080301 (0.0007) [2023-12-28 03:01:19,685][106226] Updated weights for policy 0, policy_version 1080311 (0.0009) [2023-12-28 03:01:20,018][106225] Updated weights for policy 1, policy_version 1083030 (0.0007) [2023-12-28 03:01:20,082][106225] Updated weights for policy 1, policy_version 1083040 (0.0008) [2023-12-28 03:01:20,145][106225] Updated weights for policy 1, policy_version 1083050 (0.0008) [2023-12-28 03:01:20,399][106226] Updated weights for policy 0, policy_version 1080321 (0.0011) [2023-12-28 03:01:20,453][106226] Updated weights for policy 0, policy_version 1080331 (0.0011) [2023-12-28 03:01:20,510][106226] Updated weights for policy 0, policy_version 1080341 (0.0011) [2023-12-28 03:01:20,846][106225] Updated weights for policy 1, policy_version 1083060 (0.0009) [2023-12-28 03:01:20,899][106225] Updated weights for policy 1, policy_version 1083070 (0.0010) [2023-12-28 03:01:20,954][106225] Updated weights for policy 1, policy_version 1083080 (0.0010) [2023-12-28 03:01:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 553943040. Throughput: 0: 9642.1, 1: 9769.7. Samples: 553952828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:21,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.994')] [2023-12-28 03:01:21,276][106226] Updated weights for policy 0, policy_version 1080351 (0.0010) [2023-12-28 03:01:21,338][106226] Updated weights for policy 0, policy_version 1080361 (0.0011) [2023-12-28 03:01:21,403][106226] Updated weights for policy 0, policy_version 1080371 (0.0011) [2023-12-28 03:01:21,758][106225] Updated weights for policy 1, policy_version 1083090 (0.0010) [2023-12-28 03:01:21,817][106225] Updated weights for policy 1, policy_version 1083100 (0.0009) [2023-12-28 03:01:21,882][106225] Updated weights for policy 1, policy_version 1083110 (0.0007) [2023-12-28 03:01:21,944][106225] Updated weights for policy 1, policy_version 1083120 (0.0008) [2023-12-28 03:01:22,144][106226] Updated weights for policy 0, policy_version 1080381 (0.0010) [2023-12-28 03:01:22,209][106226] Updated weights for policy 0, policy_version 1080391 (0.0011) [2023-12-28 03:01:22,271][106226] Updated weights for policy 0, policy_version 1080401 (0.0009) [2023-12-28 03:01:22,695][106225] Updated weights for policy 1, policy_version 1083130 (0.0006) [2023-12-28 03:01:22,759][106225] Updated weights for policy 1, policy_version 1083140 (0.0005) [2023-12-28 03:01:22,820][106225] Updated weights for policy 1, policy_version 1083150 (0.0007) [2023-12-28 03:01:23,009][106226] Updated weights for policy 0, policy_version 1080411 (0.0007) [2023-12-28 03:01:23,068][106226] Updated weights for policy 0, policy_version 1080421 (0.0011) [2023-12-28 03:01:23,123][106226] Updated weights for policy 0, policy_version 1080431 (0.0011) [2023-12-28 03:01:23,535][106225] Updated weights for policy 1, policy_version 1083160 (0.0007) [2023-12-28 03:01:23,583][106225] Updated weights for policy 1, policy_version 1083170 (0.0007) [2023-12-28 03:01:23,649][106225] Updated weights for policy 1, policy_version 1083180 (0.0008) [2023-12-28 03:01:23,712][106226] Updated weights for policy 0, policy_version 1080441 (0.0009) [2023-12-28 03:01:23,770][106226] Updated weights for policy 0, policy_version 1080451 (0.0008) [2023-12-28 03:01:23,826][106226] Updated weights for policy 0, policy_version 1080461 (0.0006) [2023-12-28 03:01:23,893][106226] Updated weights for policy 0, policy_version 1080471 (0.0005) [2023-12-28 03:01:24,425][106225] Updated weights for policy 1, policy_version 1083190 (0.0007) [2023-12-28 03:01:24,450][106226] Updated weights for policy 0, policy_version 1080481 (0.0009) [2023-12-28 03:01:24,482][106225] Updated weights for policy 1, policy_version 1083200 (0.0006) [2023-12-28 03:01:24,512][106226] Updated weights for policy 0, policy_version 1080491 (0.0006) [2023-12-28 03:01:24,537][106225] Updated weights for policy 1, policy_version 1083210 (0.0008) [2023-12-28 03:01:24,573][106226] Updated weights for policy 0, policy_version 1080501 (0.0006) [2023-12-28 03:01:25,155][106226] Updated weights for policy 0, policy_version 1080511 (0.0006) [2023-12-28 03:01:25,224][106226] Updated weights for policy 0, policy_version 1080521 (0.0006) [2023-12-28 03:01:25,283][106226] Updated weights for policy 0, policy_version 1080531 (0.0008) [2023-12-28 03:01:25,340][106225] Updated weights for policy 1, policy_version 1083220 (0.0009) [2023-12-28 03:01:25,398][106225] Updated weights for policy 1, policy_version 1083230 (0.0008) [2023-12-28 03:01:25,451][106225] Updated weights for policy 1, policy_version 1083240 (0.0008) [2023-12-28 03:01:25,809][106226] Updated weights for policy 0, policy_version 1080541 (0.0007) [2023-12-28 03:01:25,863][106226] Updated weights for policy 0, policy_version 1080551 (0.0005) [2023-12-28 03:01:25,919][106226] Updated weights for policy 0, policy_version 1080561 (0.0005) [2023-12-28 03:01:26,129][106225] Updated weights for policy 1, policy_version 1083250 (0.0010) [2023-12-28 03:01:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 554041344. Throughput: 0: 9646.1, 1: 9681.3. Samples: 554010876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:26,175][105115] Avg episode reward: [(0, '-4.897'), (1, '-4.731')] [2023-12-28 03:01:26,181][106225] Updated weights for policy 1, policy_version 1083260 (0.0008) [2023-12-28 03:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001080568_276684800.pth... [2023-12-28 03:01:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001079416_276389888.pth [2023-12-28 03:01:26,244][106225] Updated weights for policy 1, policy_version 1083270 (0.0010) [2023-12-28 03:01:26,296][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001083280_277364736.pth... [2023-12-28 03:01:26,297][106225] Updated weights for policy 1, policy_version 1083280 (0.0010) [2023-12-28 03:01:26,299][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001082160_277078016.pth [2023-12-28 03:01:26,494][106226] Updated weights for policy 0, policy_version 1080571 (0.0006) [2023-12-28 03:01:26,546][106226] Updated weights for policy 0, policy_version 1080581 (0.0009) [2023-12-28 03:01:26,598][106226] Updated weights for policy 0, policy_version 1080591 (0.0008) [2023-12-28 03:01:27,023][106225] Updated weights for policy 1, policy_version 1083290 (0.0005) [2023-12-28 03:01:27,076][106225] Updated weights for policy 1, policy_version 1083300 (0.0008) [2023-12-28 03:01:27,130][106225] Updated weights for policy 1, policy_version 1083310 (0.0009) [2023-12-28 03:01:27,183][106226] Updated weights for policy 0, policy_version 1080601 (0.0009) [2023-12-28 03:01:27,247][106226] Updated weights for policy 0, policy_version 1080611 (0.0008) [2023-12-28 03:01:27,316][106226] Updated weights for policy 0, policy_version 1080621 (0.0007) [2023-12-28 03:01:27,377][106226] Updated weights for policy 0, policy_version 1080631 (0.0008) [2023-12-28 03:01:27,865][106225] Updated weights for policy 1, policy_version 1083320 (0.0009) [2023-12-28 03:01:27,910][106226] Updated weights for policy 0, policy_version 1080641 (0.0005) [2023-12-28 03:01:27,926][106225] Updated weights for policy 1, policy_version 1083330 (0.0008) [2023-12-28 03:01:27,965][106226] Updated weights for policy 0, policy_version 1080651 (0.0005) [2023-12-28 03:01:27,984][106225] Updated weights for policy 1, policy_version 1083340 (0.0007) [2023-12-28 03:01:28,016][106226] Updated weights for policy 0, policy_version 1080661 (0.0005) [2023-12-28 03:01:28,626][106226] Updated weights for policy 0, policy_version 1080671 (0.0008) [2023-12-28 03:01:28,686][106226] Updated weights for policy 0, policy_version 1080681 (0.0009) [2023-12-28 03:01:28,723][106225] Updated weights for policy 1, policy_version 1083350 (0.0006) [2023-12-28 03:01:28,744][106226] Updated weights for policy 0, policy_version 1080691 (0.0007) [2023-12-28 03:01:28,774][106225] Updated weights for policy 1, policy_version 1083360 (0.0006) [2023-12-28 03:01:28,826][106225] Updated weights for policy 1, policy_version 1083370 (0.0008) [2023-12-28 03:01:29,386][106226] Updated weights for policy 0, policy_version 1080701 (0.0007) [2023-12-28 03:01:29,437][106226] Updated weights for policy 0, policy_version 1080711 (0.0008) [2023-12-28 03:01:29,502][106226] Updated weights for policy 0, policy_version 1080721 (0.0008) [2023-12-28 03:01:29,522][106225] Updated weights for policy 1, policy_version 1083380 (0.0007) [2023-12-28 03:01:29,584][106225] Updated weights for policy 1, policy_version 1083390 (0.0005) [2023-12-28 03:01:29,644][106225] Updated weights for policy 1, policy_version 1083400 (0.0007) [2023-12-28 03:01:30,178][106226] Updated weights for policy 0, policy_version 1080731 (0.0008) [2023-12-28 03:01:30,239][106226] Updated weights for policy 0, policy_version 1080741 (0.0011) [2023-12-28 03:01:30,293][106226] Updated weights for policy 0, policy_version 1080751 (0.0010) [2023-12-28 03:01:30,370][106225] Updated weights for policy 1, policy_version 1083410 (0.0008) [2023-12-28 03:01:30,430][106225] Updated weights for policy 1, policy_version 1083420 (0.0008) [2023-12-28 03:01:30,485][106225] Updated weights for policy 1, policy_version 1083430 (0.0007) [2023-12-28 03:01:30,546][106225] Updated weights for policy 1, policy_version 1083440 (0.0007) [2023-12-28 03:01:31,001][106226] Updated weights for policy 0, policy_version 1080761 (0.0010) [2023-12-28 03:01:31,063][106226] Updated weights for policy 0, policy_version 1080771 (0.0011) [2023-12-28 03:01:31,124][106226] Updated weights for policy 0, policy_version 1080781 (0.0006) [2023-12-28 03:01:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 554139648. Throughput: 0: 9907.5, 1: 9672.0. Samples: 554136740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:31,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.935')] [2023-12-28 03:01:31,185][106226] Updated weights for policy 0, policy_version 1080792 (0.0006) [2023-12-28 03:01:31,326][106225] Updated weights for policy 1, policy_version 1083450 (0.0008) [2023-12-28 03:01:31,393][106225] Updated weights for policy 1, policy_version 1083460 (0.0009) [2023-12-28 03:01:31,445][106225] Updated weights for policy 1, policy_version 1083470 (0.0008) [2023-12-28 03:01:31,841][106226] Updated weights for policy 0, policy_version 1080802 (0.0007) [2023-12-28 03:01:31,892][106226] Updated weights for policy 0, policy_version 1080812 (0.0008) [2023-12-28 03:01:31,945][106226] Updated weights for policy 0, policy_version 1080822 (0.0007) [2023-12-28 03:01:32,215][106225] Updated weights for policy 1, policy_version 1083480 (0.0008) [2023-12-28 03:01:32,279][106225] Updated weights for policy 1, policy_version 1083490 (0.0008) [2023-12-28 03:01:32,335][106225] Updated weights for policy 1, policy_version 1083500 (0.0008) [2023-12-28 03:01:32,697][106226] Updated weights for policy 0, policy_version 1080832 (0.0011) [2023-12-28 03:01:32,749][106226] Updated weights for policy 0, policy_version 1080842 (0.0011) [2023-12-28 03:01:32,807][106226] Updated weights for policy 0, policy_version 1080852 (0.0011) [2023-12-28 03:01:33,070][106225] Updated weights for policy 1, policy_version 1083510 (0.0008) [2023-12-28 03:01:33,114][106225] Updated weights for policy 1, policy_version 1083520 (0.0008) [2023-12-28 03:01:33,171][106225] Updated weights for policy 1, policy_version 1083530 (0.0007) [2023-12-28 03:01:33,534][106226] Updated weights for policy 0, policy_version 1080862 (0.0011) [2023-12-28 03:01:33,579][106226] Updated weights for policy 0, policy_version 1080872 (0.0010) [2023-12-28 03:01:33,621][106226] Updated weights for policy 0, policy_version 1080882 (0.0010) [2023-12-28 03:01:33,879][106225] Updated weights for policy 1, policy_version 1083540 (0.0007) [2023-12-28 03:01:33,940][106225] Updated weights for policy 1, policy_version 1083550 (0.0008) [2023-12-28 03:01:34,004][106225] Updated weights for policy 1, policy_version 1083560 (0.0007) [2023-12-28 03:01:34,334][106226] Updated weights for policy 0, policy_version 1080892 (0.0010) [2023-12-28 03:01:34,392][106226] Updated weights for policy 0, policy_version 1080902 (0.0011) [2023-12-28 03:01:34,452][106226] Updated weights for policy 0, policy_version 1080912 (0.0010) [2023-12-28 03:01:34,671][106225] Updated weights for policy 1, policy_version 1083570 (0.0006) [2023-12-28 03:01:34,737][106225] Updated weights for policy 1, policy_version 1083580 (0.0008) [2023-12-28 03:01:34,799][106225] Updated weights for policy 1, policy_version 1083590 (0.0008) [2023-12-28 03:01:34,860][106225] Updated weights for policy 1, policy_version 1083600 (0.0008) [2023-12-28 03:01:35,164][106226] Updated weights for policy 0, policy_version 1080922 (0.0010) [2023-12-28 03:01:35,214][106226] Updated weights for policy 0, policy_version 1080932 (0.0010) [2023-12-28 03:01:35,257][106226] Updated weights for policy 0, policy_version 1080942 (0.0010) [2023-12-28 03:01:35,303][106226] Updated weights for policy 0, policy_version 1080952 (0.0010) [2023-12-28 03:01:35,602][106225] Updated weights for policy 1, policy_version 1083610 (0.0008) [2023-12-28 03:01:35,673][106225] Updated weights for policy 1, policy_version 1083620 (0.0008) [2023-12-28 03:01:35,725][106225] Updated weights for policy 1, policy_version 1083630 (0.0008) [2023-12-28 03:01:36,046][106226] Updated weights for policy 0, policy_version 1080962 (0.0010) [2023-12-28 03:01:36,104][106226] Updated weights for policy 0, policy_version 1080972 (0.0010) [2023-12-28 03:01:36,169][106226] Updated weights for policy 0, policy_version 1080982 (0.0010) [2023-12-28 03:01:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 554237952. Throughput: 0: 9926.2, 1: 9569.7. Samples: 554252488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:36,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-4.766')] [2023-12-28 03:01:36,458][106225] Updated weights for policy 1, policy_version 1083640 (0.0008) [2023-12-28 03:01:36,521][106225] Updated weights for policy 1, policy_version 1083650 (0.0008) [2023-12-28 03:01:36,586][106225] Updated weights for policy 1, policy_version 1083660 (0.0008) [2023-12-28 03:01:36,854][106226] Updated weights for policy 0, policy_version 1080992 (0.0006) [2023-12-28 03:01:36,917][106226] Updated weights for policy 0, policy_version 1081002 (0.0005) [2023-12-28 03:01:36,968][106226] Updated weights for policy 0, policy_version 1081012 (0.0005) [2023-12-28 03:01:37,247][106225] Updated weights for policy 1, policy_version 1083670 (0.0009) [2023-12-28 03:01:37,297][106225] Updated weights for policy 1, policy_version 1083680 (0.0008) [2023-12-28 03:01:37,349][106225] Updated weights for policy 1, policy_version 1083690 (0.0007) [2023-12-28 03:01:37,551][106226] Updated weights for policy 0, policy_version 1081022 (0.0007) [2023-12-28 03:01:37,603][106226] Updated weights for policy 0, policy_version 1081032 (0.0007) [2023-12-28 03:01:37,653][106226] Updated weights for policy 0, policy_version 1081042 (0.0009) [2023-12-28 03:01:38,104][106225] Updated weights for policy 1, policy_version 1083700 (0.0008) [2023-12-28 03:01:38,153][106225] Updated weights for policy 1, policy_version 1083710 (0.0008) [2023-12-28 03:01:38,206][106225] Updated weights for policy 1, policy_version 1083720 (0.0008) [2023-12-28 03:01:38,358][106226] Updated weights for policy 0, policy_version 1081052 (0.0008) [2023-12-28 03:01:38,420][106226] Updated weights for policy 0, policy_version 1081062 (0.0008) [2023-12-28 03:01:38,483][106226] Updated weights for policy 0, policy_version 1081072 (0.0009) [2023-12-28 03:01:38,923][106225] Updated weights for policy 1, policy_version 1083730 (0.0008) [2023-12-28 03:01:38,981][106225] Updated weights for policy 1, policy_version 1083740 (0.0005) [2023-12-28 03:01:39,042][106225] Updated weights for policy 1, policy_version 1083750 (0.0005) [2023-12-28 03:01:39,110][106225] Updated weights for policy 1, policy_version 1083760 (0.0006) [2023-12-28 03:01:39,175][106226] Updated weights for policy 0, policy_version 1081082 (0.0008) [2023-12-28 03:01:39,240][106226] Updated weights for policy 0, policy_version 1081092 (0.0009) [2023-12-28 03:01:39,304][106226] Updated weights for policy 0, policy_version 1081102 (0.0008) [2023-12-28 03:01:39,374][106226] Updated weights for policy 0, policy_version 1081112 (0.0009) [2023-12-28 03:01:39,827][106225] Updated weights for policy 1, policy_version 1083770 (0.0008) [2023-12-28 03:01:39,898][106225] Updated weights for policy 1, policy_version 1083780 (0.0009) [2023-12-28 03:01:39,967][106225] Updated weights for policy 1, policy_version 1083790 (0.0008) [2023-12-28 03:01:40,186][106226] Updated weights for policy 0, policy_version 1081122 (0.0008) [2023-12-28 03:01:40,255][106226] Updated weights for policy 0, policy_version 1081132 (0.0006) [2023-12-28 03:01:40,322][106226] Updated weights for policy 0, policy_version 1081142 (0.0006) [2023-12-28 03:01:40,665][106225] Updated weights for policy 1, policy_version 1083800 (0.0007) [2023-12-28 03:01:40,716][106225] Updated weights for policy 1, policy_version 1083810 (0.0008) [2023-12-28 03:01:40,772][106225] Updated weights for policy 1, policy_version 1083820 (0.0009) [2023-12-28 03:01:40,888][106226] Updated weights for policy 0, policy_version 1081152 (0.0008) [2023-12-28 03:01:40,954][106226] Updated weights for policy 0, policy_version 1081162 (0.0008) [2023-12-28 03:01:41,012][106226] Updated weights for policy 0, policy_version 1081172 (0.0009) [2023-12-28 03:01:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 554344448. Throughput: 0: 9987.5, 1: 9552.6. Samples: 554312976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:41,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.777')] [2023-12-28 03:01:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001083824_277504000.pth... [2023-12-28 03:01:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001081176_276840448.pth... [2023-12-28 03:01:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001082704_277217280.pth [2023-12-28 03:01:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001079960_276529152.pth [2023-12-28 03:01:41,563][106225] Updated weights for policy 1, policy_version 1083830 (0.0008) [2023-12-28 03:01:41,623][106225] Updated weights for policy 1, policy_version 1083840 (0.0009) [2023-12-28 03:01:41,689][106225] Updated weights for policy 1, policy_version 1083850 (0.0007) [2023-12-28 03:01:41,846][106226] Updated weights for policy 0, policy_version 1081182 (0.0009) [2023-12-28 03:01:41,910][106226] Updated weights for policy 0, policy_version 1081192 (0.0009) [2023-12-28 03:01:41,976][106226] Updated weights for policy 0, policy_version 1081202 (0.0008) [2023-12-28 03:01:42,478][106225] Updated weights for policy 1, policy_version 1083860 (0.0010) [2023-12-28 03:01:42,545][106225] Updated weights for policy 1, policy_version 1083870 (0.0008) [2023-12-28 03:01:42,610][106225] Updated weights for policy 1, policy_version 1083880 (0.0005) [2023-12-28 03:01:42,766][106226] Updated weights for policy 0, policy_version 1081212 (0.0008) [2023-12-28 03:01:42,818][106226] Updated weights for policy 0, policy_version 1081222 (0.0010) [2023-12-28 03:01:42,869][106226] Updated weights for policy 0, policy_version 1081232 (0.0008) [2023-12-28 03:01:43,194][106225] Updated weights for policy 1, policy_version 1083890 (0.0007) [2023-12-28 03:01:43,241][106225] Updated weights for policy 1, policy_version 1083900 (0.0010) [2023-12-28 03:01:43,304][106225] Updated weights for policy 1, policy_version 1083910 (0.0010) [2023-12-28 03:01:43,361][106225] Updated weights for policy 1, policy_version 1083920 (0.0010) [2023-12-28 03:01:43,558][106226] Updated weights for policy 0, policy_version 1081242 (0.0010) [2023-12-28 03:01:43,611][106226] Updated weights for policy 0, policy_version 1081252 (0.0010) [2023-12-28 03:01:43,656][106226] Updated weights for policy 0, policy_version 1081262 (0.0010) [2023-12-28 03:01:43,720][106226] Updated weights for policy 0, policy_version 1081272 (0.0005) [2023-12-28 03:01:43,956][106225] Updated weights for policy 1, policy_version 1083930 (0.0009) [2023-12-28 03:01:44,016][106225] Updated weights for policy 1, policy_version 1083940 (0.0010) [2023-12-28 03:01:44,075][106225] Updated weights for policy 1, policy_version 1083950 (0.0010) [2023-12-28 03:01:44,341][106226] Updated weights for policy 0, policy_version 1081282 (0.0011) [2023-12-28 03:01:44,387][106226] Updated weights for policy 0, policy_version 1081292 (0.0010) [2023-12-28 03:01:44,434][106226] Updated weights for policy 0, policy_version 1081302 (0.0010) [2023-12-28 03:01:44,732][106225] Updated weights for policy 1, policy_version 1083960 (0.0008) [2023-12-28 03:01:44,803][106225] Updated weights for policy 1, policy_version 1083970 (0.0006) [2023-12-28 03:01:44,863][106225] Updated weights for policy 1, policy_version 1083980 (0.0008) [2023-12-28 03:01:45,181][106226] Updated weights for policy 0, policy_version 1081312 (0.0009) [2023-12-28 03:01:45,246][106226] Updated weights for policy 0, policy_version 1081322 (0.0008) [2023-12-28 03:01:45,306][106226] Updated weights for policy 0, policy_version 1081332 (0.0009) [2023-12-28 03:01:45,585][106225] Updated weights for policy 1, policy_version 1083990 (0.0008) [2023-12-28 03:01:45,646][106225] Updated weights for policy 1, policy_version 1084000 (0.0007) [2023-12-28 03:01:45,705][106225] Updated weights for policy 1, policy_version 1084010 (0.0010) [2023-12-28 03:01:45,957][106226] Updated weights for policy 0, policy_version 1081342 (0.0006) [2023-12-28 03:01:46,021][106226] Updated weights for policy 0, policy_version 1081352 (0.0007) [2023-12-28 03:01:46,087][106226] Updated weights for policy 0, policy_version 1081362 (0.0009) [2023-12-28 03:01:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 554442752. Throughput: 0: 9979.2, 1: 9595.9. Samples: 554430680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:46,176][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.898')] [2023-12-28 03:01:46,404][106225] Updated weights for policy 1, policy_version 1084020 (0.0009) [2023-12-28 03:01:46,465][106225] Updated weights for policy 1, policy_version 1084030 (0.0010) [2023-12-28 03:01:46,524][106225] Updated weights for policy 1, policy_version 1084040 (0.0008) [2023-12-28 03:01:46,756][106226] Updated weights for policy 0, policy_version 1081372 (0.0009) [2023-12-28 03:01:46,817][106226] Updated weights for policy 0, policy_version 1081382 (0.0011) [2023-12-28 03:01:46,877][106226] Updated weights for policy 0, policy_version 1081392 (0.0011) [2023-12-28 03:01:47,239][106225] Updated weights for policy 1, policy_version 1084050 (0.0009) [2023-12-28 03:01:47,286][106225] Updated weights for policy 1, policy_version 1084060 (0.0008) [2023-12-28 03:01:47,336][106225] Updated weights for policy 1, policy_version 1084070 (0.0009) [2023-12-28 03:01:47,389][106225] Updated weights for policy 1, policy_version 1084080 (0.0007) [2023-12-28 03:01:47,455][106226] Updated weights for policy 0, policy_version 1081402 (0.0010) [2023-12-28 03:01:47,515][106226] Updated weights for policy 0, policy_version 1081412 (0.0010) [2023-12-28 03:01:47,574][106226] Updated weights for policy 0, policy_version 1081422 (0.0010) [2023-12-28 03:01:47,630][106226] Updated weights for policy 0, policy_version 1081432 (0.0010) [2023-12-28 03:01:48,121][106225] Updated weights for policy 1, policy_version 1084090 (0.0008) [2023-12-28 03:01:48,177][106225] Updated weights for policy 1, policy_version 1084100 (0.0008) [2023-12-28 03:01:48,234][106225] Updated weights for policy 1, policy_version 1084110 (0.0008) [2023-12-28 03:01:48,363][106226] Updated weights for policy 0, policy_version 1081442 (0.0010) [2023-12-28 03:01:48,424][106226] Updated weights for policy 0, policy_version 1081452 (0.0011) [2023-12-28 03:01:48,476][106226] Updated weights for policy 0, policy_version 1081462 (0.0011) [2023-12-28 03:01:48,994][106225] Updated weights for policy 1, policy_version 1084120 (0.0008) [2023-12-28 03:01:49,051][106225] Updated weights for policy 1, policy_version 1084130 (0.0007) [2023-12-28 03:01:49,096][106225] Updated weights for policy 1, policy_version 1084140 (0.0008) [2023-12-28 03:01:49,129][106226] Updated weights for policy 0, policy_version 1081472 (0.0010) [2023-12-28 03:01:49,190][106226] Updated weights for policy 0, policy_version 1081482 (0.0011) [2023-12-28 03:01:49,258][106226] Updated weights for policy 0, policy_version 1081492 (0.0009) [2023-12-28 03:01:49,813][106225] Updated weights for policy 1, policy_version 1084150 (0.0008) [2023-12-28 03:01:49,876][106225] Updated weights for policy 1, policy_version 1084160 (0.0008) [2023-12-28 03:01:49,932][106225] Updated weights for policy 1, policy_version 1084170 (0.0008) [2023-12-28 03:01:50,011][106226] Updated weights for policy 0, policy_version 1081502 (0.0010) [2023-12-28 03:01:50,071][106226] Updated weights for policy 0, policy_version 1081512 (0.0007) [2023-12-28 03:01:50,128][106226] Updated weights for policy 0, policy_version 1081522 (0.0005) [2023-12-28 03:01:50,705][106225] Updated weights for policy 1, policy_version 1084180 (0.0007) [2023-12-28 03:01:50,762][106226] Updated weights for policy 0, policy_version 1081532 (0.0008) [2023-12-28 03:01:50,764][106225] Updated weights for policy 1, policy_version 1084190 (0.0007) [2023-12-28 03:01:50,824][106226] Updated weights for policy 0, policy_version 1081542 (0.0011) [2023-12-28 03:01:50,827][106225] Updated weights for policy 1, policy_version 1084200 (0.0008) [2023-12-28 03:01:50,882][106226] Updated weights for policy 0, policy_version 1081552 (0.0008) [2023-12-28 03:01:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 554541056. Throughput: 0: 10039.8, 1: 9555.6. Samples: 554548660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:51,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-5.045')] [2023-12-28 03:01:51,596][106225] Updated weights for policy 1, policy_version 1084210 (0.0008) [2023-12-28 03:01:51,613][106226] Updated weights for policy 0, policy_version 1081562 (0.0008) [2023-12-28 03:01:51,660][106225] Updated weights for policy 1, policy_version 1084220 (0.0008) [2023-12-28 03:01:51,677][106226] Updated weights for policy 0, policy_version 1081572 (0.0007) [2023-12-28 03:01:51,726][106225] Updated weights for policy 1, policy_version 1084230 (0.0007) [2023-12-28 03:01:51,751][106226] Updated weights for policy 0, policy_version 1081582 (0.0008) [2023-12-28 03:01:51,791][106225] Updated weights for policy 1, policy_version 1084240 (0.0007) [2023-12-28 03:01:51,819][106226] Updated weights for policy 0, policy_version 1081592 (0.0008) [2023-12-28 03:01:52,505][106225] Updated weights for policy 1, policy_version 1084250 (0.0005) [2023-12-28 03:01:52,563][106225] Updated weights for policy 1, policy_version 1084260 (0.0006) [2023-12-28 03:01:52,564][106226] Updated weights for policy 0, policy_version 1081602 (0.0008) [2023-12-28 03:01:52,617][106225] Updated weights for policy 1, policy_version 1084270 (0.0007) [2023-12-28 03:01:52,622][106226] Updated weights for policy 0, policy_version 1081612 (0.0008) [2023-12-28 03:01:52,685][106226] Updated weights for policy 0, policy_version 1081622 (0.0008) [2023-12-28 03:01:53,282][106226] Updated weights for policy 0, policy_version 1081632 (0.0006) [2023-12-28 03:01:53,299][106225] Updated weights for policy 1, policy_version 1084280 (0.0009) [2023-12-28 03:01:53,334][106226] Updated weights for policy 0, policy_version 1081642 (0.0005) [2023-12-28 03:01:53,359][106225] Updated weights for policy 1, policy_version 1084290 (0.0010) [2023-12-28 03:01:53,391][106226] Updated weights for policy 0, policy_version 1081652 (0.0005) [2023-12-28 03:01:53,416][106225] Updated weights for policy 1, policy_version 1084300 (0.0010) [2023-12-28 03:01:54,048][106226] Updated weights for policy 0, policy_version 1081662 (0.0008) [2023-12-28 03:01:54,103][106226] Updated weights for policy 0, policy_version 1081672 (0.0010) [2023-12-28 03:01:54,137][106225] Updated weights for policy 1, policy_version 1084310 (0.0010) [2023-12-28 03:01:54,162][106226] Updated weights for policy 0, policy_version 1081682 (0.0010) [2023-12-28 03:01:54,193][106225] Updated weights for policy 1, policy_version 1084320 (0.0007) [2023-12-28 03:01:54,247][106225] Updated weights for policy 1, policy_version 1084330 (0.0010) [2023-12-28 03:01:54,878][106226] Updated weights for policy 0, policy_version 1081692 (0.0010) [2023-12-28 03:01:54,941][106226] Updated weights for policy 0, policy_version 1081702 (0.0011) [2023-12-28 03:01:54,958][106225] Updated weights for policy 1, policy_version 1084340 (0.0009) [2023-12-28 03:01:54,999][106226] Updated weights for policy 0, policy_version 1081712 (0.0010) [2023-12-28 03:01:55,014][106225] Updated weights for policy 1, policy_version 1084350 (0.0009) [2023-12-28 03:01:55,071][106225] Updated weights for policy 1, policy_version 1084360 (0.0005) [2023-12-28 03:01:55,708][106226] Updated weights for policy 0, policy_version 1081722 (0.0011) [2023-12-28 03:01:55,746][106225] Updated weights for policy 1, policy_version 1084370 (0.0010) [2023-12-28 03:01:55,768][106226] Updated weights for policy 0, policy_version 1081732 (0.0010) [2023-12-28 03:01:55,800][106225] Updated weights for policy 1, policy_version 1084380 (0.0010) [2023-12-28 03:01:55,828][106226] Updated weights for policy 0, policy_version 1081742 (0.0010) [2023-12-28 03:01:55,850][106225] Updated weights for policy 1, policy_version 1084390 (0.0009) [2023-12-28 03:01:55,882][106226] Updated weights for policy 0, policy_version 1081752 (0.0011) [2023-12-28 03:01:55,904][106225] Updated weights for policy 1, policy_version 1084400 (0.0009) [2023-12-28 03:01:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 554639360. Throughput: 0: 10081.9, 1: 9547.4. Samples: 554607184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:01:56,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.640')] [2023-12-28 03:01:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001084400_277651456.pth... [2023-12-28 03:01:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001081752_276987904.pth... [2023-12-28 03:01:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001083280_277364736.pth [2023-12-28 03:01:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001080568_276684800.pth [2023-12-28 03:01:56,612][106226] Updated weights for policy 0, policy_version 1081762 (0.0011) [2023-12-28 03:01:56,631][106225] Updated weights for policy 1, policy_version 1084410 (0.0009) [2023-12-28 03:01:56,667][106226] Updated weights for policy 0, policy_version 1081772 (0.0010) [2023-12-28 03:01:56,691][106225] Updated weights for policy 1, policy_version 1084420 (0.0010) [2023-12-28 03:01:56,721][106226] Updated weights for policy 0, policy_version 1081782 (0.0010) [2023-12-28 03:01:56,749][106225] Updated weights for policy 1, policy_version 1084430 (0.0009) [2023-12-28 03:01:57,306][106225] Updated weights for policy 1, policy_version 1084440 (0.0006) [2023-12-28 03:01:57,371][106225] Updated weights for policy 1, policy_version 1084450 (0.0006) [2023-12-28 03:01:57,427][106225] Updated weights for policy 1, policy_version 1084460 (0.0010) [2023-12-28 03:01:57,432][106226] Updated weights for policy 0, policy_version 1081792 (0.0010) [2023-12-28 03:01:57,488][106226] Updated weights for policy 0, policy_version 1081802 (0.0010) [2023-12-28 03:01:57,544][106226] Updated weights for policy 0, policy_version 1081812 (0.0010) [2023-12-28 03:01:58,021][106225] Updated weights for policy 1, policy_version 1084470 (0.0007) [2023-12-28 03:01:58,079][106225] Updated weights for policy 1, policy_version 1084480 (0.0005) [2023-12-28 03:01:58,137][106225] Updated weights for policy 1, policy_version 1084490 (0.0005) [2023-12-28 03:01:58,256][106226] Updated weights for policy 0, policy_version 1081822 (0.0011) [2023-12-28 03:01:58,312][106226] Updated weights for policy 0, policy_version 1081832 (0.0010) [2023-12-28 03:01:58,378][106226] Updated weights for policy 0, policy_version 1081842 (0.0009) [2023-12-28 03:01:58,937][106225] Updated weights for policy 1, policy_version 1084500 (0.0006) [2023-12-28 03:01:59,001][106225] Updated weights for policy 1, policy_version 1084510 (0.0009) [2023-12-28 03:01:59,059][106225] Updated weights for policy 1, policy_version 1084520 (0.0008) [2023-12-28 03:01:59,151][106226] Updated weights for policy 0, policy_version 1081852 (0.0009) [2023-12-28 03:01:59,221][106226] Updated weights for policy 0, policy_version 1081863 (0.0008) [2023-12-28 03:01:59,284][106226] Updated weights for policy 0, policy_version 1081873 (0.0007) [2023-12-28 03:01:59,758][106225] Updated weights for policy 1, policy_version 1084530 (0.0009) [2023-12-28 03:01:59,817][106225] Updated weights for policy 1, policy_version 1084540 (0.0008) [2023-12-28 03:01:59,876][106225] Updated weights for policy 1, policy_version 1084550 (0.0008) [2023-12-28 03:01:59,949][106225] Updated weights for policy 1, policy_version 1084560 (0.0008) [2023-12-28 03:01:59,990][106226] Updated weights for policy 0, policy_version 1081883 (0.0006) [2023-12-28 03:02:00,042][106226] Updated weights for policy 0, policy_version 1081893 (0.0009) [2023-12-28 03:02:00,100][106226] Updated weights for policy 0, policy_version 1081903 (0.0009) [2023-12-28 03:02:00,550][106225] Updated weights for policy 1, policy_version 1084570 (0.0007) [2023-12-28 03:02:00,607][106225] Updated weights for policy 1, policy_version 1084580 (0.0008) [2023-12-28 03:02:00,667][106225] Updated weights for policy 1, policy_version 1084590 (0.0008) [2023-12-28 03:02:00,896][106226] Updated weights for policy 0, policy_version 1081913 (0.0009) [2023-12-28 03:02:00,959][106226] Updated weights for policy 0, policy_version 1081923 (0.0008) [2023-12-28 03:02:01,018][106226] Updated weights for policy 0, policy_version 1081933 (0.0009) [2023-12-28 03:02:01,082][106226] Updated weights for policy 0, policy_version 1081943 (0.0007) [2023-12-28 03:02:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 554737664. Throughput: 0: 10139.9, 1: 9654.4. Samples: 554725296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:01,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-4.978')] [2023-12-28 03:02:01,367][106225] Updated weights for policy 1, policy_version 1084600 (0.0007) [2023-12-28 03:02:01,423][106225] Updated weights for policy 1, policy_version 1084610 (0.0008) [2023-12-28 03:02:01,477][106225] Updated weights for policy 1, policy_version 1084620 (0.0009) [2023-12-28 03:02:01,744][106226] Updated weights for policy 0, policy_version 1081953 (0.0006) [2023-12-28 03:02:01,810][106226] Updated weights for policy 0, policy_version 1081963 (0.0006) [2023-12-28 03:02:01,872][106226] Updated weights for policy 0, policy_version 1081973 (0.0007) [2023-12-28 03:02:02,258][106225] Updated weights for policy 1, policy_version 1084630 (0.0009) [2023-12-28 03:02:02,317][106225] Updated weights for policy 1, policy_version 1084640 (0.0009) [2023-12-28 03:02:02,385][106225] Updated weights for policy 1, policy_version 1084650 (0.0009) [2023-12-28 03:02:02,543][106226] Updated weights for policy 0, policy_version 1081983 (0.0007) [2023-12-28 03:02:02,603][106226] Updated weights for policy 0, policy_version 1081993 (0.0009) [2023-12-28 03:02:02,664][106226] Updated weights for policy 0, policy_version 1082003 (0.0008) [2023-12-28 03:02:03,057][106225] Updated weights for policy 1, policy_version 1084660 (0.0008) [2023-12-28 03:02:03,104][106225] Updated weights for policy 1, policy_version 1084670 (0.0008) [2023-12-28 03:02:03,151][106225] Updated weights for policy 1, policy_version 1084680 (0.0008) [2023-12-28 03:02:03,380][106226] Updated weights for policy 0, policy_version 1082013 (0.0007) [2023-12-28 03:02:03,431][106226] Updated weights for policy 0, policy_version 1082023 (0.0007) [2023-12-28 03:02:03,490][106226] Updated weights for policy 0, policy_version 1082033 (0.0008) [2023-12-28 03:02:03,850][106225] Updated weights for policy 1, policy_version 1084690 (0.0008) [2023-12-28 03:02:03,908][106225] Updated weights for policy 1, policy_version 1084700 (0.0007) [2023-12-28 03:02:03,972][106225] Updated weights for policy 1, policy_version 1084710 (0.0008) [2023-12-28 03:02:04,032][106225] Updated weights for policy 1, policy_version 1084720 (0.0007) [2023-12-28 03:02:04,298][106226] Updated weights for policy 0, policy_version 1082043 (0.0008) [2023-12-28 03:02:04,359][106226] Updated weights for policy 0, policy_version 1082053 (0.0008) [2023-12-28 03:02:04,420][106226] Updated weights for policy 0, policy_version 1082063 (0.0009) [2023-12-28 03:02:04,684][106225] Updated weights for policy 1, policy_version 1084730 (0.0005) [2023-12-28 03:02:04,739][106225] Updated weights for policy 1, policy_version 1084740 (0.0005) [2023-12-28 03:02:04,792][106225] Updated weights for policy 1, policy_version 1084750 (0.0008) [2023-12-28 03:02:05,111][106226] Updated weights for policy 0, policy_version 1082073 (0.0008) [2023-12-28 03:02:05,164][106226] Updated weights for policy 0, policy_version 1082083 (0.0005) [2023-12-28 03:02:05,219][106226] Updated weights for policy 0, policy_version 1082093 (0.0005) [2023-12-28 03:02:05,269][106226] Updated weights for policy 0, policy_version 1082103 (0.0010) [2023-12-28 03:02:05,356][106225] Updated weights for policy 1, policy_version 1084760 (0.0006) [2023-12-28 03:02:05,408][106225] Updated weights for policy 1, policy_version 1084770 (0.0005) [2023-12-28 03:02:05,466][106225] Updated weights for policy 1, policy_version 1084780 (0.0006) [2023-12-28 03:02:05,846][106226] Updated weights for policy 0, policy_version 1082113 (0.0006) [2023-12-28 03:02:05,894][106226] Updated weights for policy 0, policy_version 1082123 (0.0005) [2023-12-28 03:02:05,950][106226] Updated weights for policy 0, policy_version 1082133 (0.0007) [2023-12-28 03:02:06,008][106225] Updated weights for policy 1, policy_version 1084790 (0.0005) [2023-12-28 03:02:06,071][106225] Updated weights for policy 1, policy_version 1084800 (0.0007) [2023-12-28 03:02:06,145][106225] Updated weights for policy 1, policy_version 1084810 (0.0009) [2023-12-28 03:02:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 554835968. Throughput: 0: 10095.9, 1: 9777.7. Samples: 554847144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:06,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-5.029')] [2023-12-28 03:02:06,650][106226] Updated weights for policy 0, policy_version 1082143 (0.0011) [2023-12-28 03:02:06,696][106225] Updated weights for policy 1, policy_version 1084820 (0.0011) [2023-12-28 03:02:06,717][106226] Updated weights for policy 0, policy_version 1082153 (0.0011) [2023-12-28 03:02:06,755][106225] Updated weights for policy 1, policy_version 1084830 (0.0007) [2023-12-28 03:02:06,783][106226] Updated weights for policy 0, policy_version 1082163 (0.0011) [2023-12-28 03:02:06,824][106225] Updated weights for policy 1, policy_version 1084840 (0.0007) [2023-12-28 03:02:07,349][106225] Updated weights for policy 1, policy_version 1084850 (0.0005) [2023-12-28 03:02:07,411][106225] Updated weights for policy 1, policy_version 1084860 (0.0005) [2023-12-28 03:02:07,477][106225] Updated weights for policy 1, policy_version 1084870 (0.0007) [2023-12-28 03:02:07,488][106226] Updated weights for policy 0, policy_version 1082173 (0.0011) [2023-12-28 03:02:07,535][106225] Updated weights for policy 1, policy_version 1084880 (0.0009) [2023-12-28 03:02:07,542][106226] Updated weights for policy 0, policy_version 1082183 (0.0010) [2023-12-28 03:02:07,604][106226] Updated weights for policy 0, policy_version 1082193 (0.0011) [2023-12-28 03:02:08,099][106225] Updated weights for policy 1, policy_version 1084890 (0.0010) [2023-12-28 03:02:08,148][106225] Updated weights for policy 1, policy_version 1084900 (0.0009) [2023-12-28 03:02:08,196][106225] Updated weights for policy 1, policy_version 1084910 (0.0008) [2023-12-28 03:02:08,291][106226] Updated weights for policy 0, policy_version 1082203 (0.0010) [2023-12-28 03:02:08,366][106226] Updated weights for policy 0, policy_version 1082213 (0.0007) [2023-12-28 03:02:08,435][106226] Updated weights for policy 0, policy_version 1082223 (0.0010) [2023-12-28 03:02:08,900][106225] Updated weights for policy 1, policy_version 1084920 (0.0008) [2023-12-28 03:02:08,965][106225] Updated weights for policy 1, policy_version 1084930 (0.0007) [2023-12-28 03:02:09,021][106225] Updated weights for policy 1, policy_version 1084940 (0.0005) [2023-12-28 03:02:09,135][106226] Updated weights for policy 0, policy_version 1082233 (0.0008) [2023-12-28 03:02:09,199][106226] Updated weights for policy 0, policy_version 1082243 (0.0011) [2023-12-28 03:02:09,264][106226] Updated weights for policy 0, policy_version 1082253 (0.0009) [2023-12-28 03:02:09,328][106226] Updated weights for policy 0, policy_version 1082263 (0.0009) [2023-12-28 03:02:09,742][106225] Updated weights for policy 1, policy_version 1084950 (0.0008) [2023-12-28 03:02:09,805][106225] Updated weights for policy 1, policy_version 1084960 (0.0008) [2023-12-28 03:02:09,877][106225] Updated weights for policy 1, policy_version 1084970 (0.0008) [2023-12-28 03:02:10,129][106226] Updated weights for policy 0, policy_version 1082273 (0.0008) [2023-12-28 03:02:10,189][106226] Updated weights for policy 0, policy_version 1082283 (0.0008) [2023-12-28 03:02:10,248][106226] Updated weights for policy 0, policy_version 1082293 (0.0008) [2023-12-28 03:02:10,646][106225] Updated weights for policy 1, policy_version 1084980 (0.0008) [2023-12-28 03:02:10,708][106225] Updated weights for policy 1, policy_version 1084990 (0.0008) [2023-12-28 03:02:10,763][106225] Updated weights for policy 1, policy_version 1085000 (0.0008) [2023-12-28 03:02:11,000][106226] Updated weights for policy 0, policy_version 1082303 (0.0010) [2023-12-28 03:02:11,081][106226] Updated weights for policy 0, policy_version 1082315 (0.0010) [2023-12-28 03:02:11,155][106226] Updated weights for policy 0, policy_version 1082325 (0.0008) [2023-12-28 03:02:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 554942464. Throughput: 0: 10075.1, 1: 9922.1. Samples: 554910752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:11,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.117')] [2023-12-28 03:02:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001085008_277807104.pth... [2023-12-28 03:02:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001082328_277135360.pth... [2023-12-28 03:02:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001083824_277504000.pth [2023-12-28 03:02:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001081176_276840448.pth [2023-12-28 03:02:11,504][106225] Updated weights for policy 1, policy_version 1085010 (0.0008) [2023-12-28 03:02:11,564][106225] Updated weights for policy 1, policy_version 1085020 (0.0008) [2023-12-28 03:02:11,630][106225] Updated weights for policy 1, policy_version 1085030 (0.0006) [2023-12-28 03:02:11,698][106225] Updated weights for policy 1, policy_version 1085040 (0.0008) [2023-12-28 03:02:12,003][106226] Updated weights for policy 0, policy_version 1082335 (0.0008) [2023-12-28 03:02:12,065][106226] Updated weights for policy 0, policy_version 1082345 (0.0008) [2023-12-28 03:02:12,130][106226] Updated weights for policy 0, policy_version 1082355 (0.0008) [2023-12-28 03:02:12,442][106225] Updated weights for policy 1, policy_version 1085050 (0.0008) [2023-12-28 03:02:12,494][106225] Updated weights for policy 1, policy_version 1085060 (0.0010) [2023-12-28 03:02:12,555][106225] Updated weights for policy 1, policy_version 1085070 (0.0010) [2023-12-28 03:02:12,886][106226] Updated weights for policy 0, policy_version 1082365 (0.0009) [2023-12-28 03:02:12,936][106226] Updated weights for policy 0, policy_version 1082375 (0.0008) [2023-12-28 03:02:12,996][106226] Updated weights for policy 0, policy_version 1082385 (0.0009) [2023-12-28 03:02:13,289][106225] Updated weights for policy 1, policy_version 1085080 (0.0009) [2023-12-28 03:02:13,352][106225] Updated weights for policy 1, policy_version 1085090 (0.0009) [2023-12-28 03:02:13,404][106225] Updated weights for policy 1, policy_version 1085100 (0.0008) [2023-12-28 03:02:13,775][106226] Updated weights for policy 0, policy_version 1082395 (0.0009) [2023-12-28 03:02:13,824][106226] Updated weights for policy 0, policy_version 1082405 (0.0009) [2023-12-28 03:02:13,869][106226] Updated weights for policy 0, policy_version 1082415 (0.0008) [2023-12-28 03:02:13,985][106225] Updated weights for policy 1, policy_version 1085110 (0.0009) [2023-12-28 03:02:14,044][106225] Updated weights for policy 1, policy_version 1085120 (0.0008) [2023-12-28 03:02:14,107][106225] Updated weights for policy 1, policy_version 1085130 (0.0009) [2023-12-28 03:02:14,670][106225] Updated weights for policy 1, policy_version 1085140 (0.0009) [2023-12-28 03:02:14,675][106226] Updated weights for policy 0, policy_version 1082425 (0.0008) [2023-12-28 03:02:14,728][106226] Updated weights for policy 0, policy_version 1082435 (0.0007) [2023-12-28 03:02:14,730][106225] Updated weights for policy 1, policy_version 1085150 (0.0006) [2023-12-28 03:02:14,790][106225] Updated weights for policy 1, policy_version 1085160 (0.0007) [2023-12-28 03:02:14,793][106226] Updated weights for policy 0, policy_version 1082445 (0.0007) [2023-12-28 03:02:14,851][106226] Updated weights for policy 0, policy_version 1082455 (0.0008) [2023-12-28 03:02:15,461][106225] Updated weights for policy 1, policy_version 1085170 (0.0008) [2023-12-28 03:02:15,515][106225] Updated weights for policy 1, policy_version 1085180 (0.0008) [2023-12-28 03:02:15,571][106225] Updated weights for policy 1, policy_version 1085190 (0.0008) [2023-12-28 03:02:15,625][106225] Updated weights for policy 1, policy_version 1085200 (0.0008) [2023-12-28 03:02:15,664][106226] Updated weights for policy 0, policy_version 1082465 (0.0006) [2023-12-28 03:02:15,718][106226] Updated weights for policy 0, policy_version 1082475 (0.0006) [2023-12-28 03:02:15,776][106226] Updated weights for policy 0, policy_version 1082485 (0.0006) [2023-12-28 03:02:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 555032576. Throughput: 0: 9735.0, 1: 9961.5. Samples: 555023084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:16,175][105115] Avg episode reward: [(0, '-4.737'), (1, '-5.009')] [2023-12-28 03:02:16,257][106225] Updated weights for policy 1, policy_version 1085210 (0.0007) [2023-12-28 03:02:16,321][106225] Updated weights for policy 1, policy_version 1085220 (0.0008) [2023-12-28 03:02:16,390][106225] Updated weights for policy 1, policy_version 1085230 (0.0008) [2023-12-28 03:02:16,441][106226] Updated weights for policy 0, policy_version 1082495 (0.0007) [2023-12-28 03:02:16,490][106226] Updated weights for policy 0, policy_version 1082505 (0.0008) [2023-12-28 03:02:16,540][106226] Updated weights for policy 0, policy_version 1082515 (0.0009) [2023-12-28 03:02:16,941][106225] Updated weights for policy 1, policy_version 1085240 (0.0007) [2023-12-28 03:02:16,998][106225] Updated weights for policy 1, policy_version 1085250 (0.0008) [2023-12-28 03:02:17,058][106225] Updated weights for policy 1, policy_version 1085260 (0.0008) [2023-12-28 03:02:17,335][106226] Updated weights for policy 0, policy_version 1082525 (0.0009) [2023-12-28 03:02:17,381][106226] Updated weights for policy 0, policy_version 1082535 (0.0010) [2023-12-28 03:02:17,440][106226] Updated weights for policy 0, policy_version 1082545 (0.0010) [2023-12-28 03:02:17,799][106225] Updated weights for policy 1, policy_version 1085270 (0.0008) [2023-12-28 03:02:17,855][106225] Updated weights for policy 1, policy_version 1085280 (0.0010) [2023-12-28 03:02:17,912][106225] Updated weights for policy 1, policy_version 1085290 (0.0010) [2023-12-28 03:02:18,141][106226] Updated weights for policy 0, policy_version 1082555 (0.0009) [2023-12-28 03:02:18,209][106226] Updated weights for policy 0, policy_version 1082565 (0.0007) [2023-12-28 03:02:18,273][106226] Updated weights for policy 0, policy_version 1082575 (0.0011) [2023-12-28 03:02:18,601][106225] Updated weights for policy 1, policy_version 1085300 (0.0010) [2023-12-28 03:02:18,659][106225] Updated weights for policy 1, policy_version 1085310 (0.0010) [2023-12-28 03:02:18,714][106225] Updated weights for policy 1, policy_version 1085320 (0.0010) [2023-12-28 03:02:18,952][106226] Updated weights for policy 0, policy_version 1082585 (0.0010) [2023-12-28 03:02:19,021][106226] Updated weights for policy 0, policy_version 1082595 (0.0007) [2023-12-28 03:02:19,078][106226] Updated weights for policy 0, policy_version 1082605 (0.0006) [2023-12-28 03:02:19,127][106226] Updated weights for policy 0, policy_version 1082615 (0.0006) [2023-12-28 03:02:19,490][106225] Updated weights for policy 1, policy_version 1085330 (0.0010) [2023-12-28 03:02:19,549][106225] Updated weights for policy 1, policy_version 1085340 (0.0009) [2023-12-28 03:02:19,600][106225] Updated weights for policy 1, policy_version 1085350 (0.0010) [2023-12-28 03:02:19,651][106225] Updated weights for policy 1, policy_version 1085360 (0.0008) [2023-12-28 03:02:19,800][106226] Updated weights for policy 0, policy_version 1082625 (0.0009) [2023-12-28 03:02:19,870][106226] Updated weights for policy 0, policy_version 1082635 (0.0009) [2023-12-28 03:02:19,930][106226] Updated weights for policy 0, policy_version 1082645 (0.0007) [2023-12-28 03:02:20,433][106225] Updated weights for policy 1, policy_version 1085370 (0.0008) [2023-12-28 03:02:20,495][106225] Updated weights for policy 1, policy_version 1085380 (0.0006) [2023-12-28 03:02:20,559][106225] Updated weights for policy 1, policy_version 1085390 (0.0008) [2023-12-28 03:02:20,681][106226] Updated weights for policy 0, policy_version 1082655 (0.0008) [2023-12-28 03:02:20,745][106226] Updated weights for policy 0, policy_version 1082665 (0.0008) [2023-12-28 03:02:20,802][106226] Updated weights for policy 0, policy_version 1082675 (0.0008) [2023-12-28 03:02:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 555130880. Throughput: 0: 9712.6, 1: 10033.5. Samples: 555141064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:21,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.829')] [2023-12-28 03:02:21,310][106225] Updated weights for policy 1, policy_version 1085400 (0.0009) [2023-12-28 03:02:21,377][106225] Updated weights for policy 1, policy_version 1085410 (0.0010) [2023-12-28 03:02:21,437][106225] Updated weights for policy 1, policy_version 1085420 (0.0007) [2023-12-28 03:02:21,615][106226] Updated weights for policy 0, policy_version 1082685 (0.0008) [2023-12-28 03:02:21,682][106226] Updated weights for policy 0, policy_version 1082695 (0.0008) [2023-12-28 03:02:21,745][106226] Updated weights for policy 0, policy_version 1082705 (0.0009) [2023-12-28 03:02:22,087][106225] Updated weights for policy 1, policy_version 1085430 (0.0006) [2023-12-28 03:02:22,141][106225] Updated weights for policy 1, policy_version 1085440 (0.0006) [2023-12-28 03:02:22,193][106225] Updated weights for policy 1, policy_version 1085450 (0.0010) [2023-12-28 03:02:22,568][106226] Updated weights for policy 0, policy_version 1082715 (0.0009) [2023-12-28 03:02:22,637][106226] Updated weights for policy 0, policy_version 1082725 (0.0008) [2023-12-28 03:02:22,703][106226] Updated weights for policy 0, policy_version 1082735 (0.0008) [2023-12-28 03:02:22,907][106225] Updated weights for policy 1, policy_version 1085460 (0.0010) [2023-12-28 03:02:22,973][106225] Updated weights for policy 1, policy_version 1085470 (0.0010) [2023-12-28 03:02:23,037][106225] Updated weights for policy 1, policy_version 1085480 (0.0011) [2023-12-28 03:02:23,428][106226] Updated weights for policy 0, policy_version 1082745 (0.0008) [2023-12-28 03:02:23,492][106226] Updated weights for policy 0, policy_version 1082755 (0.0007) [2023-12-28 03:02:23,550][106226] Updated weights for policy 0, policy_version 1082765 (0.0007) [2023-12-28 03:02:23,602][106226] Updated weights for policy 0, policy_version 1082775 (0.0008) [2023-12-28 03:02:23,694][106225] Updated weights for policy 1, policy_version 1085490 (0.0010) [2023-12-28 03:02:23,741][106225] Updated weights for policy 1, policy_version 1085500 (0.0007) [2023-12-28 03:02:23,789][106225] Updated weights for policy 1, policy_version 1085510 (0.0010) [2023-12-28 03:02:23,842][106225] Updated weights for policy 1, policy_version 1085520 (0.0010) [2023-12-28 03:02:24,345][106226] Updated weights for policy 0, policy_version 1082785 (0.0009) [2023-12-28 03:02:24,394][106226] Updated weights for policy 0, policy_version 1082795 (0.0009) [2023-12-28 03:02:24,438][106225] Updated weights for policy 1, policy_version 1085530 (0.0009) [2023-12-28 03:02:24,445][106226] Updated weights for policy 0, policy_version 1082805 (0.0006) [2023-12-28 03:02:24,491][106225] Updated weights for policy 1, policy_version 1085540 (0.0010) [2023-12-28 03:02:24,547][106225] Updated weights for policy 1, policy_version 1085550 (0.0010) [2023-12-28 03:02:25,198][106226] Updated weights for policy 0, policy_version 1082815 (0.0008) [2023-12-28 03:02:25,249][106226] Updated weights for policy 0, policy_version 1082825 (0.0007) [2023-12-28 03:02:25,250][106225] Updated weights for policy 1, policy_version 1085560 (0.0010) [2023-12-28 03:02:25,307][106225] Updated weights for policy 1, policy_version 1085570 (0.0010) [2023-12-28 03:02:25,312][106226] Updated weights for policy 0, policy_version 1082835 (0.0005) [2023-12-28 03:02:25,363][106225] Updated weights for policy 1, policy_version 1085580 (0.0010) [2023-12-28 03:02:26,044][106225] Updated weights for policy 1, policy_version 1085590 (0.0008) [2023-12-28 03:02:26,062][106226] Updated weights for policy 0, policy_version 1082845 (0.0008) [2023-12-28 03:02:26,096][106225] Updated weights for policy 1, policy_version 1085600 (0.0006) [2023-12-28 03:02:26,121][106226] Updated weights for policy 0, policy_version 1082855 (0.0008) [2023-12-28 03:02:26,149][106225] Updated weights for policy 1, policy_version 1085610 (0.0007) [2023-12-28 03:02:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 555220992. Throughput: 0: 9627.8, 1: 10047.2. Samples: 555198352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:26,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.741')] [2023-12-28 03:02:26,182][106226] Updated weights for policy 0, policy_version 1082865 (0.0007) [2023-12-28 03:02:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001085616_277962752.pth... [2023-12-28 03:02:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001084400_277651456.pth [2023-12-28 03:02:26,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001082872_277274624.pth... [2023-12-28 03:02:26,229][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001081752_276987904.pth [2023-12-28 03:02:26,742][106225] Updated weights for policy 1, policy_version 1085620 (0.0008) [2023-12-28 03:02:26,798][106225] Updated weights for policy 1, policy_version 1085630 (0.0010) [2023-12-28 03:02:26,857][106225] Updated weights for policy 1, policy_version 1085640 (0.0010) [2023-12-28 03:02:26,858][106226] Updated weights for policy 0, policy_version 1082875 (0.0009) [2023-12-28 03:02:26,911][106226] Updated weights for policy 0, policy_version 1082885 (0.0010) [2023-12-28 03:02:26,973][106226] Updated weights for policy 0, policy_version 1082895 (0.0006) [2023-12-28 03:02:27,517][106225] Updated weights for policy 1, policy_version 1085650 (0.0010) [2023-12-28 03:02:27,518][106226] Updated weights for policy 0, policy_version 1082905 (0.0005) [2023-12-28 03:02:27,565][106225] Updated weights for policy 1, policy_version 1085660 (0.0010) [2023-12-28 03:02:27,576][106226] Updated weights for policy 0, policy_version 1082915 (0.0009) [2023-12-28 03:02:27,611][106225] Updated weights for policy 1, policy_version 1085670 (0.0010) [2023-12-28 03:02:27,633][106226] Updated weights for policy 0, policy_version 1082925 (0.0010) [2023-12-28 03:02:27,670][106225] Updated weights for policy 1, policy_version 1085680 (0.0010) [2023-12-28 03:02:27,686][106226] Updated weights for policy 0, policy_version 1082935 (0.0010) [2023-12-28 03:02:28,380][106225] Updated weights for policy 1, policy_version 1085690 (0.0008) [2023-12-28 03:02:28,385][106226] Updated weights for policy 0, policy_version 1082945 (0.0011) [2023-12-28 03:02:28,437][106226] Updated weights for policy 0, policy_version 1082955 (0.0010) [2023-12-28 03:02:28,440][106225] Updated weights for policy 1, policy_version 1085700 (0.0008) [2023-12-28 03:02:28,494][106226] Updated weights for policy 0, policy_version 1082965 (0.0010) [2023-12-28 03:02:28,504][106225] Updated weights for policy 1, policy_version 1085710 (0.0005) [2023-12-28 03:02:29,189][106225] Updated weights for policy 1, policy_version 1085720 (0.0005) [2023-12-28 03:02:29,225][106226] Updated weights for policy 0, policy_version 1082975 (0.0010) [2023-12-28 03:02:29,261][106225] Updated weights for policy 1, policy_version 1085730 (0.0006) [2023-12-28 03:02:29,285][106226] Updated weights for policy 0, policy_version 1082985 (0.0010) [2023-12-28 03:02:29,322][106225] Updated weights for policy 1, policy_version 1085740 (0.0006) [2023-12-28 03:02:29,343][106226] Updated weights for policy 0, policy_version 1082995 (0.0010) [2023-12-28 03:02:29,994][106226] Updated weights for policy 0, policy_version 1083005 (0.0009) [2023-12-28 03:02:30,049][106226] Updated weights for policy 0, policy_version 1083015 (0.0008) [2023-12-28 03:02:30,074][106225] Updated weights for policy 1, policy_version 1085750 (0.0007) [2023-12-28 03:02:30,101][106226] Updated weights for policy 0, policy_version 1083025 (0.0008) [2023-12-28 03:02:30,134][106225] Updated weights for policy 1, policy_version 1085760 (0.0007) [2023-12-28 03:02:30,183][106225] Updated weights for policy 1, policy_version 1085770 (0.0007) [2023-12-28 03:02:30,854][106226] Updated weights for policy 0, policy_version 1083035 (0.0009) [2023-12-28 03:02:30,905][106225] Updated weights for policy 1, policy_version 1085780 (0.0007) [2023-12-28 03:02:30,910][106226] Updated weights for policy 0, policy_version 1083045 (0.0010) [2023-12-28 03:02:30,960][106225] Updated weights for policy 1, policy_version 1085790 (0.0005) [2023-12-28 03:02:30,969][106226] Updated weights for policy 0, policy_version 1083055 (0.0010) [2023-12-28 03:02:31,022][106225] Updated weights for policy 1, policy_version 1085800 (0.0006) [2023-12-28 03:02:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 555335680. Throughput: 0: 9679.6, 1: 10101.2. Samples: 555320812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:31,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-5.161')] [2023-12-28 03:02:31,652][106226] Updated weights for policy 0, policy_version 1083065 (0.0010) [2023-12-28 03:02:31,721][106226] Updated weights for policy 0, policy_version 1083075 (0.0008) [2023-12-28 03:02:31,785][106226] Updated weights for policy 0, policy_version 1083085 (0.0009) [2023-12-28 03:02:31,806][106225] Updated weights for policy 1, policy_version 1085810 (0.0008) [2023-12-28 03:02:31,843][106226] Updated weights for policy 0, policy_version 1083095 (0.0008) [2023-12-28 03:02:31,855][106225] Updated weights for policy 1, policy_version 1085820 (0.0008) [2023-12-28 03:02:31,903][106225] Updated weights for policy 1, policy_version 1085830 (0.0008) [2023-12-28 03:02:31,955][106225] Updated weights for policy 1, policy_version 1085840 (0.0008) [2023-12-28 03:02:32,610][106226] Updated weights for policy 0, policy_version 1083105 (0.0007) [2023-12-28 03:02:32,618][106225] Updated weights for policy 1, policy_version 1085850 (0.0005) [2023-12-28 03:02:32,659][106226] Updated weights for policy 0, policy_version 1083115 (0.0008) [2023-12-28 03:02:32,676][106225] Updated weights for policy 1, policy_version 1085860 (0.0005) [2023-12-28 03:02:32,708][106226] Updated weights for policy 0, policy_version 1083125 (0.0008) [2023-12-28 03:02:32,738][106225] Updated weights for policy 1, policy_version 1085870 (0.0006) [2023-12-28 03:02:33,326][106225] Updated weights for policy 1, policy_version 1085880 (0.0006) [2023-12-28 03:02:33,381][106225] Updated weights for policy 1, policy_version 1085890 (0.0005) [2023-12-28 03:02:33,445][106225] Updated weights for policy 1, policy_version 1085900 (0.0005) [2023-12-28 03:02:33,483][106226] Updated weights for policy 0, policy_version 1083135 (0.0008) [2023-12-28 03:02:33,543][106226] Updated weights for policy 0, policy_version 1083145 (0.0008) [2023-12-28 03:02:33,612][106226] Updated weights for policy 0, policy_version 1083155 (0.0009) [2023-12-28 03:02:33,985][106225] Updated weights for policy 1, policy_version 1085910 (0.0007) [2023-12-28 03:02:34,046][106225] Updated weights for policy 1, policy_version 1085920 (0.0010) [2023-12-28 03:02:34,106][106225] Updated weights for policy 1, policy_version 1085930 (0.0010) [2023-12-28 03:02:34,319][106226] Updated weights for policy 0, policy_version 1083165 (0.0008) [2023-12-28 03:02:34,381][106226] Updated weights for policy 0, policy_version 1083175 (0.0008) [2023-12-28 03:02:34,440][106226] Updated weights for policy 0, policy_version 1083185 (0.0008) [2023-12-28 03:02:34,860][106225] Updated weights for policy 1, policy_version 1085940 (0.0010) [2023-12-28 03:02:34,924][106225] Updated weights for policy 1, policy_version 1085950 (0.0010) [2023-12-28 03:02:34,974][106225] Updated weights for policy 1, policy_version 1085960 (0.0008) [2023-12-28 03:02:35,197][106226] Updated weights for policy 0, policy_version 1083195 (0.0008) [2023-12-28 03:02:35,250][106226] Updated weights for policy 0, policy_version 1083205 (0.0007) [2023-12-28 03:02:35,300][106226] Updated weights for policy 0, policy_version 1083215 (0.0008) [2023-12-28 03:02:35,628][106225] Updated weights for policy 1, policy_version 1085970 (0.0007) [2023-12-28 03:02:35,680][106225] Updated weights for policy 1, policy_version 1085980 (0.0009) [2023-12-28 03:02:35,735][106225] Updated weights for policy 1, policy_version 1085990 (0.0008) [2023-12-28 03:02:35,800][106225] Updated weights for policy 1, policy_version 1086000 (0.0008) [2023-12-28 03:02:36,064][106226] Updated weights for policy 0, policy_version 1083225 (0.0008) [2023-12-28 03:02:36,124][106226] Updated weights for policy 0, policy_version 1083235 (0.0008) [2023-12-28 03:02:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 555425792. Throughput: 0: 9575.6, 1: 10202.4. Samples: 555438668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:36,175][105115] Avg episode reward: [(0, '-4.171'), (1, '-5.021')] [2023-12-28 03:02:36,194][106226] Updated weights for policy 0, policy_version 1083245 (0.0010) [2023-12-28 03:02:36,254][106226] Updated weights for policy 0, policy_version 1083255 (0.0010) [2023-12-28 03:02:36,464][106225] Updated weights for policy 1, policy_version 1086010 (0.0008) [2023-12-28 03:02:36,525][106225] Updated weights for policy 1, policy_version 1086020 (0.0008) [2023-12-28 03:02:36,586][106225] Updated weights for policy 1, policy_version 1086030 (0.0008) [2023-12-28 03:02:36,973][106226] Updated weights for policy 0, policy_version 1083265 (0.0006) [2023-12-28 03:02:37,033][106226] Updated weights for policy 0, policy_version 1083275 (0.0008) [2023-12-28 03:02:37,088][106226] Updated weights for policy 0, policy_version 1083285 (0.0009) [2023-12-28 03:02:37,191][106225] Updated weights for policy 1, policy_version 1086040 (0.0008) [2023-12-28 03:02:37,254][106225] Updated weights for policy 1, policy_version 1086050 (0.0007) [2023-12-28 03:02:37,308][106225] Updated weights for policy 1, policy_version 1086060 (0.0005) [2023-12-28 03:02:37,755][106226] Updated weights for policy 0, policy_version 1083295 (0.0009) [2023-12-28 03:02:37,818][106226] Updated weights for policy 0, policy_version 1083305 (0.0008) [2023-12-28 03:02:37,873][106226] Updated weights for policy 0, policy_version 1083315 (0.0009) [2023-12-28 03:02:37,965][106225] Updated weights for policy 1, policy_version 1086070 (0.0007) [2023-12-28 03:02:38,022][106225] Updated weights for policy 1, policy_version 1086080 (0.0008) [2023-12-28 03:02:38,074][106225] Updated weights for policy 1, policy_version 1086090 (0.0008) [2023-12-28 03:02:38,635][106226] Updated weights for policy 0, policy_version 1083325 (0.0009) [2023-12-28 03:02:38,695][106226] Updated weights for policy 0, policy_version 1083335 (0.0008) [2023-12-28 03:02:38,758][106226] Updated weights for policy 0, policy_version 1083345 (0.0009) [2023-12-28 03:02:38,773][106225] Updated weights for policy 1, policy_version 1086100 (0.0008) [2023-12-28 03:02:38,835][106225] Updated weights for policy 1, policy_version 1086110 (0.0008) [2023-12-28 03:02:38,895][106225] Updated weights for policy 1, policy_version 1086120 (0.0008) [2023-12-28 03:02:39,559][106226] Updated weights for policy 0, policy_version 1083355 (0.0008) [2023-12-28 03:02:39,619][106226] Updated weights for policy 0, policy_version 1083365 (0.0008) [2023-12-28 03:02:39,632][106225] Updated weights for policy 1, policy_version 1086130 (0.0009) [2023-12-28 03:02:39,682][106226] Updated weights for policy 0, policy_version 1083375 (0.0006) [2023-12-28 03:02:39,684][106225] Updated weights for policy 1, policy_version 1086140 (0.0008) [2023-12-28 03:02:39,743][106225] Updated weights for policy 1, policy_version 1086150 (0.0006) [2023-12-28 03:02:39,812][106225] Updated weights for policy 1, policy_version 1086160 (0.0006) [2023-12-28 03:02:40,392][106226] Updated weights for policy 0, policy_version 1083385 (0.0009) [2023-12-28 03:02:40,455][106226] Updated weights for policy 0, policy_version 1083395 (0.0009) [2023-12-28 03:02:40,516][106226] Updated weights for policy 0, policy_version 1083405 (0.0010) [2023-12-28 03:02:40,559][106225] Updated weights for policy 1, policy_version 1086170 (0.0008) [2023-12-28 03:02:40,576][106226] Updated weights for policy 0, policy_version 1083415 (0.0010) [2023-12-28 03:02:40,620][106225] Updated weights for policy 1, policy_version 1086180 (0.0009) [2023-12-28 03:02:40,682][106225] Updated weights for policy 1, policy_version 1086190 (0.0010) [2023-12-28 03:02:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 555524096. Throughput: 0: 9542.0, 1: 10270.9. Samples: 555498760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:41,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.811')] [2023-12-28 03:02:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001083416_277413888.pth... [2023-12-28 03:02:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001086192_278110208.pth... [2023-12-28 03:02:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001082328_277135360.pth [2023-12-28 03:02:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001085008_277807104.pth [2023-12-28 03:02:41,322][106226] Updated weights for policy 0, policy_version 1083425 (0.0008) [2023-12-28 03:02:41,391][106226] Updated weights for policy 0, policy_version 1083435 (0.0009) [2023-12-28 03:02:41,455][106226] Updated weights for policy 0, policy_version 1083445 (0.0008) [2023-12-28 03:02:41,465][106225] Updated weights for policy 1, policy_version 1086200 (0.0009) [2023-12-28 03:02:41,523][106225] Updated weights for policy 1, policy_version 1086210 (0.0008) [2023-12-28 03:02:41,583][106225] Updated weights for policy 1, policy_version 1086220 (0.0009) [2023-12-28 03:02:42,192][106226] Updated weights for policy 0, policy_version 1083455 (0.0008) [2023-12-28 03:02:42,246][106226] Updated weights for policy 0, policy_version 1083465 (0.0007) [2023-12-28 03:02:42,314][106226] Updated weights for policy 0, policy_version 1083475 (0.0008) [2023-12-28 03:02:42,407][106225] Updated weights for policy 1, policy_version 1086230 (0.0008) [2023-12-28 03:02:42,462][106225] Updated weights for policy 1, policy_version 1086240 (0.0008) [2023-12-28 03:02:42,527][106225] Updated weights for policy 1, policy_version 1086250 (0.0008) [2023-12-28 03:02:43,040][106226] Updated weights for policy 0, policy_version 1083485 (0.0008) [2023-12-28 03:02:43,097][106226] Updated weights for policy 0, policy_version 1083495 (0.0008) [2023-12-28 03:02:43,155][106226] Updated weights for policy 0, policy_version 1083505 (0.0010) [2023-12-28 03:02:43,240][106225] Updated weights for policy 1, policy_version 1086260 (0.0007) [2023-12-28 03:02:43,299][106225] Updated weights for policy 1, policy_version 1086270 (0.0005) [2023-12-28 03:02:43,359][106225] Updated weights for policy 1, policy_version 1086280 (0.0005) [2023-12-28 03:02:43,942][106226] Updated weights for policy 0, policy_version 1083515 (0.0009) [2023-12-28 03:02:43,965][106225] Updated weights for policy 1, policy_version 1086290 (0.0005) [2023-12-28 03:02:43,990][106226] Updated weights for policy 0, policy_version 1083525 (0.0007) [2023-12-28 03:02:44,029][106225] Updated weights for policy 1, policy_version 1086300 (0.0007) [2023-12-28 03:02:44,039][106226] Updated weights for policy 0, policy_version 1083535 (0.0007) [2023-12-28 03:02:44,087][106225] Updated weights for policy 1, policy_version 1086310 (0.0007) [2023-12-28 03:02:44,138][106225] Updated weights for policy 1, policy_version 1086320 (0.0008) [2023-12-28 03:02:44,784][106226] Updated weights for policy 0, policy_version 1083545 (0.0006) [2023-12-28 03:02:44,848][106226] Updated weights for policy 0, policy_version 1083555 (0.0007) [2023-12-28 03:02:44,851][106225] Updated weights for policy 1, policy_version 1086330 (0.0008) [2023-12-28 03:02:44,911][106225] Updated weights for policy 1, policy_version 1086340 (0.0008) [2023-12-28 03:02:44,912][106226] Updated weights for policy 0, policy_version 1083565 (0.0007) [2023-12-28 03:02:44,967][106226] Updated weights for policy 0, policy_version 1083575 (0.0007) [2023-12-28 03:02:44,970][106225] Updated weights for policy 1, policy_version 1086350 (0.0008) [2023-12-28 03:02:45,682][106226] Updated weights for policy 0, policy_version 1083585 (0.0006) [2023-12-28 03:02:45,735][106226] Updated weights for policy 0, policy_version 1083595 (0.0005) [2023-12-28 03:02:45,767][106225] Updated weights for policy 1, policy_version 1086360 (0.0006) [2023-12-28 03:02:45,793][106226] Updated weights for policy 0, policy_version 1083605 (0.0008) [2023-12-28 03:02:45,830][106225] Updated weights for policy 1, policy_version 1086370 (0.0006) [2023-12-28 03:02:45,884][106225] Updated weights for policy 1, policy_version 1086380 (0.0008) [2023-12-28 03:02:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 555622400. Throughput: 0: 9507.3, 1: 10184.3. Samples: 555611416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:46,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-4.930')] [2023-12-28 03:02:46,452][106226] Updated weights for policy 0, policy_version 1083615 (0.0007) [2023-12-28 03:02:46,514][106226] Updated weights for policy 0, policy_version 1083625 (0.0005) [2023-12-28 03:02:46,550][106225] Updated weights for policy 1, policy_version 1086390 (0.0007) [2023-12-28 03:02:46,576][106226] Updated weights for policy 0, policy_version 1083635 (0.0006) [2023-12-28 03:02:46,612][106225] Updated weights for policy 1, policy_version 1086400 (0.0008) [2023-12-28 03:02:46,680][106225] Updated weights for policy 1, policy_version 1086410 (0.0008) [2023-12-28 03:02:47,174][106226] Updated weights for policy 0, policy_version 1083645 (0.0007) [2023-12-28 03:02:47,235][106226] Updated weights for policy 0, policy_version 1083655 (0.0009) [2023-12-28 03:02:47,284][106226] Updated weights for policy 0, policy_version 1083665 (0.0007) [2023-12-28 03:02:47,319][106225] Updated weights for policy 1, policy_version 1086420 (0.0009) [2023-12-28 03:02:47,379][106225] Updated weights for policy 1, policy_version 1086430 (0.0010) [2023-12-28 03:02:47,432][106225] Updated weights for policy 1, policy_version 1086440 (0.0010) [2023-12-28 03:02:48,016][106226] Updated weights for policy 0, policy_version 1083675 (0.0010) [2023-12-28 03:02:48,078][106226] Updated weights for policy 0, policy_version 1083685 (0.0010) [2023-12-28 03:02:48,137][106225] Updated weights for policy 1, policy_version 1086450 (0.0009) [2023-12-28 03:02:48,141][106226] Updated weights for policy 0, policy_version 1083695 (0.0010) [2023-12-28 03:02:48,200][106225] Updated weights for policy 1, policy_version 1086460 (0.0005) [2023-12-28 03:02:48,264][106225] Updated weights for policy 1, policy_version 1086470 (0.0005) [2023-12-28 03:02:48,325][106225] Updated weights for policy 1, policy_version 1086480 (0.0006) [2023-12-28 03:02:48,904][106226] Updated weights for policy 0, policy_version 1083705 (0.0010) [2023-12-28 03:02:48,951][106225] Updated weights for policy 1, policy_version 1086490 (0.0010) [2023-12-28 03:02:48,990][106226] Updated weights for policy 0, policy_version 1083715 (0.0006) [2023-12-28 03:02:49,012][106225] Updated weights for policy 1, policy_version 1086500 (0.0010) [2023-12-28 03:02:49,044][106226] Updated weights for policy 0, policy_version 1083725 (0.0005) [2023-12-28 03:02:49,058][106225] Updated weights for policy 1, policy_version 1086510 (0.0010) [2023-12-28 03:02:49,100][106226] Updated weights for policy 0, policy_version 1083735 (0.0006) [2023-12-28 03:02:49,742][106226] Updated weights for policy 0, policy_version 1083745 (0.0006) [2023-12-28 03:02:49,803][106226] Updated weights for policy 0, policy_version 1083755 (0.0008) [2023-12-28 03:02:49,843][106225] Updated weights for policy 1, policy_version 1086520 (0.0010) [2023-12-28 03:02:49,872][106226] Updated weights for policy 0, policy_version 1083765 (0.0009) [2023-12-28 03:02:49,912][106225] Updated weights for policy 1, policy_version 1086530 (0.0009) [2023-12-28 03:02:49,971][106225] Updated weights for policy 1, policy_version 1086540 (0.0008) [2023-12-28 03:02:50,602][106226] Updated weights for policy 0, policy_version 1083775 (0.0008) [2023-12-28 03:02:50,659][106226] Updated weights for policy 0, policy_version 1083785 (0.0009) [2023-12-28 03:02:50,716][106226] Updated weights for policy 0, policy_version 1083795 (0.0008) [2023-12-28 03:02:50,759][106225] Updated weights for policy 1, policy_version 1086550 (0.0008) [2023-12-28 03:02:50,819][106225] Updated weights for policy 1, policy_version 1086560 (0.0008) [2023-12-28 03:02:50,873][106225] Updated weights for policy 1, policy_version 1086570 (0.0009) [2023-12-28 03:02:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 555720704. Throughput: 0: 9501.2, 1: 10092.2. Samples: 555728844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:51,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-4.636')] [2023-12-28 03:02:51,473][106226] Updated weights for policy 0, policy_version 1083805 (0.0009) [2023-12-28 03:02:51,535][106226] Updated weights for policy 0, policy_version 1083815 (0.0008) [2023-12-28 03:02:51,599][106226] Updated weights for policy 0, policy_version 1083825 (0.0006) [2023-12-28 03:02:51,637][106225] Updated weights for policy 1, policy_version 1086580 (0.0008) [2023-12-28 03:02:51,694][106225] Updated weights for policy 1, policy_version 1086590 (0.0008) [2023-12-28 03:02:51,762][106225] Updated weights for policy 1, policy_version 1086600 (0.0009) [2023-12-28 03:02:52,327][106226] Updated weights for policy 0, policy_version 1083835 (0.0008) [2023-12-28 03:02:52,396][106226] Updated weights for policy 0, policy_version 1083845 (0.0007) [2023-12-28 03:02:52,451][106225] Updated weights for policy 1, policy_version 1086610 (0.0007) [2023-12-28 03:02:52,461][106226] Updated weights for policy 0, policy_version 1083855 (0.0007) [2023-12-28 03:02:52,506][106225] Updated weights for policy 1, policy_version 1086620 (0.0008) [2023-12-28 03:02:52,557][106225] Updated weights for policy 1, policy_version 1086630 (0.0008) [2023-12-28 03:02:52,610][106225] Updated weights for policy 1, policy_version 1086640 (0.0008) [2023-12-28 03:02:53,084][106226] Updated weights for policy 0, policy_version 1083865 (0.0008) [2023-12-28 03:02:53,136][106226] Updated weights for policy 0, policy_version 1083875 (0.0008) [2023-12-28 03:02:53,191][106226] Updated weights for policy 0, policy_version 1083885 (0.0007) [2023-12-28 03:02:53,244][106226] Updated weights for policy 0, policy_version 1083895 (0.0007) [2023-12-28 03:02:53,347][106225] Updated weights for policy 1, policy_version 1086650 (0.0010) [2023-12-28 03:02:53,401][106225] Updated weights for policy 1, policy_version 1086660 (0.0010) [2023-12-28 03:02:53,462][106225] Updated weights for policy 1, policy_version 1086670 (0.0007) [2023-12-28 03:02:53,917][106226] Updated weights for policy 0, policy_version 1083905 (0.0010) [2023-12-28 03:02:53,986][106226] Updated weights for policy 0, policy_version 1083915 (0.0011) [2023-12-28 03:02:54,039][106226] Updated weights for policy 0, policy_version 1083925 (0.0010) [2023-12-28 03:02:54,110][106225] Updated weights for policy 1, policy_version 1086680 (0.0006) [2023-12-28 03:02:54,154][106225] Updated weights for policy 1, policy_version 1086690 (0.0007) [2023-12-28 03:02:54,200][106225] Updated weights for policy 1, policy_version 1086700 (0.0007) [2023-12-28 03:02:54,719][106226] Updated weights for policy 0, policy_version 1083935 (0.0010) [2023-12-28 03:02:54,781][106226] Updated weights for policy 0, policy_version 1083945 (0.0009) [2023-12-28 03:02:54,841][106226] Updated weights for policy 0, policy_version 1083955 (0.0005) [2023-12-28 03:02:54,871][106225] Updated weights for policy 1, policy_version 1086710 (0.0006) [2023-12-28 03:02:54,938][106225] Updated weights for policy 1, policy_version 1086720 (0.0006) [2023-12-28 03:02:55,003][106225] Updated weights for policy 1, policy_version 1086730 (0.0006) [2023-12-28 03:02:55,458][106226] Updated weights for policy 0, policy_version 1083965 (0.0005) [2023-12-28 03:02:55,512][106226] Updated weights for policy 0, policy_version 1083975 (0.0005) [2023-12-28 03:02:55,566][106226] Updated weights for policy 0, policy_version 1083985 (0.0005) [2023-12-28 03:02:55,591][106225] Updated weights for policy 1, policy_version 1086740 (0.0010) [2023-12-28 03:02:55,640][106225] Updated weights for policy 1, policy_version 1086750 (0.0010) [2023-12-28 03:02:55,687][106225] Updated weights for policy 1, policy_version 1086760 (0.0010) [2023-12-28 03:02:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 555819008. Throughput: 0: 9520.2, 1: 9973.0. Samples: 555787944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:02:56,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-4.858')] [2023-12-28 03:02:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001083992_277561344.pth... [2023-12-28 03:02:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001086768_278257664.pth... [2023-12-28 03:02:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001082872_277274624.pth [2023-12-28 03:02:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001085616_277962752.pth [2023-12-28 03:02:56,226][106226] Updated weights for policy 0, policy_version 1083995 (0.0006) [2023-12-28 03:02:56,285][106226] Updated weights for policy 0, policy_version 1084005 (0.0009) [2023-12-28 03:02:56,338][106225] Updated weights for policy 1, policy_version 1086770 (0.0008) [2023-12-28 03:02:56,347][106226] Updated weights for policy 0, policy_version 1084015 (0.0008) [2023-12-28 03:02:56,388][106225] Updated weights for policy 1, policy_version 1086780 (0.0008) [2023-12-28 03:02:56,438][106225] Updated weights for policy 1, policy_version 1086790 (0.0005) [2023-12-28 03:02:56,500][106225] Updated weights for policy 1, policy_version 1086800 (0.0007) [2023-12-28 03:02:56,987][106226] Updated weights for policy 0, policy_version 1084025 (0.0008) [2023-12-28 03:02:57,052][106226] Updated weights for policy 0, policy_version 1084035 (0.0006) [2023-12-28 03:02:57,105][106226] Updated weights for policy 0, policy_version 1084045 (0.0005) [2023-12-28 03:02:57,161][106226] Updated weights for policy 0, policy_version 1084055 (0.0005) [2023-12-28 03:02:57,245][106225] Updated weights for policy 1, policy_version 1086810 (0.0010) [2023-12-28 03:02:57,310][106225] Updated weights for policy 1, policy_version 1086820 (0.0010) [2023-12-28 03:02:57,374][106225] Updated weights for policy 1, policy_version 1086830 (0.0010) [2023-12-28 03:02:57,736][106226] Updated weights for policy 0, policy_version 1084065 (0.0008) [2023-12-28 03:02:57,792][106226] Updated weights for policy 0, policy_version 1084075 (0.0011) [2023-12-28 03:02:57,852][106226] Updated weights for policy 0, policy_version 1084085 (0.0010) [2023-12-28 03:02:57,963][106225] Updated weights for policy 1, policy_version 1086840 (0.0010) [2023-12-28 03:02:58,019][106225] Updated weights for policy 1, policy_version 1086850 (0.0010) [2023-12-28 03:02:58,068][106225] Updated weights for policy 1, policy_version 1086860 (0.0010) [2023-12-28 03:02:58,513][106226] Updated weights for policy 0, policy_version 1084095 (0.0010) [2023-12-28 03:02:58,581][106226] Updated weights for policy 0, policy_version 1084105 (0.0011) [2023-12-28 03:02:58,637][106226] Updated weights for policy 0, policy_version 1084115 (0.0010) [2023-12-28 03:02:58,847][106225] Updated weights for policy 1, policy_version 1086870 (0.0009) [2023-12-28 03:02:58,915][106225] Updated weights for policy 1, policy_version 1086880 (0.0010) [2023-12-28 03:02:58,990][106225] Updated weights for policy 1, policy_version 1086890 (0.0008) [2023-12-28 03:02:59,467][106226] Updated weights for policy 0, policy_version 1084125 (0.0008) [2023-12-28 03:02:59,525][106226] Updated weights for policy 0, policy_version 1084135 (0.0008) [2023-12-28 03:02:59,589][106226] Updated weights for policy 0, policy_version 1084145 (0.0007) [2023-12-28 03:02:59,738][106225] Updated weights for policy 1, policy_version 1086900 (0.0007) [2023-12-28 03:02:59,804][106225] Updated weights for policy 1, policy_version 1086910 (0.0007) [2023-12-28 03:02:59,866][106225] Updated weights for policy 1, policy_version 1086920 (0.0011) [2023-12-28 03:03:00,285][106226] Updated weights for policy 0, policy_version 1084155 (0.0007) [2023-12-28 03:03:00,355][106226] Updated weights for policy 0, policy_version 1084165 (0.0010) [2023-12-28 03:03:00,418][106226] Updated weights for policy 0, policy_version 1084175 (0.0007) [2023-12-28 03:03:00,475][106225] Updated weights for policy 1, policy_version 1086930 (0.0010) [2023-12-28 03:03:00,545][106225] Updated weights for policy 1, policy_version 1086940 (0.0006) [2023-12-28 03:03:00,610][106225] Updated weights for policy 1, policy_version 1086950 (0.0006) [2023-12-28 03:03:00,672][106225] Updated weights for policy 1, policy_version 1086960 (0.0005) [2023-12-28 03:03:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 555917312. Throughput: 0: 9706.5, 1: 10020.6. Samples: 555910804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:03:01,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.927')] [2023-12-28 03:03:01,187][106226] Updated weights for policy 0, policy_version 1084185 (0.0008) [2023-12-28 03:03:01,238][106225] Updated weights for policy 1, policy_version 1086970 (0.0006) [2023-12-28 03:03:01,243][106226] Updated weights for policy 0, policy_version 1084195 (0.0007) [2023-12-28 03:03:01,301][106225] Updated weights for policy 1, policy_version 1086980 (0.0007) [2023-12-28 03:03:01,311][106226] Updated weights for policy 0, policy_version 1084205 (0.0006) [2023-12-28 03:03:01,364][106225] Updated weights for policy 1, policy_version 1086990 (0.0008) [2023-12-28 03:03:01,381][106226] Updated weights for policy 0, policy_version 1084215 (0.0007) [2023-12-28 03:03:02,007][106225] Updated weights for policy 1, policy_version 1087000 (0.0006) [2023-12-28 03:03:02,068][106225] Updated weights for policy 1, policy_version 1087010 (0.0005) [2023-12-28 03:03:02,129][106225] Updated weights for policy 1, policy_version 1087020 (0.0007) [2023-12-28 03:03:02,215][106226] Updated weights for policy 0, policy_version 1084225 (0.0010) [2023-12-28 03:03:02,281][106226] Updated weights for policy 0, policy_version 1084235 (0.0011) [2023-12-28 03:03:02,345][106226] Updated weights for policy 0, policy_version 1084245 (0.0011) [2023-12-28 03:03:02,830][106225] Updated weights for policy 1, policy_version 1087030 (0.0007) [2023-12-28 03:03:02,880][106225] Updated weights for policy 1, policy_version 1087040 (0.0009) [2023-12-28 03:03:02,934][106225] Updated weights for policy 1, policy_version 1087051 (0.0011) [2023-12-28 03:03:03,031][106226] Updated weights for policy 0, policy_version 1084255 (0.0009) [2023-12-28 03:03:03,084][106226] Updated weights for policy 0, policy_version 1084266 (0.0008) [2023-12-28 03:03:03,139][106226] Updated weights for policy 0, policy_version 1084276 (0.0005) [2023-12-28 03:03:03,680][106225] Updated weights for policy 1, policy_version 1087061 (0.0008) [2023-12-28 03:03:03,735][106225] Updated weights for policy 1, policy_version 1087071 (0.0008) [2023-12-28 03:03:03,777][106226] Updated weights for policy 0, policy_version 1084286 (0.0006) [2023-12-28 03:03:03,779][106225] Updated weights for policy 1, policy_version 1087081 (0.0006) [2023-12-28 03:03:03,829][106226] Updated weights for policy 0, policy_version 1084296 (0.0006) [2023-12-28 03:03:03,896][106226] Updated weights for policy 0, policy_version 1084306 (0.0008) [2023-12-28 03:03:04,546][106225] Updated weights for policy 1, policy_version 1087091 (0.0006) [2023-12-28 03:03:04,604][106225] Updated weights for policy 1, policy_version 1087101 (0.0009) [2023-12-28 03:03:04,635][106226] Updated weights for policy 0, policy_version 1084316 (0.0007) [2023-12-28 03:03:04,660][106225] Updated weights for policy 1, policy_version 1087111 (0.0008) [2023-12-28 03:03:04,689][106226] Updated weights for policy 0, policy_version 1084326 (0.0005) [2023-12-28 03:03:04,744][106226] Updated weights for policy 0, policy_version 1084336 (0.0005) [2023-12-28 03:03:05,323][106226] Updated weights for policy 0, policy_version 1084346 (0.0006) [2023-12-28 03:03:05,373][106226] Updated weights for policy 0, policy_version 1084356 (0.0006) [2023-12-28 03:03:05,428][106226] Updated weights for policy 0, policy_version 1084366 (0.0005) [2023-12-28 03:03:05,447][106225] Updated weights for policy 1, policy_version 1087121 (0.0008) [2023-12-28 03:03:05,479][106226] Updated weights for policy 0, policy_version 1084376 (0.0005) [2023-12-28 03:03:05,509][106225] Updated weights for policy 1, policy_version 1087131 (0.0008) [2023-12-28 03:03:05,559][106225] Updated weights for policy 1, policy_version 1087141 (0.0009) [2023-12-28 03:03:05,615][106225] Updated weights for policy 1, policy_version 1087151 (0.0008) [2023-12-28 03:03:06,122][106226] Updated weights for policy 0, policy_version 1084386 (0.0011) [2023-12-28 03:03:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 556015616. Throughput: 0: 9753.1, 1: 10007.1. Samples: 556030276. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:06,176][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.979')] [2023-12-28 03:03:06,187][106226] Updated weights for policy 0, policy_version 1084396 (0.0011) [2023-12-28 03:03:06,252][106226] Updated weights for policy 0, policy_version 1084406 (0.0011) [2023-12-28 03:03:06,388][106225] Updated weights for policy 1, policy_version 1087161 (0.0007) [2023-12-28 03:03:06,450][106225] Updated weights for policy 1, policy_version 1087171 (0.0008) [2023-12-28 03:03:06,510][106225] Updated weights for policy 1, policy_version 1087181 (0.0008) [2023-12-28 03:03:06,957][106226] Updated weights for policy 0, policy_version 1084416 (0.0011) [2023-12-28 03:03:07,012][106226] Updated weights for policy 0, policy_version 1084426 (0.0011) [2023-12-28 03:03:07,069][106226] Updated weights for policy 0, policy_version 1084436 (0.0011) [2023-12-28 03:03:07,176][106225] Updated weights for policy 1, policy_version 1087191 (0.0006) [2023-12-28 03:03:07,237][106225] Updated weights for policy 1, policy_version 1087201 (0.0006) [2023-12-28 03:03:07,291][106225] Updated weights for policy 1, policy_version 1087211 (0.0009) [2023-12-28 03:03:07,773][106226] Updated weights for policy 0, policy_version 1084446 (0.0007) [2023-12-28 03:03:07,820][106226] Updated weights for policy 0, policy_version 1084456 (0.0007) [2023-12-28 03:03:07,878][106226] Updated weights for policy 0, policy_version 1084466 (0.0008) [2023-12-28 03:03:07,973][106225] Updated weights for policy 1, policy_version 1087221 (0.0010) [2023-12-28 03:03:08,035][106225] Updated weights for policy 1, policy_version 1087231 (0.0009) [2023-12-28 03:03:08,091][106225] Updated weights for policy 1, policy_version 1087241 (0.0010) [2023-12-28 03:03:08,535][106226] Updated weights for policy 0, policy_version 1084476 (0.0008) [2023-12-28 03:03:08,600][106226] Updated weights for policy 0, policy_version 1084486 (0.0009) [2023-12-28 03:03:08,662][106226] Updated weights for policy 0, policy_version 1084496 (0.0008) [2023-12-28 03:03:08,757][106225] Updated weights for policy 1, policy_version 1087251 (0.0010) [2023-12-28 03:03:08,817][106225] Updated weights for policy 1, policy_version 1087261 (0.0008) [2023-12-28 03:03:08,877][106225] Updated weights for policy 1, policy_version 1087271 (0.0008) [2023-12-28 03:03:09,427][106226] Updated weights for policy 0, policy_version 1084506 (0.0008) [2023-12-28 03:03:09,480][106226] Updated weights for policy 0, policy_version 1084516 (0.0006) [2023-12-28 03:03:09,544][106226] Updated weights for policy 0, policy_version 1084526 (0.0007) [2023-12-28 03:03:09,589][106225] Updated weights for policy 1, policy_version 1087281 (0.0008) [2023-12-28 03:03:09,612][106226] Updated weights for policy 0, policy_version 1084536 (0.0009) [2023-12-28 03:03:09,647][106225] Updated weights for policy 1, policy_version 1087291 (0.0006) [2023-12-28 03:03:09,709][106225] Updated weights for policy 1, policy_version 1087301 (0.0006) [2023-12-28 03:03:09,770][106225] Updated weights for policy 1, policy_version 1087311 (0.0009) [2023-12-28 03:03:10,346][106226] Updated weights for policy 0, policy_version 1084546 (0.0008) [2023-12-28 03:03:10,401][106225] Updated weights for policy 1, policy_version 1087321 (0.0007) [2023-12-28 03:03:10,411][106226] Updated weights for policy 0, policy_version 1084556 (0.0007) [2023-12-28 03:03:10,458][106225] Updated weights for policy 1, policy_version 1087331 (0.0006) [2023-12-28 03:03:10,474][106226] Updated weights for policy 0, policy_version 1084566 (0.0007) [2023-12-28 03:03:10,520][106225] Updated weights for policy 1, policy_version 1087341 (0.0008) [2023-12-28 03:03:11,102][106225] Updated weights for policy 1, policy_version 1087351 (0.0008) [2023-12-28 03:03:11,172][106225] Updated weights for policy 1, policy_version 1087361 (0.0009) [2023-12-28 03:03:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 556113920. Throughput: 0: 9805.6, 1: 10012.4. Samples: 556090160. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:11,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.586')] [2023-12-28 03:03:11,227][106226] Updated weights for policy 0, policy_version 1084576 (0.0008) [2023-12-28 03:03:11,234][106225] Updated weights for policy 1, policy_version 1087371 (0.0009) [2023-12-28 03:03:11,270][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001087376_278413312.pth... [2023-12-28 03:03:11,274][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001086192_278110208.pth [2023-12-28 03:03:11,295][106226] Updated weights for policy 0, policy_version 1084586 (0.0008) [2023-12-28 03:03:11,389][106226] Updated weights for policy 0, policy_version 1084596 (0.0009) [2023-12-28 03:03:11,422][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001084600_277716992.pth... [2023-12-28 03:03:11,428][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001083416_277413888.pth [2023-12-28 03:03:12,033][106225] Updated weights for policy 1, policy_version 1087381 (0.0008) [2023-12-28 03:03:12,094][106225] Updated weights for policy 1, policy_version 1087391 (0.0008) [2023-12-28 03:03:12,153][106225] Updated weights for policy 1, policy_version 1087401 (0.0007) [2023-12-28 03:03:12,188][106226] Updated weights for policy 0, policy_version 1084606 (0.0008) [2023-12-28 03:03:12,252][106226] Updated weights for policy 0, policy_version 1084616 (0.0008) [2023-12-28 03:03:12,314][106226] Updated weights for policy 0, policy_version 1084626 (0.0008) [2023-12-28 03:03:12,934][106225] Updated weights for policy 1, policy_version 1087411 (0.0006) [2023-12-28 03:03:12,994][106225] Updated weights for policy 1, policy_version 1087421 (0.0007) [2023-12-28 03:03:13,031][106226] Updated weights for policy 0, policy_version 1084636 (0.0009) [2023-12-28 03:03:13,048][106225] Updated weights for policy 1, policy_version 1087431 (0.0006) [2023-12-28 03:03:13,094][106226] Updated weights for policy 0, policy_version 1084646 (0.0007) [2023-12-28 03:03:13,165][106226] Updated weights for policy 0, policy_version 1084656 (0.0006) [2023-12-28 03:03:13,694][106225] Updated weights for policy 1, policy_version 1087441 (0.0006) [2023-12-28 03:03:13,748][106226] Updated weights for policy 0, policy_version 1084666 (0.0006) [2023-12-28 03:03:13,752][106225] Updated weights for policy 1, policy_version 1087451 (0.0007) [2023-12-28 03:03:13,812][106226] Updated weights for policy 0, policy_version 1084676 (0.0011) [2023-12-28 03:03:13,815][106225] Updated weights for policy 1, policy_version 1087461 (0.0005) [2023-12-28 03:03:13,871][106225] Updated weights for policy 1, policy_version 1087471 (0.0005) [2023-12-28 03:03:13,871][106226] Updated weights for policy 0, policy_version 1084686 (0.0010) [2023-12-28 03:03:13,935][106226] Updated weights for policy 0, policy_version 1084696 (0.0010) [2023-12-28 03:03:14,507][106225] Updated weights for policy 1, policy_version 1087481 (0.0009) [2023-12-28 03:03:14,558][106225] Updated weights for policy 1, policy_version 1087491 (0.0007) [2023-12-28 03:03:14,564][106226] Updated weights for policy 0, policy_version 1084706 (0.0010) [2023-12-28 03:03:14,613][106225] Updated weights for policy 1, policy_version 1087501 (0.0006) [2023-12-28 03:03:14,627][106226] Updated weights for policy 0, policy_version 1084716 (0.0010) [2023-12-28 03:03:14,689][106226] Updated weights for policy 0, policy_version 1084726 (0.0010) [2023-12-28 03:03:15,355][106225] Updated weights for policy 1, policy_version 1087511 (0.0009) [2023-12-28 03:03:15,408][106226] Updated weights for policy 0, policy_version 1084736 (0.0011) [2023-12-28 03:03:15,413][106225] Updated weights for policy 1, policy_version 1087521 (0.0010) [2023-12-28 03:03:15,462][106226] Updated weights for policy 0, policy_version 1084746 (0.0010) [2023-12-28 03:03:15,473][106225] Updated weights for policy 1, policy_version 1087531 (0.0009) [2023-12-28 03:03:15,523][106226] Updated weights for policy 0, policy_version 1084756 (0.0011) [2023-12-28 03:03:16,153][106225] Updated weights for policy 1, policy_version 1087541 (0.0008) [2023-12-28 03:03:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 556212224. Throughput: 0: 9755.7, 1: 9961.2. Samples: 556208076. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:16,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.855')] [2023-12-28 03:03:16,204][106225] Updated weights for policy 1, policy_version 1087551 (0.0008) [2023-12-28 03:03:16,250][106226] Updated weights for policy 0, policy_version 1084766 (0.0006) [2023-12-28 03:03:16,257][106225] Updated weights for policy 1, policy_version 1087561 (0.0007) [2023-12-28 03:03:16,312][106226] Updated weights for policy 0, policy_version 1084776 (0.0005) [2023-12-28 03:03:16,375][106226] Updated weights for policy 0, policy_version 1084786 (0.0006) [2023-12-28 03:03:17,014][106225] Updated weights for policy 1, policy_version 1087571 (0.0008) [2023-12-28 03:03:17,016][106226] Updated weights for policy 0, policy_version 1084796 (0.0005) [2023-12-28 03:03:17,073][106225] Updated weights for policy 1, policy_version 1087581 (0.0007) [2023-12-28 03:03:17,075][106226] Updated weights for policy 0, policy_version 1084806 (0.0007) [2023-12-28 03:03:17,130][106225] Updated weights for policy 1, policy_version 1087591 (0.0006) [2023-12-28 03:03:17,132][106226] Updated weights for policy 0, policy_version 1084816 (0.0006) [2023-12-28 03:03:17,739][106225] Updated weights for policy 1, policy_version 1087601 (0.0005) [2023-12-28 03:03:17,755][106226] Updated weights for policy 0, policy_version 1084826 (0.0008) [2023-12-28 03:03:17,793][106225] Updated weights for policy 1, policy_version 1087611 (0.0006) [2023-12-28 03:03:17,810][106226] Updated weights for policy 0, policy_version 1084836 (0.0007) [2023-12-28 03:03:17,851][106225] Updated weights for policy 1, policy_version 1087621 (0.0006) [2023-12-28 03:03:17,869][106226] Updated weights for policy 0, policy_version 1084846 (0.0007) [2023-12-28 03:03:17,908][106225] Updated weights for policy 1, policy_version 1087631 (0.0007) [2023-12-28 03:03:17,919][106226] Updated weights for policy 0, policy_version 1084856 (0.0006) [2023-12-28 03:03:18,537][106225] Updated weights for policy 1, policy_version 1087641 (0.0008) [2023-12-28 03:03:18,595][106225] Updated weights for policy 1, policy_version 1087651 (0.0007) [2023-12-28 03:03:18,652][106225] Updated weights for policy 1, policy_version 1087661 (0.0005) [2023-12-28 03:03:18,686][106226] Updated weights for policy 0, policy_version 1084866 (0.0008) [2023-12-28 03:03:18,754][106226] Updated weights for policy 0, policy_version 1084876 (0.0009) [2023-12-28 03:03:18,815][106226] Updated weights for policy 0, policy_version 1084886 (0.0009) [2023-12-28 03:03:19,316][106225] Updated weights for policy 1, policy_version 1087671 (0.0008) [2023-12-28 03:03:19,381][106225] Updated weights for policy 1, policy_version 1087681 (0.0008) [2023-12-28 03:03:19,440][106225] Updated weights for policy 1, policy_version 1087691 (0.0008) [2023-12-28 03:03:19,536][106226] Updated weights for policy 0, policy_version 1084896 (0.0009) [2023-12-28 03:03:19,593][106226] Updated weights for policy 0, policy_version 1084906 (0.0008) [2023-12-28 03:03:19,659][106226] Updated weights for policy 0, policy_version 1084916 (0.0008) [2023-12-28 03:03:20,220][106225] Updated weights for policy 1, policy_version 1087701 (0.0009) [2023-12-28 03:03:20,279][106225] Updated weights for policy 1, policy_version 1087711 (0.0009) [2023-12-28 03:03:20,339][106225] Updated weights for policy 1, policy_version 1087721 (0.0009) [2023-12-28 03:03:20,397][106226] Updated weights for policy 0, policy_version 1084926 (0.0008) [2023-12-28 03:03:20,457][106226] Updated weights for policy 0, policy_version 1084936 (0.0007) [2023-12-28 03:03:20,517][106226] Updated weights for policy 0, policy_version 1084946 (0.0008) [2023-12-28 03:03:21,029][106225] Updated weights for policy 1, policy_version 1087731 (0.0007) [2023-12-28 03:03:21,096][106225] Updated weights for policy 1, policy_version 1087741 (0.0008) [2023-12-28 03:03:21,164][106225] Updated weights for policy 1, policy_version 1087751 (0.0009) [2023-12-28 03:03:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 556310528. Throughput: 0: 9816.5, 1: 9920.4. Samples: 556326824. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:21,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.983')] [2023-12-28 03:03:21,202][106226] Updated weights for policy 0, policy_version 1084956 (0.0007) [2023-12-28 03:03:21,267][106226] Updated weights for policy 0, policy_version 1084966 (0.0008) [2023-12-28 03:03:21,332][106226] Updated weights for policy 0, policy_version 1084976 (0.0009) [2023-12-28 03:03:21,929][106225] Updated weights for policy 1, policy_version 1087761 (0.0009) [2023-12-28 03:03:21,989][106225] Updated weights for policy 1, policy_version 1087771 (0.0008) [2023-12-28 03:03:22,048][106225] Updated weights for policy 1, policy_version 1087781 (0.0008) [2023-12-28 03:03:22,105][106225] Updated weights for policy 1, policy_version 1087791 (0.0008) [2023-12-28 03:03:22,144][106226] Updated weights for policy 0, policy_version 1084986 (0.0009) [2023-12-28 03:03:22,204][106226] Updated weights for policy 0, policy_version 1084996 (0.0006) [2023-12-28 03:03:22,261][106226] Updated weights for policy 0, policy_version 1085006 (0.0007) [2023-12-28 03:03:22,319][106226] Updated weights for policy 0, policy_version 1085016 (0.0007) [2023-12-28 03:03:22,883][106225] Updated weights for policy 1, policy_version 1087801 (0.0009) [2023-12-28 03:03:22,945][106225] Updated weights for policy 1, policy_version 1087811 (0.0009) [2023-12-28 03:03:23,005][106225] Updated weights for policy 1, policy_version 1087821 (0.0009) [2023-12-28 03:03:23,045][106226] Updated weights for policy 0, policy_version 1085026 (0.0007) [2023-12-28 03:03:23,113][106226] Updated weights for policy 0, policy_version 1085036 (0.0008) [2023-12-28 03:03:23,177][106226] Updated weights for policy 0, policy_version 1085046 (0.0009) [2023-12-28 03:03:23,665][106225] Updated weights for policy 1, policy_version 1087831 (0.0006) [2023-12-28 03:03:23,713][106225] Updated weights for policy 1, policy_version 1087841 (0.0005) [2023-12-28 03:03:23,783][106225] Updated weights for policy 1, policy_version 1087851 (0.0005) [2023-12-28 03:03:23,948][106226] Updated weights for policy 0, policy_version 1085056 (0.0009) [2023-12-28 03:03:24,013][106226] Updated weights for policy 0, policy_version 1085066 (0.0009) [2023-12-28 03:03:24,080][106226] Updated weights for policy 0, policy_version 1085076 (0.0006) [2023-12-28 03:03:24,278][106225] Updated weights for policy 1, policy_version 1087861 (0.0005) [2023-12-28 03:03:24,324][106225] Updated weights for policy 1, policy_version 1087871 (0.0005) [2023-12-28 03:03:24,386][106225] Updated weights for policy 1, policy_version 1087881 (0.0005) [2023-12-28 03:03:24,835][106226] Updated weights for policy 0, policy_version 1085086 (0.0008) [2023-12-28 03:03:24,895][106226] Updated weights for policy 0, policy_version 1085096 (0.0008) [2023-12-28 03:03:24,961][106226] Updated weights for policy 0, policy_version 1085106 (0.0008) [2023-12-28 03:03:25,032][106225] Updated weights for policy 1, policy_version 1087891 (0.0007) [2023-12-28 03:03:25,086][106225] Updated weights for policy 1, policy_version 1087901 (0.0008) [2023-12-28 03:03:25,149][106225] Updated weights for policy 1, policy_version 1087911 (0.0009) [2023-12-28 03:03:25,650][106226] Updated weights for policy 0, policy_version 1085116 (0.0009) [2023-12-28 03:03:25,706][106226] Updated weights for policy 0, policy_version 1085126 (0.0010) [2023-12-28 03:03:25,768][106226] Updated weights for policy 0, policy_version 1085136 (0.0009) [2023-12-28 03:03:25,789][106225] Updated weights for policy 1, policy_version 1087921 (0.0010) [2023-12-28 03:03:25,844][106225] Updated weights for policy 1, policy_version 1087931 (0.0008) [2023-12-28 03:03:25,898][106225] Updated weights for policy 1, policy_version 1087941 (0.0005) [2023-12-28 03:03:25,954][106225] Updated weights for policy 1, policy_version 1087951 (0.0005) [2023-12-28 03:03:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 556417024. Throughput: 0: 9775.0, 1: 9852.6. Samples: 556382004. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:26,176][105115] Avg episode reward: [(0, '-4.672'), (1, '-5.129')] [2023-12-28 03:03:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001087952_278560768.pth... [2023-12-28 03:03:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001085144_277856256.pth... [2023-12-28 03:03:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001083992_277561344.pth [2023-12-28 03:03:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001086768_278257664.pth [2023-12-28 03:03:26,351][106226] Updated weights for policy 0, policy_version 1085146 (0.0006) [2023-12-28 03:03:26,401][106226] Updated weights for policy 0, policy_version 1085156 (0.0010) [2023-12-28 03:03:26,458][106226] Updated weights for policy 0, policy_version 1085166 (0.0010) [2023-12-28 03:03:26,519][106226] Updated weights for policy 0, policy_version 1085176 (0.0007) [2023-12-28 03:03:26,572][106225] Updated weights for policy 1, policy_version 1087961 (0.0005) [2023-12-28 03:03:26,630][106225] Updated weights for policy 1, policy_version 1087971 (0.0007) [2023-12-28 03:03:26,690][106225] Updated weights for policy 1, policy_version 1087981 (0.0008) [2023-12-28 03:03:27,194][106226] Updated weights for policy 0, policy_version 1085186 (0.0009) [2023-12-28 03:03:27,253][106226] Updated weights for policy 0, policy_version 1085196 (0.0010) [2023-12-28 03:03:27,282][106225] Updated weights for policy 1, policy_version 1087991 (0.0006) [2023-12-28 03:03:27,307][106226] Updated weights for policy 0, policy_version 1085206 (0.0010) [2023-12-28 03:03:27,340][106225] Updated weights for policy 1, policy_version 1088001 (0.0007) [2023-12-28 03:03:27,402][106225] Updated weights for policy 1, policy_version 1088011 (0.0007) [2023-12-28 03:03:27,929][106226] Updated weights for policy 0, policy_version 1085216 (0.0005) [2023-12-28 03:03:27,994][106226] Updated weights for policy 0, policy_version 1085226 (0.0006) [2023-12-28 03:03:28,057][106226] Updated weights for policy 0, policy_version 1085236 (0.0005) [2023-12-28 03:03:28,178][106225] Updated weights for policy 1, policy_version 1088021 (0.0008) [2023-12-28 03:03:28,238][106225] Updated weights for policy 1, policy_version 1088031 (0.0009) [2023-12-28 03:03:28,297][106225] Updated weights for policy 1, policy_version 1088041 (0.0008) [2023-12-28 03:03:28,705][106226] Updated weights for policy 0, policy_version 1085246 (0.0009) [2023-12-28 03:03:28,770][106226] Updated weights for policy 0, policy_version 1085256 (0.0011) [2023-12-28 03:03:28,838][106226] Updated weights for policy 0, policy_version 1085266 (0.0011) [2023-12-28 03:03:28,988][106225] Updated weights for policy 1, policy_version 1088051 (0.0007) [2023-12-28 03:03:29,050][106225] Updated weights for policy 1, policy_version 1088061 (0.0005) [2023-12-28 03:03:29,116][106225] Updated weights for policy 1, policy_version 1088071 (0.0005) [2023-12-28 03:03:29,529][106226] Updated weights for policy 0, policy_version 1085276 (0.0009) [2023-12-28 03:03:29,592][106226] Updated weights for policy 0, policy_version 1085286 (0.0005) [2023-12-28 03:03:29,651][106226] Updated weights for policy 0, policy_version 1085296 (0.0005) [2023-12-28 03:03:29,766][106225] Updated weights for policy 1, policy_version 1088081 (0.0007) [2023-12-28 03:03:29,822][106225] Updated weights for policy 1, policy_version 1088091 (0.0010) [2023-12-28 03:03:29,885][106225] Updated weights for policy 1, policy_version 1088101 (0.0007) [2023-12-28 03:03:29,950][106225] Updated weights for policy 1, policy_version 1088111 (0.0007) [2023-12-28 03:03:30,293][106226] Updated weights for policy 0, policy_version 1085306 (0.0007) [2023-12-28 03:03:30,352][106226] Updated weights for policy 0, policy_version 1085316 (0.0008) [2023-12-28 03:03:30,416][106226] Updated weights for policy 0, policy_version 1085326 (0.0005) [2023-12-28 03:03:30,468][106226] Updated weights for policy 0, policy_version 1085336 (0.0005) [2023-12-28 03:03:30,715][106225] Updated weights for policy 1, policy_version 1088121 (0.0008) [2023-12-28 03:03:30,775][106225] Updated weights for policy 1, policy_version 1088131 (0.0009) [2023-12-28 03:03:30,827][106225] Updated weights for policy 1, policy_version 1088141 (0.0008) [2023-12-28 03:03:31,134][106226] Updated weights for policy 0, policy_version 1085346 (0.0008) [2023-12-28 03:03:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 556515328. Throughput: 0: 9910.8, 1: 10016.4. Samples: 556508144. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:31,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.960')] [2023-12-28 03:03:31,201][106226] Updated weights for policy 0, policy_version 1085356 (0.0008) [2023-12-28 03:03:31,265][106226] Updated weights for policy 0, policy_version 1085366 (0.0009) [2023-12-28 03:03:31,536][106225] Updated weights for policy 1, policy_version 1088151 (0.0008) [2023-12-28 03:03:31,591][106225] Updated weights for policy 1, policy_version 1088161 (0.0008) [2023-12-28 03:03:31,653][106225] Updated weights for policy 1, policy_version 1088171 (0.0009) [2023-12-28 03:03:32,041][106226] Updated weights for policy 0, policy_version 1085376 (0.0008) [2023-12-28 03:03:32,105][106226] Updated weights for policy 0, policy_version 1085386 (0.0008) [2023-12-28 03:03:32,166][106226] Updated weights for policy 0, policy_version 1085396 (0.0009) [2023-12-28 03:03:32,379][106225] Updated weights for policy 1, policy_version 1088181 (0.0009) [2023-12-28 03:03:32,437][106225] Updated weights for policy 1, policy_version 1088191 (0.0008) [2023-12-28 03:03:32,498][106225] Updated weights for policy 1, policy_version 1088201 (0.0007) [2023-12-28 03:03:32,924][106226] Updated weights for policy 0, policy_version 1085406 (0.0008) [2023-12-28 03:03:32,968][106226] Updated weights for policy 0, policy_version 1085416 (0.0008) [2023-12-28 03:03:33,013][106226] Updated weights for policy 0, policy_version 1085426 (0.0009) [2023-12-28 03:03:33,216][106225] Updated weights for policy 1, policy_version 1088211 (0.0008) [2023-12-28 03:03:33,263][106225] Updated weights for policy 1, policy_version 1088221 (0.0008) [2023-12-28 03:03:33,314][106225] Updated weights for policy 1, policy_version 1088231 (0.0008) [2023-12-28 03:03:33,751][106226] Updated weights for policy 0, policy_version 1085436 (0.0008) [2023-12-28 03:03:33,800][106226] Updated weights for policy 0, policy_version 1085446 (0.0008) [2023-12-28 03:03:33,846][106226] Updated weights for policy 0, policy_version 1085456 (0.0008) [2023-12-28 03:03:34,029][106225] Updated weights for policy 1, policy_version 1088241 (0.0008) [2023-12-28 03:03:34,078][106225] Updated weights for policy 1, policy_version 1088251 (0.0008) [2023-12-28 03:03:34,146][106225] Updated weights for policy 1, policy_version 1088261 (0.0009) [2023-12-28 03:03:34,205][106225] Updated weights for policy 1, policy_version 1088271 (0.0009) [2023-12-28 03:03:34,643][106226] Updated weights for policy 0, policy_version 1085466 (0.0008) [2023-12-28 03:03:34,705][106226] Updated weights for policy 0, policy_version 1085476 (0.0009) [2023-12-28 03:03:34,772][106226] Updated weights for policy 0, policy_version 1085486 (0.0008) [2023-12-28 03:03:34,836][106226] Updated weights for policy 0, policy_version 1085496 (0.0007) [2023-12-28 03:03:34,959][106225] Updated weights for policy 1, policy_version 1088281 (0.0009) [2023-12-28 03:03:35,018][106225] Updated weights for policy 1, policy_version 1088291 (0.0008) [2023-12-28 03:03:35,077][106225] Updated weights for policy 1, policy_version 1088301 (0.0009) [2023-12-28 03:03:35,547][106226] Updated weights for policy 0, policy_version 1085506 (0.0009) [2023-12-28 03:03:35,594][106226] Updated weights for policy 0, policy_version 1085516 (0.0009) [2023-12-28 03:03:35,639][106226] Updated weights for policy 0, policy_version 1085526 (0.0008) [2023-12-28 03:03:35,712][106225] Updated weights for policy 1, policy_version 1088311 (0.0005) [2023-12-28 03:03:35,774][106225] Updated weights for policy 1, policy_version 1088321 (0.0005) [2023-12-28 03:03:35,838][106225] Updated weights for policy 1, policy_version 1088331 (0.0005) [2023-12-28 03:03:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 556613632. Throughput: 0: 9868.2, 1: 10018.3. Samples: 556623736. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:36,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.942')] [2023-12-28 03:03:36,339][106226] Updated weights for policy 0, policy_version 1085536 (0.0006) [2023-12-28 03:03:36,409][106226] Updated weights for policy 0, policy_version 1085546 (0.0007) [2023-12-28 03:03:36,427][106225] Updated weights for policy 1, policy_version 1088341 (0.0007) [2023-12-28 03:03:36,471][106226] Updated weights for policy 0, policy_version 1085556 (0.0006) [2023-12-28 03:03:36,476][106225] Updated weights for policy 1, policy_version 1088351 (0.0008) [2023-12-28 03:03:36,542][106225] Updated weights for policy 1, policy_version 1088361 (0.0008) [2023-12-28 03:03:37,120][106226] Updated weights for policy 0, policy_version 1085566 (0.0008) [2023-12-28 03:03:37,171][106226] Updated weights for policy 0, policy_version 1085576 (0.0008) [2023-12-28 03:03:37,224][106226] Updated weights for policy 0, policy_version 1085586 (0.0008) [2023-12-28 03:03:37,307][106225] Updated weights for policy 1, policy_version 1088371 (0.0009) [2023-12-28 03:03:37,378][106225] Updated weights for policy 1, policy_version 1088381 (0.0010) [2023-12-28 03:03:37,440][106225] Updated weights for policy 1, policy_version 1088391 (0.0008) [2023-12-28 03:03:37,910][106226] Updated weights for policy 0, policy_version 1085596 (0.0007) [2023-12-28 03:03:37,980][106226] Updated weights for policy 0, policy_version 1085606 (0.0005) [2023-12-28 03:03:38,038][106226] Updated weights for policy 0, policy_version 1085616 (0.0006) [2023-12-28 03:03:38,128][106225] Updated weights for policy 1, policy_version 1088401 (0.0007) [2023-12-28 03:03:38,184][106225] Updated weights for policy 1, policy_version 1088411 (0.0008) [2023-12-28 03:03:38,234][106225] Updated weights for policy 1, policy_version 1088421 (0.0008) [2023-12-28 03:03:38,291][106225] Updated weights for policy 1, policy_version 1088431 (0.0006) [2023-12-28 03:03:38,699][106226] Updated weights for policy 0, policy_version 1085626 (0.0008) [2023-12-28 03:03:38,763][106226] Updated weights for policy 0, policy_version 1085636 (0.0008) [2023-12-28 03:03:38,825][106226] Updated weights for policy 0, policy_version 1085646 (0.0007) [2023-12-28 03:03:38,887][106226] Updated weights for policy 0, policy_version 1085656 (0.0010) [2023-12-28 03:03:39,006][106225] Updated weights for policy 1, policy_version 1088441 (0.0008) [2023-12-28 03:03:39,062][106225] Updated weights for policy 1, policy_version 1088451 (0.0008) [2023-12-28 03:03:39,120][106225] Updated weights for policy 1, policy_version 1088461 (0.0008) [2023-12-28 03:03:39,576][106226] Updated weights for policy 0, policy_version 1085666 (0.0009) [2023-12-28 03:03:39,637][106226] Updated weights for policy 0, policy_version 1085676 (0.0007) [2023-12-28 03:03:39,705][106226] Updated weights for policy 0, policy_version 1085686 (0.0005) [2023-12-28 03:03:39,890][106225] Updated weights for policy 1, policy_version 1088471 (0.0009) [2023-12-28 03:03:39,958][106225] Updated weights for policy 1, policy_version 1088481 (0.0008) [2023-12-28 03:03:40,025][106225] Updated weights for policy 1, policy_version 1088491 (0.0008) [2023-12-28 03:03:40,480][106226] Updated weights for policy 0, policy_version 1085696 (0.0009) [2023-12-28 03:03:40,555][106226] Updated weights for policy 0, policy_version 1085706 (0.0010) [2023-12-28 03:03:40,616][106226] Updated weights for policy 0, policy_version 1085716 (0.0009) [2023-12-28 03:03:40,705][106225] Updated weights for policy 1, policy_version 1088501 (0.0008) [2023-12-28 03:03:40,755][106225] Updated weights for policy 1, policy_version 1088511 (0.0009) [2023-12-28 03:03:40,803][106225] Updated weights for policy 1, policy_version 1088521 (0.0008) [2023-12-28 03:03:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 556711936. Throughput: 0: 9889.9, 1: 10040.9. Samples: 556684828. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:41,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.726')] [2023-12-28 03:03:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001085720_278003712.pth... [2023-12-28 03:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001088528_278708224.pth... [2023-12-28 03:03:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001084600_277716992.pth [2023-12-28 03:03:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001087376_278413312.pth [2023-12-28 03:03:41,389][106226] Updated weights for policy 0, policy_version 1085726 (0.0008) [2023-12-28 03:03:41,460][106226] Updated weights for policy 0, policy_version 1085736 (0.0008) [2023-12-28 03:03:41,519][106226] Updated weights for policy 0, policy_version 1085746 (0.0008) [2023-12-28 03:03:41,606][106225] Updated weights for policy 1, policy_version 1088531 (0.0008) [2023-12-28 03:03:41,678][106225] Updated weights for policy 1, policy_version 1088541 (0.0008) [2023-12-28 03:03:41,753][106225] Updated weights for policy 1, policy_version 1088551 (0.0009) [2023-12-28 03:03:42,372][106226] Updated weights for policy 0, policy_version 1085756 (0.0009) [2023-12-28 03:03:42,431][106226] Updated weights for policy 0, policy_version 1085766 (0.0009) [2023-12-28 03:03:42,488][106226] Updated weights for policy 0, policy_version 1085776 (0.0009) [2023-12-28 03:03:42,660][106225] Updated weights for policy 1, policy_version 1088561 (0.0009) [2023-12-28 03:03:42,724][106225] Updated weights for policy 1, policy_version 1088571 (0.0008) [2023-12-28 03:03:42,777][106225] Updated weights for policy 1, policy_version 1088581 (0.0008) [2023-12-28 03:03:42,832][106225] Updated weights for policy 1, policy_version 1088591 (0.0008) [2023-12-28 03:03:43,218][106226] Updated weights for policy 0, policy_version 1085786 (0.0009) [2023-12-28 03:03:43,281][106226] Updated weights for policy 0, policy_version 1085796 (0.0011) [2023-12-28 03:03:43,348][106226] Updated weights for policy 0, policy_version 1085806 (0.0010) [2023-12-28 03:03:43,404][106226] Updated weights for policy 0, policy_version 1085816 (0.0005) [2023-12-28 03:03:43,589][106225] Updated weights for policy 1, policy_version 1088601 (0.0006) [2023-12-28 03:03:43,651][106225] Updated weights for policy 1, policy_version 1088611 (0.0005) [2023-12-28 03:03:43,721][106225] Updated weights for policy 1, policy_version 1088621 (0.0005) [2023-12-28 03:03:43,940][106226] Updated weights for policy 0, policy_version 1085826 (0.0011) [2023-12-28 03:03:44,006][106226] Updated weights for policy 0, policy_version 1085836 (0.0010) [2023-12-28 03:03:44,062][106226] Updated weights for policy 0, policy_version 1085846 (0.0009) [2023-12-28 03:03:44,234][106225] Updated weights for policy 1, policy_version 1088631 (0.0007) [2023-12-28 03:03:44,290][106225] Updated weights for policy 1, policy_version 1088641 (0.0005) [2023-12-28 03:03:44,345][106225] Updated weights for policy 1, policy_version 1088651 (0.0009) [2023-12-28 03:03:44,721][106226] Updated weights for policy 0, policy_version 1085856 (0.0009) [2023-12-28 03:03:44,776][106226] Updated weights for policy 0, policy_version 1085866 (0.0010) [2023-12-28 03:03:44,843][106226] Updated weights for policy 0, policy_version 1085876 (0.0009) [2023-12-28 03:03:44,961][106225] Updated weights for policy 1, policy_version 1088661 (0.0008) [2023-12-28 03:03:45,025][106225] Updated weights for policy 1, policy_version 1088671 (0.0010) [2023-12-28 03:03:45,093][106225] Updated weights for policy 1, policy_version 1088681 (0.0011) [2023-12-28 03:03:45,500][106226] Updated weights for policy 0, policy_version 1085886 (0.0007) [2023-12-28 03:03:45,567][106226] Updated weights for policy 0, policy_version 1085896 (0.0005) [2023-12-28 03:03:45,619][106226] Updated weights for policy 0, policy_version 1085906 (0.0008) [2023-12-28 03:03:45,762][106225] Updated weights for policy 1, policy_version 1088691 (0.0010) [2023-12-28 03:03:45,819][106225] Updated weights for policy 1, policy_version 1088701 (0.0010) [2023-12-28 03:03:45,886][106225] Updated weights for policy 1, policy_version 1088711 (0.0007) [2023-12-28 03:03:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 556810240. Throughput: 0: 9792.8, 1: 9954.6. Samples: 556799436. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:46,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-5.043')] [2023-12-28 03:03:46,236][106226] Updated weights for policy 0, policy_version 1085916 (0.0008) [2023-12-28 03:03:46,303][106226] Updated weights for policy 0, policy_version 1085926 (0.0008) [2023-12-28 03:03:46,367][106226] Updated weights for policy 0, policy_version 1085936 (0.0010) [2023-12-28 03:03:46,472][106225] Updated weights for policy 1, policy_version 1088721 (0.0009) [2023-12-28 03:03:46,532][106225] Updated weights for policy 1, policy_version 1088731 (0.0005) [2023-12-28 03:03:46,600][106225] Updated weights for policy 1, policy_version 1088741 (0.0005) [2023-12-28 03:03:46,662][106225] Updated weights for policy 1, policy_version 1088751 (0.0005) [2023-12-28 03:03:46,998][106226] Updated weights for policy 0, policy_version 1085946 (0.0009) [2023-12-28 03:03:47,055][106226] Updated weights for policy 0, policy_version 1085956 (0.0010) [2023-12-28 03:03:47,117][106226] Updated weights for policy 0, policy_version 1085966 (0.0009) [2023-12-28 03:03:47,173][106226] Updated weights for policy 0, policy_version 1085976 (0.0008) [2023-12-28 03:03:47,217][106225] Updated weights for policy 1, policy_version 1088761 (0.0008) [2023-12-28 03:03:47,274][106225] Updated weights for policy 1, policy_version 1088771 (0.0009) [2023-12-28 03:03:47,328][106225] Updated weights for policy 1, policy_version 1088781 (0.0009) [2023-12-28 03:03:47,788][106226] Updated weights for policy 0, policy_version 1085986 (0.0009) [2023-12-28 03:03:47,848][106226] Updated weights for policy 0, policy_version 1085996 (0.0008) [2023-12-28 03:03:47,904][106226] Updated weights for policy 0, policy_version 1086006 (0.0009) [2023-12-28 03:03:48,043][106225] Updated weights for policy 1, policy_version 1088791 (0.0006) [2023-12-28 03:03:48,100][106225] Updated weights for policy 1, policy_version 1088801 (0.0007) [2023-12-28 03:03:48,163][106225] Updated weights for policy 1, policy_version 1088811 (0.0008) [2023-12-28 03:03:48,712][106226] Updated weights for policy 0, policy_version 1086016 (0.0009) [2023-12-28 03:03:48,779][106226] Updated weights for policy 0, policy_version 1086026 (0.0007) [2023-12-28 03:03:48,844][106226] Updated weights for policy 0, policy_version 1086036 (0.0006) [2023-12-28 03:03:48,848][106225] Updated weights for policy 1, policy_version 1088821 (0.0007) [2023-12-28 03:03:48,919][106225] Updated weights for policy 1, policy_version 1088831 (0.0006) [2023-12-28 03:03:48,987][106225] Updated weights for policy 1, policy_version 1088841 (0.0005) [2023-12-28 03:03:49,552][106226] Updated weights for policy 0, policy_version 1086046 (0.0007) [2023-12-28 03:03:49,619][106226] Updated weights for policy 0, policy_version 1086056 (0.0007) [2023-12-28 03:03:49,684][106226] Updated weights for policy 0, policy_version 1086066 (0.0007) [2023-12-28 03:03:49,693][106225] Updated weights for policy 1, policy_version 1088851 (0.0007) [2023-12-28 03:03:49,750][106225] Updated weights for policy 1, policy_version 1088861 (0.0010) [2023-12-28 03:03:49,806][106225] Updated weights for policy 1, policy_version 1088871 (0.0010) [2023-12-28 03:03:50,368][106226] Updated weights for policy 0, policy_version 1086076 (0.0008) [2023-12-28 03:03:50,433][106226] Updated weights for policy 0, policy_version 1086086 (0.0007) [2023-12-28 03:03:50,488][106226] Updated weights for policy 0, policy_version 1086096 (0.0005) [2023-12-28 03:03:50,541][106225] Updated weights for policy 1, policy_version 1088881 (0.0009) [2023-12-28 03:03:50,611][106225] Updated weights for policy 1, policy_version 1088891 (0.0009) [2023-12-28 03:03:50,680][106225] Updated weights for policy 1, policy_version 1088901 (0.0008) [2023-12-28 03:03:50,738][106225] Updated weights for policy 1, policy_version 1088911 (0.0008) [2023-12-28 03:03:51,157][106226] Updated weights for policy 0, policy_version 1086106 (0.0006) [2023-12-28 03:03:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 556908544. Throughput: 0: 9825.3, 1: 9986.4. Samples: 556921800. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:51,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.880')] [2023-12-28 03:03:51,214][106226] Updated weights for policy 0, policy_version 1086116 (0.0008) [2023-12-28 03:03:51,283][106226] Updated weights for policy 0, policy_version 1086126 (0.0009) [2023-12-28 03:03:51,350][106226] Updated weights for policy 0, policy_version 1086136 (0.0007) [2023-12-28 03:03:51,459][106225] Updated weights for policy 1, policy_version 1088921 (0.0007) [2023-12-28 03:03:51,516][106225] Updated weights for policy 1, policy_version 1088931 (0.0008) [2023-12-28 03:03:51,571][106225] Updated weights for policy 1, policy_version 1088941 (0.0009) [2023-12-28 03:03:52,043][106226] Updated weights for policy 0, policy_version 1086146 (0.0009) [2023-12-28 03:03:52,095][106226] Updated weights for policy 0, policy_version 1086156 (0.0006) [2023-12-28 03:03:52,152][106226] Updated weights for policy 0, policy_version 1086166 (0.0005) [2023-12-28 03:03:52,300][106225] Updated weights for policy 1, policy_version 1088951 (0.0008) [2023-12-28 03:03:52,357][106225] Updated weights for policy 1, policy_version 1088961 (0.0008) [2023-12-28 03:03:52,427][106225] Updated weights for policy 1, policy_version 1088971 (0.0009) [2023-12-28 03:03:52,829][106226] Updated weights for policy 0, policy_version 1086176 (0.0008) [2023-12-28 03:03:52,895][106226] Updated weights for policy 0, policy_version 1086186 (0.0009) [2023-12-28 03:03:52,954][106226] Updated weights for policy 0, policy_version 1086196 (0.0009) [2023-12-28 03:03:53,195][106225] Updated weights for policy 1, policy_version 1088981 (0.0009) [2023-12-28 03:03:53,259][106225] Updated weights for policy 1, policy_version 1088991 (0.0008) [2023-12-28 03:03:53,323][106225] Updated weights for policy 1, policy_version 1089001 (0.0008) [2023-12-28 03:03:53,668][106226] Updated weights for policy 0, policy_version 1086206 (0.0008) [2023-12-28 03:03:53,724][106226] Updated weights for policy 0, policy_version 1086216 (0.0009) [2023-12-28 03:03:53,782][106226] Updated weights for policy 0, policy_version 1086226 (0.0008) [2023-12-28 03:03:54,029][106225] Updated weights for policy 1, policy_version 1089011 (0.0008) [2023-12-28 03:03:54,086][106225] Updated weights for policy 1, policy_version 1089021 (0.0008) [2023-12-28 03:03:54,146][106225] Updated weights for policy 1, policy_version 1089031 (0.0009) [2023-12-28 03:03:54,424][106226] Updated weights for policy 0, policy_version 1086236 (0.0007) [2023-12-28 03:03:54,476][106226] Updated weights for policy 0, policy_version 1086246 (0.0005) [2023-12-28 03:03:54,524][106226] Updated weights for policy 0, policy_version 1086256 (0.0008) [2023-12-28 03:03:54,778][106225] Updated weights for policy 1, policy_version 1089041 (0.0006) [2023-12-28 03:03:54,846][106225] Updated weights for policy 1, policy_version 1089051 (0.0007) [2023-12-28 03:03:54,914][106225] Updated weights for policy 1, policy_version 1089061 (0.0008) [2023-12-28 03:03:54,980][106225] Updated weights for policy 1, policy_version 1089071 (0.0005) [2023-12-28 03:03:55,198][106226] Updated weights for policy 0, policy_version 1086266 (0.0007) [2023-12-28 03:03:55,254][106226] Updated weights for policy 0, policy_version 1086276 (0.0011) [2023-12-28 03:03:55,301][106226] Updated weights for policy 0, policy_version 1086286 (0.0010) [2023-12-28 03:03:55,356][106226] Updated weights for policy 0, policy_version 1086296 (0.0010) [2023-12-28 03:03:55,524][106225] Updated weights for policy 1, policy_version 1089081 (0.0006) [2023-12-28 03:03:55,587][106225] Updated weights for policy 1, policy_version 1089091 (0.0005) [2023-12-28 03:03:55,643][106225] Updated weights for policy 1, policy_version 1089101 (0.0006) [2023-12-28 03:03:55,945][106226] Updated weights for policy 0, policy_version 1086306 (0.0010) [2023-12-28 03:03:55,991][106226] Updated weights for policy 0, policy_version 1086316 (0.0010) [2023-12-28 03:03:56,052][106226] Updated weights for policy 0, policy_version 1086326 (0.0011) [2023-12-28 03:03:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557015040. Throughput: 0: 9820.4, 1: 9936.4. Samples: 556979212. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:03:56,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.757')] [2023-12-28 03:03:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001086328_278159360.pth... [2023-12-28 03:03:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001085144_277856256.pth [2023-12-28 03:03:56,209][106225] Updated weights for policy 1, policy_version 1089111 (0.0010) [2023-12-28 03:03:56,266][106225] Updated weights for policy 1, policy_version 1089121 (0.0010) [2023-12-28 03:03:56,323][106225] Updated weights for policy 1, policy_version 1089131 (0.0010) [2023-12-28 03:03:56,351][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001089136_278863872.pth... [2023-12-28 03:03:56,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001087952_278560768.pth [2023-12-28 03:03:56,654][106226] Updated weights for policy 0, policy_version 1086336 (0.0006) [2023-12-28 03:03:56,714][106226] Updated weights for policy 0, policy_version 1086346 (0.0005) [2023-12-28 03:03:56,773][106226] Updated weights for policy 0, policy_version 1086356 (0.0005) [2023-12-28 03:03:56,989][106225] Updated weights for policy 1, policy_version 1089141 (0.0009) [2023-12-28 03:03:57,038][106225] Updated weights for policy 1, policy_version 1089151 (0.0005) [2023-12-28 03:03:57,086][106225] Updated weights for policy 1, policy_version 1089161 (0.0005) [2023-12-28 03:03:57,383][106226] Updated weights for policy 0, policy_version 1086366 (0.0008) [2023-12-28 03:03:57,428][106226] Updated weights for policy 0, policy_version 1086376 (0.0010) [2023-12-28 03:03:57,475][106226] Updated weights for policy 0, policy_version 1086386 (0.0010) [2023-12-28 03:03:57,719][106225] Updated weights for policy 1, policy_version 1089171 (0.0008) [2023-12-28 03:03:57,769][106225] Updated weights for policy 1, policy_version 1089181 (0.0010) [2023-12-28 03:03:57,815][106225] Updated weights for policy 1, policy_version 1089191 (0.0010) [2023-12-28 03:03:58,189][106226] Updated weights for policy 0, policy_version 1086396 (0.0008) [2023-12-28 03:03:58,258][106226] Updated weights for policy 0, policy_version 1086406 (0.0008) [2023-12-28 03:03:58,332][106226] Updated weights for policy 0, policy_version 1086416 (0.0008) [2023-12-28 03:03:58,487][106225] Updated weights for policy 1, policy_version 1089201 (0.0008) [2023-12-28 03:03:58,549][106225] Updated weights for policy 1, policy_version 1089211 (0.0009) [2023-12-28 03:03:58,613][106225] Updated weights for policy 1, policy_version 1089221 (0.0010) [2023-12-28 03:03:58,682][106225] Updated weights for policy 1, policy_version 1089232 (0.0010) [2023-12-28 03:03:59,145][106226] Updated weights for policy 0, policy_version 1086426 (0.0008) [2023-12-28 03:03:59,205][106226] Updated weights for policy 0, policy_version 1086436 (0.0008) [2023-12-28 03:03:59,276][106226] Updated weights for policy 0, policy_version 1086446 (0.0008) [2023-12-28 03:03:59,337][106226] Updated weights for policy 0, policy_version 1086456 (0.0008) [2023-12-28 03:03:59,489][106225] Updated weights for policy 1, policy_version 1089242 (0.0011) [2023-12-28 03:03:59,546][106225] Updated weights for policy 1, policy_version 1089252 (0.0010) [2023-12-28 03:03:59,612][106225] Updated weights for policy 1, policy_version 1089262 (0.0011) [2023-12-28 03:04:00,154][106226] Updated weights for policy 0, policy_version 1086466 (0.0008) [2023-12-28 03:04:00,214][106226] Updated weights for policy 0, policy_version 1086476 (0.0008) [2023-12-28 03:04:00,271][106226] Updated weights for policy 0, policy_version 1086486 (0.0007) [2023-12-28 03:04:00,337][106225] Updated weights for policy 1, policy_version 1089272 (0.0010) [2023-12-28 03:04:00,390][106225] Updated weights for policy 1, policy_version 1089282 (0.0009) [2023-12-28 03:04:00,445][106225] Updated weights for policy 1, policy_version 1089292 (0.0010) [2023-12-28 03:04:00,891][106226] Updated weights for policy 0, policy_version 1086496 (0.0005) [2023-12-28 03:04:00,937][106226] Updated weights for policy 0, policy_version 1086506 (0.0005) [2023-12-28 03:04:01,004][106226] Updated weights for policy 0, policy_version 1086516 (0.0008) [2023-12-28 03:04:01,071][106225] Updated weights for policy 1, policy_version 1089302 (0.0010) [2023-12-28 03:04:01,135][106225] Updated weights for policy 1, policy_version 1089312 (0.0007) [2023-12-28 03:04:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557113344. Throughput: 0: 9895.1, 1: 10001.9. Samples: 557103440. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:01,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.916')] [2023-12-28 03:04:01,191][106225] Updated weights for policy 1, policy_version 1089322 (0.0005) [2023-12-28 03:04:01,728][106226] Updated weights for policy 0, policy_version 1086526 (0.0008) [2023-12-28 03:04:01,794][106226] Updated weights for policy 0, policy_version 1086536 (0.0008) [2023-12-28 03:04:01,852][106226] Updated weights for policy 0, policy_version 1086546 (0.0008) [2023-12-28 03:04:01,879][106225] Updated weights for policy 1, policy_version 1089332 (0.0006) [2023-12-28 03:04:01,928][106225] Updated weights for policy 1, policy_version 1089342 (0.0008) [2023-12-28 03:04:01,988][106225] Updated weights for policy 1, policy_version 1089352 (0.0007) [2023-12-28 03:04:02,578][106226] Updated weights for policy 0, policy_version 1086556 (0.0009) [2023-12-28 03:04:02,634][106226] Updated weights for policy 0, policy_version 1086566 (0.0010) [2023-12-28 03:04:02,697][106226] Updated weights for policy 0, policy_version 1086576 (0.0010) [2023-12-28 03:04:02,704][106225] Updated weights for policy 1, policy_version 1089362 (0.0011) [2023-12-28 03:04:02,761][106225] Updated weights for policy 1, policy_version 1089372 (0.0010) [2023-12-28 03:04:02,821][106225] Updated weights for policy 1, policy_version 1089382 (0.0010) [2023-12-28 03:04:02,877][106225] Updated weights for policy 1, policy_version 1089392 (0.0010) [2023-12-28 03:04:03,332][106226] Updated weights for policy 0, policy_version 1086586 (0.0009) [2023-12-28 03:04:03,394][106226] Updated weights for policy 0, policy_version 1086596 (0.0005) [2023-12-28 03:04:03,452][106226] Updated weights for policy 0, policy_version 1086606 (0.0005) [2023-12-28 03:04:03,512][106226] Updated weights for policy 0, policy_version 1086616 (0.0005) [2023-12-28 03:04:03,582][106225] Updated weights for policy 1, policy_version 1089402 (0.0010) [2023-12-28 03:04:03,651][106225] Updated weights for policy 1, policy_version 1089412 (0.0010) [2023-12-28 03:04:03,716][106225] Updated weights for policy 1, policy_version 1089422 (0.0010) [2023-12-28 03:04:04,039][106226] Updated weights for policy 0, policy_version 1086626 (0.0011) [2023-12-28 03:04:04,101][106226] Updated weights for policy 0, policy_version 1086636 (0.0011) [2023-12-28 03:04:04,167][106226] Updated weights for policy 0, policy_version 1086646 (0.0011) [2023-12-28 03:04:04,396][106225] Updated weights for policy 1, policy_version 1089432 (0.0008) [2023-12-28 03:04:04,446][106225] Updated weights for policy 1, policy_version 1089442 (0.0008) [2023-12-28 03:04:04,504][106225] Updated weights for policy 1, policy_version 1089452 (0.0007) [2023-12-28 03:04:04,877][106226] Updated weights for policy 0, policy_version 1086656 (0.0011) [2023-12-28 03:04:04,927][106226] Updated weights for policy 0, policy_version 1086666 (0.0011) [2023-12-28 03:04:04,978][106226] Updated weights for policy 0, policy_version 1086676 (0.0010) [2023-12-28 03:04:05,243][106225] Updated weights for policy 1, policy_version 1089462 (0.0008) [2023-12-28 03:04:05,292][106225] Updated weights for policy 1, policy_version 1089472 (0.0007) [2023-12-28 03:04:05,342][106225] Updated weights for policy 1, policy_version 1089482 (0.0008) [2023-12-28 03:04:05,705][106226] Updated weights for policy 0, policy_version 1086686 (0.0010) [2023-12-28 03:04:05,770][106226] Updated weights for policy 0, policy_version 1086696 (0.0010) [2023-12-28 03:04:05,836][106226] Updated weights for policy 0, policy_version 1086706 (0.0011) [2023-12-28 03:04:06,093][106225] Updated weights for policy 1, policy_version 1089492 (0.0008) [2023-12-28 03:04:06,161][106225] Updated weights for policy 1, policy_version 1089502 (0.0008) [2023-12-28 03:04:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557211648. Throughput: 0: 9933.3, 1: 9992.1. Samples: 557223468. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:06,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.741')] [2023-12-28 03:04:06,214][106225] Updated weights for policy 1, policy_version 1089512 (0.0008) [2023-12-28 03:04:06,537][106226] Updated weights for policy 0, policy_version 1086716 (0.0010) [2023-12-28 03:04:06,601][106226] Updated weights for policy 0, policy_version 1086726 (0.0009) [2023-12-28 03:04:06,660][106226] Updated weights for policy 0, policy_version 1086736 (0.0008) [2023-12-28 03:04:06,956][106225] Updated weights for policy 1, policy_version 1089522 (0.0008) [2023-12-28 03:04:07,009][106225] Updated weights for policy 1, policy_version 1089532 (0.0007) [2023-12-28 03:04:07,058][106225] Updated weights for policy 1, policy_version 1089542 (0.0007) [2023-12-28 03:04:07,107][106225] Updated weights for policy 1, policy_version 1089552 (0.0008) [2023-12-28 03:04:07,336][106226] Updated weights for policy 0, policy_version 1086746 (0.0007) [2023-12-28 03:04:07,398][106226] Updated weights for policy 0, policy_version 1086756 (0.0009) [2023-12-28 03:04:07,454][106226] Updated weights for policy 0, policy_version 1086766 (0.0008) [2023-12-28 03:04:07,518][106226] Updated weights for policy 0, policy_version 1086776 (0.0009) [2023-12-28 03:04:07,861][106225] Updated weights for policy 1, policy_version 1089562 (0.0009) [2023-12-28 03:04:07,921][106225] Updated weights for policy 1, policy_version 1089572 (0.0009) [2023-12-28 03:04:07,981][106225] Updated weights for policy 1, policy_version 1089582 (0.0009) [2023-12-28 03:04:08,157][106226] Updated weights for policy 0, policy_version 1086786 (0.0006) [2023-12-28 03:04:08,216][106226] Updated weights for policy 0, policy_version 1086796 (0.0005) [2023-12-28 03:04:08,271][106226] Updated weights for policy 0, policy_version 1086806 (0.0009) [2023-12-28 03:04:08,771][106225] Updated weights for policy 1, policy_version 1089592 (0.0006) [2023-12-28 03:04:08,824][106225] Updated weights for policy 1, policy_version 1089602 (0.0008) [2023-12-28 03:04:08,862][106226] Updated weights for policy 0, policy_version 1086816 (0.0010) [2023-12-28 03:04:08,883][106225] Updated weights for policy 1, policy_version 1089612 (0.0006) [2023-12-28 03:04:08,924][106226] Updated weights for policy 0, policy_version 1086826 (0.0011) [2023-12-28 03:04:08,985][106226] Updated weights for policy 0, policy_version 1086836 (0.0007) [2023-12-28 03:04:09,625][106225] Updated weights for policy 1, policy_version 1089622 (0.0008) [2023-12-28 03:04:09,663][106226] Updated weights for policy 0, policy_version 1086846 (0.0009) [2023-12-28 03:04:09,685][106225] Updated weights for policy 1, policy_version 1089632 (0.0006) [2023-12-28 03:04:09,726][106226] Updated weights for policy 0, policy_version 1086856 (0.0010) [2023-12-28 03:04:09,742][106225] Updated weights for policy 1, policy_version 1089642 (0.0008) [2023-12-28 03:04:09,791][106226] Updated weights for policy 0, policy_version 1086866 (0.0009) [2023-12-28 03:04:10,455][106225] Updated weights for policy 1, policy_version 1089652 (0.0007) [2023-12-28 03:04:10,511][106226] Updated weights for policy 0, policy_version 1086876 (0.0009) [2023-12-28 03:04:10,516][106225] Updated weights for policy 1, policy_version 1089662 (0.0008) [2023-12-28 03:04:10,571][106225] Updated weights for policy 1, policy_version 1089672 (0.0006) [2023-12-28 03:04:10,572][106226] Updated weights for policy 0, policy_version 1086886 (0.0011) [2023-12-28 03:04:10,630][106226] Updated weights for policy 0, policy_version 1086896 (0.0011) [2023-12-28 03:04:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 557309952. Throughput: 0: 10038.9, 1: 9983.4. Samples: 557283004. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:11,175][105115] Avg episode reward: [(0, '-4.938'), (1, '-4.852')] [2023-12-28 03:04:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001089680_279003136.pth... [2023-12-28 03:04:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001086904_278306816.pth... [2023-12-28 03:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001088528_278708224.pth [2023-12-28 03:04:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001085720_278003712.pth [2023-12-28 03:04:11,320][106225] Updated weights for policy 1, policy_version 1089682 (0.0007) [2023-12-28 03:04:11,359][106226] Updated weights for policy 0, policy_version 1086906 (0.0012) [2023-12-28 03:04:11,396][106225] Updated weights for policy 1, policy_version 1089692 (0.0009) [2023-12-28 03:04:11,426][106226] Updated weights for policy 0, policy_version 1086916 (0.0010) [2023-12-28 03:04:11,457][106225] Updated weights for policy 1, policy_version 1089702 (0.0011) [2023-12-28 03:04:11,488][106226] Updated weights for policy 0, policy_version 1086926 (0.0008) [2023-12-28 03:04:11,519][106225] Updated weights for policy 1, policy_version 1089712 (0.0010) [2023-12-28 03:04:11,546][106226] Updated weights for policy 0, policy_version 1086936 (0.0008) [2023-12-28 03:04:12,288][106225] Updated weights for policy 1, policy_version 1089722 (0.0007) [2023-12-28 03:04:12,355][106225] Updated weights for policy 1, policy_version 1089732 (0.0008) [2023-12-28 03:04:12,379][106226] Updated weights for policy 0, policy_version 1086946 (0.0007) [2023-12-28 03:04:12,429][106225] Updated weights for policy 1, policy_version 1089742 (0.0008) [2023-12-28 03:04:12,453][106226] Updated weights for policy 0, policy_version 1086956 (0.0008) [2023-12-28 03:04:12,509][106226] Updated weights for policy 0, policy_version 1086966 (0.0008) [2023-12-28 03:04:13,095][106225] Updated weights for policy 1, policy_version 1089752 (0.0007) [2023-12-28 03:04:13,145][106225] Updated weights for policy 1, policy_version 1089762 (0.0006) [2023-12-28 03:04:13,197][106226] Updated weights for policy 0, policy_version 1086976 (0.0007) [2023-12-28 03:04:13,197][106225] Updated weights for policy 1, policy_version 1089772 (0.0005) [2023-12-28 03:04:13,244][106226] Updated weights for policy 0, policy_version 1086986 (0.0007) [2023-12-28 03:04:13,294][106226] Updated weights for policy 0, policy_version 1086996 (0.0006) [2023-12-28 03:04:13,806][106225] Updated weights for policy 1, policy_version 1089782 (0.0007) [2023-12-28 03:04:13,857][106225] Updated weights for policy 1, policy_version 1089792 (0.0005) [2023-12-28 03:04:13,909][106225] Updated weights for policy 1, policy_version 1089802 (0.0006) [2023-12-28 03:04:14,065][106226] Updated weights for policy 0, policy_version 1087006 (0.0008) [2023-12-28 03:04:14,116][106226] Updated weights for policy 0, policy_version 1087016 (0.0009) [2023-12-28 03:04:14,166][106226] Updated weights for policy 0, policy_version 1087026 (0.0009) [2023-12-28 03:04:14,531][106225] Updated weights for policy 1, policy_version 1089812 (0.0006) [2023-12-28 03:04:14,584][106225] Updated weights for policy 1, policy_version 1089822 (0.0010) [2023-12-28 03:04:14,641][106225] Updated weights for policy 1, policy_version 1089832 (0.0010) [2023-12-28 03:04:14,936][106226] Updated weights for policy 0, policy_version 1087036 (0.0009) [2023-12-28 03:04:15,000][106226] Updated weights for policy 0, policy_version 1087046 (0.0009) [2023-12-28 03:04:15,069][106226] Updated weights for policy 0, policy_version 1087056 (0.0007) [2023-12-28 03:04:15,389][106225] Updated weights for policy 1, policy_version 1089842 (0.0010) [2023-12-28 03:04:15,444][106225] Updated weights for policy 1, policy_version 1089852 (0.0008) [2023-12-28 03:04:15,501][106225] Updated weights for policy 1, policy_version 1089862 (0.0009) [2023-12-28 03:04:15,554][106225] Updated weights for policy 1, policy_version 1089872 (0.0010) [2023-12-28 03:04:15,790][106226] Updated weights for policy 0, policy_version 1087066 (0.0006) [2023-12-28 03:04:15,843][106226] Updated weights for policy 0, policy_version 1087076 (0.0008) [2023-12-28 03:04:15,903][106226] Updated weights for policy 0, policy_version 1087086 (0.0007) [2023-12-28 03:04:15,960][106226] Updated weights for policy 0, policy_version 1087096 (0.0008) [2023-12-28 03:04:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557408256. Throughput: 0: 9920.2, 1: 9863.7. Samples: 557398416. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:16,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.879')] [2023-12-28 03:04:16,217][106225] Updated weights for policy 1, policy_version 1089882 (0.0009) [2023-12-28 03:04:16,282][106225] Updated weights for policy 1, policy_version 1089892 (0.0010) [2023-12-28 03:04:16,340][106225] Updated weights for policy 1, policy_version 1089902 (0.0010) [2023-12-28 03:04:16,695][106226] Updated weights for policy 0, policy_version 1087106 (0.0011) [2023-12-28 03:04:16,758][106226] Updated weights for policy 0, policy_version 1087116 (0.0010) [2023-12-28 03:04:16,811][106226] Updated weights for policy 0, policy_version 1087126 (0.0010) [2023-12-28 03:04:17,048][106225] Updated weights for policy 1, policy_version 1089912 (0.0009) [2023-12-28 03:04:17,115][106225] Updated weights for policy 1, policy_version 1089922 (0.0006) [2023-12-28 03:04:17,164][106225] Updated weights for policy 1, policy_version 1089932 (0.0005) [2023-12-28 03:04:17,451][106226] Updated weights for policy 0, policy_version 1087136 (0.0010) [2023-12-28 03:04:17,504][106226] Updated weights for policy 0, policy_version 1087146 (0.0010) [2023-12-28 03:04:17,555][106226] Updated weights for policy 0, policy_version 1087156 (0.0005) [2023-12-28 03:04:17,715][106225] Updated weights for policy 1, policy_version 1089942 (0.0006) [2023-12-28 03:04:17,761][106225] Updated weights for policy 1, policy_version 1089952 (0.0005) [2023-12-28 03:04:17,810][106225] Updated weights for policy 1, policy_version 1089962 (0.0005) [2023-12-28 03:04:18,136][106226] Updated weights for policy 0, policy_version 1087166 (0.0008) [2023-12-28 03:04:18,190][106226] Updated weights for policy 0, policy_version 1087176 (0.0010) [2023-12-28 03:04:18,242][106226] Updated weights for policy 0, policy_version 1087186 (0.0010) [2023-12-28 03:04:18,527][106225] Updated weights for policy 1, policy_version 1089972 (0.0008) [2023-12-28 03:04:18,585][106225] Updated weights for policy 1, policy_version 1089982 (0.0005) [2023-12-28 03:04:18,641][106225] Updated weights for policy 1, policy_version 1089992 (0.0006) [2023-12-28 03:04:18,946][106226] Updated weights for policy 0, policy_version 1087196 (0.0011) [2023-12-28 03:04:19,006][106226] Updated weights for policy 0, policy_version 1087206 (0.0011) [2023-12-28 03:04:19,066][106226] Updated weights for policy 0, policy_version 1087216 (0.0007) [2023-12-28 03:04:19,252][106225] Updated weights for policy 1, policy_version 1090002 (0.0007) [2023-12-28 03:04:19,314][106225] Updated weights for policy 1, policy_version 1090012 (0.0008) [2023-12-28 03:04:19,378][106225] Updated weights for policy 1, policy_version 1090022 (0.0008) [2023-12-28 03:04:19,442][106225] Updated weights for policy 1, policy_version 1090032 (0.0008) [2023-12-28 03:04:19,751][106226] Updated weights for policy 0, policy_version 1087226 (0.0007) [2023-12-28 03:04:19,816][106226] Updated weights for policy 0, policy_version 1087236 (0.0011) [2023-12-28 03:04:19,888][106226] Updated weights for policy 0, policy_version 1087246 (0.0011) [2023-12-28 03:04:19,960][106226] Updated weights for policy 0, policy_version 1087256 (0.0009) [2023-12-28 03:04:20,206][106225] Updated weights for policy 1, policy_version 1090042 (0.0009) [2023-12-28 03:04:20,261][106225] Updated weights for policy 1, policy_version 1090052 (0.0008) [2023-12-28 03:04:20,325][106225] Updated weights for policy 1, policy_version 1090062 (0.0009) [2023-12-28 03:04:20,712][106226] Updated weights for policy 0, policy_version 1087266 (0.0007) [2023-12-28 03:04:20,769][106226] Updated weights for policy 0, policy_version 1087276 (0.0009) [2023-12-28 03:04:20,829][106226] Updated weights for policy 0, policy_version 1087286 (0.0008) [2023-12-28 03:04:21,129][106225] Updated weights for policy 1, policy_version 1090072 (0.0010) [2023-12-28 03:04:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 557506560. Throughput: 0: 9969.8, 1: 9916.0. Samples: 557518600. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:21,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-5.040')] [2023-12-28 03:04:21,196][106225] Updated weights for policy 1, policy_version 1090082 (0.0009) [2023-12-28 03:04:21,259][106225] Updated weights for policy 1, policy_version 1090092 (0.0009) [2023-12-28 03:04:21,636][106226] Updated weights for policy 0, policy_version 1087296 (0.0009) [2023-12-28 03:04:21,704][106226] Updated weights for policy 0, policy_version 1087306 (0.0007) [2023-12-28 03:04:21,780][106226] Updated weights for policy 0, policy_version 1087316 (0.0009) [2023-12-28 03:04:22,026][106225] Updated weights for policy 1, policy_version 1090102 (0.0009) [2023-12-28 03:04:22,086][106225] Updated weights for policy 1, policy_version 1090112 (0.0008) [2023-12-28 03:04:22,143][106225] Updated weights for policy 1, policy_version 1090122 (0.0008) [2023-12-28 03:04:22,497][106226] Updated weights for policy 0, policy_version 1087326 (0.0009) [2023-12-28 03:04:22,553][106226] Updated weights for policy 0, policy_version 1087336 (0.0008) [2023-12-28 03:04:22,609][106226] Updated weights for policy 0, policy_version 1087346 (0.0009) [2023-12-28 03:04:22,864][106225] Updated weights for policy 1, policy_version 1090132 (0.0008) [2023-12-28 03:04:22,927][106225] Updated weights for policy 1, policy_version 1090142 (0.0006) [2023-12-28 03:04:22,993][106225] Updated weights for policy 1, policy_version 1090152 (0.0006) [2023-12-28 03:04:23,395][106226] Updated weights for policy 0, policy_version 1087356 (0.0009) [2023-12-28 03:04:23,447][106226] Updated weights for policy 0, policy_version 1087366 (0.0008) [2023-12-28 03:04:23,500][106226] Updated weights for policy 0, policy_version 1087376 (0.0008) [2023-12-28 03:04:23,665][106225] Updated weights for policy 1, policy_version 1090162 (0.0009) [2023-12-28 03:04:23,730][106225] Updated weights for policy 1, policy_version 1090172 (0.0009) [2023-12-28 03:04:23,780][106225] Updated weights for policy 1, policy_version 1090182 (0.0008) [2023-12-28 03:04:23,840][106225] Updated weights for policy 1, policy_version 1090192 (0.0009) [2023-12-28 03:04:24,245][106226] Updated weights for policy 0, policy_version 1087386 (0.0008) [2023-12-28 03:04:24,301][106226] Updated weights for policy 0, policy_version 1087396 (0.0010) [2023-12-28 03:04:24,356][106226] Updated weights for policy 0, policy_version 1087406 (0.0008) [2023-12-28 03:04:24,418][106226] Updated weights for policy 0, policy_version 1087416 (0.0006) [2023-12-28 03:04:24,560][106225] Updated weights for policy 1, policy_version 1090202 (0.0008) [2023-12-28 03:04:24,609][106225] Updated weights for policy 1, policy_version 1090212 (0.0008) [2023-12-28 03:04:24,655][106225] Updated weights for policy 1, policy_version 1090222 (0.0007) [2023-12-28 03:04:25,051][106226] Updated weights for policy 0, policy_version 1087426 (0.0010) [2023-12-28 03:04:25,110][106226] Updated weights for policy 0, policy_version 1087436 (0.0010) [2023-12-28 03:04:25,168][106226] Updated weights for policy 0, policy_version 1087446 (0.0010) [2023-12-28 03:04:25,288][106225] Updated weights for policy 1, policy_version 1090232 (0.0005) [2023-12-28 03:04:25,337][106225] Updated weights for policy 1, policy_version 1090242 (0.0005) [2023-12-28 03:04:25,384][106225] Updated weights for policy 1, policy_version 1090252 (0.0005) [2023-12-28 03:04:25,742][106226] Updated weights for policy 0, policy_version 1087456 (0.0006) [2023-12-28 03:04:25,796][106226] Updated weights for policy 0, policy_version 1087466 (0.0006) [2023-12-28 03:04:25,853][106226] Updated weights for policy 0, policy_version 1087476 (0.0008) [2023-12-28 03:04:25,983][106225] Updated weights for policy 1, policy_version 1090262 (0.0007) [2023-12-28 03:04:26,048][106225] Updated weights for policy 1, policy_version 1090272 (0.0006) [2023-12-28 03:04:26,108][106225] Updated weights for policy 1, policy_version 1090282 (0.0005) [2023-12-28 03:04:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557613056. Throughput: 0: 9889.2, 1: 9878.0. Samples: 557574348. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:26,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.697')] [2023-12-28 03:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001087480_278454272.pth... [2023-12-28 03:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001090288_279158784.pth... [2023-12-28 03:04:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001086328_278159360.pth [2023-12-28 03:04:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001089136_278863872.pth [2023-12-28 03:04:26,485][106226] Updated weights for policy 0, policy_version 1087486 (0.0006) [2023-12-28 03:04:26,538][106226] Updated weights for policy 0, policy_version 1087496 (0.0008) [2023-12-28 03:04:26,584][106226] Updated weights for policy 0, policy_version 1087506 (0.0010) [2023-12-28 03:04:26,709][106225] Updated weights for policy 1, policy_version 1090292 (0.0007) [2023-12-28 03:04:26,766][106225] Updated weights for policy 1, policy_version 1090302 (0.0010) [2023-12-28 03:04:26,835][106225] Updated weights for policy 1, policy_version 1090312 (0.0010) [2023-12-28 03:04:27,133][106226] Updated weights for policy 0, policy_version 1087516 (0.0007) [2023-12-28 03:04:27,194][106226] Updated weights for policy 0, policy_version 1087526 (0.0005) [2023-12-28 03:04:27,255][106226] Updated weights for policy 0, policy_version 1087536 (0.0005) [2023-12-28 03:04:27,518][106225] Updated weights for policy 1, policy_version 1090322 (0.0009) [2023-12-28 03:04:27,577][106225] Updated weights for policy 1, policy_version 1090332 (0.0007) [2023-12-28 03:04:27,632][106225] Updated weights for policy 1, policy_version 1090342 (0.0010) [2023-12-28 03:04:27,684][106225] Updated weights for policy 1, policy_version 1090352 (0.0010) [2023-12-28 03:04:27,880][106226] Updated weights for policy 0, policy_version 1087546 (0.0007) [2023-12-28 03:04:27,942][106226] Updated weights for policy 0, policy_version 1087556 (0.0007) [2023-12-28 03:04:27,997][106226] Updated weights for policy 0, policy_version 1087566 (0.0008) [2023-12-28 03:04:28,049][106226] Updated weights for policy 0, policy_version 1087576 (0.0010) [2023-12-28 03:04:28,388][106225] Updated weights for policy 1, policy_version 1090362 (0.0007) [2023-12-28 03:04:28,446][106225] Updated weights for policy 1, policy_version 1090372 (0.0009) [2023-12-28 03:04:28,509][106225] Updated weights for policy 1, policy_version 1090382 (0.0010) [2023-12-28 03:04:28,704][106226] Updated weights for policy 0, policy_version 1087586 (0.0006) [2023-12-28 03:04:28,771][106226] Updated weights for policy 0, policy_version 1087596 (0.0009) [2023-12-28 03:04:28,827][106226] Updated weights for policy 0, policy_version 1087606 (0.0009) [2023-12-28 03:04:29,230][106225] Updated weights for policy 1, policy_version 1090392 (0.0008) [2023-12-28 03:04:29,294][106225] Updated weights for policy 1, policy_version 1090402 (0.0008) [2023-12-28 03:04:29,360][106225] Updated weights for policy 1, policy_version 1090412 (0.0009) [2023-12-28 03:04:29,549][106226] Updated weights for policy 0, policy_version 1087616 (0.0008) [2023-12-28 03:04:29,605][106226] Updated weights for policy 0, policy_version 1087626 (0.0009) [2023-12-28 03:04:29,660][106226] Updated weights for policy 0, policy_version 1087636 (0.0008) [2023-12-28 03:04:30,083][106225] Updated weights for policy 1, policy_version 1090422 (0.0008) [2023-12-28 03:04:30,148][106225] Updated weights for policy 1, policy_version 1090432 (0.0008) [2023-12-28 03:04:30,206][106225] Updated weights for policy 1, policy_version 1090442 (0.0008) [2023-12-28 03:04:30,423][106226] Updated weights for policy 0, policy_version 1087646 (0.0008) [2023-12-28 03:04:30,487][106226] Updated weights for policy 0, policy_version 1087656 (0.0009) [2023-12-28 03:04:30,545][106226] Updated weights for policy 0, policy_version 1087666 (0.0009) [2023-12-28 03:04:30,921][106225] Updated weights for policy 1, policy_version 1090452 (0.0008) [2023-12-28 03:04:30,971][106225] Updated weights for policy 1, policy_version 1090462 (0.0005) [2023-12-28 03:04:31,032][106225] Updated weights for policy 1, policy_version 1090472 (0.0006) [2023-12-28 03:04:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557711360. Throughput: 0: 10039.0, 1: 9979.9. Samples: 557700288. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:31,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.049')] [2023-12-28 03:04:31,355][106226] Updated weights for policy 0, policy_version 1087676 (0.0009) [2023-12-28 03:04:31,416][106226] Updated weights for policy 0, policy_version 1087686 (0.0009) [2023-12-28 03:04:31,478][106226] Updated weights for policy 0, policy_version 1087696 (0.0007) [2023-12-28 03:04:31,777][106225] Updated weights for policy 1, policy_version 1090482 (0.0008) [2023-12-28 03:04:31,844][106225] Updated weights for policy 1, policy_version 1090492 (0.0008) [2023-12-28 03:04:31,913][106225] Updated weights for policy 1, policy_version 1090502 (0.0008) [2023-12-28 03:04:31,974][106225] Updated weights for policy 1, policy_version 1090512 (0.0009) [2023-12-28 03:04:32,239][106226] Updated weights for policy 0, policy_version 1087706 (0.0009) [2023-12-28 03:04:32,309][106226] Updated weights for policy 0, policy_version 1087716 (0.0008) [2023-12-28 03:04:32,375][106226] Updated weights for policy 0, policy_version 1087726 (0.0008) [2023-12-28 03:04:32,430][106226] Updated weights for policy 0, policy_version 1087736 (0.0009) [2023-12-28 03:04:32,700][106225] Updated weights for policy 1, policy_version 1090522 (0.0009) [2023-12-28 03:04:32,761][106225] Updated weights for policy 1, policy_version 1090532 (0.0008) [2023-12-28 03:04:32,821][106225] Updated weights for policy 1, policy_version 1090542 (0.0009) [2023-12-28 03:04:33,150][106226] Updated weights for policy 0, policy_version 1087746 (0.0009) [2023-12-28 03:04:33,208][106226] Updated weights for policy 0, policy_version 1087756 (0.0009) [2023-12-28 03:04:33,256][106226] Updated weights for policy 0, policy_version 1087766 (0.0008) [2023-12-28 03:04:33,556][106225] Updated weights for policy 1, policy_version 1090552 (0.0008) [2023-12-28 03:04:33,600][106225] Updated weights for policy 1, policy_version 1090562 (0.0008) [2023-12-28 03:04:33,647][106225] Updated weights for policy 1, policy_version 1090572 (0.0008) [2023-12-28 03:04:33,932][106226] Updated weights for policy 0, policy_version 1087776 (0.0010) [2023-12-28 03:04:33,983][106226] Updated weights for policy 0, policy_version 1087786 (0.0009) [2023-12-28 03:04:34,033][106226] Updated weights for policy 0, policy_version 1087796 (0.0010) [2023-12-28 03:04:34,391][106225] Updated weights for policy 1, policy_version 1090582 (0.0008) [2023-12-28 03:04:34,448][106225] Updated weights for policy 1, policy_version 1090592 (0.0008) [2023-12-28 03:04:34,507][106225] Updated weights for policy 1, policy_version 1090602 (0.0008) [2023-12-28 03:04:34,765][106226] Updated weights for policy 0, policy_version 1087806 (0.0010) [2023-12-28 03:04:34,824][106226] Updated weights for policy 0, policy_version 1087816 (0.0010) [2023-12-28 03:04:34,887][106226] Updated weights for policy 0, policy_version 1087826 (0.0008) [2023-12-28 03:04:35,158][106225] Updated weights for policy 1, policy_version 1090612 (0.0007) [2023-12-28 03:04:35,218][106225] Updated weights for policy 1, policy_version 1090622 (0.0006) [2023-12-28 03:04:35,284][106225] Updated weights for policy 1, policy_version 1090632 (0.0006) [2023-12-28 03:04:35,438][106226] Updated weights for policy 0, policy_version 1087836 (0.0006) [2023-12-28 03:04:35,496][106226] Updated weights for policy 0, policy_version 1087846 (0.0005) [2023-12-28 03:04:35,554][106226] Updated weights for policy 0, policy_version 1087856 (0.0005) [2023-12-28 03:04:35,840][106225] Updated weights for policy 1, policy_version 1090642 (0.0006) [2023-12-28 03:04:35,900][106225] Updated weights for policy 1, policy_version 1090652 (0.0005) [2023-12-28 03:04:35,958][106225] Updated weights for policy 1, policy_version 1090662 (0.0010) [2023-12-28 03:04:36,015][106225] Updated weights for policy 1, policy_version 1090672 (0.0007) [2023-12-28 03:04:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 557809664. Throughput: 0: 9985.9, 1: 9932.5. Samples: 557818132. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:36,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-4.854')] [2023-12-28 03:04:36,231][106226] Updated weights for policy 0, policy_version 1087866 (0.0005) [2023-12-28 03:04:36,293][106226] Updated weights for policy 0, policy_version 1087876 (0.0008) [2023-12-28 03:04:36,356][106226] Updated weights for policy 0, policy_version 1087886 (0.0007) [2023-12-28 03:04:36,414][106226] Updated weights for policy 0, policy_version 1087896 (0.0008) [2023-12-28 03:04:36,617][106225] Updated weights for policy 1, policy_version 1090682 (0.0010) [2023-12-28 03:04:36,683][106225] Updated weights for policy 1, policy_version 1090692 (0.0011) [2023-12-28 03:04:36,734][106225] Updated weights for policy 1, policy_version 1090702 (0.0011) [2023-12-28 03:04:37,121][106226] Updated weights for policy 0, policy_version 1087906 (0.0006) [2023-12-28 03:04:37,186][106226] Updated weights for policy 0, policy_version 1087916 (0.0005) [2023-12-28 03:04:37,238][106226] Updated weights for policy 0, policy_version 1087926 (0.0005) [2023-12-28 03:04:37,465][106225] Updated weights for policy 1, policy_version 1090712 (0.0011) [2023-12-28 03:04:37,522][106225] Updated weights for policy 1, policy_version 1090722 (0.0010) [2023-12-28 03:04:37,579][106225] Updated weights for policy 1, policy_version 1090732 (0.0010) [2023-12-28 03:04:37,849][106226] Updated weights for policy 0, policy_version 1087936 (0.0008) [2023-12-28 03:04:37,899][106226] Updated weights for policy 0, policy_version 1087946 (0.0006) [2023-12-28 03:04:37,952][106226] Updated weights for policy 0, policy_version 1087956 (0.0005) [2023-12-28 03:04:38,257][106225] Updated weights for policy 1, policy_version 1090742 (0.0007) [2023-12-28 03:04:38,309][106225] Updated weights for policy 1, policy_version 1090752 (0.0008) [2023-12-28 03:04:38,378][106225] Updated weights for policy 1, policy_version 1090762 (0.0007) [2023-12-28 03:04:38,641][106226] Updated weights for policy 0, policy_version 1087966 (0.0006) [2023-12-28 03:04:38,703][106226] Updated weights for policy 0, policy_version 1087976 (0.0007) [2023-12-28 03:04:38,773][106226] Updated weights for policy 0, policy_version 1087986 (0.0008) [2023-12-28 03:04:39,022][106225] Updated weights for policy 1, policy_version 1090772 (0.0006) [2023-12-28 03:04:39,075][106225] Updated weights for policy 1, policy_version 1090782 (0.0008) [2023-12-28 03:04:39,124][106225] Updated weights for policy 1, policy_version 1090792 (0.0009) [2023-12-28 03:04:39,439][106226] Updated weights for policy 0, policy_version 1087996 (0.0009) [2023-12-28 03:04:39,498][106226] Updated weights for policy 0, policy_version 1088006 (0.0008) [2023-12-28 03:04:39,561][106226] Updated weights for policy 0, policy_version 1088016 (0.0007) [2023-12-28 03:04:39,894][106225] Updated weights for policy 1, policy_version 1090802 (0.0008) [2023-12-28 03:04:39,961][106225] Updated weights for policy 1, policy_version 1090812 (0.0008) [2023-12-28 03:04:40,024][106225] Updated weights for policy 1, policy_version 1090822 (0.0008) [2023-12-28 03:04:40,086][106225] Updated weights for policy 1, policy_version 1090832 (0.0008) [2023-12-28 03:04:40,219][106226] Updated weights for policy 0, policy_version 1088026 (0.0007) [2023-12-28 03:04:40,274][106226] Updated weights for policy 0, policy_version 1088036 (0.0005) [2023-12-28 03:04:40,334][106226] Updated weights for policy 0, policy_version 1088046 (0.0006) [2023-12-28 03:04:40,393][106226] Updated weights for policy 0, policy_version 1088056 (0.0006) [2023-12-28 03:04:40,818][106225] Updated weights for policy 1, policy_version 1090842 (0.0006) [2023-12-28 03:04:40,881][106225] Updated weights for policy 1, policy_version 1090852 (0.0006) [2023-12-28 03:04:40,940][106225] Updated weights for policy 1, policy_version 1090862 (0.0006) [2023-12-28 03:04:41,053][106226] Updated weights for policy 0, policy_version 1088066 (0.0009) [2023-12-28 03:04:41,123][106226] Updated weights for policy 0, policy_version 1088076 (0.0007) [2023-12-28 03:04:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 557907968. Throughput: 0: 10012.1, 1: 10004.8. Samples: 557879972. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:41,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.032')] [2023-12-28 03:04:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001090864_279306240.pth... [2023-12-28 03:04:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001089680_279003136.pth [2023-12-28 03:04:41,186][106226] Updated weights for policy 0, policy_version 1088086 (0.0009) [2023-12-28 03:04:41,198][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001088088_278609920.pth... [2023-12-28 03:04:41,201][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001086904_278306816.pth [2023-12-28 03:04:41,668][106225] Updated weights for policy 1, policy_version 1090872 (0.0008) [2023-12-28 03:04:41,737][106225] Updated weights for policy 1, policy_version 1090882 (0.0008) [2023-12-28 03:04:41,803][106225] Updated weights for policy 1, policy_version 1090892 (0.0008) [2023-12-28 03:04:41,928][106226] Updated weights for policy 0, policy_version 1088096 (0.0008) [2023-12-28 03:04:41,997][106226] Updated weights for policy 0, policy_version 1088106 (0.0009) [2023-12-28 03:04:42,066][106226] Updated weights for policy 0, policy_version 1088116 (0.0008) [2023-12-28 03:04:42,564][106225] Updated weights for policy 1, policy_version 1090902 (0.0008) [2023-12-28 03:04:42,617][106225] Updated weights for policy 1, policy_version 1090912 (0.0009) [2023-12-28 03:04:42,679][106225] Updated weights for policy 1, policy_version 1090922 (0.0008) [2023-12-28 03:04:42,744][106226] Updated weights for policy 0, policy_version 1088126 (0.0009) [2023-12-28 03:04:42,815][106226] Updated weights for policy 0, policy_version 1088136 (0.0009) [2023-12-28 03:04:42,884][106226] Updated weights for policy 0, policy_version 1088146 (0.0008) [2023-12-28 03:04:43,471][106225] Updated weights for policy 1, policy_version 1090932 (0.0008) [2023-12-28 03:04:43,478][106226] Updated weights for policy 0, policy_version 1088156 (0.0007) [2023-12-28 03:04:43,518][106225] Updated weights for policy 1, policy_version 1090942 (0.0007) [2023-12-28 03:04:43,530][106226] Updated weights for policy 0, policy_version 1088166 (0.0007) [2023-12-28 03:04:43,581][106225] Updated weights for policy 1, policy_version 1090952 (0.0006) [2023-12-28 03:04:43,593][106226] Updated weights for policy 0, policy_version 1088176 (0.0011) [2023-12-28 03:04:44,237][106225] Updated weights for policy 1, policy_version 1090962 (0.0006) [2023-12-28 03:04:44,291][106225] Updated weights for policy 1, policy_version 1090972 (0.0008) [2023-12-28 03:04:44,323][106226] Updated weights for policy 0, policy_version 1088186 (0.0010) [2023-12-28 03:04:44,347][106225] Updated weights for policy 1, policy_version 1090982 (0.0008) [2023-12-28 03:04:44,380][106226] Updated weights for policy 0, policy_version 1088196 (0.0007) [2023-12-28 03:04:44,398][106225] Updated weights for policy 1, policy_version 1090992 (0.0007) [2023-12-28 03:04:44,439][106226] Updated weights for policy 0, policy_version 1088206 (0.0009) [2023-12-28 03:04:44,499][106226] Updated weights for policy 0, policy_version 1088216 (0.0008) [2023-12-28 03:04:45,085][106225] Updated weights for policy 1, policy_version 1091002 (0.0008) [2023-12-28 03:04:45,148][106225] Updated weights for policy 1, policy_version 1091012 (0.0008) [2023-12-28 03:04:45,208][106225] Updated weights for policy 1, policy_version 1091022 (0.0008) [2023-12-28 03:04:45,298][106226] Updated weights for policy 0, policy_version 1088226 (0.0009) [2023-12-28 03:04:45,357][106226] Updated weights for policy 0, policy_version 1088236 (0.0008) [2023-12-28 03:04:45,423][106226] Updated weights for policy 0, policy_version 1088246 (0.0006) [2023-12-28 03:04:45,961][106225] Updated weights for policy 1, policy_version 1091032 (0.0009) [2023-12-28 03:04:46,011][106226] Updated weights for policy 0, policy_version 1088256 (0.0005) [2023-12-28 03:04:46,022][106225] Updated weights for policy 1, policy_version 1091042 (0.0008) [2023-12-28 03:04:46,067][106225] Updated weights for policy 1, policy_version 1091052 (0.0007) [2023-12-28 03:04:46,072][106226] Updated weights for policy 0, policy_version 1088266 (0.0009) [2023-12-28 03:04:46,126][106226] Updated weights for policy 0, policy_version 1088276 (0.0008) [2023-12-28 03:04:46,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 558014464. Throughput: 0: 9970.9, 1: 9884.7. Samples: 557996944. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:46,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.082')] [2023-12-28 03:04:46,762][106225] Updated weights for policy 1, policy_version 1091062 (0.0008) [2023-12-28 03:04:46,825][106225] Updated weights for policy 1, policy_version 1091072 (0.0006) [2023-12-28 03:04:46,834][106226] Updated weights for policy 0, policy_version 1088286 (0.0007) [2023-12-28 03:04:46,880][106225] Updated weights for policy 1, policy_version 1091082 (0.0010) [2023-12-28 03:04:46,892][106226] Updated weights for policy 0, policy_version 1088296 (0.0005) [2023-12-28 03:04:46,951][106226] Updated weights for policy 0, policy_version 1088306 (0.0005) [2023-12-28 03:04:47,524][106225] Updated weights for policy 1, policy_version 1091092 (0.0008) [2023-12-28 03:04:47,569][106226] Updated weights for policy 0, policy_version 1088316 (0.0008) [2023-12-28 03:04:47,587][106225] Updated weights for policy 1, policy_version 1091102 (0.0006) [2023-12-28 03:04:47,630][106226] Updated weights for policy 0, policy_version 1088326 (0.0011) [2023-12-28 03:04:47,644][106225] Updated weights for policy 1, policy_version 1091112 (0.0009) [2023-12-28 03:04:47,684][106226] Updated weights for policy 0, policy_version 1088336 (0.0010) [2023-12-28 03:04:48,187][106225] Updated weights for policy 1, policy_version 1091122 (0.0009) [2023-12-28 03:04:48,250][106225] Updated weights for policy 1, policy_version 1091132 (0.0005) [2023-12-28 03:04:48,307][106226] Updated weights for policy 0, policy_version 1088346 (0.0009) [2023-12-28 03:04:48,309][106225] Updated weights for policy 1, policy_version 1091143 (0.0009) [2023-12-28 03:04:48,381][106226] Updated weights for policy 0, policy_version 1088356 (0.0010) [2023-12-28 03:04:48,446][106226] Updated weights for policy 0, policy_version 1088366 (0.0011) [2023-12-28 03:04:48,513][106226] Updated weights for policy 0, policy_version 1088376 (0.0011) [2023-12-28 03:04:48,948][106225] Updated weights for policy 1, policy_version 1091153 (0.0007) [2023-12-28 03:04:49,002][106225] Updated weights for policy 1, policy_version 1091163 (0.0007) [2023-12-28 03:04:49,058][106225] Updated weights for policy 1, policy_version 1091173 (0.0006) [2023-12-28 03:04:49,119][106225] Updated weights for policy 1, policy_version 1091183 (0.0007) [2023-12-28 03:04:49,204][106226] Updated weights for policy 0, policy_version 1088386 (0.0011) [2023-12-28 03:04:49,269][106226] Updated weights for policy 0, policy_version 1088396 (0.0008) [2023-12-28 03:04:49,334][106226] Updated weights for policy 0, policy_version 1088406 (0.0008) [2023-12-28 03:04:49,787][106225] Updated weights for policy 1, policy_version 1091193 (0.0005) [2023-12-28 03:04:49,849][106225] Updated weights for policy 1, policy_version 1091203 (0.0008) [2023-12-28 03:04:49,911][106225] Updated weights for policy 1, policy_version 1091213 (0.0009) [2023-12-28 03:04:50,034][106226] Updated weights for policy 0, policy_version 1088416 (0.0011) [2023-12-28 03:04:50,098][106226] Updated weights for policy 0, policy_version 1088426 (0.0011) [2023-12-28 03:04:50,148][106226] Updated weights for policy 0, policy_version 1088436 (0.0008) [2023-12-28 03:04:50,553][106225] Updated weights for policy 1, policy_version 1091223 (0.0010) [2023-12-28 03:04:50,623][106225] Updated weights for policy 1, policy_version 1091233 (0.0010) [2023-12-28 03:04:50,675][106225] Updated weights for policy 1, policy_version 1091243 (0.0008) [2023-12-28 03:04:50,844][106226] Updated weights for policy 0, policy_version 1088446 (0.0009) [2023-12-28 03:04:50,899][106226] Updated weights for policy 0, policy_version 1088456 (0.0010) [2023-12-28 03:04:50,960][106226] Updated weights for policy 0, policy_version 1088466 (0.0010) [2023-12-28 03:04:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 558112768. Throughput: 0: 9974.1, 1: 9940.3. Samples: 558119616. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:51,175][105115] Avg episode reward: [(0, '-4.949'), (1, '-4.874')] [2023-12-28 03:04:51,434][106225] Updated weights for policy 1, policy_version 1091253 (0.0008) [2023-12-28 03:04:51,491][106225] Updated weights for policy 1, policy_version 1091263 (0.0008) [2023-12-28 03:04:51,551][106225] Updated weights for policy 1, policy_version 1091273 (0.0007) [2023-12-28 03:04:51,770][106226] Updated weights for policy 0, policy_version 1088476 (0.0009) [2023-12-28 03:04:51,839][106226] Updated weights for policy 0, policy_version 1088486 (0.0006) [2023-12-28 03:04:51,906][106226] Updated weights for policy 0, policy_version 1088496 (0.0006) [2023-12-28 03:04:52,345][106225] Updated weights for policy 1, policy_version 1091283 (0.0007) [2023-12-28 03:04:52,403][106225] Updated weights for policy 1, policy_version 1091293 (0.0008) [2023-12-28 03:04:52,456][106225] Updated weights for policy 1, policy_version 1091304 (0.0008) [2023-12-28 03:04:52,515][106226] Updated weights for policy 0, policy_version 1088506 (0.0007) [2023-12-28 03:04:52,576][106226] Updated weights for policy 0, policy_version 1088516 (0.0007) [2023-12-28 03:04:52,624][106226] Updated weights for policy 0, policy_version 1088526 (0.0009) [2023-12-28 03:04:52,679][106226] Updated weights for policy 0, policy_version 1088536 (0.0008) [2023-12-28 03:04:53,220][106225] Updated weights for policy 1, policy_version 1091314 (0.0008) [2023-12-28 03:04:53,275][106225] Updated weights for policy 1, policy_version 1091324 (0.0005) [2023-12-28 03:04:53,328][106225] Updated weights for policy 1, policy_version 1091334 (0.0005) [2023-12-28 03:04:53,352][106226] Updated weights for policy 0, policy_version 1088546 (0.0008) [2023-12-28 03:04:53,389][106225] Updated weights for policy 1, policy_version 1091344 (0.0005) [2023-12-28 03:04:53,408][106226] Updated weights for policy 0, policy_version 1088556 (0.0009) [2023-12-28 03:04:53,462][106226] Updated weights for policy 0, policy_version 1088566 (0.0008) [2023-12-28 03:04:53,946][106225] Updated weights for policy 1, policy_version 1091354 (0.0009) [2023-12-28 03:04:53,996][106225] Updated weights for policy 1, policy_version 1091364 (0.0008) [2023-12-28 03:04:54,044][106225] Updated weights for policy 1, policy_version 1091374 (0.0008) [2023-12-28 03:04:54,249][106226] Updated weights for policy 0, policy_version 1088576 (0.0008) [2023-12-28 03:04:54,302][106226] Updated weights for policy 0, policy_version 1088587 (0.0011) [2023-12-28 03:04:54,356][106226] Updated weights for policy 0, policy_version 1088597 (0.0009) [2023-12-28 03:04:54,724][106225] Updated weights for policy 1, policy_version 1091384 (0.0006) [2023-12-28 03:04:54,779][106225] Updated weights for policy 1, policy_version 1091394 (0.0005) [2023-12-28 03:04:54,835][106225] Updated weights for policy 1, policy_version 1091404 (0.0005) [2023-12-28 03:04:55,059][106226] Updated weights for policy 0, policy_version 1088608 (0.0007) [2023-12-28 03:04:55,120][106226] Updated weights for policy 0, policy_version 1088618 (0.0011) [2023-12-28 03:04:55,175][106226] Updated weights for policy 0, policy_version 1088628 (0.0010) [2023-12-28 03:04:55,391][106225] Updated weights for policy 1, policy_version 1091414 (0.0008) [2023-12-28 03:04:55,440][106225] Updated weights for policy 1, policy_version 1091424 (0.0010) [2023-12-28 03:04:55,493][106225] Updated weights for policy 1, policy_version 1091434 (0.0010) [2023-12-28 03:04:55,877][106226] Updated weights for policy 0, policy_version 1088638 (0.0009) [2023-12-28 03:04:55,926][106226] Updated weights for policy 0, policy_version 1088648 (0.0008) [2023-12-28 03:04:55,986][106226] Updated weights for policy 0, policy_version 1088658 (0.0006) [2023-12-28 03:04:56,173][106225] Updated weights for policy 1, policy_version 1091444 (0.0008) [2023-12-28 03:04:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 558211072. Throughput: 0: 9918.8, 1: 9980.4. Samples: 558178472. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:04:56,176][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.634')] [2023-12-28 03:04:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001088664_278757376.pth... [2023-12-28 03:04:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001087480_278454272.pth [2023-12-28 03:04:56,231][106225] Updated weights for policy 1, policy_version 1091454 (0.0005) [2023-12-28 03:04:56,281][106225] Updated weights for policy 1, policy_version 1091464 (0.0008) [2023-12-28 03:04:56,324][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001091472_279461888.pth... [2023-12-28 03:04:56,328][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001090288_279158784.pth [2023-12-28 03:04:56,605][106226] Updated weights for policy 0, policy_version 1088668 (0.0007) [2023-12-28 03:04:56,652][106226] Updated weights for policy 0, policy_version 1088678 (0.0006) [2023-12-28 03:04:56,711][106226] Updated weights for policy 0, policy_version 1088688 (0.0005) [2023-12-28 03:04:56,876][106225] Updated weights for policy 1, policy_version 1091474 (0.0008) [2023-12-28 03:04:56,930][106225] Updated weights for policy 1, policy_version 1091484 (0.0005) [2023-12-28 03:04:56,979][106225] Updated weights for policy 1, policy_version 1091494 (0.0005) [2023-12-28 03:04:57,032][106225] Updated weights for policy 1, policy_version 1091504 (0.0005) [2023-12-28 03:04:57,287][106226] Updated weights for policy 0, policy_version 1088698 (0.0006) [2023-12-28 03:04:57,339][106226] Updated weights for policy 0, policy_version 1088708 (0.0009) [2023-12-28 03:04:57,389][106226] Updated weights for policy 0, policy_version 1088718 (0.0008) [2023-12-28 03:04:57,438][106226] Updated weights for policy 0, policy_version 1088728 (0.0009) [2023-12-28 03:04:57,606][106225] Updated weights for policy 1, policy_version 1091514 (0.0009) [2023-12-28 03:04:57,658][106225] Updated weights for policy 1, policy_version 1091524 (0.0008) [2023-12-28 03:04:57,710][106225] Updated weights for policy 1, policy_version 1091534 (0.0009) [2023-12-28 03:04:58,199][106226] Updated weights for policy 0, policy_version 1088738 (0.0009) [2023-12-28 03:04:58,269][106226] Updated weights for policy 0, policy_version 1088748 (0.0008) [2023-12-28 03:04:58,338][106226] Updated weights for policy 0, policy_version 1088758 (0.0009) [2023-12-28 03:04:58,457][106225] Updated weights for policy 1, policy_version 1091544 (0.0009) [2023-12-28 03:04:58,522][106225] Updated weights for policy 1, policy_version 1091554 (0.0011) [2023-12-28 03:04:58,583][106225] Updated weights for policy 1, policy_version 1091564 (0.0010) [2023-12-28 03:04:59,168][106226] Updated weights for policy 0, policy_version 1088768 (0.0010) [2023-12-28 03:04:59,226][106226] Updated weights for policy 0, policy_version 1088779 (0.0010) [2023-12-28 03:04:59,292][106226] Updated weights for policy 0, policy_version 1088789 (0.0008) [2023-12-28 03:04:59,383][106225] Updated weights for policy 1, policy_version 1091574 (0.0009) [2023-12-28 03:04:59,441][106225] Updated weights for policy 1, policy_version 1091584 (0.0008) [2023-12-28 03:04:59,499][106225] Updated weights for policy 1, policy_version 1091594 (0.0009) [2023-12-28 03:05:00,020][106226] Updated weights for policy 0, policy_version 1088799 (0.0007) [2023-12-28 03:05:00,077][106226] Updated weights for policy 0, policy_version 1088809 (0.0006) [2023-12-28 03:05:00,138][106226] Updated weights for policy 0, policy_version 1088819 (0.0008) [2023-12-28 03:05:00,226][106225] Updated weights for policy 1, policy_version 1091604 (0.0011) [2023-12-28 03:05:00,287][106225] Updated weights for policy 1, policy_version 1091614 (0.0010) [2023-12-28 03:05:00,350][106225] Updated weights for policy 1, policy_version 1091624 (0.0010) [2023-12-28 03:05:00,848][106226] Updated weights for policy 0, policy_version 1088829 (0.0008) [2023-12-28 03:05:00,890][106226] Updated weights for policy 0, policy_version 1088839 (0.0008) [2023-12-28 03:05:00,946][106226] Updated weights for policy 0, policy_version 1088849 (0.0007) [2023-12-28 03:05:01,055][106225] Updated weights for policy 1, policy_version 1091634 (0.0010) [2023-12-28 03:05:01,111][106225] Updated weights for policy 1, policy_version 1091644 (0.0010) [2023-12-28 03:05:01,171][106225] Updated weights for policy 1, policy_version 1091654 (0.0012) [2023-12-28 03:05:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 558309376. Throughput: 0: 9983.8, 1: 10058.3. Samples: 558300312. Policy #0 lag: (min: 30.0, avg: 41.5, max: 62.0) [2023-12-28 03:05:01,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-5.041')] [2023-12-28 03:05:01,233][106225] Updated weights for policy 1, policy_version 1091664 (0.0010) [2023-12-28 03:05:01,762][106226] Updated weights for policy 0, policy_version 1088859 (0.0008) [2023-12-28 03:05:01,823][106226] Updated weights for policy 0, policy_version 1088869 (0.0005) [2023-12-28 03:05:01,889][106226] Updated weights for policy 0, policy_version 1088879 (0.0007) [2023-12-28 03:05:01,934][106225] Updated weights for policy 1, policy_version 1091674 (0.0008) [2023-12-28 03:05:01,992][106225] Updated weights for policy 1, policy_version 1091684 (0.0007) [2023-12-28 03:05:02,048][106225] Updated weights for policy 1, policy_version 1091694 (0.0006) [2023-12-28 03:05:02,537][106226] Updated weights for policy 0, policy_version 1088889 (0.0006) [2023-12-28 03:05:02,608][106226] Updated weights for policy 0, policy_version 1088899 (0.0010) [2023-12-28 03:05:02,676][106226] Updated weights for policy 0, policy_version 1088909 (0.0008) [2023-12-28 03:05:02,714][106225] Updated weights for policy 1, policy_version 1091704 (0.0006) [2023-12-28 03:05:02,732][106226] Updated weights for policy 0, policy_version 1088919 (0.0007) [2023-12-28 03:05:02,770][106225] Updated weights for policy 1, policy_version 1091714 (0.0008) [2023-12-28 03:05:02,821][106225] Updated weights for policy 1, policy_version 1091724 (0.0008) [2023-12-28 03:05:03,453][106226] Updated weights for policy 0, policy_version 1088929 (0.0009) [2023-12-28 03:05:03,512][106226] Updated weights for policy 0, policy_version 1088939 (0.0008) [2023-12-28 03:05:03,555][106225] Updated weights for policy 1, policy_version 1091734 (0.0008) [2023-12-28 03:05:03,565][106226] Updated weights for policy 0, policy_version 1088949 (0.0007) [2023-12-28 03:05:03,601][106225] Updated weights for policy 1, policy_version 1091744 (0.0007) [2023-12-28 03:05:03,646][106225] Updated weights for policy 1, policy_version 1091754 (0.0008) [2023-12-28 03:05:04,272][106226] Updated weights for policy 0, policy_version 1088959 (0.0009) [2023-12-28 03:05:04,319][106226] Updated weights for policy 0, policy_version 1088969 (0.0011) [2023-12-28 03:05:04,370][106226] Updated weights for policy 0, policy_version 1088979 (0.0010) [2023-12-28 03:05:04,428][106225] Updated weights for policy 1, policy_version 1091764 (0.0008) [2023-12-28 03:05:04,477][106225] Updated weights for policy 1, policy_version 1091774 (0.0008) [2023-12-28 03:05:04,524][106225] Updated weights for policy 1, policy_version 1091784 (0.0008) [2023-12-28 03:05:05,084][106226] Updated weights for policy 0, policy_version 1088989 (0.0010) [2023-12-28 03:05:05,144][106226] Updated weights for policy 0, policy_version 1088999 (0.0010) [2023-12-28 03:05:05,206][106226] Updated weights for policy 0, policy_version 1089009 (0.0010) [2023-12-28 03:05:05,294][106225] Updated weights for policy 1, policy_version 1091794 (0.0008) [2023-12-28 03:05:05,361][106225] Updated weights for policy 1, policy_version 1091804 (0.0009) [2023-12-28 03:05:05,424][106225] Updated weights for policy 1, policy_version 1091814 (0.0008) [2023-12-28 03:05:05,486][106225] Updated weights for policy 1, policy_version 1091824 (0.0009) [2023-12-28 03:05:05,819][106226] Updated weights for policy 0, policy_version 1089019 (0.0008) [2023-12-28 03:05:05,877][106226] Updated weights for policy 0, policy_version 1089029 (0.0010) [2023-12-28 03:05:05,929][106226] Updated weights for policy 0, policy_version 1089039 (0.0006) [2023-12-28 03:05:06,158][106225] Updated weights for policy 1, policy_version 1091834 (0.0008) [2023-12-28 03:05:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 558407680. Throughput: 0: 9996.7, 1: 9991.5. Samples: 558418068. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:06,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.857')] [2023-12-28 03:05:06,221][106225] Updated weights for policy 1, policy_version 1091844 (0.0008) [2023-12-28 03:05:06,281][106225] Updated weights for policy 1, policy_version 1091854 (0.0006) [2023-12-28 03:05:06,548][106226] Updated weights for policy 0, policy_version 1089049 (0.0006) [2023-12-28 03:05:06,614][106226] Updated weights for policy 0, policy_version 1089059 (0.0008) [2023-12-28 03:05:06,683][106226] Updated weights for policy 0, policy_version 1089069 (0.0006) [2023-12-28 03:05:06,742][106226] Updated weights for policy 0, policy_version 1089079 (0.0006) [2023-12-28 03:05:06,946][106225] Updated weights for policy 1, policy_version 1091864 (0.0008) [2023-12-28 03:05:07,012][106225] Updated weights for policy 1, policy_version 1091874 (0.0009) [2023-12-28 03:05:07,067][106225] Updated weights for policy 1, policy_version 1091884 (0.0009) [2023-12-28 03:05:07,314][106226] Updated weights for policy 0, policy_version 1089089 (0.0008) [2023-12-28 03:05:07,373][106226] Updated weights for policy 0, policy_version 1089099 (0.0005) [2023-12-28 03:05:07,431][106226] Updated weights for policy 0, policy_version 1089109 (0.0007) [2023-12-28 03:05:07,790][106225] Updated weights for policy 1, policy_version 1091894 (0.0008) [2023-12-28 03:05:07,851][106225] Updated weights for policy 1, policy_version 1091904 (0.0009) [2023-12-28 03:05:07,912][106225] Updated weights for policy 1, policy_version 1091914 (0.0009) [2023-12-28 03:05:08,057][106226] Updated weights for policy 0, policy_version 1089119 (0.0008) [2023-12-28 03:05:08,121][106226] Updated weights for policy 0, policy_version 1089129 (0.0009) [2023-12-28 03:05:08,177][106226] Updated weights for policy 0, policy_version 1089139 (0.0009) [2023-12-28 03:05:08,639][106225] Updated weights for policy 1, policy_version 1091924 (0.0008) [2023-12-28 03:05:08,703][106225] Updated weights for policy 1, policy_version 1091934 (0.0009) [2023-12-28 03:05:08,771][106225] Updated weights for policy 1, policy_version 1091944 (0.0011) [2023-12-28 03:05:08,853][106226] Updated weights for policy 0, policy_version 1089149 (0.0007) [2023-12-28 03:05:08,909][106226] Updated weights for policy 0, policy_version 1089159 (0.0008) [2023-12-28 03:05:08,962][106226] Updated weights for policy 0, policy_version 1089169 (0.0007) [2023-12-28 03:05:09,584][106225] Updated weights for policy 1, policy_version 1091954 (0.0009) [2023-12-28 03:05:09,622][106226] Updated weights for policy 0, policy_version 1089179 (0.0007) [2023-12-28 03:05:09,644][106225] Updated weights for policy 1, policy_version 1091964 (0.0007) [2023-12-28 03:05:09,686][106226] Updated weights for policy 0, policy_version 1089189 (0.0008) [2023-12-28 03:05:09,706][106225] Updated weights for policy 1, policy_version 1091974 (0.0007) [2023-12-28 03:05:09,753][106226] Updated weights for policy 0, policy_version 1089199 (0.0008) [2023-12-28 03:05:09,766][106225] Updated weights for policy 1, policy_version 1091984 (0.0006) [2023-12-28 03:05:10,438][106226] Updated weights for policy 0, policy_version 1089209 (0.0010) [2023-12-28 03:05:10,499][106226] Updated weights for policy 0, policy_version 1089219 (0.0007) [2023-12-28 03:05:10,500][106225] Updated weights for policy 1, policy_version 1091994 (0.0007) [2023-12-28 03:05:10,553][106225] Updated weights for policy 1, policy_version 1092004 (0.0007) [2023-12-28 03:05:10,558][106226] Updated weights for policy 0, policy_version 1089229 (0.0006) [2023-12-28 03:05:10,601][106225] Updated weights for policy 1, policy_version 1092014 (0.0009) [2023-12-28 03:05:10,609][106226] Updated weights for policy 0, policy_version 1089239 (0.0009) [2023-12-28 03:05:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 558505984. Throughput: 0: 10092.3, 1: 10029.0. Samples: 558479804. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:11,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.687')] [2023-12-28 03:05:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001089240_278904832.pth... [2023-12-28 03:05:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001088088_278609920.pth [2023-12-28 03:05:11,233][106225] Updated weights for policy 1, policy_version 1092024 (0.0008) [2023-12-28 03:05:11,300][106225] Updated weights for policy 1, policy_version 1092034 (0.0007) [2023-12-28 03:05:11,328][106226] Updated weights for policy 0, policy_version 1089249 (0.0008) [2023-12-28 03:05:11,371][106225] Updated weights for policy 1, policy_version 1092044 (0.0007) [2023-12-28 03:05:11,399][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001092048_279609344.pth... [2023-12-28 03:05:11,403][106226] Updated weights for policy 0, policy_version 1089259 (0.0008) [2023-12-28 03:05:11,403][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001090864_279306240.pth [2023-12-28 03:05:11,473][106226] Updated weights for policy 0, policy_version 1089269 (0.0006) [2023-12-28 03:05:12,123][106225] Updated weights for policy 1, policy_version 1092054 (0.0009) [2023-12-28 03:05:12,179][106225] Updated weights for policy 1, policy_version 1092064 (0.0008) [2023-12-28 03:05:12,222][106226] Updated weights for policy 0, policy_version 1089279 (0.0007) [2023-12-28 03:05:12,240][106225] Updated weights for policy 1, policy_version 1092074 (0.0007) [2023-12-28 03:05:12,280][106226] Updated weights for policy 0, policy_version 1089289 (0.0008) [2023-12-28 03:05:12,350][106226] Updated weights for policy 0, policy_version 1089299 (0.0008) [2023-12-28 03:05:12,910][106225] Updated weights for policy 1, policy_version 1092084 (0.0008) [2023-12-28 03:05:12,970][106225] Updated weights for policy 1, policy_version 1092094 (0.0008) [2023-12-28 03:05:13,031][106225] Updated weights for policy 1, policy_version 1092104 (0.0007) [2023-12-28 03:05:13,117][106226] Updated weights for policy 0, policy_version 1089309 (0.0009) [2023-12-28 03:05:13,171][106226] Updated weights for policy 0, policy_version 1089319 (0.0008) [2023-12-28 03:05:13,221][106226] Updated weights for policy 0, policy_version 1089329 (0.0006) [2023-12-28 03:05:13,758][106225] Updated weights for policy 1, policy_version 1092114 (0.0008) [2023-12-28 03:05:13,814][106225] Updated weights for policy 1, policy_version 1092124 (0.0008) [2023-12-28 03:05:13,871][106225] Updated weights for policy 1, policy_version 1092134 (0.0009) [2023-12-28 03:05:13,930][106225] Updated weights for policy 1, policy_version 1092144 (0.0008) [2023-12-28 03:05:13,949][106226] Updated weights for policy 0, policy_version 1089339 (0.0008) [2023-12-28 03:05:14,007][106226] Updated weights for policy 0, policy_version 1089349 (0.0008) [2023-12-28 03:05:14,058][106226] Updated weights for policy 0, policy_version 1089359 (0.0007) [2023-12-28 03:05:14,540][106225] Updated weights for policy 1, policy_version 1092154 (0.0005) [2023-12-28 03:05:14,604][106225] Updated weights for policy 1, policy_version 1092164 (0.0005) [2023-12-28 03:05:14,666][106225] Updated weights for policy 1, policy_version 1092174 (0.0005) [2023-12-28 03:05:14,856][106226] Updated weights for policy 0, policy_version 1089369 (0.0007) [2023-12-28 03:05:14,925][106226] Updated weights for policy 0, policy_version 1089379 (0.0008) [2023-12-28 03:05:14,995][106226] Updated weights for policy 0, policy_version 1089389 (0.0008) [2023-12-28 03:05:15,065][106226] Updated weights for policy 0, policy_version 1089399 (0.0008) [2023-12-28 03:05:15,313][106225] Updated weights for policy 1, policy_version 1092184 (0.0008) [2023-12-28 03:05:15,381][106225] Updated weights for policy 1, policy_version 1092194 (0.0009) [2023-12-28 03:05:15,440][106225] Updated weights for policy 1, policy_version 1092204 (0.0008) [2023-12-28 03:05:15,800][106226] Updated weights for policy 0, policy_version 1089409 (0.0008) [2023-12-28 03:05:15,862][106226] Updated weights for policy 0, policy_version 1089419 (0.0009) [2023-12-28 03:05:15,919][106226] Updated weights for policy 0, policy_version 1089429 (0.0008) [2023-12-28 03:05:16,139][106225] Updated weights for policy 1, policy_version 1092214 (0.0007) [2023-12-28 03:05:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 558604288. Throughput: 0: 9926.0, 1: 9962.2. Samples: 558595260. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:16,176][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.972')] [2023-12-28 03:05:16,187][106225] Updated weights for policy 1, policy_version 1092224 (0.0007) [2023-12-28 03:05:16,238][106225] Updated weights for policy 1, policy_version 1092234 (0.0008) [2023-12-28 03:05:16,673][106226] Updated weights for policy 0, policy_version 1089439 (0.0008) [2023-12-28 03:05:16,740][106226] Updated weights for policy 0, policy_version 1089449 (0.0008) [2023-12-28 03:05:16,802][106226] Updated weights for policy 0, policy_version 1089459 (0.0010) [2023-12-28 03:05:17,018][106225] Updated weights for policy 1, policy_version 1092244 (0.0007) [2023-12-28 03:05:17,071][106225] Updated weights for policy 1, policy_version 1092254 (0.0008) [2023-12-28 03:05:17,119][106225] Updated weights for policy 1, policy_version 1092264 (0.0008) [2023-12-28 03:05:17,484][106226] Updated weights for policy 0, policy_version 1089469 (0.0010) [2023-12-28 03:05:17,541][106226] Updated weights for policy 0, policy_version 1089479 (0.0010) [2023-12-28 03:05:17,600][106226] Updated weights for policy 0, policy_version 1089489 (0.0008) [2023-12-28 03:05:17,836][106225] Updated weights for policy 1, policy_version 1092274 (0.0007) [2023-12-28 03:05:17,895][106225] Updated weights for policy 1, policy_version 1092284 (0.0008) [2023-12-28 03:05:17,946][106225] Updated weights for policy 1, policy_version 1092294 (0.0009) [2023-12-28 03:05:17,996][106225] Updated weights for policy 1, policy_version 1092304 (0.0008) [2023-12-28 03:05:18,163][106226] Updated weights for policy 0, policy_version 1089499 (0.0006) [2023-12-28 03:05:18,222][106226] Updated weights for policy 0, policy_version 1089509 (0.0006) [2023-12-28 03:05:18,283][106226] Updated weights for policy 0, policy_version 1089519 (0.0009) [2023-12-28 03:05:18,786][106225] Updated weights for policy 1, policy_version 1092314 (0.0007) [2023-12-28 03:05:18,853][106225] Updated weights for policy 1, policy_version 1092324 (0.0008) [2023-12-28 03:05:18,910][106226] Updated weights for policy 0, policy_version 1089529 (0.0009) [2023-12-28 03:05:18,916][106225] Updated weights for policy 1, policy_version 1092334 (0.0008) [2023-12-28 03:05:18,970][106226] Updated weights for policy 0, policy_version 1089539 (0.0009) [2023-12-28 03:05:19,029][106226] Updated weights for policy 0, policy_version 1089549 (0.0008) [2023-12-28 03:05:19,083][106226] Updated weights for policy 0, policy_version 1089559 (0.0011) [2023-12-28 03:05:19,740][106225] Updated weights for policy 1, policy_version 1092344 (0.0006) [2023-12-28 03:05:19,768][106226] Updated weights for policy 0, policy_version 1089569 (0.0011) [2023-12-28 03:05:19,803][106225] Updated weights for policy 1, policy_version 1092354 (0.0006) [2023-12-28 03:05:19,829][106226] Updated weights for policy 0, policy_version 1089579 (0.0010) [2023-12-28 03:05:19,872][106225] Updated weights for policy 1, policy_version 1092364 (0.0007) [2023-12-28 03:05:19,899][106226] Updated weights for policy 0, policy_version 1089589 (0.0009) [2023-12-28 03:05:20,543][106226] Updated weights for policy 0, policy_version 1089599 (0.0008) [2023-12-28 03:05:20,609][106226] Updated weights for policy 0, policy_version 1089609 (0.0008) [2023-12-28 03:05:20,671][106226] Updated weights for policy 0, policy_version 1089619 (0.0008) [2023-12-28 03:05:20,689][106225] Updated weights for policy 1, policy_version 1092374 (0.0010) [2023-12-28 03:05:20,744][106225] Updated weights for policy 1, policy_version 1092384 (0.0010) [2023-12-28 03:05:20,792][106225] Updated weights for policy 1, policy_version 1092394 (0.0010) [2023-12-28 03:05:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 558702592. Throughput: 0: 9960.2, 1: 9897.1. Samples: 558711708. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:21,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.756')] [2023-12-28 03:05:21,464][106226] Updated weights for policy 0, policy_version 1089629 (0.0007) [2023-12-28 03:05:21,470][106225] Updated weights for policy 1, policy_version 1092404 (0.0006) [2023-12-28 03:05:21,525][106226] Updated weights for policy 0, policy_version 1089639 (0.0007) [2023-12-28 03:05:21,539][106225] Updated weights for policy 1, policy_version 1092414 (0.0006) [2023-12-28 03:05:21,586][106226] Updated weights for policy 0, policy_version 1089649 (0.0009) [2023-12-28 03:05:21,605][106225] Updated weights for policy 1, policy_version 1092424 (0.0007) [2023-12-28 03:05:22,252][106225] Updated weights for policy 1, policy_version 1092434 (0.0009) [2023-12-28 03:05:22,312][106225] Updated weights for policy 1, policy_version 1092444 (0.0008) [2023-12-28 03:05:22,383][106225] Updated weights for policy 1, policy_version 1092454 (0.0008) [2023-12-28 03:05:22,398][106226] Updated weights for policy 0, policy_version 1089659 (0.0008) [2023-12-28 03:05:22,450][106225] Updated weights for policy 1, policy_version 1092464 (0.0008) [2023-12-28 03:05:22,463][106226] Updated weights for policy 0, policy_version 1089669 (0.0007) [2023-12-28 03:05:22,522][106226] Updated weights for policy 0, policy_version 1089679 (0.0008) [2023-12-28 03:05:23,164][106225] Updated weights for policy 1, policy_version 1092474 (0.0010) [2023-12-28 03:05:23,231][106225] Updated weights for policy 1, policy_version 1092484 (0.0010) [2023-12-28 03:05:23,252][106226] Updated weights for policy 0, policy_version 1089689 (0.0008) [2023-12-28 03:05:23,292][106225] Updated weights for policy 1, policy_version 1092494 (0.0010) [2023-12-28 03:05:23,330][106226] Updated weights for policy 0, policy_version 1089699 (0.0005) [2023-12-28 03:05:23,381][106226] Updated weights for policy 0, policy_version 1089709 (0.0005) [2023-12-28 03:05:23,447][106226] Updated weights for policy 0, policy_version 1089719 (0.0008) [2023-12-28 03:05:23,974][106225] Updated weights for policy 1, policy_version 1092504 (0.0007) [2023-12-28 03:05:24,038][106225] Updated weights for policy 1, policy_version 1092514 (0.0007) [2023-12-28 03:05:24,040][106226] Updated weights for policy 0, policy_version 1089729 (0.0009) [2023-12-28 03:05:24,097][106225] Updated weights for policy 1, policy_version 1092524 (0.0005) [2023-12-28 03:05:24,109][106226] Updated weights for policy 0, policy_version 1089739 (0.0010) [2023-12-28 03:05:24,176][106226] Updated weights for policy 0, policy_version 1089749 (0.0010) [2023-12-28 03:05:24,632][106225] Updated weights for policy 1, policy_version 1092534 (0.0006) [2023-12-28 03:05:24,698][106225] Updated weights for policy 1, policy_version 1092544 (0.0010) [2023-12-28 03:05:24,760][106225] Updated weights for policy 1, policy_version 1092554 (0.0010) [2023-12-28 03:05:24,862][106226] Updated weights for policy 0, policy_version 1089759 (0.0008) [2023-12-28 03:05:24,915][106226] Updated weights for policy 0, policy_version 1089769 (0.0010) [2023-12-28 03:05:24,962][106226] Updated weights for policy 0, policy_version 1089779 (0.0010) [2023-12-28 03:05:25,437][106225] Updated weights for policy 1, policy_version 1092564 (0.0008) [2023-12-28 03:05:25,496][106225] Updated weights for policy 1, policy_version 1092574 (0.0006) [2023-12-28 03:05:25,546][106225] Updated weights for policy 1, policy_version 1092584 (0.0005) [2023-12-28 03:05:25,677][106226] Updated weights for policy 0, policy_version 1089789 (0.0010) [2023-12-28 03:05:25,724][106226] Updated weights for policy 0, policy_version 1089799 (0.0010) [2023-12-28 03:05:25,778][106226] Updated weights for policy 0, policy_version 1089809 (0.0008) [2023-12-28 03:05:26,122][106225] Updated weights for policy 1, policy_version 1092594 (0.0009) [2023-12-28 03:05:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 558800896. Throughput: 0: 9923.4, 1: 9863.1. Samples: 558770368. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:26,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.830')] [2023-12-28 03:05:26,175][106225] Updated weights for policy 1, policy_version 1092604 (0.0010) [2023-12-28 03:05:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001089816_279052288.pth... [2023-12-28 03:05:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001088664_278757376.pth [2023-12-28 03:05:26,230][106225] Updated weights for policy 1, policy_version 1092614 (0.0006) [2023-12-28 03:05:26,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001092624_279756800.pth... [2023-12-28 03:05:26,276][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001091472_279461888.pth [2023-12-28 03:05:26,276][106225] Updated weights for policy 1, policy_version 1092624 (0.0010) [2023-12-28 03:05:26,501][106226] Updated weights for policy 0, policy_version 1089819 (0.0010) [2023-12-28 03:05:26,549][106226] Updated weights for policy 0, policy_version 1089829 (0.0010) [2023-12-28 03:05:26,598][106226] Updated weights for policy 0, policy_version 1089839 (0.0008) [2023-12-28 03:05:26,880][106225] Updated weights for policy 1, policy_version 1092634 (0.0007) [2023-12-28 03:05:26,932][106225] Updated weights for policy 1, policy_version 1092644 (0.0010) [2023-12-28 03:05:26,986][106225] Updated weights for policy 1, policy_version 1092654 (0.0010) [2023-12-28 03:05:27,339][106226] Updated weights for policy 0, policy_version 1089849 (0.0008) [2023-12-28 03:05:27,396][106226] Updated weights for policy 0, policy_version 1089859 (0.0006) [2023-12-28 03:05:27,448][106226] Updated weights for policy 0, policy_version 1089869 (0.0007) [2023-12-28 03:05:27,507][106226] Updated weights for policy 0, policy_version 1089879 (0.0008) [2023-12-28 03:05:27,614][106225] Updated weights for policy 1, policy_version 1092664 (0.0010) [2023-12-28 03:05:27,664][106225] Updated weights for policy 1, policy_version 1092674 (0.0010) [2023-12-28 03:05:27,710][106225] Updated weights for policy 1, policy_version 1092684 (0.0010) [2023-12-28 03:05:28,274][106225] Updated weights for policy 1, policy_version 1092694 (0.0007) [2023-12-28 03:05:28,287][106226] Updated weights for policy 0, policy_version 1089889 (0.0008) [2023-12-28 03:05:28,327][106225] Updated weights for policy 1, policy_version 1092704 (0.0005) [2023-12-28 03:05:28,345][106226] Updated weights for policy 0, policy_version 1089899 (0.0008) [2023-12-28 03:05:28,382][106225] Updated weights for policy 1, policy_version 1092714 (0.0008) [2023-12-28 03:05:28,401][106226] Updated weights for policy 0, policy_version 1089909 (0.0008) [2023-12-28 03:05:29,083][106225] Updated weights for policy 1, policy_version 1092724 (0.0008) [2023-12-28 03:05:29,131][106225] Updated weights for policy 1, policy_version 1092734 (0.0005) [2023-12-28 03:05:29,142][106226] Updated weights for policy 0, policy_version 1089919 (0.0008) [2023-12-28 03:05:29,196][106226] Updated weights for policy 0, policy_version 1089929 (0.0007) [2023-12-28 03:05:29,208][106225] Updated weights for policy 1, policy_version 1092744 (0.0006) [2023-12-28 03:05:29,259][106226] Updated weights for policy 0, policy_version 1089939 (0.0008) [2023-12-28 03:05:29,836][106225] Updated weights for policy 1, policy_version 1092754 (0.0008) [2023-12-28 03:05:29,905][106225] Updated weights for policy 1, policy_version 1092764 (0.0007) [2023-12-28 03:05:29,974][106225] Updated weights for policy 1, policy_version 1092774 (0.0008) [2023-12-28 03:05:30,012][106226] Updated weights for policy 0, policy_version 1089949 (0.0006) [2023-12-28 03:05:30,030][106225] Updated weights for policy 1, policy_version 1092784 (0.0008) [2023-12-28 03:05:30,061][106226] Updated weights for policy 0, policy_version 1089959 (0.0007) [2023-12-28 03:05:30,119][106226] Updated weights for policy 0, policy_version 1089969 (0.0006) [2023-12-28 03:05:30,648][106225] Updated weights for policy 1, policy_version 1092794 (0.0010) [2023-12-28 03:05:30,706][106226] Updated weights for policy 0, policy_version 1089979 (0.0005) [2023-12-28 03:05:30,707][106225] Updated weights for policy 1, policy_version 1092804 (0.0010) [2023-12-28 03:05:30,764][106225] Updated weights for policy 1, policy_version 1092814 (0.0008) [2023-12-28 03:05:30,767][106226] Updated weights for policy 0, policy_version 1089989 (0.0005) [2023-12-28 03:05:30,819][106226] Updated weights for policy 0, policy_version 1089999 (0.0005) [2023-12-28 03:05:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 558907392. Throughput: 0: 9875.9, 1: 10067.7. Samples: 558894408. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:31,175][105115] Avg episode reward: [(0, '-4.304'), (1, '-4.918')] [2023-12-28 03:05:31,367][106226] Updated weights for policy 0, policy_version 1090009 (0.0005) [2023-12-28 03:05:31,435][106226] Updated weights for policy 0, policy_version 1090019 (0.0008) [2023-12-28 03:05:31,500][106226] Updated weights for policy 0, policy_version 1090029 (0.0008) [2023-12-28 03:05:31,525][106225] Updated weights for policy 1, policy_version 1092824 (0.0008) [2023-12-28 03:05:31,562][106226] Updated weights for policy 0, policy_version 1090039 (0.0008) [2023-12-28 03:05:31,586][106225] Updated weights for policy 1, policy_version 1092834 (0.0007) [2023-12-28 03:05:31,650][106225] Updated weights for policy 1, policy_version 1092844 (0.0008) [2023-12-28 03:05:32,233][106226] Updated weights for policy 0, policy_version 1090049 (0.0006) [2023-12-28 03:05:32,299][106226] Updated weights for policy 0, policy_version 1090059 (0.0006) [2023-12-28 03:05:32,364][106226] Updated weights for policy 0, policy_version 1090069 (0.0008) [2023-12-28 03:05:32,429][106225] Updated weights for policy 1, policy_version 1092854 (0.0007) [2023-12-28 03:05:32,491][106225] Updated weights for policy 1, policy_version 1092864 (0.0008) [2023-12-28 03:05:32,557][106225] Updated weights for policy 1, policy_version 1092874 (0.0008) [2023-12-28 03:05:33,030][106226] Updated weights for policy 0, policy_version 1090079 (0.0006) [2023-12-28 03:05:33,096][106226] Updated weights for policy 0, policy_version 1090089 (0.0005) [2023-12-28 03:05:33,146][106226] Updated weights for policy 0, policy_version 1090099 (0.0009) [2023-12-28 03:05:33,290][106225] Updated weights for policy 1, policy_version 1092884 (0.0009) [2023-12-28 03:05:33,359][106225] Updated weights for policy 1, policy_version 1092894 (0.0009) [2023-12-28 03:05:33,422][106225] Updated weights for policy 1, policy_version 1092904 (0.0006) [2023-12-28 03:05:33,655][106226] Updated weights for policy 0, policy_version 1090109 (0.0006) [2023-12-28 03:05:33,719][106226] Updated weights for policy 0, policy_version 1090119 (0.0005) [2023-12-28 03:05:33,784][106226] Updated weights for policy 0, policy_version 1090129 (0.0005) [2023-12-28 03:05:34,163][106225] Updated weights for policy 1, policy_version 1092914 (0.0008) [2023-12-28 03:05:34,225][106225] Updated weights for policy 1, policy_version 1092924 (0.0009) [2023-12-28 03:05:34,293][106225] Updated weights for policy 1, policy_version 1092934 (0.0009) [2023-12-28 03:05:34,349][106225] Updated weights for policy 1, policy_version 1092944 (0.0008) [2023-12-28 03:05:34,389][106226] Updated weights for policy 0, policy_version 1090139 (0.0006) [2023-12-28 03:05:34,442][106226] Updated weights for policy 0, policy_version 1090149 (0.0009) [2023-12-28 03:05:34,499][106226] Updated weights for policy 0, policy_version 1090159 (0.0008) [2023-12-28 03:05:35,108][106225] Updated weights for policy 1, policy_version 1092954 (0.0008) [2023-12-28 03:05:35,156][106225] Updated weights for policy 1, policy_version 1092964 (0.0008) [2023-12-28 03:05:35,189][106226] Updated weights for policy 0, policy_version 1090169 (0.0006) [2023-12-28 03:05:35,209][106225] Updated weights for policy 1, policy_version 1092974 (0.0008) [2023-12-28 03:05:35,245][106226] Updated weights for policy 0, policy_version 1090179 (0.0007) [2023-12-28 03:05:35,302][106226] Updated weights for policy 0, policy_version 1090189 (0.0009) [2023-12-28 03:05:35,361][106226] Updated weights for policy 0, policy_version 1090199 (0.0008) [2023-12-28 03:05:35,991][106226] Updated weights for policy 0, policy_version 1090209 (0.0006) [2023-12-28 03:05:36,015][106225] Updated weights for policy 1, policy_version 1092984 (0.0008) [2023-12-28 03:05:36,053][106226] Updated weights for policy 0, policy_version 1090219 (0.0006) [2023-12-28 03:05:36,079][106225] Updated weights for policy 1, policy_version 1092994 (0.0006) [2023-12-28 03:05:36,120][106226] Updated weights for policy 0, policy_version 1090229 (0.0007) [2023-12-28 03:05:36,142][106225] Updated weights for policy 1, policy_version 1093004 (0.0007) [2023-12-28 03:05:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 559013888. Throughput: 0: 9995.1, 1: 9941.5. Samples: 559016764. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:36,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.825')] [2023-12-28 03:05:36,734][106225] Updated weights for policy 1, policy_version 1093014 (0.0006) [2023-12-28 03:05:36,773][106226] Updated weights for policy 0, policy_version 1090239 (0.0010) [2023-12-28 03:05:36,794][106225] Updated weights for policy 1, policy_version 1093024 (0.0005) [2023-12-28 03:05:36,831][106226] Updated weights for policy 0, policy_version 1090249 (0.0011) [2023-12-28 03:05:36,851][106225] Updated weights for policy 1, policy_version 1093034 (0.0005) [2023-12-28 03:05:36,895][106226] Updated weights for policy 0, policy_version 1090259 (0.0011) [2023-12-28 03:05:37,402][106225] Updated weights for policy 1, policy_version 1093044 (0.0006) [2023-12-28 03:05:37,461][106225] Updated weights for policy 1, policy_version 1093054 (0.0009) [2023-12-28 03:05:37,519][106225] Updated weights for policy 1, policy_version 1093064 (0.0008) [2023-12-28 03:05:37,655][106226] Updated weights for policy 0, policy_version 1090269 (0.0010) [2023-12-28 03:05:37,705][106226] Updated weights for policy 0, policy_version 1090279 (0.0008) [2023-12-28 03:05:37,758][106226] Updated weights for policy 0, policy_version 1090289 (0.0009) [2023-12-28 03:05:38,126][106225] Updated weights for policy 1, policy_version 1093074 (0.0009) [2023-12-28 03:05:38,170][106225] Updated weights for policy 1, policy_version 1093084 (0.0008) [2023-12-28 03:05:38,218][106225] Updated weights for policy 1, policy_version 1093094 (0.0005) [2023-12-28 03:05:38,271][106225] Updated weights for policy 1, policy_version 1093104 (0.0005) [2023-12-28 03:05:38,583][106226] Updated weights for policy 0, policy_version 1090299 (0.0009) [2023-12-28 03:05:38,648][106226] Updated weights for policy 0, policy_version 1090309 (0.0009) [2023-12-28 03:05:38,709][106226] Updated weights for policy 0, policy_version 1090319 (0.0009) [2023-12-28 03:05:39,015][106225] Updated weights for policy 1, policy_version 1093114 (0.0008) [2023-12-28 03:05:39,061][106225] Updated weights for policy 1, policy_version 1093124 (0.0007) [2023-12-28 03:05:39,103][106225] Updated weights for policy 1, policy_version 1093134 (0.0007) [2023-12-28 03:05:39,394][106226] Updated weights for policy 0, policy_version 1090329 (0.0008) [2023-12-28 03:05:39,460][106226] Updated weights for policy 0, policy_version 1090339 (0.0009) [2023-12-28 03:05:39,512][106226] Updated weights for policy 0, policy_version 1090349 (0.0008) [2023-12-28 03:05:39,568][106226] Updated weights for policy 0, policy_version 1090359 (0.0008) [2023-12-28 03:05:39,934][106225] Updated weights for policy 1, policy_version 1093144 (0.0009) [2023-12-28 03:05:39,996][106225] Updated weights for policy 1, policy_version 1093154 (0.0008) [2023-12-28 03:05:40,051][106225] Updated weights for policy 1, policy_version 1093164 (0.0009) [2023-12-28 03:05:40,349][106226] Updated weights for policy 0, policy_version 1090369 (0.0008) [2023-12-28 03:05:40,414][106226] Updated weights for policy 0, policy_version 1090379 (0.0008) [2023-12-28 03:05:40,474][106226] Updated weights for policy 0, policy_version 1090389 (0.0009) [2023-12-28 03:05:40,789][106225] Updated weights for policy 1, policy_version 1093174 (0.0008) [2023-12-28 03:05:40,837][106225] Updated weights for policy 1, policy_version 1093184 (0.0008) [2023-12-28 03:05:40,885][106225] Updated weights for policy 1, policy_version 1093194 (0.0008) [2023-12-28 03:05:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 559104000. Throughput: 0: 9973.0, 1: 10005.4. Samples: 559077496. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:41,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.923')] [2023-12-28 03:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001093200_279904256.pth... [2023-12-28 03:05:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001092048_279609344.pth [2023-12-28 03:05:41,218][106226] Updated weights for policy 0, policy_version 1090399 (0.0008) [2023-12-28 03:05:41,284][106226] Updated weights for policy 0, policy_version 1090409 (0.0009) [2023-12-28 03:05:41,350][106226] Updated weights for policy 0, policy_version 1090419 (0.0009) [2023-12-28 03:05:41,384][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001090424_279207936.pth... [2023-12-28 03:05:41,389][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001089240_278904832.pth [2023-12-28 03:05:41,714][106225] Updated weights for policy 1, policy_version 1093204 (0.0008) [2023-12-28 03:05:41,782][106225] Updated weights for policy 1, policy_version 1093214 (0.0007) [2023-12-28 03:05:41,841][106225] Updated weights for policy 1, policy_version 1093224 (0.0008) [2023-12-28 03:05:42,080][106226] Updated weights for policy 0, policy_version 1090429 (0.0009) [2023-12-28 03:05:42,142][106226] Updated weights for policy 0, policy_version 1090439 (0.0009) [2023-12-28 03:05:42,205][106226] Updated weights for policy 0, policy_version 1090449 (0.0008) [2023-12-28 03:05:42,549][106225] Updated weights for policy 1, policy_version 1093234 (0.0009) [2023-12-28 03:05:42,599][106225] Updated weights for policy 1, policy_version 1093244 (0.0008) [2023-12-28 03:05:42,655][106225] Updated weights for policy 1, policy_version 1093254 (0.0006) [2023-12-28 03:05:42,725][106225] Updated weights for policy 1, policy_version 1093264 (0.0005) [2023-12-28 03:05:42,904][106226] Updated weights for policy 0, policy_version 1090459 (0.0009) [2023-12-28 03:05:42,964][106226] Updated weights for policy 0, policy_version 1090469 (0.0008) [2023-12-28 03:05:43,024][106226] Updated weights for policy 0, policy_version 1090479 (0.0007) [2023-12-28 03:05:43,424][106225] Updated weights for policy 1, policy_version 1093274 (0.0008) [2023-12-28 03:05:43,478][106225] Updated weights for policy 1, policy_version 1093284 (0.0009) [2023-12-28 03:05:43,530][106225] Updated weights for policy 1, policy_version 1093294 (0.0008) [2023-12-28 03:05:43,622][106226] Updated weights for policy 0, policy_version 1090489 (0.0007) [2023-12-28 03:05:43,689][106226] Updated weights for policy 0, policy_version 1090499 (0.0010) [2023-12-28 03:05:43,746][106226] Updated weights for policy 0, policy_version 1090509 (0.0011) [2023-12-28 03:05:43,806][106226] Updated weights for policy 0, policy_version 1090519 (0.0007) [2023-12-28 03:05:44,302][106225] Updated weights for policy 1, policy_version 1093304 (0.0010) [2023-12-28 03:05:44,368][106225] Updated weights for policy 1, policy_version 1093314 (0.0010) [2023-12-28 03:05:44,430][106225] Updated weights for policy 1, policy_version 1093324 (0.0006) [2023-12-28 03:05:44,451][106226] Updated weights for policy 0, policy_version 1090529 (0.0007) [2023-12-28 03:05:44,510][106226] Updated weights for policy 0, policy_version 1090539 (0.0009) [2023-12-28 03:05:44,563][106226] Updated weights for policy 0, policy_version 1090549 (0.0010) [2023-12-28 03:05:45,160][106225] Updated weights for policy 1, policy_version 1093334 (0.0007) [2023-12-28 03:05:45,214][106225] Updated weights for policy 1, policy_version 1093344 (0.0009) [2023-12-28 03:05:45,271][106225] Updated weights for policy 1, policy_version 1093354 (0.0008) [2023-12-28 03:05:45,319][106226] Updated weights for policy 0, policy_version 1090559 (0.0008) [2023-12-28 03:05:45,386][106226] Updated weights for policy 0, policy_version 1090569 (0.0008) [2023-12-28 03:05:45,442][106226] Updated weights for policy 0, policy_version 1090579 (0.0009) [2023-12-28 03:05:45,983][106225] Updated weights for policy 1, policy_version 1093364 (0.0008) [2023-12-28 03:05:46,032][106225] Updated weights for policy 1, policy_version 1093374 (0.0008) [2023-12-28 03:05:46,091][106225] Updated weights for policy 1, policy_version 1093384 (0.0008) [2023-12-28 03:05:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 559202304. Throughput: 0: 9953.4, 1: 9857.4. Samples: 559191800. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:46,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.816')] [2023-12-28 03:05:46,203][106226] Updated weights for policy 0, policy_version 1090589 (0.0009) [2023-12-28 03:05:46,262][106226] Updated weights for policy 0, policy_version 1090599 (0.0009) [2023-12-28 03:05:46,307][106226] Updated weights for policy 0, policy_version 1090609 (0.0008) [2023-12-28 03:05:46,758][106225] Updated weights for policy 1, policy_version 1093394 (0.0008) [2023-12-28 03:05:46,804][106225] Updated weights for policy 1, policy_version 1093404 (0.0005) [2023-12-28 03:05:46,850][106225] Updated weights for policy 1, policy_version 1093414 (0.0005) [2023-12-28 03:05:46,897][106225] Updated weights for policy 1, policy_version 1093424 (0.0005) [2023-12-28 03:05:46,989][106226] Updated weights for policy 0, policy_version 1090619 (0.0008) [2023-12-28 03:05:47,060][106226] Updated weights for policy 0, policy_version 1090629 (0.0006) [2023-12-28 03:05:47,127][106226] Updated weights for policy 0, policy_version 1090639 (0.0006) [2023-12-28 03:05:47,563][106225] Updated weights for policy 1, policy_version 1093434 (0.0005) [2023-12-28 03:05:47,627][106225] Updated weights for policy 1, policy_version 1093444 (0.0007) [2023-12-28 03:05:47,675][106225] Updated weights for policy 1, policy_version 1093454 (0.0009) [2023-12-28 03:05:47,765][106226] Updated weights for policy 0, policy_version 1090649 (0.0006) [2023-12-28 03:05:47,819][106226] Updated weights for policy 0, policy_version 1090659 (0.0008) [2023-12-28 03:05:47,869][106226] Updated weights for policy 0, policy_version 1090669 (0.0009) [2023-12-28 03:05:47,929][106226] Updated weights for policy 0, policy_version 1090679 (0.0010) [2023-12-28 03:05:48,228][106225] Updated weights for policy 1, policy_version 1093464 (0.0005) [2023-12-28 03:05:48,293][106225] Updated weights for policy 1, policy_version 1093474 (0.0010) [2023-12-28 03:05:48,356][106225] Updated weights for policy 1, policy_version 1093484 (0.0010) [2023-12-28 03:05:48,563][106226] Updated weights for policy 0, policy_version 1090689 (0.0007) [2023-12-28 03:05:48,616][106226] Updated weights for policy 0, policy_version 1090699 (0.0009) [2023-12-28 03:05:48,671][106226] Updated weights for policy 0, policy_version 1090709 (0.0007) [2023-12-28 03:05:49,044][106225] Updated weights for policy 1, policy_version 1093494 (0.0010) [2023-12-28 03:05:49,110][106225] Updated weights for policy 1, policy_version 1093504 (0.0010) [2023-12-28 03:05:49,180][106225] Updated weights for policy 1, policy_version 1093514 (0.0010) [2023-12-28 03:05:49,219][106226] Updated weights for policy 0, policy_version 1090719 (0.0006) [2023-12-28 03:05:49,285][106226] Updated weights for policy 0, policy_version 1090729 (0.0007) [2023-12-28 03:05:49,347][106226] Updated weights for policy 0, policy_version 1090739 (0.0007) [2023-12-28 03:05:49,964][106225] Updated weights for policy 1, policy_version 1093524 (0.0009) [2023-12-28 03:05:50,029][106225] Updated weights for policy 1, policy_version 1093534 (0.0007) [2023-12-28 03:05:50,076][106226] Updated weights for policy 0, policy_version 1090749 (0.0009) [2023-12-28 03:05:50,093][106225] Updated weights for policy 1, policy_version 1093544 (0.0009) [2023-12-28 03:05:50,136][106226] Updated weights for policy 0, policy_version 1090759 (0.0007) [2023-12-28 03:05:50,196][106226] Updated weights for policy 0, policy_version 1090769 (0.0009) [2023-12-28 03:05:50,766][106225] Updated weights for policy 1, policy_version 1093554 (0.0009) [2023-12-28 03:05:50,824][106225] Updated weights for policy 1, policy_version 1093564 (0.0008) [2023-12-28 03:05:50,883][106225] Updated weights for policy 1, policy_version 1093574 (0.0008) [2023-12-28 03:05:50,892][106226] Updated weights for policy 0, policy_version 1090779 (0.0009) [2023-12-28 03:05:50,942][106225] Updated weights for policy 1, policy_version 1093584 (0.0008) [2023-12-28 03:05:50,944][106226] Updated weights for policy 0, policy_version 1090789 (0.0006) [2023-12-28 03:05:50,998][106226] Updated weights for policy 0, policy_version 1090799 (0.0008) [2023-12-28 03:05:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 559308800. Throughput: 0: 9977.5, 1: 9925.6. Samples: 559313708. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:51,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.877')] [2023-12-28 03:05:51,685][106225] Updated weights for policy 1, policy_version 1093594 (0.0010) [2023-12-28 03:05:51,750][106225] Updated weights for policy 1, policy_version 1093604 (0.0009) [2023-12-28 03:05:51,809][106225] Updated weights for policy 1, policy_version 1093614 (0.0008) [2023-12-28 03:05:51,812][106226] Updated weights for policy 0, policy_version 1090809 (0.0008) [2023-12-28 03:05:51,875][106226] Updated weights for policy 0, policy_version 1090819 (0.0008) [2023-12-28 03:05:51,934][106226] Updated weights for policy 0, policy_version 1090829 (0.0008) [2023-12-28 03:05:51,991][106226] Updated weights for policy 0, policy_version 1090839 (0.0008) [2023-12-28 03:05:52,530][106225] Updated weights for policy 1, policy_version 1093624 (0.0008) [2023-12-28 03:05:52,589][106225] Updated weights for policy 1, policy_version 1093634 (0.0008) [2023-12-28 03:05:52,640][106225] Updated weights for policy 1, policy_version 1093644 (0.0008) [2023-12-28 03:05:52,683][106226] Updated weights for policy 0, policy_version 1090849 (0.0007) [2023-12-28 03:05:52,747][106226] Updated weights for policy 0, policy_version 1090859 (0.0008) [2023-12-28 03:05:52,803][106226] Updated weights for policy 0, policy_version 1090869 (0.0008) [2023-12-28 03:05:53,377][106225] Updated weights for policy 1, policy_version 1093654 (0.0008) [2023-12-28 03:05:53,422][106225] Updated weights for policy 1, policy_version 1093664 (0.0008) [2023-12-28 03:05:53,472][106225] Updated weights for policy 1, policy_version 1093674 (0.0008) [2023-12-28 03:05:53,482][106226] Updated weights for policy 0, policy_version 1090879 (0.0007) [2023-12-28 03:05:53,531][106226] Updated weights for policy 0, policy_version 1090889 (0.0007) [2023-12-28 03:05:53,579][106226] Updated weights for policy 0, policy_version 1090899 (0.0008) [2023-12-28 03:05:54,222][106225] Updated weights for policy 1, policy_version 1093684 (0.0007) [2023-12-28 03:05:54,285][106225] Updated weights for policy 1, policy_version 1093694 (0.0006) [2023-12-28 03:05:54,322][106226] Updated weights for policy 0, policy_version 1090909 (0.0007) [2023-12-28 03:05:54,344][106225] Updated weights for policy 1, policy_version 1093704 (0.0008) [2023-12-28 03:05:54,385][106226] Updated weights for policy 0, policy_version 1090919 (0.0006) [2023-12-28 03:05:54,444][106226] Updated weights for policy 0, policy_version 1090929 (0.0008) [2023-12-28 03:05:55,043][106225] Updated weights for policy 1, policy_version 1093714 (0.0009) [2023-12-28 03:05:55,098][106225] Updated weights for policy 1, policy_version 1093724 (0.0008) [2023-12-28 03:05:55,156][106225] Updated weights for policy 1, policy_version 1093734 (0.0007) [2023-12-28 03:05:55,162][106226] Updated weights for policy 0, policy_version 1090939 (0.0008) [2023-12-28 03:05:55,218][106225] Updated weights for policy 1, policy_version 1093744 (0.0008) [2023-12-28 03:05:55,226][106226] Updated weights for policy 0, policy_version 1090949 (0.0007) [2023-12-28 03:05:55,290][106226] Updated weights for policy 0, policy_version 1090959 (0.0009) [2023-12-28 03:05:55,859][106226] Updated weights for policy 0, policy_version 1090969 (0.0008) [2023-12-28 03:05:55,913][106226] Updated weights for policy 0, policy_version 1090979 (0.0007) [2023-12-28 03:05:55,959][106226] Updated weights for policy 0, policy_version 1090989 (0.0005) [2023-12-28 03:05:56,008][106226] Updated weights for policy 0, policy_version 1090999 (0.0005) [2023-12-28 03:05:56,013][106225] Updated weights for policy 1, policy_version 1093754 (0.0008) [2023-12-28 03:05:56,062][106225] Updated weights for policy 1, policy_version 1093764 (0.0009) [2023-12-28 03:05:56,125][106225] Updated weights for policy 1, policy_version 1093774 (0.0010) [2023-12-28 03:05:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 559407104. Throughput: 0: 9917.7, 1: 9886.7. Samples: 559371008. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:05:56,176][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.161')] [2023-12-28 03:05:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001093776_280051712.pth... [2023-12-28 03:05:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001091000_279355392.pth... [2023-12-28 03:05:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001089816_279052288.pth [2023-12-28 03:05:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001092624_279756800.pth [2023-12-28 03:05:56,612][106226] Updated weights for policy 0, policy_version 1091009 (0.0008) [2023-12-28 03:05:56,665][106226] Updated weights for policy 0, policy_version 1091019 (0.0008) [2023-12-28 03:05:56,728][106226] Updated weights for policy 0, policy_version 1091029 (0.0009) [2023-12-28 03:05:56,899][106225] Updated weights for policy 1, policy_version 1093784 (0.0008) [2023-12-28 03:05:56,950][106225] Updated weights for policy 1, policy_version 1093794 (0.0008) [2023-12-28 03:05:56,998][106225] Updated weights for policy 1, policy_version 1093804 (0.0009) [2023-12-28 03:05:57,354][106226] Updated weights for policy 0, policy_version 1091039 (0.0006) [2023-12-28 03:05:57,400][106226] Updated weights for policy 0, policy_version 1091049 (0.0005) [2023-12-28 03:05:57,445][106226] Updated weights for policy 0, policy_version 1091059 (0.0005) [2023-12-28 03:05:57,799][106225] Updated weights for policy 1, policy_version 1093814 (0.0009) [2023-12-28 03:05:57,868][106225] Updated weights for policy 1, policy_version 1093824 (0.0008) [2023-12-28 03:05:57,923][106225] Updated weights for policy 1, policy_version 1093834 (0.0007) [2023-12-28 03:05:58,032][106226] Updated weights for policy 0, policy_version 1091069 (0.0006) [2023-12-28 03:05:58,093][106226] Updated weights for policy 0, policy_version 1091079 (0.0006) [2023-12-28 03:05:58,149][106226] Updated weights for policy 0, policy_version 1091089 (0.0010) [2023-12-28 03:05:58,676][106225] Updated weights for policy 1, policy_version 1093844 (0.0008) [2023-12-28 03:05:58,756][106225] Updated weights for policy 1, policy_version 1093854 (0.0011) [2023-12-28 03:05:58,818][106225] Updated weights for policy 1, policy_version 1093864 (0.0007) [2023-12-28 03:05:58,960][106226] Updated weights for policy 0, policy_version 1091099 (0.0009) [2023-12-28 03:05:59,021][106226] Updated weights for policy 0, policy_version 1091109 (0.0008) [2023-12-28 03:05:59,082][106226] Updated weights for policy 0, policy_version 1091119 (0.0007) [2023-12-28 03:05:59,636][106225] Updated weights for policy 1, policy_version 1093874 (0.0009) [2023-12-28 03:05:59,707][106225] Updated weights for policy 1, policy_version 1093884 (0.0008) [2023-12-28 03:05:59,733][106226] Updated weights for policy 0, policy_version 1091129 (0.0007) [2023-12-28 03:05:59,769][106225] Updated weights for policy 1, policy_version 1093894 (0.0007) [2023-12-28 03:05:59,793][106226] Updated weights for policy 0, policy_version 1091139 (0.0009) [2023-12-28 03:05:59,828][106225] Updated weights for policy 1, policy_version 1093904 (0.0006) [2023-12-28 03:05:59,857][106226] Updated weights for policy 0, policy_version 1091149 (0.0011) [2023-12-28 03:05:59,918][106226] Updated weights for policy 0, policy_version 1091159 (0.0007) [2023-12-28 03:06:00,538][106225] Updated weights for policy 1, policy_version 1093914 (0.0005) [2023-12-28 03:06:00,598][106225] Updated weights for policy 1, policy_version 1093924 (0.0005) [2023-12-28 03:06:00,603][106226] Updated weights for policy 0, policy_version 1091169 (0.0008) [2023-12-28 03:06:00,657][106225] Updated weights for policy 1, policy_version 1093934 (0.0007) [2023-12-28 03:06:00,662][106226] Updated weights for policy 0, policy_version 1091179 (0.0008) [2023-12-28 03:06:00,728][106226] Updated weights for policy 0, policy_version 1091189 (0.0008) [2023-12-28 03:06:01,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 559497216. Throughput: 0: 10059.6, 1: 9796.3. Samples: 559488772. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:01,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-4.682')] [2023-12-28 03:06:01,256][106225] Updated weights for policy 1, policy_version 1093944 (0.0007) [2023-12-28 03:06:01,313][106225] Updated weights for policy 1, policy_version 1093954 (0.0008) [2023-12-28 03:06:01,379][106225] Updated weights for policy 1, policy_version 1093964 (0.0008) [2023-12-28 03:06:01,465][106226] Updated weights for policy 0, policy_version 1091199 (0.0008) [2023-12-28 03:06:01,523][106226] Updated weights for policy 0, policy_version 1091209 (0.0008) [2023-12-28 03:06:01,571][106226] Updated weights for policy 0, policy_version 1091219 (0.0008) [2023-12-28 03:06:02,121][106225] Updated weights for policy 1, policy_version 1093974 (0.0007) [2023-12-28 03:06:02,177][106225] Updated weights for policy 1, policy_version 1093984 (0.0006) [2023-12-28 03:06:02,237][106225] Updated weights for policy 1, policy_version 1093994 (0.0008) [2023-12-28 03:06:02,340][106226] Updated weights for policy 0, policy_version 1091229 (0.0010) [2023-12-28 03:06:02,404][106226] Updated weights for policy 0, policy_version 1091239 (0.0011) [2023-12-28 03:06:02,464][106226] Updated weights for policy 0, policy_version 1091249 (0.0010) [2023-12-28 03:06:02,873][106225] Updated weights for policy 1, policy_version 1094004 (0.0007) [2023-12-28 03:06:02,933][106225] Updated weights for policy 1, policy_version 1094014 (0.0008) [2023-12-28 03:06:02,994][106225] Updated weights for policy 1, policy_version 1094024 (0.0008) [2023-12-28 03:06:03,092][106226] Updated weights for policy 0, policy_version 1091259 (0.0011) [2023-12-28 03:06:03,153][106226] Updated weights for policy 0, policy_version 1091269 (0.0010) [2023-12-28 03:06:03,210][106226] Updated weights for policy 0, policy_version 1091279 (0.0005) [2023-12-28 03:06:03,721][106225] Updated weights for policy 1, policy_version 1094034 (0.0008) [2023-12-28 03:06:03,770][106225] Updated weights for policy 1, policy_version 1094044 (0.0008) [2023-12-28 03:06:03,799][106226] Updated weights for policy 0, policy_version 1091289 (0.0008) [2023-12-28 03:06:03,820][106225] Updated weights for policy 1, policy_version 1094054 (0.0009) [2023-12-28 03:06:03,864][106226] Updated weights for policy 0, policy_version 1091299 (0.0011) [2023-12-28 03:06:03,881][106225] Updated weights for policy 1, policy_version 1094064 (0.0008) [2023-12-28 03:06:03,918][106226] Updated weights for policy 0, policy_version 1091309 (0.0006) [2023-12-28 03:06:03,976][106226] Updated weights for policy 0, policy_version 1091319 (0.0008) [2023-12-28 03:06:04,636][106226] Updated weights for policy 0, policy_version 1091329 (0.0010) [2023-12-28 03:06:04,677][106225] Updated weights for policy 1, policy_version 1094074 (0.0008) [2023-12-28 03:06:04,701][106226] Updated weights for policy 0, policy_version 1091339 (0.0007) [2023-12-28 03:06:04,739][106225] Updated weights for policy 1, policy_version 1094084 (0.0008) [2023-12-28 03:06:04,753][106226] Updated weights for policy 0, policy_version 1091349 (0.0005) [2023-12-28 03:06:04,791][106225] Updated weights for policy 1, policy_version 1094094 (0.0009) [2023-12-28 03:06:05,335][106226] Updated weights for policy 0, policy_version 1091359 (0.0009) [2023-12-28 03:06:05,405][106226] Updated weights for policy 0, policy_version 1091369 (0.0011) [2023-12-28 03:06:05,467][106226] Updated weights for policy 0, policy_version 1091379 (0.0010) [2023-12-28 03:06:05,576][106225] Updated weights for policy 1, policy_version 1094104 (0.0007) [2023-12-28 03:06:05,626][106225] Updated weights for policy 1, policy_version 1094114 (0.0008) [2023-12-28 03:06:05,677][106225] Updated weights for policy 1, policy_version 1094124 (0.0008) [2023-12-28 03:06:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 559595520. Throughput: 0: 10085.1, 1: 9832.8. Samples: 559608012. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:06,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.809')] [2023-12-28 03:06:06,180][106226] Updated weights for policy 0, policy_version 1091389 (0.0010) [2023-12-28 03:06:06,247][106226] Updated weights for policy 0, policy_version 1091399 (0.0011) [2023-12-28 03:06:06,312][106226] Updated weights for policy 0, policy_version 1091409 (0.0011) [2023-12-28 03:06:06,507][106225] Updated weights for policy 1, policy_version 1094134 (0.0008) [2023-12-28 03:06:06,566][106225] Updated weights for policy 1, policy_version 1094144 (0.0010) [2023-12-28 03:06:06,619][106225] Updated weights for policy 1, policy_version 1094154 (0.0009) [2023-12-28 03:06:06,957][106226] Updated weights for policy 0, policy_version 1091419 (0.0011) [2023-12-28 03:06:07,008][106226] Updated weights for policy 0, policy_version 1091429 (0.0011) [2023-12-28 03:06:07,060][106226] Updated weights for policy 0, policy_version 1091439 (0.0011) [2023-12-28 03:06:07,422][106225] Updated weights for policy 1, policy_version 1094164 (0.0009) [2023-12-28 03:06:07,487][106225] Updated weights for policy 1, policy_version 1094174 (0.0008) [2023-12-28 03:06:07,539][106225] Updated weights for policy 1, policy_version 1094184 (0.0008) [2023-12-28 03:06:07,636][106226] Updated weights for policy 0, policy_version 1091449 (0.0010) [2023-12-28 03:06:07,702][106226] Updated weights for policy 0, policy_version 1091459 (0.0005) [2023-12-28 03:06:07,755][106226] Updated weights for policy 0, policy_version 1091469 (0.0010) [2023-12-28 03:06:07,815][106226] Updated weights for policy 0, policy_version 1091479 (0.0010) [2023-12-28 03:06:08,221][106225] Updated weights for policy 1, policy_version 1094194 (0.0008) [2023-12-28 03:06:08,278][106225] Updated weights for policy 1, policy_version 1094204 (0.0008) [2023-12-28 03:06:08,341][106225] Updated weights for policy 1, policy_version 1094214 (0.0006) [2023-12-28 03:06:08,406][106225] Updated weights for policy 1, policy_version 1094224 (0.0007) [2023-12-28 03:06:08,440][106226] Updated weights for policy 0, policy_version 1091489 (0.0009) [2023-12-28 03:06:08,508][106226] Updated weights for policy 0, policy_version 1091499 (0.0008) [2023-12-28 03:06:08,571][106226] Updated weights for policy 0, policy_version 1091509 (0.0008) [2023-12-28 03:06:09,098][106225] Updated weights for policy 1, policy_version 1094234 (0.0007) [2023-12-28 03:06:09,151][106225] Updated weights for policy 1, policy_version 1094244 (0.0008) [2023-12-28 03:06:09,206][106225] Updated weights for policy 1, policy_version 1094254 (0.0009) [2023-12-28 03:06:09,248][106226] Updated weights for policy 0, policy_version 1091519 (0.0008) [2023-12-28 03:06:09,310][106226] Updated weights for policy 0, policy_version 1091529 (0.0008) [2023-12-28 03:06:09,379][106226] Updated weights for policy 0, policy_version 1091539 (0.0010) [2023-12-28 03:06:09,989][106225] Updated weights for policy 1, policy_version 1094264 (0.0008) [2023-12-28 03:06:10,054][106225] Updated weights for policy 1, policy_version 1094274 (0.0008) [2023-12-28 03:06:10,119][106225] Updated weights for policy 1, policy_version 1094284 (0.0008) [2023-12-28 03:06:10,174][106226] Updated weights for policy 0, policy_version 1091551 (0.0006) [2023-12-28 03:06:10,235][106226] Updated weights for policy 0, policy_version 1091561 (0.0006) [2023-12-28 03:06:10,297][106226] Updated weights for policy 0, policy_version 1091571 (0.0008) [2023-12-28 03:06:10,781][106225] Updated weights for policy 1, policy_version 1094294 (0.0008) [2023-12-28 03:06:10,836][106225] Updated weights for policy 1, policy_version 1094304 (0.0005) [2023-12-28 03:06:10,887][106225] Updated weights for policy 1, policy_version 1094314 (0.0006) [2023-12-28 03:06:10,950][106226] Updated weights for policy 0, policy_version 1091581 (0.0007) [2023-12-28 03:06:11,005][106226] Updated weights for policy 0, policy_version 1091591 (0.0009) [2023-12-28 03:06:11,068][106226] Updated weights for policy 0, policy_version 1091601 (0.0008) [2023-12-28 03:06:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 559702016. Throughput: 0: 10149.9, 1: 9800.7. Samples: 559668144. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:11,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.828')] [2023-12-28 03:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001091608_279511040.pth... [2023-12-28 03:06:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001094320_280190976.pth... [2023-12-28 03:06:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001090424_279207936.pth [2023-12-28 03:06:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001093200_279904256.pth [2023-12-28 03:06:11,646][106225] Updated weights for policy 1, policy_version 1094324 (0.0008) [2023-12-28 03:06:11,706][106225] Updated weights for policy 1, policy_version 1094334 (0.0008) [2023-12-28 03:06:11,778][106225] Updated weights for policy 1, policy_version 1094344 (0.0008) [2023-12-28 03:06:11,815][106226] Updated weights for policy 0, policy_version 1091611 (0.0007) [2023-12-28 03:06:11,880][106226] Updated weights for policy 0, policy_version 1091621 (0.0009) [2023-12-28 03:06:11,940][106226] Updated weights for policy 0, policy_version 1091631 (0.0008) [2023-12-28 03:06:12,598][106225] Updated weights for policy 1, policy_version 1094354 (0.0008) [2023-12-28 03:06:12,635][106226] Updated weights for policy 0, policy_version 1091641 (0.0008) [2023-12-28 03:06:12,662][106225] Updated weights for policy 1, policy_version 1094364 (0.0008) [2023-12-28 03:06:12,697][106226] Updated weights for policy 0, policy_version 1091651 (0.0008) [2023-12-28 03:06:12,720][106225] Updated weights for policy 1, policy_version 1094374 (0.0007) [2023-12-28 03:06:12,752][106226] Updated weights for policy 0, policy_version 1091661 (0.0006) [2023-12-28 03:06:12,789][106225] Updated weights for policy 1, policy_version 1094384 (0.0007) [2023-12-28 03:06:12,805][106226] Updated weights for policy 0, policy_version 1091671 (0.0006) [2023-12-28 03:06:13,392][106225] Updated weights for policy 1, policy_version 1094394 (0.0008) [2023-12-28 03:06:13,437][106225] Updated weights for policy 1, policy_version 1094404 (0.0008) [2023-12-28 03:06:13,482][106225] Updated weights for policy 1, policy_version 1094414 (0.0008) [2023-12-28 03:06:13,570][106226] Updated weights for policy 0, policy_version 1091681 (0.0008) [2023-12-28 03:06:13,615][106226] Updated weights for policy 0, policy_version 1091691 (0.0008) [2023-12-28 03:06:13,668][106226] Updated weights for policy 0, policy_version 1091702 (0.0009) [2023-12-28 03:06:14,061][106225] Updated weights for policy 1, policy_version 1094424 (0.0006) [2023-12-28 03:06:14,110][106225] Updated weights for policy 1, policy_version 1094434 (0.0005) [2023-12-28 03:06:14,173][106225] Updated weights for policy 1, policy_version 1094444 (0.0006) [2023-12-28 03:06:14,394][106226] Updated weights for policy 0, policy_version 1091712 (0.0007) [2023-12-28 03:06:14,453][106226] Updated weights for policy 0, policy_version 1091722 (0.0007) [2023-12-28 03:06:14,512][106226] Updated weights for policy 0, policy_version 1091732 (0.0008) [2023-12-28 03:06:14,903][106225] Updated weights for policy 1, policy_version 1094454 (0.0009) [2023-12-28 03:06:14,966][106225] Updated weights for policy 1, policy_version 1094464 (0.0009) [2023-12-28 03:06:15,029][106225] Updated weights for policy 1, policy_version 1094474 (0.0009) [2023-12-28 03:06:15,285][106226] Updated weights for policy 0, policy_version 1091742 (0.0008) [2023-12-28 03:06:15,345][106226] Updated weights for policy 0, policy_version 1091752 (0.0008) [2023-12-28 03:06:15,414][106226] Updated weights for policy 0, policy_version 1091762 (0.0008) [2023-12-28 03:06:15,795][106225] Updated weights for policy 1, policy_version 1094484 (0.0007) [2023-12-28 03:06:15,852][106225] Updated weights for policy 1, policy_version 1094494 (0.0006) [2023-12-28 03:06:15,907][106225] Updated weights for policy 1, policy_version 1094504 (0.0007) [2023-12-28 03:06:16,062][106226] Updated weights for policy 0, policy_version 1091772 (0.0007) [2023-12-28 03:06:16,110][106226] Updated weights for policy 0, policy_version 1091782 (0.0006) [2023-12-28 03:06:16,161][106226] Updated weights for policy 0, policy_version 1091792 (0.0008) [2023-12-28 03:06:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 559792128. Throughput: 0: 10148.0, 1: 9643.9. Samples: 559785044. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:16,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.865')] [2023-12-28 03:06:16,593][106225] Updated weights for policy 1, policy_version 1094514 (0.0005) [2023-12-28 03:06:16,652][106225] Updated weights for policy 1, policy_version 1094524 (0.0005) [2023-12-28 03:06:16,715][106225] Updated weights for policy 1, policy_version 1094534 (0.0005) [2023-12-28 03:06:16,768][106225] Updated weights for policy 1, policy_version 1094544 (0.0008) [2023-12-28 03:06:16,862][106226] Updated weights for policy 0, policy_version 1091802 (0.0009) [2023-12-28 03:06:16,928][106226] Updated weights for policy 0, policy_version 1091812 (0.0008) [2023-12-28 03:06:17,003][106226] Updated weights for policy 0, policy_version 1091822 (0.0008) [2023-12-28 03:06:17,067][106226] Updated weights for policy 0, policy_version 1091832 (0.0008) [2023-12-28 03:06:17,474][106225] Updated weights for policy 1, policy_version 1094554 (0.0008) [2023-12-28 03:06:17,538][106225] Updated weights for policy 1, policy_version 1094564 (0.0008) [2023-12-28 03:06:17,597][106225] Updated weights for policy 1, policy_version 1094574 (0.0005) [2023-12-28 03:06:17,720][106226] Updated weights for policy 0, policy_version 1091842 (0.0007) [2023-12-28 03:06:17,785][106226] Updated weights for policy 0, policy_version 1091852 (0.0011) [2023-12-28 03:06:17,847][106226] Updated weights for policy 0, policy_version 1091862 (0.0010) [2023-12-28 03:06:18,169][106225] Updated weights for policy 1, policy_version 1094584 (0.0007) [2023-12-28 03:06:18,234][106225] Updated weights for policy 1, policy_version 1094594 (0.0008) [2023-12-28 03:06:18,287][106225] Updated weights for policy 1, policy_version 1094604 (0.0008) [2023-12-28 03:06:18,506][106226] Updated weights for policy 0, policy_version 1091872 (0.0010) [2023-12-28 03:06:18,570][106226] Updated weights for policy 0, policy_version 1091882 (0.0011) [2023-12-28 03:06:18,633][106226] Updated weights for policy 0, policy_version 1091892 (0.0011) [2023-12-28 03:06:19,004][106225] Updated weights for policy 1, policy_version 1094614 (0.0008) [2023-12-28 03:06:19,067][106225] Updated weights for policy 1, policy_version 1094624 (0.0009) [2023-12-28 03:06:19,129][106225] Updated weights for policy 1, policy_version 1094634 (0.0010) [2023-12-28 03:06:19,348][106226] Updated weights for policy 0, policy_version 1091902 (0.0009) [2023-12-28 03:06:19,414][106226] Updated weights for policy 0, policy_version 1091912 (0.0008) [2023-12-28 03:06:19,463][106226] Updated weights for policy 0, policy_version 1091922 (0.0008) [2023-12-28 03:06:19,949][106225] Updated weights for policy 1, policy_version 1094644 (0.0009) [2023-12-28 03:06:20,016][106225] Updated weights for policy 1, policy_version 1094654 (0.0008) [2023-12-28 03:06:20,084][106225] Updated weights for policy 1, policy_version 1094664 (0.0006) [2023-12-28 03:06:20,256][106226] Updated weights for policy 0, policy_version 1091932 (0.0008) [2023-12-28 03:06:20,318][106226] Updated weights for policy 0, policy_version 1091942 (0.0008) [2023-12-28 03:06:20,386][106226] Updated weights for policy 0, policy_version 1091952 (0.0008) [2023-12-28 03:06:20,740][106225] Updated weights for policy 1, policy_version 1094674 (0.0007) [2023-12-28 03:06:20,804][106225] Updated weights for policy 1, policy_version 1094684 (0.0009) [2023-12-28 03:06:20,867][106225] Updated weights for policy 1, policy_version 1094694 (0.0006) [2023-12-28 03:06:20,934][106225] Updated weights for policy 1, policy_version 1094704 (0.0007) [2023-12-28 03:06:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 559890432. Throughput: 0: 9951.0, 1: 9701.8. Samples: 559901140. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:21,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-4.806')] [2023-12-28 03:06:21,200][106226] Updated weights for policy 0, policy_version 1091962 (0.0008) [2023-12-28 03:06:21,276][106226] Updated weights for policy 0, policy_version 1091972 (0.0010) [2023-12-28 03:06:21,340][106226] Updated weights for policy 0, policy_version 1091982 (0.0010) [2023-12-28 03:06:21,415][106226] Updated weights for policy 0, policy_version 1091992 (0.0010) [2023-12-28 03:06:21,669][106225] Updated weights for policy 1, policy_version 1094715 (0.0009) [2023-12-28 03:06:21,732][106225] Updated weights for policy 1, policy_version 1094725 (0.0010) [2023-12-28 03:06:21,792][106225] Updated weights for policy 1, policy_version 1094735 (0.0010) [2023-12-28 03:06:22,159][106226] Updated weights for policy 0, policy_version 1092002 (0.0008) [2023-12-28 03:06:22,220][106226] Updated weights for policy 0, policy_version 1092012 (0.0007) [2023-12-28 03:06:22,284][106226] Updated weights for policy 0, policy_version 1092022 (0.0009) [2023-12-28 03:06:22,524][106225] Updated weights for policy 1, policy_version 1094745 (0.0011) [2023-12-28 03:06:22,585][106225] Updated weights for policy 1, policy_version 1094755 (0.0011) [2023-12-28 03:06:22,649][106225] Updated weights for policy 1, policy_version 1094765 (0.0011) [2023-12-28 03:06:23,017][106226] Updated weights for policy 0, policy_version 1092032 (0.0006) [2023-12-28 03:06:23,077][106226] Updated weights for policy 0, policy_version 1092042 (0.0005) [2023-12-28 03:06:23,136][106226] Updated weights for policy 0, policy_version 1092052 (0.0006) [2023-12-28 03:06:23,335][106225] Updated weights for policy 1, policy_version 1094775 (0.0007) [2023-12-28 03:06:23,389][106225] Updated weights for policy 1, policy_version 1094785 (0.0005) [2023-12-28 03:06:23,440][106225] Updated weights for policy 1, policy_version 1094795 (0.0005) [2023-12-28 03:06:23,731][106226] Updated weights for policy 0, policy_version 1092062 (0.0009) [2023-12-28 03:06:23,789][106226] Updated weights for policy 0, policy_version 1092072 (0.0010) [2023-12-28 03:06:23,846][106226] Updated weights for policy 0, policy_version 1092082 (0.0005) [2023-12-28 03:06:23,993][106225] Updated weights for policy 1, policy_version 1094805 (0.0006) [2023-12-28 03:06:24,051][106225] Updated weights for policy 1, policy_version 1094815 (0.0005) [2023-12-28 03:06:24,112][106225] Updated weights for policy 1, policy_version 1094825 (0.0005) [2023-12-28 03:06:24,399][106226] Updated weights for policy 0, policy_version 1092092 (0.0008) [2023-12-28 03:06:24,455][106226] Updated weights for policy 0, policy_version 1092102 (0.0011) [2023-12-28 03:06:24,519][106226] Updated weights for policy 0, policy_version 1092112 (0.0011) [2023-12-28 03:06:24,795][106225] Updated weights for policy 1, policy_version 1094835 (0.0007) [2023-12-28 03:06:24,851][106225] Updated weights for policy 1, policy_version 1094845 (0.0010) [2023-12-28 03:06:24,913][106225] Updated weights for policy 1, policy_version 1094855 (0.0010) [2023-12-28 03:06:25,094][106226] Updated weights for policy 0, policy_version 1092122 (0.0009) [2023-12-28 03:06:25,153][106226] Updated weights for policy 0, policy_version 1092132 (0.0006) [2023-12-28 03:06:25,212][106226] Updated weights for policy 0, policy_version 1092142 (0.0008) [2023-12-28 03:06:25,269][106226] Updated weights for policy 0, policy_version 1092152 (0.0010) [2023-12-28 03:06:25,542][106225] Updated weights for policy 1, policy_version 1094865 (0.0010) [2023-12-28 03:06:25,594][106225] Updated weights for policy 1, policy_version 1094875 (0.0010) [2023-12-28 03:06:25,646][106225] Updated weights for policy 1, policy_version 1094885 (0.0010) [2023-12-28 03:06:25,692][106225] Updated weights for policy 1, policy_version 1094895 (0.0010) [2023-12-28 03:06:25,927][106226] Updated weights for policy 0, policy_version 1092162 (0.0010) [2023-12-28 03:06:25,989][106226] Updated weights for policy 0, policy_version 1092172 (0.0011) [2023-12-28 03:06:26,060][106226] Updated weights for policy 0, policy_version 1092182 (0.0011) [2023-12-28 03:06:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 559996928. Throughput: 0: 9993.3, 1: 9630.2. Samples: 559960556. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:26,176][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.465')] [2023-12-28 03:06:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001092184_279658496.pth... [2023-12-28 03:06:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001094896_280338432.pth... [2023-12-28 03:06:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001091000_279355392.pth [2023-12-28 03:06:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001093776_280051712.pth [2023-12-28 03:06:26,191][106141] Saving new best policy, reward=-4.465! [2023-12-28 03:06:26,378][106225] Updated weights for policy 1, policy_version 1094905 (0.0010) [2023-12-28 03:06:26,431][106225] Updated weights for policy 1, policy_version 1094915 (0.0010) [2023-12-28 03:06:26,486][106225] Updated weights for policy 1, policy_version 1094925 (0.0010) [2023-12-28 03:06:26,730][106226] Updated weights for policy 0, policy_version 1092192 (0.0006) [2023-12-28 03:06:26,798][106226] Updated weights for policy 0, policy_version 1092202 (0.0005) [2023-12-28 03:06:26,862][106226] Updated weights for policy 0, policy_version 1092212 (0.0005) [2023-12-28 03:06:27,114][106225] Updated weights for policy 1, policy_version 1094935 (0.0010) [2023-12-28 03:06:27,159][106225] Updated weights for policy 1, policy_version 1094945 (0.0010) [2023-12-28 03:06:27,201][106225] Updated weights for policy 1, policy_version 1094955 (0.0010) [2023-12-28 03:06:27,464][106226] Updated weights for policy 0, policy_version 1092222 (0.0006) [2023-12-28 03:06:27,525][106226] Updated weights for policy 0, policy_version 1092232 (0.0009) [2023-12-28 03:06:27,571][106226] Updated weights for policy 0, policy_version 1092242 (0.0010) [2023-12-28 03:06:27,870][106225] Updated weights for policy 1, policy_version 1094965 (0.0010) [2023-12-28 03:06:27,917][106225] Updated weights for policy 1, policy_version 1094975 (0.0010) [2023-12-28 03:06:27,969][106225] Updated weights for policy 1, policy_version 1094985 (0.0008) [2023-12-28 03:06:28,252][106226] Updated weights for policy 0, policy_version 1092252 (0.0008) [2023-12-28 03:06:28,304][106226] Updated weights for policy 0, policy_version 1092262 (0.0010) [2023-12-28 03:06:28,366][106226] Updated weights for policy 0, policy_version 1092272 (0.0007) [2023-12-28 03:06:28,689][106225] Updated weights for policy 1, policy_version 1094995 (0.0006) [2023-12-28 03:06:28,751][106225] Updated weights for policy 1, policy_version 1095005 (0.0009) [2023-12-28 03:06:28,806][106225] Updated weights for policy 1, policy_version 1095016 (0.0010) [2023-12-28 03:06:29,000][106226] Updated weights for policy 0, policy_version 1092282 (0.0007) [2023-12-28 03:06:29,052][106226] Updated weights for policy 0, policy_version 1092292 (0.0007) [2023-12-28 03:06:29,106][106226] Updated weights for policy 0, policy_version 1092302 (0.0009) [2023-12-28 03:06:29,171][106226] Updated weights for policy 0, policy_version 1092312 (0.0006) [2023-12-28 03:06:29,587][106225] Updated weights for policy 1, policy_version 1095026 (0.0008) [2023-12-28 03:06:29,646][106225] Updated weights for policy 1, policy_version 1095036 (0.0008) [2023-12-28 03:06:29,714][106225] Updated weights for policy 1, policy_version 1095046 (0.0009) [2023-12-28 03:06:29,772][106225] Updated weights for policy 1, policy_version 1095056 (0.0008) [2023-12-28 03:06:29,883][106226] Updated weights for policy 0, policy_version 1092322 (0.0009) [2023-12-28 03:06:29,948][106226] Updated weights for policy 0, policy_version 1092332 (0.0009) [2023-12-28 03:06:30,014][106226] Updated weights for policy 0, policy_version 1092342 (0.0009) [2023-12-28 03:06:30,455][106225] Updated weights for policy 1, policy_version 1095066 (0.0005) [2023-12-28 03:06:30,509][106225] Updated weights for policy 1, policy_version 1095076 (0.0008) [2023-12-28 03:06:30,557][106225] Updated weights for policy 1, policy_version 1095086 (0.0008) [2023-12-28 03:06:30,803][106226] Updated weights for policy 0, policy_version 1092352 (0.0009) [2023-12-28 03:06:30,857][106226] Updated weights for policy 0, policy_version 1092362 (0.0008) [2023-12-28 03:06:30,901][106226] Updated weights for policy 0, policy_version 1092372 (0.0008) [2023-12-28 03:06:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 560095232. Throughput: 0: 10101.0, 1: 9759.0. Samples: 560085500. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:31,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.907')] [2023-12-28 03:06:31,282][106225] Updated weights for policy 1, policy_version 1095096 (0.0007) [2023-12-28 03:06:31,348][106225] Updated weights for policy 1, policy_version 1095106 (0.0007) [2023-12-28 03:06:31,404][106225] Updated weights for policy 1, policy_version 1095116 (0.0007) [2023-12-28 03:06:31,655][106226] Updated weights for policy 0, policy_version 1092382 (0.0009) [2023-12-28 03:06:31,712][106226] Updated weights for policy 0, policy_version 1092392 (0.0009) [2023-12-28 03:06:31,783][106226] Updated weights for policy 0, policy_version 1092402 (0.0009) [2023-12-28 03:06:32,063][106225] Updated weights for policy 1, policy_version 1095126 (0.0008) [2023-12-28 03:06:32,128][106225] Updated weights for policy 1, policy_version 1095136 (0.0008) [2023-12-28 03:06:32,187][106225] Updated weights for policy 1, policy_version 1095146 (0.0009) [2023-12-28 03:06:32,417][106226] Updated weights for policy 0, policy_version 1092412 (0.0007) [2023-12-28 03:06:32,484][106226] Updated weights for policy 0, policy_version 1092422 (0.0008) [2023-12-28 03:06:32,553][106226] Updated weights for policy 0, policy_version 1092432 (0.0008) [2023-12-28 03:06:32,875][106225] Updated weights for policy 1, policy_version 1095156 (0.0008) [2023-12-28 03:06:32,936][106225] Updated weights for policy 1, policy_version 1095166 (0.0008) [2023-12-28 03:06:32,985][106225] Updated weights for policy 1, policy_version 1095176 (0.0008) [2023-12-28 03:06:33,286][106226] Updated weights for policy 0, policy_version 1092442 (0.0007) [2023-12-28 03:06:33,352][106226] Updated weights for policy 0, policy_version 1092452 (0.0007) [2023-12-28 03:06:33,411][106226] Updated weights for policy 0, policy_version 1092462 (0.0010) [2023-12-28 03:06:33,460][106226] Updated weights for policy 0, policy_version 1092472 (0.0010) [2023-12-28 03:06:33,653][106225] Updated weights for policy 1, policy_version 1095186 (0.0007) [2023-12-28 03:06:33,704][106225] Updated weights for policy 1, policy_version 1095196 (0.0007) [2023-12-28 03:06:33,754][106225] Updated weights for policy 1, policy_version 1095206 (0.0009) [2023-12-28 03:06:33,803][106225] Updated weights for policy 1, policy_version 1095216 (0.0008) [2023-12-28 03:06:34,001][106226] Updated weights for policy 0, policy_version 1092482 (0.0005) [2023-12-28 03:06:34,059][106226] Updated weights for policy 0, policy_version 1092492 (0.0005) [2023-12-28 03:06:34,111][106226] Updated weights for policy 0, policy_version 1092502 (0.0005) [2023-12-28 03:06:34,633][106225] Updated weights for policy 1, policy_version 1095226 (0.0005) [2023-12-28 03:06:34,706][106225] Updated weights for policy 1, policy_version 1095236 (0.0007) [2023-12-28 03:06:34,776][106226] Updated weights for policy 0, policy_version 1092512 (0.0008) [2023-12-28 03:06:34,776][106225] Updated weights for policy 1, policy_version 1095246 (0.0010) [2023-12-28 03:06:34,822][106226] Updated weights for policy 0, policy_version 1092522 (0.0008) [2023-12-28 03:06:34,873][106226] Updated weights for policy 0, policy_version 1092532 (0.0008) [2023-12-28 03:06:35,444][106225] Updated weights for policy 1, policy_version 1095256 (0.0010) [2023-12-28 03:06:35,495][106225] Updated weights for policy 1, policy_version 1095266 (0.0010) [2023-12-28 03:06:35,546][106226] Updated weights for policy 0, policy_version 1092542 (0.0007) [2023-12-28 03:06:35,549][106225] Updated weights for policy 1, policy_version 1095276 (0.0010) [2023-12-28 03:06:35,600][106226] Updated weights for policy 0, policy_version 1092552 (0.0005) [2023-12-28 03:06:35,651][106226] Updated weights for policy 0, policy_version 1092562 (0.0006) [2023-12-28 03:06:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 560193536. Throughput: 0: 10110.9, 1: 9720.0. Samples: 560206096. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:36,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.809')] [2023-12-28 03:06:36,204][106225] Updated weights for policy 1, policy_version 1095286 (0.0009) [2023-12-28 03:06:36,263][106225] Updated weights for policy 1, policy_version 1095296 (0.0008) [2023-12-28 03:06:36,324][106225] Updated weights for policy 1, policy_version 1095306 (0.0007) [2023-12-28 03:06:36,339][106226] Updated weights for policy 0, policy_version 1092572 (0.0009) [2023-12-28 03:06:36,395][106226] Updated weights for policy 0, policy_version 1092582 (0.0009) [2023-12-28 03:06:36,452][106226] Updated weights for policy 0, policy_version 1092592 (0.0006) [2023-12-28 03:06:37,047][106226] Updated weights for policy 0, policy_version 1092602 (0.0007) [2023-12-28 03:06:37,074][106225] Updated weights for policy 1, policy_version 1095316 (0.0008) [2023-12-28 03:06:37,108][106226] Updated weights for policy 0, policy_version 1092612 (0.0011) [2023-12-28 03:06:37,122][106225] Updated weights for policy 1, policy_version 1095326 (0.0006) [2023-12-28 03:06:37,165][106226] Updated weights for policy 0, policy_version 1092622 (0.0011) [2023-12-28 03:06:37,175][106225] Updated weights for policy 1, policy_version 1095336 (0.0008) [2023-12-28 03:06:37,230][106226] Updated weights for policy 0, policy_version 1092632 (0.0011) [2023-12-28 03:06:37,900][106225] Updated weights for policy 1, policy_version 1095346 (0.0005) [2023-12-28 03:06:37,923][106226] Updated weights for policy 0, policy_version 1092642 (0.0007) [2023-12-28 03:06:37,962][106225] Updated weights for policy 1, policy_version 1095356 (0.0005) [2023-12-28 03:06:37,988][106226] Updated weights for policy 0, policy_version 1092652 (0.0009) [2023-12-28 03:06:38,021][106225] Updated weights for policy 1, policy_version 1095366 (0.0006) [2023-12-28 03:06:38,042][106226] Updated weights for policy 0, policy_version 1092662 (0.0010) [2023-12-28 03:06:38,072][106225] Updated weights for policy 1, policy_version 1095376 (0.0007) [2023-12-28 03:06:38,761][106225] Updated weights for policy 1, policy_version 1095386 (0.0006) [2023-12-28 03:06:38,762][106226] Updated weights for policy 0, policy_version 1092672 (0.0011) [2023-12-28 03:06:38,815][106225] Updated weights for policy 1, policy_version 1095396 (0.0006) [2023-12-28 03:06:38,821][106226] Updated weights for policy 0, policy_version 1092682 (0.0011) [2023-12-28 03:06:38,873][106225] Updated weights for policy 1, policy_version 1095406 (0.0006) [2023-12-28 03:06:38,883][106226] Updated weights for policy 0, policy_version 1092692 (0.0011) [2023-12-28 03:06:39,580][106226] Updated weights for policy 0, policy_version 1092702 (0.0009) [2023-12-28 03:06:39,643][106226] Updated weights for policy 0, policy_version 1092712 (0.0008) [2023-12-28 03:06:39,680][106225] Updated weights for policy 1, policy_version 1095416 (0.0008) [2023-12-28 03:06:39,702][106226] Updated weights for policy 0, policy_version 1092722 (0.0008) [2023-12-28 03:06:39,739][106225] Updated weights for policy 1, policy_version 1095426 (0.0007) [2023-12-28 03:06:39,796][106225] Updated weights for policy 1, policy_version 1095436 (0.0007) [2023-12-28 03:06:40,434][106226] Updated weights for policy 0, policy_version 1092732 (0.0008) [2023-12-28 03:06:40,492][106226] Updated weights for policy 0, policy_version 1092742 (0.0011) [2023-12-28 03:06:40,547][106226] Updated weights for policy 0, policy_version 1092752 (0.0010) [2023-12-28 03:06:40,555][106225] Updated weights for policy 1, policy_version 1095446 (0.0007) [2023-12-28 03:06:40,617][106225] Updated weights for policy 1, policy_version 1095456 (0.0009) [2023-12-28 03:06:40,667][106225] Updated weights for policy 1, policy_version 1095466 (0.0010) [2023-12-28 03:06:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 560291840. Throughput: 0: 10137.2, 1: 9759.8. Samples: 560266368. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:41,175][105115] Avg episode reward: [(0, '-4.823'), (1, '-4.767')] [2023-12-28 03:06:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001092760_279805952.pth... [2023-12-28 03:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001095472_280485888.pth... [2023-12-28 03:06:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001091608_279511040.pth [2023-12-28 03:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001094320_280190976.pth [2023-12-28 03:06:41,236][106226] Updated weights for policy 0, policy_version 1092762 (0.0010) [2023-12-28 03:06:41,298][106226] Updated weights for policy 0, policy_version 1092772 (0.0008) [2023-12-28 03:06:41,364][106226] Updated weights for policy 0, policy_version 1092782 (0.0008) [2023-12-28 03:06:41,385][106225] Updated weights for policy 1, policy_version 1095476 (0.0009) [2023-12-28 03:06:41,434][106226] Updated weights for policy 0, policy_version 1092792 (0.0007) [2023-12-28 03:06:41,447][106225] Updated weights for policy 1, policy_version 1095486 (0.0007) [2023-12-28 03:06:41,506][106225] Updated weights for policy 1, policy_version 1095496 (0.0008) [2023-12-28 03:06:42,201][106226] Updated weights for policy 0, policy_version 1092802 (0.0009) [2023-12-28 03:06:42,235][106225] Updated weights for policy 1, policy_version 1095506 (0.0008) [2023-12-28 03:06:42,259][106226] Updated weights for policy 0, policy_version 1092812 (0.0009) [2023-12-28 03:06:42,302][106225] Updated weights for policy 1, policy_version 1095516 (0.0007) [2023-12-28 03:06:42,329][106226] Updated weights for policy 0, policy_version 1092822 (0.0008) [2023-12-28 03:06:42,378][106225] Updated weights for policy 1, policy_version 1095526 (0.0008) [2023-12-28 03:06:42,448][106225] Updated weights for policy 1, policy_version 1095536 (0.0009) [2023-12-28 03:06:42,959][106226] Updated weights for policy 0, policy_version 1092832 (0.0006) [2023-12-28 03:06:43,004][106226] Updated weights for policy 0, policy_version 1092842 (0.0005) [2023-12-28 03:06:43,048][106226] Updated weights for policy 0, policy_version 1092852 (0.0005) [2023-12-28 03:06:43,215][106225] Updated weights for policy 1, policy_version 1095546 (0.0008) [2023-12-28 03:06:43,271][106225] Updated weights for policy 1, policy_version 1095556 (0.0008) [2023-12-28 03:06:43,323][106225] Updated weights for policy 1, policy_version 1095566 (0.0007) [2023-12-28 03:06:43,689][106226] Updated weights for policy 0, policy_version 1092862 (0.0007) [2023-12-28 03:06:43,748][106226] Updated weights for policy 0, policy_version 1092872 (0.0008) [2023-12-28 03:06:43,803][106226] Updated weights for policy 0, policy_version 1092882 (0.0009) [2023-12-28 03:06:44,009][106225] Updated weights for policy 1, policy_version 1095576 (0.0008) [2023-12-28 03:06:44,054][106225] Updated weights for policy 1, policy_version 1095586 (0.0008) [2023-12-28 03:06:44,104][106225] Updated weights for policy 1, policy_version 1095596 (0.0008) [2023-12-28 03:06:44,502][106226] Updated weights for policy 0, policy_version 1092892 (0.0007) [2023-12-28 03:06:44,558][106226] Updated weights for policy 0, policy_version 1092902 (0.0005) [2023-12-28 03:06:44,617][106226] Updated weights for policy 0, policy_version 1092912 (0.0005) [2023-12-28 03:06:44,891][106225] Updated weights for policy 1, policy_version 1095606 (0.0006) [2023-12-28 03:06:44,959][106225] Updated weights for policy 1, policy_version 1095616 (0.0006) [2023-12-28 03:06:45,021][106225] Updated weights for policy 1, policy_version 1095626 (0.0006) [2023-12-28 03:06:45,273][106226] Updated weights for policy 0, policy_version 1092922 (0.0006) [2023-12-28 03:06:45,346][106226] Updated weights for policy 0, policy_version 1092932 (0.0007) [2023-12-28 03:06:45,410][106226] Updated weights for policy 0, policy_version 1092942 (0.0007) [2023-12-28 03:06:45,468][106226] Updated weights for policy 0, policy_version 1092952 (0.0007) [2023-12-28 03:06:45,673][106225] Updated weights for policy 1, policy_version 1095636 (0.0008) [2023-12-28 03:06:45,740][106225] Updated weights for policy 1, policy_version 1095646 (0.0009) [2023-12-28 03:06:45,801][106225] Updated weights for policy 1, policy_version 1095656 (0.0008) [2023-12-28 03:06:46,172][106226] Updated weights for policy 0, policy_version 1092962 (0.0008) [2023-12-28 03:06:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 560390144. Throughput: 0: 10077.0, 1: 9775.6. Samples: 560382140. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:46,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.808')] [2023-12-28 03:06:46,231][106226] Updated weights for policy 0, policy_version 1092972 (0.0009) [2023-12-28 03:06:46,291][106226] Updated weights for policy 0, policy_version 1092982 (0.0009) [2023-12-28 03:06:46,503][106225] Updated weights for policy 1, policy_version 1095666 (0.0009) [2023-12-28 03:06:46,573][106225] Updated weights for policy 1, policy_version 1095676 (0.0009) [2023-12-28 03:06:46,619][106225] Updated weights for policy 1, policy_version 1095686 (0.0008) [2023-12-28 03:06:46,681][106225] Updated weights for policy 1, policy_version 1095696 (0.0008) [2023-12-28 03:06:46,998][106226] Updated weights for policy 0, policy_version 1092992 (0.0009) [2023-12-28 03:06:47,056][106226] Updated weights for policy 0, policy_version 1093002 (0.0008) [2023-12-28 03:06:47,105][106226] Updated weights for policy 0, policy_version 1093012 (0.0009) [2023-12-28 03:06:47,394][106225] Updated weights for policy 1, policy_version 1095706 (0.0009) [2023-12-28 03:06:47,456][106225] Updated weights for policy 1, policy_version 1095716 (0.0007) [2023-12-28 03:06:47,524][106225] Updated weights for policy 1, policy_version 1095726 (0.0010) [2023-12-28 03:06:47,762][106226] Updated weights for policy 0, policy_version 1093022 (0.0008) [2023-12-28 03:06:47,829][106226] Updated weights for policy 0, policy_version 1093032 (0.0009) [2023-12-28 03:06:47,894][106226] Updated weights for policy 0, policy_version 1093042 (0.0009) [2023-12-28 03:06:48,290][106225] Updated weights for policy 1, policy_version 1095736 (0.0008) [2023-12-28 03:06:48,343][106225] Updated weights for policy 1, policy_version 1095746 (0.0008) [2023-12-28 03:06:48,403][106225] Updated weights for policy 1, policy_version 1095756 (0.0007) [2023-12-28 03:06:48,612][106226] Updated weights for policy 0, policy_version 1093052 (0.0007) [2023-12-28 03:06:48,672][106226] Updated weights for policy 0, policy_version 1093062 (0.0008) [2023-12-28 03:06:48,736][106226] Updated weights for policy 0, policy_version 1093072 (0.0009) [2023-12-28 03:06:49,133][106225] Updated weights for policy 1, policy_version 1095766 (0.0006) [2023-12-28 03:06:49,181][106225] Updated weights for policy 1, policy_version 1095776 (0.0005) [2023-12-28 03:06:49,250][106225] Updated weights for policy 1, policy_version 1095786 (0.0007) [2023-12-28 03:06:49,477][106226] Updated weights for policy 0, policy_version 1093082 (0.0009) [2023-12-28 03:06:49,540][106226] Updated weights for policy 0, policy_version 1093092 (0.0005) [2023-12-28 03:06:49,591][106226] Updated weights for policy 0, policy_version 1093102 (0.0007) [2023-12-28 03:06:49,644][106226] Updated weights for policy 0, policy_version 1093112 (0.0008) [2023-12-28 03:06:49,917][106225] Updated weights for policy 1, policy_version 1095796 (0.0008) [2023-12-28 03:06:49,977][106225] Updated weights for policy 1, policy_version 1095806 (0.0008) [2023-12-28 03:06:50,036][106225] Updated weights for policy 1, policy_version 1095816 (0.0008) [2023-12-28 03:06:50,421][106226] Updated weights for policy 0, policy_version 1093122 (0.0009) [2023-12-28 03:06:50,478][106226] Updated weights for policy 0, policy_version 1093132 (0.0008) [2023-12-28 03:06:50,527][106226] Updated weights for policy 0, policy_version 1093142 (0.0008) [2023-12-28 03:06:50,759][106225] Updated weights for policy 1, policy_version 1095826 (0.0008) [2023-12-28 03:06:50,822][106225] Updated weights for policy 1, policy_version 1095836 (0.0008) [2023-12-28 03:06:50,887][106225] Updated weights for policy 1, policy_version 1095846 (0.0010) [2023-12-28 03:06:50,946][106225] Updated weights for policy 1, policy_version 1095856 (0.0008) [2023-12-28 03:06:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 560488448. Throughput: 0: 9994.2, 1: 9791.7. Samples: 560498380. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:51,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.699')] [2023-12-28 03:06:51,274][106226] Updated weights for policy 0, policy_version 1093152 (0.0007) [2023-12-28 03:06:51,332][106226] Updated weights for policy 0, policy_version 1093162 (0.0009) [2023-12-28 03:06:51,402][106226] Updated weights for policy 0, policy_version 1093172 (0.0008) [2023-12-28 03:06:51,677][106225] Updated weights for policy 1, policy_version 1095866 (0.0007) [2023-12-28 03:06:51,741][106225] Updated weights for policy 1, policy_version 1095876 (0.0008) [2023-12-28 03:06:51,810][106225] Updated weights for policy 1, policy_version 1095886 (0.0007) [2023-12-28 03:06:52,166][106226] Updated weights for policy 0, policy_version 1093182 (0.0010) [2023-12-28 03:06:52,231][106226] Updated weights for policy 0, policy_version 1093192 (0.0009) [2023-12-28 03:06:52,296][106226] Updated weights for policy 0, policy_version 1093202 (0.0008) [2023-12-28 03:06:52,486][106225] Updated weights for policy 1, policy_version 1095896 (0.0007) [2023-12-28 03:06:52,552][106225] Updated weights for policy 1, policy_version 1095906 (0.0007) [2023-12-28 03:06:52,613][106225] Updated weights for policy 1, policy_version 1095916 (0.0008) [2023-12-28 03:06:53,100][106226] Updated weights for policy 0, policy_version 1093212 (0.0007) [2023-12-28 03:06:53,167][106226] Updated weights for policy 0, policy_version 1093222 (0.0005) [2023-12-28 03:06:53,225][106226] Updated weights for policy 0, policy_version 1093232 (0.0005) [2023-12-28 03:06:53,242][106225] Updated weights for policy 1, policy_version 1095926 (0.0008) [2023-12-28 03:06:53,298][106225] Updated weights for policy 1, policy_version 1095936 (0.0009) [2023-12-28 03:06:53,343][106225] Updated weights for policy 1, policy_version 1095946 (0.0008) [2023-12-28 03:06:53,901][106226] Updated weights for policy 0, policy_version 1093242 (0.0008) [2023-12-28 03:06:53,966][106226] Updated weights for policy 0, policy_version 1093252 (0.0006) [2023-12-28 03:06:54,011][106225] Updated weights for policy 1, policy_version 1095956 (0.0008) [2023-12-28 03:06:54,025][106226] Updated weights for policy 0, policy_version 1093262 (0.0005) [2023-12-28 03:06:54,070][106225] Updated weights for policy 1, policy_version 1095966 (0.0006) [2023-12-28 03:06:54,087][106226] Updated weights for policy 0, policy_version 1093272 (0.0006) [2023-12-28 03:06:54,131][106225] Updated weights for policy 1, policy_version 1095976 (0.0009) [2023-12-28 03:06:54,665][106226] Updated weights for policy 0, policy_version 1093282 (0.0005) [2023-12-28 03:06:54,721][106226] Updated weights for policy 0, policy_version 1093292 (0.0008) [2023-12-28 03:06:54,774][106226] Updated weights for policy 0, policy_version 1093302 (0.0009) [2023-12-28 03:06:54,783][106225] Updated weights for policy 1, policy_version 1095986 (0.0010) [2023-12-28 03:06:54,839][106225] Updated weights for policy 1, policy_version 1095996 (0.0010) [2023-12-28 03:06:54,885][106225] Updated weights for policy 1, policy_version 1096006 (0.0010) [2023-12-28 03:06:54,936][106225] Updated weights for policy 1, policy_version 1096016 (0.0009) [2023-12-28 03:06:55,400][106226] Updated weights for policy 0, policy_version 1093312 (0.0011) [2023-12-28 03:06:55,457][106226] Updated weights for policy 0, policy_version 1093322 (0.0010) [2023-12-28 03:06:55,511][106225] Updated weights for policy 1, policy_version 1096026 (0.0010) [2023-12-28 03:06:55,514][106226] Updated weights for policy 0, policy_version 1093332 (0.0010) [2023-12-28 03:06:55,574][106225] Updated weights for policy 1, policy_version 1096036 (0.0008) [2023-12-28 03:06:55,629][106225] Updated weights for policy 1, policy_version 1096046 (0.0008) [2023-12-28 03:06:56,107][106226] Updated weights for policy 0, policy_version 1093342 (0.0011) [2023-12-28 03:06:56,161][106226] Updated weights for policy 0, policy_version 1093352 (0.0010) [2023-12-28 03:06:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 560586752. Throughput: 0: 9906.2, 1: 9825.4. Samples: 560556064. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:06:56,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-4.845')] [2023-12-28 03:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001096048_280633344.pth... [2023-12-28 03:06:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001094896_280338432.pth [2023-12-28 03:06:56,217][106226] Updated weights for policy 0, policy_version 1093362 (0.0008) [2023-12-28 03:06:56,252][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001093368_279961600.pth... [2023-12-28 03:06:56,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001092184_279658496.pth [2023-12-28 03:06:56,318][106225] Updated weights for policy 1, policy_version 1096056 (0.0010) [2023-12-28 03:06:56,378][106225] Updated weights for policy 1, policy_version 1096066 (0.0010) [2023-12-28 03:06:56,435][106225] Updated weights for policy 1, policy_version 1096076 (0.0010) [2023-12-28 03:06:56,860][106226] Updated weights for policy 0, policy_version 1093372 (0.0008) [2023-12-28 03:06:56,916][106226] Updated weights for policy 0, policy_version 1093382 (0.0010) [2023-12-28 03:06:56,968][106226] Updated weights for policy 0, policy_version 1093392 (0.0005) [2023-12-28 03:06:57,036][106225] Updated weights for policy 1, policy_version 1096086 (0.0010) [2023-12-28 03:06:57,082][106225] Updated weights for policy 1, policy_version 1096096 (0.0010) [2023-12-28 03:06:57,127][106225] Updated weights for policy 1, policy_version 1096106 (0.0010) [2023-12-28 03:06:57,633][106226] Updated weights for policy 0, policy_version 1093402 (0.0006) [2023-12-28 03:06:57,685][106226] Updated weights for policy 0, policy_version 1093412 (0.0010) [2023-12-28 03:06:57,737][106226] Updated weights for policy 0, policy_version 1093422 (0.0007) [2023-12-28 03:06:57,792][106226] Updated weights for policy 0, policy_version 1093432 (0.0005) [2023-12-28 03:06:57,827][106225] Updated weights for policy 1, policy_version 1096116 (0.0010) [2023-12-28 03:06:57,881][106225] Updated weights for policy 1, policy_version 1096126 (0.0010) [2023-12-28 03:06:57,927][106225] Updated weights for policy 1, policy_version 1096136 (0.0010) [2023-12-28 03:06:58,484][106226] Updated weights for policy 0, policy_version 1093442 (0.0010) [2023-12-28 03:06:58,556][106226] Updated weights for policy 0, policy_version 1093452 (0.0010) [2023-12-28 03:06:58,621][106226] Updated weights for policy 0, policy_version 1093462 (0.0011) [2023-12-28 03:06:58,728][106225] Updated weights for policy 1, policy_version 1096146 (0.0010) [2023-12-28 03:06:58,794][106225] Updated weights for policy 1, policy_version 1096156 (0.0009) [2023-12-28 03:06:58,862][106225] Updated weights for policy 1, policy_version 1096166 (0.0009) [2023-12-28 03:06:58,929][106225] Updated weights for policy 1, policy_version 1096176 (0.0008) [2023-12-28 03:06:59,479][106226] Updated weights for policy 0, policy_version 1093472 (0.0009) [2023-12-28 03:06:59,543][106226] Updated weights for policy 0, policy_version 1093482 (0.0009) [2023-12-28 03:06:59,604][106226] Updated weights for policy 0, policy_version 1093492 (0.0006) [2023-12-28 03:06:59,751][106225] Updated weights for policy 1, policy_version 1096186 (0.0009) [2023-12-28 03:06:59,800][106225] Updated weights for policy 1, policy_version 1096196 (0.0008) [2023-12-28 03:06:59,874][106225] Updated weights for policy 1, policy_version 1096206 (0.0008) [2023-12-28 03:07:00,321][106226] Updated weights for policy 0, policy_version 1093502 (0.0008) [2023-12-28 03:07:00,381][106226] Updated weights for policy 0, policy_version 1093512 (0.0009) [2023-12-28 03:07:00,434][106226] Updated weights for policy 0, policy_version 1093522 (0.0008) [2023-12-28 03:07:00,527][106225] Updated weights for policy 1, policy_version 1096216 (0.0009) [2023-12-28 03:07:00,570][106225] Updated weights for policy 1, policy_version 1096226 (0.0010) [2023-12-28 03:07:00,616][106225] Updated weights for policy 1, policy_version 1096236 (0.0010) [2023-12-28 03:07:01,157][106226] Updated weights for policy 0, policy_version 1093532 (0.0008) [2023-12-28 03:07:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 560685056. Throughput: 0: 10008.6, 1: 9865.6. Samples: 560679380. Policy #0 lag: (min: 39.0, avg: 47.8, max: 48.0) [2023-12-28 03:07:01,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-4.989')] [2023-12-28 03:07:01,218][106226] Updated weights for policy 0, policy_version 1093542 (0.0008) [2023-12-28 03:07:01,278][106226] Updated weights for policy 0, policy_version 1093552 (0.0008) [2023-12-28 03:07:01,391][106225] Updated weights for policy 1, policy_version 1096246 (0.0011) [2023-12-28 03:07:01,448][106225] Updated weights for policy 1, policy_version 1096256 (0.0009) [2023-12-28 03:07:01,504][106225] Updated weights for policy 1, policy_version 1096266 (0.0010) [2023-12-28 03:07:02,087][106226] Updated weights for policy 0, policy_version 1093562 (0.0008) [2023-12-28 03:07:02,131][106225] Updated weights for policy 1, policy_version 1096276 (0.0008) [2023-12-28 03:07:02,152][106226] Updated weights for policy 0, policy_version 1093572 (0.0006) [2023-12-28 03:07:02,188][106225] Updated weights for policy 1, policy_version 1096286 (0.0005) [2023-12-28 03:07:02,205][106226] Updated weights for policy 0, policy_version 1093582 (0.0007) [2023-12-28 03:07:02,245][106225] Updated weights for policy 1, policy_version 1096296 (0.0007) [2023-12-28 03:07:02,256][106226] Updated weights for policy 0, policy_version 1093592 (0.0005) [2023-12-28 03:07:02,879][106225] Updated weights for policy 1, policy_version 1096306 (0.0007) [2023-12-28 03:07:02,937][106225] Updated weights for policy 1, policy_version 1096316 (0.0008) [2023-12-28 03:07:02,997][106225] Updated weights for policy 1, policy_version 1096326 (0.0006) [2023-12-28 03:07:03,011][106226] Updated weights for policy 0, policy_version 1093602 (0.0007) [2023-12-28 03:07:03,046][106225] Updated weights for policy 1, policy_version 1096336 (0.0005) [2023-12-28 03:07:03,071][106226] Updated weights for policy 0, policy_version 1093612 (0.0008) [2023-12-28 03:07:03,146][106226] Updated weights for policy 0, policy_version 1093622 (0.0010) [2023-12-28 03:07:03,678][106225] Updated weights for policy 1, policy_version 1096346 (0.0007) [2023-12-28 03:07:03,739][106225] Updated weights for policy 1, policy_version 1096356 (0.0005) [2023-12-28 03:07:03,746][106226] Updated weights for policy 0, policy_version 1093632 (0.0006) [2023-12-28 03:07:03,799][106225] Updated weights for policy 1, policy_version 1096366 (0.0006) [2023-12-28 03:07:03,801][106226] Updated weights for policy 0, policy_version 1093642 (0.0006) [2023-12-28 03:07:03,865][106226] Updated weights for policy 0, policy_version 1093652 (0.0006) [2023-12-28 03:07:04,470][106225] Updated weights for policy 1, policy_version 1096376 (0.0010) [2023-12-28 03:07:04,527][106225] Updated weights for policy 1, policy_version 1096386 (0.0010) [2023-12-28 03:07:04,540][106226] Updated weights for policy 0, policy_version 1093662 (0.0009) [2023-12-28 03:07:04,584][106225] Updated weights for policy 1, policy_version 1096396 (0.0010) [2023-12-28 03:07:04,593][106226] Updated weights for policy 0, policy_version 1093672 (0.0010) [2023-12-28 03:07:04,648][106226] Updated weights for policy 0, policy_version 1093682 (0.0010) [2023-12-28 03:07:05,298][106225] Updated weights for policy 1, policy_version 1096406 (0.0010) [2023-12-28 03:07:05,342][106226] Updated weights for policy 0, policy_version 1093692 (0.0009) [2023-12-28 03:07:05,359][106225] Updated weights for policy 1, policy_version 1096416 (0.0010) [2023-12-28 03:07:05,394][106226] Updated weights for policy 0, policy_version 1093702 (0.0006) [2023-12-28 03:07:05,409][106225] Updated weights for policy 1, policy_version 1096426 (0.0010) [2023-12-28 03:07:05,449][106226] Updated weights for policy 0, policy_version 1093712 (0.0008) [2023-12-28 03:07:06,023][106226] Updated weights for policy 0, policy_version 1093722 (0.0009) [2023-12-28 03:07:06,033][106225] Updated weights for policy 1, policy_version 1096436 (0.0008) [2023-12-28 03:07:06,081][106226] Updated weights for policy 0, policy_version 1093732 (0.0005) [2023-12-28 03:07:06,093][106225] Updated weights for policy 1, policy_version 1096446 (0.0006) [2023-12-28 03:07:06,145][106226] Updated weights for policy 0, policy_version 1093742 (0.0008) [2023-12-28 03:07:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 560783360. Throughput: 0: 10066.5, 1: 9917.8. Samples: 560800432. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:06,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.658')] [2023-12-28 03:07:06,178][106225] Updated weights for policy 1, policy_version 1096456 (0.0009) [2023-12-28 03:07:06,209][106226] Updated weights for policy 0, policy_version 1093752 (0.0006) [2023-12-28 03:07:06,823][106226] Updated weights for policy 0, policy_version 1093762 (0.0008) [2023-12-28 03:07:06,882][106226] Updated weights for policy 0, policy_version 1093772 (0.0007) [2023-12-28 03:07:06,886][106225] Updated weights for policy 1, policy_version 1096466 (0.0010) [2023-12-28 03:07:06,940][106225] Updated weights for policy 1, policy_version 1096476 (0.0010) [2023-12-28 03:07:06,943][106226] Updated weights for policy 0, policy_version 1093782 (0.0007) [2023-12-28 03:07:06,992][106225] Updated weights for policy 1, policy_version 1096486 (0.0010) [2023-12-28 03:07:07,046][106225] Updated weights for policy 1, policy_version 1096496 (0.0010) [2023-12-28 03:07:07,657][106226] Updated weights for policy 0, policy_version 1093792 (0.0007) [2023-12-28 03:07:07,717][106226] Updated weights for policy 0, policy_version 1093802 (0.0007) [2023-12-28 03:07:07,775][106226] Updated weights for policy 0, policy_version 1093812 (0.0006) [2023-12-28 03:07:07,788][106225] Updated weights for policy 1, policy_version 1096506 (0.0010) [2023-12-28 03:07:07,844][106225] Updated weights for policy 1, policy_version 1096516 (0.0010) [2023-12-28 03:07:07,897][106225] Updated weights for policy 1, policy_version 1096526 (0.0010) [2023-12-28 03:07:08,490][106226] Updated weights for policy 0, policy_version 1093822 (0.0007) [2023-12-28 03:07:08,542][106226] Updated weights for policy 0, policy_version 1093832 (0.0007) [2023-12-28 03:07:08,600][106226] Updated weights for policy 0, policy_version 1093842 (0.0007) [2023-12-28 03:07:08,612][106225] Updated weights for policy 1, policy_version 1096536 (0.0010) [2023-12-28 03:07:08,673][106225] Updated weights for policy 1, policy_version 1096546 (0.0010) [2023-12-28 03:07:08,725][106225] Updated weights for policy 1, policy_version 1096556 (0.0010) [2023-12-28 03:07:09,335][106226] Updated weights for policy 0, policy_version 1093852 (0.0010) [2023-12-28 03:07:09,416][106226] Updated weights for policy 0, policy_version 1093862 (0.0009) [2023-12-28 03:07:09,483][106225] Updated weights for policy 1, policy_version 1096566 (0.0007) [2023-12-28 03:07:09,485][106226] Updated weights for policy 0, policy_version 1093872 (0.0008) [2023-12-28 03:07:09,546][106225] Updated weights for policy 1, policy_version 1096576 (0.0008) [2023-12-28 03:07:09,606][106225] Updated weights for policy 1, policy_version 1096586 (0.0008) [2023-12-28 03:07:10,214][106226] Updated weights for policy 0, policy_version 1093882 (0.0010) [2023-12-28 03:07:10,273][106226] Updated weights for policy 0, policy_version 1093892 (0.0008) [2023-12-28 03:07:10,336][106226] Updated weights for policy 0, policy_version 1093902 (0.0008) [2023-12-28 03:07:10,379][106225] Updated weights for policy 1, policy_version 1096596 (0.0008) [2023-12-28 03:07:10,400][106226] Updated weights for policy 0, policy_version 1093912 (0.0008) [2023-12-28 03:07:10,442][106225] Updated weights for policy 1, policy_version 1096606 (0.0009) [2023-12-28 03:07:10,506][106225] Updated weights for policy 1, policy_version 1096616 (0.0009) [2023-12-28 03:07:11,121][106225] Updated weights for policy 1, policy_version 1096626 (0.0008) [2023-12-28 03:07:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 560881664. Throughput: 0: 10056.1, 1: 9929.0. Samples: 560859884. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:11,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-5.018')] [2023-12-28 03:07:11,189][106225] Updated weights for policy 1, policy_version 1096636 (0.0008) [2023-12-28 03:07:11,194][106226] Updated weights for policy 0, policy_version 1093922 (0.0007) [2023-12-28 03:07:11,250][106225] Updated weights for policy 1, policy_version 1096646 (0.0008) [2023-12-28 03:07:11,261][106226] Updated weights for policy 0, policy_version 1093932 (0.0007) [2023-12-28 03:07:11,309][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001096656_280788992.pth... [2023-12-28 03:07:11,311][106225] Updated weights for policy 1, policy_version 1096656 (0.0008) [2023-12-28 03:07:11,313][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001095472_280485888.pth [2023-12-28 03:07:11,328][106226] Updated weights for policy 0, policy_version 1093942 (0.0007) [2023-12-28 03:07:11,336][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001093944_280109056.pth... [2023-12-28 03:07:11,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001092760_279805952.pth [2023-12-28 03:07:12,070][106225] Updated weights for policy 1, policy_version 1096666 (0.0007) [2023-12-28 03:07:12,130][106225] Updated weights for policy 1, policy_version 1096676 (0.0006) [2023-12-28 03:07:12,140][106226] Updated weights for policy 0, policy_version 1093952 (0.0007) [2023-12-28 03:07:12,187][106225] Updated weights for policy 1, policy_version 1096686 (0.0007) [2023-12-28 03:07:12,195][106226] Updated weights for policy 0, policy_version 1093962 (0.0008) [2023-12-28 03:07:12,259][106226] Updated weights for policy 0, policy_version 1093972 (0.0008) [2023-12-28 03:07:12,869][106225] Updated weights for policy 1, policy_version 1096696 (0.0006) [2023-12-28 03:07:12,935][106225] Updated weights for policy 1, policy_version 1096706 (0.0007) [2023-12-28 03:07:12,998][106225] Updated weights for policy 1, policy_version 1096716 (0.0009) [2023-12-28 03:07:13,058][106226] Updated weights for policy 0, policy_version 1093982 (0.0009) [2023-12-28 03:07:13,121][106226] Updated weights for policy 0, policy_version 1093992 (0.0009) [2023-12-28 03:07:13,183][106226] Updated weights for policy 0, policy_version 1094002 (0.0009) [2023-12-28 03:07:13,640][106225] Updated weights for policy 1, policy_version 1096726 (0.0009) [2023-12-28 03:07:13,696][106225] Updated weights for policy 1, policy_version 1096736 (0.0009) [2023-12-28 03:07:13,752][106225] Updated weights for policy 1, policy_version 1096746 (0.0008) [2023-12-28 03:07:13,854][106226] Updated weights for policy 0, policy_version 1094012 (0.0007) [2023-12-28 03:07:13,911][106226] Updated weights for policy 0, policy_version 1094022 (0.0006) [2023-12-28 03:07:13,970][106226] Updated weights for policy 0, policy_version 1094032 (0.0006) [2023-12-28 03:07:14,553][106225] Updated weights for policy 1, policy_version 1096756 (0.0007) [2023-12-28 03:07:14,595][106226] Updated weights for policy 0, policy_version 1094042 (0.0007) [2023-12-28 03:07:14,613][106225] Updated weights for policy 1, policy_version 1096766 (0.0006) [2023-12-28 03:07:14,656][106226] Updated weights for policy 0, policy_version 1094052 (0.0011) [2023-12-28 03:07:14,676][106225] Updated weights for policy 1, policy_version 1096776 (0.0006) [2023-12-28 03:07:14,714][106226] Updated weights for policy 0, policy_version 1094062 (0.0009) [2023-12-28 03:07:14,770][106226] Updated weights for policy 0, policy_version 1094072 (0.0006) [2023-12-28 03:07:15,428][106226] Updated weights for policy 0, policy_version 1094082 (0.0005) [2023-12-28 03:07:15,463][106225] Updated weights for policy 1, policy_version 1096786 (0.0007) [2023-12-28 03:07:15,492][106226] Updated weights for policy 0, policy_version 1094092 (0.0005) [2023-12-28 03:07:15,524][106225] Updated weights for policy 1, policy_version 1096796 (0.0008) [2023-12-28 03:07:15,557][106226] Updated weights for policy 0, policy_version 1094102 (0.0005) [2023-12-28 03:07:15,586][106225] Updated weights for policy 1, policy_version 1096806 (0.0009) [2023-12-28 03:07:15,657][106225] Updated weights for policy 1, policy_version 1096816 (0.0010) [2023-12-28 03:07:16,069][106226] Updated weights for policy 0, policy_version 1094112 (0.0006) [2023-12-28 03:07:16,142][106226] Updated weights for policy 0, policy_version 1094122 (0.0010) [2023-12-28 03:07:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 560979968. Throughput: 0: 9903.8, 1: 9848.0. Samples: 560974332. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:16,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.709')] [2023-12-28 03:07:16,189][106226] Updated weights for policy 0, policy_version 1094132 (0.0007) [2023-12-28 03:07:16,426][106225] Updated weights for policy 1, policy_version 1096826 (0.0005) [2023-12-28 03:07:16,480][106225] Updated weights for policy 1, policy_version 1096836 (0.0005) [2023-12-28 03:07:16,539][106225] Updated weights for policy 1, policy_version 1096846 (0.0006) [2023-12-28 03:07:16,844][106226] Updated weights for policy 0, policy_version 1094142 (0.0009) [2023-12-28 03:07:16,908][106226] Updated weights for policy 0, policy_version 1094152 (0.0010) [2023-12-28 03:07:16,955][106226] Updated weights for policy 0, policy_version 1094162 (0.0008) [2023-12-28 03:07:17,109][106225] Updated weights for policy 1, policy_version 1096856 (0.0007) [2023-12-28 03:07:17,176][106225] Updated weights for policy 1, policy_version 1096866 (0.0006) [2023-12-28 03:07:17,244][106225] Updated weights for policy 1, policy_version 1096876 (0.0005) [2023-12-28 03:07:17,573][106226] Updated weights for policy 0, policy_version 1094172 (0.0005) [2023-12-28 03:07:17,628][106226] Updated weights for policy 0, policy_version 1094182 (0.0005) [2023-12-28 03:07:17,696][106226] Updated weights for policy 0, policy_version 1094192 (0.0006) [2023-12-28 03:07:17,833][106225] Updated weights for policy 1, policy_version 1096886 (0.0007) [2023-12-28 03:07:17,897][106225] Updated weights for policy 1, policy_version 1096896 (0.0007) [2023-12-28 03:07:17,959][106225] Updated weights for policy 1, policy_version 1096906 (0.0009) [2023-12-28 03:07:18,385][106226] Updated weights for policy 0, policy_version 1094202 (0.0008) [2023-12-28 03:07:18,444][106226] Updated weights for policy 0, policy_version 1094212 (0.0009) [2023-12-28 03:07:18,507][106226] Updated weights for policy 0, policy_version 1094222 (0.0009) [2023-12-28 03:07:18,575][106226] Updated weights for policy 0, policy_version 1094232 (0.0008) [2023-12-28 03:07:18,674][106225] Updated weights for policy 1, policy_version 1096916 (0.0008) [2023-12-28 03:07:18,726][106225] Updated weights for policy 1, policy_version 1096926 (0.0008) [2023-12-28 03:07:18,785][106225] Updated weights for policy 1, policy_version 1096936 (0.0009) [2023-12-28 03:07:19,299][106226] Updated weights for policy 0, policy_version 1094242 (0.0009) [2023-12-28 03:07:19,358][106226] Updated weights for policy 0, policy_version 1094252 (0.0009) [2023-12-28 03:07:19,424][106226] Updated weights for policy 0, policy_version 1094262 (0.0008) [2023-12-28 03:07:19,534][106225] Updated weights for policy 1, policy_version 1096946 (0.0007) [2023-12-28 03:07:19,595][106225] Updated weights for policy 1, policy_version 1096956 (0.0009) [2023-12-28 03:07:19,664][106225] Updated weights for policy 1, policy_version 1096966 (0.0009) [2023-12-28 03:07:19,727][106225] Updated weights for policy 1, policy_version 1096976 (0.0007) [2023-12-28 03:07:20,177][106226] Updated weights for policy 0, policy_version 1094272 (0.0007) [2023-12-28 03:07:20,249][106226] Updated weights for policy 0, policy_version 1094282 (0.0007) [2023-12-28 03:07:20,320][106226] Updated weights for policy 0, policy_version 1094292 (0.0006) [2023-12-28 03:07:20,422][106225] Updated weights for policy 1, policy_version 1096986 (0.0008) [2023-12-28 03:07:20,483][106225] Updated weights for policy 1, policy_version 1096996 (0.0007) [2023-12-28 03:07:20,541][106225] Updated weights for policy 1, policy_version 1097006 (0.0008) [2023-12-28 03:07:21,023][106226] Updated weights for policy 0, policy_version 1094302 (0.0008) [2023-12-28 03:07:21,095][106226] Updated weights for policy 0, policy_version 1094312 (0.0009) [2023-12-28 03:07:21,155][106226] Updated weights for policy 0, policy_version 1094322 (0.0009) [2023-12-28 03:07:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 561078272. Throughput: 0: 9895.0, 1: 9835.1. Samples: 561093952. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:21,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.899')] [2023-12-28 03:07:21,464][106225] Updated weights for policy 1, policy_version 1097016 (0.0009) [2023-12-28 03:07:21,517][106225] Updated weights for policy 1, policy_version 1097026 (0.0007) [2023-12-28 03:07:21,583][106225] Updated weights for policy 1, policy_version 1097036 (0.0005) [2023-12-28 03:07:22,021][106226] Updated weights for policy 0, policy_version 1094332 (0.0009) [2023-12-28 03:07:22,088][106226] Updated weights for policy 0, policy_version 1094342 (0.0006) [2023-12-28 03:07:22,148][106226] Updated weights for policy 0, policy_version 1094352 (0.0006) [2023-12-28 03:07:22,361][106225] Updated weights for policy 1, policy_version 1097046 (0.0013) [2023-12-28 03:07:22,419][106225] Updated weights for policy 1, policy_version 1097056 (0.0009) [2023-12-28 03:07:22,489][106225] Updated weights for policy 1, policy_version 1097066 (0.0008) [2023-12-28 03:07:22,822][106226] Updated weights for policy 0, policy_version 1094362 (0.0005) [2023-12-28 03:07:22,893][106226] Updated weights for policy 0, policy_version 1094372 (0.0006) [2023-12-28 03:07:22,957][106226] Updated weights for policy 0, policy_version 1094382 (0.0006) [2023-12-28 03:07:23,021][106226] Updated weights for policy 0, policy_version 1094392 (0.0006) [2023-12-28 03:07:23,140][106225] Updated weights for policy 1, policy_version 1097076 (0.0010) [2023-12-28 03:07:23,199][106225] Updated weights for policy 1, policy_version 1097086 (0.0010) [2023-12-28 03:07:23,262][106225] Updated weights for policy 1, policy_version 1097096 (0.0010) [2023-12-28 03:07:23,637][106226] Updated weights for policy 0, policy_version 1094402 (0.0005) [2023-12-28 03:07:23,686][106226] Updated weights for policy 0, policy_version 1094412 (0.0005) [2023-12-28 03:07:23,740][106226] Updated weights for policy 0, policy_version 1094422 (0.0007) [2023-12-28 03:07:23,884][106225] Updated weights for policy 1, policy_version 1097106 (0.0009) [2023-12-28 03:07:23,949][106225] Updated weights for policy 1, policy_version 1097116 (0.0005) [2023-12-28 03:07:24,016][106225] Updated weights for policy 1, policy_version 1097126 (0.0005) [2023-12-28 03:07:24,064][106225] Updated weights for policy 1, policy_version 1097136 (0.0005) [2023-12-28 03:07:24,333][106226] Updated weights for policy 0, policy_version 1094432 (0.0006) [2023-12-28 03:07:24,391][106226] Updated weights for policy 0, policy_version 1094442 (0.0005) [2023-12-28 03:07:24,450][106226] Updated weights for policy 0, policy_version 1094452 (0.0006) [2023-12-28 03:07:24,712][106225] Updated weights for policy 1, policy_version 1097146 (0.0009) [2023-12-28 03:07:24,768][106225] Updated weights for policy 1, policy_version 1097156 (0.0009) [2023-12-28 03:07:24,827][106225] Updated weights for policy 1, policy_version 1097166 (0.0008) [2023-12-28 03:07:25,078][106226] Updated weights for policy 0, policy_version 1094462 (0.0008) [2023-12-28 03:07:25,123][106226] Updated weights for policy 0, policy_version 1094472 (0.0005) [2023-12-28 03:07:25,169][106226] Updated weights for policy 0, policy_version 1094482 (0.0005) [2023-12-28 03:07:25,485][106225] Updated weights for policy 1, policy_version 1097176 (0.0006) [2023-12-28 03:07:25,551][106225] Updated weights for policy 1, policy_version 1097186 (0.0007) [2023-12-28 03:07:25,611][106225] Updated weights for policy 1, policy_version 1097196 (0.0008) [2023-12-28 03:07:25,879][106226] Updated weights for policy 0, policy_version 1094492 (0.0006) [2023-12-28 03:07:25,943][106226] Updated weights for policy 0, policy_version 1094502 (0.0009) [2023-12-28 03:07:25,995][106226] Updated weights for policy 0, policy_version 1094512 (0.0008) [2023-12-28 03:07:26,162][106225] Updated weights for policy 1, policy_version 1097206 (0.0006) [2023-12-28 03:07:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 561184768. Throughput: 0: 9873.4, 1: 9804.6. Samples: 561151880. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:26,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.613')] [2023-12-28 03:07:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001094520_280256512.pth... [2023-12-28 03:07:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001093368_279961600.pth [2023-12-28 03:07:26,218][106225] Updated weights for policy 1, policy_version 1097216 (0.0005) [2023-12-28 03:07:26,269][106225] Updated weights for policy 1, policy_version 1097226 (0.0008) [2023-12-28 03:07:26,300][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001097232_280936448.pth... [2023-12-28 03:07:26,303][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001096048_280633344.pth [2023-12-28 03:07:26,604][106226] Updated weights for policy 0, policy_version 1094522 (0.0007) [2023-12-28 03:07:26,656][106226] Updated weights for policy 0, policy_version 1094532 (0.0005) [2023-12-28 03:07:26,719][106226] Updated weights for policy 0, policy_version 1094542 (0.0009) [2023-12-28 03:07:26,775][106226] Updated weights for policy 0, policy_version 1094552 (0.0010) [2023-12-28 03:07:26,861][106225] Updated weights for policy 1, policy_version 1097236 (0.0009) [2023-12-28 03:07:26,918][106225] Updated weights for policy 1, policy_version 1097246 (0.0009) [2023-12-28 03:07:26,964][106225] Updated weights for policy 1, policy_version 1097256 (0.0007) [2023-12-28 03:07:27,415][106226] Updated weights for policy 0, policy_version 1094562 (0.0010) [2023-12-28 03:07:27,480][106226] Updated weights for policy 0, policy_version 1094572 (0.0010) [2023-12-28 03:07:27,546][106226] Updated weights for policy 0, policy_version 1094582 (0.0010) [2023-12-28 03:07:27,588][106225] Updated weights for policy 1, policy_version 1097266 (0.0007) [2023-12-28 03:07:27,639][106225] Updated weights for policy 1, policy_version 1097276 (0.0007) [2023-12-28 03:07:27,686][106225] Updated weights for policy 1, policy_version 1097286 (0.0008) [2023-12-28 03:07:27,733][106225] Updated weights for policy 1, policy_version 1097296 (0.0007) [2023-12-28 03:07:28,176][106226] Updated weights for policy 0, policy_version 1094592 (0.0010) [2023-12-28 03:07:28,231][106226] Updated weights for policy 0, policy_version 1094602 (0.0010) [2023-12-28 03:07:28,287][106226] Updated weights for policy 0, policy_version 1094612 (0.0010) [2023-12-28 03:07:28,463][106225] Updated weights for policy 1, policy_version 1097306 (0.0008) [2023-12-28 03:07:28,520][106225] Updated weights for policy 1, policy_version 1097316 (0.0008) [2023-12-28 03:07:28,581][106225] Updated weights for policy 1, policy_version 1097326 (0.0008) [2023-12-28 03:07:29,004][106226] Updated weights for policy 0, policy_version 1094622 (0.0009) [2023-12-28 03:07:29,066][106226] Updated weights for policy 0, policy_version 1094632 (0.0009) [2023-12-28 03:07:29,126][106226] Updated weights for policy 0, policy_version 1094642 (0.0009) [2023-12-28 03:07:29,315][106225] Updated weights for policy 1, policy_version 1097336 (0.0008) [2023-12-28 03:07:29,378][106225] Updated weights for policy 1, policy_version 1097346 (0.0008) [2023-12-28 03:07:29,429][106225] Updated weights for policy 1, policy_version 1097356 (0.0008) [2023-12-28 03:07:29,855][106226] Updated weights for policy 0, policy_version 1094652 (0.0008) [2023-12-28 03:07:29,926][106226] Updated weights for policy 0, policy_version 1094662 (0.0008) [2023-12-28 03:07:29,991][106226] Updated weights for policy 0, policy_version 1094672 (0.0008) [2023-12-28 03:07:30,160][106225] Updated weights for policy 1, policy_version 1097366 (0.0006) [2023-12-28 03:07:30,226][106225] Updated weights for policy 1, policy_version 1097376 (0.0007) [2023-12-28 03:07:30,286][106225] Updated weights for policy 1, policy_version 1097386 (0.0007) [2023-12-28 03:07:30,725][106226] Updated weights for policy 0, policy_version 1094682 (0.0009) [2023-12-28 03:07:30,779][106226] Updated weights for policy 0, policy_version 1094692 (0.0008) [2023-12-28 03:07:30,830][106226] Updated weights for policy 0, policy_version 1094702 (0.0005) [2023-12-28 03:07:30,873][106225] Updated weights for policy 1, policy_version 1097396 (0.0008) [2023-12-28 03:07:30,880][106226] Updated weights for policy 0, policy_version 1094712 (0.0006) [2023-12-28 03:07:30,922][106225] Updated weights for policy 1, policy_version 1097406 (0.0010) [2023-12-28 03:07:30,984][106225] Updated weights for policy 1, policy_version 1097416 (0.0010) [2023-12-28 03:07:31,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561291264. Throughput: 0: 9914.4, 1: 9969.6. Samples: 561276920. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:31,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.969')] [2023-12-28 03:07:31,558][106226] Updated weights for policy 0, policy_version 1094722 (0.0006) [2023-12-28 03:07:31,615][106226] Updated weights for policy 0, policy_version 1094732 (0.0008) [2023-12-28 03:07:31,680][106226] Updated weights for policy 0, policy_version 1094742 (0.0011) [2023-12-28 03:07:31,724][106225] Updated weights for policy 1, policy_version 1097426 (0.0006) [2023-12-28 03:07:31,785][106225] Updated weights for policy 1, policy_version 1097436 (0.0008) [2023-12-28 03:07:31,843][106225] Updated weights for policy 1, policy_version 1097446 (0.0005) [2023-12-28 03:07:31,894][106225] Updated weights for policy 1, policy_version 1097456 (0.0006) [2023-12-28 03:07:32,430][106226] Updated weights for policy 0, policy_version 1094752 (0.0011) [2023-12-28 03:07:32,479][106225] Updated weights for policy 1, policy_version 1097466 (0.0008) [2023-12-28 03:07:32,487][106226] Updated weights for policy 0, policy_version 1094762 (0.0007) [2023-12-28 03:07:32,543][106225] Updated weights for policy 1, policy_version 1097476 (0.0008) [2023-12-28 03:07:32,546][106226] Updated weights for policy 0, policy_version 1094772 (0.0010) [2023-12-28 03:07:32,607][106225] Updated weights for policy 1, policy_version 1097486 (0.0007) [2023-12-28 03:07:33,234][106226] Updated weights for policy 0, policy_version 1094782 (0.0011) [2023-12-28 03:07:33,269][106225] Updated weights for policy 1, policy_version 1097496 (0.0006) [2023-12-28 03:07:33,295][106226] Updated weights for policy 0, policy_version 1094792 (0.0010) [2023-12-28 03:07:33,328][106225] Updated weights for policy 1, policy_version 1097506 (0.0006) [2023-12-28 03:07:33,345][106226] Updated weights for policy 0, policy_version 1094802 (0.0010) [2023-12-28 03:07:33,388][106225] Updated weights for policy 1, policy_version 1097516 (0.0007) [2023-12-28 03:07:33,972][106226] Updated weights for policy 0, policy_version 1094812 (0.0006) [2023-12-28 03:07:33,996][106225] Updated weights for policy 1, policy_version 1097526 (0.0006) [2023-12-28 03:07:34,030][106226] Updated weights for policy 0, policy_version 1094822 (0.0005) [2023-12-28 03:07:34,059][106225] Updated weights for policy 1, policy_version 1097536 (0.0010) [2023-12-28 03:07:34,081][106226] Updated weights for policy 0, policy_version 1094832 (0.0005) [2023-12-28 03:07:34,112][106225] Updated weights for policy 1, policy_version 1097546 (0.0010) [2023-12-28 03:07:34,729][106225] Updated weights for policy 1, policy_version 1097556 (0.0009) [2023-12-28 03:07:34,755][106226] Updated weights for policy 0, policy_version 1094842 (0.0006) [2023-12-28 03:07:34,789][106225] Updated weights for policy 1, policy_version 1097566 (0.0007) [2023-12-28 03:07:34,806][106226] Updated weights for policy 0, policy_version 1094852 (0.0009) [2023-12-28 03:07:34,847][106225] Updated weights for policy 1, policy_version 1097576 (0.0005) [2023-12-28 03:07:34,856][106226] Updated weights for policy 0, policy_version 1094862 (0.0010) [2023-12-28 03:07:34,906][106226] Updated weights for policy 0, policy_version 1094872 (0.0011) [2023-12-28 03:07:35,571][106225] Updated weights for policy 1, policy_version 1097586 (0.0006) [2023-12-28 03:07:35,629][106225] Updated weights for policy 1, policy_version 1097596 (0.0006) [2023-12-28 03:07:35,630][106226] Updated weights for policy 0, policy_version 1094882 (0.0011) [2023-12-28 03:07:35,682][106225] Updated weights for policy 1, policy_version 1097606 (0.0008) [2023-12-28 03:07:35,688][106226] Updated weights for policy 0, policy_version 1094892 (0.0010) [2023-12-28 03:07:35,730][106225] Updated weights for policy 1, policy_version 1097616 (0.0006) [2023-12-28 03:07:35,754][106226] Updated weights for policy 0, policy_version 1094902 (0.0010) [2023-12-28 03:07:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 561389568. Throughput: 0: 9975.3, 1: 10065.5. Samples: 561400216. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:36,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-5.079')] [2023-12-28 03:07:36,340][106226] Updated weights for policy 0, policy_version 1094912 (0.0008) [2023-12-28 03:07:36,402][106226] Updated weights for policy 0, policy_version 1094922 (0.0011) [2023-12-28 03:07:36,461][106226] Updated weights for policy 0, policy_version 1094932 (0.0010) [2023-12-28 03:07:36,563][106225] Updated weights for policy 1, policy_version 1097626 (0.0007) [2023-12-28 03:07:36,625][106225] Updated weights for policy 1, policy_version 1097636 (0.0008) [2023-12-28 03:07:36,691][106225] Updated weights for policy 1, policy_version 1097646 (0.0008) [2023-12-28 03:07:37,145][106226] Updated weights for policy 0, policy_version 1094942 (0.0009) [2023-12-28 03:07:37,202][106226] Updated weights for policy 0, policy_version 1094952 (0.0009) [2023-12-28 03:07:37,249][106226] Updated weights for policy 0, policy_version 1094962 (0.0005) [2023-12-28 03:07:37,450][106225] Updated weights for policy 1, policy_version 1097656 (0.0008) [2023-12-28 03:07:37,501][106225] Updated weights for policy 1, policy_version 1097666 (0.0005) [2023-12-28 03:07:37,557][106225] Updated weights for policy 1, policy_version 1097676 (0.0005) [2023-12-28 03:07:37,818][106226] Updated weights for policy 0, policy_version 1094972 (0.0005) [2023-12-28 03:07:37,881][106226] Updated weights for policy 0, policy_version 1094982 (0.0005) [2023-12-28 03:07:37,951][106226] Updated weights for policy 0, policy_version 1094992 (0.0005) [2023-12-28 03:07:38,229][106225] Updated weights for policy 1, policy_version 1097686 (0.0005) [2023-12-28 03:07:38,299][106225] Updated weights for policy 1, policy_version 1097696 (0.0007) [2023-12-28 03:07:38,367][106225] Updated weights for policy 1, policy_version 1097706 (0.0008) [2023-12-28 03:07:38,473][106226] Updated weights for policy 0, policy_version 1095002 (0.0006) [2023-12-28 03:07:38,534][106226] Updated weights for policy 0, policy_version 1095012 (0.0006) [2023-12-28 03:07:38,598][106226] Updated weights for policy 0, policy_version 1095022 (0.0009) [2023-12-28 03:07:38,666][106226] Updated weights for policy 0, policy_version 1095032 (0.0009) [2023-12-28 03:07:39,056][106225] Updated weights for policy 1, policy_version 1097716 (0.0009) [2023-12-28 03:07:39,107][106225] Updated weights for policy 1, policy_version 1097726 (0.0008) [2023-12-28 03:07:39,157][106225] Updated weights for policy 1, policy_version 1097736 (0.0007) [2023-12-28 03:07:39,376][106226] Updated weights for policy 0, policy_version 1095042 (0.0008) [2023-12-28 03:07:39,437][106226] Updated weights for policy 0, policy_version 1095052 (0.0009) [2023-12-28 03:07:39,505][106226] Updated weights for policy 0, policy_version 1095062 (0.0010) [2023-12-28 03:07:39,918][106225] Updated weights for policy 1, policy_version 1097746 (0.0008) [2023-12-28 03:07:39,988][106225] Updated weights for policy 1, policy_version 1097756 (0.0008) [2023-12-28 03:07:40,050][106225] Updated weights for policy 1, policy_version 1097766 (0.0008) [2023-12-28 03:07:40,101][106225] Updated weights for policy 1, policy_version 1097776 (0.0007) [2023-12-28 03:07:40,285][106226] Updated weights for policy 0, policy_version 1095072 (0.0010) [2023-12-28 03:07:40,347][106226] Updated weights for policy 0, policy_version 1095082 (0.0011) [2023-12-28 03:07:40,412][106226] Updated weights for policy 0, policy_version 1095092 (0.0011) [2023-12-28 03:07:40,840][106225] Updated weights for policy 1, policy_version 1097786 (0.0010) [2023-12-28 03:07:40,904][106225] Updated weights for policy 1, policy_version 1097796 (0.0011) [2023-12-28 03:07:40,965][106225] Updated weights for policy 1, policy_version 1097806 (0.0010) [2023-12-28 03:07:41,115][106226] Updated weights for policy 0, policy_version 1095102 (0.0009) [2023-12-28 03:07:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561487872. Throughput: 0: 10090.9, 1: 10034.5. Samples: 561461708. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:41,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.895')] [2023-12-28 03:07:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001097808_281083904.pth... [2023-12-28 03:07:41,185][106226] Updated weights for policy 0, policy_version 1095112 (0.0007) [2023-12-28 03:07:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001096656_280788992.pth [2023-12-28 03:07:41,254][106226] Updated weights for policy 0, policy_version 1095122 (0.0009) [2023-12-28 03:07:41,291][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001095128_280412160.pth... [2023-12-28 03:07:41,295][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001093944_280109056.pth [2023-12-28 03:07:41,790][106225] Updated weights for policy 1, policy_version 1097816 (0.0008) [2023-12-28 03:07:41,856][106225] Updated weights for policy 1, policy_version 1097826 (0.0007) [2023-12-28 03:07:41,922][106225] Updated weights for policy 1, policy_version 1097836 (0.0009) [2023-12-28 03:07:42,080][106226] Updated weights for policy 0, policy_version 1095132 (0.0008) [2023-12-28 03:07:42,141][106226] Updated weights for policy 0, policy_version 1095142 (0.0008) [2023-12-28 03:07:42,205][106226] Updated weights for policy 0, policy_version 1095152 (0.0007) [2023-12-28 03:07:42,667][106225] Updated weights for policy 1, policy_version 1097846 (0.0010) [2023-12-28 03:07:42,728][106225] Updated weights for policy 1, policy_version 1097856 (0.0010) [2023-12-28 03:07:42,787][106225] Updated weights for policy 1, policy_version 1097866 (0.0010) [2023-12-28 03:07:42,900][106226] Updated weights for policy 0, policy_version 1095162 (0.0007) [2023-12-28 03:07:42,966][106226] Updated weights for policy 0, policy_version 1095172 (0.0008) [2023-12-28 03:07:43,027][106226] Updated weights for policy 0, policy_version 1095182 (0.0009) [2023-12-28 03:07:43,089][106226] Updated weights for policy 0, policy_version 1095192 (0.0010) [2023-12-28 03:07:43,384][106225] Updated weights for policy 1, policy_version 1097876 (0.0011) [2023-12-28 03:07:43,448][106225] Updated weights for policy 1, policy_version 1097886 (0.0010) [2023-12-28 03:07:43,502][106225] Updated weights for policy 1, policy_version 1097896 (0.0010) [2023-12-28 03:07:43,872][106226] Updated weights for policy 0, policy_version 1095202 (0.0005) [2023-12-28 03:07:43,925][106226] Updated weights for policy 0, policy_version 1095212 (0.0005) [2023-12-28 03:07:43,993][106226] Updated weights for policy 0, policy_version 1095222 (0.0006) [2023-12-28 03:07:44,129][106225] Updated weights for policy 1, policy_version 1097906 (0.0008) [2023-12-28 03:07:44,175][106225] Updated weights for policy 1, policy_version 1097916 (0.0010) [2023-12-28 03:07:44,224][106225] Updated weights for policy 1, policy_version 1097926 (0.0010) [2023-12-28 03:07:44,282][106225] Updated weights for policy 1, policy_version 1097936 (0.0010) [2023-12-28 03:07:44,611][106226] Updated weights for policy 0, policy_version 1095232 (0.0008) [2023-12-28 03:07:44,672][106226] Updated weights for policy 0, policy_version 1095242 (0.0008) [2023-12-28 03:07:44,728][106226] Updated weights for policy 0, policy_version 1095252 (0.0008) [2023-12-28 03:07:45,034][106225] Updated weights for policy 1, policy_version 1097946 (0.0008) [2023-12-28 03:07:45,096][106225] Updated weights for policy 1, policy_version 1097956 (0.0006) [2023-12-28 03:07:45,157][106225] Updated weights for policy 1, policy_version 1097966 (0.0006) [2023-12-28 03:07:45,504][106226] Updated weights for policy 0, policy_version 1095262 (0.0009) [2023-12-28 03:07:45,571][106226] Updated weights for policy 0, policy_version 1095272 (0.0008) [2023-12-28 03:07:45,637][106226] Updated weights for policy 0, policy_version 1095282 (0.0005) [2023-12-28 03:07:45,720][106225] Updated weights for policy 1, policy_version 1097976 (0.0006) [2023-12-28 03:07:45,771][106225] Updated weights for policy 1, policy_version 1097986 (0.0005) [2023-12-28 03:07:45,827][106225] Updated weights for policy 1, policy_version 1097996 (0.0005) [2023-12-28 03:07:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 561586176. Throughput: 0: 9981.7, 1: 9958.9. Samples: 561576708. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:46,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.952')] [2023-12-28 03:07:46,322][106226] Updated weights for policy 0, policy_version 1095292 (0.0007) [2023-12-28 03:07:46,380][106226] Updated weights for policy 0, policy_version 1095302 (0.0008) [2023-12-28 03:07:46,419][106225] Updated weights for policy 1, policy_version 1098006 (0.0006) [2023-12-28 03:07:46,442][106226] Updated weights for policy 0, policy_version 1095312 (0.0008) [2023-12-28 03:07:46,472][106225] Updated weights for policy 1, policy_version 1098016 (0.0006) [2023-12-28 03:07:46,522][106225] Updated weights for policy 1, policy_version 1098026 (0.0007) [2023-12-28 03:07:47,149][106226] Updated weights for policy 0, policy_version 1095322 (0.0009) [2023-12-28 03:07:47,187][106225] Updated weights for policy 1, policy_version 1098036 (0.0006) [2023-12-28 03:07:47,209][106226] Updated weights for policy 0, policy_version 1095332 (0.0007) [2023-12-28 03:07:47,233][106225] Updated weights for policy 1, policy_version 1098046 (0.0007) [2023-12-28 03:07:47,271][106226] Updated weights for policy 0, policy_version 1095342 (0.0008) [2023-12-28 03:07:47,278][106225] Updated weights for policy 1, policy_version 1098056 (0.0005) [2023-12-28 03:07:47,325][106226] Updated weights for policy 0, policy_version 1095352 (0.0008) [2023-12-28 03:07:47,938][106225] Updated weights for policy 1, policy_version 1098066 (0.0007) [2023-12-28 03:07:48,004][106225] Updated weights for policy 1, policy_version 1098076 (0.0010) [2023-12-28 03:07:48,063][106225] Updated weights for policy 1, policy_version 1098086 (0.0010) [2023-12-28 03:07:48,111][106226] Updated weights for policy 0, policy_version 1095362 (0.0008) [2023-12-28 03:07:48,123][106225] Updated weights for policy 1, policy_version 1098096 (0.0008) [2023-12-28 03:07:48,174][106226] Updated weights for policy 0, policy_version 1095372 (0.0008) [2023-12-28 03:07:48,233][106226] Updated weights for policy 0, policy_version 1095382 (0.0008) [2023-12-28 03:07:48,794][106225] Updated weights for policy 1, policy_version 1098106 (0.0010) [2023-12-28 03:07:48,851][106225] Updated weights for policy 1, policy_version 1098116 (0.0010) [2023-12-28 03:07:48,916][106225] Updated weights for policy 1, policy_version 1098126 (0.0010) [2023-12-28 03:07:48,972][106226] Updated weights for policy 0, policy_version 1095392 (0.0008) [2023-12-28 03:07:49,026][106226] Updated weights for policy 0, policy_version 1095402 (0.0008) [2023-12-28 03:07:49,075][106226] Updated weights for policy 0, policy_version 1095412 (0.0009) [2023-12-28 03:07:49,613][106225] Updated weights for policy 1, policy_version 1098136 (0.0010) [2023-12-28 03:07:49,670][106225] Updated weights for policy 1, policy_version 1098146 (0.0010) [2023-12-28 03:07:49,730][106225] Updated weights for policy 1, policy_version 1098156 (0.0010) [2023-12-28 03:07:49,823][106226] Updated weights for policy 0, policy_version 1095422 (0.0008) [2023-12-28 03:07:49,888][106226] Updated weights for policy 0, policy_version 1095432 (0.0006) [2023-12-28 03:07:49,958][106226] Updated weights for policy 0, policy_version 1095442 (0.0006) [2023-12-28 03:07:50,496][106225] Updated weights for policy 1, policy_version 1098166 (0.0010) [2023-12-28 03:07:50,555][106225] Updated weights for policy 1, policy_version 1098176 (0.0010) [2023-12-28 03:07:50,625][106225] Updated weights for policy 1, policy_version 1098186 (0.0010) [2023-12-28 03:07:50,653][106226] Updated weights for policy 0, policy_version 1095452 (0.0007) [2023-12-28 03:07:50,716][106226] Updated weights for policy 0, policy_version 1095462 (0.0008) [2023-12-28 03:07:50,779][106226] Updated weights for policy 0, policy_version 1095472 (0.0008) [2023-12-28 03:07:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561684480. Throughput: 0: 9902.8, 1: 9971.6. Samples: 561694776. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:51,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.529')] [2023-12-28 03:07:51,365][106225] Updated weights for policy 1, policy_version 1098196 (0.0010) [2023-12-28 03:07:51,432][106225] Updated weights for policy 1, policy_version 1098206 (0.0009) [2023-12-28 03:07:51,494][106225] Updated weights for policy 1, policy_version 1098216 (0.0008) [2023-12-28 03:07:51,555][106226] Updated weights for policy 0, policy_version 1095482 (0.0007) [2023-12-28 03:07:51,612][106226] Updated weights for policy 0, policy_version 1095492 (0.0006) [2023-12-28 03:07:51,674][106226] Updated weights for policy 0, policy_version 1095502 (0.0007) [2023-12-28 03:07:51,745][106226] Updated weights for policy 0, policy_version 1095512 (0.0007) [2023-12-28 03:07:52,170][106225] Updated weights for policy 1, policy_version 1098226 (0.0008) [2023-12-28 03:07:52,231][106225] Updated weights for policy 1, policy_version 1098236 (0.0008) [2023-12-28 03:07:52,296][106225] Updated weights for policy 1, policy_version 1098246 (0.0007) [2023-12-28 03:07:52,353][106225] Updated weights for policy 1, policy_version 1098256 (0.0006) [2023-12-28 03:07:52,390][106226] Updated weights for policy 0, policy_version 1095522 (0.0009) [2023-12-28 03:07:52,456][106226] Updated weights for policy 0, policy_version 1095532 (0.0009) [2023-12-28 03:07:52,513][106226] Updated weights for policy 0, policy_version 1095542 (0.0009) [2023-12-28 03:07:53,075][106225] Updated weights for policy 1, policy_version 1098266 (0.0008) [2023-12-28 03:07:53,134][106225] Updated weights for policy 1, policy_version 1098276 (0.0008) [2023-12-28 03:07:53,197][106225] Updated weights for policy 1, policy_version 1098286 (0.0009) [2023-12-28 03:07:53,219][106226] Updated weights for policy 0, policy_version 1095552 (0.0008) [2023-12-28 03:07:53,280][106226] Updated weights for policy 0, policy_version 1095562 (0.0009) [2023-12-28 03:07:53,330][106226] Updated weights for policy 0, policy_version 1095572 (0.0008) [2023-12-28 03:07:53,881][106225] Updated weights for policy 1, policy_version 1098296 (0.0006) [2023-12-28 03:07:53,944][106225] Updated weights for policy 1, policy_version 1098306 (0.0009) [2023-12-28 03:07:53,996][106225] Updated weights for policy 1, policy_version 1098316 (0.0008) [2023-12-28 03:07:54,066][106226] Updated weights for policy 0, policy_version 1095582 (0.0007) [2023-12-28 03:07:54,124][106226] Updated weights for policy 0, policy_version 1095592 (0.0006) [2023-12-28 03:07:54,172][106226] Updated weights for policy 0, policy_version 1095602 (0.0005) [2023-12-28 03:07:54,767][106225] Updated weights for policy 1, policy_version 1098326 (0.0009) [2023-12-28 03:07:54,783][106226] Updated weights for policy 0, policy_version 1095612 (0.0006) [2023-12-28 03:07:54,830][106225] Updated weights for policy 1, policy_version 1098336 (0.0009) [2023-12-28 03:07:54,839][106226] Updated weights for policy 0, policy_version 1095622 (0.0006) [2023-12-28 03:07:54,884][106225] Updated weights for policy 1, policy_version 1098346 (0.0007) [2023-12-28 03:07:54,896][106226] Updated weights for policy 0, policy_version 1095632 (0.0006) [2023-12-28 03:07:55,496][106226] Updated weights for policy 0, policy_version 1095642 (0.0007) [2023-12-28 03:07:55,550][106226] Updated weights for policy 0, policy_version 1095652 (0.0010) [2023-12-28 03:07:55,614][106225] Updated weights for policy 1, policy_version 1098356 (0.0008) [2023-12-28 03:07:55,615][106226] Updated weights for policy 0, policy_version 1095662 (0.0008) [2023-12-28 03:07:55,671][106226] Updated weights for policy 0, policy_version 1095672 (0.0010) [2023-12-28 03:07:55,672][106225] Updated weights for policy 1, policy_version 1098366 (0.0008) [2023-12-28 03:07:55,722][106225] Updated weights for policy 1, policy_version 1098376 (0.0008) [2023-12-28 03:07:56,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561782784. Throughput: 0: 9905.3, 1: 9946.6. Samples: 561753216. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:07:56,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.889')] [2023-12-28 03:07:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001098384_281231360.pth... [2023-12-28 03:07:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001097232_280936448.pth [2023-12-28 03:07:56,245][106226] Updated weights for policy 0, policy_version 1095682 (0.0005) [2023-12-28 03:07:56,303][106226] Updated weights for policy 0, policy_version 1095692 (0.0005) [2023-12-28 03:07:56,370][106226] Updated weights for policy 0, policy_version 1095702 (0.0005) [2023-12-28 03:07:56,381][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001095704_280559616.pth... [2023-12-28 03:07:56,386][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001094520_280256512.pth [2023-12-28 03:07:56,555][106225] Updated weights for policy 1, policy_version 1098386 (0.0009) [2023-12-28 03:07:56,616][106225] Updated weights for policy 1, policy_version 1098396 (0.0011) [2023-12-28 03:07:56,674][106225] Updated weights for policy 1, policy_version 1098406 (0.0010) [2023-12-28 03:07:56,734][106225] Updated weights for policy 1, policy_version 1098416 (0.0008) [2023-12-28 03:07:56,989][106226] Updated weights for policy 0, policy_version 1095712 (0.0009) [2023-12-28 03:07:57,054][106226] Updated weights for policy 0, policy_version 1095722 (0.0010) [2023-12-28 03:07:57,113][106226] Updated weights for policy 0, policy_version 1095732 (0.0010) [2023-12-28 03:07:57,404][106225] Updated weights for policy 1, policy_version 1098426 (0.0010) [2023-12-28 03:07:57,455][106225] Updated weights for policy 1, policy_version 1098436 (0.0006) [2023-12-28 03:07:57,511][106225] Updated weights for policy 1, policy_version 1098446 (0.0005) [2023-12-28 03:07:57,803][106226] Updated weights for policy 0, policy_version 1095742 (0.0010) [2023-12-28 03:07:57,853][106226] Updated weights for policy 0, policy_version 1095752 (0.0007) [2023-12-28 03:07:57,907][106226] Updated weights for policy 0, policy_version 1095762 (0.0005) [2023-12-28 03:07:58,144][106225] Updated weights for policy 1, policy_version 1098456 (0.0009) [2023-12-28 03:07:58,200][106225] Updated weights for policy 1, policy_version 1098466 (0.0010) [2023-12-28 03:07:58,268][106225] Updated weights for policy 1, policy_version 1098476 (0.0008) [2023-12-28 03:07:58,655][106226] Updated weights for policy 0, policy_version 1095772 (0.0010) [2023-12-28 03:07:58,715][106226] Updated weights for policy 0, policy_version 1095782 (0.0011) [2023-12-28 03:07:58,780][106226] Updated weights for policy 0, policy_version 1095792 (0.0008) [2023-12-28 03:07:59,085][106225] Updated weights for policy 1, policy_version 1098486 (0.0007) [2023-12-28 03:07:59,147][106225] Updated weights for policy 1, policy_version 1098496 (0.0008) [2023-12-28 03:07:59,205][106225] Updated weights for policy 1, policy_version 1098506 (0.0008) [2023-12-28 03:07:59,516][106226] Updated weights for policy 0, policy_version 1095802 (0.0008) [2023-12-28 03:07:59,580][106226] Updated weights for policy 0, policy_version 1095812 (0.0007) [2023-12-28 03:07:59,638][106226] Updated weights for policy 0, policy_version 1095822 (0.0007) [2023-12-28 03:07:59,697][106226] Updated weights for policy 0, policy_version 1095832 (0.0008) [2023-12-28 03:07:59,989][106225] Updated weights for policy 1, policy_version 1098516 (0.0008) [2023-12-28 03:08:00,051][106225] Updated weights for policy 1, policy_version 1098526 (0.0007) [2023-12-28 03:08:00,102][106225] Updated weights for policy 1, policy_version 1098536 (0.0006) [2023-12-28 03:08:00,507][106226] Updated weights for policy 0, policy_version 1095842 (0.0005) [2023-12-28 03:08:00,562][106226] Updated weights for policy 0, policy_version 1095852 (0.0005) [2023-12-28 03:08:00,613][106226] Updated weights for policy 0, policy_version 1095862 (0.0005) [2023-12-28 03:08:00,797][106225] Updated weights for policy 1, policy_version 1098546 (0.0006) [2023-12-28 03:08:00,849][106225] Updated weights for policy 1, policy_version 1098556 (0.0008) [2023-12-28 03:08:00,894][106225] Updated weights for policy 1, policy_version 1098566 (0.0008) [2023-12-28 03:08:00,945][106225] Updated weights for policy 1, policy_version 1098576 (0.0008) [2023-12-28 03:08:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561881088. Throughput: 0: 10021.2, 1: 9918.4. Samples: 561871612. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:01,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.579')] [2023-12-28 03:08:01,285][106226] Updated weights for policy 0, policy_version 1095872 (0.0009) [2023-12-28 03:08:01,344][106226] Updated weights for policy 0, policy_version 1095882 (0.0009) [2023-12-28 03:08:01,415][106226] Updated weights for policy 0, policy_version 1095892 (0.0008) [2023-12-28 03:08:01,767][106225] Updated weights for policy 1, policy_version 1098586 (0.0009) [2023-12-28 03:08:01,821][106225] Updated weights for policy 1, policy_version 1098596 (0.0009) [2023-12-28 03:08:01,870][106225] Updated weights for policy 1, policy_version 1098606 (0.0008) [2023-12-28 03:08:02,156][106226] Updated weights for policy 0, policy_version 1095902 (0.0008) [2023-12-28 03:08:02,221][106226] Updated weights for policy 0, policy_version 1095912 (0.0009) [2023-12-28 03:08:02,283][106226] Updated weights for policy 0, policy_version 1095922 (0.0008) [2023-12-28 03:08:02,593][106225] Updated weights for policy 1, policy_version 1098616 (0.0009) [2023-12-28 03:08:02,644][106225] Updated weights for policy 1, policy_version 1098626 (0.0008) [2023-12-28 03:08:02,702][106225] Updated weights for policy 1, policy_version 1098636 (0.0008) [2023-12-28 03:08:02,979][106226] Updated weights for policy 0, policy_version 1095932 (0.0007) [2023-12-28 03:08:03,032][106226] Updated weights for policy 0, policy_version 1095942 (0.0005) [2023-12-28 03:08:03,078][106226] Updated weights for policy 0, policy_version 1095952 (0.0005) [2023-12-28 03:08:03,482][106225] Updated weights for policy 1, policy_version 1098646 (0.0008) [2023-12-28 03:08:03,532][106225] Updated weights for policy 1, policy_version 1098656 (0.0007) [2023-12-28 03:08:03,586][106225] Updated weights for policy 1, policy_version 1098666 (0.0008) [2023-12-28 03:08:03,775][106226] Updated weights for policy 0, policy_version 1095962 (0.0009) [2023-12-28 03:08:03,830][106226] Updated weights for policy 0, policy_version 1095972 (0.0008) [2023-12-28 03:08:03,909][106226] Updated weights for policy 0, policy_version 1095982 (0.0009) [2023-12-28 03:08:03,970][106226] Updated weights for policy 0, policy_version 1095992 (0.0009) [2023-12-28 03:08:04,320][106225] Updated weights for policy 1, policy_version 1098676 (0.0008) [2023-12-28 03:08:04,380][106225] Updated weights for policy 1, policy_version 1098686 (0.0007) [2023-12-28 03:08:04,434][106225] Updated weights for policy 1, policy_version 1098696 (0.0010) [2023-12-28 03:08:04,670][106226] Updated weights for policy 0, policy_version 1096002 (0.0005) [2023-12-28 03:08:04,719][106226] Updated weights for policy 0, policy_version 1096012 (0.0008) [2023-12-28 03:08:04,769][106226] Updated weights for policy 0, policy_version 1096022 (0.0007) [2023-12-28 03:08:05,108][106225] Updated weights for policy 1, policy_version 1098706 (0.0007) [2023-12-28 03:08:05,168][106225] Updated weights for policy 1, policy_version 1098716 (0.0010) [2023-12-28 03:08:05,221][106225] Updated weights for policy 1, policy_version 1098726 (0.0010) [2023-12-28 03:08:05,271][106225] Updated weights for policy 1, policy_version 1098736 (0.0010) [2023-12-28 03:08:05,511][106226] Updated weights for policy 0, policy_version 1096032 (0.0007) [2023-12-28 03:08:05,573][106226] Updated weights for policy 0, policy_version 1096042 (0.0008) [2023-12-28 03:08:05,635][106226] Updated weights for policy 0, policy_version 1096052 (0.0007) [2023-12-28 03:08:05,976][106225] Updated weights for policy 1, policy_version 1098746 (0.0008) [2023-12-28 03:08:06,043][106225] Updated weights for policy 1, policy_version 1098756 (0.0006) [2023-12-28 03:08:06,114][106225] Updated weights for policy 1, policy_version 1098766 (0.0007) [2023-12-28 03:08:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 561979392. Throughput: 0: 9967.3, 1: 9912.4. Samples: 561988536. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:06,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.925')] [2023-12-28 03:08:06,308][106226] Updated weights for policy 0, policy_version 1096062 (0.0006) [2023-12-28 03:08:06,376][106226] Updated weights for policy 0, policy_version 1096072 (0.0009) [2023-12-28 03:08:06,438][106226] Updated weights for policy 0, policy_version 1096082 (0.0009) [2023-12-28 03:08:06,692][106225] Updated weights for policy 1, policy_version 1098776 (0.0007) [2023-12-28 03:08:06,763][106225] Updated weights for policy 1, policy_version 1098786 (0.0010) [2023-12-28 03:08:06,828][106225] Updated weights for policy 1, policy_version 1098796 (0.0008) [2023-12-28 03:08:07,102][106226] Updated weights for policy 0, policy_version 1096092 (0.0008) [2023-12-28 03:08:07,158][106226] Updated weights for policy 0, policy_version 1096102 (0.0006) [2023-12-28 03:08:07,226][106226] Updated weights for policy 0, policy_version 1096112 (0.0011) [2023-12-28 03:08:07,492][106225] Updated weights for policy 1, policy_version 1098806 (0.0008) [2023-12-28 03:08:07,562][106225] Updated weights for policy 1, policy_version 1098816 (0.0010) [2023-12-28 03:08:07,630][106225] Updated weights for policy 1, policy_version 1098826 (0.0009) [2023-12-28 03:08:07,905][106226] Updated weights for policy 0, policy_version 1096122 (0.0010) [2023-12-28 03:08:07,948][106226] Updated weights for policy 0, policy_version 1096132 (0.0007) [2023-12-28 03:08:07,993][106226] Updated weights for policy 0, policy_version 1096142 (0.0005) [2023-12-28 03:08:08,048][106226] Updated weights for policy 0, policy_version 1096152 (0.0008) [2023-12-28 03:08:08,328][106225] Updated weights for policy 1, policy_version 1098836 (0.0009) [2023-12-28 03:08:08,394][106225] Updated weights for policy 1, policy_version 1098846 (0.0007) [2023-12-28 03:08:08,449][106225] Updated weights for policy 1, policy_version 1098856 (0.0010) [2023-12-28 03:08:08,780][106226] Updated weights for policy 0, policy_version 1096162 (0.0005) [2023-12-28 03:08:08,831][106226] Updated weights for policy 0, policy_version 1096172 (0.0008) [2023-12-28 03:08:08,893][106226] Updated weights for policy 0, policy_version 1096182 (0.0005) [2023-12-28 03:08:09,151][106225] Updated weights for policy 1, policy_version 1098866 (0.0010) [2023-12-28 03:08:09,207][106225] Updated weights for policy 1, policy_version 1098876 (0.0008) [2023-12-28 03:08:09,276][106225] Updated weights for policy 1, policy_version 1098886 (0.0008) [2023-12-28 03:08:09,336][106225] Updated weights for policy 1, policy_version 1098896 (0.0008) [2023-12-28 03:08:09,578][106226] Updated weights for policy 0, policy_version 1096192 (0.0008) [2023-12-28 03:08:09,644][106226] Updated weights for policy 0, policy_version 1096202 (0.0008) [2023-12-28 03:08:09,709][106226] Updated weights for policy 0, policy_version 1096212 (0.0008) [2023-12-28 03:08:10,157][106225] Updated weights for policy 1, policy_version 1098906 (0.0011) [2023-12-28 03:08:10,218][106225] Updated weights for policy 1, policy_version 1098916 (0.0011) [2023-12-28 03:08:10,280][106225] Updated weights for policy 1, policy_version 1098926 (0.0011) [2023-12-28 03:08:10,443][106226] Updated weights for policy 0, policy_version 1096222 (0.0009) [2023-12-28 03:08:10,497][106226] Updated weights for policy 0, policy_version 1096232 (0.0007) [2023-12-28 03:08:10,553][106226] Updated weights for policy 0, policy_version 1096242 (0.0008) [2023-12-28 03:08:11,048][106225] Updated weights for policy 1, policy_version 1098936 (0.0009) [2023-12-28 03:08:11,129][106225] Updated weights for policy 1, policy_version 1098946 (0.0009) [2023-12-28 03:08:11,170][106226] Updated weights for policy 0, policy_version 1096252 (0.0007) [2023-12-28 03:08:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 562069504. Throughput: 0: 9995.1, 1: 9944.5. Samples: 562049160. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:11,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.690')] [2023-12-28 03:08:11,197][106225] Updated weights for policy 1, policy_version 1098956 (0.0006) [2023-12-28 03:08:11,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001098960_281378816.pth... [2023-12-28 03:08:11,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001097808_281083904.pth [2023-12-28 03:08:11,239][106226] Updated weights for policy 0, policy_version 1096262 (0.0007) [2023-12-28 03:08:11,302][106226] Updated weights for policy 0, policy_version 1096272 (0.0008) [2023-12-28 03:08:11,362][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001096280_280707072.pth... [2023-12-28 03:08:11,366][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001095128_280412160.pth [2023-12-28 03:08:11,978][106225] Updated weights for policy 1, policy_version 1098966 (0.0008) [2023-12-28 03:08:12,042][106225] Updated weights for policy 1, policy_version 1098976 (0.0009) [2023-12-28 03:08:12,057][106226] Updated weights for policy 0, policy_version 1096282 (0.0009) [2023-12-28 03:08:12,100][106225] Updated weights for policy 1, policy_version 1098986 (0.0007) [2023-12-28 03:08:12,111][106226] Updated weights for policy 0, policy_version 1096292 (0.0009) [2023-12-28 03:08:12,161][106226] Updated weights for policy 0, policy_version 1096302 (0.0007) [2023-12-28 03:08:12,222][106226] Updated weights for policy 0, policy_version 1096312 (0.0009) [2023-12-28 03:08:12,863][106225] Updated weights for policy 1, policy_version 1098996 (0.0008) [2023-12-28 03:08:12,925][106225] Updated weights for policy 1, policy_version 1099006 (0.0008) [2023-12-28 03:08:12,956][106226] Updated weights for policy 0, policy_version 1096322 (0.0006) [2023-12-28 03:08:12,981][106225] Updated weights for policy 1, policy_version 1099016 (0.0007) [2023-12-28 03:08:13,008][106226] Updated weights for policy 0, policy_version 1096332 (0.0006) [2023-12-28 03:08:13,066][106226] Updated weights for policy 0, policy_version 1096342 (0.0008) [2023-12-28 03:08:13,681][106225] Updated weights for policy 1, policy_version 1099026 (0.0008) [2023-12-28 03:08:13,736][106225] Updated weights for policy 1, policy_version 1099036 (0.0008) [2023-12-28 03:08:13,783][106225] Updated weights for policy 1, policy_version 1099046 (0.0008) [2023-12-28 03:08:13,811][106226] Updated weights for policy 0, policy_version 1096352 (0.0007) [2023-12-28 03:08:13,834][106225] Updated weights for policy 1, policy_version 1099056 (0.0005) [2023-12-28 03:08:13,864][106226] Updated weights for policy 0, policy_version 1096362 (0.0006) [2023-12-28 03:08:13,917][106226] Updated weights for policy 0, policy_version 1096372 (0.0005) [2023-12-28 03:08:14,474][106225] Updated weights for policy 1, policy_version 1099066 (0.0008) [2023-12-28 03:08:14,528][106225] Updated weights for policy 1, policy_version 1099076 (0.0007) [2023-12-28 03:08:14,583][106225] Updated weights for policy 1, policy_version 1099086 (0.0005) [2023-12-28 03:08:14,622][106226] Updated weights for policy 0, policy_version 1096382 (0.0008) [2023-12-28 03:08:14,676][106226] Updated weights for policy 0, policy_version 1096392 (0.0008) [2023-12-28 03:08:14,725][106226] Updated weights for policy 0, policy_version 1096402 (0.0009) [2023-12-28 03:08:15,232][106225] Updated weights for policy 1, policy_version 1099096 (0.0006) [2023-12-28 03:08:15,294][106225] Updated weights for policy 1, policy_version 1099106 (0.0009) [2023-12-28 03:08:15,354][106225] Updated weights for policy 1, policy_version 1099116 (0.0009) [2023-12-28 03:08:15,503][106226] Updated weights for policy 0, policy_version 1096412 (0.0007) [2023-12-28 03:08:15,573][106226] Updated weights for policy 0, policy_version 1096422 (0.0009) [2023-12-28 03:08:15,646][106226] Updated weights for policy 0, policy_version 1096432 (0.0008) [2023-12-28 03:08:15,962][106225] Updated weights for policy 1, policy_version 1099126 (0.0008) [2023-12-28 03:08:16,010][106225] Updated weights for policy 1, policy_version 1099136 (0.0008) [2023-12-28 03:08:16,058][106225] Updated weights for policy 1, policy_version 1099146 (0.0006) [2023-12-28 03:08:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 562176000. Throughput: 0: 9898.5, 1: 9810.0. Samples: 562163808. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:16,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.099')] [2023-12-28 03:08:16,424][106226] Updated weights for policy 0, policy_version 1096442 (0.0008) [2023-12-28 03:08:16,484][106226] Updated weights for policy 0, policy_version 1096452 (0.0009) [2023-12-28 03:08:16,544][106226] Updated weights for policy 0, policy_version 1096462 (0.0008) [2023-12-28 03:08:16,597][106226] Updated weights for policy 0, policy_version 1096472 (0.0009) [2023-12-28 03:08:16,704][106225] Updated weights for policy 1, policy_version 1099156 (0.0006) [2023-12-28 03:08:16,763][106225] Updated weights for policy 1, policy_version 1099166 (0.0009) [2023-12-28 03:08:16,823][106225] Updated weights for policy 1, policy_version 1099176 (0.0008) [2023-12-28 03:08:17,335][106226] Updated weights for policy 0, policy_version 1096482 (0.0007) [2023-12-28 03:08:17,384][106226] Updated weights for policy 0, policy_version 1096492 (0.0009) [2023-12-28 03:08:17,440][106226] Updated weights for policy 0, policy_version 1096502 (0.0009) [2023-12-28 03:08:17,550][106225] Updated weights for policy 1, policy_version 1099186 (0.0008) [2023-12-28 03:08:17,606][106225] Updated weights for policy 1, policy_version 1099196 (0.0008) [2023-12-28 03:08:17,658][106225] Updated weights for policy 1, policy_version 1099206 (0.0008) [2023-12-28 03:08:17,712][106225] Updated weights for policy 1, policy_version 1099216 (0.0008) [2023-12-28 03:08:18,166][106226] Updated weights for policy 0, policy_version 1096512 (0.0008) [2023-12-28 03:08:18,220][106226] Updated weights for policy 0, policy_version 1096522 (0.0008) [2023-12-28 03:08:18,291][106226] Updated weights for policy 0, policy_version 1096532 (0.0008) [2023-12-28 03:08:18,461][106225] Updated weights for policy 1, policy_version 1099226 (0.0008) [2023-12-28 03:08:18,525][106225] Updated weights for policy 1, policy_version 1099236 (0.0008) [2023-12-28 03:08:18,588][106225] Updated weights for policy 1, policy_version 1099246 (0.0008) [2023-12-28 03:08:19,090][106226] Updated weights for policy 0, policy_version 1096542 (0.0009) [2023-12-28 03:08:19,151][106226] Updated weights for policy 0, policy_version 1096552 (0.0009) [2023-12-28 03:08:19,208][106226] Updated weights for policy 0, policy_version 1096562 (0.0010) [2023-12-28 03:08:19,307][106225] Updated weights for policy 1, policy_version 1099256 (0.0008) [2023-12-28 03:08:19,368][106225] Updated weights for policy 1, policy_version 1099266 (0.0008) [2023-12-28 03:08:19,426][106225] Updated weights for policy 1, policy_version 1099276 (0.0008) [2023-12-28 03:08:19,951][106226] Updated weights for policy 0, policy_version 1096572 (0.0011) [2023-12-28 03:08:20,010][106226] Updated weights for policy 0, policy_version 1096582 (0.0009) [2023-12-28 03:08:20,068][106226] Updated weights for policy 0, policy_version 1096592 (0.0009) [2023-12-28 03:08:20,192][106225] Updated weights for policy 1, policy_version 1099286 (0.0009) [2023-12-28 03:08:20,252][106225] Updated weights for policy 1, policy_version 1099296 (0.0008) [2023-12-28 03:08:20,301][106225] Updated weights for policy 1, policy_version 1099306 (0.0008) [2023-12-28 03:08:20,749][106226] Updated weights for policy 0, policy_version 1096602 (0.0007) [2023-12-28 03:08:20,810][106226] Updated weights for policy 0, policy_version 1096612 (0.0005) [2023-12-28 03:08:20,871][106226] Updated weights for policy 0, policy_version 1096622 (0.0006) [2023-12-28 03:08:20,930][106226] Updated weights for policy 0, policy_version 1096632 (0.0007) [2023-12-28 03:08:21,109][106225] Updated weights for policy 1, policy_version 1099316 (0.0008) [2023-12-28 03:08:21,174][106225] Updated weights for policy 1, policy_version 1099326 (0.0009) [2023-12-28 03:08:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 562266112. Throughput: 0: 9798.0, 1: 9729.0. Samples: 562278932. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:21,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.929')] [2023-12-28 03:08:21,236][106225] Updated weights for policy 1, policy_version 1099336 (0.0009) [2023-12-28 03:08:21,683][106226] Updated weights for policy 0, policy_version 1096642 (0.0009) [2023-12-28 03:08:21,757][106226] Updated weights for policy 0, policy_version 1096652 (0.0008) [2023-12-28 03:08:21,819][106226] Updated weights for policy 0, policy_version 1096662 (0.0008) [2023-12-28 03:08:22,035][106225] Updated weights for policy 1, policy_version 1099346 (0.0009) [2023-12-28 03:08:22,089][106225] Updated weights for policy 1, policy_version 1099356 (0.0009) [2023-12-28 03:08:22,145][106225] Updated weights for policy 1, policy_version 1099366 (0.0011) [2023-12-28 03:08:22,192][106225] Updated weights for policy 1, policy_version 1099376 (0.0010) [2023-12-28 03:08:22,573][106226] Updated weights for policy 0, policy_version 1096672 (0.0008) [2023-12-28 03:08:22,632][106226] Updated weights for policy 0, policy_version 1096682 (0.0005) [2023-12-28 03:08:22,697][106226] Updated weights for policy 0, policy_version 1096692 (0.0008) [2023-12-28 03:08:22,975][106225] Updated weights for policy 1, policy_version 1099386 (0.0008) [2023-12-28 03:08:23,031][106225] Updated weights for policy 1, policy_version 1099396 (0.0008) [2023-12-28 03:08:23,082][106225] Updated weights for policy 1, policy_version 1099406 (0.0008) [2023-12-28 03:08:23,392][106226] Updated weights for policy 0, policy_version 1096702 (0.0010) [2023-12-28 03:08:23,445][106226] Updated weights for policy 0, policy_version 1096712 (0.0010) [2023-12-28 03:08:23,497][106226] Updated weights for policy 0, policy_version 1096722 (0.0010) [2023-12-28 03:08:23,840][106225] Updated weights for policy 1, policy_version 1099416 (0.0008) [2023-12-28 03:08:23,888][106225] Updated weights for policy 1, policy_version 1099426 (0.0006) [2023-12-28 03:08:23,936][106225] Updated weights for policy 1, policy_version 1099436 (0.0005) [2023-12-28 03:08:24,154][106226] Updated weights for policy 0, policy_version 1096732 (0.0009) [2023-12-28 03:08:24,210][106226] Updated weights for policy 0, policy_version 1096742 (0.0006) [2023-12-28 03:08:24,271][106226] Updated weights for policy 0, policy_version 1096752 (0.0005) [2023-12-28 03:08:24,616][106225] Updated weights for policy 1, policy_version 1099446 (0.0006) [2023-12-28 03:08:24,685][106225] Updated weights for policy 1, policy_version 1099456 (0.0006) [2023-12-28 03:08:24,751][106225] Updated weights for policy 1, policy_version 1099466 (0.0010) [2023-12-28 03:08:24,825][106226] Updated weights for policy 0, policy_version 1096762 (0.0007) [2023-12-28 03:08:24,876][106226] Updated weights for policy 0, policy_version 1096772 (0.0011) [2023-12-28 03:08:24,929][106226] Updated weights for policy 0, policy_version 1096782 (0.0010) [2023-12-28 03:08:24,977][106226] Updated weights for policy 0, policy_version 1096792 (0.0011) [2023-12-28 03:08:25,355][106225] Updated weights for policy 1, policy_version 1099476 (0.0008) [2023-12-28 03:08:25,415][106225] Updated weights for policy 1, policy_version 1099486 (0.0005) [2023-12-28 03:08:25,480][106225] Updated weights for policy 1, policy_version 1099496 (0.0005) [2023-12-28 03:08:25,678][106226] Updated weights for policy 0, policy_version 1096802 (0.0007) [2023-12-28 03:08:25,726][106226] Updated weights for policy 0, policy_version 1096812 (0.0005) [2023-12-28 03:08:25,778][106226] Updated weights for policy 0, policy_version 1096822 (0.0005) [2023-12-28 03:08:26,130][106225] Updated weights for policy 1, policy_version 1099506 (0.0010) [2023-12-28 03:08:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 562364416. Throughput: 0: 9699.2, 1: 9707.8. Samples: 562335024. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:26,175][105115] Avg episode reward: [(0, '-5.182'), (1, '-4.703')] [2023-12-28 03:08:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001096824_280846336.pth... [2023-12-28 03:08:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001095704_280559616.pth [2023-12-28 03:08:26,187][106225] Updated weights for policy 1, policy_version 1099516 (0.0010) [2023-12-28 03:08:26,237][106225] Updated weights for policy 1, policy_version 1099526 (0.0010) [2023-12-28 03:08:26,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001099536_281526272.pth... [2023-12-28 03:08:26,295][106225] Updated weights for policy 1, policy_version 1099536 (0.0006) [2023-12-28 03:08:26,296][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001098384_281231360.pth [2023-12-28 03:08:26,444][106226] Updated weights for policy 0, policy_version 1096832 (0.0009) [2023-12-28 03:08:26,494][106226] Updated weights for policy 0, policy_version 1096842 (0.0010) [2023-12-28 03:08:26,540][106226] Updated weights for policy 0, policy_version 1096852 (0.0010) [2023-12-28 03:08:26,831][106225] Updated weights for policy 1, policy_version 1099546 (0.0005) [2023-12-28 03:08:26,883][106225] Updated weights for policy 1, policy_version 1099556 (0.0007) [2023-12-28 03:08:26,939][106225] Updated weights for policy 1, policy_version 1099566 (0.0006) [2023-12-28 03:08:27,265][106226] Updated weights for policy 0, policy_version 1096862 (0.0010) [2023-12-28 03:08:27,311][106226] Updated weights for policy 0, policy_version 1096872 (0.0010) [2023-12-28 03:08:27,372][106226] Updated weights for policy 0, policy_version 1096882 (0.0011) [2023-12-28 03:08:27,551][106225] Updated weights for policy 1, policy_version 1099576 (0.0006) [2023-12-28 03:08:27,604][106225] Updated weights for policy 1, policy_version 1099586 (0.0005) [2023-12-28 03:08:27,654][106225] Updated weights for policy 1, policy_version 1099596 (0.0005) [2023-12-28 03:08:28,047][106226] Updated weights for policy 0, policy_version 1096892 (0.0010) [2023-12-28 03:08:28,097][106226] Updated weights for policy 0, policy_version 1096902 (0.0010) [2023-12-28 03:08:28,158][106226] Updated weights for policy 0, policy_version 1096912 (0.0011) [2023-12-28 03:08:28,181][106225] Updated weights for policy 1, policy_version 1099606 (0.0007) [2023-12-28 03:08:28,243][106225] Updated weights for policy 1, policy_version 1099616 (0.0008) [2023-12-28 03:08:28,308][106225] Updated weights for policy 1, policy_version 1099626 (0.0007) [2023-12-28 03:08:28,815][106226] Updated weights for policy 0, policy_version 1096922 (0.0010) [2023-12-28 03:08:28,886][106226] Updated weights for policy 0, policy_version 1096932 (0.0005) [2023-12-28 03:08:28,953][106226] Updated weights for policy 0, policy_version 1096942 (0.0010) [2023-12-28 03:08:28,953][106225] Updated weights for policy 1, policy_version 1099636 (0.0009) [2023-12-28 03:08:29,009][106225] Updated weights for policy 1, policy_version 1099646 (0.0009) [2023-12-28 03:08:29,016][106226] Updated weights for policy 0, policy_version 1096952 (0.0008) [2023-12-28 03:08:29,068][106225] Updated weights for policy 1, policy_version 1099656 (0.0005) [2023-12-28 03:08:29,626][106226] Updated weights for policy 0, policy_version 1096962 (0.0010) [2023-12-28 03:08:29,683][106226] Updated weights for policy 0, policy_version 1096972 (0.0011) [2023-12-28 03:08:29,707][106225] Updated weights for policy 1, policy_version 1099666 (0.0006) [2023-12-28 03:08:29,747][106226] Updated weights for policy 0, policy_version 1096982 (0.0011) [2023-12-28 03:08:29,771][106225] Updated weights for policy 1, policy_version 1099676 (0.0011) [2023-12-28 03:08:29,822][106225] Updated weights for policy 1, policy_version 1099686 (0.0010) [2023-12-28 03:08:29,884][106225] Updated weights for policy 1, policy_version 1099696 (0.0010) [2023-12-28 03:08:30,586][106226] Updated weights for policy 0, policy_version 1096992 (0.0006) [2023-12-28 03:08:30,648][106226] Updated weights for policy 0, policy_version 1097002 (0.0006) [2023-12-28 03:08:30,653][106225] Updated weights for policy 1, policy_version 1099706 (0.0005) [2023-12-28 03:08:30,703][106225] Updated weights for policy 1, policy_version 1099716 (0.0005) [2023-12-28 03:08:30,704][106226] Updated weights for policy 0, policy_version 1097012 (0.0009) [2023-12-28 03:08:30,753][106225] Updated weights for policy 1, policy_version 1099726 (0.0005) [2023-12-28 03:08:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 562470912. Throughput: 0: 9822.0, 1: 9891.0. Samples: 562463792. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:31,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.996')] [2023-12-28 03:08:31,319][106226] Updated weights for policy 0, policy_version 1097022 (0.0007) [2023-12-28 03:08:31,389][106226] Updated weights for policy 0, policy_version 1097032 (0.0008) [2023-12-28 03:08:31,420][106225] Updated weights for policy 1, policy_version 1099736 (0.0008) [2023-12-28 03:08:31,451][106226] Updated weights for policy 0, policy_version 1097042 (0.0006) [2023-12-28 03:08:31,483][106225] Updated weights for policy 1, policy_version 1099746 (0.0008) [2023-12-28 03:08:31,547][106225] Updated weights for policy 1, policy_version 1099756 (0.0009) [2023-12-28 03:08:32,123][106226] Updated weights for policy 0, policy_version 1097052 (0.0007) [2023-12-28 03:08:32,189][106226] Updated weights for policy 0, policy_version 1097062 (0.0008) [2023-12-28 03:08:32,259][106226] Updated weights for policy 0, policy_version 1097072 (0.0008) [2023-12-28 03:08:32,277][106225] Updated weights for policy 1, policy_version 1099766 (0.0009) [2023-12-28 03:08:32,334][106225] Updated weights for policy 1, policy_version 1099776 (0.0009) [2023-12-28 03:08:32,400][106225] Updated weights for policy 1, policy_version 1099786 (0.0010) [2023-12-28 03:08:32,892][106226] Updated weights for policy 0, policy_version 1097082 (0.0007) [2023-12-28 03:08:32,943][106226] Updated weights for policy 0, policy_version 1097092 (0.0007) [2023-12-28 03:08:32,996][106226] Updated weights for policy 0, policy_version 1097102 (0.0007) [2023-12-28 03:08:33,057][106226] Updated weights for policy 0, policy_version 1097112 (0.0006) [2023-12-28 03:08:33,142][106225] Updated weights for policy 1, policy_version 1099796 (0.0010) [2023-12-28 03:08:33,197][106225] Updated weights for policy 1, policy_version 1099806 (0.0010) [2023-12-28 03:08:33,257][106225] Updated weights for policy 1, policy_version 1099816 (0.0010) [2023-12-28 03:08:33,746][106226] Updated weights for policy 0, policy_version 1097122 (0.0006) [2023-12-28 03:08:33,809][106226] Updated weights for policy 0, policy_version 1097132 (0.0005) [2023-12-28 03:08:33,857][106226] Updated weights for policy 0, policy_version 1097142 (0.0005) [2023-12-28 03:08:33,975][106225] Updated weights for policy 1, policy_version 1099826 (0.0010) [2023-12-28 03:08:34,036][106225] Updated weights for policy 1, policy_version 1099836 (0.0010) [2023-12-28 03:08:34,102][106225] Updated weights for policy 1, policy_version 1099846 (0.0010) [2023-12-28 03:08:34,160][106225] Updated weights for policy 1, policy_version 1099856 (0.0010) [2023-12-28 03:08:34,480][106226] Updated weights for policy 0, policy_version 1097152 (0.0008) [2023-12-28 03:08:34,542][106226] Updated weights for policy 0, policy_version 1097162 (0.0008) [2023-12-28 03:08:34,604][106226] Updated weights for policy 0, policy_version 1097172 (0.0008) [2023-12-28 03:08:34,883][106225] Updated weights for policy 1, policy_version 1099866 (0.0010) [2023-12-28 03:08:34,942][106225] Updated weights for policy 1, policy_version 1099876 (0.0010) [2023-12-28 03:08:34,998][106225] Updated weights for policy 1, policy_version 1099886 (0.0006) [2023-12-28 03:08:35,312][106226] Updated weights for policy 0, policy_version 1097182 (0.0009) [2023-12-28 03:08:35,363][106226] Updated weights for policy 0, policy_version 1097192 (0.0008) [2023-12-28 03:08:35,411][106226] Updated weights for policy 0, policy_version 1097202 (0.0009) [2023-12-28 03:08:35,580][106225] Updated weights for policy 1, policy_version 1099896 (0.0005) [2023-12-28 03:08:35,637][106225] Updated weights for policy 1, policy_version 1099906 (0.0005) [2023-12-28 03:08:35,694][106225] Updated weights for policy 1, policy_version 1099916 (0.0005) [2023-12-28 03:08:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 562569216. Throughput: 0: 9907.6, 1: 9837.1. Samples: 562583288. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:36,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.771')] [2023-12-28 03:08:36,216][106225] Updated weights for policy 1, policy_version 1099926 (0.0008) [2023-12-28 03:08:36,266][106226] Updated weights for policy 0, policy_version 1097212 (0.0009) [2023-12-28 03:08:36,278][106225] Updated weights for policy 1, policy_version 1099936 (0.0011) [2023-12-28 03:08:36,334][106226] Updated weights for policy 0, policy_version 1097222 (0.0007) [2023-12-28 03:08:36,340][106225] Updated weights for policy 1, policy_version 1099946 (0.0010) [2023-12-28 03:08:36,400][106226] Updated weights for policy 0, policy_version 1097232 (0.0007) [2023-12-28 03:08:37,062][106225] Updated weights for policy 1, policy_version 1099956 (0.0010) [2023-12-28 03:08:37,120][106225] Updated weights for policy 1, policy_version 1099966 (0.0010) [2023-12-28 03:08:37,122][106226] Updated weights for policy 0, policy_version 1097242 (0.0008) [2023-12-28 03:08:37,177][106225] Updated weights for policy 1, policy_version 1099976 (0.0010) [2023-12-28 03:08:37,180][106226] Updated weights for policy 0, policy_version 1097252 (0.0006) [2023-12-28 03:08:37,239][106226] Updated weights for policy 0, policy_version 1097262 (0.0006) [2023-12-28 03:08:37,299][106226] Updated weights for policy 0, policy_version 1097272 (0.0008) [2023-12-28 03:08:37,879][106225] Updated weights for policy 1, policy_version 1099986 (0.0010) [2023-12-28 03:08:37,937][106225] Updated weights for policy 1, policy_version 1099996 (0.0010) [2023-12-28 03:08:37,958][106226] Updated weights for policy 0, policy_version 1097282 (0.0007) [2023-12-28 03:08:37,994][106225] Updated weights for policy 1, policy_version 1100006 (0.0010) [2023-12-28 03:08:38,007][106226] Updated weights for policy 0, policy_version 1097292 (0.0007) [2023-12-28 03:08:38,051][106225] Updated weights for policy 1, policy_version 1100016 (0.0010) [2023-12-28 03:08:38,070][106226] Updated weights for policy 0, policy_version 1097302 (0.0007) [2023-12-28 03:08:38,712][106226] Updated weights for policy 0, policy_version 1097312 (0.0006) [2023-12-28 03:08:38,787][106226] Updated weights for policy 0, policy_version 1097322 (0.0007) [2023-12-28 03:08:38,839][106225] Updated weights for policy 1, policy_version 1100026 (0.0010) [2023-12-28 03:08:38,849][106226] Updated weights for policy 0, policy_version 1097332 (0.0006) [2023-12-28 03:08:38,901][106225] Updated weights for policy 1, policy_version 1100036 (0.0010) [2023-12-28 03:08:38,961][106225] Updated weights for policy 1, policy_version 1100046 (0.0005) [2023-12-28 03:08:39,615][106226] Updated weights for policy 0, policy_version 1097342 (0.0008) [2023-12-28 03:08:39,669][106226] Updated weights for policy 0, policy_version 1097352 (0.0008) [2023-12-28 03:08:39,676][106225] Updated weights for policy 1, policy_version 1100056 (0.0007) [2023-12-28 03:08:39,725][106226] Updated weights for policy 0, policy_version 1097362 (0.0006) [2023-12-28 03:08:39,736][106225] Updated weights for policy 1, policy_version 1100066 (0.0008) [2023-12-28 03:08:39,797][106225] Updated weights for policy 1, policy_version 1100076 (0.0006) [2023-12-28 03:08:40,493][106226] Updated weights for policy 0, policy_version 1097372 (0.0007) [2023-12-28 03:08:40,525][106225] Updated weights for policy 1, policy_version 1100086 (0.0008) [2023-12-28 03:08:40,555][106226] Updated weights for policy 0, policy_version 1097382 (0.0006) [2023-12-28 03:08:40,587][106225] Updated weights for policy 1, policy_version 1100096 (0.0006) [2023-12-28 03:08:40,617][106226] Updated weights for policy 0, policy_version 1097392 (0.0007) [2023-12-28 03:08:40,646][106225] Updated weights for policy 1, policy_version 1100106 (0.0008) [2023-12-28 03:08:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 562667520. Throughput: 0: 9906.6, 1: 9858.3. Samples: 562642636. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:41,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.963')] [2023-12-28 03:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001100112_281673728.pth... [2023-12-28 03:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001097400_280993792.pth... [2023-12-28 03:08:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001098960_281378816.pth [2023-12-28 03:08:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001096280_280707072.pth [2023-12-28 03:08:41,277][106225] Updated weights for policy 1, policy_version 1100116 (0.0007) [2023-12-28 03:08:41,319][106226] Updated weights for policy 0, policy_version 1097402 (0.0007) [2023-12-28 03:08:41,340][106225] Updated weights for policy 1, policy_version 1100126 (0.0006) [2023-12-28 03:08:41,391][106226] Updated weights for policy 0, policy_version 1097412 (0.0008) [2023-12-28 03:08:41,415][106225] Updated weights for policy 1, policy_version 1100136 (0.0008) [2023-12-28 03:08:41,459][106226] Updated weights for policy 0, policy_version 1097422 (0.0008) [2023-12-28 03:08:41,518][106226] Updated weights for policy 0, policy_version 1097432 (0.0009) [2023-12-28 03:08:42,151][106225] Updated weights for policy 1, policy_version 1100146 (0.0007) [2023-12-28 03:08:42,212][106225] Updated weights for policy 1, policy_version 1100156 (0.0008) [2023-12-28 03:08:42,258][106226] Updated weights for policy 0, policy_version 1097442 (0.0007) [2023-12-28 03:08:42,279][106225] Updated weights for policy 1, policy_version 1100166 (0.0012) [2023-12-28 03:08:42,324][106226] Updated weights for policy 0, policy_version 1097452 (0.0008) [2023-12-28 03:08:42,345][106225] Updated weights for policy 1, policy_version 1100176 (0.0008) [2023-12-28 03:08:42,395][106226] Updated weights for policy 0, policy_version 1097462 (0.0007) [2023-12-28 03:08:43,042][106225] Updated weights for policy 1, policy_version 1100186 (0.0007) [2023-12-28 03:08:43,052][106226] Updated weights for policy 0, policy_version 1097472 (0.0007) [2023-12-28 03:08:43,090][106225] Updated weights for policy 1, policy_version 1100196 (0.0006) [2023-12-28 03:08:43,099][106226] Updated weights for policy 0, policy_version 1097482 (0.0006) [2023-12-28 03:08:43,139][106225] Updated weights for policy 1, policy_version 1100206 (0.0007) [2023-12-28 03:08:43,153][106226] Updated weights for policy 0, policy_version 1097492 (0.0008) [2023-12-28 03:08:43,739][106225] Updated weights for policy 1, policy_version 1100216 (0.0005) [2023-12-28 03:08:43,796][106226] Updated weights for policy 0, policy_version 1097502 (0.0010) [2023-12-28 03:08:43,800][106225] Updated weights for policy 1, policy_version 1100226 (0.0005) [2023-12-28 03:08:43,860][106226] Updated weights for policy 0, policy_version 1097512 (0.0006) [2023-12-28 03:08:43,862][106225] Updated weights for policy 1, policy_version 1100236 (0.0009) [2023-12-28 03:08:43,922][106226] Updated weights for policy 0, policy_version 1097522 (0.0008) [2023-12-28 03:08:44,554][106225] Updated weights for policy 1, policy_version 1100246 (0.0009) [2023-12-28 03:08:44,586][106226] Updated weights for policy 0, policy_version 1097532 (0.0007) [2023-12-28 03:08:44,604][106225] Updated weights for policy 1, policy_version 1100256 (0.0007) [2023-12-28 03:08:44,647][106226] Updated weights for policy 0, policy_version 1097542 (0.0007) [2023-12-28 03:08:44,654][106225] Updated weights for policy 1, policy_version 1100266 (0.0006) [2023-12-28 03:08:44,705][106226] Updated weights for policy 0, policy_version 1097552 (0.0006) [2023-12-28 03:08:45,409][106225] Updated weights for policy 1, policy_version 1100276 (0.0007) [2023-12-28 03:08:45,419][106226] Updated weights for policy 0, policy_version 1097562 (0.0008) [2023-12-28 03:08:45,464][106225] Updated weights for policy 1, policy_version 1100286 (0.0008) [2023-12-28 03:08:45,478][106226] Updated weights for policy 0, policy_version 1097572 (0.0006) [2023-12-28 03:08:45,524][106225] Updated weights for policy 1, policy_version 1100296 (0.0009) [2023-12-28 03:08:45,536][106226] Updated weights for policy 0, policy_version 1097582 (0.0009) [2023-12-28 03:08:45,591][106226] Updated weights for policy 0, policy_version 1097592 (0.0008) [2023-12-28 03:08:46,174][106225] Updated weights for policy 1, policy_version 1100306 (0.0007) [2023-12-28 03:08:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 562765824. Throughput: 0: 9820.3, 1: 9913.8. Samples: 562759652. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:46,176][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.818')] [2023-12-28 03:08:46,222][106225] Updated weights for policy 1, policy_version 1100316 (0.0006) [2023-12-28 03:08:46,267][106226] Updated weights for policy 0, policy_version 1097602 (0.0009) [2023-12-28 03:08:46,284][106225] Updated weights for policy 1, policy_version 1100326 (0.0006) [2023-12-28 03:08:46,328][106226] Updated weights for policy 0, policy_version 1097612 (0.0007) [2023-12-28 03:08:46,346][106225] Updated weights for policy 1, policy_version 1100336 (0.0006) [2023-12-28 03:08:46,403][106226] Updated weights for policy 0, policy_version 1097622 (0.0008) [2023-12-28 03:08:46,942][106225] Updated weights for policy 1, policy_version 1100346 (0.0005) [2023-12-28 03:08:46,997][106225] Updated weights for policy 1, policy_version 1100356 (0.0005) [2023-12-28 03:08:47,054][106225] Updated weights for policy 1, policy_version 1100366 (0.0005) [2023-12-28 03:08:47,192][106226] Updated weights for policy 0, policy_version 1097632 (0.0009) [2023-12-28 03:08:47,249][106226] Updated weights for policy 0, policy_version 1097642 (0.0008) [2023-12-28 03:08:47,317][106226] Updated weights for policy 0, policy_version 1097652 (0.0010) [2023-12-28 03:08:47,679][106225] Updated weights for policy 1, policy_version 1100376 (0.0008) [2023-12-28 03:08:47,737][106225] Updated weights for policy 1, policy_version 1100386 (0.0008) [2023-12-28 03:08:47,787][106225] Updated weights for policy 1, policy_version 1100396 (0.0009) [2023-12-28 03:08:48,048][106226] Updated weights for policy 0, policy_version 1097662 (0.0009) [2023-12-28 03:08:48,095][106226] Updated weights for policy 0, policy_version 1097672 (0.0008) [2023-12-28 03:08:48,147][106226] Updated weights for policy 0, policy_version 1097682 (0.0008) [2023-12-28 03:08:48,585][106225] Updated weights for policy 1, policy_version 1100406 (0.0007) [2023-12-28 03:08:48,655][106225] Updated weights for policy 1, policy_version 1100416 (0.0008) [2023-12-28 03:08:48,720][106225] Updated weights for policy 1, policy_version 1100426 (0.0009) [2023-12-28 03:08:48,875][106226] Updated weights for policy 0, policy_version 1097692 (0.0008) [2023-12-28 03:08:48,938][106226] Updated weights for policy 0, policy_version 1097702 (0.0008) [2023-12-28 03:08:48,995][106226] Updated weights for policy 0, policy_version 1097712 (0.0009) [2023-12-28 03:08:49,465][106225] Updated weights for policy 1, policy_version 1100436 (0.0008) [2023-12-28 03:08:49,527][106225] Updated weights for policy 1, policy_version 1100446 (0.0008) [2023-12-28 03:08:49,589][106225] Updated weights for policy 1, policy_version 1100456 (0.0006) [2023-12-28 03:08:49,713][106226] Updated weights for policy 0, policy_version 1097722 (0.0008) [2023-12-28 03:08:49,777][106226] Updated weights for policy 0, policy_version 1097732 (0.0008) [2023-12-28 03:08:49,843][106226] Updated weights for policy 0, policy_version 1097742 (0.0008) [2023-12-28 03:08:49,917][106226] Updated weights for policy 0, policy_version 1097752 (0.0008) [2023-12-28 03:08:50,318][106225] Updated weights for policy 1, policy_version 1100466 (0.0006) [2023-12-28 03:08:50,377][106225] Updated weights for policy 1, policy_version 1100476 (0.0009) [2023-12-28 03:08:50,427][106225] Updated weights for policy 1, policy_version 1100486 (0.0009) [2023-12-28 03:08:50,480][106225] Updated weights for policy 1, policy_version 1100496 (0.0009) [2023-12-28 03:08:50,567][106226] Updated weights for policy 0, policy_version 1097762 (0.0009) [2023-12-28 03:08:50,629][106226] Updated weights for policy 0, policy_version 1097772 (0.0009) [2023-12-28 03:08:50,681][106226] Updated weights for policy 0, policy_version 1097782 (0.0008) [2023-12-28 03:08:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 562864128. Throughput: 0: 9795.2, 1: 9940.8. Samples: 562876656. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:51,175][105115] Avg episode reward: [(0, '-4.861'), (1, '-4.923')] [2023-12-28 03:08:51,268][106225] Updated weights for policy 1, policy_version 1100506 (0.0008) [2023-12-28 03:08:51,332][106225] Updated weights for policy 1, policy_version 1100516 (0.0008) [2023-12-28 03:08:51,396][106225] Updated weights for policy 1, policy_version 1100526 (0.0008) [2023-12-28 03:08:51,492][106226] Updated weights for policy 0, policy_version 1097792 (0.0008) [2023-12-28 03:08:51,552][106226] Updated weights for policy 0, policy_version 1097802 (0.0008) [2023-12-28 03:08:51,614][106226] Updated weights for policy 0, policy_version 1097812 (0.0009) [2023-12-28 03:08:52,068][106225] Updated weights for policy 1, policy_version 1100536 (0.0009) [2023-12-28 03:08:52,117][106225] Updated weights for policy 1, policy_version 1100546 (0.0009) [2023-12-28 03:08:52,165][106225] Updated weights for policy 1, policy_version 1100556 (0.0008) [2023-12-28 03:08:52,399][106226] Updated weights for policy 0, policy_version 1097823 (0.0009) [2023-12-28 03:08:52,456][106226] Updated weights for policy 0, policy_version 1097833 (0.0011) [2023-12-28 03:08:52,516][106226] Updated weights for policy 0, policy_version 1097843 (0.0011) [2023-12-28 03:08:52,957][106225] Updated weights for policy 1, policy_version 1100566 (0.0007) [2023-12-28 03:08:53,016][106225] Updated weights for policy 1, policy_version 1100576 (0.0005) [2023-12-28 03:08:53,079][106225] Updated weights for policy 1, policy_version 1100586 (0.0006) [2023-12-28 03:08:53,164][106226] Updated weights for policy 0, policy_version 1097853 (0.0010) [2023-12-28 03:08:53,220][106226] Updated weights for policy 0, policy_version 1097863 (0.0010) [2023-12-28 03:08:53,286][106226] Updated weights for policy 0, policy_version 1097873 (0.0006) [2023-12-28 03:08:53,674][106225] Updated weights for policy 1, policy_version 1100596 (0.0009) [2023-12-28 03:08:53,730][106225] Updated weights for policy 1, policy_version 1100606 (0.0008) [2023-12-28 03:08:53,778][106225] Updated weights for policy 1, policy_version 1100616 (0.0005) [2023-12-28 03:08:53,986][106226] Updated weights for policy 0, policy_version 1097883 (0.0008) [2023-12-28 03:08:54,042][106226] Updated weights for policy 0, policy_version 1097893 (0.0010) [2023-12-28 03:08:54,097][106226] Updated weights for policy 0, policy_version 1097903 (0.0010) [2023-12-28 03:08:54,317][106225] Updated weights for policy 1, policy_version 1100626 (0.0005) [2023-12-28 03:08:54,367][106225] Updated weights for policy 1, policy_version 1100636 (0.0007) [2023-12-28 03:08:54,410][106225] Updated weights for policy 1, policy_version 1100646 (0.0010) [2023-12-28 03:08:54,459][106225] Updated weights for policy 1, policy_version 1100656 (0.0010) [2023-12-28 03:08:54,820][106226] Updated weights for policy 0, policy_version 1097913 (0.0010) [2023-12-28 03:08:54,887][106226] Updated weights for policy 0, policy_version 1097923 (0.0008) [2023-12-28 03:08:54,947][106226] Updated weights for policy 0, policy_version 1097933 (0.0008) [2023-12-28 03:08:55,011][106226] Updated weights for policy 0, policy_version 1097943 (0.0008) [2023-12-28 03:08:55,197][106225] Updated weights for policy 1, policy_version 1100666 (0.0011) [2023-12-28 03:08:55,253][106225] Updated weights for policy 1, policy_version 1100676 (0.0008) [2023-12-28 03:08:55,305][106225] Updated weights for policy 1, policy_version 1100686 (0.0005) [2023-12-28 03:08:55,711][106226] Updated weights for policy 0, policy_version 1097953 (0.0008) [2023-12-28 03:08:55,757][106226] Updated weights for policy 0, policy_version 1097963 (0.0008) [2023-12-28 03:08:55,814][106226] Updated weights for policy 0, policy_version 1097973 (0.0008) [2023-12-28 03:08:55,963][106225] Updated weights for policy 1, policy_version 1100696 (0.0009) [2023-12-28 03:08:56,024][106225] Updated weights for policy 1, policy_version 1100706 (0.0011) [2023-12-28 03:08:56,075][106225] Updated weights for policy 1, policy_version 1100716 (0.0010) [2023-12-28 03:08:56,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 562970624. Throughput: 0: 9754.2, 1: 9956.3. Samples: 562936132. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:08:56,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.950')] [2023-12-28 03:08:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001097976_281141248.pth... [2023-12-28 03:08:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001100720_281829376.pth... [2023-12-28 03:08:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001096824_280846336.pth [2023-12-28 03:08:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001099536_281526272.pth [2023-12-28 03:08:56,558][106226] Updated weights for policy 0, policy_version 1097983 (0.0008) [2023-12-28 03:08:56,620][106226] Updated weights for policy 0, policy_version 1097993 (0.0008) [2023-12-28 03:08:56,672][106226] Updated weights for policy 0, policy_version 1098003 (0.0007) [2023-12-28 03:08:56,801][106225] Updated weights for policy 1, policy_version 1100726 (0.0010) [2023-12-28 03:08:56,853][106225] Updated weights for policy 1, policy_version 1100736 (0.0010) [2023-12-28 03:08:56,903][106225] Updated weights for policy 1, policy_version 1100746 (0.0010) [2023-12-28 03:08:57,390][106226] Updated weights for policy 0, policy_version 1098013 (0.0008) [2023-12-28 03:08:57,448][106226] Updated weights for policy 0, policy_version 1098023 (0.0008) [2023-12-28 03:08:57,506][106226] Updated weights for policy 0, policy_version 1098033 (0.0008) [2023-12-28 03:08:57,629][106225] Updated weights for policy 1, policy_version 1100756 (0.0010) [2023-12-28 03:08:57,676][106225] Updated weights for policy 1, policy_version 1100766 (0.0010) [2023-12-28 03:08:57,729][106225] Updated weights for policy 1, policy_version 1100776 (0.0010) [2023-12-28 03:08:58,239][106226] Updated weights for policy 0, policy_version 1098043 (0.0008) [2023-12-28 03:08:58,299][106226] Updated weights for policy 0, policy_version 1098053 (0.0008) [2023-12-28 03:08:58,367][106226] Updated weights for policy 0, policy_version 1098063 (0.0009) [2023-12-28 03:08:58,461][106225] Updated weights for policy 1, policy_version 1100786 (0.0009) [2023-12-28 03:08:58,525][106225] Updated weights for policy 1, policy_version 1100796 (0.0009) [2023-12-28 03:08:58,590][106225] Updated weights for policy 1, policy_version 1100806 (0.0010) [2023-12-28 03:08:58,655][106225] Updated weights for policy 1, policy_version 1100816 (0.0009) [2023-12-28 03:08:59,146][106226] Updated weights for policy 0, policy_version 1098073 (0.0008) [2023-12-28 03:08:59,199][106226] Updated weights for policy 0, policy_version 1098083 (0.0008) [2023-12-28 03:08:59,272][106226] Updated weights for policy 0, policy_version 1098093 (0.0009) [2023-12-28 03:08:59,335][106226] Updated weights for policy 0, policy_version 1098103 (0.0008) [2023-12-28 03:08:59,484][106225] Updated weights for policy 1, policy_version 1100826 (0.0008) [2023-12-28 03:08:59,533][106225] Updated weights for policy 1, policy_version 1100836 (0.0008) [2023-12-28 03:08:59,588][106225] Updated weights for policy 1, policy_version 1100846 (0.0006) [2023-12-28 03:09:00,104][106226] Updated weights for policy 0, policy_version 1098113 (0.0011) [2023-12-28 03:09:00,161][106226] Updated weights for policy 0, policy_version 1098123 (0.0010) [2023-12-28 03:09:00,221][106226] Updated weights for policy 0, policy_version 1098133 (0.0011) [2023-12-28 03:09:00,345][106225] Updated weights for policy 1, policy_version 1100856 (0.0007) [2023-12-28 03:09:00,394][106225] Updated weights for policy 1, policy_version 1100866 (0.0009) [2023-12-28 03:09:00,452][106225] Updated weights for policy 1, policy_version 1100876 (0.0008) [2023-12-28 03:09:00,904][106226] Updated weights for policy 0, policy_version 1098143 (0.0010) [2023-12-28 03:09:00,972][106226] Updated weights for policy 0, policy_version 1098153 (0.0010) [2023-12-28 03:09:01,033][106226] Updated weights for policy 0, policy_version 1098163 (0.0010) [2023-12-28 03:09:01,150][106225] Updated weights for policy 1, policy_version 1100886 (0.0007) [2023-12-28 03:09:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 563060736. Throughput: 0: 9727.5, 1: 10007.1. Samples: 563051864. Policy #0 lag: (min: 22.0, avg: 29.7, max: 54.0) [2023-12-28 03:09:01,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-4.919')] [2023-12-28 03:09:01,213][106225] Updated weights for policy 1, policy_version 1100896 (0.0008) [2023-12-28 03:09:01,274][106225] Updated weights for policy 1, policy_version 1100906 (0.0008) [2023-12-28 03:09:01,736][106226] Updated weights for policy 0, policy_version 1098173 (0.0009) [2023-12-28 03:09:01,802][106226] Updated weights for policy 0, policy_version 1098183 (0.0009) [2023-12-28 03:09:01,866][106226] Updated weights for policy 0, policy_version 1098193 (0.0009) [2023-12-28 03:09:02,001][106225] Updated weights for policy 1, policy_version 1100916 (0.0007) [2023-12-28 03:09:02,063][106225] Updated weights for policy 1, policy_version 1100926 (0.0006) [2023-12-28 03:09:02,117][106225] Updated weights for policy 1, policy_version 1100936 (0.0005) [2023-12-28 03:09:02,642][106226] Updated weights for policy 0, policy_version 1098203 (0.0010) [2023-12-28 03:09:02,702][106226] Updated weights for policy 0, policy_version 1098213 (0.0010) [2023-12-28 03:09:02,713][106225] Updated weights for policy 1, policy_version 1100946 (0.0006) [2023-12-28 03:09:02,759][106226] Updated weights for policy 0, policy_version 1098223 (0.0011) [2023-12-28 03:09:02,773][106225] Updated weights for policy 1, policy_version 1100956 (0.0006) [2023-12-28 03:09:02,841][106225] Updated weights for policy 1, policy_version 1100966 (0.0006) [2023-12-28 03:09:02,901][106225] Updated weights for policy 1, policy_version 1100976 (0.0008) [2023-12-28 03:09:03,462][106226] Updated weights for policy 0, policy_version 1098233 (0.0009) [2023-12-28 03:09:03,518][106226] Updated weights for policy 0, policy_version 1098243 (0.0010) [2023-12-28 03:09:03,570][106226] Updated weights for policy 0, policy_version 1098253 (0.0010) [2023-12-28 03:09:03,578][106225] Updated weights for policy 1, policy_version 1100986 (0.0010) [2023-12-28 03:09:03,625][106225] Updated weights for policy 1, policy_version 1100996 (0.0010) [2023-12-28 03:09:03,626][106226] Updated weights for policy 0, policy_version 1098263 (0.0010) [2023-12-28 03:09:03,675][106225] Updated weights for policy 1, policy_version 1101006 (0.0009) [2023-12-28 03:09:04,325][106226] Updated weights for policy 0, policy_version 1098273 (0.0010) [2023-12-28 03:09:04,374][106226] Updated weights for policy 0, policy_version 1098283 (0.0009) [2023-12-28 03:09:04,425][106225] Updated weights for policy 1, policy_version 1101016 (0.0008) [2023-12-28 03:09:04,433][106226] Updated weights for policy 0, policy_version 1098293 (0.0008) [2023-12-28 03:09:04,490][106225] Updated weights for policy 1, policy_version 1101026 (0.0007) [2023-12-28 03:09:04,557][106225] Updated weights for policy 1, policy_version 1101036 (0.0008) [2023-12-28 03:09:05,152][106226] Updated weights for policy 0, policy_version 1098303 (0.0010) [2023-12-28 03:09:05,213][106226] Updated weights for policy 0, policy_version 1098313 (0.0011) [2023-12-28 03:09:05,264][106225] Updated weights for policy 1, policy_version 1101046 (0.0008) [2023-12-28 03:09:05,272][106226] Updated weights for policy 0, policy_version 1098323 (0.0011) [2023-12-28 03:09:05,321][106225] Updated weights for policy 1, policy_version 1101056 (0.0006) [2023-12-28 03:09:05,381][106225] Updated weights for policy 1, policy_version 1101066 (0.0008) [2023-12-28 03:09:05,850][106226] Updated weights for policy 0, policy_version 1098333 (0.0010) [2023-12-28 03:09:05,907][106226] Updated weights for policy 0, policy_version 1098343 (0.0009) [2023-12-28 03:09:05,958][106226] Updated weights for policy 0, policy_version 1098353 (0.0006) [2023-12-28 03:09:06,060][106225] Updated weights for policy 1, policy_version 1101076 (0.0008) [2023-12-28 03:09:06,126][106225] Updated weights for policy 1, policy_version 1101086 (0.0008) [2023-12-28 03:09:06,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 563159040. Throughput: 0: 9800.5, 1: 10003.6. Samples: 563170120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:06,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.743')] [2023-12-28 03:09:06,184][106225] Updated weights for policy 1, policy_version 1101096 (0.0007) [2023-12-28 03:09:06,672][106226] Updated weights for policy 0, policy_version 1098363 (0.0011) [2023-12-28 03:09:06,726][106226] Updated weights for policy 0, policy_version 1098373 (0.0011) [2023-12-28 03:09:06,780][106226] Updated weights for policy 0, policy_version 1098383 (0.0011) [2023-12-28 03:09:06,875][106225] Updated weights for policy 1, policy_version 1101106 (0.0006) [2023-12-28 03:09:06,943][106225] Updated weights for policy 1, policy_version 1101116 (0.0005) [2023-12-28 03:09:07,013][106225] Updated weights for policy 1, policy_version 1101126 (0.0008) [2023-12-28 03:09:07,079][106225] Updated weights for policy 1, policy_version 1101136 (0.0010) [2023-12-28 03:09:07,428][106226] Updated weights for policy 0, policy_version 1098393 (0.0010) [2023-12-28 03:09:07,493][106226] Updated weights for policy 0, policy_version 1098403 (0.0009) [2023-12-28 03:09:07,545][106226] Updated weights for policy 0, policy_version 1098413 (0.0010) [2023-12-28 03:09:07,605][106226] Updated weights for policy 0, policy_version 1098423 (0.0010) [2023-12-28 03:09:07,715][106225] Updated weights for policy 1, policy_version 1101146 (0.0010) [2023-12-28 03:09:07,784][106225] Updated weights for policy 1, policy_version 1101156 (0.0010) [2023-12-28 03:09:07,851][106225] Updated weights for policy 1, policy_version 1101166 (0.0010) [2023-12-28 03:09:08,176][106226] Updated weights for policy 0, policy_version 1098433 (0.0006) [2023-12-28 03:09:08,226][106226] Updated weights for policy 0, policy_version 1098443 (0.0008) [2023-12-28 03:09:08,285][106226] Updated weights for policy 0, policy_version 1098453 (0.0010) [2023-12-28 03:09:08,463][106225] Updated weights for policy 1, policy_version 1101176 (0.0006) [2023-12-28 03:09:08,528][106225] Updated weights for policy 1, policy_version 1101186 (0.0006) [2023-12-28 03:09:08,593][106225] Updated weights for policy 1, policy_version 1101196 (0.0009) [2023-12-28 03:09:08,933][106226] Updated weights for policy 0, policy_version 1098463 (0.0010) [2023-12-28 03:09:08,998][106226] Updated weights for policy 0, policy_version 1098473 (0.0011) [2023-12-28 03:09:09,054][106226] Updated weights for policy 0, policy_version 1098483 (0.0010) [2023-12-28 03:09:09,145][106225] Updated weights for policy 1, policy_version 1101206 (0.0008) [2023-12-28 03:09:09,217][106225] Updated weights for policy 1, policy_version 1101216 (0.0008) [2023-12-28 03:09:09,279][106225] Updated weights for policy 1, policy_version 1101226 (0.0009) [2023-12-28 03:09:09,821][106226] Updated weights for policy 0, policy_version 1098493 (0.0009) [2023-12-28 03:09:09,892][106226] Updated weights for policy 0, policy_version 1098503 (0.0007) [2023-12-28 03:09:09,961][106226] Updated weights for policy 0, policy_version 1098513 (0.0008) [2023-12-28 03:09:10,027][106225] Updated weights for policy 1, policy_version 1101236 (0.0008) [2023-12-28 03:09:10,086][106225] Updated weights for policy 1, policy_version 1101246 (0.0008) [2023-12-28 03:09:10,142][106225] Updated weights for policy 1, policy_version 1101256 (0.0007) [2023-12-28 03:09:10,675][106226] Updated weights for policy 0, policy_version 1098523 (0.0006) [2023-12-28 03:09:10,723][106226] Updated weights for policy 0, policy_version 1098533 (0.0006) [2023-12-28 03:09:10,778][106226] Updated weights for policy 0, policy_version 1098543 (0.0008) [2023-12-28 03:09:10,844][106225] Updated weights for policy 1, policy_version 1101266 (0.0006) [2023-12-28 03:09:10,899][106225] Updated weights for policy 1, policy_version 1101276 (0.0008) [2023-12-28 03:09:10,964][106225] Updated weights for policy 1, policy_version 1101286 (0.0007) [2023-12-28 03:09:11,019][106225] Updated weights for policy 1, policy_version 1101296 (0.0007) [2023-12-28 03:09:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 563265536. Throughput: 0: 9860.5, 1: 10094.5. Samples: 563232996. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:11,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.852')] [2023-12-28 03:09:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001098552_281288704.pth... [2023-12-28 03:09:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001101296_281976832.pth... [2023-12-28 03:09:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001100112_281673728.pth [2023-12-28 03:09:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001097400_280993792.pth [2023-12-28 03:09:11,618][106226] Updated weights for policy 0, policy_version 1098553 (0.0008) [2023-12-28 03:09:11,690][106226] Updated weights for policy 0, policy_version 1098563 (0.0008) [2023-12-28 03:09:11,754][106225] Updated weights for policy 1, policy_version 1101306 (0.0008) [2023-12-28 03:09:11,756][106226] Updated weights for policy 0, policy_version 1098573 (0.0008) [2023-12-28 03:09:11,815][106226] Updated weights for policy 0, policy_version 1098583 (0.0007) [2023-12-28 03:09:11,820][106225] Updated weights for policy 1, policy_version 1101316 (0.0008) [2023-12-28 03:09:11,880][106225] Updated weights for policy 1, policy_version 1101326 (0.0008) [2023-12-28 03:09:12,496][106226] Updated weights for policy 0, policy_version 1098593 (0.0006) [2023-12-28 03:09:12,565][106226] Updated weights for policy 0, policy_version 1098603 (0.0006) [2023-12-28 03:09:12,628][106226] Updated weights for policy 0, policy_version 1098613 (0.0007) [2023-12-28 03:09:12,638][106225] Updated weights for policy 1, policy_version 1101336 (0.0007) [2023-12-28 03:09:12,696][106225] Updated weights for policy 1, policy_version 1101346 (0.0008) [2023-12-28 03:09:12,757][106225] Updated weights for policy 1, policy_version 1101356 (0.0008) [2023-12-28 03:09:13,231][106226] Updated weights for policy 0, policy_version 1098623 (0.0007) [2023-12-28 03:09:13,276][106226] Updated weights for policy 0, policy_version 1098633 (0.0008) [2023-12-28 03:09:13,324][106226] Updated weights for policy 0, policy_version 1098643 (0.0008) [2023-12-28 03:09:13,406][106225] Updated weights for policy 1, policy_version 1101366 (0.0009) [2023-12-28 03:09:13,464][106225] Updated weights for policy 1, policy_version 1101376 (0.0008) [2023-12-28 03:09:13,518][106225] Updated weights for policy 1, policy_version 1101386 (0.0008) [2023-12-28 03:09:14,018][106226] Updated weights for policy 0, policy_version 1098653 (0.0007) [2023-12-28 03:09:14,094][106226] Updated weights for policy 0, policy_version 1098663 (0.0008) [2023-12-28 03:09:14,152][106225] Updated weights for policy 1, policy_version 1101396 (0.0007) [2023-12-28 03:09:14,160][106226] Updated weights for policy 0, policy_version 1098673 (0.0009) [2023-12-28 03:09:14,201][106225] Updated weights for policy 1, policy_version 1101406 (0.0005) [2023-12-28 03:09:14,254][106225] Updated weights for policy 1, policy_version 1101416 (0.0005) [2023-12-28 03:09:14,783][106225] Updated weights for policy 1, policy_version 1101426 (0.0006) [2023-12-28 03:09:14,840][106225] Updated weights for policy 1, policy_version 1101436 (0.0009) [2023-12-28 03:09:14,894][106225] Updated weights for policy 1, policy_version 1101446 (0.0010) [2023-12-28 03:09:14,921][106226] Updated weights for policy 0, policy_version 1098683 (0.0007) [2023-12-28 03:09:14,956][106225] Updated weights for policy 1, policy_version 1101456 (0.0008) [2023-12-28 03:09:14,972][106226] Updated weights for policy 0, policy_version 1098693 (0.0008) [2023-12-28 03:09:15,035][106226] Updated weights for policy 0, policy_version 1098703 (0.0008) [2023-12-28 03:09:15,600][106225] Updated weights for policy 1, policy_version 1101466 (0.0006) [2023-12-28 03:09:15,657][106225] Updated weights for policy 1, policy_version 1101476 (0.0009) [2023-12-28 03:09:15,707][106225] Updated weights for policy 1, policy_version 1101486 (0.0007) [2023-12-28 03:09:15,804][106226] Updated weights for policy 0, policy_version 1098713 (0.0006) [2023-12-28 03:09:15,870][106226] Updated weights for policy 0, policy_version 1098723 (0.0008) [2023-12-28 03:09:15,930][106226] Updated weights for policy 0, policy_version 1098733 (0.0009) [2023-12-28 03:09:15,994][106226] Updated weights for policy 0, policy_version 1098743 (0.0009) [2023-12-28 03:09:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 563363840. Throughput: 0: 9749.3, 1: 9985.6. Samples: 563351860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:16,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.959')] [2023-12-28 03:09:16,434][106225] Updated weights for policy 1, policy_version 1101496 (0.0006) [2023-12-28 03:09:16,492][106225] Updated weights for policy 1, policy_version 1101506 (0.0006) [2023-12-28 03:09:16,546][106225] Updated weights for policy 1, policy_version 1101516 (0.0006) [2023-12-28 03:09:16,747][106226] Updated weights for policy 0, policy_version 1098753 (0.0009) [2023-12-28 03:09:16,800][106226] Updated weights for policy 0, policy_version 1098764 (0.0009) [2023-12-28 03:09:16,848][106226] Updated weights for policy 0, policy_version 1098774 (0.0008) [2023-12-28 03:09:17,175][106225] Updated weights for policy 1, policy_version 1101526 (0.0006) [2023-12-28 03:09:17,242][106225] Updated weights for policy 1, policy_version 1101536 (0.0005) [2023-12-28 03:09:17,304][106225] Updated weights for policy 1, policy_version 1101546 (0.0007) [2023-12-28 03:09:17,637][106226] Updated weights for policy 0, policy_version 1098784 (0.0008) [2023-12-28 03:09:17,697][106226] Updated weights for policy 0, policy_version 1098794 (0.0008) [2023-12-28 03:09:17,756][106226] Updated weights for policy 0, policy_version 1098804 (0.0009) [2023-12-28 03:09:17,969][106225] Updated weights for policy 1, policy_version 1101556 (0.0008) [2023-12-28 03:09:18,028][106225] Updated weights for policy 1, policy_version 1101566 (0.0009) [2023-12-28 03:09:18,081][106225] Updated weights for policy 1, policy_version 1101576 (0.0008) [2023-12-28 03:09:18,534][106226] Updated weights for policy 0, policy_version 1098814 (0.0009) [2023-12-28 03:09:18,605][106226] Updated weights for policy 0, policy_version 1098824 (0.0009) [2023-12-28 03:09:18,674][106226] Updated weights for policy 0, policy_version 1098834 (0.0009) [2023-12-28 03:09:18,805][106225] Updated weights for policy 1, policy_version 1101586 (0.0008) [2023-12-28 03:09:18,862][106225] Updated weights for policy 1, policy_version 1101596 (0.0008) [2023-12-28 03:09:18,913][106225] Updated weights for policy 1, policy_version 1101606 (0.0008) [2023-12-28 03:09:18,965][106225] Updated weights for policy 1, policy_version 1101616 (0.0008) [2023-12-28 03:09:19,418][106226] Updated weights for policy 0, policy_version 1098844 (0.0009) [2023-12-28 03:09:19,476][106226] Updated weights for policy 0, policy_version 1098854 (0.0009) [2023-12-28 03:09:19,553][106226] Updated weights for policy 0, policy_version 1098864 (0.0010) [2023-12-28 03:09:19,683][106225] Updated weights for policy 1, policy_version 1101626 (0.0008) [2023-12-28 03:09:19,748][106225] Updated weights for policy 1, policy_version 1101636 (0.0009) [2023-12-28 03:09:19,813][106225] Updated weights for policy 1, policy_version 1101646 (0.0009) [2023-12-28 03:09:20,335][106226] Updated weights for policy 0, policy_version 1098874 (0.0009) [2023-12-28 03:09:20,393][106226] Updated weights for policy 0, policy_version 1098884 (0.0009) [2023-12-28 03:09:20,460][106226] Updated weights for policy 0, policy_version 1098894 (0.0009) [2023-12-28 03:09:20,513][106225] Updated weights for policy 1, policy_version 1101656 (0.0006) [2023-12-28 03:09:20,527][106226] Updated weights for policy 0, policy_version 1098904 (0.0009) [2023-12-28 03:09:20,577][106225] Updated weights for policy 1, policy_version 1101666 (0.0007) [2023-12-28 03:09:20,648][106225] Updated weights for policy 1, policy_version 1101676 (0.0007) [2023-12-28 03:09:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 563453952. Throughput: 0: 9614.7, 1: 10011.0. Samples: 563466444. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:21,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-4.996')] [2023-12-28 03:09:21,285][106225] Updated weights for policy 1, policy_version 1101686 (0.0006) [2023-12-28 03:09:21,291][106226] Updated weights for policy 0, policy_version 1098914 (0.0008) [2023-12-28 03:09:21,348][106225] Updated weights for policy 1, policy_version 1101696 (0.0008) [2023-12-28 03:09:21,352][106226] Updated weights for policy 0, policy_version 1098924 (0.0007) [2023-12-28 03:09:21,416][106225] Updated weights for policy 1, policy_version 1101706 (0.0008) [2023-12-28 03:09:21,426][106226] Updated weights for policy 0, policy_version 1098934 (0.0008) [2023-12-28 03:09:22,204][106226] Updated weights for policy 0, policy_version 1098944 (0.0008) [2023-12-28 03:09:22,234][106225] Updated weights for policy 1, policy_version 1101716 (0.0007) [2023-12-28 03:09:22,269][106226] Updated weights for policy 0, policy_version 1098954 (0.0008) [2023-12-28 03:09:22,302][106225] Updated weights for policy 1, policy_version 1101726 (0.0008) [2023-12-28 03:09:22,336][106226] Updated weights for policy 0, policy_version 1098964 (0.0007) [2023-12-28 03:09:22,366][106225] Updated weights for policy 1, policy_version 1101736 (0.0008) [2023-12-28 03:09:23,026][106226] Updated weights for policy 0, policy_version 1098974 (0.0008) [2023-12-28 03:09:23,080][106226] Updated weights for policy 0, policy_version 1098984 (0.0007) [2023-12-28 03:09:23,082][106225] Updated weights for policy 1, policy_version 1101746 (0.0008) [2023-12-28 03:09:23,133][106225] Updated weights for policy 1, policy_version 1101756 (0.0007) [2023-12-28 03:09:23,139][106226] Updated weights for policy 0, policy_version 1098994 (0.0006) [2023-12-28 03:09:23,194][106225] Updated weights for policy 1, policy_version 1101766 (0.0009) [2023-12-28 03:09:23,244][106225] Updated weights for policy 1, policy_version 1101776 (0.0009) [2023-12-28 03:09:23,892][106225] Updated weights for policy 1, policy_version 1101786 (0.0010) [2023-12-28 03:09:23,903][106226] Updated weights for policy 0, policy_version 1099004 (0.0007) [2023-12-28 03:09:23,946][106225] Updated weights for policy 1, policy_version 1101796 (0.0010) [2023-12-28 03:09:23,965][106226] Updated weights for policy 0, policy_version 1099014 (0.0005) [2023-12-28 03:09:24,003][106225] Updated weights for policy 1, policy_version 1101806 (0.0010) [2023-12-28 03:09:24,018][106226] Updated weights for policy 0, policy_version 1099024 (0.0005) [2023-12-28 03:09:24,586][106226] Updated weights for policy 0, policy_version 1099034 (0.0005) [2023-12-28 03:09:24,645][106225] Updated weights for policy 1, policy_version 1101816 (0.0006) [2023-12-28 03:09:24,647][106226] Updated weights for policy 0, policy_version 1099044 (0.0007) [2023-12-28 03:09:24,694][106226] Updated weights for policy 0, policy_version 1099054 (0.0006) [2023-12-28 03:09:24,701][106225] Updated weights for policy 1, policy_version 1101826 (0.0008) [2023-12-28 03:09:24,746][106226] Updated weights for policy 0, policy_version 1099064 (0.0008) [2023-12-28 03:09:24,756][106225] Updated weights for policy 1, policy_version 1101836 (0.0005) [2023-12-28 03:09:25,303][106225] Updated weights for policy 1, policy_version 1101846 (0.0008) [2023-12-28 03:09:25,359][106225] Updated weights for policy 1, policy_version 1101856 (0.0010) [2023-12-28 03:09:25,418][106225] Updated weights for policy 1, policy_version 1101866 (0.0010) [2023-12-28 03:09:25,438][106226] Updated weights for policy 0, policy_version 1099074 (0.0005) [2023-12-28 03:09:25,486][106226] Updated weights for policy 0, policy_version 1099084 (0.0005) [2023-12-28 03:09:25,542][106226] Updated weights for policy 0, policy_version 1099094 (0.0005) [2023-12-28 03:09:26,023][106225] Updated weights for policy 1, policy_version 1101876 (0.0008) [2023-12-28 03:09:26,070][106225] Updated weights for policy 1, policy_version 1101886 (0.0008) [2023-12-28 03:09:26,120][106225] Updated weights for policy 1, policy_version 1101896 (0.0007) [2023-12-28 03:09:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 563560448. Throughput: 0: 9584.4, 1: 9980.9. Samples: 563523080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:26,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-5.119')] [2023-12-28 03:09:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001101904_282132480.pth... [2023-12-28 03:09:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001100720_281829376.pth [2023-12-28 03:09:26,228][106226] Updated weights for policy 0, policy_version 1099104 (0.0008) [2023-12-28 03:09:26,283][106226] Updated weights for policy 0, policy_version 1099114 (0.0009) [2023-12-28 03:09:26,344][106226] Updated weights for policy 0, policy_version 1099124 (0.0009) [2023-12-28 03:09:26,370][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001099128_281436160.pth... [2023-12-28 03:09:26,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001097976_281141248.pth [2023-12-28 03:09:26,755][106225] Updated weights for policy 1, policy_version 1101906 (0.0005) [2023-12-28 03:09:26,820][106225] Updated weights for policy 1, policy_version 1101916 (0.0005) [2023-12-28 03:09:26,874][106225] Updated weights for policy 1, policy_version 1101926 (0.0005) [2023-12-28 03:09:26,927][106225] Updated weights for policy 1, policy_version 1101936 (0.0005) [2023-12-28 03:09:27,165][106226] Updated weights for policy 0, policy_version 1099134 (0.0008) [2023-12-28 03:09:27,215][106226] Updated weights for policy 0, policy_version 1099144 (0.0008) [2023-12-28 03:09:27,273][106226] Updated weights for policy 0, policy_version 1099154 (0.0009) [2023-12-28 03:09:27,466][106225] Updated weights for policy 1, policy_version 1101946 (0.0005) [2023-12-28 03:09:27,511][106225] Updated weights for policy 1, policy_version 1101956 (0.0005) [2023-12-28 03:09:27,562][106225] Updated weights for policy 1, policy_version 1101966 (0.0005) [2023-12-28 03:09:27,995][106226] Updated weights for policy 0, policy_version 1099164 (0.0009) [2023-12-28 03:09:28,056][106226] Updated weights for policy 0, policy_version 1099174 (0.0005) [2023-12-28 03:09:28,092][106225] Updated weights for policy 1, policy_version 1101976 (0.0007) [2023-12-28 03:09:28,110][106226] Updated weights for policy 0, policy_version 1099184 (0.0006) [2023-12-28 03:09:28,139][106225] Updated weights for policy 1, policy_version 1101986 (0.0007) [2023-12-28 03:09:28,201][106225] Updated weights for policy 1, policy_version 1101996 (0.0009) [2023-12-28 03:09:28,867][106225] Updated weights for policy 1, policy_version 1102006 (0.0007) [2023-12-28 03:09:28,871][106226] Updated weights for policy 0, policy_version 1099194 (0.0007) [2023-12-28 03:09:28,925][106226] Updated weights for policy 0, policy_version 1099204 (0.0009) [2023-12-28 03:09:28,930][106225] Updated weights for policy 1, policy_version 1102016 (0.0006) [2023-12-28 03:09:28,982][106226] Updated weights for policy 0, policy_version 1099214 (0.0009) [2023-12-28 03:09:28,984][106225] Updated weights for policy 1, policy_version 1102026 (0.0005) [2023-12-28 03:09:29,029][106226] Updated weights for policy 0, policy_version 1099224 (0.0009) [2023-12-28 03:09:29,653][106225] Updated weights for policy 1, policy_version 1102036 (0.0007) [2023-12-28 03:09:29,703][106225] Updated weights for policy 1, policy_version 1102046 (0.0010) [2023-12-28 03:09:29,750][106225] Updated weights for policy 1, policy_version 1102056 (0.0010) [2023-12-28 03:09:29,829][106226] Updated weights for policy 0, policy_version 1099234 (0.0008) [2023-12-28 03:09:29,903][106226] Updated weights for policy 0, policy_version 1099244 (0.0009) [2023-12-28 03:09:29,969][106226] Updated weights for policy 0, policy_version 1099254 (0.0009) [2023-12-28 03:09:30,515][106225] Updated weights for policy 1, policy_version 1102066 (0.0010) [2023-12-28 03:09:30,571][106225] Updated weights for policy 1, policy_version 1102076 (0.0008) [2023-12-28 03:09:30,634][106225] Updated weights for policy 1, policy_version 1102086 (0.0008) [2023-12-28 03:09:30,664][106226] Updated weights for policy 0, policy_version 1099264 (0.0010) [2023-12-28 03:09:30,685][106225] Updated weights for policy 1, policy_version 1102096 (0.0006) [2023-12-28 03:09:30,714][106226] Updated weights for policy 0, policy_version 1099274 (0.0010) [2023-12-28 03:09:30,767][106226] Updated weights for policy 0, policy_version 1099284 (0.0010) [2023-12-28 03:09:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 563658752. Throughput: 0: 9593.1, 1: 10181.6. Samples: 563649512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:31,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.857')] [2023-12-28 03:09:31,431][106226] Updated weights for policy 0, policy_version 1099294 (0.0008) [2023-12-28 03:09:31,472][106225] Updated weights for policy 1, policy_version 1102106 (0.0006) [2023-12-28 03:09:31,503][106226] Updated weights for policy 0, policy_version 1099304 (0.0008) [2023-12-28 03:09:31,533][106225] Updated weights for policy 1, policy_version 1102116 (0.0006) [2023-12-28 03:09:31,566][106226] Updated weights for policy 0, policy_version 1099314 (0.0006) [2023-12-28 03:09:31,597][106225] Updated weights for policy 1, policy_version 1102126 (0.0007) [2023-12-28 03:09:32,168][106226] Updated weights for policy 0, policy_version 1099324 (0.0007) [2023-12-28 03:09:32,230][106226] Updated weights for policy 0, policy_version 1099334 (0.0008) [2023-12-28 03:09:32,290][106226] Updated weights for policy 0, policy_version 1099344 (0.0008) [2023-12-28 03:09:32,411][106225] Updated weights for policy 1, policy_version 1102136 (0.0007) [2023-12-28 03:09:32,473][106225] Updated weights for policy 1, policy_version 1102146 (0.0007) [2023-12-28 03:09:32,537][106225] Updated weights for policy 1, policy_version 1102156 (0.0005) [2023-12-28 03:09:32,933][106226] Updated weights for policy 0, policy_version 1099354 (0.0007) [2023-12-28 03:09:32,983][106226] Updated weights for policy 0, policy_version 1099364 (0.0005) [2023-12-28 03:09:33,047][106226] Updated weights for policy 0, policy_version 1099374 (0.0005) [2023-12-28 03:09:33,113][106226] Updated weights for policy 0, policy_version 1099384 (0.0011) [2023-12-28 03:09:33,216][106225] Updated weights for policy 1, policy_version 1102166 (0.0008) [2023-12-28 03:09:33,267][106225] Updated weights for policy 1, policy_version 1102176 (0.0005) [2023-12-28 03:09:33,334][106225] Updated weights for policy 1, policy_version 1102186 (0.0006) [2023-12-28 03:09:33,668][106226] Updated weights for policy 0, policy_version 1099394 (0.0010) [2023-12-28 03:09:33,727][106226] Updated weights for policy 0, policy_version 1099404 (0.0010) [2023-12-28 03:09:33,786][106226] Updated weights for policy 0, policy_version 1099414 (0.0010) [2023-12-28 03:09:33,857][106225] Updated weights for policy 1, policy_version 1102196 (0.0006) [2023-12-28 03:09:33,914][106225] Updated weights for policy 1, policy_version 1102206 (0.0006) [2023-12-28 03:09:33,979][106225] Updated weights for policy 1, policy_version 1102216 (0.0008) [2023-12-28 03:09:34,524][106226] Updated weights for policy 0, policy_version 1099424 (0.0011) [2023-12-28 03:09:34,588][106226] Updated weights for policy 0, policy_version 1099434 (0.0011) [2023-12-28 03:09:34,655][106226] Updated weights for policy 0, policy_version 1099444 (0.0011) [2023-12-28 03:09:34,734][106225] Updated weights for policy 1, policy_version 1102226 (0.0008) [2023-12-28 03:09:34,783][106225] Updated weights for policy 1, policy_version 1102236 (0.0009) [2023-12-28 03:09:34,834][106225] Updated weights for policy 1, policy_version 1102246 (0.0007) [2023-12-28 03:09:34,888][106225] Updated weights for policy 1, policy_version 1102256 (0.0009) [2023-12-28 03:09:35,301][106226] Updated weights for policy 0, policy_version 1099454 (0.0011) [2023-12-28 03:09:35,359][106226] Updated weights for policy 0, policy_version 1099464 (0.0011) [2023-12-28 03:09:35,421][106226] Updated weights for policy 0, policy_version 1099474 (0.0011) [2023-12-28 03:09:35,664][106225] Updated weights for policy 1, policy_version 1102266 (0.0006) [2023-12-28 03:09:35,729][106225] Updated weights for policy 1, policy_version 1102276 (0.0008) [2023-12-28 03:09:35,792][106225] Updated weights for policy 1, policy_version 1102286 (0.0009) [2023-12-28 03:09:36,061][106226] Updated weights for policy 0, policy_version 1099484 (0.0010) [2023-12-28 03:09:36,111][106226] Updated weights for policy 0, policy_version 1099494 (0.0009) [2023-12-28 03:09:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 563757056. Throughput: 0: 9713.3, 1: 10156.0. Samples: 563770776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:36,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-5.011')] [2023-12-28 03:09:36,176][106226] Updated weights for policy 0, policy_version 1099504 (0.0010) [2023-12-28 03:09:36,395][106225] Updated weights for policy 1, policy_version 1102296 (0.0009) [2023-12-28 03:09:36,460][106225] Updated weights for policy 1, policy_version 1102306 (0.0011) [2023-12-28 03:09:36,522][106225] Updated weights for policy 1, policy_version 1102316 (0.0010) [2023-12-28 03:09:36,915][106226] Updated weights for policy 0, policy_version 1099514 (0.0011) [2023-12-28 03:09:36,980][106226] Updated weights for policy 0, policy_version 1099524 (0.0008) [2023-12-28 03:09:37,047][106226] Updated weights for policy 0, policy_version 1099534 (0.0008) [2023-12-28 03:09:37,104][106226] Updated weights for policy 0, policy_version 1099544 (0.0010) [2023-12-28 03:09:37,198][106225] Updated weights for policy 1, policy_version 1102326 (0.0007) [2023-12-28 03:09:37,261][106225] Updated weights for policy 1, policy_version 1102336 (0.0008) [2023-12-28 03:09:37,317][106225] Updated weights for policy 1, policy_version 1102346 (0.0007) [2023-12-28 03:09:37,795][106226] Updated weights for policy 0, policy_version 1099554 (0.0009) [2023-12-28 03:09:37,842][106226] Updated weights for policy 0, policy_version 1099564 (0.0008) [2023-12-28 03:09:37,893][106226] Updated weights for policy 0, policy_version 1099574 (0.0008) [2023-12-28 03:09:38,002][106225] Updated weights for policy 1, policy_version 1102356 (0.0008) [2023-12-28 03:09:38,049][106225] Updated weights for policy 1, policy_version 1102366 (0.0005) [2023-12-28 03:09:38,096][106225] Updated weights for policy 1, policy_version 1102376 (0.0007) [2023-12-28 03:09:38,644][106226] Updated weights for policy 0, policy_version 1099584 (0.0009) [2023-12-28 03:09:38,706][106226] Updated weights for policy 0, policy_version 1099594 (0.0008) [2023-12-28 03:09:38,763][106226] Updated weights for policy 0, policy_version 1099604 (0.0007) [2023-12-28 03:09:38,790][106225] Updated weights for policy 1, policy_version 1102386 (0.0008) [2023-12-28 03:09:38,848][106225] Updated weights for policy 1, policy_version 1102396 (0.0010) [2023-12-28 03:09:38,898][106225] Updated weights for policy 1, policy_version 1102406 (0.0009) [2023-12-28 03:09:38,953][106225] Updated weights for policy 1, policy_version 1102416 (0.0008) [2023-12-28 03:09:39,464][106226] Updated weights for policy 0, policy_version 1099614 (0.0006) [2023-12-28 03:09:39,535][106226] Updated weights for policy 0, policy_version 1099624 (0.0008) [2023-12-28 03:09:39,587][106226] Updated weights for policy 0, policy_version 1099634 (0.0006) [2023-12-28 03:09:39,709][106225] Updated weights for policy 1, policy_version 1102426 (0.0008) [2023-12-28 03:09:39,768][106225] Updated weights for policy 1, policy_version 1102436 (0.0008) [2023-12-28 03:09:39,838][106225] Updated weights for policy 1, policy_version 1102446 (0.0008) [2023-12-28 03:09:40,270][106226] Updated weights for policy 0, policy_version 1099644 (0.0006) [2023-12-28 03:09:40,339][106226] Updated weights for policy 0, policy_version 1099654 (0.0007) [2023-12-28 03:09:40,408][106226] Updated weights for policy 0, policy_version 1099664 (0.0009) [2023-12-28 03:09:40,533][106225] Updated weights for policy 1, policy_version 1102456 (0.0008) [2023-12-28 03:09:40,586][106225] Updated weights for policy 1, policy_version 1102466 (0.0009) [2023-12-28 03:09:40,634][106225] Updated weights for policy 1, policy_version 1102476 (0.0006) [2023-12-28 03:09:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 563855360. Throughput: 0: 9719.2, 1: 10150.9. Samples: 563830288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:41,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-5.051')] [2023-12-28 03:09:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001102480_282279936.pth... [2023-12-28 03:09:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001101296_281976832.pth [2023-12-28 03:09:41,198][106226] Updated weights for policy 0, policy_version 1099674 (0.0009) [2023-12-28 03:09:41,241][106225] Updated weights for policy 1, policy_version 1102486 (0.0007) [2023-12-28 03:09:41,265][106226] Updated weights for policy 0, policy_version 1099684 (0.0007) [2023-12-28 03:09:41,304][106225] Updated weights for policy 1, policy_version 1102496 (0.0007) [2023-12-28 03:09:41,327][106226] Updated weights for policy 0, policy_version 1099694 (0.0008) [2023-12-28 03:09:41,373][106225] Updated weights for policy 1, policy_version 1102506 (0.0010) [2023-12-28 03:09:41,399][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001099704_281583616.pth... [2023-12-28 03:09:41,402][106226] Updated weights for policy 0, policy_version 1099704 (0.0009) [2023-12-28 03:09:41,403][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001098552_281288704.pth [2023-12-28 03:09:42,134][106225] Updated weights for policy 1, policy_version 1102516 (0.0008) [2023-12-28 03:09:42,151][106226] Updated weights for policy 0, policy_version 1099714 (0.0009) [2023-12-28 03:09:42,197][106225] Updated weights for policy 1, policy_version 1102526 (0.0007) [2023-12-28 03:09:42,218][106226] Updated weights for policy 0, policy_version 1099724 (0.0008) [2023-12-28 03:09:42,259][106225] Updated weights for policy 1, policy_version 1102536 (0.0008) [2023-12-28 03:09:42,288][106226] Updated weights for policy 0, policy_version 1099734 (0.0007) [2023-12-28 03:09:42,920][106226] Updated weights for policy 0, policy_version 1099744 (0.0006) [2023-12-28 03:09:42,985][106226] Updated weights for policy 0, policy_version 1099754 (0.0005) [2023-12-28 03:09:43,038][106225] Updated weights for policy 1, policy_version 1102546 (0.0008) [2023-12-28 03:09:43,043][106226] Updated weights for policy 0, policy_version 1099764 (0.0005) [2023-12-28 03:09:43,101][106225] Updated weights for policy 1, policy_version 1102556 (0.0006) [2023-12-28 03:09:43,169][106225] Updated weights for policy 1, policy_version 1102566 (0.0005) [2023-12-28 03:09:43,234][106225] Updated weights for policy 1, policy_version 1102576 (0.0005) [2023-12-28 03:09:43,738][106226] Updated weights for policy 0, policy_version 1099774 (0.0007) [2023-12-28 03:09:43,775][106225] Updated weights for policy 1, policy_version 1102586 (0.0010) [2023-12-28 03:09:43,781][106226] Updated weights for policy 0, policy_version 1099784 (0.0005) [2023-12-28 03:09:43,832][106225] Updated weights for policy 1, policy_version 1102596 (0.0010) [2023-12-28 03:09:43,834][106226] Updated weights for policy 0, policy_version 1099794 (0.0006) [2023-12-28 03:09:43,882][106225] Updated weights for policy 1, policy_version 1102606 (0.0010) [2023-12-28 03:09:44,483][106225] Updated weights for policy 1, policy_version 1102616 (0.0006) [2023-12-28 03:09:44,530][106225] Updated weights for policy 1, policy_version 1102626 (0.0005) [2023-12-28 03:09:44,592][106226] Updated weights for policy 0, policy_version 1099804 (0.0006) [2023-12-28 03:09:44,596][106225] Updated weights for policy 1, policy_version 1102636 (0.0005) [2023-12-28 03:09:44,653][106226] Updated weights for policy 0, policy_version 1099814 (0.0005) [2023-12-28 03:09:44,715][106226] Updated weights for policy 0, policy_version 1099824 (0.0005) [2023-12-28 03:09:45,250][106225] Updated weights for policy 1, policy_version 1102646 (0.0007) [2023-12-28 03:09:45,309][106225] Updated weights for policy 1, policy_version 1102656 (0.0009) [2023-12-28 03:09:45,352][106226] Updated weights for policy 0, policy_version 1099834 (0.0007) [2023-12-28 03:09:45,367][106225] Updated weights for policy 1, policy_version 1102666 (0.0008) [2023-12-28 03:09:45,405][106226] Updated weights for policy 0, policy_version 1099844 (0.0006) [2023-12-28 03:09:45,454][106226] Updated weights for policy 0, policy_version 1099854 (0.0006) [2023-12-28 03:09:45,502][106226] Updated weights for policy 0, policy_version 1099864 (0.0005) [2023-12-28 03:09:46,069][106225] Updated weights for policy 1, policy_version 1102676 (0.0009) [2023-12-28 03:09:46,126][106225] Updated weights for policy 1, policy_version 1102686 (0.0010) [2023-12-28 03:09:46,168][106226] Updated weights for policy 0, policy_version 1099874 (0.0007) [2023-12-28 03:09:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 563953664. Throughput: 0: 9762.3, 1: 10187.1. Samples: 563949588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:46,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.926')] [2023-12-28 03:09:46,186][106225] Updated weights for policy 1, policy_version 1102696 (0.0010) [2023-12-28 03:09:46,222][106226] Updated weights for policy 0, policy_version 1099884 (0.0005) [2023-12-28 03:09:46,285][106226] Updated weights for policy 0, policy_version 1099894 (0.0008) [2023-12-28 03:09:46,796][106225] Updated weights for policy 1, policy_version 1102706 (0.0010) [2023-12-28 03:09:46,863][106225] Updated weights for policy 1, policy_version 1102716 (0.0010) [2023-12-28 03:09:46,909][106225] Updated weights for policy 1, policy_version 1102726 (0.0010) [2023-12-28 03:09:46,963][106225] Updated weights for policy 1, policy_version 1102736 (0.0010) [2023-12-28 03:09:47,049][106226] Updated weights for policy 0, policy_version 1099904 (0.0008) [2023-12-28 03:09:47,095][106226] Updated weights for policy 0, policy_version 1099914 (0.0008) [2023-12-28 03:09:47,142][106226] Updated weights for policy 0, policy_version 1099924 (0.0008) [2023-12-28 03:09:47,662][106225] Updated weights for policy 1, policy_version 1102746 (0.0005) [2023-12-28 03:09:47,725][106225] Updated weights for policy 1, policy_version 1102756 (0.0009) [2023-12-28 03:09:47,773][106225] Updated weights for policy 1, policy_version 1102766 (0.0010) [2023-12-28 03:09:47,939][106226] Updated weights for policy 0, policy_version 1099934 (0.0008) [2023-12-28 03:09:47,992][106226] Updated weights for policy 0, policy_version 1099944 (0.0008) [2023-12-28 03:09:48,045][106226] Updated weights for policy 0, policy_version 1099954 (0.0007) [2023-12-28 03:09:48,489][106225] Updated weights for policy 1, policy_version 1102776 (0.0011) [2023-12-28 03:09:48,550][106225] Updated weights for policy 1, policy_version 1102786 (0.0010) [2023-12-28 03:09:48,615][106225] Updated weights for policy 1, policy_version 1102796 (0.0011) [2023-12-28 03:09:48,830][106226] Updated weights for policy 0, policy_version 1099964 (0.0008) [2023-12-28 03:09:48,896][106226] Updated weights for policy 0, policy_version 1099974 (0.0008) [2023-12-28 03:09:48,954][106226] Updated weights for policy 0, policy_version 1099984 (0.0008) [2023-12-28 03:09:49,357][106225] Updated weights for policy 1, policy_version 1102806 (0.0008) [2023-12-28 03:09:49,420][106225] Updated weights for policy 1, policy_version 1102816 (0.0008) [2023-12-28 03:09:49,482][106225] Updated weights for policy 1, policy_version 1102826 (0.0008) [2023-12-28 03:09:49,693][106226] Updated weights for policy 0, policy_version 1099994 (0.0008) [2023-12-28 03:09:49,761][106226] Updated weights for policy 0, policy_version 1100004 (0.0005) [2023-12-28 03:09:49,816][106226] Updated weights for policy 0, policy_version 1100014 (0.0007) [2023-12-28 03:09:49,894][106226] Updated weights for policy 0, policy_version 1100024 (0.0008) [2023-12-28 03:09:50,212][106225] Updated weights for policy 1, policy_version 1102836 (0.0008) [2023-12-28 03:09:50,279][106225] Updated weights for policy 1, policy_version 1102846 (0.0008) [2023-12-28 03:09:50,341][106225] Updated weights for policy 1, policy_version 1102856 (0.0008) [2023-12-28 03:09:50,629][106226] Updated weights for policy 0, policy_version 1100034 (0.0008) [2023-12-28 03:09:50,695][106226] Updated weights for policy 0, policy_version 1100044 (0.0008) [2023-12-28 03:09:50,766][106226] Updated weights for policy 0, policy_version 1100054 (0.0009) [2023-12-28 03:09:51,022][106225] Updated weights for policy 1, policy_version 1102866 (0.0008) [2023-12-28 03:09:51,089][106225] Updated weights for policy 1, policy_version 1102876 (0.0008) [2023-12-28 03:09:51,155][106225] Updated weights for policy 1, policy_version 1102886 (0.0008) [2023-12-28 03:09:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 564051968. Throughput: 0: 9693.3, 1: 10185.3. Samples: 564064656. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:51,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-4.801')] [2023-12-28 03:09:51,212][106225] Updated weights for policy 1, policy_version 1102896 (0.0008) [2023-12-28 03:09:51,540][106226] Updated weights for policy 0, policy_version 1100064 (0.0008) [2023-12-28 03:09:51,595][106226] Updated weights for policy 0, policy_version 1100074 (0.0008) [2023-12-28 03:09:51,667][106226] Updated weights for policy 0, policy_version 1100084 (0.0008) [2023-12-28 03:09:51,964][106225] Updated weights for policy 1, policy_version 1102906 (0.0005) [2023-12-28 03:09:52,012][106225] Updated weights for policy 1, policy_version 1102916 (0.0009) [2023-12-28 03:09:52,073][106225] Updated weights for policy 1, policy_version 1102926 (0.0010) [2023-12-28 03:09:52,420][106226] Updated weights for policy 0, policy_version 1100094 (0.0006) [2023-12-28 03:09:52,482][106226] Updated weights for policy 0, policy_version 1100104 (0.0009) [2023-12-28 03:09:52,546][106226] Updated weights for policy 0, policy_version 1100114 (0.0009) [2023-12-28 03:09:52,767][106225] Updated weights for policy 1, policy_version 1102936 (0.0008) [2023-12-28 03:09:52,823][106225] Updated weights for policy 1, policy_version 1102946 (0.0007) [2023-12-28 03:09:52,881][106225] Updated weights for policy 1, policy_version 1102956 (0.0010) [2023-12-28 03:09:53,183][106226] Updated weights for policy 0, policy_version 1100124 (0.0007) [2023-12-28 03:09:53,235][106226] Updated weights for policy 0, policy_version 1100134 (0.0007) [2023-12-28 03:09:53,289][106226] Updated weights for policy 0, policy_version 1100144 (0.0008) [2023-12-28 03:09:53,585][106225] Updated weights for policy 1, policy_version 1102966 (0.0010) [2023-12-28 03:09:53,639][106225] Updated weights for policy 1, policy_version 1102976 (0.0010) [2023-12-28 03:09:53,688][106225] Updated weights for policy 1, policy_version 1102986 (0.0010) [2023-12-28 03:09:53,984][106226] Updated weights for policy 0, policy_version 1100154 (0.0008) [2023-12-28 03:09:54,033][106226] Updated weights for policy 0, policy_version 1100164 (0.0008) [2023-12-28 03:09:54,078][106226] Updated weights for policy 0, policy_version 1100174 (0.0008) [2023-12-28 03:09:54,132][106226] Updated weights for policy 0, policy_version 1100184 (0.0007) [2023-12-28 03:09:54,355][106225] Updated weights for policy 1, policy_version 1102996 (0.0008) [2023-12-28 03:09:54,416][106225] Updated weights for policy 1, policy_version 1103006 (0.0005) [2023-12-28 03:09:54,470][106225] Updated weights for policy 1, policy_version 1103016 (0.0006) [2023-12-28 03:09:54,973][106226] Updated weights for policy 0, policy_version 1100194 (0.0008) [2023-12-28 03:09:55,033][106226] Updated weights for policy 0, policy_version 1100204 (0.0007) [2023-12-28 03:09:55,042][106225] Updated weights for policy 1, policy_version 1103026 (0.0006) [2023-12-28 03:09:55,089][106226] Updated weights for policy 0, policy_version 1100214 (0.0006) [2023-12-28 03:09:55,106][106225] Updated weights for policy 1, policy_version 1103036 (0.0010) [2023-12-28 03:09:55,162][106225] Updated weights for policy 1, policy_version 1103046 (0.0010) [2023-12-28 03:09:55,219][106225] Updated weights for policy 1, policy_version 1103056 (0.0010) [2023-12-28 03:09:55,799][106225] Updated weights for policy 1, policy_version 1103066 (0.0005) [2023-12-28 03:09:55,850][106225] Updated weights for policy 1, policy_version 1103076 (0.0005) [2023-12-28 03:09:55,860][106226] Updated weights for policy 0, policy_version 1100224 (0.0010) [2023-12-28 03:09:55,903][106225] Updated weights for policy 1, policy_version 1103086 (0.0005) [2023-12-28 03:09:55,911][106226] Updated weights for policy 0, policy_version 1100234 (0.0010) [2023-12-28 03:09:55,958][106226] Updated weights for policy 0, policy_version 1100244 (0.0010) [2023-12-28 03:09:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 564158464. Throughput: 0: 9636.3, 1: 10146.0. Samples: 564123204. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:09:56,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.966')] [2023-12-28 03:09:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001103088_282435584.pth... [2023-12-28 03:09:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001100248_281722880.pth... [2023-12-28 03:09:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001101904_282132480.pth [2023-12-28 03:09:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001099128_281436160.pth [2023-12-28 03:09:56,487][106225] Updated weights for policy 1, policy_version 1103096 (0.0005) [2023-12-28 03:09:56,544][106225] Updated weights for policy 1, policy_version 1103106 (0.0009) [2023-12-28 03:09:56,607][106225] Updated weights for policy 1, policy_version 1103116 (0.0005) [2023-12-28 03:09:56,666][106226] Updated weights for policy 0, policy_version 1100254 (0.0007) [2023-12-28 03:09:56,719][106226] Updated weights for policy 0, policy_version 1100264 (0.0005) [2023-12-28 03:09:56,772][106226] Updated weights for policy 0, policy_version 1100274 (0.0005) [2023-12-28 03:09:57,255][106225] Updated weights for policy 1, policy_version 1103126 (0.0009) [2023-12-28 03:09:57,316][106225] Updated weights for policy 1, policy_version 1103136 (0.0010) [2023-12-28 03:09:57,375][106225] Updated weights for policy 1, policy_version 1103146 (0.0010) [2023-12-28 03:09:57,439][106226] Updated weights for policy 0, policy_version 1100284 (0.0008) [2023-12-28 03:09:57,499][106226] Updated weights for policy 0, policy_version 1100294 (0.0008) [2023-12-28 03:09:57,552][106226] Updated weights for policy 0, policy_version 1100304 (0.0007) [2023-12-28 03:09:58,067][106225] Updated weights for policy 1, policy_version 1103156 (0.0010) [2023-12-28 03:09:58,123][106225] Updated weights for policy 1, policy_version 1103166 (0.0010) [2023-12-28 03:09:58,175][106225] Updated weights for policy 1, policy_version 1103176 (0.0010) [2023-12-28 03:09:58,252][106226] Updated weights for policy 0, policy_version 1100314 (0.0009) [2023-12-28 03:09:58,311][106226] Updated weights for policy 0, policy_version 1100324 (0.0011) [2023-12-28 03:09:58,388][106226] Updated weights for policy 0, policy_version 1100334 (0.0009) [2023-12-28 03:09:58,455][106226] Updated weights for policy 0, policy_version 1100344 (0.0008) [2023-12-28 03:09:59,012][106225] Updated weights for policy 1, policy_version 1103186 (0.0010) [2023-12-28 03:09:59,078][106225] Updated weights for policy 1, policy_version 1103196 (0.0008) [2023-12-28 03:09:59,149][106225] Updated weights for policy 1, policy_version 1103206 (0.0007) [2023-12-28 03:09:59,220][106225] Updated weights for policy 1, policy_version 1103216 (0.0007) [2023-12-28 03:09:59,236][106226] Updated weights for policy 0, policy_version 1100354 (0.0009) [2023-12-28 03:09:59,308][106226] Updated weights for policy 0, policy_version 1100364 (0.0008) [2023-12-28 03:09:59,380][106226] Updated weights for policy 0, policy_version 1100374 (0.0008) [2023-12-28 03:09:59,975][106225] Updated weights for policy 1, policy_version 1103226 (0.0008) [2023-12-28 03:10:00,035][106225] Updated weights for policy 1, policy_version 1103236 (0.0007) [2023-12-28 03:10:00,056][106226] Updated weights for policy 0, policy_version 1100384 (0.0008) [2023-12-28 03:10:00,089][106225] Updated weights for policy 1, policy_version 1103246 (0.0006) [2023-12-28 03:10:00,123][106226] Updated weights for policy 0, policy_version 1100394 (0.0008) [2023-12-28 03:10:00,188][106226] Updated weights for policy 0, policy_version 1100404 (0.0008) [2023-12-28 03:10:00,834][106225] Updated weights for policy 1, policy_version 1103256 (0.0008) [2023-12-28 03:10:00,850][106226] Updated weights for policy 0, policy_version 1100414 (0.0007) [2023-12-28 03:10:00,880][106225] Updated weights for policy 1, policy_version 1103266 (0.0005) [2023-12-28 03:10:00,900][106226] Updated weights for policy 0, policy_version 1100424 (0.0008) [2023-12-28 03:10:00,926][106225] Updated weights for policy 1, policy_version 1103276 (0.0005) [2023-12-28 03:10:00,948][106226] Updated weights for policy 0, policy_version 1100434 (0.0009) [2023-12-28 03:10:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 564256768. Throughput: 0: 9631.2, 1: 10157.0. Samples: 564242328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:01,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.832')] [2023-12-28 03:10:01,571][106225] Updated weights for policy 1, policy_version 1103286 (0.0005) [2023-12-28 03:10:01,637][106225] Updated weights for policy 1, policy_version 1103296 (0.0009) [2023-12-28 03:10:01,696][106225] Updated weights for policy 1, policy_version 1103306 (0.0006) [2023-12-28 03:10:01,758][106226] Updated weights for policy 0, policy_version 1100444 (0.0008) [2023-12-28 03:10:01,813][106226] Updated weights for policy 0, policy_version 1100454 (0.0006) [2023-12-28 03:10:01,863][106226] Updated weights for policy 0, policy_version 1100464 (0.0007) [2023-12-28 03:10:02,401][106225] Updated weights for policy 1, policy_version 1103316 (0.0009) [2023-12-28 03:10:02,465][106225] Updated weights for policy 1, policy_version 1103326 (0.0010) [2023-12-28 03:10:02,528][106225] Updated weights for policy 1, policy_version 1103336 (0.0010) [2023-12-28 03:10:02,601][106226] Updated weights for policy 0, policy_version 1100474 (0.0008) [2023-12-28 03:10:02,652][106226] Updated weights for policy 0, policy_version 1100484 (0.0008) [2023-12-28 03:10:02,717][106226] Updated weights for policy 0, policy_version 1100494 (0.0008) [2023-12-28 03:10:02,771][106226] Updated weights for policy 0, policy_version 1100504 (0.0007) [2023-12-28 03:10:03,184][106225] Updated weights for policy 1, policy_version 1103346 (0.0009) [2023-12-28 03:10:03,245][106225] Updated weights for policy 1, policy_version 1103356 (0.0005) [2023-12-28 03:10:03,301][106225] Updated weights for policy 1, policy_version 1103366 (0.0005) [2023-12-28 03:10:03,360][106225] Updated weights for policy 1, policy_version 1103376 (0.0008) [2023-12-28 03:10:03,433][106226] Updated weights for policy 0, policy_version 1100514 (0.0009) [2023-12-28 03:10:03,489][106226] Updated weights for policy 0, policy_version 1100524 (0.0006) [2023-12-28 03:10:03,546][106226] Updated weights for policy 0, policy_version 1100534 (0.0006) [2023-12-28 03:10:04,014][106225] Updated weights for policy 1, policy_version 1103386 (0.0007) [2023-12-28 03:10:04,078][106225] Updated weights for policy 1, policy_version 1103396 (0.0006) [2023-12-28 03:10:04,141][106225] Updated weights for policy 1, policy_version 1103406 (0.0009) [2023-12-28 03:10:04,167][106226] Updated weights for policy 0, policy_version 1100544 (0.0005) [2023-12-28 03:10:04,234][106226] Updated weights for policy 0, policy_version 1100554 (0.0006) [2023-12-28 03:10:04,298][106226] Updated weights for policy 0, policy_version 1100564 (0.0006) [2023-12-28 03:10:04,757][106225] Updated weights for policy 1, policy_version 1103416 (0.0010) [2023-12-28 03:10:04,813][106225] Updated weights for policy 1, policy_version 1103426 (0.0010) [2023-12-28 03:10:04,878][106225] Updated weights for policy 1, policy_version 1103436 (0.0007) [2023-12-28 03:10:04,910][106226] Updated weights for policy 0, policy_version 1100574 (0.0008) [2023-12-28 03:10:04,963][106226] Updated weights for policy 0, policy_version 1100584 (0.0009) [2023-12-28 03:10:05,025][106226] Updated weights for policy 0, policy_version 1100594 (0.0009) [2023-12-28 03:10:05,517][106225] Updated weights for policy 1, policy_version 1103446 (0.0006) [2023-12-28 03:10:05,577][106225] Updated weights for policy 1, policy_version 1103456 (0.0008) [2023-12-28 03:10:05,632][106225] Updated weights for policy 1, policy_version 1103466 (0.0008) [2023-12-28 03:10:05,745][106226] Updated weights for policy 0, policy_version 1100604 (0.0007) [2023-12-28 03:10:05,807][106226] Updated weights for policy 0, policy_version 1100614 (0.0005) [2023-12-28 03:10:05,858][106226] Updated weights for policy 0, policy_version 1100624 (0.0005) [2023-12-28 03:10:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 564355072. Throughput: 0: 9767.1, 1: 10180.3. Samples: 564364080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:06,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.192')] [2023-12-28 03:10:06,354][106225] Updated weights for policy 1, policy_version 1103476 (0.0007) [2023-12-28 03:10:06,422][106225] Updated weights for policy 1, policy_version 1103486 (0.0005) [2023-12-28 03:10:06,485][106225] Updated weights for policy 1, policy_version 1103496 (0.0008) [2023-12-28 03:10:06,554][106226] Updated weights for policy 0, policy_version 1100634 (0.0006) [2023-12-28 03:10:06,621][106226] Updated weights for policy 0, policy_version 1100644 (0.0008) [2023-12-28 03:10:06,680][106226] Updated weights for policy 0, policy_version 1100654 (0.0009) [2023-12-28 03:10:06,741][106226] Updated weights for policy 0, policy_version 1100664 (0.0009) [2023-12-28 03:10:07,077][106225] Updated weights for policy 1, policy_version 1103506 (0.0006) [2023-12-28 03:10:07,128][106225] Updated weights for policy 1, policy_version 1103516 (0.0008) [2023-12-28 03:10:07,178][106225] Updated weights for policy 1, policy_version 1103526 (0.0005) [2023-12-28 03:10:07,235][106225] Updated weights for policy 1, policy_version 1103536 (0.0006) [2023-12-28 03:10:07,548][106226] Updated weights for policy 0, policy_version 1100674 (0.0008) [2023-12-28 03:10:07,603][106226] Updated weights for policy 0, policy_version 1100684 (0.0009) [2023-12-28 03:10:07,660][106226] Updated weights for policy 0, policy_version 1100694 (0.0008) [2023-12-28 03:10:07,912][106225] Updated weights for policy 1, policy_version 1103546 (0.0008) [2023-12-28 03:10:07,976][106225] Updated weights for policy 1, policy_version 1103556 (0.0009) [2023-12-28 03:10:08,036][106225] Updated weights for policy 1, policy_version 1103566 (0.0008) [2023-12-28 03:10:08,355][106226] Updated weights for policy 0, policy_version 1100704 (0.0009) [2023-12-28 03:10:08,416][106226] Updated weights for policy 0, policy_version 1100715 (0.0009) [2023-12-28 03:10:08,469][106226] Updated weights for policy 0, policy_version 1100725 (0.0009) [2023-12-28 03:10:08,757][106225] Updated weights for policy 1, policy_version 1103576 (0.0006) [2023-12-28 03:10:08,824][106225] Updated weights for policy 1, policy_version 1103586 (0.0005) [2023-12-28 03:10:08,894][106225] Updated weights for policy 1, policy_version 1103596 (0.0005) [2023-12-28 03:10:09,323][106226] Updated weights for policy 0, policy_version 1100735 (0.0009) [2023-12-28 03:10:09,393][106226] Updated weights for policy 0, policy_version 1100745 (0.0009) [2023-12-28 03:10:09,462][106226] Updated weights for policy 0, policy_version 1100755 (0.0007) [2023-12-28 03:10:09,466][106225] Updated weights for policy 1, policy_version 1103606 (0.0007) [2023-12-28 03:10:09,522][106225] Updated weights for policy 1, policy_version 1103616 (0.0008) [2023-12-28 03:10:09,570][106225] Updated weights for policy 1, policy_version 1103626 (0.0008) [2023-12-28 03:10:10,263][106226] Updated weights for policy 0, policy_version 1100765 (0.0008) [2023-12-28 03:10:10,307][106225] Updated weights for policy 1, policy_version 1103636 (0.0006) [2023-12-28 03:10:10,321][106226] Updated weights for policy 0, policy_version 1100775 (0.0008) [2023-12-28 03:10:10,361][106225] Updated weights for policy 1, policy_version 1103646 (0.0005) [2023-12-28 03:10:10,379][106226] Updated weights for policy 0, policy_version 1100785 (0.0008) [2023-12-28 03:10:10,421][106225] Updated weights for policy 1, policy_version 1103656 (0.0010) [2023-12-28 03:10:11,060][106225] Updated weights for policy 1, policy_version 1103666 (0.0009) [2023-12-28 03:10:11,088][106226] Updated weights for policy 0, policy_version 1100795 (0.0006) [2023-12-28 03:10:11,123][106225] Updated weights for policy 1, policy_version 1103676 (0.0010) [2023-12-28 03:10:11,155][106226] Updated weights for policy 0, policy_version 1100805 (0.0007) [2023-12-28 03:10:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 564445184. Throughput: 0: 9737.0, 1: 10236.8. Samples: 564421896. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:11,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.665')] [2023-12-28 03:10:11,191][106225] Updated weights for policy 1, policy_version 1103686 (0.0010) [2023-12-28 03:10:11,223][106226] Updated weights for policy 0, policy_version 1100815 (0.0006) [2023-12-28 03:10:11,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001103696_282591232.pth... [2023-12-28 03:10:11,255][106225] Updated weights for policy 1, policy_version 1103696 (0.0010) [2023-12-28 03:10:11,258][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001102480_282279936.pth [2023-12-28 03:10:11,289][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001100824_281870336.pth... [2023-12-28 03:10:11,294][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001099704_281583616.pth [2023-12-28 03:10:11,944][106226] Updated weights for policy 0, policy_version 1100825 (0.0009) [2023-12-28 03:10:12,002][106225] Updated weights for policy 1, policy_version 1103706 (0.0010) [2023-12-28 03:10:12,009][106226] Updated weights for policy 0, policy_version 1100835 (0.0010) [2023-12-28 03:10:12,057][106225] Updated weights for policy 1, policy_version 1103716 (0.0007) [2023-12-28 03:10:12,067][106226] Updated weights for policy 0, policy_version 1100845 (0.0007) [2023-12-28 03:10:12,117][106225] Updated weights for policy 1, policy_version 1103726 (0.0006) [2023-12-28 03:10:12,129][106226] Updated weights for policy 0, policy_version 1100855 (0.0008) [2023-12-28 03:10:12,847][106226] Updated weights for policy 0, policy_version 1100865 (0.0008) [2023-12-28 03:10:12,847][106225] Updated weights for policy 1, policy_version 1103736 (0.0006) [2023-12-28 03:10:12,907][106226] Updated weights for policy 0, policy_version 1100875 (0.0008) [2023-12-28 03:10:12,916][106225] Updated weights for policy 1, policy_version 1103746 (0.0005) [2023-12-28 03:10:12,965][106226] Updated weights for policy 0, policy_version 1100885 (0.0006) [2023-12-28 03:10:12,979][106225] Updated weights for policy 1, policy_version 1103756 (0.0007) [2023-12-28 03:10:13,576][106226] Updated weights for policy 0, policy_version 1100895 (0.0008) [2023-12-28 03:10:13,595][106225] Updated weights for policy 1, policy_version 1103766 (0.0008) [2023-12-28 03:10:13,631][106226] Updated weights for policy 0, policy_version 1100905 (0.0008) [2023-12-28 03:10:13,651][106225] Updated weights for policy 1, policy_version 1103776 (0.0008) [2023-12-28 03:10:13,689][106226] Updated weights for policy 0, policy_version 1100915 (0.0007) [2023-12-28 03:10:13,704][106225] Updated weights for policy 1, policy_version 1103786 (0.0007) [2023-12-28 03:10:14,292][106225] Updated weights for policy 1, policy_version 1103796 (0.0009) [2023-12-28 03:10:14,347][106225] Updated weights for policy 1, policy_version 1103806 (0.0010) [2023-12-28 03:10:14,403][106225] Updated weights for policy 1, policy_version 1103816 (0.0010) [2023-12-28 03:10:14,460][106226] Updated weights for policy 0, policy_version 1100925 (0.0007) [2023-12-28 03:10:14,509][106226] Updated weights for policy 0, policy_version 1100935 (0.0008) [2023-12-28 03:10:14,561][106226] Updated weights for policy 0, policy_version 1100945 (0.0009) [2023-12-28 03:10:14,974][106225] Updated weights for policy 1, policy_version 1103826 (0.0005) [2023-12-28 03:10:15,028][106225] Updated weights for policy 1, policy_version 1103836 (0.0005) [2023-12-28 03:10:15,091][106225] Updated weights for policy 1, policy_version 1103846 (0.0006) [2023-12-28 03:10:15,155][106225] Updated weights for policy 1, policy_version 1103856 (0.0006) [2023-12-28 03:10:15,374][106226] Updated weights for policy 0, policy_version 1100955 (0.0009) [2023-12-28 03:10:15,430][106226] Updated weights for policy 0, policy_version 1100965 (0.0008) [2023-12-28 03:10:15,482][106226] Updated weights for policy 0, policy_version 1100975 (0.0008) [2023-12-28 03:10:15,767][106225] Updated weights for policy 1, policy_version 1103866 (0.0006) [2023-12-28 03:10:15,838][106225] Updated weights for policy 1, policy_version 1103876 (0.0006) [2023-12-28 03:10:15,899][106225] Updated weights for policy 1, policy_version 1103886 (0.0007) [2023-12-28 03:10:16,174][106226] Updated weights for policy 0, policy_version 1100985 (0.0008) [2023-12-28 03:10:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 564551680. Throughput: 0: 9695.2, 1: 10110.1. Samples: 564540752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:16,176][105115] Avg episode reward: [(0, '-4.333'), (1, '-4.701')] [2023-12-28 03:10:16,236][106226] Updated weights for policy 0, policy_version 1100995 (0.0009) [2023-12-28 03:10:16,297][106226] Updated weights for policy 0, policy_version 1101005 (0.0009) [2023-12-28 03:10:16,361][106226] Updated weights for policy 0, policy_version 1101015 (0.0009) [2023-12-28 03:10:16,501][106225] Updated weights for policy 1, policy_version 1103896 (0.0008) [2023-12-28 03:10:16,556][106225] Updated weights for policy 1, policy_version 1103906 (0.0007) [2023-12-28 03:10:16,614][106225] Updated weights for policy 1, policy_version 1103916 (0.0009) [2023-12-28 03:10:17,136][106226] Updated weights for policy 0, policy_version 1101025 (0.0009) [2023-12-28 03:10:17,198][106226] Updated weights for policy 0, policy_version 1101035 (0.0010) [2023-12-28 03:10:17,257][106226] Updated weights for policy 0, policy_version 1101045 (0.0007) [2023-12-28 03:10:17,259][106225] Updated weights for policy 1, policy_version 1103926 (0.0009) [2023-12-28 03:10:17,316][106225] Updated weights for policy 1, policy_version 1103936 (0.0010) [2023-12-28 03:10:17,366][106225] Updated weights for policy 1, policy_version 1103946 (0.0010) [2023-12-28 03:10:18,007][106226] Updated weights for policy 0, policy_version 1101055 (0.0007) [2023-12-28 03:10:18,026][106225] Updated weights for policy 1, policy_version 1103956 (0.0008) [2023-12-28 03:10:18,065][106226] Updated weights for policy 0, policy_version 1101065 (0.0007) [2023-12-28 03:10:18,085][106225] Updated weights for policy 1, policy_version 1103966 (0.0007) [2023-12-28 03:10:18,129][106226] Updated weights for policy 0, policy_version 1101075 (0.0007) [2023-12-28 03:10:18,140][106225] Updated weights for policy 1, policy_version 1103976 (0.0007) [2023-12-28 03:10:18,821][106226] Updated weights for policy 0, policy_version 1101085 (0.0008) [2023-12-28 03:10:18,863][106225] Updated weights for policy 1, policy_version 1103986 (0.0008) [2023-12-28 03:10:18,880][106226] Updated weights for policy 0, policy_version 1101095 (0.0007) [2023-12-28 03:10:18,917][106225] Updated weights for policy 1, policy_version 1103996 (0.0009) [2023-12-28 03:10:18,937][106226] Updated weights for policy 0, policy_version 1101105 (0.0007) [2023-12-28 03:10:18,970][106225] Updated weights for policy 1, policy_version 1104006 (0.0008) [2023-12-28 03:10:19,035][106225] Updated weights for policy 1, policy_version 1104016 (0.0008) [2023-12-28 03:10:19,737][106226] Updated weights for policy 0, policy_version 1101115 (0.0007) [2023-12-28 03:10:19,797][106226] Updated weights for policy 0, policy_version 1101125 (0.0008) [2023-12-28 03:10:19,866][106225] Updated weights for policy 1, policy_version 1104026 (0.0012) [2023-12-28 03:10:19,874][106226] Updated weights for policy 0, policy_version 1101135 (0.0009) [2023-12-28 03:10:19,942][106225] Updated weights for policy 1, policy_version 1104036 (0.0009) [2023-12-28 03:10:19,999][106225] Updated weights for policy 1, policy_version 1104046 (0.0008) [2023-12-28 03:10:20,689][106226] Updated weights for policy 0, policy_version 1101145 (0.0009) [2023-12-28 03:10:20,757][106226] Updated weights for policy 0, policy_version 1101155 (0.0007) [2023-12-28 03:10:20,768][106225] Updated weights for policy 1, policy_version 1104056 (0.0009) [2023-12-28 03:10:20,820][106226] Updated weights for policy 0, policy_version 1101165 (0.0007) [2023-12-28 03:10:20,830][106225] Updated weights for policy 1, policy_version 1104066 (0.0008) [2023-12-28 03:10:20,883][106226] Updated weights for policy 0, policy_version 1101175 (0.0007) [2023-12-28 03:10:20,894][106225] Updated weights for policy 1, policy_version 1104076 (0.0007) [2023-12-28 03:10:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 564649984. Throughput: 0: 9519.5, 1: 10148.4. Samples: 564655832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:21,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-4.827')] [2023-12-28 03:10:21,672][106225] Updated weights for policy 1, policy_version 1104086 (0.0008) [2023-12-28 03:10:21,701][106226] Updated weights for policy 0, policy_version 1101185 (0.0008) [2023-12-28 03:10:21,740][106225] Updated weights for policy 1, policy_version 1104096 (0.0007) [2023-12-28 03:10:21,771][106226] Updated weights for policy 0, policy_version 1101195 (0.0008) [2023-12-28 03:10:21,801][106225] Updated weights for policy 1, policy_version 1104106 (0.0007) [2023-12-28 03:10:21,834][106226] Updated weights for policy 0, policy_version 1101205 (0.0008) [2023-12-28 03:10:22,536][106226] Updated weights for policy 0, policy_version 1101215 (0.0008) [2023-12-28 03:10:22,555][106225] Updated weights for policy 1, policy_version 1104116 (0.0008) [2023-12-28 03:10:22,597][106226] Updated weights for policy 0, policy_version 1101225 (0.0006) [2023-12-28 03:10:22,617][106225] Updated weights for policy 1, policy_version 1104126 (0.0008) [2023-12-28 03:10:22,664][106226] Updated weights for policy 0, policy_version 1101235 (0.0007) [2023-12-28 03:10:22,678][106225] Updated weights for policy 1, policy_version 1104136 (0.0008) [2023-12-28 03:10:23,402][106226] Updated weights for policy 0, policy_version 1101245 (0.0008) [2023-12-28 03:10:23,410][106225] Updated weights for policy 1, policy_version 1104146 (0.0008) [2023-12-28 03:10:23,463][106226] Updated weights for policy 0, policy_version 1101255 (0.0006) [2023-12-28 03:10:23,465][106225] Updated weights for policy 1, policy_version 1104156 (0.0007) [2023-12-28 03:10:23,518][106226] Updated weights for policy 0, policy_version 1101265 (0.0006) [2023-12-28 03:10:23,521][106225] Updated weights for policy 1, policy_version 1104166 (0.0007) [2023-12-28 03:10:23,576][106225] Updated weights for policy 1, policy_version 1104176 (0.0006) [2023-12-28 03:10:24,254][106225] Updated weights for policy 1, policy_version 1104186 (0.0008) [2023-12-28 03:10:24,268][106226] Updated weights for policy 0, policy_version 1101275 (0.0006) [2023-12-28 03:10:24,306][106225] Updated weights for policy 1, policy_version 1104196 (0.0006) [2023-12-28 03:10:24,327][106226] Updated weights for policy 0, policy_version 1101285 (0.0007) [2023-12-28 03:10:24,358][106225] Updated weights for policy 1, policy_version 1104206 (0.0007) [2023-12-28 03:10:24,387][106226] Updated weights for policy 0, policy_version 1101295 (0.0008) [2023-12-28 03:10:24,991][106225] Updated weights for policy 1, policy_version 1104216 (0.0008) [2023-12-28 03:10:25,057][106225] Updated weights for policy 1, policy_version 1104226 (0.0005) [2023-12-28 03:10:25,118][106225] Updated weights for policy 1, policy_version 1104236 (0.0005) [2023-12-28 03:10:25,149][106226] Updated weights for policy 0, policy_version 1101305 (0.0006) [2023-12-28 03:10:25,211][106226] Updated weights for policy 0, policy_version 1101315 (0.0008) [2023-12-28 03:10:25,275][106226] Updated weights for policy 0, policy_version 1101325 (0.0009) [2023-12-28 03:10:25,331][106226] Updated weights for policy 0, policy_version 1101335 (0.0009) [2023-12-28 03:10:25,702][106225] Updated weights for policy 1, policy_version 1104246 (0.0008) [2023-12-28 03:10:25,772][106225] Updated weights for policy 1, policy_version 1104256 (0.0009) [2023-12-28 03:10:25,819][106225] Updated weights for policy 1, policy_version 1104266 (0.0008) [2023-12-28 03:10:26,101][106226] Updated weights for policy 0, policy_version 1101345 (0.0011) [2023-12-28 03:10:26,151][106226] Updated weights for policy 0, policy_version 1101355 (0.0010) [2023-12-28 03:10:26,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 564740096. Throughput: 0: 9499.0, 1: 10075.7. Samples: 564711148. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:26,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.765')] [2023-12-28 03:10:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001104272_282738688.pth... [2023-12-28 03:10:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001103088_282435584.pth [2023-12-28 03:10:26,204][106226] Updated weights for policy 0, policy_version 1101365 (0.0010) [2023-12-28 03:10:26,219][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001101368_282009600.pth... [2023-12-28 03:10:26,222][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001100248_281722880.pth [2023-12-28 03:10:26,541][106225] Updated weights for policy 1, policy_version 1104276 (0.0007) [2023-12-28 03:10:26,590][106225] Updated weights for policy 1, policy_version 1104286 (0.0007) [2023-12-28 03:10:26,646][106225] Updated weights for policy 1, policy_version 1104296 (0.0007) [2023-12-28 03:10:26,892][106226] Updated weights for policy 0, policy_version 1101375 (0.0010) [2023-12-28 03:10:26,937][106226] Updated weights for policy 0, policy_version 1101385 (0.0010) [2023-12-28 03:10:26,984][106226] Updated weights for policy 0, policy_version 1101395 (0.0010) [2023-12-28 03:10:27,204][106225] Updated weights for policy 1, policy_version 1104306 (0.0007) [2023-12-28 03:10:27,250][106225] Updated weights for policy 1, policy_version 1104316 (0.0005) [2023-12-28 03:10:27,299][106225] Updated weights for policy 1, policy_version 1104326 (0.0005) [2023-12-28 03:10:27,350][106225] Updated weights for policy 1, policy_version 1104336 (0.0007) [2023-12-28 03:10:27,659][106226] Updated weights for policy 0, policy_version 1101405 (0.0009) [2023-12-28 03:10:27,714][106226] Updated weights for policy 0, policy_version 1101415 (0.0008) [2023-12-28 03:10:27,774][106226] Updated weights for policy 0, policy_version 1101425 (0.0006) [2023-12-28 03:10:27,963][106225] Updated weights for policy 1, policy_version 1104346 (0.0006) [2023-12-28 03:10:28,023][106225] Updated weights for policy 1, policy_version 1104356 (0.0007) [2023-12-28 03:10:28,072][106225] Updated weights for policy 1, policy_version 1104366 (0.0009) [2023-12-28 03:10:28,366][106226] Updated weights for policy 0, policy_version 1101435 (0.0006) [2023-12-28 03:10:28,423][106226] Updated weights for policy 0, policy_version 1101445 (0.0008) [2023-12-28 03:10:28,469][106226] Updated weights for policy 0, policy_version 1101455 (0.0009) [2023-12-28 03:10:28,798][106225] Updated weights for policy 1, policy_version 1104376 (0.0008) [2023-12-28 03:10:28,850][106225] Updated weights for policy 1, policy_version 1104386 (0.0009) [2023-12-28 03:10:28,901][106225] Updated weights for policy 1, policy_version 1104396 (0.0008) [2023-12-28 03:10:29,242][106226] Updated weights for policy 0, policy_version 1101465 (0.0009) [2023-12-28 03:10:29,303][106226] Updated weights for policy 0, policy_version 1101475 (0.0008) [2023-12-28 03:10:29,366][106226] Updated weights for policy 0, policy_version 1101485 (0.0009) [2023-12-28 03:10:29,435][106226] Updated weights for policy 0, policy_version 1101495 (0.0008) [2023-12-28 03:10:29,629][106225] Updated weights for policy 1, policy_version 1104406 (0.0006) [2023-12-28 03:10:29,698][106225] Updated weights for policy 1, policy_version 1104416 (0.0005) [2023-12-28 03:10:29,762][106225] Updated weights for policy 1, policy_version 1104426 (0.0005) [2023-12-28 03:10:30,273][106226] Updated weights for policy 0, policy_version 1101505 (0.0009) [2023-12-28 03:10:30,340][106226] Updated weights for policy 0, policy_version 1101515 (0.0009) [2023-12-28 03:10:30,390][106225] Updated weights for policy 1, policy_version 1104436 (0.0007) [2023-12-28 03:10:30,396][106226] Updated weights for policy 0, policy_version 1101525 (0.0007) [2023-12-28 03:10:30,443][106225] Updated weights for policy 1, policy_version 1104446 (0.0007) [2023-12-28 03:10:30,500][106225] Updated weights for policy 1, policy_version 1104456 (0.0008) [2023-12-28 03:10:31,035][106226] Updated weights for policy 0, policy_version 1101535 (0.0006) [2023-12-28 03:10:31,090][106226] Updated weights for policy 0, policy_version 1101545 (0.0006) [2023-12-28 03:10:31,151][106226] Updated weights for policy 0, policy_version 1101555 (0.0007) [2023-12-28 03:10:31,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 564838400. Throughput: 0: 9489.1, 1: 10150.1. Samples: 564833352. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:31,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.971')] [2023-12-28 03:10:31,297][106225] Updated weights for policy 1, policy_version 1104466 (0.0009) [2023-12-28 03:10:31,365][106225] Updated weights for policy 1, policy_version 1104476 (0.0009) [2023-12-28 03:10:31,422][106225] Updated weights for policy 1, policy_version 1104486 (0.0008) [2023-12-28 03:10:31,485][106225] Updated weights for policy 1, policy_version 1104496 (0.0008) [2023-12-28 03:10:31,849][106226] Updated weights for policy 0, policy_version 1101565 (0.0008) [2023-12-28 03:10:31,901][106226] Updated weights for policy 0, policy_version 1101575 (0.0008) [2023-12-28 03:10:31,956][106226] Updated weights for policy 0, policy_version 1101585 (0.0008) [2023-12-28 03:10:32,218][106225] Updated weights for policy 1, policy_version 1104506 (0.0009) [2023-12-28 03:10:32,285][106225] Updated weights for policy 1, policy_version 1104516 (0.0008) [2023-12-28 03:10:32,339][106225] Updated weights for policy 1, policy_version 1104526 (0.0008) [2023-12-28 03:10:32,680][106226] Updated weights for policy 0, policy_version 1101595 (0.0008) [2023-12-28 03:10:32,734][106226] Updated weights for policy 0, policy_version 1101605 (0.0009) [2023-12-28 03:10:32,792][106226] Updated weights for policy 0, policy_version 1101615 (0.0008) [2023-12-28 03:10:33,057][106225] Updated weights for policy 1, policy_version 1104536 (0.0008) [2023-12-28 03:10:33,110][106225] Updated weights for policy 1, policy_version 1104546 (0.0008) [2023-12-28 03:10:33,168][106225] Updated weights for policy 1, policy_version 1104556 (0.0008) [2023-12-28 03:10:33,504][106226] Updated weights for policy 0, policy_version 1101625 (0.0008) [2023-12-28 03:10:33,558][106226] Updated weights for policy 0, policy_version 1101635 (0.0006) [2023-12-28 03:10:33,601][106226] Updated weights for policy 0, policy_version 1101645 (0.0008) [2023-12-28 03:10:33,647][106226] Updated weights for policy 0, policy_version 1101655 (0.0008) [2023-12-28 03:10:33,938][106225] Updated weights for policy 1, policy_version 1104566 (0.0009) [2023-12-28 03:10:33,988][106225] Updated weights for policy 1, policy_version 1104576 (0.0009) [2023-12-28 03:10:34,031][106225] Updated weights for policy 1, policy_version 1104586 (0.0008) [2023-12-28 03:10:34,259][106226] Updated weights for policy 0, policy_version 1101665 (0.0008) [2023-12-28 03:10:34,314][106226] Updated weights for policy 0, policy_version 1101675 (0.0008) [2023-12-28 03:10:34,376][106226] Updated weights for policy 0, policy_version 1101685 (0.0008) [2023-12-28 03:10:34,779][106225] Updated weights for policy 1, policy_version 1104596 (0.0008) [2023-12-28 03:10:34,836][106225] Updated weights for policy 1, policy_version 1104606 (0.0007) [2023-12-28 03:10:34,896][106225] Updated weights for policy 1, policy_version 1104616 (0.0008) [2023-12-28 03:10:35,132][106226] Updated weights for policy 0, policy_version 1101695 (0.0010) [2023-12-28 03:10:35,184][106226] Updated weights for policy 0, policy_version 1101705 (0.0010) [2023-12-28 03:10:35,234][106226] Updated weights for policy 0, policy_version 1101715 (0.0010) [2023-12-28 03:10:35,655][106225] Updated weights for policy 1, policy_version 1104626 (0.0008) [2023-12-28 03:10:35,706][106225] Updated weights for policy 1, policy_version 1104636 (0.0005) [2023-12-28 03:10:35,765][106225] Updated weights for policy 1, policy_version 1104646 (0.0005) [2023-12-28 03:10:35,825][106225] Updated weights for policy 1, policy_version 1104656 (0.0005) [2023-12-28 03:10:35,932][106226] Updated weights for policy 0, policy_version 1101725 (0.0010) [2023-12-28 03:10:35,982][106226] Updated weights for policy 0, policy_version 1101735 (0.0010) [2023-12-28 03:10:36,042][106226] Updated weights for policy 0, policy_version 1101745 (0.0008) [2023-12-28 03:10:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 564944896. Throughput: 0: 9574.1, 1: 10110.3. Samples: 564950456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:36,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-5.060')] [2023-12-28 03:10:36,440][106225] Updated weights for policy 1, policy_version 1104666 (0.0010) [2023-12-28 03:10:36,503][106225] Updated weights for policy 1, policy_version 1104676 (0.0009) [2023-12-28 03:10:36,570][106225] Updated weights for policy 1, policy_version 1104686 (0.0008) [2023-12-28 03:10:36,652][106226] Updated weights for policy 0, policy_version 1101755 (0.0007) [2023-12-28 03:10:36,713][106226] Updated weights for policy 0, policy_version 1101765 (0.0011) [2023-12-28 03:10:36,776][106226] Updated weights for policy 0, policy_version 1101775 (0.0011) [2023-12-28 03:10:37,290][106225] Updated weights for policy 1, policy_version 1104696 (0.0008) [2023-12-28 03:10:37,350][106225] Updated weights for policy 1, policy_version 1104706 (0.0008) [2023-12-28 03:10:37,411][106225] Updated weights for policy 1, policy_version 1104716 (0.0008) [2023-12-28 03:10:37,483][106226] Updated weights for policy 0, policy_version 1101785 (0.0011) [2023-12-28 03:10:37,546][106226] Updated weights for policy 0, policy_version 1101795 (0.0011) [2023-12-28 03:10:37,607][106226] Updated weights for policy 0, policy_version 1101805 (0.0011) [2023-12-28 03:10:37,669][106226] Updated weights for policy 0, policy_version 1101815 (0.0011) [2023-12-28 03:10:38,136][106225] Updated weights for policy 1, policy_version 1104726 (0.0009) [2023-12-28 03:10:38,185][106225] Updated weights for policy 1, policy_version 1104736 (0.0008) [2023-12-28 03:10:38,255][106225] Updated weights for policy 1, policy_version 1104746 (0.0008) [2023-12-28 03:10:38,389][106226] Updated weights for policy 0, policy_version 1101825 (0.0010) [2023-12-28 03:10:38,454][106226] Updated weights for policy 0, policy_version 1101835 (0.0011) [2023-12-28 03:10:38,514][106226] Updated weights for policy 0, policy_version 1101845 (0.0011) [2023-12-28 03:10:38,942][106225] Updated weights for policy 1, policy_version 1104756 (0.0009) [2023-12-28 03:10:38,989][106225] Updated weights for policy 1, policy_version 1104766 (0.0010) [2023-12-28 03:10:39,051][106225] Updated weights for policy 1, policy_version 1104776 (0.0010) [2023-12-28 03:10:39,199][106226] Updated weights for policy 0, policy_version 1101855 (0.0011) [2023-12-28 03:10:39,265][106226] Updated weights for policy 0, policy_version 1101865 (0.0010) [2023-12-28 03:10:39,324][106226] Updated weights for policy 0, policy_version 1101875 (0.0010) [2023-12-28 03:10:39,698][106225] Updated weights for policy 1, policy_version 1104786 (0.0009) [2023-12-28 03:10:39,766][106225] Updated weights for policy 1, policy_version 1104796 (0.0006) [2023-12-28 03:10:39,830][106225] Updated weights for policy 1, policy_version 1104806 (0.0006) [2023-12-28 03:10:39,896][106225] Updated weights for policy 1, policy_version 1104816 (0.0008) [2023-12-28 03:10:40,081][106226] Updated weights for policy 0, policy_version 1101885 (0.0010) [2023-12-28 03:10:40,142][106226] Updated weights for policy 0, policy_version 1101895 (0.0006) [2023-12-28 03:10:40,205][106226] Updated weights for policy 0, policy_version 1101905 (0.0008) [2023-12-28 03:10:40,570][106225] Updated weights for policy 1, policy_version 1104826 (0.0007) [2023-12-28 03:10:40,624][106225] Updated weights for policy 1, policy_version 1104836 (0.0008) [2023-12-28 03:10:40,689][106225] Updated weights for policy 1, policy_version 1104846 (0.0008) [2023-12-28 03:10:40,876][106226] Updated weights for policy 0, policy_version 1101915 (0.0009) [2023-12-28 03:10:40,925][106226] Updated weights for policy 0, policy_version 1101925 (0.0006) [2023-12-28 03:10:40,974][106226] Updated weights for policy 0, policy_version 1101935 (0.0007) [2023-12-28 03:10:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 565043200. Throughput: 0: 9602.7, 1: 10106.8. Samples: 565010136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:41,176][105115] Avg episode reward: [(0, '-4.692'), (1, '-4.604')] [2023-12-28 03:10:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001104848_282886144.pth... [2023-12-28 03:10:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001101944_282157056.pth... [2023-12-28 03:10:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001103696_282591232.pth [2023-12-28 03:10:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001100824_281870336.pth [2023-12-28 03:10:41,477][106225] Updated weights for policy 1, policy_version 1104856 (0.0008) [2023-12-28 03:10:41,540][106225] Updated weights for policy 1, policy_version 1104866 (0.0008) [2023-12-28 03:10:41,604][106225] Updated weights for policy 1, policy_version 1104876 (0.0008) [2023-12-28 03:10:41,729][106226] Updated weights for policy 0, policy_version 1101945 (0.0007) [2023-12-28 03:10:41,798][106226] Updated weights for policy 0, policy_version 1101955 (0.0006) [2023-12-28 03:10:41,859][106226] Updated weights for policy 0, policy_version 1101965 (0.0007) [2023-12-28 03:10:41,927][106226] Updated weights for policy 0, policy_version 1101975 (0.0008) [2023-12-28 03:10:42,345][106225] Updated weights for policy 1, policy_version 1104886 (0.0008) [2023-12-28 03:10:42,410][106225] Updated weights for policy 1, policy_version 1104896 (0.0009) [2023-12-28 03:10:42,470][106225] Updated weights for policy 1, policy_version 1104906 (0.0008) [2023-12-28 03:10:42,644][106226] Updated weights for policy 0, policy_version 1101985 (0.0006) [2023-12-28 03:10:42,706][106226] Updated weights for policy 0, policy_version 1101995 (0.0011) [2023-12-28 03:10:42,764][106226] Updated weights for policy 0, policy_version 1102005 (0.0011) [2023-12-28 03:10:43,229][106225] Updated weights for policy 1, policy_version 1104916 (0.0008) [2023-12-28 03:10:43,280][106225] Updated weights for policy 1, policy_version 1104926 (0.0006) [2023-12-28 03:10:43,334][106225] Updated weights for policy 1, policy_version 1104936 (0.0005) [2023-12-28 03:10:43,433][106226] Updated weights for policy 0, policy_version 1102015 (0.0010) [2023-12-28 03:10:43,503][106226] Updated weights for policy 0, policy_version 1102025 (0.0011) [2023-12-28 03:10:43,572][106226] Updated weights for policy 0, policy_version 1102035 (0.0010) [2023-12-28 03:10:43,921][106225] Updated weights for policy 1, policy_version 1104946 (0.0006) [2023-12-28 03:10:43,986][106225] Updated weights for policy 1, policy_version 1104956 (0.0009) [2023-12-28 03:10:44,042][106225] Updated weights for policy 1, policy_version 1104966 (0.0007) [2023-12-28 03:10:44,094][106225] Updated weights for policy 1, policy_version 1104976 (0.0009) [2023-12-28 03:10:44,115][106226] Updated weights for policy 0, policy_version 1102045 (0.0008) [2023-12-28 03:10:44,173][106226] Updated weights for policy 0, policy_version 1102055 (0.0007) [2023-12-28 03:10:44,228][106226] Updated weights for policy 0, policy_version 1102065 (0.0006) [2023-12-28 03:10:44,857][106225] Updated weights for policy 1, policy_version 1104986 (0.0009) [2023-12-28 03:10:44,922][106225] Updated weights for policy 1, policy_version 1104996 (0.0007) [2023-12-28 03:10:44,930][106226] Updated weights for policy 0, policy_version 1102075 (0.0008) [2023-12-28 03:10:44,986][106225] Updated weights for policy 1, policy_version 1105006 (0.0006) [2023-12-28 03:10:45,000][106226] Updated weights for policy 0, policy_version 1102085 (0.0011) [2023-12-28 03:10:45,057][106226] Updated weights for policy 0, policy_version 1102095 (0.0009) [2023-12-28 03:10:45,610][106225] Updated weights for policy 1, policy_version 1105016 (0.0006) [2023-12-28 03:10:45,661][106225] Updated weights for policy 1, policy_version 1105026 (0.0006) [2023-12-28 03:10:45,717][106225] Updated weights for policy 1, policy_version 1105036 (0.0006) [2023-12-28 03:10:45,793][106226] Updated weights for policy 0, policy_version 1102105 (0.0007) [2023-12-28 03:10:45,862][106226] Updated weights for policy 0, policy_version 1102115 (0.0011) [2023-12-28 03:10:45,924][106226] Updated weights for policy 0, policy_version 1102125 (0.0010) [2023-12-28 03:10:45,973][106226] Updated weights for policy 0, policy_version 1102135 (0.0010) [2023-12-28 03:10:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 565141504. Throughput: 0: 9657.2, 1: 10036.7. Samples: 565128556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:46,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.647')] [2023-12-28 03:10:46,361][106225] Updated weights for policy 1, policy_version 1105046 (0.0008) [2023-12-28 03:10:46,417][106225] Updated weights for policy 1, policy_version 1105056 (0.0010) [2023-12-28 03:10:46,473][106225] Updated weights for policy 1, policy_version 1105066 (0.0010) [2023-12-28 03:10:46,660][106226] Updated weights for policy 0, policy_version 1102145 (0.0010) [2023-12-28 03:10:46,710][106226] Updated weights for policy 0, policy_version 1102155 (0.0010) [2023-12-28 03:10:46,757][106226] Updated weights for policy 0, policy_version 1102165 (0.0010) [2023-12-28 03:10:47,197][106225] Updated weights for policy 1, policy_version 1105076 (0.0010) [2023-12-28 03:10:47,253][106225] Updated weights for policy 1, policy_version 1105086 (0.0010) [2023-12-28 03:10:47,310][106225] Updated weights for policy 1, policy_version 1105096 (0.0010) [2023-12-28 03:10:47,488][106226] Updated weights for policy 0, policy_version 1102175 (0.0008) [2023-12-28 03:10:47,543][106226] Updated weights for policy 0, policy_version 1102185 (0.0005) [2023-12-28 03:10:47,598][106226] Updated weights for policy 0, policy_version 1102195 (0.0007) [2023-12-28 03:10:48,018][106225] Updated weights for policy 1, policy_version 1105106 (0.0010) [2023-12-28 03:10:48,075][106225] Updated weights for policy 1, policy_version 1105116 (0.0010) [2023-12-28 03:10:48,126][106225] Updated weights for policy 1, policy_version 1105126 (0.0010) [2023-12-28 03:10:48,179][106225] Updated weights for policy 1, policy_version 1105136 (0.0010) [2023-12-28 03:10:48,254][106226] Updated weights for policy 0, policy_version 1102205 (0.0008) [2023-12-28 03:10:48,306][106226] Updated weights for policy 0, policy_version 1102215 (0.0007) [2023-12-28 03:10:48,374][106226] Updated weights for policy 0, policy_version 1102225 (0.0008) [2023-12-28 03:10:48,945][106225] Updated weights for policy 1, policy_version 1105146 (0.0011) [2023-12-28 03:10:48,991][106225] Updated weights for policy 1, policy_version 1105156 (0.0010) [2023-12-28 03:10:49,040][106225] Updated weights for policy 1, policy_version 1105166 (0.0009) [2023-12-28 03:10:49,047][106226] Updated weights for policy 0, policy_version 1102235 (0.0007) [2023-12-28 03:10:49,108][106226] Updated weights for policy 0, policy_version 1102245 (0.0006) [2023-12-28 03:10:49,170][106226] Updated weights for policy 0, policy_version 1102255 (0.0005) [2023-12-28 03:10:49,840][106225] Updated weights for policy 1, policy_version 1105176 (0.0008) [2023-12-28 03:10:49,901][106225] Updated weights for policy 1, policy_version 1105186 (0.0010) [2023-12-28 03:10:49,902][106226] Updated weights for policy 0, policy_version 1102265 (0.0006) [2023-12-28 03:10:49,965][106225] Updated weights for policy 1, policy_version 1105196 (0.0010) [2023-12-28 03:10:49,971][106226] Updated weights for policy 0, policy_version 1102275 (0.0009) [2023-12-28 03:10:50,035][106226] Updated weights for policy 0, policy_version 1102285 (0.0008) [2023-12-28 03:10:50,099][106226] Updated weights for policy 0, policy_version 1102295 (0.0008) [2023-12-28 03:10:50,756][106225] Updated weights for policy 1, policy_version 1105206 (0.0010) [2023-12-28 03:10:50,813][106226] Updated weights for policy 0, policy_version 1102305 (0.0006) [2023-12-28 03:10:50,815][106225] Updated weights for policy 1, policy_version 1105216 (0.0010) [2023-12-28 03:10:50,866][106225] Updated weights for policy 1, policy_version 1105226 (0.0010) [2023-12-28 03:10:50,877][106226] Updated weights for policy 0, policy_version 1102315 (0.0006) [2023-12-28 03:10:50,937][106226] Updated weights for policy 0, policy_version 1102325 (0.0007) [2023-12-28 03:10:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 565239808. Throughput: 0: 9621.4, 1: 9975.0. Samples: 565245912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:51,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.621')] [2023-12-28 03:10:51,596][106225] Updated weights for policy 1, policy_version 1105236 (0.0011) [2023-12-28 03:10:51,663][106225] Updated weights for policy 1, policy_version 1105246 (0.0014) [2023-12-28 03:10:51,720][106225] Updated weights for policy 1, policy_version 1105256 (0.0009) [2023-12-28 03:10:51,731][106226] Updated weights for policy 0, policy_version 1102335 (0.0008) [2023-12-28 03:10:51,803][106226] Updated weights for policy 0, policy_version 1102345 (0.0009) [2023-12-28 03:10:51,870][106226] Updated weights for policy 0, policy_version 1102355 (0.0009) [2023-12-28 03:10:52,431][106225] Updated weights for policy 1, policy_version 1105266 (0.0009) [2023-12-28 03:10:52,494][106225] Updated weights for policy 1, policy_version 1105276 (0.0007) [2023-12-28 03:10:52,562][106225] Updated weights for policy 1, policy_version 1105286 (0.0005) [2023-12-28 03:10:52,625][106225] Updated weights for policy 1, policy_version 1105296 (0.0005) [2023-12-28 03:10:52,676][106226] Updated weights for policy 0, policy_version 1102365 (0.0010) [2023-12-28 03:10:52,739][106226] Updated weights for policy 0, policy_version 1102375 (0.0009) [2023-12-28 03:10:52,803][106226] Updated weights for policy 0, policy_version 1102385 (0.0010) [2023-12-28 03:10:53,178][106225] Updated weights for policy 1, policy_version 1105306 (0.0009) [2023-12-28 03:10:53,226][106225] Updated weights for policy 1, policy_version 1105316 (0.0009) [2023-12-28 03:10:53,283][106225] Updated weights for policy 1, policy_version 1105326 (0.0008) [2023-12-28 03:10:53,537][106226] Updated weights for policy 0, policy_version 1102395 (0.0009) [2023-12-28 03:10:53,604][106226] Updated weights for policy 0, policy_version 1102405 (0.0009) [2023-12-28 03:10:53,658][106226] Updated weights for policy 0, policy_version 1102415 (0.0009) [2023-12-28 03:10:53,954][106225] Updated weights for policy 1, policy_version 1105336 (0.0009) [2023-12-28 03:10:54,007][106225] Updated weights for policy 1, policy_version 1105346 (0.0008) [2023-12-28 03:10:54,053][106225] Updated weights for policy 1, policy_version 1105356 (0.0008) [2023-12-28 03:10:54,326][106226] Updated weights for policy 0, policy_version 1102425 (0.0009) [2023-12-28 03:10:54,382][106226] Updated weights for policy 0, policy_version 1102435 (0.0010) [2023-12-28 03:10:54,436][106226] Updated weights for policy 0, policy_version 1102445 (0.0011) [2023-12-28 03:10:54,497][106226] Updated weights for policy 0, policy_version 1102455 (0.0011) [2023-12-28 03:10:54,796][106225] Updated weights for policy 1, policy_version 1105366 (0.0007) [2023-12-28 03:10:54,851][106225] Updated weights for policy 1, policy_version 1105376 (0.0005) [2023-12-28 03:10:54,907][106225] Updated weights for policy 1, policy_version 1105386 (0.0005) [2023-12-28 03:10:55,194][106226] Updated weights for policy 0, policy_version 1102465 (0.0010) [2023-12-28 03:10:55,246][106226] Updated weights for policy 0, policy_version 1102475 (0.0010) [2023-12-28 03:10:55,292][106226] Updated weights for policy 0, policy_version 1102485 (0.0010) [2023-12-28 03:10:55,556][106225] Updated weights for policy 1, policy_version 1105396 (0.0007) [2023-12-28 03:10:55,612][106225] Updated weights for policy 1, policy_version 1105406 (0.0009) [2023-12-28 03:10:55,664][106225] Updated weights for policy 1, policy_version 1105416 (0.0010) [2023-12-28 03:10:55,964][106226] Updated weights for policy 0, policy_version 1102495 (0.0007) [2023-12-28 03:10:56,031][106226] Updated weights for policy 0, policy_version 1102505 (0.0006) [2023-12-28 03:10:56,100][106226] Updated weights for policy 0, policy_version 1102515 (0.0006) [2023-12-28 03:10:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 565338112. Throughput: 0: 9640.9, 1: 9964.3. Samples: 565304128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:10:56,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.789')] [2023-12-28 03:10:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001102520_282304512.pth... [2023-12-28 03:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001105424_283033600.pth... [2023-12-28 03:10:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001101368_282009600.pth [2023-12-28 03:10:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001104272_282738688.pth [2023-12-28 03:10:56,294][106225] Updated weights for policy 1, policy_version 1105426 (0.0005) [2023-12-28 03:10:56,348][106225] Updated weights for policy 1, policy_version 1105436 (0.0005) [2023-12-28 03:10:56,405][106225] Updated weights for policy 1, policy_version 1105446 (0.0010) [2023-12-28 03:10:56,458][106225] Updated weights for policy 1, policy_version 1105456 (0.0010) [2023-12-28 03:10:56,711][106226] Updated weights for policy 0, policy_version 1102525 (0.0007) [2023-12-28 03:10:56,767][106226] Updated weights for policy 0, policy_version 1102535 (0.0009) [2023-12-28 03:10:56,817][106226] Updated weights for policy 0, policy_version 1102545 (0.0008) [2023-12-28 03:10:57,041][106225] Updated weights for policy 1, policy_version 1105466 (0.0010) [2023-12-28 03:10:57,097][106225] Updated weights for policy 1, policy_version 1105476 (0.0010) [2023-12-28 03:10:57,150][106225] Updated weights for policy 1, policy_version 1105486 (0.0010) [2023-12-28 03:10:57,544][106226] Updated weights for policy 0, policy_version 1102555 (0.0007) [2023-12-28 03:10:57,609][106226] Updated weights for policy 0, policy_version 1102565 (0.0008) [2023-12-28 03:10:57,659][106226] Updated weights for policy 0, policy_version 1102575 (0.0009) [2023-12-28 03:10:57,759][106225] Updated weights for policy 1, policy_version 1105496 (0.0006) [2023-12-28 03:10:57,815][106225] Updated weights for policy 1, policy_version 1105506 (0.0005) [2023-12-28 03:10:57,867][106225] Updated weights for policy 1, policy_version 1105516 (0.0005) [2023-12-28 03:10:58,340][106226] Updated weights for policy 0, policy_version 1102585 (0.0010) [2023-12-28 03:10:58,403][106226] Updated weights for policy 0, policy_version 1102595 (0.0007) [2023-12-28 03:10:58,470][106226] Updated weights for policy 0, policy_version 1102605 (0.0009) [2023-12-28 03:10:58,514][106225] Updated weights for policy 1, policy_version 1105526 (0.0009) [2023-12-28 03:10:58,534][106226] Updated weights for policy 0, policy_version 1102615 (0.0008) [2023-12-28 03:10:58,575][106225] Updated weights for policy 1, policy_version 1105536 (0.0010) [2023-12-28 03:10:58,650][106225] Updated weights for policy 1, policy_version 1105546 (0.0009) [2023-12-28 03:10:59,285][106226] Updated weights for policy 0, policy_version 1102625 (0.0007) [2023-12-28 03:10:59,352][106226] Updated weights for policy 0, policy_version 1102635 (0.0007) [2023-12-28 03:10:59,425][106226] Updated weights for policy 0, policy_version 1102645 (0.0006) [2023-12-28 03:10:59,496][106225] Updated weights for policy 1, policy_version 1105556 (0.0007) [2023-12-28 03:10:59,545][106225] Updated weights for policy 1, policy_version 1105566 (0.0005) [2023-12-28 03:10:59,600][106225] Updated weights for policy 1, policy_version 1105576 (0.0006) [2023-12-28 03:11:00,154][106226] Updated weights for policy 0, policy_version 1102655 (0.0008) [2023-12-28 03:11:00,225][106226] Updated weights for policy 0, policy_version 1102665 (0.0008) [2023-12-28 03:11:00,239][106225] Updated weights for policy 1, policy_version 1105586 (0.0006) [2023-12-28 03:11:00,291][106226] Updated weights for policy 0, policy_version 1102675 (0.0006) [2023-12-28 03:11:00,302][106225] Updated weights for policy 1, policy_version 1105596 (0.0008) [2023-12-28 03:11:00,367][106225] Updated weights for policy 1, policy_version 1105606 (0.0008) [2023-12-28 03:11:00,440][106225] Updated weights for policy 1, policy_version 1105616 (0.0009) [2023-12-28 03:11:00,845][106226] Updated weights for policy 0, policy_version 1102685 (0.0007) [2023-12-28 03:11:00,903][106226] Updated weights for policy 0, policy_version 1102695 (0.0007) [2023-12-28 03:11:00,956][106226] Updated weights for policy 0, policy_version 1102705 (0.0006) [2023-12-28 03:11:01,088][106225] Updated weights for policy 1, policy_version 1105626 (0.0009) [2023-12-28 03:11:01,157][106225] Updated weights for policy 1, policy_version 1105636 (0.0010) [2023-12-28 03:11:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 565436416. Throughput: 0: 9710.4, 1: 9954.8. Samples: 565425684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 03:11:01,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-4.888')] [2023-12-28 03:11:01,223][106225] Updated weights for policy 1, policy_version 1105646 (0.0008) [2023-12-28 03:11:01,696][106226] Updated weights for policy 0, policy_version 1102715 (0.0006) [2023-12-28 03:11:01,761][106226] Updated weights for policy 0, policy_version 1102725 (0.0007) [2023-12-28 03:11:01,822][106226] Updated weights for policy 0, policy_version 1102735 (0.0008) [2023-12-28 03:11:01,997][106225] Updated weights for policy 1, policy_version 1105656 (0.0006) [2023-12-28 03:11:02,058][106225] Updated weights for policy 1, policy_version 1105666 (0.0008) [2023-12-28 03:11:02,113][106225] Updated weights for policy 1, policy_version 1105676 (0.0008) [2023-12-28 03:11:02,586][106226] Updated weights for policy 0, policy_version 1102745 (0.0008) [2023-12-28 03:11:02,639][106226] Updated weights for policy 0, policy_version 1102755 (0.0008) [2023-12-28 03:11:02,690][106226] Updated weights for policy 0, policy_version 1102765 (0.0007) [2023-12-28 03:11:02,745][106226] Updated weights for policy 0, policy_version 1102775 (0.0007) [2023-12-28 03:11:02,768][106225] Updated weights for policy 1, policy_version 1105686 (0.0008) [2023-12-28 03:11:02,821][106225] Updated weights for policy 1, policy_version 1105696 (0.0010) [2023-12-28 03:11:02,870][106225] Updated weights for policy 1, policy_version 1105706 (0.0008) [2023-12-28 03:11:03,507][106225] Updated weights for policy 1, policy_version 1105716 (0.0008) [2023-12-28 03:11:03,515][106226] Updated weights for policy 0, policy_version 1102785 (0.0008) [2023-12-28 03:11:03,558][106225] Updated weights for policy 1, policy_version 1105726 (0.0006) [2023-12-28 03:11:03,570][106226] Updated weights for policy 0, policy_version 1102795 (0.0007) [2023-12-28 03:11:03,608][106225] Updated weights for policy 1, policy_version 1105736 (0.0006) [2023-12-28 03:11:03,622][106226] Updated weights for policy 0, policy_version 1102805 (0.0007) [2023-12-28 03:11:04,302][106225] Updated weights for policy 1, policy_version 1105746 (0.0006) [2023-12-28 03:11:04,367][106225] Updated weights for policy 1, policy_version 1105756 (0.0006) [2023-12-28 03:11:04,411][106226] Updated weights for policy 0, policy_version 1102815 (0.0007) [2023-12-28 03:11:04,433][106225] Updated weights for policy 1, policy_version 1105766 (0.0006) [2023-12-28 03:11:04,465][106226] Updated weights for policy 0, policy_version 1102825 (0.0008) [2023-12-28 03:11:04,495][106225] Updated weights for policy 1, policy_version 1105776 (0.0006) [2023-12-28 03:11:04,514][106226] Updated weights for policy 0, policy_version 1102835 (0.0007) [2023-12-28 03:11:05,157][106225] Updated weights for policy 1, policy_version 1105786 (0.0006) [2023-12-28 03:11:05,220][106225] Updated weights for policy 1, policy_version 1105796 (0.0008) [2023-12-28 03:11:05,284][106225] Updated weights for policy 1, policy_version 1105806 (0.0008) [2023-12-28 03:11:05,329][106226] Updated weights for policy 0, policy_version 1102845 (0.0009) [2023-12-28 03:11:05,383][106226] Updated weights for policy 0, policy_version 1102855 (0.0008) [2023-12-28 03:11:05,438][106226] Updated weights for policy 0, policy_version 1102865 (0.0009) [2023-12-28 03:11:05,911][106225] Updated weights for policy 1, policy_version 1105816 (0.0010) [2023-12-28 03:11:05,973][106225] Updated weights for policy 1, policy_version 1105826 (0.0010) [2023-12-28 03:11:06,029][106225] Updated weights for policy 1, policy_version 1105836 (0.0010) [2023-12-28 03:11:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 565534720. Throughput: 0: 9740.4, 1: 9980.6. Samples: 565543276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:06,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.554')] [2023-12-28 03:11:06,187][106226] Updated weights for policy 0, policy_version 1102875 (0.0008) [2023-12-28 03:11:06,249][106226] Updated weights for policy 0, policy_version 1102885 (0.0008) [2023-12-28 03:11:06,316][106226] Updated weights for policy 0, policy_version 1102895 (0.0008) [2023-12-28 03:11:06,769][106225] Updated weights for policy 1, policy_version 1105846 (0.0010) [2023-12-28 03:11:06,836][106225] Updated weights for policy 1, policy_version 1105856 (0.0010) [2023-12-28 03:11:06,896][106225] Updated weights for policy 1, policy_version 1105866 (0.0010) [2023-12-28 03:11:07,024][106226] Updated weights for policy 0, policy_version 1102905 (0.0008) [2023-12-28 03:11:07,090][106226] Updated weights for policy 0, policy_version 1102915 (0.0008) [2023-12-28 03:11:07,146][106226] Updated weights for policy 0, policy_version 1102925 (0.0008) [2023-12-28 03:11:07,198][106226] Updated weights for policy 0, policy_version 1102935 (0.0009) [2023-12-28 03:11:07,485][106225] Updated weights for policy 1, policy_version 1105876 (0.0008) [2023-12-28 03:11:07,543][106225] Updated weights for policy 1, policy_version 1105886 (0.0005) [2023-12-28 03:11:07,598][106225] Updated weights for policy 1, policy_version 1105896 (0.0005) [2023-12-28 03:11:08,028][106226] Updated weights for policy 0, policy_version 1102945 (0.0008) [2023-12-28 03:11:08,078][106226] Updated weights for policy 0, policy_version 1102955 (0.0008) [2023-12-28 03:11:08,128][106226] Updated weights for policy 0, policy_version 1102965 (0.0008) [2023-12-28 03:11:08,211][106225] Updated weights for policy 1, policy_version 1105906 (0.0006) [2023-12-28 03:11:08,264][106225] Updated weights for policy 1, policy_version 1105916 (0.0010) [2023-12-28 03:11:08,319][106225] Updated weights for policy 1, policy_version 1105926 (0.0010) [2023-12-28 03:11:08,380][106225] Updated weights for policy 1, policy_version 1105936 (0.0010) [2023-12-28 03:11:08,847][106226] Updated weights for policy 0, policy_version 1102975 (0.0009) [2023-12-28 03:11:08,906][106226] Updated weights for policy 0, policy_version 1102985 (0.0008) [2023-12-28 03:11:08,973][106226] Updated weights for policy 0, policy_version 1102995 (0.0009) [2023-12-28 03:11:09,076][106225] Updated weights for policy 1, policy_version 1105946 (0.0005) [2023-12-28 03:11:09,132][106225] Updated weights for policy 1, policy_version 1105956 (0.0005) [2023-12-28 03:11:09,192][106225] Updated weights for policy 1, policy_version 1105966 (0.0005) [2023-12-28 03:11:09,736][106226] Updated weights for policy 0, policy_version 1103005 (0.0007) [2023-12-28 03:11:09,807][106226] Updated weights for policy 0, policy_version 1103015 (0.0008) [2023-12-28 03:11:09,874][106225] Updated weights for policy 1, policy_version 1105976 (0.0007) [2023-12-28 03:11:09,875][106226] Updated weights for policy 0, policy_version 1103025 (0.0009) [2023-12-28 03:11:09,939][106225] Updated weights for policy 1, policy_version 1105986 (0.0007) [2023-12-28 03:11:10,003][106225] Updated weights for policy 1, policy_version 1105996 (0.0009) [2023-12-28 03:11:10,590][106226] Updated weights for policy 0, policy_version 1103035 (0.0009) [2023-12-28 03:11:10,639][106226] Updated weights for policy 0, policy_version 1103045 (0.0008) [2023-12-28 03:11:10,699][106226] Updated weights for policy 0, policy_version 1103055 (0.0009) [2023-12-28 03:11:10,728][106225] Updated weights for policy 1, policy_version 1106006 (0.0009) [2023-12-28 03:11:10,790][106225] Updated weights for policy 1, policy_version 1106016 (0.0010) [2023-12-28 03:11:10,841][106225] Updated weights for policy 1, policy_version 1106026 (0.0010) [2023-12-28 03:11:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 565633024. Throughput: 0: 9732.1, 1: 10067.6. Samples: 565602136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:11,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-4.585')] [2023-12-28 03:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001106032_283189248.pth... [2023-12-28 03:11:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001103064_282443776.pth... [2023-12-28 03:11:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001101944_282157056.pth [2023-12-28 03:11:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001104848_282886144.pth [2023-12-28 03:11:11,543][106226] Updated weights for policy 0, policy_version 1103065 (0.0006) [2023-12-28 03:11:11,556][106225] Updated weights for policy 1, policy_version 1106036 (0.0010) [2023-12-28 03:11:11,605][106226] Updated weights for policy 0, policy_version 1103075 (0.0006) [2023-12-28 03:11:11,619][106225] Updated weights for policy 1, policy_version 1106046 (0.0007) [2023-12-28 03:11:11,675][106226] Updated weights for policy 0, policy_version 1103085 (0.0008) [2023-12-28 03:11:11,688][106225] Updated weights for policy 1, policy_version 1106056 (0.0009) [2023-12-28 03:11:11,741][106226] Updated weights for policy 0, policy_version 1103095 (0.0009) [2023-12-28 03:11:12,413][106225] Updated weights for policy 1, policy_version 1106066 (0.0009) [2023-12-28 03:11:12,476][106225] Updated weights for policy 1, policy_version 1106076 (0.0008) [2023-12-28 03:11:12,531][106225] Updated weights for policy 1, policy_version 1106086 (0.0008) [2023-12-28 03:11:12,566][106226] Updated weights for policy 0, policy_version 1103105 (0.0005) [2023-12-28 03:11:12,599][106225] Updated weights for policy 1, policy_version 1106096 (0.0009) [2023-12-28 03:11:12,635][106226] Updated weights for policy 0, policy_version 1103115 (0.0007) [2023-12-28 03:11:12,694][106226] Updated weights for policy 0, policy_version 1103125 (0.0008) [2023-12-28 03:11:13,290][106225] Updated weights for policy 1, policy_version 1106106 (0.0008) [2023-12-28 03:11:13,336][106225] Updated weights for policy 1, policy_version 1106116 (0.0008) [2023-12-28 03:11:13,375][106226] Updated weights for policy 0, policy_version 1103135 (0.0007) [2023-12-28 03:11:13,385][106225] Updated weights for policy 1, policy_version 1106126 (0.0008) [2023-12-28 03:11:13,431][106226] Updated weights for policy 0, policy_version 1103145 (0.0007) [2023-12-28 03:11:13,488][106226] Updated weights for policy 0, policy_version 1103155 (0.0009) [2023-12-28 03:11:14,074][106225] Updated weights for policy 1, policy_version 1106136 (0.0007) [2023-12-28 03:11:14,130][106225] Updated weights for policy 1, policy_version 1106146 (0.0008) [2023-12-28 03:11:14,182][106225] Updated weights for policy 1, policy_version 1106156 (0.0005) [2023-12-28 03:11:14,232][106226] Updated weights for policy 0, policy_version 1103165 (0.0008) [2023-12-28 03:11:14,296][106226] Updated weights for policy 0, policy_version 1103175 (0.0009) [2023-12-28 03:11:14,351][106226] Updated weights for policy 0, policy_version 1103185 (0.0008) [2023-12-28 03:11:14,752][106225] Updated weights for policy 1, policy_version 1106166 (0.0007) [2023-12-28 03:11:14,813][106225] Updated weights for policy 1, policy_version 1106176 (0.0009) [2023-12-28 03:11:14,874][106225] Updated weights for policy 1, policy_version 1106186 (0.0008) [2023-12-28 03:11:15,125][106226] Updated weights for policy 0, policy_version 1103195 (0.0008) [2023-12-28 03:11:15,184][106226] Updated weights for policy 0, policy_version 1103205 (0.0008) [2023-12-28 03:11:15,242][106226] Updated weights for policy 0, policy_version 1103215 (0.0008) [2023-12-28 03:11:15,584][106225] Updated weights for policy 1, policy_version 1106196 (0.0008) [2023-12-28 03:11:15,636][106225] Updated weights for policy 1, policy_version 1106206 (0.0007) [2023-12-28 03:11:15,692][106225] Updated weights for policy 1, policy_version 1106216 (0.0005) [2023-12-28 03:11:16,032][106226] Updated weights for policy 0, policy_version 1103225 (0.0008) [2023-12-28 03:11:16,090][106226] Updated weights for policy 0, policy_version 1103235 (0.0008) [2023-12-28 03:11:16,148][106226] Updated weights for policy 0, policy_version 1103245 (0.0009) [2023-12-28 03:11:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 565723136. Throughput: 0: 9668.6, 1: 9995.5. Samples: 565718236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:16,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.764')] [2023-12-28 03:11:16,208][106226] Updated weights for policy 0, policy_version 1103255 (0.0008) [2023-12-28 03:11:16,310][106225] Updated weights for policy 1, policy_version 1106226 (0.0006) [2023-12-28 03:11:16,380][106225] Updated weights for policy 1, policy_version 1106236 (0.0008) [2023-12-28 03:11:16,438][106225] Updated weights for policy 1, policy_version 1106246 (0.0008) [2023-12-28 03:11:16,489][106225] Updated weights for policy 1, policy_version 1106256 (0.0008) [2023-12-28 03:11:16,915][106226] Updated weights for policy 0, policy_version 1103265 (0.0008) [2023-12-28 03:11:16,976][106226] Updated weights for policy 0, policy_version 1103275 (0.0006) [2023-12-28 03:11:17,037][106226] Updated weights for policy 0, policy_version 1103285 (0.0006) [2023-12-28 03:11:17,207][106225] Updated weights for policy 1, policy_version 1106266 (0.0008) [2023-12-28 03:11:17,272][106225] Updated weights for policy 1, policy_version 1106276 (0.0008) [2023-12-28 03:11:17,331][106225] Updated weights for policy 1, policy_version 1106286 (0.0007) [2023-12-28 03:11:17,746][106226] Updated weights for policy 0, policy_version 1103295 (0.0008) [2023-12-28 03:11:17,802][106226] Updated weights for policy 0, policy_version 1103305 (0.0009) [2023-12-28 03:11:17,864][106226] Updated weights for policy 0, policy_version 1103315 (0.0009) [2023-12-28 03:11:18,015][106225] Updated weights for policy 1, policy_version 1106296 (0.0007) [2023-12-28 03:11:18,066][106225] Updated weights for policy 1, policy_version 1106306 (0.0005) [2023-12-28 03:11:18,130][106225] Updated weights for policy 1, policy_version 1106316 (0.0008) [2023-12-28 03:11:18,533][106226] Updated weights for policy 0, policy_version 1103325 (0.0009) [2023-12-28 03:11:18,589][106226] Updated weights for policy 0, policy_version 1103335 (0.0008) [2023-12-28 03:11:18,639][106226] Updated weights for policy 0, policy_version 1103345 (0.0008) [2023-12-28 03:11:18,805][106225] Updated weights for policy 1, policy_version 1106326 (0.0008) [2023-12-28 03:11:18,870][106225] Updated weights for policy 1, policy_version 1106336 (0.0008) [2023-12-28 03:11:18,932][106225] Updated weights for policy 1, policy_version 1106346 (0.0008) [2023-12-28 03:11:19,393][106226] Updated weights for policy 0, policy_version 1103355 (0.0007) [2023-12-28 03:11:19,452][106226] Updated weights for policy 0, policy_version 1103365 (0.0005) [2023-12-28 03:11:19,516][106226] Updated weights for policy 0, policy_version 1103375 (0.0008) [2023-12-28 03:11:19,661][106225] Updated weights for policy 1, policy_version 1106356 (0.0008) [2023-12-28 03:11:19,721][106225] Updated weights for policy 1, policy_version 1106366 (0.0007) [2023-12-28 03:11:19,787][106225] Updated weights for policy 1, policy_version 1106376 (0.0008) [2023-12-28 03:11:20,281][106226] Updated weights for policy 0, policy_version 1103385 (0.0006) [2023-12-28 03:11:20,343][106226] Updated weights for policy 0, policy_version 1103395 (0.0008) [2023-12-28 03:11:20,399][106226] Updated weights for policy 0, policy_version 1103405 (0.0008) [2023-12-28 03:11:20,451][106225] Updated weights for policy 1, policy_version 1106386 (0.0008) [2023-12-28 03:11:20,465][106226] Updated weights for policy 0, policy_version 1103415 (0.0009) [2023-12-28 03:11:20,515][106225] Updated weights for policy 1, policy_version 1106396 (0.0007) [2023-12-28 03:11:20,584][106225] Updated weights for policy 1, policy_version 1106406 (0.0008) [2023-12-28 03:11:20,651][106225] Updated weights for policy 1, policy_version 1106416 (0.0009) [2023-12-28 03:11:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 565821440. Throughput: 0: 9599.6, 1: 10048.6. Samples: 565834628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:21,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.913')] [2023-12-28 03:11:21,223][106226] Updated weights for policy 0, policy_version 1103425 (0.0008) [2023-12-28 03:11:21,292][106226] Updated weights for policy 0, policy_version 1103435 (0.0009) [2023-12-28 03:11:21,357][106226] Updated weights for policy 0, policy_version 1103445 (0.0009) [2023-12-28 03:11:21,416][106225] Updated weights for policy 1, policy_version 1106426 (0.0008) [2023-12-28 03:11:21,476][106225] Updated weights for policy 1, policy_version 1106436 (0.0008) [2023-12-28 03:11:21,540][106225] Updated weights for policy 1, policy_version 1106446 (0.0008) [2023-12-28 03:11:22,157][106226] Updated weights for policy 0, policy_version 1103455 (0.0007) [2023-12-28 03:11:22,220][106226] Updated weights for policy 0, policy_version 1103465 (0.0006) [2023-12-28 03:11:22,292][106226] Updated weights for policy 0, policy_version 1103475 (0.0008) [2023-12-28 03:11:22,323][106225] Updated weights for policy 1, policy_version 1106456 (0.0008) [2023-12-28 03:11:22,396][106225] Updated weights for policy 1, policy_version 1106466 (0.0009) [2023-12-28 03:11:22,469][106225] Updated weights for policy 1, policy_version 1106476 (0.0009) [2023-12-28 03:11:22,999][106226] Updated weights for policy 0, policy_version 1103485 (0.0008) [2023-12-28 03:11:23,064][106226] Updated weights for policy 0, policy_version 1103495 (0.0008) [2023-12-28 03:11:23,128][106226] Updated weights for policy 0, policy_version 1103505 (0.0008) [2023-12-28 03:11:23,238][106225] Updated weights for policy 1, policy_version 1106486 (0.0010) [2023-12-28 03:11:23,299][106225] Updated weights for policy 1, policy_version 1106496 (0.0010) [2023-12-28 03:11:23,362][106225] Updated weights for policy 1, policy_version 1106506 (0.0010) [2023-12-28 03:11:23,766][106226] Updated weights for policy 0, policy_version 1103515 (0.0007) [2023-12-28 03:11:23,821][106226] Updated weights for policy 0, policy_version 1103525 (0.0006) [2023-12-28 03:11:23,872][106226] Updated weights for policy 0, policy_version 1103535 (0.0006) [2023-12-28 03:11:24,073][106225] Updated weights for policy 1, policy_version 1106516 (0.0010) [2023-12-28 03:11:24,127][106225] Updated weights for policy 1, policy_version 1106526 (0.0010) [2023-12-28 03:11:24,181][106225] Updated weights for policy 1, policy_version 1106536 (0.0010) [2023-12-28 03:11:24,505][106226] Updated weights for policy 0, policy_version 1103545 (0.0006) [2023-12-28 03:11:24,563][106226] Updated weights for policy 0, policy_version 1103555 (0.0010) [2023-12-28 03:11:24,626][106226] Updated weights for policy 0, policy_version 1103565 (0.0010) [2023-12-28 03:11:24,692][106226] Updated weights for policy 0, policy_version 1103575 (0.0008) [2023-12-28 03:11:24,837][106225] Updated weights for policy 1, policy_version 1106546 (0.0010) [2023-12-28 03:11:24,894][106225] Updated weights for policy 1, policy_version 1106556 (0.0010) [2023-12-28 03:11:24,953][106225] Updated weights for policy 1, policy_version 1106566 (0.0010) [2023-12-28 03:11:25,016][106225] Updated weights for policy 1, policy_version 1106576 (0.0010) [2023-12-28 03:11:25,393][106226] Updated weights for policy 0, policy_version 1103585 (0.0008) [2023-12-28 03:11:25,458][106226] Updated weights for policy 0, policy_version 1103595 (0.0007) [2023-12-28 03:11:25,520][106226] Updated weights for policy 0, policy_version 1103605 (0.0005) [2023-12-28 03:11:25,710][106225] Updated weights for policy 1, policy_version 1106586 (0.0005) [2023-12-28 03:11:25,774][106225] Updated weights for policy 1, policy_version 1106596 (0.0010) [2023-12-28 03:11:25,837][106225] Updated weights for policy 1, policy_version 1106606 (0.0010) [2023-12-28 03:11:26,056][106226] Updated weights for policy 0, policy_version 1103615 (0.0009) [2023-12-28 03:11:26,113][106226] Updated weights for policy 0, policy_version 1103625 (0.0006) [2023-12-28 03:11:26,173][106226] Updated weights for policy 0, policy_version 1103635 (0.0005) [2023-12-28 03:11:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 565919744. Throughput: 0: 9577.8, 1: 9992.5. Samples: 565890796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:26,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-4.596')] [2023-12-28 03:11:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001106608_283336704.pth... [2023-12-28 03:11:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001105424_283033600.pth [2023-12-28 03:11:26,205][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001103640_282591232.pth... [2023-12-28 03:11:26,210][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001102520_282304512.pth [2023-12-28 03:11:26,520][106225] Updated weights for policy 1, policy_version 1106616 (0.0010) [2023-12-28 03:11:26,572][106225] Updated weights for policy 1, policy_version 1106626 (0.0010) [2023-12-28 03:11:26,643][106225] Updated weights for policy 1, policy_version 1106636 (0.0010) [2023-12-28 03:11:26,682][106226] Updated weights for policy 0, policy_version 1103645 (0.0005) [2023-12-28 03:11:26,733][106226] Updated weights for policy 0, policy_version 1103655 (0.0009) [2023-12-28 03:11:26,794][106226] Updated weights for policy 0, policy_version 1103665 (0.0010) [2023-12-28 03:11:27,300][106225] Updated weights for policy 1, policy_version 1106646 (0.0009) [2023-12-28 03:11:27,321][106226] Updated weights for policy 0, policy_version 1103675 (0.0008) [2023-12-28 03:11:27,354][106225] Updated weights for policy 1, policy_version 1106656 (0.0009) [2023-12-28 03:11:27,378][106226] Updated weights for policy 0, policy_version 1103685 (0.0005) [2023-12-28 03:11:27,407][106225] Updated weights for policy 1, policy_version 1106666 (0.0010) [2023-12-28 03:11:27,434][106226] Updated weights for policy 0, policy_version 1103695 (0.0005) [2023-12-28 03:11:28,013][106225] Updated weights for policy 1, policy_version 1106676 (0.0010) [2023-12-28 03:11:28,043][106226] Updated weights for policy 0, policy_version 1103705 (0.0006) [2023-12-28 03:11:28,069][106225] Updated weights for policy 1, policy_version 1106686 (0.0010) [2023-12-28 03:11:28,093][106226] Updated weights for policy 0, policy_version 1103715 (0.0008) [2023-12-28 03:11:28,123][106225] Updated weights for policy 1, policy_version 1106696 (0.0010) [2023-12-28 03:11:28,140][106226] Updated weights for policy 0, policy_version 1103725 (0.0005) [2023-12-28 03:11:28,194][106226] Updated weights for policy 0, policy_version 1103735 (0.0006) [2023-12-28 03:11:28,828][106225] Updated weights for policy 1, policy_version 1106706 (0.0009) [2023-12-28 03:11:28,887][106225] Updated weights for policy 1, policy_version 1106716 (0.0006) [2023-12-28 03:11:28,946][106225] Updated weights for policy 1, policy_version 1106726 (0.0010) [2023-12-28 03:11:28,947][106226] Updated weights for policy 0, policy_version 1103745 (0.0009) [2023-12-28 03:11:29,003][106225] Updated weights for policy 1, policy_version 1106736 (0.0010) [2023-12-28 03:11:29,007][106226] Updated weights for policy 0, policy_version 1103755 (0.0008) [2023-12-28 03:11:29,062][106226] Updated weights for policy 0, policy_version 1103765 (0.0010) [2023-12-28 03:11:29,668][106225] Updated weights for policy 1, policy_version 1106746 (0.0007) [2023-12-28 03:11:29,715][106226] Updated weights for policy 0, policy_version 1103775 (0.0009) [2023-12-28 03:11:29,720][106225] Updated weights for policy 1, policy_version 1106756 (0.0010) [2023-12-28 03:11:29,779][106226] Updated weights for policy 0, policy_version 1103785 (0.0008) [2023-12-28 03:11:29,780][106225] Updated weights for policy 1, policy_version 1106766 (0.0008) [2023-12-28 03:11:29,848][106226] Updated weights for policy 0, policy_version 1103795 (0.0007) [2023-12-28 03:11:30,436][106225] Updated weights for policy 1, policy_version 1106776 (0.0006) [2023-12-28 03:11:30,485][106225] Updated weights for policy 1, policy_version 1106786 (0.0005) [2023-12-28 03:11:30,537][106225] Updated weights for policy 1, policy_version 1106796 (0.0008) [2023-12-28 03:11:30,625][106226] Updated weights for policy 0, policy_version 1103805 (0.0008) [2023-12-28 03:11:30,672][106226] Updated weights for policy 0, policy_version 1103815 (0.0008) [2023-12-28 03:11:30,718][106226] Updated weights for policy 0, policy_version 1103825 (0.0008) [2023-12-28 03:11:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 566026240. Throughput: 0: 9704.0, 1: 10064.4. Samples: 566018132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:31,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.753')] [2023-12-28 03:11:31,261][106225] Updated weights for policy 1, policy_version 1106806 (0.0009) [2023-12-28 03:11:31,323][106225] Updated weights for policy 1, policy_version 1106816 (0.0008) [2023-12-28 03:11:31,393][106225] Updated weights for policy 1, policy_version 1106826 (0.0011) [2023-12-28 03:11:31,412][106226] Updated weights for policy 0, policy_version 1103835 (0.0007) [2023-12-28 03:11:31,463][106226] Updated weights for policy 0, policy_version 1103845 (0.0008) [2023-12-28 03:11:31,514][106226] Updated weights for policy 0, policy_version 1103855 (0.0008) [2023-12-28 03:11:32,132][106225] Updated weights for policy 1, policy_version 1106836 (0.0007) [2023-12-28 03:11:32,193][106225] Updated weights for policy 1, policy_version 1106846 (0.0007) [2023-12-28 03:11:32,248][106225] Updated weights for policy 1, policy_version 1106856 (0.0008) [2023-12-28 03:11:32,267][106226] Updated weights for policy 0, policy_version 1103865 (0.0008) [2023-12-28 03:11:32,327][106226] Updated weights for policy 0, policy_version 1103875 (0.0007) [2023-12-28 03:11:32,393][106226] Updated weights for policy 0, policy_version 1103885 (0.0008) [2023-12-28 03:11:32,449][106226] Updated weights for policy 0, policy_version 1103895 (0.0008) [2023-12-28 03:11:32,923][106225] Updated weights for policy 1, policy_version 1106866 (0.0008) [2023-12-28 03:11:32,973][106225] Updated weights for policy 1, policy_version 1106876 (0.0009) [2023-12-28 03:11:33,023][106225] Updated weights for policy 1, policy_version 1106886 (0.0008) [2023-12-28 03:11:33,078][106225] Updated weights for policy 1, policy_version 1106896 (0.0009) [2023-12-28 03:11:33,139][106226] Updated weights for policy 0, policy_version 1103905 (0.0009) [2023-12-28 03:11:33,194][106226] Updated weights for policy 0, policy_version 1103915 (0.0009) [2023-12-28 03:11:33,245][106226] Updated weights for policy 0, policy_version 1103925 (0.0007) [2023-12-28 03:11:33,800][106225] Updated weights for policy 1, policy_version 1106906 (0.0006) [2023-12-28 03:11:33,852][106225] Updated weights for policy 1, policy_version 1106916 (0.0005) [2023-12-28 03:11:33,898][106225] Updated weights for policy 1, policy_version 1106926 (0.0005) [2023-12-28 03:11:33,958][106226] Updated weights for policy 0, policy_version 1103935 (0.0006) [2023-12-28 03:11:34,006][106226] Updated weights for policy 0, policy_version 1103945 (0.0005) [2023-12-28 03:11:34,059][106226] Updated weights for policy 0, policy_version 1103955 (0.0005) [2023-12-28 03:11:34,594][106225] Updated weights for policy 1, policy_version 1106936 (0.0009) [2023-12-28 03:11:34,658][106225] Updated weights for policy 1, policy_version 1106946 (0.0007) [2023-12-28 03:11:34,704][106226] Updated weights for policy 0, policy_version 1103965 (0.0006) [2023-12-28 03:11:34,721][106225] Updated weights for policy 1, policy_version 1106956 (0.0009) [2023-12-28 03:11:34,753][106226] Updated weights for policy 0, policy_version 1103975 (0.0009) [2023-12-28 03:11:34,806][106226] Updated weights for policy 0, policy_version 1103985 (0.0008) [2023-12-28 03:11:35,374][106225] Updated weights for policy 1, policy_version 1106966 (0.0010) [2023-12-28 03:11:35,434][106225] Updated weights for policy 1, policy_version 1106976 (0.0010) [2023-12-28 03:11:35,499][106225] Updated weights for policy 1, policy_version 1106986 (0.0010) [2023-12-28 03:11:35,609][106226] Updated weights for policy 0, policy_version 1103995 (0.0008) [2023-12-28 03:11:35,668][106226] Updated weights for policy 0, policy_version 1104005 (0.0006) [2023-12-28 03:11:35,726][106226] Updated weights for policy 0, policy_version 1104015 (0.0006) [2023-12-28 03:11:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566124544. Throughput: 0: 9716.5, 1: 10092.8. Samples: 566137332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:36,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-5.233')] [2023-12-28 03:11:36,183][106225] Updated weights for policy 1, policy_version 1106996 (0.0008) [2023-12-28 03:11:36,249][106225] Updated weights for policy 1, policy_version 1107006 (0.0010) [2023-12-28 03:11:36,313][106225] Updated weights for policy 1, policy_version 1107016 (0.0010) [2023-12-28 03:11:36,454][106226] Updated weights for policy 0, policy_version 1104025 (0.0009) [2023-12-28 03:11:36,522][106226] Updated weights for policy 0, policy_version 1104035 (0.0006) [2023-12-28 03:11:36,582][106226] Updated weights for policy 0, policy_version 1104045 (0.0010) [2023-12-28 03:11:36,647][106226] Updated weights for policy 0, policy_version 1104055 (0.0011) [2023-12-28 03:11:37,000][106225] Updated weights for policy 1, policy_version 1107026 (0.0007) [2023-12-28 03:11:37,058][106225] Updated weights for policy 1, policy_version 1107036 (0.0010) [2023-12-28 03:11:37,104][106225] Updated weights for policy 1, policy_version 1107046 (0.0010) [2023-12-28 03:11:37,157][106225] Updated weights for policy 1, policy_version 1107056 (0.0007) [2023-12-28 03:11:37,338][106226] Updated weights for policy 0, policy_version 1104065 (0.0010) [2023-12-28 03:11:37,398][106226] Updated weights for policy 0, policy_version 1104075 (0.0010) [2023-12-28 03:11:37,464][106226] Updated weights for policy 0, policy_version 1104085 (0.0010) [2023-12-28 03:11:37,821][106225] Updated weights for policy 1, policy_version 1107066 (0.0010) [2023-12-28 03:11:37,867][106225] Updated weights for policy 1, policy_version 1107076 (0.0010) [2023-12-28 03:11:37,914][106225] Updated weights for policy 1, policy_version 1107086 (0.0008) [2023-12-28 03:11:38,167][106226] Updated weights for policy 0, policy_version 1104095 (0.0011) [2023-12-28 03:11:38,228][106226] Updated weights for policy 0, policy_version 1104105 (0.0011) [2023-12-28 03:11:38,293][106226] Updated weights for policy 0, policy_version 1104115 (0.0011) [2023-12-28 03:11:38,655][106225] Updated weights for policy 1, policy_version 1107096 (0.0010) [2023-12-28 03:11:38,717][106225] Updated weights for policy 1, policy_version 1107106 (0.0010) [2023-12-28 03:11:38,782][106225] Updated weights for policy 1, policy_version 1107116 (0.0010) [2023-12-28 03:11:39,010][106226] Updated weights for policy 0, policy_version 1104125 (0.0011) [2023-12-28 03:11:39,067][106226] Updated weights for policy 0, policy_version 1104135 (0.0010) [2023-12-28 03:11:39,123][106226] Updated weights for policy 0, policy_version 1104145 (0.0010) [2023-12-28 03:11:39,515][106225] Updated weights for policy 1, policy_version 1107126 (0.0010) [2023-12-28 03:11:39,573][106225] Updated weights for policy 1, policy_version 1107136 (0.0010) [2023-12-28 03:11:39,631][106225] Updated weights for policy 1, policy_version 1107146 (0.0010) [2023-12-28 03:11:39,858][106226] Updated weights for policy 0, policy_version 1104155 (0.0010) [2023-12-28 03:11:39,930][106226] Updated weights for policy 0, policy_version 1104165 (0.0010) [2023-12-28 03:11:39,985][106226] Updated weights for policy 0, policy_version 1104175 (0.0011) [2023-12-28 03:11:40,312][106225] Updated weights for policy 1, policy_version 1107156 (0.0008) [2023-12-28 03:11:40,377][106225] Updated weights for policy 1, policy_version 1107166 (0.0009) [2023-12-28 03:11:40,431][106225] Updated weights for policy 1, policy_version 1107176 (0.0010) [2023-12-28 03:11:40,669][106226] Updated weights for policy 0, policy_version 1104186 (0.0010) [2023-12-28 03:11:40,731][106226] Updated weights for policy 0, policy_version 1104196 (0.0009) [2023-12-28 03:11:40,790][106226] Updated weights for policy 0, policy_version 1104206 (0.0007) [2023-12-28 03:11:40,852][106226] Updated weights for policy 0, policy_version 1104216 (0.0008) [2023-12-28 03:11:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 566222848. Throughput: 0: 9735.6, 1: 10078.7. Samples: 566195772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:41,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-4.853')] [2023-12-28 03:11:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001104216_282738688.pth... [2023-12-28 03:11:41,190][106225] Updated weights for policy 1, policy_version 1107186 (0.0010) [2023-12-28 03:11:41,206][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001103064_282443776.pth [2023-12-28 03:11:41,260][106225] Updated weights for policy 1, policy_version 1107196 (0.0011) [2023-12-28 03:11:41,316][106225] Updated weights for policy 1, policy_version 1107206 (0.0008) [2023-12-28 03:11:41,383][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001107216_283492352.pth... [2023-12-28 03:11:41,384][106225] Updated weights for policy 1, policy_version 1107216 (0.0009) [2023-12-28 03:11:41,388][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001106032_283189248.pth [2023-12-28 03:11:41,560][106226] Updated weights for policy 0, policy_version 1104226 (0.0009) [2023-12-28 03:11:41,628][106226] Updated weights for policy 0, policy_version 1104236 (0.0009) [2023-12-28 03:11:41,691][106226] Updated weights for policy 0, policy_version 1104246 (0.0007) [2023-12-28 03:11:42,186][106225] Updated weights for policy 1, policy_version 1107226 (0.0008) [2023-12-28 03:11:42,238][106225] Updated weights for policy 1, policy_version 1107236 (0.0008) [2023-12-28 03:11:42,303][106225] Updated weights for policy 1, policy_version 1107246 (0.0009) [2023-12-28 03:11:42,387][106226] Updated weights for policy 0, policy_version 1104256 (0.0009) [2023-12-28 03:11:42,450][106226] Updated weights for policy 0, policy_version 1104266 (0.0009) [2023-12-28 03:11:42,512][106226] Updated weights for policy 0, policy_version 1104276 (0.0008) [2023-12-28 03:11:43,061][106225] Updated weights for policy 1, policy_version 1107256 (0.0006) [2023-12-28 03:11:43,110][106226] Updated weights for policy 0, policy_version 1104286 (0.0008) [2023-12-28 03:11:43,123][106225] Updated weights for policy 1, policy_version 1107266 (0.0005) [2023-12-28 03:11:43,164][106226] Updated weights for policy 0, policy_version 1104296 (0.0005) [2023-12-28 03:11:43,175][106225] Updated weights for policy 1, policy_version 1107276 (0.0005) [2023-12-28 03:11:43,228][106226] Updated weights for policy 0, policy_version 1104306 (0.0011) [2023-12-28 03:11:43,829][106225] Updated weights for policy 1, policy_version 1107286 (0.0005) [2023-12-28 03:11:43,887][106225] Updated weights for policy 1, policy_version 1107296 (0.0005) [2023-12-28 03:11:43,912][106226] Updated weights for policy 0, policy_version 1104316 (0.0011) [2023-12-28 03:11:43,937][106225] Updated weights for policy 1, policy_version 1107306 (0.0005) [2023-12-28 03:11:43,962][106226] Updated weights for policy 0, policy_version 1104326 (0.0010) [2023-12-28 03:11:44,008][106226] Updated weights for policy 0, policy_version 1104336 (0.0010) [2023-12-28 03:11:44,617][106225] Updated weights for policy 1, policy_version 1107316 (0.0006) [2023-12-28 03:11:44,666][106225] Updated weights for policy 1, policy_version 1107326 (0.0008) [2023-12-28 03:11:44,708][106226] Updated weights for policy 0, policy_version 1104346 (0.0009) [2023-12-28 03:11:44,715][106225] Updated weights for policy 1, policy_version 1107336 (0.0009) [2023-12-28 03:11:44,756][106226] Updated weights for policy 0, policy_version 1104356 (0.0006) [2023-12-28 03:11:44,825][106226] Updated weights for policy 0, policy_version 1104366 (0.0007) [2023-12-28 03:11:44,887][106226] Updated weights for policy 0, policy_version 1104376 (0.0007) [2023-12-28 03:11:45,517][106226] Updated weights for policy 0, policy_version 1104386 (0.0005) [2023-12-28 03:11:45,533][106225] Updated weights for policy 1, policy_version 1107346 (0.0008) [2023-12-28 03:11:45,573][106226] Updated weights for policy 0, policy_version 1104396 (0.0005) [2023-12-28 03:11:45,590][106225] Updated weights for policy 1, policy_version 1107356 (0.0008) [2023-12-28 03:11:45,624][106226] Updated weights for policy 0, policy_version 1104406 (0.0005) [2023-12-28 03:11:45,652][106225] Updated weights for policy 1, policy_version 1107366 (0.0008) [2023-12-28 03:11:45,716][106225] Updated weights for policy 1, policy_version 1107376 (0.0006) [2023-12-28 03:11:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566321152. Throughput: 0: 9745.0, 1: 9972.0. Samples: 566312948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:46,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.866')] [2023-12-28 03:11:46,272][106226] Updated weights for policy 0, policy_version 1104416 (0.0008) [2023-12-28 03:11:46,300][106225] Updated weights for policy 1, policy_version 1107386 (0.0005) [2023-12-28 03:11:46,322][106226] Updated weights for policy 0, policy_version 1104426 (0.0010) [2023-12-28 03:11:46,355][106225] Updated weights for policy 1, policy_version 1107396 (0.0005) [2023-12-28 03:11:46,375][106226] Updated weights for policy 0, policy_version 1104436 (0.0010) [2023-12-28 03:11:46,406][106225] Updated weights for policy 1, policy_version 1107406 (0.0005) [2023-12-28 03:11:46,981][106225] Updated weights for policy 1, policy_version 1107416 (0.0007) [2023-12-28 03:11:47,028][106225] Updated weights for policy 1, policy_version 1107426 (0.0008) [2023-12-28 03:11:47,065][106226] Updated weights for policy 0, policy_version 1104446 (0.0009) [2023-12-28 03:11:47,078][106225] Updated weights for policy 1, policy_version 1107436 (0.0007) [2023-12-28 03:11:47,121][106226] Updated weights for policy 0, policy_version 1104456 (0.0010) [2023-12-28 03:11:47,172][106226] Updated weights for policy 0, policy_version 1104466 (0.0010) [2023-12-28 03:11:47,848][106225] Updated weights for policy 1, policy_version 1107446 (0.0006) [2023-12-28 03:11:47,850][106226] Updated weights for policy 0, policy_version 1104476 (0.0008) [2023-12-28 03:11:47,901][106225] Updated weights for policy 1, policy_version 1107456 (0.0006) [2023-12-28 03:11:47,908][106226] Updated weights for policy 0, policy_version 1104486 (0.0010) [2023-12-28 03:11:47,960][106225] Updated weights for policy 1, policy_version 1107466 (0.0007) [2023-12-28 03:11:47,967][106226] Updated weights for policy 0, policy_version 1104496 (0.0007) [2023-12-28 03:11:48,631][106225] Updated weights for policy 1, policy_version 1107476 (0.0010) [2023-12-28 03:11:48,657][106226] Updated weights for policy 0, policy_version 1104506 (0.0008) [2023-12-28 03:11:48,694][106225] Updated weights for policy 1, policy_version 1107486 (0.0009) [2023-12-28 03:11:48,714][106226] Updated weights for policy 0, policy_version 1104516 (0.0006) [2023-12-28 03:11:48,755][106225] Updated weights for policy 1, policy_version 1107496 (0.0007) [2023-12-28 03:11:48,776][106226] Updated weights for policy 0, policy_version 1104526 (0.0009) [2023-12-28 03:11:48,840][106226] Updated weights for policy 0, policy_version 1104536 (0.0008) [2023-12-28 03:11:49,478][106225] Updated weights for policy 1, policy_version 1107506 (0.0007) [2023-12-28 03:11:49,529][106225] Updated weights for policy 1, policy_version 1107516 (0.0008) [2023-12-28 03:11:49,579][106225] Updated weights for policy 1, policy_version 1107526 (0.0005) [2023-12-28 03:11:49,583][106226] Updated weights for policy 0, policy_version 1104546 (0.0009) [2023-12-28 03:11:49,634][106225] Updated weights for policy 1, policy_version 1107536 (0.0005) [2023-12-28 03:11:49,648][106226] Updated weights for policy 0, policy_version 1104556 (0.0009) [2023-12-28 03:11:49,710][106226] Updated weights for policy 0, policy_version 1104566 (0.0010) [2023-12-28 03:11:50,287][106225] Updated weights for policy 1, policy_version 1107546 (0.0009) [2023-12-28 03:11:50,342][106225] Updated weights for policy 1, policy_version 1107556 (0.0009) [2023-12-28 03:11:50,402][106225] Updated weights for policy 1, policy_version 1107566 (0.0007) [2023-12-28 03:11:50,481][106226] Updated weights for policy 0, policy_version 1104576 (0.0006) [2023-12-28 03:11:50,544][106226] Updated weights for policy 0, policy_version 1104586 (0.0005) [2023-12-28 03:11:50,615][106226] Updated weights for policy 0, policy_version 1104596 (0.0007) [2023-12-28 03:11:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566419456. Throughput: 0: 9834.4, 1: 9956.9. Samples: 566433884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:51,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-4.963')] [2023-12-28 03:11:51,203][106225] Updated weights for policy 1, policy_version 1107576 (0.0011) [2023-12-28 03:11:51,242][106226] Updated weights for policy 0, policy_version 1104606 (0.0007) [2023-12-28 03:11:51,272][106225] Updated weights for policy 1, policy_version 1107586 (0.0010) [2023-12-28 03:11:51,312][106226] Updated weights for policy 0, policy_version 1104616 (0.0008) [2023-12-28 03:11:51,337][106225] Updated weights for policy 1, policy_version 1107596 (0.0006) [2023-12-28 03:11:51,386][106226] Updated weights for policy 0, policy_version 1104626 (0.0009) [2023-12-28 03:11:52,085][106226] Updated weights for policy 0, policy_version 1104636 (0.0008) [2023-12-28 03:11:52,148][106226] Updated weights for policy 0, policy_version 1104646 (0.0007) [2023-12-28 03:11:52,150][106225] Updated weights for policy 1, policy_version 1107606 (0.0008) [2023-12-28 03:11:52,209][106225] Updated weights for policy 1, policy_version 1107616 (0.0007) [2023-12-28 03:11:52,210][106226] Updated weights for policy 0, policy_version 1104656 (0.0010) [2023-12-28 03:11:52,298][106225] Updated weights for policy 1, policy_version 1107626 (0.0006) [2023-12-28 03:11:52,927][106226] Updated weights for policy 0, policy_version 1104666 (0.0010) [2023-12-28 03:11:52,947][106225] Updated weights for policy 1, policy_version 1107636 (0.0006) [2023-12-28 03:11:52,995][106226] Updated weights for policy 0, policy_version 1104676 (0.0007) [2023-12-28 03:11:53,003][106225] Updated weights for policy 1, policy_version 1107646 (0.0007) [2023-12-28 03:11:53,052][106226] Updated weights for policy 0, policy_version 1104686 (0.0005) [2023-12-28 03:11:53,054][106225] Updated weights for policy 1, policy_version 1107656 (0.0008) [2023-12-28 03:11:53,101][106226] Updated weights for policy 0, policy_version 1104696 (0.0007) [2023-12-28 03:11:53,717][106225] Updated weights for policy 1, policy_version 1107666 (0.0007) [2023-12-28 03:11:53,783][106225] Updated weights for policy 1, policy_version 1107676 (0.0006) [2023-12-28 03:11:53,794][106226] Updated weights for policy 0, policy_version 1104706 (0.0007) [2023-12-28 03:11:53,839][106225] Updated weights for policy 1, policy_version 1107686 (0.0008) [2023-12-28 03:11:53,849][106226] Updated weights for policy 0, policy_version 1104716 (0.0008) [2023-12-28 03:11:53,890][106225] Updated weights for policy 1, policy_version 1107696 (0.0005) [2023-12-28 03:11:53,906][106226] Updated weights for policy 0, policy_version 1104726 (0.0011) [2023-12-28 03:11:54,588][106225] Updated weights for policy 1, policy_version 1107706 (0.0006) [2023-12-28 03:11:54,597][106226] Updated weights for policy 0, policy_version 1104736 (0.0008) [2023-12-28 03:11:54,639][106225] Updated weights for policy 1, policy_version 1107716 (0.0008) [2023-12-28 03:11:54,657][106226] Updated weights for policy 0, policy_version 1104746 (0.0007) [2023-12-28 03:11:54,682][106225] Updated weights for policy 1, policy_version 1107726 (0.0006) [2023-12-28 03:11:54,713][106226] Updated weights for policy 0, policy_version 1104756 (0.0010) [2023-12-28 03:11:55,379][106226] Updated weights for policy 0, policy_version 1104766 (0.0008) [2023-12-28 03:11:55,430][106225] Updated weights for policy 1, policy_version 1107736 (0.0008) [2023-12-28 03:11:55,456][106226] Updated weights for policy 0, policy_version 1104776 (0.0005) [2023-12-28 03:11:55,484][106225] Updated weights for policy 1, policy_version 1107746 (0.0008) [2023-12-28 03:11:55,522][106226] Updated weights for policy 0, policy_version 1104786 (0.0006) [2023-12-28 03:11:55,544][106225] Updated weights for policy 1, policy_version 1107756 (0.0007) [2023-12-28 03:11:56,008][106226] Updated weights for policy 0, policy_version 1104796 (0.0009) [2023-12-28 03:11:56,071][106226] Updated weights for policy 0, policy_version 1104806 (0.0010) [2023-12-28 03:11:56,135][106226] Updated weights for policy 0, policy_version 1104816 (0.0010) [2023-12-28 03:11:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566517760. Throughput: 0: 9868.5, 1: 9902.9. Samples: 566491848. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:11:56,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.118')] [2023-12-28 03:11:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001107760_283631616.pth... [2023-12-28 03:11:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001104824_282894336.pth... [2023-12-28 03:11:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001103640_282591232.pth [2023-12-28 03:11:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001106608_283336704.pth [2023-12-28 03:11:56,296][106225] Updated weights for policy 1, policy_version 1107766 (0.0007) [2023-12-28 03:11:56,354][106225] Updated weights for policy 1, policy_version 1107776 (0.0008) [2023-12-28 03:11:56,407][106225] Updated weights for policy 1, policy_version 1107786 (0.0008) [2023-12-28 03:11:56,836][106226] Updated weights for policy 0, policy_version 1104826 (0.0008) [2023-12-28 03:11:56,896][106226] Updated weights for policy 0, policy_version 1104836 (0.0009) [2023-12-28 03:11:56,958][106226] Updated weights for policy 0, policy_version 1104846 (0.0008) [2023-12-28 03:11:57,007][106226] Updated weights for policy 0, policy_version 1104856 (0.0005) [2023-12-28 03:11:57,167][106225] Updated weights for policy 1, policy_version 1107796 (0.0009) [2023-12-28 03:11:57,227][106225] Updated weights for policy 1, policy_version 1107806 (0.0007) [2023-12-28 03:11:57,292][106225] Updated weights for policy 1, policy_version 1107816 (0.0009) [2023-12-28 03:11:57,565][106226] Updated weights for policy 0, policy_version 1104866 (0.0009) [2023-12-28 03:11:57,623][106226] Updated weights for policy 0, policy_version 1104876 (0.0009) [2023-12-28 03:11:57,678][106226] Updated weights for policy 0, policy_version 1104886 (0.0009) [2023-12-28 03:11:58,024][106225] Updated weights for policy 1, policy_version 1107826 (0.0007) [2023-12-28 03:11:58,082][106225] Updated weights for policy 1, policy_version 1107836 (0.0008) [2023-12-28 03:11:58,137][106225] Updated weights for policy 1, policy_version 1107846 (0.0008) [2023-12-28 03:11:58,203][106225] Updated weights for policy 1, policy_version 1107856 (0.0009) [2023-12-28 03:11:58,329][106226] Updated weights for policy 0, policy_version 1104896 (0.0008) [2023-12-28 03:11:58,399][106226] Updated weights for policy 0, policy_version 1104906 (0.0008) [2023-12-28 03:11:58,463][106226] Updated weights for policy 0, policy_version 1104916 (0.0007) [2023-12-28 03:11:59,039][106225] Updated weights for policy 1, policy_version 1107866 (0.0007) [2023-12-28 03:11:59,094][106225] Updated weights for policy 1, policy_version 1107876 (0.0008) [2023-12-28 03:11:59,148][106225] Updated weights for policy 1, policy_version 1107886 (0.0007) [2023-12-28 03:11:59,283][106226] Updated weights for policy 0, policy_version 1104926 (0.0009) [2023-12-28 03:11:59,353][106226] Updated weights for policy 0, policy_version 1104936 (0.0008) [2023-12-28 03:11:59,430][106226] Updated weights for policy 0, policy_version 1104946 (0.0007) [2023-12-28 03:11:59,832][106225] Updated weights for policy 1, policy_version 1107896 (0.0006) [2023-12-28 03:11:59,897][106225] Updated weights for policy 1, policy_version 1107906 (0.0007) [2023-12-28 03:11:59,964][106225] Updated weights for policy 1, policy_version 1107916 (0.0010) [2023-12-28 03:12:00,193][106226] Updated weights for policy 0, policy_version 1104956 (0.0007) [2023-12-28 03:12:00,254][106226] Updated weights for policy 0, policy_version 1104966 (0.0008) [2023-12-28 03:12:00,307][106226] Updated weights for policy 0, policy_version 1104976 (0.0009) [2023-12-28 03:12:00,643][106225] Updated weights for policy 1, policy_version 1107926 (0.0007) [2023-12-28 03:12:00,686][106225] Updated weights for policy 1, policy_version 1107936 (0.0005) [2023-12-28 03:12:00,734][106225] Updated weights for policy 1, policy_version 1107946 (0.0005) [2023-12-28 03:12:01,078][106226] Updated weights for policy 0, policy_version 1104986 (0.0009) [2023-12-28 03:12:01,128][106226] Updated weights for policy 0, policy_version 1104996 (0.0008) [2023-12-28 03:12:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566616064. Throughput: 0: 10009.1, 1: 9806.9. Samples: 566609956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:01,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.985')] [2023-12-28 03:12:01,188][106226] Updated weights for policy 0, policy_version 1105006 (0.0007) [2023-12-28 03:12:01,250][106226] Updated weights for policy 0, policy_version 1105016 (0.0008) [2023-12-28 03:12:01,401][106225] Updated weights for policy 1, policy_version 1107956 (0.0005) [2023-12-28 03:12:01,452][106225] Updated weights for policy 1, policy_version 1107966 (0.0005) [2023-12-28 03:12:01,495][106225] Updated weights for policy 1, policy_version 1107976 (0.0005) [2023-12-28 03:12:02,051][106226] Updated weights for policy 0, policy_version 1105026 (0.0009) [2023-12-28 03:12:02,112][106226] Updated weights for policy 0, policy_version 1105036 (0.0011) [2023-12-28 03:12:02,167][106225] Updated weights for policy 1, policy_version 1107986 (0.0006) [2023-12-28 03:12:02,173][106226] Updated weights for policy 0, policy_version 1105046 (0.0011) [2023-12-28 03:12:02,231][106225] Updated weights for policy 1, policy_version 1107996 (0.0008) [2023-12-28 03:12:02,296][106225] Updated weights for policy 1, policy_version 1108006 (0.0007) [2023-12-28 03:12:02,366][106225] Updated weights for policy 1, policy_version 1108016 (0.0008) [2023-12-28 03:12:02,861][106226] Updated weights for policy 0, policy_version 1105056 (0.0011) [2023-12-28 03:12:02,917][106226] Updated weights for policy 0, policy_version 1105066 (0.0010) [2023-12-28 03:12:02,971][106226] Updated weights for policy 0, policy_version 1105076 (0.0010) [2023-12-28 03:12:03,030][106225] Updated weights for policy 1, policy_version 1108026 (0.0006) [2023-12-28 03:12:03,078][106225] Updated weights for policy 1, policy_version 1108036 (0.0008) [2023-12-28 03:12:03,127][106225] Updated weights for policy 1, policy_version 1108046 (0.0008) [2023-12-28 03:12:03,654][106226] Updated weights for policy 0, policy_version 1105086 (0.0011) [2023-12-28 03:12:03,713][106226] Updated weights for policy 0, policy_version 1105096 (0.0010) [2023-12-28 03:12:03,772][106226] Updated weights for policy 0, policy_version 1105106 (0.0010) [2023-12-28 03:12:03,892][106225] Updated weights for policy 1, policy_version 1108056 (0.0007) [2023-12-28 03:12:03,954][106225] Updated weights for policy 1, policy_version 1108066 (0.0008) [2023-12-28 03:12:04,015][106225] Updated weights for policy 1, policy_version 1108076 (0.0008) [2023-12-28 03:12:04,491][106226] Updated weights for policy 0, policy_version 1105116 (0.0011) [2023-12-28 03:12:04,549][106226] Updated weights for policy 0, policy_version 1105126 (0.0008) [2023-12-28 03:12:04,617][106226] Updated weights for policy 0, policy_version 1105136 (0.0007) [2023-12-28 03:12:04,692][106225] Updated weights for policy 1, policy_version 1108086 (0.0007) [2023-12-28 03:12:04,753][106225] Updated weights for policy 1, policy_version 1108096 (0.0005) [2023-12-28 03:12:04,807][106225] Updated weights for policy 1, policy_version 1108106 (0.0005) [2023-12-28 03:12:05,287][106226] Updated weights for policy 0, policy_version 1105146 (0.0007) [2023-12-28 03:12:05,359][106226] Updated weights for policy 0, policy_version 1105156 (0.0010) [2023-12-28 03:12:05,421][106226] Updated weights for policy 0, policy_version 1105166 (0.0009) [2023-12-28 03:12:05,452][106225] Updated weights for policy 1, policy_version 1108116 (0.0005) [2023-12-28 03:12:05,478][106226] Updated weights for policy 0, policy_version 1105176 (0.0008) [2023-12-28 03:12:05,512][106225] Updated weights for policy 1, policy_version 1108126 (0.0008) [2023-12-28 03:12:05,576][106225] Updated weights for policy 1, policy_version 1108136 (0.0008) [2023-12-28 03:12:06,155][106226] Updated weights for policy 0, policy_version 1105186 (0.0009) [2023-12-28 03:12:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 566714368. Throughput: 0: 10043.7, 1: 9839.0. Samples: 566729352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:06,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.635')] [2023-12-28 03:12:06,215][106226] Updated weights for policy 0, policy_version 1105196 (0.0008) [2023-12-28 03:12:06,279][106226] Updated weights for policy 0, policy_version 1105206 (0.0008) [2023-12-28 03:12:06,313][106225] Updated weights for policy 1, policy_version 1108146 (0.0008) [2023-12-28 03:12:06,372][106225] Updated weights for policy 1, policy_version 1108156 (0.0007) [2023-12-28 03:12:06,435][106225] Updated weights for policy 1, policy_version 1108166 (0.0008) [2023-12-28 03:12:06,499][106225] Updated weights for policy 1, policy_version 1108176 (0.0008) [2023-12-28 03:12:06,978][106226] Updated weights for policy 0, policy_version 1105216 (0.0007) [2023-12-28 03:12:07,041][106226] Updated weights for policy 0, policy_version 1105226 (0.0006) [2023-12-28 03:12:07,100][106226] Updated weights for policy 0, policy_version 1105236 (0.0005) [2023-12-28 03:12:07,226][106225] Updated weights for policy 1, policy_version 1108186 (0.0010) [2023-12-28 03:12:07,292][106225] Updated weights for policy 1, policy_version 1108196 (0.0008) [2023-12-28 03:12:07,358][106225] Updated weights for policy 1, policy_version 1108206 (0.0008) [2023-12-28 03:12:07,656][106226] Updated weights for policy 0, policy_version 1105246 (0.0007) [2023-12-28 03:12:07,706][106226] Updated weights for policy 0, policy_version 1105256 (0.0007) [2023-12-28 03:12:07,761][106226] Updated weights for policy 0, policy_version 1105266 (0.0008) [2023-12-28 03:12:08,039][106225] Updated weights for policy 1, policy_version 1108216 (0.0006) [2023-12-28 03:12:08,092][106225] Updated weights for policy 1, policy_version 1108226 (0.0008) [2023-12-28 03:12:08,145][106225] Updated weights for policy 1, policy_version 1108236 (0.0007) [2023-12-28 03:12:08,448][106226] Updated weights for policy 0, policy_version 1105276 (0.0008) [2023-12-28 03:12:08,510][106226] Updated weights for policy 0, policy_version 1105286 (0.0007) [2023-12-28 03:12:08,576][106226] Updated weights for policy 0, policy_version 1105296 (0.0008) [2023-12-28 03:12:08,908][106225] Updated weights for policy 1, policy_version 1108246 (0.0010) [2023-12-28 03:12:08,962][106225] Updated weights for policy 1, policy_version 1108256 (0.0008) [2023-12-28 03:12:09,017][106225] Updated weights for policy 1, policy_version 1108266 (0.0005) [2023-12-28 03:12:09,220][106226] Updated weights for policy 0, policy_version 1105306 (0.0008) [2023-12-28 03:12:09,290][106226] Updated weights for policy 0, policy_version 1105316 (0.0008) [2023-12-28 03:12:09,359][106226] Updated weights for policy 0, policy_version 1105326 (0.0010) [2023-12-28 03:12:09,426][106226] Updated weights for policy 0, policy_version 1105336 (0.0009) [2023-12-28 03:12:09,736][106225] Updated weights for policy 1, policy_version 1108276 (0.0006) [2023-12-28 03:12:09,808][106225] Updated weights for policy 1, policy_version 1108286 (0.0009) [2023-12-28 03:12:09,882][106225] Updated weights for policy 1, policy_version 1108296 (0.0008) [2023-12-28 03:12:10,135][106226] Updated weights for policy 0, policy_version 1105346 (0.0011) [2023-12-28 03:12:10,200][106226] Updated weights for policy 0, policy_version 1105356 (0.0011) [2023-12-28 03:12:10,266][106226] Updated weights for policy 0, policy_version 1105366 (0.0011) [2023-12-28 03:12:10,599][106225] Updated weights for policy 1, policy_version 1108306 (0.0008) [2023-12-28 03:12:10,657][106225] Updated weights for policy 1, policy_version 1108316 (0.0008) [2023-12-28 03:12:10,705][106225] Updated weights for policy 1, policy_version 1108326 (0.0008) [2023-12-28 03:12:10,760][106225] Updated weights for policy 1, policy_version 1108336 (0.0008) [2023-12-28 03:12:10,929][106226] Updated weights for policy 0, policy_version 1105376 (0.0006) [2023-12-28 03:12:10,983][106226] Updated weights for policy 0, policy_version 1105386 (0.0006) [2023-12-28 03:12:11,048][106226] Updated weights for policy 0, policy_version 1105396 (0.0009) [2023-12-28 03:12:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 566820864. Throughput: 0: 10092.4, 1: 9878.4. Samples: 566789484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:11,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.973')] [2023-12-28 03:12:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001105400_283041792.pth... [2023-12-28 03:12:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001108336_283779072.pth... [2023-12-28 03:12:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001104216_282738688.pth [2023-12-28 03:12:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001107216_283492352.pth [2023-12-28 03:12:11,536][106225] Updated weights for policy 1, policy_version 1108346 (0.0008) [2023-12-28 03:12:11,600][106225] Updated weights for policy 1, policy_version 1108356 (0.0010) [2023-12-28 03:12:11,672][106225] Updated weights for policy 1, policy_version 1108366 (0.0008) [2023-12-28 03:12:11,767][106226] Updated weights for policy 0, policy_version 1105406 (0.0010) [2023-12-28 03:12:11,840][106226] Updated weights for policy 0, policy_version 1105416 (0.0011) [2023-12-28 03:12:11,899][106226] Updated weights for policy 0, policy_version 1105426 (0.0009) [2023-12-28 03:12:12,401][106225] Updated weights for policy 1, policy_version 1108376 (0.0007) [2023-12-28 03:12:12,467][106225] Updated weights for policy 1, policy_version 1108386 (0.0007) [2023-12-28 03:12:12,529][106225] Updated weights for policy 1, policy_version 1108396 (0.0009) [2023-12-28 03:12:12,640][106226] Updated weights for policy 0, policy_version 1105436 (0.0010) [2023-12-28 03:12:12,700][106226] Updated weights for policy 0, policy_version 1105446 (0.0005) [2023-12-28 03:12:12,756][106226] Updated weights for policy 0, policy_version 1105456 (0.0007) [2023-12-28 03:12:13,226][106225] Updated weights for policy 1, policy_version 1108406 (0.0008) [2023-12-28 03:12:13,283][106225] Updated weights for policy 1, policy_version 1108416 (0.0008) [2023-12-28 03:12:13,342][106225] Updated weights for policy 1, policy_version 1108426 (0.0006) [2023-12-28 03:12:13,412][106226] Updated weights for policy 0, policy_version 1105466 (0.0008) [2023-12-28 03:12:13,463][106226] Updated weights for policy 0, policy_version 1105476 (0.0007) [2023-12-28 03:12:13,520][106226] Updated weights for policy 0, policy_version 1105486 (0.0009) [2023-12-28 03:12:13,576][106226] Updated weights for policy 0, policy_version 1105496 (0.0009) [2023-12-28 03:12:14,049][106225] Updated weights for policy 1, policy_version 1108436 (0.0007) [2023-12-28 03:12:14,097][106225] Updated weights for policy 1, policy_version 1108446 (0.0008) [2023-12-28 03:12:14,147][106225] Updated weights for policy 1, policy_version 1108456 (0.0007) [2023-12-28 03:12:14,255][106226] Updated weights for policy 0, policy_version 1105506 (0.0009) [2023-12-28 03:12:14,305][106226] Updated weights for policy 0, policy_version 1105517 (0.0009) [2023-12-28 03:12:14,359][106226] Updated weights for policy 0, policy_version 1105527 (0.0009) [2023-12-28 03:12:14,718][106225] Updated weights for policy 1, policy_version 1108466 (0.0005) [2023-12-28 03:12:14,782][106225] Updated weights for policy 1, policy_version 1108476 (0.0006) [2023-12-28 03:12:14,849][106225] Updated weights for policy 1, policy_version 1108486 (0.0008) [2023-12-28 03:12:14,909][106225] Updated weights for policy 1, policy_version 1108496 (0.0008) [2023-12-28 03:12:15,214][106226] Updated weights for policy 0, policy_version 1105537 (0.0008) [2023-12-28 03:12:15,275][106226] Updated weights for policy 0, policy_version 1105547 (0.0008) [2023-12-28 03:12:15,338][106226] Updated weights for policy 0, policy_version 1105557 (0.0009) [2023-12-28 03:12:15,614][106225] Updated weights for policy 1, policy_version 1108506 (0.0008) [2023-12-28 03:12:15,661][106225] Updated weights for policy 1, policy_version 1108516 (0.0008) [2023-12-28 03:12:15,720][106225] Updated weights for policy 1, policy_version 1108526 (0.0009) [2023-12-28 03:12:16,072][106226] Updated weights for policy 0, policy_version 1105567 (0.0007) [2023-12-28 03:12:16,125][106226] Updated weights for policy 0, policy_version 1105577 (0.0006) [2023-12-28 03:12:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 566910976. Throughput: 0: 9928.5, 1: 9821.8. Samples: 566906904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:16,176][105115] Avg episode reward: [(0, '-4.851'), (1, '-4.945')] [2023-12-28 03:12:16,180][106226] Updated weights for policy 0, policy_version 1105587 (0.0007) [2023-12-28 03:12:16,379][106225] Updated weights for policy 1, policy_version 1108536 (0.0008) [2023-12-28 03:12:16,435][106225] Updated weights for policy 1, policy_version 1108546 (0.0007) [2023-12-28 03:12:16,490][106225] Updated weights for policy 1, policy_version 1108556 (0.0009) [2023-12-28 03:12:16,777][106226] Updated weights for policy 0, policy_version 1105597 (0.0005) [2023-12-28 03:12:16,837][106226] Updated weights for policy 0, policy_version 1105607 (0.0005) [2023-12-28 03:12:16,886][106226] Updated weights for policy 0, policy_version 1105617 (0.0008) [2023-12-28 03:12:17,119][106225] Updated weights for policy 1, policy_version 1108566 (0.0007) [2023-12-28 03:12:17,170][106225] Updated weights for policy 1, policy_version 1108576 (0.0005) [2023-12-28 03:12:17,228][106225] Updated weights for policy 1, policy_version 1108586 (0.0005) [2023-12-28 03:12:17,649][106226] Updated weights for policy 0, policy_version 1105627 (0.0009) [2023-12-28 03:12:17,707][106226] Updated weights for policy 0, policy_version 1105637 (0.0008) [2023-12-28 03:12:17,765][106226] Updated weights for policy 0, policy_version 1105647 (0.0009) [2023-12-28 03:12:17,779][106225] Updated weights for policy 1, policy_version 1108596 (0.0006) [2023-12-28 03:12:17,827][106225] Updated weights for policy 1, policy_version 1108606 (0.0007) [2023-12-28 03:12:17,890][106225] Updated weights for policy 1, policy_version 1108616 (0.0009) [2023-12-28 03:12:18,384][106226] Updated weights for policy 0, policy_version 1105657 (0.0009) [2023-12-28 03:12:18,443][106226] Updated weights for policy 0, policy_version 1105667 (0.0008) [2023-12-28 03:12:18,499][106226] Updated weights for policy 0, policy_version 1105677 (0.0008) [2023-12-28 03:12:18,554][106226] Updated weights for policy 0, policy_version 1105687 (0.0008) [2023-12-28 03:12:18,638][106225] Updated weights for policy 1, policy_version 1108626 (0.0011) [2023-12-28 03:12:18,698][106225] Updated weights for policy 1, policy_version 1108636 (0.0010) [2023-12-28 03:12:18,759][106225] Updated weights for policy 1, policy_version 1108646 (0.0010) [2023-12-28 03:12:18,817][106225] Updated weights for policy 1, policy_version 1108656 (0.0009) [2023-12-28 03:12:19,269][106226] Updated weights for policy 0, policy_version 1105697 (0.0008) [2023-12-28 03:12:19,333][106226] Updated weights for policy 0, policy_version 1105707 (0.0008) [2023-12-28 03:12:19,398][106226] Updated weights for policy 0, policy_version 1105717 (0.0009) [2023-12-28 03:12:19,458][106225] Updated weights for policy 1, policy_version 1108666 (0.0008) [2023-12-28 03:12:19,524][106225] Updated weights for policy 1, policy_version 1108676 (0.0008) [2023-12-28 03:12:19,573][106225] Updated weights for policy 1, policy_version 1108686 (0.0008) [2023-12-28 03:12:20,110][106226] Updated weights for policy 0, policy_version 1105727 (0.0011) [2023-12-28 03:12:20,172][106226] Updated weights for policy 0, policy_version 1105737 (0.0011) [2023-12-28 03:12:20,237][106226] Updated weights for policy 0, policy_version 1105747 (0.0011) [2023-12-28 03:12:20,307][106225] Updated weights for policy 1, policy_version 1108696 (0.0007) [2023-12-28 03:12:20,379][106225] Updated weights for policy 1, policy_version 1108706 (0.0007) [2023-12-28 03:12:20,442][106225] Updated weights for policy 1, policy_version 1108716 (0.0008) [2023-12-28 03:12:20,989][106226] Updated weights for policy 0, policy_version 1105757 (0.0009) [2023-12-28 03:12:21,064][106226] Updated weights for policy 0, policy_version 1105767 (0.0008) [2023-12-28 03:12:21,122][106226] Updated weights for policy 0, policy_version 1105777 (0.0008) [2023-12-28 03:12:21,165][106225] Updated weights for policy 1, policy_version 1108726 (0.0009) [2023-12-28 03:12:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 567017472. Throughput: 0: 9922.9, 1: 9844.3. Samples: 567026856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:21,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-5.039')] [2023-12-28 03:12:21,223][106225] Updated weights for policy 1, policy_version 1108736 (0.0010) [2023-12-28 03:12:21,282][106225] Updated weights for policy 1, policy_version 1108746 (0.0007) [2023-12-28 03:12:21,897][106226] Updated weights for policy 0, policy_version 1105787 (0.0007) [2023-12-28 03:12:21,966][106226] Updated weights for policy 0, policy_version 1105797 (0.0006) [2023-12-28 03:12:22,039][106226] Updated weights for policy 0, policy_version 1105807 (0.0008) [2023-12-28 03:12:22,078][106225] Updated weights for policy 1, policy_version 1108756 (0.0008) [2023-12-28 03:12:22,130][106225] Updated weights for policy 1, policy_version 1108766 (0.0008) [2023-12-28 03:12:22,189][106225] Updated weights for policy 1, policy_version 1108776 (0.0008) [2023-12-28 03:12:22,709][106226] Updated weights for policy 0, policy_version 1105817 (0.0008) [2023-12-28 03:12:22,766][106226] Updated weights for policy 0, policy_version 1105827 (0.0009) [2023-12-28 03:12:22,821][106226] Updated weights for policy 0, policy_version 1105837 (0.0011) [2023-12-28 03:12:22,878][106226] Updated weights for policy 0, policy_version 1105847 (0.0010) [2023-12-28 03:12:22,931][106225] Updated weights for policy 1, policy_version 1108786 (0.0008) [2023-12-28 03:12:22,997][106225] Updated weights for policy 1, policy_version 1108796 (0.0006) [2023-12-28 03:12:23,057][106225] Updated weights for policy 1, policy_version 1108806 (0.0009) [2023-12-28 03:12:23,112][106225] Updated weights for policy 1, policy_version 1108816 (0.0005) [2023-12-28 03:12:23,526][106226] Updated weights for policy 0, policy_version 1105857 (0.0008) [2023-12-28 03:12:23,583][106226] Updated weights for policy 0, policy_version 1105867 (0.0008) [2023-12-28 03:12:23,637][106226] Updated weights for policy 0, policy_version 1105877 (0.0007) [2023-12-28 03:12:23,736][106225] Updated weights for policy 1, policy_version 1108826 (0.0010) [2023-12-28 03:12:23,789][106225] Updated weights for policy 1, policy_version 1108836 (0.0010) [2023-12-28 03:12:23,838][106225] Updated weights for policy 1, policy_version 1108846 (0.0010) [2023-12-28 03:12:24,375][106226] Updated weights for policy 0, policy_version 1105887 (0.0008) [2023-12-28 03:12:24,432][106226] Updated weights for policy 0, policy_version 1105897 (0.0008) [2023-12-28 03:12:24,492][106226] Updated weights for policy 0, policy_version 1105907 (0.0007) [2023-12-28 03:12:24,560][106225] Updated weights for policy 1, policy_version 1108856 (0.0010) [2023-12-28 03:12:24,607][106225] Updated weights for policy 1, policy_version 1108866 (0.0010) [2023-12-28 03:12:24,670][106225] Updated weights for policy 1, policy_version 1108876 (0.0010) [2023-12-28 03:12:25,228][106226] Updated weights for policy 0, policy_version 1105917 (0.0008) [2023-12-28 03:12:25,285][106226] Updated weights for policy 0, policy_version 1105927 (0.0008) [2023-12-28 03:12:25,342][106226] Updated weights for policy 0, policy_version 1105937 (0.0008) [2023-12-28 03:12:25,408][106225] Updated weights for policy 1, policy_version 1108886 (0.0010) [2023-12-28 03:12:25,469][106225] Updated weights for policy 1, policy_version 1108896 (0.0010) [2023-12-28 03:12:25,525][106225] Updated weights for policy 1, policy_version 1108906 (0.0010) [2023-12-28 03:12:26,061][106226] Updated weights for policy 0, policy_version 1105947 (0.0008) [2023-12-28 03:12:26,118][106226] Updated weights for policy 0, policy_version 1105957 (0.0008) [2023-12-28 03:12:26,174][106226] Updated weights for policy 0, policy_version 1105967 (0.0008) [2023-12-28 03:12:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 567107584. Throughput: 0: 9932.0, 1: 9826.5. Samples: 567084908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:26,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-5.276')] [2023-12-28 03:12:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001108912_283926528.pth... [2023-12-28 03:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001107760_283631616.pth [2023-12-28 03:12:26,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001105976_283189248.pth... [2023-12-28 03:12:26,226][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001104824_282894336.pth [2023-12-28 03:12:26,249][106225] Updated weights for policy 1, policy_version 1108916 (0.0010) [2023-12-28 03:12:26,302][106225] Updated weights for policy 1, policy_version 1108926 (0.0010) [2023-12-28 03:12:26,358][106225] Updated weights for policy 1, policy_version 1108936 (0.0010) [2023-12-28 03:12:26,824][106226] Updated weights for policy 0, policy_version 1105977 (0.0008) [2023-12-28 03:12:26,880][106226] Updated weights for policy 0, policy_version 1105987 (0.0010) [2023-12-28 03:12:26,935][106226] Updated weights for policy 0, policy_version 1105997 (0.0006) [2023-12-28 03:12:26,959][106225] Updated weights for policy 1, policy_version 1108946 (0.0009) [2023-12-28 03:12:26,996][106226] Updated weights for policy 0, policy_version 1106007 (0.0006) [2023-12-28 03:12:27,022][106225] Updated weights for policy 1, policy_version 1108956 (0.0008) [2023-12-28 03:12:27,071][106225] Updated weights for policy 1, policy_version 1108966 (0.0010) [2023-12-28 03:12:27,120][106225] Updated weights for policy 1, policy_version 1108976 (0.0010) [2023-12-28 03:12:27,591][106226] Updated weights for policy 0, policy_version 1106017 (0.0007) [2023-12-28 03:12:27,646][106226] Updated weights for policy 0, policy_version 1106027 (0.0006) [2023-12-28 03:12:27,702][106226] Updated weights for policy 0, policy_version 1106037 (0.0005) [2023-12-28 03:12:27,756][106225] Updated weights for policy 1, policy_version 1108986 (0.0008) [2023-12-28 03:12:27,813][106225] Updated weights for policy 1, policy_version 1108996 (0.0008) [2023-12-28 03:12:27,870][106225] Updated weights for policy 1, policy_version 1109006 (0.0010) [2023-12-28 03:12:28,389][106226] Updated weights for policy 0, policy_version 1106047 (0.0006) [2023-12-28 03:12:28,450][106226] Updated weights for policy 0, policy_version 1106057 (0.0008) [2023-12-28 03:12:28,512][106226] Updated weights for policy 0, policy_version 1106067 (0.0008) [2023-12-28 03:12:28,551][106225] Updated weights for policy 1, policy_version 1109016 (0.0008) [2023-12-28 03:12:28,608][106225] Updated weights for policy 1, policy_version 1109026 (0.0008) [2023-12-28 03:12:28,662][106225] Updated weights for policy 1, policy_version 1109036 (0.0008) [2023-12-28 03:12:29,214][106226] Updated weights for policy 0, policy_version 1106077 (0.0007) [2023-12-28 03:12:29,280][106226] Updated weights for policy 0, policy_version 1106087 (0.0008) [2023-12-28 03:12:29,343][106226] Updated weights for policy 0, policy_version 1106097 (0.0009) [2023-12-28 03:12:29,422][106225] Updated weights for policy 1, policy_version 1109046 (0.0007) [2023-12-28 03:12:29,486][106225] Updated weights for policy 1, policy_version 1109056 (0.0008) [2023-12-28 03:12:29,546][106225] Updated weights for policy 1, policy_version 1109066 (0.0009) [2023-12-28 03:12:29,980][106226] Updated weights for policy 0, policy_version 1106107 (0.0007) [2023-12-28 03:12:30,033][106226] Updated weights for policy 0, policy_version 1106117 (0.0006) [2023-12-28 03:12:30,082][106226] Updated weights for policy 0, policy_version 1106127 (0.0005) [2023-12-28 03:12:30,368][106225] Updated weights for policy 1, policy_version 1109076 (0.0008) [2023-12-28 03:12:30,420][106225] Updated weights for policy 1, policy_version 1109086 (0.0005) [2023-12-28 03:12:30,476][106225] Updated weights for policy 1, policy_version 1109096 (0.0005) [2023-12-28 03:12:30,695][106226] Updated weights for policy 0, policy_version 1106137 (0.0006) [2023-12-28 03:12:30,748][106226] Updated weights for policy 0, policy_version 1106147 (0.0005) [2023-12-28 03:12:30,798][106226] Updated weights for policy 0, policy_version 1106158 (0.0006) [2023-12-28 03:12:30,848][106226] Updated weights for policy 0, policy_version 1106168 (0.0008) [2023-12-28 03:12:31,139][106225] Updated weights for policy 1, policy_version 1109106 (0.0006) [2023-12-28 03:12:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 567214080. Throughput: 0: 9968.9, 1: 9875.8. Samples: 567205960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:31,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-4.749')] [2023-12-28 03:12:31,204][106225] Updated weights for policy 1, policy_version 1109116 (0.0008) [2023-12-28 03:12:31,270][106225] Updated weights for policy 1, policy_version 1109126 (0.0009) [2023-12-28 03:12:31,330][106225] Updated weights for policy 1, policy_version 1109136 (0.0008) [2023-12-28 03:12:31,582][106226] Updated weights for policy 0, policy_version 1106178 (0.0006) [2023-12-28 03:12:31,651][106226] Updated weights for policy 0, policy_version 1106188 (0.0008) [2023-12-28 03:12:31,718][106226] Updated weights for policy 0, policy_version 1106198 (0.0007) [2023-12-28 03:12:32,038][106225] Updated weights for policy 1, policy_version 1109146 (0.0007) [2023-12-28 03:12:32,098][106225] Updated weights for policy 1, policy_version 1109156 (0.0009) [2023-12-28 03:12:32,157][106225] Updated weights for policy 1, policy_version 1109166 (0.0008) [2023-12-28 03:12:32,427][106226] Updated weights for policy 0, policy_version 1106208 (0.0009) [2023-12-28 03:12:32,485][106226] Updated weights for policy 0, policy_version 1106218 (0.0007) [2023-12-28 03:12:32,533][106226] Updated weights for policy 0, policy_version 1106228 (0.0010) [2023-12-28 03:12:32,797][106225] Updated weights for policy 1, policy_version 1109176 (0.0008) [2023-12-28 03:12:32,861][106225] Updated weights for policy 1, policy_version 1109186 (0.0006) [2023-12-28 03:12:32,919][106225] Updated weights for policy 1, policy_version 1109196 (0.0005) [2023-12-28 03:12:33,248][106226] Updated weights for policy 0, policy_version 1106238 (0.0010) [2023-12-28 03:12:33,305][106226] Updated weights for policy 0, policy_version 1106248 (0.0010) [2023-12-28 03:12:33,358][106226] Updated weights for policy 0, policy_version 1106258 (0.0010) [2023-12-28 03:12:33,433][106225] Updated weights for policy 1, policy_version 1109206 (0.0007) [2023-12-28 03:12:33,493][106225] Updated weights for policy 1, policy_version 1109216 (0.0008) [2023-12-28 03:12:33,551][106225] Updated weights for policy 1, policy_version 1109226 (0.0009) [2023-12-28 03:12:34,010][106226] Updated weights for policy 0, policy_version 1106268 (0.0010) [2023-12-28 03:12:34,059][106226] Updated weights for policy 0, policy_version 1106278 (0.0010) [2023-12-28 03:12:34,113][106226] Updated weights for policy 0, policy_version 1106288 (0.0010) [2023-12-28 03:12:34,271][106225] Updated weights for policy 1, policy_version 1109236 (0.0006) [2023-12-28 03:12:34,338][106225] Updated weights for policy 1, policy_version 1109246 (0.0008) [2023-12-28 03:12:34,398][106225] Updated weights for policy 1, policy_version 1109256 (0.0009) [2023-12-28 03:12:34,806][106226] Updated weights for policy 0, policy_version 1106298 (0.0008) [2023-12-28 03:12:34,866][106226] Updated weights for policy 0, policy_version 1106308 (0.0005) [2023-12-28 03:12:34,922][106226] Updated weights for policy 0, policy_version 1106318 (0.0005) [2023-12-28 03:12:34,972][106226] Updated weights for policy 0, policy_version 1106328 (0.0009) [2023-12-28 03:12:35,118][106225] Updated weights for policy 1, policy_version 1109266 (0.0007) [2023-12-28 03:12:35,163][106225] Updated weights for policy 1, policy_version 1109276 (0.0005) [2023-12-28 03:12:35,209][106225] Updated weights for policy 1, policy_version 1109286 (0.0005) [2023-12-28 03:12:35,254][106225] Updated weights for policy 1, policy_version 1109296 (0.0008) [2023-12-28 03:12:35,603][106226] Updated weights for policy 0, policy_version 1106338 (0.0010) [2023-12-28 03:12:35,650][106226] Updated weights for policy 0, policy_version 1106348 (0.0010) [2023-12-28 03:12:35,701][106226] Updated weights for policy 0, policy_version 1106358 (0.0011) [2023-12-28 03:12:35,977][106225] Updated weights for policy 1, policy_version 1109306 (0.0008) [2023-12-28 03:12:36,027][106225] Updated weights for policy 1, policy_version 1109316 (0.0008) [2023-12-28 03:12:36,084][106225] Updated weights for policy 1, policy_version 1109326 (0.0007) [2023-12-28 03:12:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 567320576. Throughput: 0: 9970.0, 1: 9882.5. Samples: 567327248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:36,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.991')] [2023-12-28 03:12:36,529][106226] Updated weights for policy 0, policy_version 1106368 (0.0009) [2023-12-28 03:12:36,593][106226] Updated weights for policy 0, policy_version 1106378 (0.0009) [2023-12-28 03:12:36,657][106226] Updated weights for policy 0, policy_version 1106388 (0.0009) [2023-12-28 03:12:36,754][106225] Updated weights for policy 1, policy_version 1109336 (0.0008) [2023-12-28 03:12:36,809][106225] Updated weights for policy 1, policy_version 1109346 (0.0007) [2023-12-28 03:12:36,858][106225] Updated weights for policy 1, policy_version 1109356 (0.0007) [2023-12-28 03:12:37,416][106226] Updated weights for policy 0, policy_version 1106398 (0.0011) [2023-12-28 03:12:37,464][106226] Updated weights for policy 0, policy_version 1106408 (0.0006) [2023-12-28 03:12:37,518][106226] Updated weights for policy 0, policy_version 1106418 (0.0009) [2023-12-28 03:12:37,588][106225] Updated weights for policy 1, policy_version 1109366 (0.0007) [2023-12-28 03:12:37,640][106225] Updated weights for policy 1, policy_version 1109376 (0.0005) [2023-12-28 03:12:37,698][106225] Updated weights for policy 1, policy_version 1109386 (0.0005) [2023-12-28 03:12:38,235][106226] Updated weights for policy 0, policy_version 1106428 (0.0011) [2023-12-28 03:12:38,279][106226] Updated weights for policy 0, policy_version 1106438 (0.0010) [2023-12-28 03:12:38,337][106226] Updated weights for policy 0, policy_version 1106448 (0.0011) [2023-12-28 03:12:38,373][106225] Updated weights for policy 1, policy_version 1109396 (0.0007) [2023-12-28 03:12:38,431][106225] Updated weights for policy 1, policy_version 1109406 (0.0008) [2023-12-28 03:12:38,487][106225] Updated weights for policy 1, policy_version 1109416 (0.0008) [2023-12-28 03:12:39,046][106226] Updated weights for policy 0, policy_version 1106458 (0.0011) [2023-12-28 03:12:39,114][106226] Updated weights for policy 0, policy_version 1106468 (0.0010) [2023-12-28 03:12:39,177][106226] Updated weights for policy 0, policy_version 1106478 (0.0011) [2023-12-28 03:12:39,203][106225] Updated weights for policy 1, policy_version 1109426 (0.0007) [2023-12-28 03:12:39,245][106226] Updated weights for policy 0, policy_version 1106488 (0.0009) [2023-12-28 03:12:39,270][106225] Updated weights for policy 1, policy_version 1109436 (0.0008) [2023-12-28 03:12:39,333][106225] Updated weights for policy 1, policy_version 1109446 (0.0010) [2023-12-28 03:12:39,399][106225] Updated weights for policy 1, policy_version 1109456 (0.0009) [2023-12-28 03:12:39,943][106226] Updated weights for policy 0, policy_version 1106498 (0.0008) [2023-12-28 03:12:40,004][106226] Updated weights for policy 0, policy_version 1106508 (0.0008) [2023-12-28 03:12:40,067][106226] Updated weights for policy 0, policy_version 1106518 (0.0008) [2023-12-28 03:12:40,187][106225] Updated weights for policy 1, policy_version 1109466 (0.0011) [2023-12-28 03:12:40,238][106225] Updated weights for policy 1, policy_version 1109476 (0.0010) [2023-12-28 03:12:40,296][106225] Updated weights for policy 1, policy_version 1109486 (0.0011) [2023-12-28 03:12:40,740][106226] Updated weights for policy 0, policy_version 1106528 (0.0006) [2023-12-28 03:12:40,812][106226] Updated weights for policy 0, policy_version 1106538 (0.0006) [2023-12-28 03:12:40,881][106226] Updated weights for policy 0, policy_version 1106548 (0.0006) [2023-12-28 03:12:40,964][106225] Updated weights for policy 1, policy_version 1109496 (0.0011) [2023-12-28 03:12:41,022][106225] Updated weights for policy 1, policy_version 1109506 (0.0010) [2023-12-28 03:12:41,093][106225] Updated weights for policy 1, policy_version 1109516 (0.0009) [2023-12-28 03:12:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 567418880. Throughput: 0: 9957.8, 1: 9909.9. Samples: 567385896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:41,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.941')] [2023-12-28 03:12:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001109520_284082176.pth... [2023-12-28 03:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001106552_283336704.pth... [2023-12-28 03:12:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001108336_283779072.pth [2023-12-28 03:12:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001105400_283041792.pth [2023-12-28 03:12:41,527][106226] Updated weights for policy 0, policy_version 1106558 (0.0007) [2023-12-28 03:12:41,588][106226] Updated weights for policy 0, policy_version 1106568 (0.0010) [2023-12-28 03:12:41,657][106226] Updated weights for policy 0, policy_version 1106578 (0.0009) [2023-12-28 03:12:41,853][106225] Updated weights for policy 1, policy_version 1109526 (0.0008) [2023-12-28 03:12:41,915][106225] Updated weights for policy 1, policy_version 1109536 (0.0008) [2023-12-28 03:12:41,979][106225] Updated weights for policy 1, policy_version 1109546 (0.0007) [2023-12-28 03:12:42,428][106226] Updated weights for policy 0, policy_version 1106588 (0.0010) [2023-12-28 03:12:42,493][106226] Updated weights for policy 0, policy_version 1106598 (0.0007) [2023-12-28 03:12:42,557][106226] Updated weights for policy 0, policy_version 1106608 (0.0006) [2023-12-28 03:12:42,669][106225] Updated weights for policy 1, policy_version 1109556 (0.0009) [2023-12-28 03:12:42,736][106225] Updated weights for policy 1, policy_version 1109566 (0.0006) [2023-12-28 03:12:42,794][106225] Updated weights for policy 1, policy_version 1109576 (0.0005) [2023-12-28 03:12:43,238][106226] Updated weights for policy 0, policy_version 1106618 (0.0006) [2023-12-28 03:12:43,296][106226] Updated weights for policy 0, policy_version 1106628 (0.0008) [2023-12-28 03:12:43,355][106226] Updated weights for policy 0, policy_version 1106638 (0.0005) [2023-12-28 03:12:43,405][106226] Updated weights for policy 0, policy_version 1106648 (0.0005) [2023-12-28 03:12:43,475][106225] Updated weights for policy 1, policy_version 1109586 (0.0008) [2023-12-28 03:12:43,533][106225] Updated weights for policy 1, policy_version 1109596 (0.0008) [2023-12-28 03:12:43,597][106225] Updated weights for policy 1, policy_version 1109606 (0.0008) [2023-12-28 03:12:43,657][106225] Updated weights for policy 1, policy_version 1109616 (0.0006) [2023-12-28 03:12:43,970][106226] Updated weights for policy 0, policy_version 1106658 (0.0006) [2023-12-28 03:12:44,033][106226] Updated weights for policy 0, policy_version 1106668 (0.0006) [2023-12-28 03:12:44,105][106226] Updated weights for policy 0, policy_version 1106678 (0.0008) [2023-12-28 03:12:44,213][106225] Updated weights for policy 1, policy_version 1109626 (0.0005) [2023-12-28 03:12:44,278][106225] Updated weights for policy 1, policy_version 1109636 (0.0006) [2023-12-28 03:12:44,338][106225] Updated weights for policy 1, policy_version 1109646 (0.0007) [2023-12-28 03:12:44,818][106226] Updated weights for policy 0, policy_version 1106688 (0.0008) [2023-12-28 03:12:44,882][106226] Updated weights for policy 0, policy_version 1106698 (0.0007) [2023-12-28 03:12:44,935][106225] Updated weights for policy 1, policy_version 1109656 (0.0008) [2023-12-28 03:12:44,940][106226] Updated weights for policy 0, policy_version 1106708 (0.0006) [2023-12-28 03:12:44,999][106225] Updated weights for policy 1, policy_version 1109666 (0.0006) [2023-12-28 03:12:45,065][106225] Updated weights for policy 1, policy_version 1109676 (0.0008) [2023-12-28 03:12:45,541][106226] Updated weights for policy 0, policy_version 1106718 (0.0008) [2023-12-28 03:12:45,598][106226] Updated weights for policy 0, policy_version 1106728 (0.0006) [2023-12-28 03:12:45,658][106226] Updated weights for policy 0, policy_version 1106738 (0.0005) [2023-12-28 03:12:45,739][106225] Updated weights for policy 1, policy_version 1109686 (0.0010) [2023-12-28 03:12:45,782][106225] Updated weights for policy 1, policy_version 1109696 (0.0010) [2023-12-28 03:12:45,835][106225] Updated weights for policy 1, policy_version 1109706 (0.0010) [2023-12-28 03:12:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 567517184. Throughput: 0: 9918.6, 1: 9993.8. Samples: 567506016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:46,176][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.680')] [2023-12-28 03:12:46,253][106226] Updated weights for policy 0, policy_version 1106748 (0.0007) [2023-12-28 03:12:46,310][106226] Updated weights for policy 0, policy_version 1106758 (0.0008) [2023-12-28 03:12:46,371][106226] Updated weights for policy 0, policy_version 1106768 (0.0007) [2023-12-28 03:12:46,481][106225] Updated weights for policy 1, policy_version 1109716 (0.0009) [2023-12-28 03:12:46,533][106225] Updated weights for policy 1, policy_version 1109726 (0.0005) [2023-12-28 03:12:46,580][106225] Updated weights for policy 1, policy_version 1109736 (0.0005) [2023-12-28 03:12:46,926][106226] Updated weights for policy 0, policy_version 1106778 (0.0005) [2023-12-28 03:12:46,982][106226] Updated weights for policy 0, policy_version 1106788 (0.0006) [2023-12-28 03:12:47,042][106226] Updated weights for policy 0, policy_version 1106798 (0.0009) [2023-12-28 03:12:47,104][106226] Updated weights for policy 0, policy_version 1106808 (0.0011) [2023-12-28 03:12:47,164][106225] Updated weights for policy 1, policy_version 1109746 (0.0006) [2023-12-28 03:12:47,213][106225] Updated weights for policy 1, policy_version 1109756 (0.0005) [2023-12-28 03:12:47,275][106225] Updated weights for policy 1, policy_version 1109766 (0.0007) [2023-12-28 03:12:47,335][106225] Updated weights for policy 1, policy_version 1109776 (0.0005) [2023-12-28 03:12:47,782][106226] Updated weights for policy 0, policy_version 1106818 (0.0011) [2023-12-28 03:12:47,842][106226] Updated weights for policy 0, policy_version 1106828 (0.0010) [2023-12-28 03:12:47,901][106226] Updated weights for policy 0, policy_version 1106838 (0.0010) [2023-12-28 03:12:47,911][106225] Updated weights for policy 1, policy_version 1109786 (0.0006) [2023-12-28 03:12:47,963][106225] Updated weights for policy 1, policy_version 1109796 (0.0007) [2023-12-28 03:12:48,014][106225] Updated weights for policy 1, policy_version 1109806 (0.0007) [2023-12-28 03:12:48,617][106226] Updated weights for policy 0, policy_version 1106848 (0.0011) [2023-12-28 03:12:48,672][106226] Updated weights for policy 0, policy_version 1106858 (0.0011) [2023-12-28 03:12:48,709][106225] Updated weights for policy 1, policy_version 1109816 (0.0007) [2023-12-28 03:12:48,727][106226] Updated weights for policy 0, policy_version 1106868 (0.0010) [2023-12-28 03:12:48,768][106225] Updated weights for policy 1, policy_version 1109826 (0.0006) [2023-12-28 03:12:48,827][106225] Updated weights for policy 1, policy_version 1109836 (0.0008) [2023-12-28 03:12:49,502][106226] Updated weights for policy 0, policy_version 1106878 (0.0011) [2023-12-28 03:12:49,538][106225] Updated weights for policy 1, policy_version 1109846 (0.0009) [2023-12-28 03:12:49,566][106226] Updated weights for policy 0, policy_version 1106888 (0.0011) [2023-12-28 03:12:49,604][106225] Updated weights for policy 1, policy_version 1109856 (0.0011) [2023-12-28 03:12:49,627][106226] Updated weights for policy 0, policy_version 1106898 (0.0010) [2023-12-28 03:12:49,666][106225] Updated weights for policy 1, policy_version 1109866 (0.0010) [2023-12-28 03:12:50,358][106226] Updated weights for policy 0, policy_version 1106908 (0.0011) [2023-12-28 03:12:50,405][106225] Updated weights for policy 1, policy_version 1109876 (0.0008) [2023-12-28 03:12:50,415][106226] Updated weights for policy 0, policy_version 1106918 (0.0011) [2023-12-28 03:12:50,464][106225] Updated weights for policy 1, policy_version 1109886 (0.0005) [2023-12-28 03:12:50,473][106226] Updated weights for policy 0, policy_version 1106928 (0.0010) [2023-12-28 03:12:50,525][106225] Updated weights for policy 1, policy_version 1109896 (0.0006) [2023-12-28 03:12:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 567615488. Throughput: 0: 9983.6, 1: 10025.7. Samples: 567629768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:51,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.976')] [2023-12-28 03:12:51,192][106226] Updated weights for policy 0, policy_version 1106938 (0.0009) [2023-12-28 03:12:51,258][106226] Updated weights for policy 0, policy_version 1106948 (0.0006) [2023-12-28 03:12:51,291][106225] Updated weights for policy 1, policy_version 1109906 (0.0008) [2023-12-28 03:12:51,322][106226] Updated weights for policy 0, policy_version 1106958 (0.0006) [2023-12-28 03:12:51,362][106225] Updated weights for policy 1, policy_version 1109916 (0.0008) [2023-12-28 03:12:51,389][106226] Updated weights for policy 0, policy_version 1106968 (0.0008) [2023-12-28 03:12:51,429][106225] Updated weights for policy 1, policy_version 1109926 (0.0008) [2023-12-28 03:12:51,493][106225] Updated weights for policy 1, policy_version 1109936 (0.0008) [2023-12-28 03:12:52,097][106226] Updated weights for policy 0, policy_version 1106978 (0.0011) [2023-12-28 03:12:52,152][106226] Updated weights for policy 0, policy_version 1106988 (0.0011) [2023-12-28 03:12:52,213][106226] Updated weights for policy 0, policy_version 1106998 (0.0011) [2023-12-28 03:12:52,241][106225] Updated weights for policy 1, policy_version 1109946 (0.0008) [2023-12-28 03:12:52,308][106225] Updated weights for policy 1, policy_version 1109956 (0.0007) [2023-12-28 03:12:52,381][106225] Updated weights for policy 1, policy_version 1109966 (0.0007) [2023-12-28 03:12:52,942][106226] Updated weights for policy 0, policy_version 1107008 (0.0006) [2023-12-28 03:12:53,008][106226] Updated weights for policy 0, policy_version 1107018 (0.0005) [2023-12-28 03:12:53,067][106226] Updated weights for policy 0, policy_version 1107028 (0.0008) [2023-12-28 03:12:53,110][106225] Updated weights for policy 1, policy_version 1109976 (0.0007) [2023-12-28 03:12:53,167][106225] Updated weights for policy 1, policy_version 1109986 (0.0008) [2023-12-28 03:12:53,225][106225] Updated weights for policy 1, policy_version 1109996 (0.0008) [2023-12-28 03:12:53,781][106226] Updated weights for policy 0, policy_version 1107038 (0.0009) [2023-12-28 03:12:53,851][106226] Updated weights for policy 0, policy_version 1107048 (0.0008) [2023-12-28 03:12:53,870][106225] Updated weights for policy 1, policy_version 1110006 (0.0008) [2023-12-28 03:12:53,910][106226] Updated weights for policy 0, policy_version 1107058 (0.0009) [2023-12-28 03:12:53,927][106225] Updated weights for policy 1, policy_version 1110016 (0.0007) [2023-12-28 03:12:53,988][106225] Updated weights for policy 1, policy_version 1110026 (0.0007) [2023-12-28 03:12:54,632][106225] Updated weights for policy 1, policy_version 1110036 (0.0007) [2023-12-28 03:12:54,668][106226] Updated weights for policy 0, policy_version 1107068 (0.0006) [2023-12-28 03:12:54,682][106225] Updated weights for policy 1, policy_version 1110046 (0.0006) [2023-12-28 03:12:54,725][106226] Updated weights for policy 0, policy_version 1107078 (0.0007) [2023-12-28 03:12:54,737][106225] Updated weights for policy 1, policy_version 1110056 (0.0007) [2023-12-28 03:12:54,784][106226] Updated weights for policy 0, policy_version 1107088 (0.0008) [2023-12-28 03:12:55,370][106225] Updated weights for policy 1, policy_version 1110066 (0.0007) [2023-12-28 03:12:55,423][106225] Updated weights for policy 1, policy_version 1110076 (0.0005) [2023-12-28 03:12:55,472][106225] Updated weights for policy 1, policy_version 1110086 (0.0005) [2023-12-28 03:12:55,526][106225] Updated weights for policy 1, policy_version 1110096 (0.0007) [2023-12-28 03:12:55,532][106226] Updated weights for policy 0, policy_version 1107098 (0.0008) [2023-12-28 03:12:55,585][106226] Updated weights for policy 0, policy_version 1107108 (0.0009) [2023-12-28 03:12:55,647][106226] Updated weights for policy 0, policy_version 1107118 (0.0008) [2023-12-28 03:12:55,706][106226] Updated weights for policy 0, policy_version 1107128 (0.0008) [2023-12-28 03:12:56,143][106225] Updated weights for policy 1, policy_version 1110106 (0.0008) [2023-12-28 03:12:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 567713792. Throughput: 0: 9930.3, 1: 10020.2. Samples: 567687256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:12:56,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.658')] [2023-12-28 03:12:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001107128_283484160.pth... [2023-12-28 03:12:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001105976_283189248.pth [2023-12-28 03:12:56,205][106225] Updated weights for policy 1, policy_version 1110116 (0.0006) [2023-12-28 03:12:56,264][106225] Updated weights for policy 1, policy_version 1110126 (0.0006) [2023-12-28 03:12:56,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001110128_284237824.pth... [2023-12-28 03:12:56,276][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001108912_283926528.pth [2023-12-28 03:12:56,458][106226] Updated weights for policy 0, policy_version 1107138 (0.0008) [2023-12-28 03:12:56,522][106226] Updated weights for policy 0, policy_version 1107148 (0.0008) [2023-12-28 03:12:56,587][106226] Updated weights for policy 0, policy_version 1107158 (0.0010) [2023-12-28 03:12:56,857][106225] Updated weights for policy 1, policy_version 1110136 (0.0005) [2023-12-28 03:12:56,916][106225] Updated weights for policy 1, policy_version 1110146 (0.0005) [2023-12-28 03:12:56,967][106225] Updated weights for policy 1, policy_version 1110156 (0.0010) [2023-12-28 03:12:57,312][106226] Updated weights for policy 0, policy_version 1107168 (0.0008) [2023-12-28 03:12:57,386][106226] Updated weights for policy 0, policy_version 1107178 (0.0008) [2023-12-28 03:12:57,445][106226] Updated weights for policy 0, policy_version 1107188 (0.0008) [2023-12-28 03:12:57,609][106225] Updated weights for policy 1, policy_version 1110166 (0.0008) [2023-12-28 03:12:57,661][106225] Updated weights for policy 1, policy_version 1110176 (0.0005) [2023-12-28 03:12:57,718][106225] Updated weights for policy 1, policy_version 1110186 (0.0009) [2023-12-28 03:12:58,036][106226] Updated weights for policy 0, policy_version 1107198 (0.0007) [2023-12-28 03:12:58,086][106226] Updated weights for policy 0, policy_version 1107208 (0.0005) [2023-12-28 03:12:58,143][106226] Updated weights for policy 0, policy_version 1107218 (0.0009) [2023-12-28 03:12:58,520][106225] Updated weights for policy 1, policy_version 1110196 (0.0008) [2023-12-28 03:12:58,586][106225] Updated weights for policy 1, policy_version 1110206 (0.0008) [2023-12-28 03:12:58,658][106225] Updated weights for policy 1, policy_version 1110216 (0.0008) [2023-12-28 03:12:58,820][106226] Updated weights for policy 0, policy_version 1107228 (0.0008) [2023-12-28 03:12:58,891][106226] Updated weights for policy 0, policy_version 1107238 (0.0009) [2023-12-28 03:12:58,956][106226] Updated weights for policy 0, policy_version 1107248 (0.0011) [2023-12-28 03:12:59,480][106225] Updated weights for policy 1, policy_version 1110226 (0.0009) [2023-12-28 03:12:59,525][106225] Updated weights for policy 1, policy_version 1110236 (0.0008) [2023-12-28 03:12:59,571][106225] Updated weights for policy 1, policy_version 1110246 (0.0009) [2023-12-28 03:12:59,623][106225] Updated weights for policy 1, policy_version 1110256 (0.0008) [2023-12-28 03:12:59,684][106226] Updated weights for policy 0, policy_version 1107258 (0.0010) [2023-12-28 03:12:59,740][106226] Updated weights for policy 0, policy_version 1107268 (0.0009) [2023-12-28 03:12:59,794][106226] Updated weights for policy 0, policy_version 1107278 (0.0008) [2023-12-28 03:12:59,854][106226] Updated weights for policy 0, policy_version 1107288 (0.0009) [2023-12-28 03:13:00,380][106225] Updated weights for policy 1, policy_version 1110266 (0.0008) [2023-12-28 03:13:00,427][106225] Updated weights for policy 1, policy_version 1110276 (0.0008) [2023-12-28 03:13:00,480][106225] Updated weights for policy 1, policy_version 1110286 (0.0009) [2023-12-28 03:13:00,582][106226] Updated weights for policy 0, policy_version 1107298 (0.0009) [2023-12-28 03:13:00,631][106226] Updated weights for policy 0, policy_version 1107308 (0.0009) [2023-12-28 03:13:00,680][106226] Updated weights for policy 0, policy_version 1107318 (0.0009) [2023-12-28 03:13:01,152][106225] Updated weights for policy 1, policy_version 1110296 (0.0008) [2023-12-28 03:13:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 567812096. Throughput: 0: 9915.4, 1: 10051.2. Samples: 567805396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:13:01,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.627')] [2023-12-28 03:13:01,208][106225] Updated weights for policy 1, policy_version 1110306 (0.0006) [2023-12-28 03:13:01,271][106225] Updated weights for policy 1, policy_version 1110316 (0.0010) [2023-12-28 03:13:01,481][106226] Updated weights for policy 0, policy_version 1107328 (0.0008) [2023-12-28 03:13:01,536][106226] Updated weights for policy 0, policy_version 1107338 (0.0008) [2023-12-28 03:13:01,595][106226] Updated weights for policy 0, policy_version 1107348 (0.0008) [2023-12-28 03:13:01,972][106225] Updated weights for policy 1, policy_version 1110326 (0.0010) [2023-12-28 03:13:02,029][106225] Updated weights for policy 1, policy_version 1110336 (0.0010) [2023-12-28 03:13:02,082][106225] Updated weights for policy 1, policy_version 1110346 (0.0010) [2023-12-28 03:13:02,345][106226] Updated weights for policy 0, policy_version 1107358 (0.0007) [2023-12-28 03:13:02,413][106226] Updated weights for policy 0, policy_version 1107368 (0.0009) [2023-12-28 03:13:02,469][106226] Updated weights for policy 0, policy_version 1107378 (0.0008) [2023-12-28 03:13:02,774][106225] Updated weights for policy 1, policy_version 1110356 (0.0010) [2023-12-28 03:13:02,832][106225] Updated weights for policy 1, policy_version 1110366 (0.0010) [2023-12-28 03:13:02,896][106225] Updated weights for policy 1, policy_version 1110376 (0.0010) [2023-12-28 03:13:03,202][106226] Updated weights for policy 0, policy_version 1107388 (0.0008) [2023-12-28 03:13:03,263][106226] Updated weights for policy 0, policy_version 1107398 (0.0009) [2023-12-28 03:13:03,325][106226] Updated weights for policy 0, policy_version 1107408 (0.0009) [2023-12-28 03:13:03,467][106225] Updated weights for policy 1, policy_version 1110386 (0.0007) [2023-12-28 03:13:03,517][106225] Updated weights for policy 1, policy_version 1110396 (0.0010) [2023-12-28 03:13:03,570][106225] Updated weights for policy 1, policy_version 1110406 (0.0010) [2023-12-28 03:13:03,619][106225] Updated weights for policy 1, policy_version 1110416 (0.0010) [2023-12-28 03:13:04,027][106226] Updated weights for policy 0, policy_version 1107418 (0.0009) [2023-12-28 03:13:04,078][106226] Updated weights for policy 0, policy_version 1107428 (0.0009) [2023-12-28 03:13:04,132][106226] Updated weights for policy 0, policy_version 1107438 (0.0008) [2023-12-28 03:13:04,196][106226] Updated weights for policy 0, policy_version 1107448 (0.0007) [2023-12-28 03:13:04,341][106225] Updated weights for policy 1, policy_version 1110426 (0.0010) [2023-12-28 03:13:04,405][106225] Updated weights for policy 1, policy_version 1110436 (0.0010) [2023-12-28 03:13:04,461][106225] Updated weights for policy 1, policy_version 1110446 (0.0010) [2023-12-28 03:13:04,908][106226] Updated weights for policy 0, policy_version 1107458 (0.0010) [2023-12-28 03:13:04,963][106226] Updated weights for policy 0, policy_version 1107468 (0.0010) [2023-12-28 03:13:05,014][106226] Updated weights for policy 0, policy_version 1107478 (0.0010) [2023-12-28 03:13:05,109][106225] Updated weights for policy 1, policy_version 1110456 (0.0010) [2023-12-28 03:13:05,157][106225] Updated weights for policy 1, policy_version 1110466 (0.0010) [2023-12-28 03:13:05,200][106225] Updated weights for policy 1, policy_version 1110476 (0.0009) [2023-12-28 03:13:05,756][106226] Updated weights for policy 0, policy_version 1107488 (0.0010) [2023-12-28 03:13:05,808][106225] Updated weights for policy 1, policy_version 1110486 (0.0007) [2023-12-28 03:13:05,815][106226] Updated weights for policy 0, policy_version 1107498 (0.0008) [2023-12-28 03:13:05,867][106225] Updated weights for policy 1, policy_version 1110496 (0.0008) [2023-12-28 03:13:05,875][106226] Updated weights for policy 0, policy_version 1107508 (0.0009) [2023-12-28 03:13:05,929][106225] Updated weights for policy 1, policy_version 1110506 (0.0008) [2023-12-28 03:13:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 567918592. Throughput: 0: 9871.6, 1: 10088.7. Samples: 567925064. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:06,175][105115] Avg episode reward: [(0, '-4.936'), (1, '-4.828')] [2023-12-28 03:13:06,511][106226] Updated weights for policy 0, policy_version 1107518 (0.0006) [2023-12-28 03:13:06,582][106226] Updated weights for policy 0, policy_version 1107528 (0.0006) [2023-12-28 03:13:06,648][106226] Updated weights for policy 0, policy_version 1107538 (0.0007) [2023-12-28 03:13:06,705][106225] Updated weights for policy 1, policy_version 1110516 (0.0009) [2023-12-28 03:13:06,763][106225] Updated weights for policy 1, policy_version 1110526 (0.0010) [2023-12-28 03:13:06,806][106225] Updated weights for policy 1, policy_version 1110536 (0.0010) [2023-12-28 03:13:07,256][106226] Updated weights for policy 0, policy_version 1107548 (0.0008) [2023-12-28 03:13:07,307][106226] Updated weights for policy 0, policy_version 1107558 (0.0010) [2023-12-28 03:13:07,371][106226] Updated weights for policy 0, policy_version 1107568 (0.0011) [2023-12-28 03:13:07,459][106225] Updated weights for policy 1, policy_version 1110546 (0.0010) [2023-12-28 03:13:07,519][106225] Updated weights for policy 1, policy_version 1110556 (0.0010) [2023-12-28 03:13:07,589][106225] Updated weights for policy 1, policy_version 1110566 (0.0010) [2023-12-28 03:13:07,656][106225] Updated weights for policy 1, policy_version 1110576 (0.0010) [2023-12-28 03:13:07,937][106226] Updated weights for policy 0, policy_version 1107578 (0.0010) [2023-12-28 03:13:07,994][106226] Updated weights for policy 0, policy_version 1107588 (0.0008) [2023-12-28 03:13:08,059][106226] Updated weights for policy 0, policy_version 1107598 (0.0008) [2023-12-28 03:13:08,109][106226] Updated weights for policy 0, policy_version 1107608 (0.0008) [2023-12-28 03:13:08,281][106225] Updated weights for policy 1, policy_version 1110586 (0.0010) [2023-12-28 03:13:08,342][106225] Updated weights for policy 1, policy_version 1110596 (0.0010) [2023-12-28 03:13:08,408][106225] Updated weights for policy 1, policy_version 1110606 (0.0010) [2023-12-28 03:13:08,856][106226] Updated weights for policy 0, policy_version 1107618 (0.0007) [2023-12-28 03:13:08,920][106226] Updated weights for policy 0, policy_version 1107628 (0.0006) [2023-12-28 03:13:08,978][106226] Updated weights for policy 0, policy_version 1107638 (0.0009) [2023-12-28 03:13:09,087][106225] Updated weights for policy 1, policy_version 1110616 (0.0006) [2023-12-28 03:13:09,136][106225] Updated weights for policy 1, policy_version 1110626 (0.0005) [2023-12-28 03:13:09,185][106225] Updated weights for policy 1, policy_version 1110636 (0.0005) [2023-12-28 03:13:09,653][106226] Updated weights for policy 0, policy_version 1107648 (0.0008) [2023-12-28 03:13:09,712][106226] Updated weights for policy 0, policy_version 1107658 (0.0006) [2023-12-28 03:13:09,777][106226] Updated weights for policy 0, policy_version 1107668 (0.0009) [2023-12-28 03:13:09,917][106225] Updated weights for policy 1, policy_version 1110646 (0.0007) [2023-12-28 03:13:09,982][106225] Updated weights for policy 1, policy_version 1110656 (0.0008) [2023-12-28 03:13:10,048][106225] Updated weights for policy 1, policy_version 1110666 (0.0006) [2023-12-28 03:13:10,540][106226] Updated weights for policy 0, policy_version 1107678 (0.0008) [2023-12-28 03:13:10,596][106226] Updated weights for policy 0, policy_version 1107688 (0.0009) [2023-12-28 03:13:10,627][106225] Updated weights for policy 1, policy_version 1110676 (0.0006) [2023-12-28 03:13:10,643][106226] Updated weights for policy 0, policy_version 1107698 (0.0008) [2023-12-28 03:13:10,689][106225] Updated weights for policy 1, policy_version 1110686 (0.0005) [2023-12-28 03:13:10,750][106225] Updated weights for policy 1, policy_version 1110696 (0.0007) [2023-12-28 03:13:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 568016896. Throughput: 0: 9925.9, 1: 10100.7. Samples: 567986104. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:11,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.101')] [2023-12-28 03:13:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001110704_284385280.pth... [2023-12-28 03:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001107704_283631616.pth... [2023-12-28 03:13:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001109520_284082176.pth [2023-12-28 03:13:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001106552_283336704.pth [2023-12-28 03:13:11,417][106226] Updated weights for policy 0, policy_version 1107708 (0.0006) [2023-12-28 03:13:11,480][106226] Updated weights for policy 0, policy_version 1107718 (0.0009) [2023-12-28 03:13:11,510][106225] Updated weights for policy 1, policy_version 1110706 (0.0008) [2023-12-28 03:13:11,541][106226] Updated weights for policy 0, policy_version 1107728 (0.0007) [2023-12-28 03:13:11,578][106225] Updated weights for policy 1, policy_version 1110716 (0.0008) [2023-12-28 03:13:11,643][106225] Updated weights for policy 1, policy_version 1110726 (0.0009) [2023-12-28 03:13:11,707][106225] Updated weights for policy 1, policy_version 1110736 (0.0008) [2023-12-28 03:13:12,330][106226] Updated weights for policy 0, policy_version 1107738 (0.0007) [2023-12-28 03:13:12,396][106226] Updated weights for policy 0, policy_version 1107748 (0.0008) [2023-12-28 03:13:12,397][106225] Updated weights for policy 1, policy_version 1110746 (0.0008) [2023-12-28 03:13:12,454][106226] Updated weights for policy 0, policy_version 1107758 (0.0005) [2023-12-28 03:13:12,463][106225] Updated weights for policy 1, policy_version 1110756 (0.0008) [2023-12-28 03:13:12,513][106226] Updated weights for policy 0, policy_version 1107768 (0.0006) [2023-12-28 03:13:12,519][106225] Updated weights for policy 1, policy_version 1110766 (0.0007) [2023-12-28 03:13:13,120][106226] Updated weights for policy 0, policy_version 1107778 (0.0008) [2023-12-28 03:13:13,163][106225] Updated weights for policy 1, policy_version 1110776 (0.0007) [2023-12-28 03:13:13,168][106226] Updated weights for policy 0, policy_version 1107788 (0.0006) [2023-12-28 03:13:13,212][106225] Updated weights for policy 1, policy_version 1110786 (0.0005) [2023-12-28 03:13:13,214][106226] Updated weights for policy 0, policy_version 1107798 (0.0008) [2023-12-28 03:13:13,268][106225] Updated weights for policy 1, policy_version 1110796 (0.0007) [2023-12-28 03:13:13,871][106225] Updated weights for policy 1, policy_version 1110806 (0.0007) [2023-12-28 03:13:13,931][106225] Updated weights for policy 1, policy_version 1110816 (0.0006) [2023-12-28 03:13:13,992][106225] Updated weights for policy 1, policy_version 1110826 (0.0005) [2023-12-28 03:13:14,051][106226] Updated weights for policy 0, policy_version 1107808 (0.0008) [2023-12-28 03:13:14,120][106226] Updated weights for policy 0, policy_version 1107818 (0.0008) [2023-12-28 03:13:14,177][106226] Updated weights for policy 0, policy_version 1107828 (0.0009) [2023-12-28 03:13:14,611][106225] Updated weights for policy 1, policy_version 1110836 (0.0006) [2023-12-28 03:13:14,675][106225] Updated weights for policy 1, policy_version 1110846 (0.0005) [2023-12-28 03:13:14,731][106225] Updated weights for policy 1, policy_version 1110856 (0.0005) [2023-12-28 03:13:14,954][106226] Updated weights for policy 0, policy_version 1107838 (0.0008) [2023-12-28 03:13:15,015][106226] Updated weights for policy 0, policy_version 1107848 (0.0008) [2023-12-28 03:13:15,078][106226] Updated weights for policy 0, policy_version 1107858 (0.0009) [2023-12-28 03:13:15,492][106225] Updated weights for policy 1, policy_version 1110866 (0.0007) [2023-12-28 03:13:15,539][106225] Updated weights for policy 1, policy_version 1110876 (0.0006) [2023-12-28 03:13:15,585][106225] Updated weights for policy 1, policy_version 1110886 (0.0007) [2023-12-28 03:13:15,632][106225] Updated weights for policy 1, policy_version 1110896 (0.0005) [2023-12-28 03:13:15,745][106226] Updated weights for policy 0, policy_version 1107868 (0.0007) [2023-12-28 03:13:15,805][106226] Updated weights for policy 0, policy_version 1107878 (0.0008) [2023-12-28 03:13:15,869][106226] Updated weights for policy 0, policy_version 1107888 (0.0009) [2023-12-28 03:13:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 568115200. Throughput: 0: 9807.7, 1: 10156.3. Samples: 568104340. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:16,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.078')] [2023-12-28 03:13:16,324][106225] Updated weights for policy 1, policy_version 1110906 (0.0009) [2023-12-28 03:13:16,375][106225] Updated weights for policy 1, policy_version 1110916 (0.0005) [2023-12-28 03:13:16,426][106225] Updated weights for policy 1, policy_version 1110926 (0.0008) [2023-12-28 03:13:16,620][106226] Updated weights for policy 0, policy_version 1107898 (0.0010) [2023-12-28 03:13:16,678][106226] Updated weights for policy 0, policy_version 1107908 (0.0008) [2023-12-28 03:13:16,736][106226] Updated weights for policy 0, policy_version 1107918 (0.0006) [2023-12-28 03:13:16,799][106226] Updated weights for policy 0, policy_version 1107928 (0.0005) [2023-12-28 03:13:17,067][106225] Updated weights for policy 1, policy_version 1110936 (0.0010) [2023-12-28 03:13:17,123][106225] Updated weights for policy 1, policy_version 1110946 (0.0010) [2023-12-28 03:13:17,180][106225] Updated weights for policy 1, policy_version 1110956 (0.0010) [2023-12-28 03:13:17,433][106226] Updated weights for policy 0, policy_version 1107938 (0.0005) [2023-12-28 03:13:17,495][106226] Updated weights for policy 0, policy_version 1107948 (0.0005) [2023-12-28 03:13:17,546][106226] Updated weights for policy 0, policy_version 1107958 (0.0006) [2023-12-28 03:13:17,906][106225] Updated weights for policy 1, policy_version 1110966 (0.0010) [2023-12-28 03:13:17,969][106225] Updated weights for policy 1, policy_version 1110976 (0.0010) [2023-12-28 03:13:18,018][106225] Updated weights for policy 1, policy_version 1110986 (0.0010) [2023-12-28 03:13:18,219][106226] Updated weights for policy 0, policy_version 1107968 (0.0007) [2023-12-28 03:13:18,273][106226] Updated weights for policy 0, policy_version 1107978 (0.0008) [2023-12-28 03:13:18,323][106226] Updated weights for policy 0, policy_version 1107988 (0.0008) [2023-12-28 03:13:18,730][106225] Updated weights for policy 1, policy_version 1110996 (0.0010) [2023-12-28 03:13:18,793][106225] Updated weights for policy 1, policy_version 1111006 (0.0010) [2023-12-28 03:13:18,848][106225] Updated weights for policy 1, policy_version 1111016 (0.0010) [2023-12-28 03:13:19,093][106226] Updated weights for policy 0, policy_version 1107998 (0.0007) [2023-12-28 03:13:19,148][106226] Updated weights for policy 0, policy_version 1108008 (0.0007) [2023-12-28 03:13:19,194][106226] Updated weights for policy 0, policy_version 1108018 (0.0008) [2023-12-28 03:13:19,594][106225] Updated weights for policy 1, policy_version 1111026 (0.0010) [2023-12-28 03:13:19,656][106225] Updated weights for policy 1, policy_version 1111036 (0.0010) [2023-12-28 03:13:19,717][106225] Updated weights for policy 1, policy_version 1111046 (0.0010) [2023-12-28 03:13:19,779][106225] Updated weights for policy 1, policy_version 1111056 (0.0011) [2023-12-28 03:13:19,957][106226] Updated weights for policy 0, policy_version 1108028 (0.0008) [2023-12-28 03:13:20,024][106226] Updated weights for policy 0, policy_version 1108038 (0.0011) [2023-12-28 03:13:20,090][106226] Updated weights for policy 0, policy_version 1108048 (0.0008) [2023-12-28 03:13:20,539][106225] Updated weights for policy 1, policy_version 1111066 (0.0008) [2023-12-28 03:13:20,604][106225] Updated weights for policy 1, policy_version 1111076 (0.0008) [2023-12-28 03:13:20,665][106225] Updated weights for policy 1, policy_version 1111086 (0.0008) [2023-12-28 03:13:20,840][106226] Updated weights for policy 0, policy_version 1108058 (0.0011) [2023-12-28 03:13:20,907][106226] Updated weights for policy 0, policy_version 1108068 (0.0009) [2023-12-28 03:13:20,972][106226] Updated weights for policy 0, policy_version 1108078 (0.0006) [2023-12-28 03:13:21,040][106226] Updated weights for policy 0, policy_version 1108088 (0.0008) [2023-12-28 03:13:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 568213504. Throughput: 0: 9759.2, 1: 10099.3. Samples: 568220880. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:21,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.983')] [2023-12-28 03:13:21,477][106225] Updated weights for policy 1, policy_version 1111096 (0.0008) [2023-12-28 03:13:21,538][106225] Updated weights for policy 1, policy_version 1111106 (0.0007) [2023-12-28 03:13:21,589][106225] Updated weights for policy 1, policy_version 1111116 (0.0009) [2023-12-28 03:13:21,784][106226] Updated weights for policy 0, policy_version 1108098 (0.0008) [2023-12-28 03:13:21,839][106226] Updated weights for policy 0, policy_version 1108108 (0.0008) [2023-12-28 03:13:21,897][106226] Updated weights for policy 0, policy_version 1108118 (0.0008) [2023-12-28 03:13:22,366][106225] Updated weights for policy 1, policy_version 1111126 (0.0011) [2023-12-28 03:13:22,435][106225] Updated weights for policy 1, policy_version 1111136 (0.0011) [2023-12-28 03:13:22,503][106225] Updated weights for policy 1, policy_version 1111146 (0.0011) [2023-12-28 03:13:22,540][106226] Updated weights for policy 0, policy_version 1108128 (0.0007) [2023-12-28 03:13:22,609][106226] Updated weights for policy 0, policy_version 1108138 (0.0006) [2023-12-28 03:13:22,673][106226] Updated weights for policy 0, policy_version 1108148 (0.0008) [2023-12-28 03:13:23,230][106225] Updated weights for policy 1, policy_version 1111156 (0.0010) [2023-12-28 03:13:23,283][106225] Updated weights for policy 1, policy_version 1111166 (0.0010) [2023-12-28 03:13:23,309][106226] Updated weights for policy 0, policy_version 1108158 (0.0010) [2023-12-28 03:13:23,333][106225] Updated weights for policy 1, policy_version 1111176 (0.0010) [2023-12-28 03:13:23,356][106226] Updated weights for policy 0, policy_version 1108168 (0.0010) [2023-12-28 03:13:23,416][106226] Updated weights for policy 0, policy_version 1108178 (0.0008) [2023-12-28 03:13:24,004][106225] Updated weights for policy 1, policy_version 1111186 (0.0010) [2023-12-28 03:13:24,036][106226] Updated weights for policy 0, policy_version 1108188 (0.0008) [2023-12-28 03:13:24,054][106225] Updated weights for policy 1, policy_version 1111196 (0.0008) [2023-12-28 03:13:24,095][106226] Updated weights for policy 0, policy_version 1108198 (0.0010) [2023-12-28 03:13:24,104][106225] Updated weights for policy 1, policy_version 1111206 (0.0006) [2023-12-28 03:13:24,157][106226] Updated weights for policy 0, policy_version 1108208 (0.0011) [2023-12-28 03:13:24,168][106225] Updated weights for policy 1, policy_version 1111216 (0.0007) [2023-12-28 03:13:24,744][106226] Updated weights for policy 0, policy_version 1108218 (0.0007) [2023-12-28 03:13:24,771][106225] Updated weights for policy 1, policy_version 1111226 (0.0006) [2023-12-28 03:13:24,810][106226] Updated weights for policy 0, policy_version 1108228 (0.0005) [2023-12-28 03:13:24,838][106225] Updated weights for policy 1, policy_version 1111236 (0.0005) [2023-12-28 03:13:24,870][106226] Updated weights for policy 0, policy_version 1108238 (0.0007) [2023-12-28 03:13:24,896][106225] Updated weights for policy 1, policy_version 1111246 (0.0007) [2023-12-28 03:13:24,937][106226] Updated weights for policy 0, policy_version 1108248 (0.0006) [2023-12-28 03:13:25,444][106226] Updated weights for policy 0, policy_version 1108258 (0.0005) [2023-12-28 03:13:25,502][106225] Updated weights for policy 1, policy_version 1111256 (0.0010) [2023-12-28 03:13:25,503][106226] Updated weights for policy 0, policy_version 1108268 (0.0005) [2023-12-28 03:13:25,549][106225] Updated weights for policy 1, policy_version 1111266 (0.0010) [2023-12-28 03:13:25,559][106226] Updated weights for policy 0, policy_version 1108278 (0.0005) [2023-12-28 03:13:25,594][106225] Updated weights for policy 1, policy_version 1111276 (0.0010) [2023-12-28 03:13:26,053][106226] Updated weights for policy 0, policy_version 1108288 (0.0008) [2023-12-28 03:13:26,112][106226] Updated weights for policy 0, policy_version 1108298 (0.0009) [2023-12-28 03:13:26,161][106226] Updated weights for policy 0, policy_version 1108308 (0.0008) [2023-12-28 03:13:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 568311808. Throughput: 0: 9815.8, 1: 10043.8. Samples: 568279580. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:26,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-5.060')] [2023-12-28 03:13:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001108312_283787264.pth... [2023-12-28 03:13:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001111280_284532736.pth... [2023-12-28 03:13:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001107128_283484160.pth [2023-12-28 03:13:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001110128_284237824.pth [2023-12-28 03:13:26,304][106225] Updated weights for policy 1, policy_version 1111286 (0.0009) [2023-12-28 03:13:26,352][106225] Updated weights for policy 1, policy_version 1111296 (0.0009) [2023-12-28 03:13:26,404][106225] Updated weights for policy 1, policy_version 1111306 (0.0008) [2023-12-28 03:13:26,811][106226] Updated weights for policy 0, policy_version 1108318 (0.0007) [2023-12-28 03:13:26,855][106226] Updated weights for policy 0, policy_version 1108328 (0.0005) [2023-12-28 03:13:26,902][106226] Updated weights for policy 0, policy_version 1108338 (0.0005) [2023-12-28 03:13:27,169][106225] Updated weights for policy 1, policy_version 1111316 (0.0008) [2023-12-28 03:13:27,222][106225] Updated weights for policy 1, policy_version 1111326 (0.0007) [2023-12-28 03:13:27,275][106225] Updated weights for policy 1, policy_version 1111336 (0.0008) [2023-12-28 03:13:27,481][106226] Updated weights for policy 0, policy_version 1108348 (0.0006) [2023-12-28 03:13:27,540][106226] Updated weights for policy 0, policy_version 1108358 (0.0006) [2023-12-28 03:13:27,600][106226] Updated weights for policy 0, policy_version 1108368 (0.0008) [2023-12-28 03:13:28,009][106225] Updated weights for policy 1, policy_version 1111346 (0.0009) [2023-12-28 03:13:28,066][106225] Updated weights for policy 1, policy_version 1111356 (0.0008) [2023-12-28 03:13:28,121][106225] Updated weights for policy 1, policy_version 1111366 (0.0009) [2023-12-28 03:13:28,173][106225] Updated weights for policy 1, policy_version 1111376 (0.0008) [2023-12-28 03:13:28,280][106226] Updated weights for policy 0, policy_version 1108378 (0.0008) [2023-12-28 03:13:28,342][106226] Updated weights for policy 0, policy_version 1108388 (0.0008) [2023-12-28 03:13:28,398][106226] Updated weights for policy 0, policy_version 1108398 (0.0008) [2023-12-28 03:13:28,456][106226] Updated weights for policy 0, policy_version 1108408 (0.0008) [2023-12-28 03:13:28,861][106225] Updated weights for policy 1, policy_version 1111386 (0.0008) [2023-12-28 03:13:28,909][106225] Updated weights for policy 1, policy_version 1111396 (0.0007) [2023-12-28 03:13:28,964][106225] Updated weights for policy 1, policy_version 1111406 (0.0005) [2023-12-28 03:13:29,167][106226] Updated weights for policy 0, policy_version 1108418 (0.0009) [2023-12-28 03:13:29,224][106226] Updated weights for policy 0, policy_version 1108428 (0.0008) [2023-12-28 03:13:29,291][106226] Updated weights for policy 0, policy_version 1108438 (0.0008) [2023-12-28 03:13:29,683][106225] Updated weights for policy 1, policy_version 1111416 (0.0008) [2023-12-28 03:13:29,736][106225] Updated weights for policy 1, policy_version 1111426 (0.0008) [2023-12-28 03:13:29,791][106225] Updated weights for policy 1, policy_version 1111436 (0.0006) [2023-12-28 03:13:30,041][106226] Updated weights for policy 0, policy_version 1108448 (0.0008) [2023-12-28 03:13:30,100][106226] Updated weights for policy 0, policy_version 1108458 (0.0008) [2023-12-28 03:13:30,153][106226] Updated weights for policy 0, policy_version 1108468 (0.0009) [2023-12-28 03:13:30,478][106225] Updated weights for policy 1, policy_version 1111446 (0.0008) [2023-12-28 03:13:30,529][106225] Updated weights for policy 1, policy_version 1111456 (0.0006) [2023-12-28 03:13:30,583][106225] Updated weights for policy 1, policy_version 1111466 (0.0008) [2023-12-28 03:13:30,887][106226] Updated weights for policy 0, policy_version 1108478 (0.0008) [2023-12-28 03:13:30,939][106226] Updated weights for policy 0, policy_version 1108488 (0.0008) [2023-12-28 03:13:30,989][106226] Updated weights for policy 0, policy_version 1108498 (0.0007) [2023-12-28 03:13:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 568418304. Throughput: 0: 9945.3, 1: 10062.1. Samples: 568406344. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:31,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.984')] [2023-12-28 03:13:31,343][106225] Updated weights for policy 1, policy_version 1111476 (0.0008) [2023-12-28 03:13:31,414][106225] Updated weights for policy 1, policy_version 1111486 (0.0009) [2023-12-28 03:13:31,480][106225] Updated weights for policy 1, policy_version 1111496 (0.0010) [2023-12-28 03:13:31,723][106226] Updated weights for policy 0, policy_version 1108508 (0.0008) [2023-12-28 03:13:31,790][106226] Updated weights for policy 0, policy_version 1108518 (0.0010) [2023-12-28 03:13:31,847][106226] Updated weights for policy 0, policy_version 1108528 (0.0009) [2023-12-28 03:13:32,180][106225] Updated weights for policy 1, policy_version 1111506 (0.0010) [2023-12-28 03:13:32,241][106225] Updated weights for policy 1, policy_version 1111516 (0.0008) [2023-12-28 03:13:32,303][106225] Updated weights for policy 1, policy_version 1111526 (0.0007) [2023-12-28 03:13:32,366][106225] Updated weights for policy 1, policy_version 1111536 (0.0005) [2023-12-28 03:13:32,647][106226] Updated weights for policy 0, policy_version 1108538 (0.0009) [2023-12-28 03:13:32,704][106226] Updated weights for policy 0, policy_version 1108548 (0.0010) [2023-12-28 03:13:32,763][106226] Updated weights for policy 0, policy_version 1108558 (0.0010) [2023-12-28 03:13:32,829][106226] Updated weights for policy 0, policy_version 1108568 (0.0010) [2023-12-28 03:13:33,036][106225] Updated weights for policy 1, policy_version 1111546 (0.0005) [2023-12-28 03:13:33,102][106225] Updated weights for policy 1, policy_version 1111556 (0.0005) [2023-12-28 03:13:33,160][106225] Updated weights for policy 1, policy_version 1111566 (0.0009) [2023-12-28 03:13:33,513][106226] Updated weights for policy 0, policy_version 1108578 (0.0008) [2023-12-28 03:13:33,559][106226] Updated weights for policy 0, policy_version 1108588 (0.0007) [2023-12-28 03:13:33,615][106226] Updated weights for policy 0, policy_version 1108598 (0.0005) [2023-12-28 03:13:33,751][106225] Updated weights for policy 1, policy_version 1111576 (0.0009) [2023-12-28 03:13:33,817][106225] Updated weights for policy 1, policy_version 1111586 (0.0010) [2023-12-28 03:13:33,882][106225] Updated weights for policy 1, policy_version 1111596 (0.0010) [2023-12-28 03:13:34,160][106226] Updated weights for policy 0, policy_version 1108608 (0.0007) [2023-12-28 03:13:34,218][106226] Updated weights for policy 0, policy_version 1108618 (0.0007) [2023-12-28 03:13:34,272][106226] Updated weights for policy 0, policy_version 1108628 (0.0008) [2023-12-28 03:13:34,570][106225] Updated weights for policy 1, policy_version 1111606 (0.0010) [2023-12-28 03:13:34,633][106225] Updated weights for policy 1, policy_version 1111616 (0.0011) [2023-12-28 03:13:34,692][106225] Updated weights for policy 1, policy_version 1111626 (0.0010) [2023-12-28 03:13:34,990][106226] Updated weights for policy 0, policy_version 1108638 (0.0009) [2023-12-28 03:13:35,062][106226] Updated weights for policy 0, policy_version 1108648 (0.0006) [2023-12-28 03:13:35,126][106226] Updated weights for policy 0, policy_version 1108658 (0.0006) [2023-12-28 03:13:35,306][106225] Updated weights for policy 1, policy_version 1111636 (0.0010) [2023-12-28 03:13:35,359][106225] Updated weights for policy 1, policy_version 1111646 (0.0010) [2023-12-28 03:13:35,417][106225] Updated weights for policy 1, policy_version 1111656 (0.0008) [2023-12-28 03:13:35,815][106226] Updated weights for policy 0, policy_version 1108668 (0.0009) [2023-12-28 03:13:35,877][106226] Updated weights for policy 0, policy_version 1108678 (0.0008) [2023-12-28 03:13:35,936][106226] Updated weights for policy 0, policy_version 1108688 (0.0008) [2023-12-28 03:13:36,109][106225] Updated weights for policy 1, policy_version 1111666 (0.0006) [2023-12-28 03:13:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 568516608. Throughput: 0: 9899.1, 1: 10030.9. Samples: 568526620. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:36,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.837')] [2023-12-28 03:13:36,179][106225] Updated weights for policy 1, policy_version 1111676 (0.0010) [2023-12-28 03:13:36,247][106225] Updated weights for policy 1, policy_version 1111686 (0.0009) [2023-12-28 03:13:36,315][106225] Updated weights for policy 1, policy_version 1111696 (0.0008) [2023-12-28 03:13:36,752][106226] Updated weights for policy 0, policy_version 1108698 (0.0008) [2023-12-28 03:13:36,815][106226] Updated weights for policy 0, policy_version 1108708 (0.0009) [2023-12-28 03:13:36,875][106226] Updated weights for policy 0, policy_version 1108718 (0.0008) [2023-12-28 03:13:36,896][106225] Updated weights for policy 1, policy_version 1111706 (0.0007) [2023-12-28 03:13:36,937][106226] Updated weights for policy 0, policy_version 1108728 (0.0006) [2023-12-28 03:13:36,951][106225] Updated weights for policy 1, policy_version 1111716 (0.0007) [2023-12-28 03:13:37,003][106225] Updated weights for policy 1, policy_version 1111726 (0.0008) [2023-12-28 03:13:37,674][106225] Updated weights for policy 1, policy_version 1111736 (0.0007) [2023-12-28 03:13:37,692][106226] Updated weights for policy 0, policy_version 1108738 (0.0006) [2023-12-28 03:13:37,728][106225] Updated weights for policy 1, policy_version 1111746 (0.0007) [2023-12-28 03:13:37,753][106226] Updated weights for policy 0, policy_version 1108748 (0.0007) [2023-12-28 03:13:37,776][106225] Updated weights for policy 1, policy_version 1111756 (0.0007) [2023-12-28 03:13:37,814][106226] Updated weights for policy 0, policy_version 1108758 (0.0008) [2023-12-28 03:13:38,403][106226] Updated weights for policy 0, policy_version 1108768 (0.0008) [2023-12-28 03:13:38,465][106226] Updated weights for policy 0, policy_version 1108778 (0.0008) [2023-12-28 03:13:38,479][106225] Updated weights for policy 1, policy_version 1111766 (0.0006) [2023-12-28 03:13:38,525][106226] Updated weights for policy 0, policy_version 1108788 (0.0007) [2023-12-28 03:13:38,538][106225] Updated weights for policy 1, policy_version 1111776 (0.0009) [2023-12-28 03:13:38,586][106225] Updated weights for policy 1, policy_version 1111786 (0.0007) [2023-12-28 03:13:39,271][106226] Updated weights for policy 0, policy_version 1108798 (0.0006) [2023-12-28 03:13:39,332][106226] Updated weights for policy 0, policy_version 1108808 (0.0009) [2023-12-28 03:13:39,338][106225] Updated weights for policy 1, policy_version 1111796 (0.0008) [2023-12-28 03:13:39,400][106226] Updated weights for policy 0, policy_version 1108818 (0.0009) [2023-12-28 03:13:39,409][106225] Updated weights for policy 1, policy_version 1111806 (0.0008) [2023-12-28 03:13:39,476][106225] Updated weights for policy 1, policy_version 1111816 (0.0007) [2023-12-28 03:13:40,176][106226] Updated weights for policy 0, policy_version 1108828 (0.0009) [2023-12-28 03:13:40,227][106226] Updated weights for policy 0, policy_version 1108838 (0.0008) [2023-12-28 03:13:40,269][106225] Updated weights for policy 1, policy_version 1111826 (0.0009) [2023-12-28 03:13:40,288][106226] Updated weights for policy 0, policy_version 1108848 (0.0007) [2023-12-28 03:13:40,328][106225] Updated weights for policy 1, policy_version 1111836 (0.0010) [2023-12-28 03:13:40,393][106225] Updated weights for policy 1, policy_version 1111846 (0.0010) [2023-12-28 03:13:40,459][106225] Updated weights for policy 1, policy_version 1111856 (0.0010) [2023-12-28 03:13:41,042][106226] Updated weights for policy 0, policy_version 1108858 (0.0007) [2023-12-28 03:13:41,104][106226] Updated weights for policy 0, policy_version 1108868 (0.0008) [2023-12-28 03:13:41,169][106226] Updated weights for policy 0, policy_version 1108878 (0.0008) [2023-12-28 03:13:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 568606720. Throughput: 0: 9898.3, 1: 10080.3. Samples: 568586296. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:41,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.903')] [2023-12-28 03:13:41,219][106225] Updated weights for policy 1, policy_version 1111866 (0.0008) [2023-12-28 03:13:41,233][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001108888_283934720.pth... [2023-12-28 03:13:41,235][106226] Updated weights for policy 0, policy_version 1108888 (0.0009) [2023-12-28 03:13:41,237][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001107704_283631616.pth [2023-12-28 03:13:41,238][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001108888_283934720.pth [2023-12-28 03:13:41,285][106225] Updated weights for policy 1, policy_version 1111876 (0.0011) [2023-12-28 03:13:41,349][106225] Updated weights for policy 1, policy_version 1111886 (0.0010) [2023-12-28 03:13:41,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001111888_284688384.pth... [2023-12-28 03:13:41,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001110704_284385280.pth [2023-12-28 03:13:41,370][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001111888_284688384.pth [2023-12-28 03:13:42,033][106226] Updated weights for policy 0, policy_version 1108898 (0.0008) [2023-12-28 03:13:42,086][106226] Updated weights for policy 0, policy_version 1108908 (0.0008) [2023-12-28 03:13:42,135][106225] Updated weights for policy 1, policy_version 1111896 (0.0010) [2023-12-28 03:13:42,137][106226] Updated weights for policy 0, policy_version 1108918 (0.0006) [2023-12-28 03:13:42,182][106225] Updated weights for policy 1, policy_version 1111906 (0.0010) [2023-12-28 03:13:42,237][106225] Updated weights for policy 1, policy_version 1111916 (0.0010) [2023-12-28 03:13:42,832][106226] Updated weights for policy 0, policy_version 1108928 (0.0010) [2023-12-28 03:13:42,893][106226] Updated weights for policy 0, policy_version 1108938 (0.0011) [2023-12-28 03:13:42,960][106226] Updated weights for policy 0, policy_version 1108948 (0.0010) [2023-12-28 03:13:43,026][106225] Updated weights for policy 1, policy_version 1111926 (0.0010) [2023-12-28 03:13:43,085][106225] Updated weights for policy 1, policy_version 1111936 (0.0009) [2023-12-28 03:13:43,146][106225] Updated weights for policy 1, policy_version 1111946 (0.0008) [2023-12-28 03:13:43,551][106226] Updated weights for policy 0, policy_version 1108958 (0.0006) [2023-12-28 03:13:43,614][106226] Updated weights for policy 0, policy_version 1108968 (0.0005) [2023-12-28 03:13:43,666][106226] Updated weights for policy 0, policy_version 1108978 (0.0005) [2023-12-28 03:13:43,959][106225] Updated weights for policy 1, policy_version 1111956 (0.0008) [2023-12-28 03:13:44,011][106225] Updated weights for policy 1, policy_version 1111966 (0.0007) [2023-12-28 03:13:44,061][106225] Updated weights for policy 1, policy_version 1111976 (0.0008) [2023-12-28 03:13:44,185][106226] Updated weights for policy 0, policy_version 1108988 (0.0005) [2023-12-28 03:13:44,252][106226] Updated weights for policy 0, policy_version 1108998 (0.0005) [2023-12-28 03:13:44,305][106226] Updated weights for policy 0, policy_version 1109008 (0.0005) [2023-12-28 03:13:44,759][106225] Updated weights for policy 1, policy_version 1111986 (0.0007) [2023-12-28 03:13:44,822][106225] Updated weights for policy 1, policy_version 1111996 (0.0009) [2023-12-28 03:13:44,885][106225] Updated weights for policy 1, policy_version 1112006 (0.0008) [2023-12-28 03:13:44,915][106226] Updated weights for policy 0, policy_version 1109018 (0.0005) [2023-12-28 03:13:44,943][106225] Updated weights for policy 1, policy_version 1112016 (0.0008) [2023-12-28 03:13:44,976][106226] Updated weights for policy 0, policy_version 1109028 (0.0009) [2023-12-28 03:13:45,041][106226] Updated weights for policy 0, policy_version 1109038 (0.0011) [2023-12-28 03:13:45,113][106226] Updated weights for policy 0, policy_version 1109048 (0.0011) [2023-12-28 03:13:45,656][106225] Updated weights for policy 1, policy_version 1112026 (0.0007) [2023-12-28 03:13:45,703][106225] Updated weights for policy 1, policy_version 1112036 (0.0007) [2023-12-28 03:13:45,749][106225] Updated weights for policy 1, policy_version 1112046 (0.0009) [2023-12-28 03:13:45,799][106226] Updated weights for policy 0, policy_version 1109058 (0.0007) [2023-12-28 03:13:45,845][106226] Updated weights for policy 0, policy_version 1109068 (0.0008) [2023-12-28 03:13:45,896][106226] Updated weights for policy 0, policy_version 1109078 (0.0008) [2023-12-28 03:13:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 568713216. Throughput: 0: 9967.2, 1: 9955.6. Samples: 568701924. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:46,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.572')] [2023-12-28 03:13:46,506][106226] Updated weights for policy 0, policy_version 1109088 (0.0008) [2023-12-28 03:13:46,540][106225] Updated weights for policy 1, policy_version 1112056 (0.0007) [2023-12-28 03:13:46,566][106226] Updated weights for policy 0, policy_version 1109098 (0.0005) [2023-12-28 03:13:46,590][106225] Updated weights for policy 1, policy_version 1112066 (0.0008) [2023-12-28 03:13:46,632][106226] Updated weights for policy 0, policy_version 1109108 (0.0005) [2023-12-28 03:13:46,646][106225] Updated weights for policy 1, policy_version 1112076 (0.0008) [2023-12-28 03:13:47,247][106226] Updated weights for policy 0, policy_version 1109118 (0.0008) [2023-12-28 03:13:47,299][106226] Updated weights for policy 0, policy_version 1109128 (0.0009) [2023-12-28 03:13:47,355][106226] Updated weights for policy 0, policy_version 1109138 (0.0009) [2023-12-28 03:13:47,410][106225] Updated weights for policy 1, policy_version 1112086 (0.0007) [2023-12-28 03:13:47,461][106225] Updated weights for policy 1, policy_version 1112096 (0.0008) [2023-12-28 03:13:47,512][106225] Updated weights for policy 1, policy_version 1112106 (0.0008) [2023-12-28 03:13:48,032][106226] Updated weights for policy 0, policy_version 1109148 (0.0009) [2023-12-28 03:13:48,084][106226] Updated weights for policy 0, policy_version 1109158 (0.0008) [2023-12-28 03:13:48,134][106226] Updated weights for policy 0, policy_version 1109168 (0.0009) [2023-12-28 03:13:48,267][106225] Updated weights for policy 1, policy_version 1112116 (0.0008) [2023-12-28 03:13:48,326][106225] Updated weights for policy 1, policy_version 1112126 (0.0008) [2023-12-28 03:13:48,392][106225] Updated weights for policy 1, policy_version 1112136 (0.0008) [2023-12-28 03:13:48,891][106226] Updated weights for policy 0, policy_version 1109178 (0.0009) [2023-12-28 03:13:48,961][106226] Updated weights for policy 0, policy_version 1109188 (0.0009) [2023-12-28 03:13:49,028][106226] Updated weights for policy 0, policy_version 1109198 (0.0010) [2023-12-28 03:13:49,080][106226] Updated weights for policy 0, policy_version 1109208 (0.0010) [2023-12-28 03:13:49,102][106225] Updated weights for policy 1, policy_version 1112146 (0.0007) [2023-12-28 03:13:49,160][106225] Updated weights for policy 1, policy_version 1112156 (0.0006) [2023-12-28 03:13:49,214][106225] Updated weights for policy 1, policy_version 1112166 (0.0007) [2023-12-28 03:13:49,285][106225] Updated weights for policy 1, policy_version 1112176 (0.0007) [2023-12-28 03:13:49,728][106226] Updated weights for policy 0, policy_version 1109218 (0.0008) [2023-12-28 03:13:49,781][106226] Updated weights for policy 0, policy_version 1109228 (0.0010) [2023-12-28 03:13:49,846][106226] Updated weights for policy 0, policy_version 1109238 (0.0010) [2023-12-28 03:13:50,021][106225] Updated weights for policy 1, policy_version 1112186 (0.0007) [2023-12-28 03:13:50,087][106225] Updated weights for policy 1, policy_version 1112196 (0.0008) [2023-12-28 03:13:50,147][106225] Updated weights for policy 1, policy_version 1112206 (0.0008) [2023-12-28 03:13:50,591][106226] Updated weights for policy 0, policy_version 1109248 (0.0008) [2023-12-28 03:13:50,663][106226] Updated weights for policy 0, policy_version 1109258 (0.0008) [2023-12-28 03:13:50,730][106226] Updated weights for policy 0, policy_version 1109268 (0.0008) [2023-12-28 03:13:50,799][106225] Updated weights for policy 1, policy_version 1112216 (0.0008) [2023-12-28 03:13:50,858][106225] Updated weights for policy 1, policy_version 1112226 (0.0008) [2023-12-28 03:13:50,922][106225] Updated weights for policy 1, policy_version 1112236 (0.0007) [2023-12-28 03:13:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 568811520. Throughput: 0: 10039.5, 1: 9830.5. Samples: 568819212. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:51,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-4.932')] [2023-12-28 03:13:51,512][106226] Updated weights for policy 0, policy_version 1109278 (0.0008) [2023-12-28 03:13:51,569][106226] Updated weights for policy 0, policy_version 1109288 (0.0008) [2023-12-28 03:13:51,630][106226] Updated weights for policy 0, policy_version 1109298 (0.0008) [2023-12-28 03:13:51,688][106225] Updated weights for policy 1, policy_version 1112246 (0.0008) [2023-12-28 03:13:51,757][106225] Updated weights for policy 1, policy_version 1112256 (0.0009) [2023-12-28 03:13:51,811][106225] Updated weights for policy 1, policy_version 1112266 (0.0007) [2023-12-28 03:13:52,414][106225] Updated weights for policy 1, policy_version 1112276 (0.0007) [2023-12-28 03:13:52,450][106226] Updated weights for policy 0, policy_version 1109308 (0.0009) [2023-12-28 03:13:52,472][106225] Updated weights for policy 1, policy_version 1112286 (0.0007) [2023-12-28 03:13:52,510][106226] Updated weights for policy 0, policy_version 1109318 (0.0008) [2023-12-28 03:13:52,525][106225] Updated weights for policy 1, policy_version 1112296 (0.0006) [2023-12-28 03:13:52,569][106226] Updated weights for policy 0, policy_version 1109328 (0.0009) [2023-12-28 03:13:53,257][106226] Updated weights for policy 0, policy_version 1109338 (0.0007) [2023-12-28 03:13:53,298][106225] Updated weights for policy 1, policy_version 1112306 (0.0007) [2023-12-28 03:13:53,321][106226] Updated weights for policy 0, policy_version 1109348 (0.0006) [2023-12-28 03:13:53,353][106225] Updated weights for policy 1, policy_version 1112316 (0.0008) [2023-12-28 03:13:53,371][106226] Updated weights for policy 0, policy_version 1109358 (0.0006) [2023-12-28 03:13:53,413][106225] Updated weights for policy 1, policy_version 1112326 (0.0008) [2023-12-28 03:13:53,430][106226] Updated weights for policy 0, policy_version 1109368 (0.0008) [2023-12-28 03:13:53,475][106225] Updated weights for policy 1, policy_version 1112336 (0.0008) [2023-12-28 03:13:53,984][106226] Updated weights for policy 0, policy_version 1109378 (0.0005) [2023-12-28 03:13:54,040][106226] Updated weights for policy 0, policy_version 1109388 (0.0006) [2023-12-28 03:13:54,093][106226] Updated weights for policy 0, policy_version 1109398 (0.0009) [2023-12-28 03:13:54,277][106225] Updated weights for policy 1, policy_version 1112346 (0.0008) [2023-12-28 03:13:54,339][106225] Updated weights for policy 1, policy_version 1112356 (0.0008) [2023-12-28 03:13:54,390][106225] Updated weights for policy 1, policy_version 1112366 (0.0008) [2023-12-28 03:13:54,756][106226] Updated weights for policy 0, policy_version 1109408 (0.0006) [2023-12-28 03:13:54,807][106226] Updated weights for policy 0, policy_version 1109418 (0.0005) [2023-12-28 03:13:54,852][106226] Updated weights for policy 0, policy_version 1109428 (0.0005) [2023-12-28 03:13:55,077][106225] Updated weights for policy 1, policy_version 1112376 (0.0007) [2023-12-28 03:13:55,132][106225] Updated weights for policy 1, policy_version 1112386 (0.0009) [2023-12-28 03:13:55,186][106225] Updated weights for policy 1, policy_version 1112396 (0.0009) [2023-12-28 03:13:55,492][106226] Updated weights for policy 0, policy_version 1109438 (0.0006) [2023-12-28 03:13:55,539][106226] Updated weights for policy 0, policy_version 1109448 (0.0009) [2023-12-28 03:13:55,594][106226] Updated weights for policy 0, policy_version 1109458 (0.0009) [2023-12-28 03:13:55,900][106225] Updated weights for policy 1, policy_version 1112406 (0.0007) [2023-12-28 03:13:55,957][106225] Updated weights for policy 1, policy_version 1112416 (0.0005) [2023-12-28 03:13:56,021][106225] Updated weights for policy 1, policy_version 1112426 (0.0005) [2023-12-28 03:13:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 568909824. Throughput: 0: 10004.6, 1: 9802.8. Samples: 568877432. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:13:56,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.636')] [2023-12-28 03:13:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001112432_284827648.pth... [2023-12-28 03:13:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001109464_284082176.pth... [2023-12-28 03:13:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001108312_283787264.pth [2023-12-28 03:13:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001111280_284532736.pth [2023-12-28 03:13:56,356][106226] Updated weights for policy 0, policy_version 1109468 (0.0009) [2023-12-28 03:13:56,407][106226] Updated weights for policy 0, policy_version 1109478 (0.0009) [2023-12-28 03:13:56,463][106226] Updated weights for policy 0, policy_version 1109488 (0.0009) [2023-12-28 03:13:56,644][106225] Updated weights for policy 1, policy_version 1112436 (0.0007) [2023-12-28 03:13:56,691][106225] Updated weights for policy 1, policy_version 1112446 (0.0008) [2023-12-28 03:13:56,739][106225] Updated weights for policy 1, policy_version 1112456 (0.0008) [2023-12-28 03:13:57,207][106226] Updated weights for policy 0, policy_version 1109498 (0.0009) [2023-12-28 03:13:57,269][106226] Updated weights for policy 0, policy_version 1109508 (0.0009) [2023-12-28 03:13:57,331][106226] Updated weights for policy 0, policy_version 1109518 (0.0009) [2023-12-28 03:13:57,390][106226] Updated weights for policy 0, policy_version 1109528 (0.0009) [2023-12-28 03:13:57,463][106225] Updated weights for policy 1, policy_version 1112466 (0.0008) [2023-12-28 03:13:57,520][106225] Updated weights for policy 1, policy_version 1112476 (0.0008) [2023-12-28 03:13:57,577][106225] Updated weights for policy 1, policy_version 1112486 (0.0008) [2023-12-28 03:13:57,628][106225] Updated weights for policy 1, policy_version 1112496 (0.0009) [2023-12-28 03:13:58,093][106226] Updated weights for policy 0, policy_version 1109538 (0.0006) [2023-12-28 03:13:58,144][106226] Updated weights for policy 0, policy_version 1109548 (0.0006) [2023-12-28 03:13:58,203][106226] Updated weights for policy 0, policy_version 1109558 (0.0009) [2023-12-28 03:13:58,346][106225] Updated weights for policy 1, policy_version 1112506 (0.0008) [2023-12-28 03:13:58,414][106225] Updated weights for policy 1, policy_version 1112516 (0.0007) [2023-12-28 03:13:58,482][106225] Updated weights for policy 1, policy_version 1112526 (0.0009) [2023-12-28 03:13:59,026][106226] Updated weights for policy 0, policy_version 1109568 (0.0008) [2023-12-28 03:13:59,093][106226] Updated weights for policy 0, policy_version 1109578 (0.0010) [2023-12-28 03:13:59,151][106226] Updated weights for policy 0, policy_version 1109588 (0.0010) [2023-12-28 03:13:59,319][106225] Updated weights for policy 1, policy_version 1112536 (0.0007) [2023-12-28 03:13:59,388][106225] Updated weights for policy 1, policy_version 1112546 (0.0008) [2023-12-28 03:13:59,457][106225] Updated weights for policy 1, policy_version 1112556 (0.0008) [2023-12-28 03:13:59,813][106226] Updated weights for policy 0, policy_version 1109598 (0.0010) [2023-12-28 03:13:59,877][106226] Updated weights for policy 0, policy_version 1109608 (0.0011) [2023-12-28 03:13:59,949][106226] Updated weights for policy 0, policy_version 1109618 (0.0009) [2023-12-28 03:14:00,227][106225] Updated weights for policy 1, policy_version 1112566 (0.0008) [2023-12-28 03:14:00,292][106225] Updated weights for policy 1, policy_version 1112576 (0.0007) [2023-12-28 03:14:00,359][106225] Updated weights for policy 1, policy_version 1112586 (0.0006) [2023-12-28 03:14:00,600][106226] Updated weights for policy 0, policy_version 1109628 (0.0008) [2023-12-28 03:14:00,673][106226] Updated weights for policy 0, policy_version 1109638 (0.0009) [2023-12-28 03:14:00,744][106226] Updated weights for policy 0, policy_version 1109648 (0.0010) [2023-12-28 03:14:00,907][106225] Updated weights for policy 1, policy_version 1112596 (0.0005) [2023-12-28 03:14:00,960][106225] Updated weights for policy 1, policy_version 1112606 (0.0005) [2023-12-28 03:14:01,017][106225] Updated weights for policy 1, policy_version 1112616 (0.0006) [2023-12-28 03:14:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 569008128. Throughput: 0: 10051.8, 1: 9700.2. Samples: 568993180. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:01,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.906')] [2023-12-28 03:14:01,496][106226] Updated weights for policy 0, policy_version 1109658 (0.0009) [2023-12-28 03:14:01,544][106226] Updated weights for policy 0, policy_version 1109668 (0.0009) [2023-12-28 03:14:01,591][106226] Updated weights for policy 0, policy_version 1109678 (0.0008) [2023-12-28 03:14:01,651][106226] Updated weights for policy 0, policy_version 1109688 (0.0009) [2023-12-28 03:14:01,693][106225] Updated weights for policy 1, policy_version 1112626 (0.0007) [2023-12-28 03:14:01,762][106225] Updated weights for policy 1, policy_version 1112636 (0.0009) [2023-12-28 03:14:01,826][106225] Updated weights for policy 1, policy_version 1112646 (0.0008) [2023-12-28 03:14:01,886][106225] Updated weights for policy 1, policy_version 1112656 (0.0008) [2023-12-28 03:14:02,387][106226] Updated weights for policy 0, policy_version 1109698 (0.0009) [2023-12-28 03:14:02,452][106226] Updated weights for policy 0, policy_version 1109708 (0.0007) [2023-12-28 03:14:02,526][106226] Updated weights for policy 0, policy_version 1109718 (0.0006) [2023-12-28 03:14:02,599][106225] Updated weights for policy 1, policy_version 1112666 (0.0009) [2023-12-28 03:14:02,662][106225] Updated weights for policy 1, policy_version 1112676 (0.0010) [2023-12-28 03:14:02,727][106225] Updated weights for policy 1, policy_version 1112686 (0.0008) [2023-12-28 03:14:03,078][106226] Updated weights for policy 0, policy_version 1109728 (0.0008) [2023-12-28 03:14:03,122][106226] Updated weights for policy 0, policy_version 1109738 (0.0008) [2023-12-28 03:14:03,182][106226] Updated weights for policy 0, policy_version 1109748 (0.0008) [2023-12-28 03:14:03,478][106225] Updated weights for policy 1, policy_version 1112696 (0.0007) [2023-12-28 03:14:03,528][106225] Updated weights for policy 1, policy_version 1112706 (0.0008) [2023-12-28 03:14:03,581][106225] Updated weights for policy 1, policy_version 1112716 (0.0008) [2023-12-28 03:14:03,905][106226] Updated weights for policy 0, policy_version 1109758 (0.0009) [2023-12-28 03:14:03,968][106226] Updated weights for policy 0, policy_version 1109768 (0.0011) [2023-12-28 03:14:04,022][106226] Updated weights for policy 0, policy_version 1109778 (0.0011) [2023-12-28 03:14:04,206][106225] Updated weights for policy 1, policy_version 1112726 (0.0007) [2023-12-28 03:14:04,266][106225] Updated weights for policy 1, policy_version 1112736 (0.0008) [2023-12-28 03:14:04,329][106225] Updated weights for policy 1, policy_version 1112746 (0.0008) [2023-12-28 03:14:04,646][106226] Updated weights for policy 0, policy_version 1109788 (0.0011) [2023-12-28 03:14:04,702][106226] Updated weights for policy 0, policy_version 1109798 (0.0007) [2023-12-28 03:14:04,771][106226] Updated weights for policy 0, policy_version 1109808 (0.0006) [2023-12-28 03:14:05,137][106225] Updated weights for policy 1, policy_version 1112756 (0.0009) [2023-12-28 03:14:05,198][106225] Updated weights for policy 1, policy_version 1112766 (0.0008) [2023-12-28 03:14:05,259][106225] Updated weights for policy 1, policy_version 1112776 (0.0008) [2023-12-28 03:14:05,314][106226] Updated weights for policy 0, policy_version 1109818 (0.0005) [2023-12-28 03:14:05,366][106226] Updated weights for policy 0, policy_version 1109828 (0.0005) [2023-12-28 03:14:05,433][106226] Updated weights for policy 0, policy_version 1109838 (0.0005) [2023-12-28 03:14:05,495][106226] Updated weights for policy 0, policy_version 1109848 (0.0005) [2023-12-28 03:14:06,023][106226] Updated weights for policy 0, policy_version 1109858 (0.0007) [2023-12-28 03:14:06,087][106225] Updated weights for policy 1, policy_version 1112786 (0.0008) [2023-12-28 03:14:06,089][106226] Updated weights for policy 0, policy_version 1109868 (0.0008) [2023-12-28 03:14:06,149][106226] Updated weights for policy 0, policy_version 1109878 (0.0007) [2023-12-28 03:14:06,154][106225] Updated weights for policy 1, policy_version 1112796 (0.0008) [2023-12-28 03:14:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 569106432. Throughput: 0: 10180.0, 1: 9708.1. Samples: 569115844. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:06,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.739')] [2023-12-28 03:14:06,221][106225] Updated weights for policy 1, policy_version 1112806 (0.0009) [2023-12-28 03:14:06,287][106225] Updated weights for policy 1, policy_version 1112816 (0.0009) [2023-12-28 03:14:06,909][106226] Updated weights for policy 0, policy_version 1109888 (0.0007) [2023-12-28 03:14:06,971][106226] Updated weights for policy 0, policy_version 1109898 (0.0008) [2023-12-28 03:14:07,019][106225] Updated weights for policy 1, policy_version 1112826 (0.0007) [2023-12-28 03:14:07,025][106226] Updated weights for policy 0, policy_version 1109908 (0.0005) [2023-12-28 03:14:07,088][106225] Updated weights for policy 1, policy_version 1112836 (0.0009) [2023-12-28 03:14:07,157][106225] Updated weights for policy 1, policy_version 1112846 (0.0011) [2023-12-28 03:14:07,617][106226] Updated weights for policy 0, policy_version 1109918 (0.0007) [2023-12-28 03:14:07,670][106226] Updated weights for policy 0, policy_version 1109928 (0.0008) [2023-12-28 03:14:07,721][106226] Updated weights for policy 0, policy_version 1109938 (0.0008) [2023-12-28 03:14:07,878][106225] Updated weights for policy 1, policy_version 1112856 (0.0010) [2023-12-28 03:14:07,941][106225] Updated weights for policy 1, policy_version 1112866 (0.0006) [2023-12-28 03:14:08,006][106225] Updated weights for policy 1, policy_version 1112876 (0.0005) [2023-12-28 03:14:08,385][106226] Updated weights for policy 0, policy_version 1109948 (0.0008) [2023-12-28 03:14:08,443][106226] Updated weights for policy 0, policy_version 1109958 (0.0008) [2023-12-28 03:14:08,496][106226] Updated weights for policy 0, policy_version 1109968 (0.0007) [2023-12-28 03:14:08,628][106225] Updated weights for policy 1, policy_version 1112886 (0.0008) [2023-12-28 03:14:08,693][106225] Updated weights for policy 1, policy_version 1112896 (0.0011) [2023-12-28 03:14:08,752][106225] Updated weights for policy 1, policy_version 1112906 (0.0010) [2023-12-28 03:14:09,173][106226] Updated weights for policy 0, policy_version 1109978 (0.0007) [2023-12-28 03:14:09,244][106226] Updated weights for policy 0, policy_version 1109988 (0.0009) [2023-12-28 03:14:09,316][106226] Updated weights for policy 0, policy_version 1109998 (0.0007) [2023-12-28 03:14:09,402][106226] Updated weights for policy 0, policy_version 1110008 (0.0009) [2023-12-28 03:14:09,472][106225] Updated weights for policy 1, policy_version 1112916 (0.0008) [2023-12-28 03:14:09,542][106225] Updated weights for policy 1, policy_version 1112926 (0.0008) [2023-12-28 03:14:09,615][106225] Updated weights for policy 1, policy_version 1112936 (0.0007) [2023-12-28 03:14:10,106][106226] Updated weights for policy 0, policy_version 1110018 (0.0011) [2023-12-28 03:14:10,167][106226] Updated weights for policy 0, policy_version 1110028 (0.0011) [2023-12-28 03:14:10,230][106226] Updated weights for policy 0, policy_version 1110038 (0.0011) [2023-12-28 03:14:10,301][106225] Updated weights for policy 1, policy_version 1112946 (0.0008) [2023-12-28 03:14:10,366][106225] Updated weights for policy 1, policy_version 1112956 (0.0008) [2023-12-28 03:14:10,432][106225] Updated weights for policy 1, policy_version 1112966 (0.0008) [2023-12-28 03:14:10,494][106225] Updated weights for policy 1, policy_version 1112976 (0.0008) [2023-12-28 03:14:10,966][106226] Updated weights for policy 0, policy_version 1110048 (0.0011) [2023-12-28 03:14:11,028][106226] Updated weights for policy 0, policy_version 1110058 (0.0010) [2023-12-28 03:14:11,096][106226] Updated weights for policy 0, policy_version 1110068 (0.0011) [2023-12-28 03:14:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 569204736. Throughput: 0: 10172.3, 1: 9739.0. Samples: 569175584. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:11,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-5.117')] [2023-12-28 03:14:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001110072_284237824.pth... [2023-12-28 03:14:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001108888_283934720.pth [2023-12-28 03:14:11,187][106225] Updated weights for policy 1, policy_version 1112986 (0.0008) [2023-12-28 03:14:11,252][106225] Updated weights for policy 1, policy_version 1112996 (0.0007) [2023-12-28 03:14:11,306][106225] Updated weights for policy 1, policy_version 1113006 (0.0006) [2023-12-28 03:14:11,317][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001113008_284975104.pth... [2023-12-28 03:14:11,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001111888_284688384.pth [2023-12-28 03:14:11,866][106226] Updated weights for policy 0, policy_version 1110078 (0.0009) [2023-12-28 03:14:11,934][106226] Updated weights for policy 0, policy_version 1110088 (0.0009) [2023-12-28 03:14:12,002][106226] Updated weights for policy 0, policy_version 1110098 (0.0006) [2023-12-28 03:14:12,073][106225] Updated weights for policy 1, policy_version 1113016 (0.0007) [2023-12-28 03:14:12,137][106225] Updated weights for policy 1, policy_version 1113026 (0.0008) [2023-12-28 03:14:12,201][106225] Updated weights for policy 1, policy_version 1113036 (0.0008) [2023-12-28 03:14:12,683][106226] Updated weights for policy 0, policy_version 1110108 (0.0008) [2023-12-28 03:14:12,743][106226] Updated weights for policy 0, policy_version 1110118 (0.0010) [2023-12-28 03:14:12,807][106226] Updated weights for policy 0, policy_version 1110128 (0.0011) [2023-12-28 03:14:12,946][106225] Updated weights for policy 1, policy_version 1113046 (0.0006) [2023-12-28 03:14:13,006][106225] Updated weights for policy 1, policy_version 1113056 (0.0005) [2023-12-28 03:14:13,074][106225] Updated weights for policy 1, policy_version 1113066 (0.0005) [2023-12-28 03:14:13,478][106226] Updated weights for policy 0, policy_version 1110138 (0.0010) [2023-12-28 03:14:13,529][106226] Updated weights for policy 0, policy_version 1110148 (0.0010) [2023-12-28 03:14:13,575][106226] Updated weights for policy 0, policy_version 1110158 (0.0010) [2023-12-28 03:14:13,621][106226] Updated weights for policy 0, policy_version 1110168 (0.0010) [2023-12-28 03:14:13,704][106225] Updated weights for policy 1, policy_version 1113076 (0.0006) [2023-12-28 03:14:13,761][106225] Updated weights for policy 1, policy_version 1113086 (0.0008) [2023-12-28 03:14:13,823][106225] Updated weights for policy 1, policy_version 1113096 (0.0008) [2023-12-28 03:14:14,271][106226] Updated weights for policy 0, policy_version 1110178 (0.0008) [2023-12-28 03:14:14,321][106226] Updated weights for policy 0, policy_version 1110188 (0.0006) [2023-12-28 03:14:14,377][106226] Updated weights for policy 0, policy_version 1110198 (0.0005) [2023-12-28 03:14:14,436][106225] Updated weights for policy 1, policy_version 1113106 (0.0007) [2023-12-28 03:14:14,505][106225] Updated weights for policy 1, policy_version 1113116 (0.0005) [2023-12-28 03:14:14,573][106225] Updated weights for policy 1, policy_version 1113126 (0.0005) [2023-12-28 03:14:14,633][106225] Updated weights for policy 1, policy_version 1113136 (0.0007) [2023-12-28 03:14:15,006][106226] Updated weights for policy 0, policy_version 1110208 (0.0008) [2023-12-28 03:14:15,072][106226] Updated weights for policy 0, policy_version 1110218 (0.0007) [2023-12-28 03:14:15,130][106226] Updated weights for policy 0, policy_version 1110228 (0.0009) [2023-12-28 03:14:15,339][106225] Updated weights for policy 1, policy_version 1113146 (0.0010) [2023-12-28 03:14:15,405][106225] Updated weights for policy 1, policy_version 1113156 (0.0010) [2023-12-28 03:14:15,465][106225] Updated weights for policy 1, policy_version 1113166 (0.0010) [2023-12-28 03:14:15,853][106226] Updated weights for policy 0, policy_version 1110238 (0.0009) [2023-12-28 03:14:15,916][106226] Updated weights for policy 0, policy_version 1110248 (0.0008) [2023-12-28 03:14:15,979][106226] Updated weights for policy 0, policy_version 1110258 (0.0008) [2023-12-28 03:14:16,046][106225] Updated weights for policy 1, policy_version 1113176 (0.0009) [2023-12-28 03:14:16,112][106225] Updated weights for policy 1, policy_version 1113186 (0.0008) [2023-12-28 03:14:16,160][106225] Updated weights for policy 1, policy_version 1113196 (0.0008) [2023-12-28 03:14:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 569303040. Throughput: 0: 10036.8, 1: 9702.3. Samples: 569294604. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:16,176][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.971')] [2023-12-28 03:14:16,689][106226] Updated weights for policy 0, policy_version 1110268 (0.0008) [2023-12-28 03:14:16,737][106226] Updated weights for policy 0, policy_version 1110278 (0.0008) [2023-12-28 03:14:16,782][106226] Updated weights for policy 0, policy_version 1110288 (0.0008) [2023-12-28 03:14:16,888][106225] Updated weights for policy 1, policy_version 1113206 (0.0008) [2023-12-28 03:14:16,946][106225] Updated weights for policy 1, policy_version 1113216 (0.0008) [2023-12-28 03:14:17,010][106225] Updated weights for policy 1, policy_version 1113226 (0.0009) [2023-12-28 03:14:17,528][106226] Updated weights for policy 0, policy_version 1110298 (0.0009) [2023-12-28 03:14:17,582][106226] Updated weights for policy 0, policy_version 1110308 (0.0008) [2023-12-28 03:14:17,640][106226] Updated weights for policy 0, policy_version 1110318 (0.0008) [2023-12-28 03:14:17,688][106226] Updated weights for policy 0, policy_version 1110328 (0.0009) [2023-12-28 03:14:17,740][106225] Updated weights for policy 1, policy_version 1113236 (0.0008) [2023-12-28 03:14:17,789][106225] Updated weights for policy 1, policy_version 1113246 (0.0008) [2023-12-28 03:14:17,848][106225] Updated weights for policy 1, policy_version 1113256 (0.0009) [2023-12-28 03:14:18,449][106226] Updated weights for policy 0, policy_version 1110338 (0.0009) [2023-12-28 03:14:18,505][106226] Updated weights for policy 0, policy_version 1110348 (0.0008) [2023-12-28 03:14:18,567][106226] Updated weights for policy 0, policy_version 1110358 (0.0009) [2023-12-28 03:14:18,590][106225] Updated weights for policy 1, policy_version 1113266 (0.0009) [2023-12-28 03:14:18,654][106225] Updated weights for policy 1, policy_version 1113276 (0.0009) [2023-12-28 03:14:18,719][106225] Updated weights for policy 1, policy_version 1113286 (0.0008) [2023-12-28 03:14:18,783][106225] Updated weights for policy 1, policy_version 1113296 (0.0009) [2023-12-28 03:14:19,204][106226] Updated weights for policy 0, policy_version 1110368 (0.0007) [2023-12-28 03:14:19,267][106226] Updated weights for policy 0, policy_version 1110378 (0.0009) [2023-12-28 03:14:19,339][106226] Updated weights for policy 0, policy_version 1110388 (0.0009) [2023-12-28 03:14:19,553][106225] Updated weights for policy 1, policy_version 1113306 (0.0009) [2023-12-28 03:14:19,615][106225] Updated weights for policy 1, policy_version 1113316 (0.0008) [2023-12-28 03:14:19,675][106225] Updated weights for policy 1, policy_version 1113326 (0.0009) [2023-12-28 03:14:20,073][106226] Updated weights for policy 0, policy_version 1110398 (0.0009) [2023-12-28 03:14:20,129][106226] Updated weights for policy 0, policy_version 1110408 (0.0008) [2023-12-28 03:14:20,184][106226] Updated weights for policy 0, policy_version 1110418 (0.0009) [2023-12-28 03:14:20,465][106225] Updated weights for policy 1, policy_version 1113336 (0.0007) [2023-12-28 03:14:20,520][106225] Updated weights for policy 1, policy_version 1113346 (0.0006) [2023-12-28 03:14:20,584][106225] Updated weights for policy 1, policy_version 1113356 (0.0007) [2023-12-28 03:14:20,964][106226] Updated weights for policy 0, policy_version 1110428 (0.0009) [2023-12-28 03:14:21,029][106226] Updated weights for policy 0, policy_version 1110438 (0.0007) [2023-12-28 03:14:21,095][106226] Updated weights for policy 0, policy_version 1110448 (0.0007) [2023-12-28 03:14:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 569401344. Throughput: 0: 9987.5, 1: 9626.2. Samples: 569409236. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:21,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-4.988')] [2023-12-28 03:14:21,415][106225] Updated weights for policy 1, policy_version 1113366 (0.0008) [2023-12-28 03:14:21,473][106225] Updated weights for policy 1, policy_version 1113376 (0.0011) [2023-12-28 03:14:21,528][106225] Updated weights for policy 1, policy_version 1113386 (0.0010) [2023-12-28 03:14:21,843][106226] Updated weights for policy 0, policy_version 1110458 (0.0007) [2023-12-28 03:14:21,904][106226] Updated weights for policy 0, policy_version 1110468 (0.0009) [2023-12-28 03:14:21,962][106226] Updated weights for policy 0, policy_version 1110478 (0.0008) [2023-12-28 03:14:22,024][106226] Updated weights for policy 0, policy_version 1110488 (0.0008) [2023-12-28 03:14:22,265][106225] Updated weights for policy 1, policy_version 1113396 (0.0010) [2023-12-28 03:14:22,335][106225] Updated weights for policy 1, policy_version 1113406 (0.0010) [2023-12-28 03:14:22,405][106225] Updated weights for policy 1, policy_version 1113416 (0.0009) [2023-12-28 03:14:22,819][106226] Updated weights for policy 0, policy_version 1110498 (0.0008) [2023-12-28 03:14:22,885][106226] Updated weights for policy 0, policy_version 1110508 (0.0008) [2023-12-28 03:14:22,935][106226] Updated weights for policy 0, policy_version 1110518 (0.0009) [2023-12-28 03:14:23,073][106225] Updated weights for policy 1, policy_version 1113426 (0.0008) [2023-12-28 03:14:23,124][106225] Updated weights for policy 1, policy_version 1113436 (0.0010) [2023-12-28 03:14:23,181][106225] Updated weights for policy 1, policy_version 1113446 (0.0010) [2023-12-28 03:14:23,234][106225] Updated weights for policy 1, policy_version 1113456 (0.0010) [2023-12-28 03:14:23,698][106226] Updated weights for policy 0, policy_version 1110528 (0.0010) [2023-12-28 03:14:23,749][106226] Updated weights for policy 0, policy_version 1110538 (0.0009) [2023-12-28 03:14:23,800][106226] Updated weights for policy 0, policy_version 1110548 (0.0005) [2023-12-28 03:14:23,967][106225] Updated weights for policy 1, policy_version 1113466 (0.0010) [2023-12-28 03:14:24,040][106225] Updated weights for policy 1, policy_version 1113476 (0.0010) [2023-12-28 03:14:24,106][106225] Updated weights for policy 1, policy_version 1113486 (0.0010) [2023-12-28 03:14:24,440][106226] Updated weights for policy 0, policy_version 1110558 (0.0005) [2023-12-28 03:14:24,492][106226] Updated weights for policy 0, policy_version 1110568 (0.0006) [2023-12-28 03:14:24,542][106226] Updated weights for policy 0, policy_version 1110578 (0.0010) [2023-12-28 03:14:24,789][106225] Updated weights for policy 1, policy_version 1113496 (0.0008) [2023-12-28 03:14:24,848][106225] Updated weights for policy 1, policy_version 1113506 (0.0008) [2023-12-28 03:14:24,902][106225] Updated weights for policy 1, policy_version 1113516 (0.0009) [2023-12-28 03:14:25,194][106226] Updated weights for policy 0, policy_version 1110588 (0.0011) [2023-12-28 03:14:25,244][106226] Updated weights for policy 0, policy_version 1110598 (0.0010) [2023-12-28 03:14:25,291][106226] Updated weights for policy 0, policy_version 1110608 (0.0010) [2023-12-28 03:14:25,666][106225] Updated weights for policy 1, policy_version 1113526 (0.0010) [2023-12-28 03:14:25,735][106225] Updated weights for policy 1, policy_version 1113536 (0.0008) [2023-12-28 03:14:25,797][106225] Updated weights for policy 1, policy_version 1113546 (0.0009) [2023-12-28 03:14:25,952][106226] Updated weights for policy 0, policy_version 1110618 (0.0009) [2023-12-28 03:14:26,014][106226] Updated weights for policy 0, policy_version 1110628 (0.0005) [2023-12-28 03:14:26,071][106226] Updated weights for policy 0, policy_version 1110638 (0.0010) [2023-12-28 03:14:26,122][106226] Updated weights for policy 0, policy_version 1110648 (0.0011) [2023-12-28 03:14:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 569499648. Throughput: 0: 9973.3, 1: 9568.0. Samples: 569465652. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:26,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.916')] [2023-12-28 03:14:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001113552_285114368.pth... [2023-12-28 03:14:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001110648_284385280.pth... [2023-12-28 03:14:26,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001112432_284827648.pth [2023-12-28 03:14:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001109464_284082176.pth [2023-12-28 03:14:26,529][106225] Updated weights for policy 1, policy_version 1113556 (0.0008) [2023-12-28 03:14:26,576][106225] Updated weights for policy 1, policy_version 1113566 (0.0008) [2023-12-28 03:14:26,635][106225] Updated weights for policy 1, policy_version 1113576 (0.0007) [2023-12-28 03:14:26,812][106226] Updated weights for policy 0, policy_version 1110658 (0.0010) [2023-12-28 03:14:26,868][106226] Updated weights for policy 0, policy_version 1110668 (0.0010) [2023-12-28 03:14:26,917][106226] Updated weights for policy 0, policy_version 1110678 (0.0010) [2023-12-28 03:14:27,368][106225] Updated weights for policy 1, policy_version 1113586 (0.0008) [2023-12-28 03:14:27,424][106225] Updated weights for policy 1, policy_version 1113596 (0.0008) [2023-12-28 03:14:27,504][106225] Updated weights for policy 1, policy_version 1113606 (0.0007) [2023-12-28 03:14:27,564][106225] Updated weights for policy 1, policy_version 1113616 (0.0008) [2023-12-28 03:14:27,638][106226] Updated weights for policy 0, policy_version 1110688 (0.0010) [2023-12-28 03:14:27,702][106226] Updated weights for policy 0, policy_version 1110698 (0.0011) [2023-12-28 03:14:27,760][106226] Updated weights for policy 0, policy_version 1110708 (0.0011) [2023-12-28 03:14:28,294][106225] Updated weights for policy 1, policy_version 1113626 (0.0009) [2023-12-28 03:14:28,356][106225] Updated weights for policy 1, policy_version 1113636 (0.0007) [2023-12-28 03:14:28,370][106226] Updated weights for policy 0, policy_version 1110718 (0.0009) [2023-12-28 03:14:28,419][106225] Updated weights for policy 1, policy_version 1113646 (0.0007) [2023-12-28 03:14:28,428][106226] Updated weights for policy 0, policy_version 1110728 (0.0011) [2023-12-28 03:14:28,486][106226] Updated weights for policy 0, policy_version 1110738 (0.0011) [2023-12-28 03:14:29,148][106225] Updated weights for policy 1, policy_version 1113656 (0.0008) [2023-12-28 03:14:29,197][106225] Updated weights for policy 1, policy_version 1113666 (0.0007) [2023-12-28 03:14:29,206][106226] Updated weights for policy 0, policy_version 1110748 (0.0011) [2023-12-28 03:14:29,259][106225] Updated weights for policy 1, policy_version 1113676 (0.0008) [2023-12-28 03:14:29,270][106226] Updated weights for policy 0, policy_version 1110758 (0.0008) [2023-12-28 03:14:29,331][106226] Updated weights for policy 0, policy_version 1110768 (0.0011) [2023-12-28 03:14:29,993][106225] Updated weights for policy 1, policy_version 1113686 (0.0010) [2023-12-28 03:14:30,048][106225] Updated weights for policy 1, policy_version 1113696 (0.0007) [2023-12-28 03:14:30,064][106226] Updated weights for policy 0, policy_version 1110778 (0.0010) [2023-12-28 03:14:30,099][106225] Updated weights for policy 1, policy_version 1113706 (0.0010) [2023-12-28 03:14:30,115][106226] Updated weights for policy 0, policy_version 1110788 (0.0010) [2023-12-28 03:14:30,182][106226] Updated weights for policy 0, policy_version 1110798 (0.0010) [2023-12-28 03:14:30,233][106226] Updated weights for policy 0, policy_version 1110808 (0.0011) [2023-12-28 03:14:30,726][106225] Updated weights for policy 1, policy_version 1113716 (0.0009) [2023-12-28 03:14:30,780][106225] Updated weights for policy 1, policy_version 1113726 (0.0008) [2023-12-28 03:14:30,834][106225] Updated weights for policy 1, policy_version 1113736 (0.0008) [2023-12-28 03:14:30,963][106226] Updated weights for policy 0, policy_version 1110818 (0.0008) [2023-12-28 03:14:31,026][106226] Updated weights for policy 0, policy_version 1110828 (0.0009) [2023-12-28 03:14:31,085][106226] Updated weights for policy 0, policy_version 1110838 (0.0007) [2023-12-28 03:14:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 569597952. Throughput: 0: 9985.4, 1: 9599.3. Samples: 569583236. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:31,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-5.136')] [2023-12-28 03:14:31,627][106225] Updated weights for policy 1, policy_version 1113746 (0.0008) [2023-12-28 03:14:31,689][106225] Updated weights for policy 1, policy_version 1113756 (0.0010) [2023-12-28 03:14:31,747][106225] Updated weights for policy 1, policy_version 1113766 (0.0010) [2023-12-28 03:14:31,775][106226] Updated weights for policy 0, policy_version 1110848 (0.0009) [2023-12-28 03:14:31,804][106225] Updated weights for policy 1, policy_version 1113776 (0.0006) [2023-12-28 03:14:31,826][106226] Updated weights for policy 0, policy_version 1110858 (0.0010) [2023-12-28 03:14:31,883][106226] Updated weights for policy 0, policy_version 1110868 (0.0010) [2023-12-28 03:14:32,474][106225] Updated weights for policy 1, policy_version 1113786 (0.0010) [2023-12-28 03:14:32,525][106225] Updated weights for policy 1, policy_version 1113796 (0.0010) [2023-12-28 03:14:32,540][106226] Updated weights for policy 0, policy_version 1110878 (0.0010) [2023-12-28 03:14:32,581][106225] Updated weights for policy 1, policy_version 1113806 (0.0010) [2023-12-28 03:14:32,599][106226] Updated weights for policy 0, policy_version 1110888 (0.0010) [2023-12-28 03:14:32,661][106226] Updated weights for policy 0, policy_version 1110898 (0.0010) [2023-12-28 03:14:33,243][106225] Updated weights for policy 1, policy_version 1113816 (0.0008) [2023-12-28 03:14:33,308][106225] Updated weights for policy 1, policy_version 1113826 (0.0008) [2023-12-28 03:14:33,310][106226] Updated weights for policy 0, policy_version 1110908 (0.0010) [2023-12-28 03:14:33,360][106225] Updated weights for policy 1, policy_version 1113836 (0.0005) [2023-12-28 03:14:33,364][106226] Updated weights for policy 0, policy_version 1110918 (0.0010) [2023-12-28 03:14:33,432][106226] Updated weights for policy 0, policy_version 1110928 (0.0010) [2023-12-28 03:14:34,019][106225] Updated weights for policy 1, policy_version 1113846 (0.0006) [2023-12-28 03:14:34,073][106225] Updated weights for policy 1, policy_version 1113856 (0.0007) [2023-12-28 03:14:34,126][106225] Updated weights for policy 1, policy_version 1113866 (0.0008) [2023-12-28 03:14:34,132][106226] Updated weights for policy 0, policy_version 1110938 (0.0010) [2023-12-28 03:14:34,205][106226] Updated weights for policy 0, policy_version 1110948 (0.0011) [2023-12-28 03:14:34,268][106226] Updated weights for policy 0, policy_version 1110958 (0.0010) [2023-12-28 03:14:34,333][106226] Updated weights for policy 0, policy_version 1110968 (0.0011) [2023-12-28 03:14:34,901][106225] Updated weights for policy 1, policy_version 1113876 (0.0008) [2023-12-28 03:14:34,955][106225] Updated weights for policy 1, policy_version 1113886 (0.0008) [2023-12-28 03:14:35,008][106225] Updated weights for policy 1, policy_version 1113896 (0.0008) [2023-12-28 03:14:35,022][106226] Updated weights for policy 0, policy_version 1110978 (0.0010) [2023-12-28 03:14:35,081][106226] Updated weights for policy 0, policy_version 1110988 (0.0006) [2023-12-28 03:14:35,145][106226] Updated weights for policy 0, policy_version 1110998 (0.0005) [2023-12-28 03:14:35,727][106225] Updated weights for policy 1, policy_version 1113906 (0.0006) [2023-12-28 03:14:35,729][106226] Updated weights for policy 0, policy_version 1111008 (0.0009) [2023-12-28 03:14:35,782][106226] Updated weights for policy 0, policy_version 1111018 (0.0010) [2023-12-28 03:14:35,785][106225] Updated weights for policy 1, policy_version 1113916 (0.0006) [2023-12-28 03:14:35,837][106225] Updated weights for policy 1, policy_version 1113926 (0.0006) [2023-12-28 03:14:35,838][106226] Updated weights for policy 0, policy_version 1111028 (0.0010) [2023-12-28 03:14:35,892][106225] Updated weights for policy 1, policy_version 1113936 (0.0006) [2023-12-28 03:14:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 569696256. Throughput: 0: 9989.2, 1: 9671.9. Samples: 569703964. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:36,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.785')] [2023-12-28 03:14:36,586][106226] Updated weights for policy 0, policy_version 1111038 (0.0009) [2023-12-28 03:14:36,594][106225] Updated weights for policy 1, policy_version 1113946 (0.0008) [2023-12-28 03:14:36,645][106226] Updated weights for policy 0, policy_version 1111048 (0.0008) [2023-12-28 03:14:36,655][106225] Updated weights for policy 1, policy_version 1113956 (0.0010) [2023-12-28 03:14:36,701][106226] Updated weights for policy 0, policy_version 1111058 (0.0008) [2023-12-28 03:14:36,719][106225] Updated weights for policy 1, policy_version 1113966 (0.0010) [2023-12-28 03:14:37,303][106226] Updated weights for policy 0, policy_version 1111068 (0.0009) [2023-12-28 03:14:37,361][106225] Updated weights for policy 1, policy_version 1113976 (0.0007) [2023-12-28 03:14:37,361][106226] Updated weights for policy 0, policy_version 1111078 (0.0011) [2023-12-28 03:14:37,416][106225] Updated weights for policy 1, policy_version 1113986 (0.0005) [2023-12-28 03:14:37,423][106226] Updated weights for policy 0, policy_version 1111088 (0.0010) [2023-12-28 03:14:37,480][106225] Updated weights for policy 1, policy_version 1113996 (0.0007) [2023-12-28 03:14:38,114][106226] Updated weights for policy 0, policy_version 1111098 (0.0011) [2023-12-28 03:14:38,120][106225] Updated weights for policy 1, policy_version 1114006 (0.0007) [2023-12-28 03:14:38,168][106226] Updated weights for policy 0, policy_version 1111108 (0.0011) [2023-12-28 03:14:38,173][106225] Updated weights for policy 1, policy_version 1114016 (0.0007) [2023-12-28 03:14:38,225][106226] Updated weights for policy 0, policy_version 1111118 (0.0010) [2023-12-28 03:14:38,236][106225] Updated weights for policy 1, policy_version 1114026 (0.0006) [2023-12-28 03:14:38,285][106226] Updated weights for policy 0, policy_version 1111128 (0.0009) [2023-12-28 03:14:38,888][106225] Updated weights for policy 1, policy_version 1114036 (0.0007) [2023-12-28 03:14:38,948][106225] Updated weights for policy 1, policy_version 1114046 (0.0006) [2023-12-28 03:14:38,991][106226] Updated weights for policy 0, policy_version 1111138 (0.0011) [2023-12-28 03:14:39,009][106225] Updated weights for policy 1, policy_version 1114056 (0.0006) [2023-12-28 03:14:39,052][106226] Updated weights for policy 0, policy_version 1111148 (0.0010) [2023-12-28 03:14:39,112][106226] Updated weights for policy 0, policy_version 1111158 (0.0007) [2023-12-28 03:14:39,797][106226] Updated weights for policy 0, policy_version 1111168 (0.0009) [2023-12-28 03:14:39,837][106225] Updated weights for policy 1, policy_version 1114066 (0.0006) [2023-12-28 03:14:39,869][106226] Updated weights for policy 0, policy_version 1111178 (0.0007) [2023-12-28 03:14:39,901][106225] Updated weights for policy 1, policy_version 1114076 (0.0008) [2023-12-28 03:14:39,928][106226] Updated weights for policy 0, policy_version 1111188 (0.0008) [2023-12-28 03:14:39,966][106225] Updated weights for policy 1, policy_version 1114086 (0.0008) [2023-12-28 03:14:40,017][106225] Updated weights for policy 1, policy_version 1114096 (0.0010) [2023-12-28 03:14:40,609][106226] Updated weights for policy 0, policy_version 1111198 (0.0009) [2023-12-28 03:14:40,667][106226] Updated weights for policy 0, policy_version 1111208 (0.0007) [2023-12-28 03:14:40,730][106226] Updated weights for policy 0, policy_version 1111218 (0.0007) [2023-12-28 03:14:40,753][106225] Updated weights for policy 1, policy_version 1114106 (0.0009) [2023-12-28 03:14:40,814][106225] Updated weights for policy 1, policy_version 1114116 (0.0008) [2023-12-28 03:14:40,869][106225] Updated weights for policy 1, policy_version 1114126 (0.0008) [2023-12-28 03:14:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 569794560. Throughput: 0: 10005.5, 1: 9730.4. Samples: 569765548. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:41,175][105115] Avg episode reward: [(0, '-4.927'), (1, '-4.834')] [2023-12-28 03:14:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001114128_285261824.pth... [2023-12-28 03:14:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001111224_284532736.pth... [2023-12-28 03:14:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001113008_284975104.pth [2023-12-28 03:14:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001110072_284237824.pth [2023-12-28 03:14:41,464][106226] Updated weights for policy 0, policy_version 1111228 (0.0009) [2023-12-28 03:14:41,529][106226] Updated weights for policy 0, policy_version 1111238 (0.0009) [2023-12-28 03:14:41,592][106225] Updated weights for policy 1, policy_version 1114136 (0.0008) [2023-12-28 03:14:41,594][106226] Updated weights for policy 0, policy_version 1111248 (0.0008) [2023-12-28 03:14:41,661][106225] Updated weights for policy 1, policy_version 1114146 (0.0008) [2023-12-28 03:14:41,717][106225] Updated weights for policy 1, policy_version 1114156 (0.0008) [2023-12-28 03:14:42,310][106226] Updated weights for policy 0, policy_version 1111258 (0.0009) [2023-12-28 03:14:42,378][106226] Updated weights for policy 0, policy_version 1111268 (0.0008) [2023-12-28 03:14:42,432][106226] Updated weights for policy 0, policy_version 1111278 (0.0008) [2023-12-28 03:14:42,489][106226] Updated weights for policy 0, policy_version 1111288 (0.0007) [2023-12-28 03:14:42,495][106225] Updated weights for policy 1, policy_version 1114166 (0.0009) [2023-12-28 03:14:42,554][106225] Updated weights for policy 1, policy_version 1114176 (0.0008) [2023-12-28 03:14:42,614][106225] Updated weights for policy 1, policy_version 1114186 (0.0008) [2023-12-28 03:14:43,265][106226] Updated weights for policy 0, policy_version 1111298 (0.0007) [2023-12-28 03:14:43,292][106225] Updated weights for policy 1, policy_version 1114196 (0.0007) [2023-12-28 03:14:43,324][106226] Updated weights for policy 0, policy_version 1111308 (0.0008) [2023-12-28 03:14:43,354][106225] Updated weights for policy 1, policy_version 1114206 (0.0006) [2023-12-28 03:14:43,384][106226] Updated weights for policy 0, policy_version 1111318 (0.0008) [2023-12-28 03:14:43,424][106225] Updated weights for policy 1, policy_version 1114216 (0.0006) [2023-12-28 03:14:43,971][106226] Updated weights for policy 0, policy_version 1111328 (0.0008) [2023-12-28 03:14:44,039][106226] Updated weights for policy 0, policy_version 1111338 (0.0010) [2023-12-28 03:14:44,054][106225] Updated weights for policy 1, policy_version 1114226 (0.0007) [2023-12-28 03:14:44,098][106226] Updated weights for policy 0, policy_version 1111348 (0.0005) [2023-12-28 03:14:44,103][106225] Updated weights for policy 1, policy_version 1114236 (0.0007) [2023-12-28 03:14:44,168][106225] Updated weights for policy 1, policy_version 1114246 (0.0007) [2023-12-28 03:14:44,224][106225] Updated weights for policy 1, policy_version 1114256 (0.0010) [2023-12-28 03:14:44,660][106226] Updated weights for policy 0, policy_version 1111358 (0.0006) [2023-12-28 03:14:44,717][106226] Updated weights for policy 0, policy_version 1111368 (0.0008) [2023-12-28 03:14:44,769][106226] Updated weights for policy 0, policy_version 1111378 (0.0008) [2023-12-28 03:14:44,940][106225] Updated weights for policy 1, policy_version 1114266 (0.0011) [2023-12-28 03:14:45,003][106225] Updated weights for policy 1, policy_version 1114276 (0.0010) [2023-12-28 03:14:45,062][106225] Updated weights for policy 1, policy_version 1114286 (0.0010) [2023-12-28 03:14:45,494][106226] Updated weights for policy 0, policy_version 1111388 (0.0007) [2023-12-28 03:14:45,550][106226] Updated weights for policy 0, policy_version 1111398 (0.0007) [2023-12-28 03:14:45,603][106226] Updated weights for policy 0, policy_version 1111408 (0.0008) [2023-12-28 03:14:45,798][106225] Updated weights for policy 1, policy_version 1114296 (0.0006) [2023-12-28 03:14:45,867][106225] Updated weights for policy 1, policy_version 1114306 (0.0005) [2023-12-28 03:14:45,920][106225] Updated weights for policy 1, policy_version 1114316 (0.0005) [2023-12-28 03:14:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 569892864. Throughput: 0: 10043.2, 1: 9728.2. Samples: 569882896. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:46,176][105115] Avg episode reward: [(0, '-4.786'), (1, '-4.964')] [2023-12-28 03:14:46,346][106226] Updated weights for policy 0, policy_version 1111418 (0.0008) [2023-12-28 03:14:46,397][106226] Updated weights for policy 0, policy_version 1111428 (0.0008) [2023-12-28 03:14:46,424][106225] Updated weights for policy 1, policy_version 1114326 (0.0005) [2023-12-28 03:14:46,447][106226] Updated weights for policy 0, policy_version 1111438 (0.0009) [2023-12-28 03:14:46,480][106225] Updated weights for policy 1, policy_version 1114336 (0.0005) [2023-12-28 03:14:46,496][106226] Updated weights for policy 0, policy_version 1111448 (0.0008) [2023-12-28 03:14:46,532][106225] Updated weights for policy 1, policy_version 1114346 (0.0005) [2023-12-28 03:14:47,069][106225] Updated weights for policy 1, policy_version 1114356 (0.0007) [2023-12-28 03:14:47,120][106225] Updated weights for policy 1, policy_version 1114366 (0.0010) [2023-12-28 03:14:47,173][106225] Updated weights for policy 1, policy_version 1114376 (0.0010) [2023-12-28 03:14:47,266][106226] Updated weights for policy 0, policy_version 1111458 (0.0010) [2023-12-28 03:14:47,311][106226] Updated weights for policy 0, policy_version 1111468 (0.0010) [2023-12-28 03:14:47,358][106226] Updated weights for policy 0, policy_version 1111478 (0.0008) [2023-12-28 03:14:47,900][106225] Updated weights for policy 1, policy_version 1114386 (0.0010) [2023-12-28 03:14:47,961][106225] Updated weights for policy 1, policy_version 1114396 (0.0010) [2023-12-28 03:14:48,004][106226] Updated weights for policy 0, policy_version 1111488 (0.0010) [2023-12-28 03:14:48,011][106225] Updated weights for policy 1, policy_version 1114406 (0.0010) [2023-12-28 03:14:48,060][106225] Updated weights for policy 1, policy_version 1114416 (0.0009) [2023-12-28 03:14:48,061][106226] Updated weights for policy 0, policy_version 1111498 (0.0011) [2023-12-28 03:14:48,128][106226] Updated weights for policy 0, policy_version 1111508 (0.0011) [2023-12-28 03:14:48,810][106225] Updated weights for policy 1, policy_version 1114426 (0.0009) [2023-12-28 03:14:48,814][106226] Updated weights for policy 0, policy_version 1111518 (0.0010) [2023-12-28 03:14:48,865][106225] Updated weights for policy 1, policy_version 1114436 (0.0011) [2023-12-28 03:14:48,871][106226] Updated weights for policy 0, policy_version 1111528 (0.0010) [2023-12-28 03:14:48,926][106225] Updated weights for policy 1, policy_version 1114446 (0.0010) [2023-12-28 03:14:48,935][106226] Updated weights for policy 0, policy_version 1111538 (0.0006) [2023-12-28 03:14:49,620][106225] Updated weights for policy 1, policy_version 1114456 (0.0008) [2023-12-28 03:14:49,659][106226] Updated weights for policy 0, policy_version 1111548 (0.0010) [2023-12-28 03:14:49,680][106225] Updated weights for policy 1, policy_version 1114466 (0.0006) [2023-12-28 03:14:49,720][106226] Updated weights for policy 0, policy_version 1111558 (0.0011) [2023-12-28 03:14:49,738][106225] Updated weights for policy 1, policy_version 1114476 (0.0006) [2023-12-28 03:14:49,780][106226] Updated weights for policy 0, policy_version 1111568 (0.0011) [2023-12-28 03:14:50,510][106225] Updated weights for policy 1, policy_version 1114486 (0.0009) [2023-12-28 03:14:50,517][106226] Updated weights for policy 0, policy_version 1111578 (0.0011) [2023-12-28 03:14:50,571][106225] Updated weights for policy 1, policy_version 1114496 (0.0007) [2023-12-28 03:14:50,577][106226] Updated weights for policy 0, policy_version 1111588 (0.0008) [2023-12-28 03:14:50,626][106225] Updated weights for policy 1, policy_version 1114506 (0.0008) [2023-12-28 03:14:50,636][106226] Updated weights for policy 0, policy_version 1111598 (0.0006) [2023-12-28 03:14:50,694][106226] Updated weights for policy 0, policy_version 1111608 (0.0005) [2023-12-28 03:14:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 569991168. Throughput: 0: 9922.5, 1: 9775.4. Samples: 570002256. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:51,176][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.633')] [2023-12-28 03:14:51,352][106225] Updated weights for policy 1, policy_version 1114516 (0.0008) [2023-12-28 03:14:51,421][106226] Updated weights for policy 0, policy_version 1111618 (0.0007) [2023-12-28 03:14:51,423][106225] Updated weights for policy 1, policy_version 1114526 (0.0008) [2023-12-28 03:14:51,476][106226] Updated weights for policy 0, policy_version 1111628 (0.0006) [2023-12-28 03:14:51,479][106225] Updated weights for policy 1, policy_version 1114536 (0.0008) [2023-12-28 03:14:51,537][106226] Updated weights for policy 0, policy_version 1111638 (0.0007) [2023-12-28 03:14:52,207][106225] Updated weights for policy 1, policy_version 1114546 (0.0008) [2023-12-28 03:14:52,226][106226] Updated weights for policy 0, policy_version 1111648 (0.0007) [2023-12-28 03:14:52,261][106225] Updated weights for policy 1, policy_version 1114556 (0.0006) [2023-12-28 03:14:52,291][106226] Updated weights for policy 0, policy_version 1111658 (0.0007) [2023-12-28 03:14:52,325][106225] Updated weights for policy 1, policy_version 1114566 (0.0008) [2023-12-28 03:14:52,356][106226] Updated weights for policy 0, policy_version 1111668 (0.0006) [2023-12-28 03:14:52,408][106225] Updated weights for policy 1, policy_version 1114576 (0.0007) [2023-12-28 03:14:52,976][106226] Updated weights for policy 0, policy_version 1111678 (0.0007) [2023-12-28 03:14:53,028][106226] Updated weights for policy 0, policy_version 1111688 (0.0005) [2023-12-28 03:14:53,083][106226] Updated weights for policy 0, policy_version 1111698 (0.0006) [2023-12-28 03:14:53,189][106225] Updated weights for policy 1, policy_version 1114586 (0.0005) [2023-12-28 03:14:53,259][106225] Updated weights for policy 1, policy_version 1114596 (0.0005) [2023-12-28 03:14:53,329][106225] Updated weights for policy 1, policy_version 1114606 (0.0006) [2023-12-28 03:14:53,632][106226] Updated weights for policy 0, policy_version 1111708 (0.0007) [2023-12-28 03:14:53,680][106226] Updated weights for policy 0, policy_version 1111718 (0.0008) [2023-12-28 03:14:53,728][106226] Updated weights for policy 0, policy_version 1111728 (0.0008) [2023-12-28 03:14:53,975][106225] Updated weights for policy 1, policy_version 1114616 (0.0006) [2023-12-28 03:14:54,037][106225] Updated weights for policy 1, policy_version 1114626 (0.0006) [2023-12-28 03:14:54,092][106225] Updated weights for policy 1, policy_version 1114636 (0.0006) [2023-12-28 03:14:54,372][106226] Updated weights for policy 0, policy_version 1111738 (0.0009) [2023-12-28 03:14:54,435][106226] Updated weights for policy 0, policy_version 1111748 (0.0009) [2023-12-28 03:14:54,498][106226] Updated weights for policy 0, policy_version 1111758 (0.0009) [2023-12-28 03:14:54,561][106226] Updated weights for policy 0, policy_version 1111768 (0.0009) [2023-12-28 03:14:54,701][106225] Updated weights for policy 1, policy_version 1114646 (0.0006) [2023-12-28 03:14:54,758][106225] Updated weights for policy 1, policy_version 1114656 (0.0006) [2023-12-28 03:14:54,819][106225] Updated weights for policy 1, policy_version 1114666 (0.0006) [2023-12-28 03:14:55,298][106226] Updated weights for policy 0, policy_version 1111778 (0.0005) [2023-12-28 03:14:55,348][106226] Updated weights for policy 0, policy_version 1111788 (0.0007) [2023-12-28 03:14:55,409][106226] Updated weights for policy 0, policy_version 1111798 (0.0009) [2023-12-28 03:14:55,438][106225] Updated weights for policy 1, policy_version 1114676 (0.0007) [2023-12-28 03:14:55,495][106225] Updated weights for policy 1, policy_version 1114686 (0.0008) [2023-12-28 03:14:55,560][106225] Updated weights for policy 1, policy_version 1114696 (0.0009) [2023-12-28 03:14:55,994][106226] Updated weights for policy 0, policy_version 1111808 (0.0006) [2023-12-28 03:14:56,056][106226] Updated weights for policy 0, policy_version 1111818 (0.0008) [2023-12-28 03:14:56,112][106226] Updated weights for policy 0, policy_version 1111828 (0.0009) [2023-12-28 03:14:56,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 570097664. Throughput: 0: 9955.0, 1: 9755.4. Samples: 570062552. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:14:56,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.064')] [2023-12-28 03:14:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001111832_284688384.pth... [2023-12-28 03:14:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001114704_285409280.pth... [2023-12-28 03:14:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001110648_284385280.pth [2023-12-28 03:14:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001113552_285114368.pth [2023-12-28 03:14:56,328][106225] Updated weights for policy 1, policy_version 1114706 (0.0008) [2023-12-28 03:14:56,385][106225] Updated weights for policy 1, policy_version 1114716 (0.0007) [2023-12-28 03:14:56,444][106225] Updated weights for policy 1, policy_version 1114726 (0.0006) [2023-12-28 03:14:56,502][106225] Updated weights for policy 1, policy_version 1114736 (0.0005) [2023-12-28 03:14:56,802][106226] Updated weights for policy 0, policy_version 1111838 (0.0008) [2023-12-28 03:14:56,857][106226] Updated weights for policy 0, policy_version 1111848 (0.0008) [2023-12-28 03:14:56,909][106226] Updated weights for policy 0, policy_version 1111858 (0.0009) [2023-12-28 03:14:57,120][106225] Updated weights for policy 1, policy_version 1114746 (0.0008) [2023-12-28 03:14:57,166][106225] Updated weights for policy 1, policy_version 1114756 (0.0008) [2023-12-28 03:14:57,214][106225] Updated weights for policy 1, policy_version 1114766 (0.0008) [2023-12-28 03:14:57,626][106226] Updated weights for policy 0, policy_version 1111868 (0.0009) [2023-12-28 03:14:57,676][106226] Updated weights for policy 0, policy_version 1111878 (0.0008) [2023-12-28 03:14:57,738][106226] Updated weights for policy 0, policy_version 1111888 (0.0009) [2023-12-28 03:14:57,959][106225] Updated weights for policy 1, policy_version 1114776 (0.0006) [2023-12-28 03:14:58,025][106225] Updated weights for policy 1, policy_version 1114786 (0.0005) [2023-12-28 03:14:58,092][106225] Updated weights for policy 1, policy_version 1114796 (0.0005) [2023-12-28 03:14:58,470][106226] Updated weights for policy 0, policy_version 1111898 (0.0009) [2023-12-28 03:14:58,536][106226] Updated weights for policy 0, policy_version 1111908 (0.0009) [2023-12-28 03:14:58,608][106226] Updated weights for policy 0, policy_version 1111918 (0.0009) [2023-12-28 03:14:58,661][106226] Updated weights for policy 0, policy_version 1111928 (0.0009) [2023-12-28 03:14:58,711][106225] Updated weights for policy 1, policy_version 1114806 (0.0007) [2023-12-28 03:14:58,777][106225] Updated weights for policy 1, policy_version 1114816 (0.0008) [2023-12-28 03:14:58,841][106225] Updated weights for policy 1, policy_version 1114826 (0.0007) [2023-12-28 03:14:59,474][106226] Updated weights for policy 0, policy_version 1111938 (0.0008) [2023-12-28 03:14:59,535][106226] Updated weights for policy 0, policy_version 1111948 (0.0007) [2023-12-28 03:14:59,600][106226] Updated weights for policy 0, policy_version 1111958 (0.0008) [2023-12-28 03:14:59,665][106225] Updated weights for policy 1, policy_version 1114836 (0.0007) [2023-12-28 03:14:59,723][106225] Updated weights for policy 1, policy_version 1114846 (0.0005) [2023-12-28 03:14:59,782][106225] Updated weights for policy 1, policy_version 1114856 (0.0008) [2023-12-28 03:15:00,316][106226] Updated weights for policy 0, policy_version 1111968 (0.0006) [2023-12-28 03:15:00,376][106226] Updated weights for policy 0, policy_version 1111978 (0.0008) [2023-12-28 03:15:00,425][106226] Updated weights for policy 0, policy_version 1111988 (0.0009) [2023-12-28 03:15:00,502][106225] Updated weights for policy 1, policy_version 1114866 (0.0008) [2023-12-28 03:15:00,561][106225] Updated weights for policy 1, policy_version 1114876 (0.0008) [2023-12-28 03:15:00,613][106225] Updated weights for policy 1, policy_version 1114886 (0.0006) [2023-12-28 03:15:00,661][106225] Updated weights for policy 1, policy_version 1114896 (0.0005) [2023-12-28 03:15:01,173][106226] Updated weights for policy 0, policy_version 1111998 (0.0008) [2023-12-28 03:15:01,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 570187776. Throughput: 0: 9934.4, 1: 9785.9. Samples: 570182012. Policy #0 lag: (min: 19.0, avg: 21.0, max: 51.0) [2023-12-28 03:15:01,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-5.068')] [2023-12-28 03:15:01,235][106226] Updated weights for policy 0, policy_version 1112008 (0.0008) [2023-12-28 03:15:01,299][106226] Updated weights for policy 0, policy_version 1112018 (0.0008) [2023-12-28 03:15:01,305][106225] Updated weights for policy 1, policy_version 1114906 (0.0008) [2023-12-28 03:15:01,362][106225] Updated weights for policy 1, policy_version 1114916 (0.0009) [2023-12-28 03:15:01,434][106225] Updated weights for policy 1, policy_version 1114926 (0.0008) [2023-12-28 03:15:02,057][106226] Updated weights for policy 0, policy_version 1112028 (0.0009) [2023-12-28 03:15:02,115][106225] Updated weights for policy 1, policy_version 1114936 (0.0009) [2023-12-28 03:15:02,121][106226] Updated weights for policy 0, policy_version 1112038 (0.0007) [2023-12-28 03:15:02,174][106225] Updated weights for policy 1, policy_version 1114946 (0.0010) [2023-12-28 03:15:02,187][106226] Updated weights for policy 0, policy_version 1112048 (0.0007) [2023-12-28 03:15:02,230][106225] Updated weights for policy 1, policy_version 1114956 (0.0010) [2023-12-28 03:15:02,892][106226] Updated weights for policy 0, policy_version 1112058 (0.0007) [2023-12-28 03:15:02,912][106225] Updated weights for policy 1, policy_version 1114966 (0.0009) [2023-12-28 03:15:02,949][106226] Updated weights for policy 0, policy_version 1112068 (0.0010) [2023-12-28 03:15:02,969][106225] Updated weights for policy 1, policy_version 1114976 (0.0010) [2023-12-28 03:15:03,005][106226] Updated weights for policy 0, policy_version 1112078 (0.0010) [2023-12-28 03:15:03,029][106225] Updated weights for policy 1, policy_version 1114986 (0.0010) [2023-12-28 03:15:03,055][106226] Updated weights for policy 0, policy_version 1112088 (0.0010) [2023-12-28 03:15:03,672][106225] Updated weights for policy 1, policy_version 1114996 (0.0008) [2023-12-28 03:15:03,730][106225] Updated weights for policy 1, policy_version 1115006 (0.0009) [2023-12-28 03:15:03,777][106225] Updated weights for policy 1, policy_version 1115016 (0.0010) [2023-12-28 03:15:03,814][106226] Updated weights for policy 0, policy_version 1112098 (0.0006) [2023-12-28 03:15:03,869][106226] Updated weights for policy 0, policy_version 1112108 (0.0008) [2023-12-28 03:15:03,928][106226] Updated weights for policy 0, policy_version 1112118 (0.0008) [2023-12-28 03:15:04,493][106225] Updated weights for policy 1, policy_version 1115026 (0.0010) [2023-12-28 03:15:04,551][106225] Updated weights for policy 1, policy_version 1115036 (0.0010) [2023-12-28 03:15:04,608][106225] Updated weights for policy 1, policy_version 1115046 (0.0010) [2023-12-28 03:15:04,619][106226] Updated weights for policy 0, policy_version 1112128 (0.0010) [2023-12-28 03:15:04,655][106225] Updated weights for policy 1, policy_version 1115056 (0.0005) [2023-12-28 03:15:04,679][106226] Updated weights for policy 0, policy_version 1112138 (0.0010) [2023-12-28 03:15:04,729][106226] Updated weights for policy 0, policy_version 1112148 (0.0010) [2023-12-28 03:15:05,327][106225] Updated weights for policy 1, policy_version 1115066 (0.0010) [2023-12-28 03:15:05,379][106225] Updated weights for policy 1, policy_version 1115076 (0.0010) [2023-12-28 03:15:05,385][106226] Updated weights for policy 0, policy_version 1112158 (0.0010) [2023-12-28 03:15:05,425][106225] Updated weights for policy 1, policy_version 1115086 (0.0010) [2023-12-28 03:15:05,451][106226] Updated weights for policy 0, policy_version 1112168 (0.0011) [2023-12-28 03:15:05,514][106226] Updated weights for policy 0, policy_version 1112178 (0.0008) [2023-12-28 03:15:06,023][106226] Updated weights for policy 0, policy_version 1112188 (0.0005) [2023-12-28 03:15:06,084][106226] Updated weights for policy 0, policy_version 1112198 (0.0005) [2023-12-28 03:15:06,148][106226] Updated weights for policy 0, policy_version 1112208 (0.0008) [2023-12-28 03:15:06,165][106225] Updated weights for policy 1, policy_version 1115096 (0.0011) [2023-12-28 03:15:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 570286080. Throughput: 0: 10001.0, 1: 9851.2. Samples: 570302584. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:06,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.860')] [2023-12-28 03:15:06,227][106225] Updated weights for policy 1, policy_version 1115106 (0.0006) [2023-12-28 03:15:06,291][106225] Updated weights for policy 1, policy_version 1115116 (0.0010) [2023-12-28 03:15:06,796][106226] Updated weights for policy 0, policy_version 1112218 (0.0007) [2023-12-28 03:15:06,854][106226] Updated weights for policy 0, policy_version 1112228 (0.0011) [2023-12-28 03:15:06,921][106226] Updated weights for policy 0, policy_version 1112238 (0.0011) [2023-12-28 03:15:06,982][106226] Updated weights for policy 0, policy_version 1112248 (0.0009) [2023-12-28 03:15:07,003][106225] Updated weights for policy 1, policy_version 1115126 (0.0010) [2023-12-28 03:15:07,063][106225] Updated weights for policy 1, policy_version 1115136 (0.0010) [2023-12-28 03:15:07,116][106225] Updated weights for policy 1, policy_version 1115146 (0.0010) [2023-12-28 03:15:07,555][106226] Updated weights for policy 0, policy_version 1112258 (0.0006) [2023-12-28 03:15:07,623][106226] Updated weights for policy 0, policy_version 1112268 (0.0006) [2023-12-28 03:15:07,690][106226] Updated weights for policy 0, policy_version 1112278 (0.0005) [2023-12-28 03:15:07,711][106225] Updated weights for policy 1, policy_version 1115156 (0.0009) [2023-12-28 03:15:07,764][106225] Updated weights for policy 1, policy_version 1115166 (0.0008) [2023-12-28 03:15:07,818][106225] Updated weights for policy 1, policy_version 1115176 (0.0009) [2023-12-28 03:15:08,264][106226] Updated weights for policy 0, policy_version 1112288 (0.0008) [2023-12-28 03:15:08,319][106226] Updated weights for policy 0, policy_version 1112298 (0.0008) [2023-12-28 03:15:08,386][106226] Updated weights for policy 0, policy_version 1112308 (0.0008) [2023-12-28 03:15:08,517][106225] Updated weights for policy 1, policy_version 1115186 (0.0008) [2023-12-28 03:15:08,587][106225] Updated weights for policy 1, policy_version 1115196 (0.0009) [2023-12-28 03:15:08,644][106225] Updated weights for policy 1, policy_version 1115206 (0.0008) [2023-12-28 03:15:08,696][106225] Updated weights for policy 1, policy_version 1115216 (0.0008) [2023-12-28 03:15:09,141][106226] Updated weights for policy 0, policy_version 1112318 (0.0008) [2023-12-28 03:15:09,207][106226] Updated weights for policy 0, policy_version 1112328 (0.0005) [2023-12-28 03:15:09,271][106226] Updated weights for policy 0, policy_version 1112338 (0.0008) [2023-12-28 03:15:09,477][106225] Updated weights for policy 1, policy_version 1115226 (0.0008) [2023-12-28 03:15:09,542][106225] Updated weights for policy 1, policy_version 1115236 (0.0007) [2023-12-28 03:15:09,603][106225] Updated weights for policy 1, policy_version 1115246 (0.0007) [2023-12-28 03:15:09,982][106226] Updated weights for policy 0, policy_version 1112348 (0.0008) [2023-12-28 03:15:10,045][106226] Updated weights for policy 0, policy_version 1112358 (0.0008) [2023-12-28 03:15:10,111][106226] Updated weights for policy 0, policy_version 1112368 (0.0009) [2023-12-28 03:15:10,371][106225] Updated weights for policy 1, policy_version 1115257 (0.0008) [2023-12-28 03:15:10,426][106225] Updated weights for policy 1, policy_version 1115267 (0.0010) [2023-12-28 03:15:10,483][106225] Updated weights for policy 1, policy_version 1115277 (0.0007) [2023-12-28 03:15:10,818][106226] Updated weights for policy 0, policy_version 1112378 (0.0008) [2023-12-28 03:15:10,882][106226] Updated weights for policy 0, policy_version 1112388 (0.0008) [2023-12-28 03:15:10,947][106226] Updated weights for policy 0, policy_version 1112398 (0.0006) [2023-12-28 03:15:11,003][106226] Updated weights for policy 0, policy_version 1112408 (0.0008) [2023-12-28 03:15:11,123][106225] Updated weights for policy 1, policy_version 1115287 (0.0008) [2023-12-28 03:15:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 570392576. Throughput: 0: 10079.8, 1: 9899.1. Samples: 570364704. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:11,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-5.133')] [2023-12-28 03:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001112408_284835840.pth... [2023-12-28 03:15:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001111224_284532736.pth [2023-12-28 03:15:11,194][106225] Updated weights for policy 1, policy_version 1115297 (0.0012) [2023-12-28 03:15:11,259][106225] Updated weights for policy 1, policy_version 1115307 (0.0011) [2023-12-28 03:15:11,286][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001115312_285564928.pth... [2023-12-28 03:15:11,289][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001114128_285261824.pth [2023-12-28 03:15:11,772][106226] Updated weights for policy 0, policy_version 1112418 (0.0007) [2023-12-28 03:15:11,827][106226] Updated weights for policy 0, policy_version 1112428 (0.0008) [2023-12-28 03:15:11,889][106226] Updated weights for policy 0, policy_version 1112438 (0.0009) [2023-12-28 03:15:12,005][106225] Updated weights for policy 1, policy_version 1115317 (0.0011) [2023-12-28 03:15:12,066][106225] Updated weights for policy 1, policy_version 1115327 (0.0010) [2023-12-28 03:15:12,127][106225] Updated weights for policy 1, policy_version 1115337 (0.0010) [2023-12-28 03:15:12,724][106226] Updated weights for policy 0, policy_version 1112448 (0.0008) [2023-12-28 03:15:12,782][106226] Updated weights for policy 0, policy_version 1112458 (0.0008) [2023-12-28 03:15:12,833][106226] Updated weights for policy 0, policy_version 1112468 (0.0008) [2023-12-28 03:15:12,851][106225] Updated weights for policy 1, policy_version 1115347 (0.0010) [2023-12-28 03:15:12,905][106225] Updated weights for policy 1, policy_version 1115357 (0.0010) [2023-12-28 03:15:12,951][106225] Updated weights for policy 1, policy_version 1115367 (0.0010) [2023-12-28 03:15:13,471][106226] Updated weights for policy 0, policy_version 1112478 (0.0008) [2023-12-28 03:15:13,521][106226] Updated weights for policy 0, policy_version 1112488 (0.0008) [2023-12-28 03:15:13,574][106226] Updated weights for policy 0, policy_version 1112498 (0.0006) [2023-12-28 03:15:13,667][106225] Updated weights for policy 1, policy_version 1115377 (0.0009) [2023-12-28 03:15:13,738][106225] Updated weights for policy 1, policy_version 1115387 (0.0005) [2023-12-28 03:15:13,801][106225] Updated weights for policy 1, policy_version 1115397 (0.0005) [2023-12-28 03:15:13,856][106225] Updated weights for policy 1, policy_version 1115407 (0.0005) [2023-12-28 03:15:14,272][106226] Updated weights for policy 0, policy_version 1112508 (0.0007) [2023-12-28 03:15:14,327][106226] Updated weights for policy 0, policy_version 1112518 (0.0008) [2023-12-28 03:15:14,388][106225] Updated weights for policy 1, policy_version 1115417 (0.0009) [2023-12-28 03:15:14,388][106226] Updated weights for policy 0, policy_version 1112528 (0.0008) [2023-12-28 03:15:14,447][106225] Updated weights for policy 1, policy_version 1115427 (0.0007) [2023-12-28 03:15:14,504][106225] Updated weights for policy 1, policy_version 1115437 (0.0007) [2023-12-28 03:15:15,042][106226] Updated weights for policy 0, policy_version 1112538 (0.0008) [2023-12-28 03:15:15,099][106226] Updated weights for policy 0, policy_version 1112548 (0.0008) [2023-12-28 03:15:15,165][106226] Updated weights for policy 0, policy_version 1112558 (0.0009) [2023-12-28 03:15:15,217][106225] Updated weights for policy 1, policy_version 1115447 (0.0008) [2023-12-28 03:15:15,220][106226] Updated weights for policy 0, policy_version 1112568 (0.0008) [2023-12-28 03:15:15,271][106225] Updated weights for policy 1, policy_version 1115457 (0.0009) [2023-12-28 03:15:15,333][106225] Updated weights for policy 1, policy_version 1115467 (0.0009) [2023-12-28 03:15:15,908][106226] Updated weights for policy 0, policy_version 1112578 (0.0008) [2023-12-28 03:15:15,967][106226] Updated weights for policy 0, policy_version 1112588 (0.0009) [2023-12-28 03:15:16,027][106226] Updated weights for policy 0, policy_version 1112598 (0.0008) [2023-12-28 03:15:16,036][106225] Updated weights for policy 1, policy_version 1115477 (0.0007) [2023-12-28 03:15:16,098][106225] Updated weights for policy 1, policy_version 1115487 (0.0006) [2023-12-28 03:15:16,146][106225] Updated weights for policy 1, policy_version 1115497 (0.0009) [2023-12-28 03:15:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 570490880. Throughput: 0: 10027.2, 1: 9949.3. Samples: 570482180. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:16,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.829')] [2023-12-28 03:15:16,625][106226] Updated weights for policy 0, policy_version 1112608 (0.0005) [2023-12-28 03:15:16,691][106226] Updated weights for policy 0, policy_version 1112618 (0.0005) [2023-12-28 03:15:16,698][106225] Updated weights for policy 1, policy_version 1115507 (0.0005) [2023-12-28 03:15:16,744][106225] Updated weights for policy 1, policy_version 1115517 (0.0005) [2023-12-28 03:15:16,748][106226] Updated weights for policy 0, policy_version 1112628 (0.0005) [2023-12-28 03:15:16,793][106225] Updated weights for policy 1, policy_version 1115527 (0.0006) [2023-12-28 03:15:17,379][106226] Updated weights for policy 0, policy_version 1112638 (0.0007) [2023-12-28 03:15:17,430][106226] Updated weights for policy 0, policy_version 1112648 (0.0008) [2023-12-28 03:15:17,463][106225] Updated weights for policy 1, policy_version 1115537 (0.0010) [2023-12-28 03:15:17,488][106226] Updated weights for policy 0, policy_version 1112658 (0.0006) [2023-12-28 03:15:17,523][106225] Updated weights for policy 1, policy_version 1115547 (0.0010) [2023-12-28 03:15:17,572][106225] Updated weights for policy 1, policy_version 1115557 (0.0010) [2023-12-28 03:15:17,617][106225] Updated weights for policy 1, policy_version 1115567 (0.0009) [2023-12-28 03:15:18,190][106226] Updated weights for policy 0, policy_version 1112668 (0.0007) [2023-12-28 03:15:18,204][106225] Updated weights for policy 1, policy_version 1115577 (0.0010) [2023-12-28 03:15:18,245][106226] Updated weights for policy 0, policy_version 1112678 (0.0005) [2023-12-28 03:15:18,265][106225] Updated weights for policy 1, policy_version 1115587 (0.0010) [2023-12-28 03:15:18,301][106226] Updated weights for policy 0, policy_version 1112688 (0.0005) [2023-12-28 03:15:18,324][106225] Updated weights for policy 1, policy_version 1115597 (0.0011) [2023-12-28 03:15:18,980][106226] Updated weights for policy 0, policy_version 1112698 (0.0007) [2023-12-28 03:15:19,038][106226] Updated weights for policy 0, policy_version 1112708 (0.0009) [2023-12-28 03:15:19,073][106225] Updated weights for policy 1, policy_version 1115607 (0.0007) [2023-12-28 03:15:19,092][106226] Updated weights for policy 0, policy_version 1112718 (0.0007) [2023-12-28 03:15:19,127][106225] Updated weights for policy 1, policy_version 1115617 (0.0007) [2023-12-28 03:15:19,157][106226] Updated weights for policy 0, policy_version 1112728 (0.0007) [2023-12-28 03:15:19,188][106225] Updated weights for policy 1, policy_version 1115627 (0.0007) [2023-12-28 03:15:19,870][106225] Updated weights for policy 1, policy_version 1115637 (0.0009) [2023-12-28 03:15:19,937][106225] Updated weights for policy 1, policy_version 1115647 (0.0008) [2023-12-28 03:15:19,947][106226] Updated weights for policy 0, policy_version 1112738 (0.0009) [2023-12-28 03:15:20,008][106225] Updated weights for policy 1, policy_version 1115657 (0.0007) [2023-12-28 03:15:20,010][106226] Updated weights for policy 0, policy_version 1112748 (0.0010) [2023-12-28 03:15:20,077][106226] Updated weights for policy 0, policy_version 1112758 (0.0010) [2023-12-28 03:15:20,717][106225] Updated weights for policy 1, policy_version 1115667 (0.0007) [2023-12-28 03:15:20,778][106225] Updated weights for policy 1, policy_version 1115677 (0.0009) [2023-12-28 03:15:20,845][106225] Updated weights for policy 1, policy_version 1115687 (0.0008) [2023-12-28 03:15:20,852][106226] Updated weights for policy 0, policy_version 1112768 (0.0007) [2023-12-28 03:15:20,913][106226] Updated weights for policy 0, policy_version 1112778 (0.0007) [2023-12-28 03:15:20,972][106226] Updated weights for policy 0, policy_version 1112788 (0.0008) [2023-12-28 03:15:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 570597376. Throughput: 0: 9997.7, 1: 9996.1. Samples: 570603684. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:21,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.680')] [2023-12-28 03:15:21,571][106225] Updated weights for policy 1, policy_version 1115697 (0.0007) [2023-12-28 03:15:21,634][106225] Updated weights for policy 1, policy_version 1115707 (0.0007) [2023-12-28 03:15:21,695][106225] Updated weights for policy 1, policy_version 1115717 (0.0007) [2023-12-28 03:15:21,738][106226] Updated weights for policy 0, policy_version 1112798 (0.0010) [2023-12-28 03:15:21,764][106225] Updated weights for policy 1, policy_version 1115727 (0.0008) [2023-12-28 03:15:21,805][106226] Updated weights for policy 0, policy_version 1112808 (0.0010) [2023-12-28 03:15:21,861][106226] Updated weights for policy 0, policy_version 1112818 (0.0011) [2023-12-28 03:15:22,518][106225] Updated weights for policy 1, policy_version 1115737 (0.0007) [2023-12-28 03:15:22,574][106225] Updated weights for policy 1, policy_version 1115747 (0.0008) [2023-12-28 03:15:22,585][106226] Updated weights for policy 0, policy_version 1112828 (0.0008) [2023-12-28 03:15:22,642][106226] Updated weights for policy 0, policy_version 1112838 (0.0008) [2023-12-28 03:15:22,644][106225] Updated weights for policy 1, policy_version 1115757 (0.0006) [2023-12-28 03:15:22,700][106226] Updated weights for policy 0, policy_version 1112848 (0.0007) [2023-12-28 03:15:23,231][106225] Updated weights for policy 1, policy_version 1115767 (0.0008) [2023-12-28 03:15:23,283][106225] Updated weights for policy 1, policy_version 1115777 (0.0007) [2023-12-28 03:15:23,294][106226] Updated weights for policy 0, policy_version 1112858 (0.0007) [2023-12-28 03:15:23,338][106225] Updated weights for policy 1, policy_version 1115787 (0.0005) [2023-12-28 03:15:23,351][106226] Updated weights for policy 0, policy_version 1112868 (0.0009) [2023-12-28 03:15:23,402][106226] Updated weights for policy 0, policy_version 1112878 (0.0005) [2023-12-28 03:15:23,445][106226] Updated weights for policy 0, policy_version 1112888 (0.0005) [2023-12-28 03:15:24,091][106225] Updated weights for policy 1, policy_version 1115797 (0.0009) [2023-12-28 03:15:24,118][106226] Updated weights for policy 0, policy_version 1112898 (0.0011) [2023-12-28 03:15:24,140][106225] Updated weights for policy 1, policy_version 1115807 (0.0007) [2023-12-28 03:15:24,173][106226] Updated weights for policy 0, policy_version 1112908 (0.0011) [2023-12-28 03:15:24,191][106225] Updated weights for policy 1, policy_version 1115817 (0.0006) [2023-12-28 03:15:24,231][106226] Updated weights for policy 0, policy_version 1112918 (0.0011) [2023-12-28 03:15:24,938][106226] Updated weights for policy 0, policy_version 1112928 (0.0006) [2023-12-28 03:15:24,966][106225] Updated weights for policy 1, policy_version 1115827 (0.0007) [2023-12-28 03:15:24,996][106226] Updated weights for policy 0, policy_version 1112938 (0.0009) [2023-12-28 03:15:25,025][106225] Updated weights for policy 1, policy_version 1115837 (0.0007) [2023-12-28 03:15:25,049][106226] Updated weights for policy 0, policy_version 1112948 (0.0010) [2023-12-28 03:15:25,079][106225] Updated weights for policy 1, policy_version 1115847 (0.0005) [2023-12-28 03:15:25,687][106225] Updated weights for policy 1, policy_version 1115857 (0.0008) [2023-12-28 03:15:25,719][106226] Updated weights for policy 0, policy_version 1112958 (0.0011) [2023-12-28 03:15:25,744][106225] Updated weights for policy 1, policy_version 1115867 (0.0006) [2023-12-28 03:15:25,777][106226] Updated weights for policy 0, policy_version 1112968 (0.0007) [2023-12-28 03:15:25,800][106225] Updated weights for policy 1, policy_version 1115877 (0.0006) [2023-12-28 03:15:25,834][106226] Updated weights for policy 0, policy_version 1112978 (0.0008) [2023-12-28 03:15:25,858][106225] Updated weights for policy 1, policy_version 1115887 (0.0009) [2023-12-28 03:15:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 570695680. Throughput: 0: 9992.7, 1: 9955.5. Samples: 570663212. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:26,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-5.091')] [2023-12-28 03:15:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001115888_285712384.pth... [2023-12-28 03:15:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001112984_284983296.pth... [2023-12-28 03:15:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001111832_284688384.pth [2023-12-28 03:15:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001114704_285409280.pth [2023-12-28 03:15:26,444][106225] Updated weights for policy 1, policy_version 1115897 (0.0006) [2023-12-28 03:15:26,497][106225] Updated weights for policy 1, policy_version 1115907 (0.0010) [2023-12-28 03:15:26,542][106226] Updated weights for policy 0, policy_version 1112988 (0.0006) [2023-12-28 03:15:26,561][106225] Updated weights for policy 1, policy_version 1115917 (0.0006) [2023-12-28 03:15:26,592][106226] Updated weights for policy 0, policy_version 1112998 (0.0005) [2023-12-28 03:15:26,648][106226] Updated weights for policy 0, policy_version 1113008 (0.0009) [2023-12-28 03:15:27,106][106225] Updated weights for policy 1, policy_version 1115927 (0.0009) [2023-12-28 03:15:27,164][106225] Updated weights for policy 1, policy_version 1115937 (0.0009) [2023-12-28 03:15:27,234][106225] Updated weights for policy 1, policy_version 1115947 (0.0007) [2023-12-28 03:15:27,420][106226] Updated weights for policy 0, policy_version 1113018 (0.0008) [2023-12-28 03:15:27,468][106226] Updated weights for policy 0, policy_version 1113028 (0.0007) [2023-12-28 03:15:27,520][106226] Updated weights for policy 0, policy_version 1113038 (0.0008) [2023-12-28 03:15:27,562][106226] Updated weights for policy 0, policy_version 1113048 (0.0008) [2023-12-28 03:15:27,875][106225] Updated weights for policy 1, policy_version 1115957 (0.0010) [2023-12-28 03:15:27,925][106225] Updated weights for policy 1, policy_version 1115967 (0.0010) [2023-12-28 03:15:27,971][106225] Updated weights for policy 1, policy_version 1115977 (0.0010) [2023-12-28 03:15:28,285][106226] Updated weights for policy 0, policy_version 1113058 (0.0008) [2023-12-28 03:15:28,349][106226] Updated weights for policy 0, policy_version 1113068 (0.0009) [2023-12-28 03:15:28,397][106226] Updated weights for policy 0, policy_version 1113078 (0.0008) [2023-12-28 03:15:28,672][106225] Updated weights for policy 1, policy_version 1115987 (0.0010) [2023-12-28 03:15:28,732][106225] Updated weights for policy 1, policy_version 1115997 (0.0010) [2023-12-28 03:15:28,795][106225] Updated weights for policy 1, policy_version 1116007 (0.0008) [2023-12-28 03:15:29,066][106226] Updated weights for policy 0, policy_version 1113088 (0.0010) [2023-12-28 03:15:29,118][106226] Updated weights for policy 0, policy_version 1113098 (0.0009) [2023-12-28 03:15:29,179][106226] Updated weights for policy 0, policy_version 1113108 (0.0007) [2023-12-28 03:15:29,360][106225] Updated weights for policy 1, policy_version 1116017 (0.0006) [2023-12-28 03:15:29,424][106225] Updated weights for policy 1, policy_version 1116027 (0.0008) [2023-12-28 03:15:29,485][106225] Updated weights for policy 1, policy_version 1116037 (0.0006) [2023-12-28 03:15:29,545][106225] Updated weights for policy 1, policy_version 1116047 (0.0009) [2023-12-28 03:15:29,838][106226] Updated weights for policy 0, policy_version 1113118 (0.0011) [2023-12-28 03:15:29,906][106226] Updated weights for policy 0, policy_version 1113128 (0.0011) [2023-12-28 03:15:29,971][106226] Updated weights for policy 0, policy_version 1113138 (0.0012) [2023-12-28 03:15:30,229][106225] Updated weights for policy 1, policy_version 1116057 (0.0010) [2023-12-28 03:15:30,283][106225] Updated weights for policy 1, policy_version 1116067 (0.0010) [2023-12-28 03:15:30,334][106225] Updated weights for policy 1, policy_version 1116077 (0.0010) [2023-12-28 03:15:30,598][106226] Updated weights for policy 0, policy_version 1113148 (0.0011) [2023-12-28 03:15:30,664][106226] Updated weights for policy 0, policy_version 1113158 (0.0010) [2023-12-28 03:15:30,723][106226] Updated weights for policy 0, policy_version 1113168 (0.0008) [2023-12-28 03:15:31,003][106225] Updated weights for policy 1, policy_version 1116087 (0.0010) [2023-12-28 03:15:31,072][106225] Updated weights for policy 1, policy_version 1116097 (0.0010) [2023-12-28 03:15:31,131][106225] Updated weights for policy 1, policy_version 1116107 (0.0010) [2023-12-28 03:15:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 570802176. Throughput: 0: 9977.3, 1: 10113.6. Samples: 570786984. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:31,175][105115] Avg episode reward: [(0, '-4.974'), (1, '-4.835')] [2023-12-28 03:15:31,482][106226] Updated weights for policy 0, policy_version 1113178 (0.0007) [2023-12-28 03:15:31,548][106226] Updated weights for policy 0, policy_version 1113188 (0.0007) [2023-12-28 03:15:31,612][106226] Updated weights for policy 0, policy_version 1113198 (0.0006) [2023-12-28 03:15:31,680][106226] Updated weights for policy 0, policy_version 1113208 (0.0008) [2023-12-28 03:15:31,878][106225] Updated weights for policy 1, policy_version 1116117 (0.0010) [2023-12-28 03:15:31,941][106225] Updated weights for policy 1, policy_version 1116127 (0.0010) [2023-12-28 03:15:31,995][106225] Updated weights for policy 1, policy_version 1116137 (0.0010) [2023-12-28 03:15:32,390][106226] Updated weights for policy 0, policy_version 1113218 (0.0013) [2023-12-28 03:15:32,448][106226] Updated weights for policy 0, policy_version 1113228 (0.0011) [2023-12-28 03:15:32,512][106226] Updated weights for policy 0, policy_version 1113238 (0.0011) [2023-12-28 03:15:32,643][106225] Updated weights for policy 1, policy_version 1116147 (0.0010) [2023-12-28 03:15:32,694][106225] Updated weights for policy 1, policy_version 1116157 (0.0010) [2023-12-28 03:15:32,745][106225] Updated weights for policy 1, policy_version 1116167 (0.0010) [2023-12-28 03:15:33,181][106226] Updated weights for policy 0, policy_version 1113248 (0.0010) [2023-12-28 03:15:33,249][106226] Updated weights for policy 0, policy_version 1113258 (0.0006) [2023-12-28 03:15:33,316][106226] Updated weights for policy 0, policy_version 1113268 (0.0006) [2023-12-28 03:15:33,319][106225] Updated weights for policy 1, policy_version 1116177 (0.0009) [2023-12-28 03:15:33,368][106225] Updated weights for policy 1, policy_version 1116187 (0.0007) [2023-12-28 03:15:33,418][106225] Updated weights for policy 1, policy_version 1116197 (0.0009) [2023-12-28 03:15:33,467][106225] Updated weights for policy 1, policy_version 1116207 (0.0008) [2023-12-28 03:15:33,916][106226] Updated weights for policy 0, policy_version 1113278 (0.0008) [2023-12-28 03:15:33,968][106226] Updated weights for policy 0, policy_version 1113288 (0.0009) [2023-12-28 03:15:34,020][106226] Updated weights for policy 0, policy_version 1113298 (0.0009) [2023-12-28 03:15:34,272][106225] Updated weights for policy 1, policy_version 1116217 (0.0009) [2023-12-28 03:15:34,338][106225] Updated weights for policy 1, policy_version 1116227 (0.0007) [2023-12-28 03:15:34,399][106225] Updated weights for policy 1, policy_version 1116237 (0.0008) [2023-12-28 03:15:34,784][106226] Updated weights for policy 0, policy_version 1113308 (0.0008) [2023-12-28 03:15:34,836][106226] Updated weights for policy 0, policy_version 1113318 (0.0008) [2023-12-28 03:15:34,893][106226] Updated weights for policy 0, policy_version 1113328 (0.0008) [2023-12-28 03:15:35,065][106225] Updated weights for policy 1, policy_version 1116247 (0.0006) [2023-12-28 03:15:35,118][106225] Updated weights for policy 1, policy_version 1116257 (0.0007) [2023-12-28 03:15:35,179][106225] Updated weights for policy 1, policy_version 1116267 (0.0005) [2023-12-28 03:15:35,598][106226] Updated weights for policy 0, policy_version 1113338 (0.0007) [2023-12-28 03:15:35,651][106226] Updated weights for policy 0, policy_version 1113348 (0.0005) [2023-12-28 03:15:35,702][106226] Updated weights for policy 0, policy_version 1113358 (0.0006) [2023-12-28 03:15:35,757][106226] Updated weights for policy 0, policy_version 1113368 (0.0005) [2023-12-28 03:15:35,861][106225] Updated weights for policy 1, policy_version 1116277 (0.0008) [2023-12-28 03:15:35,910][106225] Updated weights for policy 1, policy_version 1116287 (0.0010) [2023-12-28 03:15:35,962][106225] Updated weights for policy 1, policy_version 1116297 (0.0007) [2023-12-28 03:15:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 570900480. Throughput: 0: 10021.4, 1: 10114.4. Samples: 570908364. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:36,176][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.013')] [2023-12-28 03:15:36,374][106226] Updated weights for policy 0, policy_version 1113378 (0.0011) [2023-12-28 03:15:36,438][106226] Updated weights for policy 0, policy_version 1113388 (0.0010) [2023-12-28 03:15:36,501][106226] Updated weights for policy 0, policy_version 1113398 (0.0008) [2023-12-28 03:15:36,717][106225] Updated weights for policy 1, policy_version 1116307 (0.0008) [2023-12-28 03:15:36,774][106225] Updated weights for policy 1, policy_version 1116317 (0.0009) [2023-12-28 03:15:36,827][106225] Updated weights for policy 1, policy_version 1116327 (0.0009) [2023-12-28 03:15:37,061][106226] Updated weights for policy 0, policy_version 1113408 (0.0009) [2023-12-28 03:15:37,125][106226] Updated weights for policy 0, policy_version 1113418 (0.0008) [2023-12-28 03:15:37,191][106226] Updated weights for policy 0, policy_version 1113428 (0.0006) [2023-12-28 03:15:37,625][106225] Updated weights for policy 1, policy_version 1116337 (0.0010) [2023-12-28 03:15:37,682][106225] Updated weights for policy 1, policy_version 1116347 (0.0006) [2023-12-28 03:15:37,743][106225] Updated weights for policy 1, policy_version 1116357 (0.0009) [2023-12-28 03:15:37,801][106225] Updated weights for policy 1, policy_version 1116367 (0.0010) [2023-12-28 03:15:37,899][106226] Updated weights for policy 0, policy_version 1113438 (0.0011) [2023-12-28 03:15:37,961][106226] Updated weights for policy 0, policy_version 1113448 (0.0008) [2023-12-28 03:15:38,014][106226] Updated weights for policy 0, policy_version 1113458 (0.0010) [2023-12-28 03:15:38,487][106225] Updated weights for policy 1, policy_version 1116377 (0.0006) [2023-12-28 03:15:38,547][106225] Updated weights for policy 1, policy_version 1116387 (0.0008) [2023-12-28 03:15:38,609][106225] Updated weights for policy 1, policy_version 1116397 (0.0005) [2023-12-28 03:15:38,679][106226] Updated weights for policy 0, policy_version 1113468 (0.0011) [2023-12-28 03:15:38,742][106226] Updated weights for policy 0, policy_version 1113478 (0.0011) [2023-12-28 03:15:38,806][106226] Updated weights for policy 0, policy_version 1113488 (0.0011) [2023-12-28 03:15:39,210][106225] Updated weights for policy 1, policy_version 1116407 (0.0005) [2023-12-28 03:15:39,277][106225] Updated weights for policy 1, policy_version 1116417 (0.0009) [2023-12-28 03:15:39,340][106225] Updated weights for policy 1, policy_version 1116427 (0.0010) [2023-12-28 03:15:39,490][106226] Updated weights for policy 0, policy_version 1113498 (0.0010) [2023-12-28 03:15:39,557][106226] Updated weights for policy 0, policy_version 1113508 (0.0007) [2023-12-28 03:15:39,624][106226] Updated weights for policy 0, policy_version 1113518 (0.0006) [2023-12-28 03:15:39,687][106226] Updated weights for policy 0, policy_version 1113528 (0.0007) [2023-12-28 03:15:40,090][106225] Updated weights for policy 1, policy_version 1116437 (0.0010) [2023-12-28 03:15:40,148][106225] Updated weights for policy 1, policy_version 1116447 (0.0010) [2023-12-28 03:15:40,207][106225] Updated weights for policy 1, policy_version 1116457 (0.0011) [2023-12-28 03:15:40,411][106226] Updated weights for policy 0, policy_version 1113538 (0.0007) [2023-12-28 03:15:40,478][106226] Updated weights for policy 0, policy_version 1113548 (0.0005) [2023-12-28 03:15:40,544][106226] Updated weights for policy 0, policy_version 1113558 (0.0005) [2023-12-28 03:15:40,941][106225] Updated weights for policy 1, policy_version 1116467 (0.0011) [2023-12-28 03:15:40,992][106225] Updated weights for policy 1, policy_version 1116477 (0.0010) [2023-12-28 03:15:41,051][106225] Updated weights for policy 1, policy_version 1116487 (0.0009) [2023-12-28 03:15:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 570998784. Throughput: 0: 9975.0, 1: 10132.8. Samples: 570967404. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:41,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-5.187')] [2023-12-28 03:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001116496_285868032.pth... [2023-12-28 03:15:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001115312_285564928.pth [2023-12-28 03:15:41,188][106226] Updated weights for policy 0, policy_version 1113568 (0.0007) [2023-12-28 03:15:41,257][106226] Updated weights for policy 0, policy_version 1113578 (0.0009) [2023-12-28 03:15:41,324][106226] Updated weights for policy 0, policy_version 1113588 (0.0008) [2023-12-28 03:15:41,356][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001113592_285138944.pth... [2023-12-28 03:15:41,361][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001112408_284835840.pth [2023-12-28 03:15:41,844][106225] Updated weights for policy 1, policy_version 1116497 (0.0010) [2023-12-28 03:15:41,904][106225] Updated weights for policy 1, policy_version 1116507 (0.0008) [2023-12-28 03:15:41,960][106225] Updated weights for policy 1, policy_version 1116517 (0.0008) [2023-12-28 03:15:42,020][106225] Updated weights for policy 1, policy_version 1116527 (0.0008) [2023-12-28 03:15:42,124][106226] Updated weights for policy 0, policy_version 1113598 (0.0009) [2023-12-28 03:15:42,183][106226] Updated weights for policy 0, policy_version 1113608 (0.0009) [2023-12-28 03:15:42,247][106226] Updated weights for policy 0, policy_version 1113618 (0.0009) [2023-12-28 03:15:42,755][106225] Updated weights for policy 1, policy_version 1116537 (0.0006) [2023-12-28 03:15:42,821][106225] Updated weights for policy 1, policy_version 1116547 (0.0006) [2023-12-28 03:15:42,883][106225] Updated weights for policy 1, policy_version 1116557 (0.0008) [2023-12-28 03:15:42,919][106226] Updated weights for policy 0, policy_version 1113628 (0.0007) [2023-12-28 03:15:42,973][106226] Updated weights for policy 0, policy_version 1113638 (0.0009) [2023-12-28 03:15:43,027][106226] Updated weights for policy 0, policy_version 1113648 (0.0008) [2023-12-28 03:15:43,533][106225] Updated weights for policy 1, policy_version 1116567 (0.0007) [2023-12-28 03:15:43,579][106225] Updated weights for policy 1, policy_version 1116577 (0.0008) [2023-12-28 03:15:43,626][106225] Updated weights for policy 1, policy_version 1116587 (0.0008) [2023-12-28 03:15:43,680][106226] Updated weights for policy 0, policy_version 1113658 (0.0008) [2023-12-28 03:15:43,735][106226] Updated weights for policy 0, policy_version 1113668 (0.0007) [2023-12-28 03:15:43,793][106226] Updated weights for policy 0, policy_version 1113678 (0.0007) [2023-12-28 03:15:43,855][106226] Updated weights for policy 0, policy_version 1113688 (0.0006) [2023-12-28 03:15:44,382][106225] Updated weights for policy 1, policy_version 1116597 (0.0009) [2023-12-28 03:15:44,435][106225] Updated weights for policy 1, policy_version 1116607 (0.0010) [2023-12-28 03:15:44,496][106225] Updated weights for policy 1, policy_version 1116617 (0.0010) [2023-12-28 03:15:44,521][106226] Updated weights for policy 0, policy_version 1113698 (0.0006) [2023-12-28 03:15:44,576][106226] Updated weights for policy 0, policy_version 1113708 (0.0005) [2023-12-28 03:15:44,623][106226] Updated weights for policy 0, policy_version 1113718 (0.0008) [2023-12-28 03:15:45,228][106225] Updated weights for policy 1, policy_version 1116627 (0.0010) [2023-12-28 03:15:45,276][106226] Updated weights for policy 0, policy_version 1113728 (0.0009) [2023-12-28 03:15:45,284][106225] Updated weights for policy 1, policy_version 1116637 (0.0010) [2023-12-28 03:15:45,339][106226] Updated weights for policy 0, policy_version 1113738 (0.0007) [2023-12-28 03:15:45,345][106225] Updated weights for policy 1, policy_version 1116647 (0.0008) [2023-12-28 03:15:45,400][106226] Updated weights for policy 0, policy_version 1113748 (0.0005) [2023-12-28 03:15:45,938][106225] Updated weights for policy 1, policy_version 1116657 (0.0010) [2023-12-28 03:15:45,979][106226] Updated weights for policy 0, policy_version 1113758 (0.0007) [2023-12-28 03:15:45,998][106225] Updated weights for policy 1, policy_version 1116667 (0.0005) [2023-12-28 03:15:46,042][106226] Updated weights for policy 0, policy_version 1113768 (0.0006) [2023-12-28 03:15:46,064][106225] Updated weights for policy 1, policy_version 1116677 (0.0008) [2023-12-28 03:15:46,097][106226] Updated weights for policy 0, policy_version 1113778 (0.0006) [2023-12-28 03:15:46,129][106225] Updated weights for policy 1, policy_version 1116687 (0.0007) [2023-12-28 03:15:46,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 571105280. Throughput: 0: 10010.1, 1: 10052.9. Samples: 571084844. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:46,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-5.042')] [2023-12-28 03:15:46,720][106225] Updated weights for policy 1, policy_version 1116697 (0.0008) [2023-12-28 03:15:46,774][106225] Updated weights for policy 1, policy_version 1116707 (0.0007) [2023-12-28 03:15:46,795][106226] Updated weights for policy 0, policy_version 1113788 (0.0008) [2023-12-28 03:15:46,826][106225] Updated weights for policy 1, policy_version 1116717 (0.0007) [2023-12-28 03:15:46,847][106226] Updated weights for policy 0, policy_version 1113798 (0.0011) [2023-12-28 03:15:46,907][106226] Updated weights for policy 0, policy_version 1113808 (0.0011) [2023-12-28 03:15:47,550][106225] Updated weights for policy 1, policy_version 1116727 (0.0007) [2023-12-28 03:15:47,603][106225] Updated weights for policy 1, policy_version 1116737 (0.0005) [2023-12-28 03:15:47,638][106226] Updated weights for policy 0, policy_version 1113818 (0.0010) [2023-12-28 03:15:47,659][106225] Updated weights for policy 1, policy_version 1116747 (0.0006) [2023-12-28 03:15:47,688][106226] Updated weights for policy 0, policy_version 1113828 (0.0011) [2023-12-28 03:15:47,735][106226] Updated weights for policy 0, policy_version 1113838 (0.0011) [2023-12-28 03:15:47,785][106226] Updated weights for policy 0, policy_version 1113848 (0.0010) [2023-12-28 03:15:48,265][106225] Updated weights for policy 1, policy_version 1116757 (0.0008) [2023-12-28 03:15:48,327][106225] Updated weights for policy 1, policy_version 1116767 (0.0010) [2023-12-28 03:15:48,390][106225] Updated weights for policy 1, policy_version 1116777 (0.0007) [2023-12-28 03:15:48,562][106226] Updated weights for policy 0, policy_version 1113858 (0.0007) [2023-12-28 03:15:48,630][106226] Updated weights for policy 0, policy_version 1113868 (0.0007) [2023-12-28 03:15:48,690][106226] Updated weights for policy 0, policy_version 1113878 (0.0011) [2023-12-28 03:15:49,130][106225] Updated weights for policy 1, policy_version 1116787 (0.0010) [2023-12-28 03:15:49,190][106225] Updated weights for policy 1, policy_version 1116797 (0.0010) [2023-12-28 03:15:49,248][106225] Updated weights for policy 1, policy_version 1116807 (0.0010) [2023-12-28 03:15:49,389][106226] Updated weights for policy 0, policy_version 1113888 (0.0010) [2023-12-28 03:15:49,448][106226] Updated weights for policy 0, policy_version 1113898 (0.0008) [2023-12-28 03:15:49,502][106226] Updated weights for policy 0, policy_version 1113908 (0.0008) [2023-12-28 03:15:49,969][106225] Updated weights for policy 1, policy_version 1116817 (0.0009) [2023-12-28 03:15:50,032][106225] Updated weights for policy 1, policy_version 1116827 (0.0010) [2023-12-28 03:15:50,096][106225] Updated weights for policy 1, policy_version 1116837 (0.0010) [2023-12-28 03:15:50,155][106225] Updated weights for policy 1, policy_version 1116847 (0.0010) [2023-12-28 03:15:50,303][106226] Updated weights for policy 0, policy_version 1113918 (0.0008) [2023-12-28 03:15:50,360][106226] Updated weights for policy 0, policy_version 1113928 (0.0008) [2023-12-28 03:15:50,422][106226] Updated weights for policy 0, policy_version 1113938 (0.0009) [2023-12-28 03:15:50,896][106225] Updated weights for policy 1, policy_version 1116857 (0.0010) [2023-12-28 03:15:50,957][106225] Updated weights for policy 1, policy_version 1116867 (0.0011) [2023-12-28 03:15:51,019][106225] Updated weights for policy 1, policy_version 1116877 (0.0011) [2023-12-28 03:15:51,171][106226] Updated weights for policy 0, policy_version 1113948 (0.0008) [2023-12-28 03:15:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 571195392. Throughput: 0: 9988.9, 1: 10070.5. Samples: 571205256. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:51,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.861')] [2023-12-28 03:15:51,228][106226] Updated weights for policy 0, policy_version 1113958 (0.0008) [2023-12-28 03:15:51,290][106226] Updated weights for policy 0, policy_version 1113968 (0.0008) [2023-12-28 03:15:51,795][106225] Updated weights for policy 1, policy_version 1116887 (0.0008) [2023-12-28 03:15:51,853][106225] Updated weights for policy 1, policy_version 1116897 (0.0006) [2023-12-28 03:15:51,914][106225] Updated weights for policy 1, policy_version 1116907 (0.0007) [2023-12-28 03:15:52,071][106226] Updated weights for policy 0, policy_version 1113978 (0.0008) [2023-12-28 03:15:52,136][106226] Updated weights for policy 0, policy_version 1113988 (0.0010) [2023-12-28 03:15:52,198][106226] Updated weights for policy 0, policy_version 1113998 (0.0011) [2023-12-28 03:15:52,258][106226] Updated weights for policy 0, policy_version 1114008 (0.0010) [2023-12-28 03:15:52,625][106225] Updated weights for policy 1, policy_version 1116917 (0.0010) [2023-12-28 03:15:52,679][106225] Updated weights for policy 1, policy_version 1116927 (0.0010) [2023-12-28 03:15:52,726][106225] Updated weights for policy 1, policy_version 1116937 (0.0010) [2023-12-28 03:15:52,907][106226] Updated weights for policy 0, policy_version 1114018 (0.0006) [2023-12-28 03:15:52,965][106226] Updated weights for policy 0, policy_version 1114028 (0.0006) [2023-12-28 03:15:53,028][106226] Updated weights for policy 0, policy_version 1114038 (0.0008) [2023-12-28 03:15:53,454][106225] Updated weights for policy 1, policy_version 1116947 (0.0010) [2023-12-28 03:15:53,504][106225] Updated weights for policy 1, policy_version 1116957 (0.0010) [2023-12-28 03:15:53,547][106226] Updated weights for policy 0, policy_version 1114048 (0.0005) [2023-12-28 03:15:53,554][106225] Updated weights for policy 1, policy_version 1116967 (0.0010) [2023-12-28 03:15:53,599][106226] Updated weights for policy 0, policy_version 1114058 (0.0005) [2023-12-28 03:15:53,658][106226] Updated weights for policy 0, policy_version 1114068 (0.0005) [2023-12-28 03:15:54,238][106225] Updated weights for policy 1, policy_version 1116977 (0.0010) [2023-12-28 03:15:54,243][106226] Updated weights for policy 0, policy_version 1114078 (0.0006) [2023-12-28 03:15:54,296][106225] Updated weights for policy 1, policy_version 1116987 (0.0008) [2023-12-28 03:15:54,304][106226] Updated weights for policy 0, policy_version 1114088 (0.0006) [2023-12-28 03:15:54,361][106226] Updated weights for policy 0, policy_version 1114098 (0.0005) [2023-12-28 03:15:54,361][106225] Updated weights for policy 1, policy_version 1116997 (0.0006) [2023-12-28 03:15:54,419][106225] Updated weights for policy 1, policy_version 1117007 (0.0005) [2023-12-28 03:15:54,996][106226] Updated weights for policy 0, policy_version 1114108 (0.0007) [2023-12-28 03:15:55,052][106226] Updated weights for policy 0, policy_version 1114118 (0.0011) [2023-12-28 03:15:55,070][106225] Updated weights for policy 1, policy_version 1117017 (0.0010) [2023-12-28 03:15:55,113][106226] Updated weights for policy 0, policy_version 1114128 (0.0010) [2023-12-28 03:15:55,130][106225] Updated weights for policy 1, policy_version 1117027 (0.0010) [2023-12-28 03:15:55,187][106225] Updated weights for policy 1, policy_version 1117037 (0.0010) [2023-12-28 03:15:55,782][106226] Updated weights for policy 0, policy_version 1114138 (0.0006) [2023-12-28 03:15:55,802][106225] Updated weights for policy 1, policy_version 1117047 (0.0010) [2023-12-28 03:15:55,839][106226] Updated weights for policy 0, policy_version 1114148 (0.0009) [2023-12-28 03:15:55,860][106225] Updated weights for policy 1, policy_version 1117057 (0.0010) [2023-12-28 03:15:55,903][106226] Updated weights for policy 0, policy_version 1114158 (0.0006) [2023-12-28 03:15:55,924][106225] Updated weights for policy 1, policy_version 1117067 (0.0009) [2023-12-28 03:15:55,963][106226] Updated weights for policy 0, policy_version 1114168 (0.0009) [2023-12-28 03:15:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 571301888. Throughput: 0: 9995.0, 1: 10028.5. Samples: 571265760. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:15:56,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-4.673')] [2023-12-28 03:15:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001117072_286015488.pth... [2023-12-28 03:15:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001114168_285286400.pth... [2023-12-28 03:15:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001112984_284983296.pth [2023-12-28 03:15:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001115888_285712384.pth [2023-12-28 03:15:56,587][106225] Updated weights for policy 1, policy_version 1117077 (0.0006) [2023-12-28 03:15:56,630][106226] Updated weights for policy 0, policy_version 1114178 (0.0010) [2023-12-28 03:15:56,636][106225] Updated weights for policy 1, policy_version 1117087 (0.0005) [2023-12-28 03:15:56,688][106226] Updated weights for policy 0, policy_version 1114188 (0.0011) [2023-12-28 03:15:56,700][106225] Updated weights for policy 1, policy_version 1117097 (0.0005) [2023-12-28 03:15:56,740][106226] Updated weights for policy 0, policy_version 1114198 (0.0007) [2023-12-28 03:15:57,269][106225] Updated weights for policy 1, policy_version 1117107 (0.0006) [2023-12-28 03:15:57,324][106225] Updated weights for policy 1, policy_version 1117117 (0.0007) [2023-12-28 03:15:57,368][106226] Updated weights for policy 0, policy_version 1114208 (0.0010) [2023-12-28 03:15:57,386][106225] Updated weights for policy 1, policy_version 1117127 (0.0006) [2023-12-28 03:15:57,430][106226] Updated weights for policy 0, policy_version 1114218 (0.0011) [2023-12-28 03:15:57,491][106226] Updated weights for policy 0, policy_version 1114228 (0.0010) [2023-12-28 03:15:58,115][106225] Updated weights for policy 1, policy_version 1117137 (0.0006) [2023-12-28 03:15:58,175][106225] Updated weights for policy 1, policy_version 1117147 (0.0008) [2023-12-28 03:15:58,179][106226] Updated weights for policy 0, policy_version 1114238 (0.0007) [2023-12-28 03:15:58,235][106225] Updated weights for policy 1, policy_version 1117157 (0.0008) [2023-12-28 03:15:58,240][106226] Updated weights for policy 0, policy_version 1114248 (0.0007) [2023-12-28 03:15:58,295][106225] Updated weights for policy 1, policy_version 1117167 (0.0008) [2023-12-28 03:15:58,300][106226] Updated weights for policy 0, policy_version 1114258 (0.0008) [2023-12-28 03:15:59,011][106226] Updated weights for policy 0, policy_version 1114268 (0.0009) [2023-12-28 03:15:59,069][106226] Updated weights for policy 0, policy_version 1114278 (0.0009) [2023-12-28 03:15:59,122][106225] Updated weights for policy 1, policy_version 1117177 (0.0007) [2023-12-28 03:15:59,128][106226] Updated weights for policy 0, policy_version 1114288 (0.0006) [2023-12-28 03:15:59,184][106225] Updated weights for policy 1, policy_version 1117187 (0.0008) [2023-12-28 03:15:59,267][106225] Updated weights for policy 1, policy_version 1117197 (0.0007) [2023-12-28 03:15:59,975][106226] Updated weights for policy 0, policy_version 1114298 (0.0006) [2023-12-28 03:15:59,995][106225] Updated weights for policy 1, policy_version 1117207 (0.0008) [2023-12-28 03:16:00,041][106226] Updated weights for policy 0, policy_version 1114308 (0.0008) [2023-12-28 03:16:00,053][106225] Updated weights for policy 1, policy_version 1117217 (0.0010) [2023-12-28 03:16:00,098][106226] Updated weights for policy 0, policy_version 1114318 (0.0009) [2023-12-28 03:16:00,101][106225] Updated weights for policy 1, policy_version 1117227 (0.0006) [2023-12-28 03:16:00,148][106226] Updated weights for policy 0, policy_version 1114328 (0.0010) [2023-12-28 03:16:00,776][106226] Updated weights for policy 0, policy_version 1114338 (0.0007) [2023-12-28 03:16:00,841][106226] Updated weights for policy 0, policy_version 1114348 (0.0005) [2023-12-28 03:16:00,890][106225] Updated weights for policy 1, policy_version 1117237 (0.0008) [2023-12-28 03:16:00,895][106226] Updated weights for policy 0, policy_version 1114358 (0.0005) [2023-12-28 03:16:00,937][106225] Updated weights for policy 1, policy_version 1117247 (0.0010) [2023-12-28 03:16:00,984][106225] Updated weights for policy 1, policy_version 1117257 (0.0009) [2023-12-28 03:16:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 571400192. Throughput: 0: 10016.5, 1: 10067.7. Samples: 571385964. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:01,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-4.802')] [2023-12-28 03:16:01,509][106226] Updated weights for policy 0, policy_version 1114368 (0.0008) [2023-12-28 03:16:01,568][106226] Updated weights for policy 0, policy_version 1114378 (0.0008) [2023-12-28 03:16:01,631][106226] Updated weights for policy 0, policy_version 1114388 (0.0008) [2023-12-28 03:16:01,695][106225] Updated weights for policy 1, policy_version 1117267 (0.0010) [2023-12-28 03:16:01,759][106225] Updated weights for policy 1, policy_version 1117277 (0.0008) [2023-12-28 03:16:01,825][106225] Updated weights for policy 1, policy_version 1117287 (0.0007) [2023-12-28 03:16:02,406][106226] Updated weights for policy 0, policy_version 1114398 (0.0007) [2023-12-28 03:16:02,471][106226] Updated weights for policy 0, policy_version 1114408 (0.0005) [2023-12-28 03:16:02,542][106226] Updated weights for policy 0, policy_version 1114418 (0.0007) [2023-12-28 03:16:02,589][106225] Updated weights for policy 1, policy_version 1117297 (0.0009) [2023-12-28 03:16:02,655][106225] Updated weights for policy 1, policy_version 1117307 (0.0006) [2023-12-28 03:16:02,717][106225] Updated weights for policy 1, policy_version 1117317 (0.0009) [2023-12-28 03:16:02,782][106225] Updated weights for policy 1, policy_version 1117327 (0.0008) [2023-12-28 03:16:03,127][106226] Updated weights for policy 0, policy_version 1114428 (0.0007) [2023-12-28 03:16:03,174][106226] Updated weights for policy 0, policy_version 1114438 (0.0006) [2023-12-28 03:16:03,222][106226] Updated weights for policy 0, policy_version 1114448 (0.0008) [2023-12-28 03:16:03,538][106225] Updated weights for policy 1, policy_version 1117337 (0.0010) [2023-12-28 03:16:03,596][106225] Updated weights for policy 1, policy_version 1117347 (0.0010) [2023-12-28 03:16:03,659][106225] Updated weights for policy 1, policy_version 1117357 (0.0009) [2023-12-28 03:16:03,919][106226] Updated weights for policy 0, policy_version 1114458 (0.0008) [2023-12-28 03:16:03,977][106226] Updated weights for policy 0, policy_version 1114468 (0.0009) [2023-12-28 03:16:04,037][106226] Updated weights for policy 0, policy_version 1114478 (0.0007) [2023-12-28 03:16:04,100][106226] Updated weights for policy 0, policy_version 1114488 (0.0008) [2023-12-28 03:16:04,447][106225] Updated weights for policy 1, policy_version 1117367 (0.0008) [2023-12-28 03:16:04,503][106225] Updated weights for policy 1, policy_version 1117377 (0.0008) [2023-12-28 03:16:04,554][106225] Updated weights for policy 1, policy_version 1117387 (0.0008) [2023-12-28 03:16:04,849][106226] Updated weights for policy 0, policy_version 1114498 (0.0007) [2023-12-28 03:16:04,906][106226] Updated weights for policy 0, policy_version 1114508 (0.0009) [2023-12-28 03:16:04,959][106226] Updated weights for policy 0, policy_version 1114518 (0.0006) [2023-12-28 03:16:05,334][106225] Updated weights for policy 1, policy_version 1117397 (0.0008) [2023-12-28 03:16:05,402][106225] Updated weights for policy 1, policy_version 1117407 (0.0010) [2023-12-28 03:16:05,461][106225] Updated weights for policy 1, policy_version 1117417 (0.0009) [2023-12-28 03:16:05,586][106226] Updated weights for policy 0, policy_version 1114528 (0.0007) [2023-12-28 03:16:05,642][106226] Updated weights for policy 0, policy_version 1114538 (0.0006) [2023-12-28 03:16:05,708][106226] Updated weights for policy 0, policy_version 1114548 (0.0008) [2023-12-28 03:16:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 571490304. Throughput: 0: 10063.5, 1: 9908.1. Samples: 571502408. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:06,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-4.805')] [2023-12-28 03:16:06,263][106225] Updated weights for policy 1, policy_version 1117427 (0.0009) [2023-12-28 03:16:06,331][106225] Updated weights for policy 1, policy_version 1117437 (0.0009) [2023-12-28 03:16:06,400][106225] Updated weights for policy 1, policy_version 1117447 (0.0010) [2023-12-28 03:16:06,437][106226] Updated weights for policy 0, policy_version 1114558 (0.0007) [2023-12-28 03:16:06,500][106226] Updated weights for policy 0, policy_version 1114568 (0.0009) [2023-12-28 03:16:06,560][106226] Updated weights for policy 0, policy_version 1114578 (0.0008) [2023-12-28 03:16:07,155][106225] Updated weights for policy 1, policy_version 1117457 (0.0009) [2023-12-28 03:16:07,222][106225] Updated weights for policy 1, policy_version 1117467 (0.0009) [2023-12-28 03:16:07,225][106226] Updated weights for policy 0, policy_version 1114588 (0.0007) [2023-12-28 03:16:07,288][106225] Updated weights for policy 1, policy_version 1117477 (0.0008) [2023-12-28 03:16:07,295][106226] Updated weights for policy 0, policy_version 1114598 (0.0007) [2023-12-28 03:16:07,348][106226] Updated weights for policy 0, policy_version 1114608 (0.0008) [2023-12-28 03:16:08,031][106225] Updated weights for policy 1, policy_version 1117489 (0.0008) [2023-12-28 03:16:08,092][106225] Updated weights for policy 1, policy_version 1117499 (0.0008) [2023-12-28 03:16:08,094][106226] Updated weights for policy 0, policy_version 1114618 (0.0008) [2023-12-28 03:16:08,152][106225] Updated weights for policy 1, policy_version 1117509 (0.0007) [2023-12-28 03:16:08,157][106226] Updated weights for policy 0, policy_version 1114628 (0.0008) [2023-12-28 03:16:08,214][106225] Updated weights for policy 1, policy_version 1117519 (0.0006) [2023-12-28 03:16:08,223][106226] Updated weights for policy 0, policy_version 1114638 (0.0009) [2023-12-28 03:16:08,278][106226] Updated weights for policy 0, policy_version 1114648 (0.0008) [2023-12-28 03:16:08,881][106225] Updated weights for policy 1, policy_version 1117529 (0.0008) [2023-12-28 03:16:08,943][106225] Updated weights for policy 1, policy_version 1117539 (0.0008) [2023-12-28 03:16:08,998][106225] Updated weights for policy 1, policy_version 1117549 (0.0006) [2023-12-28 03:16:09,085][106226] Updated weights for policy 0, policy_version 1114658 (0.0008) [2023-12-28 03:16:09,162][106226] Updated weights for policy 0, policy_version 1114668 (0.0009) [2023-12-28 03:16:09,216][106226] Updated weights for policy 0, policy_version 1114678 (0.0009) [2023-12-28 03:16:09,714][106225] Updated weights for policy 1, policy_version 1117559 (0.0007) [2023-12-28 03:16:09,772][106225] Updated weights for policy 1, policy_version 1117569 (0.0008) [2023-12-28 03:16:09,840][106225] Updated weights for policy 1, policy_version 1117579 (0.0008) [2023-12-28 03:16:09,975][106226] Updated weights for policy 0, policy_version 1114688 (0.0009) [2023-12-28 03:16:10,041][106226] Updated weights for policy 0, policy_version 1114698 (0.0008) [2023-12-28 03:16:10,104][106226] Updated weights for policy 0, policy_version 1114708 (0.0008) [2023-12-28 03:16:10,576][106225] Updated weights for policy 1, policy_version 1117589 (0.0008) [2023-12-28 03:16:10,633][106225] Updated weights for policy 1, policy_version 1117599 (0.0007) [2023-12-28 03:16:10,696][106225] Updated weights for policy 1, policy_version 1117609 (0.0008) [2023-12-28 03:16:10,866][106226] Updated weights for policy 0, policy_version 1114718 (0.0007) [2023-12-28 03:16:10,928][106226] Updated weights for policy 0, policy_version 1114728 (0.0009) [2023-12-28 03:16:10,994][106226] Updated weights for policy 0, policy_version 1114738 (0.0011) [2023-12-28 03:16:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 571588608. Throughput: 0: 10023.5, 1: 9888.2. Samples: 571559240. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:11,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-4.593')] [2023-12-28 03:16:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001117616_286154752.pth... [2023-12-28 03:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001114744_285433856.pth... [2023-12-28 03:16:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001113592_285138944.pth [2023-12-28 03:16:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001116496_285868032.pth [2023-12-28 03:16:11,440][106225] Updated weights for policy 1, policy_version 1117619 (0.0007) [2023-12-28 03:16:11,496][106225] Updated weights for policy 1, policy_version 1117629 (0.0008) [2023-12-28 03:16:11,555][106225] Updated weights for policy 1, policy_version 1117639 (0.0008) [2023-12-28 03:16:11,751][106226] Updated weights for policy 0, policy_version 1114748 (0.0010) [2023-12-28 03:16:11,820][106226] Updated weights for policy 0, policy_version 1114758 (0.0009) [2023-12-28 03:16:11,879][106226] Updated weights for policy 0, policy_version 1114768 (0.0009) [2023-12-28 03:16:12,346][106225] Updated weights for policy 1, policy_version 1117649 (0.0008) [2023-12-28 03:16:12,414][106225] Updated weights for policy 1, policy_version 1117659 (0.0009) [2023-12-28 03:16:12,475][106225] Updated weights for policy 1, policy_version 1117669 (0.0008) [2023-12-28 03:16:12,540][106225] Updated weights for policy 1, policy_version 1117679 (0.0008) [2023-12-28 03:16:12,646][106226] Updated weights for policy 0, policy_version 1114778 (0.0009) [2023-12-28 03:16:12,704][106226] Updated weights for policy 0, policy_version 1114788 (0.0009) [2023-12-28 03:16:12,770][106226] Updated weights for policy 0, policy_version 1114798 (0.0010) [2023-12-28 03:16:12,834][106226] Updated weights for policy 0, policy_version 1114808 (0.0006) [2023-12-28 03:16:13,305][106225] Updated weights for policy 1, policy_version 1117689 (0.0008) [2023-12-28 03:16:13,366][106225] Updated weights for policy 1, policy_version 1117699 (0.0008) [2023-12-28 03:16:13,424][106225] Updated weights for policy 1, policy_version 1117709 (0.0006) [2023-12-28 03:16:13,452][106226] Updated weights for policy 0, policy_version 1114818 (0.0010) [2023-12-28 03:16:13,499][106226] Updated weights for policy 0, policy_version 1114828 (0.0010) [2023-12-28 03:16:13,542][106226] Updated weights for policy 0, policy_version 1114838 (0.0010) [2023-12-28 03:16:14,093][106225] Updated weights for policy 1, policy_version 1117719 (0.0005) [2023-12-28 03:16:14,149][106225] Updated weights for policy 1, policy_version 1117729 (0.0007) [2023-12-28 03:16:14,202][106225] Updated weights for policy 1, policy_version 1117739 (0.0008) [2023-12-28 03:16:14,272][106226] Updated weights for policy 0, policy_version 1114848 (0.0010) [2023-12-28 03:16:14,323][106226] Updated weights for policy 0, policy_version 1114858 (0.0009) [2023-12-28 03:16:14,382][106226] Updated weights for policy 0, policy_version 1114868 (0.0010) [2023-12-28 03:16:14,816][106225] Updated weights for policy 1, policy_version 1117749 (0.0007) [2023-12-28 03:16:14,874][106225] Updated weights for policy 1, policy_version 1117759 (0.0008) [2023-12-28 03:16:14,936][106225] Updated weights for policy 1, policy_version 1117769 (0.0008) [2023-12-28 03:16:15,139][106226] Updated weights for policy 0, policy_version 1114878 (0.0007) [2023-12-28 03:16:15,199][106226] Updated weights for policy 0, policy_version 1114888 (0.0008) [2023-12-28 03:16:15,257][106226] Updated weights for policy 0, policy_version 1114898 (0.0006) [2023-12-28 03:16:15,639][106225] Updated weights for policy 1, policy_version 1117779 (0.0007) [2023-12-28 03:16:15,701][106225] Updated weights for policy 1, policy_version 1117789 (0.0008) [2023-12-28 03:16:15,762][106225] Updated weights for policy 1, policy_version 1117799 (0.0007) [2023-12-28 03:16:15,940][106226] Updated weights for policy 0, policy_version 1114908 (0.0009) [2023-12-28 03:16:15,988][106226] Updated weights for policy 0, policy_version 1114918 (0.0007) [2023-12-28 03:16:16,047][106226] Updated weights for policy 0, policy_version 1114928 (0.0007) [2023-12-28 03:16:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 571686912. Throughput: 0: 9942.8, 1: 9740.9. Samples: 571672752. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:16,176][105115] Avg episode reward: [(0, '-4.482'), (1, '-5.162')] [2023-12-28 03:16:16,430][106225] Updated weights for policy 1, policy_version 1117809 (0.0008) [2023-12-28 03:16:16,486][106225] Updated weights for policy 1, policy_version 1117819 (0.0007) [2023-12-28 03:16:16,557][106225] Updated weights for policy 1, policy_version 1117829 (0.0006) [2023-12-28 03:16:16,615][106225] Updated weights for policy 1, policy_version 1117839 (0.0008) [2023-12-28 03:16:16,739][106226] Updated weights for policy 0, policy_version 1114938 (0.0006) [2023-12-28 03:16:16,791][106226] Updated weights for policy 0, policy_version 1114948 (0.0008) [2023-12-28 03:16:16,843][106226] Updated weights for policy 0, policy_version 1114958 (0.0009) [2023-12-28 03:16:16,896][106226] Updated weights for policy 0, policy_version 1114968 (0.0008) [2023-12-28 03:16:17,249][106225] Updated weights for policy 1, policy_version 1117849 (0.0006) [2023-12-28 03:16:17,303][106225] Updated weights for policy 1, policy_version 1117859 (0.0009) [2023-12-28 03:16:17,365][106225] Updated weights for policy 1, policy_version 1117869 (0.0005) [2023-12-28 03:16:17,609][106226] Updated weights for policy 0, policy_version 1114978 (0.0005) [2023-12-28 03:16:17,661][106226] Updated weights for policy 0, policy_version 1114988 (0.0007) [2023-12-28 03:16:17,711][106226] Updated weights for policy 0, policy_version 1114998 (0.0007) [2023-12-28 03:16:17,929][106225] Updated weights for policy 1, policy_version 1117879 (0.0006) [2023-12-28 03:16:17,987][106225] Updated weights for policy 1, policy_version 1117889 (0.0008) [2023-12-28 03:16:18,048][106225] Updated weights for policy 1, policy_version 1117899 (0.0006) [2023-12-28 03:16:18,480][106226] Updated weights for policy 0, policy_version 1115008 (0.0009) [2023-12-28 03:16:18,553][106226] Updated weights for policy 0, policy_version 1115018 (0.0009) [2023-12-28 03:16:18,605][106226] Updated weights for policy 0, policy_version 1115028 (0.0009) [2023-12-28 03:16:18,690][106225] Updated weights for policy 1, policy_version 1117909 (0.0007) [2023-12-28 03:16:18,740][106225] Updated weights for policy 1, policy_version 1117919 (0.0006) [2023-12-28 03:16:18,795][106225] Updated weights for policy 1, policy_version 1117929 (0.0007) [2023-12-28 03:16:19,393][106226] Updated weights for policy 0, policy_version 1115038 (0.0009) [2023-12-28 03:16:19,460][106226] Updated weights for policy 0, policy_version 1115048 (0.0009) [2023-12-28 03:16:19,481][106225] Updated weights for policy 1, policy_version 1117939 (0.0009) [2023-12-28 03:16:19,527][106226] Updated weights for policy 0, policy_version 1115058 (0.0008) [2023-12-28 03:16:19,550][106225] Updated weights for policy 1, policy_version 1117949 (0.0007) [2023-12-28 03:16:19,623][106225] Updated weights for policy 1, policy_version 1117959 (0.0009) [2023-12-28 03:16:20,173][106226] Updated weights for policy 0, policy_version 1115068 (0.0008) [2023-12-28 03:16:20,232][106226] Updated weights for policy 0, policy_version 1115078 (0.0009) [2023-12-28 03:16:20,285][106226] Updated weights for policy 0, policy_version 1115088 (0.0009) [2023-12-28 03:16:20,425][106225] Updated weights for policy 1, policy_version 1117969 (0.0010) [2023-12-28 03:16:20,486][106225] Updated weights for policy 1, policy_version 1117979 (0.0009) [2023-12-28 03:16:20,540][106225] Updated weights for policy 1, policy_version 1117989 (0.0009) [2023-12-28 03:16:20,607][106225] Updated weights for policy 1, policy_version 1117999 (0.0009) [2023-12-28 03:16:21,125][106226] Updated weights for policy 0, policy_version 1115098 (0.0008) [2023-12-28 03:16:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 571777024. Throughput: 0: 9874.6, 1: 9735.7. Samples: 571790824. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:21,176][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.978')] [2023-12-28 03:16:21,202][106226] Updated weights for policy 0, policy_version 1115108 (0.0008) [2023-12-28 03:16:21,271][106226] Updated weights for policy 0, policy_version 1115118 (0.0007) [2023-12-28 03:16:21,281][106225] Updated weights for policy 1, policy_version 1118009 (0.0007) [2023-12-28 03:16:21,332][106226] Updated weights for policy 0, policy_version 1115128 (0.0007) [2023-12-28 03:16:21,342][106225] Updated weights for policy 1, policy_version 1118019 (0.0008) [2023-12-28 03:16:21,412][106225] Updated weights for policy 1, policy_version 1118029 (0.0007) [2023-12-28 03:16:22,040][106226] Updated weights for policy 0, policy_version 1115138 (0.0011) [2023-12-28 03:16:22,089][106225] Updated weights for policy 1, policy_version 1118039 (0.0007) [2023-12-28 03:16:22,102][106226] Updated weights for policy 0, policy_version 1115148 (0.0011) [2023-12-28 03:16:22,154][106225] Updated weights for policy 1, policy_version 1118049 (0.0006) [2023-12-28 03:16:22,160][106226] Updated weights for policy 0, policy_version 1115158 (0.0008) [2023-12-28 03:16:22,210][106225] Updated weights for policy 1, policy_version 1118059 (0.0008) [2023-12-28 03:16:22,895][106226] Updated weights for policy 0, policy_version 1115168 (0.0007) [2023-12-28 03:16:22,922][106225] Updated weights for policy 1, policy_version 1118069 (0.0008) [2023-12-28 03:16:22,952][106226] Updated weights for policy 0, policy_version 1115178 (0.0006) [2023-12-28 03:16:22,980][106225] Updated weights for policy 1, policy_version 1118079 (0.0008) [2023-12-28 03:16:23,010][106226] Updated weights for policy 0, policy_version 1115188 (0.0006) [2023-12-28 03:16:23,034][106225] Updated weights for policy 1, policy_version 1118089 (0.0007) [2023-12-28 03:16:23,679][106226] Updated weights for policy 0, policy_version 1115198 (0.0009) [2023-12-28 03:16:23,746][106226] Updated weights for policy 0, policy_version 1115208 (0.0008) [2023-12-28 03:16:23,756][106225] Updated weights for policy 1, policy_version 1118099 (0.0007) [2023-12-28 03:16:23,804][106226] Updated weights for policy 0, policy_version 1115218 (0.0009) [2023-12-28 03:16:23,817][106225] Updated weights for policy 1, policy_version 1118109 (0.0005) [2023-12-28 03:16:23,878][106225] Updated weights for policy 1, policy_version 1118119 (0.0007) [2023-12-28 03:16:24,363][106226] Updated weights for policy 0, policy_version 1115228 (0.0007) [2023-12-28 03:16:24,428][106226] Updated weights for policy 0, policy_version 1115238 (0.0008) [2023-12-28 03:16:24,486][106226] Updated weights for policy 0, policy_version 1115248 (0.0005) [2023-12-28 03:16:24,547][106225] Updated weights for policy 1, policy_version 1118129 (0.0010) [2023-12-28 03:16:24,599][106225] Updated weights for policy 1, policy_version 1118139 (0.0006) [2023-12-28 03:16:24,647][106225] Updated weights for policy 1, policy_version 1118149 (0.0005) [2023-12-28 03:16:24,701][106225] Updated weights for policy 1, policy_version 1118159 (0.0005) [2023-12-28 03:16:25,060][106226] Updated weights for policy 0, policy_version 1115258 (0.0006) [2023-12-28 03:16:25,120][106226] Updated weights for policy 0, policy_version 1115268 (0.0005) [2023-12-28 03:16:25,185][106226] Updated weights for policy 0, policy_version 1115278 (0.0005) [2023-12-28 03:16:25,246][106226] Updated weights for policy 0, policy_version 1115288 (0.0008) [2023-12-28 03:16:25,273][106225] Updated weights for policy 1, policy_version 1118169 (0.0005) [2023-12-28 03:16:25,334][106225] Updated weights for policy 1, policy_version 1118179 (0.0005) [2023-12-28 03:16:25,392][106225] Updated weights for policy 1, policy_version 1118189 (0.0005) [2023-12-28 03:16:25,896][106226] Updated weights for policy 0, policy_version 1115298 (0.0009) [2023-12-28 03:16:25,912][106225] Updated weights for policy 1, policy_version 1118199 (0.0009) [2023-12-28 03:16:25,951][106226] Updated weights for policy 0, policy_version 1115308 (0.0010) [2023-12-28 03:16:25,958][106225] Updated weights for policy 1, policy_version 1118209 (0.0010) [2023-12-28 03:16:26,010][106225] Updated weights for policy 1, policy_version 1118219 (0.0009) [2023-12-28 03:16:26,011][106226] Updated weights for policy 0, policy_version 1115318 (0.0010) [2023-12-28 03:16:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 571891712. Throughput: 0: 9861.4, 1: 9751.0. Samples: 571849964. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:26,176][105115] Avg episode reward: [(0, '-4.665'), (1, '-4.893')] [2023-12-28 03:16:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001118224_286310400.pth... [2023-12-28 03:16:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001115320_285581312.pth... [2023-12-28 03:16:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001117072_286015488.pth [2023-12-28 03:16:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001114168_285286400.pth [2023-12-28 03:16:26,662][106225] Updated weights for policy 1, policy_version 1118229 (0.0008) [2023-12-28 03:16:26,707][106226] Updated weights for policy 0, policy_version 1115328 (0.0008) [2023-12-28 03:16:26,720][106225] Updated weights for policy 1, policy_version 1118239 (0.0006) [2023-12-28 03:16:26,760][106226] Updated weights for policy 0, policy_version 1115338 (0.0008) [2023-12-28 03:16:26,786][106225] Updated weights for policy 1, policy_version 1118249 (0.0007) [2023-12-28 03:16:26,818][106226] Updated weights for policy 0, policy_version 1115348 (0.0006) [2023-12-28 03:16:27,371][106226] Updated weights for policy 0, policy_version 1115358 (0.0006) [2023-12-28 03:16:27,379][106225] Updated weights for policy 1, policy_version 1118259 (0.0008) [2023-12-28 03:16:27,428][106226] Updated weights for policy 0, policy_version 1115368 (0.0010) [2023-12-28 03:16:27,435][106225] Updated weights for policy 1, policy_version 1118269 (0.0009) [2023-12-28 03:16:27,487][106225] Updated weights for policy 1, policy_version 1118279 (0.0006) [2023-12-28 03:16:27,489][106226] Updated weights for policy 0, policy_version 1115378 (0.0009) [2023-12-28 03:16:28,118][106225] Updated weights for policy 1, policy_version 1118289 (0.0007) [2023-12-28 03:16:28,129][106226] Updated weights for policy 0, policy_version 1115388 (0.0007) [2023-12-28 03:16:28,174][106225] Updated weights for policy 1, policy_version 1118299 (0.0006) [2023-12-28 03:16:28,188][106226] Updated weights for policy 0, policy_version 1115398 (0.0007) [2023-12-28 03:16:28,234][106225] Updated weights for policy 1, policy_version 1118309 (0.0007) [2023-12-28 03:16:28,242][106226] Updated weights for policy 0, policy_version 1115408 (0.0006) [2023-12-28 03:16:28,293][106225] Updated weights for policy 1, policy_version 1118319 (0.0006) [2023-12-28 03:16:28,889][106226] Updated weights for policy 0, policy_version 1115418 (0.0006) [2023-12-28 03:16:28,937][106226] Updated weights for policy 0, policy_version 1115428 (0.0005) [2023-12-28 03:16:29,000][106226] Updated weights for policy 0, policy_version 1115438 (0.0007) [2023-12-28 03:16:29,013][106225] Updated weights for policy 1, policy_version 1118329 (0.0007) [2023-12-28 03:16:29,061][106226] Updated weights for policy 0, policy_version 1115448 (0.0007) [2023-12-28 03:16:29,064][106225] Updated weights for policy 1, policy_version 1118339 (0.0006) [2023-12-28 03:16:29,122][106225] Updated weights for policy 1, policy_version 1118349 (0.0010) [2023-12-28 03:16:29,691][106226] Updated weights for policy 0, policy_version 1115458 (0.0006) [2023-12-28 03:16:29,753][106226] Updated weights for policy 0, policy_version 1115468 (0.0007) [2023-12-28 03:16:29,813][106226] Updated weights for policy 0, policy_version 1115478 (0.0009) [2023-12-28 03:16:29,916][106225] Updated weights for policy 1, policy_version 1118359 (0.0009) [2023-12-28 03:16:29,979][106225] Updated weights for policy 1, policy_version 1118369 (0.0006) [2023-12-28 03:16:30,036][106225] Updated weights for policy 1, policy_version 1118379 (0.0006) [2023-12-28 03:16:30,471][106226] Updated weights for policy 0, policy_version 1115488 (0.0009) [2023-12-28 03:16:30,525][106226] Updated weights for policy 0, policy_version 1115498 (0.0009) [2023-12-28 03:16:30,579][106226] Updated weights for policy 0, policy_version 1115508 (0.0008) [2023-12-28 03:16:30,731][106225] Updated weights for policy 1, policy_version 1118389 (0.0006) [2023-12-28 03:16:30,781][106225] Updated weights for policy 1, policy_version 1118399 (0.0005) [2023-12-28 03:16:30,838][106225] Updated weights for policy 1, policy_version 1118409 (0.0005) [2023-12-28 03:16:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 571990016. Throughput: 0: 9971.2, 1: 9894.7. Samples: 571978812. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:31,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-4.566')] [2023-12-28 03:16:31,280][106226] Updated weights for policy 0, policy_version 1115518 (0.0008) [2023-12-28 03:16:31,334][106226] Updated weights for policy 0, policy_version 1115528 (0.0010) [2023-12-28 03:16:31,400][106226] Updated weights for policy 0, policy_version 1115538 (0.0008) [2023-12-28 03:16:31,596][106225] Updated weights for policy 1, policy_version 1118419 (0.0007) [2023-12-28 03:16:31,658][106225] Updated weights for policy 1, policy_version 1118429 (0.0009) [2023-12-28 03:16:31,715][106225] Updated weights for policy 1, policy_version 1118439 (0.0008) [2023-12-28 03:16:32,118][106226] Updated weights for policy 0, policy_version 1115548 (0.0007) [2023-12-28 03:16:32,181][106226] Updated weights for policy 0, policy_version 1115558 (0.0006) [2023-12-28 03:16:32,237][106226] Updated weights for policy 0, policy_version 1115568 (0.0007) [2023-12-28 03:16:32,421][106225] Updated weights for policy 1, policy_version 1118449 (0.0006) [2023-12-28 03:16:32,483][106225] Updated weights for policy 1, policy_version 1118459 (0.0008) [2023-12-28 03:16:32,533][106225] Updated weights for policy 1, policy_version 1118469 (0.0008) [2023-12-28 03:16:32,586][106225] Updated weights for policy 1, policy_version 1118479 (0.0008) [2023-12-28 03:16:32,841][106226] Updated weights for policy 0, policy_version 1115578 (0.0010) [2023-12-28 03:16:32,898][106226] Updated weights for policy 0, policy_version 1115588 (0.0010) [2023-12-28 03:16:32,951][106226] Updated weights for policy 0, policy_version 1115598 (0.0010) [2023-12-28 03:16:33,001][106226] Updated weights for policy 0, policy_version 1115608 (0.0010) [2023-12-28 03:16:33,387][106225] Updated weights for policy 1, policy_version 1118489 (0.0007) [2023-12-28 03:16:33,433][106225] Updated weights for policy 1, policy_version 1118499 (0.0008) [2023-12-28 03:16:33,488][106225] Updated weights for policy 1, policy_version 1118509 (0.0008) [2023-12-28 03:16:33,600][106226] Updated weights for policy 0, policy_version 1115618 (0.0005) [2023-12-28 03:16:33,663][106226] Updated weights for policy 0, policy_version 1115628 (0.0005) [2023-12-28 03:16:33,731][106226] Updated weights for policy 0, policy_version 1115638 (0.0005) [2023-12-28 03:16:34,237][106226] Updated weights for policy 0, policy_version 1115648 (0.0010) [2023-12-28 03:16:34,256][106225] Updated weights for policy 1, policy_version 1118519 (0.0009) [2023-12-28 03:16:34,295][106226] Updated weights for policy 0, policy_version 1115658 (0.0011) [2023-12-28 03:16:34,311][106225] Updated weights for policy 1, policy_version 1118529 (0.0008) [2023-12-28 03:16:34,350][106226] Updated weights for policy 0, policy_version 1115668 (0.0011) [2023-12-28 03:16:34,371][106225] Updated weights for policy 1, policy_version 1118539 (0.0008) [2023-12-28 03:16:35,036][106225] Updated weights for policy 1, policy_version 1118549 (0.0007) [2023-12-28 03:16:35,049][106226] Updated weights for policy 0, policy_version 1115678 (0.0009) [2023-12-28 03:16:35,103][106225] Updated weights for policy 1, policy_version 1118559 (0.0005) [2023-12-28 03:16:35,106][106226] Updated weights for policy 0, policy_version 1115688 (0.0008) [2023-12-28 03:16:35,160][106225] Updated weights for policy 1, policy_version 1118569 (0.0005) [2023-12-28 03:16:35,160][106226] Updated weights for policy 0, policy_version 1115698 (0.0008) [2023-12-28 03:16:35,815][106225] Updated weights for policy 1, policy_version 1118579 (0.0009) [2023-12-28 03:16:35,866][106225] Updated weights for policy 1, policy_version 1118589 (0.0010) [2023-12-28 03:16:35,868][106226] Updated weights for policy 0, policy_version 1115708 (0.0006) [2023-12-28 03:16:35,913][106225] Updated weights for policy 1, policy_version 1118599 (0.0010) [2023-12-28 03:16:35,923][106226] Updated weights for policy 0, policy_version 1115718 (0.0005) [2023-12-28 03:16:35,984][106226] Updated weights for policy 0, policy_version 1115728 (0.0007) [2023-12-28 03:16:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 572096512. Throughput: 0: 10075.0, 1: 9849.4. Samples: 572101848. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:36,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.677')] [2023-12-28 03:16:36,636][106225] Updated weights for policy 1, policy_version 1118609 (0.0010) [2023-12-28 03:16:36,688][106226] Updated weights for policy 0, policy_version 1115738 (0.0011) [2023-12-28 03:16:36,702][106225] Updated weights for policy 1, policy_version 1118619 (0.0007) [2023-12-28 03:16:36,746][106226] Updated weights for policy 0, policy_version 1115748 (0.0009) [2023-12-28 03:16:36,755][106225] Updated weights for policy 1, policy_version 1118629 (0.0010) [2023-12-28 03:16:36,802][106226] Updated weights for policy 0, policy_version 1115758 (0.0008) [2023-12-28 03:16:36,816][106225] Updated weights for policy 1, policy_version 1118639 (0.0009) [2023-12-28 03:16:36,856][106226] Updated weights for policy 0, policy_version 1115768 (0.0009) [2023-12-28 03:16:37,544][106225] Updated weights for policy 1, policy_version 1118649 (0.0010) [2023-12-28 03:16:37,593][106226] Updated weights for policy 0, policy_version 1115778 (0.0006) [2023-12-28 03:16:37,603][106225] Updated weights for policy 1, policy_version 1118659 (0.0010) [2023-12-28 03:16:37,659][106226] Updated weights for policy 0, policy_version 1115788 (0.0006) [2023-12-28 03:16:37,669][106225] Updated weights for policy 1, policy_version 1118669 (0.0011) [2023-12-28 03:16:37,725][106226] Updated weights for policy 0, policy_version 1115798 (0.0007) [2023-12-28 03:16:38,366][106225] Updated weights for policy 1, policy_version 1118679 (0.0009) [2023-12-28 03:16:38,429][106225] Updated weights for policy 1, policy_version 1118689 (0.0007) [2023-12-28 03:16:38,436][106226] Updated weights for policy 0, policy_version 1115808 (0.0008) [2023-12-28 03:16:38,493][106225] Updated weights for policy 1, policy_version 1118699 (0.0006) [2023-12-28 03:16:38,498][106226] Updated weights for policy 0, policy_version 1115818 (0.0007) [2023-12-28 03:16:38,555][106226] Updated weights for policy 0, policy_version 1115828 (0.0008) [2023-12-28 03:16:39,148][106225] Updated weights for policy 1, policy_version 1118709 (0.0006) [2023-12-28 03:16:39,197][106225] Updated weights for policy 1, policy_version 1118719 (0.0008) [2023-12-28 03:16:39,248][106226] Updated weights for policy 0, policy_version 1115838 (0.0008) [2023-12-28 03:16:39,263][106225] Updated weights for policy 1, policy_version 1118729 (0.0006) [2023-12-28 03:16:39,308][106226] Updated weights for policy 0, policy_version 1115848 (0.0007) [2023-12-28 03:16:39,365][106226] Updated weights for policy 0, policy_version 1115858 (0.0009) [2023-12-28 03:16:40,056][106225] Updated weights for policy 1, policy_version 1118739 (0.0006) [2023-12-28 03:16:40,099][106226] Updated weights for policy 0, policy_version 1115868 (0.0009) [2023-12-28 03:16:40,117][106225] Updated weights for policy 1, policy_version 1118749 (0.0007) [2023-12-28 03:16:40,159][106226] Updated weights for policy 0, policy_version 1115878 (0.0007) [2023-12-28 03:16:40,179][106225] Updated weights for policy 1, policy_version 1118759 (0.0009) [2023-12-28 03:16:40,225][106226] Updated weights for policy 0, policy_version 1115888 (0.0007) [2023-12-28 03:16:40,804][106225] Updated weights for policy 1, policy_version 1118769 (0.0009) [2023-12-28 03:16:40,872][106225] Updated weights for policy 1, policy_version 1118779 (0.0007) [2023-12-28 03:16:40,937][106225] Updated weights for policy 1, policy_version 1118789 (0.0010) [2023-12-28 03:16:40,953][106226] Updated weights for policy 0, policy_version 1115898 (0.0008) [2023-12-28 03:16:40,998][106225] Updated weights for policy 1, policy_version 1118799 (0.0006) [2023-12-28 03:16:41,017][106226] Updated weights for policy 0, policy_version 1115908 (0.0007) [2023-12-28 03:16:41,087][106226] Updated weights for policy 0, policy_version 1115918 (0.0008) [2023-12-28 03:16:41,151][106226] Updated weights for policy 0, policy_version 1115928 (0.0010) [2023-12-28 03:16:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 572194816. Throughput: 0: 9994.2, 1: 9873.0. Samples: 572159784. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:41,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-4.821')] [2023-12-28 03:16:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001118800_286457856.pth... [2023-12-28 03:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001115928_285736960.pth... [2023-12-28 03:16:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001117616_286154752.pth [2023-12-28 03:16:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001114744_285433856.pth [2023-12-28 03:16:41,676][106225] Updated weights for policy 1, policy_version 1118809 (0.0007) [2023-12-28 03:16:41,745][106225] Updated weights for policy 1, policy_version 1118819 (0.0007) [2023-12-28 03:16:41,819][106225] Updated weights for policy 1, policy_version 1118829 (0.0009) [2023-12-28 03:16:41,915][106226] Updated weights for policy 0, policy_version 1115938 (0.0009) [2023-12-28 03:16:41,982][106226] Updated weights for policy 0, policy_version 1115948 (0.0011) [2023-12-28 03:16:42,045][106226] Updated weights for policy 0, policy_version 1115958 (0.0011) [2023-12-28 03:16:42,438][106225] Updated weights for policy 1, policy_version 1118839 (0.0008) [2023-12-28 03:16:42,509][106225] Updated weights for policy 1, policy_version 1118849 (0.0009) [2023-12-28 03:16:42,573][106225] Updated weights for policy 1, policy_version 1118859 (0.0006) [2023-12-28 03:16:42,743][106226] Updated weights for policy 0, policy_version 1115968 (0.0009) [2023-12-28 03:16:42,798][106226] Updated weights for policy 0, policy_version 1115978 (0.0009) [2023-12-28 03:16:42,862][106226] Updated weights for policy 0, policy_version 1115988 (0.0010) [2023-12-28 03:16:43,285][106225] Updated weights for policy 1, policy_version 1118869 (0.0006) [2023-12-28 03:16:43,344][106225] Updated weights for policy 1, policy_version 1118879 (0.0007) [2023-12-28 03:16:43,398][106225] Updated weights for policy 1, policy_version 1118889 (0.0008) [2023-12-28 03:16:43,573][106226] Updated weights for policy 0, policy_version 1115998 (0.0010) [2023-12-28 03:16:43,643][106226] Updated weights for policy 0, policy_version 1116008 (0.0010) [2023-12-28 03:16:43,708][106226] Updated weights for policy 0, policy_version 1116018 (0.0010) [2023-12-28 03:16:44,033][106225] Updated weights for policy 1, policy_version 1118899 (0.0008) [2023-12-28 03:16:44,085][106225] Updated weights for policy 1, policy_version 1118909 (0.0008) [2023-12-28 03:16:44,135][106225] Updated weights for policy 1, policy_version 1118919 (0.0008) [2023-12-28 03:16:44,396][106226] Updated weights for policy 0, policy_version 1116028 (0.0011) [2023-12-28 03:16:44,445][106226] Updated weights for policy 0, policy_version 1116038 (0.0010) [2023-12-28 03:16:44,499][106226] Updated weights for policy 0, policy_version 1116048 (0.0010) [2023-12-28 03:16:44,892][106225] Updated weights for policy 1, policy_version 1118929 (0.0008) [2023-12-28 03:16:44,949][106225] Updated weights for policy 1, policy_version 1118939 (0.0008) [2023-12-28 03:16:45,012][106225] Updated weights for policy 1, policy_version 1118949 (0.0008) [2023-12-28 03:16:45,073][106225] Updated weights for policy 1, policy_version 1118959 (0.0008) [2023-12-28 03:16:45,252][106226] Updated weights for policy 0, policy_version 1116058 (0.0011) [2023-12-28 03:16:45,310][106226] Updated weights for policy 0, policy_version 1116068 (0.0010) [2023-12-28 03:16:45,374][106226] Updated weights for policy 0, policy_version 1116078 (0.0011) [2023-12-28 03:16:45,426][106226] Updated weights for policy 0, policy_version 1116088 (0.0010) [2023-12-28 03:16:45,822][106225] Updated weights for policy 1, policy_version 1118969 (0.0007) [2023-12-28 03:16:45,868][106225] Updated weights for policy 1, policy_version 1118979 (0.0009) [2023-12-28 03:16:45,914][106225] Updated weights for policy 1, policy_version 1118989 (0.0008) [2023-12-28 03:16:46,030][106226] Updated weights for policy 0, policy_version 1116098 (0.0009) [2023-12-28 03:16:46,090][106226] Updated weights for policy 0, policy_version 1116108 (0.0009) [2023-12-28 03:16:46,148][106226] Updated weights for policy 0, policy_version 1116118 (0.0008) [2023-12-28 03:16:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 572293120. Throughput: 0: 9941.2, 1: 9844.1. Samples: 572276304. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:46,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.201')] [2023-12-28 03:16:46,666][106225] Updated weights for policy 1, policy_version 1118999 (0.0008) [2023-12-28 03:16:46,714][106225] Updated weights for policy 1, policy_version 1119009 (0.0008) [2023-12-28 03:16:46,760][106225] Updated weights for policy 1, policy_version 1119019 (0.0007) [2023-12-28 03:16:46,869][106226] Updated weights for policy 0, policy_version 1116128 (0.0009) [2023-12-28 03:16:46,925][106226] Updated weights for policy 0, policy_version 1116138 (0.0010) [2023-12-28 03:16:46,985][106226] Updated weights for policy 0, policy_version 1116148 (0.0010) [2023-12-28 03:16:47,551][106225] Updated weights for policy 1, policy_version 1119029 (0.0007) [2023-12-28 03:16:47,585][106226] Updated weights for policy 0, policy_version 1116158 (0.0011) [2023-12-28 03:16:47,608][106225] Updated weights for policy 1, policy_version 1119039 (0.0009) [2023-12-28 03:16:47,642][106226] Updated weights for policy 0, policy_version 1116168 (0.0010) [2023-12-28 03:16:47,663][106225] Updated weights for policy 1, policy_version 1119049 (0.0007) [2023-12-28 03:16:47,699][106226] Updated weights for policy 0, policy_version 1116178 (0.0011) [2023-12-28 03:16:48,400][106225] Updated weights for policy 1, policy_version 1119059 (0.0007) [2023-12-28 03:16:48,433][106226] Updated weights for policy 0, policy_version 1116188 (0.0010) [2023-12-28 03:16:48,463][106225] Updated weights for policy 1, policy_version 1119069 (0.0009) [2023-12-28 03:16:48,488][106226] Updated weights for policy 0, policy_version 1116198 (0.0007) [2023-12-28 03:16:48,522][106225] Updated weights for policy 1, policy_version 1119079 (0.0009) [2023-12-28 03:16:48,543][106226] Updated weights for policy 0, policy_version 1116208 (0.0007) [2023-12-28 03:16:49,269][106226] Updated weights for policy 0, policy_version 1116218 (0.0007) [2023-12-28 03:16:49,284][106225] Updated weights for policy 1, policy_version 1119089 (0.0008) [2023-12-28 03:16:49,334][106226] Updated weights for policy 0, policy_version 1116228 (0.0007) [2023-12-28 03:16:49,340][106225] Updated weights for policy 1, policy_version 1119099 (0.0009) [2023-12-28 03:16:49,404][106226] Updated weights for policy 0, policy_version 1116238 (0.0007) [2023-12-28 03:16:49,411][106225] Updated weights for policy 1, policy_version 1119109 (0.0007) [2023-12-28 03:16:49,463][106226] Updated weights for policy 0, policy_version 1116248 (0.0008) [2023-12-28 03:16:49,472][106225] Updated weights for policy 1, policy_version 1119119 (0.0005) [2023-12-28 03:16:50,148][106226] Updated weights for policy 0, policy_version 1116258 (0.0008) [2023-12-28 03:16:50,203][106225] Updated weights for policy 1, policy_version 1119129 (0.0007) [2023-12-28 03:16:50,205][106226] Updated weights for policy 0, policy_version 1116268 (0.0006) [2023-12-28 03:16:50,260][106225] Updated weights for policy 1, policy_version 1119139 (0.0007) [2023-12-28 03:16:50,264][106226] Updated weights for policy 0, policy_version 1116278 (0.0007) [2023-12-28 03:16:50,322][106225] Updated weights for policy 1, policy_version 1119149 (0.0006) [2023-12-28 03:16:50,986][106226] Updated weights for policy 0, policy_version 1116288 (0.0010) [2023-12-28 03:16:51,017][106225] Updated weights for policy 1, policy_version 1119159 (0.0006) [2023-12-28 03:16:51,047][106226] Updated weights for policy 0, policy_version 1116298 (0.0009) [2023-12-28 03:16:51,079][106225] Updated weights for policy 1, policy_version 1119169 (0.0009) [2023-12-28 03:16:51,109][106226] Updated weights for policy 0, policy_version 1116308 (0.0009) [2023-12-28 03:16:51,137][106225] Updated weights for policy 1, policy_version 1119179 (0.0009) [2023-12-28 03:16:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 572391424. Throughput: 0: 9908.3, 1: 9883.7. Samples: 572393048. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:51,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.661')] [2023-12-28 03:16:51,937][106225] Updated weights for policy 1, policy_version 1119189 (0.0008) [2023-12-28 03:16:51,941][106226] Updated weights for policy 0, policy_version 1116318 (0.0007) [2023-12-28 03:16:51,995][106225] Updated weights for policy 1, policy_version 1119199 (0.0007) [2023-12-28 03:16:52,005][106226] Updated weights for policy 0, policy_version 1116328 (0.0010) [2023-12-28 03:16:52,060][106225] Updated weights for policy 1, policy_version 1119209 (0.0008) [2023-12-28 03:16:52,067][106226] Updated weights for policy 0, policy_version 1116338 (0.0010) [2023-12-28 03:16:52,741][106226] Updated weights for policy 0, policy_version 1116348 (0.0007) [2023-12-28 03:16:52,794][106225] Updated weights for policy 1, policy_version 1119219 (0.0007) [2023-12-28 03:16:52,812][106226] Updated weights for policy 0, policy_version 1116358 (0.0006) [2023-12-28 03:16:52,855][106225] Updated weights for policy 1, policy_version 1119229 (0.0007) [2023-12-28 03:16:52,884][106226] Updated weights for policy 0, policy_version 1116368 (0.0006) [2023-12-28 03:16:52,913][106225] Updated weights for policy 1, policy_version 1119239 (0.0007) [2023-12-28 03:16:53,568][106226] Updated weights for policy 0, policy_version 1116378 (0.0007) [2023-12-28 03:16:53,620][106226] Updated weights for policy 0, policy_version 1116388 (0.0008) [2023-12-28 03:16:53,631][106225] Updated weights for policy 1, policy_version 1119249 (0.0006) [2023-12-28 03:16:53,681][106226] Updated weights for policy 0, policy_version 1116398 (0.0006) [2023-12-28 03:16:53,683][106225] Updated weights for policy 1, policy_version 1119259 (0.0008) [2023-12-28 03:16:53,730][106225] Updated weights for policy 1, policy_version 1119269 (0.0008) [2023-12-28 03:16:53,741][106226] Updated weights for policy 0, policy_version 1116408 (0.0005) [2023-12-28 03:16:53,784][106225] Updated weights for policy 1, policy_version 1119279 (0.0009) [2023-12-28 03:16:54,392][106226] Updated weights for policy 0, policy_version 1116418 (0.0005) [2023-12-28 03:16:54,446][106226] Updated weights for policy 0, policy_version 1116428 (0.0008) [2023-12-28 03:16:54,500][106226] Updated weights for policy 0, policy_version 1116438 (0.0007) [2023-12-28 03:16:54,540][106225] Updated weights for policy 1, policy_version 1119289 (0.0008) [2023-12-28 03:16:54,591][106225] Updated weights for policy 1, policy_version 1119299 (0.0008) [2023-12-28 03:16:54,642][106225] Updated weights for policy 1, policy_version 1119309 (0.0008) [2023-12-28 03:16:55,065][106226] Updated weights for policy 0, policy_version 1116448 (0.0007) [2023-12-28 03:16:55,115][106226] Updated weights for policy 0, policy_version 1116458 (0.0008) [2023-12-28 03:16:55,164][106226] Updated weights for policy 0, policy_version 1116468 (0.0008) [2023-12-28 03:16:55,459][106225] Updated weights for policy 1, policy_version 1119319 (0.0007) [2023-12-28 03:16:55,517][106225] Updated weights for policy 1, policy_version 1119329 (0.0006) [2023-12-28 03:16:55,575][106225] Updated weights for policy 1, policy_version 1119339 (0.0005) [2023-12-28 03:16:55,882][106226] Updated weights for policy 0, policy_version 1116478 (0.0008) [2023-12-28 03:16:55,930][106226] Updated weights for policy 0, policy_version 1116488 (0.0008) [2023-12-28 03:16:55,981][106226] Updated weights for policy 0, policy_version 1116498 (0.0008) [2023-12-28 03:16:56,159][106225] Updated weights for policy 1, policy_version 1119349 (0.0007) [2023-12-28 03:16:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 572481536. Throughput: 0: 9912.3, 1: 9879.6. Samples: 572449876. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:16:56,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.889')] [2023-12-28 03:16:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001116504_285884416.pth... [2023-12-28 03:16:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001115320_285581312.pth [2023-12-28 03:16:56,220][106225] Updated weights for policy 1, policy_version 1119359 (0.0006) [2023-12-28 03:16:56,275][106225] Updated weights for policy 1, policy_version 1119369 (0.0005) [2023-12-28 03:16:56,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001119376_286605312.pth... [2023-12-28 03:16:56,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001118224_286310400.pth [2023-12-28 03:16:56,637][106226] Updated weights for policy 0, policy_version 1116508 (0.0007) [2023-12-28 03:16:56,687][106226] Updated weights for policy 0, policy_version 1116518 (0.0010) [2023-12-28 03:16:56,736][106226] Updated weights for policy 0, policy_version 1116528 (0.0010) [2023-12-28 03:16:56,920][106225] Updated weights for policy 1, policy_version 1119379 (0.0006) [2023-12-28 03:16:56,983][106225] Updated weights for policy 1, policy_version 1119389 (0.0008) [2023-12-28 03:16:57,039][106225] Updated weights for policy 1, policy_version 1119399 (0.0008) [2023-12-28 03:16:57,353][106226] Updated weights for policy 0, policy_version 1116538 (0.0006) [2023-12-28 03:16:57,409][106226] Updated weights for policy 0, policy_version 1116548 (0.0009) [2023-12-28 03:16:57,467][106226] Updated weights for policy 0, policy_version 1116558 (0.0005) [2023-12-28 03:16:57,525][106226] Updated weights for policy 0, policy_version 1116568 (0.0005) [2023-12-28 03:16:57,857][106225] Updated weights for policy 1, policy_version 1119409 (0.0010) [2023-12-28 03:16:57,919][106225] Updated weights for policy 1, policy_version 1119419 (0.0008) [2023-12-28 03:16:57,977][106225] Updated weights for policy 1, policy_version 1119429 (0.0008) [2023-12-28 03:16:58,031][106225] Updated weights for policy 1, policy_version 1119439 (0.0008) [2023-12-28 03:16:58,075][106226] Updated weights for policy 0, policy_version 1116578 (0.0007) [2023-12-28 03:16:58,135][106226] Updated weights for policy 0, policy_version 1116588 (0.0007) [2023-12-28 03:16:58,184][106226] Updated weights for policy 0, policy_version 1116598 (0.0008) [2023-12-28 03:16:58,845][106225] Updated weights for policy 1, policy_version 1119449 (0.0007) [2023-12-28 03:16:58,927][106225] Updated weights for policy 1, policy_version 1119459 (0.0007) [2023-12-28 03:16:58,996][106225] Updated weights for policy 1, policy_version 1119469 (0.0007) [2023-12-28 03:16:59,061][106226] Updated weights for policy 0, policy_version 1116608 (0.0008) [2023-12-28 03:16:59,125][106226] Updated weights for policy 0, policy_version 1116618 (0.0008) [2023-12-28 03:16:59,188][106226] Updated weights for policy 0, policy_version 1116628 (0.0008) [2023-12-28 03:16:59,681][106225] Updated weights for policy 1, policy_version 1119479 (0.0008) [2023-12-28 03:16:59,735][106225] Updated weights for policy 1, policy_version 1119489 (0.0008) [2023-12-28 03:16:59,797][106225] Updated weights for policy 1, policy_version 1119499 (0.0008) [2023-12-28 03:16:59,978][106226] Updated weights for policy 0, policy_version 1116638 (0.0009) [2023-12-28 03:17:00,029][106226] Updated weights for policy 0, policy_version 1116648 (0.0008) [2023-12-28 03:17:00,089][106226] Updated weights for policy 0, policy_version 1116658 (0.0010) [2023-12-28 03:17:00,539][106225] Updated weights for policy 1, policy_version 1119509 (0.0007) [2023-12-28 03:17:00,596][106225] Updated weights for policy 1, policy_version 1119519 (0.0008) [2023-12-28 03:17:00,654][106225] Updated weights for policy 1, policy_version 1119529 (0.0008) [2023-12-28 03:17:00,819][106226] Updated weights for policy 0, policy_version 1116668 (0.0009) [2023-12-28 03:17:00,866][106226] Updated weights for policy 0, policy_version 1116678 (0.0008) [2023-12-28 03:17:00,919][106226] Updated weights for policy 0, policy_version 1116688 (0.0005) [2023-12-28 03:17:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 572579840. Throughput: 0: 10045.7, 1: 9872.9. Samples: 572569088. Policy #0 lag: (min: 11.0, avg: 12.4, max: 33.0) [2023-12-28 03:17:01,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-5.036')] [2023-12-28 03:17:01,333][106225] Updated weights for policy 1, policy_version 1119539 (0.0008) [2023-12-28 03:17:01,390][106225] Updated weights for policy 1, policy_version 1119549 (0.0007) [2023-12-28 03:17:01,460][106225] Updated weights for policy 1, policy_version 1119559 (0.0008) [2023-12-28 03:17:01,662][106226] Updated weights for policy 0, policy_version 1116698 (0.0005) [2023-12-28 03:17:01,732][106226] Updated weights for policy 0, policy_version 1116708 (0.0010) [2023-12-28 03:17:01,788][106226] Updated weights for policy 0, policy_version 1116718 (0.0006) [2023-12-28 03:17:01,848][106226] Updated weights for policy 0, policy_version 1116728 (0.0005) [2023-12-28 03:17:02,165][106225] Updated weights for policy 1, policy_version 1119569 (0.0008) [2023-12-28 03:17:02,252][106225] Updated weights for policy 1, policy_version 1119579 (0.0008) [2023-12-28 03:17:02,313][106225] Updated weights for policy 1, policy_version 1119589 (0.0008) [2023-12-28 03:17:02,373][106225] Updated weights for policy 1, policy_version 1119599 (0.0009) [2023-12-28 03:17:02,558][106226] Updated weights for policy 0, policy_version 1116738 (0.0010) [2023-12-28 03:17:02,608][106226] Updated weights for policy 0, policy_version 1116748 (0.0010) [2023-12-28 03:17:02,662][106226] Updated weights for policy 0, policy_version 1116758 (0.0011) [2023-12-28 03:17:03,095][106225] Updated weights for policy 1, policy_version 1119609 (0.0008) [2023-12-28 03:17:03,148][106225] Updated weights for policy 1, policy_version 1119619 (0.0009) [2023-12-28 03:17:03,201][106225] Updated weights for policy 1, policy_version 1119629 (0.0011) [2023-12-28 03:17:03,331][106226] Updated weights for policy 0, policy_version 1116768 (0.0009) [2023-12-28 03:17:03,380][106226] Updated weights for policy 0, policy_version 1116778 (0.0008) [2023-12-28 03:17:03,425][106226] Updated weights for policy 0, policy_version 1116788 (0.0008) [2023-12-28 03:17:03,933][106225] Updated weights for policy 1, policy_version 1119639 (0.0008) [2023-12-28 03:17:03,996][106225] Updated weights for policy 1, policy_version 1119649 (0.0009) [2023-12-28 03:17:04,061][106225] Updated weights for policy 1, policy_version 1119659 (0.0007) [2023-12-28 03:17:04,176][106226] Updated weights for policy 0, policy_version 1116798 (0.0009) [2023-12-28 03:17:04,238][106226] Updated weights for policy 0, policy_version 1116808 (0.0009) [2023-12-28 03:17:04,300][106226] Updated weights for policy 0, policy_version 1116818 (0.0008) [2023-12-28 03:17:04,780][106225] Updated weights for policy 1, policy_version 1119669 (0.0009) [2023-12-28 03:17:04,835][106225] Updated weights for policy 1, policy_version 1119679 (0.0008) [2023-12-28 03:17:04,898][106225] Updated weights for policy 1, policy_version 1119689 (0.0008) [2023-12-28 03:17:05,039][106226] Updated weights for policy 0, policy_version 1116828 (0.0008) [2023-12-28 03:17:05,089][106226] Updated weights for policy 0, policy_version 1116838 (0.0008) [2023-12-28 03:17:05,137][106226] Updated weights for policy 0, policy_version 1116848 (0.0008) [2023-12-28 03:17:05,674][106225] Updated weights for policy 1, policy_version 1119699 (0.0008) [2023-12-28 03:17:05,733][106225] Updated weights for policy 1, policy_version 1119709 (0.0008) [2023-12-28 03:17:05,772][106226] Updated weights for policy 0, policy_version 1116858 (0.0008) [2023-12-28 03:17:05,785][106225] Updated weights for policy 1, policy_version 1119719 (0.0007) [2023-12-28 03:17:05,823][106226] Updated weights for policy 0, policy_version 1116868 (0.0005) [2023-12-28 03:17:05,880][106226] Updated weights for policy 0, policy_version 1116878 (0.0008) [2023-12-28 03:17:05,947][106226] Updated weights for policy 0, policy_version 1116888 (0.0008) [2023-12-28 03:17:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 572678144. Throughput: 0: 10086.2, 1: 9791.4. Samples: 572685316. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:06,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.051')] [2023-12-28 03:17:06,523][106225] Updated weights for policy 1, policy_version 1119729 (0.0008) [2023-12-28 03:17:06,588][106225] Updated weights for policy 1, policy_version 1119739 (0.0011) [2023-12-28 03:17:06,647][106225] Updated weights for policy 1, policy_version 1119749 (0.0010) [2023-12-28 03:17:06,705][106225] Updated weights for policy 1, policy_version 1119759 (0.0010) [2023-12-28 03:17:06,727][106226] Updated weights for policy 0, policy_version 1116898 (0.0006) [2023-12-28 03:17:06,782][106226] Updated weights for policy 0, policy_version 1116908 (0.0008) [2023-12-28 03:17:06,833][106226] Updated weights for policy 0, policy_version 1116918 (0.0008) [2023-12-28 03:17:07,387][106225] Updated weights for policy 1, policy_version 1119769 (0.0008) [2023-12-28 03:17:07,442][106225] Updated weights for policy 1, policy_version 1119779 (0.0010) [2023-12-28 03:17:07,496][106225] Updated weights for policy 1, policy_version 1119789 (0.0010) [2023-12-28 03:17:07,560][106226] Updated weights for policy 0, policy_version 1116928 (0.0009) [2023-12-28 03:17:07,614][106226] Updated weights for policy 0, policy_version 1116938 (0.0010) [2023-12-28 03:17:07,669][106226] Updated weights for policy 0, policy_version 1116948 (0.0009) [2023-12-28 03:17:08,113][106225] Updated weights for policy 1, policy_version 1119799 (0.0010) [2023-12-28 03:17:08,167][106225] Updated weights for policy 1, policy_version 1119809 (0.0010) [2023-12-28 03:17:08,230][106225] Updated weights for policy 1, policy_version 1119819 (0.0011) [2023-12-28 03:17:08,509][106226] Updated weights for policy 0, policy_version 1116958 (0.0009) [2023-12-28 03:17:08,557][106226] Updated weights for policy 0, policy_version 1116968 (0.0009) [2023-12-28 03:17:08,610][106226] Updated weights for policy 0, policy_version 1116978 (0.0009) [2023-12-28 03:17:08,959][106225] Updated weights for policy 1, policy_version 1119829 (0.0010) [2023-12-28 03:17:09,019][106225] Updated weights for policy 1, policy_version 1119839 (0.0010) [2023-12-28 03:17:09,070][106225] Updated weights for policy 1, policy_version 1119849 (0.0010) [2023-12-28 03:17:09,334][106226] Updated weights for policy 0, policy_version 1116988 (0.0008) [2023-12-28 03:17:09,405][106226] Updated weights for policy 0, policy_version 1116998 (0.0009) [2023-12-28 03:17:09,466][106226] Updated weights for policy 0, policy_version 1117008 (0.0010) [2023-12-28 03:17:09,865][106225] Updated weights for policy 1, policy_version 1119859 (0.0010) [2023-12-28 03:17:09,928][106225] Updated weights for policy 1, policy_version 1119869 (0.0010) [2023-12-28 03:17:09,998][106225] Updated weights for policy 1, policy_version 1119879 (0.0011) [2023-12-28 03:17:10,210][106226] Updated weights for policy 0, policy_version 1117018 (0.0010) [2023-12-28 03:17:10,275][106226] Updated weights for policy 0, policy_version 1117028 (0.0008) [2023-12-28 03:17:10,329][106226] Updated weights for policy 0, policy_version 1117038 (0.0008) [2023-12-28 03:17:10,379][106226] Updated weights for policy 0, policy_version 1117048 (0.0008) [2023-12-28 03:17:10,724][106225] Updated weights for policy 1, policy_version 1119889 (0.0010) [2023-12-28 03:17:10,786][106225] Updated weights for policy 1, policy_version 1119899 (0.0010) [2023-12-28 03:17:10,838][106225] Updated weights for policy 1, policy_version 1119909 (0.0010) [2023-12-28 03:17:10,894][106225] Updated weights for policy 1, policy_version 1119919 (0.0010) [2023-12-28 03:17:11,169][106226] Updated weights for policy 0, policy_version 1117058 (0.0008) [2023-12-28 03:17:11,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 572768256. Throughput: 0: 10042.0, 1: 9805.0. Samples: 572743072. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:11,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.796')] [2023-12-28 03:17:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001119920_286744576.pth... [2023-12-28 03:17:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001118800_286457856.pth [2023-12-28 03:17:11,238][106226] Updated weights for policy 0, policy_version 1117068 (0.0008) [2023-12-28 03:17:11,304][106226] Updated weights for policy 0, policy_version 1117078 (0.0009) [2023-12-28 03:17:11,314][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001117080_286031872.pth... [2023-12-28 03:17:11,319][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001115928_285736960.pth [2023-12-28 03:17:11,696][106225] Updated weights for policy 1, policy_version 1119929 (0.0009) [2023-12-28 03:17:11,769][106225] Updated weights for policy 1, policy_version 1119939 (0.0008) [2023-12-28 03:17:11,827][106225] Updated weights for policy 1, policy_version 1119949 (0.0008) [2023-12-28 03:17:12,050][106226] Updated weights for policy 0, policy_version 1117088 (0.0009) [2023-12-28 03:17:12,119][106226] Updated weights for policy 0, policy_version 1117098 (0.0009) [2023-12-28 03:17:12,179][106226] Updated weights for policy 0, policy_version 1117108 (0.0008) [2023-12-28 03:17:12,546][106225] Updated weights for policy 1, policy_version 1119959 (0.0009) [2023-12-28 03:17:12,612][106225] Updated weights for policy 1, policy_version 1119969 (0.0008) [2023-12-28 03:17:12,672][106225] Updated weights for policy 1, policy_version 1119979 (0.0007) [2023-12-28 03:17:12,939][106226] Updated weights for policy 0, policy_version 1117118 (0.0009) [2023-12-28 03:17:12,998][106226] Updated weights for policy 0, policy_version 1117128 (0.0009) [2023-12-28 03:17:13,058][106226] Updated weights for policy 0, policy_version 1117138 (0.0008) [2023-12-28 03:17:13,298][106225] Updated weights for policy 1, policy_version 1119989 (0.0008) [2023-12-28 03:17:13,351][106225] Updated weights for policy 1, policy_version 1119999 (0.0008) [2023-12-28 03:17:13,399][106225] Updated weights for policy 1, policy_version 1120009 (0.0008) [2023-12-28 03:17:13,715][106226] Updated weights for policy 0, policy_version 1117148 (0.0007) [2023-12-28 03:17:13,776][106226] Updated weights for policy 0, policy_version 1117158 (0.0007) [2023-12-28 03:17:13,824][106226] Updated weights for policy 0, policy_version 1117168 (0.0009) [2023-12-28 03:17:14,161][106225] Updated weights for policy 1, policy_version 1120019 (0.0009) [2023-12-28 03:17:14,223][106225] Updated weights for policy 1, policy_version 1120029 (0.0008) [2023-12-28 03:17:14,286][106225] Updated weights for policy 1, policy_version 1120039 (0.0008) [2023-12-28 03:17:14,461][106226] Updated weights for policy 0, policy_version 1117178 (0.0008) [2023-12-28 03:17:14,522][106226] Updated weights for policy 0, policy_version 1117188 (0.0007) [2023-12-28 03:17:14,570][106226] Updated weights for policy 0, policy_version 1117198 (0.0008) [2023-12-28 03:17:14,624][106226] Updated weights for policy 0, policy_version 1117208 (0.0009) [2023-12-28 03:17:14,998][106225] Updated weights for policy 1, policy_version 1120049 (0.0008) [2023-12-28 03:17:15,062][106225] Updated weights for policy 1, policy_version 1120059 (0.0008) [2023-12-28 03:17:15,134][106225] Updated weights for policy 1, policy_version 1120069 (0.0008) [2023-12-28 03:17:15,197][106225] Updated weights for policy 1, policy_version 1120079 (0.0007) [2023-12-28 03:17:15,349][106226] Updated weights for policy 0, policy_version 1117218 (0.0009) [2023-12-28 03:17:15,411][106226] Updated weights for policy 0, policy_version 1117228 (0.0010) [2023-12-28 03:17:15,469][106226] Updated weights for policy 0, policy_version 1117238 (0.0008) [2023-12-28 03:17:15,804][106225] Updated weights for policy 1, policy_version 1120089 (0.0009) [2023-12-28 03:17:15,855][106225] Updated weights for policy 1, policy_version 1120099 (0.0009) [2023-12-28 03:17:15,906][106225] Updated weights for policy 1, policy_version 1120109 (0.0010) [2023-12-28 03:17:16,045][106226] Updated weights for policy 0, policy_version 1117248 (0.0010) [2023-12-28 03:17:16,101][106226] Updated weights for policy 0, policy_version 1117258 (0.0010) [2023-12-28 03:17:16,151][106226] Updated weights for policy 0, policy_version 1117268 (0.0010) [2023-12-28 03:17:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 572874752. Throughput: 0: 9883.6, 1: 9651.9. Samples: 572857912. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:16,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-4.983')] [2023-12-28 03:17:16,686][106225] Updated weights for policy 1, policy_version 1120119 (0.0009) [2023-12-28 03:17:16,744][106225] Updated weights for policy 1, policy_version 1120129 (0.0008) [2023-12-28 03:17:16,786][106226] Updated weights for policy 0, policy_version 1117278 (0.0009) [2023-12-28 03:17:16,788][106225] Updated weights for policy 1, policy_version 1120139 (0.0006) [2023-12-28 03:17:16,840][106226] Updated weights for policy 0, policy_version 1117288 (0.0010) [2023-12-28 03:17:16,889][106226] Updated weights for policy 0, policy_version 1117298 (0.0010) [2023-12-28 03:17:17,429][106225] Updated weights for policy 1, policy_version 1120149 (0.0008) [2023-12-28 03:17:17,492][106225] Updated weights for policy 1, policy_version 1120159 (0.0010) [2023-12-28 03:17:17,542][106225] Updated weights for policy 1, policy_version 1120169 (0.0010) [2023-12-28 03:17:17,563][106226] Updated weights for policy 0, policy_version 1117308 (0.0009) [2023-12-28 03:17:17,614][106226] Updated weights for policy 0, policy_version 1117318 (0.0008) [2023-12-28 03:17:17,667][106226] Updated weights for policy 0, policy_version 1117328 (0.0008) [2023-12-28 03:17:18,243][106225] Updated weights for policy 1, policy_version 1120179 (0.0010) [2023-12-28 03:17:18,291][106226] Updated weights for policy 0, policy_version 1117338 (0.0005) [2023-12-28 03:17:18,296][106225] Updated weights for policy 1, policy_version 1120189 (0.0010) [2023-12-28 03:17:18,359][106226] Updated weights for policy 0, policy_version 1117348 (0.0009) [2023-12-28 03:17:18,366][106225] Updated weights for policy 1, policy_version 1120199 (0.0009) [2023-12-28 03:17:18,417][106226] Updated weights for policy 0, policy_version 1117358 (0.0011) [2023-12-28 03:17:18,479][106226] Updated weights for policy 0, policy_version 1117368 (0.0009) [2023-12-28 03:17:19,110][106225] Updated weights for policy 1, policy_version 1120209 (0.0010) [2023-12-28 03:17:19,141][106226] Updated weights for policy 0, policy_version 1117378 (0.0010) [2023-12-28 03:17:19,167][106225] Updated weights for policy 1, policy_version 1120219 (0.0010) [2023-12-28 03:17:19,194][106226] Updated weights for policy 0, policy_version 1117388 (0.0010) [2023-12-28 03:17:19,227][106225] Updated weights for policy 1, policy_version 1120229 (0.0010) [2023-12-28 03:17:19,270][106226] Updated weights for policy 0, policy_version 1117398 (0.0010) [2023-12-28 03:17:19,287][106225] Updated weights for policy 1, policy_version 1120239 (0.0008) [2023-12-28 03:17:19,956][106225] Updated weights for policy 1, policy_version 1120249 (0.0008) [2023-12-28 03:17:20,009][106225] Updated weights for policy 1, policy_version 1120259 (0.0008) [2023-12-28 03:17:20,058][106226] Updated weights for policy 0, policy_version 1117408 (0.0008) [2023-12-28 03:17:20,072][106225] Updated weights for policy 1, policy_version 1120269 (0.0007) [2023-12-28 03:17:20,122][106226] Updated weights for policy 0, policy_version 1117418 (0.0008) [2023-12-28 03:17:20,190][106226] Updated weights for policy 0, policy_version 1117428 (0.0009) [2023-12-28 03:17:20,812][106225] Updated weights for policy 1, policy_version 1120279 (0.0007) [2023-12-28 03:17:20,874][106226] Updated weights for policy 0, policy_version 1117438 (0.0009) [2023-12-28 03:17:20,878][106225] Updated weights for policy 1, policy_version 1120289 (0.0007) [2023-12-28 03:17:20,931][106225] Updated weights for policy 1, policy_version 1120299 (0.0007) [2023-12-28 03:17:20,937][106226] Updated weights for policy 0, policy_version 1117448 (0.0007) [2023-12-28 03:17:21,001][106226] Updated weights for policy 0, policy_version 1117458 (0.0008) [2023-12-28 03:17:21,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 572973056. Throughput: 0: 9821.5, 1: 9658.4. Samples: 572978448. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:21,176][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.939')] [2023-12-28 03:17:21,692][106225] Updated weights for policy 1, policy_version 1120309 (0.0008) [2023-12-28 03:17:21,764][106225] Updated weights for policy 1, policy_version 1120319 (0.0009) [2023-12-28 03:17:21,795][106226] Updated weights for policy 0, policy_version 1117468 (0.0007) [2023-12-28 03:17:21,826][106225] Updated weights for policy 1, policy_version 1120329 (0.0007) [2023-12-28 03:17:21,860][106226] Updated weights for policy 0, policy_version 1117478 (0.0006) [2023-12-28 03:17:21,926][106226] Updated weights for policy 0, policy_version 1117488 (0.0008) [2023-12-28 03:17:22,605][106226] Updated weights for policy 0, policy_version 1117498 (0.0008) [2023-12-28 03:17:22,607][106225] Updated weights for policy 1, policy_version 1120339 (0.0007) [2023-12-28 03:17:22,668][106225] Updated weights for policy 1, policy_version 1120349 (0.0007) [2023-12-28 03:17:22,670][106226] Updated weights for policy 0, policy_version 1117508 (0.0008) [2023-12-28 03:17:22,722][106225] Updated weights for policy 1, policy_version 1120359 (0.0007) [2023-12-28 03:17:22,733][106226] Updated weights for policy 0, policy_version 1117518 (0.0006) [2023-12-28 03:17:22,787][106226] Updated weights for policy 0, policy_version 1117528 (0.0005) [2023-12-28 03:17:23,412][106226] Updated weights for policy 0, policy_version 1117538 (0.0009) [2023-12-28 03:17:23,467][106226] Updated weights for policy 0, policy_version 1117548 (0.0008) [2023-12-28 03:17:23,523][106226] Updated weights for policy 0, policy_version 1117558 (0.0008) [2023-12-28 03:17:23,526][106225] Updated weights for policy 1, policy_version 1120369 (0.0007) [2023-12-28 03:17:23,576][106225] Updated weights for policy 1, policy_version 1120379 (0.0008) [2023-12-28 03:17:23,620][106225] Updated weights for policy 1, policy_version 1120389 (0.0008) [2023-12-28 03:17:23,665][106225] Updated weights for policy 1, policy_version 1120399 (0.0006) [2023-12-28 03:17:24,282][106225] Updated weights for policy 1, policy_version 1120409 (0.0006) [2023-12-28 03:17:24,321][106226] Updated weights for policy 0, policy_version 1117568 (0.0010) [2023-12-28 03:17:24,341][106225] Updated weights for policy 1, policy_version 1120419 (0.0008) [2023-12-28 03:17:24,381][106226] Updated weights for policy 0, policy_version 1117578 (0.0008) [2023-12-28 03:17:24,394][106225] Updated weights for policy 1, policy_version 1120429 (0.0009) [2023-12-28 03:17:24,428][106226] Updated weights for policy 0, policy_version 1117588 (0.0005) [2023-12-28 03:17:24,948][106225] Updated weights for policy 1, policy_version 1120439 (0.0005) [2023-12-28 03:17:24,994][106225] Updated weights for policy 1, policy_version 1120449 (0.0006) [2023-12-28 03:17:25,020][106226] Updated weights for policy 0, policy_version 1117598 (0.0005) [2023-12-28 03:17:25,048][106225] Updated weights for policy 1, policy_version 1120459 (0.0005) [2023-12-28 03:17:25,086][106226] Updated weights for policy 0, policy_version 1117608 (0.0008) [2023-12-28 03:17:25,152][106226] Updated weights for policy 0, policy_version 1117618 (0.0010) [2023-12-28 03:17:25,597][106225] Updated weights for policy 1, policy_version 1120469 (0.0005) [2023-12-28 03:17:25,656][106225] Updated weights for policy 1, policy_version 1120479 (0.0007) [2023-12-28 03:17:25,707][106225] Updated weights for policy 1, policy_version 1120489 (0.0008) [2023-12-28 03:17:25,709][106226] Updated weights for policy 0, policy_version 1117628 (0.0010) [2023-12-28 03:17:25,765][106226] Updated weights for policy 0, policy_version 1117638 (0.0010) [2023-12-28 03:17:25,818][106226] Updated weights for policy 0, policy_version 1117648 (0.0010) [2023-12-28 03:17:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 573071360. Throughput: 0: 9829.0, 1: 9601.2. Samples: 573034140. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:26,175][105115] Avg episode reward: [(0, '-4.856'), (1, '-4.978')] [2023-12-28 03:17:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001120496_286892032.pth... [2023-12-28 03:17:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001117656_286179328.pth... [2023-12-28 03:17:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001116504_285884416.pth [2023-12-28 03:17:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001119376_286605312.pth [2023-12-28 03:17:26,320][106225] Updated weights for policy 1, policy_version 1120499 (0.0005) [2023-12-28 03:17:26,369][106225] Updated weights for policy 1, policy_version 1120509 (0.0006) [2023-12-28 03:17:26,415][106225] Updated weights for policy 1, policy_version 1120519 (0.0007) [2023-12-28 03:17:26,595][106226] Updated weights for policy 0, policy_version 1117658 (0.0010) [2023-12-28 03:17:26,644][106226] Updated weights for policy 0, policy_version 1117668 (0.0010) [2023-12-28 03:17:26,698][106226] Updated weights for policy 0, policy_version 1117678 (0.0010) [2023-12-28 03:17:26,751][106226] Updated weights for policy 0, policy_version 1117688 (0.0007) [2023-12-28 03:17:27,129][106225] Updated weights for policy 1, policy_version 1120529 (0.0008) [2023-12-28 03:17:27,191][106225] Updated weights for policy 1, policy_version 1120539 (0.0009) [2023-12-28 03:17:27,253][106225] Updated weights for policy 1, policy_version 1120549 (0.0008) [2023-12-28 03:17:27,317][106225] Updated weights for policy 1, policy_version 1120559 (0.0009) [2023-12-28 03:17:27,470][106226] Updated weights for policy 0, policy_version 1117698 (0.0008) [2023-12-28 03:17:27,518][106226] Updated weights for policy 0, policy_version 1117708 (0.0009) [2023-12-28 03:17:27,584][106226] Updated weights for policy 0, policy_version 1117718 (0.0009) [2023-12-28 03:17:28,032][106225] Updated weights for policy 1, policy_version 1120569 (0.0008) [2023-12-28 03:17:28,090][106225] Updated weights for policy 1, policy_version 1120579 (0.0008) [2023-12-28 03:17:28,147][106225] Updated weights for policy 1, policy_version 1120589 (0.0008) [2023-12-28 03:17:28,303][106226] Updated weights for policy 0, policy_version 1117728 (0.0008) [2023-12-28 03:17:28,382][106226] Updated weights for policy 0, policy_version 1117738 (0.0008) [2023-12-28 03:17:28,442][106226] Updated weights for policy 0, policy_version 1117748 (0.0008) [2023-12-28 03:17:28,851][106225] Updated weights for policy 1, policy_version 1120599 (0.0008) [2023-12-28 03:17:28,911][106225] Updated weights for policy 1, policy_version 1120609 (0.0008) [2023-12-28 03:17:28,956][106225] Updated weights for policy 1, policy_version 1120619 (0.0008) [2023-12-28 03:17:29,136][106226] Updated weights for policy 0, policy_version 1117758 (0.0009) [2023-12-28 03:17:29,200][106226] Updated weights for policy 0, policy_version 1117768 (0.0008) [2023-12-28 03:17:29,270][106226] Updated weights for policy 0, policy_version 1117778 (0.0008) [2023-12-28 03:17:29,669][106225] Updated weights for policy 1, policy_version 1120629 (0.0008) [2023-12-28 03:17:29,732][106225] Updated weights for policy 1, policy_version 1120639 (0.0008) [2023-12-28 03:17:29,788][106225] Updated weights for policy 1, policy_version 1120649 (0.0007) [2023-12-28 03:17:30,086][106226] Updated weights for policy 0, policy_version 1117788 (0.0008) [2023-12-28 03:17:30,146][106226] Updated weights for policy 0, policy_version 1117798 (0.0009) [2023-12-28 03:17:30,214][106226] Updated weights for policy 0, policy_version 1117808 (0.0009) [2023-12-28 03:17:30,501][106225] Updated weights for policy 1, policy_version 1120659 (0.0008) [2023-12-28 03:17:30,554][106225] Updated weights for policy 1, policy_version 1120669 (0.0005) [2023-12-28 03:17:30,612][106225] Updated weights for policy 1, policy_version 1120679 (0.0005) [2023-12-28 03:17:30,939][106226] Updated weights for policy 0, policy_version 1117818 (0.0008) [2023-12-28 03:17:30,987][106226] Updated weights for policy 0, policy_version 1117828 (0.0008) [2023-12-28 03:17:31,045][106226] Updated weights for policy 0, policy_version 1117838 (0.0008) [2023-12-28 03:17:31,104][106226] Updated weights for policy 0, policy_version 1117848 (0.0009) [2023-12-28 03:17:31,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 573169664. Throughput: 0: 9885.5, 1: 9707.3. Samples: 573157980. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:31,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-4.972')] [2023-12-28 03:17:31,269][106225] Updated weights for policy 1, policy_version 1120689 (0.0006) [2023-12-28 03:17:31,324][106225] Updated weights for policy 1, policy_version 1120699 (0.0007) [2023-12-28 03:17:31,398][106225] Updated weights for policy 1, policy_version 1120709 (0.0009) [2023-12-28 03:17:31,459][106225] Updated weights for policy 1, policy_version 1120719 (0.0007) [2023-12-28 03:17:31,906][106226] Updated weights for policy 0, policy_version 1117858 (0.0008) [2023-12-28 03:17:31,951][106226] Updated weights for policy 0, policy_version 1117868 (0.0009) [2023-12-28 03:17:31,999][106226] Updated weights for policy 0, policy_version 1117878 (0.0008) [2023-12-28 03:17:32,176][106225] Updated weights for policy 1, policy_version 1120729 (0.0008) [2023-12-28 03:17:32,222][106225] Updated weights for policy 1, policy_version 1120739 (0.0009) [2023-12-28 03:17:32,278][106225] Updated weights for policy 1, policy_version 1120749 (0.0009) [2023-12-28 03:17:32,770][106226] Updated weights for policy 0, policy_version 1117888 (0.0008) [2023-12-28 03:17:32,828][106226] Updated weights for policy 0, policy_version 1117898 (0.0008) [2023-12-28 03:17:32,880][106226] Updated weights for policy 0, policy_version 1117908 (0.0008) [2023-12-28 03:17:33,032][106225] Updated weights for policy 1, policy_version 1120759 (0.0008) [2023-12-28 03:17:33,078][106225] Updated weights for policy 1, policy_version 1120769 (0.0007) [2023-12-28 03:17:33,140][106225] Updated weights for policy 1, policy_version 1120779 (0.0009) [2023-12-28 03:17:33,613][106226] Updated weights for policy 0, policy_version 1117918 (0.0008) [2023-12-28 03:17:33,660][106226] Updated weights for policy 0, policy_version 1117928 (0.0008) [2023-12-28 03:17:33,714][106226] Updated weights for policy 0, policy_version 1117938 (0.0008) [2023-12-28 03:17:33,810][106225] Updated weights for policy 1, policy_version 1120789 (0.0008) [2023-12-28 03:17:33,871][106225] Updated weights for policy 1, policy_version 1120799 (0.0008) [2023-12-28 03:17:33,923][106225] Updated weights for policy 1, policy_version 1120809 (0.0008) [2023-12-28 03:17:34,327][106226] Updated weights for policy 0, policy_version 1117948 (0.0008) [2023-12-28 03:17:34,392][106226] Updated weights for policy 0, policy_version 1117958 (0.0009) [2023-12-28 03:17:34,454][106226] Updated weights for policy 0, policy_version 1117968 (0.0008) [2023-12-28 03:17:34,721][106225] Updated weights for policy 1, policy_version 1120819 (0.0008) [2023-12-28 03:17:34,770][106225] Updated weights for policy 1, policy_version 1120829 (0.0008) [2023-12-28 03:17:34,817][106225] Updated weights for policy 1, policy_version 1120839 (0.0008) [2023-12-28 03:17:35,166][106226] Updated weights for policy 0, policy_version 1117978 (0.0009) [2023-12-28 03:17:35,217][106226] Updated weights for policy 0, policy_version 1117988 (0.0008) [2023-12-28 03:17:35,263][106226] Updated weights for policy 0, policy_version 1117998 (0.0010) [2023-12-28 03:17:35,309][106226] Updated weights for policy 0, policy_version 1118008 (0.0010) [2023-12-28 03:17:35,579][106225] Updated weights for policy 1, policy_version 1120849 (0.0008) [2023-12-28 03:17:35,635][106225] Updated weights for policy 1, policy_version 1120859 (0.0010) [2023-12-28 03:17:35,685][106225] Updated weights for policy 1, policy_version 1120869 (0.0010) [2023-12-28 03:17:35,740][106225] Updated weights for policy 1, policy_version 1120879 (0.0007) [2023-12-28 03:17:36,048][106226] Updated weights for policy 0, policy_version 1118018 (0.0011) [2023-12-28 03:17:36,115][106226] Updated weights for policy 0, policy_version 1118028 (0.0009) [2023-12-28 03:17:36,170][106226] Updated weights for policy 0, policy_version 1118038 (0.0009) [2023-12-28 03:17:36,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19799.6). Total num frames: 573259776. Throughput: 0: 9841.3, 1: 9733.9. Samples: 573273932. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:36,175][105115] Avg episode reward: [(0, '-4.886'), (1, '-5.083')] [2023-12-28 03:17:36,504][106225] Updated weights for policy 1, policy_version 1120889 (0.0010) [2023-12-28 03:17:36,566][106225] Updated weights for policy 1, policy_version 1120899 (0.0010) [2023-12-28 03:17:36,625][106225] Updated weights for policy 1, policy_version 1120909 (0.0009) [2023-12-28 03:17:36,891][106226] Updated weights for policy 0, policy_version 1118048 (0.0009) [2023-12-28 03:17:36,944][106226] Updated weights for policy 0, policy_version 1118058 (0.0009) [2023-12-28 03:17:36,992][106226] Updated weights for policy 0, policy_version 1118068 (0.0008) [2023-12-28 03:17:37,289][106225] Updated weights for policy 1, policy_version 1120919 (0.0009) [2023-12-28 03:17:37,348][106225] Updated weights for policy 1, policy_version 1120929 (0.0011) [2023-12-28 03:17:37,406][106225] Updated weights for policy 1, policy_version 1120939 (0.0011) [2023-12-28 03:17:37,713][106226] Updated weights for policy 0, policy_version 1118078 (0.0008) [2023-12-28 03:17:37,774][106226] Updated weights for policy 0, policy_version 1118088 (0.0005) [2023-12-28 03:17:37,838][106226] Updated weights for policy 0, policy_version 1118098 (0.0008) [2023-12-28 03:17:38,085][106225] Updated weights for policy 1, policy_version 1120949 (0.0010) [2023-12-28 03:17:38,146][106225] Updated weights for policy 1, policy_version 1120959 (0.0011) [2023-12-28 03:17:38,207][106225] Updated weights for policy 1, policy_version 1120969 (0.0010) [2023-12-28 03:17:38,595][106226] Updated weights for policy 0, policy_version 1118108 (0.0009) [2023-12-28 03:17:38,649][106226] Updated weights for policy 0, policy_version 1118118 (0.0008) [2023-12-28 03:17:38,710][106226] Updated weights for policy 0, policy_version 1118128 (0.0009) [2023-12-28 03:17:38,883][106225] Updated weights for policy 1, policy_version 1120979 (0.0009) [2023-12-28 03:17:38,943][106225] Updated weights for policy 1, policy_version 1120989 (0.0005) [2023-12-28 03:17:38,991][106225] Updated weights for policy 1, policy_version 1120999 (0.0007) [2023-12-28 03:17:39,450][106226] Updated weights for policy 0, policy_version 1118138 (0.0009) [2023-12-28 03:17:39,518][106226] Updated weights for policy 0, policy_version 1118148 (0.0009) [2023-12-28 03:17:39,586][106226] Updated weights for policy 0, policy_version 1118158 (0.0006) [2023-12-28 03:17:39,644][106225] Updated weights for policy 1, policy_version 1121009 (0.0007) [2023-12-28 03:17:39,652][106226] Updated weights for policy 0, policy_version 1118168 (0.0006) [2023-12-28 03:17:39,717][106225] Updated weights for policy 1, policy_version 1121019 (0.0006) [2023-12-28 03:17:39,784][106225] Updated weights for policy 1, policy_version 1121029 (0.0010) [2023-12-28 03:17:39,849][106225] Updated weights for policy 1, policy_version 1121039 (0.0007) [2023-12-28 03:17:40,337][106226] Updated weights for policy 0, policy_version 1118178 (0.0007) [2023-12-28 03:17:40,385][106226] Updated weights for policy 0, policy_version 1118188 (0.0011) [2023-12-28 03:17:40,436][106226] Updated weights for policy 0, policy_version 1118198 (0.0010) [2023-12-28 03:17:40,558][106225] Updated weights for policy 1, policy_version 1121049 (0.0010) [2023-12-28 03:17:40,616][106225] Updated weights for policy 1, policy_version 1121059 (0.0010) [2023-12-28 03:17:40,681][106225] Updated weights for policy 1, policy_version 1121069 (0.0010) [2023-12-28 03:17:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19799.6). Total num frames: 573358080. Throughput: 0: 9835.2, 1: 9767.5. Samples: 573332000. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:41,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-4.928')] [2023-12-28 03:17:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001121072_287039488.pth... [2023-12-28 03:17:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001119920_286744576.pth [2023-12-28 03:17:41,187][106226] Updated weights for policy 0, policy_version 1118208 (0.0008) [2023-12-28 03:17:41,254][106226] Updated weights for policy 0, policy_version 1118218 (0.0006) [2023-12-28 03:17:41,319][106226] Updated weights for policy 0, policy_version 1118228 (0.0007) [2023-12-28 03:17:41,343][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001118232_286326784.pth... [2023-12-28 03:17:41,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001117080_286031872.pth [2023-12-28 03:17:41,485][106225] Updated weights for policy 1, policy_version 1121079 (0.0010) [2023-12-28 03:17:41,550][106225] Updated weights for policy 1, policy_version 1121089 (0.0008) [2023-12-28 03:17:41,612][106225] Updated weights for policy 1, policy_version 1121099 (0.0009) [2023-12-28 03:17:42,038][106226] Updated weights for policy 0, policy_version 1118238 (0.0008) [2023-12-28 03:17:42,090][106226] Updated weights for policy 0, policy_version 1118248 (0.0010) [2023-12-28 03:17:42,143][106226] Updated weights for policy 0, policy_version 1118258 (0.0009) [2023-12-28 03:17:42,291][106225] Updated weights for policy 1, policy_version 1121109 (0.0009) [2023-12-28 03:17:42,355][106225] Updated weights for policy 1, policy_version 1121119 (0.0008) [2023-12-28 03:17:42,441][106225] Updated weights for policy 1, policy_version 1121129 (0.0009) [2023-12-28 03:17:42,913][106226] Updated weights for policy 0, policy_version 1118268 (0.0008) [2023-12-28 03:17:42,966][106226] Updated weights for policy 0, policy_version 1118278 (0.0008) [2023-12-28 03:17:43,015][106226] Updated weights for policy 0, policy_version 1118288 (0.0009) [2023-12-28 03:17:43,145][106225] Updated weights for policy 1, policy_version 1121139 (0.0008) [2023-12-28 03:17:43,202][106225] Updated weights for policy 1, policy_version 1121149 (0.0005) [2023-12-28 03:17:43,262][106225] Updated weights for policy 1, policy_version 1121159 (0.0008) [2023-12-28 03:17:43,828][106226] Updated weights for policy 0, policy_version 1118298 (0.0009) [2023-12-28 03:17:43,857][106225] Updated weights for policy 1, policy_version 1121169 (0.0008) [2023-12-28 03:17:43,889][106226] Updated weights for policy 0, policy_version 1118308 (0.0011) [2023-12-28 03:17:43,911][106225] Updated weights for policy 1, policy_version 1121179 (0.0007) [2023-12-28 03:17:43,936][106226] Updated weights for policy 0, policy_version 1118318 (0.0010) [2023-12-28 03:17:43,965][106225] Updated weights for policy 1, policy_version 1121189 (0.0005) [2023-12-28 03:17:43,997][106226] Updated weights for policy 0, policy_version 1118328 (0.0011) [2023-12-28 03:17:44,021][106225] Updated weights for policy 1, policy_version 1121199 (0.0007) [2023-12-28 03:17:44,723][106226] Updated weights for policy 0, policy_version 1118338 (0.0009) [2023-12-28 03:17:44,767][106225] Updated weights for policy 1, policy_version 1121209 (0.0008) [2023-12-28 03:17:44,786][106226] Updated weights for policy 0, policy_version 1118348 (0.0006) [2023-12-28 03:17:44,833][106225] Updated weights for policy 1, policy_version 1121219 (0.0006) [2023-12-28 03:17:44,846][106226] Updated weights for policy 0, policy_version 1118358 (0.0008) [2023-12-28 03:17:44,898][106225] Updated weights for policy 1, policy_version 1121229 (0.0007) [2023-12-28 03:17:45,587][106225] Updated weights for policy 1, policy_version 1121239 (0.0006) [2023-12-28 03:17:45,608][106226] Updated weights for policy 0, policy_version 1118368 (0.0008) [2023-12-28 03:17:45,644][106225] Updated weights for policy 1, policy_version 1121249 (0.0006) [2023-12-28 03:17:45,666][106226] Updated weights for policy 0, policy_version 1118378 (0.0006) [2023-12-28 03:17:45,699][106225] Updated weights for policy 1, policy_version 1121259 (0.0007) [2023-12-28 03:17:45,726][106226] Updated weights for policy 0, policy_version 1118388 (0.0008) [2023-12-28 03:17:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.8, 300 sec: 19799.6). Total num frames: 573456384. Throughput: 0: 9710.2, 1: 9807.9. Samples: 573447400. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:46,175][105115] Avg episode reward: [(0, '-4.930'), (1, '-4.949')] [2023-12-28 03:17:46,346][106225] Updated weights for policy 1, policy_version 1121269 (0.0006) [2023-12-28 03:17:46,406][106225] Updated weights for policy 1, policy_version 1121279 (0.0005) [2023-12-28 03:17:46,463][106225] Updated weights for policy 1, policy_version 1121289 (0.0005) [2023-12-28 03:17:46,475][106226] Updated weights for policy 0, policy_version 1118398 (0.0008) [2023-12-28 03:17:46,533][106226] Updated weights for policy 0, policy_version 1118408 (0.0008) [2023-12-28 03:17:46,592][106226] Updated weights for policy 0, policy_version 1118418 (0.0008) [2023-12-28 03:17:47,121][106225] Updated weights for policy 1, policy_version 1121299 (0.0007) [2023-12-28 03:17:47,169][106225] Updated weights for policy 1, policy_version 1121309 (0.0009) [2023-12-28 03:17:47,219][106225] Updated weights for policy 1, policy_version 1121319 (0.0008) [2023-12-28 03:17:47,297][106226] Updated weights for policy 0, policy_version 1118428 (0.0008) [2023-12-28 03:17:47,356][106226] Updated weights for policy 0, policy_version 1118438 (0.0008) [2023-12-28 03:17:47,417][106226] Updated weights for policy 0, policy_version 1118448 (0.0009) [2023-12-28 03:17:47,942][106225] Updated weights for policy 1, policy_version 1121329 (0.0008) [2023-12-28 03:17:47,991][106225] Updated weights for policy 1, policy_version 1121339 (0.0008) [2023-12-28 03:17:48,043][106225] Updated weights for policy 1, policy_version 1121349 (0.0008) [2023-12-28 03:17:48,090][106225] Updated weights for policy 1, policy_version 1121359 (0.0008) [2023-12-28 03:17:48,114][106226] Updated weights for policy 0, policy_version 1118458 (0.0008) [2023-12-28 03:17:48,162][106226] Updated weights for policy 0, policy_version 1118468 (0.0008) [2023-12-28 03:17:48,212][106226] Updated weights for policy 0, policy_version 1118478 (0.0008) [2023-12-28 03:17:48,271][106226] Updated weights for policy 0, policy_version 1118488 (0.0009) [2023-12-28 03:17:48,842][106225] Updated weights for policy 1, policy_version 1121369 (0.0009) [2023-12-28 03:17:48,893][106225] Updated weights for policy 1, policy_version 1121379 (0.0008) [2023-12-28 03:17:48,947][106225] Updated weights for policy 1, policy_version 1121389 (0.0008) [2023-12-28 03:17:48,994][106226] Updated weights for policy 0, policy_version 1118498 (0.0005) [2023-12-28 03:17:49,055][106226] Updated weights for policy 0, policy_version 1118508 (0.0008) [2023-12-28 03:17:49,102][106226] Updated weights for policy 0, policy_version 1118518 (0.0008) [2023-12-28 03:17:49,728][106225] Updated weights for policy 1, policy_version 1121399 (0.0008) [2023-12-28 03:17:49,784][106225] Updated weights for policy 1, policy_version 1121409 (0.0009) [2023-12-28 03:17:49,849][106226] Updated weights for policy 0, policy_version 1118528 (0.0007) [2023-12-28 03:17:49,851][106225] Updated weights for policy 1, policy_version 1121419 (0.0008) [2023-12-28 03:17:49,904][106226] Updated weights for policy 0, policy_version 1118538 (0.0008) [2023-12-28 03:17:49,969][106226] Updated weights for policy 0, policy_version 1118548 (0.0008) [2023-12-28 03:17:50,517][106225] Updated weights for policy 1, policy_version 1121429 (0.0007) [2023-12-28 03:17:50,591][106225] Updated weights for policy 1, policy_version 1121439 (0.0007) [2023-12-28 03:17:50,646][106225] Updated weights for policy 1, policy_version 1121449 (0.0006) [2023-12-28 03:17:50,712][106226] Updated weights for policy 0, policy_version 1118558 (0.0008) [2023-12-28 03:17:50,776][106226] Updated weights for policy 0, policy_version 1118568 (0.0010) [2023-12-28 03:17:50,840][106226] Updated weights for policy 0, policy_version 1118578 (0.0009) [2023-12-28 03:17:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19799.7). Total num frames: 573554688. Throughput: 0: 9653.8, 1: 9863.9. Samples: 573563612. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:51,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.911')] [2023-12-28 03:17:51,291][106225] Updated weights for policy 1, policy_version 1121459 (0.0007) [2023-12-28 03:17:51,352][106225] Updated weights for policy 1, policy_version 1121469 (0.0009) [2023-12-28 03:17:51,422][106225] Updated weights for policy 1, policy_version 1121479 (0.0007) [2023-12-28 03:17:51,624][106226] Updated weights for policy 0, policy_version 1118588 (0.0009) [2023-12-28 03:17:51,687][106226] Updated weights for policy 0, policy_version 1118598 (0.0008) [2023-12-28 03:17:51,747][106226] Updated weights for policy 0, policy_version 1118608 (0.0009) [2023-12-28 03:17:52,153][106225] Updated weights for policy 1, policy_version 1121489 (0.0006) [2023-12-28 03:17:52,214][106225] Updated weights for policy 1, policy_version 1121499 (0.0008) [2023-12-28 03:17:52,284][106225] Updated weights for policy 1, policy_version 1121509 (0.0007) [2023-12-28 03:17:52,344][106225] Updated weights for policy 1, policy_version 1121519 (0.0008) [2023-12-28 03:17:52,498][106226] Updated weights for policy 0, policy_version 1118618 (0.0010) [2023-12-28 03:17:52,562][106226] Updated weights for policy 0, policy_version 1118628 (0.0007) [2023-12-28 03:17:52,616][106226] Updated weights for policy 0, policy_version 1118638 (0.0008) [2023-12-28 03:17:52,672][106226] Updated weights for policy 0, policy_version 1118648 (0.0008) [2023-12-28 03:17:53,063][106225] Updated weights for policy 1, policy_version 1121529 (0.0005) [2023-12-28 03:17:53,119][106225] Updated weights for policy 1, policy_version 1121539 (0.0005) [2023-12-28 03:17:53,173][106225] Updated weights for policy 1, policy_version 1121549 (0.0008) [2023-12-28 03:17:53,463][106226] Updated weights for policy 0, policy_version 1118658 (0.0011) [2023-12-28 03:17:53,528][106226] Updated weights for policy 0, policy_version 1118668 (0.0011) [2023-12-28 03:17:53,597][106226] Updated weights for policy 0, policy_version 1118678 (0.0011) [2023-12-28 03:17:53,762][106225] Updated weights for policy 1, policy_version 1121559 (0.0007) [2023-12-28 03:17:53,815][106225] Updated weights for policy 1, policy_version 1121569 (0.0005) [2023-12-28 03:17:53,875][106225] Updated weights for policy 1, policy_version 1121579 (0.0005) [2023-12-28 03:17:54,342][106226] Updated weights for policy 0, policy_version 1118688 (0.0006) [2023-12-28 03:17:54,396][106226] Updated weights for policy 0, policy_version 1118698 (0.0005) [2023-12-28 03:17:54,434][106225] Updated weights for policy 1, policy_version 1121589 (0.0008) [2023-12-28 03:17:54,454][106226] Updated weights for policy 0, policy_version 1118708 (0.0005) [2023-12-28 03:17:54,497][106225] Updated weights for policy 1, policy_version 1121599 (0.0010) [2023-12-28 03:17:54,565][106225] Updated weights for policy 1, policy_version 1121609 (0.0009) [2023-12-28 03:17:54,999][106226] Updated weights for policy 0, policy_version 1118718 (0.0007) [2023-12-28 03:17:55,055][106226] Updated weights for policy 0, policy_version 1118728 (0.0009) [2023-12-28 03:17:55,121][106226] Updated weights for policy 0, policy_version 1118738 (0.0005) [2023-12-28 03:17:55,183][106225] Updated weights for policy 1, policy_version 1121619 (0.0010) [2023-12-28 03:17:55,242][106225] Updated weights for policy 1, policy_version 1121629 (0.0007) [2023-12-28 03:17:55,299][106225] Updated weights for policy 1, policy_version 1121639 (0.0007) [2023-12-28 03:17:55,737][106226] Updated weights for policy 0, policy_version 1118748 (0.0005) [2023-12-28 03:17:55,791][106226] Updated weights for policy 0, policy_version 1118758 (0.0008) [2023-12-28 03:17:55,859][106226] Updated weights for policy 0, policy_version 1118768 (0.0009) [2023-12-28 03:17:55,877][106225] Updated weights for policy 1, policy_version 1121649 (0.0006) [2023-12-28 03:17:55,926][106225] Updated weights for policy 1, policy_version 1121659 (0.0006) [2023-12-28 03:17:55,977][106225] Updated weights for policy 1, policy_version 1121669 (0.0005) [2023-12-28 03:17:56,032][106225] Updated weights for policy 1, policy_version 1121679 (0.0005) [2023-12-28 03:17:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 573661184. Throughput: 0: 9649.1, 1: 9866.3. Samples: 573621272. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:17:56,176][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.839')] [2023-12-28 03:17:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001118776_286466048.pth... [2023-12-28 03:17:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001121680_287195136.pth... [2023-12-28 03:17:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001117656_286179328.pth [2023-12-28 03:17:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001120496_286892032.pth [2023-12-28 03:17:56,434][106226] Updated weights for policy 0, policy_version 1118778 (0.0007) [2023-12-28 03:17:56,483][106226] Updated weights for policy 0, policy_version 1118788 (0.0008) [2023-12-28 03:17:56,532][106226] Updated weights for policy 0, policy_version 1118799 (0.0009) [2023-12-28 03:17:56,585][106225] Updated weights for policy 1, policy_version 1121689 (0.0005) [2023-12-28 03:17:56,646][106225] Updated weights for policy 1, policy_version 1121699 (0.0005) [2023-12-28 03:17:56,702][106225] Updated weights for policy 1, policy_version 1121709 (0.0005) [2023-12-28 03:17:57,300][106226] Updated weights for policy 0, policy_version 1118809 (0.0008) [2023-12-28 03:17:57,334][106225] Updated weights for policy 1, policy_version 1121719 (0.0006) [2023-12-28 03:17:57,360][106226] Updated weights for policy 0, policy_version 1118819 (0.0006) [2023-12-28 03:17:57,382][106225] Updated weights for policy 1, policy_version 1121729 (0.0006) [2023-12-28 03:17:57,417][106226] Updated weights for policy 0, policy_version 1118829 (0.0007) [2023-12-28 03:17:57,426][106225] Updated weights for policy 1, policy_version 1121739 (0.0005) [2023-12-28 03:17:57,480][106226] Updated weights for policy 0, policy_version 1118839 (0.0005) [2023-12-28 03:17:58,084][106225] Updated weights for policy 1, policy_version 1121749 (0.0008) [2023-12-28 03:17:58,105][106226] Updated weights for policy 0, policy_version 1118849 (0.0005) [2023-12-28 03:17:58,144][106225] Updated weights for policy 1, policy_version 1121759 (0.0010) [2023-12-28 03:17:58,159][106226] Updated weights for policy 0, policy_version 1118859 (0.0005) [2023-12-28 03:17:58,204][106225] Updated weights for policy 1, policy_version 1121769 (0.0009) [2023-12-28 03:17:58,222][106226] Updated weights for policy 0, policy_version 1118869 (0.0008) [2023-12-28 03:17:58,958][106226] Updated weights for policy 0, policy_version 1118879 (0.0008) [2023-12-28 03:17:59,028][106226] Updated weights for policy 0, policy_version 1118889 (0.0008) [2023-12-28 03:17:59,082][106226] Updated weights for policy 0, policy_version 1118899 (0.0008) [2023-12-28 03:17:59,102][106225] Updated weights for policy 1, policy_version 1121779 (0.0008) [2023-12-28 03:17:59,173][106225] Updated weights for policy 1, policy_version 1121789 (0.0011) [2023-12-28 03:17:59,242][106225] Updated weights for policy 1, policy_version 1121799 (0.0011) [2023-12-28 03:17:59,889][106226] Updated weights for policy 0, policy_version 1118909 (0.0008) [2023-12-28 03:17:59,950][106226] Updated weights for policy 0, policy_version 1118919 (0.0008) [2023-12-28 03:17:59,952][106225] Updated weights for policy 1, policy_version 1121809 (0.0009) [2023-12-28 03:18:00,013][106225] Updated weights for policy 1, policy_version 1121819 (0.0007) [2023-12-28 03:18:00,023][106226] Updated weights for policy 0, policy_version 1118929 (0.0006) [2023-12-28 03:18:00,066][106225] Updated weights for policy 1, policy_version 1121829 (0.0007) [2023-12-28 03:18:00,128][106225] Updated weights for policy 1, policy_version 1121839 (0.0007) [2023-12-28 03:18:00,708][106225] Updated weights for policy 1, policy_version 1121849 (0.0010) [2023-12-28 03:18:00,766][106225] Updated weights for policy 1, policy_version 1121859 (0.0011) [2023-12-28 03:18:00,816][106226] Updated weights for policy 0, policy_version 1118939 (0.0007) [2023-12-28 03:18:00,821][106225] Updated weights for policy 1, policy_version 1121869 (0.0010) [2023-12-28 03:18:00,875][106226] Updated weights for policy 0, policy_version 1118949 (0.0009) [2023-12-28 03:18:00,932][106226] Updated weights for policy 0, policy_version 1118959 (0.0008) [2023-12-28 03:18:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 573759488. Throughput: 0: 9711.0, 1: 10002.7. Samples: 573745028. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:01,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.116')] [2023-12-28 03:18:01,569][106225] Updated weights for policy 1, policy_version 1121879 (0.0009) [2023-12-28 03:18:01,632][106225] Updated weights for policy 1, policy_version 1121889 (0.0010) [2023-12-28 03:18:01,698][106225] Updated weights for policy 1, policy_version 1121899 (0.0008) [2023-12-28 03:18:01,703][106226] Updated weights for policy 0, policy_version 1118969 (0.0008) [2023-12-28 03:18:01,772][106226] Updated weights for policy 0, policy_version 1118979 (0.0008) [2023-12-28 03:18:01,828][106226] Updated weights for policy 0, policy_version 1118989 (0.0007) [2023-12-28 03:18:01,878][106226] Updated weights for policy 0, policy_version 1118999 (0.0006) [2023-12-28 03:18:02,440][106225] Updated weights for policy 1, policy_version 1121909 (0.0007) [2023-12-28 03:18:02,491][106225] Updated weights for policy 1, policy_version 1121919 (0.0005) [2023-12-28 03:18:02,542][106225] Updated weights for policy 1, policy_version 1121929 (0.0007) [2023-12-28 03:18:02,625][106226] Updated weights for policy 0, policy_version 1119009 (0.0010) [2023-12-28 03:18:02,674][106226] Updated weights for policy 0, policy_version 1119019 (0.0010) [2023-12-28 03:18:02,734][106226] Updated weights for policy 0, policy_version 1119029 (0.0010) [2023-12-28 03:18:03,169][106225] Updated weights for policy 1, policy_version 1121939 (0.0008) [2023-12-28 03:18:03,223][106225] Updated weights for policy 1, policy_version 1121949 (0.0005) [2023-12-28 03:18:03,276][106225] Updated weights for policy 1, policy_version 1121959 (0.0010) [2023-12-28 03:18:03,332][106226] Updated weights for policy 0, policy_version 1119039 (0.0007) [2023-12-28 03:18:03,384][106226] Updated weights for policy 0, policy_version 1119049 (0.0005) [2023-12-28 03:18:03,449][106226] Updated weights for policy 0, policy_version 1119059 (0.0005) [2023-12-28 03:18:03,887][106225] Updated weights for policy 1, policy_version 1121969 (0.0010) [2023-12-28 03:18:03,944][106225] Updated weights for policy 1, policy_version 1121979 (0.0010) [2023-12-28 03:18:03,998][106225] Updated weights for policy 1, policy_version 1121989 (0.0010) [2023-12-28 03:18:04,037][106226] Updated weights for policy 0, policy_version 1119069 (0.0008) [2023-12-28 03:18:04,063][106225] Updated weights for policy 1, policy_version 1121999 (0.0010) [2023-12-28 03:18:04,098][106226] Updated weights for policy 0, policy_version 1119079 (0.0007) [2023-12-28 03:18:04,166][106226] Updated weights for policy 0, policy_version 1119089 (0.0008) [2023-12-28 03:18:04,705][106225] Updated weights for policy 1, policy_version 1122009 (0.0006) [2023-12-28 03:18:04,772][106225] Updated weights for policy 1, policy_version 1122019 (0.0006) [2023-12-28 03:18:04,828][106225] Updated weights for policy 1, policy_version 1122029 (0.0010) [2023-12-28 03:18:04,904][106226] Updated weights for policy 0, policy_version 1119099 (0.0007) [2023-12-28 03:18:04,960][106226] Updated weights for policy 0, policy_version 1119109 (0.0005) [2023-12-28 03:18:05,006][106226] Updated weights for policy 0, policy_version 1119119 (0.0005) [2023-12-28 03:18:05,511][106225] Updated weights for policy 1, policy_version 1122039 (0.0008) [2023-12-28 03:18:05,558][106225] Updated weights for policy 1, policy_version 1122049 (0.0008) [2023-12-28 03:18:05,612][106225] Updated weights for policy 1, policy_version 1122059 (0.0008) [2023-12-28 03:18:05,647][106226] Updated weights for policy 0, policy_version 1119129 (0.0005) [2023-12-28 03:18:05,708][106226] Updated weights for policy 0, policy_version 1119139 (0.0009) [2023-12-28 03:18:05,765][106226] Updated weights for policy 0, policy_version 1119149 (0.0008) [2023-12-28 03:18:05,830][106226] Updated weights for policy 0, policy_version 1119159 (0.0009) [2023-12-28 03:18:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 573857792. Throughput: 0: 9681.2, 1: 10066.4. Samples: 573867088. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:06,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.722')] [2023-12-28 03:18:06,344][106225] Updated weights for policy 1, policy_version 1122069 (0.0008) [2023-12-28 03:18:06,392][106225] Updated weights for policy 1, policy_version 1122079 (0.0008) [2023-12-28 03:18:06,452][106225] Updated weights for policy 1, policy_version 1122089 (0.0008) [2023-12-28 03:18:06,565][106226] Updated weights for policy 0, policy_version 1119169 (0.0008) [2023-12-28 03:18:06,620][106226] Updated weights for policy 0, policy_version 1119179 (0.0008) [2023-12-28 03:18:06,673][106226] Updated weights for policy 0, policy_version 1119189 (0.0008) [2023-12-28 03:18:07,207][106225] Updated weights for policy 1, policy_version 1122099 (0.0008) [2023-12-28 03:18:07,268][106225] Updated weights for policy 1, policy_version 1122109 (0.0005) [2023-12-28 03:18:07,328][106225] Updated weights for policy 1, policy_version 1122119 (0.0005) [2023-12-28 03:18:07,376][106226] Updated weights for policy 0, policy_version 1119199 (0.0009) [2023-12-28 03:18:07,437][106226] Updated weights for policy 0, policy_version 1119209 (0.0010) [2023-12-28 03:18:07,496][106226] Updated weights for policy 0, policy_version 1119219 (0.0009) [2023-12-28 03:18:07,883][106225] Updated weights for policy 1, policy_version 1122129 (0.0006) [2023-12-28 03:18:07,952][106225] Updated weights for policy 1, policy_version 1122139 (0.0008) [2023-12-28 03:18:08,022][106225] Updated weights for policy 1, policy_version 1122149 (0.0008) [2023-12-28 03:18:08,088][106225] Updated weights for policy 1, policy_version 1122159 (0.0008) [2023-12-28 03:18:08,287][106226] Updated weights for policy 0, policy_version 1119229 (0.0009) [2023-12-28 03:18:08,369][106226] Updated weights for policy 0, policy_version 1119239 (0.0009) [2023-12-28 03:18:08,440][106226] Updated weights for policy 0, policy_version 1119249 (0.0007) [2023-12-28 03:18:08,796][106225] Updated weights for policy 1, policy_version 1122169 (0.0009) [2023-12-28 03:18:08,860][106225] Updated weights for policy 1, policy_version 1122179 (0.0010) [2023-12-28 03:18:08,926][106225] Updated weights for policy 1, policy_version 1122189 (0.0010) [2023-12-28 03:18:09,047][106226] Updated weights for policy 0, policy_version 1119259 (0.0008) [2023-12-28 03:18:09,108][106226] Updated weights for policy 0, policy_version 1119269 (0.0005) [2023-12-28 03:18:09,168][106226] Updated weights for policy 0, policy_version 1119279 (0.0005) [2023-12-28 03:18:09,618][106225] Updated weights for policy 1, policy_version 1122199 (0.0006) [2023-12-28 03:18:09,676][106225] Updated weights for policy 1, policy_version 1122209 (0.0007) [2023-12-28 03:18:09,734][106225] Updated weights for policy 1, policy_version 1122219 (0.0007) [2023-12-28 03:18:09,958][106226] Updated weights for policy 0, policy_version 1119289 (0.0006) [2023-12-28 03:18:10,011][106226] Updated weights for policy 0, policy_version 1119299 (0.0007) [2023-12-28 03:18:10,076][106226] Updated weights for policy 0, policy_version 1119309 (0.0007) [2023-12-28 03:18:10,144][106226] Updated weights for policy 0, policy_version 1119319 (0.0008) [2023-12-28 03:18:10,491][106225] Updated weights for policy 1, policy_version 1122229 (0.0008) [2023-12-28 03:18:10,542][106225] Updated weights for policy 1, policy_version 1122239 (0.0008) [2023-12-28 03:18:10,588][106225] Updated weights for policy 1, policy_version 1122249 (0.0007) [2023-12-28 03:18:10,844][106226] Updated weights for policy 0, policy_version 1119329 (0.0011) [2023-12-28 03:18:10,909][106226] Updated weights for policy 0, policy_version 1119339 (0.0011) [2023-12-28 03:18:10,956][106226] Updated weights for policy 0, policy_version 1119349 (0.0010) [2023-12-28 03:18:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 573956096. Throughput: 0: 9689.7, 1: 10144.7. Samples: 573926688. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:11,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.753')] [2023-12-28 03:18:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001122256_287342592.pth... [2023-12-28 03:18:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001119352_286613504.pth... [2023-12-28 03:18:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001121072_287039488.pth [2023-12-28 03:18:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001118232_286326784.pth [2023-12-28 03:18:11,314][106225] Updated weights for policy 1, policy_version 1122259 (0.0007) [2023-12-28 03:18:11,384][106225] Updated weights for policy 1, policy_version 1122269 (0.0008) [2023-12-28 03:18:11,455][106225] Updated weights for policy 1, policy_version 1122279 (0.0008) [2023-12-28 03:18:11,677][106226] Updated weights for policy 0, policy_version 1119359 (0.0009) [2023-12-28 03:18:11,747][106226] Updated weights for policy 0, policy_version 1119369 (0.0008) [2023-12-28 03:18:11,820][106226] Updated weights for policy 0, policy_version 1119379 (0.0007) [2023-12-28 03:18:12,181][106225] Updated weights for policy 1, policy_version 1122289 (0.0009) [2023-12-28 03:18:12,251][106225] Updated weights for policy 1, policy_version 1122299 (0.0006) [2023-12-28 03:18:12,318][106225] Updated weights for policy 1, policy_version 1122309 (0.0009) [2023-12-28 03:18:12,390][106225] Updated weights for policy 1, policy_version 1122319 (0.0008) [2023-12-28 03:18:12,542][106226] Updated weights for policy 0, policy_version 1119389 (0.0009) [2023-12-28 03:18:12,606][106226] Updated weights for policy 0, policy_version 1119399 (0.0009) [2023-12-28 03:18:12,669][106226] Updated weights for policy 0, policy_version 1119409 (0.0008) [2023-12-28 03:18:13,134][106225] Updated weights for policy 1, policy_version 1122329 (0.0008) [2023-12-28 03:18:13,184][106225] Updated weights for policy 1, policy_version 1122339 (0.0008) [2023-12-28 03:18:13,233][106225] Updated weights for policy 1, policy_version 1122349 (0.0008) [2023-12-28 03:18:13,251][106226] Updated weights for policy 0, policy_version 1119419 (0.0009) [2023-12-28 03:18:13,309][106226] Updated weights for policy 0, policy_version 1119429 (0.0008) [2023-12-28 03:18:13,371][106226] Updated weights for policy 0, policy_version 1119439 (0.0009) [2023-12-28 03:18:13,988][106225] Updated weights for policy 1, policy_version 1122359 (0.0008) [2023-12-28 03:18:14,027][106226] Updated weights for policy 0, policy_version 1119449 (0.0008) [2023-12-28 03:18:14,040][106225] Updated weights for policy 1, policy_version 1122369 (0.0010) [2023-12-28 03:18:14,081][106226] Updated weights for policy 0, policy_version 1119459 (0.0006) [2023-12-28 03:18:14,095][106225] Updated weights for policy 1, policy_version 1122379 (0.0007) [2023-12-28 03:18:14,144][106226] Updated weights for policy 0, policy_version 1119469 (0.0009) [2023-12-28 03:18:14,207][106226] Updated weights for policy 0, policy_version 1119479 (0.0009) [2023-12-28 03:18:14,789][106225] Updated weights for policy 1, policy_version 1122389 (0.0007) [2023-12-28 03:18:14,856][106225] Updated weights for policy 1, policy_version 1122399 (0.0007) [2023-12-28 03:18:14,915][106225] Updated weights for policy 1, policy_version 1122409 (0.0007) [2023-12-28 03:18:14,948][106226] Updated weights for policy 0, policy_version 1119489 (0.0009) [2023-12-28 03:18:15,021][106226] Updated weights for policy 0, policy_version 1119499 (0.0009) [2023-12-28 03:18:15,091][106226] Updated weights for policy 0, policy_version 1119509 (0.0009) [2023-12-28 03:18:15,512][106225] Updated weights for policy 1, policy_version 1122419 (0.0006) [2023-12-28 03:18:15,572][106225] Updated weights for policy 1, policy_version 1122429 (0.0006) [2023-12-28 03:18:15,632][106225] Updated weights for policy 1, policy_version 1122439 (0.0005) [2023-12-28 03:18:15,874][106226] Updated weights for policy 0, policy_version 1119519 (0.0010) [2023-12-28 03:18:15,944][106226] Updated weights for policy 0, policy_version 1119529 (0.0011) [2023-12-28 03:18:16,001][106226] Updated weights for policy 0, policy_version 1119539 (0.0011) [2023-12-28 03:18:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 574054400. Throughput: 0: 9657.5, 1: 9988.7. Samples: 574042060. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:16,176][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.864')] [2023-12-28 03:18:16,293][106225] Updated weights for policy 1, policy_version 1122449 (0.0009) [2023-12-28 03:18:16,355][106225] Updated weights for policy 1, policy_version 1122459 (0.0008) [2023-12-28 03:18:16,409][106225] Updated weights for policy 1, policy_version 1122469 (0.0005) [2023-12-28 03:18:16,460][106225] Updated weights for policy 1, policy_version 1122479 (0.0005) [2023-12-28 03:18:16,566][106226] Updated weights for policy 0, policy_version 1119549 (0.0008) [2023-12-28 03:18:16,631][106226] Updated weights for policy 0, policy_version 1119559 (0.0005) [2023-12-28 03:18:16,685][106226] Updated weights for policy 0, policy_version 1119569 (0.0005) [2023-12-28 03:18:17,144][106225] Updated weights for policy 1, policy_version 1122489 (0.0010) [2023-12-28 03:18:17,197][106225] Updated weights for policy 1, policy_version 1122499 (0.0010) [2023-12-28 03:18:17,243][106225] Updated weights for policy 1, policy_version 1122509 (0.0010) [2023-12-28 03:18:17,318][106226] Updated weights for policy 0, policy_version 1119579 (0.0006) [2023-12-28 03:18:17,376][106226] Updated weights for policy 0, policy_version 1119589 (0.0008) [2023-12-28 03:18:17,431][106226] Updated weights for policy 0, policy_version 1119599 (0.0008) [2023-12-28 03:18:17,914][106225] Updated weights for policy 1, policy_version 1122519 (0.0007) [2023-12-28 03:18:17,972][106225] Updated weights for policy 1, policy_version 1122529 (0.0005) [2023-12-28 03:18:18,031][106225] Updated weights for policy 1, policy_version 1122539 (0.0010) [2023-12-28 03:18:18,114][106226] Updated weights for policy 0, policy_version 1119609 (0.0008) [2023-12-28 03:18:18,171][106226] Updated weights for policy 0, policy_version 1119619 (0.0008) [2023-12-28 03:18:18,232][106226] Updated weights for policy 0, policy_version 1119629 (0.0008) [2023-12-28 03:18:18,285][106226] Updated weights for policy 0, policy_version 1119639 (0.0008) [2023-12-28 03:18:18,681][106225] Updated weights for policy 1, policy_version 1122549 (0.0008) [2023-12-28 03:18:18,735][106225] Updated weights for policy 1, policy_version 1122559 (0.0006) [2023-12-28 03:18:18,791][106225] Updated weights for policy 1, policy_version 1122569 (0.0010) [2023-12-28 03:18:19,021][106226] Updated weights for policy 0, policy_version 1119649 (0.0009) [2023-12-28 03:18:19,086][106226] Updated weights for policy 0, policy_version 1119659 (0.0009) [2023-12-28 03:18:19,147][106226] Updated weights for policy 0, policy_version 1119669 (0.0008) [2023-12-28 03:18:19,434][106225] Updated weights for policy 1, policy_version 1122579 (0.0010) [2023-12-28 03:18:19,497][106225] Updated weights for policy 1, policy_version 1122589 (0.0010) [2023-12-28 03:18:19,560][106225] Updated weights for policy 1, policy_version 1122599 (0.0010) [2023-12-28 03:18:19,904][106226] Updated weights for policy 0, policy_version 1119679 (0.0008) [2023-12-28 03:18:19,971][106226] Updated weights for policy 0, policy_version 1119689 (0.0008) [2023-12-28 03:18:20,035][106226] Updated weights for policy 0, policy_version 1119699 (0.0008) [2023-12-28 03:18:20,283][106225] Updated weights for policy 1, policy_version 1122609 (0.0010) [2023-12-28 03:18:20,346][106225] Updated weights for policy 1, policy_version 1122619 (0.0006) [2023-12-28 03:18:20,410][106225] Updated weights for policy 1, policy_version 1122629 (0.0006) [2023-12-28 03:18:20,466][106225] Updated weights for policy 1, policy_version 1122639 (0.0005) [2023-12-28 03:18:20,856][106226] Updated weights for policy 0, policy_version 1119709 (0.0008) [2023-12-28 03:18:20,922][106226] Updated weights for policy 0, policy_version 1119719 (0.0010) [2023-12-28 03:18:20,979][106226] Updated weights for policy 0, policy_version 1119729 (0.0008) [2023-12-28 03:18:21,095][106225] Updated weights for policy 1, policy_version 1122649 (0.0008) [2023-12-28 03:18:21,164][106225] Updated weights for policy 1, policy_version 1122659 (0.0008) [2023-12-28 03:18:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 574152704. Throughput: 0: 9655.2, 1: 10087.5. Samples: 574162352. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:21,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-4.906')] [2023-12-28 03:18:21,223][106225] Updated weights for policy 1, policy_version 1122669 (0.0010) [2023-12-28 03:18:21,766][106226] Updated weights for policy 0, policy_version 1119739 (0.0008) [2023-12-28 03:18:21,830][106226] Updated weights for policy 0, policy_version 1119749 (0.0010) [2023-12-28 03:18:21,896][106226] Updated weights for policy 0, policy_version 1119759 (0.0009) [2023-12-28 03:18:22,025][106225] Updated weights for policy 1, policy_version 1122679 (0.0010) [2023-12-28 03:18:22,100][106225] Updated weights for policy 1, policy_version 1122689 (0.0008) [2023-12-28 03:18:22,162][106225] Updated weights for policy 1, policy_version 1122699 (0.0009) [2023-12-28 03:18:22,548][106226] Updated weights for policy 0, policy_version 1119769 (0.0005) [2023-12-28 03:18:22,602][106226] Updated weights for policy 0, policy_version 1119779 (0.0008) [2023-12-28 03:18:22,667][106226] Updated weights for policy 0, policy_version 1119789 (0.0008) [2023-12-28 03:18:22,716][106226] Updated weights for policy 0, policy_version 1119799 (0.0008) [2023-12-28 03:18:22,938][106225] Updated weights for policy 1, policy_version 1122709 (0.0008) [2023-12-28 03:18:22,993][106225] Updated weights for policy 1, policy_version 1122719 (0.0005) [2023-12-28 03:18:23,049][106225] Updated weights for policy 1, policy_version 1122729 (0.0005) [2023-12-28 03:18:23,506][106226] Updated weights for policy 0, policy_version 1119809 (0.0008) [2023-12-28 03:18:23,569][106226] Updated weights for policy 0, policy_version 1119819 (0.0009) [2023-12-28 03:18:23,584][106225] Updated weights for policy 1, policy_version 1122739 (0.0006) [2023-12-28 03:18:23,619][106226] Updated weights for policy 0, policy_version 1119829 (0.0007) [2023-12-28 03:18:23,644][106225] Updated weights for policy 1, policy_version 1122749 (0.0008) [2023-12-28 03:18:23,696][106225] Updated weights for policy 1, policy_version 1122759 (0.0008) [2023-12-28 03:18:24,325][106226] Updated weights for policy 0, policy_version 1119839 (0.0009) [2023-12-28 03:18:24,383][106226] Updated weights for policy 0, policy_version 1119849 (0.0008) [2023-12-28 03:18:24,434][106226] Updated weights for policy 0, policy_version 1119859 (0.0008) [2023-12-28 03:18:24,448][106225] Updated weights for policy 1, policy_version 1122769 (0.0008) [2023-12-28 03:18:24,506][106225] Updated weights for policy 1, policy_version 1122779 (0.0005) [2023-12-28 03:18:24,563][106225] Updated weights for policy 1, policy_version 1122789 (0.0005) [2023-12-28 03:18:24,614][106225] Updated weights for policy 1, policy_version 1122799 (0.0005) [2023-12-28 03:18:25,165][106226] Updated weights for policy 0, policy_version 1119869 (0.0008) [2023-12-28 03:18:25,225][106226] Updated weights for policy 0, policy_version 1119879 (0.0010) [2023-12-28 03:18:25,235][106225] Updated weights for policy 1, policy_version 1122809 (0.0010) [2023-12-28 03:18:25,279][106226] Updated weights for policy 0, policy_version 1119889 (0.0007) [2023-12-28 03:18:25,288][106225] Updated weights for policy 1, policy_version 1122819 (0.0007) [2023-12-28 03:18:25,340][106225] Updated weights for policy 1, policy_version 1122829 (0.0005) [2023-12-28 03:18:25,969][106226] Updated weights for policy 0, policy_version 1119899 (0.0007) [2023-12-28 03:18:25,996][106225] Updated weights for policy 1, policy_version 1122839 (0.0005) [2023-12-28 03:18:26,017][106226] Updated weights for policy 0, policy_version 1119909 (0.0011) [2023-12-28 03:18:26,057][106225] Updated weights for policy 1, policy_version 1122849 (0.0008) [2023-12-28 03:18:26,068][106226] Updated weights for policy 0, policy_version 1119919 (0.0010) [2023-12-28 03:18:26,117][106225] Updated weights for policy 1, policy_version 1122859 (0.0010) [2023-12-28 03:18:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 574259200. Throughput: 0: 9668.8, 1: 10080.6. Samples: 574220724. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:26,176][105115] Avg episode reward: [(0, '-4.728'), (1, '-4.792')] [2023-12-28 03:18:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001122864_287498240.pth... [2023-12-28 03:18:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001119928_286760960.pth... [2023-12-28 03:18:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001118776_286466048.pth [2023-12-28 03:18:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001121680_287195136.pth [2023-12-28 03:18:26,729][106225] Updated weights for policy 1, policy_version 1122869 (0.0008) [2023-12-28 03:18:26,786][106225] Updated weights for policy 1, policy_version 1122879 (0.0006) [2023-12-28 03:18:26,800][106226] Updated weights for policy 0, policy_version 1119929 (0.0010) [2023-12-28 03:18:26,840][106225] Updated weights for policy 1, policy_version 1122889 (0.0007) [2023-12-28 03:18:26,857][106226] Updated weights for policy 0, policy_version 1119939 (0.0010) [2023-12-28 03:18:26,911][106226] Updated weights for policy 0, policy_version 1119949 (0.0010) [2023-12-28 03:18:26,970][106226] Updated weights for policy 0, policy_version 1119959 (0.0010) [2023-12-28 03:18:27,441][106225] Updated weights for policy 1, policy_version 1122899 (0.0008) [2023-12-28 03:18:27,501][106225] Updated weights for policy 1, policy_version 1122909 (0.0007) [2023-12-28 03:18:27,561][106225] Updated weights for policy 1, policy_version 1122919 (0.0007) [2023-12-28 03:18:27,589][106226] Updated weights for policy 0, policy_version 1119969 (0.0011) [2023-12-28 03:18:27,635][106226] Updated weights for policy 0, policy_version 1119979 (0.0010) [2023-12-28 03:18:27,695][106226] Updated weights for policy 0, policy_version 1119989 (0.0010) [2023-12-28 03:18:28,174][106225] Updated weights for policy 1, policy_version 1122929 (0.0006) [2023-12-28 03:18:28,223][106225] Updated weights for policy 1, policy_version 1122939 (0.0006) [2023-12-28 03:18:28,270][106225] Updated weights for policy 1, policy_version 1122949 (0.0006) [2023-12-28 03:18:28,333][106225] Updated weights for policy 1, policy_version 1122959 (0.0010) [2023-12-28 03:18:28,407][106226] Updated weights for policy 0, policy_version 1119999 (0.0007) [2023-12-28 03:18:28,474][106226] Updated weights for policy 0, policy_version 1120009 (0.0010) [2023-12-28 03:18:28,536][106226] Updated weights for policy 0, policy_version 1120019 (0.0011) [2023-12-28 03:18:29,077][106225] Updated weights for policy 1, policy_version 1122969 (0.0007) [2023-12-28 03:18:29,128][106225] Updated weights for policy 1, policy_version 1122979 (0.0007) [2023-12-28 03:18:29,174][106225] Updated weights for policy 1, policy_version 1122989 (0.0008) [2023-12-28 03:18:29,183][106226] Updated weights for policy 0, policy_version 1120029 (0.0009) [2023-12-28 03:18:29,253][106226] Updated weights for policy 0, policy_version 1120039 (0.0011) [2023-12-28 03:18:29,316][106226] Updated weights for policy 0, policy_version 1120049 (0.0011) [2023-12-28 03:18:29,914][106225] Updated weights for policy 1, policy_version 1122999 (0.0006) [2023-12-28 03:18:29,976][106225] Updated weights for policy 1, policy_version 1123009 (0.0008) [2023-12-28 03:18:30,004][106226] Updated weights for policy 0, policy_version 1120059 (0.0010) [2023-12-28 03:18:30,034][106225] Updated weights for policy 1, policy_version 1123019 (0.0006) [2023-12-28 03:18:30,066][106226] Updated weights for policy 0, policy_version 1120069 (0.0009) [2023-12-28 03:18:30,130][106226] Updated weights for policy 0, policy_version 1120079 (0.0006) [2023-12-28 03:18:30,693][106225] Updated weights for policy 1, policy_version 1123029 (0.0007) [2023-12-28 03:18:30,703][106226] Updated weights for policy 0, policy_version 1120089 (0.0006) [2023-12-28 03:18:30,741][106225] Updated weights for policy 1, policy_version 1123039 (0.0008) [2023-12-28 03:18:30,756][106226] Updated weights for policy 0, policy_version 1120099 (0.0009) [2023-12-28 03:18:30,789][106225] Updated weights for policy 1, policy_version 1123049 (0.0008) [2023-12-28 03:18:30,812][106226] Updated weights for policy 0, policy_version 1120109 (0.0006) [2023-12-28 03:18:30,875][106226] Updated weights for policy 0, policy_version 1120119 (0.0007) [2023-12-28 03:18:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 574357504. Throughput: 0: 9755.1, 1: 10146.6. Samples: 574342976. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:31,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.616')] [2023-12-28 03:18:31,531][106226] Updated weights for policy 0, policy_version 1120129 (0.0005) [2023-12-28 03:18:31,590][106225] Updated weights for policy 1, policy_version 1123059 (0.0008) [2023-12-28 03:18:31,592][106226] Updated weights for policy 0, policy_version 1120139 (0.0006) [2023-12-28 03:18:31,648][106225] Updated weights for policy 1, policy_version 1123069 (0.0007) [2023-12-28 03:18:31,659][106226] Updated weights for policy 0, policy_version 1120149 (0.0007) [2023-12-28 03:18:31,701][106225] Updated weights for policy 1, policy_version 1123079 (0.0008) [2023-12-28 03:18:32,339][106226] Updated weights for policy 0, policy_version 1120159 (0.0006) [2023-12-28 03:18:32,405][106226] Updated weights for policy 0, policy_version 1120169 (0.0007) [2023-12-28 03:18:32,463][106225] Updated weights for policy 1, policy_version 1123089 (0.0009) [2023-12-28 03:18:32,465][106226] Updated weights for policy 0, policy_version 1120179 (0.0008) [2023-12-28 03:18:32,519][106225] Updated weights for policy 1, policy_version 1123099 (0.0007) [2023-12-28 03:18:32,565][106225] Updated weights for policy 1, policy_version 1123109 (0.0009) [2023-12-28 03:18:32,621][106225] Updated weights for policy 1, policy_version 1123119 (0.0008) [2023-12-28 03:18:33,149][106226] Updated weights for policy 0, policy_version 1120189 (0.0006) [2023-12-28 03:18:33,194][106226] Updated weights for policy 0, policy_version 1120199 (0.0005) [2023-12-28 03:18:33,241][106226] Updated weights for policy 0, policy_version 1120209 (0.0007) [2023-12-28 03:18:33,388][106225] Updated weights for policy 1, policy_version 1123129 (0.0009) [2023-12-28 03:18:33,437][106225] Updated weights for policy 1, policy_version 1123139 (0.0009) [2023-12-28 03:18:33,486][106225] Updated weights for policy 1, policy_version 1123149 (0.0008) [2023-12-28 03:18:33,769][106226] Updated weights for policy 0, policy_version 1120219 (0.0007) [2023-12-28 03:18:33,817][106226] Updated weights for policy 0, policy_version 1120229 (0.0005) [2023-12-28 03:18:33,879][106226] Updated weights for policy 0, policy_version 1120239 (0.0008) [2023-12-28 03:18:34,289][106225] Updated weights for policy 1, policy_version 1123159 (0.0008) [2023-12-28 03:18:34,353][106225] Updated weights for policy 1, policy_version 1123169 (0.0005) [2023-12-28 03:18:34,424][106225] Updated weights for policy 1, policy_version 1123179 (0.0007) [2023-12-28 03:18:34,486][106226] Updated weights for policy 0, policy_version 1120249 (0.0007) [2023-12-28 03:18:34,548][106226] Updated weights for policy 0, policy_version 1120259 (0.0008) [2023-12-28 03:18:34,607][106226] Updated weights for policy 0, policy_version 1120269 (0.0009) [2023-12-28 03:18:34,657][106226] Updated weights for policy 0, policy_version 1120279 (0.0008) [2023-12-28 03:18:34,988][106225] Updated weights for policy 1, policy_version 1123189 (0.0006) [2023-12-28 03:18:35,045][106225] Updated weights for policy 1, policy_version 1123199 (0.0005) [2023-12-28 03:18:35,111][106225] Updated weights for policy 1, policy_version 1123209 (0.0009) [2023-12-28 03:18:35,456][106226] Updated weights for policy 0, policy_version 1120289 (0.0007) [2023-12-28 03:18:35,517][106226] Updated weights for policy 0, policy_version 1120299 (0.0008) [2023-12-28 03:18:35,586][106226] Updated weights for policy 0, policy_version 1120309 (0.0007) [2023-12-28 03:18:35,687][106225] Updated weights for policy 1, policy_version 1123219 (0.0010) [2023-12-28 03:18:35,748][106225] Updated weights for policy 1, policy_version 1123229 (0.0010) [2023-12-28 03:18:35,807][106225] Updated weights for policy 1, policy_version 1123239 (0.0008) [2023-12-28 03:18:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 574455808. Throughput: 0: 9889.0, 1: 10144.7. Samples: 574465128. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:36,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.474')] [2023-12-28 03:18:36,350][106226] Updated weights for policy 0, policy_version 1120319 (0.0008) [2023-12-28 03:18:36,405][106226] Updated weights for policy 0, policy_version 1120329 (0.0008) [2023-12-28 03:18:36,461][106226] Updated weights for policy 0, policy_version 1120339 (0.0008) [2023-12-28 03:18:36,526][106225] Updated weights for policy 1, policy_version 1123249 (0.0007) [2023-12-28 03:18:36,589][106225] Updated weights for policy 1, policy_version 1123259 (0.0010) [2023-12-28 03:18:36,655][106225] Updated weights for policy 1, policy_version 1123269 (0.0010) [2023-12-28 03:18:36,711][106225] Updated weights for policy 1, policy_version 1123279 (0.0011) [2023-12-28 03:18:37,227][106226] Updated weights for policy 0, policy_version 1120349 (0.0009) [2023-12-28 03:18:37,293][106226] Updated weights for policy 0, policy_version 1120359 (0.0011) [2023-12-28 03:18:37,333][106225] Updated weights for policy 1, policy_version 1123289 (0.0008) [2023-12-28 03:18:37,355][106226] Updated weights for policy 0, policy_version 1120369 (0.0011) [2023-12-28 03:18:37,388][106225] Updated weights for policy 1, policy_version 1123299 (0.0005) [2023-12-28 03:18:37,452][106225] Updated weights for policy 1, policy_version 1123309 (0.0009) [2023-12-28 03:18:38,006][106226] Updated weights for policy 0, policy_version 1120379 (0.0011) [2023-12-28 03:18:38,057][106226] Updated weights for policy 0, policy_version 1120389 (0.0010) [2023-12-28 03:18:38,059][106225] Updated weights for policy 1, policy_version 1123319 (0.0007) [2023-12-28 03:18:38,112][106226] Updated weights for policy 0, policy_version 1120399 (0.0010) [2023-12-28 03:18:38,119][106225] Updated weights for policy 1, policy_version 1123329 (0.0005) [2023-12-28 03:18:38,173][106225] Updated weights for policy 1, policy_version 1123339 (0.0005) [2023-12-28 03:18:38,864][106226] Updated weights for policy 0, policy_version 1120409 (0.0011) [2023-12-28 03:18:38,869][106225] Updated weights for policy 1, policy_version 1123349 (0.0010) [2023-12-28 03:18:38,932][106226] Updated weights for policy 0, policy_version 1120419 (0.0007) [2023-12-28 03:18:38,933][106225] Updated weights for policy 1, policy_version 1123359 (0.0006) [2023-12-28 03:18:38,990][106225] Updated weights for policy 1, policy_version 1123369 (0.0007) [2023-12-28 03:18:39,003][106226] Updated weights for policy 0, policy_version 1120429 (0.0007) [2023-12-28 03:18:39,068][106226] Updated weights for policy 0, policy_version 1120439 (0.0011) [2023-12-28 03:18:39,711][106225] Updated weights for policy 1, policy_version 1123379 (0.0007) [2023-12-28 03:18:39,744][106226] Updated weights for policy 0, policy_version 1120449 (0.0009) [2023-12-28 03:18:39,776][106225] Updated weights for policy 1, policy_version 1123389 (0.0010) [2023-12-28 03:18:39,803][106226] Updated weights for policy 0, policy_version 1120459 (0.0011) [2023-12-28 03:18:39,839][106225] Updated weights for policy 1, policy_version 1123399 (0.0010) [2023-12-28 03:18:39,872][106226] Updated weights for policy 0, policy_version 1120469 (0.0011) [2023-12-28 03:18:40,512][106225] Updated weights for policy 1, policy_version 1123409 (0.0010) [2023-12-28 03:18:40,575][106225] Updated weights for policy 1, policy_version 1123419 (0.0010) [2023-12-28 03:18:40,637][106225] Updated weights for policy 1, policy_version 1123429 (0.0007) [2023-12-28 03:18:40,643][106226] Updated weights for policy 0, policy_version 1120479 (0.0010) [2023-12-28 03:18:40,691][106225] Updated weights for policy 1, policy_version 1123439 (0.0006) [2023-12-28 03:18:40,701][106226] Updated weights for policy 0, policy_version 1120489 (0.0010) [2023-12-28 03:18:40,765][106226] Updated weights for policy 0, policy_version 1120499 (0.0010) [2023-12-28 03:18:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 574554112. Throughput: 0: 9915.5, 1: 10166.5. Samples: 574524960. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:41,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.950')] [2023-12-28 03:18:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001123440_287645696.pth... [2023-12-28 03:18:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001120504_286908416.pth... [2023-12-28 03:18:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001122256_287342592.pth [2023-12-28 03:18:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001119352_286613504.pth [2023-12-28 03:18:41,391][106225] Updated weights for policy 1, policy_version 1123449 (0.0008) [2023-12-28 03:18:41,460][106225] Updated weights for policy 1, policy_version 1123459 (0.0009) [2023-12-28 03:18:41,521][106225] Updated weights for policy 1, policy_version 1123469 (0.0008) [2023-12-28 03:18:41,557][106226] Updated weights for policy 0, policy_version 1120509 (0.0009) [2023-12-28 03:18:41,617][106226] Updated weights for policy 0, policy_version 1120519 (0.0010) [2023-12-28 03:18:41,685][106226] Updated weights for policy 0, policy_version 1120529 (0.0010) [2023-12-28 03:18:42,246][106225] Updated weights for policy 1, policy_version 1123479 (0.0007) [2023-12-28 03:18:42,314][106225] Updated weights for policy 1, policy_version 1123489 (0.0007) [2023-12-28 03:18:42,382][106225] Updated weights for policy 1, policy_version 1123499 (0.0008) [2023-12-28 03:18:42,444][106226] Updated weights for policy 0, policy_version 1120539 (0.0009) [2023-12-28 03:18:42,501][106226] Updated weights for policy 0, policy_version 1120549 (0.0008) [2023-12-28 03:18:42,549][106226] Updated weights for policy 0, policy_version 1120559 (0.0008) [2023-12-28 03:18:43,110][106225] Updated weights for policy 1, policy_version 1123509 (0.0008) [2023-12-28 03:18:43,171][106225] Updated weights for policy 1, policy_version 1123519 (0.0010) [2023-12-28 03:18:43,216][106226] Updated weights for policy 0, policy_version 1120569 (0.0008) [2023-12-28 03:18:43,236][106225] Updated weights for policy 1, policy_version 1123529 (0.0010) [2023-12-28 03:18:43,283][106226] Updated weights for policy 0, policy_version 1120579 (0.0005) [2023-12-28 03:18:43,340][106226] Updated weights for policy 0, policy_version 1120589 (0.0005) [2023-12-28 03:18:43,389][106226] Updated weights for policy 0, policy_version 1120599 (0.0005) [2023-12-28 03:18:43,901][106226] Updated weights for policy 0, policy_version 1120609 (0.0005) [2023-12-28 03:18:43,958][106226] Updated weights for policy 0, policy_version 1120619 (0.0005) [2023-12-28 03:18:44,014][106226] Updated weights for policy 0, policy_version 1120629 (0.0005) [2023-12-28 03:18:44,074][106225] Updated weights for policy 1, policy_version 1123539 (0.0009) [2023-12-28 03:18:44,129][106225] Updated weights for policy 1, policy_version 1123549 (0.0008) [2023-12-28 03:18:44,182][106225] Updated weights for policy 1, policy_version 1123559 (0.0008) [2023-12-28 03:18:44,645][106226] Updated weights for policy 0, policy_version 1120639 (0.0005) [2023-12-28 03:18:44,710][106226] Updated weights for policy 0, policy_version 1120649 (0.0005) [2023-12-28 03:18:44,787][106226] Updated weights for policy 0, policy_version 1120659 (0.0006) [2023-12-28 03:18:44,927][106225] Updated weights for policy 1, policy_version 1123569 (0.0008) [2023-12-28 03:18:44,996][106225] Updated weights for policy 1, policy_version 1123579 (0.0011) [2023-12-28 03:18:45,065][106225] Updated weights for policy 1, policy_version 1123589 (0.0011) [2023-12-28 03:18:45,127][106225] Updated weights for policy 1, policy_version 1123599 (0.0010) [2023-12-28 03:18:45,407][106226] Updated weights for policy 0, policy_version 1120669 (0.0008) [2023-12-28 03:18:45,472][106226] Updated weights for policy 0, policy_version 1120679 (0.0009) [2023-12-28 03:18:45,530][106226] Updated weights for policy 0, policy_version 1120689 (0.0010) [2023-12-28 03:18:45,830][106225] Updated weights for policy 1, policy_version 1123609 (0.0010) [2023-12-28 03:18:45,886][106225] Updated weights for policy 1, policy_version 1123619 (0.0010) [2023-12-28 03:18:45,944][106225] Updated weights for policy 1, policy_version 1123629 (0.0010) [2023-12-28 03:18:46,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 574652416. Throughput: 0: 9915.0, 1: 10024.6. Samples: 574642312. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:46,175][105115] Avg episode reward: [(0, '-4.975'), (1, '-4.967')] [2023-12-28 03:18:46,205][106226] Updated weights for policy 0, policy_version 1120699 (0.0011) [2023-12-28 03:18:46,265][106226] Updated weights for policy 0, policy_version 1120709 (0.0011) [2023-12-28 03:18:46,322][106226] Updated weights for policy 0, policy_version 1120719 (0.0011) [2023-12-28 03:18:46,632][106225] Updated weights for policy 1, policy_version 1123639 (0.0008) [2023-12-28 03:18:46,687][106225] Updated weights for policy 1, policy_version 1123649 (0.0008) [2023-12-28 03:18:46,743][106225] Updated weights for policy 1, policy_version 1123659 (0.0007) [2023-12-28 03:18:46,992][106226] Updated weights for policy 0, policy_version 1120729 (0.0010) [2023-12-28 03:18:47,044][106226] Updated weights for policy 0, policy_version 1120739 (0.0005) [2023-12-28 03:18:47,106][106226] Updated weights for policy 0, policy_version 1120749 (0.0010) [2023-12-28 03:18:47,155][106226] Updated weights for policy 0, policy_version 1120759 (0.0010) [2023-12-28 03:18:47,464][106225] Updated weights for policy 1, policy_version 1123669 (0.0007) [2023-12-28 03:18:47,526][106225] Updated weights for policy 1, policy_version 1123679 (0.0007) [2023-12-28 03:18:47,589][106225] Updated weights for policy 1, policy_version 1123689 (0.0008) [2023-12-28 03:18:47,846][106226] Updated weights for policy 0, policy_version 1120769 (0.0006) [2023-12-28 03:18:47,895][106226] Updated weights for policy 0, policy_version 1120779 (0.0007) [2023-12-28 03:18:47,942][106226] Updated weights for policy 0, policy_version 1120789 (0.0010) [2023-12-28 03:18:48,320][106225] Updated weights for policy 1, policy_version 1123699 (0.0008) [2023-12-28 03:18:48,385][106225] Updated weights for policy 1, policy_version 1123709 (0.0009) [2023-12-28 03:18:48,447][106225] Updated weights for policy 1, policy_version 1123719 (0.0006) [2023-12-28 03:18:48,655][106226] Updated weights for policy 0, policy_version 1120799 (0.0009) [2023-12-28 03:18:48,720][106226] Updated weights for policy 0, policy_version 1120809 (0.0008) [2023-12-28 03:18:48,782][106226] Updated weights for policy 0, policy_version 1120819 (0.0008) [2023-12-28 03:18:49,139][106225] Updated weights for policy 1, policy_version 1123729 (0.0006) [2023-12-28 03:18:49,188][106225] Updated weights for policy 1, policy_version 1123739 (0.0010) [2023-12-28 03:18:49,257][106225] Updated weights for policy 1, policy_version 1123749 (0.0010) [2023-12-28 03:18:49,317][106225] Updated weights for policy 1, policy_version 1123759 (0.0009) [2023-12-28 03:18:49,534][106226] Updated weights for policy 0, policy_version 1120829 (0.0009) [2023-12-28 03:18:49,596][106226] Updated weights for policy 0, policy_version 1120839 (0.0008) [2023-12-28 03:18:49,660][106226] Updated weights for policy 0, policy_version 1120849 (0.0009) [2023-12-28 03:18:50,110][106225] Updated weights for policy 1, policy_version 1123769 (0.0008) [2023-12-28 03:18:50,162][106225] Updated weights for policy 1, policy_version 1123779 (0.0008) [2023-12-28 03:18:50,229][106225] Updated weights for policy 1, policy_version 1123789 (0.0009) [2023-12-28 03:18:50,382][106226] Updated weights for policy 0, policy_version 1120859 (0.0009) [2023-12-28 03:18:50,442][106226] Updated weights for policy 0, policy_version 1120869 (0.0009) [2023-12-28 03:18:50,496][106226] Updated weights for policy 0, policy_version 1120879 (0.0009) [2023-12-28 03:18:50,898][106225] Updated weights for policy 1, policy_version 1123799 (0.0008) [2023-12-28 03:18:50,965][106225] Updated weights for policy 1, policy_version 1123809 (0.0008) [2023-12-28 03:18:51,031][106225] Updated weights for policy 1, policy_version 1123819 (0.0008) [2023-12-28 03:18:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 574750720. Throughput: 0: 9913.8, 1: 9933.1. Samples: 574760204. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:51,176][105115] Avg episode reward: [(0, '-4.854'), (1, '-4.945')] [2023-12-28 03:18:51,193][106226] Updated weights for policy 0, policy_version 1120889 (0.0008) [2023-12-28 03:18:51,245][106226] Updated weights for policy 0, policy_version 1120899 (0.0008) [2023-12-28 03:18:51,306][106226] Updated weights for policy 0, policy_version 1120909 (0.0008) [2023-12-28 03:18:51,372][106226] Updated weights for policy 0, policy_version 1120919 (0.0008) [2023-12-28 03:18:51,789][106225] Updated weights for policy 1, policy_version 1123829 (0.0007) [2023-12-28 03:18:51,850][106225] Updated weights for policy 1, policy_version 1123839 (0.0005) [2023-12-28 03:18:51,908][106225] Updated weights for policy 1, policy_version 1123849 (0.0005) [2023-12-28 03:18:52,133][106226] Updated weights for policy 0, policy_version 1120929 (0.0008) [2023-12-28 03:18:52,186][106226] Updated weights for policy 0, policy_version 1120939 (0.0006) [2023-12-28 03:18:52,235][106226] Updated weights for policy 0, policy_version 1120949 (0.0009) [2023-12-28 03:18:52,561][106225] Updated weights for policy 1, policy_version 1123859 (0.0006) [2023-12-28 03:18:52,619][106225] Updated weights for policy 1, policy_version 1123869 (0.0010) [2023-12-28 03:18:52,665][106225] Updated weights for policy 1, policy_version 1123879 (0.0007) [2023-12-28 03:18:52,896][106226] Updated weights for policy 0, policy_version 1120959 (0.0008) [2023-12-28 03:18:52,947][106226] Updated weights for policy 0, policy_version 1120969 (0.0009) [2023-12-28 03:18:53,003][106226] Updated weights for policy 0, policy_version 1120979 (0.0008) [2023-12-28 03:18:53,321][106225] Updated weights for policy 1, policy_version 1123889 (0.0005) [2023-12-28 03:18:53,377][106225] Updated weights for policy 1, policy_version 1123899 (0.0005) [2023-12-28 03:18:53,427][106225] Updated weights for policy 1, policy_version 1123909 (0.0005) [2023-12-28 03:18:53,475][106225] Updated weights for policy 1, policy_version 1123919 (0.0005) [2023-12-28 03:18:53,777][106226] Updated weights for policy 0, policy_version 1120989 (0.0008) [2023-12-28 03:18:53,836][106226] Updated weights for policy 0, policy_version 1120999 (0.0007) [2023-12-28 03:18:53,896][106226] Updated weights for policy 0, policy_version 1121009 (0.0009) [2023-12-28 03:18:54,154][106225] Updated weights for policy 1, policy_version 1123929 (0.0007) [2023-12-28 03:18:54,220][106225] Updated weights for policy 1, policy_version 1123939 (0.0009) [2023-12-28 03:18:54,280][106225] Updated weights for policy 1, policy_version 1123949 (0.0009) [2023-12-28 03:18:54,559][106226] Updated weights for policy 0, policy_version 1121019 (0.0009) [2023-12-28 03:18:54,620][106226] Updated weights for policy 0, policy_version 1121029 (0.0009) [2023-12-28 03:18:54,675][106226] Updated weights for policy 0, policy_version 1121039 (0.0009) [2023-12-28 03:18:55,024][106225] Updated weights for policy 1, policy_version 1123959 (0.0009) [2023-12-28 03:18:55,076][106225] Updated weights for policy 1, policy_version 1123969 (0.0007) [2023-12-28 03:18:55,128][106225] Updated weights for policy 1, policy_version 1123979 (0.0005) [2023-12-28 03:18:55,335][106226] Updated weights for policy 0, policy_version 1121049 (0.0008) [2023-12-28 03:18:55,390][106226] Updated weights for policy 0, policy_version 1121059 (0.0005) [2023-12-28 03:18:55,446][106226] Updated weights for policy 0, policy_version 1121069 (0.0005) [2023-12-28 03:18:55,497][106226] Updated weights for policy 0, policy_version 1121079 (0.0005) [2023-12-28 03:18:55,748][106225] Updated weights for policy 1, policy_version 1123989 (0.0005) [2023-12-28 03:18:55,810][106225] Updated weights for policy 1, policy_version 1123999 (0.0007) [2023-12-28 03:18:55,871][106225] Updated weights for policy 1, policy_version 1124009 (0.0009) [2023-12-28 03:18:56,051][106226] Updated weights for policy 0, policy_version 1121089 (0.0005) [2023-12-28 03:18:56,105][106226] Updated weights for policy 0, policy_version 1121099 (0.0006) [2023-12-28 03:18:56,161][106226] Updated weights for policy 0, policy_version 1121109 (0.0006) [2023-12-28 03:18:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 574849024. Throughput: 0: 9899.8, 1: 9943.8. Samples: 574819652. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:18:56,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.795')] [2023-12-28 03:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001121112_287064064.pth... [2023-12-28 03:18:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001124016_287793152.pth... [2023-12-28 03:18:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001119928_286760960.pth [2023-12-28 03:18:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001122864_287498240.pth [2023-12-28 03:18:56,469][106225] Updated weights for policy 1, policy_version 1124019 (0.0008) [2023-12-28 03:18:56,524][106225] Updated weights for policy 1, policy_version 1124029 (0.0007) [2023-12-28 03:18:56,584][106225] Updated weights for policy 1, policy_version 1124039 (0.0009) [2023-12-28 03:18:56,808][106226] Updated weights for policy 0, policy_version 1121119 (0.0006) [2023-12-28 03:18:56,864][106226] Updated weights for policy 0, policy_version 1121129 (0.0005) [2023-12-28 03:18:56,919][106226] Updated weights for policy 0, policy_version 1121139 (0.0005) [2023-12-28 03:18:57,248][106225] Updated weights for policy 1, policy_version 1124049 (0.0006) [2023-12-28 03:18:57,304][106225] Updated weights for policy 1, policy_version 1124059 (0.0006) [2023-12-28 03:18:57,356][106225] Updated weights for policy 1, policy_version 1124069 (0.0009) [2023-12-28 03:18:57,409][106225] Updated weights for policy 1, policy_version 1124079 (0.0008) [2023-12-28 03:18:57,539][106226] Updated weights for policy 0, policy_version 1121149 (0.0007) [2023-12-28 03:18:57,593][106226] Updated weights for policy 0, policy_version 1121159 (0.0008) [2023-12-28 03:18:57,647][106226] Updated weights for policy 0, policy_version 1121169 (0.0006) [2023-12-28 03:18:58,008][106225] Updated weights for policy 1, policy_version 1124089 (0.0006) [2023-12-28 03:18:58,058][106225] Updated weights for policy 1, policy_version 1124099 (0.0008) [2023-12-28 03:18:58,111][106225] Updated weights for policy 1, policy_version 1124109 (0.0009) [2023-12-28 03:18:58,224][106226] Updated weights for policy 0, policy_version 1121179 (0.0006) [2023-12-28 03:18:58,286][106226] Updated weights for policy 0, policy_version 1121189 (0.0008) [2023-12-28 03:18:58,351][106226] Updated weights for policy 0, policy_version 1121199 (0.0008) [2023-12-28 03:18:58,887][106225] Updated weights for policy 1, policy_version 1124119 (0.0009) [2023-12-28 03:18:58,947][106225] Updated weights for policy 1, policy_version 1124129 (0.0007) [2023-12-28 03:18:59,015][106225] Updated weights for policy 1, policy_version 1124139 (0.0007) [2023-12-28 03:18:59,166][106226] Updated weights for policy 0, policy_version 1121209 (0.0008) [2023-12-28 03:18:59,226][106226] Updated weights for policy 0, policy_version 1121219 (0.0008) [2023-12-28 03:18:59,298][106226] Updated weights for policy 0, policy_version 1121229 (0.0008) [2023-12-28 03:18:59,367][106226] Updated weights for policy 0, policy_version 1121239 (0.0009) [2023-12-28 03:18:59,801][106225] Updated weights for policy 1, policy_version 1124149 (0.0008) [2023-12-28 03:18:59,867][106225] Updated weights for policy 1, policy_version 1124159 (0.0008) [2023-12-28 03:18:59,930][106225] Updated weights for policy 1, policy_version 1124169 (0.0009) [2023-12-28 03:19:00,097][106226] Updated weights for policy 0, policy_version 1121249 (0.0008) [2023-12-28 03:19:00,159][106226] Updated weights for policy 0, policy_version 1121259 (0.0008) [2023-12-28 03:19:00,223][106226] Updated weights for policy 0, policy_version 1121269 (0.0009) [2023-12-28 03:19:00,671][106225] Updated weights for policy 1, policy_version 1124179 (0.0008) [2023-12-28 03:19:00,721][106225] Updated weights for policy 1, policy_version 1124189 (0.0007) [2023-12-28 03:19:00,765][106225] Updated weights for policy 1, policy_version 1124199 (0.0009) [2023-12-28 03:19:00,908][106226] Updated weights for policy 0, policy_version 1121279 (0.0006) [2023-12-28 03:19:00,956][106226] Updated weights for policy 0, policy_version 1121289 (0.0005) [2023-12-28 03:19:01,016][106226] Updated weights for policy 0, policy_version 1121299 (0.0007) [2023-12-28 03:19:01,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 574955520. Throughput: 0: 10000.7, 1: 10009.2. Samples: 574942500. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:19:01,175][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.001')] [2023-12-28 03:19:01,535][106225] Updated weights for policy 1, policy_version 1124209 (0.0010) [2023-12-28 03:19:01,600][106225] Updated weights for policy 1, policy_version 1124219 (0.0011) [2023-12-28 03:19:01,668][106225] Updated weights for policy 1, policy_version 1124229 (0.0009) [2023-12-28 03:19:01,732][106225] Updated weights for policy 1, policy_version 1124239 (0.0009) [2023-12-28 03:19:01,761][106226] Updated weights for policy 0, policy_version 1121309 (0.0009) [2023-12-28 03:19:01,830][106226] Updated weights for policy 0, policy_version 1121319 (0.0007) [2023-12-28 03:19:01,902][106226] Updated weights for policy 0, policy_version 1121329 (0.0006) [2023-12-28 03:19:02,496][106225] Updated weights for policy 1, policy_version 1124249 (0.0006) [2023-12-28 03:19:02,551][106225] Updated weights for policy 1, policy_version 1124259 (0.0005) [2023-12-28 03:19:02,607][106225] Updated weights for policy 1, policy_version 1124269 (0.0010) [2023-12-28 03:19:02,633][106226] Updated weights for policy 0, policy_version 1121339 (0.0007) [2023-12-28 03:19:02,694][106226] Updated weights for policy 0, policy_version 1121349 (0.0008) [2023-12-28 03:19:02,757][106226] Updated weights for policy 0, policy_version 1121359 (0.0009) [2023-12-28 03:19:03,206][106225] Updated weights for policy 1, policy_version 1124279 (0.0010) [2023-12-28 03:19:03,269][106225] Updated weights for policy 1, policy_version 1124289 (0.0010) [2023-12-28 03:19:03,334][106225] Updated weights for policy 1, policy_version 1124299 (0.0010) [2023-12-28 03:19:03,372][106226] Updated weights for policy 0, policy_version 1121369 (0.0009) [2023-12-28 03:19:03,426][106226] Updated weights for policy 0, policy_version 1121379 (0.0007) [2023-12-28 03:19:03,475][106226] Updated weights for policy 0, policy_version 1121389 (0.0005) [2023-12-28 03:19:03,526][106226] Updated weights for policy 0, policy_version 1121399 (0.0005) [2023-12-28 03:19:04,024][106225] Updated weights for policy 1, policy_version 1124309 (0.0010) [2023-12-28 03:19:04,083][106225] Updated weights for policy 1, policy_version 1124319 (0.0010) [2023-12-28 03:19:04,142][106225] Updated weights for policy 1, policy_version 1124329 (0.0006) [2023-12-28 03:19:04,209][106226] Updated weights for policy 0, policy_version 1121409 (0.0010) [2023-12-28 03:19:04,268][106226] Updated weights for policy 0, policy_version 1121419 (0.0011) [2023-12-28 03:19:04,329][106226] Updated weights for policy 0, policy_version 1121429 (0.0011) [2023-12-28 03:19:04,750][106225] Updated weights for policy 1, policy_version 1124339 (0.0006) [2023-12-28 03:19:04,806][106225] Updated weights for policy 1, policy_version 1124349 (0.0006) [2023-12-28 03:19:04,861][106225] Updated weights for policy 1, policy_version 1124359 (0.0006) [2023-12-28 03:19:05,063][106226] Updated weights for policy 0, policy_version 1121439 (0.0010) [2023-12-28 03:19:05,121][106226] Updated weights for policy 0, policy_version 1121449 (0.0011) [2023-12-28 03:19:05,185][106226] Updated weights for policy 0, policy_version 1121459 (0.0008) [2023-12-28 03:19:05,479][106225] Updated weights for policy 1, policy_version 1124369 (0.0006) [2023-12-28 03:19:05,536][106225] Updated weights for policy 1, policy_version 1124379 (0.0007) [2023-12-28 03:19:05,581][106225] Updated weights for policy 1, policy_version 1124389 (0.0007) [2023-12-28 03:19:05,628][106225] Updated weights for policy 1, policy_version 1124399 (0.0008) [2023-12-28 03:19:05,901][106226] Updated weights for policy 0, policy_version 1121469 (0.0009) [2023-12-28 03:19:05,962][106226] Updated weights for policy 0, policy_version 1121479 (0.0011) [2023-12-28 03:19:06,028][106226] Updated weights for policy 0, policy_version 1121489 (0.0010) [2023-12-28 03:19:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 575053824. Throughput: 0: 10041.9, 1: 9957.8. Samples: 575062340. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-28 03:19:06,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.874')] [2023-12-28 03:19:06,362][106225] Updated weights for policy 1, policy_version 1124409 (0.0009) [2023-12-28 03:19:06,412][106225] Updated weights for policy 1, policy_version 1124419 (0.0008) [2023-12-28 03:19:06,475][106225] Updated weights for policy 1, policy_version 1124429 (0.0008) [2023-12-28 03:19:06,635][106226] Updated weights for policy 0, policy_version 1121499 (0.0009) [2023-12-28 03:19:06,695][106226] Updated weights for policy 0, policy_version 1121509 (0.0010) [2023-12-28 03:19:06,758][106226] Updated weights for policy 0, policy_version 1121519 (0.0006) [2023-12-28 03:19:07,184][106225] Updated weights for policy 1, policy_version 1124439 (0.0007) [2023-12-28 03:19:07,235][106225] Updated weights for policy 1, policy_version 1124449 (0.0007) [2023-12-28 03:19:07,296][106225] Updated weights for policy 1, policy_version 1124459 (0.0010) [2023-12-28 03:19:07,432][106226] Updated weights for policy 0, policy_version 1121529 (0.0006) [2023-12-28 03:19:07,498][106226] Updated weights for policy 0, policy_version 1121539 (0.0011) [2023-12-28 03:19:07,551][106226] Updated weights for policy 0, policy_version 1121549 (0.0010) [2023-12-28 03:19:07,601][106226] Updated weights for policy 0, policy_version 1121559 (0.0010) [2023-12-28 03:19:07,926][106225] Updated weights for policy 1, policy_version 1124469 (0.0008) [2023-12-28 03:19:07,985][106225] Updated weights for policy 1, policy_version 1124479 (0.0008) [2023-12-28 03:19:08,054][106225] Updated weights for policy 1, policy_version 1124489 (0.0009) [2023-12-28 03:19:08,213][106226] Updated weights for policy 0, policy_version 1121569 (0.0011) [2023-12-28 03:19:08,273][106226] Updated weights for policy 0, policy_version 1121579 (0.0010) [2023-12-28 03:19:08,329][106226] Updated weights for policy 0, policy_version 1121589 (0.0010) [2023-12-28 03:19:08,777][106225] Updated weights for policy 1, policy_version 1124499 (0.0010) [2023-12-28 03:19:08,844][106225] Updated weights for policy 1, policy_version 1124509 (0.0008) [2023-12-28 03:19:08,913][106225] Updated weights for policy 1, policy_version 1124519 (0.0009) [2023-12-28 03:19:09,001][106226] Updated weights for policy 0, policy_version 1121599 (0.0010) [2023-12-28 03:19:09,062][106226] Updated weights for policy 0, policy_version 1121609 (0.0010) [2023-12-28 03:19:09,124][106226] Updated weights for policy 0, policy_version 1121619 (0.0009) [2023-12-28 03:19:09,631][106225] Updated weights for policy 1, policy_version 1124529 (0.0010) [2023-12-28 03:19:09,702][106225] Updated weights for policy 1, policy_version 1124539 (0.0006) [2023-12-28 03:19:09,770][106225] Updated weights for policy 1, policy_version 1124549 (0.0009) [2023-12-28 03:19:09,828][106225] Updated weights for policy 1, policy_version 1124559 (0.0010) [2023-12-28 03:19:09,836][106226] Updated weights for policy 0, policy_version 1121629 (0.0008) [2023-12-28 03:19:09,910][106226] Updated weights for policy 0, policy_version 1121639 (0.0008) [2023-12-28 03:19:09,977][106226] Updated weights for policy 0, policy_version 1121649 (0.0009) [2023-12-28 03:19:10,551][106225] Updated weights for policy 1, policy_version 1124569 (0.0010) [2023-12-28 03:19:10,605][106225] Updated weights for policy 1, policy_version 1124579 (0.0010) [2023-12-28 03:19:10,646][106226] Updated weights for policy 0, policy_version 1121659 (0.0008) [2023-12-28 03:19:10,665][106225] Updated weights for policy 1, policy_version 1124589 (0.0007) [2023-12-28 03:19:10,705][106226] Updated weights for policy 0, policy_version 1121669 (0.0005) [2023-12-28 03:19:10,763][106226] Updated weights for policy 0, policy_version 1121679 (0.0007) [2023-12-28 03:19:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 575152128. Throughput: 0: 10099.3, 1: 9978.1. Samples: 575124204. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:11,175][105115] Avg episode reward: [(0, '-5.039'), (1, '-4.613')] [2023-12-28 03:19:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001124592_287940608.pth... [2023-12-28 03:19:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001121688_287211520.pth... [2023-12-28 03:19:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001123440_287645696.pth [2023-12-28 03:19:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001120504_286908416.pth [2023-12-28 03:19:11,414][106225] Updated weights for policy 1, policy_version 1124599 (0.0008) [2023-12-28 03:19:11,459][106226] Updated weights for policy 0, policy_version 1121689 (0.0007) [2023-12-28 03:19:11,477][106225] Updated weights for policy 1, policy_version 1124609 (0.0008) [2023-12-28 03:19:11,525][106226] Updated weights for policy 0, policy_version 1121699 (0.0006) [2023-12-28 03:19:11,538][106225] Updated weights for policy 1, policy_version 1124619 (0.0008) [2023-12-28 03:19:11,587][106226] Updated weights for policy 0, policy_version 1121709 (0.0006) [2023-12-28 03:19:11,654][106226] Updated weights for policy 0, policy_version 1121719 (0.0007) [2023-12-28 03:19:12,223][106225] Updated weights for policy 1, policy_version 1124629 (0.0006) [2023-12-28 03:19:12,288][106225] Updated weights for policy 1, policy_version 1124639 (0.0007) [2023-12-28 03:19:12,357][106225] Updated weights for policy 1, policy_version 1124649 (0.0009) [2023-12-28 03:19:12,376][106226] Updated weights for policy 0, policy_version 1121729 (0.0008) [2023-12-28 03:19:12,431][106226] Updated weights for policy 0, policy_version 1121739 (0.0007) [2023-12-28 03:19:12,494][106226] Updated weights for policy 0, policy_version 1121749 (0.0005) [2023-12-28 03:19:13,063][106225] Updated weights for policy 1, policy_version 1124659 (0.0009) [2023-12-28 03:19:13,119][106226] Updated weights for policy 0, policy_version 1121759 (0.0006) [2023-12-28 03:19:13,128][106225] Updated weights for policy 1, policy_version 1124669 (0.0011) [2023-12-28 03:19:13,178][106226] Updated weights for policy 0, policy_version 1121769 (0.0005) [2023-12-28 03:19:13,189][106225] Updated weights for policy 1, policy_version 1124679 (0.0010) [2023-12-28 03:19:13,237][106226] Updated weights for policy 0, policy_version 1121779 (0.0006) [2023-12-28 03:19:13,793][106225] Updated weights for policy 1, policy_version 1124689 (0.0010) [2023-12-28 03:19:13,820][106226] Updated weights for policy 0, policy_version 1121789 (0.0008) [2023-12-28 03:19:13,843][106225] Updated weights for policy 1, policy_version 1124699 (0.0005) [2023-12-28 03:19:13,873][106226] Updated weights for policy 0, policy_version 1121799 (0.0010) [2023-12-28 03:19:13,901][106225] Updated weights for policy 1, policy_version 1124709 (0.0009) [2023-12-28 03:19:13,933][106226] Updated weights for policy 0, policy_version 1121809 (0.0010) [2023-12-28 03:19:13,954][106225] Updated weights for policy 1, policy_version 1124719 (0.0010) [2023-12-28 03:19:14,550][106225] Updated weights for policy 1, policy_version 1124729 (0.0008) [2023-12-28 03:19:14,572][106226] Updated weights for policy 0, policy_version 1121819 (0.0009) [2023-12-28 03:19:14,604][106225] Updated weights for policy 1, policy_version 1124739 (0.0008) [2023-12-28 03:19:14,627][106226] Updated weights for policy 0, policy_version 1121829 (0.0007) [2023-12-28 03:19:14,660][106225] Updated weights for policy 1, policy_version 1124749 (0.0008) [2023-12-28 03:19:14,687][106226] Updated weights for policy 0, policy_version 1121839 (0.0006) [2023-12-28 03:19:15,381][106226] Updated weights for policy 0, policy_version 1121849 (0.0006) [2023-12-28 03:19:15,449][106226] Updated weights for policy 0, policy_version 1121859 (0.0011) [2023-12-28 03:19:15,451][106225] Updated weights for policy 1, policy_version 1124759 (0.0006) [2023-12-28 03:19:15,505][106226] Updated weights for policy 0, policy_version 1121869 (0.0010) [2023-12-28 03:19:15,506][106225] Updated weights for policy 1, policy_version 1124769 (0.0005) [2023-12-28 03:19:15,565][106226] Updated weights for policy 0, policy_version 1121879 (0.0011) [2023-12-28 03:19:15,567][106225] Updated weights for policy 1, policy_version 1124779 (0.0006) [2023-12-28 03:19:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 575250432. Throughput: 0: 10135.5, 1: 9911.2. Samples: 575245080. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:16,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.982')] [2023-12-28 03:19:16,234][106225] Updated weights for policy 1, policy_version 1124789 (0.0006) [2023-12-28 03:19:16,263][106226] Updated weights for policy 0, policy_version 1121889 (0.0010) [2023-12-28 03:19:16,296][106225] Updated weights for policy 1, policy_version 1124799 (0.0006) [2023-12-28 03:19:16,320][106226] Updated weights for policy 0, policy_version 1121899 (0.0008) [2023-12-28 03:19:16,351][106225] Updated weights for policy 1, policy_version 1124809 (0.0010) [2023-12-28 03:19:16,375][106226] Updated weights for policy 0, policy_version 1121909 (0.0011) [2023-12-28 03:19:17,003][106225] Updated weights for policy 1, policy_version 1124819 (0.0010) [2023-12-28 03:19:17,057][106225] Updated weights for policy 1, policy_version 1124829 (0.0010) [2023-12-28 03:19:17,101][106226] Updated weights for policy 0, policy_version 1121919 (0.0010) [2023-12-28 03:19:17,104][106225] Updated weights for policy 1, policy_version 1124839 (0.0010) [2023-12-28 03:19:17,155][106226] Updated weights for policy 0, policy_version 1121929 (0.0010) [2023-12-28 03:19:17,205][106226] Updated weights for policy 0, policy_version 1121939 (0.0010) [2023-12-28 03:19:17,844][106225] Updated weights for policy 1, policy_version 1124849 (0.0010) [2023-12-28 03:19:17,893][106225] Updated weights for policy 1, policy_version 1124859 (0.0010) [2023-12-28 03:19:17,939][106225] Updated weights for policy 1, policy_version 1124869 (0.0010) [2023-12-28 03:19:17,941][106226] Updated weights for policy 0, policy_version 1121949 (0.0008) [2023-12-28 03:19:17,985][106225] Updated weights for policy 1, policy_version 1124879 (0.0010) [2023-12-28 03:19:18,001][106226] Updated weights for policy 0, policy_version 1121959 (0.0009) [2023-12-28 03:19:18,055][106226] Updated weights for policy 0, policy_version 1121969 (0.0010) [2023-12-28 03:19:18,713][106226] Updated weights for policy 0, policy_version 1121979 (0.0009) [2023-12-28 03:19:18,732][106225] Updated weights for policy 1, policy_version 1124889 (0.0010) [2023-12-28 03:19:18,775][106226] Updated weights for policy 0, policy_version 1121989 (0.0008) [2023-12-28 03:19:18,798][106225] Updated weights for policy 1, policy_version 1124899 (0.0010) [2023-12-28 03:19:18,835][106226] Updated weights for policy 0, policy_version 1121999 (0.0007) [2023-12-28 03:19:18,852][106225] Updated weights for policy 1, policy_version 1124909 (0.0010) [2023-12-28 03:19:19,517][106225] Updated weights for policy 1, policy_version 1124919 (0.0011) [2023-12-28 03:19:19,562][106226] Updated weights for policy 0, policy_version 1122009 (0.0008) [2023-12-28 03:19:19,580][106225] Updated weights for policy 1, policy_version 1124929 (0.0008) [2023-12-28 03:19:19,632][106226] Updated weights for policy 0, policy_version 1122019 (0.0008) [2023-12-28 03:19:19,639][106225] Updated weights for policy 1, policy_version 1124939 (0.0007) [2023-12-28 03:19:19,691][106226] Updated weights for policy 0, policy_version 1122029 (0.0008) [2023-12-28 03:19:19,742][106226] Updated weights for policy 0, policy_version 1122039 (0.0008) [2023-12-28 03:19:20,360][106225] Updated weights for policy 1, policy_version 1124949 (0.0010) [2023-12-28 03:19:20,419][106225] Updated weights for policy 1, policy_version 1124959 (0.0011) [2023-12-28 03:19:20,478][106225] Updated weights for policy 1, policy_version 1124969 (0.0011) [2023-12-28 03:19:20,488][106226] Updated weights for policy 0, policy_version 1122049 (0.0006) [2023-12-28 03:19:20,548][106226] Updated weights for policy 0, policy_version 1122059 (0.0007) [2023-12-28 03:19:20,613][106226] Updated weights for policy 0, policy_version 1122069 (0.0009) [2023-12-28 03:19:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 575348736. Throughput: 0: 10017.7, 1: 9908.3. Samples: 575361804. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:21,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.049')] [2023-12-28 03:19:21,236][106225] Updated weights for policy 1, policy_version 1124979 (0.0010) [2023-12-28 03:19:21,297][106225] Updated weights for policy 1, policy_version 1124989 (0.0010) [2023-12-28 03:19:21,361][106225] Updated weights for policy 1, policy_version 1124999 (0.0011) [2023-12-28 03:19:21,416][106226] Updated weights for policy 0, policy_version 1122079 (0.0008) [2023-12-28 03:19:21,476][106226] Updated weights for policy 0, policy_version 1122089 (0.0007) [2023-12-28 03:19:21,534][106226] Updated weights for policy 0, policy_version 1122099 (0.0008) [2023-12-28 03:19:22,107][106225] Updated weights for policy 1, policy_version 1125009 (0.0010) [2023-12-28 03:19:22,164][106225] Updated weights for policy 1, policy_version 1125019 (0.0010) [2023-12-28 03:19:22,223][106225] Updated weights for policy 1, policy_version 1125029 (0.0010) [2023-12-28 03:19:22,278][106226] Updated weights for policy 0, policy_version 1122109 (0.0008) [2023-12-28 03:19:22,290][106225] Updated weights for policy 1, policy_version 1125039 (0.0011) [2023-12-28 03:19:22,345][106226] Updated weights for policy 0, policy_version 1122119 (0.0008) [2023-12-28 03:19:22,413][106226] Updated weights for policy 0, policy_version 1122129 (0.0008) [2023-12-28 03:19:23,014][106225] Updated weights for policy 1, policy_version 1125049 (0.0010) [2023-12-28 03:19:23,065][106225] Updated weights for policy 1, policy_version 1125059 (0.0010) [2023-12-28 03:19:23,111][106225] Updated weights for policy 1, policy_version 1125069 (0.0010) [2023-12-28 03:19:23,136][106226] Updated weights for policy 0, policy_version 1122139 (0.0008) [2023-12-28 03:19:23,193][106226] Updated weights for policy 0, policy_version 1122149 (0.0008) [2023-12-28 03:19:23,250][106226] Updated weights for policy 0, policy_version 1122159 (0.0008) [2023-12-28 03:19:23,790][106225] Updated weights for policy 1, policy_version 1125079 (0.0007) [2023-12-28 03:19:23,843][106225] Updated weights for policy 1, policy_version 1125089 (0.0005) [2023-12-28 03:19:23,891][106225] Updated weights for policy 1, policy_version 1125099 (0.0007) [2023-12-28 03:19:23,962][106226] Updated weights for policy 0, policy_version 1122169 (0.0008) [2023-12-28 03:19:24,026][106226] Updated weights for policy 0, policy_version 1122179 (0.0007) [2023-12-28 03:19:24,087][106226] Updated weights for policy 0, policy_version 1122189 (0.0007) [2023-12-28 03:19:24,154][106226] Updated weights for policy 0, policy_version 1122199 (0.0006) [2023-12-28 03:19:24,585][106225] Updated weights for policy 1, policy_version 1125109 (0.0010) [2023-12-28 03:19:24,636][106225] Updated weights for policy 1, policy_version 1125119 (0.0006) [2023-12-28 03:19:24,690][106225] Updated weights for policy 1, policy_version 1125129 (0.0010) [2023-12-28 03:19:24,745][106226] Updated weights for policy 0, policy_version 1122209 (0.0010) [2023-12-28 03:19:24,795][106226] Updated weights for policy 0, policy_version 1122219 (0.0010) [2023-12-28 03:19:24,841][106226] Updated weights for policy 0, policy_version 1122229 (0.0010) [2023-12-28 03:19:25,405][106225] Updated weights for policy 1, policy_version 1125139 (0.0010) [2023-12-28 03:19:25,456][106225] Updated weights for policy 1, policy_version 1125149 (0.0007) [2023-12-28 03:19:25,512][106225] Updated weights for policy 1, policy_version 1125159 (0.0010) [2023-12-28 03:19:25,585][106226] Updated weights for policy 0, policy_version 1122239 (0.0010) [2023-12-28 03:19:25,645][106226] Updated weights for policy 0, policy_version 1122249 (0.0010) [2023-12-28 03:19:25,699][106226] Updated weights for policy 0, policy_version 1122259 (0.0006) [2023-12-28 03:19:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 575447040. Throughput: 0: 10006.5, 1: 9859.2. Samples: 575418916. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:26,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-5.129')] [2023-12-28 03:19:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001122264_287358976.pth... [2023-12-28 03:19:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001121112_287064064.pth [2023-12-28 03:19:26,187][106225] Updated weights for policy 1, policy_version 1125169 (0.0010) [2023-12-28 03:19:26,231][106226] Updated weights for policy 0, policy_version 1122269 (0.0008) [2023-12-28 03:19:26,246][106225] Updated weights for policy 1, policy_version 1125179 (0.0006) [2023-12-28 03:19:26,284][106226] Updated weights for policy 0, policy_version 1122279 (0.0010) [2023-12-28 03:19:26,307][106225] Updated weights for policy 1, policy_version 1125189 (0.0005) [2023-12-28 03:19:26,348][106226] Updated weights for policy 0, policy_version 1122289 (0.0011) [2023-12-28 03:19:26,361][106225] Updated weights for policy 1, policy_version 1125199 (0.0005) [2023-12-28 03:19:26,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001125200_288096256.pth... [2023-12-28 03:19:26,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001124016_287793152.pth [2023-12-28 03:19:26,939][106225] Updated weights for policy 1, policy_version 1125209 (0.0007) [2023-12-28 03:19:26,986][106225] Updated weights for policy 1, policy_version 1125219 (0.0008) [2023-12-28 03:19:27,021][106226] Updated weights for policy 0, policy_version 1122299 (0.0011) [2023-12-28 03:19:27,034][106225] Updated weights for policy 1, policy_version 1125229 (0.0006) [2023-12-28 03:19:27,086][106226] Updated weights for policy 0, policy_version 1122309 (0.0009) [2023-12-28 03:19:27,134][106226] Updated weights for policy 0, policy_version 1122319 (0.0010) [2023-12-28 03:19:27,717][106225] Updated weights for policy 1, policy_version 1125239 (0.0006) [2023-12-28 03:19:27,771][106225] Updated weights for policy 1, policy_version 1125249 (0.0008) [2023-12-28 03:19:27,827][106225] Updated weights for policy 1, policy_version 1125259 (0.0008) [2023-12-28 03:19:27,851][106226] Updated weights for policy 0, policy_version 1122329 (0.0009) [2023-12-28 03:19:27,911][106226] Updated weights for policy 0, policy_version 1122339 (0.0005) [2023-12-28 03:19:27,965][106226] Updated weights for policy 0, policy_version 1122349 (0.0008) [2023-12-28 03:19:28,028][106226] Updated weights for policy 0, policy_version 1122359 (0.0011) [2023-12-28 03:19:28,457][106225] Updated weights for policy 1, policy_version 1125269 (0.0010) [2023-12-28 03:19:28,506][106225] Updated weights for policy 1, policy_version 1125279 (0.0010) [2023-12-28 03:19:28,555][106225] Updated weights for policy 1, policy_version 1125289 (0.0007) [2023-12-28 03:19:28,710][106226] Updated weights for policy 0, policy_version 1122369 (0.0006) [2023-12-28 03:19:28,783][106226] Updated weights for policy 0, policy_version 1122379 (0.0012) [2023-12-28 03:19:28,845][106226] Updated weights for policy 0, policy_version 1122389 (0.0011) [2023-12-28 03:19:29,234][106225] Updated weights for policy 1, policy_version 1125299 (0.0007) [2023-12-28 03:19:29,294][106225] Updated weights for policy 1, policy_version 1125309 (0.0007) [2023-12-28 03:19:29,352][106225] Updated weights for policy 1, policy_version 1125319 (0.0008) [2023-12-28 03:19:29,447][106226] Updated weights for policy 0, policy_version 1122399 (0.0009) [2023-12-28 03:19:29,509][106226] Updated weights for policy 0, policy_version 1122409 (0.0008) [2023-12-28 03:19:29,574][106226] Updated weights for policy 0, policy_version 1122419 (0.0005) [2023-12-28 03:19:30,078][106225] Updated weights for policy 1, policy_version 1125329 (0.0008) [2023-12-28 03:19:30,130][106225] Updated weights for policy 1, policy_version 1125339 (0.0008) [2023-12-28 03:19:30,182][106225] Updated weights for policy 1, policy_version 1125349 (0.0009) [2023-12-28 03:19:30,215][106226] Updated weights for policy 0, policy_version 1122429 (0.0007) [2023-12-28 03:19:30,235][106225] Updated weights for policy 1, policy_version 1125359 (0.0009) [2023-12-28 03:19:30,277][106226] Updated weights for policy 0, policy_version 1122439 (0.0007) [2023-12-28 03:19:30,342][106226] Updated weights for policy 0, policy_version 1122449 (0.0007) [2023-12-28 03:19:30,866][106225] Updated weights for policy 1, policy_version 1125369 (0.0005) [2023-12-28 03:19:30,924][106225] Updated weights for policy 1, policy_version 1125379 (0.0006) [2023-12-28 03:19:30,974][106225] Updated weights for policy 1, policy_version 1125389 (0.0010) [2023-12-28 03:19:30,996][106226] Updated weights for policy 0, policy_version 1122459 (0.0007) [2023-12-28 03:19:31,055][106226] Updated weights for policy 0, policy_version 1122469 (0.0008) [2023-12-28 03:19:31,122][106226] Updated weights for policy 0, policy_version 1122479 (0.0006) [2023-12-28 03:19:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 575553536. Throughput: 0: 10058.4, 1: 9976.4. Samples: 575543876. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:31,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.975')] [2023-12-28 03:19:31,643][106225] Updated weights for policy 1, policy_version 1125399 (0.0008) [2023-12-28 03:19:31,705][106225] Updated weights for policy 1, policy_version 1125409 (0.0008) [2023-12-28 03:19:31,770][106225] Updated weights for policy 1, policy_version 1125419 (0.0008) [2023-12-28 03:19:31,894][106226] Updated weights for policy 0, policy_version 1122489 (0.0007) [2023-12-28 03:19:31,963][106226] Updated weights for policy 0, policy_version 1122499 (0.0007) [2023-12-28 03:19:32,024][106226] Updated weights for policy 0, policy_version 1122509 (0.0006) [2023-12-28 03:19:32,082][106226] Updated weights for policy 0, policy_version 1122519 (0.0007) [2023-12-28 03:19:32,504][106225] Updated weights for policy 1, policy_version 1125429 (0.0008) [2023-12-28 03:19:32,564][106225] Updated weights for policy 1, policy_version 1125439 (0.0007) [2023-12-28 03:19:32,618][106225] Updated weights for policy 1, policy_version 1125449 (0.0009) [2023-12-28 03:19:32,776][106226] Updated weights for policy 0, policy_version 1122529 (0.0008) [2023-12-28 03:19:32,825][106226] Updated weights for policy 0, policy_version 1122539 (0.0007) [2023-12-28 03:19:32,885][106226] Updated weights for policy 0, policy_version 1122549 (0.0009) [2023-12-28 03:19:33,258][106225] Updated weights for policy 1, policy_version 1125459 (0.0009) [2023-12-28 03:19:33,311][106225] Updated weights for policy 1, policy_version 1125469 (0.0008) [2023-12-28 03:19:33,362][106225] Updated weights for policy 1, policy_version 1125479 (0.0008) [2023-12-28 03:19:33,675][106226] Updated weights for policy 0, policy_version 1122559 (0.0009) [2023-12-28 03:19:33,731][106226] Updated weights for policy 0, policy_version 1122569 (0.0009) [2023-12-28 03:19:33,786][106226] Updated weights for policy 0, policy_version 1122579 (0.0009) [2023-12-28 03:19:33,973][106225] Updated weights for policy 1, policy_version 1125489 (0.0008) [2023-12-28 03:19:34,039][106225] Updated weights for policy 1, policy_version 1125499 (0.0007) [2023-12-28 03:19:34,099][106225] Updated weights for policy 1, policy_version 1125509 (0.0009) [2023-12-28 03:19:34,165][106225] Updated weights for policy 1, policy_version 1125519 (0.0007) [2023-12-28 03:19:34,656][106226] Updated weights for policy 0, policy_version 1122589 (0.0009) [2023-12-28 03:19:34,708][106225] Updated weights for policy 1, policy_version 1125529 (0.0007) [2023-12-28 03:19:34,715][106226] Updated weights for policy 0, policy_version 1122599 (0.0006) [2023-12-28 03:19:34,764][106225] Updated weights for policy 1, policy_version 1125539 (0.0006) [2023-12-28 03:19:34,781][106226] Updated weights for policy 0, policy_version 1122609 (0.0005) [2023-12-28 03:19:34,837][106225] Updated weights for policy 1, policy_version 1125549 (0.0006) [2023-12-28 03:19:35,434][106225] Updated weights for policy 1, policy_version 1125559 (0.0006) [2023-12-28 03:19:35,484][106226] Updated weights for policy 0, policy_version 1122619 (0.0008) [2023-12-28 03:19:35,487][106225] Updated weights for policy 1, policy_version 1125569 (0.0005) [2023-12-28 03:19:35,536][106225] Updated weights for policy 1, policy_version 1125579 (0.0005) [2023-12-28 03:19:35,541][106226] Updated weights for policy 0, policy_version 1122629 (0.0009) [2023-12-28 03:19:35,587][106226] Updated weights for policy 0, policy_version 1122639 (0.0008) [2023-12-28 03:19:36,160][106225] Updated weights for policy 1, policy_version 1125589 (0.0006) [2023-12-28 03:19:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 575651840. Throughput: 0: 9986.0, 1: 10112.0. Samples: 575664612. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:36,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.850')] [2023-12-28 03:19:36,223][106225] Updated weights for policy 1, policy_version 1125599 (0.0007) [2023-12-28 03:19:36,286][106225] Updated weights for policy 1, policy_version 1125609 (0.0011) [2023-12-28 03:19:36,375][106226] Updated weights for policy 0, policy_version 1122649 (0.0008) [2023-12-28 03:19:36,439][106226] Updated weights for policy 0, policy_version 1122659 (0.0008) [2023-12-28 03:19:36,495][106226] Updated weights for policy 0, policy_version 1122669 (0.0009) [2023-12-28 03:19:36,552][106226] Updated weights for policy 0, policy_version 1122679 (0.0009) [2023-12-28 03:19:36,902][106225] Updated weights for policy 1, policy_version 1125619 (0.0009) [2023-12-28 03:19:36,954][106225] Updated weights for policy 1, policy_version 1125629 (0.0005) [2023-12-28 03:19:37,003][106225] Updated weights for policy 1, policy_version 1125639 (0.0005) [2023-12-28 03:19:37,343][106226] Updated weights for policy 0, policy_version 1122689 (0.0006) [2023-12-28 03:19:37,398][106226] Updated weights for policy 0, policy_version 1122699 (0.0006) [2023-12-28 03:19:37,454][106226] Updated weights for policy 0, policy_version 1122709 (0.0006) [2023-12-28 03:19:37,584][106225] Updated weights for policy 1, policy_version 1125649 (0.0006) [2023-12-28 03:19:37,644][106225] Updated weights for policy 1, policy_version 1125659 (0.0008) [2023-12-28 03:19:37,698][106225] Updated weights for policy 1, policy_version 1125669 (0.0010) [2023-12-28 03:19:37,746][106225] Updated weights for policy 1, policy_version 1125679 (0.0008) [2023-12-28 03:19:38,076][106226] Updated weights for policy 0, policy_version 1122719 (0.0008) [2023-12-28 03:19:38,135][106226] Updated weights for policy 0, policy_version 1122729 (0.0008) [2023-12-28 03:19:38,193][106226] Updated weights for policy 0, policy_version 1122739 (0.0008) [2023-12-28 03:19:38,502][106225] Updated weights for policy 1, policy_version 1125689 (0.0008) [2023-12-28 03:19:38,565][106225] Updated weights for policy 1, policy_version 1125699 (0.0009) [2023-12-28 03:19:38,623][106225] Updated weights for policy 1, policy_version 1125709 (0.0006) [2023-12-28 03:19:38,944][106226] Updated weights for policy 0, policy_version 1122749 (0.0008) [2023-12-28 03:19:38,997][106226] Updated weights for policy 0, policy_version 1122759 (0.0008) [2023-12-28 03:19:39,064][106226] Updated weights for policy 0, policy_version 1122769 (0.0009) [2023-12-28 03:19:39,304][106225] Updated weights for policy 1, policy_version 1125719 (0.0009) [2023-12-28 03:19:39,375][106225] Updated weights for policy 1, policy_version 1125729 (0.0009) [2023-12-28 03:19:39,443][106225] Updated weights for policy 1, policy_version 1125739 (0.0008) [2023-12-28 03:19:39,825][106226] Updated weights for policy 0, policy_version 1122779 (0.0009) [2023-12-28 03:19:39,897][106226] Updated weights for policy 0, policy_version 1122789 (0.0008) [2023-12-28 03:19:39,960][106226] Updated weights for policy 0, policy_version 1122799 (0.0008) [2023-12-28 03:19:40,261][106225] Updated weights for policy 1, policy_version 1125749 (0.0008) [2023-12-28 03:19:40,322][106225] Updated weights for policy 1, policy_version 1125759 (0.0008) [2023-12-28 03:19:40,392][106225] Updated weights for policy 1, policy_version 1125769 (0.0008) [2023-12-28 03:19:40,780][106226] Updated weights for policy 0, policy_version 1122809 (0.0008) [2023-12-28 03:19:40,830][106226] Updated weights for policy 0, policy_version 1122819 (0.0007) [2023-12-28 03:19:40,880][106226] Updated weights for policy 0, policy_version 1122829 (0.0010) [2023-12-28 03:19:40,930][106226] Updated weights for policy 0, policy_version 1122839 (0.0010) [2023-12-28 03:19:41,073][106225] Updated weights for policy 1, policy_version 1125779 (0.0008) [2023-12-28 03:19:41,149][106225] Updated weights for policy 1, policy_version 1125789 (0.0009) [2023-12-28 03:19:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 575750144. Throughput: 0: 9984.5, 1: 10128.2. Samples: 575724724. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:41,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.913')] [2023-12-28 03:19:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001122840_287506432.pth... [2023-12-28 03:19:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001121688_287211520.pth [2023-12-28 03:19:41,213][106225] Updated weights for policy 1, policy_version 1125799 (0.0007) [2023-12-28 03:19:41,274][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001125808_288251904.pth... [2023-12-28 03:19:41,277][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001124592_287940608.pth [2023-12-28 03:19:41,724][106226] Updated weights for policy 0, policy_version 1122849 (0.0008) [2023-12-28 03:19:41,797][106226] Updated weights for policy 0, policy_version 1122859 (0.0008) [2023-12-28 03:19:41,865][106226] Updated weights for policy 0, policy_version 1122869 (0.0009) [2023-12-28 03:19:42,049][106225] Updated weights for policy 1, policy_version 1125809 (0.0008) [2023-12-28 03:19:42,111][106225] Updated weights for policy 1, policy_version 1125819 (0.0008) [2023-12-28 03:19:42,176][106225] Updated weights for policy 1, policy_version 1125829 (0.0008) [2023-12-28 03:19:42,237][106225] Updated weights for policy 1, policy_version 1125839 (0.0008) [2023-12-28 03:19:42,554][106226] Updated weights for policy 0, policy_version 1122879 (0.0009) [2023-12-28 03:19:42,611][106226] Updated weights for policy 0, policy_version 1122889 (0.0010) [2023-12-28 03:19:42,665][106226] Updated weights for policy 0, policy_version 1122899 (0.0011) [2023-12-28 03:19:43,017][106225] Updated weights for policy 1, policy_version 1125849 (0.0008) [2023-12-28 03:19:43,081][106225] Updated weights for policy 1, policy_version 1125859 (0.0008) [2023-12-28 03:19:43,135][106225] Updated weights for policy 1, policy_version 1125869 (0.0007) [2023-12-28 03:19:43,309][106226] Updated weights for policy 0, policy_version 1122909 (0.0008) [2023-12-28 03:19:43,366][106226] Updated weights for policy 0, policy_version 1122919 (0.0006) [2023-12-28 03:19:43,422][106226] Updated weights for policy 0, policy_version 1122929 (0.0005) [2023-12-28 03:19:43,920][106225] Updated weights for policy 1, policy_version 1125879 (0.0008) [2023-12-28 03:19:43,974][106226] Updated weights for policy 0, policy_version 1122939 (0.0006) [2023-12-28 03:19:43,983][106225] Updated weights for policy 1, policy_version 1125889 (0.0009) [2023-12-28 03:19:44,024][106226] Updated weights for policy 0, policy_version 1122949 (0.0007) [2023-12-28 03:19:44,041][106225] Updated weights for policy 1, policy_version 1125899 (0.0007) [2023-12-28 03:19:44,092][106226] Updated weights for policy 0, policy_version 1122959 (0.0008) [2023-12-28 03:19:44,731][106226] Updated weights for policy 0, policy_version 1122969 (0.0008) [2023-12-28 03:19:44,797][106225] Updated weights for policy 1, policy_version 1125909 (0.0008) [2023-12-28 03:19:44,799][106226] Updated weights for policy 0, policy_version 1122979 (0.0008) [2023-12-28 03:19:44,858][106226] Updated weights for policy 0, policy_version 1122989 (0.0007) [2023-12-28 03:19:44,860][106225] Updated weights for policy 1, policy_version 1125919 (0.0006) [2023-12-28 03:19:44,919][106225] Updated weights for policy 1, policy_version 1125929 (0.0006) [2023-12-28 03:19:44,921][106226] Updated weights for policy 0, policy_version 1122999 (0.0009) [2023-12-28 03:19:45,605][106226] Updated weights for policy 0, policy_version 1123009 (0.0008) [2023-12-28 03:19:45,662][106226] Updated weights for policy 0, policy_version 1123019 (0.0008) [2023-12-28 03:19:45,664][106225] Updated weights for policy 1, policy_version 1125939 (0.0008) [2023-12-28 03:19:45,724][106225] Updated weights for policy 1, policy_version 1125949 (0.0008) [2023-12-28 03:19:45,727][106226] Updated weights for policy 0, policy_version 1123029 (0.0005) [2023-12-28 03:19:45,781][106225] Updated weights for policy 1, policy_version 1125959 (0.0009) [2023-12-28 03:19:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 575848448. Throughput: 0: 9910.2, 1: 10008.6. Samples: 575838844. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:46,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.642')] [2023-12-28 03:19:46,265][106226] Updated weights for policy 0, policy_version 1123039 (0.0006) [2023-12-28 03:19:46,315][106226] Updated weights for policy 0, policy_version 1123049 (0.0009) [2023-12-28 03:19:46,371][106226] Updated weights for policy 0, policy_version 1123059 (0.0008) [2023-12-28 03:19:46,538][106225] Updated weights for policy 1, policy_version 1125969 (0.0006) [2023-12-28 03:19:46,600][106225] Updated weights for policy 1, policy_version 1125979 (0.0008) [2023-12-28 03:19:46,666][106225] Updated weights for policy 1, policy_version 1125989 (0.0006) [2023-12-28 03:19:46,731][106225] Updated weights for policy 1, policy_version 1125999 (0.0008) [2023-12-28 03:19:47,087][106226] Updated weights for policy 0, policy_version 1123069 (0.0009) [2023-12-28 03:19:47,143][106226] Updated weights for policy 0, policy_version 1123079 (0.0009) [2023-12-28 03:19:47,207][106226] Updated weights for policy 0, policy_version 1123089 (0.0009) [2023-12-28 03:19:47,442][106225] Updated weights for policy 1, policy_version 1126009 (0.0009) [2023-12-28 03:19:47,490][106225] Updated weights for policy 1, policy_version 1126019 (0.0008) [2023-12-28 03:19:47,537][106225] Updated weights for policy 1, policy_version 1126029 (0.0007) [2023-12-28 03:19:47,927][106226] Updated weights for policy 0, policy_version 1123099 (0.0009) [2023-12-28 03:19:47,978][106226] Updated weights for policy 0, policy_version 1123109 (0.0007) [2023-12-28 03:19:48,035][106226] Updated weights for policy 0, policy_version 1123119 (0.0006) [2023-12-28 03:19:48,278][106225] Updated weights for policy 1, policy_version 1126039 (0.0009) [2023-12-28 03:19:48,365][106225] Updated weights for policy 1, policy_version 1126049 (0.0009) [2023-12-28 03:19:48,432][106225] Updated weights for policy 1, policy_version 1126059 (0.0009) [2023-12-28 03:19:48,765][106226] Updated weights for policy 0, policy_version 1123129 (0.0009) [2023-12-28 03:19:48,825][106226] Updated weights for policy 0, policy_version 1123139 (0.0009) [2023-12-28 03:19:48,887][106226] Updated weights for policy 0, policy_version 1123149 (0.0009) [2023-12-28 03:19:48,949][106226] Updated weights for policy 0, policy_version 1123159 (0.0008) [2023-12-28 03:19:49,134][106225] Updated weights for policy 1, policy_version 1126069 (0.0009) [2023-12-28 03:19:49,184][106225] Updated weights for policy 1, policy_version 1126079 (0.0009) [2023-12-28 03:19:49,250][106225] Updated weights for policy 1, policy_version 1126089 (0.0008) [2023-12-28 03:19:49,715][106226] Updated weights for policy 0, policy_version 1123169 (0.0009) [2023-12-28 03:19:49,780][106226] Updated weights for policy 0, policy_version 1123179 (0.0008) [2023-12-28 03:19:49,845][106226] Updated weights for policy 0, policy_version 1123189 (0.0009) [2023-12-28 03:19:50,055][106225] Updated weights for policy 1, policy_version 1126099 (0.0008) [2023-12-28 03:19:50,118][106225] Updated weights for policy 1, policy_version 1126109 (0.0008) [2023-12-28 03:19:50,181][106225] Updated weights for policy 1, policy_version 1126119 (0.0008) [2023-12-28 03:19:50,520][106226] Updated weights for policy 0, policy_version 1123199 (0.0008) [2023-12-28 03:19:50,566][106226] Updated weights for policy 0, policy_version 1123209 (0.0007) [2023-12-28 03:19:50,633][106226] Updated weights for policy 0, policy_version 1123219 (0.0007) [2023-12-28 03:19:51,044][106225] Updated weights for policy 1, policy_version 1126129 (0.0009) [2023-12-28 03:19:51,113][106225] Updated weights for policy 1, policy_version 1126139 (0.0007) [2023-12-28 03:19:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 575938560. Throughput: 0: 9938.3, 1: 9909.2. Samples: 575955480. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:51,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-5.024')] [2023-12-28 03:19:51,176][106225] Updated weights for policy 1, policy_version 1126149 (0.0007) [2023-12-28 03:19:51,238][106225] Updated weights for policy 1, policy_version 1126159 (0.0008) [2023-12-28 03:19:51,279][106226] Updated weights for policy 0, policy_version 1123229 (0.0008) [2023-12-28 03:19:51,340][106226] Updated weights for policy 0, policy_version 1123239 (0.0006) [2023-12-28 03:19:51,408][106226] Updated weights for policy 0, policy_version 1123249 (0.0009) [2023-12-28 03:19:52,023][106225] Updated weights for policy 1, policy_version 1126169 (0.0008) [2023-12-28 03:19:52,080][106225] Updated weights for policy 1, policy_version 1126179 (0.0008) [2023-12-28 03:19:52,119][106226] Updated weights for policy 0, policy_version 1123259 (0.0006) [2023-12-28 03:19:52,136][106225] Updated weights for policy 1, policy_version 1126189 (0.0008) [2023-12-28 03:19:52,175][106226] Updated weights for policy 0, policy_version 1123269 (0.0007) [2023-12-28 03:19:52,233][106226] Updated weights for policy 0, policy_version 1123279 (0.0009) [2023-12-28 03:19:52,869][106225] Updated weights for policy 1, policy_version 1126199 (0.0007) [2023-12-28 03:19:52,907][106226] Updated weights for policy 0, policy_version 1123289 (0.0008) [2023-12-28 03:19:52,921][106225] Updated weights for policy 1, policy_version 1126209 (0.0009) [2023-12-28 03:19:52,955][106226] Updated weights for policy 0, policy_version 1123299 (0.0010) [2023-12-28 03:19:52,969][106225] Updated weights for policy 1, policy_version 1126219 (0.0006) [2023-12-28 03:19:53,002][106226] Updated weights for policy 0, policy_version 1123309 (0.0010) [2023-12-28 03:19:53,048][106226] Updated weights for policy 0, policy_version 1123319 (0.0010) [2023-12-28 03:19:53,722][106225] Updated weights for policy 1, policy_version 1126229 (0.0007) [2023-12-28 03:19:53,771][106225] Updated weights for policy 1, policy_version 1126239 (0.0007) [2023-12-28 03:19:53,787][106226] Updated weights for policy 0, policy_version 1123329 (0.0007) [2023-12-28 03:19:53,827][106225] Updated weights for policy 1, policy_version 1126249 (0.0008) [2023-12-28 03:19:53,853][106226] Updated weights for policy 0, policy_version 1123339 (0.0005) [2023-12-28 03:19:53,918][106226] Updated weights for policy 0, policy_version 1123349 (0.0008) [2023-12-28 03:19:54,519][106226] Updated weights for policy 0, policy_version 1123359 (0.0009) [2023-12-28 03:19:54,571][106226] Updated weights for policy 0, policy_version 1123369 (0.0008) [2023-12-28 03:19:54,620][106225] Updated weights for policy 1, policy_version 1126259 (0.0008) [2023-12-28 03:19:54,626][106226] Updated weights for policy 0, policy_version 1123379 (0.0007) [2023-12-28 03:19:54,682][106225] Updated weights for policy 1, policy_version 1126269 (0.0007) [2023-12-28 03:19:54,734][106225] Updated weights for policy 1, policy_version 1126279 (0.0008) [2023-12-28 03:19:55,334][106226] Updated weights for policy 0, policy_version 1123389 (0.0007) [2023-12-28 03:19:55,383][106226] Updated weights for policy 0, policy_version 1123399 (0.0008) [2023-12-28 03:19:55,432][106226] Updated weights for policy 0, policy_version 1123409 (0.0008) [2023-12-28 03:19:55,469][106225] Updated weights for policy 1, policy_version 1126289 (0.0008) [2023-12-28 03:19:55,526][106225] Updated weights for policy 1, policy_version 1126299 (0.0008) [2023-12-28 03:19:55,583][106225] Updated weights for policy 1, policy_version 1126309 (0.0009) [2023-12-28 03:19:55,642][106225] Updated weights for policy 1, policy_version 1126319 (0.0010) [2023-12-28 03:19:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 576036864. Throughput: 0: 9893.2, 1: 9842.7. Samples: 576012316. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:19:56,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.766')] [2023-12-28 03:19:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001123416_287653888.pth... [2023-12-28 03:19:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001122264_287358976.pth [2023-12-28 03:19:56,232][106225] Updated weights for policy 1, policy_version 1126329 (0.0005) [2023-12-28 03:19:56,268][106226] Updated weights for policy 0, policy_version 1123419 (0.0008) [2023-12-28 03:19:56,284][106225] Updated weights for policy 1, policy_version 1126339 (0.0005) [2023-12-28 03:19:56,315][106226] Updated weights for policy 0, policy_version 1123429 (0.0007) [2023-12-28 03:19:56,346][106225] Updated weights for policy 1, policy_version 1126349 (0.0005) [2023-12-28 03:19:56,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001126352_288391168.pth... [2023-12-28 03:19:56,366][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001125200_288096256.pth [2023-12-28 03:19:56,370][106226] Updated weights for policy 0, policy_version 1123439 (0.0009) [2023-12-28 03:19:56,886][106225] Updated weights for policy 1, policy_version 1126359 (0.0008) [2023-12-28 03:19:56,944][106225] Updated weights for policy 1, policy_version 1126369 (0.0008) [2023-12-28 03:19:56,969][106226] Updated weights for policy 0, policy_version 1123449 (0.0007) [2023-12-28 03:19:56,998][106225] Updated weights for policy 1, policy_version 1126379 (0.0008) [2023-12-28 03:19:57,021][106226] Updated weights for policy 0, policy_version 1123459 (0.0005) [2023-12-28 03:19:57,077][106226] Updated weights for policy 0, policy_version 1123469 (0.0007) [2023-12-28 03:19:57,135][106226] Updated weights for policy 0, policy_version 1123479 (0.0008) [2023-12-28 03:19:57,697][106226] Updated weights for policy 0, policy_version 1123489 (0.0006) [2023-12-28 03:19:57,757][106226] Updated weights for policy 0, policy_version 1123499 (0.0006) [2023-12-28 03:19:57,758][106225] Updated weights for policy 1, policy_version 1126389 (0.0007) [2023-12-28 03:19:57,817][106226] Updated weights for policy 0, policy_version 1123509 (0.0009) [2023-12-28 03:19:57,821][106225] Updated weights for policy 1, policy_version 1126399 (0.0005) [2023-12-28 03:19:57,879][106225] Updated weights for policy 1, policy_version 1126409 (0.0006) [2023-12-28 03:19:58,370][106226] Updated weights for policy 0, policy_version 1123519 (0.0008) [2023-12-28 03:19:58,439][106226] Updated weights for policy 0, policy_version 1123529 (0.0010) [2023-12-28 03:19:58,498][106226] Updated weights for policy 0, policy_version 1123539 (0.0010) [2023-12-28 03:19:58,519][106225] Updated weights for policy 1, policy_version 1126419 (0.0009) [2023-12-28 03:19:58,579][106225] Updated weights for policy 1, policy_version 1126429 (0.0009) [2023-12-28 03:19:58,641][106225] Updated weights for policy 1, policy_version 1126439 (0.0010) [2023-12-28 03:19:59,327][106226] Updated weights for policy 0, policy_version 1123549 (0.0009) [2023-12-28 03:19:59,405][106226] Updated weights for policy 0, policy_version 1123559 (0.0007) [2023-12-28 03:19:59,444][106225] Updated weights for policy 1, policy_version 1126449 (0.0009) [2023-12-28 03:19:59,464][106226] Updated weights for policy 0, policy_version 1123569 (0.0007) [2023-12-28 03:19:59,511][106225] Updated weights for policy 1, policy_version 1126459 (0.0007) [2023-12-28 03:19:59,574][106225] Updated weights for policy 1, policy_version 1126469 (0.0009) [2023-12-28 03:19:59,633][106225] Updated weights for policy 1, policy_version 1126479 (0.0009) [2023-12-28 03:20:00,134][106226] Updated weights for policy 0, policy_version 1123579 (0.0007) [2023-12-28 03:20:00,185][106226] Updated weights for policy 0, policy_version 1123589 (0.0008) [2023-12-28 03:20:00,237][106226] Updated weights for policy 0, policy_version 1123600 (0.0010) [2023-12-28 03:20:00,359][106225] Updated weights for policy 1, policy_version 1126489 (0.0009) [2023-12-28 03:20:00,419][106225] Updated weights for policy 1, policy_version 1126499 (0.0010) [2023-12-28 03:20:00,467][106225] Updated weights for policy 1, policy_version 1126509 (0.0009) [2023-12-28 03:20:00,973][106226] Updated weights for policy 0, policy_version 1123610 (0.0008) [2023-12-28 03:20:01,046][106226] Updated weights for policy 0, policy_version 1123623 (0.0006) [2023-12-28 03:20:01,098][106226] Updated weights for policy 0, policy_version 1123633 (0.0006) [2023-12-28 03:20:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 576143360. Throughput: 0: 9893.2, 1: 9842.9. Samples: 576133200. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:01,175][105115] Avg episode reward: [(0, '-4.721'), (1, '-4.715')] [2023-12-28 03:20:01,202][106225] Updated weights for policy 1, policy_version 1126519 (0.0008) [2023-12-28 03:20:01,259][106225] Updated weights for policy 1, policy_version 1126529 (0.0009) [2023-12-28 03:20:01,321][106225] Updated weights for policy 1, policy_version 1126539 (0.0008) [2023-12-28 03:20:01,905][106226] Updated weights for policy 0, policy_version 1123643 (0.0008) [2023-12-28 03:20:01,975][106226] Updated weights for policy 0, policy_version 1123653 (0.0008) [2023-12-28 03:20:02,002][106225] Updated weights for policy 1, policy_version 1126549 (0.0009) [2023-12-28 03:20:02,028][106226] Updated weights for policy 0, policy_version 1123663 (0.0007) [2023-12-28 03:20:02,064][106225] Updated weights for policy 1, policy_version 1126559 (0.0008) [2023-12-28 03:20:02,125][106225] Updated weights for policy 1, policy_version 1126569 (0.0007) [2023-12-28 03:20:02,775][106226] Updated weights for policy 0, policy_version 1123673 (0.0006) [2023-12-28 03:20:02,780][106225] Updated weights for policy 1, policy_version 1126579 (0.0007) [2023-12-28 03:20:02,833][106226] Updated weights for policy 0, policy_version 1123683 (0.0006) [2023-12-28 03:20:02,836][106225] Updated weights for policy 1, policy_version 1126589 (0.0009) [2023-12-28 03:20:02,888][106225] Updated weights for policy 1, policy_version 1126599 (0.0006) [2023-12-28 03:20:02,890][106226] Updated weights for policy 0, policy_version 1123693 (0.0008) [2023-12-28 03:20:02,950][106226] Updated weights for policy 0, policy_version 1123703 (0.0008) [2023-12-28 03:20:03,466][106225] Updated weights for policy 1, policy_version 1126609 (0.0006) [2023-12-28 03:20:03,517][106225] Updated weights for policy 1, policy_version 1126619 (0.0005) [2023-12-28 03:20:03,569][106225] Updated weights for policy 1, policy_version 1126629 (0.0005) [2023-12-28 03:20:03,616][106225] Updated weights for policy 1, policy_version 1126639 (0.0005) [2023-12-28 03:20:03,681][106226] Updated weights for policy 0, policy_version 1123713 (0.0010) [2023-12-28 03:20:03,731][106226] Updated weights for policy 0, policy_version 1123723 (0.0009) [2023-12-28 03:20:03,777][106226] Updated weights for policy 0, policy_version 1123733 (0.0007) [2023-12-28 03:20:04,241][106225] Updated weights for policy 1, policy_version 1126649 (0.0008) [2023-12-28 03:20:04,306][106225] Updated weights for policy 1, policy_version 1126659 (0.0008) [2023-12-28 03:20:04,370][106225] Updated weights for policy 1, policy_version 1126669 (0.0008) [2023-12-28 03:20:04,487][106226] Updated weights for policy 0, policy_version 1123743 (0.0009) [2023-12-28 03:20:04,550][106226] Updated weights for policy 0, policy_version 1123753 (0.0011) [2023-12-28 03:20:04,620][106226] Updated weights for policy 0, policy_version 1123763 (0.0011) [2023-12-28 03:20:04,932][106225] Updated weights for policy 1, policy_version 1126679 (0.0006) [2023-12-28 03:20:04,981][106225] Updated weights for policy 1, policy_version 1126689 (0.0005) [2023-12-28 03:20:05,027][106225] Updated weights for policy 1, policy_version 1126699 (0.0005) [2023-12-28 03:20:05,248][106226] Updated weights for policy 0, policy_version 1123773 (0.0010) [2023-12-28 03:20:05,297][106226] Updated weights for policy 0, policy_version 1123783 (0.0010) [2023-12-28 03:20:05,360][106226] Updated weights for policy 0, policy_version 1123793 (0.0010) [2023-12-28 03:20:05,720][106225] Updated weights for policy 1, policy_version 1126709 (0.0007) [2023-12-28 03:20:05,782][106225] Updated weights for policy 1, policy_version 1126719 (0.0008) [2023-12-28 03:20:05,837][106225] Updated weights for policy 1, policy_version 1126729 (0.0008) [2023-12-28 03:20:06,085][106226] Updated weights for policy 0, policy_version 1123803 (0.0010) [2023-12-28 03:20:06,151][106226] Updated weights for policy 0, policy_version 1123813 (0.0011) [2023-12-28 03:20:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 576241664. Throughput: 0: 9891.7, 1: 9938.8. Samples: 576254180. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:06,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-4.984')] [2023-12-28 03:20:06,202][106226] Updated weights for policy 0, policy_version 1123823 (0.0011) [2023-12-28 03:20:06,610][106225] Updated weights for policy 1, policy_version 1126739 (0.0008) [2023-12-28 03:20:06,675][106225] Updated weights for policy 1, policy_version 1126749 (0.0008) [2023-12-28 03:20:06,736][106225] Updated weights for policy 1, policy_version 1126759 (0.0007) [2023-12-28 03:20:06,964][106226] Updated weights for policy 0, policy_version 1123833 (0.0011) [2023-12-28 03:20:07,021][106226] Updated weights for policy 0, policy_version 1123843 (0.0011) [2023-12-28 03:20:07,079][106226] Updated weights for policy 0, policy_version 1123853 (0.0011) [2023-12-28 03:20:07,143][106226] Updated weights for policy 0, policy_version 1123863 (0.0011) [2023-12-28 03:20:07,473][106225] Updated weights for policy 1, policy_version 1126769 (0.0008) [2023-12-28 03:20:07,528][106225] Updated weights for policy 1, policy_version 1126779 (0.0008) [2023-12-28 03:20:07,584][106225] Updated weights for policy 1, policy_version 1126789 (0.0008) [2023-12-28 03:20:07,633][106225] Updated weights for policy 1, policy_version 1126799 (0.0008) [2023-12-28 03:20:07,859][106226] Updated weights for policy 0, policy_version 1123873 (0.0010) [2023-12-28 03:20:07,909][106226] Updated weights for policy 0, policy_version 1123883 (0.0010) [2023-12-28 03:20:07,962][106226] Updated weights for policy 0, policy_version 1123893 (0.0010) [2023-12-28 03:20:08,380][106225] Updated weights for policy 1, policy_version 1126809 (0.0008) [2023-12-28 03:20:08,441][106225] Updated weights for policy 1, policy_version 1126819 (0.0008) [2023-12-28 03:20:08,500][106225] Updated weights for policy 1, policy_version 1126829 (0.0008) [2023-12-28 03:20:08,698][106226] Updated weights for policy 0, policy_version 1123903 (0.0011) [2023-12-28 03:20:08,761][106226] Updated weights for policy 0, policy_version 1123913 (0.0011) [2023-12-28 03:20:08,822][106226] Updated weights for policy 0, policy_version 1123923 (0.0008) [2023-12-28 03:20:09,207][106225] Updated weights for policy 1, policy_version 1126839 (0.0007) [2023-12-28 03:20:09,270][106225] Updated weights for policy 1, policy_version 1126849 (0.0008) [2023-12-28 03:20:09,329][106225] Updated weights for policy 1, policy_version 1126859 (0.0008) [2023-12-28 03:20:09,553][106226] Updated weights for policy 0, policy_version 1123933 (0.0008) [2023-12-28 03:20:09,614][106226] Updated weights for policy 0, policy_version 1123943 (0.0011) [2023-12-28 03:20:09,683][106226] Updated weights for policy 0, policy_version 1123953 (0.0009) [2023-12-28 03:20:10,170][106225] Updated weights for policy 1, policy_version 1126869 (0.0008) [2023-12-28 03:20:10,230][106225] Updated weights for policy 1, policy_version 1126879 (0.0009) [2023-12-28 03:20:10,286][106225] Updated weights for policy 1, policy_version 1126889 (0.0008) [2023-12-28 03:20:10,423][106226] Updated weights for policy 0, policy_version 1123963 (0.0009) [2023-12-28 03:20:10,484][106226] Updated weights for policy 0, policy_version 1123973 (0.0010) [2023-12-28 03:20:10,538][106226] Updated weights for policy 0, policy_version 1123983 (0.0010) [2023-12-28 03:20:11,072][106225] Updated weights for policy 1, policy_version 1126899 (0.0008) [2023-12-28 03:20:11,142][106225] Updated weights for policy 1, policy_version 1126909 (0.0008) [2023-12-28 03:20:11,175][105115] Fps is (10 sec: 18840.8, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 576331776. Throughput: 0: 9903.8, 1: 9916.1. Samples: 576310820. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:11,176][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.573')] [2023-12-28 03:20:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001123992_287801344.pth... [2023-12-28 03:20:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001122840_287506432.pth [2023-12-28 03:20:11,218][106225] Updated weights for policy 1, policy_version 1126919 (0.0008) [2023-12-28 03:20:11,224][106226] Updated weights for policy 0, policy_version 1123993 (0.0008) [2023-12-28 03:20:11,276][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001126928_288538624.pth... [2023-12-28 03:20:11,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001125808_288251904.pth [2023-12-28 03:20:11,286][106226] Updated weights for policy 0, policy_version 1124003 (0.0009) [2023-12-28 03:20:11,357][106226] Updated weights for policy 0, policy_version 1124013 (0.0008) [2023-12-28 03:20:11,428][106226] Updated weights for policy 0, policy_version 1124023 (0.0009) [2023-12-28 03:20:11,953][106225] Updated weights for policy 1, policy_version 1126929 (0.0008) [2023-12-28 03:20:12,013][106225] Updated weights for policy 1, policy_version 1126939 (0.0008) [2023-12-28 03:20:12,064][106225] Updated weights for policy 1, policy_version 1126949 (0.0008) [2023-12-28 03:20:12,103][106226] Updated weights for policy 0, policy_version 1124033 (0.0006) [2023-12-28 03:20:12,121][106225] Updated weights for policy 1, policy_version 1126959 (0.0009) [2023-12-28 03:20:12,165][106226] Updated weights for policy 0, policy_version 1124043 (0.0006) [2023-12-28 03:20:12,231][106226] Updated weights for policy 0, policy_version 1124053 (0.0006) [2023-12-28 03:20:12,846][106226] Updated weights for policy 0, policy_version 1124063 (0.0009) [2023-12-28 03:20:12,900][106225] Updated weights for policy 1, policy_version 1126969 (0.0007) [2023-12-28 03:20:12,905][106226] Updated weights for policy 0, policy_version 1124073 (0.0007) [2023-12-28 03:20:12,955][106226] Updated weights for policy 0, policy_version 1124083 (0.0005) [2023-12-28 03:20:12,956][106225] Updated weights for policy 1, policy_version 1126979 (0.0008) [2023-12-28 03:20:13,012][106225] Updated weights for policy 1, policy_version 1126989 (0.0007) [2023-12-28 03:20:13,665][106225] Updated weights for policy 1, policy_version 1126999 (0.0005) [2023-12-28 03:20:13,722][106225] Updated weights for policy 1, policy_version 1127009 (0.0007) [2023-12-28 03:20:13,727][106226] Updated weights for policy 0, policy_version 1124093 (0.0007) [2023-12-28 03:20:13,780][106226] Updated weights for policy 0, policy_version 1124103 (0.0007) [2023-12-28 03:20:13,782][106225] Updated weights for policy 1, policy_version 1127019 (0.0006) [2023-12-28 03:20:13,839][106226] Updated weights for policy 0, policy_version 1124113 (0.0007) [2023-12-28 03:20:14,401][106225] Updated weights for policy 1, policy_version 1127029 (0.0007) [2023-12-28 03:20:14,445][106225] Updated weights for policy 1, policy_version 1127039 (0.0008) [2023-12-28 03:20:14,493][106225] Updated weights for policy 1, policy_version 1127049 (0.0008) [2023-12-28 03:20:14,563][106226] Updated weights for policy 0, policy_version 1124123 (0.0009) [2023-12-28 03:20:14,615][106226] Updated weights for policy 0, policy_version 1124133 (0.0009) [2023-12-28 03:20:14,660][106226] Updated weights for policy 0, policy_version 1124143 (0.0009) [2023-12-28 03:20:15,262][106225] Updated weights for policy 1, policy_version 1127059 (0.0009) [2023-12-28 03:20:15,326][106225] Updated weights for policy 1, policy_version 1127069 (0.0009) [2023-12-28 03:20:15,392][106225] Updated weights for policy 1, policy_version 1127079 (0.0010) [2023-12-28 03:20:15,422][106226] Updated weights for policy 0, policy_version 1124153 (0.0008) [2023-12-28 03:20:15,482][106226] Updated weights for policy 0, policy_version 1124163 (0.0008) [2023-12-28 03:20:15,540][106226] Updated weights for policy 0, policy_version 1124173 (0.0011) [2023-12-28 03:20:15,593][106226] Updated weights for policy 0, policy_version 1124183 (0.0007) [2023-12-28 03:20:16,113][106225] Updated weights for policy 1, policy_version 1127089 (0.0008) [2023-12-28 03:20:16,167][106225] Updated weights for policy 1, policy_version 1127099 (0.0007) [2023-12-28 03:20:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 576430080. Throughput: 0: 9788.4, 1: 9810.3. Samples: 576425820. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:16,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.872')] [2023-12-28 03:20:16,195][106226] Updated weights for policy 0, policy_version 1124193 (0.0010) [2023-12-28 03:20:16,224][106225] Updated weights for policy 1, policy_version 1127109 (0.0006) [2023-12-28 03:20:16,245][106226] Updated weights for policy 0, policy_version 1124203 (0.0010) [2023-12-28 03:20:16,279][106225] Updated weights for policy 1, policy_version 1127119 (0.0005) [2023-12-28 03:20:16,296][106226] Updated weights for policy 0, policy_version 1124213 (0.0010) [2023-12-28 03:20:16,888][106225] Updated weights for policy 1, policy_version 1127129 (0.0007) [2023-12-28 03:20:16,951][106225] Updated weights for policy 1, policy_version 1127139 (0.0008) [2023-12-28 03:20:16,999][106226] Updated weights for policy 0, policy_version 1124223 (0.0007) [2023-12-28 03:20:17,004][106225] Updated weights for policy 1, policy_version 1127149 (0.0008) [2023-12-28 03:20:17,052][106226] Updated weights for policy 0, policy_version 1124233 (0.0005) [2023-12-28 03:20:17,107][106226] Updated weights for policy 0, policy_version 1124243 (0.0006) [2023-12-28 03:20:17,745][106225] Updated weights for policy 1, policy_version 1127159 (0.0006) [2023-12-28 03:20:17,784][106226] Updated weights for policy 0, policy_version 1124253 (0.0010) [2023-12-28 03:20:17,806][106225] Updated weights for policy 1, policy_version 1127169 (0.0006) [2023-12-28 03:20:17,842][106226] Updated weights for policy 0, policy_version 1124263 (0.0011) [2023-12-28 03:20:17,866][106225] Updated weights for policy 1, policy_version 1127179 (0.0007) [2023-12-28 03:20:17,906][106226] Updated weights for policy 0, policy_version 1124273 (0.0007) [2023-12-28 03:20:18,510][106225] Updated weights for policy 1, policy_version 1127189 (0.0008) [2023-12-28 03:20:18,570][106225] Updated weights for policy 1, policy_version 1127199 (0.0008) [2023-12-28 03:20:18,607][106226] Updated weights for policy 0, policy_version 1124283 (0.0006) [2023-12-28 03:20:18,630][106225] Updated weights for policy 1, policy_version 1127209 (0.0008) [2023-12-28 03:20:18,663][106226] Updated weights for policy 0, policy_version 1124293 (0.0008) [2023-12-28 03:20:18,724][106226] Updated weights for policy 0, policy_version 1124303 (0.0011) [2023-12-28 03:20:19,355][106226] Updated weights for policy 0, policy_version 1124313 (0.0010) [2023-12-28 03:20:19,389][106225] Updated weights for policy 1, policy_version 1127219 (0.0008) [2023-12-28 03:20:19,425][106226] Updated weights for policy 0, policy_version 1124323 (0.0009) [2023-12-28 03:20:19,449][106225] Updated weights for policy 1, policy_version 1127229 (0.0008) [2023-12-28 03:20:19,488][106226] Updated weights for policy 0, policy_version 1124333 (0.0009) [2023-12-28 03:20:19,509][106225] Updated weights for policy 1, policy_version 1127239 (0.0007) [2023-12-28 03:20:19,558][106226] Updated weights for policy 0, policy_version 1124343 (0.0008) [2023-12-28 03:20:20,255][106225] Updated weights for policy 1, policy_version 1127249 (0.0006) [2023-12-28 03:20:20,308][106226] Updated weights for policy 0, policy_version 1124353 (0.0006) [2023-12-28 03:20:20,314][106225] Updated weights for policy 1, policy_version 1127259 (0.0010) [2023-12-28 03:20:20,367][106226] Updated weights for policy 0, policy_version 1124363 (0.0006) [2023-12-28 03:20:20,376][106225] Updated weights for policy 1, policy_version 1127269 (0.0011) [2023-12-28 03:20:20,426][106226] Updated weights for policy 0, policy_version 1124373 (0.0006) [2023-12-28 03:20:20,438][106225] Updated weights for policy 1, policy_version 1127279 (0.0010) [2023-12-28 03:20:21,167][106225] Updated weights for policy 1, policy_version 1127289 (0.0009) [2023-12-28 03:20:21,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 576528384. Throughput: 0: 9874.2, 1: 9676.1. Samples: 576544376. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:21,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.797')] [2023-12-28 03:20:21,192][106226] Updated weights for policy 0, policy_version 1124383 (0.0008) [2023-12-28 03:20:21,221][106225] Updated weights for policy 1, policy_version 1127299 (0.0007) [2023-12-28 03:20:21,256][106226] Updated weights for policy 0, policy_version 1124393 (0.0007) [2023-12-28 03:20:21,286][106225] Updated weights for policy 1, policy_version 1127309 (0.0007) [2023-12-28 03:20:21,322][106226] Updated weights for policy 0, policy_version 1124403 (0.0008) [2023-12-28 03:20:22,053][106226] Updated weights for policy 0, policy_version 1124413 (0.0007) [2023-12-28 03:20:22,071][106225] Updated weights for policy 1, policy_version 1127319 (0.0007) [2023-12-28 03:20:22,113][106226] Updated weights for policy 0, policy_version 1124423 (0.0005) [2023-12-28 03:20:22,130][106225] Updated weights for policy 1, policy_version 1127329 (0.0008) [2023-12-28 03:20:22,171][106226] Updated weights for policy 0, policy_version 1124433 (0.0006) [2023-12-28 03:20:22,184][106225] Updated weights for policy 1, policy_version 1127339 (0.0008) [2023-12-28 03:20:22,886][106226] Updated weights for policy 0, policy_version 1124443 (0.0007) [2023-12-28 03:20:22,912][106225] Updated weights for policy 1, policy_version 1127349 (0.0006) [2023-12-28 03:20:22,949][106226] Updated weights for policy 0, policy_version 1124453 (0.0008) [2023-12-28 03:20:22,976][106225] Updated weights for policy 1, policy_version 1127359 (0.0006) [2023-12-28 03:20:23,009][106226] Updated weights for policy 0, policy_version 1124463 (0.0008) [2023-12-28 03:20:23,038][106225] Updated weights for policy 1, policy_version 1127369 (0.0006) [2023-12-28 03:20:23,666][106226] Updated weights for policy 0, policy_version 1124473 (0.0006) [2023-12-28 03:20:23,730][106226] Updated weights for policy 0, policy_version 1124483 (0.0008) [2023-12-28 03:20:23,771][106225] Updated weights for policy 1, policy_version 1127379 (0.0008) [2023-12-28 03:20:23,794][106226] Updated weights for policy 0, policy_version 1124493 (0.0007) [2023-12-28 03:20:23,815][106225] Updated weights for policy 1, policy_version 1127389 (0.0005) [2023-12-28 03:20:23,850][106226] Updated weights for policy 0, policy_version 1124503 (0.0006) [2023-12-28 03:20:23,868][106225] Updated weights for policy 1, policy_version 1127399 (0.0005) [2023-12-28 03:20:24,392][106225] Updated weights for policy 1, policy_version 1127409 (0.0005) [2023-12-28 03:20:24,441][106225] Updated weights for policy 1, policy_version 1127419 (0.0007) [2023-12-28 03:20:24,494][106225] Updated weights for policy 1, policy_version 1127429 (0.0005) [2023-12-28 03:20:24,545][106225] Updated weights for policy 1, policy_version 1127439 (0.0006) [2023-12-28 03:20:24,619][106226] Updated weights for policy 0, policy_version 1124513 (0.0009) [2023-12-28 03:20:24,671][106226] Updated weights for policy 0, policy_version 1124523 (0.0009) [2023-12-28 03:20:24,730][106226] Updated weights for policy 0, policy_version 1124533 (0.0009) [2023-12-28 03:20:25,132][106225] Updated weights for policy 1, policy_version 1127449 (0.0006) [2023-12-28 03:20:25,192][106225] Updated weights for policy 1, policy_version 1127459 (0.0007) [2023-12-28 03:20:25,243][106225] Updated weights for policy 1, policy_version 1127469 (0.0008) [2023-12-28 03:20:25,521][106226] Updated weights for policy 0, policy_version 1124543 (0.0010) [2023-12-28 03:20:25,579][106226] Updated weights for policy 0, policy_version 1124553 (0.0008) [2023-12-28 03:20:25,640][106226] Updated weights for policy 0, policy_version 1124563 (0.0009) [2023-12-28 03:20:25,861][106225] Updated weights for policy 1, policy_version 1127479 (0.0008) [2023-12-28 03:20:25,922][106225] Updated weights for policy 1, policy_version 1127489 (0.0008) [2023-12-28 03:20:25,977][106225] Updated weights for policy 1, policy_version 1127499 (0.0008) [2023-12-28 03:20:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 576634880. Throughput: 0: 9868.2, 1: 9587.9. Samples: 576600252. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:26,176][105115] Avg episode reward: [(0, '-4.668'), (1, '-4.761')] [2023-12-28 03:20:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001124568_287948800.pth... [2023-12-28 03:20:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001127504_288686080.pth... [2023-12-28 03:20:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001126352_288391168.pth [2023-12-28 03:20:26,197][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001123416_287653888.pth [2023-12-28 03:20:26,431][106226] Updated weights for policy 0, policy_version 1124573 (0.0009) [2023-12-28 03:20:26,495][106226] Updated weights for policy 0, policy_version 1124583 (0.0009) [2023-12-28 03:20:26,554][106226] Updated weights for policy 0, policy_version 1124593 (0.0008) [2023-12-28 03:20:26,583][106225] Updated weights for policy 1, policy_version 1127509 (0.0007) [2023-12-28 03:20:26,628][106225] Updated weights for policy 1, policy_version 1127519 (0.0005) [2023-12-28 03:20:26,681][106225] Updated weights for policy 1, policy_version 1127529 (0.0005) [2023-12-28 03:20:27,281][106226] Updated weights for policy 0, policy_version 1124603 (0.0008) [2023-12-28 03:20:27,322][106225] Updated weights for policy 1, policy_version 1127539 (0.0007) [2023-12-28 03:20:27,342][106226] Updated weights for policy 0, policy_version 1124613 (0.0007) [2023-12-28 03:20:27,381][106225] Updated weights for policy 1, policy_version 1127549 (0.0007) [2023-12-28 03:20:27,390][106226] Updated weights for policy 0, policy_version 1124623 (0.0005) [2023-12-28 03:20:27,439][106225] Updated weights for policy 1, policy_version 1127559 (0.0008) [2023-12-28 03:20:28,083][106226] Updated weights for policy 0, policy_version 1124633 (0.0008) [2023-12-28 03:20:28,131][106226] Updated weights for policy 0, policy_version 1124643 (0.0009) [2023-12-28 03:20:28,146][106225] Updated weights for policy 1, policy_version 1127569 (0.0007) [2023-12-28 03:20:28,176][106226] Updated weights for policy 0, policy_version 1124653 (0.0006) [2023-12-28 03:20:28,196][106225] Updated weights for policy 1, policy_version 1127579 (0.0006) [2023-12-28 03:20:28,218][106226] Updated weights for policy 0, policy_version 1124663 (0.0005) [2023-12-28 03:20:28,245][106225] Updated weights for policy 1, policy_version 1127589 (0.0007) [2023-12-28 03:20:28,302][106225] Updated weights for policy 1, policy_version 1127599 (0.0008) [2023-12-28 03:20:28,960][106226] Updated weights for policy 0, policy_version 1124673 (0.0005) [2023-12-28 03:20:29,011][106226] Updated weights for policy 0, policy_version 1124683 (0.0006) [2023-12-28 03:20:29,069][106225] Updated weights for policy 1, policy_version 1127609 (0.0007) [2023-12-28 03:20:29,071][106226] Updated weights for policy 0, policy_version 1124693 (0.0007) [2023-12-28 03:20:29,127][106225] Updated weights for policy 1, policy_version 1127619 (0.0007) [2023-12-28 03:20:29,191][106225] Updated weights for policy 1, policy_version 1127629 (0.0008) [2023-12-28 03:20:29,747][106226] Updated weights for policy 0, policy_version 1124703 (0.0007) [2023-12-28 03:20:29,812][106226] Updated weights for policy 0, policy_version 1124713 (0.0007) [2023-12-28 03:20:29,879][106226] Updated weights for policy 0, policy_version 1124723 (0.0008) [2023-12-28 03:20:29,956][106225] Updated weights for policy 1, policy_version 1127639 (0.0008) [2023-12-28 03:20:30,019][106225] Updated weights for policy 1, policy_version 1127649 (0.0008) [2023-12-28 03:20:30,081][106225] Updated weights for policy 1, policy_version 1127659 (0.0008) [2023-12-28 03:20:30,577][106226] Updated weights for policy 0, policy_version 1124733 (0.0007) [2023-12-28 03:20:30,635][106226] Updated weights for policy 0, policy_version 1124743 (0.0007) [2023-12-28 03:20:30,689][106226] Updated weights for policy 0, policy_version 1124753 (0.0005) [2023-12-28 03:20:30,715][106225] Updated weights for policy 1, policy_version 1127669 (0.0006) [2023-12-28 03:20:30,764][106225] Updated weights for policy 1, policy_version 1127679 (0.0008) [2023-12-28 03:20:30,812][106225] Updated weights for policy 1, policy_version 1127689 (0.0008) [2023-12-28 03:20:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 576733184. Throughput: 0: 9812.6, 1: 9794.0. Samples: 576721144. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:31,175][105115] Avg episode reward: [(0, '-4.681'), (1, '-4.779')] [2023-12-28 03:20:31,399][106226] Updated weights for policy 0, policy_version 1124763 (0.0008) [2023-12-28 03:20:31,449][106226] Updated weights for policy 0, policy_version 1124773 (0.0009) [2023-12-28 03:20:31,501][106226] Updated weights for policy 0, policy_version 1124783 (0.0008) [2023-12-28 03:20:31,585][106225] Updated weights for policy 1, policy_version 1127699 (0.0008) [2023-12-28 03:20:31,646][106225] Updated weights for policy 1, policy_version 1127709 (0.0007) [2023-12-28 03:20:31,707][106225] Updated weights for policy 1, policy_version 1127719 (0.0008) [2023-12-28 03:20:32,332][106226] Updated weights for policy 0, policy_version 1124793 (0.0008) [2023-12-28 03:20:32,356][106225] Updated weights for policy 1, policy_version 1127729 (0.0007) [2023-12-28 03:20:32,402][106226] Updated weights for policy 0, policy_version 1124803 (0.0008) [2023-12-28 03:20:32,434][106225] Updated weights for policy 1, policy_version 1127739 (0.0008) [2023-12-28 03:20:32,465][106226] Updated weights for policy 0, policy_version 1124813 (0.0008) [2023-12-28 03:20:32,493][106225] Updated weights for policy 1, policy_version 1127749 (0.0008) [2023-12-28 03:20:32,526][106226] Updated weights for policy 0, policy_version 1124823 (0.0011) [2023-12-28 03:20:32,551][106225] Updated weights for policy 1, policy_version 1127759 (0.0006) [2023-12-28 03:20:33,205][106226] Updated weights for policy 0, policy_version 1124833 (0.0006) [2023-12-28 03:20:33,237][106225] Updated weights for policy 1, policy_version 1127769 (0.0010) [2023-12-28 03:20:33,259][106226] Updated weights for policy 0, policy_version 1124843 (0.0005) [2023-12-28 03:20:33,298][106225] Updated weights for policy 1, policy_version 1127779 (0.0008) [2023-12-28 03:20:33,327][106226] Updated weights for policy 0, policy_version 1124853 (0.0010) [2023-12-28 03:20:33,357][106225] Updated weights for policy 1, policy_version 1127789 (0.0006) [2023-12-28 03:20:33,974][106226] Updated weights for policy 0, policy_version 1124863 (0.0011) [2023-12-28 03:20:33,981][106225] Updated weights for policy 1, policy_version 1127799 (0.0008) [2023-12-28 03:20:34,026][106226] Updated weights for policy 0, policy_version 1124873 (0.0010) [2023-12-28 03:20:34,031][106225] Updated weights for policy 1, policy_version 1127809 (0.0005) [2023-12-28 03:20:34,080][106226] Updated weights for policy 0, policy_version 1124883 (0.0010) [2023-12-28 03:20:34,081][106225] Updated weights for policy 1, policy_version 1127819 (0.0006) [2023-12-28 03:20:34,705][106226] Updated weights for policy 0, policy_version 1124893 (0.0010) [2023-12-28 03:20:34,741][106225] Updated weights for policy 1, policy_version 1127829 (0.0007) [2023-12-28 03:20:34,763][106226] Updated weights for policy 0, policy_version 1124903 (0.0008) [2023-12-28 03:20:34,800][106225] Updated weights for policy 1, policy_version 1127839 (0.0008) [2023-12-28 03:20:34,824][106226] Updated weights for policy 0, policy_version 1124913 (0.0010) [2023-12-28 03:20:34,851][106225] Updated weights for policy 1, policy_version 1127849 (0.0006) [2023-12-28 03:20:35,465][106226] Updated weights for policy 0, policy_version 1124923 (0.0009) [2023-12-28 03:20:35,523][106226] Updated weights for policy 0, policy_version 1124933 (0.0005) [2023-12-28 03:20:35,554][106225] Updated weights for policy 1, policy_version 1127859 (0.0007) [2023-12-28 03:20:35,582][106226] Updated weights for policy 0, policy_version 1124943 (0.0005) [2023-12-28 03:20:35,602][106225] Updated weights for policy 1, policy_version 1127869 (0.0008) [2023-12-28 03:20:35,648][106225] Updated weights for policy 1, policy_version 1127879 (0.0006) [2023-12-28 03:20:36,161][106226] Updated weights for policy 0, policy_version 1124953 (0.0006) [2023-12-28 03:20:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 576831488. Throughput: 0: 9821.9, 1: 9917.3. Samples: 576843744. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:36,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-4.603')] [2023-12-28 03:20:36,220][106226] Updated weights for policy 0, policy_version 1124963 (0.0008) [2023-12-28 03:20:36,283][106226] Updated weights for policy 0, policy_version 1124973 (0.0008) [2023-12-28 03:20:36,285][106225] Updated weights for policy 1, policy_version 1127889 (0.0006) [2023-12-28 03:20:36,338][106226] Updated weights for policy 0, policy_version 1124983 (0.0006) [2023-12-28 03:20:36,347][106225] Updated weights for policy 1, policy_version 1127899 (0.0011) [2023-12-28 03:20:36,401][106225] Updated weights for policy 1, policy_version 1127909 (0.0010) [2023-12-28 03:20:36,459][106225] Updated weights for policy 1, policy_version 1127919 (0.0010) [2023-12-28 03:20:37,064][106226] Updated weights for policy 0, policy_version 1124993 (0.0008) [2023-12-28 03:20:37,122][106226] Updated weights for policy 0, policy_version 1125003 (0.0008) [2023-12-28 03:20:37,181][106226] Updated weights for policy 0, policy_version 1125013 (0.0006) [2023-12-28 03:20:37,195][106225] Updated weights for policy 1, policy_version 1127929 (0.0011) [2023-12-28 03:20:37,253][106225] Updated weights for policy 1, policy_version 1127939 (0.0010) [2023-12-28 03:20:37,312][106225] Updated weights for policy 1, policy_version 1127949 (0.0010) [2023-12-28 03:20:37,838][106226] Updated weights for policy 0, policy_version 1125023 (0.0007) [2023-12-28 03:20:37,895][106226] Updated weights for policy 0, policy_version 1125033 (0.0008) [2023-12-28 03:20:37,958][106226] Updated weights for policy 0, policy_version 1125043 (0.0008) [2023-12-28 03:20:38,042][106225] Updated weights for policy 1, policy_version 1127959 (0.0010) [2023-12-28 03:20:38,102][106225] Updated weights for policy 1, policy_version 1127969 (0.0010) [2023-12-28 03:20:38,155][106225] Updated weights for policy 1, policy_version 1127979 (0.0010) [2023-12-28 03:20:38,646][106226] Updated weights for policy 0, policy_version 1125053 (0.0008) [2023-12-28 03:20:38,707][106226] Updated weights for policy 0, policy_version 1125063 (0.0008) [2023-12-28 03:20:38,764][106226] Updated weights for policy 0, policy_version 1125073 (0.0008) [2023-12-28 03:20:38,818][106225] Updated weights for policy 1, policy_version 1127989 (0.0008) [2023-12-28 03:20:38,876][106225] Updated weights for policy 1, policy_version 1127999 (0.0010) [2023-12-28 03:20:38,940][106225] Updated weights for policy 1, policy_version 1128009 (0.0010) [2023-12-28 03:20:39,563][106226] Updated weights for policy 0, policy_version 1125083 (0.0009) [2023-12-28 03:20:39,637][106226] Updated weights for policy 0, policy_version 1125093 (0.0008) [2023-12-28 03:20:39,658][106225] Updated weights for policy 1, policy_version 1128019 (0.0009) [2023-12-28 03:20:39,725][106226] Updated weights for policy 0, policy_version 1125103 (0.0008) [2023-12-28 03:20:39,726][106225] Updated weights for policy 1, policy_version 1128029 (0.0009) [2023-12-28 03:20:39,792][106225] Updated weights for policy 1, policy_version 1128039 (0.0008) [2023-12-28 03:20:40,475][106226] Updated weights for policy 0, policy_version 1125113 (0.0007) [2023-12-28 03:20:40,475][106225] Updated weights for policy 1, policy_version 1128049 (0.0010) [2023-12-28 03:20:40,523][106226] Updated weights for policy 0, policy_version 1125123 (0.0007) [2023-12-28 03:20:40,530][106225] Updated weights for policy 1, policy_version 1128059 (0.0010) [2023-12-28 03:20:40,571][106226] Updated weights for policy 0, policy_version 1125133 (0.0005) [2023-12-28 03:20:40,580][106225] Updated weights for policy 1, policy_version 1128069 (0.0010) [2023-12-28 03:20:40,615][106226] Updated weights for policy 0, policy_version 1125143 (0.0010) [2023-12-28 03:20:40,627][106225] Updated weights for policy 1, policy_version 1128079 (0.0010) [2023-12-28 03:20:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 576929792. Throughput: 0: 9813.0, 1: 9986.1. Samples: 576903280. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:41,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.975')] [2023-12-28 03:20:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001128080_288833536.pth... [2023-12-28 03:20:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001125144_288096256.pth... [2023-12-28 03:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001126928_288538624.pth [2023-12-28 03:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001123992_287801344.pth [2023-12-28 03:20:41,408][106226] Updated weights for policy 0, policy_version 1125153 (0.0008) [2023-12-28 03:20:41,456][106225] Updated weights for policy 1, policy_version 1128089 (0.0007) [2023-12-28 03:20:41,463][106226] Updated weights for policy 0, policy_version 1125163 (0.0007) [2023-12-28 03:20:41,517][106225] Updated weights for policy 1, policy_version 1128099 (0.0006) [2023-12-28 03:20:41,531][106226] Updated weights for policy 0, policy_version 1125173 (0.0009) [2023-12-28 03:20:41,579][106225] Updated weights for policy 1, policy_version 1128109 (0.0009) [2023-12-28 03:20:42,238][106226] Updated weights for policy 0, policy_version 1125183 (0.0009) [2023-12-28 03:20:42,307][106226] Updated weights for policy 0, policy_version 1125193 (0.0009) [2023-12-28 03:20:42,373][106226] Updated weights for policy 0, policy_version 1125203 (0.0009) [2023-12-28 03:20:42,410][106225] Updated weights for policy 1, policy_version 1128119 (0.0009) [2023-12-28 03:20:42,472][106225] Updated weights for policy 1, policy_version 1128129 (0.0005) [2023-12-28 03:20:42,530][106225] Updated weights for policy 1, policy_version 1128139 (0.0005) [2023-12-28 03:20:43,076][106226] Updated weights for policy 0, policy_version 1125213 (0.0009) [2023-12-28 03:20:43,137][106226] Updated weights for policy 0, policy_version 1125223 (0.0011) [2023-12-28 03:20:43,197][106226] Updated weights for policy 0, policy_version 1125233 (0.0011) [2023-12-28 03:20:43,204][106225] Updated weights for policy 1, policy_version 1128149 (0.0006) [2023-12-28 03:20:43,267][106225] Updated weights for policy 1, policy_version 1128159 (0.0008) [2023-12-28 03:20:43,336][106225] Updated weights for policy 1, policy_version 1128169 (0.0010) [2023-12-28 03:20:43,767][106226] Updated weights for policy 0, policy_version 1125243 (0.0006) [2023-12-28 03:20:43,822][106226] Updated weights for policy 0, policy_version 1125253 (0.0005) [2023-12-28 03:20:43,881][106226] Updated weights for policy 0, policy_version 1125263 (0.0006) [2023-12-28 03:20:43,897][106225] Updated weights for policy 1, policy_version 1128179 (0.0008) [2023-12-28 03:20:43,953][106225] Updated weights for policy 1, policy_version 1128189 (0.0005) [2023-12-28 03:20:44,002][106225] Updated weights for policy 1, policy_version 1128199 (0.0005) [2023-12-28 03:20:44,404][106226] Updated weights for policy 0, policy_version 1125273 (0.0005) [2023-12-28 03:20:44,472][106226] Updated weights for policy 0, policy_version 1125283 (0.0005) [2023-12-28 03:20:44,536][106226] Updated weights for policy 0, policy_version 1125293 (0.0005) [2023-12-28 03:20:44,552][106225] Updated weights for policy 1, policy_version 1128209 (0.0006) [2023-12-28 03:20:44,602][106226] Updated weights for policy 0, policy_version 1125303 (0.0008) [2023-12-28 03:20:44,608][106225] Updated weights for policy 1, policy_version 1128219 (0.0007) [2023-12-28 03:20:44,655][106225] Updated weights for policy 1, policy_version 1128229 (0.0007) [2023-12-28 03:20:44,701][106225] Updated weights for policy 1, policy_version 1128239 (0.0008) [2023-12-28 03:20:45,232][106226] Updated weights for policy 0, policy_version 1125313 (0.0006) [2023-12-28 03:20:45,282][106226] Updated weights for policy 0, policy_version 1125323 (0.0006) [2023-12-28 03:20:45,335][106226] Updated weights for policy 0, policy_version 1125333 (0.0005) [2023-12-28 03:20:45,513][106225] Updated weights for policy 1, policy_version 1128249 (0.0009) [2023-12-28 03:20:45,571][106225] Updated weights for policy 1, policy_version 1128259 (0.0008) [2023-12-28 03:20:45,632][106225] Updated weights for policy 1, policy_version 1128269 (0.0008) [2023-12-28 03:20:45,957][106226] Updated weights for policy 0, policy_version 1125343 (0.0009) [2023-12-28 03:20:46,014][106226] Updated weights for policy 0, policy_version 1125353 (0.0011) [2023-12-28 03:20:46,069][106226] Updated weights for policy 0, policy_version 1125363 (0.0010) [2023-12-28 03:20:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 577036288. Throughput: 0: 9795.1, 1: 9993.7. Samples: 577023696. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:46,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.677')] [2023-12-28 03:20:46,367][106225] Updated weights for policy 1, policy_version 1128279 (0.0006) [2023-12-28 03:20:46,413][106225] Updated weights for policy 1, policy_version 1128289 (0.0005) [2023-12-28 03:20:46,460][106225] Updated weights for policy 1, policy_version 1128299 (0.0005) [2023-12-28 03:20:46,692][106226] Updated weights for policy 0, policy_version 1125373 (0.0009) [2023-12-28 03:20:46,750][106226] Updated weights for policy 0, policy_version 1125383 (0.0008) [2023-12-28 03:20:46,806][106226] Updated weights for policy 0, policy_version 1125393 (0.0009) [2023-12-28 03:20:47,056][106225] Updated weights for policy 1, policy_version 1128309 (0.0007) [2023-12-28 03:20:47,105][106225] Updated weights for policy 1, policy_version 1128319 (0.0008) [2023-12-28 03:20:47,157][106225] Updated weights for policy 1, policy_version 1128329 (0.0008) [2023-12-28 03:20:47,551][106226] Updated weights for policy 0, policy_version 1125403 (0.0009) [2023-12-28 03:20:47,602][106226] Updated weights for policy 0, policy_version 1125413 (0.0010) [2023-12-28 03:20:47,648][106226] Updated weights for policy 0, policy_version 1125423 (0.0009) [2023-12-28 03:20:47,764][106225] Updated weights for policy 1, policy_version 1128339 (0.0007) [2023-12-28 03:20:47,814][106225] Updated weights for policy 1, policy_version 1128349 (0.0009) [2023-12-28 03:20:47,864][106225] Updated weights for policy 1, policy_version 1128360 (0.0008) [2023-12-28 03:20:48,232][106226] Updated weights for policy 0, policy_version 1125433 (0.0006) [2023-12-28 03:20:48,283][106226] Updated weights for policy 0, policy_version 1125443 (0.0010) [2023-12-28 03:20:48,341][106226] Updated weights for policy 0, policy_version 1125453 (0.0011) [2023-12-28 03:20:48,403][106226] Updated weights for policy 0, policy_version 1125463 (0.0011) [2023-12-28 03:20:48,697][106225] Updated weights for policy 1, policy_version 1128370 (0.0008) [2023-12-28 03:20:48,748][106225] Updated weights for policy 1, policy_version 1128380 (0.0007) [2023-12-28 03:20:48,803][106225] Updated weights for policy 1, policy_version 1128390 (0.0005) [2023-12-28 03:20:48,861][106225] Updated weights for policy 1, policy_version 1128400 (0.0006) [2023-12-28 03:20:49,146][106226] Updated weights for policy 0, policy_version 1125473 (0.0011) [2023-12-28 03:20:49,216][106226] Updated weights for policy 0, policy_version 1125483 (0.0011) [2023-12-28 03:20:49,282][106226] Updated weights for policy 0, policy_version 1125493 (0.0011) [2023-12-28 03:20:49,558][106225] Updated weights for policy 1, policy_version 1128410 (0.0007) [2023-12-28 03:20:49,618][106225] Updated weights for policy 1, policy_version 1128420 (0.0006) [2023-12-28 03:20:49,670][106225] Updated weights for policy 1, policy_version 1128430 (0.0007) [2023-12-28 03:20:50,014][106226] Updated weights for policy 0, policy_version 1125503 (0.0009) [2023-12-28 03:20:50,072][106226] Updated weights for policy 0, policy_version 1125513 (0.0008) [2023-12-28 03:20:50,127][106226] Updated weights for policy 0, policy_version 1125523 (0.0008) [2023-12-28 03:20:50,415][106225] Updated weights for policy 1, policy_version 1128440 (0.0007) [2023-12-28 03:20:50,479][106225] Updated weights for policy 1, policy_version 1128450 (0.0009) [2023-12-28 03:20:50,540][106225] Updated weights for policy 1, policy_version 1128460 (0.0007) [2023-12-28 03:20:50,860][106226] Updated weights for policy 0, policy_version 1125533 (0.0010) [2023-12-28 03:20:50,921][106226] Updated weights for policy 0, policy_version 1125543 (0.0010) [2023-12-28 03:20:50,968][106226] Updated weights for policy 0, policy_version 1125553 (0.0010) [2023-12-28 03:20:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 577134592. Throughput: 0: 9866.1, 1: 9908.8. Samples: 577144052. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:51,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.860')] [2023-12-28 03:20:51,281][106225] Updated weights for policy 1, policy_version 1128470 (0.0008) [2023-12-28 03:20:51,336][106225] Updated weights for policy 1, policy_version 1128480 (0.0008) [2023-12-28 03:20:51,404][106225] Updated weights for policy 1, policy_version 1128490 (0.0009) [2023-12-28 03:20:51,601][106226] Updated weights for policy 0, policy_version 1125563 (0.0009) [2023-12-28 03:20:51,667][106226] Updated weights for policy 0, policy_version 1125573 (0.0008) [2023-12-28 03:20:51,733][106226] Updated weights for policy 0, policy_version 1125583 (0.0008) [2023-12-28 03:20:52,176][106225] Updated weights for policy 1, policy_version 1128500 (0.0009) [2023-12-28 03:20:52,227][106225] Updated weights for policy 1, policy_version 1128510 (0.0008) [2023-12-28 03:20:52,286][106225] Updated weights for policy 1, policy_version 1128520 (0.0008) [2023-12-28 03:20:52,336][106226] Updated weights for policy 0, policy_version 1125593 (0.0007) [2023-12-28 03:20:52,398][106226] Updated weights for policy 0, policy_version 1125603 (0.0007) [2023-12-28 03:20:52,461][106226] Updated weights for policy 0, policy_version 1125613 (0.0008) [2023-12-28 03:20:52,529][106226] Updated weights for policy 0, policy_version 1125623 (0.0008) [2023-12-28 03:20:53,110][106225] Updated weights for policy 1, policy_version 1128530 (0.0008) [2023-12-28 03:20:53,136][106226] Updated weights for policy 0, policy_version 1125633 (0.0006) [2023-12-28 03:20:53,172][106225] Updated weights for policy 1, policy_version 1128540 (0.0007) [2023-12-28 03:20:53,192][106226] Updated weights for policy 0, policy_version 1125643 (0.0007) [2023-12-28 03:20:53,233][106225] Updated weights for policy 1, policy_version 1128550 (0.0006) [2023-12-28 03:20:53,248][106226] Updated weights for policy 0, policy_version 1125653 (0.0006) [2023-12-28 03:20:53,291][106225] Updated weights for policy 1, policy_version 1128560 (0.0007) [2023-12-28 03:20:53,902][106225] Updated weights for policy 1, policy_version 1128570 (0.0005) [2023-12-28 03:20:53,951][106226] Updated weights for policy 0, policy_version 1125663 (0.0007) [2023-12-28 03:20:53,961][106225] Updated weights for policy 1, policy_version 1128580 (0.0005) [2023-12-28 03:20:54,002][106226] Updated weights for policy 0, policy_version 1125673 (0.0008) [2023-12-28 03:20:54,018][106225] Updated weights for policy 1, policy_version 1128590 (0.0008) [2023-12-28 03:20:54,053][106226] Updated weights for policy 0, policy_version 1125683 (0.0008) [2023-12-28 03:20:54,675][106225] Updated weights for policy 1, policy_version 1128600 (0.0008) [2023-12-28 03:20:54,689][106226] Updated weights for policy 0, policy_version 1125693 (0.0008) [2023-12-28 03:20:54,719][106225] Updated weights for policy 1, policy_version 1128610 (0.0006) [2023-12-28 03:20:54,746][106226] Updated weights for policy 0, policy_version 1125703 (0.0008) [2023-12-28 03:20:54,764][106225] Updated weights for policy 1, policy_version 1128620 (0.0007) [2023-12-28 03:20:54,801][106226] Updated weights for policy 0, policy_version 1125713 (0.0007) [2023-12-28 03:20:55,538][106226] Updated weights for policy 0, policy_version 1125723 (0.0008) [2023-12-28 03:20:55,560][106225] Updated weights for policy 1, policy_version 1128630 (0.0007) [2023-12-28 03:20:55,597][106226] Updated weights for policy 0, policy_version 1125733 (0.0007) [2023-12-28 03:20:55,619][106225] Updated weights for policy 1, policy_version 1128640 (0.0006) [2023-12-28 03:20:55,662][106226] Updated weights for policy 0, policy_version 1125743 (0.0007) [2023-12-28 03:20:55,676][106225] Updated weights for policy 1, policy_version 1128650 (0.0006) [2023-12-28 03:20:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 577232896. Throughput: 0: 9926.3, 1: 9909.0. Samples: 577203408. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:20:56,176][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.764')] [2023-12-28 03:20:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001128656_288980992.pth... [2023-12-28 03:20:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001125752_288251904.pth... [2023-12-28 03:20:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001127504_288686080.pth [2023-12-28 03:20:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001124568_287948800.pth [2023-12-28 03:20:56,375][106225] Updated weights for policy 1, policy_version 1128660 (0.0006) [2023-12-28 03:20:56,376][106226] Updated weights for policy 0, policy_version 1125753 (0.0008) [2023-12-28 03:20:56,423][106226] Updated weights for policy 0, policy_version 1125763 (0.0010) [2023-12-28 03:20:56,424][106225] Updated weights for policy 1, policy_version 1128670 (0.0005) [2023-12-28 03:20:56,481][106226] Updated weights for policy 0, policy_version 1125773 (0.0010) [2023-12-28 03:20:56,482][106225] Updated weights for policy 1, policy_version 1128680 (0.0005) [2023-12-28 03:20:56,534][106226] Updated weights for policy 0, policy_version 1125783 (0.0010) [2023-12-28 03:20:57,087][106225] Updated weights for policy 1, policy_version 1128690 (0.0006) [2023-12-28 03:20:57,144][106225] Updated weights for policy 1, policy_version 1128700 (0.0008) [2023-12-28 03:20:57,200][106225] Updated weights for policy 1, policy_version 1128710 (0.0009) [2023-12-28 03:20:57,238][106226] Updated weights for policy 0, policy_version 1125793 (0.0006) [2023-12-28 03:20:57,264][106225] Updated weights for policy 1, policy_version 1128720 (0.0007) [2023-12-28 03:20:57,288][106226] Updated weights for policy 0, policy_version 1125803 (0.0008) [2023-12-28 03:20:57,351][106226] Updated weights for policy 0, policy_version 1125813 (0.0010) [2023-12-28 03:20:57,929][106226] Updated weights for policy 0, policy_version 1125823 (0.0009) [2023-12-28 03:20:57,982][106226] Updated weights for policy 0, policy_version 1125833 (0.0008) [2023-12-28 03:20:58,011][106225] Updated weights for policy 1, policy_version 1128730 (0.0006) [2023-12-28 03:20:58,044][106226] Updated weights for policy 0, policy_version 1125843 (0.0007) [2023-12-28 03:20:58,068][106225] Updated weights for policy 1, policy_version 1128740 (0.0005) [2023-12-28 03:20:58,130][106225] Updated weights for policy 1, policy_version 1128750 (0.0005) [2023-12-28 03:20:58,783][106226] Updated weights for policy 0, policy_version 1125853 (0.0008) [2023-12-28 03:20:58,838][106225] Updated weights for policy 1, policy_version 1128760 (0.0006) [2023-12-28 03:20:58,854][106226] Updated weights for policy 0, policy_version 1125863 (0.0009) [2023-12-28 03:20:58,907][106225] Updated weights for policy 1, policy_version 1128770 (0.0007) [2023-12-28 03:20:58,919][106226] Updated weights for policy 0, policy_version 1125873 (0.0008) [2023-12-28 03:20:58,973][106225] Updated weights for policy 1, policy_version 1128780 (0.0008) [2023-12-28 03:20:59,719][106226] Updated weights for policy 0, policy_version 1125883 (0.0009) [2023-12-28 03:20:59,757][106225] Updated weights for policy 1, policy_version 1128790 (0.0009) [2023-12-28 03:20:59,780][106226] Updated weights for policy 0, policy_version 1125893 (0.0006) [2023-12-28 03:20:59,824][106225] Updated weights for policy 1, policy_version 1128800 (0.0010) [2023-12-28 03:20:59,837][106226] Updated weights for policy 0, policy_version 1125903 (0.0009) [2023-12-28 03:20:59,886][106225] Updated weights for policy 1, policy_version 1128810 (0.0013) [2023-12-28 03:21:00,509][106226] Updated weights for policy 0, policy_version 1125913 (0.0011) [2023-12-28 03:21:00,525][106225] Updated weights for policy 1, policy_version 1128820 (0.0008) [2023-12-28 03:21:00,567][106226] Updated weights for policy 0, policy_version 1125923 (0.0011) [2023-12-28 03:21:00,579][106225] Updated weights for policy 1, policy_version 1128830 (0.0010) [2023-12-28 03:21:00,626][106226] Updated weights for policy 0, policy_version 1125933 (0.0011) [2023-12-28 03:21:00,638][106225] Updated weights for policy 1, policy_version 1128840 (0.0010) [2023-12-28 03:21:00,688][106226] Updated weights for policy 0, policy_version 1125943 (0.0010) [2023-12-28 03:21:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 577331200. Throughput: 0: 9985.7, 1: 9949.5. Samples: 577322904. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:21:01,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.765')] [2023-12-28 03:21:01,313][106225] Updated weights for policy 1, policy_version 1128850 (0.0010) [2023-12-28 03:21:01,375][106225] Updated weights for policy 1, policy_version 1128860 (0.0011) [2023-12-28 03:21:01,408][106226] Updated weights for policy 0, policy_version 1125953 (0.0009) [2023-12-28 03:21:01,436][106225] Updated weights for policy 1, policy_version 1128870 (0.0009) [2023-12-28 03:21:01,470][106226] Updated weights for policy 0, policy_version 1125963 (0.0008) [2023-12-28 03:21:01,502][106225] Updated weights for policy 1, policy_version 1128880 (0.0008) [2023-12-28 03:21:01,533][106226] Updated weights for policy 0, policy_version 1125973 (0.0007) [2023-12-28 03:21:02,188][106225] Updated weights for policy 1, policy_version 1128890 (0.0008) [2023-12-28 03:21:02,189][106226] Updated weights for policy 0, policy_version 1125983 (0.0006) [2023-12-28 03:21:02,243][106226] Updated weights for policy 0, policy_version 1125993 (0.0008) [2023-12-28 03:21:02,249][106225] Updated weights for policy 1, policy_version 1128900 (0.0005) [2023-12-28 03:21:02,304][106226] Updated weights for policy 0, policy_version 1126003 (0.0007) [2023-12-28 03:21:02,314][106225] Updated weights for policy 1, policy_version 1128910 (0.0006) [2023-12-28 03:21:02,939][106225] Updated weights for policy 1, policy_version 1128920 (0.0005) [2023-12-28 03:21:03,001][106225] Updated weights for policy 1, policy_version 1128930 (0.0005) [2023-12-28 03:21:03,034][106226] Updated weights for policy 0, policy_version 1126013 (0.0006) [2023-12-28 03:21:03,063][106225] Updated weights for policy 1, policy_version 1128940 (0.0005) [2023-12-28 03:21:03,092][106226] Updated weights for policy 0, policy_version 1126023 (0.0005) [2023-12-28 03:21:03,139][106226] Updated weights for policy 0, policy_version 1126033 (0.0005) [2023-12-28 03:21:03,664][106225] Updated weights for policy 1, policy_version 1128950 (0.0008) [2023-12-28 03:21:03,716][106225] Updated weights for policy 1, policy_version 1128960 (0.0008) [2023-12-28 03:21:03,765][106225] Updated weights for policy 1, policy_version 1128970 (0.0009) [2023-12-28 03:21:03,802][106226] Updated weights for policy 0, policy_version 1126043 (0.0005) [2023-12-28 03:21:03,872][106226] Updated weights for policy 0, policy_version 1126053 (0.0007) [2023-12-28 03:21:03,936][106226] Updated weights for policy 0, policy_version 1126063 (0.0007) [2023-12-28 03:21:04,511][106225] Updated weights for policy 1, policy_version 1128980 (0.0009) [2023-12-28 03:21:04,572][106225] Updated weights for policy 1, policy_version 1128990 (0.0010) [2023-12-28 03:21:04,634][106225] Updated weights for policy 1, policy_version 1129000 (0.0010) [2023-12-28 03:21:04,653][106226] Updated weights for policy 0, policy_version 1126073 (0.0007) [2023-12-28 03:21:04,713][106226] Updated weights for policy 0, policy_version 1126083 (0.0008) [2023-12-28 03:21:04,769][106226] Updated weights for policy 0, policy_version 1126093 (0.0009) [2023-12-28 03:21:04,828][106226] Updated weights for policy 0, policy_version 1126103 (0.0009) [2023-12-28 03:21:05,204][106225] Updated weights for policy 1, policy_version 1129010 (0.0007) [2023-12-28 03:21:05,253][106225] Updated weights for policy 1, policy_version 1129020 (0.0008) [2023-12-28 03:21:05,305][106225] Updated weights for policy 1, policy_version 1129030 (0.0010) [2023-12-28 03:21:05,368][106225] Updated weights for policy 1, policy_version 1129040 (0.0010) [2023-12-28 03:21:05,613][106226] Updated weights for policy 0, policy_version 1126113 (0.0008) [2023-12-28 03:21:05,662][106226] Updated weights for policy 0, policy_version 1126123 (0.0007) [2023-12-28 03:21:05,712][106226] Updated weights for policy 0, policy_version 1126133 (0.0008) [2023-12-28 03:21:06,098][106225] Updated weights for policy 1, policy_version 1129050 (0.0009) [2023-12-28 03:21:06,163][106225] Updated weights for policy 1, policy_version 1129060 (0.0007) [2023-12-28 03:21:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 577429504. Throughput: 0: 9933.3, 1: 10039.3. Samples: 577443144. Policy #0 lag: (min: 29.0, avg: 38.5, max: 61.0) [2023-12-28 03:21:06,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.817')] [2023-12-28 03:21:06,229][106225] Updated weights for policy 1, policy_version 1129070 (0.0007) [2023-12-28 03:21:06,499][106226] Updated weights for policy 0, policy_version 1126143 (0.0008) [2023-12-28 03:21:06,565][106226] Updated weights for policy 0, policy_version 1126153 (0.0010) [2023-12-28 03:21:06,629][106226] Updated weights for policy 0, policy_version 1126163 (0.0008) [2023-12-28 03:21:06,854][106225] Updated weights for policy 1, policy_version 1129080 (0.0010) [2023-12-28 03:21:06,921][106225] Updated weights for policy 1, policy_version 1129090 (0.0011) [2023-12-28 03:21:06,985][106225] Updated weights for policy 1, policy_version 1129100 (0.0010) [2023-12-28 03:21:07,276][106226] Updated weights for policy 0, policy_version 1126173 (0.0009) [2023-12-28 03:21:07,338][106226] Updated weights for policy 0, policy_version 1126183 (0.0010) [2023-12-28 03:21:07,395][106226] Updated weights for policy 0, policy_version 1126193 (0.0009) [2023-12-28 03:21:07,598][106225] Updated weights for policy 1, policy_version 1129110 (0.0009) [2023-12-28 03:21:07,659][106225] Updated weights for policy 1, policy_version 1129120 (0.0008) [2023-12-28 03:21:07,723][106225] Updated weights for policy 1, policy_version 1129130 (0.0008) [2023-12-28 03:21:08,081][106226] Updated weights for policy 0, policy_version 1126203 (0.0009) [2023-12-28 03:21:08,141][106226] Updated weights for policy 0, policy_version 1126213 (0.0009) [2023-12-28 03:21:08,194][106226] Updated weights for policy 0, policy_version 1126223 (0.0011) [2023-12-28 03:21:08,282][106225] Updated weights for policy 1, policy_version 1129140 (0.0007) [2023-12-28 03:21:08,339][106225] Updated weights for policy 1, policy_version 1129150 (0.0007) [2023-12-28 03:21:08,410][106225] Updated weights for policy 1, policy_version 1129160 (0.0007) [2023-12-28 03:21:08,929][106226] Updated weights for policy 0, policy_version 1126233 (0.0010) [2023-12-28 03:21:08,990][106226] Updated weights for policy 0, policy_version 1126243 (0.0006) [2023-12-28 03:21:09,052][106226] Updated weights for policy 0, policy_version 1126253 (0.0006) [2023-12-28 03:21:09,118][106226] Updated weights for policy 0, policy_version 1126263 (0.0005) [2023-12-28 03:21:09,133][106225] Updated weights for policy 1, policy_version 1129170 (0.0007) [2023-12-28 03:21:09,179][106225] Updated weights for policy 1, policy_version 1129180 (0.0010) [2023-12-28 03:21:09,237][106225] Updated weights for policy 1, policy_version 1129190 (0.0009) [2023-12-28 03:21:09,288][106225] Updated weights for policy 1, policy_version 1129200 (0.0009) [2023-12-28 03:21:09,838][106226] Updated weights for policy 0, policy_version 1126273 (0.0008) [2023-12-28 03:21:09,903][106226] Updated weights for policy 0, policy_version 1126283 (0.0007) [2023-12-28 03:21:09,975][106226] Updated weights for policy 0, policy_version 1126293 (0.0008) [2023-12-28 03:21:10,096][106225] Updated weights for policy 1, policy_version 1129210 (0.0010) [2023-12-28 03:21:10,159][106225] Updated weights for policy 1, policy_version 1129220 (0.0009) [2023-12-28 03:21:10,217][106225] Updated weights for policy 1, policy_version 1129230 (0.0010) [2023-12-28 03:21:10,539][106226] Updated weights for policy 0, policy_version 1126303 (0.0008) [2023-12-28 03:21:10,597][106226] Updated weights for policy 0, policy_version 1126313 (0.0009) [2023-12-28 03:21:10,663][106226] Updated weights for policy 0, policy_version 1126323 (0.0011) [2023-12-28 03:21:10,855][106225] Updated weights for policy 1, policy_version 1129240 (0.0006) [2023-12-28 03:21:10,917][106225] Updated weights for policy 1, policy_version 1129250 (0.0006) [2023-12-28 03:21:10,973][106225] Updated weights for policy 1, policy_version 1129260 (0.0005) [2023-12-28 03:21:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.6, 300 sec: 19827.4). Total num frames: 577536000. Throughput: 0: 9964.7, 1: 10132.2. Samples: 577504608. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:11,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-5.025')] [2023-12-28 03:21:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001126328_288399360.pth... [2023-12-28 03:21:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001129264_289136640.pth... [2023-12-28 03:21:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001128080_288833536.pth [2023-12-28 03:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001125144_288096256.pth [2023-12-28 03:21:11,457][106226] Updated weights for policy 0, policy_version 1126333 (0.0009) [2023-12-28 03:21:11,520][106226] Updated weights for policy 0, policy_version 1126343 (0.0007) [2023-12-28 03:21:11,580][106226] Updated weights for policy 0, policy_version 1126353 (0.0009) [2023-12-28 03:21:11,648][106225] Updated weights for policy 1, policy_version 1129270 (0.0008) [2023-12-28 03:21:11,714][106225] Updated weights for policy 1, policy_version 1129280 (0.0009) [2023-12-28 03:21:11,789][106225] Updated weights for policy 1, policy_version 1129290 (0.0009) [2023-12-28 03:21:12,399][106226] Updated weights for policy 0, policy_version 1126363 (0.0008) [2023-12-28 03:21:12,478][106226] Updated weights for policy 0, policy_version 1126373 (0.0008) [2023-12-28 03:21:12,541][106226] Updated weights for policy 0, policy_version 1126383 (0.0008) [2023-12-28 03:21:12,549][106225] Updated weights for policy 1, policy_version 1129300 (0.0007) [2023-12-28 03:21:12,608][106225] Updated weights for policy 1, policy_version 1129310 (0.0005) [2023-12-28 03:21:12,688][106225] Updated weights for policy 1, policy_version 1129320 (0.0008) [2023-12-28 03:21:13,275][106226] Updated weights for policy 0, policy_version 1126393 (0.0008) [2023-12-28 03:21:13,328][106226] Updated weights for policy 0, policy_version 1126403 (0.0007) [2023-12-28 03:21:13,388][106226] Updated weights for policy 0, policy_version 1126413 (0.0008) [2023-12-28 03:21:13,402][106225] Updated weights for policy 1, policy_version 1129330 (0.0009) [2023-12-28 03:21:13,449][106226] Updated weights for policy 0, policy_version 1126423 (0.0006) [2023-12-28 03:21:13,464][106225] Updated weights for policy 1, policy_version 1129340 (0.0008) [2023-12-28 03:21:13,514][106225] Updated weights for policy 1, policy_version 1129350 (0.0008) [2023-12-28 03:21:13,568][106225] Updated weights for policy 1, policy_version 1129360 (0.0009) [2023-12-28 03:21:14,048][106226] Updated weights for policy 0, policy_version 1126433 (0.0008) [2023-12-28 03:21:14,111][106226] Updated weights for policy 0, policy_version 1126443 (0.0009) [2023-12-28 03:21:14,176][106226] Updated weights for policy 0, policy_version 1126453 (0.0010) [2023-12-28 03:21:14,322][106225] Updated weights for policy 1, policy_version 1129370 (0.0009) [2023-12-28 03:21:14,385][106225] Updated weights for policy 1, policy_version 1129380 (0.0008) [2023-12-28 03:21:14,433][106225] Updated weights for policy 1, policy_version 1129390 (0.0008) [2023-12-28 03:21:14,817][106226] Updated weights for policy 0, policy_version 1126463 (0.0008) [2023-12-28 03:21:14,878][106226] Updated weights for policy 0, policy_version 1126473 (0.0009) [2023-12-28 03:21:14,941][106226] Updated weights for policy 0, policy_version 1126483 (0.0007) [2023-12-28 03:21:15,231][106225] Updated weights for policy 1, policy_version 1129400 (0.0010) [2023-12-28 03:21:15,292][106225] Updated weights for policy 1, policy_version 1129410 (0.0010) [2023-12-28 03:21:15,358][106225] Updated weights for policy 1, policy_version 1129420 (0.0011) [2023-12-28 03:21:15,648][106226] Updated weights for policy 0, policy_version 1126493 (0.0008) [2023-12-28 03:21:15,710][106226] Updated weights for policy 0, policy_version 1126503 (0.0008) [2023-12-28 03:21:15,767][106226] Updated weights for policy 0, policy_version 1126513 (0.0008) [2023-12-28 03:21:16,067][106225] Updated weights for policy 1, policy_version 1129430 (0.0010) [2023-12-28 03:21:16,127][106225] Updated weights for policy 1, policy_version 1129440 (0.0011) [2023-12-28 03:21:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 577626112. Throughput: 0: 10002.7, 1: 9975.6. Samples: 577620164. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:16,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.942')] [2023-12-28 03:21:16,181][106225] Updated weights for policy 1, policy_version 1129450 (0.0010) [2023-12-28 03:21:16,495][106226] Updated weights for policy 0, policy_version 1126523 (0.0008) [2023-12-28 03:21:16,549][106226] Updated weights for policy 0, policy_version 1126533 (0.0008) [2023-12-28 03:21:16,606][106226] Updated weights for policy 0, policy_version 1126543 (0.0008) [2023-12-28 03:21:16,909][106225] Updated weights for policy 1, policy_version 1129460 (0.0010) [2023-12-28 03:21:16,972][106225] Updated weights for policy 1, policy_version 1129470 (0.0010) [2023-12-28 03:21:17,028][106225] Updated weights for policy 1, policy_version 1129480 (0.0010) [2023-12-28 03:21:17,350][106226] Updated weights for policy 0, policy_version 1126553 (0.0008) [2023-12-28 03:21:17,407][106226] Updated weights for policy 0, policy_version 1126563 (0.0008) [2023-12-28 03:21:17,469][106226] Updated weights for policy 0, policy_version 1126573 (0.0007) [2023-12-28 03:21:17,526][106226] Updated weights for policy 0, policy_version 1126583 (0.0005) [2023-12-28 03:21:17,674][106225] Updated weights for policy 1, policy_version 1129490 (0.0009) [2023-12-28 03:21:17,732][106225] Updated weights for policy 1, policy_version 1129500 (0.0006) [2023-12-28 03:21:17,786][106225] Updated weights for policy 1, policy_version 1129510 (0.0008) [2023-12-28 03:21:17,833][106225] Updated weights for policy 1, policy_version 1129520 (0.0007) [2023-12-28 03:21:18,155][106226] Updated weights for policy 0, policy_version 1126593 (0.0010) [2023-12-28 03:21:18,211][106226] Updated weights for policy 0, policy_version 1126603 (0.0010) [2023-12-28 03:21:18,270][106226] Updated weights for policy 0, policy_version 1126613 (0.0010) [2023-12-28 03:21:18,427][106225] Updated weights for policy 1, policy_version 1129530 (0.0008) [2023-12-28 03:21:18,482][106225] Updated weights for policy 1, policy_version 1129540 (0.0008) [2023-12-28 03:21:18,537][106225] Updated weights for policy 1, policy_version 1129550 (0.0008) [2023-12-28 03:21:18,993][106226] Updated weights for policy 0, policy_version 1126623 (0.0011) [2023-12-28 03:21:19,052][106226] Updated weights for policy 0, policy_version 1126633 (0.0010) [2023-12-28 03:21:19,113][106226] Updated weights for policy 0, policy_version 1126643 (0.0011) [2023-12-28 03:21:19,285][106225] Updated weights for policy 1, policy_version 1129560 (0.0009) [2023-12-28 03:21:19,335][106225] Updated weights for policy 1, policy_version 1129570 (0.0005) [2023-12-28 03:21:19,404][106225] Updated weights for policy 1, policy_version 1129580 (0.0008) [2023-12-28 03:21:19,867][106226] Updated weights for policy 0, policy_version 1126653 (0.0010) [2023-12-28 03:21:19,935][106226] Updated weights for policy 0, policy_version 1126663 (0.0010) [2023-12-28 03:21:20,004][106226] Updated weights for policy 0, policy_version 1126673 (0.0009) [2023-12-28 03:21:20,230][106225] Updated weights for policy 1, policy_version 1129590 (0.0010) [2023-12-28 03:21:20,291][106225] Updated weights for policy 1, policy_version 1129600 (0.0010) [2023-12-28 03:21:20,346][106225] Updated weights for policy 1, policy_version 1129610 (0.0011) [2023-12-28 03:21:20,767][106226] Updated weights for policy 0, policy_version 1126683 (0.0009) [2023-12-28 03:21:20,834][106226] Updated weights for policy 0, policy_version 1126693 (0.0008) [2023-12-28 03:21:20,901][106226] Updated weights for policy 0, policy_version 1126703 (0.0008) [2023-12-28 03:21:21,091][106225] Updated weights for policy 1, policy_version 1129620 (0.0011) [2023-12-28 03:21:21,161][106225] Updated weights for policy 1, policy_version 1129630 (0.0011) [2023-12-28 03:21:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 577724416. Throughput: 0: 9909.1, 1: 9915.5. Samples: 577735852. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:21,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.837')] [2023-12-28 03:21:21,226][106225] Updated weights for policy 1, policy_version 1129640 (0.0011) [2023-12-28 03:21:21,706][106226] Updated weights for policy 0, policy_version 1126713 (0.0008) [2023-12-28 03:21:21,778][106226] Updated weights for policy 0, policy_version 1126723 (0.0009) [2023-12-28 03:21:21,846][106226] Updated weights for policy 0, policy_version 1126733 (0.0008) [2023-12-28 03:21:21,914][106226] Updated weights for policy 0, policy_version 1126743 (0.0008) [2023-12-28 03:21:21,953][106225] Updated weights for policy 1, policy_version 1129650 (0.0010) [2023-12-28 03:21:22,011][106225] Updated weights for policy 1, policy_version 1129660 (0.0007) [2023-12-28 03:21:22,068][106225] Updated weights for policy 1, policy_version 1129670 (0.0008) [2023-12-28 03:21:22,131][106225] Updated weights for policy 1, policy_version 1129680 (0.0008) [2023-12-28 03:21:22,669][106226] Updated weights for policy 0, policy_version 1126753 (0.0010) [2023-12-28 03:21:22,724][106226] Updated weights for policy 0, policy_version 1126763 (0.0011) [2023-12-28 03:21:22,785][106226] Updated weights for policy 0, policy_version 1126773 (0.0009) [2023-12-28 03:21:22,883][106225] Updated weights for policy 1, policy_version 1129690 (0.0008) [2023-12-28 03:21:22,945][106225] Updated weights for policy 1, policy_version 1129700 (0.0007) [2023-12-28 03:21:22,992][106225] Updated weights for policy 1, policy_version 1129710 (0.0008) [2023-12-28 03:21:23,524][106226] Updated weights for policy 0, policy_version 1126783 (0.0011) [2023-12-28 03:21:23,586][106226] Updated weights for policy 0, policy_version 1126793 (0.0010) [2023-12-28 03:21:23,655][106226] Updated weights for policy 0, policy_version 1126803 (0.0010) [2023-12-28 03:21:23,750][106225] Updated weights for policy 1, policy_version 1129720 (0.0006) [2023-12-28 03:21:23,806][106225] Updated weights for policy 1, policy_version 1129730 (0.0006) [2023-12-28 03:21:23,860][106225] Updated weights for policy 1, policy_version 1129740 (0.0006) [2023-12-28 03:21:24,320][106226] Updated weights for policy 0, policy_version 1126813 (0.0008) [2023-12-28 03:21:24,390][106226] Updated weights for policy 0, policy_version 1126823 (0.0006) [2023-12-28 03:21:24,426][106225] Updated weights for policy 1, policy_version 1129750 (0.0008) [2023-12-28 03:21:24,454][106226] Updated weights for policy 0, policy_version 1126833 (0.0010) [2023-12-28 03:21:24,486][106225] Updated weights for policy 1, policy_version 1129760 (0.0010) [2023-12-28 03:21:24,546][106225] Updated weights for policy 1, policy_version 1129770 (0.0010) [2023-12-28 03:21:25,078][106226] Updated weights for policy 0, policy_version 1126843 (0.0011) [2023-12-28 03:21:25,140][106226] Updated weights for policy 0, policy_version 1126853 (0.0010) [2023-12-28 03:21:25,201][106226] Updated weights for policy 0, policy_version 1126863 (0.0011) [2023-12-28 03:21:25,266][106225] Updated weights for policy 1, policy_version 1129780 (0.0010) [2023-12-28 03:21:25,327][106225] Updated weights for policy 1, policy_version 1129790 (0.0010) [2023-12-28 03:21:25,388][106225] Updated weights for policy 1, policy_version 1129800 (0.0010) [2023-12-28 03:21:25,845][106226] Updated weights for policy 0, policy_version 1126873 (0.0010) [2023-12-28 03:21:25,902][106226] Updated weights for policy 0, policy_version 1126883 (0.0005) [2023-12-28 03:21:25,952][106226] Updated weights for policy 0, policy_version 1126893 (0.0007) [2023-12-28 03:21:25,997][106226] Updated weights for policy 0, policy_version 1126903 (0.0008) [2023-12-28 03:21:26,086][106225] Updated weights for policy 1, policy_version 1129810 (0.0009) [2023-12-28 03:21:26,140][106225] Updated weights for policy 1, policy_version 1129820 (0.0006) [2023-12-28 03:21:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 577822720. Throughput: 0: 9868.9, 1: 9866.3. Samples: 577791364. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:26,175][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.557')] [2023-12-28 03:21:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001126904_288546816.pth... [2023-12-28 03:21:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001125752_288251904.pth [2023-12-28 03:21:26,191][106225] Updated weights for policy 1, policy_version 1129830 (0.0010) [2023-12-28 03:21:26,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001129840_289284096.pth... [2023-12-28 03:21:26,241][106225] Updated weights for policy 1, policy_version 1129840 (0.0010) [2023-12-28 03:21:26,244][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001128656_288980992.pth [2023-12-28 03:21:26,669][106226] Updated weights for policy 0, policy_version 1126913 (0.0006) [2023-12-28 03:21:26,724][106226] Updated weights for policy 0, policy_version 1126923 (0.0005) [2023-12-28 03:21:26,775][106226] Updated weights for policy 0, policy_version 1126933 (0.0005) [2023-12-28 03:21:26,955][106225] Updated weights for policy 1, policy_version 1129850 (0.0010) [2023-12-28 03:21:27,011][106225] Updated weights for policy 1, policy_version 1129860 (0.0010) [2023-12-28 03:21:27,070][106225] Updated weights for policy 1, policy_version 1129870 (0.0010) [2023-12-28 03:21:27,332][106226] Updated weights for policy 0, policy_version 1126943 (0.0006) [2023-12-28 03:21:27,385][106226] Updated weights for policy 0, policy_version 1126953 (0.0010) [2023-12-28 03:21:27,431][106226] Updated weights for policy 0, policy_version 1126963 (0.0010) [2023-12-28 03:21:27,751][106225] Updated weights for policy 1, policy_version 1129880 (0.0010) [2023-12-28 03:21:27,798][106225] Updated weights for policy 1, policy_version 1129890 (0.0009) [2023-12-28 03:21:27,848][106225] Updated weights for policy 1, policy_version 1129900 (0.0007) [2023-12-28 03:21:28,139][106226] Updated weights for policy 0, policy_version 1126973 (0.0010) [2023-12-28 03:21:28,192][106226] Updated weights for policy 0, policy_version 1126983 (0.0010) [2023-12-28 03:21:28,238][106226] Updated weights for policy 0, policy_version 1126993 (0.0010) [2023-12-28 03:21:28,520][106225] Updated weights for policy 1, policy_version 1129910 (0.0008) [2023-12-28 03:21:28,580][106225] Updated weights for policy 1, policy_version 1129920 (0.0008) [2023-12-28 03:21:28,632][106225] Updated weights for policy 1, policy_version 1129930 (0.0008) [2023-12-28 03:21:28,936][106226] Updated weights for policy 0, policy_version 1127003 (0.0010) [2023-12-28 03:21:29,001][106226] Updated weights for policy 0, policy_version 1127013 (0.0011) [2023-12-28 03:21:29,060][106226] Updated weights for policy 0, policy_version 1127023 (0.0010) [2023-12-28 03:21:29,311][106225] Updated weights for policy 1, policy_version 1129940 (0.0008) [2023-12-28 03:21:29,379][106225] Updated weights for policy 1, policy_version 1129950 (0.0008) [2023-12-28 03:21:29,437][106225] Updated weights for policy 1, policy_version 1129960 (0.0010) [2023-12-28 03:21:29,764][106226] Updated weights for policy 0, policy_version 1127033 (0.0010) [2023-12-28 03:21:29,829][106226] Updated weights for policy 0, policy_version 1127043 (0.0011) [2023-12-28 03:21:29,888][106226] Updated weights for policy 0, policy_version 1127053 (0.0007) [2023-12-28 03:21:29,952][106226] Updated weights for policy 0, policy_version 1127063 (0.0009) [2023-12-28 03:21:30,169][106225] Updated weights for policy 1, policy_version 1129970 (0.0009) [2023-12-28 03:21:30,235][106225] Updated weights for policy 1, policy_version 1129981 (0.0006) [2023-12-28 03:21:30,291][106225] Updated weights for policy 1, policy_version 1129991 (0.0009) [2023-12-28 03:21:30,576][106226] Updated weights for policy 0, policy_version 1127073 (0.0006) [2023-12-28 03:21:30,641][106226] Updated weights for policy 0, policy_version 1127083 (0.0008) [2023-12-28 03:21:30,693][106226] Updated weights for policy 0, policy_version 1127093 (0.0005) [2023-12-28 03:21:30,921][106225] Updated weights for policy 1, policy_version 1130001 (0.0009) [2023-12-28 03:21:30,981][106225] Updated weights for policy 1, policy_version 1130011 (0.0005) [2023-12-28 03:21:31,048][106225] Updated weights for policy 1, policy_version 1130021 (0.0008) [2023-12-28 03:21:31,108][106225] Updated weights for policy 1, policy_version 1130031 (0.0009) [2023-12-28 03:21:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 577929216. Throughput: 0: 9911.9, 1: 9897.2. Samples: 577915108. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:31,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.618')] [2023-12-28 03:21:31,422][106226] Updated weights for policy 0, policy_version 1127103 (0.0008) [2023-12-28 03:21:31,470][106226] Updated weights for policy 0, policy_version 1127113 (0.0008) [2023-12-28 03:21:31,533][106226] Updated weights for policy 0, policy_version 1127123 (0.0009) [2023-12-28 03:21:31,734][106225] Updated weights for policy 1, policy_version 1130041 (0.0008) [2023-12-28 03:21:31,805][106225] Updated weights for policy 1, policy_version 1130051 (0.0005) [2023-12-28 03:21:31,867][106225] Updated weights for policy 1, policy_version 1130061 (0.0006) [2023-12-28 03:21:32,233][106226] Updated weights for policy 0, policy_version 1127133 (0.0009) [2023-12-28 03:21:32,296][106226] Updated weights for policy 0, policy_version 1127143 (0.0011) [2023-12-28 03:21:32,363][106226] Updated weights for policy 0, policy_version 1127153 (0.0008) [2023-12-28 03:21:32,534][106225] Updated weights for policy 1, policy_version 1130071 (0.0008) [2023-12-28 03:21:32,592][106225] Updated weights for policy 1, policy_version 1130081 (0.0008) [2023-12-28 03:21:32,646][106225] Updated weights for policy 1, policy_version 1130091 (0.0008) [2023-12-28 03:21:33,103][106226] Updated weights for policy 0, policy_version 1127163 (0.0011) [2023-12-28 03:21:33,149][106226] Updated weights for policy 0, policy_version 1127173 (0.0010) [2023-12-28 03:21:33,211][106226] Updated weights for policy 0, policy_version 1127183 (0.0010) [2023-12-28 03:21:33,346][106225] Updated weights for policy 1, policy_version 1130101 (0.0009) [2023-12-28 03:21:33,405][106225] Updated weights for policy 1, policy_version 1130111 (0.0010) [2023-12-28 03:21:33,461][106225] Updated weights for policy 1, policy_version 1130121 (0.0010) [2023-12-28 03:21:33,924][106226] Updated weights for policy 0, policy_version 1127193 (0.0010) [2023-12-28 03:21:33,987][106226] Updated weights for policy 0, policy_version 1127203 (0.0010) [2023-12-28 03:21:34,030][106226] Updated weights for policy 0, policy_version 1127213 (0.0010) [2023-12-28 03:21:34,087][106226] Updated weights for policy 0, policy_version 1127223 (0.0011) [2023-12-28 03:21:34,118][106225] Updated weights for policy 1, policy_version 1130131 (0.0009) [2023-12-28 03:21:34,203][106225] Updated weights for policy 1, policy_version 1130141 (0.0010) [2023-12-28 03:21:34,261][106225] Updated weights for policy 1, policy_version 1130151 (0.0009) [2023-12-28 03:21:34,843][106226] Updated weights for policy 0, policy_version 1127233 (0.0010) [2023-12-28 03:21:34,901][106226] Updated weights for policy 0, policy_version 1127243 (0.0011) [2023-12-28 03:21:34,937][106225] Updated weights for policy 1, policy_version 1130161 (0.0008) [2023-12-28 03:21:34,962][106226] Updated weights for policy 0, policy_version 1127253 (0.0011) [2023-12-28 03:21:34,999][106225] Updated weights for policy 1, policy_version 1130171 (0.0006) [2023-12-28 03:21:35,056][106225] Updated weights for policy 1, policy_version 1130181 (0.0006) [2023-12-28 03:21:35,117][106225] Updated weights for policy 1, policy_version 1130191 (0.0009) [2023-12-28 03:21:35,665][106225] Updated weights for policy 1, policy_version 1130201 (0.0007) [2023-12-28 03:21:35,672][106226] Updated weights for policy 0, policy_version 1127263 (0.0010) [2023-12-28 03:21:35,713][106225] Updated weights for policy 1, policy_version 1130211 (0.0010) [2023-12-28 03:21:35,722][106226] Updated weights for policy 0, policy_version 1127273 (0.0010) [2023-12-28 03:21:35,764][106225] Updated weights for policy 1, policy_version 1130221 (0.0010) [2023-12-28 03:21:35,770][106226] Updated weights for policy 0, policy_version 1127283 (0.0010) [2023-12-28 03:21:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 578027520. Throughput: 0: 9860.5, 1: 9958.1. Samples: 578035888. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:36,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-4.701')] [2023-12-28 03:21:36,385][106225] Updated weights for policy 1, policy_version 1130231 (0.0009) [2023-12-28 03:21:36,450][106225] Updated weights for policy 1, policy_version 1130241 (0.0008) [2023-12-28 03:21:36,513][106225] Updated weights for policy 1, policy_version 1130251 (0.0009) [2023-12-28 03:21:36,547][106226] Updated weights for policy 0, policy_version 1127293 (0.0009) [2023-12-28 03:21:36,618][106226] Updated weights for policy 0, policy_version 1127303 (0.0010) [2023-12-28 03:21:36,684][106226] Updated weights for policy 0, policy_version 1127313 (0.0006) [2023-12-28 03:21:37,229][106225] Updated weights for policy 1, policy_version 1130261 (0.0007) [2023-12-28 03:21:37,293][106225] Updated weights for policy 1, policy_version 1130271 (0.0009) [2023-12-28 03:21:37,353][106225] Updated weights for policy 1, policy_version 1130281 (0.0008) [2023-12-28 03:21:37,382][106226] Updated weights for policy 0, policy_version 1127323 (0.0008) [2023-12-28 03:21:37,438][106226] Updated weights for policy 0, policy_version 1127333 (0.0009) [2023-12-28 03:21:37,491][106226] Updated weights for policy 0, policy_version 1127343 (0.0009) [2023-12-28 03:21:38,112][106225] Updated weights for policy 1, policy_version 1130291 (0.0008) [2023-12-28 03:21:38,121][106226] Updated weights for policy 0, policy_version 1127353 (0.0008) [2023-12-28 03:21:38,170][106225] Updated weights for policy 1, policy_version 1130301 (0.0006) [2023-12-28 03:21:38,179][106226] Updated weights for policy 0, policy_version 1127363 (0.0008) [2023-12-28 03:21:38,228][106226] Updated weights for policy 0, policy_version 1127373 (0.0007) [2023-12-28 03:21:38,230][106225] Updated weights for policy 1, policy_version 1130311 (0.0006) [2023-12-28 03:21:38,287][106226] Updated weights for policy 0, policy_version 1127383 (0.0006) [2023-12-28 03:21:38,954][106225] Updated weights for policy 1, policy_version 1130321 (0.0006) [2023-12-28 03:21:39,010][106225] Updated weights for policy 1, policy_version 1130331 (0.0005) [2023-12-28 03:21:39,041][106226] Updated weights for policy 0, policy_version 1127393 (0.0005) [2023-12-28 03:21:39,061][106225] Updated weights for policy 1, policy_version 1130341 (0.0005) [2023-12-28 03:21:39,108][106226] Updated weights for policy 0, policy_version 1127403 (0.0005) [2023-12-28 03:21:39,126][106225] Updated weights for policy 1, policy_version 1130351 (0.0006) [2023-12-28 03:21:39,177][106226] Updated weights for policy 0, policy_version 1127413 (0.0006) [2023-12-28 03:21:39,828][106225] Updated weights for policy 1, policy_version 1130361 (0.0010) [2023-12-28 03:21:39,866][106226] Updated weights for policy 0, policy_version 1127423 (0.0007) [2023-12-28 03:21:39,894][106225] Updated weights for policy 1, policy_version 1130371 (0.0008) [2023-12-28 03:21:39,926][106226] Updated weights for policy 0, policy_version 1127433 (0.0009) [2023-12-28 03:21:39,960][106225] Updated weights for policy 1, policy_version 1130381 (0.0008) [2023-12-28 03:21:39,988][106226] Updated weights for policy 0, policy_version 1127443 (0.0008) [2023-12-28 03:21:40,663][106225] Updated weights for policy 1, policy_version 1130391 (0.0010) [2023-12-28 03:21:40,716][106225] Updated weights for policy 1, policy_version 1130401 (0.0010) [2023-12-28 03:21:40,729][106226] Updated weights for policy 0, policy_version 1127453 (0.0008) [2023-12-28 03:21:40,766][106225] Updated weights for policy 1, policy_version 1130411 (0.0010) [2023-12-28 03:21:40,789][106226] Updated weights for policy 0, policy_version 1127463 (0.0010) [2023-12-28 03:21:40,846][106226] Updated weights for policy 0, policy_version 1127473 (0.0010) [2023-12-28 03:21:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 578125824. Throughput: 0: 9824.8, 1: 9986.2. Samples: 578094904. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:41,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-4.775')] [2023-12-28 03:21:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001130416_289431552.pth... [2023-12-28 03:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001127480_288694272.pth... [2023-12-28 03:21:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001129264_289136640.pth [2023-12-28 03:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001126328_288399360.pth [2023-12-28 03:21:41,601][106225] Updated weights for policy 1, policy_version 1130421 (0.0010) [2023-12-28 03:21:41,643][106226] Updated weights for policy 0, policy_version 1127483 (0.0010) [2023-12-28 03:21:41,671][106225] Updated weights for policy 1, policy_version 1130431 (0.0010) [2023-12-28 03:21:41,712][106226] Updated weights for policy 0, policy_version 1127493 (0.0009) [2023-12-28 03:21:41,736][106225] Updated weights for policy 1, policy_version 1130441 (0.0010) [2023-12-28 03:21:41,774][106226] Updated weights for policy 0, policy_version 1127503 (0.0009) [2023-12-28 03:21:42,522][106225] Updated weights for policy 1, policy_version 1130451 (0.0008) [2023-12-28 03:21:42,567][106226] Updated weights for policy 0, policy_version 1127513 (0.0008) [2023-12-28 03:21:42,581][106225] Updated weights for policy 1, policy_version 1130461 (0.0008) [2023-12-28 03:21:42,631][106226] Updated weights for policy 0, policy_version 1127523 (0.0006) [2023-12-28 03:21:42,648][106225] Updated weights for policy 1, policy_version 1130471 (0.0007) [2023-12-28 03:21:42,694][106226] Updated weights for policy 0, policy_version 1127533 (0.0007) [2023-12-28 03:21:42,762][106226] Updated weights for policy 0, policy_version 1127543 (0.0008) [2023-12-28 03:21:43,375][106226] Updated weights for policy 0, policy_version 1127553 (0.0009) [2023-12-28 03:21:43,406][106225] Updated weights for policy 1, policy_version 1130481 (0.0006) [2023-12-28 03:21:43,431][106226] Updated weights for policy 0, policy_version 1127563 (0.0007) [2023-12-28 03:21:43,465][106225] Updated weights for policy 1, policy_version 1130491 (0.0007) [2023-12-28 03:21:43,485][106226] Updated weights for policy 0, policy_version 1127573 (0.0007) [2023-12-28 03:21:43,516][106225] Updated weights for policy 1, policy_version 1130501 (0.0005) [2023-12-28 03:21:43,564][106225] Updated weights for policy 1, policy_version 1130511 (0.0005) [2023-12-28 03:21:44,182][106225] Updated weights for policy 1, policy_version 1130521 (0.0008) [2023-12-28 03:21:44,241][106225] Updated weights for policy 1, policy_version 1130531 (0.0009) [2023-12-28 03:21:44,259][106226] Updated weights for policy 0, policy_version 1127583 (0.0008) [2023-12-28 03:21:44,300][106225] Updated weights for policy 1, policy_version 1130541 (0.0006) [2023-12-28 03:21:44,309][106226] Updated weights for policy 0, policy_version 1127593 (0.0008) [2023-12-28 03:21:44,359][106226] Updated weights for policy 0, policy_version 1127603 (0.0009) [2023-12-28 03:21:44,983][106225] Updated weights for policy 1, policy_version 1130551 (0.0008) [2023-12-28 03:21:45,046][106225] Updated weights for policy 1, policy_version 1130561 (0.0009) [2023-12-28 03:21:45,104][106225] Updated weights for policy 1, policy_version 1130571 (0.0010) [2023-12-28 03:21:45,128][106226] Updated weights for policy 0, policy_version 1127613 (0.0007) [2023-12-28 03:21:45,193][106226] Updated weights for policy 0, policy_version 1127623 (0.0008) [2023-12-28 03:21:45,279][106226] Updated weights for policy 0, policy_version 1127633 (0.0009) [2023-12-28 03:21:45,808][106225] Updated weights for policy 1, policy_version 1130581 (0.0007) [2023-12-28 03:21:45,854][106225] Updated weights for policy 1, policy_version 1130591 (0.0005) [2023-12-28 03:21:45,879][106226] Updated weights for policy 0, policy_version 1127643 (0.0006) [2023-12-28 03:21:45,907][106225] Updated weights for policy 1, policy_version 1130601 (0.0005) [2023-12-28 03:21:45,948][106226] Updated weights for policy 0, policy_version 1127653 (0.0008) [2023-12-28 03:21:46,005][106226] Updated weights for policy 0, policy_version 1127663 (0.0008) [2023-12-28 03:21:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 578224128. Throughput: 0: 9733.3, 1: 9947.4. Samples: 578208536. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:46,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.584')] [2023-12-28 03:21:46,588][106225] Updated weights for policy 1, policy_version 1130611 (0.0007) [2023-12-28 03:21:46,651][106225] Updated weights for policy 1, policy_version 1130621 (0.0008) [2023-12-28 03:21:46,710][106226] Updated weights for policy 0, policy_version 1127673 (0.0008) [2023-12-28 03:21:46,712][106225] Updated weights for policy 1, policy_version 1130631 (0.0009) [2023-12-28 03:21:46,776][106226] Updated weights for policy 0, policy_version 1127683 (0.0008) [2023-12-28 03:21:46,843][106226] Updated weights for policy 0, policy_version 1127693 (0.0011) [2023-12-28 03:21:46,903][106226] Updated weights for policy 0, policy_version 1127703 (0.0010) [2023-12-28 03:21:47,412][106225] Updated weights for policy 1, policy_version 1130641 (0.0007) [2023-12-28 03:21:47,468][106225] Updated weights for policy 1, policy_version 1130651 (0.0008) [2023-12-28 03:21:47,478][106226] Updated weights for policy 0, policy_version 1127713 (0.0010) [2023-12-28 03:21:47,526][106225] Updated weights for policy 1, policy_version 1130661 (0.0005) [2023-12-28 03:21:47,538][106226] Updated weights for policy 0, policy_version 1127723 (0.0011) [2023-12-28 03:21:47,585][106226] Updated weights for policy 0, policy_version 1127733 (0.0010) [2023-12-28 03:21:47,586][106225] Updated weights for policy 1, policy_version 1130671 (0.0006) [2023-12-28 03:21:48,253][106225] Updated weights for policy 1, policy_version 1130681 (0.0008) [2023-12-28 03:21:48,309][106225] Updated weights for policy 1, policy_version 1130691 (0.0008) [2023-12-28 03:21:48,315][106226] Updated weights for policy 0, policy_version 1127743 (0.0010) [2023-12-28 03:21:48,375][106225] Updated weights for policy 1, policy_version 1130701 (0.0008) [2023-12-28 03:21:48,381][106226] Updated weights for policy 0, policy_version 1127753 (0.0011) [2023-12-28 03:21:48,449][106226] Updated weights for policy 0, policy_version 1127763 (0.0007) [2023-12-28 03:21:49,110][106225] Updated weights for policy 1, policy_version 1130711 (0.0006) [2023-12-28 03:21:49,150][106226] Updated weights for policy 0, policy_version 1127773 (0.0010) [2023-12-28 03:21:49,170][106225] Updated weights for policy 1, policy_version 1130721 (0.0005) [2023-12-28 03:21:49,200][106226] Updated weights for policy 0, policy_version 1127783 (0.0010) [2023-12-28 03:21:49,230][106225] Updated weights for policy 1, policy_version 1130731 (0.0006) [2023-12-28 03:21:49,260][106226] Updated weights for policy 0, policy_version 1127793 (0.0009) [2023-12-28 03:21:49,961][106225] Updated weights for policy 1, policy_version 1130741 (0.0008) [2023-12-28 03:21:50,022][106225] Updated weights for policy 1, policy_version 1130751 (0.0006) [2023-12-28 03:21:50,075][106226] Updated weights for policy 0, policy_version 1127803 (0.0008) [2023-12-28 03:21:50,091][106225] Updated weights for policy 1, policy_version 1130761 (0.0006) [2023-12-28 03:21:50,134][106226] Updated weights for policy 0, policy_version 1127813 (0.0008) [2023-12-28 03:21:50,187][106226] Updated weights for policy 0, policy_version 1127823 (0.0009) [2023-12-28 03:21:50,673][106225] Updated weights for policy 1, policy_version 1130771 (0.0005) [2023-12-28 03:21:50,727][106225] Updated weights for policy 1, policy_version 1130781 (0.0008) [2023-12-28 03:21:50,789][106225] Updated weights for policy 1, policy_version 1130791 (0.0009) [2023-12-28 03:21:50,990][106226] Updated weights for policy 0, policy_version 1127833 (0.0008) [2023-12-28 03:21:51,057][106226] Updated weights for policy 0, policy_version 1127843 (0.0010) [2023-12-28 03:21:51,119][106226] Updated weights for policy 0, policy_version 1127853 (0.0008) [2023-12-28 03:21:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 578314240. Throughput: 0: 9739.0, 1: 9917.0. Samples: 578327664. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:51,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-4.787')] [2023-12-28 03:21:51,181][106226] Updated weights for policy 0, policy_version 1127863 (0.0008) [2023-12-28 03:21:51,470][106225] Updated weights for policy 1, policy_version 1130801 (0.0008) [2023-12-28 03:21:51,537][106225] Updated weights for policy 1, policy_version 1130811 (0.0005) [2023-12-28 03:21:51,603][106225] Updated weights for policy 1, policy_version 1130821 (0.0008) [2023-12-28 03:21:51,676][106225] Updated weights for policy 1, policy_version 1130831 (0.0008) [2023-12-28 03:21:51,922][106226] Updated weights for policy 0, policy_version 1127873 (0.0006) [2023-12-28 03:21:51,983][106226] Updated weights for policy 0, policy_version 1127883 (0.0005) [2023-12-28 03:21:52,047][106226] Updated weights for policy 0, policy_version 1127893 (0.0007) [2023-12-28 03:21:52,331][106225] Updated weights for policy 1, policy_version 1130841 (0.0008) [2023-12-28 03:21:52,400][106225] Updated weights for policy 1, policy_version 1130851 (0.0008) [2023-12-28 03:21:52,463][106225] Updated weights for policy 1, policy_version 1130861 (0.0009) [2023-12-28 03:21:52,745][106226] Updated weights for policy 0, policy_version 1127903 (0.0009) [2023-12-28 03:21:52,800][106226] Updated weights for policy 0, policy_version 1127913 (0.0010) [2023-12-28 03:21:52,851][106226] Updated weights for policy 0, policy_version 1127923 (0.0009) [2023-12-28 03:21:52,873][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000008 [2023-12-28 03:21:53,094][106225] Updated weights for policy 1, policy_version 1130871 (0.0007) [2023-12-28 03:21:53,160][106225] Updated weights for policy 1, policy_version 1130881 (0.0005) [2023-12-28 03:21:53,218][106225] Updated weights for policy 1, policy_version 1130891 (0.0005) [2023-12-28 03:21:53,671][106226] Updated weights for policy 0, policy_version 1127933 (0.0008) [2023-12-28 03:21:53,727][106226] Updated weights for policy 0, policy_version 1127943 (0.0005) [2023-12-28 03:21:53,789][106226] Updated weights for policy 0, policy_version 1127953 (0.0005) [2023-12-28 03:21:53,823][106225] Updated weights for policy 1, policy_version 1130901 (0.0005) [2023-12-28 03:21:53,880][106225] Updated weights for policy 1, policy_version 1130911 (0.0006) [2023-12-28 03:21:53,946][106225] Updated weights for policy 1, policy_version 1130921 (0.0008) [2023-12-28 03:21:54,375][106226] Updated weights for policy 0, policy_version 1127963 (0.0006) [2023-12-28 03:21:54,424][106226] Updated weights for policy 0, policy_version 1127973 (0.0008) [2023-12-28 03:21:54,484][106226] Updated weights for policy 0, policy_version 1127983 (0.0009) [2023-12-28 03:21:54,639][106225] Updated weights for policy 1, policy_version 1130931 (0.0008) [2023-12-28 03:21:54,693][106225] Updated weights for policy 1, policy_version 1130941 (0.0008) [2023-12-28 03:21:54,736][106225] Updated weights for policy 1, policy_version 1130951 (0.0009) [2023-12-28 03:21:55,175][106226] Updated weights for policy 0, policy_version 1127993 (0.0008) [2023-12-28 03:21:55,224][106226] Updated weights for policy 0, policy_version 1128003 (0.0005) [2023-12-28 03:21:55,270][106226] Updated weights for policy 0, policy_version 1128013 (0.0006) [2023-12-28 03:21:55,333][106226] Updated weights for policy 0, policy_version 1128023 (0.0008) [2023-12-28 03:21:55,523][106225] Updated weights for policy 1, policy_version 1130961 (0.0008) [2023-12-28 03:21:55,581][106225] Updated weights for policy 1, policy_version 1130971 (0.0008) [2023-12-28 03:21:55,637][106225] Updated weights for policy 1, policy_version 1130981 (0.0008) [2023-12-28 03:21:55,696][106225] Updated weights for policy 1, policy_version 1130991 (0.0009) [2023-12-28 03:21:56,035][106226] Updated weights for policy 0, policy_version 1128033 (0.0009) [2023-12-28 03:21:56,103][106226] Updated weights for policy 0, policy_version 1128043 (0.0010) [2023-12-28 03:21:56,162][106226] Updated weights for policy 0, policy_version 1128053 (0.0009) [2023-12-28 03:21:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 578420736. Throughput: 0: 9710.8, 1: 9898.1. Samples: 578387012. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:21:56,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-4.874')] [2023-12-28 03:21:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001130992_289579008.pth... [2023-12-28 03:21:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001128056_288841728.pth... [2023-12-28 03:21:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001129840_289284096.pth [2023-12-28 03:21:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001126904_288546816.pth [2023-12-28 03:21:56,291][106225] Updated weights for policy 1, policy_version 1131001 (0.0006) [2023-12-28 03:21:56,344][106225] Updated weights for policy 1, policy_version 1131011 (0.0006) [2023-12-28 03:21:56,407][106225] Updated weights for policy 1, policy_version 1131021 (0.0005) [2023-12-28 03:21:56,969][106226] Updated weights for policy 0, policy_version 1128063 (0.0009) [2023-12-28 03:21:56,972][106225] Updated weights for policy 1, policy_version 1131031 (0.0009) [2023-12-28 03:21:57,017][106226] Updated weights for policy 0, policy_version 1128073 (0.0006) [2023-12-28 03:21:57,019][106225] Updated weights for policy 1, policy_version 1131041 (0.0010) [2023-12-28 03:21:57,069][106226] Updated weights for policy 0, policy_version 1128083 (0.0008) [2023-12-28 03:21:57,076][106225] Updated weights for policy 1, policy_version 1131051 (0.0010) [2023-12-28 03:21:57,687][106225] Updated weights for policy 1, policy_version 1131061 (0.0010) [2023-12-28 03:21:57,720][106226] Updated weights for policy 0, policy_version 1128093 (0.0008) [2023-12-28 03:21:57,744][106225] Updated weights for policy 1, policy_version 1131071 (0.0010) [2023-12-28 03:21:57,769][106226] Updated weights for policy 0, policy_version 1128103 (0.0010) [2023-12-28 03:21:57,797][106225] Updated weights for policy 1, policy_version 1131081 (0.0010) [2023-12-28 03:21:57,816][106226] Updated weights for policy 0, policy_version 1128113 (0.0010) [2023-12-28 03:21:58,528][106225] Updated weights for policy 1, policy_version 1131091 (0.0010) [2023-12-28 03:21:58,590][106225] Updated weights for policy 1, policy_version 1131101 (0.0011) [2023-12-28 03:21:58,594][106226] Updated weights for policy 0, policy_version 1128123 (0.0010) [2023-12-28 03:21:58,654][106225] Updated weights for policy 1, policy_version 1131111 (0.0010) [2023-12-28 03:21:58,659][106226] Updated weights for policy 0, policy_version 1128133 (0.0009) [2023-12-28 03:21:58,727][106226] Updated weights for policy 0, policy_version 1128143 (0.0008) [2023-12-28 03:21:59,408][106225] Updated weights for policy 1, policy_version 1131121 (0.0008) [2023-12-28 03:21:59,476][106225] Updated weights for policy 1, policy_version 1131131 (0.0009) [2023-12-28 03:21:59,531][106225] Updated weights for policy 1, policy_version 1131141 (0.0008) [2023-12-28 03:21:59,533][106226] Updated weights for policy 0, policy_version 1128153 (0.0008) [2023-12-28 03:21:59,583][106225] Updated weights for policy 1, policy_version 1131151 (0.0005) [2023-12-28 03:21:59,594][106226] Updated weights for policy 0, policy_version 1128163 (0.0008) [2023-12-28 03:21:59,665][106226] Updated weights for policy 0, policy_version 1128173 (0.0010) [2023-12-28 03:21:59,739][106226] Updated weights for policy 0, policy_version 1128183 (0.0010) [2023-12-28 03:22:00,307][106225] Updated weights for policy 1, policy_version 1131161 (0.0009) [2023-12-28 03:22:00,358][106225] Updated weights for policy 1, policy_version 1131171 (0.0009) [2023-12-28 03:22:00,412][106226] Updated weights for policy 0, policy_version 1128193 (0.0009) [2023-12-28 03:22:00,416][106225] Updated weights for policy 1, policy_version 1131181 (0.0007) [2023-12-28 03:22:00,468][106226] Updated weights for policy 0, policy_version 1128203 (0.0008) [2023-12-28 03:22:00,519][106226] Updated weights for policy 0, policy_version 1128213 (0.0008) [2023-12-28 03:22:01,113][106225] Updated weights for policy 1, policy_version 1131191 (0.0008) [2023-12-28 03:22:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 578510848. Throughput: 0: 9688.7, 1: 9981.8. Samples: 578505340. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:01,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-4.845')] [2023-12-28 03:22:01,178][106225] Updated weights for policy 1, policy_version 1131201 (0.0008) [2023-12-28 03:22:01,243][106225] Updated weights for policy 1, policy_version 1131211 (0.0008) [2023-12-28 03:22:01,260][106226] Updated weights for policy 0, policy_version 1128223 (0.0006) [2023-12-28 03:22:01,322][106226] Updated weights for policy 0, policy_version 1128233 (0.0008) [2023-12-28 03:22:01,405][106226] Updated weights for policy 0, policy_version 1128243 (0.0009) [2023-12-28 03:22:01,985][106225] Updated weights for policy 1, policy_version 1131221 (0.0008) [2023-12-28 03:22:02,040][106225] Updated weights for policy 1, policy_version 1131231 (0.0009) [2023-12-28 03:22:02,098][106225] Updated weights for policy 1, policy_version 1131241 (0.0008) [2023-12-28 03:22:02,138][106226] Updated weights for policy 0, policy_version 1128253 (0.0008) [2023-12-28 03:22:02,198][106226] Updated weights for policy 0, policy_version 1128263 (0.0009) [2023-12-28 03:22:02,254][106226] Updated weights for policy 0, policy_version 1128273 (0.0010) [2023-12-28 03:22:02,844][106225] Updated weights for policy 1, policy_version 1131251 (0.0009) [2023-12-28 03:22:02,906][106225] Updated weights for policy 1, policy_version 1131261 (0.0008) [2023-12-28 03:22:02,966][106225] Updated weights for policy 1, policy_version 1131271 (0.0008) [2023-12-28 03:22:02,971][106226] Updated weights for policy 0, policy_version 1128283 (0.0008) [2023-12-28 03:22:03,027][106226] Updated weights for policy 0, policy_version 1128293 (0.0008) [2023-12-28 03:22:03,084][106226] Updated weights for policy 0, policy_version 1128304 (0.0009) [2023-12-28 03:22:03,513][106225] Updated weights for policy 1, policy_version 1131281 (0.0006) [2023-12-28 03:22:03,566][106225] Updated weights for policy 1, policy_version 1131291 (0.0010) [2023-12-28 03:22:03,632][106225] Updated weights for policy 1, policy_version 1131301 (0.0010) [2023-12-28 03:22:03,683][106226] Updated weights for policy 0, policy_version 1128314 (0.0005) [2023-12-28 03:22:03,688][106225] Updated weights for policy 1, policy_version 1131311 (0.0010) [2023-12-28 03:22:03,741][106226] Updated weights for policy 0, policy_version 1128324 (0.0007) [2023-12-28 03:22:03,801][106226] Updated weights for policy 0, policy_version 1128334 (0.0008) [2023-12-28 03:22:03,870][106226] Updated weights for policy 0, policy_version 1128344 (0.0008) [2023-12-28 03:22:04,341][106225] Updated weights for policy 1, policy_version 1131321 (0.0006) [2023-12-28 03:22:04,401][106225] Updated weights for policy 1, policy_version 1131331 (0.0006) [2023-12-28 03:22:04,463][106225] Updated weights for policy 1, policy_version 1131341 (0.0006) [2023-12-28 03:22:04,545][106226] Updated weights for policy 0, policy_version 1128354 (0.0006) [2023-12-28 03:22:04,611][106226] Updated weights for policy 0, policy_version 1128364 (0.0005) [2023-12-28 03:22:04,677][106226] Updated weights for policy 0, policy_version 1128374 (0.0005) [2023-12-28 03:22:05,043][106225] Updated weights for policy 1, policy_version 1131351 (0.0008) [2023-12-28 03:22:05,105][106225] Updated weights for policy 1, policy_version 1131361 (0.0008) [2023-12-28 03:22:05,163][106225] Updated weights for policy 1, policy_version 1131371 (0.0009) [2023-12-28 03:22:05,208][106226] Updated weights for policy 0, policy_version 1128384 (0.0006) [2023-12-28 03:22:05,258][106226] Updated weights for policy 0, policy_version 1128394 (0.0009) [2023-12-28 03:22:05,315][106226] Updated weights for policy 0, policy_version 1128404 (0.0010) [2023-12-28 03:22:05,821][106225] Updated weights for policy 1, policy_version 1131381 (0.0009) [2023-12-28 03:22:05,871][106225] Updated weights for policy 1, policy_version 1131391 (0.0009) [2023-12-28 03:22:05,925][106225] Updated weights for policy 1, policy_version 1131401 (0.0005) [2023-12-28 03:22:05,989][106226] Updated weights for policy 0, policy_version 1128414 (0.0008) [2023-12-28 03:22:06,051][106226] Updated weights for policy 0, policy_version 1128424 (0.0006) [2023-12-28 03:22:06,113][106226] Updated weights for policy 0, policy_version 1128434 (0.0007) [2023-12-28 03:22:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 578625536. Throughput: 0: 9796.4, 1: 10048.4. Samples: 578628864. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:06,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.038')] [2023-12-28 03:22:06,619][106225] Updated weights for policy 1, policy_version 1131411 (0.0006) [2023-12-28 03:22:06,685][106225] Updated weights for policy 1, policy_version 1131421 (0.0007) [2023-12-28 03:22:06,751][106225] Updated weights for policy 1, policy_version 1131431 (0.0006) [2023-12-28 03:22:06,780][106226] Updated weights for policy 0, policy_version 1128444 (0.0008) [2023-12-28 03:22:06,848][106226] Updated weights for policy 0, policy_version 1128454 (0.0008) [2023-12-28 03:22:06,915][106226] Updated weights for policy 0, policy_version 1128464 (0.0008) [2023-12-28 03:22:07,368][106225] Updated weights for policy 1, policy_version 1131441 (0.0006) [2023-12-28 03:22:07,434][106225] Updated weights for policy 1, policy_version 1131451 (0.0008) [2023-12-28 03:22:07,496][106225] Updated weights for policy 1, policy_version 1131461 (0.0009) [2023-12-28 03:22:07,559][106225] Updated weights for policy 1, policy_version 1131471 (0.0009) [2023-12-28 03:22:07,605][106226] Updated weights for policy 0, policy_version 1128474 (0.0008) [2023-12-28 03:22:07,676][106226] Updated weights for policy 0, policy_version 1128484 (0.0009) [2023-12-28 03:22:07,734][106226] Updated weights for policy 0, policy_version 1128494 (0.0008) [2023-12-28 03:22:07,792][106226] Updated weights for policy 0, policy_version 1128504 (0.0008) [2023-12-28 03:22:08,237][106225] Updated weights for policy 1, policy_version 1131481 (0.0009) [2023-12-28 03:22:08,282][106225] Updated weights for policy 1, policy_version 1131491 (0.0008) [2023-12-28 03:22:08,337][106225] Updated weights for policy 1, policy_version 1131501 (0.0008) [2023-12-28 03:22:08,527][106226] Updated weights for policy 0, policy_version 1128514 (0.0009) [2023-12-28 03:22:08,587][106226] Updated weights for policy 0, policy_version 1128524 (0.0008) [2023-12-28 03:22:08,654][106226] Updated weights for policy 0, policy_version 1128534 (0.0009) [2023-12-28 03:22:09,073][106225] Updated weights for policy 1, policy_version 1131511 (0.0006) [2023-12-28 03:22:09,148][106225] Updated weights for policy 1, policy_version 1131521 (0.0005) [2023-12-28 03:22:09,203][106225] Updated weights for policy 1, policy_version 1131531 (0.0005) [2023-12-28 03:22:09,417][106226] Updated weights for policy 0, policy_version 1128544 (0.0008) [2023-12-28 03:22:09,485][106226] Updated weights for policy 0, policy_version 1128554 (0.0009) [2023-12-28 03:22:09,550][106226] Updated weights for policy 0, policy_version 1128564 (0.0009) [2023-12-28 03:22:09,850][106225] Updated weights for policy 1, policy_version 1131541 (0.0008) [2023-12-28 03:22:09,908][106225] Updated weights for policy 1, policy_version 1131551 (0.0008) [2023-12-28 03:22:09,970][106225] Updated weights for policy 1, policy_version 1131561 (0.0009) [2023-12-28 03:22:10,249][106226] Updated weights for policy 0, policy_version 1128574 (0.0008) [2023-12-28 03:22:10,308][106226] Updated weights for policy 0, policy_version 1128584 (0.0005) [2023-12-28 03:22:10,378][106226] Updated weights for policy 0, policy_version 1128594 (0.0008) [2023-12-28 03:22:10,784][106225] Updated weights for policy 1, policy_version 1131571 (0.0008) [2023-12-28 03:22:10,844][106225] Updated weights for policy 1, policy_version 1131581 (0.0006) [2023-12-28 03:22:10,902][106225] Updated weights for policy 1, policy_version 1131591 (0.0006) [2023-12-28 03:22:11,091][106226] Updated weights for policy 0, policy_version 1128604 (0.0010) [2023-12-28 03:22:11,159][106226] Updated weights for policy 0, policy_version 1128614 (0.0008) [2023-12-28 03:22:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 578715648. Throughput: 0: 9824.3, 1: 10098.4. Samples: 578687884. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:11,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.372')] [2023-12-28 03:22:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001131600_289734656.pth... [2023-12-28 03:22:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001130416_289431552.pth [2023-12-28 03:22:11,187][106141] Saving new best policy, reward=-4.372! [2023-12-28 03:22:11,216][106226] Updated weights for policy 0, policy_version 1128624 (0.0008) [2023-12-28 03:22:11,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001128632_288989184.pth... [2023-12-28 03:22:11,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001127480_288694272.pth [2023-12-28 03:22:11,649][106225] Updated weights for policy 1, policy_version 1131601 (0.0006) [2023-12-28 03:22:11,710][106225] Updated weights for policy 1, policy_version 1131611 (0.0008) [2023-12-28 03:22:11,791][106225] Updated weights for policy 1, policy_version 1131621 (0.0010) [2023-12-28 03:22:11,850][106225] Updated weights for policy 1, policy_version 1131631 (0.0009) [2023-12-28 03:22:11,890][106226] Updated weights for policy 0, policy_version 1128634 (0.0007) [2023-12-28 03:22:11,953][106226] Updated weights for policy 0, policy_version 1128644 (0.0007) [2023-12-28 03:22:12,017][106226] Updated weights for policy 0, policy_version 1128654 (0.0009) [2023-12-28 03:22:12,077][106226] Updated weights for policy 0, policy_version 1128664 (0.0009) [2023-12-28 03:22:12,607][106225] Updated weights for policy 1, policy_version 1131641 (0.0008) [2023-12-28 03:22:12,674][106225] Updated weights for policy 1, policy_version 1131651 (0.0008) [2023-12-28 03:22:12,739][106225] Updated weights for policy 1, policy_version 1131661 (0.0008) [2023-12-28 03:22:12,795][106226] Updated weights for policy 0, policy_version 1128674 (0.0010) [2023-12-28 03:22:12,857][106226] Updated weights for policy 0, policy_version 1128684 (0.0011) [2023-12-28 03:22:12,923][106226] Updated weights for policy 0, policy_version 1128694 (0.0011) [2023-12-28 03:22:13,474][106225] Updated weights for policy 1, policy_version 1131671 (0.0008) [2023-12-28 03:22:13,532][106225] Updated weights for policy 1, policy_version 1131681 (0.0007) [2023-12-28 03:22:13,571][106226] Updated weights for policy 0, policy_version 1128704 (0.0010) [2023-12-28 03:22:13,586][106225] Updated weights for policy 1, policy_version 1131691 (0.0009) [2023-12-28 03:22:13,620][106226] Updated weights for policy 0, policy_version 1128714 (0.0010) [2023-12-28 03:22:13,680][106226] Updated weights for policy 0, policy_version 1128724 (0.0010) [2023-12-28 03:22:14,267][106225] Updated weights for policy 1, policy_version 1131701 (0.0008) [2023-12-28 03:22:14,328][106225] Updated weights for policy 1, policy_version 1131711 (0.0008) [2023-12-28 03:22:14,384][106225] Updated weights for policy 1, policy_version 1131721 (0.0006) [2023-12-28 03:22:14,402][106226] Updated weights for policy 0, policy_version 1128734 (0.0010) [2023-12-28 03:22:14,454][106226] Updated weights for policy 0, policy_version 1128744 (0.0009) [2023-12-28 03:22:14,516][106226] Updated weights for policy 0, policy_version 1128754 (0.0009) [2023-12-28 03:22:15,126][106225] Updated weights for policy 1, policy_version 1131731 (0.0007) [2023-12-28 03:22:15,189][106225] Updated weights for policy 1, policy_version 1131741 (0.0010) [2023-12-28 03:22:15,204][106226] Updated weights for policy 0, policy_version 1128764 (0.0006) [2023-12-28 03:22:15,246][106225] Updated weights for policy 1, policy_version 1131751 (0.0008) [2023-12-28 03:22:15,269][106226] Updated weights for policy 0, policy_version 1128774 (0.0007) [2023-12-28 03:22:15,329][106226] Updated weights for policy 0, policy_version 1128784 (0.0007) [2023-12-28 03:22:15,953][106226] Updated weights for policy 0, policy_version 1128794 (0.0007) [2023-12-28 03:22:15,958][106225] Updated weights for policy 1, policy_version 1131761 (0.0011) [2023-12-28 03:22:16,008][106225] Updated weights for policy 1, policy_version 1131771 (0.0010) [2023-12-28 03:22:16,012][106226] Updated weights for policy 0, policy_version 1128804 (0.0005) [2023-12-28 03:22:16,067][106226] Updated weights for policy 0, policy_version 1128814 (0.0005) [2023-12-28 03:22:16,069][106225] Updated weights for policy 1, policy_version 1131781 (0.0010) [2023-12-28 03:22:16,125][106225] Updated weights for policy 1, policy_version 1131791 (0.0010) [2023-12-28 03:22:16,126][106226] Updated weights for policy 0, policy_version 1128824 (0.0005) [2023-12-28 03:22:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 578822144. Throughput: 0: 9740.5, 1: 10007.6. Samples: 578803776. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:16,176][105115] Avg episode reward: [(0, '-4.859'), (1, '-4.792')] [2023-12-28 03:22:16,716][106225] Updated weights for policy 1, policy_version 1131801 (0.0006) [2023-12-28 03:22:16,771][106225] Updated weights for policy 1, policy_version 1131811 (0.0009) [2023-12-28 03:22:16,827][106225] Updated weights for policy 1, policy_version 1131821 (0.0007) [2023-12-28 03:22:16,842][106226] Updated weights for policy 0, policy_version 1128834 (0.0007) [2023-12-28 03:22:16,892][106226] Updated weights for policy 0, policy_version 1128844 (0.0008) [2023-12-28 03:22:16,952][106226] Updated weights for policy 0, policy_version 1128854 (0.0008) [2023-12-28 03:22:17,508][106225] Updated weights for policy 1, policy_version 1131831 (0.0008) [2023-12-28 03:22:17,557][106225] Updated weights for policy 1, policy_version 1131841 (0.0008) [2023-12-28 03:22:17,605][106225] Updated weights for policy 1, policy_version 1131851 (0.0008) [2023-12-28 03:22:17,647][106226] Updated weights for policy 0, policy_version 1128864 (0.0008) [2023-12-28 03:22:17,701][106226] Updated weights for policy 0, policy_version 1128874 (0.0009) [2023-12-28 03:22:17,748][106226] Updated weights for policy 0, policy_version 1128884 (0.0008) [2023-12-28 03:22:18,231][106225] Updated weights for policy 1, policy_version 1131861 (0.0008) [2023-12-28 03:22:18,284][106225] Updated weights for policy 1, policy_version 1131871 (0.0010) [2023-12-28 03:22:18,331][106225] Updated weights for policy 1, policy_version 1131881 (0.0010) [2023-12-28 03:22:18,464][106226] Updated weights for policy 0, policy_version 1128894 (0.0008) [2023-12-28 03:22:18,526][106226] Updated weights for policy 0, policy_version 1128904 (0.0008) [2023-12-28 03:22:18,584][106226] Updated weights for policy 0, policy_version 1128914 (0.0008) [2023-12-28 03:22:19,072][106225] Updated weights for policy 1, policy_version 1131891 (0.0010) [2023-12-28 03:22:19,122][106225] Updated weights for policy 1, policy_version 1131901 (0.0010) [2023-12-28 03:22:19,175][106225] Updated weights for policy 1, policy_version 1131911 (0.0010) [2023-12-28 03:22:19,314][106226] Updated weights for policy 0, policy_version 1128924 (0.0008) [2023-12-28 03:22:19,379][106226] Updated weights for policy 0, policy_version 1128934 (0.0010) [2023-12-28 03:22:19,437][106226] Updated weights for policy 0, policy_version 1128944 (0.0011) [2023-12-28 03:22:19,939][106225] Updated weights for policy 1, policy_version 1131921 (0.0010) [2023-12-28 03:22:20,005][106225] Updated weights for policy 1, policy_version 1131931 (0.0006) [2023-12-28 03:22:20,067][106225] Updated weights for policy 1, policy_version 1131941 (0.0008) [2023-12-28 03:22:20,127][106225] Updated weights for policy 1, policy_version 1131951 (0.0008) [2023-12-28 03:22:20,163][106226] Updated weights for policy 0, policy_version 1128954 (0.0011) [2023-12-28 03:22:20,225][106226] Updated weights for policy 0, policy_version 1128964 (0.0011) [2023-12-28 03:22:20,284][106226] Updated weights for policy 0, policy_version 1128974 (0.0011) [2023-12-28 03:22:20,340][106226] Updated weights for policy 0, policy_version 1128984 (0.0009) [2023-12-28 03:22:20,835][106225] Updated weights for policy 1, policy_version 1131961 (0.0006) [2023-12-28 03:22:20,894][106225] Updated weights for policy 1, policy_version 1131971 (0.0008) [2023-12-28 03:22:20,957][106225] Updated weights for policy 1, policy_version 1131981 (0.0008) [2023-12-28 03:22:21,108][106226] Updated weights for policy 0, policy_version 1128994 (0.0008) [2023-12-28 03:22:21,174][106226] Updated weights for policy 0, policy_version 1129004 (0.0009) [2023-12-28 03:22:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 578912256. Throughput: 0: 9743.1, 1: 9959.0. Samples: 578922484. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:21,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.799')] [2023-12-28 03:22:21,238][106226] Updated weights for policy 0, policy_version 1129014 (0.0009) [2023-12-28 03:22:21,645][106225] Updated weights for policy 1, policy_version 1131991 (0.0009) [2023-12-28 03:22:21,705][106225] Updated weights for policy 1, policy_version 1132001 (0.0008) [2023-12-28 03:22:21,766][106225] Updated weights for policy 1, policy_version 1132011 (0.0007) [2023-12-28 03:22:22,089][106226] Updated weights for policy 0, policy_version 1129024 (0.0010) [2023-12-28 03:22:22,139][106226] Updated weights for policy 0, policy_version 1129034 (0.0008) [2023-12-28 03:22:22,199][106226] Updated weights for policy 0, policy_version 1129044 (0.0009) [2023-12-28 03:22:22,510][106225] Updated weights for policy 1, policy_version 1132021 (0.0008) [2023-12-28 03:22:22,559][106225] Updated weights for policy 1, policy_version 1132031 (0.0008) [2023-12-28 03:22:22,612][106225] Updated weights for policy 1, policy_version 1132041 (0.0007) [2023-12-28 03:22:22,971][106226] Updated weights for policy 0, policy_version 1129054 (0.0008) [2023-12-28 03:22:23,034][106226] Updated weights for policy 0, policy_version 1129064 (0.0008) [2023-12-28 03:22:23,081][106226] Updated weights for policy 0, policy_version 1129074 (0.0008) [2023-12-28 03:22:23,354][106225] Updated weights for policy 1, policy_version 1132051 (0.0006) [2023-12-28 03:22:23,413][106225] Updated weights for policy 1, policy_version 1132061 (0.0008) [2023-12-28 03:22:23,478][106225] Updated weights for policy 1, policy_version 1132071 (0.0008) [2023-12-28 03:22:23,792][106226] Updated weights for policy 0, policy_version 1129084 (0.0009) [2023-12-28 03:22:23,856][106226] Updated weights for policy 0, policy_version 1129094 (0.0009) [2023-12-28 03:22:23,916][106226] Updated weights for policy 0, policy_version 1129104 (0.0008) [2023-12-28 03:22:24,159][106225] Updated weights for policy 1, policy_version 1132081 (0.0010) [2023-12-28 03:22:24,217][106225] Updated weights for policy 1, policy_version 1132091 (0.0005) [2023-12-28 03:22:24,277][106225] Updated weights for policy 1, policy_version 1132101 (0.0005) [2023-12-28 03:22:24,337][106225] Updated weights for policy 1, policy_version 1132111 (0.0006) [2023-12-28 03:22:24,661][106226] Updated weights for policy 0, policy_version 1129114 (0.0006) [2023-12-28 03:22:24,707][106226] Updated weights for policy 0, policy_version 1129124 (0.0009) [2023-12-28 03:22:24,760][106226] Updated weights for policy 0, policy_version 1129134 (0.0008) [2023-12-28 03:22:24,821][106226] Updated weights for policy 0, policy_version 1129144 (0.0009) [2023-12-28 03:22:24,985][106225] Updated weights for policy 1, policy_version 1132121 (0.0008) [2023-12-28 03:22:25,048][106225] Updated weights for policy 1, policy_version 1132131 (0.0008) [2023-12-28 03:22:25,109][106225] Updated weights for policy 1, policy_version 1132141 (0.0008) [2023-12-28 03:22:25,531][106226] Updated weights for policy 0, policy_version 1129154 (0.0005) [2023-12-28 03:22:25,597][106226] Updated weights for policy 0, policy_version 1129164 (0.0007) [2023-12-28 03:22:25,658][106226] Updated weights for policy 0, policy_version 1129174 (0.0009) [2023-12-28 03:22:25,846][106225] Updated weights for policy 1, policy_version 1132151 (0.0008) [2023-12-28 03:22:25,906][106225] Updated weights for policy 1, policy_version 1132161 (0.0008) [2023-12-28 03:22:25,966][106225] Updated weights for policy 1, policy_version 1132171 (0.0009) [2023-12-28 03:22:26,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 579010560. Throughput: 0: 9682.4, 1: 9958.7. Samples: 578978748. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:26,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-4.884')] [2023-12-28 03:22:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001132176_289882112.pth... [2023-12-28 03:22:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001129176_289128448.pth... [2023-12-28 03:22:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001130992_289579008.pth [2023-12-28 03:22:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001128056_288841728.pth [2023-12-28 03:22:26,316][106226] Updated weights for policy 0, policy_version 1129184 (0.0008) [2023-12-28 03:22:26,361][106226] Updated weights for policy 0, policy_version 1129194 (0.0008) [2023-12-28 03:22:26,420][106226] Updated weights for policy 0, policy_version 1129204 (0.0008) [2023-12-28 03:22:26,686][106225] Updated weights for policy 1, policy_version 1132181 (0.0010) [2023-12-28 03:22:26,742][106225] Updated weights for policy 1, policy_version 1132191 (0.0008) [2023-12-28 03:22:26,795][106225] Updated weights for policy 1, policy_version 1132201 (0.0007) [2023-12-28 03:22:27,110][106226] Updated weights for policy 0, policy_version 1129214 (0.0007) [2023-12-28 03:22:27,166][106226] Updated weights for policy 0, policy_version 1129224 (0.0006) [2023-12-28 03:22:27,221][106226] Updated weights for policy 0, policy_version 1129234 (0.0006) [2023-12-28 03:22:27,370][106225] Updated weights for policy 1, policy_version 1132211 (0.0008) [2023-12-28 03:22:27,427][106225] Updated weights for policy 1, policy_version 1132221 (0.0005) [2023-12-28 03:22:27,474][106225] Updated weights for policy 1, policy_version 1132231 (0.0005) [2023-12-28 03:22:27,746][106226] Updated weights for policy 0, policy_version 1129244 (0.0006) [2023-12-28 03:22:27,797][106226] Updated weights for policy 0, policy_version 1129254 (0.0005) [2023-12-28 03:22:27,859][106226] Updated weights for policy 0, policy_version 1129264 (0.0006) [2023-12-28 03:22:27,983][106225] Updated weights for policy 1, policy_version 1132241 (0.0005) [2023-12-28 03:22:28,034][106225] Updated weights for policy 1, policy_version 1132251 (0.0008) [2023-12-28 03:22:28,085][106225] Updated weights for policy 1, policy_version 1132261 (0.0008) [2023-12-28 03:22:28,139][106225] Updated weights for policy 1, policy_version 1132271 (0.0008) [2023-12-28 03:22:28,451][106226] Updated weights for policy 0, policy_version 1129274 (0.0008) [2023-12-28 03:22:28,504][106226] Updated weights for policy 0, policy_version 1129284 (0.0009) [2023-12-28 03:22:28,564][106226] Updated weights for policy 0, policy_version 1129294 (0.0008) [2023-12-28 03:22:28,631][106226] Updated weights for policy 0, policy_version 1129304 (0.0009) [2023-12-28 03:22:28,785][106225] Updated weights for policy 1, policy_version 1132281 (0.0007) [2023-12-28 03:22:28,843][106225] Updated weights for policy 1, policy_version 1132291 (0.0008) [2023-12-28 03:22:28,906][106225] Updated weights for policy 1, policy_version 1132301 (0.0008) [2023-12-28 03:22:29,288][106226] Updated weights for policy 0, policy_version 1129314 (0.0008) [2023-12-28 03:22:29,359][106226] Updated weights for policy 0, policy_version 1129324 (0.0009) [2023-12-28 03:22:29,413][106226] Updated weights for policy 0, policy_version 1129334 (0.0006) [2023-12-28 03:22:29,662][106225] Updated weights for policy 1, policy_version 1132311 (0.0009) [2023-12-28 03:22:29,723][106225] Updated weights for policy 1, policy_version 1132321 (0.0008) [2023-12-28 03:22:29,784][106225] Updated weights for policy 1, policy_version 1132331 (0.0008) [2023-12-28 03:22:30,094][106226] Updated weights for policy 0, policy_version 1129344 (0.0008) [2023-12-28 03:22:30,151][106226] Updated weights for policy 0, policy_version 1129354 (0.0008) [2023-12-28 03:22:30,212][106226] Updated weights for policy 0, policy_version 1129364 (0.0008) [2023-12-28 03:22:30,476][106225] Updated weights for policy 1, policy_version 1132341 (0.0009) [2023-12-28 03:22:30,531][106225] Updated weights for policy 1, policy_version 1132351 (0.0010) [2023-12-28 03:22:30,590][106225] Updated weights for policy 1, policy_version 1132361 (0.0010) [2023-12-28 03:22:30,934][106226] Updated weights for policy 0, policy_version 1129374 (0.0008) [2023-12-28 03:22:30,980][106226] Updated weights for policy 0, policy_version 1129384 (0.0007) [2023-12-28 03:22:31,035][106226] Updated weights for policy 0, policy_version 1129394 (0.0008) [2023-12-28 03:22:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 579117056. Throughput: 0: 9832.3, 1: 10076.0. Samples: 579104412. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:31,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-4.887')] [2023-12-28 03:22:31,322][106225] Updated weights for policy 1, policy_version 1132371 (0.0010) [2023-12-28 03:22:31,387][106225] Updated weights for policy 1, policy_version 1132381 (0.0009) [2023-12-28 03:22:31,449][106225] Updated weights for policy 1, policy_version 1132391 (0.0009) [2023-12-28 03:22:31,815][106226] Updated weights for policy 0, policy_version 1129404 (0.0008) [2023-12-28 03:22:31,866][106226] Updated weights for policy 0, policy_version 1129414 (0.0008) [2023-12-28 03:22:31,916][106226] Updated weights for policy 0, policy_version 1129424 (0.0008) [2023-12-28 03:22:32,162][106225] Updated weights for policy 1, policy_version 1132401 (0.0010) [2023-12-28 03:22:32,225][106225] Updated weights for policy 1, policy_version 1132411 (0.0006) [2023-12-28 03:22:32,286][106225] Updated weights for policy 1, policy_version 1132421 (0.0007) [2023-12-28 03:22:32,349][106225] Updated weights for policy 1, policy_version 1132431 (0.0006) [2023-12-28 03:22:32,662][106226] Updated weights for policy 0, policy_version 1129434 (0.0008) [2023-12-28 03:22:32,729][106226] Updated weights for policy 0, policy_version 1129444 (0.0011) [2023-12-28 03:22:32,785][106226] Updated weights for policy 0, policy_version 1129454 (0.0010) [2023-12-28 03:22:32,841][106226] Updated weights for policy 0, policy_version 1129464 (0.0010) [2023-12-28 03:22:33,049][106225] Updated weights for policy 1, policy_version 1132441 (0.0008) [2023-12-28 03:22:33,098][106225] Updated weights for policy 1, policy_version 1132451 (0.0008) [2023-12-28 03:22:33,148][106225] Updated weights for policy 1, policy_version 1132461 (0.0008) [2023-12-28 03:22:33,535][106226] Updated weights for policy 0, policy_version 1129474 (0.0008) [2023-12-28 03:22:33,594][106226] Updated weights for policy 0, policy_version 1129484 (0.0007) [2023-12-28 03:22:33,648][106226] Updated weights for policy 0, policy_version 1129494 (0.0007) [2023-12-28 03:22:33,884][106225] Updated weights for policy 1, policy_version 1132471 (0.0006) [2023-12-28 03:22:33,941][106225] Updated weights for policy 1, policy_version 1132481 (0.0008) [2023-12-28 03:22:33,999][106225] Updated weights for policy 1, policy_version 1132491 (0.0008) [2023-12-28 03:22:34,322][106226] Updated weights for policy 0, policy_version 1129504 (0.0010) [2023-12-28 03:22:34,388][106226] Updated weights for policy 0, policy_version 1129514 (0.0008) [2023-12-28 03:22:34,456][106226] Updated weights for policy 0, policy_version 1129524 (0.0006) [2023-12-28 03:22:34,645][106225] Updated weights for policy 1, policy_version 1132501 (0.0008) [2023-12-28 03:22:34,696][106225] Updated weights for policy 1, policy_version 1132511 (0.0008) [2023-12-28 03:22:34,748][106225] Updated weights for policy 1, policy_version 1132521 (0.0008) [2023-12-28 03:22:35,136][106226] Updated weights for policy 0, policy_version 1129534 (0.0008) [2023-12-28 03:22:35,190][106226] Updated weights for policy 0, policy_version 1129544 (0.0010) [2023-12-28 03:22:35,254][106226] Updated weights for policy 0, policy_version 1129554 (0.0011) [2023-12-28 03:22:35,347][106225] Updated weights for policy 1, policy_version 1132531 (0.0007) [2023-12-28 03:22:35,401][106225] Updated weights for policy 1, policy_version 1132541 (0.0010) [2023-12-28 03:22:35,464][106225] Updated weights for policy 1, policy_version 1132551 (0.0010) [2023-12-28 03:22:35,930][106226] Updated weights for policy 0, policy_version 1129564 (0.0011) [2023-12-28 03:22:35,981][106226] Updated weights for policy 0, policy_version 1129574 (0.0011) [2023-12-28 03:22:36,037][106226] Updated weights for policy 0, policy_version 1129584 (0.0010) [2023-12-28 03:22:36,059][106225] Updated weights for policy 1, policy_version 1132561 (0.0010) [2023-12-28 03:22:36,128][106225] Updated weights for policy 1, policy_version 1132571 (0.0007) [2023-12-28 03:22:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 579215360. Throughput: 0: 9837.7, 1: 10055.0. Samples: 579222836. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:36,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.812')] [2023-12-28 03:22:36,193][106225] Updated weights for policy 1, policy_version 1132581 (0.0008) [2023-12-28 03:22:36,253][106225] Updated weights for policy 1, policy_version 1132591 (0.0008) [2023-12-28 03:22:36,729][106226] Updated weights for policy 0, policy_version 1129594 (0.0009) [2023-12-28 03:22:36,777][106226] Updated weights for policy 0, policy_version 1129604 (0.0005) [2023-12-28 03:22:36,825][106226] Updated weights for policy 0, policy_version 1129614 (0.0008) [2023-12-28 03:22:36,883][106226] Updated weights for policy 0, policy_version 1129624 (0.0011) [2023-12-28 03:22:36,967][106225] Updated weights for policy 1, policy_version 1132601 (0.0008) [2023-12-28 03:22:37,034][106225] Updated weights for policy 1, policy_version 1132611 (0.0010) [2023-12-28 03:22:37,095][106225] Updated weights for policy 1, policy_version 1132621 (0.0010) [2023-12-28 03:22:37,574][106226] Updated weights for policy 0, policy_version 1129634 (0.0006) [2023-12-28 03:22:37,632][106226] Updated weights for policy 0, policy_version 1129644 (0.0006) [2023-12-28 03:22:37,690][106226] Updated weights for policy 0, policy_version 1129654 (0.0007) [2023-12-28 03:22:37,767][106225] Updated weights for policy 1, policy_version 1132631 (0.0010) [2023-12-28 03:22:37,814][106225] Updated weights for policy 1, policy_version 1132641 (0.0010) [2023-12-28 03:22:37,874][106225] Updated weights for policy 1, policy_version 1132651 (0.0010) [2023-12-28 03:22:38,298][106226] Updated weights for policy 0, policy_version 1129664 (0.0007) [2023-12-28 03:22:38,365][106226] Updated weights for policy 0, policy_version 1129674 (0.0008) [2023-12-28 03:22:38,420][106226] Updated weights for policy 0, policy_version 1129684 (0.0008) [2023-12-28 03:22:38,540][106225] Updated weights for policy 1, policy_version 1132661 (0.0010) [2023-12-28 03:22:38,593][106225] Updated weights for policy 1, policy_version 1132671 (0.0010) [2023-12-28 03:22:38,656][106225] Updated weights for policy 1, policy_version 1132681 (0.0010) [2023-12-28 03:22:39,107][106226] Updated weights for policy 0, policy_version 1129694 (0.0007) [2023-12-28 03:22:39,165][106226] Updated weights for policy 0, policy_version 1129704 (0.0005) [2023-12-28 03:22:39,227][106226] Updated weights for policy 0, policy_version 1129714 (0.0006) [2023-12-28 03:22:39,406][106225] Updated weights for policy 1, policy_version 1132691 (0.0010) [2023-12-28 03:22:39,469][106225] Updated weights for policy 1, policy_version 1132701 (0.0008) [2023-12-28 03:22:39,534][106225] Updated weights for policy 1, policy_version 1132711 (0.0008) [2023-12-28 03:22:39,881][106226] Updated weights for policy 0, policy_version 1129724 (0.0007) [2023-12-28 03:22:39,947][106226] Updated weights for policy 0, policy_version 1129734 (0.0007) [2023-12-28 03:22:40,004][106226] Updated weights for policy 0, policy_version 1129744 (0.0006) [2023-12-28 03:22:40,311][106225] Updated weights for policy 1, policy_version 1132721 (0.0008) [2023-12-28 03:22:40,366][106225] Updated weights for policy 1, policy_version 1132731 (0.0008) [2023-12-28 03:22:40,436][106225] Updated weights for policy 1, policy_version 1132741 (0.0008) [2023-12-28 03:22:40,502][106225] Updated weights for policy 1, policy_version 1132751 (0.0006) [2023-12-28 03:22:40,675][106226] Updated weights for policy 0, policy_version 1129754 (0.0008) [2023-12-28 03:22:40,746][106226] Updated weights for policy 0, policy_version 1129764 (0.0009) [2023-12-28 03:22:40,812][106226] Updated weights for policy 0, policy_version 1129774 (0.0008) [2023-12-28 03:22:40,879][106226] Updated weights for policy 0, policy_version 1129784 (0.0009) [2023-12-28 03:22:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 579313664. Throughput: 0: 9903.5, 1: 10047.6. Samples: 579284816. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:41,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.954')] [2023-12-28 03:22:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001132752_290029568.pth... [2023-12-28 03:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001129784_289284096.pth... [2023-12-28 03:22:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001131600_289734656.pth [2023-12-28 03:22:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001128632_288989184.pth [2023-12-28 03:22:41,291][106225] Updated weights for policy 1, policy_version 1132761 (0.0008) [2023-12-28 03:22:41,343][106225] Updated weights for policy 1, policy_version 1132771 (0.0008) [2023-12-28 03:22:41,406][106225] Updated weights for policy 1, policy_version 1132781 (0.0008) [2023-12-28 03:22:41,558][106226] Updated weights for policy 0, policy_version 1129794 (0.0009) [2023-12-28 03:22:41,621][106226] Updated weights for policy 0, policy_version 1129804 (0.0008) [2023-12-28 03:22:41,692][106226] Updated weights for policy 0, policy_version 1129814 (0.0007) [2023-12-28 03:22:42,248][106225] Updated weights for policy 1, policy_version 1132791 (0.0009) [2023-12-28 03:22:42,315][106225] Updated weights for policy 1, policy_version 1132801 (0.0011) [2023-12-28 03:22:42,375][106226] Updated weights for policy 0, policy_version 1129824 (0.0008) [2023-12-28 03:22:42,380][106225] Updated weights for policy 1, policy_version 1132811 (0.0010) [2023-12-28 03:22:42,431][106226] Updated weights for policy 0, policy_version 1129834 (0.0007) [2023-12-28 03:22:42,483][106226] Updated weights for policy 0, policy_version 1129844 (0.0006) [2023-12-28 03:22:43,153][106225] Updated weights for policy 1, policy_version 1132821 (0.0008) [2023-12-28 03:22:43,153][106226] Updated weights for policy 0, policy_version 1129854 (0.0007) [2023-12-28 03:22:43,204][106226] Updated weights for policy 0, policy_version 1129864 (0.0010) [2023-12-28 03:22:43,214][106225] Updated weights for policy 1, policy_version 1132831 (0.0006) [2023-12-28 03:22:43,254][106226] Updated weights for policy 0, policy_version 1129874 (0.0005) [2023-12-28 03:22:43,274][106225] Updated weights for policy 1, policy_version 1132841 (0.0008) [2023-12-28 03:22:43,845][106226] Updated weights for policy 0, policy_version 1129884 (0.0007) [2023-12-28 03:22:43,897][106226] Updated weights for policy 0, policy_version 1129894 (0.0010) [2023-12-28 03:22:43,951][106226] Updated weights for policy 0, policy_version 1129904 (0.0010) [2023-12-28 03:22:44,042][106225] Updated weights for policy 1, policy_version 1132851 (0.0009) [2023-12-28 03:22:44,100][106225] Updated weights for policy 1, policy_version 1132861 (0.0008) [2023-12-28 03:22:44,148][106225] Updated weights for policy 1, policy_version 1132871 (0.0008) [2023-12-28 03:22:44,625][106226] Updated weights for policy 0, policy_version 1129914 (0.0010) [2023-12-28 03:22:44,681][106226] Updated weights for policy 0, policy_version 1129924 (0.0010) [2023-12-28 03:22:44,732][106226] Updated weights for policy 0, policy_version 1129934 (0.0010) [2023-12-28 03:22:44,793][106226] Updated weights for policy 0, policy_version 1129944 (0.0011) [2023-12-28 03:22:44,817][106225] Updated weights for policy 1, policy_version 1132881 (0.0008) [2023-12-28 03:22:44,865][106225] Updated weights for policy 1, policy_version 1132891 (0.0008) [2023-12-28 03:22:44,913][106225] Updated weights for policy 1, policy_version 1132901 (0.0008) [2023-12-28 03:22:44,964][106225] Updated weights for policy 1, policy_version 1132911 (0.0007) [2023-12-28 03:22:45,456][106226] Updated weights for policy 0, policy_version 1129954 (0.0011) [2023-12-28 03:22:45,507][106226] Updated weights for policy 0, policy_version 1129964 (0.0010) [2023-12-28 03:22:45,554][106226] Updated weights for policy 0, policy_version 1129974 (0.0010) [2023-12-28 03:22:45,600][106225] Updated weights for policy 1, policy_version 1132921 (0.0010) [2023-12-28 03:22:45,663][106225] Updated weights for policy 1, policy_version 1132931 (0.0010) [2023-12-28 03:22:45,723][106225] Updated weights for policy 1, policy_version 1132941 (0.0007) [2023-12-28 03:22:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 579411968. Throughput: 0: 9993.3, 1: 9922.3. Samples: 579401540. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:46,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.816')] [2023-12-28 03:22:46,247][106226] Updated weights for policy 0, policy_version 1129984 (0.0006) [2023-12-28 03:22:46,312][106226] Updated weights for policy 0, policy_version 1129994 (0.0010) [2023-12-28 03:22:46,329][106225] Updated weights for policy 1, policy_version 1132951 (0.0005) [2023-12-28 03:22:46,372][106226] Updated weights for policy 0, policy_version 1130004 (0.0011) [2023-12-28 03:22:46,375][106225] Updated weights for policy 1, policy_version 1132961 (0.0005) [2023-12-28 03:22:46,427][106225] Updated weights for policy 1, policy_version 1132971 (0.0006) [2023-12-28 03:22:46,916][106226] Updated weights for policy 0, policy_version 1130014 (0.0007) [2023-12-28 03:22:46,971][106226] Updated weights for policy 0, policy_version 1130024 (0.0005) [2023-12-28 03:22:47,019][106226] Updated weights for policy 0, policy_version 1130034 (0.0005) [2023-12-28 03:22:47,080][106225] Updated weights for policy 1, policy_version 1132981 (0.0009) [2023-12-28 03:22:47,134][106225] Updated weights for policy 1, policy_version 1132991 (0.0009) [2023-12-28 03:22:47,188][106225] Updated weights for policy 1, policy_version 1133001 (0.0008) [2023-12-28 03:22:47,599][106226] Updated weights for policy 0, policy_version 1130044 (0.0005) [2023-12-28 03:22:47,654][106226] Updated weights for policy 0, policy_version 1130054 (0.0006) [2023-12-28 03:22:47,708][106226] Updated weights for policy 0, policy_version 1130064 (0.0009) [2023-12-28 03:22:47,865][106225] Updated weights for policy 1, policy_version 1133011 (0.0008) [2023-12-28 03:22:47,929][106225] Updated weights for policy 1, policy_version 1133021 (0.0008) [2023-12-28 03:22:47,991][106225] Updated weights for policy 1, policy_version 1133031 (0.0005) [2023-12-28 03:22:48,292][106226] Updated weights for policy 0, policy_version 1130074 (0.0008) [2023-12-28 03:22:48,354][106226] Updated weights for policy 0, policy_version 1130084 (0.0007) [2023-12-28 03:22:48,418][106226] Updated weights for policy 0, policy_version 1130094 (0.0008) [2023-12-28 03:22:48,480][106226] Updated weights for policy 0, policy_version 1130104 (0.0009) [2023-12-28 03:22:48,646][106225] Updated weights for policy 1, policy_version 1133041 (0.0006) [2023-12-28 03:22:48,707][106225] Updated weights for policy 1, policy_version 1133051 (0.0009) [2023-12-28 03:22:48,773][106225] Updated weights for policy 1, policy_version 1133061 (0.0009) [2023-12-28 03:22:48,835][106225] Updated weights for policy 1, policy_version 1133071 (0.0008) [2023-12-28 03:22:49,132][106226] Updated weights for policy 0, policy_version 1130114 (0.0006) [2023-12-28 03:22:49,198][106226] Updated weights for policy 0, policy_version 1130124 (0.0010) [2023-12-28 03:22:49,270][106226] Updated weights for policy 0, policy_version 1130134 (0.0011) [2023-12-28 03:22:49,620][106225] Updated weights for policy 1, policy_version 1133081 (0.0010) [2023-12-28 03:22:49,682][106225] Updated weights for policy 1, policy_version 1133091 (0.0010) [2023-12-28 03:22:49,745][106225] Updated weights for policy 1, policy_version 1133101 (0.0008) [2023-12-28 03:22:49,991][106226] Updated weights for policy 0, policy_version 1130144 (0.0009) [2023-12-28 03:22:50,048][106226] Updated weights for policy 0, policy_version 1130154 (0.0005) [2023-12-28 03:22:50,102][106226] Updated weights for policy 0, policy_version 1130164 (0.0005) [2023-12-28 03:22:50,411][106225] Updated weights for policy 1, policy_version 1133111 (0.0006) [2023-12-28 03:22:50,458][106225] Updated weights for policy 1, policy_version 1133121 (0.0007) [2023-12-28 03:22:50,515][106225] Updated weights for policy 1, policy_version 1133131 (0.0007) [2023-12-28 03:22:50,817][106226] Updated weights for policy 0, policy_version 1130174 (0.0010) [2023-12-28 03:22:50,885][106226] Updated weights for policy 0, policy_version 1130184 (0.0011) [2023-12-28 03:22:50,949][106226] Updated weights for policy 0, policy_version 1130194 (0.0010) [2023-12-28 03:22:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 579518464. Throughput: 0: 10039.1, 1: 9919.1. Samples: 579526984. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:51,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.865')] [2023-12-28 03:22:51,218][106225] Updated weights for policy 1, policy_version 1133141 (0.0007) [2023-12-28 03:22:51,292][106225] Updated weights for policy 1, policy_version 1133151 (0.0008) [2023-12-28 03:22:51,345][106225] Updated weights for policy 1, policy_version 1133161 (0.0007) [2023-12-28 03:22:51,629][106226] Updated weights for policy 0, policy_version 1130204 (0.0008) [2023-12-28 03:22:51,699][106226] Updated weights for policy 0, policy_version 1130214 (0.0008) [2023-12-28 03:22:51,772][106226] Updated weights for policy 0, policy_version 1130224 (0.0009) [2023-12-28 03:22:52,129][106225] Updated weights for policy 1, policy_version 1133171 (0.0009) [2023-12-28 03:22:52,185][106225] Updated weights for policy 1, policy_version 1133181 (0.0008) [2023-12-28 03:22:52,235][106225] Updated weights for policy 1, policy_version 1133191 (0.0008) [2023-12-28 03:22:52,478][106226] Updated weights for policy 0, policy_version 1130234 (0.0011) [2023-12-28 03:22:52,543][106226] Updated weights for policy 0, policy_version 1130244 (0.0011) [2023-12-28 03:22:52,607][106226] Updated weights for policy 0, policy_version 1130254 (0.0011) [2023-12-28 03:22:52,671][106226] Updated weights for policy 0, policy_version 1130264 (0.0011) [2023-12-28 03:22:52,949][106225] Updated weights for policy 1, policy_version 1133201 (0.0007) [2023-12-28 03:22:53,001][106225] Updated weights for policy 1, policy_version 1133211 (0.0007) [2023-12-28 03:22:53,052][106225] Updated weights for policy 1, policy_version 1133221 (0.0009) [2023-12-28 03:22:53,103][106225] Updated weights for policy 1, policy_version 1133231 (0.0009) [2023-12-28 03:22:53,280][106226] Updated weights for policy 0, policy_version 1130274 (0.0010) [2023-12-28 03:22:53,340][106226] Updated weights for policy 0, policy_version 1130284 (0.0010) [2023-12-28 03:22:53,402][106226] Updated weights for policy 0, policy_version 1130294 (0.0010) [2023-12-28 03:22:53,837][106225] Updated weights for policy 1, policy_version 1133241 (0.0005) [2023-12-28 03:22:53,893][106225] Updated weights for policy 1, policy_version 1133251 (0.0007) [2023-12-28 03:22:53,939][106225] Updated weights for policy 1, policy_version 1133261 (0.0008) [2023-12-28 03:22:54,097][106226] Updated weights for policy 0, policy_version 1130304 (0.0010) [2023-12-28 03:22:54,153][106226] Updated weights for policy 0, policy_version 1130314 (0.0010) [2023-12-28 03:22:54,213][106226] Updated weights for policy 0, policy_version 1130324 (0.0011) [2023-12-28 03:22:54,648][106225] Updated weights for policy 1, policy_version 1133271 (0.0008) [2023-12-28 03:22:54,709][106225] Updated weights for policy 1, policy_version 1133281 (0.0008) [2023-12-28 03:22:54,756][106225] Updated weights for policy 1, policy_version 1133291 (0.0008) [2023-12-28 03:22:54,897][106226] Updated weights for policy 0, policy_version 1130334 (0.0009) [2023-12-28 03:22:54,956][106226] Updated weights for policy 0, policy_version 1130344 (0.0009) [2023-12-28 03:22:55,017][106226] Updated weights for policy 0, policy_version 1130354 (0.0009) [2023-12-28 03:22:55,525][106225] Updated weights for policy 1, policy_version 1133301 (0.0009) [2023-12-28 03:22:55,592][106225] Updated weights for policy 1, policy_version 1133311 (0.0009) [2023-12-28 03:22:55,650][106225] Updated weights for policy 1, policy_version 1133321 (0.0008) [2023-12-28 03:22:55,717][106226] Updated weights for policy 0, policy_version 1130364 (0.0008) [2023-12-28 03:22:55,765][106226] Updated weights for policy 0, policy_version 1130374 (0.0008) [2023-12-28 03:22:55,813][106226] Updated weights for policy 0, policy_version 1130384 (0.0008) [2023-12-28 03:22:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 579616768. Throughput: 0: 10083.6, 1: 9883.5. Samples: 579586404. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:22:56,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.935')] [2023-12-28 03:22:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001133328_290177024.pth... [2023-12-28 03:22:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001130392_289439744.pth... [2023-12-28 03:22:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001129176_289128448.pth [2023-12-28 03:22:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001132176_289882112.pth [2023-12-28 03:22:56,417][106225] Updated weights for policy 1, policy_version 1133331 (0.0008) [2023-12-28 03:22:56,477][106225] Updated weights for policy 1, policy_version 1133341 (0.0008) [2023-12-28 03:22:56,538][106225] Updated weights for policy 1, policy_version 1133351 (0.0009) [2023-12-28 03:22:56,567][106226] Updated weights for policy 0, policy_version 1130394 (0.0007) [2023-12-28 03:22:56,621][106226] Updated weights for policy 0, policy_version 1130404 (0.0006) [2023-12-28 03:22:56,686][106226] Updated weights for policy 0, policy_version 1130414 (0.0005) [2023-12-28 03:22:56,743][106226] Updated weights for policy 0, policy_version 1130424 (0.0005) [2023-12-28 03:22:57,244][106225] Updated weights for policy 1, policy_version 1133361 (0.0009) [2023-12-28 03:22:57,302][106225] Updated weights for policy 1, policy_version 1133371 (0.0006) [2023-12-28 03:22:57,354][106225] Updated weights for policy 1, policy_version 1133381 (0.0007) [2023-12-28 03:22:57,376][106226] Updated weights for policy 0, policy_version 1130434 (0.0010) [2023-12-28 03:22:57,411][106225] Updated weights for policy 1, policy_version 1133391 (0.0005) [2023-12-28 03:22:57,438][106226] Updated weights for policy 0, policy_version 1130444 (0.0010) [2023-12-28 03:22:57,504][106226] Updated weights for policy 0, policy_version 1130454 (0.0011) [2023-12-28 03:22:58,051][106225] Updated weights for policy 1, policy_version 1133401 (0.0010) [2023-12-28 03:22:58,081][106226] Updated weights for policy 0, policy_version 1130464 (0.0006) [2023-12-28 03:22:58,107][106225] Updated weights for policy 1, policy_version 1133411 (0.0010) [2023-12-28 03:22:58,140][106226] Updated weights for policy 0, policy_version 1130474 (0.0005) [2023-12-28 03:22:58,163][106225] Updated weights for policy 1, policy_version 1133421 (0.0010) [2023-12-28 03:22:58,194][106226] Updated weights for policy 0, policy_version 1130484 (0.0005) [2023-12-28 03:22:58,932][106226] Updated weights for policy 0, policy_version 1130494 (0.0008) [2023-12-28 03:22:58,987][106226] Updated weights for policy 0, policy_version 1130504 (0.0008) [2023-12-28 03:22:58,989][106225] Updated weights for policy 1, policy_version 1133431 (0.0008) [2023-12-28 03:22:59,037][106225] Updated weights for policy 1, policy_version 1133441 (0.0007) [2023-12-28 03:22:59,050][106226] Updated weights for policy 0, policy_version 1130514 (0.0006) [2023-12-28 03:22:59,100][106225] Updated weights for policy 1, policy_version 1133451 (0.0009) [2023-12-28 03:22:59,793][106226] Updated weights for policy 0, policy_version 1130524 (0.0009) [2023-12-28 03:22:59,856][106226] Updated weights for policy 0, policy_version 1130534 (0.0008) [2023-12-28 03:22:59,888][106225] Updated weights for policy 1, policy_version 1133461 (0.0009) [2023-12-28 03:22:59,923][106226] Updated weights for policy 0, policy_version 1130544 (0.0008) [2023-12-28 03:22:59,952][106225] Updated weights for policy 1, policy_version 1133471 (0.0009) [2023-12-28 03:23:00,011][106225] Updated weights for policy 1, policy_version 1133481 (0.0009) [2023-12-28 03:23:00,677][106226] Updated weights for policy 0, policy_version 1130554 (0.0008) [2023-12-28 03:23:00,721][106225] Updated weights for policy 1, policy_version 1133491 (0.0011) [2023-12-28 03:23:00,735][106226] Updated weights for policy 0, policy_version 1130564 (0.0006) [2023-12-28 03:23:00,776][106225] Updated weights for policy 1, policy_version 1133501 (0.0010) [2023-12-28 03:23:00,786][106226] Updated weights for policy 0, policy_version 1130574 (0.0005) [2023-12-28 03:23:00,833][106225] Updated weights for policy 1, policy_version 1133511 (0.0010) [2023-12-28 03:23:00,835][106226] Updated weights for policy 0, policy_version 1130584 (0.0005) [2023-12-28 03:23:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 579715072. Throughput: 0: 10098.7, 1: 9883.4. Samples: 579702968. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:23:01,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.744')] [2023-12-28 03:23:01,577][106225] Updated weights for policy 1, policy_version 1133521 (0.0010) [2023-12-28 03:23:01,588][106226] Updated weights for policy 0, policy_version 1130594 (0.0008) [2023-12-28 03:23:01,647][106225] Updated weights for policy 1, policy_version 1133531 (0.0008) [2023-12-28 03:23:01,647][106226] Updated weights for policy 0, policy_version 1130604 (0.0008) [2023-12-28 03:23:01,703][106225] Updated weights for policy 1, policy_version 1133541 (0.0007) [2023-12-28 03:23:01,707][106226] Updated weights for policy 0, policy_version 1130614 (0.0006) [2023-12-28 03:23:01,777][106225] Updated weights for policy 1, policy_version 1133551 (0.0007) [2023-12-28 03:23:02,442][106225] Updated weights for policy 1, policy_version 1133561 (0.0008) [2023-12-28 03:23:02,476][106226] Updated weights for policy 0, policy_version 1130624 (0.0008) [2023-12-28 03:23:02,490][106225] Updated weights for policy 1, policy_version 1133571 (0.0007) [2023-12-28 03:23:02,535][106226] Updated weights for policy 0, policy_version 1130634 (0.0007) [2023-12-28 03:23:02,552][106225] Updated weights for policy 1, policy_version 1133581 (0.0007) [2023-12-28 03:23:02,596][106226] Updated weights for policy 0, policy_version 1130644 (0.0007) [2023-12-28 03:23:03,138][106225] Updated weights for policy 1, policy_version 1133591 (0.0007) [2023-12-28 03:23:03,186][106225] Updated weights for policy 1, policy_version 1133601 (0.0009) [2023-12-28 03:23:03,236][106225] Updated weights for policy 1, policy_version 1133611 (0.0009) [2023-12-28 03:23:03,327][106226] Updated weights for policy 0, policy_version 1130654 (0.0006) [2023-12-28 03:23:03,372][106226] Updated weights for policy 0, policy_version 1130664 (0.0005) [2023-12-28 03:23:03,428][106226] Updated weights for policy 0, policy_version 1130674 (0.0005) [2023-12-28 03:23:04,022][106225] Updated weights for policy 1, policy_version 1133621 (0.0009) [2023-12-28 03:23:04,082][106225] Updated weights for policy 1, policy_version 1133631 (0.0007) [2023-12-28 03:23:04,096][106226] Updated weights for policy 0, policy_version 1130684 (0.0007) [2023-12-28 03:23:04,142][106225] Updated weights for policy 1, policy_version 1133641 (0.0006) [2023-12-28 03:23:04,148][106226] Updated weights for policy 0, policy_version 1130694 (0.0010) [2023-12-28 03:23:04,216][106226] Updated weights for policy 0, policy_version 1130704 (0.0008) [2023-12-28 03:23:04,802][106225] Updated weights for policy 1, policy_version 1133651 (0.0007) [2023-12-28 03:23:04,847][106225] Updated weights for policy 1, policy_version 1133661 (0.0009) [2023-12-28 03:23:04,901][106225] Updated weights for policy 1, policy_version 1133671 (0.0008) [2023-12-28 03:23:04,920][106226] Updated weights for policy 0, policy_version 1130714 (0.0008) [2023-12-28 03:23:04,981][106226] Updated weights for policy 0, policy_version 1130724 (0.0007) [2023-12-28 03:23:05,047][106226] Updated weights for policy 0, policy_version 1130734 (0.0008) [2023-12-28 03:23:05,116][106226] Updated weights for policy 0, policy_version 1130744 (0.0008) [2023-12-28 03:23:05,512][106225] Updated weights for policy 1, policy_version 1133681 (0.0007) [2023-12-28 03:23:05,571][106225] Updated weights for policy 1, policy_version 1133691 (0.0005) [2023-12-28 03:23:05,628][106225] Updated weights for policy 1, policy_version 1133701 (0.0007) [2023-12-28 03:23:05,679][106225] Updated weights for policy 1, policy_version 1133711 (0.0006) [2023-12-28 03:23:05,807][106226] Updated weights for policy 0, policy_version 1130754 (0.0009) [2023-12-28 03:23:05,855][106226] Updated weights for policy 0, policy_version 1130764 (0.0009) [2023-12-28 03:23:05,913][106226] Updated weights for policy 0, policy_version 1130774 (0.0010) [2023-12-28 03:23:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 579813376. Throughput: 0: 10082.7, 1: 9891.9. Samples: 579821340. Policy #0 lag: (min: 2.0, avg: 16.4, max: 34.0) [2023-12-28 03:23:06,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-4.946')] [2023-12-28 03:23:06,350][106225] Updated weights for policy 1, policy_version 1133721 (0.0008) [2023-12-28 03:23:06,409][106225] Updated weights for policy 1, policy_version 1133731 (0.0008) [2023-12-28 03:23:06,472][106225] Updated weights for policy 1, policy_version 1133741 (0.0008) [2023-12-28 03:23:06,727][106226] Updated weights for policy 0, policy_version 1130784 (0.0007) [2023-12-28 03:23:06,777][106226] Updated weights for policy 0, policy_version 1130794 (0.0005) [2023-12-28 03:23:06,829][106226] Updated weights for policy 0, policy_version 1130804 (0.0005) [2023-12-28 03:23:07,196][106225] Updated weights for policy 1, policy_version 1133751 (0.0007) [2023-12-28 03:23:07,247][106225] Updated weights for policy 1, policy_version 1133761 (0.0008) [2023-12-28 03:23:07,310][106225] Updated weights for policy 1, policy_version 1133771 (0.0008) [2023-12-28 03:23:07,504][106226] Updated weights for policy 0, policy_version 1130814 (0.0006) [2023-12-28 03:23:07,572][106226] Updated weights for policy 0, policy_version 1130824 (0.0006) [2023-12-28 03:23:07,626][106226] Updated weights for policy 0, policy_version 1130834 (0.0007) [2023-12-28 03:23:08,090][106225] Updated weights for policy 1, policy_version 1133781 (0.0009) [2023-12-28 03:23:08,147][106225] Updated weights for policy 1, policy_version 1133791 (0.0008) [2023-12-28 03:23:08,190][106226] Updated weights for policy 0, policy_version 1130844 (0.0005) [2023-12-28 03:23:08,202][106225] Updated weights for policy 1, policy_version 1133801 (0.0008) [2023-12-28 03:23:08,252][106226] Updated weights for policy 0, policy_version 1130854 (0.0005) [2023-12-28 03:23:08,304][106226] Updated weights for policy 0, policy_version 1130864 (0.0005) [2023-12-28 03:23:08,977][106225] Updated weights for policy 1, policy_version 1133811 (0.0008) [2023-12-28 03:23:08,979][106226] Updated weights for policy 0, policy_version 1130874 (0.0008) [2023-12-28 03:23:09,039][106225] Updated weights for policy 1, policy_version 1133821 (0.0005) [2023-12-28 03:23:09,040][106226] Updated weights for policy 0, policy_version 1130884 (0.0008) [2023-12-28 03:23:09,097][106225] Updated weights for policy 1, policy_version 1133831 (0.0005) [2023-12-28 03:23:09,097][106226] Updated weights for policy 0, policy_version 1130894 (0.0008) [2023-12-28 03:23:09,157][106226] Updated weights for policy 0, policy_version 1130904 (0.0007) [2023-12-28 03:23:09,846][106226] Updated weights for policy 0, policy_version 1130914 (0.0009) [2023-12-28 03:23:09,881][106225] Updated weights for policy 1, policy_version 1133841 (0.0006) [2023-12-28 03:23:09,913][106226] Updated weights for policy 0, policy_version 1130924 (0.0010) [2023-12-28 03:23:09,945][106225] Updated weights for policy 1, policy_version 1133851 (0.0011) [2023-12-28 03:23:09,969][106226] Updated weights for policy 0, policy_version 1130934 (0.0007) [2023-12-28 03:23:10,015][106225] Updated weights for policy 1, policy_version 1133861 (0.0011) [2023-12-28 03:23:10,081][106225] Updated weights for policy 1, policy_version 1133871 (0.0010) [2023-12-28 03:23:10,614][106226] Updated weights for policy 0, policy_version 1130944 (0.0007) [2023-12-28 03:23:10,668][106226] Updated weights for policy 0, policy_version 1130954 (0.0008) [2023-12-28 03:23:10,730][106226] Updated weights for policy 0, policy_version 1130964 (0.0008) [2023-12-28 03:23:10,813][106225] Updated weights for policy 1, policy_version 1133881 (0.0008) [2023-12-28 03:23:10,866][106225] Updated weights for policy 1, policy_version 1133891 (0.0008) [2023-12-28 03:23:10,925][106225] Updated weights for policy 1, policy_version 1133901 (0.0010) [2023-12-28 03:23:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 579911680. Throughput: 0: 10172.8, 1: 9869.2. Samples: 579880644. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:11,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-5.059')] [2023-12-28 03:23:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001133904_290324480.pth... [2023-12-28 03:23:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001130968_289587200.pth... [2023-12-28 03:23:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001132752_290029568.pth [2023-12-28 03:23:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001129784_289284096.pth [2023-12-28 03:23:11,452][106226] Updated weights for policy 0, policy_version 1130974 (0.0007) [2023-12-28 03:23:11,516][106226] Updated weights for policy 0, policy_version 1130984 (0.0006) [2023-12-28 03:23:11,565][106226] Updated weights for policy 0, policy_version 1130994 (0.0008) [2023-12-28 03:23:11,742][106225] Updated weights for policy 1, policy_version 1133911 (0.0009) [2023-12-28 03:23:11,809][106225] Updated weights for policy 1, policy_version 1133921 (0.0008) [2023-12-28 03:23:11,872][106225] Updated weights for policy 1, policy_version 1133931 (0.0007) [2023-12-28 03:23:12,312][106226] Updated weights for policy 0, policy_version 1131004 (0.0009) [2023-12-28 03:23:12,373][106226] Updated weights for policy 0, policy_version 1131014 (0.0010) [2023-12-28 03:23:12,424][106226] Updated weights for policy 0, policy_version 1131024 (0.0009) [2023-12-28 03:23:12,631][106225] Updated weights for policy 1, policy_version 1133941 (0.0008) [2023-12-28 03:23:12,691][106225] Updated weights for policy 1, policy_version 1133951 (0.0009) [2023-12-28 03:23:12,754][106225] Updated weights for policy 1, policy_version 1133961 (0.0008) [2023-12-28 03:23:13,117][106226] Updated weights for policy 0, policy_version 1131034 (0.0010) [2023-12-28 03:23:13,181][106226] Updated weights for policy 0, policy_version 1131044 (0.0008) [2023-12-28 03:23:13,249][106226] Updated weights for policy 0, policy_version 1131054 (0.0005) [2023-12-28 03:23:13,310][106226] Updated weights for policy 0, policy_version 1131064 (0.0005) [2023-12-28 03:23:13,448][106225] Updated weights for policy 1, policy_version 1133971 (0.0008) [2023-12-28 03:23:13,496][106225] Updated weights for policy 1, policy_version 1133981 (0.0007) [2023-12-28 03:23:13,546][106225] Updated weights for policy 1, policy_version 1133991 (0.0005) [2023-12-28 03:23:13,952][106226] Updated weights for policy 0, policy_version 1131074 (0.0011) [2023-12-28 03:23:14,012][106226] Updated weights for policy 0, policy_version 1131084 (0.0011) [2023-12-28 03:23:14,069][106226] Updated weights for policy 0, policy_version 1131094 (0.0010) [2023-12-28 03:23:14,200][106225] Updated weights for policy 1, policy_version 1134001 (0.0005) [2023-12-28 03:23:14,264][106225] Updated weights for policy 1, policy_version 1134011 (0.0005) [2023-12-28 03:23:14,328][106225] Updated weights for policy 1, policy_version 1134021 (0.0006) [2023-12-28 03:23:14,390][106225] Updated weights for policy 1, policy_version 1134031 (0.0008) [2023-12-28 03:23:14,738][106226] Updated weights for policy 0, policy_version 1131104 (0.0009) [2023-12-28 03:23:14,803][106226] Updated weights for policy 0, policy_version 1131114 (0.0007) [2023-12-28 03:23:14,867][106226] Updated weights for policy 0, policy_version 1131124 (0.0007) [2023-12-28 03:23:15,051][106225] Updated weights for policy 1, policy_version 1134041 (0.0007) [2023-12-28 03:23:15,109][106225] Updated weights for policy 1, policy_version 1134051 (0.0006) [2023-12-28 03:23:15,163][106225] Updated weights for policy 1, policy_version 1134061 (0.0008) [2023-12-28 03:23:15,580][106226] Updated weights for policy 0, policy_version 1131134 (0.0008) [2023-12-28 03:23:15,644][106226] Updated weights for policy 0, policy_version 1131144 (0.0005) [2023-12-28 03:23:15,708][106226] Updated weights for policy 0, policy_version 1131154 (0.0005) [2023-12-28 03:23:15,873][106225] Updated weights for policy 1, policy_version 1134071 (0.0009) [2023-12-28 03:23:15,925][106225] Updated weights for policy 1, policy_version 1134081 (0.0008) [2023-12-28 03:23:15,971][106225] Updated weights for policy 1, policy_version 1134091 (0.0007) [2023-12-28 03:23:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 580009984. Throughput: 0: 10100.9, 1: 9744.1. Samples: 579997436. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:16,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-5.029')] [2023-12-28 03:23:16,305][106226] Updated weights for policy 0, policy_version 1131164 (0.0008) [2023-12-28 03:23:16,360][106226] Updated weights for policy 0, policy_version 1131174 (0.0009) [2023-12-28 03:23:16,406][106226] Updated weights for policy 0, policy_version 1131184 (0.0008) [2023-12-28 03:23:16,650][106225] Updated weights for policy 1, policy_version 1134101 (0.0007) [2023-12-28 03:23:16,701][106225] Updated weights for policy 1, policy_version 1134111 (0.0008) [2023-12-28 03:23:16,754][106225] Updated weights for policy 1, policy_version 1134121 (0.0007) [2023-12-28 03:23:17,172][106226] Updated weights for policy 0, policy_version 1131194 (0.0008) [2023-12-28 03:23:17,233][106226] Updated weights for policy 0, policy_version 1131204 (0.0006) [2023-12-28 03:23:17,283][106226] Updated weights for policy 0, policy_version 1131214 (0.0006) [2023-12-28 03:23:17,341][106226] Updated weights for policy 0, policy_version 1131224 (0.0005) [2023-12-28 03:23:17,484][106225] Updated weights for policy 1, policy_version 1134131 (0.0008) [2023-12-28 03:23:17,543][106225] Updated weights for policy 1, policy_version 1134141 (0.0008) [2023-12-28 03:23:17,599][106225] Updated weights for policy 1, policy_version 1134151 (0.0007) [2023-12-28 03:23:17,983][106226] Updated weights for policy 0, policy_version 1131234 (0.0011) [2023-12-28 03:23:18,045][106226] Updated weights for policy 0, policy_version 1131244 (0.0006) [2023-12-28 03:23:18,109][106226] Updated weights for policy 0, policy_version 1131254 (0.0005) [2023-12-28 03:23:18,266][106225] Updated weights for policy 1, policy_version 1134161 (0.0006) [2023-12-28 03:23:18,314][106225] Updated weights for policy 1, policy_version 1134171 (0.0008) [2023-12-28 03:23:18,385][106225] Updated weights for policy 1, policy_version 1134181 (0.0008) [2023-12-28 03:23:18,446][106225] Updated weights for policy 1, policy_version 1134191 (0.0008) [2023-12-28 03:23:18,682][106226] Updated weights for policy 0, policy_version 1131264 (0.0006) [2023-12-28 03:23:18,745][106226] Updated weights for policy 0, policy_version 1131274 (0.0009) [2023-12-28 03:23:18,798][106226] Updated weights for policy 0, policy_version 1131284 (0.0009) [2023-12-28 03:23:19,198][106225] Updated weights for policy 1, policy_version 1134201 (0.0005) [2023-12-28 03:23:19,269][106225] Updated weights for policy 1, policy_version 1134211 (0.0008) [2023-12-28 03:23:19,330][106225] Updated weights for policy 1, policy_version 1134221 (0.0009) [2023-12-28 03:23:19,520][106226] Updated weights for policy 0, policy_version 1131294 (0.0008) [2023-12-28 03:23:19,579][106226] Updated weights for policy 0, policy_version 1131304 (0.0009) [2023-12-28 03:23:19,642][106226] Updated weights for policy 0, policy_version 1131314 (0.0009) [2023-12-28 03:23:20,033][106225] Updated weights for policy 1, policy_version 1134231 (0.0009) [2023-12-28 03:23:20,084][106225] Updated weights for policy 1, policy_version 1134241 (0.0008) [2023-12-28 03:23:20,141][106225] Updated weights for policy 1, policy_version 1134251 (0.0008) [2023-12-28 03:23:20,376][106226] Updated weights for policy 0, policy_version 1131324 (0.0009) [2023-12-28 03:23:20,430][106226] Updated weights for policy 0, policy_version 1131334 (0.0007) [2023-12-28 03:23:20,488][106226] Updated weights for policy 0, policy_version 1131344 (0.0010) [2023-12-28 03:23:20,984][106225] Updated weights for policy 1, policy_version 1134261 (0.0010) [2023-12-28 03:23:21,051][106225] Updated weights for policy 1, policy_version 1134271 (0.0009) [2023-12-28 03:23:21,113][106225] Updated weights for policy 1, policy_version 1134281 (0.0008) [2023-12-28 03:23:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 580108288. Throughput: 0: 10150.9, 1: 9702.6. Samples: 580116240. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:21,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.883')] [2023-12-28 03:23:21,222][106226] Updated weights for policy 0, policy_version 1131354 (0.0010) [2023-12-28 03:23:21,285][106226] Updated weights for policy 0, policy_version 1131364 (0.0007) [2023-12-28 03:23:21,371][106226] Updated weights for policy 0, policy_version 1131374 (0.0009) [2023-12-28 03:23:21,438][106226] Updated weights for policy 0, policy_version 1131384 (0.0009) [2023-12-28 03:23:21,876][106225] Updated weights for policy 1, policy_version 1134291 (0.0008) [2023-12-28 03:23:21,934][106225] Updated weights for policy 1, policy_version 1134301 (0.0009) [2023-12-28 03:23:21,996][106225] Updated weights for policy 1, policy_version 1134311 (0.0009) [2023-12-28 03:23:22,107][106226] Updated weights for policy 0, policy_version 1131394 (0.0009) [2023-12-28 03:23:22,158][106226] Updated weights for policy 0, policy_version 1131404 (0.0008) [2023-12-28 03:23:22,216][106226] Updated weights for policy 0, policy_version 1131414 (0.0007) [2023-12-28 03:23:22,766][106225] Updated weights for policy 1, policy_version 1134321 (0.0008) [2023-12-28 03:23:22,822][106225] Updated weights for policy 1, policy_version 1134331 (0.0010) [2023-12-28 03:23:22,876][106225] Updated weights for policy 1, policy_version 1134341 (0.0006) [2023-12-28 03:23:22,919][106226] Updated weights for policy 0, policy_version 1131424 (0.0006) [2023-12-28 03:23:22,939][106225] Updated weights for policy 1, policy_version 1134351 (0.0006) [2023-12-28 03:23:22,985][106226] Updated weights for policy 0, policy_version 1131434 (0.0007) [2023-12-28 03:23:23,038][106226] Updated weights for policy 0, policy_version 1131444 (0.0008) [2023-12-28 03:23:23,574][106225] Updated weights for policy 1, policy_version 1134361 (0.0005) [2023-12-28 03:23:23,624][106225] Updated weights for policy 1, policy_version 1134371 (0.0005) [2023-12-28 03:23:23,680][106225] Updated weights for policy 1, policy_version 1134381 (0.0005) [2023-12-28 03:23:23,707][106226] Updated weights for policy 0, policy_version 1131454 (0.0008) [2023-12-28 03:23:23,759][106226] Updated weights for policy 0, policy_version 1131464 (0.0007) [2023-12-28 03:23:23,804][106226] Updated weights for policy 0, policy_version 1131474 (0.0006) [2023-12-28 03:23:24,319][106225] Updated weights for policy 1, policy_version 1134391 (0.0009) [2023-12-28 03:23:24,372][106225] Updated weights for policy 1, policy_version 1134401 (0.0010) [2023-12-28 03:23:24,391][106226] Updated weights for policy 0, policy_version 1131484 (0.0007) [2023-12-28 03:23:24,433][106225] Updated weights for policy 1, policy_version 1134411 (0.0010) [2023-12-28 03:23:24,447][106226] Updated weights for policy 0, policy_version 1131494 (0.0006) [2023-12-28 03:23:24,507][106226] Updated weights for policy 0, policy_version 1131504 (0.0005) [2023-12-28 03:23:24,981][106225] Updated weights for policy 1, policy_version 1134421 (0.0008) [2023-12-28 03:23:25,038][106225] Updated weights for policy 1, policy_version 1134431 (0.0010) [2023-12-28 03:23:25,091][106225] Updated weights for policy 1, policy_version 1134441 (0.0010) [2023-12-28 03:23:25,246][106226] Updated weights for policy 0, policy_version 1131514 (0.0007) [2023-12-28 03:23:25,304][106226] Updated weights for policy 0, policy_version 1131524 (0.0009) [2023-12-28 03:23:25,354][106226] Updated weights for policy 0, policy_version 1131534 (0.0009) [2023-12-28 03:23:25,404][106226] Updated weights for policy 0, policy_version 1131544 (0.0009) [2023-12-28 03:23:25,705][106225] Updated weights for policy 1, policy_version 1134451 (0.0010) [2023-12-28 03:23:25,765][106225] Updated weights for policy 1, policy_version 1134461 (0.0010) [2023-12-28 03:23:25,831][106225] Updated weights for policy 1, policy_version 1134471 (0.0010) [2023-12-28 03:23:26,165][106226] Updated weights for policy 0, policy_version 1131554 (0.0011) [2023-12-28 03:23:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 580206592. Throughput: 0: 10125.2, 1: 9664.8. Samples: 580175364. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:26,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.119')] [2023-12-28 03:23:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001134480_290471936.pth... [2023-12-28 03:23:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001133328_290177024.pth [2023-12-28 03:23:26,229][106226] Updated weights for policy 0, policy_version 1131564 (0.0011) [2023-12-28 03:23:26,284][106226] Updated weights for policy 0, policy_version 1131574 (0.0008) [2023-12-28 03:23:26,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001131576_289742848.pth... [2023-12-28 03:23:26,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001130392_289439744.pth [2023-12-28 03:23:26,513][106225] Updated weights for policy 1, policy_version 1134481 (0.0010) [2023-12-28 03:23:26,574][106225] Updated weights for policy 1, policy_version 1134491 (0.0006) [2023-12-28 03:23:26,636][106225] Updated weights for policy 1, policy_version 1134501 (0.0010) [2023-12-28 03:23:26,698][106225] Updated weights for policy 1, policy_version 1134511 (0.0009) [2023-12-28 03:23:26,985][106226] Updated weights for policy 0, policy_version 1131584 (0.0009) [2023-12-28 03:23:27,045][106226] Updated weights for policy 0, policy_version 1131594 (0.0009) [2023-12-28 03:23:27,096][106226] Updated weights for policy 0, policy_version 1131604 (0.0009) [2023-12-28 03:23:27,276][106225] Updated weights for policy 1, policy_version 1134521 (0.0010) [2023-12-28 03:23:27,337][106225] Updated weights for policy 1, policy_version 1134531 (0.0008) [2023-12-28 03:23:27,408][106225] Updated weights for policy 1, policy_version 1134541 (0.0005) [2023-12-28 03:23:27,723][106226] Updated weights for policy 0, policy_version 1131614 (0.0008) [2023-12-28 03:23:27,781][106226] Updated weights for policy 0, policy_version 1131624 (0.0009) [2023-12-28 03:23:27,840][106226] Updated weights for policy 0, policy_version 1131634 (0.0008) [2023-12-28 03:23:27,996][106225] Updated weights for policy 1, policy_version 1134551 (0.0006) [2023-12-28 03:23:28,063][106225] Updated weights for policy 1, policy_version 1134561 (0.0009) [2023-12-28 03:23:28,115][106225] Updated weights for policy 1, policy_version 1134571 (0.0008) [2023-12-28 03:23:28,518][106226] Updated weights for policy 0, policy_version 1131644 (0.0009) [2023-12-28 03:23:28,582][106226] Updated weights for policy 0, policy_version 1131654 (0.0009) [2023-12-28 03:23:28,653][106226] Updated weights for policy 0, policy_version 1131664 (0.0009) [2023-12-28 03:23:28,764][106225] Updated weights for policy 1, policy_version 1134581 (0.0009) [2023-12-28 03:23:28,825][106225] Updated weights for policy 1, policy_version 1134591 (0.0010) [2023-12-28 03:23:28,886][106225] Updated weights for policy 1, policy_version 1134601 (0.0007) [2023-12-28 03:23:29,365][106226] Updated weights for policy 0, policy_version 1131674 (0.0009) [2023-12-28 03:23:29,424][106226] Updated weights for policy 0, policy_version 1131684 (0.0009) [2023-12-28 03:23:29,474][106226] Updated weights for policy 0, policy_version 1131694 (0.0008) [2023-12-28 03:23:29,491][106225] Updated weights for policy 1, policy_version 1134611 (0.0007) [2023-12-28 03:23:29,536][106226] Updated weights for policy 0, policy_version 1131704 (0.0006) [2023-12-28 03:23:29,551][106225] Updated weights for policy 1, policy_version 1134621 (0.0008) [2023-12-28 03:23:29,612][106225] Updated weights for policy 1, policy_version 1134631 (0.0005) [2023-12-28 03:23:30,228][106225] Updated weights for policy 1, policy_version 1134641 (0.0005) [2023-12-28 03:23:30,290][106225] Updated weights for policy 1, policy_version 1134651 (0.0005) [2023-12-28 03:23:30,349][106225] Updated weights for policy 1, policy_version 1134661 (0.0007) [2023-12-28 03:23:30,383][106226] Updated weights for policy 0, policy_version 1131714 (0.0006) [2023-12-28 03:23:30,411][106225] Updated weights for policy 1, policy_version 1134671 (0.0008) [2023-12-28 03:23:30,447][106226] Updated weights for policy 0, policy_version 1131724 (0.0009) [2023-12-28 03:23:30,518][106226] Updated weights for policy 0, policy_version 1131734 (0.0008) [2023-12-28 03:23:30,958][106225] Updated weights for policy 1, policy_version 1134681 (0.0008) [2023-12-28 03:23:31,010][106225] Updated weights for policy 1, policy_version 1134691 (0.0006) [2023-12-28 03:23:31,074][106225] Updated weights for policy 1, policy_version 1134701 (0.0009) [2023-12-28 03:23:31,117][106226] Updated weights for policy 0, policy_version 1131744 (0.0007) [2023-12-28 03:23:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 580313088. Throughput: 0: 10064.6, 1: 9908.3. Samples: 580300320. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:31,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-5.169')] [2023-12-28 03:23:31,182][106226] Updated weights for policy 0, policy_version 1131754 (0.0007) [2023-12-28 03:23:31,238][106226] Updated weights for policy 0, policy_version 1131764 (0.0008) [2023-12-28 03:23:31,804][106225] Updated weights for policy 1, policy_version 1134711 (0.0009) [2023-12-28 03:23:31,855][106225] Updated weights for policy 1, policy_version 1134721 (0.0009) [2023-12-28 03:23:31,905][106225] Updated weights for policy 1, policy_version 1134731 (0.0009) [2023-12-28 03:23:31,962][106226] Updated weights for policy 0, policy_version 1131774 (0.0009) [2023-12-28 03:23:32,017][106226] Updated weights for policy 0, policy_version 1131784 (0.0008) [2023-12-28 03:23:32,074][106226] Updated weights for policy 0, policy_version 1131794 (0.0009) [2023-12-28 03:23:32,692][106225] Updated weights for policy 1, policy_version 1134741 (0.0008) [2023-12-28 03:23:32,752][106225] Updated weights for policy 1, policy_version 1134751 (0.0008) [2023-12-28 03:23:32,761][106226] Updated weights for policy 0, policy_version 1131804 (0.0008) [2023-12-28 03:23:32,809][106225] Updated weights for policy 1, policy_version 1134761 (0.0008) [2023-12-28 03:23:32,816][106226] Updated weights for policy 0, policy_version 1131814 (0.0005) [2023-12-28 03:23:32,875][106226] Updated weights for policy 0, policy_version 1131824 (0.0008) [2023-12-28 03:23:33,539][106225] Updated weights for policy 1, policy_version 1134771 (0.0008) [2023-12-28 03:23:33,572][106226] Updated weights for policy 0, policy_version 1131834 (0.0008) [2023-12-28 03:23:33,591][106225] Updated weights for policy 1, policy_version 1134781 (0.0006) [2023-12-28 03:23:33,627][106226] Updated weights for policy 0, policy_version 1131844 (0.0007) [2023-12-28 03:23:33,644][106225] Updated weights for policy 1, policy_version 1134791 (0.0006) [2023-12-28 03:23:33,678][106226] Updated weights for policy 0, policy_version 1131854 (0.0006) [2023-12-28 03:23:33,729][106226] Updated weights for policy 0, policy_version 1131864 (0.0007) [2023-12-28 03:23:34,262][106225] Updated weights for policy 1, policy_version 1134801 (0.0007) [2023-12-28 03:23:34,331][106225] Updated weights for policy 1, policy_version 1134811 (0.0008) [2023-12-28 03:23:34,400][106225] Updated weights for policy 1, policy_version 1134821 (0.0008) [2023-12-28 03:23:34,472][106225] Updated weights for policy 1, policy_version 1134831 (0.0007) [2023-12-28 03:23:34,548][106226] Updated weights for policy 0, policy_version 1131874 (0.0007) [2023-12-28 03:23:34,615][106226] Updated weights for policy 0, policy_version 1131884 (0.0008) [2023-12-28 03:23:34,687][106226] Updated weights for policy 0, policy_version 1131894 (0.0008) [2023-12-28 03:23:35,158][106225] Updated weights for policy 1, policy_version 1134841 (0.0009) [2023-12-28 03:23:35,208][106225] Updated weights for policy 1, policy_version 1134851 (0.0008) [2023-12-28 03:23:35,263][106225] Updated weights for policy 1, policy_version 1134861 (0.0008) [2023-12-28 03:23:35,368][106226] Updated weights for policy 0, policy_version 1131904 (0.0006) [2023-12-28 03:23:35,433][106226] Updated weights for policy 0, policy_version 1131914 (0.0005) [2023-12-28 03:23:35,502][106226] Updated weights for policy 0, policy_version 1131924 (0.0005) [2023-12-28 03:23:36,000][106225] Updated weights for policy 1, policy_version 1134871 (0.0009) [2023-12-28 03:23:36,048][106225] Updated weights for policy 1, policy_version 1134881 (0.0010) [2023-12-28 03:23:36,079][106226] Updated weights for policy 0, policy_version 1131934 (0.0005) [2023-12-28 03:23:36,102][106225] Updated weights for policy 1, policy_version 1134891 (0.0010) [2023-12-28 03:23:36,147][106226] Updated weights for policy 0, policy_version 1131944 (0.0008) [2023-12-28 03:23:36,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 580411392. Throughput: 0: 9970.9, 1: 9891.9. Samples: 580420812. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:36,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.667')] [2023-12-28 03:23:36,210][106226] Updated weights for policy 0, policy_version 1131954 (0.0008) [2023-12-28 03:23:36,848][106225] Updated weights for policy 1, policy_version 1134901 (0.0011) [2023-12-28 03:23:36,850][106226] Updated weights for policy 0, policy_version 1131964 (0.0009) [2023-12-28 03:23:36,904][106225] Updated weights for policy 1, policy_version 1134911 (0.0010) [2023-12-28 03:23:36,912][106226] Updated weights for policy 0, policy_version 1131974 (0.0009) [2023-12-28 03:23:36,964][106225] Updated weights for policy 1, policy_version 1134921 (0.0010) [2023-12-28 03:23:36,970][106226] Updated weights for policy 0, policy_version 1131984 (0.0008) [2023-12-28 03:23:37,575][106226] Updated weights for policy 0, policy_version 1131994 (0.0010) [2023-12-28 03:23:37,632][106226] Updated weights for policy 0, policy_version 1132004 (0.0008) [2023-12-28 03:23:37,688][106226] Updated weights for policy 0, policy_version 1132014 (0.0007) [2023-12-28 03:23:37,697][106225] Updated weights for policy 1, policy_version 1134931 (0.0011) [2023-12-28 03:23:37,744][106226] Updated weights for policy 0, policy_version 1132024 (0.0006) [2023-12-28 03:23:37,747][106225] Updated weights for policy 1, policy_version 1134941 (0.0010) [2023-12-28 03:23:37,799][106225] Updated weights for policy 1, policy_version 1134951 (0.0010) [2023-12-28 03:23:38,460][106226] Updated weights for policy 0, policy_version 1132034 (0.0007) [2023-12-28 03:23:38,516][106226] Updated weights for policy 0, policy_version 1132044 (0.0008) [2023-12-28 03:23:38,544][106225] Updated weights for policy 1, policy_version 1134961 (0.0010) [2023-12-28 03:23:38,578][106226] Updated weights for policy 0, policy_version 1132054 (0.0008) [2023-12-28 03:23:38,601][106225] Updated weights for policy 1, policy_version 1134971 (0.0007) [2023-12-28 03:23:38,661][106225] Updated weights for policy 1, policy_version 1134981 (0.0008) [2023-12-28 03:23:38,718][106225] Updated weights for policy 1, policy_version 1134991 (0.0008) [2023-12-28 03:23:39,268][106226] Updated weights for policy 0, policy_version 1132064 (0.0008) [2023-12-28 03:23:39,322][106226] Updated weights for policy 0, policy_version 1132074 (0.0009) [2023-12-28 03:23:39,394][106226] Updated weights for policy 0, policy_version 1132084 (0.0008) [2023-12-28 03:23:39,506][106225] Updated weights for policy 1, policy_version 1135001 (0.0009) [2023-12-28 03:23:39,565][106225] Updated weights for policy 1, policy_version 1135011 (0.0008) [2023-12-28 03:23:39,628][106225] Updated weights for policy 1, policy_version 1135021 (0.0009) [2023-12-28 03:23:40,133][106226] Updated weights for policy 0, policy_version 1132094 (0.0008) [2023-12-28 03:23:40,191][106226] Updated weights for policy 0, policy_version 1132104 (0.0008) [2023-12-28 03:23:40,253][106226] Updated weights for policy 0, policy_version 1132114 (0.0009) [2023-12-28 03:23:40,376][106225] Updated weights for policy 1, policy_version 1135031 (0.0009) [2023-12-28 03:23:40,435][106225] Updated weights for policy 1, policy_version 1135041 (0.0010) [2023-12-28 03:23:40,500][106225] Updated weights for policy 1, policy_version 1135051 (0.0010) [2023-12-28 03:23:40,912][106226] Updated weights for policy 0, policy_version 1132124 (0.0007) [2023-12-28 03:23:40,971][106226] Updated weights for policy 0, policy_version 1132134 (0.0007) [2023-12-28 03:23:41,030][106226] Updated weights for policy 0, policy_version 1132144 (0.0009) [2023-12-28 03:23:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 580509696. Throughput: 0: 9981.7, 1: 9881.1. Samples: 580480236. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:41,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.603')] [2023-12-28 03:23:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001135056_290619392.pth... [2023-12-28 03:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001132152_289890304.pth... [2023-12-28 03:23:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001133904_290324480.pth [2023-12-28 03:23:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001130968_289587200.pth [2023-12-28 03:23:41,253][106225] Updated weights for policy 1, policy_version 1135061 (0.0009) [2023-12-28 03:23:41,330][106225] Updated weights for policy 1, policy_version 1135071 (0.0014) [2023-12-28 03:23:41,400][106225] Updated weights for policy 1, policy_version 1135081 (0.0007) [2023-12-28 03:23:41,859][106226] Updated weights for policy 0, policy_version 1132154 (0.0009) [2023-12-28 03:23:41,927][106226] Updated weights for policy 0, policy_version 1132164 (0.0011) [2023-12-28 03:23:41,991][106226] Updated weights for policy 0, policy_version 1132174 (0.0010) [2023-12-28 03:23:42,049][106226] Updated weights for policy 0, policy_version 1132184 (0.0011) [2023-12-28 03:23:42,109][106225] Updated weights for policy 1, policy_version 1135091 (0.0009) [2023-12-28 03:23:42,171][106225] Updated weights for policy 1, policy_version 1135101 (0.0007) [2023-12-28 03:23:42,240][106225] Updated weights for policy 1, policy_version 1135111 (0.0008) [2023-12-28 03:23:42,788][106226] Updated weights for policy 0, policy_version 1132194 (0.0010) [2023-12-28 03:23:42,848][106226] Updated weights for policy 0, policy_version 1132204 (0.0010) [2023-12-28 03:23:42,901][106226] Updated weights for policy 0, policy_version 1132214 (0.0010) [2023-12-28 03:23:42,992][106225] Updated weights for policy 1, policy_version 1135121 (0.0008) [2023-12-28 03:23:43,052][106225] Updated weights for policy 1, policy_version 1135131 (0.0010) [2023-12-28 03:23:43,109][106225] Updated weights for policy 1, policy_version 1135141 (0.0010) [2023-12-28 03:23:43,158][106225] Updated weights for policy 1, policy_version 1135151 (0.0009) [2023-12-28 03:23:43,601][106226] Updated weights for policy 0, policy_version 1132224 (0.0010) [2023-12-28 03:23:43,647][106226] Updated weights for policy 0, policy_version 1132234 (0.0010) [2023-12-28 03:23:43,699][106226] Updated weights for policy 0, policy_version 1132244 (0.0010) [2023-12-28 03:23:43,869][106225] Updated weights for policy 1, policy_version 1135161 (0.0009) [2023-12-28 03:23:43,923][106225] Updated weights for policy 1, policy_version 1135171 (0.0007) [2023-12-28 03:23:43,976][106225] Updated weights for policy 1, policy_version 1135181 (0.0007) [2023-12-28 03:23:44,407][106226] Updated weights for policy 0, policy_version 1132254 (0.0011) [2023-12-28 03:23:44,460][106226] Updated weights for policy 0, policy_version 1132264 (0.0010) [2023-12-28 03:23:44,526][106226] Updated weights for policy 0, policy_version 1132274 (0.0010) [2023-12-28 03:23:44,558][106225] Updated weights for policy 1, policy_version 1135191 (0.0008) [2023-12-28 03:23:44,628][106225] Updated weights for policy 1, policy_version 1135201 (0.0008) [2023-12-28 03:23:44,685][106225] Updated weights for policy 1, policy_version 1135211 (0.0008) [2023-12-28 03:23:45,232][106226] Updated weights for policy 0, policy_version 1132284 (0.0009) [2023-12-28 03:23:45,291][106226] Updated weights for policy 0, policy_version 1132294 (0.0010) [2023-12-28 03:23:45,352][106226] Updated weights for policy 0, policy_version 1132304 (0.0011) [2023-12-28 03:23:45,447][106225] Updated weights for policy 1, policy_version 1135221 (0.0007) [2023-12-28 03:23:45,503][106225] Updated weights for policy 1, policy_version 1135231 (0.0005) [2023-12-28 03:23:45,559][106225] Updated weights for policy 1, policy_version 1135241 (0.0008) [2023-12-28 03:23:46,032][106226] Updated weights for policy 0, policy_version 1132314 (0.0008) [2023-12-28 03:23:46,085][106226] Updated weights for policy 0, policy_version 1132324 (0.0010) [2023-12-28 03:23:46,138][106226] Updated weights for policy 0, policy_version 1132334 (0.0010) [2023-12-28 03:23:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 580599808. Throughput: 0: 9932.1, 1: 9891.2. Samples: 580595016. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:46,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.843')] [2023-12-28 03:23:46,197][106226] Updated weights for policy 0, policy_version 1132344 (0.0010) [2023-12-28 03:23:46,251][106225] Updated weights for policy 1, policy_version 1135251 (0.0007) [2023-12-28 03:23:46,300][106225] Updated weights for policy 1, policy_version 1135261 (0.0008) [2023-12-28 03:23:46,354][106225] Updated weights for policy 1, policy_version 1135271 (0.0007) [2023-12-28 03:23:46,918][106226] Updated weights for policy 0, policy_version 1132354 (0.0010) [2023-12-28 03:23:46,977][106226] Updated weights for policy 0, policy_version 1132364 (0.0010) [2023-12-28 03:23:47,027][106226] Updated weights for policy 0, policy_version 1132374 (0.0010) [2023-12-28 03:23:47,053][106225] Updated weights for policy 1, policy_version 1135281 (0.0007) [2023-12-28 03:23:47,103][106225] Updated weights for policy 1, policy_version 1135291 (0.0008) [2023-12-28 03:23:47,149][106225] Updated weights for policy 1, policy_version 1135301 (0.0007) [2023-12-28 03:23:47,207][106225] Updated weights for policy 1, policy_version 1135311 (0.0008) [2023-12-28 03:23:47,747][106226] Updated weights for policy 0, policy_version 1132384 (0.0011) [2023-12-28 03:23:47,811][106226] Updated weights for policy 0, policy_version 1132394 (0.0011) [2023-12-28 03:23:47,870][106226] Updated weights for policy 0, policy_version 1132404 (0.0010) [2023-12-28 03:23:47,977][106225] Updated weights for policy 1, policy_version 1135321 (0.0008) [2023-12-28 03:23:48,045][106225] Updated weights for policy 1, policy_version 1135331 (0.0008) [2023-12-28 03:23:48,109][106225] Updated weights for policy 1, policy_version 1135341 (0.0006) [2023-12-28 03:23:48,513][106226] Updated weights for policy 0, policy_version 1132414 (0.0008) [2023-12-28 03:23:48,568][106226] Updated weights for policy 0, policy_version 1132424 (0.0005) [2023-12-28 03:23:48,627][106226] Updated weights for policy 0, policy_version 1132434 (0.0007) [2023-12-28 03:23:48,919][106225] Updated weights for policy 1, policy_version 1135351 (0.0009) [2023-12-28 03:23:48,969][106225] Updated weights for policy 1, policy_version 1135361 (0.0009) [2023-12-28 03:23:49,017][106225] Updated weights for policy 1, policy_version 1135371 (0.0008) [2023-12-28 03:23:49,242][106226] Updated weights for policy 0, policy_version 1132444 (0.0008) [2023-12-28 03:23:49,309][106226] Updated weights for policy 0, policy_version 1132454 (0.0006) [2023-12-28 03:23:49,375][106226] Updated weights for policy 0, policy_version 1132464 (0.0009) [2023-12-28 03:23:49,775][106225] Updated weights for policy 1, policy_version 1135381 (0.0008) [2023-12-28 03:23:49,837][106225] Updated weights for policy 1, policy_version 1135391 (0.0008) [2023-12-28 03:23:49,899][106225] Updated weights for policy 1, policy_version 1135401 (0.0008) [2023-12-28 03:23:50,091][106226] Updated weights for policy 0, policy_version 1132474 (0.0007) [2023-12-28 03:23:50,145][106226] Updated weights for policy 0, policy_version 1132484 (0.0011) [2023-12-28 03:23:50,209][106226] Updated weights for policy 0, policy_version 1132494 (0.0011) [2023-12-28 03:23:50,277][106226] Updated weights for policy 0, policy_version 1132504 (0.0011) [2023-12-28 03:23:50,652][106225] Updated weights for policy 1, policy_version 1135411 (0.0008) [2023-12-28 03:23:50,705][106225] Updated weights for policy 1, policy_version 1135421 (0.0007) [2023-12-28 03:23:50,757][106225] Updated weights for policy 1, policy_version 1135431 (0.0007) [2023-12-28 03:23:50,994][106226] Updated weights for policy 0, policy_version 1132514 (0.0011) [2023-12-28 03:23:51,067][106226] Updated weights for policy 0, policy_version 1132524 (0.0011) [2023-12-28 03:23:51,130][106226] Updated weights for policy 0, policy_version 1132534 (0.0010) [2023-12-28 03:23:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 580706304. Throughput: 0: 9976.9, 1: 9794.5. Samples: 580711052. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:51,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.725')] [2023-12-28 03:23:51,545][106225] Updated weights for policy 1, policy_version 1135441 (0.0008) [2023-12-28 03:23:51,597][106225] Updated weights for policy 1, policy_version 1135451 (0.0007) [2023-12-28 03:23:51,666][106225] Updated weights for policy 1, policy_version 1135461 (0.0008) [2023-12-28 03:23:51,734][106225] Updated weights for policy 1, policy_version 1135471 (0.0008) [2023-12-28 03:23:51,869][106226] Updated weights for policy 0, policy_version 1132544 (0.0009) [2023-12-28 03:23:51,926][106226] Updated weights for policy 0, policy_version 1132554 (0.0009) [2023-12-28 03:23:51,981][106226] Updated weights for policy 0, policy_version 1132564 (0.0009) [2023-12-28 03:23:52,435][106225] Updated weights for policy 1, policy_version 1135481 (0.0008) [2023-12-28 03:23:52,493][106225] Updated weights for policy 1, policy_version 1135491 (0.0009) [2023-12-28 03:23:52,551][106225] Updated weights for policy 1, policy_version 1135501 (0.0008) [2023-12-28 03:23:52,736][106226] Updated weights for policy 0, policy_version 1132574 (0.0009) [2023-12-28 03:23:52,796][106226] Updated weights for policy 0, policy_version 1132584 (0.0009) [2023-12-28 03:23:52,853][106226] Updated weights for policy 0, policy_version 1132594 (0.0009) [2023-12-28 03:23:53,163][106225] Updated weights for policy 1, policy_version 1135511 (0.0009) [2023-12-28 03:23:53,215][106225] Updated weights for policy 1, policy_version 1135521 (0.0009) [2023-12-28 03:23:53,263][106225] Updated weights for policy 1, policy_version 1135531 (0.0009) [2023-12-28 03:23:53,516][106226] Updated weights for policy 0, policy_version 1132604 (0.0009) [2023-12-28 03:23:53,577][106226] Updated weights for policy 0, policy_version 1132614 (0.0006) [2023-12-28 03:23:53,643][106226] Updated weights for policy 0, policy_version 1132624 (0.0005) [2023-12-28 03:23:54,072][106225] Updated weights for policy 1, policy_version 1135541 (0.0008) [2023-12-28 03:23:54,121][106225] Updated weights for policy 1, policy_version 1135551 (0.0008) [2023-12-28 03:23:54,172][106225] Updated weights for policy 1, policy_version 1135561 (0.0008) [2023-12-28 03:23:54,239][106226] Updated weights for policy 0, policy_version 1132634 (0.0006) [2023-12-28 03:23:54,298][106226] Updated weights for policy 0, policy_version 1132644 (0.0008) [2023-12-28 03:23:54,360][106226] Updated weights for policy 0, policy_version 1132654 (0.0009) [2023-12-28 03:23:54,419][106226] Updated weights for policy 0, policy_version 1132664 (0.0008) [2023-12-28 03:23:54,934][106225] Updated weights for policy 1, policy_version 1135571 (0.0008) [2023-12-28 03:23:54,985][106225] Updated weights for policy 1, policy_version 1135581 (0.0008) [2023-12-28 03:23:55,047][106225] Updated weights for policy 1, policy_version 1135591 (0.0006) [2023-12-28 03:23:55,093][106226] Updated weights for policy 0, policy_version 1132674 (0.0009) [2023-12-28 03:23:55,148][106226] Updated weights for policy 0, policy_version 1132684 (0.0008) [2023-12-28 03:23:55,198][106226] Updated weights for policy 0, policy_version 1132694 (0.0008) [2023-12-28 03:23:55,732][106225] Updated weights for policy 1, policy_version 1135601 (0.0007) [2023-12-28 03:23:55,795][106225] Updated weights for policy 1, policy_version 1135611 (0.0008) [2023-12-28 03:23:55,857][106225] Updated weights for policy 1, policy_version 1135621 (0.0009) [2023-12-28 03:23:55,913][106225] Updated weights for policy 1, policy_version 1135631 (0.0006) [2023-12-28 03:23:55,949][106226] Updated weights for policy 0, policy_version 1132704 (0.0007) [2023-12-28 03:23:56,005][106226] Updated weights for policy 0, policy_version 1132714 (0.0006) [2023-12-28 03:23:56,056][106226] Updated weights for policy 0, policy_version 1132724 (0.0009) [2023-12-28 03:23:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 580804608. Throughput: 0: 9952.6, 1: 9811.9. Samples: 580770048. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:23:56,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-5.092')] [2023-12-28 03:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001132728_290037760.pth... [2023-12-28 03:23:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001135632_290766848.pth... [2023-12-28 03:23:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001131576_289742848.pth [2023-12-28 03:23:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001134480_290471936.pth [2023-12-28 03:23:56,605][106225] Updated weights for policy 1, policy_version 1135641 (0.0009) [2023-12-28 03:23:56,666][106225] Updated weights for policy 1, policy_version 1135651 (0.0009) [2023-12-28 03:23:56,726][106225] Updated weights for policy 1, policy_version 1135661 (0.0009) [2023-12-28 03:23:56,823][106226] Updated weights for policy 0, policy_version 1132734 (0.0008) [2023-12-28 03:23:56,878][106226] Updated weights for policy 0, policy_version 1132744 (0.0009) [2023-12-28 03:23:56,933][106226] Updated weights for policy 0, policy_version 1132754 (0.0008) [2023-12-28 03:23:57,378][106225] Updated weights for policy 1, policy_version 1135671 (0.0009) [2023-12-28 03:23:57,435][106225] Updated weights for policy 1, policy_version 1135681 (0.0008) [2023-12-28 03:23:57,496][106225] Updated weights for policy 1, policy_version 1135691 (0.0008) [2023-12-28 03:23:57,683][106226] Updated weights for policy 0, policy_version 1132764 (0.0008) [2023-12-28 03:23:57,753][106226] Updated weights for policy 0, policy_version 1132774 (0.0009) [2023-12-28 03:23:57,808][106226] Updated weights for policy 0, policy_version 1132784 (0.0009) [2023-12-28 03:23:58,227][106225] Updated weights for policy 1, policy_version 1135701 (0.0009) [2023-12-28 03:23:58,293][106225] Updated weights for policy 1, policy_version 1135711 (0.0008) [2023-12-28 03:23:58,380][106225] Updated weights for policy 1, policy_version 1135721 (0.0009) [2023-12-28 03:23:58,553][106226] Updated weights for policy 0, policy_version 1132794 (0.0008) [2023-12-28 03:23:58,613][106226] Updated weights for policy 0, policy_version 1132804 (0.0008) [2023-12-28 03:23:58,675][106226] Updated weights for policy 0, policy_version 1132814 (0.0008) [2023-12-28 03:23:58,743][106226] Updated weights for policy 0, policy_version 1132824 (0.0008) [2023-12-28 03:23:59,162][106225] Updated weights for policy 1, policy_version 1135731 (0.0008) [2023-12-28 03:23:59,235][106225] Updated weights for policy 1, policy_version 1135741 (0.0008) [2023-12-28 03:23:59,305][106225] Updated weights for policy 1, policy_version 1135751 (0.0007) [2023-12-28 03:23:59,579][106226] Updated weights for policy 0, policy_version 1132834 (0.0008) [2023-12-28 03:23:59,637][106226] Updated weights for policy 0, policy_version 1132844 (0.0009) [2023-12-28 03:23:59,700][106226] Updated weights for policy 0, policy_version 1132854 (0.0006) [2023-12-28 03:24:00,050][106225] Updated weights for policy 1, policy_version 1135761 (0.0008) [2023-12-28 03:24:00,106][106225] Updated weights for policy 1, policy_version 1135771 (0.0008) [2023-12-28 03:24:00,160][106225] Updated weights for policy 1, policy_version 1135781 (0.0008) [2023-12-28 03:24:00,210][106225] Updated weights for policy 1, policy_version 1135791 (0.0008) [2023-12-28 03:24:00,383][106226] Updated weights for policy 0, policy_version 1132864 (0.0007) [2023-12-28 03:24:00,441][106226] Updated weights for policy 0, policy_version 1132874 (0.0008) [2023-12-28 03:24:00,496][106226] Updated weights for policy 0, policy_version 1132884 (0.0008) [2023-12-28 03:24:00,976][106225] Updated weights for policy 1, policy_version 1135801 (0.0008) [2023-12-28 03:24:01,030][106225] Updated weights for policy 1, policy_version 1135811 (0.0006) [2023-12-28 03:24:01,092][106225] Updated weights for policy 1, policy_version 1135821 (0.0007) [2023-12-28 03:24:01,103][106226] Updated weights for policy 0, policy_version 1132894 (0.0007) [2023-12-28 03:24:01,162][106226] Updated weights for policy 0, policy_version 1132904 (0.0008) [2023-12-28 03:24:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 580894720. Throughput: 0: 9873.3, 1: 9825.0. Samples: 580883860. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:01,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-4.758')] [2023-12-28 03:24:01,232][106226] Updated weights for policy 0, policy_version 1132914 (0.0007) [2023-12-28 03:24:01,773][106225] Updated weights for policy 1, policy_version 1135831 (0.0008) [2023-12-28 03:24:01,829][106225] Updated weights for policy 1, policy_version 1135841 (0.0009) [2023-12-28 03:24:01,888][106225] Updated weights for policy 1, policy_version 1135851 (0.0007) [2023-12-28 03:24:01,985][106226] Updated weights for policy 0, policy_version 1132924 (0.0008) [2023-12-28 03:24:02,040][106226] Updated weights for policy 0, policy_version 1132934 (0.0008) [2023-12-28 03:24:02,092][106226] Updated weights for policy 0, policy_version 1132944 (0.0009) [2023-12-28 03:24:02,622][106225] Updated weights for policy 1, policy_version 1135861 (0.0009) [2023-12-28 03:24:02,671][106225] Updated weights for policy 1, policy_version 1135871 (0.0008) [2023-12-28 03:24:02,723][106225] Updated weights for policy 1, policy_version 1135881 (0.0009) [2023-12-28 03:24:02,741][106226] Updated weights for policy 0, policy_version 1132954 (0.0008) [2023-12-28 03:24:02,799][106226] Updated weights for policy 0, policy_version 1132964 (0.0007) [2023-12-28 03:24:02,855][106226] Updated weights for policy 0, policy_version 1132974 (0.0009) [2023-12-28 03:24:02,902][106226] Updated weights for policy 0, policy_version 1132984 (0.0006) [2023-12-28 03:24:03,356][106225] Updated weights for policy 1, policy_version 1135891 (0.0009) [2023-12-28 03:24:03,410][106225] Updated weights for policy 1, policy_version 1135901 (0.0007) [2023-12-28 03:24:03,462][106225] Updated weights for policy 1, policy_version 1135911 (0.0006) [2023-12-28 03:24:03,606][106226] Updated weights for policy 0, policy_version 1132994 (0.0010) [2023-12-28 03:24:03,664][106226] Updated weights for policy 0, policy_version 1133004 (0.0005) [2023-12-28 03:24:03,714][106226] Updated weights for policy 0, policy_version 1133014 (0.0005) [2023-12-28 03:24:04,138][106225] Updated weights for policy 1, policy_version 1135921 (0.0007) [2023-12-28 03:24:04,196][106225] Updated weights for policy 1, policy_version 1135931 (0.0010) [2023-12-28 03:24:04,261][106225] Updated weights for policy 1, policy_version 1135941 (0.0009) [2023-12-28 03:24:04,316][106225] Updated weights for policy 1, policy_version 1135951 (0.0008) [2023-12-28 03:24:04,389][106226] Updated weights for policy 0, policy_version 1133024 (0.0008) [2023-12-28 03:24:04,453][106226] Updated weights for policy 0, policy_version 1133034 (0.0007) [2023-12-28 03:24:04,519][106226] Updated weights for policy 0, policy_version 1133044 (0.0008) [2023-12-28 03:24:05,042][106225] Updated weights for policy 1, policy_version 1135961 (0.0008) [2023-12-28 03:24:05,094][106225] Updated weights for policy 1, policy_version 1135971 (0.0008) [2023-12-28 03:24:05,154][106225] Updated weights for policy 1, policy_version 1135981 (0.0008) [2023-12-28 03:24:05,195][106226] Updated weights for policy 0, policy_version 1133054 (0.0008) [2023-12-28 03:24:05,255][106226] Updated weights for policy 0, policy_version 1133064 (0.0009) [2023-12-28 03:24:05,310][106226] Updated weights for policy 0, policy_version 1133074 (0.0009) [2023-12-28 03:24:05,893][106226] Updated weights for policy 0, policy_version 1133084 (0.0010) [2023-12-28 03:24:05,947][106226] Updated weights for policy 0, policy_version 1133094 (0.0010) [2023-12-28 03:24:05,972][106225] Updated weights for policy 1, policy_version 1135991 (0.0006) [2023-12-28 03:24:05,997][106226] Updated weights for policy 0, policy_version 1133104 (0.0010) [2023-12-28 03:24:06,023][106225] Updated weights for policy 1, policy_version 1136001 (0.0005) [2023-12-28 03:24:06,071][106225] Updated weights for policy 1, policy_version 1136011 (0.0008) [2023-12-28 03:24:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 581001216. Throughput: 0: 9894.5, 1: 9835.6. Samples: 581004096. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:06,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-4.898')] [2023-12-28 03:24:06,721][106226] Updated weights for policy 0, policy_version 1133114 (0.0010) [2023-12-28 03:24:06,775][106226] Updated weights for policy 0, policy_version 1133124 (0.0005) [2023-12-28 03:24:06,840][106226] Updated weights for policy 0, policy_version 1133134 (0.0008) [2023-12-28 03:24:06,853][106225] Updated weights for policy 1, policy_version 1136021 (0.0008) [2023-12-28 03:24:06,891][106226] Updated weights for policy 0, policy_version 1133144 (0.0010) [2023-12-28 03:24:06,909][106225] Updated weights for policy 1, policy_version 1136031 (0.0006) [2023-12-28 03:24:06,966][106225] Updated weights for policy 1, policy_version 1136041 (0.0008) [2023-12-28 03:24:07,617][106226] Updated weights for policy 0, policy_version 1133154 (0.0009) [2023-12-28 03:24:07,654][106225] Updated weights for policy 1, policy_version 1136051 (0.0008) [2023-12-28 03:24:07,680][106226] Updated weights for policy 0, policy_version 1133164 (0.0006) [2023-12-28 03:24:07,706][106225] Updated weights for policy 1, policy_version 1136061 (0.0007) [2023-12-28 03:24:07,735][106226] Updated weights for policy 0, policy_version 1133174 (0.0007) [2023-12-28 03:24:07,758][106225] Updated weights for policy 1, policy_version 1136071 (0.0006) [2023-12-28 03:24:08,415][106226] Updated weights for policy 0, policy_version 1133184 (0.0008) [2023-12-28 03:24:08,471][106226] Updated weights for policy 0, policy_version 1133194 (0.0009) [2023-12-28 03:24:08,527][106225] Updated weights for policy 1, policy_version 1136081 (0.0008) [2023-12-28 03:24:08,532][106226] Updated weights for policy 0, policy_version 1133204 (0.0008) [2023-12-28 03:24:08,579][106225] Updated weights for policy 1, policy_version 1136091 (0.0007) [2023-12-28 03:24:08,636][106225] Updated weights for policy 1, policy_version 1136101 (0.0009) [2023-12-28 03:24:08,691][106225] Updated weights for policy 1, policy_version 1136111 (0.0009) [2023-12-28 03:24:09,245][106226] Updated weights for policy 0, policy_version 1133214 (0.0008) [2023-12-28 03:24:09,314][106226] Updated weights for policy 0, policy_version 1133224 (0.0009) [2023-12-28 03:24:09,385][106226] Updated weights for policy 0, policy_version 1133234 (0.0009) [2023-12-28 03:24:09,449][106225] Updated weights for policy 1, policy_version 1136121 (0.0007) [2023-12-28 03:24:09,507][106225] Updated weights for policy 1, policy_version 1136131 (0.0008) [2023-12-28 03:24:09,567][106225] Updated weights for policy 1, policy_version 1136141 (0.0008) [2023-12-28 03:24:10,122][106226] Updated weights for policy 0, policy_version 1133244 (0.0007) [2023-12-28 03:24:10,190][106226] Updated weights for policy 0, policy_version 1133254 (0.0008) [2023-12-28 03:24:10,255][106226] Updated weights for policy 0, policy_version 1133264 (0.0010) [2023-12-28 03:24:10,319][106225] Updated weights for policy 1, policy_version 1136151 (0.0007) [2023-12-28 03:24:10,388][106225] Updated weights for policy 1, policy_version 1136161 (0.0008) [2023-12-28 03:24:10,457][106225] Updated weights for policy 1, policy_version 1136171 (0.0010) [2023-12-28 03:24:10,841][106226] Updated weights for policy 0, policy_version 1133274 (0.0007) [2023-12-28 03:24:10,891][106226] Updated weights for policy 0, policy_version 1133284 (0.0005) [2023-12-28 03:24:10,939][106226] Updated weights for policy 0, policy_version 1133294 (0.0007) [2023-12-28 03:24:10,988][106226] Updated weights for policy 0, policy_version 1133304 (0.0009) [2023-12-28 03:24:11,162][106225] Updated weights for policy 1, policy_version 1136181 (0.0010) [2023-12-28 03:24:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 581091328. Throughput: 0: 9884.3, 1: 9813.6. Samples: 581061772. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:11,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.942')] [2023-12-28 03:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001133304_290185216.pth... [2023-12-28 03:24:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001132152_289890304.pth [2023-12-28 03:24:11,220][106225] Updated weights for policy 1, policy_version 1136191 (0.0011) [2023-12-28 03:24:11,286][106225] Updated weights for policy 1, policy_version 1136201 (0.0011) [2023-12-28 03:24:11,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001136208_290914304.pth... [2023-12-28 03:24:11,334][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001135056_290619392.pth [2023-12-28 03:24:11,793][106226] Updated weights for policy 0, policy_version 1133314 (0.0011) [2023-12-28 03:24:11,851][106226] Updated weights for policy 0, policy_version 1133324 (0.0011) [2023-12-28 03:24:11,906][106226] Updated weights for policy 0, policy_version 1133334 (0.0011) [2023-12-28 03:24:12,021][106225] Updated weights for policy 1, policy_version 1136211 (0.0009) [2023-12-28 03:24:12,089][106225] Updated weights for policy 1, policy_version 1136221 (0.0008) [2023-12-28 03:24:12,154][106225] Updated weights for policy 1, policy_version 1136231 (0.0008) [2023-12-28 03:24:12,671][106226] Updated weights for policy 0, policy_version 1133344 (0.0008) [2023-12-28 03:24:12,732][106226] Updated weights for policy 0, policy_version 1133354 (0.0010) [2023-12-28 03:24:12,793][106226] Updated weights for policy 0, policy_version 1133364 (0.0009) [2023-12-28 03:24:12,889][106225] Updated weights for policy 1, policy_version 1136241 (0.0007) [2023-12-28 03:24:12,943][106225] Updated weights for policy 1, policy_version 1136251 (0.0008) [2023-12-28 03:24:13,001][106225] Updated weights for policy 1, policy_version 1136261 (0.0010) [2023-12-28 03:24:13,064][106225] Updated weights for policy 1, policy_version 1136271 (0.0009) [2023-12-28 03:24:13,458][106226] Updated weights for policy 0, policy_version 1133374 (0.0008) [2023-12-28 03:24:13,507][106226] Updated weights for policy 0, policy_version 1133384 (0.0006) [2023-12-28 03:24:13,560][106226] Updated weights for policy 0, policy_version 1133394 (0.0005) [2023-12-28 03:24:13,817][106225] Updated weights for policy 1, policy_version 1136281 (0.0009) [2023-12-28 03:24:13,871][106225] Updated weights for policy 1, policy_version 1136291 (0.0007) [2023-12-28 03:24:13,919][106225] Updated weights for policy 1, policy_version 1136301 (0.0008) [2023-12-28 03:24:14,231][106226] Updated weights for policy 0, policy_version 1133404 (0.0006) [2023-12-28 03:24:14,286][106226] Updated weights for policy 0, policy_version 1133414 (0.0008) [2023-12-28 03:24:14,345][106226] Updated weights for policy 0, policy_version 1133424 (0.0008) [2023-12-28 03:24:14,668][106225] Updated weights for policy 1, policy_version 1136311 (0.0008) [2023-12-28 03:24:14,724][106225] Updated weights for policy 1, policy_version 1136321 (0.0008) [2023-12-28 03:24:14,792][106225] Updated weights for policy 1, policy_version 1136331 (0.0009) [2023-12-28 03:24:15,065][106226] Updated weights for policy 0, policy_version 1133434 (0.0008) [2023-12-28 03:24:15,135][106226] Updated weights for policy 0, policy_version 1133444 (0.0008) [2023-12-28 03:24:15,206][106226] Updated weights for policy 0, policy_version 1133454 (0.0006) [2023-12-28 03:24:15,280][106226] Updated weights for policy 0, policy_version 1133464 (0.0009) [2023-12-28 03:24:15,493][106225] Updated weights for policy 1, policy_version 1136341 (0.0009) [2023-12-28 03:24:15,544][106225] Updated weights for policy 1, policy_version 1136351 (0.0008) [2023-12-28 03:24:15,603][106225] Updated weights for policy 1, policy_version 1136361 (0.0008) [2023-12-28 03:24:15,933][106226] Updated weights for policy 0, policy_version 1133474 (0.0007) [2023-12-28 03:24:15,994][106226] Updated weights for policy 0, policy_version 1133484 (0.0008) [2023-12-28 03:24:16,050][106226] Updated weights for policy 0, policy_version 1133494 (0.0009) [2023-12-28 03:24:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 581189632. Throughput: 0: 9885.0, 1: 9598.7. Samples: 581177092. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:16,176][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.847')] [2023-12-28 03:24:16,281][106225] Updated weights for policy 1, policy_version 1136371 (0.0008) [2023-12-28 03:24:16,336][106225] Updated weights for policy 1, policy_version 1136381 (0.0008) [2023-12-28 03:24:16,393][106225] Updated weights for policy 1, policy_version 1136391 (0.0008) [2023-12-28 03:24:16,743][106226] Updated weights for policy 0, policy_version 1133504 (0.0006) [2023-12-28 03:24:16,811][106226] Updated weights for policy 0, policy_version 1133514 (0.0007) [2023-12-28 03:24:16,872][106226] Updated weights for policy 0, policy_version 1133524 (0.0008) [2023-12-28 03:24:17,072][106225] Updated weights for policy 1, policy_version 1136401 (0.0008) [2023-12-28 03:24:17,137][106225] Updated weights for policy 1, policy_version 1136411 (0.0005) [2023-12-28 03:24:17,195][106225] Updated weights for policy 1, policy_version 1136421 (0.0006) [2023-12-28 03:24:17,261][106225] Updated weights for policy 1, policy_version 1136431 (0.0005) [2023-12-28 03:24:17,575][106226] Updated weights for policy 0, policy_version 1133534 (0.0007) [2023-12-28 03:24:17,623][106226] Updated weights for policy 0, policy_version 1133544 (0.0008) [2023-12-28 03:24:17,671][106226] Updated weights for policy 0, policy_version 1133554 (0.0008) [2023-12-28 03:24:17,862][106225] Updated weights for policy 1, policy_version 1136441 (0.0008) [2023-12-28 03:24:17,916][106225] Updated weights for policy 1, policy_version 1136451 (0.0009) [2023-12-28 03:24:17,971][106225] Updated weights for policy 1, policy_version 1136462 (0.0010) [2023-12-28 03:24:18,291][106226] Updated weights for policy 0, policy_version 1133564 (0.0007) [2023-12-28 03:24:18,358][106226] Updated weights for policy 0, policy_version 1133574 (0.0007) [2023-12-28 03:24:18,420][106226] Updated weights for policy 0, policy_version 1133584 (0.0008) [2023-12-28 03:24:18,780][106225] Updated weights for policy 1, policy_version 1136472 (0.0008) [2023-12-28 03:24:18,833][106225] Updated weights for policy 1, policy_version 1136482 (0.0007) [2023-12-28 03:24:18,882][106225] Updated weights for policy 1, policy_version 1136492 (0.0005) [2023-12-28 03:24:19,086][106226] Updated weights for policy 0, policy_version 1133594 (0.0007) [2023-12-28 03:24:19,155][106226] Updated weights for policy 0, policy_version 1133604 (0.0006) [2023-12-28 03:24:19,223][106226] Updated weights for policy 0, policy_version 1133614 (0.0010) [2023-12-28 03:24:19,537][106225] Updated weights for policy 1, policy_version 1136502 (0.0008) [2023-12-28 03:24:19,601][106225] Updated weights for policy 1, policy_version 1136512 (0.0009) [2023-12-28 03:24:19,663][106225] Updated weights for policy 1, policy_version 1136522 (0.0009) [2023-12-28 03:24:19,923][106226] Updated weights for policy 0, policy_version 1133625 (0.0007) [2023-12-28 03:24:19,988][106226] Updated weights for policy 0, policy_version 1133635 (0.0011) [2023-12-28 03:24:20,053][106226] Updated weights for policy 0, policy_version 1133645 (0.0007) [2023-12-28 03:24:20,128][106226] Updated weights for policy 0, policy_version 1133655 (0.0009) [2023-12-28 03:24:20,502][106225] Updated weights for policy 1, policy_version 1136532 (0.0007) [2023-12-28 03:24:20,557][106225] Updated weights for policy 1, policy_version 1136542 (0.0006) [2023-12-28 03:24:20,631][106225] Updated weights for policy 1, policy_version 1136552 (0.0008) [2023-12-28 03:24:20,708][106226] Updated weights for policy 0, policy_version 1133665 (0.0006) [2023-12-28 03:24:20,775][106226] Updated weights for policy 0, policy_version 1133675 (0.0007) [2023-12-28 03:24:20,840][106226] Updated weights for policy 0, policy_version 1133685 (0.0008) [2023-12-28 03:24:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 581287936. Throughput: 0: 9911.6, 1: 9568.4. Samples: 581297408. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:21,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.979')] [2023-12-28 03:24:21,358][106225] Updated weights for policy 1, policy_version 1136562 (0.0008) [2023-12-28 03:24:21,430][106225] Updated weights for policy 1, policy_version 1136572 (0.0008) [2023-12-28 03:24:21,489][106225] Updated weights for policy 1, policy_version 1136582 (0.0006) [2023-12-28 03:24:21,537][106226] Updated weights for policy 0, policy_version 1133695 (0.0007) [2023-12-28 03:24:21,550][106225] Updated weights for policy 1, policy_version 1136592 (0.0007) [2023-12-28 03:24:21,595][106226] Updated weights for policy 0, policy_version 1133705 (0.0010) [2023-12-28 03:24:21,663][106226] Updated weights for policy 0, policy_version 1133715 (0.0007) [2023-12-28 03:24:22,196][106225] Updated weights for policy 1, policy_version 1136602 (0.0008) [2023-12-28 03:24:22,257][106225] Updated weights for policy 1, policy_version 1136612 (0.0008) [2023-12-28 03:24:22,323][106225] Updated weights for policy 1, policy_version 1136622 (0.0007) [2023-12-28 03:24:22,513][106226] Updated weights for policy 0, policy_version 1133725 (0.0008) [2023-12-28 03:24:22,581][106226] Updated weights for policy 0, policy_version 1133735 (0.0009) [2023-12-28 03:24:22,643][106226] Updated weights for policy 0, policy_version 1133745 (0.0008) [2023-12-28 03:24:22,958][106225] Updated weights for policy 1, policy_version 1136632 (0.0006) [2023-12-28 03:24:23,015][106225] Updated weights for policy 1, policy_version 1136642 (0.0006) [2023-12-28 03:24:23,071][106225] Updated weights for policy 1, policy_version 1136652 (0.0007) [2023-12-28 03:24:23,400][106226] Updated weights for policy 0, policy_version 1133755 (0.0009) [2023-12-28 03:24:23,450][106226] Updated weights for policy 0, policy_version 1133765 (0.0008) [2023-12-28 03:24:23,503][106226] Updated weights for policy 0, policy_version 1133775 (0.0009) [2023-12-28 03:24:23,654][106225] Updated weights for policy 1, policy_version 1136662 (0.0009) [2023-12-28 03:24:23,709][106225] Updated weights for policy 1, policy_version 1136672 (0.0008) [2023-12-28 03:24:23,769][106225] Updated weights for policy 1, policy_version 1136682 (0.0005) [2023-12-28 03:24:24,222][106226] Updated weights for policy 0, policy_version 1133785 (0.0008) [2023-12-28 03:24:24,282][106226] Updated weights for policy 0, policy_version 1133795 (0.0011) [2023-12-28 03:24:24,345][106226] Updated weights for policy 0, policy_version 1133805 (0.0010) [2023-12-28 03:24:24,403][106226] Updated weights for policy 0, policy_version 1133815 (0.0006) [2023-12-28 03:24:24,454][106225] Updated weights for policy 1, policy_version 1136692 (0.0006) [2023-12-28 03:24:24,504][106225] Updated weights for policy 1, policy_version 1136702 (0.0009) [2023-12-28 03:24:24,552][106225] Updated weights for policy 1, policy_version 1136712 (0.0008) [2023-12-28 03:24:25,009][106226] Updated weights for policy 0, policy_version 1133825 (0.0006) [2023-12-28 03:24:25,070][106226] Updated weights for policy 0, policy_version 1133835 (0.0005) [2023-12-28 03:24:25,128][106226] Updated weights for policy 0, policy_version 1133845 (0.0006) [2023-12-28 03:24:25,318][106225] Updated weights for policy 1, policy_version 1136723 (0.0009) [2023-12-28 03:24:25,379][106225] Updated weights for policy 1, policy_version 1136733 (0.0010) [2023-12-28 03:24:25,441][106225] Updated weights for policy 1, policy_version 1136743 (0.0008) [2023-12-28 03:24:25,732][106226] Updated weights for policy 0, policy_version 1133855 (0.0007) [2023-12-28 03:24:25,785][106226] Updated weights for policy 0, policy_version 1133865 (0.0005) [2023-12-28 03:24:25,843][106226] Updated weights for policy 0, policy_version 1133875 (0.0005) [2023-12-28 03:24:26,052][106225] Updated weights for policy 1, policy_version 1136753 (0.0006) [2023-12-28 03:24:26,110][106225] Updated weights for policy 1, policy_version 1136763 (0.0008) [2023-12-28 03:24:26,165][106225] Updated weights for policy 1, policy_version 1136773 (0.0006) [2023-12-28 03:24:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 581386240. Throughput: 0: 9825.4, 1: 9640.4. Samples: 581356192. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:26,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-4.987')] [2023-12-28 03:24:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001133880_290332672.pth... [2023-12-28 03:24:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001132728_290037760.pth [2023-12-28 03:24:26,216][106225] Updated weights for policy 1, policy_version 1136783 (0.0005) [2023-12-28 03:24:26,219][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001136784_291061760.pth... [2023-12-28 03:24:26,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001135632_290766848.pth [2023-12-28 03:24:26,511][106226] Updated weights for policy 0, policy_version 1133885 (0.0009) [2023-12-28 03:24:26,565][106226] Updated weights for policy 0, policy_version 1133895 (0.0010) [2023-12-28 03:24:26,620][106226] Updated weights for policy 0, policy_version 1133905 (0.0010) [2023-12-28 03:24:26,846][106225] Updated weights for policy 1, policy_version 1136793 (0.0008) [2023-12-28 03:24:26,907][106225] Updated weights for policy 1, policy_version 1136803 (0.0008) [2023-12-28 03:24:26,971][106225] Updated weights for policy 1, policy_version 1136813 (0.0006) [2023-12-28 03:24:27,392][106226] Updated weights for policy 0, policy_version 1133915 (0.0008) [2023-12-28 03:24:27,457][106226] Updated weights for policy 0, policy_version 1133925 (0.0010) [2023-12-28 03:24:27,515][106226] Updated weights for policy 0, policy_version 1133935 (0.0009) [2023-12-28 03:24:27,523][106225] Updated weights for policy 1, policy_version 1136823 (0.0005) [2023-12-28 03:24:27,582][106225] Updated weights for policy 1, policy_version 1136833 (0.0005) [2023-12-28 03:24:27,641][106225] Updated weights for policy 1, policy_version 1136843 (0.0005) [2023-12-28 03:24:28,269][106226] Updated weights for policy 0, policy_version 1133945 (0.0008) [2023-12-28 03:24:28,290][106225] Updated weights for policy 1, policy_version 1136853 (0.0005) [2023-12-28 03:24:28,331][106226] Updated weights for policy 0, policy_version 1133955 (0.0008) [2023-12-28 03:24:28,342][106225] Updated weights for policy 1, policy_version 1136863 (0.0008) [2023-12-28 03:24:28,393][106226] Updated weights for policy 0, policy_version 1133965 (0.0007) [2023-12-28 03:24:28,398][106225] Updated weights for policy 1, policy_version 1136873 (0.0010) [2023-12-28 03:24:28,449][106226] Updated weights for policy 0, policy_version 1133975 (0.0006) [2023-12-28 03:24:29,069][106225] Updated weights for policy 1, policy_version 1136883 (0.0009) [2023-12-28 03:24:29,135][106225] Updated weights for policy 1, policy_version 1136893 (0.0005) [2023-12-28 03:24:29,197][106225] Updated weights for policy 1, policy_version 1136903 (0.0005) [2023-12-28 03:24:29,244][106226] Updated weights for policy 0, policy_version 1133985 (0.0009) [2023-12-28 03:24:29,308][106226] Updated weights for policy 0, policy_version 1133995 (0.0009) [2023-12-28 03:24:29,380][106226] Updated weights for policy 0, policy_version 1134005 (0.0008) [2023-12-28 03:24:29,795][106225] Updated weights for policy 1, policy_version 1136913 (0.0006) [2023-12-28 03:24:29,863][106225] Updated weights for policy 1, policy_version 1136923 (0.0007) [2023-12-28 03:24:29,922][106225] Updated weights for policy 1, policy_version 1136933 (0.0009) [2023-12-28 03:24:30,004][106225] Updated weights for policy 1, policy_version 1136943 (0.0008) [2023-12-28 03:24:30,067][106226] Updated weights for policy 0, policy_version 1134015 (0.0009) [2023-12-28 03:24:30,130][106226] Updated weights for policy 0, policy_version 1134025 (0.0008) [2023-12-28 03:24:30,189][106226] Updated weights for policy 0, policy_version 1134035 (0.0006) [2023-12-28 03:24:30,734][106225] Updated weights for policy 1, policy_version 1136953 (0.0009) [2023-12-28 03:24:30,799][106225] Updated weights for policy 1, policy_version 1136963 (0.0008) [2023-12-28 03:24:30,855][106225] Updated weights for policy 1, policy_version 1136973 (0.0008) [2023-12-28 03:24:30,885][106226] Updated weights for policy 0, policy_version 1134045 (0.0008) [2023-12-28 03:24:30,933][106226] Updated weights for policy 0, policy_version 1134055 (0.0008) [2023-12-28 03:24:30,985][106226] Updated weights for policy 0, policy_version 1134065 (0.0008) [2023-12-28 03:24:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 581492736. Throughput: 0: 9867.9, 1: 9780.7. Samples: 581479204. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:31,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.932')] [2023-12-28 03:24:31,554][106225] Updated weights for policy 1, policy_version 1136983 (0.0007) [2023-12-28 03:24:31,620][106225] Updated weights for policy 1, policy_version 1136993 (0.0009) [2023-12-28 03:24:31,684][106225] Updated weights for policy 1, policy_version 1137003 (0.0008) [2023-12-28 03:24:31,811][106226] Updated weights for policy 0, policy_version 1134075 (0.0009) [2023-12-28 03:24:31,863][106226] Updated weights for policy 0, policy_version 1134085 (0.0008) [2023-12-28 03:24:31,918][106226] Updated weights for policy 0, policy_version 1134095 (0.0009) [2023-12-28 03:24:32,303][106225] Updated weights for policy 1, policy_version 1137013 (0.0007) [2023-12-28 03:24:32,362][106225] Updated weights for policy 1, policy_version 1137023 (0.0008) [2023-12-28 03:24:32,431][106225] Updated weights for policy 1, policy_version 1137033 (0.0009) [2023-12-28 03:24:32,640][106226] Updated weights for policy 0, policy_version 1134105 (0.0010) [2023-12-28 03:24:32,710][106226] Updated weights for policy 0, policy_version 1134115 (0.0006) [2023-12-28 03:24:32,774][106226] Updated weights for policy 0, policy_version 1134125 (0.0007) [2023-12-28 03:24:32,841][106226] Updated weights for policy 0, policy_version 1134135 (0.0009) [2023-12-28 03:24:33,100][106225] Updated weights for policy 1, policy_version 1137043 (0.0007) [2023-12-28 03:24:33,151][106225] Updated weights for policy 1, policy_version 1137053 (0.0008) [2023-12-28 03:24:33,206][106225] Updated weights for policy 1, policy_version 1137063 (0.0008) [2023-12-28 03:24:33,526][106226] Updated weights for policy 0, policy_version 1134145 (0.0008) [2023-12-28 03:24:33,572][106226] Updated weights for policy 0, policy_version 1134155 (0.0007) [2023-12-28 03:24:33,624][106226] Updated weights for policy 0, policy_version 1134165 (0.0006) [2023-12-28 03:24:33,856][106225] Updated weights for policy 1, policy_version 1137073 (0.0008) [2023-12-28 03:24:33,919][106225] Updated weights for policy 1, policy_version 1137083 (0.0006) [2023-12-28 03:24:33,968][106225] Updated weights for policy 1, policy_version 1137093 (0.0005) [2023-12-28 03:24:34,016][106225] Updated weights for policy 1, policy_version 1137103 (0.0005) [2023-12-28 03:24:34,286][106226] Updated weights for policy 0, policy_version 1134175 (0.0007) [2023-12-28 03:24:34,337][106226] Updated weights for policy 0, policy_version 1134185 (0.0008) [2023-12-28 03:24:34,395][106226] Updated weights for policy 0, policy_version 1134195 (0.0007) [2023-12-28 03:24:34,682][106225] Updated weights for policy 1, policy_version 1137113 (0.0010) [2023-12-28 03:24:34,743][106225] Updated weights for policy 1, policy_version 1137123 (0.0010) [2023-12-28 03:24:34,800][106225] Updated weights for policy 1, policy_version 1137133 (0.0010) [2023-12-28 03:24:35,141][106226] Updated weights for policy 0, policy_version 1134205 (0.0009) [2023-12-28 03:24:35,204][106226] Updated weights for policy 0, policy_version 1134215 (0.0011) [2023-12-28 03:24:35,265][106226] Updated weights for policy 0, policy_version 1134225 (0.0011) [2023-12-28 03:24:35,415][106225] Updated weights for policy 1, policy_version 1137143 (0.0011) [2023-12-28 03:24:35,473][106225] Updated weights for policy 1, policy_version 1137153 (0.0010) [2023-12-28 03:24:35,534][106225] Updated weights for policy 1, policy_version 1137163 (0.0011) [2023-12-28 03:24:35,984][106226] Updated weights for policy 0, policy_version 1134235 (0.0011) [2023-12-28 03:24:36,048][106226] Updated weights for policy 0, policy_version 1134245 (0.0011) [2023-12-28 03:24:36,113][106226] Updated weights for policy 0, policy_version 1134255 (0.0010) [2023-12-28 03:24:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 581591040. Throughput: 0: 9817.3, 1: 9895.8. Samples: 581598144. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:36,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-4.826')] [2023-12-28 03:24:36,256][106225] Updated weights for policy 1, policy_version 1137173 (0.0009) [2023-12-28 03:24:36,315][106225] Updated weights for policy 1, policy_version 1137183 (0.0008) [2023-12-28 03:24:36,375][106225] Updated weights for policy 1, policy_version 1137193 (0.0008) [2023-12-28 03:24:36,824][106226] Updated weights for policy 0, policy_version 1134265 (0.0011) [2023-12-28 03:24:36,891][106226] Updated weights for policy 0, policy_version 1134275 (0.0007) [2023-12-28 03:24:36,947][106226] Updated weights for policy 0, policy_version 1134285 (0.0007) [2023-12-28 03:24:37,004][106226] Updated weights for policy 0, policy_version 1134295 (0.0009) [2023-12-28 03:24:37,018][106225] Updated weights for policy 1, policy_version 1137203 (0.0007) [2023-12-28 03:24:37,075][106225] Updated weights for policy 1, policy_version 1137213 (0.0005) [2023-12-28 03:24:37,127][106225] Updated weights for policy 1, policy_version 1137223 (0.0005) [2023-12-28 03:24:37,562][106226] Updated weights for policy 0, policy_version 1134305 (0.0006) [2023-12-28 03:24:37,619][106226] Updated weights for policy 0, policy_version 1134315 (0.0011) [2023-12-28 03:24:37,679][106226] Updated weights for policy 0, policy_version 1134325 (0.0011) [2023-12-28 03:24:37,681][106225] Updated weights for policy 1, policy_version 1137233 (0.0007) [2023-12-28 03:24:37,747][106225] Updated weights for policy 1, policy_version 1137243 (0.0009) [2023-12-28 03:24:37,816][106225] Updated weights for policy 1, policy_version 1137253 (0.0008) [2023-12-28 03:24:37,881][106225] Updated weights for policy 1, policy_version 1137263 (0.0010) [2023-12-28 03:24:38,331][106226] Updated weights for policy 0, policy_version 1134335 (0.0010) [2023-12-28 03:24:38,397][106226] Updated weights for policy 0, policy_version 1134345 (0.0006) [2023-12-28 03:24:38,461][106226] Updated weights for policy 0, policy_version 1134355 (0.0006) [2023-12-28 03:24:38,590][106225] Updated weights for policy 1, policy_version 1137273 (0.0009) [2023-12-28 03:24:38,656][106225] Updated weights for policy 1, policy_version 1137283 (0.0006) [2023-12-28 03:24:38,722][106225] Updated weights for policy 1, policy_version 1137293 (0.0005) [2023-12-28 03:24:39,112][106226] Updated weights for policy 0, policy_version 1134365 (0.0006) [2023-12-28 03:24:39,162][106226] Updated weights for policy 0, policy_version 1134375 (0.0006) [2023-12-28 03:24:39,222][106226] Updated weights for policy 0, policy_version 1134385 (0.0010) [2023-12-28 03:24:39,339][106225] Updated weights for policy 1, policy_version 1137303 (0.0006) [2023-12-28 03:24:39,410][106225] Updated weights for policy 1, policy_version 1137313 (0.0008) [2023-12-28 03:24:39,480][106225] Updated weights for policy 1, policy_version 1137323 (0.0007) [2023-12-28 03:24:39,850][106226] Updated weights for policy 0, policy_version 1134395 (0.0008) [2023-12-28 03:24:39,904][106226] Updated weights for policy 0, policy_version 1134405 (0.0009) [2023-12-28 03:24:39,973][106226] Updated weights for policy 0, policy_version 1134415 (0.0009) [2023-12-28 03:24:40,192][106225] Updated weights for policy 1, policy_version 1137333 (0.0008) [2023-12-28 03:24:40,262][106225] Updated weights for policy 1, policy_version 1137343 (0.0009) [2023-12-28 03:24:40,324][106225] Updated weights for policy 1, policy_version 1137353 (0.0009) [2023-12-28 03:24:40,752][106226] Updated weights for policy 0, policy_version 1134425 (0.0009) [2023-12-28 03:24:40,811][106226] Updated weights for policy 0, policy_version 1134435 (0.0008) [2023-12-28 03:24:40,878][106226] Updated weights for policy 0, policy_version 1134445 (0.0008) [2023-12-28 03:24:40,924][106226] Updated weights for policy 0, policy_version 1134455 (0.0007) [2023-12-28 03:24:41,012][106225] Updated weights for policy 1, policy_version 1137363 (0.0008) [2023-12-28 03:24:41,076][106225] Updated weights for policy 1, policy_version 1137373 (0.0007) [2023-12-28 03:24:41,139][106225] Updated weights for policy 1, policy_version 1137383 (0.0007) [2023-12-28 03:24:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 581689344. Throughput: 0: 9860.2, 1: 9944.0. Samples: 581661236. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:41,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.688')] [2023-12-28 03:24:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001134456_290480128.pth... [2023-12-28 03:24:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001133304_290185216.pth [2023-12-28 03:24:41,195][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001137392_291217408.pth... [2023-12-28 03:24:41,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001136208_290914304.pth [2023-12-28 03:24:41,705][106226] Updated weights for policy 0, policy_version 1134465 (0.0010) [2023-12-28 03:24:41,771][106226] Updated weights for policy 0, policy_version 1134475 (0.0009) [2023-12-28 03:24:41,839][106226] Updated weights for policy 0, policy_version 1134485 (0.0009) [2023-12-28 03:24:41,858][106225] Updated weights for policy 1, policy_version 1137393 (0.0007) [2023-12-28 03:24:41,927][106225] Updated weights for policy 1, policy_version 1137403 (0.0008) [2023-12-28 03:24:41,981][106225] Updated weights for policy 1, policy_version 1137413 (0.0008) [2023-12-28 03:24:42,035][106225] Updated weights for policy 1, policy_version 1137423 (0.0008) [2023-12-28 03:24:42,586][106226] Updated weights for policy 0, policy_version 1134495 (0.0007) [2023-12-28 03:24:42,646][106226] Updated weights for policy 0, policy_version 1134505 (0.0008) [2023-12-28 03:24:42,706][106226] Updated weights for policy 0, policy_version 1134515 (0.0009) [2023-12-28 03:24:42,766][106225] Updated weights for policy 1, policy_version 1137433 (0.0006) [2023-12-28 03:24:42,824][106225] Updated weights for policy 1, policy_version 1137443 (0.0006) [2023-12-28 03:24:42,887][106225] Updated weights for policy 1, policy_version 1137453 (0.0007) [2023-12-28 03:24:43,306][106226] Updated weights for policy 0, policy_version 1134525 (0.0007) [2023-12-28 03:24:43,366][106226] Updated weights for policy 0, policy_version 1134535 (0.0009) [2023-12-28 03:24:43,416][106226] Updated weights for policy 0, policy_version 1134545 (0.0008) [2023-12-28 03:24:43,474][106225] Updated weights for policy 1, policy_version 1137463 (0.0007) [2023-12-28 03:24:43,540][106225] Updated weights for policy 1, policy_version 1137473 (0.0005) [2023-12-28 03:24:43,609][106225] Updated weights for policy 1, policy_version 1137483 (0.0005) [2023-12-28 03:24:44,118][106226] Updated weights for policy 0, policy_version 1134555 (0.0008) [2023-12-28 03:24:44,172][106226] Updated weights for policy 0, policy_version 1134565 (0.0005) [2023-12-28 03:24:44,239][106226] Updated weights for policy 0, policy_version 1134575 (0.0007) [2023-12-28 03:24:44,268][106225] Updated weights for policy 1, policy_version 1137493 (0.0008) [2023-12-28 03:24:44,322][106225] Updated weights for policy 1, policy_version 1137503 (0.0007) [2023-12-28 03:24:44,380][106225] Updated weights for policy 1, policy_version 1137513 (0.0008) [2023-12-28 03:24:44,878][106226] Updated weights for policy 0, policy_version 1134585 (0.0007) [2023-12-28 03:24:44,944][106226] Updated weights for policy 0, policy_version 1134595 (0.0008) [2023-12-28 03:24:45,008][106226] Updated weights for policy 0, policy_version 1134605 (0.0008) [2023-12-28 03:24:45,073][106226] Updated weights for policy 0, policy_version 1134615 (0.0008) [2023-12-28 03:24:45,120][106225] Updated weights for policy 1, policy_version 1137523 (0.0009) [2023-12-28 03:24:45,178][106225] Updated weights for policy 1, policy_version 1137533 (0.0010) [2023-12-28 03:24:45,233][106225] Updated weights for policy 1, policy_version 1137543 (0.0011) [2023-12-28 03:24:45,849][106226] Updated weights for policy 0, policy_version 1134625 (0.0008) [2023-12-28 03:24:45,878][106225] Updated weights for policy 1, policy_version 1137553 (0.0010) [2023-12-28 03:24:45,902][106226] Updated weights for policy 0, policy_version 1134635 (0.0008) [2023-12-28 03:24:45,945][106225] Updated weights for policy 1, policy_version 1137563 (0.0009) [2023-12-28 03:24:45,956][106226] Updated weights for policy 0, policy_version 1134645 (0.0006) [2023-12-28 03:24:46,001][106225] Updated weights for policy 1, policy_version 1137573 (0.0006) [2023-12-28 03:24:46,054][106225] Updated weights for policy 1, policy_version 1137583 (0.0007) [2023-12-28 03:24:46,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 581795840. Throughput: 0: 9918.9, 1: 9984.3. Samples: 581779508. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:46,176][105115] Avg episode reward: [(0, '-4.660'), (1, '-5.082')] [2023-12-28 03:24:46,614][106226] Updated weights for policy 0, policy_version 1134655 (0.0007) [2023-12-28 03:24:46,670][106226] Updated weights for policy 0, policy_version 1134665 (0.0006) [2023-12-28 03:24:46,695][106225] Updated weights for policy 1, policy_version 1137593 (0.0007) [2023-12-28 03:24:46,723][106226] Updated weights for policy 0, policy_version 1134675 (0.0005) [2023-12-28 03:24:46,756][106225] Updated weights for policy 1, policy_version 1137603 (0.0006) [2023-12-28 03:24:46,823][106225] Updated weights for policy 1, policy_version 1137613 (0.0006) [2023-12-28 03:24:47,421][106226] Updated weights for policy 0, policy_version 1134685 (0.0007) [2023-12-28 03:24:47,430][106225] Updated weights for policy 1, policy_version 1137623 (0.0010) [2023-12-28 03:24:47,475][106226] Updated weights for policy 0, policy_version 1134695 (0.0006) [2023-12-28 03:24:47,478][106225] Updated weights for policy 1, policy_version 1137633 (0.0009) [2023-12-28 03:24:47,524][106225] Updated weights for policy 1, policy_version 1137643 (0.0005) [2023-12-28 03:24:47,529][106226] Updated weights for policy 0, policy_version 1134705 (0.0008) [2023-12-28 03:24:48,167][106225] Updated weights for policy 1, policy_version 1137653 (0.0008) [2023-12-28 03:24:48,230][106225] Updated weights for policy 1, policy_version 1137663 (0.0010) [2023-12-28 03:24:48,288][106225] Updated weights for policy 1, policy_version 1137673 (0.0010) [2023-12-28 03:24:48,294][106226] Updated weights for policy 0, policy_version 1134715 (0.0008) [2023-12-28 03:24:48,355][106226] Updated weights for policy 0, policy_version 1134725 (0.0006) [2023-12-28 03:24:48,410][106226] Updated weights for policy 0, policy_version 1134735 (0.0008) [2023-12-28 03:24:49,008][106225] Updated weights for policy 1, policy_version 1137683 (0.0010) [2023-12-28 03:24:49,068][106225] Updated weights for policy 1, policy_version 1137693 (0.0008) [2023-12-28 03:24:49,109][106226] Updated weights for policy 0, policy_version 1134745 (0.0007) [2023-12-28 03:24:49,122][106225] Updated weights for policy 1, policy_version 1137703 (0.0010) [2023-12-28 03:24:49,165][106226] Updated weights for policy 0, policy_version 1134755 (0.0005) [2023-12-28 03:24:49,218][106226] Updated weights for policy 0, policy_version 1134765 (0.0006) [2023-12-28 03:24:49,292][106226] Updated weights for policy 0, policy_version 1134775 (0.0007) [2023-12-28 03:24:49,886][106225] Updated weights for policy 1, policy_version 1137713 (0.0009) [2023-12-28 03:24:49,952][106225] Updated weights for policy 1, policy_version 1137723 (0.0008) [2023-12-28 03:24:49,968][106226] Updated weights for policy 0, policy_version 1134785 (0.0008) [2023-12-28 03:24:50,016][106225] Updated weights for policy 1, policy_version 1137733 (0.0008) [2023-12-28 03:24:50,034][106226] Updated weights for policy 0, policy_version 1134795 (0.0006) [2023-12-28 03:24:50,077][106225] Updated weights for policy 1, policy_version 1137743 (0.0008) [2023-12-28 03:24:50,096][106226] Updated weights for policy 0, policy_version 1134805 (0.0008) [2023-12-28 03:24:50,854][106225] Updated weights for policy 1, policy_version 1137753 (0.0006) [2023-12-28 03:24:50,862][106226] Updated weights for policy 0, policy_version 1134815 (0.0008) [2023-12-28 03:24:50,908][106225] Updated weights for policy 1, policy_version 1137763 (0.0008) [2023-12-28 03:24:50,918][106226] Updated weights for policy 0, policy_version 1134825 (0.0006) [2023-12-28 03:24:50,963][106225] Updated weights for policy 1, policy_version 1137773 (0.0009) [2023-12-28 03:24:50,981][106226] Updated weights for policy 0, policy_version 1134835 (0.0008) [2023-12-28 03:24:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 581894144. Throughput: 0: 9836.2, 1: 10036.5. Samples: 581898368. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:51,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.730')] [2023-12-28 03:24:51,787][106225] Updated weights for policy 1, policy_version 1137783 (0.0008) [2023-12-28 03:24:51,790][106226] Updated weights for policy 0, policy_version 1134845 (0.0008) [2023-12-28 03:24:51,844][106225] Updated weights for policy 1, policy_version 1137793 (0.0006) [2023-12-28 03:24:51,845][106226] Updated weights for policy 0, policy_version 1134855 (0.0006) [2023-12-28 03:24:51,902][106226] Updated weights for policy 0, policy_version 1134865 (0.0008) [2023-12-28 03:24:51,907][106225] Updated weights for policy 1, policy_version 1137803 (0.0008) [2023-12-28 03:24:52,601][106225] Updated weights for policy 1, policy_version 1137813 (0.0007) [2023-12-28 03:24:52,653][106225] Updated weights for policy 1, policy_version 1137823 (0.0008) [2023-12-28 03:24:52,660][106226] Updated weights for policy 0, policy_version 1134875 (0.0007) [2023-12-28 03:24:52,709][106225] Updated weights for policy 1, policy_version 1137833 (0.0008) [2023-12-28 03:24:52,715][106226] Updated weights for policy 0, policy_version 1134885 (0.0007) [2023-12-28 03:24:52,781][106226] Updated weights for policy 0, policy_version 1134895 (0.0008) [2023-12-28 03:24:53,430][106225] Updated weights for policy 1, policy_version 1137843 (0.0005) [2023-12-28 03:24:53,482][106225] Updated weights for policy 1, policy_version 1137853 (0.0006) [2023-12-28 03:24:53,503][106226] Updated weights for policy 0, policy_version 1134905 (0.0009) [2023-12-28 03:24:53,548][106225] Updated weights for policy 1, policy_version 1137863 (0.0005) [2023-12-28 03:24:53,560][106226] Updated weights for policy 0, policy_version 1134915 (0.0008) [2023-12-28 03:24:53,622][106226] Updated weights for policy 0, policy_version 1134925 (0.0007) [2023-12-28 03:24:53,685][106226] Updated weights for policy 0, policy_version 1134935 (0.0009) [2023-12-28 03:24:54,193][106225] Updated weights for policy 1, policy_version 1137873 (0.0007) [2023-12-28 03:24:54,248][106225] Updated weights for policy 1, policy_version 1137883 (0.0009) [2023-12-28 03:24:54,299][106225] Updated weights for policy 1, policy_version 1137893 (0.0009) [2023-12-28 03:24:54,350][106225] Updated weights for policy 1, policy_version 1137903 (0.0008) [2023-12-28 03:24:54,388][106226] Updated weights for policy 0, policy_version 1134945 (0.0009) [2023-12-28 03:24:54,442][106226] Updated weights for policy 0, policy_version 1134955 (0.0010) [2023-12-28 03:24:54,502][106226] Updated weights for policy 0, policy_version 1134965 (0.0010) [2023-12-28 03:24:55,073][106226] Updated weights for policy 0, policy_version 1134975 (0.0009) [2023-12-28 03:24:55,106][106225] Updated weights for policy 1, policy_version 1137913 (0.0008) [2023-12-28 03:24:55,136][106226] Updated weights for policy 0, policy_version 1134985 (0.0007) [2023-12-28 03:24:55,151][106225] Updated weights for policy 1, policy_version 1137923 (0.0007) [2023-12-28 03:24:55,191][106226] Updated weights for policy 0, policy_version 1134995 (0.0010) [2023-12-28 03:24:55,202][106225] Updated weights for policy 1, policy_version 1137933 (0.0008) [2023-12-28 03:24:55,826][106225] Updated weights for policy 1, policy_version 1137943 (0.0007) [2023-12-28 03:24:55,878][106225] Updated weights for policy 1, policy_version 1137953 (0.0007) [2023-12-28 03:24:55,891][106226] Updated weights for policy 0, policy_version 1135005 (0.0010) [2023-12-28 03:24:55,932][106225] Updated weights for policy 1, policy_version 1137963 (0.0007) [2023-12-28 03:24:55,950][106226] Updated weights for policy 0, policy_version 1135015 (0.0010) [2023-12-28 03:24:56,009][106226] Updated weights for policy 0, policy_version 1135025 (0.0005) [2023-12-28 03:24:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 581992448. Throughput: 0: 9796.8, 1: 10064.5. Samples: 581955536. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:24:56,176][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.618')] [2023-12-28 03:24:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001137968_291364864.pth... [2023-12-28 03:24:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001135032_290627584.pth... [2023-12-28 03:24:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001136784_291061760.pth [2023-12-28 03:24:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001133880_290332672.pth [2023-12-28 03:24:56,610][106225] Updated weights for policy 1, policy_version 1137973 (0.0008) [2023-12-28 03:24:56,636][106226] Updated weights for policy 0, policy_version 1135035 (0.0007) [2023-12-28 03:24:56,668][106225] Updated weights for policy 1, policy_version 1137983 (0.0007) [2023-12-28 03:24:56,686][106226] Updated weights for policy 0, policy_version 1135045 (0.0010) [2023-12-28 03:24:56,712][106225] Updated weights for policy 1, policy_version 1137993 (0.0005) [2023-12-28 03:24:56,738][106226] Updated weights for policy 0, policy_version 1135055 (0.0010) [2023-12-28 03:24:57,326][106225] Updated weights for policy 1, policy_version 1138003 (0.0006) [2023-12-28 03:24:57,386][106225] Updated weights for policy 1, policy_version 1138013 (0.0008) [2023-12-28 03:24:57,446][106225] Updated weights for policy 1, policy_version 1138023 (0.0009) [2023-12-28 03:24:57,471][106226] Updated weights for policy 0, policy_version 1135065 (0.0010) [2023-12-28 03:24:57,519][106226] Updated weights for policy 0, policy_version 1135075 (0.0005) [2023-12-28 03:24:57,565][106226] Updated weights for policy 0, policy_version 1135085 (0.0005) [2023-12-28 03:24:57,622][106226] Updated weights for policy 0, policy_version 1135095 (0.0007) [2023-12-28 03:24:58,175][106225] Updated weights for policy 1, policy_version 1138033 (0.0009) [2023-12-28 03:24:58,233][106225] Updated weights for policy 1, policy_version 1138043 (0.0008) [2023-12-28 03:24:58,295][106225] Updated weights for policy 1, policy_version 1138053 (0.0006) [2023-12-28 03:24:58,324][106226] Updated weights for policy 0, policy_version 1135105 (0.0007) [2023-12-28 03:24:58,360][106225] Updated weights for policy 1, policy_version 1138063 (0.0008) [2023-12-28 03:24:58,393][106226] Updated weights for policy 0, policy_version 1135115 (0.0008) [2023-12-28 03:24:58,456][106226] Updated weights for policy 0, policy_version 1135125 (0.0008) [2023-12-28 03:24:59,191][106225] Updated weights for policy 1, policy_version 1138073 (0.0008) [2023-12-28 03:24:59,260][106225] Updated weights for policy 1, policy_version 1138083 (0.0008) [2023-12-28 03:24:59,327][106225] Updated weights for policy 1, policy_version 1138093 (0.0007) [2023-12-28 03:24:59,355][106226] Updated weights for policy 0, policy_version 1135135 (0.0009) [2023-12-28 03:24:59,419][106226] Updated weights for policy 0, policy_version 1135145 (0.0010) [2023-12-28 03:24:59,479][106226] Updated weights for policy 0, policy_version 1135155 (0.0010) [2023-12-28 03:25:00,113][106225] Updated weights for policy 1, policy_version 1138103 (0.0006) [2023-12-28 03:25:00,175][106225] Updated weights for policy 1, policy_version 1138113 (0.0006) [2023-12-28 03:25:00,214][106226] Updated weights for policy 0, policy_version 1135165 (0.0011) [2023-12-28 03:25:00,239][106225] Updated weights for policy 1, policy_version 1138123 (0.0008) [2023-12-28 03:25:00,274][106226] Updated weights for policy 0, policy_version 1135175 (0.0010) [2023-12-28 03:25:00,335][106226] Updated weights for policy 0, policy_version 1135185 (0.0011) [2023-12-28 03:25:00,918][106225] Updated weights for policy 1, policy_version 1138133 (0.0006) [2023-12-28 03:25:00,964][106225] Updated weights for policy 1, policy_version 1138143 (0.0007) [2023-12-28 03:25:01,026][106225] Updated weights for policy 1, policy_version 1138153 (0.0008) [2023-12-28 03:25:01,046][106226] Updated weights for policy 0, policy_version 1135195 (0.0011) [2023-12-28 03:25:01,111][106226] Updated weights for policy 0, policy_version 1135205 (0.0011) [2023-12-28 03:25:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 582082560. Throughput: 0: 9806.0, 1: 10123.1. Samples: 582073896. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:25:01,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-4.932')] [2023-12-28 03:25:01,178][106226] Updated weights for policy 0, policy_version 1135215 (0.0010) [2023-12-28 03:25:01,799][106225] Updated weights for policy 1, policy_version 1138163 (0.0010) [2023-12-28 03:25:01,864][106225] Updated weights for policy 1, policy_version 1138173 (0.0009) [2023-12-28 03:25:01,896][106226] Updated weights for policy 0, policy_version 1135225 (0.0010) [2023-12-28 03:25:01,924][106225] Updated weights for policy 1, policy_version 1138183 (0.0009) [2023-12-28 03:25:01,943][106226] Updated weights for policy 0, policy_version 1135235 (0.0005) [2023-12-28 03:25:01,991][106226] Updated weights for policy 0, policy_version 1135245 (0.0006) [2023-12-28 03:25:02,042][106226] Updated weights for policy 0, policy_version 1135255 (0.0006) [2023-12-28 03:25:02,644][106226] Updated weights for policy 0, policy_version 1135265 (0.0005) [2023-12-28 03:25:02,708][106226] Updated weights for policy 0, policy_version 1135275 (0.0007) [2023-12-28 03:25:02,756][106225] Updated weights for policy 1, policy_version 1138193 (0.0008) [2023-12-28 03:25:02,770][106226] Updated weights for policy 0, policy_version 1135285 (0.0007) [2023-12-28 03:25:02,814][106225] Updated weights for policy 1, policy_version 1138203 (0.0009) [2023-12-28 03:25:02,863][106225] Updated weights for policy 1, policy_version 1138213 (0.0008) [2023-12-28 03:25:02,925][106225] Updated weights for policy 1, policy_version 1138223 (0.0009) [2023-12-28 03:25:03,393][106226] Updated weights for policy 0, policy_version 1135295 (0.0006) [2023-12-28 03:25:03,447][106226] Updated weights for policy 0, policy_version 1135305 (0.0006) [2023-12-28 03:25:03,499][106226] Updated weights for policy 0, policy_version 1135315 (0.0008) [2023-12-28 03:25:03,663][106225] Updated weights for policy 1, policy_version 1138233 (0.0006) [2023-12-28 03:25:03,715][106225] Updated weights for policy 1, policy_version 1138243 (0.0005) [2023-12-28 03:25:03,771][106225] Updated weights for policy 1, policy_version 1138253 (0.0005) [2023-12-28 03:25:04,239][106226] Updated weights for policy 0, policy_version 1135325 (0.0008) [2023-12-28 03:25:04,296][106226] Updated weights for policy 0, policy_version 1135335 (0.0005) [2023-12-28 03:25:04,334][106225] Updated weights for policy 1, policy_version 1138263 (0.0008) [2023-12-28 03:25:04,358][106226] Updated weights for policy 0, policy_version 1135345 (0.0005) [2023-12-28 03:25:04,395][106225] Updated weights for policy 1, policy_version 1138273 (0.0008) [2023-12-28 03:25:04,462][106225] Updated weights for policy 1, policy_version 1138283 (0.0008) [2023-12-28 03:25:04,901][106226] Updated weights for policy 0, policy_version 1135355 (0.0007) [2023-12-28 03:25:04,970][106226] Updated weights for policy 0, policy_version 1135365 (0.0005) [2023-12-28 03:25:05,033][106226] Updated weights for policy 0, policy_version 1135375 (0.0007) [2023-12-28 03:25:05,143][106225] Updated weights for policy 1, policy_version 1138293 (0.0008) [2023-12-28 03:25:05,200][106225] Updated weights for policy 1, policy_version 1138303 (0.0008) [2023-12-28 03:25:05,254][106225] Updated weights for policy 1, policy_version 1138313 (0.0008) [2023-12-28 03:25:05,692][106226] Updated weights for policy 0, policy_version 1135385 (0.0008) [2023-12-28 03:25:05,761][106226] Updated weights for policy 0, policy_version 1135395 (0.0008) [2023-12-28 03:25:05,826][106226] Updated weights for policy 0, policy_version 1135405 (0.0008) [2023-12-28 03:25:05,889][106225] Updated weights for policy 1, policy_version 1138323 (0.0006) [2023-12-28 03:25:05,891][106226] Updated weights for policy 0, policy_version 1135415 (0.0006) [2023-12-28 03:25:05,944][106225] Updated weights for policy 1, policy_version 1138333 (0.0006) [2023-12-28 03:25:06,003][106225] Updated weights for policy 1, policy_version 1138343 (0.0009) [2023-12-28 03:25:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 582189056. Throughput: 0: 9841.4, 1: 10117.3. Samples: 582195552. Policy #0 lag: (min: 5.0, avg: 7.1, max: 35.0) [2023-12-28 03:25:06,176][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.847')] [2023-12-28 03:25:06,562][106226] Updated weights for policy 0, policy_version 1135425 (0.0006) [2023-12-28 03:25:06,620][106226] Updated weights for policy 0, policy_version 1135435 (0.0005) [2023-12-28 03:25:06,682][106226] Updated weights for policy 0, policy_version 1135445 (0.0006) [2023-12-28 03:25:06,756][106225] Updated weights for policy 1, policy_version 1138353 (0.0009) [2023-12-28 03:25:06,821][106225] Updated weights for policy 1, policy_version 1138363 (0.0008) [2023-12-28 03:25:06,885][106225] Updated weights for policy 1, policy_version 1138373 (0.0009) [2023-12-28 03:25:06,946][106225] Updated weights for policy 1, policy_version 1138383 (0.0009) [2023-12-28 03:25:07,369][106226] Updated weights for policy 0, policy_version 1135455 (0.0006) [2023-12-28 03:25:07,418][106226] Updated weights for policy 0, policy_version 1135465 (0.0005) [2023-12-28 03:25:07,472][106226] Updated weights for policy 0, policy_version 1135475 (0.0006) [2023-12-28 03:25:07,732][106225] Updated weights for policy 1, policy_version 1138393 (0.0009) [2023-12-28 03:25:07,789][106225] Updated weights for policy 1, policy_version 1138403 (0.0008) [2023-12-28 03:25:07,843][106225] Updated weights for policy 1, policy_version 1138413 (0.0009) [2023-12-28 03:25:08,038][106226] Updated weights for policy 0, policy_version 1135485 (0.0008) [2023-12-28 03:25:08,102][106226] Updated weights for policy 0, policy_version 1135495 (0.0007) [2023-12-28 03:25:08,156][106226] Updated weights for policy 0, policy_version 1135505 (0.0008) [2023-12-28 03:25:08,635][106225] Updated weights for policy 1, policy_version 1138423 (0.0009) [2023-12-28 03:25:08,696][106225] Updated weights for policy 1, policy_version 1138433 (0.0009) [2023-12-28 03:25:08,756][106225] Updated weights for policy 1, policy_version 1138443 (0.0009) [2023-12-28 03:25:08,896][106226] Updated weights for policy 0, policy_version 1135515 (0.0008) [2023-12-28 03:25:08,945][106226] Updated weights for policy 0, policy_version 1135525 (0.0008) [2023-12-28 03:25:09,002][106226] Updated weights for policy 0, policy_version 1135535 (0.0008) [2023-12-28 03:25:09,449][106225] Updated weights for policy 1, policy_version 1138453 (0.0008) [2023-12-28 03:25:09,520][106225] Updated weights for policy 1, policy_version 1138463 (0.0005) [2023-12-28 03:25:09,585][106225] Updated weights for policy 1, policy_version 1138473 (0.0008) [2023-12-28 03:25:09,798][106226] Updated weights for policy 0, policy_version 1135545 (0.0010) [2023-12-28 03:25:09,865][106226] Updated weights for policy 0, policy_version 1135555 (0.0007) [2023-12-28 03:25:09,922][106226] Updated weights for policy 0, policy_version 1135565 (0.0009) [2023-12-28 03:25:09,985][106226] Updated weights for policy 0, policy_version 1135575 (0.0010) [2023-12-28 03:25:10,253][106225] Updated weights for policy 1, policy_version 1138483 (0.0009) [2023-12-28 03:25:10,313][106225] Updated weights for policy 1, policy_version 1138493 (0.0009) [2023-12-28 03:25:10,375][106225] Updated weights for policy 1, policy_version 1138503 (0.0006) [2023-12-28 03:25:10,750][106226] Updated weights for policy 0, policy_version 1135585 (0.0007) [2023-12-28 03:25:10,807][106226] Updated weights for policy 0, policy_version 1135595 (0.0006) [2023-12-28 03:25:10,853][106226] Updated weights for policy 0, policy_version 1135605 (0.0005) [2023-12-28 03:25:11,119][106225] Updated weights for policy 1, policy_version 1138513 (0.0006) [2023-12-28 03:25:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 582279168. Throughput: 0: 9913.4, 1: 10020.7. Samples: 582253228. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:11,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.976')] [2023-12-28 03:25:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001135608_290775040.pth... [2023-12-28 03:25:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001134456_290480128.pth [2023-12-28 03:25:11,184][106225] Updated weights for policy 1, policy_version 1138523 (0.0009) [2023-12-28 03:25:11,242][106225] Updated weights for policy 1, policy_version 1138533 (0.0009) [2023-12-28 03:25:11,311][106225] Updated weights for policy 1, policy_version 1138543 (0.0008) [2023-12-28 03:25:11,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001138544_291512320.pth... [2023-12-28 03:25:11,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001137392_291217408.pth [2023-12-28 03:25:11,545][106226] Updated weights for policy 0, policy_version 1135615 (0.0008) [2023-12-28 03:25:11,607][106226] Updated weights for policy 0, policy_version 1135625 (0.0009) [2023-12-28 03:25:11,678][106226] Updated weights for policy 0, policy_version 1135635 (0.0009) [2023-12-28 03:25:12,054][106225] Updated weights for policy 1, policy_version 1138553 (0.0008) [2023-12-28 03:25:12,117][106225] Updated weights for policy 1, policy_version 1138563 (0.0009) [2023-12-28 03:25:12,173][106225] Updated weights for policy 1, policy_version 1138573 (0.0008) [2023-12-28 03:25:12,432][106226] Updated weights for policy 0, policy_version 1135645 (0.0008) [2023-12-28 03:25:12,489][106226] Updated weights for policy 0, policy_version 1135655 (0.0009) [2023-12-28 03:25:12,551][106226] Updated weights for policy 0, policy_version 1135665 (0.0007) [2023-12-28 03:25:12,922][106225] Updated weights for policy 1, policy_version 1138583 (0.0009) [2023-12-28 03:25:12,989][106225] Updated weights for policy 1, policy_version 1138593 (0.0007) [2023-12-28 03:25:13,047][106225] Updated weights for policy 1, policy_version 1138603 (0.0008) [2023-12-28 03:25:13,315][106226] Updated weights for policy 0, policy_version 1135675 (0.0007) [2023-12-28 03:25:13,379][106226] Updated weights for policy 0, policy_version 1135685 (0.0008) [2023-12-28 03:25:13,447][106226] Updated weights for policy 0, policy_version 1135695 (0.0008) [2023-12-28 03:25:13,717][106225] Updated weights for policy 1, policy_version 1138613 (0.0007) [2023-12-28 03:25:13,764][106225] Updated weights for policy 1, policy_version 1138623 (0.0005) [2023-12-28 03:25:13,813][106225] Updated weights for policy 1, policy_version 1138633 (0.0007) [2023-12-28 03:25:14,189][106226] Updated weights for policy 0, policy_version 1135705 (0.0008) [2023-12-28 03:25:14,246][106226] Updated weights for policy 0, policy_version 1135715 (0.0008) [2023-12-28 03:25:14,309][106226] Updated weights for policy 0, policy_version 1135725 (0.0007) [2023-12-28 03:25:14,374][106226] Updated weights for policy 0, policy_version 1135735 (0.0008) [2023-12-28 03:25:14,539][106225] Updated weights for policy 1, policy_version 1138643 (0.0010) [2023-12-28 03:25:14,596][106225] Updated weights for policy 1, policy_version 1138653 (0.0010) [2023-12-28 03:25:14,660][106225] Updated weights for policy 1, policy_version 1138663 (0.0010) [2023-12-28 03:25:15,107][106226] Updated weights for policy 0, policy_version 1135745 (0.0008) [2023-12-28 03:25:15,172][106226] Updated weights for policy 0, policy_version 1135755 (0.0007) [2023-12-28 03:25:15,237][106226] Updated weights for policy 0, policy_version 1135765 (0.0008) [2023-12-28 03:25:15,360][106225] Updated weights for policy 1, policy_version 1138673 (0.0010) [2023-12-28 03:25:15,425][106225] Updated weights for policy 1, policy_version 1138683 (0.0010) [2023-12-28 03:25:15,484][106225] Updated weights for policy 1, policy_version 1138693 (0.0010) [2023-12-28 03:25:15,538][106225] Updated weights for policy 1, policy_version 1138703 (0.0010) [2023-12-28 03:25:15,964][106226] Updated weights for policy 0, policy_version 1135775 (0.0008) [2023-12-28 03:25:16,022][106226] Updated weights for policy 0, policy_version 1135785 (0.0007) [2023-12-28 03:25:16,082][106226] Updated weights for policy 0, policy_version 1135795 (0.0007) [2023-12-28 03:25:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 582377472. Throughput: 0: 9837.8, 1: 9896.1. Samples: 582367228. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:16,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-5.006')] [2023-12-28 03:25:16,252][106225] Updated weights for policy 1, policy_version 1138713 (0.0010) [2023-12-28 03:25:16,296][106225] Updated weights for policy 1, policy_version 1138723 (0.0010) [2023-12-28 03:25:16,347][106225] Updated weights for policy 1, policy_version 1138733 (0.0010) [2023-12-28 03:25:16,791][106226] Updated weights for policy 0, policy_version 1135805 (0.0008) [2023-12-28 03:25:16,851][106226] Updated weights for policy 0, policy_version 1135815 (0.0008) [2023-12-28 03:25:16,914][106226] Updated weights for policy 0, policy_version 1135825 (0.0007) [2023-12-28 03:25:17,093][106225] Updated weights for policy 1, policy_version 1138743 (0.0010) [2023-12-28 03:25:17,151][106225] Updated weights for policy 1, policy_version 1138753 (0.0010) [2023-12-28 03:25:17,203][106225] Updated weights for policy 1, policy_version 1138763 (0.0010) [2023-12-28 03:25:17,517][106226] Updated weights for policy 0, policy_version 1135835 (0.0007) [2023-12-28 03:25:17,586][106226] Updated weights for policy 0, policy_version 1135845 (0.0005) [2023-12-28 03:25:17,649][106226] Updated weights for policy 0, policy_version 1135855 (0.0005) [2023-12-28 03:25:17,822][106225] Updated weights for policy 1, policy_version 1138773 (0.0008) [2023-12-28 03:25:17,886][106225] Updated weights for policy 1, policy_version 1138783 (0.0007) [2023-12-28 03:25:17,937][106225] Updated weights for policy 1, policy_version 1138793 (0.0010) [2023-12-28 03:25:18,179][106226] Updated weights for policy 0, policy_version 1135865 (0.0010) [2023-12-28 03:25:18,242][106226] Updated weights for policy 0, policy_version 1135875 (0.0005) [2023-12-28 03:25:18,309][106226] Updated weights for policy 0, policy_version 1135885 (0.0008) [2023-12-28 03:25:18,375][106226] Updated weights for policy 0, policy_version 1135895 (0.0009) [2023-12-28 03:25:18,629][106225] Updated weights for policy 1, policy_version 1138803 (0.0010) [2023-12-28 03:25:18,687][106225] Updated weights for policy 1, policy_version 1138813 (0.0010) [2023-12-28 03:25:18,751][106225] Updated weights for policy 1, policy_version 1138823 (0.0010) [2023-12-28 03:25:19,035][106226] Updated weights for policy 0, policy_version 1135905 (0.0010) [2023-12-28 03:25:19,088][106226] Updated weights for policy 0, policy_version 1135915 (0.0010) [2023-12-28 03:25:19,137][106226] Updated weights for policy 0, policy_version 1135925 (0.0010) [2023-12-28 03:25:19,486][106225] Updated weights for policy 1, policy_version 1138833 (0.0010) [2023-12-28 03:25:19,554][106225] Updated weights for policy 1, policy_version 1138843 (0.0008) [2023-12-28 03:25:19,620][106225] Updated weights for policy 1, policy_version 1138853 (0.0008) [2023-12-28 03:25:19,683][106225] Updated weights for policy 1, policy_version 1138863 (0.0009) [2023-12-28 03:25:19,872][106226] Updated weights for policy 0, policy_version 1135935 (0.0008) [2023-12-28 03:25:19,942][106226] Updated weights for policy 0, policy_version 1135945 (0.0009) [2023-12-28 03:25:20,011][106226] Updated weights for policy 0, policy_version 1135955 (0.0011) [2023-12-28 03:25:20,400][106225] Updated weights for policy 1, policy_version 1138873 (0.0008) [2023-12-28 03:25:20,468][106225] Updated weights for policy 1, policy_version 1138883 (0.0010) [2023-12-28 03:25:20,523][106225] Updated weights for policy 1, policy_version 1138893 (0.0009) [2023-12-28 03:25:20,742][106226] Updated weights for policy 0, policy_version 1135965 (0.0009) [2023-12-28 03:25:20,800][106226] Updated weights for policy 0, policy_version 1135975 (0.0008) [2023-12-28 03:25:20,866][106226] Updated weights for policy 0, policy_version 1135985 (0.0009) [2023-12-28 03:25:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 582475776. Throughput: 0: 9888.4, 1: 9828.6. Samples: 582485404. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:21,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.877')] [2023-12-28 03:25:21,327][106225] Updated weights for policy 1, policy_version 1138903 (0.0007) [2023-12-28 03:25:21,401][106225] Updated weights for policy 1, policy_version 1138913 (0.0008) [2023-12-28 03:25:21,453][106225] Updated weights for policy 1, policy_version 1138923 (0.0008) [2023-12-28 03:25:21,617][106226] Updated weights for policy 0, policy_version 1135995 (0.0008) [2023-12-28 03:25:21,689][106226] Updated weights for policy 0, policy_version 1136005 (0.0007) [2023-12-28 03:25:21,759][106226] Updated weights for policy 0, policy_version 1136015 (0.0008) [2023-12-28 03:25:22,197][106225] Updated weights for policy 1, policy_version 1138933 (0.0007) [2023-12-28 03:25:22,259][106225] Updated weights for policy 1, policy_version 1138943 (0.0009) [2023-12-28 03:25:22,317][106225] Updated weights for policy 1, policy_version 1138953 (0.0009) [2023-12-28 03:25:22,349][106226] Updated weights for policy 0, policy_version 1136025 (0.0006) [2023-12-28 03:25:22,426][106226] Updated weights for policy 0, policy_version 1136035 (0.0008) [2023-12-28 03:25:22,496][106226] Updated weights for policy 0, policy_version 1136045 (0.0006) [2023-12-28 03:25:22,565][106226] Updated weights for policy 0, policy_version 1136055 (0.0007) [2023-12-28 03:25:23,083][106225] Updated weights for policy 1, policy_version 1138963 (0.0008) [2023-12-28 03:25:23,144][106225] Updated weights for policy 1, policy_version 1138973 (0.0008) [2023-12-28 03:25:23,162][106226] Updated weights for policy 0, policy_version 1136065 (0.0007) [2023-12-28 03:25:23,200][106225] Updated weights for policy 1, policy_version 1138983 (0.0007) [2023-12-28 03:25:23,225][106226] Updated weights for policy 0, policy_version 1136075 (0.0006) [2023-12-28 03:25:23,281][106226] Updated weights for policy 0, policy_version 1136085 (0.0007) [2023-12-28 03:25:23,868][106225] Updated weights for policy 1, policy_version 1138993 (0.0008) [2023-12-28 03:25:23,930][106225] Updated weights for policy 1, policy_version 1139003 (0.0005) [2023-12-28 03:25:23,980][106225] Updated weights for policy 1, policy_version 1139013 (0.0005) [2023-12-28 03:25:24,007][106226] Updated weights for policy 0, policy_version 1136095 (0.0010) [2023-12-28 03:25:24,038][106225] Updated weights for policy 1, policy_version 1139023 (0.0007) [2023-12-28 03:25:24,057][106226] Updated weights for policy 0, policy_version 1136105 (0.0010) [2023-12-28 03:25:24,121][106226] Updated weights for policy 0, policy_version 1136115 (0.0010) [2023-12-28 03:25:24,580][106225] Updated weights for policy 1, policy_version 1139033 (0.0010) [2023-12-28 03:25:24,637][106225] Updated weights for policy 1, policy_version 1139043 (0.0010) [2023-12-28 03:25:24,684][106225] Updated weights for policy 1, policy_version 1139053 (0.0008) [2023-12-28 03:25:24,827][106226] Updated weights for policy 0, policy_version 1136125 (0.0010) [2023-12-28 03:25:24,877][106226] Updated weights for policy 0, policy_version 1136135 (0.0010) [2023-12-28 03:25:24,924][106226] Updated weights for policy 0, policy_version 1136145 (0.0010) [2023-12-28 03:25:25,288][106225] Updated weights for policy 1, policy_version 1139063 (0.0009) [2023-12-28 03:25:25,343][106225] Updated weights for policy 1, policy_version 1139073 (0.0010) [2023-12-28 03:25:25,399][106225] Updated weights for policy 1, policy_version 1139083 (0.0010) [2023-12-28 03:25:25,631][106226] Updated weights for policy 0, policy_version 1136155 (0.0010) [2023-12-28 03:25:25,690][106226] Updated weights for policy 0, policy_version 1136165 (0.0010) [2023-12-28 03:25:25,762][106226] Updated weights for policy 0, policy_version 1136175 (0.0011) [2023-12-28 03:25:26,012][106225] Updated weights for policy 1, policy_version 1139093 (0.0008) [2023-12-28 03:25:26,065][106225] Updated weights for policy 1, policy_version 1139103 (0.0005) [2023-12-28 03:25:26,122][106225] Updated weights for policy 1, policy_version 1139113 (0.0006) [2023-12-28 03:25:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 582582272. Throughput: 0: 9852.3, 1: 9756.0. Samples: 582543612. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:26,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.586')] [2023-12-28 03:25:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001136184_290922496.pth... [2023-12-28 03:25:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001139120_291659776.pth... [2023-12-28 03:25:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001135032_290627584.pth [2023-12-28 03:25:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001137968_291364864.pth [2023-12-28 03:25:26,384][106226] Updated weights for policy 0, policy_version 1136185 (0.0011) [2023-12-28 03:25:26,437][106226] Updated weights for policy 0, policy_version 1136195 (0.0010) [2023-12-28 03:25:26,487][106226] Updated weights for policy 0, policy_version 1136205 (0.0010) [2023-12-28 03:25:26,536][106226] Updated weights for policy 0, policy_version 1136215 (0.0010) [2023-12-28 03:25:26,663][106225] Updated weights for policy 1, policy_version 1139123 (0.0007) [2023-12-28 03:25:26,731][106225] Updated weights for policy 1, policy_version 1139133 (0.0010) [2023-12-28 03:25:26,786][106225] Updated weights for policy 1, policy_version 1139143 (0.0010) [2023-12-28 03:25:27,270][106226] Updated weights for policy 0, policy_version 1136225 (0.0011) [2023-12-28 03:25:27,337][106226] Updated weights for policy 0, policy_version 1136235 (0.0011) [2023-12-28 03:25:27,401][106226] Updated weights for policy 0, policy_version 1136245 (0.0010) [2023-12-28 03:25:27,480][106225] Updated weights for policy 1, policy_version 1139153 (0.0010) [2023-12-28 03:25:27,529][106225] Updated weights for policy 1, policy_version 1139163 (0.0005) [2023-12-28 03:25:27,594][106225] Updated weights for policy 1, policy_version 1139173 (0.0005) [2023-12-28 03:25:27,653][106225] Updated weights for policy 1, policy_version 1139183 (0.0007) [2023-12-28 03:25:28,097][106226] Updated weights for policy 0, policy_version 1136255 (0.0011) [2023-12-28 03:25:28,160][106226] Updated weights for policy 0, policy_version 1136265 (0.0010) [2023-12-28 03:25:28,231][106226] Updated weights for policy 0, policy_version 1136275 (0.0008) [2023-12-28 03:25:28,272][106225] Updated weights for policy 1, policy_version 1139193 (0.0007) [2023-12-28 03:25:28,335][106225] Updated weights for policy 1, policy_version 1139203 (0.0009) [2023-12-28 03:25:28,399][106225] Updated weights for policy 1, policy_version 1139213 (0.0008) [2023-12-28 03:25:28,832][106226] Updated weights for policy 0, policy_version 1136285 (0.0007) [2023-12-28 03:25:28,887][106226] Updated weights for policy 0, policy_version 1136295 (0.0007) [2023-12-28 03:25:28,937][106226] Updated weights for policy 0, policy_version 1136305 (0.0008) [2023-12-28 03:25:29,174][106225] Updated weights for policy 1, policy_version 1139223 (0.0007) [2023-12-28 03:25:29,241][106225] Updated weights for policy 1, policy_version 1139233 (0.0006) [2023-12-28 03:25:29,304][106225] Updated weights for policy 1, policy_version 1139243 (0.0009) [2023-12-28 03:25:29,641][106226] Updated weights for policy 0, policy_version 1136315 (0.0008) [2023-12-28 03:25:29,701][106226] Updated weights for policy 0, policy_version 1136325 (0.0008) [2023-12-28 03:25:29,766][106226] Updated weights for policy 0, policy_version 1136335 (0.0008) [2023-12-28 03:25:29,958][106225] Updated weights for policy 1, policy_version 1139253 (0.0009) [2023-12-28 03:25:30,023][106225] Updated weights for policy 1, policy_version 1139263 (0.0008) [2023-12-28 03:25:30,094][106225] Updated weights for policy 1, policy_version 1139273 (0.0009) [2023-12-28 03:25:30,430][106226] Updated weights for policy 0, policy_version 1136345 (0.0009) [2023-12-28 03:25:30,480][106226] Updated weights for policy 0, policy_version 1136355 (0.0007) [2023-12-28 03:25:30,533][106226] Updated weights for policy 0, policy_version 1136365 (0.0008) [2023-12-28 03:25:30,596][106226] Updated weights for policy 0, policy_version 1136375 (0.0008) [2023-12-28 03:25:30,794][106225] Updated weights for policy 1, policy_version 1139283 (0.0008) [2023-12-28 03:25:30,845][106225] Updated weights for policy 1, policy_version 1139293 (0.0009) [2023-12-28 03:25:30,902][106225] Updated weights for policy 1, policy_version 1139303 (0.0005) [2023-12-28 03:25:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 582680576. Throughput: 0: 9886.1, 1: 9883.1. Samples: 582669116. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:31,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.517')] [2023-12-28 03:25:31,306][106226] Updated weights for policy 0, policy_version 1136385 (0.0007) [2023-12-28 03:25:31,367][106226] Updated weights for policy 0, policy_version 1136395 (0.0008) [2023-12-28 03:25:31,423][106226] Updated weights for policy 0, policy_version 1136405 (0.0007) [2023-12-28 03:25:31,626][106225] Updated weights for policy 1, policy_version 1139313 (0.0006) [2023-12-28 03:25:31,680][106225] Updated weights for policy 1, policy_version 1139323 (0.0009) [2023-12-28 03:25:31,744][106225] Updated weights for policy 1, policy_version 1139333 (0.0010) [2023-12-28 03:25:31,811][106225] Updated weights for policy 1, policy_version 1139343 (0.0008) [2023-12-28 03:25:32,089][106226] Updated weights for policy 0, policy_version 1136415 (0.0007) [2023-12-28 03:25:32,155][106226] Updated weights for policy 0, policy_version 1136425 (0.0005) [2023-12-28 03:25:32,215][106226] Updated weights for policy 0, policy_version 1136435 (0.0007) [2023-12-28 03:25:32,544][106225] Updated weights for policy 1, policy_version 1139353 (0.0008) [2023-12-28 03:25:32,592][106225] Updated weights for policy 1, policy_version 1139363 (0.0006) [2023-12-28 03:25:32,646][106225] Updated weights for policy 1, policy_version 1139373 (0.0005) [2023-12-28 03:25:32,835][106226] Updated weights for policy 0, policy_version 1136445 (0.0009) [2023-12-28 03:25:32,884][106226] Updated weights for policy 0, policy_version 1136455 (0.0009) [2023-12-28 03:25:32,940][106226] Updated weights for policy 0, policy_version 1136465 (0.0009) [2023-12-28 03:25:33,265][106225] Updated weights for policy 1, policy_version 1139383 (0.0006) [2023-12-28 03:25:33,323][106225] Updated weights for policy 1, policy_version 1139393 (0.0008) [2023-12-28 03:25:33,372][106225] Updated weights for policy 1, policy_version 1139403 (0.0008) [2023-12-28 03:25:33,678][106226] Updated weights for policy 0, policy_version 1136475 (0.0009) [2023-12-28 03:25:33,735][106226] Updated weights for policy 0, policy_version 1136485 (0.0008) [2023-12-28 03:25:33,797][106226] Updated weights for policy 0, policy_version 1136495 (0.0008) [2023-12-28 03:25:34,063][106225] Updated weights for policy 1, policy_version 1139413 (0.0009) [2023-12-28 03:25:34,120][106225] Updated weights for policy 1, policy_version 1139423 (0.0010) [2023-12-28 03:25:34,196][106225] Updated weights for policy 1, policy_version 1139433 (0.0011) [2023-12-28 03:25:34,562][106226] Updated weights for policy 0, policy_version 1136505 (0.0008) [2023-12-28 03:25:34,649][106226] Updated weights for policy 0, policy_version 1136515 (0.0009) [2023-12-28 03:25:34,700][106226] Updated weights for policy 0, policy_version 1136525 (0.0008) [2023-12-28 03:25:34,754][106226] Updated weights for policy 0, policy_version 1136535 (0.0007) [2023-12-28 03:25:34,911][106225] Updated weights for policy 1, policy_version 1139443 (0.0010) [2023-12-28 03:25:34,964][106225] Updated weights for policy 1, policy_version 1139453 (0.0010) [2023-12-28 03:25:35,021][106225] Updated weights for policy 1, policy_version 1139463 (0.0010) [2023-12-28 03:25:35,474][106226] Updated weights for policy 0, policy_version 1136545 (0.0008) [2023-12-28 03:25:35,537][106226] Updated weights for policy 0, policy_version 1136555 (0.0008) [2023-12-28 03:25:35,598][106226] Updated weights for policy 0, policy_version 1136565 (0.0008) [2023-12-28 03:25:35,743][106225] Updated weights for policy 1, policy_version 1139473 (0.0010) [2023-12-28 03:25:35,798][106225] Updated weights for policy 1, policy_version 1139483 (0.0010) [2023-12-28 03:25:35,848][106225] Updated weights for policy 1, policy_version 1139493 (0.0010) [2023-12-28 03:25:35,894][106225] Updated weights for policy 1, policy_version 1139503 (0.0010) [2023-12-28 03:25:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 582778880. Throughput: 0: 9926.0, 1: 9846.2. Samples: 582788112. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:36,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.883')] [2023-12-28 03:25:36,320][106226] Updated weights for policy 0, policy_version 1136575 (0.0008) [2023-12-28 03:25:36,382][106226] Updated weights for policy 0, policy_version 1136585 (0.0008) [2023-12-28 03:25:36,444][106226] Updated weights for policy 0, policy_version 1136595 (0.0008) [2023-12-28 03:25:36,681][106225] Updated weights for policy 1, policy_version 1139513 (0.0011) [2023-12-28 03:25:36,745][106225] Updated weights for policy 1, policy_version 1139523 (0.0011) [2023-12-28 03:25:36,804][106225] Updated weights for policy 1, policy_version 1139533 (0.0009) [2023-12-28 03:25:37,217][106226] Updated weights for policy 0, policy_version 1136605 (0.0009) [2023-12-28 03:25:37,271][106226] Updated weights for policy 0, policy_version 1136615 (0.0008) [2023-12-28 03:25:37,326][106226] Updated weights for policy 0, policy_version 1136625 (0.0008) [2023-12-28 03:25:37,484][106225] Updated weights for policy 1, policy_version 1139543 (0.0009) [2023-12-28 03:25:37,539][106225] Updated weights for policy 1, policy_version 1139553 (0.0010) [2023-12-28 03:25:37,597][106225] Updated weights for policy 1, policy_version 1139563 (0.0010) [2023-12-28 03:25:38,094][106226] Updated weights for policy 0, policy_version 1136635 (0.0008) [2023-12-28 03:25:38,143][106226] Updated weights for policy 0, policy_version 1136645 (0.0008) [2023-12-28 03:25:38,207][106226] Updated weights for policy 0, policy_version 1136655 (0.0009) [2023-12-28 03:25:38,261][106225] Updated weights for policy 1, policy_version 1139573 (0.0008) [2023-12-28 03:25:38,325][106225] Updated weights for policy 1, policy_version 1139583 (0.0006) [2023-12-28 03:25:38,393][106225] Updated weights for policy 1, policy_version 1139593 (0.0008) [2023-12-28 03:25:39,010][106226] Updated weights for policy 0, policy_version 1136665 (0.0007) [2023-12-28 03:25:39,070][106225] Updated weights for policy 1, policy_version 1139603 (0.0009) [2023-12-28 03:25:39,081][106226] Updated weights for policy 0, policy_version 1136675 (0.0005) [2023-12-28 03:25:39,127][106225] Updated weights for policy 1, policy_version 1139613 (0.0010) [2023-12-28 03:25:39,141][106226] Updated weights for policy 0, policy_version 1136685 (0.0006) [2023-12-28 03:25:39,181][106225] Updated weights for policy 1, policy_version 1139623 (0.0010) [2023-12-28 03:25:39,194][106226] Updated weights for policy 0, policy_version 1136695 (0.0008) [2023-12-28 03:25:39,882][106225] Updated weights for policy 1, policy_version 1139633 (0.0009) [2023-12-28 03:25:39,965][106225] Updated weights for policy 1, policy_version 1139643 (0.0011) [2023-12-28 03:25:39,979][106226] Updated weights for policy 0, policy_version 1136705 (0.0008) [2023-12-28 03:25:40,020][106225] Updated weights for policy 1, policy_version 1139653 (0.0009) [2023-12-28 03:25:40,046][106226] Updated weights for policy 0, policy_version 1136715 (0.0008) [2023-12-28 03:25:40,083][106225] Updated weights for policy 1, policy_version 1139663 (0.0009) [2023-12-28 03:25:40,114][106226] Updated weights for policy 0, policy_version 1136725 (0.0008) [2023-12-28 03:25:40,780][106225] Updated weights for policy 1, policy_version 1139673 (0.0010) [2023-12-28 03:25:40,837][106225] Updated weights for policy 1, policy_version 1139683 (0.0010) [2023-12-28 03:25:40,892][106226] Updated weights for policy 0, policy_version 1136735 (0.0006) [2023-12-28 03:25:40,902][106225] Updated weights for policy 1, policy_version 1139693 (0.0010) [2023-12-28 03:25:40,952][106226] Updated weights for policy 0, policy_version 1136745 (0.0008) [2023-12-28 03:25:41,014][106226] Updated weights for policy 0, policy_version 1136755 (0.0008) [2023-12-28 03:25:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 582877184. Throughput: 0: 9915.8, 1: 9863.2. Samples: 582845592. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:41,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.663')] [2023-12-28 03:25:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001136760_291069952.pth... [2023-12-28 03:25:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001139696_291807232.pth... [2023-12-28 03:25:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001135608_290775040.pth [2023-12-28 03:25:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001138544_291512320.pth [2023-12-28 03:25:41,663][106225] Updated weights for policy 1, policy_version 1139703 (0.0009) [2023-12-28 03:25:41,731][106225] Updated weights for policy 1, policy_version 1139713 (0.0009) [2023-12-28 03:25:41,786][106226] Updated weights for policy 0, policy_version 1136765 (0.0009) [2023-12-28 03:25:41,794][106225] Updated weights for policy 1, policy_version 1139723 (0.0007) [2023-12-28 03:25:41,845][106226] Updated weights for policy 0, policy_version 1136775 (0.0006) [2023-12-28 03:25:41,904][106226] Updated weights for policy 0, policy_version 1136785 (0.0008) [2023-12-28 03:25:42,523][106225] Updated weights for policy 1, policy_version 1139733 (0.0008) [2023-12-28 03:25:42,571][106225] Updated weights for policy 1, policy_version 1139743 (0.0005) [2023-12-28 03:25:42,622][106225] Updated weights for policy 1, policy_version 1139753 (0.0007) [2023-12-28 03:25:42,627][106226] Updated weights for policy 0, policy_version 1136795 (0.0008) [2023-12-28 03:25:42,724][106226] Updated weights for policy 0, policy_version 1136805 (0.0011) [2023-12-28 03:25:42,791][106226] Updated weights for policy 0, policy_version 1136815 (0.0009) [2023-12-28 03:25:43,280][106225] Updated weights for policy 1, policy_version 1139763 (0.0008) [2023-12-28 03:25:43,335][106225] Updated weights for policy 1, policy_version 1139773 (0.0008) [2023-12-28 03:25:43,383][106225] Updated weights for policy 1, policy_version 1139783 (0.0008) [2023-12-28 03:25:43,413][106226] Updated weights for policy 0, policy_version 1136825 (0.0008) [2023-12-28 03:25:43,476][106226] Updated weights for policy 0, policy_version 1136835 (0.0007) [2023-12-28 03:25:43,534][106226] Updated weights for policy 0, policy_version 1136845 (0.0009) [2023-12-28 03:25:43,593][106226] Updated weights for policy 0, policy_version 1136855 (0.0008) [2023-12-28 03:25:44,162][106225] Updated weights for policy 1, policy_version 1139793 (0.0007) [2023-12-28 03:25:44,210][106225] Updated weights for policy 1, policy_version 1139803 (0.0006) [2023-12-28 03:25:44,215][106226] Updated weights for policy 0, policy_version 1136865 (0.0006) [2023-12-28 03:25:44,261][106225] Updated weights for policy 1, policy_version 1139813 (0.0006) [2023-12-28 03:25:44,275][106226] Updated weights for policy 0, policy_version 1136875 (0.0007) [2023-12-28 03:25:44,316][106225] Updated weights for policy 1, policy_version 1139823 (0.0006) [2023-12-28 03:25:44,326][106226] Updated weights for policy 0, policy_version 1136885 (0.0007) [2023-12-28 03:25:45,020][106226] Updated weights for policy 0, policy_version 1136895 (0.0008) [2023-12-28 03:25:45,076][106226] Updated weights for policy 0, policy_version 1136905 (0.0008) [2023-12-28 03:25:45,098][106225] Updated weights for policy 1, policy_version 1139833 (0.0007) [2023-12-28 03:25:45,137][106226] Updated weights for policy 0, policy_version 1136915 (0.0006) [2023-12-28 03:25:45,157][106225] Updated weights for policy 1, policy_version 1139843 (0.0009) [2023-12-28 03:25:45,219][106225] Updated weights for policy 1, policy_version 1139853 (0.0008) [2023-12-28 03:25:45,803][106226] Updated weights for policy 0, policy_version 1136925 (0.0005) [2023-12-28 03:25:45,856][106226] Updated weights for policy 0, policy_version 1136935 (0.0006) [2023-12-28 03:25:45,915][106226] Updated weights for policy 0, policy_version 1136945 (0.0005) [2023-12-28 03:25:45,995][106225] Updated weights for policy 1, policy_version 1139863 (0.0009) [2023-12-28 03:25:46,043][106225] Updated weights for policy 1, policy_version 1139873 (0.0008) [2023-12-28 03:25:46,095][106225] Updated weights for policy 1, policy_version 1139883 (0.0008) [2023-12-28 03:25:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 582975488. Throughput: 0: 9881.8, 1: 9840.5. Samples: 582961396. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:46,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.633')] [2023-12-28 03:25:46,589][106226] Updated weights for policy 0, policy_version 1136955 (0.0008) [2023-12-28 03:25:46,645][106226] Updated weights for policy 0, policy_version 1136965 (0.0009) [2023-12-28 03:25:46,706][106226] Updated weights for policy 0, policy_version 1136975 (0.0008) [2023-12-28 03:25:46,780][106225] Updated weights for policy 1, policy_version 1139893 (0.0007) [2023-12-28 03:25:46,834][106225] Updated weights for policy 1, policy_version 1139903 (0.0007) [2023-12-28 03:25:46,890][106225] Updated weights for policy 1, policy_version 1139913 (0.0008) [2023-12-28 03:25:47,400][106226] Updated weights for policy 0, policy_version 1136985 (0.0009) [2023-12-28 03:25:47,468][106226] Updated weights for policy 0, policy_version 1136995 (0.0011) [2023-12-28 03:25:47,532][106226] Updated weights for policy 0, policy_version 1137005 (0.0011) [2023-12-28 03:25:47,588][106226] Updated weights for policy 0, policy_version 1137015 (0.0010) [2023-12-28 03:25:47,590][106225] Updated weights for policy 1, policy_version 1139923 (0.0010) [2023-12-28 03:25:47,652][106225] Updated weights for policy 1, policy_version 1139933 (0.0010) [2023-12-28 03:25:47,714][106225] Updated weights for policy 1, policy_version 1139943 (0.0010) [2023-12-28 03:25:48,274][106226] Updated weights for policy 0, policy_version 1137025 (0.0011) [2023-12-28 03:25:48,338][106226] Updated weights for policy 0, policy_version 1137035 (0.0011) [2023-12-28 03:25:48,375][106225] Updated weights for policy 1, policy_version 1139953 (0.0010) [2023-12-28 03:25:48,404][106226] Updated weights for policy 0, policy_version 1137045 (0.0011) [2023-12-28 03:25:48,434][106225] Updated weights for policy 1, policy_version 1139963 (0.0006) [2023-12-28 03:25:48,492][106225] Updated weights for policy 1, policy_version 1139973 (0.0008) [2023-12-28 03:25:48,541][106225] Updated weights for policy 1, policy_version 1139983 (0.0008) [2023-12-28 03:25:49,104][106226] Updated weights for policy 0, policy_version 1137055 (0.0007) [2023-12-28 03:25:49,152][106226] Updated weights for policy 0, policy_version 1137065 (0.0005) [2023-12-28 03:25:49,203][106226] Updated weights for policy 0, policy_version 1137075 (0.0009) [2023-12-28 03:25:49,356][106225] Updated weights for policy 1, policy_version 1139993 (0.0009) [2023-12-28 03:25:49,423][106225] Updated weights for policy 1, policy_version 1140003 (0.0010) [2023-12-28 03:25:49,487][106225] Updated weights for policy 1, policy_version 1140013 (0.0010) [2023-12-28 03:25:49,915][106226] Updated weights for policy 0, policy_version 1137085 (0.0008) [2023-12-28 03:25:49,979][106226] Updated weights for policy 0, policy_version 1137095 (0.0010) [2023-12-28 03:25:50,039][106226] Updated weights for policy 0, policy_version 1137105 (0.0007) [2023-12-28 03:25:50,183][106225] Updated weights for policy 1, policy_version 1140023 (0.0010) [2023-12-28 03:25:50,251][106225] Updated weights for policy 1, policy_version 1140033 (0.0010) [2023-12-28 03:25:50,312][106225] Updated weights for policy 1, policy_version 1140043 (0.0011) [2023-12-28 03:25:50,708][106226] Updated weights for policy 0, policy_version 1137115 (0.0007) [2023-12-28 03:25:50,769][106226] Updated weights for policy 0, policy_version 1137125 (0.0008) [2023-12-28 03:25:50,824][106226] Updated weights for policy 0, policy_version 1137135 (0.0007) [2023-12-28 03:25:51,040][106225] Updated weights for policy 1, policy_version 1140053 (0.0010) [2023-12-28 03:25:51,110][106225] Updated weights for policy 1, policy_version 1140063 (0.0010) [2023-12-28 03:25:51,174][106225] Updated weights for policy 1, policy_version 1140073 (0.0009) [2023-12-28 03:25:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 583065600. Throughput: 0: 9824.9, 1: 9803.5. Samples: 583078828. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:51,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-4.560')] [2023-12-28 03:25:51,521][106226] Updated weights for policy 0, policy_version 1137145 (0.0007) [2023-12-28 03:25:51,580][106226] Updated weights for policy 0, policy_version 1137155 (0.0005) [2023-12-28 03:25:51,645][106226] Updated weights for policy 0, policy_version 1137165 (0.0008) [2023-12-28 03:25:51,701][106226] Updated weights for policy 0, policy_version 1137175 (0.0006) [2023-12-28 03:25:51,980][106225] Updated weights for policy 1, policy_version 1140083 (0.0009) [2023-12-28 03:25:52,045][106225] Updated weights for policy 1, policy_version 1140093 (0.0011) [2023-12-28 03:25:52,110][106225] Updated weights for policy 1, policy_version 1140103 (0.0010) [2023-12-28 03:25:52,295][106226] Updated weights for policy 0, policy_version 1137185 (0.0008) [2023-12-28 03:25:52,361][106226] Updated weights for policy 0, policy_version 1137195 (0.0008) [2023-12-28 03:25:52,427][106226] Updated weights for policy 0, policy_version 1137205 (0.0007) [2023-12-28 03:25:52,812][106225] Updated weights for policy 1, policy_version 1140113 (0.0010) [2023-12-28 03:25:52,870][106225] Updated weights for policy 1, policy_version 1140123 (0.0008) [2023-12-28 03:25:52,929][106225] Updated weights for policy 1, policy_version 1140133 (0.0009) [2023-12-28 03:25:52,990][106225] Updated weights for policy 1, policy_version 1140143 (0.0009) [2023-12-28 03:25:53,091][106226] Updated weights for policy 0, policy_version 1137215 (0.0009) [2023-12-28 03:25:53,144][106226] Updated weights for policy 0, policy_version 1137225 (0.0009) [2023-12-28 03:25:53,193][106226] Updated weights for policy 0, policy_version 1137235 (0.0008) [2023-12-28 03:25:53,599][106225] Updated weights for policy 1, policy_version 1140153 (0.0008) [2023-12-28 03:25:53,660][106225] Updated weights for policy 1, policy_version 1140163 (0.0008) [2023-12-28 03:25:53,722][106225] Updated weights for policy 1, policy_version 1140173 (0.0009) [2023-12-28 03:25:53,884][106226] Updated weights for policy 0, policy_version 1137245 (0.0007) [2023-12-28 03:25:53,951][106226] Updated weights for policy 0, policy_version 1137255 (0.0005) [2023-12-28 03:25:54,013][106226] Updated weights for policy 0, policy_version 1137265 (0.0009) [2023-12-28 03:25:54,374][106225] Updated weights for policy 1, policy_version 1140183 (0.0008) [2023-12-28 03:25:54,429][106225] Updated weights for policy 1, policy_version 1140193 (0.0006) [2023-12-28 03:25:54,492][106225] Updated weights for policy 1, policy_version 1140203 (0.0005) [2023-12-28 03:25:54,672][106226] Updated weights for policy 0, policy_version 1137275 (0.0008) [2023-12-28 03:25:54,729][106226] Updated weights for policy 0, policy_version 1137285 (0.0005) [2023-12-28 03:25:54,774][106226] Updated weights for policy 0, policy_version 1137295 (0.0005) [2023-12-28 03:25:55,081][106225] Updated weights for policy 1, policy_version 1140213 (0.0007) [2023-12-28 03:25:55,137][106225] Updated weights for policy 1, policy_version 1140223 (0.0009) [2023-12-28 03:25:55,202][106225] Updated weights for policy 1, policy_version 1140233 (0.0007) [2023-12-28 03:25:55,352][106226] Updated weights for policy 0, policy_version 1137305 (0.0006) [2023-12-28 03:25:55,414][106226] Updated weights for policy 0, policy_version 1137315 (0.0008) [2023-12-28 03:25:55,473][106226] Updated weights for policy 0, policy_version 1137325 (0.0009) [2023-12-28 03:25:55,531][106226] Updated weights for policy 0, policy_version 1137335 (0.0009) [2023-12-28 03:25:55,862][106225] Updated weights for policy 1, policy_version 1140243 (0.0006) [2023-12-28 03:25:55,920][106225] Updated weights for policy 1, policy_version 1140253 (0.0006) [2023-12-28 03:25:55,987][106225] Updated weights for policy 1, policy_version 1140263 (0.0006) [2023-12-28 03:25:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 583172096. Throughput: 0: 9849.7, 1: 9836.2. Samples: 583139092. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:25:56,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.849')] [2023-12-28 03:25:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001140272_291954688.pth... [2023-12-28 03:25:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001139120_291659776.pth [2023-12-28 03:25:56,211][106226] Updated weights for policy 0, policy_version 1137345 (0.0008) [2023-12-28 03:25:56,263][106226] Updated weights for policy 0, policy_version 1137355 (0.0008) [2023-12-28 03:25:56,325][106226] Updated weights for policy 0, policy_version 1137365 (0.0008) [2023-12-28 03:25:56,338][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001137368_291225600.pth... [2023-12-28 03:25:56,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001136184_290922496.pth [2023-12-28 03:25:56,582][106225] Updated weights for policy 1, policy_version 1140273 (0.0006) [2023-12-28 03:25:56,636][106225] Updated weights for policy 1, policy_version 1140283 (0.0006) [2023-12-28 03:25:56,679][106225] Updated weights for policy 1, policy_version 1140293 (0.0008) [2023-12-28 03:25:56,725][106225] Updated weights for policy 1, policy_version 1140303 (0.0005) [2023-12-28 03:25:57,091][106226] Updated weights for policy 0, policy_version 1137375 (0.0008) [2023-12-28 03:25:57,141][106226] Updated weights for policy 0, policy_version 1137385 (0.0007) [2023-12-28 03:25:57,190][106226] Updated weights for policy 0, policy_version 1137395 (0.0007) [2023-12-28 03:25:57,354][106225] Updated weights for policy 1, policy_version 1140313 (0.0008) [2023-12-28 03:25:57,399][106225] Updated weights for policy 1, policy_version 1140323 (0.0005) [2023-12-28 03:25:57,454][106225] Updated weights for policy 1, policy_version 1140333 (0.0005) [2023-12-28 03:25:57,972][106226] Updated weights for policy 0, policy_version 1137405 (0.0008) [2023-12-28 03:25:58,032][106226] Updated weights for policy 0, policy_version 1137415 (0.0006) [2023-12-28 03:25:58,093][106226] Updated weights for policy 0, policy_version 1137425 (0.0006) [2023-12-28 03:25:58,124][106225] Updated weights for policy 1, policy_version 1140343 (0.0009) [2023-12-28 03:25:58,180][106225] Updated weights for policy 1, policy_version 1140353 (0.0010) [2023-12-28 03:25:58,241][106225] Updated weights for policy 1, policy_version 1140363 (0.0009) [2023-12-28 03:25:58,800][106226] Updated weights for policy 0, policy_version 1137435 (0.0006) [2023-12-28 03:25:58,864][106226] Updated weights for policy 0, policy_version 1137445 (0.0007) [2023-12-28 03:25:58,937][106226] Updated weights for policy 0, policy_version 1137455 (0.0008) [2023-12-28 03:25:59,019][106225] Updated weights for policy 1, policy_version 1140373 (0.0007) [2023-12-28 03:25:59,076][106225] Updated weights for policy 1, policy_version 1140383 (0.0006) [2023-12-28 03:25:59,137][106225] Updated weights for policy 1, policy_version 1140393 (0.0006) [2023-12-28 03:25:59,699][106226] Updated weights for policy 0, policy_version 1137465 (0.0008) [2023-12-28 03:25:59,760][106226] Updated weights for policy 0, policy_version 1137475 (0.0011) [2023-12-28 03:25:59,819][106226] Updated weights for policy 0, policy_version 1137485 (0.0011) [2023-12-28 03:25:59,877][106226] Updated weights for policy 0, policy_version 1137495 (0.0011) [2023-12-28 03:25:59,883][106225] Updated weights for policy 1, policy_version 1140403 (0.0006) [2023-12-28 03:25:59,949][106225] Updated weights for policy 1, policy_version 1140413 (0.0008) [2023-12-28 03:26:00,007][106225] Updated weights for policy 1, policy_version 1140423 (0.0008) [2023-12-28 03:26:00,564][106226] Updated weights for policy 0, policy_version 1137505 (0.0010) [2023-12-28 03:26:00,617][106226] Updated weights for policy 0, policy_version 1137515 (0.0010) [2023-12-28 03:26:00,659][106226] Updated weights for policy 0, policy_version 1137525 (0.0010) [2023-12-28 03:26:00,760][106225] Updated weights for policy 1, policy_version 1140433 (0.0008) [2023-12-28 03:26:00,814][106225] Updated weights for policy 1, policy_version 1140443 (0.0005) [2023-12-28 03:26:00,878][106225] Updated weights for policy 1, policy_version 1140453 (0.0005) [2023-12-28 03:26:00,931][106225] Updated weights for policy 1, policy_version 1140463 (0.0005) [2023-12-28 03:26:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 583270400. Throughput: 0: 9896.8, 1: 9931.4. Samples: 583259496. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:01,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-4.990')] [2023-12-28 03:26:01,308][106226] Updated weights for policy 0, policy_version 1137535 (0.0010) [2023-12-28 03:26:01,368][106226] Updated weights for policy 0, policy_version 1137545 (0.0008) [2023-12-28 03:26:01,439][106226] Updated weights for policy 0, policy_version 1137555 (0.0008) [2023-12-28 03:26:01,618][106225] Updated weights for policy 1, policy_version 1140473 (0.0008) [2023-12-28 03:26:01,685][106225] Updated weights for policy 1, policy_version 1140483 (0.0007) [2023-12-28 03:26:01,750][106225] Updated weights for policy 1, policy_version 1140493 (0.0009) [2023-12-28 03:26:02,172][106226] Updated weights for policy 0, policy_version 1137565 (0.0009) [2023-12-28 03:26:02,222][106226] Updated weights for policy 0, policy_version 1137575 (0.0010) [2023-12-28 03:26:02,286][106226] Updated weights for policy 0, policy_version 1137585 (0.0011) [2023-12-28 03:26:02,403][106225] Updated weights for policy 1, policy_version 1140503 (0.0009) [2023-12-28 03:26:02,463][106225] Updated weights for policy 1, policy_version 1140513 (0.0009) [2023-12-28 03:26:02,517][106225] Updated weights for policy 1, policy_version 1140523 (0.0010) [2023-12-28 03:26:02,915][106226] Updated weights for policy 0, policy_version 1137595 (0.0009) [2023-12-28 03:26:02,982][106226] Updated weights for policy 0, policy_version 1137605 (0.0005) [2023-12-28 03:26:03,050][106226] Updated weights for policy 0, policy_version 1137615 (0.0008) [2023-12-28 03:26:03,176][106225] Updated weights for policy 1, policy_version 1140533 (0.0008) [2023-12-28 03:26:03,244][106225] Updated weights for policy 1, policy_version 1140543 (0.0007) [2023-12-28 03:26:03,308][106225] Updated weights for policy 1, policy_version 1140553 (0.0006) [2023-12-28 03:26:03,700][106226] Updated weights for policy 0, policy_version 1137625 (0.0008) [2023-12-28 03:26:03,761][106226] Updated weights for policy 0, policy_version 1137635 (0.0010) [2023-12-28 03:26:03,822][106226] Updated weights for policy 0, policy_version 1137645 (0.0010) [2023-12-28 03:26:03,891][106226] Updated weights for policy 0, policy_version 1137655 (0.0008) [2023-12-28 03:26:03,919][106225] Updated weights for policy 1, policy_version 1140563 (0.0007) [2023-12-28 03:26:03,978][106225] Updated weights for policy 1, policy_version 1140573 (0.0009) [2023-12-28 03:26:04,036][106225] Updated weights for policy 1, policy_version 1140583 (0.0009) [2023-12-28 03:26:04,613][106226] Updated weights for policy 0, policy_version 1137665 (0.0008) [2023-12-28 03:26:04,665][106226] Updated weights for policy 0, policy_version 1137675 (0.0008) [2023-12-28 03:26:04,710][106226] Updated weights for policy 0, policy_version 1137685 (0.0009) [2023-12-28 03:26:04,761][106225] Updated weights for policy 1, policy_version 1140593 (0.0009) [2023-12-28 03:26:04,822][106225] Updated weights for policy 1, policy_version 1140603 (0.0009) [2023-12-28 03:26:04,881][106225] Updated weights for policy 1, policy_version 1140613 (0.0009) [2023-12-28 03:26:04,935][106225] Updated weights for policy 1, policy_version 1140623 (0.0009) [2023-12-28 03:26:05,373][106226] Updated weights for policy 0, policy_version 1137695 (0.0009) [2023-12-28 03:26:05,446][106226] Updated weights for policy 0, policy_version 1137705 (0.0009) [2023-12-28 03:26:05,514][106226] Updated weights for policy 0, policy_version 1137715 (0.0009) [2023-12-28 03:26:05,631][106225] Updated weights for policy 1, policy_version 1140633 (0.0006) [2023-12-28 03:26:05,686][106225] Updated weights for policy 1, policy_version 1140643 (0.0006) [2023-12-28 03:26:05,742][106225] Updated weights for policy 1, policy_version 1140653 (0.0006) [2023-12-28 03:26:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 583368704. Throughput: 0: 9919.0, 1: 9971.3. Samples: 583380468. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:06,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.736')] [2023-12-28 03:26:06,227][106226] Updated weights for policy 0, policy_version 1137725 (0.0009) [2023-12-28 03:26:06,294][106226] Updated weights for policy 0, policy_version 1137735 (0.0008) [2023-12-28 03:26:06,361][106226] Updated weights for policy 0, policy_version 1137745 (0.0008) [2023-12-28 03:26:06,407][106225] Updated weights for policy 1, policy_version 1140663 (0.0007) [2023-12-28 03:26:06,471][106225] Updated weights for policy 1, policy_version 1140673 (0.0009) [2023-12-28 03:26:06,529][106225] Updated weights for policy 1, policy_version 1140683 (0.0009) [2023-12-28 03:26:07,018][106226] Updated weights for policy 0, policy_version 1137755 (0.0008) [2023-12-28 03:26:07,070][106226] Updated weights for policy 0, policy_version 1137765 (0.0005) [2023-12-28 03:26:07,122][106226] Updated weights for policy 0, policy_version 1137775 (0.0005) [2023-12-28 03:26:07,285][106225] Updated weights for policy 1, policy_version 1140693 (0.0007) [2023-12-28 03:26:07,350][106225] Updated weights for policy 1, policy_version 1140703 (0.0006) [2023-12-28 03:26:07,405][106225] Updated weights for policy 1, policy_version 1140713 (0.0006) [2023-12-28 03:26:07,798][106226] Updated weights for policy 0, policy_version 1137785 (0.0006) [2023-12-28 03:26:07,842][106226] Updated weights for policy 0, policy_version 1137795 (0.0008) [2023-12-28 03:26:07,889][106226] Updated weights for policy 0, policy_version 1137805 (0.0008) [2023-12-28 03:26:07,937][106226] Updated weights for policy 0, policy_version 1137815 (0.0008) [2023-12-28 03:26:08,012][106225] Updated weights for policy 1, policy_version 1140723 (0.0007) [2023-12-28 03:26:08,073][106225] Updated weights for policy 1, policy_version 1140733 (0.0007) [2023-12-28 03:26:08,135][106225] Updated weights for policy 1, policy_version 1140743 (0.0008) [2023-12-28 03:26:08,710][106226] Updated weights for policy 0, policy_version 1137825 (0.0006) [2023-12-28 03:26:08,766][106226] Updated weights for policy 0, policy_version 1137835 (0.0006) [2023-12-28 03:26:08,829][106226] Updated weights for policy 0, policy_version 1137845 (0.0005) [2023-12-28 03:26:08,871][106225] Updated weights for policy 1, policy_version 1140753 (0.0008) [2023-12-28 03:26:08,929][106225] Updated weights for policy 1, policy_version 1140763 (0.0009) [2023-12-28 03:26:08,992][106225] Updated weights for policy 1, policy_version 1140773 (0.0009) [2023-12-28 03:26:09,041][106225] Updated weights for policy 1, policy_version 1140783 (0.0008) [2023-12-28 03:26:09,520][106226] Updated weights for policy 0, policy_version 1137855 (0.0006) [2023-12-28 03:26:09,591][106226] Updated weights for policy 0, policy_version 1137865 (0.0006) [2023-12-28 03:26:09,659][106226] Updated weights for policy 0, policy_version 1137875 (0.0006) [2023-12-28 03:26:09,914][106225] Updated weights for policy 1, policy_version 1140793 (0.0009) [2023-12-28 03:26:09,988][106225] Updated weights for policy 1, policy_version 1140803 (0.0009) [2023-12-28 03:26:10,056][106225] Updated weights for policy 1, policy_version 1140813 (0.0009) [2023-12-28 03:26:10,285][106226] Updated weights for policy 0, policy_version 1137885 (0.0007) [2023-12-28 03:26:10,352][106226] Updated weights for policy 0, policy_version 1137895 (0.0008) [2023-12-28 03:26:10,418][106226] Updated weights for policy 0, policy_version 1137905 (0.0007) [2023-12-28 03:26:10,814][106225] Updated weights for policy 1, policy_version 1140823 (0.0006) [2023-12-28 03:26:10,874][106225] Updated weights for policy 1, policy_version 1140833 (0.0005) [2023-12-28 03:26:10,929][106225] Updated weights for policy 1, policy_version 1140843 (0.0008) [2023-12-28 03:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 583467008. Throughput: 0: 9923.5, 1: 10016.5. Samples: 583440908. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:11,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.704')] [2023-12-28 03:26:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001140848_292102144.pth... [2023-12-28 03:26:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001139696_291807232.pth [2023-12-28 03:26:11,187][106226] Updated weights for policy 0, policy_version 1137915 (0.0009) [2023-12-28 03:26:11,250][106226] Updated weights for policy 0, policy_version 1137925 (0.0009) [2023-12-28 03:26:11,321][106226] Updated weights for policy 0, policy_version 1137935 (0.0008) [2023-12-28 03:26:11,376][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001137944_291373056.pth... [2023-12-28 03:26:11,381][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001136760_291069952.pth [2023-12-28 03:26:11,734][106225] Updated weights for policy 1, policy_version 1140853 (0.0009) [2023-12-28 03:26:11,799][106225] Updated weights for policy 1, policy_version 1140863 (0.0006) [2023-12-28 03:26:11,861][106225] Updated weights for policy 1, policy_version 1140873 (0.0005) [2023-12-28 03:26:12,084][106226] Updated weights for policy 0, policy_version 1137945 (0.0008) [2023-12-28 03:26:12,151][106226] Updated weights for policy 0, policy_version 1137955 (0.0007) [2023-12-28 03:26:12,214][106226] Updated weights for policy 0, policy_version 1137965 (0.0008) [2023-12-28 03:26:12,275][106226] Updated weights for policy 0, policy_version 1137975 (0.0009) [2023-12-28 03:26:12,523][106225] Updated weights for policy 1, policy_version 1140883 (0.0007) [2023-12-28 03:26:12,581][106225] Updated weights for policy 1, policy_version 1140893 (0.0008) [2023-12-28 03:26:12,652][106225] Updated weights for policy 1, policy_version 1140903 (0.0009) [2023-12-28 03:26:13,027][106226] Updated weights for policy 0, policy_version 1137985 (0.0009) [2023-12-28 03:26:13,082][106226] Updated weights for policy 0, policy_version 1137995 (0.0008) [2023-12-28 03:26:13,145][106226] Updated weights for policy 0, policy_version 1138005 (0.0007) [2023-12-28 03:26:13,316][106225] Updated weights for policy 1, policy_version 1140913 (0.0005) [2023-12-28 03:26:13,370][106225] Updated weights for policy 1, policy_version 1140923 (0.0008) [2023-12-28 03:26:13,426][106225] Updated weights for policy 1, policy_version 1140933 (0.0008) [2023-12-28 03:26:13,495][106225] Updated weights for policy 1, policy_version 1140943 (0.0008) [2023-12-28 03:26:13,792][106226] Updated weights for policy 0, policy_version 1138015 (0.0006) [2023-12-28 03:26:13,853][106226] Updated weights for policy 0, policy_version 1138025 (0.0008) [2023-12-28 03:26:13,911][106226] Updated weights for policy 0, policy_version 1138035 (0.0009) [2023-12-28 03:26:14,250][106225] Updated weights for policy 1, policy_version 1140953 (0.0008) [2023-12-28 03:26:14,314][106225] Updated weights for policy 1, policy_version 1140963 (0.0006) [2023-12-28 03:26:14,378][106225] Updated weights for policy 1, policy_version 1140973 (0.0005) [2023-12-28 03:26:14,569][106226] Updated weights for policy 0, policy_version 1138046 (0.0009) [2023-12-28 03:26:14,619][106226] Updated weights for policy 0, policy_version 1138056 (0.0009) [2023-12-28 03:26:14,684][106226] Updated weights for policy 0, policy_version 1138066 (0.0008) [2023-12-28 03:26:14,938][106225] Updated weights for policy 1, policy_version 1140983 (0.0005) [2023-12-28 03:26:15,007][106225] Updated weights for policy 1, policy_version 1140993 (0.0006) [2023-12-28 03:26:15,072][106225] Updated weights for policy 1, policy_version 1141003 (0.0007) [2023-12-28 03:26:15,407][106226] Updated weights for policy 0, policy_version 1138076 (0.0010) [2023-12-28 03:26:15,465][106226] Updated weights for policy 0, policy_version 1138086 (0.0011) [2023-12-28 03:26:15,520][106226] Updated weights for policy 0, policy_version 1138096 (0.0011) [2023-12-28 03:26:15,713][106225] Updated weights for policy 1, policy_version 1141013 (0.0008) [2023-12-28 03:26:15,767][106225] Updated weights for policy 1, policy_version 1141023 (0.0008) [2023-12-28 03:26:15,832][106225] Updated weights for policy 1, policy_version 1141033 (0.0008) [2023-12-28 03:26:16,130][106226] Updated weights for policy 0, policy_version 1138106 (0.0009) [2023-12-28 03:26:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 583565312. Throughput: 0: 9859.0, 1: 9839.4. Samples: 583555540. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:16,175][105115] Avg episode reward: [(0, '-4.283'), (1, '-4.878')] [2023-12-28 03:26:16,183][106226] Updated weights for policy 0, policy_version 1138116 (0.0005) [2023-12-28 03:26:16,240][106226] Updated weights for policy 0, policy_version 1138126 (0.0005) [2023-12-28 03:26:16,293][106226] Updated weights for policy 0, policy_version 1138136 (0.0005) [2023-12-28 03:26:16,595][106225] Updated weights for policy 1, policy_version 1141043 (0.0008) [2023-12-28 03:26:16,639][106225] Updated weights for policy 1, policy_version 1141053 (0.0008) [2023-12-28 03:26:16,691][106225] Updated weights for policy 1, policy_version 1141063 (0.0009) [2023-12-28 03:26:16,955][106226] Updated weights for policy 0, policy_version 1138146 (0.0009) [2023-12-28 03:26:17,013][106226] Updated weights for policy 0, policy_version 1138156 (0.0008) [2023-12-28 03:26:17,069][106226] Updated weights for policy 0, policy_version 1138166 (0.0008) [2023-12-28 03:26:17,413][106225] Updated weights for policy 1, policy_version 1141073 (0.0007) [2023-12-28 03:26:17,473][106225] Updated weights for policy 1, policy_version 1141083 (0.0009) [2023-12-28 03:26:17,528][106225] Updated weights for policy 1, policy_version 1141093 (0.0009) [2023-12-28 03:26:17,593][106225] Updated weights for policy 1, policy_version 1141103 (0.0007) [2023-12-28 03:26:17,661][106226] Updated weights for policy 0, policy_version 1138176 (0.0006) [2023-12-28 03:26:17,720][106226] Updated weights for policy 0, policy_version 1138186 (0.0006) [2023-12-28 03:26:17,766][106226] Updated weights for policy 0, policy_version 1138196 (0.0005) [2023-12-28 03:26:18,289][106225] Updated weights for policy 1, policy_version 1141113 (0.0009) [2023-12-28 03:26:18,361][106225] Updated weights for policy 1, policy_version 1141123 (0.0009) [2023-12-28 03:26:18,399][106226] Updated weights for policy 0, policy_version 1138206 (0.0007) [2023-12-28 03:26:18,428][106225] Updated weights for policy 1, policy_version 1141133 (0.0007) [2023-12-28 03:26:18,459][106226] Updated weights for policy 0, policy_version 1138216 (0.0008) [2023-12-28 03:26:18,517][106226] Updated weights for policy 0, policy_version 1138226 (0.0008) [2023-12-28 03:26:19,127][106225] Updated weights for policy 1, policy_version 1141143 (0.0009) [2023-12-28 03:26:19,187][106225] Updated weights for policy 1, policy_version 1141153 (0.0010) [2023-12-28 03:26:19,257][106225] Updated weights for policy 1, policy_version 1141163 (0.0009) [2023-12-28 03:26:19,269][106226] Updated weights for policy 0, policy_version 1138236 (0.0007) [2023-12-28 03:26:19,335][106226] Updated weights for policy 0, policy_version 1138246 (0.0008) [2023-12-28 03:26:19,409][106226] Updated weights for policy 0, policy_version 1138256 (0.0008) [2023-12-28 03:26:19,971][106225] Updated weights for policy 1, policy_version 1141173 (0.0008) [2023-12-28 03:26:20,032][106225] Updated weights for policy 1, policy_version 1141183 (0.0010) [2023-12-28 03:26:20,083][106226] Updated weights for policy 0, policy_version 1138266 (0.0007) [2023-12-28 03:26:20,098][106225] Updated weights for policy 1, policy_version 1141193 (0.0011) [2023-12-28 03:26:20,148][106226] Updated weights for policy 0, policy_version 1138276 (0.0011) [2023-12-28 03:26:20,216][106226] Updated weights for policy 0, policy_version 1138286 (0.0011) [2023-12-28 03:26:20,285][106226] Updated weights for policy 0, policy_version 1138296 (0.0008) [2023-12-28 03:26:20,839][106225] Updated weights for policy 1, policy_version 1141203 (0.0011) [2023-12-28 03:26:20,897][106225] Updated weights for policy 1, policy_version 1141213 (0.0010) [2023-12-28 03:26:20,948][106225] Updated weights for policy 1, policy_version 1141223 (0.0010) [2023-12-28 03:26:20,967][106226] Updated weights for policy 0, policy_version 1138306 (0.0006) [2023-12-28 03:26:21,039][106226] Updated weights for policy 0, policy_version 1138316 (0.0007) [2023-12-28 03:26:21,107][106226] Updated weights for policy 0, policy_version 1138326 (0.0009) [2023-12-28 03:26:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 583671808. Throughput: 0: 9908.4, 1: 9818.0. Samples: 583675804. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:21,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.056')] [2023-12-28 03:26:21,791][106225] Updated weights for policy 1, policy_version 1141233 (0.0010) [2023-12-28 03:26:21,844][106225] Updated weights for policy 1, policy_version 1141243 (0.0008) [2023-12-28 03:26:21,851][106226] Updated weights for policy 0, policy_version 1138336 (0.0008) [2023-12-28 03:26:21,896][106225] Updated weights for policy 1, policy_version 1141253 (0.0008) [2023-12-28 03:26:21,906][106226] Updated weights for policy 0, policy_version 1138346 (0.0006) [2023-12-28 03:26:21,948][106225] Updated weights for policy 1, policy_version 1141263 (0.0008) [2023-12-28 03:26:21,968][106226] Updated weights for policy 0, policy_version 1138356 (0.0007) [2023-12-28 03:26:22,665][106226] Updated weights for policy 0, policy_version 1138366 (0.0006) [2023-12-28 03:26:22,721][106226] Updated weights for policy 0, policy_version 1138376 (0.0007) [2023-12-28 03:26:22,729][106225] Updated weights for policy 1, policy_version 1141273 (0.0008) [2023-12-28 03:26:22,780][106226] Updated weights for policy 0, policy_version 1138386 (0.0010) [2023-12-28 03:26:22,790][106225] Updated weights for policy 1, policy_version 1141283 (0.0009) [2023-12-28 03:26:22,848][106225] Updated weights for policy 1, policy_version 1141293 (0.0008) [2023-12-28 03:26:23,463][106226] Updated weights for policy 0, policy_version 1138396 (0.0007) [2023-12-28 03:26:23,514][106226] Updated weights for policy 0, policy_version 1138406 (0.0008) [2023-12-28 03:26:23,568][106225] Updated weights for policy 1, policy_version 1141303 (0.0007) [2023-12-28 03:26:23,573][106226] Updated weights for policy 0, policy_version 1138416 (0.0006) [2023-12-28 03:26:23,618][106225] Updated weights for policy 1, policy_version 1141313 (0.0006) [2023-12-28 03:26:23,675][106225] Updated weights for policy 1, policy_version 1141323 (0.0005) [2023-12-28 03:26:24,293][106225] Updated weights for policy 1, policy_version 1141333 (0.0007) [2023-12-28 03:26:24,336][106226] Updated weights for policy 0, policy_version 1138426 (0.0010) [2023-12-28 03:26:24,346][106225] Updated weights for policy 1, policy_version 1141343 (0.0007) [2023-12-28 03:26:24,387][106226] Updated weights for policy 0, policy_version 1138436 (0.0007) [2023-12-28 03:26:24,399][106225] Updated weights for policy 1, policy_version 1141353 (0.0007) [2023-12-28 03:26:24,436][106226] Updated weights for policy 0, policy_version 1138446 (0.0006) [2023-12-28 03:26:24,484][106226] Updated weights for policy 0, policy_version 1138456 (0.0009) [2023-12-28 03:26:25,089][106225] Updated weights for policy 1, policy_version 1141363 (0.0009) [2023-12-28 03:26:25,124][106226] Updated weights for policy 0, policy_version 1138466 (0.0010) [2023-12-28 03:26:25,142][106225] Updated weights for policy 1, policy_version 1141373 (0.0010) [2023-12-28 03:26:25,180][106226] Updated weights for policy 0, policy_version 1138476 (0.0007) [2023-12-28 03:26:25,195][106225] Updated weights for policy 1, policy_version 1141383 (0.0010) [2023-12-28 03:26:25,231][106226] Updated weights for policy 0, policy_version 1138486 (0.0005) [2023-12-28 03:26:25,810][106226] Updated weights for policy 0, policy_version 1138496 (0.0005) [2023-12-28 03:26:25,842][106225] Updated weights for policy 1, policy_version 1141393 (0.0009) [2023-12-28 03:26:25,873][106226] Updated weights for policy 0, policy_version 1138506 (0.0005) [2023-12-28 03:26:25,898][106225] Updated weights for policy 1, policy_version 1141403 (0.0010) [2023-12-28 03:26:25,931][106226] Updated weights for policy 0, policy_version 1138516 (0.0005) [2023-12-28 03:26:25,955][106225] Updated weights for policy 1, policy_version 1141413 (0.0010) [2023-12-28 03:26:26,013][106225] Updated weights for policy 1, policy_version 1141423 (0.0010) [2023-12-28 03:26:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 583770112. Throughput: 0: 9944.8, 1: 9765.7. Samples: 583732564. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:26,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.800')] [2023-12-28 03:26:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001138520_291520512.pth... [2023-12-28 03:26:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001141424_292249600.pth... [2023-12-28 03:26:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001140272_291954688.pth [2023-12-28 03:26:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001137368_291225600.pth [2023-12-28 03:26:26,556][106226] Updated weights for policy 0, policy_version 1138526 (0.0008) [2023-12-28 03:26:26,608][106226] Updated weights for policy 0, policy_version 1138536 (0.0010) [2023-12-28 03:26:26,624][106225] Updated weights for policy 1, policy_version 1141433 (0.0006) [2023-12-28 03:26:26,658][106226] Updated weights for policy 0, policy_version 1138546 (0.0010) [2023-12-28 03:26:26,683][106225] Updated weights for policy 1, policy_version 1141443 (0.0005) [2023-12-28 03:26:26,731][106225] Updated weights for policy 1, policy_version 1141453 (0.0005) [2023-12-28 03:26:27,290][106225] Updated weights for policy 1, policy_version 1141463 (0.0007) [2023-12-28 03:26:27,348][106225] Updated weights for policy 1, policy_version 1141473 (0.0007) [2023-12-28 03:26:27,378][106226] Updated weights for policy 0, policy_version 1138556 (0.0010) [2023-12-28 03:26:27,400][106225] Updated weights for policy 1, policy_version 1141483 (0.0006) [2023-12-28 03:26:27,429][106226] Updated weights for policy 0, policy_version 1138566 (0.0010) [2023-12-28 03:26:27,478][106226] Updated weights for policy 0, policy_version 1138576 (0.0010) [2023-12-28 03:26:28,138][106225] Updated weights for policy 1, policy_version 1141493 (0.0008) [2023-12-28 03:26:28,179][106226] Updated weights for policy 0, policy_version 1138586 (0.0009) [2023-12-28 03:26:28,197][106225] Updated weights for policy 1, policy_version 1141503 (0.0010) [2023-12-28 03:26:28,236][106226] Updated weights for policy 0, policy_version 1138596 (0.0005) [2023-12-28 03:26:28,248][106225] Updated weights for policy 1, policy_version 1141513 (0.0010) [2023-12-28 03:26:28,281][106226] Updated weights for policy 0, policy_version 1138606 (0.0005) [2023-12-28 03:26:28,336][106226] Updated weights for policy 0, policy_version 1138616 (0.0008) [2023-12-28 03:26:28,991][106225] Updated weights for policy 1, policy_version 1141523 (0.0010) [2023-12-28 03:26:29,018][106226] Updated weights for policy 0, policy_version 1138626 (0.0008) [2023-12-28 03:26:29,043][106225] Updated weights for policy 1, policy_version 1141533 (0.0010) [2023-12-28 03:26:29,075][106226] Updated weights for policy 0, policy_version 1138636 (0.0005) [2023-12-28 03:26:29,096][106225] Updated weights for policy 1, policy_version 1141543 (0.0010) [2023-12-28 03:26:29,122][106226] Updated weights for policy 0, policy_version 1138646 (0.0006) [2023-12-28 03:26:29,865][106226] Updated weights for policy 0, policy_version 1138656 (0.0008) [2023-12-28 03:26:29,870][106225] Updated weights for policy 1, policy_version 1141553 (0.0010) [2023-12-28 03:26:29,921][106225] Updated weights for policy 1, policy_version 1141563 (0.0010) [2023-12-28 03:26:29,925][106226] Updated weights for policy 0, policy_version 1138666 (0.0007) [2023-12-28 03:26:29,976][106225] Updated weights for policy 1, policy_version 1141573 (0.0008) [2023-12-28 03:26:29,982][106226] Updated weights for policy 0, policy_version 1138676 (0.0008) [2023-12-28 03:26:30,035][106225] Updated weights for policy 1, policy_version 1141583 (0.0008) [2023-12-28 03:26:30,679][106226] Updated weights for policy 0, policy_version 1138686 (0.0006) [2023-12-28 03:26:30,729][106226] Updated weights for policy 0, policy_version 1138696 (0.0005) [2023-12-28 03:26:30,777][106226] Updated weights for policy 0, policy_version 1138706 (0.0005) [2023-12-28 03:26:30,780][106225] Updated weights for policy 1, policy_version 1141593 (0.0008) [2023-12-28 03:26:30,827][106225] Updated weights for policy 1, policy_version 1141603 (0.0006) [2023-12-28 03:26:30,871][106225] Updated weights for policy 1, policy_version 1141613 (0.0005) [2023-12-28 03:26:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 583868416. Throughput: 0: 10037.6, 1: 9863.2. Samples: 583856936. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:31,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-5.057')] [2023-12-28 03:26:31,375][106226] Updated weights for policy 0, policy_version 1138716 (0.0006) [2023-12-28 03:26:31,442][106226] Updated weights for policy 0, policy_version 1138726 (0.0010) [2023-12-28 03:26:31,494][106226] Updated weights for policy 0, policy_version 1138736 (0.0011) [2023-12-28 03:26:31,518][106225] Updated weights for policy 1, policy_version 1141623 (0.0005) [2023-12-28 03:26:31,575][106225] Updated weights for policy 1, policy_version 1141633 (0.0006) [2023-12-28 03:26:31,632][106225] Updated weights for policy 1, policy_version 1141643 (0.0010) [2023-12-28 03:26:32,235][106226] Updated weights for policy 0, policy_version 1138746 (0.0010) [2023-12-28 03:26:32,302][106226] Updated weights for policy 0, policy_version 1138756 (0.0008) [2023-12-28 03:26:32,330][106225] Updated weights for policy 1, policy_version 1141653 (0.0008) [2023-12-28 03:26:32,367][106226] Updated weights for policy 0, policy_version 1138766 (0.0008) [2023-12-28 03:26:32,392][106225] Updated weights for policy 1, policy_version 1141663 (0.0008) [2023-12-28 03:26:32,427][106226] Updated weights for policy 0, policy_version 1138776 (0.0008) [2023-12-28 03:26:32,447][106225] Updated weights for policy 1, policy_version 1141673 (0.0007) [2023-12-28 03:26:33,037][106226] Updated weights for policy 0, policy_version 1138786 (0.0008) [2023-12-28 03:26:33,094][106226] Updated weights for policy 0, policy_version 1138796 (0.0008) [2023-12-28 03:26:33,145][106226] Updated weights for policy 0, policy_version 1138806 (0.0008) [2023-12-28 03:26:33,189][106225] Updated weights for policy 1, policy_version 1141683 (0.0009) [2023-12-28 03:26:33,241][106225] Updated weights for policy 1, policy_version 1141693 (0.0005) [2023-12-28 03:26:33,293][106225] Updated weights for policy 1, policy_version 1141703 (0.0005) [2023-12-28 03:26:33,839][106226] Updated weights for policy 0, policy_version 1138816 (0.0008) [2023-12-28 03:26:33,901][106226] Updated weights for policy 0, policy_version 1138826 (0.0008) [2023-12-28 03:26:33,908][106225] Updated weights for policy 1, policy_version 1141713 (0.0007) [2023-12-28 03:26:33,955][106226] Updated weights for policy 0, policy_version 1138836 (0.0006) [2023-12-28 03:26:33,961][106225] Updated weights for policy 1, policy_version 1141723 (0.0006) [2023-12-28 03:26:34,007][106225] Updated weights for policy 1, policy_version 1141733 (0.0007) [2023-12-28 03:26:34,063][106225] Updated weights for policy 1, policy_version 1141743 (0.0008) [2023-12-28 03:26:34,666][106226] Updated weights for policy 0, policy_version 1138846 (0.0007) [2023-12-28 03:26:34,728][106226] Updated weights for policy 0, policy_version 1138856 (0.0008) [2023-12-28 03:26:34,779][106226] Updated weights for policy 0, policy_version 1138866 (0.0008) [2023-12-28 03:26:34,888][106225] Updated weights for policy 1, policy_version 1141753 (0.0008) [2023-12-28 03:26:34,944][106225] Updated weights for policy 1, policy_version 1141763 (0.0008) [2023-12-28 03:26:34,990][106225] Updated weights for policy 1, policy_version 1141773 (0.0008) [2023-12-28 03:26:35,524][106226] Updated weights for policy 0, policy_version 1138876 (0.0008) [2023-12-28 03:26:35,569][106226] Updated weights for policy 0, policy_version 1138886 (0.0008) [2023-12-28 03:26:35,622][106226] Updated weights for policy 0, policy_version 1138896 (0.0009) [2023-12-28 03:26:35,644][106225] Updated weights for policy 1, policy_version 1141783 (0.0007) [2023-12-28 03:26:35,694][106225] Updated weights for policy 1, policy_version 1141793 (0.0007) [2023-12-28 03:26:35,748][106225] Updated weights for policy 1, policy_version 1141803 (0.0006) [2023-12-28 03:26:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 583966720. Throughput: 0: 10042.7, 1: 9912.8. Samples: 583976828. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:36,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.798')] [2023-12-28 03:26:36,422][106226] Updated weights for policy 0, policy_version 1138906 (0.0008) [2023-12-28 03:26:36,455][106225] Updated weights for policy 1, policy_version 1141813 (0.0007) [2023-12-28 03:26:36,488][106226] Updated weights for policy 0, policy_version 1138916 (0.0008) [2023-12-28 03:26:36,517][106225] Updated weights for policy 1, policy_version 1141823 (0.0010) [2023-12-28 03:26:36,550][106226] Updated weights for policy 0, policy_version 1138926 (0.0008) [2023-12-28 03:26:36,577][106225] Updated weights for policy 1, policy_version 1141833 (0.0006) [2023-12-28 03:26:36,617][106226] Updated weights for policy 0, policy_version 1138936 (0.0007) [2023-12-28 03:26:37,289][106225] Updated weights for policy 1, policy_version 1141843 (0.0008) [2023-12-28 03:26:37,310][106226] Updated weights for policy 0, policy_version 1138946 (0.0008) [2023-12-28 03:26:37,346][106225] Updated weights for policy 1, policy_version 1141853 (0.0005) [2023-12-28 03:26:37,362][106226] Updated weights for policy 0, policy_version 1138956 (0.0008) [2023-12-28 03:26:37,404][106225] Updated weights for policy 1, policy_version 1141863 (0.0006) [2023-12-28 03:26:37,426][106226] Updated weights for policy 0, policy_version 1138966 (0.0007) [2023-12-28 03:26:38,084][106225] Updated weights for policy 1, policy_version 1141873 (0.0008) [2023-12-28 03:26:38,143][106225] Updated weights for policy 1, policy_version 1141883 (0.0005) [2023-12-28 03:26:38,164][106226] Updated weights for policy 0, policy_version 1138976 (0.0005) [2023-12-28 03:26:38,208][106225] Updated weights for policy 1, policy_version 1141893 (0.0006) [2023-12-28 03:26:38,217][106226] Updated weights for policy 0, policy_version 1138986 (0.0009) [2023-12-28 03:26:38,263][106226] Updated weights for policy 0, policy_version 1138996 (0.0005) [2023-12-28 03:26:38,266][106225] Updated weights for policy 1, policy_version 1141903 (0.0007) [2023-12-28 03:26:38,945][106225] Updated weights for policy 1, policy_version 1141913 (0.0009) [2023-12-28 03:26:39,001][106225] Updated weights for policy 1, policy_version 1141923 (0.0010) [2023-12-28 03:26:39,042][106226] Updated weights for policy 0, policy_version 1139006 (0.0006) [2023-12-28 03:26:39,052][106225] Updated weights for policy 1, policy_version 1141933 (0.0010) [2023-12-28 03:26:39,089][106226] Updated weights for policy 0, policy_version 1139016 (0.0006) [2023-12-28 03:26:39,146][106226] Updated weights for policy 0, policy_version 1139026 (0.0009) [2023-12-28 03:26:39,842][106225] Updated weights for policy 1, policy_version 1141943 (0.0008) [2023-12-28 03:26:39,901][106225] Updated weights for policy 1, policy_version 1141953 (0.0008) [2023-12-28 03:26:39,965][106225] Updated weights for policy 1, policy_version 1141963 (0.0011) [2023-12-28 03:26:39,989][106226] Updated weights for policy 0, policy_version 1139036 (0.0010) [2023-12-28 03:26:40,055][106226] Updated weights for policy 0, policy_version 1139046 (0.0011) [2023-12-28 03:26:40,129][106226] Updated weights for policy 0, policy_version 1139056 (0.0011) [2023-12-28 03:26:40,707][106225] Updated weights for policy 1, policy_version 1141973 (0.0011) [2023-12-28 03:26:40,754][106225] Updated weights for policy 1, policy_version 1141983 (0.0010) [2023-12-28 03:26:40,818][106225] Updated weights for policy 1, policy_version 1141993 (0.0010) [2023-12-28 03:26:40,844][106226] Updated weights for policy 0, policy_version 1139066 (0.0011) [2023-12-28 03:26:40,894][106226] Updated weights for policy 0, policy_version 1139076 (0.0011) [2023-12-28 03:26:40,955][106226] Updated weights for policy 0, policy_version 1139086 (0.0010) [2023-12-28 03:26:41,013][106226] Updated weights for policy 0, policy_version 1139096 (0.0011) [2023-12-28 03:26:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 584065024. Throughput: 0: 9973.7, 1: 9941.7. Samples: 584035284. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:41,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.905')] [2023-12-28 03:26:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001139096_291667968.pth... [2023-12-28 03:26:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001142000_292397056.pth... [2023-12-28 03:26:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001137944_291373056.pth [2023-12-28 03:26:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001140848_292102144.pth [2023-12-28 03:26:41,517][106225] Updated weights for policy 1, policy_version 1142003 (0.0009) [2023-12-28 03:26:41,577][106225] Updated weights for policy 1, policy_version 1142013 (0.0011) [2023-12-28 03:26:41,641][106225] Updated weights for policy 1, policy_version 1142023 (0.0011) [2023-12-28 03:26:41,855][106226] Updated weights for policy 0, policy_version 1139106 (0.0008) [2023-12-28 03:26:41,922][106226] Updated weights for policy 0, policy_version 1139116 (0.0008) [2023-12-28 03:26:41,991][106226] Updated weights for policy 0, policy_version 1139126 (0.0008) [2023-12-28 03:26:42,361][106225] Updated weights for policy 1, policy_version 1142033 (0.0010) [2023-12-28 03:26:42,428][106225] Updated weights for policy 1, policy_version 1142043 (0.0009) [2023-12-28 03:26:42,490][106225] Updated weights for policy 1, policy_version 1142053 (0.0008) [2023-12-28 03:26:42,544][106225] Updated weights for policy 1, policy_version 1142063 (0.0010) [2023-12-28 03:26:42,664][106226] Updated weights for policy 0, policy_version 1139136 (0.0006) [2023-12-28 03:26:42,725][106226] Updated weights for policy 0, policy_version 1139146 (0.0007) [2023-12-28 03:26:42,785][106226] Updated weights for policy 0, policy_version 1139156 (0.0008) [2023-12-28 03:26:43,298][106225] Updated weights for policy 1, policy_version 1142073 (0.0011) [2023-12-28 03:26:43,361][106225] Updated weights for policy 1, policy_version 1142083 (0.0010) [2023-12-28 03:26:43,413][106225] Updated weights for policy 1, policy_version 1142093 (0.0010) [2023-12-28 03:26:43,420][106226] Updated weights for policy 0, policy_version 1139166 (0.0009) [2023-12-28 03:26:43,480][106226] Updated weights for policy 0, policy_version 1139176 (0.0009) [2023-12-28 03:26:43,534][106226] Updated weights for policy 0, policy_version 1139186 (0.0008) [2023-12-28 03:26:44,121][106225] Updated weights for policy 1, policy_version 1142103 (0.0007) [2023-12-28 03:26:44,186][106225] Updated weights for policy 1, policy_version 1142113 (0.0008) [2023-12-28 03:26:44,248][106225] Updated weights for policy 1, policy_version 1142123 (0.0010) [2023-12-28 03:26:44,261][106226] Updated weights for policy 0, policy_version 1139196 (0.0008) [2023-12-28 03:26:44,321][106226] Updated weights for policy 0, policy_version 1139206 (0.0008) [2023-12-28 03:26:44,382][106226] Updated weights for policy 0, policy_version 1139216 (0.0009) [2023-12-28 03:26:44,826][106225] Updated weights for policy 1, policy_version 1142133 (0.0008) [2023-12-28 03:26:44,889][106225] Updated weights for policy 1, policy_version 1142143 (0.0010) [2023-12-28 03:26:44,944][106225] Updated weights for policy 1, policy_version 1142153 (0.0010) [2023-12-28 03:26:45,152][106226] Updated weights for policy 0, policy_version 1139226 (0.0007) [2023-12-28 03:26:45,216][106226] Updated weights for policy 0, policy_version 1139236 (0.0008) [2023-12-28 03:26:45,274][106226] Updated weights for policy 0, policy_version 1139246 (0.0008) [2023-12-28 03:26:45,329][106226] Updated weights for policy 0, policy_version 1139256 (0.0008) [2023-12-28 03:26:45,625][106225] Updated weights for policy 1, policy_version 1142163 (0.0009) [2023-12-28 03:26:45,684][106225] Updated weights for policy 1, policy_version 1142173 (0.0005) [2023-12-28 03:26:45,734][106225] Updated weights for policy 1, policy_version 1142183 (0.0005) [2023-12-28 03:26:46,047][106226] Updated weights for policy 0, policy_version 1139266 (0.0006) [2023-12-28 03:26:46,101][106226] Updated weights for policy 0, policy_version 1139276 (0.0008) [2023-12-28 03:26:46,162][106226] Updated weights for policy 0, policy_version 1139286 (0.0008) [2023-12-28 03:26:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 584163328. Throughput: 0: 9937.0, 1: 9851.0. Samples: 584149956. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:46,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-4.926')] [2023-12-28 03:26:46,351][106225] Updated weights for policy 1, policy_version 1142193 (0.0005) [2023-12-28 03:26:46,398][106225] Updated weights for policy 1, policy_version 1142203 (0.0005) [2023-12-28 03:26:46,444][106225] Updated weights for policy 1, policy_version 1142213 (0.0005) [2023-12-28 03:26:46,490][106225] Updated weights for policy 1, policy_version 1142223 (0.0005) [2023-12-28 03:26:46,895][106226] Updated weights for policy 0, policy_version 1139296 (0.0006) [2023-12-28 03:26:46,949][106226] Updated weights for policy 0, policy_version 1139306 (0.0005) [2023-12-28 03:26:47,008][106226] Updated weights for policy 0, policy_version 1139316 (0.0005) [2023-12-28 03:26:47,031][106225] Updated weights for policy 1, policy_version 1142233 (0.0005) [2023-12-28 03:26:47,093][106225] Updated weights for policy 1, policy_version 1142243 (0.0005) [2023-12-28 03:26:47,154][106225] Updated weights for policy 1, policy_version 1142253 (0.0006) [2023-12-28 03:26:47,632][106226] Updated weights for policy 0, policy_version 1139326 (0.0005) [2023-12-28 03:26:47,693][106226] Updated weights for policy 0, policy_version 1139336 (0.0007) [2023-12-28 03:26:47,757][106226] Updated weights for policy 0, policy_version 1139346 (0.0008) [2023-12-28 03:26:47,833][106225] Updated weights for policy 1, policy_version 1142263 (0.0008) [2023-12-28 03:26:47,886][106225] Updated weights for policy 1, policy_version 1142273 (0.0009) [2023-12-28 03:26:47,951][106225] Updated weights for policy 1, policy_version 1142283 (0.0008) [2023-12-28 03:26:48,442][106226] Updated weights for policy 0, policy_version 1139356 (0.0009) [2023-12-28 03:26:48,502][106226] Updated weights for policy 0, policy_version 1139366 (0.0007) [2023-12-28 03:26:48,559][106226] Updated weights for policy 0, policy_version 1139376 (0.0005) [2023-12-28 03:26:48,664][106225] Updated weights for policy 1, policy_version 1142293 (0.0009) [2023-12-28 03:26:48,722][106225] Updated weights for policy 1, policy_version 1142303 (0.0009) [2023-12-28 03:26:48,785][106225] Updated weights for policy 1, policy_version 1142313 (0.0007) [2023-12-28 03:26:49,147][106226] Updated weights for policy 0, policy_version 1139386 (0.0006) [2023-12-28 03:26:49,204][106226] Updated weights for policy 0, policy_version 1139396 (0.0009) [2023-12-28 03:26:49,271][106226] Updated weights for policy 0, policy_version 1139406 (0.0009) [2023-12-28 03:26:49,335][106226] Updated weights for policy 0, policy_version 1139416 (0.0009) [2023-12-28 03:26:49,599][106225] Updated weights for policy 1, policy_version 1142323 (0.0009) [2023-12-28 03:26:49,659][106225] Updated weights for policy 1, policy_version 1142333 (0.0007) [2023-12-28 03:26:49,719][106225] Updated weights for policy 1, policy_version 1142343 (0.0005) [2023-12-28 03:26:49,978][106226] Updated weights for policy 0, policy_version 1139426 (0.0007) [2023-12-28 03:26:50,037][106226] Updated weights for policy 0, policy_version 1139436 (0.0007) [2023-12-28 03:26:50,094][106226] Updated weights for policy 0, policy_version 1139446 (0.0006) [2023-12-28 03:26:50,429][106225] Updated weights for policy 1, policy_version 1142353 (0.0005) [2023-12-28 03:26:50,483][106225] Updated weights for policy 1, policy_version 1142363 (0.0006) [2023-12-28 03:26:50,542][106225] Updated weights for policy 1, policy_version 1142373 (0.0005) [2023-12-28 03:26:50,610][106225] Updated weights for policy 1, policy_version 1142383 (0.0007) [2023-12-28 03:26:50,833][106226] Updated weights for policy 0, policy_version 1139456 (0.0008) [2023-12-28 03:26:50,897][106226] Updated weights for policy 0, policy_version 1139466 (0.0008) [2023-12-28 03:26:50,966][106226] Updated weights for policy 0, policy_version 1139476 (0.0008) [2023-12-28 03:26:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 584261632. Throughput: 0: 9926.0, 1: 9880.0. Samples: 584271736. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:51,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.873')] [2023-12-28 03:26:51,247][106225] Updated weights for policy 1, policy_version 1142393 (0.0008) [2023-12-28 03:26:51,318][106225] Updated weights for policy 1, policy_version 1142403 (0.0008) [2023-12-28 03:26:51,391][106225] Updated weights for policy 1, policy_version 1142413 (0.0009) [2023-12-28 03:26:51,708][106226] Updated weights for policy 0, policy_version 1139486 (0.0007) [2023-12-28 03:26:51,779][106226] Updated weights for policy 0, policy_version 1139496 (0.0008) [2023-12-28 03:26:51,842][106226] Updated weights for policy 0, policy_version 1139506 (0.0008) [2023-12-28 03:26:52,064][106225] Updated weights for policy 1, policy_version 1142423 (0.0007) [2023-12-28 03:26:52,115][106225] Updated weights for policy 1, policy_version 1142433 (0.0006) [2023-12-28 03:26:52,166][106225] Updated weights for policy 1, policy_version 1142443 (0.0008) [2023-12-28 03:26:52,594][106226] Updated weights for policy 0, policy_version 1139516 (0.0008) [2023-12-28 03:26:52,650][106226] Updated weights for policy 0, policy_version 1139526 (0.0009) [2023-12-28 03:26:52,705][106226] Updated weights for policy 0, policy_version 1139536 (0.0008) [2023-12-28 03:26:52,830][106225] Updated weights for policy 1, policy_version 1142453 (0.0007) [2023-12-28 03:26:52,886][106225] Updated weights for policy 1, policy_version 1142463 (0.0006) [2023-12-28 03:26:52,932][106225] Updated weights for policy 1, policy_version 1142473 (0.0005) [2023-12-28 03:26:53,406][106226] Updated weights for policy 0, policy_version 1139546 (0.0009) [2023-12-28 03:26:53,478][106226] Updated weights for policy 0, policy_version 1139556 (0.0006) [2023-12-28 03:26:53,538][106226] Updated weights for policy 0, policy_version 1139566 (0.0009) [2023-12-28 03:26:53,588][106226] Updated weights for policy 0, policy_version 1139576 (0.0010) [2023-12-28 03:26:53,613][106225] Updated weights for policy 1, policy_version 1142483 (0.0006) [2023-12-28 03:26:53,670][106225] Updated weights for policy 1, policy_version 1142493 (0.0008) [2023-12-28 03:26:53,720][106225] Updated weights for policy 1, policy_version 1142503 (0.0009) [2023-12-28 03:26:54,263][106226] Updated weights for policy 0, policy_version 1139586 (0.0010) [2023-12-28 03:26:54,313][106226] Updated weights for policy 0, policy_version 1139596 (0.0010) [2023-12-28 03:26:54,359][106226] Updated weights for policy 0, policy_version 1139606 (0.0010) [2023-12-28 03:26:54,466][106225] Updated weights for policy 1, policy_version 1142513 (0.0007) [2023-12-28 03:26:54,527][106225] Updated weights for policy 1, policy_version 1142523 (0.0005) [2023-12-28 03:26:54,576][106225] Updated weights for policy 1, policy_version 1142533 (0.0006) [2023-12-28 03:26:54,634][106225] Updated weights for policy 1, policy_version 1142543 (0.0008) [2023-12-28 03:26:55,119][106226] Updated weights for policy 0, policy_version 1139616 (0.0010) [2023-12-28 03:26:55,170][106226] Updated weights for policy 0, policy_version 1139626 (0.0011) [2023-12-28 03:26:55,240][106226] Updated weights for policy 0, policy_version 1139636 (0.0010) [2023-12-28 03:26:55,279][106225] Updated weights for policy 1, policy_version 1142553 (0.0007) [2023-12-28 03:26:55,328][106225] Updated weights for policy 1, policy_version 1142563 (0.0007) [2023-12-28 03:26:55,384][106225] Updated weights for policy 1, policy_version 1142573 (0.0008) [2023-12-28 03:26:55,930][106226] Updated weights for policy 0, policy_version 1139646 (0.0011) [2023-12-28 03:26:55,986][106226] Updated weights for policy 0, policy_version 1139656 (0.0011) [2023-12-28 03:26:56,041][106226] Updated weights for policy 0, policy_version 1139666 (0.0008) [2023-12-28 03:26:56,113][106225] Updated weights for policy 1, policy_version 1142583 (0.0007) [2023-12-28 03:26:56,169][106225] Updated weights for policy 1, policy_version 1142593 (0.0005) [2023-12-28 03:26:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 584359936. Throughput: 0: 9883.4, 1: 9893.5. Samples: 584330872. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:26:56,176][105115] Avg episode reward: [(0, '-4.347'), (1, '-4.551')] [2023-12-28 03:26:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001139672_291815424.pth... [2023-12-28 03:26:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001138520_291520512.pth [2023-12-28 03:26:56,222][106225] Updated weights for policy 1, policy_version 1142603 (0.0005) [2023-12-28 03:26:56,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001142608_292552704.pth... [2023-12-28 03:26:56,248][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001141424_292249600.pth [2023-12-28 03:26:56,606][106226] Updated weights for policy 0, policy_version 1139676 (0.0009) [2023-12-28 03:26:56,650][106226] Updated weights for policy 0, policy_version 1139686 (0.0005) [2023-12-28 03:26:56,701][106226] Updated weights for policy 0, policy_version 1139696 (0.0005) [2023-12-28 03:26:56,745][106225] Updated weights for policy 1, policy_version 1142613 (0.0005) [2023-12-28 03:26:56,802][106225] Updated weights for policy 1, policy_version 1142623 (0.0005) [2023-12-28 03:26:56,869][106225] Updated weights for policy 1, policy_version 1142633 (0.0005) [2023-12-28 03:26:57,293][106226] Updated weights for policy 0, policy_version 1139706 (0.0008) [2023-12-28 03:26:57,343][106226] Updated weights for policy 0, policy_version 1139716 (0.0009) [2023-12-28 03:26:57,354][106225] Updated weights for policy 1, policy_version 1142643 (0.0006) [2023-12-28 03:26:57,391][106226] Updated weights for policy 0, policy_version 1139726 (0.0005) [2023-12-28 03:26:57,399][106225] Updated weights for policy 1, policy_version 1142653 (0.0008) [2023-12-28 03:26:57,441][106226] Updated weights for policy 0, policy_version 1139736 (0.0009) [2023-12-28 03:26:57,451][106225] Updated weights for policy 1, policy_version 1142663 (0.0006) [2023-12-28 03:26:58,062][106225] Updated weights for policy 1, policy_version 1142673 (0.0008) [2023-12-28 03:26:58,094][106226] Updated weights for policy 0, policy_version 1139746 (0.0011) [2023-12-28 03:26:58,125][106225] Updated weights for policy 1, policy_version 1142683 (0.0008) [2023-12-28 03:26:58,152][106226] Updated weights for policy 0, policy_version 1139756 (0.0010) [2023-12-28 03:26:58,183][106225] Updated weights for policy 1, policy_version 1142693 (0.0008) [2023-12-28 03:26:58,217][106226] Updated weights for policy 0, policy_version 1139766 (0.0008) [2023-12-28 03:26:58,247][106225] Updated weights for policy 1, policy_version 1142703 (0.0009) [2023-12-28 03:26:59,035][106226] Updated weights for policy 0, policy_version 1139776 (0.0009) [2023-12-28 03:26:59,064][106225] Updated weights for policy 1, policy_version 1142713 (0.0007) [2023-12-28 03:26:59,098][106226] Updated weights for policy 0, policy_version 1139786 (0.0006) [2023-12-28 03:26:59,125][106225] Updated weights for policy 1, policy_version 1142723 (0.0006) [2023-12-28 03:26:59,161][106226] Updated weights for policy 0, policy_version 1139796 (0.0010) [2023-12-28 03:26:59,181][106225] Updated weights for policy 1, policy_version 1142733 (0.0006) [2023-12-28 03:26:59,871][106226] Updated weights for policy 0, policy_version 1139806 (0.0009) [2023-12-28 03:26:59,912][106225] Updated weights for policy 1, policy_version 1142743 (0.0007) [2023-12-28 03:26:59,938][106226] Updated weights for policy 0, policy_version 1139816 (0.0009) [2023-12-28 03:26:59,974][106225] Updated weights for policy 1, policy_version 1142753 (0.0006) [2023-12-28 03:27:00,002][106226] Updated weights for policy 0, policy_version 1139826 (0.0008) [2023-12-28 03:27:00,031][106225] Updated weights for policy 1, policy_version 1142763 (0.0006) [2023-12-28 03:27:00,686][106226] Updated weights for policy 0, policy_version 1139836 (0.0007) [2023-12-28 03:27:00,704][106225] Updated weights for policy 1, policy_version 1142773 (0.0007) [2023-12-28 03:27:00,735][106226] Updated weights for policy 0, policy_version 1139846 (0.0005) [2023-12-28 03:27:00,750][106225] Updated weights for policy 1, policy_version 1142783 (0.0010) [2023-12-28 03:27:00,786][106226] Updated weights for policy 0, policy_version 1139856 (0.0005) [2023-12-28 03:27:00,793][106225] Updated weights for policy 1, policy_version 1142793 (0.0010) [2023-12-28 03:27:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 584466432. Throughput: 0: 9962.5, 1: 10019.6. Samples: 584454736. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:27:01,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.790')] [2023-12-28 03:27:01,500][106226] Updated weights for policy 0, policy_version 1139866 (0.0006) [2023-12-28 03:27:01,556][106226] Updated weights for policy 0, policy_version 1139876 (0.0009) [2023-12-28 03:27:01,594][106225] Updated weights for policy 1, policy_version 1142803 (0.0010) [2023-12-28 03:27:01,608][106226] Updated weights for policy 0, policy_version 1139886 (0.0009) [2023-12-28 03:27:01,658][106225] Updated weights for policy 1, policy_version 1142813 (0.0009) [2023-12-28 03:27:01,668][106226] Updated weights for policy 0, policy_version 1139896 (0.0009) [2023-12-28 03:27:01,710][106225] Updated weights for policy 1, policy_version 1142823 (0.0009) [2023-12-28 03:27:02,359][106226] Updated weights for policy 0, policy_version 1139906 (0.0006) [2023-12-28 03:27:02,428][106226] Updated weights for policy 0, policy_version 1139916 (0.0007) [2023-12-28 03:27:02,463][106225] Updated weights for policy 1, policy_version 1142833 (0.0009) [2023-12-28 03:27:02,481][106226] Updated weights for policy 0, policy_version 1139926 (0.0010) [2023-12-28 03:27:02,514][106225] Updated weights for policy 1, policy_version 1142843 (0.0006) [2023-12-28 03:27:02,571][106225] Updated weights for policy 1, policy_version 1142853 (0.0005) [2023-12-28 03:27:02,626][106225] Updated weights for policy 1, policy_version 1142863 (0.0005) [2023-12-28 03:27:03,231][106226] Updated weights for policy 0, policy_version 1139936 (0.0008) [2023-12-28 03:27:03,256][106225] Updated weights for policy 1, policy_version 1142873 (0.0006) [2023-12-28 03:27:03,286][106226] Updated weights for policy 0, policy_version 1139946 (0.0007) [2023-12-28 03:27:03,300][106225] Updated weights for policy 1, policy_version 1142883 (0.0006) [2023-12-28 03:27:03,347][106226] Updated weights for policy 0, policy_version 1139956 (0.0007) [2023-12-28 03:27:03,360][106225] Updated weights for policy 1, policy_version 1142893 (0.0007) [2023-12-28 03:27:03,998][106226] Updated weights for policy 0, policy_version 1139966 (0.0008) [2023-12-28 03:27:04,057][106226] Updated weights for policy 0, policy_version 1139976 (0.0007) [2023-12-28 03:27:04,117][106226] Updated weights for policy 0, policy_version 1139986 (0.0006) [2023-12-28 03:27:04,141][106225] Updated weights for policy 1, policy_version 1142903 (0.0007) [2023-12-28 03:27:04,205][106225] Updated weights for policy 1, policy_version 1142913 (0.0009) [2023-12-28 03:27:04,275][106225] Updated weights for policy 1, policy_version 1142923 (0.0008) [2023-12-28 03:27:04,776][106226] Updated weights for policy 0, policy_version 1139996 (0.0007) [2023-12-28 03:27:04,835][106226] Updated weights for policy 0, policy_version 1140006 (0.0009) [2023-12-28 03:27:04,885][106226] Updated weights for policy 0, policy_version 1140016 (0.0005) [2023-12-28 03:27:05,018][106225] Updated weights for policy 1, policy_version 1142933 (0.0010) [2023-12-28 03:27:05,071][106225] Updated weights for policy 1, policy_version 1142943 (0.0008) [2023-12-28 03:27:05,121][106225] Updated weights for policy 1, policy_version 1142953 (0.0008) [2023-12-28 03:27:05,501][106226] Updated weights for policy 0, policy_version 1140026 (0.0007) [2023-12-28 03:27:05,565][106226] Updated weights for policy 0, policy_version 1140036 (0.0008) [2023-12-28 03:27:05,627][106226] Updated weights for policy 0, policy_version 1140046 (0.0006) [2023-12-28 03:27:05,689][106226] Updated weights for policy 0, policy_version 1140056 (0.0007) [2023-12-28 03:27:05,925][106225] Updated weights for policy 1, policy_version 1142963 (0.0008) [2023-12-28 03:27:05,974][106225] Updated weights for policy 1, policy_version 1142973 (0.0010) [2023-12-28 03:27:06,034][106225] Updated weights for policy 1, policy_version 1142983 (0.0010) [2023-12-28 03:27:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 584564736. Throughput: 0: 9965.8, 1: 9992.3. Samples: 584573920. Policy #0 lag: (min: 19.0, avg: 28.9, max: 51.0) [2023-12-28 03:27:06,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.729')] [2023-12-28 03:27:06,245][106226] Updated weights for policy 0, policy_version 1140066 (0.0008) [2023-12-28 03:27:06,308][106226] Updated weights for policy 0, policy_version 1140076 (0.0008) [2023-12-28 03:27:06,380][106226] Updated weights for policy 0, policy_version 1140086 (0.0009) [2023-12-28 03:27:06,778][106225] Updated weights for policy 1, policy_version 1142993 (0.0010) [2023-12-28 03:27:06,829][106225] Updated weights for policy 1, policy_version 1143003 (0.0010) [2023-12-28 03:27:06,894][106225] Updated weights for policy 1, policy_version 1143013 (0.0007) [2023-12-28 03:27:06,960][106225] Updated weights for policy 1, policy_version 1143023 (0.0005) [2023-12-28 03:27:07,010][106226] Updated weights for policy 0, policy_version 1140096 (0.0010) [2023-12-28 03:27:07,067][106226] Updated weights for policy 0, policy_version 1140106 (0.0010) [2023-12-28 03:27:07,127][106226] Updated weights for policy 0, policy_version 1140116 (0.0011) [2023-12-28 03:27:07,588][106225] Updated weights for policy 1, policy_version 1143033 (0.0010) [2023-12-28 03:27:07,649][106225] Updated weights for policy 1, policy_version 1143043 (0.0007) [2023-12-28 03:27:07,712][106225] Updated weights for policy 1, policy_version 1143053 (0.0006) [2023-12-28 03:27:07,718][106226] Updated weights for policy 0, policy_version 1140126 (0.0010) [2023-12-28 03:27:07,782][106226] Updated weights for policy 0, policy_version 1140136 (0.0011) [2023-12-28 03:27:07,836][106226] Updated weights for policy 0, policy_version 1140146 (0.0011) [2023-12-28 03:27:08,232][106225] Updated weights for policy 1, policy_version 1143063 (0.0007) [2023-12-28 03:27:08,299][106225] Updated weights for policy 1, policy_version 1143073 (0.0008) [2023-12-28 03:27:08,368][106225] Updated weights for policy 1, policy_version 1143083 (0.0009) [2023-12-28 03:27:08,565][106226] Updated weights for policy 0, policy_version 1140156 (0.0011) [2023-12-28 03:27:08,624][106226] Updated weights for policy 0, policy_version 1140166 (0.0011) [2023-12-28 03:27:08,678][106226] Updated weights for policy 0, policy_version 1140176 (0.0011) [2023-12-28 03:27:09,093][106225] Updated weights for policy 1, policy_version 1143093 (0.0008) [2023-12-28 03:27:09,150][106225] Updated weights for policy 1, policy_version 1143103 (0.0008) [2023-12-28 03:27:09,209][106225] Updated weights for policy 1, policy_version 1143113 (0.0008) [2023-12-28 03:27:09,459][106226] Updated weights for policy 0, policy_version 1140186 (0.0010) [2023-12-28 03:27:09,524][106226] Updated weights for policy 0, policy_version 1140196 (0.0011) [2023-12-28 03:27:09,582][106226] Updated weights for policy 0, policy_version 1140206 (0.0011) [2023-12-28 03:27:09,644][106226] Updated weights for policy 0, policy_version 1140216 (0.0010) [2023-12-28 03:27:10,019][106225] Updated weights for policy 1, policy_version 1143123 (0.0009) [2023-12-28 03:27:10,081][106225] Updated weights for policy 1, policy_version 1143133 (0.0008) [2023-12-28 03:27:10,150][106225] Updated weights for policy 1, policy_version 1143143 (0.0008) [2023-12-28 03:27:10,349][106226] Updated weights for policy 0, policy_version 1140226 (0.0011) [2023-12-28 03:27:10,413][106226] Updated weights for policy 0, policy_version 1140236 (0.0011) [2023-12-28 03:27:10,484][106226] Updated weights for policy 0, policy_version 1140246 (0.0011) [2023-12-28 03:27:10,874][106225] Updated weights for policy 1, policy_version 1143153 (0.0008) [2023-12-28 03:27:10,932][106225] Updated weights for policy 1, policy_version 1143163 (0.0008) [2023-12-28 03:27:10,989][106225] Updated weights for policy 1, policy_version 1143173 (0.0007) [2023-12-28 03:27:11,060][106225] Updated weights for policy 1, policy_version 1143183 (0.0007) [2023-12-28 03:27:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 584663040. Throughput: 0: 10004.5, 1: 10070.1. Samples: 584635916. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:11,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.616')] [2023-12-28 03:27:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001143184_292700160.pth... [2023-12-28 03:27:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001142000_292397056.pth [2023-12-28 03:27:11,237][106226] Updated weights for policy 0, policy_version 1140256 (0.0010) [2023-12-28 03:27:11,302][106226] Updated weights for policy 0, policy_version 1140266 (0.0007) [2023-12-28 03:27:11,369][106226] Updated weights for policy 0, policy_version 1140276 (0.0006) [2023-12-28 03:27:11,398][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001140280_291971072.pth... [2023-12-28 03:27:11,402][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001139096_291667968.pth [2023-12-28 03:27:11,801][106225] Updated weights for policy 1, policy_version 1143193 (0.0008) [2023-12-28 03:27:11,857][106225] Updated weights for policy 1, policy_version 1143203 (0.0008) [2023-12-28 03:27:11,919][106225] Updated weights for policy 1, policy_version 1143213 (0.0008) [2023-12-28 03:27:12,155][106226] Updated weights for policy 0, policy_version 1140286 (0.0009) [2023-12-28 03:27:12,215][106226] Updated weights for policy 0, policy_version 1140296 (0.0009) [2023-12-28 03:27:12,272][106226] Updated weights for policy 0, policy_version 1140306 (0.0009) [2023-12-28 03:27:12,573][106225] Updated weights for policy 1, policy_version 1143223 (0.0008) [2023-12-28 03:27:12,630][106225] Updated weights for policy 1, policy_version 1143233 (0.0009) [2023-12-28 03:27:12,690][106225] Updated weights for policy 1, policy_version 1143243 (0.0008) [2023-12-28 03:27:13,024][106226] Updated weights for policy 0, policy_version 1140316 (0.0009) [2023-12-28 03:27:13,077][106226] Updated weights for policy 0, policy_version 1140326 (0.0007) [2023-12-28 03:27:13,135][106226] Updated weights for policy 0, policy_version 1140336 (0.0006) [2023-12-28 03:27:13,432][106225] Updated weights for policy 1, policy_version 1143253 (0.0008) [2023-12-28 03:27:13,495][106225] Updated weights for policy 1, policy_version 1143263 (0.0008) [2023-12-28 03:27:13,564][106225] Updated weights for policy 1, policy_version 1143273 (0.0008) [2023-12-28 03:27:13,943][106226] Updated weights for policy 0, policy_version 1140347 (0.0008) [2023-12-28 03:27:13,999][106226] Updated weights for policy 0, policy_version 1140357 (0.0008) [2023-12-28 03:27:14,055][106226] Updated weights for policy 0, policy_version 1140367 (0.0009) [2023-12-28 03:27:14,236][106225] Updated weights for policy 1, policy_version 1143283 (0.0006) [2023-12-28 03:27:14,289][106225] Updated weights for policy 1, policy_version 1143293 (0.0006) [2023-12-28 03:27:14,347][106225] Updated weights for policy 1, policy_version 1143303 (0.0006) [2023-12-28 03:27:14,714][106226] Updated weights for policy 0, policy_version 1140377 (0.0008) [2023-12-28 03:27:14,785][106226] Updated weights for policy 0, policy_version 1140387 (0.0007) [2023-12-28 03:27:14,849][106226] Updated weights for policy 0, policy_version 1140397 (0.0008) [2023-12-28 03:27:14,913][106226] Updated weights for policy 0, policy_version 1140407 (0.0010) [2023-12-28 03:27:14,924][106225] Updated weights for policy 1, policy_version 1143313 (0.0005) [2023-12-28 03:27:14,994][106225] Updated weights for policy 1, policy_version 1143323 (0.0006) [2023-12-28 03:27:15,062][106225] Updated weights for policy 1, policy_version 1143333 (0.0006) [2023-12-28 03:27:15,129][106225] Updated weights for policy 1, policy_version 1143343 (0.0006) [2023-12-28 03:27:15,659][106225] Updated weights for policy 1, policy_version 1143353 (0.0006) [2023-12-28 03:27:15,710][106226] Updated weights for policy 0, policy_version 1140417 (0.0009) [2023-12-28 03:27:15,727][106225] Updated weights for policy 1, policy_version 1143363 (0.0006) [2023-12-28 03:27:15,771][106226] Updated weights for policy 0, policy_version 1140427 (0.0007) [2023-12-28 03:27:15,785][106225] Updated weights for policy 1, policy_version 1143373 (0.0005) [2023-12-28 03:27:15,830][106226] Updated weights for policy 0, policy_version 1140437 (0.0008) [2023-12-28 03:27:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 584761344. Throughput: 0: 9864.8, 1: 9980.9. Samples: 584749992. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:16,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.880')] [2023-12-28 03:27:16,390][106225] Updated weights for policy 1, policy_version 1143383 (0.0008) [2023-12-28 03:27:16,454][106225] Updated weights for policy 1, policy_version 1143393 (0.0009) [2023-12-28 03:27:16,482][106226] Updated weights for policy 0, policy_version 1140447 (0.0007) [2023-12-28 03:27:16,515][106225] Updated weights for policy 1, policy_version 1143403 (0.0006) [2023-12-28 03:27:16,537][106226] Updated weights for policy 0, policy_version 1140457 (0.0007) [2023-12-28 03:27:16,594][106226] Updated weights for policy 0, policy_version 1140467 (0.0011) [2023-12-28 03:27:17,205][106225] Updated weights for policy 1, policy_version 1143413 (0.0006) [2023-12-28 03:27:17,225][106226] Updated weights for policy 0, policy_version 1140477 (0.0010) [2023-12-28 03:27:17,260][106225] Updated weights for policy 1, policy_version 1143423 (0.0005) [2023-12-28 03:27:17,282][106226] Updated weights for policy 0, policy_version 1140487 (0.0011) [2023-12-28 03:27:17,318][106225] Updated weights for policy 1, policy_version 1143433 (0.0005) [2023-12-28 03:27:17,332][106226] Updated weights for policy 0, policy_version 1140497 (0.0010) [2023-12-28 03:27:17,943][106225] Updated weights for policy 1, policy_version 1143443 (0.0006) [2023-12-28 03:27:17,995][106225] Updated weights for policy 1, policy_version 1143453 (0.0007) [2023-12-28 03:27:18,030][106226] Updated weights for policy 0, policy_version 1140507 (0.0010) [2023-12-28 03:27:18,056][106225] Updated weights for policy 1, policy_version 1143463 (0.0005) [2023-12-28 03:27:18,084][106226] Updated weights for policy 0, policy_version 1140517 (0.0010) [2023-12-28 03:27:18,134][106226] Updated weights for policy 0, policy_version 1140527 (0.0010) [2023-12-28 03:27:18,722][106225] Updated weights for policy 1, policy_version 1143473 (0.0006) [2023-12-28 03:27:18,785][106225] Updated weights for policy 1, policy_version 1143483 (0.0008) [2023-12-28 03:27:18,844][106225] Updated weights for policy 1, policy_version 1143493 (0.0008) [2023-12-28 03:27:18,880][106226] Updated weights for policy 0, policy_version 1140537 (0.0011) [2023-12-28 03:27:18,906][106225] Updated weights for policy 1, policy_version 1143503 (0.0007) [2023-12-28 03:27:18,944][106226] Updated weights for policy 0, policy_version 1140547 (0.0008) [2023-12-28 03:27:19,005][106226] Updated weights for policy 0, policy_version 1140557 (0.0008) [2023-12-28 03:27:19,066][106226] Updated weights for policy 0, policy_version 1140567 (0.0006) [2023-12-28 03:27:19,623][106225] Updated weights for policy 1, policy_version 1143513 (0.0006) [2023-12-28 03:27:19,688][106225] Updated weights for policy 1, policy_version 1143523 (0.0005) [2023-12-28 03:27:19,751][106225] Updated weights for policy 1, policy_version 1143533 (0.0005) [2023-12-28 03:27:19,785][106226] Updated weights for policy 0, policy_version 1140577 (0.0010) [2023-12-28 03:27:19,853][106226] Updated weights for policy 0, policy_version 1140587 (0.0009) [2023-12-28 03:27:19,912][106226] Updated weights for policy 0, policy_version 1140597 (0.0011) [2023-12-28 03:27:20,368][106225] Updated weights for policy 1, policy_version 1143543 (0.0007) [2023-12-28 03:27:20,430][106225] Updated weights for policy 1, policy_version 1143553 (0.0008) [2023-12-28 03:27:20,488][106225] Updated weights for policy 1, policy_version 1143563 (0.0008) [2023-12-28 03:27:20,665][106226] Updated weights for policy 0, policy_version 1140607 (0.0008) [2023-12-28 03:27:20,734][106226] Updated weights for policy 0, policy_version 1140617 (0.0009) [2023-12-28 03:27:20,796][106226] Updated weights for policy 0, policy_version 1140627 (0.0009) [2023-12-28 03:27:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 584859648. Throughput: 0: 9818.9, 1: 10049.2. Samples: 584870892. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:21,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-4.499')] [2023-12-28 03:27:21,224][106225] Updated weights for policy 1, policy_version 1143573 (0.0008) [2023-12-28 03:27:21,279][106225] Updated weights for policy 1, policy_version 1143583 (0.0008) [2023-12-28 03:27:21,341][106225] Updated weights for policy 1, policy_version 1143593 (0.0008) [2023-12-28 03:27:21,466][106226] Updated weights for policy 0, policy_version 1140637 (0.0007) [2023-12-28 03:27:21,522][106226] Updated weights for policy 0, policy_version 1140647 (0.0006) [2023-12-28 03:27:21,581][106226] Updated weights for policy 0, policy_version 1140657 (0.0007) [2023-12-28 03:27:22,180][106225] Updated weights for policy 1, policy_version 1143603 (0.0008) [2023-12-28 03:27:22,217][106226] Updated weights for policy 0, policy_version 1140667 (0.0010) [2023-12-28 03:27:22,242][106225] Updated weights for policy 1, policy_version 1143613 (0.0007) [2023-12-28 03:27:22,281][106226] Updated weights for policy 0, policy_version 1140677 (0.0011) [2023-12-28 03:27:22,311][106225] Updated weights for policy 1, policy_version 1143623 (0.0007) [2023-12-28 03:27:22,340][106226] Updated weights for policy 0, policy_version 1140687 (0.0011) [2023-12-28 03:27:23,047][106225] Updated weights for policy 1, policy_version 1143633 (0.0007) [2023-12-28 03:27:23,065][106226] Updated weights for policy 0, policy_version 1140697 (0.0010) [2023-12-28 03:27:23,103][106225] Updated weights for policy 1, policy_version 1143643 (0.0006) [2023-12-28 03:27:23,126][106226] Updated weights for policy 0, policy_version 1140707 (0.0008) [2023-12-28 03:27:23,159][106225] Updated weights for policy 1, policy_version 1143653 (0.0009) [2023-12-28 03:27:23,191][106226] Updated weights for policy 0, policy_version 1140717 (0.0007) [2023-12-28 03:27:23,207][106225] Updated weights for policy 1, policy_version 1143663 (0.0007) [2023-12-28 03:27:23,248][106226] Updated weights for policy 0, policy_version 1140727 (0.0008) [2023-12-28 03:27:23,833][106226] Updated weights for policy 0, policy_version 1140737 (0.0006) [2023-12-28 03:27:23,885][106226] Updated weights for policy 0, policy_version 1140747 (0.0005) [2023-12-28 03:27:23,943][106226] Updated weights for policy 0, policy_version 1140757 (0.0005) [2023-12-28 03:27:24,037][106225] Updated weights for policy 1, policy_version 1143673 (0.0009) [2023-12-28 03:27:24,109][106225] Updated weights for policy 1, policy_version 1143683 (0.0009) [2023-12-28 03:27:24,177][106225] Updated weights for policy 1, policy_version 1143693 (0.0010) [2023-12-28 03:27:24,498][106226] Updated weights for policy 0, policy_version 1140767 (0.0007) [2023-12-28 03:27:24,550][106226] Updated weights for policy 0, policy_version 1140777 (0.0007) [2023-12-28 03:27:24,617][106226] Updated weights for policy 0, policy_version 1140787 (0.0006) [2023-12-28 03:27:24,936][106225] Updated weights for policy 1, policy_version 1143703 (0.0010) [2023-12-28 03:27:24,997][106225] Updated weights for policy 1, policy_version 1143713 (0.0008) [2023-12-28 03:27:25,056][106225] Updated weights for policy 1, policy_version 1143723 (0.0008) [2023-12-28 03:27:25,197][106226] Updated weights for policy 0, policy_version 1140797 (0.0007) [2023-12-28 03:27:25,256][106226] Updated weights for policy 0, policy_version 1140807 (0.0005) [2023-12-28 03:27:25,313][106226] Updated weights for policy 0, policy_version 1140817 (0.0005) [2023-12-28 03:27:25,860][106225] Updated weights for policy 1, policy_version 1143733 (0.0008) [2023-12-28 03:27:25,882][106226] Updated weights for policy 0, policy_version 1140827 (0.0006) [2023-12-28 03:27:25,920][106225] Updated weights for policy 1, policy_version 1143743 (0.0007) [2023-12-28 03:27:25,940][106226] Updated weights for policy 0, policy_version 1140837 (0.0007) [2023-12-28 03:27:25,984][106225] Updated weights for policy 1, policy_version 1143753 (0.0008) [2023-12-28 03:27:25,999][106226] Updated weights for policy 0, policy_version 1140847 (0.0005) [2023-12-28 03:27:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 584966144. Throughput: 0: 9894.9, 1: 9989.0. Samples: 584930056. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:26,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.684')] [2023-12-28 03:27:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001143760_292847616.pth... [2023-12-28 03:27:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001140856_292118528.pth... [2023-12-28 03:27:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001142608_292552704.pth [2023-12-28 03:27:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001139672_291815424.pth [2023-12-28 03:27:26,541][106225] Updated weights for policy 1, policy_version 1143763 (0.0007) [2023-12-28 03:27:26,593][106225] Updated weights for policy 1, policy_version 1143773 (0.0005) [2023-12-28 03:27:26,648][106225] Updated weights for policy 1, policy_version 1143783 (0.0005) [2023-12-28 03:27:26,764][106226] Updated weights for policy 0, policy_version 1140857 (0.0007) [2023-12-28 03:27:26,809][106226] Updated weights for policy 0, policy_version 1140867 (0.0008) [2023-12-28 03:27:26,856][106226] Updated weights for policy 0, policy_version 1140877 (0.0008) [2023-12-28 03:27:26,918][106226] Updated weights for policy 0, policy_version 1140887 (0.0008) [2023-12-28 03:27:27,216][106225] Updated weights for policy 1, policy_version 1143793 (0.0006) [2023-12-28 03:27:27,266][106225] Updated weights for policy 1, policy_version 1143803 (0.0006) [2023-12-28 03:27:27,324][106225] Updated weights for policy 1, policy_version 1143813 (0.0006) [2023-12-28 03:27:27,376][106225] Updated weights for policy 1, policy_version 1143823 (0.0009) [2023-12-28 03:27:27,702][106226] Updated weights for policy 0, policy_version 1140897 (0.0009) [2023-12-28 03:27:27,749][106226] Updated weights for policy 0, policy_version 1140907 (0.0008) [2023-12-28 03:27:27,797][106226] Updated weights for policy 0, policy_version 1140917 (0.0009) [2023-12-28 03:27:27,960][106225] Updated weights for policy 1, policy_version 1143833 (0.0005) [2023-12-28 03:27:28,026][106225] Updated weights for policy 1, policy_version 1143843 (0.0007) [2023-12-28 03:27:28,079][106225] Updated weights for policy 1, policy_version 1143853 (0.0007) [2023-12-28 03:27:28,566][106226] Updated weights for policy 0, policy_version 1140927 (0.0009) [2023-12-28 03:27:28,622][106226] Updated weights for policy 0, policy_version 1140937 (0.0008) [2023-12-28 03:27:28,682][106226] Updated weights for policy 0, policy_version 1140947 (0.0008) [2023-12-28 03:27:28,754][106225] Updated weights for policy 1, policy_version 1143863 (0.0009) [2023-12-28 03:27:28,806][106225] Updated weights for policy 1, policy_version 1143873 (0.0009) [2023-12-28 03:27:28,862][106225] Updated weights for policy 1, policy_version 1143883 (0.0008) [2023-12-28 03:27:29,448][106226] Updated weights for policy 0, policy_version 1140957 (0.0008) [2023-12-28 03:27:29,500][106226] Updated weights for policy 0, policy_version 1140967 (0.0008) [2023-12-28 03:27:29,556][106226] Updated weights for policy 0, policy_version 1140977 (0.0007) [2023-12-28 03:27:29,568][106225] Updated weights for policy 1, policy_version 1143893 (0.0009) [2023-12-28 03:27:29,628][106225] Updated weights for policy 1, policy_version 1143903 (0.0010) [2023-12-28 03:27:29,692][106225] Updated weights for policy 1, policy_version 1143913 (0.0008) [2023-12-28 03:27:30,286][106226] Updated weights for policy 0, policy_version 1140987 (0.0010) [2023-12-28 03:27:30,351][106226] Updated weights for policy 0, policy_version 1140997 (0.0008) [2023-12-28 03:27:30,390][106225] Updated weights for policy 1, policy_version 1143923 (0.0009) [2023-12-28 03:27:30,415][106226] Updated weights for policy 0, policy_version 1141007 (0.0008) [2023-12-28 03:27:30,454][106225] Updated weights for policy 1, policy_version 1143933 (0.0006) [2023-12-28 03:27:30,512][106225] Updated weights for policy 1, policy_version 1143943 (0.0008) [2023-12-28 03:27:31,097][106226] Updated weights for policy 0, policy_version 1141017 (0.0008) [2023-12-28 03:27:31,166][106226] Updated weights for policy 0, policy_version 1141027 (0.0008) [2023-12-28 03:27:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 585056256. Throughput: 0: 9977.4, 1: 10039.7. Samples: 585050728. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:31,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.593')] [2023-12-28 03:27:31,211][106225] Updated weights for policy 1, policy_version 1143953 (0.0009) [2023-12-28 03:27:31,230][106226] Updated weights for policy 0, policy_version 1141037 (0.0008) [2023-12-28 03:27:31,278][106225] Updated weights for policy 1, policy_version 1143963 (0.0008) [2023-12-28 03:27:31,296][106226] Updated weights for policy 0, policy_version 1141047 (0.0008) [2023-12-28 03:27:31,343][106225] Updated weights for policy 1, policy_version 1143973 (0.0008) [2023-12-28 03:27:31,415][106225] Updated weights for policy 1, policy_version 1143983 (0.0009) [2023-12-28 03:27:31,951][106226] Updated weights for policy 0, policy_version 1141057 (0.0008) [2023-12-28 03:27:32,005][106226] Updated weights for policy 0, policy_version 1141067 (0.0005) [2023-12-28 03:27:32,066][106226] Updated weights for policy 0, policy_version 1141077 (0.0005) [2023-12-28 03:27:32,169][106225] Updated weights for policy 1, policy_version 1143993 (0.0010) [2023-12-28 03:27:32,231][106225] Updated weights for policy 1, policy_version 1144003 (0.0008) [2023-12-28 03:27:32,290][106225] Updated weights for policy 1, policy_version 1144013 (0.0007) [2023-12-28 03:27:32,707][106226] Updated weights for policy 0, policy_version 1141087 (0.0009) [2023-12-28 03:27:32,767][106226] Updated weights for policy 0, policy_version 1141097 (0.0011) [2023-12-28 03:27:32,823][106226] Updated weights for policy 0, policy_version 1141107 (0.0010) [2023-12-28 03:27:33,052][106225] Updated weights for policy 1, policy_version 1144023 (0.0008) [2023-12-28 03:27:33,113][106225] Updated weights for policy 1, policy_version 1144033 (0.0008) [2023-12-28 03:27:33,171][106225] Updated weights for policy 1, policy_version 1144043 (0.0008) [2023-12-28 03:27:33,521][106226] Updated weights for policy 0, policy_version 1141117 (0.0009) [2023-12-28 03:27:33,573][106226] Updated weights for policy 0, policy_version 1141127 (0.0009) [2023-12-28 03:27:33,626][106226] Updated weights for policy 0, policy_version 1141137 (0.0008) [2023-12-28 03:27:33,909][106225] Updated weights for policy 1, policy_version 1144053 (0.0008) [2023-12-28 03:27:33,964][106225] Updated weights for policy 1, policy_version 1144063 (0.0008) [2023-12-28 03:27:34,023][106225] Updated weights for policy 1, policy_version 1144073 (0.0009) [2023-12-28 03:27:34,321][106226] Updated weights for policy 0, policy_version 1141147 (0.0007) [2023-12-28 03:27:34,374][106226] Updated weights for policy 0, policy_version 1141157 (0.0008) [2023-12-28 03:27:34,437][106226] Updated weights for policy 0, policy_version 1141167 (0.0009) [2023-12-28 03:27:34,744][106225] Updated weights for policy 1, policy_version 1144083 (0.0008) [2023-12-28 03:27:34,796][106225] Updated weights for policy 1, policy_version 1144093 (0.0007) [2023-12-28 03:27:34,845][106225] Updated weights for policy 1, policy_version 1144103 (0.0009) [2023-12-28 03:27:35,189][106226] Updated weights for policy 0, policy_version 1141177 (0.0009) [2023-12-28 03:27:35,250][106226] Updated weights for policy 0, policy_version 1141187 (0.0009) [2023-12-28 03:27:35,318][106226] Updated weights for policy 0, policy_version 1141197 (0.0010) [2023-12-28 03:27:35,388][106226] Updated weights for policy 0, policy_version 1141207 (0.0009) [2023-12-28 03:27:35,541][106225] Updated weights for policy 1, policy_version 1144113 (0.0008) [2023-12-28 03:27:35,597][106225] Updated weights for policy 1, policy_version 1144123 (0.0005) [2023-12-28 03:27:35,651][106225] Updated weights for policy 1, policy_version 1144133 (0.0005) [2023-12-28 03:27:35,706][106225] Updated weights for policy 1, policy_version 1144143 (0.0005) [2023-12-28 03:27:36,044][106226] Updated weights for policy 0, policy_version 1141217 (0.0010) [2023-12-28 03:27:36,106][106226] Updated weights for policy 0, policy_version 1141227 (0.0010) [2023-12-28 03:27:36,170][106226] Updated weights for policy 0, policy_version 1141237 (0.0008) [2023-12-28 03:27:36,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 585154560. Throughput: 0: 9956.9, 1: 9967.1. Samples: 585168316. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:36,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.473')] [2023-12-28 03:27:36,438][106225] Updated weights for policy 1, policy_version 1144153 (0.0008) [2023-12-28 03:27:36,504][106225] Updated weights for policy 1, policy_version 1144163 (0.0008) [2023-12-28 03:27:36,565][106225] Updated weights for policy 1, policy_version 1144173 (0.0006) [2023-12-28 03:27:36,871][106226] Updated weights for policy 0, policy_version 1141247 (0.0009) [2023-12-28 03:27:36,938][106226] Updated weights for policy 0, policy_version 1141257 (0.0011) [2023-12-28 03:27:36,997][106226] Updated weights for policy 0, policy_version 1141267 (0.0011) [2023-12-28 03:27:37,128][106225] Updated weights for policy 1, policy_version 1144183 (0.0007) [2023-12-28 03:27:37,181][106225] Updated weights for policy 1, policy_version 1144193 (0.0007) [2023-12-28 03:27:37,226][106225] Updated weights for policy 1, policy_version 1144203 (0.0008) [2023-12-28 03:27:37,686][106226] Updated weights for policy 0, policy_version 1141277 (0.0008) [2023-12-28 03:27:37,749][106226] Updated weights for policy 0, policy_version 1141287 (0.0005) [2023-12-28 03:27:37,804][106226] Updated weights for policy 0, policy_version 1141297 (0.0009) [2023-12-28 03:27:38,021][106225] Updated weights for policy 1, policy_version 1144213 (0.0008) [2023-12-28 03:27:38,073][106225] Updated weights for policy 1, policy_version 1144223 (0.0009) [2023-12-28 03:27:38,125][106225] Updated weights for policy 1, policy_version 1144233 (0.0007) [2023-12-28 03:27:38,353][106226] Updated weights for policy 0, policy_version 1141307 (0.0009) [2023-12-28 03:27:38,417][106226] Updated weights for policy 0, policy_version 1141317 (0.0008) [2023-12-28 03:27:38,473][106226] Updated weights for policy 0, policy_version 1141327 (0.0009) [2023-12-28 03:27:38,918][106225] Updated weights for policy 1, policy_version 1144243 (0.0010) [2023-12-28 03:27:38,974][106225] Updated weights for policy 1, policy_version 1144253 (0.0010) [2023-12-28 03:27:39,025][106225] Updated weights for policy 1, policy_version 1144263 (0.0010) [2023-12-28 03:27:39,141][106226] Updated weights for policy 0, policy_version 1141337 (0.0009) [2023-12-28 03:27:39,211][106226] Updated weights for policy 0, policy_version 1141347 (0.0011) [2023-12-28 03:27:39,286][106226] Updated weights for policy 0, policy_version 1141357 (0.0010) [2023-12-28 03:27:39,348][106226] Updated weights for policy 0, policy_version 1141367 (0.0011) [2023-12-28 03:27:39,835][106225] Updated weights for policy 1, policy_version 1144273 (0.0010) [2023-12-28 03:27:39,908][106225] Updated weights for policy 1, policy_version 1144283 (0.0010) [2023-12-28 03:27:39,977][106225] Updated weights for policy 1, policy_version 1144293 (0.0010) [2023-12-28 03:27:40,040][106225] Updated weights for policy 1, policy_version 1144303 (0.0009) [2023-12-28 03:27:40,152][106226] Updated weights for policy 0, policy_version 1141377 (0.0009) [2023-12-28 03:27:40,211][106226] Updated weights for policy 0, policy_version 1141387 (0.0008) [2023-12-28 03:27:40,276][106226] Updated weights for policy 0, policy_version 1141397 (0.0009) [2023-12-28 03:27:40,792][106225] Updated weights for policy 1, policy_version 1144313 (0.0010) [2023-12-28 03:27:40,843][106225] Updated weights for policy 1, policy_version 1144323 (0.0010) [2023-12-28 03:27:40,886][106225] Updated weights for policy 1, policy_version 1144333 (0.0010) [2023-12-28 03:27:41,032][106226] Updated weights for policy 0, policy_version 1141407 (0.0009) [2023-12-28 03:27:41,096][106226] Updated weights for policy 0, policy_version 1141417 (0.0009) [2023-12-28 03:27:41,162][106226] Updated weights for policy 0, policy_version 1141427 (0.0009) [2023-12-28 03:27:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 585252864. Throughput: 0: 10018.3, 1: 9934.6. Samples: 585228748. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:41,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.767')] [2023-12-28 03:27:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001144336_292995072.pth... [2023-12-28 03:27:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001143184_292700160.pth [2023-12-28 03:27:41,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001141432_292265984.pth... [2023-12-28 03:27:41,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001140280_291971072.pth [2023-12-28 03:27:41,776][106225] Updated weights for policy 1, policy_version 1144343 (0.0008) [2023-12-28 03:27:41,847][106225] Updated weights for policy 1, policy_version 1144353 (0.0006) [2023-12-28 03:27:41,911][106225] Updated weights for policy 1, policy_version 1144363 (0.0006) [2023-12-28 03:27:41,954][106226] Updated weights for policy 0, policy_version 1141437 (0.0011) [2023-12-28 03:27:42,023][106226] Updated weights for policy 0, policy_version 1141447 (0.0008) [2023-12-28 03:27:42,097][106226] Updated weights for policy 0, policy_version 1141457 (0.0008) [2023-12-28 03:27:42,546][106225] Updated weights for policy 1, policy_version 1144373 (0.0006) [2023-12-28 03:27:42,598][106225] Updated weights for policy 1, policy_version 1144383 (0.0007) [2023-12-28 03:27:42,657][106225] Updated weights for policy 1, policy_version 1144393 (0.0008) [2023-12-28 03:27:42,720][106226] Updated weights for policy 0, policy_version 1141467 (0.0009) [2023-12-28 03:27:42,773][106226] Updated weights for policy 0, policy_version 1141477 (0.0010) [2023-12-28 03:27:42,828][106226] Updated weights for policy 0, policy_version 1141487 (0.0011) [2023-12-28 03:27:43,349][106225] Updated weights for policy 1, policy_version 1144403 (0.0008) [2023-12-28 03:27:43,401][106225] Updated weights for policy 1, policy_version 1144413 (0.0009) [2023-12-28 03:27:43,461][106225] Updated weights for policy 1, policy_version 1144423 (0.0010) [2023-12-28 03:27:43,545][106226] Updated weights for policy 0, policy_version 1141497 (0.0011) [2023-12-28 03:27:43,610][106226] Updated weights for policy 0, policy_version 1141507 (0.0011) [2023-12-28 03:27:43,678][106226] Updated weights for policy 0, policy_version 1141517 (0.0010) [2023-12-28 03:27:43,735][106226] Updated weights for policy 0, policy_version 1141527 (0.0010) [2023-12-28 03:27:44,150][106225] Updated weights for policy 1, policy_version 1144433 (0.0010) [2023-12-28 03:27:44,203][106225] Updated weights for policy 1, policy_version 1144443 (0.0010) [2023-12-28 03:27:44,253][106225] Updated weights for policy 1, policy_version 1144453 (0.0010) [2023-12-28 03:27:44,303][106225] Updated weights for policy 1, policy_version 1144463 (0.0010) [2023-12-28 03:27:44,440][106226] Updated weights for policy 0, policy_version 1141537 (0.0010) [2023-12-28 03:27:44,491][106226] Updated weights for policy 0, policy_version 1141547 (0.0010) [2023-12-28 03:27:44,540][106226] Updated weights for policy 0, policy_version 1141557 (0.0010) [2023-12-28 03:27:45,055][106225] Updated weights for policy 1, policy_version 1144473 (0.0010) [2023-12-28 03:27:45,119][106225] Updated weights for policy 1, policy_version 1144483 (0.0010) [2023-12-28 03:27:45,187][106225] Updated weights for policy 1, policy_version 1144493 (0.0010) [2023-12-28 03:27:45,296][106226] Updated weights for policy 0, policy_version 1141567 (0.0010) [2023-12-28 03:27:45,364][106226] Updated weights for policy 0, policy_version 1141577 (0.0011) [2023-12-28 03:27:45,418][106226] Updated weights for policy 0, policy_version 1141587 (0.0011) [2023-12-28 03:27:45,797][106225] Updated weights for policy 1, policy_version 1144503 (0.0007) [2023-12-28 03:27:45,855][106225] Updated weights for policy 1, policy_version 1144513 (0.0007) [2023-12-28 03:27:45,914][106225] Updated weights for policy 1, policy_version 1144523 (0.0007) [2023-12-28 03:27:46,116][106226] Updated weights for policy 0, policy_version 1141597 (0.0010) [2023-12-28 03:27:46,168][106226] Updated weights for policy 0, policy_version 1141607 (0.0011) [2023-12-28 03:27:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 585351168. Throughput: 0: 9921.1, 1: 9800.6. Samples: 585342216. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:46,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.679')] [2023-12-28 03:27:46,235][106226] Updated weights for policy 0, policy_version 1141617 (0.0011) [2023-12-28 03:27:46,549][106225] Updated weights for policy 1, policy_version 1144533 (0.0006) [2023-12-28 03:27:46,595][106225] Updated weights for policy 1, policy_version 1144543 (0.0005) [2023-12-28 03:27:46,649][106225] Updated weights for policy 1, policy_version 1144553 (0.0005) [2023-12-28 03:27:46,873][106226] Updated weights for policy 0, policy_version 1141627 (0.0010) [2023-12-28 03:27:46,929][106226] Updated weights for policy 0, policy_version 1141637 (0.0008) [2023-12-28 03:27:46,988][106226] Updated weights for policy 0, policy_version 1141647 (0.0006) [2023-12-28 03:27:47,259][106225] Updated weights for policy 1, policy_version 1144563 (0.0007) [2023-12-28 03:27:47,313][106225] Updated weights for policy 1, policy_version 1144573 (0.0008) [2023-12-28 03:27:47,366][106225] Updated weights for policy 1, policy_version 1144583 (0.0009) [2023-12-28 03:27:47,519][106226] Updated weights for policy 0, policy_version 1141657 (0.0006) [2023-12-28 03:27:47,568][106226] Updated weights for policy 0, policy_version 1141667 (0.0010) [2023-12-28 03:27:47,624][106226] Updated weights for policy 0, policy_version 1141677 (0.0010) [2023-12-28 03:27:47,696][106226] Updated weights for policy 0, policy_version 1141687 (0.0010) [2023-12-28 03:27:48,014][106225] Updated weights for policy 1, policy_version 1144593 (0.0005) [2023-12-28 03:27:48,062][106225] Updated weights for policy 1, policy_version 1144603 (0.0005) [2023-12-28 03:27:48,108][106225] Updated weights for policy 1, policy_version 1144613 (0.0005) [2023-12-28 03:27:48,161][106225] Updated weights for policy 1, policy_version 1144623 (0.0005) [2023-12-28 03:27:48,363][106226] Updated weights for policy 0, policy_version 1141697 (0.0009) [2023-12-28 03:27:48,421][106226] Updated weights for policy 0, policy_version 1141707 (0.0011) [2023-12-28 03:27:48,485][106226] Updated weights for policy 0, policy_version 1141717 (0.0011) [2023-12-28 03:27:48,806][106225] Updated weights for policy 1, policy_version 1144633 (0.0008) [2023-12-28 03:27:48,863][106225] Updated weights for policy 1, policy_version 1144643 (0.0007) [2023-12-28 03:27:48,924][106225] Updated weights for policy 1, policy_version 1144653 (0.0006) [2023-12-28 03:27:49,223][106226] Updated weights for policy 0, policy_version 1141727 (0.0010) [2023-12-28 03:27:49,286][106226] Updated weights for policy 0, policy_version 1141737 (0.0010) [2023-12-28 03:27:49,354][106226] Updated weights for policy 0, policy_version 1141747 (0.0010) [2023-12-28 03:27:49,545][106225] Updated weights for policy 1, policy_version 1144663 (0.0005) [2023-12-28 03:27:49,612][106225] Updated weights for policy 1, policy_version 1144673 (0.0006) [2023-12-28 03:27:49,675][106225] Updated weights for policy 1, policy_version 1144683 (0.0008) [2023-12-28 03:27:50,078][106226] Updated weights for policy 0, policy_version 1141757 (0.0008) [2023-12-28 03:27:50,143][106226] Updated weights for policy 0, policy_version 1141767 (0.0009) [2023-12-28 03:27:50,204][106226] Updated weights for policy 0, policy_version 1141777 (0.0007) [2023-12-28 03:27:50,348][106225] Updated weights for policy 1, policy_version 1144693 (0.0006) [2023-12-28 03:27:50,412][106225] Updated weights for policy 1, policy_version 1144703 (0.0007) [2023-12-28 03:27:50,476][106225] Updated weights for policy 1, policy_version 1144713 (0.0008) [2023-12-28 03:27:50,956][106226] Updated weights for policy 0, policy_version 1141787 (0.0009) [2023-12-28 03:27:51,019][106226] Updated weights for policy 0, policy_version 1141797 (0.0010) [2023-12-28 03:27:51,086][106226] Updated weights for policy 0, policy_version 1141807 (0.0008) [2023-12-28 03:27:51,102][106225] Updated weights for policy 1, policy_version 1144723 (0.0007) [2023-12-28 03:27:51,162][106225] Updated weights for policy 1, policy_version 1144733 (0.0007) [2023-12-28 03:27:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 585457664. Throughput: 0: 9865.7, 1: 9945.3. Samples: 585465416. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:51,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.774')] [2023-12-28 03:27:51,222][106225] Updated weights for policy 1, policy_version 1144743 (0.0008) [2023-12-28 03:27:51,858][106226] Updated weights for policy 0, policy_version 1141817 (0.0007) [2023-12-28 03:27:51,916][106226] Updated weights for policy 0, policy_version 1141827 (0.0009) [2023-12-28 03:27:51,971][106225] Updated weights for policy 1, policy_version 1144753 (0.0008) [2023-12-28 03:27:51,978][106226] Updated weights for policy 0, policy_version 1141837 (0.0010) [2023-12-28 03:27:52,032][106225] Updated weights for policy 1, policy_version 1144763 (0.0007) [2023-12-28 03:27:52,039][106226] Updated weights for policy 0, policy_version 1141847 (0.0008) [2023-12-28 03:27:52,092][106225] Updated weights for policy 1, policy_version 1144773 (0.0008) [2023-12-28 03:27:52,154][106225] Updated weights for policy 1, policy_version 1144783 (0.0008) [2023-12-28 03:27:52,805][106226] Updated weights for policy 0, policy_version 1141857 (0.0010) [2023-12-28 03:27:52,851][106225] Updated weights for policy 1, policy_version 1144793 (0.0007) [2023-12-28 03:27:52,865][106226] Updated weights for policy 0, policy_version 1141867 (0.0008) [2023-12-28 03:27:52,904][106225] Updated weights for policy 1, policy_version 1144803 (0.0006) [2023-12-28 03:27:52,918][106226] Updated weights for policy 0, policy_version 1141877 (0.0006) [2023-12-28 03:27:52,961][106225] Updated weights for policy 1, policy_version 1144813 (0.0009) [2023-12-28 03:27:53,622][106225] Updated weights for policy 1, policy_version 1144823 (0.0008) [2023-12-28 03:27:53,667][106225] Updated weights for policy 1, policy_version 1144833 (0.0006) [2023-12-28 03:27:53,669][106226] Updated weights for policy 0, policy_version 1141887 (0.0006) [2023-12-28 03:27:53,721][106225] Updated weights for policy 1, policy_version 1144843 (0.0006) [2023-12-28 03:27:53,723][106226] Updated weights for policy 0, policy_version 1141897 (0.0006) [2023-12-28 03:27:53,778][106226] Updated weights for policy 0, policy_version 1141907 (0.0009) [2023-12-28 03:27:54,366][106225] Updated weights for policy 1, policy_version 1144853 (0.0010) [2023-12-28 03:27:54,431][106225] Updated weights for policy 1, policy_version 1144863 (0.0008) [2023-12-28 03:27:54,484][106225] Updated weights for policy 1, policy_version 1144873 (0.0008) [2023-12-28 03:27:54,550][106226] Updated weights for policy 0, policy_version 1141917 (0.0009) [2023-12-28 03:27:54,604][106226] Updated weights for policy 0, policy_version 1141927 (0.0009) [2023-12-28 03:27:54,661][106226] Updated weights for policy 0, policy_version 1141937 (0.0007) [2023-12-28 03:27:55,129][106225] Updated weights for policy 1, policy_version 1144883 (0.0006) [2023-12-28 03:27:55,180][106225] Updated weights for policy 1, policy_version 1144893 (0.0008) [2023-12-28 03:27:55,227][106225] Updated weights for policy 1, policy_version 1144903 (0.0008) [2023-12-28 03:27:55,293][106226] Updated weights for policy 0, policy_version 1141947 (0.0006) [2023-12-28 03:27:55,341][106226] Updated weights for policy 0, policy_version 1141957 (0.0009) [2023-12-28 03:27:55,385][106226] Updated weights for policy 0, policy_version 1141967 (0.0008) [2023-12-28 03:27:55,962][106225] Updated weights for policy 1, policy_version 1144913 (0.0008) [2023-12-28 03:27:56,026][106225] Updated weights for policy 1, policy_version 1144923 (0.0007) [2023-12-28 03:27:56,089][106225] Updated weights for policy 1, policy_version 1144933 (0.0006) [2023-12-28 03:27:56,149][106225] Updated weights for policy 1, policy_version 1144943 (0.0008) [2023-12-28 03:27:56,154][106226] Updated weights for policy 0, policy_version 1141977 (0.0008) [2023-12-28 03:27:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 585555968. Throughput: 0: 9783.6, 1: 9918.8. Samples: 585522528. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:27:56,176][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.736')] [2023-12-28 03:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001144944_293150720.pth... [2023-12-28 03:27:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001143760_292847616.pth [2023-12-28 03:27:56,209][106226] Updated weights for policy 0, policy_version 1141987 (0.0007) [2023-12-28 03:27:56,258][106226] Updated weights for policy 0, policy_version 1141997 (0.0008) [2023-12-28 03:27:56,319][106226] Updated weights for policy 0, policy_version 1142007 (0.0008) [2023-12-28 03:27:56,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001142008_292413440.pth... [2023-12-28 03:27:56,327][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001140856_292118528.pth [2023-12-28 03:27:56,801][106225] Updated weights for policy 1, policy_version 1144953 (0.0008) [2023-12-28 03:27:56,866][106225] Updated weights for policy 1, policy_version 1144963 (0.0007) [2023-12-28 03:27:56,925][106225] Updated weights for policy 1, policy_version 1144973 (0.0009) [2023-12-28 03:27:57,065][106226] Updated weights for policy 0, policy_version 1142017 (0.0008) [2023-12-28 03:27:57,110][106226] Updated weights for policy 0, policy_version 1142027 (0.0008) [2023-12-28 03:27:57,157][106226] Updated weights for policy 0, policy_version 1142037 (0.0009) [2023-12-28 03:27:57,578][106225] Updated weights for policy 1, policy_version 1144983 (0.0008) [2023-12-28 03:27:57,636][106225] Updated weights for policy 1, policy_version 1144994 (0.0010) [2023-12-28 03:27:57,688][106225] Updated weights for policy 1, policy_version 1145005 (0.0009) [2023-12-28 03:27:57,843][106226] Updated weights for policy 0, policy_version 1142047 (0.0009) [2023-12-28 03:27:57,903][106226] Updated weights for policy 0, policy_version 1142057 (0.0008) [2023-12-28 03:27:57,958][106226] Updated weights for policy 0, policy_version 1142067 (0.0007) [2023-12-28 03:27:58,519][106225] Updated weights for policy 1, policy_version 1145015 (0.0009) [2023-12-28 03:27:58,588][106225] Updated weights for policy 1, policy_version 1145025 (0.0009) [2023-12-28 03:27:58,599][106226] Updated weights for policy 0, policy_version 1142077 (0.0007) [2023-12-28 03:27:58,658][106225] Updated weights for policy 1, policy_version 1145035 (0.0008) [2023-12-28 03:27:58,666][106226] Updated weights for policy 0, policy_version 1142087 (0.0011) [2023-12-28 03:27:58,728][106226] Updated weights for policy 0, policy_version 1142097 (0.0010) [2023-12-28 03:27:59,530][106226] Updated weights for policy 0, policy_version 1142107 (0.0008) [2023-12-28 03:27:59,541][106225] Updated weights for policy 1, policy_version 1145045 (0.0007) [2023-12-28 03:27:59,591][106226] Updated weights for policy 0, policy_version 1142117 (0.0005) [2023-12-28 03:27:59,606][106225] Updated weights for policy 1, policy_version 1145055 (0.0008) [2023-12-28 03:27:59,651][106226] Updated weights for policy 0, policy_version 1142127 (0.0007) [2023-12-28 03:27:59,666][106225] Updated weights for policy 1, policy_version 1145065 (0.0007) [2023-12-28 03:28:00,325][106226] Updated weights for policy 0, policy_version 1142137 (0.0006) [2023-12-28 03:28:00,368][106225] Updated weights for policy 1, policy_version 1145075 (0.0007) [2023-12-28 03:28:00,384][106226] Updated weights for policy 0, policy_version 1142147 (0.0008) [2023-12-28 03:28:00,428][106225] Updated weights for policy 1, policy_version 1145085 (0.0010) [2023-12-28 03:28:00,436][106226] Updated weights for policy 0, policy_version 1142157 (0.0008) [2023-12-28 03:28:00,479][106225] Updated weights for policy 1, policy_version 1145095 (0.0010) [2023-12-28 03:28:00,489][106226] Updated weights for policy 0, policy_version 1142167 (0.0006) [2023-12-28 03:28:01,129][106226] Updated weights for policy 0, policy_version 1142177 (0.0007) [2023-12-28 03:28:01,141][106225] Updated weights for policy 1, policy_version 1145105 (0.0010) [2023-12-28 03:28:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 585646080. Throughput: 0: 9853.2, 1: 9920.5. Samples: 585639812. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:01,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.687')] [2023-12-28 03:28:01,194][106226] Updated weights for policy 0, policy_version 1142187 (0.0008) [2023-12-28 03:28:01,207][106225] Updated weights for policy 1, policy_version 1145115 (0.0008) [2023-12-28 03:28:01,254][106226] Updated weights for policy 0, policy_version 1142197 (0.0008) [2023-12-28 03:28:01,263][106225] Updated weights for policy 1, policy_version 1145125 (0.0007) [2023-12-28 03:28:01,316][106225] Updated weights for policy 1, policy_version 1145135 (0.0009) [2023-12-28 03:28:01,982][106225] Updated weights for policy 1, policy_version 1145145 (0.0009) [2023-12-28 03:28:02,004][106226] Updated weights for policy 0, policy_version 1142207 (0.0007) [2023-12-28 03:28:02,032][106225] Updated weights for policy 1, policy_version 1145155 (0.0010) [2023-12-28 03:28:02,057][106226] Updated weights for policy 0, policy_version 1142217 (0.0006) [2023-12-28 03:28:02,088][106225] Updated weights for policy 1, policy_version 1145165 (0.0006) [2023-12-28 03:28:02,117][106226] Updated weights for policy 0, policy_version 1142227 (0.0006) [2023-12-28 03:28:02,767][106225] Updated weights for policy 1, policy_version 1145175 (0.0009) [2023-12-28 03:28:02,796][106226] Updated weights for policy 0, policy_version 1142237 (0.0007) [2023-12-28 03:28:02,827][106225] Updated weights for policy 1, policy_version 1145185 (0.0010) [2023-12-28 03:28:02,847][106226] Updated weights for policy 0, policy_version 1142247 (0.0008) [2023-12-28 03:28:02,884][106225] Updated weights for policy 1, policy_version 1145195 (0.0010) [2023-12-28 03:28:02,901][106226] Updated weights for policy 0, policy_version 1142257 (0.0005) [2023-12-28 03:28:03,487][106225] Updated weights for policy 1, policy_version 1145205 (0.0008) [2023-12-28 03:28:03,544][106225] Updated weights for policy 1, policy_version 1145215 (0.0005) [2023-12-28 03:28:03,565][106226] Updated weights for policy 0, policy_version 1142267 (0.0008) [2023-12-28 03:28:03,598][106225] Updated weights for policy 1, policy_version 1145225 (0.0005) [2023-12-28 03:28:03,615][106226] Updated weights for policy 0, policy_version 1142277 (0.0010) [2023-12-28 03:28:03,661][106226] Updated weights for policy 0, policy_version 1142287 (0.0010) [2023-12-28 03:28:04,136][106225] Updated weights for policy 1, policy_version 1145235 (0.0007) [2023-12-28 03:28:04,194][106225] Updated weights for policy 1, policy_version 1145245 (0.0010) [2023-12-28 03:28:04,250][106225] Updated weights for policy 1, policy_version 1145255 (0.0011) [2023-12-28 03:28:04,396][106226] Updated weights for policy 0, policy_version 1142297 (0.0010) [2023-12-28 03:28:04,448][106226] Updated weights for policy 0, policy_version 1142307 (0.0011) [2023-12-28 03:28:04,498][106226] Updated weights for policy 0, policy_version 1142317 (0.0010) [2023-12-28 03:28:04,550][106226] Updated weights for policy 0, policy_version 1142327 (0.0010) [2023-12-28 03:28:04,919][106225] Updated weights for policy 1, policy_version 1145265 (0.0010) [2023-12-28 03:28:04,980][106225] Updated weights for policy 1, policy_version 1145275 (0.0010) [2023-12-28 03:28:05,044][106225] Updated weights for policy 1, policy_version 1145285 (0.0010) [2023-12-28 03:28:05,108][106225] Updated weights for policy 1, policy_version 1145295 (0.0009) [2023-12-28 03:28:05,265][106226] Updated weights for policy 0, policy_version 1142337 (0.0011) [2023-12-28 03:28:05,315][106226] Updated weights for policy 0, policy_version 1142347 (0.0010) [2023-12-28 03:28:05,378][106226] Updated weights for policy 0, policy_version 1142357 (0.0010) [2023-12-28 03:28:05,767][106225] Updated weights for policy 1, policy_version 1145305 (0.0010) [2023-12-28 03:28:05,820][106225] Updated weights for policy 1, policy_version 1145315 (0.0010) [2023-12-28 03:28:05,876][106225] Updated weights for policy 1, policy_version 1145325 (0.0010) [2023-12-28 03:28:06,013][106226] Updated weights for policy 0, policy_version 1142367 (0.0006) [2023-12-28 03:28:06,077][106226] Updated weights for policy 0, policy_version 1142377 (0.0009) [2023-12-28 03:28:06,141][106226] Updated weights for policy 0, policy_version 1142387 (0.0011) [2023-12-28 03:28:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 585760768. Throughput: 0: 9911.3, 1: 9938.6. Samples: 585764136. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:06,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.832')] [2023-12-28 03:28:06,618][106225] Updated weights for policy 1, policy_version 1145335 (0.0007) [2023-12-28 03:28:06,679][106225] Updated weights for policy 1, policy_version 1145345 (0.0010) [2023-12-28 03:28:06,738][106225] Updated weights for policy 1, policy_version 1145355 (0.0006) [2023-12-28 03:28:06,861][106226] Updated weights for policy 0, policy_version 1142397 (0.0011) [2023-12-28 03:28:06,926][106226] Updated weights for policy 0, policy_version 1142407 (0.0011) [2023-12-28 03:28:06,984][106226] Updated weights for policy 0, policy_version 1142417 (0.0011) [2023-12-28 03:28:07,417][106225] Updated weights for policy 1, policy_version 1145365 (0.0008) [2023-12-28 03:28:07,473][106225] Updated weights for policy 1, policy_version 1145375 (0.0010) [2023-12-28 03:28:07,526][106225] Updated weights for policy 1, policy_version 1145385 (0.0010) [2023-12-28 03:28:07,704][106226] Updated weights for policy 0, policy_version 1142427 (0.0011) [2023-12-28 03:28:07,753][106226] Updated weights for policy 0, policy_version 1142437 (0.0009) [2023-12-28 03:28:07,806][106226] Updated weights for policy 0, policy_version 1142447 (0.0009) [2023-12-28 03:28:08,131][106225] Updated weights for policy 1, policy_version 1145395 (0.0010) [2023-12-28 03:28:08,191][106225] Updated weights for policy 1, policy_version 1145405 (0.0010) [2023-12-28 03:28:08,251][106225] Updated weights for policy 1, policy_version 1145415 (0.0010) [2023-12-28 03:28:08,418][106226] Updated weights for policy 0, policy_version 1142457 (0.0010) [2023-12-28 03:28:08,470][106226] Updated weights for policy 0, policy_version 1142467 (0.0008) [2023-12-28 03:28:08,526][106226] Updated weights for policy 0, policy_version 1142477 (0.0008) [2023-12-28 03:28:08,586][106226] Updated weights for policy 0, policy_version 1142487 (0.0008) [2023-12-28 03:28:08,953][106225] Updated weights for policy 1, policy_version 1145425 (0.0010) [2023-12-28 03:28:09,006][106225] Updated weights for policy 1, policy_version 1145435 (0.0009) [2023-12-28 03:28:09,063][106225] Updated weights for policy 1, policy_version 1145445 (0.0006) [2023-12-28 03:28:09,126][106225] Updated weights for policy 1, policy_version 1145455 (0.0005) [2023-12-28 03:28:09,281][106226] Updated weights for policy 0, policy_version 1142497 (0.0009) [2023-12-28 03:28:09,344][106226] Updated weights for policy 0, policy_version 1142507 (0.0011) [2023-12-28 03:28:09,431][106226] Updated weights for policy 0, policy_version 1142517 (0.0009) [2023-12-28 03:28:09,872][106225] Updated weights for policy 1, policy_version 1145465 (0.0008) [2023-12-28 03:28:09,934][106225] Updated weights for policy 1, policy_version 1145475 (0.0008) [2023-12-28 03:28:09,998][106225] Updated weights for policy 1, policy_version 1145485 (0.0008) [2023-12-28 03:28:10,113][106226] Updated weights for policy 0, policy_version 1142527 (0.0008) [2023-12-28 03:28:10,184][106226] Updated weights for policy 0, policy_version 1142537 (0.0008) [2023-12-28 03:28:10,247][106226] Updated weights for policy 0, policy_version 1142547 (0.0008) [2023-12-28 03:28:10,787][106225] Updated weights for policy 1, policy_version 1145495 (0.0009) [2023-12-28 03:28:10,854][106225] Updated weights for policy 1, policy_version 1145505 (0.0007) [2023-12-28 03:28:10,915][106225] Updated weights for policy 1, policy_version 1145515 (0.0008) [2023-12-28 03:28:10,961][106226] Updated weights for policy 0, policy_version 1142557 (0.0009) [2023-12-28 03:28:11,018][106226] Updated weights for policy 0, policy_version 1142567 (0.0007) [2023-12-28 03:28:11,092][106226] Updated weights for policy 0, policy_version 1142577 (0.0008) [2023-12-28 03:28:11,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 585859072. Throughput: 0: 9883.8, 1: 10008.9. Samples: 585825228. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:11,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.967')] [2023-12-28 03:28:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001142584_292560896.pth... [2023-12-28 03:28:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001145520_293298176.pth... [2023-12-28 03:28:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001141432_292265984.pth [2023-12-28 03:28:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001144336_292995072.pth [2023-12-28 03:28:11,750][106225] Updated weights for policy 1, policy_version 1145525 (0.0009) [2023-12-28 03:28:11,824][106225] Updated weights for policy 1, policy_version 1145535 (0.0009) [2023-12-28 03:28:11,888][106225] Updated weights for policy 1, policy_version 1145545 (0.0008) [2023-12-28 03:28:11,942][106226] Updated weights for policy 0, policy_version 1142587 (0.0007) [2023-12-28 03:28:12,012][106226] Updated weights for policy 0, policy_version 1142597 (0.0007) [2023-12-28 03:28:12,080][106226] Updated weights for policy 0, policy_version 1142607 (0.0008) [2023-12-28 03:28:12,643][106225] Updated weights for policy 1, policy_version 1145555 (0.0008) [2023-12-28 03:28:12,702][106225] Updated weights for policy 1, policy_version 1145565 (0.0010) [2023-12-28 03:28:12,765][106225] Updated weights for policy 1, policy_version 1145575 (0.0008) [2023-12-28 03:28:12,772][106226] Updated weights for policy 0, policy_version 1142617 (0.0008) [2023-12-28 03:28:12,839][106226] Updated weights for policy 0, policy_version 1142627 (0.0006) [2023-12-28 03:28:12,910][106226] Updated weights for policy 0, policy_version 1142637 (0.0007) [2023-12-28 03:28:12,974][106226] Updated weights for policy 0, policy_version 1142647 (0.0008) [2023-12-28 03:28:13,421][106225] Updated weights for policy 1, policy_version 1145585 (0.0008) [2023-12-28 03:28:13,486][106225] Updated weights for policy 1, policy_version 1145595 (0.0009) [2023-12-28 03:28:13,540][106225] Updated weights for policy 1, policy_version 1145605 (0.0010) [2023-12-28 03:28:13,594][106225] Updated weights for policy 1, policy_version 1145615 (0.0009) [2023-12-28 03:28:13,633][106226] Updated weights for policy 0, policy_version 1142657 (0.0009) [2023-12-28 03:28:13,704][106226] Updated weights for policy 0, policy_version 1142667 (0.0008) [2023-12-28 03:28:13,769][106226] Updated weights for policy 0, policy_version 1142677 (0.0008) [2023-12-28 03:28:14,243][106225] Updated weights for policy 1, policy_version 1145625 (0.0009) [2023-12-28 03:28:14,315][106225] Updated weights for policy 1, policy_version 1145635 (0.0006) [2023-12-28 03:28:14,351][106226] Updated weights for policy 0, policy_version 1142687 (0.0005) [2023-12-28 03:28:14,381][106225] Updated weights for policy 1, policy_version 1145645 (0.0008) [2023-12-28 03:28:14,411][106226] Updated weights for policy 0, policy_version 1142697 (0.0006) [2023-12-28 03:28:14,467][106226] Updated weights for policy 0, policy_version 1142707 (0.0006) [2023-12-28 03:28:14,949][106225] Updated weights for policy 1, policy_version 1145655 (0.0007) [2023-12-28 03:28:15,015][106225] Updated weights for policy 1, policy_version 1145665 (0.0007) [2023-12-28 03:28:15,082][106225] Updated weights for policy 1, policy_version 1145675 (0.0008) [2023-12-28 03:28:15,117][106226] Updated weights for policy 0, policy_version 1142717 (0.0008) [2023-12-28 03:28:15,179][106226] Updated weights for policy 0, policy_version 1142727 (0.0008) [2023-12-28 03:28:15,239][106226] Updated weights for policy 0, policy_version 1142737 (0.0009) [2023-12-28 03:28:15,737][106225] Updated weights for policy 1, policy_version 1145685 (0.0009) [2023-12-28 03:28:15,785][106225] Updated weights for policy 1, policy_version 1145695 (0.0008) [2023-12-28 03:28:15,830][106225] Updated weights for policy 1, policy_version 1145705 (0.0008) [2023-12-28 03:28:15,980][106226] Updated weights for policy 0, policy_version 1142747 (0.0009) [2023-12-28 03:28:16,044][106226] Updated weights for policy 0, policy_version 1142757 (0.0007) [2023-12-28 03:28:16,110][106226] Updated weights for policy 0, policy_version 1142767 (0.0005) [2023-12-28 03:28:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 585957376. Throughput: 0: 9853.7, 1: 9946.0. Samples: 585941716. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:16,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-4.827')] [2023-12-28 03:28:16,499][106225] Updated weights for policy 1, policy_version 1145715 (0.0007) [2023-12-28 03:28:16,549][106225] Updated weights for policy 1, policy_version 1145725 (0.0005) [2023-12-28 03:28:16,597][106225] Updated weights for policy 1, policy_version 1145735 (0.0005) [2023-12-28 03:28:16,838][106226] Updated weights for policy 0, policy_version 1142777 (0.0006) [2023-12-28 03:28:16,899][106226] Updated weights for policy 0, policy_version 1142787 (0.0011) [2023-12-28 03:28:16,967][106226] Updated weights for policy 0, policy_version 1142797 (0.0011) [2023-12-28 03:28:17,049][106226] Updated weights for policy 0, policy_version 1142807 (0.0011) [2023-12-28 03:28:17,294][106225] Updated weights for policy 1, policy_version 1145745 (0.0007) [2023-12-28 03:28:17,354][106225] Updated weights for policy 1, policy_version 1145755 (0.0008) [2023-12-28 03:28:17,403][106225] Updated weights for policy 1, policy_version 1145765 (0.0008) [2023-12-28 03:28:17,448][106225] Updated weights for policy 1, policy_version 1145775 (0.0008) [2023-12-28 03:28:17,724][106226] Updated weights for policy 0, policy_version 1142817 (0.0009) [2023-12-28 03:28:17,780][106226] Updated weights for policy 0, policy_version 1142827 (0.0007) [2023-12-28 03:28:17,838][106226] Updated weights for policy 0, policy_version 1142837 (0.0005) [2023-12-28 03:28:18,244][106225] Updated weights for policy 1, policy_version 1145785 (0.0008) [2023-12-28 03:28:18,302][106225] Updated weights for policy 1, policy_version 1145795 (0.0009) [2023-12-28 03:28:18,370][106225] Updated weights for policy 1, policy_version 1145805 (0.0009) [2023-12-28 03:28:18,502][106226] Updated weights for policy 0, policy_version 1142847 (0.0008) [2023-12-28 03:28:18,569][106226] Updated weights for policy 0, policy_version 1142857 (0.0009) [2023-12-28 03:28:18,635][106226] Updated weights for policy 0, policy_version 1142867 (0.0008) [2023-12-28 03:28:19,038][106225] Updated weights for policy 1, policy_version 1145815 (0.0006) [2023-12-28 03:28:19,094][106225] Updated weights for policy 1, policy_version 1145825 (0.0005) [2023-12-28 03:28:19,142][106225] Updated weights for policy 1, policy_version 1145835 (0.0006) [2023-12-28 03:28:19,421][106226] Updated weights for policy 0, policy_version 1142877 (0.0009) [2023-12-28 03:28:19,477][106226] Updated weights for policy 0, policy_version 1142887 (0.0008) [2023-12-28 03:28:19,544][106226] Updated weights for policy 0, policy_version 1142897 (0.0008) [2023-12-28 03:28:19,858][106225] Updated weights for policy 1, policy_version 1145845 (0.0007) [2023-12-28 03:28:19,924][106225] Updated weights for policy 1, policy_version 1145855 (0.0010) [2023-12-28 03:28:19,986][106225] Updated weights for policy 1, policy_version 1145865 (0.0009) [2023-12-28 03:28:20,305][106226] Updated weights for policy 0, policy_version 1142907 (0.0008) [2023-12-28 03:28:20,365][106226] Updated weights for policy 0, policy_version 1142917 (0.0007) [2023-12-28 03:28:20,419][106226] Updated weights for policy 0, policy_version 1142927 (0.0009) [2023-12-28 03:28:20,845][106225] Updated weights for policy 1, policy_version 1145875 (0.0008) [2023-12-28 03:28:20,902][106225] Updated weights for policy 1, policy_version 1145885 (0.0009) [2023-12-28 03:28:20,968][106225] Updated weights for policy 1, policy_version 1145895 (0.0009) [2023-12-28 03:28:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 586047488. Throughput: 0: 9795.6, 1: 9967.0. Samples: 586057632. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:21,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.674')] [2023-12-28 03:28:21,185][106226] Updated weights for policy 0, policy_version 1142937 (0.0007) [2023-12-28 03:28:21,251][106226] Updated weights for policy 0, policy_version 1142947 (0.0008) [2023-12-28 03:28:21,308][106226] Updated weights for policy 0, policy_version 1142958 (0.0010) [2023-12-28 03:28:21,379][106226] Updated weights for policy 0, policy_version 1142968 (0.0008) [2023-12-28 03:28:21,802][106225] Updated weights for policy 1, policy_version 1145905 (0.0009) [2023-12-28 03:28:21,867][106225] Updated weights for policy 1, policy_version 1145915 (0.0011) [2023-12-28 03:28:21,926][106225] Updated weights for policy 1, policy_version 1145925 (0.0007) [2023-12-28 03:28:21,986][106225] Updated weights for policy 1, policy_version 1145935 (0.0007) [2023-12-28 03:28:22,138][106226] Updated weights for policy 0, policy_version 1142978 (0.0009) [2023-12-28 03:28:22,208][106226] Updated weights for policy 0, policy_version 1142988 (0.0009) [2023-12-28 03:28:22,276][106226] Updated weights for policy 0, policy_version 1142998 (0.0009) [2023-12-28 03:28:22,744][106225] Updated weights for policy 1, policy_version 1145945 (0.0010) [2023-12-28 03:28:22,798][106225] Updated weights for policy 1, policy_version 1145955 (0.0011) [2023-12-28 03:28:22,859][106225] Updated weights for policy 1, policy_version 1145965 (0.0010) [2023-12-28 03:28:23,017][106226] Updated weights for policy 0, policy_version 1143008 (0.0008) [2023-12-28 03:28:23,074][106226] Updated weights for policy 0, policy_version 1143018 (0.0008) [2023-12-28 03:28:23,128][106226] Updated weights for policy 0, policy_version 1143028 (0.0007) [2023-12-28 03:28:23,543][106225] Updated weights for policy 1, policy_version 1145975 (0.0007) [2023-12-28 03:28:23,599][106225] Updated weights for policy 1, policy_version 1145985 (0.0009) [2023-12-28 03:28:23,650][106225] Updated weights for policy 1, policy_version 1145995 (0.0010) [2023-12-28 03:28:23,906][106226] Updated weights for policy 0, policy_version 1143038 (0.0009) [2023-12-28 03:28:23,956][106226] Updated weights for policy 0, policy_version 1143048 (0.0008) [2023-12-28 03:28:24,017][106226] Updated weights for policy 0, policy_version 1143058 (0.0008) [2023-12-28 03:28:24,300][106225] Updated weights for policy 1, policy_version 1146005 (0.0010) [2023-12-28 03:28:24,361][106225] Updated weights for policy 1, policy_version 1146015 (0.0010) [2023-12-28 03:28:24,415][106225] Updated weights for policy 1, policy_version 1146025 (0.0010) [2023-12-28 03:28:24,787][106226] Updated weights for policy 0, policy_version 1143068 (0.0007) [2023-12-28 03:28:24,836][106226] Updated weights for policy 0, policy_version 1143078 (0.0007) [2023-12-28 03:28:24,886][106226] Updated weights for policy 0, policy_version 1143088 (0.0008) [2023-12-28 03:28:25,089][106225] Updated weights for policy 1, policy_version 1146035 (0.0011) [2023-12-28 03:28:25,151][106225] Updated weights for policy 1, policy_version 1146045 (0.0010) [2023-12-28 03:28:25,212][106225] Updated weights for policy 1, policy_version 1146055 (0.0010) [2023-12-28 03:28:25,691][106226] Updated weights for policy 0, policy_version 1143098 (0.0008) [2023-12-28 03:28:25,739][106226] Updated weights for policy 0, policy_version 1143108 (0.0008) [2023-12-28 03:28:25,786][106226] Updated weights for policy 0, policy_version 1143118 (0.0008) [2023-12-28 03:28:25,816][106225] Updated weights for policy 1, policy_version 1146065 (0.0010) [2023-12-28 03:28:25,836][106226] Updated weights for policy 0, policy_version 1143128 (0.0007) [2023-12-28 03:28:25,865][106225] Updated weights for policy 1, policy_version 1146075 (0.0005) [2023-12-28 03:28:25,912][106225] Updated weights for policy 1, policy_version 1146085 (0.0005) [2023-12-28 03:28:25,964][106225] Updated weights for policy 1, policy_version 1146095 (0.0005) [2023-12-28 03:28:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 586145792. Throughput: 0: 9692.5, 1: 9925.7. Samples: 586111564. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:26,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-4.706')] [2023-12-28 03:28:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001143128_292700160.pth... [2023-12-28 03:28:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001146096_293445632.pth... [2023-12-28 03:28:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001142008_292413440.pth [2023-12-28 03:28:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001144944_293150720.pth [2023-12-28 03:28:26,590][106226] Updated weights for policy 0, policy_version 1143138 (0.0009) [2023-12-28 03:28:26,622][106225] Updated weights for policy 1, policy_version 1146105 (0.0005) [2023-12-28 03:28:26,639][106226] Updated weights for policy 0, policy_version 1143148 (0.0006) [2023-12-28 03:28:26,668][106225] Updated weights for policy 1, policy_version 1146115 (0.0005) [2023-12-28 03:28:26,692][106226] Updated weights for policy 0, policy_version 1143158 (0.0005) [2023-12-28 03:28:26,722][106225] Updated weights for policy 1, policy_version 1146125 (0.0007) [2023-12-28 03:28:27,302][106226] Updated weights for policy 0, policy_version 1143168 (0.0006) [2023-12-28 03:28:27,304][106225] Updated weights for policy 1, policy_version 1146135 (0.0006) [2023-12-28 03:28:27,358][106226] Updated weights for policy 0, policy_version 1143178 (0.0006) [2023-12-28 03:28:27,364][106225] Updated weights for policy 1, policy_version 1146145 (0.0006) [2023-12-28 03:28:27,416][106226] Updated weights for policy 0, policy_version 1143188 (0.0005) [2023-12-28 03:28:27,422][106225] Updated weights for policy 1, policy_version 1146155 (0.0010) [2023-12-28 03:28:27,936][106226] Updated weights for policy 0, policy_version 1143198 (0.0008) [2023-12-28 03:28:27,992][106226] Updated weights for policy 0, policy_version 1143208 (0.0007) [2023-12-28 03:28:28,045][106226] Updated weights for policy 0, policy_version 1143218 (0.0007) [2023-12-28 03:28:28,099][106225] Updated weights for policy 1, policy_version 1146165 (0.0010) [2023-12-28 03:28:28,159][106225] Updated weights for policy 1, policy_version 1146175 (0.0010) [2023-12-28 03:28:28,215][106225] Updated weights for policy 1, policy_version 1146185 (0.0009) [2023-12-28 03:28:28,778][106226] Updated weights for policy 0, policy_version 1143228 (0.0008) [2023-12-28 03:28:28,838][106226] Updated weights for policy 0, policy_version 1143238 (0.0008) [2023-12-28 03:28:28,899][106226] Updated weights for policy 0, policy_version 1143248 (0.0008) [2023-12-28 03:28:28,937][106225] Updated weights for policy 1, policy_version 1146195 (0.0010) [2023-12-28 03:28:28,991][106225] Updated weights for policy 1, policy_version 1146205 (0.0010) [2023-12-28 03:28:29,045][106225] Updated weights for policy 1, policy_version 1146215 (0.0010) [2023-12-28 03:28:29,663][106226] Updated weights for policy 0, policy_version 1143258 (0.0008) [2023-12-28 03:28:29,702][106225] Updated weights for policy 1, policy_version 1146225 (0.0008) [2023-12-28 03:28:29,719][106226] Updated weights for policy 0, policy_version 1143268 (0.0008) [2023-12-28 03:28:29,760][106225] Updated weights for policy 1, policy_version 1146235 (0.0006) [2023-12-28 03:28:29,778][106226] Updated weights for policy 0, policy_version 1143278 (0.0008) [2023-12-28 03:28:29,822][106225] Updated weights for policy 1, policy_version 1146245 (0.0006) [2023-12-28 03:28:29,834][106226] Updated weights for policy 0, policy_version 1143288 (0.0008) [2023-12-28 03:28:29,887][106225] Updated weights for policy 1, policy_version 1146255 (0.0008) [2023-12-28 03:28:30,507][106225] Updated weights for policy 1, policy_version 1146265 (0.0007) [2023-12-28 03:28:30,571][106225] Updated weights for policy 1, policy_version 1146275 (0.0006) [2023-12-28 03:28:30,612][106226] Updated weights for policy 0, policy_version 1143298 (0.0006) [2023-12-28 03:28:30,622][106225] Updated weights for policy 1, policy_version 1146285 (0.0007) [2023-12-28 03:28:30,666][106226] Updated weights for policy 0, policy_version 1143308 (0.0009) [2023-12-28 03:28:30,716][106226] Updated weights for policy 0, policy_version 1143318 (0.0009) [2023-12-28 03:28:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 586244096. Throughput: 0: 9754.0, 1: 10075.7. Samples: 586234552. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:31,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.797')] [2023-12-28 03:28:31,223][106225] Updated weights for policy 1, policy_version 1146295 (0.0007) [2023-12-28 03:28:31,285][106225] Updated weights for policy 1, policy_version 1146305 (0.0008) [2023-12-28 03:28:31,343][106225] Updated weights for policy 1, policy_version 1146315 (0.0006) [2023-12-28 03:28:31,555][106226] Updated weights for policy 0, policy_version 1143328 (0.0008) [2023-12-28 03:28:31,621][106226] Updated weights for policy 0, policy_version 1143338 (0.0009) [2023-12-28 03:28:31,685][106226] Updated weights for policy 0, policy_version 1143348 (0.0008) [2023-12-28 03:28:32,016][106225] Updated weights for policy 1, policy_version 1146325 (0.0009) [2023-12-28 03:28:32,079][106225] Updated weights for policy 1, policy_version 1146335 (0.0009) [2023-12-28 03:28:32,135][106225] Updated weights for policy 1, policy_version 1146345 (0.0008) [2023-12-28 03:28:32,435][106226] Updated weights for policy 0, policy_version 1143358 (0.0009) [2023-12-28 03:28:32,494][106226] Updated weights for policy 0, policy_version 1143368 (0.0008) [2023-12-28 03:28:32,556][106226] Updated weights for policy 0, policy_version 1143378 (0.0009) [2023-12-28 03:28:32,813][106225] Updated weights for policy 1, policy_version 1146355 (0.0007) [2023-12-28 03:28:32,869][106225] Updated weights for policy 1, policy_version 1146365 (0.0006) [2023-12-28 03:28:32,922][106225] Updated weights for policy 1, policy_version 1146375 (0.0005) [2023-12-28 03:28:33,343][106226] Updated weights for policy 0, policy_version 1143388 (0.0009) [2023-12-28 03:28:33,396][106226] Updated weights for policy 0, policy_version 1143398 (0.0008) [2023-12-28 03:28:33,455][106226] Updated weights for policy 0, policy_version 1143408 (0.0007) [2023-12-28 03:28:33,459][106225] Updated weights for policy 1, policy_version 1146385 (0.0006) [2023-12-28 03:28:33,509][106225] Updated weights for policy 1, policy_version 1146395 (0.0005) [2023-12-28 03:28:33,559][106225] Updated weights for policy 1, policy_version 1146405 (0.0007) [2023-12-28 03:28:33,620][106225] Updated weights for policy 1, policy_version 1146415 (0.0008) [2023-12-28 03:28:34,219][106226] Updated weights for policy 0, policy_version 1143418 (0.0008) [2023-12-28 03:28:34,275][106225] Updated weights for policy 1, policy_version 1146425 (0.0010) [2023-12-28 03:28:34,277][106226] Updated weights for policy 0, policy_version 1143428 (0.0006) [2023-12-28 03:28:34,333][106226] Updated weights for policy 0, policy_version 1143438 (0.0006) [2023-12-28 03:28:34,335][106225] Updated weights for policy 1, policy_version 1146435 (0.0008) [2023-12-28 03:28:34,393][106226] Updated weights for policy 0, policy_version 1143448 (0.0007) [2023-12-28 03:28:34,395][106225] Updated weights for policy 1, policy_version 1146445 (0.0007) [2023-12-28 03:28:35,044][106226] Updated weights for policy 0, policy_version 1143458 (0.0005) [2023-12-28 03:28:35,092][106226] Updated weights for policy 0, policy_version 1143468 (0.0005) [2023-12-28 03:28:35,142][106226] Updated weights for policy 0, policy_version 1143478 (0.0007) [2023-12-28 03:28:35,178][106225] Updated weights for policy 1, policy_version 1146455 (0.0008) [2023-12-28 03:28:35,233][106225] Updated weights for policy 1, policy_version 1146465 (0.0008) [2023-12-28 03:28:35,294][106225] Updated weights for policy 1, policy_version 1146475 (0.0008) [2023-12-28 03:28:35,803][106226] Updated weights for policy 0, policy_version 1143488 (0.0008) [2023-12-28 03:28:35,852][106226] Updated weights for policy 0, policy_version 1143498 (0.0008) [2023-12-28 03:28:35,897][106226] Updated weights for policy 0, policy_version 1143508 (0.0008) [2023-12-28 03:28:36,005][106225] Updated weights for policy 1, policy_version 1146485 (0.0009) [2023-12-28 03:28:36,054][106225] Updated weights for policy 1, policy_version 1146495 (0.0008) [2023-12-28 03:28:36,112][106225] Updated weights for policy 1, policy_version 1146505 (0.0008) [2023-12-28 03:28:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 586350592. Throughput: 0: 9680.7, 1: 10061.0. Samples: 586353792. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:36,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.796')] [2023-12-28 03:28:36,694][106226] Updated weights for policy 0, policy_version 1143518 (0.0009) [2023-12-28 03:28:36,758][106226] Updated weights for policy 0, policy_version 1143528 (0.0009) [2023-12-28 03:28:36,808][106226] Updated weights for policy 0, policy_version 1143538 (0.0009) [2023-12-28 03:28:36,865][106225] Updated weights for policy 1, policy_version 1146515 (0.0007) [2023-12-28 03:28:36,931][106225] Updated weights for policy 1, policy_version 1146525 (0.0005) [2023-12-28 03:28:36,990][106225] Updated weights for policy 1, policy_version 1146535 (0.0007) [2023-12-28 03:28:37,549][106225] Updated weights for policy 1, policy_version 1146545 (0.0007) [2023-12-28 03:28:37,611][106225] Updated weights for policy 1, policy_version 1146555 (0.0006) [2023-12-28 03:28:37,640][106226] Updated weights for policy 0, policy_version 1143548 (0.0010) [2023-12-28 03:28:37,655][106225] Updated weights for policy 1, policy_version 1146565 (0.0006) [2023-12-28 03:28:37,695][106226] Updated weights for policy 0, policy_version 1143558 (0.0008) [2023-12-28 03:28:37,706][106225] Updated weights for policy 1, policy_version 1146575 (0.0008) [2023-12-28 03:28:37,749][106226] Updated weights for policy 0, policy_version 1143568 (0.0008) [2023-12-28 03:28:38,385][106225] Updated weights for policy 1, policy_version 1146585 (0.0009) [2023-12-28 03:28:38,451][106225] Updated weights for policy 1, policy_version 1146595 (0.0008) [2023-12-28 03:28:38,503][106226] Updated weights for policy 0, policy_version 1143578 (0.0009) [2023-12-28 03:28:38,512][106225] Updated weights for policy 1, policy_version 1146605 (0.0009) [2023-12-28 03:28:38,565][106226] Updated weights for policy 0, policy_version 1143588 (0.0008) [2023-12-28 03:28:38,626][106226] Updated weights for policy 0, policy_version 1143598 (0.0008) [2023-12-28 03:28:38,691][106226] Updated weights for policy 0, policy_version 1143608 (0.0008) [2023-12-28 03:28:39,212][106225] Updated weights for policy 1, policy_version 1146615 (0.0010) [2023-12-28 03:28:39,280][106225] Updated weights for policy 1, policy_version 1146625 (0.0011) [2023-12-28 03:28:39,341][106225] Updated weights for policy 1, policy_version 1146635 (0.0008) [2023-12-28 03:28:39,471][106226] Updated weights for policy 0, policy_version 1143618 (0.0009) [2023-12-28 03:28:39,539][106226] Updated weights for policy 0, policy_version 1143628 (0.0006) [2023-12-28 03:28:39,597][106226] Updated weights for policy 0, policy_version 1143638 (0.0008) [2023-12-28 03:28:40,099][106225] Updated weights for policy 1, policy_version 1146645 (0.0008) [2023-12-28 03:28:40,162][106225] Updated weights for policy 1, policy_version 1146655 (0.0009) [2023-12-28 03:28:40,222][106225] Updated weights for policy 1, policy_version 1146665 (0.0008) [2023-12-28 03:28:40,331][106226] Updated weights for policy 0, policy_version 1143648 (0.0009) [2023-12-28 03:28:40,391][106226] Updated weights for policy 0, policy_version 1143658 (0.0009) [2023-12-28 03:28:40,445][106226] Updated weights for policy 0, policy_version 1143668 (0.0009) [2023-12-28 03:28:40,860][106225] Updated weights for policy 1, policy_version 1146675 (0.0008) [2023-12-28 03:28:40,924][106225] Updated weights for policy 1, policy_version 1146685 (0.0006) [2023-12-28 03:28:40,988][106225] Updated weights for policy 1, policy_version 1146695 (0.0006) [2023-12-28 03:28:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 586440704. Throughput: 0: 9677.4, 1: 10083.4. Samples: 586411764. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:41,175][105115] Avg episode reward: [(0, '-4.195'), (1, '-4.875')] [2023-12-28 03:28:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001146704_293601280.pth... [2023-12-28 03:28:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001143672_292839424.pth... [2023-12-28 03:28:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001145520_293298176.pth [2023-12-28 03:28:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001142584_292560896.pth [2023-12-28 03:28:41,235][106226] Updated weights for policy 0, policy_version 1143678 (0.0009) [2023-12-28 03:28:41,301][106226] Updated weights for policy 0, policy_version 1143688 (0.0008) [2023-12-28 03:28:41,374][106226] Updated weights for policy 0, policy_version 1143698 (0.0008) [2023-12-28 03:28:41,719][106225] Updated weights for policy 1, policy_version 1146705 (0.0009) [2023-12-28 03:28:41,785][106225] Updated weights for policy 1, policy_version 1146715 (0.0009) [2023-12-28 03:28:41,850][106225] Updated weights for policy 1, policy_version 1146725 (0.0009) [2023-12-28 03:28:41,914][106225] Updated weights for policy 1, policy_version 1146735 (0.0008) [2023-12-28 03:28:42,112][106226] Updated weights for policy 0, policy_version 1143708 (0.0008) [2023-12-28 03:28:42,170][106226] Updated weights for policy 0, policy_version 1143718 (0.0008) [2023-12-28 03:28:42,234][106226] Updated weights for policy 0, policy_version 1143728 (0.0008) [2023-12-28 03:28:42,693][106225] Updated weights for policy 1, policy_version 1146745 (0.0009) [2023-12-28 03:28:42,760][106225] Updated weights for policy 1, policy_version 1146755 (0.0007) [2023-12-28 03:28:42,825][106225] Updated weights for policy 1, policy_version 1146765 (0.0008) [2023-12-28 03:28:42,979][106226] Updated weights for policy 0, policy_version 1143738 (0.0008) [2023-12-28 03:28:43,049][106226] Updated weights for policy 0, policy_version 1143748 (0.0008) [2023-12-28 03:28:43,106][106226] Updated weights for policy 0, policy_version 1143758 (0.0008) [2023-12-28 03:28:43,160][106226] Updated weights for policy 0, policy_version 1143768 (0.0008) [2023-12-28 03:28:43,471][106225] Updated weights for policy 1, policy_version 1146775 (0.0010) [2023-12-28 03:28:43,523][106225] Updated weights for policy 1, policy_version 1146785 (0.0010) [2023-12-28 03:28:43,584][106225] Updated weights for policy 1, policy_version 1146795 (0.0010) [2023-12-28 03:28:43,896][106226] Updated weights for policy 0, policy_version 1143778 (0.0008) [2023-12-28 03:28:43,958][106226] Updated weights for policy 0, policy_version 1143788 (0.0007) [2023-12-28 03:28:44,031][106226] Updated weights for policy 0, policy_version 1143798 (0.0008) [2023-12-28 03:28:44,304][106225] Updated weights for policy 1, policy_version 1146805 (0.0010) [2023-12-28 03:28:44,365][106225] Updated weights for policy 1, policy_version 1146815 (0.0010) [2023-12-28 03:28:44,425][106225] Updated weights for policy 1, policy_version 1146825 (0.0010) [2023-12-28 03:28:44,686][106226] Updated weights for policy 0, policy_version 1143808 (0.0009) [2023-12-28 03:28:44,740][106226] Updated weights for policy 0, policy_version 1143818 (0.0008) [2023-12-28 03:28:44,806][106226] Updated weights for policy 0, policy_version 1143828 (0.0008) [2023-12-28 03:28:45,133][106225] Updated weights for policy 1, policy_version 1146835 (0.0010) [2023-12-28 03:28:45,188][106225] Updated weights for policy 1, policy_version 1146845 (0.0010) [2023-12-28 03:28:45,247][106225] Updated weights for policy 1, policy_version 1146855 (0.0007) [2023-12-28 03:28:45,557][106226] Updated weights for policy 0, policy_version 1143838 (0.0008) [2023-12-28 03:28:45,614][106226] Updated weights for policy 0, policy_version 1143848 (0.0008) [2023-12-28 03:28:45,672][106226] Updated weights for policy 0, policy_version 1143858 (0.0008) [2023-12-28 03:28:45,878][106225] Updated weights for policy 1, policy_version 1146865 (0.0008) [2023-12-28 03:28:45,938][106225] Updated weights for policy 1, policy_version 1146875 (0.0010) [2023-12-28 03:28:46,004][106225] Updated weights for policy 1, policy_version 1146885 (0.0010) [2023-12-28 03:28:46,067][106225] Updated weights for policy 1, policy_version 1146895 (0.0010) [2023-12-28 03:28:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 586539008. Throughput: 0: 9616.2, 1: 10065.1. Samples: 586525468. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:46,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.725')] [2023-12-28 03:28:46,333][106226] Updated weights for policy 0, policy_version 1143868 (0.0007) [2023-12-28 03:28:46,393][106226] Updated weights for policy 0, policy_version 1143878 (0.0010) [2023-12-28 03:28:46,443][106226] Updated weights for policy 0, policy_version 1143888 (0.0010) [2023-12-28 03:28:46,748][106225] Updated weights for policy 1, policy_version 1146905 (0.0010) [2023-12-28 03:28:46,804][106225] Updated weights for policy 1, policy_version 1146915 (0.0010) [2023-12-28 03:28:46,864][106225] Updated weights for policy 1, policy_version 1146925 (0.0010) [2023-12-28 03:28:47,071][106226] Updated weights for policy 0, policy_version 1143898 (0.0009) [2023-12-28 03:28:47,124][106226] Updated weights for policy 0, policy_version 1143908 (0.0005) [2023-12-28 03:28:47,172][106226] Updated weights for policy 0, policy_version 1143918 (0.0005) [2023-12-28 03:28:47,228][106226] Updated weights for policy 0, policy_version 1143928 (0.0010) [2023-12-28 03:28:47,502][106225] Updated weights for policy 1, policy_version 1146935 (0.0007) [2023-12-28 03:28:47,553][106225] Updated weights for policy 1, policy_version 1146945 (0.0006) [2023-12-28 03:28:47,612][106225] Updated weights for policy 1, policy_version 1146955 (0.0010) [2023-12-28 03:28:47,855][106226] Updated weights for policy 0, policy_version 1143938 (0.0010) [2023-12-28 03:28:47,917][106226] Updated weights for policy 0, policy_version 1143948 (0.0010) [2023-12-28 03:28:47,973][106226] Updated weights for policy 0, policy_version 1143958 (0.0011) [2023-12-28 03:28:48,180][106225] Updated weights for policy 1, policy_version 1146965 (0.0008) [2023-12-28 03:28:48,239][106225] Updated weights for policy 1, policy_version 1146975 (0.0005) [2023-12-28 03:28:48,294][106225] Updated weights for policy 1, policy_version 1146985 (0.0005) [2023-12-28 03:28:48,698][106226] Updated weights for policy 0, policy_version 1143968 (0.0008) [2023-12-28 03:28:48,759][106226] Updated weights for policy 0, policy_version 1143978 (0.0009) [2023-12-28 03:28:48,822][106226] Updated weights for policy 0, policy_version 1143988 (0.0011) [2023-12-28 03:28:48,915][106225] Updated weights for policy 1, policy_version 1146995 (0.0007) [2023-12-28 03:28:48,988][106225] Updated weights for policy 1, policy_version 1147005 (0.0009) [2023-12-28 03:28:49,047][106225] Updated weights for policy 1, policy_version 1147015 (0.0008) [2023-12-28 03:28:49,527][106226] Updated weights for policy 0, policy_version 1143998 (0.0008) [2023-12-28 03:28:49,584][106226] Updated weights for policy 0, policy_version 1144008 (0.0005) [2023-12-28 03:28:49,652][106226] Updated weights for policy 0, policy_version 1144018 (0.0009) [2023-12-28 03:28:49,749][106225] Updated weights for policy 1, policy_version 1147025 (0.0006) [2023-12-28 03:28:49,813][106225] Updated weights for policy 1, policy_version 1147035 (0.0007) [2023-12-28 03:28:49,886][106225] Updated weights for policy 1, policy_version 1147045 (0.0009) [2023-12-28 03:28:49,951][106225] Updated weights for policy 1, policy_version 1147055 (0.0009) [2023-12-28 03:28:50,381][106226] Updated weights for policy 0, policy_version 1144028 (0.0011) [2023-12-28 03:28:50,439][106226] Updated weights for policy 0, policy_version 1144038 (0.0010) [2023-12-28 03:28:50,490][106226] Updated weights for policy 0, policy_version 1144048 (0.0010) [2023-12-28 03:28:50,693][106225] Updated weights for policy 1, policy_version 1147065 (0.0008) [2023-12-28 03:28:50,750][106225] Updated weights for policy 1, policy_version 1147075 (0.0007) [2023-12-28 03:28:50,808][106225] Updated weights for policy 1, policy_version 1147085 (0.0008) [2023-12-28 03:28:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 586637312. Throughput: 0: 9601.1, 1: 10036.3. Samples: 586647824. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:51,175][105115] Avg episode reward: [(0, '-4.141'), (1, '-4.980')] [2023-12-28 03:28:51,240][106226] Updated weights for policy 0, policy_version 1144058 (0.0010) [2023-12-28 03:28:51,300][106226] Updated weights for policy 0, policy_version 1144068 (0.0009) [2023-12-28 03:28:51,359][106226] Updated weights for policy 0, policy_version 1144078 (0.0009) [2023-12-28 03:28:51,431][106226] Updated weights for policy 0, policy_version 1144088 (0.0007) [2023-12-28 03:28:51,587][106225] Updated weights for policy 1, policy_version 1147095 (0.0007) [2023-12-28 03:28:51,653][106225] Updated weights for policy 1, policy_version 1147105 (0.0008) [2023-12-28 03:28:51,719][106225] Updated weights for policy 1, policy_version 1147115 (0.0008) [2023-12-28 03:28:52,195][106226] Updated weights for policy 0, policy_version 1144098 (0.0009) [2023-12-28 03:28:52,246][106226] Updated weights for policy 0, policy_version 1144108 (0.0009) [2023-12-28 03:28:52,307][106226] Updated weights for policy 0, policy_version 1144118 (0.0006) [2023-12-28 03:28:52,457][106225] Updated weights for policy 1, policy_version 1147125 (0.0008) [2023-12-28 03:28:52,523][106225] Updated weights for policy 1, policy_version 1147135 (0.0008) [2023-12-28 03:28:52,587][106225] Updated weights for policy 1, policy_version 1147145 (0.0008) [2023-12-28 03:28:53,042][106226] Updated weights for policy 0, policy_version 1144128 (0.0008) [2023-12-28 03:28:53,101][106226] Updated weights for policy 0, policy_version 1144138 (0.0009) [2023-12-28 03:28:53,156][106226] Updated weights for policy 0, policy_version 1144148 (0.0009) [2023-12-28 03:28:53,283][106225] Updated weights for policy 1, policy_version 1147155 (0.0008) [2023-12-28 03:28:53,351][106225] Updated weights for policy 1, policy_version 1147165 (0.0008) [2023-12-28 03:28:53,399][106225] Updated weights for policy 1, policy_version 1147175 (0.0008) [2023-12-28 03:28:53,925][106226] Updated weights for policy 0, policy_version 1144158 (0.0010) [2023-12-28 03:28:53,982][106226] Updated weights for policy 0, policy_version 1144168 (0.0009) [2023-12-28 03:28:53,988][106225] Updated weights for policy 1, policy_version 1147185 (0.0008) [2023-12-28 03:28:54,034][106226] Updated weights for policy 0, policy_version 1144178 (0.0006) [2023-12-28 03:28:54,044][106225] Updated weights for policy 1, policy_version 1147195 (0.0006) [2023-12-28 03:28:54,099][106225] Updated weights for policy 1, policy_version 1147205 (0.0009) [2023-12-28 03:28:54,156][106225] Updated weights for policy 1, policy_version 1147215 (0.0009) [2023-12-28 03:28:54,749][106226] Updated weights for policy 0, policy_version 1144188 (0.0007) [2023-12-28 03:28:54,806][106226] Updated weights for policy 0, policy_version 1144198 (0.0008) [2023-12-28 03:28:54,859][106226] Updated weights for policy 0, policy_version 1144208 (0.0008) [2023-12-28 03:28:54,883][106225] Updated weights for policy 1, policy_version 1147225 (0.0007) [2023-12-28 03:28:54,943][106225] Updated weights for policy 1, policy_version 1147235 (0.0008) [2023-12-28 03:28:54,965][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000003 [2023-12-28 03:28:55,580][106226] Updated weights for policy 0, policy_version 1144218 (0.0009) [2023-12-28 03:28:55,635][106226] Updated weights for policy 0, policy_version 1144228 (0.0007) [2023-12-28 03:28:55,697][106226] Updated weights for policy 0, policy_version 1144238 (0.0007) [2023-12-28 03:28:55,703][106225] Updated weights for policy 1, policy_version 1147245 (0.0008) [2023-12-28 03:28:55,756][106225] Updated weights for policy 1, policy_version 1147255 (0.0005) [2023-12-28 03:28:55,757][106226] Updated weights for policy 0, policy_version 1144248 (0.0008) [2023-12-28 03:28:55,814][106225] Updated weights for policy 1, policy_version 1147265 (0.0005) [2023-12-28 03:28:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 586735616. Throughput: 0: 9538.7, 1: 10009.6. Samples: 586704900. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:28:56,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.574')] [2023-12-28 03:28:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001147272_293748736.pth... [2023-12-28 03:28:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001144248_292986880.pth... [2023-12-28 03:28:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001146096_293445632.pth [2023-12-28 03:28:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001143128_292700160.pth [2023-12-28 03:28:56,402][106225] Updated weights for policy 1, policy_version 1147275 (0.0009) [2023-12-28 03:28:56,464][106225] Updated weights for policy 1, policy_version 1147285 (0.0010) [2023-12-28 03:28:56,512][106226] Updated weights for policy 0, policy_version 1144258 (0.0005) [2023-12-28 03:28:56,518][106225] Updated weights for policy 1, policy_version 1147295 (0.0010) [2023-12-28 03:28:56,570][106226] Updated weights for policy 0, policy_version 1144268 (0.0005) [2023-12-28 03:28:56,621][106226] Updated weights for policy 0, policy_version 1144278 (0.0008) [2023-12-28 03:28:57,108][106225] Updated weights for policy 1, policy_version 1147305 (0.0010) [2023-12-28 03:28:57,168][106225] Updated weights for policy 1, policy_version 1147315 (0.0006) [2023-12-28 03:28:57,229][106225] Updated weights for policy 1, policy_version 1147325 (0.0009) [2023-12-28 03:28:57,282][106225] Updated weights for policy 1, policy_version 1147335 (0.0010) [2023-12-28 03:28:57,376][106226] Updated weights for policy 0, policy_version 1144288 (0.0008) [2023-12-28 03:28:57,421][106226] Updated weights for policy 0, policy_version 1144298 (0.0007) [2023-12-28 03:28:57,470][106226] Updated weights for policy 0, policy_version 1144308 (0.0006) [2023-12-28 03:28:57,972][106225] Updated weights for policy 1, policy_version 1147345 (0.0006) [2023-12-28 03:28:58,020][106226] Updated weights for policy 0, policy_version 1144318 (0.0006) [2023-12-28 03:28:58,033][106225] Updated weights for policy 1, policy_version 1147355 (0.0006) [2023-12-28 03:28:58,072][106226] Updated weights for policy 0, policy_version 1144328 (0.0007) [2023-12-28 03:28:58,085][106225] Updated weights for policy 1, policy_version 1147365 (0.0009) [2023-12-28 03:28:58,121][106226] Updated weights for policy 0, policy_version 1144338 (0.0006) [2023-12-28 03:28:58,875][106226] Updated weights for policy 0, policy_version 1144348 (0.0006) [2023-12-28 03:28:58,882][106225] Updated weights for policy 1, policy_version 1147375 (0.0008) [2023-12-28 03:28:58,936][106226] Updated weights for policy 0, policy_version 1144358 (0.0007) [2023-12-28 03:28:58,950][106225] Updated weights for policy 1, policy_version 1147385 (0.0006) [2023-12-28 03:28:59,001][106226] Updated weights for policy 0, policy_version 1144368 (0.0008) [2023-12-28 03:28:59,015][106225] Updated weights for policy 1, policy_version 1147395 (0.0007) [2023-12-28 03:28:59,765][106226] Updated weights for policy 0, policy_version 1144378 (0.0010) [2023-12-28 03:28:59,828][106226] Updated weights for policy 0, policy_version 1144388 (0.0007) [2023-12-28 03:28:59,855][106225] Updated weights for policy 1, policy_version 1147405 (0.0007) [2023-12-28 03:28:59,891][106226] Updated weights for policy 0, policy_version 1144398 (0.0011) [2023-12-28 03:28:59,907][106225] Updated weights for policy 1, policy_version 1147415 (0.0008) [2023-12-28 03:28:59,955][106226] Updated weights for policy 0, policy_version 1144408 (0.0011) [2023-12-28 03:28:59,971][106225] Updated weights for policy 1, policy_version 1147425 (0.0007) [2023-12-28 03:29:00,609][106225] Updated weights for policy 1, policy_version 1147435 (0.0008) [2023-12-28 03:29:00,660][106226] Updated weights for policy 0, policy_version 1144418 (0.0006) [2023-12-28 03:29:00,663][106225] Updated weights for policy 1, policy_version 1147445 (0.0006) [2023-12-28 03:29:00,704][106226] Updated weights for policy 0, policy_version 1144428 (0.0005) [2023-12-28 03:29:00,708][106225] Updated weights for policy 1, policy_version 1147455 (0.0005) [2023-12-28 03:29:00,752][106226] Updated weights for policy 0, policy_version 1144438 (0.0005) [2023-12-28 03:29:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 586833920. Throughput: 0: 9540.5, 1: 10049.4. Samples: 586823260. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:29:01,175][105115] Avg episode reward: [(0, '-4.317'), (1, '-4.716')] [2023-12-28 03:29:01,298][106225] Updated weights for policy 1, policy_version 1147465 (0.0006) [2023-12-28 03:29:01,348][106225] Updated weights for policy 1, policy_version 1147475 (0.0008) [2023-12-28 03:29:01,393][106226] Updated weights for policy 0, policy_version 1144448 (0.0007) [2023-12-28 03:29:01,415][106225] Updated weights for policy 1, policy_version 1147485 (0.0008) [2023-12-28 03:29:01,451][106226] Updated weights for policy 0, policy_version 1144458 (0.0007) [2023-12-28 03:29:01,474][106225] Updated weights for policy 1, policy_version 1147495 (0.0005) [2023-12-28 03:29:01,512][106226] Updated weights for policy 0, policy_version 1144468 (0.0009) [2023-12-28 03:29:02,187][106225] Updated weights for policy 1, policy_version 1147505 (0.0009) [2023-12-28 03:29:02,217][106226] Updated weights for policy 0, policy_version 1144478 (0.0007) [2023-12-28 03:29:02,241][106225] Updated weights for policy 1, policy_version 1147515 (0.0009) [2023-12-28 03:29:02,285][106226] Updated weights for policy 0, policy_version 1144488 (0.0007) [2023-12-28 03:29:02,308][106225] Updated weights for policy 1, policy_version 1147525 (0.0007) [2023-12-28 03:29:02,331][106226] Updated weights for policy 0, policy_version 1144498 (0.0006) [2023-12-28 03:29:03,031][106225] Updated weights for policy 1, policy_version 1147535 (0.0008) [2023-12-28 03:29:03,073][106226] Updated weights for policy 0, policy_version 1144508 (0.0007) [2023-12-28 03:29:03,083][106225] Updated weights for policy 1, policy_version 1147545 (0.0007) [2023-12-28 03:29:03,114][106226] Updated weights for policy 0, policy_version 1144518 (0.0005) [2023-12-28 03:29:03,130][106225] Updated weights for policy 1, policy_version 1147555 (0.0006) [2023-12-28 03:29:03,167][106226] Updated weights for policy 0, policy_version 1144528 (0.0005) [2023-12-28 03:29:03,799][106226] Updated weights for policy 0, policy_version 1144538 (0.0005) [2023-12-28 03:29:03,895][106226] Updated weights for policy 0, policy_version 1144548 (0.0007) [2023-12-28 03:29:03,901][106225] Updated weights for policy 1, policy_version 1147565 (0.0008) [2023-12-28 03:29:03,952][106226] Updated weights for policy 0, policy_version 1144558 (0.0006) [2023-12-28 03:29:03,957][106225] Updated weights for policy 1, policy_version 1147575 (0.0008) [2023-12-28 03:29:04,014][106226] Updated weights for policy 0, policy_version 1144568 (0.0006) [2023-12-28 03:29:04,017][106225] Updated weights for policy 1, policy_version 1147585 (0.0007) [2023-12-28 03:29:04,681][106226] Updated weights for policy 0, policy_version 1144578 (0.0008) [2023-12-28 03:29:04,695][106225] Updated weights for policy 1, policy_version 1147595 (0.0007) [2023-12-28 03:29:04,737][106226] Updated weights for policy 0, policy_version 1144588 (0.0007) [2023-12-28 03:29:04,757][106225] Updated weights for policy 1, policy_version 1147605 (0.0007) [2023-12-28 03:29:04,793][106226] Updated weights for policy 0, policy_version 1144598 (0.0006) [2023-12-28 03:29:04,818][106225] Updated weights for policy 1, policy_version 1147615 (0.0009) [2023-12-28 03:29:05,497][106226] Updated weights for policy 0, policy_version 1144608 (0.0007) [2023-12-28 03:29:05,529][106225] Updated weights for policy 1, policy_version 1147625 (0.0009) [2023-12-28 03:29:05,555][106226] Updated weights for policy 0, policy_version 1144618 (0.0006) [2023-12-28 03:29:05,588][106225] Updated weights for policy 1, policy_version 1147635 (0.0008) [2023-12-28 03:29:05,620][106226] Updated weights for policy 0, policy_version 1144628 (0.0005) [2023-12-28 03:29:05,641][106225] Updated weights for policy 1, policy_version 1147645 (0.0008) [2023-12-28 03:29:05,699][106225] Updated weights for policy 1, policy_version 1147655 (0.0008) [2023-12-28 03:29:06,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 586932224. Throughput: 0: 9637.4, 1: 10061.2. Samples: 586944072. Policy #0 lag: (min: 19.0, avg: 36.0, max: 51.0) [2023-12-28 03:29:06,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.986')] [2023-12-28 03:29:06,218][106226] Updated weights for policy 0, policy_version 1144638 (0.0007) [2023-12-28 03:29:06,284][106226] Updated weights for policy 0, policy_version 1144648 (0.0007) [2023-12-28 03:29:06,348][106226] Updated weights for policy 0, policy_version 1144658 (0.0008) [2023-12-28 03:29:06,482][106225] Updated weights for policy 1, policy_version 1147665 (0.0006) [2023-12-28 03:29:06,530][106225] Updated weights for policy 1, policy_version 1147675 (0.0007) [2023-12-28 03:29:06,590][106225] Updated weights for policy 1, policy_version 1147685 (0.0009) [2023-12-28 03:29:07,111][106226] Updated weights for policy 0, policy_version 1144668 (0.0008) [2023-12-28 03:29:07,174][106226] Updated weights for policy 0, policy_version 1144678 (0.0008) [2023-12-28 03:29:07,237][106226] Updated weights for policy 0, policy_version 1144688 (0.0009) [2023-12-28 03:29:07,259][106225] Updated weights for policy 1, policy_version 1147695 (0.0007) [2023-12-28 03:29:07,327][106225] Updated weights for policy 1, policy_version 1147705 (0.0005) [2023-12-28 03:29:07,394][106225] Updated weights for policy 1, policy_version 1147715 (0.0005) [2023-12-28 03:29:07,892][106226] Updated weights for policy 0, policy_version 1144698 (0.0007) [2023-12-28 03:29:07,929][106225] Updated weights for policy 1, policy_version 1147725 (0.0006) [2023-12-28 03:29:07,947][106226] Updated weights for policy 0, policy_version 1144708 (0.0007) [2023-12-28 03:29:07,978][106225] Updated weights for policy 1, policy_version 1147735 (0.0005) [2023-12-28 03:29:08,005][106226] Updated weights for policy 0, policy_version 1144718 (0.0011) [2023-12-28 03:29:08,039][106225] Updated weights for policy 1, policy_version 1147745 (0.0009) [2023-12-28 03:29:08,059][106226] Updated weights for policy 0, policy_version 1144728 (0.0010) [2023-12-28 03:29:08,749][106225] Updated weights for policy 1, policy_version 1147755 (0.0010) [2023-12-28 03:29:08,761][106226] Updated weights for policy 0, policy_version 1144738 (0.0011) [2023-12-28 03:29:08,809][106226] Updated weights for policy 0, policy_version 1144748 (0.0010) [2023-12-28 03:29:08,813][106225] Updated weights for policy 1, policy_version 1147765 (0.0010) [2023-12-28 03:29:08,866][106226] Updated weights for policy 0, policy_version 1144758 (0.0011) [2023-12-28 03:29:08,871][106225] Updated weights for policy 1, policy_version 1147775 (0.0010) [2023-12-28 03:29:09,603][106225] Updated weights for policy 1, policy_version 1147785 (0.0010) [2023-12-28 03:29:09,656][106226] Updated weights for policy 0, policy_version 1144768 (0.0008) [2023-12-28 03:29:09,668][106225] Updated weights for policy 1, policy_version 1147795 (0.0008) [2023-12-28 03:29:09,726][106226] Updated weights for policy 0, policy_version 1144778 (0.0008) [2023-12-28 03:29:09,740][106225] Updated weights for policy 1, policy_version 1147805 (0.0006) [2023-12-28 03:29:09,794][106226] Updated weights for policy 0, policy_version 1144788 (0.0008) [2023-12-28 03:29:09,797][106225] Updated weights for policy 1, policy_version 1147815 (0.0006) [2023-12-28 03:29:10,489][106225] Updated weights for policy 1, policy_version 1147825 (0.0008) [2023-12-28 03:29:10,543][106226] Updated weights for policy 0, policy_version 1144798 (0.0007) [2023-12-28 03:29:10,552][106225] Updated weights for policy 1, policy_version 1147835 (0.0008) [2023-12-28 03:29:10,598][106226] Updated weights for policy 0, policy_version 1144808 (0.0006) [2023-12-28 03:29:10,608][106225] Updated weights for policy 1, policy_version 1147845 (0.0008) [2023-12-28 03:29:10,652][106226] Updated weights for policy 0, policy_version 1144818 (0.0007) [2023-12-28 03:29:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19799.7). Total num frames: 587030528. Throughput: 0: 9683.5, 1: 10147.4. Samples: 587003956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:11,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-5.190')] [2023-12-28 03:29:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001147848_293896192.pth... [2023-12-28 03:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001144824_293134336.pth... [2023-12-28 03:29:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001146704_293601280.pth [2023-12-28 03:29:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001143672_292839424.pth [2023-12-28 03:29:11,315][106225] Updated weights for policy 1, policy_version 1147855 (0.0008) [2023-12-28 03:29:11,388][106225] Updated weights for policy 1, policy_version 1147865 (0.0009) [2023-12-28 03:29:11,389][106226] Updated weights for policy 0, policy_version 1144828 (0.0008) [2023-12-28 03:29:11,455][106225] Updated weights for policy 1, policy_version 1147875 (0.0006) [2023-12-28 03:29:11,458][106226] Updated weights for policy 0, policy_version 1144838 (0.0007) [2023-12-28 03:29:11,522][106226] Updated weights for policy 0, policy_version 1144848 (0.0008) [2023-12-28 03:29:12,185][106225] Updated weights for policy 1, policy_version 1147885 (0.0009) [2023-12-28 03:29:12,247][106225] Updated weights for policy 1, policy_version 1147895 (0.0006) [2023-12-28 03:29:12,315][106225] Updated weights for policy 1, policy_version 1147905 (0.0009) [2023-12-28 03:29:12,343][106226] Updated weights for policy 0, policy_version 1144858 (0.0009) [2023-12-28 03:29:12,407][106226] Updated weights for policy 0, policy_version 1144868 (0.0009) [2023-12-28 03:29:12,468][106226] Updated weights for policy 0, policy_version 1144878 (0.0010) [2023-12-28 03:29:12,526][106226] Updated weights for policy 0, policy_version 1144888 (0.0011) [2023-12-28 03:29:13,047][106225] Updated weights for policy 1, policy_version 1147915 (0.0009) [2023-12-28 03:29:13,107][106225] Updated weights for policy 1, policy_version 1147925 (0.0008) [2023-12-28 03:29:13,174][106225] Updated weights for policy 1, policy_version 1147935 (0.0010) [2023-12-28 03:29:13,219][106226] Updated weights for policy 0, policy_version 1144898 (0.0011) [2023-12-28 03:29:13,282][106226] Updated weights for policy 0, policy_version 1144908 (0.0010) [2023-12-28 03:29:13,344][106226] Updated weights for policy 0, policy_version 1144918 (0.0011) [2023-12-28 03:29:13,856][106225] Updated weights for policy 1, policy_version 1147945 (0.0010) [2023-12-28 03:29:13,909][106225] Updated weights for policy 1, policy_version 1147955 (0.0010) [2023-12-28 03:29:13,969][106225] Updated weights for policy 1, policy_version 1147965 (0.0010) [2023-12-28 03:29:14,020][106225] Updated weights for policy 1, policy_version 1147975 (0.0010) [2023-12-28 03:29:14,043][106226] Updated weights for policy 0, policy_version 1144928 (0.0010) [2023-12-28 03:29:14,109][106226] Updated weights for policy 0, policy_version 1144938 (0.0010) [2023-12-28 03:29:14,173][106226] Updated weights for policy 0, policy_version 1144948 (0.0010) [2023-12-28 03:29:14,797][106225] Updated weights for policy 1, policy_version 1147985 (0.0008) [2023-12-28 03:29:14,863][106225] Updated weights for policy 1, policy_version 1147995 (0.0009) [2023-12-28 03:29:14,930][106225] Updated weights for policy 1, policy_version 1148005 (0.0008) [2023-12-28 03:29:14,945][106226] Updated weights for policy 0, policy_version 1144958 (0.0008) [2023-12-28 03:29:15,021][106226] Updated weights for policy 0, policy_version 1144968 (0.0009) [2023-12-28 03:29:15,091][106226] Updated weights for policy 0, policy_version 1144978 (0.0008) [2023-12-28 03:29:15,618][106225] Updated weights for policy 1, policy_version 1148015 (0.0009) [2023-12-28 03:29:15,672][106225] Updated weights for policy 1, policy_version 1148025 (0.0009) [2023-12-28 03:29:15,722][106226] Updated weights for policy 0, policy_version 1144988 (0.0008) [2023-12-28 03:29:15,734][106225] Updated weights for policy 1, policy_version 1148035 (0.0009) [2023-12-28 03:29:15,780][106226] Updated weights for policy 0, policy_version 1144998 (0.0007) [2023-12-28 03:29:15,833][106226] Updated weights for policy 0, policy_version 1145008 (0.0009) [2023-12-28 03:29:16,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 587128832. Throughput: 0: 9594.8, 1: 10005.6. Samples: 587116568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:16,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.736')] [2023-12-28 03:29:16,418][106225] Updated weights for policy 1, policy_version 1148045 (0.0009) [2023-12-28 03:29:16,462][106225] Updated weights for policy 1, policy_version 1148055 (0.0010) [2023-12-28 03:29:16,510][106225] Updated weights for policy 1, policy_version 1148065 (0.0010) [2023-12-28 03:29:16,539][106226] Updated weights for policy 0, policy_version 1145018 (0.0008) [2023-12-28 03:29:16,596][106226] Updated weights for policy 0, policy_version 1145028 (0.0008) [2023-12-28 03:29:16,656][106226] Updated weights for policy 0, policy_version 1145038 (0.0008) [2023-12-28 03:29:16,729][106226] Updated weights for policy 0, policy_version 1145048 (0.0008) [2023-12-28 03:29:17,239][106225] Updated weights for policy 1, policy_version 1148075 (0.0010) [2023-12-28 03:29:17,289][106225] Updated weights for policy 1, policy_version 1148085 (0.0010) [2023-12-28 03:29:17,339][106225] Updated weights for policy 1, policy_version 1148095 (0.0010) [2023-12-28 03:29:17,460][106226] Updated weights for policy 0, policy_version 1145058 (0.0007) [2023-12-28 03:29:17,517][106226] Updated weights for policy 0, policy_version 1145068 (0.0008) [2023-12-28 03:29:17,566][106226] Updated weights for policy 0, policy_version 1145078 (0.0008) [2023-12-28 03:29:18,069][106225] Updated weights for policy 1, policy_version 1148105 (0.0010) [2023-12-28 03:29:18,123][106225] Updated weights for policy 1, policy_version 1148115 (0.0010) [2023-12-28 03:29:18,177][106225] Updated weights for policy 1, policy_version 1148125 (0.0010) [2023-12-28 03:29:18,227][106225] Updated weights for policy 1, policy_version 1148135 (0.0010) [2023-12-28 03:29:18,297][106226] Updated weights for policy 0, policy_version 1145088 (0.0008) [2023-12-28 03:29:18,348][106226] Updated weights for policy 0, policy_version 1145098 (0.0009) [2023-12-28 03:29:18,416][106226] Updated weights for policy 0, policy_version 1145108 (0.0006) [2023-12-28 03:29:18,901][106225] Updated weights for policy 1, policy_version 1148145 (0.0006) [2023-12-28 03:29:18,967][106225] Updated weights for policy 1, policy_version 1148155 (0.0006) [2023-12-28 03:29:19,023][106225] Updated weights for policy 1, policy_version 1148165 (0.0008) [2023-12-28 03:29:19,174][106226] Updated weights for policy 0, policy_version 1145118 (0.0008) [2023-12-28 03:29:19,240][106226] Updated weights for policy 0, policy_version 1145128 (0.0009) [2023-12-28 03:29:19,298][106226] Updated weights for policy 0, policy_version 1145138 (0.0009) [2023-12-28 03:29:19,669][106225] Updated weights for policy 1, policy_version 1148175 (0.0008) [2023-12-28 03:29:19,728][106225] Updated weights for policy 1, policy_version 1148185 (0.0008) [2023-12-28 03:29:19,785][106225] Updated weights for policy 1, policy_version 1148195 (0.0009) [2023-12-28 03:29:19,973][106226] Updated weights for policy 0, policy_version 1145148 (0.0009) [2023-12-28 03:29:20,037][106226] Updated weights for policy 0, policy_version 1145158 (0.0009) [2023-12-28 03:29:20,106][106226] Updated weights for policy 0, policy_version 1145168 (0.0008) [2023-12-28 03:29:20,528][106225] Updated weights for policy 1, policy_version 1148205 (0.0009) [2023-12-28 03:29:20,601][106225] Updated weights for policy 1, policy_version 1148215 (0.0010) [2023-12-28 03:29:20,668][106225] Updated weights for policy 1, policy_version 1148225 (0.0009) [2023-12-28 03:29:20,871][106226] Updated weights for policy 0, policy_version 1145178 (0.0009) [2023-12-28 03:29:20,930][106226] Updated weights for policy 0, policy_version 1145188 (0.0010) [2023-12-28 03:29:20,985][106226] Updated weights for policy 0, policy_version 1145198 (0.0010) [2023-12-28 03:29:21,051][106226] Updated weights for policy 0, policy_version 1145208 (0.0008) [2023-12-28 03:29:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 587227136. Throughput: 0: 9612.3, 1: 9926.1. Samples: 587233020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:21,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-4.798')] [2023-12-28 03:29:21,332][106225] Updated weights for policy 1, policy_version 1148235 (0.0009) [2023-12-28 03:29:21,416][106225] Updated weights for policy 1, policy_version 1148245 (0.0008) [2023-12-28 03:29:21,472][106225] Updated weights for policy 1, policy_version 1148255 (0.0008) [2023-12-28 03:29:21,904][106226] Updated weights for policy 0, policy_version 1145218 (0.0007) [2023-12-28 03:29:21,970][106226] Updated weights for policy 0, policy_version 1145228 (0.0008) [2023-12-28 03:29:22,037][106226] Updated weights for policy 0, policy_version 1145238 (0.0007) [2023-12-28 03:29:22,290][106225] Updated weights for policy 1, policy_version 1148265 (0.0008) [2023-12-28 03:29:22,366][106225] Updated weights for policy 1, policy_version 1148275 (0.0009) [2023-12-28 03:29:22,432][106225] Updated weights for policy 1, policy_version 1148285 (0.0008) [2023-12-28 03:29:22,493][106225] Updated weights for policy 1, policy_version 1148295 (0.0009) [2023-12-28 03:29:22,725][106226] Updated weights for policy 0, policy_version 1145248 (0.0010) [2023-12-28 03:29:22,788][106226] Updated weights for policy 0, policy_version 1145258 (0.0009) [2023-12-28 03:29:22,851][106226] Updated weights for policy 0, policy_version 1145268 (0.0009) [2023-12-28 03:29:23,108][106225] Updated weights for policy 1, policy_version 1148305 (0.0008) [2023-12-28 03:29:23,159][106225] Updated weights for policy 1, policy_version 1148315 (0.0008) [2023-12-28 03:29:23,217][106225] Updated weights for policy 1, policy_version 1148325 (0.0009) [2023-12-28 03:29:23,615][106226] Updated weights for policy 0, policy_version 1145278 (0.0009) [2023-12-28 03:29:23,674][106226] Updated weights for policy 0, policy_version 1145288 (0.0008) [2023-12-28 03:29:23,726][106226] Updated weights for policy 0, policy_version 1145298 (0.0009) [2023-12-28 03:29:23,927][106225] Updated weights for policy 1, policy_version 1148335 (0.0008) [2023-12-28 03:29:23,987][106225] Updated weights for policy 1, policy_version 1148345 (0.0007) [2023-12-28 03:29:24,054][106225] Updated weights for policy 1, policy_version 1148355 (0.0010) [2023-12-28 03:29:24,378][106226] Updated weights for policy 0, policy_version 1145308 (0.0008) [2023-12-28 03:29:24,437][106226] Updated weights for policy 0, policy_version 1145318 (0.0009) [2023-12-28 03:29:24,497][106226] Updated weights for policy 0, policy_version 1145328 (0.0009) [2023-12-28 03:29:24,749][106225] Updated weights for policy 1, policy_version 1148365 (0.0009) [2023-12-28 03:29:24,808][106225] Updated weights for policy 1, policy_version 1148375 (0.0005) [2023-12-28 03:29:24,864][106225] Updated weights for policy 1, policy_version 1148385 (0.0005) [2023-12-28 03:29:25,157][106226] Updated weights for policy 0, policy_version 1145338 (0.0010) [2023-12-28 03:29:25,226][106226] Updated weights for policy 0, policy_version 1145348 (0.0010) [2023-12-28 03:29:25,294][106226] Updated weights for policy 0, policy_version 1145358 (0.0008) [2023-12-28 03:29:25,347][106226] Updated weights for policy 0, policy_version 1145368 (0.0007) [2023-12-28 03:29:25,471][106225] Updated weights for policy 1, policy_version 1148395 (0.0006) [2023-12-28 03:29:25,526][106225] Updated weights for policy 1, policy_version 1148405 (0.0008) [2023-12-28 03:29:25,591][106225] Updated weights for policy 1, policy_version 1148415 (0.0008) [2023-12-28 03:29:25,985][106226] Updated weights for policy 0, policy_version 1145378 (0.0009) [2023-12-28 03:29:26,045][106226] Updated weights for policy 0, policy_version 1145388 (0.0009) [2023-12-28 03:29:26,106][106226] Updated weights for policy 0, policy_version 1145398 (0.0009) [2023-12-28 03:29:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 587325440. Throughput: 0: 9641.3, 1: 9889.9. Samples: 587290668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:26,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.109')] [2023-12-28 03:29:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001148424_294043648.pth... [2023-12-28 03:29:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001145400_293281792.pth... [2023-12-28 03:29:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001144248_292986880.pth [2023-12-28 03:29:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001147272_293748736.pth [2023-12-28 03:29:26,294][106225] Updated weights for policy 1, policy_version 1148425 (0.0007) [2023-12-28 03:29:26,349][106225] Updated weights for policy 1, policy_version 1148435 (0.0005) [2023-12-28 03:29:26,403][106225] Updated weights for policy 1, policy_version 1148445 (0.0008) [2023-12-28 03:29:26,462][106225] Updated weights for policy 1, policy_version 1148455 (0.0008) [2023-12-28 03:29:26,725][106226] Updated weights for policy 0, policy_version 1145408 (0.0007) [2023-12-28 03:29:26,779][106226] Updated weights for policy 0, policy_version 1145418 (0.0005) [2023-12-28 03:29:26,836][106226] Updated weights for policy 0, policy_version 1145428 (0.0005) [2023-12-28 03:29:27,162][106225] Updated weights for policy 1, policy_version 1148465 (0.0008) [2023-12-28 03:29:27,209][106225] Updated weights for policy 1, policy_version 1148475 (0.0008) [2023-12-28 03:29:27,263][106225] Updated weights for policy 1, policy_version 1148485 (0.0008) [2023-12-28 03:29:27,463][106226] Updated weights for policy 0, policy_version 1145438 (0.0007) [2023-12-28 03:29:27,507][106226] Updated weights for policy 0, policy_version 1145448 (0.0008) [2023-12-28 03:29:27,551][106226] Updated weights for policy 0, policy_version 1145458 (0.0008) [2023-12-28 03:29:27,922][106225] Updated weights for policy 1, policy_version 1148495 (0.0009) [2023-12-28 03:29:27,966][106225] Updated weights for policy 1, policy_version 1148505 (0.0008) [2023-12-28 03:29:28,012][106225] Updated weights for policy 1, policy_version 1148515 (0.0008) [2023-12-28 03:29:28,309][106226] Updated weights for policy 0, policy_version 1145468 (0.0008) [2023-12-28 03:29:28,377][106226] Updated weights for policy 0, policy_version 1145478 (0.0010) [2023-12-28 03:29:28,436][106226] Updated weights for policy 0, policy_version 1145488 (0.0008) [2023-12-28 03:29:28,769][106225] Updated weights for policy 1, policy_version 1148525 (0.0008) [2023-12-28 03:29:28,831][106225] Updated weights for policy 1, policy_version 1148535 (0.0008) [2023-12-28 03:29:28,892][106225] Updated weights for policy 1, policy_version 1148545 (0.0010) [2023-12-28 03:29:29,167][106226] Updated weights for policy 0, policy_version 1145498 (0.0009) [2023-12-28 03:29:29,227][106226] Updated weights for policy 0, policy_version 1145508 (0.0009) [2023-12-28 03:29:29,296][106226] Updated weights for policy 0, policy_version 1145518 (0.0007) [2023-12-28 03:29:29,366][106226] Updated weights for policy 0, policy_version 1145528 (0.0007) [2023-12-28 03:29:29,568][106225] Updated weights for policy 1, policy_version 1148555 (0.0009) [2023-12-28 03:29:29,627][106225] Updated weights for policy 1, policy_version 1148565 (0.0011) [2023-12-28 03:29:29,693][106225] Updated weights for policy 1, policy_version 1148575 (0.0010) [2023-12-28 03:29:30,092][106226] Updated weights for policy 0, policy_version 1145538 (0.0010) [2023-12-28 03:29:30,157][106226] Updated weights for policy 0, policy_version 1145548 (0.0011) [2023-12-28 03:29:30,229][106226] Updated weights for policy 0, policy_version 1145558 (0.0011) [2023-12-28 03:29:30,410][106225] Updated weights for policy 1, policy_version 1148585 (0.0009) [2023-12-28 03:29:30,469][106225] Updated weights for policy 1, policy_version 1148595 (0.0005) [2023-12-28 03:29:30,528][106225] Updated weights for policy 1, policy_version 1148605 (0.0005) [2023-12-28 03:29:30,591][106225] Updated weights for policy 1, policy_version 1148615 (0.0005) [2023-12-28 03:29:30,940][106226] Updated weights for policy 0, policy_version 1145568 (0.0008) [2023-12-28 03:29:30,989][106226] Updated weights for policy 0, policy_version 1145578 (0.0007) [2023-12-28 03:29:31,047][106226] Updated weights for policy 0, policy_version 1145588 (0.0008) [2023-12-28 03:29:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 587423744. Throughput: 0: 9744.9, 1: 9957.6. Samples: 587412080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:31,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.726')] [2023-12-28 03:29:31,205][106225] Updated weights for policy 1, policy_version 1148625 (0.0007) [2023-12-28 03:29:31,269][106225] Updated weights for policy 1, policy_version 1148635 (0.0006) [2023-12-28 03:29:31,336][106225] Updated weights for policy 1, policy_version 1148645 (0.0008) [2023-12-28 03:29:31,836][106226] Updated weights for policy 0, policy_version 1145598 (0.0008) [2023-12-28 03:29:31,893][106226] Updated weights for policy 0, policy_version 1145608 (0.0005) [2023-12-28 03:29:31,957][106226] Updated weights for policy 0, policy_version 1145618 (0.0005) [2023-12-28 03:29:32,024][106225] Updated weights for policy 1, policy_version 1148655 (0.0008) [2023-12-28 03:29:32,086][106225] Updated weights for policy 1, policy_version 1148665 (0.0006) [2023-12-28 03:29:32,139][106225] Updated weights for policy 1, policy_version 1148675 (0.0006) [2023-12-28 03:29:32,634][106226] Updated weights for policy 0, policy_version 1145628 (0.0007) [2023-12-28 03:29:32,694][106226] Updated weights for policy 0, policy_version 1145638 (0.0008) [2023-12-28 03:29:32,754][106226] Updated weights for policy 0, policy_version 1145648 (0.0007) [2023-12-28 03:29:32,891][106225] Updated weights for policy 1, policy_version 1148685 (0.0008) [2023-12-28 03:29:32,943][106225] Updated weights for policy 1, policy_version 1148695 (0.0010) [2023-12-28 03:29:32,999][106225] Updated weights for policy 1, policy_version 1148705 (0.0007) [2023-12-28 03:29:33,480][106226] Updated weights for policy 0, policy_version 1145658 (0.0008) [2023-12-28 03:29:33,540][106226] Updated weights for policy 0, policy_version 1145668 (0.0007) [2023-12-28 03:29:33,600][106226] Updated weights for policy 0, policy_version 1145678 (0.0008) [2023-12-28 03:29:33,652][106226] Updated weights for policy 0, policy_version 1145688 (0.0007) [2023-12-28 03:29:33,712][106225] Updated weights for policy 1, policy_version 1148715 (0.0010) [2023-12-28 03:29:33,773][106225] Updated weights for policy 1, policy_version 1148725 (0.0010) [2023-12-28 03:29:33,838][106225] Updated weights for policy 1, policy_version 1148735 (0.0010) [2023-12-28 03:29:34,380][106226] Updated weights for policy 0, policy_version 1145698 (0.0008) [2023-12-28 03:29:34,435][106226] Updated weights for policy 0, policy_version 1145708 (0.0008) [2023-12-28 03:29:34,494][106226] Updated weights for policy 0, policy_version 1145718 (0.0008) [2023-12-28 03:29:34,585][106225] Updated weights for policy 1, policy_version 1148745 (0.0010) [2023-12-28 03:29:34,647][106225] Updated weights for policy 1, policy_version 1148755 (0.0011) [2023-12-28 03:29:34,701][106225] Updated weights for policy 1, policy_version 1148765 (0.0010) [2023-12-28 03:29:34,758][106225] Updated weights for policy 1, policy_version 1148775 (0.0010) [2023-12-28 03:29:35,240][106226] Updated weights for policy 0, policy_version 1145728 (0.0008) [2023-12-28 03:29:35,304][106226] Updated weights for policy 0, policy_version 1145738 (0.0008) [2023-12-28 03:29:35,358][106226] Updated weights for policy 0, policy_version 1145748 (0.0008) [2023-12-28 03:29:35,476][106225] Updated weights for policy 1, policy_version 1148785 (0.0011) [2023-12-28 03:29:35,526][106225] Updated weights for policy 1, policy_version 1148795 (0.0010) [2023-12-28 03:29:35,585][106225] Updated weights for policy 1, policy_version 1148805 (0.0010) [2023-12-28 03:29:36,126][106226] Updated weights for policy 0, policy_version 1145758 (0.0009) [2023-12-28 03:29:36,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19744.1). Total num frames: 587513856. Throughput: 0: 9673.7, 1: 9883.1. Samples: 587527880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:36,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.794')] [2023-12-28 03:29:36,193][106226] Updated weights for policy 0, policy_version 1145768 (0.0011) [2023-12-28 03:29:36,244][106226] Updated weights for policy 0, policy_version 1145778 (0.0009) [2023-12-28 03:29:36,280][106225] Updated weights for policy 1, policy_version 1148815 (0.0009) [2023-12-28 03:29:36,343][106225] Updated weights for policy 1, policy_version 1148825 (0.0008) [2023-12-28 03:29:36,409][106225] Updated weights for policy 1, policy_version 1148835 (0.0006) [2023-12-28 03:29:36,913][106226] Updated weights for policy 0, policy_version 1145788 (0.0010) [2023-12-28 03:29:36,979][106226] Updated weights for policy 0, policy_version 1145798 (0.0008) [2023-12-28 03:29:37,042][106226] Updated weights for policy 0, policy_version 1145808 (0.0008) [2023-12-28 03:29:37,069][106225] Updated weights for policy 1, policy_version 1148845 (0.0008) [2023-12-28 03:29:37,121][106225] Updated weights for policy 1, policy_version 1148855 (0.0010) [2023-12-28 03:29:37,178][106225] Updated weights for policy 1, policy_version 1148865 (0.0010) [2023-12-28 03:29:37,666][106226] Updated weights for policy 0, policy_version 1145818 (0.0006) [2023-12-28 03:29:37,737][106226] Updated weights for policy 0, policy_version 1145828 (0.0007) [2023-12-28 03:29:37,797][106226] Updated weights for policy 0, policy_version 1145838 (0.0008) [2023-12-28 03:29:37,827][106225] Updated weights for policy 1, policy_version 1148875 (0.0009) [2023-12-28 03:29:37,856][106226] Updated weights for policy 0, policy_version 1145848 (0.0007) [2023-12-28 03:29:37,877][106225] Updated weights for policy 1, policy_version 1148885 (0.0007) [2023-12-28 03:29:37,927][106225] Updated weights for policy 1, policy_version 1148895 (0.0009) [2023-12-28 03:29:38,532][106226] Updated weights for policy 0, policy_version 1145858 (0.0008) [2023-12-28 03:29:38,587][106226] Updated weights for policy 0, policy_version 1145868 (0.0008) [2023-12-28 03:29:38,639][106226] Updated weights for policy 0, policy_version 1145878 (0.0008) [2023-12-28 03:29:38,664][106225] Updated weights for policy 1, policy_version 1148905 (0.0008) [2023-12-28 03:29:38,728][106225] Updated weights for policy 1, policy_version 1148915 (0.0010) [2023-12-28 03:29:38,793][106225] Updated weights for policy 1, policy_version 1148925 (0.0010) [2023-12-28 03:29:38,850][106225] Updated weights for policy 1, policy_version 1148935 (0.0010) [2023-12-28 03:29:39,312][106226] Updated weights for policy 0, policy_version 1145888 (0.0010) [2023-12-28 03:29:39,384][106226] Updated weights for policy 0, policy_version 1145898 (0.0008) [2023-12-28 03:29:39,450][106226] Updated weights for policy 0, policy_version 1145908 (0.0008) [2023-12-28 03:29:39,610][106225] Updated weights for policy 1, policy_version 1148945 (0.0006) [2023-12-28 03:29:39,672][106225] Updated weights for policy 1, policy_version 1148955 (0.0008) [2023-12-28 03:29:39,733][106225] Updated weights for policy 1, policy_version 1148965 (0.0008) [2023-12-28 03:29:40,268][106226] Updated weights for policy 0, policy_version 1145918 (0.0008) [2023-12-28 03:29:40,333][106226] Updated weights for policy 0, policy_version 1145928 (0.0008) [2023-12-28 03:29:40,396][106225] Updated weights for policy 1, policy_version 1148975 (0.0006) [2023-12-28 03:29:40,405][106226] Updated weights for policy 0, policy_version 1145938 (0.0009) [2023-12-28 03:29:40,455][106225] Updated weights for policy 1, policy_version 1148985 (0.0006) [2023-12-28 03:29:40,514][106225] Updated weights for policy 1, policy_version 1148995 (0.0008) [2023-12-28 03:29:41,147][106226] Updated weights for policy 0, policy_version 1145948 (0.0007) [2023-12-28 03:29:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 587612160. Throughput: 0: 9732.2, 1: 9906.7. Samples: 587588652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:41,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-4.450')] [2023-12-28 03:29:41,218][106225] Updated weights for policy 1, policy_version 1149005 (0.0009) [2023-12-28 03:29:41,221][106226] Updated weights for policy 0, policy_version 1145958 (0.0008) [2023-12-28 03:29:41,285][106225] Updated weights for policy 1, policy_version 1149015 (0.0012) [2023-12-28 03:29:41,292][106226] Updated weights for policy 0, policy_version 1145968 (0.0008) [2023-12-28 03:29:41,344][106225] Updated weights for policy 1, policy_version 1149025 (0.0009) [2023-12-28 03:29:41,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001145976_293429248.pth... [2023-12-28 03:29:41,350][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001144824_293134336.pth [2023-12-28 03:29:41,400][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001149032_294199296.pth... [2023-12-28 03:29:41,405][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001147848_293896192.pth [2023-12-28 03:29:42,045][106226] Updated weights for policy 0, policy_version 1145978 (0.0008) [2023-12-28 03:29:42,098][106226] Updated weights for policy 0, policy_version 1145988 (0.0008) [2023-12-28 03:29:42,163][106226] Updated weights for policy 0, policy_version 1145998 (0.0007) [2023-12-28 03:29:42,164][106225] Updated weights for policy 1, policy_version 1149035 (0.0009) [2023-12-28 03:29:42,226][106225] Updated weights for policy 1, policy_version 1149045 (0.0010) [2023-12-28 03:29:42,228][106226] Updated weights for policy 0, policy_version 1146008 (0.0006) [2023-12-28 03:29:42,291][106225] Updated weights for policy 1, policy_version 1149055 (0.0009) [2023-12-28 03:29:42,941][106226] Updated weights for policy 0, policy_version 1146018 (0.0008) [2023-12-28 03:29:42,995][106226] Updated weights for policy 0, policy_version 1146028 (0.0008) [2023-12-28 03:29:43,037][106225] Updated weights for policy 1, policy_version 1149065 (0.0010) [2023-12-28 03:29:43,060][106226] Updated weights for policy 0, policy_version 1146038 (0.0008) [2023-12-28 03:29:43,094][106225] Updated weights for policy 1, policy_version 1149075 (0.0008) [2023-12-28 03:29:43,142][106225] Updated weights for policy 1, policy_version 1149085 (0.0008) [2023-12-28 03:29:43,210][106225] Updated weights for policy 1, policy_version 1149095 (0.0007) [2023-12-28 03:29:43,714][106226] Updated weights for policy 0, policy_version 1146048 (0.0005) [2023-12-28 03:29:43,784][106226] Updated weights for policy 0, policy_version 1146058 (0.0005) [2023-12-28 03:29:43,842][106226] Updated weights for policy 0, policy_version 1146068 (0.0007) [2023-12-28 03:29:43,978][106225] Updated weights for policy 1, policy_version 1149105 (0.0009) [2023-12-28 03:29:44,031][106225] Updated weights for policy 1, policy_version 1149115 (0.0007) [2023-12-28 03:29:44,085][106225] Updated weights for policy 1, policy_version 1149125 (0.0008) [2023-12-28 03:29:44,481][106226] Updated weights for policy 0, policy_version 1146078 (0.0009) [2023-12-28 03:29:44,546][106226] Updated weights for policy 0, policy_version 1146088 (0.0005) [2023-12-28 03:29:44,618][106226] Updated weights for policy 0, policy_version 1146098 (0.0009) [2023-12-28 03:29:44,829][106225] Updated weights for policy 1, policy_version 1149135 (0.0010) [2023-12-28 03:29:44,881][106225] Updated weights for policy 1, policy_version 1149145 (0.0010) [2023-12-28 03:29:44,934][106225] Updated weights for policy 1, policy_version 1149155 (0.0010) [2023-12-28 03:29:45,351][106226] Updated weights for policy 0, policy_version 1146108 (0.0010) [2023-12-28 03:29:45,412][106226] Updated weights for policy 0, policy_version 1146118 (0.0007) [2023-12-28 03:29:45,474][106226] Updated weights for policy 0, policy_version 1146128 (0.0008) [2023-12-28 03:29:45,707][106225] Updated weights for policy 1, policy_version 1149165 (0.0009) [2023-12-28 03:29:45,770][106225] Updated weights for policy 1, policy_version 1149175 (0.0008) [2023-12-28 03:29:45,836][106225] Updated weights for policy 1, policy_version 1149185 (0.0005) [2023-12-28 03:29:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 587710464. Throughput: 0: 9696.1, 1: 9824.2. Samples: 587701672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:46,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.867')] [2023-12-28 03:29:46,223][106226] Updated weights for policy 0, policy_version 1146138 (0.0008) [2023-12-28 03:29:46,283][106226] Updated weights for policy 0, policy_version 1146148 (0.0011) [2023-12-28 03:29:46,341][106226] Updated weights for policy 0, policy_version 1146158 (0.0011) [2023-12-28 03:29:46,396][106225] Updated weights for policy 1, policy_version 1149195 (0.0006) [2023-12-28 03:29:46,401][106226] Updated weights for policy 0, policy_version 1146168 (0.0009) [2023-12-28 03:29:46,458][106225] Updated weights for policy 1, policy_version 1149205 (0.0006) [2023-12-28 03:29:46,524][106225] Updated weights for policy 1, policy_version 1149215 (0.0005) [2023-12-28 03:29:47,088][106226] Updated weights for policy 0, policy_version 1146178 (0.0011) [2023-12-28 03:29:47,144][106226] Updated weights for policy 0, policy_version 1146188 (0.0010) [2023-12-28 03:29:47,197][106226] Updated weights for policy 0, policy_version 1146198 (0.0010) [2023-12-28 03:29:47,205][106225] Updated weights for policy 1, policy_version 1149225 (0.0010) [2023-12-28 03:29:47,251][106225] Updated weights for policy 1, policy_version 1149235 (0.0010) [2023-12-28 03:29:47,301][106225] Updated weights for policy 1, policy_version 1149245 (0.0010) [2023-12-28 03:29:47,353][106225] Updated weights for policy 1, policy_version 1149255 (0.0010) [2023-12-28 03:29:47,842][106226] Updated weights for policy 0, policy_version 1146208 (0.0006) [2023-12-28 03:29:47,889][106226] Updated weights for policy 0, policy_version 1146218 (0.0005) [2023-12-28 03:29:47,940][106226] Updated weights for policy 0, policy_version 1146228 (0.0005) [2023-12-28 03:29:48,092][106225] Updated weights for policy 1, policy_version 1149265 (0.0010) [2023-12-28 03:29:48,155][106225] Updated weights for policy 1, policy_version 1149275 (0.0010) [2023-12-28 03:29:48,216][106225] Updated weights for policy 1, policy_version 1149285 (0.0010) [2023-12-28 03:29:48,618][106226] Updated weights for policy 0, policy_version 1146238 (0.0006) [2023-12-28 03:29:48,675][106226] Updated weights for policy 0, policy_version 1146248 (0.0009) [2023-12-28 03:29:48,731][106226] Updated weights for policy 0, policy_version 1146258 (0.0009) [2023-12-28 03:29:48,819][106225] Updated weights for policy 1, policy_version 1149295 (0.0009) [2023-12-28 03:29:48,879][106225] Updated weights for policy 1, policy_version 1149305 (0.0010) [2023-12-28 03:29:48,940][106225] Updated weights for policy 1, policy_version 1149315 (0.0010) [2023-12-28 03:29:49,499][106226] Updated weights for policy 0, policy_version 1146268 (0.0009) [2023-12-28 03:29:49,560][106226] Updated weights for policy 0, policy_version 1146278 (0.0011) [2023-12-28 03:29:49,625][106226] Updated weights for policy 0, policy_version 1146288 (0.0010) [2023-12-28 03:29:49,653][106225] Updated weights for policy 1, policy_version 1149325 (0.0010) [2023-12-28 03:29:49,706][106225] Updated weights for policy 1, policy_version 1149335 (0.0007) [2023-12-28 03:29:49,765][106225] Updated weights for policy 1, policy_version 1149345 (0.0008) [2023-12-28 03:29:50,342][106226] Updated weights for policy 0, policy_version 1146298 (0.0009) [2023-12-28 03:29:50,399][106226] Updated weights for policy 0, policy_version 1146308 (0.0011) [2023-12-28 03:29:50,457][106226] Updated weights for policy 0, policy_version 1146318 (0.0010) [2023-12-28 03:29:50,500][106225] Updated weights for policy 1, policy_version 1149355 (0.0007) [2023-12-28 03:29:50,513][106226] Updated weights for policy 0, policy_version 1146328 (0.0010) [2023-12-28 03:29:50,549][106225] Updated weights for policy 1, policy_version 1149365 (0.0005) [2023-12-28 03:29:50,613][106225] Updated weights for policy 1, policy_version 1149375 (0.0008) [2023-12-28 03:29:51,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 587808768. Throughput: 0: 9641.7, 1: 9843.7. Samples: 587820916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:51,176][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.812')] [2023-12-28 03:29:51,260][106226] Updated weights for policy 0, policy_version 1146338 (0.0008) [2023-12-28 03:29:51,295][106225] Updated weights for policy 1, policy_version 1149385 (0.0008) [2023-12-28 03:29:51,321][106226] Updated weights for policy 0, policy_version 1146348 (0.0006) [2023-12-28 03:29:51,357][106225] Updated weights for policy 1, policy_version 1149395 (0.0008) [2023-12-28 03:29:51,388][106226] Updated weights for policy 0, policy_version 1146358 (0.0008) [2023-12-28 03:29:51,420][106225] Updated weights for policy 1, policy_version 1149405 (0.0009) [2023-12-28 03:29:51,482][106225] Updated weights for policy 1, policy_version 1149415 (0.0008) [2023-12-28 03:29:52,151][106226] Updated weights for policy 0, policy_version 1146368 (0.0010) [2023-12-28 03:29:52,211][106226] Updated weights for policy 0, policy_version 1146378 (0.0010) [2023-12-28 03:29:52,259][106225] Updated weights for policy 1, policy_version 1149425 (0.0007) [2023-12-28 03:29:52,277][106226] Updated weights for policy 0, policy_version 1146388 (0.0009) [2023-12-28 03:29:52,323][106225] Updated weights for policy 1, policy_version 1149435 (0.0008) [2023-12-28 03:29:52,396][106225] Updated weights for policy 1, policy_version 1149445 (0.0009) [2023-12-28 03:29:52,997][106226] Updated weights for policy 0, policy_version 1146398 (0.0010) [2023-12-28 03:29:53,052][106226] Updated weights for policy 0, policy_version 1146408 (0.0010) [2023-12-28 03:29:53,111][106226] Updated weights for policy 0, policy_version 1146418 (0.0008) [2023-12-28 03:29:53,137][106225] Updated weights for policy 1, policy_version 1149455 (0.0006) [2023-12-28 03:29:53,187][106225] Updated weights for policy 1, policy_version 1149465 (0.0008) [2023-12-28 03:29:53,240][106225] Updated weights for policy 1, policy_version 1149475 (0.0010) [2023-12-28 03:29:53,681][106226] Updated weights for policy 0, policy_version 1146428 (0.0008) [2023-12-28 03:29:53,737][106226] Updated weights for policy 0, policy_version 1146438 (0.0008) [2023-12-28 03:29:53,801][106226] Updated weights for policy 0, policy_version 1146448 (0.0009) [2023-12-28 03:29:53,858][106225] Updated weights for policy 1, policy_version 1149485 (0.0008) [2023-12-28 03:29:53,926][106225] Updated weights for policy 1, policy_version 1149495 (0.0006) [2023-12-28 03:29:53,991][106225] Updated weights for policy 1, policy_version 1149505 (0.0005) [2023-12-28 03:29:54,446][106226] Updated weights for policy 0, policy_version 1146458 (0.0009) [2023-12-28 03:29:54,505][106226] Updated weights for policy 0, policy_version 1146468 (0.0008) [2023-12-28 03:29:54,556][106226] Updated weights for policy 0, policy_version 1146478 (0.0008) [2023-12-28 03:29:54,608][106226] Updated weights for policy 0, policy_version 1146488 (0.0008) [2023-12-28 03:29:54,614][106225] Updated weights for policy 1, policy_version 1149515 (0.0006) [2023-12-28 03:29:54,677][106225] Updated weights for policy 1, policy_version 1149525 (0.0009) [2023-12-28 03:29:54,725][106225] Updated weights for policy 1, policy_version 1149535 (0.0008) [2023-12-28 03:29:55,316][106226] Updated weights for policy 0, policy_version 1146498 (0.0009) [2023-12-28 03:29:55,366][106226] Updated weights for policy 0, policy_version 1146509 (0.0009) [2023-12-28 03:29:55,390][106225] Updated weights for policy 1, policy_version 1149545 (0.0008) [2023-12-28 03:29:55,416][106226] Updated weights for policy 0, policy_version 1146519 (0.0008) [2023-12-28 03:29:55,444][106225] Updated weights for policy 1, policy_version 1149555 (0.0005) [2023-12-28 03:29:55,499][106225] Updated weights for policy 1, policy_version 1149565 (0.0007) [2023-12-28 03:29:55,559][106225] Updated weights for policy 1, policy_version 1149575 (0.0010) [2023-12-28 03:29:56,133][106226] Updated weights for policy 0, policy_version 1146529 (0.0011) [2023-12-28 03:29:56,172][106225] Updated weights for policy 1, policy_version 1149585 (0.0006) [2023-12-28 03:29:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 587907072. Throughput: 0: 9668.5, 1: 9814.8. Samples: 587880708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:29:56,176][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.850')] [2023-12-28 03:29:56,189][106226] Updated weights for policy 0, policy_version 1146539 (0.0010) [2023-12-28 03:29:56,231][106225] Updated weights for policy 1, policy_version 1149595 (0.0006) [2023-12-28 03:29:56,253][106226] Updated weights for policy 0, policy_version 1146549 (0.0011) [2023-12-28 03:29:56,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001146552_293576704.pth... [2023-12-28 03:29:56,275][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001145400_293281792.pth [2023-12-28 03:29:56,290][106225] Updated weights for policy 1, policy_version 1149605 (0.0005) [2023-12-28 03:29:56,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001149608_294346752.pth... [2023-12-28 03:29:56,312][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001148424_294043648.pth [2023-12-28 03:29:56,881][106226] Updated weights for policy 0, policy_version 1146559 (0.0007) [2023-12-28 03:29:56,932][106226] Updated weights for policy 0, policy_version 1146569 (0.0007) [2023-12-28 03:29:56,985][106225] Updated weights for policy 1, policy_version 1149615 (0.0005) [2023-12-28 03:29:56,994][106226] Updated weights for policy 0, policy_version 1146579 (0.0007) [2023-12-28 03:29:57,039][106225] Updated weights for policy 1, policy_version 1149625 (0.0008) [2023-12-28 03:29:57,083][106225] Updated weights for policy 1, policy_version 1149635 (0.0008) [2023-12-28 03:29:57,613][106226] Updated weights for policy 0, policy_version 1146589 (0.0007) [2023-12-28 03:29:57,671][106226] Updated weights for policy 0, policy_version 1146599 (0.0009) [2023-12-28 03:29:57,733][106226] Updated weights for policy 0, policy_version 1146609 (0.0009) [2023-12-28 03:29:57,857][106225] Updated weights for policy 1, policy_version 1149645 (0.0008) [2023-12-28 03:29:57,905][106225] Updated weights for policy 1, policy_version 1149655 (0.0008) [2023-12-28 03:29:57,963][106225] Updated weights for policy 1, policy_version 1149665 (0.0008) [2023-12-28 03:29:58,471][106226] Updated weights for policy 0, policy_version 1146619 (0.0009) [2023-12-28 03:29:58,539][106226] Updated weights for policy 0, policy_version 1146629 (0.0009) [2023-12-28 03:29:58,605][106226] Updated weights for policy 0, policy_version 1146639 (0.0008) [2023-12-28 03:29:58,728][106225] Updated weights for policy 1, policy_version 1149675 (0.0008) [2023-12-28 03:29:58,799][106225] Updated weights for policy 1, policy_version 1149685 (0.0009) [2023-12-28 03:29:58,864][106225] Updated weights for policy 1, policy_version 1149695 (0.0010) [2023-12-28 03:29:59,410][106226] Updated weights for policy 0, policy_version 1146649 (0.0008) [2023-12-28 03:29:59,457][106226] Updated weights for policy 0, policy_version 1146659 (0.0008) [2023-12-28 03:29:59,510][106226] Updated weights for policy 0, policy_version 1146669 (0.0005) [2023-12-28 03:29:59,562][106226] Updated weights for policy 0, policy_version 1146679 (0.0005) [2023-12-28 03:29:59,612][106225] Updated weights for policy 1, policy_version 1149705 (0.0009) [2023-12-28 03:29:59,665][106225] Updated weights for policy 1, policy_version 1149715 (0.0008) [2023-12-28 03:29:59,729][106225] Updated weights for policy 1, policy_version 1149725 (0.0008) [2023-12-28 03:29:59,789][106225] Updated weights for policy 1, policy_version 1149735 (0.0008) [2023-12-28 03:30:00,317][106226] Updated weights for policy 0, policy_version 1146689 (0.0006) [2023-12-28 03:30:00,368][106226] Updated weights for policy 0, policy_version 1146699 (0.0009) [2023-12-28 03:30:00,429][106226] Updated weights for policy 0, policy_version 1146709 (0.0008) [2023-12-28 03:30:00,437][106225] Updated weights for policy 1, policy_version 1149745 (0.0005) [2023-12-28 03:30:00,492][106225] Updated weights for policy 1, policy_version 1149755 (0.0005) [2023-12-28 03:30:00,552][106225] Updated weights for policy 1, policy_version 1149765 (0.0005) [2023-12-28 03:30:01,040][106226] Updated weights for policy 0, policy_version 1146719 (0.0007) [2023-12-28 03:30:01,103][106226] Updated weights for policy 0, policy_version 1146729 (0.0009) [2023-12-28 03:30:01,164][106226] Updated weights for policy 0, policy_version 1146739 (0.0009) [2023-12-28 03:30:01,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 588005376. Throughput: 0: 9756.3, 1: 9854.7. Samples: 587999060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:01,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.981')] [2023-12-28 03:30:01,231][106225] Updated weights for policy 1, policy_version 1149775 (0.0007) [2023-12-28 03:30:01,298][106225] Updated weights for policy 1, policy_version 1149785 (0.0010) [2023-12-28 03:30:01,364][106225] Updated weights for policy 1, policy_version 1149795 (0.0008) [2023-12-28 03:30:02,006][106226] Updated weights for policy 0, policy_version 1146749 (0.0008) [2023-12-28 03:30:02,067][106226] Updated weights for policy 0, policy_version 1146759 (0.0008) [2023-12-28 03:30:02,076][106225] Updated weights for policy 1, policy_version 1149805 (0.0008) [2023-12-28 03:30:02,124][106226] Updated weights for policy 0, policy_version 1146769 (0.0006) [2023-12-28 03:30:02,133][106225] Updated weights for policy 1, policy_version 1149815 (0.0007) [2023-12-28 03:30:02,186][106225] Updated weights for policy 1, policy_version 1149825 (0.0008) [2023-12-28 03:30:02,826][106225] Updated weights for policy 1, policy_version 1149835 (0.0008) [2023-12-28 03:30:02,890][106226] Updated weights for policy 0, policy_version 1146779 (0.0008) [2023-12-28 03:30:02,894][106225] Updated weights for policy 1, policy_version 1149845 (0.0008) [2023-12-28 03:30:02,940][106226] Updated weights for policy 0, policy_version 1146789 (0.0009) [2023-12-28 03:30:02,951][106225] Updated weights for policy 1, policy_version 1149855 (0.0005) [2023-12-28 03:30:02,989][106226] Updated weights for policy 0, policy_version 1146799 (0.0008) [2023-12-28 03:30:03,556][106225] Updated weights for policy 1, policy_version 1149865 (0.0005) [2023-12-28 03:30:03,614][106225] Updated weights for policy 1, policy_version 1149875 (0.0007) [2023-12-28 03:30:03,677][106225] Updated weights for policy 1, policy_version 1149885 (0.0010) [2023-12-28 03:30:03,722][106225] Updated weights for policy 1, policy_version 1149895 (0.0010) [2023-12-28 03:30:03,735][106226] Updated weights for policy 0, policy_version 1146809 (0.0008) [2023-12-28 03:30:03,786][106226] Updated weights for policy 0, policy_version 1146819 (0.0010) [2023-12-28 03:30:03,867][106226] Updated weights for policy 0, policy_version 1146829 (0.0008) [2023-12-28 03:30:03,927][106226] Updated weights for policy 0, policy_version 1146839 (0.0008) [2023-12-28 03:30:04,360][106225] Updated weights for policy 1, policy_version 1149905 (0.0006) [2023-12-28 03:30:04,425][106225] Updated weights for policy 1, policy_version 1149915 (0.0008) [2023-12-28 03:30:04,489][106225] Updated weights for policy 1, policy_version 1149925 (0.0009) [2023-12-28 03:30:04,592][106226] Updated weights for policy 0, policy_version 1146849 (0.0010) [2023-12-28 03:30:04,653][106226] Updated weights for policy 0, policy_version 1146859 (0.0010) [2023-12-28 03:30:04,717][106226] Updated weights for policy 0, policy_version 1146869 (0.0011) [2023-12-28 03:30:05,090][106225] Updated weights for policy 1, policy_version 1149935 (0.0008) [2023-12-28 03:30:05,145][106225] Updated weights for policy 1, policy_version 1149945 (0.0007) [2023-12-28 03:30:05,191][106225] Updated weights for policy 1, policy_version 1149955 (0.0005) [2023-12-28 03:30:05,428][106226] Updated weights for policy 0, policy_version 1146879 (0.0010) [2023-12-28 03:30:05,485][106226] Updated weights for policy 0, policy_version 1146889 (0.0011) [2023-12-28 03:30:05,544][106226] Updated weights for policy 0, policy_version 1146899 (0.0010) [2023-12-28 03:30:05,809][106225] Updated weights for policy 1, policy_version 1149965 (0.0006) [2023-12-28 03:30:05,856][106225] Updated weights for policy 1, policy_version 1149975 (0.0010) [2023-12-28 03:30:05,914][106225] Updated weights for policy 1, policy_version 1149986 (0.0010) [2023-12-28 03:30:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 588111872. Throughput: 0: 9779.6, 1: 9947.1. Samples: 588120720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:06,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-5.013')] [2023-12-28 03:30:06,216][106226] Updated weights for policy 0, policy_version 1146909 (0.0011) [2023-12-28 03:30:06,287][106226] Updated weights for policy 0, policy_version 1146919 (0.0008) [2023-12-28 03:30:06,351][106226] Updated weights for policy 0, policy_version 1146929 (0.0010) [2023-12-28 03:30:06,631][106225] Updated weights for policy 1, policy_version 1149996 (0.0008) [2023-12-28 03:30:06,685][106225] Updated weights for policy 1, policy_version 1150006 (0.0010) [2023-12-28 03:30:06,747][106225] Updated weights for policy 1, policy_version 1150016 (0.0011) [2023-12-28 03:30:07,031][106226] Updated weights for policy 0, policy_version 1146939 (0.0008) [2023-12-28 03:30:07,088][106226] Updated weights for policy 0, policy_version 1146949 (0.0010) [2023-12-28 03:30:07,145][106226] Updated weights for policy 0, policy_version 1146959 (0.0010) [2023-12-28 03:30:07,433][106225] Updated weights for policy 1, policy_version 1150026 (0.0010) [2023-12-28 03:30:07,497][106225] Updated weights for policy 1, policy_version 1150036 (0.0010) [2023-12-28 03:30:07,559][106225] Updated weights for policy 1, policy_version 1150046 (0.0010) [2023-12-28 03:30:07,624][106225] Updated weights for policy 1, policy_version 1150056 (0.0007) [2023-12-28 03:30:07,869][106226] Updated weights for policy 0, policy_version 1146969 (0.0010) [2023-12-28 03:30:07,929][106226] Updated weights for policy 0, policy_version 1146979 (0.0010) [2023-12-28 03:30:07,990][106226] Updated weights for policy 0, policy_version 1146989 (0.0010) [2023-12-28 03:30:08,057][106226] Updated weights for policy 0, policy_version 1146999 (0.0011) [2023-12-28 03:30:08,175][106225] Updated weights for policy 1, policy_version 1150066 (0.0005) [2023-12-28 03:30:08,234][106225] Updated weights for policy 1, policy_version 1150076 (0.0005) [2023-12-28 03:30:08,290][106225] Updated weights for policy 1, policy_version 1150086 (0.0005) [2023-12-28 03:30:08,726][106226] Updated weights for policy 0, policy_version 1147009 (0.0010) [2023-12-28 03:30:08,770][106226] Updated weights for policy 0, policy_version 1147019 (0.0010) [2023-12-28 03:30:08,828][106226] Updated weights for policy 0, policy_version 1147029 (0.0011) [2023-12-28 03:30:08,908][106225] Updated weights for policy 1, policy_version 1150096 (0.0007) [2023-12-28 03:30:08,968][106225] Updated weights for policy 1, policy_version 1150106 (0.0010) [2023-12-28 03:30:09,031][106225] Updated weights for policy 1, policy_version 1150116 (0.0010) [2023-12-28 03:30:09,583][106226] Updated weights for policy 0, policy_version 1147039 (0.0009) [2023-12-28 03:30:09,639][106226] Updated weights for policy 0, policy_version 1147049 (0.0009) [2023-12-28 03:30:09,694][106226] Updated weights for policy 0, policy_version 1147059 (0.0009) [2023-12-28 03:30:09,812][106225] Updated weights for policy 1, policy_version 1150126 (0.0010) [2023-12-28 03:30:09,886][106225] Updated weights for policy 1, policy_version 1150136 (0.0008) [2023-12-28 03:30:09,957][106225] Updated weights for policy 1, policy_version 1150146 (0.0007) [2023-12-28 03:30:10,447][106226] Updated weights for policy 0, policy_version 1147069 (0.0009) [2023-12-28 03:30:10,501][106226] Updated weights for policy 0, policy_version 1147079 (0.0009) [2023-12-28 03:30:10,555][106226] Updated weights for policy 0, policy_version 1147089 (0.0009) [2023-12-28 03:30:10,626][106225] Updated weights for policy 1, policy_version 1150156 (0.0008) [2023-12-28 03:30:10,690][106225] Updated weights for policy 1, policy_version 1150166 (0.0006) [2023-12-28 03:30:10,756][106225] Updated weights for policy 1, policy_version 1150176 (0.0008) [2023-12-28 03:30:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 588210176. Throughput: 0: 9804.4, 1: 10009.7. Samples: 588182304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:11,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.896')] [2023-12-28 03:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001150184_294494208.pth... [2023-12-28 03:30:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001147096_293715968.pth... [2023-12-28 03:30:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001145976_293429248.pth [2023-12-28 03:30:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001149032_294199296.pth [2023-12-28 03:30:11,300][106226] Updated weights for policy 0, policy_version 1147099 (0.0009) [2023-12-28 03:30:11,355][106226] Updated weights for policy 0, policy_version 1147109 (0.0008) [2023-12-28 03:30:11,434][106226] Updated weights for policy 0, policy_version 1147119 (0.0007) [2023-12-28 03:30:11,503][106225] Updated weights for policy 1, policy_version 1150186 (0.0009) [2023-12-28 03:30:11,569][106225] Updated weights for policy 1, policy_version 1150196 (0.0010) [2023-12-28 03:30:11,637][106225] Updated weights for policy 1, policy_version 1150206 (0.0009) [2023-12-28 03:30:11,701][106225] Updated weights for policy 1, policy_version 1150216 (0.0010) [2023-12-28 03:30:12,184][106226] Updated weights for policy 0, policy_version 1147129 (0.0008) [2023-12-28 03:30:12,245][106226] Updated weights for policy 0, policy_version 1147139 (0.0009) [2023-12-28 03:30:12,306][106226] Updated weights for policy 0, policy_version 1147149 (0.0008) [2023-12-28 03:30:12,376][106226] Updated weights for policy 0, policy_version 1147159 (0.0009) [2023-12-28 03:30:12,412][106225] Updated weights for policy 1, policy_version 1150226 (0.0008) [2023-12-28 03:30:12,471][106225] Updated weights for policy 1, policy_version 1150236 (0.0008) [2023-12-28 03:30:12,520][106225] Updated weights for policy 1, policy_version 1150246 (0.0009) [2023-12-28 03:30:13,113][106226] Updated weights for policy 0, policy_version 1147169 (0.0009) [2023-12-28 03:30:13,173][106226] Updated weights for policy 0, policy_version 1147179 (0.0009) [2023-12-28 03:30:13,230][106226] Updated weights for policy 0, policy_version 1147189 (0.0008) [2023-12-28 03:30:13,267][106225] Updated weights for policy 1, policy_version 1150256 (0.0008) [2023-12-28 03:30:13,323][106225] Updated weights for policy 1, policy_version 1150266 (0.0008) [2023-12-28 03:30:13,376][106225] Updated weights for policy 1, policy_version 1150276 (0.0008) [2023-12-28 03:30:13,943][106226] Updated weights for policy 0, policy_version 1147199 (0.0008) [2023-12-28 03:30:13,993][106226] Updated weights for policy 0, policy_version 1147209 (0.0008) [2023-12-28 03:30:14,049][106226] Updated weights for policy 0, policy_version 1147219 (0.0007) [2023-12-28 03:30:14,062][106225] Updated weights for policy 1, policy_version 1150286 (0.0009) [2023-12-28 03:30:14,129][106225] Updated weights for policy 1, policy_version 1150296 (0.0008) [2023-12-28 03:30:14,198][106225] Updated weights for policy 1, policy_version 1150306 (0.0008) [2023-12-28 03:30:14,819][106226] Updated weights for policy 0, policy_version 1147229 (0.0006) [2023-12-28 03:30:14,887][106226] Updated weights for policy 0, policy_version 1147239 (0.0009) [2023-12-28 03:30:14,889][106225] Updated weights for policy 1, policy_version 1150316 (0.0008) [2023-12-28 03:30:14,951][106225] Updated weights for policy 1, policy_version 1150326 (0.0007) [2023-12-28 03:30:14,952][106226] Updated weights for policy 0, policy_version 1147249 (0.0007) [2023-12-28 03:30:15,017][106225] Updated weights for policy 1, policy_version 1150336 (0.0007) [2023-12-28 03:30:15,576][106226] Updated weights for policy 0, policy_version 1147259 (0.0008) [2023-12-28 03:30:15,624][106226] Updated weights for policy 0, policy_version 1147269 (0.0009) [2023-12-28 03:30:15,674][106226] Updated weights for policy 0, policy_version 1147279 (0.0008) [2023-12-28 03:30:15,739][106225] Updated weights for policy 1, policy_version 1150346 (0.0007) [2023-12-28 03:30:15,799][106225] Updated weights for policy 1, policy_version 1150356 (0.0008) [2023-12-28 03:30:15,861][106225] Updated weights for policy 1, policy_version 1150366 (0.0009) [2023-12-28 03:30:15,916][106225] Updated weights for policy 1, policy_version 1150376 (0.0006) [2023-12-28 03:30:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 588308480. Throughput: 0: 9696.6, 1: 9948.6. Samples: 588296108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:16,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.563')] [2023-12-28 03:30:16,465][106226] Updated weights for policy 0, policy_version 1147289 (0.0008) [2023-12-28 03:30:16,524][106226] Updated weights for policy 0, policy_version 1147299 (0.0009) [2023-12-28 03:30:16,563][106225] Updated weights for policy 1, policy_version 1150386 (0.0006) [2023-12-28 03:30:16,583][106226] Updated weights for policy 0, policy_version 1147309 (0.0007) [2023-12-28 03:30:16,621][106225] Updated weights for policy 1, policy_version 1150396 (0.0006) [2023-12-28 03:30:16,646][106226] Updated weights for policy 0, policy_version 1147319 (0.0008) [2023-12-28 03:30:16,677][106225] Updated weights for policy 1, policy_version 1150406 (0.0005) [2023-12-28 03:30:17,366][106225] Updated weights for policy 1, policy_version 1150416 (0.0005) [2023-12-28 03:30:17,381][106226] Updated weights for policy 0, policy_version 1147329 (0.0009) [2023-12-28 03:30:17,433][106225] Updated weights for policy 1, policy_version 1150426 (0.0007) [2023-12-28 03:30:17,443][106226] Updated weights for policy 0, policy_version 1147339 (0.0007) [2023-12-28 03:30:17,487][106225] Updated weights for policy 1, policy_version 1150436 (0.0009) [2023-12-28 03:30:17,507][106226] Updated weights for policy 0, policy_version 1147349 (0.0005) [2023-12-28 03:30:18,176][106225] Updated weights for policy 1, policy_version 1150446 (0.0007) [2023-12-28 03:30:18,218][106226] Updated weights for policy 0, policy_version 1147359 (0.0007) [2023-12-28 03:30:18,239][106225] Updated weights for policy 1, policy_version 1150456 (0.0007) [2023-12-28 03:30:18,280][106226] Updated weights for policy 0, policy_version 1147369 (0.0007) [2023-12-28 03:30:18,295][106225] Updated weights for policy 1, policy_version 1150466 (0.0005) [2023-12-28 03:30:18,346][106226] Updated weights for policy 0, policy_version 1147379 (0.0008) [2023-12-28 03:30:18,918][106225] Updated weights for policy 1, policy_version 1150476 (0.0007) [2023-12-28 03:30:18,978][106225] Updated weights for policy 1, policy_version 1150486 (0.0009) [2023-12-28 03:30:19,026][106225] Updated weights for policy 1, policy_version 1150496 (0.0008) [2023-12-28 03:30:19,143][106226] Updated weights for policy 0, policy_version 1147389 (0.0008) [2023-12-28 03:30:19,202][106226] Updated weights for policy 0, policy_version 1147399 (0.0008) [2023-12-28 03:30:19,265][106226] Updated weights for policy 0, policy_version 1147409 (0.0008) [2023-12-28 03:30:19,813][106225] Updated weights for policy 1, policy_version 1150506 (0.0009) [2023-12-28 03:30:19,883][106225] Updated weights for policy 1, policy_version 1150516 (0.0010) [2023-12-28 03:30:19,955][106225] Updated weights for policy 1, policy_version 1150526 (0.0007) [2023-12-28 03:30:19,970][106226] Updated weights for policy 0, policy_version 1147419 (0.0007) [2023-12-28 03:30:20,019][106225] Updated weights for policy 1, policy_version 1150536 (0.0007) [2023-12-28 03:30:20,030][106226] Updated weights for policy 0, policy_version 1147429 (0.0008) [2023-12-28 03:30:20,085][106226] Updated weights for policy 0, policy_version 1147439 (0.0006) [2023-12-28 03:30:20,781][106225] Updated weights for policy 1, policy_version 1150546 (0.0009) [2023-12-28 03:30:20,815][106226] Updated weights for policy 0, policy_version 1147449 (0.0006) [2023-12-28 03:30:20,842][106225] Updated weights for policy 1, policy_version 1150556 (0.0009) [2023-12-28 03:30:20,883][106226] Updated weights for policy 0, policy_version 1147459 (0.0006) [2023-12-28 03:30:20,900][106225] Updated weights for policy 1, policy_version 1150566 (0.0008) [2023-12-28 03:30:20,953][106226] Updated weights for policy 0, policy_version 1147469 (0.0006) [2023-12-28 03:30:21,018][106226] Updated weights for policy 0, policy_version 1147479 (0.0007) [2023-12-28 03:30:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 588406784. Throughput: 0: 9700.8, 1: 9943.5. Samples: 588411872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:21,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-5.015')] [2023-12-28 03:30:21,724][106225] Updated weights for policy 1, policy_version 1150576 (0.0009) [2023-12-28 03:30:21,799][106225] Updated weights for policy 1, policy_version 1150586 (0.0008) [2023-12-28 03:30:21,816][106226] Updated weights for policy 0, policy_version 1147489 (0.0009) [2023-12-28 03:30:21,858][106225] Updated weights for policy 1, policy_version 1150596 (0.0007) [2023-12-28 03:30:21,876][106226] Updated weights for policy 0, policy_version 1147499 (0.0007) [2023-12-28 03:30:21,942][106226] Updated weights for policy 0, policy_version 1147509 (0.0009) [2023-12-28 03:30:22,607][106225] Updated weights for policy 1, policy_version 1150606 (0.0008) [2023-12-28 03:30:22,653][106225] Updated weights for policy 1, policy_version 1150616 (0.0007) [2023-12-28 03:30:22,682][106226] Updated weights for policy 0, policy_version 1147519 (0.0010) [2023-12-28 03:30:22,699][106225] Updated weights for policy 1, policy_version 1150626 (0.0008) [2023-12-28 03:30:22,743][106226] Updated weights for policy 0, policy_version 1147529 (0.0011) [2023-12-28 03:30:22,799][106226] Updated weights for policy 0, policy_version 1147539 (0.0010) [2023-12-28 03:30:23,480][106226] Updated weights for policy 0, policy_version 1147549 (0.0010) [2023-12-28 03:30:23,510][106225] Updated weights for policy 1, policy_version 1150636 (0.0006) [2023-12-28 03:30:23,538][106226] Updated weights for policy 0, policy_version 1147559 (0.0010) [2023-12-28 03:30:23,571][106225] Updated weights for policy 1, policy_version 1150646 (0.0007) [2023-12-28 03:30:23,589][106226] Updated weights for policy 0, policy_version 1147569 (0.0011) [2023-12-28 03:30:23,624][106225] Updated weights for policy 1, policy_version 1150656 (0.0008) [2023-12-28 03:30:24,221][106226] Updated weights for policy 0, policy_version 1147579 (0.0011) [2023-12-28 03:30:24,242][106225] Updated weights for policy 1, policy_version 1150666 (0.0006) [2023-12-28 03:30:24,279][106226] Updated weights for policy 0, policy_version 1147589 (0.0010) [2023-12-28 03:30:24,309][106225] Updated weights for policy 1, policy_version 1150676 (0.0010) [2023-12-28 03:30:24,335][106226] Updated weights for policy 0, policy_version 1147599 (0.0009) [2023-12-28 03:30:24,369][106225] Updated weights for policy 1, policy_version 1150686 (0.0010) [2023-12-28 03:30:24,424][106225] Updated weights for policy 1, policy_version 1150696 (0.0010) [2023-12-28 03:30:25,030][106225] Updated weights for policy 1, policy_version 1150706 (0.0008) [2023-12-28 03:30:25,037][106226] Updated weights for policy 0, policy_version 1147609 (0.0011) [2023-12-28 03:30:25,086][106225] Updated weights for policy 1, policy_version 1150716 (0.0010) [2023-12-28 03:30:25,091][106226] Updated weights for policy 0, policy_version 1147619 (0.0011) [2023-12-28 03:30:25,147][106226] Updated weights for policy 0, policy_version 1147629 (0.0007) [2023-12-28 03:30:25,147][106225] Updated weights for policy 1, policy_version 1150726 (0.0010) [2023-12-28 03:30:25,200][106226] Updated weights for policy 0, policy_version 1147639 (0.0011) [2023-12-28 03:30:25,786][106226] Updated weights for policy 0, policy_version 1147649 (0.0007) [2023-12-28 03:30:25,834][106225] Updated weights for policy 1, policy_version 1150736 (0.0010) [2023-12-28 03:30:25,836][106226] Updated weights for policy 0, policy_version 1147659 (0.0006) [2023-12-28 03:30:25,891][106225] Updated weights for policy 1, policy_version 1150746 (0.0010) [2023-12-28 03:30:25,894][106226] Updated weights for policy 0, policy_version 1147669 (0.0007) [2023-12-28 03:30:25,948][106225] Updated weights for policy 1, policy_version 1150756 (0.0010) [2023-12-28 03:30:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 588505088. Throughput: 0: 9668.0, 1: 9863.7. Samples: 588467576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:26,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.923')] [2023-12-28 03:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001150760_294641664.pth... [2023-12-28 03:30:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001147672_293863424.pth... [2023-12-28 03:30:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001149608_294346752.pth [2023-12-28 03:30:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001146552_293576704.pth [2023-12-28 03:30:26,517][106225] Updated weights for policy 1, policy_version 1150766 (0.0007) [2023-12-28 03:30:26,553][106226] Updated weights for policy 0, policy_version 1147679 (0.0006) [2023-12-28 03:30:26,575][106225] Updated weights for policy 1, policy_version 1150776 (0.0006) [2023-12-28 03:30:26,614][106226] Updated weights for policy 0, policy_version 1147689 (0.0011) [2023-12-28 03:30:26,627][106225] Updated weights for policy 1, policy_version 1150786 (0.0006) [2023-12-28 03:30:26,670][106226] Updated weights for policy 0, policy_version 1147699 (0.0010) [2023-12-28 03:30:27,179][106225] Updated weights for policy 1, policy_version 1150796 (0.0007) [2023-12-28 03:30:27,242][106225] Updated weights for policy 1, policy_version 1150806 (0.0009) [2023-12-28 03:30:27,301][106225] Updated weights for policy 1, policy_version 1150816 (0.0010) [2023-12-28 03:30:27,325][106226] Updated weights for policy 0, policy_version 1147709 (0.0008) [2023-12-28 03:30:27,377][106226] Updated weights for policy 0, policy_version 1147719 (0.0010) [2023-12-28 03:30:27,423][106226] Updated weights for policy 0, policy_version 1147729 (0.0010) [2023-12-28 03:30:27,999][106225] Updated weights for policy 1, policy_version 1150826 (0.0010) [2023-12-28 03:30:28,056][106225] Updated weights for policy 1, policy_version 1150836 (0.0010) [2023-12-28 03:30:28,104][106225] Updated weights for policy 1, policy_version 1150846 (0.0008) [2023-12-28 03:30:28,138][106226] Updated weights for policy 0, policy_version 1147739 (0.0010) [2023-12-28 03:30:28,159][106225] Updated weights for policy 1, policy_version 1150856 (0.0006) [2023-12-28 03:30:28,206][106226] Updated weights for policy 0, policy_version 1147749 (0.0010) [2023-12-28 03:30:28,271][106226] Updated weights for policy 0, policy_version 1147759 (0.0010) [2023-12-28 03:30:28,830][106225] Updated weights for policy 1, policy_version 1150866 (0.0011) [2023-12-28 03:30:28,894][106225] Updated weights for policy 1, policy_version 1150876 (0.0010) [2023-12-28 03:30:28,948][106225] Updated weights for policy 1, policy_version 1150886 (0.0009) [2023-12-28 03:30:28,960][106226] Updated weights for policy 0, policy_version 1147769 (0.0009) [2023-12-28 03:30:29,009][106226] Updated weights for policy 0, policy_version 1147779 (0.0006) [2023-12-28 03:30:29,059][106226] Updated weights for policy 0, policy_version 1147789 (0.0007) [2023-12-28 03:30:29,111][106226] Updated weights for policy 0, policy_version 1147799 (0.0008) [2023-12-28 03:30:29,718][106225] Updated weights for policy 1, policy_version 1150896 (0.0006) [2023-12-28 03:30:29,775][106225] Updated weights for policy 1, policy_version 1150906 (0.0005) [2023-12-28 03:30:29,807][106226] Updated weights for policy 0, policy_version 1147809 (0.0006) [2023-12-28 03:30:29,839][106225] Updated weights for policy 1, policy_version 1150916 (0.0007) [2023-12-28 03:30:29,867][106226] Updated weights for policy 0, policy_version 1147819 (0.0008) [2023-12-28 03:30:29,921][106226] Updated weights for policy 0, policy_version 1147829 (0.0008) [2023-12-28 03:30:30,548][106225] Updated weights for policy 1, policy_version 1150926 (0.0008) [2023-12-28 03:30:30,578][106226] Updated weights for policy 0, policy_version 1147839 (0.0006) [2023-12-28 03:30:30,607][106225] Updated weights for policy 1, policy_version 1150936 (0.0008) [2023-12-28 03:30:30,633][106226] Updated weights for policy 0, policy_version 1147849 (0.0005) [2023-12-28 03:30:30,660][106225] Updated weights for policy 1, policy_version 1150946 (0.0008) [2023-12-28 03:30:30,688][106226] Updated weights for policy 0, policy_version 1147859 (0.0005) [2023-12-28 03:30:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 588603392. Throughput: 0: 9776.1, 1: 10045.3. Samples: 588593632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:31,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.806')] [2023-12-28 03:30:31,316][106225] Updated weights for policy 1, policy_version 1150956 (0.0007) [2023-12-28 03:30:31,343][106226] Updated weights for policy 0, policy_version 1147869 (0.0006) [2023-12-28 03:30:31,382][106225] Updated weights for policy 1, policy_version 1150966 (0.0008) [2023-12-28 03:30:31,416][106226] Updated weights for policy 0, policy_version 1147879 (0.0008) [2023-12-28 03:30:31,444][106225] Updated weights for policy 1, policy_version 1150976 (0.0006) [2023-12-28 03:30:31,484][106226] Updated weights for policy 0, policy_version 1147889 (0.0008) [2023-12-28 03:30:32,094][106225] Updated weights for policy 1, policy_version 1150986 (0.0006) [2023-12-28 03:30:32,159][106225] Updated weights for policy 1, policy_version 1150996 (0.0007) [2023-12-28 03:30:32,179][106226] Updated weights for policy 0, policy_version 1147899 (0.0008) [2023-12-28 03:30:32,211][106225] Updated weights for policy 1, policy_version 1151006 (0.0007) [2023-12-28 03:30:32,244][106226] Updated weights for policy 0, policy_version 1147909 (0.0011) [2023-12-28 03:30:32,270][106225] Updated weights for policy 1, policy_version 1151016 (0.0008) [2023-12-28 03:30:32,307][106226] Updated weights for policy 0, policy_version 1147919 (0.0008) [2023-12-28 03:30:33,007][106225] Updated weights for policy 1, policy_version 1151026 (0.0008) [2023-12-28 03:30:33,019][106226] Updated weights for policy 0, policy_version 1147929 (0.0008) [2023-12-28 03:30:33,062][106225] Updated weights for policy 1, policy_version 1151036 (0.0007) [2023-12-28 03:30:33,076][106226] Updated weights for policy 0, policy_version 1147939 (0.0010) [2023-12-28 03:30:33,112][106225] Updated weights for policy 1, policy_version 1151046 (0.0006) [2023-12-28 03:30:33,136][106226] Updated weights for policy 0, policy_version 1147949 (0.0011) [2023-12-28 03:30:33,195][106226] Updated weights for policy 0, policy_version 1147959 (0.0010) [2023-12-28 03:30:33,835][106225] Updated weights for policy 1, policy_version 1151056 (0.0009) [2023-12-28 03:30:33,886][106226] Updated weights for policy 0, policy_version 1147969 (0.0006) [2023-12-28 03:30:33,888][106225] Updated weights for policy 1, policy_version 1151066 (0.0010) [2023-12-28 03:30:33,937][106226] Updated weights for policy 0, policy_version 1147979 (0.0008) [2023-12-28 03:30:33,945][106225] Updated weights for policy 1, policy_version 1151076 (0.0009) [2023-12-28 03:30:33,992][106226] Updated weights for policy 0, policy_version 1147989 (0.0012) [2023-12-28 03:30:34,669][106225] Updated weights for policy 1, policy_version 1151086 (0.0009) [2023-12-28 03:30:34,731][106225] Updated weights for policy 1, policy_version 1151096 (0.0010) [2023-12-28 03:30:34,780][106226] Updated weights for policy 0, policy_version 1147999 (0.0007) [2023-12-28 03:30:34,786][106225] Updated weights for policy 1, policy_version 1151106 (0.0010) [2023-12-28 03:30:34,846][106226] Updated weights for policy 0, policy_version 1148009 (0.0006) [2023-12-28 03:30:34,898][106226] Updated weights for policy 0, policy_version 1148019 (0.0008) [2023-12-28 03:30:35,503][106225] Updated weights for policy 1, policy_version 1151116 (0.0010) [2023-12-28 03:30:35,549][106225] Updated weights for policy 1, policy_version 1151126 (0.0010) [2023-12-28 03:30:35,605][106225] Updated weights for policy 1, policy_version 1151136 (0.0010) [2023-12-28 03:30:35,634][106226] Updated weights for policy 0, policy_version 1148029 (0.0006) [2023-12-28 03:30:35,683][106226] Updated weights for policy 0, policy_version 1148039 (0.0008) [2023-12-28 03:30:35,734][106226] Updated weights for policy 0, policy_version 1148049 (0.0008) [2023-12-28 03:30:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 588701696. Throughput: 0: 9776.1, 1: 10000.2. Samples: 588710844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:36,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.905')] [2023-12-28 03:30:36,415][106225] Updated weights for policy 1, policy_version 1151146 (0.0010) [2023-12-28 03:30:36,445][106226] Updated weights for policy 0, policy_version 1148059 (0.0008) [2023-12-28 03:30:36,473][106225] Updated weights for policy 1, policy_version 1151156 (0.0008) [2023-12-28 03:30:36,514][106226] Updated weights for policy 0, policy_version 1148069 (0.0010) [2023-12-28 03:30:36,535][106225] Updated weights for policy 1, policy_version 1151166 (0.0008) [2023-12-28 03:30:36,583][106226] Updated weights for policy 0, policy_version 1148079 (0.0006) [2023-12-28 03:30:36,592][106225] Updated weights for policy 1, policy_version 1151176 (0.0006) [2023-12-28 03:30:37,153][106226] Updated weights for policy 0, policy_version 1148089 (0.0006) [2023-12-28 03:30:37,218][106226] Updated weights for policy 0, policy_version 1148099 (0.0006) [2023-12-28 03:30:37,220][106225] Updated weights for policy 1, policy_version 1151186 (0.0007) [2023-12-28 03:30:37,277][106225] Updated weights for policy 1, policy_version 1151196 (0.0006) [2023-12-28 03:30:37,279][106226] Updated weights for policy 0, policy_version 1148109 (0.0011) [2023-12-28 03:30:37,332][106225] Updated weights for policy 1, policy_version 1151206 (0.0006) [2023-12-28 03:30:37,346][106226] Updated weights for policy 0, policy_version 1148119 (0.0011) [2023-12-28 03:30:37,900][106225] Updated weights for policy 1, policy_version 1151216 (0.0008) [2023-12-28 03:30:37,936][106226] Updated weights for policy 0, policy_version 1148129 (0.0007) [2023-12-28 03:30:37,956][106225] Updated weights for policy 1, policy_version 1151226 (0.0006) [2023-12-28 03:30:37,995][106226] Updated weights for policy 0, policy_version 1148139 (0.0005) [2023-12-28 03:30:38,000][106225] Updated weights for policy 1, policy_version 1151236 (0.0007) [2023-12-28 03:30:38,058][106226] Updated weights for policy 0, policy_version 1148149 (0.0007) [2023-12-28 03:30:38,646][106225] Updated weights for policy 1, policy_version 1151246 (0.0008) [2023-12-28 03:30:38,701][106225] Updated weights for policy 1, policy_version 1151256 (0.0007) [2023-12-28 03:30:38,722][106226] Updated weights for policy 0, policy_version 1148159 (0.0008) [2023-12-28 03:30:38,756][106225] Updated weights for policy 1, policy_version 1151266 (0.0006) [2023-12-28 03:30:38,778][106226] Updated weights for policy 0, policy_version 1148169 (0.0008) [2023-12-28 03:30:38,834][106226] Updated weights for policy 0, policy_version 1148179 (0.0007) [2023-12-28 03:30:39,474][106225] Updated weights for policy 1, policy_version 1151276 (0.0007) [2023-12-28 03:30:39,541][106225] Updated weights for policy 1, policy_version 1151286 (0.0008) [2023-12-28 03:30:39,604][106225] Updated weights for policy 1, policy_version 1151296 (0.0008) [2023-12-28 03:30:39,619][106226] Updated weights for policy 0, policy_version 1148189 (0.0006) [2023-12-28 03:30:39,690][106226] Updated weights for policy 0, policy_version 1148199 (0.0006) [2023-12-28 03:30:39,748][106226] Updated weights for policy 0, policy_version 1148209 (0.0006) [2023-12-28 03:30:40,365][106225] Updated weights for policy 1, policy_version 1151306 (0.0008) [2023-12-28 03:30:40,426][106225] Updated weights for policy 1, policy_version 1151316 (0.0011) [2023-12-28 03:30:40,434][106226] Updated weights for policy 0, policy_version 1148219 (0.0006) [2023-12-28 03:30:40,495][106225] Updated weights for policy 1, policy_version 1151326 (0.0011) [2023-12-28 03:30:40,499][106226] Updated weights for policy 0, policy_version 1148229 (0.0006) [2023-12-28 03:30:40,556][106226] Updated weights for policy 0, policy_version 1148239 (0.0006) [2023-12-28 03:30:40,559][106225] Updated weights for policy 1, policy_version 1151336 (0.0010) [2023-12-28 03:30:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 588800000. Throughput: 0: 9816.9, 1: 10045.5. Samples: 588774508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:41,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-4.837')] [2023-12-28 03:30:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001151336_294789120.pth... [2023-12-28 03:30:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001148248_294010880.pth... [2023-12-28 03:30:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001147096_293715968.pth [2023-12-28 03:30:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001150184_294494208.pth [2023-12-28 03:30:41,278][106226] Updated weights for policy 0, policy_version 1148249 (0.0007) [2023-12-28 03:30:41,291][106225] Updated weights for policy 1, policy_version 1151346 (0.0008) [2023-12-28 03:30:41,344][106226] Updated weights for policy 0, policy_version 1148259 (0.0007) [2023-12-28 03:30:41,359][106225] Updated weights for policy 1, policy_version 1151356 (0.0007) [2023-12-28 03:30:41,422][106226] Updated weights for policy 0, policy_version 1148269 (0.0009) [2023-12-28 03:30:41,436][106225] Updated weights for policy 1, policy_version 1151366 (0.0008) [2023-12-28 03:30:41,484][106226] Updated weights for policy 0, policy_version 1148279 (0.0007) [2023-12-28 03:30:42,175][106226] Updated weights for policy 0, policy_version 1148289 (0.0008) [2023-12-28 03:30:42,199][106225] Updated weights for policy 1, policy_version 1151376 (0.0009) [2023-12-28 03:30:42,239][106226] Updated weights for policy 0, policy_version 1148299 (0.0008) [2023-12-28 03:30:42,254][106225] Updated weights for policy 1, policy_version 1151386 (0.0007) [2023-12-28 03:30:42,304][106226] Updated weights for policy 0, policy_version 1148309 (0.0009) [2023-12-28 03:30:42,322][106225] Updated weights for policy 1, policy_version 1151396 (0.0006) [2023-12-28 03:30:42,978][106225] Updated weights for policy 1, policy_version 1151406 (0.0009) [2023-12-28 03:30:43,036][106225] Updated weights for policy 1, policy_version 1151416 (0.0009) [2023-12-28 03:30:43,088][106226] Updated weights for policy 0, policy_version 1148319 (0.0006) [2023-12-28 03:30:43,098][106225] Updated weights for policy 1, policy_version 1151426 (0.0006) [2023-12-28 03:30:43,146][106226] Updated weights for policy 0, policy_version 1148329 (0.0008) [2023-12-28 03:30:43,198][106226] Updated weights for policy 0, policy_version 1148339 (0.0008) [2023-12-28 03:30:43,767][106225] Updated weights for policy 1, policy_version 1151436 (0.0007) [2023-12-28 03:30:43,835][106225] Updated weights for policy 1, policy_version 1151446 (0.0008) [2023-12-28 03:30:43,901][106225] Updated weights for policy 1, policy_version 1151456 (0.0009) [2023-12-28 03:30:43,956][106226] Updated weights for policy 0, policy_version 1148349 (0.0008) [2023-12-28 03:30:44,006][106226] Updated weights for policy 0, policy_version 1148359 (0.0008) [2023-12-28 03:30:44,065][106226] Updated weights for policy 0, policy_version 1148369 (0.0008) [2023-12-28 03:30:44,502][106225] Updated weights for policy 1, policy_version 1151466 (0.0010) [2023-12-28 03:30:44,559][106225] Updated weights for policy 1, policy_version 1151476 (0.0008) [2023-12-28 03:30:44,615][106225] Updated weights for policy 1, policy_version 1151486 (0.0008) [2023-12-28 03:30:44,673][106225] Updated weights for policy 1, policy_version 1151496 (0.0008) [2023-12-28 03:30:44,749][106226] Updated weights for policy 0, policy_version 1148379 (0.0008) [2023-12-28 03:30:44,814][106226] Updated weights for policy 0, policy_version 1148389 (0.0008) [2023-12-28 03:30:44,867][106226] Updated weights for policy 0, policy_version 1148399 (0.0009) [2023-12-28 03:30:45,407][106225] Updated weights for policy 1, policy_version 1151506 (0.0006) [2023-12-28 03:30:45,459][106225] Updated weights for policy 1, policy_version 1151516 (0.0007) [2023-12-28 03:30:45,515][106225] Updated weights for policy 1, policy_version 1151526 (0.0008) [2023-12-28 03:30:45,658][106226] Updated weights for policy 0, policy_version 1148409 (0.0008) [2023-12-28 03:30:45,722][106226] Updated weights for policy 0, policy_version 1148419 (0.0009) [2023-12-28 03:30:45,782][106226] Updated weights for policy 0, policy_version 1148429 (0.0008) [2023-12-28 03:30:45,847][106226] Updated weights for policy 0, policy_version 1148439 (0.0008) [2023-12-28 03:30:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 588898304. Throughput: 0: 9754.9, 1: 10034.8. Samples: 588889600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:46,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.793')] [2023-12-28 03:30:46,237][106225] Updated weights for policy 1, policy_version 1151536 (0.0009) [2023-12-28 03:30:46,292][106225] Updated weights for policy 1, policy_version 1151546 (0.0008) [2023-12-28 03:30:46,352][106225] Updated weights for policy 1, policy_version 1151556 (0.0009) [2023-12-28 03:30:46,513][106226] Updated weights for policy 0, policy_version 1148449 (0.0007) [2023-12-28 03:30:46,578][106226] Updated weights for policy 0, policy_version 1148459 (0.0005) [2023-12-28 03:30:46,631][106226] Updated weights for policy 0, policy_version 1148469 (0.0005) [2023-12-28 03:30:47,147][106226] Updated weights for policy 0, policy_version 1148479 (0.0005) [2023-12-28 03:30:47,166][106225] Updated weights for policy 1, policy_version 1151566 (0.0007) [2023-12-28 03:30:47,198][106226] Updated weights for policy 0, policy_version 1148489 (0.0008) [2023-12-28 03:30:47,217][106225] Updated weights for policy 1, policy_version 1151576 (0.0005) [2023-12-28 03:30:47,255][106226] Updated weights for policy 0, policy_version 1148499 (0.0007) [2023-12-28 03:30:47,272][106225] Updated weights for policy 1, policy_version 1151586 (0.0005) [2023-12-28 03:30:47,824][106225] Updated weights for policy 1, policy_version 1151596 (0.0005) [2023-12-28 03:30:47,884][106225] Updated weights for policy 1, policy_version 1151606 (0.0007) [2023-12-28 03:30:47,948][106225] Updated weights for policy 1, policy_version 1151616 (0.0005) [2023-12-28 03:30:48,059][106226] Updated weights for policy 0, policy_version 1148509 (0.0008) [2023-12-28 03:30:48,118][106226] Updated weights for policy 0, policy_version 1148519 (0.0009) [2023-12-28 03:30:48,172][106226] Updated weights for policy 0, policy_version 1148529 (0.0008) [2023-12-28 03:30:48,507][106225] Updated weights for policy 1, policy_version 1151626 (0.0008) [2023-12-28 03:30:48,572][106225] Updated weights for policy 1, policy_version 1151636 (0.0006) [2023-12-28 03:30:48,632][106225] Updated weights for policy 1, policy_version 1151646 (0.0009) [2023-12-28 03:30:48,696][106225] Updated weights for policy 1, policy_version 1151656 (0.0009) [2023-12-28 03:30:48,958][106226] Updated weights for policy 0, policy_version 1148539 (0.0009) [2023-12-28 03:30:49,023][106226] Updated weights for policy 0, policy_version 1148549 (0.0008) [2023-12-28 03:30:49,085][106226] Updated weights for policy 0, policy_version 1148559 (0.0009) [2023-12-28 03:30:49,404][106225] Updated weights for policy 1, policy_version 1151666 (0.0009) [2023-12-28 03:30:49,468][106225] Updated weights for policy 1, policy_version 1151676 (0.0006) [2023-12-28 03:30:49,533][106225] Updated weights for policy 1, policy_version 1151686 (0.0007) [2023-12-28 03:30:49,859][106226] Updated weights for policy 0, policy_version 1148569 (0.0008) [2023-12-28 03:30:49,922][106226] Updated weights for policy 0, policy_version 1148579 (0.0009) [2023-12-28 03:30:49,990][106226] Updated weights for policy 0, policy_version 1148589 (0.0007) [2023-12-28 03:30:50,055][106226] Updated weights for policy 0, policy_version 1148599 (0.0008) [2023-12-28 03:30:50,200][106225] Updated weights for policy 1, policy_version 1151696 (0.0006) [2023-12-28 03:30:50,261][106225] Updated weights for policy 1, policy_version 1151706 (0.0008) [2023-12-28 03:30:50,320][106225] Updated weights for policy 1, policy_version 1151716 (0.0008) [2023-12-28 03:30:50,778][106226] Updated weights for policy 0, policy_version 1148609 (0.0007) [2023-12-28 03:30:50,841][106226] Updated weights for policy 0, policy_version 1148619 (0.0011) [2023-12-28 03:30:50,896][106226] Updated weights for policy 0, policy_version 1148629 (0.0008) [2023-12-28 03:30:51,069][106225] Updated weights for policy 1, policy_version 1151726 (0.0007) [2023-12-28 03:30:51,133][106225] Updated weights for policy 1, policy_version 1151736 (0.0008) [2023-12-28 03:30:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 588996608. Throughput: 0: 9745.6, 1: 9974.3. Samples: 589008116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:51,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.925')] [2023-12-28 03:30:51,197][106225] Updated weights for policy 1, policy_version 1151746 (0.0008) [2023-12-28 03:30:51,598][106226] Updated weights for policy 0, policy_version 1148639 (0.0007) [2023-12-28 03:30:51,661][106226] Updated weights for policy 0, policy_version 1148649 (0.0008) [2023-12-28 03:30:51,719][106226] Updated weights for policy 0, policy_version 1148659 (0.0006) [2023-12-28 03:30:51,929][106225] Updated weights for policy 1, policy_version 1151756 (0.0009) [2023-12-28 03:30:51,995][106225] Updated weights for policy 1, policy_version 1151766 (0.0008) [2023-12-28 03:30:52,062][106225] Updated weights for policy 1, policy_version 1151776 (0.0008) [2023-12-28 03:30:52,470][106226] Updated weights for policy 0, policy_version 1148669 (0.0011) [2023-12-28 03:30:52,525][106226] Updated weights for policy 0, policy_version 1148679 (0.0008) [2023-12-28 03:30:52,581][106226] Updated weights for policy 0, policy_version 1148689 (0.0009) [2023-12-28 03:30:52,689][106225] Updated weights for policy 1, policy_version 1151786 (0.0008) [2023-12-28 03:30:52,748][106225] Updated weights for policy 1, policy_version 1151796 (0.0007) [2023-12-28 03:30:52,811][106225] Updated weights for policy 1, policy_version 1151806 (0.0010) [2023-12-28 03:30:52,894][106225] Updated weights for policy 1, policy_version 1151816 (0.0010) [2023-12-28 03:30:53,300][106226] Updated weights for policy 0, policy_version 1148699 (0.0009) [2023-12-28 03:30:53,361][106226] Updated weights for policy 0, policy_version 1148709 (0.0007) [2023-12-28 03:30:53,409][106226] Updated weights for policy 0, policy_version 1148719 (0.0008) [2023-12-28 03:30:53,551][106225] Updated weights for policy 1, policy_version 1151826 (0.0010) [2023-12-28 03:30:53,612][106225] Updated weights for policy 1, policy_version 1151836 (0.0010) [2023-12-28 03:30:53,671][106225] Updated weights for policy 1, policy_version 1151846 (0.0010) [2023-12-28 03:30:54,061][106226] Updated weights for policy 0, policy_version 1148729 (0.0008) [2023-12-28 03:30:54,122][106226] Updated weights for policy 0, policy_version 1148739 (0.0005) [2023-12-28 03:30:54,186][106226] Updated weights for policy 0, policy_version 1148749 (0.0006) [2023-12-28 03:30:54,249][106226] Updated weights for policy 0, policy_version 1148759 (0.0011) [2023-12-28 03:30:54,381][106225] Updated weights for policy 1, policy_version 1151856 (0.0009) [2023-12-28 03:30:54,432][106225] Updated weights for policy 1, policy_version 1151866 (0.0009) [2023-12-28 03:30:54,488][106225] Updated weights for policy 1, policy_version 1151876 (0.0008) [2023-12-28 03:30:54,878][106226] Updated weights for policy 0, policy_version 1148769 (0.0010) [2023-12-28 03:30:54,931][106226] Updated weights for policy 0, policy_version 1148779 (0.0010) [2023-12-28 03:30:54,985][106226] Updated weights for policy 0, policy_version 1148789 (0.0010) [2023-12-28 03:30:55,238][106225] Updated weights for policy 1, policy_version 1151886 (0.0008) [2023-12-28 03:30:55,299][106225] Updated weights for policy 1, policy_version 1151896 (0.0008) [2023-12-28 03:30:55,358][106225] Updated weights for policy 1, policy_version 1151906 (0.0008) [2023-12-28 03:30:55,623][106226] Updated weights for policy 0, policy_version 1148799 (0.0006) [2023-12-28 03:30:55,678][106226] Updated weights for policy 0, policy_version 1148809 (0.0005) [2023-12-28 03:30:55,733][106226] Updated weights for policy 0, policy_version 1148819 (0.0010) [2023-12-28 03:30:56,131][106225] Updated weights for policy 1, policy_version 1151916 (0.0009) [2023-12-28 03:30:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 589094912. Throughput: 0: 9745.7, 1: 9915.4. Samples: 589067052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:30:56,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.767')] [2023-12-28 03:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001148824_294158336.pth... [2023-12-28 03:30:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001147672_293863424.pth [2023-12-28 03:30:56,194][106225] Updated weights for policy 1, policy_version 1151926 (0.0007) [2023-12-28 03:30:56,261][106225] Updated weights for policy 1, policy_version 1151936 (0.0008) [2023-12-28 03:30:56,316][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001151944_294944768.pth... [2023-12-28 03:30:56,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001150760_294641664.pth [2023-12-28 03:30:56,403][106226] Updated weights for policy 0, policy_version 1148829 (0.0008) [2023-12-28 03:30:56,463][106226] Updated weights for policy 0, policy_version 1148839 (0.0005) [2023-12-28 03:30:56,513][106226] Updated weights for policy 0, policy_version 1148849 (0.0005) [2023-12-28 03:30:57,041][106225] Updated weights for policy 1, policy_version 1151946 (0.0010) [2023-12-28 03:30:57,046][106226] Updated weights for policy 0, policy_version 1148859 (0.0005) [2023-12-28 03:30:57,094][106225] Updated weights for policy 1, policy_version 1151956 (0.0007) [2023-12-28 03:30:57,099][106226] Updated weights for policy 0, policy_version 1148869 (0.0006) [2023-12-28 03:30:57,138][106225] Updated weights for policy 1, policy_version 1151966 (0.0008) [2023-12-28 03:30:57,150][106226] Updated weights for policy 0, policy_version 1148879 (0.0005) [2023-12-28 03:30:57,187][106225] Updated weights for policy 1, policy_version 1151976 (0.0008) [2023-12-28 03:30:57,783][106226] Updated weights for policy 0, policy_version 1148889 (0.0006) [2023-12-28 03:30:57,842][106226] Updated weights for policy 0, policy_version 1148899 (0.0009) [2023-12-28 03:30:57,896][106226] Updated weights for policy 0, policy_version 1148909 (0.0008) [2023-12-28 03:30:57,943][106226] Updated weights for policy 0, policy_version 1148919 (0.0006) [2023-12-28 03:30:57,967][106225] Updated weights for policy 1, policy_version 1151986 (0.0008) [2023-12-28 03:30:58,019][106225] Updated weights for policy 1, policy_version 1151996 (0.0009) [2023-12-28 03:30:58,072][106225] Updated weights for policy 1, policy_version 1152006 (0.0009) [2023-12-28 03:30:58,626][106226] Updated weights for policy 0, policy_version 1148929 (0.0008) [2023-12-28 03:30:58,692][106226] Updated weights for policy 0, policy_version 1148939 (0.0009) [2023-12-28 03:30:58,756][106226] Updated weights for policy 0, policy_version 1148949 (0.0008) [2023-12-28 03:30:58,914][106225] Updated weights for policy 1, policy_version 1152016 (0.0009) [2023-12-28 03:30:58,977][106225] Updated weights for policy 1, policy_version 1152026 (0.0010) [2023-12-28 03:30:59,036][106225] Updated weights for policy 1, policy_version 1152036 (0.0006) [2023-12-28 03:30:59,489][106226] Updated weights for policy 0, policy_version 1148959 (0.0008) [2023-12-28 03:30:59,552][106226] Updated weights for policy 0, policy_version 1148969 (0.0008) [2023-12-28 03:30:59,615][106226] Updated weights for policy 0, policy_version 1148979 (0.0008) [2023-12-28 03:30:59,793][106225] Updated weights for policy 1, policy_version 1152046 (0.0006) [2023-12-28 03:30:59,861][106225] Updated weights for policy 1, policy_version 1152056 (0.0006) [2023-12-28 03:30:59,922][106225] Updated weights for policy 1, policy_version 1152066 (0.0006) [2023-12-28 03:31:00,337][106226] Updated weights for policy 0, policy_version 1148989 (0.0007) [2023-12-28 03:31:00,392][106226] Updated weights for policy 0, policy_version 1148999 (0.0008) [2023-12-28 03:31:00,442][106226] Updated weights for policy 0, policy_version 1149009 (0.0008) [2023-12-28 03:31:00,624][106225] Updated weights for policy 1, policy_version 1152076 (0.0009) [2023-12-28 03:31:00,682][106225] Updated weights for policy 1, policy_version 1152086 (0.0010) [2023-12-28 03:31:00,743][106225] Updated weights for policy 1, policy_version 1152096 (0.0010) [2023-12-28 03:31:01,050][106226] Updated weights for policy 0, policy_version 1149019 (0.0008) [2023-12-28 03:31:01,105][106226] Updated weights for policy 0, policy_version 1149029 (0.0007) [2023-12-28 03:31:01,164][106226] Updated weights for policy 0, policy_version 1149039 (0.0007) [2023-12-28 03:31:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 589193216. Throughput: 0: 9902.9, 1: 9847.4. Samples: 589184876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:31:01,175][105115] Avg episode reward: [(0, '-4.195'), (1, '-4.872')] [2023-12-28 03:31:01,415][106225] Updated weights for policy 1, policy_version 1152106 (0.0009) [2023-12-28 03:31:01,471][106225] Updated weights for policy 1, policy_version 1152116 (0.0006) [2023-12-28 03:31:01,530][106225] Updated weights for policy 1, policy_version 1152126 (0.0005) [2023-12-28 03:31:01,592][106225] Updated weights for policy 1, policy_version 1152136 (0.0007) [2023-12-28 03:31:01,940][106226] Updated weights for policy 0, policy_version 1149049 (0.0006) [2023-12-28 03:31:01,994][106226] Updated weights for policy 0, policy_version 1149059 (0.0006) [2023-12-28 03:31:02,055][106226] Updated weights for policy 0, policy_version 1149069 (0.0007) [2023-12-28 03:31:02,109][106226] Updated weights for policy 0, policy_version 1149079 (0.0009) [2023-12-28 03:31:02,327][106225] Updated weights for policy 1, policy_version 1152146 (0.0009) [2023-12-28 03:31:02,394][106225] Updated weights for policy 1, policy_version 1152156 (0.0009) [2023-12-28 03:31:02,455][106225] Updated weights for policy 1, policy_version 1152166 (0.0006) [2023-12-28 03:31:02,792][106226] Updated weights for policy 0, policy_version 1149089 (0.0007) [2023-12-28 03:31:02,853][106226] Updated weights for policy 0, policy_version 1149099 (0.0008) [2023-12-28 03:31:02,913][106226] Updated weights for policy 0, policy_version 1149109 (0.0007) [2023-12-28 03:31:03,201][106225] Updated weights for policy 1, policy_version 1152176 (0.0010) [2023-12-28 03:31:03,265][106225] Updated weights for policy 1, policy_version 1152186 (0.0010) [2023-12-28 03:31:03,331][106225] Updated weights for policy 1, policy_version 1152196 (0.0006) [2023-12-28 03:31:03,565][106226] Updated weights for policy 0, policy_version 1149119 (0.0007) [2023-12-28 03:31:03,622][106226] Updated weights for policy 0, policy_version 1149129 (0.0008) [2023-12-28 03:31:03,685][106226] Updated weights for policy 0, policy_version 1149139 (0.0006) [2023-12-28 03:31:03,974][106225] Updated weights for policy 1, policy_version 1152206 (0.0007) [2023-12-28 03:31:04,039][106225] Updated weights for policy 1, policy_version 1152216 (0.0011) [2023-12-28 03:31:04,101][106225] Updated weights for policy 1, policy_version 1152226 (0.0011) [2023-12-28 03:31:04,369][106226] Updated weights for policy 0, policy_version 1149149 (0.0008) [2023-12-28 03:31:04,433][106226] Updated weights for policy 0, policy_version 1149159 (0.0007) [2023-12-28 03:31:04,499][106226] Updated weights for policy 0, policy_version 1149169 (0.0006) [2023-12-28 03:31:04,860][106225] Updated weights for policy 1, policy_version 1152236 (0.0010) [2023-12-28 03:31:04,918][106225] Updated weights for policy 1, policy_version 1152246 (0.0010) [2023-12-28 03:31:04,974][106225] Updated weights for policy 1, policy_version 1152256 (0.0010) [2023-12-28 03:31:05,077][106226] Updated weights for policy 0, policy_version 1149179 (0.0006) [2023-12-28 03:31:05,141][106226] Updated weights for policy 0, policy_version 1149189 (0.0005) [2023-12-28 03:31:05,205][106226] Updated weights for policy 0, policy_version 1149199 (0.0008) [2023-12-28 03:31:05,653][106225] Updated weights for policy 1, policy_version 1152266 (0.0010) [2023-12-28 03:31:05,717][106225] Updated weights for policy 1, policy_version 1152276 (0.0009) [2023-12-28 03:31:05,775][106225] Updated weights for policy 1, policy_version 1152286 (0.0010) [2023-12-28 03:31:05,794][106226] Updated weights for policy 0, policy_version 1149209 (0.0011) [2023-12-28 03:31:05,834][106225] Updated weights for policy 1, policy_version 1152296 (0.0008) [2023-12-28 03:31:05,848][106226] Updated weights for policy 0, policy_version 1149219 (0.0007) [2023-12-28 03:31:05,911][106226] Updated weights for policy 0, policy_version 1149229 (0.0007) [2023-12-28 03:31:05,973][106226] Updated weights for policy 0, policy_version 1149239 (0.0007) [2023-12-28 03:31:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 589299712. Throughput: 0: 10031.5, 1: 9844.9. Samples: 589306312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:31:06,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.022')] [2023-12-28 03:31:06,619][106225] Updated weights for policy 1, policy_version 1152306 (0.0008) [2023-12-28 03:31:06,685][106225] Updated weights for policy 1, policy_version 1152316 (0.0009) [2023-12-28 03:31:06,713][106226] Updated weights for policy 0, policy_version 1149249 (0.0008) [2023-12-28 03:31:06,751][106225] Updated weights for policy 1, policy_version 1152326 (0.0006) [2023-12-28 03:31:06,774][106226] Updated weights for policy 0, policy_version 1149259 (0.0008) [2023-12-28 03:31:06,839][106226] Updated weights for policy 0, policy_version 1149269 (0.0008) [2023-12-28 03:31:07,489][106225] Updated weights for policy 1, policy_version 1152336 (0.0007) [2023-12-28 03:31:07,544][106225] Updated weights for policy 1, policy_version 1152346 (0.0007) [2023-12-28 03:31:07,557][106226] Updated weights for policy 0, policy_version 1149279 (0.0007) [2023-12-28 03:31:07,597][106225] Updated weights for policy 1, policy_version 1152356 (0.0009) [2023-12-28 03:31:07,619][106226] Updated weights for policy 0, policy_version 1149289 (0.0007) [2023-12-28 03:31:07,686][106226] Updated weights for policy 0, policy_version 1149299 (0.0011) [2023-12-28 03:31:08,266][106225] Updated weights for policy 1, policy_version 1152366 (0.0008) [2023-12-28 03:31:08,325][106225] Updated weights for policy 1, policy_version 1152376 (0.0009) [2023-12-28 03:31:08,384][106225] Updated weights for policy 1, policy_version 1152386 (0.0008) [2023-12-28 03:31:08,463][106226] Updated weights for policy 0, policy_version 1149309 (0.0009) [2023-12-28 03:31:08,532][106226] Updated weights for policy 0, policy_version 1149319 (0.0008) [2023-12-28 03:31:08,598][106226] Updated weights for policy 0, policy_version 1149329 (0.0008) [2023-12-28 03:31:09,122][106225] Updated weights for policy 1, policy_version 1152396 (0.0008) [2023-12-28 03:31:09,176][106225] Updated weights for policy 1, policy_version 1152406 (0.0008) [2023-12-28 03:31:09,242][106225] Updated weights for policy 1, policy_version 1152416 (0.0007) [2023-12-28 03:31:09,391][106226] Updated weights for policy 0, policy_version 1149339 (0.0008) [2023-12-28 03:31:09,469][106226] Updated weights for policy 0, policy_version 1149349 (0.0008) [2023-12-28 03:31:09,540][106226] Updated weights for policy 0, policy_version 1149359 (0.0009) [2023-12-28 03:31:09,963][106225] Updated weights for policy 1, policy_version 1152426 (0.0008) [2023-12-28 03:31:10,033][106225] Updated weights for policy 1, policy_version 1152436 (0.0006) [2023-12-28 03:31:10,094][106225] Updated weights for policy 1, policy_version 1152446 (0.0006) [2023-12-28 03:31:10,157][106225] Updated weights for policy 1, policy_version 1152456 (0.0008) [2023-12-28 03:31:10,375][106226] Updated weights for policy 0, policy_version 1149369 (0.0009) [2023-12-28 03:31:10,439][106226] Updated weights for policy 0, policy_version 1149379 (0.0009) [2023-12-28 03:31:10,502][106226] Updated weights for policy 0, policy_version 1149389 (0.0009) [2023-12-28 03:31:10,558][106226] Updated weights for policy 0, policy_version 1149399 (0.0008) [2023-12-28 03:31:10,853][106225] Updated weights for policy 1, policy_version 1152466 (0.0007) [2023-12-28 03:31:10,913][106225] Updated weights for policy 1, policy_version 1152476 (0.0006) [2023-12-28 03:31:10,980][106225] Updated weights for policy 1, policy_version 1152486 (0.0006) [2023-12-28 03:31:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 589389824. Throughput: 0: 10002.0, 1: 9889.6. Samples: 589362700. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:11,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.815')] [2023-12-28 03:31:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001152488_295084032.pth... [2023-12-28 03:31:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001149400_294305792.pth... [2023-12-28 03:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001148248_294010880.pth [2023-12-28 03:31:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001151336_294789120.pth [2023-12-28 03:31:11,432][106226] Updated weights for policy 0, policy_version 1149409 (0.0009) [2023-12-28 03:31:11,497][106226] Updated weights for policy 0, policy_version 1149419 (0.0008) [2023-12-28 03:31:11,564][106226] Updated weights for policy 0, policy_version 1149429 (0.0009) [2023-12-28 03:31:11,792][106225] Updated weights for policy 1, policy_version 1152496 (0.0008) [2023-12-28 03:31:11,856][106225] Updated weights for policy 1, policy_version 1152506 (0.0008) [2023-12-28 03:31:11,914][106225] Updated weights for policy 1, policy_version 1152516 (0.0008) [2023-12-28 03:31:12,359][106226] Updated weights for policy 0, policy_version 1149439 (0.0008) [2023-12-28 03:31:12,427][106226] Updated weights for policy 0, policy_version 1149449 (0.0009) [2023-12-28 03:31:12,493][106226] Updated weights for policy 0, policy_version 1149459 (0.0010) [2023-12-28 03:31:12,638][106225] Updated weights for policy 1, policy_version 1152526 (0.0007) [2023-12-28 03:31:12,702][106225] Updated weights for policy 1, policy_version 1152536 (0.0008) [2023-12-28 03:31:12,764][106225] Updated weights for policy 1, policy_version 1152546 (0.0007) [2023-12-28 03:31:13,210][106226] Updated weights for policy 0, policy_version 1149469 (0.0009) [2023-12-28 03:31:13,271][106226] Updated weights for policy 0, policy_version 1149479 (0.0011) [2023-12-28 03:31:13,320][106226] Updated weights for policy 0, policy_version 1149489 (0.0010) [2023-12-28 03:31:13,454][106225] Updated weights for policy 1, policy_version 1152556 (0.0007) [2023-12-28 03:31:13,520][106225] Updated weights for policy 1, policy_version 1152566 (0.0005) [2023-12-28 03:31:13,582][106225] Updated weights for policy 1, policy_version 1152576 (0.0006) [2023-12-28 03:31:13,950][106226] Updated weights for policy 0, policy_version 1149499 (0.0009) [2023-12-28 03:31:14,019][106226] Updated weights for policy 0, policy_version 1149509 (0.0005) [2023-12-28 03:31:14,079][106226] Updated weights for policy 0, policy_version 1149519 (0.0008) [2023-12-28 03:31:14,266][106225] Updated weights for policy 1, policy_version 1152586 (0.0008) [2023-12-28 03:31:14,325][106225] Updated weights for policy 1, policy_version 1152596 (0.0008) [2023-12-28 03:31:14,384][106225] Updated weights for policy 1, policy_version 1152606 (0.0008) [2023-12-28 03:31:14,450][106225] Updated weights for policy 1, policy_version 1152616 (0.0007) [2023-12-28 03:31:14,746][106226] Updated weights for policy 0, policy_version 1149529 (0.0011) [2023-12-28 03:31:14,816][106226] Updated weights for policy 0, policy_version 1149539 (0.0011) [2023-12-28 03:31:14,877][106226] Updated weights for policy 0, policy_version 1149549 (0.0011) [2023-12-28 03:31:14,941][106226] Updated weights for policy 0, policy_version 1149559 (0.0007) [2023-12-28 03:31:15,126][106225] Updated weights for policy 1, policy_version 1152626 (0.0006) [2023-12-28 03:31:15,185][106225] Updated weights for policy 1, policy_version 1152636 (0.0007) [2023-12-28 03:31:15,236][106225] Updated weights for policy 1, policy_version 1152646 (0.0007) [2023-12-28 03:31:15,650][106226] Updated weights for policy 0, policy_version 1149569 (0.0008) [2023-12-28 03:31:15,711][106226] Updated weights for policy 0, policy_version 1149579 (0.0009) [2023-12-28 03:31:15,775][106226] Updated weights for policy 0, policy_version 1149589 (0.0009) [2023-12-28 03:31:15,925][106225] Updated weights for policy 1, policy_version 1152656 (0.0010) [2023-12-28 03:31:15,982][106225] Updated weights for policy 1, policy_version 1152666 (0.0010) [2023-12-28 03:31:16,032][106225] Updated weights for policy 1, policy_version 1152676 (0.0010) [2023-12-28 03:31:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 589488128. Throughput: 0: 9837.2, 1: 9755.1. Samples: 589475288. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:16,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.650')] [2023-12-28 03:31:16,437][106226] Updated weights for policy 0, policy_version 1149599 (0.0008) [2023-12-28 03:31:16,505][106226] Updated weights for policy 0, policy_version 1149609 (0.0008) [2023-12-28 03:31:16,572][106226] Updated weights for policy 0, policy_version 1149619 (0.0009) [2023-12-28 03:31:16,681][106225] Updated weights for policy 1, policy_version 1152686 (0.0007) [2023-12-28 03:31:16,745][106225] Updated weights for policy 1, policy_version 1152696 (0.0008) [2023-12-28 03:31:16,814][106225] Updated weights for policy 1, policy_version 1152706 (0.0008) [2023-12-28 03:31:17,215][106226] Updated weights for policy 0, policy_version 1149629 (0.0009) [2023-12-28 03:31:17,275][106226] Updated weights for policy 0, policy_version 1149640 (0.0009) [2023-12-28 03:31:17,335][106226] Updated weights for policy 0, policy_version 1149650 (0.0010) [2023-12-28 03:31:17,439][106225] Updated weights for policy 1, policy_version 1152716 (0.0008) [2023-12-28 03:31:17,504][106225] Updated weights for policy 1, policy_version 1152726 (0.0010) [2023-12-28 03:31:17,551][106225] Updated weights for policy 1, policy_version 1152736 (0.0010) [2023-12-28 03:31:18,019][106226] Updated weights for policy 0, policy_version 1149660 (0.0010) [2023-12-28 03:31:18,073][106226] Updated weights for policy 0, policy_version 1149670 (0.0006) [2023-12-28 03:31:18,129][106226] Updated weights for policy 0, policy_version 1149680 (0.0007) [2023-12-28 03:31:18,155][106225] Updated weights for policy 1, policy_version 1152746 (0.0010) [2023-12-28 03:31:18,208][106225] Updated weights for policy 1, policy_version 1152756 (0.0010) [2023-12-28 03:31:18,257][106225] Updated weights for policy 1, policy_version 1152766 (0.0010) [2023-12-28 03:31:18,310][106225] Updated weights for policy 1, policy_version 1152776 (0.0010) [2023-12-28 03:31:18,864][106226] Updated weights for policy 0, policy_version 1149690 (0.0010) [2023-12-28 03:31:18,927][106226] Updated weights for policy 0, policy_version 1149700 (0.0008) [2023-12-28 03:31:18,989][106226] Updated weights for policy 0, policy_version 1149710 (0.0008) [2023-12-28 03:31:19,034][106226] Updated weights for policy 0, policy_version 1149720 (0.0007) [2023-12-28 03:31:19,049][106225] Updated weights for policy 1, policy_version 1152786 (0.0010) [2023-12-28 03:31:19,100][106225] Updated weights for policy 1, policy_version 1152796 (0.0010) [2023-12-28 03:31:19,163][106225] Updated weights for policy 1, policy_version 1152806 (0.0010) [2023-12-28 03:31:19,778][106226] Updated weights for policy 0, policy_version 1149730 (0.0008) [2023-12-28 03:31:19,844][106226] Updated weights for policy 0, policy_version 1149740 (0.0007) [2023-12-28 03:31:19,917][106226] Updated weights for policy 0, policy_version 1149750 (0.0008) [2023-12-28 03:31:19,968][106225] Updated weights for policy 1, policy_version 1152816 (0.0010) [2023-12-28 03:31:20,031][106225] Updated weights for policy 1, policy_version 1152826 (0.0009) [2023-12-28 03:31:20,094][106225] Updated weights for policy 1, policy_version 1152836 (0.0010) [2023-12-28 03:31:20,591][106226] Updated weights for policy 0, policy_version 1149760 (0.0007) [2023-12-28 03:31:20,662][106226] Updated weights for policy 0, policy_version 1149770 (0.0008) [2023-12-28 03:31:20,733][106226] Updated weights for policy 0, policy_version 1149780 (0.0007) [2023-12-28 03:31:20,842][106225] Updated weights for policy 1, policy_version 1152846 (0.0010) [2023-12-28 03:31:20,899][106225] Updated weights for policy 1, policy_version 1152856 (0.0009) [2023-12-28 03:31:20,963][106225] Updated weights for policy 1, policy_version 1152866 (0.0008) [2023-12-28 03:31:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 589586432. Throughput: 0: 9835.9, 1: 9793.3. Samples: 589594160. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:21,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.932')] [2023-12-28 03:31:21,492][106226] Updated weights for policy 0, policy_version 1149790 (0.0009) [2023-12-28 03:31:21,550][106226] Updated weights for policy 0, policy_version 1149800 (0.0009) [2023-12-28 03:31:21,614][106226] Updated weights for policy 0, policy_version 1149810 (0.0008) [2023-12-28 03:31:21,706][106225] Updated weights for policy 1, policy_version 1152876 (0.0008) [2023-12-28 03:31:21,775][106225] Updated weights for policy 1, policy_version 1152886 (0.0012) [2023-12-28 03:31:21,839][106225] Updated weights for policy 1, policy_version 1152896 (0.0008) [2023-12-28 03:31:22,412][106226] Updated weights for policy 0, policy_version 1149820 (0.0009) [2023-12-28 03:31:22,475][106226] Updated weights for policy 0, policy_version 1149830 (0.0009) [2023-12-28 03:31:22,528][106226] Updated weights for policy 0, policy_version 1149840 (0.0009) [2023-12-28 03:31:22,581][106225] Updated weights for policy 1, policy_version 1152906 (0.0008) [2023-12-28 03:31:22,630][106225] Updated weights for policy 1, policy_version 1152916 (0.0008) [2023-12-28 03:31:22,675][106225] Updated weights for policy 1, policy_version 1152926 (0.0008) [2023-12-28 03:31:22,720][106225] Updated weights for policy 1, policy_version 1152936 (0.0005) [2023-12-28 03:31:23,280][106226] Updated weights for policy 0, policy_version 1149850 (0.0009) [2023-12-28 03:31:23,333][106226] Updated weights for policy 0, policy_version 1149860 (0.0008) [2023-12-28 03:31:23,392][106226] Updated weights for policy 0, policy_version 1149870 (0.0008) [2023-12-28 03:31:23,449][106226] Updated weights for policy 0, policy_version 1149880 (0.0009) [2023-12-28 03:31:23,450][106225] Updated weights for policy 1, policy_version 1152946 (0.0008) [2023-12-28 03:31:23,503][106225] Updated weights for policy 1, policy_version 1152956 (0.0010) [2023-12-28 03:31:23,549][106225] Updated weights for policy 1, policy_version 1152966 (0.0010) [2023-12-28 03:31:24,211][106226] Updated weights for policy 0, policy_version 1149890 (0.0007) [2023-12-28 03:31:24,246][106225] Updated weights for policy 1, policy_version 1152976 (0.0009) [2023-12-28 03:31:24,271][106226] Updated weights for policy 0, policy_version 1149900 (0.0006) [2023-12-28 03:31:24,307][106225] Updated weights for policy 1, policy_version 1152986 (0.0008) [2023-12-28 03:31:24,330][106226] Updated weights for policy 0, policy_version 1149910 (0.0005) [2023-12-28 03:31:24,371][106225] Updated weights for policy 1, policy_version 1152996 (0.0009) [2023-12-28 03:31:25,009][106226] Updated weights for policy 0, policy_version 1149920 (0.0008) [2023-12-28 03:31:25,073][106225] Updated weights for policy 1, policy_version 1153006 (0.0007) [2023-12-28 03:31:25,074][106226] Updated weights for policy 0, policy_version 1149930 (0.0009) [2023-12-28 03:31:25,125][106226] Updated weights for policy 0, policy_version 1149940 (0.0007) [2023-12-28 03:31:25,127][106225] Updated weights for policy 1, policy_version 1153016 (0.0006) [2023-12-28 03:31:25,177][106225] Updated weights for policy 1, policy_version 1153026 (0.0007) [2023-12-28 03:31:25,756][106225] Updated weights for policy 1, policy_version 1153036 (0.0006) [2023-12-28 03:31:25,810][106225] Updated weights for policy 1, policy_version 1153046 (0.0007) [2023-12-28 03:31:25,862][106225] Updated weights for policy 1, policy_version 1153056 (0.0008) [2023-12-28 03:31:25,916][106226] Updated weights for policy 0, policy_version 1149950 (0.0008) [2023-12-28 03:31:25,964][106226] Updated weights for policy 0, policy_version 1149960 (0.0008) [2023-12-28 03:31:26,016][106226] Updated weights for policy 0, policy_version 1149970 (0.0009) [2023-12-28 03:31:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 589684736. Throughput: 0: 9734.5, 1: 9715.7. Samples: 589649768. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:26,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.809')] [2023-12-28 03:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001149976_294453248.pth... [2023-12-28 03:31:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001153064_295231488.pth... [2023-12-28 03:31:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001148824_294158336.pth [2023-12-28 03:31:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001151944_294944768.pth [2023-12-28 03:31:26,451][106225] Updated weights for policy 1, policy_version 1153066 (0.0008) [2023-12-28 03:31:26,509][106225] Updated weights for policy 1, policy_version 1153076 (0.0008) [2023-12-28 03:31:26,562][106225] Updated weights for policy 1, policy_version 1153086 (0.0008) [2023-12-28 03:31:26,622][106225] Updated weights for policy 1, policy_version 1153096 (0.0008) [2023-12-28 03:31:26,810][106226] Updated weights for policy 0, policy_version 1149980 (0.0009) [2023-12-28 03:31:26,859][106226] Updated weights for policy 0, policy_version 1149990 (0.0009) [2023-12-28 03:31:26,922][106226] Updated weights for policy 0, policy_version 1150000 (0.0008) [2023-12-28 03:31:27,300][106225] Updated weights for policy 1, policy_version 1153106 (0.0005) [2023-12-28 03:31:27,351][106225] Updated weights for policy 1, policy_version 1153116 (0.0007) [2023-12-28 03:31:27,396][106225] Updated weights for policy 1, policy_version 1153126 (0.0008) [2023-12-28 03:31:27,721][106226] Updated weights for policy 0, policy_version 1150010 (0.0009) [2023-12-28 03:31:27,769][106226] Updated weights for policy 0, policy_version 1150020 (0.0008) [2023-12-28 03:31:27,823][106226] Updated weights for policy 0, policy_version 1150030 (0.0008) [2023-12-28 03:31:27,874][106226] Updated weights for policy 0, policy_version 1150040 (0.0008) [2023-12-28 03:31:28,020][106225] Updated weights for policy 1, policy_version 1153136 (0.0008) [2023-12-28 03:31:28,067][106225] Updated weights for policy 1, policy_version 1153146 (0.0008) [2023-12-28 03:31:28,127][106225] Updated weights for policy 1, policy_version 1153156 (0.0008) [2023-12-28 03:31:28,613][106226] Updated weights for policy 0, policy_version 1150050 (0.0008) [2023-12-28 03:31:28,672][106226] Updated weights for policy 0, policy_version 1150060 (0.0009) [2023-12-28 03:31:28,731][106226] Updated weights for policy 0, policy_version 1150070 (0.0009) [2023-12-28 03:31:28,812][106225] Updated weights for policy 1, policy_version 1153166 (0.0008) [2023-12-28 03:31:28,861][106225] Updated weights for policy 1, policy_version 1153176 (0.0008) [2023-12-28 03:31:28,916][106225] Updated weights for policy 1, policy_version 1153186 (0.0008) [2023-12-28 03:31:29,555][106225] Updated weights for policy 1, policy_version 1153196 (0.0006) [2023-12-28 03:31:29,598][106226] Updated weights for policy 0, policy_version 1150080 (0.0008) [2023-12-28 03:31:29,612][106225] Updated weights for policy 1, policy_version 1153206 (0.0008) [2023-12-28 03:31:29,649][106226] Updated weights for policy 0, policy_version 1150090 (0.0006) [2023-12-28 03:31:29,667][106225] Updated weights for policy 1, policy_version 1153216 (0.0006) [2023-12-28 03:31:29,700][106226] Updated weights for policy 0, policy_version 1150100 (0.0005) [2023-12-28 03:31:30,365][106225] Updated weights for policy 1, policy_version 1153226 (0.0007) [2023-12-28 03:31:30,424][106225] Updated weights for policy 1, policy_version 1153236 (0.0005) [2023-12-28 03:31:30,478][106226] Updated weights for policy 0, policy_version 1150110 (0.0009) [2023-12-28 03:31:30,490][106225] Updated weights for policy 1, policy_version 1153246 (0.0006) [2023-12-28 03:31:30,539][106226] Updated weights for policy 0, policy_version 1150120 (0.0008) [2023-12-28 03:31:30,557][106225] Updated weights for policy 1, policy_version 1153256 (0.0007) [2023-12-28 03:31:30,598][106226] Updated weights for policy 0, policy_version 1150130 (0.0008) [2023-12-28 03:31:31,128][106225] Updated weights for policy 1, policy_version 1153266 (0.0009) [2023-12-28 03:31:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 589774848. Throughput: 0: 9698.6, 1: 9841.9. Samples: 589768920. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:31,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.634')] [2023-12-28 03:31:31,188][106225] Updated weights for policy 1, policy_version 1153276 (0.0009) [2023-12-28 03:31:31,247][106225] Updated weights for policy 1, policy_version 1153286 (0.0008) [2023-12-28 03:31:31,400][106226] Updated weights for policy 0, policy_version 1150140 (0.0008) [2023-12-28 03:31:31,463][106226] Updated weights for policy 0, policy_version 1150150 (0.0009) [2023-12-28 03:31:31,525][106226] Updated weights for policy 0, policy_version 1150160 (0.0008) [2023-12-28 03:31:31,960][106225] Updated weights for policy 1, policy_version 1153296 (0.0007) [2023-12-28 03:31:32,015][106225] Updated weights for policy 1, policy_version 1153306 (0.0010) [2023-12-28 03:31:32,072][106225] Updated weights for policy 1, policy_version 1153316 (0.0010) [2023-12-28 03:31:32,197][106226] Updated weights for policy 0, policy_version 1150170 (0.0009) [2023-12-28 03:31:32,248][106226] Updated weights for policy 0, policy_version 1150180 (0.0008) [2023-12-28 03:31:32,316][106226] Updated weights for policy 0, policy_version 1150190 (0.0007) [2023-12-28 03:31:32,384][106226] Updated weights for policy 0, policy_version 1150200 (0.0009) [2023-12-28 03:31:32,748][106225] Updated weights for policy 1, policy_version 1153326 (0.0007) [2023-12-28 03:31:32,801][106225] Updated weights for policy 1, policy_version 1153336 (0.0007) [2023-12-28 03:31:32,857][106225] Updated weights for policy 1, policy_version 1153346 (0.0008) [2023-12-28 03:31:33,160][106226] Updated weights for policy 0, policy_version 1150210 (0.0007) [2023-12-28 03:31:33,210][106226] Updated weights for policy 0, policy_version 1150220 (0.0008) [2023-12-28 03:31:33,255][106226] Updated weights for policy 0, policy_version 1150230 (0.0007) [2023-12-28 03:31:33,549][106225] Updated weights for policy 1, policy_version 1153356 (0.0010) [2023-12-28 03:31:33,605][106225] Updated weights for policy 1, policy_version 1153366 (0.0010) [2023-12-28 03:31:33,657][106225] Updated weights for policy 1, policy_version 1153376 (0.0010) [2023-12-28 03:31:33,943][106226] Updated weights for policy 0, policy_version 1150240 (0.0009) [2023-12-28 03:31:33,995][106226] Updated weights for policy 0, policy_version 1150250 (0.0008) [2023-12-28 03:31:34,059][106226] Updated weights for policy 0, policy_version 1150260 (0.0008) [2023-12-28 03:31:34,279][106225] Updated weights for policy 1, policy_version 1153386 (0.0010) [2023-12-28 03:31:34,348][106225] Updated weights for policy 1, policy_version 1153396 (0.0011) [2023-12-28 03:31:34,410][106225] Updated weights for policy 1, policy_version 1153406 (0.0011) [2023-12-28 03:31:34,472][106225] Updated weights for policy 1, policy_version 1153416 (0.0011) [2023-12-28 03:31:34,801][106226] Updated weights for policy 0, policy_version 1150270 (0.0008) [2023-12-28 03:31:34,856][106226] Updated weights for policy 0, policy_version 1150280 (0.0009) [2023-12-28 03:31:34,910][106226] Updated weights for policy 0, policy_version 1150290 (0.0009) [2023-12-28 03:31:35,194][106225] Updated weights for policy 1, policy_version 1153426 (0.0008) [2023-12-28 03:31:35,251][106225] Updated weights for policy 1, policy_version 1153436 (0.0007) [2023-12-28 03:31:35,313][106225] Updated weights for policy 1, policy_version 1153446 (0.0008) [2023-12-28 03:31:35,483][106226] Updated weights for policy 0, policy_version 1150300 (0.0007) [2023-12-28 03:31:35,537][106226] Updated weights for policy 0, policy_version 1150310 (0.0008) [2023-12-28 03:31:35,595][106226] Updated weights for policy 0, policy_version 1150320 (0.0005) [2023-12-28 03:31:36,128][106226] Updated weights for policy 0, policy_version 1150330 (0.0006) [2023-12-28 03:31:36,148][106225] Updated weights for policy 1, policy_version 1153456 (0.0007) [2023-12-28 03:31:36,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 589873152. Throughput: 0: 9747.0, 1: 9836.9. Samples: 589889392. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:36,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-4.868')] [2023-12-28 03:31:36,185][106226] Updated weights for policy 0, policy_version 1150340 (0.0008) [2023-12-28 03:31:36,210][106225] Updated weights for policy 1, policy_version 1153466 (0.0006) [2023-12-28 03:31:36,245][106226] Updated weights for policy 0, policy_version 1150350 (0.0008) [2023-12-28 03:31:36,269][106225] Updated weights for policy 1, policy_version 1153476 (0.0006) [2023-12-28 03:31:36,309][106226] Updated weights for policy 0, policy_version 1150360 (0.0008) [2023-12-28 03:31:36,987][106225] Updated weights for policy 1, policy_version 1153486 (0.0008) [2023-12-28 03:31:37,025][106226] Updated weights for policy 0, policy_version 1150370 (0.0005) [2023-12-28 03:31:37,035][106225] Updated weights for policy 1, policy_version 1153496 (0.0008) [2023-12-28 03:31:37,081][106226] Updated weights for policy 0, policy_version 1150380 (0.0006) [2023-12-28 03:31:37,091][106225] Updated weights for policy 1, policy_version 1153506 (0.0008) [2023-12-28 03:31:37,135][106226] Updated weights for policy 0, policy_version 1150390 (0.0010) [2023-12-28 03:31:37,795][106226] Updated weights for policy 0, policy_version 1150400 (0.0006) [2023-12-28 03:31:37,855][106226] Updated weights for policy 0, policy_version 1150410 (0.0006) [2023-12-28 03:31:37,878][106225] Updated weights for policy 1, policy_version 1153516 (0.0007) [2023-12-28 03:31:37,914][106226] Updated weights for policy 0, policy_version 1150420 (0.0005) [2023-12-28 03:31:37,927][106225] Updated weights for policy 1, policy_version 1153526 (0.0008) [2023-12-28 03:31:37,977][106225] Updated weights for policy 1, policy_version 1153536 (0.0007) [2023-12-28 03:31:38,443][106226] Updated weights for policy 0, policy_version 1150430 (0.0008) [2023-12-28 03:31:38,493][106226] Updated weights for policy 0, policy_version 1150440 (0.0010) [2023-12-28 03:31:38,548][106226] Updated weights for policy 0, policy_version 1150450 (0.0010) [2023-12-28 03:31:38,822][106225] Updated weights for policy 1, policy_version 1153546 (0.0009) [2023-12-28 03:31:38,885][106225] Updated weights for policy 1, policy_version 1153556 (0.0008) [2023-12-28 03:31:38,942][106225] Updated weights for policy 1, policy_version 1153566 (0.0008) [2023-12-28 03:31:38,992][106225] Updated weights for policy 1, policy_version 1153576 (0.0008) [2023-12-28 03:31:39,208][106226] Updated weights for policy 0, policy_version 1150460 (0.0010) [2023-12-28 03:31:39,276][106226] Updated weights for policy 0, policy_version 1150470 (0.0009) [2023-12-28 03:31:39,335][106226] Updated weights for policy 0, policy_version 1150480 (0.0008) [2023-12-28 03:31:39,772][106225] Updated weights for policy 1, policy_version 1153586 (0.0008) [2023-12-28 03:31:39,842][106225] Updated weights for policy 1, policy_version 1153596 (0.0008) [2023-12-28 03:31:39,900][106225] Updated weights for policy 1, policy_version 1153606 (0.0009) [2023-12-28 03:31:40,060][106226] Updated weights for policy 0, policy_version 1150490 (0.0010) [2023-12-28 03:31:40,122][106226] Updated weights for policy 0, policy_version 1150500 (0.0011) [2023-12-28 03:31:40,183][106226] Updated weights for policy 0, policy_version 1150510 (0.0011) [2023-12-28 03:31:40,251][106226] Updated weights for policy 0, policy_version 1150520 (0.0011) [2023-12-28 03:31:40,570][106225] Updated weights for policy 1, policy_version 1153616 (0.0006) [2023-12-28 03:31:40,620][106225] Updated weights for policy 1, policy_version 1153626 (0.0006) [2023-12-28 03:31:40,677][106225] Updated weights for policy 1, policy_version 1153636 (0.0005) [2023-12-28 03:31:41,020][106226] Updated weights for policy 0, policy_version 1150530 (0.0008) [2023-12-28 03:31:41,085][106226] Updated weights for policy 0, policy_version 1150540 (0.0008) [2023-12-28 03:31:41,152][106226] Updated weights for policy 0, policy_version 1150550 (0.0009) [2023-12-28 03:31:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 589979648. Throughput: 0: 9803.6, 1: 9783.7. Samples: 589948480. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:41,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-5.035')] [2023-12-28 03:31:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001153640_295378944.pth... [2023-12-28 03:31:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001150552_294600704.pth... [2023-12-28 03:31:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001152488_295084032.pth [2023-12-28 03:31:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001149400_294305792.pth [2023-12-28 03:31:41,279][106225] Updated weights for policy 1, policy_version 1153646 (0.0006) [2023-12-28 03:31:41,348][106225] Updated weights for policy 1, policy_version 1153656 (0.0008) [2023-12-28 03:31:41,415][106225] Updated weights for policy 1, policy_version 1153666 (0.0007) [2023-12-28 03:31:41,919][106226] Updated weights for policy 0, policy_version 1150560 (0.0008) [2023-12-28 03:31:41,981][106226] Updated weights for policy 0, policy_version 1150570 (0.0008) [2023-12-28 03:31:42,045][106226] Updated weights for policy 0, policy_version 1150580 (0.0008) [2023-12-28 03:31:42,179][106225] Updated weights for policy 1, policy_version 1153676 (0.0007) [2023-12-28 03:31:42,235][106225] Updated weights for policy 1, policy_version 1153686 (0.0006) [2023-12-28 03:31:42,300][106225] Updated weights for policy 1, policy_version 1153696 (0.0008) [2023-12-28 03:31:42,827][106226] Updated weights for policy 0, policy_version 1150590 (0.0010) [2023-12-28 03:31:42,891][106226] Updated weights for policy 0, policy_version 1150600 (0.0011) [2023-12-28 03:31:42,955][106226] Updated weights for policy 0, policy_version 1150610 (0.0011) [2023-12-28 03:31:43,054][106225] Updated weights for policy 1, policy_version 1153706 (0.0008) [2023-12-28 03:31:43,110][106225] Updated weights for policy 1, policy_version 1153716 (0.0007) [2023-12-28 03:31:43,170][106225] Updated weights for policy 1, policy_version 1153726 (0.0007) [2023-12-28 03:31:43,230][106225] Updated weights for policy 1, policy_version 1153736 (0.0007) [2023-12-28 03:31:43,674][106226] Updated weights for policy 0, policy_version 1150620 (0.0010) [2023-12-28 03:31:43,720][106226] Updated weights for policy 0, policy_version 1150630 (0.0008) [2023-12-28 03:31:43,766][106226] Updated weights for policy 0, policy_version 1150640 (0.0005) [2023-12-28 03:31:43,940][106225] Updated weights for policy 1, policy_version 1153746 (0.0010) [2023-12-28 03:31:43,986][106225] Updated weights for policy 1, policy_version 1153756 (0.0007) [2023-12-28 03:31:44,040][106225] Updated weights for policy 1, policy_version 1153766 (0.0005) [2023-12-28 03:31:44,427][106226] Updated weights for policy 0, policy_version 1150650 (0.0006) [2023-12-28 03:31:44,481][106226] Updated weights for policy 0, policy_version 1150660 (0.0009) [2023-12-28 03:31:44,538][106226] Updated weights for policy 0, policy_version 1150670 (0.0009) [2023-12-28 03:31:44,595][106226] Updated weights for policy 0, policy_version 1150680 (0.0009) [2023-12-28 03:31:44,637][106225] Updated weights for policy 1, policy_version 1153776 (0.0007) [2023-12-28 03:31:44,699][106225] Updated weights for policy 1, policy_version 1153786 (0.0008) [2023-12-28 03:31:44,762][106225] Updated weights for policy 1, policy_version 1153796 (0.0008) [2023-12-28 03:31:45,335][106226] Updated weights for policy 0, policy_version 1150690 (0.0009) [2023-12-28 03:31:45,389][106226] Updated weights for policy 0, policy_version 1150700 (0.0009) [2023-12-28 03:31:45,441][106226] Updated weights for policy 0, policy_version 1150710 (0.0008) [2023-12-28 03:31:45,518][106225] Updated weights for policy 1, policy_version 1153806 (0.0009) [2023-12-28 03:31:45,575][106225] Updated weights for policy 1, policy_version 1153816 (0.0008) [2023-12-28 03:31:45,645][106225] Updated weights for policy 1, policy_version 1153826 (0.0008) [2023-12-28 03:31:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 590069760. Throughput: 0: 9660.9, 1: 9884.6. Samples: 590064424. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:46,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.132')] [2023-12-28 03:31:46,195][106226] Updated weights for policy 0, policy_version 1150720 (0.0009) [2023-12-28 03:31:46,254][106226] Updated weights for policy 0, policy_version 1150730 (0.0008) [2023-12-28 03:31:46,317][106226] Updated weights for policy 0, policy_version 1150740 (0.0009) [2023-12-28 03:31:46,392][106225] Updated weights for policy 1, policy_version 1153836 (0.0008) [2023-12-28 03:31:46,454][106225] Updated weights for policy 1, policy_version 1153846 (0.0008) [2023-12-28 03:31:46,510][106225] Updated weights for policy 1, policy_version 1153856 (0.0008) [2023-12-28 03:31:47,042][106226] Updated weights for policy 0, policy_version 1150750 (0.0009) [2023-12-28 03:31:47,103][106226] Updated weights for policy 0, policy_version 1150760 (0.0008) [2023-12-28 03:31:47,167][106226] Updated weights for policy 0, policy_version 1150770 (0.0009) [2023-12-28 03:31:47,195][106225] Updated weights for policy 1, policy_version 1153866 (0.0009) [2023-12-28 03:31:47,245][106225] Updated weights for policy 1, policy_version 1153876 (0.0010) [2023-12-28 03:31:47,299][106225] Updated weights for policy 1, policy_version 1153886 (0.0010) [2023-12-28 03:31:47,363][106225] Updated weights for policy 1, policy_version 1153896 (0.0010) [2023-12-28 03:31:47,930][106226] Updated weights for policy 0, policy_version 1150780 (0.0008) [2023-12-28 03:31:47,967][106225] Updated weights for policy 1, policy_version 1153906 (0.0010) [2023-12-28 03:31:47,977][106226] Updated weights for policy 0, policy_version 1150790 (0.0005) [2023-12-28 03:31:48,023][106225] Updated weights for policy 1, policy_version 1153916 (0.0008) [2023-12-28 03:31:48,035][106226] Updated weights for policy 0, policy_version 1150800 (0.0007) [2023-12-28 03:31:48,079][106225] Updated weights for policy 1, policy_version 1153926 (0.0005) [2023-12-28 03:31:48,724][106225] Updated weights for policy 1, policy_version 1153936 (0.0006) [2023-12-28 03:31:48,785][106225] Updated weights for policy 1, policy_version 1153946 (0.0008) [2023-12-28 03:31:48,846][106225] Updated weights for policy 1, policy_version 1153956 (0.0010) [2023-12-28 03:31:48,862][106226] Updated weights for policy 0, policy_version 1150810 (0.0009) [2023-12-28 03:31:48,923][106226] Updated weights for policy 0, policy_version 1150820 (0.0008) [2023-12-28 03:31:48,983][106226] Updated weights for policy 0, policy_version 1150830 (0.0007) [2023-12-28 03:31:49,043][106226] Updated weights for policy 0, policy_version 1150840 (0.0007) [2023-12-28 03:31:49,523][106225] Updated weights for policy 1, policy_version 1153966 (0.0009) [2023-12-28 03:31:49,582][106225] Updated weights for policy 1, policy_version 1153976 (0.0008) [2023-12-28 03:31:49,634][106225] Updated weights for policy 1, policy_version 1153986 (0.0008) [2023-12-28 03:31:49,790][106226] Updated weights for policy 0, policy_version 1150850 (0.0009) [2023-12-28 03:31:49,866][106226] Updated weights for policy 0, policy_version 1150860 (0.0009) [2023-12-28 03:31:49,934][106226] Updated weights for policy 0, policy_version 1150870 (0.0009) [2023-12-28 03:31:50,323][106225] Updated weights for policy 1, policy_version 1153996 (0.0008) [2023-12-28 03:31:50,380][106225] Updated weights for policy 1, policy_version 1154006 (0.0009) [2023-12-28 03:31:50,432][106225] Updated weights for policy 1, policy_version 1154016 (0.0008) [2023-12-28 03:31:50,736][106226] Updated weights for policy 0, policy_version 1150880 (0.0010) [2023-12-28 03:31:50,799][106226] Updated weights for policy 0, policy_version 1150890 (0.0010) [2023-12-28 03:31:50,863][106226] Updated weights for policy 0, policy_version 1150900 (0.0005) [2023-12-28 03:31:51,073][106225] Updated weights for policy 1, policy_version 1154026 (0.0006) [2023-12-28 03:31:51,136][106225] Updated weights for policy 1, policy_version 1154036 (0.0008) [2023-12-28 03:31:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 590168064. Throughput: 0: 9474.0, 1: 9928.7. Samples: 590179436. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:51,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.712')] [2023-12-28 03:31:51,199][106225] Updated weights for policy 1, policy_version 1154046 (0.0008) [2023-12-28 03:31:51,251][106225] Updated weights for policy 1, policy_version 1154056 (0.0008) [2023-12-28 03:31:51,656][106226] Updated weights for policy 0, policy_version 1150910 (0.0008) [2023-12-28 03:31:51,726][106226] Updated weights for policy 0, policy_version 1150920 (0.0007) [2023-12-28 03:31:51,794][106226] Updated weights for policy 0, policy_version 1150930 (0.0008) [2023-12-28 03:31:52,058][106225] Updated weights for policy 1, policy_version 1154066 (0.0008) [2023-12-28 03:31:52,115][106225] Updated weights for policy 1, policy_version 1154076 (0.0009) [2023-12-28 03:31:52,167][106225] Updated weights for policy 1, policy_version 1154086 (0.0008) [2023-12-28 03:31:52,524][106226] Updated weights for policy 0, policy_version 1150940 (0.0009) [2023-12-28 03:31:52,583][106226] Updated weights for policy 0, policy_version 1150950 (0.0007) [2023-12-28 03:31:52,635][106226] Updated weights for policy 0, policy_version 1150960 (0.0006) [2023-12-28 03:31:52,904][106225] Updated weights for policy 1, policy_version 1154096 (0.0008) [2023-12-28 03:31:52,951][106225] Updated weights for policy 1, policy_version 1154106 (0.0007) [2023-12-28 03:31:53,002][106225] Updated weights for policy 1, policy_version 1154116 (0.0007) [2023-12-28 03:31:53,320][106226] Updated weights for policy 0, policy_version 1150970 (0.0005) [2023-12-28 03:31:53,367][106226] Updated weights for policy 0, policy_version 1150980 (0.0005) [2023-12-28 03:31:53,423][106226] Updated weights for policy 0, policy_version 1150990 (0.0005) [2023-12-28 03:31:53,489][106226] Updated weights for policy 0, policy_version 1151000 (0.0009) [2023-12-28 03:31:53,723][106225] Updated weights for policy 1, policy_version 1154126 (0.0008) [2023-12-28 03:31:53,784][106225] Updated weights for policy 1, policy_version 1154136 (0.0010) [2023-12-28 03:31:53,841][106225] Updated weights for policy 1, policy_version 1154146 (0.0010) [2023-12-28 03:31:54,185][106226] Updated weights for policy 0, policy_version 1151010 (0.0010) [2023-12-28 03:31:54,242][106226] Updated weights for policy 0, policy_version 1151020 (0.0011) [2023-12-28 03:31:54,302][106226] Updated weights for policy 0, policy_version 1151030 (0.0011) [2023-12-28 03:31:54,563][106225] Updated weights for policy 1, policy_version 1154156 (0.0010) [2023-12-28 03:31:54,624][106225] Updated weights for policy 1, policy_version 1154166 (0.0010) [2023-12-28 03:31:54,684][106225] Updated weights for policy 1, policy_version 1154176 (0.0011) [2023-12-28 03:31:55,021][106226] Updated weights for policy 0, policy_version 1151040 (0.0011) [2023-12-28 03:31:55,067][106226] Updated weights for policy 0, policy_version 1151050 (0.0010) [2023-12-28 03:31:55,125][106226] Updated weights for policy 0, policy_version 1151060 (0.0009) [2023-12-28 03:31:55,356][106225] Updated weights for policy 1, policy_version 1154186 (0.0010) [2023-12-28 03:31:55,403][106225] Updated weights for policy 1, policy_version 1154196 (0.0010) [2023-12-28 03:31:55,446][106225] Updated weights for policy 1, policy_version 1154206 (0.0010) [2023-12-28 03:31:55,494][106225] Updated weights for policy 1, policy_version 1154216 (0.0010) [2023-12-28 03:31:55,822][106226] Updated weights for policy 0, policy_version 1151070 (0.0011) [2023-12-28 03:31:55,874][106226] Updated weights for policy 0, policy_version 1151080 (0.0010) [2023-12-28 03:31:55,918][106226] Updated weights for policy 0, policy_version 1151090 (0.0010) [2023-12-28 03:31:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 590266368. Throughput: 0: 9511.0, 1: 9935.8. Samples: 590237808. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:31:56,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-4.825')] [2023-12-28 03:31:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001151096_294739968.pth... [2023-12-28 03:31:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001149976_294453248.pth [2023-12-28 03:31:56,188][106225] Updated weights for policy 1, policy_version 1154226 (0.0005) [2023-12-28 03:31:56,249][106225] Updated weights for policy 1, policy_version 1154236 (0.0008) [2023-12-28 03:31:56,306][106225] Updated weights for policy 1, policy_version 1154246 (0.0006) [2023-12-28 03:31:56,317][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001154248_295534592.pth... [2023-12-28 03:31:56,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001153064_295231488.pth [2023-12-28 03:31:56,518][106226] Updated weights for policy 0, policy_version 1151100 (0.0008) [2023-12-28 03:31:56,566][106226] Updated weights for policy 0, policy_version 1151110 (0.0010) [2023-12-28 03:31:56,619][106226] Updated weights for policy 0, policy_version 1151120 (0.0010) [2023-12-28 03:31:56,852][106225] Updated weights for policy 1, policy_version 1154256 (0.0009) [2023-12-28 03:31:56,897][106225] Updated weights for policy 1, policy_version 1154266 (0.0010) [2023-12-28 03:31:56,950][106225] Updated weights for policy 1, policy_version 1154276 (0.0010) [2023-12-28 03:31:57,195][106226] Updated weights for policy 0, policy_version 1151130 (0.0010) [2023-12-28 03:31:57,249][106226] Updated weights for policy 0, policy_version 1151140 (0.0005) [2023-12-28 03:31:57,306][106226] Updated weights for policy 0, policy_version 1151150 (0.0005) [2023-12-28 03:31:57,368][106226] Updated weights for policy 0, policy_version 1151160 (0.0005) [2023-12-28 03:31:57,572][106225] Updated weights for policy 1, policy_version 1154286 (0.0008) [2023-12-28 03:31:57,622][106225] Updated weights for policy 1, policy_version 1154296 (0.0010) [2023-12-28 03:31:57,681][106225] Updated weights for policy 1, policy_version 1154306 (0.0010) [2023-12-28 03:31:57,913][106226] Updated weights for policy 0, policy_version 1151170 (0.0005) [2023-12-28 03:31:57,971][106226] Updated weights for policy 0, policy_version 1151180 (0.0005) [2023-12-28 03:31:58,033][106226] Updated weights for policy 0, policy_version 1151190 (0.0006) [2023-12-28 03:31:58,425][106225] Updated weights for policy 1, policy_version 1154316 (0.0010) [2023-12-28 03:31:58,488][106225] Updated weights for policy 1, policy_version 1154326 (0.0008) [2023-12-28 03:31:58,551][106225] Updated weights for policy 1, policy_version 1154336 (0.0008) [2023-12-28 03:31:58,664][106226] Updated weights for policy 0, policy_version 1151200 (0.0008) [2023-12-28 03:31:58,735][106226] Updated weights for policy 0, policy_version 1151210 (0.0010) [2023-12-28 03:31:58,805][106226] Updated weights for policy 0, policy_version 1151220 (0.0009) [2023-12-28 03:31:59,383][106225] Updated weights for policy 1, policy_version 1154346 (0.0008) [2023-12-28 03:31:59,450][106225] Updated weights for policy 1, policy_version 1154356 (0.0012) [2023-12-28 03:31:59,514][106225] Updated weights for policy 1, policy_version 1154366 (0.0010) [2023-12-28 03:31:59,571][106225] Updated weights for policy 1, policy_version 1154376 (0.0010) [2023-12-28 03:31:59,609][106226] Updated weights for policy 0, policy_version 1151230 (0.0010) [2023-12-28 03:31:59,659][106226] Updated weights for policy 0, policy_version 1151240 (0.0010) [2023-12-28 03:31:59,710][106226] Updated weights for policy 0, policy_version 1151250 (0.0011) [2023-12-28 03:32:00,254][106225] Updated weights for policy 1, policy_version 1154386 (0.0007) [2023-12-28 03:32:00,311][106225] Updated weights for policy 1, policy_version 1154396 (0.0010) [2023-12-28 03:32:00,374][106225] Updated weights for policy 1, policy_version 1154406 (0.0010) [2023-12-28 03:32:00,448][106226] Updated weights for policy 0, policy_version 1151260 (0.0008) [2023-12-28 03:32:00,503][106226] Updated weights for policy 0, policy_version 1151270 (0.0005) [2023-12-28 03:32:00,558][106226] Updated weights for policy 0, policy_version 1151280 (0.0005) [2023-12-28 03:32:01,035][106225] Updated weights for policy 1, policy_version 1154416 (0.0010) [2023-12-28 03:32:01,101][106225] Updated weights for policy 1, policy_version 1154426 (0.0008) [2023-12-28 03:32:01,166][106225] Updated weights for policy 1, policy_version 1154436 (0.0008) [2023-12-28 03:32:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 590364672. Throughput: 0: 9688.8, 1: 9990.1. Samples: 590360840. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:01,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.869')] [2023-12-28 03:32:01,246][106226] Updated weights for policy 0, policy_version 1151290 (0.0008) [2023-12-28 03:32:01,313][106226] Updated weights for policy 0, policy_version 1151300 (0.0008) [2023-12-28 03:32:01,374][106226] Updated weights for policy 0, policy_version 1151310 (0.0009) [2023-12-28 03:32:01,442][106226] Updated weights for policy 0, policy_version 1151320 (0.0007) [2023-12-28 03:32:01,942][106225] Updated weights for policy 1, policy_version 1154446 (0.0008) [2023-12-28 03:32:02,001][106225] Updated weights for policy 1, policy_version 1154456 (0.0006) [2023-12-28 03:32:02,057][106225] Updated weights for policy 1, policy_version 1154466 (0.0006) [2023-12-28 03:32:02,184][106226] Updated weights for policy 0, policy_version 1151330 (0.0006) [2023-12-28 03:32:02,242][106226] Updated weights for policy 0, policy_version 1151340 (0.0011) [2023-12-28 03:32:02,314][106226] Updated weights for policy 0, policy_version 1151350 (0.0011) [2023-12-28 03:32:02,746][106225] Updated weights for policy 1, policy_version 1154476 (0.0007) [2023-12-28 03:32:02,795][106225] Updated weights for policy 1, policy_version 1154486 (0.0009) [2023-12-28 03:32:02,853][106225] Updated weights for policy 1, policy_version 1154496 (0.0008) [2023-12-28 03:32:02,938][106226] Updated weights for policy 0, policy_version 1151360 (0.0007) [2023-12-28 03:32:03,001][106226] Updated weights for policy 0, policy_version 1151370 (0.0005) [2023-12-28 03:32:03,053][106226] Updated weights for policy 0, policy_version 1151380 (0.0005) [2023-12-28 03:32:03,596][106226] Updated weights for policy 0, policy_version 1151390 (0.0006) [2023-12-28 03:32:03,635][106225] Updated weights for policy 1, policy_version 1154506 (0.0010) [2023-12-28 03:32:03,651][106226] Updated weights for policy 0, policy_version 1151400 (0.0005) [2023-12-28 03:32:03,701][106225] Updated weights for policy 1, policy_version 1154516 (0.0010) [2023-12-28 03:32:03,702][106226] Updated weights for policy 0, policy_version 1151410 (0.0005) [2023-12-28 03:32:03,760][106225] Updated weights for policy 1, policy_version 1154526 (0.0010) [2023-12-28 03:32:03,819][106225] Updated weights for policy 1, policy_version 1154536 (0.0010) [2023-12-28 03:32:04,372][106226] Updated weights for policy 0, policy_version 1151420 (0.0007) [2023-12-28 03:32:04,420][106226] Updated weights for policy 0, policy_version 1151430 (0.0007) [2023-12-28 03:32:04,477][106226] Updated weights for policy 0, policy_version 1151440 (0.0008) [2023-12-28 03:32:04,547][106225] Updated weights for policy 1, policy_version 1154546 (0.0010) [2023-12-28 03:32:04,597][106225] Updated weights for policy 1, policy_version 1154556 (0.0010) [2023-12-28 03:32:04,659][106225] Updated weights for policy 1, policy_version 1154566 (0.0005) [2023-12-28 03:32:05,185][106226] Updated weights for policy 0, policy_version 1151450 (0.0008) [2023-12-28 03:32:05,247][106226] Updated weights for policy 0, policy_version 1151460 (0.0005) [2023-12-28 03:32:05,302][106226] Updated weights for policy 0, policy_version 1151470 (0.0006) [2023-12-28 03:32:05,350][106225] Updated weights for policy 1, policy_version 1154576 (0.0008) [2023-12-28 03:32:05,357][106226] Updated weights for policy 0, policy_version 1151480 (0.0005) [2023-12-28 03:32:05,402][106225] Updated weights for policy 1, policy_version 1154586 (0.0008) [2023-12-28 03:32:05,460][106225] Updated weights for policy 1, policy_version 1154596 (0.0009) [2023-12-28 03:32:05,926][106226] Updated weights for policy 0, policy_version 1151490 (0.0010) [2023-12-28 03:32:05,988][106226] Updated weights for policy 0, policy_version 1151500 (0.0009) [2023-12-28 03:32:06,043][106226] Updated weights for policy 0, policy_version 1151510 (0.0009) [2023-12-28 03:32:06,172][106225] Updated weights for policy 1, policy_version 1154606 (0.0008) [2023-12-28 03:32:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 590471168. Throughput: 0: 9784.3, 1: 9926.8. Samples: 590481156. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:06,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.994')] [2023-12-28 03:32:06,231][106225] Updated weights for policy 1, policy_version 1154616 (0.0006) [2023-12-28 03:32:06,291][106225] Updated weights for policy 1, policy_version 1154626 (0.0006) [2023-12-28 03:32:06,762][106226] Updated weights for policy 0, policy_version 1151520 (0.0009) [2023-12-28 03:32:06,826][106226] Updated weights for policy 0, policy_version 1151530 (0.0009) [2023-12-28 03:32:06,887][106226] Updated weights for policy 0, policy_version 1151540 (0.0010) [2023-12-28 03:32:06,959][106225] Updated weights for policy 1, policy_version 1154636 (0.0006) [2023-12-28 03:32:07,027][106225] Updated weights for policy 1, policy_version 1154646 (0.0009) [2023-12-28 03:32:07,081][106225] Updated weights for policy 1, policy_version 1154656 (0.0008) [2023-12-28 03:32:07,565][106226] Updated weights for policy 0, policy_version 1151550 (0.0007) [2023-12-28 03:32:07,622][106226] Updated weights for policy 0, policy_version 1151560 (0.0007) [2023-12-28 03:32:07,687][106226] Updated weights for policy 0, policy_version 1151570 (0.0007) [2023-12-28 03:32:07,759][106225] Updated weights for policy 1, policy_version 1154666 (0.0009) [2023-12-28 03:32:07,822][106225] Updated weights for policy 1, policy_version 1154676 (0.0009) [2023-12-28 03:32:07,883][106225] Updated weights for policy 1, policy_version 1154686 (0.0008) [2023-12-28 03:32:07,937][106225] Updated weights for policy 1, policy_version 1154696 (0.0006) [2023-12-28 03:32:08,349][106226] Updated weights for policy 0, policy_version 1151580 (0.0007) [2023-12-28 03:32:08,416][106226] Updated weights for policy 0, policy_version 1151590 (0.0007) [2023-12-28 03:32:08,478][106226] Updated weights for policy 0, policy_version 1151600 (0.0008) [2023-12-28 03:32:08,645][106225] Updated weights for policy 1, policy_version 1154706 (0.0006) [2023-12-28 03:32:08,703][106225] Updated weights for policy 1, policy_version 1154716 (0.0008) [2023-12-28 03:32:08,760][106225] Updated weights for policy 1, policy_version 1154727 (0.0008) [2023-12-28 03:32:09,181][106226] Updated weights for policy 0, policy_version 1151610 (0.0008) [2023-12-28 03:32:09,241][106226] Updated weights for policy 0, policy_version 1151620 (0.0009) [2023-12-28 03:32:09,304][106226] Updated weights for policy 0, policy_version 1151630 (0.0009) [2023-12-28 03:32:09,371][106226] Updated weights for policy 0, policy_version 1151640 (0.0009) [2023-12-28 03:32:09,454][106225] Updated weights for policy 1, policy_version 1154737 (0.0008) [2023-12-28 03:32:09,526][106225] Updated weights for policy 1, policy_version 1154747 (0.0009) [2023-12-28 03:32:09,590][106225] Updated weights for policy 1, policy_version 1154757 (0.0008) [2023-12-28 03:32:10,191][106226] Updated weights for policy 0, policy_version 1151650 (0.0010) [2023-12-28 03:32:10,254][106226] Updated weights for policy 0, policy_version 1151660 (0.0008) [2023-12-28 03:32:10,262][106225] Updated weights for policy 1, policy_version 1154767 (0.0008) [2023-12-28 03:32:10,315][106226] Updated weights for policy 0, policy_version 1151670 (0.0007) [2023-12-28 03:32:10,327][106225] Updated weights for policy 1, policy_version 1154777 (0.0007) [2023-12-28 03:32:10,393][106225] Updated weights for policy 1, policy_version 1154787 (0.0008) [2023-12-28 03:32:11,018][106225] Updated weights for policy 1, policy_version 1154797 (0.0008) [2023-12-28 03:32:11,079][106226] Updated weights for policy 0, policy_version 1151680 (0.0010) [2023-12-28 03:32:11,080][106225] Updated weights for policy 1, policy_version 1154807 (0.0008) [2023-12-28 03:32:11,145][106226] Updated weights for policy 0, policy_version 1151690 (0.0007) [2023-12-28 03:32:11,150][106225] Updated weights for policy 1, policy_version 1154817 (0.0007) [2023-12-28 03:32:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 590561280. Throughput: 0: 9846.0, 1: 9977.5. Samples: 590541828. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:11,175][105115] Avg episode reward: [(0, '-4.691'), (1, '-4.711')] [2023-12-28 03:32:11,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001154824_295682048.pth... [2023-12-28 03:32:11,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001153640_295378944.pth [2023-12-28 03:32:11,214][106226] Updated weights for policy 0, policy_version 1151700 (0.0008) [2023-12-28 03:32:11,241][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001151704_294895616.pth... [2023-12-28 03:32:11,246][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001150552_294600704.pth [2023-12-28 03:32:11,880][106225] Updated weights for policy 1, policy_version 1154827 (0.0007) [2023-12-28 03:32:11,946][106225] Updated weights for policy 1, policy_version 1154837 (0.0007) [2023-12-28 03:32:12,007][106226] Updated weights for policy 0, policy_version 1151710 (0.0010) [2023-12-28 03:32:12,018][106225] Updated weights for policy 1, policy_version 1154847 (0.0006) [2023-12-28 03:32:12,063][106226] Updated weights for policy 0, policy_version 1151720 (0.0007) [2023-12-28 03:32:12,123][106226] Updated weights for policy 0, policy_version 1151730 (0.0009) [2023-12-28 03:32:12,710][106225] Updated weights for policy 1, policy_version 1154857 (0.0007) [2023-12-28 03:32:12,771][106225] Updated weights for policy 1, policy_version 1154867 (0.0008) [2023-12-28 03:32:12,835][106225] Updated weights for policy 1, policy_version 1154877 (0.0006) [2023-12-28 03:32:12,857][106226] Updated weights for policy 0, policy_version 1151740 (0.0007) [2023-12-28 03:32:12,893][106225] Updated weights for policy 1, policy_version 1154887 (0.0007) [2023-12-28 03:32:12,927][106226] Updated weights for policy 0, policy_version 1151750 (0.0006) [2023-12-28 03:32:12,993][106226] Updated weights for policy 0, policy_version 1151760 (0.0007) [2023-12-28 03:32:13,498][106225] Updated weights for policy 1, policy_version 1154897 (0.0010) [2023-12-28 03:32:13,551][106225] Updated weights for policy 1, policy_version 1154907 (0.0010) [2023-12-28 03:32:13,602][106225] Updated weights for policy 1, policy_version 1154917 (0.0010) [2023-12-28 03:32:13,706][106226] Updated weights for policy 0, policy_version 1151770 (0.0009) [2023-12-28 03:32:13,759][106226] Updated weights for policy 0, policy_version 1151780 (0.0008) [2023-12-28 03:32:13,817][106226] Updated weights for policy 0, policy_version 1151790 (0.0009) [2023-12-28 03:32:13,871][106226] Updated weights for policy 0, policy_version 1151800 (0.0009) [2023-12-28 03:32:14,236][106225] Updated weights for policy 1, policy_version 1154927 (0.0010) [2023-12-28 03:32:14,294][106225] Updated weights for policy 1, policy_version 1154937 (0.0010) [2023-12-28 03:32:14,357][106225] Updated weights for policy 1, policy_version 1154947 (0.0010) [2023-12-28 03:32:14,653][106226] Updated weights for policy 0, policy_version 1151810 (0.0008) [2023-12-28 03:32:14,717][106226] Updated weights for policy 0, policy_version 1151820 (0.0008) [2023-12-28 03:32:14,778][106226] Updated weights for policy 0, policy_version 1151830 (0.0007) [2023-12-28 03:32:15,082][106225] Updated weights for policy 1, policy_version 1154957 (0.0009) [2023-12-28 03:32:15,138][106225] Updated weights for policy 1, policy_version 1154967 (0.0008) [2023-12-28 03:32:15,198][106225] Updated weights for policy 1, policy_version 1154977 (0.0008) [2023-12-28 03:32:15,543][106226] Updated weights for policy 0, policy_version 1151840 (0.0010) [2023-12-28 03:32:15,604][106226] Updated weights for policy 0, policy_version 1151850 (0.0009) [2023-12-28 03:32:15,661][106226] Updated weights for policy 0, policy_version 1151860 (0.0008) [2023-12-28 03:32:15,940][106225] Updated weights for policy 1, policy_version 1154987 (0.0008) [2023-12-28 03:32:16,001][106225] Updated weights for policy 1, policy_version 1154997 (0.0010) [2023-12-28 03:32:16,071][106225] Updated weights for policy 1, policy_version 1155007 (0.0007) [2023-12-28 03:32:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 590667776. Throughput: 0: 9828.9, 1: 9893.7. Samples: 590656436. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:16,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.885')] [2023-12-28 03:32:16,388][106226] Updated weights for policy 0, policy_version 1151870 (0.0008) [2023-12-28 03:32:16,449][106226] Updated weights for policy 0, policy_version 1151880 (0.0008) [2023-12-28 03:32:16,505][106226] Updated weights for policy 0, policy_version 1151890 (0.0006) [2023-12-28 03:32:16,774][106225] Updated weights for policy 1, policy_version 1155017 (0.0009) [2023-12-28 03:32:16,839][106225] Updated weights for policy 1, policy_version 1155027 (0.0010) [2023-12-28 03:32:16,900][106225] Updated weights for policy 1, policy_version 1155037 (0.0010) [2023-12-28 03:32:16,961][106225] Updated weights for policy 1, policy_version 1155047 (0.0010) [2023-12-28 03:32:17,239][106226] Updated weights for policy 0, policy_version 1151900 (0.0008) [2023-12-28 03:32:17,293][106226] Updated weights for policy 0, policy_version 1151910 (0.0006) [2023-12-28 03:32:17,342][106226] Updated weights for policy 0, policy_version 1151920 (0.0006) [2023-12-28 03:32:17,575][106225] Updated weights for policy 1, policy_version 1155057 (0.0006) [2023-12-28 03:32:17,628][106225] Updated weights for policy 1, policy_version 1155067 (0.0006) [2023-12-28 03:32:17,677][106225] Updated weights for policy 1, policy_version 1155077 (0.0007) [2023-12-28 03:32:17,983][106226] Updated weights for policy 0, policy_version 1151930 (0.0009) [2023-12-28 03:32:18,047][106226] Updated weights for policy 0, policy_version 1151940 (0.0010) [2023-12-28 03:32:18,114][106226] Updated weights for policy 0, policy_version 1151950 (0.0011) [2023-12-28 03:32:18,161][106226] Updated weights for policy 0, policy_version 1151960 (0.0010) [2023-12-28 03:32:18,325][106225] Updated weights for policy 1, policy_version 1155087 (0.0007) [2023-12-28 03:32:18,393][106225] Updated weights for policy 1, policy_version 1155097 (0.0008) [2023-12-28 03:32:18,444][106225] Updated weights for policy 1, policy_version 1155107 (0.0008) [2023-12-28 03:32:18,875][106226] Updated weights for policy 0, policy_version 1151970 (0.0011) [2023-12-28 03:32:18,936][106226] Updated weights for policy 0, policy_version 1151980 (0.0010) [2023-12-28 03:32:18,999][106226] Updated weights for policy 0, policy_version 1151990 (0.0011) [2023-12-28 03:32:19,162][106225] Updated weights for policy 1, policy_version 1155117 (0.0008) [2023-12-28 03:32:19,213][106225] Updated weights for policy 1, policy_version 1155127 (0.0006) [2023-12-28 03:32:19,282][106225] Updated weights for policy 1, policy_version 1155137 (0.0008) [2023-12-28 03:32:19,743][106226] Updated weights for policy 0, policy_version 1152000 (0.0007) [2023-12-28 03:32:19,813][106226] Updated weights for policy 0, policy_version 1152010 (0.0007) [2023-12-28 03:32:19,886][106226] Updated weights for policy 0, policy_version 1152020 (0.0008) [2023-12-28 03:32:20,091][106225] Updated weights for policy 1, policy_version 1155147 (0.0008) [2023-12-28 03:32:20,155][106225] Updated weights for policy 1, policy_version 1155157 (0.0009) [2023-12-28 03:32:20,224][106225] Updated weights for policy 1, policy_version 1155167 (0.0009) [2023-12-28 03:32:20,540][106226] Updated weights for policy 0, policy_version 1152030 (0.0008) [2023-12-28 03:32:20,613][106226] Updated weights for policy 0, policy_version 1152040 (0.0008) [2023-12-28 03:32:20,672][106226] Updated weights for policy 0, policy_version 1152050 (0.0009) [2023-12-28 03:32:20,944][106225] Updated weights for policy 1, policy_version 1155177 (0.0008) [2023-12-28 03:32:21,015][106225] Updated weights for policy 1, policy_version 1155187 (0.0009) [2023-12-28 03:32:21,083][106225] Updated weights for policy 1, policy_version 1155197 (0.0009) [2023-12-28 03:32:21,151][106225] Updated weights for policy 1, policy_version 1155207 (0.0008) [2023-12-28 03:32:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 590766080. Throughput: 0: 9805.3, 1: 9851.2. Samples: 590773932. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:21,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.136')] [2023-12-28 03:32:21,427][106226] Updated weights for policy 0, policy_version 1152060 (0.0010) [2023-12-28 03:32:21,492][106226] Updated weights for policy 0, policy_version 1152070 (0.0007) [2023-12-28 03:32:21,552][106226] Updated weights for policy 0, policy_version 1152080 (0.0007) [2023-12-28 03:32:21,903][106225] Updated weights for policy 1, policy_version 1155217 (0.0010) [2023-12-28 03:32:21,970][106225] Updated weights for policy 1, policy_version 1155227 (0.0008) [2023-12-28 03:32:22,043][106225] Updated weights for policy 1, policy_version 1155237 (0.0009) [2023-12-28 03:32:22,280][106226] Updated weights for policy 0, policy_version 1152090 (0.0008) [2023-12-28 03:32:22,354][106226] Updated weights for policy 0, policy_version 1152100 (0.0009) [2023-12-28 03:32:22,420][106226] Updated weights for policy 0, policy_version 1152110 (0.0009) [2023-12-28 03:32:22,484][106226] Updated weights for policy 0, policy_version 1152120 (0.0008) [2023-12-28 03:32:22,736][106225] Updated weights for policy 1, policy_version 1155247 (0.0008) [2023-12-28 03:32:22,798][106225] Updated weights for policy 1, policy_version 1155257 (0.0008) [2023-12-28 03:32:22,858][106225] Updated weights for policy 1, policy_version 1155267 (0.0008) [2023-12-28 03:32:23,227][106226] Updated weights for policy 0, policy_version 1152130 (0.0011) [2023-12-28 03:32:23,291][106226] Updated weights for policy 0, policy_version 1152140 (0.0011) [2023-12-28 03:32:23,348][106226] Updated weights for policy 0, policy_version 1152150 (0.0011) [2023-12-28 03:32:23,590][106225] Updated weights for policy 1, policy_version 1155277 (0.0008) [2023-12-28 03:32:23,653][106225] Updated weights for policy 1, policy_version 1155287 (0.0008) [2023-12-28 03:32:23,722][106225] Updated weights for policy 1, policy_version 1155297 (0.0008) [2023-12-28 03:32:24,062][106226] Updated weights for policy 0, policy_version 1152160 (0.0010) [2023-12-28 03:32:24,116][106226] Updated weights for policy 0, policy_version 1152170 (0.0011) [2023-12-28 03:32:24,182][106226] Updated weights for policy 0, policy_version 1152180 (0.0011) [2023-12-28 03:32:24,439][106225] Updated weights for policy 1, policy_version 1155307 (0.0008) [2023-12-28 03:32:24,489][106225] Updated weights for policy 1, policy_version 1155317 (0.0008) [2023-12-28 03:32:24,539][106225] Updated weights for policy 1, policy_version 1155327 (0.0008) [2023-12-28 03:32:24,893][106226] Updated weights for policy 0, policy_version 1152190 (0.0011) [2023-12-28 03:32:24,949][106226] Updated weights for policy 0, policy_version 1152200 (0.0010) [2023-12-28 03:32:24,999][106226] Updated weights for policy 0, policy_version 1152210 (0.0010) [2023-12-28 03:32:25,283][106225] Updated weights for policy 1, policy_version 1155337 (0.0007) [2023-12-28 03:32:25,353][106225] Updated weights for policy 1, policy_version 1155347 (0.0008) [2023-12-28 03:32:25,412][106225] Updated weights for policy 1, policy_version 1155357 (0.0008) [2023-12-28 03:32:25,473][106225] Updated weights for policy 1, policy_version 1155367 (0.0008) [2023-12-28 03:32:25,734][106226] Updated weights for policy 0, policy_version 1152220 (0.0010) [2023-12-28 03:32:25,793][106226] Updated weights for policy 0, policy_version 1152230 (0.0011) [2023-12-28 03:32:25,853][106226] Updated weights for policy 0, policy_version 1152240 (0.0010) [2023-12-28 03:32:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 590856192. Throughput: 0: 9717.6, 1: 9871.0. Samples: 590829964. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:26,175][105115] Avg episode reward: [(0, '-4.223'), (1, '-4.872')] [2023-12-28 03:32:26,177][106225] Updated weights for policy 1, policy_version 1155377 (0.0007) [2023-12-28 03:32:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001152248_295034880.pth... [2023-12-28 03:32:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001151096_294739968.pth [2023-12-28 03:32:26,232][106225] Updated weights for policy 1, policy_version 1155387 (0.0005) [2023-12-28 03:32:26,283][106225] Updated weights for policy 1, policy_version 1155397 (0.0005) [2023-12-28 03:32:26,301][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001155400_295829504.pth... [2023-12-28 03:32:26,304][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001154248_295534592.pth [2023-12-28 03:32:26,544][106226] Updated weights for policy 0, policy_version 1152250 (0.0010) [2023-12-28 03:32:26,595][106226] Updated weights for policy 0, policy_version 1152260 (0.0008) [2023-12-28 03:32:26,644][106226] Updated weights for policy 0, policy_version 1152270 (0.0008) [2023-12-28 03:32:26,687][106226] Updated weights for policy 0, policy_version 1152280 (0.0008) [2023-12-28 03:32:26,962][106225] Updated weights for policy 1, policy_version 1155407 (0.0008) [2023-12-28 03:32:27,011][106225] Updated weights for policy 1, policy_version 1155417 (0.0008) [2023-12-28 03:32:27,068][106225] Updated weights for policy 1, policy_version 1155427 (0.0010) [2023-12-28 03:32:27,368][106226] Updated weights for policy 0, policy_version 1152290 (0.0007) [2023-12-28 03:32:27,414][106226] Updated weights for policy 0, policy_version 1152300 (0.0007) [2023-12-28 03:32:27,471][106226] Updated weights for policy 0, policy_version 1152310 (0.0008) [2023-12-28 03:32:27,777][106225] Updated weights for policy 1, policy_version 1155437 (0.0010) [2023-12-28 03:32:27,824][106225] Updated weights for policy 1, policy_version 1155447 (0.0010) [2023-12-28 03:32:27,870][106225] Updated weights for policy 1, policy_version 1155457 (0.0010) [2023-12-28 03:32:28,208][106226] Updated weights for policy 0, policy_version 1152320 (0.0005) [2023-12-28 03:32:28,254][106226] Updated weights for policy 0, policy_version 1152330 (0.0005) [2023-12-28 03:32:28,311][106226] Updated weights for policy 0, policy_version 1152340 (0.0005) [2023-12-28 03:32:28,514][106225] Updated weights for policy 1, policy_version 1155467 (0.0010) [2023-12-28 03:32:28,566][106225] Updated weights for policy 1, policy_version 1155477 (0.0007) [2023-12-28 03:32:28,626][106225] Updated weights for policy 1, policy_version 1155487 (0.0006) [2023-12-28 03:32:28,940][106226] Updated weights for policy 0, policy_version 1152350 (0.0009) [2023-12-28 03:32:28,992][106226] Updated weights for policy 0, policy_version 1152360 (0.0010) [2023-12-28 03:32:29,045][106226] Updated weights for policy 0, policy_version 1152370 (0.0006) [2023-12-28 03:32:29,254][106225] Updated weights for policy 1, policy_version 1155497 (0.0006) [2023-12-28 03:32:29,323][106225] Updated weights for policy 1, policy_version 1155507 (0.0008) [2023-12-28 03:32:29,399][106225] Updated weights for policy 1, policy_version 1155517 (0.0008) [2023-12-28 03:32:29,467][106225] Updated weights for policy 1, policy_version 1155527 (0.0010) [2023-12-28 03:32:29,752][106226] Updated weights for policy 0, policy_version 1152380 (0.0005) [2023-12-28 03:32:29,815][106226] Updated weights for policy 0, policy_version 1152390 (0.0007) [2023-12-28 03:32:29,882][106226] Updated weights for policy 0, policy_version 1152400 (0.0009) [2023-12-28 03:32:30,224][106225] Updated weights for policy 1, policy_version 1155537 (0.0010) [2023-12-28 03:32:30,288][106225] Updated weights for policy 1, policy_version 1155547 (0.0010) [2023-12-28 03:32:30,352][106225] Updated weights for policy 1, policy_version 1155557 (0.0009) [2023-12-28 03:32:30,612][106226] Updated weights for policy 0, policy_version 1152410 (0.0008) [2023-12-28 03:32:30,666][106226] Updated weights for policy 0, policy_version 1152420 (0.0011) [2023-12-28 03:32:30,723][106226] Updated weights for policy 0, policy_version 1152430 (0.0010) [2023-12-28 03:32:30,782][106226] Updated weights for policy 0, policy_version 1152440 (0.0010) [2023-12-28 03:32:30,993][106225] Updated weights for policy 1, policy_version 1155567 (0.0009) [2023-12-28 03:32:31,063][106225] Updated weights for policy 1, policy_version 1155577 (0.0009) [2023-12-28 03:32:31,122][106225] Updated weights for policy 1, policy_version 1155587 (0.0010) [2023-12-28 03:32:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 590962688. Throughput: 0: 9790.3, 1: 9886.2. Samples: 590949868. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:31,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.709')] [2023-12-28 03:32:31,531][106226] Updated weights for policy 0, policy_version 1152450 (0.0011) [2023-12-28 03:32:31,578][106226] Updated weights for policy 0, policy_version 1152460 (0.0010) [2023-12-28 03:32:31,634][106226] Updated weights for policy 0, policy_version 1152470 (0.0011) [2023-12-28 03:32:31,897][106225] Updated weights for policy 1, policy_version 1155597 (0.0010) [2023-12-28 03:32:31,954][106225] Updated weights for policy 1, policy_version 1155607 (0.0010) [2023-12-28 03:32:32,012][106225] Updated weights for policy 1, policy_version 1155617 (0.0008) [2023-12-28 03:32:32,347][106226] Updated weights for policy 0, policy_version 1152480 (0.0009) [2023-12-28 03:32:32,409][106226] Updated weights for policy 0, policy_version 1152490 (0.0008) [2023-12-28 03:32:32,463][106226] Updated weights for policy 0, policy_version 1152500 (0.0008) [2023-12-28 03:32:32,732][106225] Updated weights for policy 1, policy_version 1155627 (0.0008) [2023-12-28 03:32:32,792][106225] Updated weights for policy 1, policy_version 1155637 (0.0010) [2023-12-28 03:32:32,847][106225] Updated weights for policy 1, policy_version 1155647 (0.0010) [2023-12-28 03:32:33,213][106226] Updated weights for policy 0, policy_version 1152510 (0.0006) [2023-12-28 03:32:33,262][106226] Updated weights for policy 0, policy_version 1152520 (0.0005) [2023-12-28 03:32:33,309][106226] Updated weights for policy 0, policy_version 1152530 (0.0008) [2023-12-28 03:32:33,493][106225] Updated weights for policy 1, policy_version 1155658 (0.0007) [2023-12-28 03:32:33,550][106225] Updated weights for policy 1, policy_version 1155668 (0.0010) [2023-12-28 03:32:33,601][106225] Updated weights for policy 1, policy_version 1155678 (0.0006) [2023-12-28 03:32:33,648][106225] Updated weights for policy 1, policy_version 1155688 (0.0005) [2023-12-28 03:32:33,853][106226] Updated weights for policy 0, policy_version 1152540 (0.0006) [2023-12-28 03:32:33,911][106226] Updated weights for policy 0, policy_version 1152550 (0.0008) [2023-12-28 03:32:33,964][106226] Updated weights for policy 0, policy_version 1152560 (0.0008) [2023-12-28 03:32:34,207][106225] Updated weights for policy 1, policy_version 1155698 (0.0006) [2023-12-28 03:32:34,264][106225] Updated weights for policy 1, policy_version 1155708 (0.0010) [2023-12-28 03:32:34,331][106225] Updated weights for policy 1, policy_version 1155718 (0.0008) [2023-12-28 03:32:34,787][106226] Updated weights for policy 0, policy_version 1152570 (0.0009) [2023-12-28 03:32:34,849][106226] Updated weights for policy 0, policy_version 1152580 (0.0005) [2023-12-28 03:32:34,911][106226] Updated weights for policy 0, policy_version 1152590 (0.0005) [2023-12-28 03:32:34,961][106226] Updated weights for policy 0, policy_version 1152600 (0.0005) [2023-12-28 03:32:34,969][106225] Updated weights for policy 1, policy_version 1155728 (0.0010) [2023-12-28 03:32:35,030][106225] Updated weights for policy 1, policy_version 1155738 (0.0010) [2023-12-28 03:32:35,094][106225] Updated weights for policy 1, policy_version 1155748 (0.0010) [2023-12-28 03:32:35,507][106226] Updated weights for policy 0, policy_version 1152610 (0.0005) [2023-12-28 03:32:35,561][106226] Updated weights for policy 0, policy_version 1152620 (0.0007) [2023-12-28 03:32:35,618][106226] Updated weights for policy 0, policy_version 1152630 (0.0008) [2023-12-28 03:32:35,806][106225] Updated weights for policy 1, policy_version 1155758 (0.0010) [2023-12-28 03:32:35,857][106225] Updated weights for policy 1, policy_version 1155768 (0.0010) [2023-12-28 03:32:35,921][106225] Updated weights for policy 1, policy_version 1155778 (0.0011) [2023-12-28 03:32:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 591060992. Throughput: 0: 9921.9, 1: 9908.5. Samples: 591071800. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:36,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.714')] [2023-12-28 03:32:36,306][106226] Updated weights for policy 0, policy_version 1152640 (0.0008) [2023-12-28 03:32:36,353][106226] Updated weights for policy 0, policy_version 1152650 (0.0007) [2023-12-28 03:32:36,416][106226] Updated weights for policy 0, policy_version 1152660 (0.0008) [2023-12-28 03:32:36,636][106225] Updated weights for policy 1, policy_version 1155788 (0.0009) [2023-12-28 03:32:36,708][106225] Updated weights for policy 1, policy_version 1155798 (0.0008) [2023-12-28 03:32:36,762][106225] Updated weights for policy 1, policy_version 1155808 (0.0007) [2023-12-28 03:32:37,159][106226] Updated weights for policy 0, policy_version 1152670 (0.0008) [2023-12-28 03:32:37,220][106226] Updated weights for policy 0, policy_version 1152680 (0.0008) [2023-12-28 03:32:37,275][106226] Updated weights for policy 0, policy_version 1152690 (0.0010) [2023-12-28 03:32:37,411][106225] Updated weights for policy 1, policy_version 1155818 (0.0006) [2023-12-28 03:32:37,475][106225] Updated weights for policy 1, policy_version 1155828 (0.0005) [2023-12-28 03:32:37,537][106225] Updated weights for policy 1, policy_version 1155838 (0.0005) [2023-12-28 03:32:37,600][106225] Updated weights for policy 1, policy_version 1155848 (0.0005) [2023-12-28 03:32:37,958][106226] Updated weights for policy 0, policy_version 1152700 (0.0008) [2023-12-28 03:32:38,019][106226] Updated weights for policy 0, policy_version 1152710 (0.0006) [2023-12-28 03:32:38,082][106226] Updated weights for policy 0, policy_version 1152720 (0.0008) [2023-12-28 03:32:38,165][106225] Updated weights for policy 1, policy_version 1155858 (0.0010) [2023-12-28 03:32:38,213][106225] Updated weights for policy 1, policy_version 1155868 (0.0008) [2023-12-28 03:32:38,263][106225] Updated weights for policy 1, policy_version 1155878 (0.0005) [2023-12-28 03:32:38,766][106226] Updated weights for policy 0, policy_version 1152730 (0.0008) [2023-12-28 03:32:38,820][106226] Updated weights for policy 0, policy_version 1152740 (0.0011) [2023-12-28 03:32:38,873][106225] Updated weights for policy 1, policy_version 1155888 (0.0006) [2023-12-28 03:32:38,875][106226] Updated weights for policy 0, policy_version 1152750 (0.0011) [2023-12-28 03:32:38,933][106225] Updated weights for policy 1, policy_version 1155898 (0.0006) [2023-12-28 03:32:38,933][106226] Updated weights for policy 0, policy_version 1152760 (0.0011) [2023-12-28 03:32:38,995][106225] Updated weights for policy 1, policy_version 1155908 (0.0008) [2023-12-28 03:32:39,711][106226] Updated weights for policy 0, policy_version 1152770 (0.0011) [2023-12-28 03:32:39,773][106226] Updated weights for policy 0, policy_version 1152780 (0.0011) [2023-12-28 03:32:39,778][106225] Updated weights for policy 1, policy_version 1155918 (0.0007) [2023-12-28 03:32:39,838][106226] Updated weights for policy 0, policy_version 1152790 (0.0011) [2023-12-28 03:32:39,842][106225] Updated weights for policy 1, policy_version 1155928 (0.0007) [2023-12-28 03:32:39,900][106225] Updated weights for policy 1, policy_version 1155938 (0.0008) [2023-12-28 03:32:40,606][106226] Updated weights for policy 0, policy_version 1152800 (0.0007) [2023-12-28 03:32:40,675][106225] Updated weights for policy 1, policy_version 1155948 (0.0008) [2023-12-28 03:32:40,676][106226] Updated weights for policy 0, policy_version 1152810 (0.0005) [2023-12-28 03:32:40,733][106225] Updated weights for policy 1, policy_version 1155958 (0.0009) [2023-12-28 03:32:40,736][106226] Updated weights for policy 0, policy_version 1152820 (0.0007) [2023-12-28 03:32:40,793][106225] Updated weights for policy 1, policy_version 1155968 (0.0008) [2023-12-28 03:32:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 591159296. Throughput: 0: 9925.4, 1: 9969.8. Samples: 591133088. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:41,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-4.657')] [2023-12-28 03:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001155976_295976960.pth... [2023-12-28 03:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001152824_295182336.pth... [2023-12-28 03:32:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001151704_294895616.pth [2023-12-28 03:32:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001154824_295682048.pth [2023-12-28 03:32:41,383][106226] Updated weights for policy 0, policy_version 1152830 (0.0009) [2023-12-28 03:32:41,446][106226] Updated weights for policy 0, policy_version 1152840 (0.0007) [2023-12-28 03:32:41,501][106226] Updated weights for policy 0, policy_version 1152850 (0.0011) [2023-12-28 03:32:41,606][106225] Updated weights for policy 1, policy_version 1155978 (0.0008) [2023-12-28 03:32:41,680][106225] Updated weights for policy 1, policy_version 1155988 (0.0008) [2023-12-28 03:32:41,743][106225] Updated weights for policy 1, policy_version 1155998 (0.0008) [2023-12-28 03:32:41,808][106225] Updated weights for policy 1, policy_version 1156008 (0.0009) [2023-12-28 03:32:42,197][106226] Updated weights for policy 0, policy_version 1152860 (0.0011) [2023-12-28 03:32:42,257][106226] Updated weights for policy 0, policy_version 1152870 (0.0011) [2023-12-28 03:32:42,322][106226] Updated weights for policy 0, policy_version 1152880 (0.0010) [2023-12-28 03:32:42,571][106225] Updated weights for policy 1, policy_version 1156018 (0.0008) [2023-12-28 03:32:42,635][106225] Updated weights for policy 1, policy_version 1156028 (0.0008) [2023-12-28 03:32:42,697][106225] Updated weights for policy 1, policy_version 1156038 (0.0008) [2023-12-28 03:32:43,020][106226] Updated weights for policy 0, policy_version 1152890 (0.0008) [2023-12-28 03:32:43,075][106226] Updated weights for policy 0, policy_version 1152900 (0.0008) [2023-12-28 03:32:43,139][106226] Updated weights for policy 0, policy_version 1152910 (0.0009) [2023-12-28 03:32:43,196][106226] Updated weights for policy 0, policy_version 1152920 (0.0006) [2023-12-28 03:32:43,477][106225] Updated weights for policy 1, policy_version 1156048 (0.0008) [2023-12-28 03:32:43,529][106225] Updated weights for policy 1, policy_version 1156058 (0.0008) [2023-12-28 03:32:43,581][106225] Updated weights for policy 1, policy_version 1156068 (0.0008) [2023-12-28 03:32:43,815][106226] Updated weights for policy 0, policy_version 1152930 (0.0005) [2023-12-28 03:32:43,872][106226] Updated weights for policy 0, policy_version 1152940 (0.0005) [2023-12-28 03:32:43,920][106226] Updated weights for policy 0, policy_version 1152950 (0.0005) [2023-12-28 03:32:44,419][106225] Updated weights for policy 1, policy_version 1156078 (0.0009) [2023-12-28 03:32:44,457][106226] Updated weights for policy 0, policy_version 1152960 (0.0005) [2023-12-28 03:32:44,469][106225] Updated weights for policy 1, policy_version 1156088 (0.0008) [2023-12-28 03:32:44,514][106226] Updated weights for policy 0, policy_version 1152970 (0.0005) [2023-12-28 03:32:44,522][106225] Updated weights for policy 1, policy_version 1156098 (0.0008) [2023-12-28 03:32:44,567][106226] Updated weights for policy 0, policy_version 1152980 (0.0008) [2023-12-28 03:32:45,264][106226] Updated weights for policy 0, policy_version 1152990 (0.0010) [2023-12-28 03:32:45,326][106226] Updated weights for policy 0, policy_version 1153000 (0.0007) [2023-12-28 03:32:45,329][106225] Updated weights for policy 1, policy_version 1156108 (0.0007) [2023-12-28 03:32:45,381][106225] Updated weights for policy 1, policy_version 1156118 (0.0008) [2023-12-28 03:32:45,391][106226] Updated weights for policy 0, policy_version 1153010 (0.0011) [2023-12-28 03:32:45,435][106225] Updated weights for policy 1, policy_version 1156128 (0.0009) [2023-12-28 03:32:46,020][106226] Updated weights for policy 0, policy_version 1153020 (0.0010) [2023-12-28 03:32:46,074][106226] Updated weights for policy 0, policy_version 1153030 (0.0006) [2023-12-28 03:32:46,109][106225] Updated weights for policy 1, policy_version 1156138 (0.0005) [2023-12-28 03:32:46,122][106226] Updated weights for policy 0, policy_version 1153040 (0.0009) [2023-12-28 03:32:46,174][106225] Updated weights for policy 1, policy_version 1156148 (0.0007) [2023-12-28 03:32:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 591257600. Throughput: 0: 9902.5, 1: 9804.3. Samples: 591247648. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:46,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.815')] [2023-12-28 03:32:46,248][106225] Updated weights for policy 1, policy_version 1156158 (0.0008) [2023-12-28 03:32:46,307][106225] Updated weights for policy 1, policy_version 1156168 (0.0008) [2023-12-28 03:32:46,856][106226] Updated weights for policy 0, policy_version 1153050 (0.0007) [2023-12-28 03:32:46,913][106226] Updated weights for policy 0, policy_version 1153061 (0.0009) [2023-12-28 03:32:46,970][106226] Updated weights for policy 0, policy_version 1153071 (0.0006) [2023-12-28 03:32:47,031][106225] Updated weights for policy 1, policy_version 1156178 (0.0008) [2023-12-28 03:32:47,084][106225] Updated weights for policy 1, policy_version 1156188 (0.0009) [2023-12-28 03:32:47,137][106225] Updated weights for policy 1, policy_version 1156198 (0.0009) [2023-12-28 03:32:47,592][106226] Updated weights for policy 0, policy_version 1153081 (0.0006) [2023-12-28 03:32:47,641][106226] Updated weights for policy 0, policy_version 1153091 (0.0008) [2023-12-28 03:32:47,701][106226] Updated weights for policy 0, policy_version 1153101 (0.0008) [2023-12-28 03:32:47,753][106226] Updated weights for policy 0, policy_version 1153111 (0.0006) [2023-12-28 03:32:47,766][106225] Updated weights for policy 1, policy_version 1156208 (0.0009) [2023-12-28 03:32:47,828][106225] Updated weights for policy 1, policy_version 1156218 (0.0008) [2023-12-28 03:32:47,881][106225] Updated weights for policy 1, policy_version 1156228 (0.0009) [2023-12-28 03:32:48,451][106226] Updated weights for policy 0, policy_version 1153121 (0.0008) [2023-12-28 03:32:48,513][106226] Updated weights for policy 0, policy_version 1153131 (0.0010) [2023-12-28 03:32:48,567][106226] Updated weights for policy 0, policy_version 1153141 (0.0008) [2023-12-28 03:32:48,594][106225] Updated weights for policy 1, policy_version 1156238 (0.0006) [2023-12-28 03:32:48,654][106225] Updated weights for policy 1, policy_version 1156248 (0.0008) [2023-12-28 03:32:48,704][106225] Updated weights for policy 1, policy_version 1156258 (0.0009) [2023-12-28 03:32:49,310][106226] Updated weights for policy 0, policy_version 1153151 (0.0009) [2023-12-28 03:32:49,374][106226] Updated weights for policy 0, policy_version 1153161 (0.0010) [2023-12-28 03:32:49,429][106226] Updated weights for policy 0, policy_version 1153171 (0.0008) [2023-12-28 03:32:49,492][106225] Updated weights for policy 1, policy_version 1156268 (0.0008) [2023-12-28 03:32:49,541][106225] Updated weights for policy 1, policy_version 1156278 (0.0008) [2023-12-28 03:32:49,598][106225] Updated weights for policy 1, policy_version 1156288 (0.0009) [2023-12-28 03:32:50,160][106226] Updated weights for policy 0, policy_version 1153181 (0.0008) [2023-12-28 03:32:50,216][106226] Updated weights for policy 0, policy_version 1153191 (0.0008) [2023-12-28 03:32:50,283][106226] Updated weights for policy 0, policy_version 1153201 (0.0008) [2023-12-28 03:32:50,402][106225] Updated weights for policy 1, policy_version 1156298 (0.0009) [2023-12-28 03:32:50,457][106225] Updated weights for policy 1, policy_version 1156308 (0.0008) [2023-12-28 03:32:50,520][106225] Updated weights for policy 1, policy_version 1156318 (0.0007) [2023-12-28 03:32:50,586][106225] Updated weights for policy 1, policy_version 1156328 (0.0006) [2023-12-28 03:32:51,012][106226] Updated weights for policy 0, policy_version 1153211 (0.0009) [2023-12-28 03:32:51,079][106226] Updated weights for policy 0, policy_version 1153221 (0.0009) [2023-12-28 03:32:51,143][106226] Updated weights for policy 0, policy_version 1153231 (0.0008) [2023-12-28 03:32:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 591347712. Throughput: 0: 9813.5, 1: 9813.8. Samples: 591364388. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:51,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.814')] [2023-12-28 03:32:51,332][106225] Updated weights for policy 1, policy_version 1156338 (0.0009) [2023-12-28 03:32:51,402][106225] Updated weights for policy 1, policy_version 1156348 (0.0009) [2023-12-28 03:32:51,458][106225] Updated weights for policy 1, policy_version 1156358 (0.0008) [2023-12-28 03:32:51,877][106226] Updated weights for policy 0, policy_version 1153241 (0.0009) [2023-12-28 03:32:51,939][106226] Updated weights for policy 0, policy_version 1153251 (0.0008) [2023-12-28 03:32:51,996][106226] Updated weights for policy 0, policy_version 1153261 (0.0009) [2023-12-28 03:32:52,060][106226] Updated weights for policy 0, policy_version 1153271 (0.0009) [2023-12-28 03:32:52,300][106225] Updated weights for policy 1, policy_version 1156368 (0.0009) [2023-12-28 03:32:52,367][106225] Updated weights for policy 1, policy_version 1156378 (0.0009) [2023-12-28 03:32:52,434][106225] Updated weights for policy 1, policy_version 1156388 (0.0007) [2023-12-28 03:32:52,761][106226] Updated weights for policy 0, policy_version 1153281 (0.0008) [2023-12-28 03:32:52,833][106226] Updated weights for policy 0, policy_version 1153291 (0.0009) [2023-12-28 03:32:52,891][106226] Updated weights for policy 0, policy_version 1153301 (0.0009) [2023-12-28 03:32:53,074][106225] Updated weights for policy 1, policy_version 1156398 (0.0009) [2023-12-28 03:32:53,130][106225] Updated weights for policy 1, policy_version 1156408 (0.0010) [2023-12-28 03:32:53,183][106225] Updated weights for policy 1, policy_version 1156418 (0.0010) [2023-12-28 03:32:53,553][106226] Updated weights for policy 0, policy_version 1153311 (0.0007) [2023-12-28 03:32:53,615][106226] Updated weights for policy 0, policy_version 1153321 (0.0005) [2023-12-28 03:32:53,668][106226] Updated weights for policy 0, policy_version 1153331 (0.0005) [2023-12-28 03:32:53,894][106225] Updated weights for policy 1, policy_version 1156428 (0.0010) [2023-12-28 03:32:53,957][106225] Updated weights for policy 1, policy_version 1156438 (0.0010) [2023-12-28 03:32:54,016][106225] Updated weights for policy 1, policy_version 1156448 (0.0010) [2023-12-28 03:32:54,298][106226] Updated weights for policy 0, policy_version 1153341 (0.0008) [2023-12-28 03:32:54,362][106226] Updated weights for policy 0, policy_version 1153351 (0.0009) [2023-12-28 03:32:54,415][106226] Updated weights for policy 0, policy_version 1153361 (0.0008) [2023-12-28 03:32:54,696][106225] Updated weights for policy 1, policy_version 1156458 (0.0009) [2023-12-28 03:32:54,751][106225] Updated weights for policy 1, policy_version 1156468 (0.0005) [2023-12-28 03:32:54,803][106225] Updated weights for policy 1, policy_version 1156478 (0.0010) [2023-12-28 03:32:54,856][106225] Updated weights for policy 1, policy_version 1156488 (0.0010) [2023-12-28 03:32:55,057][106226] Updated weights for policy 0, policy_version 1153371 (0.0009) [2023-12-28 03:32:55,111][106226] Updated weights for policy 0, policy_version 1153381 (0.0006) [2023-12-28 03:32:55,166][106226] Updated weights for policy 0, policy_version 1153391 (0.0007) [2023-12-28 03:32:55,569][106225] Updated weights for policy 1, policy_version 1156498 (0.0010) [2023-12-28 03:32:55,635][106225] Updated weights for policy 1, policy_version 1156508 (0.0007) [2023-12-28 03:32:55,696][106225] Updated weights for policy 1, policy_version 1156518 (0.0008) [2023-12-28 03:32:55,719][106226] Updated weights for policy 0, policy_version 1153401 (0.0006) [2023-12-28 03:32:55,775][106226] Updated weights for policy 0, policy_version 1153411 (0.0008) [2023-12-28 03:32:55,829][106226] Updated weights for policy 0, policy_version 1153421 (0.0008) [2023-12-28 03:32:55,881][106226] Updated weights for policy 0, policy_version 1153431 (0.0007) [2023-12-28 03:32:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 591454208. Throughput: 0: 9805.6, 1: 9769.7. Samples: 591422716. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:32:56,175][105115] Avg episode reward: [(0, '-4.115'), (1, '-4.509')] [2023-12-28 03:32:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001153432_295337984.pth... [2023-12-28 03:32:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001156520_296116224.pth... [2023-12-28 03:32:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001152248_295034880.pth [2023-12-28 03:32:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001155400_295829504.pth [2023-12-28 03:32:56,375][106225] Updated weights for policy 1, policy_version 1156528 (0.0010) [2023-12-28 03:32:56,420][106225] Updated weights for policy 1, policy_version 1156538 (0.0010) [2023-12-28 03:32:56,476][106225] Updated weights for policy 1, policy_version 1156548 (0.0010) [2023-12-28 03:32:56,495][106226] Updated weights for policy 0, policy_version 1153441 (0.0006) [2023-12-28 03:32:56,547][106226] Updated weights for policy 0, policy_version 1153451 (0.0007) [2023-12-28 03:32:56,598][106226] Updated weights for policy 0, policy_version 1153461 (0.0007) [2023-12-28 03:32:57,179][106225] Updated weights for policy 1, policy_version 1156558 (0.0007) [2023-12-28 03:32:57,243][106225] Updated weights for policy 1, policy_version 1156568 (0.0006) [2023-12-28 03:32:57,247][106226] Updated weights for policy 0, policy_version 1153471 (0.0007) [2023-12-28 03:32:57,308][106225] Updated weights for policy 1, policy_version 1156578 (0.0007) [2023-12-28 03:32:57,310][106226] Updated weights for policy 0, policy_version 1153481 (0.0006) [2023-12-28 03:32:57,366][106226] Updated weights for policy 0, policy_version 1153491 (0.0006) [2023-12-28 03:32:57,887][106225] Updated weights for policy 1, policy_version 1156588 (0.0005) [2023-12-28 03:32:57,900][106226] Updated weights for policy 0, policy_version 1153501 (0.0007) [2023-12-28 03:32:57,937][106225] Updated weights for policy 1, policy_version 1156598 (0.0005) [2023-12-28 03:32:57,955][106226] Updated weights for policy 0, policy_version 1153511 (0.0007) [2023-12-28 03:32:57,988][106225] Updated weights for policy 1, policy_version 1156608 (0.0005) [2023-12-28 03:32:58,015][106226] Updated weights for policy 0, policy_version 1153521 (0.0007) [2023-12-28 03:32:58,735][106225] Updated weights for policy 1, policy_version 1156618 (0.0007) [2023-12-28 03:32:58,735][106226] Updated weights for policy 0, policy_version 1153531 (0.0008) [2023-12-28 03:32:58,796][106225] Updated weights for policy 1, policy_version 1156628 (0.0009) [2023-12-28 03:32:58,805][106226] Updated weights for policy 0, policy_version 1153541 (0.0008) [2023-12-28 03:32:58,863][106225] Updated weights for policy 1, policy_version 1156638 (0.0008) [2023-12-28 03:32:58,876][106226] Updated weights for policy 0, policy_version 1153551 (0.0009) [2023-12-28 03:32:58,934][106225] Updated weights for policy 1, policy_version 1156648 (0.0008) [2023-12-28 03:32:59,699][106226] Updated weights for policy 0, policy_version 1153561 (0.0009) [2023-12-28 03:32:59,733][106225] Updated weights for policy 1, policy_version 1156658 (0.0006) [2023-12-28 03:32:59,762][106226] Updated weights for policy 0, policy_version 1153571 (0.0008) [2023-12-28 03:32:59,784][106225] Updated weights for policy 1, policy_version 1156668 (0.0005) [2023-12-28 03:32:59,823][106226] Updated weights for policy 0, policy_version 1153581 (0.0008) [2023-12-28 03:32:59,839][106225] Updated weights for policy 1, policy_version 1156678 (0.0007) [2023-12-28 03:32:59,894][106226] Updated weights for policy 0, policy_version 1153591 (0.0008) [2023-12-28 03:33:00,526][106225] Updated weights for policy 1, policy_version 1156688 (0.0009) [2023-12-28 03:33:00,586][106225] Updated weights for policy 1, policy_version 1156698 (0.0008) [2023-12-28 03:33:00,644][106225] Updated weights for policy 1, policy_version 1156708 (0.0007) [2023-12-28 03:33:00,650][106226] Updated weights for policy 0, policy_version 1153601 (0.0007) [2023-12-28 03:33:00,695][106226] Updated weights for policy 0, policy_version 1153611 (0.0007) [2023-12-28 03:33:00,743][106226] Updated weights for policy 0, policy_version 1153621 (0.0008) [2023-12-28 03:33:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 591552512. Throughput: 0: 9995.4, 1: 9744.7. Samples: 591544740. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:33:01,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.951')] [2023-12-28 03:33:01,408][106225] Updated weights for policy 1, policy_version 1156718 (0.0008) [2023-12-28 03:33:01,447][106226] Updated weights for policy 0, policy_version 1153631 (0.0008) [2023-12-28 03:33:01,465][106225] Updated weights for policy 1, policy_version 1156728 (0.0006) [2023-12-28 03:33:01,502][106226] Updated weights for policy 0, policy_version 1153641 (0.0007) [2023-12-28 03:33:01,520][106225] Updated weights for policy 1, policy_version 1156738 (0.0006) [2023-12-28 03:33:01,557][106226] Updated weights for policy 0, policy_version 1153651 (0.0008) [2023-12-28 03:33:02,253][106225] Updated weights for policy 1, policy_version 1156748 (0.0007) [2023-12-28 03:33:02,293][106226] Updated weights for policy 0, policy_version 1153661 (0.0007) [2023-12-28 03:33:02,315][106225] Updated weights for policy 1, policy_version 1156758 (0.0007) [2023-12-28 03:33:02,348][106226] Updated weights for policy 0, policy_version 1153671 (0.0006) [2023-12-28 03:33:02,375][106225] Updated weights for policy 1, policy_version 1156768 (0.0007) [2023-12-28 03:33:02,420][106226] Updated weights for policy 0, policy_version 1153681 (0.0007) [2023-12-28 03:33:02,974][106225] Updated weights for policy 1, policy_version 1156778 (0.0007) [2023-12-28 03:33:02,977][106226] Updated weights for policy 0, policy_version 1153691 (0.0006) [2023-12-28 03:33:03,035][106225] Updated weights for policy 1, policy_version 1156788 (0.0008) [2023-12-28 03:33:03,037][106226] Updated weights for policy 0, policy_version 1153701 (0.0005) [2023-12-28 03:33:03,097][106226] Updated weights for policy 0, policy_version 1153711 (0.0005) [2023-12-28 03:33:03,099][106225] Updated weights for policy 1, policy_version 1156798 (0.0008) [2023-12-28 03:33:03,162][106225] Updated weights for policy 1, policy_version 1156808 (0.0007) [2023-12-28 03:33:03,741][106225] Updated weights for policy 1, policy_version 1156818 (0.0005) [2023-12-28 03:33:03,796][106225] Updated weights for policy 1, policy_version 1156828 (0.0005) [2023-12-28 03:33:03,856][106225] Updated weights for policy 1, policy_version 1156838 (0.0008) [2023-12-28 03:33:03,868][106226] Updated weights for policy 0, policy_version 1153721 (0.0006) [2023-12-28 03:33:03,930][106226] Updated weights for policy 0, policy_version 1153731 (0.0006) [2023-12-28 03:33:03,986][106226] Updated weights for policy 0, policy_version 1153741 (0.0008) [2023-12-28 03:33:04,053][106226] Updated weights for policy 0, policy_version 1153751 (0.0008) [2023-12-28 03:33:04,532][106225] Updated weights for policy 1, policy_version 1156848 (0.0009) [2023-12-28 03:33:04,585][106225] Updated weights for policy 1, policy_version 1156858 (0.0008) [2023-12-28 03:33:04,643][106225] Updated weights for policy 1, policy_version 1156868 (0.0009) [2023-12-28 03:33:04,739][106226] Updated weights for policy 0, policy_version 1153761 (0.0009) [2023-12-28 03:33:04,799][106226] Updated weights for policy 0, policy_version 1153771 (0.0009) [2023-12-28 03:33:04,864][106226] Updated weights for policy 0, policy_version 1153781 (0.0009) [2023-12-28 03:33:05,360][106225] Updated weights for policy 1, policy_version 1156878 (0.0008) [2023-12-28 03:33:05,406][106225] Updated weights for policy 1, policy_version 1156888 (0.0008) [2023-12-28 03:33:05,458][106225] Updated weights for policy 1, policy_version 1156898 (0.0009) [2023-12-28 03:33:05,582][106226] Updated weights for policy 0, policy_version 1153791 (0.0010) [2023-12-28 03:33:05,638][106226] Updated weights for policy 0, policy_version 1153801 (0.0010) [2023-12-28 03:33:05,698][106226] Updated weights for policy 0, policy_version 1153811 (0.0010) [2023-12-28 03:33:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 591650816. Throughput: 0: 10011.0, 1: 9781.9. Samples: 591664616. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-28 03:33:06,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.746')] [2023-12-28 03:33:06,182][106225] Updated weights for policy 1, policy_version 1156908 (0.0010) [2023-12-28 03:33:06,251][106225] Updated weights for policy 1, policy_version 1156918 (0.0010) [2023-12-28 03:33:06,319][106225] Updated weights for policy 1, policy_version 1156928 (0.0010) [2023-12-28 03:33:06,402][106226] Updated weights for policy 0, policy_version 1153821 (0.0009) [2023-12-28 03:33:06,466][106226] Updated weights for policy 0, policy_version 1153831 (0.0007) [2023-12-28 03:33:06,530][106226] Updated weights for policy 0, policy_version 1153841 (0.0008) [2023-12-28 03:33:06,935][106225] Updated weights for policy 1, policy_version 1156938 (0.0010) [2023-12-28 03:33:07,002][106225] Updated weights for policy 1, policy_version 1156948 (0.0006) [2023-12-28 03:33:07,063][106225] Updated weights for policy 1, policy_version 1156958 (0.0006) [2023-12-28 03:33:07,127][106225] Updated weights for policy 1, policy_version 1156968 (0.0006) [2023-12-28 03:33:07,349][106226] Updated weights for policy 0, policy_version 1153851 (0.0010) [2023-12-28 03:33:07,414][106226] Updated weights for policy 0, policy_version 1153861 (0.0009) [2023-12-28 03:33:07,474][106226] Updated weights for policy 0, policy_version 1153871 (0.0008) [2023-12-28 03:33:07,686][106225] Updated weights for policy 1, policy_version 1156978 (0.0006) [2023-12-28 03:33:07,749][106225] Updated weights for policy 1, policy_version 1156988 (0.0008) [2023-12-28 03:33:07,811][106225] Updated weights for policy 1, policy_version 1156998 (0.0009) [2023-12-28 03:33:08,173][106226] Updated weights for policy 0, policy_version 1153881 (0.0008) [2023-12-28 03:33:08,227][106226] Updated weights for policy 0, policy_version 1153891 (0.0007) [2023-12-28 03:33:08,285][106226] Updated weights for policy 0, policy_version 1153901 (0.0007) [2023-12-28 03:33:08,416][106225] Updated weights for policy 1, policy_version 1157008 (0.0010) [2023-12-28 03:33:08,477][106225] Updated weights for policy 1, policy_version 1157018 (0.0010) [2023-12-28 03:33:08,541][106225] Updated weights for policy 1, policy_version 1157028 (0.0011) [2023-12-28 03:33:09,071][106226] Updated weights for policy 0, policy_version 1153914 (0.0008) [2023-12-28 03:33:09,128][106226] Updated weights for policy 0, policy_version 1153924 (0.0010) [2023-12-28 03:33:09,173][106225] Updated weights for policy 1, policy_version 1157038 (0.0009) [2023-12-28 03:33:09,186][106226] Updated weights for policy 0, policy_version 1153934 (0.0008) [2023-12-28 03:33:09,226][106225] Updated weights for policy 1, policy_version 1157048 (0.0007) [2023-12-28 03:33:09,248][106226] Updated weights for policy 0, policy_version 1153944 (0.0007) [2023-12-28 03:33:09,288][106225] Updated weights for policy 1, policy_version 1157058 (0.0009) [2023-12-28 03:33:09,998][106226] Updated weights for policy 0, policy_version 1153954 (0.0008) [2023-12-28 03:33:10,063][106226] Updated weights for policy 0, policy_version 1153964 (0.0008) [2023-12-28 03:33:10,069][106225] Updated weights for policy 1, policy_version 1157068 (0.0008) [2023-12-28 03:33:10,126][106226] Updated weights for policy 0, policy_version 1153974 (0.0009) [2023-12-28 03:33:10,132][106225] Updated weights for policy 1, policy_version 1157078 (0.0006) [2023-12-28 03:33:10,195][106225] Updated weights for policy 1, policy_version 1157088 (0.0009) [2023-12-28 03:33:10,793][106226] Updated weights for policy 0, policy_version 1153984 (0.0005) [2023-12-28 03:33:10,853][106226] Updated weights for policy 0, policy_version 1153994 (0.0005) [2023-12-28 03:33:10,914][106226] Updated weights for policy 0, policy_version 1154004 (0.0007) [2023-12-28 03:33:10,971][106225] Updated weights for policy 1, policy_version 1157098 (0.0008) [2023-12-28 03:33:11,029][106225] Updated weights for policy 1, policy_version 1157108 (0.0008) [2023-12-28 03:33:11,096][106225] Updated weights for policy 1, policy_version 1157118 (0.0006) [2023-12-28 03:33:11,167][106225] Updated weights for policy 1, policy_version 1157128 (0.0007) [2023-12-28 03:33:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19660.8). Total num frames: 591757312. Throughput: 0: 10008.4, 1: 9877.9. Samples: 591724852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:11,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.921')] [2023-12-28 03:33:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001157128_296271872.pth... [2023-12-28 03:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001154008_295485440.pth... [2023-12-28 03:33:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001155976_295976960.pth [2023-12-28 03:33:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001152824_295182336.pth [2023-12-28 03:33:11,657][106226] Updated weights for policy 0, policy_version 1154014 (0.0007) [2023-12-28 03:33:11,720][106226] Updated weights for policy 0, policy_version 1154024 (0.0009) [2023-12-28 03:33:11,785][106226] Updated weights for policy 0, policy_version 1154034 (0.0009) [2023-12-28 03:33:11,886][106225] Updated weights for policy 1, policy_version 1157138 (0.0006) [2023-12-28 03:33:11,934][106225] Updated weights for policy 1, policy_version 1157148 (0.0008) [2023-12-28 03:33:11,991][106225] Updated weights for policy 1, policy_version 1157158 (0.0008) [2023-12-28 03:33:12,493][106226] Updated weights for policy 0, policy_version 1154044 (0.0009) [2023-12-28 03:33:12,550][106226] Updated weights for policy 0, policy_version 1154054 (0.0005) [2023-12-28 03:33:12,612][106226] Updated weights for policy 0, policy_version 1154064 (0.0006) [2023-12-28 03:33:12,757][106225] Updated weights for policy 1, policy_version 1157168 (0.0008) [2023-12-28 03:33:12,827][106225] Updated weights for policy 1, policy_version 1157178 (0.0008) [2023-12-28 03:33:12,895][106225] Updated weights for policy 1, policy_version 1157188 (0.0008) [2023-12-28 03:33:13,299][106226] Updated weights for policy 0, policy_version 1154074 (0.0010) [2023-12-28 03:33:13,390][106226] Updated weights for policy 0, policy_version 1154084 (0.0008) [2023-12-28 03:33:13,454][106226] Updated weights for policy 0, policy_version 1154094 (0.0011) [2023-12-28 03:33:13,464][106225] Updated weights for policy 1, policy_version 1157198 (0.0006) [2023-12-28 03:33:13,510][106226] Updated weights for policy 0, policy_version 1154104 (0.0010) [2023-12-28 03:33:13,522][106225] Updated weights for policy 1, policy_version 1157208 (0.0009) [2023-12-28 03:33:13,581][106225] Updated weights for policy 1, policy_version 1157218 (0.0008) [2023-12-28 03:33:14,166][106226] Updated weights for policy 0, policy_version 1154114 (0.0010) [2023-12-28 03:33:14,205][106225] Updated weights for policy 1, policy_version 1157228 (0.0007) [2023-12-28 03:33:14,226][106226] Updated weights for policy 0, policy_version 1154124 (0.0010) [2023-12-28 03:33:14,259][106225] Updated weights for policy 1, policy_version 1157238 (0.0006) [2023-12-28 03:33:14,283][106226] Updated weights for policy 0, policy_version 1154134 (0.0008) [2023-12-28 03:33:14,308][106225] Updated weights for policy 1, policy_version 1157248 (0.0008) [2023-12-28 03:33:14,889][106226] Updated weights for policy 0, policy_version 1154144 (0.0008) [2023-12-28 03:33:14,953][106226] Updated weights for policy 0, policy_version 1154154 (0.0009) [2023-12-28 03:33:15,023][106226] Updated weights for policy 0, policy_version 1154164 (0.0010) [2023-12-28 03:33:15,069][106225] Updated weights for policy 1, policy_version 1157258 (0.0010) [2023-12-28 03:33:15,125][106225] Updated weights for policy 1, policy_version 1157268 (0.0009) [2023-12-28 03:33:15,183][106225] Updated weights for policy 1, policy_version 1157278 (0.0010) [2023-12-28 03:33:15,240][106225] Updated weights for policy 1, policy_version 1157288 (0.0010) [2023-12-28 03:33:15,594][106226] Updated weights for policy 0, policy_version 1154174 (0.0006) [2023-12-28 03:33:15,646][106226] Updated weights for policy 0, policy_version 1154184 (0.0005) [2023-12-28 03:33:15,699][106226] Updated weights for policy 0, policy_version 1154194 (0.0005) [2023-12-28 03:33:16,052][106225] Updated weights for policy 1, policy_version 1157298 (0.0007) [2023-12-28 03:33:16,112][106225] Updated weights for policy 1, policy_version 1157308 (0.0008) [2023-12-28 03:33:16,170][106225] Updated weights for policy 1, policy_version 1157318 (0.0010) [2023-12-28 03:33:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 591847424. Throughput: 0: 9984.7, 1: 9850.3. Samples: 591842444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:16,176][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.819')] [2023-12-28 03:33:16,282][106226] Updated weights for policy 0, policy_version 1154204 (0.0005) [2023-12-28 03:33:16,344][106226] Updated weights for policy 0, policy_version 1154214 (0.0005) [2023-12-28 03:33:16,412][106226] Updated weights for policy 0, policy_version 1154224 (0.0009) [2023-12-28 03:33:16,905][106225] Updated weights for policy 1, policy_version 1157328 (0.0006) [2023-12-28 03:33:16,964][106225] Updated weights for policy 1, policy_version 1157338 (0.0005) [2023-12-28 03:33:17,014][106225] Updated weights for policy 1, policy_version 1157348 (0.0007) [2023-12-28 03:33:17,146][106226] Updated weights for policy 0, policy_version 1154234 (0.0010) [2023-12-28 03:33:17,204][106226] Updated weights for policy 0, policy_version 1154244 (0.0009) [2023-12-28 03:33:17,260][106226] Updated weights for policy 0, policy_version 1154254 (0.0011) [2023-12-28 03:33:17,321][106226] Updated weights for policy 0, policy_version 1154264 (0.0006) [2023-12-28 03:33:17,773][106225] Updated weights for policy 1, policy_version 1157358 (0.0005) [2023-12-28 03:33:17,830][106225] Updated weights for policy 1, policy_version 1157368 (0.0005) [2023-12-28 03:33:17,887][106225] Updated weights for policy 1, policy_version 1157378 (0.0008) [2023-12-28 03:33:17,917][106226] Updated weights for policy 0, policy_version 1154274 (0.0005) [2023-12-28 03:33:17,978][106226] Updated weights for policy 0, policy_version 1154284 (0.0005) [2023-12-28 03:33:18,037][106226] Updated weights for policy 0, policy_version 1154294 (0.0007) [2023-12-28 03:33:18,552][106225] Updated weights for policy 1, policy_version 1157388 (0.0010) [2023-12-28 03:33:18,614][106225] Updated weights for policy 1, policy_version 1157398 (0.0011) [2023-12-28 03:33:18,665][106225] Updated weights for policy 1, policy_version 1157408 (0.0010) [2023-12-28 03:33:18,708][106226] Updated weights for policy 0, policy_version 1154304 (0.0008) [2023-12-28 03:33:18,766][106226] Updated weights for policy 0, policy_version 1154314 (0.0005) [2023-12-28 03:33:18,818][106226] Updated weights for policy 0, policy_version 1154324 (0.0007) [2023-12-28 03:33:19,394][106225] Updated weights for policy 1, policy_version 1157418 (0.0008) [2023-12-28 03:33:19,454][106225] Updated weights for policy 1, policy_version 1157428 (0.0006) [2023-12-28 03:33:19,473][106226] Updated weights for policy 0, policy_version 1154334 (0.0007) [2023-12-28 03:33:19,513][106225] Updated weights for policy 1, policy_version 1157438 (0.0008) [2023-12-28 03:33:19,539][106226] Updated weights for policy 0, policy_version 1154344 (0.0008) [2023-12-28 03:33:19,562][106225] Updated weights for policy 1, policy_version 1157448 (0.0005) [2023-12-28 03:33:19,607][106226] Updated weights for policy 0, policy_version 1154354 (0.0007) [2023-12-28 03:33:20,311][106225] Updated weights for policy 1, policy_version 1157458 (0.0008) [2023-12-28 03:33:20,363][106226] Updated weights for policy 0, policy_version 1154364 (0.0008) [2023-12-28 03:33:20,369][106225] Updated weights for policy 1, policy_version 1157468 (0.0008) [2023-12-28 03:33:20,424][106226] Updated weights for policy 0, policy_version 1154374 (0.0007) [2023-12-28 03:33:20,430][106225] Updated weights for policy 1, policy_version 1157478 (0.0010) [2023-12-28 03:33:20,488][106226] Updated weights for policy 0, policy_version 1154384 (0.0007) [2023-12-28 03:33:21,150][106225] Updated weights for policy 1, policy_version 1157488 (0.0009) [2023-12-28 03:33:21,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 591945728. Throughput: 0: 10025.5, 1: 9744.3. Samples: 591961440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:21,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.885')] [2023-12-28 03:33:21,215][106225] Updated weights for policy 1, policy_version 1157498 (0.0006) [2023-12-28 03:33:21,267][106226] Updated weights for policy 0, policy_version 1154394 (0.0008) [2023-12-28 03:33:21,279][106225] Updated weights for policy 1, policy_version 1157508 (0.0013) [2023-12-28 03:33:21,323][106226] Updated weights for policy 0, policy_version 1154404 (0.0008) [2023-12-28 03:33:21,396][106226] Updated weights for policy 0, policy_version 1154414 (0.0008) [2023-12-28 03:33:21,447][106226] Updated weights for policy 0, policy_version 1154424 (0.0008) [2023-12-28 03:33:22,036][106225] Updated weights for policy 1, policy_version 1157518 (0.0010) [2023-12-28 03:33:22,106][106225] Updated weights for policy 1, policy_version 1157528 (0.0009) [2023-12-28 03:33:22,160][106225] Updated weights for policy 1, policy_version 1157538 (0.0006) [2023-12-28 03:33:22,172][106226] Updated weights for policy 0, policy_version 1154434 (0.0011) [2023-12-28 03:33:22,230][106226] Updated weights for policy 0, policy_version 1154444 (0.0009) [2023-12-28 03:33:22,302][106226] Updated weights for policy 0, policy_version 1154454 (0.0007) [2023-12-28 03:33:22,821][106225] Updated weights for policy 1, policy_version 1157548 (0.0007) [2023-12-28 03:33:22,888][106225] Updated weights for policy 1, policy_version 1157558 (0.0008) [2023-12-28 03:33:22,913][106226] Updated weights for policy 0, policy_version 1154464 (0.0007) [2023-12-28 03:33:22,941][106225] Updated weights for policy 1, policy_version 1157568 (0.0008) [2023-12-28 03:33:22,974][106226] Updated weights for policy 0, policy_version 1154474 (0.0011) [2023-12-28 03:33:23,037][106226] Updated weights for policy 0, policy_version 1154484 (0.0006) [2023-12-28 03:33:23,687][106225] Updated weights for policy 1, policy_version 1157578 (0.0006) [2023-12-28 03:33:23,708][106226] Updated weights for policy 0, policy_version 1154494 (0.0008) [2023-12-28 03:33:23,749][106225] Updated weights for policy 1, policy_version 1157588 (0.0007) [2023-12-28 03:33:23,771][106226] Updated weights for policy 0, policy_version 1154504 (0.0005) [2023-12-28 03:33:23,803][106225] Updated weights for policy 1, policy_version 1157598 (0.0006) [2023-12-28 03:33:23,820][106226] Updated weights for policy 0, policy_version 1154514 (0.0008) [2023-12-28 03:33:23,855][106225] Updated weights for policy 1, policy_version 1157608 (0.0008) [2023-12-28 03:33:24,480][106226] Updated weights for policy 0, policy_version 1154524 (0.0007) [2023-12-28 03:33:24,529][106225] Updated weights for policy 1, policy_version 1157618 (0.0005) [2023-12-28 03:33:24,541][106226] Updated weights for policy 0, policy_version 1154534 (0.0009) [2023-12-28 03:33:24,584][106225] Updated weights for policy 1, policy_version 1157628 (0.0005) [2023-12-28 03:33:24,591][106226] Updated weights for policy 0, policy_version 1154544 (0.0007) [2023-12-28 03:33:24,636][106225] Updated weights for policy 1, policy_version 1157638 (0.0006) [2023-12-28 03:33:25,310][106226] Updated weights for policy 0, policy_version 1154554 (0.0006) [2023-12-28 03:33:25,350][106225] Updated weights for policy 1, policy_version 1157648 (0.0009) [2023-12-28 03:33:25,359][106226] Updated weights for policy 0, policy_version 1154564 (0.0005) [2023-12-28 03:33:25,395][106225] Updated weights for policy 1, policy_version 1157658 (0.0008) [2023-12-28 03:33:25,414][106226] Updated weights for policy 0, policy_version 1154574 (0.0005) [2023-12-28 03:33:25,446][106225] Updated weights for policy 1, policy_version 1157668 (0.0009) [2023-12-28 03:33:25,475][106226] Updated weights for policy 0, policy_version 1154584 (0.0005) [2023-12-28 03:33:26,035][106226] Updated weights for policy 0, policy_version 1154594 (0.0011) [2023-12-28 03:33:26,089][106226] Updated weights for policy 0, policy_version 1154604 (0.0011) [2023-12-28 03:33:26,140][106226] Updated weights for policy 0, policy_version 1154614 (0.0010) [2023-12-28 03:33:26,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 592052224. Throughput: 0: 10054.7, 1: 9675.4. Samples: 592020940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:26,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.962')] [2023-12-28 03:33:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001154616_295641088.pth... [2023-12-28 03:33:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001153432_295337984.pth [2023-12-28 03:33:26,205][106225] Updated weights for policy 1, policy_version 1157678 (0.0008) [2023-12-28 03:33:26,266][106225] Updated weights for policy 1, policy_version 1157688 (0.0008) [2023-12-28 03:33:26,323][106225] Updated weights for policy 1, policy_version 1157698 (0.0008) [2023-12-28 03:33:26,352][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001157704_296419328.pth... [2023-12-28 03:33:26,355][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001156520_296116224.pth [2023-12-28 03:33:26,861][106226] Updated weights for policy 0, policy_version 1154624 (0.0008) [2023-12-28 03:33:26,922][106226] Updated weights for policy 0, policy_version 1154634 (0.0006) [2023-12-28 03:33:26,983][106226] Updated weights for policy 0, policy_version 1154644 (0.0007) [2023-12-28 03:33:27,071][106225] Updated weights for policy 1, policy_version 1157708 (0.0008) [2023-12-28 03:33:27,130][106225] Updated weights for policy 1, policy_version 1157718 (0.0007) [2023-12-28 03:33:27,186][106225] Updated weights for policy 1, policy_version 1157728 (0.0008) [2023-12-28 03:33:27,590][106226] Updated weights for policy 0, policy_version 1154654 (0.0011) [2023-12-28 03:33:27,643][106226] Updated weights for policy 0, policy_version 1154664 (0.0010) [2023-12-28 03:33:27,706][106226] Updated weights for policy 0, policy_version 1154674 (0.0010) [2023-12-28 03:33:27,946][106225] Updated weights for policy 1, policy_version 1157738 (0.0009) [2023-12-28 03:33:27,999][106225] Updated weights for policy 1, policy_version 1157748 (0.0007) [2023-12-28 03:33:28,058][106225] Updated weights for policy 1, policy_version 1157758 (0.0008) [2023-12-28 03:33:28,106][106225] Updated weights for policy 1, policy_version 1157768 (0.0007) [2023-12-28 03:33:28,398][106226] Updated weights for policy 0, policy_version 1154684 (0.0009) [2023-12-28 03:33:28,452][106226] Updated weights for policy 0, policy_version 1154694 (0.0010) [2023-12-28 03:33:28,502][106226] Updated weights for policy 0, policy_version 1154704 (0.0010) [2023-12-28 03:33:28,762][106225] Updated weights for policy 1, policy_version 1157778 (0.0008) [2023-12-28 03:33:28,843][106225] Updated weights for policy 1, policy_version 1157788 (0.0010) [2023-12-28 03:33:28,900][106225] Updated weights for policy 1, policy_version 1157798 (0.0008) [2023-12-28 03:33:29,186][106226] Updated weights for policy 0, policy_version 1154714 (0.0010) [2023-12-28 03:33:29,250][106226] Updated weights for policy 0, policy_version 1154724 (0.0009) [2023-12-28 03:33:29,315][106226] Updated weights for policy 0, policy_version 1154734 (0.0008) [2023-12-28 03:33:29,382][106226] Updated weights for policy 0, policy_version 1154744 (0.0008) [2023-12-28 03:33:29,584][106225] Updated weights for policy 1, policy_version 1157808 (0.0006) [2023-12-28 03:33:29,657][106225] Updated weights for policy 1, policy_version 1157818 (0.0005) [2023-12-28 03:33:29,725][106225] Updated weights for policy 1, policy_version 1157828 (0.0007) [2023-12-28 03:33:30,032][106226] Updated weights for policy 0, policy_version 1154754 (0.0011) [2023-12-28 03:33:30,093][106226] Updated weights for policy 0, policy_version 1154764 (0.0010) [2023-12-28 03:33:30,150][106226] Updated weights for policy 0, policy_version 1154774 (0.0010) [2023-12-28 03:33:30,355][106225] Updated weights for policy 1, policy_version 1157838 (0.0007) [2023-12-28 03:33:30,409][106225] Updated weights for policy 1, policy_version 1157848 (0.0006) [2023-12-28 03:33:30,466][106225] Updated weights for policy 1, policy_version 1157858 (0.0005) [2023-12-28 03:33:30,784][106226] Updated weights for policy 0, policy_version 1154784 (0.0006) [2023-12-28 03:33:30,847][106226] Updated weights for policy 0, policy_version 1154794 (0.0009) [2023-12-28 03:33:30,896][106226] Updated weights for policy 0, policy_version 1154804 (0.0010) [2023-12-28 03:33:31,163][106225] Updated weights for policy 1, policy_version 1157868 (0.0009) [2023-12-28 03:33:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 592150528. Throughput: 0: 10058.8, 1: 9799.2. Samples: 592141256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:31,175][105115] Avg episode reward: [(0, '-4.113'), (1, '-4.727')] [2023-12-28 03:33:31,230][106225] Updated weights for policy 1, policy_version 1157878 (0.0006) [2023-12-28 03:33:31,305][106225] Updated weights for policy 1, policy_version 1157888 (0.0007) [2023-12-28 03:33:31,539][106226] Updated weights for policy 0, policy_version 1154814 (0.0010) [2023-12-28 03:33:31,599][106226] Updated weights for policy 0, policy_version 1154824 (0.0007) [2023-12-28 03:33:31,669][106226] Updated weights for policy 0, policy_version 1154834 (0.0008) [2023-12-28 03:33:31,966][106225] Updated weights for policy 1, policy_version 1157898 (0.0008) [2023-12-28 03:33:32,033][106225] Updated weights for policy 1, policy_version 1157908 (0.0005) [2023-12-28 03:33:32,092][106225] Updated weights for policy 1, policy_version 1157918 (0.0005) [2023-12-28 03:33:32,146][106225] Updated weights for policy 1, policy_version 1157928 (0.0006) [2023-12-28 03:33:32,449][106226] Updated weights for policy 0, policy_version 1154844 (0.0009) [2023-12-28 03:33:32,503][106226] Updated weights for policy 0, policy_version 1154854 (0.0007) [2023-12-28 03:33:32,557][106226] Updated weights for policy 0, policy_version 1154864 (0.0009) [2023-12-28 03:33:32,721][106225] Updated weights for policy 1, policy_version 1157938 (0.0008) [2023-12-28 03:33:32,766][106225] Updated weights for policy 1, policy_version 1157948 (0.0009) [2023-12-28 03:33:32,813][106225] Updated weights for policy 1, policy_version 1157958 (0.0010) [2023-12-28 03:33:33,284][106226] Updated weights for policy 0, policy_version 1154874 (0.0008) [2023-12-28 03:33:33,334][106226] Updated weights for policy 0, policy_version 1154884 (0.0007) [2023-12-28 03:33:33,386][106226] Updated weights for policy 0, policy_version 1154894 (0.0008) [2023-12-28 03:33:33,440][106226] Updated weights for policy 0, policy_version 1154904 (0.0008) [2023-12-28 03:33:33,543][106225] Updated weights for policy 1, policy_version 1157968 (0.0010) [2023-12-28 03:33:33,601][106225] Updated weights for policy 1, policy_version 1157978 (0.0010) [2023-12-28 03:33:33,657][106225] Updated weights for policy 1, policy_version 1157988 (0.0009) [2023-12-28 03:33:34,209][106225] Updated weights for policy 1, policy_version 1157998 (0.0008) [2023-12-28 03:33:34,271][106225] Updated weights for policy 1, policy_version 1158008 (0.0010) [2023-12-28 03:33:34,273][106226] Updated weights for policy 0, policy_version 1154914 (0.0007) [2023-12-28 03:33:34,334][106226] Updated weights for policy 0, policy_version 1154924 (0.0007) [2023-12-28 03:33:34,334][106225] Updated weights for policy 1, policy_version 1158018 (0.0009) [2023-12-28 03:33:34,390][106226] Updated weights for policy 0, policy_version 1154934 (0.0009) [2023-12-28 03:33:35,077][106225] Updated weights for policy 1, policy_version 1158028 (0.0010) [2023-12-28 03:33:35,133][106225] Updated weights for policy 1, policy_version 1158038 (0.0010) [2023-12-28 03:33:35,139][106226] Updated weights for policy 0, policy_version 1154944 (0.0006) [2023-12-28 03:33:35,185][106225] Updated weights for policy 1, policy_version 1158048 (0.0010) [2023-12-28 03:33:35,198][106226] Updated weights for policy 0, policy_version 1154954 (0.0009) [2023-12-28 03:33:35,257][106226] Updated weights for policy 0, policy_version 1154964 (0.0006) [2023-12-28 03:33:35,867][106226] Updated weights for policy 0, policy_version 1154974 (0.0006) [2023-12-28 03:33:35,874][106225] Updated weights for policy 1, policy_version 1158058 (0.0010) [2023-12-28 03:33:35,919][106226] Updated weights for policy 0, policy_version 1154984 (0.0005) [2023-12-28 03:33:35,922][106225] Updated weights for policy 1, policy_version 1158068 (0.0008) [2023-12-28 03:33:35,975][106225] Updated weights for policy 1, policy_version 1158078 (0.0007) [2023-12-28 03:33:35,980][106226] Updated weights for policy 0, policy_version 1154994 (0.0008) [2023-12-28 03:33:36,033][106225] Updated weights for policy 1, policy_version 1158088 (0.0007) [2023-12-28 03:33:36,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 592257024. Throughput: 0: 10057.1, 1: 9902.2. Samples: 592262560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:36,176][105115] Avg episode reward: [(0, '-4.622'), (1, '-4.736')] [2023-12-28 03:33:36,553][106226] Updated weights for policy 0, policy_version 1155004 (0.0009) [2023-12-28 03:33:36,611][106226] Updated weights for policy 0, policy_version 1155014 (0.0005) [2023-12-28 03:33:36,676][106226] Updated weights for policy 0, policy_version 1155024 (0.0005) [2023-12-28 03:33:36,822][106225] Updated weights for policy 1, policy_version 1158098 (0.0005) [2023-12-28 03:33:36,888][106225] Updated weights for policy 1, policy_version 1158108 (0.0005) [2023-12-28 03:33:36,950][106225] Updated weights for policy 1, policy_version 1158118 (0.0007) [2023-12-28 03:33:37,314][106226] Updated weights for policy 0, policy_version 1155034 (0.0007) [2023-12-28 03:33:37,381][106226] Updated weights for policy 0, policy_version 1155044 (0.0011) [2023-12-28 03:33:37,437][106226] Updated weights for policy 0, policy_version 1155054 (0.0008) [2023-12-28 03:33:37,493][106226] Updated weights for policy 0, policy_version 1155064 (0.0005) [2023-12-28 03:33:37,639][106225] Updated weights for policy 1, policy_version 1158128 (0.0008) [2023-12-28 03:33:37,697][106225] Updated weights for policy 1, policy_version 1158138 (0.0008) [2023-12-28 03:33:37,759][106225] Updated weights for policy 1, policy_version 1158148 (0.0008) [2023-12-28 03:33:38,135][106226] Updated weights for policy 0, policy_version 1155074 (0.0005) [2023-12-28 03:33:38,197][106226] Updated weights for policy 0, policy_version 1155084 (0.0007) [2023-12-28 03:33:38,254][106226] Updated weights for policy 0, policy_version 1155094 (0.0010) [2023-12-28 03:33:38,449][106225] Updated weights for policy 1, policy_version 1158158 (0.0008) [2023-12-28 03:33:38,503][106225] Updated weights for policy 1, policy_version 1158168 (0.0007) [2023-12-28 03:33:38,551][106225] Updated weights for policy 1, policy_version 1158178 (0.0008) [2023-12-28 03:33:38,945][106226] Updated weights for policy 0, policy_version 1155104 (0.0006) [2023-12-28 03:33:39,015][106226] Updated weights for policy 0, policy_version 1155114 (0.0006) [2023-12-28 03:33:39,074][106226] Updated weights for policy 0, policy_version 1155124 (0.0007) [2023-12-28 03:33:39,211][106225] Updated weights for policy 1, policy_version 1158188 (0.0009) [2023-12-28 03:33:39,275][106225] Updated weights for policy 1, policy_version 1158198 (0.0008) [2023-12-28 03:33:39,363][106225] Updated weights for policy 1, policy_version 1158208 (0.0008) [2023-12-28 03:33:39,681][106226] Updated weights for policy 0, policy_version 1155134 (0.0005) [2023-12-28 03:33:39,746][106226] Updated weights for policy 0, policy_version 1155144 (0.0009) [2023-12-28 03:33:39,809][106226] Updated weights for policy 0, policy_version 1155154 (0.0010) [2023-12-28 03:33:40,168][106225] Updated weights for policy 1, policy_version 1158218 (0.0009) [2023-12-28 03:33:40,226][106225] Updated weights for policy 1, policy_version 1158228 (0.0008) [2023-12-28 03:33:40,282][106225] Updated weights for policy 1, policy_version 1158238 (0.0009) [2023-12-28 03:33:40,338][106225] Updated weights for policy 1, policy_version 1158248 (0.0008) [2023-12-28 03:33:40,523][106226] Updated weights for policy 0, policy_version 1155164 (0.0008) [2023-12-28 03:33:40,572][106226] Updated weights for policy 0, policy_version 1155174 (0.0009) [2023-12-28 03:33:40,628][106226] Updated weights for policy 0, policy_version 1155184 (0.0009) [2023-12-28 03:33:41,090][106225] Updated weights for policy 1, policy_version 1158258 (0.0008) [2023-12-28 03:33:41,157][106225] Updated weights for policy 1, policy_version 1158268 (0.0009) [2023-12-28 03:33:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 592347136. Throughput: 0: 10120.6, 1: 9909.3. Samples: 592324060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:41,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.803')] [2023-12-28 03:33:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001155192_295788544.pth... [2023-12-28 03:33:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001154008_295485440.pth [2023-12-28 03:33:41,185][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001155192_295788544.pth [2023-12-28 03:33:41,212][106225] Updated weights for policy 1, policy_version 1158278 (0.0007) [2023-12-28 03:33:41,223][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001158280_296566784.pth... [2023-12-28 03:33:41,226][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001157128_296271872.pth [2023-12-28 03:33:41,227][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001158280_296566784.pth [2023-12-28 03:33:41,410][106226] Updated weights for policy 0, policy_version 1155194 (0.0009) [2023-12-28 03:33:41,468][106226] Updated weights for policy 0, policy_version 1155204 (0.0008) [2023-12-28 03:33:41,528][106226] Updated weights for policy 0, policy_version 1155214 (0.0009) [2023-12-28 03:33:41,589][106226] Updated weights for policy 0, policy_version 1155224 (0.0008) [2023-12-28 03:33:41,982][106225] Updated weights for policy 1, policy_version 1158288 (0.0008) [2023-12-28 03:33:42,043][106225] Updated weights for policy 1, policy_version 1158298 (0.0009) [2023-12-28 03:33:42,108][106225] Updated weights for policy 1, policy_version 1158308 (0.0008) [2023-12-28 03:33:42,416][106226] Updated weights for policy 0, policy_version 1155234 (0.0008) [2023-12-28 03:33:42,480][106226] Updated weights for policy 0, policy_version 1155244 (0.0009) [2023-12-28 03:33:42,539][106226] Updated weights for policy 0, policy_version 1155254 (0.0008) [2023-12-28 03:33:42,801][106225] Updated weights for policy 1, policy_version 1158318 (0.0008) [2023-12-28 03:33:42,850][106225] Updated weights for policy 1, policy_version 1158328 (0.0008) [2023-12-28 03:33:42,910][106225] Updated weights for policy 1, policy_version 1158338 (0.0009) [2023-12-28 03:33:43,215][106226] Updated weights for policy 0, policy_version 1155264 (0.0008) [2023-12-28 03:33:43,272][106226] Updated weights for policy 0, policy_version 1155274 (0.0008) [2023-12-28 03:33:43,326][106226] Updated weights for policy 0, policy_version 1155284 (0.0008) [2023-12-28 03:33:43,644][106225] Updated weights for policy 1, policy_version 1158348 (0.0009) [2023-12-28 03:33:43,704][106225] Updated weights for policy 1, policy_version 1158358 (0.0010) [2023-12-28 03:33:43,764][106225] Updated weights for policy 1, policy_version 1158368 (0.0008) [2023-12-28 03:33:43,998][106226] Updated weights for policy 0, policy_version 1155294 (0.0006) [2023-12-28 03:33:44,050][106226] Updated weights for policy 0, policy_version 1155304 (0.0009) [2023-12-28 03:33:44,108][106226] Updated weights for policy 0, policy_version 1155314 (0.0009) [2023-12-28 03:33:44,334][106225] Updated weights for policy 1, policy_version 1158378 (0.0008) [2023-12-28 03:33:44,394][106225] Updated weights for policy 1, policy_version 1158388 (0.0010) [2023-12-28 03:33:44,449][106225] Updated weights for policy 1, policy_version 1158398 (0.0008) [2023-12-28 03:33:44,502][106225] Updated weights for policy 1, policy_version 1158408 (0.0009) [2023-12-28 03:33:44,917][106226] Updated weights for policy 0, policy_version 1155324 (0.0009) [2023-12-28 03:33:44,978][106226] Updated weights for policy 0, policy_version 1155334 (0.0009) [2023-12-28 03:33:45,033][106226] Updated weights for policy 0, policy_version 1155344 (0.0009) [2023-12-28 03:33:45,135][106225] Updated weights for policy 1, policy_version 1158418 (0.0011) [2023-12-28 03:33:45,201][106225] Updated weights for policy 1, policy_version 1158428 (0.0011) [2023-12-28 03:33:45,260][106225] Updated weights for policy 1, policy_version 1158438 (0.0010) [2023-12-28 03:33:45,745][106226] Updated weights for policy 0, policy_version 1155354 (0.0008) [2023-12-28 03:33:45,798][106226] Updated weights for policy 0, policy_version 1155364 (0.0008) [2023-12-28 03:33:45,856][106226] Updated weights for policy 0, policy_version 1155374 (0.0008) [2023-12-28 03:33:45,919][106226] Updated weights for policy 0, policy_version 1155384 (0.0009) [2023-12-28 03:33:45,967][106225] Updated weights for policy 1, policy_version 1158448 (0.0006) [2023-12-28 03:33:46,021][106225] Updated weights for policy 1, policy_version 1158458 (0.0007) [2023-12-28 03:33:46,071][106225] Updated weights for policy 1, policy_version 1158468 (0.0007) [2023-12-28 03:33:46,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 592453632. Throughput: 0: 9982.1, 1: 9910.5. Samples: 592439904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:46,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.935')] [2023-12-28 03:33:46,560][106226] Updated weights for policy 0, policy_version 1155394 (0.0005) [2023-12-28 03:33:46,621][106226] Updated weights for policy 0, policy_version 1155404 (0.0006) [2023-12-28 03:33:46,641][106225] Updated weights for policy 1, policy_version 1158478 (0.0007) [2023-12-28 03:33:46,684][106226] Updated weights for policy 0, policy_version 1155414 (0.0008) [2023-12-28 03:33:46,709][106225] Updated weights for policy 1, policy_version 1158488 (0.0008) [2023-12-28 03:33:46,772][106225] Updated weights for policy 1, policy_version 1158498 (0.0008) [2023-12-28 03:33:47,268][106226] Updated weights for policy 0, policy_version 1155424 (0.0006) [2023-12-28 03:33:47,327][106226] Updated weights for policy 0, policy_version 1155434 (0.0007) [2023-12-28 03:33:47,382][106226] Updated weights for policy 0, policy_version 1155444 (0.0008) [2023-12-28 03:33:47,533][106225] Updated weights for policy 1, policy_version 1158508 (0.0009) [2023-12-28 03:33:47,590][106225] Updated weights for policy 1, policy_version 1158518 (0.0010) [2023-12-28 03:33:47,647][106225] Updated weights for policy 1, policy_version 1158528 (0.0010) [2023-12-28 03:33:48,105][106226] Updated weights for policy 0, policy_version 1155454 (0.0008) [2023-12-28 03:33:48,158][106226] Updated weights for policy 0, policy_version 1155464 (0.0009) [2023-12-28 03:33:48,221][106226] Updated weights for policy 0, policy_version 1155474 (0.0005) [2023-12-28 03:33:48,320][106225] Updated weights for policy 1, policy_version 1158538 (0.0010) [2023-12-28 03:33:48,395][106225] Updated weights for policy 1, policy_version 1158548 (0.0008) [2023-12-28 03:33:48,458][106225] Updated weights for policy 1, policy_version 1158558 (0.0009) [2023-12-28 03:33:48,513][106225] Updated weights for policy 1, policy_version 1158568 (0.0009) [2023-12-28 03:33:48,880][106226] Updated weights for policy 0, policy_version 1155484 (0.0006) [2023-12-28 03:33:48,943][106226] Updated weights for policy 0, policy_version 1155494 (0.0007) [2023-12-28 03:33:49,005][106226] Updated weights for policy 0, policy_version 1155504 (0.0010) [2023-12-28 03:33:49,175][106225] Updated weights for policy 1, policy_version 1158578 (0.0008) [2023-12-28 03:33:49,242][106225] Updated weights for policy 1, policy_version 1158588 (0.0008) [2023-12-28 03:33:49,307][106225] Updated weights for policy 1, policy_version 1158598 (0.0008) [2023-12-28 03:33:49,730][106226] Updated weights for policy 0, policy_version 1155514 (0.0008) [2023-12-28 03:33:49,802][106226] Updated weights for policy 0, policy_version 1155524 (0.0009) [2023-12-28 03:33:49,866][106226] Updated weights for policy 0, policy_version 1155534 (0.0009) [2023-12-28 03:33:49,933][106226] Updated weights for policy 0, policy_version 1155544 (0.0008) [2023-12-28 03:33:49,959][106225] Updated weights for policy 1, policy_version 1158611 (0.0007) [2023-12-28 03:33:50,021][106225] Updated weights for policy 1, policy_version 1158621 (0.0007) [2023-12-28 03:33:50,085][106225] Updated weights for policy 1, policy_version 1158631 (0.0008) [2023-12-28 03:33:50,674][106226] Updated weights for policy 0, policy_version 1155554 (0.0008) [2023-12-28 03:33:50,738][106226] Updated weights for policy 0, policy_version 1155564 (0.0009) [2023-12-28 03:33:50,800][106226] Updated weights for policy 0, policy_version 1155574 (0.0007) [2023-12-28 03:33:50,816][106225] Updated weights for policy 1, policy_version 1158641 (0.0008) [2023-12-28 03:33:50,867][106225] Updated weights for policy 1, policy_version 1158651 (0.0008) [2023-12-28 03:33:50,919][106225] Updated weights for policy 1, policy_version 1158661 (0.0008) [2023-12-28 03:33:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.5, 300 sec: 19716.3). Total num frames: 592551936. Throughput: 0: 9985.7, 1: 9917.9. Samples: 592560276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:51,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.787')] [2023-12-28 03:33:51,596][106226] Updated weights for policy 0, policy_version 1155584 (0.0008) [2023-12-28 03:33:51,638][106225] Updated weights for policy 1, policy_version 1158671 (0.0008) [2023-12-28 03:33:51,663][106226] Updated weights for policy 0, policy_version 1155594 (0.0009) [2023-12-28 03:33:51,689][106225] Updated weights for policy 1, policy_version 1158681 (0.0008) [2023-12-28 03:33:51,719][106226] Updated weights for policy 0, policy_version 1155604 (0.0007) [2023-12-28 03:33:51,769][106225] Updated weights for policy 1, policy_version 1158691 (0.0006) [2023-12-28 03:33:52,444][106225] Updated weights for policy 1, policy_version 1158701 (0.0009) [2023-12-28 03:33:52,469][106226] Updated weights for policy 0, policy_version 1155614 (0.0007) [2023-12-28 03:33:52,508][106225] Updated weights for policy 1, policy_version 1158711 (0.0010) [2023-12-28 03:33:52,530][106226] Updated weights for policy 0, policy_version 1155624 (0.0008) [2023-12-28 03:33:52,561][106225] Updated weights for policy 1, policy_version 1158721 (0.0010) [2023-12-28 03:33:52,594][106226] Updated weights for policy 0, policy_version 1155634 (0.0006) [2023-12-28 03:33:53,278][106225] Updated weights for policy 1, policy_version 1158731 (0.0010) [2023-12-28 03:33:53,295][106226] Updated weights for policy 0, policy_version 1155644 (0.0006) [2023-12-28 03:33:53,324][106225] Updated weights for policy 1, policy_version 1158741 (0.0010) [2023-12-28 03:33:53,344][106226] Updated weights for policy 0, policy_version 1155654 (0.0006) [2023-12-28 03:33:53,377][106225] Updated weights for policy 1, policy_version 1158751 (0.0009) [2023-12-28 03:33:53,405][106226] Updated weights for policy 0, policy_version 1155664 (0.0006) [2023-12-28 03:33:54,005][106225] Updated weights for policy 1, policy_version 1158761 (0.0009) [2023-12-28 03:33:54,062][106225] Updated weights for policy 1, policy_version 1158771 (0.0010) [2023-12-28 03:33:54,109][106226] Updated weights for policy 0, policy_version 1155674 (0.0008) [2023-12-28 03:33:54,124][106225] Updated weights for policy 1, policy_version 1158781 (0.0011) [2023-12-28 03:33:54,165][106226] Updated weights for policy 0, policy_version 1155684 (0.0005) [2023-12-28 03:33:54,181][106225] Updated weights for policy 1, policy_version 1158791 (0.0010) [2023-12-28 03:33:54,221][106226] Updated weights for policy 0, policy_version 1155694 (0.0008) [2023-12-28 03:33:54,283][106226] Updated weights for policy 0, policy_version 1155704 (0.0008) [2023-12-28 03:33:54,820][106225] Updated weights for policy 1, policy_version 1158801 (0.0010) [2023-12-28 03:33:54,866][106225] Updated weights for policy 1, policy_version 1158811 (0.0010) [2023-12-28 03:33:54,913][106225] Updated weights for policy 1, policy_version 1158821 (0.0010) [2023-12-28 03:33:54,953][106226] Updated weights for policy 0, policy_version 1155714 (0.0006) [2023-12-28 03:33:55,014][106226] Updated weights for policy 0, policy_version 1155724 (0.0008) [2023-12-28 03:33:55,063][106226] Updated weights for policy 0, policy_version 1155734 (0.0009) [2023-12-28 03:33:55,646][106225] Updated weights for policy 1, policy_version 1158831 (0.0010) [2023-12-28 03:33:55,699][106225] Updated weights for policy 1, policy_version 1158841 (0.0010) [2023-12-28 03:33:55,752][106225] Updated weights for policy 1, policy_version 1158851 (0.0010) [2023-12-28 03:33:55,811][106226] Updated weights for policy 0, policy_version 1155744 (0.0009) [2023-12-28 03:33:55,871][106226] Updated weights for policy 0, policy_version 1155754 (0.0008) [2023-12-28 03:33:55,921][106226] Updated weights for policy 0, policy_version 1155764 (0.0007) [2023-12-28 03:33:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 592650240. Throughput: 0: 9994.3, 1: 9865.3. Samples: 592618528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:33:56,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.613')] [2023-12-28 03:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001155768_295936000.pth... [2023-12-28 03:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001158856_296714240.pth... [2023-12-28 03:33:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001154616_295641088.pth [2023-12-28 03:33:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001157704_296419328.pth [2023-12-28 03:33:56,415][106225] Updated weights for policy 1, policy_version 1158861 (0.0008) [2023-12-28 03:33:56,469][106225] Updated weights for policy 1, policy_version 1158871 (0.0006) [2023-12-28 03:33:56,524][106225] Updated weights for policy 1, policy_version 1158881 (0.0010) [2023-12-28 03:33:56,653][106226] Updated weights for policy 0, policy_version 1155774 (0.0008) [2023-12-28 03:33:56,698][106226] Updated weights for policy 0, policy_version 1155784 (0.0007) [2023-12-28 03:33:56,740][106226] Updated weights for policy 0, policy_version 1155794 (0.0007) [2023-12-28 03:33:57,201][106225] Updated weights for policy 1, policy_version 1158891 (0.0010) [2023-12-28 03:33:57,258][106225] Updated weights for policy 1, policy_version 1158901 (0.0010) [2023-12-28 03:33:57,313][106225] Updated weights for policy 1, policy_version 1158911 (0.0008) [2023-12-28 03:33:57,460][106226] Updated weights for policy 0, policy_version 1155804 (0.0007) [2023-12-28 03:33:57,507][106226] Updated weights for policy 0, policy_version 1155814 (0.0005) [2023-12-28 03:33:57,562][106226] Updated weights for policy 0, policy_version 1155824 (0.0005) [2023-12-28 03:33:58,026][106225] Updated weights for policy 1, policy_version 1158921 (0.0009) [2023-12-28 03:33:58,074][106225] Updated weights for policy 1, policy_version 1158931 (0.0005) [2023-12-28 03:33:58,120][106226] Updated weights for policy 0, policy_version 1155834 (0.0006) [2023-12-28 03:33:58,122][106225] Updated weights for policy 1, policy_version 1158941 (0.0007) [2023-12-28 03:33:58,168][106225] Updated weights for policy 1, policy_version 1158951 (0.0006) [2023-12-28 03:33:58,181][106226] Updated weights for policy 0, policy_version 1155844 (0.0006) [2023-12-28 03:33:58,250][106226] Updated weights for policy 0, policy_version 1155854 (0.0007) [2023-12-28 03:33:58,307][106226] Updated weights for policy 0, policy_version 1155864 (0.0008) [2023-12-28 03:33:58,986][106225] Updated weights for policy 1, policy_version 1158961 (0.0009) [2023-12-28 03:33:59,033][106226] Updated weights for policy 0, policy_version 1155874 (0.0006) [2023-12-28 03:33:59,035][106225] Updated weights for policy 1, policy_version 1158971 (0.0007) [2023-12-28 03:33:59,092][106226] Updated weights for policy 0, policy_version 1155884 (0.0009) [2023-12-28 03:33:59,098][106225] Updated weights for policy 1, policy_version 1158981 (0.0007) [2023-12-28 03:33:59,149][106226] Updated weights for policy 0, policy_version 1155894 (0.0008) [2023-12-28 03:33:59,893][106225] Updated weights for policy 1, policy_version 1158991 (0.0006) [2023-12-28 03:33:59,894][106226] Updated weights for policy 0, policy_version 1155904 (0.0008) [2023-12-28 03:33:59,953][106225] Updated weights for policy 1, policy_version 1159001 (0.0007) [2023-12-28 03:33:59,962][106226] Updated weights for policy 0, policy_version 1155914 (0.0006) [2023-12-28 03:34:00,014][106225] Updated weights for policy 1, policy_version 1159011 (0.0008) [2023-12-28 03:34:00,022][106226] Updated weights for policy 0, policy_version 1155924 (0.0005) [2023-12-28 03:34:00,610][106226] Updated weights for policy 0, policy_version 1155934 (0.0005) [2023-12-28 03:34:00,654][106225] Updated weights for policy 1, policy_version 1159021 (0.0007) [2023-12-28 03:34:00,664][106226] Updated weights for policy 0, policy_version 1155944 (0.0006) [2023-12-28 03:34:00,707][106225] Updated weights for policy 1, policy_version 1159031 (0.0006) [2023-12-28 03:34:00,721][106226] Updated weights for policy 0, policy_version 1155954 (0.0006) [2023-12-28 03:34:00,762][106225] Updated weights for policy 1, policy_version 1159041 (0.0008) [2023-12-28 03:34:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 592748544. Throughput: 0: 9997.8, 1: 9868.8. Samples: 592736436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:01,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-5.069')] [2023-12-28 03:34:01,378][106226] Updated weights for policy 0, policy_version 1155964 (0.0007) [2023-12-28 03:34:01,446][106226] Updated weights for policy 0, policy_version 1155974 (0.0006) [2023-12-28 03:34:01,464][106225] Updated weights for policy 1, policy_version 1159051 (0.0007) [2023-12-28 03:34:01,494][106226] Updated weights for policy 0, policy_version 1155984 (0.0006) [2023-12-28 03:34:01,537][106225] Updated weights for policy 1, policy_version 1159061 (0.0006) [2023-12-28 03:34:01,600][106225] Updated weights for policy 1, policy_version 1159071 (0.0007) [2023-12-28 03:34:02,184][106225] Updated weights for policy 1, policy_version 1159081 (0.0007) [2023-12-28 03:34:02,243][106225] Updated weights for policy 1, policy_version 1159091 (0.0006) [2023-12-28 03:34:02,248][106226] Updated weights for policy 0, policy_version 1155994 (0.0007) [2023-12-28 03:34:02,299][106225] Updated weights for policy 1, policy_version 1159101 (0.0006) [2023-12-28 03:34:02,317][106226] Updated weights for policy 0, policy_version 1156004 (0.0007) [2023-12-28 03:34:02,365][106225] Updated weights for policy 1, policy_version 1159111 (0.0007) [2023-12-28 03:34:02,382][106226] Updated weights for policy 0, policy_version 1156014 (0.0009) [2023-12-28 03:34:02,434][106226] Updated weights for policy 0, policy_version 1156024 (0.0009) [2023-12-28 03:34:02,959][106225] Updated weights for policy 1, policy_version 1159121 (0.0006) [2023-12-28 03:34:03,015][106225] Updated weights for policy 1, policy_version 1159131 (0.0005) [2023-12-28 03:34:03,070][106225] Updated weights for policy 1, policy_version 1159141 (0.0005) [2023-12-28 03:34:03,093][106226] Updated weights for policy 0, policy_version 1156034 (0.0005) [2023-12-28 03:34:03,140][106226] Updated weights for policy 0, policy_version 1156044 (0.0006) [2023-12-28 03:34:03,196][106226] Updated weights for policy 0, policy_version 1156054 (0.0008) [2023-12-28 03:34:03,701][106225] Updated weights for policy 1, policy_version 1159151 (0.0007) [2023-12-28 03:34:03,744][106225] Updated weights for policy 1, policy_version 1159161 (0.0005) [2023-12-28 03:34:03,789][106225] Updated weights for policy 1, policy_version 1159171 (0.0005) [2023-12-28 03:34:03,890][106226] Updated weights for policy 0, policy_version 1156064 (0.0007) [2023-12-28 03:34:03,960][106226] Updated weights for policy 0, policy_version 1156074 (0.0009) [2023-12-28 03:34:04,021][106226] Updated weights for policy 0, policy_version 1156084 (0.0008) [2023-12-28 03:34:04,492][106225] Updated weights for policy 1, policy_version 1159181 (0.0008) [2023-12-28 03:34:04,539][106225] Updated weights for policy 1, policy_version 1159191 (0.0010) [2023-12-28 03:34:04,593][106225] Updated weights for policy 1, policy_version 1159201 (0.0010) [2023-12-28 03:34:04,765][106226] Updated weights for policy 0, policy_version 1156094 (0.0008) [2023-12-28 03:34:04,815][106226] Updated weights for policy 0, policy_version 1156104 (0.0007) [2023-12-28 03:34:04,868][106226] Updated weights for policy 0, policy_version 1156114 (0.0008) [2023-12-28 03:34:05,239][106225] Updated weights for policy 1, policy_version 1159211 (0.0009) [2023-12-28 03:34:05,312][106225] Updated weights for policy 1, policy_version 1159221 (0.0005) [2023-12-28 03:34:05,380][106225] Updated weights for policy 1, policy_version 1159231 (0.0006) [2023-12-28 03:34:05,479][106226] Updated weights for policy 0, policy_version 1156124 (0.0007) [2023-12-28 03:34:05,538][106226] Updated weights for policy 0, policy_version 1156134 (0.0006) [2023-12-28 03:34:05,589][106226] Updated weights for policy 0, policy_version 1156144 (0.0005) [2023-12-28 03:34:06,005][106225] Updated weights for policy 1, policy_version 1159241 (0.0006) [2023-12-28 03:34:06,056][106225] Updated weights for policy 1, policy_version 1159251 (0.0008) [2023-12-28 03:34:06,115][106225] Updated weights for policy 1, policy_version 1159261 (0.0009) [2023-12-28 03:34:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 592846848. Throughput: 0: 10010.0, 1: 10028.0. Samples: 592863152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:06,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-5.064')] [2023-12-28 03:34:06,180][106225] Updated weights for policy 1, policy_version 1159271 (0.0009) [2023-12-28 03:34:06,190][106226] Updated weights for policy 0, policy_version 1156154 (0.0006) [2023-12-28 03:34:06,250][106226] Updated weights for policy 0, policy_version 1156164 (0.0009) [2023-12-28 03:34:06,316][106226] Updated weights for policy 0, policy_version 1156174 (0.0010) [2023-12-28 03:34:06,382][106226] Updated weights for policy 0, policy_version 1156184 (0.0010) [2023-12-28 03:34:06,771][106225] Updated weights for policy 1, policy_version 1159282 (0.0008) [2023-12-28 03:34:06,819][106225] Updated weights for policy 1, policy_version 1159292 (0.0007) [2023-12-28 03:34:06,865][106225] Updated weights for policy 1, policy_version 1159302 (0.0008) [2023-12-28 03:34:07,140][106226] Updated weights for policy 0, policy_version 1156194 (0.0008) [2023-12-28 03:34:07,204][106226] Updated weights for policy 0, policy_version 1156204 (0.0008) [2023-12-28 03:34:07,271][106226] Updated weights for policy 0, policy_version 1156214 (0.0008) [2023-12-28 03:34:07,629][106225] Updated weights for policy 1, policy_version 1159312 (0.0010) [2023-12-28 03:34:07,675][106225] Updated weights for policy 1, policy_version 1159322 (0.0010) [2023-12-28 03:34:07,732][106225] Updated weights for policy 1, policy_version 1159332 (0.0010) [2023-12-28 03:34:07,979][106226] Updated weights for policy 0, policy_version 1156224 (0.0008) [2023-12-28 03:34:08,045][106226] Updated weights for policy 0, policy_version 1156234 (0.0009) [2023-12-28 03:34:08,104][106226] Updated weights for policy 0, policy_version 1156244 (0.0009) [2023-12-28 03:34:08,361][106225] Updated weights for policy 1, policy_version 1159342 (0.0009) [2023-12-28 03:34:08,424][106225] Updated weights for policy 1, policy_version 1159352 (0.0006) [2023-12-28 03:34:08,488][106225] Updated weights for policy 1, policy_version 1159362 (0.0006) [2023-12-28 03:34:08,869][106226] Updated weights for policy 0, policy_version 1156254 (0.0007) [2023-12-28 03:34:08,927][106226] Updated weights for policy 0, policy_version 1156264 (0.0006) [2023-12-28 03:34:08,988][106226] Updated weights for policy 0, policy_version 1156274 (0.0006) [2023-12-28 03:34:09,178][106225] Updated weights for policy 1, policy_version 1159372 (0.0008) [2023-12-28 03:34:09,256][106225] Updated weights for policy 1, policy_version 1159383 (0.0009) [2023-12-28 03:34:09,319][106225] Updated weights for policy 1, policy_version 1159393 (0.0008) [2023-12-28 03:34:09,664][106226] Updated weights for policy 0, policy_version 1156284 (0.0006) [2023-12-28 03:34:09,728][106226] Updated weights for policy 0, policy_version 1156294 (0.0009) [2023-12-28 03:34:09,789][106226] Updated weights for policy 0, policy_version 1156304 (0.0009) [2023-12-28 03:34:10,119][106225] Updated weights for policy 1, policy_version 1159403 (0.0008) [2023-12-28 03:34:10,183][106225] Updated weights for policy 1, policy_version 1159413 (0.0009) [2023-12-28 03:34:10,249][106225] Updated weights for policy 1, policy_version 1159423 (0.0008) [2023-12-28 03:34:10,586][106226] Updated weights for policy 0, policy_version 1156314 (0.0008) [2023-12-28 03:34:10,643][106226] Updated weights for policy 0, policy_version 1156324 (0.0007) [2023-12-28 03:34:10,702][106226] Updated weights for policy 0, policy_version 1156334 (0.0010) [2023-12-28 03:34:10,758][106226] Updated weights for policy 0, policy_version 1156344 (0.0008) [2023-12-28 03:34:10,919][106225] Updated weights for policy 1, policy_version 1159433 (0.0009) [2023-12-28 03:34:10,989][106225] Updated weights for policy 1, policy_version 1159443 (0.0007) [2023-12-28 03:34:11,060][106225] Updated weights for policy 1, policy_version 1159453 (0.0008) [2023-12-28 03:34:11,121][106225] Updated weights for policy 1, policy_version 1159463 (0.0008) [2023-12-28 03:34:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 592953344. Throughput: 0: 9945.7, 1: 10079.7. Samples: 592922088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:11,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.992')] [2023-12-28 03:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001156344_296083456.pth... [2023-12-28 03:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001159464_296869888.pth... [2023-12-28 03:34:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001155192_295788544.pth [2023-12-28 03:34:11,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001158280_296566784.pth [2023-12-28 03:34:11,542][106226] Updated weights for policy 0, policy_version 1156354 (0.0007) [2023-12-28 03:34:11,604][106226] Updated weights for policy 0, policy_version 1156364 (0.0010) [2023-12-28 03:34:11,673][106226] Updated weights for policy 0, policy_version 1156374 (0.0011) [2023-12-28 03:34:11,892][106225] Updated weights for policy 1, policy_version 1159473 (0.0007) [2023-12-28 03:34:11,944][106225] Updated weights for policy 1, policy_version 1159483 (0.0008) [2023-12-28 03:34:12,000][106225] Updated weights for policy 1, policy_version 1159493 (0.0006) [2023-12-28 03:34:12,386][106226] Updated weights for policy 0, policy_version 1156384 (0.0010) [2023-12-28 03:34:12,448][106226] Updated weights for policy 0, policy_version 1156394 (0.0010) [2023-12-28 03:34:12,498][106226] Updated weights for policy 0, policy_version 1156404 (0.0010) [2023-12-28 03:34:12,738][106225] Updated weights for policy 1, policy_version 1159503 (0.0007) [2023-12-28 03:34:12,802][106225] Updated weights for policy 1, policy_version 1159513 (0.0011) [2023-12-28 03:34:12,864][106225] Updated weights for policy 1, policy_version 1159523 (0.0010) [2023-12-28 03:34:13,189][106226] Updated weights for policy 0, policy_version 1156414 (0.0011) [2023-12-28 03:34:13,251][106226] Updated weights for policy 0, policy_version 1156424 (0.0010) [2023-12-28 03:34:13,310][106226] Updated weights for policy 0, policy_version 1156434 (0.0010) [2023-12-28 03:34:13,576][106225] Updated weights for policy 1, policy_version 1159533 (0.0010) [2023-12-28 03:34:13,627][106225] Updated weights for policy 1, policy_version 1159543 (0.0010) [2023-12-28 03:34:13,674][106225] Updated weights for policy 1, policy_version 1159553 (0.0010) [2023-12-28 03:34:13,954][106226] Updated weights for policy 0, policy_version 1156444 (0.0010) [2023-12-28 03:34:14,008][106226] Updated weights for policy 0, policy_version 1156454 (0.0010) [2023-12-28 03:34:14,063][106226] Updated weights for policy 0, policy_version 1156464 (0.0008) [2023-12-28 03:34:14,397][106225] Updated weights for policy 1, policy_version 1159563 (0.0009) [2023-12-28 03:34:14,454][106225] Updated weights for policy 1, policy_version 1159573 (0.0005) [2023-12-28 03:34:14,506][106225] Updated weights for policy 1, policy_version 1159583 (0.0008) [2023-12-28 03:34:14,768][106226] Updated weights for policy 0, policy_version 1156474 (0.0010) [2023-12-28 03:34:14,834][106226] Updated weights for policy 0, policy_version 1156484 (0.0009) [2023-12-28 03:34:14,894][106226] Updated weights for policy 0, policy_version 1156494 (0.0008) [2023-12-28 03:34:14,954][106226] Updated weights for policy 0, policy_version 1156504 (0.0009) [2023-12-28 03:34:15,159][106225] Updated weights for policy 1, policy_version 1159593 (0.0010) [2023-12-28 03:34:15,228][106225] Updated weights for policy 1, policy_version 1159603 (0.0008) [2023-12-28 03:34:15,287][106225] Updated weights for policy 1, policy_version 1159613 (0.0010) [2023-12-28 03:34:15,343][106225] Updated weights for policy 1, policy_version 1159623 (0.0010) [2023-12-28 03:34:15,702][106226] Updated weights for policy 0, policy_version 1156514 (0.0005) [2023-12-28 03:34:15,749][106226] Updated weights for policy 0, policy_version 1156524 (0.0005) [2023-12-28 03:34:15,800][106226] Updated weights for policy 0, policy_version 1156534 (0.0005) [2023-12-28 03:34:16,047][106225] Updated weights for policy 1, policy_version 1159633 (0.0010) [2023-12-28 03:34:16,101][106225] Updated weights for policy 1, policy_version 1159643 (0.0010) [2023-12-28 03:34:16,147][106225] Updated weights for policy 1, policy_version 1159653 (0.0010) [2023-12-28 03:34:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.5, 300 sec: 19744.1). Total num frames: 593051648. Throughput: 0: 9849.9, 1: 10047.6. Samples: 593036640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:16,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.718')] [2023-12-28 03:34:16,474][106226] Updated weights for policy 0, policy_version 1156544 (0.0007) [2023-12-28 03:34:16,536][106226] Updated weights for policy 0, policy_version 1156554 (0.0008) [2023-12-28 03:34:16,596][106226] Updated weights for policy 0, policy_version 1156564 (0.0008) [2023-12-28 03:34:16,874][106225] Updated weights for policy 1, policy_version 1159663 (0.0009) [2023-12-28 03:34:16,938][106225] Updated weights for policy 1, policy_version 1159673 (0.0010) [2023-12-28 03:34:16,991][106225] Updated weights for policy 1, policy_version 1159683 (0.0006) [2023-12-28 03:34:17,265][106226] Updated weights for policy 0, policy_version 1156574 (0.0010) [2023-12-28 03:34:17,319][106226] Updated weights for policy 0, policy_version 1156584 (0.0011) [2023-12-28 03:34:17,372][106226] Updated weights for policy 0, policy_version 1156594 (0.0010) [2023-12-28 03:34:17,692][106225] Updated weights for policy 1, policy_version 1159693 (0.0006) [2023-12-28 03:34:17,753][106225] Updated weights for policy 1, policy_version 1159703 (0.0006) [2023-12-28 03:34:17,807][106225] Updated weights for policy 1, policy_version 1159713 (0.0005) [2023-12-28 03:34:18,016][106226] Updated weights for policy 0, policy_version 1156604 (0.0009) [2023-12-28 03:34:18,086][106226] Updated weights for policy 0, policy_version 1156614 (0.0008) [2023-12-28 03:34:18,144][106226] Updated weights for policy 0, policy_version 1156624 (0.0009) [2023-12-28 03:34:18,424][106225] Updated weights for policy 1, policy_version 1159723 (0.0007) [2023-12-28 03:34:18,479][106225] Updated weights for policy 1, policy_version 1159733 (0.0011) [2023-12-28 03:34:18,541][106225] Updated weights for policy 1, policy_version 1159743 (0.0011) [2023-12-28 03:34:18,786][106226] Updated weights for policy 0, policy_version 1156634 (0.0006) [2023-12-28 03:34:18,866][106226] Updated weights for policy 0, policy_version 1156644 (0.0008) [2023-12-28 03:34:18,938][106226] Updated weights for policy 0, policy_version 1156654 (0.0008) [2023-12-28 03:34:19,001][106226] Updated weights for policy 0, policy_version 1156664 (0.0008) [2023-12-28 03:34:19,292][106225] Updated weights for policy 1, policy_version 1159753 (0.0010) [2023-12-28 03:34:19,365][106225] Updated weights for policy 1, policy_version 1159763 (0.0008) [2023-12-28 03:34:19,429][106225] Updated weights for policy 1, policy_version 1159773 (0.0009) [2023-12-28 03:34:19,498][106225] Updated weights for policy 1, policy_version 1159783 (0.0008) [2023-12-28 03:34:19,683][106226] Updated weights for policy 0, policy_version 1156674 (0.0009) [2023-12-28 03:34:19,754][106226] Updated weights for policy 0, policy_version 1156684 (0.0008) [2023-12-28 03:34:19,826][106226] Updated weights for policy 0, policy_version 1156694 (0.0009) [2023-12-28 03:34:20,287][106225] Updated weights for policy 1, policy_version 1159793 (0.0007) [2023-12-28 03:34:20,355][106225] Updated weights for policy 1, policy_version 1159803 (0.0008) [2023-12-28 03:34:20,409][106225] Updated weights for policy 1, policy_version 1159813 (0.0009) [2023-12-28 03:34:20,510][106226] Updated weights for policy 0, policy_version 1156704 (0.0006) [2023-12-28 03:34:20,587][106226] Updated weights for policy 0, policy_version 1156714 (0.0007) [2023-12-28 03:34:20,650][106226] Updated weights for policy 0, policy_version 1156724 (0.0008) [2023-12-28 03:34:21,116][106225] Updated weights for policy 1, policy_version 1159823 (0.0008) [2023-12-28 03:34:21,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 593141760. Throughput: 0: 9876.4, 1: 9956.7. Samples: 593155048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:21,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-5.068')] [2023-12-28 03:34:21,176][106225] Updated weights for policy 1, policy_version 1159833 (0.0008) [2023-12-28 03:34:21,238][106225] Updated weights for policy 1, policy_version 1159843 (0.0008) [2023-12-28 03:34:21,405][106226] Updated weights for policy 0, policy_version 1156734 (0.0008) [2023-12-28 03:34:21,468][106226] Updated weights for policy 0, policy_version 1156744 (0.0006) [2023-12-28 03:34:21,544][106226] Updated weights for policy 0, policy_version 1156754 (0.0007) [2023-12-28 03:34:21,988][106225] Updated weights for policy 1, policy_version 1159853 (0.0007) [2023-12-28 03:34:22,052][106225] Updated weights for policy 1, policy_version 1159863 (0.0006) [2023-12-28 03:34:22,116][106225] Updated weights for policy 1, policy_version 1159873 (0.0006) [2023-12-28 03:34:22,283][106226] Updated weights for policy 0, policy_version 1156764 (0.0008) [2023-12-28 03:34:22,356][106226] Updated weights for policy 0, policy_version 1156774 (0.0006) [2023-12-28 03:34:22,412][106226] Updated weights for policy 0, policy_version 1156784 (0.0006) [2023-12-28 03:34:22,813][106225] Updated weights for policy 1, policy_version 1159883 (0.0007) [2023-12-28 03:34:22,866][106225] Updated weights for policy 1, policy_version 1159893 (0.0008) [2023-12-28 03:34:22,919][106225] Updated weights for policy 1, policy_version 1159903 (0.0009) [2023-12-28 03:34:23,084][106226] Updated weights for policy 0, policy_version 1156794 (0.0007) [2023-12-28 03:34:23,135][106226] Updated weights for policy 0, policy_version 1156804 (0.0008) [2023-12-28 03:34:23,189][106226] Updated weights for policy 0, policy_version 1156814 (0.0008) [2023-12-28 03:34:23,246][106226] Updated weights for policy 0, policy_version 1156824 (0.0009) [2023-12-28 03:34:23,670][106225] Updated weights for policy 1, policy_version 1159913 (0.0009) [2023-12-28 03:34:23,729][106225] Updated weights for policy 1, policy_version 1159923 (0.0008) [2023-12-28 03:34:23,777][106225] Updated weights for policy 1, policy_version 1159933 (0.0005) [2023-12-28 03:34:23,835][106225] Updated weights for policy 1, policy_version 1159943 (0.0006) [2023-12-28 03:34:23,908][106226] Updated weights for policy 0, policy_version 1156834 (0.0005) [2023-12-28 03:34:23,959][106226] Updated weights for policy 0, policy_version 1156844 (0.0006) [2023-12-28 03:34:24,014][106226] Updated weights for policy 0, policy_version 1156854 (0.0005) [2023-12-28 03:34:24,493][106225] Updated weights for policy 1, policy_version 1159953 (0.0005) [2023-12-28 03:34:24,538][106226] Updated weights for policy 0, policy_version 1156864 (0.0005) [2023-12-28 03:34:24,550][106225] Updated weights for policy 1, policy_version 1159963 (0.0005) [2023-12-28 03:34:24,599][106226] Updated weights for policy 0, policy_version 1156874 (0.0005) [2023-12-28 03:34:24,614][106225] Updated weights for policy 1, policy_version 1159973 (0.0005) [2023-12-28 03:34:24,665][106226] Updated weights for policy 0, policy_version 1156884 (0.0010) [2023-12-28 03:34:25,120][106225] Updated weights for policy 1, policy_version 1159983 (0.0005) [2023-12-28 03:34:25,169][106225] Updated weights for policy 1, policy_version 1159993 (0.0005) [2023-12-28 03:34:25,221][106225] Updated weights for policy 1, policy_version 1160003 (0.0008) [2023-12-28 03:34:25,253][106226] Updated weights for policy 0, policy_version 1156894 (0.0007) [2023-12-28 03:34:25,307][106226] Updated weights for policy 0, policy_version 1156904 (0.0008) [2023-12-28 03:34:25,364][106226] Updated weights for policy 0, policy_version 1156914 (0.0008) [2023-12-28 03:34:25,924][106225] Updated weights for policy 1, policy_version 1160013 (0.0010) [2023-12-28 03:34:25,971][106225] Updated weights for policy 1, policy_version 1160023 (0.0010) [2023-12-28 03:34:25,985][106226] Updated weights for policy 0, policy_version 1156924 (0.0009) [2023-12-28 03:34:26,022][106225] Updated weights for policy 1, policy_version 1160033 (0.0010) [2023-12-28 03:34:26,037][106226] Updated weights for policy 0, policy_version 1156934 (0.0009) [2023-12-28 03:34:26,096][106226] Updated weights for policy 0, policy_version 1156944 (0.0011) [2023-12-28 03:34:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 593256448. Throughput: 0: 9813.8, 1: 9955.1. Samples: 593213660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:26,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.911')] [2023-12-28 03:34:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001160040_297017344.pth... [2023-12-28 03:34:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001156952_296239104.pth... [2023-12-28 03:34:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001158856_296714240.pth [2023-12-28 03:34:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001155768_295936000.pth [2023-12-28 03:34:26,653][106225] Updated weights for policy 1, policy_version 1160043 (0.0010) [2023-12-28 03:34:26,709][106225] Updated weights for policy 1, policy_version 1160053 (0.0010) [2023-12-28 03:34:26,761][106226] Updated weights for policy 0, policy_version 1156954 (0.0011) [2023-12-28 03:34:26,762][106225] Updated weights for policy 1, policy_version 1160063 (0.0010) [2023-12-28 03:34:26,824][106226] Updated weights for policy 0, policy_version 1156964 (0.0011) [2023-12-28 03:34:26,891][106226] Updated weights for policy 0, policy_version 1156974 (0.0011) [2023-12-28 03:34:26,951][106226] Updated weights for policy 0, policy_version 1156984 (0.0010) [2023-12-28 03:34:27,372][106225] Updated weights for policy 1, policy_version 1160073 (0.0007) [2023-12-28 03:34:27,422][106225] Updated weights for policy 1, policy_version 1160083 (0.0006) [2023-12-28 03:34:27,486][106225] Updated weights for policy 1, policy_version 1160093 (0.0007) [2023-12-28 03:34:27,547][106225] Updated weights for policy 1, policy_version 1160103 (0.0005) [2023-12-28 03:34:27,636][106226] Updated weights for policy 0, policy_version 1156994 (0.0010) [2023-12-28 03:34:27,685][106226] Updated weights for policy 0, policy_version 1157004 (0.0010) [2023-12-28 03:34:27,735][106226] Updated weights for policy 0, policy_version 1157014 (0.0010) [2023-12-28 03:34:28,147][106225] Updated weights for policy 1, policy_version 1160113 (0.0010) [2023-12-28 03:34:28,202][106225] Updated weights for policy 1, policy_version 1160123 (0.0010) [2023-12-28 03:34:28,256][106225] Updated weights for policy 1, policy_version 1160133 (0.0010) [2023-12-28 03:34:28,471][106226] Updated weights for policy 0, policy_version 1157024 (0.0010) [2023-12-28 03:34:28,521][106226] Updated weights for policy 0, policy_version 1157034 (0.0010) [2023-12-28 03:34:28,585][106226] Updated weights for policy 0, policy_version 1157044 (0.0011) [2023-12-28 03:34:29,001][106225] Updated weights for policy 1, policy_version 1160143 (0.0008) [2023-12-28 03:34:29,051][106225] Updated weights for policy 1, policy_version 1160153 (0.0008) [2023-12-28 03:34:29,103][106225] Updated weights for policy 1, policy_version 1160163 (0.0007) [2023-12-28 03:34:29,329][106226] Updated weights for policy 0, policy_version 1157054 (0.0011) [2023-12-28 03:34:29,399][106226] Updated weights for policy 0, policy_version 1157064 (0.0011) [2023-12-28 03:34:29,463][106226] Updated weights for policy 0, policy_version 1157074 (0.0010) [2023-12-28 03:34:29,787][106225] Updated weights for policy 1, policy_version 1160173 (0.0007) [2023-12-28 03:34:29,853][106225] Updated weights for policy 1, policy_version 1160183 (0.0008) [2023-12-28 03:34:29,911][106225] Updated weights for policy 1, policy_version 1160193 (0.0009) [2023-12-28 03:34:30,118][106226] Updated weights for policy 0, policy_version 1157084 (0.0010) [2023-12-28 03:34:30,171][106226] Updated weights for policy 0, policy_version 1157094 (0.0008) [2023-12-28 03:34:30,218][106226] Updated weights for policy 0, policy_version 1157104 (0.0008) [2023-12-28 03:34:30,620][106225] Updated weights for policy 1, policy_version 1160203 (0.0007) [2023-12-28 03:34:30,669][106225] Updated weights for policy 1, policy_version 1160213 (0.0005) [2023-12-28 03:34:30,718][106225] Updated weights for policy 1, policy_version 1160223 (0.0008) [2023-12-28 03:34:30,895][106226] Updated weights for policy 0, policy_version 1157114 (0.0007) [2023-12-28 03:34:30,942][106226] Updated weights for policy 0, policy_version 1157124 (0.0005) [2023-12-28 03:34:31,001][106226] Updated weights for policy 0, policy_version 1157134 (0.0005) [2023-12-28 03:34:31,072][106226] Updated weights for policy 0, policy_version 1157144 (0.0007) [2023-12-28 03:34:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 593354752. Throughput: 0: 9958.4, 1: 10079.9. Samples: 593341628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:31,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.842')] [2023-12-28 03:34:31,420][106225] Updated weights for policy 1, policy_version 1160233 (0.0008) [2023-12-28 03:34:31,484][106225] Updated weights for policy 1, policy_version 1160243 (0.0006) [2023-12-28 03:34:31,543][106225] Updated weights for policy 1, policy_version 1160253 (0.0008) [2023-12-28 03:34:31,602][106225] Updated weights for policy 1, policy_version 1160263 (0.0008) [2023-12-28 03:34:31,692][106226] Updated weights for policy 0, policy_version 1157154 (0.0008) [2023-12-28 03:34:31,754][106226] Updated weights for policy 0, policy_version 1157164 (0.0008) [2023-12-28 03:34:31,813][106226] Updated weights for policy 0, policy_version 1157174 (0.0009) [2023-12-28 03:34:32,339][106225] Updated weights for policy 1, policy_version 1160273 (0.0008) [2023-12-28 03:34:32,405][106225] Updated weights for policy 1, policy_version 1160283 (0.0008) [2023-12-28 03:34:32,457][106225] Updated weights for policy 1, policy_version 1160293 (0.0007) [2023-12-28 03:34:32,496][106226] Updated weights for policy 0, policy_version 1157184 (0.0009) [2023-12-28 03:34:32,548][106226] Updated weights for policy 0, policy_version 1157194 (0.0008) [2023-12-28 03:34:32,598][106226] Updated weights for policy 0, policy_version 1157204 (0.0009) [2023-12-28 03:34:33,137][106225] Updated weights for policy 1, policy_version 1160303 (0.0009) [2023-12-28 03:34:33,188][106225] Updated weights for policy 1, policy_version 1160313 (0.0008) [2023-12-28 03:34:33,234][106225] Updated weights for policy 1, policy_version 1160323 (0.0008) [2023-12-28 03:34:33,321][106226] Updated weights for policy 0, policy_version 1157214 (0.0008) [2023-12-28 03:34:33,373][106226] Updated weights for policy 0, policy_version 1157224 (0.0008) [2023-12-28 03:34:33,435][106226] Updated weights for policy 0, policy_version 1157234 (0.0008) [2023-12-28 03:34:33,942][106225] Updated weights for policy 1, policy_version 1160333 (0.0008) [2023-12-28 03:34:33,998][106225] Updated weights for policy 1, policy_version 1160343 (0.0010) [2023-12-28 03:34:34,047][106225] Updated weights for policy 1, policy_version 1160353 (0.0010) [2023-12-28 03:34:34,139][106226] Updated weights for policy 0, policy_version 1157244 (0.0008) [2023-12-28 03:34:34,203][106226] Updated weights for policy 0, policy_version 1157254 (0.0008) [2023-12-28 03:34:34,254][106226] Updated weights for policy 0, policy_version 1157264 (0.0008) [2023-12-28 03:34:34,773][106225] Updated weights for policy 1, policy_version 1160363 (0.0009) [2023-12-28 03:34:34,839][106225] Updated weights for policy 1, policy_version 1160373 (0.0007) [2023-12-28 03:34:34,906][106225] Updated weights for policy 1, policy_version 1160383 (0.0005) [2023-12-28 03:34:35,016][106226] Updated weights for policy 0, policy_version 1157274 (0.0008) [2023-12-28 03:34:35,064][106226] Updated weights for policy 0, policy_version 1157284 (0.0008) [2023-12-28 03:34:35,111][106226] Updated weights for policy 0, policy_version 1157294 (0.0008) [2023-12-28 03:34:35,166][106226] Updated weights for policy 0, policy_version 1157304 (0.0009) [2023-12-28 03:34:35,519][106225] Updated weights for policy 1, policy_version 1160393 (0.0007) [2023-12-28 03:34:35,582][106225] Updated weights for policy 1, policy_version 1160403 (0.0007) [2023-12-28 03:34:35,637][106225] Updated weights for policy 1, policy_version 1160413 (0.0008) [2023-12-28 03:34:35,681][106225] Updated weights for policy 1, policy_version 1160423 (0.0008) [2023-12-28 03:34:35,912][106226] Updated weights for policy 0, policy_version 1157314 (0.0005) [2023-12-28 03:34:35,975][106226] Updated weights for policy 0, policy_version 1157324 (0.0005) [2023-12-28 03:34:36,028][106226] Updated weights for policy 0, policy_version 1157334 (0.0005) [2023-12-28 03:34:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 593453056. Throughput: 0: 9958.7, 1: 10049.1. Samples: 593460632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:36,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.769')] [2023-12-28 03:34:36,414][106225] Updated weights for policy 1, policy_version 1160433 (0.0007) [2023-12-28 03:34:36,474][106225] Updated weights for policy 1, policy_version 1160443 (0.0005) [2023-12-28 03:34:36,539][106225] Updated weights for policy 1, policy_version 1160453 (0.0005) [2023-12-28 03:34:36,710][106226] Updated weights for policy 0, policy_version 1157344 (0.0008) [2023-12-28 03:34:36,764][106226] Updated weights for policy 0, policy_version 1157354 (0.0007) [2023-12-28 03:34:36,816][106226] Updated weights for policy 0, policy_version 1157364 (0.0008) [2023-12-28 03:34:37,106][106225] Updated weights for policy 1, policy_version 1160463 (0.0008) [2023-12-28 03:34:37,159][106225] Updated weights for policy 1, policy_version 1160473 (0.0010) [2023-12-28 03:34:37,213][106225] Updated weights for policy 1, policy_version 1160483 (0.0010) [2023-12-28 03:34:37,615][106226] Updated weights for policy 0, policy_version 1157374 (0.0009) [2023-12-28 03:34:37,675][106226] Updated weights for policy 0, policy_version 1157384 (0.0008) [2023-12-28 03:34:37,728][106226] Updated weights for policy 0, policy_version 1157394 (0.0008) [2023-12-28 03:34:37,948][106225] Updated weights for policy 1, policy_version 1160493 (0.0010) [2023-12-28 03:34:38,006][106225] Updated weights for policy 1, policy_version 1160503 (0.0008) [2023-12-28 03:34:38,064][106225] Updated weights for policy 1, policy_version 1160513 (0.0005) [2023-12-28 03:34:38,475][106226] Updated weights for policy 0, policy_version 1157404 (0.0007) [2023-12-28 03:34:38,540][106226] Updated weights for policy 0, policy_version 1157414 (0.0005) [2023-12-28 03:34:38,595][106226] Updated weights for policy 0, policy_version 1157424 (0.0007) [2023-12-28 03:34:38,762][106225] Updated weights for policy 1, policy_version 1160523 (0.0006) [2023-12-28 03:34:38,816][106225] Updated weights for policy 1, policy_version 1160533 (0.0008) [2023-12-28 03:34:38,881][106225] Updated weights for policy 1, policy_version 1160543 (0.0008) [2023-12-28 03:34:39,272][106226] Updated weights for policy 0, policy_version 1157434 (0.0008) [2023-12-28 03:34:39,334][106226] Updated weights for policy 0, policy_version 1157444 (0.0010) [2023-12-28 03:34:39,400][106226] Updated weights for policy 0, policy_version 1157454 (0.0010) [2023-12-28 03:34:39,466][106226] Updated weights for policy 0, policy_version 1157464 (0.0008) [2023-12-28 03:34:39,632][106225] Updated weights for policy 1, policy_version 1160553 (0.0008) [2023-12-28 03:34:39,691][106225] Updated weights for policy 1, policy_version 1160563 (0.0008) [2023-12-28 03:34:39,744][106225] Updated weights for policy 1, policy_version 1160573 (0.0008) [2023-12-28 03:34:39,804][106225] Updated weights for policy 1, policy_version 1160583 (0.0008) [2023-12-28 03:34:40,253][106226] Updated weights for policy 0, policy_version 1157474 (0.0009) [2023-12-28 03:34:40,309][106226] Updated weights for policy 0, policy_version 1157484 (0.0008) [2023-12-28 03:34:40,357][106226] Updated weights for policy 0, policy_version 1157494 (0.0008) [2023-12-28 03:34:40,553][106225] Updated weights for policy 1, policy_version 1160593 (0.0009) [2023-12-28 03:34:40,613][106225] Updated weights for policy 1, policy_version 1160603 (0.0008) [2023-12-28 03:34:40,676][106225] Updated weights for policy 1, policy_version 1160613 (0.0009) [2023-12-28 03:34:41,072][106226] Updated weights for policy 0, policy_version 1157504 (0.0008) [2023-12-28 03:34:41,145][106226] Updated weights for policy 0, policy_version 1157514 (0.0007) [2023-12-28 03:34:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 593543168. Throughput: 0: 9961.6, 1: 10061.1. Samples: 593519552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:41,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.773')] [2023-12-28 03:34:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001160616_297164800.pth... [2023-12-28 03:34:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001159464_296869888.pth [2023-12-28 03:34:41,212][106226] Updated weights for policy 0, policy_version 1157524 (0.0007) [2023-12-28 03:34:41,238][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001157528_296386560.pth... [2023-12-28 03:34:41,242][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001156344_296083456.pth [2023-12-28 03:34:41,405][106225] Updated weights for policy 1, policy_version 1160623 (0.0008) [2023-12-28 03:34:41,453][106225] Updated weights for policy 1, policy_version 1160633 (0.0008) [2023-12-28 03:34:41,514][106225] Updated weights for policy 1, policy_version 1160643 (0.0008) [2023-12-28 03:34:41,960][106226] Updated weights for policy 0, policy_version 1157534 (0.0010) [2023-12-28 03:34:42,025][106226] Updated weights for policy 0, policy_version 1157544 (0.0011) [2023-12-28 03:34:42,092][106226] Updated weights for policy 0, policy_version 1157554 (0.0010) [2023-12-28 03:34:42,267][106225] Updated weights for policy 1, policy_version 1160653 (0.0008) [2023-12-28 03:34:42,331][106225] Updated weights for policy 1, policy_version 1160663 (0.0008) [2023-12-28 03:34:42,398][106225] Updated weights for policy 1, policy_version 1160673 (0.0008) [2023-12-28 03:34:42,767][106226] Updated weights for policy 0, policy_version 1157564 (0.0011) [2023-12-28 03:34:42,822][106226] Updated weights for policy 0, policy_version 1157574 (0.0010) [2023-12-28 03:34:42,875][106226] Updated weights for policy 0, policy_version 1157584 (0.0009) [2023-12-28 03:34:43,163][106225] Updated weights for policy 1, policy_version 1160683 (0.0008) [2023-12-28 03:34:43,226][106225] Updated weights for policy 1, policy_version 1160693 (0.0010) [2023-12-28 03:34:43,283][106225] Updated weights for policy 1, policy_version 1160703 (0.0010) [2023-12-28 03:34:43,477][106226] Updated weights for policy 0, policy_version 1157594 (0.0007) [2023-12-28 03:34:43,527][106226] Updated weights for policy 0, policy_version 1157604 (0.0007) [2023-12-28 03:34:43,584][106226] Updated weights for policy 0, policy_version 1157614 (0.0008) [2023-12-28 03:34:43,632][106226] Updated weights for policy 0, policy_version 1157624 (0.0005) [2023-12-28 03:34:43,972][106225] Updated weights for policy 1, policy_version 1160713 (0.0010) [2023-12-28 03:34:44,029][106225] Updated weights for policy 1, policy_version 1160723 (0.0010) [2023-12-28 03:34:44,081][106225] Updated weights for policy 1, policy_version 1160733 (0.0010) [2023-12-28 03:34:44,141][106225] Updated weights for policy 1, policy_version 1160743 (0.0009) [2023-12-28 03:34:44,310][106226] Updated weights for policy 0, policy_version 1157634 (0.0009) [2023-12-28 03:34:44,354][106226] Updated weights for policy 0, policy_version 1157644 (0.0008) [2023-12-28 03:34:44,399][106226] Updated weights for policy 0, policy_version 1157654 (0.0008) [2023-12-28 03:34:44,857][106225] Updated weights for policy 1, policy_version 1160753 (0.0007) [2023-12-28 03:34:44,920][106225] Updated weights for policy 1, policy_version 1160763 (0.0008) [2023-12-28 03:34:44,986][106225] Updated weights for policy 1, policy_version 1160773 (0.0009) [2023-12-28 03:34:45,165][106226] Updated weights for policy 0, policy_version 1157664 (0.0006) [2023-12-28 03:34:45,226][106226] Updated weights for policy 0, policy_version 1157674 (0.0006) [2023-12-28 03:34:45,281][106226] Updated weights for policy 0, policy_version 1157684 (0.0006) [2023-12-28 03:34:45,753][106225] Updated weights for policy 1, policy_version 1160783 (0.0009) [2023-12-28 03:34:45,809][106225] Updated weights for policy 1, policy_version 1160793 (0.0008) [2023-12-28 03:34:45,862][106226] Updated weights for policy 0, policy_version 1157694 (0.0007) [2023-12-28 03:34:45,866][106225] Updated weights for policy 1, policy_version 1160803 (0.0005) [2023-12-28 03:34:45,923][106226] Updated weights for policy 0, policy_version 1157704 (0.0009) [2023-12-28 03:34:45,977][106226] Updated weights for policy 0, policy_version 1157714 (0.0010) [2023-12-28 03:34:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 593649664. Throughput: 0: 9948.5, 1: 10008.4. Samples: 593634500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:46,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.644')] [2023-12-28 03:34:46,546][106225] Updated weights for policy 1, policy_version 1160813 (0.0007) [2023-12-28 03:34:46,594][106225] Updated weights for policy 1, policy_version 1160823 (0.0008) [2023-12-28 03:34:46,645][106225] Updated weights for policy 1, policy_version 1160833 (0.0008) [2023-12-28 03:34:46,717][106226] Updated weights for policy 0, policy_version 1157724 (0.0008) [2023-12-28 03:34:46,776][106226] Updated weights for policy 0, policy_version 1157734 (0.0008) [2023-12-28 03:34:46,822][106226] Updated weights for policy 0, policy_version 1157744 (0.0007) [2023-12-28 03:34:47,408][106225] Updated weights for policy 1, policy_version 1160843 (0.0008) [2023-12-28 03:34:47,474][106225] Updated weights for policy 1, policy_version 1160853 (0.0008) [2023-12-28 03:34:47,483][106226] Updated weights for policy 0, policy_version 1157754 (0.0007) [2023-12-28 03:34:47,532][106225] Updated weights for policy 1, policy_version 1160863 (0.0010) [2023-12-28 03:34:47,545][106226] Updated weights for policy 0, policy_version 1157764 (0.0007) [2023-12-28 03:34:47,606][106226] Updated weights for policy 0, policy_version 1157774 (0.0010) [2023-12-28 03:34:47,659][106226] Updated weights for policy 0, policy_version 1157784 (0.0008) [2023-12-28 03:34:48,207][106225] Updated weights for policy 1, policy_version 1160873 (0.0011) [2023-12-28 03:34:48,272][106225] Updated weights for policy 1, policy_version 1160883 (0.0011) [2023-12-28 03:34:48,336][106225] Updated weights for policy 1, policy_version 1160893 (0.0010) [2023-12-28 03:34:48,402][106225] Updated weights for policy 1, policy_version 1160903 (0.0009) [2023-12-28 03:34:48,418][106226] Updated weights for policy 0, policy_version 1157794 (0.0007) [2023-12-28 03:34:48,489][106226] Updated weights for policy 0, policy_version 1157804 (0.0006) [2023-12-28 03:34:48,544][106226] Updated weights for policy 0, policy_version 1157814 (0.0010) [2023-12-28 03:34:49,097][106225] Updated weights for policy 1, policy_version 1160913 (0.0011) [2023-12-28 03:34:49,161][106225] Updated weights for policy 1, policy_version 1160923 (0.0010) [2023-12-28 03:34:49,217][106225] Updated weights for policy 1, policy_version 1160933 (0.0010) [2023-12-28 03:34:49,284][106226] Updated weights for policy 0, policy_version 1157824 (0.0009) [2023-12-28 03:34:49,354][106226] Updated weights for policy 0, policy_version 1157834 (0.0007) [2023-12-28 03:34:49,416][106226] Updated weights for policy 0, policy_version 1157844 (0.0009) [2023-12-28 03:34:49,845][106225] Updated weights for policy 1, policy_version 1160943 (0.0009) [2023-12-28 03:34:49,908][106225] Updated weights for policy 1, policy_version 1160953 (0.0009) [2023-12-28 03:34:49,973][106225] Updated weights for policy 1, policy_version 1160963 (0.0010) [2023-12-28 03:34:50,200][106226] Updated weights for policy 0, policy_version 1157854 (0.0008) [2023-12-28 03:34:50,257][106226] Updated weights for policy 0, policy_version 1157864 (0.0008) [2023-12-28 03:34:50,318][106226] Updated weights for policy 0, policy_version 1157874 (0.0008) [2023-12-28 03:34:50,698][106225] Updated weights for policy 1, policy_version 1160973 (0.0009) [2023-12-28 03:34:50,759][106225] Updated weights for policy 1, policy_version 1160983 (0.0009) [2023-12-28 03:34:50,821][106225] Updated weights for policy 1, policy_version 1160993 (0.0008) [2023-12-28 03:34:51,120][106226] Updated weights for policy 0, policy_version 1157884 (0.0010) [2023-12-28 03:34:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 593739776. Throughput: 0: 9830.7, 1: 9892.7. Samples: 593750704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:51,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.324')] [2023-12-28 03:34:51,176][106141] Saving new best policy, reward=-4.324! [2023-12-28 03:34:51,186][106226] Updated weights for policy 0, policy_version 1157894 (0.0008) [2023-12-28 03:34:51,253][106226] Updated weights for policy 0, policy_version 1157904 (0.0007) [2023-12-28 03:34:51,597][106225] Updated weights for policy 1, policy_version 1161003 (0.0007) [2023-12-28 03:34:51,669][106225] Updated weights for policy 1, policy_version 1161013 (0.0009) [2023-12-28 03:34:51,734][106225] Updated weights for policy 1, policy_version 1161023 (0.0008) [2023-12-28 03:34:51,968][106226] Updated weights for policy 0, policy_version 1157914 (0.0008) [2023-12-28 03:34:52,022][106226] Updated weights for policy 0, policy_version 1157924 (0.0008) [2023-12-28 03:34:52,077][106226] Updated weights for policy 0, policy_version 1157934 (0.0008) [2023-12-28 03:34:52,135][106226] Updated weights for policy 0, policy_version 1157944 (0.0008) [2023-12-28 03:34:52,474][106225] Updated weights for policy 1, policy_version 1161033 (0.0007) [2023-12-28 03:34:52,536][106225] Updated weights for policy 1, policy_version 1161043 (0.0009) [2023-12-28 03:34:52,606][106225] Updated weights for policy 1, policy_version 1161053 (0.0009) [2023-12-28 03:34:52,669][106225] Updated weights for policy 1, policy_version 1161063 (0.0009) [2023-12-28 03:34:52,796][106226] Updated weights for policy 0, policy_version 1157954 (0.0008) [2023-12-28 03:34:52,864][106226] Updated weights for policy 0, policy_version 1157964 (0.0009) [2023-12-28 03:34:52,925][106226] Updated weights for policy 0, policy_version 1157974 (0.0009) [2023-12-28 03:34:53,356][106225] Updated weights for policy 1, policy_version 1161073 (0.0008) [2023-12-28 03:34:53,404][106225] Updated weights for policy 1, policy_version 1161083 (0.0009) [2023-12-28 03:34:53,460][106225] Updated weights for policy 1, policy_version 1161093 (0.0009) [2023-12-28 03:34:53,593][106226] Updated weights for policy 0, policy_version 1157984 (0.0007) [2023-12-28 03:34:53,658][106226] Updated weights for policy 0, policy_version 1157994 (0.0007) [2023-12-28 03:34:53,715][106226] Updated weights for policy 0, policy_version 1158004 (0.0008) [2023-12-28 03:34:54,267][106225] Updated weights for policy 1, policy_version 1161103 (0.0008) [2023-12-28 03:34:54,283][106226] Updated weights for policy 0, policy_version 1158014 (0.0007) [2023-12-28 03:34:54,316][106225] Updated weights for policy 1, policy_version 1161113 (0.0007) [2023-12-28 03:34:54,335][106226] Updated weights for policy 0, policy_version 1158024 (0.0006) [2023-12-28 03:34:54,364][106225] Updated weights for policy 1, policy_version 1161123 (0.0006) [2023-12-28 03:34:54,386][106226] Updated weights for policy 0, policy_version 1158034 (0.0006) [2023-12-28 03:34:55,012][106226] Updated weights for policy 0, policy_version 1158044 (0.0008) [2023-12-28 03:34:55,068][106226] Updated weights for policy 0, policy_version 1158054 (0.0009) [2023-12-28 03:34:55,127][106226] Updated weights for policy 0, policy_version 1158064 (0.0009) [2023-12-28 03:34:55,148][106225] Updated weights for policy 1, policy_version 1161133 (0.0007) [2023-12-28 03:34:55,207][106225] Updated weights for policy 1, policy_version 1161143 (0.0009) [2023-12-28 03:34:55,272][106225] Updated weights for policy 1, policy_version 1161153 (0.0007) [2023-12-28 03:34:55,719][106226] Updated weights for policy 0, policy_version 1158074 (0.0006) [2023-12-28 03:34:55,777][106226] Updated weights for policy 0, policy_version 1158084 (0.0009) [2023-12-28 03:34:55,832][106226] Updated weights for policy 0, policy_version 1158094 (0.0008) [2023-12-28 03:34:55,889][106226] Updated weights for policy 0, policy_version 1158104 (0.0007) [2023-12-28 03:34:56,034][106225] Updated weights for policy 1, policy_version 1161163 (0.0009) [2023-12-28 03:34:56,100][106225] Updated weights for policy 1, policy_version 1161173 (0.0009) [2023-12-28 03:34:56,163][106225] Updated weights for policy 1, policy_version 1161183 (0.0008) [2023-12-28 03:34:56,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 593838080. Throughput: 0: 9896.4, 1: 9813.7. Samples: 593809044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:34:56,176][105115] Avg episode reward: [(0, '-4.540'), (1, '-5.018')] [2023-12-28 03:34:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001158104_296534016.pth... [2023-12-28 03:34:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001156952_296239104.pth [2023-12-28 03:34:56,216][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001161192_297312256.pth... [2023-12-28 03:34:56,226][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001160040_297017344.pth [2023-12-28 03:34:56,619][106226] Updated weights for policy 0, policy_version 1158114 (0.0008) [2023-12-28 03:34:56,677][106226] Updated weights for policy 0, policy_version 1158124 (0.0008) [2023-12-28 03:34:56,728][106226] Updated weights for policy 0, policy_version 1158134 (0.0009) [2023-12-28 03:34:56,824][106225] Updated weights for policy 1, policy_version 1161193 (0.0008) [2023-12-28 03:34:56,868][106225] Updated weights for policy 1, policy_version 1161203 (0.0009) [2023-12-28 03:34:56,912][106225] Updated weights for policy 1, policy_version 1161213 (0.0008) [2023-12-28 03:34:56,964][106225] Updated weights for policy 1, policy_version 1161223 (0.0008) [2023-12-28 03:34:57,463][106226] Updated weights for policy 0, policy_version 1158144 (0.0006) [2023-12-28 03:34:57,516][106226] Updated weights for policy 0, policy_version 1158154 (0.0005) [2023-12-28 03:34:57,572][106226] Updated weights for policy 0, policy_version 1158164 (0.0005) [2023-12-28 03:34:57,758][106225] Updated weights for policy 1, policy_version 1161233 (0.0008) [2023-12-28 03:34:57,809][106225] Updated weights for policy 1, policy_version 1161243 (0.0006) [2023-12-28 03:34:57,856][106225] Updated weights for policy 1, policy_version 1161253 (0.0005) [2023-12-28 03:34:58,245][106226] Updated weights for policy 0, policy_version 1158174 (0.0008) [2023-12-28 03:34:58,308][106226] Updated weights for policy 0, policy_version 1158184 (0.0008) [2023-12-28 03:34:58,380][106226] Updated weights for policy 0, policy_version 1158194 (0.0008) [2023-12-28 03:34:58,523][106225] Updated weights for policy 1, policy_version 1161263 (0.0008) [2023-12-28 03:34:58,589][106225] Updated weights for policy 1, policy_version 1161273 (0.0009) [2023-12-28 03:34:58,656][106225] Updated weights for policy 1, policy_version 1161283 (0.0008) [2023-12-28 03:34:59,263][106226] Updated weights for policy 0, policy_version 1158204 (0.0008) [2023-12-28 03:34:59,330][106226] Updated weights for policy 0, policy_version 1158214 (0.0008) [2023-12-28 03:34:59,394][106226] Updated weights for policy 0, policy_version 1158224 (0.0008) [2023-12-28 03:34:59,538][106225] Updated weights for policy 1, policy_version 1161293 (0.0009) [2023-12-28 03:34:59,598][106225] Updated weights for policy 1, policy_version 1161303 (0.0008) [2023-12-28 03:34:59,650][106225] Updated weights for policy 1, policy_version 1161313 (0.0009) [2023-12-28 03:35:00,032][106226] Updated weights for policy 0, policy_version 1158234 (0.0009) [2023-12-28 03:35:00,099][106226] Updated weights for policy 0, policy_version 1158244 (0.0008) [2023-12-28 03:35:00,160][106226] Updated weights for policy 0, policy_version 1158254 (0.0009) [2023-12-28 03:35:00,213][106226] Updated weights for policy 0, policy_version 1158264 (0.0009) [2023-12-28 03:35:00,448][106225] Updated weights for policy 1, policy_version 1161323 (0.0009) [2023-12-28 03:35:00,506][106225] Updated weights for policy 1, policy_version 1161333 (0.0008) [2023-12-28 03:35:00,558][106225] Updated weights for policy 1, policy_version 1161343 (0.0007) [2023-12-28 03:35:00,852][106226] Updated weights for policy 0, policy_version 1158274 (0.0006) [2023-12-28 03:35:00,916][106226] Updated weights for policy 0, policy_version 1158284 (0.0005) [2023-12-28 03:35:00,974][106226] Updated weights for policy 0, policy_version 1158294 (0.0006) [2023-12-28 03:35:01,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 593936384. Throughput: 0: 9946.5, 1: 9781.5. Samples: 593924400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:35:01,176][105115] Avg episode reward: [(0, '-4.583'), (1, '-4.760')] [2023-12-28 03:35:01,418][106225] Updated weights for policy 1, policy_version 1161353 (0.0010) [2023-12-28 03:35:01,480][106225] Updated weights for policy 1, policy_version 1161363 (0.0011) [2023-12-28 03:35:01,538][106225] Updated weights for policy 1, policy_version 1161373 (0.0010) [2023-12-28 03:35:01,600][106225] Updated weights for policy 1, policy_version 1161383 (0.0010) [2023-12-28 03:35:01,665][106226] Updated weights for policy 0, policy_version 1158304 (0.0008) [2023-12-28 03:35:01,717][106226] Updated weights for policy 0, policy_version 1158314 (0.0008) [2023-12-28 03:35:01,788][106226] Updated weights for policy 0, policy_version 1158324 (0.0009) [2023-12-28 03:35:02,331][106225] Updated weights for policy 1, policy_version 1161393 (0.0010) [2023-12-28 03:35:02,397][106225] Updated weights for policy 1, policy_version 1161403 (0.0009) [2023-12-28 03:35:02,438][106226] Updated weights for policy 0, policy_version 1158334 (0.0006) [2023-12-28 03:35:02,458][106225] Updated weights for policy 1, policy_version 1161413 (0.0010) [2023-12-28 03:35:02,490][106226] Updated weights for policy 0, policy_version 1158344 (0.0006) [2023-12-28 03:35:02,544][106226] Updated weights for policy 0, policy_version 1158354 (0.0008) [2023-12-28 03:35:03,165][106225] Updated weights for policy 1, policy_version 1161423 (0.0008) [2023-12-28 03:35:03,215][106225] Updated weights for policy 1, policy_version 1161433 (0.0005) [2023-12-28 03:35:03,266][106225] Updated weights for policy 1, policy_version 1161443 (0.0005) [2023-12-28 03:35:03,324][106226] Updated weights for policy 0, policy_version 1158364 (0.0008) [2023-12-28 03:35:03,394][106226] Updated weights for policy 0, policy_version 1158374 (0.0008) [2023-12-28 03:35:03,455][106226] Updated weights for policy 0, policy_version 1158384 (0.0009) [2023-12-28 03:35:03,806][106225] Updated weights for policy 1, policy_version 1161453 (0.0005) [2023-12-28 03:35:03,861][106225] Updated weights for policy 1, policy_version 1161463 (0.0007) [2023-12-28 03:35:03,923][106225] Updated weights for policy 1, policy_version 1161473 (0.0006) [2023-12-28 03:35:04,175][106226] Updated weights for policy 0, policy_version 1158394 (0.0007) [2023-12-28 03:35:04,243][106226] Updated weights for policy 0, policy_version 1158404 (0.0008) [2023-12-28 03:35:04,299][106226] Updated weights for policy 0, policy_version 1158414 (0.0007) [2023-12-28 03:35:04,350][106226] Updated weights for policy 0, policy_version 1158424 (0.0006) [2023-12-28 03:35:04,648][106225] Updated weights for policy 1, policy_version 1161483 (0.0006) [2023-12-28 03:35:04,705][106225] Updated weights for policy 1, policy_version 1161493 (0.0007) [2023-12-28 03:35:04,763][106225] Updated weights for policy 1, policy_version 1161503 (0.0005) [2023-12-28 03:35:05,033][106226] Updated weights for policy 0, policy_version 1158434 (0.0011) [2023-12-28 03:35:05,086][106226] Updated weights for policy 0, policy_version 1158444 (0.0010) [2023-12-28 03:35:05,137][106226] Updated weights for policy 0, policy_version 1158454 (0.0010) [2023-12-28 03:35:05,434][106225] Updated weights for policy 1, policy_version 1161513 (0.0007) [2023-12-28 03:35:05,486][106225] Updated weights for policy 1, policy_version 1161523 (0.0007) [2023-12-28 03:35:05,551][106225] Updated weights for policy 1, policy_version 1161533 (0.0008) [2023-12-28 03:35:05,605][106225] Updated weights for policy 1, policy_version 1161543 (0.0006) [2023-12-28 03:35:05,863][106226] Updated weights for policy 0, policy_version 1158464 (0.0011) [2023-12-28 03:35:05,928][106226] Updated weights for policy 0, policy_version 1158474 (0.0008) [2023-12-28 03:35:05,985][106226] Updated weights for policy 0, policy_version 1158484 (0.0010) [2023-12-28 03:35:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 594034688. Throughput: 0: 9937.8, 1: 9801.1. Samples: 594043296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 03:35:06,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.735')] [2023-12-28 03:35:06,290][106225] Updated weights for policy 1, policy_version 1161553 (0.0008) [2023-12-28 03:35:06,349][106225] Updated weights for policy 1, policy_version 1161563 (0.0008) [2023-12-28 03:35:06,415][106225] Updated weights for policy 1, policy_version 1161573 (0.0008) [2023-12-28 03:35:06,654][106226] Updated weights for policy 0, policy_version 1158494 (0.0011) [2023-12-28 03:35:06,719][106226] Updated weights for policy 0, policy_version 1158504 (0.0011) [2023-12-28 03:35:06,783][106226] Updated weights for policy 0, policy_version 1158514 (0.0011) [2023-12-28 03:35:07,163][106225] Updated weights for policy 1, policy_version 1161583 (0.0008) [2023-12-28 03:35:07,220][106225] Updated weights for policy 1, policy_version 1161593 (0.0006) [2023-12-28 03:35:07,278][106225] Updated weights for policy 1, policy_version 1161603 (0.0006) [2023-12-28 03:35:07,486][106226] Updated weights for policy 0, policy_version 1158524 (0.0011) [2023-12-28 03:35:07,549][106226] Updated weights for policy 0, policy_version 1158534 (0.0011) [2023-12-28 03:35:07,605][106226] Updated weights for policy 0, policy_version 1158544 (0.0010) [2023-12-28 03:35:07,811][106225] Updated weights for policy 1, policy_version 1161613 (0.0005) [2023-12-28 03:35:07,868][106225] Updated weights for policy 1, policy_version 1161623 (0.0005) [2023-12-28 03:35:07,928][106225] Updated weights for policy 1, policy_version 1161633 (0.0006) [2023-12-28 03:35:08,309][106226] Updated weights for policy 0, policy_version 1158554 (0.0011) [2023-12-28 03:35:08,377][106226] Updated weights for policy 0, policy_version 1158564 (0.0011) [2023-12-28 03:35:08,441][106226] Updated weights for policy 0, policy_version 1158574 (0.0009) [2023-12-28 03:35:08,504][106226] Updated weights for policy 0, policy_version 1158584 (0.0005) [2023-12-28 03:35:08,527][106225] Updated weights for policy 1, policy_version 1161643 (0.0008) [2023-12-28 03:35:08,586][106225] Updated weights for policy 1, policy_version 1161653 (0.0008) [2023-12-28 03:35:08,641][106225] Updated weights for policy 1, policy_version 1161663 (0.0008) [2023-12-28 03:35:09,144][106226] Updated weights for policy 0, policy_version 1158594 (0.0010) [2023-12-28 03:35:09,208][106226] Updated weights for policy 0, policy_version 1158604 (0.0011) [2023-12-28 03:35:09,277][106226] Updated weights for policy 0, policy_version 1158614 (0.0011) [2023-12-28 03:35:09,416][106225] Updated weights for policy 1, policy_version 1161673 (0.0008) [2023-12-28 03:35:09,480][106225] Updated weights for policy 1, policy_version 1161683 (0.0008) [2023-12-28 03:35:09,535][106225] Updated weights for policy 1, policy_version 1161693 (0.0010) [2023-12-28 03:35:09,588][106225] Updated weights for policy 1, policy_version 1161703 (0.0010) [2023-12-28 03:35:10,062][106226] Updated weights for policy 0, policy_version 1158624 (0.0007) [2023-12-28 03:35:10,135][106226] Updated weights for policy 0, policy_version 1158634 (0.0006) [2023-12-28 03:35:10,203][106226] Updated weights for policy 0, policy_version 1158644 (0.0007) [2023-12-28 03:35:10,364][106225] Updated weights for policy 1, policy_version 1161713 (0.0010) [2023-12-28 03:35:10,432][106225] Updated weights for policy 1, policy_version 1161723 (0.0011) [2023-12-28 03:35:10,490][106225] Updated weights for policy 1, policy_version 1161733 (0.0010) [2023-12-28 03:35:10,854][106226] Updated weights for policy 0, policy_version 1158654 (0.0009) [2023-12-28 03:35:10,918][106226] Updated weights for policy 0, policy_version 1158664 (0.0011) [2023-12-28 03:35:10,982][106226] Updated weights for policy 0, policy_version 1158674 (0.0011) [2023-12-28 03:35:11,159][106225] Updated weights for policy 1, policy_version 1161743 (0.0010) [2023-12-28 03:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 594132992. Throughput: 0: 9951.3, 1: 9857.4. Samples: 594105056. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:11,178][105115] Avg episode reward: [(0, '-4.536'), (1, '-4.829')] [2023-12-28 03:35:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001158680_296681472.pth... [2023-12-28 03:35:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001157528_296386560.pth [2023-12-28 03:35:11,229][106225] Updated weights for policy 1, policy_version 1161753 (0.0009) [2023-12-28 03:35:11,295][106225] Updated weights for policy 1, policy_version 1161763 (0.0009) [2023-12-28 03:35:11,323][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001161768_297459712.pth... [2023-12-28 03:35:11,327][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001160616_297164800.pth [2023-12-28 03:35:11,823][106226] Updated weights for policy 0, policy_version 1158684 (0.0009) [2023-12-28 03:35:11,882][106226] Updated weights for policy 0, policy_version 1158694 (0.0008) [2023-12-28 03:35:11,947][106226] Updated weights for policy 0, policy_version 1158704 (0.0008) [2023-12-28 03:35:12,048][106225] Updated weights for policy 1, policy_version 1161773 (0.0007) [2023-12-28 03:35:12,110][106225] Updated weights for policy 1, policy_version 1161783 (0.0008) [2023-12-28 03:35:12,166][106225] Updated weights for policy 1, policy_version 1161793 (0.0007) [2023-12-28 03:35:12,690][106226] Updated weights for policy 0, policy_version 1158714 (0.0008) [2023-12-28 03:35:12,739][106226] Updated weights for policy 0, policy_version 1158724 (0.0009) [2023-12-28 03:35:12,791][106226] Updated weights for policy 0, policy_version 1158734 (0.0006) [2023-12-28 03:35:12,841][106226] Updated weights for policy 0, policy_version 1158744 (0.0005) [2023-12-28 03:35:12,937][106225] Updated weights for policy 1, policy_version 1161803 (0.0007) [2023-12-28 03:35:12,987][106225] Updated weights for policy 1, policy_version 1161813 (0.0009) [2023-12-28 03:35:13,039][106225] Updated weights for policy 1, policy_version 1161823 (0.0008) [2023-12-28 03:35:13,523][106226] Updated weights for policy 0, policy_version 1158754 (0.0008) [2023-12-28 03:35:13,585][106226] Updated weights for policy 0, policy_version 1158764 (0.0007) [2023-12-28 03:35:13,644][106226] Updated weights for policy 0, policy_version 1158774 (0.0005) [2023-12-28 03:35:13,710][106225] Updated weights for policy 1, policy_version 1161833 (0.0010) [2023-12-28 03:35:13,775][106225] Updated weights for policy 1, policy_version 1161843 (0.0010) [2023-12-28 03:35:13,841][106225] Updated weights for policy 1, policy_version 1161853 (0.0008) [2023-12-28 03:35:13,904][106225] Updated weights for policy 1, policy_version 1161863 (0.0008) [2023-12-28 03:35:14,335][106226] Updated weights for policy 0, policy_version 1158784 (0.0007) [2023-12-28 03:35:14,395][106226] Updated weights for policy 0, policy_version 1158794 (0.0007) [2023-12-28 03:35:14,459][106226] Updated weights for policy 0, policy_version 1158804 (0.0008) [2023-12-28 03:35:14,588][106225] Updated weights for policy 1, policy_version 1161873 (0.0010) [2023-12-28 03:35:14,649][106225] Updated weights for policy 1, policy_version 1161883 (0.0010) [2023-12-28 03:35:14,714][106225] Updated weights for policy 1, policy_version 1161893 (0.0010) [2023-12-28 03:35:15,137][106226] Updated weights for policy 0, policy_version 1158814 (0.0007) [2023-12-28 03:35:15,202][106226] Updated weights for policy 0, policy_version 1158824 (0.0009) [2023-12-28 03:35:15,262][106226] Updated weights for policy 0, policy_version 1158834 (0.0009) [2023-12-28 03:35:15,457][106225] Updated weights for policy 1, policy_version 1161903 (0.0009) [2023-12-28 03:35:15,524][106225] Updated weights for policy 1, policy_version 1161914 (0.0009) [2023-12-28 03:35:15,583][106225] Updated weights for policy 1, policy_version 1161924 (0.0008) [2023-12-28 03:35:15,897][106226] Updated weights for policy 0, policy_version 1158844 (0.0009) [2023-12-28 03:35:15,948][106226] Updated weights for policy 0, policy_version 1158854 (0.0008) [2023-12-28 03:35:16,004][106226] Updated weights for policy 0, policy_version 1158864 (0.0007) [2023-12-28 03:35:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 594231296. Throughput: 0: 9824.9, 1: 9690.8. Samples: 594219832. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:16,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-4.847')] [2023-12-28 03:35:16,277][106225] Updated weights for policy 1, policy_version 1161934 (0.0009) [2023-12-28 03:35:16,333][106225] Updated weights for policy 1, policy_version 1161944 (0.0010) [2023-12-28 03:35:16,390][106225] Updated weights for policy 1, policy_version 1161954 (0.0010) [2023-12-28 03:35:16,722][106226] Updated weights for policy 0, policy_version 1158874 (0.0007) [2023-12-28 03:35:16,781][106226] Updated weights for policy 0, policy_version 1158884 (0.0010) [2023-12-28 03:35:16,840][106226] Updated weights for policy 0, policy_version 1158894 (0.0010) [2023-12-28 03:35:16,899][106226] Updated weights for policy 0, policy_version 1158904 (0.0010) [2023-12-28 03:35:17,049][106225] Updated weights for policy 1, policy_version 1161964 (0.0009) [2023-12-28 03:35:17,098][106225] Updated weights for policy 1, policy_version 1161974 (0.0006) [2023-12-28 03:35:17,156][106225] Updated weights for policy 1, policy_version 1161984 (0.0005) [2023-12-28 03:35:17,615][106226] Updated weights for policy 0, policy_version 1158914 (0.0011) [2023-12-28 03:35:17,683][106226] Updated weights for policy 0, policy_version 1158924 (0.0009) [2023-12-28 03:35:17,753][106226] Updated weights for policy 0, policy_version 1158934 (0.0009) [2023-12-28 03:35:17,798][106225] Updated weights for policy 1, policy_version 1161994 (0.0006) [2023-12-28 03:35:17,860][106225] Updated weights for policy 1, policy_version 1162004 (0.0008) [2023-12-28 03:35:17,923][106225] Updated weights for policy 1, policy_version 1162014 (0.0008) [2023-12-28 03:35:17,989][106225] Updated weights for policy 1, policy_version 1162024 (0.0006) [2023-12-28 03:35:18,542][106226] Updated weights for policy 0, policy_version 1158944 (0.0010) [2023-12-28 03:35:18,581][106225] Updated weights for policy 1, policy_version 1162034 (0.0007) [2023-12-28 03:35:18,602][106226] Updated weights for policy 0, policy_version 1158954 (0.0010) [2023-12-28 03:35:18,637][106225] Updated weights for policy 1, policy_version 1162044 (0.0006) [2023-12-28 03:35:18,667][106226] Updated weights for policy 0, policy_version 1158964 (0.0006) [2023-12-28 03:35:18,697][106225] Updated weights for policy 1, policy_version 1162054 (0.0009) [2023-12-28 03:35:19,457][106226] Updated weights for policy 0, policy_version 1158974 (0.0008) [2023-12-28 03:35:19,462][106225] Updated weights for policy 1, policy_version 1162064 (0.0007) [2023-12-28 03:35:19,531][106225] Updated weights for policy 1, policy_version 1162074 (0.0008) [2023-12-28 03:35:19,533][106226] Updated weights for policy 0, policy_version 1158984 (0.0008) [2023-12-28 03:35:19,600][106225] Updated weights for policy 1, policy_version 1162084 (0.0009) [2023-12-28 03:35:19,604][106226] Updated weights for policy 0, policy_version 1158994 (0.0008) [2023-12-28 03:35:20,396][106226] Updated weights for policy 0, policy_version 1159004 (0.0008) [2023-12-28 03:35:20,406][106225] Updated weights for policy 1, policy_version 1162094 (0.0007) [2023-12-28 03:35:20,456][106226] Updated weights for policy 0, policy_version 1159014 (0.0006) [2023-12-28 03:35:20,465][106225] Updated weights for policy 1, policy_version 1162104 (0.0008) [2023-12-28 03:35:20,520][106226] Updated weights for policy 0, policy_version 1159024 (0.0006) [2023-12-28 03:35:20,526][106225] Updated weights for policy 1, policy_version 1162114 (0.0007) [2023-12-28 03:35:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 594321408. Throughput: 0: 9734.5, 1: 9682.3. Samples: 594334392. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:21,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.983')] [2023-12-28 03:35:21,322][106225] Updated weights for policy 1, policy_version 1162124 (0.0008) [2023-12-28 03:35:21,359][106226] Updated weights for policy 0, policy_version 1159034 (0.0007) [2023-12-28 03:35:21,393][106225] Updated weights for policy 1, policy_version 1162134 (0.0011) [2023-12-28 03:35:21,446][106226] Updated weights for policy 0, policy_version 1159046 (0.0008) [2023-12-28 03:35:21,455][106225] Updated weights for policy 1, policy_version 1162144 (0.0011) [2023-12-28 03:35:21,502][106226] Updated weights for policy 0, policy_version 1159056 (0.0008) [2023-12-28 03:35:22,166][106225] Updated weights for policy 1, policy_version 1162154 (0.0011) [2023-12-28 03:35:22,216][106225] Updated weights for policy 1, policy_version 1162164 (0.0007) [2023-12-28 03:35:22,265][106226] Updated weights for policy 0, policy_version 1159066 (0.0009) [2023-12-28 03:35:22,278][106225] Updated weights for policy 1, policy_version 1162174 (0.0008) [2023-12-28 03:35:22,331][106226] Updated weights for policy 0, policy_version 1159076 (0.0008) [2023-12-28 03:35:22,344][106225] Updated weights for policy 1, policy_version 1162184 (0.0009) [2023-12-28 03:35:22,396][106226] Updated weights for policy 0, policy_version 1159086 (0.0008) [2023-12-28 03:35:22,466][106226] Updated weights for policy 0, policy_version 1159096 (0.0007) [2023-12-28 03:35:23,058][106225] Updated weights for policy 1, policy_version 1162194 (0.0009) [2023-12-28 03:35:23,119][106225] Updated weights for policy 1, policy_version 1162204 (0.0009) [2023-12-28 03:35:23,184][106225] Updated weights for policy 1, policy_version 1162214 (0.0008) [2023-12-28 03:35:23,240][106226] Updated weights for policy 0, policy_version 1159106 (0.0009) [2023-12-28 03:35:23,293][106226] Updated weights for policy 0, policy_version 1159116 (0.0008) [2023-12-28 03:35:23,350][106226] Updated weights for policy 0, policy_version 1159126 (0.0009) [2023-12-28 03:35:23,892][106225] Updated weights for policy 1, policy_version 1162224 (0.0010) [2023-12-28 03:35:23,953][106225] Updated weights for policy 1, policy_version 1162234 (0.0009) [2023-12-28 03:35:24,010][106225] Updated weights for policy 1, policy_version 1162244 (0.0008) [2023-12-28 03:35:24,072][106226] Updated weights for policy 0, policy_version 1159137 (0.0009) [2023-12-28 03:35:24,129][106226] Updated weights for policy 0, policy_version 1159147 (0.0008) [2023-12-28 03:35:24,177][106226] Updated weights for policy 0, policy_version 1159157 (0.0008) [2023-12-28 03:35:24,711][106225] Updated weights for policy 1, policy_version 1162254 (0.0005) [2023-12-28 03:35:24,776][106225] Updated weights for policy 1, policy_version 1162264 (0.0005) [2023-12-28 03:35:24,831][106225] Updated weights for policy 1, policy_version 1162274 (0.0006) [2023-12-28 03:35:24,879][106226] Updated weights for policy 0, policy_version 1159167 (0.0008) [2023-12-28 03:35:24,930][106226] Updated weights for policy 0, policy_version 1159177 (0.0008) [2023-12-28 03:35:24,981][106226] Updated weights for policy 0, policy_version 1159187 (0.0007) [2023-12-28 03:35:25,469][106225] Updated weights for policy 1, policy_version 1162284 (0.0007) [2023-12-28 03:35:25,519][106225] Updated weights for policy 1, policy_version 1162294 (0.0010) [2023-12-28 03:35:25,565][106225] Updated weights for policy 1, policy_version 1162304 (0.0010) [2023-12-28 03:35:25,725][106226] Updated weights for policy 0, policy_version 1159197 (0.0009) [2023-12-28 03:35:25,784][106226] Updated weights for policy 0, policy_version 1159207 (0.0010) [2023-12-28 03:35:25,840][106226] Updated weights for policy 0, policy_version 1159217 (0.0010) [2023-12-28 03:35:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 594419712. Throughput: 0: 9706.1, 1: 9639.4. Samples: 594390100. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:26,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.718')] [2023-12-28 03:35:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001159224_296820736.pth... [2023-12-28 03:35:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001158104_296534016.pth [2023-12-28 03:35:26,200][106225] Updated weights for policy 1, policy_version 1162314 (0.0009) [2023-12-28 03:35:26,259][106225] Updated weights for policy 1, policy_version 1162324 (0.0007) [2023-12-28 03:35:26,319][106225] Updated weights for policy 1, policy_version 1162334 (0.0008) [2023-12-28 03:35:26,382][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001162344_297607168.pth... [2023-12-28 03:35:26,384][106225] Updated weights for policy 1, policy_version 1162344 (0.0008) [2023-12-28 03:35:26,386][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001161192_297312256.pth [2023-12-28 03:35:26,556][106226] Updated weights for policy 0, policy_version 1159227 (0.0009) [2023-12-28 03:35:26,609][106226] Updated weights for policy 0, policy_version 1159237 (0.0006) [2023-12-28 03:35:26,658][106226] Updated weights for policy 0, policy_version 1159247 (0.0010) [2023-12-28 03:35:27,032][106225] Updated weights for policy 1, policy_version 1162354 (0.0010) [2023-12-28 03:35:27,087][106225] Updated weights for policy 1, policy_version 1162364 (0.0010) [2023-12-28 03:35:27,146][106225] Updated weights for policy 1, policy_version 1162374 (0.0010) [2023-12-28 03:35:27,313][106226] Updated weights for policy 0, policy_version 1159257 (0.0010) [2023-12-28 03:35:27,370][106226] Updated weights for policy 0, policy_version 1159267 (0.0010) [2023-12-28 03:35:27,429][106226] Updated weights for policy 0, policy_version 1159277 (0.0010) [2023-12-28 03:35:27,490][106226] Updated weights for policy 0, policy_version 1159287 (0.0011) [2023-12-28 03:35:27,831][106225] Updated weights for policy 1, policy_version 1162384 (0.0006) [2023-12-28 03:35:27,876][106225] Updated weights for policy 1, policy_version 1162394 (0.0005) [2023-12-28 03:35:27,926][106225] Updated weights for policy 1, policy_version 1162404 (0.0005) [2023-12-28 03:35:28,166][106226] Updated weights for policy 0, policy_version 1159297 (0.0011) [2023-12-28 03:35:28,212][106226] Updated weights for policy 0, policy_version 1159307 (0.0010) [2023-12-28 03:35:28,269][106226] Updated weights for policy 0, policy_version 1159317 (0.0010) [2023-12-28 03:35:28,472][106225] Updated weights for policy 1, policy_version 1162414 (0.0008) [2023-12-28 03:35:28,523][106225] Updated weights for policy 1, policy_version 1162424 (0.0010) [2023-12-28 03:35:28,584][106225] Updated weights for policy 1, policy_version 1162434 (0.0010) [2023-12-28 03:35:29,001][106226] Updated weights for policy 0, policy_version 1159327 (0.0009) [2023-12-28 03:35:29,043][106226] Updated weights for policy 0, policy_version 1159337 (0.0007) [2023-12-28 03:35:29,090][106226] Updated weights for policy 0, policy_version 1159347 (0.0008) [2023-12-28 03:35:29,307][106225] Updated weights for policy 1, policy_version 1162444 (0.0010) [2023-12-28 03:35:29,369][106225] Updated weights for policy 1, policy_version 1162454 (0.0008) [2023-12-28 03:35:29,427][106225] Updated weights for policy 1, policy_version 1162464 (0.0010) [2023-12-28 03:35:29,865][106226] Updated weights for policy 0, policy_version 1159357 (0.0008) [2023-12-28 03:35:29,922][106226] Updated weights for policy 0, policy_version 1159367 (0.0008) [2023-12-28 03:35:29,984][106226] Updated weights for policy 0, policy_version 1159377 (0.0008) [2023-12-28 03:35:30,173][106225] Updated weights for policy 1, policy_version 1162474 (0.0011) [2023-12-28 03:35:30,227][106225] Updated weights for policy 1, policy_version 1162484 (0.0010) [2023-12-28 03:35:30,284][106225] Updated weights for policy 1, policy_version 1162494 (0.0010) [2023-12-28 03:35:30,341][106225] Updated weights for policy 1, policy_version 1162504 (0.0010) [2023-12-28 03:35:30,694][106226] Updated weights for policy 0, policy_version 1159387 (0.0007) [2023-12-28 03:35:30,752][106226] Updated weights for policy 0, policy_version 1159397 (0.0005) [2023-12-28 03:35:30,806][106226] Updated weights for policy 0, policy_version 1159407 (0.0005) [2023-12-28 03:35:31,046][106225] Updated weights for policy 1, policy_version 1162514 (0.0008) [2023-12-28 03:35:31,114][106225] Updated weights for policy 1, policy_version 1162524 (0.0010) [2023-12-28 03:35:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 594518016. Throughput: 0: 9711.9, 1: 9761.6. Samples: 594510808. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:31,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-4.720')] [2023-12-28 03:35:31,182][106225] Updated weights for policy 1, policy_version 1162534 (0.0008) [2023-12-28 03:35:31,497][106226] Updated weights for policy 0, policy_version 1159417 (0.0007) [2023-12-28 03:35:31,556][106226] Updated weights for policy 0, policy_version 1159427 (0.0007) [2023-12-28 03:35:31,606][106226] Updated weights for policy 0, policy_version 1159437 (0.0009) [2023-12-28 03:35:31,672][106226] Updated weights for policy 0, policy_version 1159447 (0.0008) [2023-12-28 03:35:31,901][106225] Updated weights for policy 1, policy_version 1162544 (0.0006) [2023-12-28 03:35:31,958][106225] Updated weights for policy 1, policy_version 1162554 (0.0005) [2023-12-28 03:35:32,011][106225] Updated weights for policy 1, policy_version 1162564 (0.0006) [2023-12-28 03:35:32,260][106226] Updated weights for policy 0, policy_version 1159457 (0.0008) [2023-12-28 03:35:32,324][106226] Updated weights for policy 0, policy_version 1159467 (0.0006) [2023-12-28 03:35:32,390][106226] Updated weights for policy 0, policy_version 1159477 (0.0007) [2023-12-28 03:35:32,701][106225] Updated weights for policy 1, policy_version 1162574 (0.0007) [2023-12-28 03:35:32,760][106225] Updated weights for policy 1, policy_version 1162584 (0.0009) [2023-12-28 03:35:32,819][106225] Updated weights for policy 1, policy_version 1162594 (0.0009) [2023-12-28 03:35:32,959][106226] Updated weights for policy 0, policy_version 1159487 (0.0005) [2023-12-28 03:35:33,013][106226] Updated weights for policy 0, policy_version 1159497 (0.0008) [2023-12-28 03:35:33,068][106226] Updated weights for policy 0, policy_version 1159507 (0.0007) [2023-12-28 03:35:33,584][106225] Updated weights for policy 1, policy_version 1162604 (0.0007) [2023-12-28 03:35:33,638][106225] Updated weights for policy 1, policy_version 1162614 (0.0005) [2023-12-28 03:35:33,692][106225] Updated weights for policy 1, policy_version 1162624 (0.0005) [2023-12-28 03:35:33,745][106226] Updated weights for policy 0, policy_version 1159517 (0.0008) [2023-12-28 03:35:33,801][106226] Updated weights for policy 0, policy_version 1159527 (0.0010) [2023-12-28 03:35:33,853][106226] Updated weights for policy 0, policy_version 1159537 (0.0008) [2023-12-28 03:35:34,204][106225] Updated weights for policy 1, policy_version 1162634 (0.0006) [2023-12-28 03:35:34,262][106225] Updated weights for policy 1, policy_version 1162644 (0.0008) [2023-12-28 03:35:34,314][106225] Updated weights for policy 1, policy_version 1162654 (0.0008) [2023-12-28 03:35:34,367][106225] Updated weights for policy 1, policy_version 1162664 (0.0007) [2023-12-28 03:35:34,513][106226] Updated weights for policy 0, policy_version 1159547 (0.0007) [2023-12-28 03:35:34,575][106226] Updated weights for policy 0, policy_version 1159557 (0.0011) [2023-12-28 03:35:34,636][106226] Updated weights for policy 0, policy_version 1159567 (0.0010) [2023-12-28 03:35:35,106][106225] Updated weights for policy 1, policy_version 1162674 (0.0010) [2023-12-28 03:35:35,162][106225] Updated weights for policy 1, policy_version 1162684 (0.0010) [2023-12-28 03:35:35,212][106225] Updated weights for policy 1, policy_version 1162694 (0.0010) [2023-12-28 03:35:35,330][106226] Updated weights for policy 0, policy_version 1159577 (0.0010) [2023-12-28 03:35:35,387][106226] Updated weights for policy 0, policy_version 1159587 (0.0011) [2023-12-28 03:35:35,450][106226] Updated weights for policy 0, policy_version 1159597 (0.0010) [2023-12-28 03:35:35,513][106226] Updated weights for policy 0, policy_version 1159607 (0.0011) [2023-12-28 03:35:35,935][106225] Updated weights for policy 1, policy_version 1162704 (0.0008) [2023-12-28 03:35:35,989][106225] Updated weights for policy 1, policy_version 1162714 (0.0008) [2023-12-28 03:35:36,052][106225] Updated weights for policy 1, policy_version 1162724 (0.0006) [2023-12-28 03:35:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 594624512. Throughput: 0: 9840.4, 1: 9784.0. Samples: 594633804. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:36,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.459')] [2023-12-28 03:35:36,227][106226] Updated weights for policy 0, policy_version 1159617 (0.0008) [2023-12-28 03:35:36,290][106226] Updated weights for policy 0, policy_version 1159627 (0.0008) [2023-12-28 03:35:36,355][106226] Updated weights for policy 0, policy_version 1159637 (0.0009) [2023-12-28 03:35:36,784][106225] Updated weights for policy 1, policy_version 1162734 (0.0007) [2023-12-28 03:35:36,833][106225] Updated weights for policy 1, policy_version 1162744 (0.0007) [2023-12-28 03:35:36,877][106225] Updated weights for policy 1, policy_version 1162754 (0.0008) [2023-12-28 03:35:37,025][106226] Updated weights for policy 0, policy_version 1159647 (0.0009) [2023-12-28 03:35:37,084][106226] Updated weights for policy 0, policy_version 1159657 (0.0009) [2023-12-28 03:35:37,145][106226] Updated weights for policy 0, policy_version 1159667 (0.0008) [2023-12-28 03:35:37,542][106225] Updated weights for policy 1, policy_version 1162764 (0.0007) [2023-12-28 03:35:37,591][106225] Updated weights for policy 1, policy_version 1162774 (0.0005) [2023-12-28 03:35:37,652][106225] Updated weights for policy 1, policy_version 1162784 (0.0007) [2023-12-28 03:35:37,909][106226] Updated weights for policy 0, policy_version 1159677 (0.0008) [2023-12-28 03:35:37,972][106226] Updated weights for policy 0, policy_version 1159687 (0.0009) [2023-12-28 03:35:38,037][106226] Updated weights for policy 0, policy_version 1159697 (0.0007) [2023-12-28 03:35:38,275][106225] Updated weights for policy 1, policy_version 1162794 (0.0009) [2023-12-28 03:35:38,332][106225] Updated weights for policy 1, policy_version 1162804 (0.0009) [2023-12-28 03:35:38,388][106225] Updated weights for policy 1, policy_version 1162814 (0.0009) [2023-12-28 03:35:38,442][106225] Updated weights for policy 1, policy_version 1162824 (0.0010) [2023-12-28 03:35:38,759][106226] Updated weights for policy 0, policy_version 1159707 (0.0009) [2023-12-28 03:35:38,812][106226] Updated weights for policy 0, policy_version 1159717 (0.0010) [2023-12-28 03:35:38,873][106226] Updated weights for policy 0, policy_version 1159727 (0.0011) [2023-12-28 03:35:39,197][106225] Updated weights for policy 1, policy_version 1162834 (0.0010) [2023-12-28 03:35:39,266][106225] Updated weights for policy 1, policy_version 1162844 (0.0010) [2023-12-28 03:35:39,328][106225] Updated weights for policy 1, policy_version 1162854 (0.0006) [2023-12-28 03:35:39,569][106226] Updated weights for policy 0, policy_version 1159737 (0.0011) [2023-12-28 03:35:39,634][106226] Updated weights for policy 0, policy_version 1159747 (0.0011) [2023-12-28 03:35:39,709][106226] Updated weights for policy 0, policy_version 1159757 (0.0011) [2023-12-28 03:35:39,784][106226] Updated weights for policy 0, policy_version 1159767 (0.0011) [2023-12-28 03:35:40,077][106225] Updated weights for policy 1, policy_version 1162864 (0.0007) [2023-12-28 03:35:40,140][106225] Updated weights for policy 1, policy_version 1162874 (0.0007) [2023-12-28 03:35:40,194][106225] Updated weights for policy 1, policy_version 1162884 (0.0006) [2023-12-28 03:35:40,492][106226] Updated weights for policy 0, policy_version 1159777 (0.0011) [2023-12-28 03:35:40,556][106226] Updated weights for policy 0, policy_version 1159787 (0.0011) [2023-12-28 03:35:40,609][106226] Updated weights for policy 0, policy_version 1159797 (0.0011) [2023-12-28 03:35:40,894][106225] Updated weights for policy 1, policy_version 1162894 (0.0006) [2023-12-28 03:35:40,960][106225] Updated weights for policy 1, policy_version 1162904 (0.0007) [2023-12-28 03:35:41,029][106225] Updated weights for policy 1, policy_version 1162914 (0.0008) [2023-12-28 03:35:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 594722816. Throughput: 0: 9795.5, 1: 9851.9. Samples: 594693176. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:41,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.780')] [2023-12-28 03:35:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001162920_297754624.pth... [2023-12-28 03:35:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001159800_296968192.pth... [2023-12-28 03:35:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001158680_296681472.pth [2023-12-28 03:35:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001161768_297459712.pth [2023-12-28 03:35:41,314][106226] Updated weights for policy 0, policy_version 1159807 (0.0011) [2023-12-28 03:35:41,383][106226] Updated weights for policy 0, policy_version 1159817 (0.0009) [2023-12-28 03:35:41,451][106226] Updated weights for policy 0, policy_version 1159827 (0.0011) [2023-12-28 03:35:41,797][106225] Updated weights for policy 1, policy_version 1162924 (0.0008) [2023-12-28 03:35:41,857][106225] Updated weights for policy 1, policy_version 1162934 (0.0008) [2023-12-28 03:35:41,912][106225] Updated weights for policy 1, policy_version 1162944 (0.0008) [2023-12-28 03:35:42,217][106226] Updated weights for policy 0, policy_version 1159837 (0.0010) [2023-12-28 03:35:42,281][106226] Updated weights for policy 0, policy_version 1159847 (0.0008) [2023-12-28 03:35:42,349][106226] Updated weights for policy 0, policy_version 1159857 (0.0009) [2023-12-28 03:35:42,658][106225] Updated weights for policy 1, policy_version 1162954 (0.0008) [2023-12-28 03:35:42,710][106225] Updated weights for policy 1, policy_version 1162964 (0.0010) [2023-12-28 03:35:42,771][106225] Updated weights for policy 1, policy_version 1162974 (0.0010) [2023-12-28 03:35:42,832][106225] Updated weights for policy 1, policy_version 1162984 (0.0010) [2023-12-28 03:35:43,093][106226] Updated weights for policy 0, policy_version 1159867 (0.0007) [2023-12-28 03:35:43,151][106226] Updated weights for policy 0, policy_version 1159877 (0.0008) [2023-12-28 03:35:43,213][106226] Updated weights for policy 0, policy_version 1159887 (0.0008) [2023-12-28 03:35:43,536][106225] Updated weights for policy 1, policy_version 1162994 (0.0008) [2023-12-28 03:35:43,601][106225] Updated weights for policy 1, policy_version 1163004 (0.0010) [2023-12-28 03:35:43,664][106225] Updated weights for policy 1, policy_version 1163014 (0.0010) [2023-12-28 03:35:43,945][106226] Updated weights for policy 0, policy_version 1159897 (0.0008) [2023-12-28 03:35:43,996][106226] Updated weights for policy 0, policy_version 1159907 (0.0007) [2023-12-28 03:35:44,054][106226] Updated weights for policy 0, policy_version 1159917 (0.0009) [2023-12-28 03:35:44,104][106226] Updated weights for policy 0, policy_version 1159927 (0.0010) [2023-12-28 03:35:44,351][106225] Updated weights for policy 1, policy_version 1163024 (0.0010) [2023-12-28 03:35:44,409][106225] Updated weights for policy 1, policy_version 1163034 (0.0010) [2023-12-28 03:35:44,453][106225] Updated weights for policy 1, policy_version 1163044 (0.0009) [2023-12-28 03:35:44,793][106226] Updated weights for policy 0, policy_version 1159937 (0.0009) [2023-12-28 03:35:44,855][106226] Updated weights for policy 0, policy_version 1159947 (0.0011) [2023-12-28 03:35:44,919][106226] Updated weights for policy 0, policy_version 1159957 (0.0011) [2023-12-28 03:35:45,086][106225] Updated weights for policy 1, policy_version 1163054 (0.0007) [2023-12-28 03:35:45,153][106225] Updated weights for policy 1, policy_version 1163064 (0.0008) [2023-12-28 03:35:45,212][106225] Updated weights for policy 1, policy_version 1163074 (0.0008) [2023-12-28 03:35:45,645][106226] Updated weights for policy 0, policy_version 1159967 (0.0010) [2023-12-28 03:35:45,698][106226] Updated weights for policy 0, policy_version 1159977 (0.0009) [2023-12-28 03:35:45,752][106226] Updated weights for policy 0, policy_version 1159987 (0.0009) [2023-12-28 03:35:45,875][106225] Updated weights for policy 1, policy_version 1163084 (0.0007) [2023-12-28 03:35:45,938][106225] Updated weights for policy 1, policy_version 1163094 (0.0006) [2023-12-28 03:35:46,006][106225] Updated weights for policy 1, policy_version 1163104 (0.0005) [2023-12-28 03:35:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 594821120. Throughput: 0: 9734.3, 1: 9909.5. Samples: 594808364. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:46,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.458')] [2023-12-28 03:35:46,396][106226] Updated weights for policy 0, policy_version 1159997 (0.0008) [2023-12-28 03:35:46,466][106226] Updated weights for policy 0, policy_version 1160007 (0.0006) [2023-12-28 03:35:46,526][106226] Updated weights for policy 0, policy_version 1160017 (0.0008) [2023-12-28 03:35:46,675][106225] Updated weights for policy 1, policy_version 1163114 (0.0008) [2023-12-28 03:35:46,736][106225] Updated weights for policy 1, policy_version 1163124 (0.0006) [2023-12-28 03:35:46,796][106225] Updated weights for policy 1, policy_version 1163134 (0.0006) [2023-12-28 03:35:46,851][106225] Updated weights for policy 1, policy_version 1163144 (0.0006) [2023-12-28 03:35:47,157][106226] Updated weights for policy 0, policy_version 1160027 (0.0007) [2023-12-28 03:35:47,213][106226] Updated weights for policy 0, policy_version 1160037 (0.0008) [2023-12-28 03:35:47,265][106226] Updated weights for policy 0, policy_version 1160047 (0.0006) [2023-12-28 03:35:47,526][106225] Updated weights for policy 1, policy_version 1163154 (0.0010) [2023-12-28 03:35:47,596][106225] Updated weights for policy 1, policy_version 1163164 (0.0009) [2023-12-28 03:35:47,663][106225] Updated weights for policy 1, policy_version 1163174 (0.0009) [2023-12-28 03:35:47,862][106226] Updated weights for policy 0, policy_version 1160057 (0.0006) [2023-12-28 03:35:47,919][106226] Updated weights for policy 0, policy_version 1160067 (0.0007) [2023-12-28 03:35:47,973][106226] Updated weights for policy 0, policy_version 1160077 (0.0008) [2023-12-28 03:35:48,039][106226] Updated weights for policy 0, policy_version 1160087 (0.0008) [2023-12-28 03:35:48,413][106225] Updated weights for policy 1, policy_version 1163184 (0.0010) [2023-12-28 03:35:48,472][106225] Updated weights for policy 1, policy_version 1163194 (0.0010) [2023-12-28 03:35:48,540][106225] Updated weights for policy 1, policy_version 1163204 (0.0010) [2023-12-28 03:35:48,686][106226] Updated weights for policy 0, policy_version 1160097 (0.0009) [2023-12-28 03:35:48,734][106226] Updated weights for policy 0, policy_version 1160107 (0.0010) [2023-12-28 03:35:48,780][106226] Updated weights for policy 0, policy_version 1160117 (0.0010) [2023-12-28 03:35:49,171][106225] Updated weights for policy 1, policy_version 1163214 (0.0010) [2023-12-28 03:35:49,244][106225] Updated weights for policy 1, policy_version 1163224 (0.0011) [2023-12-28 03:35:49,308][106225] Updated weights for policy 1, policy_version 1163234 (0.0006) [2023-12-28 03:35:49,507][106226] Updated weights for policy 0, policy_version 1160127 (0.0009) [2023-12-28 03:35:49,562][106226] Updated weights for policy 0, policy_version 1160137 (0.0008) [2023-12-28 03:35:49,610][106226] Updated weights for policy 0, policy_version 1160147 (0.0008) [2023-12-28 03:35:49,940][106225] Updated weights for policy 1, policy_version 1163244 (0.0007) [2023-12-28 03:35:50,002][106225] Updated weights for policy 1, policy_version 1163254 (0.0009) [2023-12-28 03:35:50,062][106225] Updated weights for policy 1, policy_version 1163264 (0.0008) [2023-12-28 03:35:50,407][106226] Updated weights for policy 0, policy_version 1160157 (0.0007) [2023-12-28 03:35:50,460][106226] Updated weights for policy 0, policy_version 1160167 (0.0010) [2023-12-28 03:35:50,518][106226] Updated weights for policy 0, policy_version 1160177 (0.0010) [2023-12-28 03:35:50,750][106225] Updated weights for policy 1, policy_version 1163274 (0.0008) [2023-12-28 03:35:50,816][106225] Updated weights for policy 1, policy_version 1163284 (0.0008) [2023-12-28 03:35:50,883][106225] Updated weights for policy 1, policy_version 1163294 (0.0008) [2023-12-28 03:35:50,948][106225] Updated weights for policy 1, policy_version 1163304 (0.0008) [2023-12-28 03:35:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 594919424. Throughput: 0: 9761.3, 1: 9940.9. Samples: 594929896. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:51,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.577')] [2023-12-28 03:35:51,284][106226] Updated weights for policy 0, policy_version 1160187 (0.0009) [2023-12-28 03:35:51,346][106226] Updated weights for policy 0, policy_version 1160197 (0.0011) [2023-12-28 03:35:51,424][106226] Updated weights for policy 0, policy_version 1160207 (0.0010) [2023-12-28 03:35:51,657][106225] Updated weights for policy 1, policy_version 1163314 (0.0009) [2023-12-28 03:35:51,725][106225] Updated weights for policy 1, policy_version 1163324 (0.0008) [2023-12-28 03:35:51,796][106225] Updated weights for policy 1, policy_version 1163334 (0.0008) [2023-12-28 03:35:52,125][106226] Updated weights for policy 0, policy_version 1160217 (0.0010) [2023-12-28 03:35:52,180][106226] Updated weights for policy 0, policy_version 1160227 (0.0008) [2023-12-28 03:35:52,234][106226] Updated weights for policy 0, policy_version 1160237 (0.0008) [2023-12-28 03:35:52,302][106226] Updated weights for policy 0, policy_version 1160247 (0.0009) [2023-12-28 03:35:52,519][106225] Updated weights for policy 1, policy_version 1163344 (0.0007) [2023-12-28 03:35:52,579][106225] Updated weights for policy 1, policy_version 1163354 (0.0008) [2023-12-28 03:35:52,649][106225] Updated weights for policy 1, policy_version 1163364 (0.0010) [2023-12-28 03:35:53,010][106226] Updated weights for policy 0, policy_version 1160257 (0.0008) [2023-12-28 03:35:53,069][106226] Updated weights for policy 0, policy_version 1160267 (0.0008) [2023-12-28 03:35:53,120][106226] Updated weights for policy 0, policy_version 1160277 (0.0009) [2023-12-28 03:35:53,264][106225] Updated weights for policy 1, policy_version 1163374 (0.0008) [2023-12-28 03:35:53,309][106225] Updated weights for policy 1, policy_version 1163384 (0.0008) [2023-12-28 03:35:53,353][106225] Updated weights for policy 1, policy_version 1163394 (0.0008) [2023-12-28 03:35:53,858][106226] Updated weights for policy 0, policy_version 1160287 (0.0008) [2023-12-28 03:35:53,913][106226] Updated weights for policy 0, policy_version 1160297 (0.0008) [2023-12-28 03:35:53,971][106226] Updated weights for policy 0, policy_version 1160307 (0.0009) [2023-12-28 03:35:54,073][106225] Updated weights for policy 1, policy_version 1163404 (0.0008) [2023-12-28 03:35:54,143][106225] Updated weights for policy 1, policy_version 1163414 (0.0008) [2023-12-28 03:35:54,203][106225] Updated weights for policy 1, policy_version 1163425 (0.0008) [2023-12-28 03:35:54,658][106226] Updated weights for policy 0, policy_version 1160317 (0.0009) [2023-12-28 03:35:54,725][106226] Updated weights for policy 0, policy_version 1160327 (0.0008) [2023-12-28 03:35:54,789][106226] Updated weights for policy 0, policy_version 1160337 (0.0008) [2023-12-28 03:35:54,887][106225] Updated weights for policy 1, policy_version 1163435 (0.0006) [2023-12-28 03:35:54,942][106225] Updated weights for policy 1, policy_version 1163445 (0.0005) [2023-12-28 03:35:54,991][106225] Updated weights for policy 1, policy_version 1163455 (0.0007) [2023-12-28 03:35:55,425][106226] Updated weights for policy 0, policy_version 1160347 (0.0006) [2023-12-28 03:35:55,491][106226] Updated weights for policy 0, policy_version 1160357 (0.0010) [2023-12-28 03:35:55,557][106226] Updated weights for policy 0, policy_version 1160367 (0.0010) [2023-12-28 03:35:55,558][106225] Updated weights for policy 1, policy_version 1163465 (0.0008) [2023-12-28 03:35:55,606][106225] Updated weights for policy 1, policy_version 1163475 (0.0005) [2023-12-28 03:35:55,656][106225] Updated weights for policy 1, policy_version 1163485 (0.0005) [2023-12-28 03:35:55,718][106225] Updated weights for policy 1, policy_version 1163495 (0.0005) [2023-12-28 03:35:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 595017728. Throughput: 0: 9706.5, 1: 9890.0. Samples: 594986896. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:35:56,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-4.721')] [2023-12-28 03:35:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001163496_297902080.pth... [2023-12-28 03:35:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001160376_297115648.pth... [2023-12-28 03:35:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001159224_296820736.pth [2023-12-28 03:35:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001162344_297607168.pth [2023-12-28 03:35:56,207][106226] Updated weights for policy 0, policy_version 1160377 (0.0009) [2023-12-28 03:35:56,262][106226] Updated weights for policy 0, policy_version 1160387 (0.0009) [2023-12-28 03:35:56,324][106226] Updated weights for policy 0, policy_version 1160397 (0.0009) [2023-12-28 03:35:56,338][106225] Updated weights for policy 1, policy_version 1163505 (0.0005) [2023-12-28 03:35:56,381][106226] Updated weights for policy 0, policy_version 1160407 (0.0008) [2023-12-28 03:35:56,391][106225] Updated weights for policy 1, policy_version 1163515 (0.0005) [2023-12-28 03:35:56,447][106225] Updated weights for policy 1, policy_version 1163525 (0.0008) [2023-12-28 03:35:57,034][106226] Updated weights for policy 0, policy_version 1160417 (0.0009) [2023-12-28 03:35:57,103][106226] Updated weights for policy 0, policy_version 1160427 (0.0008) [2023-12-28 03:35:57,117][106225] Updated weights for policy 1, policy_version 1163535 (0.0008) [2023-12-28 03:35:57,169][106225] Updated weights for policy 1, policy_version 1163545 (0.0010) [2023-12-28 03:35:57,181][106226] Updated weights for policy 0, policy_version 1160437 (0.0007) [2023-12-28 03:35:57,224][106225] Updated weights for policy 1, policy_version 1163555 (0.0011) [2023-12-28 03:35:57,813][106226] Updated weights for policy 0, policy_version 1160447 (0.0007) [2023-12-28 03:35:57,871][106226] Updated weights for policy 0, policy_version 1160457 (0.0005) [2023-12-28 03:35:57,883][106225] Updated weights for policy 1, policy_version 1163565 (0.0008) [2023-12-28 03:35:57,927][106226] Updated weights for policy 0, policy_version 1160467 (0.0005) [2023-12-28 03:35:57,939][106225] Updated weights for policy 1, policy_version 1163575 (0.0008) [2023-12-28 03:35:57,991][106225] Updated weights for policy 1, policy_version 1163585 (0.0010) [2023-12-28 03:35:58,540][106226] Updated weights for policy 0, policy_version 1160477 (0.0009) [2023-12-28 03:35:58,609][106226] Updated weights for policy 0, policy_version 1160487 (0.0010) [2023-12-28 03:35:58,678][106226] Updated weights for policy 0, policy_version 1160497 (0.0011) [2023-12-28 03:35:58,699][106225] Updated weights for policy 1, policy_version 1163595 (0.0007) [2023-12-28 03:35:58,764][106225] Updated weights for policy 1, policy_version 1163605 (0.0007) [2023-12-28 03:35:58,829][106225] Updated weights for policy 1, policy_version 1163615 (0.0008) [2023-12-28 03:35:59,516][106226] Updated weights for policy 0, policy_version 1160507 (0.0009) [2023-12-28 03:35:59,576][106226] Updated weights for policy 0, policy_version 1160517 (0.0007) [2023-12-28 03:35:59,643][106226] Updated weights for policy 0, policy_version 1160527 (0.0011) [2023-12-28 03:35:59,692][106225] Updated weights for policy 1, policy_version 1163625 (0.0007) [2023-12-28 03:35:59,740][106225] Updated weights for policy 1, policy_version 1163635 (0.0007) [2023-12-28 03:35:59,791][106225] Updated weights for policy 1, policy_version 1163645 (0.0008) [2023-12-28 03:35:59,845][106225] Updated weights for policy 1, policy_version 1163655 (0.0009) [2023-12-28 03:36:00,298][106226] Updated weights for policy 0, policy_version 1160537 (0.0010) [2023-12-28 03:36:00,362][106226] Updated weights for policy 0, policy_version 1160547 (0.0008) [2023-12-28 03:36:00,425][106226] Updated weights for policy 0, policy_version 1160557 (0.0011) [2023-12-28 03:36:00,484][106226] Updated weights for policy 0, policy_version 1160567 (0.0010) [2023-12-28 03:36:00,647][106225] Updated weights for policy 1, policy_version 1163665 (0.0010) [2023-12-28 03:36:00,698][106225] Updated weights for policy 1, policy_version 1163675 (0.0009) [2023-12-28 03:36:00,763][106225] Updated weights for policy 1, policy_version 1163685 (0.0007) [2023-12-28 03:36:01,079][106226] Updated weights for policy 0, policy_version 1160577 (0.0008) [2023-12-28 03:36:01,139][106226] Updated weights for policy 0, policy_version 1160587 (0.0006) [2023-12-28 03:36:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 595116032. Throughput: 0: 9792.8, 1: 9985.5. Samples: 595109856. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:01,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.750')] [2023-12-28 03:36:01,208][106226] Updated weights for policy 0, policy_version 1160597 (0.0008) [2023-12-28 03:36:01,470][106225] Updated weights for policy 1, policy_version 1163695 (0.0005) [2023-12-28 03:36:01,530][106225] Updated weights for policy 1, policy_version 1163705 (0.0005) [2023-12-28 03:36:01,590][106225] Updated weights for policy 1, policy_version 1163715 (0.0005) [2023-12-28 03:36:01,927][106226] Updated weights for policy 0, policy_version 1160607 (0.0008) [2023-12-28 03:36:01,982][106226] Updated weights for policy 0, policy_version 1160617 (0.0009) [2023-12-28 03:36:02,041][106226] Updated weights for policy 0, policy_version 1160627 (0.0006) [2023-12-28 03:36:02,274][106225] Updated weights for policy 1, policy_version 1163725 (0.0009) [2023-12-28 03:36:02,331][106225] Updated weights for policy 1, policy_version 1163735 (0.0007) [2023-12-28 03:36:02,395][106225] Updated weights for policy 1, policy_version 1163745 (0.0010) [2023-12-28 03:36:02,715][106226] Updated weights for policy 0, policy_version 1160637 (0.0007) [2023-12-28 03:36:02,777][106226] Updated weights for policy 0, policy_version 1160647 (0.0007) [2023-12-28 03:36:02,840][106226] Updated weights for policy 0, policy_version 1160657 (0.0008) [2023-12-28 03:36:03,122][106225] Updated weights for policy 1, policy_version 1163755 (0.0010) [2023-12-28 03:36:03,184][106225] Updated weights for policy 1, policy_version 1163765 (0.0010) [2023-12-28 03:36:03,239][106225] Updated weights for policy 1, policy_version 1163775 (0.0009) [2023-12-28 03:36:03,467][106226] Updated weights for policy 0, policy_version 1160667 (0.0007) [2023-12-28 03:36:03,520][106226] Updated weights for policy 0, policy_version 1160677 (0.0005) [2023-12-28 03:36:03,571][106226] Updated weights for policy 0, policy_version 1160687 (0.0005) [2023-12-28 03:36:03,933][106225] Updated weights for policy 1, policy_version 1163785 (0.0008) [2023-12-28 03:36:03,995][106225] Updated weights for policy 1, policy_version 1163795 (0.0009) [2023-12-28 03:36:04,056][106225] Updated weights for policy 1, policy_version 1163805 (0.0009) [2023-12-28 03:36:04,113][106225] Updated weights for policy 1, policy_version 1163815 (0.0008) [2023-12-28 03:36:04,243][106226] Updated weights for policy 0, policy_version 1160697 (0.0006) [2023-12-28 03:36:04,312][106226] Updated weights for policy 0, policy_version 1160707 (0.0009) [2023-12-28 03:36:04,375][106226] Updated weights for policy 0, policy_version 1160717 (0.0009) [2023-12-28 03:36:04,434][106226] Updated weights for policy 0, policy_version 1160727 (0.0009) [2023-12-28 03:36:04,805][106225] Updated weights for policy 1, policy_version 1163825 (0.0006) [2023-12-28 03:36:04,868][106225] Updated weights for policy 1, policy_version 1163835 (0.0005) [2023-12-28 03:36:04,924][106225] Updated weights for policy 1, policy_version 1163845 (0.0005) [2023-12-28 03:36:05,172][106226] Updated weights for policy 0, policy_version 1160737 (0.0009) [2023-12-28 03:36:05,223][106226] Updated weights for policy 0, policy_version 1160747 (0.0009) [2023-12-28 03:36:05,270][106226] Updated weights for policy 0, policy_version 1160757 (0.0006) [2023-12-28 03:36:05,445][106225] Updated weights for policy 1, policy_version 1163855 (0.0008) [2023-12-28 03:36:05,505][106225] Updated weights for policy 1, policy_version 1163865 (0.0008) [2023-12-28 03:36:05,550][106225] Updated weights for policy 1, policy_version 1163875 (0.0008) [2023-12-28 03:36:05,889][106226] Updated weights for policy 0, policy_version 1160767 (0.0008) [2023-12-28 03:36:05,947][106226] Updated weights for policy 0, policy_version 1160777 (0.0008) [2023-12-28 03:36:05,995][106226] Updated weights for policy 0, policy_version 1160787 (0.0008) [2023-12-28 03:36:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 595222528. Throughput: 0: 9923.1, 1: 9999.7. Samples: 595230916. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:06,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.591')] [2023-12-28 03:36:06,247][106225] Updated weights for policy 1, policy_version 1163885 (0.0009) [2023-12-28 03:36:06,318][106225] Updated weights for policy 1, policy_version 1163895 (0.0010) [2023-12-28 03:36:06,392][106225] Updated weights for policy 1, policy_version 1163905 (0.0009) [2023-12-28 03:36:06,713][106226] Updated weights for policy 0, policy_version 1160797 (0.0009) [2023-12-28 03:36:06,766][106226] Updated weights for policy 0, policy_version 1160807 (0.0009) [2023-12-28 03:36:06,815][106226] Updated weights for policy 0, policy_version 1160817 (0.0008) [2023-12-28 03:36:07,149][106225] Updated weights for policy 1, policy_version 1163915 (0.0009) [2023-12-28 03:36:07,202][106225] Updated weights for policy 1, policy_version 1163925 (0.0008) [2023-12-28 03:36:07,249][106225] Updated weights for policy 1, policy_version 1163935 (0.0007) [2023-12-28 03:36:07,491][106226] Updated weights for policy 0, policy_version 1160827 (0.0010) [2023-12-28 03:36:07,551][106226] Updated weights for policy 0, policy_version 1160837 (0.0007) [2023-12-28 03:36:07,607][106226] Updated weights for policy 0, policy_version 1160847 (0.0010) [2023-12-28 03:36:07,971][106225] Updated weights for policy 1, policy_version 1163945 (0.0008) [2023-12-28 03:36:08,016][106225] Updated weights for policy 1, policy_version 1163955 (0.0008) [2023-12-28 03:36:08,065][106225] Updated weights for policy 1, policy_version 1163965 (0.0008) [2023-12-28 03:36:08,114][106225] Updated weights for policy 1, policy_version 1163975 (0.0008) [2023-12-28 03:36:08,344][106226] Updated weights for policy 0, policy_version 1160857 (0.0008) [2023-12-28 03:36:08,404][106226] Updated weights for policy 0, policy_version 1160867 (0.0007) [2023-12-28 03:36:08,468][106226] Updated weights for policy 0, policy_version 1160877 (0.0006) [2023-12-28 03:36:08,532][106226] Updated weights for policy 0, policy_version 1160887 (0.0011) [2023-12-28 03:36:08,888][106225] Updated weights for policy 1, policy_version 1163985 (0.0008) [2023-12-28 03:36:08,941][106225] Updated weights for policy 1, policy_version 1163995 (0.0009) [2023-12-28 03:36:08,998][106225] Updated weights for policy 1, policy_version 1164005 (0.0009) [2023-12-28 03:36:09,171][106226] Updated weights for policy 0, policy_version 1160897 (0.0006) [2023-12-28 03:36:09,237][106226] Updated weights for policy 0, policy_version 1160907 (0.0008) [2023-12-28 03:36:09,298][106226] Updated weights for policy 0, policy_version 1160917 (0.0008) [2023-12-28 03:36:09,782][106225] Updated weights for policy 1, policy_version 1164015 (0.0009) [2023-12-28 03:36:09,850][106225] Updated weights for policy 1, policy_version 1164025 (0.0008) [2023-12-28 03:36:09,916][106225] Updated weights for policy 1, policy_version 1164035 (0.0008) [2023-12-28 03:36:10,019][106226] Updated weights for policy 0, policy_version 1160927 (0.0008) [2023-12-28 03:36:10,080][106226] Updated weights for policy 0, policy_version 1160937 (0.0008) [2023-12-28 03:36:10,141][106226] Updated weights for policy 0, policy_version 1160947 (0.0007) [2023-12-28 03:36:10,662][106225] Updated weights for policy 1, policy_version 1164045 (0.0007) [2023-12-28 03:36:10,718][106225] Updated weights for policy 1, policy_version 1164055 (0.0006) [2023-12-28 03:36:10,783][106225] Updated weights for policy 1, policy_version 1164065 (0.0008) [2023-12-28 03:36:10,800][106226] Updated weights for policy 0, policy_version 1160957 (0.0007) [2023-12-28 03:36:10,860][106226] Updated weights for policy 0, policy_version 1160967 (0.0005) [2023-12-28 03:36:10,914][106226] Updated weights for policy 0, policy_version 1160977 (0.0009) [2023-12-28 03:36:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 595320832. Throughput: 0: 9993.8, 1: 10008.2. Samples: 595290188. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:11,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.952')] [2023-12-28 03:36:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001164072_298049536.pth... [2023-12-28 03:36:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001160984_297271296.pth... [2023-12-28 03:36:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001162920_297754624.pth [2023-12-28 03:36:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001159800_296968192.pth [2023-12-28 03:36:11,550][106225] Updated weights for policy 1, policy_version 1164075 (0.0009) [2023-12-28 03:36:11,602][106225] Updated weights for policy 1, policy_version 1164085 (0.0008) [2023-12-28 03:36:11,652][106226] Updated weights for policy 0, policy_version 1160987 (0.0009) [2023-12-28 03:36:11,686][106225] Updated weights for policy 1, policy_version 1164095 (0.0008) [2023-12-28 03:36:11,727][106226] Updated weights for policy 0, policy_version 1160997 (0.0009) [2023-12-28 03:36:11,790][106226] Updated weights for policy 0, policy_version 1161007 (0.0009) [2023-12-28 03:36:12,433][106225] Updated weights for policy 1, policy_version 1164105 (0.0008) [2023-12-28 03:36:12,449][106226] Updated weights for policy 0, policy_version 1161017 (0.0008) [2023-12-28 03:36:12,490][106225] Updated weights for policy 1, policy_version 1164115 (0.0008) [2023-12-28 03:36:12,507][106226] Updated weights for policy 0, policy_version 1161027 (0.0007) [2023-12-28 03:36:12,546][106225] Updated weights for policy 1, policy_version 1164125 (0.0009) [2023-12-28 03:36:12,570][106226] Updated weights for policy 0, policy_version 1161037 (0.0008) [2023-12-28 03:36:12,599][106225] Updated weights for policy 1, policy_version 1164135 (0.0008) [2023-12-28 03:36:12,624][106226] Updated weights for policy 0, policy_version 1161047 (0.0007) [2023-12-28 03:36:13,312][106226] Updated weights for policy 0, policy_version 1161057 (0.0005) [2023-12-28 03:36:13,370][106226] Updated weights for policy 0, policy_version 1161067 (0.0005) [2023-12-28 03:36:13,376][106225] Updated weights for policy 1, policy_version 1164145 (0.0008) [2023-12-28 03:36:13,423][106225] Updated weights for policy 1, policy_version 1164155 (0.0008) [2023-12-28 03:36:13,427][106226] Updated weights for policy 0, policy_version 1161077 (0.0005) [2023-12-28 03:36:13,474][106225] Updated weights for policy 1, policy_version 1164165 (0.0008) [2023-12-28 03:36:14,093][106226] Updated weights for policy 0, policy_version 1161087 (0.0007) [2023-12-28 03:36:14,156][106226] Updated weights for policy 0, policy_version 1161097 (0.0008) [2023-12-28 03:36:14,215][106226] Updated weights for policy 0, policy_version 1161107 (0.0007) [2023-12-28 03:36:14,225][106225] Updated weights for policy 1, policy_version 1164175 (0.0007) [2023-12-28 03:36:14,291][106225] Updated weights for policy 1, policy_version 1164185 (0.0008) [2023-12-28 03:36:14,360][106225] Updated weights for policy 1, policy_version 1164195 (0.0009) [2023-12-28 03:36:14,907][106226] Updated weights for policy 0, policy_version 1161117 (0.0009) [2023-12-28 03:36:14,972][106226] Updated weights for policy 0, policy_version 1161127 (0.0009) [2023-12-28 03:36:15,036][106226] Updated weights for policy 0, policy_version 1161137 (0.0008) [2023-12-28 03:36:15,113][106225] Updated weights for policy 1, policy_version 1164205 (0.0008) [2023-12-28 03:36:15,170][106225] Updated weights for policy 1, policy_version 1164215 (0.0009) [2023-12-28 03:36:15,235][106225] Updated weights for policy 1, policy_version 1164225 (0.0009) [2023-12-28 03:36:15,733][106226] Updated weights for policy 0, policy_version 1161147 (0.0008) [2023-12-28 03:36:15,779][106226] Updated weights for policy 0, policy_version 1161157 (0.0008) [2023-12-28 03:36:15,841][106226] Updated weights for policy 0, policy_version 1161167 (0.0008) [2023-12-28 03:36:15,978][106225] Updated weights for policy 1, policy_version 1164235 (0.0009) [2023-12-28 03:36:16,024][106225] Updated weights for policy 1, policy_version 1164245 (0.0008) [2023-12-28 03:36:16,078][106225] Updated weights for policy 1, policy_version 1164255 (0.0009) [2023-12-28 03:36:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 595419136. Throughput: 0: 10008.1, 1: 9851.1. Samples: 595404472. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:16,175][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.911')] [2023-12-28 03:36:16,535][106226] Updated weights for policy 0, policy_version 1161177 (0.0008) [2023-12-28 03:36:16,587][106226] Updated weights for policy 0, policy_version 1161187 (0.0008) [2023-12-28 03:36:16,649][106226] Updated weights for policy 0, policy_version 1161197 (0.0008) [2023-12-28 03:36:16,719][106226] Updated weights for policy 0, policy_version 1161207 (0.0010) [2023-12-28 03:36:16,823][106225] Updated weights for policy 1, policy_version 1164265 (0.0010) [2023-12-28 03:36:16,872][106225] Updated weights for policy 1, policy_version 1164275 (0.0008) [2023-12-28 03:36:16,919][106225] Updated weights for policy 1, policy_version 1164285 (0.0008) [2023-12-28 03:36:16,966][106225] Updated weights for policy 1, policy_version 1164295 (0.0010) [2023-12-28 03:36:17,468][106226] Updated weights for policy 0, policy_version 1161217 (0.0006) [2023-12-28 03:36:17,536][106226] Updated weights for policy 0, policy_version 1161227 (0.0007) [2023-12-28 03:36:17,598][106226] Updated weights for policy 0, policy_version 1161237 (0.0008) [2023-12-28 03:36:17,653][106225] Updated weights for policy 1, policy_version 1164305 (0.0006) [2023-12-28 03:36:17,712][106225] Updated weights for policy 1, policy_version 1164315 (0.0008) [2023-12-28 03:36:17,765][106225] Updated weights for policy 1, policy_version 1164325 (0.0010) [2023-12-28 03:36:18,234][106226] Updated weights for policy 0, policy_version 1161247 (0.0008) [2023-12-28 03:36:18,292][106226] Updated weights for policy 0, policy_version 1161257 (0.0007) [2023-12-28 03:36:18,350][106226] Updated weights for policy 0, policy_version 1161267 (0.0008) [2023-12-28 03:36:18,465][106225] Updated weights for policy 1, policy_version 1164335 (0.0010) [2023-12-28 03:36:18,528][106225] Updated weights for policy 1, policy_version 1164345 (0.0011) [2023-12-28 03:36:18,583][106225] Updated weights for policy 1, policy_version 1164355 (0.0010) [2023-12-28 03:36:19,001][106226] Updated weights for policy 0, policy_version 1161277 (0.0007) [2023-12-28 03:36:19,057][106226] Updated weights for policy 0, policy_version 1161287 (0.0006) [2023-12-28 03:36:19,118][106226] Updated weights for policy 0, policy_version 1161297 (0.0006) [2023-12-28 03:36:19,261][106225] Updated weights for policy 1, policy_version 1164365 (0.0009) [2023-12-28 03:36:19,327][106225] Updated weights for policy 1, policy_version 1164375 (0.0008) [2023-12-28 03:36:19,393][106225] Updated weights for policy 1, policy_version 1164385 (0.0008) [2023-12-28 03:36:19,818][106226] Updated weights for policy 0, policy_version 1161307 (0.0006) [2023-12-28 03:36:19,883][106226] Updated weights for policy 0, policy_version 1161317 (0.0010) [2023-12-28 03:36:19,950][106226] Updated weights for policy 0, policy_version 1161327 (0.0010) [2023-12-28 03:36:20,147][106225] Updated weights for policy 1, policy_version 1164395 (0.0009) [2023-12-28 03:36:20,215][106225] Updated weights for policy 1, policy_version 1164405 (0.0010) [2023-12-28 03:36:20,279][106225] Updated weights for policy 1, policy_version 1164415 (0.0006) [2023-12-28 03:36:20,702][106226] Updated weights for policy 0, policy_version 1161337 (0.0011) [2023-12-28 03:36:20,768][106226] Updated weights for policy 0, policy_version 1161347 (0.0009) [2023-12-28 03:36:20,828][106226] Updated weights for policy 0, policy_version 1161357 (0.0008) [2023-12-28 03:36:20,891][106226] Updated weights for policy 0, policy_version 1161367 (0.0008) [2023-12-28 03:36:21,008][106225] Updated weights for policy 1, policy_version 1164425 (0.0008) [2023-12-28 03:36:21,065][106225] Updated weights for policy 1, policy_version 1164435 (0.0008) [2023-12-28 03:36:21,132][106225] Updated weights for policy 1, policy_version 1164445 (0.0008) [2023-12-28 03:36:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 595509248. Throughput: 0: 9905.4, 1: 9811.4. Samples: 595521064. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:21,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-5.035')] [2023-12-28 03:36:21,190][106225] Updated weights for policy 1, policy_version 1164455 (0.0008) [2023-12-28 03:36:21,767][106226] Updated weights for policy 0, policy_version 1161377 (0.0007) [2023-12-28 03:36:21,833][106226] Updated weights for policy 0, policy_version 1161387 (0.0008) [2023-12-28 03:36:21,893][106226] Updated weights for policy 0, policy_version 1161397 (0.0008) [2023-12-28 03:36:21,998][106225] Updated weights for policy 1, policy_version 1164465 (0.0009) [2023-12-28 03:36:22,066][106225] Updated weights for policy 1, policy_version 1164475 (0.0009) [2023-12-28 03:36:22,133][106225] Updated weights for policy 1, policy_version 1164485 (0.0011) [2023-12-28 03:36:22,599][106226] Updated weights for policy 0, policy_version 1161407 (0.0007) [2023-12-28 03:36:22,670][106226] Updated weights for policy 0, policy_version 1161417 (0.0006) [2023-12-28 03:36:22,730][106226] Updated weights for policy 0, policy_version 1161427 (0.0009) [2023-12-28 03:36:22,850][106225] Updated weights for policy 1, policy_version 1164495 (0.0010) [2023-12-28 03:36:22,920][106225] Updated weights for policy 1, policy_version 1164505 (0.0009) [2023-12-28 03:36:22,979][106225] Updated weights for policy 1, policy_version 1164515 (0.0008) [2023-12-28 03:36:23,436][106226] Updated weights for policy 0, policy_version 1161437 (0.0009) [2023-12-28 03:36:23,486][106226] Updated weights for policy 0, policy_version 1161447 (0.0010) [2023-12-28 03:36:23,542][106226] Updated weights for policy 0, policy_version 1161457 (0.0008) [2023-12-28 03:36:23,626][106225] Updated weights for policy 1, policy_version 1164525 (0.0010) [2023-12-28 03:36:23,689][106225] Updated weights for policy 1, policy_version 1164535 (0.0010) [2023-12-28 03:36:23,735][106225] Updated weights for policy 1, policy_version 1164545 (0.0009) [2023-12-28 03:36:24,113][106226] Updated weights for policy 0, policy_version 1161467 (0.0007) [2023-12-28 03:36:24,176][106226] Updated weights for policy 0, policy_version 1161477 (0.0006) [2023-12-28 03:36:24,238][106226] Updated weights for policy 0, policy_version 1161487 (0.0007) [2023-12-28 03:36:24,414][106225] Updated weights for policy 1, policy_version 1164555 (0.0009) [2023-12-28 03:36:24,467][106225] Updated weights for policy 1, policy_version 1164565 (0.0010) [2023-12-28 03:36:24,527][106225] Updated weights for policy 1, policy_version 1164575 (0.0007) [2023-12-28 03:36:24,763][106226] Updated weights for policy 0, policy_version 1161497 (0.0006) [2023-12-28 03:36:24,814][106226] Updated weights for policy 0, policy_version 1161507 (0.0006) [2023-12-28 03:36:24,860][106226] Updated weights for policy 0, policy_version 1161517 (0.0005) [2023-12-28 03:36:24,908][106226] Updated weights for policy 0, policy_version 1161527 (0.0006) [2023-12-28 03:36:25,217][106225] Updated weights for policy 1, policy_version 1164585 (0.0007) [2023-12-28 03:36:25,269][106225] Updated weights for policy 1, policy_version 1164595 (0.0007) [2023-12-28 03:36:25,319][106225] Updated weights for policy 1, policy_version 1164605 (0.0007) [2023-12-28 03:36:25,371][106225] Updated weights for policy 1, policy_version 1164615 (0.0007) [2023-12-28 03:36:25,525][106226] Updated weights for policy 0, policy_version 1161537 (0.0011) [2023-12-28 03:36:25,588][106226] Updated weights for policy 0, policy_version 1161547 (0.0011) [2023-12-28 03:36:25,641][106226] Updated weights for policy 0, policy_version 1161557 (0.0010) [2023-12-28 03:36:26,079][106225] Updated weights for policy 1, policy_version 1164625 (0.0006) [2023-12-28 03:36:26,132][106225] Updated weights for policy 1, policy_version 1164635 (0.0010) [2023-12-28 03:36:26,175][105115] Fps is (10 sec: 18840.9, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 595607552. Throughput: 0: 9915.7, 1: 9775.8. Samples: 595579296. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:26,176][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.821')] [2023-12-28 03:36:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001161560_297418752.pth... [2023-12-28 03:36:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001160376_297115648.pth [2023-12-28 03:36:26,191][106225] Updated weights for policy 1, policy_version 1164645 (0.0009) [2023-12-28 03:36:26,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001164648_298196992.pth... [2023-12-28 03:36:26,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001163496_297902080.pth [2023-12-28 03:36:26,367][106226] Updated weights for policy 0, policy_version 1161567 (0.0010) [2023-12-28 03:36:26,430][106226] Updated weights for policy 0, policy_version 1161577 (0.0011) [2023-12-28 03:36:26,497][106226] Updated weights for policy 0, policy_version 1161587 (0.0010) [2023-12-28 03:36:26,850][106225] Updated weights for policy 1, policy_version 1164655 (0.0007) [2023-12-28 03:36:26,907][106225] Updated weights for policy 1, policy_version 1164665 (0.0008) [2023-12-28 03:36:26,961][106225] Updated weights for policy 1, policy_version 1164675 (0.0006) [2023-12-28 03:36:27,192][106226] Updated weights for policy 0, policy_version 1161597 (0.0010) [2023-12-28 03:36:27,242][106226] Updated weights for policy 0, policy_version 1161607 (0.0010) [2023-12-28 03:36:27,293][106226] Updated weights for policy 0, policy_version 1161617 (0.0006) [2023-12-28 03:36:27,631][106225] Updated weights for policy 1, policy_version 1164685 (0.0007) [2023-12-28 03:36:27,681][106225] Updated weights for policy 1, policy_version 1164695 (0.0007) [2023-12-28 03:36:27,741][106225] Updated weights for policy 1, policy_version 1164705 (0.0007) [2023-12-28 03:36:28,015][106226] Updated weights for policy 0, policy_version 1161627 (0.0010) [2023-12-28 03:36:28,077][106226] Updated weights for policy 0, policy_version 1161637 (0.0011) [2023-12-28 03:36:28,133][106226] Updated weights for policy 0, policy_version 1161647 (0.0010) [2023-12-28 03:36:28,355][106225] Updated weights for policy 1, policy_version 1164715 (0.0007) [2023-12-28 03:36:28,423][106225] Updated weights for policy 1, policy_version 1164725 (0.0006) [2023-12-28 03:36:28,485][106225] Updated weights for policy 1, policy_version 1164735 (0.0007) [2023-12-28 03:36:28,890][106226] Updated weights for policy 0, policy_version 1161657 (0.0011) [2023-12-28 03:36:28,940][106226] Updated weights for policy 0, policy_version 1161667 (0.0010) [2023-12-28 03:36:29,003][106226] Updated weights for policy 0, policy_version 1161677 (0.0011) [2023-12-28 03:36:29,067][106226] Updated weights for policy 0, policy_version 1161687 (0.0010) [2023-12-28 03:36:29,076][106225] Updated weights for policy 1, policy_version 1164745 (0.0008) [2023-12-28 03:36:29,137][106225] Updated weights for policy 1, policy_version 1164755 (0.0010) [2023-12-28 03:36:29,201][106225] Updated weights for policy 1, policy_version 1164765 (0.0010) [2023-12-28 03:36:29,266][106225] Updated weights for policy 1, policy_version 1164775 (0.0010) [2023-12-28 03:36:29,801][106226] Updated weights for policy 0, policy_version 1161697 (0.0011) [2023-12-28 03:36:29,872][106226] Updated weights for policy 0, policy_version 1161707 (0.0009) [2023-12-28 03:36:29,944][106226] Updated weights for policy 0, policy_version 1161717 (0.0008) [2023-12-28 03:36:29,980][106225] Updated weights for policy 1, policy_version 1164785 (0.0011) [2023-12-28 03:36:30,034][106225] Updated weights for policy 1, policy_version 1164795 (0.0010) [2023-12-28 03:36:30,098][106225] Updated weights for policy 1, policy_version 1164805 (0.0010) [2023-12-28 03:36:30,600][106226] Updated weights for policy 0, policy_version 1161727 (0.0009) [2023-12-28 03:36:30,649][106226] Updated weights for policy 0, policy_version 1161737 (0.0010) [2023-12-28 03:36:30,699][106226] Updated weights for policy 0, policy_version 1161747 (0.0010) [2023-12-28 03:36:30,770][106225] Updated weights for policy 1, policy_version 1164815 (0.0007) [2023-12-28 03:36:30,826][106225] Updated weights for policy 1, policy_version 1164825 (0.0005) [2023-12-28 03:36:30,878][106225] Updated weights for policy 1, policy_version 1164835 (0.0005) [2023-12-28 03:36:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 595714048. Throughput: 0: 9989.5, 1: 9865.8. Samples: 595701852. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:31,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.924')] [2023-12-28 03:36:31,420][106226] Updated weights for policy 0, policy_version 1161757 (0.0011) [2023-12-28 03:36:31,475][106226] Updated weights for policy 0, policy_version 1161767 (0.0007) [2023-12-28 03:36:31,538][106226] Updated weights for policy 0, policy_version 1161777 (0.0010) [2023-12-28 03:36:31,573][106225] Updated weights for policy 1, policy_version 1164845 (0.0008) [2023-12-28 03:36:31,632][106225] Updated weights for policy 1, policy_version 1164855 (0.0009) [2023-12-28 03:36:31,692][106225] Updated weights for policy 1, policy_version 1164865 (0.0006) [2023-12-28 03:36:32,215][106226] Updated weights for policy 0, policy_version 1161787 (0.0009) [2023-12-28 03:36:32,268][106226] Updated weights for policy 0, policy_version 1161797 (0.0007) [2023-12-28 03:36:32,336][106226] Updated weights for policy 0, policy_version 1161807 (0.0011) [2023-12-28 03:36:32,408][106225] Updated weights for policy 1, policy_version 1164875 (0.0009) [2023-12-28 03:36:32,462][106225] Updated weights for policy 1, policy_version 1164885 (0.0010) [2023-12-28 03:36:32,516][106225] Updated weights for policy 1, policy_version 1164895 (0.0010) [2023-12-28 03:36:33,065][106226] Updated weights for policy 0, policy_version 1161817 (0.0009) [2023-12-28 03:36:33,138][106226] Updated weights for policy 0, policy_version 1161827 (0.0010) [2023-12-28 03:36:33,191][106225] Updated weights for policy 1, policy_version 1164905 (0.0010) [2023-12-28 03:36:33,192][106226] Updated weights for policy 0, policy_version 1161837 (0.0009) [2023-12-28 03:36:33,250][106226] Updated weights for policy 0, policy_version 1161847 (0.0008) [2023-12-28 03:36:33,252][106225] Updated weights for policy 1, policy_version 1164915 (0.0010) [2023-12-28 03:36:33,310][106225] Updated weights for policy 1, policy_version 1164925 (0.0010) [2023-12-28 03:36:33,370][106225] Updated weights for policy 1, policy_version 1164935 (0.0010) [2023-12-28 03:36:33,924][106226] Updated weights for policy 0, policy_version 1161857 (0.0010) [2023-12-28 03:36:33,973][106226] Updated weights for policy 0, policy_version 1161867 (0.0010) [2023-12-28 03:36:34,027][106226] Updated weights for policy 0, policy_version 1161877 (0.0010) [2023-12-28 03:36:34,031][106225] Updated weights for policy 1, policy_version 1164945 (0.0008) [2023-12-28 03:36:34,083][106225] Updated weights for policy 1, policy_version 1164955 (0.0008) [2023-12-28 03:36:34,147][106225] Updated weights for policy 1, policy_version 1164965 (0.0010) [2023-12-28 03:36:34,748][106226] Updated weights for policy 0, policy_version 1161887 (0.0011) [2023-12-28 03:36:34,801][106226] Updated weights for policy 0, policy_version 1161897 (0.0009) [2023-12-28 03:36:34,834][106225] Updated weights for policy 1, policy_version 1164975 (0.0006) [2023-12-28 03:36:34,854][106226] Updated weights for policy 0, policy_version 1161907 (0.0009) [2023-12-28 03:36:34,892][106225] Updated weights for policy 1, policy_version 1164985 (0.0007) [2023-12-28 03:36:34,945][106225] Updated weights for policy 1, policy_version 1164995 (0.0008) [2023-12-28 03:36:35,435][106226] Updated weights for policy 0, policy_version 1161917 (0.0010) [2023-12-28 03:36:35,502][106226] Updated weights for policy 0, policy_version 1161927 (0.0011) [2023-12-28 03:36:35,542][106225] Updated weights for policy 1, policy_version 1165005 (0.0007) [2023-12-28 03:36:35,561][106226] Updated weights for policy 0, policy_version 1161937 (0.0011) [2023-12-28 03:36:35,600][106225] Updated weights for policy 1, policy_version 1165015 (0.0006) [2023-12-28 03:36:35,655][106225] Updated weights for policy 1, policy_version 1165025 (0.0006) [2023-12-28 03:36:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 595812352. Throughput: 0: 10018.2, 1: 9889.1. Samples: 595825728. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:36,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.679')] [2023-12-28 03:36:36,198][106225] Updated weights for policy 1, policy_version 1165035 (0.0006) [2023-12-28 03:36:36,225][106226] Updated weights for policy 0, policy_version 1161947 (0.0011) [2023-12-28 03:36:36,267][106225] Updated weights for policy 1, policy_version 1165045 (0.0008) [2023-12-28 03:36:36,294][106226] Updated weights for policy 0, policy_version 1161957 (0.0011) [2023-12-28 03:36:36,335][106225] Updated weights for policy 1, policy_version 1165055 (0.0007) [2023-12-28 03:36:36,359][106226] Updated weights for policy 0, policy_version 1161967 (0.0011) [2023-12-28 03:36:36,976][106225] Updated weights for policy 1, policy_version 1165065 (0.0007) [2023-12-28 03:36:37,043][106225] Updated weights for policy 1, policy_version 1165075 (0.0005) [2023-12-28 03:36:37,071][106226] Updated weights for policy 0, policy_version 1161977 (0.0010) [2023-12-28 03:36:37,097][106225] Updated weights for policy 1, policy_version 1165085 (0.0007) [2023-12-28 03:36:37,123][106226] Updated weights for policy 0, policy_version 1161987 (0.0006) [2023-12-28 03:36:37,148][106225] Updated weights for policy 1, policy_version 1165095 (0.0007) [2023-12-28 03:36:37,172][106226] Updated weights for policy 0, policy_version 1161997 (0.0006) [2023-12-28 03:36:37,221][106226] Updated weights for policy 0, policy_version 1162007 (0.0008) [2023-12-28 03:36:37,841][106225] Updated weights for policy 1, policy_version 1165105 (0.0007) [2023-12-28 03:36:37,890][106225] Updated weights for policy 1, policy_version 1165115 (0.0009) [2023-12-28 03:36:37,912][106226] Updated weights for policy 0, policy_version 1162017 (0.0008) [2023-12-28 03:36:37,948][106225] Updated weights for policy 1, policy_version 1165125 (0.0005) [2023-12-28 03:36:37,972][106226] Updated weights for policy 0, policy_version 1162027 (0.0011) [2023-12-28 03:36:38,033][106226] Updated weights for policy 0, policy_version 1162037 (0.0011) [2023-12-28 03:36:38,702][106225] Updated weights for policy 1, policy_version 1165135 (0.0006) [2023-12-28 03:36:38,714][106226] Updated weights for policy 0, policy_version 1162047 (0.0009) [2023-12-28 03:36:38,763][106225] Updated weights for policy 1, policy_version 1165145 (0.0006) [2023-12-28 03:36:38,772][106226] Updated weights for policy 0, policy_version 1162057 (0.0008) [2023-12-28 03:36:38,815][106225] Updated weights for policy 1, policy_version 1165155 (0.0005) [2023-12-28 03:36:38,830][106226] Updated weights for policy 0, policy_version 1162067 (0.0008) [2023-12-28 03:36:39,517][106225] Updated weights for policy 1, policy_version 1165165 (0.0007) [2023-12-28 03:36:39,544][106226] Updated weights for policy 0, policy_version 1162077 (0.0009) [2023-12-28 03:36:39,584][106225] Updated weights for policy 1, policy_version 1165175 (0.0007) [2023-12-28 03:36:39,609][106226] Updated weights for policy 0, policy_version 1162087 (0.0009) [2023-12-28 03:36:39,643][106225] Updated weights for policy 1, policy_version 1165185 (0.0007) [2023-12-28 03:36:39,671][106226] Updated weights for policy 0, policy_version 1162097 (0.0007) [2023-12-28 03:36:40,381][106226] Updated weights for policy 0, policy_version 1162107 (0.0007) [2023-12-28 03:36:40,398][106225] Updated weights for policy 1, policy_version 1165195 (0.0007) [2023-12-28 03:36:40,442][106226] Updated weights for policy 0, policy_version 1162117 (0.0011) [2023-12-28 03:36:40,449][106225] Updated weights for policy 1, policy_version 1165205 (0.0006) [2023-12-28 03:36:40,501][106225] Updated weights for policy 1, policy_version 1165215 (0.0006) [2023-12-28 03:36:40,506][106226] Updated weights for policy 0, policy_version 1162127 (0.0011) [2023-12-28 03:36:41,165][106226] Updated weights for policy 0, policy_version 1162137 (0.0010) [2023-12-28 03:36:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 595910656. Throughput: 0: 10056.8, 1: 9929.1. Samples: 595886264. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:41,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.450')] [2023-12-28 03:36:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001165224_298344448.pth... [2023-12-28 03:36:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001164072_298049536.pth [2023-12-28 03:36:41,216][106226] Updated weights for policy 0, policy_version 1162147 (0.0009) [2023-12-28 03:36:41,278][106226] Updated weights for policy 0, policy_version 1162157 (0.0010) [2023-12-28 03:36:41,278][106225] Updated weights for policy 1, policy_version 1165225 (0.0006) [2023-12-28 03:36:41,339][106225] Updated weights for policy 1, policy_version 1165235 (0.0006) [2023-12-28 03:36:41,341][106226] Updated weights for policy 0, policy_version 1162167 (0.0007) [2023-12-28 03:36:41,344][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001162168_297574400.pth... [2023-12-28 03:36:41,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001160984_297271296.pth [2023-12-28 03:36:41,413][106225] Updated weights for policy 1, policy_version 1165245 (0.0008) [2023-12-28 03:36:41,471][106225] Updated weights for policy 1, policy_version 1165255 (0.0008) [2023-12-28 03:36:42,146][106226] Updated weights for policy 0, policy_version 1162177 (0.0009) [2023-12-28 03:36:42,199][106226] Updated weights for policy 0, policy_version 1162187 (0.0008) [2023-12-28 03:36:42,240][106225] Updated weights for policy 1, policy_version 1165265 (0.0008) [2023-12-28 03:36:42,261][106226] Updated weights for policy 0, policy_version 1162197 (0.0006) [2023-12-28 03:36:42,303][106225] Updated weights for policy 1, policy_version 1165275 (0.0007) [2023-12-28 03:36:42,365][106225] Updated weights for policy 1, policy_version 1165285 (0.0008) [2023-12-28 03:36:43,009][106226] Updated weights for policy 0, policy_version 1162207 (0.0007) [2023-12-28 03:36:43,062][106225] Updated weights for policy 1, policy_version 1165295 (0.0008) [2023-12-28 03:36:43,069][106226] Updated weights for policy 0, policy_version 1162217 (0.0008) [2023-12-28 03:36:43,117][106225] Updated weights for policy 1, policy_version 1165305 (0.0010) [2023-12-28 03:36:43,124][106226] Updated weights for policy 0, policy_version 1162227 (0.0005) [2023-12-28 03:36:43,174][106225] Updated weights for policy 1, policy_version 1165315 (0.0010) [2023-12-28 03:36:43,861][106226] Updated weights for policy 0, policy_version 1162237 (0.0006) [2023-12-28 03:36:43,863][106225] Updated weights for policy 1, policy_version 1165325 (0.0010) [2023-12-28 03:36:43,911][106226] Updated weights for policy 0, policy_version 1162247 (0.0005) [2023-12-28 03:36:43,920][106225] Updated weights for policy 1, policy_version 1165335 (0.0010) [2023-12-28 03:36:43,957][106226] Updated weights for policy 0, policy_version 1162257 (0.0005) [2023-12-28 03:36:43,970][106225] Updated weights for policy 1, policy_version 1165345 (0.0010) [2023-12-28 03:36:44,635][106225] Updated weights for policy 1, policy_version 1165355 (0.0009) [2023-12-28 03:36:44,679][106226] Updated weights for policy 0, policy_version 1162267 (0.0006) [2023-12-28 03:36:44,695][106225] Updated weights for policy 1, policy_version 1165365 (0.0009) [2023-12-28 03:36:44,738][106226] Updated weights for policy 0, policy_version 1162277 (0.0007) [2023-12-28 03:36:44,748][106225] Updated weights for policy 1, policy_version 1165375 (0.0007) [2023-12-28 03:36:44,802][106226] Updated weights for policy 0, policy_version 1162287 (0.0009) [2023-12-28 03:36:45,468][106225] Updated weights for policy 1, policy_version 1165385 (0.0006) [2023-12-28 03:36:45,535][106225] Updated weights for policy 1, policy_version 1165395 (0.0005) [2023-12-28 03:36:45,550][106226] Updated weights for policy 0, policy_version 1162297 (0.0009) [2023-12-28 03:36:45,599][106225] Updated weights for policy 1, policy_version 1165405 (0.0005) [2023-12-28 03:36:45,600][106226] Updated weights for policy 0, policy_version 1162307 (0.0008) [2023-12-28 03:36:45,645][106226] Updated weights for policy 0, policy_version 1162317 (0.0005) [2023-12-28 03:36:45,662][106225] Updated weights for policy 1, policy_version 1165415 (0.0007) [2023-12-28 03:36:45,696][106226] Updated weights for policy 0, policy_version 1162327 (0.0006) [2023-12-28 03:36:46,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 596008960. Throughput: 0: 9966.6, 1: 9841.4. Samples: 596001216. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:46,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-4.824')] [2023-12-28 03:36:46,268][106225] Updated weights for policy 1, policy_version 1165425 (0.0006) [2023-12-28 03:36:46,306][106226] Updated weights for policy 0, policy_version 1162337 (0.0008) [2023-12-28 03:36:46,322][106225] Updated weights for policy 1, policy_version 1165435 (0.0005) [2023-12-28 03:36:46,359][106226] Updated weights for policy 0, policy_version 1162347 (0.0005) [2023-12-28 03:36:46,411][106225] Updated weights for policy 1, policy_version 1165445 (0.0005) [2023-12-28 03:36:46,423][106226] Updated weights for policy 0, policy_version 1162357 (0.0006) [2023-12-28 03:36:46,913][106225] Updated weights for policy 1, policy_version 1165455 (0.0009) [2023-12-28 03:36:46,965][106225] Updated weights for policy 1, policy_version 1165465 (0.0006) [2023-12-28 03:36:46,979][106226] Updated weights for policy 0, policy_version 1162367 (0.0006) [2023-12-28 03:36:47,021][106225] Updated weights for policy 1, policy_version 1165475 (0.0006) [2023-12-28 03:36:47,028][106226] Updated weights for policy 0, policy_version 1162377 (0.0005) [2023-12-28 03:36:47,089][106226] Updated weights for policy 0, policy_version 1162387 (0.0009) [2023-12-28 03:36:47,551][106225] Updated weights for policy 1, policy_version 1165485 (0.0005) [2023-12-28 03:36:47,612][106225] Updated weights for policy 1, policy_version 1165495 (0.0005) [2023-12-28 03:36:47,670][106225] Updated weights for policy 1, policy_version 1165505 (0.0007) [2023-12-28 03:36:47,899][106226] Updated weights for policy 0, policy_version 1162397 (0.0007) [2023-12-28 03:36:47,949][106226] Updated weights for policy 0, policy_version 1162407 (0.0009) [2023-12-28 03:36:47,999][106226] Updated weights for policy 0, policy_version 1162417 (0.0009) [2023-12-28 03:36:48,212][106225] Updated weights for policy 1, policy_version 1165515 (0.0010) [2023-12-28 03:36:48,275][106225] Updated weights for policy 1, policy_version 1165525 (0.0010) [2023-12-28 03:36:48,342][106225] Updated weights for policy 1, policy_version 1165535 (0.0010) [2023-12-28 03:36:48,712][106226] Updated weights for policy 0, policy_version 1162427 (0.0008) [2023-12-28 03:36:48,779][106226] Updated weights for policy 0, policy_version 1162437 (0.0010) [2023-12-28 03:36:48,843][106226] Updated weights for policy 0, policy_version 1162447 (0.0011) [2023-12-28 03:36:49,095][106225] Updated weights for policy 1, policy_version 1165545 (0.0009) [2023-12-28 03:36:49,149][106225] Updated weights for policy 1, policy_version 1165555 (0.0008) [2023-12-28 03:36:49,214][106225] Updated weights for policy 1, policy_version 1165565 (0.0008) [2023-12-28 03:36:49,277][106225] Updated weights for policy 1, policy_version 1165575 (0.0008) [2023-12-28 03:36:49,516][106226] Updated weights for policy 0, policy_version 1162457 (0.0010) [2023-12-28 03:36:49,574][106226] Updated weights for policy 0, policy_version 1162467 (0.0008) [2023-12-28 03:36:49,637][106226] Updated weights for policy 0, policy_version 1162477 (0.0008) [2023-12-28 03:36:49,702][106226] Updated weights for policy 0, policy_version 1162487 (0.0007) [2023-12-28 03:36:50,040][106225] Updated weights for policy 1, policy_version 1165585 (0.0008) [2023-12-28 03:36:50,108][106225] Updated weights for policy 1, policy_version 1165595 (0.0008) [2023-12-28 03:36:50,172][106225] Updated weights for policy 1, policy_version 1165605 (0.0008) [2023-12-28 03:36:50,447][106226] Updated weights for policy 0, policy_version 1162497 (0.0010) [2023-12-28 03:36:50,523][106226] Updated weights for policy 0, policy_version 1162507 (0.0006) [2023-12-28 03:36:50,582][106226] Updated weights for policy 0, policy_version 1162517 (0.0007) [2023-12-28 03:36:50,764][106225] Updated weights for policy 1, policy_version 1165615 (0.0008) [2023-12-28 03:36:50,825][106225] Updated weights for policy 1, policy_version 1165625 (0.0010) [2023-12-28 03:36:50,892][106225] Updated weights for policy 1, policy_version 1165635 (0.0008) [2023-12-28 03:36:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 596115456. Throughput: 0: 9955.4, 1: 9943.5. Samples: 596126364. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:51,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.913')] [2023-12-28 03:36:51,193][106226] Updated weights for policy 0, policy_version 1162527 (0.0007) [2023-12-28 03:36:51,261][106226] Updated weights for policy 0, policy_version 1162537 (0.0008) [2023-12-28 03:36:51,331][106226] Updated weights for policy 0, policy_version 1162547 (0.0008) [2023-12-28 03:36:51,723][106225] Updated weights for policy 1, policy_version 1165645 (0.0010) [2023-12-28 03:36:51,780][106225] Updated weights for policy 1, policy_version 1165655 (0.0007) [2023-12-28 03:36:51,840][106225] Updated weights for policy 1, policy_version 1165665 (0.0007) [2023-12-28 03:36:52,127][106226] Updated weights for policy 0, policy_version 1162557 (0.0009) [2023-12-28 03:36:52,195][106226] Updated weights for policy 0, policy_version 1162567 (0.0010) [2023-12-28 03:36:52,256][106226] Updated weights for policy 0, policy_version 1162577 (0.0010) [2023-12-28 03:36:52,529][106225] Updated weights for policy 1, policy_version 1165675 (0.0007) [2023-12-28 03:36:52,591][106225] Updated weights for policy 1, policy_version 1165685 (0.0007) [2023-12-28 03:36:52,654][106225] Updated weights for policy 1, policy_version 1165695 (0.0007) [2023-12-28 03:36:52,989][106226] Updated weights for policy 0, policy_version 1162587 (0.0009) [2023-12-28 03:36:53,049][106226] Updated weights for policy 0, policy_version 1162597 (0.0009) [2023-12-28 03:36:53,111][106226] Updated weights for policy 0, policy_version 1162607 (0.0007) [2023-12-28 03:36:53,326][106225] Updated weights for policy 1, policy_version 1165705 (0.0009) [2023-12-28 03:36:53,382][106225] Updated weights for policy 1, policy_version 1165715 (0.0008) [2023-12-28 03:36:53,431][106225] Updated weights for policy 1, policy_version 1165725 (0.0009) [2023-12-28 03:36:53,480][106225] Updated weights for policy 1, policy_version 1165735 (0.0009) [2023-12-28 03:36:53,832][106226] Updated weights for policy 0, policy_version 1162617 (0.0007) [2023-12-28 03:36:53,887][106226] Updated weights for policy 0, policy_version 1162627 (0.0009) [2023-12-28 03:36:53,938][106226] Updated weights for policy 0, policy_version 1162637 (0.0008) [2023-12-28 03:36:53,988][106226] Updated weights for policy 0, policy_version 1162647 (0.0009) [2023-12-28 03:36:54,213][106225] Updated weights for policy 1, policy_version 1165745 (0.0008) [2023-12-28 03:36:54,268][106225] Updated weights for policy 1, policy_version 1165755 (0.0008) [2023-12-28 03:36:54,331][106225] Updated weights for policy 1, policy_version 1165765 (0.0008) [2023-12-28 03:36:54,748][106226] Updated weights for policy 0, policy_version 1162657 (0.0008) [2023-12-28 03:36:54,810][106226] Updated weights for policy 0, policy_version 1162667 (0.0008) [2023-12-28 03:36:54,875][106226] Updated weights for policy 0, policy_version 1162677 (0.0008) [2023-12-28 03:36:55,036][106225] Updated weights for policy 1, policy_version 1165775 (0.0010) [2023-12-28 03:36:55,085][106225] Updated weights for policy 1, policy_version 1165785 (0.0009) [2023-12-28 03:36:55,142][106225] Updated weights for policy 1, policy_version 1165795 (0.0009) [2023-12-28 03:36:55,608][106226] Updated weights for policy 0, policy_version 1162687 (0.0008) [2023-12-28 03:36:55,662][106226] Updated weights for policy 0, policy_version 1162697 (0.0009) [2023-12-28 03:36:55,715][106226] Updated weights for policy 0, policy_version 1162707 (0.0008) [2023-12-28 03:36:55,736][106225] Updated weights for policy 1, policy_version 1165805 (0.0007) [2023-12-28 03:36:55,794][106225] Updated weights for policy 1, policy_version 1165815 (0.0008) [2023-12-28 03:36:55,846][106225] Updated weights for policy 1, policy_version 1165825 (0.0008) [2023-12-28 03:36:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 596213760. Throughput: 0: 9887.0, 1: 9931.9. Samples: 596182040. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:36:56,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.019')] [2023-12-28 03:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001165832_298500096.pth... [2023-12-28 03:36:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001162712_297713664.pth... [2023-12-28 03:36:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001164648_298196992.pth [2023-12-28 03:36:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001161560_297418752.pth [2023-12-28 03:36:56,470][106226] Updated weights for policy 0, policy_version 1162717 (0.0007) [2023-12-28 03:36:56,530][106226] Updated weights for policy 0, policy_version 1162727 (0.0007) [2023-12-28 03:36:56,546][106225] Updated weights for policy 1, policy_version 1165835 (0.0009) [2023-12-28 03:36:56,588][106226] Updated weights for policy 0, policy_version 1162737 (0.0009) [2023-12-28 03:36:56,602][106225] Updated weights for policy 1, policy_version 1165845 (0.0007) [2023-12-28 03:36:56,653][106225] Updated weights for policy 1, policy_version 1165855 (0.0007) [2023-12-28 03:36:57,292][106226] Updated weights for policy 0, policy_version 1162747 (0.0009) [2023-12-28 03:36:57,350][106226] Updated weights for policy 0, policy_version 1162757 (0.0007) [2023-12-28 03:36:57,376][106225] Updated weights for policy 1, policy_version 1165865 (0.0008) [2023-12-28 03:36:57,405][106226] Updated weights for policy 0, policy_version 1162767 (0.0007) [2023-12-28 03:36:57,427][106225] Updated weights for policy 1, policy_version 1165875 (0.0006) [2023-12-28 03:36:57,486][106225] Updated weights for policy 1, policy_version 1165885 (0.0007) [2023-12-28 03:36:57,545][106225] Updated weights for policy 1, policy_version 1165895 (0.0008) [2023-12-28 03:36:58,126][106226] Updated weights for policy 0, policy_version 1162777 (0.0007) [2023-12-28 03:36:58,182][106226] Updated weights for policy 0, policy_version 1162787 (0.0009) [2023-12-28 03:36:58,231][106225] Updated weights for policy 1, policy_version 1165905 (0.0008) [2023-12-28 03:36:58,243][106226] Updated weights for policy 0, policy_version 1162797 (0.0007) [2023-12-28 03:36:58,290][106225] Updated weights for policy 1, policy_version 1165915 (0.0008) [2023-12-28 03:36:58,304][106226] Updated weights for policy 0, policy_version 1162807 (0.0008) [2023-12-28 03:36:58,354][106225] Updated weights for policy 1, policy_version 1165925 (0.0009) [2023-12-28 03:36:59,095][106226] Updated weights for policy 0, policy_version 1162817 (0.0006) [2023-12-28 03:36:59,160][106226] Updated weights for policy 0, policy_version 1162827 (0.0006) [2023-12-28 03:36:59,198][106225] Updated weights for policy 1, policy_version 1165935 (0.0010) [2023-12-28 03:36:59,223][106226] Updated weights for policy 0, policy_version 1162837 (0.0007) [2023-12-28 03:36:59,266][106225] Updated weights for policy 1, policy_version 1165945 (0.0010) [2023-12-28 03:36:59,328][106225] Updated weights for policy 1, policy_version 1165955 (0.0008) [2023-12-28 03:36:59,906][106226] Updated weights for policy 0, policy_version 1162847 (0.0008) [2023-12-28 03:36:59,971][106226] Updated weights for policy 0, policy_version 1162857 (0.0008) [2023-12-28 03:37:00,043][106226] Updated weights for policy 0, policy_version 1162867 (0.0008) [2023-12-28 03:37:00,078][106225] Updated weights for policy 1, policy_version 1165965 (0.0008) [2023-12-28 03:37:00,140][106225] Updated weights for policy 1, policy_version 1165975 (0.0006) [2023-12-28 03:37:00,199][106225] Updated weights for policy 1, policy_version 1165985 (0.0007) [2023-12-28 03:37:00,759][106226] Updated weights for policy 0, policy_version 1162877 (0.0007) [2023-12-28 03:37:00,824][106226] Updated weights for policy 0, policy_version 1162887 (0.0007) [2023-12-28 03:37:00,889][106226] Updated weights for policy 0, policy_version 1162897 (0.0008) [2023-12-28 03:37:00,905][106225] Updated weights for policy 1, policy_version 1165995 (0.0008) [2023-12-28 03:37:00,956][106225] Updated weights for policy 1, policy_version 1166005 (0.0006) [2023-12-28 03:37:01,024][106225] Updated weights for policy 1, policy_version 1166015 (0.0008) [2023-12-28 03:37:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 596312064. Throughput: 0: 9830.4, 1: 10022.1. Samples: 596297836. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:37:01,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.716')] [2023-12-28 03:37:01,616][106226] Updated weights for policy 0, policy_version 1162907 (0.0010) [2023-12-28 03:37:01,682][106226] Updated weights for policy 0, policy_version 1162917 (0.0009) [2023-12-28 03:37:01,740][106226] Updated weights for policy 0, policy_version 1162927 (0.0009) [2023-12-28 03:37:01,808][106225] Updated weights for policy 1, policy_version 1166025 (0.0007) [2023-12-28 03:37:01,862][106225] Updated weights for policy 1, policy_version 1166035 (0.0008) [2023-12-28 03:37:01,925][106225] Updated weights for policy 1, policy_version 1166045 (0.0008) [2023-12-28 03:37:01,980][106225] Updated weights for policy 1, policy_version 1166055 (0.0009) [2023-12-28 03:37:02,403][106226] Updated weights for policy 0, policy_version 1162937 (0.0008) [2023-12-28 03:37:02,464][106226] Updated weights for policy 0, policy_version 1162947 (0.0009) [2023-12-28 03:37:02,528][106226] Updated weights for policy 0, policy_version 1162957 (0.0008) [2023-12-28 03:37:02,602][106226] Updated weights for policy 0, policy_version 1162967 (0.0009) [2023-12-28 03:37:02,760][106225] Updated weights for policy 1, policy_version 1166065 (0.0008) [2023-12-28 03:37:02,821][106225] Updated weights for policy 1, policy_version 1166075 (0.0007) [2023-12-28 03:37:02,880][106225] Updated weights for policy 1, policy_version 1166085 (0.0009) [2023-12-28 03:37:03,305][106226] Updated weights for policy 0, policy_version 1162977 (0.0007) [2023-12-28 03:37:03,359][106226] Updated weights for policy 0, policy_version 1162987 (0.0006) [2023-12-28 03:37:03,426][106226] Updated weights for policy 0, policy_version 1162997 (0.0007) [2023-12-28 03:37:03,624][106225] Updated weights for policy 1, policy_version 1166095 (0.0008) [2023-12-28 03:37:03,686][106225] Updated weights for policy 1, policy_version 1166105 (0.0009) [2023-12-28 03:37:03,747][106225] Updated weights for policy 1, policy_version 1166115 (0.0008) [2023-12-28 03:37:04,087][106226] Updated weights for policy 0, policy_version 1163007 (0.0006) [2023-12-28 03:37:04,143][106226] Updated weights for policy 0, policy_version 1163017 (0.0009) [2023-12-28 03:37:04,203][106226] Updated weights for policy 0, policy_version 1163027 (0.0009) [2023-12-28 03:37:04,492][106225] Updated weights for policy 1, policy_version 1166125 (0.0008) [2023-12-28 03:37:04,546][106225] Updated weights for policy 1, policy_version 1166135 (0.0007) [2023-12-28 03:37:04,606][106225] Updated weights for policy 1, policy_version 1166145 (0.0005) [2023-12-28 03:37:04,910][106226] Updated weights for policy 0, policy_version 1163037 (0.0007) [2023-12-28 03:37:04,967][106226] Updated weights for policy 0, policy_version 1163047 (0.0009) [2023-12-28 03:37:05,021][106226] Updated weights for policy 0, policy_version 1163057 (0.0007) [2023-12-28 03:37:05,207][106225] Updated weights for policy 1, policy_version 1166155 (0.0007) [2023-12-28 03:37:05,265][106225] Updated weights for policy 1, policy_version 1166165 (0.0010) [2023-12-28 03:37:05,325][106225] Updated weights for policy 1, policy_version 1166175 (0.0010) [2023-12-28 03:37:05,695][106226] Updated weights for policy 0, policy_version 1163067 (0.0009) [2023-12-28 03:37:05,745][106226] Updated weights for policy 0, policy_version 1163077 (0.0009) [2023-12-28 03:37:05,792][106226] Updated weights for policy 0, policy_version 1163087 (0.0010) [2023-12-28 03:37:05,994][106225] Updated weights for policy 1, policy_version 1166185 (0.0008) [2023-12-28 03:37:06,045][106225] Updated weights for policy 1, policy_version 1166195 (0.0009) [2023-12-28 03:37:06,101][106225] Updated weights for policy 1, policy_version 1166205 (0.0006) [2023-12-28 03:37:06,165][106225] Updated weights for policy 1, policy_version 1166215 (0.0007) [2023-12-28 03:37:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 596410368. Throughput: 0: 9854.8, 1: 10025.8. Samples: 596415688. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:37:06,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-5.111')] [2023-12-28 03:37:06,513][106226] Updated weights for policy 0, policy_version 1163097 (0.0010) [2023-12-28 03:37:06,573][106226] Updated weights for policy 0, policy_version 1163107 (0.0011) [2023-12-28 03:37:06,638][106226] Updated weights for policy 0, policy_version 1163117 (0.0009) [2023-12-28 03:37:06,699][106226] Updated weights for policy 0, policy_version 1163127 (0.0006) [2023-12-28 03:37:06,877][106225] Updated weights for policy 1, policy_version 1166225 (0.0006) [2023-12-28 03:37:06,938][106225] Updated weights for policy 1, policy_version 1166235 (0.0005) [2023-12-28 03:37:07,001][106225] Updated weights for policy 1, policy_version 1166245 (0.0005) [2023-12-28 03:37:07,324][106226] Updated weights for policy 0, policy_version 1163137 (0.0005) [2023-12-28 03:37:07,385][106226] Updated weights for policy 0, policy_version 1163147 (0.0010) [2023-12-28 03:37:07,449][106226] Updated weights for policy 0, policy_version 1163157 (0.0011) [2023-12-28 03:37:07,684][106225] Updated weights for policy 1, policy_version 1166255 (0.0008) [2023-12-28 03:37:07,751][106225] Updated weights for policy 1, policy_version 1166265 (0.0005) [2023-12-28 03:37:07,824][106225] Updated weights for policy 1, policy_version 1166275 (0.0005) [2023-12-28 03:37:08,065][106226] Updated weights for policy 0, policy_version 1163167 (0.0010) [2023-12-28 03:37:08,119][106226] Updated weights for policy 0, policy_version 1163177 (0.0011) [2023-12-28 03:37:08,170][106226] Updated weights for policy 0, policy_version 1163187 (0.0011) [2023-12-28 03:37:08,403][106225] Updated weights for policy 1, policy_version 1166285 (0.0007) [2023-12-28 03:37:08,464][106225] Updated weights for policy 1, policy_version 1166295 (0.0008) [2023-12-28 03:37:08,525][106225] Updated weights for policy 1, policy_version 1166305 (0.0008) [2023-12-28 03:37:08,922][106226] Updated weights for policy 0, policy_version 1163197 (0.0011) [2023-12-28 03:37:08,983][106226] Updated weights for policy 0, policy_version 1163207 (0.0011) [2023-12-28 03:37:09,043][106226] Updated weights for policy 0, policy_version 1163217 (0.0010) [2023-12-28 03:37:09,240][106225] Updated weights for policy 1, policy_version 1166315 (0.0007) [2023-12-28 03:37:09,295][106225] Updated weights for policy 1, policy_version 1166325 (0.0008) [2023-12-28 03:37:09,365][106225] Updated weights for policy 1, policy_version 1166335 (0.0008) [2023-12-28 03:37:09,798][106226] Updated weights for policy 0, policy_version 1163227 (0.0010) [2023-12-28 03:37:09,872][106226] Updated weights for policy 0, policy_version 1163237 (0.0009) [2023-12-28 03:37:09,940][106226] Updated weights for policy 0, policy_version 1163247 (0.0009) [2023-12-28 03:37:10,040][106225] Updated weights for policy 1, policy_version 1166345 (0.0009) [2023-12-28 03:37:10,105][106225] Updated weights for policy 1, policy_version 1166355 (0.0008) [2023-12-28 03:37:10,167][106225] Updated weights for policy 1, policy_version 1166365 (0.0007) [2023-12-28 03:37:10,225][106225] Updated weights for policy 1, policy_version 1166375 (0.0008) [2023-12-28 03:37:10,668][106226] Updated weights for policy 0, policy_version 1163257 (0.0011) [2023-12-28 03:37:10,731][106226] Updated weights for policy 0, policy_version 1163267 (0.0011) [2023-12-28 03:37:10,802][106226] Updated weights for policy 0, policy_version 1163277 (0.0011) [2023-12-28 03:37:10,862][106226] Updated weights for policy 0, policy_version 1163287 (0.0011) [2023-12-28 03:37:10,979][106225] Updated weights for policy 1, policy_version 1166385 (0.0008) [2023-12-28 03:37:11,040][106225] Updated weights for policy 1, policy_version 1166395 (0.0008) [2023-12-28 03:37:11,102][106225] Updated weights for policy 1, policy_version 1166405 (0.0008) [2023-12-28 03:37:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 596508672. Throughput: 0: 9891.2, 1: 10050.4. Samples: 596476668. Policy #0 lag: (min: 19.0, avg: 23.9, max: 51.0) [2023-12-28 03:37:11,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.820')] [2023-12-28 03:37:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001166408_298647552.pth... [2023-12-28 03:37:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001163288_297861120.pth... [2023-12-28 03:37:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001162168_297574400.pth [2023-12-28 03:37:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001165224_298344448.pth [2023-12-28 03:37:11,574][106226] Updated weights for policy 0, policy_version 1163297 (0.0008) [2023-12-28 03:37:11,639][106226] Updated weights for policy 0, policy_version 1163307 (0.0007) [2023-12-28 03:37:11,699][106226] Updated weights for policy 0, policy_version 1163317 (0.0008) [2023-12-28 03:37:11,941][106225] Updated weights for policy 1, policy_version 1166415 (0.0008) [2023-12-28 03:37:12,005][106225] Updated weights for policy 1, policy_version 1166425 (0.0008) [2023-12-28 03:37:12,065][106225] Updated weights for policy 1, policy_version 1166435 (0.0008) [2023-12-28 03:37:12,397][106226] Updated weights for policy 0, policy_version 1163327 (0.0009) [2023-12-28 03:37:12,458][106226] Updated weights for policy 0, policy_version 1163337 (0.0011) [2023-12-28 03:37:12,523][106226] Updated weights for policy 0, policy_version 1163347 (0.0011) [2023-12-28 03:37:12,812][106225] Updated weights for policy 1, policy_version 1166445 (0.0009) [2023-12-28 03:37:12,874][106225] Updated weights for policy 1, policy_version 1166455 (0.0007) [2023-12-28 03:37:12,939][106225] Updated weights for policy 1, policy_version 1166465 (0.0010) [2023-12-28 03:37:13,221][106226] Updated weights for policy 0, policy_version 1163357 (0.0008) [2023-12-28 03:37:13,282][106226] Updated weights for policy 0, policy_version 1163367 (0.0006) [2023-12-28 03:37:13,340][106226] Updated weights for policy 0, policy_version 1163377 (0.0006) [2023-12-28 03:37:13,632][106225] Updated weights for policy 1, policy_version 1166475 (0.0009) [2023-12-28 03:37:13,689][106225] Updated weights for policy 1, policy_version 1166485 (0.0005) [2023-12-28 03:37:13,746][106225] Updated weights for policy 1, policy_version 1166495 (0.0005) [2023-12-28 03:37:13,896][106226] Updated weights for policy 0, policy_version 1163387 (0.0009) [2023-12-28 03:37:13,962][106226] Updated weights for policy 0, policy_version 1163397 (0.0010) [2023-12-28 03:37:14,019][106226] Updated weights for policy 0, policy_version 1163407 (0.0010) [2023-12-28 03:37:14,288][106225] Updated weights for policy 1, policy_version 1166505 (0.0006) [2023-12-28 03:37:14,351][106225] Updated weights for policy 1, policy_version 1166515 (0.0008) [2023-12-28 03:37:14,408][106225] Updated weights for policy 1, policy_version 1166525 (0.0006) [2023-12-28 03:37:14,463][106225] Updated weights for policy 1, policy_version 1166535 (0.0005) [2023-12-28 03:37:14,740][106226] Updated weights for policy 0, policy_version 1163417 (0.0008) [2023-12-28 03:37:14,805][106226] Updated weights for policy 0, policy_version 1163427 (0.0009) [2023-12-28 03:37:14,857][106226] Updated weights for policy 0, policy_version 1163437 (0.0005) [2023-12-28 03:37:14,915][106226] Updated weights for policy 0, policy_version 1163447 (0.0007) [2023-12-28 03:37:15,169][106225] Updated weights for policy 1, policy_version 1166545 (0.0009) [2023-12-28 03:37:15,230][106225] Updated weights for policy 1, policy_version 1166555 (0.0008) [2023-12-28 03:37:15,292][106225] Updated weights for policy 1, policy_version 1166565 (0.0008) [2023-12-28 03:37:15,588][106226] Updated weights for policy 0, policy_version 1163457 (0.0009) [2023-12-28 03:37:15,648][106226] Updated weights for policy 0, policy_version 1163467 (0.0010) [2023-12-28 03:37:15,722][106226] Updated weights for policy 0, policy_version 1163477 (0.0006) [2023-12-28 03:37:15,950][106225] Updated weights for policy 1, policy_version 1166575 (0.0007) [2023-12-28 03:37:16,007][106225] Updated weights for policy 1, policy_version 1166585 (0.0009) [2023-12-28 03:37:16,058][106225] Updated weights for policy 1, policy_version 1166595 (0.0008) [2023-12-28 03:37:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 596606976. Throughput: 0: 9863.5, 1: 9966.9. Samples: 596594220. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:16,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-5.208')] [2023-12-28 03:37:16,304][106226] Updated weights for policy 0, policy_version 1163487 (0.0006) [2023-12-28 03:37:16,354][106226] Updated weights for policy 0, policy_version 1163497 (0.0007) [2023-12-28 03:37:16,404][106226] Updated weights for policy 0, policy_version 1163507 (0.0010) [2023-12-28 03:37:16,837][106225] Updated weights for policy 1, policy_version 1166605 (0.0007) [2023-12-28 03:37:16,889][106225] Updated weights for policy 1, policy_version 1166615 (0.0005) [2023-12-28 03:37:16,943][106225] Updated weights for policy 1, policy_version 1166625 (0.0005) [2023-12-28 03:37:17,045][106226] Updated weights for policy 0, policy_version 1163517 (0.0008) [2023-12-28 03:37:17,108][106226] Updated weights for policy 0, policy_version 1163527 (0.0010) [2023-12-28 03:37:17,175][106226] Updated weights for policy 0, policy_version 1163537 (0.0010) [2023-12-28 03:37:17,539][106225] Updated weights for policy 1, policy_version 1166635 (0.0006) [2023-12-28 03:37:17,592][106225] Updated weights for policy 1, policy_version 1166645 (0.0007) [2023-12-28 03:37:17,645][106225] Updated weights for policy 1, policy_version 1166655 (0.0007) [2023-12-28 03:37:17,828][106226] Updated weights for policy 0, policy_version 1163547 (0.0006) [2023-12-28 03:37:17,884][106226] Updated weights for policy 0, policy_version 1163557 (0.0007) [2023-12-28 03:37:17,930][106226] Updated weights for policy 0, policy_version 1163567 (0.0008) [2023-12-28 03:37:18,354][106225] Updated weights for policy 1, policy_version 1166665 (0.0009) [2023-12-28 03:37:18,418][106225] Updated weights for policy 1, policy_version 1166675 (0.0009) [2023-12-28 03:37:18,482][106225] Updated weights for policy 1, policy_version 1166685 (0.0011) [2023-12-28 03:37:18,540][106225] Updated weights for policy 1, policy_version 1166695 (0.0009) [2023-12-28 03:37:18,688][106226] Updated weights for policy 0, policy_version 1163577 (0.0008) [2023-12-28 03:37:18,747][106226] Updated weights for policy 0, policy_version 1163587 (0.0008) [2023-12-28 03:37:18,806][106226] Updated weights for policy 0, policy_version 1163597 (0.0008) [2023-12-28 03:37:18,872][106226] Updated weights for policy 0, policy_version 1163607 (0.0008) [2023-12-28 03:37:19,176][106225] Updated weights for policy 1, policy_version 1166705 (0.0007) [2023-12-28 03:37:19,232][106225] Updated weights for policy 1, policy_version 1166715 (0.0008) [2023-12-28 03:37:19,299][106225] Updated weights for policy 1, policy_version 1166725 (0.0007) [2023-12-28 03:37:19,587][106226] Updated weights for policy 0, policy_version 1163617 (0.0008) [2023-12-28 03:37:19,652][106226] Updated weights for policy 0, policy_version 1163627 (0.0007) [2023-12-28 03:37:19,720][106226] Updated weights for policy 0, policy_version 1163637 (0.0008) [2023-12-28 03:37:20,031][106225] Updated weights for policy 1, policy_version 1166735 (0.0009) [2023-12-28 03:37:20,096][106225] Updated weights for policy 1, policy_version 1166745 (0.0009) [2023-12-28 03:37:20,162][106225] Updated weights for policy 1, policy_version 1166755 (0.0009) [2023-12-28 03:37:20,428][106226] Updated weights for policy 0, policy_version 1163647 (0.0009) [2023-12-28 03:37:20,491][106226] Updated weights for policy 0, policy_version 1163657 (0.0009) [2023-12-28 03:37:20,549][106226] Updated weights for policy 0, policy_version 1163667 (0.0008) [2023-12-28 03:37:20,906][106225] Updated weights for policy 1, policy_version 1166765 (0.0007) [2023-12-28 03:37:20,973][106225] Updated weights for policy 1, policy_version 1166775 (0.0005) [2023-12-28 03:37:21,049][106225] Updated weights for policy 1, policy_version 1166785 (0.0006) [2023-12-28 03:37:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 596705280. Throughput: 0: 9810.9, 1: 9917.1. Samples: 596713488. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:21,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.939')] [2023-12-28 03:37:21,287][106226] Updated weights for policy 0, policy_version 1163677 (0.0009) [2023-12-28 03:37:21,348][106226] Updated weights for policy 0, policy_version 1163687 (0.0008) [2023-12-28 03:37:21,422][106226] Updated weights for policy 0, policy_version 1163697 (0.0009) [2023-12-28 03:37:21,843][106225] Updated weights for policy 1, policy_version 1166795 (0.0007) [2023-12-28 03:37:21,912][106225] Updated weights for policy 1, policy_version 1166805 (0.0008) [2023-12-28 03:37:21,983][106225] Updated weights for policy 1, policy_version 1166815 (0.0008) [2023-12-28 03:37:22,159][106226] Updated weights for policy 0, policy_version 1163707 (0.0008) [2023-12-28 03:37:22,215][106226] Updated weights for policy 0, policy_version 1163717 (0.0010) [2023-12-28 03:37:22,280][106226] Updated weights for policy 0, policy_version 1163727 (0.0009) [2023-12-28 03:37:22,664][106225] Updated weights for policy 1, policy_version 1166825 (0.0008) [2023-12-28 03:37:22,731][106225] Updated weights for policy 1, policy_version 1166835 (0.0009) [2023-12-28 03:37:22,796][106225] Updated weights for policy 1, policy_version 1166845 (0.0007) [2023-12-28 03:37:22,856][106225] Updated weights for policy 1, policy_version 1166855 (0.0008) [2023-12-28 03:37:22,918][106226] Updated weights for policy 0, policy_version 1163737 (0.0006) [2023-12-28 03:37:22,972][106226] Updated weights for policy 0, policy_version 1163747 (0.0009) [2023-12-28 03:37:23,028][106226] Updated weights for policy 0, policy_version 1163757 (0.0008) [2023-12-28 03:37:23,079][106226] Updated weights for policy 0, policy_version 1163767 (0.0009) [2023-12-28 03:37:23,575][106225] Updated weights for policy 1, policy_version 1166865 (0.0008) [2023-12-28 03:37:23,631][106225] Updated weights for policy 1, policy_version 1166875 (0.0009) [2023-12-28 03:37:23,693][106225] Updated weights for policy 1, policy_version 1166885 (0.0008) [2023-12-28 03:37:23,749][106226] Updated weights for policy 0, policy_version 1163777 (0.0008) [2023-12-28 03:37:23,798][106226] Updated weights for policy 0, policy_version 1163787 (0.0008) [2023-12-28 03:37:23,847][106226] Updated weights for policy 0, policy_version 1163797 (0.0009) [2023-12-28 03:37:24,354][106225] Updated weights for policy 1, policy_version 1166895 (0.0007) [2023-12-28 03:37:24,416][106225] Updated weights for policy 1, policy_version 1166905 (0.0008) [2023-12-28 03:37:24,479][106225] Updated weights for policy 1, policy_version 1166915 (0.0008) [2023-12-28 03:37:24,563][106226] Updated weights for policy 0, policy_version 1163807 (0.0009) [2023-12-28 03:37:24,617][106226] Updated weights for policy 0, policy_version 1163817 (0.0011) [2023-12-28 03:37:24,663][106226] Updated weights for policy 0, policy_version 1163827 (0.0010) [2023-12-28 03:37:25,231][106225] Updated weights for policy 1, policy_version 1166925 (0.0008) [2023-12-28 03:37:25,283][106225] Updated weights for policy 1, policy_version 1166935 (0.0009) [2023-12-28 03:37:25,328][106226] Updated weights for policy 0, policy_version 1163837 (0.0010) [2023-12-28 03:37:25,341][106225] Updated weights for policy 1, policy_version 1166945 (0.0007) [2023-12-28 03:37:25,387][106226] Updated weights for policy 0, policy_version 1163847 (0.0010) [2023-12-28 03:37:25,444][106226] Updated weights for policy 0, policy_version 1163857 (0.0010) [2023-12-28 03:37:26,056][106226] Updated weights for policy 0, policy_version 1163867 (0.0009) [2023-12-28 03:37:26,060][106225] Updated weights for policy 1, policy_version 1166955 (0.0006) [2023-12-28 03:37:26,114][106226] Updated weights for policy 0, policy_version 1163877 (0.0008) [2023-12-28 03:37:26,126][106225] Updated weights for policy 1, policy_version 1166965 (0.0006) [2023-12-28 03:37:26,174][106226] Updated weights for policy 0, policy_version 1163887 (0.0010) [2023-12-28 03:37:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 596795392. Throughput: 0: 9820.7, 1: 9848.4. Samples: 596771376. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:26,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.752')] [2023-12-28 03:37:26,191][106225] Updated weights for policy 1, policy_version 1166975 (0.0005) [2023-12-28 03:37:26,219][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001163896_298016768.pth... [2023-12-28 03:37:26,222][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001162712_297713664.pth [2023-12-28 03:37:26,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001166984_298795008.pth... [2023-12-28 03:37:26,247][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001165832_298500096.pth [2023-12-28 03:37:26,731][106226] Updated weights for policy 0, policy_version 1163897 (0.0010) [2023-12-28 03:37:26,765][106225] Updated weights for policy 1, policy_version 1166985 (0.0006) [2023-12-28 03:37:26,798][106226] Updated weights for policy 0, policy_version 1163907 (0.0009) [2023-12-28 03:37:26,820][106225] Updated weights for policy 1, policy_version 1166995 (0.0005) [2023-12-28 03:37:26,860][106226] Updated weights for policy 0, policy_version 1163917 (0.0009) [2023-12-28 03:37:26,879][106225] Updated weights for policy 1, policy_version 1167005 (0.0006) [2023-12-28 03:37:26,911][106226] Updated weights for policy 0, policy_version 1163927 (0.0006) [2023-12-28 03:37:26,937][106225] Updated weights for policy 1, policy_version 1167015 (0.0009) [2023-12-28 03:37:27,429][106226] Updated weights for policy 0, policy_version 1163937 (0.0005) [2023-12-28 03:37:27,485][106226] Updated weights for policy 0, policy_version 1163947 (0.0005) [2023-12-28 03:37:27,537][106226] Updated weights for policy 0, policy_version 1163957 (0.0005) [2023-12-28 03:37:27,705][106225] Updated weights for policy 1, policy_version 1167025 (0.0009) [2023-12-28 03:37:27,754][106225] Updated weights for policy 1, policy_version 1167035 (0.0008) [2023-12-28 03:37:27,804][106225] Updated weights for policy 1, policy_version 1167046 (0.0009) [2023-12-28 03:37:28,077][106226] Updated weights for policy 0, policy_version 1163967 (0.0006) [2023-12-28 03:37:28,124][106226] Updated weights for policy 0, policy_version 1163977 (0.0006) [2023-12-28 03:37:28,171][106226] Updated weights for policy 0, policy_version 1163987 (0.0008) [2023-12-28 03:37:28,602][106225] Updated weights for policy 1, policy_version 1167056 (0.0009) [2023-12-28 03:37:28,656][106225] Updated weights for policy 1, policy_version 1167066 (0.0008) [2023-12-28 03:37:28,723][106225] Updated weights for policy 1, policy_version 1167076 (0.0008) [2023-12-28 03:37:28,940][106226] Updated weights for policy 0, policy_version 1163997 (0.0010) [2023-12-28 03:37:28,991][106226] Updated weights for policy 0, policy_version 1164007 (0.0008) [2023-12-28 03:37:29,041][106226] Updated weights for policy 0, policy_version 1164017 (0.0005) [2023-12-28 03:37:29,480][106225] Updated weights for policy 1, policy_version 1167086 (0.0007) [2023-12-28 03:37:29,536][106225] Updated weights for policy 1, policy_version 1167096 (0.0007) [2023-12-28 03:37:29,593][106225] Updated weights for policy 1, policy_version 1167106 (0.0007) [2023-12-28 03:37:29,709][106226] Updated weights for policy 0, policy_version 1164027 (0.0007) [2023-12-28 03:37:29,762][106226] Updated weights for policy 0, policy_version 1164037 (0.0010) [2023-12-28 03:37:29,825][106226] Updated weights for policy 0, policy_version 1164047 (0.0012) [2023-12-28 03:37:30,366][106225] Updated weights for policy 1, policy_version 1167116 (0.0008) [2023-12-28 03:37:30,428][106225] Updated weights for policy 1, policy_version 1167126 (0.0007) [2023-12-28 03:37:30,486][106225] Updated weights for policy 1, policy_version 1167136 (0.0007) [2023-12-28 03:37:30,516][106226] Updated weights for policy 0, policy_version 1164057 (0.0010) [2023-12-28 03:37:30,576][106226] Updated weights for policy 0, policy_version 1164067 (0.0010) [2023-12-28 03:37:30,636][106226] Updated weights for policy 0, policy_version 1164077 (0.0010) [2023-12-28 03:37:30,689][106226] Updated weights for policy 0, policy_version 1164087 (0.0010) [2023-12-28 03:37:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 596901888. Throughput: 0: 10019.2, 1: 9858.3. Samples: 596895704. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:31,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.874')] [2023-12-28 03:37:31,204][106225] Updated weights for policy 1, policy_version 1167146 (0.0006) [2023-12-28 03:37:31,273][106225] Updated weights for policy 1, policy_version 1167156 (0.0007) [2023-12-28 03:37:31,337][106225] Updated weights for policy 1, policy_version 1167166 (0.0008) [2023-12-28 03:37:31,376][106226] Updated weights for policy 0, policy_version 1164097 (0.0010) [2023-12-28 03:37:31,411][106225] Updated weights for policy 1, policy_version 1167176 (0.0008) [2023-12-28 03:37:31,435][106226] Updated weights for policy 0, policy_version 1164107 (0.0011) [2023-12-28 03:37:31,489][106226] Updated weights for policy 0, policy_version 1164117 (0.0010) [2023-12-28 03:37:32,137][106225] Updated weights for policy 1, policy_version 1167186 (0.0008) [2023-12-28 03:37:32,195][106225] Updated weights for policy 1, policy_version 1167196 (0.0007) [2023-12-28 03:37:32,232][106226] Updated weights for policy 0, policy_version 1164127 (0.0011) [2023-12-28 03:37:32,256][106225] Updated weights for policy 1, policy_version 1167206 (0.0006) [2023-12-28 03:37:32,294][106226] Updated weights for policy 0, policy_version 1164137 (0.0009) [2023-12-28 03:37:32,363][106226] Updated weights for policy 0, policy_version 1164147 (0.0009) [2023-12-28 03:37:32,992][106226] Updated weights for policy 0, policy_version 1164157 (0.0009) [2023-12-28 03:37:33,025][106225] Updated weights for policy 1, policy_version 1167216 (0.0007) [2023-12-28 03:37:33,047][106226] Updated weights for policy 0, policy_version 1164167 (0.0010) [2023-12-28 03:37:33,072][106225] Updated weights for policy 1, policy_version 1167226 (0.0008) [2023-12-28 03:37:33,106][106226] Updated weights for policy 0, policy_version 1164177 (0.0010) [2023-12-28 03:37:33,122][106225] Updated weights for policy 1, policy_version 1167236 (0.0008) [2023-12-28 03:37:33,764][106226] Updated weights for policy 0, policy_version 1164187 (0.0009) [2023-12-28 03:37:33,821][106226] Updated weights for policy 0, policy_version 1164197 (0.0006) [2023-12-28 03:37:33,878][106226] Updated weights for policy 0, policy_version 1164207 (0.0006) [2023-12-28 03:37:33,890][106225] Updated weights for policy 1, policy_version 1167246 (0.0007) [2023-12-28 03:37:33,945][106225] Updated weights for policy 1, policy_version 1167256 (0.0007) [2023-12-28 03:37:34,001][106225] Updated weights for policy 1, policy_version 1167266 (0.0011) [2023-12-28 03:37:34,573][106226] Updated weights for policy 0, policy_version 1164217 (0.0010) [2023-12-28 03:37:34,640][106226] Updated weights for policy 0, policy_version 1164227 (0.0011) [2023-12-28 03:37:34,703][106226] Updated weights for policy 0, policy_version 1164237 (0.0010) [2023-12-28 03:37:34,740][106225] Updated weights for policy 1, policy_version 1167276 (0.0007) [2023-12-28 03:37:34,758][106226] Updated weights for policy 0, policy_version 1164247 (0.0006) [2023-12-28 03:37:34,797][106225] Updated weights for policy 1, policy_version 1167286 (0.0008) [2023-12-28 03:37:34,848][106225] Updated weights for policy 1, policy_version 1167296 (0.0008) [2023-12-28 03:37:35,451][106226] Updated weights for policy 0, policy_version 1164257 (0.0008) [2023-12-28 03:37:35,520][106226] Updated weights for policy 0, policy_version 1164267 (0.0009) [2023-12-28 03:37:35,569][106226] Updated weights for policy 0, policy_version 1164277 (0.0008) [2023-12-28 03:37:35,592][106225] Updated weights for policy 1, policy_version 1167306 (0.0008) [2023-12-28 03:37:35,642][106225] Updated weights for policy 1, policy_version 1167316 (0.0008) [2023-12-28 03:37:35,690][106225] Updated weights for policy 1, policy_version 1167326 (0.0008) [2023-12-28 03:37:35,738][106225] Updated weights for policy 1, policy_version 1167336 (0.0008) [2023-12-28 03:37:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 597000192. Throughput: 0: 9989.9, 1: 9673.8. Samples: 597011228. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:36,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.794')] [2023-12-28 03:37:36,295][106226] Updated weights for policy 0, policy_version 1164287 (0.0008) [2023-12-28 03:37:36,362][106226] Updated weights for policy 0, policy_version 1164297 (0.0009) [2023-12-28 03:37:36,422][106226] Updated weights for policy 0, policy_version 1164307 (0.0008) [2023-12-28 03:37:36,512][106225] Updated weights for policy 1, policy_version 1167346 (0.0008) [2023-12-28 03:37:36,576][106225] Updated weights for policy 1, policy_version 1167356 (0.0008) [2023-12-28 03:37:36,639][106225] Updated weights for policy 1, policy_version 1167366 (0.0008) [2023-12-28 03:37:37,118][106226] Updated weights for policy 0, policy_version 1164317 (0.0007) [2023-12-28 03:37:37,177][106226] Updated weights for policy 0, policy_version 1164327 (0.0005) [2023-12-28 03:37:37,224][106226] Updated weights for policy 0, policy_version 1164337 (0.0009) [2023-12-28 03:37:37,399][106225] Updated weights for policy 1, policy_version 1167376 (0.0008) [2023-12-28 03:37:37,458][106225] Updated weights for policy 1, policy_version 1167386 (0.0008) [2023-12-28 03:37:37,516][106225] Updated weights for policy 1, policy_version 1167396 (0.0008) [2023-12-28 03:37:37,910][106226] Updated weights for policy 0, policy_version 1164347 (0.0008) [2023-12-28 03:37:37,970][106226] Updated weights for policy 0, policy_version 1164357 (0.0005) [2023-12-28 03:37:38,031][106226] Updated weights for policy 0, policy_version 1164367 (0.0007) [2023-12-28 03:37:38,248][106225] Updated weights for policy 1, policy_version 1167406 (0.0007) [2023-12-28 03:37:38,310][106225] Updated weights for policy 1, policy_version 1167416 (0.0009) [2023-12-28 03:37:38,372][106225] Updated weights for policy 1, policy_version 1167426 (0.0007) [2023-12-28 03:37:38,745][106226] Updated weights for policy 0, policy_version 1164377 (0.0009) [2023-12-28 03:37:38,809][106226] Updated weights for policy 0, policy_version 1164387 (0.0011) [2023-12-28 03:37:38,877][106226] Updated weights for policy 0, policy_version 1164397 (0.0011) [2023-12-28 03:37:38,935][106226] Updated weights for policy 0, policy_version 1164407 (0.0011) [2023-12-28 03:37:39,142][106225] Updated weights for policy 1, policy_version 1167436 (0.0008) [2023-12-28 03:37:39,192][106225] Updated weights for policy 1, policy_version 1167446 (0.0008) [2023-12-28 03:37:39,267][106225] Updated weights for policy 1, policy_version 1167456 (0.0008) [2023-12-28 03:37:39,666][106226] Updated weights for policy 0, policy_version 1164417 (0.0011) [2023-12-28 03:37:39,729][106226] Updated weights for policy 0, policy_version 1164427 (0.0011) [2023-12-28 03:37:39,799][106226] Updated weights for policy 0, policy_version 1164437 (0.0011) [2023-12-28 03:37:40,037][106225] Updated weights for policy 1, policy_version 1167466 (0.0008) [2023-12-28 03:37:40,103][106225] Updated weights for policy 1, policy_version 1167476 (0.0008) [2023-12-28 03:37:40,162][106225] Updated weights for policy 1, policy_version 1167486 (0.0008) [2023-12-28 03:37:40,223][106225] Updated weights for policy 1, policy_version 1167496 (0.0007) [2023-12-28 03:37:40,528][106226] Updated weights for policy 0, policy_version 1164447 (0.0011) [2023-12-28 03:37:40,594][106226] Updated weights for policy 0, policy_version 1164457 (0.0009) [2023-12-28 03:37:40,650][106226] Updated weights for policy 0, policy_version 1164467 (0.0005) [2023-12-28 03:37:40,989][106225] Updated weights for policy 1, policy_version 1167506 (0.0009) [2023-12-28 03:37:41,054][106225] Updated weights for policy 1, policy_version 1167516 (0.0009) [2023-12-28 03:37:41,120][106225] Updated weights for policy 1, policy_version 1167526 (0.0009) [2023-12-28 03:37:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 597098496. Throughput: 0: 10039.9, 1: 9659.7. Samples: 597068516. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:41,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.954')] [2023-12-28 03:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001167528_298934272.pth... [2023-12-28 03:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001164472_298164224.pth... [2023-12-28 03:37:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001163288_297861120.pth [2023-12-28 03:37:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001166408_298647552.pth [2023-12-28 03:37:41,271][106226] Updated weights for policy 0, policy_version 1164477 (0.0008) [2023-12-28 03:37:41,332][106226] Updated weights for policy 0, policy_version 1164487 (0.0011) [2023-12-28 03:37:41,400][106226] Updated weights for policy 0, policy_version 1164497 (0.0010) [2023-12-28 03:37:41,949][106225] Updated weights for policy 1, policy_version 1167536 (0.0007) [2023-12-28 03:37:42,004][106225] Updated weights for policy 1, policy_version 1167546 (0.0008) [2023-12-28 03:37:42,061][106225] Updated weights for policy 1, policy_version 1167556 (0.0010) [2023-12-28 03:37:42,135][106226] Updated weights for policy 0, policy_version 1164507 (0.0009) [2023-12-28 03:37:42,193][106226] Updated weights for policy 0, policy_version 1164517 (0.0009) [2023-12-28 03:37:42,253][106226] Updated weights for policy 0, policy_version 1164527 (0.0009) [2023-12-28 03:37:42,813][106225] Updated weights for policy 1, policy_version 1167566 (0.0009) [2023-12-28 03:37:42,863][106225] Updated weights for policy 1, policy_version 1167576 (0.0006) [2023-12-28 03:37:42,911][106225] Updated weights for policy 1, policy_version 1167586 (0.0008) [2023-12-28 03:37:42,999][106226] Updated weights for policy 0, policy_version 1164537 (0.0007) [2023-12-28 03:37:43,053][106226] Updated weights for policy 0, policy_version 1164547 (0.0008) [2023-12-28 03:37:43,113][106226] Updated weights for policy 0, policy_version 1164557 (0.0009) [2023-12-28 03:37:43,165][106226] Updated weights for policy 0, policy_version 1164567 (0.0009) [2023-12-28 03:37:43,574][106225] Updated weights for policy 1, policy_version 1167596 (0.0007) [2023-12-28 03:37:43,627][106225] Updated weights for policy 1, policy_version 1167606 (0.0008) [2023-12-28 03:37:43,671][106225] Updated weights for policy 1, policy_version 1167616 (0.0008) [2023-12-28 03:37:43,912][106226] Updated weights for policy 0, policy_version 1164577 (0.0006) [2023-12-28 03:37:43,973][106226] Updated weights for policy 0, policy_version 1164587 (0.0008) [2023-12-28 03:37:44,021][106226] Updated weights for policy 0, policy_version 1164597 (0.0008) [2023-12-28 03:37:44,441][106225] Updated weights for policy 1, policy_version 1167626 (0.0007) [2023-12-28 03:37:44,500][106225] Updated weights for policy 1, policy_version 1167636 (0.0005) [2023-12-28 03:37:44,557][106225] Updated weights for policy 1, policy_version 1167646 (0.0006) [2023-12-28 03:37:44,625][106225] Updated weights for policy 1, policy_version 1167656 (0.0005) [2023-12-28 03:37:44,707][106226] Updated weights for policy 0, policy_version 1164607 (0.0009) [2023-12-28 03:37:44,765][106226] Updated weights for policy 0, policy_version 1164617 (0.0008) [2023-12-28 03:37:44,835][106226] Updated weights for policy 0, policy_version 1164627 (0.0007) [2023-12-28 03:37:45,271][106225] Updated weights for policy 1, policy_version 1167666 (0.0006) [2023-12-28 03:37:45,326][106225] Updated weights for policy 1, policy_version 1167676 (0.0007) [2023-12-28 03:37:45,382][106225] Updated weights for policy 1, policy_version 1167686 (0.0008) [2023-12-28 03:37:45,574][106226] Updated weights for policy 0, policy_version 1164637 (0.0007) [2023-12-28 03:37:45,636][106226] Updated weights for policy 0, policy_version 1164647 (0.0006) [2023-12-28 03:37:45,693][106226] Updated weights for policy 0, policy_version 1164657 (0.0005) [2023-12-28 03:37:46,127][106225] Updated weights for policy 1, policy_version 1167696 (0.0008) [2023-12-28 03:37:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 597188608. Throughput: 0: 10056.7, 1: 9598.3. Samples: 597182312. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:46,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.970')] [2023-12-28 03:37:46,189][106225] Updated weights for policy 1, policy_version 1167706 (0.0008) [2023-12-28 03:37:46,243][106225] Updated weights for policy 1, policy_version 1167716 (0.0008) [2023-12-28 03:37:46,265][106226] Updated weights for policy 0, policy_version 1164667 (0.0006) [2023-12-28 03:37:46,328][106226] Updated weights for policy 0, policy_version 1164677 (0.0008) [2023-12-28 03:37:46,389][106226] Updated weights for policy 0, policy_version 1164687 (0.0010) [2023-12-28 03:37:46,951][106226] Updated weights for policy 0, policy_version 1164697 (0.0010) [2023-12-28 03:37:47,015][106226] Updated weights for policy 0, policy_version 1164707 (0.0006) [2023-12-28 03:37:47,028][106225] Updated weights for policy 1, policy_version 1167726 (0.0007) [2023-12-28 03:37:47,075][106226] Updated weights for policy 0, policy_version 1164717 (0.0011) [2023-12-28 03:37:47,076][106225] Updated weights for policy 1, policy_version 1167736 (0.0008) [2023-12-28 03:37:47,123][106225] Updated weights for policy 1, policy_version 1167746 (0.0006) [2023-12-28 03:37:47,132][106226] Updated weights for policy 0, policy_version 1164727 (0.0010) [2023-12-28 03:37:47,842][106226] Updated weights for policy 0, policy_version 1164737 (0.0011) [2023-12-28 03:37:47,885][106225] Updated weights for policy 1, policy_version 1167756 (0.0007) [2023-12-28 03:37:47,907][106226] Updated weights for policy 0, policy_version 1164747 (0.0011) [2023-12-28 03:37:47,943][106225] Updated weights for policy 1, policy_version 1167766 (0.0005) [2023-12-28 03:37:47,963][106226] Updated weights for policy 0, policy_version 1164757 (0.0010) [2023-12-28 03:37:47,997][106225] Updated weights for policy 1, policy_version 1167776 (0.0006) [2023-12-28 03:37:48,631][106226] Updated weights for policy 0, policy_version 1164767 (0.0009) [2023-12-28 03:37:48,697][106226] Updated weights for policy 0, policy_version 1164777 (0.0008) [2023-12-28 03:37:48,761][106226] Updated weights for policy 0, policy_version 1164787 (0.0008) [2023-12-28 03:37:48,785][106225] Updated weights for policy 1, policy_version 1167786 (0.0007) [2023-12-28 03:37:48,853][106225] Updated weights for policy 1, policy_version 1167796 (0.0008) [2023-12-28 03:37:48,919][106225] Updated weights for policy 1, policy_version 1167806 (0.0009) [2023-12-28 03:37:48,984][106225] Updated weights for policy 1, policy_version 1167816 (0.0008) [2023-12-28 03:37:49,491][106226] Updated weights for policy 0, policy_version 1164797 (0.0008) [2023-12-28 03:37:49,552][106226] Updated weights for policy 0, policy_version 1164807 (0.0006) [2023-12-28 03:37:49,611][106226] Updated weights for policy 0, policy_version 1164817 (0.0006) [2023-12-28 03:37:49,700][106225] Updated weights for policy 1, policy_version 1167826 (0.0008) [2023-12-28 03:37:49,754][106225] Updated weights for policy 1, policy_version 1167836 (0.0007) [2023-12-28 03:37:49,810][106225] Updated weights for policy 1, policy_version 1167846 (0.0006) [2023-12-28 03:37:50,291][106226] Updated weights for policy 0, policy_version 1164827 (0.0007) [2023-12-28 03:37:50,348][106226] Updated weights for policy 0, policy_version 1164837 (0.0006) [2023-12-28 03:37:50,401][106226] Updated weights for policy 0, policy_version 1164847 (0.0006) [2023-12-28 03:37:50,519][106225] Updated weights for policy 1, policy_version 1167856 (0.0009) [2023-12-28 03:37:50,592][106225] Updated weights for policy 1, policy_version 1167866 (0.0009) [2023-12-28 03:37:50,655][106225] Updated weights for policy 1, policy_version 1167876 (0.0009) [2023-12-28 03:37:51,118][106226] Updated weights for policy 0, policy_version 1164857 (0.0008) [2023-12-28 03:37:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 597286912. Throughput: 0: 10107.7, 1: 9551.8. Samples: 597300360. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:51,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.933')] [2023-12-28 03:37:51,183][106226] Updated weights for policy 0, policy_version 1164867 (0.0007) [2023-12-28 03:37:51,243][106226] Updated weights for policy 0, policy_version 1164877 (0.0006) [2023-12-28 03:37:51,312][106226] Updated weights for policy 0, policy_version 1164887 (0.0009) [2023-12-28 03:37:51,318][106225] Updated weights for policy 1, policy_version 1167886 (0.0009) [2023-12-28 03:37:51,386][106225] Updated weights for policy 1, policy_version 1167896 (0.0013) [2023-12-28 03:37:51,441][106225] Updated weights for policy 1, policy_version 1167906 (0.0010) [2023-12-28 03:37:52,004][106226] Updated weights for policy 0, policy_version 1164897 (0.0008) [2023-12-28 03:37:52,069][106226] Updated weights for policy 0, policy_version 1164907 (0.0006) [2023-12-28 03:37:52,137][106226] Updated weights for policy 0, policy_version 1164917 (0.0006) [2023-12-28 03:37:52,221][106225] Updated weights for policy 1, policy_version 1167916 (0.0009) [2023-12-28 03:37:52,290][106225] Updated weights for policy 1, policy_version 1167926 (0.0008) [2023-12-28 03:37:52,362][106225] Updated weights for policy 1, policy_version 1167936 (0.0009) [2023-12-28 03:37:52,793][106226] Updated weights for policy 0, policy_version 1164927 (0.0006) [2023-12-28 03:37:52,857][106226] Updated weights for policy 0, policy_version 1164937 (0.0008) [2023-12-28 03:37:52,907][106226] Updated weights for policy 0, policy_version 1164947 (0.0007) [2023-12-28 03:37:53,079][106225] Updated weights for policy 1, policy_version 1167946 (0.0010) [2023-12-28 03:37:53,140][106225] Updated weights for policy 1, policy_version 1167956 (0.0008) [2023-12-28 03:37:53,209][106225] Updated weights for policy 1, policy_version 1167966 (0.0008) [2023-12-28 03:37:53,273][106225] Updated weights for policy 1, policy_version 1167976 (0.0009) [2023-12-28 03:37:53,455][106226] Updated weights for policy 0, policy_version 1164957 (0.0006) [2023-12-28 03:37:53,511][106226] Updated weights for policy 0, policy_version 1164967 (0.0008) [2023-12-28 03:37:53,565][106226] Updated weights for policy 0, policy_version 1164977 (0.0008) [2023-12-28 03:37:53,980][106225] Updated weights for policy 1, policy_version 1167986 (0.0011) [2023-12-28 03:37:54,034][106225] Updated weights for policy 1, policy_version 1167996 (0.0010) [2023-12-28 03:37:54,084][106225] Updated weights for policy 1, policy_version 1168006 (0.0010) [2023-12-28 03:37:54,225][106226] Updated weights for policy 0, policy_version 1164987 (0.0007) [2023-12-28 03:37:54,275][106226] Updated weights for policy 0, policy_version 1164997 (0.0008) [2023-12-28 03:37:54,326][106226] Updated weights for policy 0, policy_version 1165007 (0.0008) [2023-12-28 03:37:54,770][106225] Updated weights for policy 1, policy_version 1168016 (0.0010) [2023-12-28 03:37:54,820][106225] Updated weights for policy 1, policy_version 1168026 (0.0010) [2023-12-28 03:37:54,873][106225] Updated weights for policy 1, policy_version 1168036 (0.0010) [2023-12-28 03:37:55,029][106226] Updated weights for policy 0, policy_version 1165017 (0.0008) [2023-12-28 03:37:55,087][106226] Updated weights for policy 0, policy_version 1165027 (0.0008) [2023-12-28 03:37:55,137][106226] Updated weights for policy 0, policy_version 1165037 (0.0007) [2023-12-28 03:37:55,194][106226] Updated weights for policy 0, policy_version 1165047 (0.0006) [2023-12-28 03:37:55,545][106225] Updated weights for policy 1, policy_version 1168046 (0.0010) [2023-12-28 03:37:55,611][106225] Updated weights for policy 1, policy_version 1168056 (0.0010) [2023-12-28 03:37:55,666][106225] Updated weights for policy 1, policy_version 1168066 (0.0010) [2023-12-28 03:37:55,925][106226] Updated weights for policy 0, policy_version 1165057 (0.0010) [2023-12-28 03:37:55,987][106226] Updated weights for policy 0, policy_version 1165067 (0.0010) [2023-12-28 03:37:56,050][106226] Updated weights for policy 0, policy_version 1165077 (0.0011) [2023-12-28 03:37:56,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 597393408. Throughput: 0: 10119.9, 1: 9519.3. Samples: 597360432. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:37:56,176][105115] Avg episode reward: [(0, '-4.760'), (1, '-4.936')] [2023-12-28 03:37:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001165080_298319872.pth... [2023-12-28 03:37:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001168072_299073536.pth... [2023-12-28 03:37:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001163896_298016768.pth [2023-12-28 03:37:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001166984_298795008.pth [2023-12-28 03:37:56,370][106225] Updated weights for policy 1, policy_version 1168076 (0.0010) [2023-12-28 03:37:56,430][106225] Updated weights for policy 1, policy_version 1168086 (0.0010) [2023-12-28 03:37:56,498][106225] Updated weights for policy 1, policy_version 1168096 (0.0010) [2023-12-28 03:37:56,690][106226] Updated weights for policy 0, policy_version 1165087 (0.0007) [2023-12-28 03:37:56,740][106226] Updated weights for policy 0, policy_version 1165097 (0.0007) [2023-12-28 03:37:56,790][106226] Updated weights for policy 0, policy_version 1165107 (0.0008) [2023-12-28 03:37:57,186][106225] Updated weights for policy 1, policy_version 1168106 (0.0008) [2023-12-28 03:37:57,232][106225] Updated weights for policy 1, policy_version 1168116 (0.0010) [2023-12-28 03:37:57,278][106225] Updated weights for policy 1, policy_version 1168126 (0.0010) [2023-12-28 03:37:57,338][106225] Updated weights for policy 1, policy_version 1168136 (0.0010) [2023-12-28 03:37:57,404][106226] Updated weights for policy 0, policy_version 1165117 (0.0007) [2023-12-28 03:37:57,467][106226] Updated weights for policy 0, policy_version 1165127 (0.0008) [2023-12-28 03:37:57,528][106226] Updated weights for policy 0, policy_version 1165137 (0.0008) [2023-12-28 03:37:57,977][106225] Updated weights for policy 1, policy_version 1168146 (0.0005) [2023-12-28 03:37:58,035][106225] Updated weights for policy 1, policy_version 1168156 (0.0009) [2023-12-28 03:37:58,084][106225] Updated weights for policy 1, policy_version 1168166 (0.0010) [2023-12-28 03:37:58,275][106226] Updated weights for policy 0, policy_version 1165147 (0.0008) [2023-12-28 03:37:58,342][106226] Updated weights for policy 0, policy_version 1165157 (0.0008) [2023-12-28 03:37:58,411][106226] Updated weights for policy 0, policy_version 1165167 (0.0008) [2023-12-28 03:37:58,903][106225] Updated weights for policy 1, policy_version 1168176 (0.0009) [2023-12-28 03:37:58,972][106225] Updated weights for policy 1, policy_version 1168186 (0.0008) [2023-12-28 03:37:59,034][106225] Updated weights for policy 1, policy_version 1168196 (0.0008) [2023-12-28 03:37:59,206][106226] Updated weights for policy 0, policy_version 1165177 (0.0008) [2023-12-28 03:37:59,287][106226] Updated weights for policy 0, policy_version 1165187 (0.0009) [2023-12-28 03:37:59,358][106226] Updated weights for policy 0, policy_version 1165197 (0.0009) [2023-12-28 03:37:59,427][106226] Updated weights for policy 0, policy_version 1165207 (0.0007) [2023-12-28 03:37:59,745][106225] Updated weights for policy 1, policy_version 1168206 (0.0008) [2023-12-28 03:37:59,796][106225] Updated weights for policy 1, policy_version 1168216 (0.0008) [2023-12-28 03:37:59,862][106225] Updated weights for policy 1, policy_version 1168226 (0.0008) [2023-12-28 03:38:00,146][106226] Updated weights for policy 0, policy_version 1165217 (0.0008) [2023-12-28 03:38:00,207][106226] Updated weights for policy 0, policy_version 1165227 (0.0009) [2023-12-28 03:38:00,266][106226] Updated weights for policy 0, policy_version 1165237 (0.0008) [2023-12-28 03:38:00,578][106225] Updated weights for policy 1, policy_version 1168236 (0.0007) [2023-12-28 03:38:00,630][106225] Updated weights for policy 1, policy_version 1168246 (0.0009) [2023-12-28 03:38:00,674][106225] Updated weights for policy 1, policy_version 1168256 (0.0006) [2023-12-28 03:38:00,929][106226] Updated weights for policy 0, policy_version 1165247 (0.0008) [2023-12-28 03:38:00,996][106226] Updated weights for policy 0, policy_version 1165257 (0.0007) [2023-12-28 03:38:01,057][106226] Updated weights for policy 0, policy_version 1165267 (0.0009) [2023-12-28 03:38:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 597491712. Throughput: 0: 10093.1, 1: 9551.5. Samples: 597478232. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:01,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-5.030')] [2023-12-28 03:38:01,278][106225] Updated weights for policy 1, policy_version 1168266 (0.0006) [2023-12-28 03:38:01,336][106225] Updated weights for policy 1, policy_version 1168276 (0.0008) [2023-12-28 03:38:01,405][106225] Updated weights for policy 1, policy_version 1168286 (0.0007) [2023-12-28 03:38:01,466][106225] Updated weights for policy 1, policy_version 1168296 (0.0007) [2023-12-28 03:38:01,793][106226] Updated weights for policy 0, policy_version 1165277 (0.0007) [2023-12-28 03:38:01,864][106226] Updated weights for policy 0, policy_version 1165287 (0.0005) [2023-12-28 03:38:01,935][106226] Updated weights for policy 0, policy_version 1165297 (0.0006) [2023-12-28 03:38:02,194][106225] Updated weights for policy 1, policy_version 1168306 (0.0009) [2023-12-28 03:38:02,246][106225] Updated weights for policy 1, policy_version 1168316 (0.0008) [2023-12-28 03:38:02,310][106225] Updated weights for policy 1, policy_version 1168326 (0.0009) [2023-12-28 03:38:02,590][106226] Updated weights for policy 0, policy_version 1165307 (0.0008) [2023-12-28 03:38:02,645][106226] Updated weights for policy 0, policy_version 1165317 (0.0009) [2023-12-28 03:38:02,707][106226] Updated weights for policy 0, policy_version 1165327 (0.0010) [2023-12-28 03:38:02,972][106225] Updated weights for policy 1, policy_version 1168336 (0.0006) [2023-12-28 03:38:03,033][106225] Updated weights for policy 1, policy_version 1168346 (0.0005) [2023-12-28 03:38:03,095][106225] Updated weights for policy 1, policy_version 1168356 (0.0007) [2023-12-28 03:38:03,512][106226] Updated weights for policy 0, policy_version 1165337 (0.0009) [2023-12-28 03:38:03,566][106226] Updated weights for policy 0, policy_version 1165347 (0.0009) [2023-12-28 03:38:03,616][106226] Updated weights for policy 0, policy_version 1165357 (0.0008) [2023-12-28 03:38:03,665][106225] Updated weights for policy 1, policy_version 1168366 (0.0009) [2023-12-28 03:38:03,667][106226] Updated weights for policy 0, policy_version 1165367 (0.0006) [2023-12-28 03:38:03,710][106225] Updated weights for policy 1, policy_version 1168376 (0.0010) [2023-12-28 03:38:03,772][106225] Updated weights for policy 1, policy_version 1168386 (0.0009) [2023-12-28 03:38:04,402][106226] Updated weights for policy 0, policy_version 1165377 (0.0006) [2023-12-28 03:38:04,466][106225] Updated weights for policy 1, policy_version 1168396 (0.0010) [2023-12-28 03:38:04,468][106226] Updated weights for policy 0, policy_version 1165387 (0.0010) [2023-12-28 03:38:04,526][106226] Updated weights for policy 0, policy_version 1165397 (0.0006) [2023-12-28 03:38:04,527][106225] Updated weights for policy 1, policy_version 1168406 (0.0007) [2023-12-28 03:38:04,581][106225] Updated weights for policy 1, policy_version 1168416 (0.0007) [2023-12-28 03:38:05,171][106225] Updated weights for policy 1, policy_version 1168426 (0.0008) [2023-12-28 03:38:05,217][106225] Updated weights for policy 1, policy_version 1168436 (0.0010) [2023-12-28 03:38:05,249][106226] Updated weights for policy 0, policy_version 1165407 (0.0009) [2023-12-28 03:38:05,264][106225] Updated weights for policy 1, policy_version 1168446 (0.0010) [2023-12-28 03:38:05,309][106226] Updated weights for policy 0, policy_version 1165417 (0.0007) [2023-12-28 03:38:05,310][106225] Updated weights for policy 1, policy_version 1168456 (0.0009) [2023-12-28 03:38:05,372][106226] Updated weights for policy 0, policy_version 1165427 (0.0007) [2023-12-28 03:38:06,056][106225] Updated weights for policy 1, policy_version 1168466 (0.0008) [2023-12-28 03:38:06,102][106226] Updated weights for policy 0, policy_version 1165437 (0.0009) [2023-12-28 03:38:06,119][106225] Updated weights for policy 1, policy_version 1168476 (0.0007) [2023-12-28 03:38:06,170][106226] Updated weights for policy 0, policy_version 1165447 (0.0007) [2023-12-28 03:38:06,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 597581824. Throughput: 0: 10044.7, 1: 9614.6. Samples: 597598156. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:06,175][105115] Avg episode reward: [(0, '-4.583'), (1, '-5.023')] [2023-12-28 03:38:06,183][106225] Updated weights for policy 1, policy_version 1168486 (0.0008) [2023-12-28 03:38:06,233][106226] Updated weights for policy 0, policy_version 1165457 (0.0008) [2023-12-28 03:38:06,910][106225] Updated weights for policy 1, policy_version 1168496 (0.0010) [2023-12-28 03:38:06,964][106225] Updated weights for policy 1, policy_version 1168506 (0.0009) [2023-12-28 03:38:06,996][106226] Updated weights for policy 0, policy_version 1165467 (0.0008) [2023-12-28 03:38:07,014][106225] Updated weights for policy 1, policy_version 1168516 (0.0007) [2023-12-28 03:38:07,060][106226] Updated weights for policy 0, policy_version 1165477 (0.0008) [2023-12-28 03:38:07,129][106226] Updated weights for policy 0, policy_version 1165487 (0.0009) [2023-12-28 03:38:07,649][106225] Updated weights for policy 1, policy_version 1168526 (0.0006) [2023-12-28 03:38:07,700][106225] Updated weights for policy 1, policy_version 1168536 (0.0005) [2023-12-28 03:38:07,763][106225] Updated weights for policy 1, policy_version 1168546 (0.0006) [2023-12-28 03:38:07,923][106226] Updated weights for policy 0, policy_version 1165497 (0.0010) [2023-12-28 03:38:07,997][106226] Updated weights for policy 0, policy_version 1165507 (0.0010) [2023-12-28 03:38:08,060][106226] Updated weights for policy 0, policy_version 1165517 (0.0010) [2023-12-28 03:38:08,116][106226] Updated weights for policy 0, policy_version 1165527 (0.0008) [2023-12-28 03:38:08,345][106225] Updated weights for policy 1, policy_version 1168558 (0.0006) [2023-12-28 03:38:08,402][106225] Updated weights for policy 1, policy_version 1168568 (0.0008) [2023-12-28 03:38:08,462][106225] Updated weights for policy 1, policy_version 1168578 (0.0008) [2023-12-28 03:38:08,868][106226] Updated weights for policy 0, policy_version 1165537 (0.0009) [2023-12-28 03:38:08,928][106226] Updated weights for policy 0, policy_version 1165547 (0.0008) [2023-12-28 03:38:08,988][106226] Updated weights for policy 0, policy_version 1165557 (0.0008) [2023-12-28 03:38:09,173][106225] Updated weights for policy 1, policy_version 1168588 (0.0007) [2023-12-28 03:38:09,234][106225] Updated weights for policy 1, policy_version 1168598 (0.0007) [2023-12-28 03:38:09,300][106225] Updated weights for policy 1, policy_version 1168608 (0.0007) [2023-12-28 03:38:09,733][106226] Updated weights for policy 0, policy_version 1165567 (0.0010) [2023-12-28 03:38:09,783][106226] Updated weights for policy 0, policy_version 1165577 (0.0008) [2023-12-28 03:38:09,845][106226] Updated weights for policy 0, policy_version 1165587 (0.0008) [2023-12-28 03:38:10,005][106225] Updated weights for policy 1, policy_version 1168618 (0.0008) [2023-12-28 03:38:10,073][106225] Updated weights for policy 1, policy_version 1168628 (0.0008) [2023-12-28 03:38:10,135][106225] Updated weights for policy 1, policy_version 1168638 (0.0009) [2023-12-28 03:38:10,197][106225] Updated weights for policy 1, policy_version 1168648 (0.0008) [2023-12-28 03:38:10,606][106226] Updated weights for policy 0, policy_version 1165597 (0.0009) [2023-12-28 03:38:10,667][106226] Updated weights for policy 0, policy_version 1165607 (0.0009) [2023-12-28 03:38:10,740][106226] Updated weights for policy 0, policy_version 1165617 (0.0009) [2023-12-28 03:38:10,911][106225] Updated weights for policy 1, policy_version 1168658 (0.0008) [2023-12-28 03:38:10,971][106225] Updated weights for policy 1, policy_version 1168668 (0.0005) [2023-12-28 03:38:11,044][106225] Updated weights for policy 1, policy_version 1168678 (0.0006) [2023-12-28 03:38:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 597688320. Throughput: 0: 9976.1, 1: 9685.0. Samples: 597656124. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:11,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.916')] [2023-12-28 03:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001168680_299229184.pth... [2023-12-28 03:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001165624_298459136.pth... [2023-12-28 03:38:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001164472_298164224.pth [2023-12-28 03:38:11,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001167528_298934272.pth [2023-12-28 03:38:11,521][106226] Updated weights for policy 0, policy_version 1165627 (0.0008) [2023-12-28 03:38:11,584][106226] Updated weights for policy 0, policy_version 1165637 (0.0008) [2023-12-28 03:38:11,655][106226] Updated weights for policy 0, policy_version 1165647 (0.0009) [2023-12-28 03:38:11,868][106225] Updated weights for policy 1, policy_version 1168688 (0.0006) [2023-12-28 03:38:11,928][106225] Updated weights for policy 1, policy_version 1168698 (0.0008) [2023-12-28 03:38:11,996][106225] Updated weights for policy 1, policy_version 1168708 (0.0008) [2023-12-28 03:38:12,378][106226] Updated weights for policy 0, policy_version 1165657 (0.0012) [2023-12-28 03:38:12,443][106226] Updated weights for policy 0, policy_version 1165667 (0.0007) [2023-12-28 03:38:12,510][106226] Updated weights for policy 0, policy_version 1165677 (0.0008) [2023-12-28 03:38:12,568][106226] Updated weights for policy 0, policy_version 1165687 (0.0008) [2023-12-28 03:38:12,705][106225] Updated weights for policy 1, policy_version 1168718 (0.0008) [2023-12-28 03:38:12,774][106225] Updated weights for policy 1, policy_version 1168728 (0.0007) [2023-12-28 03:38:12,836][106225] Updated weights for policy 1, policy_version 1168738 (0.0008) [2023-12-28 03:38:13,237][106226] Updated weights for policy 0, policy_version 1165697 (0.0008) [2023-12-28 03:38:13,295][106226] Updated weights for policy 0, policy_version 1165707 (0.0006) [2023-12-28 03:38:13,352][106226] Updated weights for policy 0, policy_version 1165717 (0.0005) [2023-12-28 03:38:13,540][106225] Updated weights for policy 1, policy_version 1168748 (0.0009) [2023-12-28 03:38:13,587][106225] Updated weights for policy 1, policy_version 1168758 (0.0010) [2023-12-28 03:38:13,637][106225] Updated weights for policy 1, policy_version 1168768 (0.0010) [2023-12-28 03:38:13,960][106226] Updated weights for policy 0, policy_version 1165727 (0.0008) [2023-12-28 03:38:14,015][106226] Updated weights for policy 0, policy_version 1165737 (0.0008) [2023-12-28 03:38:14,069][106226] Updated weights for policy 0, policy_version 1165747 (0.0008) [2023-12-28 03:38:14,358][106225] Updated weights for policy 1, policy_version 1168778 (0.0010) [2023-12-28 03:38:14,408][106225] Updated weights for policy 1, policy_version 1168788 (0.0010) [2023-12-28 03:38:14,454][106225] Updated weights for policy 1, policy_version 1168798 (0.0007) [2023-12-28 03:38:14,501][106225] Updated weights for policy 1, policy_version 1168808 (0.0005) [2023-12-28 03:38:14,724][106226] Updated weights for policy 0, policy_version 1165757 (0.0007) [2023-12-28 03:38:14,784][106226] Updated weights for policy 0, policy_version 1165767 (0.0007) [2023-12-28 03:38:14,847][106226] Updated weights for policy 0, policy_version 1165777 (0.0009) [2023-12-28 03:38:15,124][106225] Updated weights for policy 1, policy_version 1168818 (0.0010) [2023-12-28 03:38:15,186][106225] Updated weights for policy 1, policy_version 1168828 (0.0010) [2023-12-28 03:38:15,250][106225] Updated weights for policy 1, policy_version 1168838 (0.0010) [2023-12-28 03:38:15,515][106226] Updated weights for policy 0, policy_version 1165787 (0.0010) [2023-12-28 03:38:15,572][106226] Updated weights for policy 0, policy_version 1165797 (0.0008) [2023-12-28 03:38:15,630][106226] Updated weights for policy 0, policy_version 1165807 (0.0005) [2023-12-28 03:38:15,921][106225] Updated weights for policy 1, policy_version 1168848 (0.0009) [2023-12-28 03:38:15,969][106225] Updated weights for policy 1, policy_version 1168858 (0.0007) [2023-12-28 03:38:16,026][106225] Updated weights for policy 1, policy_version 1168868 (0.0009) [2023-12-28 03:38:16,170][106226] Updated weights for policy 0, policy_version 1165817 (0.0006) [2023-12-28 03:38:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 597786624. Throughput: 0: 9824.5, 1: 9690.2. Samples: 597773868. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:16,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.891')] [2023-12-28 03:38:16,224][106226] Updated weights for policy 0, policy_version 1165827 (0.0006) [2023-12-28 03:38:16,283][106226] Updated weights for policy 0, policy_version 1165837 (0.0008) [2023-12-28 03:38:16,335][106226] Updated weights for policy 0, policy_version 1165847 (0.0009) [2023-12-28 03:38:16,724][106225] Updated weights for policy 1, policy_version 1168878 (0.0009) [2023-12-28 03:38:16,778][106225] Updated weights for policy 1, policy_version 1168888 (0.0009) [2023-12-28 03:38:16,829][106225] Updated weights for policy 1, policy_version 1168898 (0.0007) [2023-12-28 03:38:17,005][106226] Updated weights for policy 0, policy_version 1165857 (0.0008) [2023-12-28 03:38:17,059][106226] Updated weights for policy 0, policy_version 1165867 (0.0009) [2023-12-28 03:38:17,114][106226] Updated weights for policy 0, policy_version 1165877 (0.0008) [2023-12-28 03:38:17,484][106225] Updated weights for policy 1, policy_version 1168908 (0.0007) [2023-12-28 03:38:17,534][106225] Updated weights for policy 1, policy_version 1168918 (0.0008) [2023-12-28 03:38:17,597][106225] Updated weights for policy 1, policy_version 1168928 (0.0009) [2023-12-28 03:38:17,794][106226] Updated weights for policy 0, policy_version 1165888 (0.0008) [2023-12-28 03:38:17,863][106226] Updated weights for policy 0, policy_version 1165898 (0.0005) [2023-12-28 03:38:17,926][106226] Updated weights for policy 0, policy_version 1165908 (0.0010) [2023-12-28 03:38:18,273][106225] Updated weights for policy 1, policy_version 1168938 (0.0009) [2023-12-28 03:38:18,327][106225] Updated weights for policy 1, policy_version 1168948 (0.0006) [2023-12-28 03:38:18,392][106225] Updated weights for policy 1, policy_version 1168958 (0.0010) [2023-12-28 03:38:18,447][106225] Updated weights for policy 1, policy_version 1168968 (0.0010) [2023-12-28 03:38:18,592][106226] Updated weights for policy 0, policy_version 1165918 (0.0011) [2023-12-28 03:38:18,653][106226] Updated weights for policy 0, policy_version 1165928 (0.0011) [2023-12-28 03:38:18,716][106226] Updated weights for policy 0, policy_version 1165938 (0.0010) [2023-12-28 03:38:19,149][106225] Updated weights for policy 1, policy_version 1168978 (0.0007) [2023-12-28 03:38:19,208][106225] Updated weights for policy 1, policy_version 1168988 (0.0006) [2023-12-28 03:38:19,284][106225] Updated weights for policy 1, policy_version 1168998 (0.0010) [2023-12-28 03:38:19,482][106226] Updated weights for policy 0, policy_version 1165948 (0.0010) [2023-12-28 03:38:19,551][106226] Updated weights for policy 0, policy_version 1165958 (0.0007) [2023-12-28 03:38:19,616][106226] Updated weights for policy 0, policy_version 1165968 (0.0006) [2023-12-28 03:38:20,101][106225] Updated weights for policy 1, policy_version 1169008 (0.0008) [2023-12-28 03:38:20,155][106225] Updated weights for policy 1, policy_version 1169018 (0.0008) [2023-12-28 03:38:20,215][106225] Updated weights for policy 1, policy_version 1169028 (0.0008) [2023-12-28 03:38:20,308][106226] Updated weights for policy 0, policy_version 1165978 (0.0007) [2023-12-28 03:38:20,362][106226] Updated weights for policy 0, policy_version 1165988 (0.0009) [2023-12-28 03:38:20,417][106226] Updated weights for policy 0, policy_version 1165998 (0.0011) [2023-12-28 03:38:20,468][106226] Updated weights for policy 0, policy_version 1166008 (0.0011) [2023-12-28 03:38:20,951][106225] Updated weights for policy 1, policy_version 1169038 (0.0006) [2023-12-28 03:38:21,017][106225] Updated weights for policy 1, policy_version 1169048 (0.0006) [2023-12-28 03:38:21,085][106225] Updated weights for policy 1, policy_version 1169058 (0.0008) [2023-12-28 03:38:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 597884928. Throughput: 0: 9840.5, 1: 9756.8. Samples: 597893108. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:21,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-4.519')] [2023-12-28 03:38:21,212][106226] Updated weights for policy 0, policy_version 1166018 (0.0011) [2023-12-28 03:38:21,274][106226] Updated weights for policy 0, policy_version 1166028 (0.0011) [2023-12-28 03:38:21,323][106226] Updated weights for policy 0, policy_version 1166038 (0.0010) [2023-12-28 03:38:21,840][106225] Updated weights for policy 1, policy_version 1169068 (0.0007) [2023-12-28 03:38:21,897][106225] Updated weights for policy 1, policy_version 1169078 (0.0007) [2023-12-28 03:38:21,956][106225] Updated weights for policy 1, policy_version 1169088 (0.0007) [2023-12-28 03:38:22,149][106226] Updated weights for policy 0, policy_version 1166048 (0.0009) [2023-12-28 03:38:22,200][106226] Updated weights for policy 0, policy_version 1166058 (0.0009) [2023-12-28 03:38:22,258][106226] Updated weights for policy 0, policy_version 1166068 (0.0007) [2023-12-28 03:38:22,671][106225] Updated weights for policy 1, policy_version 1169098 (0.0007) [2023-12-28 03:38:22,735][106225] Updated weights for policy 1, policy_version 1169108 (0.0008) [2023-12-28 03:38:22,803][106225] Updated weights for policy 1, policy_version 1169118 (0.0008) [2023-12-28 03:38:22,871][106225] Updated weights for policy 1, policy_version 1169128 (0.0008) [2023-12-28 03:38:22,991][106226] Updated weights for policy 0, policy_version 1166078 (0.0007) [2023-12-28 03:38:23,047][106226] Updated weights for policy 0, policy_version 1166088 (0.0009) [2023-12-28 03:38:23,111][106226] Updated weights for policy 0, policy_version 1166098 (0.0007) [2023-12-28 03:38:23,654][106225] Updated weights for policy 1, policy_version 1169138 (0.0009) [2023-12-28 03:38:23,676][106226] Updated weights for policy 0, policy_version 1166108 (0.0009) [2023-12-28 03:38:23,704][106225] Updated weights for policy 1, policy_version 1169148 (0.0008) [2023-12-28 03:38:23,729][106226] Updated weights for policy 0, policy_version 1166118 (0.0005) [2023-12-28 03:38:23,763][106225] Updated weights for policy 1, policy_version 1169158 (0.0008) [2023-12-28 03:38:23,790][106226] Updated weights for policy 0, policy_version 1166128 (0.0006) [2023-12-28 03:38:24,424][106226] Updated weights for policy 0, policy_version 1166138 (0.0009) [2023-12-28 03:38:24,482][106226] Updated weights for policy 0, policy_version 1166148 (0.0008) [2023-12-28 03:38:24,538][106226] Updated weights for policy 0, policy_version 1166158 (0.0007) [2023-12-28 03:38:24,549][106225] Updated weights for policy 1, policy_version 1169168 (0.0007) [2023-12-28 03:38:24,595][106226] Updated weights for policy 0, policy_version 1166168 (0.0008) [2023-12-28 03:38:24,613][106225] Updated weights for policy 1, policy_version 1169178 (0.0007) [2023-12-28 03:38:24,666][106225] Updated weights for policy 1, policy_version 1169188 (0.0008) [2023-12-28 03:38:25,202][106226] Updated weights for policy 0, policy_version 1166178 (0.0010) [2023-12-28 03:38:25,251][106226] Updated weights for policy 0, policy_version 1166188 (0.0010) [2023-12-28 03:38:25,297][106226] Updated weights for policy 0, policy_version 1166198 (0.0010) [2023-12-28 03:38:25,364][106225] Updated weights for policy 1, policy_version 1169198 (0.0008) [2023-12-28 03:38:25,417][106225] Updated weights for policy 1, policy_version 1169208 (0.0008) [2023-12-28 03:38:25,473][106225] Updated weights for policy 1, policy_version 1169218 (0.0008) [2023-12-28 03:38:25,984][106226] Updated weights for policy 0, policy_version 1166208 (0.0006) [2023-12-28 03:38:26,047][106226] Updated weights for policy 0, policy_version 1166218 (0.0005) [2023-12-28 03:38:26,057][106225] Updated weights for policy 1, policy_version 1169228 (0.0006) [2023-12-28 03:38:26,110][106225] Updated weights for policy 1, policy_version 1169238 (0.0007) [2023-12-28 03:38:26,115][106226] Updated weights for policy 0, policy_version 1166228 (0.0007) [2023-12-28 03:38:26,167][106225] Updated weights for policy 1, policy_version 1169248 (0.0008) [2023-12-28 03:38:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 597983232. Throughput: 0: 9844.9, 1: 9756.2. Samples: 597950564. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:26,175][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.779')] [2023-12-28 03:38:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001166232_298614784.pth... [2023-12-28 03:38:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001165080_298319872.pth [2023-12-28 03:38:26,204][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001169256_299376640.pth... [2023-12-28 03:38:26,207][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001168072_299073536.pth [2023-12-28 03:38:26,645][106226] Updated weights for policy 0, policy_version 1166238 (0.0005) [2023-12-28 03:38:26,693][106226] Updated weights for policy 0, policy_version 1166248 (0.0010) [2023-12-28 03:38:26,739][106226] Updated weights for policy 0, policy_version 1166258 (0.0010) [2023-12-28 03:38:26,912][106225] Updated weights for policy 1, policy_version 1169258 (0.0009) [2023-12-28 03:38:26,961][106225] Updated weights for policy 1, policy_version 1169268 (0.0006) [2023-12-28 03:38:27,010][106225] Updated weights for policy 1, policy_version 1169278 (0.0008) [2023-12-28 03:38:27,059][106225] Updated weights for policy 1, policy_version 1169288 (0.0007) [2023-12-28 03:38:27,441][106226] Updated weights for policy 0, policy_version 1166268 (0.0008) [2023-12-28 03:38:27,506][106226] Updated weights for policy 0, policy_version 1166278 (0.0006) [2023-12-28 03:38:27,555][106226] Updated weights for policy 0, policy_version 1166288 (0.0010) [2023-12-28 03:38:27,734][106225] Updated weights for policy 1, policy_version 1169298 (0.0006) [2023-12-28 03:38:27,784][106225] Updated weights for policy 1, policy_version 1169308 (0.0005) [2023-12-28 03:38:27,836][106225] Updated weights for policy 1, policy_version 1169318 (0.0005) [2023-12-28 03:38:28,183][106226] Updated weights for policy 0, policy_version 1166298 (0.0010) [2023-12-28 03:38:28,249][106226] Updated weights for policy 0, policy_version 1166308 (0.0010) [2023-12-28 03:38:28,311][106226] Updated weights for policy 0, policy_version 1166318 (0.0010) [2023-12-28 03:38:28,376][106226] Updated weights for policy 0, policy_version 1166328 (0.0010) [2023-12-28 03:38:28,518][106225] Updated weights for policy 1, policy_version 1169328 (0.0008) [2023-12-28 03:38:28,581][106225] Updated weights for policy 1, policy_version 1169338 (0.0008) [2023-12-28 03:38:28,638][106225] Updated weights for policy 1, policy_version 1169348 (0.0008) [2023-12-28 03:38:29,052][106226] Updated weights for policy 0, policy_version 1166338 (0.0010) [2023-12-28 03:38:29,102][106226] Updated weights for policy 0, policy_version 1166348 (0.0010) [2023-12-28 03:38:29,160][106226] Updated weights for policy 0, policy_version 1166358 (0.0010) [2023-12-28 03:38:29,359][106225] Updated weights for policy 1, policy_version 1169358 (0.0007) [2023-12-28 03:38:29,423][106225] Updated weights for policy 1, policy_version 1169368 (0.0006) [2023-12-28 03:38:29,488][106225] Updated weights for policy 1, policy_version 1169378 (0.0007) [2023-12-28 03:38:29,838][106226] Updated weights for policy 0, policy_version 1166368 (0.0009) [2023-12-28 03:38:29,900][106226] Updated weights for policy 0, policy_version 1166378 (0.0008) [2023-12-28 03:38:29,962][106226] Updated weights for policy 0, policy_version 1166388 (0.0009) [2023-12-28 03:38:30,220][106225] Updated weights for policy 1, policy_version 1169388 (0.0008) [2023-12-28 03:38:30,286][106225] Updated weights for policy 1, policy_version 1169398 (0.0008) [2023-12-28 03:38:30,350][106225] Updated weights for policy 1, policy_version 1169408 (0.0009) [2023-12-28 03:38:30,610][106226] Updated weights for policy 0, policy_version 1166398 (0.0007) [2023-12-28 03:38:30,656][106226] Updated weights for policy 0, policy_version 1166408 (0.0005) [2023-12-28 03:38:30,712][106226] Updated weights for policy 0, policy_version 1166418 (0.0008) [2023-12-28 03:38:31,048][106225] Updated weights for policy 1, policy_version 1169418 (0.0008) [2023-12-28 03:38:31,113][106225] Updated weights for policy 1, policy_version 1169428 (0.0008) [2023-12-28 03:38:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 598081536. Throughput: 0: 9968.9, 1: 9843.4. Samples: 598073864. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:31,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.598')] [2023-12-28 03:38:31,179][106225] Updated weights for policy 1, policy_version 1169438 (0.0007) [2023-12-28 03:38:31,239][106225] Updated weights for policy 1, policy_version 1169448 (0.0006) [2023-12-28 03:38:31,432][106226] Updated weights for policy 0, policy_version 1166428 (0.0008) [2023-12-28 03:38:31,492][106226] Updated weights for policy 0, policy_version 1166438 (0.0009) [2023-12-28 03:38:31,552][106226] Updated weights for policy 0, policy_version 1166448 (0.0009) [2023-12-28 03:38:31,917][106225] Updated weights for policy 1, policy_version 1169458 (0.0008) [2023-12-28 03:38:31,973][106225] Updated weights for policy 1, policy_version 1169468 (0.0006) [2023-12-28 03:38:32,034][106225] Updated weights for policy 1, policy_version 1169478 (0.0006) [2023-12-28 03:38:32,322][106226] Updated weights for policy 0, policy_version 1166458 (0.0006) [2023-12-28 03:38:32,386][106226] Updated weights for policy 0, policy_version 1166468 (0.0007) [2023-12-28 03:38:32,453][106226] Updated weights for policy 0, policy_version 1166478 (0.0006) [2023-12-28 03:38:32,517][106226] Updated weights for policy 0, policy_version 1166488 (0.0008) [2023-12-28 03:38:32,707][106225] Updated weights for policy 1, policy_version 1169488 (0.0009) [2023-12-28 03:38:32,753][106225] Updated weights for policy 1, policy_version 1169498 (0.0007) [2023-12-28 03:38:32,801][106225] Updated weights for policy 1, policy_version 1169508 (0.0010) [2023-12-28 03:38:33,163][106226] Updated weights for policy 0, policy_version 1166498 (0.0008) [2023-12-28 03:38:33,212][106226] Updated weights for policy 0, policy_version 1166508 (0.0008) [2023-12-28 03:38:33,262][106226] Updated weights for policy 0, policy_version 1166519 (0.0009) [2023-12-28 03:38:33,415][106225] Updated weights for policy 1, policy_version 1169518 (0.0007) [2023-12-28 03:38:33,471][106225] Updated weights for policy 1, policy_version 1169528 (0.0008) [2023-12-28 03:38:33,526][106225] Updated weights for policy 1, policy_version 1169538 (0.0007) [2023-12-28 03:38:33,901][106226] Updated weights for policy 0, policy_version 1166529 (0.0007) [2023-12-28 03:38:33,951][106226] Updated weights for policy 0, policy_version 1166539 (0.0008) [2023-12-28 03:38:34,004][106226] Updated weights for policy 0, policy_version 1166549 (0.0007) [2023-12-28 03:38:34,134][106225] Updated weights for policy 1, policy_version 1169548 (0.0007) [2023-12-28 03:38:34,193][106225] Updated weights for policy 1, policy_version 1169558 (0.0009) [2023-12-28 03:38:34,250][106225] Updated weights for policy 1, policy_version 1169569 (0.0011) [2023-12-28 03:38:34,784][106226] Updated weights for policy 0, policy_version 1166559 (0.0008) [2023-12-28 03:38:34,830][106226] Updated weights for policy 0, policy_version 1166569 (0.0007) [2023-12-28 03:38:34,876][106226] Updated weights for policy 0, policy_version 1166579 (0.0006) [2023-12-28 03:38:35,007][106225] Updated weights for policy 1, policy_version 1169579 (0.0010) [2023-12-28 03:38:35,070][106225] Updated weights for policy 1, policy_version 1169589 (0.0007) [2023-12-28 03:38:35,139][106225] Updated weights for policy 1, policy_version 1169599 (0.0010) [2023-12-28 03:38:35,442][106226] Updated weights for policy 0, policy_version 1166589 (0.0006) [2023-12-28 03:38:35,506][106226] Updated weights for policy 0, policy_version 1166599 (0.0005) [2023-12-28 03:38:35,562][106226] Updated weights for policy 0, policy_version 1166609 (0.0005) [2023-12-28 03:38:35,775][106225] Updated weights for policy 1, policy_version 1169609 (0.0009) [2023-12-28 03:38:35,822][106225] Updated weights for policy 1, policy_version 1169619 (0.0005) [2023-12-28 03:38:35,870][106225] Updated weights for policy 1, policy_version 1169629 (0.0005) [2023-12-28 03:38:35,921][106225] Updated weights for policy 1, policy_version 1169639 (0.0005) [2023-12-28 03:38:36,110][106226] Updated weights for policy 0, policy_version 1166619 (0.0006) [2023-12-28 03:38:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 598188032. Throughput: 0: 9994.9, 1: 9959.9. Samples: 598198328. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:36,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.788')] [2023-12-28 03:38:36,181][106226] Updated weights for policy 0, policy_version 1166629 (0.0008) [2023-12-28 03:38:36,243][106226] Updated weights for policy 0, policy_version 1166639 (0.0008) [2023-12-28 03:38:36,627][106225] Updated weights for policy 1, policy_version 1169649 (0.0008) [2023-12-28 03:38:36,690][106225] Updated weights for policy 1, policy_version 1169659 (0.0008) [2023-12-28 03:38:36,753][106225] Updated weights for policy 1, policy_version 1169669 (0.0009) [2023-12-28 03:38:36,929][106226] Updated weights for policy 0, policy_version 1166649 (0.0007) [2023-12-28 03:38:36,985][106226] Updated weights for policy 0, policy_version 1166659 (0.0008) [2023-12-28 03:38:37,045][106226] Updated weights for policy 0, policy_version 1166669 (0.0010) [2023-12-28 03:38:37,101][106226] Updated weights for policy 0, policy_version 1166679 (0.0010) [2023-12-28 03:38:37,492][106225] Updated weights for policy 1, policy_version 1169679 (0.0007) [2023-12-28 03:38:37,558][106225] Updated weights for policy 1, policy_version 1169689 (0.0006) [2023-12-28 03:38:37,616][106225] Updated weights for policy 1, policy_version 1169699 (0.0005) [2023-12-28 03:38:37,816][106226] Updated weights for policy 0, policy_version 1166689 (0.0011) [2023-12-28 03:38:37,891][106226] Updated weights for policy 0, policy_version 1166699 (0.0010) [2023-12-28 03:38:37,959][106226] Updated weights for policy 0, policy_version 1166709 (0.0008) [2023-12-28 03:38:38,207][106225] Updated weights for policy 1, policy_version 1169709 (0.0006) [2023-12-28 03:38:38,267][106225] Updated weights for policy 1, policy_version 1169719 (0.0007) [2023-12-28 03:38:38,328][106225] Updated weights for policy 1, policy_version 1169729 (0.0007) [2023-12-28 03:38:38,589][106226] Updated weights for policy 0, policy_version 1166719 (0.0009) [2023-12-28 03:38:38,639][106226] Updated weights for policy 0, policy_version 1166729 (0.0010) [2023-12-28 03:38:38,698][106226] Updated weights for policy 0, policy_version 1166739 (0.0011) [2023-12-28 03:38:39,034][106225] Updated weights for policy 1, policy_version 1169739 (0.0009) [2023-12-28 03:38:39,084][106225] Updated weights for policy 1, policy_version 1169749 (0.0008) [2023-12-28 03:38:39,129][106225] Updated weights for policy 1, policy_version 1169759 (0.0007) [2023-12-28 03:38:39,463][106226] Updated weights for policy 0, policy_version 1166749 (0.0011) [2023-12-28 03:38:39,527][106226] Updated weights for policy 0, policy_version 1166759 (0.0011) [2023-12-28 03:38:39,592][106226] Updated weights for policy 0, policy_version 1166769 (0.0011) [2023-12-28 03:38:39,910][106225] Updated weights for policy 1, policy_version 1169769 (0.0007) [2023-12-28 03:38:39,979][106225] Updated weights for policy 1, policy_version 1169779 (0.0010) [2023-12-28 03:38:40,048][106225] Updated weights for policy 1, policy_version 1169789 (0.0010) [2023-12-28 03:38:40,116][106225] Updated weights for policy 1, policy_version 1169799 (0.0006) [2023-12-28 03:38:40,336][106226] Updated weights for policy 0, policy_version 1166779 (0.0010) [2023-12-28 03:38:40,402][106226] Updated weights for policy 0, policy_version 1166789 (0.0008) [2023-12-28 03:38:40,464][106226] Updated weights for policy 0, policy_version 1166799 (0.0008) [2023-12-28 03:38:40,797][106225] Updated weights for policy 1, policy_version 1169809 (0.0010) [2023-12-28 03:38:40,858][106225] Updated weights for policy 1, policy_version 1169819 (0.0011) [2023-12-28 03:38:40,920][106225] Updated weights for policy 1, policy_version 1169829 (0.0010) [2023-12-28 03:38:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 598286336. Throughput: 0: 9949.7, 1: 10000.1. Samples: 598258168. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:41,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.716')] [2023-12-28 03:38:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001169832_299524096.pth... [2023-12-28 03:38:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001166808_298762240.pth... [2023-12-28 03:38:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001165624_298459136.pth [2023-12-28 03:38:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001168680_299229184.pth [2023-12-28 03:38:41,248][106226] Updated weights for policy 0, policy_version 1166809 (0.0008) [2023-12-28 03:38:41,308][106226] Updated weights for policy 0, policy_version 1166819 (0.0011) [2023-12-28 03:38:41,373][106226] Updated weights for policy 0, policy_version 1166829 (0.0010) [2023-12-28 03:38:41,436][106226] Updated weights for policy 0, policy_version 1166839 (0.0006) [2023-12-28 03:38:41,658][106225] Updated weights for policy 1, policy_version 1169839 (0.0009) [2023-12-28 03:38:41,726][106225] Updated weights for policy 1, policy_version 1169849 (0.0010) [2023-12-28 03:38:41,794][106225] Updated weights for policy 1, policy_version 1169859 (0.0009) [2023-12-28 03:38:42,248][106226] Updated weights for policy 0, policy_version 1166849 (0.0008) [2023-12-28 03:38:42,309][106226] Updated weights for policy 0, policy_version 1166859 (0.0008) [2023-12-28 03:38:42,375][106226] Updated weights for policy 0, policy_version 1166869 (0.0008) [2023-12-28 03:38:42,573][106225] Updated weights for policy 1, policy_version 1169869 (0.0010) [2023-12-28 03:38:42,637][106225] Updated weights for policy 1, policy_version 1169879 (0.0010) [2023-12-28 03:38:42,700][106225] Updated weights for policy 1, policy_version 1169889 (0.0008) [2023-12-28 03:38:43,178][106226] Updated weights for policy 0, policy_version 1166879 (0.0009) [2023-12-28 03:38:43,245][106226] Updated weights for policy 0, policy_version 1166889 (0.0008) [2023-12-28 03:38:43,262][106225] Updated weights for policy 1, policy_version 1169899 (0.0009) [2023-12-28 03:38:43,306][106226] Updated weights for policy 0, policy_version 1166899 (0.0007) [2023-12-28 03:38:43,310][106225] Updated weights for policy 1, policy_version 1169909 (0.0006) [2023-12-28 03:38:43,356][106225] Updated weights for policy 1, policy_version 1169919 (0.0005) [2023-12-28 03:38:43,938][106225] Updated weights for policy 1, policy_version 1169929 (0.0005) [2023-12-28 03:38:43,991][106225] Updated weights for policy 1, policy_version 1169939 (0.0008) [2023-12-28 03:38:44,048][106225] Updated weights for policy 1, policy_version 1169949 (0.0008) [2023-12-28 03:38:44,104][106225] Updated weights for policy 1, policy_version 1169959 (0.0007) [2023-12-28 03:38:44,104][106226] Updated weights for policy 0, policy_version 1166909 (0.0008) [2023-12-28 03:38:44,160][106226] Updated weights for policy 0, policy_version 1166919 (0.0009) [2023-12-28 03:38:44,223][106226] Updated weights for policy 0, policy_version 1166929 (0.0008) [2023-12-28 03:38:44,782][106225] Updated weights for policy 1, policy_version 1169969 (0.0007) [2023-12-28 03:38:44,843][106225] Updated weights for policy 1, policy_version 1169979 (0.0008) [2023-12-28 03:38:44,909][106225] Updated weights for policy 1, policy_version 1169989 (0.0006) [2023-12-28 03:38:44,979][106226] Updated weights for policy 0, policy_version 1166939 (0.0009) [2023-12-28 03:38:45,040][106226] Updated weights for policy 0, policy_version 1166949 (0.0009) [2023-12-28 03:38:45,099][106226] Updated weights for policy 0, policy_version 1166959 (0.0008) [2023-12-28 03:38:45,488][106225] Updated weights for policy 1, policy_version 1169999 (0.0006) [2023-12-28 03:38:45,552][106225] Updated weights for policy 1, policy_version 1170009 (0.0005) [2023-12-28 03:38:45,605][106225] Updated weights for policy 1, policy_version 1170019 (0.0007) [2023-12-28 03:38:45,945][106226] Updated weights for policy 0, policy_version 1166969 (0.0008) [2023-12-28 03:38:45,999][106226] Updated weights for policy 0, policy_version 1166979 (0.0007) [2023-12-28 03:38:46,049][106226] Updated weights for policy 0, policy_version 1166990 (0.0008) [2023-12-28 03:38:46,105][106226] Updated weights for policy 0, policy_version 1167000 (0.0008) [2023-12-28 03:38:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 598384640. Throughput: 0: 9853.3, 1: 10008.0. Samples: 598371992. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:46,176][105115] Avg episode reward: [(0, '-4.624'), (1, '-5.251')] [2023-12-28 03:38:46,241][106225] Updated weights for policy 1, policy_version 1170029 (0.0009) [2023-12-28 03:38:46,291][106225] Updated weights for policy 1, policy_version 1170039 (0.0008) [2023-12-28 03:38:46,337][106225] Updated weights for policy 1, policy_version 1170049 (0.0008) [2023-12-28 03:38:46,791][106226] Updated weights for policy 0, policy_version 1167010 (0.0011) [2023-12-28 03:38:46,857][106226] Updated weights for policy 0, policy_version 1167020 (0.0011) [2023-12-28 03:38:46,921][106226] Updated weights for policy 0, policy_version 1167030 (0.0006) [2023-12-28 03:38:46,993][106225] Updated weights for policy 1, policy_version 1170059 (0.0008) [2023-12-28 03:38:47,043][106225] Updated weights for policy 1, policy_version 1170069 (0.0010) [2023-12-28 03:38:47,101][106225] Updated weights for policy 1, policy_version 1170079 (0.0010) [2023-12-28 03:38:47,526][106226] Updated weights for policy 0, policy_version 1167040 (0.0005) [2023-12-28 03:38:47,572][106226] Updated weights for policy 0, policy_version 1167050 (0.0005) [2023-12-28 03:38:47,623][106226] Updated weights for policy 0, policy_version 1167060 (0.0006) [2023-12-28 03:38:47,801][106225] Updated weights for policy 1, policy_version 1170089 (0.0006) [2023-12-28 03:38:47,857][106225] Updated weights for policy 1, policy_version 1170099 (0.0005) [2023-12-28 03:38:47,921][106225] Updated weights for policy 1, policy_version 1170109 (0.0006) [2023-12-28 03:38:47,973][106225] Updated weights for policy 1, policy_version 1170119 (0.0007) [2023-12-28 03:38:48,183][106226] Updated weights for policy 0, policy_version 1167070 (0.0005) [2023-12-28 03:38:48,238][106226] Updated weights for policy 0, policy_version 1167080 (0.0005) [2023-12-28 03:38:48,295][106226] Updated weights for policy 0, policy_version 1167090 (0.0008) [2023-12-28 03:38:48,671][106225] Updated weights for policy 1, policy_version 1170129 (0.0010) [2023-12-28 03:38:48,728][106225] Updated weights for policy 1, policy_version 1170139 (0.0010) [2023-12-28 03:38:48,789][106225] Updated weights for policy 1, policy_version 1170149 (0.0010) [2023-12-28 03:38:48,877][106226] Updated weights for policy 0, policy_version 1167100 (0.0009) [2023-12-28 03:38:48,934][106226] Updated weights for policy 0, policy_version 1167110 (0.0010) [2023-12-28 03:38:48,990][106226] Updated weights for policy 0, policy_version 1167120 (0.0010) [2023-12-28 03:38:49,488][106225] Updated weights for policy 1, policy_version 1170159 (0.0009) [2023-12-28 03:38:49,543][106225] Updated weights for policy 1, policy_version 1170169 (0.0008) [2023-12-28 03:38:49,600][106225] Updated weights for policy 1, policy_version 1170179 (0.0007) [2023-12-28 03:38:49,767][106226] Updated weights for policy 0, policy_version 1167130 (0.0010) [2023-12-28 03:38:49,831][106226] Updated weights for policy 0, policy_version 1167140 (0.0008) [2023-12-28 03:38:49,892][106226] Updated weights for policy 0, policy_version 1167150 (0.0008) [2023-12-28 03:38:50,344][106225] Updated weights for policy 1, policy_version 1170189 (0.0009) [2023-12-28 03:38:50,402][106225] Updated weights for policy 1, policy_version 1170199 (0.0009) [2023-12-28 03:38:50,449][106225] Updated weights for policy 1, policy_version 1170209 (0.0009) [2023-12-28 03:38:50,580][106226] Updated weights for policy 0, policy_version 1167161 (0.0008) [2023-12-28 03:38:50,640][106226] Updated weights for policy 0, policy_version 1167171 (0.0009) [2023-12-28 03:38:50,704][106226] Updated weights for policy 0, policy_version 1167181 (0.0008) [2023-12-28 03:38:50,767][106226] Updated weights for policy 0, policy_version 1167191 (0.0009) [2023-12-28 03:38:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 598482944. Throughput: 0: 9915.5, 1: 9972.4. Samples: 598493108. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:51,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.918')] [2023-12-28 03:38:51,240][106225] Updated weights for policy 1, policy_version 1170219 (0.0008) [2023-12-28 03:38:51,309][106225] Updated weights for policy 1, policy_version 1170229 (0.0008) [2023-12-28 03:38:51,372][106225] Updated weights for policy 1, policy_version 1170239 (0.0007) [2023-12-28 03:38:51,566][106226] Updated weights for policy 0, policy_version 1167201 (0.0009) [2023-12-28 03:38:51,635][106226] Updated weights for policy 0, policy_version 1167211 (0.0007) [2023-12-28 03:38:51,709][106226] Updated weights for policy 0, policy_version 1167221 (0.0014) [2023-12-28 03:38:52,152][106225] Updated weights for policy 1, policy_version 1170249 (0.0007) [2023-12-28 03:38:52,205][106225] Updated weights for policy 1, policy_version 1170259 (0.0008) [2023-12-28 03:38:52,271][106225] Updated weights for policy 1, policy_version 1170269 (0.0009) [2023-12-28 03:38:52,331][106225] Updated weights for policy 1, policy_version 1170279 (0.0008) [2023-12-28 03:38:52,375][106226] Updated weights for policy 0, policy_version 1167231 (0.0010) [2023-12-28 03:38:52,442][106226] Updated weights for policy 0, policy_version 1167241 (0.0011) [2023-12-28 03:38:52,506][106226] Updated weights for policy 0, policy_version 1167251 (0.0010) [2023-12-28 03:38:53,083][106225] Updated weights for policy 1, policy_version 1170289 (0.0010) [2023-12-28 03:38:53,149][106225] Updated weights for policy 1, policy_version 1170299 (0.0010) [2023-12-28 03:38:53,167][106226] Updated weights for policy 0, policy_version 1167261 (0.0010) [2023-12-28 03:38:53,203][106225] Updated weights for policy 1, policy_version 1170309 (0.0010) [2023-12-28 03:38:53,218][106226] Updated weights for policy 0, policy_version 1167271 (0.0010) [2023-12-28 03:38:53,266][106226] Updated weights for policy 0, policy_version 1167281 (0.0008) [2023-12-28 03:38:53,924][106225] Updated weights for policy 1, policy_version 1170319 (0.0010) [2023-12-28 03:38:53,981][106225] Updated weights for policy 1, policy_version 1170329 (0.0010) [2023-12-28 03:38:54,002][106226] Updated weights for policy 0, policy_version 1167291 (0.0008) [2023-12-28 03:38:54,031][106225] Updated weights for policy 1, policy_version 1170339 (0.0010) [2023-12-28 03:38:54,058][106226] Updated weights for policy 0, policy_version 1167301 (0.0005) [2023-12-28 03:38:54,117][106226] Updated weights for policy 0, policy_version 1167311 (0.0005) [2023-12-28 03:38:54,735][106226] Updated weights for policy 0, policy_version 1167321 (0.0006) [2023-12-28 03:38:54,755][106225] Updated weights for policy 1, policy_version 1170349 (0.0010) [2023-12-28 03:38:54,796][106226] Updated weights for policy 0, policy_version 1167331 (0.0007) [2023-12-28 03:38:54,809][106225] Updated weights for policy 1, policy_version 1170359 (0.0010) [2023-12-28 03:38:54,857][106226] Updated weights for policy 0, policy_version 1167341 (0.0005) [2023-12-28 03:38:54,869][106225] Updated weights for policy 1, policy_version 1170369 (0.0010) [2023-12-28 03:38:54,916][106226] Updated weights for policy 0, policy_version 1167351 (0.0007) [2023-12-28 03:38:55,577][106226] Updated weights for policy 0, policy_version 1167361 (0.0005) [2023-12-28 03:38:55,606][106225] Updated weights for policy 1, policy_version 1170379 (0.0010) [2023-12-28 03:38:55,629][106226] Updated weights for policy 0, policy_version 1167371 (0.0007) [2023-12-28 03:38:55,656][106225] Updated weights for policy 1, policy_version 1170389 (0.0010) [2023-12-28 03:38:55,685][106226] Updated weights for policy 0, policy_version 1167381 (0.0006) [2023-12-28 03:38:55,713][106225] Updated weights for policy 1, policy_version 1170399 (0.0010) [2023-12-28 03:38:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 598581248. Throughput: 0: 9967.6, 1: 9904.4. Samples: 598550364. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:38:56,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-4.665')] [2023-12-28 03:38:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001167384_298909696.pth... [2023-12-28 03:38:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001170408_299671552.pth... [2023-12-28 03:38:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001166232_298614784.pth [2023-12-28 03:38:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001169256_299376640.pth [2023-12-28 03:38:56,266][106226] Updated weights for policy 0, policy_version 1167391 (0.0007) [2023-12-28 03:38:56,318][106226] Updated weights for policy 0, policy_version 1167401 (0.0008) [2023-12-28 03:38:56,365][106226] Updated weights for policy 0, policy_version 1167411 (0.0008) [2023-12-28 03:38:56,446][106225] Updated weights for policy 1, policy_version 1170409 (0.0010) [2023-12-28 03:38:56,516][106225] Updated weights for policy 1, policy_version 1170419 (0.0010) [2023-12-28 03:38:56,576][106225] Updated weights for policy 1, policy_version 1170429 (0.0010) [2023-12-28 03:38:56,629][106225] Updated weights for policy 1, policy_version 1170439 (0.0010) [2023-12-28 03:38:56,983][106226] Updated weights for policy 0, policy_version 1167421 (0.0007) [2023-12-28 03:38:57,042][106226] Updated weights for policy 0, policy_version 1167431 (0.0008) [2023-12-28 03:38:57,101][106226] Updated weights for policy 0, policy_version 1167441 (0.0008) [2023-12-28 03:38:57,341][106225] Updated weights for policy 1, policy_version 1170449 (0.0010) [2023-12-28 03:38:57,404][106225] Updated weights for policy 1, policy_version 1170459 (0.0010) [2023-12-28 03:38:57,460][106225] Updated weights for policy 1, policy_version 1170469 (0.0010) [2023-12-28 03:38:57,740][106226] Updated weights for policy 0, policy_version 1167451 (0.0007) [2023-12-28 03:38:57,796][106226] Updated weights for policy 0, policy_version 1167461 (0.0005) [2023-12-28 03:38:57,854][106226] Updated weights for policy 0, policy_version 1167471 (0.0006) [2023-12-28 03:38:58,170][106225] Updated weights for policy 1, policy_version 1170479 (0.0010) [2023-12-28 03:38:58,223][106225] Updated weights for policy 1, policy_version 1170489 (0.0009) [2023-12-28 03:38:58,285][106225] Updated weights for policy 1, policy_version 1170499 (0.0009) [2023-12-28 03:38:58,451][106226] Updated weights for policy 0, policy_version 1167481 (0.0007) [2023-12-28 03:38:58,519][106226] Updated weights for policy 0, policy_version 1167491 (0.0008) [2023-12-28 03:38:58,579][106226] Updated weights for policy 0, policy_version 1167501 (0.0008) [2023-12-28 03:38:58,647][106226] Updated weights for policy 0, policy_version 1167511 (0.0012) [2023-12-28 03:38:59,104][106225] Updated weights for policy 1, policy_version 1170509 (0.0008) [2023-12-28 03:38:59,163][106225] Updated weights for policy 1, policy_version 1170519 (0.0008) [2023-12-28 03:38:59,226][106225] Updated weights for policy 1, policy_version 1170529 (0.0008) [2023-12-28 03:38:59,459][106226] Updated weights for policy 0, policy_version 1167521 (0.0011) [2023-12-28 03:38:59,518][106226] Updated weights for policy 0, policy_version 1167531 (0.0010) [2023-12-28 03:38:59,582][106226] Updated weights for policy 0, policy_version 1167541 (0.0009) [2023-12-28 03:38:59,946][106225] Updated weights for policy 1, policy_version 1170539 (0.0008) [2023-12-28 03:39:00,006][106225] Updated weights for policy 1, policy_version 1170549 (0.0008) [2023-12-28 03:39:00,069][106225] Updated weights for policy 1, policy_version 1170559 (0.0008) [2023-12-28 03:39:00,336][106226] Updated weights for policy 0, policy_version 1167551 (0.0010) [2023-12-28 03:39:00,390][106226] Updated weights for policy 0, policy_version 1167561 (0.0011) [2023-12-28 03:39:00,444][106226] Updated weights for policy 0, policy_version 1167571 (0.0009) [2023-12-28 03:39:00,724][106225] Updated weights for policy 1, policy_version 1170569 (0.0008) [2023-12-28 03:39:00,781][106225] Updated weights for policy 1, policy_version 1170579 (0.0008) [2023-12-28 03:39:00,842][106225] Updated weights for policy 1, policy_version 1170589 (0.0008) [2023-12-28 03:39:00,913][106225] Updated weights for policy 1, policy_version 1170599 (0.0009) [2023-12-28 03:39:01,164][106226] Updated weights for policy 0, policy_version 1167581 (0.0009) [2023-12-28 03:39:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 598679552. Throughput: 0: 10039.6, 1: 9866.8. Samples: 598669652. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:39:01,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.689')] [2023-12-28 03:39:01,215][106226] Updated weights for policy 0, policy_version 1167591 (0.0010) [2023-12-28 03:39:01,276][106226] Updated weights for policy 0, policy_version 1167601 (0.0011) [2023-12-28 03:39:01,631][106225] Updated weights for policy 1, policy_version 1170609 (0.0008) [2023-12-28 03:39:01,697][106225] Updated weights for policy 1, policy_version 1170619 (0.0008) [2023-12-28 03:39:01,770][106225] Updated weights for policy 1, policy_version 1170629 (0.0009) [2023-12-28 03:39:02,012][106226] Updated weights for policy 0, policy_version 1167611 (0.0009) [2023-12-28 03:39:02,081][106226] Updated weights for policy 0, policy_version 1167621 (0.0008) [2023-12-28 03:39:02,139][106226] Updated weights for policy 0, policy_version 1167631 (0.0010) [2023-12-28 03:39:02,479][106225] Updated weights for policy 1, policy_version 1170639 (0.0006) [2023-12-28 03:39:02,538][106225] Updated weights for policy 1, policy_version 1170649 (0.0006) [2023-12-28 03:39:02,602][106225] Updated weights for policy 1, policy_version 1170659 (0.0006) [2023-12-28 03:39:02,776][106226] Updated weights for policy 0, policy_version 1167641 (0.0009) [2023-12-28 03:39:02,840][106226] Updated weights for policy 0, policy_version 1167651 (0.0007) [2023-12-28 03:39:02,893][106226] Updated weights for policy 0, policy_version 1167661 (0.0006) [2023-12-28 03:39:02,939][106226] Updated weights for policy 0, policy_version 1167671 (0.0005) [2023-12-28 03:39:03,225][106225] Updated weights for policy 1, policy_version 1170669 (0.0008) [2023-12-28 03:39:03,274][106225] Updated weights for policy 1, policy_version 1170679 (0.0005) [2023-12-28 03:39:03,327][106225] Updated weights for policy 1, policy_version 1170689 (0.0009) [2023-12-28 03:39:03,473][106226] Updated weights for policy 0, policy_version 1167681 (0.0009) [2023-12-28 03:39:03,526][106226] Updated weights for policy 0, policy_version 1167691 (0.0009) [2023-12-28 03:39:03,585][106226] Updated weights for policy 0, policy_version 1167701 (0.0007) [2023-12-28 03:39:03,893][106225] Updated weights for policy 1, policy_version 1170699 (0.0009) [2023-12-28 03:39:03,953][106225] Updated weights for policy 1, policy_version 1170709 (0.0009) [2023-12-28 03:39:04,020][106225] Updated weights for policy 1, policy_version 1170719 (0.0009) [2023-12-28 03:39:04,258][106226] Updated weights for policy 0, policy_version 1167711 (0.0009) [2023-12-28 03:39:04,322][106226] Updated weights for policy 0, policy_version 1167721 (0.0010) [2023-12-28 03:39:04,388][106226] Updated weights for policy 0, policy_version 1167731 (0.0009) [2023-12-28 03:39:04,673][106225] Updated weights for policy 1, policy_version 1170729 (0.0006) [2023-12-28 03:39:04,739][106225] Updated weights for policy 1, policy_version 1170739 (0.0006) [2023-12-28 03:39:04,798][106225] Updated weights for policy 1, policy_version 1170749 (0.0010) [2023-12-28 03:39:04,859][106225] Updated weights for policy 1, policy_version 1170759 (0.0010) [2023-12-28 03:39:05,076][106226] Updated weights for policy 0, policy_version 1167741 (0.0007) [2023-12-28 03:39:05,137][106226] Updated weights for policy 0, policy_version 1167751 (0.0005) [2023-12-28 03:39:05,197][106226] Updated weights for policy 0, policy_version 1167761 (0.0007) [2023-12-28 03:39:05,485][106225] Updated weights for policy 1, policy_version 1170769 (0.0007) [2023-12-28 03:39:05,532][106225] Updated weights for policy 1, policy_version 1170779 (0.0010) [2023-12-28 03:39:05,581][106225] Updated weights for policy 1, policy_version 1170789 (0.0010) [2023-12-28 03:39:05,788][106226] Updated weights for policy 0, policy_version 1167771 (0.0010) [2023-12-28 03:39:05,847][106226] Updated weights for policy 0, policy_version 1167781 (0.0010) [2023-12-28 03:39:05,906][106226] Updated weights for policy 0, policy_version 1167791 (0.0010) [2023-12-28 03:39:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 598786048. Throughput: 0: 10093.4, 1: 9957.4. Samples: 598795396. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:39:06,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.244')] [2023-12-28 03:39:06,226][106225] Updated weights for policy 1, policy_version 1170799 (0.0007) [2023-12-28 03:39:06,286][106225] Updated weights for policy 1, policy_version 1170809 (0.0008) [2023-12-28 03:39:06,346][106225] Updated weights for policy 1, policy_version 1170819 (0.0008) [2023-12-28 03:39:06,626][106226] Updated weights for policy 0, policy_version 1167801 (0.0010) [2023-12-28 03:39:06,695][106226] Updated weights for policy 0, policy_version 1167811 (0.0008) [2023-12-28 03:39:06,759][106226] Updated weights for policy 0, policy_version 1167821 (0.0008) [2023-12-28 03:39:06,825][106226] Updated weights for policy 0, policy_version 1167831 (0.0007) [2023-12-28 03:39:07,049][106225] Updated weights for policy 1, policy_version 1170829 (0.0009) [2023-12-28 03:39:07,109][106225] Updated weights for policy 1, policy_version 1170839 (0.0010) [2023-12-28 03:39:07,163][106225] Updated weights for policy 1, policy_version 1170849 (0.0010) [2023-12-28 03:39:07,535][106226] Updated weights for policy 0, policy_version 1167841 (0.0006) [2023-12-28 03:39:07,609][106226] Updated weights for policy 0, policy_version 1167851 (0.0006) [2023-12-28 03:39:07,662][106226] Updated weights for policy 0, policy_version 1167861 (0.0008) [2023-12-28 03:39:07,882][106225] Updated weights for policy 1, policy_version 1170859 (0.0010) [2023-12-28 03:39:07,935][106225] Updated weights for policy 1, policy_version 1170869 (0.0010) [2023-12-28 03:39:07,997][106225] Updated weights for policy 1, policy_version 1170879 (0.0009) [2023-12-28 03:39:08,195][106226] Updated weights for policy 0, policy_version 1167871 (0.0008) [2023-12-28 03:39:08,246][106226] Updated weights for policy 0, policy_version 1167881 (0.0008) [2023-12-28 03:39:08,301][106226] Updated weights for policy 0, policy_version 1167891 (0.0008) [2023-12-28 03:39:08,756][106225] Updated weights for policy 1, policy_version 1170889 (0.0009) [2023-12-28 03:39:08,804][106225] Updated weights for policy 1, policy_version 1170899 (0.0009) [2023-12-28 03:39:08,849][106225] Updated weights for policy 1, policy_version 1170909 (0.0008) [2023-12-28 03:39:08,893][106225] Updated weights for policy 1, policy_version 1170919 (0.0008) [2023-12-28 03:39:09,062][106226] Updated weights for policy 0, policy_version 1167901 (0.0009) [2023-12-28 03:39:09,113][106226] Updated weights for policy 0, policy_version 1167911 (0.0009) [2023-12-28 03:39:09,160][106226] Updated weights for policy 0, policy_version 1167921 (0.0008) [2023-12-28 03:39:09,665][106225] Updated weights for policy 1, policy_version 1170929 (0.0010) [2023-12-28 03:39:09,728][106225] Updated weights for policy 1, policy_version 1170939 (0.0009) [2023-12-28 03:39:09,790][106225] Updated weights for policy 1, policy_version 1170949 (0.0010) [2023-12-28 03:39:09,870][106226] Updated weights for policy 0, policy_version 1167931 (0.0010) [2023-12-28 03:39:09,924][106226] Updated weights for policy 0, policy_version 1167941 (0.0010) [2023-12-28 03:39:10,003][106226] Updated weights for policy 0, policy_version 1167951 (0.0011) [2023-12-28 03:39:10,504][106225] Updated weights for policy 1, policy_version 1170959 (0.0010) [2023-12-28 03:39:10,563][106225] Updated weights for policy 1, policy_version 1170969 (0.0010) [2023-12-28 03:39:10,621][106225] Updated weights for policy 1, policy_version 1170979 (0.0010) [2023-12-28 03:39:10,640][106226] Updated weights for policy 0, policy_version 1167961 (0.0007) [2023-12-28 03:39:10,701][106226] Updated weights for policy 0, policy_version 1167971 (0.0011) [2023-12-28 03:39:10,766][106226] Updated weights for policy 0, policy_version 1167981 (0.0011) [2023-12-28 03:39:10,837][106226] Updated weights for policy 0, policy_version 1167991 (0.0011) [2023-12-28 03:39:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 598884352. Throughput: 0: 10109.2, 1: 9990.2. Samples: 598855036. Policy #0 lag: (min: 4.0, avg: 11.9, max: 36.0) [2023-12-28 03:39:11,175][105115] Avg episode reward: [(0, '-4.660'), (1, '-4.924')] [2023-12-28 03:39:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001170984_299819008.pth... [2023-12-28 03:39:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001167992_299065344.pth... [2023-12-28 03:39:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001169832_299524096.pth [2023-12-28 03:39:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001166808_298762240.pth [2023-12-28 03:39:11,290][106225] Updated weights for policy 1, policy_version 1170989 (0.0011) [2023-12-28 03:39:11,353][106225] Updated weights for policy 1, policy_version 1170999 (0.0011) [2023-12-28 03:39:11,429][106225] Updated weights for policy 1, policy_version 1171009 (0.0009) [2023-12-28 03:39:11,531][106226] Updated weights for policy 0, policy_version 1168001 (0.0007) [2023-12-28 03:39:11,592][106226] Updated weights for policy 0, policy_version 1168011 (0.0008) [2023-12-28 03:39:11,659][106226] Updated weights for policy 0, policy_version 1168021 (0.0008) [2023-12-28 03:39:12,087][106225] Updated weights for policy 1, policy_version 1171019 (0.0011) [2023-12-28 03:39:12,151][106225] Updated weights for policy 1, policy_version 1171029 (0.0009) [2023-12-28 03:39:12,219][106225] Updated weights for policy 1, policy_version 1171039 (0.0009) [2023-12-28 03:39:12,396][106226] Updated weights for policy 0, policy_version 1168031 (0.0008) [2023-12-28 03:39:12,462][106226] Updated weights for policy 0, policy_version 1168041 (0.0010) [2023-12-28 03:39:12,516][106226] Updated weights for policy 0, policy_version 1168051 (0.0010) [2023-12-28 03:39:12,894][106225] Updated weights for policy 1, policy_version 1171049 (0.0009) [2023-12-28 03:39:12,959][106225] Updated weights for policy 1, policy_version 1171059 (0.0006) [2023-12-28 03:39:13,025][106225] Updated weights for policy 1, policy_version 1171069 (0.0009) [2023-12-28 03:39:13,088][106225] Updated weights for policy 1, policy_version 1171079 (0.0009) [2023-12-28 03:39:13,242][106226] Updated weights for policy 0, policy_version 1168061 (0.0009) [2023-12-28 03:39:13,298][106226] Updated weights for policy 0, policy_version 1168071 (0.0010) [2023-12-28 03:39:13,354][106226] Updated weights for policy 0, policy_version 1168081 (0.0010) [2023-12-28 03:39:13,643][106225] Updated weights for policy 1, policy_version 1171089 (0.0008) [2023-12-28 03:39:13,701][106225] Updated weights for policy 1, policy_version 1171099 (0.0006) [2023-12-28 03:39:13,768][106225] Updated weights for policy 1, policy_version 1171109 (0.0008) [2023-12-28 03:39:13,943][106226] Updated weights for policy 0, policy_version 1168091 (0.0009) [2023-12-28 03:39:14,008][106226] Updated weights for policy 0, policy_version 1168101 (0.0005) [2023-12-28 03:39:14,068][106226] Updated weights for policy 0, policy_version 1168111 (0.0006) [2023-12-28 03:39:14,296][106225] Updated weights for policy 1, policy_version 1171119 (0.0008) [2023-12-28 03:39:14,365][106225] Updated weights for policy 1, policy_version 1171129 (0.0007) [2023-12-28 03:39:14,437][106225] Updated weights for policy 1, policy_version 1171139 (0.0009) [2023-12-28 03:39:14,623][106226] Updated weights for policy 0, policy_version 1168121 (0.0007) [2023-12-28 03:39:14,686][106226] Updated weights for policy 0, policy_version 1168131 (0.0006) [2023-12-28 03:39:14,747][106226] Updated weights for policy 0, policy_version 1168141 (0.0008) [2023-12-28 03:39:14,808][106226] Updated weights for policy 0, policy_version 1168151 (0.0010) [2023-12-28 03:39:15,088][106225] Updated weights for policy 1, policy_version 1171149 (0.0007) [2023-12-28 03:39:15,157][106225] Updated weights for policy 1, policy_version 1171159 (0.0006) [2023-12-28 03:39:15,222][106225] Updated weights for policy 1, policy_version 1171169 (0.0006) [2023-12-28 03:39:15,505][106226] Updated weights for policy 0, policy_version 1168161 (0.0007) [2023-12-28 03:39:15,559][106226] Updated weights for policy 0, policy_version 1168171 (0.0010) [2023-12-28 03:39:15,608][106226] Updated weights for policy 0, policy_version 1168181 (0.0010) [2023-12-28 03:39:15,831][106225] Updated weights for policy 1, policy_version 1171179 (0.0008) [2023-12-28 03:39:15,890][106225] Updated weights for policy 1, policy_version 1171189 (0.0010) [2023-12-28 03:39:15,950][106225] Updated weights for policy 1, policy_version 1171199 (0.0010) [2023-12-28 03:39:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 598990848. Throughput: 0: 10055.7, 1: 10028.4. Samples: 598977644. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:16,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.747')] [2023-12-28 03:39:16,232][106226] Updated weights for policy 0, policy_version 1168191 (0.0008) [2023-12-28 03:39:16,297][106226] Updated weights for policy 0, policy_version 1168201 (0.0008) [2023-12-28 03:39:16,362][106226] Updated weights for policy 0, policy_version 1168211 (0.0010) [2023-12-28 03:39:16,567][106225] Updated weights for policy 1, policy_version 1171209 (0.0010) [2023-12-28 03:39:16,625][106225] Updated weights for policy 1, policy_version 1171219 (0.0005) [2023-12-28 03:39:16,673][106225] Updated weights for policy 1, policy_version 1171229 (0.0005) [2023-12-28 03:39:16,728][106225] Updated weights for policy 1, policy_version 1171239 (0.0005) [2023-12-28 03:39:17,018][106226] Updated weights for policy 0, policy_version 1168221 (0.0008) [2023-12-28 03:39:17,074][106226] Updated weights for policy 0, policy_version 1168231 (0.0008) [2023-12-28 03:39:17,131][106226] Updated weights for policy 0, policy_version 1168241 (0.0008) [2023-12-28 03:39:17,285][106225] Updated weights for policy 1, policy_version 1171249 (0.0006) [2023-12-28 03:39:17,334][106225] Updated weights for policy 1, policy_version 1171259 (0.0010) [2023-12-28 03:39:17,382][106225] Updated weights for policy 1, policy_version 1171269 (0.0010) [2023-12-28 03:39:17,815][106226] Updated weights for policy 0, policy_version 1168251 (0.0010) [2023-12-28 03:39:17,864][106226] Updated weights for policy 0, policy_version 1168261 (0.0010) [2023-12-28 03:39:17,924][106226] Updated weights for policy 0, policy_version 1168271 (0.0010) [2023-12-28 03:39:18,064][106225] Updated weights for policy 1, policy_version 1171279 (0.0007) [2023-12-28 03:39:18,122][106225] Updated weights for policy 1, policy_version 1171289 (0.0008) [2023-12-28 03:39:18,187][106225] Updated weights for policy 1, policy_version 1171299 (0.0007) [2023-12-28 03:39:18,619][106226] Updated weights for policy 0, policy_version 1168281 (0.0010) [2023-12-28 03:39:18,680][106226] Updated weights for policy 0, policy_version 1168291 (0.0008) [2023-12-28 03:39:18,743][106226] Updated weights for policy 0, policy_version 1168301 (0.0008) [2023-12-28 03:39:18,808][106226] Updated weights for policy 0, policy_version 1168311 (0.0005) [2023-12-28 03:39:18,857][106225] Updated weights for policy 1, policy_version 1171309 (0.0008) [2023-12-28 03:39:18,912][106225] Updated weights for policy 1, policy_version 1171319 (0.0009) [2023-12-28 03:39:18,976][106225] Updated weights for policy 1, policy_version 1171329 (0.0008) [2023-12-28 03:39:19,469][106226] Updated weights for policy 0, policy_version 1168321 (0.0007) [2023-12-28 03:39:19,535][106226] Updated weights for policy 0, policy_version 1168331 (0.0007) [2023-12-28 03:39:19,603][106226] Updated weights for policy 0, policy_version 1168341 (0.0007) [2023-12-28 03:39:19,793][106225] Updated weights for policy 1, policy_version 1171339 (0.0008) [2023-12-28 03:39:19,858][106225] Updated weights for policy 1, policy_version 1171349 (0.0007) [2023-12-28 03:39:19,914][106225] Updated weights for policy 1, policy_version 1171359 (0.0008) [2023-12-28 03:39:20,335][106226] Updated weights for policy 0, policy_version 1168351 (0.0008) [2023-12-28 03:39:20,406][106226] Updated weights for policy 0, policy_version 1168361 (0.0006) [2023-12-28 03:39:20,474][106226] Updated weights for policy 0, policy_version 1168371 (0.0007) [2023-12-28 03:39:20,664][106225] Updated weights for policy 1, policy_version 1171369 (0.0008) [2023-12-28 03:39:20,727][106225] Updated weights for policy 1, policy_version 1171379 (0.0006) [2023-12-28 03:39:20,788][106225] Updated weights for policy 1, policy_version 1171389 (0.0006) [2023-12-28 03:39:20,854][106225] Updated weights for policy 1, policy_version 1171399 (0.0007) [2023-12-28 03:39:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 599089152. Throughput: 0: 9980.6, 1: 10038.5. Samples: 599099184. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:21,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.093')] [2023-12-28 03:39:21,243][106226] Updated weights for policy 0, policy_version 1168381 (0.0008) [2023-12-28 03:39:21,309][106226] Updated weights for policy 0, policy_version 1168391 (0.0010) [2023-12-28 03:39:21,370][106226] Updated weights for policy 0, policy_version 1168401 (0.0010) [2023-12-28 03:39:21,593][106225] Updated weights for policy 1, policy_version 1171409 (0.0009) [2023-12-28 03:39:21,682][106225] Updated weights for policy 1, policy_version 1171419 (0.0008) [2023-12-28 03:39:21,738][106225] Updated weights for policy 1, policy_version 1171429 (0.0008) [2023-12-28 03:39:22,169][106226] Updated weights for policy 0, policy_version 1168411 (0.0010) [2023-12-28 03:39:22,240][106226] Updated weights for policy 0, policy_version 1168421 (0.0008) [2023-12-28 03:39:22,296][106226] Updated weights for policy 0, policy_version 1168431 (0.0007) [2023-12-28 03:39:22,486][106225] Updated weights for policy 1, policy_version 1171439 (0.0009) [2023-12-28 03:39:22,541][106225] Updated weights for policy 1, policy_version 1171449 (0.0008) [2023-12-28 03:39:22,598][106225] Updated weights for policy 1, policy_version 1171459 (0.0008) [2023-12-28 03:39:22,974][106226] Updated weights for policy 0, policy_version 1168441 (0.0008) [2023-12-28 03:39:23,051][106226] Updated weights for policy 0, policy_version 1168451 (0.0005) [2023-12-28 03:39:23,111][106226] Updated weights for policy 0, policy_version 1168461 (0.0009) [2023-12-28 03:39:23,167][106226] Updated weights for policy 0, policy_version 1168471 (0.0007) [2023-12-28 03:39:23,319][106225] Updated weights for policy 1, policy_version 1171470 (0.0008) [2023-12-28 03:39:23,393][106225] Updated weights for policy 1, policy_version 1171480 (0.0009) [2023-12-28 03:39:23,448][106225] Updated weights for policy 1, policy_version 1171490 (0.0008) [2023-12-28 03:39:23,669][106226] Updated weights for policy 0, policy_version 1168481 (0.0008) [2023-12-28 03:39:23,723][106226] Updated weights for policy 0, policy_version 1168491 (0.0009) [2023-12-28 03:39:23,775][106226] Updated weights for policy 0, policy_version 1168501 (0.0008) [2023-12-28 03:39:24,123][106225] Updated weights for policy 1, policy_version 1171500 (0.0006) [2023-12-28 03:39:24,185][106225] Updated weights for policy 1, policy_version 1171510 (0.0008) [2023-12-28 03:39:24,254][106225] Updated weights for policy 1, policy_version 1171520 (0.0006) [2023-12-28 03:39:24,482][106226] Updated weights for policy 0, policy_version 1168511 (0.0008) [2023-12-28 03:39:24,535][106226] Updated weights for policy 0, policy_version 1168521 (0.0007) [2023-12-28 03:39:24,592][106226] Updated weights for policy 0, policy_version 1168531 (0.0010) [2023-12-28 03:39:24,901][106225] Updated weights for policy 1, policy_version 1171530 (0.0009) [2023-12-28 03:39:24,947][106225] Updated weights for policy 1, policy_version 1171540 (0.0005) [2023-12-28 03:39:25,000][106225] Updated weights for policy 1, policy_version 1171550 (0.0005) [2023-12-28 03:39:25,047][106225] Updated weights for policy 1, policy_version 1171560 (0.0007) [2023-12-28 03:39:25,290][106226] Updated weights for policy 0, policy_version 1168541 (0.0010) [2023-12-28 03:39:25,356][106226] Updated weights for policy 0, policy_version 1168551 (0.0010) [2023-12-28 03:39:25,419][106226] Updated weights for policy 0, policy_version 1168561 (0.0010) [2023-12-28 03:39:25,706][106225] Updated weights for policy 1, policy_version 1171570 (0.0009) [2023-12-28 03:39:25,764][106225] Updated weights for policy 1, policy_version 1171580 (0.0010) [2023-12-28 03:39:25,826][106225] Updated weights for policy 1, policy_version 1171590 (0.0011) [2023-12-28 03:39:26,102][106226] Updated weights for policy 0, policy_version 1168571 (0.0009) [2023-12-28 03:39:26,152][106226] Updated weights for policy 0, policy_version 1168581 (0.0008) [2023-12-28 03:39:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 599187456. Throughput: 0: 10000.3, 1: 9996.1. Samples: 599158004. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:26,175][105115] Avg episode reward: [(0, '-4.139'), (1, '-4.797')] [2023-12-28 03:39:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001171592_299974656.pth... [2023-12-28 03:39:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001170408_299671552.pth [2023-12-28 03:39:26,207][106226] Updated weights for policy 0, policy_version 1168591 (0.0005) [2023-12-28 03:39:26,256][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001168600_299220992.pth... [2023-12-28 03:39:26,260][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001167384_298909696.pth [2023-12-28 03:39:26,475][106225] Updated weights for policy 1, policy_version 1171600 (0.0006) [2023-12-28 03:39:26,524][106225] Updated weights for policy 1, policy_version 1171610 (0.0005) [2023-12-28 03:39:26,571][106225] Updated weights for policy 1, policy_version 1171620 (0.0005) [2023-12-28 03:39:26,789][106226] Updated weights for policy 0, policy_version 1168601 (0.0006) [2023-12-28 03:39:26,851][106226] Updated weights for policy 0, policy_version 1168611 (0.0010) [2023-12-28 03:39:26,900][106226] Updated weights for policy 0, policy_version 1168621 (0.0010) [2023-12-28 03:39:26,952][106226] Updated weights for policy 0, policy_version 1168631 (0.0010) [2023-12-28 03:39:27,121][106225] Updated weights for policy 1, policy_version 1171630 (0.0005) [2023-12-28 03:39:27,176][106225] Updated weights for policy 1, policy_version 1171640 (0.0005) [2023-12-28 03:39:27,228][106225] Updated weights for policy 1, policy_version 1171650 (0.0007) [2023-12-28 03:39:27,598][106226] Updated weights for policy 0, policy_version 1168641 (0.0006) [2023-12-28 03:39:27,653][106226] Updated weights for policy 0, policy_version 1168651 (0.0005) [2023-12-28 03:39:27,703][106226] Updated weights for policy 0, policy_version 1168661 (0.0005) [2023-12-28 03:39:27,849][106225] Updated weights for policy 1, policy_version 1171660 (0.0008) [2023-12-28 03:39:27,912][106225] Updated weights for policy 1, policy_version 1171670 (0.0009) [2023-12-28 03:39:27,971][106225] Updated weights for policy 1, policy_version 1171680 (0.0009) [2023-12-28 03:39:28,237][106226] Updated weights for policy 0, policy_version 1168671 (0.0005) [2023-12-28 03:39:28,301][106226] Updated weights for policy 0, policy_version 1168681 (0.0007) [2023-12-28 03:39:28,368][106226] Updated weights for policy 0, policy_version 1168691 (0.0011) [2023-12-28 03:39:28,574][106225] Updated weights for policy 1, policy_version 1171690 (0.0007) [2023-12-28 03:39:28,632][106225] Updated weights for policy 1, policy_version 1171700 (0.0008) [2023-12-28 03:39:28,687][106225] Updated weights for policy 1, policy_version 1171710 (0.0009) [2023-12-28 03:39:28,737][106225] Updated weights for policy 1, policy_version 1171720 (0.0010) [2023-12-28 03:39:28,992][106226] Updated weights for policy 0, policy_version 1168701 (0.0007) [2023-12-28 03:39:29,037][106226] Updated weights for policy 0, policy_version 1168711 (0.0005) [2023-12-28 03:39:29,085][106226] Updated weights for policy 0, policy_version 1168721 (0.0008) [2023-12-28 03:39:29,386][106225] Updated weights for policy 1, policy_version 1171730 (0.0007) [2023-12-28 03:39:29,447][106225] Updated weights for policy 1, policy_version 1171740 (0.0005) [2023-12-28 03:39:29,505][106225] Updated weights for policy 1, policy_version 1171750 (0.0005) [2023-12-28 03:39:29,825][106226] Updated weights for policy 0, policy_version 1168731 (0.0010) [2023-12-28 03:39:29,889][106226] Updated weights for policy 0, policy_version 1168741 (0.0010) [2023-12-28 03:39:29,953][106226] Updated weights for policy 0, policy_version 1168751 (0.0010) [2023-12-28 03:39:30,116][106225] Updated weights for policy 1, policy_version 1171760 (0.0007) [2023-12-28 03:39:30,172][106225] Updated weights for policy 1, policy_version 1171770 (0.0007) [2023-12-28 03:39:30,233][106225] Updated weights for policy 1, policy_version 1171780 (0.0005) [2023-12-28 03:39:30,682][106226] Updated weights for policy 0, policy_version 1168761 (0.0008) [2023-12-28 03:39:30,737][106226] Updated weights for policy 0, policy_version 1168771 (0.0005) [2023-12-28 03:39:30,798][106226] Updated weights for policy 0, policy_version 1168781 (0.0006) [2023-12-28 03:39:30,857][106226] Updated weights for policy 0, policy_version 1168791 (0.0006) [2023-12-28 03:39:30,900][106225] Updated weights for policy 1, policy_version 1171790 (0.0006) [2023-12-28 03:39:30,951][106225] Updated weights for policy 1, policy_version 1171800 (0.0008) [2023-12-28 03:39:31,005][106225] Updated weights for policy 1, policy_version 1171810 (0.0008) [2023-12-28 03:39:31,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20343.5, 300 sec: 19827.4). Total num frames: 599302144. Throughput: 0: 10224.5, 1: 10115.1. Samples: 599287268. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:31,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.819')] [2023-12-28 03:39:31,542][106226] Updated weights for policy 0, policy_version 1168801 (0.0008) [2023-12-28 03:39:31,588][106226] Updated weights for policy 0, policy_version 1168811 (0.0008) [2023-12-28 03:39:31,646][106226] Updated weights for policy 0, policy_version 1168821 (0.0008) [2023-12-28 03:39:31,780][106225] Updated weights for policy 1, policy_version 1171820 (0.0009) [2023-12-28 03:39:31,838][106225] Updated weights for policy 1, policy_version 1171830 (0.0009) [2023-12-28 03:39:31,904][106225] Updated weights for policy 1, policy_version 1171840 (0.0010) [2023-12-28 03:39:32,270][106226] Updated weights for policy 0, policy_version 1168831 (0.0009) [2023-12-28 03:39:32,323][106226] Updated weights for policy 0, policy_version 1168841 (0.0008) [2023-12-28 03:39:32,383][106226] Updated weights for policy 0, policy_version 1168851 (0.0008) [2023-12-28 03:39:32,729][106225] Updated weights for policy 1, policy_version 1171850 (0.0009) [2023-12-28 03:39:32,775][106225] Updated weights for policy 1, policy_version 1171860 (0.0008) [2023-12-28 03:39:32,836][106225] Updated weights for policy 1, policy_version 1171870 (0.0008) [2023-12-28 03:39:32,891][106225] Updated weights for policy 1, policy_version 1171880 (0.0013) [2023-12-28 03:39:32,978][106226] Updated weights for policy 0, policy_version 1168861 (0.0007) [2023-12-28 03:39:33,032][106226] Updated weights for policy 0, policy_version 1168871 (0.0008) [2023-12-28 03:39:33,087][106226] Updated weights for policy 0, policy_version 1168881 (0.0005) [2023-12-28 03:39:33,689][106226] Updated weights for policy 0, policy_version 1168891 (0.0007) [2023-12-28 03:39:33,697][106225] Updated weights for policy 1, policy_version 1171890 (0.0008) [2023-12-28 03:39:33,742][106226] Updated weights for policy 0, policy_version 1168901 (0.0005) [2023-12-28 03:39:33,749][106225] Updated weights for policy 1, policy_version 1171900 (0.0008) [2023-12-28 03:39:33,795][106225] Updated weights for policy 1, policy_version 1171910 (0.0007) [2023-12-28 03:39:33,798][106226] Updated weights for policy 0, policy_version 1168911 (0.0006) [2023-12-28 03:39:34,434][106226] Updated weights for policy 0, policy_version 1168921 (0.0008) [2023-12-28 03:39:34,440][106225] Updated weights for policy 1, policy_version 1171920 (0.0010) [2023-12-28 03:39:34,500][106226] Updated weights for policy 0, policy_version 1168931 (0.0011) [2023-12-28 03:39:34,503][106225] Updated weights for policy 1, policy_version 1171930 (0.0010) [2023-12-28 03:39:34,564][106225] Updated weights for policy 1, policy_version 1171940 (0.0010) [2023-12-28 03:39:34,566][106226] Updated weights for policy 0, policy_version 1168941 (0.0011) [2023-12-28 03:39:34,627][106226] Updated weights for policy 0, policy_version 1168951 (0.0011) [2023-12-28 03:39:35,193][106225] Updated weights for policy 1, policy_version 1171950 (0.0007) [2023-12-28 03:39:35,239][106225] Updated weights for policy 1, policy_version 1171960 (0.0005) [2023-12-28 03:39:35,291][106225] Updated weights for policy 1, policy_version 1171970 (0.0005) [2023-12-28 03:39:35,343][106226] Updated weights for policy 0, policy_version 1168961 (0.0010) [2023-12-28 03:39:35,389][106226] Updated weights for policy 0, policy_version 1168971 (0.0010) [2023-12-28 03:39:35,435][106226] Updated weights for policy 0, policy_version 1168981 (0.0010) [2023-12-28 03:39:35,814][106225] Updated weights for policy 1, policy_version 1171980 (0.0006) [2023-12-28 03:39:35,873][106225] Updated weights for policy 1, policy_version 1171990 (0.0009) [2023-12-28 03:39:35,933][106225] Updated weights for policy 1, policy_version 1172000 (0.0010) [2023-12-28 03:39:36,169][106226] Updated weights for policy 0, policy_version 1168991 (0.0009) [2023-12-28 03:39:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 599400448. Throughput: 0: 10273.7, 1: 10095.5. Samples: 599409720. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:36,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-4.918')] [2023-12-28 03:39:36,241][106226] Updated weights for policy 0, policy_version 1169001 (0.0008) [2023-12-28 03:39:36,306][106226] Updated weights for policy 0, policy_version 1169011 (0.0008) [2023-12-28 03:39:36,639][106225] Updated weights for policy 1, policy_version 1172010 (0.0010) [2023-12-28 03:39:36,699][106225] Updated weights for policy 1, policy_version 1172020 (0.0010) [2023-12-28 03:39:36,761][106225] Updated weights for policy 1, policy_version 1172030 (0.0010) [2023-12-28 03:39:36,817][106225] Updated weights for policy 1, policy_version 1172040 (0.0010) [2023-12-28 03:39:37,018][106226] Updated weights for policy 0, policy_version 1169021 (0.0008) [2023-12-28 03:39:37,072][106226] Updated weights for policy 0, policy_version 1169031 (0.0008) [2023-12-28 03:39:37,131][106226] Updated weights for policy 0, policy_version 1169041 (0.0008) [2023-12-28 03:39:37,533][106225] Updated weights for policy 1, policy_version 1172050 (0.0010) [2023-12-28 03:39:37,590][106225] Updated weights for policy 1, policy_version 1172060 (0.0010) [2023-12-28 03:39:37,644][106225] Updated weights for policy 1, policy_version 1172070 (0.0010) [2023-12-28 03:39:37,848][106226] Updated weights for policy 0, policy_version 1169051 (0.0009) [2023-12-28 03:39:37,913][106226] Updated weights for policy 0, policy_version 1169061 (0.0011) [2023-12-28 03:39:37,968][106226] Updated weights for policy 0, policy_version 1169071 (0.0010) [2023-12-28 03:39:38,378][106225] Updated weights for policy 1, policy_version 1172080 (0.0009) [2023-12-28 03:39:38,438][106225] Updated weights for policy 1, policy_version 1172090 (0.0008) [2023-12-28 03:39:38,500][106225] Updated weights for policy 1, policy_version 1172100 (0.0008) [2023-12-28 03:39:38,669][106226] Updated weights for policy 0, policy_version 1169081 (0.0010) [2023-12-28 03:39:38,740][106226] Updated weights for policy 0, policy_version 1169091 (0.0006) [2023-12-28 03:39:38,808][106226] Updated weights for policy 0, policy_version 1169101 (0.0005) [2023-12-28 03:39:38,872][106226] Updated weights for policy 0, policy_version 1169111 (0.0008) [2023-12-28 03:39:39,146][106225] Updated weights for policy 1, policy_version 1172110 (0.0008) [2023-12-28 03:39:39,194][106225] Updated weights for policy 1, policy_version 1172120 (0.0006) [2023-12-28 03:39:39,256][106225] Updated weights for policy 1, policy_version 1172130 (0.0009) [2023-12-28 03:39:39,576][106226] Updated weights for policy 0, policy_version 1169121 (0.0008) [2023-12-28 03:39:39,633][106226] Updated weights for policy 0, policy_version 1169131 (0.0009) [2023-12-28 03:39:39,690][106226] Updated weights for policy 0, policy_version 1169141 (0.0009) [2023-12-28 03:39:40,088][106225] Updated weights for policy 1, policy_version 1172140 (0.0009) [2023-12-28 03:39:40,146][106225] Updated weights for policy 1, policy_version 1172150 (0.0008) [2023-12-28 03:39:40,194][106225] Updated weights for policy 1, policy_version 1172160 (0.0011) [2023-12-28 03:39:40,456][106226] Updated weights for policy 0, policy_version 1169151 (0.0008) [2023-12-28 03:39:40,510][106226] Updated weights for policy 0, policy_version 1169161 (0.0010) [2023-12-28 03:39:40,558][106226] Updated weights for policy 0, policy_version 1169171 (0.0008) [2023-12-28 03:39:40,822][106225] Updated weights for policy 1, policy_version 1172170 (0.0009) [2023-12-28 03:39:40,881][106225] Updated weights for policy 1, policy_version 1172180 (0.0009) [2023-12-28 03:39:40,927][106225] Updated weights for policy 1, policy_version 1172190 (0.0010) [2023-12-28 03:39:40,992][106225] Updated weights for policy 1, policy_version 1172200 (0.0010) [2023-12-28 03:39:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 599498752. Throughput: 0: 10266.0, 1: 10118.2. Samples: 599467652. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:41,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-4.989')] [2023-12-28 03:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001172200_300130304.pth... [2023-12-28 03:39:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001169176_299368448.pth... [2023-12-28 03:39:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001170984_299819008.pth [2023-12-28 03:39:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001167992_299065344.pth [2023-12-28 03:39:41,392][106226] Updated weights for policy 0, policy_version 1169181 (0.0010) [2023-12-28 03:39:41,455][106226] Updated weights for policy 0, policy_version 1169191 (0.0009) [2023-12-28 03:39:41,521][106226] Updated weights for policy 0, policy_version 1169201 (0.0009) [2023-12-28 03:39:41,722][106225] Updated weights for policy 1, policy_version 1172210 (0.0009) [2023-12-28 03:39:41,778][106225] Updated weights for policy 1, policy_version 1172220 (0.0010) [2023-12-28 03:39:41,836][106225] Updated weights for policy 1, policy_version 1172230 (0.0010) [2023-12-28 03:39:42,255][106226] Updated weights for policy 0, policy_version 1169211 (0.0008) [2023-12-28 03:39:42,323][106226] Updated weights for policy 0, policy_version 1169221 (0.0007) [2023-12-28 03:39:42,394][106226] Updated weights for policy 0, policy_version 1169231 (0.0010) [2023-12-28 03:39:42,577][106225] Updated weights for policy 1, policy_version 1172240 (0.0009) [2023-12-28 03:39:42,642][106225] Updated weights for policy 1, policy_version 1172250 (0.0008) [2023-12-28 03:39:42,706][106225] Updated weights for policy 1, policy_version 1172260 (0.0005) [2023-12-28 03:39:43,079][106226] Updated weights for policy 0, policy_version 1169241 (0.0011) [2023-12-28 03:39:43,137][106226] Updated weights for policy 0, policy_version 1169251 (0.0008) [2023-12-28 03:39:43,188][106226] Updated weights for policy 0, policy_version 1169261 (0.0007) [2023-12-28 03:39:43,240][106226] Updated weights for policy 0, policy_version 1169271 (0.0010) [2023-12-28 03:39:43,418][106225] Updated weights for policy 1, policy_version 1172270 (0.0009) [2023-12-28 03:39:43,488][106225] Updated weights for policy 1, policy_version 1172280 (0.0010) [2023-12-28 03:39:43,553][106225] Updated weights for policy 1, policy_version 1172290 (0.0007) [2023-12-28 03:39:43,862][106226] Updated weights for policy 0, policy_version 1169281 (0.0011) [2023-12-28 03:39:43,920][106226] Updated weights for policy 0, policy_version 1169291 (0.0009) [2023-12-28 03:39:43,976][106226] Updated weights for policy 0, policy_version 1169301 (0.0007) [2023-12-28 03:39:44,150][106225] Updated weights for policy 1, policy_version 1172300 (0.0008) [2023-12-28 03:39:44,212][106225] Updated weights for policy 1, policy_version 1172310 (0.0009) [2023-12-28 03:39:44,274][106225] Updated weights for policy 1, policy_version 1172320 (0.0010) [2023-12-28 03:39:44,634][106226] Updated weights for policy 0, policy_version 1169311 (0.0009) [2023-12-28 03:39:44,694][106226] Updated weights for policy 0, policy_version 1169321 (0.0007) [2023-12-28 03:39:44,758][106226] Updated weights for policy 0, policy_version 1169331 (0.0008) [2023-12-28 03:39:44,980][106225] Updated weights for policy 1, policy_version 1172330 (0.0010) [2023-12-28 03:39:45,041][106225] Updated weights for policy 1, policy_version 1172340 (0.0011) [2023-12-28 03:39:45,102][106225] Updated weights for policy 1, policy_version 1172350 (0.0010) [2023-12-28 03:39:45,162][106225] Updated weights for policy 1, policy_version 1172360 (0.0010) [2023-12-28 03:39:45,495][106226] Updated weights for policy 0, policy_version 1169341 (0.0008) [2023-12-28 03:39:45,551][106226] Updated weights for policy 0, policy_version 1169351 (0.0008) [2023-12-28 03:39:45,606][106226] Updated weights for policy 0, policy_version 1169361 (0.0008) [2023-12-28 03:39:45,870][106225] Updated weights for policy 1, policy_version 1172370 (0.0010) [2023-12-28 03:39:45,919][106225] Updated weights for policy 1, policy_version 1172380 (0.0010) [2023-12-28 03:39:45,972][106225] Updated weights for policy 1, policy_version 1172390 (0.0010) [2023-12-28 03:39:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 599597056. Throughput: 0: 10173.3, 1: 10177.0. Samples: 599585416. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:46,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-5.071')] [2023-12-28 03:39:46,370][106226] Updated weights for policy 0, policy_version 1169371 (0.0008) [2023-12-28 03:39:46,421][106226] Updated weights for policy 0, policy_version 1169381 (0.0008) [2023-12-28 03:39:46,468][106226] Updated weights for policy 0, policy_version 1169391 (0.0007) [2023-12-28 03:39:46,698][106225] Updated weights for policy 1, policy_version 1172400 (0.0010) [2023-12-28 03:39:46,755][106225] Updated weights for policy 1, policy_version 1172410 (0.0010) [2023-12-28 03:39:46,805][106225] Updated weights for policy 1, policy_version 1172420 (0.0010) [2023-12-28 03:39:47,249][106226] Updated weights for policy 0, policy_version 1169401 (0.0008) [2023-12-28 03:39:47,298][106226] Updated weights for policy 0, policy_version 1169411 (0.0008) [2023-12-28 03:39:47,345][106226] Updated weights for policy 0, policy_version 1169421 (0.0008) [2023-12-28 03:39:47,401][106225] Updated weights for policy 1, policy_version 1172430 (0.0010) [2023-12-28 03:39:47,403][106226] Updated weights for policy 0, policy_version 1169431 (0.0006) [2023-12-28 03:39:47,453][106225] Updated weights for policy 1, policy_version 1172440 (0.0010) [2023-12-28 03:39:47,499][106225] Updated weights for policy 1, policy_version 1172450 (0.0010) [2023-12-28 03:39:48,107][106225] Updated weights for policy 1, policy_version 1172460 (0.0008) [2023-12-28 03:39:48,162][106226] Updated weights for policy 0, policy_version 1169441 (0.0006) [2023-12-28 03:39:48,169][106225] Updated weights for policy 1, policy_version 1172470 (0.0005) [2023-12-28 03:39:48,222][106226] Updated weights for policy 0, policy_version 1169451 (0.0006) [2023-12-28 03:39:48,226][106225] Updated weights for policy 1, policy_version 1172480 (0.0005) [2023-12-28 03:39:48,284][106226] Updated weights for policy 0, policy_version 1169461 (0.0008) [2023-12-28 03:39:48,893][106225] Updated weights for policy 1, policy_version 1172490 (0.0006) [2023-12-28 03:39:48,944][106225] Updated weights for policy 1, policy_version 1172500 (0.0010) [2023-12-28 03:39:48,985][106226] Updated weights for policy 0, policy_version 1169471 (0.0007) [2023-12-28 03:39:49,002][106225] Updated weights for policy 1, policy_version 1172510 (0.0011) [2023-12-28 03:39:49,043][106226] Updated weights for policy 0, policy_version 1169481 (0.0006) [2023-12-28 03:39:49,063][106225] Updated weights for policy 1, policy_version 1172520 (0.0010) [2023-12-28 03:39:49,093][106226] Updated weights for policy 0, policy_version 1169491 (0.0008) [2023-12-28 03:39:49,801][106225] Updated weights for policy 1, policy_version 1172530 (0.0009) [2023-12-28 03:39:49,847][106226] Updated weights for policy 0, policy_version 1169501 (0.0007) [2023-12-28 03:39:49,870][106225] Updated weights for policy 1, policy_version 1172540 (0.0012) [2023-12-28 03:39:49,908][106226] Updated weights for policy 0, policy_version 1169511 (0.0008) [2023-12-28 03:39:49,941][106225] Updated weights for policy 1, policy_version 1172550 (0.0008) [2023-12-28 03:39:49,974][106226] Updated weights for policy 0, policy_version 1169521 (0.0006) [2023-12-28 03:39:50,652][106226] Updated weights for policy 0, policy_version 1169531 (0.0007) [2023-12-28 03:39:50,674][106225] Updated weights for policy 1, policy_version 1172560 (0.0007) [2023-12-28 03:39:50,716][106226] Updated weights for policy 0, policy_version 1169541 (0.0007) [2023-12-28 03:39:50,734][106225] Updated weights for policy 1, policy_version 1172570 (0.0006) [2023-12-28 03:39:50,783][106226] Updated weights for policy 0, policy_version 1169551 (0.0008) [2023-12-28 03:39:50,793][106225] Updated weights for policy 1, policy_version 1172580 (0.0006) [2023-12-28 03:39:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 599695360. Throughput: 0: 10025.2, 1: 10126.5. Samples: 599702220. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:51,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-4.659')] [2023-12-28 03:39:51,576][106226] Updated weights for policy 0, policy_version 1169561 (0.0008) [2023-12-28 03:39:51,583][106225] Updated weights for policy 1, policy_version 1172590 (0.0006) [2023-12-28 03:39:51,651][106225] Updated weights for policy 1, policy_version 1172600 (0.0006) [2023-12-28 03:39:51,651][106226] Updated weights for policy 0, policy_version 1169571 (0.0011) [2023-12-28 03:39:51,707][106225] Updated weights for policy 1, policy_version 1172610 (0.0007) [2023-12-28 03:39:51,713][106226] Updated weights for policy 0, policy_version 1169581 (0.0011) [2023-12-28 03:39:51,780][106226] Updated weights for policy 0, policy_version 1169591 (0.0009) [2023-12-28 03:39:52,387][106225] Updated weights for policy 1, policy_version 1172620 (0.0008) [2023-12-28 03:39:52,441][106225] Updated weights for policy 1, policy_version 1172630 (0.0008) [2023-12-28 03:39:52,496][106225] Updated weights for policy 1, policy_version 1172640 (0.0008) [2023-12-28 03:39:52,506][106226] Updated weights for policy 0, policy_version 1169601 (0.0011) [2023-12-28 03:39:52,574][106226] Updated weights for policy 0, policy_version 1169611 (0.0011) [2023-12-28 03:39:52,639][106226] Updated weights for policy 0, policy_version 1169621 (0.0011) [2023-12-28 03:39:53,258][106225] Updated weights for policy 1, policy_version 1172650 (0.0008) [2023-12-28 03:39:53,314][106225] Updated weights for policy 1, policy_version 1172660 (0.0008) [2023-12-28 03:39:53,323][106226] Updated weights for policy 0, policy_version 1169631 (0.0008) [2023-12-28 03:39:53,371][106225] Updated weights for policy 1, policy_version 1172670 (0.0008) [2023-12-28 03:39:53,380][106226] Updated weights for policy 0, policy_version 1169641 (0.0007) [2023-12-28 03:39:53,426][106225] Updated weights for policy 1, policy_version 1172680 (0.0005) [2023-12-28 03:39:53,433][106226] Updated weights for policy 0, policy_version 1169651 (0.0007) [2023-12-28 03:39:53,985][106225] Updated weights for policy 1, policy_version 1172690 (0.0006) [2023-12-28 03:39:54,052][106225] Updated weights for policy 1, policy_version 1172700 (0.0005) [2023-12-28 03:39:54,091][106226] Updated weights for policy 0, policy_version 1169661 (0.0007) [2023-12-28 03:39:54,115][106225] Updated weights for policy 1, policy_version 1172710 (0.0008) [2023-12-28 03:39:54,148][106226] Updated weights for policy 0, policy_version 1169671 (0.0005) [2023-12-28 03:39:54,212][106226] Updated weights for policy 0, policy_version 1169681 (0.0006) [2023-12-28 03:39:54,738][106225] Updated weights for policy 1, policy_version 1172720 (0.0006) [2023-12-28 03:39:54,789][106225] Updated weights for policy 1, policy_version 1172730 (0.0005) [2023-12-28 03:39:54,848][106226] Updated weights for policy 0, policy_version 1169691 (0.0006) [2023-12-28 03:39:54,850][106225] Updated weights for policy 1, policy_version 1172740 (0.0005) [2023-12-28 03:39:54,903][106226] Updated weights for policy 0, policy_version 1169701 (0.0005) [2023-12-28 03:39:54,958][106226] Updated weights for policy 0, policy_version 1169711 (0.0006) [2023-12-28 03:39:55,418][106225] Updated weights for policy 1, policy_version 1172750 (0.0006) [2023-12-28 03:39:55,470][106225] Updated weights for policy 1, policy_version 1172760 (0.0008) [2023-12-28 03:39:55,531][106225] Updated weights for policy 1, policy_version 1172770 (0.0008) [2023-12-28 03:39:55,565][106226] Updated weights for policy 0, policy_version 1169721 (0.0008) [2023-12-28 03:39:55,615][106226] Updated weights for policy 0, policy_version 1169731 (0.0005) [2023-12-28 03:39:55,665][106226] Updated weights for policy 0, policy_version 1169741 (0.0005) [2023-12-28 03:39:55,721][106226] Updated weights for policy 0, policy_version 1169751 (0.0005) [2023-12-28 03:39:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 599793664. Throughput: 0: 9989.7, 1: 10128.9. Samples: 599760380. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:39:56,176][105115] Avg episode reward: [(0, '-4.756'), (1, '-5.245')] [2023-12-28 03:39:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001169752_299515904.pth... [2023-12-28 03:39:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001172776_300277760.pth... [2023-12-28 03:39:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001168600_299220992.pth [2023-12-28 03:39:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001171592_299974656.pth [2023-12-28 03:39:56,272][106225] Updated weights for policy 1, policy_version 1172780 (0.0007) [2023-12-28 03:39:56,331][106225] Updated weights for policy 1, policy_version 1172790 (0.0009) [2023-12-28 03:39:56,348][106226] Updated weights for policy 0, policy_version 1169761 (0.0005) [2023-12-28 03:39:56,397][106225] Updated weights for policy 1, policy_version 1172800 (0.0008) [2023-12-28 03:39:56,408][106226] Updated weights for policy 0, policy_version 1169771 (0.0005) [2023-12-28 03:39:56,470][106226] Updated weights for policy 0, policy_version 1169781 (0.0007) [2023-12-28 03:39:57,098][106225] Updated weights for policy 1, policy_version 1172810 (0.0008) [2023-12-28 03:39:57,157][106225] Updated weights for policy 1, policy_version 1172820 (0.0009) [2023-12-28 03:39:57,163][106226] Updated weights for policy 0, policy_version 1169791 (0.0008) [2023-12-28 03:39:57,208][106225] Updated weights for policy 1, policy_version 1172830 (0.0007) [2023-12-28 03:39:57,218][106226] Updated weights for policy 0, policy_version 1169801 (0.0007) [2023-12-28 03:39:57,269][106225] Updated weights for policy 1, policy_version 1172840 (0.0009) [2023-12-28 03:39:57,275][106226] Updated weights for policy 0, policy_version 1169811 (0.0006) [2023-12-28 03:39:57,848][106225] Updated weights for policy 1, policy_version 1172850 (0.0008) [2023-12-28 03:39:57,898][106225] Updated weights for policy 1, policy_version 1172860 (0.0008) [2023-12-28 03:39:57,959][106225] Updated weights for policy 1, policy_version 1172870 (0.0008) [2023-12-28 03:39:57,987][106226] Updated weights for policy 0, policy_version 1169821 (0.0009) [2023-12-28 03:39:58,049][106226] Updated weights for policy 0, policy_version 1169831 (0.0008) [2023-12-28 03:39:58,110][106226] Updated weights for policy 0, policy_version 1169841 (0.0008) [2023-12-28 03:39:58,730][106225] Updated weights for policy 1, policy_version 1172880 (0.0007) [2023-12-28 03:39:58,792][106225] Updated weights for policy 1, policy_version 1172890 (0.0008) [2023-12-28 03:39:58,859][106225] Updated weights for policy 1, policy_version 1172900 (0.0008) [2023-12-28 03:39:58,966][106226] Updated weights for policy 0, policy_version 1169851 (0.0008) [2023-12-28 03:39:59,028][106226] Updated weights for policy 0, policy_version 1169861 (0.0008) [2023-12-28 03:39:59,090][106226] Updated weights for policy 0, policy_version 1169871 (0.0008) [2023-12-28 03:39:59,611][106225] Updated weights for policy 1, policy_version 1172910 (0.0008) [2023-12-28 03:39:59,668][106225] Updated weights for policy 1, policy_version 1172920 (0.0008) [2023-12-28 03:39:59,724][106225] Updated weights for policy 1, policy_version 1172930 (0.0009) [2023-12-28 03:39:59,835][106226] Updated weights for policy 0, policy_version 1169881 (0.0006) [2023-12-28 03:39:59,905][106226] Updated weights for policy 0, policy_version 1169891 (0.0007) [2023-12-28 03:39:59,968][106226] Updated weights for policy 0, policy_version 1169901 (0.0009) [2023-12-28 03:40:00,029][106226] Updated weights for policy 0, policy_version 1169911 (0.0010) [2023-12-28 03:40:00,536][106225] Updated weights for policy 1, policy_version 1172940 (0.0008) [2023-12-28 03:40:00,583][106225] Updated weights for policy 1, policy_version 1172950 (0.0007) [2023-12-28 03:40:00,633][106225] Updated weights for policy 1, policy_version 1172960 (0.0007) [2023-12-28 03:40:00,660][106226] Updated weights for policy 0, policy_version 1169921 (0.0007) [2023-12-28 03:40:00,717][106226] Updated weights for policy 0, policy_version 1169931 (0.0009) [2023-12-28 03:40:00,769][106226] Updated weights for policy 0, policy_version 1169941 (0.0008) [2023-12-28 03:40:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 599891968. Throughput: 0: 9963.4, 1: 10111.0. Samples: 599880992. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:01,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-5.075')] [2023-12-28 03:40:01,262][106225] Updated weights for policy 1, policy_version 1172970 (0.0005) [2023-12-28 03:40:01,316][106225] Updated weights for policy 1, policy_version 1172980 (0.0009) [2023-12-28 03:40:01,369][106225] Updated weights for policy 1, policy_version 1172990 (0.0008) [2023-12-28 03:40:01,431][106225] Updated weights for policy 1, policy_version 1173000 (0.0007) [2023-12-28 03:40:01,492][106226] Updated weights for policy 0, policy_version 1169951 (0.0009) [2023-12-28 03:40:01,549][106226] Updated weights for policy 0, policy_version 1169961 (0.0009) [2023-12-28 03:40:01,613][106226] Updated weights for policy 0, policy_version 1169971 (0.0009) [2023-12-28 03:40:02,181][106225] Updated weights for policy 1, policy_version 1173010 (0.0008) [2023-12-28 03:40:02,234][106225] Updated weights for policy 1, policy_version 1173020 (0.0008) [2023-12-28 03:40:02,295][106225] Updated weights for policy 1, policy_version 1173030 (0.0008) [2023-12-28 03:40:02,359][106226] Updated weights for policy 0, policy_version 1169981 (0.0009) [2023-12-28 03:40:02,420][106226] Updated weights for policy 0, policy_version 1169991 (0.0008) [2023-12-28 03:40:02,476][106226] Updated weights for policy 0, policy_version 1170001 (0.0007) [2023-12-28 03:40:03,054][106225] Updated weights for policy 1, policy_version 1173040 (0.0008) [2023-12-28 03:40:03,103][106225] Updated weights for policy 1, policy_version 1173050 (0.0008) [2023-12-28 03:40:03,147][106225] Updated weights for policy 1, policy_version 1173060 (0.0009) [2023-12-28 03:40:03,195][106226] Updated weights for policy 0, policy_version 1170011 (0.0008) [2023-12-28 03:40:03,240][106226] Updated weights for policy 0, policy_version 1170021 (0.0007) [2023-12-28 03:40:03,282][106226] Updated weights for policy 0, policy_version 1170031 (0.0005) [2023-12-28 03:40:03,815][106226] Updated weights for policy 0, policy_version 1170041 (0.0005) [2023-12-28 03:40:03,883][106226] Updated weights for policy 0, policy_version 1170051 (0.0007) [2023-12-28 03:40:03,948][106226] Updated weights for policy 0, policy_version 1170061 (0.0007) [2023-12-28 03:40:03,992][106225] Updated weights for policy 1, policy_version 1173070 (0.0009) [2023-12-28 03:40:04,006][106226] Updated weights for policy 0, policy_version 1170071 (0.0006) [2023-12-28 03:40:04,050][106225] Updated weights for policy 1, policy_version 1173080 (0.0007) [2023-12-28 03:40:04,106][106225] Updated weights for policy 1, policy_version 1173090 (0.0007) [2023-12-28 03:40:04,697][106225] Updated weights for policy 1, policy_version 1173100 (0.0007) [2023-12-28 03:40:04,748][106225] Updated weights for policy 1, policy_version 1173110 (0.0006) [2023-12-28 03:40:04,750][106226] Updated weights for policy 0, policy_version 1170081 (0.0007) [2023-12-28 03:40:04,806][106226] Updated weights for policy 0, policy_version 1170091 (0.0008) [2023-12-28 03:40:04,806][106225] Updated weights for policy 1, policy_version 1173120 (0.0007) [2023-12-28 03:40:04,874][106226] Updated weights for policy 0, policy_version 1170101 (0.0008) [2023-12-28 03:40:05,465][106225] Updated weights for policy 1, policy_version 1173130 (0.0006) [2023-12-28 03:40:05,519][106225] Updated weights for policy 1, policy_version 1173140 (0.0005) [2023-12-28 03:40:05,580][106225] Updated weights for policy 1, policy_version 1173150 (0.0005) [2023-12-28 03:40:05,638][106225] Updated weights for policy 1, policy_version 1173160 (0.0008) [2023-12-28 03:40:05,682][106226] Updated weights for policy 0, policy_version 1170111 (0.0007) [2023-12-28 03:40:05,752][106226] Updated weights for policy 0, policy_version 1170121 (0.0005) [2023-12-28 03:40:05,825][106226] Updated weights for policy 0, policy_version 1170131 (0.0005) [2023-12-28 03:40:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 599990272. Throughput: 0: 9984.6, 1: 10060.0. Samples: 600001192. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:06,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.033')] [2023-12-28 03:40:06,335][106225] Updated weights for policy 1, policy_version 1173170 (0.0006) [2023-12-28 03:40:06,356][106226] Updated weights for policy 0, policy_version 1170141 (0.0006) [2023-12-28 03:40:06,401][106225] Updated weights for policy 1, policy_version 1173180 (0.0006) [2023-12-28 03:40:06,426][106226] Updated weights for policy 0, policy_version 1170151 (0.0007) [2023-12-28 03:40:06,468][106225] Updated weights for policy 1, policy_version 1173190 (0.0006) [2023-12-28 03:40:06,492][106226] Updated weights for policy 0, policy_version 1170161 (0.0008) [2023-12-28 03:40:07,056][106225] Updated weights for policy 1, policy_version 1173200 (0.0009) [2023-12-28 03:40:07,118][106225] Updated weights for policy 1, policy_version 1173210 (0.0011) [2023-12-28 03:40:07,169][106226] Updated weights for policy 0, policy_version 1170171 (0.0008) [2023-12-28 03:40:07,175][106225] Updated weights for policy 1, policy_version 1173220 (0.0010) [2023-12-28 03:40:07,221][106226] Updated weights for policy 0, policy_version 1170181 (0.0005) [2023-12-28 03:40:07,276][106226] Updated weights for policy 0, policy_version 1170191 (0.0005) [2023-12-28 03:40:07,912][106225] Updated weights for policy 1, policy_version 1173230 (0.0007) [2023-12-28 03:40:07,931][106226] Updated weights for policy 0, policy_version 1170201 (0.0006) [2023-12-28 03:40:07,971][106225] Updated weights for policy 1, policy_version 1173240 (0.0006) [2023-12-28 03:40:07,991][106226] Updated weights for policy 0, policy_version 1170211 (0.0006) [2023-12-28 03:40:08,030][106225] Updated weights for policy 1, policy_version 1173250 (0.0009) [2023-12-28 03:40:08,041][106226] Updated weights for policy 0, policy_version 1170221 (0.0006) [2023-12-28 03:40:08,092][106226] Updated weights for policy 0, policy_version 1170231 (0.0006) [2023-12-28 03:40:08,731][106225] Updated weights for policy 1, policy_version 1173260 (0.0010) [2023-12-28 03:40:08,781][106225] Updated weights for policy 1, policy_version 1173270 (0.0010) [2023-12-28 03:40:08,815][106226] Updated weights for policy 0, policy_version 1170241 (0.0008) [2023-12-28 03:40:08,831][106225] Updated weights for policy 1, policy_version 1173280 (0.0007) [2023-12-28 03:40:08,880][106226] Updated weights for policy 0, policy_version 1170251 (0.0009) [2023-12-28 03:40:08,943][106226] Updated weights for policy 0, policy_version 1170261 (0.0010) [2023-12-28 03:40:09,413][106225] Updated weights for policy 1, policy_version 1173290 (0.0006) [2023-12-28 03:40:09,482][106225] Updated weights for policy 1, policy_version 1173300 (0.0011) [2023-12-28 03:40:09,543][106225] Updated weights for policy 1, policy_version 1173310 (0.0010) [2023-12-28 03:40:09,608][106225] Updated weights for policy 1, policy_version 1173320 (0.0005) [2023-12-28 03:40:09,776][106226] Updated weights for policy 0, policy_version 1170271 (0.0010) [2023-12-28 03:40:09,843][106226] Updated weights for policy 0, policy_version 1170281 (0.0009) [2023-12-28 03:40:09,897][106226] Updated weights for policy 0, policy_version 1170291 (0.0008) [2023-12-28 03:40:10,317][106225] Updated weights for policy 1, policy_version 1173330 (0.0007) [2023-12-28 03:40:10,372][106225] Updated weights for policy 1, policy_version 1173340 (0.0008) [2023-12-28 03:40:10,434][106225] Updated weights for policy 1, policy_version 1173350 (0.0008) [2023-12-28 03:40:10,596][106226] Updated weights for policy 0, policy_version 1170301 (0.0008) [2023-12-28 03:40:10,661][106226] Updated weights for policy 0, policy_version 1170311 (0.0005) [2023-12-28 03:40:10,726][106226] Updated weights for policy 0, policy_version 1170321 (0.0008) [2023-12-28 03:40:11,130][106225] Updated weights for policy 1, policy_version 1173360 (0.0006) [2023-12-28 03:40:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 600088576. Throughput: 0: 9970.4, 1: 10103.7. Samples: 600061340. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:11,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-4.742')] [2023-12-28 03:40:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001170328_299663360.pth... [2023-12-28 03:40:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001169176_299368448.pth [2023-12-28 03:40:11,204][106225] Updated weights for policy 1, policy_version 1173370 (0.0007) [2023-12-28 03:40:11,265][106225] Updated weights for policy 1, policy_version 1173380 (0.0008) [2023-12-28 03:40:11,290][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001173384_300433408.pth... [2023-12-28 03:40:11,293][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001172200_300130304.pth [2023-12-28 03:40:11,388][106226] Updated weights for policy 0, policy_version 1170331 (0.0010) [2023-12-28 03:40:11,458][106226] Updated weights for policy 0, policy_version 1170341 (0.0008) [2023-12-28 03:40:11,518][106226] Updated weights for policy 0, policy_version 1170351 (0.0008) [2023-12-28 03:40:11,986][106225] Updated weights for policy 1, policy_version 1173390 (0.0009) [2023-12-28 03:40:12,051][106225] Updated weights for policy 1, policy_version 1173400 (0.0009) [2023-12-28 03:40:12,112][106225] Updated weights for policy 1, policy_version 1173410 (0.0008) [2023-12-28 03:40:12,263][106226] Updated weights for policy 0, policy_version 1170361 (0.0008) [2023-12-28 03:40:12,329][106226] Updated weights for policy 0, policy_version 1170371 (0.0008) [2023-12-28 03:40:12,399][106226] Updated weights for policy 0, policy_version 1170381 (0.0009) [2023-12-28 03:40:12,450][106226] Updated weights for policy 0, policy_version 1170391 (0.0008) [2023-12-28 03:40:12,841][106225] Updated weights for policy 1, policy_version 1173420 (0.0009) [2023-12-28 03:40:12,893][106225] Updated weights for policy 1, policy_version 1173430 (0.0009) [2023-12-28 03:40:12,948][106225] Updated weights for policy 1, policy_version 1173440 (0.0009) [2023-12-28 03:40:13,148][106226] Updated weights for policy 0, policy_version 1170401 (0.0010) [2023-12-28 03:40:13,205][106226] Updated weights for policy 0, policy_version 1170411 (0.0011) [2023-12-28 03:40:13,254][106226] Updated weights for policy 0, policy_version 1170421 (0.0010) [2023-12-28 03:40:13,719][106225] Updated weights for policy 1, policy_version 1173450 (0.0009) [2023-12-28 03:40:13,778][106225] Updated weights for policy 1, policy_version 1173460 (0.0009) [2023-12-28 03:40:13,828][106225] Updated weights for policy 1, policy_version 1173470 (0.0009) [2023-12-28 03:40:13,881][106225] Updated weights for policy 1, policy_version 1173480 (0.0007) [2023-12-28 03:40:13,931][106226] Updated weights for policy 0, policy_version 1170431 (0.0007) [2023-12-28 03:40:13,985][106226] Updated weights for policy 0, policy_version 1170441 (0.0005) [2023-12-28 03:40:14,035][106226] Updated weights for policy 0, policy_version 1170451 (0.0005) [2023-12-28 03:40:14,620][106226] Updated weights for policy 0, policy_version 1170461 (0.0005) [2023-12-28 03:40:14,676][106226] Updated weights for policy 0, policy_version 1170471 (0.0009) [2023-12-28 03:40:14,681][106225] Updated weights for policy 1, policy_version 1173490 (0.0007) [2023-12-28 03:40:14,739][106225] Updated weights for policy 1, policy_version 1173500 (0.0006) [2023-12-28 03:40:14,740][106226] Updated weights for policy 0, policy_version 1170481 (0.0011) [2023-12-28 03:40:14,808][106225] Updated weights for policy 1, policy_version 1173510 (0.0008) [2023-12-28 03:40:15,455][106226] Updated weights for policy 0, policy_version 1170491 (0.0010) [2023-12-28 03:40:15,506][106226] Updated weights for policy 0, policy_version 1170501 (0.0011) [2023-12-28 03:40:15,556][106226] Updated weights for policy 0, policy_version 1170511 (0.0010) [2023-12-28 03:40:15,578][106225] Updated weights for policy 1, policy_version 1173520 (0.0008) [2023-12-28 03:40:15,635][106225] Updated weights for policy 1, policy_version 1173530 (0.0010) [2023-12-28 03:40:15,690][106225] Updated weights for policy 1, policy_version 1173540 (0.0008) [2023-12-28 03:40:16,134][106226] Updated weights for policy 0, policy_version 1170521 (0.0006) [2023-12-28 03:40:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 600186880. Throughput: 0: 9891.1, 1: 9924.2. Samples: 600178956. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:16,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.687')] [2023-12-28 03:40:16,199][106226] Updated weights for policy 0, policy_version 1170531 (0.0011) [2023-12-28 03:40:16,261][106226] Updated weights for policy 0, policy_version 1170541 (0.0010) [2023-12-28 03:40:16,317][106226] Updated weights for policy 0, policy_version 1170551 (0.0010) [2023-12-28 03:40:16,479][106225] Updated weights for policy 1, policy_version 1173550 (0.0008) [2023-12-28 03:40:16,534][106225] Updated weights for policy 1, policy_version 1173560 (0.0007) [2023-12-28 03:40:16,600][106225] Updated weights for policy 1, policy_version 1173570 (0.0007) [2023-12-28 03:40:16,970][106226] Updated weights for policy 0, policy_version 1170561 (0.0006) [2023-12-28 03:40:17,016][106226] Updated weights for policy 0, policy_version 1170571 (0.0005) [2023-12-28 03:40:17,064][106226] Updated weights for policy 0, policy_version 1170581 (0.0008) [2023-12-28 03:40:17,336][106225] Updated weights for policy 1, policy_version 1173580 (0.0006) [2023-12-28 03:40:17,383][106225] Updated weights for policy 1, policy_version 1173590 (0.0008) [2023-12-28 03:40:17,438][106225] Updated weights for policy 1, policy_version 1173600 (0.0009) [2023-12-28 03:40:17,712][106226] Updated weights for policy 0, policy_version 1170591 (0.0006) [2023-12-28 03:40:17,777][106226] Updated weights for policy 0, policy_version 1170601 (0.0005) [2023-12-28 03:40:17,841][106226] Updated weights for policy 0, policy_version 1170611 (0.0005) [2023-12-28 03:40:18,064][106225] Updated weights for policy 1, policy_version 1173610 (0.0009) [2023-12-28 03:40:18,113][106225] Updated weights for policy 1, policy_version 1173620 (0.0005) [2023-12-28 03:40:18,162][106225] Updated weights for policy 1, policy_version 1173630 (0.0005) [2023-12-28 03:40:18,222][106225] Updated weights for policy 1, policy_version 1173640 (0.0009) [2023-12-28 03:40:18,419][106226] Updated weights for policy 0, policy_version 1170621 (0.0006) [2023-12-28 03:40:18,479][106226] Updated weights for policy 0, policy_version 1170631 (0.0006) [2023-12-28 03:40:18,534][106226] Updated weights for policy 0, policy_version 1170641 (0.0007) [2023-12-28 03:40:18,879][106225] Updated weights for policy 1, policy_version 1173650 (0.0010) [2023-12-28 03:40:18,940][106225] Updated weights for policy 1, policy_version 1173660 (0.0010) [2023-12-28 03:40:19,007][106225] Updated weights for policy 1, policy_version 1173670 (0.0010) [2023-12-28 03:40:19,088][106226] Updated weights for policy 0, policy_version 1170651 (0.0005) [2023-12-28 03:40:19,137][106226] Updated weights for policy 0, policy_version 1170661 (0.0006) [2023-12-28 03:40:19,187][106226] Updated weights for policy 0, policy_version 1170671 (0.0008) [2023-12-28 03:40:19,741][106225] Updated weights for policy 1, policy_version 1173680 (0.0010) [2023-12-28 03:40:19,807][106225] Updated weights for policy 1, policy_version 1173690 (0.0011) [2023-12-28 03:40:19,867][106225] Updated weights for policy 1, policy_version 1173700 (0.0010) [2023-12-28 03:40:19,940][106226] Updated weights for policy 0, policy_version 1170681 (0.0007) [2023-12-28 03:40:20,004][106226] Updated weights for policy 0, policy_version 1170691 (0.0007) [2023-12-28 03:40:20,066][106226] Updated weights for policy 0, policy_version 1170701 (0.0006) [2023-12-28 03:40:20,131][106226] Updated weights for policy 0, policy_version 1170711 (0.0008) [2023-12-28 03:40:20,620][106225] Updated weights for policy 1, policy_version 1173710 (0.0008) [2023-12-28 03:40:20,686][106225] Updated weights for policy 1, policy_version 1173720 (0.0010) [2023-12-28 03:40:20,752][106225] Updated weights for policy 1, policy_version 1173730 (0.0008) [2023-12-28 03:40:20,887][106226] Updated weights for policy 0, policy_version 1170721 (0.0008) [2023-12-28 03:40:20,953][106226] Updated weights for policy 0, policy_version 1170731 (0.0008) [2023-12-28 03:40:21,017][106226] Updated weights for policy 0, policy_version 1170741 (0.0008) [2023-12-28 03:40:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 600293376. Throughput: 0: 9890.0, 1: 9873.2. Samples: 600299068. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:21,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-5.057')] [2023-12-28 03:40:21,542][106225] Updated weights for policy 1, policy_version 1173740 (0.0008) [2023-12-28 03:40:21,608][106225] Updated weights for policy 1, policy_version 1173750 (0.0009) [2023-12-28 03:40:21,681][106225] Updated weights for policy 1, policy_version 1173760 (0.0009) [2023-12-28 03:40:21,744][106226] Updated weights for policy 0, policy_version 1170751 (0.0008) [2023-12-28 03:40:21,807][106226] Updated weights for policy 0, policy_version 1170761 (0.0009) [2023-12-28 03:40:21,865][106226] Updated weights for policy 0, policy_version 1170771 (0.0009) [2023-12-28 03:40:22,407][106225] Updated weights for policy 1, policy_version 1173770 (0.0008) [2023-12-28 03:40:22,466][106225] Updated weights for policy 1, policy_version 1173780 (0.0008) [2023-12-28 03:40:22,519][106225] Updated weights for policy 1, policy_version 1173790 (0.0009) [2023-12-28 03:40:22,577][106225] Updated weights for policy 1, policy_version 1173800 (0.0007) [2023-12-28 03:40:22,632][106226] Updated weights for policy 0, policy_version 1170781 (0.0010) [2023-12-28 03:40:22,702][106226] Updated weights for policy 0, policy_version 1170791 (0.0009) [2023-12-28 03:40:22,761][106226] Updated weights for policy 0, policy_version 1170801 (0.0008) [2023-12-28 03:40:23,311][106225] Updated weights for policy 1, policy_version 1173810 (0.0011) [2023-12-28 03:40:23,375][106225] Updated weights for policy 1, policy_version 1173820 (0.0010) [2023-12-28 03:40:23,435][106225] Updated weights for policy 1, policy_version 1173830 (0.0010) [2023-12-28 03:40:23,449][106226] Updated weights for policy 0, policy_version 1170811 (0.0008) [2023-12-28 03:40:23,505][106226] Updated weights for policy 0, policy_version 1170821 (0.0008) [2023-12-28 03:40:23,552][106226] Updated weights for policy 0, policy_version 1170831 (0.0009) [2023-12-28 03:40:24,073][106225] Updated weights for policy 1, policy_version 1173840 (0.0007) [2023-12-28 03:40:24,120][106226] Updated weights for policy 0, policy_version 1170841 (0.0006) [2023-12-28 03:40:24,136][106225] Updated weights for policy 1, policy_version 1173850 (0.0007) [2023-12-28 03:40:24,183][106226] Updated weights for policy 0, policy_version 1170851 (0.0011) [2023-12-28 03:40:24,188][106225] Updated weights for policy 1, policy_version 1173860 (0.0005) [2023-12-28 03:40:24,247][106226] Updated weights for policy 0, policy_version 1170861 (0.0011) [2023-12-28 03:40:24,314][106226] Updated weights for policy 0, policy_version 1170871 (0.0010) [2023-12-28 03:40:24,764][106225] Updated weights for policy 1, policy_version 1173870 (0.0005) [2023-12-28 03:40:24,824][106225] Updated weights for policy 1, policy_version 1173880 (0.0008) [2023-12-28 03:40:24,879][106225] Updated weights for policy 1, policy_version 1173890 (0.0008) [2023-12-28 03:40:25,004][106226] Updated weights for policy 0, policy_version 1170881 (0.0009) [2023-12-28 03:40:25,069][106226] Updated weights for policy 0, policy_version 1170891 (0.0009) [2023-12-28 03:40:25,125][106226] Updated weights for policy 0, policy_version 1170901 (0.0008) [2023-12-28 03:40:25,480][106225] Updated weights for policy 1, policy_version 1173900 (0.0008) [2023-12-28 03:40:25,528][106225] Updated weights for policy 1, policy_version 1173910 (0.0008) [2023-12-28 03:40:25,573][106225] Updated weights for policy 1, policy_version 1173920 (0.0008) [2023-12-28 03:40:25,912][106226] Updated weights for policy 0, policy_version 1170911 (0.0010) [2023-12-28 03:40:25,970][106226] Updated weights for policy 0, policy_version 1170921 (0.0009) [2023-12-28 03:40:26,027][106226] Updated weights for policy 0, policy_version 1170931 (0.0009) [2023-12-28 03:40:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 600391680. Throughput: 0: 9921.7, 1: 9853.8. Samples: 600357548. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:26,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.997')] [2023-12-28 03:40:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001173928_300572672.pth... [2023-12-28 03:40:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001170936_299819008.pth... [2023-12-28 03:40:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001172776_300277760.pth [2023-12-28 03:40:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001169752_299515904.pth [2023-12-28 03:40:26,258][106225] Updated weights for policy 1, policy_version 1173930 (0.0008) [2023-12-28 03:40:26,327][106225] Updated weights for policy 1, policy_version 1173940 (0.0010) [2023-12-28 03:40:26,398][106225] Updated weights for policy 1, policy_version 1173950 (0.0007) [2023-12-28 03:40:26,458][106225] Updated weights for policy 1, policy_version 1173960 (0.0009) [2023-12-28 03:40:26,693][106226] Updated weights for policy 0, policy_version 1170941 (0.0009) [2023-12-28 03:40:26,749][106226] Updated weights for policy 0, policy_version 1170951 (0.0008) [2023-12-28 03:40:26,798][106226] Updated weights for policy 0, policy_version 1170961 (0.0008) [2023-12-28 03:40:27,127][106225] Updated weights for policy 1, policy_version 1173970 (0.0008) [2023-12-28 03:40:27,175][106225] Updated weights for policy 1, policy_version 1173980 (0.0008) [2023-12-28 03:40:27,231][106225] Updated weights for policy 1, policy_version 1173990 (0.0009) [2023-12-28 03:40:27,470][106226] Updated weights for policy 0, policy_version 1170971 (0.0006) [2023-12-28 03:40:27,536][106226] Updated weights for policy 0, policy_version 1170981 (0.0005) [2023-12-28 03:40:27,601][106226] Updated weights for policy 0, policy_version 1170991 (0.0006) [2023-12-28 03:40:28,000][106225] Updated weights for policy 1, policy_version 1174000 (0.0008) [2023-12-28 03:40:28,059][106225] Updated weights for policy 1, policy_version 1174010 (0.0008) [2023-12-28 03:40:28,122][106225] Updated weights for policy 1, policy_version 1174020 (0.0008) [2023-12-28 03:40:28,235][106226] Updated weights for policy 0, policy_version 1171001 (0.0006) [2023-12-28 03:40:28,281][106226] Updated weights for policy 0, policy_version 1171011 (0.0008) [2023-12-28 03:40:28,329][106226] Updated weights for policy 0, policy_version 1171021 (0.0008) [2023-12-28 03:40:28,393][106226] Updated weights for policy 0, policy_version 1171031 (0.0010) [2023-12-28 03:40:28,810][106225] Updated weights for policy 1, policy_version 1174030 (0.0006) [2023-12-28 03:40:28,866][106225] Updated weights for policy 1, policy_version 1174040 (0.0005) [2023-12-28 03:40:28,928][106225] Updated weights for policy 1, policy_version 1174050 (0.0009) [2023-12-28 03:40:29,124][106226] Updated weights for policy 0, policy_version 1171041 (0.0008) [2023-12-28 03:40:29,177][106226] Updated weights for policy 0, policy_version 1171051 (0.0010) [2023-12-28 03:40:29,231][106226] Updated weights for policy 0, policy_version 1171061 (0.0009) [2023-12-28 03:40:29,629][106225] Updated weights for policy 1, policy_version 1174060 (0.0009) [2023-12-28 03:40:29,691][106225] Updated weights for policy 1, policy_version 1174070 (0.0008) [2023-12-28 03:40:29,751][106225] Updated weights for policy 1, policy_version 1174080 (0.0008) [2023-12-28 03:40:29,970][106226] Updated weights for policy 0, policy_version 1171071 (0.0009) [2023-12-28 03:40:30,031][106226] Updated weights for policy 0, policy_version 1171081 (0.0008) [2023-12-28 03:40:30,081][106226] Updated weights for policy 0, policy_version 1171091 (0.0010) [2023-12-28 03:40:30,569][106225] Updated weights for policy 1, policy_version 1174090 (0.0008) [2023-12-28 03:40:30,624][106225] Updated weights for policy 1, policy_version 1174100 (0.0007) [2023-12-28 03:40:30,673][106225] Updated weights for policy 1, policy_version 1174110 (0.0007) [2023-12-28 03:40:30,683][106226] Updated weights for policy 0, policy_version 1171101 (0.0008) [2023-12-28 03:40:30,723][106225] Updated weights for policy 1, policy_version 1174120 (0.0007) [2023-12-28 03:40:30,739][106226] Updated weights for policy 0, policy_version 1171111 (0.0007) [2023-12-28 03:40:30,789][106226] Updated weights for policy 0, policy_version 1171121 (0.0005) [2023-12-28 03:40:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 600489984. Throughput: 0: 9943.8, 1: 9903.4. Samples: 600478536. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:31,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.098')] [2023-12-28 03:40:31,470][106226] Updated weights for policy 0, policy_version 1171131 (0.0006) [2023-12-28 03:40:31,531][106226] Updated weights for policy 0, policy_version 1171141 (0.0008) [2023-12-28 03:40:31,583][106226] Updated weights for policy 0, policy_version 1171151 (0.0008) [2023-12-28 03:40:31,585][106225] Updated weights for policy 1, policy_version 1174130 (0.0005) [2023-12-28 03:40:31,651][106225] Updated weights for policy 1, policy_version 1174140 (0.0008) [2023-12-28 03:40:31,708][106225] Updated weights for policy 1, policy_version 1174150 (0.0009) [2023-12-28 03:40:32,369][106226] Updated weights for policy 0, policy_version 1171161 (0.0007) [2023-12-28 03:40:32,390][106225] Updated weights for policy 1, policy_version 1174160 (0.0007) [2023-12-28 03:40:32,437][106226] Updated weights for policy 0, policy_version 1171171 (0.0008) [2023-12-28 03:40:32,446][106225] Updated weights for policy 1, policy_version 1174170 (0.0008) [2023-12-28 03:40:32,488][106226] Updated weights for policy 0, policy_version 1171181 (0.0008) [2023-12-28 03:40:32,496][106225] Updated weights for policy 1, policy_version 1174180 (0.0007) [2023-12-28 03:40:32,542][106226] Updated weights for policy 0, policy_version 1171191 (0.0008) [2023-12-28 03:40:33,159][106226] Updated weights for policy 0, policy_version 1171201 (0.0010) [2023-12-28 03:40:33,212][106226] Updated weights for policy 0, policy_version 1171211 (0.0010) [2023-12-28 03:40:33,214][106225] Updated weights for policy 1, policy_version 1174190 (0.0006) [2023-12-28 03:40:33,258][106226] Updated weights for policy 0, policy_version 1171221 (0.0010) [2023-12-28 03:40:33,278][106225] Updated weights for policy 1, policy_version 1174200 (0.0008) [2023-12-28 03:40:33,324][106225] Updated weights for policy 1, policy_version 1174210 (0.0010) [2023-12-28 03:40:33,933][106225] Updated weights for policy 1, policy_version 1174220 (0.0010) [2023-12-28 03:40:33,982][106225] Updated weights for policy 1, policy_version 1174230 (0.0010) [2023-12-28 03:40:33,988][106226] Updated weights for policy 0, policy_version 1171231 (0.0008) [2023-12-28 03:40:34,028][106225] Updated weights for policy 1, policy_version 1174240 (0.0010) [2023-12-28 03:40:34,045][106226] Updated weights for policy 0, policy_version 1171241 (0.0005) [2023-12-28 03:40:34,100][106226] Updated weights for policy 0, policy_version 1171251 (0.0005) [2023-12-28 03:40:34,778][106226] Updated weights for policy 0, policy_version 1171261 (0.0008) [2023-12-28 03:40:34,783][106225] Updated weights for policy 1, policy_version 1174250 (0.0009) [2023-12-28 03:40:34,837][106226] Updated weights for policy 0, policy_version 1171271 (0.0011) [2023-12-28 03:40:34,843][106225] Updated weights for policy 1, policy_version 1174260 (0.0010) [2023-12-28 03:40:34,897][106226] Updated weights for policy 0, policy_version 1171281 (0.0010) [2023-12-28 03:40:34,901][106225] Updated weights for policy 1, policy_version 1174270 (0.0010) [2023-12-28 03:40:34,961][106225] Updated weights for policy 1, policy_version 1174280 (0.0010) [2023-12-28 03:40:35,568][106226] Updated weights for policy 0, policy_version 1171291 (0.0010) [2023-12-28 03:40:35,636][106226] Updated weights for policy 0, policy_version 1171301 (0.0007) [2023-12-28 03:40:35,653][106225] Updated weights for policy 1, policy_version 1174290 (0.0009) [2023-12-28 03:40:35,699][106226] Updated weights for policy 0, policy_version 1171311 (0.0006) [2023-12-28 03:40:35,715][106225] Updated weights for policy 1, policy_version 1174300 (0.0009) [2023-12-28 03:40:35,778][106225] Updated weights for policy 1, policy_version 1174310 (0.0008) [2023-12-28 03:40:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 600588288. Throughput: 0: 10074.3, 1: 9848.7. Samples: 600598756. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:36,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-4.940')] [2023-12-28 03:40:36,407][106226] Updated weights for policy 0, policy_version 1171321 (0.0006) [2023-12-28 03:40:36,467][106226] Updated weights for policy 0, policy_version 1171331 (0.0007) [2023-12-28 03:40:36,534][106226] Updated weights for policy 0, policy_version 1171341 (0.0008) [2023-12-28 03:40:36,600][106226] Updated weights for policy 0, policy_version 1171351 (0.0008) [2023-12-28 03:40:36,653][106225] Updated weights for policy 1, policy_version 1174320 (0.0009) [2023-12-28 03:40:36,709][106225] Updated weights for policy 1, policy_version 1174330 (0.0010) [2023-12-28 03:40:36,765][106225] Updated weights for policy 1, policy_version 1174340 (0.0009) [2023-12-28 03:40:37,329][106226] Updated weights for policy 0, policy_version 1171361 (0.0008) [2023-12-28 03:40:37,384][106226] Updated weights for policy 0, policy_version 1171371 (0.0009) [2023-12-28 03:40:37,440][106226] Updated weights for policy 0, policy_version 1171381 (0.0008) [2023-12-28 03:40:37,446][106225] Updated weights for policy 1, policy_version 1174350 (0.0009) [2023-12-28 03:40:37,500][106225] Updated weights for policy 1, policy_version 1174360 (0.0008) [2023-12-28 03:40:37,561][106225] Updated weights for policy 1, policy_version 1174370 (0.0008) [2023-12-28 03:40:38,143][106226] Updated weights for policy 0, policy_version 1171391 (0.0005) [2023-12-28 03:40:38,194][106226] Updated weights for policy 0, policy_version 1171401 (0.0005) [2023-12-28 03:40:38,245][106225] Updated weights for policy 1, policy_version 1174380 (0.0007) [2023-12-28 03:40:38,247][106226] Updated weights for policy 0, policy_version 1171411 (0.0006) [2023-12-28 03:40:38,295][106225] Updated weights for policy 1, policy_version 1174390 (0.0005) [2023-12-28 03:40:38,360][106225] Updated weights for policy 1, policy_version 1174400 (0.0009) [2023-12-28 03:40:38,929][106226] Updated weights for policy 0, policy_version 1171421 (0.0008) [2023-12-28 03:40:38,990][106226] Updated weights for policy 0, policy_version 1171431 (0.0008) [2023-12-28 03:40:39,048][106226] Updated weights for policy 0, policy_version 1171441 (0.0008) [2023-12-28 03:40:39,071][106225] Updated weights for policy 1, policy_version 1174410 (0.0009) [2023-12-28 03:40:39,124][106225] Updated weights for policy 1, policy_version 1174420 (0.0008) [2023-12-28 03:40:39,182][106225] Updated weights for policy 1, policy_version 1174430 (0.0008) [2023-12-28 03:40:39,239][106225] Updated weights for policy 1, policy_version 1174440 (0.0008) [2023-12-28 03:40:39,865][106226] Updated weights for policy 0, policy_version 1171451 (0.0009) [2023-12-28 03:40:39,935][106226] Updated weights for policy 0, policy_version 1171461 (0.0007) [2023-12-28 03:40:39,951][106225] Updated weights for policy 1, policy_version 1174450 (0.0008) [2023-12-28 03:40:40,007][106226] Updated weights for policy 0, policy_version 1171471 (0.0007) [2023-12-28 03:40:40,014][106225] Updated weights for policy 1, policy_version 1174460 (0.0007) [2023-12-28 03:40:40,077][106225] Updated weights for policy 1, policy_version 1174470 (0.0006) [2023-12-28 03:40:40,628][106226] Updated weights for policy 0, policy_version 1171481 (0.0008) [2023-12-28 03:40:40,683][106226] Updated weights for policy 0, policy_version 1171491 (0.0008) [2023-12-28 03:40:40,741][106226] Updated weights for policy 0, policy_version 1171501 (0.0008) [2023-12-28 03:40:40,798][106225] Updated weights for policy 1, policy_version 1174480 (0.0007) [2023-12-28 03:40:40,806][106226] Updated weights for policy 0, policy_version 1171511 (0.0008) [2023-12-28 03:40:40,849][106225] Updated weights for policy 1, policy_version 1174490 (0.0008) [2023-12-28 03:40:40,901][106225] Updated weights for policy 1, policy_version 1174500 (0.0009) [2023-12-28 03:40:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 600686592. Throughput: 0: 10064.2, 1: 9822.4. Samples: 600655272. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:41,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.968')] [2023-12-28 03:40:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001171512_299966464.pth... [2023-12-28 03:40:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001174504_300720128.pth... [2023-12-28 03:40:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001173384_300433408.pth [2023-12-28 03:40:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001170328_299663360.pth [2023-12-28 03:40:41,521][106226] Updated weights for policy 0, policy_version 1171521 (0.0010) [2023-12-28 03:40:41,587][106226] Updated weights for policy 0, policy_version 1171531 (0.0011) [2023-12-28 03:40:41,650][106226] Updated weights for policy 0, policy_version 1171541 (0.0011) [2023-12-28 03:40:41,744][106225] Updated weights for policy 1, policy_version 1174510 (0.0008) [2023-12-28 03:40:41,818][106225] Updated weights for policy 1, policy_version 1174520 (0.0008) [2023-12-28 03:40:41,883][106225] Updated weights for policy 1, policy_version 1174530 (0.0006) [2023-12-28 03:40:42,402][106226] Updated weights for policy 0, policy_version 1171551 (0.0009) [2023-12-28 03:40:42,465][106226] Updated weights for policy 0, policy_version 1171561 (0.0009) [2023-12-28 03:40:42,532][106226] Updated weights for policy 0, policy_version 1171571 (0.0006) [2023-12-28 03:40:42,644][106225] Updated weights for policy 1, policy_version 1174540 (0.0008) [2023-12-28 03:40:42,694][106225] Updated weights for policy 1, policy_version 1174550 (0.0007) [2023-12-28 03:40:42,742][106225] Updated weights for policy 1, policy_version 1174560 (0.0008) [2023-12-28 03:40:43,219][106226] Updated weights for policy 0, policy_version 1171581 (0.0008) [2023-12-28 03:40:43,285][106226] Updated weights for policy 0, policy_version 1171591 (0.0010) [2023-12-28 03:40:43,348][106226] Updated weights for policy 0, policy_version 1171601 (0.0010) [2023-12-28 03:40:43,497][106225] Updated weights for policy 1, policy_version 1174570 (0.0008) [2023-12-28 03:40:43,557][106225] Updated weights for policy 1, policy_version 1174580 (0.0008) [2023-12-28 03:40:43,615][106225] Updated weights for policy 1, policy_version 1174590 (0.0008) [2023-12-28 03:40:43,677][106225] Updated weights for policy 1, policy_version 1174600 (0.0008) [2023-12-28 03:40:44,028][106226] Updated weights for policy 0, policy_version 1171611 (0.0009) [2023-12-28 03:40:44,078][106226] Updated weights for policy 0, policy_version 1171621 (0.0007) [2023-12-28 03:40:44,141][106226] Updated weights for policy 0, policy_version 1171631 (0.0010) [2023-12-28 03:40:44,277][106225] Updated weights for policy 1, policy_version 1174610 (0.0009) [2023-12-28 03:40:44,334][106225] Updated weights for policy 1, policy_version 1174620 (0.0007) [2023-12-28 03:40:44,391][106225] Updated weights for policy 1, policy_version 1174630 (0.0006) [2023-12-28 03:40:44,825][106226] Updated weights for policy 0, policy_version 1171641 (0.0010) [2023-12-28 03:40:44,891][106226] Updated weights for policy 0, policy_version 1171651 (0.0008) [2023-12-28 03:40:44,966][106226] Updated weights for policy 0, policy_version 1171661 (0.0007) [2023-12-28 03:40:45,031][106226] Updated weights for policy 0, policy_version 1171671 (0.0008) [2023-12-28 03:40:45,105][106225] Updated weights for policy 1, policy_version 1174640 (0.0011) [2023-12-28 03:40:45,170][106225] Updated weights for policy 1, policy_version 1174650 (0.0011) [2023-12-28 03:40:45,235][106225] Updated weights for policy 1, policy_version 1174660 (0.0011) [2023-12-28 03:40:45,713][106226] Updated weights for policy 0, policy_version 1171681 (0.0006) [2023-12-28 03:40:45,770][106226] Updated weights for policy 0, policy_version 1171691 (0.0006) [2023-12-28 03:40:45,817][106226] Updated weights for policy 0, policy_version 1171701 (0.0011) [2023-12-28 03:40:45,906][106225] Updated weights for policy 1, policy_version 1174670 (0.0007) [2023-12-28 03:40:45,967][106225] Updated weights for policy 1, policy_version 1174680 (0.0005) [2023-12-28 03:40:46,021][106225] Updated weights for policy 1, policy_version 1174690 (0.0005) [2023-12-28 03:40:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 600784896. Throughput: 0: 10033.0, 1: 9749.2. Samples: 600771188. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:46,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-4.714')] [2023-12-28 03:40:46,559][106226] Updated weights for policy 0, policy_version 1171711 (0.0010) [2023-12-28 03:40:46,612][106226] Updated weights for policy 0, policy_version 1171721 (0.0010) [2023-12-28 03:40:46,656][106225] Updated weights for policy 1, policy_version 1174700 (0.0009) [2023-12-28 03:40:46,662][106226] Updated weights for policy 0, policy_version 1171731 (0.0010) [2023-12-28 03:40:46,722][106225] Updated weights for policy 1, policy_version 1174710 (0.0010) [2023-12-28 03:40:46,788][106225] Updated weights for policy 1, policy_version 1174720 (0.0010) [2023-12-28 03:40:47,347][106225] Updated weights for policy 1, policy_version 1174730 (0.0005) [2023-12-28 03:40:47,368][106226] Updated weights for policy 0, policy_version 1171741 (0.0010) [2023-12-28 03:40:47,394][106225] Updated weights for policy 1, policy_version 1174740 (0.0005) [2023-12-28 03:40:47,422][106226] Updated weights for policy 0, policy_version 1171751 (0.0010) [2023-12-28 03:40:47,447][106225] Updated weights for policy 1, policy_version 1174750 (0.0005) [2023-12-28 03:40:47,486][106226] Updated weights for policy 0, policy_version 1171761 (0.0011) [2023-12-28 03:40:47,506][106225] Updated weights for policy 1, policy_version 1174760 (0.0005) [2023-12-28 03:40:48,027][106225] Updated weights for policy 1, policy_version 1174770 (0.0005) [2023-12-28 03:40:48,083][106225] Updated weights for policy 1, policy_version 1174780 (0.0009) [2023-12-28 03:40:48,109][106226] Updated weights for policy 0, policy_version 1171771 (0.0011) [2023-12-28 03:40:48,142][106225] Updated weights for policy 1, policy_version 1174790 (0.0008) [2023-12-28 03:40:48,168][106226] Updated weights for policy 0, policy_version 1171781 (0.0011) [2023-12-28 03:40:48,224][106226] Updated weights for policy 0, policy_version 1171791 (0.0010) [2023-12-28 03:40:48,862][106225] Updated weights for policy 1, policy_version 1174800 (0.0008) [2023-12-28 03:40:48,929][106225] Updated weights for policy 1, policy_version 1174810 (0.0008) [2023-12-28 03:40:48,985][106226] Updated weights for policy 0, policy_version 1171801 (0.0011) [2023-12-28 03:40:48,987][106225] Updated weights for policy 1, policy_version 1174820 (0.0008) [2023-12-28 03:40:49,039][106226] Updated weights for policy 0, policy_version 1171811 (0.0011) [2023-12-28 03:40:49,097][106226] Updated weights for policy 0, policy_version 1171821 (0.0011) [2023-12-28 03:40:49,155][106226] Updated weights for policy 0, policy_version 1171831 (0.0011) [2023-12-28 03:40:49,639][106225] Updated weights for policy 1, policy_version 1174830 (0.0008) [2023-12-28 03:40:49,701][106225] Updated weights for policy 1, policy_version 1174840 (0.0008) [2023-12-28 03:40:49,761][106225] Updated weights for policy 1, policy_version 1174850 (0.0007) [2023-12-28 03:40:49,907][106226] Updated weights for policy 0, policy_version 1171841 (0.0010) [2023-12-28 03:40:49,971][106226] Updated weights for policy 0, policy_version 1171851 (0.0008) [2023-12-28 03:40:50,029][106226] Updated weights for policy 0, policy_version 1171861 (0.0008) [2023-12-28 03:40:50,507][106225] Updated weights for policy 1, policy_version 1174860 (0.0008) [2023-12-28 03:40:50,565][106225] Updated weights for policy 1, policy_version 1174870 (0.0008) [2023-12-28 03:40:50,623][106225] Updated weights for policy 1, policy_version 1174880 (0.0010) [2023-12-28 03:40:50,788][106226] Updated weights for policy 0, policy_version 1171871 (0.0009) [2023-12-28 03:40:50,845][106226] Updated weights for policy 0, policy_version 1171881 (0.0010) [2023-12-28 03:40:50,907][106226] Updated weights for policy 0, policy_version 1171891 (0.0008) [2023-12-28 03:40:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 600883200. Throughput: 0: 9955.0, 1: 9807.8. Samples: 600890520. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:51,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.979')] [2023-12-28 03:40:51,360][106225] Updated weights for policy 1, policy_version 1174890 (0.0010) [2023-12-28 03:40:51,424][106225] Updated weights for policy 1, policy_version 1174900 (0.0008) [2023-12-28 03:40:51,492][106225] Updated weights for policy 1, policy_version 1174910 (0.0010) [2023-12-28 03:40:51,564][106225] Updated weights for policy 1, policy_version 1174920 (0.0011) [2023-12-28 03:40:51,662][106226] Updated weights for policy 0, policy_version 1171901 (0.0008) [2023-12-28 03:40:51,732][106226] Updated weights for policy 0, policy_version 1171911 (0.0009) [2023-12-28 03:40:51,793][106226] Updated weights for policy 0, policy_version 1171921 (0.0009) [2023-12-28 03:40:52,316][106225] Updated weights for policy 1, policy_version 1174930 (0.0011) [2023-12-28 03:40:52,379][106225] Updated weights for policy 1, policy_version 1174940 (0.0009) [2023-12-28 03:40:52,438][106225] Updated weights for policy 1, policy_version 1174950 (0.0009) [2023-12-28 03:40:52,545][106226] Updated weights for policy 0, policy_version 1171931 (0.0008) [2023-12-28 03:40:52,615][106226] Updated weights for policy 0, policy_version 1171941 (0.0007) [2023-12-28 03:40:52,674][106226] Updated weights for policy 0, policy_version 1171951 (0.0006) [2023-12-28 03:40:53,140][106225] Updated weights for policy 1, policy_version 1174960 (0.0006) [2023-12-28 03:40:53,204][106225] Updated weights for policy 1, policy_version 1174970 (0.0008) [2023-12-28 03:40:53,261][106225] Updated weights for policy 1, policy_version 1174980 (0.0010) [2023-12-28 03:40:53,405][106226] Updated weights for policy 0, policy_version 1171961 (0.0006) [2023-12-28 03:40:53,470][106226] Updated weights for policy 0, policy_version 1171971 (0.0008) [2023-12-28 03:40:53,532][106226] Updated weights for policy 0, policy_version 1171981 (0.0008) [2023-12-28 03:40:53,592][106226] Updated weights for policy 0, policy_version 1171991 (0.0008) [2023-12-28 03:40:53,929][106225] Updated weights for policy 1, policy_version 1174990 (0.0007) [2023-12-28 03:40:53,974][106225] Updated weights for policy 1, policy_version 1175000 (0.0005) [2023-12-28 03:40:54,022][106225] Updated weights for policy 1, policy_version 1175010 (0.0005) [2023-12-28 03:40:54,346][106226] Updated weights for policy 0, policy_version 1172001 (0.0008) [2023-12-28 03:40:54,396][106226] Updated weights for policy 0, policy_version 1172011 (0.0008) [2023-12-28 03:40:54,452][106226] Updated weights for policy 0, policy_version 1172021 (0.0008) [2023-12-28 03:40:54,624][106225] Updated weights for policy 1, policy_version 1175020 (0.0005) [2023-12-28 03:40:54,676][106225] Updated weights for policy 1, policy_version 1175030 (0.0007) [2023-12-28 03:40:54,721][106225] Updated weights for policy 1, policy_version 1175040 (0.0009) [2023-12-28 03:40:55,113][106226] Updated weights for policy 0, policy_version 1172031 (0.0008) [2023-12-28 03:40:55,168][106226] Updated weights for policy 0, policy_version 1172041 (0.0008) [2023-12-28 03:40:55,224][106226] Updated weights for policy 0, policy_version 1172051 (0.0009) [2023-12-28 03:40:55,449][106225] Updated weights for policy 1, policy_version 1175050 (0.0008) [2023-12-28 03:40:55,511][106225] Updated weights for policy 1, policy_version 1175060 (0.0006) [2023-12-28 03:40:55,564][106225] Updated weights for policy 1, policy_version 1175070 (0.0005) [2023-12-28 03:40:55,619][106225] Updated weights for policy 1, policy_version 1175080 (0.0005) [2023-12-28 03:40:55,960][106226] Updated weights for policy 0, policy_version 1172061 (0.0009) [2023-12-28 03:40:56,024][106226] Updated weights for policy 0, policy_version 1172071 (0.0009) [2023-12-28 03:40:56,084][106226] Updated weights for policy 0, policy_version 1172081 (0.0008) [2023-12-28 03:40:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 600981504. Throughput: 0: 9922.1, 1: 9774.6. Samples: 600947688. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:40:56,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-5.288')] [2023-12-28 03:40:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001172088_300113920.pth... [2023-12-28 03:40:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001170936_299819008.pth [2023-12-28 03:40:56,224][106225] Updated weights for policy 1, policy_version 1175090 (0.0008) [2023-12-28 03:40:56,285][106225] Updated weights for policy 1, policy_version 1175100 (0.0008) [2023-12-28 03:40:56,339][106225] Updated weights for policy 1, policy_version 1175110 (0.0008) [2023-12-28 03:40:56,348][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001175112_300875776.pth... [2023-12-28 03:40:56,351][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001173928_300572672.pth [2023-12-28 03:40:56,769][106226] Updated weights for policy 0, policy_version 1172091 (0.0008) [2023-12-28 03:40:56,828][106226] Updated weights for policy 0, policy_version 1172101 (0.0007) [2023-12-28 03:40:56,885][106226] Updated weights for policy 0, policy_version 1172111 (0.0008) [2023-12-28 03:40:57,078][106225] Updated weights for policy 1, policy_version 1175120 (0.0006) [2023-12-28 03:40:57,147][106225] Updated weights for policy 1, policy_version 1175130 (0.0005) [2023-12-28 03:40:57,197][106225] Updated weights for policy 1, policy_version 1175140 (0.0007) [2023-12-28 03:40:57,503][106226] Updated weights for policy 0, policy_version 1172121 (0.0007) [2023-12-28 03:40:57,562][106226] Updated weights for policy 0, policy_version 1172131 (0.0009) [2023-12-28 03:40:57,618][106226] Updated weights for policy 0, policy_version 1172141 (0.0008) [2023-12-28 03:40:57,671][106226] Updated weights for policy 0, policy_version 1172151 (0.0009) [2023-12-28 03:40:57,874][106225] Updated weights for policy 1, policy_version 1175150 (0.0008) [2023-12-28 03:40:57,924][106225] Updated weights for policy 1, policy_version 1175160 (0.0008) [2023-12-28 03:40:57,979][106225] Updated weights for policy 1, policy_version 1175170 (0.0009) [2023-12-28 03:40:58,430][106226] Updated weights for policy 0, policy_version 1172161 (0.0007) [2023-12-28 03:40:58,488][106226] Updated weights for policy 0, policy_version 1172171 (0.0009) [2023-12-28 03:40:58,549][106226] Updated weights for policy 0, policy_version 1172181 (0.0007) [2023-12-28 03:40:58,805][106225] Updated weights for policy 1, policy_version 1175180 (0.0008) [2023-12-28 03:40:58,874][106225] Updated weights for policy 1, policy_version 1175190 (0.0008) [2023-12-28 03:40:58,945][106225] Updated weights for policy 1, policy_version 1175200 (0.0009) [2023-12-28 03:40:59,437][106226] Updated weights for policy 0, policy_version 1172191 (0.0010) [2023-12-28 03:40:59,529][106226] Updated weights for policy 0, policy_version 1172201 (0.0008) [2023-12-28 03:40:59,578][106226] Updated weights for policy 0, policy_version 1172211 (0.0008) [2023-12-28 03:40:59,741][106225] Updated weights for policy 1, policy_version 1175210 (0.0007) [2023-12-28 03:40:59,808][106225] Updated weights for policy 1, policy_version 1175220 (0.0005) [2023-12-28 03:40:59,879][106225] Updated weights for policy 1, policy_version 1175230 (0.0008) [2023-12-28 03:40:59,945][106225] Updated weights for policy 1, policy_version 1175240 (0.0009) [2023-12-28 03:41:00,241][106226] Updated weights for policy 0, policy_version 1172221 (0.0009) [2023-12-28 03:41:00,301][106226] Updated weights for policy 0, policy_version 1172231 (0.0009) [2023-12-28 03:41:00,366][106226] Updated weights for policy 0, policy_version 1172241 (0.0009) [2023-12-28 03:41:00,618][106225] Updated weights for policy 1, policy_version 1175250 (0.0008) [2023-12-28 03:41:00,672][106225] Updated weights for policy 1, policy_version 1175260 (0.0008) [2023-12-28 03:41:00,727][106225] Updated weights for policy 1, policy_version 1175270 (0.0008) [2023-12-28 03:41:01,131][106226] Updated weights for policy 0, policy_version 1172251 (0.0009) [2023-12-28 03:41:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 601071616. Throughput: 0: 9867.1, 1: 9816.8. Samples: 601064732. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:41:01,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-4.794')] [2023-12-28 03:41:01,190][106226] Updated weights for policy 0, policy_version 1172261 (0.0008) [2023-12-28 03:41:01,253][106226] Updated weights for policy 0, policy_version 1172271 (0.0008) [2023-12-28 03:41:01,347][106225] Updated weights for policy 1, policy_version 1175280 (0.0008) [2023-12-28 03:41:01,411][106225] Updated weights for policy 1, policy_version 1175290 (0.0008) [2023-12-28 03:41:01,466][106225] Updated weights for policy 1, policy_version 1175300 (0.0008) [2023-12-28 03:41:01,951][106226] Updated weights for policy 0, policy_version 1172281 (0.0005) [2023-12-28 03:41:02,013][106226] Updated weights for policy 0, policy_version 1172291 (0.0005) [2023-12-28 03:41:02,077][106226] Updated weights for policy 0, policy_version 1172301 (0.0007) [2023-12-28 03:41:02,144][106226] Updated weights for policy 0, policy_version 1172311 (0.0005) [2023-12-28 03:41:02,239][106225] Updated weights for policy 1, policy_version 1175310 (0.0009) [2023-12-28 03:41:02,292][106225] Updated weights for policy 1, policy_version 1175320 (0.0010) [2023-12-28 03:41:02,350][106225] Updated weights for policy 1, policy_version 1175330 (0.0010) [2023-12-28 03:41:02,743][106226] Updated weights for policy 0, policy_version 1172321 (0.0008) [2023-12-28 03:41:02,799][106226] Updated weights for policy 0, policy_version 1172331 (0.0008) [2023-12-28 03:41:02,860][106226] Updated weights for policy 0, policy_version 1172341 (0.0007) [2023-12-28 03:41:03,078][106225] Updated weights for policy 1, policy_version 1175340 (0.0008) [2023-12-28 03:41:03,130][106225] Updated weights for policy 1, policy_version 1175350 (0.0006) [2023-12-28 03:41:03,190][106225] Updated weights for policy 1, policy_version 1175360 (0.0005) [2023-12-28 03:41:03,567][106226] Updated weights for policy 0, policy_version 1172351 (0.0008) [2023-12-28 03:41:03,615][106226] Updated weights for policy 0, policy_version 1172361 (0.0006) [2023-12-28 03:41:03,670][106226] Updated weights for policy 0, policy_version 1172371 (0.0005) [2023-12-28 03:41:03,808][106225] Updated weights for policy 1, policy_version 1175370 (0.0008) [2023-12-28 03:41:03,866][106225] Updated weights for policy 1, policy_version 1175380 (0.0011) [2023-12-28 03:41:03,930][106225] Updated weights for policy 1, policy_version 1175390 (0.0010) [2023-12-28 03:41:04,005][106225] Updated weights for policy 1, policy_version 1175400 (0.0011) [2023-12-28 03:41:04,342][106226] Updated weights for policy 0, policy_version 1172381 (0.0006) [2023-12-28 03:41:04,410][106226] Updated weights for policy 0, policy_version 1172391 (0.0008) [2023-12-28 03:41:04,472][106226] Updated weights for policy 0, policy_version 1172401 (0.0008) [2023-12-28 03:41:04,699][106225] Updated weights for policy 1, policy_version 1175410 (0.0010) [2023-12-28 03:41:04,749][106225] Updated weights for policy 1, policy_version 1175420 (0.0010) [2023-12-28 03:41:04,803][106225] Updated weights for policy 1, policy_version 1175430 (0.0010) [2023-12-28 03:41:05,201][106226] Updated weights for policy 0, policy_version 1172411 (0.0007) [2023-12-28 03:41:05,257][106226] Updated weights for policy 0, policy_version 1172421 (0.0005) [2023-12-28 03:41:05,315][106226] Updated weights for policy 0, policy_version 1172431 (0.0005) [2023-12-28 03:41:05,386][106225] Updated weights for policy 1, policy_version 1175440 (0.0006) [2023-12-28 03:41:05,443][106225] Updated weights for policy 1, policy_version 1175450 (0.0005) [2023-12-28 03:41:05,498][106225] Updated weights for policy 1, policy_version 1175460 (0.0005) [2023-12-28 03:41:06,027][106226] Updated weights for policy 0, policy_version 1172441 (0.0007) [2023-12-28 03:41:06,084][106226] Updated weights for policy 0, policy_version 1172451 (0.0009) [2023-12-28 03:41:06,152][106226] Updated weights for policy 0, policy_version 1172461 (0.0008) [2023-12-28 03:41:06,160][106225] Updated weights for policy 1, policy_version 1175470 (0.0008) [2023-12-28 03:41:06,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 601169920. Throughput: 0: 9812.3, 1: 9899.8. Samples: 601186116. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:41:06,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.865')] [2023-12-28 03:41:06,218][106225] Updated weights for policy 1, policy_version 1175480 (0.0006) [2023-12-28 03:41:06,221][106226] Updated weights for policy 0, policy_version 1172471 (0.0008) [2023-12-28 03:41:06,273][106225] Updated weights for policy 1, policy_version 1175490 (0.0006) [2023-12-28 03:41:06,859][106226] Updated weights for policy 0, policy_version 1172481 (0.0006) [2023-12-28 03:41:06,915][106226] Updated weights for policy 0, policy_version 1172491 (0.0005) [2023-12-28 03:41:06,979][106226] Updated weights for policy 0, policy_version 1172501 (0.0005) [2023-12-28 03:41:06,992][106225] Updated weights for policy 1, policy_version 1175500 (0.0006) [2023-12-28 03:41:07,044][106225] Updated weights for policy 1, policy_version 1175510 (0.0005) [2023-12-28 03:41:07,099][106225] Updated weights for policy 1, policy_version 1175520 (0.0005) [2023-12-28 03:41:07,551][106226] Updated weights for policy 0, policy_version 1172511 (0.0006) [2023-12-28 03:41:07,609][106226] Updated weights for policy 0, policy_version 1172521 (0.0006) [2023-12-28 03:41:07,648][106225] Updated weights for policy 1, policy_version 1175530 (0.0006) [2023-12-28 03:41:07,662][106226] Updated weights for policy 0, policy_version 1172531 (0.0005) [2023-12-28 03:41:07,694][106225] Updated weights for policy 1, policy_version 1175540 (0.0009) [2023-12-28 03:41:07,749][106225] Updated weights for policy 1, policy_version 1175550 (0.0009) [2023-12-28 03:41:07,798][106225] Updated weights for policy 1, policy_version 1175560 (0.0008) [2023-12-28 03:41:08,329][106226] Updated weights for policy 0, policy_version 1172541 (0.0006) [2023-12-28 03:41:08,389][106226] Updated weights for policy 0, policy_version 1172551 (0.0007) [2023-12-28 03:41:08,444][106226] Updated weights for policy 0, policy_version 1172561 (0.0009) [2023-12-28 03:41:08,445][106225] Updated weights for policy 1, policy_version 1175570 (0.0006) [2023-12-28 03:41:08,499][106225] Updated weights for policy 1, policy_version 1175580 (0.0010) [2023-12-28 03:41:08,557][106225] Updated weights for policy 1, policy_version 1175590 (0.0010) [2023-12-28 03:41:09,097][106226] Updated weights for policy 0, policy_version 1172571 (0.0007) [2023-12-28 03:41:09,150][106226] Updated weights for policy 0, policy_version 1172581 (0.0010) [2023-12-28 03:41:09,204][106226] Updated weights for policy 0, policy_version 1172591 (0.0011) [2023-12-28 03:41:09,268][106225] Updated weights for policy 1, policy_version 1175600 (0.0008) [2023-12-28 03:41:09,329][106225] Updated weights for policy 1, policy_version 1175610 (0.0008) [2023-12-28 03:41:09,404][106225] Updated weights for policy 1, policy_version 1175620 (0.0009) [2023-12-28 03:41:10,021][106226] Updated weights for policy 0, policy_version 1172601 (0.0014) [2023-12-28 03:41:10,086][106226] Updated weights for policy 0, policy_version 1172611 (0.0011) [2023-12-28 03:41:10,152][106226] Updated weights for policy 0, policy_version 1172621 (0.0011) [2023-12-28 03:41:10,197][106225] Updated weights for policy 1, policy_version 1175630 (0.0006) [2023-12-28 03:41:10,210][106226] Updated weights for policy 0, policy_version 1172631 (0.0011) [2023-12-28 03:41:10,254][106225] Updated weights for policy 1, policy_version 1175640 (0.0007) [2023-12-28 03:41:10,313][106225] Updated weights for policy 1, policy_version 1175650 (0.0008) [2023-12-28 03:41:10,913][106226] Updated weights for policy 0, policy_version 1172641 (0.0008) [2023-12-28 03:41:10,951][106225] Updated weights for policy 1, policy_version 1175660 (0.0008) [2023-12-28 03:41:10,961][106226] Updated weights for policy 0, policy_version 1172651 (0.0005) [2023-12-28 03:41:11,001][106225] Updated weights for policy 1, policy_version 1175670 (0.0008) [2023-12-28 03:41:11,018][106226] Updated weights for policy 0, policy_version 1172661 (0.0006) [2023-12-28 03:41:11,079][106225] Updated weights for policy 1, policy_version 1175680 (0.0008) [2023-12-28 03:41:11,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 601284608. Throughput: 0: 9850.6, 1: 9984.7. Samples: 601250136. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-28 03:41:11,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.796')] [2023-12-28 03:41:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001175688_301023232.pth... [2023-12-28 03:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001172664_300261376.pth... [2023-12-28 03:41:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001174504_300720128.pth [2023-12-28 03:41:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001171512_299966464.pth [2023-12-28 03:41:11,752][106226] Updated weights for policy 0, policy_version 1172671 (0.0011) [2023-12-28 03:41:11,812][106226] Updated weights for policy 0, policy_version 1172681 (0.0008) [2023-12-28 03:41:11,872][106226] Updated weights for policy 0, policy_version 1172691 (0.0009) [2023-12-28 03:41:11,890][106225] Updated weights for policy 1, policy_version 1175690 (0.0007) [2023-12-28 03:41:11,951][106225] Updated weights for policy 1, policy_version 1175700 (0.0008) [2023-12-28 03:41:12,009][106225] Updated weights for policy 1, policy_version 1175710 (0.0009) [2023-12-28 03:41:12,064][106225] Updated weights for policy 1, policy_version 1175720 (0.0008) [2023-12-28 03:41:12,650][106226] Updated weights for policy 0, policy_version 1172701 (0.0009) [2023-12-28 03:41:12,702][106226] Updated weights for policy 0, policy_version 1172711 (0.0007) [2023-12-28 03:41:12,729][106225] Updated weights for policy 1, policy_version 1175730 (0.0005) [2023-12-28 03:41:12,761][106226] Updated weights for policy 0, policy_version 1172721 (0.0009) [2023-12-28 03:41:12,785][106225] Updated weights for policy 1, policy_version 1175740 (0.0007) [2023-12-28 03:41:12,835][106225] Updated weights for policy 1, policy_version 1175750 (0.0006) [2023-12-28 03:41:13,424][106225] Updated weights for policy 1, policy_version 1175760 (0.0005) [2023-12-28 03:41:13,431][106226] Updated weights for policy 0, policy_version 1172731 (0.0008) [2023-12-28 03:41:13,485][106225] Updated weights for policy 1, policy_version 1175770 (0.0005) [2023-12-28 03:41:13,496][106226] Updated weights for policy 0, policy_version 1172741 (0.0006) [2023-12-28 03:41:13,544][106225] Updated weights for policy 1, policy_version 1175780 (0.0006) [2023-12-28 03:41:13,561][106226] Updated weights for policy 0, policy_version 1172751 (0.0009) [2023-12-28 03:41:14,079][106225] Updated weights for policy 1, policy_version 1175790 (0.0005) [2023-12-28 03:41:14,138][106225] Updated weights for policy 1, policy_version 1175800 (0.0007) [2023-12-28 03:41:14,190][106225] Updated weights for policy 1, policy_version 1175810 (0.0008) [2023-12-28 03:41:14,217][106226] Updated weights for policy 0, policy_version 1172761 (0.0008) [2023-12-28 03:41:14,278][106226] Updated weights for policy 0, policy_version 1172771 (0.0008) [2023-12-28 03:41:14,332][106226] Updated weights for policy 0, policy_version 1172781 (0.0008) [2023-12-28 03:41:14,383][106226] Updated weights for policy 0, policy_version 1172791 (0.0008) [2023-12-28 03:41:14,801][106225] Updated weights for policy 1, policy_version 1175820 (0.0009) [2023-12-28 03:41:14,864][106225] Updated weights for policy 1, policy_version 1175830 (0.0008) [2023-12-28 03:41:14,917][106225] Updated weights for policy 1, policy_version 1175840 (0.0008) [2023-12-28 03:41:15,117][106226] Updated weights for policy 0, policy_version 1172801 (0.0008) [2023-12-28 03:41:15,180][106226] Updated weights for policy 0, policy_version 1172811 (0.0009) [2023-12-28 03:41:15,233][106226] Updated weights for policy 0, policy_version 1172821 (0.0008) [2023-12-28 03:41:15,655][106225] Updated weights for policy 1, policy_version 1175850 (0.0008) [2023-12-28 03:41:15,702][106225] Updated weights for policy 1, policy_version 1175860 (0.0007) [2023-12-28 03:41:15,748][106225] Updated weights for policy 1, policy_version 1175870 (0.0008) [2023-12-28 03:41:15,794][106225] Updated weights for policy 1, policy_version 1175880 (0.0007) [2023-12-28 03:41:15,976][106226] Updated weights for policy 0, policy_version 1172831 (0.0007) [2023-12-28 03:41:16,027][106226] Updated weights for policy 0, policy_version 1172841 (0.0006) [2023-12-28 03:41:16,075][106226] Updated weights for policy 0, policy_version 1172851 (0.0008) [2023-12-28 03:41:16,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 601382912. Throughput: 0: 9816.8, 1: 9984.9. Samples: 601369612. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:16,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.964')] [2023-12-28 03:41:16,410][106225] Updated weights for policy 1, policy_version 1175890 (0.0005) [2023-12-28 03:41:16,463][106225] Updated weights for policy 1, policy_version 1175900 (0.0005) [2023-12-28 03:41:16,516][106225] Updated weights for policy 1, policy_version 1175910 (0.0005) [2023-12-28 03:41:16,753][106226] Updated weights for policy 0, policy_version 1172861 (0.0007) [2023-12-28 03:41:16,816][106226] Updated weights for policy 0, policy_version 1172871 (0.0008) [2023-12-28 03:41:16,884][106226] Updated weights for policy 0, policy_version 1172881 (0.0005) [2023-12-28 03:41:17,030][106225] Updated weights for policy 1, policy_version 1175920 (0.0005) [2023-12-28 03:41:17,084][106225] Updated weights for policy 1, policy_version 1175930 (0.0006) [2023-12-28 03:41:17,130][106225] Updated weights for policy 1, policy_version 1175940 (0.0005) [2023-12-28 03:41:17,522][106226] Updated weights for policy 0, policy_version 1172891 (0.0006) [2023-12-28 03:41:17,578][106226] Updated weights for policy 0, policy_version 1172901 (0.0008) [2023-12-28 03:41:17,629][106226] Updated weights for policy 0, policy_version 1172911 (0.0008) [2023-12-28 03:41:17,851][106225] Updated weights for policy 1, policy_version 1175950 (0.0010) [2023-12-28 03:41:17,901][106225] Updated weights for policy 1, policy_version 1175960 (0.0010) [2023-12-28 03:41:17,951][106225] Updated weights for policy 1, policy_version 1175970 (0.0010) [2023-12-28 03:41:18,263][106226] Updated weights for policy 0, policy_version 1172921 (0.0007) [2023-12-28 03:41:18,331][106226] Updated weights for policy 0, policy_version 1172931 (0.0006) [2023-12-28 03:41:18,392][106226] Updated weights for policy 0, policy_version 1172941 (0.0010) [2023-12-28 03:41:18,453][106226] Updated weights for policy 0, policy_version 1172951 (0.0010) [2023-12-28 03:41:18,673][106225] Updated weights for policy 1, policy_version 1175980 (0.0010) [2023-12-28 03:41:18,733][106225] Updated weights for policy 1, policy_version 1175990 (0.0008) [2023-12-28 03:41:18,793][106225] Updated weights for policy 1, policy_version 1176000 (0.0008) [2023-12-28 03:41:19,150][106226] Updated weights for policy 0, policy_version 1172961 (0.0008) [2023-12-28 03:41:19,195][106226] Updated weights for policy 0, policy_version 1172971 (0.0008) [2023-12-28 03:41:19,272][106226] Updated weights for policy 0, policy_version 1172981 (0.0008) [2023-12-28 03:41:19,544][106225] Updated weights for policy 1, policy_version 1176010 (0.0008) [2023-12-28 03:41:19,610][106225] Updated weights for policy 1, policy_version 1176020 (0.0008) [2023-12-28 03:41:19,677][106225] Updated weights for policy 1, policy_version 1176030 (0.0009) [2023-12-28 03:41:19,740][106225] Updated weights for policy 1, policy_version 1176040 (0.0008) [2023-12-28 03:41:20,018][106226] Updated weights for policy 0, policy_version 1172991 (0.0008) [2023-12-28 03:41:20,084][106226] Updated weights for policy 0, policy_version 1173001 (0.0007) [2023-12-28 03:41:20,149][106226] Updated weights for policy 0, policy_version 1173011 (0.0006) [2023-12-28 03:41:20,592][106225] Updated weights for policy 1, policy_version 1176050 (0.0009) [2023-12-28 03:41:20,662][106225] Updated weights for policy 1, policy_version 1176060 (0.0010) [2023-12-28 03:41:20,733][106225] Updated weights for policy 1, policy_version 1176070 (0.0010) [2023-12-28 03:41:20,803][106226] Updated weights for policy 0, policy_version 1173021 (0.0008) [2023-12-28 03:41:20,860][106226] Updated weights for policy 0, policy_version 1173031 (0.0009) [2023-12-28 03:41:20,918][106226] Updated weights for policy 0, policy_version 1173041 (0.0009) [2023-12-28 03:41:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 601481216. Throughput: 0: 9758.1, 1: 10009.5. Samples: 601488300. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:21,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.886')] [2023-12-28 03:41:21,572][106225] Updated weights for policy 1, policy_version 1176080 (0.0010) [2023-12-28 03:41:21,640][106225] Updated weights for policy 1, policy_version 1176090 (0.0008) [2023-12-28 03:41:21,659][106226] Updated weights for policy 0, policy_version 1173051 (0.0009) [2023-12-28 03:41:21,704][106225] Updated weights for policy 1, policy_version 1176100 (0.0008) [2023-12-28 03:41:21,711][106226] Updated weights for policy 0, policy_version 1173061 (0.0006) [2023-12-28 03:41:21,780][106226] Updated weights for policy 0, policy_version 1173071 (0.0008) [2023-12-28 03:41:22,473][106225] Updated weights for policy 1, policy_version 1176110 (0.0008) [2023-12-28 03:41:22,487][106226] Updated weights for policy 0, policy_version 1173081 (0.0007) [2023-12-28 03:41:22,533][106225] Updated weights for policy 1, policy_version 1176120 (0.0007) [2023-12-28 03:41:22,549][106226] Updated weights for policy 0, policy_version 1173091 (0.0008) [2023-12-28 03:41:22,600][106225] Updated weights for policy 1, policy_version 1176130 (0.0007) [2023-12-28 03:41:22,611][106226] Updated weights for policy 0, policy_version 1173101 (0.0007) [2023-12-28 03:41:22,668][106226] Updated weights for policy 0, policy_version 1173111 (0.0007) [2023-12-28 03:41:23,236][106225] Updated weights for policy 1, policy_version 1176140 (0.0009) [2023-12-28 03:41:23,298][106225] Updated weights for policy 1, policy_version 1176150 (0.0009) [2023-12-28 03:41:23,364][106225] Updated weights for policy 1, policy_version 1176160 (0.0008) [2023-12-28 03:41:23,382][106226] Updated weights for policy 0, policy_version 1173121 (0.0005) [2023-12-28 03:41:23,427][106226] Updated weights for policy 0, policy_version 1173131 (0.0005) [2023-12-28 03:41:23,479][106226] Updated weights for policy 0, policy_version 1173141 (0.0006) [2023-12-28 03:41:24,075][106226] Updated weights for policy 0, policy_version 1173151 (0.0009) [2023-12-28 03:41:24,138][106226] Updated weights for policy 0, policy_version 1173161 (0.0008) [2023-12-28 03:41:24,142][106225] Updated weights for policy 1, policy_version 1176170 (0.0008) [2023-12-28 03:41:24,198][106226] Updated weights for policy 0, policy_version 1173171 (0.0006) [2023-12-28 03:41:24,199][106225] Updated weights for policy 1, policy_version 1176180 (0.0008) [2023-12-28 03:41:24,259][106225] Updated weights for policy 1, policy_version 1176190 (0.0009) [2023-12-28 03:41:24,318][106225] Updated weights for policy 1, policy_version 1176200 (0.0009) [2023-12-28 03:41:24,814][106226] Updated weights for policy 0, policy_version 1173181 (0.0007) [2023-12-28 03:41:24,899][106226] Updated weights for policy 0, policy_version 1173191 (0.0005) [2023-12-28 03:41:24,953][106226] Updated weights for policy 0, policy_version 1173201 (0.0005) [2023-12-28 03:41:25,057][106225] Updated weights for policy 1, policy_version 1176210 (0.0010) [2023-12-28 03:41:25,104][106225] Updated weights for policy 1, policy_version 1176220 (0.0010) [2023-12-28 03:41:25,158][106225] Updated weights for policy 1, policy_version 1176230 (0.0010) [2023-12-28 03:41:25,471][106226] Updated weights for policy 0, policy_version 1173211 (0.0005) [2023-12-28 03:41:25,531][106226] Updated weights for policy 0, policy_version 1173221 (0.0005) [2023-12-28 03:41:25,592][106226] Updated weights for policy 0, policy_version 1173231 (0.0005) [2023-12-28 03:41:25,852][106225] Updated weights for policy 1, policy_version 1176240 (0.0010) [2023-12-28 03:41:25,898][106225] Updated weights for policy 1, policy_version 1176250 (0.0010) [2023-12-28 03:41:25,945][106225] Updated weights for policy 1, policy_version 1176260 (0.0007) [2023-12-28 03:41:26,103][106226] Updated weights for policy 0, policy_version 1173241 (0.0006) [2023-12-28 03:41:26,166][106226] Updated weights for policy 0, policy_version 1173251 (0.0011) [2023-12-28 03:41:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 601579520. Throughput: 0: 9808.6, 1: 9999.5. Samples: 601546636. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:26,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.096')] [2023-12-28 03:41:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001176264_301170688.pth... [2023-12-28 03:41:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001175112_300875776.pth [2023-12-28 03:41:26,223][106226] Updated weights for policy 0, policy_version 1173261 (0.0011) [2023-12-28 03:41:26,276][106226] Updated weights for policy 0, policy_version 1173271 (0.0010) [2023-12-28 03:41:26,278][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001173272_300417024.pth... [2023-12-28 03:41:26,282][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001172088_300113920.pth [2023-12-28 03:41:26,661][106225] Updated weights for policy 1, policy_version 1176270 (0.0005) [2023-12-28 03:41:26,707][106225] Updated weights for policy 1, policy_version 1176280 (0.0005) [2023-12-28 03:41:26,752][106225] Updated weights for policy 1, policy_version 1176290 (0.0005) [2023-12-28 03:41:26,984][106226] Updated weights for policy 0, policy_version 1173281 (0.0006) [2023-12-28 03:41:27,047][106226] Updated weights for policy 0, policy_version 1173291 (0.0005) [2023-12-28 03:41:27,105][106226] Updated weights for policy 0, policy_version 1173301 (0.0008) [2023-12-28 03:41:27,437][106225] Updated weights for policy 1, policy_version 1176300 (0.0007) [2023-12-28 03:41:27,486][106225] Updated weights for policy 1, policy_version 1176310 (0.0010) [2023-12-28 03:41:27,546][106225] Updated weights for policy 1, policy_version 1176320 (0.0010) [2023-12-28 03:41:27,697][106226] Updated weights for policy 0, policy_version 1173311 (0.0008) [2023-12-28 03:41:27,763][106226] Updated weights for policy 0, policy_version 1173321 (0.0006) [2023-12-28 03:41:27,821][106226] Updated weights for policy 0, policy_version 1173331 (0.0005) [2023-12-28 03:41:28,260][106225] Updated weights for policy 1, policy_version 1176330 (0.0010) [2023-12-28 03:41:28,346][106225] Updated weights for policy 1, policy_version 1176340 (0.0010) [2023-12-28 03:41:28,349][106226] Updated weights for policy 0, policy_version 1173341 (0.0007) [2023-12-28 03:41:28,412][106225] Updated weights for policy 1, policy_version 1176350 (0.0007) [2023-12-28 03:41:28,416][106226] Updated weights for policy 0, policy_version 1173351 (0.0009) [2023-12-28 03:41:28,474][106225] Updated weights for policy 1, policy_version 1176360 (0.0008) [2023-12-28 03:41:28,479][106226] Updated weights for policy 0, policy_version 1173361 (0.0008) [2023-12-28 03:41:29,103][106225] Updated weights for policy 1, policy_version 1176370 (0.0010) [2023-12-28 03:41:29,136][106226] Updated weights for policy 0, policy_version 1173371 (0.0008) [2023-12-28 03:41:29,161][106225] Updated weights for policy 1, policy_version 1176380 (0.0007) [2023-12-28 03:41:29,202][106226] Updated weights for policy 0, policy_version 1173381 (0.0008) [2023-12-28 03:41:29,228][106225] Updated weights for policy 1, policy_version 1176390 (0.0006) [2023-12-28 03:41:29,300][106226] Updated weights for policy 0, policy_version 1173391 (0.0007) [2023-12-28 03:41:29,959][106225] Updated weights for policy 1, policy_version 1176400 (0.0010) [2023-12-28 03:41:30,014][106225] Updated weights for policy 1, policy_version 1176410 (0.0008) [2023-12-28 03:41:30,026][106226] Updated weights for policy 0, policy_version 1173401 (0.0009) [2023-12-28 03:41:30,062][106225] Updated weights for policy 1, policy_version 1176420 (0.0010) [2023-12-28 03:41:30,075][106226] Updated weights for policy 0, policy_version 1173411 (0.0009) [2023-12-28 03:41:30,126][106226] Updated weights for policy 0, policy_version 1173421 (0.0007) [2023-12-28 03:41:30,183][106226] Updated weights for policy 0, policy_version 1173431 (0.0005) [2023-12-28 03:41:30,731][106225] Updated weights for policy 1, policy_version 1176430 (0.0010) [2023-12-28 03:41:30,759][106226] Updated weights for policy 0, policy_version 1173441 (0.0007) [2023-12-28 03:41:30,784][106225] Updated weights for policy 1, policy_version 1176440 (0.0010) [2023-12-28 03:41:30,815][106226] Updated weights for policy 0, policy_version 1173451 (0.0006) [2023-12-28 03:41:30,834][106225] Updated weights for policy 1, policy_version 1176450 (0.0010) [2023-12-28 03:41:30,867][106226] Updated weights for policy 0, policy_version 1173461 (0.0005) [2023-12-28 03:41:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 601686016. Throughput: 0: 9974.4, 1: 10035.7. Samples: 601671640. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:31,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-4.592')] [2023-12-28 03:41:31,556][106226] Updated weights for policy 0, policy_version 1173471 (0.0008) [2023-12-28 03:41:31,562][106225] Updated weights for policy 1, policy_version 1176460 (0.0008) [2023-12-28 03:41:31,606][106226] Updated weights for policy 0, policy_version 1173481 (0.0008) [2023-12-28 03:41:31,619][106225] Updated weights for policy 1, policy_version 1176470 (0.0006) [2023-12-28 03:41:31,673][106226] Updated weights for policy 0, policy_version 1173491 (0.0007) [2023-12-28 03:41:31,686][106225] Updated weights for policy 1, policy_version 1176480 (0.0008) [2023-12-28 03:41:32,325][106225] Updated weights for policy 1, policy_version 1176490 (0.0008) [2023-12-28 03:41:32,390][106225] Updated weights for policy 1, policy_version 1176500 (0.0008) [2023-12-28 03:41:32,448][106225] Updated weights for policy 1, policy_version 1176510 (0.0007) [2023-12-28 03:41:32,477][106226] Updated weights for policy 0, policy_version 1173501 (0.0008) [2023-12-28 03:41:32,510][106225] Updated weights for policy 1, policy_version 1176520 (0.0006) [2023-12-28 03:41:32,536][106226] Updated weights for policy 0, policy_version 1173511 (0.0009) [2023-12-28 03:41:32,592][106226] Updated weights for policy 0, policy_version 1173521 (0.0008) [2023-12-28 03:41:33,070][106225] Updated weights for policy 1, policy_version 1176530 (0.0005) [2023-12-28 03:41:33,115][106225] Updated weights for policy 1, policy_version 1176540 (0.0005) [2023-12-28 03:41:33,177][106225] Updated weights for policy 1, policy_version 1176550 (0.0005) [2023-12-28 03:41:33,396][106226] Updated weights for policy 0, policy_version 1173531 (0.0010) [2023-12-28 03:41:33,445][106226] Updated weights for policy 0, policy_version 1173541 (0.0009) [2023-12-28 03:41:33,500][106226] Updated weights for policy 0, policy_version 1173551 (0.0005) [2023-12-28 03:41:33,714][106225] Updated weights for policy 1, policy_version 1176560 (0.0007) [2023-12-28 03:41:33,775][106225] Updated weights for policy 1, policy_version 1176570 (0.0009) [2023-12-28 03:41:33,838][106225] Updated weights for policy 1, policy_version 1176580 (0.0010) [2023-12-28 03:41:34,053][106226] Updated weights for policy 0, policy_version 1173561 (0.0006) [2023-12-28 03:41:34,111][106226] Updated weights for policy 0, policy_version 1173571 (0.0005) [2023-12-28 03:41:34,177][106226] Updated weights for policy 0, policy_version 1173581 (0.0008) [2023-12-28 03:41:34,234][106226] Updated weights for policy 0, policy_version 1173591 (0.0007) [2023-12-28 03:41:34,524][106225] Updated weights for policy 1, policy_version 1176590 (0.0009) [2023-12-28 03:41:34,587][106225] Updated weights for policy 1, policy_version 1176600 (0.0008) [2023-12-28 03:41:34,650][106225] Updated weights for policy 1, policy_version 1176610 (0.0008) [2023-12-28 03:41:34,934][106226] Updated weights for policy 0, policy_version 1173601 (0.0006) [2023-12-28 03:41:34,998][106226] Updated weights for policy 0, policy_version 1173611 (0.0007) [2023-12-28 03:41:35,058][106226] Updated weights for policy 0, policy_version 1173621 (0.0006) [2023-12-28 03:41:35,276][106225] Updated weights for policy 1, policy_version 1176620 (0.0008) [2023-12-28 03:41:35,331][106225] Updated weights for policy 1, policy_version 1176630 (0.0008) [2023-12-28 03:41:35,390][106225] Updated weights for policy 1, policy_version 1176640 (0.0008) [2023-12-28 03:41:35,736][106226] Updated weights for policy 0, policy_version 1173631 (0.0007) [2023-12-28 03:41:35,797][106226] Updated weights for policy 0, policy_version 1173641 (0.0008) [2023-12-28 03:41:35,862][106226] Updated weights for policy 0, policy_version 1173651 (0.0005) [2023-12-28 03:41:36,135][106225] Updated weights for policy 1, policy_version 1176650 (0.0008) [2023-12-28 03:41:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 601784320. Throughput: 0: 10033.3, 1: 10077.2. Samples: 601795492. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:36,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-5.168')] [2023-12-28 03:41:36,198][106225] Updated weights for policy 1, policy_version 1176660 (0.0008) [2023-12-28 03:41:36,265][106225] Updated weights for policy 1, policy_version 1176670 (0.0008) [2023-12-28 03:41:36,332][106225] Updated weights for policy 1, policy_version 1176680 (0.0009) [2023-12-28 03:41:36,566][106226] Updated weights for policy 0, policy_version 1173661 (0.0006) [2023-12-28 03:41:36,627][106226] Updated weights for policy 0, policy_version 1173671 (0.0005) [2023-12-28 03:41:36,686][106226] Updated weights for policy 0, policy_version 1173681 (0.0006) [2023-12-28 03:41:37,022][106225] Updated weights for policy 1, policy_version 1176690 (0.0008) [2023-12-28 03:41:37,073][106225] Updated weights for policy 1, policy_version 1176700 (0.0008) [2023-12-28 03:41:37,121][106225] Updated weights for policy 1, policy_version 1176710 (0.0008) [2023-12-28 03:41:37,346][106226] Updated weights for policy 0, policy_version 1173691 (0.0009) [2023-12-28 03:41:37,409][106226] Updated weights for policy 0, policy_version 1173701 (0.0011) [2023-12-28 03:41:37,470][106226] Updated weights for policy 0, policy_version 1173711 (0.0010) [2023-12-28 03:41:37,873][106225] Updated weights for policy 1, policy_version 1176720 (0.0008) [2023-12-28 03:41:37,929][106225] Updated weights for policy 1, policy_version 1176730 (0.0007) [2023-12-28 03:41:37,993][106225] Updated weights for policy 1, policy_version 1176740 (0.0008) [2023-12-28 03:41:38,174][106226] Updated weights for policy 0, policy_version 1173721 (0.0011) [2023-12-28 03:41:38,228][106226] Updated weights for policy 0, policy_version 1173731 (0.0005) [2023-12-28 03:41:38,292][106226] Updated weights for policy 0, policy_version 1173741 (0.0009) [2023-12-28 03:41:38,353][106226] Updated weights for policy 0, policy_version 1173751 (0.0009) [2023-12-28 03:41:38,726][106225] Updated weights for policy 1, policy_version 1176750 (0.0007) [2023-12-28 03:41:38,789][106225] Updated weights for policy 1, policy_version 1176760 (0.0008) [2023-12-28 03:41:38,849][106225] Updated weights for policy 1, policy_version 1176770 (0.0008) [2023-12-28 03:41:39,053][106226] Updated weights for policy 0, policy_version 1173761 (0.0010) [2023-12-28 03:41:39,098][106226] Updated weights for policy 0, policy_version 1173771 (0.0008) [2023-12-28 03:41:39,161][106226] Updated weights for policy 0, policy_version 1173781 (0.0009) [2023-12-28 03:41:39,648][106225] Updated weights for policy 1, policy_version 1176780 (0.0008) [2023-12-28 03:41:39,710][106225] Updated weights for policy 1, policy_version 1176790 (0.0009) [2023-12-28 03:41:39,775][106225] Updated weights for policy 1, policy_version 1176800 (0.0009) [2023-12-28 03:41:39,904][106226] Updated weights for policy 0, policy_version 1173791 (0.0009) [2023-12-28 03:41:39,974][106226] Updated weights for policy 0, policy_version 1173801 (0.0009) [2023-12-28 03:41:40,035][106226] Updated weights for policy 0, policy_version 1173811 (0.0009) [2023-12-28 03:41:40,523][106225] Updated weights for policy 1, policy_version 1176810 (0.0009) [2023-12-28 03:41:40,583][106225] Updated weights for policy 1, policy_version 1176820 (0.0007) [2023-12-28 03:41:40,646][106225] Updated weights for policy 1, policy_version 1176830 (0.0009) [2023-12-28 03:41:40,700][106225] Updated weights for policy 1, policy_version 1176840 (0.0008) [2023-12-28 03:41:40,793][106226] Updated weights for policy 0, policy_version 1173821 (0.0007) [2023-12-28 03:41:40,844][106226] Updated weights for policy 0, policy_version 1173831 (0.0005) [2023-12-28 03:41:40,900][106226] Updated weights for policy 0, policy_version 1173841 (0.0005) [2023-12-28 03:41:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 601882624. Throughput: 0: 10068.9, 1: 10068.5. Samples: 601853876. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:41,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-4.741')] [2023-12-28 03:41:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001173848_300564480.pth... [2023-12-28 03:41:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001176840_301318144.pth... [2023-12-28 03:41:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001172664_300261376.pth [2023-12-28 03:41:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001175688_301023232.pth [2023-12-28 03:41:41,429][106225] Updated weights for policy 1, policy_version 1176850 (0.0012) [2023-12-28 03:41:41,493][106225] Updated weights for policy 1, policy_version 1176860 (0.0011) [2023-12-28 03:41:41,548][106225] Updated weights for policy 1, policy_version 1176870 (0.0010) [2023-12-28 03:41:41,596][106226] Updated weights for policy 0, policy_version 1173851 (0.0006) [2023-12-28 03:41:41,666][106226] Updated weights for policy 0, policy_version 1173861 (0.0007) [2023-12-28 03:41:41,731][106226] Updated weights for policy 0, policy_version 1173871 (0.0009) [2023-12-28 03:41:42,330][106225] Updated weights for policy 1, policy_version 1176880 (0.0009) [2023-12-28 03:41:42,399][106226] Updated weights for policy 0, policy_version 1173881 (0.0009) [2023-12-28 03:41:42,403][106225] Updated weights for policy 1, policy_version 1176890 (0.0008) [2023-12-28 03:41:42,467][106226] Updated weights for policy 0, policy_version 1173891 (0.0006) [2023-12-28 03:41:42,469][106225] Updated weights for policy 1, policy_version 1176900 (0.0008) [2023-12-28 03:41:42,531][106226] Updated weights for policy 0, policy_version 1173901 (0.0010) [2023-12-28 03:41:42,595][106226] Updated weights for policy 0, policy_version 1173911 (0.0009) [2023-12-28 03:41:43,044][106225] Updated weights for policy 1, policy_version 1176910 (0.0006) [2023-12-28 03:41:43,098][106225] Updated weights for policy 1, policy_version 1176920 (0.0005) [2023-12-28 03:41:43,155][106225] Updated weights for policy 1, policy_version 1176930 (0.0005) [2023-12-28 03:41:43,410][106226] Updated weights for policy 0, policy_version 1173921 (0.0011) [2023-12-28 03:41:43,470][106226] Updated weights for policy 0, policy_version 1173931 (0.0009) [2023-12-28 03:41:43,524][106226] Updated weights for policy 0, policy_version 1173941 (0.0010) [2023-12-28 03:41:43,671][106225] Updated weights for policy 1, policy_version 1176940 (0.0005) [2023-12-28 03:41:43,728][106225] Updated weights for policy 1, policy_version 1176950 (0.0005) [2023-12-28 03:41:43,776][106225] Updated weights for policy 1, policy_version 1176960 (0.0005) [2023-12-28 03:41:44,297][106226] Updated weights for policy 0, policy_version 1173951 (0.0006) [2023-12-28 03:41:44,332][106225] Updated weights for policy 1, policy_version 1176970 (0.0005) [2023-12-28 03:41:44,357][106226] Updated weights for policy 0, policy_version 1173961 (0.0008) [2023-12-28 03:41:44,394][106225] Updated weights for policy 1, policy_version 1176980 (0.0006) [2023-12-28 03:41:44,406][106226] Updated weights for policy 0, policy_version 1173971 (0.0008) [2023-12-28 03:41:44,455][106225] Updated weights for policy 1, policy_version 1176990 (0.0009) [2023-12-28 03:41:44,512][106225] Updated weights for policy 1, policy_version 1177000 (0.0010) [2023-12-28 03:41:45,097][106226] Updated weights for policy 0, policy_version 1173981 (0.0009) [2023-12-28 03:41:45,166][106226] Updated weights for policy 0, policy_version 1173991 (0.0009) [2023-12-28 03:41:45,197][106225] Updated weights for policy 1, policy_version 1177010 (0.0009) [2023-12-28 03:41:45,230][106226] Updated weights for policy 0, policy_version 1174001 (0.0011) [2023-12-28 03:41:45,263][106225] Updated weights for policy 1, policy_version 1177020 (0.0008) [2023-12-28 03:41:45,326][106225] Updated weights for policy 1, policy_version 1177030 (0.0008) [2023-12-28 03:41:45,938][106225] Updated weights for policy 1, policy_version 1177040 (0.0006) [2023-12-28 03:41:45,938][106226] Updated weights for policy 0, policy_version 1174011 (0.0011) [2023-12-28 03:41:45,989][106226] Updated weights for policy 0, policy_version 1174021 (0.0010) [2023-12-28 03:41:45,996][106225] Updated weights for policy 1, policy_version 1177050 (0.0005) [2023-12-28 03:41:46,038][106226] Updated weights for policy 0, policy_version 1174031 (0.0009) [2023-12-28 03:41:46,050][106225] Updated weights for policy 1, policy_version 1177060 (0.0005) [2023-12-28 03:41:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 601989120. Throughput: 0: 10052.8, 1: 10095.3. Samples: 601971396. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:46,176][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.599')] [2023-12-28 03:41:46,600][106225] Updated weights for policy 1, policy_version 1177070 (0.0005) [2023-12-28 03:41:46,647][106225] Updated weights for policy 1, policy_version 1177080 (0.0005) [2023-12-28 03:41:46,697][106225] Updated weights for policy 1, policy_version 1177090 (0.0007) [2023-12-28 03:41:46,774][106226] Updated weights for policy 0, policy_version 1174041 (0.0009) [2023-12-28 03:41:46,831][106226] Updated weights for policy 0, policy_version 1174051 (0.0007) [2023-12-28 03:41:46,887][106226] Updated weights for policy 0, policy_version 1174061 (0.0009) [2023-12-28 03:41:46,936][106226] Updated weights for policy 0, policy_version 1174071 (0.0008) [2023-12-28 03:41:47,353][106225] Updated weights for policy 1, policy_version 1177100 (0.0007) [2023-12-28 03:41:47,410][106225] Updated weights for policy 1, policy_version 1177110 (0.0005) [2023-12-28 03:41:47,473][106225] Updated weights for policy 1, policy_version 1177120 (0.0005) [2023-12-28 03:41:47,742][106226] Updated weights for policy 0, policy_version 1174081 (0.0009) [2023-12-28 03:41:47,797][106226] Updated weights for policy 0, policy_version 1174091 (0.0009) [2023-12-28 03:41:47,860][106226] Updated weights for policy 0, policy_version 1174101 (0.0009) [2023-12-28 03:41:48,002][106225] Updated weights for policy 1, policy_version 1177130 (0.0006) [2023-12-28 03:41:48,049][106225] Updated weights for policy 1, policy_version 1177140 (0.0005) [2023-12-28 03:41:48,121][106225] Updated weights for policy 1, policy_version 1177150 (0.0006) [2023-12-28 03:41:48,180][106225] Updated weights for policy 1, policy_version 1177160 (0.0005) [2023-12-28 03:41:48,581][106226] Updated weights for policy 0, policy_version 1174111 (0.0008) [2023-12-28 03:41:48,640][106226] Updated weights for policy 0, policy_version 1174121 (0.0009) [2023-12-28 03:41:48,709][106226] Updated weights for policy 0, policy_version 1174131 (0.0008) [2023-12-28 03:41:48,780][106225] Updated weights for policy 1, policy_version 1177170 (0.0008) [2023-12-28 03:41:48,841][106225] Updated weights for policy 1, policy_version 1177180 (0.0007) [2023-12-28 03:41:48,904][106225] Updated weights for policy 1, policy_version 1177190 (0.0008) [2023-12-28 03:41:49,511][106226] Updated weights for policy 0, policy_version 1174141 (0.0009) [2023-12-28 03:41:49,567][106225] Updated weights for policy 1, policy_version 1177200 (0.0007) [2023-12-28 03:41:49,571][106226] Updated weights for policy 0, policy_version 1174151 (0.0009) [2023-12-28 03:41:49,616][106225] Updated weights for policy 1, policy_version 1177210 (0.0009) [2023-12-28 03:41:49,630][106226] Updated weights for policy 0, policy_version 1174161 (0.0007) [2023-12-28 03:41:49,665][106225] Updated weights for policy 1, policy_version 1177220 (0.0006) [2023-12-28 03:41:50,310][106226] Updated weights for policy 0, policy_version 1174171 (0.0007) [2023-12-28 03:41:50,374][106226] Updated weights for policy 0, policy_version 1174181 (0.0009) [2023-12-28 03:41:50,424][106225] Updated weights for policy 1, policy_version 1177230 (0.0008) [2023-12-28 03:41:50,437][106226] Updated weights for policy 0, policy_version 1174191 (0.0007) [2023-12-28 03:41:50,492][106225] Updated weights for policy 1, policy_version 1177240 (0.0006) [2023-12-28 03:41:50,545][106225] Updated weights for policy 1, policy_version 1177250 (0.0009) [2023-12-28 03:41:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 602079232. Throughput: 0: 9965.2, 1: 10164.6. Samples: 602091956. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:51,175][105115] Avg episode reward: [(0, '-4.668'), (1, '-4.747')] [2023-12-28 03:41:51,188][106226] Updated weights for policy 0, policy_version 1174201 (0.0006) [2023-12-28 03:41:51,248][106226] Updated weights for policy 0, policy_version 1174211 (0.0006) [2023-12-28 03:41:51,309][106226] Updated weights for policy 0, policy_version 1174221 (0.0009) [2023-12-28 03:41:51,320][106225] Updated weights for policy 1, policy_version 1177260 (0.0009) [2023-12-28 03:41:51,379][106226] Updated weights for policy 0, policy_version 1174231 (0.0011) [2023-12-28 03:41:51,394][106225] Updated weights for policy 1, policy_version 1177270 (0.0008) [2023-12-28 03:41:51,450][106225] Updated weights for policy 1, policy_version 1177280 (0.0008) [2023-12-28 03:41:52,091][106226] Updated weights for policy 0, policy_version 1174241 (0.0011) [2023-12-28 03:41:52,145][106226] Updated weights for policy 0, policy_version 1174251 (0.0011) [2023-12-28 03:41:52,200][106226] Updated weights for policy 0, policy_version 1174261 (0.0010) [2023-12-28 03:41:52,226][106225] Updated weights for policy 1, policy_version 1177290 (0.0007) [2023-12-28 03:41:52,287][106225] Updated weights for policy 1, policy_version 1177300 (0.0009) [2023-12-28 03:41:52,360][106225] Updated weights for policy 1, policy_version 1177310 (0.0008) [2023-12-28 03:41:52,428][106225] Updated weights for policy 1, policy_version 1177320 (0.0008) [2023-12-28 03:41:52,957][106226] Updated weights for policy 0, policy_version 1174271 (0.0009) [2023-12-28 03:41:53,020][106226] Updated weights for policy 0, policy_version 1174281 (0.0006) [2023-12-28 03:41:53,088][106226] Updated weights for policy 0, policy_version 1174291 (0.0005) [2023-12-28 03:41:53,124][106225] Updated weights for policy 1, policy_version 1177330 (0.0008) [2023-12-28 03:41:53,184][106225] Updated weights for policy 1, policy_version 1177340 (0.0008) [2023-12-28 03:41:53,245][106225] Updated weights for policy 1, policy_version 1177350 (0.0010) [2023-12-28 03:41:53,648][106226] Updated weights for policy 0, policy_version 1174301 (0.0005) [2023-12-28 03:41:53,694][106226] Updated weights for policy 0, policy_version 1174311 (0.0005) [2023-12-28 03:41:53,741][106226] Updated weights for policy 0, policy_version 1174321 (0.0007) [2023-12-28 03:41:54,052][106225] Updated weights for policy 1, policy_version 1177360 (0.0009) [2023-12-28 03:41:54,109][106225] Updated weights for policy 1, policy_version 1177370 (0.0008) [2023-12-28 03:41:54,159][106225] Updated weights for policy 1, policy_version 1177381 (0.0008) [2023-12-28 03:41:54,359][106226] Updated weights for policy 0, policy_version 1174331 (0.0007) [2023-12-28 03:41:54,421][106226] Updated weights for policy 0, policy_version 1174341 (0.0009) [2023-12-28 03:41:54,480][106226] Updated weights for policy 0, policy_version 1174351 (0.0009) [2023-12-28 03:41:54,994][106225] Updated weights for policy 1, policy_version 1177391 (0.0009) [2023-12-28 03:41:55,052][106225] Updated weights for policy 1, policy_version 1177401 (0.0008) [2023-12-28 03:41:55,066][106226] Updated weights for policy 0, policy_version 1174361 (0.0009) [2023-12-28 03:41:55,112][106225] Updated weights for policy 1, policy_version 1177411 (0.0008) [2023-12-28 03:41:55,126][106226] Updated weights for policy 0, policy_version 1174371 (0.0008) [2023-12-28 03:41:55,181][106226] Updated weights for policy 0, policy_version 1174381 (0.0008) [2023-12-28 03:41:55,242][106226] Updated weights for policy 0, policy_version 1174391 (0.0008) [2023-12-28 03:41:55,759][106225] Updated weights for policy 1, policy_version 1177421 (0.0008) [2023-12-28 03:41:55,811][106225] Updated weights for policy 1, policy_version 1177431 (0.0006) [2023-12-28 03:41:55,833][106226] Updated weights for policy 0, policy_version 1174401 (0.0006) [2023-12-28 03:41:55,880][106225] Updated weights for policy 1, policy_version 1177441 (0.0005) [2023-12-28 03:41:55,897][106226] Updated weights for policy 0, policy_version 1174411 (0.0006) [2023-12-28 03:41:55,960][106226] Updated weights for policy 0, policy_version 1174421 (0.0006) [2023-12-28 03:41:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 602185728. Throughput: 0: 9940.5, 1: 10067.3. Samples: 602150496. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:41:56,176][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.970')] [2023-12-28 03:41:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001177448_301473792.pth... [2023-12-28 03:41:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001174424_300711936.pth... [2023-12-28 03:41:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001176264_301170688.pth [2023-12-28 03:41:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001173272_300417024.pth [2023-12-28 03:41:56,580][106225] Updated weights for policy 1, policy_version 1177451 (0.0005) [2023-12-28 03:41:56,590][106226] Updated weights for policy 0, policy_version 1174431 (0.0009) [2023-12-28 03:41:56,633][106225] Updated weights for policy 1, policy_version 1177461 (0.0005) [2023-12-28 03:41:56,638][106226] Updated weights for policy 0, policy_version 1174441 (0.0008) [2023-12-28 03:41:56,680][106225] Updated weights for policy 1, policy_version 1177471 (0.0005) [2023-12-28 03:41:56,692][106226] Updated weights for policy 0, policy_version 1174451 (0.0005) [2023-12-28 03:41:57,297][106226] Updated weights for policy 0, policy_version 1174461 (0.0006) [2023-12-28 03:41:57,354][106226] Updated weights for policy 0, policy_version 1174471 (0.0008) [2023-12-28 03:41:57,377][106225] Updated weights for policy 1, policy_version 1177481 (0.0010) [2023-12-28 03:41:57,407][106226] Updated weights for policy 0, policy_version 1174481 (0.0006) [2023-12-28 03:41:57,430][106225] Updated weights for policy 1, policy_version 1177491 (0.0008) [2023-12-28 03:41:57,485][106225] Updated weights for policy 1, policy_version 1177501 (0.0009) [2023-12-28 03:41:57,536][106225] Updated weights for policy 1, policy_version 1177511 (0.0008) [2023-12-28 03:41:58,122][106226] Updated weights for policy 0, policy_version 1174491 (0.0008) [2023-12-28 03:41:58,174][106226] Updated weights for policy 0, policy_version 1174501 (0.0008) [2023-12-28 03:41:58,189][106225] Updated weights for policy 1, policy_version 1177521 (0.0007) [2023-12-28 03:41:58,240][106226] Updated weights for policy 0, policy_version 1174511 (0.0007) [2023-12-28 03:41:58,254][106225] Updated weights for policy 1, policy_version 1177531 (0.0007) [2023-12-28 03:41:58,315][106225] Updated weights for policy 1, policy_version 1177541 (0.0007) [2023-12-28 03:41:59,042][106226] Updated weights for policy 0, policy_version 1174521 (0.0007) [2023-12-28 03:41:59,104][106226] Updated weights for policy 0, policy_version 1174531 (0.0009) [2023-12-28 03:41:59,117][106225] Updated weights for policy 1, policy_version 1177551 (0.0009) [2023-12-28 03:41:59,167][106226] Updated weights for policy 0, policy_version 1174541 (0.0008) [2023-12-28 03:41:59,183][106225] Updated weights for policy 1, policy_version 1177561 (0.0007) [2023-12-28 03:41:59,248][106226] Updated weights for policy 0, policy_version 1174551 (0.0009) [2023-12-28 03:41:59,262][106225] Updated weights for policy 1, policy_version 1177571 (0.0007) [2023-12-28 03:41:59,989][106225] Updated weights for policy 1, policy_version 1177581 (0.0008) [2023-12-28 03:42:00,021][106226] Updated weights for policy 0, policy_version 1174561 (0.0008) [2023-12-28 03:42:00,057][106225] Updated weights for policy 1, policy_version 1177591 (0.0008) [2023-12-28 03:42:00,071][106226] Updated weights for policy 0, policy_version 1174571 (0.0006) [2023-12-28 03:42:00,121][106226] Updated weights for policy 0, policy_version 1174581 (0.0005) [2023-12-28 03:42:00,122][106225] Updated weights for policy 1, policy_version 1177601 (0.0008) [2023-12-28 03:42:00,702][106225] Updated weights for policy 1, policy_version 1177611 (0.0008) [2023-12-28 03:42:00,752][106225] Updated weights for policy 1, policy_version 1177621 (0.0010) [2023-12-28 03:42:00,804][106226] Updated weights for policy 0, policy_version 1174591 (0.0006) [2023-12-28 03:42:00,805][106225] Updated weights for policy 1, policy_version 1177631 (0.0009) [2023-12-28 03:42:00,857][106226] Updated weights for policy 0, policy_version 1174601 (0.0010) [2023-12-28 03:42:00,917][106226] Updated weights for policy 0, policy_version 1174611 (0.0009) [2023-12-28 03:42:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 602284032. Throughput: 0: 10011.7, 1: 9969.0. Samples: 602268748. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:01,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.807')] [2023-12-28 03:42:01,509][106225] Updated weights for policy 1, policy_version 1177641 (0.0006) [2023-12-28 03:42:01,569][106225] Updated weights for policy 1, policy_version 1177651 (0.0008) [2023-12-28 03:42:01,578][106226] Updated weights for policy 0, policy_version 1174621 (0.0005) [2023-12-28 03:42:01,625][106225] Updated weights for policy 1, policy_version 1177661 (0.0011) [2023-12-28 03:42:01,639][106226] Updated weights for policy 0, policy_version 1174631 (0.0007) [2023-12-28 03:42:01,689][106225] Updated weights for policy 1, policy_version 1177671 (0.0009) [2023-12-28 03:42:01,700][106226] Updated weights for policy 0, policy_version 1174641 (0.0008) [2023-12-28 03:42:02,394][106225] Updated weights for policy 1, policy_version 1177681 (0.0006) [2023-12-28 03:42:02,428][106226] Updated weights for policy 0, policy_version 1174651 (0.0008) [2023-12-28 03:42:02,453][106225] Updated weights for policy 1, policy_version 1177691 (0.0005) [2023-12-28 03:42:02,489][106226] Updated weights for policy 0, policy_version 1174661 (0.0008) [2023-12-28 03:42:02,512][106225] Updated weights for policy 1, policy_version 1177701 (0.0009) [2023-12-28 03:42:02,546][106226] Updated weights for policy 0, policy_version 1174671 (0.0007) [2023-12-28 03:42:03,142][106225] Updated weights for policy 1, policy_version 1177711 (0.0010) [2023-12-28 03:42:03,194][106225] Updated weights for policy 1, policy_version 1177721 (0.0010) [2023-12-28 03:42:03,250][106225] Updated weights for policy 1, policy_version 1177731 (0.0010) [2023-12-28 03:42:03,316][106226] Updated weights for policy 0, policy_version 1174681 (0.0008) [2023-12-28 03:42:03,362][106226] Updated weights for policy 0, policy_version 1174691 (0.0008) [2023-12-28 03:42:03,413][106226] Updated weights for policy 0, policy_version 1174701 (0.0008) [2023-12-28 03:42:03,470][106226] Updated weights for policy 0, policy_version 1174711 (0.0008) [2023-12-28 03:42:03,951][106225] Updated weights for policy 1, policy_version 1177741 (0.0010) [2023-12-28 03:42:04,017][106225] Updated weights for policy 1, policy_version 1177751 (0.0010) [2023-12-28 03:42:04,074][106225] Updated weights for policy 1, policy_version 1177761 (0.0010) [2023-12-28 03:42:04,096][106226] Updated weights for policy 0, policy_version 1174721 (0.0006) [2023-12-28 03:42:04,158][106226] Updated weights for policy 0, policy_version 1174731 (0.0007) [2023-12-28 03:42:04,213][106226] Updated weights for policy 0, policy_version 1174741 (0.0008) [2023-12-28 03:42:04,798][106225] Updated weights for policy 1, policy_version 1177771 (0.0011) [2023-12-28 03:42:04,861][106225] Updated weights for policy 1, policy_version 1177781 (0.0010) [2023-12-28 03:42:04,888][106226] Updated weights for policy 0, policy_version 1174751 (0.0006) [2023-12-28 03:42:04,915][106225] Updated weights for policy 1, policy_version 1177791 (0.0006) [2023-12-28 03:42:04,945][106226] Updated weights for policy 0, policy_version 1174761 (0.0005) [2023-12-28 03:42:05,005][106226] Updated weights for policy 0, policy_version 1174771 (0.0009) [2023-12-28 03:42:05,450][106225] Updated weights for policy 1, policy_version 1177801 (0.0005) [2023-12-28 03:42:05,512][106225] Updated weights for policy 1, policy_version 1177811 (0.0005) [2023-12-28 03:42:05,579][106225] Updated weights for policy 1, policy_version 1177821 (0.0009) [2023-12-28 03:42:05,635][106225] Updated weights for policy 1, policy_version 1177831 (0.0010) [2023-12-28 03:42:05,699][106226] Updated weights for policy 0, policy_version 1174781 (0.0007) [2023-12-28 03:42:05,761][106226] Updated weights for policy 0, policy_version 1174791 (0.0010) [2023-12-28 03:42:05,825][106226] Updated weights for policy 0, policy_version 1174801 (0.0011) [2023-12-28 03:42:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 602382336. Throughput: 0: 10028.1, 1: 10058.8. Samples: 602392212. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:06,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.547')] [2023-12-28 03:42:06,326][106225] Updated weights for policy 1, policy_version 1177841 (0.0011) [2023-12-28 03:42:06,389][106225] Updated weights for policy 1, policy_version 1177851 (0.0011) [2023-12-28 03:42:06,449][106225] Updated weights for policy 1, policy_version 1177861 (0.0010) [2023-12-28 03:42:06,503][106226] Updated weights for policy 0, policy_version 1174811 (0.0009) [2023-12-28 03:42:06,558][106226] Updated weights for policy 0, policy_version 1174821 (0.0006) [2023-12-28 03:42:06,618][106226] Updated weights for policy 0, policy_version 1174831 (0.0008) [2023-12-28 03:42:07,185][106225] Updated weights for policy 1, policy_version 1177871 (0.0010) [2023-12-28 03:42:07,256][106225] Updated weights for policy 1, policy_version 1177881 (0.0011) [2023-12-28 03:42:07,271][106226] Updated weights for policy 0, policy_version 1174841 (0.0009) [2023-12-28 03:42:07,319][106225] Updated weights for policy 1, policy_version 1177891 (0.0010) [2023-12-28 03:42:07,327][106226] Updated weights for policy 0, policy_version 1174851 (0.0005) [2023-12-28 03:42:07,386][106226] Updated weights for policy 0, policy_version 1174861 (0.0009) [2023-12-28 03:42:07,443][106226] Updated weights for policy 0, policy_version 1174871 (0.0010) [2023-12-28 03:42:08,002][106226] Updated weights for policy 0, policy_version 1174881 (0.0006) [2023-12-28 03:42:08,012][106225] Updated weights for policy 1, policy_version 1177901 (0.0009) [2023-12-28 03:42:08,058][106226] Updated weights for policy 0, policy_version 1174891 (0.0005) [2023-12-28 03:42:08,078][106225] Updated weights for policy 1, policy_version 1177911 (0.0005) [2023-12-28 03:42:08,110][106226] Updated weights for policy 0, policy_version 1174901 (0.0005) [2023-12-28 03:42:08,135][106225] Updated weights for policy 1, policy_version 1177921 (0.0008) [2023-12-28 03:42:08,756][106226] Updated weights for policy 0, policy_version 1174911 (0.0009) [2023-12-28 03:42:08,821][106226] Updated weights for policy 0, policy_version 1174921 (0.0010) [2023-12-28 03:42:08,827][106225] Updated weights for policy 1, policy_version 1177931 (0.0010) [2023-12-28 03:42:08,882][106226] Updated weights for policy 0, policy_version 1174931 (0.0008) [2023-12-28 03:42:08,887][106225] Updated weights for policy 1, policy_version 1177941 (0.0011) [2023-12-28 03:42:08,948][106225] Updated weights for policy 1, policy_version 1177951 (0.0010) [2023-12-28 03:42:09,595][106226] Updated weights for policy 0, policy_version 1174941 (0.0011) [2023-12-28 03:42:09,616][106225] Updated weights for policy 1, policy_version 1177961 (0.0010) [2023-12-28 03:42:09,657][106226] Updated weights for policy 0, policy_version 1174951 (0.0011) [2023-12-28 03:42:09,670][106225] Updated weights for policy 1, policy_version 1177971 (0.0010) [2023-12-28 03:42:09,718][106226] Updated weights for policy 0, policy_version 1174961 (0.0011) [2023-12-28 03:42:09,731][106225] Updated weights for policy 1, policy_version 1177981 (0.0010) [2023-12-28 03:42:09,795][106225] Updated weights for policy 1, policy_version 1177991 (0.0011) [2023-12-28 03:42:10,459][106226] Updated weights for policy 0, policy_version 1174971 (0.0009) [2023-12-28 03:42:10,529][106226] Updated weights for policy 0, policy_version 1174981 (0.0007) [2023-12-28 03:42:10,533][106225] Updated weights for policy 1, policy_version 1178001 (0.0008) [2023-12-28 03:42:10,592][106226] Updated weights for policy 0, policy_version 1174991 (0.0006) [2023-12-28 03:42:10,603][106225] Updated weights for policy 1, policy_version 1178011 (0.0007) [2023-12-28 03:42:10,663][106225] Updated weights for policy 1, policy_version 1178021 (0.0006) [2023-12-28 03:42:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 602480640. Throughput: 0: 10060.0, 1: 10089.0. Samples: 602453340. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:11,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.730')] [2023-12-28 03:42:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001175000_300859392.pth... [2023-12-28 03:42:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001178024_301621248.pth... [2023-12-28 03:42:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001173848_300564480.pth [2023-12-28 03:42:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001176840_301318144.pth [2023-12-28 03:42:11,263][106226] Updated weights for policy 0, policy_version 1175001 (0.0007) [2023-12-28 03:42:11,320][106225] Updated weights for policy 1, policy_version 1178031 (0.0009) [2023-12-28 03:42:11,322][106226] Updated weights for policy 0, policy_version 1175011 (0.0007) [2023-12-28 03:42:11,389][106225] Updated weights for policy 1, policy_version 1178041 (0.0009) [2023-12-28 03:42:11,394][106226] Updated weights for policy 0, policy_version 1175021 (0.0009) [2023-12-28 03:42:11,450][106225] Updated weights for policy 1, policy_version 1178051 (0.0009) [2023-12-28 03:42:11,452][106226] Updated weights for policy 0, policy_version 1175031 (0.0007) [2023-12-28 03:42:12,222][106225] Updated weights for policy 1, policy_version 1178061 (0.0008) [2023-12-28 03:42:12,223][106226] Updated weights for policy 0, policy_version 1175041 (0.0009) [2023-12-28 03:42:12,283][106226] Updated weights for policy 0, policy_version 1175051 (0.0008) [2023-12-28 03:42:12,285][106225] Updated weights for policy 1, policy_version 1178071 (0.0007) [2023-12-28 03:42:12,348][106225] Updated weights for policy 1, policy_version 1178081 (0.0007) [2023-12-28 03:42:12,350][106226] Updated weights for policy 0, policy_version 1175061 (0.0007) [2023-12-28 03:42:12,978][106225] Updated weights for policy 1, policy_version 1178092 (0.0009) [2023-12-28 03:42:13,040][106225] Updated weights for policy 1, policy_version 1178102 (0.0009) [2023-12-28 03:42:13,081][106226] Updated weights for policy 0, policy_version 1175071 (0.0008) [2023-12-28 03:42:13,095][106225] Updated weights for policy 1, policy_version 1178112 (0.0006) [2023-12-28 03:42:13,126][106226] Updated weights for policy 0, policy_version 1175081 (0.0007) [2023-12-28 03:42:13,171][106226] Updated weights for policy 0, policy_version 1175091 (0.0009) [2023-12-28 03:42:13,773][106225] Updated weights for policy 1, policy_version 1178122 (0.0006) [2023-12-28 03:42:13,841][106225] Updated weights for policy 1, policy_version 1178132 (0.0005) [2023-12-28 03:42:13,900][106225] Updated weights for policy 1, policy_version 1178142 (0.0006) [2023-12-28 03:42:13,956][106225] Updated weights for policy 1, policy_version 1178152 (0.0007) [2023-12-28 03:42:13,959][106226] Updated weights for policy 0, policy_version 1175101 (0.0008) [2023-12-28 03:42:14,009][106226] Updated weights for policy 0, policy_version 1175111 (0.0008) [2023-12-28 03:42:14,060][106226] Updated weights for policy 0, policy_version 1175121 (0.0009) [2023-12-28 03:42:14,518][106225] Updated weights for policy 1, policy_version 1178162 (0.0008) [2023-12-28 03:42:14,564][106225] Updated weights for policy 1, policy_version 1178172 (0.0007) [2023-12-28 03:42:14,618][106225] Updated weights for policy 1, policy_version 1178182 (0.0007) [2023-12-28 03:42:14,835][106226] Updated weights for policy 0, policy_version 1175131 (0.0008) [2023-12-28 03:42:14,903][106226] Updated weights for policy 0, policy_version 1175141 (0.0006) [2023-12-28 03:42:14,964][106226] Updated weights for policy 0, policy_version 1175151 (0.0007) [2023-12-28 03:42:15,342][106225] Updated weights for policy 1, policy_version 1178192 (0.0006) [2023-12-28 03:42:15,399][106225] Updated weights for policy 1, policy_version 1178202 (0.0005) [2023-12-28 03:42:15,453][106225] Updated weights for policy 1, policy_version 1178212 (0.0005) [2023-12-28 03:42:15,615][106226] Updated weights for policy 0, policy_version 1175161 (0.0007) [2023-12-28 03:42:15,662][106226] Updated weights for policy 0, policy_version 1175171 (0.0007) [2023-12-28 03:42:15,720][106226] Updated weights for policy 0, policy_version 1175181 (0.0010) [2023-12-28 03:42:15,777][106226] Updated weights for policy 0, policy_version 1175191 (0.0009) [2023-12-28 03:42:16,009][106225] Updated weights for policy 1, policy_version 1178222 (0.0009) [2023-12-28 03:42:16,062][106225] Updated weights for policy 1, policy_version 1178232 (0.0010) [2023-12-28 03:42:16,116][106225] Updated weights for policy 1, policy_version 1178242 (0.0009) [2023-12-28 03:42:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.3, 300 sec: 19938.5). Total num frames: 602587136. Throughput: 0: 9857.6, 1: 10110.9. Samples: 602570224. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:16,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.565')] [2023-12-28 03:42:16,497][106226] Updated weights for policy 0, policy_version 1175201 (0.0005) [2023-12-28 03:42:16,547][106226] Updated weights for policy 0, policy_version 1175211 (0.0007) [2023-12-28 03:42:16,601][106226] Updated weights for policy 0, policy_version 1175221 (0.0008) [2023-12-28 03:42:16,711][106225] Updated weights for policy 1, policy_version 1178252 (0.0005) [2023-12-28 03:42:16,763][106225] Updated weights for policy 1, policy_version 1178262 (0.0010) [2023-12-28 03:42:16,820][106225] Updated weights for policy 1, policy_version 1178272 (0.0009) [2023-12-28 03:42:17,350][106226] Updated weights for policy 0, policy_version 1175231 (0.0008) [2023-12-28 03:42:17,397][106226] Updated weights for policy 0, policy_version 1175241 (0.0008) [2023-12-28 03:42:17,450][106226] Updated weights for policy 0, policy_version 1175251 (0.0007) [2023-12-28 03:42:17,501][106225] Updated weights for policy 1, policy_version 1178282 (0.0006) [2023-12-28 03:42:17,553][106225] Updated weights for policy 1, policy_version 1178292 (0.0006) [2023-12-28 03:42:17,604][106225] Updated weights for policy 1, policy_version 1178302 (0.0005) [2023-12-28 03:42:17,658][106225] Updated weights for policy 1, policy_version 1178312 (0.0005) [2023-12-28 03:42:18,143][106226] Updated weights for policy 0, policy_version 1175261 (0.0009) [2023-12-28 03:42:18,202][106226] Updated weights for policy 0, policy_version 1175271 (0.0011) [2023-12-28 03:42:18,255][106226] Updated weights for policy 0, policy_version 1175281 (0.0010) [2023-12-28 03:42:18,307][106225] Updated weights for policy 1, policy_version 1178322 (0.0008) [2023-12-28 03:42:18,380][106225] Updated weights for policy 1, policy_version 1178332 (0.0008) [2023-12-28 03:42:18,435][106225] Updated weights for policy 1, policy_version 1178342 (0.0010) [2023-12-28 03:42:18,987][106226] Updated weights for policy 0, policy_version 1175291 (0.0011) [2023-12-28 03:42:19,041][106226] Updated weights for policy 0, policy_version 1175301 (0.0011) [2023-12-28 03:42:19,101][106226] Updated weights for policy 0, policy_version 1175311 (0.0011) [2023-12-28 03:42:19,145][106225] Updated weights for policy 1, policy_version 1178352 (0.0010) [2023-12-28 03:42:19,206][106225] Updated weights for policy 1, policy_version 1178362 (0.0009) [2023-12-28 03:42:19,284][106225] Updated weights for policy 1, policy_version 1178372 (0.0009) [2023-12-28 03:42:19,788][106226] Updated weights for policy 0, policy_version 1175321 (0.0010) [2023-12-28 03:42:19,861][106226] Updated weights for policy 0, policy_version 1175331 (0.0007) [2023-12-28 03:42:19,932][106226] Updated weights for policy 0, policy_version 1175341 (0.0008) [2023-12-28 03:42:19,950][106225] Updated weights for policy 1, policy_version 1178382 (0.0008) [2023-12-28 03:42:19,999][106226] Updated weights for policy 0, policy_version 1175351 (0.0008) [2023-12-28 03:42:20,014][106225] Updated weights for policy 1, policy_version 1178392 (0.0007) [2023-12-28 03:42:20,073][106225] Updated weights for policy 1, policy_version 1178402 (0.0006) [2023-12-28 03:42:20,746][106226] Updated weights for policy 0, policy_version 1175361 (0.0008) [2023-12-28 03:42:20,762][106225] Updated weights for policy 1, policy_version 1178412 (0.0006) [2023-12-28 03:42:20,800][106226] Updated weights for policy 0, policy_version 1175371 (0.0009) [2023-12-28 03:42:20,820][106225] Updated weights for policy 1, policy_version 1178422 (0.0007) [2023-12-28 03:42:20,858][106226] Updated weights for policy 0, policy_version 1175381 (0.0011) [2023-12-28 03:42:20,876][106225] Updated weights for policy 1, policy_version 1178432 (0.0006) [2023-12-28 03:42:21,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19966.3). Total num frames: 602685440. Throughput: 0: 9809.5, 1: 10096.2. Samples: 602691252. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:21,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-5.071')] [2023-12-28 03:42:21,686][106225] Updated weights for policy 1, policy_version 1178442 (0.0008) [2023-12-28 03:42:21,705][106226] Updated weights for policy 0, policy_version 1175391 (0.0008) [2023-12-28 03:42:21,753][106225] Updated weights for policy 1, policy_version 1178452 (0.0008) [2023-12-28 03:42:21,772][106226] Updated weights for policy 0, policy_version 1175401 (0.0008) [2023-12-28 03:42:21,814][106225] Updated weights for policy 1, policy_version 1178462 (0.0006) [2023-12-28 03:42:21,830][106226] Updated weights for policy 0, policy_version 1175411 (0.0009) [2023-12-28 03:42:21,876][106225] Updated weights for policy 1, policy_version 1178472 (0.0006) [2023-12-28 03:42:22,625][106225] Updated weights for policy 1, policy_version 1178482 (0.0008) [2023-12-28 03:42:22,632][106226] Updated weights for policy 0, policy_version 1175421 (0.0008) [2023-12-28 03:42:22,688][106225] Updated weights for policy 1, policy_version 1178492 (0.0008) [2023-12-28 03:42:22,691][106226] Updated weights for policy 0, policy_version 1175431 (0.0007) [2023-12-28 03:42:22,741][106226] Updated weights for policy 0, policy_version 1175441 (0.0007) [2023-12-28 03:42:22,747][106225] Updated weights for policy 1, policy_version 1178502 (0.0008) [2023-12-28 03:42:23,429][106226] Updated weights for policy 0, policy_version 1175451 (0.0008) [2023-12-28 03:42:23,492][106226] Updated weights for policy 0, policy_version 1175461 (0.0011) [2023-12-28 03:42:23,532][106225] Updated weights for policy 1, policy_version 1178512 (0.0006) [2023-12-28 03:42:23,560][106226] Updated weights for policy 0, policy_version 1175471 (0.0011) [2023-12-28 03:42:23,589][106225] Updated weights for policy 1, policy_version 1178522 (0.0006) [2023-12-28 03:42:23,651][106225] Updated weights for policy 1, policy_version 1178532 (0.0007) [2023-12-28 03:42:24,268][106226] Updated weights for policy 0, policy_version 1175481 (0.0011) [2023-12-28 03:42:24,287][106225] Updated weights for policy 1, policy_version 1178542 (0.0007) [2023-12-28 03:42:24,324][106226] Updated weights for policy 0, policy_version 1175491 (0.0010) [2023-12-28 03:42:24,342][106225] Updated weights for policy 1, policy_version 1178552 (0.0006) [2023-12-28 03:42:24,384][106226] Updated weights for policy 0, policy_version 1175501 (0.0010) [2023-12-28 03:42:24,390][106225] Updated weights for policy 1, policy_version 1178562 (0.0007) [2023-12-28 03:42:24,444][106226] Updated weights for policy 0, policy_version 1175511 (0.0010) [2023-12-28 03:42:25,062][106226] Updated weights for policy 0, policy_version 1175521 (0.0010) [2023-12-28 03:42:25,122][106226] Updated weights for policy 0, policy_version 1175531 (0.0011) [2023-12-28 03:42:25,169][106225] Updated weights for policy 1, policy_version 1178572 (0.0006) [2023-12-28 03:42:25,178][106226] Updated weights for policy 0, policy_version 1175541 (0.0008) [2023-12-28 03:42:25,222][106225] Updated weights for policy 1, policy_version 1178582 (0.0008) [2023-12-28 03:42:25,274][106225] Updated weights for policy 1, policy_version 1178592 (0.0007) [2023-12-28 03:42:25,865][106226] Updated weights for policy 0, policy_version 1175551 (0.0009) [2023-12-28 03:42:25,921][106226] Updated weights for policy 0, policy_version 1175561 (0.0010) [2023-12-28 03:42:25,953][106225] Updated weights for policy 1, policy_version 1178602 (0.0007) [2023-12-28 03:42:25,972][106226] Updated weights for policy 0, policy_version 1175571 (0.0010) [2023-12-28 03:42:26,010][106225] Updated weights for policy 1, policy_version 1178612 (0.0010) [2023-12-28 03:42:26,071][106225] Updated weights for policy 1, policy_version 1178622 (0.0010) [2023-12-28 03:42:26,125][106225] Updated weights for policy 1, policy_version 1178632 (0.0010) [2023-12-28 03:42:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 602783744. Throughput: 0: 9767.0, 1: 10063.1. Samples: 602746224. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:26,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.999')] [2023-12-28 03:42:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001175576_301006848.pth... [2023-12-28 03:42:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001178632_301776896.pth... [2023-12-28 03:42:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001174424_300711936.pth [2023-12-28 03:42:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001177448_301473792.pth [2023-12-28 03:42:26,696][106226] Updated weights for policy 0, policy_version 1175581 (0.0008) [2023-12-28 03:42:26,746][106226] Updated weights for policy 0, policy_version 1175591 (0.0005) [2023-12-28 03:42:26,802][106226] Updated weights for policy 0, policy_version 1175601 (0.0005) [2023-12-28 03:42:26,834][106225] Updated weights for policy 1, policy_version 1178642 (0.0005) [2023-12-28 03:42:26,888][106225] Updated weights for policy 1, policy_version 1178652 (0.0005) [2023-12-28 03:42:26,944][106225] Updated weights for policy 1, policy_version 1178662 (0.0005) [2023-12-28 03:42:27,334][106226] Updated weights for policy 0, policy_version 1175611 (0.0007) [2023-12-28 03:42:27,386][106226] Updated weights for policy 0, policy_version 1175621 (0.0008) [2023-12-28 03:42:27,439][106226] Updated weights for policy 0, policy_version 1175631 (0.0009) [2023-12-28 03:42:27,474][106225] Updated weights for policy 1, policy_version 1178672 (0.0006) [2023-12-28 03:42:27,527][106225] Updated weights for policy 1, policy_version 1178682 (0.0007) [2023-12-28 03:42:27,584][106225] Updated weights for policy 1, policy_version 1178692 (0.0005) [2023-12-28 03:42:28,059][106226] Updated weights for policy 0, policy_version 1175641 (0.0008) [2023-12-28 03:42:28,115][106226] Updated weights for policy 0, policy_version 1175651 (0.0005) [2023-12-28 03:42:28,176][106226] Updated weights for policy 0, policy_version 1175661 (0.0006) [2023-12-28 03:42:28,224][106226] Updated weights for policy 0, policy_version 1175671 (0.0005) [2023-12-28 03:42:28,258][106225] Updated weights for policy 1, policy_version 1178702 (0.0007) [2023-12-28 03:42:28,310][106225] Updated weights for policy 1, policy_version 1178712 (0.0008) [2023-12-28 03:42:28,371][106225] Updated weights for policy 1, policy_version 1178722 (0.0008) [2023-12-28 03:42:28,925][106226] Updated weights for policy 0, policy_version 1175681 (0.0008) [2023-12-28 03:42:28,969][106226] Updated weights for policy 0, policy_version 1175691 (0.0009) [2023-12-28 03:42:29,015][106226] Updated weights for policy 0, policy_version 1175701 (0.0008) [2023-12-28 03:42:29,038][106225] Updated weights for policy 1, policy_version 1178732 (0.0007) [2023-12-28 03:42:29,094][106225] Updated weights for policy 1, policy_version 1178742 (0.0009) [2023-12-28 03:42:29,144][106225] Updated weights for policy 1, policy_version 1178752 (0.0009) [2023-12-28 03:42:29,739][106226] Updated weights for policy 0, policy_version 1175711 (0.0007) [2023-12-28 03:42:29,806][106226] Updated weights for policy 0, policy_version 1175721 (0.0006) [2023-12-28 03:42:29,874][106226] Updated weights for policy 0, policy_version 1175731 (0.0010) [2023-12-28 03:42:29,982][106225] Updated weights for policy 1, policy_version 1178762 (0.0008) [2023-12-28 03:42:30,037][106225] Updated weights for policy 1, policy_version 1178772 (0.0008) [2023-12-28 03:42:30,093][106225] Updated weights for policy 1, policy_version 1178782 (0.0008) [2023-12-28 03:42:30,156][106225] Updated weights for policy 1, policy_version 1178792 (0.0009) [2023-12-28 03:42:30,626][106226] Updated weights for policy 0, policy_version 1175741 (0.0009) [2023-12-28 03:42:30,682][106226] Updated weights for policy 0, policy_version 1175751 (0.0008) [2023-12-28 03:42:30,739][106226] Updated weights for policy 0, policy_version 1175761 (0.0008) [2023-12-28 03:42:30,806][106225] Updated weights for policy 1, policy_version 1178802 (0.0008) [2023-12-28 03:42:30,859][106225] Updated weights for policy 1, policy_version 1178812 (0.0010) [2023-12-28 03:42:30,912][106225] Updated weights for policy 1, policy_version 1178822 (0.0010) [2023-12-28 03:42:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 602882048. Throughput: 0: 9901.7, 1: 10076.8. Samples: 602870428. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:31,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-5.087')] [2023-12-28 03:42:31,434][106226] Updated weights for policy 0, policy_version 1175771 (0.0006) [2023-12-28 03:42:31,490][106226] Updated weights for policy 0, policy_version 1175781 (0.0008) [2023-12-28 03:42:31,547][106226] Updated weights for policy 0, policy_version 1175791 (0.0007) [2023-12-28 03:42:31,709][106225] Updated weights for policy 1, policy_version 1178832 (0.0009) [2023-12-28 03:42:31,774][106225] Updated weights for policy 1, policy_version 1178842 (0.0009) [2023-12-28 03:42:31,825][106225] Updated weights for policy 1, policy_version 1178852 (0.0008) [2023-12-28 03:42:32,256][106226] Updated weights for policy 0, policy_version 1175801 (0.0006) [2023-12-28 03:42:32,304][106226] Updated weights for policy 0, policy_version 1175811 (0.0007) [2023-12-28 03:42:32,355][106226] Updated weights for policy 0, policy_version 1175821 (0.0006) [2023-12-28 03:42:32,425][106226] Updated weights for policy 0, policy_version 1175831 (0.0007) [2023-12-28 03:42:32,565][106225] Updated weights for policy 1, policy_version 1178862 (0.0006) [2023-12-28 03:42:32,619][106225] Updated weights for policy 1, policy_version 1178872 (0.0005) [2023-12-28 03:42:32,674][106225] Updated weights for policy 1, policy_version 1178882 (0.0005) [2023-12-28 03:42:33,187][106226] Updated weights for policy 0, policy_version 1175841 (0.0008) [2023-12-28 03:42:33,246][106226] Updated weights for policy 0, policy_version 1175851 (0.0009) [2023-12-28 03:42:33,282][106225] Updated weights for policy 1, policy_version 1178892 (0.0005) [2023-12-28 03:42:33,298][106226] Updated weights for policy 0, policy_version 1175861 (0.0006) [2023-12-28 03:42:33,343][106225] Updated weights for policy 1, policy_version 1178902 (0.0005) [2023-12-28 03:42:33,403][106225] Updated weights for policy 1, policy_version 1178912 (0.0005) [2023-12-28 03:42:33,876][106226] Updated weights for policy 0, policy_version 1175871 (0.0005) [2023-12-28 03:42:33,947][106226] Updated weights for policy 0, policy_version 1175881 (0.0005) [2023-12-28 03:42:33,968][106225] Updated weights for policy 1, policy_version 1178922 (0.0006) [2023-12-28 03:42:34,002][106226] Updated weights for policy 0, policy_version 1175891 (0.0009) [2023-12-28 03:42:34,019][106225] Updated weights for policy 1, policy_version 1178932 (0.0006) [2023-12-28 03:42:34,074][106225] Updated weights for policy 1, policy_version 1178942 (0.0005) [2023-12-28 03:42:34,128][106225] Updated weights for policy 1, policy_version 1178952 (0.0005) [2023-12-28 03:42:34,707][106226] Updated weights for policy 0, policy_version 1175901 (0.0009) [2023-12-28 03:42:34,776][106226] Updated weights for policy 0, policy_version 1175911 (0.0007) [2023-12-28 03:42:34,792][106225] Updated weights for policy 1, policy_version 1178962 (0.0006) [2023-12-28 03:42:34,829][106226] Updated weights for policy 0, policy_version 1175921 (0.0008) [2023-12-28 03:42:34,842][106225] Updated weights for policy 1, policy_version 1178972 (0.0005) [2023-12-28 03:42:34,904][106225] Updated weights for policy 1, policy_version 1178982 (0.0005) [2023-12-28 03:42:35,526][106225] Updated weights for policy 1, policy_version 1178992 (0.0007) [2023-12-28 03:42:35,571][106226] Updated weights for policy 0, policy_version 1175931 (0.0008) [2023-12-28 03:42:35,582][106225] Updated weights for policy 1, policy_version 1179002 (0.0007) [2023-12-28 03:42:35,626][106226] Updated weights for policy 0, policy_version 1175941 (0.0007) [2023-12-28 03:42:35,632][106225] Updated weights for policy 1, policy_version 1179012 (0.0005) [2023-12-28 03:42:35,686][106226] Updated weights for policy 0, policy_version 1175951 (0.0009) [2023-12-28 03:42:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 602980352. Throughput: 0: 9978.9, 1: 10027.5. Samples: 602992248. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:36,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.871')] [2023-12-28 03:42:36,261][106225] Updated weights for policy 1, policy_version 1179022 (0.0007) [2023-12-28 03:42:36,342][106225] Updated weights for policy 1, policy_version 1179032 (0.0009) [2023-12-28 03:42:36,397][106226] Updated weights for policy 0, policy_version 1175961 (0.0008) [2023-12-28 03:42:36,407][106225] Updated weights for policy 1, policy_version 1179042 (0.0008) [2023-12-28 03:42:36,461][106226] Updated weights for policy 0, policy_version 1175971 (0.0007) [2023-12-28 03:42:36,517][106226] Updated weights for policy 0, policy_version 1175981 (0.0009) [2023-12-28 03:42:36,576][106226] Updated weights for policy 0, policy_version 1175991 (0.0008) [2023-12-28 03:42:37,121][106225] Updated weights for policy 1, policy_version 1179052 (0.0009) [2023-12-28 03:42:37,179][106225] Updated weights for policy 1, policy_version 1179062 (0.0010) [2023-12-28 03:42:37,197][106226] Updated weights for policy 0, policy_version 1176001 (0.0006) [2023-12-28 03:42:37,235][106225] Updated weights for policy 1, policy_version 1179072 (0.0010) [2023-12-28 03:42:37,260][106226] Updated weights for policy 0, policy_version 1176011 (0.0006) [2023-12-28 03:42:37,321][106226] Updated weights for policy 0, policy_version 1176021 (0.0008) [2023-12-28 03:42:37,935][106225] Updated weights for policy 1, policy_version 1179082 (0.0009) [2023-12-28 03:42:37,937][106226] Updated weights for policy 0, policy_version 1176031 (0.0007) [2023-12-28 03:42:37,986][106225] Updated weights for policy 1, policy_version 1179092 (0.0006) [2023-12-28 03:42:37,987][106226] Updated weights for policy 0, policy_version 1176041 (0.0009) [2023-12-28 03:42:38,040][106226] Updated weights for policy 0, policy_version 1176051 (0.0007) [2023-12-28 03:42:38,048][106225] Updated weights for policy 1, policy_version 1179102 (0.0006) [2023-12-28 03:42:38,110][106225] Updated weights for policy 1, policy_version 1179112 (0.0009) [2023-12-28 03:42:38,756][106226] Updated weights for policy 0, policy_version 1176061 (0.0007) [2023-12-28 03:42:38,774][106225] Updated weights for policy 1, policy_version 1179122 (0.0007) [2023-12-28 03:42:38,820][106226] Updated weights for policy 0, policy_version 1176071 (0.0007) [2023-12-28 03:42:38,834][106225] Updated weights for policy 1, policy_version 1179132 (0.0006) [2023-12-28 03:42:38,887][106226] Updated weights for policy 0, policy_version 1176081 (0.0008) [2023-12-28 03:42:38,889][106225] Updated weights for policy 1, policy_version 1179142 (0.0007) [2023-12-28 03:42:39,582][106226] Updated weights for policy 0, policy_version 1176091 (0.0007) [2023-12-28 03:42:39,584][106225] Updated weights for policy 1, policy_version 1179152 (0.0009) [2023-12-28 03:42:39,641][106226] Updated weights for policy 0, policy_version 1176101 (0.0006) [2023-12-28 03:42:39,647][106225] Updated weights for policy 1, policy_version 1179162 (0.0008) [2023-12-28 03:42:39,698][106226] Updated weights for policy 0, policy_version 1176111 (0.0007) [2023-12-28 03:42:39,708][106225] Updated weights for policy 1, policy_version 1179172 (0.0005) [2023-12-28 03:42:40,384][106226] Updated weights for policy 0, policy_version 1176121 (0.0008) [2023-12-28 03:42:40,453][106226] Updated weights for policy 0, policy_version 1176131 (0.0008) [2023-12-28 03:42:40,471][106225] Updated weights for policy 1, policy_version 1179182 (0.0007) [2023-12-28 03:42:40,512][106226] Updated weights for policy 0, policy_version 1176141 (0.0009) [2023-12-28 03:42:40,530][106225] Updated weights for policy 1, policy_version 1179192 (0.0007) [2023-12-28 03:42:40,574][106226] Updated weights for policy 0, policy_version 1176151 (0.0010) [2023-12-28 03:42:40,589][106225] Updated weights for policy 1, policy_version 1179202 (0.0007) [2023-12-28 03:42:41,168][106226] Updated weights for policy 0, policy_version 1176161 (0.0011) [2023-12-28 03:42:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 603078656. Throughput: 0: 9981.8, 1: 10100.9. Samples: 603054216. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:41,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-5.079')] [2023-12-28 03:42:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001179208_301924352.pth... [2023-12-28 03:42:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001178024_301621248.pth [2023-12-28 03:42:41,233][106226] Updated weights for policy 0, policy_version 1176171 (0.0010) [2023-12-28 03:42:41,292][106226] Updated weights for policy 0, policy_version 1176181 (0.0008) [2023-12-28 03:42:41,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001176184_301162496.pth... [2023-12-28 03:42:41,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001175000_300859392.pth [2023-12-28 03:42:41,363][106225] Updated weights for policy 1, policy_version 1179212 (0.0009) [2023-12-28 03:42:41,428][106225] Updated weights for policy 1, policy_version 1179222 (0.0009) [2023-12-28 03:42:41,486][106225] Updated weights for policy 1, policy_version 1179232 (0.0008) [2023-12-28 03:42:41,962][106226] Updated weights for policy 0, policy_version 1176191 (0.0008) [2023-12-28 03:42:42,026][106226] Updated weights for policy 0, policy_version 1176201 (0.0008) [2023-12-28 03:42:42,087][106226] Updated weights for policy 0, policy_version 1176211 (0.0008) [2023-12-28 03:42:42,288][106225] Updated weights for policy 1, policy_version 1179242 (0.0007) [2023-12-28 03:42:42,348][106225] Updated weights for policy 1, policy_version 1179252 (0.0008) [2023-12-28 03:42:42,411][106225] Updated weights for policy 1, policy_version 1179262 (0.0008) [2023-12-28 03:42:42,466][106225] Updated weights for policy 1, policy_version 1179272 (0.0007) [2023-12-28 03:42:42,789][106226] Updated weights for policy 0, policy_version 1176221 (0.0009) [2023-12-28 03:42:42,849][106226] Updated weights for policy 0, policy_version 1176231 (0.0009) [2023-12-28 03:42:42,908][106226] Updated weights for policy 0, policy_version 1176241 (0.0009) [2023-12-28 03:42:43,212][106225] Updated weights for policy 1, policy_version 1179282 (0.0008) [2023-12-28 03:42:43,264][106225] Updated weights for policy 1, policy_version 1179292 (0.0009) [2023-12-28 03:42:43,334][106225] Updated weights for policy 1, policy_version 1179302 (0.0010) [2023-12-28 03:42:43,550][106226] Updated weights for policy 0, policy_version 1176251 (0.0009) [2023-12-28 03:42:43,603][106226] Updated weights for policy 0, policy_version 1176261 (0.0010) [2023-12-28 03:42:43,651][106226] Updated weights for policy 0, policy_version 1176271 (0.0007) [2023-12-28 03:42:44,082][106225] Updated weights for policy 1, policy_version 1179312 (0.0008) [2023-12-28 03:42:44,129][106225] Updated weights for policy 1, policy_version 1179322 (0.0007) [2023-12-28 03:42:44,184][106225] Updated weights for policy 1, policy_version 1179332 (0.0007) [2023-12-28 03:42:44,266][106226] Updated weights for policy 0, policy_version 1176281 (0.0008) [2023-12-28 03:42:44,329][106226] Updated weights for policy 0, policy_version 1176291 (0.0011) [2023-12-28 03:42:44,386][106226] Updated weights for policy 0, policy_version 1176301 (0.0010) [2023-12-28 03:42:44,440][106226] Updated weights for policy 0, policy_version 1176311 (0.0010) [2023-12-28 03:42:44,865][106225] Updated weights for policy 1, policy_version 1179342 (0.0007) [2023-12-28 03:42:44,927][106225] Updated weights for policy 1, policy_version 1179352 (0.0008) [2023-12-28 03:42:44,987][106225] Updated weights for policy 1, policy_version 1179362 (0.0008) [2023-12-28 03:42:45,126][106226] Updated weights for policy 0, policy_version 1176321 (0.0011) [2023-12-28 03:42:45,191][106226] Updated weights for policy 0, policy_version 1176331 (0.0011) [2023-12-28 03:42:45,250][106226] Updated weights for policy 0, policy_version 1176341 (0.0011) [2023-12-28 03:42:45,631][106225] Updated weights for policy 1, policy_version 1179372 (0.0008) [2023-12-28 03:42:45,687][106225] Updated weights for policy 1, policy_version 1179382 (0.0007) [2023-12-28 03:42:45,741][106225] Updated weights for policy 1, policy_version 1179392 (0.0007) [2023-12-28 03:42:45,973][106226] Updated weights for policy 0, policy_version 1176351 (0.0011) [2023-12-28 03:42:46,032][106226] Updated weights for policy 0, policy_version 1176361 (0.0010) [2023-12-28 03:42:46,083][106226] Updated weights for policy 0, policy_version 1176371 (0.0010) [2023-12-28 03:42:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19994.0). Total num frames: 603185152. Throughput: 0: 9994.1, 1: 10078.4. Samples: 603172012. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:46,176][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.200')] [2023-12-28 03:42:46,397][106225] Updated weights for policy 1, policy_version 1179402 (0.0007) [2023-12-28 03:42:46,451][106225] Updated weights for policy 1, policy_version 1179412 (0.0005) [2023-12-28 03:42:46,506][106225] Updated weights for policy 1, policy_version 1179422 (0.0005) [2023-12-28 03:42:46,556][106225] Updated weights for policy 1, policy_version 1179432 (0.0007) [2023-12-28 03:42:46,798][106226] Updated weights for policy 0, policy_version 1176381 (0.0009) [2023-12-28 03:42:46,844][106226] Updated weights for policy 0, policy_version 1176391 (0.0010) [2023-12-28 03:42:46,891][106226] Updated weights for policy 0, policy_version 1176401 (0.0010) [2023-12-28 03:42:47,175][106225] Updated weights for policy 1, policy_version 1179442 (0.0010) [2023-12-28 03:42:47,231][106225] Updated weights for policy 1, policy_version 1179452 (0.0010) [2023-12-28 03:42:47,282][106225] Updated weights for policy 1, policy_version 1179462 (0.0009) [2023-12-28 03:42:47,634][106226] Updated weights for policy 0, policy_version 1176411 (0.0011) [2023-12-28 03:42:47,686][106226] Updated weights for policy 0, policy_version 1176421 (0.0010) [2023-12-28 03:42:47,736][106226] Updated weights for policy 0, policy_version 1176431 (0.0010) [2023-12-28 03:42:47,967][106225] Updated weights for policy 1, policy_version 1179472 (0.0005) [2023-12-28 03:42:48,019][106225] Updated weights for policy 1, policy_version 1179482 (0.0008) [2023-12-28 03:42:48,078][106225] Updated weights for policy 1, policy_version 1179492 (0.0010) [2023-12-28 03:42:48,429][106226] Updated weights for policy 0, policy_version 1176441 (0.0010) [2023-12-28 03:42:48,491][106226] Updated weights for policy 0, policy_version 1176451 (0.0011) [2023-12-28 03:42:48,538][106226] Updated weights for policy 0, policy_version 1176461 (0.0010) [2023-12-28 03:42:48,586][106226] Updated weights for policy 0, policy_version 1176471 (0.0011) [2023-12-28 03:42:48,814][106225] Updated weights for policy 1, policy_version 1179502 (0.0010) [2023-12-28 03:42:48,873][106225] Updated weights for policy 1, policy_version 1179512 (0.0011) [2023-12-28 03:42:48,935][106225] Updated weights for policy 1, policy_version 1179522 (0.0010) [2023-12-28 03:42:49,333][106226] Updated weights for policy 0, policy_version 1176481 (0.0010) [2023-12-28 03:42:49,395][106226] Updated weights for policy 0, policy_version 1176491 (0.0011) [2023-12-28 03:42:49,449][106226] Updated weights for policy 0, policy_version 1176501 (0.0010) [2023-12-28 03:42:49,618][106225] Updated weights for policy 1, policy_version 1179532 (0.0010) [2023-12-28 03:42:49,668][106225] Updated weights for policy 1, policy_version 1179542 (0.0010) [2023-12-28 03:42:49,728][106225] Updated weights for policy 1, policy_version 1179552 (0.0010) [2023-12-28 03:42:50,206][106226] Updated weights for policy 0, policy_version 1176511 (0.0011) [2023-12-28 03:42:50,261][106226] Updated weights for policy 0, policy_version 1176521 (0.0011) [2023-12-28 03:42:50,313][106226] Updated weights for policy 0, policy_version 1176531 (0.0011) [2023-12-28 03:42:50,449][106225] Updated weights for policy 1, policy_version 1179562 (0.0010) [2023-12-28 03:42:50,506][106225] Updated weights for policy 1, policy_version 1179572 (0.0011) [2023-12-28 03:42:50,573][106225] Updated weights for policy 1, policy_version 1179582 (0.0011) [2023-12-28 03:42:50,633][106225] Updated weights for policy 1, policy_version 1179592 (0.0010) [2023-12-28 03:42:51,035][106226] Updated weights for policy 0, policy_version 1176541 (0.0009) [2023-12-28 03:42:51,098][106226] Updated weights for policy 0, policy_version 1176551 (0.0008) [2023-12-28 03:42:51,166][106226] Updated weights for policy 0, policy_version 1176561 (0.0007) [2023-12-28 03:42:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 603275264. Throughput: 0: 9938.2, 1: 10027.3. Samples: 603290652. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:51,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-5.228')] [2023-12-28 03:42:51,376][106225] Updated weights for policy 1, policy_version 1179603 (0.0008) [2023-12-28 03:42:51,440][106225] Updated weights for policy 1, policy_version 1179613 (0.0008) [2023-12-28 03:42:51,507][106225] Updated weights for policy 1, policy_version 1179623 (0.0008) [2023-12-28 03:42:51,933][106226] Updated weights for policy 0, policy_version 1176571 (0.0007) [2023-12-28 03:42:51,992][106226] Updated weights for policy 0, policy_version 1176581 (0.0008) [2023-12-28 03:42:52,054][106226] Updated weights for policy 0, policy_version 1176591 (0.0010) [2023-12-28 03:42:52,252][106225] Updated weights for policy 1, policy_version 1179633 (0.0008) [2023-12-28 03:42:52,312][106225] Updated weights for policy 1, policy_version 1179643 (0.0009) [2023-12-28 03:42:52,377][106225] Updated weights for policy 1, policy_version 1179653 (0.0009) [2023-12-28 03:42:52,757][106226] Updated weights for policy 0, policy_version 1176601 (0.0009) [2023-12-28 03:42:52,809][106226] Updated weights for policy 0, policy_version 1176611 (0.0008) [2023-12-28 03:42:52,854][106226] Updated weights for policy 0, policy_version 1176621 (0.0008) [2023-12-28 03:42:52,912][106226] Updated weights for policy 0, policy_version 1176631 (0.0008) [2023-12-28 03:42:53,065][106225] Updated weights for policy 1, policy_version 1179663 (0.0007) [2023-12-28 03:42:53,114][106225] Updated weights for policy 1, policy_version 1179673 (0.0010) [2023-12-28 03:42:53,163][106225] Updated weights for policy 1, policy_version 1179683 (0.0010) [2023-12-28 03:42:53,711][106226] Updated weights for policy 0, policy_version 1176641 (0.0008) [2023-12-28 03:42:53,770][106226] Updated weights for policy 0, policy_version 1176651 (0.0007) [2023-12-28 03:42:53,791][106225] Updated weights for policy 1, policy_version 1179693 (0.0010) [2023-12-28 03:42:53,827][106226] Updated weights for policy 0, policy_version 1176661 (0.0005) [2023-12-28 03:42:53,847][106225] Updated weights for policy 1, policy_version 1179703 (0.0010) [2023-12-28 03:42:53,903][106225] Updated weights for policy 1, policy_version 1179713 (0.0010) [2023-12-28 03:42:54,537][106226] Updated weights for policy 0, policy_version 1176671 (0.0007) [2023-12-28 03:42:54,602][106226] Updated weights for policy 0, policy_version 1176681 (0.0008) [2023-12-28 03:42:54,622][106225] Updated weights for policy 1, policy_version 1179723 (0.0010) [2023-12-28 03:42:54,655][106226] Updated weights for policy 0, policy_version 1176691 (0.0007) [2023-12-28 03:42:54,679][106225] Updated weights for policy 1, policy_version 1179733 (0.0010) [2023-12-28 03:42:54,739][106225] Updated weights for policy 1, policy_version 1179743 (0.0010) [2023-12-28 03:42:55,400][106226] Updated weights for policy 0, policy_version 1176701 (0.0007) [2023-12-28 03:42:55,455][106226] Updated weights for policy 0, policy_version 1176711 (0.0006) [2023-12-28 03:42:55,470][106225] Updated weights for policy 1, policy_version 1179753 (0.0010) [2023-12-28 03:42:55,511][106226] Updated weights for policy 0, policy_version 1176721 (0.0006) [2023-12-28 03:42:55,531][106225] Updated weights for policy 1, policy_version 1179763 (0.0011) [2023-12-28 03:42:55,588][106225] Updated weights for policy 1, policy_version 1179773 (0.0010) [2023-12-28 03:42:55,648][106225] Updated weights for policy 1, policy_version 1179783 (0.0010) [2023-12-28 03:42:56,159][106226] Updated weights for policy 0, policy_version 1176731 (0.0006) [2023-12-28 03:42:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 603373568. Throughput: 0: 9845.0, 1: 10039.1. Samples: 603348128. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:42:56,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.736')] [2023-12-28 03:42:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001179784_302071808.pth... [2023-12-28 03:42:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001178632_301776896.pth [2023-12-28 03:42:56,211][106226] Updated weights for policy 0, policy_version 1176741 (0.0006) [2023-12-28 03:42:56,272][106226] Updated weights for policy 0, policy_version 1176751 (0.0011) [2023-12-28 03:42:56,330][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001176760_301309952.pth... [2023-12-28 03:42:56,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001175576_301006848.pth [2023-12-28 03:42:56,347][106225] Updated weights for policy 1, policy_version 1179793 (0.0008) [2023-12-28 03:42:56,404][106225] Updated weights for policy 1, policy_version 1179803 (0.0010) [2023-12-28 03:42:56,462][106225] Updated weights for policy 1, policy_version 1179813 (0.0010) [2023-12-28 03:42:56,925][106226] Updated weights for policy 0, policy_version 1176761 (0.0011) [2023-12-28 03:42:56,973][106226] Updated weights for policy 0, policy_version 1176771 (0.0010) [2023-12-28 03:42:57,035][106226] Updated weights for policy 0, policy_version 1176781 (0.0008) [2023-12-28 03:42:57,090][106226] Updated weights for policy 0, policy_version 1176791 (0.0009) [2023-12-28 03:42:57,136][106225] Updated weights for policy 1, policy_version 1179823 (0.0010) [2023-12-28 03:42:57,198][106225] Updated weights for policy 1, policy_version 1179833 (0.0010) [2023-12-28 03:42:57,247][106225] Updated weights for policy 1, policy_version 1179843 (0.0010) [2023-12-28 03:42:57,703][106226] Updated weights for policy 0, policy_version 1176801 (0.0010) [2023-12-28 03:42:57,760][106226] Updated weights for policy 0, policy_version 1176811 (0.0010) [2023-12-28 03:42:57,822][106226] Updated weights for policy 0, policy_version 1176821 (0.0007) [2023-12-28 03:42:57,897][106225] Updated weights for policy 1, policy_version 1179853 (0.0010) [2023-12-28 03:42:57,950][106225] Updated weights for policy 1, policy_version 1179863 (0.0010) [2023-12-28 03:42:58,012][106225] Updated weights for policy 1, policy_version 1179873 (0.0010) [2023-12-28 03:42:58,573][106226] Updated weights for policy 0, policy_version 1176831 (0.0007) [2023-12-28 03:42:58,636][106226] Updated weights for policy 0, policy_version 1176841 (0.0008) [2023-12-28 03:42:58,692][106226] Updated weights for policy 0, policy_version 1176851 (0.0008) [2023-12-28 03:42:58,735][106225] Updated weights for policy 1, policy_version 1179883 (0.0010) [2023-12-28 03:42:58,804][106225] Updated weights for policy 1, policy_version 1179893 (0.0008) [2023-12-28 03:42:58,872][106225] Updated weights for policy 1, policy_version 1179903 (0.0007) [2023-12-28 03:42:59,634][106226] Updated weights for policy 0, policy_version 1176861 (0.0008) [2023-12-28 03:42:59,687][106226] Updated weights for policy 0, policy_version 1176871 (0.0008) [2023-12-28 03:42:59,728][106225] Updated weights for policy 1, policy_version 1179913 (0.0008) [2023-12-28 03:42:59,745][106226] Updated weights for policy 0, policy_version 1176881 (0.0009) [2023-12-28 03:42:59,776][106225] Updated weights for policy 1, policy_version 1179923 (0.0005) [2023-12-28 03:42:59,836][106225] Updated weights for policy 1, policy_version 1179933 (0.0006) [2023-12-28 03:42:59,894][106225] Updated weights for policy 1, policy_version 1179943 (0.0009) [2023-12-28 03:43:00,537][106226] Updated weights for policy 0, policy_version 1176891 (0.0009) [2023-12-28 03:43:00,596][106226] Updated weights for policy 0, policy_version 1176901 (0.0010) [2023-12-28 03:43:00,625][106225] Updated weights for policy 1, policy_version 1179953 (0.0006) [2023-12-28 03:43:00,656][106226] Updated weights for policy 0, policy_version 1176911 (0.0010) [2023-12-28 03:43:00,680][106225] Updated weights for policy 1, policy_version 1179963 (0.0008) [2023-12-28 03:43:00,735][106225] Updated weights for policy 1, policy_version 1179973 (0.0006) [2023-12-28 03:43:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19966.3). Total num frames: 603471872. Throughput: 0: 9876.4, 1: 9973.1. Samples: 603463448. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:43:01,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-4.828')] [2023-12-28 03:43:01,359][106226] Updated weights for policy 0, policy_version 1176921 (0.0010) [2023-12-28 03:43:01,426][106225] Updated weights for policy 1, policy_version 1179983 (0.0007) [2023-12-28 03:43:01,427][106226] Updated weights for policy 0, policy_version 1176931 (0.0008) [2023-12-28 03:43:01,481][106226] Updated weights for policy 0, policy_version 1176941 (0.0007) [2023-12-28 03:43:01,490][106225] Updated weights for policy 1, policy_version 1179993 (0.0008) [2023-12-28 03:43:01,542][106226] Updated weights for policy 0, policy_version 1176951 (0.0006) [2023-12-28 03:43:01,544][106225] Updated weights for policy 1, policy_version 1180003 (0.0010) [2023-12-28 03:43:02,185][106226] Updated weights for policy 0, policy_version 1176961 (0.0009) [2023-12-28 03:43:02,238][106226] Updated weights for policy 0, policy_version 1176971 (0.0006) [2023-12-28 03:43:02,253][106225] Updated weights for policy 1, policy_version 1180013 (0.0011) [2023-12-28 03:43:02,302][106226] Updated weights for policy 0, policy_version 1176981 (0.0010) [2023-12-28 03:43:02,316][106225] Updated weights for policy 1, policy_version 1180023 (0.0010) [2023-12-28 03:43:02,378][106225] Updated weights for policy 1, policy_version 1180033 (0.0010) [2023-12-28 03:43:02,905][106226] Updated weights for policy 0, policy_version 1176991 (0.0007) [2023-12-28 03:43:02,958][106226] Updated weights for policy 0, policy_version 1177001 (0.0008) [2023-12-28 03:43:03,008][106226] Updated weights for policy 0, policy_version 1177011 (0.0005) [2023-12-28 03:43:03,106][106225] Updated weights for policy 1, policy_version 1180043 (0.0009) [2023-12-28 03:43:03,161][106225] Updated weights for policy 1, policy_version 1180053 (0.0008) [2023-12-28 03:43:03,222][106225] Updated weights for policy 1, policy_version 1180063 (0.0008) [2023-12-28 03:43:03,588][106226] Updated weights for policy 0, policy_version 1177021 (0.0008) [2023-12-28 03:43:03,645][106226] Updated weights for policy 0, policy_version 1177031 (0.0010) [2023-12-28 03:43:03,700][106226] Updated weights for policy 0, policy_version 1177041 (0.0009) [2023-12-28 03:43:03,943][106225] Updated weights for policy 1, policy_version 1180073 (0.0007) [2023-12-28 03:43:03,993][106225] Updated weights for policy 1, policy_version 1180083 (0.0008) [2023-12-28 03:43:04,055][106225] Updated weights for policy 1, policy_version 1180093 (0.0008) [2023-12-28 03:43:04,106][106225] Updated weights for policy 1, policy_version 1180103 (0.0008) [2023-12-28 03:43:04,412][106226] Updated weights for policy 0, policy_version 1177051 (0.0008) [2023-12-28 03:43:04,462][106226] Updated weights for policy 0, policy_version 1177061 (0.0008) [2023-12-28 03:43:04,517][106226] Updated weights for policy 0, policy_version 1177071 (0.0008) [2023-12-28 03:43:04,849][106225] Updated weights for policy 1, policy_version 1180113 (0.0008) [2023-12-28 03:43:04,910][106225] Updated weights for policy 1, policy_version 1180123 (0.0008) [2023-12-28 03:43:04,965][106225] Updated weights for policy 1, policy_version 1180133 (0.0009) [2023-12-28 03:43:05,258][106226] Updated weights for policy 0, policy_version 1177081 (0.0009) [2023-12-28 03:43:05,316][106226] Updated weights for policy 0, policy_version 1177091 (0.0008) [2023-12-28 03:43:05,377][106226] Updated weights for policy 0, policy_version 1177101 (0.0007) [2023-12-28 03:43:05,438][106226] Updated weights for policy 0, policy_version 1177111 (0.0006) [2023-12-28 03:43:05,667][106225] Updated weights for policy 1, policy_version 1180143 (0.0008) [2023-12-28 03:43:05,716][106225] Updated weights for policy 1, policy_version 1180153 (0.0008) [2023-12-28 03:43:05,768][106225] Updated weights for policy 1, policy_version 1180163 (0.0008) [2023-12-28 03:43:06,161][106226] Updated weights for policy 0, policy_version 1177121 (0.0009) [2023-12-28 03:43:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 603570176. Throughput: 0: 9955.5, 1: 9848.3. Samples: 603582420. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:43:06,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.938')] [2023-12-28 03:43:06,224][106226] Updated weights for policy 0, policy_version 1177131 (0.0009) [2023-12-28 03:43:06,288][106226] Updated weights for policy 0, policy_version 1177141 (0.0008) [2023-12-28 03:43:06,568][106225] Updated weights for policy 1, policy_version 1180173 (0.0009) [2023-12-28 03:43:06,629][106225] Updated weights for policy 1, policy_version 1180183 (0.0008) [2023-12-28 03:43:06,689][106225] Updated weights for policy 1, policy_version 1180193 (0.0008) [2023-12-28 03:43:07,003][106226] Updated weights for policy 0, policy_version 1177151 (0.0007) [2023-12-28 03:43:07,067][106226] Updated weights for policy 0, policy_version 1177161 (0.0008) [2023-12-28 03:43:07,125][106226] Updated weights for policy 0, policy_version 1177171 (0.0008) [2023-12-28 03:43:07,429][106225] Updated weights for policy 1, policy_version 1180203 (0.0008) [2023-12-28 03:43:07,484][106225] Updated weights for policy 1, policy_version 1180213 (0.0008) [2023-12-28 03:43:07,544][106225] Updated weights for policy 1, policy_version 1180223 (0.0008) [2023-12-28 03:43:07,737][106226] Updated weights for policy 0, policy_version 1177181 (0.0009) [2023-12-28 03:43:07,801][106226] Updated weights for policy 0, policy_version 1177191 (0.0006) [2023-12-28 03:43:07,859][106226] Updated weights for policy 0, policy_version 1177201 (0.0008) [2023-12-28 03:43:08,266][106225] Updated weights for policy 1, policy_version 1180233 (0.0007) [2023-12-28 03:43:08,324][106225] Updated weights for policy 1, policy_version 1180243 (0.0010) [2023-12-28 03:43:08,387][106225] Updated weights for policy 1, policy_version 1180253 (0.0008) [2023-12-28 03:43:08,428][106226] Updated weights for policy 0, policy_version 1177211 (0.0009) [2023-12-28 03:43:08,451][106225] Updated weights for policy 1, policy_version 1180263 (0.0009) [2023-12-28 03:43:08,495][106226] Updated weights for policy 0, policy_version 1177221 (0.0006) [2023-12-28 03:43:08,562][106226] Updated weights for policy 0, policy_version 1177231 (0.0008) [2023-12-28 03:43:09,204][106225] Updated weights for policy 1, policy_version 1180273 (0.0007) [2023-12-28 03:43:09,233][106226] Updated weights for policy 0, policy_version 1177241 (0.0010) [2023-12-28 03:43:09,270][106225] Updated weights for policy 1, policy_version 1180283 (0.0008) [2023-12-28 03:43:09,295][106226] Updated weights for policy 0, policy_version 1177251 (0.0012) [2023-12-28 03:43:09,337][106225] Updated weights for policy 1, policy_version 1180293 (0.0006) [2023-12-28 03:43:09,358][106226] Updated weights for policy 0, policy_version 1177261 (0.0010) [2023-12-28 03:43:09,428][106226] Updated weights for policy 0, policy_version 1177271 (0.0010) [2023-12-28 03:43:10,095][106225] Updated weights for policy 1, policy_version 1180303 (0.0008) [2023-12-28 03:43:10,140][106226] Updated weights for policy 0, policy_version 1177281 (0.0011) [2023-12-28 03:43:10,155][106225] Updated weights for policy 1, policy_version 1180313 (0.0007) [2023-12-28 03:43:10,204][106226] Updated weights for policy 0, policy_version 1177291 (0.0009) [2023-12-28 03:43:10,215][106225] Updated weights for policy 1, policy_version 1180323 (0.0008) [2023-12-28 03:43:10,263][106226] Updated weights for policy 0, policy_version 1177301 (0.0011) [2023-12-28 03:43:10,874][106226] Updated weights for policy 0, policy_version 1177311 (0.0007) [2023-12-28 03:43:10,924][106226] Updated weights for policy 0, policy_version 1177321 (0.0006) [2023-12-28 03:43:10,984][106226] Updated weights for policy 0, policy_version 1177331 (0.0010) [2023-12-28 03:43:11,014][106225] Updated weights for policy 1, policy_version 1180333 (0.0007) [2023-12-28 03:43:11,096][106225] Updated weights for policy 1, policy_version 1180343 (0.0007) [2023-12-28 03:43:11,167][106225] Updated weights for policy 1, policy_version 1180353 (0.0007) [2023-12-28 03:43:11,176][105115] Fps is (10 sec: 19658.7, 60 sec: 19797.0, 300 sec: 19938.4). Total num frames: 603668480. Throughput: 0: 10031.0, 1: 9860.8. Samples: 603641376. Policy #0 lag: (min: 9.0, avg: 27.1, max: 41.0) [2023-12-28 03:43:11,176][105115] Avg episode reward: [(0, '-4.706'), (1, '-5.194')] [2023-12-28 03:43:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001177336_301457408.pth... [2023-12-28 03:43:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001176184_301162496.pth [2023-12-28 03:43:11,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001180360_302219264.pth... [2023-12-28 03:43:11,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001179208_301924352.pth [2023-12-28 03:43:11,740][106226] Updated weights for policy 0, policy_version 1177341 (0.0010) [2023-12-28 03:43:11,814][106226] Updated weights for policy 0, policy_version 1177351 (0.0008) [2023-12-28 03:43:11,875][106226] Updated weights for policy 0, policy_version 1177361 (0.0008) [2023-12-28 03:43:11,906][106225] Updated weights for policy 1, policy_version 1180363 (0.0007) [2023-12-28 03:43:11,974][106225] Updated weights for policy 1, policy_version 1180373 (0.0009) [2023-12-28 03:43:12,036][106225] Updated weights for policy 1, policy_version 1180383 (0.0006) [2023-12-28 03:43:12,563][106226] Updated weights for policy 0, policy_version 1177371 (0.0007) [2023-12-28 03:43:12,617][106226] Updated weights for policy 0, policy_version 1177381 (0.0009) [2023-12-28 03:43:12,686][106226] Updated weights for policy 0, policy_version 1177391 (0.0007) [2023-12-28 03:43:12,783][106225] Updated weights for policy 1, policy_version 1180393 (0.0008) [2023-12-28 03:43:12,845][106225] Updated weights for policy 1, policy_version 1180403 (0.0009) [2023-12-28 03:43:12,894][106225] Updated weights for policy 1, policy_version 1180413 (0.0009) [2023-12-28 03:43:12,952][106225] Updated weights for policy 1, policy_version 1180423 (0.0007) [2023-12-28 03:43:13,345][106226] Updated weights for policy 0, policy_version 1177401 (0.0007) [2023-12-28 03:43:13,392][106226] Updated weights for policy 0, policy_version 1177411 (0.0008) [2023-12-28 03:43:13,438][106226] Updated weights for policy 0, policy_version 1177421 (0.0007) [2023-12-28 03:43:13,486][106226] Updated weights for policy 0, policy_version 1177431 (0.0005) [2023-12-28 03:43:13,703][106225] Updated weights for policy 1, policy_version 1180433 (0.0007) [2023-12-28 03:43:13,763][106225] Updated weights for policy 1, policy_version 1180443 (0.0007) [2023-12-28 03:43:13,824][106225] Updated weights for policy 1, policy_version 1180453 (0.0007) [2023-12-28 03:43:14,197][106226] Updated weights for policy 0, policy_version 1177441 (0.0007) [2023-12-28 03:43:14,250][106226] Updated weights for policy 0, policy_version 1177451 (0.0007) [2023-12-28 03:43:14,304][106226] Updated weights for policy 0, policy_version 1177461 (0.0008) [2023-12-28 03:43:14,463][106225] Updated weights for policy 1, policy_version 1180463 (0.0006) [2023-12-28 03:43:14,521][106225] Updated weights for policy 1, policy_version 1180473 (0.0005) [2023-12-28 03:43:14,584][106225] Updated weights for policy 1, policy_version 1180483 (0.0005) [2023-12-28 03:43:15,107][106226] Updated weights for policy 0, policy_version 1177471 (0.0009) [2023-12-28 03:43:15,167][106225] Updated weights for policy 1, policy_version 1180493 (0.0006) [2023-12-28 03:43:15,173][106226] Updated weights for policy 0, policy_version 1177481 (0.0008) [2023-12-28 03:43:15,234][106225] Updated weights for policy 1, policy_version 1180503 (0.0007) [2023-12-28 03:43:15,241][106226] Updated weights for policy 0, policy_version 1177491 (0.0008) [2023-12-28 03:43:15,299][106225] Updated weights for policy 1, policy_version 1180513 (0.0007) [2023-12-28 03:43:15,976][106226] Updated weights for policy 0, policy_version 1177501 (0.0008) [2023-12-28 03:43:16,022][106225] Updated weights for policy 1, policy_version 1180523 (0.0009) [2023-12-28 03:43:16,036][106226] Updated weights for policy 0, policy_version 1177511 (0.0008) [2023-12-28 03:43:16,082][106225] Updated weights for policy 1, policy_version 1180533 (0.0010) [2023-12-28 03:43:16,100][106226] Updated weights for policy 0, policy_version 1177521 (0.0005) [2023-12-28 03:43:16,140][106225] Updated weights for policy 1, policy_version 1180543 (0.0008) [2023-12-28 03:43:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 603766784. Throughput: 0: 9954.2, 1: 9755.4. Samples: 603757360. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:16,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-5.270')] [2023-12-28 03:43:16,729][106225] Updated weights for policy 1, policy_version 1180553 (0.0006) [2023-12-28 03:43:16,777][106225] Updated weights for policy 1, policy_version 1180563 (0.0007) [2023-12-28 03:43:16,822][106225] Updated weights for policy 1, policy_version 1180573 (0.0005) [2023-12-28 03:43:16,847][106226] Updated weights for policy 0, policy_version 1177531 (0.0008) [2023-12-28 03:43:16,871][106225] Updated weights for policy 1, policy_version 1180583 (0.0006) [2023-12-28 03:43:16,902][106226] Updated weights for policy 0, policy_version 1177541 (0.0008) [2023-12-28 03:43:16,963][106226] Updated weights for policy 0, policy_version 1177551 (0.0008) [2023-12-28 03:43:17,467][106225] Updated weights for policy 1, policy_version 1180593 (0.0008) [2023-12-28 03:43:17,515][106225] Updated weights for policy 1, policy_version 1180603 (0.0008) [2023-12-28 03:43:17,565][106225] Updated weights for policy 1, policy_version 1180613 (0.0008) [2023-12-28 03:43:17,765][106226] Updated weights for policy 0, policy_version 1177561 (0.0008) [2023-12-28 03:43:17,820][106226] Updated weights for policy 0, policy_version 1177571 (0.0008) [2023-12-28 03:43:17,866][106226] Updated weights for policy 0, policy_version 1177581 (0.0008) [2023-12-28 03:43:17,922][106226] Updated weights for policy 0, policy_version 1177591 (0.0007) [2023-12-28 03:43:18,242][106225] Updated weights for policy 1, policy_version 1180623 (0.0007) [2023-12-28 03:43:18,301][106225] Updated weights for policy 1, policy_version 1180633 (0.0005) [2023-12-28 03:43:18,366][106225] Updated weights for policy 1, policy_version 1180643 (0.0008) [2023-12-28 03:43:18,708][106226] Updated weights for policy 0, policy_version 1177601 (0.0009) [2023-12-28 03:43:18,765][106226] Updated weights for policy 0, policy_version 1177611 (0.0008) [2023-12-28 03:43:18,821][106226] Updated weights for policy 0, policy_version 1177621 (0.0005) [2023-12-28 03:43:18,925][106225] Updated weights for policy 1, policy_version 1180653 (0.0010) [2023-12-28 03:43:18,986][106225] Updated weights for policy 1, policy_version 1180663 (0.0010) [2023-12-28 03:43:19,054][106225] Updated weights for policy 1, policy_version 1180673 (0.0010) [2023-12-28 03:43:19,440][106226] Updated weights for policy 0, policy_version 1177631 (0.0008) [2023-12-28 03:43:19,500][106226] Updated weights for policy 0, policy_version 1177641 (0.0008) [2023-12-28 03:43:19,566][106226] Updated weights for policy 0, policy_version 1177651 (0.0007) [2023-12-28 03:43:19,709][106225] Updated weights for policy 1, policy_version 1180683 (0.0009) [2023-12-28 03:43:19,769][106225] Updated weights for policy 1, policy_version 1180693 (0.0009) [2023-12-28 03:43:19,829][106225] Updated weights for policy 1, policy_version 1180703 (0.0010) [2023-12-28 03:43:20,234][106226] Updated weights for policy 0, policy_version 1177661 (0.0008) [2023-12-28 03:43:20,304][106226] Updated weights for policy 0, policy_version 1177671 (0.0006) [2023-12-28 03:43:20,366][106226] Updated weights for policy 0, policy_version 1177681 (0.0008) [2023-12-28 03:43:20,576][106225] Updated weights for policy 1, policy_version 1180713 (0.0010) [2023-12-28 03:43:20,644][106225] Updated weights for policy 1, policy_version 1180723 (0.0008) [2023-12-28 03:43:20,707][106225] Updated weights for policy 1, policy_version 1180733 (0.0006) [2023-12-28 03:43:20,769][106225] Updated weights for policy 1, policy_version 1180743 (0.0006) [2023-12-28 03:43:21,125][106226] Updated weights for policy 0, policy_version 1177691 (0.0006) [2023-12-28 03:43:21,174][105115] Fps is (10 sec: 19662.9, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 603865088. Throughput: 0: 9903.3, 1: 9784.8. Samples: 603878212. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:21,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.045')] [2023-12-28 03:43:21,189][106226] Updated weights for policy 0, policy_version 1177701 (0.0008) [2023-12-28 03:43:21,251][106226] Updated weights for policy 0, policy_version 1177711 (0.0007) [2023-12-28 03:43:21,493][106225] Updated weights for policy 1, policy_version 1180753 (0.0009) [2023-12-28 03:43:21,554][106225] Updated weights for policy 1, policy_version 1180763 (0.0009) [2023-12-28 03:43:21,620][106225] Updated weights for policy 1, policy_version 1180773 (0.0010) [2023-12-28 03:43:21,995][106226] Updated weights for policy 0, policy_version 1177721 (0.0006) [2023-12-28 03:43:22,050][106226] Updated weights for policy 0, policy_version 1177731 (0.0008) [2023-12-28 03:43:22,111][106226] Updated weights for policy 0, policy_version 1177741 (0.0006) [2023-12-28 03:43:22,176][106226] Updated weights for policy 0, policy_version 1177751 (0.0006) [2023-12-28 03:43:22,404][106225] Updated weights for policy 1, policy_version 1180783 (0.0010) [2023-12-28 03:43:22,468][106225] Updated weights for policy 1, policy_version 1180793 (0.0011) [2023-12-28 03:43:22,536][106225] Updated weights for policy 1, policy_version 1180803 (0.0010) [2023-12-28 03:43:22,876][106226] Updated weights for policy 0, policy_version 1177761 (0.0010) [2023-12-28 03:43:22,935][106226] Updated weights for policy 0, policy_version 1177771 (0.0008) [2023-12-28 03:43:23,001][106226] Updated weights for policy 0, policy_version 1177781 (0.0006) [2023-12-28 03:43:23,250][106225] Updated weights for policy 1, policy_version 1180813 (0.0011) [2023-12-28 03:43:23,298][106225] Updated weights for policy 1, policy_version 1180823 (0.0010) [2023-12-28 03:43:23,351][106225] Updated weights for policy 1, policy_version 1180833 (0.0010) [2023-12-28 03:43:23,708][106226] Updated weights for policy 0, policy_version 1177791 (0.0007) [2023-12-28 03:43:23,755][106226] Updated weights for policy 0, policy_version 1177801 (0.0010) [2023-12-28 03:43:23,801][106226] Updated weights for policy 0, policy_version 1177811 (0.0010) [2023-12-28 03:43:24,002][106225] Updated weights for policy 1, policy_version 1180843 (0.0010) [2023-12-28 03:43:24,069][106225] Updated weights for policy 1, policy_version 1180853 (0.0010) [2023-12-28 03:43:24,130][106225] Updated weights for policy 1, policy_version 1180863 (0.0010) [2023-12-28 03:43:24,479][106226] Updated weights for policy 0, policy_version 1177821 (0.0008) [2023-12-28 03:43:24,538][106226] Updated weights for policy 0, policy_version 1177831 (0.0008) [2023-12-28 03:43:24,602][106226] Updated weights for policy 0, policy_version 1177841 (0.0008) [2023-12-28 03:43:24,819][106225] Updated weights for policy 1, policy_version 1180873 (0.0010) [2023-12-28 03:43:24,873][106225] Updated weights for policy 1, policy_version 1180883 (0.0010) [2023-12-28 03:43:24,933][106225] Updated weights for policy 1, policy_version 1180893 (0.0010) [2023-12-28 03:43:24,989][106225] Updated weights for policy 1, policy_version 1180903 (0.0010) [2023-12-28 03:43:25,286][106226] Updated weights for policy 0, policy_version 1177851 (0.0008) [2023-12-28 03:43:25,345][106226] Updated weights for policy 0, policy_version 1177861 (0.0008) [2023-12-28 03:43:25,404][106226] Updated weights for policy 0, policy_version 1177871 (0.0007) [2023-12-28 03:43:25,700][106225] Updated weights for policy 1, policy_version 1180913 (0.0010) [2023-12-28 03:43:25,763][106225] Updated weights for policy 1, policy_version 1180923 (0.0010) [2023-12-28 03:43:25,824][106225] Updated weights for policy 1, policy_version 1180933 (0.0010) [2023-12-28 03:43:26,112][106226] Updated weights for policy 0, policy_version 1177881 (0.0006) [2023-12-28 03:43:26,169][106226] Updated weights for policy 0, policy_version 1177891 (0.0008) [2023-12-28 03:43:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19938.5). Total num frames: 603963392. Throughput: 0: 9856.9, 1: 9723.6. Samples: 603935340. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:26,176][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.935')] [2023-12-28 03:43:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001180936_302366720.pth... [2023-12-28 03:43:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001179784_302071808.pth [2023-12-28 03:43:26,223][106226] Updated weights for policy 0, policy_version 1177901 (0.0008) [2023-12-28 03:43:26,284][106226] Updated weights for policy 0, policy_version 1177911 (0.0008) [2023-12-28 03:43:26,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001177912_301604864.pth... [2023-12-28 03:43:26,289][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001176760_301309952.pth [2023-12-28 03:43:26,505][106225] Updated weights for policy 1, policy_version 1180943 (0.0010) [2023-12-28 03:43:26,565][106225] Updated weights for policy 1, policy_version 1180953 (0.0010) [2023-12-28 03:43:26,621][106225] Updated weights for policy 1, policy_version 1180963 (0.0010) [2023-12-28 03:43:26,918][106226] Updated weights for policy 0, policy_version 1177921 (0.0007) [2023-12-28 03:43:26,969][106226] Updated weights for policy 0, policy_version 1177931 (0.0007) [2023-12-28 03:43:27,022][106226] Updated weights for policy 0, policy_version 1177941 (0.0008) [2023-12-28 03:43:27,337][106225] Updated weights for policy 1, policy_version 1180973 (0.0010) [2023-12-28 03:43:27,400][106225] Updated weights for policy 1, policy_version 1180983 (0.0010) [2023-12-28 03:43:27,452][106225] Updated weights for policy 1, policy_version 1180993 (0.0010) [2023-12-28 03:43:27,725][106226] Updated weights for policy 0, policy_version 1177951 (0.0008) [2023-12-28 03:43:27,775][106226] Updated weights for policy 0, policy_version 1177961 (0.0008) [2023-12-28 03:43:27,820][106226] Updated weights for policy 0, policy_version 1177971 (0.0007) [2023-12-28 03:43:28,118][106225] Updated weights for policy 1, policy_version 1181003 (0.0010) [2023-12-28 03:43:28,171][106225] Updated weights for policy 1, policy_version 1181013 (0.0010) [2023-12-28 03:43:28,223][106225] Updated weights for policy 1, policy_version 1181023 (0.0010) [2023-12-28 03:43:28,569][106226] Updated weights for policy 0, policy_version 1177981 (0.0006) [2023-12-28 03:43:28,627][106226] Updated weights for policy 0, policy_version 1177991 (0.0006) [2023-12-28 03:43:28,687][106226] Updated weights for policy 0, policy_version 1178001 (0.0006) [2023-12-28 03:43:28,953][106225] Updated weights for policy 1, policy_version 1181033 (0.0010) [2023-12-28 03:43:29,003][106225] Updated weights for policy 1, policy_version 1181043 (0.0010) [2023-12-28 03:43:29,060][106225] Updated weights for policy 1, policy_version 1181053 (0.0010) [2023-12-28 03:43:29,115][106225] Updated weights for policy 1, policy_version 1181063 (0.0010) [2023-12-28 03:43:29,293][106226] Updated weights for policy 0, policy_version 1178011 (0.0006) [2023-12-28 03:43:29,358][106226] Updated weights for policy 0, policy_version 1178021 (0.0008) [2023-12-28 03:43:29,421][106226] Updated weights for policy 0, policy_version 1178031 (0.0008) [2023-12-28 03:43:29,838][106225] Updated weights for policy 1, policy_version 1181073 (0.0010) [2023-12-28 03:43:29,897][106225] Updated weights for policy 1, policy_version 1181083 (0.0011) [2023-12-28 03:43:29,966][106225] Updated weights for policy 1, policy_version 1181093 (0.0009) [2023-12-28 03:43:30,073][106226] Updated weights for policy 0, policy_version 1178041 (0.0006) [2023-12-28 03:43:30,135][106226] Updated weights for policy 0, policy_version 1178051 (0.0006) [2023-12-28 03:43:30,193][106226] Updated weights for policy 0, policy_version 1178061 (0.0006) [2023-12-28 03:43:30,248][106226] Updated weights for policy 0, policy_version 1178071 (0.0007) [2023-12-28 03:43:30,631][106225] Updated weights for policy 1, policy_version 1181103 (0.0007) [2023-12-28 03:43:30,680][106225] Updated weights for policy 1, policy_version 1181113 (0.0005) [2023-12-28 03:43:30,727][106225] Updated weights for policy 1, policy_version 1181123 (0.0005) [2023-12-28 03:43:30,874][106226] Updated weights for policy 0, policy_version 1178081 (0.0010) [2023-12-28 03:43:30,927][106226] Updated weights for policy 0, policy_version 1178091 (0.0010) [2023-12-28 03:43:30,984][106226] Updated weights for policy 0, policy_version 1178101 (0.0011) [2023-12-28 03:43:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 604069888. Throughput: 0: 9841.0, 1: 9804.3. Samples: 604056040. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:31,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-5.019')] [2023-12-28 03:43:31,344][106225] Updated weights for policy 1, policy_version 1181133 (0.0007) [2023-12-28 03:43:31,407][106225] Updated weights for policy 1, policy_version 1181143 (0.0007) [2023-12-28 03:43:31,481][106225] Updated weights for policy 1, policy_version 1181153 (0.0006) [2023-12-28 03:43:31,792][106226] Updated weights for policy 0, policy_version 1178111 (0.0009) [2023-12-28 03:43:31,843][106226] Updated weights for policy 0, policy_version 1178121 (0.0008) [2023-12-28 03:43:31,901][106226] Updated weights for policy 0, policy_version 1178131 (0.0008) [2023-12-28 03:43:32,152][106225] Updated weights for policy 1, policy_version 1181163 (0.0008) [2023-12-28 03:43:32,212][106225] Updated weights for policy 1, policy_version 1181173 (0.0009) [2023-12-28 03:43:32,271][106225] Updated weights for policy 1, policy_version 1181183 (0.0008) [2023-12-28 03:43:32,609][106226] Updated weights for policy 0, policy_version 1178142 (0.0009) [2023-12-28 03:43:32,665][106226] Updated weights for policy 0, policy_version 1178152 (0.0009) [2023-12-28 03:43:32,726][106226] Updated weights for policy 0, policy_version 1178162 (0.0007) [2023-12-28 03:43:32,961][106225] Updated weights for policy 1, policy_version 1181193 (0.0008) [2023-12-28 03:43:33,015][106225] Updated weights for policy 1, policy_version 1181203 (0.0008) [2023-12-28 03:43:33,063][106225] Updated weights for policy 1, policy_version 1181213 (0.0008) [2023-12-28 03:43:33,112][106225] Updated weights for policy 1, policy_version 1181223 (0.0008) [2023-12-28 03:43:33,346][106226] Updated weights for policy 0, policy_version 1178172 (0.0006) [2023-12-28 03:43:33,393][106226] Updated weights for policy 0, policy_version 1178182 (0.0005) [2023-12-28 03:43:33,438][106226] Updated weights for policy 0, policy_version 1178192 (0.0005) [2023-12-28 03:43:33,897][106225] Updated weights for policy 1, policy_version 1181233 (0.0007) [2023-12-28 03:43:33,945][106225] Updated weights for policy 1, policy_version 1181243 (0.0008) [2023-12-28 03:43:33,998][106225] Updated weights for policy 1, policy_version 1181253 (0.0009) [2023-12-28 03:43:34,037][106226] Updated weights for policy 0, policy_version 1178202 (0.0007) [2023-12-28 03:43:34,090][106226] Updated weights for policy 0, policy_version 1178212 (0.0006) [2023-12-28 03:43:34,154][106226] Updated weights for policy 0, policy_version 1178222 (0.0007) [2023-12-28 03:43:34,215][106226] Updated weights for policy 0, policy_version 1178232 (0.0009) [2023-12-28 03:43:34,789][106225] Updated weights for policy 1, policy_version 1181263 (0.0007) [2023-12-28 03:43:34,843][106225] Updated weights for policy 1, policy_version 1181273 (0.0008) [2023-12-28 03:43:34,892][106225] Updated weights for policy 1, policy_version 1181283 (0.0008) [2023-12-28 03:43:34,920][106226] Updated weights for policy 0, policy_version 1178242 (0.0009) [2023-12-28 03:43:34,979][106226] Updated weights for policy 0, policy_version 1178252 (0.0009) [2023-12-28 03:43:35,028][106226] Updated weights for policy 0, policy_version 1178262 (0.0008) [2023-12-28 03:43:35,639][106226] Updated weights for policy 0, policy_version 1178272 (0.0006) [2023-12-28 03:43:35,677][106225] Updated weights for policy 1, policy_version 1181293 (0.0007) [2023-12-28 03:43:35,692][106226] Updated weights for policy 0, policy_version 1178282 (0.0005) [2023-12-28 03:43:35,724][106225] Updated weights for policy 1, policy_version 1181303 (0.0007) [2023-12-28 03:43:35,743][106226] Updated weights for policy 0, policy_version 1178292 (0.0006) [2023-12-28 03:43:35,776][106225] Updated weights for policy 1, policy_version 1181313 (0.0008) [2023-12-28 03:43:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 604168192. Throughput: 0: 9957.3, 1: 9747.1. Samples: 604177356. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:36,176][105115] Avg episode reward: [(0, '-4.541'), (1, '-5.213')] [2023-12-28 03:43:36,348][106226] Updated weights for policy 0, policy_version 1178302 (0.0007) [2023-12-28 03:43:36,406][106226] Updated weights for policy 0, policy_version 1178312 (0.0009) [2023-12-28 03:43:36,471][106226] Updated weights for policy 0, policy_version 1178322 (0.0009) [2023-12-28 03:43:36,604][106225] Updated weights for policy 1, policy_version 1181323 (0.0008) [2023-12-28 03:43:36,668][106225] Updated weights for policy 1, policy_version 1181333 (0.0008) [2023-12-28 03:43:36,728][106225] Updated weights for policy 1, policy_version 1181343 (0.0008) [2023-12-28 03:43:37,253][106226] Updated weights for policy 0, policy_version 1178332 (0.0009) [2023-12-28 03:43:37,317][106226] Updated weights for policy 0, policy_version 1178342 (0.0009) [2023-12-28 03:43:37,375][106226] Updated weights for policy 0, policy_version 1178352 (0.0009) [2023-12-28 03:43:37,429][106225] Updated weights for policy 1, policy_version 1181353 (0.0007) [2023-12-28 03:43:37,487][106225] Updated weights for policy 1, policy_version 1181363 (0.0008) [2023-12-28 03:43:37,543][106225] Updated weights for policy 1, policy_version 1181373 (0.0009) [2023-12-28 03:43:37,601][106225] Updated weights for policy 1, policy_version 1181383 (0.0008) [2023-12-28 03:43:38,113][106226] Updated weights for policy 0, policy_version 1178362 (0.0008) [2023-12-28 03:43:38,175][106226] Updated weights for policy 0, policy_version 1178372 (0.0008) [2023-12-28 03:43:38,237][106226] Updated weights for policy 0, policy_version 1178382 (0.0006) [2023-12-28 03:43:38,255][106225] Updated weights for policy 1, policy_version 1181393 (0.0008) [2023-12-28 03:43:38,299][106226] Updated weights for policy 0, policy_version 1178392 (0.0005) [2023-12-28 03:43:38,307][106225] Updated weights for policy 1, policy_version 1181403 (0.0009) [2023-12-28 03:43:38,371][106225] Updated weights for policy 1, policy_version 1181413 (0.0007) [2023-12-28 03:43:38,964][106226] Updated weights for policy 0, policy_version 1178402 (0.0005) [2023-12-28 03:43:39,012][106226] Updated weights for policy 0, policy_version 1178412 (0.0006) [2023-12-28 03:43:39,053][106225] Updated weights for policy 1, policy_version 1181423 (0.0007) [2023-12-28 03:43:39,065][106226] Updated weights for policy 0, policy_version 1178422 (0.0007) [2023-12-28 03:43:39,105][106225] Updated weights for policy 1, policy_version 1181433 (0.0005) [2023-12-28 03:43:39,154][106225] Updated weights for policy 1, policy_version 1181443 (0.0005) [2023-12-28 03:43:39,828][106226] Updated weights for policy 0, policy_version 1178432 (0.0008) [2023-12-28 03:43:39,890][106226] Updated weights for policy 0, policy_version 1178442 (0.0009) [2023-12-28 03:43:39,929][106225] Updated weights for policy 1, policy_version 1181453 (0.0007) [2023-12-28 03:43:39,960][106226] Updated weights for policy 0, policy_version 1178452 (0.0007) [2023-12-28 03:43:39,992][106225] Updated weights for policy 1, policy_version 1181463 (0.0007) [2023-12-28 03:43:40,054][106225] Updated weights for policy 1, policy_version 1181473 (0.0007) [2023-12-28 03:43:40,654][106226] Updated weights for policy 0, policy_version 1178462 (0.0008) [2023-12-28 03:43:40,713][106226] Updated weights for policy 0, policy_version 1178472 (0.0008) [2023-12-28 03:43:40,762][106225] Updated weights for policy 1, policy_version 1181483 (0.0008) [2023-12-28 03:43:40,771][106226] Updated weights for policy 0, policy_version 1178482 (0.0009) [2023-12-28 03:43:40,822][106225] Updated weights for policy 1, policy_version 1181493 (0.0008) [2023-12-28 03:43:40,885][106225] Updated weights for policy 1, policy_version 1181503 (0.0009) [2023-12-28 03:43:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 604266496. Throughput: 0: 9980.5, 1: 9732.6. Samples: 604235216. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:41,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.132')] [2023-12-28 03:43:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001181512_302514176.pth... [2023-12-28 03:43:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001178488_301752320.pth... [2023-12-28 03:43:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001180360_302219264.pth [2023-12-28 03:43:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001177336_301457408.pth [2023-12-28 03:43:41,510][106226] Updated weights for policy 0, policy_version 1178492 (0.0006) [2023-12-28 03:43:41,573][106226] Updated weights for policy 0, policy_version 1178502 (0.0008) [2023-12-28 03:43:41,636][106226] Updated weights for policy 0, policy_version 1178512 (0.0007) [2023-12-28 03:43:41,731][106225] Updated weights for policy 1, policy_version 1181513 (0.0009) [2023-12-28 03:43:41,807][106225] Updated weights for policy 1, policy_version 1181523 (0.0009) [2023-12-28 03:43:41,866][106225] Updated weights for policy 1, policy_version 1181533 (0.0008) [2023-12-28 03:43:41,933][106225] Updated weights for policy 1, policy_version 1181543 (0.0006) [2023-12-28 03:43:42,395][106226] Updated weights for policy 0, policy_version 1178522 (0.0008) [2023-12-28 03:43:42,458][106226] Updated weights for policy 0, policy_version 1178532 (0.0009) [2023-12-28 03:43:42,515][106226] Updated weights for policy 0, policy_version 1178542 (0.0010) [2023-12-28 03:43:42,578][106226] Updated weights for policy 0, policy_version 1178552 (0.0006) [2023-12-28 03:43:42,622][106225] Updated weights for policy 1, policy_version 1181553 (0.0008) [2023-12-28 03:43:42,673][106225] Updated weights for policy 1, policy_version 1181563 (0.0007) [2023-12-28 03:43:42,724][106225] Updated weights for policy 1, policy_version 1181573 (0.0008) [2023-12-28 03:43:43,300][106226] Updated weights for policy 0, policy_version 1178562 (0.0010) [2023-12-28 03:43:43,357][106226] Updated weights for policy 0, policy_version 1178572 (0.0010) [2023-12-28 03:43:43,392][106225] Updated weights for policy 1, policy_version 1181583 (0.0006) [2023-12-28 03:43:43,414][106226] Updated weights for policy 0, policy_version 1178582 (0.0010) [2023-12-28 03:43:43,459][106225] Updated weights for policy 1, policy_version 1181593 (0.0006) [2023-12-28 03:43:43,531][106225] Updated weights for policy 1, policy_version 1181603 (0.0005) [2023-12-28 03:43:44,007][106225] Updated weights for policy 1, policy_version 1181613 (0.0005) [2023-12-28 03:43:44,059][106225] Updated weights for policy 1, policy_version 1181623 (0.0005) [2023-12-28 03:43:44,073][106226] Updated weights for policy 0, policy_version 1178592 (0.0011) [2023-12-28 03:43:44,110][106225] Updated weights for policy 1, policy_version 1181633 (0.0007) [2023-12-28 03:43:44,138][106226] Updated weights for policy 0, policy_version 1178602 (0.0007) [2023-12-28 03:43:44,208][106226] Updated weights for policy 0, policy_version 1178612 (0.0008) [2023-12-28 03:43:44,710][106225] Updated weights for policy 1, policy_version 1181643 (0.0007) [2023-12-28 03:43:44,771][106225] Updated weights for policy 1, policy_version 1181653 (0.0007) [2023-12-28 03:43:44,827][106225] Updated weights for policy 1, policy_version 1181663 (0.0008) [2023-12-28 03:43:44,870][106226] Updated weights for policy 0, policy_version 1178622 (0.0011) [2023-12-28 03:43:44,932][106226] Updated weights for policy 0, policy_version 1178632 (0.0011) [2023-12-28 03:43:44,987][106226] Updated weights for policy 0, policy_version 1178642 (0.0010) [2023-12-28 03:43:45,544][106225] Updated weights for policy 1, policy_version 1181673 (0.0007) [2023-12-28 03:43:45,600][106225] Updated weights for policy 1, policy_version 1181683 (0.0008) [2023-12-28 03:43:45,659][106225] Updated weights for policy 1, policy_version 1181693 (0.0008) [2023-12-28 03:43:45,709][106225] Updated weights for policy 1, policy_version 1181703 (0.0008) [2023-12-28 03:43:45,716][106226] Updated weights for policy 0, policy_version 1178652 (0.0009) [2023-12-28 03:43:45,765][106226] Updated weights for policy 0, policy_version 1178662 (0.0010) [2023-12-28 03:43:45,815][106226] Updated weights for policy 0, policy_version 1178672 (0.0010) [2023-12-28 03:43:46,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19938.5). Total num frames: 604364800. Throughput: 0: 9972.0, 1: 9819.2. Samples: 604354052. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:46,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-5.132')] [2023-12-28 03:43:46,458][106225] Updated weights for policy 1, policy_version 1181713 (0.0009) [2023-12-28 03:43:46,489][106226] Updated weights for policy 0, policy_version 1178682 (0.0009) [2023-12-28 03:43:46,513][106225] Updated weights for policy 1, policy_version 1181723 (0.0009) [2023-12-28 03:43:46,541][106226] Updated weights for policy 0, policy_version 1178692 (0.0008) [2023-12-28 03:43:46,566][106225] Updated weights for policy 1, policy_version 1181733 (0.0006) [2023-12-28 03:43:46,593][106226] Updated weights for policy 0, policy_version 1178702 (0.0007) [2023-12-28 03:43:46,655][106226] Updated weights for policy 0, policy_version 1178712 (0.0009) [2023-12-28 03:43:47,250][106225] Updated weights for policy 1, policy_version 1181743 (0.0007) [2023-12-28 03:43:47,288][106226] Updated weights for policy 0, policy_version 1178722 (0.0010) [2023-12-28 03:43:47,308][106225] Updated weights for policy 1, policy_version 1181753 (0.0008) [2023-12-28 03:43:47,332][106226] Updated weights for policy 0, policy_version 1178732 (0.0010) [2023-12-28 03:43:47,369][106225] Updated weights for policy 1, policy_version 1181763 (0.0006) [2023-12-28 03:43:47,379][106226] Updated weights for policy 0, policy_version 1178742 (0.0010) [2023-12-28 03:43:48,019][106226] Updated weights for policy 0, policy_version 1178752 (0.0008) [2023-12-28 03:43:48,078][106226] Updated weights for policy 0, policy_version 1178762 (0.0005) [2023-12-28 03:43:48,133][106225] Updated weights for policy 1, policy_version 1181773 (0.0006) [2023-12-28 03:43:48,139][106226] Updated weights for policy 0, policy_version 1178772 (0.0010) [2023-12-28 03:43:48,192][106225] Updated weights for policy 1, policy_version 1181783 (0.0006) [2023-12-28 03:43:48,255][106225] Updated weights for policy 1, policy_version 1181793 (0.0009) [2023-12-28 03:43:48,758][106226] Updated weights for policy 0, policy_version 1178782 (0.0011) [2023-12-28 03:43:48,822][106226] Updated weights for policy 0, policy_version 1178792 (0.0011) [2023-12-28 03:43:48,883][106226] Updated weights for policy 0, policy_version 1178802 (0.0011) [2023-12-28 03:43:48,987][106225] Updated weights for policy 1, policy_version 1181803 (0.0010) [2023-12-28 03:43:49,042][106225] Updated weights for policy 1, policy_version 1181813 (0.0007) [2023-12-28 03:43:49,102][106225] Updated weights for policy 1, policy_version 1181823 (0.0008) [2023-12-28 03:43:49,626][106226] Updated weights for policy 0, policy_version 1178812 (0.0010) [2023-12-28 03:43:49,689][106226] Updated weights for policy 0, policy_version 1178822 (0.0006) [2023-12-28 03:43:49,754][106226] Updated weights for policy 0, policy_version 1178832 (0.0006) [2023-12-28 03:43:49,824][106225] Updated weights for policy 1, policy_version 1181833 (0.0007) [2023-12-28 03:43:49,891][106225] Updated weights for policy 1, policy_version 1181843 (0.0010) [2023-12-28 03:43:49,956][106225] Updated weights for policy 1, policy_version 1181853 (0.0011) [2023-12-28 03:43:50,020][106225] Updated weights for policy 1, policy_version 1181863 (0.0006) [2023-12-28 03:43:50,478][106226] Updated weights for policy 0, policy_version 1178842 (0.0008) [2023-12-28 03:43:50,532][106226] Updated weights for policy 0, policy_version 1178852 (0.0008) [2023-12-28 03:43:50,584][106226] Updated weights for policy 0, policy_version 1178862 (0.0008) [2023-12-28 03:43:50,646][106226] Updated weights for policy 0, policy_version 1178872 (0.0008) [2023-12-28 03:43:50,810][106225] Updated weights for policy 1, policy_version 1181873 (0.0010) [2023-12-28 03:43:50,869][106225] Updated weights for policy 1, policy_version 1181883 (0.0008) [2023-12-28 03:43:50,934][106225] Updated weights for policy 1, policy_version 1181893 (0.0009) [2023-12-28 03:43:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 604463104. Throughput: 0: 9958.4, 1: 9815.4. Samples: 604472240. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:51,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.800')] [2023-12-28 03:43:51,439][106226] Updated weights for policy 0, policy_version 1178882 (0.0008) [2023-12-28 03:43:51,500][106226] Updated weights for policy 0, policy_version 1178892 (0.0008) [2023-12-28 03:43:51,567][106226] Updated weights for policy 0, policy_version 1178902 (0.0009) [2023-12-28 03:43:51,671][106225] Updated weights for policy 1, policy_version 1181903 (0.0008) [2023-12-28 03:43:51,733][106225] Updated weights for policy 1, policy_version 1181913 (0.0006) [2023-12-28 03:43:51,803][106225] Updated weights for policy 1, policy_version 1181923 (0.0009) [2023-12-28 03:43:52,291][106226] Updated weights for policy 0, policy_version 1178912 (0.0008) [2023-12-28 03:43:52,363][106226] Updated weights for policy 0, policy_version 1178922 (0.0009) [2023-12-28 03:43:52,429][106226] Updated weights for policy 0, policy_version 1178932 (0.0009) [2023-12-28 03:43:52,588][106225] Updated weights for policy 1, policy_version 1181933 (0.0009) [2023-12-28 03:43:52,651][106225] Updated weights for policy 1, policy_version 1181943 (0.0008) [2023-12-28 03:43:52,707][106225] Updated weights for policy 1, policy_version 1181953 (0.0008) [2023-12-28 03:43:53,139][106226] Updated weights for policy 0, policy_version 1178942 (0.0007) [2023-12-28 03:43:53,186][106226] Updated weights for policy 0, policy_version 1178952 (0.0008) [2023-12-28 03:43:53,242][106226] Updated weights for policy 0, policy_version 1178962 (0.0008) [2023-12-28 03:43:53,427][106225] Updated weights for policy 1, policy_version 1181963 (0.0008) [2023-12-28 03:43:53,483][106225] Updated weights for policy 1, policy_version 1181973 (0.0006) [2023-12-28 03:43:53,530][106225] Updated weights for policy 1, policy_version 1181983 (0.0005) [2023-12-28 03:43:53,949][106226] Updated weights for policy 0, policy_version 1178972 (0.0009) [2023-12-28 03:43:54,002][106226] Updated weights for policy 0, policy_version 1178982 (0.0010) [2023-12-28 03:43:54,054][106226] Updated weights for policy 0, policy_version 1178992 (0.0006) [2023-12-28 03:43:54,095][106225] Updated weights for policy 1, policy_version 1181993 (0.0010) [2023-12-28 03:43:54,144][106225] Updated weights for policy 1, policy_version 1182003 (0.0008) [2023-12-28 03:43:54,198][106225] Updated weights for policy 1, policy_version 1182013 (0.0005) [2023-12-28 03:43:54,250][106225] Updated weights for policy 1, policy_version 1182023 (0.0005) [2023-12-28 03:43:54,616][106226] Updated weights for policy 0, policy_version 1179002 (0.0005) [2023-12-28 03:43:54,678][106226] Updated weights for policy 0, policy_version 1179012 (0.0009) [2023-12-28 03:43:54,737][106226] Updated weights for policy 0, policy_version 1179022 (0.0010) [2023-12-28 03:43:54,788][106226] Updated weights for policy 0, policy_version 1179032 (0.0010) [2023-12-28 03:43:54,887][106225] Updated weights for policy 1, policy_version 1182033 (0.0005) [2023-12-28 03:43:54,941][106225] Updated weights for policy 1, policy_version 1182043 (0.0008) [2023-12-28 03:43:55,005][106225] Updated weights for policy 1, policy_version 1182053 (0.0010) [2023-12-28 03:43:55,355][106226] Updated weights for policy 0, policy_version 1179042 (0.0005) [2023-12-28 03:43:55,411][106226] Updated weights for policy 0, policy_version 1179052 (0.0005) [2023-12-28 03:43:55,472][106226] Updated weights for policy 0, policy_version 1179062 (0.0005) [2023-12-28 03:43:55,687][106225] Updated weights for policy 1, policy_version 1182063 (0.0010) [2023-12-28 03:43:55,740][106225] Updated weights for policy 1, policy_version 1182073 (0.0010) [2023-12-28 03:43:55,796][106225] Updated weights for policy 1, policy_version 1182083 (0.0010) [2023-12-28 03:43:55,970][106226] Updated weights for policy 0, policy_version 1179072 (0.0005) [2023-12-28 03:43:56,027][106226] Updated weights for policy 0, policy_version 1179082 (0.0008) [2023-12-28 03:43:56,086][106226] Updated weights for policy 0, policy_version 1179092 (0.0010) [2023-12-28 03:43:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 604569600. Throughput: 0: 9902.1, 1: 9826.5. Samples: 604529140. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:43:56,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.973')] [2023-12-28 03:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001182088_302661632.pth... [2023-12-28 03:43:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001179096_301907968.pth... [2023-12-28 03:43:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001180936_302366720.pth [2023-12-28 03:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001177912_301604864.pth [2023-12-28 03:43:56,464][106225] Updated weights for policy 1, policy_version 1182093 (0.0008) [2023-12-28 03:43:56,520][106225] Updated weights for policy 1, policy_version 1182103 (0.0007) [2023-12-28 03:43:56,581][106225] Updated weights for policy 1, policy_version 1182113 (0.0007) [2023-12-28 03:43:56,696][106226] Updated weights for policy 0, policy_version 1179102 (0.0010) [2023-12-28 03:43:56,745][106226] Updated weights for policy 0, policy_version 1179112 (0.0010) [2023-12-28 03:43:56,799][106226] Updated weights for policy 0, policy_version 1179122 (0.0008) [2023-12-28 03:43:57,241][106225] Updated weights for policy 1, policy_version 1182123 (0.0009) [2023-12-28 03:43:57,297][106225] Updated weights for policy 1, policy_version 1182133 (0.0010) [2023-12-28 03:43:57,360][106225] Updated weights for policy 1, policy_version 1182143 (0.0010) [2023-12-28 03:43:57,492][106226] Updated weights for policy 0, policy_version 1179132 (0.0008) [2023-12-28 03:43:57,550][106226] Updated weights for policy 0, policy_version 1179142 (0.0005) [2023-12-28 03:43:57,605][106226] Updated weights for policy 0, policy_version 1179152 (0.0006) [2023-12-28 03:43:57,956][106225] Updated weights for policy 1, policy_version 1182153 (0.0009) [2023-12-28 03:43:58,016][106225] Updated weights for policy 1, policy_version 1182163 (0.0009) [2023-12-28 03:43:58,070][106225] Updated weights for policy 1, policy_version 1182173 (0.0010) [2023-12-28 03:43:58,125][106225] Updated weights for policy 1, policy_version 1182183 (0.0010) [2023-12-28 03:43:58,286][106226] Updated weights for policy 0, policy_version 1179162 (0.0011) [2023-12-28 03:43:58,351][106226] Updated weights for policy 0, policy_version 1179172 (0.0010) [2023-12-28 03:43:58,426][106226] Updated weights for policy 0, policy_version 1179182 (0.0008) [2023-12-28 03:43:58,488][106226] Updated weights for policy 0, policy_version 1179192 (0.0008) [2023-12-28 03:43:58,909][106225] Updated weights for policy 1, policy_version 1182193 (0.0009) [2023-12-28 03:43:58,977][106225] Updated weights for policy 1, policy_version 1182203 (0.0008) [2023-12-28 03:43:59,041][106225] Updated weights for policy 1, policy_version 1182213 (0.0007) [2023-12-28 03:43:59,282][106226] Updated weights for policy 0, policy_version 1179202 (0.0007) [2023-12-28 03:43:59,349][106226] Updated weights for policy 0, policy_version 1179212 (0.0008) [2023-12-28 03:43:59,414][106226] Updated weights for policy 0, policy_version 1179222 (0.0007) [2023-12-28 03:43:59,788][106225] Updated weights for policy 1, policy_version 1182223 (0.0006) [2023-12-28 03:43:59,857][106225] Updated weights for policy 1, policy_version 1182233 (0.0007) [2023-12-28 03:43:59,927][106225] Updated weights for policy 1, policy_version 1182243 (0.0007) [2023-12-28 03:44:00,189][106226] Updated weights for policy 0, policy_version 1179232 (0.0008) [2023-12-28 03:44:00,256][106226] Updated weights for policy 0, policy_version 1179242 (0.0008) [2023-12-28 03:44:00,318][106226] Updated weights for policy 0, policy_version 1179252 (0.0008) [2023-12-28 03:44:00,687][106225] Updated weights for policy 1, policy_version 1182253 (0.0008) [2023-12-28 03:44:00,736][106225] Updated weights for policy 1, policy_version 1182263 (0.0005) [2023-12-28 03:44:00,787][106225] Updated weights for policy 1, policy_version 1182273 (0.0005) [2023-12-28 03:44:00,952][106226] Updated weights for policy 0, policy_version 1179262 (0.0007) [2023-12-28 03:44:01,016][106226] Updated weights for policy 0, policy_version 1179272 (0.0009) [2023-12-28 03:44:01,087][106226] Updated weights for policy 0, policy_version 1179282 (0.0007) [2023-12-28 03:44:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 604667904. Throughput: 0: 9992.7, 1: 9947.4. Samples: 604654664. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:01,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.705')] [2023-12-28 03:44:01,507][106225] Updated weights for policy 1, policy_version 1182283 (0.0006) [2023-12-28 03:44:01,575][106225] Updated weights for policy 1, policy_version 1182293 (0.0006) [2023-12-28 03:44:01,652][106225] Updated weights for policy 1, policy_version 1182303 (0.0008) [2023-12-28 03:44:01,766][106226] Updated weights for policy 0, policy_version 1179292 (0.0007) [2023-12-28 03:44:01,819][106226] Updated weights for policy 0, policy_version 1179302 (0.0008) [2023-12-28 03:44:01,870][106226] Updated weights for policy 0, policy_version 1179312 (0.0008) [2023-12-28 03:44:02,247][106225] Updated weights for policy 1, policy_version 1182313 (0.0006) [2023-12-28 03:44:02,298][106225] Updated weights for policy 1, policy_version 1182323 (0.0008) [2023-12-28 03:44:02,359][106225] Updated weights for policy 1, policy_version 1182333 (0.0008) [2023-12-28 03:44:02,419][106225] Updated weights for policy 1, policy_version 1182343 (0.0008) [2023-12-28 03:44:02,582][106226] Updated weights for policy 0, policy_version 1179322 (0.0008) [2023-12-28 03:44:02,635][106226] Updated weights for policy 0, policy_version 1179332 (0.0007) [2023-12-28 03:44:02,680][106226] Updated weights for policy 0, policy_version 1179342 (0.0008) [2023-12-28 03:44:02,741][106226] Updated weights for policy 0, policy_version 1179352 (0.0008) [2023-12-28 03:44:03,083][106225] Updated weights for policy 1, policy_version 1182353 (0.0006) [2023-12-28 03:44:03,138][106225] Updated weights for policy 1, policy_version 1182363 (0.0005) [2023-12-28 03:44:03,202][106225] Updated weights for policy 1, policy_version 1182373 (0.0006) [2023-12-28 03:44:03,501][106226] Updated weights for policy 0, policy_version 1179362 (0.0009) [2023-12-28 03:44:03,556][106226] Updated weights for policy 0, policy_version 1179372 (0.0008) [2023-12-28 03:44:03,611][106226] Updated weights for policy 0, policy_version 1179382 (0.0008) [2023-12-28 03:44:03,831][106225] Updated weights for policy 1, policy_version 1182383 (0.0009) [2023-12-28 03:44:03,901][106225] Updated weights for policy 1, policy_version 1182393 (0.0006) [2023-12-28 03:44:03,975][106225] Updated weights for policy 1, policy_version 1182403 (0.0008) [2023-12-28 03:44:04,323][106226] Updated weights for policy 0, policy_version 1179392 (0.0010) [2023-12-28 03:44:04,380][106226] Updated weights for policy 0, policy_version 1179402 (0.0009) [2023-12-28 03:44:04,439][106226] Updated weights for policy 0, policy_version 1179412 (0.0007) [2023-12-28 03:44:04,695][106225] Updated weights for policy 1, policy_version 1182413 (0.0009) [2023-12-28 03:44:04,743][106225] Updated weights for policy 1, policy_version 1182423 (0.0008) [2023-12-28 03:44:04,797][106225] Updated weights for policy 1, policy_version 1182433 (0.0009) [2023-12-28 03:44:05,017][106226] Updated weights for policy 0, policy_version 1179422 (0.0008) [2023-12-28 03:44:05,062][106226] Updated weights for policy 0, policy_version 1179432 (0.0008) [2023-12-28 03:44:05,120][106226] Updated weights for policy 0, policy_version 1179442 (0.0008) [2023-12-28 03:44:05,559][106225] Updated weights for policy 1, policy_version 1182443 (0.0009) [2023-12-28 03:44:05,605][106225] Updated weights for policy 1, policy_version 1182453 (0.0008) [2023-12-28 03:44:05,652][106225] Updated weights for policy 1, policy_version 1182463 (0.0008) [2023-12-28 03:44:05,814][106226] Updated weights for policy 0, policy_version 1179452 (0.0007) [2023-12-28 03:44:05,874][106226] Updated weights for policy 0, policy_version 1179462 (0.0006) [2023-12-28 03:44:05,927][106226] Updated weights for policy 0, policy_version 1179472 (0.0006) [2023-12-28 03:44:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 604766208. Throughput: 0: 10071.7, 1: 9849.2. Samples: 604774656. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:06,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-4.955')] [2023-12-28 03:44:06,350][106225] Updated weights for policy 1, policy_version 1182473 (0.0008) [2023-12-28 03:44:06,412][106225] Updated weights for policy 1, policy_version 1182483 (0.0008) [2023-12-28 03:44:06,482][106225] Updated weights for policy 1, policy_version 1182493 (0.0007) [2023-12-28 03:44:06,542][106225] Updated weights for policy 1, policy_version 1182503 (0.0009) [2023-12-28 03:44:06,669][106226] Updated weights for policy 0, policy_version 1179482 (0.0009) [2023-12-28 03:44:06,728][106226] Updated weights for policy 0, policy_version 1179492 (0.0009) [2023-12-28 03:44:06,782][106226] Updated weights for policy 0, policy_version 1179502 (0.0005) [2023-12-28 03:44:06,843][106226] Updated weights for policy 0, policy_version 1179512 (0.0005) [2023-12-28 03:44:07,292][106225] Updated weights for policy 1, policy_version 1182513 (0.0009) [2023-12-28 03:44:07,355][106225] Updated weights for policy 1, policy_version 1182523 (0.0008) [2023-12-28 03:44:07,421][106225] Updated weights for policy 1, policy_version 1182533 (0.0009) [2023-12-28 03:44:07,556][106226] Updated weights for policy 0, policy_version 1179522 (0.0009) [2023-12-28 03:44:07,619][106226] Updated weights for policy 0, policy_version 1179532 (0.0008) [2023-12-28 03:44:07,679][106226] Updated weights for policy 0, policy_version 1179542 (0.0009) [2023-12-28 03:44:08,181][106225] Updated weights for policy 1, policy_version 1182543 (0.0009) [2023-12-28 03:44:08,245][106225] Updated weights for policy 1, policy_version 1182553 (0.0009) [2023-12-28 03:44:08,308][106225] Updated weights for policy 1, policy_version 1182563 (0.0006) [2023-12-28 03:44:08,377][106226] Updated weights for policy 0, policy_version 1179552 (0.0008) [2023-12-28 03:44:08,436][106226] Updated weights for policy 0, policy_version 1179562 (0.0006) [2023-12-28 03:44:08,499][106226] Updated weights for policy 0, policy_version 1179572 (0.0008) [2023-12-28 03:44:09,032][106225] Updated weights for policy 1, policy_version 1182573 (0.0008) [2023-12-28 03:44:09,080][106225] Updated weights for policy 1, policy_version 1182583 (0.0010) [2023-12-28 03:44:09,134][106225] Updated weights for policy 1, policy_version 1182593 (0.0009) [2023-12-28 03:44:09,190][106226] Updated weights for policy 0, policy_version 1179582 (0.0009) [2023-12-28 03:44:09,255][106226] Updated weights for policy 0, policy_version 1179592 (0.0009) [2023-12-28 03:44:09,323][106226] Updated weights for policy 0, policy_version 1179602 (0.0007) [2023-12-28 03:44:09,843][106225] Updated weights for policy 1, policy_version 1182603 (0.0006) [2023-12-28 03:44:09,910][106225] Updated weights for policy 1, policy_version 1182613 (0.0008) [2023-12-28 03:44:09,973][106225] Updated weights for policy 1, policy_version 1182623 (0.0008) [2023-12-28 03:44:10,091][106226] Updated weights for policy 0, policy_version 1179612 (0.0007) [2023-12-28 03:44:10,147][106226] Updated weights for policy 0, policy_version 1179622 (0.0008) [2023-12-28 03:44:10,204][106226] Updated weights for policy 0, policy_version 1179632 (0.0008) [2023-12-28 03:44:10,749][106225] Updated weights for policy 1, policy_version 1182633 (0.0009) [2023-12-28 03:44:10,815][106225] Updated weights for policy 1, policy_version 1182643 (0.0010) [2023-12-28 03:44:10,881][106225] Updated weights for policy 1, policy_version 1182653 (0.0009) [2023-12-28 03:44:10,881][106226] Updated weights for policy 0, policy_version 1179642 (0.0007) [2023-12-28 03:44:10,931][106226] Updated weights for policy 0, policy_version 1179652 (0.0006) [2023-12-28 03:44:10,940][106225] Updated weights for policy 1, policy_version 1182663 (0.0006) [2023-12-28 03:44:10,982][106226] Updated weights for policy 0, policy_version 1179662 (0.0010) [2023-12-28 03:44:11,059][106226] Updated weights for policy 0, policy_version 1179672 (0.0010) [2023-12-28 03:44:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.2, 300 sec: 19910.7). Total num frames: 604864512. Throughput: 0: 10070.5, 1: 9856.9. Samples: 604832068. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:11,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.057')] [2023-12-28 03:44:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001179672_302055424.pth... [2023-12-28 03:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001182664_302809088.pth... [2023-12-28 03:44:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001178488_301752320.pth [2023-12-28 03:44:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001181512_302514176.pth [2023-12-28 03:44:11,689][106225] Updated weights for policy 1, policy_version 1182673 (0.0007) [2023-12-28 03:44:11,763][106225] Updated weights for policy 1, policy_version 1182683 (0.0008) [2023-12-28 03:44:11,794][106226] Updated weights for policy 0, policy_version 1179682 (0.0008) [2023-12-28 03:44:11,831][106225] Updated weights for policy 1, policy_version 1182693 (0.0011) [2023-12-28 03:44:11,857][106226] Updated weights for policy 0, policy_version 1179692 (0.0007) [2023-12-28 03:44:11,923][106226] Updated weights for policy 0, policy_version 1179702 (0.0006) [2023-12-28 03:44:12,513][106225] Updated weights for policy 1, policy_version 1182703 (0.0007) [2023-12-28 03:44:12,580][106225] Updated weights for policy 1, policy_version 1182713 (0.0006) [2023-12-28 03:44:12,641][106225] Updated weights for policy 1, policy_version 1182723 (0.0008) [2023-12-28 03:44:12,669][106226] Updated weights for policy 0, policy_version 1179712 (0.0008) [2023-12-28 03:44:12,721][106226] Updated weights for policy 0, policy_version 1179722 (0.0008) [2023-12-28 03:44:12,780][106226] Updated weights for policy 0, policy_version 1179732 (0.0007) [2023-12-28 03:44:13,304][106225] Updated weights for policy 1, policy_version 1182733 (0.0008) [2023-12-28 03:44:13,358][106225] Updated weights for policy 1, policy_version 1182743 (0.0010) [2023-12-28 03:44:13,413][106225] Updated weights for policy 1, policy_version 1182753 (0.0009) [2023-12-28 03:44:13,423][106226] Updated weights for policy 0, policy_version 1179742 (0.0006) [2023-12-28 03:44:13,480][106226] Updated weights for policy 0, policy_version 1179752 (0.0006) [2023-12-28 03:44:13,533][106226] Updated weights for policy 0, policy_version 1179762 (0.0009) [2023-12-28 03:44:14,173][106225] Updated weights for policy 1, policy_version 1182763 (0.0008) [2023-12-28 03:44:14,182][106226] Updated weights for policy 0, policy_version 1179772 (0.0010) [2023-12-28 03:44:14,229][106225] Updated weights for policy 1, policy_version 1182773 (0.0008) [2023-12-28 03:44:14,236][106226] Updated weights for policy 0, policy_version 1179782 (0.0011) [2023-12-28 03:44:14,280][106225] Updated weights for policy 1, policy_version 1182783 (0.0005) [2023-12-28 03:44:14,289][106226] Updated weights for policy 0, policy_version 1179792 (0.0010) [2023-12-28 03:44:15,011][106225] Updated weights for policy 1, policy_version 1182793 (0.0007) [2023-12-28 03:44:15,037][106226] Updated weights for policy 0, policy_version 1179802 (0.0011) [2023-12-28 03:44:15,071][106225] Updated weights for policy 1, policy_version 1182803 (0.0007) [2023-12-28 03:44:15,089][106226] Updated weights for policy 0, policy_version 1179812 (0.0010) [2023-12-28 03:44:15,132][106225] Updated weights for policy 1, policy_version 1182813 (0.0006) [2023-12-28 03:44:15,152][106226] Updated weights for policy 0, policy_version 1179822 (0.0011) [2023-12-28 03:44:15,190][106225] Updated weights for policy 1, policy_version 1182823 (0.0008) [2023-12-28 03:44:15,208][106226] Updated weights for policy 0, policy_version 1179832 (0.0010) [2023-12-28 03:44:15,907][106226] Updated weights for policy 0, policy_version 1179842 (0.0008) [2023-12-28 03:44:15,940][106225] Updated weights for policy 1, policy_version 1182833 (0.0007) [2023-12-28 03:44:15,959][106226] Updated weights for policy 0, policy_version 1179852 (0.0006) [2023-12-28 03:44:15,994][106225] Updated weights for policy 1, policy_version 1182843 (0.0008) [2023-12-28 03:44:16,024][106226] Updated weights for policy 0, policy_version 1179862 (0.0008) [2023-12-28 03:44:16,048][106225] Updated weights for policy 1, policy_version 1182853 (0.0007) [2023-12-28 03:44:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 604962816. Throughput: 0: 10022.2, 1: 9809.6. Samples: 604948480. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:16,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.579')] [2023-12-28 03:44:16,645][106226] Updated weights for policy 0, policy_version 1179872 (0.0008) [2023-12-28 03:44:16,689][106226] Updated weights for policy 0, policy_version 1179882 (0.0007) [2023-12-28 03:44:16,741][106226] Updated weights for policy 0, policy_version 1179892 (0.0008) [2023-12-28 03:44:16,792][106225] Updated weights for policy 1, policy_version 1182863 (0.0008) [2023-12-28 03:44:16,852][106225] Updated weights for policy 1, policy_version 1182873 (0.0008) [2023-12-28 03:44:16,904][106225] Updated weights for policy 1, policy_version 1182883 (0.0008) [2023-12-28 03:44:17,388][106226] Updated weights for policy 0, policy_version 1179902 (0.0006) [2023-12-28 03:44:17,446][106226] Updated weights for policy 0, policy_version 1179912 (0.0005) [2023-12-28 03:44:17,500][106226] Updated weights for policy 0, policy_version 1179922 (0.0005) [2023-12-28 03:44:17,719][106225] Updated weights for policy 1, policy_version 1182893 (0.0009) [2023-12-28 03:44:17,786][106225] Updated weights for policy 1, policy_version 1182903 (0.0008) [2023-12-28 03:44:17,846][106225] Updated weights for policy 1, policy_version 1182913 (0.0009) [2023-12-28 03:44:18,083][106226] Updated weights for policy 0, policy_version 1179932 (0.0007) [2023-12-28 03:44:18,145][106226] Updated weights for policy 0, policy_version 1179942 (0.0005) [2023-12-28 03:44:18,205][106226] Updated weights for policy 0, policy_version 1179952 (0.0008) [2023-12-28 03:44:18,586][106225] Updated weights for policy 1, policy_version 1182923 (0.0008) [2023-12-28 03:44:18,635][106225] Updated weights for policy 1, policy_version 1182933 (0.0008) [2023-12-28 03:44:18,683][106225] Updated weights for policy 1, policy_version 1182943 (0.0009) [2023-12-28 03:44:18,884][106226] Updated weights for policy 0, policy_version 1179962 (0.0008) [2023-12-28 03:44:18,944][106226] Updated weights for policy 0, policy_version 1179972 (0.0008) [2023-12-28 03:44:19,011][106226] Updated weights for policy 0, policy_version 1179982 (0.0007) [2023-12-28 03:44:19,075][106226] Updated weights for policy 0, policy_version 1179992 (0.0007) [2023-12-28 03:44:19,489][106225] Updated weights for policy 1, policy_version 1182953 (0.0008) [2023-12-28 03:44:19,557][106225] Updated weights for policy 1, policy_version 1182963 (0.0009) [2023-12-28 03:44:19,620][106225] Updated weights for policy 1, policy_version 1182973 (0.0009) [2023-12-28 03:44:19,680][106225] Updated weights for policy 1, policy_version 1182983 (0.0008) [2023-12-28 03:44:19,690][106226] Updated weights for policy 0, policy_version 1180002 (0.0006) [2023-12-28 03:44:19,754][106226] Updated weights for policy 0, policy_version 1180012 (0.0009) [2023-12-28 03:44:19,817][106226] Updated weights for policy 0, policy_version 1180022 (0.0009) [2023-12-28 03:44:20,412][106226] Updated weights for policy 0, policy_version 1180032 (0.0008) [2023-12-28 03:44:20,466][106226] Updated weights for policy 0, policy_version 1180042 (0.0005) [2023-12-28 03:44:20,506][106225] Updated weights for policy 1, policy_version 1182993 (0.0008) [2023-12-28 03:44:20,527][106226] Updated weights for policy 0, policy_version 1180052 (0.0006) [2023-12-28 03:44:20,562][106225] Updated weights for policy 1, policy_version 1183003 (0.0009) [2023-12-28 03:44:20,643][106225] Updated weights for policy 1, policy_version 1183013 (0.0008) [2023-12-28 03:44:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 605052928. Throughput: 0: 10033.1, 1: 9718.2. Samples: 605066160. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:21,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-5.183')] [2023-12-28 03:44:21,231][106226] Updated weights for policy 0, policy_version 1180062 (0.0008) [2023-12-28 03:44:21,299][106226] Updated weights for policy 0, policy_version 1180072 (0.0007) [2023-12-28 03:44:21,369][106226] Updated weights for policy 0, policy_version 1180082 (0.0009) [2023-12-28 03:44:21,384][106225] Updated weights for policy 1, policy_version 1183023 (0.0009) [2023-12-28 03:44:21,445][106225] Updated weights for policy 1, policy_version 1183033 (0.0007) [2023-12-28 03:44:21,500][106225] Updated weights for policy 1, policy_version 1183043 (0.0008) [2023-12-28 03:44:22,124][106226] Updated weights for policy 0, policy_version 1180092 (0.0007) [2023-12-28 03:44:22,178][106226] Updated weights for policy 0, policy_version 1180102 (0.0009) [2023-12-28 03:44:22,237][106226] Updated weights for policy 0, policy_version 1180112 (0.0008) [2023-12-28 03:44:22,263][106225] Updated weights for policy 1, policy_version 1183053 (0.0008) [2023-12-28 03:44:22,331][106225] Updated weights for policy 1, policy_version 1183063 (0.0009) [2023-12-28 03:44:22,400][106225] Updated weights for policy 1, policy_version 1183073 (0.0006) [2023-12-28 03:44:23,002][106226] Updated weights for policy 0, policy_version 1180122 (0.0008) [2023-12-28 03:44:23,066][106226] Updated weights for policy 0, policy_version 1180132 (0.0008) [2023-12-28 03:44:23,078][106225] Updated weights for policy 1, policy_version 1183083 (0.0007) [2023-12-28 03:44:23,119][106226] Updated weights for policy 0, policy_version 1180142 (0.0010) [2023-12-28 03:44:23,122][106225] Updated weights for policy 1, policy_version 1183093 (0.0007) [2023-12-28 03:44:23,167][106225] Updated weights for policy 1, policy_version 1183103 (0.0008) [2023-12-28 03:44:23,180][106226] Updated weights for policy 0, policy_version 1180152 (0.0010) [2023-12-28 03:44:23,814][106226] Updated weights for policy 0, policy_version 1180162 (0.0008) [2023-12-28 03:44:23,867][106226] Updated weights for policy 0, policy_version 1180172 (0.0005) [2023-12-28 03:44:23,905][106225] Updated weights for policy 1, policy_version 1183113 (0.0007) [2023-12-28 03:44:23,930][106226] Updated weights for policy 0, policy_version 1180182 (0.0005) [2023-12-28 03:44:23,961][106225] Updated weights for policy 1, policy_version 1183123 (0.0008) [2023-12-28 03:44:24,029][106225] Updated weights for policy 1, policy_version 1183133 (0.0011) [2023-12-28 03:44:24,092][106225] Updated weights for policy 1, policy_version 1183143 (0.0010) [2023-12-28 03:44:24,618][106226] Updated weights for policy 0, policy_version 1180192 (0.0005) [2023-12-28 03:44:24,678][106226] Updated weights for policy 0, policy_version 1180202 (0.0006) [2023-12-28 03:44:24,725][106226] Updated weights for policy 0, policy_version 1180212 (0.0008) [2023-12-28 03:44:24,744][106225] Updated weights for policy 1, policy_version 1183153 (0.0006) [2023-12-28 03:44:24,797][106225] Updated weights for policy 1, policy_version 1183163 (0.0005) [2023-12-28 03:44:24,858][106225] Updated weights for policy 1, policy_version 1183173 (0.0005) [2023-12-28 03:44:25,382][106225] Updated weights for policy 1, policy_version 1183183 (0.0005) [2023-12-28 03:44:25,437][106225] Updated weights for policy 1, policy_version 1183193 (0.0005) [2023-12-28 03:44:25,489][106225] Updated weights for policy 1, policy_version 1183203 (0.0009) [2023-12-28 03:44:25,499][106226] Updated weights for policy 0, policy_version 1180222 (0.0007) [2023-12-28 03:44:25,557][106226] Updated weights for policy 0, policy_version 1180232 (0.0007) [2023-12-28 03:44:25,615][106226] Updated weights for policy 0, policy_version 1180242 (0.0006) [2023-12-28 03:44:26,071][106225] Updated weights for policy 1, policy_version 1183213 (0.0010) [2023-12-28 03:44:26,125][106225] Updated weights for policy 1, policy_version 1183223 (0.0010) [2023-12-28 03:44:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 605151232. Throughput: 0: 10030.4, 1: 9714.2. Samples: 605123724. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:26,178][106225] Updated weights for policy 1, policy_version 1183233 (0.0010) [2023-12-28 03:44:26,178][105115] Avg episode reward: [(0, '-4.922'), (1, '-5.186')] [2023-12-28 03:44:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001180248_302202880.pth... [2023-12-28 03:44:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001179096_301907968.pth [2023-12-28 03:44:26,211][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001183240_302956544.pth... [2023-12-28 03:44:26,214][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001182088_302661632.pth [2023-12-28 03:44:26,315][106226] Updated weights for policy 0, policy_version 1180252 (0.0007) [2023-12-28 03:44:26,372][106226] Updated weights for policy 0, policy_version 1180262 (0.0005) [2023-12-28 03:44:26,420][106226] Updated weights for policy 0, policy_version 1180272 (0.0005) [2023-12-28 03:44:26,898][106225] Updated weights for policy 1, policy_version 1183243 (0.0010) [2023-12-28 03:44:26,951][106225] Updated weights for policy 1, policy_version 1183253 (0.0010) [2023-12-28 03:44:26,990][106226] Updated weights for policy 0, policy_version 1180282 (0.0005) [2023-12-28 03:44:27,001][106225] Updated weights for policy 1, policy_version 1183263 (0.0010) [2023-12-28 03:44:27,037][106226] Updated weights for policy 0, policy_version 1180292 (0.0006) [2023-12-28 03:44:27,091][106226] Updated weights for policy 0, policy_version 1180302 (0.0007) [2023-12-28 03:44:27,143][106226] Updated weights for policy 0, policy_version 1180312 (0.0008) [2023-12-28 03:44:27,679][106225] Updated weights for policy 1, policy_version 1183273 (0.0010) [2023-12-28 03:44:27,726][106225] Updated weights for policy 1, policy_version 1183283 (0.0009) [2023-12-28 03:44:27,779][106226] Updated weights for policy 0, policy_version 1180322 (0.0008) [2023-12-28 03:44:27,784][106225] Updated weights for policy 1, policy_version 1183293 (0.0005) [2023-12-28 03:44:27,832][106226] Updated weights for policy 0, policy_version 1180332 (0.0008) [2023-12-28 03:44:27,838][106225] Updated weights for policy 1, policy_version 1183303 (0.0005) [2023-12-28 03:44:27,884][106226] Updated weights for policy 0, policy_version 1180342 (0.0007) [2023-12-28 03:44:28,476][106225] Updated weights for policy 1, policy_version 1183313 (0.0006) [2023-12-28 03:44:28,528][106225] Updated weights for policy 1, policy_version 1183323 (0.0005) [2023-12-28 03:44:28,564][106226] Updated weights for policy 0, policy_version 1180352 (0.0008) [2023-12-28 03:44:28,574][106225] Updated weights for policy 1, policy_version 1183333 (0.0005) [2023-12-28 03:44:28,619][106226] Updated weights for policy 0, policy_version 1180362 (0.0008) [2023-12-28 03:44:28,677][106226] Updated weights for policy 0, policy_version 1180372 (0.0008) [2023-12-28 03:44:29,225][106225] Updated weights for policy 1, policy_version 1183343 (0.0008) [2023-12-28 03:44:29,290][106225] Updated weights for policy 1, policy_version 1183353 (0.0010) [2023-12-28 03:44:29,353][106225] Updated weights for policy 1, policy_version 1183363 (0.0010) [2023-12-28 03:44:29,375][106226] Updated weights for policy 0, policy_version 1180382 (0.0009) [2023-12-28 03:44:29,434][106226] Updated weights for policy 0, policy_version 1180392 (0.0009) [2023-12-28 03:44:29,485][106226] Updated weights for policy 0, policy_version 1180402 (0.0010) [2023-12-28 03:44:30,068][106225] Updated weights for policy 1, policy_version 1183373 (0.0007) [2023-12-28 03:44:30,129][106225] Updated weights for policy 1, policy_version 1183383 (0.0008) [2023-12-28 03:44:30,189][106225] Updated weights for policy 1, policy_version 1183393 (0.0008) [2023-12-28 03:44:30,202][106226] Updated weights for policy 0, policy_version 1180412 (0.0009) [2023-12-28 03:44:30,267][106226] Updated weights for policy 0, policy_version 1180422 (0.0008) [2023-12-28 03:44:30,331][106226] Updated weights for policy 0, policy_version 1180432 (0.0008) [2023-12-28 03:44:30,866][106225] Updated weights for policy 1, policy_version 1183403 (0.0006) [2023-12-28 03:44:30,921][106225] Updated weights for policy 1, policy_version 1183413 (0.0006) [2023-12-28 03:44:30,972][106225] Updated weights for policy 1, policy_version 1183423 (0.0005) [2023-12-28 03:44:31,018][106226] Updated weights for policy 0, policy_version 1180442 (0.0009) [2023-12-28 03:44:31,086][106226] Updated weights for policy 0, policy_version 1180452 (0.0008) [2023-12-28 03:44:31,142][106226] Updated weights for policy 0, policy_version 1180462 (0.0010) [2023-12-28 03:44:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 605257728. Throughput: 0: 10119.1, 1: 9777.3. Samples: 605249392. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:31,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.007')] [2023-12-28 03:44:31,210][106226] Updated weights for policy 0, policy_version 1180472 (0.0011) [2023-12-28 03:44:31,596][106225] Updated weights for policy 1, policy_version 1183433 (0.0009) [2023-12-28 03:44:31,660][106225] Updated weights for policy 1, policy_version 1183443 (0.0009) [2023-12-28 03:44:31,715][106225] Updated weights for policy 1, policy_version 1183453 (0.0008) [2023-12-28 03:44:31,776][106225] Updated weights for policy 1, policy_version 1183463 (0.0008) [2023-12-28 03:44:31,961][106226] Updated weights for policy 0, policy_version 1180482 (0.0011) [2023-12-28 03:44:32,026][106226] Updated weights for policy 0, policy_version 1180492 (0.0011) [2023-12-28 03:44:32,088][106226] Updated weights for policy 0, policy_version 1180502 (0.0011) [2023-12-28 03:44:32,538][106225] Updated weights for policy 1, policy_version 1183473 (0.0007) [2023-12-28 03:44:32,597][106225] Updated weights for policy 1, policy_version 1183483 (0.0010) [2023-12-28 03:44:32,642][106225] Updated weights for policy 1, policy_version 1183493 (0.0008) [2023-12-28 03:44:32,758][106226] Updated weights for policy 0, policy_version 1180512 (0.0009) [2023-12-28 03:44:32,809][106226] Updated weights for policy 0, policy_version 1180522 (0.0006) [2023-12-28 03:44:32,861][106226] Updated weights for policy 0, policy_version 1180532 (0.0006) [2023-12-28 03:44:33,267][106225] Updated weights for policy 1, policy_version 1183503 (0.0007) [2023-12-28 03:44:33,315][106225] Updated weights for policy 1, policy_version 1183513 (0.0005) [2023-12-28 03:44:33,370][106225] Updated weights for policy 1, policy_version 1183523 (0.0005) [2023-12-28 03:44:33,515][106226] Updated weights for policy 0, policy_version 1180542 (0.0007) [2023-12-28 03:44:33,573][106226] Updated weights for policy 0, policy_version 1180552 (0.0008) [2023-12-28 03:44:33,630][106226] Updated weights for policy 0, policy_version 1180562 (0.0007) [2023-12-28 03:44:33,967][106225] Updated weights for policy 1, policy_version 1183533 (0.0005) [2023-12-28 03:44:34,021][106225] Updated weights for policy 1, policy_version 1183543 (0.0006) [2023-12-28 03:44:34,076][106225] Updated weights for policy 1, policy_version 1183553 (0.0008) [2023-12-28 03:44:34,322][106226] Updated weights for policy 0, policy_version 1180572 (0.0007) [2023-12-28 03:44:34,389][106226] Updated weights for policy 0, policy_version 1180582 (0.0008) [2023-12-28 03:44:34,457][106226] Updated weights for policy 0, policy_version 1180592 (0.0008) [2023-12-28 03:44:34,810][106225] Updated weights for policy 1, policy_version 1183563 (0.0007) [2023-12-28 03:44:34,865][106225] Updated weights for policy 1, policy_version 1183573 (0.0008) [2023-12-28 03:44:34,909][106225] Updated weights for policy 1, policy_version 1183583 (0.0009) [2023-12-28 03:44:35,141][106226] Updated weights for policy 0, policy_version 1180602 (0.0007) [2023-12-28 03:44:35,198][106226] Updated weights for policy 0, policy_version 1180612 (0.0005) [2023-12-28 03:44:35,251][106226] Updated weights for policy 0, policy_version 1180622 (0.0005) [2023-12-28 03:44:35,296][106226] Updated weights for policy 0, policy_version 1180632 (0.0005) [2023-12-28 03:44:35,612][106225] Updated weights for policy 1, policy_version 1183593 (0.0008) [2023-12-28 03:44:35,665][106225] Updated weights for policy 1, policy_version 1183603 (0.0010) [2023-12-28 03:44:35,725][106225] Updated weights for policy 1, policy_version 1183613 (0.0010) [2023-12-28 03:44:35,779][106225] Updated weights for policy 1, policy_version 1183623 (0.0010) [2023-12-28 03:44:35,946][106226] Updated weights for policy 0, policy_version 1180642 (0.0007) [2023-12-28 03:44:36,004][106226] Updated weights for policy 0, policy_version 1180652 (0.0009) [2023-12-28 03:44:36,054][106226] Updated weights for policy 0, policy_version 1180662 (0.0008) [2023-12-28 03:44:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 605364224. Throughput: 0: 10099.5, 1: 9871.6. Samples: 605370936. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:36,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.191')] [2023-12-28 03:44:36,415][106225] Updated weights for policy 1, policy_version 1183633 (0.0009) [2023-12-28 03:44:36,469][106225] Updated weights for policy 1, policy_version 1183643 (0.0008) [2023-12-28 03:44:36,519][106225] Updated weights for policy 1, policy_version 1183653 (0.0009) [2023-12-28 03:44:36,762][106226] Updated weights for policy 0, policy_version 1180672 (0.0008) [2023-12-28 03:44:36,827][106226] Updated weights for policy 0, policy_version 1180682 (0.0009) [2023-12-28 03:44:36,872][106226] Updated weights for policy 0, policy_version 1180692 (0.0008) [2023-12-28 03:44:37,177][106225] Updated weights for policy 1, policy_version 1183663 (0.0007) [2023-12-28 03:44:37,232][106225] Updated weights for policy 1, policy_version 1183673 (0.0008) [2023-12-28 03:44:37,280][106225] Updated weights for policy 1, policy_version 1183683 (0.0008) [2023-12-28 03:44:37,631][106226] Updated weights for policy 0, policy_version 1180702 (0.0009) [2023-12-28 03:44:37,692][106226] Updated weights for policy 0, policy_version 1180712 (0.0009) [2023-12-28 03:44:37,746][106226] Updated weights for policy 0, policy_version 1180722 (0.0009) [2023-12-28 03:44:38,036][106225] Updated weights for policy 1, policy_version 1183693 (0.0008) [2023-12-28 03:44:38,088][106225] Updated weights for policy 1, policy_version 1183703 (0.0009) [2023-12-28 03:44:38,139][106225] Updated weights for policy 1, policy_version 1183713 (0.0008) [2023-12-28 03:44:38,509][106226] Updated weights for policy 0, policy_version 1180732 (0.0008) [2023-12-28 03:44:38,565][106226] Updated weights for policy 0, policy_version 1180742 (0.0009) [2023-12-28 03:44:38,627][106226] Updated weights for policy 0, policy_version 1180752 (0.0009) [2023-12-28 03:44:38,892][106225] Updated weights for policy 1, policy_version 1183723 (0.0009) [2023-12-28 03:44:38,942][106225] Updated weights for policy 1, policy_version 1183733 (0.0007) [2023-12-28 03:44:38,993][106225] Updated weights for policy 1, policy_version 1183743 (0.0008) [2023-12-28 03:44:39,313][106226] Updated weights for policy 0, policy_version 1180762 (0.0006) [2023-12-28 03:44:39,381][106226] Updated weights for policy 0, policy_version 1180772 (0.0009) [2023-12-28 03:44:39,454][106226] Updated weights for policy 0, policy_version 1180782 (0.0011) [2023-12-28 03:44:39,523][106226] Updated weights for policy 0, policy_version 1180792 (0.0011) [2023-12-28 03:44:39,770][106225] Updated weights for policy 1, policy_version 1183753 (0.0009) [2023-12-28 03:44:39,839][106225] Updated weights for policy 1, policy_version 1183763 (0.0011) [2023-12-28 03:44:39,904][106225] Updated weights for policy 1, policy_version 1183773 (0.0008) [2023-12-28 03:44:39,966][106225] Updated weights for policy 1, policy_version 1183783 (0.0008) [2023-12-28 03:44:40,271][106226] Updated weights for policy 0, policy_version 1180802 (0.0011) [2023-12-28 03:44:40,319][106226] Updated weights for policy 0, policy_version 1180812 (0.0010) [2023-12-28 03:44:40,370][106226] Updated weights for policy 0, policy_version 1180822 (0.0011) [2023-12-28 03:44:40,706][106225] Updated weights for policy 1, policy_version 1183793 (0.0007) [2023-12-28 03:44:40,763][106225] Updated weights for policy 1, policy_version 1183803 (0.0005) [2023-12-28 03:44:40,822][106225] Updated weights for policy 1, policy_version 1183813 (0.0006) [2023-12-28 03:44:41,028][106226] Updated weights for policy 0, policy_version 1180832 (0.0011) [2023-12-28 03:44:41,094][106226] Updated weights for policy 0, policy_version 1180842 (0.0009) [2023-12-28 03:44:41,161][106226] Updated weights for policy 0, policy_version 1180852 (0.0011) [2023-12-28 03:44:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 605454336. Throughput: 0: 10094.3, 1: 9919.8. Samples: 605429776. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:41,176][105115] Avg episode reward: [(0, '-4.975'), (1, '-4.780')] [2023-12-28 03:44:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001183816_303104000.pth... [2023-12-28 03:44:41,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001180856_302358528.pth... [2023-12-28 03:44:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001182664_302809088.pth [2023-12-28 03:44:41,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001179672_302055424.pth [2023-12-28 03:44:41,474][106225] Updated weights for policy 1, policy_version 1183823 (0.0006) [2023-12-28 03:44:41,532][106225] Updated weights for policy 1, policy_version 1183833 (0.0009) [2023-12-28 03:44:41,593][106225] Updated weights for policy 1, policy_version 1183843 (0.0008) [2023-12-28 03:44:41,955][106226] Updated weights for policy 0, policy_version 1180862 (0.0007) [2023-12-28 03:44:42,020][106226] Updated weights for policy 0, policy_version 1180872 (0.0005) [2023-12-28 03:44:42,086][106226] Updated weights for policy 0, policy_version 1180882 (0.0007) [2023-12-28 03:44:42,389][106225] Updated weights for policy 1, policy_version 1183853 (0.0008) [2023-12-28 03:44:42,453][106225] Updated weights for policy 1, policy_version 1183863 (0.0008) [2023-12-28 03:44:42,516][106225] Updated weights for policy 1, policy_version 1183873 (0.0009) [2023-12-28 03:44:42,691][106226] Updated weights for policy 0, policy_version 1180892 (0.0006) [2023-12-28 03:44:42,750][106226] Updated weights for policy 0, policy_version 1180902 (0.0006) [2023-12-28 03:44:42,810][106226] Updated weights for policy 0, policy_version 1180912 (0.0008) [2023-12-28 03:44:43,196][106225] Updated weights for policy 1, policy_version 1183883 (0.0010) [2023-12-28 03:44:43,246][106225] Updated weights for policy 1, policy_version 1183893 (0.0008) [2023-12-28 03:44:43,301][106225] Updated weights for policy 1, policy_version 1183903 (0.0008) [2023-12-28 03:44:43,544][106226] Updated weights for policy 0, policy_version 1180922 (0.0008) [2023-12-28 03:44:43,595][106226] Updated weights for policy 0, policy_version 1180932 (0.0009) [2023-12-28 03:44:43,642][106226] Updated weights for policy 0, policy_version 1180942 (0.0009) [2023-12-28 03:44:43,688][106226] Updated weights for policy 0, policy_version 1180952 (0.0008) [2023-12-28 03:44:44,003][106225] Updated weights for policy 1, policy_version 1183913 (0.0008) [2023-12-28 03:44:44,050][106225] Updated weights for policy 1, policy_version 1183923 (0.0008) [2023-12-28 03:44:44,106][106225] Updated weights for policy 1, policy_version 1183933 (0.0008) [2023-12-28 03:44:44,164][106225] Updated weights for policy 1, policy_version 1183943 (0.0008) [2023-12-28 03:44:44,443][106226] Updated weights for policy 0, policy_version 1180962 (0.0010) [2023-12-28 03:44:44,500][106226] Updated weights for policy 0, policy_version 1180972 (0.0010) [2023-12-28 03:44:44,557][106226] Updated weights for policy 0, policy_version 1180982 (0.0010) [2023-12-28 03:44:44,808][106225] Updated weights for policy 1, policy_version 1183953 (0.0009) [2023-12-28 03:44:44,856][106225] Updated weights for policy 1, policy_version 1183963 (0.0008) [2023-12-28 03:44:44,910][106225] Updated weights for policy 1, policy_version 1183973 (0.0005) [2023-12-28 03:44:45,276][106226] Updated weights for policy 0, policy_version 1180992 (0.0011) [2023-12-28 03:44:45,342][106226] Updated weights for policy 0, policy_version 1181002 (0.0011) [2023-12-28 03:44:45,400][106226] Updated weights for policy 0, policy_version 1181012 (0.0011) [2023-12-28 03:44:45,624][106225] Updated weights for policy 1, policy_version 1183983 (0.0007) [2023-12-28 03:44:45,681][106225] Updated weights for policy 1, policy_version 1183993 (0.0008) [2023-12-28 03:44:45,741][106225] Updated weights for policy 1, policy_version 1184003 (0.0008) [2023-12-28 03:44:46,136][106226] Updated weights for policy 0, policy_version 1181022 (0.0010) [2023-12-28 03:44:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 605552640. Throughput: 0: 9993.0, 1: 9833.8. Samples: 605546868. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:46,175][105115] Avg episode reward: [(0, '-4.998'), (1, '-4.941')] [2023-12-28 03:44:46,193][106226] Updated weights for policy 0, policy_version 1181032 (0.0008) [2023-12-28 03:44:46,245][106226] Updated weights for policy 0, policy_version 1181042 (0.0008) [2023-12-28 03:44:46,406][106225] Updated weights for policy 1, policy_version 1184013 (0.0009) [2023-12-28 03:44:46,453][106225] Updated weights for policy 1, policy_version 1184023 (0.0010) [2023-12-28 03:44:46,500][106225] Updated weights for policy 1, policy_version 1184033 (0.0010) [2023-12-28 03:44:46,911][106226] Updated weights for policy 0, policy_version 1181052 (0.0006) [2023-12-28 03:44:46,964][106226] Updated weights for policy 0, policy_version 1181062 (0.0005) [2023-12-28 03:44:47,019][106226] Updated weights for policy 0, policy_version 1181072 (0.0007) [2023-12-28 03:44:47,147][106225] Updated weights for policy 1, policy_version 1184043 (0.0009) [2023-12-28 03:44:47,208][106225] Updated weights for policy 1, policy_version 1184053 (0.0009) [2023-12-28 03:44:47,269][106225] Updated weights for policy 1, policy_version 1184063 (0.0010) [2023-12-28 03:44:47,744][106226] Updated weights for policy 0, policy_version 1181082 (0.0008) [2023-12-28 03:44:47,793][106226] Updated weights for policy 0, policy_version 1181092 (0.0008) [2023-12-28 03:44:47,840][106226] Updated weights for policy 0, policy_version 1181102 (0.0007) [2023-12-28 03:44:47,886][106226] Updated weights for policy 0, policy_version 1181112 (0.0008) [2023-12-28 03:44:47,955][106225] Updated weights for policy 1, policy_version 1184073 (0.0010) [2023-12-28 03:44:48,018][106225] Updated weights for policy 1, policy_version 1184083 (0.0010) [2023-12-28 03:44:48,078][106225] Updated weights for policy 1, policy_version 1184093 (0.0010) [2023-12-28 03:44:48,137][106225] Updated weights for policy 1, policy_version 1184103 (0.0010) [2023-12-28 03:44:48,667][106226] Updated weights for policy 0, policy_version 1181122 (0.0008) [2023-12-28 03:44:48,728][106226] Updated weights for policy 0, policy_version 1181132 (0.0006) [2023-12-28 03:44:48,796][106226] Updated weights for policy 0, policy_version 1181142 (0.0008) [2023-12-28 03:44:48,835][106225] Updated weights for policy 1, policy_version 1184113 (0.0010) [2023-12-28 03:44:48,889][106225] Updated weights for policy 1, policy_version 1184123 (0.0009) [2023-12-28 03:44:48,942][106225] Updated weights for policy 1, policy_version 1184133 (0.0008) [2023-12-28 03:44:49,502][106226] Updated weights for policy 0, policy_version 1181152 (0.0009) [2023-12-28 03:44:49,560][106226] Updated weights for policy 0, policy_version 1181162 (0.0008) [2023-12-28 03:44:49,612][106226] Updated weights for policy 0, policy_version 1181172 (0.0008) [2023-12-28 03:44:49,767][106225] Updated weights for policy 1, policy_version 1184143 (0.0007) [2023-12-28 03:44:49,838][106225] Updated weights for policy 1, policy_version 1184153 (0.0008) [2023-12-28 03:44:49,902][106225] Updated weights for policy 1, policy_version 1184163 (0.0008) [2023-12-28 03:44:50,302][106226] Updated weights for policy 0, policy_version 1181182 (0.0009) [2023-12-28 03:44:50,358][106226] Updated weights for policy 0, policy_version 1181192 (0.0007) [2023-12-28 03:44:50,421][106226] Updated weights for policy 0, policy_version 1181202 (0.0007) [2023-12-28 03:44:50,641][106225] Updated weights for policy 1, policy_version 1184173 (0.0008) [2023-12-28 03:44:50,695][106225] Updated weights for policy 1, policy_version 1184183 (0.0008) [2023-12-28 03:44:50,754][106225] Updated weights for policy 1, policy_version 1184193 (0.0008) [2023-12-28 03:44:51,160][106226] Updated weights for policy 0, policy_version 1181212 (0.0009) [2023-12-28 03:44:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 605650944. Throughput: 0: 9934.0, 1: 9819.9. Samples: 605663580. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:51,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.806')] [2023-12-28 03:44:51,218][106226] Updated weights for policy 0, policy_version 1181222 (0.0011) [2023-12-28 03:44:51,286][106226] Updated weights for policy 0, policy_version 1181232 (0.0011) [2023-12-28 03:44:51,498][106225] Updated weights for policy 1, policy_version 1184203 (0.0008) [2023-12-28 03:44:51,559][106225] Updated weights for policy 1, policy_version 1184213 (0.0008) [2023-12-28 03:44:51,624][106225] Updated weights for policy 1, policy_version 1184223 (0.0008) [2023-12-28 03:44:51,976][106226] Updated weights for policy 0, policy_version 1181242 (0.0011) [2023-12-28 03:44:52,037][106226] Updated weights for policy 0, policy_version 1181252 (0.0007) [2023-12-28 03:44:52,089][106226] Updated weights for policy 0, policy_version 1181262 (0.0007) [2023-12-28 03:44:52,176][106226] Updated weights for policy 0, policy_version 1181272 (0.0007) [2023-12-28 03:44:52,377][106225] Updated weights for policy 1, policy_version 1184233 (0.0008) [2023-12-28 03:44:52,435][106225] Updated weights for policy 1, policy_version 1184243 (0.0010) [2023-12-28 03:44:52,493][106225] Updated weights for policy 1, policy_version 1184253 (0.0008) [2023-12-28 03:44:52,555][106225] Updated weights for policy 1, policy_version 1184263 (0.0008) [2023-12-28 03:44:52,811][106226] Updated weights for policy 0, policy_version 1181282 (0.0005) [2023-12-28 03:44:52,867][106226] Updated weights for policy 0, policy_version 1181292 (0.0008) [2023-12-28 03:44:52,923][106226] Updated weights for policy 0, policy_version 1181302 (0.0008) [2023-12-28 03:44:53,287][106225] Updated weights for policy 1, policy_version 1184273 (0.0008) [2023-12-28 03:44:53,345][106225] Updated weights for policy 1, policy_version 1184283 (0.0008) [2023-12-28 03:44:53,408][106225] Updated weights for policy 1, policy_version 1184293 (0.0006) [2023-12-28 03:44:53,600][106226] Updated weights for policy 0, policy_version 1181312 (0.0007) [2023-12-28 03:44:53,659][106226] Updated weights for policy 0, policy_version 1181322 (0.0007) [2023-12-28 03:44:53,712][106226] Updated weights for policy 0, policy_version 1181332 (0.0005) [2023-12-28 03:44:54,065][106225] Updated weights for policy 1, policy_version 1184303 (0.0005) [2023-12-28 03:44:54,133][106225] Updated weights for policy 1, policy_version 1184313 (0.0005) [2023-12-28 03:44:54,196][106225] Updated weights for policy 1, policy_version 1184323 (0.0008) [2023-12-28 03:44:54,323][106226] Updated weights for policy 0, policy_version 1181342 (0.0008) [2023-12-28 03:44:54,387][106226] Updated weights for policy 0, policy_version 1181352 (0.0007) [2023-12-28 03:44:54,455][106226] Updated weights for policy 0, policy_version 1181362 (0.0006) [2023-12-28 03:44:54,764][106225] Updated weights for policy 1, policy_version 1184333 (0.0007) [2023-12-28 03:44:54,823][106225] Updated weights for policy 1, policy_version 1184343 (0.0009) [2023-12-28 03:44:54,880][106225] Updated weights for policy 1, policy_version 1184353 (0.0008) [2023-12-28 03:44:55,091][106226] Updated weights for policy 0, policy_version 1181372 (0.0007) [2023-12-28 03:44:55,144][106226] Updated weights for policy 0, policy_version 1181382 (0.0009) [2023-12-28 03:44:55,195][106226] Updated weights for policy 0, policy_version 1181392 (0.0008) [2023-12-28 03:44:55,679][106225] Updated weights for policy 1, policy_version 1184363 (0.0009) [2023-12-28 03:44:55,733][106225] Updated weights for policy 1, policy_version 1184373 (0.0008) [2023-12-28 03:44:55,752][106226] Updated weights for policy 0, policy_version 1181402 (0.0005) [2023-12-28 03:44:55,788][106225] Updated weights for policy 1, policy_version 1184383 (0.0008) [2023-12-28 03:44:55,810][106226] Updated weights for policy 0, policy_version 1181412 (0.0006) [2023-12-28 03:44:55,858][106226] Updated weights for policy 0, policy_version 1181422 (0.0005) [2023-12-28 03:44:55,913][106226] Updated weights for policy 0, policy_version 1181432 (0.0005) [2023-12-28 03:44:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 605757440. Throughput: 0: 9978.7, 1: 9824.7. Samples: 605723220. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:44:56,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.963')] [2023-12-28 03:44:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001181432_302505984.pth... [2023-12-28 03:44:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001184392_303251456.pth... [2023-12-28 03:44:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001180248_302202880.pth [2023-12-28 03:44:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001183240_302956544.pth [2023-12-28 03:44:56,480][106225] Updated weights for policy 1, policy_version 1184393 (0.0007) [2023-12-28 03:44:56,536][106225] Updated weights for policy 1, policy_version 1184403 (0.0009) [2023-12-28 03:44:56,547][106226] Updated weights for policy 0, policy_version 1181442 (0.0005) [2023-12-28 03:44:56,586][106225] Updated weights for policy 1, policy_version 1184413 (0.0008) [2023-12-28 03:44:56,597][106226] Updated weights for policy 0, policy_version 1181452 (0.0005) [2023-12-28 03:44:56,640][106225] Updated weights for policy 1, policy_version 1184423 (0.0008) [2023-12-28 03:44:56,646][106226] Updated weights for policy 0, policy_version 1181462 (0.0006) [2023-12-28 03:44:57,338][106226] Updated weights for policy 0, policy_version 1181472 (0.0008) [2023-12-28 03:44:57,386][106226] Updated weights for policy 0, policy_version 1181482 (0.0007) [2023-12-28 03:44:57,388][106225] Updated weights for policy 1, policy_version 1184433 (0.0006) [2023-12-28 03:44:57,437][106226] Updated weights for policy 0, policy_version 1181492 (0.0006) [2023-12-28 03:44:57,438][106225] Updated weights for policy 1, policy_version 1184443 (0.0006) [2023-12-28 03:44:57,487][106225] Updated weights for policy 1, policy_version 1184453 (0.0007) [2023-12-28 03:44:58,151][106226] Updated weights for policy 0, policy_version 1181502 (0.0009) [2023-12-28 03:44:58,203][106226] Updated weights for policy 0, policy_version 1181512 (0.0006) [2023-12-28 03:44:58,230][106225] Updated weights for policy 1, policy_version 1184463 (0.0008) [2023-12-28 03:44:58,265][106226] Updated weights for policy 0, policy_version 1181522 (0.0008) [2023-12-28 03:44:58,291][106225] Updated weights for policy 1, policy_version 1184473 (0.0007) [2023-12-28 03:44:58,356][106225] Updated weights for policy 1, policy_version 1184483 (0.0009) [2023-12-28 03:44:59,089][106226] Updated weights for policy 0, policy_version 1181532 (0.0008) [2023-12-28 03:44:59,160][106226] Updated weights for policy 0, policy_version 1181542 (0.0008) [2023-12-28 03:44:59,190][106225] Updated weights for policy 1, policy_version 1184493 (0.0008) [2023-12-28 03:44:59,237][106226] Updated weights for policy 0, policy_version 1181552 (0.0008) [2023-12-28 03:44:59,257][106225] Updated weights for policy 1, policy_version 1184503 (0.0008) [2023-12-28 03:44:59,327][106225] Updated weights for policy 1, policy_version 1184513 (0.0009) [2023-12-28 03:44:59,831][106226] Updated weights for policy 0, policy_version 1181562 (0.0007) [2023-12-28 03:44:59,895][106226] Updated weights for policy 0, policy_version 1181572 (0.0007) [2023-12-28 03:44:59,958][106226] Updated weights for policy 0, policy_version 1181582 (0.0008) [2023-12-28 03:45:00,015][106226] Updated weights for policy 0, policy_version 1181592 (0.0008) [2023-12-28 03:45:00,117][106225] Updated weights for policy 1, policy_version 1184523 (0.0008) [2023-12-28 03:45:00,164][106225] Updated weights for policy 1, policy_version 1184533 (0.0008) [2023-12-28 03:45:00,217][106225] Updated weights for policy 1, policy_version 1184543 (0.0008) [2023-12-28 03:45:00,740][106226] Updated weights for policy 0, policy_version 1181602 (0.0008) [2023-12-28 03:45:00,798][106226] Updated weights for policy 0, policy_version 1181612 (0.0007) [2023-12-28 03:45:00,856][106226] Updated weights for policy 0, policy_version 1181622 (0.0005) [2023-12-28 03:45:00,897][106225] Updated weights for policy 1, policy_version 1184553 (0.0009) [2023-12-28 03:45:00,966][106225] Updated weights for policy 1, policy_version 1184563 (0.0009) [2023-12-28 03:45:01,036][106225] Updated weights for policy 1, policy_version 1184573 (0.0008) [2023-12-28 03:45:01,112][106225] Updated weights for policy 1, policy_version 1184583 (0.0009) [2023-12-28 03:45:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 605855744. Throughput: 0: 10039.3, 1: 9807.8. Samples: 605841596. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:45:01,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-5.028')] [2023-12-28 03:45:01,655][106226] Updated weights for policy 0, policy_version 1181632 (0.0008) [2023-12-28 03:45:01,721][106226] Updated weights for policy 0, policy_version 1181642 (0.0008) [2023-12-28 03:45:01,786][106226] Updated weights for policy 0, policy_version 1181652 (0.0007) [2023-12-28 03:45:01,928][106225] Updated weights for policy 1, policy_version 1184593 (0.0009) [2023-12-28 03:45:01,992][106225] Updated weights for policy 1, policy_version 1184603 (0.0008) [2023-12-28 03:45:02,050][106225] Updated weights for policy 1, policy_version 1184613 (0.0009) [2023-12-28 03:45:02,434][106226] Updated weights for policy 0, policy_version 1181662 (0.0007) [2023-12-28 03:45:02,481][106226] Updated weights for policy 0, policy_version 1181672 (0.0008) [2023-12-28 03:45:02,544][106226] Updated weights for policy 0, policy_version 1181682 (0.0008) [2023-12-28 03:45:02,743][106225] Updated weights for policy 1, policy_version 1184623 (0.0008) [2023-12-28 03:45:02,808][106225] Updated weights for policy 1, policy_version 1184633 (0.0006) [2023-12-28 03:45:02,869][106225] Updated weights for policy 1, policy_version 1184643 (0.0008) [2023-12-28 03:45:03,279][106226] Updated weights for policy 0, policy_version 1181692 (0.0009) [2023-12-28 03:45:03,328][106226] Updated weights for policy 0, policy_version 1181702 (0.0005) [2023-12-28 03:45:03,372][106226] Updated weights for policy 0, policy_version 1181712 (0.0005) [2023-12-28 03:45:03,418][106225] Updated weights for policy 1, policy_version 1184653 (0.0007) [2023-12-28 03:45:03,468][106225] Updated weights for policy 1, policy_version 1184663 (0.0008) [2023-12-28 03:45:03,514][106225] Updated weights for policy 1, policy_version 1184673 (0.0007) [2023-12-28 03:45:04,034][106226] Updated weights for policy 0, policy_version 1181722 (0.0006) [2023-12-28 03:45:04,089][106226] Updated weights for policy 0, policy_version 1181732 (0.0008) [2023-12-28 03:45:04,147][106226] Updated weights for policy 0, policy_version 1181742 (0.0008) [2023-12-28 03:45:04,199][106226] Updated weights for policy 0, policy_version 1181752 (0.0008) [2023-12-28 03:45:04,210][106225] Updated weights for policy 1, policy_version 1184683 (0.0007) [2023-12-28 03:45:04,269][106225] Updated weights for policy 1, policy_version 1184693 (0.0011) [2023-12-28 03:45:04,320][106225] Updated weights for policy 1, policy_version 1184703 (0.0010) [2023-12-28 03:45:04,924][106226] Updated weights for policy 0, policy_version 1181762 (0.0005) [2023-12-28 03:45:04,940][106225] Updated weights for policy 1, policy_version 1184713 (0.0010) [2023-12-28 03:45:04,984][106226] Updated weights for policy 0, policy_version 1181772 (0.0005) [2023-12-28 03:45:05,003][106225] Updated weights for policy 1, policy_version 1184723 (0.0006) [2023-12-28 03:45:05,039][106226] Updated weights for policy 0, policy_version 1181782 (0.0005) [2023-12-28 03:45:05,057][106225] Updated weights for policy 1, policy_version 1184733 (0.0006) [2023-12-28 03:45:05,108][106225] Updated weights for policy 1, policy_version 1184743 (0.0008) [2023-12-28 03:45:05,601][106226] Updated weights for policy 0, policy_version 1181792 (0.0007) [2023-12-28 03:45:05,665][106226] Updated weights for policy 0, policy_version 1181802 (0.0008) [2023-12-28 03:45:05,725][106226] Updated weights for policy 0, policy_version 1181812 (0.0008) [2023-12-28 03:45:05,866][106225] Updated weights for policy 1, policy_version 1184753 (0.0008) [2023-12-28 03:45:05,912][106225] Updated weights for policy 1, policy_version 1184763 (0.0009) [2023-12-28 03:45:05,966][106225] Updated weights for policy 1, policy_version 1184773 (0.0010) [2023-12-28 03:45:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 605954048. Throughput: 0: 9975.2, 1: 9940.6. Samples: 605962372. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:45:06,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.885')] [2023-12-28 03:45:06,451][106226] Updated weights for policy 0, policy_version 1181822 (0.0008) [2023-12-28 03:45:06,516][106226] Updated weights for policy 0, policy_version 1181832 (0.0008) [2023-12-28 03:45:06,571][106226] Updated weights for policy 0, policy_version 1181842 (0.0008) [2023-12-28 03:45:06,729][106225] Updated weights for policy 1, policy_version 1184783 (0.0010) [2023-12-28 03:45:06,792][106225] Updated weights for policy 1, policy_version 1184793 (0.0010) [2023-12-28 03:45:06,848][106225] Updated weights for policy 1, policy_version 1184803 (0.0010) [2023-12-28 03:45:07,342][106226] Updated weights for policy 0, policy_version 1181852 (0.0007) [2023-12-28 03:45:07,399][106226] Updated weights for policy 0, policy_version 1181862 (0.0006) [2023-12-28 03:45:07,465][106226] Updated weights for policy 0, policy_version 1181872 (0.0008) [2023-12-28 03:45:07,485][106225] Updated weights for policy 1, policy_version 1184813 (0.0008) [2023-12-28 03:45:07,548][106225] Updated weights for policy 1, policy_version 1184823 (0.0005) [2023-12-28 03:45:07,601][106225] Updated weights for policy 1, policy_version 1184833 (0.0010) [2023-12-28 03:45:08,090][106226] Updated weights for policy 0, policy_version 1181882 (0.0008) [2023-12-28 03:45:08,148][106226] Updated weights for policy 0, policy_version 1181892 (0.0008) [2023-12-28 03:45:08,199][106226] Updated weights for policy 0, policy_version 1181902 (0.0008) [2023-12-28 03:45:08,266][106226] Updated weights for policy 0, policy_version 1181912 (0.0009) [2023-12-28 03:45:08,312][106225] Updated weights for policy 1, policy_version 1184843 (0.0010) [2023-12-28 03:45:08,384][106225] Updated weights for policy 1, policy_version 1184853 (0.0010) [2023-12-28 03:45:08,448][106225] Updated weights for policy 1, policy_version 1184863 (0.0010) [2023-12-28 03:45:09,005][106226] Updated weights for policy 0, policy_version 1181922 (0.0008) [2023-12-28 03:45:09,064][106226] Updated weights for policy 0, policy_version 1181932 (0.0008) [2023-12-28 03:45:09,096][106225] Updated weights for policy 1, policy_version 1184873 (0.0010) [2023-12-28 03:45:09,114][106226] Updated weights for policy 0, policy_version 1181942 (0.0008) [2023-12-28 03:45:09,156][106225] Updated weights for policy 1, policy_version 1184883 (0.0010) [2023-12-28 03:45:09,223][106225] Updated weights for policy 1, policy_version 1184893 (0.0010) [2023-12-28 03:45:09,289][106225] Updated weights for policy 1, policy_version 1184903 (0.0011) [2023-12-28 03:45:09,922][106226] Updated weights for policy 0, policy_version 1181952 (0.0008) [2023-12-28 03:45:09,966][106225] Updated weights for policy 1, policy_version 1184913 (0.0014) [2023-12-28 03:45:09,991][106226] Updated weights for policy 0, policy_version 1181962 (0.0008) [2023-12-28 03:45:10,020][106225] Updated weights for policy 1, policy_version 1184923 (0.0010) [2023-12-28 03:45:10,057][106226] Updated weights for policy 0, policy_version 1181972 (0.0007) [2023-12-28 03:45:10,082][106225] Updated weights for policy 1, policy_version 1184933 (0.0010) [2023-12-28 03:45:10,831][106226] Updated weights for policy 0, policy_version 1181982 (0.0009) [2023-12-28 03:45:10,836][106225] Updated weights for policy 1, policy_version 1184943 (0.0010) [2023-12-28 03:45:10,876][106226] Updated weights for policy 0, policy_version 1181992 (0.0005) [2023-12-28 03:45:10,892][106225] Updated weights for policy 1, policy_version 1184953 (0.0007) [2023-12-28 03:45:10,932][106226] Updated weights for policy 0, policy_version 1182002 (0.0008) [2023-12-28 03:45:10,947][106225] Updated weights for policy 1, policy_version 1184963 (0.0007) [2023-12-28 03:45:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 606052352. Throughput: 0: 9971.9, 1: 9954.7. Samples: 606020420. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 03:45:11,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-4.772')] [2023-12-28 03:45:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001184968_303398912.pth... [2023-12-28 03:45:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001182008_302653440.pth... [2023-12-28 03:45:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001183816_303104000.pth [2023-12-28 03:45:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001180856_302358528.pth [2023-12-28 03:45:11,708][106225] Updated weights for policy 1, policy_version 1184973 (0.0008) [2023-12-28 03:45:11,742][106226] Updated weights for policy 0, policy_version 1182012 (0.0008) [2023-12-28 03:45:11,777][106225] Updated weights for policy 1, policy_version 1184983 (0.0008) [2023-12-28 03:45:11,811][106226] Updated weights for policy 0, policy_version 1182022 (0.0009) [2023-12-28 03:45:11,840][106225] Updated weights for policy 1, policy_version 1184993 (0.0007) [2023-12-28 03:45:11,874][106226] Updated weights for policy 0, policy_version 1182032 (0.0006) [2023-12-28 03:45:12,574][106225] Updated weights for policy 1, policy_version 1185003 (0.0007) [2023-12-28 03:45:12,633][106225] Updated weights for policy 1, policy_version 1185013 (0.0008) [2023-12-28 03:45:12,653][106226] Updated weights for policy 0, policy_version 1182042 (0.0008) [2023-12-28 03:45:12,694][106225] Updated weights for policy 1, policy_version 1185023 (0.0007) [2023-12-28 03:45:12,712][106226] Updated weights for policy 0, policy_version 1182052 (0.0006) [2023-12-28 03:45:12,777][106226] Updated weights for policy 0, policy_version 1182062 (0.0011) [2023-12-28 03:45:12,837][106226] Updated weights for policy 0, policy_version 1182072 (0.0010) [2023-12-28 03:45:13,403][106225] Updated weights for policy 1, policy_version 1185033 (0.0006) [2023-12-28 03:45:13,459][106225] Updated weights for policy 1, policy_version 1185043 (0.0008) [2023-12-28 03:45:13,516][106225] Updated weights for policy 1, policy_version 1185053 (0.0007) [2023-12-28 03:45:13,542][106226] Updated weights for policy 0, policy_version 1182082 (0.0007) [2023-12-28 03:45:13,577][106225] Updated weights for policy 1, policy_version 1185063 (0.0007) [2023-12-28 03:45:13,591][106226] Updated weights for policy 0, policy_version 1182092 (0.0008) [2023-12-28 03:45:13,642][106226] Updated weights for policy 0, policy_version 1182102 (0.0008) [2023-12-28 03:45:14,300][106225] Updated weights for policy 1, policy_version 1185073 (0.0009) [2023-12-28 03:45:14,345][106225] Updated weights for policy 1, policy_version 1185083 (0.0007) [2023-12-28 03:45:14,349][106226] Updated weights for policy 0, policy_version 1182112 (0.0008) [2023-12-28 03:45:14,394][106225] Updated weights for policy 1, policy_version 1185093 (0.0008) [2023-12-28 03:45:14,400][106226] Updated weights for policy 0, policy_version 1182122 (0.0005) [2023-12-28 03:45:14,461][106226] Updated weights for policy 0, policy_version 1182132 (0.0005) [2023-12-28 03:45:15,072][106226] Updated weights for policy 0, policy_version 1182142 (0.0007) [2023-12-28 03:45:15,131][106226] Updated weights for policy 0, policy_version 1182152 (0.0008) [2023-12-28 03:45:15,193][106226] Updated weights for policy 0, policy_version 1182162 (0.0009) [2023-12-28 03:45:15,206][106225] Updated weights for policy 1, policy_version 1185103 (0.0006) [2023-12-28 03:45:15,258][106225] Updated weights for policy 1, policy_version 1185113 (0.0008) [2023-12-28 03:45:15,318][106225] Updated weights for policy 1, policy_version 1185123 (0.0009) [2023-12-28 03:45:15,955][106226] Updated weights for policy 0, policy_version 1182172 (0.0009) [2023-12-28 03:45:15,980][106225] Updated weights for policy 1, policy_version 1185133 (0.0008) [2023-12-28 03:45:16,011][106226] Updated weights for policy 0, policy_version 1182182 (0.0007) [2023-12-28 03:45:16,034][106225] Updated weights for policy 1, policy_version 1185143 (0.0008) [2023-12-28 03:45:16,069][106226] Updated weights for policy 0, policy_version 1182192 (0.0005) [2023-12-28 03:45:16,099][106225] Updated weights for policy 1, policy_version 1185153 (0.0008) [2023-12-28 03:45:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 606150656. Throughput: 0: 9868.5, 1: 9786.5. Samples: 606133868. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:16,176][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.736')] [2023-12-28 03:45:16,680][106226] Updated weights for policy 0, policy_version 1182202 (0.0005) [2023-12-28 03:45:16,743][106226] Updated weights for policy 0, policy_version 1182212 (0.0006) [2023-12-28 03:45:16,798][106225] Updated weights for policy 1, policy_version 1185163 (0.0009) [2023-12-28 03:45:16,809][106226] Updated weights for policy 0, policy_version 1182222 (0.0008) [2023-12-28 03:45:16,860][106225] Updated weights for policy 1, policy_version 1185173 (0.0010) [2023-12-28 03:45:16,862][106226] Updated weights for policy 0, policy_version 1182232 (0.0008) [2023-12-28 03:45:16,915][106225] Updated weights for policy 1, policy_version 1185183 (0.0010) [2023-12-28 03:45:17,517][106226] Updated weights for policy 0, policy_version 1182242 (0.0010) [2023-12-28 03:45:17,572][106226] Updated weights for policy 0, policy_version 1182252 (0.0009) [2023-12-28 03:45:17,609][106225] Updated weights for policy 1, policy_version 1185193 (0.0006) [2023-12-28 03:45:17,628][106226] Updated weights for policy 0, policy_version 1182262 (0.0008) [2023-12-28 03:45:17,665][106225] Updated weights for policy 1, policy_version 1185203 (0.0010) [2023-12-28 03:45:17,719][106225] Updated weights for policy 1, policy_version 1185213 (0.0010) [2023-12-28 03:45:17,772][106225] Updated weights for policy 1, policy_version 1185223 (0.0010) [2023-12-28 03:45:18,367][106225] Updated weights for policy 1, policy_version 1185233 (0.0008) [2023-12-28 03:45:18,377][106226] Updated weights for policy 0, policy_version 1182272 (0.0008) [2023-12-28 03:45:18,436][106225] Updated weights for policy 1, policy_version 1185243 (0.0007) [2023-12-28 03:45:18,440][106226] Updated weights for policy 0, policy_version 1182282 (0.0007) [2023-12-28 03:45:18,496][106225] Updated weights for policy 1, policy_version 1185253 (0.0008) [2023-12-28 03:45:18,503][106226] Updated weights for policy 0, policy_version 1182292 (0.0006) [2023-12-28 03:45:19,170][106226] Updated weights for policy 0, policy_version 1182302 (0.0007) [2023-12-28 03:45:19,174][106225] Updated weights for policy 1, policy_version 1185263 (0.0006) [2023-12-28 03:45:19,230][106226] Updated weights for policy 0, policy_version 1182312 (0.0008) [2023-12-28 03:45:19,239][106225] Updated weights for policy 1, policy_version 1185273 (0.0008) [2023-12-28 03:45:19,296][106226] Updated weights for policy 0, policy_version 1182322 (0.0007) [2023-12-28 03:45:19,302][106225] Updated weights for policy 1, policy_version 1185283 (0.0008) [2023-12-28 03:45:20,001][106225] Updated weights for policy 1, policy_version 1185293 (0.0007) [2023-12-28 03:45:20,036][106226] Updated weights for policy 0, policy_version 1182332 (0.0008) [2023-12-28 03:45:20,065][106225] Updated weights for policy 1, policy_version 1185303 (0.0007) [2023-12-28 03:45:20,100][106226] Updated weights for policy 0, policy_version 1182342 (0.0009) [2023-12-28 03:45:20,128][106225] Updated weights for policy 1, policy_version 1185313 (0.0006) [2023-12-28 03:45:20,165][106226] Updated weights for policy 0, policy_version 1182352 (0.0009) [2023-12-28 03:45:20,791][106225] Updated weights for policy 1, policy_version 1185323 (0.0007) [2023-12-28 03:45:20,852][106225] Updated weights for policy 1, policy_version 1185333 (0.0009) [2023-12-28 03:45:20,913][106225] Updated weights for policy 1, policy_version 1185343 (0.0008) [2023-12-28 03:45:20,944][106226] Updated weights for policy 0, policy_version 1182362 (0.0008) [2023-12-28 03:45:21,013][106226] Updated weights for policy 0, policy_version 1182372 (0.0007) [2023-12-28 03:45:21,078][106226] Updated weights for policy 0, policy_version 1182382 (0.0008) [2023-12-28 03:45:21,149][106226] Updated weights for policy 0, policy_version 1182392 (0.0008) [2023-12-28 03:45:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 606248960. Throughput: 0: 9823.7, 1: 9768.5. Samples: 606252580. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:21,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.882')] [2023-12-28 03:45:21,742][106225] Updated weights for policy 1, policy_version 1185353 (0.0008) [2023-12-28 03:45:21,809][106225] Updated weights for policy 1, policy_version 1185363 (0.0007) [2023-12-28 03:45:21,860][106225] Updated weights for policy 1, policy_version 1185373 (0.0008) [2023-12-28 03:45:21,865][106226] Updated weights for policy 0, policy_version 1182402 (0.0006) [2023-12-28 03:45:21,918][106225] Updated weights for policy 1, policy_version 1185383 (0.0007) [2023-12-28 03:45:21,936][106226] Updated weights for policy 0, policy_version 1182412 (0.0007) [2023-12-28 03:45:22,008][106226] Updated weights for policy 0, policy_version 1182422 (0.0007) [2023-12-28 03:45:22,697][106225] Updated weights for policy 1, policy_version 1185393 (0.0006) [2023-12-28 03:45:22,734][106226] Updated weights for policy 0, policy_version 1182432 (0.0007) [2023-12-28 03:45:22,757][106225] Updated weights for policy 1, policy_version 1185403 (0.0007) [2023-12-28 03:45:22,796][106226] Updated weights for policy 0, policy_version 1182442 (0.0008) [2023-12-28 03:45:22,822][106225] Updated weights for policy 1, policy_version 1185413 (0.0008) [2023-12-28 03:45:22,866][106226] Updated weights for policy 0, policy_version 1182452 (0.0007) [2023-12-28 03:45:23,529][106225] Updated weights for policy 1, policy_version 1185423 (0.0010) [2023-12-28 03:45:23,591][106226] Updated weights for policy 0, policy_version 1182462 (0.0005) [2023-12-28 03:45:23,592][106225] Updated weights for policy 1, policy_version 1185433 (0.0010) [2023-12-28 03:45:23,649][106225] Updated weights for policy 1, policy_version 1185443 (0.0010) [2023-12-28 03:45:23,655][106226] Updated weights for policy 0, policy_version 1182472 (0.0006) [2023-12-28 03:45:23,724][106226] Updated weights for policy 0, policy_version 1182482 (0.0006) [2023-12-28 03:45:24,267][106225] Updated weights for policy 1, policy_version 1185453 (0.0009) [2023-12-28 03:45:24,328][106225] Updated weights for policy 1, policy_version 1185463 (0.0009) [2023-12-28 03:45:24,386][106225] Updated weights for policy 1, policy_version 1185473 (0.0006) [2023-12-28 03:45:24,387][106226] Updated weights for policy 0, policy_version 1182492 (0.0007) [2023-12-28 03:45:24,443][106226] Updated weights for policy 0, policy_version 1182502 (0.0008) [2023-12-28 03:45:24,491][106226] Updated weights for policy 0, policy_version 1182512 (0.0007) [2023-12-28 03:45:24,992][106225] Updated weights for policy 1, policy_version 1185483 (0.0007) [2023-12-28 03:45:25,052][106225] Updated weights for policy 1, policy_version 1185493 (0.0006) [2023-12-28 03:45:25,105][106225] Updated weights for policy 1, policy_version 1185503 (0.0008) [2023-12-28 03:45:25,191][106226] Updated weights for policy 0, policy_version 1182522 (0.0006) [2023-12-28 03:45:25,240][106226] Updated weights for policy 0, policy_version 1182532 (0.0010) [2023-12-28 03:45:25,290][106226] Updated weights for policy 0, policy_version 1182542 (0.0010) [2023-12-28 03:45:25,344][106226] Updated weights for policy 0, policy_version 1182552 (0.0010) [2023-12-28 03:45:25,767][106225] Updated weights for policy 1, policy_version 1185513 (0.0008) [2023-12-28 03:45:25,833][106225] Updated weights for policy 1, policy_version 1185523 (0.0010) [2023-12-28 03:45:25,895][106225] Updated weights for policy 1, policy_version 1185533 (0.0010) [2023-12-28 03:45:25,949][106225] Updated weights for policy 1, policy_version 1185543 (0.0006) [2023-12-28 03:45:26,050][106226] Updated weights for policy 0, policy_version 1182562 (0.0009) [2023-12-28 03:45:26,097][106226] Updated weights for policy 0, policy_version 1182572 (0.0008) [2023-12-28 03:45:26,144][106226] Updated weights for policy 0, policy_version 1182582 (0.0008) [2023-12-28 03:45:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 606347264. Throughput: 0: 9830.8, 1: 9712.4. Samples: 606309224. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:26,176][105115] Avg episode reward: [(0, '-4.553'), (1, '-5.050')] [2023-12-28 03:45:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001185544_303546368.pth... [2023-12-28 03:45:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001182584_302800896.pth... [2023-12-28 03:45:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001184392_303251456.pth [2023-12-28 03:45:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001181432_302505984.pth [2023-12-28 03:45:26,545][106225] Updated weights for policy 1, policy_version 1185553 (0.0010) [2023-12-28 03:45:26,594][106225] Updated weights for policy 1, policy_version 1185563 (0.0010) [2023-12-28 03:45:26,643][106225] Updated weights for policy 1, policy_version 1185573 (0.0010) [2023-12-28 03:45:26,918][106226] Updated weights for policy 0, policy_version 1182592 (0.0008) [2023-12-28 03:45:26,964][106226] Updated weights for policy 0, policy_version 1182602 (0.0007) [2023-12-28 03:45:27,026][106226] Updated weights for policy 0, policy_version 1182612 (0.0008) [2023-12-28 03:45:27,374][106225] Updated weights for policy 1, policy_version 1185583 (0.0010) [2023-12-28 03:45:27,432][106225] Updated weights for policy 1, policy_version 1185593 (0.0010) [2023-12-28 03:45:27,485][106225] Updated weights for policy 1, policy_version 1185603 (0.0010) [2023-12-28 03:45:27,715][106226] Updated weights for policy 0, policy_version 1182622 (0.0008) [2023-12-28 03:45:27,781][106226] Updated weights for policy 0, policy_version 1182632 (0.0008) [2023-12-28 03:45:27,847][106226] Updated weights for policy 0, policy_version 1182642 (0.0008) [2023-12-28 03:45:28,187][106225] Updated weights for policy 1, policy_version 1185613 (0.0010) [2023-12-28 03:45:28,233][106225] Updated weights for policy 1, policy_version 1185623 (0.0007) [2023-12-28 03:45:28,277][106225] Updated weights for policy 1, policy_version 1185633 (0.0007) [2023-12-28 03:45:28,555][106226] Updated weights for policy 0, policy_version 1182652 (0.0009) [2023-12-28 03:45:28,616][106226] Updated weights for policy 0, policy_version 1182662 (0.0011) [2023-12-28 03:45:28,674][106226] Updated weights for policy 0, policy_version 1182672 (0.0007) [2023-12-28 03:45:28,999][106225] Updated weights for policy 1, policy_version 1185643 (0.0008) [2023-12-28 03:45:29,046][106225] Updated weights for policy 1, policy_version 1185653 (0.0005) [2023-12-28 03:45:29,095][106225] Updated weights for policy 1, policy_version 1185663 (0.0007) [2023-12-28 03:45:29,408][106226] Updated weights for policy 0, policy_version 1182682 (0.0009) [2023-12-28 03:45:29,460][106226] Updated weights for policy 0, policy_version 1182692 (0.0011) [2023-12-28 03:45:29,515][106226] Updated weights for policy 0, policy_version 1182702 (0.0008) [2023-12-28 03:45:29,566][106226] Updated weights for policy 0, policy_version 1182712 (0.0005) [2023-12-28 03:45:29,832][106225] Updated weights for policy 1, policy_version 1185673 (0.0007) [2023-12-28 03:45:29,895][106225] Updated weights for policy 1, policy_version 1185683 (0.0010) [2023-12-28 03:45:29,965][106225] Updated weights for policy 1, policy_version 1185693 (0.0007) [2023-12-28 03:45:30,019][106225] Updated weights for policy 1, policy_version 1185703 (0.0005) [2023-12-28 03:45:30,236][106226] Updated weights for policy 0, policy_version 1182722 (0.0005) [2023-12-28 03:45:30,293][106226] Updated weights for policy 0, policy_version 1182732 (0.0005) [2023-12-28 03:45:30,351][106226] Updated weights for policy 0, policy_version 1182742 (0.0005) [2023-12-28 03:45:30,665][106225] Updated weights for policy 1, policy_version 1185713 (0.0005) [2023-12-28 03:45:30,711][106225] Updated weights for policy 1, policy_version 1185723 (0.0005) [2023-12-28 03:45:30,762][106225] Updated weights for policy 1, policy_version 1185733 (0.0008) [2023-12-28 03:45:31,022][106226] Updated weights for policy 0, policy_version 1182752 (0.0010) [2023-12-28 03:45:31,087][106226] Updated weights for policy 0, policy_version 1182762 (0.0009) [2023-12-28 03:45:31,154][106226] Updated weights for policy 0, policy_version 1182772 (0.0009) [2023-12-28 03:45:31,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 606437376. Throughput: 0: 9841.5, 1: 9805.7. Samples: 606430996. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:31,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-4.960')] [2023-12-28 03:45:31,467][106225] Updated weights for policy 1, policy_version 1185743 (0.0008) [2023-12-28 03:45:31,527][106225] Updated weights for policy 1, policy_version 1185753 (0.0008) [2023-12-28 03:45:31,585][106225] Updated weights for policy 1, policy_version 1185763 (0.0005) [2023-12-28 03:45:31,901][106226] Updated weights for policy 0, policy_version 1182782 (0.0008) [2023-12-28 03:45:31,970][106226] Updated weights for policy 0, policy_version 1182792 (0.0007) [2023-12-28 03:45:32,032][106226] Updated weights for policy 0, policy_version 1182802 (0.0008) [2023-12-28 03:45:32,304][106225] Updated weights for policy 1, policy_version 1185773 (0.0007) [2023-12-28 03:45:32,358][106225] Updated weights for policy 1, policy_version 1185783 (0.0007) [2023-12-28 03:45:32,424][106225] Updated weights for policy 1, policy_version 1185793 (0.0008) [2023-12-28 03:45:32,761][106226] Updated weights for policy 0, policy_version 1182812 (0.0008) [2023-12-28 03:45:32,828][106226] Updated weights for policy 0, policy_version 1182822 (0.0009) [2023-12-28 03:45:32,885][106226] Updated weights for policy 0, policy_version 1182832 (0.0008) [2023-12-28 03:45:33,198][106225] Updated weights for policy 1, policy_version 1185803 (0.0008) [2023-12-28 03:45:33,252][106225] Updated weights for policy 1, policy_version 1185813 (0.0009) [2023-12-28 03:45:33,310][106225] Updated weights for policy 1, policy_version 1185823 (0.0007) [2023-12-28 03:45:33,497][106226] Updated weights for policy 0, policy_version 1182842 (0.0008) [2023-12-28 03:45:33,563][106226] Updated weights for policy 0, policy_version 1182852 (0.0007) [2023-12-28 03:45:33,622][106226] Updated weights for policy 0, policy_version 1182862 (0.0008) [2023-12-28 03:45:33,682][106226] Updated weights for policy 0, policy_version 1182872 (0.0009) [2023-12-28 03:45:33,957][106225] Updated weights for policy 1, policy_version 1185833 (0.0009) [2023-12-28 03:45:34,017][106225] Updated weights for policy 1, policy_version 1185843 (0.0005) [2023-12-28 03:45:34,074][106225] Updated weights for policy 1, policy_version 1185853 (0.0006) [2023-12-28 03:45:34,136][106225] Updated weights for policy 1, policy_version 1185863 (0.0009) [2023-12-28 03:45:34,465][106226] Updated weights for policy 0, policy_version 1182882 (0.0009) [2023-12-28 03:45:34,526][106226] Updated weights for policy 0, policy_version 1182892 (0.0009) [2023-12-28 03:45:34,589][106226] Updated weights for policy 0, policy_version 1182902 (0.0009) [2023-12-28 03:45:34,823][106225] Updated weights for policy 1, policy_version 1185873 (0.0008) [2023-12-28 03:45:34,872][106225] Updated weights for policy 1, policy_version 1185883 (0.0010) [2023-12-28 03:45:34,938][106225] Updated weights for policy 1, policy_version 1185893 (0.0007) [2023-12-28 03:45:35,255][106226] Updated weights for policy 0, policy_version 1182912 (0.0007) [2023-12-28 03:45:35,308][106226] Updated weights for policy 0, policy_version 1182922 (0.0009) [2023-12-28 03:45:35,363][106226] Updated weights for policy 0, policy_version 1182932 (0.0009) [2023-12-28 03:45:35,520][106225] Updated weights for policy 1, policy_version 1185903 (0.0009) [2023-12-28 03:45:35,577][106225] Updated weights for policy 1, policy_version 1185913 (0.0007) [2023-12-28 03:45:35,638][106225] Updated weights for policy 1, policy_version 1185923 (0.0005) [2023-12-28 03:45:35,988][106226] Updated weights for policy 0, policy_version 1182942 (0.0008) [2023-12-28 03:45:36,048][106226] Updated weights for policy 0, policy_version 1182952 (0.0005) [2023-12-28 03:45:36,095][106226] Updated weights for policy 0, policy_version 1182962 (0.0005) [2023-12-28 03:45:36,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 606543872. Throughput: 0: 9861.1, 1: 9856.2. Samples: 606550856. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:36,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-4.903')] [2023-12-28 03:45:36,274][106225] Updated weights for policy 1, policy_version 1185933 (0.0006) [2023-12-28 03:45:36,326][106225] Updated weights for policy 1, policy_version 1185943 (0.0005) [2023-12-28 03:45:36,383][106225] Updated weights for policy 1, policy_version 1185953 (0.0006) [2023-12-28 03:45:36,817][106226] Updated weights for policy 0, policy_version 1182972 (0.0008) [2023-12-28 03:45:36,873][106226] Updated weights for policy 0, policy_version 1182982 (0.0009) [2023-12-28 03:45:36,922][106226] Updated weights for policy 0, policy_version 1182992 (0.0008) [2023-12-28 03:45:36,969][106225] Updated weights for policy 1, policy_version 1185963 (0.0005) [2023-12-28 03:45:37,025][106225] Updated weights for policy 1, policy_version 1185973 (0.0005) [2023-12-28 03:45:37,081][106225] Updated weights for policy 1, policy_version 1185983 (0.0005) [2023-12-28 03:45:37,597][106226] Updated weights for policy 0, policy_version 1183002 (0.0008) [2023-12-28 03:45:37,646][106226] Updated weights for policy 0, policy_version 1183012 (0.0005) [2023-12-28 03:45:37,699][106226] Updated weights for policy 0, policy_version 1183022 (0.0006) [2023-12-28 03:45:37,754][106226] Updated weights for policy 0, policy_version 1183032 (0.0006) [2023-12-28 03:45:37,831][106225] Updated weights for policy 1, policy_version 1185993 (0.0008) [2023-12-28 03:45:37,893][106225] Updated weights for policy 1, policy_version 1186003 (0.0008) [2023-12-28 03:45:37,960][106225] Updated weights for policy 1, policy_version 1186013 (0.0008) [2023-12-28 03:45:38,026][106225] Updated weights for policy 1, policy_version 1186023 (0.0008) [2023-12-28 03:45:38,459][106226] Updated weights for policy 0, policy_version 1183042 (0.0006) [2023-12-28 03:45:38,525][106226] Updated weights for policy 0, policy_version 1183052 (0.0006) [2023-12-28 03:45:38,594][106226] Updated weights for policy 0, policy_version 1183062 (0.0006) [2023-12-28 03:45:38,778][106225] Updated weights for policy 1, policy_version 1186033 (0.0009) [2023-12-28 03:45:38,843][106225] Updated weights for policy 1, policy_version 1186043 (0.0009) [2023-12-28 03:45:38,899][106225] Updated weights for policy 1, policy_version 1186053 (0.0009) [2023-12-28 03:45:39,245][106226] Updated weights for policy 0, policy_version 1183072 (0.0008) [2023-12-28 03:45:39,304][106226] Updated weights for policy 0, policy_version 1183082 (0.0008) [2023-12-28 03:45:39,357][106226] Updated weights for policy 0, policy_version 1183092 (0.0008) [2023-12-28 03:45:39,627][106225] Updated weights for policy 1, policy_version 1186063 (0.0010) [2023-12-28 03:45:39,682][106225] Updated weights for policy 1, policy_version 1186073 (0.0011) [2023-12-28 03:45:39,733][106225] Updated weights for policy 1, policy_version 1186083 (0.0011) [2023-12-28 03:45:40,093][106226] Updated weights for policy 0, policy_version 1183102 (0.0009) [2023-12-28 03:45:40,164][106226] Updated weights for policy 0, policy_version 1183112 (0.0010) [2023-12-28 03:45:40,231][106226] Updated weights for policy 0, policy_version 1183122 (0.0008) [2023-12-28 03:45:40,430][106225] Updated weights for policy 1, policy_version 1186093 (0.0008) [2023-12-28 03:45:40,489][106225] Updated weights for policy 1, policy_version 1186103 (0.0006) [2023-12-28 03:45:40,548][106225] Updated weights for policy 1, policy_version 1186113 (0.0005) [2023-12-28 03:45:41,036][106226] Updated weights for policy 0, policy_version 1183132 (0.0007) [2023-12-28 03:45:41,099][106226] Updated weights for policy 0, policy_version 1183142 (0.0008) [2023-12-28 03:45:41,138][106225] Updated weights for policy 1, policy_version 1186123 (0.0007) [2023-12-28 03:45:41,172][106226] Updated weights for policy 0, policy_version 1183152 (0.0009) [2023-12-28 03:45:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 606633984. Throughput: 0: 9859.4, 1: 9894.6. Samples: 606612156. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:41,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-4.973')] [2023-12-28 03:45:41,205][106225] Updated weights for policy 1, policy_version 1186133 (0.0008) [2023-12-28 03:45:41,227][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001183160_302948352.pth... [2023-12-28 03:45:41,232][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001182008_302653440.pth [2023-12-28 03:45:41,271][106225] Updated weights for policy 1, policy_version 1186143 (0.0007) [2023-12-28 03:45:41,330][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001186152_303702016.pth... [2023-12-28 03:45:41,335][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001184968_303398912.pth [2023-12-28 03:45:41,930][106226] Updated weights for policy 0, policy_version 1183162 (0.0006) [2023-12-28 03:45:41,991][106226] Updated weights for policy 0, policy_version 1183172 (0.0006) [2023-12-28 03:45:42,048][106225] Updated weights for policy 1, policy_version 1186153 (0.0007) [2023-12-28 03:45:42,056][106226] Updated weights for policy 0, policy_version 1183182 (0.0007) [2023-12-28 03:45:42,107][106225] Updated weights for policy 1, policy_version 1186163 (0.0006) [2023-12-28 03:45:42,121][106226] Updated weights for policy 0, policy_version 1183192 (0.0008) [2023-12-28 03:45:42,164][106225] Updated weights for policy 1, policy_version 1186173 (0.0006) [2023-12-28 03:45:42,221][106225] Updated weights for policy 1, policy_version 1186183 (0.0006) [2023-12-28 03:45:42,825][106226] Updated weights for policy 0, policy_version 1183202 (0.0009) [2023-12-28 03:45:42,886][106226] Updated weights for policy 0, policy_version 1183212 (0.0007) [2023-12-28 03:45:42,906][106225] Updated weights for policy 1, policy_version 1186193 (0.0008) [2023-12-28 03:45:42,952][106226] Updated weights for policy 0, policy_version 1183222 (0.0006) [2023-12-28 03:45:42,966][106225] Updated weights for policy 1, policy_version 1186203 (0.0008) [2023-12-28 03:45:43,029][106225] Updated weights for policy 1, policy_version 1186213 (0.0008) [2023-12-28 03:45:43,667][106226] Updated weights for policy 0, policy_version 1183232 (0.0009) [2023-12-28 03:45:43,688][106225] Updated weights for policy 1, policy_version 1186223 (0.0007) [2023-12-28 03:45:43,724][106226] Updated weights for policy 0, policy_version 1183242 (0.0008) [2023-12-28 03:45:43,743][106225] Updated weights for policy 1, policy_version 1186233 (0.0006) [2023-12-28 03:45:43,778][106226] Updated weights for policy 0, policy_version 1183252 (0.0009) [2023-12-28 03:45:43,796][106225] Updated weights for policy 1, policy_version 1186243 (0.0005) [2023-12-28 03:45:44,336][106225] Updated weights for policy 1, policy_version 1186253 (0.0007) [2023-12-28 03:45:44,390][106225] Updated weights for policy 1, policy_version 1186263 (0.0005) [2023-12-28 03:45:44,448][106225] Updated weights for policy 1, policy_version 1186273 (0.0008) [2023-12-28 03:45:44,606][106226] Updated weights for policy 0, policy_version 1183262 (0.0009) [2023-12-28 03:45:44,677][106226] Updated weights for policy 0, policy_version 1183272 (0.0008) [2023-12-28 03:45:44,727][106226] Updated weights for policy 0, policy_version 1183282 (0.0007) [2023-12-28 03:45:45,105][106225] Updated weights for policy 1, policy_version 1186283 (0.0009) [2023-12-28 03:45:45,173][106225] Updated weights for policy 1, policy_version 1186293 (0.0011) [2023-12-28 03:45:45,231][106225] Updated weights for policy 1, policy_version 1186303 (0.0011) [2023-12-28 03:45:45,491][106226] Updated weights for policy 0, policy_version 1183292 (0.0008) [2023-12-28 03:45:45,552][106226] Updated weights for policy 0, policy_version 1183302 (0.0008) [2023-12-28 03:45:45,603][106226] Updated weights for policy 0, policy_version 1183312 (0.0008) [2023-12-28 03:45:45,945][106225] Updated weights for policy 1, policy_version 1186313 (0.0011) [2023-12-28 03:45:46,000][106225] Updated weights for policy 1, policy_version 1186323 (0.0006) [2023-12-28 03:45:46,056][106225] Updated weights for policy 1, policy_version 1186333 (0.0006) [2023-12-28 03:45:46,102][106225] Updated weights for policy 1, policy_version 1186343 (0.0005) [2023-12-28 03:45:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 606740480. Throughput: 0: 9692.3, 1: 10009.5. Samples: 606728176. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:46,175][105115] Avg episode reward: [(0, '-4.818'), (1, '-4.926')] [2023-12-28 03:45:46,317][106226] Updated weights for policy 0, policy_version 1183322 (0.0009) [2023-12-28 03:45:46,365][106226] Updated weights for policy 0, policy_version 1183332 (0.0010) [2023-12-28 03:45:46,415][106226] Updated weights for policy 0, policy_version 1183342 (0.0010) [2023-12-28 03:45:46,463][106226] Updated weights for policy 0, policy_version 1183352 (0.0009) [2023-12-28 03:45:46,670][106225] Updated weights for policy 1, policy_version 1186353 (0.0005) [2023-12-28 03:45:46,731][106225] Updated weights for policy 1, policy_version 1186363 (0.0005) [2023-12-28 03:45:46,797][106225] Updated weights for policy 1, policy_version 1186373 (0.0005) [2023-12-28 03:45:47,050][106226] Updated weights for policy 0, policy_version 1183362 (0.0010) [2023-12-28 03:45:47,110][106226] Updated weights for policy 0, policy_version 1183372 (0.0010) [2023-12-28 03:45:47,173][106226] Updated weights for policy 0, policy_version 1183382 (0.0010) [2023-12-28 03:45:47,325][106225] Updated weights for policy 1, policy_version 1186383 (0.0006) [2023-12-28 03:45:47,393][106225] Updated weights for policy 1, policy_version 1186393 (0.0005) [2023-12-28 03:45:47,446][106225] Updated weights for policy 1, policy_version 1186403 (0.0005) [2023-12-28 03:45:47,699][106226] Updated weights for policy 0, policy_version 1183392 (0.0006) [2023-12-28 03:45:47,754][106226] Updated weights for policy 0, policy_version 1183402 (0.0005) [2023-12-28 03:45:47,803][106226] Updated weights for policy 0, policy_version 1183412 (0.0005) [2023-12-28 03:45:47,951][106225] Updated weights for policy 1, policy_version 1186413 (0.0005) [2023-12-28 03:45:48,005][106225] Updated weights for policy 1, policy_version 1186423 (0.0006) [2023-12-28 03:45:48,055][106225] Updated weights for policy 1, policy_version 1186433 (0.0009) [2023-12-28 03:45:48,495][106226] Updated weights for policy 0, policy_version 1183422 (0.0009) [2023-12-28 03:45:48,557][106226] Updated weights for policy 0, policy_version 1183432 (0.0011) [2023-12-28 03:45:48,614][106226] Updated weights for policy 0, policy_version 1183442 (0.0009) [2023-12-28 03:45:48,735][106225] Updated weights for policy 1, policy_version 1186443 (0.0006) [2023-12-28 03:45:48,791][106225] Updated weights for policy 1, policy_version 1186453 (0.0008) [2023-12-28 03:45:48,843][106225] Updated weights for policy 1, policy_version 1186463 (0.0008) [2023-12-28 03:45:49,309][106226] Updated weights for policy 0, policy_version 1183452 (0.0007) [2023-12-28 03:45:49,380][106226] Updated weights for policy 0, policy_version 1183462 (0.0007) [2023-12-28 03:45:49,440][106226] Updated weights for policy 0, policy_version 1183472 (0.0005) [2023-12-28 03:45:49,594][106225] Updated weights for policy 1, policy_version 1186473 (0.0009) [2023-12-28 03:45:49,648][106225] Updated weights for policy 1, policy_version 1186483 (0.0010) [2023-12-28 03:45:49,695][106225] Updated weights for policy 1, policy_version 1186493 (0.0010) [2023-12-28 03:45:49,742][106225] Updated weights for policy 1, policy_version 1186503 (0.0010) [2023-12-28 03:45:50,149][106226] Updated weights for policy 0, policy_version 1183482 (0.0008) [2023-12-28 03:45:50,213][106226] Updated weights for policy 0, policy_version 1183492 (0.0009) [2023-12-28 03:45:50,274][106226] Updated weights for policy 0, policy_version 1183502 (0.0009) [2023-12-28 03:45:50,330][106226] Updated weights for policy 0, policy_version 1183512 (0.0008) [2023-12-28 03:45:50,487][106225] Updated weights for policy 1, policy_version 1186513 (0.0010) [2023-12-28 03:45:50,541][106225] Updated weights for policy 1, policy_version 1186523 (0.0010) [2023-12-28 03:45:50,602][106225] Updated weights for policy 1, policy_version 1186533 (0.0010) [2023-12-28 03:45:51,012][106226] Updated weights for policy 0, policy_version 1183522 (0.0008) [2023-12-28 03:45:51,089][106226] Updated weights for policy 0, policy_version 1183532 (0.0007) [2023-12-28 03:45:51,160][106226] Updated weights for policy 0, policy_version 1183542 (0.0008) [2023-12-28 03:45:51,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 606846976. Throughput: 0: 9729.9, 1: 10088.0. Samples: 606854176. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:51,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-5.177')] [2023-12-28 03:45:51,277][106225] Updated weights for policy 1, policy_version 1186543 (0.0010) [2023-12-28 03:45:51,334][106225] Updated weights for policy 1, policy_version 1186553 (0.0010) [2023-12-28 03:45:51,405][106225] Updated weights for policy 1, policy_version 1186563 (0.0010) [2023-12-28 03:45:51,887][106226] Updated weights for policy 0, policy_version 1183552 (0.0006) [2023-12-28 03:45:51,949][106226] Updated weights for policy 0, policy_version 1183562 (0.0007) [2023-12-28 03:45:52,016][106226] Updated weights for policy 0, policy_version 1183572 (0.0009) [2023-12-28 03:45:52,110][106225] Updated weights for policy 1, policy_version 1186573 (0.0008) [2023-12-28 03:45:52,161][106225] Updated weights for policy 1, policy_version 1186583 (0.0010) [2023-12-28 03:45:52,211][106225] Updated weights for policy 1, policy_version 1186593 (0.0010) [2023-12-28 03:45:52,719][106226] Updated weights for policy 0, policy_version 1183582 (0.0009) [2023-12-28 03:45:52,773][106226] Updated weights for policy 0, policy_version 1183592 (0.0006) [2023-12-28 03:45:52,840][106226] Updated weights for policy 0, policy_version 1183602 (0.0005) [2023-12-28 03:45:53,012][106225] Updated weights for policy 1, policy_version 1186603 (0.0010) [2023-12-28 03:45:53,074][106225] Updated weights for policy 1, policy_version 1186613 (0.0007) [2023-12-28 03:45:53,141][106225] Updated weights for policy 1, policy_version 1186623 (0.0005) [2023-12-28 03:45:53,504][106226] Updated weights for policy 0, policy_version 1183612 (0.0005) [2023-12-28 03:45:53,574][106226] Updated weights for policy 0, policy_version 1183622 (0.0005) [2023-12-28 03:45:53,644][106226] Updated weights for policy 0, policy_version 1183632 (0.0005) [2023-12-28 03:45:53,776][106225] Updated weights for policy 1, policy_version 1186633 (0.0005) [2023-12-28 03:45:53,825][106225] Updated weights for policy 1, policy_version 1186643 (0.0005) [2023-12-28 03:45:53,877][106225] Updated weights for policy 1, policy_version 1186653 (0.0005) [2023-12-28 03:45:53,934][106225] Updated weights for policy 1, policy_version 1186663 (0.0006) [2023-12-28 03:45:54,351][106226] Updated weights for policy 0, policy_version 1183642 (0.0006) [2023-12-28 03:45:54,408][106226] Updated weights for policy 0, policy_version 1183652 (0.0008) [2023-12-28 03:45:54,471][106226] Updated weights for policy 0, policy_version 1183662 (0.0005) [2023-12-28 03:45:54,473][106225] Updated weights for policy 1, policy_version 1186673 (0.0007) [2023-12-28 03:45:54,533][106226] Updated weights for policy 0, policy_version 1183672 (0.0006) [2023-12-28 03:45:54,537][106225] Updated weights for policy 1, policy_version 1186683 (0.0009) [2023-12-28 03:45:54,598][106225] Updated weights for policy 1, policy_version 1186693 (0.0008) [2023-12-28 03:45:55,079][106226] Updated weights for policy 0, policy_version 1183682 (0.0007) [2023-12-28 03:45:55,143][106226] Updated weights for policy 0, policy_version 1183692 (0.0009) [2023-12-28 03:45:55,202][106226] Updated weights for policy 0, policy_version 1183702 (0.0008) [2023-12-28 03:45:55,235][106225] Updated weights for policy 1, policy_version 1186703 (0.0008) [2023-12-28 03:45:55,287][106225] Updated weights for policy 1, policy_version 1186713 (0.0008) [2023-12-28 03:45:55,339][106225] Updated weights for policy 1, policy_version 1186723 (0.0006) [2023-12-28 03:45:55,904][106225] Updated weights for policy 1, policy_version 1186733 (0.0005) [2023-12-28 03:45:55,932][106226] Updated weights for policy 0, policy_version 1183712 (0.0006) [2023-12-28 03:45:55,960][106225] Updated weights for policy 1, policy_version 1186743 (0.0008) [2023-12-28 03:45:55,984][106226] Updated weights for policy 0, policy_version 1183722 (0.0005) [2023-12-28 03:45:56,007][106225] Updated weights for policy 1, policy_version 1186753 (0.0008) [2023-12-28 03:45:56,034][106226] Updated weights for policy 0, policy_version 1183732 (0.0006) [2023-12-28 03:45:56,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 606953472. Throughput: 0: 9749.1, 1: 10092.0. Samples: 606913276. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:45:56,176][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.950')] [2023-12-28 03:45:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001186760_303857664.pth... [2023-12-28 03:45:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001183736_303095808.pth... [2023-12-28 03:45:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001185544_303546368.pth [2023-12-28 03:45:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001182584_302800896.pth [2023-12-28 03:45:56,685][106225] Updated weights for policy 1, policy_version 1186763 (0.0006) [2023-12-28 03:45:56,719][106226] Updated weights for policy 0, policy_version 1183742 (0.0007) [2023-12-28 03:45:56,753][106225] Updated weights for policy 1, policy_version 1186773 (0.0010) [2023-12-28 03:45:56,774][106226] Updated weights for policy 0, policy_version 1183752 (0.0007) [2023-12-28 03:45:56,805][106225] Updated weights for policy 1, policy_version 1186783 (0.0010) [2023-12-28 03:45:56,826][106226] Updated weights for policy 0, policy_version 1183762 (0.0006) [2023-12-28 03:45:57,445][106226] Updated weights for policy 0, policy_version 1183772 (0.0008) [2023-12-28 03:45:57,483][106225] Updated weights for policy 1, policy_version 1186793 (0.0010) [2023-12-28 03:45:57,495][106226] Updated weights for policy 0, policy_version 1183782 (0.0008) [2023-12-28 03:45:57,546][106226] Updated weights for policy 0, policy_version 1183792 (0.0008) [2023-12-28 03:45:57,549][106225] Updated weights for policy 1, policy_version 1186803 (0.0006) [2023-12-28 03:45:57,592][106225] Updated weights for policy 1, policy_version 1186813 (0.0005) [2023-12-28 03:45:57,639][106225] Updated weights for policy 1, policy_version 1186823 (0.0007) [2023-12-28 03:45:58,226][106226] Updated weights for policy 0, policy_version 1183802 (0.0007) [2023-12-28 03:45:58,286][106226] Updated weights for policy 0, policy_version 1183812 (0.0008) [2023-12-28 03:45:58,354][106226] Updated weights for policy 0, policy_version 1183822 (0.0008) [2023-12-28 03:45:58,379][106225] Updated weights for policy 1, policy_version 1186833 (0.0008) [2023-12-28 03:45:58,426][106226] Updated weights for policy 0, policy_version 1183832 (0.0008) [2023-12-28 03:45:58,444][106225] Updated weights for policy 1, policy_version 1186843 (0.0008) [2023-12-28 03:45:58,512][106225] Updated weights for policy 1, policy_version 1186853 (0.0008) [2023-12-28 03:45:59,259][106226] Updated weights for policy 0, policy_version 1183842 (0.0009) [2023-12-28 03:45:59,320][106226] Updated weights for policy 0, policy_version 1183852 (0.0008) [2023-12-28 03:45:59,348][106225] Updated weights for policy 1, policy_version 1186863 (0.0008) [2023-12-28 03:45:59,399][106226] Updated weights for policy 0, policy_version 1183862 (0.0008) [2023-12-28 03:45:59,420][106225] Updated weights for policy 1, policy_version 1186873 (0.0008) [2023-12-28 03:45:59,485][106225] Updated weights for policy 1, policy_version 1186883 (0.0008) [2023-12-28 03:46:00,171][106226] Updated weights for policy 0, policy_version 1183872 (0.0008) [2023-12-28 03:46:00,177][106225] Updated weights for policy 1, policy_version 1186893 (0.0008) [2023-12-28 03:46:00,231][106225] Updated weights for policy 1, policy_version 1186903 (0.0006) [2023-12-28 03:46:00,232][106226] Updated weights for policy 0, policy_version 1183882 (0.0007) [2023-12-28 03:46:00,295][106226] Updated weights for policy 0, policy_version 1183892 (0.0008) [2023-12-28 03:46:00,298][106225] Updated weights for policy 1, policy_version 1186913 (0.0006) [2023-12-28 03:46:00,919][106225] Updated weights for policy 1, policy_version 1186923 (0.0007) [2023-12-28 03:46:00,984][106225] Updated weights for policy 1, policy_version 1186933 (0.0010) [2023-12-28 03:46:01,052][106226] Updated weights for policy 0, policy_version 1183902 (0.0008) [2023-12-28 03:46:01,053][106225] Updated weights for policy 1, policy_version 1186943 (0.0010) [2023-12-28 03:46:01,118][106226] Updated weights for policy 0, policy_version 1183912 (0.0007) [2023-12-28 03:46:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 607043584. Throughput: 0: 9804.1, 1: 10181.8. Samples: 607033232. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:01,175][105115] Avg episode reward: [(0, '-4.836'), (1, '-4.998')] [2023-12-28 03:46:01,184][106226] Updated weights for policy 0, policy_version 1183922 (0.0009) [2023-12-28 03:46:01,772][106225] Updated weights for policy 1, policy_version 1186953 (0.0009) [2023-12-28 03:46:01,837][106225] Updated weights for policy 1, policy_version 1186963 (0.0010) [2023-12-28 03:46:01,888][106225] Updated weights for policy 1, policy_version 1186973 (0.0010) [2023-12-28 03:46:01,928][106226] Updated weights for policy 0, policy_version 1183932 (0.0009) [2023-12-28 03:46:01,949][106225] Updated weights for policy 1, policy_version 1186983 (0.0007) [2023-12-28 03:46:01,996][106226] Updated weights for policy 0, policy_version 1183942 (0.0009) [2023-12-28 03:46:02,057][106226] Updated weights for policy 0, policy_version 1183952 (0.0010) [2023-12-28 03:46:02,719][106225] Updated weights for policy 1, policy_version 1186993 (0.0011) [2023-12-28 03:46:02,773][106226] Updated weights for policy 0, policy_version 1183962 (0.0006) [2023-12-28 03:46:02,779][106225] Updated weights for policy 1, policy_version 1187003 (0.0008) [2023-12-28 03:46:02,836][106226] Updated weights for policy 0, policy_version 1183972 (0.0008) [2023-12-28 03:46:02,842][106225] Updated weights for policy 1, policy_version 1187013 (0.0010) [2023-12-28 03:46:02,897][106226] Updated weights for policy 0, policy_version 1183982 (0.0007) [2023-12-28 03:46:02,959][106226] Updated weights for policy 0, policy_version 1183992 (0.0007) [2023-12-28 03:46:03,589][106225] Updated weights for policy 1, policy_version 1187023 (0.0008) [2023-12-28 03:46:03,611][106226] Updated weights for policy 0, policy_version 1184002 (0.0007) [2023-12-28 03:46:03,651][106225] Updated weights for policy 1, policy_version 1187033 (0.0006) [2023-12-28 03:46:03,664][106226] Updated weights for policy 0, policy_version 1184012 (0.0006) [2023-12-28 03:46:03,705][106225] Updated weights for policy 1, policy_version 1187043 (0.0007) [2023-12-28 03:46:03,728][106226] Updated weights for policy 0, policy_version 1184022 (0.0006) [2023-12-28 03:46:04,507][106226] Updated weights for policy 0, policy_version 1184032 (0.0007) [2023-12-28 03:46:04,556][106225] Updated weights for policy 1, policy_version 1187053 (0.0008) [2023-12-28 03:46:04,566][106226] Updated weights for policy 0, policy_version 1184042 (0.0008) [2023-12-28 03:46:04,622][106225] Updated weights for policy 1, policy_version 1187063 (0.0009) [2023-12-28 03:46:04,629][106226] Updated weights for policy 0, policy_version 1184052 (0.0008) [2023-12-28 03:46:04,688][106225] Updated weights for policy 1, policy_version 1187073 (0.0010) [2023-12-28 03:46:05,265][106225] Updated weights for policy 1, policy_version 1187083 (0.0008) [2023-12-28 03:46:05,313][106225] Updated weights for policy 1, policy_version 1187093 (0.0006) [2023-12-28 03:46:05,370][106225] Updated weights for policy 1, policy_version 1187103 (0.0007) [2023-12-28 03:46:05,436][106226] Updated weights for policy 0, policy_version 1184062 (0.0010) [2023-12-28 03:46:05,498][106226] Updated weights for policy 0, policy_version 1184072 (0.0010) [2023-12-28 03:46:05,552][106226] Updated weights for policy 0, policy_version 1184082 (0.0009) [2023-12-28 03:46:05,960][106225] Updated weights for policy 1, policy_version 1187113 (0.0006) [2023-12-28 03:46:06,018][106225] Updated weights for policy 1, policy_version 1187123 (0.0008) [2023-12-28 03:46:06,072][106225] Updated weights for policy 1, policy_version 1187133 (0.0010) [2023-12-28 03:46:06,126][106225] Updated weights for policy 1, policy_version 1187143 (0.0010) [2023-12-28 03:46:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 607141888. Throughput: 0: 9793.0, 1: 10164.5. Samples: 607150668. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:06,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.835')] [2023-12-28 03:46:06,215][106226] Updated weights for policy 0, policy_version 1184092 (0.0009) [2023-12-28 03:46:06,282][106226] Updated weights for policy 0, policy_version 1184102 (0.0008) [2023-12-28 03:46:06,349][106226] Updated weights for policy 0, policy_version 1184112 (0.0008) [2023-12-28 03:46:06,817][106225] Updated weights for policy 1, policy_version 1187153 (0.0008) [2023-12-28 03:46:06,882][106225] Updated weights for policy 1, policy_version 1187163 (0.0008) [2023-12-28 03:46:06,940][106225] Updated weights for policy 1, policy_version 1187173 (0.0008) [2023-12-28 03:46:07,098][106226] Updated weights for policy 0, policy_version 1184122 (0.0009) [2023-12-28 03:46:07,159][106226] Updated weights for policy 0, policy_version 1184132 (0.0011) [2023-12-28 03:46:07,213][106226] Updated weights for policy 0, policy_version 1184142 (0.0005) [2023-12-28 03:46:07,278][106226] Updated weights for policy 0, policy_version 1184152 (0.0010) [2023-12-28 03:46:07,650][106225] Updated weights for policy 1, policy_version 1187183 (0.0006) [2023-12-28 03:46:07,706][106225] Updated weights for policy 1, policy_version 1187193 (0.0005) [2023-12-28 03:46:07,755][106225] Updated weights for policy 1, policy_version 1187203 (0.0006) [2023-12-28 03:46:07,966][106226] Updated weights for policy 0, policy_version 1184162 (0.0011) [2023-12-28 03:46:08,035][106226] Updated weights for policy 0, policy_version 1184172 (0.0007) [2023-12-28 03:46:08,104][106226] Updated weights for policy 0, policy_version 1184182 (0.0010) [2023-12-28 03:46:08,456][106225] Updated weights for policy 1, policy_version 1187213 (0.0009) [2023-12-28 03:46:08,521][106225] Updated weights for policy 1, policy_version 1187223 (0.0010) [2023-12-28 03:46:08,585][106225] Updated weights for policy 1, policy_version 1187233 (0.0009) [2023-12-28 03:46:08,796][106226] Updated weights for policy 0, policy_version 1184192 (0.0010) [2023-12-28 03:46:08,846][106226] Updated weights for policy 0, policy_version 1184202 (0.0010) [2023-12-28 03:46:08,903][106226] Updated weights for policy 0, policy_version 1184212 (0.0010) [2023-12-28 03:46:09,240][106225] Updated weights for policy 1, policy_version 1187243 (0.0006) [2023-12-28 03:46:09,308][106225] Updated weights for policy 1, policy_version 1187253 (0.0008) [2023-12-28 03:46:09,376][106225] Updated weights for policy 1, policy_version 1187263 (0.0009) [2023-12-28 03:46:09,699][106226] Updated weights for policy 0, policy_version 1184222 (0.0008) [2023-12-28 03:46:09,765][106226] Updated weights for policy 0, policy_version 1184232 (0.0006) [2023-12-28 03:46:09,839][106226] Updated weights for policy 0, policy_version 1184242 (0.0010) [2023-12-28 03:46:10,131][106225] Updated weights for policy 1, policy_version 1187273 (0.0009) [2023-12-28 03:46:10,201][106225] Updated weights for policy 1, policy_version 1187283 (0.0007) [2023-12-28 03:46:10,271][106225] Updated weights for policy 1, policy_version 1187293 (0.0009) [2023-12-28 03:46:10,337][106225] Updated weights for policy 1, policy_version 1187303 (0.0007) [2023-12-28 03:46:10,518][106226] Updated weights for policy 0, policy_version 1184252 (0.0009) [2023-12-28 03:46:10,578][106226] Updated weights for policy 0, policy_version 1184262 (0.0005) [2023-12-28 03:46:10,627][106226] Updated weights for policy 0, policy_version 1184272 (0.0005) [2023-12-28 03:46:11,094][106225] Updated weights for policy 1, policy_version 1187313 (0.0008) [2023-12-28 03:46:11,161][106225] Updated weights for policy 1, policy_version 1187323 (0.0009) [2023-12-28 03:46:11,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 607232000. Throughput: 0: 9778.0, 1: 10215.5. Samples: 607208924. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:11,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.489')] [2023-12-28 03:46:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001184280_303235072.pth... [2023-12-28 03:46:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001183160_302948352.pth [2023-12-28 03:46:11,221][106225] Updated weights for policy 1, policy_version 1187333 (0.0008) [2023-12-28 03:46:11,239][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001187336_304005120.pth... [2023-12-28 03:46:11,243][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001186152_303702016.pth [2023-12-28 03:46:11,303][106226] Updated weights for policy 0, policy_version 1184282 (0.0005) [2023-12-28 03:46:11,375][106226] Updated weights for policy 0, policy_version 1184292 (0.0008) [2023-12-28 03:46:11,440][106226] Updated weights for policy 0, policy_version 1184302 (0.0008) [2023-12-28 03:46:11,502][106226] Updated weights for policy 0, policy_version 1184312 (0.0008) [2023-12-28 03:46:12,060][106225] Updated weights for policy 1, policy_version 1187343 (0.0008) [2023-12-28 03:46:12,129][106225] Updated weights for policy 1, policy_version 1187353 (0.0008) [2023-12-28 03:46:12,194][106225] Updated weights for policy 1, policy_version 1187363 (0.0008) [2023-12-28 03:46:12,197][106226] Updated weights for policy 0, policy_version 1184322 (0.0007) [2023-12-28 03:46:12,257][106226] Updated weights for policy 0, policy_version 1184332 (0.0007) [2023-12-28 03:46:12,324][106226] Updated weights for policy 0, policy_version 1184342 (0.0007) [2023-12-28 03:46:12,958][106225] Updated weights for policy 1, policy_version 1187373 (0.0008) [2023-12-28 03:46:13,018][106225] Updated weights for policy 1, policy_version 1187383 (0.0008) [2023-12-28 03:46:13,051][106226] Updated weights for policy 0, policy_version 1184352 (0.0006) [2023-12-28 03:46:13,072][106225] Updated weights for policy 1, policy_version 1187393 (0.0008) [2023-12-28 03:46:13,121][106226] Updated weights for policy 0, policy_version 1184362 (0.0006) [2023-12-28 03:46:13,187][106226] Updated weights for policy 0, policy_version 1184372 (0.0005) [2023-12-28 03:46:13,806][106225] Updated weights for policy 1, policy_version 1187403 (0.0007) [2023-12-28 03:46:13,816][106226] Updated weights for policy 0, policy_version 1184382 (0.0008) [2023-12-28 03:46:13,865][106226] Updated weights for policy 0, policy_version 1184392 (0.0009) [2023-12-28 03:46:13,870][106225] Updated weights for policy 1, policy_version 1187413 (0.0006) [2023-12-28 03:46:13,914][106226] Updated weights for policy 0, policy_version 1184402 (0.0006) [2023-12-28 03:46:13,934][106225] Updated weights for policy 1, policy_version 1187423 (0.0007) [2023-12-28 03:46:14,601][106226] Updated weights for policy 0, policy_version 1184412 (0.0007) [2023-12-28 03:46:14,633][106225] Updated weights for policy 1, policy_version 1187433 (0.0009) [2023-12-28 03:46:14,651][106226] Updated weights for policy 0, policy_version 1184422 (0.0007) [2023-12-28 03:46:14,696][106225] Updated weights for policy 1, policy_version 1187443 (0.0008) [2023-12-28 03:46:14,704][106226] Updated weights for policy 0, policy_version 1184432 (0.0007) [2023-12-28 03:46:14,753][106225] Updated weights for policy 1, policy_version 1187453 (0.0006) [2023-12-28 03:46:14,823][106225] Updated weights for policy 1, policy_version 1187463 (0.0010) [2023-12-28 03:46:15,381][106226] Updated weights for policy 0, policy_version 1184442 (0.0007) [2023-12-28 03:46:15,441][106226] Updated weights for policy 0, policy_version 1184452 (0.0006) [2023-12-28 03:46:15,503][106226] Updated weights for policy 0, policy_version 1184462 (0.0007) [2023-12-28 03:46:15,560][106226] Updated weights for policy 0, policy_version 1184472 (0.0008) [2023-12-28 03:46:15,593][106225] Updated weights for policy 1, policy_version 1187473 (0.0008) [2023-12-28 03:46:15,649][106225] Updated weights for policy 1, policy_version 1187483 (0.0009) [2023-12-28 03:46:15,701][106225] Updated weights for policy 1, policy_version 1187493 (0.0009) [2023-12-28 03:46:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 607330304. Throughput: 0: 9775.9, 1: 10057.5. Samples: 607323492. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:16,175][105115] Avg episode reward: [(0, '-4.917'), (1, '-4.862')] [2023-12-28 03:46:16,235][106226] Updated weights for policy 0, policy_version 1184482 (0.0008) [2023-12-28 03:46:16,289][106226] Updated weights for policy 0, policy_version 1184492 (0.0008) [2023-12-28 03:46:16,348][106226] Updated weights for policy 0, policy_version 1184502 (0.0008) [2023-12-28 03:46:16,395][106225] Updated weights for policy 1, policy_version 1187503 (0.0007) [2023-12-28 03:46:16,456][106225] Updated weights for policy 1, policy_version 1187513 (0.0007) [2023-12-28 03:46:16,515][106225] Updated weights for policy 1, policy_version 1187523 (0.0008) [2023-12-28 03:46:17,080][106226] Updated weights for policy 0, policy_version 1184512 (0.0007) [2023-12-28 03:46:17,130][106226] Updated weights for policy 0, policy_version 1184522 (0.0008) [2023-12-28 03:46:17,174][106226] Updated weights for policy 0, policy_version 1184532 (0.0007) [2023-12-28 03:46:17,234][106225] Updated weights for policy 1, policy_version 1187533 (0.0010) [2023-12-28 03:46:17,293][106225] Updated weights for policy 1, policy_version 1187543 (0.0010) [2023-12-28 03:46:17,355][106225] Updated weights for policy 1, policy_version 1187553 (0.0010) [2023-12-28 03:46:17,960][106226] Updated weights for policy 0, policy_version 1184542 (0.0009) [2023-12-28 03:46:17,991][106225] Updated weights for policy 1, policy_version 1187563 (0.0009) [2023-12-28 03:46:18,017][106226] Updated weights for policy 0, policy_version 1184552 (0.0007) [2023-12-28 03:46:18,046][106225] Updated weights for policy 1, policy_version 1187573 (0.0005) [2023-12-28 03:46:18,080][106226] Updated weights for policy 0, policy_version 1184562 (0.0007) [2023-12-28 03:46:18,101][106225] Updated weights for policy 1, policy_version 1187583 (0.0009) [2023-12-28 03:46:18,748][106225] Updated weights for policy 1, policy_version 1187593 (0.0010) [2023-12-28 03:46:18,800][106225] Updated weights for policy 1, policy_version 1187603 (0.0008) [2023-12-28 03:46:18,854][106225] Updated weights for policy 1, policy_version 1187613 (0.0007) [2023-12-28 03:46:18,858][106226] Updated weights for policy 0, policy_version 1184572 (0.0007) [2023-12-28 03:46:18,913][106225] Updated weights for policy 1, policy_version 1187623 (0.0006) [2023-12-28 03:46:18,916][106226] Updated weights for policy 0, policy_version 1184582 (0.0006) [2023-12-28 03:46:18,980][106226] Updated weights for policy 0, policy_version 1184592 (0.0009) [2023-12-28 03:46:19,627][106225] Updated weights for policy 1, policy_version 1187633 (0.0008) [2023-12-28 03:46:19,689][106225] Updated weights for policy 1, policy_version 1187643 (0.0008) [2023-12-28 03:46:19,753][106225] Updated weights for policy 1, policy_version 1187653 (0.0008) [2023-12-28 03:46:19,782][106226] Updated weights for policy 0, policy_version 1184602 (0.0009) [2023-12-28 03:46:19,855][106226] Updated weights for policy 0, policy_version 1184612 (0.0007) [2023-12-28 03:46:19,923][106226] Updated weights for policy 0, policy_version 1184622 (0.0007) [2023-12-28 03:46:19,987][106226] Updated weights for policy 0, policy_version 1184632 (0.0009) [2023-12-28 03:46:20,495][106225] Updated weights for policy 1, policy_version 1187663 (0.0008) [2023-12-28 03:46:20,556][106225] Updated weights for policy 1, policy_version 1187673 (0.0008) [2023-12-28 03:46:20,622][106225] Updated weights for policy 1, policy_version 1187683 (0.0008) [2023-12-28 03:46:20,739][106226] Updated weights for policy 0, policy_version 1184642 (0.0008) [2023-12-28 03:46:20,806][106226] Updated weights for policy 0, policy_version 1184652 (0.0008) [2023-12-28 03:46:20,864][106226] Updated weights for policy 0, policy_version 1184662 (0.0008) [2023-12-28 03:46:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 607428608. Throughput: 0: 9697.7, 1: 10011.6. Samples: 607437780. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:21,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.954')] [2023-12-28 03:46:21,317][106225] Updated weights for policy 1, policy_version 1187693 (0.0007) [2023-12-28 03:46:21,389][106225] Updated weights for policy 1, policy_version 1187703 (0.0008) [2023-12-28 03:46:21,452][106225] Updated weights for policy 1, policy_version 1187713 (0.0007) [2023-12-28 03:46:21,659][106226] Updated weights for policy 0, policy_version 1184672 (0.0008) [2023-12-28 03:46:21,715][106226] Updated weights for policy 0, policy_version 1184682 (0.0009) [2023-12-28 03:46:21,780][106226] Updated weights for policy 0, policy_version 1184692 (0.0008) [2023-12-28 03:46:22,210][106225] Updated weights for policy 1, policy_version 1187723 (0.0007) [2023-12-28 03:46:22,269][106225] Updated weights for policy 1, policy_version 1187733 (0.0007) [2023-12-28 03:46:22,334][106225] Updated weights for policy 1, policy_version 1187743 (0.0008) [2023-12-28 03:46:22,465][106226] Updated weights for policy 0, policy_version 1184702 (0.0006) [2023-12-28 03:46:22,527][106226] Updated weights for policy 0, policy_version 1184712 (0.0006) [2023-12-28 03:46:22,589][106226] Updated weights for policy 0, policy_version 1184722 (0.0006) [2023-12-28 03:46:23,084][106225] Updated weights for policy 1, policy_version 1187753 (0.0008) [2023-12-28 03:46:23,142][106225] Updated weights for policy 1, policy_version 1187763 (0.0009) [2023-12-28 03:46:23,190][106226] Updated weights for policy 0, policy_version 1184732 (0.0006) [2023-12-28 03:46:23,194][106225] Updated weights for policy 1, policy_version 1187773 (0.0008) [2023-12-28 03:46:23,242][106226] Updated weights for policy 0, policy_version 1184742 (0.0005) [2023-12-28 03:46:23,244][106225] Updated weights for policy 1, policy_version 1187783 (0.0007) [2023-12-28 03:46:23,289][106226] Updated weights for policy 0, policy_version 1184752 (0.0007) [2023-12-28 03:46:24,010][106226] Updated weights for policy 0, policy_version 1184762 (0.0007) [2023-12-28 03:46:24,028][106225] Updated weights for policy 1, policy_version 1187793 (0.0007) [2023-12-28 03:46:24,063][106226] Updated weights for policy 0, policy_version 1184772 (0.0005) [2023-12-28 03:46:24,080][106225] Updated weights for policy 1, policy_version 1187803 (0.0008) [2023-12-28 03:46:24,124][106226] Updated weights for policy 0, policy_version 1184782 (0.0006) [2023-12-28 03:46:24,130][106225] Updated weights for policy 1, policy_version 1187813 (0.0007) [2023-12-28 03:46:24,194][106226] Updated weights for policy 0, policy_version 1184792 (0.0007) [2023-12-28 03:46:24,782][106226] Updated weights for policy 0, policy_version 1184802 (0.0009) [2023-12-28 03:46:24,832][106226] Updated weights for policy 0, policy_version 1184812 (0.0009) [2023-12-28 03:46:24,888][106226] Updated weights for policy 0, policy_version 1184822 (0.0009) [2023-12-28 03:46:24,926][106225] Updated weights for policy 1, policy_version 1187823 (0.0007) [2023-12-28 03:46:24,971][106225] Updated weights for policy 1, policy_version 1187833 (0.0008) [2023-12-28 03:46:25,030][106225] Updated weights for policy 1, policy_version 1187844 (0.0008) [2023-12-28 03:46:25,520][106226] Updated weights for policy 0, policy_version 1184832 (0.0007) [2023-12-28 03:46:25,582][106226] Updated weights for policy 0, policy_version 1184842 (0.0010) [2023-12-28 03:46:25,646][106226] Updated weights for policy 0, policy_version 1184852 (0.0006) [2023-12-28 03:46:25,650][106225] Updated weights for policy 1, policy_version 1187854 (0.0006) [2023-12-28 03:46:25,715][106225] Updated weights for policy 1, policy_version 1187864 (0.0008) [2023-12-28 03:46:25,780][106225] Updated weights for policy 1, policy_version 1187874 (0.0010) [2023-12-28 03:46:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 607526912. Throughput: 0: 9688.7, 1: 9967.1. Samples: 607496668. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:26,176][105115] Avg episode reward: [(0, '-4.639'), (1, '-5.023')] [2023-12-28 03:46:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001187880_304144384.pth... [2023-12-28 03:46:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001184856_303382528.pth... [2023-12-28 03:46:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001186760_303857664.pth [2023-12-28 03:46:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001183736_303095808.pth [2023-12-28 03:46:26,310][106226] Updated weights for policy 0, policy_version 1184862 (0.0009) [2023-12-28 03:46:26,368][106225] Updated weights for policy 1, policy_version 1187884 (0.0008) [2023-12-28 03:46:26,375][106226] Updated weights for policy 0, policy_version 1184872 (0.0010) [2023-12-28 03:46:26,432][106225] Updated weights for policy 1, policy_version 1187894 (0.0008) [2023-12-28 03:46:26,432][106226] Updated weights for policy 0, policy_version 1184882 (0.0010) [2023-12-28 03:46:26,480][106225] Updated weights for policy 1, policy_version 1187904 (0.0008) [2023-12-28 03:46:27,095][106226] Updated weights for policy 0, policy_version 1184892 (0.0008) [2023-12-28 03:46:27,134][106225] Updated weights for policy 1, policy_version 1187914 (0.0009) [2023-12-28 03:46:27,153][106226] Updated weights for policy 0, policy_version 1184902 (0.0005) [2023-12-28 03:46:27,191][106225] Updated weights for policy 1, policy_version 1187924 (0.0010) [2023-12-28 03:46:27,207][106226] Updated weights for policy 0, policy_version 1184912 (0.0005) [2023-12-28 03:46:27,243][106225] Updated weights for policy 1, policy_version 1187934 (0.0010) [2023-12-28 03:46:27,302][106225] Updated weights for policy 1, policy_version 1187944 (0.0010) [2023-12-28 03:46:27,779][106226] Updated weights for policy 0, policy_version 1184922 (0.0006) [2023-12-28 03:46:27,826][106226] Updated weights for policy 0, policy_version 1184932 (0.0010) [2023-12-28 03:46:27,871][106226] Updated weights for policy 0, policy_version 1184942 (0.0009) [2023-12-28 03:46:27,895][106225] Updated weights for policy 1, policy_version 1187954 (0.0005) [2023-12-28 03:46:27,917][106226] Updated weights for policy 0, policy_version 1184952 (0.0005) [2023-12-28 03:46:27,943][106225] Updated weights for policy 1, policy_version 1187964 (0.0010) [2023-12-28 03:46:27,995][106225] Updated weights for policy 1, policy_version 1187974 (0.0010) [2023-12-28 03:46:28,622][106226] Updated weights for policy 0, policy_version 1184962 (0.0011) [2023-12-28 03:46:28,678][106226] Updated weights for policy 0, policy_version 1184972 (0.0010) [2023-12-28 03:46:28,722][106225] Updated weights for policy 1, policy_version 1187984 (0.0009) [2023-12-28 03:46:28,736][106226] Updated weights for policy 0, policy_version 1184982 (0.0010) [2023-12-28 03:46:28,784][106225] Updated weights for policy 1, policy_version 1187994 (0.0007) [2023-12-28 03:46:28,841][106225] Updated weights for policy 1, policy_version 1188004 (0.0008) [2023-12-28 03:46:29,472][106226] Updated weights for policy 0, policy_version 1184992 (0.0010) [2023-12-28 03:46:29,527][106226] Updated weights for policy 0, policy_version 1185002 (0.0011) [2023-12-28 03:46:29,557][106225] Updated weights for policy 1, policy_version 1188014 (0.0007) [2023-12-28 03:46:29,579][106226] Updated weights for policy 0, policy_version 1185012 (0.0010) [2023-12-28 03:46:29,615][106225] Updated weights for policy 1, policy_version 1188024 (0.0006) [2023-12-28 03:46:29,669][106225] Updated weights for policy 1, policy_version 1188034 (0.0007) [2023-12-28 03:46:30,301][106226] Updated weights for policy 0, policy_version 1185022 (0.0009) [2023-12-28 03:46:30,355][106225] Updated weights for policy 1, policy_version 1188044 (0.0007) [2023-12-28 03:46:30,363][106226] Updated weights for policy 0, policy_version 1185032 (0.0008) [2023-12-28 03:46:30,405][106225] Updated weights for policy 1, policy_version 1188054 (0.0005) [2023-12-28 03:46:30,423][106226] Updated weights for policy 0, policy_version 1185042 (0.0008) [2023-12-28 03:46:30,458][106225] Updated weights for policy 1, policy_version 1188064 (0.0005) [2023-12-28 03:46:31,052][106226] Updated weights for policy 0, policy_version 1185052 (0.0008) [2023-12-28 03:46:31,092][106225] Updated weights for policy 1, policy_version 1188074 (0.0007) [2023-12-28 03:46:31,116][106226] Updated weights for policy 0, policy_version 1185062 (0.0006) [2023-12-28 03:46:31,155][106225] Updated weights for policy 1, policy_version 1188084 (0.0008) [2023-12-28 03:46:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 607625216. Throughput: 0: 9881.0, 1: 9955.6. Samples: 607620820. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:31,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.890')] [2023-12-28 03:46:31,184][106226] Updated weights for policy 0, policy_version 1185072 (0.0007) [2023-12-28 03:46:31,215][106225] Updated weights for policy 1, policy_version 1188094 (0.0007) [2023-12-28 03:46:31,279][106225] Updated weights for policy 1, policy_version 1188104 (0.0009) [2023-12-28 03:46:31,978][106225] Updated weights for policy 1, policy_version 1188114 (0.0006) [2023-12-28 03:46:31,995][106226] Updated weights for policy 0, policy_version 1185082 (0.0005) [2023-12-28 03:46:32,041][106225] Updated weights for policy 1, policy_version 1188124 (0.0006) [2023-12-28 03:46:32,049][106226] Updated weights for policy 0, policy_version 1185092 (0.0005) [2023-12-28 03:46:32,096][106225] Updated weights for policy 1, policy_version 1188134 (0.0007) [2023-12-28 03:46:32,099][106226] Updated weights for policy 0, policy_version 1185102 (0.0007) [2023-12-28 03:46:32,152][106226] Updated weights for policy 0, policy_version 1185112 (0.0008) [2023-12-28 03:46:32,741][106225] Updated weights for policy 1, policy_version 1188144 (0.0007) [2023-12-28 03:46:32,803][106225] Updated weights for policy 1, policy_version 1188154 (0.0006) [2023-12-28 03:46:32,854][106225] Updated weights for policy 1, policy_version 1188164 (0.0005) [2023-12-28 03:46:32,862][106226] Updated weights for policy 0, policy_version 1185122 (0.0008) [2023-12-28 03:46:32,931][106226] Updated weights for policy 0, policy_version 1185132 (0.0009) [2023-12-28 03:46:32,988][106226] Updated weights for policy 0, policy_version 1185142 (0.0008) [2023-12-28 03:46:33,505][106225] Updated weights for policy 1, policy_version 1188174 (0.0008) [2023-12-28 03:46:33,552][106225] Updated weights for policy 1, policy_version 1188184 (0.0008) [2023-12-28 03:46:33,604][106225] Updated weights for policy 1, policy_version 1188194 (0.0008) [2023-12-28 03:46:33,632][106226] Updated weights for policy 0, policy_version 1185152 (0.0007) [2023-12-28 03:46:33,678][106226] Updated weights for policy 0, policy_version 1185162 (0.0005) [2023-12-28 03:46:33,728][106226] Updated weights for policy 0, policy_version 1185172 (0.0005) [2023-12-28 03:46:34,375][106225] Updated weights for policy 1, policy_version 1188204 (0.0007) [2023-12-28 03:46:34,411][106226] Updated weights for policy 0, policy_version 1185182 (0.0009) [2023-12-28 03:46:34,435][106225] Updated weights for policy 1, policy_version 1188214 (0.0007) [2023-12-28 03:46:34,479][106226] Updated weights for policy 0, policy_version 1185192 (0.0009) [2023-12-28 03:46:34,500][106225] Updated weights for policy 1, policy_version 1188224 (0.0007) [2023-12-28 03:46:34,540][106226] Updated weights for policy 0, policy_version 1185202 (0.0008) [2023-12-28 03:46:35,196][106226] Updated weights for policy 0, policy_version 1185212 (0.0007) [2023-12-28 03:46:35,251][106226] Updated weights for policy 0, policy_version 1185222 (0.0005) [2023-12-28 03:46:35,262][106225] Updated weights for policy 1, policy_version 1188234 (0.0006) [2023-12-28 03:46:35,301][106226] Updated weights for policy 0, policy_version 1185232 (0.0005) [2023-12-28 03:46:35,311][106225] Updated weights for policy 1, policy_version 1188244 (0.0008) [2023-12-28 03:46:35,357][106225] Updated weights for policy 1, policy_version 1188254 (0.0008) [2023-12-28 03:46:35,407][106225] Updated weights for policy 1, policy_version 1188264 (0.0006) [2023-12-28 03:46:35,978][106226] Updated weights for policy 0, policy_version 1185242 (0.0007) [2023-12-28 03:46:36,041][106226] Updated weights for policy 0, policy_version 1185252 (0.0010) [2023-12-28 03:46:36,118][106226] Updated weights for policy 0, policy_version 1185262 (0.0006) [2023-12-28 03:46:36,155][106225] Updated weights for policy 1, policy_version 1188274 (0.0008) [2023-12-28 03:46:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 607723520. Throughput: 0: 9846.5, 1: 9867.8. Samples: 607741320. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:36,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-5.025')] [2023-12-28 03:46:36,188][106226] Updated weights for policy 0, policy_version 1185272 (0.0007) [2023-12-28 03:46:36,217][106225] Updated weights for policy 1, policy_version 1188284 (0.0008) [2023-12-28 03:46:36,277][106225] Updated weights for policy 1, policy_version 1188294 (0.0008) [2023-12-28 03:46:36,881][106226] Updated weights for policy 0, policy_version 1185282 (0.0009) [2023-12-28 03:46:36,945][106226] Updated weights for policy 0, policy_version 1185292 (0.0007) [2023-12-28 03:46:37,001][106225] Updated weights for policy 1, policy_version 1188304 (0.0006) [2023-12-28 03:46:37,007][106226] Updated weights for policy 0, policy_version 1185302 (0.0007) [2023-12-28 03:46:37,061][106225] Updated weights for policy 1, policy_version 1188314 (0.0005) [2023-12-28 03:46:37,122][106225] Updated weights for policy 1, policy_version 1188324 (0.0005) [2023-12-28 03:46:37,616][106226] Updated weights for policy 0, policy_version 1185312 (0.0010) [2023-12-28 03:46:37,666][106226] Updated weights for policy 0, policy_version 1185322 (0.0008) [2023-12-28 03:46:37,710][106225] Updated weights for policy 1, policy_version 1188334 (0.0006) [2023-12-28 03:46:37,726][106226] Updated weights for policy 0, policy_version 1185332 (0.0007) [2023-12-28 03:46:37,764][106225] Updated weights for policy 1, policy_version 1188344 (0.0008) [2023-12-28 03:46:37,824][106225] Updated weights for policy 1, policy_version 1188354 (0.0009) [2023-12-28 03:46:38,315][106226] Updated weights for policy 0, policy_version 1185342 (0.0006) [2023-12-28 03:46:38,386][106226] Updated weights for policy 0, policy_version 1185352 (0.0009) [2023-12-28 03:46:38,400][106225] Updated weights for policy 1, policy_version 1188364 (0.0007) [2023-12-28 03:46:38,451][106226] Updated weights for policy 0, policy_version 1185362 (0.0009) [2023-12-28 03:46:38,461][106225] Updated weights for policy 1, policy_version 1188374 (0.0008) [2023-12-28 03:46:38,520][106225] Updated weights for policy 1, policy_version 1188384 (0.0008) [2023-12-28 03:46:39,099][106226] Updated weights for policy 0, policy_version 1185372 (0.0007) [2023-12-28 03:46:39,153][106226] Updated weights for policy 0, policy_version 1185382 (0.0005) [2023-12-28 03:46:39,203][106226] Updated weights for policy 0, policy_version 1185392 (0.0006) [2023-12-28 03:46:39,242][106225] Updated weights for policy 1, policy_version 1188394 (0.0008) [2023-12-28 03:46:39,304][106225] Updated weights for policy 1, policy_version 1188404 (0.0008) [2023-12-28 03:46:39,368][106225] Updated weights for policy 1, policy_version 1188414 (0.0009) [2023-12-28 03:46:39,431][106225] Updated weights for policy 1, policy_version 1188424 (0.0009) [2023-12-28 03:46:39,959][106226] Updated weights for policy 0, policy_version 1185402 (0.0009) [2023-12-28 03:46:40,030][106226] Updated weights for policy 0, policy_version 1185412 (0.0008) [2023-12-28 03:46:40,086][106226] Updated weights for policy 0, policy_version 1185422 (0.0009) [2023-12-28 03:46:40,145][106226] Updated weights for policy 0, policy_version 1185432 (0.0007) [2023-12-28 03:46:40,175][106225] Updated weights for policy 1, policy_version 1188434 (0.0009) [2023-12-28 03:46:40,242][106225] Updated weights for policy 1, policy_version 1188444 (0.0009) [2023-12-28 03:46:40,303][106225] Updated weights for policy 1, policy_version 1188454 (0.0008) [2023-12-28 03:46:40,827][106226] Updated weights for policy 0, policy_version 1185442 (0.0010) [2023-12-28 03:46:40,890][106226] Updated weights for policy 0, policy_version 1185452 (0.0009) [2023-12-28 03:46:40,943][106226] Updated weights for policy 0, policy_version 1185462 (0.0010) [2023-12-28 03:46:41,064][106225] Updated weights for policy 1, policy_version 1188464 (0.0009) [2023-12-28 03:46:41,133][106225] Updated weights for policy 1, policy_version 1188474 (0.0009) [2023-12-28 03:46:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 607830016. Throughput: 0: 9906.6, 1: 9915.1. Samples: 607805252. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:41,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-5.117')] [2023-12-28 03:46:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001185464_303538176.pth... [2023-12-28 03:46:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001184280_303235072.pth [2023-12-28 03:46:41,200][106225] Updated weights for policy 1, policy_version 1188484 (0.0008) [2023-12-28 03:46:41,226][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001188488_304300032.pth... [2023-12-28 03:46:41,231][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001187336_304005120.pth [2023-12-28 03:46:41,668][106226] Updated weights for policy 0, policy_version 1185472 (0.0009) [2023-12-28 03:46:41,729][106226] Updated weights for policy 0, policy_version 1185482 (0.0008) [2023-12-28 03:46:41,796][106226] Updated weights for policy 0, policy_version 1185492 (0.0007) [2023-12-28 03:46:41,999][106225] Updated weights for policy 1, policy_version 1188494 (0.0007) [2023-12-28 03:46:42,060][106225] Updated weights for policy 1, policy_version 1188504 (0.0009) [2023-12-28 03:46:42,121][106225] Updated weights for policy 1, policy_version 1188514 (0.0008) [2023-12-28 03:46:42,519][106226] Updated weights for policy 0, policy_version 1185502 (0.0007) [2023-12-28 03:46:42,571][106226] Updated weights for policy 0, policy_version 1185512 (0.0008) [2023-12-28 03:46:42,623][106226] Updated weights for policy 0, policy_version 1185522 (0.0008) [2023-12-28 03:46:42,850][106225] Updated weights for policy 1, policy_version 1188524 (0.0009) [2023-12-28 03:46:42,902][106225] Updated weights for policy 1, policy_version 1188534 (0.0011) [2023-12-28 03:46:42,966][106225] Updated weights for policy 1, policy_version 1188544 (0.0011) [2023-12-28 03:46:43,329][106226] Updated weights for policy 0, policy_version 1185532 (0.0006) [2023-12-28 03:46:43,394][106226] Updated weights for policy 0, policy_version 1185542 (0.0005) [2023-12-28 03:46:43,452][106226] Updated weights for policy 0, policy_version 1185552 (0.0006) [2023-12-28 03:46:43,673][106225] Updated weights for policy 1, policy_version 1188554 (0.0009) [2023-12-28 03:46:43,735][106225] Updated weights for policy 1, policy_version 1188564 (0.0009) [2023-12-28 03:46:43,795][106225] Updated weights for policy 1, policy_version 1188574 (0.0010) [2023-12-28 03:46:43,851][106225] Updated weights for policy 1, policy_version 1188584 (0.0010) [2023-12-28 03:46:44,015][106226] Updated weights for policy 0, policy_version 1185562 (0.0006) [2023-12-28 03:46:44,079][106226] Updated weights for policy 0, policy_version 1185572 (0.0008) [2023-12-28 03:46:44,136][106226] Updated weights for policy 0, policy_version 1185582 (0.0006) [2023-12-28 03:46:44,193][106226] Updated weights for policy 0, policy_version 1185592 (0.0007) [2023-12-28 03:46:44,541][106225] Updated weights for policy 1, policy_version 1188594 (0.0007) [2023-12-28 03:46:44,598][106225] Updated weights for policy 1, policy_version 1188604 (0.0008) [2023-12-28 03:46:44,651][106225] Updated weights for policy 1, policy_version 1188614 (0.0006) [2023-12-28 03:46:44,817][106226] Updated weights for policy 0, policy_version 1185602 (0.0009) [2023-12-28 03:46:44,877][106226] Updated weights for policy 0, policy_version 1185612 (0.0011) [2023-12-28 03:46:44,939][106226] Updated weights for policy 0, policy_version 1185622 (0.0010) [2023-12-28 03:46:45,322][106225] Updated weights for policy 1, policy_version 1188624 (0.0010) [2023-12-28 03:46:45,377][106225] Updated weights for policy 1, policy_version 1188634 (0.0011) [2023-12-28 03:46:45,439][106225] Updated weights for policy 1, policy_version 1188644 (0.0010) [2023-12-28 03:46:45,661][106226] Updated weights for policy 0, policy_version 1185632 (0.0009) [2023-12-28 03:46:45,710][106226] Updated weights for policy 0, policy_version 1185642 (0.0008) [2023-12-28 03:46:45,762][106226] Updated weights for policy 0, policy_version 1185652 (0.0008) [2023-12-28 03:46:46,089][106225] Updated weights for policy 1, policy_version 1188654 (0.0007) [2023-12-28 03:46:46,146][106225] Updated weights for policy 1, policy_version 1188664 (0.0008) [2023-12-28 03:46:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 607928320. Throughput: 0: 9922.6, 1: 9821.8. Samples: 607921728. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:46,176][105115] Avg episode reward: [(0, '-4.909'), (1, '-5.423')] [2023-12-28 03:46:46,198][106225] Updated weights for policy 1, policy_version 1188674 (0.0010) [2023-12-28 03:46:46,491][106226] Updated weights for policy 0, policy_version 1185662 (0.0010) [2023-12-28 03:46:46,548][106226] Updated weights for policy 0, policy_version 1185672 (0.0010) [2023-12-28 03:46:46,602][106226] Updated weights for policy 0, policy_version 1185682 (0.0011) [2023-12-28 03:46:46,803][106225] Updated weights for policy 1, policy_version 1188684 (0.0010) [2023-12-28 03:46:46,853][106225] Updated weights for policy 1, policy_version 1188694 (0.0010) [2023-12-28 03:46:46,911][106225] Updated weights for policy 1, policy_version 1188704 (0.0009) [2023-12-28 03:46:47,292][106226] Updated weights for policy 0, policy_version 1185692 (0.0010) [2023-12-28 03:46:47,339][106226] Updated weights for policy 0, policy_version 1185702 (0.0008) [2023-12-28 03:46:47,392][106226] Updated weights for policy 0, policy_version 1185712 (0.0007) [2023-12-28 03:46:47,537][106225] Updated weights for policy 1, policy_version 1188714 (0.0010) [2023-12-28 03:46:47,583][106225] Updated weights for policy 1, policy_version 1188724 (0.0010) [2023-12-28 03:46:47,635][106225] Updated weights for policy 1, policy_version 1188734 (0.0010) [2023-12-28 03:46:47,688][106225] Updated weights for policy 1, policy_version 1188744 (0.0010) [2023-12-28 03:46:47,969][106226] Updated weights for policy 0, policy_version 1185722 (0.0006) [2023-12-28 03:46:48,025][106226] Updated weights for policy 0, policy_version 1185732 (0.0005) [2023-12-28 03:46:48,084][106226] Updated weights for policy 0, policy_version 1185742 (0.0008) [2023-12-28 03:46:48,140][106226] Updated weights for policy 0, policy_version 1185752 (0.0008) [2023-12-28 03:46:48,394][106225] Updated weights for policy 1, policy_version 1188754 (0.0007) [2023-12-28 03:46:48,455][106225] Updated weights for policy 1, policy_version 1188764 (0.0007) [2023-12-28 03:46:48,519][106225] Updated weights for policy 1, policy_version 1188774 (0.0006) [2023-12-28 03:46:48,775][106226] Updated weights for policy 0, policy_version 1185762 (0.0005) [2023-12-28 03:46:48,842][106226] Updated weights for policy 0, policy_version 1185772 (0.0006) [2023-12-28 03:46:48,910][106226] Updated weights for policy 0, policy_version 1185782 (0.0006) [2023-12-28 03:46:49,272][106225] Updated weights for policy 1, policy_version 1188784 (0.0008) [2023-12-28 03:46:49,336][106225] Updated weights for policy 1, policy_version 1188794 (0.0009) [2023-12-28 03:46:49,400][106225] Updated weights for policy 1, policy_version 1188804 (0.0007) [2023-12-28 03:46:49,449][106226] Updated weights for policy 0, policy_version 1185792 (0.0008) [2023-12-28 03:46:49,502][106226] Updated weights for policy 0, policy_version 1185802 (0.0008) [2023-12-28 03:46:49,557][106226] Updated weights for policy 0, policy_version 1185812 (0.0008) [2023-12-28 03:46:50,139][106225] Updated weights for policy 1, policy_version 1188814 (0.0010) [2023-12-28 03:46:50,204][106225] Updated weights for policy 1, policy_version 1188824 (0.0009) [2023-12-28 03:46:50,264][106225] Updated weights for policy 1, policy_version 1188834 (0.0008) [2023-12-28 03:46:50,306][106226] Updated weights for policy 0, policy_version 1185822 (0.0009) [2023-12-28 03:46:50,372][106226] Updated weights for policy 0, policy_version 1185832 (0.0007) [2023-12-28 03:46:50,431][106226] Updated weights for policy 0, policy_version 1185842 (0.0007) [2023-12-28 03:46:50,950][106225] Updated weights for policy 1, policy_version 1188844 (0.0008) [2023-12-28 03:46:51,007][106225] Updated weights for policy 1, policy_version 1188854 (0.0009) [2023-12-28 03:46:51,071][106225] Updated weights for policy 1, policy_version 1188864 (0.0009) [2023-12-28 03:46:51,174][105115] Fps is (10 sec: 20480.8, 60 sec: 19797.4, 300 sec: 19827.5). Total num frames: 608034816. Throughput: 0: 10024.5, 1: 9827.5. Samples: 608044004. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:51,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-5.182')] [2023-12-28 03:46:51,178][106226] Updated weights for policy 0, policy_version 1185852 (0.0006) [2023-12-28 03:46:51,235][106226] Updated weights for policy 0, policy_version 1185862 (0.0005) [2023-12-28 03:46:51,301][106226] Updated weights for policy 0, policy_version 1185872 (0.0008) [2023-12-28 03:46:51,905][106225] Updated weights for policy 1, policy_version 1188874 (0.0009) [2023-12-28 03:46:51,961][106225] Updated weights for policy 1, policy_version 1188884 (0.0009) [2023-12-28 03:46:52,024][106225] Updated weights for policy 1, policy_version 1188894 (0.0009) [2023-12-28 03:46:52,035][106226] Updated weights for policy 0, policy_version 1185882 (0.0005) [2023-12-28 03:46:52,082][106225] Updated weights for policy 1, policy_version 1188904 (0.0007) [2023-12-28 03:46:52,098][106226] Updated weights for policy 0, policy_version 1185892 (0.0010) [2023-12-28 03:46:52,161][106226] Updated weights for policy 0, policy_version 1185902 (0.0008) [2023-12-28 03:46:52,221][106226] Updated weights for policy 0, policy_version 1185912 (0.0008) [2023-12-28 03:46:52,879][106225] Updated weights for policy 1, policy_version 1188914 (0.0008) [2023-12-28 03:46:52,913][106226] Updated weights for policy 0, policy_version 1185922 (0.0010) [2023-12-28 03:46:52,927][106225] Updated weights for policy 1, policy_version 1188924 (0.0005) [2023-12-28 03:46:52,966][106226] Updated weights for policy 0, policy_version 1185932 (0.0010) [2023-12-28 03:46:52,977][106225] Updated weights for policy 1, policy_version 1188934 (0.0006) [2023-12-28 03:46:53,016][106226] Updated weights for policy 0, policy_version 1185942 (0.0010) [2023-12-28 03:46:53,648][106225] Updated weights for policy 1, policy_version 1188944 (0.0009) [2023-12-28 03:46:53,704][106226] Updated weights for policy 0, policy_version 1185952 (0.0008) [2023-12-28 03:46:53,709][106225] Updated weights for policy 1, policy_version 1188954 (0.0008) [2023-12-28 03:46:53,765][106226] Updated weights for policy 0, policy_version 1185962 (0.0010) [2023-12-28 03:46:53,769][106225] Updated weights for policy 1, policy_version 1188964 (0.0007) [2023-12-28 03:46:53,822][106226] Updated weights for policy 0, policy_version 1185972 (0.0008) [2023-12-28 03:46:54,370][106226] Updated weights for policy 0, policy_version 1185982 (0.0006) [2023-12-28 03:46:54,425][106226] Updated weights for policy 0, policy_version 1185992 (0.0005) [2023-12-28 03:46:54,485][106226] Updated weights for policy 0, policy_version 1186002 (0.0005) [2023-12-28 03:46:54,495][106225] Updated weights for policy 1, policy_version 1188974 (0.0009) [2023-12-28 03:46:54,545][106225] Updated weights for policy 1, policy_version 1188984 (0.0010) [2023-12-28 03:46:54,596][106225] Updated weights for policy 1, policy_version 1188994 (0.0010) [2023-12-28 03:46:55,102][106226] Updated weights for policy 0, policy_version 1186012 (0.0007) [2023-12-28 03:46:55,162][106226] Updated weights for policy 0, policy_version 1186022 (0.0010) [2023-12-28 03:46:55,220][106226] Updated weights for policy 0, policy_version 1186032 (0.0010) [2023-12-28 03:46:55,332][106225] Updated weights for policy 1, policy_version 1189004 (0.0010) [2023-12-28 03:46:55,385][106225] Updated weights for policy 1, policy_version 1189014 (0.0010) [2023-12-28 03:46:55,440][106225] Updated weights for policy 1, policy_version 1189024 (0.0010) [2023-12-28 03:46:55,915][106226] Updated weights for policy 0, policy_version 1186042 (0.0010) [2023-12-28 03:46:55,967][106226] Updated weights for policy 0, policy_version 1186052 (0.0010) [2023-12-28 03:46:56,017][106226] Updated weights for policy 0, policy_version 1186062 (0.0010) [2023-12-28 03:46:56,063][106226] Updated weights for policy 0, policy_version 1186072 (0.0010) [2023-12-28 03:46:56,160][106225] Updated weights for policy 1, policy_version 1189034 (0.0010) [2023-12-28 03:46:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 608133120. Throughput: 0: 10067.1, 1: 9786.3. Samples: 608102328. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:46:56,176][105115] Avg episode reward: [(0, '-4.926'), (1, '-4.820')] [2023-12-28 03:46:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001186072_303693824.pth... [2023-12-28 03:46:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001184856_303382528.pth [2023-12-28 03:46:56,214][106225] Updated weights for policy 1, policy_version 1189044 (0.0010) [2023-12-28 03:46:56,267][106225] Updated weights for policy 1, policy_version 1189054 (0.0010) [2023-12-28 03:46:56,321][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001189064_304447488.pth... [2023-12-28 03:46:56,324][106225] Updated weights for policy 1, policy_version 1189064 (0.0010) [2023-12-28 03:46:56,325][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001187880_304144384.pth [2023-12-28 03:46:56,714][106226] Updated weights for policy 0, policy_version 1186082 (0.0010) [2023-12-28 03:46:56,769][106226] Updated weights for policy 0, policy_version 1186092 (0.0010) [2023-12-28 03:46:56,828][106226] Updated weights for policy 0, policy_version 1186102 (0.0010) [2023-12-28 03:46:57,053][106225] Updated weights for policy 1, policy_version 1189074 (0.0010) [2023-12-28 03:46:57,108][106225] Updated weights for policy 1, policy_version 1189084 (0.0010) [2023-12-28 03:46:57,169][106225] Updated weights for policy 1, policy_version 1189094 (0.0010) [2023-12-28 03:46:57,558][106226] Updated weights for policy 0, policy_version 1186112 (0.0010) [2023-12-28 03:46:57,610][106226] Updated weights for policy 0, policy_version 1186122 (0.0010) [2023-12-28 03:46:57,659][106226] Updated weights for policy 0, policy_version 1186132 (0.0010) [2023-12-28 03:46:57,878][106225] Updated weights for policy 1, policy_version 1189104 (0.0010) [2023-12-28 03:46:57,927][106225] Updated weights for policy 1, policy_version 1189114 (0.0009) [2023-12-28 03:46:57,983][106225] Updated weights for policy 1, policy_version 1189124 (0.0010) [2023-12-28 03:46:58,331][106226] Updated weights for policy 0, policy_version 1186142 (0.0009) [2023-12-28 03:46:58,397][106226] Updated weights for policy 0, policy_version 1186152 (0.0008) [2023-12-28 03:46:58,465][106226] Updated weights for policy 0, policy_version 1186162 (0.0008) [2023-12-28 03:46:58,734][106225] Updated weights for policy 1, policy_version 1189134 (0.0010) [2023-12-28 03:46:58,802][106225] Updated weights for policy 1, policy_version 1189144 (0.0009) [2023-12-28 03:46:58,870][106225] Updated weights for policy 1, policy_version 1189154 (0.0014) [2023-12-28 03:46:59,256][106226] Updated weights for policy 0, policy_version 1186172 (0.0007) [2023-12-28 03:46:59,321][106226] Updated weights for policy 0, policy_version 1186182 (0.0008) [2023-12-28 03:46:59,404][106226] Updated weights for policy 0, policy_version 1186193 (0.0009) [2023-12-28 03:46:59,709][106225] Updated weights for policy 1, policy_version 1189164 (0.0009) [2023-12-28 03:46:59,772][106225] Updated weights for policy 1, policy_version 1189174 (0.0010) [2023-12-28 03:46:59,839][106225] Updated weights for policy 1, policy_version 1189184 (0.0010) [2023-12-28 03:47:00,165][106226] Updated weights for policy 0, policy_version 1186203 (0.0008) [2023-12-28 03:47:00,232][106226] Updated weights for policy 0, policy_version 1186213 (0.0008) [2023-12-28 03:47:00,290][106226] Updated weights for policy 0, policy_version 1186223 (0.0008) [2023-12-28 03:47:00,616][106225] Updated weights for policy 1, policy_version 1189194 (0.0009) [2023-12-28 03:47:00,674][106225] Updated weights for policy 1, policy_version 1189204 (0.0007) [2023-12-28 03:47:00,723][106225] Updated weights for policy 1, policy_version 1189214 (0.0007) [2023-12-28 03:47:00,769][106225] Updated weights for policy 1, policy_version 1189224 (0.0007) [2023-12-28 03:47:00,938][106226] Updated weights for policy 0, policy_version 1186233 (0.0008) [2023-12-28 03:47:00,984][106226] Updated weights for policy 0, policy_version 1186243 (0.0008) [2023-12-28 03:47:01,036][106226] Updated weights for policy 0, policy_version 1186253 (0.0008) [2023-12-28 03:47:01,094][106226] Updated weights for policy 0, policy_version 1186263 (0.0008) [2023-12-28 03:47:01,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 608231424. Throughput: 0: 10085.7, 1: 9806.3. Samples: 608218632. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:47:01,175][105115] Avg episode reward: [(0, '-4.873'), (1, '-5.186')] [2023-12-28 03:47:01,540][106225] Updated weights for policy 1, policy_version 1189234 (0.0010) [2023-12-28 03:47:01,597][106225] Updated weights for policy 1, policy_version 1189244 (0.0010) [2023-12-28 03:47:01,658][106225] Updated weights for policy 1, policy_version 1189254 (0.0009) [2023-12-28 03:47:01,858][106226] Updated weights for policy 0, policy_version 1186273 (0.0008) [2023-12-28 03:47:01,907][106226] Updated weights for policy 0, policy_version 1186283 (0.0008) [2023-12-28 03:47:01,957][106226] Updated weights for policy 0, policy_version 1186293 (0.0009) [2023-12-28 03:47:02,404][106225] Updated weights for policy 1, policy_version 1189264 (0.0009) [2023-12-28 03:47:02,460][106225] Updated weights for policy 1, policy_version 1189274 (0.0009) [2023-12-28 03:47:02,519][106225] Updated weights for policy 1, policy_version 1189284 (0.0008) [2023-12-28 03:47:02,731][106226] Updated weights for policy 0, policy_version 1186303 (0.0009) [2023-12-28 03:47:02,794][106226] Updated weights for policy 0, policy_version 1186313 (0.0009) [2023-12-28 03:47:02,842][106226] Updated weights for policy 0, policy_version 1186323 (0.0008) [2023-12-28 03:47:03,250][106225] Updated weights for policy 1, policy_version 1189294 (0.0009) [2023-12-28 03:47:03,304][106225] Updated weights for policy 1, policy_version 1189304 (0.0008) [2023-12-28 03:47:03,351][106225] Updated weights for policy 1, policy_version 1189314 (0.0006) [2023-12-28 03:47:03,442][106226] Updated weights for policy 0, policy_version 1186333 (0.0008) [2023-12-28 03:47:03,500][106226] Updated weights for policy 0, policy_version 1186343 (0.0008) [2023-12-28 03:47:03,558][106226] Updated weights for policy 0, policy_version 1186353 (0.0008) [2023-12-28 03:47:04,076][106225] Updated weights for policy 1, policy_version 1189324 (0.0007) [2023-12-28 03:47:04,140][106225] Updated weights for policy 1, policy_version 1189334 (0.0008) [2023-12-28 03:47:04,229][106225] Updated weights for policy 1, policy_version 1189344 (0.0008) [2023-12-28 03:47:04,291][106226] Updated weights for policy 0, policy_version 1186363 (0.0008) [2023-12-28 03:47:04,356][106226] Updated weights for policy 0, policy_version 1186373 (0.0007) [2023-12-28 03:47:04,418][106226] Updated weights for policy 0, policy_version 1186383 (0.0006) [2023-12-28 03:47:04,975][106225] Updated weights for policy 1, policy_version 1189354 (0.0009) [2023-12-28 03:47:05,025][106226] Updated weights for policy 0, policy_version 1186393 (0.0006) [2023-12-28 03:47:05,034][106225] Updated weights for policy 1, policy_version 1189364 (0.0011) [2023-12-28 03:47:05,086][106226] Updated weights for policy 0, policy_version 1186403 (0.0010) [2023-12-28 03:47:05,088][106225] Updated weights for policy 1, policy_version 1189374 (0.0010) [2023-12-28 03:47:05,146][106226] Updated weights for policy 0, policy_version 1186413 (0.0011) [2023-12-28 03:47:05,149][106225] Updated weights for policy 1, policy_version 1189384 (0.0010) [2023-12-28 03:47:05,209][106226] Updated weights for policy 0, policy_version 1186423 (0.0006) [2023-12-28 03:47:05,788][106226] Updated weights for policy 0, policy_version 1186433 (0.0006) [2023-12-28 03:47:05,822][106225] Updated weights for policy 1, policy_version 1189394 (0.0008) [2023-12-28 03:47:05,850][106226] Updated weights for policy 0, policy_version 1186443 (0.0005) [2023-12-28 03:47:05,882][106225] Updated weights for policy 1, policy_version 1189404 (0.0007) [2023-12-28 03:47:05,902][106226] Updated weights for policy 0, policy_version 1186453 (0.0005) [2023-12-28 03:47:05,950][106225] Updated weights for policy 1, policy_version 1189414 (0.0009) [2023-12-28 03:47:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 608329728. Throughput: 0: 10214.2, 1: 9761.7. Samples: 608336696. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:47:06,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-5.093')] [2023-12-28 03:47:06,508][106226] Updated weights for policy 0, policy_version 1186463 (0.0006) [2023-12-28 03:47:06,564][106226] Updated weights for policy 0, policy_version 1186473 (0.0008) [2023-12-28 03:47:06,633][106226] Updated weights for policy 0, policy_version 1186483 (0.0008) [2023-12-28 03:47:06,683][106225] Updated weights for policy 1, policy_version 1189424 (0.0011) [2023-12-28 03:47:06,745][106225] Updated weights for policy 1, policy_version 1189434 (0.0011) [2023-12-28 03:47:06,803][106225] Updated weights for policy 1, policy_version 1189444 (0.0010) [2023-12-28 03:47:07,394][106226] Updated weights for policy 0, policy_version 1186493 (0.0008) [2023-12-28 03:47:07,439][106225] Updated weights for policy 1, policy_version 1189454 (0.0007) [2023-12-28 03:47:07,464][106226] Updated weights for policy 0, policy_version 1186503 (0.0009) [2023-12-28 03:47:07,496][106225] Updated weights for policy 1, policy_version 1189464 (0.0006) [2023-12-28 03:47:07,526][106226] Updated weights for policy 0, policy_version 1186513 (0.0008) [2023-12-28 03:47:07,562][106225] Updated weights for policy 1, policy_version 1189474 (0.0005) [2023-12-28 03:47:08,134][106225] Updated weights for policy 1, policy_version 1189484 (0.0006) [2023-12-28 03:47:08,189][106225] Updated weights for policy 1, policy_version 1189494 (0.0008) [2023-12-28 03:47:08,235][106226] Updated weights for policy 0, policy_version 1186523 (0.0008) [2023-12-28 03:47:08,256][106225] Updated weights for policy 1, policy_version 1189504 (0.0010) [2023-12-28 03:47:08,295][106226] Updated weights for policy 0, policy_version 1186533 (0.0006) [2023-12-28 03:47:08,363][106226] Updated weights for policy 0, policy_version 1186543 (0.0007) [2023-12-28 03:47:08,999][106225] Updated weights for policy 1, policy_version 1189514 (0.0007) [2023-12-28 03:47:09,024][106226] Updated weights for policy 0, policy_version 1186553 (0.0006) [2023-12-28 03:47:09,053][106225] Updated weights for policy 1, policy_version 1189524 (0.0007) [2023-12-28 03:47:09,072][106226] Updated weights for policy 0, policy_version 1186563 (0.0010) [2023-12-28 03:47:09,104][106225] Updated weights for policy 1, policy_version 1189534 (0.0009) [2023-12-28 03:47:09,126][106226] Updated weights for policy 0, policy_version 1186573 (0.0011) [2023-12-28 03:47:09,158][106225] Updated weights for policy 1, policy_version 1189544 (0.0007) [2023-12-28 03:47:09,183][106226] Updated weights for policy 0, policy_version 1186583 (0.0010) [2023-12-28 03:47:09,856][106226] Updated weights for policy 0, policy_version 1186593 (0.0010) [2023-12-28 03:47:09,926][106226] Updated weights for policy 0, policy_version 1186603 (0.0009) [2023-12-28 03:47:09,971][106225] Updated weights for policy 1, policy_version 1189554 (0.0007) [2023-12-28 03:47:09,993][106226] Updated weights for policy 0, policy_version 1186613 (0.0009) [2023-12-28 03:47:10,031][106225] Updated weights for policy 1, policy_version 1189564 (0.0006) [2023-12-28 03:47:10,102][106225] Updated weights for policy 1, policy_version 1189574 (0.0006) [2023-12-28 03:47:10,634][106226] Updated weights for policy 0, policy_version 1186623 (0.0008) [2023-12-28 03:47:10,690][106226] Updated weights for policy 0, policy_version 1186633 (0.0005) [2023-12-28 03:47:10,750][106226] Updated weights for policy 0, policy_version 1186643 (0.0005) [2023-12-28 03:47:10,781][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000008 [2023-12-28 03:47:10,878][106225] Updated weights for policy 1, policy_version 1189584 (0.0008) [2023-12-28 03:47:10,928][106225] Updated weights for policy 1, policy_version 1189594 (0.0008) [2023-12-28 03:47:10,974][106225] Updated weights for policy 1, policy_version 1189604 (0.0007) [2023-12-28 03:47:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 608428032. Throughput: 0: 10192.3, 1: 9799.8. Samples: 608396308. Policy #0 lag: (min: 28.0, avg: 31.0, max: 60.0) [2023-12-28 03:47:11,176][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.840')] [2023-12-28 03:47:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001186648_303841280.pth... [2023-12-28 03:47:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001189608_304586752.pth... [2023-12-28 03:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001185464_303538176.pth [2023-12-28 03:47:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001188488_304300032.pth [2023-12-28 03:47:11,369][106226] Updated weights for policy 0, policy_version 1186653 (0.0008) [2023-12-28 03:47:11,441][106226] Updated weights for policy 0, policy_version 1186663 (0.0008) [2023-12-28 03:47:11,507][106226] Updated weights for policy 0, policy_version 1186673 (0.0006) [2023-12-28 03:47:11,808][106225] Updated weights for policy 1, policy_version 1189614 (0.0008) [2023-12-28 03:47:11,858][106225] Updated weights for policy 1, policy_version 1189624 (0.0010) [2023-12-28 03:47:11,910][106225] Updated weights for policy 1, policy_version 1189634 (0.0008) [2023-12-28 03:47:12,154][106226] Updated weights for policy 0, policy_version 1186683 (0.0007) [2023-12-28 03:47:12,211][106226] Updated weights for policy 0, policy_version 1186693 (0.0008) [2023-12-28 03:47:12,277][106226] Updated weights for policy 0, policy_version 1186703 (0.0008) [2023-12-28 03:47:12,693][106225] Updated weights for policy 1, policy_version 1189644 (0.0008) [2023-12-28 03:47:12,757][106225] Updated weights for policy 1, policy_version 1189654 (0.0008) [2023-12-28 03:47:12,821][106225] Updated weights for policy 1, policy_version 1189664 (0.0008) [2023-12-28 03:47:13,022][106226] Updated weights for policy 0, policy_version 1186713 (0.0008) [2023-12-28 03:47:13,089][106226] Updated weights for policy 0, policy_version 1186723 (0.0011) [2023-12-28 03:47:13,146][106226] Updated weights for policy 0, policy_version 1186733 (0.0011) [2023-12-28 03:47:13,193][106226] Updated weights for policy 0, policy_version 1186743 (0.0010) [2023-12-28 03:47:13,483][106225] Updated weights for policy 1, policy_version 1189674 (0.0007) [2023-12-28 03:47:13,536][106225] Updated weights for policy 1, policy_version 1189684 (0.0005) [2023-12-28 03:47:13,598][106225] Updated weights for policy 1, policy_version 1189694 (0.0005) [2023-12-28 03:47:13,659][106225] Updated weights for policy 1, policy_version 1189704 (0.0005) [2023-12-28 03:47:13,922][106226] Updated weights for policy 0, policy_version 1186753 (0.0011) [2023-12-28 03:47:13,988][106226] Updated weights for policy 0, policy_version 1186763 (0.0011) [2023-12-28 03:47:14,052][106226] Updated weights for policy 0, policy_version 1186773 (0.0011) [2023-12-28 03:47:14,171][106225] Updated weights for policy 1, policy_version 1189714 (0.0005) [2023-12-28 03:47:14,231][106225] Updated weights for policy 1, policy_version 1189724 (0.0005) [2023-12-28 03:47:14,301][106225] Updated weights for policy 1, policy_version 1189734 (0.0005) [2023-12-28 03:47:14,770][106226] Updated weights for policy 0, policy_version 1186783 (0.0010) [2023-12-28 03:47:14,833][106226] Updated weights for policy 0, policy_version 1186793 (0.0011) [2023-12-28 03:47:14,901][106226] Updated weights for policy 0, policy_version 1186803 (0.0010) [2023-12-28 03:47:14,945][106225] Updated weights for policy 1, policy_version 1189744 (0.0008) [2023-12-28 03:47:15,010][106225] Updated weights for policy 1, policy_version 1189754 (0.0009) [2023-12-28 03:47:15,076][106225] Updated weights for policy 1, policy_version 1189764 (0.0009) [2023-12-28 03:47:15,551][106226] Updated weights for policy 0, policy_version 1186813 (0.0009) [2023-12-28 03:47:15,607][106226] Updated weights for policy 0, policy_version 1186823 (0.0006) [2023-12-28 03:47:15,659][106226] Updated weights for policy 0, policy_version 1186833 (0.0005) [2023-12-28 03:47:15,842][106225] Updated weights for policy 1, policy_version 1189774 (0.0009) [2023-12-28 03:47:15,896][106225] Updated weights for policy 1, policy_version 1189784 (0.0008) [2023-12-28 03:47:15,954][106225] Updated weights for policy 1, policy_version 1189794 (0.0009) [2023-12-28 03:47:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 608526336. Throughput: 0: 10138.6, 1: 9733.4. Samples: 608515056. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:16,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-4.859')] [2023-12-28 03:47:16,263][106226] Updated weights for policy 0, policy_version 1186843 (0.0006) [2023-12-28 03:47:16,325][106226] Updated weights for policy 0, policy_version 1186853 (0.0007) [2023-12-28 03:47:16,391][106226] Updated weights for policy 0, policy_version 1186863 (0.0005) [2023-12-28 03:47:16,634][106225] Updated weights for policy 1, policy_version 1189804 (0.0008) [2023-12-28 03:47:16,680][106225] Updated weights for policy 1, policy_version 1189814 (0.0005) [2023-12-28 03:47:16,740][106225] Updated weights for policy 1, policy_version 1189824 (0.0009) [2023-12-28 03:47:16,951][106226] Updated weights for policy 0, policy_version 1186873 (0.0006) [2023-12-28 03:47:17,009][106226] Updated weights for policy 0, policy_version 1186883 (0.0008) [2023-12-28 03:47:17,064][106226] Updated weights for policy 0, policy_version 1186893 (0.0009) [2023-12-28 03:47:17,133][106226] Updated weights for policy 0, policy_version 1186903 (0.0008) [2023-12-28 03:47:17,424][106225] Updated weights for policy 1, policy_version 1189834 (0.0008) [2023-12-28 03:47:17,479][106225] Updated weights for policy 1, policy_version 1189844 (0.0005) [2023-12-28 03:47:17,541][106225] Updated weights for policy 1, policy_version 1189854 (0.0006) [2023-12-28 03:47:17,603][106225] Updated weights for policy 1, policy_version 1189864 (0.0005) [2023-12-28 03:47:17,871][106226] Updated weights for policy 0, policy_version 1186913 (0.0009) [2023-12-28 03:47:17,929][106226] Updated weights for policy 0, policy_version 1186923 (0.0009) [2023-12-28 03:47:17,990][106226] Updated weights for policy 0, policy_version 1186933 (0.0008) [2023-12-28 03:47:18,200][106225] Updated weights for policy 1, policy_version 1189874 (0.0010) [2023-12-28 03:47:18,255][106225] Updated weights for policy 1, policy_version 1189884 (0.0008) [2023-12-28 03:47:18,307][106225] Updated weights for policy 1, policy_version 1189894 (0.0008) [2023-12-28 03:47:18,739][106226] Updated weights for policy 0, policy_version 1186943 (0.0009) [2023-12-28 03:47:18,806][106226] Updated weights for policy 0, policy_version 1186953 (0.0009) [2023-12-28 03:47:18,868][106226] Updated weights for policy 0, policy_version 1186963 (0.0006) [2023-12-28 03:47:19,023][106225] Updated weights for policy 1, policy_version 1189904 (0.0008) [2023-12-28 03:47:19,081][106225] Updated weights for policy 1, policy_version 1189914 (0.0009) [2023-12-28 03:47:19,138][106225] Updated weights for policy 1, policy_version 1189924 (0.0008) [2023-12-28 03:47:19,573][106226] Updated weights for policy 0, policy_version 1186973 (0.0007) [2023-12-28 03:47:19,635][106226] Updated weights for policy 0, policy_version 1186983 (0.0009) [2023-12-28 03:47:19,705][106226] Updated weights for policy 0, policy_version 1186993 (0.0008) [2023-12-28 03:47:19,878][106225] Updated weights for policy 1, policy_version 1189934 (0.0008) [2023-12-28 03:47:19,940][106225] Updated weights for policy 1, policy_version 1189944 (0.0008) [2023-12-28 03:47:19,988][106225] Updated weights for policy 1, policy_version 1189954 (0.0009) [2023-12-28 03:47:20,506][106226] Updated weights for policy 0, policy_version 1187003 (0.0009) [2023-12-28 03:47:20,558][106226] Updated weights for policy 0, policy_version 1187013 (0.0008) [2023-12-28 03:47:20,631][106226] Updated weights for policy 0, policy_version 1187023 (0.0008) [2023-12-28 03:47:20,740][106225] Updated weights for policy 1, policy_version 1189964 (0.0008) [2023-12-28 03:47:20,811][106225] Updated weights for policy 1, policy_version 1189974 (0.0009) [2023-12-28 03:47:20,874][106225] Updated weights for policy 1, policy_version 1189984 (0.0010) [2023-12-28 03:47:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 608624640. Throughput: 0: 10123.6, 1: 9715.7. Samples: 608634092. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:21,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-5.100')] [2023-12-28 03:47:21,354][106226] Updated weights for policy 0, policy_version 1187033 (0.0006) [2023-12-28 03:47:21,419][106226] Updated weights for policy 0, policy_version 1187043 (0.0009) [2023-12-28 03:47:21,477][106226] Updated weights for policy 0, policy_version 1187053 (0.0009) [2023-12-28 03:47:21,528][106226] Updated weights for policy 0, policy_version 1187063 (0.0009) [2023-12-28 03:47:21,662][106225] Updated weights for policy 1, policy_version 1189994 (0.0007) [2023-12-28 03:47:21,729][106225] Updated weights for policy 1, policy_version 1190004 (0.0007) [2023-12-28 03:47:21,795][106225] Updated weights for policy 1, policy_version 1190014 (0.0008) [2023-12-28 03:47:21,846][106225] Updated weights for policy 1, policy_version 1190024 (0.0008) [2023-12-28 03:47:22,327][106226] Updated weights for policy 0, policy_version 1187073 (0.0010) [2023-12-28 03:47:22,402][106226] Updated weights for policy 0, policy_version 1187083 (0.0009) [2023-12-28 03:47:22,468][106226] Updated weights for policy 0, policy_version 1187093 (0.0006) [2023-12-28 03:47:22,538][106225] Updated weights for policy 1, policy_version 1190034 (0.0009) [2023-12-28 03:47:22,595][106225] Updated weights for policy 1, policy_version 1190044 (0.0008) [2023-12-28 03:47:22,652][106225] Updated weights for policy 1, policy_version 1190054 (0.0009) [2023-12-28 03:47:23,110][106226] Updated weights for policy 0, policy_version 1187103 (0.0010) [2023-12-28 03:47:23,173][106226] Updated weights for policy 0, policy_version 1187113 (0.0011) [2023-12-28 03:47:23,232][106226] Updated weights for policy 0, policy_version 1187123 (0.0008) [2023-12-28 03:47:23,338][106225] Updated weights for policy 1, policy_version 1190064 (0.0008) [2023-12-28 03:47:23,392][106225] Updated weights for policy 1, policy_version 1190074 (0.0005) [2023-12-28 03:47:23,449][106225] Updated weights for policy 1, policy_version 1190084 (0.0005) [2023-12-28 03:47:23,950][106226] Updated weights for policy 0, policy_version 1187133 (0.0009) [2023-12-28 03:47:24,008][106226] Updated weights for policy 0, policy_version 1187143 (0.0008) [2023-12-28 03:47:24,072][106226] Updated weights for policy 0, policy_version 1187153 (0.0009) [2023-12-28 03:47:24,140][106225] Updated weights for policy 1, policy_version 1190094 (0.0009) [2023-12-28 03:47:24,185][106225] Updated weights for policy 1, policy_version 1190104 (0.0008) [2023-12-28 03:47:24,234][106225] Updated weights for policy 1, policy_version 1190114 (0.0008) [2023-12-28 03:47:24,788][106226] Updated weights for policy 0, policy_version 1187163 (0.0008) [2023-12-28 03:47:24,850][106226] Updated weights for policy 0, policy_version 1187173 (0.0009) [2023-12-28 03:47:24,910][106226] Updated weights for policy 0, policy_version 1187183 (0.0009) [2023-12-28 03:47:25,013][106225] Updated weights for policy 1, policy_version 1190124 (0.0009) [2023-12-28 03:47:25,070][106225] Updated weights for policy 1, policy_version 1190134 (0.0008) [2023-12-28 03:47:25,135][106225] Updated weights for policy 1, policy_version 1190144 (0.0007) [2023-12-28 03:47:25,618][106226] Updated weights for policy 0, policy_version 1187193 (0.0008) [2023-12-28 03:47:25,668][106226] Updated weights for policy 0, policy_version 1187203 (0.0008) [2023-12-28 03:47:25,713][106226] Updated weights for policy 0, policy_version 1187213 (0.0008) [2023-12-28 03:47:25,765][106226] Updated weights for policy 0, policy_version 1187223 (0.0009) [2023-12-28 03:47:25,816][106225] Updated weights for policy 1, policy_version 1190154 (0.0008) [2023-12-28 03:47:25,878][106225] Updated weights for policy 1, policy_version 1190164 (0.0009) [2023-12-28 03:47:25,936][106225] Updated weights for policy 1, policy_version 1190174 (0.0009) [2023-12-28 03:47:25,997][106225] Updated weights for policy 1, policy_version 1190184 (0.0008) [2023-12-28 03:47:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 608722944. Throughput: 0: 10044.3, 1: 9658.4. Samples: 608691868. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:26,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-5.147')] [2023-12-28 03:47:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001187224_303988736.pth... [2023-12-28 03:47:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001190184_304734208.pth... [2023-12-28 03:47:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001186072_303693824.pth [2023-12-28 03:47:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001189064_304447488.pth [2023-12-28 03:47:26,466][106226] Updated weights for policy 0, policy_version 1187233 (0.0009) [2023-12-28 03:47:26,528][106226] Updated weights for policy 0, policy_version 1187243 (0.0009) [2023-12-28 03:47:26,618][106226] Updated weights for policy 0, policy_version 1187253 (0.0008) [2023-12-28 03:47:26,733][106225] Updated weights for policy 1, policy_version 1190194 (0.0008) [2023-12-28 03:47:26,784][106225] Updated weights for policy 1, policy_version 1190204 (0.0009) [2023-12-28 03:47:26,836][106225] Updated weights for policy 1, policy_version 1190214 (0.0008) [2023-12-28 03:47:27,183][106226] Updated weights for policy 0, policy_version 1187263 (0.0006) [2023-12-28 03:47:27,237][106226] Updated weights for policy 0, policy_version 1187273 (0.0005) [2023-12-28 03:47:27,292][106226] Updated weights for policy 0, policy_version 1187283 (0.0006) [2023-12-28 03:47:27,619][106225] Updated weights for policy 1, policy_version 1190224 (0.0008) [2023-12-28 03:47:27,687][106225] Updated weights for policy 1, policy_version 1190234 (0.0008) [2023-12-28 03:47:27,751][106225] Updated weights for policy 1, policy_version 1190244 (0.0008) [2023-12-28 03:47:27,804][106226] Updated weights for policy 0, policy_version 1187293 (0.0005) [2023-12-28 03:47:27,851][106226] Updated weights for policy 0, policy_version 1187303 (0.0005) [2023-12-28 03:47:27,901][106226] Updated weights for policy 0, policy_version 1187313 (0.0005) [2023-12-28 03:47:28,437][106225] Updated weights for policy 1, policy_version 1190254 (0.0010) [2023-12-28 03:47:28,500][106225] Updated weights for policy 1, policy_version 1190264 (0.0010) [2023-12-28 03:47:28,504][106226] Updated weights for policy 0, policy_version 1187323 (0.0007) [2023-12-28 03:47:28,560][106225] Updated weights for policy 1, policy_version 1190274 (0.0010) [2023-12-28 03:47:28,564][106226] Updated weights for policy 0, policy_version 1187333 (0.0007) [2023-12-28 03:47:28,623][106226] Updated weights for policy 0, policy_version 1187343 (0.0008) [2023-12-28 03:47:29,242][106225] Updated weights for policy 1, policy_version 1190284 (0.0009) [2023-12-28 03:47:29,300][106225] Updated weights for policy 1, policy_version 1190294 (0.0008) [2023-12-28 03:47:29,304][106226] Updated weights for policy 0, policy_version 1187353 (0.0006) [2023-12-28 03:47:29,363][106225] Updated weights for policy 1, policy_version 1190304 (0.0008) [2023-12-28 03:47:29,381][106226] Updated weights for policy 0, policy_version 1187363 (0.0011) [2023-12-28 03:47:29,442][106226] Updated weights for policy 0, policy_version 1187373 (0.0010) [2023-12-28 03:47:29,506][106226] Updated weights for policy 0, policy_version 1187383 (0.0011) [2023-12-28 03:47:30,131][106225] Updated weights for policy 1, policy_version 1190314 (0.0007) [2023-12-28 03:47:30,172][106226] Updated weights for policy 0, policy_version 1187393 (0.0006) [2023-12-28 03:47:30,185][106225] Updated weights for policy 1, policy_version 1190324 (0.0008) [2023-12-28 03:47:30,231][106226] Updated weights for policy 0, policy_version 1187403 (0.0009) [2023-12-28 03:47:30,248][106225] Updated weights for policy 1, policy_version 1190334 (0.0008) [2023-12-28 03:47:30,285][106226] Updated weights for policy 0, policy_version 1187413 (0.0010) [2023-12-28 03:47:30,305][106225] Updated weights for policy 1, policy_version 1190344 (0.0007) [2023-12-28 03:47:30,843][106226] Updated weights for policy 0, policy_version 1187423 (0.0010) [2023-12-28 03:47:30,862][106225] Updated weights for policy 1, policy_version 1190354 (0.0005) [2023-12-28 03:47:30,898][106226] Updated weights for policy 0, policy_version 1187433 (0.0010) [2023-12-28 03:47:30,905][106225] Updated weights for policy 1, policy_version 1190364 (0.0005) [2023-12-28 03:47:30,950][106225] Updated weights for policy 1, policy_version 1190374 (0.0005) [2023-12-28 03:47:30,957][106226] Updated weights for policy 0, policy_version 1187443 (0.0010) [2023-12-28 03:47:31,182][105115] Fps is (10 sec: 20464.0, 60 sec: 20067.8, 300 sec: 19826.9). Total num frames: 608829440. Throughput: 0: 10123.3, 1: 9686.4. Samples: 608813320. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:31,183][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.894')] [2023-12-28 03:47:31,618][106225] Updated weights for policy 1, policy_version 1190384 (0.0006) [2023-12-28 03:47:31,681][106225] Updated weights for policy 1, policy_version 1190394 (0.0006) [2023-12-28 03:47:31,752][106225] Updated weights for policy 1, policy_version 1190404 (0.0008) [2023-12-28 03:47:31,752][106226] Updated weights for policy 0, policy_version 1187453 (0.0011) [2023-12-28 03:47:31,813][106226] Updated weights for policy 0, policy_version 1187463 (0.0010) [2023-12-28 03:47:31,877][106226] Updated weights for policy 0, policy_version 1187473 (0.0011) [2023-12-28 03:47:32,411][106225] Updated weights for policy 1, policy_version 1190414 (0.0008) [2023-12-28 03:47:32,465][106225] Updated weights for policy 1, policy_version 1190424 (0.0008) [2023-12-28 03:47:32,522][106225] Updated weights for policy 1, policy_version 1190434 (0.0008) [2023-12-28 03:47:32,565][106226] Updated weights for policy 0, policy_version 1187483 (0.0009) [2023-12-28 03:47:32,629][106226] Updated weights for policy 0, policy_version 1187493 (0.0009) [2023-12-28 03:47:32,685][106226] Updated weights for policy 0, policy_version 1187503 (0.0010) [2023-12-28 03:47:33,159][106225] Updated weights for policy 1, policy_version 1190444 (0.0009) [2023-12-28 03:47:33,202][106225] Updated weights for policy 1, policy_version 1190454 (0.0010) [2023-12-28 03:47:33,247][106225] Updated weights for policy 1, policy_version 1190464 (0.0010) [2023-12-28 03:47:33,317][106226] Updated weights for policy 0, policy_version 1187513 (0.0010) [2023-12-28 03:47:33,382][106226] Updated weights for policy 0, policy_version 1187523 (0.0010) [2023-12-28 03:47:33,431][106226] Updated weights for policy 0, policy_version 1187533 (0.0010) [2023-12-28 03:47:33,486][106226] Updated weights for policy 0, policy_version 1187543 (0.0008) [2023-12-28 03:47:33,828][106225] Updated weights for policy 1, policy_version 1190474 (0.0008) [2023-12-28 03:47:33,880][106225] Updated weights for policy 1, policy_version 1190484 (0.0005) [2023-12-28 03:47:33,929][106225] Updated weights for policy 1, policy_version 1190494 (0.0005) [2023-12-28 03:47:33,989][106225] Updated weights for policy 1, policy_version 1190504 (0.0005) [2023-12-28 03:47:34,041][106226] Updated weights for policy 0, policy_version 1187553 (0.0008) [2023-12-28 03:47:34,096][106226] Updated weights for policy 0, policy_version 1187563 (0.0007) [2023-12-28 03:47:34,148][106226] Updated weights for policy 0, policy_version 1187573 (0.0009) [2023-12-28 03:47:34,640][106225] Updated weights for policy 1, policy_version 1190514 (0.0010) [2023-12-28 03:47:34,700][106225] Updated weights for policy 1, policy_version 1190524 (0.0010) [2023-12-28 03:47:34,767][106225] Updated weights for policy 1, policy_version 1190534 (0.0010) [2023-12-28 03:47:34,871][106226] Updated weights for policy 0, policy_version 1187583 (0.0007) [2023-12-28 03:47:34,933][106226] Updated weights for policy 0, policy_version 1187593 (0.0006) [2023-12-28 03:47:34,998][106226] Updated weights for policy 0, policy_version 1187603 (0.0005) [2023-12-28 03:47:35,448][106225] Updated weights for policy 1, policy_version 1190544 (0.0006) [2023-12-28 03:47:35,512][106225] Updated weights for policy 1, policy_version 1190554 (0.0008) [2023-12-28 03:47:35,574][106225] Updated weights for policy 1, policy_version 1190564 (0.0008) [2023-12-28 03:47:35,639][106226] Updated weights for policy 0, policy_version 1187613 (0.0006) [2023-12-28 03:47:35,695][106226] Updated weights for policy 0, policy_version 1187623 (0.0007) [2023-12-28 03:47:35,748][106226] Updated weights for policy 0, policy_version 1187633 (0.0009) [2023-12-28 03:47:36,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 608927744. Throughput: 0: 10125.8, 1: 9769.2. Samples: 608939284. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:36,176][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.920')] [2023-12-28 03:47:36,198][106225] Updated weights for policy 1, policy_version 1190574 (0.0008) [2023-12-28 03:47:36,257][106225] Updated weights for policy 1, policy_version 1190584 (0.0006) [2023-12-28 03:47:36,316][106225] Updated weights for policy 1, policy_version 1190594 (0.0007) [2023-12-28 03:47:36,541][106226] Updated weights for policy 0, policy_version 1187643 (0.0009) [2023-12-28 03:47:36,605][106226] Updated weights for policy 0, policy_version 1187653 (0.0008) [2023-12-28 03:47:36,667][106226] Updated weights for policy 0, policy_version 1187663 (0.0008) [2023-12-28 03:47:36,932][106225] Updated weights for policy 1, policy_version 1190604 (0.0008) [2023-12-28 03:47:36,989][106225] Updated weights for policy 1, policy_version 1190614 (0.0008) [2023-12-28 03:47:37,042][106225] Updated weights for policy 1, policy_version 1190624 (0.0008) [2023-12-28 03:47:37,434][106226] Updated weights for policy 0, policy_version 1187673 (0.0009) [2023-12-28 03:47:37,493][106226] Updated weights for policy 0, policy_version 1187683 (0.0009) [2023-12-28 03:47:37,553][106226] Updated weights for policy 0, policy_version 1187693 (0.0009) [2023-12-28 03:47:37,608][106226] Updated weights for policy 0, policy_version 1187703 (0.0008) [2023-12-28 03:47:37,769][106225] Updated weights for policy 1, policy_version 1190634 (0.0009) [2023-12-28 03:47:37,826][106225] Updated weights for policy 1, policy_version 1190644 (0.0009) [2023-12-28 03:47:37,880][106225] Updated weights for policy 1, policy_version 1190654 (0.0010) [2023-12-28 03:47:37,937][106225] Updated weights for policy 1, policy_version 1190664 (0.0010) [2023-12-28 03:47:38,349][106226] Updated weights for policy 0, policy_version 1187713 (0.0009) [2023-12-28 03:47:38,414][106226] Updated weights for policy 0, policy_version 1187723 (0.0008) [2023-12-28 03:47:38,483][106226] Updated weights for policy 0, policy_version 1187733 (0.0008) [2023-12-28 03:47:38,665][106225] Updated weights for policy 1, policy_version 1190674 (0.0011) [2023-12-28 03:47:38,720][106225] Updated weights for policy 1, policy_version 1190684 (0.0010) [2023-12-28 03:47:38,778][106225] Updated weights for policy 1, policy_version 1190694 (0.0010) [2023-12-28 03:47:39,236][106226] Updated weights for policy 0, policy_version 1187743 (0.0009) [2023-12-28 03:47:39,298][106226] Updated weights for policy 0, policy_version 1187753 (0.0008) [2023-12-28 03:47:39,366][106226] Updated weights for policy 0, policy_version 1187763 (0.0009) [2023-12-28 03:47:39,571][106225] Updated weights for policy 1, policy_version 1190704 (0.0011) [2023-12-28 03:47:39,635][106225] Updated weights for policy 1, policy_version 1190714 (0.0008) [2023-12-28 03:47:39,698][106225] Updated weights for policy 1, policy_version 1190724 (0.0010) [2023-12-28 03:47:40,213][106226] Updated weights for policy 0, policy_version 1187773 (0.0009) [2023-12-28 03:47:40,261][106226] Updated weights for policy 0, policy_version 1187783 (0.0008) [2023-12-28 03:47:40,318][106226] Updated weights for policy 0, policy_version 1187793 (0.0008) [2023-12-28 03:47:40,443][106225] Updated weights for policy 1, policy_version 1190734 (0.0010) [2023-12-28 03:47:40,500][106225] Updated weights for policy 1, policy_version 1190744 (0.0010) [2023-12-28 03:47:40,563][106225] Updated weights for policy 1, policy_version 1190754 (0.0010) [2023-12-28 03:47:41,071][106226] Updated weights for policy 0, policy_version 1187803 (0.0008) [2023-12-28 03:47:41,141][106226] Updated weights for policy 0, policy_version 1187813 (0.0008) [2023-12-28 03:47:41,175][105115] Fps is (10 sec: 18856.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 609017856. Throughput: 0: 10060.9, 1: 9821.9. Samples: 608997056. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:41,176][105115] Avg episode reward: [(0, '-4.729'), (1, '-4.896')] [2023-12-28 03:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001190760_304881664.pth... [2023-12-28 03:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001189608_304586752.pth [2023-12-28 03:47:41,208][106226] Updated weights for policy 0, policy_version 1187823 (0.0008) [2023-12-28 03:47:41,264][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001187832_304144384.pth... [2023-12-28 03:47:41,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001186648_303841280.pth [2023-12-28 03:47:41,291][106225] Updated weights for policy 1, policy_version 1190764 (0.0011) [2023-12-28 03:47:41,358][106225] Updated weights for policy 1, policy_version 1190774 (0.0008) [2023-12-28 03:47:41,421][106225] Updated weights for policy 1, policy_version 1190784 (0.0007) [2023-12-28 03:47:41,991][106226] Updated weights for policy 0, policy_version 1187833 (0.0008) [2023-12-28 03:47:42,058][106226] Updated weights for policy 0, policy_version 1187843 (0.0010) [2023-12-28 03:47:42,122][106226] Updated weights for policy 0, policy_version 1187853 (0.0009) [2023-12-28 03:47:42,135][106225] Updated weights for policy 1, policy_version 1190794 (0.0008) [2023-12-28 03:47:42,180][106226] Updated weights for policy 0, policy_version 1187863 (0.0006) [2023-12-28 03:47:42,192][106225] Updated weights for policy 1, policy_version 1190804 (0.0009) [2023-12-28 03:47:42,259][106225] Updated weights for policy 1, policy_version 1190814 (0.0007) [2023-12-28 03:47:42,324][106225] Updated weights for policy 1, policy_version 1190824 (0.0008) [2023-12-28 03:47:42,887][106226] Updated weights for policy 0, policy_version 1187873 (0.0009) [2023-12-28 03:47:42,943][106226] Updated weights for policy 0, policy_version 1187883 (0.0008) [2023-12-28 03:47:43,004][106226] Updated weights for policy 0, policy_version 1187893 (0.0008) [2023-12-28 03:47:43,043][106225] Updated weights for policy 1, policy_version 1190834 (0.0007) [2023-12-28 03:47:43,093][106225] Updated weights for policy 1, policy_version 1190844 (0.0010) [2023-12-28 03:47:43,143][106225] Updated weights for policy 1, policy_version 1190854 (0.0010) [2023-12-28 03:47:43,742][106226] Updated weights for policy 0, policy_version 1187903 (0.0008) [2023-12-28 03:47:43,804][106226] Updated weights for policy 0, policy_version 1187913 (0.0009) [2023-12-28 03:47:43,845][106225] Updated weights for policy 1, policy_version 1190864 (0.0006) [2023-12-28 03:47:43,854][106226] Updated weights for policy 0, policy_version 1187923 (0.0009) [2023-12-28 03:47:43,908][106225] Updated weights for policy 1, policy_version 1190874 (0.0007) [2023-12-28 03:47:43,962][106225] Updated weights for policy 1, policy_version 1190884 (0.0010) [2023-12-28 03:47:44,595][106226] Updated weights for policy 0, policy_version 1187933 (0.0009) [2023-12-28 03:47:44,600][106225] Updated weights for policy 1, policy_version 1190894 (0.0007) [2023-12-28 03:47:44,648][106225] Updated weights for policy 1, policy_version 1190904 (0.0008) [2023-12-28 03:47:44,651][106226] Updated weights for policy 0, policy_version 1187943 (0.0007) [2023-12-28 03:47:44,704][106225] Updated weights for policy 1, policy_version 1190914 (0.0011) [2023-12-28 03:47:44,710][106226] Updated weights for policy 0, policy_version 1187953 (0.0006) [2023-12-28 03:47:45,444][106225] Updated weights for policy 1, policy_version 1190924 (0.0010) [2023-12-28 03:47:45,457][106226] Updated weights for policy 0, policy_version 1187963 (0.0008) [2023-12-28 03:47:45,498][106225] Updated weights for policy 1, policy_version 1190934 (0.0010) [2023-12-28 03:47:45,507][106226] Updated weights for policy 0, policy_version 1187973 (0.0009) [2023-12-28 03:47:45,549][106225] Updated weights for policy 1, policy_version 1190944 (0.0010) [2023-12-28 03:47:45,562][106226] Updated weights for policy 0, policy_version 1187983 (0.0005) [2023-12-28 03:47:46,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 609116160. Throughput: 0: 9941.5, 1: 9861.7. Samples: 609109776. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:46,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.826')] [2023-12-28 03:47:46,207][106225] Updated weights for policy 1, policy_version 1190954 (0.0009) [2023-12-28 03:47:46,260][106225] Updated weights for policy 1, policy_version 1190964 (0.0005) [2023-12-28 03:47:46,321][106225] Updated weights for policy 1, policy_version 1190974 (0.0005) [2023-12-28 03:47:46,351][106226] Updated weights for policy 0, policy_version 1187993 (0.0008) [2023-12-28 03:47:46,378][106225] Updated weights for policy 1, policy_version 1190984 (0.0005) [2023-12-28 03:47:46,411][106226] Updated weights for policy 0, policy_version 1188003 (0.0008) [2023-12-28 03:47:46,462][106226] Updated weights for policy 0, policy_version 1188013 (0.0008) [2023-12-28 03:47:46,510][106226] Updated weights for policy 0, policy_version 1188023 (0.0008) [2023-12-28 03:47:46,968][106225] Updated weights for policy 1, policy_version 1190994 (0.0007) [2023-12-28 03:47:47,021][106225] Updated weights for policy 1, policy_version 1191004 (0.0007) [2023-12-28 03:47:47,075][106225] Updated weights for policy 1, policy_version 1191014 (0.0009) [2023-12-28 03:47:47,230][106226] Updated weights for policy 0, policy_version 1188033 (0.0008) [2023-12-28 03:47:47,280][106226] Updated weights for policy 0, policy_version 1188043 (0.0007) [2023-12-28 03:47:47,330][106226] Updated weights for policy 0, policy_version 1188053 (0.0010) [2023-12-28 03:47:47,761][106225] Updated weights for policy 1, policy_version 1191024 (0.0008) [2023-12-28 03:47:47,816][106225] Updated weights for policy 1, policy_version 1191034 (0.0009) [2023-12-28 03:47:47,868][106225] Updated weights for policy 1, policy_version 1191044 (0.0008) [2023-12-28 03:47:48,021][106226] Updated weights for policy 0, policy_version 1188063 (0.0011) [2023-12-28 03:47:48,082][106226] Updated weights for policy 0, policy_version 1188073 (0.0010) [2023-12-28 03:47:48,143][106226] Updated weights for policy 0, policy_version 1188083 (0.0007) [2023-12-28 03:47:48,520][106225] Updated weights for policy 1, policy_version 1191054 (0.0007) [2023-12-28 03:47:48,574][106225] Updated weights for policy 1, policy_version 1191064 (0.0008) [2023-12-28 03:47:48,621][106225] Updated weights for policy 1, policy_version 1191074 (0.0008) [2023-12-28 03:47:48,798][106226] Updated weights for policy 0, policy_version 1188093 (0.0008) [2023-12-28 03:47:48,855][106226] Updated weights for policy 0, policy_version 1188103 (0.0011) [2023-12-28 03:47:48,916][106226] Updated weights for policy 0, policy_version 1188113 (0.0011) [2023-12-28 03:47:49,374][106225] Updated weights for policy 1, policy_version 1191084 (0.0008) [2023-12-28 03:47:49,444][106225] Updated weights for policy 1, policy_version 1191094 (0.0008) [2023-12-28 03:47:49,500][106225] Updated weights for policy 1, policy_version 1191104 (0.0008) [2023-12-28 03:47:49,651][106226] Updated weights for policy 0, policy_version 1188123 (0.0009) [2023-12-28 03:47:49,714][106226] Updated weights for policy 0, policy_version 1188133 (0.0007) [2023-12-28 03:47:49,784][106226] Updated weights for policy 0, policy_version 1188143 (0.0008) [2023-12-28 03:47:50,263][106225] Updated weights for policy 1, policy_version 1191114 (0.0008) [2023-12-28 03:47:50,320][106225] Updated weights for policy 1, policy_version 1191124 (0.0006) [2023-12-28 03:47:50,380][106225] Updated weights for policy 1, policy_version 1191134 (0.0008) [2023-12-28 03:47:50,438][106225] Updated weights for policy 1, policy_version 1191144 (0.0010) [2023-12-28 03:47:50,450][106226] Updated weights for policy 0, policy_version 1188153 (0.0008) [2023-12-28 03:47:50,504][106226] Updated weights for policy 0, policy_version 1188163 (0.0007) [2023-12-28 03:47:50,570][106226] Updated weights for policy 0, policy_version 1188173 (0.0008) [2023-12-28 03:47:50,641][106226] Updated weights for policy 0, policy_version 1188183 (0.0008) [2023-12-28 03:47:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.7, 300 sec: 19799.7). Total num frames: 609214464. Throughput: 0: 9865.1, 1: 9933.8. Samples: 609227644. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:51,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-5.094')] [2023-12-28 03:47:51,218][106225] Updated weights for policy 1, policy_version 1191154 (0.0005) [2023-12-28 03:47:51,287][106225] Updated weights for policy 1, policy_version 1191164 (0.0006) [2023-12-28 03:47:51,346][106225] Updated weights for policy 1, policy_version 1191174 (0.0006) [2023-12-28 03:47:51,406][106226] Updated weights for policy 0, policy_version 1188193 (0.0009) [2023-12-28 03:47:51,463][106226] Updated weights for policy 0, policy_version 1188203 (0.0008) [2023-12-28 03:47:51,527][106226] Updated weights for policy 0, policy_version 1188213 (0.0008) [2023-12-28 03:47:52,082][106225] Updated weights for policy 1, policy_version 1191184 (0.0006) [2023-12-28 03:47:52,142][106225] Updated weights for policy 1, policy_version 1191194 (0.0005) [2023-12-28 03:47:52,203][106225] Updated weights for policy 1, policy_version 1191204 (0.0007) [2023-12-28 03:47:52,282][106226] Updated weights for policy 0, policy_version 1188223 (0.0008) [2023-12-28 03:47:52,347][106226] Updated weights for policy 0, policy_version 1188233 (0.0008) [2023-12-28 03:47:52,420][106226] Updated weights for policy 0, policy_version 1188243 (0.0008) [2023-12-28 03:47:52,888][106225] Updated weights for policy 1, policy_version 1191214 (0.0008) [2023-12-28 03:47:52,951][106225] Updated weights for policy 1, policy_version 1191224 (0.0006) [2023-12-28 03:47:53,005][106225] Updated weights for policy 1, policy_version 1191234 (0.0005) [2023-12-28 03:47:53,151][106226] Updated weights for policy 0, policy_version 1188253 (0.0006) [2023-12-28 03:47:53,222][106226] Updated weights for policy 0, policy_version 1188263 (0.0005) [2023-12-28 03:47:53,278][106226] Updated weights for policy 0, policy_version 1188273 (0.0005) [2023-12-28 03:47:53,631][106225] Updated weights for policy 1, policy_version 1191244 (0.0007) [2023-12-28 03:47:53,687][106225] Updated weights for policy 1, policy_version 1191254 (0.0010) [2023-12-28 03:47:53,749][106225] Updated weights for policy 1, policy_version 1191264 (0.0010) [2023-12-28 03:47:53,845][106226] Updated weights for policy 0, policy_version 1188283 (0.0005) [2023-12-28 03:47:53,895][106226] Updated weights for policy 0, policy_version 1188293 (0.0005) [2023-12-28 03:47:53,957][106226] Updated weights for policy 0, policy_version 1188303 (0.0006) [2023-12-28 03:47:54,403][106225] Updated weights for policy 1, policy_version 1191274 (0.0008) [2023-12-28 03:47:54,464][106225] Updated weights for policy 1, policy_version 1191284 (0.0006) [2023-12-28 03:47:54,519][106225] Updated weights for policy 1, policy_version 1191294 (0.0005) [2023-12-28 03:47:54,576][106225] Updated weights for policy 1, policy_version 1191304 (0.0005) [2023-12-28 03:47:54,623][106226] Updated weights for policy 0, policy_version 1188313 (0.0010) [2023-12-28 03:47:54,686][106226] Updated weights for policy 0, policy_version 1188323 (0.0010) [2023-12-28 03:47:54,751][106226] Updated weights for policy 0, policy_version 1188333 (0.0012) [2023-12-28 03:47:54,816][106226] Updated weights for policy 0, policy_version 1188343 (0.0010) [2023-12-28 03:47:55,216][106225] Updated weights for policy 1, policy_version 1191314 (0.0008) [2023-12-28 03:47:55,271][106225] Updated weights for policy 1, policy_version 1191324 (0.0008) [2023-12-28 03:47:55,332][106225] Updated weights for policy 1, policy_version 1191334 (0.0008) [2023-12-28 03:47:55,501][106226] Updated weights for policy 0, policy_version 1188353 (0.0006) [2023-12-28 03:47:55,565][106226] Updated weights for policy 0, policy_version 1188363 (0.0005) [2023-12-28 03:47:55,637][106226] Updated weights for policy 0, policy_version 1188373 (0.0005) [2023-12-28 03:47:56,015][106225] Updated weights for policy 1, policy_version 1191344 (0.0010) [2023-12-28 03:47:56,074][106225] Updated weights for policy 1, policy_version 1191354 (0.0010) [2023-12-28 03:47:56,134][106225] Updated weights for policy 1, policy_version 1191364 (0.0010) [2023-12-28 03:47:56,168][106226] Updated weights for policy 0, policy_version 1188383 (0.0009) [2023-12-28 03:47:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 609320960. Throughput: 0: 9865.7, 1: 9941.0. Samples: 609287608. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:47:56,176][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.002')] [2023-12-28 03:47:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001191368_305037312.pth... [2023-12-28 03:47:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001190184_304734208.pth [2023-12-28 03:47:56,227][106226] Updated weights for policy 0, policy_version 1188393 (0.0010) [2023-12-28 03:47:56,284][106226] Updated weights for policy 0, policy_version 1188403 (0.0009) [2023-12-28 03:47:56,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001188408_304291840.pth... [2023-12-28 03:47:56,311][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001187224_303988736.pth [2023-12-28 03:47:56,675][106225] Updated weights for policy 1, policy_version 1191374 (0.0010) [2023-12-28 03:47:56,722][106225] Updated weights for policy 1, policy_version 1191384 (0.0010) [2023-12-28 03:47:56,769][106225] Updated weights for policy 1, policy_version 1191394 (0.0007) [2023-12-28 03:47:56,931][106226] Updated weights for policy 0, policy_version 1188413 (0.0007) [2023-12-28 03:47:56,982][106226] Updated weights for policy 0, policy_version 1188423 (0.0006) [2023-12-28 03:47:57,034][106226] Updated weights for policy 0, policy_version 1188433 (0.0010) [2023-12-28 03:47:57,372][106225] Updated weights for policy 1, policy_version 1191404 (0.0007) [2023-12-28 03:47:57,434][106225] Updated weights for policy 1, policy_version 1191414 (0.0010) [2023-12-28 03:47:57,496][106225] Updated weights for policy 1, policy_version 1191424 (0.0010) [2023-12-28 03:47:57,593][106226] Updated weights for policy 0, policy_version 1188443 (0.0010) [2023-12-28 03:47:57,639][106226] Updated weights for policy 0, policy_version 1188453 (0.0010) [2023-12-28 03:47:57,689][106226] Updated weights for policy 0, policy_version 1188463 (0.0010) [2023-12-28 03:47:58,118][106225] Updated weights for policy 1, policy_version 1191434 (0.0009) [2023-12-28 03:47:58,167][106225] Updated weights for policy 1, policy_version 1191444 (0.0005) [2023-12-28 03:47:58,235][106225] Updated weights for policy 1, policy_version 1191454 (0.0007) [2023-12-28 03:47:58,296][106225] Updated weights for policy 1, policy_version 1191464 (0.0010) [2023-12-28 03:47:58,439][106226] Updated weights for policy 0, policy_version 1188473 (0.0010) [2023-12-28 03:47:58,503][106226] Updated weights for policy 0, policy_version 1188483 (0.0011) [2023-12-28 03:47:58,563][106226] Updated weights for policy 0, policy_version 1188493 (0.0010) [2023-12-28 03:47:58,630][106226] Updated weights for policy 0, policy_version 1188503 (0.0010) [2023-12-28 03:47:58,999][106225] Updated weights for policy 1, policy_version 1191474 (0.0010) [2023-12-28 03:47:59,057][106225] Updated weights for policy 1, policy_version 1191484 (0.0011) [2023-12-28 03:47:59,125][106225] Updated weights for policy 1, policy_version 1191494 (0.0009) [2023-12-28 03:47:59,493][106226] Updated weights for policy 0, policy_version 1188513 (0.0009) [2023-12-28 03:47:59,552][106226] Updated weights for policy 0, policy_version 1188523 (0.0009) [2023-12-28 03:47:59,613][106226] Updated weights for policy 0, policy_version 1188533 (0.0009) [2023-12-28 03:47:59,793][106225] Updated weights for policy 1, policy_version 1191504 (0.0006) [2023-12-28 03:47:59,857][106225] Updated weights for policy 1, policy_version 1191514 (0.0007) [2023-12-28 03:47:59,922][106225] Updated weights for policy 1, policy_version 1191524 (0.0006) [2023-12-28 03:48:00,428][106226] Updated weights for policy 0, policy_version 1188543 (0.0008) [2023-12-28 03:48:00,496][106226] Updated weights for policy 0, policy_version 1188553 (0.0008) [2023-12-28 03:48:00,552][106226] Updated weights for policy 0, policy_version 1188563 (0.0008) [2023-12-28 03:48:00,556][106225] Updated weights for policy 1, policy_version 1191534 (0.0008) [2023-12-28 03:48:00,612][106225] Updated weights for policy 1, policy_version 1191544 (0.0005) [2023-12-28 03:48:00,670][106225] Updated weights for policy 1, policy_version 1191554 (0.0006) [2023-12-28 03:48:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 609419264. Throughput: 0: 9868.5, 1: 10052.3. Samples: 609411492. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:01,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-5.027')] [2023-12-28 03:48:01,284][106226] Updated weights for policy 0, policy_version 1188573 (0.0007) [2023-12-28 03:48:01,309][106225] Updated weights for policy 1, policy_version 1191564 (0.0008) [2023-12-28 03:48:01,355][106226] Updated weights for policy 0, policy_version 1188583 (0.0007) [2023-12-28 03:48:01,375][106225] Updated weights for policy 1, policy_version 1191574 (0.0007) [2023-12-28 03:48:01,418][106226] Updated weights for policy 0, policy_version 1188593 (0.0009) [2023-12-28 03:48:01,436][106225] Updated weights for policy 1, policy_version 1191584 (0.0005) [2023-12-28 03:48:02,081][106226] Updated weights for policy 0, policy_version 1188603 (0.0008) [2023-12-28 03:48:02,126][106225] Updated weights for policy 1, policy_version 1191594 (0.0007) [2023-12-28 03:48:02,135][106226] Updated weights for policy 0, policy_version 1188613 (0.0008) [2023-12-28 03:48:02,186][106225] Updated weights for policy 1, policy_version 1191604 (0.0006) [2023-12-28 03:48:02,195][106226] Updated weights for policy 0, policy_version 1188623 (0.0006) [2023-12-28 03:48:02,244][106225] Updated weights for policy 1, policy_version 1191614 (0.0008) [2023-12-28 03:48:02,309][106225] Updated weights for policy 1, policy_version 1191624 (0.0006) [2023-12-28 03:48:02,890][106226] Updated weights for policy 0, policy_version 1188633 (0.0006) [2023-12-28 03:48:02,937][106226] Updated weights for policy 0, policy_version 1188643 (0.0008) [2023-12-28 03:48:02,981][106226] Updated weights for policy 0, policy_version 1188653 (0.0008) [2023-12-28 03:48:02,992][106225] Updated weights for policy 1, policy_version 1191634 (0.0009) [2023-12-28 03:48:03,031][106226] Updated weights for policy 0, policy_version 1188663 (0.0008) [2023-12-28 03:48:03,052][106225] Updated weights for policy 1, policy_version 1191644 (0.0007) [2023-12-28 03:48:03,100][106225] Updated weights for policy 1, policy_version 1191654 (0.0008) [2023-12-28 03:48:03,647][106226] Updated weights for policy 0, policy_version 1188673 (0.0008) [2023-12-28 03:48:03,698][106226] Updated weights for policy 0, policy_version 1188683 (0.0008) [2023-12-28 03:48:03,755][106226] Updated weights for policy 0, policy_version 1188693 (0.0008) [2023-12-28 03:48:03,882][106225] Updated weights for policy 1, policy_version 1191664 (0.0008) [2023-12-28 03:48:03,943][106225] Updated weights for policy 1, policy_version 1191674 (0.0008) [2023-12-28 03:48:04,002][106225] Updated weights for policy 1, policy_version 1191684 (0.0008) [2023-12-28 03:48:04,458][106226] Updated weights for policy 0, policy_version 1188703 (0.0006) [2023-12-28 03:48:04,506][106226] Updated weights for policy 0, policy_version 1188713 (0.0007) [2023-12-28 03:48:04,557][106226] Updated weights for policy 0, policy_version 1188723 (0.0007) [2023-12-28 03:48:04,809][106225] Updated weights for policy 1, policy_version 1191694 (0.0009) [2023-12-28 03:48:04,868][106225] Updated weights for policy 1, policy_version 1191704 (0.0007) [2023-12-28 03:48:04,921][106225] Updated weights for policy 1, policy_version 1191714 (0.0008) [2023-12-28 03:48:05,127][106226] Updated weights for policy 0, policy_version 1188733 (0.0008) [2023-12-28 03:48:05,177][106226] Updated weights for policy 0, policy_version 1188743 (0.0010) [2023-12-28 03:48:05,236][106226] Updated weights for policy 0, policy_version 1188753 (0.0010) [2023-12-28 03:48:05,637][106225] Updated weights for policy 1, policy_version 1191724 (0.0007) [2023-12-28 03:48:05,689][106225] Updated weights for policy 1, policy_version 1191734 (0.0005) [2023-12-28 03:48:05,759][106225] Updated weights for policy 1, policy_version 1191744 (0.0005) [2023-12-28 03:48:05,961][106226] Updated weights for policy 0, policy_version 1188763 (0.0010) [2023-12-28 03:48:06,015][106226] Updated weights for policy 0, policy_version 1188773 (0.0008) [2023-12-28 03:48:06,072][106226] Updated weights for policy 0, policy_version 1188783 (0.0008) [2023-12-28 03:48:06,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19855.3). Total num frames: 609525760. Throughput: 0: 9893.3, 1: 10048.9. Samples: 609531492. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:06,175][105115] Avg episode reward: [(0, '-4.968'), (1, '-4.706')] [2023-12-28 03:48:06,490][106225] Updated weights for policy 1, policy_version 1191754 (0.0007) [2023-12-28 03:48:06,548][106225] Updated weights for policy 1, policy_version 1191764 (0.0008) [2023-12-28 03:48:06,607][106225] Updated weights for policy 1, policy_version 1191774 (0.0008) [2023-12-28 03:48:06,670][106225] Updated weights for policy 1, policy_version 1191784 (0.0009) [2023-12-28 03:48:06,711][106226] Updated weights for policy 0, policy_version 1188793 (0.0007) [2023-12-28 03:48:06,764][106226] Updated weights for policy 0, policy_version 1188803 (0.0006) [2023-12-28 03:48:06,826][106226] Updated weights for policy 0, policy_version 1188813 (0.0008) [2023-12-28 03:48:06,887][106226] Updated weights for policy 0, policy_version 1188823 (0.0008) [2023-12-28 03:48:07,426][106225] Updated weights for policy 1, policy_version 1191794 (0.0009) [2023-12-28 03:48:07,490][106225] Updated weights for policy 1, policy_version 1191804 (0.0008) [2023-12-28 03:48:07,551][106225] Updated weights for policy 1, policy_version 1191814 (0.0008) [2023-12-28 03:48:07,590][106226] Updated weights for policy 0, policy_version 1188833 (0.0008) [2023-12-28 03:48:07,641][106226] Updated weights for policy 0, policy_version 1188843 (0.0008) [2023-12-28 03:48:07,697][106226] Updated weights for policy 0, policy_version 1188853 (0.0009) [2023-12-28 03:48:08,271][106225] Updated weights for policy 1, policy_version 1191824 (0.0009) [2023-12-28 03:48:08,330][106225] Updated weights for policy 1, policy_version 1191834 (0.0008) [2023-12-28 03:48:08,385][106225] Updated weights for policy 1, policy_version 1191844 (0.0008) [2023-12-28 03:48:08,449][106226] Updated weights for policy 0, policy_version 1188863 (0.0009) [2023-12-28 03:48:08,496][106226] Updated weights for policy 0, policy_version 1188873 (0.0009) [2023-12-28 03:48:08,543][106226] Updated weights for policy 0, policy_version 1188883 (0.0009) [2023-12-28 03:48:09,114][106225] Updated weights for policy 1, policy_version 1191854 (0.0009) [2023-12-28 03:48:09,176][106225] Updated weights for policy 1, policy_version 1191864 (0.0008) [2023-12-28 03:48:09,240][106225] Updated weights for policy 1, policy_version 1191874 (0.0008) [2023-12-28 03:48:09,331][106226] Updated weights for policy 0, policy_version 1188893 (0.0008) [2023-12-28 03:48:09,403][106226] Updated weights for policy 0, policy_version 1188903 (0.0010) [2023-12-28 03:48:09,465][106226] Updated weights for policy 0, policy_version 1188913 (0.0009) [2023-12-28 03:48:10,025][106225] Updated weights for policy 1, policy_version 1191884 (0.0009) [2023-12-28 03:48:10,086][106225] Updated weights for policy 1, policy_version 1191894 (0.0010) [2023-12-28 03:48:10,161][106225] Updated weights for policy 1, policy_version 1191905 (0.0013) [2023-12-28 03:48:10,221][106226] Updated weights for policy 0, policy_version 1188923 (0.0010) [2023-12-28 03:48:10,270][106226] Updated weights for policy 0, policy_version 1188933 (0.0007) [2023-12-28 03:48:10,321][106226] Updated weights for policy 0, policy_version 1188943 (0.0008) [2023-12-28 03:48:10,878][106225] Updated weights for policy 1, policy_version 1191915 (0.0009) [2023-12-28 03:48:10,935][106225] Updated weights for policy 1, policy_version 1191925 (0.0010) [2023-12-28 03:48:11,000][106225] Updated weights for policy 1, policy_version 1191935 (0.0010) [2023-12-28 03:48:11,059][106226] Updated weights for policy 0, policy_version 1188953 (0.0007) [2023-12-28 03:48:11,133][106226] Updated weights for policy 0, policy_version 1188963 (0.0008) [2023-12-28 03:48:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 609615872. Throughput: 0: 9910.8, 1: 10025.1. Samples: 609588984. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:11,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-5.159')] [2023-12-28 03:48:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001191944_305184768.pth... [2023-12-28 03:48:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001190760_304881664.pth [2023-12-28 03:48:11,199][106226] Updated weights for policy 0, policy_version 1188973 (0.0009) [2023-12-28 03:48:11,270][106226] Updated weights for policy 0, policy_version 1188983 (0.0009) [2023-12-28 03:48:11,274][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001188984_304439296.pth... [2023-12-28 03:48:11,278][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001187832_304144384.pth [2023-12-28 03:48:11,842][106225] Updated weights for policy 1, policy_version 1191945 (0.0009) [2023-12-28 03:48:11,901][106225] Updated weights for policy 1, policy_version 1191955 (0.0009) [2023-12-28 03:48:11,963][106225] Updated weights for policy 1, policy_version 1191965 (0.0008) [2023-12-28 03:48:12,025][106225] Updated weights for policy 1, policy_version 1191975 (0.0007) [2023-12-28 03:48:12,051][106226] Updated weights for policy 0, policy_version 1188993 (0.0009) [2023-12-28 03:48:12,113][106226] Updated weights for policy 0, policy_version 1189003 (0.0010) [2023-12-28 03:48:12,173][106226] Updated weights for policy 0, policy_version 1189013 (0.0010) [2023-12-28 03:48:12,748][106225] Updated weights for policy 1, policy_version 1191985 (0.0008) [2023-12-28 03:48:12,808][106225] Updated weights for policy 1, policy_version 1191995 (0.0009) [2023-12-28 03:48:12,865][106225] Updated weights for policy 1, policy_version 1192005 (0.0008) [2023-12-28 03:48:12,919][106226] Updated weights for policy 0, policy_version 1189023 (0.0009) [2023-12-28 03:48:12,969][106226] Updated weights for policy 0, policy_version 1189033 (0.0009) [2023-12-28 03:48:13,019][106226] Updated weights for policy 0, policy_version 1189043 (0.0009) [2023-12-28 03:48:13,509][106225] Updated weights for policy 1, policy_version 1192015 (0.0009) [2023-12-28 03:48:13,565][106225] Updated weights for policy 1, policy_version 1192025 (0.0010) [2023-12-28 03:48:13,628][106225] Updated weights for policy 1, policy_version 1192035 (0.0010) [2023-12-28 03:48:13,803][106226] Updated weights for policy 0, policy_version 1189053 (0.0008) [2023-12-28 03:48:13,861][106226] Updated weights for policy 0, policy_version 1189063 (0.0008) [2023-12-28 03:48:13,924][106226] Updated weights for policy 0, policy_version 1189073 (0.0008) [2023-12-28 03:48:14,346][106225] Updated weights for policy 1, policy_version 1192045 (0.0010) [2023-12-28 03:48:14,410][106225] Updated weights for policy 1, policy_version 1192055 (0.0010) [2023-12-28 03:48:14,464][106225] Updated weights for policy 1, policy_version 1192065 (0.0010) [2023-12-28 03:48:14,593][106226] Updated weights for policy 0, policy_version 1189083 (0.0008) [2023-12-28 03:48:14,640][106226] Updated weights for policy 0, policy_version 1189093 (0.0010) [2023-12-28 03:48:14,695][106226] Updated weights for policy 0, policy_version 1189103 (0.0011) [2023-12-28 03:48:15,221][106225] Updated weights for policy 1, policy_version 1192075 (0.0009) [2023-12-28 03:48:15,278][106225] Updated weights for policy 1, policy_version 1192085 (0.0009) [2023-12-28 03:48:15,336][106225] Updated weights for policy 1, policy_version 1192095 (0.0009) [2023-12-28 03:48:15,377][106226] Updated weights for policy 0, policy_version 1189113 (0.0010) [2023-12-28 03:48:15,445][106226] Updated weights for policy 0, policy_version 1189123 (0.0007) [2023-12-28 03:48:15,513][106226] Updated weights for policy 0, policy_version 1189133 (0.0006) [2023-12-28 03:48:15,584][106226] Updated weights for policy 0, policy_version 1189143 (0.0006) [2023-12-28 03:48:16,131][106226] Updated weights for policy 0, policy_version 1189153 (0.0005) [2023-12-28 03:48:16,159][106225] Updated weights for policy 1, policy_version 1192105 (0.0009) [2023-12-28 03:48:16,174][105115] Fps is (10 sec: 18022.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 609705984. Throughput: 0: 9742.4, 1: 10001.8. Samples: 609701656. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:16,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-4.772')] [2023-12-28 03:48:16,187][106226] Updated weights for policy 0, policy_version 1189163 (0.0005) [2023-12-28 03:48:16,212][106225] Updated weights for policy 1, policy_version 1192115 (0.0008) [2023-12-28 03:48:16,248][106226] Updated weights for policy 0, policy_version 1189173 (0.0005) [2023-12-28 03:48:16,268][106225] Updated weights for policy 1, policy_version 1192125 (0.0008) [2023-12-28 03:48:16,327][106225] Updated weights for policy 1, policy_version 1192135 (0.0008) [2023-12-28 03:48:16,884][106226] Updated weights for policy 0, policy_version 1189183 (0.0005) [2023-12-28 03:48:16,941][106226] Updated weights for policy 0, policy_version 1189193 (0.0005) [2023-12-28 03:48:16,998][106226] Updated weights for policy 0, policy_version 1189203 (0.0006) [2023-12-28 03:48:17,058][106225] Updated weights for policy 1, policy_version 1192145 (0.0007) [2023-12-28 03:48:17,105][106225] Updated weights for policy 1, policy_version 1192155 (0.0008) [2023-12-28 03:48:17,157][106225] Updated weights for policy 1, policy_version 1192165 (0.0008) [2023-12-28 03:48:17,631][106226] Updated weights for policy 0, policy_version 1189213 (0.0006) [2023-12-28 03:48:17,685][106226] Updated weights for policy 0, policy_version 1189223 (0.0005) [2023-12-28 03:48:17,747][106226] Updated weights for policy 0, policy_version 1189233 (0.0005) [2023-12-28 03:48:17,795][106225] Updated weights for policy 1, policy_version 1192175 (0.0008) [2023-12-28 03:48:17,851][106225] Updated weights for policy 1, policy_version 1192187 (0.0009) [2023-12-28 03:48:17,909][106225] Updated weights for policy 1, policy_version 1192197 (0.0009) [2023-12-28 03:48:18,310][106226] Updated weights for policy 0, policy_version 1189243 (0.0006) [2023-12-28 03:48:18,378][106226] Updated weights for policy 0, policy_version 1189253 (0.0008) [2023-12-28 03:48:18,443][106226] Updated weights for policy 0, policy_version 1189263 (0.0007) [2023-12-28 03:48:18,736][106225] Updated weights for policy 1, policy_version 1192207 (0.0008) [2023-12-28 03:48:18,796][106225] Updated weights for policy 1, policy_version 1192217 (0.0008) [2023-12-28 03:48:18,855][106225] Updated weights for policy 1, policy_version 1192227 (0.0008) [2023-12-28 03:48:19,066][106226] Updated weights for policy 0, policy_version 1189273 (0.0006) [2023-12-28 03:48:19,119][106226] Updated weights for policy 0, policy_version 1189283 (0.0009) [2023-12-28 03:48:19,167][106226] Updated weights for policy 0, policy_version 1189293 (0.0008) [2023-12-28 03:48:19,221][106226] Updated weights for policy 0, policy_version 1189303 (0.0008) [2023-12-28 03:48:19,638][106225] Updated weights for policy 1, policy_version 1192237 (0.0009) [2023-12-28 03:48:19,702][106225] Updated weights for policy 1, policy_version 1192247 (0.0008) [2023-12-28 03:48:19,768][106225] Updated weights for policy 1, policy_version 1192257 (0.0009) [2023-12-28 03:48:19,939][106226] Updated weights for policy 0, policy_version 1189313 (0.0008) [2023-12-28 03:48:20,010][106226] Updated weights for policy 0, policy_version 1189323 (0.0009) [2023-12-28 03:48:20,070][106226] Updated weights for policy 0, policy_version 1189333 (0.0008) [2023-12-28 03:48:20,564][106225] Updated weights for policy 1, policy_version 1192267 (0.0008) [2023-12-28 03:48:20,630][106225] Updated weights for policy 1, policy_version 1192277 (0.0008) [2023-12-28 03:48:20,686][106225] Updated weights for policy 1, policy_version 1192287 (0.0010) [2023-12-28 03:48:20,778][106226] Updated weights for policy 0, policy_version 1189343 (0.0010) [2023-12-28 03:48:20,833][106226] Updated weights for policy 0, policy_version 1189353 (0.0011) [2023-12-28 03:48:20,893][106226] Updated weights for policy 0, policy_version 1189363 (0.0011) [2023-12-28 03:48:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 609812480. Throughput: 0: 9787.2, 1: 9799.7. Samples: 609820692. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:21,175][105115] Avg episode reward: [(0, '-4.874'), (1, '-5.290')] [2023-12-28 03:48:21,501][106225] Updated weights for policy 1, policy_version 1192297 (0.0008) [2023-12-28 03:48:21,566][106225] Updated weights for policy 1, policy_version 1192307 (0.0006) [2023-12-28 03:48:21,627][106225] Updated weights for policy 1, policy_version 1192317 (0.0007) [2023-12-28 03:48:21,634][106226] Updated weights for policy 0, policy_version 1189373 (0.0014) [2023-12-28 03:48:21,693][106225] Updated weights for policy 1, policy_version 1192327 (0.0007) [2023-12-28 03:48:21,698][106226] Updated weights for policy 0, policy_version 1189383 (0.0009) [2023-12-28 03:48:21,773][106226] Updated weights for policy 0, policy_version 1189393 (0.0009) [2023-12-28 03:48:22,429][106225] Updated weights for policy 1, policy_version 1192337 (0.0008) [2023-12-28 03:48:22,492][106225] Updated weights for policy 1, policy_version 1192347 (0.0005) [2023-12-28 03:48:22,530][106226] Updated weights for policy 0, policy_version 1189403 (0.0011) [2023-12-28 03:48:22,560][106225] Updated weights for policy 1, policy_version 1192357 (0.0005) [2023-12-28 03:48:22,595][106226] Updated weights for policy 0, policy_version 1189413 (0.0008) [2023-12-28 03:48:22,662][106226] Updated weights for policy 0, policy_version 1189423 (0.0008) [2023-12-28 03:48:23,220][106225] Updated weights for policy 1, policy_version 1192367 (0.0009) [2023-12-28 03:48:23,280][106225] Updated weights for policy 1, policy_version 1192377 (0.0010) [2023-12-28 03:48:23,303][106226] Updated weights for policy 0, policy_version 1189433 (0.0008) [2023-12-28 03:48:23,347][106225] Updated weights for policy 1, policy_version 1192387 (0.0010) [2023-12-28 03:48:23,368][106226] Updated weights for policy 0, policy_version 1189443 (0.0005) [2023-12-28 03:48:23,424][106226] Updated weights for policy 0, policy_version 1189453 (0.0007) [2023-12-28 03:48:23,477][106226] Updated weights for policy 0, policy_version 1189463 (0.0007) [2023-12-28 03:48:24,016][106225] Updated weights for policy 1, policy_version 1192397 (0.0010) [2023-12-28 03:48:24,073][106225] Updated weights for policy 1, policy_version 1192407 (0.0010) [2023-12-28 03:48:24,075][106226] Updated weights for policy 0, policy_version 1189473 (0.0006) [2023-12-28 03:48:24,123][106225] Updated weights for policy 1, policy_version 1192417 (0.0010) [2023-12-28 03:48:24,131][106226] Updated weights for policy 0, policy_version 1189483 (0.0005) [2023-12-28 03:48:24,189][106226] Updated weights for policy 0, policy_version 1189493 (0.0005) [2023-12-28 03:48:24,849][106226] Updated weights for policy 0, policy_version 1189503 (0.0008) [2023-12-28 03:48:24,850][106225] Updated weights for policy 1, policy_version 1192427 (0.0007) [2023-12-28 03:48:24,905][106225] Updated weights for policy 1, policy_version 1192437 (0.0005) [2023-12-28 03:48:24,915][106226] Updated weights for policy 0, policy_version 1189513 (0.0007) [2023-12-28 03:48:24,955][106225] Updated weights for policy 1, policy_version 1192447 (0.0005) [2023-12-28 03:48:24,968][106226] Updated weights for policy 0, policy_version 1189523 (0.0008) [2023-12-28 03:48:25,513][106225] Updated weights for policy 1, policy_version 1192457 (0.0006) [2023-12-28 03:48:25,565][106225] Updated weights for policy 1, policy_version 1192467 (0.0008) [2023-12-28 03:48:25,617][106225] Updated weights for policy 1, policy_version 1192477 (0.0008) [2023-12-28 03:48:25,673][106225] Updated weights for policy 1, policy_version 1192487 (0.0008) [2023-12-28 03:48:25,753][106226] Updated weights for policy 0, policy_version 1189533 (0.0008) [2023-12-28 03:48:25,807][106226] Updated weights for policy 0, policy_version 1189543 (0.0009) [2023-12-28 03:48:25,862][106226] Updated weights for policy 0, policy_version 1189553 (0.0007) [2023-12-28 03:48:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 609910784. Throughput: 0: 9853.4, 1: 9764.8. Samples: 609879876. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:26,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.845')] [2023-12-28 03:48:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001189560_304586752.pth... [2023-12-28 03:48:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001192488_305324032.pth... [2023-12-28 03:48:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001188408_304291840.pth [2023-12-28 03:48:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001191368_305037312.pth [2023-12-28 03:48:26,381][106225] Updated weights for policy 1, policy_version 1192497 (0.0008) [2023-12-28 03:48:26,429][106225] Updated weights for policy 1, policy_version 1192507 (0.0008) [2023-12-28 03:48:26,478][106225] Updated weights for policy 1, policy_version 1192517 (0.0008) [2023-12-28 03:48:26,531][106226] Updated weights for policy 0, policy_version 1189563 (0.0008) [2023-12-28 03:48:26,589][106226] Updated weights for policy 0, policy_version 1189573 (0.0008) [2023-12-28 03:48:26,642][106226] Updated weights for policy 0, policy_version 1189583 (0.0008) [2023-12-28 03:48:27,228][106225] Updated weights for policy 1, policy_version 1192527 (0.0008) [2023-12-28 03:48:27,284][106225] Updated weights for policy 1, policy_version 1192537 (0.0008) [2023-12-28 03:48:27,336][106225] Updated weights for policy 1, policy_version 1192547 (0.0008) [2023-12-28 03:48:27,357][106226] Updated weights for policy 0, policy_version 1189593 (0.0007) [2023-12-28 03:48:27,413][106226] Updated weights for policy 0, policy_version 1189603 (0.0008) [2023-12-28 03:48:27,457][106226] Updated weights for policy 0, policy_version 1189613 (0.0008) [2023-12-28 03:48:27,519][106226] Updated weights for policy 0, policy_version 1189623 (0.0009) [2023-12-28 03:48:28,104][106225] Updated weights for policy 1, policy_version 1192557 (0.0008) [2023-12-28 03:48:28,160][106226] Updated weights for policy 0, policy_version 1189633 (0.0006) [2023-12-28 03:48:28,162][106225] Updated weights for policy 1, policy_version 1192567 (0.0007) [2023-12-28 03:48:28,204][106226] Updated weights for policy 0, policy_version 1189643 (0.0006) [2023-12-28 03:48:28,210][106225] Updated weights for policy 1, policy_version 1192577 (0.0006) [2023-12-28 03:48:28,254][106226] Updated weights for policy 0, policy_version 1189653 (0.0007) [2023-12-28 03:48:28,951][106225] Updated weights for policy 1, policy_version 1192587 (0.0006) [2023-12-28 03:48:29,000][106225] Updated weights for policy 1, policy_version 1192597 (0.0008) [2023-12-28 03:48:29,032][106226] Updated weights for policy 0, policy_version 1189663 (0.0006) [2023-12-28 03:48:29,043][106225] Updated weights for policy 1, policy_version 1192607 (0.0007) [2023-12-28 03:48:29,083][106226] Updated weights for policy 0, policy_version 1189673 (0.0005) [2023-12-28 03:48:29,140][106226] Updated weights for policy 0, policy_version 1189683 (0.0007) [2023-12-28 03:48:29,771][106225] Updated weights for policy 1, policy_version 1192617 (0.0009) [2023-12-28 03:48:29,827][106226] Updated weights for policy 0, policy_version 1189693 (0.0008) [2023-12-28 03:48:29,838][106225] Updated weights for policy 1, policy_version 1192627 (0.0008) [2023-12-28 03:48:29,894][106226] Updated weights for policy 0, policy_version 1189703 (0.0008) [2023-12-28 03:48:29,900][106225] Updated weights for policy 1, policy_version 1192637 (0.0006) [2023-12-28 03:48:29,961][106226] Updated weights for policy 0, policy_version 1189713 (0.0007) [2023-12-28 03:48:29,965][106225] Updated weights for policy 1, policy_version 1192647 (0.0007) [2023-12-28 03:48:30,592][106226] Updated weights for policy 0, policy_version 1189723 (0.0007) [2023-12-28 03:48:30,651][106226] Updated weights for policy 0, policy_version 1189733 (0.0008) [2023-12-28 03:48:30,705][106225] Updated weights for policy 1, policy_version 1192657 (0.0006) [2023-12-28 03:48:30,707][106226] Updated weights for policy 0, policy_version 1189743 (0.0007) [2023-12-28 03:48:30,763][106225] Updated weights for policy 1, policy_version 1192667 (0.0006) [2023-12-28 03:48:30,832][106225] Updated weights for policy 1, policy_version 1192677 (0.0009) [2023-12-28 03:48:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19663.4, 300 sec: 19799.7). Total num frames: 610009088. Throughput: 0: 9957.6, 1: 9799.0. Samples: 609998824. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:31,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-5.014')] [2023-12-28 03:48:31,299][106226] Updated weights for policy 0, policy_version 1189753 (0.0006) [2023-12-28 03:48:31,346][106226] Updated weights for policy 0, policy_version 1189763 (0.0008) [2023-12-28 03:48:31,414][106226] Updated weights for policy 0, policy_version 1189773 (0.0010) [2023-12-28 03:48:31,477][106226] Updated weights for policy 0, policy_version 1189783 (0.0008) [2023-12-28 03:48:31,604][106225] Updated weights for policy 1, policy_version 1192687 (0.0009) [2023-12-28 03:48:31,670][106225] Updated weights for policy 1, policy_version 1192697 (0.0009) [2023-12-28 03:48:31,723][106225] Updated weights for policy 1, policy_version 1192707 (0.0008) [2023-12-28 03:48:32,247][106226] Updated weights for policy 0, policy_version 1189793 (0.0009) [2023-12-28 03:48:32,313][106226] Updated weights for policy 0, policy_version 1189803 (0.0008) [2023-12-28 03:48:32,377][106226] Updated weights for policy 0, policy_version 1189813 (0.0008) [2023-12-28 03:48:32,445][106225] Updated weights for policy 1, policy_version 1192717 (0.0009) [2023-12-28 03:48:32,495][106225] Updated weights for policy 1, policy_version 1192727 (0.0009) [2023-12-28 03:48:32,558][106225] Updated weights for policy 1, policy_version 1192737 (0.0008) [2023-12-28 03:48:33,036][106226] Updated weights for policy 0, policy_version 1189823 (0.0006) [2023-12-28 03:48:33,089][106226] Updated weights for policy 0, policy_version 1189833 (0.0009) [2023-12-28 03:48:33,133][106226] Updated weights for policy 0, policy_version 1189843 (0.0008) [2023-12-28 03:48:33,235][106225] Updated weights for policy 1, policy_version 1192747 (0.0009) [2023-12-28 03:48:33,290][106225] Updated weights for policy 1, policy_version 1192757 (0.0005) [2023-12-28 03:48:33,338][106225] Updated weights for policy 1, policy_version 1192767 (0.0005) [2023-12-28 03:48:33,789][106226] Updated weights for policy 0, policy_version 1189853 (0.0009) [2023-12-28 03:48:33,840][106226] Updated weights for policy 0, policy_version 1189863 (0.0008) [2023-12-28 03:48:33,895][106226] Updated weights for policy 0, policy_version 1189873 (0.0009) [2023-12-28 03:48:34,016][106225] Updated weights for policy 1, policy_version 1192777 (0.0005) [2023-12-28 03:48:34,059][106225] Updated weights for policy 1, policy_version 1192787 (0.0005) [2023-12-28 03:48:34,116][106225] Updated weights for policy 1, policy_version 1192797 (0.0007) [2023-12-28 03:48:34,178][106225] Updated weights for policy 1, policy_version 1192807 (0.0008) [2023-12-28 03:48:34,585][106226] Updated weights for policy 0, policy_version 1189883 (0.0007) [2023-12-28 03:48:34,650][106226] Updated weights for policy 0, policy_version 1189893 (0.0008) [2023-12-28 03:48:34,719][106226] Updated weights for policy 0, policy_version 1189903 (0.0009) [2023-12-28 03:48:34,896][106225] Updated weights for policy 1, policy_version 1192817 (0.0005) [2023-12-28 03:48:34,954][106225] Updated weights for policy 1, policy_version 1192827 (0.0005) [2023-12-28 03:48:35,004][106225] Updated weights for policy 1, policy_version 1192837 (0.0005) [2023-12-28 03:48:35,350][106226] Updated weights for policy 0, policy_version 1189913 (0.0010) [2023-12-28 03:48:35,416][106226] Updated weights for policy 0, policy_version 1189923 (0.0011) [2023-12-28 03:48:35,489][106226] Updated weights for policy 0, policy_version 1189933 (0.0011) [2023-12-28 03:48:35,529][106225] Updated weights for policy 1, policy_version 1192847 (0.0005) [2023-12-28 03:48:35,546][106226] Updated weights for policy 0, policy_version 1189943 (0.0010) [2023-12-28 03:48:35,585][106225] Updated weights for policy 1, policy_version 1192857 (0.0006) [2023-12-28 03:48:35,635][106225] Updated weights for policy 1, policy_version 1192867 (0.0009) [2023-12-28 03:48:36,087][106226] Updated weights for policy 0, policy_version 1189953 (0.0009) [2023-12-28 03:48:36,156][106226] Updated weights for policy 0, policy_version 1189963 (0.0008) [2023-12-28 03:48:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 610107392. Throughput: 0: 10080.0, 1: 9807.1. Samples: 610122564. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:36,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-5.009')] [2023-12-28 03:48:36,214][106226] Updated weights for policy 0, policy_version 1189973 (0.0008) [2023-12-28 03:48:36,445][106225] Updated weights for policy 1, policy_version 1192877 (0.0009) [2023-12-28 03:48:36,504][106225] Updated weights for policy 1, policy_version 1192887 (0.0010) [2023-12-28 03:48:36,566][106225] Updated weights for policy 1, policy_version 1192897 (0.0011) [2023-12-28 03:48:36,941][106226] Updated weights for policy 0, policy_version 1189983 (0.0010) [2023-12-28 03:48:37,010][106226] Updated weights for policy 0, policy_version 1189993 (0.0008) [2023-12-28 03:48:37,064][106226] Updated weights for policy 0, policy_version 1190003 (0.0010) [2023-12-28 03:48:37,273][106225] Updated weights for policy 1, policy_version 1192907 (0.0011) [2023-12-28 03:48:37,329][106225] Updated weights for policy 1, policy_version 1192917 (0.0010) [2023-12-28 03:48:37,382][106225] Updated weights for policy 1, policy_version 1192927 (0.0010) [2023-12-28 03:48:37,761][106226] Updated weights for policy 0, policy_version 1190013 (0.0008) [2023-12-28 03:48:37,829][106226] Updated weights for policy 0, policy_version 1190023 (0.0006) [2023-12-28 03:48:37,890][106226] Updated weights for policy 0, policy_version 1190033 (0.0005) [2023-12-28 03:48:38,086][106225] Updated weights for policy 1, policy_version 1192937 (0.0010) [2023-12-28 03:48:38,145][106225] Updated weights for policy 1, policy_version 1192947 (0.0009) [2023-12-28 03:48:38,198][106225] Updated weights for policy 1, policy_version 1192957 (0.0010) [2023-12-28 03:48:38,246][106225] Updated weights for policy 1, policy_version 1192967 (0.0006) [2023-12-28 03:48:38,533][106226] Updated weights for policy 0, policy_version 1190043 (0.0007) [2023-12-28 03:48:38,597][106226] Updated weights for policy 0, policy_version 1190053 (0.0011) [2023-12-28 03:48:38,651][106226] Updated weights for policy 0, policy_version 1190063 (0.0010) [2023-12-28 03:48:38,931][106225] Updated weights for policy 1, policy_version 1192977 (0.0010) [2023-12-28 03:48:38,985][106225] Updated weights for policy 1, policy_version 1192987 (0.0010) [2023-12-28 03:48:39,035][106225] Updated weights for policy 1, policy_version 1192997 (0.0010) [2023-12-28 03:48:39,384][106226] Updated weights for policy 0, policy_version 1190073 (0.0010) [2023-12-28 03:48:39,452][106226] Updated weights for policy 0, policy_version 1190083 (0.0007) [2023-12-28 03:48:39,517][106226] Updated weights for policy 0, policy_version 1190093 (0.0009) [2023-12-28 03:48:39,585][106226] Updated weights for policy 0, policy_version 1190103 (0.0010) [2023-12-28 03:48:39,804][106225] Updated weights for policy 1, policy_version 1193007 (0.0009) [2023-12-28 03:48:39,873][106225] Updated weights for policy 1, policy_version 1193017 (0.0008) [2023-12-28 03:48:39,942][106225] Updated weights for policy 1, policy_version 1193027 (0.0007) [2023-12-28 03:48:40,298][106226] Updated weights for policy 0, policy_version 1190113 (0.0007) [2023-12-28 03:48:40,356][106226] Updated weights for policy 0, policy_version 1190123 (0.0008) [2023-12-28 03:48:40,413][106226] Updated weights for policy 0, policy_version 1190133 (0.0008) [2023-12-28 03:48:40,610][106225] Updated weights for policy 1, policy_version 1193037 (0.0009) [2023-12-28 03:48:40,671][106225] Updated weights for policy 1, policy_version 1193047 (0.0010) [2023-12-28 03:48:40,727][106225] Updated weights for policy 1, policy_version 1193057 (0.0010) [2023-12-28 03:48:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 610205696. Throughput: 0: 10078.9, 1: 9778.2. Samples: 610181176. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:41,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.154')] [2023-12-28 03:48:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001193064_305471488.pth... [2023-12-28 03:48:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001191944_305184768.pth [2023-12-28 03:48:41,198][106226] Updated weights for policy 0, policy_version 1190143 (0.0008) [2023-12-28 03:48:41,264][106226] Updated weights for policy 0, policy_version 1190153 (0.0008) [2023-12-28 03:48:41,331][106226] Updated weights for policy 0, policy_version 1190163 (0.0010) [2023-12-28 03:48:41,365][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001190168_304742400.pth... [2023-12-28 03:48:41,374][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001188984_304439296.pth [2023-12-28 03:48:41,462][106225] Updated weights for policy 1, policy_version 1193067 (0.0009) [2023-12-28 03:48:41,515][106225] Updated weights for policy 1, policy_version 1193077 (0.0005) [2023-12-28 03:48:41,582][106225] Updated weights for policy 1, policy_version 1193087 (0.0007) [2023-12-28 03:48:42,070][106226] Updated weights for policy 0, policy_version 1190173 (0.0009) [2023-12-28 03:48:42,131][106226] Updated weights for policy 0, policy_version 1190183 (0.0011) [2023-12-28 03:48:42,193][106226] Updated weights for policy 0, policy_version 1190193 (0.0006) [2023-12-28 03:48:42,309][106225] Updated weights for policy 1, policy_version 1193097 (0.0009) [2023-12-28 03:48:42,375][106225] Updated weights for policy 1, policy_version 1193107 (0.0010) [2023-12-28 03:48:42,449][106225] Updated weights for policy 1, policy_version 1193117 (0.0008) [2023-12-28 03:48:42,512][106225] Updated weights for policy 1, policy_version 1193127 (0.0010) [2023-12-28 03:48:42,865][106226] Updated weights for policy 0, policy_version 1190203 (0.0007) [2023-12-28 03:48:42,924][106226] Updated weights for policy 0, policy_version 1190213 (0.0011) [2023-12-28 03:48:42,986][106226] Updated weights for policy 0, policy_version 1190223 (0.0011) [2023-12-28 03:48:43,225][106225] Updated weights for policy 1, policy_version 1193137 (0.0010) [2023-12-28 03:48:43,274][106225] Updated weights for policy 1, policy_version 1193147 (0.0010) [2023-12-28 03:48:43,333][106225] Updated weights for policy 1, policy_version 1193157 (0.0010) [2023-12-28 03:48:43,701][106226] Updated weights for policy 0, policy_version 1190233 (0.0010) [2023-12-28 03:48:43,753][106226] Updated weights for policy 0, policy_version 1190243 (0.0005) [2023-12-28 03:48:43,804][106226] Updated weights for policy 0, policy_version 1190253 (0.0007) [2023-12-28 03:48:43,854][106226] Updated weights for policy 0, policy_version 1190263 (0.0010) [2023-12-28 03:48:43,900][106225] Updated weights for policy 1, policy_version 1193167 (0.0008) [2023-12-28 03:48:43,969][106225] Updated weights for policy 1, policy_version 1193177 (0.0006) [2023-12-28 03:48:44,036][106225] Updated weights for policy 1, policy_version 1193187 (0.0006) [2023-12-28 03:48:44,439][106226] Updated weights for policy 0, policy_version 1190273 (0.0006) [2023-12-28 03:48:44,487][106226] Updated weights for policy 0, policy_version 1190283 (0.0005) [2023-12-28 03:48:44,540][106226] Updated weights for policy 0, policy_version 1190293 (0.0005) [2023-12-28 03:48:44,584][106225] Updated weights for policy 1, policy_version 1193197 (0.0008) [2023-12-28 03:48:44,649][106225] Updated weights for policy 1, policy_version 1193207 (0.0010) [2023-12-28 03:48:44,710][106225] Updated weights for policy 1, policy_version 1193217 (0.0010) [2023-12-28 03:48:45,166][106226] Updated weights for policy 0, policy_version 1190303 (0.0007) [2023-12-28 03:48:45,231][106226] Updated weights for policy 0, policy_version 1190313 (0.0009) [2023-12-28 03:48:45,289][106226] Updated weights for policy 0, policy_version 1190323 (0.0009) [2023-12-28 03:48:45,399][106225] Updated weights for policy 1, policy_version 1193227 (0.0009) [2023-12-28 03:48:45,471][106225] Updated weights for policy 1, policy_version 1193237 (0.0007) [2023-12-28 03:48:45,540][106225] Updated weights for policy 1, policy_version 1193247 (0.0008) [2023-12-28 03:48:45,937][106226] Updated weights for policy 0, policy_version 1190333 (0.0008) [2023-12-28 03:48:46,002][106226] Updated weights for policy 0, policy_version 1190343 (0.0006) [2023-12-28 03:48:46,065][106226] Updated weights for policy 0, policy_version 1190353 (0.0005) [2023-12-28 03:48:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 610312192. Throughput: 0: 10051.7, 1: 9702.5. Samples: 610300432. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:46,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.933')] [2023-12-28 03:48:46,248][106225] Updated weights for policy 1, policy_version 1193257 (0.0011) [2023-12-28 03:48:46,304][106225] Updated weights for policy 1, policy_version 1193267 (0.0010) [2023-12-28 03:48:46,367][106225] Updated weights for policy 1, policy_version 1193277 (0.0010) [2023-12-28 03:48:46,431][106225] Updated weights for policy 1, policy_version 1193287 (0.0010) [2023-12-28 03:48:46,715][106226] Updated weights for policy 0, policy_version 1190363 (0.0007) [2023-12-28 03:48:46,775][106226] Updated weights for policy 0, policy_version 1190373 (0.0009) [2023-12-28 03:48:46,838][106226] Updated weights for policy 0, policy_version 1190383 (0.0011) [2023-12-28 03:48:47,029][106225] Updated weights for policy 1, policy_version 1193297 (0.0006) [2023-12-28 03:48:47,093][106225] Updated weights for policy 1, policy_version 1193307 (0.0007) [2023-12-28 03:48:47,154][106225] Updated weights for policy 1, policy_version 1193317 (0.0005) [2023-12-28 03:48:47,510][106226] Updated weights for policy 0, policy_version 1190393 (0.0010) [2023-12-28 03:48:47,572][106226] Updated weights for policy 0, policy_version 1190403 (0.0005) [2023-12-28 03:48:47,630][106226] Updated weights for policy 0, policy_version 1190413 (0.0005) [2023-12-28 03:48:47,692][106226] Updated weights for policy 0, policy_version 1190423 (0.0005) [2023-12-28 03:48:47,722][106225] Updated weights for policy 1, policy_version 1193327 (0.0009) [2023-12-28 03:48:47,777][106225] Updated weights for policy 1, policy_version 1193337 (0.0010) [2023-12-28 03:48:47,827][106225] Updated weights for policy 1, policy_version 1193347 (0.0010) [2023-12-28 03:48:48,301][106226] Updated weights for policy 0, policy_version 1190433 (0.0008) [2023-12-28 03:48:48,367][106226] Updated weights for policy 0, policy_version 1190443 (0.0009) [2023-12-28 03:48:48,434][106226] Updated weights for policy 0, policy_version 1190453 (0.0008) [2023-12-28 03:48:48,553][106225] Updated weights for policy 1, policy_version 1193357 (0.0009) [2023-12-28 03:48:48,611][106225] Updated weights for policy 1, policy_version 1193367 (0.0008) [2023-12-28 03:48:48,665][106225] Updated weights for policy 1, policy_version 1193377 (0.0005) [2023-12-28 03:48:49,255][106225] Updated weights for policy 1, policy_version 1193387 (0.0007) [2023-12-28 03:48:49,278][106226] Updated weights for policy 0, policy_version 1190463 (0.0008) [2023-12-28 03:48:49,317][106225] Updated weights for policy 1, policy_version 1193397 (0.0007) [2023-12-28 03:48:49,342][106226] Updated weights for policy 0, policy_version 1190473 (0.0007) [2023-12-28 03:48:49,381][106225] Updated weights for policy 1, policy_version 1193407 (0.0007) [2023-12-28 03:48:49,410][106226] Updated weights for policy 0, policy_version 1190483 (0.0008) [2023-12-28 03:48:50,133][106226] Updated weights for policy 0, policy_version 1190493 (0.0008) [2023-12-28 03:48:50,146][106225] Updated weights for policy 1, policy_version 1193417 (0.0008) [2023-12-28 03:48:50,194][106226] Updated weights for policy 0, policy_version 1190503 (0.0009) [2023-12-28 03:48:50,199][106225] Updated weights for policy 1, policy_version 1193427 (0.0007) [2023-12-28 03:48:50,248][106225] Updated weights for policy 1, policy_version 1193437 (0.0006) [2023-12-28 03:48:50,252][106226] Updated weights for policy 0, policy_version 1190513 (0.0009) [2023-12-28 03:48:50,301][106225] Updated weights for policy 1, policy_version 1193447 (0.0007) [2023-12-28 03:48:51,009][106225] Updated weights for policy 1, policy_version 1193457 (0.0008) [2023-12-28 03:48:51,036][106226] Updated weights for policy 0, policy_version 1190523 (0.0008) [2023-12-28 03:48:51,075][106225] Updated weights for policy 1, policy_version 1193467 (0.0007) [2023-12-28 03:48:51,101][106226] Updated weights for policy 0, policy_version 1190533 (0.0007) [2023-12-28 03:48:51,144][106225] Updated weights for policy 1, policy_version 1193477 (0.0008) [2023-12-28 03:48:51,164][106226] Updated weights for policy 0, policy_version 1190543 (0.0008) [2023-12-28 03:48:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 610410496. Throughput: 0: 9992.5, 1: 9750.7. Samples: 610419936. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:51,175][105115] Avg episode reward: [(0, '-5.278'), (1, '-4.976')] [2023-12-28 03:48:51,816][106225] Updated weights for policy 1, policy_version 1193487 (0.0009) [2023-12-28 03:48:51,869][106225] Updated weights for policy 1, policy_version 1193497 (0.0006) [2023-12-28 03:48:51,919][106226] Updated weights for policy 0, policy_version 1190553 (0.0008) [2023-12-28 03:48:51,930][106225] Updated weights for policy 1, policy_version 1193507 (0.0009) [2023-12-28 03:48:51,970][106226] Updated weights for policy 0, policy_version 1190563 (0.0005) [2023-12-28 03:48:52,022][106226] Updated weights for policy 0, policy_version 1190573 (0.0005) [2023-12-28 03:48:52,077][106226] Updated weights for policy 0, policy_version 1190583 (0.0006) [2023-12-28 03:48:52,673][106226] Updated weights for policy 0, policy_version 1190593 (0.0005) [2023-12-28 03:48:52,720][106226] Updated weights for policy 0, policy_version 1190603 (0.0008) [2023-12-28 03:48:52,759][106225] Updated weights for policy 1, policy_version 1193517 (0.0007) [2023-12-28 03:48:52,781][106226] Updated weights for policy 0, policy_version 1190613 (0.0007) [2023-12-28 03:48:52,819][106225] Updated weights for policy 1, policy_version 1193527 (0.0007) [2023-12-28 03:48:52,870][106225] Updated weights for policy 1, policy_version 1193537 (0.0008) [2023-12-28 03:48:53,475][106225] Updated weights for policy 1, policy_version 1193547 (0.0009) [2023-12-28 03:48:53,535][106225] Updated weights for policy 1, policy_version 1193557 (0.0007) [2023-12-28 03:48:53,542][106226] Updated weights for policy 0, policy_version 1190623 (0.0007) [2023-12-28 03:48:53,602][106225] Updated weights for policy 1, policy_version 1193567 (0.0005) [2023-12-28 03:48:53,604][106226] Updated weights for policy 0, policy_version 1190633 (0.0008) [2023-12-28 03:48:53,670][106226] Updated weights for policy 0, policy_version 1190643 (0.0010) [2023-12-28 03:48:54,264][106225] Updated weights for policy 1, policy_version 1193577 (0.0005) [2023-12-28 03:48:54,326][106225] Updated weights for policy 1, policy_version 1193587 (0.0007) [2023-12-28 03:48:54,389][106225] Updated weights for policy 1, policy_version 1193597 (0.0005) [2023-12-28 03:48:54,422][106226] Updated weights for policy 0, policy_version 1190653 (0.0008) [2023-12-28 03:48:54,456][106225] Updated weights for policy 1, policy_version 1193607 (0.0005) [2023-12-28 03:48:54,484][106226] Updated weights for policy 0, policy_version 1190663 (0.0008) [2023-12-28 03:48:54,534][106226] Updated weights for policy 0, policy_version 1190673 (0.0009) [2023-12-28 03:48:55,043][106225] Updated weights for policy 1, policy_version 1193617 (0.0009) [2023-12-28 03:48:55,102][106225] Updated weights for policy 1, policy_version 1193627 (0.0006) [2023-12-28 03:48:55,163][106225] Updated weights for policy 1, policy_version 1193637 (0.0008) [2023-12-28 03:48:55,239][106226] Updated weights for policy 0, policy_version 1190683 (0.0009) [2023-12-28 03:48:55,290][106226] Updated weights for policy 0, policy_version 1190693 (0.0005) [2023-12-28 03:48:55,337][106226] Updated weights for policy 0, policy_version 1190703 (0.0008) [2023-12-28 03:48:55,889][106225] Updated weights for policy 1, policy_version 1193647 (0.0009) [2023-12-28 03:48:55,943][106225] Updated weights for policy 1, policy_version 1193657 (0.0009) [2023-12-28 03:48:55,988][106226] Updated weights for policy 0, policy_version 1190713 (0.0008) [2023-12-28 03:48:55,996][106225] Updated weights for policy 1, policy_version 1193667 (0.0006) [2023-12-28 03:48:56,046][106226] Updated weights for policy 0, policy_version 1190723 (0.0007) [2023-12-28 03:48:56,104][106226] Updated weights for policy 0, policy_version 1190733 (0.0008) [2023-12-28 03:48:56,169][106226] Updated weights for policy 0, policy_version 1190743 (0.0007) [2023-12-28 03:48:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 610508800. Throughput: 0: 9987.5, 1: 9798.2. Samples: 610479348. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:48:56,176][105115] Avg episode reward: [(0, '-4.601'), (1, '-5.156')] [2023-12-28 03:48:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001193672_305627136.pth... [2023-12-28 03:48:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001190744_304889856.pth... [2023-12-28 03:48:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001192488_305324032.pth [2023-12-28 03:48:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001189560_304586752.pth [2023-12-28 03:48:56,689][106225] Updated weights for policy 1, policy_version 1193677 (0.0008) [2023-12-28 03:48:56,734][106225] Updated weights for policy 1, policy_version 1193687 (0.0008) [2023-12-28 03:48:56,786][106225] Updated weights for policy 1, policy_version 1193697 (0.0007) [2023-12-28 03:48:56,813][106226] Updated weights for policy 0, policy_version 1190753 (0.0007) [2023-12-28 03:48:56,867][106226] Updated weights for policy 0, policy_version 1190763 (0.0008) [2023-12-28 03:48:56,919][106226] Updated weights for policy 0, policy_version 1190773 (0.0008) [2023-12-28 03:48:57,548][106225] Updated weights for policy 1, policy_version 1193707 (0.0007) [2023-12-28 03:48:57,565][106226] Updated weights for policy 0, policy_version 1190783 (0.0008) [2023-12-28 03:48:57,605][106225] Updated weights for policy 1, policy_version 1193717 (0.0006) [2023-12-28 03:48:57,609][106226] Updated weights for policy 0, policy_version 1190793 (0.0006) [2023-12-28 03:48:57,663][106226] Updated weights for policy 0, policy_version 1190803 (0.0006) [2023-12-28 03:48:57,668][106225] Updated weights for policy 1, policy_version 1193727 (0.0008) [2023-12-28 03:48:58,356][106226] Updated weights for policy 0, policy_version 1190813 (0.0007) [2023-12-28 03:48:58,417][106225] Updated weights for policy 1, policy_version 1193737 (0.0008) [2023-12-28 03:48:58,424][106226] Updated weights for policy 0, policy_version 1190823 (0.0007) [2023-12-28 03:48:58,478][106225] Updated weights for policy 1, policy_version 1193747 (0.0008) [2023-12-28 03:48:58,487][106226] Updated weights for policy 0, policy_version 1190833 (0.0007) [2023-12-28 03:48:58,544][106225] Updated weights for policy 1, policy_version 1193757 (0.0008) [2023-12-28 03:48:58,604][106225] Updated weights for policy 1, policy_version 1193767 (0.0008) [2023-12-28 03:48:59,319][106226] Updated weights for policy 0, policy_version 1190843 (0.0007) [2023-12-28 03:48:59,389][106226] Updated weights for policy 0, policy_version 1190853 (0.0009) [2023-12-28 03:48:59,414][106225] Updated weights for policy 1, policy_version 1193777 (0.0009) [2023-12-28 03:48:59,450][106226] Updated weights for policy 0, policy_version 1190863 (0.0006) [2023-12-28 03:48:59,474][106225] Updated weights for policy 1, policy_version 1193787 (0.0007) [2023-12-28 03:48:59,533][106225] Updated weights for policy 1, policy_version 1193797 (0.0009) [2023-12-28 03:49:00,124][106226] Updated weights for policy 0, policy_version 1190873 (0.0006) [2023-12-28 03:49:00,186][106226] Updated weights for policy 0, policy_version 1190883 (0.0008) [2023-12-28 03:49:00,250][106226] Updated weights for policy 0, policy_version 1190893 (0.0008) [2023-12-28 03:49:00,310][106226] Updated weights for policy 0, policy_version 1190903 (0.0009) [2023-12-28 03:49:00,326][106225] Updated weights for policy 1, policy_version 1193807 (0.0009) [2023-12-28 03:49:00,382][106225] Updated weights for policy 1, policy_version 1193817 (0.0009) [2023-12-28 03:49:00,442][106225] Updated weights for policy 1, policy_version 1193827 (0.0010) [2023-12-28 03:49:00,983][106226] Updated weights for policy 0, policy_version 1190913 (0.0006) [2023-12-28 03:49:01,046][106226] Updated weights for policy 0, policy_version 1190923 (0.0008) [2023-12-28 03:49:01,111][106226] Updated weights for policy 0, policy_version 1190933 (0.0008) [2023-12-28 03:49:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 610607104. Throughput: 0: 10076.0, 1: 9812.7. Samples: 610596648. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:49:01,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-4.994')] [2023-12-28 03:49:01,240][106225] Updated weights for policy 1, policy_version 1193837 (0.0008) [2023-12-28 03:49:01,301][106225] Updated weights for policy 1, policy_version 1193847 (0.0008) [2023-12-28 03:49:01,358][106225] Updated weights for policy 1, policy_version 1193857 (0.0008) [2023-12-28 03:49:01,806][106226] Updated weights for policy 0, policy_version 1190943 (0.0008) [2023-12-28 03:49:01,860][106226] Updated weights for policy 0, policy_version 1190953 (0.0009) [2023-12-28 03:49:01,922][106226] Updated weights for policy 0, policy_version 1190963 (0.0008) [2023-12-28 03:49:02,006][106225] Updated weights for policy 1, policy_version 1193867 (0.0007) [2023-12-28 03:49:02,068][106225] Updated weights for policy 1, policy_version 1193877 (0.0008) [2023-12-28 03:49:02,128][106225] Updated weights for policy 1, policy_version 1193887 (0.0009) [2023-12-28 03:49:02,600][106226] Updated weights for policy 0, policy_version 1190973 (0.0008) [2023-12-28 03:49:02,661][106226] Updated weights for policy 0, policy_version 1190983 (0.0005) [2023-12-28 03:49:02,722][106226] Updated weights for policy 0, policy_version 1190993 (0.0008) [2023-12-28 03:49:02,913][106225] Updated weights for policy 1, policy_version 1193897 (0.0008) [2023-12-28 03:49:02,973][106225] Updated weights for policy 1, policy_version 1193907 (0.0009) [2023-12-28 03:49:03,030][106225] Updated weights for policy 1, policy_version 1193917 (0.0009) [2023-12-28 03:49:03,084][106225] Updated weights for policy 1, policy_version 1193927 (0.0008) [2023-12-28 03:49:03,418][106226] Updated weights for policy 0, policy_version 1191003 (0.0009) [2023-12-28 03:49:03,466][106226] Updated weights for policy 0, policy_version 1191013 (0.0008) [2023-12-28 03:49:03,513][106226] Updated weights for policy 0, policy_version 1191023 (0.0008) [2023-12-28 03:49:03,798][106225] Updated weights for policy 1, policy_version 1193937 (0.0008) [2023-12-28 03:49:03,856][106225] Updated weights for policy 1, policy_version 1193947 (0.0008) [2023-12-28 03:49:03,912][106225] Updated weights for policy 1, policy_version 1193957 (0.0008) [2023-12-28 03:49:04,248][106226] Updated weights for policy 0, policy_version 1191033 (0.0009) [2023-12-28 03:49:04,310][106226] Updated weights for policy 0, policy_version 1191043 (0.0009) [2023-12-28 03:49:04,378][106226] Updated weights for policy 0, policy_version 1191053 (0.0008) [2023-12-28 03:49:04,450][106226] Updated weights for policy 0, policy_version 1191063 (0.0005) [2023-12-28 03:49:04,676][106225] Updated weights for policy 1, policy_version 1193967 (0.0009) [2023-12-28 03:49:04,738][106225] Updated weights for policy 1, policy_version 1193977 (0.0008) [2023-12-28 03:49:04,797][106225] Updated weights for policy 1, policy_version 1193987 (0.0008) [2023-12-28 03:49:05,121][106226] Updated weights for policy 0, policy_version 1191073 (0.0007) [2023-12-28 03:49:05,176][106226] Updated weights for policy 0, policy_version 1191083 (0.0007) [2023-12-28 03:49:05,234][106226] Updated weights for policy 0, policy_version 1191093 (0.0008) [2023-12-28 03:49:05,509][106225] Updated weights for policy 1, policy_version 1193997 (0.0009) [2023-12-28 03:49:05,569][106225] Updated weights for policy 1, policy_version 1194007 (0.0010) [2023-12-28 03:49:05,626][106225] Updated weights for policy 1, policy_version 1194017 (0.0010) [2023-12-28 03:49:05,923][106226] Updated weights for policy 0, policy_version 1191103 (0.0010) [2023-12-28 03:49:05,986][106226] Updated weights for policy 0, policy_version 1191113 (0.0011) [2023-12-28 03:49:06,049][106226] Updated weights for policy 0, policy_version 1191123 (0.0011) [2023-12-28 03:49:06,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 610705408. Throughput: 0: 9970.4, 1: 9856.2. Samples: 610712888. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:49:06,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-4.464')] [2023-12-28 03:49:06,352][106225] Updated weights for policy 1, policy_version 1194027 (0.0010) [2023-12-28 03:49:06,417][106225] Updated weights for policy 1, policy_version 1194037 (0.0010) [2023-12-28 03:49:06,482][106225] Updated weights for policy 1, policy_version 1194047 (0.0011) [2023-12-28 03:49:06,744][106226] Updated weights for policy 0, policy_version 1191133 (0.0009) [2023-12-28 03:49:06,809][106226] Updated weights for policy 0, policy_version 1191143 (0.0009) [2023-12-28 03:49:06,880][106226] Updated weights for policy 0, policy_version 1191154 (0.0009) [2023-12-28 03:49:07,211][106225] Updated weights for policy 1, policy_version 1194057 (0.0010) [2023-12-28 03:49:07,262][106225] Updated weights for policy 1, policy_version 1194067 (0.0011) [2023-12-28 03:49:07,317][106225] Updated weights for policy 1, policy_version 1194077 (0.0011) [2023-12-28 03:49:07,379][106225] Updated weights for policy 1, policy_version 1194087 (0.0011) [2023-12-28 03:49:07,598][106226] Updated weights for policy 0, policy_version 1191164 (0.0009) [2023-12-28 03:49:07,657][106226] Updated weights for policy 0, policy_version 1191174 (0.0010) [2023-12-28 03:49:07,710][106226] Updated weights for policy 0, policy_version 1191184 (0.0010) [2023-12-28 03:49:08,046][106225] Updated weights for policy 1, policy_version 1194097 (0.0010) [2023-12-28 03:49:08,101][106225] Updated weights for policy 1, policy_version 1194107 (0.0010) [2023-12-28 03:49:08,151][106225] Updated weights for policy 1, policy_version 1194117 (0.0010) [2023-12-28 03:49:08,443][106226] Updated weights for policy 0, policy_version 1191194 (0.0010) [2023-12-28 03:49:08,497][106226] Updated weights for policy 0, policy_version 1191204 (0.0011) [2023-12-28 03:49:08,552][106226] Updated weights for policy 0, policy_version 1191214 (0.0011) [2023-12-28 03:49:08,611][106226] Updated weights for policy 0, policy_version 1191224 (0.0011) [2023-12-28 03:49:08,856][106225] Updated weights for policy 1, policy_version 1194127 (0.0007) [2023-12-28 03:49:08,909][106225] Updated weights for policy 1, policy_version 1194137 (0.0005) [2023-12-28 03:49:08,965][106225] Updated weights for policy 1, policy_version 1194147 (0.0008) [2023-12-28 03:49:09,462][106226] Updated weights for policy 0, policy_version 1191234 (0.0007) [2023-12-28 03:49:09,516][106226] Updated weights for policy 0, policy_version 1191244 (0.0008) [2023-12-28 03:49:09,570][106226] Updated weights for policy 0, policy_version 1191254 (0.0009) [2023-12-28 03:49:09,669][106225] Updated weights for policy 1, policy_version 1194157 (0.0009) [2023-12-28 03:49:09,722][106225] Updated weights for policy 1, policy_version 1194167 (0.0009) [2023-12-28 03:49:09,791][106225] Updated weights for policy 1, policy_version 1194177 (0.0008) [2023-12-28 03:49:10,346][106226] Updated weights for policy 0, policy_version 1191264 (0.0009) [2023-12-28 03:49:10,409][106226] Updated weights for policy 0, policy_version 1191274 (0.0009) [2023-12-28 03:49:10,469][106226] Updated weights for policy 0, policy_version 1191284 (0.0009) [2023-12-28 03:49:10,567][106225] Updated weights for policy 1, policy_version 1194187 (0.0009) [2023-12-28 03:49:10,619][106225] Updated weights for policy 1, policy_version 1194197 (0.0008) [2023-12-28 03:49:10,667][106225] Updated weights for policy 1, policy_version 1194207 (0.0008) [2023-12-28 03:49:11,105][106226] Updated weights for policy 0, policy_version 1191294 (0.0009) [2023-12-28 03:49:11,175][106226] Updated weights for policy 0, policy_version 1191304 (0.0009) [2023-12-28 03:49:11,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 610795520. Throughput: 0: 9945.2, 1: 9864.8. Samples: 610771328. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 03:49:11,175][105115] Avg episode reward: [(0, '-4.869'), (1, '-4.796')] [2023-12-28 03:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001194216_305766400.pth... [2023-12-28 03:49:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001193064_305471488.pth [2023-12-28 03:49:11,232][106226] Updated weights for policy 0, policy_version 1191314 (0.0009) [2023-12-28 03:49:11,268][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001191320_305037312.pth... [2023-12-28 03:49:11,272][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001190168_304742400.pth [2023-12-28 03:49:11,398][106225] Updated weights for policy 1, policy_version 1194217 (0.0009) [2023-12-28 03:49:11,463][106225] Updated weights for policy 1, policy_version 1194227 (0.0008) [2023-12-28 03:49:11,518][106225] Updated weights for policy 1, policy_version 1194237 (0.0005) [2023-12-28 03:49:11,575][106225] Updated weights for policy 1, policy_version 1194247 (0.0005) [2023-12-28 03:49:12,059][106226] Updated weights for policy 0, policy_version 1191324 (0.0008) [2023-12-28 03:49:12,108][106226] Updated weights for policy 0, policy_version 1191334 (0.0008) [2023-12-28 03:49:12,166][106226] Updated weights for policy 0, policy_version 1191344 (0.0007) [2023-12-28 03:49:12,288][106225] Updated weights for policy 1, policy_version 1194257 (0.0008) [2023-12-28 03:49:12,358][106225] Updated weights for policy 1, policy_version 1194267 (0.0008) [2023-12-28 03:49:12,427][106225] Updated weights for policy 1, policy_version 1194277 (0.0006) [2023-12-28 03:49:12,959][106226] Updated weights for policy 0, policy_version 1191354 (0.0007) [2023-12-28 03:49:13,012][106226] Updated weights for policy 0, policy_version 1191364 (0.0009) [2023-12-28 03:49:13,063][106226] Updated weights for policy 0, policy_version 1191374 (0.0009) [2023-12-28 03:49:13,107][106225] Updated weights for policy 1, policy_version 1194287 (0.0010) [2023-12-28 03:49:13,110][106226] Updated weights for policy 0, policy_version 1191384 (0.0008) [2023-12-28 03:49:13,165][106225] Updated weights for policy 1, policy_version 1194297 (0.0010) [2023-12-28 03:49:13,235][106225] Updated weights for policy 1, policy_version 1194307 (0.0010) [2023-12-28 03:49:13,877][106226] Updated weights for policy 0, policy_version 1191394 (0.0009) [2023-12-28 03:49:13,881][106225] Updated weights for policy 1, policy_version 1194317 (0.0007) [2023-12-28 03:49:13,933][106226] Updated weights for policy 0, policy_version 1191404 (0.0008) [2023-12-28 03:49:13,936][106225] Updated weights for policy 1, policy_version 1194327 (0.0005) [2023-12-28 03:49:13,988][106226] Updated weights for policy 0, policy_version 1191414 (0.0007) [2023-12-28 03:49:13,993][106225] Updated weights for policy 1, policy_version 1194337 (0.0008) [2023-12-28 03:49:14,612][106226] Updated weights for policy 0, policy_version 1191424 (0.0009) [2023-12-28 03:49:14,650][106225] Updated weights for policy 1, policy_version 1194347 (0.0008) [2023-12-28 03:49:14,663][106226] Updated weights for policy 0, policy_version 1191434 (0.0008) [2023-12-28 03:49:14,708][106225] Updated weights for policy 1, policy_version 1194357 (0.0007) [2023-12-28 03:49:14,717][106226] Updated weights for policy 0, policy_version 1191444 (0.0006) [2023-12-28 03:49:14,771][106225] Updated weights for policy 1, policy_version 1194367 (0.0009) [2023-12-28 03:49:15,462][106225] Updated weights for policy 1, policy_version 1194377 (0.0007) [2023-12-28 03:49:15,480][106226] Updated weights for policy 0, policy_version 1191454 (0.0009) [2023-12-28 03:49:15,522][106225] Updated weights for policy 1, policy_version 1194387 (0.0006) [2023-12-28 03:49:15,539][106226] Updated weights for policy 0, policy_version 1191464 (0.0011) [2023-12-28 03:49:15,579][106225] Updated weights for policy 1, policy_version 1194397 (0.0006) [2023-12-28 03:49:15,597][106226] Updated weights for policy 0, policy_version 1191474 (0.0011) [2023-12-28 03:49:15,638][106225] Updated weights for policy 1, policy_version 1194407 (0.0005) [2023-12-28 03:49:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 610893824. Throughput: 0: 9869.2, 1: 9849.9. Samples: 610886180. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:16,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-4.712')] [2023-12-28 03:49:16,263][106225] Updated weights for policy 1, policy_version 1194417 (0.0008) [2023-12-28 03:49:16,270][106226] Updated weights for policy 0, policy_version 1191484 (0.0011) [2023-12-28 03:49:16,325][106225] Updated weights for policy 1, policy_version 1194427 (0.0006) [2023-12-28 03:49:16,328][106226] Updated weights for policy 0, policy_version 1191494 (0.0010) [2023-12-28 03:49:16,385][106225] Updated weights for policy 1, policy_version 1194437 (0.0007) [2023-12-28 03:49:16,388][106226] Updated weights for policy 0, policy_version 1191504 (0.0008) [2023-12-28 03:49:16,978][106226] Updated weights for policy 0, policy_version 1191514 (0.0008) [2023-12-28 03:49:17,032][106226] Updated weights for policy 0, policy_version 1191524 (0.0006) [2023-12-28 03:49:17,085][106226] Updated weights for policy 0, policy_version 1191534 (0.0010) [2023-12-28 03:49:17,141][106225] Updated weights for policy 1, policy_version 1194447 (0.0007) [2023-12-28 03:49:17,145][106226] Updated weights for policy 0, policy_version 1191544 (0.0007) [2023-12-28 03:49:17,205][106225] Updated weights for policy 1, policy_version 1194457 (0.0005) [2023-12-28 03:49:17,266][106225] Updated weights for policy 1, policy_version 1194467 (0.0007) [2023-12-28 03:49:17,829][106226] Updated weights for policy 0, policy_version 1191554 (0.0009) [2023-12-28 03:49:17,892][106226] Updated weights for policy 0, policy_version 1191564 (0.0008) [2023-12-28 03:49:17,934][106225] Updated weights for policy 1, policy_version 1194477 (0.0007) [2023-12-28 03:49:17,948][106226] Updated weights for policy 0, policy_version 1191574 (0.0008) [2023-12-28 03:49:17,983][106225] Updated weights for policy 1, policy_version 1194487 (0.0007) [2023-12-28 03:49:18,039][106225] Updated weights for policy 1, policy_version 1194497 (0.0007) [2023-12-28 03:49:18,725][106226] Updated weights for policy 0, policy_version 1191584 (0.0008) [2023-12-28 03:49:18,735][106225] Updated weights for policy 1, policy_version 1194507 (0.0006) [2023-12-28 03:49:18,780][106226] Updated weights for policy 0, policy_version 1191594 (0.0007) [2023-12-28 03:49:18,793][106225] Updated weights for policy 1, policy_version 1194517 (0.0009) [2023-12-28 03:49:18,834][106226] Updated weights for policy 0, policy_version 1191604 (0.0007) [2023-12-28 03:49:18,852][106225] Updated weights for policy 1, policy_version 1194527 (0.0008) [2023-12-28 03:49:19,610][106226] Updated weights for policy 0, policy_version 1191614 (0.0008) [2023-12-28 03:49:19,646][106225] Updated weights for policy 1, policy_version 1194537 (0.0008) [2023-12-28 03:49:19,672][106226] Updated weights for policy 0, policy_version 1191624 (0.0009) [2023-12-28 03:49:19,703][106225] Updated weights for policy 1, policy_version 1194547 (0.0008) [2023-12-28 03:49:19,727][106226] Updated weights for policy 0, policy_version 1191634 (0.0006) [2023-12-28 03:49:19,754][106225] Updated weights for policy 1, policy_version 1194557 (0.0007) [2023-12-28 03:49:19,817][106225] Updated weights for policy 1, policy_version 1194567 (0.0008) [2023-12-28 03:49:20,538][106225] Updated weights for policy 1, policy_version 1194577 (0.0008) [2023-12-28 03:49:20,543][106226] Updated weights for policy 0, policy_version 1191644 (0.0010) [2023-12-28 03:49:20,600][106225] Updated weights for policy 1, policy_version 1194587 (0.0007) [2023-12-28 03:49:20,612][106226] Updated weights for policy 0, policy_version 1191654 (0.0008) [2023-12-28 03:49:20,665][106225] Updated weights for policy 1, policy_version 1194597 (0.0010) [2023-12-28 03:49:20,672][106226] Updated weights for policy 0, policy_version 1191664 (0.0009) [2023-12-28 03:49:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 610992128. Throughput: 0: 9739.1, 1: 9816.4. Samples: 611002560. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:21,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.131')] [2023-12-28 03:49:21,402][106226] Updated weights for policy 0, policy_version 1191674 (0.0009) [2023-12-28 03:49:21,464][106226] Updated weights for policy 0, policy_version 1191684 (0.0007) [2023-12-28 03:49:21,485][106225] Updated weights for policy 1, policy_version 1194607 (0.0008) [2023-12-28 03:49:21,527][106226] Updated weights for policy 0, policy_version 1191694 (0.0007) [2023-12-28 03:49:21,545][106225] Updated weights for policy 1, policy_version 1194617 (0.0006) [2023-12-28 03:49:21,590][106226] Updated weights for policy 0, policy_version 1191704 (0.0008) [2023-12-28 03:49:21,606][106225] Updated weights for policy 1, policy_version 1194627 (0.0006) [2023-12-28 03:49:22,358][106226] Updated weights for policy 0, policy_version 1191714 (0.0009) [2023-12-28 03:49:22,380][106225] Updated weights for policy 1, policy_version 1194637 (0.0010) [2023-12-28 03:49:22,428][106226] Updated weights for policy 0, policy_version 1191724 (0.0006) [2023-12-28 03:49:22,444][106225] Updated weights for policy 1, policy_version 1194647 (0.0009) [2023-12-28 03:49:22,498][106226] Updated weights for policy 0, policy_version 1191734 (0.0006) [2023-12-28 03:49:22,511][106225] Updated weights for policy 1, policy_version 1194657 (0.0011) [2023-12-28 03:49:23,146][106226] Updated weights for policy 0, policy_version 1191744 (0.0008) [2023-12-28 03:49:23,206][106226] Updated weights for policy 0, policy_version 1191754 (0.0008) [2023-12-28 03:49:23,232][106225] Updated weights for policy 1, policy_version 1194667 (0.0010) [2023-12-28 03:49:23,267][106226] Updated weights for policy 0, policy_version 1191764 (0.0009) [2023-12-28 03:49:23,292][106225] Updated weights for policy 1, policy_version 1194677 (0.0010) [2023-12-28 03:49:23,345][106225] Updated weights for policy 1, policy_version 1194687 (0.0010) [2023-12-28 03:49:23,924][106225] Updated weights for policy 1, policy_version 1194697 (0.0010) [2023-12-28 03:49:23,983][106225] Updated weights for policy 1, policy_version 1194707 (0.0010) [2023-12-28 03:49:24,002][106226] Updated weights for policy 0, policy_version 1191774 (0.0006) [2023-12-28 03:49:24,040][106225] Updated weights for policy 1, policy_version 1194717 (0.0010) [2023-12-28 03:49:24,058][106226] Updated weights for policy 0, policy_version 1191784 (0.0008) [2023-12-28 03:49:24,096][106225] Updated weights for policy 1, policy_version 1194727 (0.0010) [2023-12-28 03:49:24,120][106226] Updated weights for policy 0, policy_version 1191794 (0.0008) [2023-12-28 03:49:24,677][106226] Updated weights for policy 0, policy_version 1191804 (0.0005) [2023-12-28 03:49:24,692][106225] Updated weights for policy 1, policy_version 1194737 (0.0006) [2023-12-28 03:49:24,737][106225] Updated weights for policy 1, policy_version 1194747 (0.0005) [2023-12-28 03:49:24,740][106226] Updated weights for policy 0, policy_version 1191814 (0.0005) [2023-12-28 03:49:24,783][106225] Updated weights for policy 1, policy_version 1194757 (0.0005) [2023-12-28 03:49:24,800][106226] Updated weights for policy 0, policy_version 1191824 (0.0009) [2023-12-28 03:49:25,438][106226] Updated weights for policy 0, policy_version 1191834 (0.0010) [2023-12-28 03:49:25,474][106225] Updated weights for policy 1, policy_version 1194767 (0.0009) [2023-12-28 03:49:25,500][106226] Updated weights for policy 0, policy_version 1191844 (0.0011) [2023-12-28 03:49:25,535][106225] Updated weights for policy 1, policy_version 1194777 (0.0010) [2023-12-28 03:49:25,560][106226] Updated weights for policy 0, policy_version 1191854 (0.0010) [2023-12-28 03:49:25,581][106225] Updated weights for policy 1, policy_version 1194787 (0.0010) [2023-12-28 03:49:25,619][106226] Updated weights for policy 0, policy_version 1191864 (0.0009) [2023-12-28 03:49:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 611090432. Throughput: 0: 9728.7, 1: 9802.3. Samples: 611060072. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:26,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-5.028')] [2023-12-28 03:49:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001194792_305913856.pth... [2023-12-28 03:49:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001193672_305627136.pth [2023-12-28 03:49:26,221][106226] Updated weights for policy 0, policy_version 1191874 (0.0011) [2023-12-28 03:49:26,271][106226] Updated weights for policy 0, policy_version 1191884 (0.0010) [2023-12-28 03:49:26,305][106225] Updated weights for policy 1, policy_version 1194797 (0.0010) [2023-12-28 03:49:26,318][106226] Updated weights for policy 0, policy_version 1191894 (0.0010) [2023-12-28 03:49:26,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001191896_305184768.pth... [2023-12-28 03:49:26,330][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001190744_304889856.pth [2023-12-28 03:49:26,361][106225] Updated weights for policy 1, policy_version 1194807 (0.0010) [2023-12-28 03:49:26,423][106225] Updated weights for policy 1, policy_version 1194817 (0.0010) [2023-12-28 03:49:27,000][106225] Updated weights for policy 1, policy_version 1194827 (0.0009) [2023-12-28 03:49:27,044][106226] Updated weights for policy 0, policy_version 1191904 (0.0011) [2023-12-28 03:49:27,061][106225] Updated weights for policy 1, policy_version 1194837 (0.0005) [2023-12-28 03:49:27,088][106226] Updated weights for policy 0, policy_version 1191914 (0.0010) [2023-12-28 03:49:27,116][106225] Updated weights for policy 1, policy_version 1194847 (0.0005) [2023-12-28 03:49:27,144][106226] Updated weights for policy 0, policy_version 1191924 (0.0010) [2023-12-28 03:49:27,746][106226] Updated weights for policy 0, policy_version 1191934 (0.0007) [2023-12-28 03:49:27,746][106225] Updated weights for policy 1, policy_version 1194857 (0.0006) [2023-12-28 03:49:27,795][106226] Updated weights for policy 0, policy_version 1191944 (0.0005) [2023-12-28 03:49:27,809][106225] Updated weights for policy 1, policy_version 1194867 (0.0010) [2023-12-28 03:49:27,846][106226] Updated weights for policy 0, policy_version 1191954 (0.0005) [2023-12-28 03:49:27,855][106225] Updated weights for policy 1, policy_version 1194877 (0.0010) [2023-12-28 03:49:27,914][106225] Updated weights for policy 1, policy_version 1194887 (0.0010) [2023-12-28 03:49:28,523][106226] Updated weights for policy 0, policy_version 1191964 (0.0007) [2023-12-28 03:49:28,551][106225] Updated weights for policy 1, policy_version 1194897 (0.0009) [2023-12-28 03:49:28,576][106226] Updated weights for policy 0, policy_version 1191974 (0.0009) [2023-12-28 03:49:28,608][106225] Updated weights for policy 1, policy_version 1194907 (0.0009) [2023-12-28 03:49:28,632][106226] Updated weights for policy 0, policy_version 1191984 (0.0009) [2023-12-28 03:49:28,665][106225] Updated weights for policy 1, policy_version 1194917 (0.0009) [2023-12-28 03:49:29,311][106226] Updated weights for policy 0, policy_version 1191994 (0.0009) [2023-12-28 03:49:29,371][106226] Updated weights for policy 0, policy_version 1192004 (0.0008) [2023-12-28 03:49:29,415][106225] Updated weights for policy 1, policy_version 1194927 (0.0010) [2023-12-28 03:49:29,437][106226] Updated weights for policy 0, policy_version 1192014 (0.0006) [2023-12-28 03:49:29,467][106225] Updated weights for policy 1, policy_version 1194937 (0.0010) [2023-12-28 03:49:29,494][106226] Updated weights for policy 0, policy_version 1192024 (0.0006) [2023-12-28 03:49:29,525][106225] Updated weights for policy 1, policy_version 1194947 (0.0010) [2023-12-28 03:49:30,184][106226] Updated weights for policy 0, policy_version 1192034 (0.0008) [2023-12-28 03:49:30,239][106226] Updated weights for policy 0, policy_version 1192044 (0.0007) [2023-12-28 03:49:30,287][106226] Updated weights for policy 0, policy_version 1192054 (0.0008) [2023-12-28 03:49:30,315][106225] Updated weights for policy 1, policy_version 1194957 (0.0008) [2023-12-28 03:49:30,377][106225] Updated weights for policy 1, policy_version 1194967 (0.0008) [2023-12-28 03:49:30,445][106225] Updated weights for policy 1, policy_version 1194977 (0.0006) [2023-12-28 03:49:30,981][106226] Updated weights for policy 0, policy_version 1192064 (0.0006) [2023-12-28 03:49:30,991][106225] Updated weights for policy 1, policy_version 1194987 (0.0007) [2023-12-28 03:49:31,038][106226] Updated weights for policy 0, policy_version 1192074 (0.0005) [2023-12-28 03:49:31,057][106225] Updated weights for policy 1, policy_version 1194997 (0.0007) [2023-12-28 03:49:31,104][106226] Updated weights for policy 0, policy_version 1192084 (0.0008) [2023-12-28 03:49:31,124][106225] Updated weights for policy 1, policy_version 1195007 (0.0009) [2023-12-28 03:49:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 611196928. Throughput: 0: 9840.7, 1: 9866.7. Samples: 611187264. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:31,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-5.043')] [2023-12-28 03:49:31,813][106226] Updated weights for policy 0, policy_version 1192094 (0.0010) [2023-12-28 03:49:31,846][106225] Updated weights for policy 1, policy_version 1195017 (0.0007) [2023-12-28 03:49:31,861][106226] Updated weights for policy 0, policy_version 1192104 (0.0008) [2023-12-28 03:49:31,902][106225] Updated weights for policy 1, policy_version 1195027 (0.0005) [2023-12-28 03:49:31,917][106226] Updated weights for policy 0, policy_version 1192114 (0.0008) [2023-12-28 03:49:31,958][106225] Updated weights for policy 1, policy_version 1195037 (0.0007) [2023-12-28 03:49:32,019][106225] Updated weights for policy 1, policy_version 1195047 (0.0005) [2023-12-28 03:49:32,621][106225] Updated weights for policy 1, policy_version 1195057 (0.0007) [2023-12-28 03:49:32,673][106225] Updated weights for policy 1, policy_version 1195067 (0.0006) [2023-12-28 03:49:32,723][106226] Updated weights for policy 0, policy_version 1192124 (0.0008) [2023-12-28 03:49:32,725][106225] Updated weights for policy 1, policy_version 1195077 (0.0005) [2023-12-28 03:49:32,788][106226] Updated weights for policy 0, policy_version 1192134 (0.0010) [2023-12-28 03:49:32,849][106226] Updated weights for policy 0, policy_version 1192144 (0.0009) [2023-12-28 03:49:33,258][106225] Updated weights for policy 1, policy_version 1195087 (0.0005) [2023-12-28 03:49:33,318][106225] Updated weights for policy 1, policy_version 1195097 (0.0005) [2023-12-28 03:49:33,374][106225] Updated weights for policy 1, policy_version 1195107 (0.0005) [2023-12-28 03:49:33,691][106226] Updated weights for policy 0, policy_version 1192154 (0.0008) [2023-12-28 03:49:33,744][106226] Updated weights for policy 0, policy_version 1192164 (0.0009) [2023-12-28 03:49:33,802][106226] Updated weights for policy 0, policy_version 1192174 (0.0008) [2023-12-28 03:49:33,853][106226] Updated weights for policy 0, policy_version 1192184 (0.0009) [2023-12-28 03:49:33,924][106225] Updated weights for policy 1, policy_version 1195117 (0.0006) [2023-12-28 03:49:33,975][106225] Updated weights for policy 1, policy_version 1195127 (0.0005) [2023-12-28 03:49:34,026][106225] Updated weights for policy 1, policy_version 1195137 (0.0006) [2023-12-28 03:49:34,580][106226] Updated weights for policy 0, policy_version 1192194 (0.0005) [2023-12-28 03:49:34,641][106226] Updated weights for policy 0, policy_version 1192204 (0.0008) [2023-12-28 03:49:34,701][106226] Updated weights for policy 0, policy_version 1192214 (0.0008) [2023-12-28 03:49:34,742][106225] Updated weights for policy 1, policy_version 1195147 (0.0007) [2023-12-28 03:49:34,807][106225] Updated weights for policy 1, policy_version 1195157 (0.0009) [2023-12-28 03:49:34,863][106225] Updated weights for policy 1, policy_version 1195167 (0.0009) [2023-12-28 03:49:35,374][106226] Updated weights for policy 0, policy_version 1192224 (0.0006) [2023-12-28 03:49:35,431][106226] Updated weights for policy 0, policy_version 1192234 (0.0005) [2023-12-28 03:49:35,487][106226] Updated weights for policy 0, policy_version 1192244 (0.0006) [2023-12-28 03:49:35,621][106225] Updated weights for policy 1, policy_version 1195177 (0.0009) [2023-12-28 03:49:35,673][106225] Updated weights for policy 1, policy_version 1195187 (0.0008) [2023-12-28 03:49:35,735][106225] Updated weights for policy 1, policy_version 1195198 (0.0009) [2023-12-28 03:49:35,789][106225] Updated weights for policy 1, policy_version 1195208 (0.0009) [2023-12-28 03:49:36,055][106226] Updated weights for policy 0, policy_version 1192254 (0.0008) [2023-12-28 03:49:36,128][106226] Updated weights for policy 0, policy_version 1192264 (0.0008) [2023-12-28 03:49:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 611295232. Throughput: 0: 9835.3, 1: 9915.7. Samples: 611308732. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:36,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.239')] [2023-12-28 03:49:36,185][106226] Updated weights for policy 0, policy_version 1192274 (0.0007) [2023-12-28 03:49:36,644][106225] Updated weights for policy 1, policy_version 1195218 (0.0008) [2023-12-28 03:49:36,690][106225] Updated weights for policy 1, policy_version 1195228 (0.0008) [2023-12-28 03:49:36,747][106225] Updated weights for policy 1, policy_version 1195238 (0.0008) [2023-12-28 03:49:36,824][106226] Updated weights for policy 0, policy_version 1192284 (0.0008) [2023-12-28 03:49:36,882][106226] Updated weights for policy 0, policy_version 1192294 (0.0007) [2023-12-28 03:49:36,941][106226] Updated weights for policy 0, policy_version 1192304 (0.0005) [2023-12-28 03:49:37,491][106226] Updated weights for policy 0, policy_version 1192314 (0.0006) [2023-12-28 03:49:37,550][106226] Updated weights for policy 0, policy_version 1192324 (0.0008) [2023-12-28 03:49:37,584][106225] Updated weights for policy 1, policy_version 1195248 (0.0007) [2023-12-28 03:49:37,610][106226] Updated weights for policy 0, policy_version 1192334 (0.0007) [2023-12-28 03:49:37,642][106225] Updated weights for policy 1, policy_version 1195258 (0.0006) [2023-12-28 03:49:37,673][106226] Updated weights for policy 0, policy_version 1192344 (0.0008) [2023-12-28 03:49:37,703][106225] Updated weights for policy 1, policy_version 1195268 (0.0006) [2023-12-28 03:49:38,333][106226] Updated weights for policy 0, policy_version 1192354 (0.0008) [2023-12-28 03:49:38,397][106226] Updated weights for policy 0, policy_version 1192364 (0.0007) [2023-12-28 03:49:38,443][106225] Updated weights for policy 1, policy_version 1195278 (0.0009) [2023-12-28 03:49:38,456][106226] Updated weights for policy 0, policy_version 1192374 (0.0007) [2023-12-28 03:49:38,500][106225] Updated weights for policy 1, policy_version 1195288 (0.0007) [2023-12-28 03:49:38,563][106225] Updated weights for policy 1, policy_version 1195298 (0.0009) [2023-12-28 03:49:39,167][106226] Updated weights for policy 0, policy_version 1192384 (0.0007) [2023-12-28 03:49:39,219][106226] Updated weights for policy 0, policy_version 1192394 (0.0010) [2023-12-28 03:49:39,266][106225] Updated weights for policy 1, policy_version 1195308 (0.0008) [2023-12-28 03:49:39,283][106226] Updated weights for policy 0, policy_version 1192404 (0.0008) [2023-12-28 03:49:39,363][106225] Updated weights for policy 1, policy_version 1195318 (0.0007) [2023-12-28 03:49:39,434][106225] Updated weights for policy 1, policy_version 1195328 (0.0008) [2023-12-28 03:49:40,121][106225] Updated weights for policy 1, policy_version 1195338 (0.0007) [2023-12-28 03:49:40,152][106226] Updated weights for policy 0, policy_version 1192414 (0.0008) [2023-12-28 03:49:40,182][106225] Updated weights for policy 1, policy_version 1195348 (0.0007) [2023-12-28 03:49:40,213][106226] Updated weights for policy 0, policy_version 1192424 (0.0006) [2023-12-28 03:49:40,244][106225] Updated weights for policy 1, policy_version 1195358 (0.0008) [2023-12-28 03:49:40,275][106226] Updated weights for policy 0, policy_version 1192434 (0.0007) [2023-12-28 03:49:40,311][106225] Updated weights for policy 1, policy_version 1195368 (0.0008) [2023-12-28 03:49:40,957][106226] Updated weights for policy 0, policy_version 1192444 (0.0008) [2023-12-28 03:49:41,018][106226] Updated weights for policy 0, policy_version 1192454 (0.0007) [2023-12-28 03:49:41,035][106225] Updated weights for policy 1, policy_version 1195378 (0.0008) [2023-12-28 03:49:41,088][106226] Updated weights for policy 0, policy_version 1192464 (0.0009) [2023-12-28 03:49:41,100][106225] Updated weights for policy 1, policy_version 1195388 (0.0007) [2023-12-28 03:49:41,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 611393536. Throughput: 0: 9885.8, 1: 9833.1. Samples: 611366696. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:41,176][105115] Avg episode reward: [(0, '-4.599'), (1, '-5.370')] [2023-12-28 03:49:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001192472_305332224.pth... [2023-12-28 03:49:41,183][106225] Updated weights for policy 1, policy_version 1195398 (0.0007) [2023-12-28 03:49:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001191320_305037312.pth [2023-12-28 03:49:41,196][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001195400_306069504.pth... [2023-12-28 03:49:41,200][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001194216_305766400.pth [2023-12-28 03:49:41,938][106225] Updated weights for policy 1, policy_version 1195408 (0.0008) [2023-12-28 03:49:41,945][106226] Updated weights for policy 0, policy_version 1192474 (0.0007) [2023-12-28 03:49:41,998][106225] Updated weights for policy 1, policy_version 1195418 (0.0008) [2023-12-28 03:49:42,004][106226] Updated weights for policy 0, policy_version 1192484 (0.0008) [2023-12-28 03:49:42,058][106225] Updated weights for policy 1, policy_version 1195428 (0.0008) [2023-12-28 03:49:42,061][106226] Updated weights for policy 0, policy_version 1192494 (0.0008) [2023-12-28 03:49:42,120][106226] Updated weights for policy 0, policy_version 1192504 (0.0008) [2023-12-28 03:49:42,790][106225] Updated weights for policy 1, policy_version 1195438 (0.0009) [2023-12-28 03:49:42,847][106225] Updated weights for policy 1, policy_version 1195448 (0.0008) [2023-12-28 03:49:42,864][106226] Updated weights for policy 0, policy_version 1192514 (0.0007) [2023-12-28 03:49:42,907][106225] Updated weights for policy 1, policy_version 1195458 (0.0007) [2023-12-28 03:49:42,920][106226] Updated weights for policy 0, policy_version 1192524 (0.0009) [2023-12-28 03:49:42,986][106226] Updated weights for policy 0, policy_version 1192534 (0.0008) [2023-12-28 03:49:43,639][106225] Updated weights for policy 1, policy_version 1195468 (0.0007) [2023-12-28 03:49:43,640][106226] Updated weights for policy 0, policy_version 1192544 (0.0008) [2023-12-28 03:49:43,687][106225] Updated weights for policy 1, policy_version 1195478 (0.0006) [2023-12-28 03:49:43,701][106226] Updated weights for policy 0, policy_version 1192554 (0.0007) [2023-12-28 03:49:43,736][106225] Updated weights for policy 1, policy_version 1195488 (0.0006) [2023-12-28 03:49:43,759][106226] Updated weights for policy 0, policy_version 1192564 (0.0008) [2023-12-28 03:49:44,462][106225] Updated weights for policy 1, policy_version 1195498 (0.0006) [2023-12-28 03:49:44,484][106226] Updated weights for policy 0, policy_version 1192574 (0.0009) [2023-12-28 03:49:44,515][106225] Updated weights for policy 1, policy_version 1195508 (0.0005) [2023-12-28 03:49:44,541][106226] Updated weights for policy 0, policy_version 1192584 (0.0007) [2023-12-28 03:49:44,571][106225] Updated weights for policy 1, policy_version 1195518 (0.0007) [2023-12-28 03:49:44,589][106226] Updated weights for policy 0, policy_version 1192594 (0.0006) [2023-12-28 03:49:44,623][106225] Updated weights for policy 1, policy_version 1195528 (0.0006) [2023-12-28 03:49:45,287][106226] Updated weights for policy 0, policy_version 1192604 (0.0007) [2023-12-28 03:49:45,351][106226] Updated weights for policy 0, policy_version 1192614 (0.0008) [2023-12-28 03:49:45,407][106226] Updated weights for policy 0, policy_version 1192624 (0.0011) [2023-12-28 03:49:45,409][106225] Updated weights for policy 1, policy_version 1195538 (0.0008) [2023-12-28 03:49:45,465][106225] Updated weights for policy 1, policy_version 1195548 (0.0006) [2023-12-28 03:49:45,520][106225] Updated weights for policy 1, policy_version 1195558 (0.0007) [2023-12-28 03:49:46,078][106226] Updated weights for policy 0, policy_version 1192634 (0.0010) [2023-12-28 03:49:46,148][106226] Updated weights for policy 0, policy_version 1192644 (0.0011) [2023-12-28 03:49:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 611483648. Throughput: 0: 9797.2, 1: 9830.6. Samples: 611479900. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:46,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-5.012')] [2023-12-28 03:49:46,197][106226] Updated weights for policy 0, policy_version 1192654 (0.0009) [2023-12-28 03:49:46,259][106226] Updated weights for policy 0, policy_version 1192664 (0.0008) [2023-12-28 03:49:46,287][106225] Updated weights for policy 1, policy_version 1195568 (0.0008) [2023-12-28 03:49:46,340][106225] Updated weights for policy 1, policy_version 1195578 (0.0008) [2023-12-28 03:49:46,386][106225] Updated weights for policy 1, policy_version 1195588 (0.0008) [2023-12-28 03:49:46,961][106226] Updated weights for policy 0, policy_version 1192674 (0.0005) [2023-12-28 03:49:47,021][106226] Updated weights for policy 0, policy_version 1192684 (0.0006) [2023-12-28 03:49:47,081][106226] Updated weights for policy 0, policy_version 1192694 (0.0010) [2023-12-28 03:49:47,082][106225] Updated weights for policy 1, policy_version 1195598 (0.0010) [2023-12-28 03:49:47,137][106225] Updated weights for policy 1, policy_version 1195608 (0.0008) [2023-12-28 03:49:47,196][106225] Updated weights for policy 1, policy_version 1195618 (0.0010) [2023-12-28 03:49:47,750][106226] Updated weights for policy 0, policy_version 1192704 (0.0005) [2023-12-28 03:49:47,808][106226] Updated weights for policy 0, policy_version 1192714 (0.0006) [2023-12-28 03:49:47,854][106225] Updated weights for policy 1, policy_version 1195628 (0.0010) [2023-12-28 03:49:47,856][106226] Updated weights for policy 0, policy_version 1192724 (0.0006) [2023-12-28 03:49:47,916][106225] Updated weights for policy 1, policy_version 1195638 (0.0009) [2023-12-28 03:49:47,972][106225] Updated weights for policy 1, policy_version 1195648 (0.0009) [2023-12-28 03:49:48,503][106226] Updated weights for policy 0, policy_version 1192734 (0.0006) [2023-12-28 03:49:48,572][106226] Updated weights for policy 0, policy_version 1192744 (0.0006) [2023-12-28 03:49:48,580][106225] Updated weights for policy 1, policy_version 1195658 (0.0006) [2023-12-28 03:49:48,635][106226] Updated weights for policy 0, policy_version 1192754 (0.0008) [2023-12-28 03:49:48,641][106225] Updated weights for policy 1, policy_version 1195668 (0.0006) [2023-12-28 03:49:48,701][106225] Updated weights for policy 1, policy_version 1195678 (0.0006) [2023-12-28 03:49:48,762][106225] Updated weights for policy 1, policy_version 1195688 (0.0011) [2023-12-28 03:49:49,305][106226] Updated weights for policy 0, policy_version 1192764 (0.0009) [2023-12-28 03:49:49,370][106226] Updated weights for policy 0, policy_version 1192774 (0.0009) [2023-12-28 03:49:49,435][106226] Updated weights for policy 0, policy_version 1192784 (0.0008) [2023-12-28 03:49:49,463][106225] Updated weights for policy 1, policy_version 1195698 (0.0010) [2023-12-28 03:49:49,526][106225] Updated weights for policy 1, policy_version 1195708 (0.0010) [2023-12-28 03:49:49,581][106225] Updated weights for policy 1, policy_version 1195718 (0.0010) [2023-12-28 03:49:50,055][106226] Updated weights for policy 0, policy_version 1192794 (0.0007) [2023-12-28 03:49:50,116][106226] Updated weights for policy 0, policy_version 1192804 (0.0011) [2023-12-28 03:49:50,183][106226] Updated weights for policy 0, policy_version 1192814 (0.0011) [2023-12-28 03:49:50,244][106226] Updated weights for policy 0, policy_version 1192824 (0.0011) [2023-12-28 03:49:50,312][106225] Updated weights for policy 1, policy_version 1195728 (0.0009) [2023-12-28 03:49:50,376][106225] Updated weights for policy 1, policy_version 1195738 (0.0010) [2023-12-28 03:49:50,434][106225] Updated weights for policy 1, policy_version 1195748 (0.0008) [2023-12-28 03:49:50,864][106226] Updated weights for policy 0, policy_version 1192834 (0.0011) [2023-12-28 03:49:50,919][106226] Updated weights for policy 0, policy_version 1192844 (0.0010) [2023-12-28 03:49:50,983][106226] Updated weights for policy 0, policy_version 1192854 (0.0011) [2023-12-28 03:49:51,161][106225] Updated weights for policy 1, policy_version 1195758 (0.0008) [2023-12-28 03:49:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 611590144. Throughput: 0: 9852.5, 1: 9870.5. Samples: 611600424. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:51,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.745')] [2023-12-28 03:49:51,227][106225] Updated weights for policy 1, policy_version 1195768 (0.0007) [2023-12-28 03:49:51,286][106225] Updated weights for policy 1, policy_version 1195778 (0.0007) [2023-12-28 03:49:51,768][106226] Updated weights for policy 0, policy_version 1192864 (0.0009) [2023-12-28 03:49:51,836][106226] Updated weights for policy 0, policy_version 1192874 (0.0007) [2023-12-28 03:49:51,904][106226] Updated weights for policy 0, policy_version 1192884 (0.0007) [2023-12-28 03:49:52,047][106225] Updated weights for policy 1, policy_version 1195788 (0.0008) [2023-12-28 03:49:52,099][106225] Updated weights for policy 1, policy_version 1195798 (0.0008) [2023-12-28 03:49:52,153][106225] Updated weights for policy 1, policy_version 1195808 (0.0007) [2023-12-28 03:49:52,520][106226] Updated weights for policy 0, policy_version 1192894 (0.0008) [2023-12-28 03:49:52,583][106226] Updated weights for policy 0, policy_version 1192904 (0.0009) [2023-12-28 03:49:52,645][106226] Updated weights for policy 0, policy_version 1192914 (0.0009) [2023-12-28 03:49:52,858][106225] Updated weights for policy 1, policy_version 1195818 (0.0009) [2023-12-28 03:49:52,922][106225] Updated weights for policy 1, policy_version 1195828 (0.0008) [2023-12-28 03:49:52,982][106225] Updated weights for policy 1, policy_version 1195838 (0.0008) [2023-12-28 03:49:53,046][106225] Updated weights for policy 1, policy_version 1195848 (0.0008) [2023-12-28 03:49:53,447][106226] Updated weights for policy 0, policy_version 1192924 (0.0009) [2023-12-28 03:49:53,509][106226] Updated weights for policy 0, policy_version 1192934 (0.0008) [2023-12-28 03:49:53,567][106226] Updated weights for policy 0, policy_version 1192944 (0.0008) [2023-12-28 03:49:53,642][106225] Updated weights for policy 1, policy_version 1195858 (0.0009) [2023-12-28 03:49:53,697][106225] Updated weights for policy 1, policy_version 1195868 (0.0008) [2023-12-28 03:49:53,746][106225] Updated weights for policy 1, policy_version 1195878 (0.0010) [2023-12-28 03:49:54,251][106226] Updated weights for policy 0, policy_version 1192954 (0.0008) [2023-12-28 03:49:54,302][106226] Updated weights for policy 0, policy_version 1192964 (0.0008) [2023-12-28 03:49:54,361][106226] Updated weights for policy 0, policy_version 1192974 (0.0008) [2023-12-28 03:49:54,421][106226] Updated weights for policy 0, policy_version 1192984 (0.0007) [2023-12-28 03:49:54,482][106225] Updated weights for policy 1, policy_version 1195888 (0.0010) [2023-12-28 03:49:54,538][106225] Updated weights for policy 1, policy_version 1195898 (0.0010) [2023-12-28 03:49:54,598][106225] Updated weights for policy 1, policy_version 1195908 (0.0010) [2023-12-28 03:49:55,136][106226] Updated weights for policy 0, policy_version 1192994 (0.0007) [2023-12-28 03:49:55,185][106226] Updated weights for policy 0, policy_version 1193004 (0.0008) [2023-12-28 03:49:55,249][106226] Updated weights for policy 0, policy_version 1193014 (0.0008) [2023-12-28 03:49:55,329][106225] Updated weights for policy 1, policy_version 1195918 (0.0005) [2023-12-28 03:49:55,398][106225] Updated weights for policy 1, policy_version 1195928 (0.0008) [2023-12-28 03:49:55,469][106225] Updated weights for policy 1, policy_version 1195938 (0.0008) [2023-12-28 03:49:56,003][106226] Updated weights for policy 0, policy_version 1193024 (0.0008) [2023-12-28 03:49:56,003][106225] Updated weights for policy 1, policy_version 1195948 (0.0006) [2023-12-28 03:49:56,050][106225] Updated weights for policy 1, policy_version 1195958 (0.0009) [2023-12-28 03:49:56,066][106226] Updated weights for policy 0, policy_version 1193034 (0.0008) [2023-12-28 03:49:56,101][106225] Updated weights for policy 1, policy_version 1195968 (0.0009) [2023-12-28 03:49:56,132][106226] Updated weights for policy 0, policy_version 1193044 (0.0006) [2023-12-28 03:49:56,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.5, 300 sec: 19799.6). Total num frames: 611696640. Throughput: 0: 9848.7, 1: 9883.8. Samples: 611659284. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:49:56,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-5.340')] [2023-12-28 03:49:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001193048_305479680.pth... [2023-12-28 03:49:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001195976_306216960.pth... [2023-12-28 03:49:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001191896_305184768.pth [2023-12-28 03:49:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001194792_305913856.pth [2023-12-28 03:49:56,719][106225] Updated weights for policy 1, policy_version 1195978 (0.0009) [2023-12-28 03:49:56,738][106226] Updated weights for policy 0, policy_version 1193054 (0.0005) [2023-12-28 03:49:56,777][106225] Updated weights for policy 1, policy_version 1195988 (0.0007) [2023-12-28 03:49:56,794][106226] Updated weights for policy 0, policy_version 1193064 (0.0009) [2023-12-28 03:49:56,839][106225] Updated weights for policy 1, policy_version 1195998 (0.0010) [2023-12-28 03:49:56,856][106226] Updated weights for policy 0, policy_version 1193074 (0.0010) [2023-12-28 03:49:56,890][106225] Updated weights for policy 1, policy_version 1196008 (0.0010) [2023-12-28 03:49:57,459][106226] Updated weights for policy 0, policy_version 1193084 (0.0010) [2023-12-28 03:49:57,504][106226] Updated weights for policy 0, policy_version 1193094 (0.0007) [2023-12-28 03:49:57,541][106225] Updated weights for policy 1, policy_version 1196018 (0.0007) [2023-12-28 03:49:57,553][106226] Updated weights for policy 0, policy_version 1193104 (0.0008) [2023-12-28 03:49:57,598][106225] Updated weights for policy 1, policy_version 1196028 (0.0005) [2023-12-28 03:49:57,660][106225] Updated weights for policy 1, policy_version 1196038 (0.0007) [2023-12-28 03:49:58,254][106226] Updated weights for policy 0, policy_version 1193114 (0.0008) [2023-12-28 03:49:58,257][106225] Updated weights for policy 1, policy_version 1196048 (0.0007) [2023-12-28 03:49:58,313][106226] Updated weights for policy 0, policy_version 1193124 (0.0009) [2023-12-28 03:49:58,315][106225] Updated weights for policy 1, policy_version 1196058 (0.0006) [2023-12-28 03:49:58,391][106225] Updated weights for policy 1, policy_version 1196069 (0.0008) [2023-12-28 03:49:58,397][106226] Updated weights for policy 0, policy_version 1193134 (0.0009) [2023-12-28 03:49:58,462][106226] Updated weights for policy 0, policy_version 1193144 (0.0009) [2023-12-28 03:49:59,192][106225] Updated weights for policy 1, policy_version 1196079 (0.0010) [2023-12-28 03:49:59,222][106226] Updated weights for policy 0, policy_version 1193154 (0.0008) [2023-12-28 03:49:59,255][106225] Updated weights for policy 1, policy_version 1196089 (0.0012) [2023-12-28 03:49:59,292][106226] Updated weights for policy 0, policy_version 1193164 (0.0008) [2023-12-28 03:49:59,315][106225] Updated weights for policy 1, policy_version 1196099 (0.0009) [2023-12-28 03:49:59,354][106226] Updated weights for policy 0, policy_version 1193174 (0.0006) [2023-12-28 03:50:00,029][106225] Updated weights for policy 1, policy_version 1196109 (0.0007) [2023-12-28 03:50:00,086][106225] Updated weights for policy 1, policy_version 1196119 (0.0005) [2023-12-28 03:50:00,102][106226] Updated weights for policy 0, policy_version 1193184 (0.0008) [2023-12-28 03:50:00,143][106225] Updated weights for policy 1, policy_version 1196129 (0.0006) [2023-12-28 03:50:00,156][106226] Updated weights for policy 0, policy_version 1193194 (0.0008) [2023-12-28 03:50:00,210][106226] Updated weights for policy 0, policy_version 1193204 (0.0007) [2023-12-28 03:50:00,844][106225] Updated weights for policy 1, policy_version 1196139 (0.0005) [2023-12-28 03:50:00,856][106226] Updated weights for policy 0, policy_version 1193214 (0.0009) [2023-12-28 03:50:00,903][106225] Updated weights for policy 1, policy_version 1196149 (0.0006) [2023-12-28 03:50:00,910][106226] Updated weights for policy 0, policy_version 1193224 (0.0008) [2023-12-28 03:50:00,969][106225] Updated weights for policy 1, policy_version 1196159 (0.0009) [2023-12-28 03:50:00,983][106226] Updated weights for policy 0, policy_version 1193234 (0.0005) [2023-12-28 03:50:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 611794944. Throughput: 0: 9908.7, 1: 9933.3. Samples: 611779072. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:01,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.942')] [2023-12-28 03:50:01,649][106226] Updated weights for policy 0, policy_version 1193245 (0.0009) [2023-12-28 03:50:01,716][106226] Updated weights for policy 0, policy_version 1193255 (0.0006) [2023-12-28 03:50:01,790][106226] Updated weights for policy 0, policy_version 1193265 (0.0008) [2023-12-28 03:50:01,793][106225] Updated weights for policy 1, policy_version 1196169 (0.0007) [2023-12-28 03:50:01,854][106225] Updated weights for policy 1, policy_version 1196179 (0.0007) [2023-12-28 03:50:01,910][106225] Updated weights for policy 1, policy_version 1196189 (0.0008) [2023-12-28 03:50:01,967][106225] Updated weights for policy 1, policy_version 1196199 (0.0008) [2023-12-28 03:50:02,513][106226] Updated weights for policy 0, policy_version 1193275 (0.0009) [2023-12-28 03:50:02,573][106226] Updated weights for policy 0, policy_version 1193285 (0.0010) [2023-12-28 03:50:02,630][106226] Updated weights for policy 0, policy_version 1193295 (0.0010) [2023-12-28 03:50:02,655][106225] Updated weights for policy 1, policy_version 1196209 (0.0006) [2023-12-28 03:50:02,707][106225] Updated weights for policy 1, policy_version 1196219 (0.0007) [2023-12-28 03:50:02,771][106225] Updated weights for policy 1, policy_version 1196229 (0.0008) [2023-12-28 03:50:03,322][106226] Updated weights for policy 0, policy_version 1193305 (0.0010) [2023-12-28 03:50:03,381][106226] Updated weights for policy 0, policy_version 1193315 (0.0007) [2023-12-28 03:50:03,386][106225] Updated weights for policy 1, policy_version 1196239 (0.0006) [2023-12-28 03:50:03,441][106226] Updated weights for policy 0, policy_version 1193325 (0.0006) [2023-12-28 03:50:03,444][106225] Updated weights for policy 1, policy_version 1196249 (0.0005) [2023-12-28 03:50:03,497][106225] Updated weights for policy 1, policy_version 1196259 (0.0005) [2023-12-28 03:50:03,498][106226] Updated weights for policy 0, policy_version 1193335 (0.0009) [2023-12-28 03:50:04,085][106225] Updated weights for policy 1, policy_version 1196269 (0.0006) [2023-12-28 03:50:04,127][106226] Updated weights for policy 0, policy_version 1193345 (0.0008) [2023-12-28 03:50:04,149][106225] Updated weights for policy 1, policy_version 1196279 (0.0008) [2023-12-28 03:50:04,188][106226] Updated weights for policy 0, policy_version 1193355 (0.0006) [2023-12-28 03:50:04,210][106225] Updated weights for policy 1, policy_version 1196289 (0.0007) [2023-12-28 03:50:04,254][106226] Updated weights for policy 0, policy_version 1193365 (0.0010) [2023-12-28 03:50:04,849][106226] Updated weights for policy 0, policy_version 1193375 (0.0011) [2023-12-28 03:50:04,906][106226] Updated weights for policy 0, policy_version 1193385 (0.0009) [2023-12-28 03:50:04,963][106226] Updated weights for policy 0, policy_version 1193395 (0.0008) [2023-12-28 03:50:04,975][106225] Updated weights for policy 1, policy_version 1196299 (0.0008) [2023-12-28 03:50:05,036][106225] Updated weights for policy 1, policy_version 1196309 (0.0008) [2023-12-28 03:50:05,082][106225] Updated weights for policy 1, policy_version 1196319 (0.0007) [2023-12-28 03:50:05,639][106226] Updated weights for policy 0, policy_version 1193405 (0.0008) [2023-12-28 03:50:05,691][106226] Updated weights for policy 0, policy_version 1193415 (0.0008) [2023-12-28 03:50:05,744][106226] Updated weights for policy 0, policy_version 1193425 (0.0006) [2023-12-28 03:50:05,786][106225] Updated weights for policy 1, policy_version 1196329 (0.0008) [2023-12-28 03:50:05,841][106225] Updated weights for policy 1, policy_version 1196339 (0.0010) [2023-12-28 03:50:05,892][106225] Updated weights for policy 1, policy_version 1196349 (0.0009) [2023-12-28 03:50:05,938][106225] Updated weights for policy 1, policy_version 1196359 (0.0007) [2023-12-28 03:50:06,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 611893248. Throughput: 0: 10018.2, 1: 9958.9. Samples: 611901532. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:06,176][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.858')] [2023-12-28 03:50:06,501][106226] Updated weights for policy 0, policy_version 1193435 (0.0007) [2023-12-28 03:50:06,559][106226] Updated weights for policy 0, policy_version 1193445 (0.0011) [2023-12-28 03:50:06,621][106226] Updated weights for policy 0, policy_version 1193455 (0.0011) [2023-12-28 03:50:06,643][106225] Updated weights for policy 1, policy_version 1196369 (0.0007) [2023-12-28 03:50:06,700][106225] Updated weights for policy 1, policy_version 1196379 (0.0007) [2023-12-28 03:50:06,762][106225] Updated weights for policy 1, policy_version 1196389 (0.0007) [2023-12-28 03:50:07,362][106226] Updated weights for policy 0, policy_version 1193465 (0.0010) [2023-12-28 03:50:07,423][106226] Updated weights for policy 0, policy_version 1193475 (0.0006) [2023-12-28 03:50:07,455][106225] Updated weights for policy 1, policy_version 1196399 (0.0007) [2023-12-28 03:50:07,477][106226] Updated weights for policy 0, policy_version 1193485 (0.0008) [2023-12-28 03:50:07,515][106225] Updated weights for policy 1, policy_version 1196409 (0.0006) [2023-12-28 03:50:07,540][106226] Updated weights for policy 0, policy_version 1193495 (0.0007) [2023-12-28 03:50:07,584][106225] Updated weights for policy 1, policy_version 1196419 (0.0008) [2023-12-28 03:50:08,155][106226] Updated weights for policy 0, policy_version 1193505 (0.0006) [2023-12-28 03:50:08,182][106225] Updated weights for policy 1, policy_version 1196429 (0.0009) [2023-12-28 03:50:08,222][106226] Updated weights for policy 0, policy_version 1193515 (0.0005) [2023-12-28 03:50:08,242][106225] Updated weights for policy 1, policy_version 1196439 (0.0008) [2023-12-28 03:50:08,284][106226] Updated weights for policy 0, policy_version 1193525 (0.0005) [2023-12-28 03:50:08,298][106225] Updated weights for policy 1, policy_version 1196449 (0.0009) [2023-12-28 03:50:08,922][106226] Updated weights for policy 0, policy_version 1193535 (0.0010) [2023-12-28 03:50:08,976][106226] Updated weights for policy 0, policy_version 1193545 (0.0011) [2023-12-28 03:50:09,023][106225] Updated weights for policy 1, policy_version 1196459 (0.0010) [2023-12-28 03:50:09,030][106226] Updated weights for policy 0, policy_version 1193555 (0.0010) [2023-12-28 03:50:09,083][106225] Updated weights for policy 1, policy_version 1196469 (0.0010) [2023-12-28 03:50:09,151][106225] Updated weights for policy 1, policy_version 1196479 (0.0010) [2023-12-28 03:50:09,769][106226] Updated weights for policy 0, policy_version 1193565 (0.0010) [2023-12-28 03:50:09,831][106226] Updated weights for policy 0, policy_version 1193575 (0.0010) [2023-12-28 03:50:09,899][106226] Updated weights for policy 0, policy_version 1193585 (0.0011) [2023-12-28 03:50:09,909][106225] Updated weights for policy 1, policy_version 1196489 (0.0010) [2023-12-28 03:50:09,979][106225] Updated weights for policy 1, policy_version 1196499 (0.0008) [2023-12-28 03:50:10,034][106225] Updated weights for policy 1, policy_version 1196509 (0.0008) [2023-12-28 03:50:10,100][106225] Updated weights for policy 1, policy_version 1196519 (0.0006) [2023-12-28 03:50:10,666][106226] Updated weights for policy 0, policy_version 1193595 (0.0012) [2023-12-28 03:50:10,734][106226] Updated weights for policy 0, policy_version 1193605 (0.0011) [2023-12-28 03:50:10,801][106226] Updated weights for policy 0, policy_version 1193615 (0.0011) [2023-12-28 03:50:10,834][106225] Updated weights for policy 1, policy_version 1196529 (0.0009) [2023-12-28 03:50:10,893][106225] Updated weights for policy 1, policy_version 1196539 (0.0008) [2023-12-28 03:50:10,948][106225] Updated weights for policy 1, policy_version 1196549 (0.0008) [2023-12-28 03:50:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 611991552. Throughput: 0: 10037.0, 1: 10000.8. Samples: 611961772. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:11,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.117')] [2023-12-28 03:50:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001193624_305627136.pth... [2023-12-28 03:50:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001196552_306364416.pth... [2023-12-28 03:50:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001192472_305332224.pth [2023-12-28 03:50:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001195400_306069504.pth [2023-12-28 03:50:11,595][106226] Updated weights for policy 0, policy_version 1193625 (0.0010) [2023-12-28 03:50:11,658][106226] Updated weights for policy 0, policy_version 1193635 (0.0009) [2023-12-28 03:50:11,724][106225] Updated weights for policy 1, policy_version 1196559 (0.0008) [2023-12-28 03:50:11,731][106226] Updated weights for policy 0, policy_version 1193645 (0.0008) [2023-12-28 03:50:11,791][106226] Updated weights for policy 0, policy_version 1193655 (0.0006) [2023-12-28 03:50:11,792][106225] Updated weights for policy 1, policy_version 1196569 (0.0007) [2023-12-28 03:50:11,855][106225] Updated weights for policy 1, policy_version 1196579 (0.0010) [2023-12-28 03:50:12,462][106226] Updated weights for policy 0, policy_version 1193665 (0.0008) [2023-12-28 03:50:12,526][106226] Updated weights for policy 0, policy_version 1193675 (0.0009) [2023-12-28 03:50:12,592][106226] Updated weights for policy 0, policy_version 1193685 (0.0008) [2023-12-28 03:50:12,628][106225] Updated weights for policy 1, policy_version 1196589 (0.0008) [2023-12-28 03:50:12,698][106225] Updated weights for policy 1, policy_version 1196599 (0.0008) [2023-12-28 03:50:12,772][106225] Updated weights for policy 1, policy_version 1196609 (0.0009) [2023-12-28 03:50:13,280][106226] Updated weights for policy 0, policy_version 1193695 (0.0006) [2023-12-28 03:50:13,338][106226] Updated weights for policy 0, policy_version 1193705 (0.0005) [2023-12-28 03:50:13,389][106226] Updated weights for policy 0, policy_version 1193715 (0.0005) [2023-12-28 03:50:13,444][106225] Updated weights for policy 1, policy_version 1196619 (0.0009) [2023-12-28 03:50:13,492][106225] Updated weights for policy 1, policy_version 1196629 (0.0005) [2023-12-28 03:50:13,559][106225] Updated weights for policy 1, policy_version 1196639 (0.0005) [2023-12-28 03:50:13,962][106226] Updated weights for policy 0, policy_version 1193725 (0.0005) [2023-12-28 03:50:14,014][106226] Updated weights for policy 0, policy_version 1193735 (0.0005) [2023-12-28 03:50:14,074][106226] Updated weights for policy 0, policy_version 1193745 (0.0008) [2023-12-28 03:50:14,096][106225] Updated weights for policy 1, policy_version 1196649 (0.0005) [2023-12-28 03:50:14,151][106225] Updated weights for policy 1, policy_version 1196659 (0.0007) [2023-12-28 03:50:14,208][106225] Updated weights for policy 1, policy_version 1196669 (0.0005) [2023-12-28 03:50:14,268][106225] Updated weights for policy 1, policy_version 1196679 (0.0005) [2023-12-28 03:50:14,720][106226] Updated weights for policy 0, policy_version 1193755 (0.0008) [2023-12-28 03:50:14,793][106226] Updated weights for policy 0, policy_version 1193765 (0.0009) [2023-12-28 03:50:14,845][106225] Updated weights for policy 1, policy_version 1196689 (0.0006) [2023-12-28 03:50:14,853][106226] Updated weights for policy 0, policy_version 1193775 (0.0007) [2023-12-28 03:50:14,913][106225] Updated weights for policy 1, policy_version 1196699 (0.0008) [2023-12-28 03:50:14,969][106225] Updated weights for policy 1, policy_version 1196709 (0.0008) [2023-12-28 03:50:15,540][106226] Updated weights for policy 0, policy_version 1193785 (0.0006) [2023-12-28 03:50:15,599][106226] Updated weights for policy 0, policy_version 1193795 (0.0005) [2023-12-28 03:50:15,636][106225] Updated weights for policy 1, policy_version 1196719 (0.0007) [2023-12-28 03:50:15,651][106226] Updated weights for policy 0, policy_version 1193805 (0.0005) [2023-12-28 03:50:15,692][106225] Updated weights for policy 1, policy_version 1196729 (0.0008) [2023-12-28 03:50:15,705][106226] Updated weights for policy 0, policy_version 1193815 (0.0005) [2023-12-28 03:50:15,747][106225] Updated weights for policy 1, policy_version 1196739 (0.0008) [2023-12-28 03:50:16,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 612089856. Throughput: 0: 9925.0, 1: 9913.8. Samples: 612080008. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:16,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.189')] [2023-12-28 03:50:16,286][106226] Updated weights for policy 0, policy_version 1193825 (0.0007) [2023-12-28 03:50:16,339][106226] Updated weights for policy 0, policy_version 1193835 (0.0009) [2023-12-28 03:50:16,410][106226] Updated weights for policy 0, policy_version 1193845 (0.0010) [2023-12-28 03:50:16,436][106225] Updated weights for policy 1, policy_version 1196749 (0.0006) [2023-12-28 03:50:16,499][106225] Updated weights for policy 1, policy_version 1196759 (0.0007) [2023-12-28 03:50:16,557][106225] Updated weights for policy 1, policy_version 1196769 (0.0006) [2023-12-28 03:50:17,153][106225] Updated weights for policy 1, policy_version 1196779 (0.0006) [2023-12-28 03:50:17,177][106226] Updated weights for policy 0, policy_version 1193855 (0.0009) [2023-12-28 03:50:17,214][106225] Updated weights for policy 1, policy_version 1196789 (0.0006) [2023-12-28 03:50:17,246][106226] Updated weights for policy 0, policy_version 1193865 (0.0008) [2023-12-28 03:50:17,272][106225] Updated weights for policy 1, policy_version 1196799 (0.0007) [2023-12-28 03:50:17,317][106226] Updated weights for policy 0, policy_version 1193875 (0.0006) [2023-12-28 03:50:17,986][106225] Updated weights for policy 1, policy_version 1196809 (0.0008) [2023-12-28 03:50:18,033][106226] Updated weights for policy 0, policy_version 1193885 (0.0007) [2023-12-28 03:50:18,033][106225] Updated weights for policy 1, policy_version 1196819 (0.0008) [2023-12-28 03:50:18,090][106225] Updated weights for policy 1, policy_version 1196829 (0.0008) [2023-12-28 03:50:18,090][106226] Updated weights for policy 0, policy_version 1193895 (0.0005) [2023-12-28 03:50:18,137][106226] Updated weights for policy 0, policy_version 1193905 (0.0005) [2023-12-28 03:50:18,154][106225] Updated weights for policy 1, policy_version 1196839 (0.0008) [2023-12-28 03:50:18,845][106226] Updated weights for policy 0, policy_version 1193915 (0.0007) [2023-12-28 03:50:18,909][106226] Updated weights for policy 0, policy_version 1193925 (0.0008) [2023-12-28 03:50:18,920][106225] Updated weights for policy 1, policy_version 1196849 (0.0006) [2023-12-28 03:50:18,961][106226] Updated weights for policy 0, policy_version 1193935 (0.0008) [2023-12-28 03:50:18,979][106225] Updated weights for policy 1, policy_version 1196859 (0.0006) [2023-12-28 03:50:19,039][106225] Updated weights for policy 1, policy_version 1196869 (0.0009) [2023-12-28 03:50:19,691][106226] Updated weights for policy 0, policy_version 1193945 (0.0008) [2023-12-28 03:50:19,751][106226] Updated weights for policy 0, policy_version 1193955 (0.0009) [2023-12-28 03:50:19,758][106225] Updated weights for policy 1, policy_version 1196879 (0.0010) [2023-12-28 03:50:19,807][106226] Updated weights for policy 0, policy_version 1193965 (0.0006) [2023-12-28 03:50:19,813][106225] Updated weights for policy 1, policy_version 1196889 (0.0011) [2023-12-28 03:50:19,879][106226] Updated weights for policy 0, policy_version 1193975 (0.0008) [2023-12-28 03:50:19,884][106225] Updated weights for policy 1, policy_version 1196899 (0.0010) [2023-12-28 03:50:20,632][106226] Updated weights for policy 0, policy_version 1193985 (0.0008) [2023-12-28 03:50:20,638][106225] Updated weights for policy 1, policy_version 1196909 (0.0010) [2023-12-28 03:50:20,696][106226] Updated weights for policy 0, policy_version 1193995 (0.0010) [2023-12-28 03:50:20,697][106225] Updated weights for policy 1, policy_version 1196919 (0.0009) [2023-12-28 03:50:20,758][106225] Updated weights for policy 1, policy_version 1196929 (0.0009) [2023-12-28 03:50:20,765][106226] Updated weights for policy 0, policy_version 1194005 (0.0011) [2023-12-28 03:50:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 612188160. Throughput: 0: 9915.2, 1: 9825.0. Samples: 612197040. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:21,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-4.721')] [2023-12-28 03:50:21,556][106225] Updated weights for policy 1, policy_version 1196939 (0.0009) [2023-12-28 03:50:21,574][106226] Updated weights for policy 0, policy_version 1194015 (0.0009) [2023-12-28 03:50:21,613][106225] Updated weights for policy 1, policy_version 1196949 (0.0008) [2023-12-28 03:50:21,639][106226] Updated weights for policy 0, policy_version 1194025 (0.0008) [2023-12-28 03:50:21,678][106225] Updated weights for policy 1, policy_version 1196959 (0.0007) [2023-12-28 03:50:21,704][106226] Updated weights for policy 0, policy_version 1194035 (0.0007) [2023-12-28 03:50:22,343][106225] Updated weights for policy 1, policy_version 1196969 (0.0007) [2023-12-28 03:50:22,408][106225] Updated weights for policy 1, policy_version 1196979 (0.0009) [2023-12-28 03:50:22,423][106226] Updated weights for policy 0, policy_version 1194045 (0.0007) [2023-12-28 03:50:22,464][106225] Updated weights for policy 1, policy_version 1196989 (0.0006) [2023-12-28 03:50:22,486][106226] Updated weights for policy 0, policy_version 1194055 (0.0008) [2023-12-28 03:50:22,526][106225] Updated weights for policy 1, policy_version 1196999 (0.0006) [2023-12-28 03:50:22,545][106226] Updated weights for policy 0, policy_version 1194065 (0.0006) [2023-12-28 03:50:23,221][106226] Updated weights for policy 0, policy_version 1194075 (0.0007) [2023-12-28 03:50:23,282][106226] Updated weights for policy 0, policy_version 1194085 (0.0007) [2023-12-28 03:50:23,292][106225] Updated weights for policy 1, policy_version 1197009 (0.0006) [2023-12-28 03:50:23,334][106226] Updated weights for policy 0, policy_version 1194095 (0.0007) [2023-12-28 03:50:23,351][106225] Updated weights for policy 1, policy_version 1197019 (0.0007) [2023-12-28 03:50:23,400][106225] Updated weights for policy 1, policy_version 1197029 (0.0006) [2023-12-28 03:50:23,982][106226] Updated weights for policy 0, policy_version 1194105 (0.0007) [2023-12-28 03:50:24,040][106226] Updated weights for policy 0, policy_version 1194115 (0.0008) [2023-12-28 03:50:24,099][106226] Updated weights for policy 0, policy_version 1194125 (0.0008) [2023-12-28 03:50:24,148][106226] Updated weights for policy 0, policy_version 1194135 (0.0009) [2023-12-28 03:50:24,176][106225] Updated weights for policy 1, policy_version 1197039 (0.0006) [2023-12-28 03:50:24,234][106225] Updated weights for policy 1, policy_version 1197049 (0.0005) [2023-12-28 03:50:24,288][106225] Updated weights for policy 1, policy_version 1197059 (0.0006) [2023-12-28 03:50:24,752][106226] Updated weights for policy 0, policy_version 1194145 (0.0005) [2023-12-28 03:50:24,802][106226] Updated weights for policy 0, policy_version 1194155 (0.0007) [2023-12-28 03:50:24,848][106226] Updated weights for policy 0, policy_version 1194165 (0.0007) [2023-12-28 03:50:24,980][106225] Updated weights for policy 1, policy_version 1197069 (0.0007) [2023-12-28 03:50:25,029][106225] Updated weights for policy 1, policy_version 1197079 (0.0007) [2023-12-28 03:50:25,080][106225] Updated weights for policy 1, policy_version 1197089 (0.0005) [2023-12-28 03:50:25,654][106226] Updated weights for policy 0, policy_version 1194175 (0.0009) [2023-12-28 03:50:25,700][106225] Updated weights for policy 1, policy_version 1197099 (0.0005) [2023-12-28 03:50:25,713][106226] Updated weights for policy 0, policy_version 1194185 (0.0009) [2023-12-28 03:50:25,763][106225] Updated weights for policy 1, policy_version 1197109 (0.0008) [2023-12-28 03:50:25,769][106226] Updated weights for policy 0, policy_version 1194195 (0.0006) [2023-12-28 03:50:25,825][106225] Updated weights for policy 1, policy_version 1197119 (0.0008) [2023-12-28 03:50:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 612286464. Throughput: 0: 9867.5, 1: 9858.7. Samples: 612254372. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:26,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-5.040')] [2023-12-28 03:50:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001197128_306511872.pth... [2023-12-28 03:50:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001194200_305774592.pth... [2023-12-28 03:50:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001195976_306216960.pth [2023-12-28 03:50:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001193048_305479680.pth [2023-12-28 03:50:26,442][106226] Updated weights for policy 0, policy_version 1194205 (0.0005) [2023-12-28 03:50:26,488][106225] Updated weights for policy 1, policy_version 1197129 (0.0008) [2023-12-28 03:50:26,499][106226] Updated weights for policy 0, policy_version 1194215 (0.0006) [2023-12-28 03:50:26,543][106225] Updated weights for policy 1, policy_version 1197139 (0.0005) [2023-12-28 03:50:26,562][106226] Updated weights for policy 0, policy_version 1194225 (0.0007) [2023-12-28 03:50:26,595][106225] Updated weights for policy 1, policy_version 1197149 (0.0005) [2023-12-28 03:50:26,641][106225] Updated weights for policy 1, policy_version 1197159 (0.0008) [2023-12-28 03:50:27,113][106226] Updated weights for policy 0, policy_version 1194235 (0.0011) [2023-12-28 03:50:27,159][106226] Updated weights for policy 0, policy_version 1194245 (0.0010) [2023-12-28 03:50:27,229][106226] Updated weights for policy 0, policy_version 1194255 (0.0011) [2023-12-28 03:50:27,294][106225] Updated weights for policy 1, policy_version 1197169 (0.0006) [2023-12-28 03:50:27,351][106225] Updated weights for policy 1, policy_version 1197179 (0.0008) [2023-12-28 03:50:27,410][106225] Updated weights for policy 1, policy_version 1197189 (0.0008) [2023-12-28 03:50:27,852][106226] Updated weights for policy 0, policy_version 1194265 (0.0010) [2023-12-28 03:50:27,908][106226] Updated weights for policy 0, policy_version 1194275 (0.0010) [2023-12-28 03:50:27,971][106226] Updated weights for policy 0, policy_version 1194285 (0.0011) [2023-12-28 03:50:28,032][106226] Updated weights for policy 0, policy_version 1194295 (0.0006) [2023-12-28 03:50:28,190][106225] Updated weights for policy 1, policy_version 1197199 (0.0006) [2023-12-28 03:50:28,249][106225] Updated weights for policy 1, policy_version 1197209 (0.0006) [2023-12-28 03:50:28,302][106225] Updated weights for policy 1, policy_version 1197219 (0.0009) [2023-12-28 03:50:28,680][106226] Updated weights for policy 0, policy_version 1194305 (0.0005) [2023-12-28 03:50:28,740][106226] Updated weights for policy 0, policy_version 1194315 (0.0005) [2023-12-28 03:50:28,798][106226] Updated weights for policy 0, policy_version 1194325 (0.0006) [2023-12-28 03:50:28,971][106225] Updated weights for policy 1, policy_version 1197230 (0.0009) [2023-12-28 03:50:29,031][106225] Updated weights for policy 1, policy_version 1197240 (0.0009) [2023-12-28 03:50:29,086][106225] Updated weights for policy 1, policy_version 1197250 (0.0010) [2023-12-28 03:50:29,468][106226] Updated weights for policy 0, policy_version 1194335 (0.0009) [2023-12-28 03:50:29,522][106226] Updated weights for policy 0, policy_version 1194345 (0.0008) [2023-12-28 03:50:29,576][106226] Updated weights for policy 0, policy_version 1194355 (0.0008) [2023-12-28 03:50:29,796][106225] Updated weights for policy 1, policy_version 1197260 (0.0010) [2023-12-28 03:50:29,859][106225] Updated weights for policy 1, policy_version 1197270 (0.0009) [2023-12-28 03:50:29,918][106225] Updated weights for policy 1, policy_version 1197280 (0.0008) [2023-12-28 03:50:30,364][106226] Updated weights for policy 0, policy_version 1194365 (0.0009) [2023-12-28 03:50:30,434][106226] Updated weights for policy 0, policy_version 1194375 (0.0010) [2023-12-28 03:50:30,493][106226] Updated weights for policy 0, policy_version 1194385 (0.0010) [2023-12-28 03:50:30,593][106225] Updated weights for policy 1, policy_version 1197290 (0.0008) [2023-12-28 03:50:30,648][106225] Updated weights for policy 1, policy_version 1197300 (0.0005) [2023-12-28 03:50:30,696][106225] Updated weights for policy 1, policy_version 1197310 (0.0005) [2023-12-28 03:50:30,757][106225] Updated weights for policy 1, policy_version 1197320 (0.0007) [2023-12-28 03:50:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 612384768. Throughput: 0: 10004.7, 1: 9936.7. Samples: 612377264. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:31,175][106226] Updated weights for policy 0, policy_version 1194395 (0.0011) [2023-12-28 03:50:31,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-4.766')] [2023-12-28 03:50:31,237][106226] Updated weights for policy 0, policy_version 1194405 (0.0011) [2023-12-28 03:50:31,305][106226] Updated weights for policy 0, policy_version 1194415 (0.0011) [2023-12-28 03:50:31,365][106225] Updated weights for policy 1, policy_version 1197330 (0.0010) [2023-12-28 03:50:31,433][106225] Updated weights for policy 1, policy_version 1197340 (0.0010) [2023-12-28 03:50:31,491][106225] Updated weights for policy 1, policy_version 1197350 (0.0010) [2023-12-28 03:50:31,899][106226] Updated weights for policy 0, policy_version 1194425 (0.0010) [2023-12-28 03:50:31,961][106226] Updated weights for policy 0, policy_version 1194435 (0.0006) [2023-12-28 03:50:32,010][106226] Updated weights for policy 0, policy_version 1194445 (0.0009) [2023-12-28 03:50:32,078][106226] Updated weights for policy 0, policy_version 1194455 (0.0007) [2023-12-28 03:50:32,281][106225] Updated weights for policy 1, policy_version 1197360 (0.0008) [2023-12-28 03:50:32,335][106225] Updated weights for policy 1, policy_version 1197370 (0.0009) [2023-12-28 03:50:32,404][106225] Updated weights for policy 1, policy_version 1197380 (0.0007) [2023-12-28 03:50:32,663][106226] Updated weights for policy 0, policy_version 1194465 (0.0005) [2023-12-28 03:50:32,722][106226] Updated weights for policy 0, policy_version 1194475 (0.0008) [2023-12-28 03:50:32,777][106226] Updated weights for policy 0, policy_version 1194485 (0.0008) [2023-12-28 03:50:33,049][106225] Updated weights for policy 1, policy_version 1197390 (0.0010) [2023-12-28 03:50:33,116][106225] Updated weights for policy 1, policy_version 1197400 (0.0010) [2023-12-28 03:50:33,186][106225] Updated weights for policy 1, policy_version 1197410 (0.0010) [2023-12-28 03:50:33,360][106226] Updated weights for policy 0, policy_version 1194496 (0.0006) [2023-12-28 03:50:33,415][106226] Updated weights for policy 0, policy_version 1194506 (0.0005) [2023-12-28 03:50:33,473][106226] Updated weights for policy 0, policy_version 1194516 (0.0005) [2023-12-28 03:50:33,882][106225] Updated weights for policy 1, policy_version 1197420 (0.0010) [2023-12-28 03:50:33,929][106225] Updated weights for policy 1, policy_version 1197430 (0.0010) [2023-12-28 03:50:33,989][106225] Updated weights for policy 1, policy_version 1197440 (0.0010) [2023-12-28 03:50:34,010][106226] Updated weights for policy 0, policy_version 1194526 (0.0007) [2023-12-28 03:50:34,068][106226] Updated weights for policy 0, policy_version 1194536 (0.0007) [2023-12-28 03:50:34,121][106226] Updated weights for policy 0, policy_version 1194546 (0.0008) [2023-12-28 03:50:34,666][106225] Updated weights for policy 1, policy_version 1197450 (0.0009) [2023-12-28 03:50:34,731][106225] Updated weights for policy 1, policy_version 1197460 (0.0005) [2023-12-28 03:50:34,793][106225] Updated weights for policy 1, policy_version 1197470 (0.0005) [2023-12-28 03:50:34,857][106225] Updated weights for policy 1, policy_version 1197480 (0.0008) [2023-12-28 03:50:34,873][106226] Updated weights for policy 0, policy_version 1194556 (0.0008) [2023-12-28 03:50:34,941][106226] Updated weights for policy 0, policy_version 1194566 (0.0011) [2023-12-28 03:50:34,998][106226] Updated weights for policy 0, policy_version 1194576 (0.0011) [2023-12-28 03:50:35,471][106225] Updated weights for policy 1, policy_version 1197490 (0.0009) [2023-12-28 03:50:35,532][106225] Updated weights for policy 1, policy_version 1197500 (0.0006) [2023-12-28 03:50:35,591][106225] Updated weights for policy 1, policy_version 1197510 (0.0005) [2023-12-28 03:50:35,682][106226] Updated weights for policy 0, policy_version 1194586 (0.0008) [2023-12-28 03:50:35,745][106226] Updated weights for policy 0, policy_version 1194596 (0.0011) [2023-12-28 03:50:35,802][106226] Updated weights for policy 0, policy_version 1194606 (0.0010) [2023-12-28 03:50:35,862][106226] Updated weights for policy 0, policy_version 1194616 (0.0010) [2023-12-28 03:50:36,155][106225] Updated weights for policy 1, policy_version 1197520 (0.0008) [2023-12-28 03:50:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 612491264. Throughput: 0: 10036.6, 1: 9999.4. Samples: 612502044. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:36,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.045')] [2023-12-28 03:50:36,215][106225] Updated weights for policy 1, policy_version 1197530 (0.0008) [2023-12-28 03:50:36,276][106225] Updated weights for policy 1, policy_version 1197540 (0.0009) [2023-12-28 03:50:36,607][106226] Updated weights for policy 0, policy_version 1194626 (0.0010) [2023-12-28 03:50:36,672][106226] Updated weights for policy 0, policy_version 1194636 (0.0010) [2023-12-28 03:50:36,730][106226] Updated weights for policy 0, policy_version 1194646 (0.0010) [2023-12-28 03:50:36,935][106225] Updated weights for policy 1, policy_version 1197550 (0.0006) [2023-12-28 03:50:36,997][106225] Updated weights for policy 1, policy_version 1197560 (0.0010) [2023-12-28 03:50:37,047][106225] Updated weights for policy 1, policy_version 1197570 (0.0010) [2023-12-28 03:50:37,416][106226] Updated weights for policy 0, policy_version 1194656 (0.0009) [2023-12-28 03:50:37,465][106226] Updated weights for policy 0, policy_version 1194666 (0.0008) [2023-12-28 03:50:37,527][106226] Updated weights for policy 0, policy_version 1194676 (0.0009) [2023-12-28 03:50:37,634][106225] Updated weights for policy 1, policy_version 1197580 (0.0010) [2023-12-28 03:50:37,689][106225] Updated weights for policy 1, policy_version 1197590 (0.0010) [2023-12-28 03:50:37,742][106225] Updated weights for policy 1, policy_version 1197600 (0.0007) [2023-12-28 03:50:38,185][106226] Updated weights for policy 0, policy_version 1194686 (0.0007) [2023-12-28 03:50:38,240][106226] Updated weights for policy 0, policy_version 1194696 (0.0005) [2023-12-28 03:50:38,295][106226] Updated weights for policy 0, policy_version 1194706 (0.0005) [2023-12-28 03:50:38,352][106225] Updated weights for policy 1, policy_version 1197610 (0.0006) [2023-12-28 03:50:38,423][106225] Updated weights for policy 1, policy_version 1197620 (0.0009) [2023-12-28 03:50:38,479][106225] Updated weights for policy 1, policy_version 1197630 (0.0008) [2023-12-28 03:50:38,544][106225] Updated weights for policy 1, policy_version 1197640 (0.0008) [2023-12-28 03:50:38,933][106226] Updated weights for policy 0, policy_version 1194716 (0.0007) [2023-12-28 03:50:38,997][106226] Updated weights for policy 0, policy_version 1194726 (0.0007) [2023-12-28 03:50:39,063][106226] Updated weights for policy 0, policy_version 1194736 (0.0009) [2023-12-28 03:50:39,311][106225] Updated weights for policy 1, policy_version 1197650 (0.0008) [2023-12-28 03:50:39,377][106225] Updated weights for policy 1, policy_version 1197660 (0.0008) [2023-12-28 03:50:39,447][106225] Updated weights for policy 1, policy_version 1197670 (0.0007) [2023-12-28 03:50:39,833][106226] Updated weights for policy 0, policy_version 1194746 (0.0009) [2023-12-28 03:50:39,908][106226] Updated weights for policy 0, policy_version 1194756 (0.0009) [2023-12-28 03:50:39,972][106226] Updated weights for policy 0, policy_version 1194766 (0.0009) [2023-12-28 03:50:40,036][106226] Updated weights for policy 0, policy_version 1194776 (0.0006) [2023-12-28 03:50:40,189][106225] Updated weights for policy 1, policy_version 1197680 (0.0008) [2023-12-28 03:50:40,254][106225] Updated weights for policy 1, policy_version 1197690 (0.0009) [2023-12-28 03:50:40,317][106225] Updated weights for policy 1, policy_version 1197700 (0.0009) [2023-12-28 03:50:40,728][106226] Updated weights for policy 0, policy_version 1194786 (0.0009) [2023-12-28 03:50:40,793][106226] Updated weights for policy 0, policy_version 1194796 (0.0008) [2023-12-28 03:50:40,852][106226] Updated weights for policy 0, policy_version 1194806 (0.0008) [2023-12-28 03:50:41,076][106225] Updated weights for policy 1, policy_version 1197710 (0.0008) [2023-12-28 03:50:41,134][106225] Updated weights for policy 1, policy_version 1197720 (0.0006) [2023-12-28 03:50:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 612589568. Throughput: 0: 10077.9, 1: 10055.4. Samples: 612565288. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:41,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-5.107')] [2023-12-28 03:50:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001194808_305930240.pth... [2023-12-28 03:50:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001193624_305627136.pth [2023-12-28 03:50:41,200][106225] Updated weights for policy 1, policy_version 1197730 (0.0008) [2023-12-28 03:50:41,235][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001197736_306667520.pth... [2023-12-28 03:50:41,240][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001196552_306364416.pth [2023-12-28 03:50:41,526][106226] Updated weights for policy 0, policy_version 1194816 (0.0008) [2023-12-28 03:50:41,572][106226] Updated weights for policy 0, policy_version 1194826 (0.0008) [2023-12-28 03:50:41,633][106226] Updated weights for policy 0, policy_version 1194836 (0.0007) [2023-12-28 03:50:42,007][106225] Updated weights for policy 1, policy_version 1197740 (0.0008) [2023-12-28 03:50:42,068][106225] Updated weights for policy 1, policy_version 1197750 (0.0008) [2023-12-28 03:50:42,125][106225] Updated weights for policy 1, policy_version 1197760 (0.0009) [2023-12-28 03:50:42,428][106226] Updated weights for policy 0, policy_version 1194846 (0.0007) [2023-12-28 03:50:42,494][106226] Updated weights for policy 0, policy_version 1194856 (0.0007) [2023-12-28 03:50:42,554][106226] Updated weights for policy 0, policy_version 1194866 (0.0009) [2023-12-28 03:50:42,873][106225] Updated weights for policy 1, policy_version 1197770 (0.0008) [2023-12-28 03:50:42,938][106225] Updated weights for policy 1, policy_version 1197780 (0.0006) [2023-12-28 03:50:42,992][106225] Updated weights for policy 1, policy_version 1197790 (0.0005) [2023-12-28 03:50:43,052][106225] Updated weights for policy 1, policy_version 1197800 (0.0005) [2023-12-28 03:50:43,292][106226] Updated weights for policy 0, policy_version 1194876 (0.0007) [2023-12-28 03:50:43,350][106226] Updated weights for policy 0, policy_version 1194886 (0.0005) [2023-12-28 03:50:43,402][106226] Updated weights for policy 0, policy_version 1194896 (0.0008) [2023-12-28 03:50:43,668][106225] Updated weights for policy 1, policy_version 1197810 (0.0009) [2023-12-28 03:50:43,729][106225] Updated weights for policy 1, policy_version 1197820 (0.0007) [2023-12-28 03:50:43,780][106225] Updated weights for policy 1, policy_version 1197830 (0.0005) [2023-12-28 03:50:44,048][106226] Updated weights for policy 0, policy_version 1194906 (0.0007) [2023-12-28 03:50:44,117][106226] Updated weights for policy 0, policy_version 1194916 (0.0008) [2023-12-28 03:50:44,172][106226] Updated weights for policy 0, policy_version 1194926 (0.0008) [2023-12-28 03:50:44,222][106226] Updated weights for policy 0, policy_version 1194936 (0.0008) [2023-12-28 03:50:44,467][106225] Updated weights for policy 1, policy_version 1197840 (0.0007) [2023-12-28 03:50:44,534][106225] Updated weights for policy 1, policy_version 1197850 (0.0006) [2023-12-28 03:50:44,593][106225] Updated weights for policy 1, policy_version 1197860 (0.0010) [2023-12-28 03:50:44,889][106226] Updated weights for policy 0, policy_version 1194946 (0.0008) [2023-12-28 03:50:44,961][106226] Updated weights for policy 0, policy_version 1194956 (0.0007) [2023-12-28 03:50:45,023][106226] Updated weights for policy 0, policy_version 1194966 (0.0008) [2023-12-28 03:50:45,293][106225] Updated weights for policy 1, policy_version 1197870 (0.0010) [2023-12-28 03:50:45,357][106225] Updated weights for policy 1, policy_version 1197880 (0.0010) [2023-12-28 03:50:45,427][106225] Updated weights for policy 1, policy_version 1197890 (0.0010) [2023-12-28 03:50:45,648][106226] Updated weights for policy 0, policy_version 1194976 (0.0009) [2023-12-28 03:50:45,711][106226] Updated weights for policy 0, policy_version 1194986 (0.0006) [2023-12-28 03:50:45,765][106226] Updated weights for policy 0, policy_version 1194996 (0.0009) [2023-12-28 03:50:46,008][106225] Updated weights for policy 1, policy_version 1197900 (0.0008) [2023-12-28 03:50:46,065][106225] Updated weights for policy 1, policy_version 1197910 (0.0008) [2023-12-28 03:50:46,116][106225] Updated weights for policy 1, policy_version 1197920 (0.0009) [2023-12-28 03:50:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 612696064. Throughput: 0: 10072.3, 1: 9961.1. Samples: 612680572. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:46,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.811')] [2023-12-28 03:50:46,493][106226] Updated weights for policy 0, policy_version 1195006 (0.0008) [2023-12-28 03:50:46,544][106226] Updated weights for policy 0, policy_version 1195016 (0.0007) [2023-12-28 03:50:46,600][106226] Updated weights for policy 0, policy_version 1195026 (0.0005) [2023-12-28 03:50:46,875][106225] Updated weights for policy 1, policy_version 1197930 (0.0008) [2023-12-28 03:50:46,930][106225] Updated weights for policy 1, policy_version 1197940 (0.0005) [2023-12-28 03:50:46,976][106225] Updated weights for policy 1, policy_version 1197950 (0.0006) [2023-12-28 03:50:47,022][106225] Updated weights for policy 1, policy_version 1197960 (0.0006) [2023-12-28 03:50:47,243][106226] Updated weights for policy 0, policy_version 1195036 (0.0005) [2023-12-28 03:50:47,311][106226] Updated weights for policy 0, policy_version 1195046 (0.0005) [2023-12-28 03:50:47,371][106226] Updated weights for policy 0, policy_version 1195056 (0.0009) [2023-12-28 03:50:47,657][106225] Updated weights for policy 1, policy_version 1197970 (0.0008) [2023-12-28 03:50:47,705][106225] Updated weights for policy 1, policy_version 1197980 (0.0008) [2023-12-28 03:50:47,761][106225] Updated weights for policy 1, policy_version 1197990 (0.0008) [2023-12-28 03:50:48,043][106226] Updated weights for policy 0, policy_version 1195066 (0.0009) [2023-12-28 03:50:48,115][106226] Updated weights for policy 0, policy_version 1195076 (0.0008) [2023-12-28 03:50:48,174][106226] Updated weights for policy 0, policy_version 1195086 (0.0008) [2023-12-28 03:50:48,240][106226] Updated weights for policy 0, policy_version 1195096 (0.0008) [2023-12-28 03:50:48,509][106225] Updated weights for policy 1, policy_version 1198000 (0.0009) [2023-12-28 03:50:48,575][106225] Updated weights for policy 1, policy_version 1198010 (0.0009) [2023-12-28 03:50:48,638][106225] Updated weights for policy 1, policy_version 1198020 (0.0009) [2023-12-28 03:50:48,956][106226] Updated weights for policy 0, policy_version 1195106 (0.0008) [2023-12-28 03:50:49,013][106226] Updated weights for policy 0, policy_version 1195116 (0.0006) [2023-12-28 03:50:49,071][106226] Updated weights for policy 0, policy_version 1195126 (0.0005) [2023-12-28 03:50:49,352][106225] Updated weights for policy 1, policy_version 1198030 (0.0008) [2023-12-28 03:50:49,418][106225] Updated weights for policy 1, policy_version 1198040 (0.0008) [2023-12-28 03:50:49,476][106225] Updated weights for policy 1, policy_version 1198050 (0.0007) [2023-12-28 03:50:49,711][106226] Updated weights for policy 0, policy_version 1195136 (0.0008) [2023-12-28 03:50:49,777][106226] Updated weights for policy 0, policy_version 1195146 (0.0009) [2023-12-28 03:50:49,841][106226] Updated weights for policy 0, policy_version 1195156 (0.0008) [2023-12-28 03:50:50,179][106225] Updated weights for policy 1, policy_version 1198060 (0.0008) [2023-12-28 03:50:50,225][106225] Updated weights for policy 1, policy_version 1198070 (0.0008) [2023-12-28 03:50:50,282][106225] Updated weights for policy 1, policy_version 1198080 (0.0007) [2023-12-28 03:50:50,513][106226] Updated weights for policy 0, policy_version 1195166 (0.0008) [2023-12-28 03:50:50,571][106226] Updated weights for policy 0, policy_version 1195176 (0.0006) [2023-12-28 03:50:50,636][106226] Updated weights for policy 0, policy_version 1195186 (0.0007) [2023-12-28 03:50:51,028][106225] Updated weights for policy 1, policy_version 1198090 (0.0010) [2023-12-28 03:50:51,095][106225] Updated weights for policy 1, policy_version 1198100 (0.0007) [2023-12-28 03:50:51,165][106225] Updated weights for policy 1, policy_version 1198110 (0.0008) [2023-12-28 03:50:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 612786176. Throughput: 0: 10018.5, 1: 9947.1. Samples: 612799976. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:51,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-5.081')] [2023-12-28 03:50:51,230][106225] Updated weights for policy 1, policy_version 1198120 (0.0006) [2023-12-28 03:50:51,403][106226] Updated weights for policy 0, policy_version 1195196 (0.0008) [2023-12-28 03:50:51,466][106226] Updated weights for policy 0, policy_version 1195206 (0.0006) [2023-12-28 03:50:51,527][106226] Updated weights for policy 0, policy_version 1195216 (0.0008) [2023-12-28 03:50:51,950][106225] Updated weights for policy 1, policy_version 1198130 (0.0009) [2023-12-28 03:50:52,007][106225] Updated weights for policy 1, policy_version 1198140 (0.0009) [2023-12-28 03:50:52,067][106225] Updated weights for policy 1, policy_version 1198150 (0.0006) [2023-12-28 03:50:52,267][106226] Updated weights for policy 0, policy_version 1195226 (0.0009) [2023-12-28 03:50:52,333][106226] Updated weights for policy 0, policy_version 1195236 (0.0008) [2023-12-28 03:50:52,405][106226] Updated weights for policy 0, policy_version 1195246 (0.0008) [2023-12-28 03:50:52,470][106226] Updated weights for policy 0, policy_version 1195256 (0.0010) [2023-12-28 03:50:52,682][106225] Updated weights for policy 1, policy_version 1198160 (0.0008) [2023-12-28 03:50:52,738][106225] Updated weights for policy 1, policy_version 1198170 (0.0008) [2023-12-28 03:50:52,794][106225] Updated weights for policy 1, policy_version 1198180 (0.0007) [2023-12-28 03:50:53,221][106226] Updated weights for policy 0, policy_version 1195266 (0.0008) [2023-12-28 03:50:53,283][106226] Updated weights for policy 0, policy_version 1195276 (0.0008) [2023-12-28 03:50:53,348][106226] Updated weights for policy 0, policy_version 1195286 (0.0007) [2023-12-28 03:50:53,485][106225] Updated weights for policy 1, policy_version 1198190 (0.0008) [2023-12-28 03:50:53,536][106225] Updated weights for policy 1, policy_version 1198200 (0.0008) [2023-12-28 03:50:53,582][106225] Updated weights for policy 1, policy_version 1198210 (0.0008) [2023-12-28 03:50:54,020][106226] Updated weights for policy 0, policy_version 1195296 (0.0006) [2023-12-28 03:50:54,079][106226] Updated weights for policy 0, policy_version 1195306 (0.0005) [2023-12-28 03:50:54,137][106226] Updated weights for policy 0, policy_version 1195316 (0.0005) [2023-12-28 03:50:54,392][106225] Updated weights for policy 1, policy_version 1198220 (0.0008) [2023-12-28 03:50:54,452][106225] Updated weights for policy 1, policy_version 1198230 (0.0005) [2023-12-28 03:50:54,508][106225] Updated weights for policy 1, policy_version 1198240 (0.0005) [2023-12-28 03:50:54,705][106226] Updated weights for policy 0, policy_version 1195326 (0.0008) [2023-12-28 03:50:54,765][106226] Updated weights for policy 0, policy_version 1195336 (0.0009) [2023-12-28 03:50:54,828][106226] Updated weights for policy 0, policy_version 1195346 (0.0007) [2023-12-28 03:50:55,163][106225] Updated weights for policy 1, policy_version 1198250 (0.0006) [2023-12-28 03:50:55,213][106225] Updated weights for policy 1, policy_version 1198260 (0.0007) [2023-12-28 03:50:55,267][106225] Updated weights for policy 1, policy_version 1198270 (0.0007) [2023-12-28 03:50:55,330][106225] Updated weights for policy 1, policy_version 1198280 (0.0008) [2023-12-28 03:50:55,524][106226] Updated weights for policy 0, policy_version 1195356 (0.0007) [2023-12-28 03:50:55,584][106226] Updated weights for policy 0, policy_version 1195366 (0.0005) [2023-12-28 03:50:55,644][106226] Updated weights for policy 0, policy_version 1195376 (0.0005) [2023-12-28 03:50:56,009][106225] Updated weights for policy 1, policy_version 1198290 (0.0006) [2023-12-28 03:50:56,073][106225] Updated weights for policy 1, policy_version 1198300 (0.0010) [2023-12-28 03:50:56,134][106225] Updated weights for policy 1, policy_version 1198310 (0.0010) [2023-12-28 03:50:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 612892672. Throughput: 0: 9991.7, 1: 9932.2. Samples: 612858352. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:50:56,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-5.265')] [2023-12-28 03:50:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001198312_306814976.pth... [2023-12-28 03:50:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001195384_306077696.pth... [2023-12-28 03:50:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001197128_306511872.pth [2023-12-28 03:50:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001194200_305774592.pth [2023-12-28 03:50:56,313][106226] Updated weights for policy 0, policy_version 1195386 (0.0007) [2023-12-28 03:50:56,366][106226] Updated weights for policy 0, policy_version 1195396 (0.0010) [2023-12-28 03:50:56,420][106226] Updated weights for policy 0, policy_version 1195406 (0.0011) [2023-12-28 03:50:56,470][106226] Updated weights for policy 0, policy_version 1195416 (0.0011) [2023-12-28 03:50:56,821][106225] Updated weights for policy 1, policy_version 1198320 (0.0010) [2023-12-28 03:50:56,880][106225] Updated weights for policy 1, policy_version 1198330 (0.0010) [2023-12-28 03:50:56,943][106225] Updated weights for policy 1, policy_version 1198340 (0.0010) [2023-12-28 03:50:57,206][106226] Updated weights for policy 0, policy_version 1195426 (0.0007) [2023-12-28 03:50:57,270][106226] Updated weights for policy 0, policy_version 1195436 (0.0008) [2023-12-28 03:50:57,327][106226] Updated weights for policy 0, policy_version 1195446 (0.0008) [2023-12-28 03:50:57,613][106225] Updated weights for policy 1, policy_version 1198350 (0.0008) [2023-12-28 03:50:57,671][106225] Updated weights for policy 1, policy_version 1198360 (0.0008) [2023-12-28 03:50:57,738][106225] Updated weights for policy 1, policy_version 1198370 (0.0007) [2023-12-28 03:50:58,089][106226] Updated weights for policy 0, policy_version 1195456 (0.0009) [2023-12-28 03:50:58,147][106226] Updated weights for policy 0, policy_version 1195466 (0.0009) [2023-12-28 03:50:58,197][106226] Updated weights for policy 0, policy_version 1195476 (0.0010) [2023-12-28 03:50:58,400][106225] Updated weights for policy 1, policy_version 1198380 (0.0008) [2023-12-28 03:50:58,468][106225] Updated weights for policy 1, policy_version 1198390 (0.0008) [2023-12-28 03:50:58,531][106225] Updated weights for policy 1, policy_version 1198400 (0.0008) [2023-12-28 03:50:59,071][106226] Updated weights for policy 0, policy_version 1195486 (0.0008) [2023-12-28 03:50:59,134][106226] Updated weights for policy 0, policy_version 1195496 (0.0008) [2023-12-28 03:50:59,200][106226] Updated weights for policy 0, policy_version 1195506 (0.0007) [2023-12-28 03:50:59,374][106225] Updated weights for policy 1, policy_version 1198410 (0.0009) [2023-12-28 03:50:59,443][106225] Updated weights for policy 1, policy_version 1198420 (0.0011) [2023-12-28 03:50:59,506][106225] Updated weights for policy 1, policy_version 1198430 (0.0010) [2023-12-28 03:50:59,569][106225] Updated weights for policy 1, policy_version 1198440 (0.0010) [2023-12-28 03:50:59,949][106226] Updated weights for policy 0, policy_version 1195516 (0.0009) [2023-12-28 03:51:00,009][106226] Updated weights for policy 0, policy_version 1195526 (0.0010) [2023-12-28 03:51:00,066][106226] Updated weights for policy 0, policy_version 1195536 (0.0010) [2023-12-28 03:51:00,255][106225] Updated weights for policy 1, policy_version 1198450 (0.0008) [2023-12-28 03:51:00,314][106225] Updated weights for policy 1, policy_version 1198460 (0.0006) [2023-12-28 03:51:00,377][106225] Updated weights for policy 1, policy_version 1198470 (0.0006) [2023-12-28 03:51:00,749][106226] Updated weights for policy 0, policy_version 1195546 (0.0010) [2023-12-28 03:51:00,797][106226] Updated weights for policy 0, policy_version 1195556 (0.0005) [2023-12-28 03:51:00,842][106226] Updated weights for policy 0, policy_version 1195566 (0.0005) [2023-12-28 03:51:00,893][106226] Updated weights for policy 0, policy_version 1195576 (0.0006) [2023-12-28 03:51:01,029][106225] Updated weights for policy 1, policy_version 1198480 (0.0008) [2023-12-28 03:51:01,088][106225] Updated weights for policy 1, policy_version 1198490 (0.0008) [2023-12-28 03:51:01,153][106225] Updated weights for policy 1, policy_version 1198500 (0.0008) [2023-12-28 03:51:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 612990976. Throughput: 0: 9956.3, 1: 9909.4. Samples: 612973960. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:51:01,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.300')] [2023-12-28 03:51:01,587][106226] Updated weights for policy 0, policy_version 1195586 (0.0011) [2023-12-28 03:51:01,653][106226] Updated weights for policy 0, policy_version 1195596 (0.0009) [2023-12-28 03:51:01,713][106226] Updated weights for policy 0, policy_version 1195606 (0.0008) [2023-12-28 03:51:01,855][106225] Updated weights for policy 1, policy_version 1198510 (0.0007) [2023-12-28 03:51:01,903][106225] Updated weights for policy 1, policy_version 1198520 (0.0008) [2023-12-28 03:51:01,957][106225] Updated weights for policy 1, policy_version 1198530 (0.0009) [2023-12-28 03:51:02,335][106226] Updated weights for policy 0, policy_version 1195616 (0.0009) [2023-12-28 03:51:02,404][106226] Updated weights for policy 0, policy_version 1195626 (0.0008) [2023-12-28 03:51:02,461][106226] Updated weights for policy 0, policy_version 1195636 (0.0005) [2023-12-28 03:51:02,620][106225] Updated weights for policy 1, policy_version 1198540 (0.0008) [2023-12-28 03:51:02,678][106225] Updated weights for policy 1, policy_version 1198550 (0.0007) [2023-12-28 03:51:02,744][106225] Updated weights for policy 1, policy_version 1198560 (0.0007) [2023-12-28 03:51:03,117][106226] Updated weights for policy 0, policy_version 1195646 (0.0007) [2023-12-28 03:51:03,176][106226] Updated weights for policy 0, policy_version 1195656 (0.0008) [2023-12-28 03:51:03,239][106226] Updated weights for policy 0, policy_version 1195666 (0.0007) [2023-12-28 03:51:03,460][106225] Updated weights for policy 1, policy_version 1198570 (0.0008) [2023-12-28 03:51:03,522][106225] Updated weights for policy 1, policy_version 1198580 (0.0008) [2023-12-28 03:51:03,576][106225] Updated weights for policy 1, policy_version 1198590 (0.0008) [2023-12-28 03:51:03,638][106225] Updated weights for policy 1, policy_version 1198600 (0.0008) [2023-12-28 03:51:03,976][106226] Updated weights for policy 0, policy_version 1195676 (0.0009) [2023-12-28 03:51:04,029][106226] Updated weights for policy 0, policy_version 1195686 (0.0009) [2023-12-28 03:51:04,089][106226] Updated weights for policy 0, policy_version 1195696 (0.0009) [2023-12-28 03:51:04,354][106225] Updated weights for policy 1, policy_version 1198610 (0.0010) [2023-12-28 03:51:04,413][106225] Updated weights for policy 1, policy_version 1198620 (0.0010) [2023-12-28 03:51:04,482][106225] Updated weights for policy 1, policy_version 1198630 (0.0006) [2023-12-28 03:51:04,816][106226] Updated weights for policy 0, policy_version 1195706 (0.0007) [2023-12-28 03:51:04,871][106226] Updated weights for policy 0, policy_version 1195716 (0.0005) [2023-12-28 03:51:04,922][106226] Updated weights for policy 0, policy_version 1195726 (0.0006) [2023-12-28 03:51:04,975][106226] Updated weights for policy 0, policy_version 1195736 (0.0010) [2023-12-28 03:51:05,122][106225] Updated weights for policy 1, policy_version 1198640 (0.0005) [2023-12-28 03:51:05,175][106225] Updated weights for policy 1, policy_version 1198650 (0.0006) [2023-12-28 03:51:05,224][106225] Updated weights for policy 1, policy_version 1198660 (0.0010) [2023-12-28 03:51:05,690][106226] Updated weights for policy 0, policy_version 1195746 (0.0007) [2023-12-28 03:51:05,751][106226] Updated weights for policy 0, policy_version 1195756 (0.0009) [2023-12-28 03:51:05,809][106226] Updated weights for policy 0, policy_version 1195766 (0.0008) [2023-12-28 03:51:05,926][106225] Updated weights for policy 1, policy_version 1198671 (0.0010) [2023-12-28 03:51:05,989][106225] Updated weights for policy 1, policy_version 1198681 (0.0008) [2023-12-28 03:51:06,049][106225] Updated weights for policy 1, policy_version 1198691 (0.0009) [2023-12-28 03:51:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 613089280. Throughput: 0: 10011.0, 1: 9935.9. Samples: 613094648. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:51:06,176][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.882')] [2023-12-28 03:51:06,437][106226] Updated weights for policy 0, policy_version 1195776 (0.0008) [2023-12-28 03:51:06,498][106226] Updated weights for policy 0, policy_version 1195786 (0.0008) [2023-12-28 03:51:06,568][106226] Updated weights for policy 0, policy_version 1195796 (0.0009) [2023-12-28 03:51:06,816][106225] Updated weights for policy 1, policy_version 1198701 (0.0009) [2023-12-28 03:51:06,869][106225] Updated weights for policy 1, policy_version 1198711 (0.0009) [2023-12-28 03:51:06,927][106225] Updated weights for policy 1, policy_version 1198721 (0.0008) [2023-12-28 03:51:07,209][106226] Updated weights for policy 0, policy_version 1195806 (0.0009) [2023-12-28 03:51:07,273][106226] Updated weights for policy 0, policy_version 1195816 (0.0008) [2023-12-28 03:51:07,332][106226] Updated weights for policy 0, policy_version 1195826 (0.0009) [2023-12-28 03:51:07,683][106225] Updated weights for policy 1, policy_version 1198731 (0.0007) [2023-12-28 03:51:07,726][106225] Updated weights for policy 1, policy_version 1198741 (0.0005) [2023-12-28 03:51:07,775][106225] Updated weights for policy 1, policy_version 1198751 (0.0005) [2023-12-28 03:51:07,974][106226] Updated weights for policy 0, policy_version 1195836 (0.0009) [2023-12-28 03:51:08,036][106226] Updated weights for policy 0, policy_version 1195846 (0.0010) [2023-12-28 03:51:08,091][106226] Updated weights for policy 0, policy_version 1195856 (0.0010) [2023-12-28 03:51:08,348][106225] Updated weights for policy 1, policy_version 1198761 (0.0006) [2023-12-28 03:51:08,409][106225] Updated weights for policy 1, policy_version 1198771 (0.0010) [2023-12-28 03:51:08,466][106225] Updated weights for policy 1, policy_version 1198781 (0.0010) [2023-12-28 03:51:08,528][106225] Updated weights for policy 1, policy_version 1198791 (0.0011) [2023-12-28 03:51:08,778][106226] Updated weights for policy 0, policy_version 1195866 (0.0011) [2023-12-28 03:51:08,841][106226] Updated weights for policy 0, policy_version 1195876 (0.0010) [2023-12-28 03:51:08,899][106226] Updated weights for policy 0, policy_version 1195886 (0.0009) [2023-12-28 03:51:08,962][106226] Updated weights for policy 0, policy_version 1195896 (0.0009) [2023-12-28 03:51:09,246][106225] Updated weights for policy 1, policy_version 1198801 (0.0009) [2023-12-28 03:51:09,295][106225] Updated weights for policy 1, policy_version 1198811 (0.0007) [2023-12-28 03:51:09,354][106225] Updated weights for policy 1, policy_version 1198821 (0.0010) [2023-12-28 03:51:09,637][106226] Updated weights for policy 0, policy_version 1195906 (0.0006) [2023-12-28 03:51:09,692][106226] Updated weights for policy 0, policy_version 1195916 (0.0006) [2023-12-28 03:51:09,749][106226] Updated weights for policy 0, policy_version 1195926 (0.0006) [2023-12-28 03:51:10,173][106225] Updated weights for policy 1, policy_version 1198831 (0.0011) [2023-12-28 03:51:10,233][106225] Updated weights for policy 1, policy_version 1198841 (0.0009) [2023-12-28 03:51:10,297][106225] Updated weights for policy 1, policy_version 1198851 (0.0009) [2023-12-28 03:51:10,445][106226] Updated weights for policy 0, policy_version 1195936 (0.0008) [2023-12-28 03:51:10,502][106226] Updated weights for policy 0, policy_version 1195946 (0.0009) [2023-12-28 03:51:10,556][106226] Updated weights for policy 0, policy_version 1195956 (0.0006) [2023-12-28 03:51:11,143][106225] Updated weights for policy 1, policy_version 1198861 (0.0009) [2023-12-28 03:51:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 613179392. Throughput: 0: 10052.2, 1: 9973.7. Samples: 613155536. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:51:11,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.999')] [2023-12-28 03:51:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001195960_306225152.pth... [2023-12-28 03:51:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001194808_305930240.pth [2023-12-28 03:51:11,210][106225] Updated weights for policy 1, policy_version 1198871 (0.0007) [2023-12-28 03:51:11,277][106225] Updated weights for policy 1, policy_version 1198881 (0.0007) [2023-12-28 03:51:11,287][106226] Updated weights for policy 0, policy_version 1195966 (0.0007) [2023-12-28 03:51:11,317][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001198888_306962432.pth... [2023-12-28 03:51:11,321][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001197736_306667520.pth [2023-12-28 03:51:11,350][106226] Updated weights for policy 0, policy_version 1195976 (0.0009) [2023-12-28 03:51:11,414][106226] Updated weights for policy 0, policy_version 1195986 (0.0009) [2023-12-28 03:51:12,060][106225] Updated weights for policy 1, policy_version 1198891 (0.0007) [2023-12-28 03:51:12,116][106225] Updated weights for policy 1, policy_version 1198901 (0.0007) [2023-12-28 03:51:12,179][106225] Updated weights for policy 1, policy_version 1198911 (0.0007) [2023-12-28 03:51:12,197][106226] Updated weights for policy 0, policy_version 1195996 (0.0008) [2023-12-28 03:51:12,254][106226] Updated weights for policy 0, policy_version 1196006 (0.0007) [2023-12-28 03:51:12,316][106226] Updated weights for policy 0, policy_version 1196016 (0.0008) [2023-12-28 03:51:12,861][106225] Updated weights for policy 1, policy_version 1198921 (0.0005) [2023-12-28 03:51:12,928][106225] Updated weights for policy 1, policy_version 1198931 (0.0006) [2023-12-28 03:51:12,977][106225] Updated weights for policy 1, policy_version 1198941 (0.0008) [2023-12-28 03:51:13,024][106225] Updated weights for policy 1, policy_version 1198951 (0.0008) [2023-12-28 03:51:13,048][106226] Updated weights for policy 0, policy_version 1196026 (0.0008) [2023-12-28 03:51:13,109][106226] Updated weights for policy 0, policy_version 1196036 (0.0008) [2023-12-28 03:51:13,162][106226] Updated weights for policy 0, policy_version 1196046 (0.0009) [2023-12-28 03:51:13,218][106226] Updated weights for policy 0, policy_version 1196056 (0.0008) [2023-12-28 03:51:13,621][106225] Updated weights for policy 1, policy_version 1198961 (0.0008) [2023-12-28 03:51:13,665][106225] Updated weights for policy 1, policy_version 1198971 (0.0008) [2023-12-28 03:51:13,720][106225] Updated weights for policy 1, policy_version 1198981 (0.0006) [2023-12-28 03:51:13,992][106226] Updated weights for policy 0, policy_version 1196066 (0.0010) [2023-12-28 03:51:14,052][106226] Updated weights for policy 0, policy_version 1196076 (0.0010) [2023-12-28 03:51:14,114][106226] Updated weights for policy 0, policy_version 1196086 (0.0011) [2023-12-28 03:51:14,275][106225] Updated weights for policy 1, policy_version 1198991 (0.0006) [2023-12-28 03:51:14,329][106225] Updated weights for policy 1, policy_version 1199001 (0.0009) [2023-12-28 03:51:14,388][106225] Updated weights for policy 1, policy_version 1199011 (0.0010) [2023-12-28 03:51:14,732][106226] Updated weights for policy 0, policy_version 1196096 (0.0009) [2023-12-28 03:51:14,790][106226] Updated weights for policy 0, policy_version 1196106 (0.0009) [2023-12-28 03:51:14,856][106226] Updated weights for policy 0, policy_version 1196116 (0.0008) [2023-12-28 03:51:15,113][106225] Updated weights for policy 1, policy_version 1199021 (0.0007) [2023-12-28 03:51:15,164][106225] Updated weights for policy 1, policy_version 1199031 (0.0007) [2023-12-28 03:51:15,228][106225] Updated weights for policy 1, policy_version 1199041 (0.0006) [2023-12-28 03:51:15,573][106226] Updated weights for policy 0, policy_version 1196126 (0.0009) [2023-12-28 03:51:15,636][106226] Updated weights for policy 0, policy_version 1196137 (0.0009) [2023-12-28 03:51:15,692][106226] Updated weights for policy 0, policy_version 1196149 (0.0010) [2023-12-28 03:51:15,850][106225] Updated weights for policy 1, policy_version 1199051 (0.0009) [2023-12-28 03:51:15,895][106225] Updated weights for policy 1, policy_version 1199061 (0.0007) [2023-12-28 03:51:15,950][106225] Updated weights for policy 1, policy_version 1199071 (0.0009) [2023-12-28 03:51:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 613285888. Throughput: 0: 9960.0, 1: 9920.7. Samples: 613271896. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-28 03:51:16,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.853')] [2023-12-28 03:51:16,400][106226] Updated weights for policy 0, policy_version 1196159 (0.0006) [2023-12-28 03:51:16,459][106226] Updated weights for policy 0, policy_version 1196169 (0.0009) [2023-12-28 03:51:16,518][106226] Updated weights for policy 0, policy_version 1196179 (0.0008) [2023-12-28 03:51:16,552][106225] Updated weights for policy 1, policy_version 1199081 (0.0007) [2023-12-28 03:51:16,615][106225] Updated weights for policy 1, policy_version 1199091 (0.0010) [2023-12-28 03:51:16,672][106225] Updated weights for policy 1, policy_version 1199101 (0.0010) [2023-12-28 03:51:16,719][106225] Updated weights for policy 1, policy_version 1199111 (0.0010) [2023-12-28 03:51:17,122][106226] Updated weights for policy 0, policy_version 1196189 (0.0007) [2023-12-28 03:51:17,185][106226] Updated weights for policy 0, policy_version 1196199 (0.0005) [2023-12-28 03:51:17,231][106226] Updated weights for policy 0, policy_version 1196209 (0.0005) [2023-12-28 03:51:17,324][106225] Updated weights for policy 1, policy_version 1199121 (0.0007) [2023-12-28 03:51:17,384][106225] Updated weights for policy 1, policy_version 1199131 (0.0010) [2023-12-28 03:51:17,440][106225] Updated weights for policy 1, policy_version 1199141 (0.0010) [2023-12-28 03:51:17,880][106226] Updated weights for policy 0, policy_version 1196219 (0.0007) [2023-12-28 03:51:17,930][106226] Updated weights for policy 0, policy_version 1196229 (0.0010) [2023-12-28 03:51:17,982][106226] Updated weights for policy 0, policy_version 1196239 (0.0009) [2023-12-28 03:51:18,077][106225] Updated weights for policy 1, policy_version 1199151 (0.0009) [2023-12-28 03:51:18,135][106225] Updated weights for policy 1, policy_version 1199161 (0.0005) [2023-12-28 03:51:18,193][106225] Updated weights for policy 1, policy_version 1199171 (0.0005) [2023-12-28 03:51:18,771][106226] Updated weights for policy 0, policy_version 1196249 (0.0008) [2023-12-28 03:51:18,798][106225] Updated weights for policy 1, policy_version 1199181 (0.0007) [2023-12-28 03:51:18,834][106226] Updated weights for policy 0, policy_version 1196259 (0.0011) [2023-12-28 03:51:18,855][106225] Updated weights for policy 1, policy_version 1199191 (0.0010) [2023-12-28 03:51:18,892][106226] Updated weights for policy 0, policy_version 1196269 (0.0011) [2023-12-28 03:51:18,904][106225] Updated weights for policy 1, policy_version 1199201 (0.0007) [2023-12-28 03:51:18,954][106226] Updated weights for policy 0, policy_version 1196279 (0.0011) [2023-12-28 03:51:19,669][106226] Updated weights for policy 0, policy_version 1196289 (0.0007) [2023-12-28 03:51:19,719][106225] Updated weights for policy 1, policy_version 1199211 (0.0008) [2023-12-28 03:51:19,736][106226] Updated weights for policy 0, policy_version 1196299 (0.0007) [2023-12-28 03:51:19,785][106225] Updated weights for policy 1, policy_version 1199221 (0.0007) [2023-12-28 03:51:19,800][106226] Updated weights for policy 0, policy_version 1196309 (0.0006) [2023-12-28 03:51:19,859][106225] Updated weights for policy 1, policy_version 1199231 (0.0008) [2023-12-28 03:51:20,470][106226] Updated weights for policy 0, policy_version 1196319 (0.0006) [2023-12-28 03:51:20,532][106226] Updated weights for policy 0, policy_version 1196329 (0.0008) [2023-12-28 03:51:20,617][106226] Updated weights for policy 0, policy_version 1196339 (0.0007) [2023-12-28 03:51:20,629][106225] Updated weights for policy 1, policy_version 1199241 (0.0009) [2023-12-28 03:51:20,694][106225] Updated weights for policy 1, policy_version 1199251 (0.0009) [2023-12-28 03:51:20,759][106225] Updated weights for policy 1, policy_version 1199261 (0.0009) [2023-12-28 03:51:20,820][106225] Updated weights for policy 1, policy_version 1199271 (0.0008) [2023-12-28 03:51:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 613384192. Throughput: 0: 9876.3, 1: 9936.8. Samples: 613393632. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:21,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-5.189')] [2023-12-28 03:51:21,401][106226] Updated weights for policy 0, policy_version 1196349 (0.0009) [2023-12-28 03:51:21,462][106226] Updated weights for policy 0, policy_version 1196359 (0.0009) [2023-12-28 03:51:21,526][106226] Updated weights for policy 0, policy_version 1196369 (0.0007) [2023-12-28 03:51:21,537][106225] Updated weights for policy 1, policy_version 1199281 (0.0007) [2023-12-28 03:51:21,594][106225] Updated weights for policy 1, policy_version 1199291 (0.0006) [2023-12-28 03:51:21,662][106225] Updated weights for policy 1, policy_version 1199301 (0.0009) [2023-12-28 03:51:22,340][106225] Updated weights for policy 1, policy_version 1199311 (0.0011) [2023-12-28 03:51:22,353][106226] Updated weights for policy 0, policy_version 1196379 (0.0008) [2023-12-28 03:51:22,413][106225] Updated weights for policy 1, policy_version 1199321 (0.0010) [2023-12-28 03:51:22,425][106226] Updated weights for policy 0, policy_version 1196389 (0.0006) [2023-12-28 03:51:22,472][106225] Updated weights for policy 1, policy_version 1199331 (0.0011) [2023-12-28 03:51:22,494][106226] Updated weights for policy 0, policy_version 1196399 (0.0006) [2023-12-28 03:51:23,157][106225] Updated weights for policy 1, policy_version 1199341 (0.0011) [2023-12-28 03:51:23,185][106226] Updated weights for policy 0, policy_version 1196409 (0.0006) [2023-12-28 03:51:23,209][106225] Updated weights for policy 1, policy_version 1199351 (0.0010) [2023-12-28 03:51:23,243][106226] Updated weights for policy 0, policy_version 1196419 (0.0010) [2023-12-28 03:51:23,263][106225] Updated weights for policy 1, policy_version 1199361 (0.0010) [2023-12-28 03:51:23,306][106226] Updated weights for policy 0, policy_version 1196429 (0.0010) [2023-12-28 03:51:23,369][106226] Updated weights for policy 0, policy_version 1196439 (0.0010) [2023-12-28 03:51:23,921][106225] Updated weights for policy 1, policy_version 1199371 (0.0010) [2023-12-28 03:51:23,977][106225] Updated weights for policy 1, policy_version 1199381 (0.0010) [2023-12-28 03:51:24,019][106225] Updated weights for policy 1, policy_version 1199391 (0.0010) [2023-12-28 03:51:24,068][106226] Updated weights for policy 0, policy_version 1196449 (0.0010) [2023-12-28 03:51:24,132][106226] Updated weights for policy 0, policy_version 1196459 (0.0010) [2023-12-28 03:51:24,185][106226] Updated weights for policy 0, policy_version 1196469 (0.0010) [2023-12-28 03:51:24,599][106225] Updated weights for policy 1, policy_version 1199401 (0.0010) [2023-12-28 03:51:24,645][106225] Updated weights for policy 1, policy_version 1199411 (0.0007) [2023-12-28 03:51:24,693][106225] Updated weights for policy 1, policy_version 1199421 (0.0007) [2023-12-28 03:51:24,754][106225] Updated weights for policy 1, policy_version 1199431 (0.0008) [2023-12-28 03:51:24,903][106226] Updated weights for policy 0, policy_version 1196479 (0.0010) [2023-12-28 03:51:24,964][106226] Updated weights for policy 0, policy_version 1196489 (0.0011) [2023-12-28 03:51:25,019][106226] Updated weights for policy 0, policy_version 1196499 (0.0010) [2023-12-28 03:51:25,373][106225] Updated weights for policy 1, policy_version 1199441 (0.0007) [2023-12-28 03:51:25,435][106225] Updated weights for policy 1, policy_version 1199451 (0.0005) [2023-12-28 03:51:25,486][106225] Updated weights for policy 1, policy_version 1199461 (0.0005) [2023-12-28 03:51:25,746][106226] Updated weights for policy 0, policy_version 1196509 (0.0011) [2023-12-28 03:51:25,806][106226] Updated weights for policy 0, policy_version 1196519 (0.0011) [2023-12-28 03:51:25,856][106226] Updated weights for policy 0, policy_version 1196529 (0.0010) [2023-12-28 03:51:26,054][106225] Updated weights for policy 1, policy_version 1199471 (0.0006) [2023-12-28 03:51:26,121][106225] Updated weights for policy 1, policy_version 1199481 (0.0010) [2023-12-28 03:51:26,175][105115] Fps is (10 sec: 19659.8, 60 sec: 19933.7, 300 sec: 19855.1). Total num frames: 613482496. Throughput: 0: 9809.1, 1: 9875.6. Samples: 613451112. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:26,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-5.393')] [2023-12-28 03:51:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001196536_306372608.pth... [2023-12-28 03:51:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001195384_306077696.pth [2023-12-28 03:51:26,188][106225] Updated weights for policy 1, policy_version 1199491 (0.0010) [2023-12-28 03:51:26,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001199496_307118080.pth... [2023-12-28 03:51:26,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001198312_306814976.pth [2023-12-28 03:51:26,573][106226] Updated weights for policy 0, policy_version 1196539 (0.0010) [2023-12-28 03:51:26,641][106226] Updated weights for policy 0, policy_version 1196549 (0.0011) [2023-12-28 03:51:26,698][106226] Updated weights for policy 0, policy_version 1196559 (0.0010) [2023-12-28 03:51:26,801][106225] Updated weights for policy 1, policy_version 1199501 (0.0008) [2023-12-28 03:51:26,854][106225] Updated weights for policy 1, policy_version 1199511 (0.0005) [2023-12-28 03:51:26,911][106225] Updated weights for policy 1, policy_version 1199521 (0.0005) [2023-12-28 03:51:27,446][106226] Updated weights for policy 0, policy_version 1196569 (0.0010) [2023-12-28 03:51:27,463][106225] Updated weights for policy 1, policy_version 1199531 (0.0007) [2023-12-28 03:51:27,509][106226] Updated weights for policy 0, policy_version 1196579 (0.0005) [2023-12-28 03:51:27,525][106225] Updated weights for policy 1, policy_version 1199541 (0.0010) [2023-12-28 03:51:27,567][106226] Updated weights for policy 0, policy_version 1196589 (0.0005) [2023-12-28 03:51:27,588][106225] Updated weights for policy 1, policy_version 1199551 (0.0010) [2023-12-28 03:51:27,624][106226] Updated weights for policy 0, policy_version 1196599 (0.0006) [2023-12-28 03:51:28,173][106226] Updated weights for policy 0, policy_version 1196609 (0.0006) [2023-12-28 03:51:28,216][106225] Updated weights for policy 1, policy_version 1199561 (0.0006) [2023-12-28 03:51:28,233][106226] Updated weights for policy 0, policy_version 1196619 (0.0005) [2023-12-28 03:51:28,262][106225] Updated weights for policy 1, policy_version 1199571 (0.0010) [2023-12-28 03:51:28,290][106226] Updated weights for policy 0, policy_version 1196629 (0.0005) [2023-12-28 03:51:28,319][106225] Updated weights for policy 1, policy_version 1199581 (0.0010) [2023-12-28 03:51:28,380][106225] Updated weights for policy 1, policy_version 1199591 (0.0010) [2023-12-28 03:51:28,879][106226] Updated weights for policy 0, policy_version 1196639 (0.0007) [2023-12-28 03:51:28,948][106226] Updated weights for policy 0, policy_version 1196649 (0.0005) [2023-12-28 03:51:29,011][106226] Updated weights for policy 0, policy_version 1196659 (0.0007) [2023-12-28 03:51:29,079][106225] Updated weights for policy 1, policy_version 1199601 (0.0006) [2023-12-28 03:51:29,138][106225] Updated weights for policy 1, policy_version 1199611 (0.0007) [2023-12-28 03:51:29,198][106225] Updated weights for policy 1, policy_version 1199621 (0.0008) [2023-12-28 03:51:29,776][106226] Updated weights for policy 0, policy_version 1196669 (0.0008) [2023-12-28 03:51:29,785][106225] Updated weights for policy 1, policy_version 1199631 (0.0006) [2023-12-28 03:51:29,841][106226] Updated weights for policy 0, policy_version 1196679 (0.0007) [2023-12-28 03:51:29,850][106225] Updated weights for policy 1, policy_version 1199641 (0.0009) [2023-12-28 03:51:29,898][106226] Updated weights for policy 0, policy_version 1196689 (0.0006) [2023-12-28 03:51:29,916][106225] Updated weights for policy 1, policy_version 1199651 (0.0009) [2023-12-28 03:51:30,532][106225] Updated weights for policy 1, policy_version 1199661 (0.0008) [2023-12-28 03:51:30,583][106225] Updated weights for policy 1, policy_version 1199671 (0.0008) [2023-12-28 03:51:30,626][106225] Updated weights for policy 1, policy_version 1199681 (0.0008) [2023-12-28 03:51:30,667][106226] Updated weights for policy 0, policy_version 1196699 (0.0007) [2023-12-28 03:51:30,723][106226] Updated weights for policy 0, policy_version 1196709 (0.0005) [2023-12-28 03:51:30,775][106226] Updated weights for policy 0, policy_version 1196719 (0.0005) [2023-12-28 03:51:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 613588992. Throughput: 0: 9840.8, 1: 10105.1. Samples: 613578136. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:31,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-5.198')] [2023-12-28 03:51:31,418][106225] Updated weights for policy 1, policy_version 1199691 (0.0007) [2023-12-28 03:51:31,443][106226] Updated weights for policy 0, policy_version 1196729 (0.0005) [2023-12-28 03:51:31,470][106225] Updated weights for policy 1, policy_version 1199701 (0.0007) [2023-12-28 03:51:31,499][106226] Updated weights for policy 0, policy_version 1196739 (0.0006) [2023-12-28 03:51:31,524][106225] Updated weights for policy 1, policy_version 1199711 (0.0008) [2023-12-28 03:51:31,550][106226] Updated weights for policy 0, policy_version 1196749 (0.0005) [2023-12-28 03:51:31,613][106226] Updated weights for policy 0, policy_version 1196759 (0.0007) [2023-12-28 03:51:32,264][106225] Updated weights for policy 1, policy_version 1199721 (0.0008) [2023-12-28 03:51:32,304][106226] Updated weights for policy 0, policy_version 1196769 (0.0008) [2023-12-28 03:51:32,326][106225] Updated weights for policy 1, policy_version 1199731 (0.0007) [2023-12-28 03:51:32,370][106226] Updated weights for policy 0, policy_version 1196779 (0.0006) [2023-12-28 03:51:32,394][106225] Updated weights for policy 1, policy_version 1199741 (0.0008) [2023-12-28 03:51:32,434][106226] Updated weights for policy 0, policy_version 1196789 (0.0006) [2023-12-28 03:51:32,454][106225] Updated weights for policy 1, policy_version 1199751 (0.0008) [2023-12-28 03:51:33,127][106225] Updated weights for policy 1, policy_version 1199761 (0.0007) [2023-12-28 03:51:33,187][106226] Updated weights for policy 0, policy_version 1196799 (0.0009) [2023-12-28 03:51:33,187][106225] Updated weights for policy 1, policy_version 1199771 (0.0008) [2023-12-28 03:51:33,242][106225] Updated weights for policy 1, policy_version 1199781 (0.0007) [2023-12-28 03:51:33,247][106226] Updated weights for policy 0, policy_version 1196809 (0.0008) [2023-12-28 03:51:33,303][106226] Updated weights for policy 0, policy_version 1196819 (0.0009) [2023-12-28 03:51:33,896][106226] Updated weights for policy 0, policy_version 1196829 (0.0009) [2023-12-28 03:51:33,944][106226] Updated weights for policy 0, policy_version 1196839 (0.0006) [2023-12-28 03:51:33,957][106225] Updated weights for policy 1, policy_version 1199791 (0.0005) [2023-12-28 03:51:33,993][106226] Updated weights for policy 0, policy_version 1196849 (0.0006) [2023-12-28 03:51:34,014][106225] Updated weights for policy 1, policy_version 1199801 (0.0006) [2023-12-28 03:51:34,069][106225] Updated weights for policy 1, policy_version 1199811 (0.0007) [2023-12-28 03:51:34,655][106225] Updated weights for policy 1, policy_version 1199821 (0.0008) [2023-12-28 03:51:34,712][106225] Updated weights for policy 1, policy_version 1199831 (0.0010) [2023-12-28 03:51:34,775][106225] Updated weights for policy 1, policy_version 1199841 (0.0010) [2023-12-28 03:51:34,777][106226] Updated weights for policy 0, policy_version 1196859 (0.0007) [2023-12-28 03:51:34,844][106226] Updated weights for policy 0, policy_version 1196869 (0.0006) [2023-12-28 03:51:34,906][106226] Updated weights for policy 0, policy_version 1196879 (0.0008) [2023-12-28 03:51:35,470][106225] Updated weights for policy 1, policy_version 1199851 (0.0010) [2023-12-28 03:51:35,518][106225] Updated weights for policy 1, policy_version 1199861 (0.0008) [2023-12-28 03:51:35,581][106225] Updated weights for policy 1, policy_version 1199871 (0.0008) [2023-12-28 03:51:35,585][106226] Updated weights for policy 0, policy_version 1196889 (0.0005) [2023-12-28 03:51:35,640][106226] Updated weights for policy 0, policy_version 1196899 (0.0005) [2023-12-28 03:51:35,688][106226] Updated weights for policy 0, policy_version 1196909 (0.0005) [2023-12-28 03:51:35,733][106226] Updated weights for policy 0, policy_version 1196919 (0.0007) [2023-12-28 03:51:36,175][105115] Fps is (10 sec: 20481.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 613687296. Throughput: 0: 9833.8, 1: 10113.0. Samples: 613697580. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:36,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.686')] [2023-12-28 03:51:36,330][106225] Updated weights for policy 1, policy_version 1199881 (0.0008) [2023-12-28 03:51:36,396][106225] Updated weights for policy 1, policy_version 1199891 (0.0007) [2023-12-28 03:51:36,462][106225] Updated weights for policy 1, policy_version 1199901 (0.0006) [2023-12-28 03:51:36,476][106226] Updated weights for policy 0, policy_version 1196929 (0.0008) [2023-12-28 03:51:36,521][106225] Updated weights for policy 1, policy_version 1199911 (0.0007) [2023-12-28 03:51:36,536][106226] Updated weights for policy 0, policy_version 1196939 (0.0007) [2023-12-28 03:51:36,594][106226] Updated weights for policy 0, policy_version 1196949 (0.0007) [2023-12-28 03:51:37,137][106225] Updated weights for policy 1, policy_version 1199921 (0.0008) [2023-12-28 03:51:37,198][106225] Updated weights for policy 1, policy_version 1199931 (0.0008) [2023-12-28 03:51:37,255][106225] Updated weights for policy 1, policy_version 1199941 (0.0007) [2023-12-28 03:51:37,321][106226] Updated weights for policy 0, policy_version 1196959 (0.0009) [2023-12-28 03:51:37,380][106226] Updated weights for policy 0, policy_version 1196969 (0.0009) [2023-12-28 03:51:37,426][106226] Updated weights for policy 0, policy_version 1196979 (0.0008) [2023-12-28 03:51:37,899][106225] Updated weights for policy 1, policy_version 1199951 (0.0008) [2023-12-28 03:51:37,958][106225] Updated weights for policy 1, policy_version 1199961 (0.0008) [2023-12-28 03:51:38,015][106225] Updated weights for policy 1, policy_version 1199971 (0.0009) [2023-12-28 03:51:38,168][106226] Updated weights for policy 0, policy_version 1196989 (0.0007) [2023-12-28 03:51:38,233][106226] Updated weights for policy 0, policy_version 1196999 (0.0007) [2023-12-28 03:51:38,298][106226] Updated weights for policy 0, policy_version 1197009 (0.0007) [2023-12-28 03:51:38,713][106225] Updated weights for policy 1, policy_version 1199981 (0.0009) [2023-12-28 03:51:38,760][106225] Updated weights for policy 1, policy_version 1199991 (0.0008) [2023-12-28 03:51:38,817][106225] Updated weights for policy 1, policy_version 1200001 (0.0007) [2023-12-28 03:51:38,972][106226] Updated weights for policy 0, policy_version 1197019 (0.0010) [2023-12-28 03:51:39,028][106226] Updated weights for policy 0, policy_version 1197029 (0.0009) [2023-12-28 03:51:39,080][106226] Updated weights for policy 0, policy_version 1197039 (0.0008) [2023-12-28 03:51:39,690][106225] Updated weights for policy 1, policy_version 1200011 (0.0008) [2023-12-28 03:51:39,761][106225] Updated weights for policy 1, policy_version 1200021 (0.0010) [2023-12-28 03:51:39,820][106226] Updated weights for policy 0, policy_version 1197049 (0.0008) [2023-12-28 03:51:39,824][106225] Updated weights for policy 1, policy_version 1200031 (0.0009) [2023-12-28 03:51:39,890][106226] Updated weights for policy 0, policy_version 1197059 (0.0007) [2023-12-28 03:51:39,955][106226] Updated weights for policy 0, policy_version 1197069 (0.0008) [2023-12-28 03:51:40,007][106226] Updated weights for policy 0, policy_version 1197079 (0.0007) [2023-12-28 03:51:40,604][106225] Updated weights for policy 1, policy_version 1200041 (0.0009) [2023-12-28 03:51:40,649][106226] Updated weights for policy 0, policy_version 1197089 (0.0007) [2023-12-28 03:51:40,664][106225] Updated weights for policy 1, policy_version 1200051 (0.0006) [2023-12-28 03:51:40,710][106226] Updated weights for policy 0, policy_version 1197099 (0.0008) [2023-12-28 03:51:40,725][106225] Updated weights for policy 1, policy_version 1200061 (0.0006) [2023-12-28 03:51:40,779][106226] Updated weights for policy 0, policy_version 1197109 (0.0008) [2023-12-28 03:51:40,794][106225] Updated weights for policy 1, policy_version 1200071 (0.0006) [2023-12-28 03:51:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 613785600. Throughput: 0: 9828.9, 1: 10144.9. Samples: 613757172. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:41,176][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.945')] [2023-12-28 03:51:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001200072_307265536.pth... [2023-12-28 03:51:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001197112_306520064.pth... [2023-12-28 03:51:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001198888_306962432.pth [2023-12-28 03:51:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001195960_306225152.pth [2023-12-28 03:51:41,538][106225] Updated weights for policy 1, policy_version 1200081 (0.0006) [2023-12-28 03:51:41,601][106225] Updated weights for policy 1, policy_version 1200091 (0.0006) [2023-12-28 03:51:41,652][106226] Updated weights for policy 0, policy_version 1197119 (0.0008) [2023-12-28 03:51:41,669][106225] Updated weights for policy 1, policy_version 1200101 (0.0008) [2023-12-28 03:51:41,717][106226] Updated weights for policy 0, policy_version 1197129 (0.0008) [2023-12-28 03:51:41,787][106226] Updated weights for policy 0, policy_version 1197139 (0.0009) [2023-12-28 03:51:42,293][106225] Updated weights for policy 1, policy_version 1200111 (0.0008) [2023-12-28 03:51:42,356][106225] Updated weights for policy 1, policy_version 1200121 (0.0008) [2023-12-28 03:51:42,418][106225] Updated weights for policy 1, policy_version 1200131 (0.0009) [2023-12-28 03:51:42,470][106226] Updated weights for policy 0, policy_version 1197149 (0.0008) [2023-12-28 03:51:42,533][106226] Updated weights for policy 0, policy_version 1197159 (0.0008) [2023-12-28 03:51:42,590][106226] Updated weights for policy 0, policy_version 1197169 (0.0008) [2023-12-28 03:51:43,140][106225] Updated weights for policy 1, policy_version 1200141 (0.0009) [2023-12-28 03:51:43,197][106225] Updated weights for policy 1, policy_version 1200151 (0.0010) [2023-12-28 03:51:43,259][106225] Updated weights for policy 1, policy_version 1200161 (0.0008) [2023-12-28 03:51:43,328][106226] Updated weights for policy 0, policy_version 1197179 (0.0008) [2023-12-28 03:51:43,385][106226] Updated weights for policy 0, policy_version 1197189 (0.0010) [2023-12-28 03:51:43,451][106226] Updated weights for policy 0, policy_version 1197199 (0.0011) [2023-12-28 03:51:43,888][106225] Updated weights for policy 1, policy_version 1200171 (0.0009) [2023-12-28 03:51:43,937][106225] Updated weights for policy 1, policy_version 1200181 (0.0007) [2023-12-28 03:51:43,990][106225] Updated weights for policy 1, policy_version 1200191 (0.0007) [2023-12-28 03:51:44,125][106226] Updated weights for policy 0, policy_version 1197209 (0.0011) [2023-12-28 03:51:44,175][106226] Updated weights for policy 0, policy_version 1197219 (0.0007) [2023-12-28 03:51:44,224][106226] Updated weights for policy 0, policy_version 1197229 (0.0007) [2023-12-28 03:51:44,286][106226] Updated weights for policy 0, policy_version 1197239 (0.0008) [2023-12-28 03:51:44,618][106225] Updated weights for policy 1, policy_version 1200201 (0.0007) [2023-12-28 03:51:44,677][106225] Updated weights for policy 1, policy_version 1200211 (0.0010) [2023-12-28 03:51:44,732][106225] Updated weights for policy 1, policy_version 1200221 (0.0010) [2023-12-28 03:51:44,792][106225] Updated weights for policy 1, policy_version 1200231 (0.0009) [2023-12-28 03:51:45,023][106226] Updated weights for policy 0, policy_version 1197249 (0.0010) [2023-12-28 03:51:45,088][106226] Updated weights for policy 0, policy_version 1197259 (0.0010) [2023-12-28 03:51:45,153][106226] Updated weights for policy 0, policy_version 1197269 (0.0011) [2023-12-28 03:51:45,518][106225] Updated weights for policy 1, policy_version 1200241 (0.0010) [2023-12-28 03:51:45,565][106225] Updated weights for policy 1, policy_version 1200251 (0.0010) [2023-12-28 03:51:45,616][106225] Updated weights for policy 1, policy_version 1200261 (0.0010) [2023-12-28 03:51:45,866][106226] Updated weights for policy 0, policy_version 1197279 (0.0011) [2023-12-28 03:51:45,929][106226] Updated weights for policy 0, policy_version 1197289 (0.0010) [2023-12-28 03:51:45,982][106226] Updated weights for policy 0, policy_version 1197299 (0.0010) [2023-12-28 03:51:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 613883904. Throughput: 0: 9826.6, 1: 10166.9. Samples: 613873668. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:46,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.662')] [2023-12-28 03:51:46,232][106225] Updated weights for policy 1, policy_version 1200271 (0.0007) [2023-12-28 03:51:46,279][106225] Updated weights for policy 1, policy_version 1200281 (0.0005) [2023-12-28 03:51:46,325][106225] Updated weights for policy 1, policy_version 1200291 (0.0005) [2023-12-28 03:51:46,678][106226] Updated weights for policy 0, policy_version 1197309 (0.0011) [2023-12-28 03:51:46,739][106226] Updated weights for policy 0, policy_version 1197319 (0.0011) [2023-12-28 03:51:46,788][106226] Updated weights for policy 0, policy_version 1197329 (0.0010) [2023-12-28 03:51:46,930][106225] Updated weights for policy 1, policy_version 1200301 (0.0005) [2023-12-28 03:51:46,988][106225] Updated weights for policy 1, policy_version 1200311 (0.0008) [2023-12-28 03:51:47,037][106225] Updated weights for policy 1, policy_version 1200321 (0.0010) [2023-12-28 03:51:47,488][106226] Updated weights for policy 0, policy_version 1197339 (0.0010) [2023-12-28 03:51:47,549][106226] Updated weights for policy 0, policy_version 1197349 (0.0010) [2023-12-28 03:51:47,609][106226] Updated weights for policy 0, policy_version 1197359 (0.0008) [2023-12-28 03:51:47,664][106225] Updated weights for policy 1, policy_version 1200331 (0.0006) [2023-12-28 03:51:47,722][106225] Updated weights for policy 1, policy_version 1200341 (0.0009) [2023-12-28 03:51:47,777][106225] Updated weights for policy 1, policy_version 1200351 (0.0010) [2023-12-28 03:51:48,338][106225] Updated weights for policy 1, policy_version 1200361 (0.0009) [2023-12-28 03:51:48,344][106226] Updated weights for policy 0, policy_version 1197369 (0.0010) [2023-12-28 03:51:48,401][106226] Updated weights for policy 0, policy_version 1197379 (0.0011) [2023-12-28 03:51:48,402][106225] Updated weights for policy 1, policy_version 1200371 (0.0010) [2023-12-28 03:51:48,457][106225] Updated weights for policy 1, policy_version 1200381 (0.0009) [2023-12-28 03:51:48,460][106226] Updated weights for policy 0, policy_version 1197389 (0.0011) [2023-12-28 03:51:48,513][106225] Updated weights for policy 1, policy_version 1200391 (0.0006) [2023-12-28 03:51:48,524][106226] Updated weights for policy 0, policy_version 1197399 (0.0010) [2023-12-28 03:51:49,182][106226] Updated weights for policy 0, policy_version 1197409 (0.0006) [2023-12-28 03:51:49,190][106225] Updated weights for policy 1, policy_version 1200401 (0.0008) [2023-12-28 03:51:49,253][106226] Updated weights for policy 0, policy_version 1197419 (0.0007) [2023-12-28 03:51:49,254][106225] Updated weights for policy 1, policy_version 1200411 (0.0007) [2023-12-28 03:51:49,310][106225] Updated weights for policy 1, policy_version 1200421 (0.0010) [2023-12-28 03:51:49,321][106226] Updated weights for policy 0, policy_version 1197429 (0.0006) [2023-12-28 03:51:49,974][106226] Updated weights for policy 0, policy_version 1197439 (0.0007) [2023-12-28 03:51:50,049][106226] Updated weights for policy 0, policy_version 1197449 (0.0005) [2023-12-28 03:51:50,077][106225] Updated weights for policy 1, policy_version 1200431 (0.0009) [2023-12-28 03:51:50,117][106226] Updated weights for policy 0, policy_version 1197459 (0.0006) [2023-12-28 03:51:50,135][106225] Updated weights for policy 1, policy_version 1200441 (0.0007) [2023-12-28 03:51:50,193][106225] Updated weights for policy 1, policy_version 1200451 (0.0008) [2023-12-28 03:51:50,747][106226] Updated weights for policy 0, policy_version 1197469 (0.0008) [2023-12-28 03:51:50,809][106226] Updated weights for policy 0, policy_version 1197479 (0.0009) [2023-12-28 03:51:50,870][106226] Updated weights for policy 0, policy_version 1197489 (0.0009) [2023-12-28 03:51:50,976][106225] Updated weights for policy 1, policy_version 1200461 (0.0008) [2023-12-28 03:51:51,043][106225] Updated weights for policy 1, policy_version 1200471 (0.0009) [2023-12-28 03:51:51,107][106225] Updated weights for policy 1, policy_version 1200481 (0.0008) [2023-12-28 03:51:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 613990400. Throughput: 0: 9798.3, 1: 10199.6. Samples: 613994552. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:51,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-5.256')] [2023-12-28 03:51:51,675][106226] Updated weights for policy 0, policy_version 1197499 (0.0009) [2023-12-28 03:51:51,739][106226] Updated weights for policy 0, policy_version 1197509 (0.0008) [2023-12-28 03:51:51,809][106226] Updated weights for policy 0, policy_version 1197519 (0.0008) [2023-12-28 03:51:51,878][106225] Updated weights for policy 1, policy_version 1200491 (0.0008) [2023-12-28 03:51:51,944][106225] Updated weights for policy 1, policy_version 1200501 (0.0008) [2023-12-28 03:51:52,010][106225] Updated weights for policy 1, policy_version 1200511 (0.0008) [2023-12-28 03:51:52,451][106226] Updated weights for policy 0, policy_version 1197529 (0.0008) [2023-12-28 03:51:52,513][106226] Updated weights for policy 0, policy_version 1197539 (0.0008) [2023-12-28 03:51:52,576][106226] Updated weights for policy 0, policy_version 1197549 (0.0009) [2023-12-28 03:51:52,639][106226] Updated weights for policy 0, policy_version 1197559 (0.0008) [2023-12-28 03:51:52,756][106225] Updated weights for policy 1, policy_version 1200521 (0.0009) [2023-12-28 03:51:52,826][106225] Updated weights for policy 1, policy_version 1200531 (0.0009) [2023-12-28 03:51:52,892][106225] Updated weights for policy 1, policy_version 1200541 (0.0008) [2023-12-28 03:51:52,953][106225] Updated weights for policy 1, policy_version 1200551 (0.0008) [2023-12-28 03:51:53,325][106226] Updated weights for policy 0, policy_version 1197569 (0.0009) [2023-12-28 03:51:53,378][106226] Updated weights for policy 0, policy_version 1197579 (0.0008) [2023-12-28 03:51:53,432][106226] Updated weights for policy 0, policy_version 1197589 (0.0008) [2023-12-28 03:51:53,644][106225] Updated weights for policy 1, policy_version 1200561 (0.0008) [2023-12-28 03:51:53,705][106225] Updated weights for policy 1, policy_version 1200571 (0.0006) [2023-12-28 03:51:53,771][106225] Updated weights for policy 1, policy_version 1200581 (0.0005) [2023-12-28 03:51:54,178][106226] Updated weights for policy 0, policy_version 1197599 (0.0009) [2023-12-28 03:51:54,229][106226] Updated weights for policy 0, policy_version 1197609 (0.0008) [2023-12-28 03:51:54,291][106226] Updated weights for policy 0, policy_version 1197619 (0.0008) [2023-12-28 03:51:54,441][106225] Updated weights for policy 1, policy_version 1200591 (0.0007) [2023-12-28 03:51:54,497][106225] Updated weights for policy 1, policy_version 1200601 (0.0008) [2023-12-28 03:51:54,556][106225] Updated weights for policy 1, policy_version 1200611 (0.0009) [2023-12-28 03:51:55,025][106226] Updated weights for policy 0, policy_version 1197629 (0.0007) [2023-12-28 03:51:55,077][106226] Updated weights for policy 0, policy_version 1197639 (0.0008) [2023-12-28 03:51:55,138][106226] Updated weights for policy 0, policy_version 1197649 (0.0009) [2023-12-28 03:51:55,242][106225] Updated weights for policy 1, policy_version 1200621 (0.0009) [2023-12-28 03:51:55,296][106225] Updated weights for policy 1, policy_version 1200631 (0.0007) [2023-12-28 03:51:55,344][106225] Updated weights for policy 1, policy_version 1200641 (0.0005) [2023-12-28 03:51:55,833][106226] Updated weights for policy 0, policy_version 1197659 (0.0007) [2023-12-28 03:51:55,882][106226] Updated weights for policy 0, policy_version 1197669 (0.0009) [2023-12-28 03:51:55,939][106226] Updated weights for policy 0, policy_version 1197679 (0.0009) [2023-12-28 03:51:55,945][106225] Updated weights for policy 1, policy_version 1200651 (0.0006) [2023-12-28 03:51:55,993][106225] Updated weights for policy 1, policy_version 1200661 (0.0006) [2023-12-28 03:51:56,042][106225] Updated weights for policy 1, policy_version 1200671 (0.0008) [2023-12-28 03:51:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 614088704. Throughput: 0: 9745.9, 1: 10164.3. Samples: 614051492. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:51:56,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-4.899')] [2023-12-28 03:51:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001200680_307421184.pth... [2023-12-28 03:51:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001197688_306667520.pth... [2023-12-28 03:51:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001199496_307118080.pth [2023-12-28 03:51:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001196536_306372608.pth [2023-12-28 03:51:56,677][106226] Updated weights for policy 0, policy_version 1197689 (0.0006) [2023-12-28 03:51:56,737][106226] Updated weights for policy 0, policy_version 1197699 (0.0006) [2023-12-28 03:51:56,803][106226] Updated weights for policy 0, policy_version 1197709 (0.0008) [2023-12-28 03:51:56,822][106225] Updated weights for policy 1, policy_version 1200681 (0.0008) [2023-12-28 03:51:56,860][106226] Updated weights for policy 0, policy_version 1197719 (0.0009) [2023-12-28 03:51:56,871][106225] Updated weights for policy 1, policy_version 1200691 (0.0006) [2023-12-28 03:51:56,919][106225] Updated weights for policy 1, policy_version 1200701 (0.0008) [2023-12-28 03:51:56,965][106225] Updated weights for policy 1, policy_version 1200711 (0.0007) [2023-12-28 03:51:57,538][106226] Updated weights for policy 0, policy_version 1197729 (0.0008) [2023-12-28 03:51:57,596][106226] Updated weights for policy 0, policy_version 1197739 (0.0006) [2023-12-28 03:51:57,655][106226] Updated weights for policy 0, policy_version 1197749 (0.0008) [2023-12-28 03:51:57,691][106225] Updated weights for policy 1, policy_version 1200721 (0.0005) [2023-12-28 03:51:57,756][106225] Updated weights for policy 1, policy_version 1200731 (0.0005) [2023-12-28 03:51:57,819][106225] Updated weights for policy 1, policy_version 1200741 (0.0007) [2023-12-28 03:51:58,313][106226] Updated weights for policy 0, policy_version 1197759 (0.0008) [2023-12-28 03:51:58,399][106226] Updated weights for policy 0, policy_version 1197769 (0.0008) [2023-12-28 03:51:58,439][106225] Updated weights for policy 1, policy_version 1200751 (0.0009) [2023-12-28 03:51:58,464][106226] Updated weights for policy 0, policy_version 1197779 (0.0009) [2023-12-28 03:51:58,504][106225] Updated weights for policy 1, policy_version 1200761 (0.0008) [2023-12-28 03:51:58,563][106225] Updated weights for policy 1, policy_version 1200771 (0.0008) [2023-12-28 03:51:59,274][106226] Updated weights for policy 0, policy_version 1197789 (0.0008) [2023-12-28 03:51:59,341][106226] Updated weights for policy 0, policy_version 1197799 (0.0008) [2023-12-28 03:51:59,356][106225] Updated weights for policy 1, policy_version 1200781 (0.0009) [2023-12-28 03:51:59,401][106226] Updated weights for policy 0, policy_version 1197809 (0.0006) [2023-12-28 03:51:59,417][106225] Updated weights for policy 1, policy_version 1200791 (0.0009) [2023-12-28 03:51:59,468][106225] Updated weights for policy 1, policy_version 1200801 (0.0009) [2023-12-28 03:52:00,051][106226] Updated weights for policy 0, policy_version 1197819 (0.0008) [2023-12-28 03:52:00,112][106226] Updated weights for policy 0, policy_version 1197829 (0.0009) [2023-12-28 03:52:00,164][106225] Updated weights for policy 1, policy_version 1200811 (0.0007) [2023-12-28 03:52:00,166][106226] Updated weights for policy 0, policy_version 1197839 (0.0008) [2023-12-28 03:52:00,230][106225] Updated weights for policy 1, policy_version 1200821 (0.0005) [2023-12-28 03:52:00,293][106225] Updated weights for policy 1, policy_version 1200831 (0.0005) [2023-12-28 03:52:00,820][106225] Updated weights for policy 1, policy_version 1200841 (0.0005) [2023-12-28 03:52:00,884][106225] Updated weights for policy 1, policy_version 1200851 (0.0005) [2023-12-28 03:52:00,948][106225] Updated weights for policy 1, policy_version 1200861 (0.0005) [2023-12-28 03:52:01,010][106225] Updated weights for policy 1, policy_version 1200871 (0.0006) [2023-12-28 03:52:01,018][106226] Updated weights for policy 0, policy_version 1197849 (0.0008) [2023-12-28 03:52:01,080][106226] Updated weights for policy 0, policy_version 1197859 (0.0009) [2023-12-28 03:52:01,142][106226] Updated weights for policy 0, policy_version 1197869 (0.0009) [2023-12-28 03:52:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 614178816. Throughput: 0: 9771.5, 1: 10204.2. Samples: 614170800. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:01,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.920')] [2023-12-28 03:52:01,204][106226] Updated weights for policy 0, policy_version 1197879 (0.0008) [2023-12-28 03:52:01,653][106225] Updated weights for policy 1, policy_version 1200881 (0.0011) [2023-12-28 03:52:01,717][106225] Updated weights for policy 1, policy_version 1200891 (0.0010) [2023-12-28 03:52:01,785][106225] Updated weights for policy 1, policy_version 1200901 (0.0006) [2023-12-28 03:52:01,916][106226] Updated weights for policy 0, policy_version 1197889 (0.0006) [2023-12-28 03:52:01,983][106226] Updated weights for policy 0, policy_version 1197899 (0.0008) [2023-12-28 03:52:02,034][106226] Updated weights for policy 0, policy_version 1197909 (0.0009) [2023-12-28 03:52:02,410][106225] Updated weights for policy 1, policy_version 1200911 (0.0008) [2023-12-28 03:52:02,469][106225] Updated weights for policy 1, policy_version 1200921 (0.0007) [2023-12-28 03:52:02,524][106225] Updated weights for policy 1, policy_version 1200931 (0.0008) [2023-12-28 03:52:02,687][106226] Updated weights for policy 0, policy_version 1197919 (0.0009) [2023-12-28 03:52:02,734][106226] Updated weights for policy 0, policy_version 1197929 (0.0007) [2023-12-28 03:52:02,782][106226] Updated weights for policy 0, policy_version 1197939 (0.0008) [2023-12-28 03:52:03,269][106225] Updated weights for policy 1, policy_version 1200941 (0.0007) [2023-12-28 03:52:03,318][106225] Updated weights for policy 1, policy_version 1200951 (0.0009) [2023-12-28 03:52:03,371][106225] Updated weights for policy 1, policy_version 1200961 (0.0009) [2023-12-28 03:52:03,452][106226] Updated weights for policy 0, policy_version 1197949 (0.0009) [2023-12-28 03:52:03,511][106226] Updated weights for policy 0, policy_version 1197959 (0.0009) [2023-12-28 03:52:03,565][106226] Updated weights for policy 0, policy_version 1197969 (0.0008) [2023-12-28 03:52:04,131][106225] Updated weights for policy 1, policy_version 1200971 (0.0008) [2023-12-28 03:52:04,196][106225] Updated weights for policy 1, policy_version 1200981 (0.0008) [2023-12-28 03:52:04,252][106225] Updated weights for policy 1, policy_version 1200991 (0.0008) [2023-12-28 03:52:04,253][106226] Updated weights for policy 0, policy_version 1197979 (0.0007) [2023-12-28 03:52:04,310][106226] Updated weights for policy 0, policy_version 1197989 (0.0007) [2023-12-28 03:52:04,376][106226] Updated weights for policy 0, policy_version 1197999 (0.0008) [2023-12-28 03:52:05,019][106226] Updated weights for policy 0, policy_version 1198009 (0.0008) [2023-12-28 03:52:05,035][106225] Updated weights for policy 1, policy_version 1201001 (0.0009) [2023-12-28 03:52:05,071][106226] Updated weights for policy 0, policy_version 1198019 (0.0009) [2023-12-28 03:52:05,083][106225] Updated weights for policy 1, policy_version 1201011 (0.0005) [2023-12-28 03:52:05,124][106226] Updated weights for policy 0, policy_version 1198029 (0.0005) [2023-12-28 03:52:05,134][106225] Updated weights for policy 1, policy_version 1201021 (0.0007) [2023-12-28 03:52:05,183][106225] Updated weights for policy 1, policy_version 1201031 (0.0008) [2023-12-28 03:52:05,184][106226] Updated weights for policy 0, policy_version 1198039 (0.0005) [2023-12-28 03:52:05,759][106226] Updated weights for policy 0, policy_version 1198049 (0.0007) [2023-12-28 03:52:05,820][106226] Updated weights for policy 0, policy_version 1198059 (0.0005) [2023-12-28 03:52:05,878][106226] Updated weights for policy 0, policy_version 1198069 (0.0005) [2023-12-28 03:52:05,983][106225] Updated weights for policy 1, policy_version 1201041 (0.0008) [2023-12-28 03:52:06,038][106225] Updated weights for policy 1, policy_version 1201051 (0.0009) [2023-12-28 03:52:06,102][106225] Updated weights for policy 1, policy_version 1201061 (0.0009) [2023-12-28 03:52:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 614285312. Throughput: 0: 9806.6, 1: 10151.3. Samples: 614291736. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:06,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.699')] [2023-12-28 03:52:06,529][106226] Updated weights for policy 0, policy_version 1198079 (0.0009) [2023-12-28 03:52:06,579][106226] Updated weights for policy 0, policy_version 1198089 (0.0010) [2023-12-28 03:52:06,627][106226] Updated weights for policy 0, policy_version 1198099 (0.0010) [2023-12-28 03:52:06,852][106225] Updated weights for policy 1, policy_version 1201071 (0.0006) [2023-12-28 03:52:06,917][106225] Updated weights for policy 1, policy_version 1201081 (0.0005) [2023-12-28 03:52:06,984][106225] Updated weights for policy 1, policy_version 1201091 (0.0008) [2023-12-28 03:52:07,274][106226] Updated weights for policy 0, policy_version 1198109 (0.0008) [2023-12-28 03:52:07,338][106226] Updated weights for policy 0, policy_version 1198119 (0.0006) [2023-12-28 03:52:07,398][106226] Updated weights for policy 0, policy_version 1198129 (0.0008) [2023-12-28 03:52:07,545][106225] Updated weights for policy 1, policy_version 1201101 (0.0006) [2023-12-28 03:52:07,594][106225] Updated weights for policy 1, policy_version 1201111 (0.0009) [2023-12-28 03:52:07,644][106225] Updated weights for policy 1, policy_version 1201121 (0.0009) [2023-12-28 03:52:07,909][106226] Updated weights for policy 0, policy_version 1198139 (0.0007) [2023-12-28 03:52:07,973][106226] Updated weights for policy 0, policy_version 1198149 (0.0010) [2023-12-28 03:52:08,037][106226] Updated weights for policy 0, policy_version 1198159 (0.0011) [2023-12-28 03:52:08,277][106225] Updated weights for policy 1, policy_version 1201131 (0.0008) [2023-12-28 03:52:08,345][106225] Updated weights for policy 1, policy_version 1201142 (0.0009) [2023-12-28 03:52:08,402][106225] Updated weights for policy 1, policy_version 1201152 (0.0008) [2023-12-28 03:52:08,746][106226] Updated weights for policy 0, policy_version 1198169 (0.0010) [2023-12-28 03:52:08,810][106226] Updated weights for policy 0, policy_version 1198179 (0.0011) [2023-12-28 03:52:08,872][106226] Updated weights for policy 0, policy_version 1198189 (0.0011) [2023-12-28 03:52:08,933][106226] Updated weights for policy 0, policy_version 1198199 (0.0011) [2023-12-28 03:52:09,158][106225] Updated weights for policy 1, policy_version 1201162 (0.0007) [2023-12-28 03:52:09,236][106225] Updated weights for policy 1, policy_version 1201172 (0.0007) [2023-12-28 03:52:09,298][106225] Updated weights for policy 1, policy_version 1201182 (0.0008) [2023-12-28 03:52:09,365][106225] Updated weights for policy 1, policy_version 1201192 (0.0007) [2023-12-28 03:52:09,643][106226] Updated weights for policy 0, policy_version 1198209 (0.0009) [2023-12-28 03:52:09,704][106226] Updated weights for policy 0, policy_version 1198219 (0.0009) [2023-12-28 03:52:09,765][106226] Updated weights for policy 0, policy_version 1198229 (0.0008) [2023-12-28 03:52:10,124][106225] Updated weights for policy 1, policy_version 1201202 (0.0009) [2023-12-28 03:52:10,179][106225] Updated weights for policy 1, policy_version 1201212 (0.0008) [2023-12-28 03:52:10,234][106225] Updated weights for policy 1, policy_version 1201222 (0.0009) [2023-12-28 03:52:10,454][106226] Updated weights for policy 0, policy_version 1198239 (0.0007) [2023-12-28 03:52:10,527][106226] Updated weights for policy 0, policy_version 1198249 (0.0007) [2023-12-28 03:52:10,599][106226] Updated weights for policy 0, policy_version 1198259 (0.0006) [2023-12-28 03:52:10,969][106225] Updated weights for policy 1, policy_version 1201232 (0.0008) [2023-12-28 03:52:11,036][106225] Updated weights for policy 1, policy_version 1201242 (0.0009) [2023-12-28 03:52:11,108][106225] Updated weights for policy 1, policy_version 1201252 (0.0007) [2023-12-28 03:52:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 614383616. Throughput: 0: 9889.0, 1: 10175.6. Samples: 614354008. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:11,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-5.090')] [2023-12-28 03:52:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001198264_306814976.pth... [2023-12-28 03:52:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001201256_307568640.pth... [2023-12-28 03:52:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001200072_307265536.pth [2023-12-28 03:52:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001197112_306520064.pth [2023-12-28 03:52:11,246][106226] Updated weights for policy 0, policy_version 1198269 (0.0008) [2023-12-28 03:52:11,313][106226] Updated weights for policy 0, policy_version 1198279 (0.0010) [2023-12-28 03:52:11,378][106226] Updated weights for policy 0, policy_version 1198289 (0.0008) [2023-12-28 03:52:11,875][106225] Updated weights for policy 1, policy_version 1201262 (0.0008) [2023-12-28 03:52:11,933][106225] Updated weights for policy 1, policy_version 1201272 (0.0006) [2023-12-28 03:52:11,992][106225] Updated weights for policy 1, policy_version 1201282 (0.0006) [2023-12-28 03:52:12,194][106226] Updated weights for policy 0, policy_version 1198299 (0.0009) [2023-12-28 03:52:12,246][106226] Updated weights for policy 0, policy_version 1198309 (0.0008) [2023-12-28 03:52:12,311][106226] Updated weights for policy 0, policy_version 1198319 (0.0008) [2023-12-28 03:52:12,643][106225] Updated weights for policy 1, policy_version 1201292 (0.0008) [2023-12-28 03:52:12,720][106225] Updated weights for policy 1, policy_version 1201302 (0.0009) [2023-12-28 03:52:12,775][106225] Updated weights for policy 1, policy_version 1201312 (0.0008) [2023-12-28 03:52:12,991][106226] Updated weights for policy 0, policy_version 1198329 (0.0009) [2023-12-28 03:52:13,041][106226] Updated weights for policy 0, policy_version 1198339 (0.0010) [2023-12-28 03:52:13,094][106226] Updated weights for policy 0, policy_version 1198349 (0.0010) [2023-12-28 03:52:13,150][106226] Updated weights for policy 0, policy_version 1198359 (0.0010) [2023-12-28 03:52:13,431][106225] Updated weights for policy 1, policy_version 1201322 (0.0010) [2023-12-28 03:52:13,481][106225] Updated weights for policy 1, policy_version 1201332 (0.0010) [2023-12-28 03:52:13,540][106225] Updated weights for policy 1, policy_version 1201342 (0.0010) [2023-12-28 03:52:13,600][106225] Updated weights for policy 1, policy_version 1201352 (0.0010) [2023-12-28 03:52:13,820][106226] Updated weights for policy 0, policy_version 1198369 (0.0006) [2023-12-28 03:52:13,881][106226] Updated weights for policy 0, policy_version 1198379 (0.0005) [2023-12-28 03:52:13,935][106226] Updated weights for policy 0, policy_version 1198389 (0.0005) [2023-12-28 03:52:14,306][106225] Updated weights for policy 1, policy_version 1201362 (0.0009) [2023-12-28 03:52:14,354][106225] Updated weights for policy 1, policy_version 1201372 (0.0010) [2023-12-28 03:52:14,420][106225] Updated weights for policy 1, policy_version 1201382 (0.0009) [2023-12-28 03:52:14,522][106226] Updated weights for policy 0, policy_version 1198399 (0.0009) [2023-12-28 03:52:14,584][106226] Updated weights for policy 0, policy_version 1198409 (0.0010) [2023-12-28 03:52:14,642][106226] Updated weights for policy 0, policy_version 1198419 (0.0010) [2023-12-28 03:52:15,167][106225] Updated weights for policy 1, policy_version 1201392 (0.0009) [2023-12-28 03:52:15,234][106225] Updated weights for policy 1, policy_version 1201402 (0.0008) [2023-12-28 03:52:15,299][106225] Updated weights for policy 1, policy_version 1201412 (0.0008) [2023-12-28 03:52:15,357][106226] Updated weights for policy 0, policy_version 1198429 (0.0009) [2023-12-28 03:52:15,415][106226] Updated weights for policy 0, policy_version 1198439 (0.0009) [2023-12-28 03:52:15,464][106226] Updated weights for policy 0, policy_version 1198449 (0.0009) [2023-12-28 03:52:15,880][106225] Updated weights for policy 1, policy_version 1201422 (0.0006) [2023-12-28 03:52:15,942][106225] Updated weights for policy 1, policy_version 1201432 (0.0005) [2023-12-28 03:52:16,005][106225] Updated weights for policy 1, policy_version 1201442 (0.0008) [2023-12-28 03:52:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 614481920. Throughput: 0: 9887.0, 1: 9960.7. Samples: 614471284. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:16,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.773')] [2023-12-28 03:52:16,269][106226] Updated weights for policy 0, policy_version 1198459 (0.0009) [2023-12-28 03:52:16,325][106226] Updated weights for policy 0, policy_version 1198469 (0.0009) [2023-12-28 03:52:16,373][106226] Updated weights for policy 0, policy_version 1198479 (0.0008) [2023-12-28 03:52:16,609][106225] Updated weights for policy 1, policy_version 1201452 (0.0009) [2023-12-28 03:52:16,676][106225] Updated weights for policy 1, policy_version 1201462 (0.0009) [2023-12-28 03:52:16,727][106225] Updated weights for policy 1, policy_version 1201472 (0.0009) [2023-12-28 03:52:17,110][106226] Updated weights for policy 0, policy_version 1198489 (0.0008) [2023-12-28 03:52:17,186][106226] Updated weights for policy 0, policy_version 1198499 (0.0006) [2023-12-28 03:52:17,251][106226] Updated weights for policy 0, policy_version 1198509 (0.0005) [2023-12-28 03:52:17,312][106226] Updated weights for policy 0, policy_version 1198519 (0.0005) [2023-12-28 03:52:17,353][106225] Updated weights for policy 1, policy_version 1201482 (0.0008) [2023-12-28 03:52:17,413][106225] Updated weights for policy 1, policy_version 1201492 (0.0005) [2023-12-28 03:52:17,480][106225] Updated weights for policy 1, policy_version 1201502 (0.0010) [2023-12-28 03:52:17,533][106225] Updated weights for policy 1, policy_version 1201512 (0.0008) [2023-12-28 03:52:17,790][106226] Updated weights for policy 0, policy_version 1198529 (0.0007) [2023-12-28 03:52:17,843][106226] Updated weights for policy 0, policy_version 1198539 (0.0010) [2023-12-28 03:52:17,906][106226] Updated weights for policy 0, policy_version 1198549 (0.0011) [2023-12-28 03:52:18,219][106225] Updated weights for policy 1, policy_version 1201522 (0.0008) [2023-12-28 03:52:18,265][106225] Updated weights for policy 1, policy_version 1201532 (0.0010) [2023-12-28 03:52:18,330][106225] Updated weights for policy 1, policy_version 1201542 (0.0010) [2023-12-28 03:52:18,526][106226] Updated weights for policy 0, policy_version 1198559 (0.0007) [2023-12-28 03:52:18,593][106226] Updated weights for policy 0, policy_version 1198569 (0.0005) [2023-12-28 03:52:18,655][106226] Updated weights for policy 0, policy_version 1198579 (0.0005) [2023-12-28 03:52:19,061][106225] Updated weights for policy 1, policy_version 1201552 (0.0010) [2023-12-28 03:52:19,128][106225] Updated weights for policy 1, policy_version 1201562 (0.0010) [2023-12-28 03:52:19,177][106226] Updated weights for policy 0, policy_version 1198589 (0.0005) [2023-12-28 03:52:19,190][106225] Updated weights for policy 1, policy_version 1201572 (0.0010) [2023-12-28 03:52:19,234][106226] Updated weights for policy 0, policy_version 1198599 (0.0007) [2023-12-28 03:52:19,289][106226] Updated weights for policy 0, policy_version 1198609 (0.0006) [2023-12-28 03:52:19,873][106225] Updated weights for policy 1, policy_version 1201582 (0.0010) [2023-12-28 03:52:19,946][106225] Updated weights for policy 1, policy_version 1201592 (0.0010) [2023-12-28 03:52:19,982][106226] Updated weights for policy 0, policy_version 1198619 (0.0010) [2023-12-28 03:52:20,010][106225] Updated weights for policy 1, policy_version 1201602 (0.0010) [2023-12-28 03:52:20,052][106226] Updated weights for policy 0, policy_version 1198629 (0.0006) [2023-12-28 03:52:20,120][106226] Updated weights for policy 0, policy_version 1198639 (0.0007) [2023-12-28 03:52:20,700][106225] Updated weights for policy 1, policy_version 1201612 (0.0010) [2023-12-28 03:52:20,754][106225] Updated weights for policy 1, policy_version 1201622 (0.0008) [2023-12-28 03:52:20,801][106226] Updated weights for policy 0, policy_version 1198649 (0.0007) [2023-12-28 03:52:20,812][106225] Updated weights for policy 1, policy_version 1201632 (0.0009) [2023-12-28 03:52:20,864][106226] Updated weights for policy 0, policy_version 1198659 (0.0006) [2023-12-28 03:52:20,930][106226] Updated weights for policy 0, policy_version 1198669 (0.0007) [2023-12-28 03:52:20,991][106226] Updated weights for policy 0, policy_version 1198679 (0.0008) [2023-12-28 03:52:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 614588416. Throughput: 0: 9943.5, 1: 9988.6. Samples: 614594524. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:21,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.880')] [2023-12-28 03:52:21,609][106225] Updated weights for policy 1, policy_version 1201642 (0.0010) [2023-12-28 03:52:21,681][106225] Updated weights for policy 1, policy_version 1201652 (0.0009) [2023-12-28 03:52:21,752][106225] Updated weights for policy 1, policy_version 1201662 (0.0010) [2023-12-28 03:52:21,812][106226] Updated weights for policy 0, policy_version 1198689 (0.0010) [2023-12-28 03:52:21,820][106225] Updated weights for policy 1, policy_version 1201672 (0.0011) [2023-12-28 03:52:21,874][106226] Updated weights for policy 0, policy_version 1198699 (0.0009) [2023-12-28 03:52:21,934][106226] Updated weights for policy 0, policy_version 1198709 (0.0011) [2023-12-28 03:52:22,546][106225] Updated weights for policy 1, policy_version 1201682 (0.0010) [2023-12-28 03:52:22,611][106225] Updated weights for policy 1, policy_version 1201692 (0.0010) [2023-12-28 03:52:22,629][106226] Updated weights for policy 0, policy_version 1198719 (0.0010) [2023-12-28 03:52:22,671][106225] Updated weights for policy 1, policy_version 1201702 (0.0010) [2023-12-28 03:52:22,679][106226] Updated weights for policy 0, policy_version 1198729 (0.0009) [2023-12-28 03:52:22,731][106226] Updated weights for policy 0, policy_version 1198739 (0.0009) [2023-12-28 03:52:23,295][106225] Updated weights for policy 1, policy_version 1201712 (0.0008) [2023-12-28 03:52:23,351][106225] Updated weights for policy 1, policy_version 1201722 (0.0007) [2023-12-28 03:52:23,408][106225] Updated weights for policy 1, policy_version 1201732 (0.0008) [2023-12-28 03:52:23,520][106226] Updated weights for policy 0, policy_version 1198749 (0.0009) [2023-12-28 03:52:23,584][106226] Updated weights for policy 0, policy_version 1198759 (0.0008) [2023-12-28 03:52:23,636][106226] Updated weights for policy 0, policy_version 1198769 (0.0009) [2023-12-28 03:52:24,098][106225] Updated weights for policy 1, policy_version 1201742 (0.0006) [2023-12-28 03:52:24,157][106225] Updated weights for policy 1, policy_version 1201752 (0.0006) [2023-12-28 03:52:24,215][106225] Updated weights for policy 1, policy_version 1201762 (0.0005) [2023-12-28 03:52:24,347][106226] Updated weights for policy 0, policy_version 1198779 (0.0008) [2023-12-28 03:52:24,411][106226] Updated weights for policy 0, policy_version 1198789 (0.0011) [2023-12-28 03:52:24,464][106226] Updated weights for policy 0, policy_version 1198799 (0.0010) [2023-12-28 03:52:24,806][106225] Updated weights for policy 1, policy_version 1201772 (0.0007) [2023-12-28 03:52:24,874][106225] Updated weights for policy 1, policy_version 1201782 (0.0010) [2023-12-28 03:52:24,931][106225] Updated weights for policy 1, policy_version 1201792 (0.0010) [2023-12-28 03:52:25,058][106226] Updated weights for policy 0, policy_version 1198809 (0.0008) [2023-12-28 03:52:25,112][106226] Updated weights for policy 0, policy_version 1198819 (0.0010) [2023-12-28 03:52:25,162][106226] Updated weights for policy 0, policy_version 1198829 (0.0010) [2023-12-28 03:52:25,211][106226] Updated weights for policy 0, policy_version 1198839 (0.0010) [2023-12-28 03:52:25,567][106225] Updated weights for policy 1, policy_version 1201802 (0.0009) [2023-12-28 03:52:25,617][106225] Updated weights for policy 1, policy_version 1201812 (0.0005) [2023-12-28 03:52:25,671][106225] Updated weights for policy 1, policy_version 1201822 (0.0007) [2023-12-28 03:52:25,720][106225] Updated weights for policy 1, policy_version 1201832 (0.0010) [2023-12-28 03:52:25,800][106226] Updated weights for policy 0, policy_version 1198849 (0.0006) [2023-12-28 03:52:25,854][106226] Updated weights for policy 0, policy_version 1198859 (0.0005) [2023-12-28 03:52:25,905][106226] Updated weights for policy 0, policy_version 1198869 (0.0005) [2023-12-28 03:52:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.6, 300 sec: 19855.7). Total num frames: 614686720. Throughput: 0: 9934.9, 1: 9940.4. Samples: 614651556. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:26,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-5.011')] [2023-12-28 03:52:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001201832_307716096.pth... [2023-12-28 03:52:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001198872_306970624.pth... [2023-12-28 03:52:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001200680_307421184.pth [2023-12-28 03:52:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001197688_306667520.pth [2023-12-28 03:52:26,300][106225] Updated weights for policy 1, policy_version 1201842 (0.0010) [2023-12-28 03:52:26,351][106225] Updated weights for policy 1, policy_version 1201852 (0.0010) [2023-12-28 03:52:26,401][106225] Updated weights for policy 1, policy_version 1201862 (0.0009) [2023-12-28 03:52:26,541][106226] Updated weights for policy 0, policy_version 1198879 (0.0009) [2023-12-28 03:52:26,599][106226] Updated weights for policy 0, policy_version 1198889 (0.0011) [2023-12-28 03:52:26,658][106226] Updated weights for policy 0, policy_version 1198899 (0.0010) [2023-12-28 03:52:27,047][106225] Updated weights for policy 1, policy_version 1201872 (0.0008) [2023-12-28 03:52:27,105][106225] Updated weights for policy 1, policy_version 1201882 (0.0011) [2023-12-28 03:52:27,152][106225] Updated weights for policy 1, policy_version 1201892 (0.0010) [2023-12-28 03:52:27,306][106226] Updated weights for policy 0, policy_version 1198909 (0.0008) [2023-12-28 03:52:27,358][106226] Updated weights for policy 0, policy_version 1198919 (0.0007) [2023-12-28 03:52:27,403][106226] Updated weights for policy 0, policy_version 1198929 (0.0007) [2023-12-28 03:52:27,752][106225] Updated weights for policy 1, policy_version 1201902 (0.0007) [2023-12-28 03:52:27,819][106225] Updated weights for policy 1, policy_version 1201912 (0.0008) [2023-12-28 03:52:27,873][106225] Updated weights for policy 1, policy_version 1201922 (0.0009) [2023-12-28 03:52:27,944][106226] Updated weights for policy 0, policy_version 1198939 (0.0007) [2023-12-28 03:52:27,989][106226] Updated weights for policy 0, policy_version 1198949 (0.0008) [2023-12-28 03:52:28,039][106226] Updated weights for policy 0, policy_version 1198959 (0.0008) [2023-12-28 03:52:28,567][106225] Updated weights for policy 1, policy_version 1201932 (0.0009) [2023-12-28 03:52:28,624][106225] Updated weights for policy 1, policy_version 1201942 (0.0010) [2023-12-28 03:52:28,688][106225] Updated weights for policy 1, policy_version 1201952 (0.0010) [2023-12-28 03:52:28,690][106226] Updated weights for policy 0, policy_version 1198969 (0.0007) [2023-12-28 03:52:28,750][106226] Updated weights for policy 0, policy_version 1198979 (0.0009) [2023-12-28 03:52:28,811][106226] Updated weights for policy 0, policy_version 1198989 (0.0010) [2023-12-28 03:52:28,864][106226] Updated weights for policy 0, policy_version 1198999 (0.0011) [2023-12-28 03:52:29,354][106225] Updated weights for policy 1, policy_version 1201962 (0.0009) [2023-12-28 03:52:29,406][106225] Updated weights for policy 1, policy_version 1201972 (0.0009) [2023-12-28 03:52:29,462][106225] Updated weights for policy 1, policy_version 1201982 (0.0009) [2023-12-28 03:52:29,518][106225] Updated weights for policy 1, policy_version 1201992 (0.0010) [2023-12-28 03:52:29,584][106226] Updated weights for policy 0, policy_version 1199009 (0.0006) [2023-12-28 03:52:29,642][106226] Updated weights for policy 0, policy_version 1199019 (0.0008) [2023-12-28 03:52:29,687][106226] Updated weights for policy 0, policy_version 1199029 (0.0008) [2023-12-28 03:52:30,316][106225] Updated weights for policy 1, policy_version 1202002 (0.0007) [2023-12-28 03:52:30,370][106225] Updated weights for policy 1, policy_version 1202012 (0.0008) [2023-12-28 03:52:30,407][106226] Updated weights for policy 0, policy_version 1199039 (0.0008) [2023-12-28 03:52:30,428][106225] Updated weights for policy 1, policy_version 1202022 (0.0007) [2023-12-28 03:52:30,463][106226] Updated weights for policy 0, policy_version 1199049 (0.0008) [2023-12-28 03:52:30,512][106226] Updated weights for policy 0, policy_version 1199059 (0.0008) [2023-12-28 03:52:31,171][106225] Updated weights for policy 1, policy_version 1202032 (0.0008) [2023-12-28 03:52:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 614785024. Throughput: 0: 10109.6, 1: 10056.0. Samples: 614781120. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:31,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.937')] [2023-12-28 03:52:31,221][106226] Updated weights for policy 0, policy_version 1199069 (0.0008) [2023-12-28 03:52:31,233][106225] Updated weights for policy 1, policy_version 1202042 (0.0007) [2023-12-28 03:52:31,286][106226] Updated weights for policy 0, policy_version 1199079 (0.0007) [2023-12-28 03:52:31,296][106225] Updated weights for policy 1, policy_version 1202052 (0.0008) [2023-12-28 03:52:31,357][106226] Updated weights for policy 0, policy_version 1199089 (0.0007) [2023-12-28 03:52:32,044][106225] Updated weights for policy 1, policy_version 1202062 (0.0006) [2023-12-28 03:52:32,087][106226] Updated weights for policy 0, policy_version 1199099 (0.0008) [2023-12-28 03:52:32,107][106225] Updated weights for policy 1, policy_version 1202072 (0.0006) [2023-12-28 03:52:32,140][106226] Updated weights for policy 0, policy_version 1199109 (0.0010) [2023-12-28 03:52:32,166][106225] Updated weights for policy 1, policy_version 1202082 (0.0006) [2023-12-28 03:52:32,192][106226] Updated weights for policy 0, policy_version 1199119 (0.0010) [2023-12-28 03:52:32,788][106225] Updated weights for policy 1, policy_version 1202092 (0.0007) [2023-12-28 03:52:32,845][106225] Updated weights for policy 1, policy_version 1202102 (0.0008) [2023-12-28 03:52:32,912][106225] Updated weights for policy 1, policy_version 1202112 (0.0008) [2023-12-28 03:52:32,918][106226] Updated weights for policy 0, policy_version 1199129 (0.0011) [2023-12-28 03:52:32,980][106226] Updated weights for policy 0, policy_version 1199139 (0.0010) [2023-12-28 03:52:33,040][106226] Updated weights for policy 0, policy_version 1199149 (0.0010) [2023-12-28 03:52:33,104][106226] Updated weights for policy 0, policy_version 1199159 (0.0010) [2023-12-28 03:52:33,576][106225] Updated weights for policy 1, policy_version 1202122 (0.0005) [2023-12-28 03:52:33,624][106225] Updated weights for policy 1, policy_version 1202132 (0.0005) [2023-12-28 03:52:33,675][106225] Updated weights for policy 1, policy_version 1202142 (0.0006) [2023-12-28 03:52:33,727][106225] Updated weights for policy 1, policy_version 1202152 (0.0008) [2023-12-28 03:52:33,798][106226] Updated weights for policy 0, policy_version 1199169 (0.0010) [2023-12-28 03:52:33,847][106226] Updated weights for policy 0, policy_version 1199179 (0.0010) [2023-12-28 03:52:33,893][106226] Updated weights for policy 0, policy_version 1199189 (0.0010) [2023-12-28 03:52:34,409][106225] Updated weights for policy 1, policy_version 1202162 (0.0008) [2023-12-28 03:52:34,474][106225] Updated weights for policy 1, policy_version 1202172 (0.0008) [2023-12-28 03:52:34,530][106225] Updated weights for policy 1, policy_version 1202182 (0.0008) [2023-12-28 03:52:34,631][106226] Updated weights for policy 0, policy_version 1199199 (0.0010) [2023-12-28 03:52:34,716][106226] Updated weights for policy 0, policy_version 1199209 (0.0006) [2023-12-28 03:52:34,769][106226] Updated weights for policy 0, policy_version 1199219 (0.0008) [2023-12-28 03:52:35,291][106225] Updated weights for policy 1, policy_version 1202192 (0.0009) [2023-12-28 03:52:35,344][106225] Updated weights for policy 1, policy_version 1202202 (0.0007) [2023-12-28 03:52:35,351][106226] Updated weights for policy 0, policy_version 1199229 (0.0006) [2023-12-28 03:52:35,392][106225] Updated weights for policy 1, policy_version 1202212 (0.0008) [2023-12-28 03:52:35,397][106226] Updated weights for policy 0, policy_version 1199239 (0.0005) [2023-12-28 03:52:35,451][106226] Updated weights for policy 0, policy_version 1199249 (0.0005) [2023-12-28 03:52:36,019][106226] Updated weights for policy 0, policy_version 1199259 (0.0006) [2023-12-28 03:52:36,069][106226] Updated weights for policy 0, policy_version 1199269 (0.0008) [2023-12-28 03:52:36,131][106226] Updated weights for policy 0, policy_version 1199279 (0.0009) [2023-12-28 03:52:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 614883328. Throughput: 0: 10154.3, 1: 9973.9. Samples: 614900320. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:36,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-4.958')] [2023-12-28 03:52:36,212][106225] Updated weights for policy 1, policy_version 1202222 (0.0008) [2023-12-28 03:52:36,266][106225] Updated weights for policy 1, policy_version 1202232 (0.0008) [2023-12-28 03:52:36,322][106225] Updated weights for policy 1, policy_version 1202242 (0.0008) [2023-12-28 03:52:36,786][106226] Updated weights for policy 0, policy_version 1199289 (0.0006) [2023-12-28 03:52:36,839][106226] Updated weights for policy 0, policy_version 1199299 (0.0008) [2023-12-28 03:52:36,910][106226] Updated weights for policy 0, policy_version 1199309 (0.0008) [2023-12-28 03:52:36,964][106226] Updated weights for policy 0, policy_version 1199319 (0.0005) [2023-12-28 03:52:37,110][106225] Updated weights for policy 1, policy_version 1202252 (0.0008) [2023-12-28 03:52:37,177][106225] Updated weights for policy 1, policy_version 1202262 (0.0008) [2023-12-28 03:52:37,242][106225] Updated weights for policy 1, policy_version 1202272 (0.0008) [2023-12-28 03:52:37,640][106226] Updated weights for policy 0, policy_version 1199329 (0.0008) [2023-12-28 03:52:37,687][106226] Updated weights for policy 0, policy_version 1199339 (0.0009) [2023-12-28 03:52:37,749][106226] Updated weights for policy 0, policy_version 1199349 (0.0010) [2023-12-28 03:52:37,874][106225] Updated weights for policy 1, policy_version 1202282 (0.0008) [2023-12-28 03:52:37,943][106225] Updated weights for policy 1, policy_version 1202292 (0.0008) [2023-12-28 03:52:37,998][106225] Updated weights for policy 1, policy_version 1202302 (0.0009) [2023-12-28 03:52:38,053][106225] Updated weights for policy 1, policy_version 1202312 (0.0009) [2023-12-28 03:52:38,370][106226] Updated weights for policy 0, policy_version 1199359 (0.0007) [2023-12-28 03:52:38,437][106226] Updated weights for policy 0, policy_version 1199369 (0.0007) [2023-12-28 03:52:38,493][106226] Updated weights for policy 0, policy_version 1199379 (0.0008) [2023-12-28 03:52:38,818][106225] Updated weights for policy 1, policy_version 1202322 (0.0009) [2023-12-28 03:52:38,866][106225] Updated weights for policy 1, policy_version 1202332 (0.0009) [2023-12-28 03:52:38,917][106225] Updated weights for policy 1, policy_version 1202342 (0.0011) [2023-12-28 03:52:39,159][106226] Updated weights for policy 0, policy_version 1199389 (0.0008) [2023-12-28 03:52:39,207][106226] Updated weights for policy 0, policy_version 1199399 (0.0009) [2023-12-28 03:52:39,266][106226] Updated weights for policy 0, policy_version 1199409 (0.0009) [2023-12-28 03:52:39,753][106225] Updated weights for policy 1, policy_version 1202352 (0.0008) [2023-12-28 03:52:39,807][106225] Updated weights for policy 1, policy_version 1202362 (0.0008) [2023-12-28 03:52:39,870][106225] Updated weights for policy 1, policy_version 1202372 (0.0007) [2023-12-28 03:52:40,132][106226] Updated weights for policy 0, policy_version 1199419 (0.0010) [2023-12-28 03:52:40,200][106226] Updated weights for policy 0, policy_version 1199429 (0.0011) [2023-12-28 03:52:40,269][106226] Updated weights for policy 0, policy_version 1199439 (0.0011) [2023-12-28 03:52:40,626][106225] Updated weights for policy 1, policy_version 1202382 (0.0007) [2023-12-28 03:52:40,687][106225] Updated weights for policy 1, policy_version 1202392 (0.0008) [2023-12-28 03:52:40,742][106225] Updated weights for policy 1, policy_version 1202402 (0.0008) [2023-12-28 03:52:40,976][106226] Updated weights for policy 0, policy_version 1199449 (0.0011) [2023-12-28 03:52:41,032][106226] Updated weights for policy 0, policy_version 1199459 (0.0010) [2023-12-28 03:52:41,097][106226] Updated weights for policy 0, policy_version 1199469 (0.0010) [2023-12-28 03:52:41,162][106226] Updated weights for policy 0, policy_version 1199479 (0.0010) [2023-12-28 03:52:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 614989824. Throughput: 0: 10203.0, 1: 9981.9. Samples: 614959816. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:41,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.978')] [2023-12-28 03:52:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001202408_307863552.pth... [2023-12-28 03:52:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001199480_307126272.pth... [2023-12-28 03:52:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001201256_307568640.pth [2023-12-28 03:52:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001198264_306814976.pth [2023-12-28 03:52:41,544][106225] Updated weights for policy 1, policy_version 1202412 (0.0007) [2023-12-28 03:52:41,610][106225] Updated weights for policy 1, policy_version 1202422 (0.0007) [2023-12-28 03:52:41,678][106225] Updated weights for policy 1, policy_version 1202432 (0.0009) [2023-12-28 03:52:41,968][106226] Updated weights for policy 0, policy_version 1199489 (0.0007) [2023-12-28 03:52:42,034][106226] Updated weights for policy 0, policy_version 1199499 (0.0007) [2023-12-28 03:52:42,097][106226] Updated weights for policy 0, policy_version 1199509 (0.0007) [2023-12-28 03:52:42,422][106225] Updated weights for policy 1, policy_version 1202442 (0.0009) [2023-12-28 03:52:42,486][106225] Updated weights for policy 1, policy_version 1202452 (0.0008) [2023-12-28 03:52:42,537][106225] Updated weights for policy 1, policy_version 1202462 (0.0008) [2023-12-28 03:52:42,595][106225] Updated weights for policy 1, policy_version 1202472 (0.0008) [2023-12-28 03:52:42,804][106226] Updated weights for policy 0, policy_version 1199519 (0.0008) [2023-12-28 03:52:42,855][106226] Updated weights for policy 0, policy_version 1199529 (0.0008) [2023-12-28 03:52:42,912][106226] Updated weights for policy 0, policy_version 1199539 (0.0008) [2023-12-28 03:52:43,333][106225] Updated weights for policy 1, policy_version 1202482 (0.0010) [2023-12-28 03:52:43,381][106225] Updated weights for policy 1, policy_version 1202492 (0.0010) [2023-12-28 03:52:43,427][106225] Updated weights for policy 1, policy_version 1202502 (0.0010) [2023-12-28 03:52:43,602][106226] Updated weights for policy 0, policy_version 1199549 (0.0007) [2023-12-28 03:52:43,665][106226] Updated weights for policy 0, policy_version 1199559 (0.0005) [2023-12-28 03:52:43,727][106226] Updated weights for policy 0, policy_version 1199569 (0.0005) [2023-12-28 03:52:44,115][106225] Updated weights for policy 1, policy_version 1202512 (0.0007) [2023-12-28 03:52:44,169][106225] Updated weights for policy 1, policy_version 1202522 (0.0005) [2023-12-28 03:52:44,227][106225] Updated weights for policy 1, policy_version 1202532 (0.0008) [2023-12-28 03:52:44,350][106226] Updated weights for policy 0, policy_version 1199579 (0.0008) [2023-12-28 03:52:44,414][106226] Updated weights for policy 0, policy_version 1199589 (0.0011) [2023-12-28 03:52:44,472][106226] Updated weights for policy 0, policy_version 1199599 (0.0010) [2023-12-28 03:52:44,899][106225] Updated weights for policy 1, policy_version 1202542 (0.0011) [2023-12-28 03:52:44,957][106225] Updated weights for policy 1, policy_version 1202552 (0.0006) [2023-12-28 03:52:45,018][106225] Updated weights for policy 1, policy_version 1202562 (0.0007) [2023-12-28 03:52:45,125][106226] Updated weights for policy 0, policy_version 1199609 (0.0009) [2023-12-28 03:52:45,189][106226] Updated weights for policy 0, policy_version 1199619 (0.0006) [2023-12-28 03:52:45,253][106226] Updated weights for policy 0, policy_version 1199629 (0.0006) [2023-12-28 03:52:45,311][106226] Updated weights for policy 0, policy_version 1199639 (0.0011) [2023-12-28 03:52:45,649][106225] Updated weights for policy 1, policy_version 1202572 (0.0009) [2023-12-28 03:52:45,706][106225] Updated weights for policy 1, policy_version 1202582 (0.0006) [2023-12-28 03:52:45,765][106225] Updated weights for policy 1, policy_version 1202592 (0.0009) [2023-12-28 03:52:45,857][106226] Updated weights for policy 0, policy_version 1199649 (0.0005) [2023-12-28 03:52:45,910][106226] Updated weights for policy 0, policy_version 1199659 (0.0005) [2023-12-28 03:52:45,982][106226] Updated weights for policy 0, policy_version 1199669 (0.0007) [2023-12-28 03:52:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 615088128. Throughput: 0: 10157.2, 1: 9908.2. Samples: 615073744. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:46,175][105115] Avg episode reward: [(0, '-4.123'), (1, '-4.864')] [2023-12-28 03:52:46,497][106225] Updated weights for policy 1, policy_version 1202602 (0.0008) [2023-12-28 03:52:46,502][106226] Updated weights for policy 0, policy_version 1199679 (0.0011) [2023-12-28 03:52:46,563][106226] Updated weights for policy 0, policy_version 1199689 (0.0011) [2023-12-28 03:52:46,565][106225] Updated weights for policy 1, policy_version 1202612 (0.0005) [2023-12-28 03:52:46,612][106226] Updated weights for policy 0, policy_version 1199699 (0.0010) [2023-12-28 03:52:46,621][106225] Updated weights for policy 1, policy_version 1202622 (0.0005) [2023-12-28 03:52:46,673][106225] Updated weights for policy 1, policy_version 1202632 (0.0005) [2023-12-28 03:52:47,173][106225] Updated weights for policy 1, policy_version 1202642 (0.0006) [2023-12-28 03:52:47,216][106225] Updated weights for policy 1, policy_version 1202652 (0.0005) [2023-12-28 03:52:47,264][106225] Updated weights for policy 1, policy_version 1202662 (0.0005) [2023-12-28 03:52:47,325][106226] Updated weights for policy 0, policy_version 1199709 (0.0008) [2023-12-28 03:52:47,378][106226] Updated weights for policy 0, policy_version 1199719 (0.0006) [2023-12-28 03:52:47,434][106226] Updated weights for policy 0, policy_version 1199729 (0.0011) [2023-12-28 03:52:47,898][106225] Updated weights for policy 1, policy_version 1202672 (0.0008) [2023-12-28 03:52:47,958][106225] Updated weights for policy 1, policy_version 1202682 (0.0010) [2023-12-28 03:52:48,013][106225] Updated weights for policy 1, policy_version 1202692 (0.0008) [2023-12-28 03:52:48,050][106226] Updated weights for policy 0, policy_version 1199739 (0.0008) [2023-12-28 03:52:48,100][106226] Updated weights for policy 0, policy_version 1199749 (0.0010) [2023-12-28 03:52:48,157][106226] Updated weights for policy 0, policy_version 1199759 (0.0010) [2023-12-28 03:52:48,704][106225] Updated weights for policy 1, policy_version 1202702 (0.0006) [2023-12-28 03:52:48,761][106225] Updated weights for policy 1, policy_version 1202712 (0.0006) [2023-12-28 03:52:48,814][106225] Updated weights for policy 1, policy_version 1202722 (0.0007) [2023-12-28 03:52:48,869][106226] Updated weights for policy 0, policy_version 1199769 (0.0007) [2023-12-28 03:52:48,928][106226] Updated weights for policy 0, policy_version 1199779 (0.0008) [2023-12-28 03:52:48,991][106226] Updated weights for policy 0, policy_version 1199789 (0.0008) [2023-12-28 03:52:49,051][106226] Updated weights for policy 0, policy_version 1199799 (0.0008) [2023-12-28 03:52:49,525][106225] Updated weights for policy 1, policy_version 1202732 (0.0009) [2023-12-28 03:52:49,598][106225] Updated weights for policy 1, policy_version 1202742 (0.0005) [2023-12-28 03:52:49,669][106225] Updated weights for policy 1, policy_version 1202752 (0.0006) [2023-12-28 03:52:49,835][106226] Updated weights for policy 0, policy_version 1199809 (0.0008) [2023-12-28 03:52:49,899][106226] Updated weights for policy 0, policy_version 1199819 (0.0008) [2023-12-28 03:52:49,971][106226] Updated weights for policy 0, policy_version 1199829 (0.0008) [2023-12-28 03:52:50,355][106225] Updated weights for policy 1, policy_version 1202762 (0.0008) [2023-12-28 03:52:50,409][106225] Updated weights for policy 1, policy_version 1202772 (0.0008) [2023-12-28 03:52:50,469][106225] Updated weights for policy 1, policy_version 1202782 (0.0009) [2023-12-28 03:52:50,521][106225] Updated weights for policy 1, policy_version 1202792 (0.0008) [2023-12-28 03:52:50,712][106226] Updated weights for policy 0, policy_version 1199839 (0.0008) [2023-12-28 03:52:50,777][106226] Updated weights for policy 0, policy_version 1199849 (0.0009) [2023-12-28 03:52:50,839][106226] Updated weights for policy 0, policy_version 1199859 (0.0009) [2023-12-28 03:52:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 615186432. Throughput: 0: 10175.2, 1: 9952.2. Samples: 615197468. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:51,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.996')] [2023-12-28 03:52:51,236][106225] Updated weights for policy 1, policy_version 1202802 (0.0009) [2023-12-28 03:52:51,305][106225] Updated weights for policy 1, policy_version 1202812 (0.0009) [2023-12-28 03:52:51,371][106225] Updated weights for policy 1, policy_version 1202822 (0.0007) [2023-12-28 03:52:51,632][106226] Updated weights for policy 0, policy_version 1199869 (0.0011) [2023-12-28 03:52:51,697][106226] Updated weights for policy 0, policy_version 1199879 (0.0011) [2023-12-28 03:52:51,768][106226] Updated weights for policy 0, policy_version 1199889 (0.0009) [2023-12-28 03:52:52,079][106225] Updated weights for policy 1, policy_version 1202832 (0.0007) [2023-12-28 03:52:52,144][106225] Updated weights for policy 1, policy_version 1202842 (0.0007) [2023-12-28 03:52:52,205][106225] Updated weights for policy 1, policy_version 1202852 (0.0008) [2023-12-28 03:52:52,442][106226] Updated weights for policy 0, policy_version 1199899 (0.0009) [2023-12-28 03:52:52,505][106226] Updated weights for policy 0, policy_version 1199909 (0.0008) [2023-12-28 03:52:52,563][106226] Updated weights for policy 0, policy_version 1199919 (0.0008) [2023-12-28 03:52:52,938][106225] Updated weights for policy 1, policy_version 1202862 (0.0008) [2023-12-28 03:52:52,996][106225] Updated weights for policy 1, policy_version 1202872 (0.0008) [2023-12-28 03:52:53,044][106225] Updated weights for policy 1, policy_version 1202882 (0.0008) [2023-12-28 03:52:53,252][106226] Updated weights for policy 0, policy_version 1199929 (0.0008) [2023-12-28 03:52:53,298][106226] Updated weights for policy 0, policy_version 1199939 (0.0010) [2023-12-28 03:52:53,344][106226] Updated weights for policy 0, policy_version 1199949 (0.0010) [2023-12-28 03:52:53,397][106226] Updated weights for policy 0, policy_version 1199959 (0.0010) [2023-12-28 03:52:53,720][106225] Updated weights for policy 1, policy_version 1202892 (0.0007) [2023-12-28 03:52:53,769][106225] Updated weights for policy 1, policy_version 1202902 (0.0007) [2023-12-28 03:52:53,818][106225] Updated weights for policy 1, policy_version 1202912 (0.0010) [2023-12-28 03:52:54,048][106226] Updated weights for policy 0, policy_version 1199969 (0.0010) [2023-12-28 03:52:54,112][106226] Updated weights for policy 0, policy_version 1199979 (0.0010) [2023-12-28 03:52:54,181][106226] Updated weights for policy 0, policy_version 1199989 (0.0011) [2023-12-28 03:52:54,505][106225] Updated weights for policy 1, policy_version 1202922 (0.0007) [2023-12-28 03:52:54,568][106225] Updated weights for policy 1, policy_version 1202932 (0.0008) [2023-12-28 03:52:54,624][106225] Updated weights for policy 1, policy_version 1202942 (0.0008) [2023-12-28 03:52:54,671][106225] Updated weights for policy 1, policy_version 1202952 (0.0007) [2023-12-28 03:52:54,814][106226] Updated weights for policy 0, policy_version 1199999 (0.0011) [2023-12-28 03:52:54,871][106226] Updated weights for policy 0, policy_version 1200009 (0.0010) [2023-12-28 03:52:54,928][106226] Updated weights for policy 0, policy_version 1200019 (0.0011) [2023-12-28 03:52:55,334][106225] Updated weights for policy 1, policy_version 1202962 (0.0006) [2023-12-28 03:52:55,397][106225] Updated weights for policy 1, policy_version 1202972 (0.0006) [2023-12-28 03:52:55,453][106225] Updated weights for policy 1, policy_version 1202982 (0.0009) [2023-12-28 03:52:55,627][106226] Updated weights for policy 0, policy_version 1200029 (0.0011) [2023-12-28 03:52:55,677][106226] Updated weights for policy 0, policy_version 1200039 (0.0010) [2023-12-28 03:52:55,724][106226] Updated weights for policy 0, policy_version 1200049 (0.0010) [2023-12-28 03:52:56,026][106225] Updated weights for policy 1, policy_version 1202992 (0.0007) [2023-12-28 03:52:56,081][106225] Updated weights for policy 1, policy_version 1203002 (0.0006) [2023-12-28 03:52:56,143][106225] Updated weights for policy 1, policy_version 1203012 (0.0009) [2023-12-28 03:52:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 615292928. Throughput: 0: 10146.0, 1: 9926.8. Samples: 615257288. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:52:56,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-4.966')] [2023-12-28 03:52:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001203016_308019200.pth... [2023-12-28 03:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001200056_307273728.pth... [2023-12-28 03:52:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001201832_307716096.pth [2023-12-28 03:52:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001198872_306970624.pth [2023-12-28 03:52:56,515][106226] Updated weights for policy 0, policy_version 1200059 (0.0010) [2023-12-28 03:52:56,574][106226] Updated weights for policy 0, policy_version 1200069 (0.0008) [2023-12-28 03:52:56,633][106226] Updated weights for policy 0, policy_version 1200079 (0.0008) [2023-12-28 03:52:56,704][106225] Updated weights for policy 1, policy_version 1203022 (0.0006) [2023-12-28 03:52:56,767][106225] Updated weights for policy 1, policy_version 1203032 (0.0010) [2023-12-28 03:52:56,826][106225] Updated weights for policy 1, policy_version 1203042 (0.0009) [2023-12-28 03:52:57,391][106226] Updated weights for policy 0, policy_version 1200089 (0.0010) [2023-12-28 03:52:57,444][106226] Updated weights for policy 0, policy_version 1200099 (0.0009) [2023-12-28 03:52:57,473][106225] Updated weights for policy 1, policy_version 1203052 (0.0010) [2023-12-28 03:52:57,499][106226] Updated weights for policy 0, policy_version 1200109 (0.0010) [2023-12-28 03:52:57,536][106225] Updated weights for policy 1, policy_version 1203062 (0.0007) [2023-12-28 03:52:57,556][106226] Updated weights for policy 0, policy_version 1200119 (0.0007) [2023-12-28 03:52:57,591][106225] Updated weights for policy 1, policy_version 1203072 (0.0008) [2023-12-28 03:52:58,133][106225] Updated weights for policy 1, policy_version 1203082 (0.0007) [2023-12-28 03:52:58,142][106226] Updated weights for policy 0, policy_version 1200129 (0.0006) [2023-12-28 03:52:58,183][106225] Updated weights for policy 1, policy_version 1203092 (0.0007) [2023-12-28 03:52:58,202][106226] Updated weights for policy 0, policy_version 1200139 (0.0008) [2023-12-28 03:52:58,253][106225] Updated weights for policy 1, policy_version 1203102 (0.0008) [2023-12-28 03:52:58,272][106226] Updated weights for policy 0, policy_version 1200149 (0.0010) [2023-12-28 03:52:58,312][106225] Updated weights for policy 1, policy_version 1203112 (0.0009) [2023-12-28 03:52:59,090][106226] Updated weights for policy 0, policy_version 1200159 (0.0009) [2023-12-28 03:52:59,121][106225] Updated weights for policy 1, policy_version 1203122 (0.0008) [2023-12-28 03:52:59,152][106226] Updated weights for policy 0, policy_version 1200169 (0.0008) [2023-12-28 03:52:59,180][106225] Updated weights for policy 1, policy_version 1203132 (0.0008) [2023-12-28 03:52:59,221][106226] Updated weights for policy 0, policy_version 1200179 (0.0011) [2023-12-28 03:52:59,257][106225] Updated weights for policy 1, policy_version 1203142 (0.0009) [2023-12-28 03:52:59,945][106226] Updated weights for policy 0, policy_version 1200189 (0.0008) [2023-12-28 03:52:59,996][106225] Updated weights for policy 1, policy_version 1203152 (0.0007) [2023-12-28 03:53:00,006][106226] Updated weights for policy 0, policy_version 1200199 (0.0008) [2023-12-28 03:53:00,052][106225] Updated weights for policy 1, policy_version 1203162 (0.0007) [2023-12-28 03:53:00,073][106226] Updated weights for policy 0, policy_version 1200209 (0.0005) [2023-12-28 03:53:00,109][106225] Updated weights for policy 1, policy_version 1203172 (0.0005) [2023-12-28 03:53:00,760][106225] Updated weights for policy 1, policy_version 1203182 (0.0007) [2023-12-28 03:53:00,780][106226] Updated weights for policy 0, policy_version 1200219 (0.0007) [2023-12-28 03:53:00,810][106225] Updated weights for policy 1, policy_version 1203192 (0.0005) [2023-12-28 03:53:00,829][106226] Updated weights for policy 0, policy_version 1200229 (0.0007) [2023-12-28 03:53:00,855][106225] Updated weights for policy 1, policy_version 1203202 (0.0005) [2023-12-28 03:53:00,888][106226] Updated weights for policy 0, policy_version 1200239 (0.0008) [2023-12-28 03:53:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 615391232. Throughput: 0: 10112.3, 1: 10035.3. Samples: 615377924. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:53:01,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.196')] [2023-12-28 03:53:01,525][106225] Updated weights for policy 1, policy_version 1203212 (0.0006) [2023-12-28 03:53:01,584][106225] Updated weights for policy 1, policy_version 1203222 (0.0008) [2023-12-28 03:53:01,634][106226] Updated weights for policy 0, policy_version 1200249 (0.0009) [2023-12-28 03:53:01,650][106225] Updated weights for policy 1, policy_version 1203232 (0.0008) [2023-12-28 03:53:01,706][106226] Updated weights for policy 0, policy_version 1200259 (0.0008) [2023-12-28 03:53:01,782][106226] Updated weights for policy 0, policy_version 1200269 (0.0009) [2023-12-28 03:53:01,846][106226] Updated weights for policy 0, policy_version 1200279 (0.0008) [2023-12-28 03:53:02,332][106225] Updated weights for policy 1, policy_version 1203242 (0.0008) [2023-12-28 03:53:02,404][106225] Updated weights for policy 1, policy_version 1203252 (0.0008) [2023-12-28 03:53:02,460][106225] Updated weights for policy 1, policy_version 1203262 (0.0007) [2023-12-28 03:53:02,519][106225] Updated weights for policy 1, policy_version 1203272 (0.0007) [2023-12-28 03:53:02,566][106226] Updated weights for policy 0, policy_version 1200289 (0.0010) [2023-12-28 03:53:02,627][106226] Updated weights for policy 0, policy_version 1200299 (0.0011) [2023-12-28 03:53:02,690][106226] Updated weights for policy 0, policy_version 1200309 (0.0011) [2023-12-28 03:53:03,256][106225] Updated weights for policy 1, policy_version 1203282 (0.0005) [2023-12-28 03:53:03,323][106225] Updated weights for policy 1, policy_version 1203292 (0.0010) [2023-12-28 03:53:03,372][106226] Updated weights for policy 0, policy_version 1200319 (0.0010) [2023-12-28 03:53:03,382][106225] Updated weights for policy 1, policy_version 1203302 (0.0010) [2023-12-28 03:53:03,422][106226] Updated weights for policy 0, policy_version 1200329 (0.0010) [2023-12-28 03:53:03,479][106226] Updated weights for policy 0, policy_version 1200339 (0.0010) [2023-12-28 03:53:03,947][106225] Updated weights for policy 1, policy_version 1203312 (0.0007) [2023-12-28 03:53:04,006][106225] Updated weights for policy 1, policy_version 1203322 (0.0006) [2023-12-28 03:53:04,061][106225] Updated weights for policy 1, policy_version 1203332 (0.0005) [2023-12-28 03:53:04,194][106226] Updated weights for policy 0, policy_version 1200349 (0.0010) [2023-12-28 03:53:04,258][106226] Updated weights for policy 0, policy_version 1200359 (0.0008) [2023-12-28 03:53:04,317][106226] Updated weights for policy 0, policy_version 1200369 (0.0008) [2023-12-28 03:53:04,731][106225] Updated weights for policy 1, policy_version 1203342 (0.0010) [2023-12-28 03:53:04,782][106225] Updated weights for policy 1, policy_version 1203352 (0.0008) [2023-12-28 03:53:04,836][106225] Updated weights for policy 1, policy_version 1203362 (0.0008) [2023-12-28 03:53:05,021][106226] Updated weights for policy 0, policy_version 1200379 (0.0007) [2023-12-28 03:53:05,069][106226] Updated weights for policy 0, policy_version 1200389 (0.0008) [2023-12-28 03:53:05,112][106226] Updated weights for policy 0, policy_version 1200399 (0.0007) [2023-12-28 03:53:05,489][106225] Updated weights for policy 1, policy_version 1203372 (0.0008) [2023-12-28 03:53:05,538][106225] Updated weights for policy 1, policy_version 1203382 (0.0010) [2023-12-28 03:53:05,585][106225] Updated weights for policy 1, policy_version 1203392 (0.0010) [2023-12-28 03:53:05,848][106226] Updated weights for policy 0, policy_version 1200409 (0.0007) [2023-12-28 03:53:05,904][106226] Updated weights for policy 0, policy_version 1200419 (0.0010) [2023-12-28 03:53:05,964][106226] Updated weights for policy 0, policy_version 1200429 (0.0011) [2023-12-28 03:53:06,023][106226] Updated weights for policy 0, policy_version 1200439 (0.0011) [2023-12-28 03:53:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 615489536. Throughput: 0: 10006.0, 1: 10058.7. Samples: 615497440. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:53:06,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-4.888')] [2023-12-28 03:53:06,288][106225] Updated weights for policy 1, policy_version 1203402 (0.0010) [2023-12-28 03:53:06,350][106225] Updated weights for policy 1, policy_version 1203412 (0.0010) [2023-12-28 03:53:06,415][106225] Updated weights for policy 1, policy_version 1203422 (0.0011) [2023-12-28 03:53:06,478][106225] Updated weights for policy 1, policy_version 1203432 (0.0010) [2023-12-28 03:53:06,742][106226] Updated weights for policy 0, policy_version 1200449 (0.0010) [2023-12-28 03:53:06,792][106226] Updated weights for policy 0, policy_version 1200459 (0.0010) [2023-12-28 03:53:06,849][106226] Updated weights for policy 0, policy_version 1200469 (0.0009) [2023-12-28 03:53:07,191][106225] Updated weights for policy 1, policy_version 1203442 (0.0008) [2023-12-28 03:53:07,255][106225] Updated weights for policy 1, policy_version 1203452 (0.0006) [2023-12-28 03:53:07,304][106225] Updated weights for policy 1, policy_version 1203462 (0.0005) [2023-12-28 03:53:07,445][106226] Updated weights for policy 0, policy_version 1200479 (0.0005) [2023-12-28 03:53:07,498][106226] Updated weights for policy 0, policy_version 1200489 (0.0005) [2023-12-28 03:53:07,549][106226] Updated weights for policy 0, policy_version 1200499 (0.0005) [2023-12-28 03:53:07,926][106225] Updated weights for policy 1, policy_version 1203472 (0.0005) [2023-12-28 03:53:07,987][106225] Updated weights for policy 1, policy_version 1203482 (0.0006) [2023-12-28 03:53:08,047][106225] Updated weights for policy 1, policy_version 1203492 (0.0008) [2023-12-28 03:53:08,077][106226] Updated weights for policy 0, policy_version 1200509 (0.0006) [2023-12-28 03:53:08,127][106226] Updated weights for policy 0, policy_version 1200519 (0.0006) [2023-12-28 03:53:08,175][106226] Updated weights for policy 0, policy_version 1200529 (0.0006) [2023-12-28 03:53:08,699][106225] Updated weights for policy 1, policy_version 1203502 (0.0009) [2023-12-28 03:53:08,749][106225] Updated weights for policy 1, policy_version 1203512 (0.0007) [2023-12-28 03:53:08,813][106225] Updated weights for policy 1, policy_version 1203522 (0.0007) [2023-12-28 03:53:08,921][106226] Updated weights for policy 0, policy_version 1200539 (0.0008) [2023-12-28 03:53:08,984][106226] Updated weights for policy 0, policy_version 1200549 (0.0008) [2023-12-28 03:53:09,049][106226] Updated weights for policy 0, policy_version 1200559 (0.0008) [2023-12-28 03:53:09,517][106225] Updated weights for policy 1, policy_version 1203532 (0.0010) [2023-12-28 03:53:09,568][106225] Updated weights for policy 1, policy_version 1203542 (0.0008) [2023-12-28 03:53:09,623][106225] Updated weights for policy 1, policy_version 1203552 (0.0008) [2023-12-28 03:53:09,751][106226] Updated weights for policy 0, policy_version 1200569 (0.0009) [2023-12-28 03:53:09,817][106226] Updated weights for policy 0, policy_version 1200579 (0.0010) [2023-12-28 03:53:09,887][106226] Updated weights for policy 0, policy_version 1200589 (0.0008) [2023-12-28 03:53:09,952][106226] Updated weights for policy 0, policy_version 1200599 (0.0007) [2023-12-28 03:53:10,366][106225] Updated weights for policy 1, policy_version 1203562 (0.0009) [2023-12-28 03:53:10,429][106225] Updated weights for policy 1, policy_version 1203572 (0.0010) [2023-12-28 03:53:10,494][106225] Updated weights for policy 1, policy_version 1203582 (0.0010) [2023-12-28 03:53:10,556][106225] Updated weights for policy 1, policy_version 1203592 (0.0008) [2023-12-28 03:53:10,616][106226] Updated weights for policy 0, policy_version 1200609 (0.0010) [2023-12-28 03:53:10,674][106226] Updated weights for policy 0, policy_version 1200619 (0.0008) [2023-12-28 03:53:10,744][106226] Updated weights for policy 0, policy_version 1200629 (0.0009) [2023-12-28 03:53:11,144][106225] Updated weights for policy 1, policy_version 1203602 (0.0009) [2023-12-28 03:53:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 615587840. Throughput: 0: 10094.4, 1: 10100.2. Samples: 615560312. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:53:11,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.943')] [2023-12-28 03:53:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001200632_307421184.pth... [2023-12-28 03:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001199480_307126272.pth [2023-12-28 03:53:11,202][106225] Updated weights for policy 1, policy_version 1203612 (0.0008) [2023-12-28 03:53:11,271][106225] Updated weights for policy 1, policy_version 1203622 (0.0008) [2023-12-28 03:53:11,282][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001203624_308174848.pth... [2023-12-28 03:53:11,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001202408_307863552.pth [2023-12-28 03:53:11,565][106226] Updated weights for policy 0, policy_version 1200639 (0.0009) [2023-12-28 03:53:11,635][106226] Updated weights for policy 0, policy_version 1200649 (0.0009) [2023-12-28 03:53:11,698][106226] Updated weights for policy 0, policy_version 1200659 (0.0009) [2023-12-28 03:53:11,995][106225] Updated weights for policy 1, policy_version 1203632 (0.0008) [2023-12-28 03:53:12,052][106225] Updated weights for policy 1, policy_version 1203642 (0.0008) [2023-12-28 03:53:12,113][106225] Updated weights for policy 1, policy_version 1203652 (0.0009) [2023-12-28 03:53:12,489][106226] Updated weights for policy 0, policy_version 1200669 (0.0008) [2023-12-28 03:53:12,548][106226] Updated weights for policy 0, policy_version 1200679 (0.0008) [2023-12-28 03:53:12,612][106226] Updated weights for policy 0, policy_version 1200689 (0.0008) [2023-12-28 03:53:12,884][106225] Updated weights for policy 1, policy_version 1203662 (0.0008) [2023-12-28 03:53:12,931][106225] Updated weights for policy 1, policy_version 1203672 (0.0007) [2023-12-28 03:53:12,995][106225] Updated weights for policy 1, policy_version 1203682 (0.0008) [2023-12-28 03:53:13,353][106226] Updated weights for policy 0, policy_version 1200699 (0.0007) [2023-12-28 03:53:13,413][106226] Updated weights for policy 0, policy_version 1200709 (0.0005) [2023-12-28 03:53:13,466][106226] Updated weights for policy 0, policy_version 1200719 (0.0005) [2023-12-28 03:53:13,774][106225] Updated weights for policy 1, policy_version 1203692 (0.0008) [2023-12-28 03:53:13,831][106225] Updated weights for policy 1, policy_version 1203702 (0.0008) [2023-12-28 03:53:13,900][106225] Updated weights for policy 1, policy_version 1203712 (0.0010) [2023-12-28 03:53:14,011][106226] Updated weights for policy 0, policy_version 1200729 (0.0005) [2023-12-28 03:53:14,074][106226] Updated weights for policy 0, policy_version 1200739 (0.0005) [2023-12-28 03:53:14,141][106226] Updated weights for policy 0, policy_version 1200749 (0.0005) [2023-12-28 03:53:14,209][106226] Updated weights for policy 0, policy_version 1200759 (0.0006) [2023-12-28 03:53:14,593][106225] Updated weights for policy 1, policy_version 1203722 (0.0009) [2023-12-28 03:53:14,648][106225] Updated weights for policy 1, policy_version 1203732 (0.0005) [2023-12-28 03:53:14,712][106225] Updated weights for policy 1, policy_version 1203742 (0.0007) [2023-12-28 03:53:14,773][106225] Updated weights for policy 1, policy_version 1203752 (0.0007) [2023-12-28 03:53:14,862][106226] Updated weights for policy 0, policy_version 1200769 (0.0005) [2023-12-28 03:53:14,934][106226] Updated weights for policy 0, policy_version 1200779 (0.0006) [2023-12-28 03:53:15,010][106226] Updated weights for policy 0, policy_version 1200789 (0.0006) [2023-12-28 03:53:15,467][106225] Updated weights for policy 1, policy_version 1203762 (0.0008) [2023-12-28 03:53:15,519][106225] Updated weights for policy 1, policy_version 1203772 (0.0008) [2023-12-28 03:53:15,565][106225] Updated weights for policy 1, policy_version 1203782 (0.0009) [2023-12-28 03:53:15,685][106226] Updated weights for policy 0, policy_version 1200799 (0.0009) [2023-12-28 03:53:15,739][106226] Updated weights for policy 0, policy_version 1200809 (0.0008) [2023-12-28 03:53:15,797][106226] Updated weights for policy 0, policy_version 1200819 (0.0009) [2023-12-28 03:53:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 615686144. Throughput: 0: 9947.4, 1: 9973.4. Samples: 615677560. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-28 03:53:16,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.136')] [2023-12-28 03:53:16,192][106225] Updated weights for policy 1, policy_version 1203792 (0.0008) [2023-12-28 03:53:16,243][106225] Updated weights for policy 1, policy_version 1203802 (0.0008) [2023-12-28 03:53:16,287][106225] Updated weights for policy 1, policy_version 1203812 (0.0008) [2023-12-28 03:53:16,566][106226] Updated weights for policy 0, policy_version 1200829 (0.0009) [2023-12-28 03:53:16,616][106226] Updated weights for policy 0, policy_version 1200839 (0.0008) [2023-12-28 03:53:16,664][106226] Updated weights for policy 0, policy_version 1200849 (0.0008) [2023-12-28 03:53:17,011][106225] Updated weights for policy 1, policy_version 1203822 (0.0008) [2023-12-28 03:53:17,058][106225] Updated weights for policy 1, policy_version 1203832 (0.0008) [2023-12-28 03:53:17,113][106225] Updated weights for policy 1, policy_version 1203842 (0.0008) [2023-12-28 03:53:17,379][106226] Updated weights for policy 0, policy_version 1200859 (0.0008) [2023-12-28 03:53:17,432][106226] Updated weights for policy 0, policy_version 1200869 (0.0008) [2023-12-28 03:53:17,490][106226] Updated weights for policy 0, policy_version 1200879 (0.0009) [2023-12-28 03:53:17,779][106225] Updated weights for policy 1, policy_version 1203852 (0.0007) [2023-12-28 03:53:17,828][106225] Updated weights for policy 1, policy_version 1203862 (0.0005) [2023-12-28 03:53:17,877][106225] Updated weights for policy 1, policy_version 1203872 (0.0005) [2023-12-28 03:53:18,290][106226] Updated weights for policy 0, policy_version 1200889 (0.0009) [2023-12-28 03:53:18,352][106226] Updated weights for policy 0, policy_version 1200899 (0.0007) [2023-12-28 03:53:18,409][106226] Updated weights for policy 0, policy_version 1200909 (0.0010) [2023-12-28 03:53:18,471][106226] Updated weights for policy 0, policy_version 1200919 (0.0009) [2023-12-28 03:53:18,522][106225] Updated weights for policy 1, policy_version 1203882 (0.0006) [2023-12-28 03:53:18,590][106225] Updated weights for policy 1, policy_version 1203892 (0.0010) [2023-12-28 03:53:18,650][106225] Updated weights for policy 1, policy_version 1203902 (0.0011) [2023-12-28 03:53:18,714][106225] Updated weights for policy 1, policy_version 1203912 (0.0010) [2023-12-28 03:53:19,243][106226] Updated weights for policy 0, policy_version 1200929 (0.0008) [2023-12-28 03:53:19,311][106226] Updated weights for policy 0, policy_version 1200939 (0.0008) [2023-12-28 03:53:19,379][106226] Updated weights for policy 0, policy_version 1200949 (0.0009) [2023-12-28 03:53:19,484][106225] Updated weights for policy 1, policy_version 1203922 (0.0011) [2023-12-28 03:53:19,544][106225] Updated weights for policy 1, policy_version 1203932 (0.0010) [2023-12-28 03:53:19,602][106225] Updated weights for policy 1, policy_version 1203942 (0.0010) [2023-12-28 03:53:20,141][106226] Updated weights for policy 0, policy_version 1200959 (0.0008) [2023-12-28 03:53:20,197][106226] Updated weights for policy 0, policy_version 1200969 (0.0009) [2023-12-28 03:53:20,255][106226] Updated weights for policy 0, policy_version 1200979 (0.0008) [2023-12-28 03:53:20,316][106225] Updated weights for policy 1, policy_version 1203952 (0.0010) [2023-12-28 03:53:20,376][106225] Updated weights for policy 1, policy_version 1203962 (0.0011) [2023-12-28 03:53:20,427][106225] Updated weights for policy 1, policy_version 1203972 (0.0010) [2023-12-28 03:53:21,047][106226] Updated weights for policy 0, policy_version 1200989 (0.0008) [2023-12-28 03:53:21,106][106226] Updated weights for policy 0, policy_version 1200999 (0.0008) [2023-12-28 03:53:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 615776256. Throughput: 0: 9819.2, 1: 10011.4. Samples: 615792696. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:21,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-5.122')] [2023-12-28 03:53:21,181][106226] Updated weights for policy 0, policy_version 1201009 (0.0008) [2023-12-28 03:53:21,197][106225] Updated weights for policy 1, policy_version 1203982 (0.0010) [2023-12-28 03:53:21,261][106225] Updated weights for policy 1, policy_version 1203992 (0.0008) [2023-12-28 03:53:21,330][106225] Updated weights for policy 1, policy_version 1204002 (0.0008) [2023-12-28 03:53:21,937][106226] Updated weights for policy 0, policy_version 1201019 (0.0007) [2023-12-28 03:53:21,999][106226] Updated weights for policy 0, policy_version 1201029 (0.0007) [2023-12-28 03:53:22,067][106226] Updated weights for policy 0, policy_version 1201039 (0.0007) [2023-12-28 03:53:22,085][106225] Updated weights for policy 1, policy_version 1204012 (0.0009) [2023-12-28 03:53:22,151][106225] Updated weights for policy 1, policy_version 1204022 (0.0006) [2023-12-28 03:53:22,210][106225] Updated weights for policy 1, policy_version 1204032 (0.0008) [2023-12-28 03:53:22,747][106226] Updated weights for policy 0, policy_version 1201049 (0.0009) [2023-12-28 03:53:22,818][106226] Updated weights for policy 0, policy_version 1201059 (0.0009) [2023-12-28 03:53:22,881][106226] Updated weights for policy 0, policy_version 1201069 (0.0010) [2023-12-28 03:53:22,946][106226] Updated weights for policy 0, policy_version 1201079 (0.0009) [2023-12-28 03:53:22,962][106225] Updated weights for policy 1, policy_version 1204042 (0.0008) [2023-12-28 03:53:23,020][106225] Updated weights for policy 1, policy_version 1204052 (0.0010) [2023-12-28 03:53:23,071][106225] Updated weights for policy 1, policy_version 1204062 (0.0010) [2023-12-28 03:53:23,130][106225] Updated weights for policy 1, policy_version 1204072 (0.0009) [2023-12-28 03:53:23,549][106226] Updated weights for policy 0, policy_version 1201089 (0.0011) [2023-12-28 03:53:23,603][106226] Updated weights for policy 0, policy_version 1201099 (0.0010) [2023-12-28 03:53:23,650][106226] Updated weights for policy 0, policy_version 1201109 (0.0010) [2023-12-28 03:53:23,899][106225] Updated weights for policy 1, policy_version 1204082 (0.0010) [2023-12-28 03:53:23,959][106225] Updated weights for policy 1, policy_version 1204092 (0.0010) [2023-12-28 03:53:24,016][106225] Updated weights for policy 1, policy_version 1204102 (0.0008) [2023-12-28 03:53:24,382][106226] Updated weights for policy 0, policy_version 1201119 (0.0011) [2023-12-28 03:53:24,442][106226] Updated weights for policy 0, policy_version 1201129 (0.0011) [2023-12-28 03:53:24,503][106226] Updated weights for policy 0, policy_version 1201139 (0.0011) [2023-12-28 03:53:24,634][106225] Updated weights for policy 1, policy_version 1204112 (0.0009) [2023-12-28 03:53:24,699][106225] Updated weights for policy 1, policy_version 1204122 (0.0010) [2023-12-28 03:53:24,751][106225] Updated weights for policy 1, policy_version 1204132 (0.0010) [2023-12-28 03:53:25,165][106226] Updated weights for policy 0, policy_version 1201149 (0.0009) [2023-12-28 03:53:25,213][106226] Updated weights for policy 0, policy_version 1201159 (0.0005) [2023-12-28 03:53:25,260][106226] Updated weights for policy 0, policy_version 1201169 (0.0006) [2023-12-28 03:53:25,506][106225] Updated weights for policy 1, policy_version 1204142 (0.0009) [2023-12-28 03:53:25,570][106225] Updated weights for policy 1, policy_version 1204152 (0.0008) [2023-12-28 03:53:25,634][106225] Updated weights for policy 1, policy_version 1204162 (0.0009) [2023-12-28 03:53:25,887][106226] Updated weights for policy 0, policy_version 1201179 (0.0007) [2023-12-28 03:53:25,944][106226] Updated weights for policy 0, policy_version 1201189 (0.0010) [2023-12-28 03:53:26,000][106226] Updated weights for policy 0, policy_version 1201199 (0.0010) [2023-12-28 03:53:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 615882752. Throughput: 0: 9783.3, 1: 9992.4. Samples: 615849720. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:26,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-5.097')] [2023-12-28 03:53:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001204168_308314112.pth... [2023-12-28 03:53:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001201208_307568640.pth... [2023-12-28 03:53:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001203016_308019200.pth [2023-12-28 03:53:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001200056_307273728.pth [2023-12-28 03:53:26,343][106225] Updated weights for policy 1, policy_version 1204172 (0.0010) [2023-12-28 03:53:26,403][106225] Updated weights for policy 1, policy_version 1204182 (0.0010) [2023-12-28 03:53:26,462][106225] Updated weights for policy 1, policy_version 1204192 (0.0008) [2023-12-28 03:53:26,712][106226] Updated weights for policy 0, policy_version 1201209 (0.0011) [2023-12-28 03:53:26,765][106226] Updated weights for policy 0, policy_version 1201219 (0.0010) [2023-12-28 03:53:26,822][106226] Updated weights for policy 0, policy_version 1201229 (0.0010) [2023-12-28 03:53:26,873][106226] Updated weights for policy 0, policy_version 1201239 (0.0010) [2023-12-28 03:53:27,145][106225] Updated weights for policy 1, policy_version 1204202 (0.0010) [2023-12-28 03:53:27,212][106225] Updated weights for policy 1, policy_version 1204212 (0.0010) [2023-12-28 03:53:27,278][106225] Updated weights for policy 1, policy_version 1204222 (0.0010) [2023-12-28 03:53:27,344][106225] Updated weights for policy 1, policy_version 1204232 (0.0010) [2023-12-28 03:53:27,616][106226] Updated weights for policy 0, policy_version 1201249 (0.0010) [2023-12-28 03:53:27,666][106226] Updated weights for policy 0, policy_version 1201259 (0.0010) [2023-12-28 03:53:27,719][106226] Updated weights for policy 0, policy_version 1201269 (0.0010) [2023-12-28 03:53:28,021][106225] Updated weights for policy 1, policy_version 1204242 (0.0010) [2023-12-28 03:53:28,073][106225] Updated weights for policy 1, policy_version 1204252 (0.0010) [2023-12-28 03:53:28,128][106225] Updated weights for policy 1, policy_version 1204262 (0.0010) [2023-12-28 03:53:28,407][106226] Updated weights for policy 0, policy_version 1201279 (0.0008) [2023-12-28 03:53:28,455][106226] Updated weights for policy 0, policy_version 1201289 (0.0010) [2023-12-28 03:53:28,523][106226] Updated weights for policy 0, policy_version 1201299 (0.0009) [2023-12-28 03:53:28,847][106225] Updated weights for policy 1, policy_version 1204272 (0.0010) [2023-12-28 03:53:28,898][106225] Updated weights for policy 1, policy_version 1204282 (0.0007) [2023-12-28 03:53:28,957][106225] Updated weights for policy 1, policy_version 1204292 (0.0010) [2023-12-28 03:53:29,220][106226] Updated weights for policy 0, policy_version 1201309 (0.0008) [2023-12-28 03:53:29,284][106226] Updated weights for policy 0, policy_version 1201319 (0.0008) [2023-12-28 03:53:29,347][106226] Updated weights for policy 0, policy_version 1201329 (0.0008) [2023-12-28 03:53:29,690][106225] Updated weights for policy 1, policy_version 1204302 (0.0010) [2023-12-28 03:53:29,746][106225] Updated weights for policy 1, policy_version 1204312 (0.0009) [2023-12-28 03:53:29,803][106225] Updated weights for policy 1, policy_version 1204322 (0.0008) [2023-12-28 03:53:29,980][106226] Updated weights for policy 0, policy_version 1201339 (0.0007) [2023-12-28 03:53:30,031][106226] Updated weights for policy 0, policy_version 1201349 (0.0005) [2023-12-28 03:53:30,078][106226] Updated weights for policy 0, policy_version 1201359 (0.0006) [2023-12-28 03:53:30,519][106225] Updated weights for policy 1, policy_version 1204332 (0.0006) [2023-12-28 03:53:30,585][106225] Updated weights for policy 1, policy_version 1204342 (0.0005) [2023-12-28 03:53:30,643][106225] Updated weights for policy 1, policy_version 1204352 (0.0005) [2023-12-28 03:53:30,762][106226] Updated weights for policy 0, policy_version 1201369 (0.0007) [2023-12-28 03:53:30,811][106226] Updated weights for policy 0, policy_version 1201379 (0.0008) [2023-12-28 03:53:30,866][106226] Updated weights for policy 0, policy_version 1201389 (0.0009) [2023-12-28 03:53:30,924][106226] Updated weights for policy 0, policy_version 1201399 (0.0009) [2023-12-28 03:53:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 615981056. Throughput: 0: 9876.0, 1: 10040.6. Samples: 615969992. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:31,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-5.074')] [2023-12-28 03:53:31,214][106225] Updated weights for policy 1, policy_version 1204362 (0.0006) [2023-12-28 03:53:31,277][106225] Updated weights for policy 1, policy_version 1204372 (0.0011) [2023-12-28 03:53:31,337][106225] Updated weights for policy 1, policy_version 1204382 (0.0009) [2023-12-28 03:53:31,396][106225] Updated weights for policy 1, policy_version 1204392 (0.0011) [2023-12-28 03:53:31,731][106226] Updated weights for policy 0, policy_version 1201409 (0.0008) [2023-12-28 03:53:31,796][106226] Updated weights for policy 0, policy_version 1201419 (0.0008) [2023-12-28 03:53:31,857][106226] Updated weights for policy 0, policy_version 1201429 (0.0008) [2023-12-28 03:53:32,111][106225] Updated weights for policy 1, policy_version 1204402 (0.0005) [2023-12-28 03:53:32,172][106225] Updated weights for policy 1, policy_version 1204412 (0.0005) [2023-12-28 03:53:32,237][106225] Updated weights for policy 1, policy_version 1204422 (0.0006) [2023-12-28 03:53:32,540][106226] Updated weights for policy 0, policy_version 1201439 (0.0007) [2023-12-28 03:53:32,598][106226] Updated weights for policy 0, policy_version 1201449 (0.0006) [2023-12-28 03:53:32,664][106226] Updated weights for policy 0, policy_version 1201459 (0.0005) [2023-12-28 03:53:32,858][106225] Updated weights for policy 1, policy_version 1204432 (0.0006) [2023-12-28 03:53:32,909][106225] Updated weights for policy 1, policy_version 1204442 (0.0009) [2023-12-28 03:53:32,959][106225] Updated weights for policy 1, policy_version 1204452 (0.0008) [2023-12-28 03:53:33,277][106226] Updated weights for policy 0, policy_version 1201469 (0.0006) [2023-12-28 03:53:33,337][106226] Updated weights for policy 0, policy_version 1201479 (0.0007) [2023-12-28 03:53:33,397][106226] Updated weights for policy 0, policy_version 1201489 (0.0008) [2023-12-28 03:53:33,579][106225] Updated weights for policy 1, policy_version 1204462 (0.0005) [2023-12-28 03:53:33,640][106225] Updated weights for policy 1, policy_version 1204472 (0.0006) [2023-12-28 03:53:33,697][106225] Updated weights for policy 1, policy_version 1204482 (0.0005) [2023-12-28 03:53:34,066][106226] Updated weights for policy 0, policy_version 1201499 (0.0007) [2023-12-28 03:53:34,120][106226] Updated weights for policy 0, policy_version 1201509 (0.0007) [2023-12-28 03:53:34,187][106226] Updated weights for policy 0, policy_version 1201519 (0.0008) [2023-12-28 03:53:34,252][106225] Updated weights for policy 1, policy_version 1204492 (0.0006) [2023-12-28 03:53:34,302][106225] Updated weights for policy 1, policy_version 1204502 (0.0007) [2023-12-28 03:53:34,355][106225] Updated weights for policy 1, policy_version 1204512 (0.0008) [2023-12-28 03:53:34,900][106226] Updated weights for policy 0, policy_version 1201529 (0.0008) [2023-12-28 03:53:34,951][106226] Updated weights for policy 0, policy_version 1201539 (0.0009) [2023-12-28 03:53:35,006][106226] Updated weights for policy 0, policy_version 1201549 (0.0008) [2023-12-28 03:53:35,058][106226] Updated weights for policy 0, policy_version 1201559 (0.0008) [2023-12-28 03:53:35,126][106225] Updated weights for policy 1, policy_version 1204522 (0.0008) [2023-12-28 03:53:35,179][106225] Updated weights for policy 1, policy_version 1204532 (0.0008) [2023-12-28 03:53:35,234][106225] Updated weights for policy 1, policy_version 1204542 (0.0008) [2023-12-28 03:53:35,289][106225] Updated weights for policy 1, policy_version 1204552 (0.0008) [2023-12-28 03:53:35,711][106226] Updated weights for policy 0, policy_version 1201569 (0.0009) [2023-12-28 03:53:35,756][106226] Updated weights for policy 0, policy_version 1201579 (0.0008) [2023-12-28 03:53:35,801][106226] Updated weights for policy 0, policy_version 1201589 (0.0007) [2023-12-28 03:53:36,063][106225] Updated weights for policy 1, policy_version 1204562 (0.0010) [2023-12-28 03:53:36,119][106225] Updated weights for policy 1, policy_version 1204572 (0.0009) [2023-12-28 03:53:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 616079360. Throughput: 0: 9841.1, 1: 10051.7. Samples: 616092640. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:36,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.932')] [2023-12-28 03:53:36,178][106225] Updated weights for policy 1, policy_version 1204582 (0.0009) [2023-12-28 03:53:36,526][106226] Updated weights for policy 0, policy_version 1201599 (0.0007) [2023-12-28 03:53:36,589][106226] Updated weights for policy 0, policy_version 1201609 (0.0005) [2023-12-28 03:53:36,650][106226] Updated weights for policy 0, policy_version 1201619 (0.0007) [2023-12-28 03:53:36,884][106225] Updated weights for policy 1, policy_version 1204592 (0.0009) [2023-12-28 03:53:36,938][106225] Updated weights for policy 1, policy_version 1204602 (0.0008) [2023-12-28 03:53:36,994][106225] Updated weights for policy 1, policy_version 1204612 (0.0008) [2023-12-28 03:53:37,420][106226] Updated weights for policy 0, policy_version 1201629 (0.0009) [2023-12-28 03:53:37,466][106226] Updated weights for policy 0, policy_version 1201639 (0.0008) [2023-12-28 03:53:37,515][106226] Updated weights for policy 0, policy_version 1201649 (0.0008) [2023-12-28 03:53:37,709][106225] Updated weights for policy 1, policy_version 1204622 (0.0009) [2023-12-28 03:53:37,775][106225] Updated weights for policy 1, policy_version 1204632 (0.0008) [2023-12-28 03:53:37,838][106225] Updated weights for policy 1, policy_version 1204642 (0.0009) [2023-12-28 03:53:38,186][106226] Updated weights for policy 0, policy_version 1201659 (0.0006) [2023-12-28 03:53:38,248][106226] Updated weights for policy 0, policy_version 1201669 (0.0009) [2023-12-28 03:53:38,301][106226] Updated weights for policy 0, policy_version 1201679 (0.0009) [2023-12-28 03:53:38,560][106225] Updated weights for policy 1, policy_version 1204652 (0.0008) [2023-12-28 03:53:38,606][106225] Updated weights for policy 1, policy_version 1204662 (0.0007) [2023-12-28 03:53:38,659][106225] Updated weights for policy 1, policy_version 1204672 (0.0006) [2023-12-28 03:53:39,009][106226] Updated weights for policy 0, policy_version 1201689 (0.0009) [2023-12-28 03:53:39,072][106226] Updated weights for policy 0, policy_version 1201699 (0.0006) [2023-12-28 03:53:39,138][106226] Updated weights for policy 0, policy_version 1201709 (0.0007) [2023-12-28 03:53:39,200][106226] Updated weights for policy 0, policy_version 1201719 (0.0010) [2023-12-28 03:53:39,393][106225] Updated weights for policy 1, policy_version 1204682 (0.0007) [2023-12-28 03:53:39,461][106225] Updated weights for policy 1, policy_version 1204692 (0.0008) [2023-12-28 03:53:39,528][106225] Updated weights for policy 1, policy_version 1204702 (0.0008) [2023-12-28 03:53:39,591][106225] Updated weights for policy 1, policy_version 1204712 (0.0008) [2023-12-28 03:53:39,818][106226] Updated weights for policy 0, policy_version 1201729 (0.0009) [2023-12-28 03:53:39,888][106226] Updated weights for policy 0, policy_version 1201739 (0.0008) [2023-12-28 03:53:39,953][106226] Updated weights for policy 0, policy_version 1201749 (0.0008) [2023-12-28 03:53:40,356][106225] Updated weights for policy 1, policy_version 1204722 (0.0009) [2023-12-28 03:53:40,407][106225] Updated weights for policy 1, policy_version 1204732 (0.0009) [2023-12-28 03:53:40,460][106225] Updated weights for policy 1, policy_version 1204742 (0.0008) [2023-12-28 03:53:40,650][106226] Updated weights for policy 0, policy_version 1201759 (0.0007) [2023-12-28 03:53:40,707][106226] Updated weights for policy 0, policy_version 1201769 (0.0005) [2023-12-28 03:53:40,767][106226] Updated weights for policy 0, policy_version 1201779 (0.0005) [2023-12-28 03:53:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 616177664. Throughput: 0: 9829.2, 1: 10038.8. Samples: 616151344. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:41,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.107')] [2023-12-28 03:53:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001201784_307716096.pth... [2023-12-28 03:53:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001200632_307421184.pth [2023-12-28 03:53:41,185][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001201784_307716096.pth [2023-12-28 03:53:41,193][106225] Updated weights for policy 1, policy_version 1204752 (0.0010) [2023-12-28 03:53:41,265][106225] Updated weights for policy 1, policy_version 1204762 (0.0009) [2023-12-28 03:53:41,337][106225] Updated weights for policy 1, policy_version 1204772 (0.0006) [2023-12-28 03:53:41,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001204776_308469760.pth... [2023-12-28 03:53:41,366][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001203624_308174848.pth [2023-12-28 03:53:41,366][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001204776_308469760.pth [2023-12-28 03:53:41,409][106226] Updated weights for policy 0, policy_version 1201789 (0.0007) [2023-12-28 03:53:41,472][106226] Updated weights for policy 0, policy_version 1201799 (0.0009) [2023-12-28 03:53:41,534][106226] Updated weights for policy 0, policy_version 1201809 (0.0011) [2023-12-28 03:53:41,981][106225] Updated weights for policy 1, policy_version 1204782 (0.0010) [2023-12-28 03:53:42,047][106225] Updated weights for policy 1, policy_version 1204792 (0.0011) [2023-12-28 03:53:42,105][106225] Updated weights for policy 1, policy_version 1204802 (0.0010) [2023-12-28 03:53:42,322][106226] Updated weights for policy 0, policy_version 1201819 (0.0009) [2023-12-28 03:53:42,390][106226] Updated weights for policy 0, policy_version 1201829 (0.0010) [2023-12-28 03:53:42,446][106226] Updated weights for policy 0, policy_version 1201839 (0.0008) [2023-12-28 03:53:42,848][106225] Updated weights for policy 1, policy_version 1204812 (0.0009) [2023-12-28 03:53:42,915][106225] Updated weights for policy 1, policy_version 1204822 (0.0006) [2023-12-28 03:53:42,983][106225] Updated weights for policy 1, policy_version 1204832 (0.0006) [2023-12-28 03:53:43,153][106226] Updated weights for policy 0, policy_version 1201849 (0.0008) [2023-12-28 03:53:43,204][106226] Updated weights for policy 0, policy_version 1201859 (0.0008) [2023-12-28 03:53:43,262][106226] Updated weights for policy 0, policy_version 1201869 (0.0007) [2023-12-28 03:53:43,315][106226] Updated weights for policy 0, policy_version 1201879 (0.0009) [2023-12-28 03:53:43,603][106225] Updated weights for policy 1, policy_version 1204842 (0.0006) [2023-12-28 03:53:43,665][106225] Updated weights for policy 1, policy_version 1204852 (0.0006) [2023-12-28 03:53:43,735][106225] Updated weights for policy 1, policy_version 1204862 (0.0006) [2023-12-28 03:53:43,788][106225] Updated weights for policy 1, policy_version 1204872 (0.0005) [2023-12-28 03:53:43,978][106226] Updated weights for policy 0, policy_version 1201889 (0.0006) [2023-12-28 03:53:44,033][106226] Updated weights for policy 0, policy_version 1201899 (0.0007) [2023-12-28 03:53:44,087][106226] Updated weights for policy 0, policy_version 1201909 (0.0008) [2023-12-28 03:53:44,437][106225] Updated weights for policy 1, policy_version 1204882 (0.0010) [2023-12-28 03:53:44,490][106225] Updated weights for policy 1, policy_version 1204892 (0.0010) [2023-12-28 03:53:44,550][106225] Updated weights for policy 1, policy_version 1204902 (0.0010) [2023-12-28 03:53:44,746][106226] Updated weights for policy 0, policy_version 1201919 (0.0006) [2023-12-28 03:53:44,808][106226] Updated weights for policy 0, policy_version 1201929 (0.0008) [2023-12-28 03:53:44,877][106226] Updated weights for policy 0, policy_version 1201939 (0.0011) [2023-12-28 03:53:45,214][106225] Updated weights for policy 1, policy_version 1204912 (0.0010) [2023-12-28 03:53:45,272][106225] Updated weights for policy 1, policy_version 1204922 (0.0010) [2023-12-28 03:53:45,337][106225] Updated weights for policy 1, policy_version 1204932 (0.0011) [2023-12-28 03:53:45,610][106226] Updated weights for policy 0, policy_version 1201949 (0.0010) [2023-12-28 03:53:45,679][106226] Updated weights for policy 0, policy_version 1201959 (0.0005) [2023-12-28 03:53:45,745][106226] Updated weights for policy 0, policy_version 1201969 (0.0007) [2023-12-28 03:53:46,034][106225] Updated weights for policy 1, policy_version 1204942 (0.0010) [2023-12-28 03:53:46,093][106225] Updated weights for policy 1, policy_version 1204952 (0.0010) [2023-12-28 03:53:46,135][106225] Updated weights for policy 1, policy_version 1204962 (0.0008) [2023-12-28 03:53:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 616284160. Throughput: 0: 9860.0, 1: 9957.8. Samples: 616269728. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:46,176][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.907')] [2023-12-28 03:53:46,409][106226] Updated weights for policy 0, policy_version 1201979 (0.0010) [2023-12-28 03:53:46,459][106226] Updated weights for policy 0, policy_version 1201989 (0.0010) [2023-12-28 03:53:46,512][106226] Updated weights for policy 0, policy_version 1201999 (0.0010) [2023-12-28 03:53:46,824][106225] Updated weights for policy 1, policy_version 1204972 (0.0006) [2023-12-28 03:53:46,876][106225] Updated weights for policy 1, policy_version 1204982 (0.0006) [2023-12-28 03:53:46,921][106225] Updated weights for policy 1, policy_version 1204992 (0.0005) [2023-12-28 03:53:47,218][106226] Updated weights for policy 0, policy_version 1202009 (0.0010) [2023-12-28 03:53:47,275][106226] Updated weights for policy 0, policy_version 1202019 (0.0010) [2023-12-28 03:53:47,336][106226] Updated weights for policy 0, policy_version 1202029 (0.0010) [2023-12-28 03:53:47,385][106226] Updated weights for policy 0, policy_version 1202039 (0.0010) [2023-12-28 03:53:47,567][106225] Updated weights for policy 1, policy_version 1205002 (0.0005) [2023-12-28 03:53:47,633][106225] Updated weights for policy 1, policy_version 1205012 (0.0007) [2023-12-28 03:53:47,689][106225] Updated weights for policy 1, policy_version 1205022 (0.0008) [2023-12-28 03:53:47,750][106225] Updated weights for policy 1, policy_version 1205032 (0.0008) [2023-12-28 03:53:48,107][106226] Updated weights for policy 0, policy_version 1202049 (0.0011) [2023-12-28 03:53:48,160][106226] Updated weights for policy 0, policy_version 1202059 (0.0010) [2023-12-28 03:53:48,209][106226] Updated weights for policy 0, policy_version 1202069 (0.0008) [2023-12-28 03:53:48,315][106225] Updated weights for policy 1, policy_version 1205042 (0.0006) [2023-12-28 03:53:48,376][106225] Updated weights for policy 1, policy_version 1205052 (0.0011) [2023-12-28 03:53:48,433][106225] Updated weights for policy 1, policy_version 1205062 (0.0010) [2023-12-28 03:53:48,904][106226] Updated weights for policy 0, policy_version 1202079 (0.0009) [2023-12-28 03:53:48,965][106226] Updated weights for policy 0, policy_version 1202089 (0.0010) [2023-12-28 03:53:49,024][106226] Updated weights for policy 0, policy_version 1202099 (0.0008) [2023-12-28 03:53:49,054][106225] Updated weights for policy 1, policy_version 1205072 (0.0010) [2023-12-28 03:53:49,109][106225] Updated weights for policy 1, policy_version 1205082 (0.0010) [2023-12-28 03:53:49,165][106225] Updated weights for policy 1, policy_version 1205092 (0.0010) [2023-12-28 03:53:49,792][106226] Updated weights for policy 0, policy_version 1202109 (0.0009) [2023-12-28 03:53:49,862][106226] Updated weights for policy 0, policy_version 1202119 (0.0008) [2023-12-28 03:53:49,920][106226] Updated weights for policy 0, policy_version 1202129 (0.0008) [2023-12-28 03:53:49,968][106225] Updated weights for policy 1, policy_version 1205102 (0.0009) [2023-12-28 03:53:50,037][106225] Updated weights for policy 1, policy_version 1205112 (0.0006) [2023-12-28 03:53:50,099][106225] Updated weights for policy 1, policy_version 1205122 (0.0008) [2023-12-28 03:53:50,674][106226] Updated weights for policy 0, policy_version 1202139 (0.0009) [2023-12-28 03:53:50,714][106225] Updated weights for policy 1, policy_version 1205132 (0.0005) [2023-12-28 03:53:50,742][106226] Updated weights for policy 0, policy_version 1202149 (0.0011) [2023-12-28 03:53:50,770][106225] Updated weights for policy 1, policy_version 1205142 (0.0009) [2023-12-28 03:53:50,796][106226] Updated weights for policy 0, policy_version 1202159 (0.0011) [2023-12-28 03:53:50,823][106225] Updated weights for policy 1, policy_version 1205152 (0.0009) [2023-12-28 03:53:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19910.8). Total num frames: 616382464. Throughput: 0: 9867.9, 1: 9981.3. Samples: 616390648. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:51,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.826')] [2023-12-28 03:53:51,489][106226] Updated weights for policy 0, policy_version 1202169 (0.0010) [2023-12-28 03:53:51,540][106225] Updated weights for policy 1, policy_version 1205162 (0.0010) [2023-12-28 03:53:51,553][106226] Updated weights for policy 0, policy_version 1202179 (0.0008) [2023-12-28 03:53:51,601][106225] Updated weights for policy 1, policy_version 1205172 (0.0010) [2023-12-28 03:53:51,613][106226] Updated weights for policy 0, policy_version 1202189 (0.0007) [2023-12-28 03:53:51,670][106225] Updated weights for policy 1, policy_version 1205182 (0.0010) [2023-12-28 03:53:51,679][106226] Updated weights for policy 0, policy_version 1202199 (0.0011) [2023-12-28 03:53:51,741][106225] Updated weights for policy 1, policy_version 1205192 (0.0010) [2023-12-28 03:53:52,411][106226] Updated weights for policy 0, policy_version 1202209 (0.0009) [2023-12-28 03:53:52,453][106225] Updated weights for policy 1, policy_version 1205202 (0.0008) [2023-12-28 03:53:52,472][106226] Updated weights for policy 0, policy_version 1202219 (0.0010) [2023-12-28 03:53:52,515][106225] Updated weights for policy 1, policy_version 1205212 (0.0008) [2023-12-28 03:53:52,534][106226] Updated weights for policy 0, policy_version 1202229 (0.0011) [2023-12-28 03:53:52,578][106225] Updated weights for policy 1, policy_version 1205222 (0.0008) [2023-12-28 03:53:53,241][106225] Updated weights for policy 1, policy_version 1205232 (0.0008) [2023-12-28 03:53:53,279][106226] Updated weights for policy 0, policy_version 1202239 (0.0007) [2023-12-28 03:53:53,305][106225] Updated weights for policy 1, policy_version 1205242 (0.0007) [2023-12-28 03:53:53,338][106226] Updated weights for policy 0, policy_version 1202249 (0.0006) [2023-12-28 03:53:53,366][106225] Updated weights for policy 1, policy_version 1205252 (0.0008) [2023-12-28 03:53:53,398][106226] Updated weights for policy 0, policy_version 1202259 (0.0008) [2023-12-28 03:53:54,021][106225] Updated weights for policy 1, policy_version 1205262 (0.0006) [2023-12-28 03:53:54,077][106225] Updated weights for policy 1, policy_version 1205272 (0.0006) [2023-12-28 03:53:54,084][106226] Updated weights for policy 0, policy_version 1202269 (0.0007) [2023-12-28 03:53:54,130][106225] Updated weights for policy 1, policy_version 1205282 (0.0005) [2023-12-28 03:53:54,139][106226] Updated weights for policy 0, policy_version 1202279 (0.0008) [2023-12-28 03:53:54,193][106226] Updated weights for policy 0, policy_version 1202289 (0.0009) [2023-12-28 03:53:54,765][106225] Updated weights for policy 1, policy_version 1205292 (0.0008) [2023-12-28 03:53:54,834][106225] Updated weights for policy 1, policy_version 1205302 (0.0008) [2023-12-28 03:53:54,881][106226] Updated weights for policy 0, policy_version 1202299 (0.0009) [2023-12-28 03:53:54,898][106225] Updated weights for policy 1, policy_version 1205312 (0.0008) [2023-12-28 03:53:54,935][106226] Updated weights for policy 0, policy_version 1202309 (0.0007) [2023-12-28 03:53:54,997][106226] Updated weights for policy 0, policy_version 1202319 (0.0006) [2023-12-28 03:53:55,616][106226] Updated weights for policy 0, policy_version 1202329 (0.0006) [2023-12-28 03:53:55,627][106225] Updated weights for policy 1, policy_version 1205322 (0.0007) [2023-12-28 03:53:55,672][106225] Updated weights for policy 1, policy_version 1205332 (0.0006) [2023-12-28 03:53:55,673][106226] Updated weights for policy 0, policy_version 1202339 (0.0008) [2023-12-28 03:53:55,720][106225] Updated weights for policy 1, policy_version 1205342 (0.0007) [2023-12-28 03:53:55,733][106226] Updated weights for policy 0, policy_version 1202349 (0.0007) [2023-12-28 03:53:55,763][106225] Updated weights for policy 1, policy_version 1205352 (0.0006) [2023-12-28 03:53:55,788][106226] Updated weights for policy 0, policy_version 1202359 (0.0009) [2023-12-28 03:53:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 616480768. Throughput: 0: 9796.8, 1: 9936.5. Samples: 616448312. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:53:56,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.241')] [2023-12-28 03:53:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001205352_308617216.pth... [2023-12-28 03:53:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001202360_307863552.pth... [2023-12-28 03:53:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001201208_307568640.pth [2023-12-28 03:53:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001204168_308314112.pth [2023-12-28 03:53:56,406][106226] Updated weights for policy 0, policy_version 1202369 (0.0006) [2023-12-28 03:53:56,464][106226] Updated weights for policy 0, policy_version 1202379 (0.0005) [2023-12-28 03:53:56,515][106226] Updated weights for policy 0, policy_version 1202389 (0.0005) [2023-12-28 03:53:56,541][106225] Updated weights for policy 1, policy_version 1205362 (0.0008) [2023-12-28 03:53:56,605][106225] Updated weights for policy 1, policy_version 1205372 (0.0010) [2023-12-28 03:53:56,663][106225] Updated weights for policy 1, policy_version 1205382 (0.0009) [2023-12-28 03:53:57,030][106226] Updated weights for policy 0, policy_version 1202399 (0.0007) [2023-12-28 03:53:57,082][106226] Updated weights for policy 0, policy_version 1202409 (0.0010) [2023-12-28 03:53:57,136][106226] Updated weights for policy 0, policy_version 1202419 (0.0009) [2023-12-28 03:53:57,473][106225] Updated weights for policy 1, policy_version 1205392 (0.0008) [2023-12-28 03:53:57,537][106225] Updated weights for policy 1, policy_version 1205402 (0.0008) [2023-12-28 03:53:57,587][106225] Updated weights for policy 1, policy_version 1205412 (0.0007) [2023-12-28 03:53:57,829][106226] Updated weights for policy 0, policy_version 1202429 (0.0007) [2023-12-28 03:53:57,883][106226] Updated weights for policy 0, policy_version 1202439 (0.0009) [2023-12-28 03:53:57,942][106226] Updated weights for policy 0, policy_version 1202449 (0.0009) [2023-12-28 03:53:58,321][106225] Updated weights for policy 1, policy_version 1205422 (0.0008) [2023-12-28 03:53:58,395][106225] Updated weights for policy 1, policy_version 1205432 (0.0011) [2023-12-28 03:53:58,470][106225] Updated weights for policy 1, policy_version 1205442 (0.0010) [2023-12-28 03:53:58,750][106226] Updated weights for policy 0, policy_version 1202459 (0.0009) [2023-12-28 03:53:58,821][106226] Updated weights for policy 0, policy_version 1202469 (0.0009) [2023-12-28 03:53:58,887][106226] Updated weights for policy 0, policy_version 1202479 (0.0008) [2023-12-28 03:53:59,254][106225] Updated weights for policy 1, policy_version 1205452 (0.0009) [2023-12-28 03:53:59,318][106225] Updated weights for policy 1, policy_version 1205462 (0.0008) [2023-12-28 03:53:59,390][106225] Updated weights for policy 1, policy_version 1205472 (0.0008) [2023-12-28 03:53:59,727][106226] Updated weights for policy 0, policy_version 1202489 (0.0009) [2023-12-28 03:53:59,782][106226] Updated weights for policy 0, policy_version 1202499 (0.0008) [2023-12-28 03:53:59,848][106226] Updated weights for policy 0, policy_version 1202509 (0.0008) [2023-12-28 03:53:59,903][106226] Updated weights for policy 0, policy_version 1202519 (0.0009) [2023-12-28 03:54:00,103][106225] Updated weights for policy 1, policy_version 1205482 (0.0008) [2023-12-28 03:54:00,154][106225] Updated weights for policy 1, policy_version 1205492 (0.0007) [2023-12-28 03:54:00,208][106225] Updated weights for policy 1, policy_version 1205502 (0.0005) [2023-12-28 03:54:00,263][106225] Updated weights for policy 1, policy_version 1205512 (0.0005) [2023-12-28 03:54:00,633][106226] Updated weights for policy 0, policy_version 1202529 (0.0009) [2023-12-28 03:54:00,688][106226] Updated weights for policy 0, policy_version 1202539 (0.0010) [2023-12-28 03:54:00,737][106226] Updated weights for policy 0, policy_version 1202549 (0.0010) [2023-12-28 03:54:00,899][106225] Updated weights for policy 1, policy_version 1205522 (0.0006) [2023-12-28 03:54:00,946][106225] Updated weights for policy 1, policy_version 1205532 (0.0005) [2023-12-28 03:54:00,999][106225] Updated weights for policy 1, policy_version 1205542 (0.0006) [2023-12-28 03:54:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 616579072. Throughput: 0: 9826.9, 1: 9898.6. Samples: 616565204. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:01,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-5.047')] [2023-12-28 03:54:01,404][106226] Updated weights for policy 0, policy_version 1202559 (0.0010) [2023-12-28 03:54:01,470][106226] Updated weights for policy 0, policy_version 1202569 (0.0009) [2023-12-28 03:54:01,530][106226] Updated weights for policy 0, policy_version 1202579 (0.0010) [2023-12-28 03:54:01,735][106225] Updated weights for policy 1, policy_version 1205552 (0.0009) [2023-12-28 03:54:01,804][106225] Updated weights for policy 1, policy_version 1205562 (0.0005) [2023-12-28 03:54:01,850][106225] Updated weights for policy 1, policy_version 1205572 (0.0006) [2023-12-28 03:54:02,184][106226] Updated weights for policy 0, policy_version 1202589 (0.0010) [2023-12-28 03:54:02,238][106226] Updated weights for policy 0, policy_version 1202599 (0.0011) [2023-12-28 03:54:02,304][106226] Updated weights for policy 0, policy_version 1202609 (0.0011) [2023-12-28 03:54:02,439][106225] Updated weights for policy 1, policy_version 1205582 (0.0007) [2023-12-28 03:54:02,498][106225] Updated weights for policy 1, policy_version 1205592 (0.0008) [2023-12-28 03:54:02,553][106225] Updated weights for policy 1, policy_version 1205602 (0.0007) [2023-12-28 03:54:02,947][106226] Updated weights for policy 0, policy_version 1202619 (0.0009) [2023-12-28 03:54:03,001][106226] Updated weights for policy 0, policy_version 1202629 (0.0007) [2023-12-28 03:54:03,058][106226] Updated weights for policy 0, policy_version 1202639 (0.0007) [2023-12-28 03:54:03,137][106225] Updated weights for policy 1, policy_version 1205612 (0.0006) [2023-12-28 03:54:03,198][106225] Updated weights for policy 1, policy_version 1205622 (0.0005) [2023-12-28 03:54:03,249][106225] Updated weights for policy 1, policy_version 1205632 (0.0007) [2023-12-28 03:54:03,747][106226] Updated weights for policy 0, policy_version 1202649 (0.0009) [2023-12-28 03:54:03,797][106226] Updated weights for policy 0, policy_version 1202659 (0.0007) [2023-12-28 03:54:03,851][106226] Updated weights for policy 0, policy_version 1202669 (0.0008) [2023-12-28 03:54:03,883][106225] Updated weights for policy 1, policy_version 1205642 (0.0009) [2023-12-28 03:54:03,916][106226] Updated weights for policy 0, policy_version 1202679 (0.0008) [2023-12-28 03:54:03,939][106225] Updated weights for policy 1, policy_version 1205652 (0.0009) [2023-12-28 03:54:03,995][106225] Updated weights for policy 1, policy_version 1205662 (0.0010) [2023-12-28 03:54:04,046][106225] Updated weights for policy 1, policy_version 1205672 (0.0010) [2023-12-28 03:54:04,660][106226] Updated weights for policy 0, policy_version 1202689 (0.0008) [2023-12-28 03:54:04,710][106226] Updated weights for policy 0, policy_version 1202699 (0.0008) [2023-12-28 03:54:04,764][106225] Updated weights for policy 1, policy_version 1205682 (0.0010) [2023-12-28 03:54:04,773][106226] Updated weights for policy 0, policy_version 1202709 (0.0005) [2023-12-28 03:54:04,821][106225] Updated weights for policy 1, policy_version 1205692 (0.0010) [2023-12-28 03:54:04,877][106225] Updated weights for policy 1, policy_version 1205702 (0.0010) [2023-12-28 03:54:05,438][106226] Updated weights for policy 0, policy_version 1202719 (0.0009) [2023-12-28 03:54:05,508][106226] Updated weights for policy 0, policy_version 1202729 (0.0011) [2023-12-28 03:54:05,535][106225] Updated weights for policy 1, policy_version 1205712 (0.0008) [2023-12-28 03:54:05,574][106226] Updated weights for policy 0, policy_version 1202739 (0.0007) [2023-12-28 03:54:05,592][106225] Updated weights for policy 1, policy_version 1205722 (0.0008) [2023-12-28 03:54:05,648][106225] Updated weights for policy 1, policy_version 1205732 (0.0009) [2023-12-28 03:54:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 616677376. Throughput: 0: 9972.5, 1: 9963.3. Samples: 616689804. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:06,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.902')] [2023-12-28 03:54:06,189][106226] Updated weights for policy 0, policy_version 1202749 (0.0008) [2023-12-28 03:54:06,247][106226] Updated weights for policy 0, policy_version 1202759 (0.0010) [2023-12-28 03:54:06,310][106226] Updated weights for policy 0, policy_version 1202769 (0.0009) [2023-12-28 03:54:06,367][106225] Updated weights for policy 1, policy_version 1205742 (0.0010) [2023-12-28 03:54:06,421][106225] Updated weights for policy 1, policy_version 1205752 (0.0010) [2023-12-28 03:54:06,475][106225] Updated weights for policy 1, policy_version 1205762 (0.0010) [2023-12-28 03:54:07,040][106226] Updated weights for policy 0, policy_version 1202779 (0.0011) [2023-12-28 03:54:07,100][106226] Updated weights for policy 0, policy_version 1202789 (0.0011) [2023-12-28 03:54:07,145][106225] Updated weights for policy 1, policy_version 1205772 (0.0011) [2023-12-28 03:54:07,157][106226] Updated weights for policy 0, policy_version 1202799 (0.0010) [2023-12-28 03:54:07,203][106225] Updated weights for policy 1, policy_version 1205782 (0.0007) [2023-12-28 03:54:07,265][106225] Updated weights for policy 1, policy_version 1205792 (0.0008) [2023-12-28 03:54:07,877][106226] Updated weights for policy 0, policy_version 1202809 (0.0011) [2023-12-28 03:54:07,937][106226] Updated weights for policy 0, policy_version 1202819 (0.0011) [2023-12-28 03:54:07,941][106225] Updated weights for policy 1, policy_version 1205802 (0.0009) [2023-12-28 03:54:07,988][106226] Updated weights for policy 0, policy_version 1202829 (0.0010) [2023-12-28 03:54:07,997][106225] Updated weights for policy 1, policy_version 1205812 (0.0006) [2023-12-28 03:54:08,039][106226] Updated weights for policy 0, policy_version 1202839 (0.0010) [2023-12-28 03:54:08,052][106225] Updated weights for policy 1, policy_version 1205822 (0.0005) [2023-12-28 03:54:08,112][106225] Updated weights for policy 1, policy_version 1205832 (0.0005) [2023-12-28 03:54:08,743][106226] Updated weights for policy 0, policy_version 1202849 (0.0008) [2023-12-28 03:54:08,759][106225] Updated weights for policy 1, policy_version 1205842 (0.0005) [2023-12-28 03:54:08,808][106225] Updated weights for policy 1, policy_version 1205852 (0.0005) [2023-12-28 03:54:08,809][106226] Updated weights for policy 0, policy_version 1202859 (0.0008) [2023-12-28 03:54:08,865][106225] Updated weights for policy 1, policy_version 1205862 (0.0005) [2023-12-28 03:54:08,875][106226] Updated weights for policy 0, policy_version 1202869 (0.0008) [2023-12-28 03:54:09,590][106225] Updated weights for policy 1, policy_version 1205872 (0.0008) [2023-12-28 03:54:09,617][106226] Updated weights for policy 0, policy_version 1202879 (0.0007) [2023-12-28 03:54:09,650][106225] Updated weights for policy 1, policy_version 1205882 (0.0008) [2023-12-28 03:54:09,675][106226] Updated weights for policy 0, policy_version 1202889 (0.0006) [2023-12-28 03:54:09,706][106225] Updated weights for policy 1, policy_version 1205892 (0.0006) [2023-12-28 03:54:09,735][106226] Updated weights for policy 0, policy_version 1202899 (0.0008) [2023-12-28 03:54:10,419][106225] Updated weights for policy 1, policy_version 1205902 (0.0008) [2023-12-28 03:54:10,481][106225] Updated weights for policy 1, policy_version 1205912 (0.0009) [2023-12-28 03:54:10,512][106226] Updated weights for policy 0, policy_version 1202909 (0.0008) [2023-12-28 03:54:10,542][106225] Updated weights for policy 1, policy_version 1205922 (0.0006) [2023-12-28 03:54:10,573][106226] Updated weights for policy 0, policy_version 1202919 (0.0009) [2023-12-28 03:54:10,632][106226] Updated weights for policy 0, policy_version 1202929 (0.0008) [2023-12-28 03:54:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 616775680. Throughput: 0: 9967.2, 1: 10043.5. Samples: 616750200. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:11,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.675')] [2023-12-28 03:54:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001205928_308764672.pth... [2023-12-28 03:54:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001202936_308011008.pth... [2023-12-28 03:54:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001204776_308469760.pth [2023-12-28 03:54:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001201784_307716096.pth [2023-12-28 03:54:11,288][106225] Updated weights for policy 1, policy_version 1205932 (0.0007) [2023-12-28 03:54:11,354][106225] Updated weights for policy 1, policy_version 1205942 (0.0008) [2023-12-28 03:54:11,423][106225] Updated weights for policy 1, policy_version 1205952 (0.0009) [2023-12-28 03:54:11,444][106226] Updated weights for policy 0, policy_version 1202939 (0.0008) [2023-12-28 03:54:11,506][106226] Updated weights for policy 0, policy_version 1202949 (0.0008) [2023-12-28 03:54:11,558][106226] Updated weights for policy 0, policy_version 1202959 (0.0008) [2023-12-28 03:54:12,164][106225] Updated weights for policy 1, policy_version 1205962 (0.0008) [2023-12-28 03:54:12,215][106225] Updated weights for policy 1, policy_version 1205972 (0.0009) [2023-12-28 03:54:12,284][106225] Updated weights for policy 1, policy_version 1205982 (0.0008) [2023-12-28 03:54:12,335][106226] Updated weights for policy 0, policy_version 1202969 (0.0008) [2023-12-28 03:54:12,351][106225] Updated weights for policy 1, policy_version 1205992 (0.0008) [2023-12-28 03:54:12,400][106226] Updated weights for policy 0, policy_version 1202979 (0.0008) [2023-12-28 03:54:12,472][106226] Updated weights for policy 0, policy_version 1202989 (0.0006) [2023-12-28 03:54:12,534][106226] Updated weights for policy 0, policy_version 1202999 (0.0008) [2023-12-28 03:54:13,085][106225] Updated weights for policy 1, policy_version 1206002 (0.0008) [2023-12-28 03:54:13,143][106225] Updated weights for policy 1, policy_version 1206012 (0.0009) [2023-12-28 03:54:13,197][106225] Updated weights for policy 1, policy_version 1206022 (0.0008) [2023-12-28 03:54:13,214][106226] Updated weights for policy 0, policy_version 1203009 (0.0006) [2023-12-28 03:54:13,258][106226] Updated weights for policy 0, policy_version 1203019 (0.0008) [2023-12-28 03:54:13,320][106226] Updated weights for policy 0, policy_version 1203029 (0.0009) [2023-12-28 03:54:13,880][106225] Updated weights for policy 1, policy_version 1206032 (0.0007) [2023-12-28 03:54:13,939][106225] Updated weights for policy 1, policy_version 1206042 (0.0009) [2023-12-28 03:54:13,996][106225] Updated weights for policy 1, policy_version 1206052 (0.0009) [2023-12-28 03:54:14,105][106226] Updated weights for policy 0, policy_version 1203039 (0.0009) [2023-12-28 03:54:14,155][106226] Updated weights for policy 0, policy_version 1203049 (0.0009) [2023-12-28 03:54:14,210][106226] Updated weights for policy 0, policy_version 1203059 (0.0008) [2023-12-28 03:54:14,694][106225] Updated weights for policy 1, policy_version 1206063 (0.0008) [2023-12-28 03:54:14,738][106225] Updated weights for policy 1, policy_version 1206073 (0.0005) [2023-12-28 03:54:14,799][106225] Updated weights for policy 1, policy_version 1206083 (0.0007) [2023-12-28 03:54:14,973][106226] Updated weights for policy 0, policy_version 1203069 (0.0008) [2023-12-28 03:54:15,035][106226] Updated weights for policy 0, policy_version 1203079 (0.0008) [2023-12-28 03:54:15,094][106226] Updated weights for policy 0, policy_version 1203089 (0.0009) [2023-12-28 03:54:15,474][106225] Updated weights for policy 1, policy_version 1206093 (0.0008) [2023-12-28 03:54:15,534][106225] Updated weights for policy 1, policy_version 1206103 (0.0008) [2023-12-28 03:54:15,591][106225] Updated weights for policy 1, policy_version 1206113 (0.0009) [2023-12-28 03:54:15,871][106226] Updated weights for policy 0, policy_version 1203099 (0.0008) [2023-12-28 03:54:15,931][106226] Updated weights for policy 0, policy_version 1203109 (0.0005) [2023-12-28 03:54:15,988][106226] Updated weights for policy 0, policy_version 1203119 (0.0005) [2023-12-28 03:54:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 616873984. Throughput: 0: 9821.1, 1: 10007.3. Samples: 616862268. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:16,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.786')] [2023-12-28 03:54:16,341][106225] Updated weights for policy 1, policy_version 1206123 (0.0009) [2023-12-28 03:54:16,393][106225] Updated weights for policy 1, policy_version 1206133 (0.0008) [2023-12-28 03:54:16,456][106225] Updated weights for policy 1, policy_version 1206143 (0.0008) [2023-12-28 03:54:16,590][106226] Updated weights for policy 0, policy_version 1203129 (0.0006) [2023-12-28 03:54:16,644][106226] Updated weights for policy 0, policy_version 1203139 (0.0007) [2023-12-28 03:54:16,699][106226] Updated weights for policy 0, policy_version 1203149 (0.0009) [2023-12-28 03:54:16,756][106226] Updated weights for policy 0, policy_version 1203159 (0.0008) [2023-12-28 03:54:17,120][106225] Updated weights for policy 1, policy_version 1206153 (0.0009) [2023-12-28 03:54:17,179][106225] Updated weights for policy 1, policy_version 1206163 (0.0009) [2023-12-28 03:54:17,231][106225] Updated weights for policy 1, policy_version 1206173 (0.0008) [2023-12-28 03:54:17,278][106225] Updated weights for policy 1, policy_version 1206183 (0.0008) [2023-12-28 03:54:17,518][106226] Updated weights for policy 0, policy_version 1203169 (0.0008) [2023-12-28 03:54:17,571][106226] Updated weights for policy 0, policy_version 1203179 (0.0008) [2023-12-28 03:54:17,619][106226] Updated weights for policy 0, policy_version 1203189 (0.0008) [2023-12-28 03:54:18,019][106225] Updated weights for policy 1, policy_version 1206193 (0.0009) [2023-12-28 03:54:18,074][106225] Updated weights for policy 1, policy_version 1206203 (0.0008) [2023-12-28 03:54:18,132][106225] Updated weights for policy 1, policy_version 1206213 (0.0008) [2023-12-28 03:54:18,360][106226] Updated weights for policy 0, policy_version 1203199 (0.0008) [2023-12-28 03:54:18,408][106226] Updated weights for policy 0, policy_version 1203209 (0.0007) [2023-12-28 03:54:18,468][106226] Updated weights for policy 0, policy_version 1203219 (0.0007) [2023-12-28 03:54:18,903][106225] Updated weights for policy 1, policy_version 1206223 (0.0008) [2023-12-28 03:54:18,955][106225] Updated weights for policy 1, policy_version 1206233 (0.0008) [2023-12-28 03:54:19,004][106225] Updated weights for policy 1, policy_version 1206243 (0.0008) [2023-12-28 03:54:19,200][106226] Updated weights for policy 0, policy_version 1203229 (0.0009) [2023-12-28 03:54:19,268][106226] Updated weights for policy 0, policy_version 1203239 (0.0011) [2023-12-28 03:54:19,325][106226] Updated weights for policy 0, policy_version 1203249 (0.0010) [2023-12-28 03:54:19,725][106225] Updated weights for policy 1, policy_version 1206253 (0.0008) [2023-12-28 03:54:19,779][106225] Updated weights for policy 1, policy_version 1206263 (0.0006) [2023-12-28 03:54:19,842][106225] Updated weights for policy 1, policy_version 1206273 (0.0007) [2023-12-28 03:54:20,114][106226] Updated weights for policy 0, policy_version 1203259 (0.0010) [2023-12-28 03:54:20,174][106226] Updated weights for policy 0, policy_version 1203269 (0.0010) [2023-12-28 03:54:20,237][106226] Updated weights for policy 0, policy_version 1203279 (0.0009) [2023-12-28 03:54:20,519][106225] Updated weights for policy 1, policy_version 1206283 (0.0009) [2023-12-28 03:54:20,578][106225] Updated weights for policy 1, policy_version 1206293 (0.0009) [2023-12-28 03:54:20,645][106225] Updated weights for policy 1, policy_version 1206303 (0.0008) [2023-12-28 03:54:20,994][106226] Updated weights for policy 0, policy_version 1203289 (0.0008) [2023-12-28 03:54:21,064][106226] Updated weights for policy 0, policy_version 1203299 (0.0008) [2023-12-28 03:54:21,132][106226] Updated weights for policy 0, policy_version 1203309 (0.0009) [2023-12-28 03:54:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 616964096. Throughput: 0: 9744.2, 1: 9918.8. Samples: 616977472. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:21,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-4.602')] [2023-12-28 03:54:21,198][106226] Updated weights for policy 0, policy_version 1203319 (0.0009) [2023-12-28 03:54:21,454][106225] Updated weights for policy 1, policy_version 1206313 (0.0008) [2023-12-28 03:54:21,518][106225] Updated weights for policy 1, policy_version 1206323 (0.0009) [2023-12-28 03:54:21,572][106225] Updated weights for policy 1, policy_version 1206333 (0.0008) [2023-12-28 03:54:21,639][106225] Updated weights for policy 1, policy_version 1206343 (0.0007) [2023-12-28 03:54:21,956][106226] Updated weights for policy 0, policy_version 1203329 (0.0009) [2023-12-28 03:54:22,014][106226] Updated weights for policy 0, policy_version 1203339 (0.0009) [2023-12-28 03:54:22,080][106226] Updated weights for policy 0, policy_version 1203349 (0.0008) [2023-12-28 03:54:22,322][106225] Updated weights for policy 1, policy_version 1206353 (0.0006) [2023-12-28 03:54:22,394][106225] Updated weights for policy 1, policy_version 1206363 (0.0008) [2023-12-28 03:54:22,459][106225] Updated weights for policy 1, policy_version 1206373 (0.0007) [2023-12-28 03:54:22,838][106226] Updated weights for policy 0, policy_version 1203359 (0.0009) [2023-12-28 03:54:22,908][106226] Updated weights for policy 0, policy_version 1203369 (0.0009) [2023-12-28 03:54:22,978][106226] Updated weights for policy 0, policy_version 1203379 (0.0008) [2023-12-28 03:54:23,139][106225] Updated weights for policy 1, policy_version 1206383 (0.0006) [2023-12-28 03:54:23,197][106225] Updated weights for policy 1, policy_version 1206393 (0.0006) [2023-12-28 03:54:23,254][106225] Updated weights for policy 1, policy_version 1206403 (0.0005) [2023-12-28 03:54:23,673][106226] Updated weights for policy 0, policy_version 1203389 (0.0008) [2023-12-28 03:54:23,738][106226] Updated weights for policy 0, policy_version 1203399 (0.0009) [2023-12-28 03:54:23,789][106226] Updated weights for policy 0, policy_version 1203409 (0.0009) [2023-12-28 03:54:23,913][106225] Updated weights for policy 1, policy_version 1206413 (0.0007) [2023-12-28 03:54:23,962][106225] Updated weights for policy 1, policy_version 1206423 (0.0009) [2023-12-28 03:54:24,013][106225] Updated weights for policy 1, policy_version 1206434 (0.0009) [2023-12-28 03:54:24,505][106226] Updated weights for policy 0, policy_version 1203419 (0.0006) [2023-12-28 03:54:24,565][106226] Updated weights for policy 0, policy_version 1203429 (0.0005) [2023-12-28 03:54:24,621][106226] Updated weights for policy 0, policy_version 1203439 (0.0006) [2023-12-28 03:54:24,714][106225] Updated weights for policy 1, policy_version 1206444 (0.0009) [2023-12-28 03:54:24,769][106225] Updated weights for policy 1, policy_version 1206454 (0.0008) [2023-12-28 03:54:24,828][106225] Updated weights for policy 1, policy_version 1206464 (0.0009) [2023-12-28 03:54:25,266][106226] Updated weights for policy 0, policy_version 1203449 (0.0005) [2023-12-28 03:54:25,324][106226] Updated weights for policy 0, policy_version 1203459 (0.0005) [2023-12-28 03:54:25,379][106226] Updated weights for policy 0, policy_version 1203469 (0.0005) [2023-12-28 03:54:25,432][106226] Updated weights for policy 0, policy_version 1203479 (0.0005) [2023-12-28 03:54:25,597][106225] Updated weights for policy 1, policy_version 1206474 (0.0009) [2023-12-28 03:54:25,660][106225] Updated weights for policy 1, policy_version 1206484 (0.0009) [2023-12-28 03:54:25,706][106225] Updated weights for policy 1, policy_version 1206494 (0.0008) [2023-12-28 03:54:25,763][106225] Updated weights for policy 1, policy_version 1206504 (0.0008) [2023-12-28 03:54:26,049][106226] Updated weights for policy 0, policy_version 1203489 (0.0005) [2023-12-28 03:54:26,098][106226] Updated weights for policy 0, policy_version 1203499 (0.0005) [2023-12-28 03:54:26,146][106226] Updated weights for policy 0, policy_version 1203509 (0.0005) [2023-12-28 03:54:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617070592. Throughput: 0: 9713.2, 1: 9922.4. Samples: 617034944. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:26,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.832')] [2023-12-28 03:54:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001206504_308912128.pth... [2023-12-28 03:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001203512_308158464.pth... [2023-12-28 03:54:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001205352_308617216.pth [2023-12-28 03:54:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001202360_307863552.pth [2023-12-28 03:54:26,598][106225] Updated weights for policy 1, policy_version 1206514 (0.0007) [2023-12-28 03:54:26,644][106225] Updated weights for policy 1, policy_version 1206524 (0.0007) [2023-12-28 03:54:26,693][106225] Updated weights for policy 1, policy_version 1206534 (0.0005) [2023-12-28 03:54:26,712][106226] Updated weights for policy 0, policy_version 1203519 (0.0005) [2023-12-28 03:54:26,765][106226] Updated weights for policy 0, policy_version 1203529 (0.0005) [2023-12-28 03:54:26,819][106226] Updated weights for policy 0, policy_version 1203539 (0.0005) [2023-12-28 03:54:27,317][106225] Updated weights for policy 1, policy_version 1206544 (0.0006) [2023-12-28 03:54:27,369][106225] Updated weights for policy 1, policy_version 1206554 (0.0005) [2023-12-28 03:54:27,424][106225] Updated weights for policy 1, policy_version 1206564 (0.0005) [2023-12-28 03:54:27,455][106226] Updated weights for policy 0, policy_version 1203549 (0.0008) [2023-12-28 03:54:27,519][106226] Updated weights for policy 0, policy_version 1203559 (0.0007) [2023-12-28 03:54:27,576][106226] Updated weights for policy 0, policy_version 1203569 (0.0009) [2023-12-28 03:54:28,090][106225] Updated weights for policy 1, policy_version 1206574 (0.0008) [2023-12-28 03:54:28,148][106225] Updated weights for policy 1, policy_version 1206584 (0.0010) [2023-12-28 03:54:28,205][106225] Updated weights for policy 1, policy_version 1206594 (0.0010) [2023-12-28 03:54:28,298][106226] Updated weights for policy 0, policy_version 1203579 (0.0007) [2023-12-28 03:54:28,369][106226] Updated weights for policy 0, policy_version 1203589 (0.0008) [2023-12-28 03:54:28,427][106226] Updated weights for policy 0, policy_version 1203599 (0.0008) [2023-12-28 03:54:28,917][106225] Updated weights for policy 1, policy_version 1206604 (0.0010) [2023-12-28 03:54:28,968][106225] Updated weights for policy 1, policy_version 1206614 (0.0010) [2023-12-28 03:54:29,022][106225] Updated weights for policy 1, policy_version 1206624 (0.0010) [2023-12-28 03:54:29,164][106226] Updated weights for policy 0, policy_version 1203609 (0.0008) [2023-12-28 03:54:29,222][106226] Updated weights for policy 0, policy_version 1203619 (0.0008) [2023-12-28 03:54:29,292][106226] Updated weights for policy 0, policy_version 1203629 (0.0008) [2023-12-28 03:54:29,361][106226] Updated weights for policy 0, policy_version 1203639 (0.0009) [2023-12-28 03:54:29,787][106225] Updated weights for policy 1, policy_version 1206634 (0.0010) [2023-12-28 03:54:29,859][106225] Updated weights for policy 1, policy_version 1206644 (0.0012) [2023-12-28 03:54:29,925][106225] Updated weights for policy 1, policy_version 1206654 (0.0011) [2023-12-28 03:54:29,983][106225] Updated weights for policy 1, policy_version 1206664 (0.0010) [2023-12-28 03:54:30,049][106226] Updated weights for policy 0, policy_version 1203649 (0.0008) [2023-12-28 03:54:30,113][106226] Updated weights for policy 0, policy_version 1203659 (0.0008) [2023-12-28 03:54:30,175][106226] Updated weights for policy 0, policy_version 1203669 (0.0008) [2023-12-28 03:54:30,670][106225] Updated weights for policy 1, policy_version 1206674 (0.0010) [2023-12-28 03:54:30,716][106225] Updated weights for policy 1, policy_version 1206684 (0.0010) [2023-12-28 03:54:30,758][106225] Updated weights for policy 1, policy_version 1206694 (0.0010) [2023-12-28 03:54:30,892][106226] Updated weights for policy 0, policy_version 1203679 (0.0007) [2023-12-28 03:54:30,953][106226] Updated weights for policy 0, policy_version 1203689 (0.0008) [2023-12-28 03:54:31,012][106226] Updated weights for policy 0, policy_version 1203699 (0.0008) [2023-12-28 03:54:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617168896. Throughput: 0: 9767.1, 1: 9922.3. Samples: 617155744. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:31,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.703')] [2023-12-28 03:54:31,566][106225] Updated weights for policy 1, policy_version 1206704 (0.0008) [2023-12-28 03:54:31,627][106225] Updated weights for policy 1, policy_version 1206714 (0.0008) [2023-12-28 03:54:31,698][106225] Updated weights for policy 1, policy_version 1206724 (0.0008) [2023-12-28 03:54:31,802][106226] Updated weights for policy 0, policy_version 1203709 (0.0007) [2023-12-28 03:54:31,863][106226] Updated weights for policy 0, policy_version 1203719 (0.0008) [2023-12-28 03:54:31,925][106226] Updated weights for policy 0, policy_version 1203729 (0.0008) [2023-12-28 03:54:32,309][106225] Updated weights for policy 1, policy_version 1206734 (0.0008) [2023-12-28 03:54:32,371][106225] Updated weights for policy 1, policy_version 1206744 (0.0007) [2023-12-28 03:54:32,432][106225] Updated weights for policy 1, policy_version 1206754 (0.0005) [2023-12-28 03:54:32,644][106226] Updated weights for policy 0, policy_version 1203739 (0.0008) [2023-12-28 03:54:32,706][106226] Updated weights for policy 0, policy_version 1203749 (0.0010) [2023-12-28 03:54:32,774][106226] Updated weights for policy 0, policy_version 1203759 (0.0009) [2023-12-28 03:54:33,005][106225] Updated weights for policy 1, policy_version 1206764 (0.0006) [2023-12-28 03:54:33,063][106225] Updated weights for policy 1, policy_version 1206774 (0.0008) [2023-12-28 03:54:33,118][106225] Updated weights for policy 1, policy_version 1206784 (0.0008) [2023-12-28 03:54:33,458][106226] Updated weights for policy 0, policy_version 1203769 (0.0010) [2023-12-28 03:54:33,511][106226] Updated weights for policy 0, policy_version 1203779 (0.0010) [2023-12-28 03:54:33,566][106226] Updated weights for policy 0, policy_version 1203789 (0.0007) [2023-12-28 03:54:33,622][106226] Updated weights for policy 0, policy_version 1203799 (0.0010) [2023-12-28 03:54:33,822][106225] Updated weights for policy 1, policy_version 1206794 (0.0008) [2023-12-28 03:54:33,883][106225] Updated weights for policy 1, policy_version 1206804 (0.0009) [2023-12-28 03:54:33,953][106225] Updated weights for policy 1, policy_version 1206814 (0.0009) [2023-12-28 03:54:34,009][106225] Updated weights for policy 1, policy_version 1206824 (0.0006) [2023-12-28 03:54:34,214][106226] Updated weights for policy 0, policy_version 1203809 (0.0008) [2023-12-28 03:54:34,282][106226] Updated weights for policy 0, policy_version 1203819 (0.0009) [2023-12-28 03:54:34,334][106226] Updated weights for policy 0, policy_version 1203829 (0.0011) [2023-12-28 03:54:34,664][106225] Updated weights for policy 1, policy_version 1206834 (0.0005) [2023-12-28 03:54:34,731][106225] Updated weights for policy 1, policy_version 1206844 (0.0005) [2023-12-28 03:54:34,790][106225] Updated weights for policy 1, policy_version 1206854 (0.0005) [2023-12-28 03:54:35,059][106226] Updated weights for policy 0, policy_version 1203839 (0.0011) [2023-12-28 03:54:35,123][106226] Updated weights for policy 0, policy_version 1203849 (0.0011) [2023-12-28 03:54:35,173][106226] Updated weights for policy 0, policy_version 1203859 (0.0010) [2023-12-28 03:54:35,336][106225] Updated weights for policy 1, policy_version 1206864 (0.0005) [2023-12-28 03:54:35,391][106225] Updated weights for policy 1, policy_version 1206874 (0.0007) [2023-12-28 03:54:35,445][106225] Updated weights for policy 1, policy_version 1206884 (0.0007) [2023-12-28 03:54:35,876][106226] Updated weights for policy 0, policy_version 1203869 (0.0011) [2023-12-28 03:54:35,943][106226] Updated weights for policy 0, policy_version 1203879 (0.0011) [2023-12-28 03:54:36,015][106226] Updated weights for policy 0, policy_version 1203889 (0.0011) [2023-12-28 03:54:36,149][106225] Updated weights for policy 1, policy_version 1206894 (0.0009) [2023-12-28 03:54:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617267200. Throughput: 0: 9790.8, 1: 9902.0. Samples: 617276820. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:36,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.734')] [2023-12-28 03:54:36,209][106225] Updated weights for policy 1, policy_version 1206904 (0.0008) [2023-12-28 03:54:36,272][106225] Updated weights for policy 1, policy_version 1206914 (0.0008) [2023-12-28 03:54:36,724][106226] Updated weights for policy 0, policy_version 1203899 (0.0011) [2023-12-28 03:54:36,777][106226] Updated weights for policy 0, policy_version 1203909 (0.0010) [2023-12-28 03:54:36,828][106226] Updated weights for policy 0, policy_version 1203919 (0.0011) [2023-12-28 03:54:37,009][106225] Updated weights for policy 1, policy_version 1206924 (0.0008) [2023-12-28 03:54:37,072][106225] Updated weights for policy 1, policy_version 1206934 (0.0007) [2023-12-28 03:54:37,122][106225] Updated weights for policy 1, policy_version 1206944 (0.0006) [2023-12-28 03:54:37,538][106226] Updated weights for policy 0, policy_version 1203929 (0.0010) [2023-12-28 03:54:37,604][106226] Updated weights for policy 0, policy_version 1203939 (0.0007) [2023-12-28 03:54:37,671][106226] Updated weights for policy 0, policy_version 1203949 (0.0006) [2023-12-28 03:54:37,724][106225] Updated weights for policy 1, policy_version 1206954 (0.0005) [2023-12-28 03:54:37,733][106226] Updated weights for policy 0, policy_version 1203959 (0.0006) [2023-12-28 03:54:37,795][106225] Updated weights for policy 1, policy_version 1206964 (0.0005) [2023-12-28 03:54:37,858][106225] Updated weights for policy 1, policy_version 1206974 (0.0007) [2023-12-28 03:54:37,922][106225] Updated weights for policy 1, policy_version 1206984 (0.0009) [2023-12-28 03:54:38,367][106226] Updated weights for policy 0, policy_version 1203969 (0.0008) [2023-12-28 03:54:38,428][106226] Updated weights for policy 0, policy_version 1203979 (0.0008) [2023-12-28 03:54:38,494][106226] Updated weights for policy 0, policy_version 1203989 (0.0009) [2023-12-28 03:54:38,502][106225] Updated weights for policy 1, policy_version 1206994 (0.0005) [2023-12-28 03:54:38,556][106225] Updated weights for policy 1, policy_version 1207004 (0.0006) [2023-12-28 03:54:38,608][106225] Updated weights for policy 1, policy_version 1207014 (0.0007) [2023-12-28 03:54:39,082][106226] Updated weights for policy 0, policy_version 1203999 (0.0009) [2023-12-28 03:54:39,156][106226] Updated weights for policy 0, policy_version 1204009 (0.0008) [2023-12-28 03:54:39,233][106226] Updated weights for policy 0, policy_version 1204019 (0.0008) [2023-12-28 03:54:39,318][106225] Updated weights for policy 1, policy_version 1207024 (0.0009) [2023-12-28 03:54:39,387][106225] Updated weights for policy 1, policy_version 1207034 (0.0007) [2023-12-28 03:54:39,454][106225] Updated weights for policy 1, policy_version 1207044 (0.0008) [2023-12-28 03:54:40,015][106226] Updated weights for policy 0, policy_version 1204029 (0.0009) [2023-12-28 03:54:40,074][106226] Updated weights for policy 0, policy_version 1204039 (0.0008) [2023-12-28 03:54:40,117][106225] Updated weights for policy 1, policy_version 1207054 (0.0008) [2023-12-28 03:54:40,137][106226] Updated weights for policy 0, policy_version 1204049 (0.0008) [2023-12-28 03:54:40,174][106225] Updated weights for policy 1, policy_version 1207064 (0.0007) [2023-12-28 03:54:40,227][106225] Updated weights for policy 1, policy_version 1207074 (0.0007) [2023-12-28 03:54:40,849][106226] Updated weights for policy 0, policy_version 1204059 (0.0009) [2023-12-28 03:54:40,906][106226] Updated weights for policy 0, policy_version 1204069 (0.0010) [2023-12-28 03:54:40,946][106225] Updated weights for policy 1, policy_version 1207084 (0.0008) [2023-12-28 03:54:40,973][106226] Updated weights for policy 0, policy_version 1204079 (0.0011) [2023-12-28 03:54:41,002][106225] Updated weights for policy 1, policy_version 1207094 (0.0007) [2023-12-28 03:54:41,073][106225] Updated weights for policy 1, policy_version 1207104 (0.0009) [2023-12-28 03:54:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 617373696. Throughput: 0: 9840.2, 1: 9955.8. Samples: 617339132. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:41,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.826')] [2023-12-28 03:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001207112_309067776.pth... [2023-12-28 03:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001204088_308305920.pth... [2023-12-28 03:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001205928_308764672.pth [2023-12-28 03:54:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001202936_308011008.pth [2023-12-28 03:54:41,690][106226] Updated weights for policy 0, policy_version 1204089 (0.0011) [2023-12-28 03:54:41,759][106226] Updated weights for policy 0, policy_version 1204099 (0.0009) [2023-12-28 03:54:41,813][106226] Updated weights for policy 0, policy_version 1204109 (0.0011) [2023-12-28 03:54:41,865][106226] Updated weights for policy 0, policy_version 1204119 (0.0010) [2023-12-28 03:54:41,930][106225] Updated weights for policy 1, policy_version 1207114 (0.0010) [2023-12-28 03:54:41,988][106225] Updated weights for policy 1, policy_version 1207124 (0.0006) [2023-12-28 03:54:42,047][106225] Updated weights for policy 1, policy_version 1207134 (0.0006) [2023-12-28 03:54:42,111][106225] Updated weights for policy 1, policy_version 1207144 (0.0008) [2023-12-28 03:54:42,604][106226] Updated weights for policy 0, policy_version 1204129 (0.0008) [2023-12-28 03:54:42,667][106226] Updated weights for policy 0, policy_version 1204139 (0.0008) [2023-12-28 03:54:42,730][106226] Updated weights for policy 0, policy_version 1204149 (0.0007) [2023-12-28 03:54:42,790][106225] Updated weights for policy 1, policy_version 1207154 (0.0010) [2023-12-28 03:54:42,852][106225] Updated weights for policy 1, policy_version 1207164 (0.0006) [2023-12-28 03:54:42,910][106225] Updated weights for policy 1, policy_version 1207174 (0.0006) [2023-12-28 03:54:43,413][106226] Updated weights for policy 0, policy_version 1204159 (0.0008) [2023-12-28 03:54:43,467][106226] Updated weights for policy 0, policy_version 1204169 (0.0009) [2023-12-28 03:54:43,534][106226] Updated weights for policy 0, policy_version 1204179 (0.0007) [2023-12-28 03:54:43,587][106225] Updated weights for policy 1, policy_version 1207184 (0.0009) [2023-12-28 03:54:43,642][106225] Updated weights for policy 1, policy_version 1207194 (0.0007) [2023-12-28 03:54:43,712][106225] Updated weights for policy 1, policy_version 1207204 (0.0010) [2023-12-28 03:54:44,103][106226] Updated weights for policy 0, policy_version 1204189 (0.0005) [2023-12-28 03:54:44,165][106226] Updated weights for policy 0, policy_version 1204199 (0.0006) [2023-12-28 03:54:44,226][106226] Updated weights for policy 0, policy_version 1204209 (0.0006) [2023-12-28 03:54:44,409][106225] Updated weights for policy 1, policy_version 1207214 (0.0011) [2023-12-28 03:54:44,468][106225] Updated weights for policy 1, policy_version 1207224 (0.0010) [2023-12-28 03:54:44,541][106225] Updated weights for policy 1, policy_version 1207234 (0.0011) [2023-12-28 03:54:44,927][106226] Updated weights for policy 0, policy_version 1204219 (0.0008) [2023-12-28 03:54:44,981][106226] Updated weights for policy 0, policy_version 1204229 (0.0008) [2023-12-28 03:54:45,041][106226] Updated weights for policy 0, policy_version 1204239 (0.0008) [2023-12-28 03:54:45,265][106225] Updated weights for policy 1, policy_version 1207244 (0.0011) [2023-12-28 03:54:45,323][106225] Updated weights for policy 1, policy_version 1207254 (0.0010) [2023-12-28 03:54:45,373][106225] Updated weights for policy 1, policy_version 1207264 (0.0010) [2023-12-28 03:54:45,790][106226] Updated weights for policy 0, policy_version 1204249 (0.0007) [2023-12-28 03:54:45,843][106226] Updated weights for policy 0, policy_version 1204259 (0.0008) [2023-12-28 03:54:45,897][106226] Updated weights for policy 0, policy_version 1204269 (0.0007) [2023-12-28 03:54:45,957][106226] Updated weights for policy 0, policy_version 1204279 (0.0008) [2023-12-28 03:54:46,092][106225] Updated weights for policy 1, policy_version 1207274 (0.0010) [2023-12-28 03:54:46,152][106225] Updated weights for policy 1, policy_version 1207284 (0.0009) [2023-12-28 03:54:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 617463808. Throughput: 0: 9802.9, 1: 9980.8. Samples: 617455472. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:46,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.826')] [2023-12-28 03:54:46,212][106225] Updated weights for policy 1, policy_version 1207294 (0.0008) [2023-12-28 03:54:46,262][106225] Updated weights for policy 1, policy_version 1207304 (0.0008) [2023-12-28 03:54:46,577][106226] Updated weights for policy 0, policy_version 1204289 (0.0006) [2023-12-28 03:54:46,633][106226] Updated weights for policy 0, policy_version 1204299 (0.0005) [2023-12-28 03:54:46,680][106226] Updated weights for policy 0, policy_version 1204309 (0.0005) [2023-12-28 03:54:46,963][106225] Updated weights for policy 1, policy_version 1207314 (0.0006) [2023-12-28 03:54:47,027][106225] Updated weights for policy 1, policy_version 1207324 (0.0005) [2023-12-28 03:54:47,071][106225] Updated weights for policy 1, policy_version 1207334 (0.0005) [2023-12-28 03:54:47,304][106226] Updated weights for policy 0, policy_version 1204319 (0.0007) [2023-12-28 03:54:47,352][106226] Updated weights for policy 0, policy_version 1204329 (0.0008) [2023-12-28 03:54:47,406][106226] Updated weights for policy 0, policy_version 1204339 (0.0008) [2023-12-28 03:54:47,707][106225] Updated weights for policy 1, policy_version 1207344 (0.0007) [2023-12-28 03:54:47,760][106225] Updated weights for policy 1, policy_version 1207355 (0.0008) [2023-12-28 03:54:47,810][106225] Updated weights for policy 1, policy_version 1207365 (0.0006) [2023-12-28 03:54:48,134][106226] Updated weights for policy 0, policy_version 1204349 (0.0007) [2023-12-28 03:54:48,193][106226] Updated weights for policy 0, policy_version 1204359 (0.0009) [2023-12-28 03:54:48,249][106226] Updated weights for policy 0, policy_version 1204369 (0.0008) [2023-12-28 03:54:48,481][106225] Updated weights for policy 1, policy_version 1207375 (0.0008) [2023-12-28 03:54:48,547][106225] Updated weights for policy 1, policy_version 1207385 (0.0008) [2023-12-28 03:54:48,610][106225] Updated weights for policy 1, policy_version 1207395 (0.0009) [2023-12-28 03:54:48,937][106226] Updated weights for policy 0, policy_version 1204379 (0.0009) [2023-12-28 03:54:48,999][106226] Updated weights for policy 0, policy_version 1204389 (0.0007) [2023-12-28 03:54:49,052][106226] Updated weights for policy 0, policy_version 1204399 (0.0006) [2023-12-28 03:54:49,380][106225] Updated weights for policy 1, policy_version 1207405 (0.0008) [2023-12-28 03:54:49,443][106225] Updated weights for policy 1, policy_version 1207415 (0.0010) [2023-12-28 03:54:49,499][106225] Updated weights for policy 1, policy_version 1207425 (0.0009) [2023-12-28 03:54:49,741][106226] Updated weights for policy 0, policy_version 1204409 (0.0008) [2023-12-28 03:54:49,810][106226] Updated weights for policy 0, policy_version 1204419 (0.0007) [2023-12-28 03:54:49,877][106226] Updated weights for policy 0, policy_version 1204429 (0.0008) [2023-12-28 03:54:49,965][106226] Updated weights for policy 0, policy_version 1204439 (0.0008) [2023-12-28 03:54:50,174][106225] Updated weights for policy 1, policy_version 1207435 (0.0007) [2023-12-28 03:54:50,240][106225] Updated weights for policy 1, policy_version 1207445 (0.0010) [2023-12-28 03:54:50,301][106225] Updated weights for policy 1, policy_version 1207455 (0.0010) [2023-12-28 03:54:50,623][106226] Updated weights for policy 0, policy_version 1204449 (0.0008) [2023-12-28 03:54:50,676][106226] Updated weights for policy 0, policy_version 1204459 (0.0008) [2023-12-28 03:54:50,731][106226] Updated weights for policy 0, policy_version 1204469 (0.0009) [2023-12-28 03:54:50,962][106225] Updated weights for policy 1, policy_version 1207465 (0.0009) [2023-12-28 03:54:51,029][106225] Updated weights for policy 1, policy_version 1207475 (0.0008) [2023-12-28 03:54:51,094][106225] Updated weights for policy 1, policy_version 1207485 (0.0007) [2023-12-28 03:54:51,164][106225] Updated weights for policy 1, policy_version 1207496 (0.0008) [2023-12-28 03:54:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617570304. Throughput: 0: 9773.3, 1: 9919.7. Samples: 617575992. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:51,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-5.292')] [2023-12-28 03:54:51,482][106226] Updated weights for policy 0, policy_version 1204479 (0.0009) [2023-12-28 03:54:51,545][106226] Updated weights for policy 0, policy_version 1204489 (0.0007) [2023-12-28 03:54:51,604][106226] Updated weights for policy 0, policy_version 1204499 (0.0007) [2023-12-28 03:54:51,911][106225] Updated weights for policy 1, policy_version 1207506 (0.0008) [2023-12-28 03:54:51,968][106225] Updated weights for policy 1, policy_version 1207516 (0.0009) [2023-12-28 03:54:52,023][106225] Updated weights for policy 1, policy_version 1207526 (0.0008) [2023-12-28 03:54:52,308][106226] Updated weights for policy 0, policy_version 1204509 (0.0009) [2023-12-28 03:54:52,372][106226] Updated weights for policy 0, policy_version 1204519 (0.0007) [2023-12-28 03:54:52,438][106226] Updated weights for policy 0, policy_version 1204529 (0.0008) [2023-12-28 03:54:52,742][106225] Updated weights for policy 1, policy_version 1207536 (0.0007) [2023-12-28 03:54:52,797][106225] Updated weights for policy 1, policy_version 1207546 (0.0006) [2023-12-28 03:54:52,860][106225] Updated weights for policy 1, policy_version 1207556 (0.0005) [2023-12-28 03:54:53,106][106226] Updated weights for policy 0, policy_version 1204539 (0.0007) [2023-12-28 03:54:53,174][106226] Updated weights for policy 0, policy_version 1204549 (0.0005) [2023-12-28 03:54:53,241][106226] Updated weights for policy 0, policy_version 1204559 (0.0010) [2023-12-28 03:54:53,430][106225] Updated weights for policy 1, policy_version 1207566 (0.0005) [2023-12-28 03:54:53,481][106225] Updated weights for policy 1, policy_version 1207576 (0.0005) [2023-12-28 03:54:53,530][106225] Updated weights for policy 1, policy_version 1207586 (0.0005) [2023-12-28 03:54:53,917][106226] Updated weights for policy 0, policy_version 1204569 (0.0011) [2023-12-28 03:54:53,966][106226] Updated weights for policy 0, policy_version 1204579 (0.0008) [2023-12-28 03:54:54,016][106226] Updated weights for policy 0, policy_version 1204589 (0.0007) [2023-12-28 03:54:54,074][106226] Updated weights for policy 0, policy_version 1204599 (0.0005) [2023-12-28 03:54:54,129][106225] Updated weights for policy 1, policy_version 1207596 (0.0006) [2023-12-28 03:54:54,195][106225] Updated weights for policy 1, policy_version 1207606 (0.0008) [2023-12-28 03:54:54,258][106225] Updated weights for policy 1, policy_version 1207616 (0.0009) [2023-12-28 03:54:54,705][106226] Updated weights for policy 0, policy_version 1204609 (0.0006) [2023-12-28 03:54:54,763][106226] Updated weights for policy 0, policy_version 1204619 (0.0005) [2023-12-28 03:54:54,821][106226] Updated weights for policy 0, policy_version 1204629 (0.0005) [2023-12-28 03:54:54,888][106225] Updated weights for policy 1, policy_version 1207626 (0.0008) [2023-12-28 03:54:54,950][106225] Updated weights for policy 1, policy_version 1207636 (0.0008) [2023-12-28 03:54:55,010][106225] Updated weights for policy 1, policy_version 1207646 (0.0008) [2023-12-28 03:54:55,072][106225] Updated weights for policy 1, policy_version 1207656 (0.0009) [2023-12-28 03:54:55,478][106226] Updated weights for policy 0, policy_version 1204639 (0.0009) [2023-12-28 03:54:55,537][106226] Updated weights for policy 0, policy_version 1204649 (0.0010) [2023-12-28 03:54:55,593][106226] Updated weights for policy 0, policy_version 1204659 (0.0010) [2023-12-28 03:54:55,670][106225] Updated weights for policy 1, policy_version 1207666 (0.0008) [2023-12-28 03:54:55,731][106225] Updated weights for policy 1, policy_version 1207676 (0.0008) [2023-12-28 03:54:55,787][106225] Updated weights for policy 1, policy_version 1207686 (0.0008) [2023-12-28 03:54:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617668608. Throughput: 0: 9786.1, 1: 9908.2. Samples: 617636448. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:54:56,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.993')] [2023-12-28 03:54:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001207688_309215232.pth... [2023-12-28 03:54:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001204664_308453376.pth... [2023-12-28 03:54:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001206504_308912128.pth [2023-12-28 03:54:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001203512_308158464.pth [2023-12-28 03:54:56,275][106226] Updated weights for policy 0, policy_version 1204669 (0.0010) [2023-12-28 03:54:56,334][106226] Updated weights for policy 0, policy_version 1204679 (0.0010) [2023-12-28 03:54:56,396][106226] Updated weights for policy 0, policy_version 1204689 (0.0011) [2023-12-28 03:54:56,517][106225] Updated weights for policy 1, policy_version 1207696 (0.0006) [2023-12-28 03:54:56,582][106225] Updated weights for policy 1, policy_version 1207706 (0.0005) [2023-12-28 03:54:56,644][106225] Updated weights for policy 1, policy_version 1207716 (0.0005) [2023-12-28 03:54:57,073][106226] Updated weights for policy 0, policy_version 1204699 (0.0009) [2023-12-28 03:54:57,128][106226] Updated weights for policy 0, policy_version 1204709 (0.0007) [2023-12-28 03:54:57,177][106226] Updated weights for policy 0, policy_version 1204719 (0.0010) [2023-12-28 03:54:57,197][106225] Updated weights for policy 1, policy_version 1207726 (0.0008) [2023-12-28 03:54:57,248][106225] Updated weights for policy 1, policy_version 1207736 (0.0007) [2023-12-28 03:54:57,310][106225] Updated weights for policy 1, policy_version 1207746 (0.0006) [2023-12-28 03:54:57,851][106226] Updated weights for policy 0, policy_version 1204729 (0.0008) [2023-12-28 03:54:57,887][106225] Updated weights for policy 1, policy_version 1207756 (0.0006) [2023-12-28 03:54:57,913][106226] Updated weights for policy 0, policy_version 1204739 (0.0011) [2023-12-28 03:54:57,949][106225] Updated weights for policy 1, policy_version 1207766 (0.0010) [2023-12-28 03:54:57,977][106226] Updated weights for policy 0, policy_version 1204749 (0.0010) [2023-12-28 03:54:58,008][106225] Updated weights for policy 1, policy_version 1207776 (0.0010) [2023-12-28 03:54:58,036][106226] Updated weights for policy 0, policy_version 1204759 (0.0006) [2023-12-28 03:54:58,751][106226] Updated weights for policy 0, policy_version 1204769 (0.0009) [2023-12-28 03:54:58,776][106225] Updated weights for policy 1, policy_version 1207786 (0.0010) [2023-12-28 03:54:58,819][106226] Updated weights for policy 0, policy_version 1204779 (0.0010) [2023-12-28 03:54:58,835][106225] Updated weights for policy 1, policy_version 1207796 (0.0008) [2023-12-28 03:54:58,884][106226] Updated weights for policy 0, policy_version 1204789 (0.0008) [2023-12-28 03:54:58,904][106225] Updated weights for policy 1, policy_version 1207806 (0.0008) [2023-12-28 03:54:58,971][106225] Updated weights for policy 1, policy_version 1207816 (0.0009) [2023-12-28 03:54:59,648][106226] Updated weights for policy 0, policy_version 1204799 (0.0006) [2023-12-28 03:54:59,696][106226] Updated weights for policy 0, policy_version 1204809 (0.0008) [2023-12-28 03:54:59,738][106225] Updated weights for policy 1, policy_version 1207826 (0.0008) [2023-12-28 03:54:59,750][106226] Updated weights for policy 0, policy_version 1204819 (0.0006) [2023-12-28 03:54:59,798][106225] Updated weights for policy 1, policy_version 1207836 (0.0008) [2023-12-28 03:54:59,862][106225] Updated weights for policy 1, policy_version 1207846 (0.0006) [2023-12-28 03:55:00,468][106226] Updated weights for policy 0, policy_version 1204829 (0.0007) [2023-12-28 03:55:00,533][106226] Updated weights for policy 0, policy_version 1204839 (0.0008) [2023-12-28 03:55:00,575][106225] Updated weights for policy 1, policy_version 1207856 (0.0005) [2023-12-28 03:55:00,589][106226] Updated weights for policy 0, policy_version 1204849 (0.0007) [2023-12-28 03:55:00,628][106225] Updated weights for policy 1, policy_version 1207866 (0.0007) [2023-12-28 03:55:00,689][106225] Updated weights for policy 1, policy_version 1207876 (0.0008) [2023-12-28 03:55:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617766912. Throughput: 0: 9924.1, 1: 10008.0. Samples: 617759216. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:55:01,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.772')] [2023-12-28 03:55:01,194][106226] Updated weights for policy 0, policy_version 1204859 (0.0007) [2023-12-28 03:55:01,251][106226] Updated weights for policy 0, policy_version 1204869 (0.0009) [2023-12-28 03:55:01,322][106226] Updated weights for policy 0, policy_version 1204879 (0.0008) [2023-12-28 03:55:01,577][106225] Updated weights for policy 1, policy_version 1207886 (0.0007) [2023-12-28 03:55:01,637][106225] Updated weights for policy 1, policy_version 1207896 (0.0007) [2023-12-28 03:55:01,694][106225] Updated weights for policy 1, policy_version 1207906 (0.0006) [2023-12-28 03:55:01,996][106226] Updated weights for policy 0, policy_version 1204889 (0.0008) [2023-12-28 03:55:02,045][106226] Updated weights for policy 0, policy_version 1204899 (0.0008) [2023-12-28 03:55:02,095][106226] Updated weights for policy 0, policy_version 1204909 (0.0008) [2023-12-28 03:55:02,148][106226] Updated weights for policy 0, policy_version 1204919 (0.0008) [2023-12-28 03:55:02,382][106225] Updated weights for policy 1, policy_version 1207916 (0.0008) [2023-12-28 03:55:02,431][106225] Updated weights for policy 1, policy_version 1207926 (0.0005) [2023-12-28 03:55:02,481][106225] Updated weights for policy 1, policy_version 1207936 (0.0005) [2023-12-28 03:55:02,939][106226] Updated weights for policy 0, policy_version 1204929 (0.0008) [2023-12-28 03:55:02,990][106226] Updated weights for policy 0, policy_version 1204939 (0.0008) [2023-12-28 03:55:03,039][106226] Updated weights for policy 0, policy_version 1204949 (0.0008) [2023-12-28 03:55:03,115][106225] Updated weights for policy 1, policy_version 1207946 (0.0006) [2023-12-28 03:55:03,172][106225] Updated weights for policy 1, policy_version 1207956 (0.0009) [2023-12-28 03:55:03,225][106225] Updated weights for policy 1, policy_version 1207966 (0.0008) [2023-12-28 03:55:03,284][106225] Updated weights for policy 1, policy_version 1207976 (0.0009) [2023-12-28 03:55:03,791][106226] Updated weights for policy 0, policy_version 1204959 (0.0009) [2023-12-28 03:55:03,844][106226] Updated weights for policy 0, policy_version 1204969 (0.0010) [2023-12-28 03:55:03,903][106226] Updated weights for policy 0, policy_version 1204979 (0.0008) [2023-12-28 03:55:03,980][106225] Updated weights for policy 1, policy_version 1207986 (0.0007) [2023-12-28 03:55:04,037][106225] Updated weights for policy 1, policy_version 1207996 (0.0007) [2023-12-28 03:55:04,095][106225] Updated weights for policy 1, policy_version 1208006 (0.0008) [2023-12-28 03:55:04,679][106226] Updated weights for policy 0, policy_version 1204989 (0.0009) [2023-12-28 03:55:04,732][106226] Updated weights for policy 0, policy_version 1204999 (0.0010) [2023-12-28 03:55:04,778][106226] Updated weights for policy 0, policy_version 1205009 (0.0010) [2023-12-28 03:55:04,804][106225] Updated weights for policy 1, policy_version 1208016 (0.0006) [2023-12-28 03:55:04,861][106225] Updated weights for policy 1, policy_version 1208026 (0.0008) [2023-12-28 03:55:04,917][106225] Updated weights for policy 1, policy_version 1208036 (0.0008) [2023-12-28 03:55:05,433][106226] Updated weights for policy 0, policy_version 1205019 (0.0010) [2023-12-28 03:55:05,492][106226] Updated weights for policy 0, policy_version 1205029 (0.0009) [2023-12-28 03:55:05,551][106226] Updated weights for policy 0, policy_version 1205039 (0.0009) [2023-12-28 03:55:05,656][106225] Updated weights for policy 1, policy_version 1208046 (0.0008) [2023-12-28 03:55:05,706][106225] Updated weights for policy 1, policy_version 1208057 (0.0009) [2023-12-28 03:55:05,760][106225] Updated weights for policy 1, policy_version 1208067 (0.0008) [2023-12-28 03:55:06,125][106226] Updated weights for policy 0, policy_version 1205049 (0.0007) [2023-12-28 03:55:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617865216. Throughput: 0: 10004.4, 1: 10002.8. Samples: 617877800. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:55:06,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.909')] [2023-12-28 03:55:06,186][106226] Updated weights for policy 0, policy_version 1205059 (0.0008) [2023-12-28 03:55:06,248][106226] Updated weights for policy 0, policy_version 1205069 (0.0010) [2023-12-28 03:55:06,311][106226] Updated weights for policy 0, policy_version 1205079 (0.0011) [2023-12-28 03:55:06,581][106225] Updated weights for policy 1, policy_version 1208077 (0.0007) [2023-12-28 03:55:06,644][106225] Updated weights for policy 1, policy_version 1208087 (0.0007) [2023-12-28 03:55:06,706][106225] Updated weights for policy 1, policy_version 1208097 (0.0008) [2023-12-28 03:55:07,018][106226] Updated weights for policy 0, policy_version 1205089 (0.0008) [2023-12-28 03:55:07,081][106226] Updated weights for policy 0, policy_version 1205099 (0.0009) [2023-12-28 03:55:07,142][106226] Updated weights for policy 0, policy_version 1205109 (0.0009) [2023-12-28 03:55:07,410][106225] Updated weights for policy 1, policy_version 1208107 (0.0009) [2023-12-28 03:55:07,470][106225] Updated weights for policy 1, policy_version 1208117 (0.0008) [2023-12-28 03:55:07,520][106225] Updated weights for policy 1, policy_version 1208127 (0.0008) [2023-12-28 03:55:07,886][106226] Updated weights for policy 0, policy_version 1205119 (0.0008) [2023-12-28 03:55:07,929][106226] Updated weights for policy 0, policy_version 1205129 (0.0007) [2023-12-28 03:55:07,981][106226] Updated weights for policy 0, policy_version 1205139 (0.0008) [2023-12-28 03:55:08,225][106225] Updated weights for policy 1, policy_version 1208137 (0.0009) [2023-12-28 03:55:08,281][106225] Updated weights for policy 1, policy_version 1208147 (0.0009) [2023-12-28 03:55:08,345][106225] Updated weights for policy 1, policy_version 1208157 (0.0009) [2023-12-28 03:55:08,414][106225] Updated weights for policy 1, policy_version 1208167 (0.0010) [2023-12-28 03:55:08,631][106226] Updated weights for policy 0, policy_version 1205149 (0.0006) [2023-12-28 03:55:08,687][106226] Updated weights for policy 0, policy_version 1205159 (0.0006) [2023-12-28 03:55:08,747][106226] Updated weights for policy 0, policy_version 1205169 (0.0007) [2023-12-28 03:55:09,141][106225] Updated weights for policy 1, policy_version 1208177 (0.0009) [2023-12-28 03:55:09,202][106225] Updated weights for policy 1, policy_version 1208187 (0.0009) [2023-12-28 03:55:09,266][106225] Updated weights for policy 1, policy_version 1208197 (0.0007) [2023-12-28 03:55:09,475][106226] Updated weights for policy 0, policy_version 1205179 (0.0008) [2023-12-28 03:55:09,530][106226] Updated weights for policy 0, policy_version 1205189 (0.0008) [2023-12-28 03:55:09,618][106226] Updated weights for policy 0, policy_version 1205199 (0.0008) [2023-12-28 03:55:10,006][106225] Updated weights for policy 1, policy_version 1208207 (0.0009) [2023-12-28 03:55:10,069][106225] Updated weights for policy 1, policy_version 1208217 (0.0010) [2023-12-28 03:55:10,143][106225] Updated weights for policy 1, policy_version 1208227 (0.0010) [2023-12-28 03:55:10,329][106226] Updated weights for policy 0, policy_version 1205209 (0.0008) [2023-12-28 03:55:10,397][106226] Updated weights for policy 0, policy_version 1205219 (0.0008) [2023-12-28 03:55:10,463][106226] Updated weights for policy 0, policy_version 1205229 (0.0008) [2023-12-28 03:55:10,517][106226] Updated weights for policy 0, policy_version 1205239 (0.0008) [2023-12-28 03:55:10,848][106225] Updated weights for policy 1, policy_version 1208237 (0.0008) [2023-12-28 03:55:10,897][106225] Updated weights for policy 1, policy_version 1208247 (0.0005) [2023-12-28 03:55:10,958][106225] Updated weights for policy 1, policy_version 1208257 (0.0005) [2023-12-28 03:55:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 617963520. Throughput: 0: 10034.4, 1: 9975.6. Samples: 617935396. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:55:11,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.758')] [2023-12-28 03:55:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001208264_309362688.pth... [2023-12-28 03:55:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001205240_308600832.pth... [2023-12-28 03:55:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001207112_309067776.pth [2023-12-28 03:55:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001204088_308305920.pth [2023-12-28 03:55:11,329][106226] Updated weights for policy 0, policy_version 1205249 (0.0008) [2023-12-28 03:55:11,398][106226] Updated weights for policy 0, policy_version 1205259 (0.0008) [2023-12-28 03:55:11,466][106226] Updated weights for policy 0, policy_version 1205269 (0.0006) [2023-12-28 03:55:11,666][106225] Updated weights for policy 1, policy_version 1208267 (0.0010) [2023-12-28 03:55:11,721][106225] Updated weights for policy 1, policy_version 1208277 (0.0008) [2023-12-28 03:55:11,791][106225] Updated weights for policy 1, policy_version 1208287 (0.0008) [2023-12-28 03:55:12,167][106226] Updated weights for policy 0, policy_version 1205279 (0.0008) [2023-12-28 03:55:12,225][106226] Updated weights for policy 0, policy_version 1205289 (0.0009) [2023-12-28 03:55:12,284][106226] Updated weights for policy 0, policy_version 1205299 (0.0009) [2023-12-28 03:55:12,518][106225] Updated weights for policy 1, policy_version 1208297 (0.0008) [2023-12-28 03:55:12,579][106225] Updated weights for policy 1, policy_version 1208307 (0.0010) [2023-12-28 03:55:12,633][106225] Updated weights for policy 1, policy_version 1208317 (0.0010) [2023-12-28 03:55:12,691][106225] Updated weights for policy 1, policy_version 1208327 (0.0010) [2023-12-28 03:55:13,019][106226] Updated weights for policy 0, policy_version 1205309 (0.0007) [2023-12-28 03:55:13,079][106226] Updated weights for policy 0, policy_version 1205319 (0.0007) [2023-12-28 03:55:13,144][106226] Updated weights for policy 0, policy_version 1205329 (0.0008) [2023-12-28 03:55:13,414][106225] Updated weights for policy 1, policy_version 1208337 (0.0010) [2023-12-28 03:55:13,460][106225] Updated weights for policy 1, policy_version 1208347 (0.0010) [2023-12-28 03:55:13,507][106225] Updated weights for policy 1, policy_version 1208357 (0.0010) [2023-12-28 03:55:13,865][106226] Updated weights for policy 0, policy_version 1205339 (0.0008) [2023-12-28 03:55:13,926][106226] Updated weights for policy 0, policy_version 1205349 (0.0008) [2023-12-28 03:55:13,980][106226] Updated weights for policy 0, policy_version 1205359 (0.0008) [2023-12-28 03:55:14,159][106225] Updated weights for policy 1, policy_version 1208367 (0.0009) [2023-12-28 03:55:14,204][106225] Updated weights for policy 1, policy_version 1208377 (0.0008) [2023-12-28 03:55:14,262][106225] Updated weights for policy 1, policy_version 1208387 (0.0006) [2023-12-28 03:55:14,750][106226] Updated weights for policy 0, policy_version 1205369 (0.0009) [2023-12-28 03:55:14,821][106226] Updated weights for policy 0, policy_version 1205379 (0.0008) [2023-12-28 03:55:14,886][106226] Updated weights for policy 0, policy_version 1205389 (0.0008) [2023-12-28 03:55:14,954][106226] Updated weights for policy 0, policy_version 1205399 (0.0008) [2023-12-28 03:55:14,972][106225] Updated weights for policy 1, policy_version 1208397 (0.0008) [2023-12-28 03:55:15,033][106225] Updated weights for policy 1, policy_version 1208407 (0.0008) [2023-12-28 03:55:15,085][106225] Updated weights for policy 1, policy_version 1208417 (0.0008) [2023-12-28 03:55:15,676][106226] Updated weights for policy 0, policy_version 1205409 (0.0005) [2023-12-28 03:55:15,738][106226] Updated weights for policy 0, policy_version 1205419 (0.0005) [2023-12-28 03:55:15,802][106226] Updated weights for policy 0, policy_version 1205429 (0.0005) [2023-12-28 03:55:15,861][106225] Updated weights for policy 1, policy_version 1208427 (0.0009) [2023-12-28 03:55:15,914][106225] Updated weights for policy 1, policy_version 1208437 (0.0008) [2023-12-28 03:55:15,966][106225] Updated weights for policy 1, policy_version 1208447 (0.0007) [2023-12-28 03:55:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 618061824. Throughput: 0: 9889.5, 1: 9980.7. Samples: 618049904. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 03:55:16,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.890')] [2023-12-28 03:55:16,408][106226] Updated weights for policy 0, policy_version 1205439 (0.0009) [2023-12-28 03:55:16,460][106226] Updated weights for policy 0, policy_version 1205449 (0.0005) [2023-12-28 03:55:16,513][106226] Updated weights for policy 0, policy_version 1205459 (0.0005) [2023-12-28 03:55:16,653][106225] Updated weights for policy 1, policy_version 1208457 (0.0007) [2023-12-28 03:55:16,703][106225] Updated weights for policy 1, policy_version 1208467 (0.0007) [2023-12-28 03:55:16,750][106225] Updated weights for policy 1, policy_version 1208477 (0.0010) [2023-12-28 03:55:16,801][106225] Updated weights for policy 1, policy_version 1208487 (0.0010) [2023-12-28 03:55:17,062][106226] Updated weights for policy 0, policy_version 1205469 (0.0007) [2023-12-28 03:55:17,110][106226] Updated weights for policy 0, policy_version 1205479 (0.0008) [2023-12-28 03:55:17,166][106226] Updated weights for policy 0, policy_version 1205489 (0.0010) [2023-12-28 03:55:17,393][106225] Updated weights for policy 1, policy_version 1208497 (0.0010) [2023-12-28 03:55:17,451][106225] Updated weights for policy 1, policy_version 1208507 (0.0010) [2023-12-28 03:55:17,520][106225] Updated weights for policy 1, policy_version 1208517 (0.0010) [2023-12-28 03:55:17,812][106226] Updated weights for policy 0, policy_version 1205499 (0.0009) [2023-12-28 03:55:17,869][106226] Updated weights for policy 0, policy_version 1205509 (0.0005) [2023-12-28 03:55:17,919][106226] Updated weights for policy 0, policy_version 1205519 (0.0007) [2023-12-28 03:55:18,139][106225] Updated weights for policy 1, policy_version 1208527 (0.0006) [2023-12-28 03:55:18,203][106225] Updated weights for policy 1, policy_version 1208537 (0.0010) [2023-12-28 03:55:18,255][106225] Updated weights for policy 1, policy_version 1208547 (0.0008) [2023-12-28 03:55:18,608][106226] Updated weights for policy 0, policy_version 1205529 (0.0009) [2023-12-28 03:55:18,665][106226] Updated weights for policy 0, policy_version 1205539 (0.0009) [2023-12-28 03:55:18,730][106226] Updated weights for policy 0, policy_version 1205549 (0.0006) [2023-12-28 03:55:18,787][106226] Updated weights for policy 0, policy_version 1205559 (0.0007) [2023-12-28 03:55:19,001][106225] Updated weights for policy 1, policy_version 1208557 (0.0009) [2023-12-28 03:55:19,054][106225] Updated weights for policy 1, policy_version 1208567 (0.0006) [2023-12-28 03:55:19,106][106225] Updated weights for policy 1, policy_version 1208577 (0.0005) [2023-12-28 03:55:19,450][106226] Updated weights for policy 0, policy_version 1205569 (0.0008) [2023-12-28 03:55:19,509][106226] Updated weights for policy 0, policy_version 1205579 (0.0008) [2023-12-28 03:55:19,566][106226] Updated weights for policy 0, policy_version 1205589 (0.0008) [2023-12-28 03:55:19,831][106225] Updated weights for policy 1, policy_version 1208587 (0.0009) [2023-12-28 03:55:19,888][106225] Updated weights for policy 1, policy_version 1208597 (0.0009) [2023-12-28 03:55:19,960][106225] Updated weights for policy 1, policy_version 1208607 (0.0006) [2023-12-28 03:55:20,278][106226] Updated weights for policy 0, policy_version 1205599 (0.0008) [2023-12-28 03:55:20,341][106226] Updated weights for policy 0, policy_version 1205609 (0.0009) [2023-12-28 03:55:20,407][106226] Updated weights for policy 0, policy_version 1205619 (0.0011) [2023-12-28 03:55:20,620][106225] Updated weights for policy 1, policy_version 1208617 (0.0008) [2023-12-28 03:55:20,687][106225] Updated weights for policy 1, policy_version 1208627 (0.0008) [2023-12-28 03:55:20,747][106225] Updated weights for policy 1, policy_version 1208637 (0.0008) [2023-12-28 03:55:20,811][106225] Updated weights for policy 1, policy_version 1208647 (0.0009) [2023-12-28 03:55:21,156][106226] Updated weights for policy 0, policy_version 1205629 (0.0008) [2023-12-28 03:55:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 618160128. Throughput: 0: 9953.7, 1: 9942.0. Samples: 618172124. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:21,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.693')] [2023-12-28 03:55:21,225][106226] Updated weights for policy 0, policy_version 1205639 (0.0008) [2023-12-28 03:55:21,295][106226] Updated weights for policy 0, policy_version 1205649 (0.0009) [2023-12-28 03:55:21,573][106225] Updated weights for policy 1, policy_version 1208657 (0.0009) [2023-12-28 03:55:21,641][106225] Updated weights for policy 1, policy_version 1208667 (0.0009) [2023-12-28 03:55:21,708][106225] Updated weights for policy 1, policy_version 1208677 (0.0009) [2023-12-28 03:55:21,990][106226] Updated weights for policy 0, policy_version 1205659 (0.0007) [2023-12-28 03:55:22,053][106226] Updated weights for policy 0, policy_version 1205669 (0.0009) [2023-12-28 03:55:22,113][106226] Updated weights for policy 0, policy_version 1205679 (0.0007) [2023-12-28 03:55:22,629][106225] Updated weights for policy 1, policy_version 1208687 (0.0009) [2023-12-28 03:55:22,695][106225] Updated weights for policy 1, policy_version 1208697 (0.0009) [2023-12-28 03:55:22,751][106225] Updated weights for policy 1, policy_version 1208707 (0.0009) [2023-12-28 03:55:22,836][106226] Updated weights for policy 0, policy_version 1205689 (0.0007) [2023-12-28 03:55:22,896][106226] Updated weights for policy 0, policy_version 1205699 (0.0009) [2023-12-28 03:55:22,953][106226] Updated weights for policy 0, policy_version 1205709 (0.0009) [2023-12-28 03:55:23,005][106226] Updated weights for policy 0, policy_version 1205719 (0.0008) [2023-12-28 03:55:23,460][106225] Updated weights for policy 1, policy_version 1208717 (0.0009) [2023-12-28 03:55:23,516][106225] Updated weights for policy 1, policy_version 1208727 (0.0008) [2023-12-28 03:55:23,580][106225] Updated weights for policy 1, policy_version 1208737 (0.0005) [2023-12-28 03:55:23,783][106226] Updated weights for policy 0, policy_version 1205729 (0.0009) [2023-12-28 03:55:23,846][106226] Updated weights for policy 0, policy_version 1205739 (0.0010) [2023-12-28 03:55:23,903][106226] Updated weights for policy 0, policy_version 1205749 (0.0008) [2023-12-28 03:55:24,132][106225] Updated weights for policy 1, policy_version 1208747 (0.0005) [2023-12-28 03:55:24,193][106225] Updated weights for policy 1, policy_version 1208757 (0.0007) [2023-12-28 03:55:24,260][106225] Updated weights for policy 1, policy_version 1208767 (0.0009) [2023-12-28 03:55:24,692][106226] Updated weights for policy 0, policy_version 1205759 (0.0008) [2023-12-28 03:55:24,757][106226] Updated weights for policy 0, policy_version 1205769 (0.0008) [2023-12-28 03:55:24,821][106226] Updated weights for policy 0, policy_version 1205779 (0.0008) [2023-12-28 03:55:24,922][106225] Updated weights for policy 1, policy_version 1208777 (0.0008) [2023-12-28 03:55:24,974][106225] Updated weights for policy 1, policy_version 1208787 (0.0005) [2023-12-28 03:55:25,031][106225] Updated weights for policy 1, policy_version 1208797 (0.0008) [2023-12-28 03:55:25,078][106225] Updated weights for policy 1, policy_version 1208807 (0.0010) [2023-12-28 03:55:25,554][106226] Updated weights for policy 0, policy_version 1205789 (0.0007) [2023-12-28 03:55:25,600][106226] Updated weights for policy 0, policy_version 1205799 (0.0008) [2023-12-28 03:55:25,651][106226] Updated weights for policy 0, policy_version 1205809 (0.0008) [2023-12-28 03:55:25,771][106225] Updated weights for policy 1, policy_version 1208817 (0.0011) [2023-12-28 03:55:25,830][106225] Updated weights for policy 1, policy_version 1208827 (0.0010) [2023-12-28 03:55:25,880][106225] Updated weights for policy 1, policy_version 1208837 (0.0010) [2023-12-28 03:55:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 618258432. Throughput: 0: 9867.8, 1: 9842.1. Samples: 618226072. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:26,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.912')] [2023-12-28 03:55:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001208840_309510144.pth... [2023-12-28 03:55:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001205816_308748288.pth... [2023-12-28 03:55:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001207688_309215232.pth [2023-12-28 03:55:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001204664_308453376.pth [2023-12-28 03:55:26,372][106226] Updated weights for policy 0, policy_version 1205819 (0.0008) [2023-12-28 03:55:26,431][106226] Updated weights for policy 0, policy_version 1205829 (0.0009) [2023-12-28 03:55:26,496][106226] Updated weights for policy 0, policy_version 1205839 (0.0008) [2023-12-28 03:55:26,523][106225] Updated weights for policy 1, policy_version 1208847 (0.0010) [2023-12-28 03:55:26,568][106225] Updated weights for policy 1, policy_version 1208857 (0.0010) [2023-12-28 03:55:26,618][106225] Updated weights for policy 1, policy_version 1208867 (0.0010) [2023-12-28 03:55:27,260][106226] Updated weights for policy 0, policy_version 1205849 (0.0006) [2023-12-28 03:55:27,303][106225] Updated weights for policy 1, policy_version 1208877 (0.0009) [2023-12-28 03:55:27,325][106226] Updated weights for policy 0, policy_version 1205859 (0.0005) [2023-12-28 03:55:27,359][106225] Updated weights for policy 1, policy_version 1208887 (0.0008) [2023-12-28 03:55:27,378][106226] Updated weights for policy 0, policy_version 1205869 (0.0005) [2023-12-28 03:55:27,411][106225] Updated weights for policy 1, policy_version 1208897 (0.0007) [2023-12-28 03:55:27,423][106226] Updated weights for policy 0, policy_version 1205879 (0.0005) [2023-12-28 03:55:28,070][106226] Updated weights for policy 0, policy_version 1205889 (0.0008) [2023-12-28 03:55:28,119][106226] Updated weights for policy 0, policy_version 1205899 (0.0008) [2023-12-28 03:55:28,154][106225] Updated weights for policy 1, policy_version 1208907 (0.0007) [2023-12-28 03:55:28,168][106226] Updated weights for policy 0, policy_version 1205909 (0.0007) [2023-12-28 03:55:28,206][106225] Updated weights for policy 1, policy_version 1208917 (0.0007) [2023-12-28 03:55:28,265][106225] Updated weights for policy 1, policy_version 1208927 (0.0006) [2023-12-28 03:55:28,855][106225] Updated weights for policy 1, policy_version 1208937 (0.0010) [2023-12-28 03:55:28,912][106226] Updated weights for policy 0, policy_version 1205919 (0.0009) [2023-12-28 03:55:28,916][106225] Updated weights for policy 1, policy_version 1208947 (0.0006) [2023-12-28 03:55:28,970][106225] Updated weights for policy 1, policy_version 1208957 (0.0005) [2023-12-28 03:55:28,970][106226] Updated weights for policy 0, policy_version 1205929 (0.0010) [2023-12-28 03:55:29,030][106226] Updated weights for policy 0, policy_version 1205939 (0.0010) [2023-12-28 03:55:29,031][106225] Updated weights for policy 1, policy_version 1208967 (0.0005) [2023-12-28 03:55:29,635][106225] Updated weights for policy 1, policy_version 1208977 (0.0006) [2023-12-28 03:55:29,702][106225] Updated weights for policy 1, policy_version 1208987 (0.0010) [2023-12-28 03:55:29,741][106226] Updated weights for policy 0, policy_version 1205949 (0.0008) [2023-12-28 03:55:29,761][106225] Updated weights for policy 1, policy_version 1208997 (0.0010) [2023-12-28 03:55:29,802][106226] Updated weights for policy 0, policy_version 1205959 (0.0006) [2023-12-28 03:55:29,865][106226] Updated weights for policy 0, policy_version 1205969 (0.0008) [2023-12-28 03:55:30,484][106225] Updated weights for policy 1, policy_version 1209007 (0.0011) [2023-12-28 03:55:30,541][106226] Updated weights for policy 0, policy_version 1205979 (0.0007) [2023-12-28 03:55:30,548][106225] Updated weights for policy 1, policy_version 1209017 (0.0010) [2023-12-28 03:55:30,590][106226] Updated weights for policy 0, policy_version 1205989 (0.0005) [2023-12-28 03:55:30,608][106225] Updated weights for policy 1, policy_version 1209027 (0.0010) [2023-12-28 03:55:30,642][106226] Updated weights for policy 0, policy_version 1205999 (0.0005) [2023-12-28 03:55:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 618356736. Throughput: 0: 9864.4, 1: 9964.4. Samples: 618347768. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:31,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-4.983')] [2023-12-28 03:55:31,300][106225] Updated weights for policy 1, policy_version 1209037 (0.0010) [2023-12-28 03:55:31,367][106225] Updated weights for policy 1, policy_version 1209047 (0.0009) [2023-12-28 03:55:31,395][106226] Updated weights for policy 0, policy_version 1206009 (0.0006) [2023-12-28 03:55:31,435][106225] Updated weights for policy 1, policy_version 1209057 (0.0009) [2023-12-28 03:55:31,462][106226] Updated weights for policy 0, policy_version 1206019 (0.0009) [2023-12-28 03:55:31,526][106226] Updated weights for policy 0, policy_version 1206029 (0.0009) [2023-12-28 03:55:31,590][106226] Updated weights for policy 0, policy_version 1206039 (0.0009) [2023-12-28 03:55:32,226][106225] Updated weights for policy 1, policy_version 1209067 (0.0008) [2023-12-28 03:55:32,291][106225] Updated weights for policy 1, policy_version 1209077 (0.0010) [2023-12-28 03:55:32,346][106225] Updated weights for policy 1, policy_version 1209087 (0.0009) [2023-12-28 03:55:32,348][106226] Updated weights for policy 0, policy_version 1206049 (0.0006) [2023-12-28 03:55:32,419][106226] Updated weights for policy 0, policy_version 1206059 (0.0009) [2023-12-28 03:55:32,478][106226] Updated weights for policy 0, policy_version 1206069 (0.0009) [2023-12-28 03:55:33,071][106225] Updated weights for policy 1, policy_version 1209097 (0.0008) [2023-12-28 03:55:33,132][106225] Updated weights for policy 1, policy_version 1209107 (0.0005) [2023-12-28 03:55:33,146][106226] Updated weights for policy 0, policy_version 1206079 (0.0010) [2023-12-28 03:55:33,185][106225] Updated weights for policy 1, policy_version 1209117 (0.0005) [2023-12-28 03:55:33,205][106226] Updated weights for policy 0, policy_version 1206089 (0.0010) [2023-12-28 03:55:33,251][106225] Updated weights for policy 1, policy_version 1209127 (0.0005) [2023-12-28 03:55:33,268][106226] Updated weights for policy 0, policy_version 1206099 (0.0010) [2023-12-28 03:55:33,888][106225] Updated weights for policy 1, policy_version 1209137 (0.0008) [2023-12-28 03:55:33,934][106225] Updated weights for policy 1, policy_version 1209147 (0.0008) [2023-12-28 03:55:33,954][106226] Updated weights for policy 0, policy_version 1206109 (0.0010) [2023-12-28 03:55:33,987][106225] Updated weights for policy 1, policy_version 1209157 (0.0006) [2023-12-28 03:55:34,014][106226] Updated weights for policy 0, policy_version 1206119 (0.0010) [2023-12-28 03:55:34,079][106226] Updated weights for policy 0, policy_version 1206129 (0.0010) [2023-12-28 03:55:34,725][106226] Updated weights for policy 0, policy_version 1206139 (0.0010) [2023-12-28 03:55:34,729][106225] Updated weights for policy 1, policy_version 1209167 (0.0008) [2023-12-28 03:55:34,783][106226] Updated weights for policy 0, policy_version 1206149 (0.0011) [2023-12-28 03:55:34,785][106225] Updated weights for policy 1, policy_version 1209177 (0.0007) [2023-12-28 03:55:34,843][106225] Updated weights for policy 1, policy_version 1209187 (0.0008) [2023-12-28 03:55:34,844][106226] Updated weights for policy 0, policy_version 1206159 (0.0011) [2023-12-28 03:55:35,463][106226] Updated weights for policy 0, policy_version 1206169 (0.0007) [2023-12-28 03:55:35,523][106226] Updated weights for policy 0, policy_version 1206179 (0.0007) [2023-12-28 03:55:35,591][106226] Updated weights for policy 0, policy_version 1206189 (0.0010) [2023-12-28 03:55:35,601][106225] Updated weights for policy 1, policy_version 1209197 (0.0006) [2023-12-28 03:55:35,639][106226] Updated weights for policy 0, policy_version 1206199 (0.0008) [2023-12-28 03:55:35,661][106225] Updated weights for policy 1, policy_version 1209207 (0.0008) [2023-12-28 03:55:35,729][106225] Updated weights for policy 1, policy_version 1209217 (0.0008) [2023-12-28 03:55:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 618455040. Throughput: 0: 9899.5, 1: 9905.8. Samples: 618467228. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:36,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.758')] [2023-12-28 03:55:36,213][106226] Updated weights for policy 0, policy_version 1206209 (0.0010) [2023-12-28 03:55:36,277][106226] Updated weights for policy 0, policy_version 1206219 (0.0008) [2023-12-28 03:55:36,343][106226] Updated weights for policy 0, policy_version 1206229 (0.0008) [2023-12-28 03:55:36,514][106225] Updated weights for policy 1, policy_version 1209227 (0.0010) [2023-12-28 03:55:36,579][106225] Updated weights for policy 1, policy_version 1209237 (0.0011) [2023-12-28 03:55:36,642][106225] Updated weights for policy 1, policy_version 1209247 (0.0011) [2023-12-28 03:55:37,067][106226] Updated weights for policy 0, policy_version 1206239 (0.0007) [2023-12-28 03:55:37,112][106226] Updated weights for policy 0, policy_version 1206249 (0.0007) [2023-12-28 03:55:37,163][106226] Updated weights for policy 0, policy_version 1206259 (0.0008) [2023-12-28 03:55:37,341][106225] Updated weights for policy 1, policy_version 1209257 (0.0011) [2023-12-28 03:55:37,394][106225] Updated weights for policy 1, policy_version 1209267 (0.0010) [2023-12-28 03:55:37,455][106225] Updated weights for policy 1, policy_version 1209277 (0.0008) [2023-12-28 03:55:37,512][106225] Updated weights for policy 1, policy_version 1209287 (0.0005) [2023-12-28 03:55:37,916][106226] Updated weights for policy 0, policy_version 1206269 (0.0011) [2023-12-28 03:55:37,971][106226] Updated weights for policy 0, policy_version 1206279 (0.0009) [2023-12-28 03:55:38,024][106226] Updated weights for policy 0, policy_version 1206289 (0.0009) [2023-12-28 03:55:38,058][106225] Updated weights for policy 1, policy_version 1209297 (0.0010) [2023-12-28 03:55:38,118][106225] Updated weights for policy 1, policy_version 1209307 (0.0009) [2023-12-28 03:55:38,183][106225] Updated weights for policy 1, policy_version 1209317 (0.0007) [2023-12-28 03:55:38,730][106226] Updated weights for policy 0, policy_version 1206299 (0.0009) [2023-12-28 03:55:38,788][106226] Updated weights for policy 0, policy_version 1206309 (0.0008) [2023-12-28 03:55:38,843][106226] Updated weights for policy 0, policy_version 1206319 (0.0008) [2023-12-28 03:55:38,881][106225] Updated weights for policy 1, policy_version 1209327 (0.0006) [2023-12-28 03:55:38,934][106225] Updated weights for policy 1, policy_version 1209337 (0.0008) [2023-12-28 03:55:38,990][106225] Updated weights for policy 1, policy_version 1209347 (0.0008) [2023-12-28 03:55:39,554][106226] Updated weights for policy 0, policy_version 1206329 (0.0007) [2023-12-28 03:55:39,617][106226] Updated weights for policy 0, policy_version 1206339 (0.0008) [2023-12-28 03:55:39,680][106226] Updated weights for policy 0, policy_version 1206349 (0.0008) [2023-12-28 03:55:39,743][106226] Updated weights for policy 0, policy_version 1206359 (0.0008) [2023-12-28 03:55:39,799][106225] Updated weights for policy 1, policy_version 1209357 (0.0008) [2023-12-28 03:55:39,868][106225] Updated weights for policy 1, policy_version 1209367 (0.0008) [2023-12-28 03:55:39,938][106225] Updated weights for policy 1, policy_version 1209377 (0.0010) [2023-12-28 03:55:40,494][106226] Updated weights for policy 0, policy_version 1206369 (0.0009) [2023-12-28 03:55:40,553][106226] Updated weights for policy 0, policy_version 1206379 (0.0009) [2023-12-28 03:55:40,601][106226] Updated weights for policy 0, policy_version 1206389 (0.0006) [2023-12-28 03:55:40,636][106225] Updated weights for policy 1, policy_version 1209387 (0.0009) [2023-12-28 03:55:40,690][106225] Updated weights for policy 1, policy_version 1209397 (0.0010) [2023-12-28 03:55:40,744][106225] Updated weights for policy 1, policy_version 1209407 (0.0010) [2023-12-28 03:55:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 618553344. Throughput: 0: 9872.4, 1: 9895.9. Samples: 618526020. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:41,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.242')] [2023-12-28 03:55:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001209416_309657600.pth... [2023-12-28 03:55:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001206392_308895744.pth... [2023-12-28 03:55:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001205240_308600832.pth [2023-12-28 03:55:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001208264_309362688.pth [2023-12-28 03:55:41,321][106226] Updated weights for policy 0, policy_version 1206399 (0.0008) [2023-12-28 03:55:41,391][106226] Updated weights for policy 0, policy_version 1206409 (0.0008) [2023-12-28 03:55:41,454][106226] Updated weights for policy 0, policy_version 1206419 (0.0006) [2023-12-28 03:55:41,529][106225] Updated weights for policy 1, policy_version 1209417 (0.0010) [2023-12-28 03:55:41,581][106225] Updated weights for policy 1, policy_version 1209427 (0.0010) [2023-12-28 03:55:41,645][106225] Updated weights for policy 1, policy_version 1209437 (0.0010) [2023-12-28 03:55:41,710][106225] Updated weights for policy 1, policy_version 1209447 (0.0009) [2023-12-28 03:55:42,185][106226] Updated weights for policy 0, policy_version 1206429 (0.0007) [2023-12-28 03:55:42,245][106226] Updated weights for policy 0, policy_version 1206439 (0.0011) [2023-12-28 03:55:42,311][106226] Updated weights for policy 0, policy_version 1206449 (0.0008) [2023-12-28 03:55:42,445][106225] Updated weights for policy 1, policy_version 1209457 (0.0010) [2023-12-28 03:55:42,492][106225] Updated weights for policy 1, policy_version 1209467 (0.0010) [2023-12-28 03:55:42,539][106225] Updated weights for policy 1, policy_version 1209477 (0.0010) [2023-12-28 03:55:42,993][106226] Updated weights for policy 0, policy_version 1206459 (0.0008) [2023-12-28 03:55:43,056][106226] Updated weights for policy 0, policy_version 1206469 (0.0005) [2023-12-28 03:55:43,119][106226] Updated weights for policy 0, policy_version 1206479 (0.0008) [2023-12-28 03:55:43,199][106225] Updated weights for policy 1, policy_version 1209487 (0.0009) [2023-12-28 03:55:43,260][106225] Updated weights for policy 1, policy_version 1209497 (0.0005) [2023-12-28 03:55:43,330][106225] Updated weights for policy 1, policy_version 1209507 (0.0007) [2023-12-28 03:55:43,779][106226] Updated weights for policy 0, policy_version 1206489 (0.0009) [2023-12-28 03:55:43,829][106226] Updated weights for policy 0, policy_version 1206499 (0.0009) [2023-12-28 03:55:43,879][106226] Updated weights for policy 0, policy_version 1206509 (0.0009) [2023-12-28 03:55:43,935][106226] Updated weights for policy 0, policy_version 1206519 (0.0008) [2023-12-28 03:55:43,941][106225] Updated weights for policy 1, policy_version 1209517 (0.0008) [2023-12-28 03:55:43,994][106225] Updated weights for policy 1, policy_version 1209527 (0.0006) [2023-12-28 03:55:44,043][106225] Updated weights for policy 1, policy_version 1209537 (0.0005) [2023-12-28 03:55:44,660][106226] Updated weights for policy 0, policy_version 1206529 (0.0007) [2023-12-28 03:55:44,662][106225] Updated weights for policy 1, policy_version 1209547 (0.0007) [2023-12-28 03:55:44,707][106226] Updated weights for policy 0, policy_version 1206539 (0.0005) [2023-12-28 03:55:44,710][106225] Updated weights for policy 1, policy_version 1209557 (0.0010) [2023-12-28 03:55:44,764][106226] Updated weights for policy 0, policy_version 1206549 (0.0006) [2023-12-28 03:55:44,770][106225] Updated weights for policy 1, policy_version 1209567 (0.0010) [2023-12-28 03:55:45,555][106226] Updated weights for policy 0, policy_version 1206559 (0.0008) [2023-12-28 03:55:45,564][106225] Updated weights for policy 1, policy_version 1209577 (0.0008) [2023-12-28 03:55:45,609][106226] Updated weights for policy 0, policy_version 1206569 (0.0007) [2023-12-28 03:55:45,623][106225] Updated weights for policy 1, policy_version 1209587 (0.0008) [2023-12-28 03:55:45,663][106226] Updated weights for policy 0, policy_version 1206579 (0.0006) [2023-12-28 03:55:45,678][106225] Updated weights for policy 1, policy_version 1209597 (0.0008) [2023-12-28 03:55:45,744][106225] Updated weights for policy 1, policy_version 1209607 (0.0006) [2023-12-28 03:55:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 618651648. Throughput: 0: 9818.7, 1: 9842.6. Samples: 618643972. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:46,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-4.904')] [2023-12-28 03:55:46,313][106225] Updated weights for policy 1, policy_version 1209617 (0.0008) [2023-12-28 03:55:46,372][106225] Updated weights for policy 1, policy_version 1209627 (0.0008) [2023-12-28 03:55:46,431][106225] Updated weights for policy 1, policy_version 1209637 (0.0008) [2023-12-28 03:55:46,447][106226] Updated weights for policy 0, policy_version 1206589 (0.0008) [2023-12-28 03:55:46,508][106226] Updated weights for policy 0, policy_version 1206599 (0.0008) [2023-12-28 03:55:46,563][106226] Updated weights for policy 0, policy_version 1206609 (0.0008) [2023-12-28 03:55:47,081][106225] Updated weights for policy 1, policy_version 1209647 (0.0007) [2023-12-28 03:55:47,141][106225] Updated weights for policy 1, policy_version 1209657 (0.0006) [2023-12-28 03:55:47,203][106225] Updated weights for policy 1, policy_version 1209667 (0.0005) [2023-12-28 03:55:47,347][106226] Updated weights for policy 0, policy_version 1206619 (0.0009) [2023-12-28 03:55:47,407][106226] Updated weights for policy 0, policy_version 1206629 (0.0008) [2023-12-28 03:55:47,465][106226] Updated weights for policy 0, policy_version 1206639 (0.0008) [2023-12-28 03:55:47,851][106225] Updated weights for policy 1, policy_version 1209677 (0.0008) [2023-12-28 03:55:47,910][106225] Updated weights for policy 1, policy_version 1209687 (0.0009) [2023-12-28 03:55:47,966][106225] Updated weights for policy 1, policy_version 1209697 (0.0008) [2023-12-28 03:55:48,199][106226] Updated weights for policy 0, policy_version 1206649 (0.0009) [2023-12-28 03:55:48,262][106226] Updated weights for policy 0, policy_version 1206659 (0.0008) [2023-12-28 03:55:48,322][106226] Updated weights for policy 0, policy_version 1206669 (0.0008) [2023-12-28 03:55:48,386][106226] Updated weights for policy 0, policy_version 1206679 (0.0007) [2023-12-28 03:55:48,708][106225] Updated weights for policy 1, policy_version 1209707 (0.0008) [2023-12-28 03:55:48,762][106225] Updated weights for policy 1, policy_version 1209717 (0.0008) [2023-12-28 03:55:48,813][106225] Updated weights for policy 1, policy_version 1209727 (0.0007) [2023-12-28 03:55:49,005][106226] Updated weights for policy 0, policy_version 1206689 (0.0009) [2023-12-28 03:55:49,069][106226] Updated weights for policy 0, policy_version 1206699 (0.0011) [2023-12-28 03:55:49,126][106226] Updated weights for policy 0, policy_version 1206709 (0.0009) [2023-12-28 03:55:49,607][106225] Updated weights for policy 1, policy_version 1209737 (0.0009) [2023-12-28 03:55:49,671][106225] Updated weights for policy 1, policy_version 1209747 (0.0008) [2023-12-28 03:55:49,728][106225] Updated weights for policy 1, policy_version 1209757 (0.0007) [2023-12-28 03:55:49,786][106225] Updated weights for policy 1, policy_version 1209767 (0.0008) [2023-12-28 03:55:49,846][106226] Updated weights for policy 0, policy_version 1206719 (0.0009) [2023-12-28 03:55:49,914][106226] Updated weights for policy 0, policy_version 1206729 (0.0008) [2023-12-28 03:55:49,983][106226] Updated weights for policy 0, policy_version 1206739 (0.0009) [2023-12-28 03:55:50,549][106225] Updated weights for policy 1, policy_version 1209777 (0.0008) [2023-12-28 03:55:50,632][106225] Updated weights for policy 1, policy_version 1209787 (0.0009) [2023-12-28 03:55:50,683][106226] Updated weights for policy 0, policy_version 1206749 (0.0007) [2023-12-28 03:55:50,687][106225] Updated weights for policy 1, policy_version 1209797 (0.0008) [2023-12-28 03:55:50,748][106226] Updated weights for policy 0, policy_version 1206759 (0.0007) [2023-12-28 03:55:50,814][106226] Updated weights for policy 0, policy_version 1206769 (0.0007) [2023-12-28 03:55:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 618749952. Throughput: 0: 9752.9, 1: 9839.1. Samples: 618759440. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:51,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-5.031')] [2023-12-28 03:55:51,501][106225] Updated weights for policy 1, policy_version 1209807 (0.0008) [2023-12-28 03:55:51,517][106226] Updated weights for policy 0, policy_version 1206779 (0.0009) [2023-12-28 03:55:51,562][106225] Updated weights for policy 1, policy_version 1209817 (0.0006) [2023-12-28 03:55:51,568][106226] Updated weights for policy 0, policy_version 1206789 (0.0010) [2023-12-28 03:55:51,620][106225] Updated weights for policy 1, policy_version 1209827 (0.0006) [2023-12-28 03:55:51,631][106226] Updated weights for policy 0, policy_version 1206799 (0.0011) [2023-12-28 03:55:52,363][106226] Updated weights for policy 0, policy_version 1206809 (0.0010) [2023-12-28 03:55:52,383][106225] Updated weights for policy 1, policy_version 1209837 (0.0008) [2023-12-28 03:55:52,429][106226] Updated weights for policy 0, policy_version 1206819 (0.0007) [2023-12-28 03:55:52,445][106225] Updated weights for policy 1, policy_version 1209847 (0.0007) [2023-12-28 03:55:52,497][106226] Updated weights for policy 0, policy_version 1206829 (0.0008) [2023-12-28 03:55:52,506][106225] Updated weights for policy 1, policy_version 1209857 (0.0006) [2023-12-28 03:55:52,551][106226] Updated weights for policy 0, policy_version 1206839 (0.0008) [2023-12-28 03:55:53,138][106225] Updated weights for policy 1, policy_version 1209867 (0.0007) [2023-12-28 03:55:53,200][106225] Updated weights for policy 1, policy_version 1209877 (0.0008) [2023-12-28 03:55:53,219][106226] Updated weights for policy 0, policy_version 1206849 (0.0006) [2023-12-28 03:55:53,264][106225] Updated weights for policy 1, policy_version 1209887 (0.0008) [2023-12-28 03:55:53,273][106226] Updated weights for policy 0, policy_version 1206859 (0.0005) [2023-12-28 03:55:53,319][106226] Updated weights for policy 0, policy_version 1206869 (0.0005) [2023-12-28 03:55:53,943][106226] Updated weights for policy 0, policy_version 1206879 (0.0007) [2023-12-28 03:55:53,989][106226] Updated weights for policy 0, policy_version 1206889 (0.0009) [2023-12-28 03:55:54,015][106225] Updated weights for policy 1, policy_version 1209897 (0.0008) [2023-12-28 03:55:54,045][106226] Updated weights for policy 0, policy_version 1206899 (0.0006) [2023-12-28 03:55:54,071][106225] Updated weights for policy 1, policy_version 1209907 (0.0007) [2023-12-28 03:55:54,133][106225] Updated weights for policy 1, policy_version 1209917 (0.0009) [2023-12-28 03:55:54,189][106225] Updated weights for policy 1, policy_version 1209927 (0.0008) [2023-12-28 03:55:54,770][106226] Updated weights for policy 0, policy_version 1206909 (0.0007) [2023-12-28 03:55:54,828][106226] Updated weights for policy 0, policy_version 1206919 (0.0007) [2023-12-28 03:55:54,885][106226] Updated weights for policy 0, policy_version 1206929 (0.0011) [2023-12-28 03:55:54,938][106225] Updated weights for policy 1, policy_version 1209937 (0.0007) [2023-12-28 03:55:54,997][106225] Updated weights for policy 1, policy_version 1209947 (0.0008) [2023-12-28 03:55:55,058][106225] Updated weights for policy 1, policy_version 1209957 (0.0007) [2023-12-28 03:55:55,595][106226] Updated weights for policy 0, policy_version 1206939 (0.0010) [2023-12-28 03:55:55,654][106226] Updated weights for policy 0, policy_version 1206949 (0.0008) [2023-12-28 03:55:55,714][106226] Updated weights for policy 0, policy_version 1206959 (0.0009) [2023-12-28 03:55:55,764][106225] Updated weights for policy 1, policy_version 1209967 (0.0009) [2023-12-28 03:55:55,813][106225] Updated weights for policy 1, policy_version 1209977 (0.0009) [2023-12-28 03:55:55,862][106225] Updated weights for policy 1, policy_version 1209987 (0.0008) [2023-12-28 03:55:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 618848256. Throughput: 0: 9759.8, 1: 9848.0. Samples: 618817748. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:55:56,175][105115] Avg episode reward: [(0, '-4.271'), (1, '-4.901')] [2023-12-28 03:55:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001206968_309043200.pth... [2023-12-28 03:55:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001209992_309805056.pth... [2023-12-28 03:55:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001205816_308748288.pth [2023-12-28 03:55:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001208840_309510144.pth [2023-12-28 03:55:56,400][106226] Updated weights for policy 0, policy_version 1206969 (0.0007) [2023-12-28 03:55:56,457][106226] Updated weights for policy 0, policy_version 1206979 (0.0005) [2023-12-28 03:55:56,508][106226] Updated weights for policy 0, policy_version 1206989 (0.0005) [2023-12-28 03:55:56,553][106226] Updated weights for policy 0, policy_version 1206999 (0.0005) [2023-12-28 03:55:56,647][106225] Updated weights for policy 1, policy_version 1209997 (0.0009) [2023-12-28 03:55:56,694][106225] Updated weights for policy 1, policy_version 1210007 (0.0008) [2023-12-28 03:55:56,738][106225] Updated weights for policy 1, policy_version 1210017 (0.0008) [2023-12-28 03:55:57,129][106226] Updated weights for policy 0, policy_version 1207009 (0.0009) [2023-12-28 03:55:57,192][106226] Updated weights for policy 0, policy_version 1207019 (0.0009) [2023-12-28 03:55:57,241][106226] Updated weights for policy 0, policy_version 1207029 (0.0008) [2023-12-28 03:55:57,521][106225] Updated weights for policy 1, policy_version 1210027 (0.0009) [2023-12-28 03:55:57,581][106225] Updated weights for policy 1, policy_version 1210037 (0.0008) [2023-12-28 03:55:57,629][106225] Updated weights for policy 1, policy_version 1210047 (0.0008) [2023-12-28 03:55:57,962][106226] Updated weights for policy 0, policy_version 1207039 (0.0008) [2023-12-28 03:55:58,019][106226] Updated weights for policy 0, policy_version 1207049 (0.0008) [2023-12-28 03:55:58,077][106226] Updated weights for policy 0, policy_version 1207059 (0.0008) [2023-12-28 03:55:58,358][106225] Updated weights for policy 1, policy_version 1210057 (0.0009) [2023-12-28 03:55:58,425][106225] Updated weights for policy 1, policy_version 1210067 (0.0008) [2023-12-28 03:55:58,487][106225] Updated weights for policy 1, policy_version 1210077 (0.0008) [2023-12-28 03:55:58,545][106225] Updated weights for policy 1, policy_version 1210087 (0.0008) [2023-12-28 03:55:58,845][106226] Updated weights for policy 0, policy_version 1207069 (0.0008) [2023-12-28 03:55:58,920][106226] Updated weights for policy 0, policy_version 1207079 (0.0008) [2023-12-28 03:55:58,987][106226] Updated weights for policy 0, policy_version 1207089 (0.0008) [2023-12-28 03:55:59,338][106225] Updated weights for policy 1, policy_version 1210097 (0.0008) [2023-12-28 03:55:59,408][106225] Updated weights for policy 1, policy_version 1210107 (0.0008) [2023-12-28 03:55:59,471][106225] Updated weights for policy 1, policy_version 1210117 (0.0007) [2023-12-28 03:55:59,744][106226] Updated weights for policy 0, policy_version 1207099 (0.0007) [2023-12-28 03:55:59,800][106226] Updated weights for policy 0, policy_version 1207109 (0.0005) [2023-12-28 03:55:59,866][106226] Updated weights for policy 0, policy_version 1207119 (0.0007) [2023-12-28 03:56:00,249][106225] Updated weights for policy 1, policy_version 1210127 (0.0008) [2023-12-28 03:56:00,308][106225] Updated weights for policy 1, policy_version 1210137 (0.0008) [2023-12-28 03:56:00,370][106225] Updated weights for policy 1, policy_version 1210147 (0.0009) [2023-12-28 03:56:00,533][106226] Updated weights for policy 0, policy_version 1207129 (0.0006) [2023-12-28 03:56:00,590][106226] Updated weights for policy 0, policy_version 1207139 (0.0005) [2023-12-28 03:56:00,643][106226] Updated weights for policy 0, policy_version 1207149 (0.0005) [2023-12-28 03:56:00,700][106226] Updated weights for policy 0, policy_version 1207159 (0.0005) [2023-12-28 03:56:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 618938368. Throughput: 0: 9837.4, 1: 9775.2. Samples: 618932472. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:01,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.972')] [2023-12-28 03:56:01,194][106225] Updated weights for policy 1, policy_version 1210157 (0.0008) [2023-12-28 03:56:01,263][106225] Updated weights for policy 1, policy_version 1210167 (0.0008) [2023-12-28 03:56:01,296][106226] Updated weights for policy 0, policy_version 1207169 (0.0007) [2023-12-28 03:56:01,334][106225] Updated weights for policy 1, policy_version 1210177 (0.0008) [2023-12-28 03:56:01,357][106226] Updated weights for policy 0, policy_version 1207179 (0.0008) [2023-12-28 03:56:01,418][106226] Updated weights for policy 0, policy_version 1207189 (0.0010) [2023-12-28 03:56:02,031][106225] Updated weights for policy 1, policy_version 1210187 (0.0008) [2023-12-28 03:56:02,082][106225] Updated weights for policy 1, policy_version 1210197 (0.0009) [2023-12-28 03:56:02,141][106225] Updated weights for policy 1, policy_version 1210207 (0.0009) [2023-12-28 03:56:02,174][106226] Updated weights for policy 0, policy_version 1207199 (0.0008) [2023-12-28 03:56:02,228][106226] Updated weights for policy 0, policy_version 1207209 (0.0008) [2023-12-28 03:56:02,290][106226] Updated weights for policy 0, policy_version 1207219 (0.0009) [2023-12-28 03:56:02,859][106225] Updated weights for policy 1, policy_version 1210217 (0.0006) [2023-12-28 03:56:02,915][106225] Updated weights for policy 1, policy_version 1210227 (0.0008) [2023-12-28 03:56:02,960][106226] Updated weights for policy 0, policy_version 1207229 (0.0010) [2023-12-28 03:56:02,976][106225] Updated weights for policy 1, policy_version 1210237 (0.0007) [2023-12-28 03:56:03,016][106226] Updated weights for policy 0, policy_version 1207239 (0.0010) [2023-12-28 03:56:03,034][106225] Updated weights for policy 1, policy_version 1210247 (0.0007) [2023-12-28 03:56:03,070][106226] Updated weights for policy 0, policy_version 1207249 (0.0010) [2023-12-28 03:56:03,706][106226] Updated weights for policy 0, policy_version 1207259 (0.0010) [2023-12-28 03:56:03,761][106226] Updated weights for policy 0, policy_version 1207269 (0.0010) [2023-12-28 03:56:03,807][106225] Updated weights for policy 1, policy_version 1210257 (0.0006) [2023-12-28 03:56:03,810][106226] Updated weights for policy 0, policy_version 1207279 (0.0006) [2023-12-28 03:56:03,877][106225] Updated weights for policy 1, policy_version 1210267 (0.0008) [2023-12-28 03:56:03,939][106225] Updated weights for policy 1, policy_version 1210277 (0.0008) [2023-12-28 03:56:04,563][106226] Updated weights for policy 0, policy_version 1207289 (0.0008) [2023-12-28 03:56:04,617][106226] Updated weights for policy 0, policy_version 1207299 (0.0006) [2023-12-28 03:56:04,680][106226] Updated weights for policy 0, policy_version 1207309 (0.0011) [2023-12-28 03:56:04,712][106225] Updated weights for policy 1, policy_version 1210287 (0.0006) [2023-12-28 03:56:04,731][106226] Updated weights for policy 0, policy_version 1207319 (0.0010) [2023-12-28 03:56:04,764][106225] Updated weights for policy 1, policy_version 1210297 (0.0005) [2023-12-28 03:56:04,822][106225] Updated weights for policy 1, policy_version 1210307 (0.0005) [2023-12-28 03:56:05,439][106226] Updated weights for policy 0, policy_version 1207329 (0.0010) [2023-12-28 03:56:05,456][106225] Updated weights for policy 1, policy_version 1210317 (0.0006) [2023-12-28 03:56:05,492][106226] Updated weights for policy 0, policy_version 1207339 (0.0010) [2023-12-28 03:56:05,516][106225] Updated weights for policy 1, policy_version 1210327 (0.0005) [2023-12-28 03:56:05,545][106226] Updated weights for policy 0, policy_version 1207349 (0.0010) [2023-12-28 03:56:05,570][106225] Updated weights for policy 1, policy_version 1210337 (0.0005) [2023-12-28 03:56:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 619036672. Throughput: 0: 9806.2, 1: 9691.3. Samples: 619049512. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:06,178][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.674')] [2023-12-28 03:56:06,261][106226] Updated weights for policy 0, policy_version 1207359 (0.0011) [2023-12-28 03:56:06,286][106225] Updated weights for policy 1, policy_version 1210347 (0.0007) [2023-12-28 03:56:06,324][106226] Updated weights for policy 0, policy_version 1207369 (0.0009) [2023-12-28 03:56:06,356][106225] Updated weights for policy 1, policy_version 1210357 (0.0006) [2023-12-28 03:56:06,388][106226] Updated weights for policy 0, policy_version 1207379 (0.0006) [2023-12-28 03:56:06,418][106225] Updated weights for policy 1, policy_version 1210367 (0.0006) [2023-12-28 03:56:07,056][106225] Updated weights for policy 1, policy_version 1210377 (0.0008) [2023-12-28 03:56:07,086][106226] Updated weights for policy 0, policy_version 1207389 (0.0009) [2023-12-28 03:56:07,119][106225] Updated weights for policy 1, policy_version 1210387 (0.0008) [2023-12-28 03:56:07,141][106226] Updated weights for policy 0, policy_version 1207399 (0.0009) [2023-12-28 03:56:07,178][106225] Updated weights for policy 1, policy_version 1210397 (0.0005) [2023-12-28 03:56:07,203][106226] Updated weights for policy 0, policy_version 1207409 (0.0008) [2023-12-28 03:56:07,235][106225] Updated weights for policy 1, policy_version 1210407 (0.0006) [2023-12-28 03:56:07,781][106225] Updated weights for policy 1, policy_version 1210417 (0.0007) [2023-12-28 03:56:07,829][106225] Updated weights for policy 1, policy_version 1210427 (0.0008) [2023-12-28 03:56:07,846][106226] Updated weights for policy 0, policy_version 1207419 (0.0009) [2023-12-28 03:56:07,888][106225] Updated weights for policy 1, policy_version 1210437 (0.0008) [2023-12-28 03:56:07,905][106226] Updated weights for policy 0, policy_version 1207429 (0.0006) [2023-12-28 03:56:07,963][106226] Updated weights for policy 0, policy_version 1207439 (0.0005) [2023-12-28 03:56:08,678][106226] Updated weights for policy 0, policy_version 1207449 (0.0007) [2023-12-28 03:56:08,681][106225] Updated weights for policy 1, policy_version 1210447 (0.0007) [2023-12-28 03:56:08,738][106226] Updated weights for policy 0, policy_version 1207459 (0.0007) [2023-12-28 03:56:08,740][106225] Updated weights for policy 1, policy_version 1210457 (0.0005) [2023-12-28 03:56:08,791][106226] Updated weights for policy 0, policy_version 1207469 (0.0007) [2023-12-28 03:56:08,798][106225] Updated weights for policy 1, policy_version 1210467 (0.0007) [2023-12-28 03:56:08,845][106226] Updated weights for policy 0, policy_version 1207479 (0.0008) [2023-12-28 03:56:09,536][106225] Updated weights for policy 1, policy_version 1210477 (0.0008) [2023-12-28 03:56:09,604][106225] Updated weights for policy 1, policy_version 1210487 (0.0008) [2023-12-28 03:56:09,661][106226] Updated weights for policy 0, policy_version 1207489 (0.0010) [2023-12-28 03:56:09,664][106225] Updated weights for policy 1, policy_version 1210497 (0.0007) [2023-12-28 03:56:09,719][106226] Updated weights for policy 0, policy_version 1207499 (0.0009) [2023-12-28 03:56:09,777][106226] Updated weights for policy 0, policy_version 1207509 (0.0011) [2023-12-28 03:56:10,445][106225] Updated weights for policy 1, policy_version 1210507 (0.0008) [2023-12-28 03:56:10,498][106225] Updated weights for policy 1, policy_version 1210517 (0.0006) [2023-12-28 03:56:10,527][106226] Updated weights for policy 0, policy_version 1207519 (0.0011) [2023-12-28 03:56:10,544][106225] Updated weights for policy 1, policy_version 1210527 (0.0005) [2023-12-28 03:56:10,588][106226] Updated weights for policy 0, policy_version 1207529 (0.0011) [2023-12-28 03:56:10,642][106226] Updated weights for policy 0, policy_version 1207539 (0.0011) [2023-12-28 03:56:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 619134976. Throughput: 0: 9853.9, 1: 9782.7. Samples: 619109716. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:11,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.833')] [2023-12-28 03:56:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001207544_309190656.pth... [2023-12-28 03:56:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001210536_309944320.pth... [2023-12-28 03:56:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001206392_308895744.pth [2023-12-28 03:56:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001209416_309657600.pth [2023-12-28 03:56:11,250][106226] Updated weights for policy 0, policy_version 1207549 (0.0010) [2023-12-28 03:56:11,290][106225] Updated weights for policy 1, policy_version 1210537 (0.0006) [2023-12-28 03:56:11,316][106226] Updated weights for policy 0, policy_version 1207559 (0.0010) [2023-12-28 03:56:11,362][106225] Updated weights for policy 1, policy_version 1210547 (0.0011) [2023-12-28 03:56:11,385][106226] Updated weights for policy 0, policy_version 1207569 (0.0010) [2023-12-28 03:56:11,428][106225] Updated weights for policy 1, policy_version 1210557 (0.0008) [2023-12-28 03:56:11,485][106225] Updated weights for policy 1, policy_version 1210567 (0.0006) [2023-12-28 03:56:12,103][106226] Updated weights for policy 0, policy_version 1207579 (0.0009) [2023-12-28 03:56:12,161][106226] Updated weights for policy 0, policy_version 1207589 (0.0007) [2023-12-28 03:56:12,176][106225] Updated weights for policy 1, policy_version 1210577 (0.0008) [2023-12-28 03:56:12,219][106226] Updated weights for policy 0, policy_version 1207599 (0.0006) [2023-12-28 03:56:12,236][106225] Updated weights for policy 1, policy_version 1210587 (0.0007) [2023-12-28 03:56:12,299][106225] Updated weights for policy 1, policy_version 1210597 (0.0006) [2023-12-28 03:56:12,975][106226] Updated weights for policy 0, policy_version 1207609 (0.0007) [2023-12-28 03:56:13,008][106225] Updated weights for policy 1, policy_version 1210607 (0.0009) [2023-12-28 03:56:13,029][106226] Updated weights for policy 0, policy_version 1207619 (0.0008) [2023-12-28 03:56:13,055][106225] Updated weights for policy 1, policy_version 1210617 (0.0005) [2023-12-28 03:56:13,077][106226] Updated weights for policy 0, policy_version 1207629 (0.0007) [2023-12-28 03:56:13,103][106225] Updated weights for policy 1, policy_version 1210627 (0.0006) [2023-12-28 03:56:13,130][106226] Updated weights for policy 0, policy_version 1207639 (0.0005) [2023-12-28 03:56:13,816][106226] Updated weights for policy 0, policy_version 1207649 (0.0008) [2023-12-28 03:56:13,874][106226] Updated weights for policy 0, policy_version 1207659 (0.0008) [2023-12-28 03:56:13,904][106225] Updated weights for policy 1, policy_version 1210637 (0.0007) [2023-12-28 03:56:13,933][106226] Updated weights for policy 0, policy_version 1207669 (0.0008) [2023-12-28 03:56:13,968][106225] Updated weights for policy 1, policy_version 1210647 (0.0008) [2023-12-28 03:56:14,023][106225] Updated weights for policy 1, policy_version 1210657 (0.0008) [2023-12-28 03:56:14,614][106226] Updated weights for policy 0, policy_version 1207679 (0.0005) [2023-12-28 03:56:14,666][106226] Updated weights for policy 0, policy_version 1207689 (0.0005) [2023-12-28 03:56:14,724][106226] Updated weights for policy 0, policy_version 1207699 (0.0007) [2023-12-28 03:56:14,793][106225] Updated weights for policy 1, policy_version 1210667 (0.0008) [2023-12-28 03:56:14,846][106225] Updated weights for policy 1, policy_version 1210677 (0.0009) [2023-12-28 03:56:14,913][106225] Updated weights for policy 1, policy_version 1210687 (0.0009) [2023-12-28 03:56:15,357][106226] Updated weights for policy 0, policy_version 1207709 (0.0006) [2023-12-28 03:56:15,415][106226] Updated weights for policy 0, policy_version 1207719 (0.0006) [2023-12-28 03:56:15,471][106226] Updated weights for policy 0, policy_version 1207729 (0.0006) [2023-12-28 03:56:15,651][106225] Updated weights for policy 1, policy_version 1210697 (0.0010) [2023-12-28 03:56:15,713][106225] Updated weights for policy 1, policy_version 1210707 (0.0007) [2023-12-28 03:56:15,783][106225] Updated weights for policy 1, policy_version 1210717 (0.0005) [2023-12-28 03:56:15,840][106225] Updated weights for policy 1, policy_version 1210727 (0.0005) [2023-12-28 03:56:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 619233280. Throughput: 0: 9882.8, 1: 9622.2. Samples: 619225496. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:16,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.731')] [2023-12-28 03:56:16,184][106226] Updated weights for policy 0, policy_version 1207739 (0.0006) [2023-12-28 03:56:16,243][106226] Updated weights for policy 0, policy_version 1207749 (0.0007) [2023-12-28 03:56:16,294][106226] Updated weights for policy 0, policy_version 1207759 (0.0008) [2023-12-28 03:56:16,463][106225] Updated weights for policy 1, policy_version 1210737 (0.0010) [2023-12-28 03:56:16,520][106225] Updated weights for policy 1, policy_version 1210747 (0.0010) [2023-12-28 03:56:16,580][106225] Updated weights for policy 1, policy_version 1210757 (0.0010) [2023-12-28 03:56:16,939][106226] Updated weights for policy 0, policy_version 1207769 (0.0008) [2023-12-28 03:56:16,992][106226] Updated weights for policy 0, policy_version 1207779 (0.0006) [2023-12-28 03:56:17,054][106226] Updated weights for policy 0, policy_version 1207789 (0.0006) [2023-12-28 03:56:17,104][106226] Updated weights for policy 0, policy_version 1207799 (0.0005) [2023-12-28 03:56:17,143][106225] Updated weights for policy 1, policy_version 1210767 (0.0009) [2023-12-28 03:56:17,192][106225] Updated weights for policy 1, policy_version 1210777 (0.0009) [2023-12-28 03:56:17,242][106225] Updated weights for policy 1, policy_version 1210787 (0.0010) [2023-12-28 03:56:17,766][106226] Updated weights for policy 0, policy_version 1207809 (0.0008) [2023-12-28 03:56:17,830][106226] Updated weights for policy 0, policy_version 1207819 (0.0008) [2023-12-28 03:56:17,887][106226] Updated weights for policy 0, policy_version 1207829 (0.0007) [2023-12-28 03:56:17,995][106225] Updated weights for policy 1, policy_version 1210797 (0.0008) [2023-12-28 03:56:18,049][106225] Updated weights for policy 1, policy_version 1210807 (0.0007) [2023-12-28 03:56:18,103][106225] Updated weights for policy 1, policy_version 1210817 (0.0010) [2023-12-28 03:56:18,638][106226] Updated weights for policy 0, policy_version 1207839 (0.0008) [2023-12-28 03:56:18,700][106226] Updated weights for policy 0, policy_version 1207849 (0.0008) [2023-12-28 03:56:18,766][106226] Updated weights for policy 0, policy_version 1207859 (0.0008) [2023-12-28 03:56:18,783][106225] Updated weights for policy 1, policy_version 1210827 (0.0010) [2023-12-28 03:56:18,834][106225] Updated weights for policy 1, policy_version 1210837 (0.0010) [2023-12-28 03:56:18,893][106225] Updated weights for policy 1, policy_version 1210847 (0.0010) [2023-12-28 03:56:19,498][106226] Updated weights for policy 0, policy_version 1207869 (0.0008) [2023-12-28 03:56:19,562][106225] Updated weights for policy 1, policy_version 1210857 (0.0005) [2023-12-28 03:56:19,564][106226] Updated weights for policy 0, policy_version 1207879 (0.0010) [2023-12-28 03:56:19,629][106225] Updated weights for policy 1, policy_version 1210867 (0.0006) [2023-12-28 03:56:19,632][106226] Updated weights for policy 0, policy_version 1207889 (0.0011) [2023-12-28 03:56:19,692][106225] Updated weights for policy 1, policy_version 1210877 (0.0007) [2023-12-28 03:56:19,756][106225] Updated weights for policy 1, policy_version 1210887 (0.0010) [2023-12-28 03:56:20,356][106226] Updated weights for policy 0, policy_version 1207899 (0.0011) [2023-12-28 03:56:20,414][106226] Updated weights for policy 0, policy_version 1207909 (0.0011) [2023-12-28 03:56:20,438][106225] Updated weights for policy 1, policy_version 1210897 (0.0010) [2023-12-28 03:56:20,476][106226] Updated weights for policy 0, policy_version 1207919 (0.0011) [2023-12-28 03:56:20,500][106225] Updated weights for policy 1, policy_version 1210907 (0.0011) [2023-12-28 03:56:20,559][106225] Updated weights for policy 1, policy_version 1210917 (0.0010) [2023-12-28 03:56:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19827.5). Total num frames: 619331584. Throughput: 0: 9804.2, 1: 9693.6. Samples: 619344628. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:21,175][105115] Avg episode reward: [(0, '-4.236'), (1, '-4.828')] [2023-12-28 03:56:21,250][106226] Updated weights for policy 0, policy_version 1207929 (0.0010) [2023-12-28 03:56:21,303][106225] Updated weights for policy 1, policy_version 1210927 (0.0012) [2023-12-28 03:56:21,321][106226] Updated weights for policy 0, policy_version 1207939 (0.0011) [2023-12-28 03:56:21,374][106225] Updated weights for policy 1, policy_version 1210937 (0.0012) [2023-12-28 03:56:21,386][106226] Updated weights for policy 0, policy_version 1207949 (0.0010) [2023-12-28 03:56:21,442][106225] Updated weights for policy 1, policy_version 1210947 (0.0008) [2023-12-28 03:56:21,448][106226] Updated weights for policy 0, policy_version 1207959 (0.0008) [2023-12-28 03:56:22,168][106225] Updated weights for policy 1, policy_version 1210957 (0.0008) [2023-12-28 03:56:22,237][106225] Updated weights for policy 1, policy_version 1210967 (0.0006) [2023-12-28 03:56:22,269][106226] Updated weights for policy 0, policy_version 1207969 (0.0008) [2023-12-28 03:56:22,302][106225] Updated weights for policy 1, policy_version 1210977 (0.0008) [2023-12-28 03:56:22,334][106226] Updated weights for policy 0, policy_version 1207979 (0.0010) [2023-12-28 03:56:22,406][106226] Updated weights for policy 0, policy_version 1207989 (0.0009) [2023-12-28 03:56:23,031][106225] Updated weights for policy 1, policy_version 1210987 (0.0009) [2023-12-28 03:56:23,091][106225] Updated weights for policy 1, policy_version 1210997 (0.0008) [2023-12-28 03:56:23,143][106226] Updated weights for policy 0, policy_version 1207999 (0.0007) [2023-12-28 03:56:23,153][106225] Updated weights for policy 1, policy_version 1211007 (0.0009) [2023-12-28 03:56:23,192][106226] Updated weights for policy 0, policy_version 1208009 (0.0006) [2023-12-28 03:56:23,241][106226] Updated weights for policy 0, policy_version 1208019 (0.0009) [2023-12-28 03:56:23,721][106225] Updated weights for policy 1, policy_version 1211017 (0.0006) [2023-12-28 03:56:23,783][106225] Updated weights for policy 1, policy_version 1211027 (0.0010) [2023-12-28 03:56:23,833][106225] Updated weights for policy 1, policy_version 1211037 (0.0008) [2023-12-28 03:56:23,895][106225] Updated weights for policy 1, policy_version 1211047 (0.0009) [2023-12-28 03:56:24,054][106226] Updated weights for policy 0, policy_version 1208029 (0.0007) [2023-12-28 03:56:24,119][106226] Updated weights for policy 0, policy_version 1208039 (0.0009) [2023-12-28 03:56:24,174][106226] Updated weights for policy 0, policy_version 1208049 (0.0008) [2023-12-28 03:56:24,613][106225] Updated weights for policy 1, policy_version 1211057 (0.0008) [2023-12-28 03:56:24,677][106225] Updated weights for policy 1, policy_version 1211067 (0.0005) [2023-12-28 03:56:24,733][106225] Updated weights for policy 1, policy_version 1211077 (0.0007) [2023-12-28 03:56:24,921][106226] Updated weights for policy 0, policy_version 1208059 (0.0008) [2023-12-28 03:56:24,978][106226] Updated weights for policy 0, policy_version 1208069 (0.0009) [2023-12-28 03:56:25,038][106226] Updated weights for policy 0, policy_version 1208079 (0.0008) [2023-12-28 03:56:25,415][106225] Updated weights for policy 1, policy_version 1211087 (0.0009) [2023-12-28 03:56:25,466][106225] Updated weights for policy 1, policy_version 1211097 (0.0008) [2023-12-28 03:56:25,511][106225] Updated weights for policy 1, policy_version 1211107 (0.0008) [2023-12-28 03:56:25,736][106226] Updated weights for policy 0, policy_version 1208089 (0.0007) [2023-12-28 03:56:25,796][106226] Updated weights for policy 0, policy_version 1208099 (0.0009) [2023-12-28 03:56:25,853][106226] Updated weights for policy 0, policy_version 1208109 (0.0008) [2023-12-28 03:56:25,912][106226] Updated weights for policy 0, policy_version 1208119 (0.0008) [2023-12-28 03:56:26,175][105115] Fps is (10 sec: 19659.5, 60 sec: 19524.1, 300 sec: 19799.6). Total num frames: 619429888. Throughput: 0: 9764.6, 1: 9685.5. Samples: 619401292. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:26,177][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.731')] [2023-12-28 03:56:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001208120_309338112.pth... [2023-12-28 03:56:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001211112_310091776.pth... [2023-12-28 03:56:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001206968_309043200.pth [2023-12-28 03:56:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001209992_309805056.pth [2023-12-28 03:56:26,235][106225] Updated weights for policy 1, policy_version 1211117 (0.0007) [2023-12-28 03:56:26,292][106225] Updated weights for policy 1, policy_version 1211127 (0.0005) [2023-12-28 03:56:26,354][106225] Updated weights for policy 1, policy_version 1211137 (0.0005) [2023-12-28 03:56:26,715][106226] Updated weights for policy 0, policy_version 1208129 (0.0009) [2023-12-28 03:56:26,770][106226] Updated weights for policy 0, policy_version 1208139 (0.0008) [2023-12-28 03:56:26,823][106226] Updated weights for policy 0, policy_version 1208149 (0.0008) [2023-12-28 03:56:26,883][106225] Updated weights for policy 1, policy_version 1211147 (0.0007) [2023-12-28 03:56:26,939][106225] Updated weights for policy 1, policy_version 1211157 (0.0008) [2023-12-28 03:56:27,004][106225] Updated weights for policy 1, policy_version 1211167 (0.0008) [2023-12-28 03:56:27,536][106226] Updated weights for policy 0, policy_version 1208159 (0.0006) [2023-12-28 03:56:27,589][106226] Updated weights for policy 0, policy_version 1208169 (0.0005) [2023-12-28 03:56:27,649][106226] Updated weights for policy 0, policy_version 1208179 (0.0005) [2023-12-28 03:56:27,675][106225] Updated weights for policy 1, policy_version 1211177 (0.0008) [2023-12-28 03:56:27,733][106225] Updated weights for policy 1, policy_version 1211187 (0.0008) [2023-12-28 03:56:27,793][106225] Updated weights for policy 1, policy_version 1211197 (0.0009) [2023-12-28 03:56:27,842][106225] Updated weights for policy 1, policy_version 1211207 (0.0008) [2023-12-28 03:56:28,188][106226] Updated weights for policy 0, policy_version 1208189 (0.0005) [2023-12-28 03:56:28,234][106226] Updated weights for policy 0, policy_version 1208199 (0.0005) [2023-12-28 03:56:28,280][106226] Updated weights for policy 0, policy_version 1208209 (0.0005) [2023-12-28 03:56:28,567][106225] Updated weights for policy 1, policy_version 1211217 (0.0008) [2023-12-28 03:56:28,633][106225] Updated weights for policy 1, policy_version 1211227 (0.0009) [2023-12-28 03:56:28,689][106225] Updated weights for policy 1, policy_version 1211237 (0.0008) [2023-12-28 03:56:28,992][106226] Updated weights for policy 0, policy_version 1208219 (0.0005) [2023-12-28 03:56:29,061][106226] Updated weights for policy 0, policy_version 1208229 (0.0005) [2023-12-28 03:56:29,135][106226] Updated weights for policy 0, policy_version 1208239 (0.0006) [2023-12-28 03:56:29,361][106225] Updated weights for policy 1, policy_version 1211247 (0.0009) [2023-12-28 03:56:29,419][106225] Updated weights for policy 1, policy_version 1211257 (0.0009) [2023-12-28 03:56:29,475][106225] Updated weights for policy 1, policy_version 1211267 (0.0009) [2023-12-28 03:56:29,761][106226] Updated weights for policy 0, policy_version 1208249 (0.0010) [2023-12-28 03:56:29,827][106226] Updated weights for policy 0, policy_version 1208259 (0.0007) [2023-12-28 03:56:29,887][106226] Updated weights for policy 0, policy_version 1208269 (0.0008) [2023-12-28 03:56:29,955][106226] Updated weights for policy 0, policy_version 1208279 (0.0009) [2023-12-28 03:56:30,160][106225] Updated weights for policy 1, policy_version 1211277 (0.0009) [2023-12-28 03:56:30,223][106225] Updated weights for policy 1, policy_version 1211287 (0.0007) [2023-12-28 03:56:30,288][106225] Updated weights for policy 1, policy_version 1211297 (0.0005) [2023-12-28 03:56:30,663][106226] Updated weights for policy 0, policy_version 1208289 (0.0007) [2023-12-28 03:56:30,714][106226] Updated weights for policy 0, policy_version 1208299 (0.0005) [2023-12-28 03:56:30,764][106226] Updated weights for policy 0, policy_version 1208309 (0.0005) [2023-12-28 03:56:30,874][106225] Updated weights for policy 1, policy_version 1211307 (0.0006) [2023-12-28 03:56:30,928][106225] Updated weights for policy 1, policy_version 1211317 (0.0008) [2023-12-28 03:56:30,990][106225] Updated weights for policy 1, policy_version 1211327 (0.0009) [2023-12-28 03:56:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 619536384. Throughput: 0: 9788.2, 1: 9714.8. Samples: 619521608. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:31,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.881')] [2023-12-28 03:56:31,461][106226] Updated weights for policy 0, policy_version 1208319 (0.0005) [2023-12-28 03:56:31,530][106226] Updated weights for policy 0, policy_version 1208329 (0.0005) [2023-12-28 03:56:31,590][106226] Updated weights for policy 0, policy_version 1208339 (0.0008) [2023-12-28 03:56:31,638][106225] Updated weights for policy 1, policy_version 1211337 (0.0009) [2023-12-28 03:56:31,708][106225] Updated weights for policy 1, policy_version 1211347 (0.0008) [2023-12-28 03:56:31,768][106225] Updated weights for policy 1, policy_version 1211357 (0.0008) [2023-12-28 03:56:31,824][106225] Updated weights for policy 1, policy_version 1211367 (0.0008) [2023-12-28 03:56:32,242][106226] Updated weights for policy 0, policy_version 1208349 (0.0008) [2023-12-28 03:56:32,306][106226] Updated weights for policy 0, policy_version 1208359 (0.0008) [2023-12-28 03:56:32,369][106226] Updated weights for policy 0, policy_version 1208369 (0.0007) [2023-12-28 03:56:32,541][106225] Updated weights for policy 1, policy_version 1211377 (0.0007) [2023-12-28 03:56:32,605][106225] Updated weights for policy 1, policy_version 1211387 (0.0008) [2023-12-28 03:56:32,660][106225] Updated weights for policy 1, policy_version 1211397 (0.0008) [2023-12-28 03:56:33,141][106226] Updated weights for policy 0, policy_version 1208379 (0.0007) [2023-12-28 03:56:33,212][106226] Updated weights for policy 0, policy_version 1208389 (0.0005) [2023-12-28 03:56:33,280][106226] Updated weights for policy 0, policy_version 1208399 (0.0006) [2023-12-28 03:56:33,351][106225] Updated weights for policy 1, policy_version 1211407 (0.0006) [2023-12-28 03:56:33,409][106225] Updated weights for policy 1, policy_version 1211417 (0.0006) [2023-12-28 03:56:33,472][106225] Updated weights for policy 1, policy_version 1211427 (0.0005) [2023-12-28 03:56:33,906][106226] Updated weights for policy 0, policy_version 1208409 (0.0005) [2023-12-28 03:56:33,960][106226] Updated weights for policy 0, policy_version 1208419 (0.0005) [2023-12-28 03:56:34,015][106226] Updated weights for policy 0, policy_version 1208429 (0.0008) [2023-12-28 03:56:34,048][106225] Updated weights for policy 1, policy_version 1211437 (0.0007) [2023-12-28 03:56:34,068][106226] Updated weights for policy 0, policy_version 1208439 (0.0008) [2023-12-28 03:56:34,104][106225] Updated weights for policy 1, policy_version 1211447 (0.0007) [2023-12-28 03:56:34,161][106225] Updated weights for policy 1, policy_version 1211457 (0.0008) [2023-12-28 03:56:34,701][106226] Updated weights for policy 0, policy_version 1208449 (0.0008) [2023-12-28 03:56:34,759][106225] Updated weights for policy 1, policy_version 1211467 (0.0008) [2023-12-28 03:56:34,760][106226] Updated weights for policy 0, policy_version 1208459 (0.0008) [2023-12-28 03:56:34,810][106225] Updated weights for policy 1, policy_version 1211477 (0.0006) [2023-12-28 03:56:34,812][106226] Updated weights for policy 0, policy_version 1208469 (0.0008) [2023-12-28 03:56:34,868][106225] Updated weights for policy 1, policy_version 1211487 (0.0008) [2023-12-28 03:56:35,511][106226] Updated weights for policy 0, policy_version 1208479 (0.0006) [2023-12-28 03:56:35,558][106225] Updated weights for policy 1, policy_version 1211497 (0.0008) [2023-12-28 03:56:35,567][106226] Updated weights for policy 0, policy_version 1208489 (0.0009) [2023-12-28 03:56:35,617][106225] Updated weights for policy 1, policy_version 1211507 (0.0005) [2023-12-28 03:56:35,624][106226] Updated weights for policy 0, policy_version 1208499 (0.0008) [2023-12-28 03:56:35,665][106225] Updated weights for policy 1, policy_version 1211517 (0.0005) [2023-12-28 03:56:35,715][106225] Updated weights for policy 1, policy_version 1211527 (0.0005) [2023-12-28 03:56:36,174][105115] Fps is (10 sec: 20481.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 619634688. Throughput: 0: 9866.4, 1: 9830.8. Samples: 619645812. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:36,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.647')] [2023-12-28 03:56:36,347][106226] Updated weights for policy 0, policy_version 1208509 (0.0008) [2023-12-28 03:56:36,402][106226] Updated weights for policy 0, policy_version 1208519 (0.0007) [2023-12-28 03:56:36,404][106225] Updated weights for policy 1, policy_version 1211537 (0.0006) [2023-12-28 03:56:36,454][106226] Updated weights for policy 0, policy_version 1208529 (0.0008) [2023-12-28 03:56:36,466][106225] Updated weights for policy 1, policy_version 1211547 (0.0009) [2023-12-28 03:56:36,526][106225] Updated weights for policy 1, policy_version 1211557 (0.0007) [2023-12-28 03:56:37,207][106226] Updated weights for policy 0, policy_version 1208539 (0.0007) [2023-12-28 03:56:37,228][106225] Updated weights for policy 1, policy_version 1211567 (0.0007) [2023-12-28 03:56:37,260][106226] Updated weights for policy 0, policy_version 1208549 (0.0007) [2023-12-28 03:56:37,282][106225] Updated weights for policy 1, policy_version 1211577 (0.0007) [2023-12-28 03:56:37,318][106226] Updated weights for policy 0, policy_version 1208559 (0.0006) [2023-12-28 03:56:37,336][106225] Updated weights for policy 1, policy_version 1211587 (0.0005) [2023-12-28 03:56:38,007][106225] Updated weights for policy 1, policy_version 1211597 (0.0007) [2023-12-28 03:56:38,055][106225] Updated weights for policy 1, policy_version 1211607 (0.0008) [2023-12-28 03:56:38,058][106226] Updated weights for policy 0, policy_version 1208569 (0.0007) [2023-12-28 03:56:38,115][106226] Updated weights for policy 0, policy_version 1208579 (0.0006) [2023-12-28 03:56:38,117][106225] Updated weights for policy 1, policy_version 1211617 (0.0009) [2023-12-28 03:56:38,171][106226] Updated weights for policy 0, policy_version 1208589 (0.0006) [2023-12-28 03:56:38,235][106226] Updated weights for policy 0, policy_version 1208599 (0.0009) [2023-12-28 03:56:38,844][106225] Updated weights for policy 1, policy_version 1211627 (0.0008) [2023-12-28 03:56:38,907][106225] Updated weights for policy 1, policy_version 1211637 (0.0008) [2023-12-28 03:56:38,962][106226] Updated weights for policy 0, policy_version 1208609 (0.0009) [2023-12-28 03:56:38,964][106225] Updated weights for policy 1, policy_version 1211647 (0.0008) [2023-12-28 03:56:39,014][106226] Updated weights for policy 0, policy_version 1208619 (0.0006) [2023-12-28 03:56:39,063][106226] Updated weights for policy 0, policy_version 1208629 (0.0007) [2023-12-28 03:56:39,704][106225] Updated weights for policy 1, policy_version 1211657 (0.0006) [2023-12-28 03:56:39,773][106225] Updated weights for policy 1, policy_version 1211667 (0.0006) [2023-12-28 03:56:39,839][106225] Updated weights for policy 1, policy_version 1211677 (0.0009) [2023-12-28 03:56:39,904][106225] Updated weights for policy 1, policy_version 1211687 (0.0008) [2023-12-28 03:56:39,912][106226] Updated weights for policy 0, policy_version 1208639 (0.0008) [2023-12-28 03:56:39,975][106226] Updated weights for policy 0, policy_version 1208649 (0.0009) [2023-12-28 03:56:40,042][106226] Updated weights for policy 0, policy_version 1208659 (0.0007) [2023-12-28 03:56:40,647][106226] Updated weights for policy 0, policy_version 1208669 (0.0006) [2023-12-28 03:56:40,665][106225] Updated weights for policy 1, policy_version 1211697 (0.0008) [2023-12-28 03:56:40,705][106226] Updated weights for policy 0, policy_version 1208679 (0.0005) [2023-12-28 03:56:40,728][106225] Updated weights for policy 1, policy_version 1211707 (0.0007) [2023-12-28 03:56:40,773][106226] Updated weights for policy 0, policy_version 1208689 (0.0007) [2023-12-28 03:56:40,780][106225] Updated weights for policy 1, policy_version 1211717 (0.0006) [2023-12-28 03:56:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 619732992. Throughput: 0: 9825.9, 1: 9863.3. Samples: 619703760. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:41,175][105115] Avg episode reward: [(0, '-3.998'), (1, '-4.850')] [2023-12-28 03:56:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001211720_310247424.pth... [2023-12-28 03:56:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001208696_309485568.pth... [2023-12-28 03:56:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001207544_309190656.pth [2023-12-28 03:56:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001210536_309944320.pth [2023-12-28 03:56:41,475][106226] Updated weights for policy 0, policy_version 1208699 (0.0009) [2023-12-28 03:56:41,541][106226] Updated weights for policy 0, policy_version 1208709 (0.0010) [2023-12-28 03:56:41,559][106225] Updated weights for policy 1, policy_version 1211727 (0.0007) [2023-12-28 03:56:41,606][106226] Updated weights for policy 0, policy_version 1208719 (0.0011) [2023-12-28 03:56:41,629][106225] Updated weights for policy 1, policy_version 1211737 (0.0007) [2023-12-28 03:56:41,697][106225] Updated weights for policy 1, policy_version 1211747 (0.0006) [2023-12-28 03:56:42,324][106226] Updated weights for policy 0, policy_version 1208729 (0.0011) [2023-12-28 03:56:42,400][106226] Updated weights for policy 0, policy_version 1208739 (0.0010) [2023-12-28 03:56:42,467][106226] Updated weights for policy 0, policy_version 1208749 (0.0010) [2023-12-28 03:56:42,473][106225] Updated weights for policy 1, policy_version 1211757 (0.0006) [2023-12-28 03:56:42,524][106226] Updated weights for policy 0, policy_version 1208759 (0.0011) [2023-12-28 03:56:42,531][106225] Updated weights for policy 1, policy_version 1211767 (0.0005) [2023-12-28 03:56:42,589][106225] Updated weights for policy 1, policy_version 1211777 (0.0007) [2023-12-28 03:56:43,153][106226] Updated weights for policy 0, policy_version 1208769 (0.0006) [2023-12-28 03:56:43,210][106226] Updated weights for policy 0, policy_version 1208779 (0.0005) [2023-12-28 03:56:43,275][106226] Updated weights for policy 0, policy_version 1208789 (0.0007) [2023-12-28 03:56:43,308][106225] Updated weights for policy 1, policy_version 1211787 (0.0007) [2023-12-28 03:56:43,354][106225] Updated weights for policy 1, policy_version 1211797 (0.0010) [2023-12-28 03:56:43,410][106225] Updated weights for policy 1, policy_version 1211807 (0.0010) [2023-12-28 03:56:43,881][106226] Updated weights for policy 0, policy_version 1208799 (0.0006) [2023-12-28 03:56:43,944][106226] Updated weights for policy 0, policy_version 1208809 (0.0005) [2023-12-28 03:56:43,995][106226] Updated weights for policy 0, policy_version 1208819 (0.0008) [2023-12-28 03:56:44,122][106225] Updated weights for policy 1, policy_version 1211817 (0.0010) [2023-12-28 03:56:44,182][106225] Updated weights for policy 1, policy_version 1211827 (0.0010) [2023-12-28 03:56:44,244][106225] Updated weights for policy 1, policy_version 1211837 (0.0010) [2023-12-28 03:56:44,305][106225] Updated weights for policy 1, policy_version 1211847 (0.0010) [2023-12-28 03:56:44,715][106226] Updated weights for policy 0, policy_version 1208829 (0.0008) [2023-12-28 03:56:44,766][106226] Updated weights for policy 0, policy_version 1208839 (0.0009) [2023-12-28 03:56:44,838][106226] Updated weights for policy 0, policy_version 1208849 (0.0009) [2023-12-28 03:56:44,986][106225] Updated weights for policy 1, policy_version 1211857 (0.0008) [2023-12-28 03:56:45,038][106225] Updated weights for policy 1, policy_version 1211867 (0.0008) [2023-12-28 03:56:45,091][106225] Updated weights for policy 1, policy_version 1211877 (0.0008) [2023-12-28 03:56:45,655][106226] Updated weights for policy 0, policy_version 1208859 (0.0009) [2023-12-28 03:56:45,703][106225] Updated weights for policy 1, policy_version 1211887 (0.0006) [2023-12-28 03:56:45,717][106226] Updated weights for policy 0, policy_version 1208869 (0.0008) [2023-12-28 03:56:45,755][106225] Updated weights for policy 1, policy_version 1211897 (0.0006) [2023-12-28 03:56:45,770][106226] Updated weights for policy 0, policy_version 1208879 (0.0009) [2023-12-28 03:56:45,804][106225] Updated weights for policy 1, policy_version 1211907 (0.0007) [2023-12-28 03:56:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 619831296. Throughput: 0: 9841.3, 1: 9865.3. Samples: 619819272. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:46,175][105115] Avg episode reward: [(0, '-4.173'), (1, '-5.123')] [2023-12-28 03:56:46,398][106226] Updated weights for policy 0, policy_version 1208889 (0.0008) [2023-12-28 03:56:46,442][106225] Updated weights for policy 1, policy_version 1211917 (0.0006) [2023-12-28 03:56:46,454][106226] Updated weights for policy 0, policy_version 1208899 (0.0007) [2023-12-28 03:56:46,504][106226] Updated weights for policy 0, policy_version 1208909 (0.0008) [2023-12-28 03:56:46,510][106225] Updated weights for policy 1, policy_version 1211927 (0.0006) [2023-12-28 03:56:46,554][106226] Updated weights for policy 0, policy_version 1208919 (0.0007) [2023-12-28 03:56:46,567][106225] Updated weights for policy 1, policy_version 1211937 (0.0006) [2023-12-28 03:56:47,174][106225] Updated weights for policy 1, policy_version 1211947 (0.0006) [2023-12-28 03:56:47,225][106225] Updated weights for policy 1, policy_version 1211957 (0.0008) [2023-12-28 03:56:47,281][106225] Updated weights for policy 1, policy_version 1211967 (0.0008) [2023-12-28 03:56:47,282][106226] Updated weights for policy 0, policy_version 1208929 (0.0006) [2023-12-28 03:56:47,336][106226] Updated weights for policy 0, policy_version 1208939 (0.0007) [2023-12-28 03:56:47,391][106226] Updated weights for policy 0, policy_version 1208949 (0.0009) [2023-12-28 03:56:47,846][106225] Updated weights for policy 1, policy_version 1211977 (0.0009) [2023-12-28 03:56:47,910][106225] Updated weights for policy 1, policy_version 1211987 (0.0010) [2023-12-28 03:56:47,963][106225] Updated weights for policy 1, policy_version 1211997 (0.0010) [2023-12-28 03:56:48,019][106225] Updated weights for policy 1, policy_version 1212007 (0.0010) [2023-12-28 03:56:48,140][106226] Updated weights for policy 0, policy_version 1208959 (0.0008) [2023-12-28 03:56:48,189][106226] Updated weights for policy 0, policy_version 1208969 (0.0007) [2023-12-28 03:56:48,243][106226] Updated weights for policy 0, policy_version 1208979 (0.0007) [2023-12-28 03:56:48,735][106225] Updated weights for policy 1, policy_version 1212017 (0.0010) [2023-12-28 03:56:48,801][106225] Updated weights for policy 1, policy_version 1212027 (0.0011) [2023-12-28 03:56:48,870][106225] Updated weights for policy 1, policy_version 1212037 (0.0010) [2023-12-28 03:56:48,967][106226] Updated weights for policy 0, policy_version 1208989 (0.0007) [2023-12-28 03:56:49,028][106226] Updated weights for policy 0, policy_version 1208999 (0.0006) [2023-12-28 03:56:49,088][106226] Updated weights for policy 0, policy_version 1209009 (0.0008) [2023-12-28 03:56:49,619][106225] Updated weights for policy 1, policy_version 1212047 (0.0008) [2023-12-28 03:56:49,678][106225] Updated weights for policy 1, policy_version 1212057 (0.0008) [2023-12-28 03:56:49,739][106225] Updated weights for policy 1, policy_version 1212067 (0.0009) [2023-12-28 03:56:49,834][106226] Updated weights for policy 0, policy_version 1209019 (0.0007) [2023-12-28 03:56:49,888][106226] Updated weights for policy 0, policy_version 1209029 (0.0008) [2023-12-28 03:56:49,957][106226] Updated weights for policy 0, policy_version 1209039 (0.0009) [2023-12-28 03:56:50,447][106225] Updated weights for policy 1, policy_version 1212077 (0.0006) [2023-12-28 03:56:50,512][106225] Updated weights for policy 1, policy_version 1212087 (0.0008) [2023-12-28 03:56:50,571][106225] Updated weights for policy 1, policy_version 1212097 (0.0009) [2023-12-28 03:56:50,699][106226] Updated weights for policy 0, policy_version 1209049 (0.0008) [2023-12-28 03:56:50,768][106226] Updated weights for policy 0, policy_version 1209059 (0.0008) [2023-12-28 03:56:50,829][106226] Updated weights for policy 0, policy_version 1209069 (0.0007) [2023-12-28 03:56:50,892][106226] Updated weights for policy 0, policy_version 1209079 (0.0008) [2023-12-28 03:56:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 619929600. Throughput: 0: 9769.4, 1: 9995.7. Samples: 619938944. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:51,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-5.129')] [2023-12-28 03:56:51,300][106225] Updated weights for policy 1, policy_version 1212107 (0.0009) [2023-12-28 03:56:51,363][106225] Updated weights for policy 1, policy_version 1212117 (0.0008) [2023-12-28 03:56:51,433][106225] Updated weights for policy 1, policy_version 1212127 (0.0008) [2023-12-28 03:56:51,675][106226] Updated weights for policy 0, policy_version 1209089 (0.0008) [2023-12-28 03:56:51,746][106226] Updated weights for policy 0, policy_version 1209099 (0.0008) [2023-12-28 03:56:51,806][106226] Updated weights for policy 0, policy_version 1209109 (0.0008) [2023-12-28 03:56:52,260][106225] Updated weights for policy 1, policy_version 1212137 (0.0008) [2023-12-28 03:56:52,322][106225] Updated weights for policy 1, policy_version 1212147 (0.0009) [2023-12-28 03:56:52,388][106225] Updated weights for policy 1, policy_version 1212157 (0.0007) [2023-12-28 03:56:52,445][106225] Updated weights for policy 1, policy_version 1212167 (0.0006) [2023-12-28 03:56:52,524][106226] Updated weights for policy 0, policy_version 1209119 (0.0008) [2023-12-28 03:56:52,576][106226] Updated weights for policy 0, policy_version 1209129 (0.0009) [2023-12-28 03:56:52,627][106226] Updated weights for policy 0, policy_version 1209139 (0.0008) [2023-12-28 03:56:53,018][106225] Updated weights for policy 1, policy_version 1212177 (0.0010) [2023-12-28 03:56:53,081][106225] Updated weights for policy 1, policy_version 1212187 (0.0006) [2023-12-28 03:56:53,141][106225] Updated weights for policy 1, policy_version 1212197 (0.0009) [2023-12-28 03:56:53,466][106226] Updated weights for policy 0, policy_version 1209149 (0.0007) [2023-12-28 03:56:53,518][106226] Updated weights for policy 0, policy_version 1209159 (0.0005) [2023-12-28 03:56:53,568][106226] Updated weights for policy 0, policy_version 1209169 (0.0005) [2023-12-28 03:56:53,719][106225] Updated weights for policy 1, policy_version 1212207 (0.0010) [2023-12-28 03:56:53,786][106225] Updated weights for policy 1, policy_version 1212217 (0.0009) [2023-12-28 03:56:53,850][106225] Updated weights for policy 1, policy_version 1212227 (0.0006) [2023-12-28 03:56:54,179][106226] Updated weights for policy 0, policy_version 1209179 (0.0008) [2023-12-28 03:56:54,243][106226] Updated weights for policy 0, policy_version 1209189 (0.0008) [2023-12-28 03:56:54,305][106226] Updated weights for policy 0, policy_version 1209199 (0.0008) [2023-12-28 03:56:54,460][106225] Updated weights for policy 1, policy_version 1212237 (0.0005) [2023-12-28 03:56:54,516][106225] Updated weights for policy 1, policy_version 1212247 (0.0005) [2023-12-28 03:56:54,572][106225] Updated weights for policy 1, policy_version 1212257 (0.0005) [2023-12-28 03:56:55,027][106226] Updated weights for policy 0, policy_version 1209209 (0.0008) [2023-12-28 03:56:55,091][106226] Updated weights for policy 0, policy_version 1209219 (0.0008) [2023-12-28 03:56:55,092][106225] Updated weights for policy 1, policy_version 1212267 (0.0006) [2023-12-28 03:56:55,139][106226] Updated weights for policy 0, policy_version 1209229 (0.0008) [2023-12-28 03:56:55,152][106225] Updated weights for policy 1, policy_version 1212277 (0.0010) [2023-12-28 03:56:55,193][106226] Updated weights for policy 0, policy_version 1209239 (0.0006) [2023-12-28 03:56:55,205][106225] Updated weights for policy 1, policy_version 1212287 (0.0010) [2023-12-28 03:56:55,844][106225] Updated weights for policy 1, policy_version 1212297 (0.0010) [2023-12-28 03:56:55,895][106225] Updated weights for policy 1, policy_version 1212307 (0.0010) [2023-12-28 03:56:55,949][106225] Updated weights for policy 1, policy_version 1212317 (0.0010) [2023-12-28 03:56:55,959][106226] Updated weights for policy 0, policy_version 1209249 (0.0006) [2023-12-28 03:56:56,009][106225] Updated weights for policy 1, policy_version 1212327 (0.0010) [2023-12-28 03:56:56,026][106226] Updated weights for policy 0, policy_version 1209259 (0.0006) [2023-12-28 03:56:56,094][106226] Updated weights for policy 0, policy_version 1209269 (0.0006) [2023-12-28 03:56:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 620036096. Throughput: 0: 9754.8, 1: 9999.5. Samples: 619998660. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:56:56,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-4.963')] [2023-12-28 03:56:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001212328_310403072.pth... [2023-12-28 03:56:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001209272_309633024.pth... [2023-12-28 03:56:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001211112_310091776.pth [2023-12-28 03:56:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001208120_309338112.pth [2023-12-28 03:56:56,603][106225] Updated weights for policy 1, policy_version 1212337 (0.0006) [2023-12-28 03:56:56,650][106225] Updated weights for policy 1, policy_version 1212347 (0.0006) [2023-12-28 03:56:56,695][106225] Updated weights for policy 1, policy_version 1212357 (0.0005) [2023-12-28 03:56:56,768][106226] Updated weights for policy 0, policy_version 1209279 (0.0007) [2023-12-28 03:56:56,825][106226] Updated weights for policy 0, policy_version 1209289 (0.0009) [2023-12-28 03:56:56,877][106226] Updated weights for policy 0, policy_version 1209299 (0.0008) [2023-12-28 03:56:57,226][106225] Updated weights for policy 1, policy_version 1212367 (0.0007) [2023-12-28 03:56:57,284][106225] Updated weights for policy 1, policy_version 1212377 (0.0009) [2023-12-28 03:56:57,342][106225] Updated weights for policy 1, policy_version 1212387 (0.0010) [2023-12-28 03:56:57,673][106226] Updated weights for policy 0, policy_version 1209309 (0.0007) [2023-12-28 03:56:57,716][106226] Updated weights for policy 0, policy_version 1209319 (0.0007) [2023-12-28 03:56:57,761][106226] Updated weights for policy 0, policy_version 1209329 (0.0007) [2023-12-28 03:56:58,018][106225] Updated weights for policy 1, policy_version 1212397 (0.0006) [2023-12-28 03:56:58,080][106225] Updated weights for policy 1, policy_version 1212407 (0.0005) [2023-12-28 03:56:58,136][106225] Updated weights for policy 1, policy_version 1212417 (0.0008) [2023-12-28 03:56:58,565][106226] Updated weights for policy 0, policy_version 1209339 (0.0009) [2023-12-28 03:56:58,644][106226] Updated weights for policy 0, policy_version 1209350 (0.0010) [2023-12-28 03:56:58,709][106226] Updated weights for policy 0, policy_version 1209360 (0.0008) [2023-12-28 03:56:58,874][106225] Updated weights for policy 1, policy_version 1212427 (0.0010) [2023-12-28 03:56:58,943][106225] Updated weights for policy 1, policy_version 1212437 (0.0008) [2023-12-28 03:56:59,004][106225] Updated weights for policy 1, policy_version 1212447 (0.0009) [2023-12-28 03:56:59,558][106226] Updated weights for policy 0, policy_version 1209370 (0.0010) [2023-12-28 03:56:59,618][106226] Updated weights for policy 0, policy_version 1209380 (0.0009) [2023-12-28 03:56:59,690][106226] Updated weights for policy 0, policy_version 1209390 (0.0010) [2023-12-28 03:56:59,710][106225] Updated weights for policy 1, policy_version 1212457 (0.0008) [2023-12-28 03:56:59,754][106226] Updated weights for policy 0, policy_version 1209400 (0.0008) [2023-12-28 03:56:59,772][106225] Updated weights for policy 1, policy_version 1212467 (0.0005) [2023-12-28 03:56:59,829][106225] Updated weights for policy 1, policy_version 1212477 (0.0006) [2023-12-28 03:56:59,897][106225] Updated weights for policy 1, policy_version 1212487 (0.0007) [2023-12-28 03:57:00,525][106225] Updated weights for policy 1, policy_version 1212497 (0.0005) [2023-12-28 03:57:00,556][106226] Updated weights for policy 0, policy_version 1209410 (0.0008) [2023-12-28 03:57:00,581][106225] Updated weights for policy 1, policy_version 1212507 (0.0005) [2023-12-28 03:57:00,613][106226] Updated weights for policy 0, policy_version 1209420 (0.0009) [2023-12-28 03:57:00,637][106225] Updated weights for policy 1, policy_version 1212517 (0.0005) [2023-12-28 03:57:00,670][106226] Updated weights for policy 0, policy_version 1209430 (0.0008) [2023-12-28 03:57:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 620126208. Throughput: 0: 9635.8, 1: 10189.7. Samples: 620117644. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:57:01,175][105115] Avg episode reward: [(0, '-4.221'), (1, '-4.878')] [2023-12-28 03:57:01,300][106225] Updated weights for policy 1, policy_version 1212527 (0.0007) [2023-12-28 03:57:01,369][106225] Updated weights for policy 1, policy_version 1212537 (0.0007) [2023-12-28 03:57:01,399][106226] Updated weights for policy 0, policy_version 1209440 (0.0009) [2023-12-28 03:57:01,431][106225] Updated weights for policy 1, policy_version 1212547 (0.0007) [2023-12-28 03:57:01,468][106226] Updated weights for policy 0, policy_version 1209450 (0.0012) [2023-12-28 03:57:01,538][106226] Updated weights for policy 0, policy_version 1209460 (0.0009) [2023-12-28 03:57:02,070][106225] Updated weights for policy 1, policy_version 1212557 (0.0008) [2023-12-28 03:57:02,131][106225] Updated weights for policy 1, policy_version 1212567 (0.0007) [2023-12-28 03:57:02,195][106225] Updated weights for policy 1, policy_version 1212577 (0.0006) [2023-12-28 03:57:02,282][106226] Updated weights for policy 0, policy_version 1209470 (0.0007) [2023-12-28 03:57:02,348][106226] Updated weights for policy 0, policy_version 1209480 (0.0011) [2023-12-28 03:57:02,413][106226] Updated weights for policy 0, policy_version 1209490 (0.0008) [2023-12-28 03:57:02,818][106225] Updated weights for policy 1, policy_version 1212587 (0.0008) [2023-12-28 03:57:02,882][106225] Updated weights for policy 1, policy_version 1212597 (0.0008) [2023-12-28 03:57:02,944][106225] Updated weights for policy 1, policy_version 1212607 (0.0008) [2023-12-28 03:57:03,031][106226] Updated weights for policy 0, policy_version 1209500 (0.0009) [2023-12-28 03:57:03,088][106226] Updated weights for policy 0, policy_version 1209510 (0.0010) [2023-12-28 03:57:03,140][106226] Updated weights for policy 0, policy_version 1209520 (0.0010) [2023-12-28 03:57:03,644][106225] Updated weights for policy 1, policy_version 1212617 (0.0008) [2023-12-28 03:57:03,704][106225] Updated weights for policy 1, policy_version 1212627 (0.0007) [2023-12-28 03:57:03,753][106225] Updated weights for policy 1, policy_version 1212637 (0.0007) [2023-12-28 03:57:03,802][106225] Updated weights for policy 1, policy_version 1212647 (0.0005) [2023-12-28 03:57:03,857][106226] Updated weights for policy 0, policy_version 1209530 (0.0010) [2023-12-28 03:57:03,920][106226] Updated weights for policy 0, policy_version 1209540 (0.0011) [2023-12-28 03:57:03,971][106226] Updated weights for policy 0, policy_version 1209550 (0.0010) [2023-12-28 03:57:04,019][106226] Updated weights for policy 0, policy_version 1209560 (0.0010) [2023-12-28 03:57:04,482][106225] Updated weights for policy 1, policy_version 1212657 (0.0007) [2023-12-28 03:57:04,544][106225] Updated weights for policy 1, policy_version 1212667 (0.0008) [2023-12-28 03:57:04,602][106225] Updated weights for policy 1, policy_version 1212677 (0.0008) [2023-12-28 03:57:04,746][106226] Updated weights for policy 0, policy_version 1209570 (0.0008) [2023-12-28 03:57:04,796][106226] Updated weights for policy 0, policy_version 1209580 (0.0005) [2023-12-28 03:57:04,862][106226] Updated weights for policy 0, policy_version 1209590 (0.0009) [2023-12-28 03:57:05,302][106225] Updated weights for policy 1, policy_version 1212687 (0.0008) [2023-12-28 03:57:05,359][106225] Updated weights for policy 1, policy_version 1212697 (0.0008) [2023-12-28 03:57:05,408][106225] Updated weights for policy 1, policy_version 1212707 (0.0007) [2023-12-28 03:57:05,510][106226] Updated weights for policy 0, policy_version 1209600 (0.0010) [2023-12-28 03:57:05,566][106226] Updated weights for policy 0, policy_version 1209610 (0.0010) [2023-12-28 03:57:05,614][106226] Updated weights for policy 0, policy_version 1209620 (0.0010) [2023-12-28 03:57:06,043][106225] Updated weights for policy 1, policy_version 1212717 (0.0006) [2023-12-28 03:57:06,097][106225] Updated weights for policy 1, policy_version 1212727 (0.0005) [2023-12-28 03:57:06,172][106225] Updated weights for policy 1, policy_version 1212737 (0.0007) [2023-12-28 03:57:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 620224512. Throughput: 0: 9649.0, 1: 10216.5. Samples: 620238576. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:57:06,175][105115] Avg episode reward: [(0, '-3.993'), (1, '-5.046')] [2023-12-28 03:57:06,331][106226] Updated weights for policy 0, policy_version 1209630 (0.0011) [2023-12-28 03:57:06,396][106226] Updated weights for policy 0, policy_version 1209640 (0.0011) [2023-12-28 03:57:06,460][106226] Updated weights for policy 0, policy_version 1209650 (0.0007) [2023-12-28 03:57:06,933][106225] Updated weights for policy 1, policy_version 1212747 (0.0008) [2023-12-28 03:57:06,999][106225] Updated weights for policy 1, policy_version 1212757 (0.0008) [2023-12-28 03:57:07,062][106225] Updated weights for policy 1, policy_version 1212767 (0.0010) [2023-12-28 03:57:07,101][106226] Updated weights for policy 0, policy_version 1209660 (0.0008) [2023-12-28 03:57:07,168][106226] Updated weights for policy 0, policy_version 1209670 (0.0011) [2023-12-28 03:57:07,236][106226] Updated weights for policy 0, policy_version 1209680 (0.0011) [2023-12-28 03:57:07,691][106225] Updated weights for policy 1, policy_version 1212777 (0.0010) [2023-12-28 03:57:07,755][106225] Updated weights for policy 1, policy_version 1212787 (0.0007) [2023-12-28 03:57:07,815][106225] Updated weights for policy 1, policy_version 1212797 (0.0007) [2023-12-28 03:57:07,878][106225] Updated weights for policy 1, policy_version 1212807 (0.0006) [2023-12-28 03:57:07,913][106226] Updated weights for policy 0, policy_version 1209690 (0.0007) [2023-12-28 03:57:07,974][106226] Updated weights for policy 0, policy_version 1209700 (0.0008) [2023-12-28 03:57:08,043][106226] Updated weights for policy 0, policy_version 1209710 (0.0006) [2023-12-28 03:57:08,091][106226] Updated weights for policy 0, policy_version 1209720 (0.0005) [2023-12-28 03:57:08,551][106225] Updated weights for policy 1, policy_version 1212817 (0.0008) [2023-12-28 03:57:08,610][106225] Updated weights for policy 1, policy_version 1212827 (0.0008) [2023-12-28 03:57:08,645][106226] Updated weights for policy 0, policy_version 1209730 (0.0011) [2023-12-28 03:57:08,667][106225] Updated weights for policy 1, policy_version 1212837 (0.0008) [2023-12-28 03:57:08,699][106226] Updated weights for policy 0, policy_version 1209740 (0.0010) [2023-12-28 03:57:08,763][106226] Updated weights for policy 0, policy_version 1209750 (0.0011) [2023-12-28 03:57:09,332][106226] Updated weights for policy 0, policy_version 1209760 (0.0010) [2023-12-28 03:57:09,404][106226] Updated weights for policy 0, policy_version 1209770 (0.0011) [2023-12-28 03:57:09,461][106225] Updated weights for policy 1, policy_version 1212847 (0.0007) [2023-12-28 03:57:09,473][106226] Updated weights for policy 0, policy_version 1209780 (0.0010) [2023-12-28 03:57:09,526][106225] Updated weights for policy 1, policy_version 1212857 (0.0006) [2023-12-28 03:57:09,590][106225] Updated weights for policy 1, policy_version 1212867 (0.0008) [2023-12-28 03:57:10,239][106226] Updated weights for policy 0, policy_version 1209790 (0.0009) [2023-12-28 03:57:10,307][106226] Updated weights for policy 0, policy_version 1209800 (0.0007) [2023-12-28 03:57:10,358][106225] Updated weights for policy 1, policy_version 1212877 (0.0008) [2023-12-28 03:57:10,370][106226] Updated weights for policy 0, policy_version 1209810 (0.0008) [2023-12-28 03:57:10,423][106225] Updated weights for policy 1, policy_version 1212887 (0.0009) [2023-12-28 03:57:10,491][106225] Updated weights for policy 1, policy_version 1212897 (0.0008) [2023-12-28 03:57:11,060][106225] Updated weights for policy 1, policy_version 1212907 (0.0009) [2023-12-28 03:57:11,132][106225] Updated weights for policy 1, policy_version 1212917 (0.0006) [2023-12-28 03:57:11,158][106226] Updated weights for policy 0, policy_version 1209820 (0.0008) [2023-12-28 03:57:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 620322816. Throughput: 0: 9773.7, 1: 10216.4. Samples: 620300832. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:57:11,176][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.730')] [2023-12-28 03:57:11,198][106225] Updated weights for policy 1, policy_version 1212927 (0.0008) [2023-12-28 03:57:11,226][106226] Updated weights for policy 0, policy_version 1209830 (0.0008) [2023-12-28 03:57:11,252][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001212936_310558720.pth... [2023-12-28 03:57:11,257][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001211720_310247424.pth [2023-12-28 03:57:11,290][106226] Updated weights for policy 0, policy_version 1209840 (0.0007) [2023-12-28 03:57:11,344][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001209848_309780480.pth... [2023-12-28 03:57:11,349][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001208696_309485568.pth [2023-12-28 03:57:11,963][106225] Updated weights for policy 1, policy_version 1212937 (0.0010) [2023-12-28 03:57:12,019][106225] Updated weights for policy 1, policy_version 1212947 (0.0006) [2023-12-28 03:57:12,070][106226] Updated weights for policy 0, policy_version 1209850 (0.0008) [2023-12-28 03:57:12,082][106225] Updated weights for policy 1, policy_version 1212957 (0.0007) [2023-12-28 03:57:12,120][106226] Updated weights for policy 0, policy_version 1209860 (0.0008) [2023-12-28 03:57:12,141][106225] Updated weights for policy 1, policy_version 1212967 (0.0006) [2023-12-28 03:57:12,171][106226] Updated weights for policy 0, policy_version 1209870 (0.0009) [2023-12-28 03:57:12,221][106226] Updated weights for policy 0, policy_version 1209880 (0.0008) [2023-12-28 03:57:12,725][106225] Updated weights for policy 1, policy_version 1212977 (0.0006) [2023-12-28 03:57:12,784][106225] Updated weights for policy 1, policy_version 1212987 (0.0006) [2023-12-28 03:57:12,849][106225] Updated weights for policy 1, policy_version 1212997 (0.0008) [2023-12-28 03:57:12,965][106226] Updated weights for policy 0, policy_version 1209890 (0.0006) [2023-12-28 03:57:13,019][106226] Updated weights for policy 0, policy_version 1209900 (0.0006) [2023-12-28 03:57:13,066][106226] Updated weights for policy 0, policy_version 1209910 (0.0005) [2023-12-28 03:57:13,462][106225] Updated weights for policy 1, policy_version 1213007 (0.0008) [2023-12-28 03:57:13,528][106225] Updated weights for policy 1, policy_version 1213017 (0.0008) [2023-12-28 03:57:13,579][106225] Updated weights for policy 1, policy_version 1213027 (0.0008) [2023-12-28 03:57:13,685][106226] Updated weights for policy 0, policy_version 1209920 (0.0010) [2023-12-28 03:57:13,744][106226] Updated weights for policy 0, policy_version 1209930 (0.0005) [2023-12-28 03:57:13,813][106226] Updated weights for policy 0, policy_version 1209940 (0.0006) [2023-12-28 03:57:14,342][106225] Updated weights for policy 1, policy_version 1213037 (0.0008) [2023-12-28 03:57:14,398][106225] Updated weights for policy 1, policy_version 1213047 (0.0007) [2023-12-28 03:57:14,431][106226] Updated weights for policy 0, policy_version 1209950 (0.0007) [2023-12-28 03:57:14,462][106225] Updated weights for policy 1, policy_version 1213057 (0.0007) [2023-12-28 03:57:14,490][106226] Updated weights for policy 0, policy_version 1209960 (0.0008) [2023-12-28 03:57:14,545][106226] Updated weights for policy 0, policy_version 1209970 (0.0008) [2023-12-28 03:57:15,159][106225] Updated weights for policy 1, policy_version 1213067 (0.0008) [2023-12-28 03:57:15,215][106225] Updated weights for policy 1, policy_version 1213077 (0.0008) [2023-12-28 03:57:15,243][106226] Updated weights for policy 0, policy_version 1209980 (0.0009) [2023-12-28 03:57:15,276][106225] Updated weights for policy 1, policy_version 1213087 (0.0007) [2023-12-28 03:57:15,308][106226] Updated weights for policy 0, policy_version 1209990 (0.0008) [2023-12-28 03:57:15,375][106226] Updated weights for policy 0, policy_version 1210000 (0.0010) [2023-12-28 03:57:16,010][106225] Updated weights for policy 1, policy_version 1213097 (0.0009) [2023-12-28 03:57:16,059][106225] Updated weights for policy 1, policy_version 1213107 (0.0008) [2023-12-28 03:57:16,079][106226] Updated weights for policy 0, policy_version 1210010 (0.0009) [2023-12-28 03:57:16,107][106225] Updated weights for policy 1, policy_version 1213117 (0.0007) [2023-12-28 03:57:16,135][106226] Updated weights for policy 0, policy_version 1210020 (0.0010) [2023-12-28 03:57:16,156][106225] Updated weights for policy 1, policy_version 1213127 (0.0006) [2023-12-28 03:57:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 620429312. Throughput: 0: 9732.2, 1: 10174.2. Samples: 620417396. Policy #0 lag: (min: 39.0, avg: 54.9, max: 56.0) [2023-12-28 03:57:16,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-4.928')] [2023-12-28 03:57:16,198][106226] Updated weights for policy 0, policy_version 1210030 (0.0011) [2023-12-28 03:57:16,248][106226] Updated weights for policy 0, policy_version 1210040 (0.0010) [2023-12-28 03:57:16,905][106225] Updated weights for policy 1, policy_version 1213137 (0.0007) [2023-12-28 03:57:16,958][106225] Updated weights for policy 1, policy_version 1213147 (0.0006) [2023-12-28 03:57:16,966][106226] Updated weights for policy 0, policy_version 1210050 (0.0008) [2023-12-28 03:57:17,018][106225] Updated weights for policy 1, policy_version 1213157 (0.0006) [2023-12-28 03:57:17,019][106226] Updated weights for policy 0, policy_version 1210060 (0.0009) [2023-12-28 03:57:17,076][106226] Updated weights for policy 0, policy_version 1210070 (0.0011) [2023-12-28 03:57:17,764][106225] Updated weights for policy 1, policy_version 1213167 (0.0007) [2023-12-28 03:57:17,809][106226] Updated weights for policy 0, policy_version 1210080 (0.0011) [2023-12-28 03:57:17,819][106225] Updated weights for policy 1, policy_version 1213177 (0.0005) [2023-12-28 03:57:17,867][106226] Updated weights for policy 0, policy_version 1210090 (0.0010) [2023-12-28 03:57:17,869][106225] Updated weights for policy 1, policy_version 1213187 (0.0005) [2023-12-28 03:57:17,924][106226] Updated weights for policy 0, policy_version 1210100 (0.0010) [2023-12-28 03:57:18,508][106225] Updated weights for policy 1, policy_version 1213197 (0.0006) [2023-12-28 03:57:18,566][106225] Updated weights for policy 1, policy_version 1213207 (0.0005) [2023-12-28 03:57:18,590][106226] Updated weights for policy 0, policy_version 1210110 (0.0010) [2023-12-28 03:57:18,633][106225] Updated weights for policy 1, policy_version 1213217 (0.0007) [2023-12-28 03:57:18,649][106226] Updated weights for policy 0, policy_version 1210120 (0.0008) [2023-12-28 03:57:18,711][106226] Updated weights for policy 0, policy_version 1210130 (0.0005) [2023-12-28 03:57:19,293][106225] Updated weights for policy 1, policy_version 1213227 (0.0010) [2023-12-28 03:57:19,308][106226] Updated weights for policy 0, policy_version 1210140 (0.0006) [2023-12-28 03:57:19,355][106225] Updated weights for policy 1, policy_version 1213237 (0.0007) [2023-12-28 03:57:19,376][106226] Updated weights for policy 0, policy_version 1210150 (0.0009) [2023-12-28 03:57:19,440][106226] Updated weights for policy 0, policy_version 1210160 (0.0007) [2023-12-28 03:57:19,451][106225] Updated weights for policy 1, policy_version 1213247 (0.0008) [2023-12-28 03:57:20,199][106225] Updated weights for policy 1, policy_version 1213257 (0.0007) [2023-12-28 03:57:20,246][106226] Updated weights for policy 0, policy_version 1210170 (0.0008) [2023-12-28 03:57:20,255][106225] Updated weights for policy 1, policy_version 1213267 (0.0008) [2023-12-28 03:57:20,304][106226] Updated weights for policy 0, policy_version 1210180 (0.0007) [2023-12-28 03:57:20,311][106225] Updated weights for policy 1, policy_version 1213277 (0.0008) [2023-12-28 03:57:20,363][106226] Updated weights for policy 0, policy_version 1210190 (0.0006) [2023-12-28 03:57:20,365][106225] Updated weights for policy 1, policy_version 1213287 (0.0008) [2023-12-28 03:57:20,427][106226] Updated weights for policy 0, policy_version 1210200 (0.0008) [2023-12-28 03:57:21,129][106226] Updated weights for policy 0, policy_version 1210210 (0.0008) [2023-12-28 03:57:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 620519424. Throughput: 0: 9699.0, 1: 10054.9. Samples: 620534740. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:21,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-4.936')] [2023-12-28 03:57:21,194][106226] Updated weights for policy 0, policy_version 1210220 (0.0009) [2023-12-28 03:57:21,228][106225] Updated weights for policy 1, policy_version 1213297 (0.0006) [2023-12-28 03:57:21,258][106226] Updated weights for policy 0, policy_version 1210230 (0.0009) [2023-12-28 03:57:21,291][106225] Updated weights for policy 1, policy_version 1213307 (0.0008) [2023-12-28 03:57:21,361][106225] Updated weights for policy 1, policy_version 1213317 (0.0008) [2023-12-28 03:57:22,024][106226] Updated weights for policy 0, policy_version 1210240 (0.0008) [2023-12-28 03:57:22,085][106226] Updated weights for policy 0, policy_version 1210250 (0.0009) [2023-12-28 03:57:22,108][106225] Updated weights for policy 1, policy_version 1213327 (0.0007) [2023-12-28 03:57:22,138][106226] Updated weights for policy 0, policy_version 1210260 (0.0006) [2023-12-28 03:57:22,164][106225] Updated weights for policy 1, policy_version 1213337 (0.0007) [2023-12-28 03:57:22,217][106225] Updated weights for policy 1, policy_version 1213347 (0.0008) [2023-12-28 03:57:22,833][106226] Updated weights for policy 0, policy_version 1210270 (0.0008) [2023-12-28 03:57:22,888][106226] Updated weights for policy 0, policy_version 1210280 (0.0009) [2023-12-28 03:57:22,952][106226] Updated weights for policy 0, policy_version 1210290 (0.0010) [2023-12-28 03:57:22,996][106225] Updated weights for policy 1, policy_version 1213357 (0.0008) [2023-12-28 03:57:23,051][106225] Updated weights for policy 1, policy_version 1213367 (0.0008) [2023-12-28 03:57:23,101][106225] Updated weights for policy 1, policy_version 1213377 (0.0008) [2023-12-28 03:57:23,562][106226] Updated weights for policy 0, policy_version 1210300 (0.0007) [2023-12-28 03:57:23,620][106226] Updated weights for policy 0, policy_version 1210310 (0.0005) [2023-12-28 03:57:23,677][106226] Updated weights for policy 0, policy_version 1210320 (0.0006) [2023-12-28 03:57:23,870][106225] Updated weights for policy 1, policy_version 1213387 (0.0008) [2023-12-28 03:57:23,923][106225] Updated weights for policy 1, policy_version 1213397 (0.0008) [2023-12-28 03:57:23,976][106225] Updated weights for policy 1, policy_version 1213407 (0.0008) [2023-12-28 03:57:24,332][106226] Updated weights for policy 0, policy_version 1210330 (0.0010) [2023-12-28 03:57:24,389][106226] Updated weights for policy 0, policy_version 1210340 (0.0008) [2023-12-28 03:57:24,445][106226] Updated weights for policy 0, policy_version 1210350 (0.0009) [2023-12-28 03:57:24,497][106226] Updated weights for policy 0, policy_version 1210360 (0.0009) [2023-12-28 03:57:24,682][106225] Updated weights for policy 1, policy_version 1213417 (0.0007) [2023-12-28 03:57:24,731][106225] Updated weights for policy 1, policy_version 1213427 (0.0005) [2023-12-28 03:57:24,781][106225] Updated weights for policy 1, policy_version 1213437 (0.0005) [2023-12-28 03:57:24,829][106225] Updated weights for policy 1, policy_version 1213447 (0.0005) [2023-12-28 03:57:25,077][106226] Updated weights for policy 0, policy_version 1210370 (0.0006) [2023-12-28 03:57:25,120][106226] Updated weights for policy 0, policy_version 1210380 (0.0005) [2023-12-28 03:57:25,172][106226] Updated weights for policy 0, policy_version 1210390 (0.0005) [2023-12-28 03:57:25,445][106225] Updated weights for policy 1, policy_version 1213457 (0.0009) [2023-12-28 03:57:25,488][106225] Updated weights for policy 1, policy_version 1213467 (0.0010) [2023-12-28 03:57:25,534][106225] Updated weights for policy 1, policy_version 1213477 (0.0010) [2023-12-28 03:57:25,813][106226] Updated weights for policy 0, policy_version 1210400 (0.0008) [2023-12-28 03:57:25,864][106226] Updated weights for policy 0, policy_version 1210410 (0.0007) [2023-12-28 03:57:25,922][106226] Updated weights for policy 0, policy_version 1210420 (0.0007) [2023-12-28 03:57:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.1, 300 sec: 19799.7). Total num frames: 620625920. Throughput: 0: 9738.4, 1: 9991.9. Samples: 620591620. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:26,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.922')] [2023-12-28 03:57:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001210424_309927936.pth... [2023-12-28 03:57:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001213480_310697984.pth... [2023-12-28 03:57:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001209272_309633024.pth [2023-12-28 03:57:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001212328_310403072.pth [2023-12-28 03:57:26,265][106225] Updated weights for policy 1, policy_version 1213487 (0.0010) [2023-12-28 03:57:26,322][106225] Updated weights for policy 1, policy_version 1213497 (0.0010) [2023-12-28 03:57:26,381][106225] Updated weights for policy 1, policy_version 1213507 (0.0009) [2023-12-28 03:57:26,564][106226] Updated weights for policy 0, policy_version 1210430 (0.0007) [2023-12-28 03:57:26,629][106226] Updated weights for policy 0, policy_version 1210440 (0.0005) [2023-12-28 03:57:26,681][106226] Updated weights for policy 0, policy_version 1210450 (0.0007) [2023-12-28 03:57:27,003][106225] Updated weights for policy 1, policy_version 1213517 (0.0008) [2023-12-28 03:57:27,070][106225] Updated weights for policy 1, policy_version 1213527 (0.0008) [2023-12-28 03:57:27,133][106225] Updated weights for policy 1, policy_version 1213537 (0.0009) [2023-12-28 03:57:27,311][106226] Updated weights for policy 0, policy_version 1210460 (0.0007) [2023-12-28 03:57:27,367][106226] Updated weights for policy 0, policy_version 1210470 (0.0010) [2023-12-28 03:57:27,422][106226] Updated weights for policy 0, policy_version 1210480 (0.0007) [2023-12-28 03:57:27,747][106225] Updated weights for policy 1, policy_version 1213547 (0.0008) [2023-12-28 03:57:27,799][106225] Updated weights for policy 1, policy_version 1213557 (0.0008) [2023-12-28 03:57:27,854][106225] Updated weights for policy 1, policy_version 1213567 (0.0008) [2023-12-28 03:57:28,064][106226] Updated weights for policy 0, policy_version 1210490 (0.0009) [2023-12-28 03:57:28,116][106226] Updated weights for policy 0, policy_version 1210500 (0.0010) [2023-12-28 03:57:28,169][106226] Updated weights for policy 0, policy_version 1210510 (0.0010) [2023-12-28 03:57:28,222][106226] Updated weights for policy 0, policy_version 1210520 (0.0010) [2023-12-28 03:57:28,517][106225] Updated weights for policy 1, policy_version 1213577 (0.0007) [2023-12-28 03:57:28,570][106225] Updated weights for policy 1, policy_version 1213587 (0.0008) [2023-12-28 03:57:28,628][106225] Updated weights for policy 1, policy_version 1213597 (0.0008) [2023-12-28 03:57:28,691][106225] Updated weights for policy 1, policy_version 1213607 (0.0008) [2023-12-28 03:57:28,944][106226] Updated weights for policy 0, policy_version 1210530 (0.0007) [2023-12-28 03:57:29,002][106226] Updated weights for policy 0, policy_version 1210540 (0.0010) [2023-12-28 03:57:29,058][106226] Updated weights for policy 0, policy_version 1210550 (0.0010) [2023-12-28 03:57:29,492][106225] Updated weights for policy 1, policy_version 1213617 (0.0008) [2023-12-28 03:57:29,549][106225] Updated weights for policy 1, policy_version 1213627 (0.0007) [2023-12-28 03:57:29,603][106225] Updated weights for policy 1, policy_version 1213637 (0.0009) [2023-12-28 03:57:29,743][106226] Updated weights for policy 0, policy_version 1210560 (0.0006) [2023-12-28 03:57:29,802][106226] Updated weights for policy 0, policy_version 1210570 (0.0008) [2023-12-28 03:57:29,860][106226] Updated weights for policy 0, policy_version 1210580 (0.0009) [2023-12-28 03:57:30,397][106225] Updated weights for policy 1, policy_version 1213647 (0.0009) [2023-12-28 03:57:30,458][106225] Updated weights for policy 1, policy_version 1213657 (0.0007) [2023-12-28 03:57:30,522][106225] Updated weights for policy 1, policy_version 1213667 (0.0007) [2023-12-28 03:57:30,542][106226] Updated weights for policy 0, policy_version 1210590 (0.0008) [2023-12-28 03:57:30,598][106226] Updated weights for policy 0, policy_version 1210600 (0.0006) [2023-12-28 03:57:30,656][106226] Updated weights for policy 0, policy_version 1210610 (0.0005) [2023-12-28 03:57:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 620724224. Throughput: 0: 9820.6, 1: 10105.5. Samples: 620715944. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:31,175][105115] Avg episode reward: [(0, '-4.209'), (1, '-4.842')] [2023-12-28 03:57:31,265][106225] Updated weights for policy 1, policy_version 1213677 (0.0006) [2023-12-28 03:57:31,326][106225] Updated weights for policy 1, policy_version 1213687 (0.0008) [2023-12-28 03:57:31,357][106226] Updated weights for policy 0, policy_version 1210620 (0.0007) [2023-12-28 03:57:31,391][106225] Updated weights for policy 1, policy_version 1213697 (0.0009) [2023-12-28 03:57:31,424][106226] Updated weights for policy 0, policy_version 1210630 (0.0007) [2023-12-28 03:57:31,489][106226] Updated weights for policy 0, policy_version 1210640 (0.0005) [2023-12-28 03:57:32,120][106225] Updated weights for policy 1, policy_version 1213707 (0.0007) [2023-12-28 03:57:32,146][106226] Updated weights for policy 0, policy_version 1210650 (0.0006) [2023-12-28 03:57:32,178][106225] Updated weights for policy 1, policy_version 1213717 (0.0006) [2023-12-28 03:57:32,203][106226] Updated weights for policy 0, policy_version 1210660 (0.0010) [2023-12-28 03:57:32,238][106225] Updated weights for policy 1, policy_version 1213727 (0.0010) [2023-12-28 03:57:32,264][106226] Updated weights for policy 0, policy_version 1210670 (0.0010) [2023-12-28 03:57:32,323][106226] Updated weights for policy 0, policy_version 1210680 (0.0009) [2023-12-28 03:57:32,992][106225] Updated weights for policy 1, policy_version 1213737 (0.0009) [2023-12-28 03:57:33,035][106225] Updated weights for policy 1, policy_version 1213747 (0.0006) [2023-12-28 03:57:33,036][106226] Updated weights for policy 0, policy_version 1210690 (0.0010) [2023-12-28 03:57:33,078][106226] Updated weights for policy 0, policy_version 1210700 (0.0009) [2023-12-28 03:57:33,088][106225] Updated weights for policy 1, policy_version 1213757 (0.0007) [2023-12-28 03:57:33,124][106226] Updated weights for policy 0, policy_version 1210710 (0.0010) [2023-12-28 03:57:33,149][106225] Updated weights for policy 1, policy_version 1213767 (0.0006) [2023-12-28 03:57:33,811][106226] Updated weights for policy 0, policy_version 1210720 (0.0006) [2023-12-28 03:57:33,827][106225] Updated weights for policy 1, policy_version 1213777 (0.0010) [2023-12-28 03:57:33,866][106226] Updated weights for policy 0, policy_version 1210730 (0.0007) [2023-12-28 03:57:33,883][106225] Updated weights for policy 1, policy_version 1213787 (0.0010) [2023-12-28 03:57:33,922][106226] Updated weights for policy 0, policy_version 1210740 (0.0005) [2023-12-28 03:57:33,939][106225] Updated weights for policy 1, policy_version 1213797 (0.0010) [2023-12-28 03:57:34,612][106226] Updated weights for policy 0, policy_version 1210750 (0.0009) [2023-12-28 03:57:34,677][106226] Updated weights for policy 0, policy_version 1210760 (0.0011) [2023-12-28 03:57:34,720][106225] Updated weights for policy 1, policy_version 1213807 (0.0010) [2023-12-28 03:57:34,738][106226] Updated weights for policy 0, policy_version 1210770 (0.0011) [2023-12-28 03:57:34,782][106225] Updated weights for policy 1, policy_version 1213817 (0.0007) [2023-12-28 03:57:34,835][106225] Updated weights for policy 1, policy_version 1213827 (0.0007) [2023-12-28 03:57:35,457][106226] Updated weights for policy 0, policy_version 1210780 (0.0010) [2023-12-28 03:57:35,520][106226] Updated weights for policy 0, policy_version 1210790 (0.0011) [2023-12-28 03:57:35,572][106225] Updated weights for policy 1, policy_version 1213837 (0.0008) [2023-12-28 03:57:35,577][106226] Updated weights for policy 0, policy_version 1210800 (0.0010) [2023-12-28 03:57:35,622][106225] Updated weights for policy 1, policy_version 1213847 (0.0005) [2023-12-28 03:57:35,683][106225] Updated weights for policy 1, policy_version 1213857 (0.0008) [2023-12-28 03:57:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 620822528. Throughput: 0: 9881.2, 1: 9987.8. Samples: 620833048. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:36,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.873')] [2023-12-28 03:57:36,297][106226] Updated weights for policy 0, policy_version 1210810 (0.0011) [2023-12-28 03:57:36,359][106226] Updated weights for policy 0, policy_version 1210820 (0.0011) [2023-12-28 03:57:36,423][106226] Updated weights for policy 0, policy_version 1210830 (0.0011) [2023-12-28 03:57:36,430][106225] Updated weights for policy 1, policy_version 1213867 (0.0008) [2023-12-28 03:57:36,489][106226] Updated weights for policy 0, policy_version 1210840 (0.0011) [2023-12-28 03:57:36,495][106225] Updated weights for policy 1, policy_version 1213877 (0.0006) [2023-12-28 03:57:36,568][106225] Updated weights for policy 1, policy_version 1213887 (0.0008) [2023-12-28 03:57:37,215][106226] Updated weights for policy 0, policy_version 1210850 (0.0010) [2023-12-28 03:57:37,265][106226] Updated weights for policy 0, policy_version 1210860 (0.0010) [2023-12-28 03:57:37,293][106225] Updated weights for policy 1, policy_version 1213897 (0.0008) [2023-12-28 03:57:37,319][106226] Updated weights for policy 0, policy_version 1210870 (0.0011) [2023-12-28 03:57:37,349][106225] Updated weights for policy 1, policy_version 1213907 (0.0007) [2023-12-28 03:57:37,405][106225] Updated weights for policy 1, policy_version 1213917 (0.0007) [2023-12-28 03:57:37,463][106225] Updated weights for policy 1, policy_version 1213927 (0.0008) [2023-12-28 03:57:38,053][106226] Updated weights for policy 0, policy_version 1210880 (0.0011) [2023-12-28 03:57:38,107][106226] Updated weights for policy 0, policy_version 1210890 (0.0011) [2023-12-28 03:57:38,161][106226] Updated weights for policy 0, policy_version 1210900 (0.0011) [2023-12-28 03:57:38,195][106225] Updated weights for policy 1, policy_version 1213937 (0.0007) [2023-12-28 03:57:38,244][106225] Updated weights for policy 1, policy_version 1213947 (0.0007) [2023-12-28 03:57:38,305][106225] Updated weights for policy 1, policy_version 1213957 (0.0008) [2023-12-28 03:57:38,922][106226] Updated weights for policy 0, policy_version 1210910 (0.0011) [2023-12-28 03:57:38,992][106226] Updated weights for policy 0, policy_version 1210920 (0.0011) [2023-12-28 03:57:39,048][106226] Updated weights for policy 0, policy_version 1210930 (0.0010) [2023-12-28 03:57:39,098][106225] Updated weights for policy 1, policy_version 1213967 (0.0008) [2023-12-28 03:57:39,153][106225] Updated weights for policy 1, policy_version 1213977 (0.0008) [2023-12-28 03:57:39,223][106225] Updated weights for policy 1, policy_version 1213987 (0.0008) [2023-12-28 03:57:39,808][106226] Updated weights for policy 0, policy_version 1210940 (0.0011) [2023-12-28 03:57:39,880][106226] Updated weights for policy 0, policy_version 1210950 (0.0011) [2023-12-28 03:57:39,950][106226] Updated weights for policy 0, policy_version 1210960 (0.0011) [2023-12-28 03:57:40,037][106225] Updated weights for policy 1, policy_version 1213997 (0.0008) [2023-12-28 03:57:40,085][106225] Updated weights for policy 1, policy_version 1214007 (0.0008) [2023-12-28 03:57:40,137][106225] Updated weights for policy 1, policy_version 1214017 (0.0008) [2023-12-28 03:57:40,724][106226] Updated weights for policy 0, policy_version 1210970 (0.0010) [2023-12-28 03:57:40,777][106226] Updated weights for policy 0, policy_version 1210980 (0.0007) [2023-12-28 03:57:40,785][106225] Updated weights for policy 1, policy_version 1214027 (0.0007) [2023-12-28 03:57:40,833][106226] Updated weights for policy 0, policy_version 1210990 (0.0007) [2023-12-28 03:57:40,840][106225] Updated weights for policy 1, policy_version 1214037 (0.0007) [2023-12-28 03:57:40,886][106226] Updated weights for policy 0, policy_version 1211000 (0.0008) [2023-12-28 03:57:40,894][106225] Updated weights for policy 1, policy_version 1214047 (0.0008) [2023-12-28 03:57:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 620920832. Throughput: 0: 9874.0, 1: 9925.3. Samples: 620889624. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:41,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.742')] [2023-12-28 03:57:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001214056_310845440.pth... [2023-12-28 03:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001211000_310075392.pth... [2023-12-28 03:57:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001209848_309780480.pth [2023-12-28 03:57:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001212936_310558720.pth [2023-12-28 03:57:41,699][106225] Updated weights for policy 1, policy_version 1214057 (0.0008) [2023-12-28 03:57:41,707][106226] Updated weights for policy 0, policy_version 1211010 (0.0009) [2023-12-28 03:57:41,771][106225] Updated weights for policy 1, policy_version 1214067 (0.0008) [2023-12-28 03:57:41,778][106226] Updated weights for policy 0, policy_version 1211020 (0.0008) [2023-12-28 03:57:41,831][106225] Updated weights for policy 1, policy_version 1214077 (0.0008) [2023-12-28 03:57:41,846][106226] Updated weights for policy 0, policy_version 1211030 (0.0007) [2023-12-28 03:57:41,890][106225] Updated weights for policy 1, policy_version 1214087 (0.0008) [2023-12-28 03:57:42,527][106226] Updated weights for policy 0, policy_version 1211040 (0.0008) [2023-12-28 03:57:42,588][106226] Updated weights for policy 0, policy_version 1211050 (0.0008) [2023-12-28 03:57:42,649][106226] Updated weights for policy 0, policy_version 1211060 (0.0008) [2023-12-28 03:57:42,667][106225] Updated weights for policy 1, policy_version 1214097 (0.0006) [2023-12-28 03:57:42,725][106225] Updated weights for policy 1, policy_version 1214107 (0.0005) [2023-12-28 03:57:42,778][106225] Updated weights for policy 1, policy_version 1214117 (0.0007) [2023-12-28 03:57:43,423][106226] Updated weights for policy 0, policy_version 1211070 (0.0008) [2023-12-28 03:57:43,426][106225] Updated weights for policy 1, policy_version 1214127 (0.0006) [2023-12-28 03:57:43,491][106225] Updated weights for policy 1, policy_version 1214137 (0.0005) [2023-12-28 03:57:43,491][106226] Updated weights for policy 0, policy_version 1211080 (0.0009) [2023-12-28 03:57:43,542][106226] Updated weights for policy 0, policy_version 1211090 (0.0009) [2023-12-28 03:57:43,552][106225] Updated weights for policy 1, policy_version 1214147 (0.0005) [2023-12-28 03:57:44,078][106225] Updated weights for policy 1, policy_version 1214157 (0.0010) [2023-12-28 03:57:44,137][106225] Updated weights for policy 1, policy_version 1214167 (0.0010) [2023-12-28 03:57:44,186][106225] Updated weights for policy 1, policy_version 1214177 (0.0009) [2023-12-28 03:57:44,346][106226] Updated weights for policy 0, policy_version 1211100 (0.0009) [2023-12-28 03:57:44,409][106226] Updated weights for policy 0, policy_version 1211110 (0.0008) [2023-12-28 03:57:44,475][106226] Updated weights for policy 0, policy_version 1211120 (0.0008) [2023-12-28 03:57:44,915][106225] Updated weights for policy 1, policy_version 1214187 (0.0008) [2023-12-28 03:57:44,966][106225] Updated weights for policy 1, policy_version 1214197 (0.0008) [2023-12-28 03:57:45,026][106225] Updated weights for policy 1, policy_version 1214207 (0.0009) [2023-12-28 03:57:45,165][106226] Updated weights for policy 0, policy_version 1211130 (0.0007) [2023-12-28 03:57:45,230][106226] Updated weights for policy 0, policy_version 1211140 (0.0009) [2023-12-28 03:57:45,295][106226] Updated weights for policy 0, policy_version 1211150 (0.0009) [2023-12-28 03:57:45,358][106226] Updated weights for policy 0, policy_version 1211160 (0.0008) [2023-12-28 03:57:45,706][106225] Updated weights for policy 1, policy_version 1214217 (0.0010) [2023-12-28 03:57:45,774][106225] Updated weights for policy 1, policy_version 1214227 (0.0008) [2023-12-28 03:57:45,846][106225] Updated weights for policy 1, policy_version 1214237 (0.0007) [2023-12-28 03:57:45,908][106225] Updated weights for policy 1, policy_version 1214247 (0.0008) [2023-12-28 03:57:45,955][106226] Updated weights for policy 0, policy_version 1211170 (0.0005) [2023-12-28 03:57:46,017][106226] Updated weights for policy 0, policy_version 1211180 (0.0010) [2023-12-28 03:57:46,070][106226] Updated weights for policy 0, policy_version 1211190 (0.0010) [2023-12-28 03:57:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 621019136. Throughput: 0: 9888.0, 1: 9805.9. Samples: 621003872. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:46,176][105115] Avg episode reward: [(0, '-4.595'), (1, '-5.025')] [2023-12-28 03:57:46,517][106225] Updated weights for policy 1, policy_version 1214257 (0.0010) [2023-12-28 03:57:46,563][106225] Updated weights for policy 1, policy_version 1214267 (0.0008) [2023-12-28 03:57:46,617][106225] Updated weights for policy 1, policy_version 1214277 (0.0005) [2023-12-28 03:57:46,781][106226] Updated weights for policy 0, policy_version 1211200 (0.0011) [2023-12-28 03:57:46,838][106226] Updated weights for policy 0, policy_version 1211210 (0.0010) [2023-12-28 03:57:46,902][106226] Updated weights for policy 0, policy_version 1211220 (0.0011) [2023-12-28 03:57:47,228][106225] Updated weights for policy 1, policy_version 1214287 (0.0006) [2023-12-28 03:57:47,273][106225] Updated weights for policy 1, policy_version 1214297 (0.0006) [2023-12-28 03:57:47,339][106225] Updated weights for policy 1, policy_version 1214307 (0.0006) [2023-12-28 03:57:47,609][106226] Updated weights for policy 0, policy_version 1211230 (0.0007) [2023-12-28 03:57:47,670][106226] Updated weights for policy 0, policy_version 1211240 (0.0008) [2023-12-28 03:57:47,721][106226] Updated weights for policy 0, policy_version 1211250 (0.0007) [2023-12-28 03:57:47,924][106225] Updated weights for policy 1, policy_version 1214317 (0.0006) [2023-12-28 03:57:47,980][106225] Updated weights for policy 1, policy_version 1214327 (0.0008) [2023-12-28 03:57:48,041][106225] Updated weights for policy 1, policy_version 1214337 (0.0009) [2023-12-28 03:57:48,464][106226] Updated weights for policy 0, policy_version 1211260 (0.0008) [2023-12-28 03:57:48,512][106226] Updated weights for policy 0, policy_version 1211270 (0.0008) [2023-12-28 03:57:48,571][106226] Updated weights for policy 0, policy_version 1211280 (0.0009) [2023-12-28 03:57:48,782][106225] Updated weights for policy 1, policy_version 1214347 (0.0008) [2023-12-28 03:57:48,848][106225] Updated weights for policy 1, policy_version 1214357 (0.0008) [2023-12-28 03:57:48,917][106225] Updated weights for policy 1, policy_version 1214367 (0.0008) [2023-12-28 03:57:49,357][106226] Updated weights for policy 0, policy_version 1211290 (0.0008) [2023-12-28 03:57:49,414][106226] Updated weights for policy 0, policy_version 1211300 (0.0007) [2023-12-28 03:57:49,471][106226] Updated weights for policy 0, policy_version 1211310 (0.0005) [2023-12-28 03:57:49,527][106226] Updated weights for policy 0, policy_version 1211320 (0.0006) [2023-12-28 03:57:49,580][106225] Updated weights for policy 1, policy_version 1214377 (0.0007) [2023-12-28 03:57:49,645][106225] Updated weights for policy 1, policy_version 1214387 (0.0008) [2023-12-28 03:57:49,710][106225] Updated weights for policy 1, policy_version 1214397 (0.0008) [2023-12-28 03:57:49,772][106225] Updated weights for policy 1, policy_version 1214407 (0.0008) [2023-12-28 03:57:50,249][106226] Updated weights for policy 0, policy_version 1211330 (0.0008) [2023-12-28 03:57:50,304][106226] Updated weights for policy 0, policy_version 1211340 (0.0007) [2023-12-28 03:57:50,368][106226] Updated weights for policy 0, policy_version 1211350 (0.0005) [2023-12-28 03:57:50,499][106225] Updated weights for policy 1, policy_version 1214417 (0.0008) [2023-12-28 03:57:50,557][106225] Updated weights for policy 1, policy_version 1214427 (0.0010) [2023-12-28 03:57:50,624][106225] Updated weights for policy 1, policy_version 1214437 (0.0007) [2023-12-28 03:57:51,068][106226] Updated weights for policy 0, policy_version 1211360 (0.0009) [2023-12-28 03:57:51,139][106226] Updated weights for policy 0, policy_version 1211370 (0.0007) [2023-12-28 03:57:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 621109248. Throughput: 0: 9881.2, 1: 9795.2. Samples: 621124012. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:51,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.114')] [2023-12-28 03:57:51,206][106226] Updated weights for policy 0, policy_version 1211380 (0.0008) [2023-12-28 03:57:51,318][106225] Updated weights for policy 1, policy_version 1214447 (0.0009) [2023-12-28 03:57:51,385][106225] Updated weights for policy 1, policy_version 1214457 (0.0009) [2023-12-28 03:57:51,450][106225] Updated weights for policy 1, policy_version 1214467 (0.0006) [2023-12-28 03:57:51,904][106226] Updated weights for policy 0, policy_version 1211390 (0.0006) [2023-12-28 03:57:51,961][106226] Updated weights for policy 0, policy_version 1211400 (0.0005) [2023-12-28 03:57:52,012][106226] Updated weights for policy 0, policy_version 1211410 (0.0005) [2023-12-28 03:57:52,189][106225] Updated weights for policy 1, policy_version 1214477 (0.0008) [2023-12-28 03:57:52,247][106225] Updated weights for policy 1, policy_version 1214487 (0.0008) [2023-12-28 03:57:52,306][106225] Updated weights for policy 1, policy_version 1214497 (0.0006) [2023-12-28 03:57:52,695][106226] Updated weights for policy 0, policy_version 1211420 (0.0007) [2023-12-28 03:57:52,750][106226] Updated weights for policy 0, policy_version 1211430 (0.0008) [2023-12-28 03:57:52,807][106226] Updated weights for policy 0, policy_version 1211440 (0.0009) [2023-12-28 03:57:53,005][106225] Updated weights for policy 1, policy_version 1214507 (0.0009) [2023-12-28 03:57:53,052][106225] Updated weights for policy 1, policy_version 1214517 (0.0009) [2023-12-28 03:57:53,115][106225] Updated weights for policy 1, policy_version 1214527 (0.0007) [2023-12-28 03:57:53,448][106226] Updated weights for policy 0, policy_version 1211450 (0.0010) [2023-12-28 03:57:53,496][106226] Updated weights for policy 0, policy_version 1211460 (0.0009) [2023-12-28 03:57:53,544][106226] Updated weights for policy 0, policy_version 1211470 (0.0008) [2023-12-28 03:57:53,596][106226] Updated weights for policy 0, policy_version 1211480 (0.0008) [2023-12-28 03:57:53,884][106225] Updated weights for policy 1, policy_version 1214537 (0.0009) [2023-12-28 03:57:53,945][106225] Updated weights for policy 1, policy_version 1214547 (0.0008) [2023-12-28 03:57:53,994][106225] Updated weights for policy 1, policy_version 1214557 (0.0008) [2023-12-28 03:57:54,042][106225] Updated weights for policy 1, policy_version 1214567 (0.0008) [2023-12-28 03:57:54,290][106226] Updated weights for policy 0, policy_version 1211490 (0.0010) [2023-12-28 03:57:54,343][106226] Updated weights for policy 0, policy_version 1211500 (0.0010) [2023-12-28 03:57:54,395][106226] Updated weights for policy 0, policy_version 1211510 (0.0009) [2023-12-28 03:57:54,836][106225] Updated weights for policy 1, policy_version 1214577 (0.0009) [2023-12-28 03:57:54,904][106225] Updated weights for policy 1, policy_version 1214587 (0.0009) [2023-12-28 03:57:54,972][106225] Updated weights for policy 1, policy_version 1214597 (0.0008) [2023-12-28 03:57:55,008][106226] Updated weights for policy 0, policy_version 1211520 (0.0008) [2023-12-28 03:57:55,065][106226] Updated weights for policy 0, policy_version 1211530 (0.0008) [2023-12-28 03:57:55,128][106226] Updated weights for policy 0, policy_version 1211540 (0.0006) [2023-12-28 03:57:55,650][106225] Updated weights for policy 1, policy_version 1214607 (0.0006) [2023-12-28 03:57:55,715][106225] Updated weights for policy 1, policy_version 1214617 (0.0008) [2023-12-28 03:57:55,765][106225] Updated weights for policy 1, policy_version 1214627 (0.0010) [2023-12-28 03:57:55,811][106226] Updated weights for policy 0, policy_version 1211550 (0.0007) [2023-12-28 03:57:55,871][106226] Updated weights for policy 0, policy_version 1211560 (0.0005) [2023-12-28 03:57:55,930][106226] Updated weights for policy 0, policy_version 1211570 (0.0007) [2023-12-28 03:57:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 621215744. Throughput: 0: 9833.3, 1: 9772.3. Samples: 621183092. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:57:56,176][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.813')] [2023-12-28 03:57:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001214632_310992896.pth... [2023-12-28 03:57:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001211576_310222848.pth... [2023-12-28 03:57:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001213480_310697984.pth [2023-12-28 03:57:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001210424_309927936.pth [2023-12-28 03:57:56,405][106225] Updated weights for policy 1, policy_version 1214637 (0.0008) [2023-12-28 03:57:56,465][106225] Updated weights for policy 1, policy_version 1214647 (0.0008) [2023-12-28 03:57:56,521][106225] Updated weights for policy 1, policy_version 1214657 (0.0007) [2023-12-28 03:57:56,617][106226] Updated weights for policy 0, policy_version 1211580 (0.0007) [2023-12-28 03:57:56,670][106226] Updated weights for policy 0, policy_version 1211590 (0.0008) [2023-12-28 03:57:56,718][106226] Updated weights for policy 0, policy_version 1211600 (0.0008) [2023-12-28 03:57:57,046][106225] Updated weights for policy 1, policy_version 1214667 (0.0009) [2023-12-28 03:57:57,105][106225] Updated weights for policy 1, policy_version 1214677 (0.0005) [2023-12-28 03:57:57,155][106225] Updated weights for policy 1, policy_version 1214687 (0.0005) [2023-12-28 03:57:57,505][106226] Updated weights for policy 0, policy_version 1211611 (0.0009) [2023-12-28 03:57:57,553][106226] Updated weights for policy 0, policy_version 1211621 (0.0007) [2023-12-28 03:57:57,599][106226] Updated weights for policy 0, policy_version 1211631 (0.0007) [2023-12-28 03:57:57,824][106225] Updated weights for policy 1, policy_version 1214697 (0.0008) [2023-12-28 03:57:57,881][106225] Updated weights for policy 1, policy_version 1214707 (0.0010) [2023-12-28 03:57:57,942][106225] Updated weights for policy 1, policy_version 1214717 (0.0010) [2023-12-28 03:57:58,004][106225] Updated weights for policy 1, policy_version 1214727 (0.0011) [2023-12-28 03:57:58,370][106226] Updated weights for policy 0, policy_version 1211641 (0.0008) [2023-12-28 03:57:58,438][106226] Updated weights for policy 0, policy_version 1211651 (0.0008) [2023-12-28 03:57:58,499][106226] Updated weights for policy 0, policy_version 1211661 (0.0008) [2023-12-28 03:57:58,559][106226] Updated weights for policy 0, policy_version 1211671 (0.0008) [2023-12-28 03:57:58,797][106225] Updated weights for policy 1, policy_version 1214737 (0.0008) [2023-12-28 03:57:58,863][106225] Updated weights for policy 1, policy_version 1214747 (0.0008) [2023-12-28 03:57:58,931][106225] Updated weights for policy 1, policy_version 1214757 (0.0008) [2023-12-28 03:57:59,408][106226] Updated weights for policy 0, policy_version 1211681 (0.0008) [2023-12-28 03:57:59,472][106226] Updated weights for policy 0, policy_version 1211691 (0.0007) [2023-12-28 03:57:59,536][106226] Updated weights for policy 0, policy_version 1211701 (0.0010) [2023-12-28 03:57:59,694][106225] Updated weights for policy 1, policy_version 1214767 (0.0010) [2023-12-28 03:57:59,759][106225] Updated weights for policy 1, policy_version 1214777 (0.0010) [2023-12-28 03:57:59,824][106225] Updated weights for policy 1, policy_version 1214787 (0.0008) [2023-12-28 03:58:00,219][106226] Updated weights for policy 0, policy_version 1211711 (0.0007) [2023-12-28 03:58:00,278][106226] Updated weights for policy 0, policy_version 1211721 (0.0008) [2023-12-28 03:58:00,342][106226] Updated weights for policy 0, policy_version 1211731 (0.0008) [2023-12-28 03:58:00,490][106225] Updated weights for policy 1, policy_version 1214797 (0.0006) [2023-12-28 03:58:00,544][106225] Updated weights for policy 1, policy_version 1214807 (0.0008) [2023-12-28 03:58:00,601][106225] Updated weights for policy 1, policy_version 1214817 (0.0008) [2023-12-28 03:58:01,151][106226] Updated weights for policy 0, policy_version 1211741 (0.0008) [2023-12-28 03:58:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 621305856. Throughput: 0: 9831.8, 1: 9782.8. Samples: 621300052. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:01,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.809')] [2023-12-28 03:58:01,203][106226] Updated weights for policy 0, policy_version 1211751 (0.0009) [2023-12-28 03:58:01,256][106226] Updated weights for policy 0, policy_version 1211761 (0.0009) [2023-12-28 03:58:01,271][106225] Updated weights for policy 1, policy_version 1214827 (0.0008) [2023-12-28 03:58:01,328][106225] Updated weights for policy 1, policy_version 1214837 (0.0009) [2023-12-28 03:58:01,396][106225] Updated weights for policy 1, policy_version 1214847 (0.0009) [2023-12-28 03:58:02,043][106226] Updated weights for policy 0, policy_version 1211771 (0.0009) [2023-12-28 03:58:02,103][106226] Updated weights for policy 0, policy_version 1211781 (0.0008) [2023-12-28 03:58:02,112][106225] Updated weights for policy 1, policy_version 1214857 (0.0009) [2023-12-28 03:58:02,161][106225] Updated weights for policy 1, policy_version 1214867 (0.0007) [2023-12-28 03:58:02,169][106226] Updated weights for policy 0, policy_version 1211791 (0.0008) [2023-12-28 03:58:02,219][106225] Updated weights for policy 1, policy_version 1214877 (0.0008) [2023-12-28 03:58:02,278][106225] Updated weights for policy 1, policy_version 1214887 (0.0007) [2023-12-28 03:58:02,861][106226] Updated weights for policy 0, policy_version 1211801 (0.0006) [2023-12-28 03:58:02,913][106226] Updated weights for policy 0, policy_version 1211811 (0.0008) [2023-12-28 03:58:02,961][106225] Updated weights for policy 1, policy_version 1214897 (0.0008) [2023-12-28 03:58:02,968][106226] Updated weights for policy 0, policy_version 1211821 (0.0006) [2023-12-28 03:58:03,019][106226] Updated weights for policy 0, policy_version 1211831 (0.0005) [2023-12-28 03:58:03,020][106225] Updated weights for policy 1, policy_version 1214907 (0.0008) [2023-12-28 03:58:03,065][106225] Updated weights for policy 1, policy_version 1214917 (0.0008) [2023-12-28 03:58:03,650][106226] Updated weights for policy 0, policy_version 1211841 (0.0009) [2023-12-28 03:58:03,708][106226] Updated weights for policy 0, policy_version 1211851 (0.0008) [2023-12-28 03:58:03,772][106226] Updated weights for policy 0, policy_version 1211861 (0.0008) [2023-12-28 03:58:03,820][106225] Updated weights for policy 1, policy_version 1214927 (0.0006) [2023-12-28 03:58:03,887][106225] Updated weights for policy 1, policy_version 1214937 (0.0007) [2023-12-28 03:58:03,938][106225] Updated weights for policy 1, policy_version 1214947 (0.0005) [2023-12-28 03:58:04,526][106226] Updated weights for policy 0, policy_version 1211871 (0.0009) [2023-12-28 03:58:04,573][106226] Updated weights for policy 0, policy_version 1211881 (0.0009) [2023-12-28 03:58:04,595][106225] Updated weights for policy 1, policy_version 1214957 (0.0007) [2023-12-28 03:58:04,618][106226] Updated weights for policy 0, policy_version 1211891 (0.0005) [2023-12-28 03:58:04,660][106225] Updated weights for policy 1, policy_version 1214967 (0.0009) [2023-12-28 03:58:04,722][106225] Updated weights for policy 1, policy_version 1214977 (0.0009) [2023-12-28 03:58:05,352][106226] Updated weights for policy 0, policy_version 1211901 (0.0007) [2023-12-28 03:58:05,402][106226] Updated weights for policy 0, policy_version 1211911 (0.0009) [2023-12-28 03:58:05,404][106225] Updated weights for policy 1, policy_version 1214987 (0.0008) [2023-12-28 03:58:05,457][106226] Updated weights for policy 0, policy_version 1211921 (0.0006) [2023-12-28 03:58:05,462][106225] Updated weights for policy 1, policy_version 1214997 (0.0006) [2023-12-28 03:58:05,524][106225] Updated weights for policy 1, policy_version 1215007 (0.0008) [2023-12-28 03:58:06,101][106225] Updated weights for policy 1, policy_version 1215017 (0.0008) [2023-12-28 03:58:06,173][106225] Updated weights for policy 1, policy_version 1215027 (0.0008) [2023-12-28 03:58:06,174][105115] Fps is (10 sec: 18842.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 621404160. Throughput: 0: 9787.7, 1: 9835.9. Samples: 621417800. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:06,175][105115] Avg episode reward: [(0, '-4.283'), (1, '-4.723')] [2023-12-28 03:58:06,231][106225] Updated weights for policy 1, policy_version 1215037 (0.0007) [2023-12-28 03:58:06,265][106226] Updated weights for policy 0, policy_version 1211931 (0.0006) [2023-12-28 03:58:06,294][106225] Updated weights for policy 1, policy_version 1215047 (0.0008) [2023-12-28 03:58:06,322][106226] Updated weights for policy 0, policy_version 1211941 (0.0007) [2023-12-28 03:58:06,383][106226] Updated weights for policy 0, policy_version 1211951 (0.0009) [2023-12-28 03:58:07,011][106225] Updated weights for policy 1, policy_version 1215057 (0.0007) [2023-12-28 03:58:07,078][106225] Updated weights for policy 1, policy_version 1215067 (0.0008) [2023-12-28 03:58:07,135][106226] Updated weights for policy 0, policy_version 1211961 (0.0008) [2023-12-28 03:58:07,140][106225] Updated weights for policy 1, policy_version 1215077 (0.0009) [2023-12-28 03:58:07,187][106226] Updated weights for policy 0, policy_version 1211971 (0.0008) [2023-12-28 03:58:07,237][106226] Updated weights for policy 0, policy_version 1211981 (0.0009) [2023-12-28 03:58:07,286][106226] Updated weights for policy 0, policy_version 1211991 (0.0008) [2023-12-28 03:58:07,815][106225] Updated weights for policy 1, policy_version 1215087 (0.0008) [2023-12-28 03:58:07,859][106225] Updated weights for policy 1, policy_version 1215097 (0.0008) [2023-12-28 03:58:07,911][106225] Updated weights for policy 1, policy_version 1215107 (0.0008) [2023-12-28 03:58:08,033][106226] Updated weights for policy 0, policy_version 1212001 (0.0009) [2023-12-28 03:58:08,082][106226] Updated weights for policy 0, policy_version 1212011 (0.0008) [2023-12-28 03:58:08,136][106226] Updated weights for policy 0, policy_version 1212022 (0.0007) [2023-12-28 03:58:08,586][106225] Updated weights for policy 1, policy_version 1215117 (0.0009) [2023-12-28 03:58:08,641][106225] Updated weights for policy 1, policy_version 1215127 (0.0008) [2023-12-28 03:58:08,700][106225] Updated weights for policy 1, policy_version 1215137 (0.0009) [2023-12-28 03:58:08,898][106226] Updated weights for policy 0, policy_version 1212032 (0.0009) [2023-12-28 03:58:08,951][106226] Updated weights for policy 0, policy_version 1212042 (0.0009) [2023-12-28 03:58:09,010][106226] Updated weights for policy 0, policy_version 1212052 (0.0008) [2023-12-28 03:58:09,456][106225] Updated weights for policy 1, policy_version 1215147 (0.0008) [2023-12-28 03:58:09,519][106225] Updated weights for policy 1, policy_version 1215157 (0.0008) [2023-12-28 03:58:09,575][106225] Updated weights for policy 1, policy_version 1215167 (0.0008) [2023-12-28 03:58:09,768][106226] Updated weights for policy 0, policy_version 1212062 (0.0008) [2023-12-28 03:58:09,831][106226] Updated weights for policy 0, policy_version 1212072 (0.0008) [2023-12-28 03:58:09,900][106226] Updated weights for policy 0, policy_version 1212082 (0.0008) [2023-12-28 03:58:10,346][106225] Updated weights for policy 1, policy_version 1215177 (0.0007) [2023-12-28 03:58:10,415][106225] Updated weights for policy 1, policy_version 1215187 (0.0009) [2023-12-28 03:58:10,478][106225] Updated weights for policy 1, policy_version 1215197 (0.0007) [2023-12-28 03:58:10,545][106225] Updated weights for policy 1, policy_version 1215207 (0.0005) [2023-12-28 03:58:10,633][106226] Updated weights for policy 0, policy_version 1212092 (0.0009) [2023-12-28 03:58:10,687][106226] Updated weights for policy 0, policy_version 1212102 (0.0009) [2023-12-28 03:58:10,740][106226] Updated weights for policy 0, policy_version 1212112 (0.0008) [2023-12-28 03:58:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 621502464. Throughput: 0: 9745.1, 1: 9906.0. Samples: 621475924. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:11,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.036')] [2023-12-28 03:58:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001212120_310362112.pth... [2023-12-28 03:58:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001211000_310075392.pth [2023-12-28 03:58:11,222][106225] Updated weights for policy 1, policy_version 1215217 (0.0008) [2023-12-28 03:58:11,291][106225] Updated weights for policy 1, policy_version 1215227 (0.0008) [2023-12-28 03:58:11,355][106225] Updated weights for policy 1, policy_version 1215237 (0.0009) [2023-12-28 03:58:11,384][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001215240_311148544.pth... [2023-12-28 03:58:11,388][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001214056_310845440.pth [2023-12-28 03:58:11,529][106226] Updated weights for policy 0, policy_version 1212122 (0.0008) [2023-12-28 03:58:11,591][106226] Updated weights for policy 0, policy_version 1212132 (0.0006) [2023-12-28 03:58:11,660][106226] Updated weights for policy 0, policy_version 1212142 (0.0009) [2023-12-28 03:58:11,721][106226] Updated weights for policy 0, policy_version 1212152 (0.0008) [2023-12-28 03:58:12,141][106225] Updated weights for policy 1, policy_version 1215247 (0.0009) [2023-12-28 03:58:12,195][106225] Updated weights for policy 1, policy_version 1215257 (0.0009) [2023-12-28 03:58:12,249][106225] Updated weights for policy 1, policy_version 1215267 (0.0009) [2023-12-28 03:58:12,435][106226] Updated weights for policy 0, policy_version 1212162 (0.0005) [2023-12-28 03:58:12,501][106226] Updated weights for policy 0, policy_version 1212172 (0.0006) [2023-12-28 03:58:12,564][106226] Updated weights for policy 0, policy_version 1212182 (0.0008) [2023-12-28 03:58:13,039][106225] Updated weights for policy 1, policy_version 1215277 (0.0008) [2023-12-28 03:58:13,101][106225] Updated weights for policy 1, policy_version 1215287 (0.0008) [2023-12-28 03:58:13,158][106225] Updated weights for policy 1, policy_version 1215297 (0.0009) [2023-12-28 03:58:13,203][106226] Updated weights for policy 0, policy_version 1212192 (0.0006) [2023-12-28 03:58:13,266][106226] Updated weights for policy 0, policy_version 1212202 (0.0007) [2023-12-28 03:58:13,316][106226] Updated weights for policy 0, policy_version 1212212 (0.0008) [2023-12-28 03:58:13,902][106225] Updated weights for policy 1, policy_version 1215307 (0.0008) [2023-12-28 03:58:13,961][106225] Updated weights for policy 1, policy_version 1215317 (0.0009) [2023-12-28 03:58:14,014][106225] Updated weights for policy 1, policy_version 1215327 (0.0008) [2023-12-28 03:58:14,034][106226] Updated weights for policy 0, policy_version 1212222 (0.0009) [2023-12-28 03:58:14,088][106226] Updated weights for policy 0, policy_version 1212232 (0.0007) [2023-12-28 03:58:14,141][106226] Updated weights for policy 0, policy_version 1212242 (0.0009) [2023-12-28 03:58:14,768][106225] Updated weights for policy 1, policy_version 1215337 (0.0008) [2023-12-28 03:58:14,832][106225] Updated weights for policy 1, policy_version 1215347 (0.0009) [2023-12-28 03:58:14,891][106225] Updated weights for policy 1, policy_version 1215357 (0.0009) [2023-12-28 03:58:14,907][106226] Updated weights for policy 0, policy_version 1212252 (0.0008) [2023-12-28 03:58:14,955][106225] Updated weights for policy 1, policy_version 1215367 (0.0008) [2023-12-28 03:58:14,968][106226] Updated weights for policy 0, policy_version 1212262 (0.0008) [2023-12-28 03:58:15,022][106226] Updated weights for policy 0, policy_version 1212272 (0.0009) [2023-12-28 03:58:15,667][106225] Updated weights for policy 1, policy_version 1215377 (0.0008) [2023-12-28 03:58:15,711][106225] Updated weights for policy 1, policy_version 1215387 (0.0008) [2023-12-28 03:58:15,758][106225] Updated weights for policy 1, policy_version 1215397 (0.0008) [2023-12-28 03:58:15,763][106226] Updated weights for policy 0, policy_version 1212282 (0.0009) [2023-12-28 03:58:15,817][106226] Updated weights for policy 0, policy_version 1212292 (0.0010) [2023-12-28 03:58:15,879][106226] Updated weights for policy 0, policy_version 1212302 (0.0010) [2023-12-28 03:58:15,925][106226] Updated weights for policy 0, policy_version 1212312 (0.0010) [2023-12-28 03:58:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 621600768. Throughput: 0: 9603.5, 1: 9789.3. Samples: 621588620. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:16,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.941')] [2023-12-28 03:58:16,510][106225] Updated weights for policy 1, policy_version 1215407 (0.0007) [2023-12-28 03:58:16,580][106225] Updated weights for policy 1, policy_version 1215417 (0.0008) [2023-12-28 03:58:16,632][106225] Updated weights for policy 1, policy_version 1215427 (0.0006) [2023-12-28 03:58:16,638][106226] Updated weights for policy 0, policy_version 1212322 (0.0010) [2023-12-28 03:58:16,684][106226] Updated weights for policy 0, policy_version 1212332 (0.0010) [2023-12-28 03:58:16,727][106226] Updated weights for policy 0, policy_version 1212342 (0.0010) [2023-12-28 03:58:17,347][106225] Updated weights for policy 1, policy_version 1215437 (0.0007) [2023-12-28 03:58:17,403][106225] Updated weights for policy 1, policy_version 1215447 (0.0008) [2023-12-28 03:58:17,467][106225] Updated weights for policy 1, policy_version 1215457 (0.0008) [2023-12-28 03:58:17,480][106226] Updated weights for policy 0, policy_version 1212352 (0.0006) [2023-12-28 03:58:17,537][106226] Updated weights for policy 0, policy_version 1212362 (0.0006) [2023-12-28 03:58:17,601][106226] Updated weights for policy 0, policy_version 1212372 (0.0008) [2023-12-28 03:58:18,166][106225] Updated weights for policy 1, policy_version 1215467 (0.0008) [2023-12-28 03:58:18,220][106225] Updated weights for policy 1, policy_version 1215477 (0.0010) [2023-12-28 03:58:18,243][106226] Updated weights for policy 0, policy_version 1212382 (0.0007) [2023-12-28 03:58:18,270][106225] Updated weights for policy 1, policy_version 1215487 (0.0010) [2023-12-28 03:58:18,298][106226] Updated weights for policy 0, policy_version 1212392 (0.0008) [2023-12-28 03:58:18,366][106226] Updated weights for policy 0, policy_version 1212402 (0.0009) [2023-12-28 03:58:19,037][106226] Updated weights for policy 0, policy_version 1212412 (0.0011) [2023-12-28 03:58:19,072][106225] Updated weights for policy 1, policy_version 1215497 (0.0010) [2023-12-28 03:58:19,097][106226] Updated weights for policy 0, policy_version 1212422 (0.0011) [2023-12-28 03:58:19,130][106225] Updated weights for policy 1, policy_version 1215507 (0.0006) [2023-12-28 03:58:19,162][106226] Updated weights for policy 0, policy_version 1212432 (0.0011) [2023-12-28 03:58:19,180][106225] Updated weights for policy 1, policy_version 1215517 (0.0006) [2023-12-28 03:58:19,236][106225] Updated weights for policy 1, policy_version 1215527 (0.0009) [2023-12-28 03:58:19,886][106226] Updated weights for policy 0, policy_version 1212442 (0.0011) [2023-12-28 03:58:19,951][106226] Updated weights for policy 0, policy_version 1212452 (0.0010) [2023-12-28 03:58:20,016][106226] Updated weights for policy 0, policy_version 1212462 (0.0010) [2023-12-28 03:58:20,034][106225] Updated weights for policy 1, policy_version 1215537 (0.0007) [2023-12-28 03:58:20,077][106226] Updated weights for policy 0, policy_version 1212472 (0.0007) [2023-12-28 03:58:20,088][106225] Updated weights for policy 1, policy_version 1215547 (0.0006) [2023-12-28 03:58:20,139][106225] Updated weights for policy 1, policy_version 1215557 (0.0008) [2023-12-28 03:58:20,856][106225] Updated weights for policy 1, policy_version 1215567 (0.0007) [2023-12-28 03:58:20,864][106226] Updated weights for policy 0, policy_version 1212482 (0.0011) [2023-12-28 03:58:20,909][106225] Updated weights for policy 1, policy_version 1215577 (0.0008) [2023-12-28 03:58:20,933][106226] Updated weights for policy 0, policy_version 1212492 (0.0009) [2023-12-28 03:58:20,968][106225] Updated weights for policy 1, policy_version 1215587 (0.0008) [2023-12-28 03:58:21,001][106226] Updated weights for policy 0, policy_version 1212502 (0.0011) [2023-12-28 03:58:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 621699072. Throughput: 0: 9568.5, 1: 9782.1. Samples: 621703828. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:21,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-5.016')] [2023-12-28 03:58:21,766][106226] Updated weights for policy 0, policy_version 1212512 (0.0010) [2023-12-28 03:58:21,813][106225] Updated weights for policy 1, policy_version 1215597 (0.0005) [2023-12-28 03:58:21,823][106226] Updated weights for policy 0, policy_version 1212522 (0.0008) [2023-12-28 03:58:21,871][106225] Updated weights for policy 1, policy_version 1215607 (0.0006) [2023-12-28 03:58:21,883][106226] Updated weights for policy 0, policy_version 1212532 (0.0007) [2023-12-28 03:58:21,936][106225] Updated weights for policy 1, policy_version 1215617 (0.0006) [2023-12-28 03:58:22,602][106225] Updated weights for policy 1, policy_version 1215627 (0.0008) [2023-12-28 03:58:22,667][106225] Updated weights for policy 1, policy_version 1215637 (0.0008) [2023-12-28 03:58:22,706][106226] Updated weights for policy 0, policy_version 1212542 (0.0007) [2023-12-28 03:58:22,724][106225] Updated weights for policy 1, policy_version 1215647 (0.0009) [2023-12-28 03:58:22,765][106226] Updated weights for policy 0, policy_version 1212552 (0.0008) [2023-12-28 03:58:22,831][106226] Updated weights for policy 0, policy_version 1212562 (0.0008) [2023-12-28 03:58:23,430][106225] Updated weights for policy 1, policy_version 1215657 (0.0006) [2023-12-28 03:58:23,482][106225] Updated weights for policy 1, policy_version 1215667 (0.0008) [2023-12-28 03:58:23,519][106226] Updated weights for policy 0, policy_version 1212572 (0.0008) [2023-12-28 03:58:23,537][106225] Updated weights for policy 1, policy_version 1215677 (0.0006) [2023-12-28 03:58:23,573][106226] Updated weights for policy 0, policy_version 1212582 (0.0006) [2023-12-28 03:58:23,591][106225] Updated weights for policy 1, policy_version 1215687 (0.0006) [2023-12-28 03:58:23,625][106226] Updated weights for policy 0, policy_version 1212592 (0.0007) [2023-12-28 03:58:24,277][106225] Updated weights for policy 1, policy_version 1215697 (0.0010) [2023-12-28 03:58:24,341][106225] Updated weights for policy 1, policy_version 1215707 (0.0010) [2023-12-28 03:58:24,366][106226] Updated weights for policy 0, policy_version 1212602 (0.0008) [2023-12-28 03:58:24,402][106225] Updated weights for policy 1, policy_version 1215717 (0.0010) [2023-12-28 03:58:24,423][106226] Updated weights for policy 0, policy_version 1212612 (0.0006) [2023-12-28 03:58:24,469][106226] Updated weights for policy 0, policy_version 1212622 (0.0008) [2023-12-28 03:58:24,523][106226] Updated weights for policy 0, policy_version 1212632 (0.0007) [2023-12-28 03:58:25,046][106225] Updated weights for policy 1, policy_version 1215727 (0.0010) [2023-12-28 03:58:25,110][106225] Updated weights for policy 1, policy_version 1215737 (0.0010) [2023-12-28 03:58:25,174][106225] Updated weights for policy 1, policy_version 1215747 (0.0010) [2023-12-28 03:58:25,302][106226] Updated weights for policy 0, policy_version 1212642 (0.0008) [2023-12-28 03:58:25,355][106226] Updated weights for policy 0, policy_version 1212652 (0.0007) [2023-12-28 03:58:25,403][106226] Updated weights for policy 0, policy_version 1212662 (0.0008) [2023-12-28 03:58:25,795][106225] Updated weights for policy 1, policy_version 1215757 (0.0008) [2023-12-28 03:58:25,852][106225] Updated weights for policy 1, policy_version 1215767 (0.0005) [2023-12-28 03:58:25,906][106225] Updated weights for policy 1, policy_version 1215777 (0.0009) [2023-12-28 03:58:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 621789184. Throughput: 0: 9551.2, 1: 9787.0. Samples: 621759844. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:26,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.726')] [2023-12-28 03:58:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001215784_311287808.pth... [2023-12-28 03:58:26,183][106226] Updated weights for policy 0, policy_version 1212672 (0.0006) [2023-12-28 03:58:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001214632_310992896.pth [2023-12-28 03:58:26,241][106226] Updated weights for policy 0, policy_version 1212682 (0.0009) [2023-12-28 03:58:26,294][106226] Updated weights for policy 0, policy_version 1212692 (0.0009) [2023-12-28 03:58:26,313][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001212696_310509568.pth... [2023-12-28 03:58:26,316][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001211576_310222848.pth [2023-12-28 03:58:26,475][106225] Updated weights for policy 1, policy_version 1215787 (0.0010) [2023-12-28 03:58:26,541][106225] Updated weights for policy 1, policy_version 1215797 (0.0010) [2023-12-28 03:58:26,597][106225] Updated weights for policy 1, policy_version 1215807 (0.0008) [2023-12-28 03:58:26,878][106226] Updated weights for policy 0, policy_version 1212702 (0.0007) [2023-12-28 03:58:26,933][106226] Updated weights for policy 0, policy_version 1212712 (0.0005) [2023-12-28 03:58:26,989][106226] Updated weights for policy 0, policy_version 1212722 (0.0005) [2023-12-28 03:58:27,259][106225] Updated weights for policy 1, policy_version 1215817 (0.0006) [2023-12-28 03:58:27,305][106225] Updated weights for policy 1, policy_version 1215827 (0.0010) [2023-12-28 03:58:27,360][106225] Updated weights for policy 1, policy_version 1215837 (0.0010) [2023-12-28 03:58:27,410][106225] Updated weights for policy 1, policy_version 1215847 (0.0010) [2023-12-28 03:58:27,586][106226] Updated weights for policy 0, policy_version 1212732 (0.0006) [2023-12-28 03:58:27,632][106226] Updated weights for policy 0, policy_version 1212742 (0.0008) [2023-12-28 03:58:27,685][106226] Updated weights for policy 0, policy_version 1212752 (0.0009) [2023-12-28 03:58:28,116][106225] Updated weights for policy 1, policy_version 1215857 (0.0010) [2023-12-28 03:58:28,169][106225] Updated weights for policy 1, policy_version 1215867 (0.0010) [2023-12-28 03:58:28,212][106225] Updated weights for policy 1, policy_version 1215877 (0.0010) [2023-12-28 03:58:28,325][106226] Updated weights for policy 0, policy_version 1212762 (0.0009) [2023-12-28 03:58:28,387][106226] Updated weights for policy 0, policy_version 1212772 (0.0009) [2023-12-28 03:58:28,446][106226] Updated weights for policy 0, policy_version 1212782 (0.0011) [2023-12-28 03:58:28,506][106226] Updated weights for policy 0, policy_version 1212792 (0.0011) [2023-12-28 03:58:28,811][106225] Updated weights for policy 1, policy_version 1215887 (0.0009) [2023-12-28 03:58:28,871][106225] Updated weights for policy 1, policy_version 1215897 (0.0010) [2023-12-28 03:58:28,935][106225] Updated weights for policy 1, policy_version 1215907 (0.0010) [2023-12-28 03:58:29,197][106226] Updated weights for policy 0, policy_version 1212802 (0.0007) [2023-12-28 03:58:29,265][106226] Updated weights for policy 0, policy_version 1212812 (0.0008) [2023-12-28 03:58:29,332][106226] Updated weights for policy 0, policy_version 1212822 (0.0008) [2023-12-28 03:58:29,648][106225] Updated weights for policy 1, policy_version 1215917 (0.0008) [2023-12-28 03:58:29,713][106225] Updated weights for policy 1, policy_version 1215927 (0.0005) [2023-12-28 03:58:29,779][106225] Updated weights for policy 1, policy_version 1215937 (0.0011) [2023-12-28 03:58:30,067][106226] Updated weights for policy 0, policy_version 1212832 (0.0010) [2023-12-28 03:58:30,115][106226] Updated weights for policy 0, policy_version 1212842 (0.0010) [2023-12-28 03:58:30,175][106226] Updated weights for policy 0, policy_version 1212852 (0.0011) [2023-12-28 03:58:30,470][106225] Updated weights for policy 1, policy_version 1215947 (0.0011) [2023-12-28 03:58:30,529][106225] Updated weights for policy 1, policy_version 1215957 (0.0010) [2023-12-28 03:58:30,588][106225] Updated weights for policy 1, policy_version 1215967 (0.0010) [2023-12-28 03:58:30,772][106226] Updated weights for policy 0, policy_version 1212862 (0.0007) [2023-12-28 03:58:30,815][106226] Updated weights for policy 0, policy_version 1212872 (0.0005) [2023-12-28 03:58:30,861][106226] Updated weights for policy 0, policy_version 1212882 (0.0005) [2023-12-28 03:58:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 621895680. Throughput: 0: 9682.1, 1: 9884.6. Samples: 621884368. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:31,175][105115] Avg episode reward: [(0, '-4.141'), (1, '-4.762')] [2023-12-28 03:58:31,271][106225] Updated weights for policy 1, policy_version 1215977 (0.0010) [2023-12-28 03:58:31,338][106225] Updated weights for policy 1, policy_version 1215987 (0.0008) [2023-12-28 03:58:31,411][106225] Updated weights for policy 1, policy_version 1215997 (0.0008) [2023-12-28 03:58:31,469][106225] Updated weights for policy 1, policy_version 1216007 (0.0008) [2023-12-28 03:58:31,537][106226] Updated weights for policy 0, policy_version 1212892 (0.0007) [2023-12-28 03:58:31,585][106226] Updated weights for policy 0, policy_version 1212902 (0.0010) [2023-12-28 03:58:31,642][106226] Updated weights for policy 0, policy_version 1212912 (0.0009) [2023-12-28 03:58:32,270][106225] Updated weights for policy 1, policy_version 1216017 (0.0008) [2023-12-28 03:58:32,336][106225] Updated weights for policy 1, policy_version 1216027 (0.0007) [2023-12-28 03:58:32,380][106226] Updated weights for policy 0, policy_version 1212922 (0.0008) [2023-12-28 03:58:32,399][106225] Updated weights for policy 1, policy_version 1216037 (0.0006) [2023-12-28 03:58:32,442][106226] Updated weights for policy 0, policy_version 1212932 (0.0008) [2023-12-28 03:58:32,497][106226] Updated weights for policy 0, policy_version 1212942 (0.0009) [2023-12-28 03:58:32,565][106226] Updated weights for policy 0, policy_version 1212952 (0.0009) [2023-12-28 03:58:32,966][106225] Updated weights for policy 1, policy_version 1216047 (0.0008) [2023-12-28 03:58:33,025][106225] Updated weights for policy 1, policy_version 1216057 (0.0007) [2023-12-28 03:58:33,078][106225] Updated weights for policy 1, policy_version 1216067 (0.0008) [2023-12-28 03:58:33,299][106226] Updated weights for policy 0, policy_version 1212962 (0.0005) [2023-12-28 03:58:33,342][106226] Updated weights for policy 0, policy_version 1212972 (0.0005) [2023-12-28 03:58:33,389][106226] Updated weights for policy 0, policy_version 1212982 (0.0005) [2023-12-28 03:58:33,781][106225] Updated weights for policy 1, policy_version 1216077 (0.0006) [2023-12-28 03:58:33,830][106225] Updated weights for policy 1, policy_version 1216087 (0.0010) [2023-12-28 03:58:33,880][106225] Updated weights for policy 1, policy_version 1216097 (0.0010) [2023-12-28 03:58:33,976][106226] Updated weights for policy 0, policy_version 1212992 (0.0007) [2023-12-28 03:58:34,030][106226] Updated weights for policy 0, policy_version 1213002 (0.0006) [2023-12-28 03:58:34,074][106226] Updated weights for policy 0, policy_version 1213012 (0.0005) [2023-12-28 03:58:34,612][106225] Updated weights for policy 1, policy_version 1216107 (0.0010) [2023-12-28 03:58:34,671][106225] Updated weights for policy 1, policy_version 1216117 (0.0010) [2023-12-28 03:58:34,737][106225] Updated weights for policy 1, policy_version 1216127 (0.0009) [2023-12-28 03:58:34,778][106226] Updated weights for policy 0, policy_version 1213022 (0.0005) [2023-12-28 03:58:34,833][106226] Updated weights for policy 0, policy_version 1213032 (0.0005) [2023-12-28 03:58:34,890][106226] Updated weights for policy 0, policy_version 1213042 (0.0005) [2023-12-28 03:58:35,368][106225] Updated weights for policy 1, policy_version 1216137 (0.0006) [2023-12-28 03:58:35,409][106226] Updated weights for policy 0, policy_version 1213052 (0.0005) [2023-12-28 03:58:35,428][106225] Updated weights for policy 1, policy_version 1216147 (0.0009) [2023-12-28 03:58:35,463][106226] Updated weights for policy 0, policy_version 1213062 (0.0005) [2023-12-28 03:58:35,482][106225] Updated weights for policy 1, policy_version 1216157 (0.0010) [2023-12-28 03:58:35,519][106226] Updated weights for policy 0, policy_version 1213072 (0.0005) [2023-12-28 03:58:35,539][106225] Updated weights for policy 1, policy_version 1216167 (0.0010) [2023-12-28 03:58:36,070][106226] Updated weights for policy 0, policy_version 1213082 (0.0006) [2023-12-28 03:58:36,136][106226] Updated weights for policy 0, policy_version 1213092 (0.0007) [2023-12-28 03:58:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 621993984. Throughput: 0: 9829.1, 1: 9847.1. Samples: 622009444. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:36,175][105115] Avg episode reward: [(0, '-4.176'), (1, '-5.164')] [2023-12-28 03:58:36,191][106226] Updated weights for policy 0, policy_version 1213102 (0.0009) [2023-12-28 03:58:36,194][106225] Updated weights for policy 1, policy_version 1216177 (0.0008) [2023-12-28 03:58:36,243][106226] Updated weights for policy 0, policy_version 1213112 (0.0011) [2023-12-28 03:58:36,258][106225] Updated weights for policy 1, policy_version 1216187 (0.0006) [2023-12-28 03:58:36,323][106225] Updated weights for policy 1, policy_version 1216197 (0.0006) [2023-12-28 03:58:36,887][106225] Updated weights for policy 1, policy_version 1216207 (0.0007) [2023-12-28 03:58:36,931][106226] Updated weights for policy 0, policy_version 1213122 (0.0008) [2023-12-28 03:58:36,944][106225] Updated weights for policy 1, policy_version 1216217 (0.0007) [2023-12-28 03:58:36,985][106226] Updated weights for policy 0, policy_version 1213132 (0.0011) [2023-12-28 03:58:36,995][106225] Updated weights for policy 1, policy_version 1216227 (0.0005) [2023-12-28 03:58:37,036][106226] Updated weights for policy 0, policy_version 1213142 (0.0011) [2023-12-28 03:58:37,757][106225] Updated weights for policy 1, policy_version 1216237 (0.0006) [2023-12-28 03:58:37,767][106226] Updated weights for policy 0, policy_version 1213152 (0.0011) [2023-12-28 03:58:37,815][106226] Updated weights for policy 0, policy_version 1213162 (0.0010) [2023-12-28 03:58:37,820][106225] Updated weights for policy 1, policy_version 1216247 (0.0005) [2023-12-28 03:58:37,861][106226] Updated weights for policy 0, policy_version 1213172 (0.0010) [2023-12-28 03:58:37,883][106225] Updated weights for policy 1, policy_version 1216257 (0.0005) [2023-12-28 03:58:38,493][106225] Updated weights for policy 1, policy_version 1216267 (0.0007) [2023-12-28 03:58:38,554][106225] Updated weights for policy 1, policy_version 1216277 (0.0010) [2023-12-28 03:58:38,610][106225] Updated weights for policy 1, policy_version 1216287 (0.0011) [2023-12-28 03:58:38,638][106226] Updated weights for policy 0, policy_version 1213182 (0.0009) [2023-12-28 03:58:38,690][106226] Updated weights for policy 0, policy_version 1213192 (0.0008) [2023-12-28 03:58:38,743][106226] Updated weights for policy 0, policy_version 1213202 (0.0009) [2023-12-28 03:58:39,350][106225] Updated weights for policy 1, policy_version 1216297 (0.0008) [2023-12-28 03:58:39,420][106225] Updated weights for policy 1, policy_version 1216307 (0.0008) [2023-12-28 03:58:39,485][106225] Updated weights for policy 1, policy_version 1216317 (0.0008) [2023-12-28 03:58:39,502][106226] Updated weights for policy 0, policy_version 1213212 (0.0011) [2023-12-28 03:58:39,549][106225] Updated weights for policy 1, policy_version 1216327 (0.0009) [2023-12-28 03:58:39,568][106226] Updated weights for policy 0, policy_version 1213222 (0.0011) [2023-12-28 03:58:39,644][106226] Updated weights for policy 0, policy_version 1213232 (0.0011) [2023-12-28 03:58:40,268][106225] Updated weights for policy 1, policy_version 1216337 (0.0006) [2023-12-28 03:58:40,327][106225] Updated weights for policy 1, policy_version 1216347 (0.0008) [2023-12-28 03:58:40,358][106226] Updated weights for policy 0, policy_version 1213242 (0.0010) [2023-12-28 03:58:40,393][106225] Updated weights for policy 1, policy_version 1216357 (0.0007) [2023-12-28 03:58:40,427][106226] Updated weights for policy 0, policy_version 1213252 (0.0008) [2023-12-28 03:58:40,494][106226] Updated weights for policy 0, policy_version 1213262 (0.0009) [2023-12-28 03:58:40,557][106226] Updated weights for policy 0, policy_version 1213272 (0.0009) [2023-12-28 03:58:41,079][106225] Updated weights for policy 1, policy_version 1216367 (0.0007) [2023-12-28 03:58:41,146][106225] Updated weights for policy 1, policy_version 1216377 (0.0008) [2023-12-28 03:58:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 622092288. Throughput: 0: 9796.7, 1: 9897.8. Samples: 622069340. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:41,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.843')] [2023-12-28 03:58:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001213272_310657024.pth... [2023-12-28 03:58:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001212120_310362112.pth [2023-12-28 03:58:41,220][106225] Updated weights for policy 1, policy_version 1216387 (0.0009) [2023-12-28 03:58:41,253][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001216392_311443456.pth... [2023-12-28 03:58:41,257][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001215240_311148544.pth [2023-12-28 03:58:41,372][106226] Updated weights for policy 0, policy_version 1213283 (0.0009) [2023-12-28 03:58:41,439][106226] Updated weights for policy 0, policy_version 1213293 (0.0008) [2023-12-28 03:58:41,502][106226] Updated weights for policy 0, policy_version 1213303 (0.0008) [2023-12-28 03:58:41,984][106225] Updated weights for policy 1, policy_version 1216397 (0.0009) [2023-12-28 03:58:42,047][106225] Updated weights for policy 1, policy_version 1216407 (0.0011) [2023-12-28 03:58:42,115][106225] Updated weights for policy 1, policy_version 1216417 (0.0009) [2023-12-28 03:58:42,217][106226] Updated weights for policy 0, policy_version 1213313 (0.0006) [2023-12-28 03:58:42,281][106226] Updated weights for policy 0, policy_version 1213323 (0.0008) [2023-12-28 03:58:42,344][106226] Updated weights for policy 0, policy_version 1213333 (0.0008) [2023-12-28 03:58:42,739][106225] Updated weights for policy 1, policy_version 1216427 (0.0006) [2023-12-28 03:58:42,799][106225] Updated weights for policy 1, policy_version 1216437 (0.0009) [2023-12-28 03:58:42,848][106225] Updated weights for policy 1, policy_version 1216447 (0.0009) [2023-12-28 03:58:43,090][106226] Updated weights for policy 0, policy_version 1213343 (0.0008) [2023-12-28 03:58:43,136][106226] Updated weights for policy 0, policy_version 1213353 (0.0008) [2023-12-28 03:58:43,194][106226] Updated weights for policy 0, policy_version 1213363 (0.0008) [2023-12-28 03:58:43,516][106225] Updated weights for policy 1, policy_version 1216457 (0.0008) [2023-12-28 03:58:43,571][106225] Updated weights for policy 1, policy_version 1216467 (0.0008) [2023-12-28 03:58:43,619][106225] Updated weights for policy 1, policy_version 1216477 (0.0008) [2023-12-28 03:58:43,678][106225] Updated weights for policy 1, policy_version 1216487 (0.0008) [2023-12-28 03:58:43,892][106226] Updated weights for policy 0, policy_version 1213373 (0.0007) [2023-12-28 03:58:43,957][106226] Updated weights for policy 0, policy_version 1213383 (0.0008) [2023-12-28 03:58:44,011][106226] Updated weights for policy 0, policy_version 1213393 (0.0009) [2023-12-28 03:58:44,452][106225] Updated weights for policy 1, policy_version 1216497 (0.0009) [2023-12-28 03:58:44,502][106225] Updated weights for policy 1, policy_version 1216507 (0.0009) [2023-12-28 03:58:44,551][106225] Updated weights for policy 1, policy_version 1216517 (0.0008) [2023-12-28 03:58:44,677][106226] Updated weights for policy 0, policy_version 1213403 (0.0008) [2023-12-28 03:58:44,733][106226] Updated weights for policy 0, policy_version 1213413 (0.0009) [2023-12-28 03:58:44,789][106226] Updated weights for policy 0, policy_version 1213423 (0.0009) [2023-12-28 03:58:45,336][106225] Updated weights for policy 1, policy_version 1216527 (0.0008) [2023-12-28 03:58:45,397][106225] Updated weights for policy 1, policy_version 1216537 (0.0008) [2023-12-28 03:58:45,458][106225] Updated weights for policy 1, policy_version 1216547 (0.0009) [2023-12-28 03:58:45,583][106226] Updated weights for policy 0, policy_version 1213433 (0.0008) [2023-12-28 03:58:45,644][106226] Updated weights for policy 0, policy_version 1213443 (0.0008) [2023-12-28 03:58:45,704][106226] Updated weights for policy 0, policy_version 1213453 (0.0008) [2023-12-28 03:58:45,768][106226] Updated weights for policy 0, policy_version 1213463 (0.0009) [2023-12-28 03:58:46,127][106225] Updated weights for policy 1, policy_version 1216557 (0.0008) [2023-12-28 03:58:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 622190592. Throughput: 0: 9769.6, 1: 9868.0. Samples: 622183744. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:46,175][105115] Avg episode reward: [(0, '-4.130'), (1, '-4.807')] [2023-12-28 03:58:46,185][106225] Updated weights for policy 1, policy_version 1216567 (0.0008) [2023-12-28 03:58:46,240][106225] Updated weights for policy 1, policy_version 1216577 (0.0008) [2023-12-28 03:58:46,464][106226] Updated weights for policy 0, policy_version 1213473 (0.0009) [2023-12-28 03:58:46,518][106226] Updated weights for policy 0, policy_version 1213483 (0.0008) [2023-12-28 03:58:46,570][106226] Updated weights for policy 0, policy_version 1213493 (0.0008) [2023-12-28 03:58:46,908][106225] Updated weights for policy 1, policy_version 1216587 (0.0007) [2023-12-28 03:58:46,957][106225] Updated weights for policy 1, policy_version 1216597 (0.0007) [2023-12-28 03:58:47,016][106225] Updated weights for policy 1, policy_version 1216607 (0.0009) [2023-12-28 03:58:47,160][106226] Updated weights for policy 0, policy_version 1213503 (0.0007) [2023-12-28 03:58:47,209][106226] Updated weights for policy 0, policy_version 1213513 (0.0008) [2023-12-28 03:58:47,270][106226] Updated weights for policy 0, policy_version 1213523 (0.0008) [2023-12-28 03:58:47,777][106225] Updated weights for policy 1, policy_version 1216617 (0.0009) [2023-12-28 03:58:47,833][106225] Updated weights for policy 1, policy_version 1216627 (0.0007) [2023-12-28 03:58:47,895][106225] Updated weights for policy 1, policy_version 1216637 (0.0009) [2023-12-28 03:58:47,900][106226] Updated weights for policy 0, policy_version 1213533 (0.0007) [2023-12-28 03:58:47,951][106225] Updated weights for policy 1, policy_version 1216647 (0.0009) [2023-12-28 03:58:47,958][106226] Updated weights for policy 0, policy_version 1213543 (0.0006) [2023-12-28 03:58:48,017][106226] Updated weights for policy 0, policy_version 1213553 (0.0006) [2023-12-28 03:58:48,586][106226] Updated weights for policy 0, policy_version 1213563 (0.0007) [2023-12-28 03:58:48,647][106226] Updated weights for policy 0, policy_version 1213573 (0.0010) [2023-12-28 03:58:48,708][106226] Updated weights for policy 0, policy_version 1213583 (0.0011) [2023-12-28 03:58:48,753][106225] Updated weights for policy 1, policy_version 1216657 (0.0006) [2023-12-28 03:58:48,801][106225] Updated weights for policy 1, policy_version 1216667 (0.0009) [2023-12-28 03:58:48,852][106225] Updated weights for policy 1, policy_version 1216677 (0.0009) [2023-12-28 03:58:49,393][106226] Updated weights for policy 0, policy_version 1213593 (0.0011) [2023-12-28 03:58:49,456][106226] Updated weights for policy 0, policy_version 1213603 (0.0008) [2023-12-28 03:58:49,527][106226] Updated weights for policy 0, policy_version 1213613 (0.0008) [2023-12-28 03:58:49,590][106226] Updated weights for policy 0, policy_version 1213623 (0.0008) [2023-12-28 03:58:49,622][106225] Updated weights for policy 1, policy_version 1216687 (0.0006) [2023-12-28 03:58:49,687][106225] Updated weights for policy 1, policy_version 1216697 (0.0006) [2023-12-28 03:58:49,753][106225] Updated weights for policy 1, policy_version 1216707 (0.0006) [2023-12-28 03:58:50,374][106226] Updated weights for policy 0, policy_version 1213633 (0.0007) [2023-12-28 03:58:50,404][106225] Updated weights for policy 1, policy_version 1216717 (0.0007) [2023-12-28 03:58:50,438][106226] Updated weights for policy 0, policy_version 1213643 (0.0010) [2023-12-28 03:58:50,464][106225] Updated weights for policy 1, policy_version 1216727 (0.0006) [2023-12-28 03:58:50,498][106226] Updated weights for policy 0, policy_version 1213653 (0.0009) [2023-12-28 03:58:50,527][106225] Updated weights for policy 1, policy_version 1216737 (0.0008) [2023-12-28 03:58:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 622288896. Throughput: 0: 9854.4, 1: 9813.4. Samples: 622302852. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:51,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.964')] [2023-12-28 03:58:51,200][106225] Updated weights for policy 1, policy_version 1216747 (0.0007) [2023-12-28 03:58:51,232][106226] Updated weights for policy 0, policy_version 1213663 (0.0010) [2023-12-28 03:58:51,264][106225] Updated weights for policy 1, policy_version 1216757 (0.0006) [2023-12-28 03:58:51,292][106226] Updated weights for policy 0, policy_version 1213673 (0.0009) [2023-12-28 03:58:51,329][106225] Updated weights for policy 1, policy_version 1216767 (0.0006) [2023-12-28 03:58:51,347][106226] Updated weights for policy 0, policy_version 1213683 (0.0009) [2023-12-28 03:58:52,032][106225] Updated weights for policy 1, policy_version 1216777 (0.0007) [2023-12-28 03:58:52,094][106225] Updated weights for policy 1, policy_version 1216787 (0.0007) [2023-12-28 03:58:52,129][106226] Updated weights for policy 0, policy_version 1213693 (0.0009) [2023-12-28 03:58:52,158][106225] Updated weights for policy 1, policy_version 1216797 (0.0009) [2023-12-28 03:58:52,181][106226] Updated weights for policy 0, policy_version 1213703 (0.0006) [2023-12-28 03:58:52,219][106225] Updated weights for policy 1, policy_version 1216807 (0.0007) [2023-12-28 03:58:52,231][106226] Updated weights for policy 0, policy_version 1213713 (0.0005) [2023-12-28 03:58:52,880][106226] Updated weights for policy 0, policy_version 1213723 (0.0008) [2023-12-28 03:58:52,931][106226] Updated weights for policy 0, policy_version 1213733 (0.0010) [2023-12-28 03:58:52,976][106225] Updated weights for policy 1, policy_version 1216817 (0.0005) [2023-12-28 03:58:52,992][106226] Updated weights for policy 0, policy_version 1213743 (0.0008) [2023-12-28 03:58:53,036][106225] Updated weights for policy 1, policy_version 1216827 (0.0005) [2023-12-28 03:58:53,094][106225] Updated weights for policy 1, policy_version 1216837 (0.0008) [2023-12-28 03:58:53,567][106226] Updated weights for policy 0, policy_version 1213753 (0.0009) [2023-12-28 03:58:53,639][106226] Updated weights for policy 0, policy_version 1213763 (0.0010) [2023-12-28 03:58:53,693][106226] Updated weights for policy 0, policy_version 1213773 (0.0010) [2023-12-28 03:58:53,741][106225] Updated weights for policy 1, policy_version 1216847 (0.0007) [2023-12-28 03:58:53,751][106226] Updated weights for policy 0, policy_version 1213783 (0.0009) [2023-12-28 03:58:53,803][106225] Updated weights for policy 1, policy_version 1216857 (0.0006) [2023-12-28 03:58:53,865][106225] Updated weights for policy 1, policy_version 1216867 (0.0006) [2023-12-28 03:58:54,381][106225] Updated weights for policy 1, policy_version 1216877 (0.0005) [2023-12-28 03:58:54,443][106225] Updated weights for policy 1, policy_version 1216887 (0.0008) [2023-12-28 03:58:54,452][106226] Updated weights for policy 0, policy_version 1213793 (0.0006) [2023-12-28 03:58:54,501][106225] Updated weights for policy 1, policy_version 1216897 (0.0009) [2023-12-28 03:58:54,513][106226] Updated weights for policy 0, policy_version 1213803 (0.0005) [2023-12-28 03:58:54,575][106226] Updated weights for policy 0, policy_version 1213813 (0.0005) [2023-12-28 03:58:55,100][106226] Updated weights for policy 0, policy_version 1213823 (0.0006) [2023-12-28 03:58:55,156][106226] Updated weights for policy 0, policy_version 1213833 (0.0005) [2023-12-28 03:58:55,176][106225] Updated weights for policy 1, policy_version 1216907 (0.0009) [2023-12-28 03:58:55,213][106226] Updated weights for policy 0, policy_version 1213843 (0.0005) [2023-12-28 03:58:55,235][106225] Updated weights for policy 1, policy_version 1216917 (0.0008) [2023-12-28 03:58:55,298][106225] Updated weights for policy 1, policy_version 1216927 (0.0006) [2023-12-28 03:58:55,874][106226] Updated weights for policy 0, policy_version 1213853 (0.0006) [2023-12-28 03:58:55,932][106226] Updated weights for policy 0, policy_version 1213863 (0.0008) [2023-12-28 03:58:55,941][106225] Updated weights for policy 1, policy_version 1216937 (0.0006) [2023-12-28 03:58:55,978][106226] Updated weights for policy 0, policy_version 1213873 (0.0007) [2023-12-28 03:58:55,997][106225] Updated weights for policy 1, policy_version 1216947 (0.0008) [2023-12-28 03:58:56,061][106225] Updated weights for policy 1, policy_version 1216957 (0.0007) [2023-12-28 03:58:56,120][106225] Updated weights for policy 1, policy_version 1216967 (0.0008) [2023-12-28 03:58:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.5, 300 sec: 19744.1). Total num frames: 622403584. Throughput: 0: 9907.6, 1: 9797.1. Samples: 622362632. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:58:56,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.917')] [2023-12-28 03:58:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001213880_310812672.pth... [2023-12-28 03:58:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001216968_311590912.pth... [2023-12-28 03:58:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001215784_311287808.pth [2023-12-28 03:58:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001212696_310509568.pth [2023-12-28 03:58:56,693][106226] Updated weights for policy 0, policy_version 1213883 (0.0009) [2023-12-28 03:58:56,747][106226] Updated weights for policy 0, policy_version 1213893 (0.0009) [2023-12-28 03:58:56,785][106225] Updated weights for policy 1, policy_version 1216977 (0.0008) [2023-12-28 03:58:56,796][106226] Updated weights for policy 0, policy_version 1213903 (0.0005) [2023-12-28 03:58:56,829][106225] Updated weights for policy 1, policy_version 1216987 (0.0007) [2023-12-28 03:58:56,883][106225] Updated weights for policy 1, policy_version 1216997 (0.0007) [2023-12-28 03:58:57,472][106226] Updated weights for policy 0, policy_version 1213913 (0.0006) [2023-12-28 03:58:57,535][106226] Updated weights for policy 0, policy_version 1213923 (0.0007) [2023-12-28 03:58:57,594][106226] Updated weights for policy 0, policy_version 1213933 (0.0008) [2023-12-28 03:58:57,625][106225] Updated weights for policy 1, policy_version 1217007 (0.0009) [2023-12-28 03:58:57,654][106226] Updated weights for policy 0, policy_version 1213943 (0.0007) [2023-12-28 03:58:57,684][106225] Updated weights for policy 1, policy_version 1217017 (0.0007) [2023-12-28 03:58:57,734][106225] Updated weights for policy 1, policy_version 1217027 (0.0008) [2023-12-28 03:58:58,365][106226] Updated weights for policy 0, policy_version 1213953 (0.0008) [2023-12-28 03:58:58,435][106226] Updated weights for policy 0, policy_version 1213963 (0.0009) [2023-12-28 03:58:58,492][106226] Updated weights for policy 0, policy_version 1213973 (0.0009) [2023-12-28 03:58:58,494][106225] Updated weights for policy 1, policy_version 1217037 (0.0007) [2023-12-28 03:58:58,561][106225] Updated weights for policy 1, policy_version 1217047 (0.0007) [2023-12-28 03:58:58,628][106225] Updated weights for policy 1, policy_version 1217057 (0.0008) [2023-12-28 03:58:59,374][106226] Updated weights for policy 0, policy_version 1213983 (0.0009) [2023-12-28 03:58:59,436][106226] Updated weights for policy 0, policy_version 1213993 (0.0008) [2023-12-28 03:58:59,482][106226] Updated weights for policy 0, policy_version 1214003 (0.0007) [2023-12-28 03:58:59,491][106225] Updated weights for policy 1, policy_version 1217067 (0.0008) [2023-12-28 03:58:59,554][106225] Updated weights for policy 1, policy_version 1217077 (0.0007) [2023-12-28 03:58:59,614][106225] Updated weights for policy 1, policy_version 1217087 (0.0009) [2023-12-28 03:59:00,192][106226] Updated weights for policy 0, policy_version 1214013 (0.0008) [2023-12-28 03:59:00,254][106226] Updated weights for policy 0, policy_version 1214023 (0.0009) [2023-12-28 03:59:00,298][106225] Updated weights for policy 1, policy_version 1217097 (0.0009) [2023-12-28 03:59:00,316][106226] Updated weights for policy 0, policy_version 1214033 (0.0008) [2023-12-28 03:59:00,354][106225] Updated weights for policy 1, policy_version 1217107 (0.0008) [2023-12-28 03:59:00,412][106225] Updated weights for policy 1, policy_version 1217117 (0.0006) [2023-12-28 03:59:00,477][106225] Updated weights for policy 1, policy_version 1217127 (0.0006) [2023-12-28 03:59:01,033][106225] Updated weights for policy 1, policy_version 1217137 (0.0006) [2023-12-28 03:59:01,095][106225] Updated weights for policy 1, policy_version 1217147 (0.0010) [2023-12-28 03:59:01,117][106226] Updated weights for policy 0, policy_version 1214043 (0.0006) [2023-12-28 03:59:01,160][106225] Updated weights for policy 1, policy_version 1217157 (0.0009) [2023-12-28 03:59:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 622485504. Throughput: 0: 9973.2, 1: 9879.9. Samples: 622482012. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:59:01,175][105115] Avg episode reward: [(0, '-4.119'), (1, '-4.946')] [2023-12-28 03:59:01,183][106226] Updated weights for policy 0, policy_version 1214053 (0.0007) [2023-12-28 03:59:01,251][106226] Updated weights for policy 0, policy_version 1214063 (0.0008) [2023-12-28 03:59:01,837][106225] Updated weights for policy 1, policy_version 1217167 (0.0007) [2023-12-28 03:59:01,893][106225] Updated weights for policy 1, policy_version 1217177 (0.0006) [2023-12-28 03:59:01,945][106225] Updated weights for policy 1, policy_version 1217187 (0.0008) [2023-12-28 03:59:01,992][106226] Updated weights for policy 0, policy_version 1214073 (0.0006) [2023-12-28 03:59:02,050][106226] Updated weights for policy 0, policy_version 1214083 (0.0008) [2023-12-28 03:59:02,113][106226] Updated weights for policy 0, policy_version 1214093 (0.0008) [2023-12-28 03:59:02,176][106226] Updated weights for policy 0, policy_version 1214103 (0.0008) [2023-12-28 03:59:02,659][106225] Updated weights for policy 1, policy_version 1217197 (0.0008) [2023-12-28 03:59:02,723][106225] Updated weights for policy 1, policy_version 1217207 (0.0006) [2023-12-28 03:59:02,779][106225] Updated weights for policy 1, policy_version 1217217 (0.0010) [2023-12-28 03:59:02,926][106226] Updated weights for policy 0, policy_version 1214113 (0.0008) [2023-12-28 03:59:02,975][106226] Updated weights for policy 0, policy_version 1214123 (0.0007) [2023-12-28 03:59:03,022][106226] Updated weights for policy 0, policy_version 1214133 (0.0008) [2023-12-28 03:59:03,515][106225] Updated weights for policy 1, policy_version 1217227 (0.0009) [2023-12-28 03:59:03,572][106225] Updated weights for policy 1, policy_version 1217237 (0.0010) [2023-12-28 03:59:03,603][106226] Updated weights for policy 0, policy_version 1214143 (0.0006) [2023-12-28 03:59:03,628][106225] Updated weights for policy 1, policy_version 1217247 (0.0010) [2023-12-28 03:59:03,667][106226] Updated weights for policy 0, policy_version 1214153 (0.0006) [2023-12-28 03:59:03,712][106226] Updated weights for policy 0, policy_version 1214163 (0.0007) [2023-12-28 03:59:04,266][106225] Updated weights for policy 1, policy_version 1217257 (0.0010) [2023-12-28 03:59:04,325][106225] Updated weights for policy 1, policy_version 1217267 (0.0007) [2023-12-28 03:59:04,379][106225] Updated weights for policy 1, policy_version 1217277 (0.0007) [2023-12-28 03:59:04,427][106225] Updated weights for policy 1, policy_version 1217287 (0.0008) [2023-12-28 03:59:04,459][106226] Updated weights for policy 0, policy_version 1214174 (0.0010) [2023-12-28 03:59:04,520][106226] Updated weights for policy 0, policy_version 1214184 (0.0011) [2023-12-28 03:59:04,574][106226] Updated weights for policy 0, policy_version 1214194 (0.0011) [2023-12-28 03:59:05,200][106225] Updated weights for policy 1, policy_version 1217297 (0.0009) [2023-12-28 03:59:05,236][106226] Updated weights for policy 0, policy_version 1214204 (0.0011) [2023-12-28 03:59:05,254][106225] Updated weights for policy 1, policy_version 1217307 (0.0006) [2023-12-28 03:59:05,287][106226] Updated weights for policy 0, policy_version 1214214 (0.0010) [2023-12-28 03:59:05,301][106225] Updated weights for policy 1, policy_version 1217317 (0.0006) [2023-12-28 03:59:05,342][106226] Updated weights for policy 0, policy_version 1214224 (0.0010) [2023-12-28 03:59:05,920][106225] Updated weights for policy 1, policy_version 1217327 (0.0007) [2023-12-28 03:59:05,965][106225] Updated weights for policy 1, policy_version 1217337 (0.0005) [2023-12-28 03:59:06,029][106225] Updated weights for policy 1, policy_version 1217347 (0.0005) [2023-12-28 03:59:06,051][106226] Updated weights for policy 0, policy_version 1214234 (0.0008) [2023-12-28 03:59:06,114][106226] Updated weights for policy 0, policy_version 1214244 (0.0009) [2023-12-28 03:59:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 622592000. Throughput: 0: 9981.1, 1: 9978.9. Samples: 622602032. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:59:06,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.851')] [2023-12-28 03:59:06,183][106226] Updated weights for policy 0, policy_version 1214254 (0.0011) [2023-12-28 03:59:06,249][106226] Updated weights for policy 0, policy_version 1214264 (0.0011) [2023-12-28 03:59:06,755][106225] Updated weights for policy 1, policy_version 1217357 (0.0007) [2023-12-28 03:59:06,801][106225] Updated weights for policy 1, policy_version 1217367 (0.0008) [2023-12-28 03:59:06,851][106225] Updated weights for policy 1, policy_version 1217377 (0.0008) [2023-12-28 03:59:06,929][106226] Updated weights for policy 0, policy_version 1214274 (0.0011) [2023-12-28 03:59:06,976][106226] Updated weights for policy 0, policy_version 1214284 (0.0010) [2023-12-28 03:59:07,024][106226] Updated weights for policy 0, policy_version 1214294 (0.0010) [2023-12-28 03:59:07,620][106225] Updated weights for policy 1, policy_version 1217387 (0.0008) [2023-12-28 03:59:07,669][106225] Updated weights for policy 1, policy_version 1217397 (0.0008) [2023-12-28 03:59:07,718][106225] Updated weights for policy 1, policy_version 1217407 (0.0008) [2023-12-28 03:59:07,756][106226] Updated weights for policy 0, policy_version 1214304 (0.0007) [2023-12-28 03:59:07,804][106226] Updated weights for policy 0, policy_version 1214314 (0.0008) [2023-12-28 03:59:07,856][106226] Updated weights for policy 0, policy_version 1214324 (0.0008) [2023-12-28 03:59:08,451][106225] Updated weights for policy 1, policy_version 1217417 (0.0006) [2023-12-28 03:59:08,512][106225] Updated weights for policy 1, policy_version 1217427 (0.0008) [2023-12-28 03:59:08,579][106225] Updated weights for policy 1, policy_version 1217437 (0.0009) [2023-12-28 03:59:08,622][106226] Updated weights for policy 0, policy_version 1214334 (0.0007) [2023-12-28 03:59:08,642][106225] Updated weights for policy 1, policy_version 1217447 (0.0008) [2023-12-28 03:59:08,684][106226] Updated weights for policy 0, policy_version 1214344 (0.0009) [2023-12-28 03:59:08,746][106226] Updated weights for policy 0, policy_version 1214354 (0.0007) [2023-12-28 03:59:09,377][106225] Updated weights for policy 1, policy_version 1217457 (0.0008) [2023-12-28 03:59:09,443][106225] Updated weights for policy 1, policy_version 1217467 (0.0008) [2023-12-28 03:59:09,503][106225] Updated weights for policy 1, policy_version 1217477 (0.0007) [2023-12-28 03:59:09,507][106226] Updated weights for policy 0, policy_version 1214364 (0.0008) [2023-12-28 03:59:09,572][106226] Updated weights for policy 0, policy_version 1214374 (0.0011) [2023-12-28 03:59:09,634][106226] Updated weights for policy 0, policy_version 1214384 (0.0011) [2023-12-28 03:59:10,320][106225] Updated weights for policy 1, policy_version 1217487 (0.0008) [2023-12-28 03:59:10,378][106225] Updated weights for policy 1, policy_version 1217497 (0.0008) [2023-12-28 03:59:10,382][106226] Updated weights for policy 0, policy_version 1214394 (0.0011) [2023-12-28 03:59:10,443][106225] Updated weights for policy 1, policy_version 1217507 (0.0010) [2023-12-28 03:59:10,447][106226] Updated weights for policy 0, policy_version 1214404 (0.0011) [2023-12-28 03:59:10,494][106226] Updated weights for policy 0, policy_version 1214414 (0.0011) [2023-12-28 03:59:10,548][106226] Updated weights for policy 0, policy_version 1214424 (0.0010) [2023-12-28 03:59:11,112][106225] Updated weights for policy 1, policy_version 1217517 (0.0008) [2023-12-28 03:59:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 622682112. Throughput: 0: 10013.7, 1: 9992.5. Samples: 622660120. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:59:11,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-4.851')] [2023-12-28 03:59:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001214424_310951936.pth... [2023-12-28 03:59:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001213272_310657024.pth [2023-12-28 03:59:11,185][106225] Updated weights for policy 1, policy_version 1217527 (0.0008) [2023-12-28 03:59:11,252][106225] Updated weights for policy 1, policy_version 1217537 (0.0008) [2023-12-28 03:59:11,289][106226] Updated weights for policy 0, policy_version 1214434 (0.0010) [2023-12-28 03:59:11,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001217544_311738368.pth... [2023-12-28 03:59:11,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001216392_311443456.pth [2023-12-28 03:59:11,357][106226] Updated weights for policy 0, policy_version 1214444 (0.0010) [2023-12-28 03:59:11,430][106226] Updated weights for policy 0, policy_version 1214454 (0.0007) [2023-12-28 03:59:12,007][106225] Updated weights for policy 1, policy_version 1217547 (0.0007) [2023-12-28 03:59:12,059][106225] Updated weights for policy 1, policy_version 1217557 (0.0009) [2023-12-28 03:59:12,112][106225] Updated weights for policy 1, policy_version 1217567 (0.0009) [2023-12-28 03:59:12,203][106226] Updated weights for policy 0, policy_version 1214464 (0.0007) [2023-12-28 03:59:12,267][106226] Updated weights for policy 0, policy_version 1214474 (0.0007) [2023-12-28 03:59:12,330][106226] Updated weights for policy 0, policy_version 1214484 (0.0008) [2023-12-28 03:59:12,909][106225] Updated weights for policy 1, policy_version 1217577 (0.0008) [2023-12-28 03:59:12,969][106225] Updated weights for policy 1, policy_version 1217587 (0.0007) [2023-12-28 03:59:13,020][106226] Updated weights for policy 0, policy_version 1214494 (0.0008) [2023-12-28 03:59:13,029][106225] Updated weights for policy 1, policy_version 1217597 (0.0007) [2023-12-28 03:59:13,078][106226] Updated weights for policy 0, policy_version 1214504 (0.0006) [2023-12-28 03:59:13,080][106225] Updated weights for policy 1, policy_version 1217607 (0.0007) [2023-12-28 03:59:13,139][106226] Updated weights for policy 0, policy_version 1214514 (0.0008) [2023-12-28 03:59:13,692][106226] Updated weights for policy 0, policy_version 1214524 (0.0007) [2023-12-28 03:59:13,741][106226] Updated weights for policy 0, policy_version 1214534 (0.0005) [2023-12-28 03:59:13,787][106226] Updated weights for policy 0, policy_version 1214544 (0.0005) [2023-12-28 03:59:13,892][106225] Updated weights for policy 1, policy_version 1217617 (0.0009) [2023-12-28 03:59:13,940][106225] Updated weights for policy 1, policy_version 1217627 (0.0008) [2023-12-28 03:59:13,991][106225] Updated weights for policy 1, policy_version 1217637 (0.0008) [2023-12-28 03:59:14,457][106226] Updated weights for policy 0, policy_version 1214554 (0.0007) [2023-12-28 03:59:14,508][106226] Updated weights for policy 0, policy_version 1214564 (0.0010) [2023-12-28 03:59:14,565][106226] Updated weights for policy 0, policy_version 1214574 (0.0010) [2023-12-28 03:59:14,609][106226] Updated weights for policy 0, policy_version 1214584 (0.0007) [2023-12-28 03:59:14,682][106225] Updated weights for policy 1, policy_version 1217647 (0.0006) [2023-12-28 03:59:14,740][106225] Updated weights for policy 1, policy_version 1217657 (0.0009) [2023-12-28 03:59:14,805][106225] Updated weights for policy 1, policy_version 1217667 (0.0007) [2023-12-28 03:59:15,319][106226] Updated weights for policy 0, policy_version 1214594 (0.0006) [2023-12-28 03:59:15,378][106226] Updated weights for policy 0, policy_version 1214604 (0.0006) [2023-12-28 03:59:15,437][106226] Updated weights for policy 0, policy_version 1214614 (0.0006) [2023-12-28 03:59:15,456][106225] Updated weights for policy 1, policy_version 1217677 (0.0007) [2023-12-28 03:59:15,515][106225] Updated weights for policy 1, policy_version 1217687 (0.0008) [2023-12-28 03:59:15,574][106225] Updated weights for policy 1, policy_version 1217697 (0.0008) [2023-12-28 03:59:16,021][106226] Updated weights for policy 0, policy_version 1214624 (0.0005) [2023-12-28 03:59:16,075][106226] Updated weights for policy 0, policy_version 1214634 (0.0005) [2023-12-28 03:59:16,127][106226] Updated weights for policy 0, policy_version 1214644 (0.0006) [2023-12-28 03:59:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 622788608. Throughput: 0: 9987.3, 1: 9826.0. Samples: 622775968. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 03:59:16,176][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.975')] [2023-12-28 03:59:16,266][106225] Updated weights for policy 1, policy_version 1217707 (0.0009) [2023-12-28 03:59:16,327][106225] Updated weights for policy 1, policy_version 1217717 (0.0008) [2023-12-28 03:59:16,384][106225] Updated weights for policy 1, policy_version 1217727 (0.0008) [2023-12-28 03:59:16,853][106226] Updated weights for policy 0, policy_version 1214654 (0.0010) [2023-12-28 03:59:16,927][106226] Updated weights for policy 0, policy_version 1214664 (0.0009) [2023-12-28 03:59:16,943][106225] Updated weights for policy 1, policy_version 1217737 (0.0008) [2023-12-28 03:59:16,974][106226] Updated weights for policy 0, policy_version 1214674 (0.0007) [2023-12-28 03:59:16,997][106225] Updated weights for policy 1, policy_version 1217747 (0.0006) [2023-12-28 03:59:17,047][106225] Updated weights for policy 1, policy_version 1217757 (0.0008) [2023-12-28 03:59:17,107][106225] Updated weights for policy 1, policy_version 1217767 (0.0008) [2023-12-28 03:59:17,664][106226] Updated weights for policy 0, policy_version 1214684 (0.0009) [2023-12-28 03:59:17,728][106226] Updated weights for policy 0, policy_version 1214694 (0.0009) [2023-12-28 03:59:17,787][106226] Updated weights for policy 0, policy_version 1214704 (0.0009) [2023-12-28 03:59:17,804][106225] Updated weights for policy 1, policy_version 1217777 (0.0006) [2023-12-28 03:59:17,858][106225] Updated weights for policy 1, policy_version 1217787 (0.0005) [2023-12-28 03:59:17,921][106225] Updated weights for policy 1, policy_version 1217797 (0.0005) [2023-12-28 03:59:18,530][106226] Updated weights for policy 0, policy_version 1214714 (0.0008) [2023-12-28 03:59:18,583][106226] Updated weights for policy 0, policy_version 1214724 (0.0007) [2023-12-28 03:59:18,606][106225] Updated weights for policy 1, policy_version 1217807 (0.0006) [2023-12-28 03:59:18,634][106226] Updated weights for policy 0, policy_version 1214734 (0.0008) [2023-12-28 03:59:18,677][106225] Updated weights for policy 1, policy_version 1217817 (0.0010) [2023-12-28 03:59:18,682][106226] Updated weights for policy 0, policy_version 1214744 (0.0007) [2023-12-28 03:59:18,744][106225] Updated weights for policy 1, policy_version 1217827 (0.0007) [2023-12-28 03:59:19,353][106225] Updated weights for policy 1, policy_version 1217837 (0.0008) [2023-12-28 03:59:19,419][106225] Updated weights for policy 1, policy_version 1217847 (0.0008) [2023-12-28 03:59:19,470][106226] Updated weights for policy 0, policy_version 1214754 (0.0008) [2023-12-28 03:59:19,484][106225] Updated weights for policy 1, policy_version 1217857 (0.0007) [2023-12-28 03:59:19,541][106226] Updated weights for policy 0, policy_version 1214764 (0.0009) [2023-12-28 03:59:19,603][106226] Updated weights for policy 0, policy_version 1214774 (0.0009) [2023-12-28 03:59:20,176][106225] Updated weights for policy 1, policy_version 1217867 (0.0008) [2023-12-28 03:59:20,242][106225] Updated weights for policy 1, policy_version 1217877 (0.0009) [2023-12-28 03:59:20,294][106225] Updated weights for policy 1, policy_version 1217887 (0.0008) [2023-12-28 03:59:20,336][106226] Updated weights for policy 0, policy_version 1214784 (0.0008) [2023-12-28 03:59:20,399][106226] Updated weights for policy 0, policy_version 1214794 (0.0007) [2023-12-28 03:59:20,468][106226] Updated weights for policy 0, policy_version 1214804 (0.0010) [2023-12-28 03:59:21,057][106225] Updated weights for policy 1, policy_version 1217897 (0.0007) [2023-12-28 03:59:21,124][106225] Updated weights for policy 1, policy_version 1217907 (0.0009) [2023-12-28 03:59:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 622878720. Throughput: 0: 9817.8, 1: 9862.0. Samples: 622895032. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:21,175][105115] Avg episode reward: [(0, '-4.160'), (1, '-5.080')] [2023-12-28 03:59:21,190][106225] Updated weights for policy 1, policy_version 1217917 (0.0009) [2023-12-28 03:59:21,224][106226] Updated weights for policy 0, policy_version 1214814 (0.0008) [2023-12-28 03:59:21,251][106225] Updated weights for policy 1, policy_version 1217927 (0.0006) [2023-12-28 03:59:21,290][106226] Updated weights for policy 0, policy_version 1214824 (0.0008) [2023-12-28 03:59:21,357][106226] Updated weights for policy 0, policy_version 1214834 (0.0007) [2023-12-28 03:59:21,955][106225] Updated weights for policy 1, policy_version 1217937 (0.0009) [2023-12-28 03:59:22,018][106225] Updated weights for policy 1, policy_version 1217947 (0.0009) [2023-12-28 03:59:22,052][106226] Updated weights for policy 0, policy_version 1214844 (0.0008) [2023-12-28 03:59:22,080][106225] Updated weights for policy 1, policy_version 1217957 (0.0010) [2023-12-28 03:59:22,116][106226] Updated weights for policy 0, policy_version 1214854 (0.0008) [2023-12-28 03:59:22,179][106226] Updated weights for policy 0, policy_version 1214864 (0.0008) [2023-12-28 03:59:22,834][106225] Updated weights for policy 1, policy_version 1217967 (0.0008) [2023-12-28 03:59:22,895][106225] Updated weights for policy 1, policy_version 1217977 (0.0008) [2023-12-28 03:59:22,907][106226] Updated weights for policy 0, policy_version 1214874 (0.0009) [2023-12-28 03:59:22,956][106225] Updated weights for policy 1, policy_version 1217987 (0.0006) [2023-12-28 03:59:22,970][106226] Updated weights for policy 0, policy_version 1214884 (0.0009) [2023-12-28 03:59:23,018][106226] Updated weights for policy 0, policy_version 1214894 (0.0010) [2023-12-28 03:59:23,074][106226] Updated weights for policy 0, policy_version 1214904 (0.0006) [2023-12-28 03:59:23,614][106225] Updated weights for policy 1, policy_version 1217997 (0.0007) [2023-12-28 03:59:23,668][106225] Updated weights for policy 1, policy_version 1218007 (0.0005) [2023-12-28 03:59:23,700][106226] Updated weights for policy 0, policy_version 1214914 (0.0010) [2023-12-28 03:59:23,714][106225] Updated weights for policy 1, policy_version 1218017 (0.0005) [2023-12-28 03:59:23,757][106226] Updated weights for policy 0, policy_version 1214924 (0.0011) [2023-12-28 03:59:23,819][106226] Updated weights for policy 0, policy_version 1214934 (0.0011) [2023-12-28 03:59:24,266][106225] Updated weights for policy 1, policy_version 1218027 (0.0005) [2023-12-28 03:59:24,321][106225] Updated weights for policy 1, policy_version 1218037 (0.0005) [2023-12-28 03:59:24,380][106225] Updated weights for policy 1, policy_version 1218047 (0.0005) [2023-12-28 03:59:24,527][106226] Updated weights for policy 0, policy_version 1214944 (0.0011) [2023-12-28 03:59:24,577][106226] Updated weights for policy 0, policy_version 1214954 (0.0010) [2023-12-28 03:59:24,629][106226] Updated weights for policy 0, policy_version 1214964 (0.0009) [2023-12-28 03:59:25,039][106225] Updated weights for policy 1, policy_version 1218057 (0.0006) [2023-12-28 03:59:25,099][106225] Updated weights for policy 1, policy_version 1218067 (0.0008) [2023-12-28 03:59:25,166][106225] Updated weights for policy 1, policy_version 1218077 (0.0008) [2023-12-28 03:59:25,224][106225] Updated weights for policy 1, policy_version 1218087 (0.0008) [2023-12-28 03:59:25,323][106226] Updated weights for policy 0, policy_version 1214974 (0.0009) [2023-12-28 03:59:25,385][106226] Updated weights for policy 0, policy_version 1214984 (0.0009) [2023-12-28 03:59:25,440][106226] Updated weights for policy 0, policy_version 1214994 (0.0009) [2023-12-28 03:59:25,877][106225] Updated weights for policy 1, policy_version 1218097 (0.0006) [2023-12-28 03:59:25,929][106225] Updated weights for policy 1, policy_version 1218107 (0.0005) [2023-12-28 03:59:25,995][106225] Updated weights for policy 1, policy_version 1218117 (0.0005) [2023-12-28 03:59:26,104][106226] Updated weights for policy 0, policy_version 1215004 (0.0008) [2023-12-28 03:59:26,167][106226] Updated weights for policy 0, policy_version 1215014 (0.0009) [2023-12-28 03:59:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 622985216. Throughput: 0: 9827.1, 1: 9812.8. Samples: 622953136. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:26,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-5.031')] [2023-12-28 03:59:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001218120_311885824.pth... [2023-12-28 03:59:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001216968_311590912.pth [2023-12-28 03:59:26,236][106226] Updated weights for policy 0, policy_version 1215024 (0.0008) [2023-12-28 03:59:26,282][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001215032_311107584.pth... [2023-12-28 03:59:26,291][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001213880_310812672.pth [2023-12-28 03:59:26,630][106225] Updated weights for policy 1, policy_version 1218127 (0.0009) [2023-12-28 03:59:26,684][106225] Updated weights for policy 1, policy_version 1218137 (0.0008) [2023-12-28 03:59:26,746][106225] Updated weights for policy 1, policy_version 1218147 (0.0009) [2023-12-28 03:59:26,839][106226] Updated weights for policy 0, policy_version 1215034 (0.0008) [2023-12-28 03:59:26,893][106226] Updated weights for policy 0, policy_version 1215044 (0.0006) [2023-12-28 03:59:26,938][106226] Updated weights for policy 0, policy_version 1215054 (0.0005) [2023-12-28 03:59:26,992][106226] Updated weights for policy 0, policy_version 1215064 (0.0006) [2023-12-28 03:59:27,475][106225] Updated weights for policy 1, policy_version 1218157 (0.0008) [2023-12-28 03:59:27,523][106225] Updated weights for policy 1, policy_version 1218167 (0.0008) [2023-12-28 03:59:27,574][106225] Updated weights for policy 1, policy_version 1218177 (0.0008) [2023-12-28 03:59:27,647][106226] Updated weights for policy 0, policy_version 1215074 (0.0008) [2023-12-28 03:59:27,700][106226] Updated weights for policy 0, policy_version 1215084 (0.0006) [2023-12-28 03:59:27,758][106226] Updated weights for policy 0, policy_version 1215094 (0.0006) [2023-12-28 03:59:28,353][106226] Updated weights for policy 0, policy_version 1215104 (0.0010) [2023-12-28 03:59:28,395][106225] Updated weights for policy 1, policy_version 1218187 (0.0007) [2023-12-28 03:59:28,418][106226] Updated weights for policy 0, policy_version 1215114 (0.0008) [2023-12-28 03:59:28,456][106225] Updated weights for policy 1, policy_version 1218197 (0.0008) [2023-12-28 03:59:28,469][106226] Updated weights for policy 0, policy_version 1215124 (0.0006) [2023-12-28 03:59:28,519][106225] Updated weights for policy 1, policy_version 1218207 (0.0009) [2023-12-28 03:59:29,142][106226] Updated weights for policy 0, policy_version 1215134 (0.0006) [2023-12-28 03:59:29,185][106225] Updated weights for policy 1, policy_version 1218217 (0.0008) [2023-12-28 03:59:29,197][106226] Updated weights for policy 0, policy_version 1215144 (0.0007) [2023-12-28 03:59:29,256][106225] Updated weights for policy 1, policy_version 1218227 (0.0007) [2023-12-28 03:59:29,267][106226] Updated weights for policy 0, policy_version 1215154 (0.0010) [2023-12-28 03:59:29,323][106225] Updated weights for policy 1, policy_version 1218237 (0.0006) [2023-12-28 03:59:29,402][106225] Updated weights for policy 1, policy_version 1218247 (0.0008) [2023-12-28 03:59:29,970][106226] Updated weights for policy 0, policy_version 1215164 (0.0011) [2023-12-28 03:59:30,031][106226] Updated weights for policy 0, policy_version 1215174 (0.0011) [2023-12-28 03:59:30,085][106226] Updated weights for policy 0, policy_version 1215184 (0.0010) [2023-12-28 03:59:30,118][106225] Updated weights for policy 1, policy_version 1218257 (0.0006) [2023-12-28 03:59:30,174][106225] Updated weights for policy 1, policy_version 1218267 (0.0008) [2023-12-28 03:59:30,236][106225] Updated weights for policy 1, policy_version 1218277 (0.0008) [2023-12-28 03:59:30,800][106226] Updated weights for policy 0, policy_version 1215194 (0.0010) [2023-12-28 03:59:30,865][106226] Updated weights for policy 0, policy_version 1215204 (0.0009) [2023-12-28 03:59:30,929][106226] Updated weights for policy 0, policy_version 1215214 (0.0006) [2023-12-28 03:59:30,962][106225] Updated weights for policy 1, policy_version 1218287 (0.0008) [2023-12-28 03:59:30,987][106226] Updated weights for policy 0, policy_version 1215224 (0.0006) [2023-12-28 03:59:31,026][106225] Updated weights for policy 1, policy_version 1218297 (0.0007) [2023-12-28 03:59:31,085][106225] Updated weights for policy 1, policy_version 1218307 (0.0007) [2023-12-28 03:59:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 623091712. Throughput: 0: 9960.2, 1: 9880.3. Samples: 623076564. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:31,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.790')] [2023-12-28 03:59:31,754][106226] Updated weights for policy 0, policy_version 1215234 (0.0009) [2023-12-28 03:59:31,816][106226] Updated weights for policy 0, policy_version 1215244 (0.0009) [2023-12-28 03:59:31,868][106226] Updated weights for policy 0, policy_version 1215254 (0.0007) [2023-12-28 03:59:31,884][106225] Updated weights for policy 1, policy_version 1218317 (0.0007) [2023-12-28 03:59:31,944][106225] Updated weights for policy 1, policy_version 1218327 (0.0008) [2023-12-28 03:59:32,002][106225] Updated weights for policy 1, policy_version 1218337 (0.0009) [2023-12-28 03:59:32,553][106226] Updated weights for policy 0, policy_version 1215264 (0.0005) [2023-12-28 03:59:32,605][106226] Updated weights for policy 0, policy_version 1215274 (0.0005) [2023-12-28 03:59:32,659][106226] Updated weights for policy 0, policy_version 1215284 (0.0005) [2023-12-28 03:59:32,684][106225] Updated weights for policy 1, policy_version 1218347 (0.0008) [2023-12-28 03:59:32,739][106225] Updated weights for policy 1, policy_version 1218357 (0.0009) [2023-12-28 03:59:32,795][106225] Updated weights for policy 1, policy_version 1218367 (0.0008) [2023-12-28 03:59:33,236][106226] Updated weights for policy 0, policy_version 1215294 (0.0006) [2023-12-28 03:59:33,286][106226] Updated weights for policy 0, policy_version 1215304 (0.0006) [2023-12-28 03:59:33,334][106226] Updated weights for policy 0, policy_version 1215314 (0.0008) [2023-12-28 03:59:33,476][106225] Updated weights for policy 1, policy_version 1218377 (0.0008) [2023-12-28 03:59:33,530][106225] Updated weights for policy 1, policy_version 1218387 (0.0005) [2023-12-28 03:59:33,589][106225] Updated weights for policy 1, policy_version 1218397 (0.0005) [2023-12-28 03:59:33,654][106225] Updated weights for policy 1, policy_version 1218407 (0.0005) [2023-12-28 03:59:34,014][106226] Updated weights for policy 0, policy_version 1215324 (0.0007) [2023-12-28 03:59:34,066][106226] Updated weights for policy 0, policy_version 1215334 (0.0005) [2023-12-28 03:59:34,121][106226] Updated weights for policy 0, policy_version 1215344 (0.0005) [2023-12-28 03:59:34,343][106225] Updated weights for policy 1, policy_version 1218417 (0.0009) [2023-12-28 03:59:34,404][106225] Updated weights for policy 1, policy_version 1218427 (0.0010) [2023-12-28 03:59:34,469][106225] Updated weights for policy 1, policy_version 1218437 (0.0011) [2023-12-28 03:59:34,811][106226] Updated weights for policy 0, policy_version 1215354 (0.0008) [2023-12-28 03:59:34,865][106226] Updated weights for policy 0, policy_version 1215364 (0.0008) [2023-12-28 03:59:34,917][106226] Updated weights for policy 0, policy_version 1215374 (0.0007) [2023-12-28 03:59:34,966][106226] Updated weights for policy 0, policy_version 1215384 (0.0008) [2023-12-28 03:59:35,174][106225] Updated weights for policy 1, policy_version 1218447 (0.0010) [2023-12-28 03:59:35,226][106225] Updated weights for policy 1, policy_version 1218457 (0.0010) [2023-12-28 03:59:35,285][106225] Updated weights for policy 1, policy_version 1218467 (0.0008) [2023-12-28 03:59:35,669][106226] Updated weights for policy 0, policy_version 1215394 (0.0008) [2023-12-28 03:59:35,720][106226] Updated weights for policy 0, policy_version 1215404 (0.0008) [2023-12-28 03:59:35,770][106226] Updated weights for policy 0, policy_version 1215414 (0.0008) [2023-12-28 03:59:35,914][106225] Updated weights for policy 1, policy_version 1218477 (0.0008) [2023-12-28 03:59:35,970][106225] Updated weights for policy 1, policy_version 1218487 (0.0010) [2023-12-28 03:59:36,024][106225] Updated weights for policy 1, policy_version 1218497 (0.0010) [2023-12-28 03:59:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 623190016. Throughput: 0: 9945.1, 1: 9919.1. Samples: 623196740. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:36,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.920')] [2023-12-28 03:59:36,560][106226] Updated weights for policy 0, policy_version 1215424 (0.0008) [2023-12-28 03:59:36,621][106226] Updated weights for policy 0, policy_version 1215434 (0.0008) [2023-12-28 03:59:36,683][106226] Updated weights for policy 0, policy_version 1215444 (0.0008) [2023-12-28 03:59:36,756][106225] Updated weights for policy 1, policy_version 1218507 (0.0010) [2023-12-28 03:59:36,812][106225] Updated weights for policy 1, policy_version 1218517 (0.0010) [2023-12-28 03:59:36,869][106225] Updated weights for policy 1, policy_version 1218527 (0.0010) [2023-12-28 03:59:37,401][106226] Updated weights for policy 0, policy_version 1215454 (0.0007) [2023-12-28 03:59:37,462][106226] Updated weights for policy 0, policy_version 1215464 (0.0008) [2023-12-28 03:59:37,521][106226] Updated weights for policy 0, policy_version 1215474 (0.0008) [2023-12-28 03:59:37,590][106225] Updated weights for policy 1, policy_version 1218537 (0.0010) [2023-12-28 03:59:37,637][106225] Updated weights for policy 1, policy_version 1218547 (0.0010) [2023-12-28 03:59:37,691][106225] Updated weights for policy 1, policy_version 1218557 (0.0010) [2023-12-28 03:59:37,746][106225] Updated weights for policy 1, policy_version 1218567 (0.0011) [2023-12-28 03:59:38,159][106226] Updated weights for policy 0, policy_version 1215484 (0.0007) [2023-12-28 03:59:38,216][106226] Updated weights for policy 0, policy_version 1215494 (0.0005) [2023-12-28 03:59:38,280][106226] Updated weights for policy 0, policy_version 1215504 (0.0006) [2023-12-28 03:59:38,515][106225] Updated weights for policy 1, policy_version 1218577 (0.0010) [2023-12-28 03:59:38,569][106225] Updated weights for policy 1, policy_version 1218587 (0.0010) [2023-12-28 03:59:38,626][106225] Updated weights for policy 1, policy_version 1218597 (0.0010) [2023-12-28 03:59:38,909][106226] Updated weights for policy 0, policy_version 1215514 (0.0008) [2023-12-28 03:59:38,965][106226] Updated weights for policy 0, policy_version 1215524 (0.0007) [2023-12-28 03:59:39,014][106226] Updated weights for policy 0, policy_version 1215534 (0.0005) [2023-12-28 03:59:39,071][106226] Updated weights for policy 0, policy_version 1215544 (0.0005) [2023-12-28 03:59:39,370][106225] Updated weights for policy 1, policy_version 1218607 (0.0009) [2023-12-28 03:59:39,440][106225] Updated weights for policy 1, policy_version 1218617 (0.0009) [2023-12-28 03:59:39,510][106225] Updated weights for policy 1, policy_version 1218627 (0.0011) [2023-12-28 03:59:39,740][106226] Updated weights for policy 0, policy_version 1215554 (0.0008) [2023-12-28 03:59:39,803][106226] Updated weights for policy 0, policy_version 1215564 (0.0008) [2023-12-28 03:59:39,872][106226] Updated weights for policy 0, policy_version 1215574 (0.0008) [2023-12-28 03:59:40,254][106225] Updated weights for policy 1, policy_version 1218637 (0.0011) [2023-12-28 03:59:40,319][106225] Updated weights for policy 1, policy_version 1218647 (0.0010) [2023-12-28 03:59:40,382][106225] Updated weights for policy 1, policy_version 1218657 (0.0010) [2023-12-28 03:59:40,606][106226] Updated weights for policy 0, policy_version 1215584 (0.0010) [2023-12-28 03:59:40,661][106226] Updated weights for policy 0, policy_version 1215594 (0.0011) [2023-12-28 03:59:40,728][106226] Updated weights for policy 0, policy_version 1215604 (0.0008) [2023-12-28 03:59:41,124][106225] Updated weights for policy 1, policy_version 1218667 (0.0008) [2023-12-28 03:59:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 623280128. Throughput: 0: 9950.3, 1: 9898.0. Samples: 623255808. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:41,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-4.878')] [2023-12-28 03:59:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001215608_311255040.pth... [2023-12-28 03:59:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001214424_310951936.pth [2023-12-28 03:59:41,197][106225] Updated weights for policy 1, policy_version 1218677 (0.0008) [2023-12-28 03:59:41,253][106225] Updated weights for policy 1, policy_version 1218687 (0.0008) [2023-12-28 03:59:41,306][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001218696_312033280.pth... [2023-12-28 03:59:41,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001217544_311738368.pth [2023-12-28 03:59:41,406][106226] Updated weights for policy 0, policy_version 1215614 (0.0008) [2023-12-28 03:59:41,471][106226] Updated weights for policy 0, policy_version 1215624 (0.0010) [2023-12-28 03:59:41,536][106226] Updated weights for policy 0, policy_version 1215634 (0.0009) [2023-12-28 03:59:42,014][106225] Updated weights for policy 1, policy_version 1218697 (0.0009) [2023-12-28 03:59:42,077][106225] Updated weights for policy 1, policy_version 1218707 (0.0008) [2023-12-28 03:59:42,142][106225] Updated weights for policy 1, policy_version 1218717 (0.0007) [2023-12-28 03:59:42,196][106225] Updated weights for policy 1, policy_version 1218727 (0.0006) [2023-12-28 03:59:42,253][106226] Updated weights for policy 0, policy_version 1215644 (0.0007) [2023-12-28 03:59:42,318][106226] Updated weights for policy 0, policy_version 1215654 (0.0008) [2023-12-28 03:59:42,391][106226] Updated weights for policy 0, policy_version 1215664 (0.0008) [2023-12-28 03:59:42,825][106225] Updated weights for policy 1, policy_version 1218737 (0.0008) [2023-12-28 03:59:42,878][106225] Updated weights for policy 1, policy_version 1218747 (0.0009) [2023-12-28 03:59:42,941][106225] Updated weights for policy 1, policy_version 1218757 (0.0009) [2023-12-28 03:59:43,117][106226] Updated weights for policy 0, policy_version 1215674 (0.0008) [2023-12-28 03:59:43,170][106226] Updated weights for policy 0, policy_version 1215684 (0.0005) [2023-12-28 03:59:43,225][106226] Updated weights for policy 0, policy_version 1215694 (0.0005) [2023-12-28 03:59:43,281][106226] Updated weights for policy 0, policy_version 1215704 (0.0005) [2023-12-28 03:59:43,735][106225] Updated weights for policy 1, policy_version 1218767 (0.0008) [2023-12-28 03:59:43,790][106225] Updated weights for policy 1, policy_version 1218777 (0.0008) [2023-12-28 03:59:43,842][106225] Updated weights for policy 1, policy_version 1218787 (0.0009) [2023-12-28 03:59:43,900][106226] Updated weights for policy 0, policy_version 1215714 (0.0007) [2023-12-28 03:59:43,955][106226] Updated weights for policy 0, policy_version 1215724 (0.0008) [2023-12-28 03:59:44,009][106226] Updated weights for policy 0, policy_version 1215734 (0.0009) [2023-12-28 03:59:44,483][106225] Updated weights for policy 1, policy_version 1218797 (0.0007) [2023-12-28 03:59:44,550][106225] Updated weights for policy 1, policy_version 1218807 (0.0009) [2023-12-28 03:59:44,605][106225] Updated weights for policy 1, policy_version 1218817 (0.0008) [2023-12-28 03:59:44,776][106226] Updated weights for policy 0, policy_version 1215744 (0.0008) [2023-12-28 03:59:44,840][106226] Updated weights for policy 0, policy_version 1215754 (0.0008) [2023-12-28 03:59:44,897][106226] Updated weights for policy 0, policy_version 1215764 (0.0009) [2023-12-28 03:59:45,326][106225] Updated weights for policy 1, policy_version 1218827 (0.0008) [2023-12-28 03:59:45,382][106225] Updated weights for policy 1, policy_version 1218837 (0.0009) [2023-12-28 03:59:45,448][106225] Updated weights for policy 1, policy_version 1218847 (0.0008) [2023-12-28 03:59:45,671][106226] Updated weights for policy 0, policy_version 1215774 (0.0009) [2023-12-28 03:59:45,735][106226] Updated weights for policy 0, policy_version 1215784 (0.0007) [2023-12-28 03:59:45,798][106226] Updated weights for policy 0, policy_version 1215794 (0.0009) [2023-12-28 03:59:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 623378432. Throughput: 0: 9903.0, 1: 9854.4. Samples: 623371096. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:46,176][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.967')] [2023-12-28 03:59:46,247][106225] Updated weights for policy 1, policy_version 1218857 (0.0008) [2023-12-28 03:59:46,305][106225] Updated weights for policy 1, policy_version 1218867 (0.0009) [2023-12-28 03:59:46,362][106225] Updated weights for policy 1, policy_version 1218877 (0.0008) [2023-12-28 03:59:46,423][106225] Updated weights for policy 1, policy_version 1218887 (0.0006) [2023-12-28 03:59:46,429][106226] Updated weights for policy 0, policy_version 1215804 (0.0010) [2023-12-28 03:59:46,482][106226] Updated weights for policy 0, policy_version 1215814 (0.0010) [2023-12-28 03:59:46,535][106226] Updated weights for policy 0, policy_version 1215824 (0.0010) [2023-12-28 03:59:47,003][106225] Updated weights for policy 1, policy_version 1218897 (0.0005) [2023-12-28 03:59:47,059][106225] Updated weights for policy 1, policy_version 1218907 (0.0006) [2023-12-28 03:59:47,116][106225] Updated weights for policy 1, policy_version 1218917 (0.0005) [2023-12-28 03:59:47,182][106226] Updated weights for policy 0, policy_version 1215834 (0.0010) [2023-12-28 03:59:47,229][106226] Updated weights for policy 0, policy_version 1215844 (0.0009) [2023-12-28 03:59:47,289][106226] Updated weights for policy 0, policy_version 1215855 (0.0009) [2023-12-28 03:59:47,619][106225] Updated weights for policy 1, policy_version 1218927 (0.0005) [2023-12-28 03:59:47,666][106225] Updated weights for policy 1, policy_version 1218937 (0.0005) [2023-12-28 03:59:47,716][106225] Updated weights for policy 1, policy_version 1218947 (0.0005) [2023-12-28 03:59:47,928][106226] Updated weights for policy 0, policy_version 1215865 (0.0006) [2023-12-28 03:59:47,973][106226] Updated weights for policy 0, policy_version 1215875 (0.0008) [2023-12-28 03:59:48,024][106226] Updated weights for policy 0, policy_version 1215885 (0.0008) [2023-12-28 03:59:48,085][106226] Updated weights for policy 0, policy_version 1215895 (0.0008) [2023-12-28 03:59:48,363][106225] Updated weights for policy 1, policy_version 1218957 (0.0007) [2023-12-28 03:59:48,424][106225] Updated weights for policy 1, policy_version 1218967 (0.0008) [2023-12-28 03:59:48,484][106225] Updated weights for policy 1, policy_version 1218977 (0.0009) [2023-12-28 03:59:48,844][106226] Updated weights for policy 0, policy_version 1215905 (0.0008) [2023-12-28 03:59:48,896][106226] Updated weights for policy 0, policy_version 1215915 (0.0008) [2023-12-28 03:59:48,947][106226] Updated weights for policy 0, policy_version 1215925 (0.0008) [2023-12-28 03:59:49,214][106225] Updated weights for policy 1, policy_version 1218987 (0.0008) [2023-12-28 03:59:49,289][106225] Updated weights for policy 1, policy_version 1218997 (0.0008) [2023-12-28 03:59:49,353][106225] Updated weights for policy 1, policy_version 1219007 (0.0009) [2023-12-28 03:59:49,701][106226] Updated weights for policy 0, policy_version 1215935 (0.0010) [2023-12-28 03:59:49,764][106226] Updated weights for policy 0, policy_version 1215945 (0.0011) [2023-12-28 03:59:49,828][106226] Updated weights for policy 0, policy_version 1215955 (0.0011) [2023-12-28 03:59:50,067][106225] Updated weights for policy 1, policy_version 1219017 (0.0008) [2023-12-28 03:59:50,131][106225] Updated weights for policy 1, policy_version 1219027 (0.0008) [2023-12-28 03:59:50,180][106225] Updated weights for policy 1, policy_version 1219037 (0.0007) [2023-12-28 03:59:50,228][106225] Updated weights for policy 1, policy_version 1219047 (0.0008) [2023-12-28 03:59:50,552][106226] Updated weights for policy 0, policy_version 1215965 (0.0011) [2023-12-28 03:59:50,618][106226] Updated weights for policy 0, policy_version 1215975 (0.0011) [2023-12-28 03:59:50,678][106226] Updated weights for policy 0, policy_version 1215985 (0.0010) [2023-12-28 03:59:51,023][106225] Updated weights for policy 1, policy_version 1219057 (0.0008) [2023-12-28 03:59:51,086][106225] Updated weights for policy 1, policy_version 1219067 (0.0008) [2023-12-28 03:59:51,152][106225] Updated weights for policy 1, policy_version 1219077 (0.0008) [2023-12-28 03:59:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 623484928. Throughput: 0: 9911.6, 1: 9840.9. Samples: 623490892. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:51,175][105115] Avg episode reward: [(0, '-4.200'), (1, '-4.715')] [2023-12-28 03:59:51,447][106226] Updated weights for policy 0, policy_version 1215995 (0.0011) [2023-12-28 03:59:51,504][106226] Updated weights for policy 0, policy_version 1216005 (0.0008) [2023-12-28 03:59:51,567][106226] Updated weights for policy 0, policy_version 1216015 (0.0009) [2023-12-28 03:59:51,891][106225] Updated weights for policy 1, policy_version 1219087 (0.0008) [2023-12-28 03:59:51,953][106225] Updated weights for policy 1, policy_version 1219097 (0.0008) [2023-12-28 03:59:51,997][106225] Updated weights for policy 1, policy_version 1219107 (0.0007) [2023-12-28 03:59:52,322][106226] Updated weights for policy 0, policy_version 1216025 (0.0009) [2023-12-28 03:59:52,388][106226] Updated weights for policy 0, policy_version 1216035 (0.0011) [2023-12-28 03:59:52,441][106226] Updated weights for policy 0, policy_version 1216045 (0.0010) [2023-12-28 03:59:52,492][106226] Updated weights for policy 0, policy_version 1216055 (0.0010) [2023-12-28 03:59:52,751][106225] Updated weights for policy 1, policy_version 1219117 (0.0007) [2023-12-28 03:59:52,809][106225] Updated weights for policy 1, policy_version 1219127 (0.0008) [2023-12-28 03:59:52,860][106225] Updated weights for policy 1, policy_version 1219137 (0.0008) [2023-12-28 03:59:53,226][106226] Updated weights for policy 0, policy_version 1216065 (0.0011) [2023-12-28 03:59:53,286][106226] Updated weights for policy 0, policy_version 1216075 (0.0010) [2023-12-28 03:59:53,343][106226] Updated weights for policy 0, policy_version 1216085 (0.0010) [2023-12-28 03:59:53,596][106225] Updated weights for policy 1, policy_version 1219147 (0.0009) [2023-12-28 03:59:53,646][106225] Updated weights for policy 1, policy_version 1219157 (0.0010) [2023-12-28 03:59:53,694][106225] Updated weights for policy 1, policy_version 1219167 (0.0010) [2023-12-28 03:59:54,043][106226] Updated weights for policy 0, policy_version 1216095 (0.0009) [2023-12-28 03:59:54,103][106226] Updated weights for policy 0, policy_version 1216105 (0.0009) [2023-12-28 03:59:54,164][106226] Updated weights for policy 0, policy_version 1216115 (0.0007) [2023-12-28 03:59:54,365][106225] Updated weights for policy 1, policy_version 1219177 (0.0010) [2023-12-28 03:59:54,419][106225] Updated weights for policy 1, policy_version 1219187 (0.0008) [2023-12-28 03:59:54,472][106225] Updated weights for policy 1, policy_version 1219197 (0.0008) [2023-12-28 03:59:54,530][106225] Updated weights for policy 1, policy_version 1219207 (0.0010) [2023-12-28 03:59:54,754][106226] Updated weights for policy 0, policy_version 1216125 (0.0007) [2023-12-28 03:59:54,815][106226] Updated weights for policy 0, policy_version 1216135 (0.0006) [2023-12-28 03:59:54,867][106226] Updated weights for policy 0, policy_version 1216145 (0.0006) [2023-12-28 03:59:55,197][106225] Updated weights for policy 1, policy_version 1219217 (0.0007) [2023-12-28 03:59:55,267][106225] Updated weights for policy 1, policy_version 1219227 (0.0007) [2023-12-28 03:59:55,324][106225] Updated weights for policy 1, policy_version 1219237 (0.0008) [2023-12-28 03:59:55,525][106226] Updated weights for policy 0, policy_version 1216155 (0.0010) [2023-12-28 03:59:55,575][106226] Updated weights for policy 0, policy_version 1216165 (0.0010) [2023-12-28 03:59:55,623][106226] Updated weights for policy 0, policy_version 1216175 (0.0010) [2023-12-28 03:59:55,942][106225] Updated weights for policy 1, policy_version 1219247 (0.0010) [2023-12-28 03:59:55,995][106225] Updated weights for policy 1, policy_version 1219257 (0.0010) [2023-12-28 03:59:56,055][106225] Updated weights for policy 1, policy_version 1219267 (0.0010) [2023-12-28 03:59:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 623583232. Throughput: 0: 9897.0, 1: 9824.8. Samples: 623547604. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 03:59:56,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.983')] [2023-12-28 03:59:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001219272_312180736.pth... [2023-12-28 03:59:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001216184_311402496.pth... [2023-12-28 03:59:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001215032_311107584.pth [2023-12-28 03:59:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001218120_311885824.pth [2023-12-28 03:59:56,253][106226] Updated weights for policy 0, policy_version 1216185 (0.0010) [2023-12-28 03:59:56,303][106226] Updated weights for policy 0, policy_version 1216195 (0.0010) [2023-12-28 03:59:56,363][106226] Updated weights for policy 0, policy_version 1216205 (0.0005) [2023-12-28 03:59:56,417][106226] Updated weights for policy 0, policy_version 1216215 (0.0008) [2023-12-28 03:59:56,650][106225] Updated weights for policy 1, policy_version 1219277 (0.0008) [2023-12-28 03:59:56,720][106225] Updated weights for policy 1, policy_version 1219287 (0.0007) [2023-12-28 03:59:56,775][106225] Updated weights for policy 1, policy_version 1219297 (0.0009) [2023-12-28 03:59:57,096][106226] Updated weights for policy 0, policy_version 1216225 (0.0006) [2023-12-28 03:59:57,153][106226] Updated weights for policy 0, policy_version 1216235 (0.0005) [2023-12-28 03:59:57,202][106226] Updated weights for policy 0, policy_version 1216245 (0.0005) [2023-12-28 03:59:57,421][106225] Updated weights for policy 1, policy_version 1219307 (0.0010) [2023-12-28 03:59:57,469][106225] Updated weights for policy 1, policy_version 1219318 (0.0007) [2023-12-28 03:59:57,514][106225] Updated weights for policy 1, policy_version 1219328 (0.0005) [2023-12-28 03:59:57,830][106226] Updated weights for policy 0, policy_version 1216255 (0.0008) [2023-12-28 03:59:57,890][106226] Updated weights for policy 0, policy_version 1216265 (0.0007) [2023-12-28 03:59:57,956][106226] Updated weights for policy 0, policy_version 1216275 (0.0010) [2023-12-28 03:59:58,066][106225] Updated weights for policy 1, policy_version 1219338 (0.0005) [2023-12-28 03:59:58,115][106225] Updated weights for policy 1, policy_version 1219348 (0.0005) [2023-12-28 03:59:58,173][106225] Updated weights for policy 1, policy_version 1219358 (0.0005) [2023-12-28 03:59:58,244][106225] Updated weights for policy 1, policy_version 1219368 (0.0008) [2023-12-28 03:59:58,887][106226] Updated weights for policy 0, policy_version 1216285 (0.0009) [2023-12-28 03:59:58,950][106226] Updated weights for policy 0, policy_version 1216295 (0.0010) [2023-12-28 03:59:59,017][106226] Updated weights for policy 0, policy_version 1216305 (0.0010) [2023-12-28 03:59:59,038][106225] Updated weights for policy 1, policy_version 1219378 (0.0006) [2023-12-28 03:59:59,095][106225] Updated weights for policy 1, policy_version 1219388 (0.0007) [2023-12-28 03:59:59,157][106225] Updated weights for policy 1, policy_version 1219398 (0.0008) [2023-12-28 03:59:59,827][106226] Updated weights for policy 0, policy_version 1216315 (0.0010) [2023-12-28 03:59:59,903][106226] Updated weights for policy 0, policy_version 1216325 (0.0009) [2023-12-28 03:59:59,939][106225] Updated weights for policy 1, policy_version 1219408 (0.0008) [2023-12-28 03:59:59,963][106226] Updated weights for policy 0, policy_version 1216335 (0.0007) [2023-12-28 03:59:59,998][106225] Updated weights for policy 1, policy_version 1219418 (0.0007) [2023-12-28 04:00:00,056][106225] Updated weights for policy 1, policy_version 1219428 (0.0008) [2023-12-28 04:00:00,717][106226] Updated weights for policy 0, policy_version 1216345 (0.0008) [2023-12-28 04:00:00,718][106225] Updated weights for policy 1, policy_version 1219438 (0.0008) [2023-12-28 04:00:00,773][106226] Updated weights for policy 0, policy_version 1216355 (0.0006) [2023-12-28 04:00:00,778][106225] Updated weights for policy 1, policy_version 1219448 (0.0008) [2023-12-28 04:00:00,836][106226] Updated weights for policy 0, policy_version 1216365 (0.0006) [2023-12-28 04:00:00,839][106225] Updated weights for policy 1, policy_version 1219458 (0.0007) [2023-12-28 04:00:00,898][106226] Updated weights for policy 0, policy_version 1216375 (0.0008) [2023-12-28 04:00:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 623681536. Throughput: 0: 9894.8, 1: 9965.9. Samples: 623669696. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:01,175][105115] Avg episode reward: [(0, '-4.222'), (1, '-4.845')] [2023-12-28 04:00:01,604][106225] Updated weights for policy 1, policy_version 1219468 (0.0008) [2023-12-28 04:00:01,636][106226] Updated weights for policy 0, policy_version 1216385 (0.0008) [2023-12-28 04:00:01,672][106225] Updated weights for policy 1, policy_version 1219478 (0.0007) [2023-12-28 04:00:01,695][106226] Updated weights for policy 0, policy_version 1216395 (0.0008) [2023-12-28 04:00:01,738][106225] Updated weights for policy 1, policy_version 1219488 (0.0007) [2023-12-28 04:00:01,760][106226] Updated weights for policy 0, policy_version 1216405 (0.0008) [2023-12-28 04:00:02,443][106226] Updated weights for policy 0, policy_version 1216415 (0.0006) [2023-12-28 04:00:02,482][106225] Updated weights for policy 1, policy_version 1219498 (0.0006) [2023-12-28 04:00:02,497][106226] Updated weights for policy 0, policy_version 1216425 (0.0009) [2023-12-28 04:00:02,547][106225] Updated weights for policy 1, policy_version 1219508 (0.0006) [2023-12-28 04:00:02,561][106226] Updated weights for policy 0, policy_version 1216435 (0.0009) [2023-12-28 04:00:02,611][106225] Updated weights for policy 1, policy_version 1219518 (0.0007) [2023-12-28 04:00:02,671][106225] Updated weights for policy 1, policy_version 1219528 (0.0009) [2023-12-28 04:00:03,276][106225] Updated weights for policy 1, policy_version 1219538 (0.0006) [2023-12-28 04:00:03,329][106225] Updated weights for policy 1, policy_version 1219548 (0.0009) [2023-12-28 04:00:03,339][106226] Updated weights for policy 0, policy_version 1216445 (0.0007) [2023-12-28 04:00:03,382][106225] Updated weights for policy 1, policy_version 1219558 (0.0008) [2023-12-28 04:00:03,395][106226] Updated weights for policy 0, policy_version 1216455 (0.0007) [2023-12-28 04:00:03,452][106226] Updated weights for policy 0, policy_version 1216465 (0.0008) [2023-12-28 04:00:03,976][106225] Updated weights for policy 1, policy_version 1219568 (0.0009) [2023-12-28 04:00:04,027][106225] Updated weights for policy 1, policy_version 1219578 (0.0009) [2023-12-28 04:00:04,080][106225] Updated weights for policy 1, policy_version 1219588 (0.0005) [2023-12-28 04:00:04,265][106226] Updated weights for policy 0, policy_version 1216475 (0.0009) [2023-12-28 04:00:04,331][106226] Updated weights for policy 0, policy_version 1216485 (0.0008) [2023-12-28 04:00:04,391][106226] Updated weights for policy 0, policy_version 1216495 (0.0007) [2023-12-28 04:00:04,732][106225] Updated weights for policy 1, policy_version 1219598 (0.0007) [2023-12-28 04:00:04,790][106225] Updated weights for policy 1, policy_version 1219608 (0.0006) [2023-12-28 04:00:04,844][106225] Updated weights for policy 1, policy_version 1219618 (0.0005) [2023-12-28 04:00:05,181][106226] Updated weights for policy 0, policy_version 1216505 (0.0010) [2023-12-28 04:00:05,230][106226] Updated weights for policy 0, policy_version 1216515 (0.0009) [2023-12-28 04:00:05,285][106226] Updated weights for policy 0, policy_version 1216525 (0.0008) [2023-12-28 04:00:05,350][106226] Updated weights for policy 0, policy_version 1216535 (0.0008) [2023-12-28 04:00:05,448][106225] Updated weights for policy 1, policy_version 1219628 (0.0007) [2023-12-28 04:00:05,507][106225] Updated weights for policy 1, policy_version 1219638 (0.0009) [2023-12-28 04:00:05,566][106225] Updated weights for policy 1, policy_version 1219648 (0.0010) [2023-12-28 04:00:06,140][106226] Updated weights for policy 0, policy_version 1216545 (0.0009) [2023-12-28 04:00:06,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 623771648. Throughput: 0: 9845.0, 1: 9978.8. Samples: 623787104. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:06,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-4.800')] [2023-12-28 04:00:06,204][106225] Updated weights for policy 1, policy_version 1219658 (0.0010) [2023-12-28 04:00:06,204][106226] Updated weights for policy 0, policy_version 1216555 (0.0008) [2023-12-28 04:00:06,268][106226] Updated weights for policy 0, policy_version 1216565 (0.0008) [2023-12-28 04:00:06,269][106225] Updated weights for policy 1, policy_version 1219668 (0.0009) [2023-12-28 04:00:06,329][106225] Updated weights for policy 1, policy_version 1219678 (0.0009) [2023-12-28 04:00:06,396][106225] Updated weights for policy 1, policy_version 1219688 (0.0008) [2023-12-28 04:00:07,006][106226] Updated weights for policy 0, policy_version 1216575 (0.0008) [2023-12-28 04:00:07,055][106226] Updated weights for policy 0, policy_version 1216585 (0.0010) [2023-12-28 04:00:07,086][106225] Updated weights for policy 1, policy_version 1219698 (0.0006) [2023-12-28 04:00:07,103][106226] Updated weights for policy 0, policy_version 1216595 (0.0006) [2023-12-28 04:00:07,142][106225] Updated weights for policy 1, policy_version 1219708 (0.0008) [2023-12-28 04:00:07,189][106225] Updated weights for policy 1, policy_version 1219718 (0.0010) [2023-12-28 04:00:07,711][106226] Updated weights for policy 0, policy_version 1216605 (0.0007) [2023-12-28 04:00:07,777][106226] Updated weights for policy 0, policy_version 1216615 (0.0008) [2023-12-28 04:00:07,839][106226] Updated weights for policy 0, policy_version 1216625 (0.0008) [2023-12-28 04:00:07,895][106225] Updated weights for policy 1, policy_version 1219728 (0.0006) [2023-12-28 04:00:07,950][106225] Updated weights for policy 1, policy_version 1219738 (0.0006) [2023-12-28 04:00:08,000][106225] Updated weights for policy 1, policy_version 1219748 (0.0010) [2023-12-28 04:00:08,418][106226] Updated weights for policy 0, policy_version 1216635 (0.0005) [2023-12-28 04:00:08,487][106226] Updated weights for policy 0, policy_version 1216645 (0.0005) [2023-12-28 04:00:08,546][106226] Updated weights for policy 0, policy_version 1216655 (0.0010) [2023-12-28 04:00:08,616][106225] Updated weights for policy 1, policy_version 1219758 (0.0010) [2023-12-28 04:00:08,662][106225] Updated weights for policy 1, policy_version 1219768 (0.0009) [2023-12-28 04:00:08,710][106225] Updated weights for policy 1, policy_version 1219778 (0.0005) [2023-12-28 04:00:09,280][106226] Updated weights for policy 0, policy_version 1216665 (0.0008) [2023-12-28 04:00:09,329][106225] Updated weights for policy 1, policy_version 1219788 (0.0008) [2023-12-28 04:00:09,347][106226] Updated weights for policy 0, policy_version 1216675 (0.0008) [2023-12-28 04:00:09,398][106225] Updated weights for policy 1, policy_version 1219799 (0.0008) [2023-12-28 04:00:09,417][106226] Updated weights for policy 0, policy_version 1216685 (0.0008) [2023-12-28 04:00:09,466][106225] Updated weights for policy 1, policy_version 1219809 (0.0010) [2023-12-28 04:00:09,479][106226] Updated weights for policy 0, policy_version 1216695 (0.0008) [2023-12-28 04:00:10,186][106225] Updated weights for policy 1, policy_version 1219819 (0.0009) [2023-12-28 04:00:10,228][106226] Updated weights for policy 0, policy_version 1216705 (0.0010) [2023-12-28 04:00:10,246][106225] Updated weights for policy 1, policy_version 1219829 (0.0006) [2023-12-28 04:00:10,289][106226] Updated weights for policy 0, policy_version 1216715 (0.0011) [2023-12-28 04:00:10,308][106225] Updated weights for policy 1, policy_version 1219839 (0.0006) [2023-12-28 04:00:10,354][106226] Updated weights for policy 0, policy_version 1216725 (0.0011) [2023-12-28 04:00:10,904][106225] Updated weights for policy 1, policy_version 1219849 (0.0006) [2023-12-28 04:00:10,934][106226] Updated weights for policy 0, policy_version 1216735 (0.0009) [2023-12-28 04:00:10,956][106225] Updated weights for policy 1, policy_version 1219859 (0.0007) [2023-12-28 04:00:10,994][106226] Updated weights for policy 0, policy_version 1216745 (0.0010) [2023-12-28 04:00:11,017][106225] Updated weights for policy 1, policy_version 1219869 (0.0006) [2023-12-28 04:00:11,063][106226] Updated weights for policy 0, policy_version 1216755 (0.0009) [2023-12-28 04:00:11,084][106225] Updated weights for policy 1, policy_version 1219879 (0.0006) [2023-12-28 04:00:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 623886336. Throughput: 0: 9882.5, 1: 10024.8. Samples: 623848964. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:11,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-5.147')] [2023-12-28 04:00:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001219880_312336384.pth... [2023-12-28 04:00:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001216760_311549952.pth... [2023-12-28 04:00:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001215608_311255040.pth [2023-12-28 04:00:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001218696_312033280.pth [2023-12-28 04:00:11,795][106225] Updated weights for policy 1, policy_version 1219889 (0.0007) [2023-12-28 04:00:11,856][106225] Updated weights for policy 1, policy_version 1219899 (0.0008) [2023-12-28 04:00:11,858][106226] Updated weights for policy 0, policy_version 1216765 (0.0008) [2023-12-28 04:00:11,911][106226] Updated weights for policy 0, policy_version 1216775 (0.0006) [2023-12-28 04:00:11,912][106225] Updated weights for policy 1, policy_version 1219909 (0.0007) [2023-12-28 04:00:11,975][106226] Updated weights for policy 0, policy_version 1216785 (0.0008) [2023-12-28 04:00:12,604][106225] Updated weights for policy 1, policy_version 1219919 (0.0008) [2023-12-28 04:00:12,657][106226] Updated weights for policy 0, policy_version 1216795 (0.0007) [2023-12-28 04:00:12,669][106225] Updated weights for policy 1, policy_version 1219929 (0.0008) [2023-12-28 04:00:12,713][106226] Updated weights for policy 0, policy_version 1216805 (0.0006) [2023-12-28 04:00:12,736][106225] Updated weights for policy 1, policy_version 1219939 (0.0008) [2023-12-28 04:00:12,775][106226] Updated weights for policy 0, policy_version 1216815 (0.0006) [2023-12-28 04:00:13,338][106226] Updated weights for policy 0, policy_version 1216825 (0.0007) [2023-12-28 04:00:13,391][106226] Updated weights for policy 0, policy_version 1216835 (0.0005) [2023-12-28 04:00:13,429][106225] Updated weights for policy 1, policy_version 1219949 (0.0009) [2023-12-28 04:00:13,441][106226] Updated weights for policy 0, policy_version 1216845 (0.0006) [2023-12-28 04:00:13,486][106225] Updated weights for policy 1, policy_version 1219959 (0.0010) [2023-12-28 04:00:13,494][106226] Updated weights for policy 0, policy_version 1216855 (0.0009) [2023-12-28 04:00:13,546][106225] Updated weights for policy 1, policy_version 1219969 (0.0010) [2023-12-28 04:00:14,117][106226] Updated weights for policy 0, policy_version 1216865 (0.0007) [2023-12-28 04:00:14,140][106225] Updated weights for policy 1, policy_version 1219979 (0.0009) [2023-12-28 04:00:14,165][106226] Updated weights for policy 0, policy_version 1216875 (0.0006) [2023-12-28 04:00:14,198][106225] Updated weights for policy 1, policy_version 1219989 (0.0007) [2023-12-28 04:00:14,216][106226] Updated weights for policy 0, policy_version 1216885 (0.0006) [2023-12-28 04:00:14,253][106225] Updated weights for policy 1, policy_version 1219999 (0.0008) [2023-12-28 04:00:14,912][106225] Updated weights for policy 1, policy_version 1220009 (0.0008) [2023-12-28 04:00:14,952][106226] Updated weights for policy 0, policy_version 1216895 (0.0007) [2023-12-28 04:00:14,978][106225] Updated weights for policy 1, policy_version 1220019 (0.0006) [2023-12-28 04:00:15,019][106226] Updated weights for policy 0, policy_version 1216905 (0.0008) [2023-12-28 04:00:15,047][106225] Updated weights for policy 1, policy_version 1220029 (0.0006) [2023-12-28 04:00:15,084][106226] Updated weights for policy 0, policy_version 1216915 (0.0009) [2023-12-28 04:00:15,111][106225] Updated weights for policy 1, policy_version 1220039 (0.0007) [2023-12-28 04:00:15,692][106225] Updated weights for policy 1, policy_version 1220049 (0.0008) [2023-12-28 04:00:15,759][106225] Updated weights for policy 1, policy_version 1220059 (0.0007) [2023-12-28 04:00:15,822][106225] Updated weights for policy 1, policy_version 1220069 (0.0009) [2023-12-28 04:00:15,841][106226] Updated weights for policy 0, policy_version 1216925 (0.0006) [2023-12-28 04:00:15,897][106226] Updated weights for policy 0, policy_version 1216935 (0.0008) [2023-12-28 04:00:15,962][106226] Updated weights for policy 0, policy_version 1216945 (0.0009) [2023-12-28 04:00:16,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 623984640. Throughput: 0: 9833.3, 1: 10034.1. Samples: 623970592. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:16,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.875')] [2023-12-28 04:00:16,448][106225] Updated weights for policy 1, policy_version 1220079 (0.0009) [2023-12-28 04:00:16,498][106225] Updated weights for policy 1, policy_version 1220089 (0.0008) [2023-12-28 04:00:16,551][106225] Updated weights for policy 1, policy_version 1220099 (0.0008) [2023-12-28 04:00:16,738][106226] Updated weights for policy 0, policy_version 1216955 (0.0008) [2023-12-28 04:00:16,805][106226] Updated weights for policy 0, policy_version 1216965 (0.0009) [2023-12-28 04:00:16,870][106226] Updated weights for policy 0, policy_version 1216975 (0.0009) [2023-12-28 04:00:17,247][106225] Updated weights for policy 1, policy_version 1220109 (0.0008) [2023-12-28 04:00:17,292][106225] Updated weights for policy 1, policy_version 1220119 (0.0008) [2023-12-28 04:00:17,336][106225] Updated weights for policy 1, policy_version 1220129 (0.0008) [2023-12-28 04:00:17,587][106226] Updated weights for policy 0, policy_version 1216985 (0.0008) [2023-12-28 04:00:17,642][106226] Updated weights for policy 0, policy_version 1216995 (0.0009) [2023-12-28 04:00:17,694][106226] Updated weights for policy 0, policy_version 1217005 (0.0008) [2023-12-28 04:00:17,749][106226] Updated weights for policy 0, policy_version 1217015 (0.0009) [2023-12-28 04:00:18,122][106225] Updated weights for policy 1, policy_version 1220139 (0.0008) [2023-12-28 04:00:18,176][106225] Updated weights for policy 1, policy_version 1220149 (0.0005) [2023-12-28 04:00:18,233][106225] Updated weights for policy 1, policy_version 1220159 (0.0005) [2023-12-28 04:00:18,446][106226] Updated weights for policy 0, policy_version 1217025 (0.0008) [2023-12-28 04:00:18,512][106226] Updated weights for policy 0, policy_version 1217035 (0.0008) [2023-12-28 04:00:18,575][106226] Updated weights for policy 0, policy_version 1217045 (0.0006) [2023-12-28 04:00:18,881][106225] Updated weights for policy 1, policy_version 1220169 (0.0005) [2023-12-28 04:00:18,930][106225] Updated weights for policy 1, policy_version 1220179 (0.0006) [2023-12-28 04:00:18,979][106225] Updated weights for policy 1, policy_version 1220189 (0.0006) [2023-12-28 04:00:19,039][106225] Updated weights for policy 1, policy_version 1220199 (0.0005) [2023-12-28 04:00:19,231][106226] Updated weights for policy 0, policy_version 1217055 (0.0008) [2023-12-28 04:00:19,286][106226] Updated weights for policy 0, policy_version 1217065 (0.0007) [2023-12-28 04:00:19,347][106226] Updated weights for policy 0, policy_version 1217075 (0.0009) [2023-12-28 04:00:19,672][106225] Updated weights for policy 1, policy_version 1220209 (0.0010) [2023-12-28 04:00:19,735][106225] Updated weights for policy 1, policy_version 1220219 (0.0007) [2023-12-28 04:00:19,793][106225] Updated weights for policy 1, policy_version 1220229 (0.0006) [2023-12-28 04:00:20,074][106226] Updated weights for policy 0, policy_version 1217085 (0.0007) [2023-12-28 04:00:20,142][106226] Updated weights for policy 0, policy_version 1217095 (0.0008) [2023-12-28 04:00:20,202][106226] Updated weights for policy 0, policy_version 1217105 (0.0007) [2023-12-28 04:00:20,449][106225] Updated weights for policy 1, policy_version 1220239 (0.0008) [2023-12-28 04:00:20,514][106225] Updated weights for policy 1, policy_version 1220249 (0.0009) [2023-12-28 04:00:20,589][106225] Updated weights for policy 1, policy_version 1220259 (0.0008) [2023-12-28 04:00:20,896][106226] Updated weights for policy 0, policy_version 1217115 (0.0010) [2023-12-28 04:00:20,961][106226] Updated weights for policy 0, policy_version 1217125 (0.0011) [2023-12-28 04:00:21,027][106226] Updated weights for policy 0, policy_version 1217135 (0.0009) [2023-12-28 04:00:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 624082944. Throughput: 0: 9763.5, 1: 10084.8. Samples: 624089912. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:21,175][105115] Avg episode reward: [(0, '-4.167'), (1, '-5.019')] [2023-12-28 04:00:21,350][106225] Updated weights for policy 1, policy_version 1220269 (0.0009) [2023-12-28 04:00:21,420][106225] Updated weights for policy 1, policy_version 1220279 (0.0006) [2023-12-28 04:00:21,478][106225] Updated weights for policy 1, policy_version 1220289 (0.0007) [2023-12-28 04:00:21,808][106226] Updated weights for policy 0, policy_version 1217145 (0.0008) [2023-12-28 04:00:21,874][106226] Updated weights for policy 0, policy_version 1217155 (0.0008) [2023-12-28 04:00:21,937][106226] Updated weights for policy 0, policy_version 1217165 (0.0009) [2023-12-28 04:00:22,007][106226] Updated weights for policy 0, policy_version 1217175 (0.0009) [2023-12-28 04:00:22,261][106225] Updated weights for policy 1, policy_version 1220299 (0.0006) [2023-12-28 04:00:22,330][106225] Updated weights for policy 1, policy_version 1220309 (0.0009) [2023-12-28 04:00:22,398][106225] Updated weights for policy 1, policy_version 1220319 (0.0009) [2023-12-28 04:00:22,740][106226] Updated weights for policy 0, policy_version 1217185 (0.0009) [2023-12-28 04:00:22,785][106226] Updated weights for policy 0, policy_version 1217195 (0.0009) [2023-12-28 04:00:22,846][106226] Updated weights for policy 0, policy_version 1217205 (0.0009) [2023-12-28 04:00:23,148][106225] Updated weights for policy 1, policy_version 1220329 (0.0009) [2023-12-28 04:00:23,207][106225] Updated weights for policy 1, policy_version 1220339 (0.0008) [2023-12-28 04:00:23,262][106225] Updated weights for policy 1, policy_version 1220349 (0.0005) [2023-12-28 04:00:23,313][106225] Updated weights for policy 1, policy_version 1220359 (0.0005) [2023-12-28 04:00:23,610][106226] Updated weights for policy 0, policy_version 1217215 (0.0008) [2023-12-28 04:00:23,664][106226] Updated weights for policy 0, policy_version 1217225 (0.0009) [2023-12-28 04:00:23,713][106226] Updated weights for policy 0, policy_version 1217235 (0.0008) [2023-12-28 04:00:23,862][106225] Updated weights for policy 1, policy_version 1220369 (0.0008) [2023-12-28 04:00:23,921][106225] Updated weights for policy 1, policy_version 1220379 (0.0008) [2023-12-28 04:00:23,974][106225] Updated weights for policy 1, policy_version 1220389 (0.0006) [2023-12-28 04:00:24,523][106226] Updated weights for policy 0, policy_version 1217245 (0.0008) [2023-12-28 04:00:24,573][106225] Updated weights for policy 1, policy_version 1220399 (0.0006) [2023-12-28 04:00:24,577][106226] Updated weights for policy 0, policy_version 1217255 (0.0009) [2023-12-28 04:00:24,629][106225] Updated weights for policy 1, policy_version 1220409 (0.0005) [2023-12-28 04:00:24,631][106226] Updated weights for policy 0, policy_version 1217265 (0.0008) [2023-12-28 04:00:24,682][106225] Updated weights for policy 1, policy_version 1220419 (0.0005) [2023-12-28 04:00:25,218][106225] Updated weights for policy 1, policy_version 1220429 (0.0005) [2023-12-28 04:00:25,279][106225] Updated weights for policy 1, policy_version 1220439 (0.0005) [2023-12-28 04:00:25,345][106225] Updated weights for policy 1, policy_version 1220449 (0.0005) [2023-12-28 04:00:25,459][106226] Updated weights for policy 0, policy_version 1217275 (0.0008) [2023-12-28 04:00:25,506][106226] Updated weights for policy 0, policy_version 1217285 (0.0008) [2023-12-28 04:00:25,569][106226] Updated weights for policy 0, policy_version 1217295 (0.0009) [2023-12-28 04:00:25,884][106225] Updated weights for policy 1, policy_version 1220459 (0.0005) [2023-12-28 04:00:25,940][106225] Updated weights for policy 1, policy_version 1220469 (0.0005) [2023-12-28 04:00:25,987][106225] Updated weights for policy 1, policy_version 1220479 (0.0005) [2023-12-28 04:00:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 624181248. Throughput: 0: 9687.3, 1: 10094.6. Samples: 624145992. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:26,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.853')] [2023-12-28 04:00:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001217304_311689216.pth... [2023-12-28 04:00:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001220488_312492032.pth... [2023-12-28 04:00:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001216184_311402496.pth [2023-12-28 04:00:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001219272_312180736.pth [2023-12-28 04:00:26,370][106226] Updated weights for policy 0, policy_version 1217305 (0.0009) [2023-12-28 04:00:26,425][106226] Updated weights for policy 0, policy_version 1217315 (0.0008) [2023-12-28 04:00:26,483][106226] Updated weights for policy 0, policy_version 1217325 (0.0008) [2023-12-28 04:00:26,526][106226] Updated weights for policy 0, policy_version 1217335 (0.0008) [2023-12-28 04:00:26,611][106225] Updated weights for policy 1, policy_version 1220489 (0.0005) [2023-12-28 04:00:26,655][106225] Updated weights for policy 1, policy_version 1220499 (0.0008) [2023-12-28 04:00:26,700][106225] Updated weights for policy 1, policy_version 1220509 (0.0008) [2023-12-28 04:00:26,758][106225] Updated weights for policy 1, policy_version 1220520 (0.0008) [2023-12-28 04:00:27,241][106226] Updated weights for policy 0, policy_version 1217345 (0.0008) [2023-12-28 04:00:27,291][106226] Updated weights for policy 0, policy_version 1217355 (0.0008) [2023-12-28 04:00:27,348][106226] Updated weights for policy 0, policy_version 1217365 (0.0006) [2023-12-28 04:00:27,494][106225] Updated weights for policy 1, policy_version 1220530 (0.0010) [2023-12-28 04:00:27,539][106225] Updated weights for policy 1, policy_version 1220540 (0.0010) [2023-12-28 04:00:27,595][106225] Updated weights for policy 1, policy_version 1220550 (0.0009) [2023-12-28 04:00:27,918][106226] Updated weights for policy 0, policy_version 1217375 (0.0007) [2023-12-28 04:00:27,965][106226] Updated weights for policy 0, policy_version 1217385 (0.0008) [2023-12-28 04:00:28,023][106226] Updated weights for policy 0, policy_version 1217395 (0.0009) [2023-12-28 04:00:28,257][106225] Updated weights for policy 1, policy_version 1220560 (0.0010) [2023-12-28 04:00:28,307][106225] Updated weights for policy 1, policy_version 1220570 (0.0010) [2023-12-28 04:00:28,369][106225] Updated weights for policy 1, policy_version 1220580 (0.0010) [2023-12-28 04:00:28,714][106226] Updated weights for policy 0, policy_version 1217405 (0.0008) [2023-12-28 04:00:28,771][106226] Updated weights for policy 0, policy_version 1217415 (0.0008) [2023-12-28 04:00:28,837][106226] Updated weights for policy 0, policy_version 1217425 (0.0008) [2023-12-28 04:00:29,084][106225] Updated weights for policy 1, policy_version 1220590 (0.0010) [2023-12-28 04:00:29,130][106225] Updated weights for policy 1, policy_version 1220600 (0.0010) [2023-12-28 04:00:29,179][106225] Updated weights for policy 1, policy_version 1220610 (0.0010) [2023-12-28 04:00:29,544][106226] Updated weights for policy 0, policy_version 1217435 (0.0009) [2023-12-28 04:00:29,610][106226] Updated weights for policy 0, policy_version 1217445 (0.0008) [2023-12-28 04:00:29,666][106226] Updated weights for policy 0, policy_version 1217455 (0.0005) [2023-12-28 04:00:30,061][106225] Updated weights for policy 1, policy_version 1220620 (0.0010) [2023-12-28 04:00:30,123][106225] Updated weights for policy 1, policy_version 1220630 (0.0009) [2023-12-28 04:00:30,180][106225] Updated weights for policy 1, policy_version 1220640 (0.0009) [2023-12-28 04:00:30,218][106226] Updated weights for policy 0, policy_version 1217465 (0.0005) [2023-12-28 04:00:30,279][106226] Updated weights for policy 0, policy_version 1217475 (0.0005) [2023-12-28 04:00:30,349][106226] Updated weights for policy 0, policy_version 1217485 (0.0006) [2023-12-28 04:00:30,414][106226] Updated weights for policy 0, policy_version 1217495 (0.0006) [2023-12-28 04:00:30,964][106225] Updated weights for policy 1, policy_version 1220650 (0.0009) [2023-12-28 04:00:31,029][106225] Updated weights for policy 1, policy_version 1220660 (0.0007) [2023-12-28 04:00:31,049][106226] Updated weights for policy 0, policy_version 1217505 (0.0008) [2023-12-28 04:00:31,091][106225] Updated weights for policy 1, policy_version 1220670 (0.0010) [2023-12-28 04:00:31,106][106226] Updated weights for policy 0, policy_version 1217515 (0.0010) [2023-12-28 04:00:31,159][106225] Updated weights for policy 1, policy_version 1220680 (0.0012) [2023-12-28 04:00:31,165][106226] Updated weights for policy 0, policy_version 1217525 (0.0009) [2023-12-28 04:00:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 624279552. Throughput: 0: 9718.1, 1: 10250.9. Samples: 624269696. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:31,175][105115] Avg episode reward: [(0, '-4.227'), (1, '-4.572')] [2023-12-28 04:00:31,868][106226] Updated weights for policy 0, policy_version 1217535 (0.0006) [2023-12-28 04:00:31,898][106225] Updated weights for policy 1, policy_version 1220690 (0.0006) [2023-12-28 04:00:31,928][106226] Updated weights for policy 0, policy_version 1217545 (0.0007) [2023-12-28 04:00:31,955][106225] Updated weights for policy 1, policy_version 1220700 (0.0007) [2023-12-28 04:00:31,987][106226] Updated weights for policy 0, policy_version 1217555 (0.0006) [2023-12-28 04:00:32,015][106225] Updated weights for policy 1, policy_version 1220710 (0.0008) [2023-12-28 04:00:32,662][106226] Updated weights for policy 0, policy_version 1217565 (0.0007) [2023-12-28 04:00:32,723][106226] Updated weights for policy 0, policy_version 1217575 (0.0008) [2023-12-28 04:00:32,757][106225] Updated weights for policy 1, policy_version 1220720 (0.0007) [2023-12-28 04:00:32,775][106226] Updated weights for policy 0, policy_version 1217585 (0.0007) [2023-12-28 04:00:32,818][106225] Updated weights for policy 1, policy_version 1220730 (0.0007) [2023-12-28 04:00:32,878][106225] Updated weights for policy 1, policy_version 1220740 (0.0008) [2023-12-28 04:00:33,488][106226] Updated weights for policy 0, policy_version 1217595 (0.0005) [2023-12-28 04:00:33,497][106225] Updated weights for policy 1, policy_version 1220750 (0.0008) [2023-12-28 04:00:33,544][106226] Updated weights for policy 0, policy_version 1217605 (0.0006) [2023-12-28 04:00:33,544][106225] Updated weights for policy 1, policy_version 1220760 (0.0006) [2023-12-28 04:00:33,594][106225] Updated weights for policy 1, policy_version 1220770 (0.0007) [2023-12-28 04:00:33,599][106226] Updated weights for policy 0, policy_version 1217615 (0.0006) [2023-12-28 04:00:34,238][106226] Updated weights for policy 0, policy_version 1217625 (0.0006) [2023-12-28 04:00:34,292][106226] Updated weights for policy 0, policy_version 1217635 (0.0011) [2023-12-28 04:00:34,302][106225] Updated weights for policy 1, policy_version 1220780 (0.0007) [2023-12-28 04:00:34,349][106226] Updated weights for policy 0, policy_version 1217645 (0.0011) [2023-12-28 04:00:34,356][106225] Updated weights for policy 1, policy_version 1220790 (0.0006) [2023-12-28 04:00:34,414][106226] Updated weights for policy 0, policy_version 1217655 (0.0011) [2023-12-28 04:00:34,417][106225] Updated weights for policy 1, policy_version 1220800 (0.0006) [2023-12-28 04:00:35,122][106226] Updated weights for policy 0, policy_version 1217665 (0.0010) [2023-12-28 04:00:35,166][106225] Updated weights for policy 1, policy_version 1220810 (0.0008) [2023-12-28 04:00:35,187][106226] Updated weights for policy 0, policy_version 1217675 (0.0010) [2023-12-28 04:00:35,218][106225] Updated weights for policy 1, policy_version 1220820 (0.0008) [2023-12-28 04:00:35,249][106226] Updated weights for policy 0, policy_version 1217685 (0.0010) [2023-12-28 04:00:35,271][106225] Updated weights for policy 1, policy_version 1220830 (0.0006) [2023-12-28 04:00:35,318][106225] Updated weights for policy 1, policy_version 1220840 (0.0007) [2023-12-28 04:00:35,949][106226] Updated weights for policy 0, policy_version 1217695 (0.0009) [2023-12-28 04:00:35,997][106226] Updated weights for policy 0, policy_version 1217705 (0.0008) [2023-12-28 04:00:36,053][106226] Updated weights for policy 0, policy_version 1217715 (0.0008) [2023-12-28 04:00:36,068][106225] Updated weights for policy 1, policy_version 1220850 (0.0005) [2023-12-28 04:00:36,124][106225] Updated weights for policy 1, policy_version 1220860 (0.0009) [2023-12-28 04:00:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 624377856. Throughput: 0: 9744.9, 1: 10163.7. Samples: 624386780. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:36,175][105115] Avg episode reward: [(0, '-4.077'), (1, '-5.230')] [2023-12-28 04:00:36,185][106225] Updated weights for policy 1, policy_version 1220870 (0.0007) [2023-12-28 04:00:36,797][106226] Updated weights for policy 0, policy_version 1217725 (0.0008) [2023-12-28 04:00:36,862][106226] Updated weights for policy 0, policy_version 1217735 (0.0008) [2023-12-28 04:00:36,917][106225] Updated weights for policy 1, policy_version 1220880 (0.0008) [2023-12-28 04:00:36,921][106226] Updated weights for policy 0, policy_version 1217745 (0.0006) [2023-12-28 04:00:36,973][106225] Updated weights for policy 1, policy_version 1220890 (0.0008) [2023-12-28 04:00:37,027][106225] Updated weights for policy 1, policy_version 1220900 (0.0009) [2023-12-28 04:00:37,589][106226] Updated weights for policy 0, policy_version 1217755 (0.0007) [2023-12-28 04:00:37,642][106226] Updated weights for policy 0, policy_version 1217765 (0.0006) [2023-12-28 04:00:37,693][106226] Updated weights for policy 0, policy_version 1217775 (0.0008) [2023-12-28 04:00:37,758][106225] Updated weights for policy 1, policy_version 1220910 (0.0008) [2023-12-28 04:00:37,816][106225] Updated weights for policy 1, policy_version 1220920 (0.0008) [2023-12-28 04:00:37,872][106225] Updated weights for policy 1, policy_version 1220930 (0.0007) [2023-12-28 04:00:38,423][106226] Updated weights for policy 0, policy_version 1217785 (0.0008) [2023-12-28 04:00:38,484][106226] Updated weights for policy 0, policy_version 1217795 (0.0011) [2023-12-28 04:00:38,505][106225] Updated weights for policy 1, policy_version 1220940 (0.0005) [2023-12-28 04:00:38,545][106226] Updated weights for policy 0, policy_version 1217805 (0.0011) [2023-12-28 04:00:38,564][106225] Updated weights for policy 1, policy_version 1220950 (0.0009) [2023-12-28 04:00:38,608][106226] Updated weights for policy 0, policy_version 1217815 (0.0007) [2023-12-28 04:00:38,627][106225] Updated weights for policy 1, policy_version 1220960 (0.0008) [2023-12-28 04:00:39,345][106225] Updated weights for policy 1, policy_version 1220970 (0.0008) [2023-12-28 04:00:39,355][106226] Updated weights for policy 0, policy_version 1217825 (0.0010) [2023-12-28 04:00:39,414][106225] Updated weights for policy 1, policy_version 1220980 (0.0009) [2023-12-28 04:00:39,428][106226] Updated weights for policy 0, policy_version 1217835 (0.0008) [2023-12-28 04:00:39,477][106225] Updated weights for policy 1, policy_version 1220990 (0.0007) [2023-12-28 04:00:39,494][106226] Updated weights for policy 0, policy_version 1217845 (0.0008) [2023-12-28 04:00:39,537][106225] Updated weights for policy 1, policy_version 1221000 (0.0006) [2023-12-28 04:00:40,210][106225] Updated weights for policy 1, policy_version 1221010 (0.0006) [2023-12-28 04:00:40,277][106225] Updated weights for policy 1, policy_version 1221020 (0.0007) [2023-12-28 04:00:40,318][106226] Updated weights for policy 0, policy_version 1217855 (0.0006) [2023-12-28 04:00:40,345][106225] Updated weights for policy 1, policy_version 1221030 (0.0008) [2023-12-28 04:00:40,381][106226] Updated weights for policy 0, policy_version 1217865 (0.0007) [2023-12-28 04:00:40,441][106226] Updated weights for policy 0, policy_version 1217875 (0.0008) [2023-12-28 04:00:40,903][106225] Updated weights for policy 1, policy_version 1221040 (0.0007) [2023-12-28 04:00:40,962][106225] Updated weights for policy 1, policy_version 1221050 (0.0008) [2023-12-28 04:00:41,026][106225] Updated weights for policy 1, policy_version 1221060 (0.0010) [2023-12-28 04:00:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 624476160. Throughput: 0: 9774.0, 1: 10188.3. Samples: 624445904. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:41,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-5.125')] [2023-12-28 04:00:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001221064_312639488.pth... [2023-12-28 04:00:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001219880_312336384.pth [2023-12-28 04:00:41,219][106226] Updated weights for policy 0, policy_version 1217885 (0.0009) [2023-12-28 04:00:41,289][106226] Updated weights for policy 0, policy_version 1217895 (0.0008) [2023-12-28 04:00:41,359][106226] Updated weights for policy 0, policy_version 1217905 (0.0008) [2023-12-28 04:00:41,411][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001217912_311844864.pth... [2023-12-28 04:00:41,415][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001216760_311549952.pth [2023-12-28 04:00:41,837][106225] Updated weights for policy 1, policy_version 1221070 (0.0008) [2023-12-28 04:00:41,900][106225] Updated weights for policy 1, policy_version 1221080 (0.0008) [2023-12-28 04:00:41,967][106225] Updated weights for policy 1, policy_version 1221090 (0.0008) [2023-12-28 04:00:42,060][106226] Updated weights for policy 0, policy_version 1217915 (0.0007) [2023-12-28 04:00:42,119][106226] Updated weights for policy 0, policy_version 1217925 (0.0005) [2023-12-28 04:00:42,181][106226] Updated weights for policy 0, policy_version 1217935 (0.0007) [2023-12-28 04:00:42,697][106225] Updated weights for policy 1, policy_version 1221100 (0.0007) [2023-12-28 04:00:42,761][106225] Updated weights for policy 1, policy_version 1221110 (0.0005) [2023-12-28 04:00:42,823][106225] Updated weights for policy 1, policy_version 1221120 (0.0005) [2023-12-28 04:00:42,916][106226] Updated weights for policy 0, policy_version 1217945 (0.0008) [2023-12-28 04:00:42,964][106226] Updated weights for policy 0, policy_version 1217955 (0.0008) [2023-12-28 04:00:43,014][106226] Updated weights for policy 0, policy_version 1217965 (0.0009) [2023-12-28 04:00:43,065][106226] Updated weights for policy 0, policy_version 1217975 (0.0009) [2023-12-28 04:00:43,365][106225] Updated weights for policy 1, policy_version 1221130 (0.0005) [2023-12-28 04:00:43,431][106225] Updated weights for policy 1, policy_version 1221140 (0.0008) [2023-12-28 04:00:43,487][106225] Updated weights for policy 1, policy_version 1221150 (0.0009) [2023-12-28 04:00:43,537][106225] Updated weights for policy 1, policy_version 1221160 (0.0005) [2023-12-28 04:00:43,843][106226] Updated weights for policy 0, policy_version 1217985 (0.0008) [2023-12-28 04:00:43,890][106226] Updated weights for policy 0, policy_version 1217995 (0.0008) [2023-12-28 04:00:43,946][106226] Updated weights for policy 0, policy_version 1218005 (0.0009) [2023-12-28 04:00:44,144][106225] Updated weights for policy 1, policy_version 1221170 (0.0008) [2023-12-28 04:00:44,208][106225] Updated weights for policy 1, policy_version 1221180 (0.0008) [2023-12-28 04:00:44,275][106225] Updated weights for policy 1, policy_version 1221190 (0.0008) [2023-12-28 04:00:44,590][106226] Updated weights for policy 0, policy_version 1218015 (0.0006) [2023-12-28 04:00:44,649][106226] Updated weights for policy 0, policy_version 1218025 (0.0008) [2023-12-28 04:00:44,710][106226] Updated weights for policy 0, policy_version 1218035 (0.0009) [2023-12-28 04:00:45,003][106225] Updated weights for policy 1, policy_version 1221200 (0.0008) [2023-12-28 04:00:45,063][106225] Updated weights for policy 1, policy_version 1221210 (0.0009) [2023-12-28 04:00:45,125][106225] Updated weights for policy 1, policy_version 1221220 (0.0008) [2023-12-28 04:00:45,490][106226] Updated weights for policy 0, policy_version 1218045 (0.0009) [2023-12-28 04:00:45,552][106226] Updated weights for policy 0, policy_version 1218055 (0.0008) [2023-12-28 04:00:45,612][106226] Updated weights for policy 0, policy_version 1218065 (0.0008) [2023-12-28 04:00:45,822][106225] Updated weights for policy 1, policy_version 1221230 (0.0010) [2023-12-28 04:00:45,882][106225] Updated weights for policy 1, policy_version 1221240 (0.0011) [2023-12-28 04:00:45,942][106225] Updated weights for policy 1, policy_version 1221250 (0.0010) [2023-12-28 04:00:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 624574464. Throughput: 0: 9695.4, 1: 10162.4. Samples: 624563296. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:46,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-5.107')] [2023-12-28 04:00:46,343][106226] Updated weights for policy 0, policy_version 1218075 (0.0008) [2023-12-28 04:00:46,404][106226] Updated weights for policy 0, policy_version 1218085 (0.0010) [2023-12-28 04:00:46,461][106226] Updated weights for policy 0, policy_version 1218095 (0.0010) [2023-12-28 04:00:46,580][106225] Updated weights for policy 1, policy_version 1221260 (0.0010) [2023-12-28 04:00:46,636][106225] Updated weights for policy 1, policy_version 1221270 (0.0006) [2023-12-28 04:00:46,689][106225] Updated weights for policy 1, policy_version 1221280 (0.0005) [2023-12-28 04:00:47,119][106226] Updated weights for policy 0, policy_version 1218105 (0.0010) [2023-12-28 04:00:47,187][106226] Updated weights for policy 0, policy_version 1218115 (0.0005) [2023-12-28 04:00:47,250][106226] Updated weights for policy 0, policy_version 1218125 (0.0005) [2023-12-28 04:00:47,315][106226] Updated weights for policy 0, policy_version 1218135 (0.0005) [2023-12-28 04:00:47,393][106225] Updated weights for policy 1, policy_version 1221290 (0.0006) [2023-12-28 04:00:47,457][106225] Updated weights for policy 1, policy_version 1221300 (0.0005) [2023-12-28 04:00:47,514][106225] Updated weights for policy 1, policy_version 1221310 (0.0005) [2023-12-28 04:00:47,565][106225] Updated weights for policy 1, policy_version 1221320 (0.0008) [2023-12-28 04:00:47,794][106226] Updated weights for policy 0, policy_version 1218145 (0.0005) [2023-12-28 04:00:47,844][106226] Updated weights for policy 0, policy_version 1218155 (0.0005) [2023-12-28 04:00:47,895][106226] Updated weights for policy 0, policy_version 1218165 (0.0006) [2023-12-28 04:00:48,313][106225] Updated weights for policy 1, policy_version 1221330 (0.0008) [2023-12-28 04:00:48,380][106225] Updated weights for policy 1, policy_version 1221340 (0.0008) [2023-12-28 04:00:48,443][106225] Updated weights for policy 1, policy_version 1221350 (0.0008) [2023-12-28 04:00:48,539][106226] Updated weights for policy 0, policy_version 1218175 (0.0006) [2023-12-28 04:00:48,605][106226] Updated weights for policy 0, policy_version 1218185 (0.0008) [2023-12-28 04:00:48,667][106226] Updated weights for policy 0, policy_version 1218195 (0.0008) [2023-12-28 04:00:49,142][106225] Updated weights for policy 1, policy_version 1221360 (0.0008) [2023-12-28 04:00:49,204][106225] Updated weights for policy 1, policy_version 1221370 (0.0009) [2023-12-28 04:00:49,263][106225] Updated weights for policy 1, policy_version 1221380 (0.0006) [2023-12-28 04:00:49,422][106226] Updated weights for policy 0, policy_version 1218205 (0.0008) [2023-12-28 04:00:49,476][106226] Updated weights for policy 0, policy_version 1218215 (0.0009) [2023-12-28 04:00:49,539][106226] Updated weights for policy 0, policy_version 1218225 (0.0007) [2023-12-28 04:00:50,004][106225] Updated weights for policy 1, policy_version 1221390 (0.0007) [2023-12-28 04:00:50,066][106225] Updated weights for policy 1, policy_version 1221400 (0.0005) [2023-12-28 04:00:50,131][106225] Updated weights for policy 1, policy_version 1221410 (0.0006) [2023-12-28 04:00:50,224][106226] Updated weights for policy 0, policy_version 1218235 (0.0008) [2023-12-28 04:00:50,284][106226] Updated weights for policy 0, policy_version 1218245 (0.0009) [2023-12-28 04:00:50,344][106226] Updated weights for policy 0, policy_version 1218255 (0.0009) [2023-12-28 04:00:50,813][106225] Updated weights for policy 1, policy_version 1221420 (0.0008) [2023-12-28 04:00:50,875][106225] Updated weights for policy 1, policy_version 1221430 (0.0009) [2023-12-28 04:00:50,938][106225] Updated weights for policy 1, policy_version 1221440 (0.0008) [2023-12-28 04:00:51,040][106226] Updated weights for policy 0, policy_version 1218265 (0.0009) [2023-12-28 04:00:51,107][106226] Updated weights for policy 0, policy_version 1218275 (0.0008) [2023-12-28 04:00:51,169][106226] Updated weights for policy 0, policy_version 1218285 (0.0008) [2023-12-28 04:00:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 624672768. Throughput: 0: 9825.2, 1: 10109.1. Samples: 624684148. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:51,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-5.096')] [2023-12-28 04:00:51,231][106226] Updated weights for policy 0, policy_version 1218295 (0.0010) [2023-12-28 04:00:51,684][106225] Updated weights for policy 1, policy_version 1221450 (0.0008) [2023-12-28 04:00:51,751][106225] Updated weights for policy 1, policy_version 1221460 (0.0009) [2023-12-28 04:00:51,804][106225] Updated weights for policy 1, policy_version 1221470 (0.0008) [2023-12-28 04:00:51,861][106225] Updated weights for policy 1, policy_version 1221480 (0.0008) [2023-12-28 04:00:51,973][106226] Updated weights for policy 0, policy_version 1218305 (0.0009) [2023-12-28 04:00:52,027][106226] Updated weights for policy 0, policy_version 1218315 (0.0009) [2023-12-28 04:00:52,088][106226] Updated weights for policy 0, policy_version 1218325 (0.0009) [2023-12-28 04:00:52,644][106225] Updated weights for policy 1, policy_version 1221490 (0.0009) [2023-12-28 04:00:52,702][106225] Updated weights for policy 1, policy_version 1221500 (0.0009) [2023-12-28 04:00:52,762][106225] Updated weights for policy 1, policy_version 1221510 (0.0009) [2023-12-28 04:00:52,863][106226] Updated weights for policy 0, policy_version 1218335 (0.0008) [2023-12-28 04:00:52,926][106226] Updated weights for policy 0, policy_version 1218345 (0.0009) [2023-12-28 04:00:52,988][106226] Updated weights for policy 0, policy_version 1218355 (0.0011) [2023-12-28 04:00:53,428][106225] Updated weights for policy 1, policy_version 1221520 (0.0008) [2023-12-28 04:00:53,481][106225] Updated weights for policy 1, policy_version 1221530 (0.0009) [2023-12-28 04:00:53,534][106225] Updated weights for policy 1, policy_version 1221540 (0.0010) [2023-12-28 04:00:53,661][106226] Updated weights for policy 0, policy_version 1218365 (0.0008) [2023-12-28 04:00:53,712][106226] Updated weights for policy 0, policy_version 1218375 (0.0007) [2023-12-28 04:00:53,767][106226] Updated weights for policy 0, policy_version 1218385 (0.0008) [2023-12-28 04:00:54,234][106225] Updated weights for policy 1, policy_version 1221550 (0.0009) [2023-12-28 04:00:54,284][106225] Updated weights for policy 1, policy_version 1221560 (0.0010) [2023-12-28 04:00:54,330][106225] Updated weights for policy 1, policy_version 1221570 (0.0010) [2023-12-28 04:00:54,459][106226] Updated weights for policy 0, policy_version 1218395 (0.0008) [2023-12-28 04:00:54,520][106226] Updated weights for policy 0, policy_version 1218405 (0.0008) [2023-12-28 04:00:54,573][106226] Updated weights for policy 0, policy_version 1218415 (0.0007) [2023-12-28 04:00:54,959][106225] Updated weights for policy 1, policy_version 1221580 (0.0009) [2023-12-28 04:00:55,021][106225] Updated weights for policy 1, policy_version 1221590 (0.0008) [2023-12-28 04:00:55,083][106225] Updated weights for policy 1, policy_version 1221600 (0.0007) [2023-12-28 04:00:55,270][106226] Updated weights for policy 0, policy_version 1218425 (0.0010) [2023-12-28 04:00:55,329][106226] Updated weights for policy 0, policy_version 1218435 (0.0009) [2023-12-28 04:00:55,390][106226] Updated weights for policy 0, policy_version 1218445 (0.0008) [2023-12-28 04:00:55,445][106226] Updated weights for policy 0, policy_version 1218455 (0.0009) [2023-12-28 04:00:55,757][106225] Updated weights for policy 1, policy_version 1221610 (0.0008) [2023-12-28 04:00:55,818][106225] Updated weights for policy 1, policy_version 1221620 (0.0005) [2023-12-28 04:00:55,870][106225] Updated weights for policy 1, policy_version 1221630 (0.0005) [2023-12-28 04:00:55,936][106225] Updated weights for policy 1, policy_version 1221640 (0.0005) [2023-12-28 04:00:56,007][106226] Updated weights for policy 0, policy_version 1218465 (0.0008) [2023-12-28 04:00:56,064][106226] Updated weights for policy 0, policy_version 1218475 (0.0006) [2023-12-28 04:00:56,109][106226] Updated weights for policy 0, policy_version 1218485 (0.0009) [2023-12-28 04:00:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 624779264. Throughput: 0: 9770.4, 1: 10055.0. Samples: 624741108. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:00:56,175][105115] Avg episode reward: [(0, '-4.183'), (1, '-5.029')] [2023-12-28 04:00:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001221640_312786944.pth... [2023-12-28 04:00:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001218488_311992320.pth... [2023-12-28 04:00:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001220488_312492032.pth [2023-12-28 04:00:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001217304_311689216.pth [2023-12-28 04:00:56,478][106225] Updated weights for policy 1, policy_version 1221650 (0.0005) [2023-12-28 04:00:56,536][106225] Updated weights for policy 1, policy_version 1221660 (0.0005) [2023-12-28 04:00:56,593][106225] Updated weights for policy 1, policy_version 1221670 (0.0005) [2023-12-28 04:00:56,815][106226] Updated weights for policy 0, policy_version 1218495 (0.0007) [2023-12-28 04:00:56,871][106226] Updated weights for policy 0, policy_version 1218505 (0.0005) [2023-12-28 04:00:56,919][106226] Updated weights for policy 0, policy_version 1218515 (0.0005) [2023-12-28 04:00:57,114][106225] Updated weights for policy 1, policy_version 1221680 (0.0005) [2023-12-28 04:00:57,171][106225] Updated weights for policy 1, policy_version 1221690 (0.0005) [2023-12-28 04:00:57,233][106225] Updated weights for policy 1, policy_version 1221700 (0.0005) [2023-12-28 04:00:57,536][106226] Updated weights for policy 0, policy_version 1218525 (0.0007) [2023-12-28 04:00:57,592][106226] Updated weights for policy 0, policy_version 1218535 (0.0009) [2023-12-28 04:00:57,654][106226] Updated weights for policy 0, policy_version 1218545 (0.0008) [2023-12-28 04:00:57,932][106225] Updated weights for policy 1, policy_version 1221710 (0.0007) [2023-12-28 04:00:57,986][106225] Updated weights for policy 1, policy_version 1221720 (0.0008) [2023-12-28 04:00:58,040][106225] Updated weights for policy 1, policy_version 1221730 (0.0009) [2023-12-28 04:00:58,270][106226] Updated weights for policy 0, policy_version 1218555 (0.0007) [2023-12-28 04:00:58,337][106226] Updated weights for policy 0, policy_version 1218565 (0.0008) [2023-12-28 04:00:58,405][106226] Updated weights for policy 0, policy_version 1218575 (0.0008) [2023-12-28 04:00:58,873][106225] Updated weights for policy 1, policy_version 1221740 (0.0008) [2023-12-28 04:00:58,947][106225] Updated weights for policy 1, policy_version 1221750 (0.0008) [2023-12-28 04:00:59,010][106225] Updated weights for policy 1, policy_version 1221760 (0.0008) [2023-12-28 04:00:59,217][106226] Updated weights for policy 0, policy_version 1218585 (0.0008) [2023-12-28 04:00:59,284][106226] Updated weights for policy 0, policy_version 1218595 (0.0009) [2023-12-28 04:00:59,347][106226] Updated weights for policy 0, policy_version 1218605 (0.0008) [2023-12-28 04:00:59,417][106226] Updated weights for policy 0, policy_version 1218615 (0.0008) [2023-12-28 04:00:59,780][106225] Updated weights for policy 1, policy_version 1221770 (0.0008) [2023-12-28 04:00:59,847][106225] Updated weights for policy 1, policy_version 1221780 (0.0010) [2023-12-28 04:00:59,913][106225] Updated weights for policy 1, policy_version 1221790 (0.0008) [2023-12-28 04:00:59,980][106225] Updated weights for policy 1, policy_version 1221800 (0.0010) [2023-12-28 04:01:00,254][106226] Updated weights for policy 0, policy_version 1218625 (0.0008) [2023-12-28 04:01:00,324][106226] Updated weights for policy 0, policy_version 1218635 (0.0009) [2023-12-28 04:01:00,387][106226] Updated weights for policy 0, policy_version 1218645 (0.0008) [2023-12-28 04:01:00,700][106225] Updated weights for policy 1, policy_version 1221810 (0.0005) [2023-12-28 04:01:00,760][106225] Updated weights for policy 1, policy_version 1221820 (0.0005) [2023-12-28 04:01:00,810][106225] Updated weights for policy 1, policy_version 1221830 (0.0005) [2023-12-28 04:01:01,085][106226] Updated weights for policy 0, policy_version 1218655 (0.0008) [2023-12-28 04:01:01,161][106226] Updated weights for policy 0, policy_version 1218665 (0.0008) [2023-12-28 04:01:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 624869376. Throughput: 0: 9781.2, 1: 10055.9. Samples: 624863264. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:01:01,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.697')] [2023-12-28 04:01:01,226][106226] Updated weights for policy 0, policy_version 1218675 (0.0008) [2023-12-28 04:01:01,538][106225] Updated weights for policy 1, policy_version 1221840 (0.0010) [2023-12-28 04:01:01,608][106225] Updated weights for policy 1, policy_version 1221850 (0.0011) [2023-12-28 04:01:01,692][106225] Updated weights for policy 1, policy_version 1221860 (0.0011) [2023-12-28 04:01:02,008][106226] Updated weights for policy 0, policy_version 1218685 (0.0009) [2023-12-28 04:01:02,075][106226] Updated weights for policy 0, policy_version 1218695 (0.0009) [2023-12-28 04:01:02,129][106226] Updated weights for policy 0, policy_version 1218705 (0.0007) [2023-12-28 04:01:02,359][106225] Updated weights for policy 1, policy_version 1221870 (0.0008) [2023-12-28 04:01:02,421][106225] Updated weights for policy 1, policy_version 1221880 (0.0006) [2023-12-28 04:01:02,485][106225] Updated weights for policy 1, policy_version 1221890 (0.0006) [2023-12-28 04:01:02,895][106226] Updated weights for policy 0, policy_version 1218715 (0.0008) [2023-12-28 04:01:02,954][106226] Updated weights for policy 0, policy_version 1218725 (0.0008) [2023-12-28 04:01:03,009][106226] Updated weights for policy 0, policy_version 1218735 (0.0008) [2023-12-28 04:01:03,132][106225] Updated weights for policy 1, policy_version 1221900 (0.0007) [2023-12-28 04:01:03,179][106225] Updated weights for policy 1, policy_version 1221910 (0.0006) [2023-12-28 04:01:03,231][106225] Updated weights for policy 1, policy_version 1221920 (0.0007) [2023-12-28 04:01:03,777][106226] Updated weights for policy 0, policy_version 1218745 (0.0009) [2023-12-28 04:01:03,833][106226] Updated weights for policy 0, policy_version 1218755 (0.0008) [2023-12-28 04:01:03,909][106226] Updated weights for policy 0, policy_version 1218765 (0.0008) [2023-12-28 04:01:03,930][106225] Updated weights for policy 1, policy_version 1221930 (0.0008) [2023-12-28 04:01:03,971][106226] Updated weights for policy 0, policy_version 1218775 (0.0008) [2023-12-28 04:01:03,997][106225] Updated weights for policy 1, policy_version 1221940 (0.0007) [2023-12-28 04:01:04,063][106225] Updated weights for policy 1, policy_version 1221950 (0.0008) [2023-12-28 04:01:04,125][106225] Updated weights for policy 1, policy_version 1221960 (0.0008) [2023-12-28 04:01:04,733][106226] Updated weights for policy 0, policy_version 1218785 (0.0008) [2023-12-28 04:01:04,791][106226] Updated weights for policy 0, policy_version 1218795 (0.0006) [2023-12-28 04:01:04,848][106225] Updated weights for policy 1, policy_version 1221970 (0.0007) [2023-12-28 04:01:04,858][106226] Updated weights for policy 0, policy_version 1218805 (0.0008) [2023-12-28 04:01:04,905][106225] Updated weights for policy 1, policy_version 1221980 (0.0009) [2023-12-28 04:01:04,960][106225] Updated weights for policy 1, policy_version 1221990 (0.0008) [2023-12-28 04:01:05,615][106226] Updated weights for policy 0, policy_version 1218815 (0.0008) [2023-12-28 04:01:05,653][106225] Updated weights for policy 1, policy_version 1222000 (0.0010) [2023-12-28 04:01:05,675][106226] Updated weights for policy 0, policy_version 1218825 (0.0007) [2023-12-28 04:01:05,708][106225] Updated weights for policy 1, policy_version 1222010 (0.0008) [2023-12-28 04:01:05,738][106226] Updated weights for policy 0, policy_version 1218835 (0.0007) [2023-12-28 04:01:05,764][106225] Updated weights for policy 1, policy_version 1222020 (0.0006) [2023-12-28 04:01:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 624967680. Throughput: 0: 9707.3, 1: 9973.8. Samples: 624975560. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:01:06,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.822')] [2023-12-28 04:01:06,475][106225] Updated weights for policy 1, policy_version 1222030 (0.0008) [2023-12-28 04:01:06,538][106225] Updated weights for policy 1, policy_version 1222040 (0.0009) [2023-12-28 04:01:06,583][106226] Updated weights for policy 0, policy_version 1218845 (0.0007) [2023-12-28 04:01:06,597][106225] Updated weights for policy 1, policy_version 1222050 (0.0007) [2023-12-28 04:01:06,647][106226] Updated weights for policy 0, policy_version 1218855 (0.0009) [2023-12-28 04:01:06,711][106226] Updated weights for policy 0, policy_version 1218865 (0.0009) [2023-12-28 04:01:07,371][106225] Updated weights for policy 1, policy_version 1222060 (0.0007) [2023-12-28 04:01:07,431][106225] Updated weights for policy 1, policy_version 1222070 (0.0008) [2023-12-28 04:01:07,466][106226] Updated weights for policy 0, policy_version 1218875 (0.0008) [2023-12-28 04:01:07,492][106225] Updated weights for policy 1, policy_version 1222080 (0.0008) [2023-12-28 04:01:07,526][106226] Updated weights for policy 0, policy_version 1218885 (0.0007) [2023-12-28 04:01:07,583][106226] Updated weights for policy 0, policy_version 1218895 (0.0008) [2023-12-28 04:01:08,214][106225] Updated weights for policy 1, policy_version 1222090 (0.0007) [2023-12-28 04:01:08,273][106225] Updated weights for policy 1, policy_version 1222100 (0.0008) [2023-12-28 04:01:08,325][106225] Updated weights for policy 1, policy_version 1222110 (0.0008) [2023-12-28 04:01:08,340][106226] Updated weights for policy 0, policy_version 1218905 (0.0008) [2023-12-28 04:01:08,393][106225] Updated weights for policy 1, policy_version 1222120 (0.0007) [2023-12-28 04:01:08,406][106226] Updated weights for policy 0, policy_version 1218915 (0.0008) [2023-12-28 04:01:08,467][106226] Updated weights for policy 0, policy_version 1218925 (0.0008) [2023-12-28 04:01:08,530][106226] Updated weights for policy 0, policy_version 1218935 (0.0008) [2023-12-28 04:01:09,126][106225] Updated weights for policy 1, policy_version 1222130 (0.0008) [2023-12-28 04:01:09,178][106225] Updated weights for policy 1, policy_version 1222140 (0.0009) [2023-12-28 04:01:09,254][106225] Updated weights for policy 1, policy_version 1222150 (0.0011) [2023-12-28 04:01:09,297][106226] Updated weights for policy 0, policy_version 1218945 (0.0007) [2023-12-28 04:01:09,371][106226] Updated weights for policy 0, policy_version 1218955 (0.0007) [2023-12-28 04:01:09,440][106226] Updated weights for policy 0, policy_version 1218965 (0.0008) [2023-12-28 04:01:09,997][106225] Updated weights for policy 1, policy_version 1222160 (0.0009) [2023-12-28 04:01:10,059][106225] Updated weights for policy 1, policy_version 1222170 (0.0009) [2023-12-28 04:01:10,115][106225] Updated weights for policy 1, policy_version 1222180 (0.0009) [2023-12-28 04:01:10,281][106226] Updated weights for policy 0, policy_version 1218975 (0.0010) [2023-12-28 04:01:10,338][106226] Updated weights for policy 0, policy_version 1218985 (0.0009) [2023-12-28 04:01:10,407][106226] Updated weights for policy 0, policy_version 1218995 (0.0010) [2023-12-28 04:01:10,899][106225] Updated weights for policy 1, policy_version 1222190 (0.0008) [2023-12-28 04:01:10,953][106225] Updated weights for policy 1, policy_version 1222200 (0.0008) [2023-12-28 04:01:11,007][106225] Updated weights for policy 1, policy_version 1222210 (0.0008) [2023-12-28 04:01:11,173][106226] Updated weights for policy 0, policy_version 1219005 (0.0009) [2023-12-28 04:01:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 625057792. Throughput: 0: 9714.1, 1: 9964.7. Samples: 625031536. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:01:11,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.131')] [2023-12-28 04:01:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001222216_312934400.pth... [2023-12-28 04:01:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001221064_312639488.pth [2023-12-28 04:01:11,238][106226] Updated weights for policy 0, policy_version 1219015 (0.0009) [2023-12-28 04:01:11,308][106226] Updated weights for policy 0, policy_version 1219025 (0.0009) [2023-12-28 04:01:11,348][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001219032_312131584.pth... [2023-12-28 04:01:11,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001217912_311844864.pth [2023-12-28 04:01:11,877][106225] Updated weights for policy 1, policy_version 1222220 (0.0008) [2023-12-28 04:01:11,944][106225] Updated weights for policy 1, policy_version 1222230 (0.0008) [2023-12-28 04:01:12,010][106225] Updated weights for policy 1, policy_version 1222240 (0.0008) [2023-12-28 04:01:12,081][106226] Updated weights for policy 0, policy_version 1219035 (0.0008) [2023-12-28 04:01:12,141][106226] Updated weights for policy 0, policy_version 1219045 (0.0008) [2023-12-28 04:01:12,209][106226] Updated weights for policy 0, policy_version 1219055 (0.0008) [2023-12-28 04:01:12,666][106225] Updated weights for policy 1, policy_version 1222250 (0.0008) [2023-12-28 04:01:12,720][106225] Updated weights for policy 1, policy_version 1222260 (0.0007) [2023-12-28 04:01:12,779][106225] Updated weights for policy 1, policy_version 1222270 (0.0008) [2023-12-28 04:01:12,840][106225] Updated weights for policy 1, policy_version 1222280 (0.0007) [2023-12-28 04:01:12,972][106226] Updated weights for policy 0, policy_version 1219065 (0.0006) [2023-12-28 04:01:13,035][106226] Updated weights for policy 0, policy_version 1219075 (0.0007) [2023-12-28 04:01:13,107][106226] Updated weights for policy 0, policy_version 1219085 (0.0009) [2023-12-28 04:01:13,166][106226] Updated weights for policy 0, policy_version 1219095 (0.0009) [2023-12-28 04:01:13,509][106225] Updated weights for policy 1, policy_version 1222290 (0.0007) [2023-12-28 04:01:13,565][106225] Updated weights for policy 1, policy_version 1222300 (0.0007) [2023-12-28 04:01:13,629][106225] Updated weights for policy 1, policy_version 1222310 (0.0005) [2023-12-28 04:01:13,902][106226] Updated weights for policy 0, policy_version 1219105 (0.0008) [2023-12-28 04:01:13,968][106226] Updated weights for policy 0, policy_version 1219115 (0.0009) [2023-12-28 04:01:14,033][106226] Updated weights for policy 0, policy_version 1219125 (0.0006) [2023-12-28 04:01:14,238][106225] Updated weights for policy 1, policy_version 1222320 (0.0005) [2023-12-28 04:01:14,305][106225] Updated weights for policy 1, policy_version 1222330 (0.0006) [2023-12-28 04:01:14,368][106225] Updated weights for policy 1, policy_version 1222340 (0.0005) [2023-12-28 04:01:14,773][106226] Updated weights for policy 0, policy_version 1219135 (0.0008) [2023-12-28 04:01:14,836][106226] Updated weights for policy 0, policy_version 1219145 (0.0008) [2023-12-28 04:01:14,906][106226] Updated weights for policy 0, policy_version 1219155 (0.0009) [2023-12-28 04:01:14,937][106225] Updated weights for policy 1, policy_version 1222350 (0.0006) [2023-12-28 04:01:15,003][106225] Updated weights for policy 1, policy_version 1222360 (0.0008) [2023-12-28 04:01:15,059][106225] Updated weights for policy 1, policy_version 1222370 (0.0008) [2023-12-28 04:01:15,658][106226] Updated weights for policy 0, policy_version 1219165 (0.0006) [2023-12-28 04:01:15,731][106226] Updated weights for policy 0, policy_version 1219175 (0.0007) [2023-12-28 04:01:15,761][106225] Updated weights for policy 1, policy_version 1222380 (0.0008) [2023-12-28 04:01:15,785][106226] Updated weights for policy 0, policy_version 1219185 (0.0008) [2023-12-28 04:01:15,821][106225] Updated weights for policy 1, policy_version 1222390 (0.0007) [2023-12-28 04:01:15,869][106225] Updated weights for policy 1, policy_version 1222400 (0.0008) [2023-12-28 04:01:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 625156096. Throughput: 0: 9593.1, 1: 9841.0. Samples: 625144228. Policy #0 lag: (min: 56.0, avg: 56.0, max: 56.0) [2023-12-28 04:01:16,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-4.918')] [2023-12-28 04:01:16,509][106226] Updated weights for policy 0, policy_version 1219195 (0.0007) [2023-12-28 04:01:16,566][106226] Updated weights for policy 0, policy_version 1219205 (0.0011) [2023-12-28 04:01:16,630][106225] Updated weights for policy 1, policy_version 1222410 (0.0008) [2023-12-28 04:01:16,633][106226] Updated weights for policy 0, policy_version 1219215 (0.0011) [2023-12-28 04:01:16,692][106225] Updated weights for policy 1, policy_version 1222420 (0.0006) [2023-12-28 04:01:16,757][106225] Updated weights for policy 1, policy_version 1222430 (0.0006) [2023-12-28 04:01:16,825][106225] Updated weights for policy 1, policy_version 1222440 (0.0008) [2023-12-28 04:01:17,205][106226] Updated weights for policy 0, policy_version 1219225 (0.0010) [2023-12-28 04:01:17,265][106226] Updated weights for policy 0, policy_version 1219235 (0.0009) [2023-12-28 04:01:17,326][106226] Updated weights for policy 0, policy_version 1219245 (0.0010) [2023-12-28 04:01:17,385][106226] Updated weights for policy 0, policy_version 1219255 (0.0010) [2023-12-28 04:01:17,543][106225] Updated weights for policy 1, policy_version 1222450 (0.0007) [2023-12-28 04:01:17,599][106225] Updated weights for policy 1, policy_version 1222460 (0.0009) [2023-12-28 04:01:17,656][106225] Updated weights for policy 1, policy_version 1222470 (0.0009) [2023-12-28 04:01:18,042][106226] Updated weights for policy 0, policy_version 1219265 (0.0008) [2023-12-28 04:01:18,102][106226] Updated weights for policy 0, policy_version 1219275 (0.0005) [2023-12-28 04:01:18,152][106226] Updated weights for policy 0, policy_version 1219285 (0.0008) [2023-12-28 04:01:18,326][106225] Updated weights for policy 1, policy_version 1222480 (0.0008) [2023-12-28 04:01:18,395][106225] Updated weights for policy 1, policy_version 1222490 (0.0008) [2023-12-28 04:01:18,454][106225] Updated weights for policy 1, policy_version 1222500 (0.0008) [2023-12-28 04:01:18,887][106226] Updated weights for policy 0, policy_version 1219295 (0.0011) [2023-12-28 04:01:18,944][106226] Updated weights for policy 0, policy_version 1219305 (0.0011) [2023-12-28 04:01:19,008][106226] Updated weights for policy 0, policy_version 1219315 (0.0011) [2023-12-28 04:01:19,167][106225] Updated weights for policy 1, policy_version 1222510 (0.0007) [2023-12-28 04:01:19,215][106225] Updated weights for policy 1, policy_version 1222520 (0.0008) [2023-12-28 04:01:19,278][106225] Updated weights for policy 1, policy_version 1222530 (0.0007) [2023-12-28 04:01:19,781][106226] Updated weights for policy 0, policy_version 1219325 (0.0010) [2023-12-28 04:01:19,852][106226] Updated weights for policy 0, policy_version 1219335 (0.0010) [2023-12-28 04:01:19,921][106226] Updated weights for policy 0, policy_version 1219345 (0.0008) [2023-12-28 04:01:20,092][106225] Updated weights for policy 1, policy_version 1222540 (0.0007) [2023-12-28 04:01:20,153][106225] Updated weights for policy 1, policy_version 1222550 (0.0007) [2023-12-28 04:01:20,213][106225] Updated weights for policy 1, policy_version 1222560 (0.0006) [2023-12-28 04:01:20,698][106226] Updated weights for policy 0, policy_version 1219355 (0.0008) [2023-12-28 04:01:20,766][106226] Updated weights for policy 0, policy_version 1219365 (0.0008) [2023-12-28 04:01:20,830][106226] Updated weights for policy 0, policy_version 1219375 (0.0009) [2023-12-28 04:01:20,895][106225] Updated weights for policy 1, policy_version 1222570 (0.0007) [2023-12-28 04:01:20,957][106225] Updated weights for policy 1, policy_version 1222580 (0.0008) [2023-12-28 04:01:21,017][106225] Updated weights for policy 1, policy_version 1222590 (0.0008) [2023-12-28 04:01:21,089][106225] Updated weights for policy 1, policy_version 1222600 (0.0008) [2023-12-28 04:01:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.2). Total num frames: 625254400. Throughput: 0: 9545.4, 1: 9871.9. Samples: 625260560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:21,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.888')] [2023-12-28 04:01:21,533][106226] Updated weights for policy 0, policy_version 1219385 (0.0007) [2023-12-28 04:01:21,595][106226] Updated weights for policy 0, policy_version 1219395 (0.0008) [2023-12-28 04:01:21,663][106226] Updated weights for policy 0, policy_version 1219405 (0.0008) [2023-12-28 04:01:21,726][106226] Updated weights for policy 0, policy_version 1219415 (0.0008) [2023-12-28 04:01:21,840][106225] Updated weights for policy 1, policy_version 1222610 (0.0008) [2023-12-28 04:01:21,895][106225] Updated weights for policy 1, policy_version 1222620 (0.0008) [2023-12-28 04:01:21,954][106225] Updated weights for policy 1, policy_version 1222630 (0.0007) [2023-12-28 04:01:22,488][106226] Updated weights for policy 0, policy_version 1219425 (0.0008) [2023-12-28 04:01:22,550][106226] Updated weights for policy 0, policy_version 1219435 (0.0011) [2023-12-28 04:01:22,612][106226] Updated weights for policy 0, policy_version 1219445 (0.0010) [2023-12-28 04:01:22,665][106225] Updated weights for policy 1, policy_version 1222640 (0.0007) [2023-12-28 04:01:22,725][106225] Updated weights for policy 1, policy_version 1222650 (0.0006) [2023-12-28 04:01:22,783][106225] Updated weights for policy 1, policy_version 1222660 (0.0006) [2023-12-28 04:01:23,317][106226] Updated weights for policy 0, policy_version 1219455 (0.0010) [2023-12-28 04:01:23,379][106226] Updated weights for policy 0, policy_version 1219465 (0.0011) [2023-12-28 04:01:23,436][106226] Updated weights for policy 0, policy_version 1219475 (0.0010) [2023-12-28 04:01:23,507][106225] Updated weights for policy 1, policy_version 1222670 (0.0007) [2023-12-28 04:01:23,562][106225] Updated weights for policy 1, policy_version 1222680 (0.0009) [2023-12-28 04:01:23,616][106225] Updated weights for policy 1, policy_version 1222690 (0.0008) [2023-12-28 04:01:24,044][106226] Updated weights for policy 0, policy_version 1219485 (0.0011) [2023-12-28 04:01:24,109][106226] Updated weights for policy 0, policy_version 1219495 (0.0011) [2023-12-28 04:01:24,165][106226] Updated weights for policy 0, policy_version 1219505 (0.0011) [2023-12-28 04:01:24,408][106225] Updated weights for policy 1, policy_version 1222700 (0.0008) [2023-12-28 04:01:24,462][106225] Updated weights for policy 1, policy_version 1222710 (0.0007) [2023-12-28 04:01:24,518][106225] Updated weights for policy 1, policy_version 1222720 (0.0008) [2023-12-28 04:01:24,845][106226] Updated weights for policy 0, policy_version 1219515 (0.0011) [2023-12-28 04:01:24,901][106226] Updated weights for policy 0, policy_version 1219525 (0.0010) [2023-12-28 04:01:24,951][106226] Updated weights for policy 0, policy_version 1219535 (0.0010) [2023-12-28 04:01:25,280][106225] Updated weights for policy 1, policy_version 1222730 (0.0007) [2023-12-28 04:01:25,327][106225] Updated weights for policy 1, policy_version 1222740 (0.0008) [2023-12-28 04:01:25,380][106225] Updated weights for policy 1, policy_version 1222750 (0.0007) [2023-12-28 04:01:25,429][106225] Updated weights for policy 1, policy_version 1222760 (0.0008) [2023-12-28 04:01:25,623][106226] Updated weights for policy 0, policy_version 1219545 (0.0006) [2023-12-28 04:01:25,679][106226] Updated weights for policy 0, policy_version 1219555 (0.0010) [2023-12-28 04:01:25,725][106226] Updated weights for policy 0, policy_version 1219565 (0.0010) [2023-12-28 04:01:25,773][106226] Updated weights for policy 0, policy_version 1219575 (0.0010) [2023-12-28 04:01:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 625344512. Throughput: 0: 9536.2, 1: 9842.8. Samples: 625317960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:26,175][105115] Avg episode reward: [(0, '-4.269'), (1, '-4.928')] [2023-12-28 04:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001219576_312270848.pth... [2023-12-28 04:01:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001218488_311992320.pth [2023-12-28 04:01:26,223][106225] Updated weights for policy 1, policy_version 1222770 (0.0008) [2023-12-28 04:01:26,290][106225] Updated weights for policy 1, policy_version 1222780 (0.0008) [2023-12-28 04:01:26,345][106225] Updated weights for policy 1, policy_version 1222790 (0.0007) [2023-12-28 04:01:26,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001222792_313081856.pth... [2023-12-28 04:01:26,371][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001221640_312786944.pth [2023-12-28 04:01:26,403][106226] Updated weights for policy 0, policy_version 1219585 (0.0010) [2023-12-28 04:01:26,452][106226] Updated weights for policy 0, policy_version 1219595 (0.0010) [2023-12-28 04:01:26,511][106226] Updated weights for policy 0, policy_version 1219605 (0.0010) [2023-12-28 04:01:27,045][106225] Updated weights for policy 1, policy_version 1222800 (0.0007) [2023-12-28 04:01:27,106][106225] Updated weights for policy 1, policy_version 1222810 (0.0007) [2023-12-28 04:01:27,159][106225] Updated weights for policy 1, policy_version 1222820 (0.0007) [2023-12-28 04:01:27,220][106226] Updated weights for policy 0, policy_version 1219615 (0.0007) [2023-12-28 04:01:27,270][106226] Updated weights for policy 0, policy_version 1219625 (0.0007) [2023-12-28 04:01:27,321][106226] Updated weights for policy 0, policy_version 1219635 (0.0008) [2023-12-28 04:01:27,873][106225] Updated weights for policy 1, policy_version 1222830 (0.0007) [2023-12-28 04:01:27,925][106225] Updated weights for policy 1, policy_version 1222840 (0.0007) [2023-12-28 04:01:27,979][106225] Updated weights for policy 1, policy_version 1222850 (0.0008) [2023-12-28 04:01:28,015][106226] Updated weights for policy 0, policy_version 1219645 (0.0008) [2023-12-28 04:01:28,064][106226] Updated weights for policy 0, policy_version 1219655 (0.0010) [2023-12-28 04:01:28,114][106226] Updated weights for policy 0, policy_version 1219665 (0.0010) [2023-12-28 04:01:28,714][106225] Updated weights for policy 1, policy_version 1222860 (0.0007) [2023-12-28 04:01:28,774][106225] Updated weights for policy 1, policy_version 1222870 (0.0007) [2023-12-28 04:01:28,833][106225] Updated weights for policy 1, policy_version 1222880 (0.0008) [2023-12-28 04:01:28,843][106226] Updated weights for policy 0, policy_version 1219675 (0.0011) [2023-12-28 04:01:28,903][106226] Updated weights for policy 0, policy_version 1219685 (0.0011) [2023-12-28 04:01:28,970][106226] Updated weights for policy 0, policy_version 1219695 (0.0011) [2023-12-28 04:01:29,563][106225] Updated weights for policy 1, policy_version 1222890 (0.0006) [2023-12-28 04:01:29,630][106225] Updated weights for policy 1, policy_version 1222900 (0.0008) [2023-12-28 04:01:29,692][106225] Updated weights for policy 1, policy_version 1222910 (0.0008) [2023-12-28 04:01:29,711][106226] Updated weights for policy 0, policy_version 1219705 (0.0010) [2023-12-28 04:01:29,751][106225] Updated weights for policy 1, policy_version 1222920 (0.0006) [2023-12-28 04:01:29,768][106226] Updated weights for policy 0, policy_version 1219715 (0.0010) [2023-12-28 04:01:29,831][106226] Updated weights for policy 0, policy_version 1219725 (0.0010) [2023-12-28 04:01:29,890][106226] Updated weights for policy 0, policy_version 1219735 (0.0010) [2023-12-28 04:01:30,486][106225] Updated weights for policy 1, policy_version 1222930 (0.0009) [2023-12-28 04:01:30,535][106225] Updated weights for policy 1, policy_version 1222940 (0.0007) [2023-12-28 04:01:30,590][106225] Updated weights for policy 1, policy_version 1222950 (0.0007) [2023-12-28 04:01:30,598][106226] Updated weights for policy 0, policy_version 1219745 (0.0007) [2023-12-28 04:01:30,662][106226] Updated weights for policy 0, policy_version 1219755 (0.0005) [2023-12-28 04:01:30,718][106226] Updated weights for policy 0, policy_version 1219765 (0.0005) [2023-12-28 04:01:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19688.6). Total num frames: 625442816. Throughput: 0: 9629.6, 1: 9735.9. Samples: 625434744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:31,175][105115] Avg episode reward: [(0, '-4.156'), (1, '-4.827')] [2023-12-28 04:01:31,310][106225] Updated weights for policy 1, policy_version 1222960 (0.0008) [2023-12-28 04:01:31,373][106226] Updated weights for policy 0, policy_version 1219775 (0.0008) [2023-12-28 04:01:31,383][106225] Updated weights for policy 1, policy_version 1222970 (0.0008) [2023-12-28 04:01:31,440][106226] Updated weights for policy 0, policy_version 1219785 (0.0007) [2023-12-28 04:01:31,447][106225] Updated weights for policy 1, policy_version 1222980 (0.0008) [2023-12-28 04:01:31,491][106226] Updated weights for policy 0, policy_version 1219795 (0.0007) [2023-12-28 04:01:32,194][106225] Updated weights for policy 1, policy_version 1222990 (0.0008) [2023-12-28 04:01:32,236][106226] Updated weights for policy 0, policy_version 1219805 (0.0007) [2023-12-28 04:01:32,262][106225] Updated weights for policy 1, policy_version 1223000 (0.0007) [2023-12-28 04:01:32,296][106226] Updated weights for policy 0, policy_version 1219815 (0.0007) [2023-12-28 04:01:32,322][106225] Updated weights for policy 1, policy_version 1223010 (0.0006) [2023-12-28 04:01:32,359][106226] Updated weights for policy 0, policy_version 1219825 (0.0008) [2023-12-28 04:01:32,975][106225] Updated weights for policy 1, policy_version 1223020 (0.0007) [2023-12-28 04:01:33,018][106226] Updated weights for policy 0, policy_version 1219835 (0.0008) [2023-12-28 04:01:33,027][106225] Updated weights for policy 1, policy_version 1223030 (0.0007) [2023-12-28 04:01:33,079][106226] Updated weights for policy 0, policy_version 1219845 (0.0006) [2023-12-28 04:01:33,084][106225] Updated weights for policy 1, policy_version 1223040 (0.0006) [2023-12-28 04:01:33,139][106226] Updated weights for policy 0, policy_version 1219855 (0.0007) [2023-12-28 04:01:33,698][106225] Updated weights for policy 1, policy_version 1223050 (0.0007) [2023-12-28 04:01:33,768][106225] Updated weights for policy 1, policy_version 1223060 (0.0009) [2023-12-28 04:01:33,818][106225] Updated weights for policy 1, policy_version 1223070 (0.0005) [2023-12-28 04:01:33,856][106226] Updated weights for policy 0, policy_version 1219865 (0.0008) [2023-12-28 04:01:33,867][106225] Updated weights for policy 1, policy_version 1223080 (0.0005) [2023-12-28 04:01:33,910][106226] Updated weights for policy 0, policy_version 1219875 (0.0009) [2023-12-28 04:01:33,969][106226] Updated weights for policy 0, policy_version 1219885 (0.0007) [2023-12-28 04:01:34,028][106226] Updated weights for policy 0, policy_version 1219895 (0.0009) [2023-12-28 04:01:34,465][106225] Updated weights for policy 1, policy_version 1223090 (0.0006) [2023-12-28 04:01:34,527][106225] Updated weights for policy 1, policy_version 1223100 (0.0010) [2023-12-28 04:01:34,589][106225] Updated weights for policy 1, policy_version 1223110 (0.0010) [2023-12-28 04:01:34,807][106226] Updated weights for policy 0, policy_version 1219905 (0.0007) [2023-12-28 04:01:34,859][106226] Updated weights for policy 0, policy_version 1219915 (0.0007) [2023-12-28 04:01:34,911][106226] Updated weights for policy 0, policy_version 1219925 (0.0008) [2023-12-28 04:01:35,288][106225] Updated weights for policy 1, policy_version 1223120 (0.0010) [2023-12-28 04:01:35,348][106225] Updated weights for policy 1, policy_version 1223130 (0.0010) [2023-12-28 04:01:35,405][106225] Updated weights for policy 1, policy_version 1223140 (0.0010) [2023-12-28 04:01:35,652][106226] Updated weights for policy 0, policy_version 1219935 (0.0008) [2023-12-28 04:01:35,710][106226] Updated weights for policy 0, policy_version 1219945 (0.0008) [2023-12-28 04:01:35,772][106226] Updated weights for policy 0, policy_version 1219955 (0.0008) [2023-12-28 04:01:36,136][106225] Updated weights for policy 1, policy_version 1223150 (0.0010) [2023-12-28 04:01:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 625541120. Throughput: 0: 9576.2, 1: 9757.0. Samples: 625554140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:36,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.058')] [2023-12-28 04:01:36,192][106225] Updated weights for policy 1, policy_version 1223160 (0.0008) [2023-12-28 04:01:36,256][106225] Updated weights for policy 1, policy_version 1223170 (0.0009) [2023-12-28 04:01:36,458][106226] Updated weights for policy 0, policy_version 1219965 (0.0008) [2023-12-28 04:01:36,516][106226] Updated weights for policy 0, policy_version 1219975 (0.0010) [2023-12-28 04:01:36,573][106226] Updated weights for policy 0, policy_version 1219985 (0.0008) [2023-12-28 04:01:36,944][106225] Updated weights for policy 1, policy_version 1223180 (0.0008) [2023-12-28 04:01:37,006][106225] Updated weights for policy 1, policy_version 1223190 (0.0008) [2023-12-28 04:01:37,064][106225] Updated weights for policy 1, policy_version 1223200 (0.0008) [2023-12-28 04:01:37,310][106226] Updated weights for policy 0, policy_version 1219995 (0.0009) [2023-12-28 04:01:37,370][106226] Updated weights for policy 0, policy_version 1220005 (0.0009) [2023-12-28 04:01:37,422][106226] Updated weights for policy 0, policy_version 1220015 (0.0008) [2023-12-28 04:01:37,838][106225] Updated weights for policy 1, policy_version 1223210 (0.0009) [2023-12-28 04:01:37,899][106225] Updated weights for policy 1, policy_version 1223220 (0.0010) [2023-12-28 04:01:37,952][106225] Updated weights for policy 1, policy_version 1223230 (0.0010) [2023-12-28 04:01:38,012][106225] Updated weights for policy 1, policy_version 1223240 (0.0008) [2023-12-28 04:01:38,032][106226] Updated weights for policy 0, policy_version 1220025 (0.0008) [2023-12-28 04:01:38,083][106226] Updated weights for policy 0, policy_version 1220035 (0.0005) [2023-12-28 04:01:38,138][106226] Updated weights for policy 0, policy_version 1220045 (0.0005) [2023-12-28 04:01:38,199][106226] Updated weights for policy 0, policy_version 1220055 (0.0006) [2023-12-28 04:01:38,803][106226] Updated weights for policy 0, policy_version 1220065 (0.0009) [2023-12-28 04:01:38,826][106225] Updated weights for policy 1, policy_version 1223250 (0.0010) [2023-12-28 04:01:38,865][106226] Updated weights for policy 0, policy_version 1220075 (0.0011) [2023-12-28 04:01:38,887][106225] Updated weights for policy 1, policy_version 1223260 (0.0010) [2023-12-28 04:01:38,923][106226] Updated weights for policy 0, policy_version 1220085 (0.0011) [2023-12-28 04:01:38,948][106225] Updated weights for policy 1, policy_version 1223270 (0.0007) [2023-12-28 04:01:39,646][106226] Updated weights for policy 0, policy_version 1220095 (0.0011) [2023-12-28 04:01:39,652][106225] Updated weights for policy 1, policy_version 1223280 (0.0006) [2023-12-28 04:01:39,701][106226] Updated weights for policy 0, policy_version 1220105 (0.0011) [2023-12-28 04:01:39,715][106225] Updated weights for policy 1, policy_version 1223290 (0.0006) [2023-12-28 04:01:39,756][106226] Updated weights for policy 0, policy_version 1220115 (0.0011) [2023-12-28 04:01:39,778][106225] Updated weights for policy 1, policy_version 1223300 (0.0007) [2023-12-28 04:01:40,511][106226] Updated weights for policy 0, policy_version 1220125 (0.0011) [2023-12-28 04:01:40,551][106225] Updated weights for policy 1, policy_version 1223310 (0.0006) [2023-12-28 04:01:40,565][106226] Updated weights for policy 0, policy_version 1220135 (0.0011) [2023-12-28 04:01:40,598][106225] Updated weights for policy 1, policy_version 1223320 (0.0005) [2023-12-28 04:01:40,612][106226] Updated weights for policy 0, policy_version 1220145 (0.0010) [2023-12-28 04:01:40,653][106225] Updated weights for policy 1, policy_version 1223330 (0.0006) [2023-12-28 04:01:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 625639424. Throughput: 0: 9646.7, 1: 9735.7. Samples: 625613320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:41,175][105115] Avg episode reward: [(0, '-4.101'), (1, '-5.340')] [2023-12-28 04:01:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001220152_312418304.pth... [2023-12-28 04:01:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001223336_313221120.pth... [2023-12-28 04:01:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001219032_312131584.pth [2023-12-28 04:01:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001222216_312934400.pth [2023-12-28 04:01:41,365][106226] Updated weights for policy 0, policy_version 1220155 (0.0010) [2023-12-28 04:01:41,434][106226] Updated weights for policy 0, policy_version 1220165 (0.0007) [2023-12-28 04:01:41,490][106225] Updated weights for policy 1, policy_version 1223340 (0.0008) [2023-12-28 04:01:41,500][106226] Updated weights for policy 0, policy_version 1220175 (0.0009) [2023-12-28 04:01:41,553][106225] Updated weights for policy 1, policy_version 1223350 (0.0009) [2023-12-28 04:01:41,608][106225] Updated weights for policy 1, policy_version 1223360 (0.0008) [2023-12-28 04:01:42,232][106226] Updated weights for policy 0, policy_version 1220185 (0.0007) [2023-12-28 04:01:42,298][106226] Updated weights for policy 0, policy_version 1220195 (0.0009) [2023-12-28 04:01:42,363][106226] Updated weights for policy 0, policy_version 1220205 (0.0009) [2023-12-28 04:01:42,363][106225] Updated weights for policy 1, policy_version 1223370 (0.0008) [2023-12-28 04:01:42,423][106226] Updated weights for policy 0, policy_version 1220215 (0.0008) [2023-12-28 04:01:42,424][106225] Updated weights for policy 1, policy_version 1223380 (0.0006) [2023-12-28 04:01:42,485][106225] Updated weights for policy 1, policy_version 1223390 (0.0006) [2023-12-28 04:01:42,540][106225] Updated weights for policy 1, policy_version 1223400 (0.0006) [2023-12-28 04:01:43,150][106226] Updated weights for policy 0, policy_version 1220225 (0.0006) [2023-12-28 04:01:43,208][106226] Updated weights for policy 0, policy_version 1220235 (0.0005) [2023-12-28 04:01:43,231][106225] Updated weights for policy 1, policy_version 1223410 (0.0008) [2023-12-28 04:01:43,270][106226] Updated weights for policy 0, policy_version 1220245 (0.0007) [2023-12-28 04:01:43,289][106225] Updated weights for policy 1, policy_version 1223420 (0.0005) [2023-12-28 04:01:43,354][106225] Updated weights for policy 1, policy_version 1223430 (0.0006) [2023-12-28 04:01:43,909][106226] Updated weights for policy 0, policy_version 1220255 (0.0009) [2023-12-28 04:01:43,971][106226] Updated weights for policy 0, policy_version 1220265 (0.0009) [2023-12-28 04:01:44,000][106225] Updated weights for policy 1, policy_version 1223440 (0.0008) [2023-12-28 04:01:44,026][106226] Updated weights for policy 0, policy_version 1220275 (0.0006) [2023-12-28 04:01:44,058][106225] Updated weights for policy 1, policy_version 1223450 (0.0006) [2023-12-28 04:01:44,114][106225] Updated weights for policy 1, policy_version 1223460 (0.0005) [2023-12-28 04:01:44,639][106226] Updated weights for policy 0, policy_version 1220285 (0.0006) [2023-12-28 04:01:44,702][106226] Updated weights for policy 0, policy_version 1220295 (0.0007) [2023-12-28 04:01:44,748][106226] Updated weights for policy 0, policy_version 1220305 (0.0008) [2023-12-28 04:01:44,867][106225] Updated weights for policy 1, policy_version 1223470 (0.0008) [2023-12-28 04:01:44,934][106225] Updated weights for policy 1, policy_version 1223480 (0.0008) [2023-12-28 04:01:45,006][106225] Updated weights for policy 1, policy_version 1223490 (0.0009) [2023-12-28 04:01:45,410][106226] Updated weights for policy 0, policy_version 1220315 (0.0009) [2023-12-28 04:01:45,464][106226] Updated weights for policy 0, policy_version 1220325 (0.0006) [2023-12-28 04:01:45,517][106226] Updated weights for policy 0, policy_version 1220335 (0.0006) [2023-12-28 04:01:45,800][106225] Updated weights for policy 1, policy_version 1223500 (0.0008) [2023-12-28 04:01:45,849][106225] Updated weights for policy 1, policy_version 1223510 (0.0009) [2023-12-28 04:01:45,898][106225] Updated weights for policy 1, policy_version 1223520 (0.0008) [2023-12-28 04:01:46,035][106226] Updated weights for policy 0, policy_version 1220345 (0.0006) [2023-12-28 04:01:46,089][106226] Updated weights for policy 0, policy_version 1220355 (0.0008) [2023-12-28 04:01:46,152][106226] Updated weights for policy 0, policy_version 1220365 (0.0009) [2023-12-28 04:01:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 625737728. Throughput: 0: 9592.6, 1: 9635.2. Samples: 625728512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:46,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.885')] [2023-12-28 04:01:46,223][106226] Updated weights for policy 0, policy_version 1220375 (0.0007) [2023-12-28 04:01:46,656][106225] Updated weights for policy 1, policy_version 1223530 (0.0009) [2023-12-28 04:01:46,708][106225] Updated weights for policy 1, policy_version 1223540 (0.0008) [2023-12-28 04:01:46,773][106225] Updated weights for policy 1, policy_version 1223550 (0.0008) [2023-12-28 04:01:46,831][106225] Updated weights for policy 1, policy_version 1223560 (0.0008) [2023-12-28 04:01:46,958][106226] Updated weights for policy 0, policy_version 1220385 (0.0009) [2023-12-28 04:01:47,021][106226] Updated weights for policy 0, policy_version 1220395 (0.0008) [2023-12-28 04:01:47,077][106226] Updated weights for policy 0, policy_version 1220405 (0.0008) [2023-12-28 04:01:47,562][106225] Updated weights for policy 1, policy_version 1223570 (0.0008) [2023-12-28 04:01:47,616][106225] Updated weights for policy 1, policy_version 1223580 (0.0008) [2023-12-28 04:01:47,665][106225] Updated weights for policy 1, policy_version 1223590 (0.0008) [2023-12-28 04:01:47,803][106226] Updated weights for policy 0, policy_version 1220415 (0.0009) [2023-12-28 04:01:47,864][106226] Updated weights for policy 0, policy_version 1220425 (0.0008) [2023-12-28 04:01:47,926][106226] Updated weights for policy 0, policy_version 1220435 (0.0008) [2023-12-28 04:01:48,403][106225] Updated weights for policy 1, policy_version 1223600 (0.0008) [2023-12-28 04:01:48,465][106225] Updated weights for policy 1, policy_version 1223610 (0.0008) [2023-12-28 04:01:48,527][106225] Updated weights for policy 1, policy_version 1223620 (0.0006) [2023-12-28 04:01:48,668][106226] Updated weights for policy 0, policy_version 1220445 (0.0009) [2023-12-28 04:01:48,725][106226] Updated weights for policy 0, policy_version 1220455 (0.0008) [2023-12-28 04:01:48,783][106226] Updated weights for policy 0, policy_version 1220465 (0.0009) [2023-12-28 04:01:49,212][106225] Updated weights for policy 1, policy_version 1223630 (0.0007) [2023-12-28 04:01:49,280][106225] Updated weights for policy 1, policy_version 1223640 (0.0008) [2023-12-28 04:01:49,350][106225] Updated weights for policy 1, policy_version 1223650 (0.0009) [2023-12-28 04:01:49,545][106226] Updated weights for policy 0, policy_version 1220475 (0.0007) [2023-12-28 04:01:49,607][106226] Updated weights for policy 0, policy_version 1220485 (0.0005) [2023-12-28 04:01:49,677][106226] Updated weights for policy 0, policy_version 1220495 (0.0007) [2023-12-28 04:01:50,097][106225] Updated weights for policy 1, policy_version 1223660 (0.0008) [2023-12-28 04:01:50,159][106225] Updated weights for policy 1, policy_version 1223670 (0.0008) [2023-12-28 04:01:50,216][106225] Updated weights for policy 1, policy_version 1223680 (0.0008) [2023-12-28 04:01:50,376][106226] Updated weights for policy 0, policy_version 1220505 (0.0009) [2023-12-28 04:01:50,443][106226] Updated weights for policy 0, policy_version 1220515 (0.0006) [2023-12-28 04:01:50,511][106226] Updated weights for policy 0, policy_version 1220525 (0.0008) [2023-12-28 04:01:50,580][106226] Updated weights for policy 0, policy_version 1220535 (0.0007) [2023-12-28 04:01:50,960][106225] Updated weights for policy 1, policy_version 1223690 (0.0010) [2023-12-28 04:01:51,033][106225] Updated weights for policy 1, policy_version 1223700 (0.0010) [2023-12-28 04:01:51,106][106225] Updated weights for policy 1, policy_version 1223710 (0.0008) [2023-12-28 04:01:51,174][106225] Updated weights for policy 1, policy_version 1223720 (0.0008) [2023-12-28 04:01:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 625836032. Throughput: 0: 9736.5, 1: 9584.6. Samples: 625845008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:51,175][105115] Avg episode reward: [(0, '-4.209'), (1, '-5.004')] [2023-12-28 04:01:51,205][106226] Updated weights for policy 0, policy_version 1220545 (0.0007) [2023-12-28 04:01:51,272][106226] Updated weights for policy 0, policy_version 1220555 (0.0008) [2023-12-28 04:01:51,334][106226] Updated weights for policy 0, policy_version 1220565 (0.0010) [2023-12-28 04:01:51,905][106225] Updated weights for policy 1, policy_version 1223730 (0.0006) [2023-12-28 04:01:51,972][106225] Updated weights for policy 1, policy_version 1223740 (0.0006) [2023-12-28 04:01:52,030][106225] Updated weights for policy 1, policy_version 1223750 (0.0008) [2023-12-28 04:01:52,073][106226] Updated weights for policy 0, policy_version 1220575 (0.0008) [2023-12-28 04:01:52,136][106226] Updated weights for policy 0, policy_version 1220585 (0.0009) [2023-12-28 04:01:52,194][106226] Updated weights for policy 0, policy_version 1220595 (0.0007) [2023-12-28 04:01:52,728][106225] Updated weights for policy 1, policy_version 1223760 (0.0008) [2023-12-28 04:01:52,789][106225] Updated weights for policy 1, policy_version 1223770 (0.0008) [2023-12-28 04:01:52,847][106225] Updated weights for policy 1, policy_version 1223780 (0.0008) [2023-12-28 04:01:52,871][106226] Updated weights for policy 0, policy_version 1220605 (0.0006) [2023-12-28 04:01:52,928][106226] Updated weights for policy 0, policy_version 1220615 (0.0009) [2023-12-28 04:01:52,984][106226] Updated weights for policy 0, policy_version 1220625 (0.0009) [2023-12-28 04:01:53,578][106225] Updated weights for policy 1, policy_version 1223790 (0.0008) [2023-12-28 04:01:53,626][106225] Updated weights for policy 1, policy_version 1223800 (0.0008) [2023-12-28 04:01:53,675][106226] Updated weights for policy 0, policy_version 1220635 (0.0008) [2023-12-28 04:01:53,679][106225] Updated weights for policy 1, policy_version 1223810 (0.0008) [2023-12-28 04:01:53,730][106226] Updated weights for policy 0, policy_version 1220645 (0.0006) [2023-12-28 04:01:53,785][106226] Updated weights for policy 0, policy_version 1220655 (0.0009) [2023-12-28 04:01:54,442][106225] Updated weights for policy 1, policy_version 1223820 (0.0007) [2023-12-28 04:01:54,454][106226] Updated weights for policy 0, policy_version 1220665 (0.0008) [2023-12-28 04:01:54,507][106225] Updated weights for policy 1, policy_version 1223830 (0.0005) [2023-12-28 04:01:54,517][106226] Updated weights for policy 0, policy_version 1220675 (0.0007) [2023-12-28 04:01:54,573][106226] Updated weights for policy 0, policy_version 1220685 (0.0009) [2023-12-28 04:01:54,573][106225] Updated weights for policy 1, policy_version 1223840 (0.0005) [2023-12-28 04:01:54,627][106226] Updated weights for policy 0, policy_version 1220695 (0.0009) [2023-12-28 04:01:55,248][106225] Updated weights for policy 1, policy_version 1223850 (0.0006) [2023-12-28 04:01:55,294][106226] Updated weights for policy 0, policy_version 1220705 (0.0006) [2023-12-28 04:01:55,303][106225] Updated weights for policy 1, policy_version 1223860 (0.0007) [2023-12-28 04:01:55,352][106226] Updated weights for policy 0, policy_version 1220715 (0.0006) [2023-12-28 04:01:55,358][106225] Updated weights for policy 1, policy_version 1223870 (0.0006) [2023-12-28 04:01:55,409][106225] Updated weights for policy 1, policy_version 1223880 (0.0009) [2023-12-28 04:01:55,411][106226] Updated weights for policy 0, policy_version 1220725 (0.0007) [2023-12-28 04:01:56,108][106226] Updated weights for policy 0, policy_version 1220735 (0.0006) [2023-12-28 04:01:56,165][106225] Updated weights for policy 1, policy_version 1223890 (0.0008) [2023-12-28 04:01:56,166][106226] Updated weights for policy 0, policy_version 1220745 (0.0006) [2023-12-28 04:01:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19114.7, 300 sec: 19660.8). Total num frames: 625926144. Throughput: 0: 9763.2, 1: 9575.4. Samples: 625901772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:01:56,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.534')] [2023-12-28 04:01:56,215][106225] Updated weights for policy 1, policy_version 1223900 (0.0005) [2023-12-28 04:01:56,226][106226] Updated weights for policy 0, policy_version 1220755 (0.0007) [2023-12-28 04:01:56,254][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001220760_312573952.pth... [2023-12-28 04:01:56,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001219576_312270848.pth [2023-12-28 04:01:56,274][106225] Updated weights for policy 1, policy_version 1223910 (0.0008) [2023-12-28 04:01:56,286][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001223912_313368576.pth... [2023-12-28 04:01:56,290][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001222792_313081856.pth [2023-12-28 04:01:56,922][106226] Updated weights for policy 0, policy_version 1220765 (0.0007) [2023-12-28 04:01:56,968][106226] Updated weights for policy 0, policy_version 1220775 (0.0008) [2023-12-28 04:01:56,996][106225] Updated weights for policy 1, policy_version 1223920 (0.0009) [2023-12-28 04:01:57,018][106226] Updated weights for policy 0, policy_version 1220785 (0.0006) [2023-12-28 04:01:57,048][106225] Updated weights for policy 1, policy_version 1223930 (0.0006) [2023-12-28 04:01:57,103][106225] Updated weights for policy 1, policy_version 1223940 (0.0008) [2023-12-28 04:01:57,660][106226] Updated weights for policy 0, policy_version 1220795 (0.0008) [2023-12-28 04:01:57,714][106226] Updated weights for policy 0, policy_version 1220805 (0.0007) [2023-12-28 04:01:57,767][106226] Updated weights for policy 0, policy_version 1220815 (0.0008) [2023-12-28 04:01:57,839][106225] Updated weights for policy 1, policy_version 1223950 (0.0008) [2023-12-28 04:01:57,882][106225] Updated weights for policy 1, policy_version 1223960 (0.0008) [2023-12-28 04:01:57,929][106225] Updated weights for policy 1, policy_version 1223970 (0.0007) [2023-12-28 04:01:58,532][106226] Updated weights for policy 0, policy_version 1220825 (0.0008) [2023-12-28 04:01:58,593][106226] Updated weights for policy 0, policy_version 1220835 (0.0008) [2023-12-28 04:01:58,667][106226] Updated weights for policy 0, policy_version 1220845 (0.0007) [2023-12-28 04:01:58,738][106226] Updated weights for policy 0, policy_version 1220855 (0.0008) [2023-12-28 04:01:58,757][106225] Updated weights for policy 1, policy_version 1223980 (0.0008) [2023-12-28 04:01:58,821][106225] Updated weights for policy 1, policy_version 1223990 (0.0008) [2023-12-28 04:01:58,889][106225] Updated weights for policy 1, policy_version 1224000 (0.0008) [2023-12-28 04:01:59,529][106226] Updated weights for policy 0, policy_version 1220865 (0.0009) [2023-12-28 04:01:59,592][106226] Updated weights for policy 0, policy_version 1220875 (0.0008) [2023-12-28 04:01:59,619][106225] Updated weights for policy 1, policy_version 1224010 (0.0009) [2023-12-28 04:01:59,655][106226] Updated weights for policy 0, policy_version 1220885 (0.0007) [2023-12-28 04:01:59,678][106225] Updated weights for policy 1, policy_version 1224020 (0.0006) [2023-12-28 04:01:59,743][106225] Updated weights for policy 1, policy_version 1224030 (0.0010) [2023-12-28 04:01:59,799][106225] Updated weights for policy 1, policy_version 1224040 (0.0007) [2023-12-28 04:02:00,358][106226] Updated weights for policy 0, policy_version 1220895 (0.0008) [2023-12-28 04:02:00,415][106226] Updated weights for policy 0, policy_version 1220905 (0.0008) [2023-12-28 04:02:00,473][106226] Updated weights for policy 0, policy_version 1220915 (0.0008) [2023-12-28 04:02:00,527][106225] Updated weights for policy 1, policy_version 1224050 (0.0011) [2023-12-28 04:02:00,587][106225] Updated weights for policy 1, policy_version 1224060 (0.0010) [2023-12-28 04:02:00,646][106225] Updated weights for policy 1, policy_version 1224070 (0.0009) [2023-12-28 04:02:01,153][106226] Updated weights for policy 0, policy_version 1220925 (0.0008) [2023-12-28 04:02:01,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19251.2, 300 sec: 19660.8). Total num frames: 626024448. Throughput: 0: 9896.4, 1: 9532.7. Samples: 626018536. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:01,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-5.046')] [2023-12-28 04:02:01,216][106226] Updated weights for policy 0, policy_version 1220935 (0.0006) [2023-12-28 04:02:01,226][106225] Updated weights for policy 1, policy_version 1224080 (0.0007) [2023-12-28 04:02:01,277][106226] Updated weights for policy 0, policy_version 1220945 (0.0008) [2023-12-28 04:02:01,291][106225] Updated weights for policy 1, policy_version 1224090 (0.0007) [2023-12-28 04:02:01,353][106225] Updated weights for policy 1, policy_version 1224100 (0.0006) [2023-12-28 04:02:02,013][106226] Updated weights for policy 0, policy_version 1220955 (0.0009) [2023-12-28 04:02:02,062][106226] Updated weights for policy 0, policy_version 1220965 (0.0008) [2023-12-28 04:02:02,096][106225] Updated weights for policy 1, policy_version 1224110 (0.0008) [2023-12-28 04:02:02,114][106226] Updated weights for policy 0, policy_version 1220975 (0.0007) [2023-12-28 04:02:02,156][106225] Updated weights for policy 1, policy_version 1224120 (0.0007) [2023-12-28 04:02:02,212][106225] Updated weights for policy 1, policy_version 1224130 (0.0009) [2023-12-28 04:02:02,883][106225] Updated weights for policy 1, policy_version 1224140 (0.0005) [2023-12-28 04:02:02,898][106226] Updated weights for policy 0, policy_version 1220985 (0.0006) [2023-12-28 04:02:02,945][106225] Updated weights for policy 1, policy_version 1224150 (0.0007) [2023-12-28 04:02:02,955][106226] Updated weights for policy 0, policy_version 1220995 (0.0007) [2023-12-28 04:02:03,008][106225] Updated weights for policy 1, policy_version 1224160 (0.0007) [2023-12-28 04:02:03,014][106226] Updated weights for policy 0, policy_version 1221005 (0.0006) [2023-12-28 04:02:03,063][106226] Updated weights for policy 0, policy_version 1221015 (0.0006) [2023-12-28 04:02:03,656][106225] Updated weights for policy 1, policy_version 1224170 (0.0008) [2023-12-28 04:02:03,707][106225] Updated weights for policy 1, policy_version 1224180 (0.0008) [2023-12-28 04:02:03,759][106225] Updated weights for policy 1, policy_version 1224190 (0.0009) [2023-12-28 04:02:03,799][106226] Updated weights for policy 0, policy_version 1221025 (0.0007) [2023-12-28 04:02:03,816][106225] Updated weights for policy 1, policy_version 1224200 (0.0006) [2023-12-28 04:02:03,857][106226] Updated weights for policy 0, policy_version 1221035 (0.0008) [2023-12-28 04:02:03,923][106226] Updated weights for policy 0, policy_version 1221045 (0.0008) [2023-12-28 04:02:04,590][106225] Updated weights for policy 1, policy_version 1224210 (0.0007) [2023-12-28 04:02:04,599][106226] Updated weights for policy 0, policy_version 1221055 (0.0008) [2023-12-28 04:02:04,639][106225] Updated weights for policy 1, policy_version 1224220 (0.0006) [2023-12-28 04:02:04,656][106226] Updated weights for policy 0, policy_version 1221065 (0.0008) [2023-12-28 04:02:04,687][106225] Updated weights for policy 1, policy_version 1224230 (0.0007) [2023-12-28 04:02:04,715][106226] Updated weights for policy 0, policy_version 1221075 (0.0006) [2023-12-28 04:02:05,365][106225] Updated weights for policy 1, policy_version 1224240 (0.0009) [2023-12-28 04:02:05,433][106225] Updated weights for policy 1, policy_version 1224250 (0.0009) [2023-12-28 04:02:05,453][106226] Updated weights for policy 0, policy_version 1221085 (0.0005) [2023-12-28 04:02:05,490][106225] Updated weights for policy 1, policy_version 1224260 (0.0009) [2023-12-28 04:02:05,518][106226] Updated weights for policy 0, policy_version 1221095 (0.0005) [2023-12-28 04:02:05,571][106226] Updated weights for policy 0, policy_version 1221105 (0.0005) [2023-12-28 04:02:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19660.8). Total num frames: 626122752. Throughput: 0: 9898.1, 1: 9563.4. Samples: 626136328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:06,175][105115] Avg episode reward: [(0, '-4.121'), (1, '-5.048')] [2023-12-28 04:02:06,188][106226] Updated weights for policy 0, policy_version 1221115 (0.0006) [2023-12-28 04:02:06,251][106226] Updated weights for policy 0, policy_version 1221125 (0.0009) [2023-12-28 04:02:06,272][106225] Updated weights for policy 1, policy_version 1224270 (0.0009) [2023-12-28 04:02:06,312][106226] Updated weights for policy 0, policy_version 1221135 (0.0008) [2023-12-28 04:02:06,331][106225] Updated weights for policy 1, policy_version 1224280 (0.0006) [2023-12-28 04:02:06,387][106225] Updated weights for policy 1, policy_version 1224290 (0.0007) [2023-12-28 04:02:06,997][106226] Updated weights for policy 0, policy_version 1221145 (0.0007) [2023-12-28 04:02:07,057][106226] Updated weights for policy 0, policy_version 1221155 (0.0010) [2023-12-28 04:02:07,118][106226] Updated weights for policy 0, policy_version 1221165 (0.0011) [2023-12-28 04:02:07,143][106225] Updated weights for policy 1, policy_version 1224300 (0.0007) [2023-12-28 04:02:07,181][106226] Updated weights for policy 0, policy_version 1221175 (0.0007) [2023-12-28 04:02:07,205][106225] Updated weights for policy 1, policy_version 1224310 (0.0008) [2023-12-28 04:02:07,264][106225] Updated weights for policy 1, policy_version 1224320 (0.0009) [2023-12-28 04:02:07,874][106226] Updated weights for policy 0, policy_version 1221185 (0.0008) [2023-12-28 04:02:07,932][106226] Updated weights for policy 0, policy_version 1221195 (0.0008) [2023-12-28 04:02:07,977][106225] Updated weights for policy 1, policy_version 1224330 (0.0009) [2023-12-28 04:02:08,000][106226] Updated weights for policy 0, policy_version 1221205 (0.0005) [2023-12-28 04:02:08,034][106225] Updated weights for policy 1, policy_version 1224340 (0.0007) [2023-12-28 04:02:08,089][106225] Updated weights for policy 1, policy_version 1224350 (0.0009) [2023-12-28 04:02:08,136][106225] Updated weights for policy 1, policy_version 1224360 (0.0008) [2023-12-28 04:02:08,606][106226] Updated weights for policy 0, policy_version 1221215 (0.0008) [2023-12-28 04:02:08,668][106226] Updated weights for policy 0, policy_version 1221225 (0.0009) [2023-12-28 04:02:08,732][106226] Updated weights for policy 0, policy_version 1221235 (0.0007) [2023-12-28 04:02:08,927][106225] Updated weights for policy 1, policy_version 1224370 (0.0009) [2023-12-28 04:02:08,980][106225] Updated weights for policy 1, policy_version 1224380 (0.0009) [2023-12-28 04:02:09,030][106225] Updated weights for policy 1, policy_version 1224390 (0.0006) [2023-12-28 04:02:09,501][106226] Updated weights for policy 0, policy_version 1221245 (0.0009) [2023-12-28 04:02:09,563][106226] Updated weights for policy 0, policy_version 1221255 (0.0011) [2023-12-28 04:02:09,628][106226] Updated weights for policy 0, policy_version 1221265 (0.0011) [2023-12-28 04:02:09,737][106225] Updated weights for policy 1, policy_version 1224400 (0.0008) [2023-12-28 04:02:09,807][106225] Updated weights for policy 1, policy_version 1224410 (0.0008) [2023-12-28 04:02:09,874][106225] Updated weights for policy 1, policy_version 1224420 (0.0010) [2023-12-28 04:02:10,360][106226] Updated weights for policy 0, policy_version 1221275 (0.0011) [2023-12-28 04:02:10,420][106226] Updated weights for policy 0, policy_version 1221285 (0.0011) [2023-12-28 04:02:10,483][106226] Updated weights for policy 0, policy_version 1221295 (0.0011) [2023-12-28 04:02:10,610][106225] Updated weights for policy 1, policy_version 1224430 (0.0010) [2023-12-28 04:02:10,668][106225] Updated weights for policy 1, policy_version 1224440 (0.0010) [2023-12-28 04:02:10,730][106225] Updated weights for policy 1, policy_version 1224450 (0.0011) [2023-12-28 04:02:11,120][106226] Updated weights for policy 0, policy_version 1221305 (0.0008) [2023-12-28 04:02:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 626221056. Throughput: 0: 9922.1, 1: 9570.5. Samples: 626195128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:11,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.921')] [2023-12-28 04:02:11,186][106226] Updated weights for policy 0, policy_version 1221315 (0.0011) [2023-12-28 04:02:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001224456_313507840.pth... [2023-12-28 04:02:11,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001223336_313221120.pth [2023-12-28 04:02:11,252][106226] Updated weights for policy 0, policy_version 1221325 (0.0011) [2023-12-28 04:02:11,316][106226] Updated weights for policy 0, policy_version 1221335 (0.0011) [2023-12-28 04:02:11,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001221336_312721408.pth... [2023-12-28 04:02:11,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001220152_312418304.pth [2023-12-28 04:02:11,453][106225] Updated weights for policy 1, policy_version 1224460 (0.0010) [2023-12-28 04:02:11,515][106225] Updated weights for policy 1, policy_version 1224470 (0.0008) [2023-12-28 04:02:11,581][106225] Updated weights for policy 1, policy_version 1224480 (0.0008) [2023-12-28 04:02:12,082][106226] Updated weights for policy 0, policy_version 1221345 (0.0010) [2023-12-28 04:02:12,141][106226] Updated weights for policy 0, policy_version 1221355 (0.0009) [2023-12-28 04:02:12,211][106226] Updated weights for policy 0, policy_version 1221365 (0.0005) [2023-12-28 04:02:12,302][106225] Updated weights for policy 1, policy_version 1224490 (0.0009) [2023-12-28 04:02:12,357][106225] Updated weights for policy 1, policy_version 1224500 (0.0006) [2023-12-28 04:02:12,419][106225] Updated weights for policy 1, policy_version 1224510 (0.0007) [2023-12-28 04:02:12,490][106225] Updated weights for policy 1, policy_version 1224520 (0.0008) [2023-12-28 04:02:12,835][106226] Updated weights for policy 0, policy_version 1221375 (0.0009) [2023-12-28 04:02:12,891][106226] Updated weights for policy 0, policy_version 1221385 (0.0011) [2023-12-28 04:02:12,946][106226] Updated weights for policy 0, policy_version 1221395 (0.0009) [2023-12-28 04:02:13,232][106225] Updated weights for policy 1, policy_version 1224530 (0.0009) [2023-12-28 04:02:13,281][106225] Updated weights for policy 1, policy_version 1224540 (0.0008) [2023-12-28 04:02:13,331][106225] Updated weights for policy 1, policy_version 1224550 (0.0008) [2023-12-28 04:02:13,498][106226] Updated weights for policy 0, policy_version 1221405 (0.0005) [2023-12-28 04:02:13,557][106226] Updated weights for policy 0, policy_version 1221415 (0.0006) [2023-12-28 04:02:13,615][106226] Updated weights for policy 0, policy_version 1221425 (0.0005) [2023-12-28 04:02:14,164][106225] Updated weights for policy 1, policy_version 1224560 (0.0006) [2023-12-28 04:02:14,192][106226] Updated weights for policy 0, policy_version 1221435 (0.0007) [2023-12-28 04:02:14,224][106225] Updated weights for policy 1, policy_version 1224570 (0.0006) [2023-12-28 04:02:14,249][106226] Updated weights for policy 0, policy_version 1221445 (0.0010) [2023-12-28 04:02:14,281][106225] Updated weights for policy 1, policy_version 1224580 (0.0005) [2023-12-28 04:02:14,309][106226] Updated weights for policy 0, policy_version 1221455 (0.0010) [2023-12-28 04:02:14,901][106225] Updated weights for policy 1, policy_version 1224590 (0.0009) [2023-12-28 04:02:14,972][106225] Updated weights for policy 1, policy_version 1224600 (0.0009) [2023-12-28 04:02:15,008][106226] Updated weights for policy 0, policy_version 1221465 (0.0010) [2023-12-28 04:02:15,039][106225] Updated weights for policy 1, policy_version 1224610 (0.0007) [2023-12-28 04:02:15,073][106226] Updated weights for policy 0, policy_version 1221475 (0.0010) [2023-12-28 04:02:15,139][106226] Updated weights for policy 0, policy_version 1221485 (0.0011) [2023-12-28 04:02:15,208][106226] Updated weights for policy 0, policy_version 1221495 (0.0011) [2023-12-28 04:02:15,720][106225] Updated weights for policy 1, policy_version 1224620 (0.0008) [2023-12-28 04:02:15,773][106225] Updated weights for policy 1, policy_version 1224630 (0.0010) [2023-12-28 04:02:15,823][106225] Updated weights for policy 1, policy_version 1224640 (0.0010) [2023-12-28 04:02:15,845][106226] Updated weights for policy 0, policy_version 1221505 (0.0007) [2023-12-28 04:02:15,910][106226] Updated weights for policy 0, policy_version 1221515 (0.0007) [2023-12-28 04:02:15,977][106226] Updated weights for policy 0, policy_version 1221525 (0.0006) [2023-12-28 04:02:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 626327552. Throughput: 0: 9950.1, 1: 9579.7. Samples: 626313588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:16,176][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.915')] [2023-12-28 04:02:16,422][106225] Updated weights for policy 1, policy_version 1224650 (0.0009) [2023-12-28 04:02:16,481][106225] Updated weights for policy 1, policy_version 1224660 (0.0008) [2023-12-28 04:02:16,538][106225] Updated weights for policy 1, policy_version 1224670 (0.0008) [2023-12-28 04:02:16,597][106225] Updated weights for policy 1, policy_version 1224680 (0.0009) [2023-12-28 04:02:16,674][106226] Updated weights for policy 0, policy_version 1221535 (0.0008) [2023-12-28 04:02:16,736][106226] Updated weights for policy 0, policy_version 1221545 (0.0009) [2023-12-28 04:02:16,802][106226] Updated weights for policy 0, policy_version 1221555 (0.0008) [2023-12-28 04:02:17,261][106225] Updated weights for policy 1, policy_version 1224690 (0.0009) [2023-12-28 04:02:17,319][106225] Updated weights for policy 1, policy_version 1224700 (0.0009) [2023-12-28 04:02:17,380][106225] Updated weights for policy 1, policy_version 1224710 (0.0009) [2023-12-28 04:02:17,547][106226] Updated weights for policy 0, policy_version 1221565 (0.0008) [2023-12-28 04:02:17,611][106226] Updated weights for policy 0, policy_version 1221575 (0.0008) [2023-12-28 04:02:17,672][106226] Updated weights for policy 0, policy_version 1221585 (0.0008) [2023-12-28 04:02:18,128][106225] Updated weights for policy 1, policy_version 1224720 (0.0009) [2023-12-28 04:02:18,184][106225] Updated weights for policy 1, policy_version 1224730 (0.0010) [2023-12-28 04:02:18,244][106225] Updated weights for policy 1, policy_version 1224740 (0.0010) [2023-12-28 04:02:18,289][106226] Updated weights for policy 0, policy_version 1221595 (0.0008) [2023-12-28 04:02:18,343][106226] Updated weights for policy 0, policy_version 1221605 (0.0008) [2023-12-28 04:02:18,415][106226] Updated weights for policy 0, policy_version 1221615 (0.0007) [2023-12-28 04:02:18,922][106225] Updated weights for policy 1, policy_version 1224750 (0.0008) [2023-12-28 04:02:18,986][106225] Updated weights for policy 1, policy_version 1224760 (0.0005) [2023-12-28 04:02:19,042][106225] Updated weights for policy 1, policy_version 1224770 (0.0008) [2023-12-28 04:02:19,234][106226] Updated weights for policy 0, policy_version 1221625 (0.0008) [2023-12-28 04:02:19,292][106226] Updated weights for policy 0, policy_version 1221635 (0.0009) [2023-12-28 04:02:19,365][106226] Updated weights for policy 0, policy_version 1221645 (0.0008) [2023-12-28 04:02:19,428][106226] Updated weights for policy 0, policy_version 1221655 (0.0009) [2023-12-28 04:02:19,659][106225] Updated weights for policy 1, policy_version 1224780 (0.0008) [2023-12-28 04:02:19,719][106225] Updated weights for policy 1, policy_version 1224790 (0.0009) [2023-12-28 04:02:19,785][106225] Updated weights for policy 1, policy_version 1224800 (0.0010) [2023-12-28 04:02:20,202][106226] Updated weights for policy 0, policy_version 1221665 (0.0008) [2023-12-28 04:02:20,252][106226] Updated weights for policy 0, policy_version 1221675 (0.0008) [2023-12-28 04:02:20,309][106226] Updated weights for policy 0, policy_version 1221685 (0.0008) [2023-12-28 04:02:20,548][106225] Updated weights for policy 1, policy_version 1224810 (0.0008) [2023-12-28 04:02:20,613][106225] Updated weights for policy 1, policy_version 1224820 (0.0009) [2023-12-28 04:02:20,673][106225] Updated weights for policy 1, policy_version 1224830 (0.0007) [2023-12-28 04:02:20,731][106225] Updated weights for policy 1, policy_version 1224840 (0.0005) [2023-12-28 04:02:21,112][106226] Updated weights for policy 0, policy_version 1221695 (0.0009) [2023-12-28 04:02:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.8, 300 sec: 19633.0). Total num frames: 626417664. Throughput: 0: 9908.0, 1: 9573.8. Samples: 626430820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:21,175][105115] Avg episode reward: [(0, '-4.153'), (1, '-5.099')] [2023-12-28 04:02:21,177][106226] Updated weights for policy 0, policy_version 1221705 (0.0008) [2023-12-28 04:02:21,243][106226] Updated weights for policy 0, policy_version 1221715 (0.0008) [2023-12-28 04:02:21,485][106225] Updated weights for policy 1, policy_version 1224850 (0.0005) [2023-12-28 04:02:21,536][106225] Updated weights for policy 1, policy_version 1224860 (0.0006) [2023-12-28 04:02:21,589][106225] Updated weights for policy 1, policy_version 1224870 (0.0008) [2023-12-28 04:02:22,075][106226] Updated weights for policy 0, policy_version 1221725 (0.0008) [2023-12-28 04:02:22,145][106226] Updated weights for policy 0, policy_version 1221735 (0.0008) [2023-12-28 04:02:22,208][106226] Updated weights for policy 0, policy_version 1221745 (0.0008) [2023-12-28 04:02:22,347][106225] Updated weights for policy 1, policy_version 1224880 (0.0008) [2023-12-28 04:02:22,414][106225] Updated weights for policy 1, policy_version 1224890 (0.0009) [2023-12-28 04:02:22,474][106225] Updated weights for policy 1, policy_version 1224900 (0.0008) [2023-12-28 04:02:22,934][106226] Updated weights for policy 0, policy_version 1221755 (0.0007) [2023-12-28 04:02:22,996][106226] Updated weights for policy 0, policy_version 1221765 (0.0007) [2023-12-28 04:02:23,061][106226] Updated weights for policy 0, policy_version 1221775 (0.0009) [2023-12-28 04:02:23,220][106225] Updated weights for policy 1, policy_version 1224910 (0.0010) [2023-12-28 04:02:23,280][106225] Updated weights for policy 1, policy_version 1224920 (0.0010) [2023-12-28 04:02:23,343][106225] Updated weights for policy 1, policy_version 1224930 (0.0010) [2023-12-28 04:02:23,653][106226] Updated weights for policy 0, policy_version 1221785 (0.0010) [2023-12-28 04:02:23,701][106226] Updated weights for policy 0, policy_version 1221795 (0.0005) [2023-12-28 04:02:23,749][106226] Updated weights for policy 0, policy_version 1221805 (0.0005) [2023-12-28 04:02:23,810][106226] Updated weights for policy 0, policy_version 1221815 (0.0006) [2023-12-28 04:02:23,941][106225] Updated weights for policy 1, policy_version 1224940 (0.0008) [2023-12-28 04:02:24,004][106225] Updated weights for policy 1, policy_version 1224950 (0.0010) [2023-12-28 04:02:24,063][106225] Updated weights for policy 1, policy_version 1224960 (0.0010) [2023-12-28 04:02:24,500][106226] Updated weights for policy 0, policy_version 1221825 (0.0011) [2023-12-28 04:02:24,564][106226] Updated weights for policy 0, policy_version 1221835 (0.0011) [2023-12-28 04:02:24,624][106226] Updated weights for policy 0, policy_version 1221845 (0.0011) [2023-12-28 04:02:24,774][106225] Updated weights for policy 1, policy_version 1224970 (0.0010) [2023-12-28 04:02:24,828][106225] Updated weights for policy 1, policy_version 1224980 (0.0010) [2023-12-28 04:02:24,892][106225] Updated weights for policy 1, policy_version 1224990 (0.0007) [2023-12-28 04:02:24,943][106225] Updated weights for policy 1, policy_version 1225000 (0.0008) [2023-12-28 04:02:25,271][106226] Updated weights for policy 0, policy_version 1221855 (0.0010) [2023-12-28 04:02:25,330][106226] Updated weights for policy 0, policy_version 1221865 (0.0010) [2023-12-28 04:02:25,385][106226] Updated weights for policy 0, policy_version 1221875 (0.0010) [2023-12-28 04:02:25,653][106225] Updated weights for policy 1, policy_version 1225010 (0.0010) [2023-12-28 04:02:25,705][106225] Updated weights for policy 1, policy_version 1225020 (0.0010) [2023-12-28 04:02:25,755][106225] Updated weights for policy 1, policy_version 1225030 (0.0010) [2023-12-28 04:02:26,093][106226] Updated weights for policy 0, policy_version 1221885 (0.0008) [2023-12-28 04:02:26,155][106226] Updated weights for policy 0, policy_version 1221895 (0.0005) [2023-12-28 04:02:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 626515968. Throughput: 0: 9850.6, 1: 9617.6. Samples: 626489396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:26,176][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.831')] [2023-12-28 04:02:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001225032_313655296.pth... [2023-12-28 04:02:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001223912_313368576.pth [2023-12-28 04:02:26,221][106226] Updated weights for policy 0, policy_version 1221905 (0.0009) [2023-12-28 04:02:26,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001221912_312868864.pth... [2023-12-28 04:02:26,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001220760_312573952.pth [2023-12-28 04:02:26,446][106225] Updated weights for policy 1, policy_version 1225040 (0.0010) [2023-12-28 04:02:26,502][106225] Updated weights for policy 1, policy_version 1225050 (0.0008) [2023-12-28 04:02:26,560][106225] Updated weights for policy 1, policy_version 1225060 (0.0005) [2023-12-28 04:02:26,883][106226] Updated weights for policy 0, policy_version 1221915 (0.0011) [2023-12-28 04:02:26,947][106226] Updated weights for policy 0, policy_version 1221925 (0.0011) [2023-12-28 04:02:27,007][106226] Updated weights for policy 0, policy_version 1221935 (0.0011) [2023-12-28 04:02:27,224][106225] Updated weights for policy 1, policy_version 1225070 (0.0007) [2023-12-28 04:02:27,285][106225] Updated weights for policy 1, policy_version 1225080 (0.0007) [2023-12-28 04:02:27,339][106225] Updated weights for policy 1, policy_version 1225090 (0.0009) [2023-12-28 04:02:27,718][106226] Updated weights for policy 0, policy_version 1221945 (0.0011) [2023-12-28 04:02:27,774][106226] Updated weights for policy 0, policy_version 1221955 (0.0010) [2023-12-28 04:02:27,830][106226] Updated weights for policy 0, policy_version 1221965 (0.0010) [2023-12-28 04:02:27,889][106226] Updated weights for policy 0, policy_version 1221975 (0.0011) [2023-12-28 04:02:28,002][106225] Updated weights for policy 1, policy_version 1225100 (0.0010) [2023-12-28 04:02:28,051][106225] Updated weights for policy 1, policy_version 1225110 (0.0010) [2023-12-28 04:02:28,100][106225] Updated weights for policy 1, policy_version 1225120 (0.0010) [2023-12-28 04:02:28,619][106226] Updated weights for policy 0, policy_version 1221985 (0.0011) [2023-12-28 04:02:28,679][106226] Updated weights for policy 0, policy_version 1221995 (0.0011) [2023-12-28 04:02:28,745][106226] Updated weights for policy 0, policy_version 1222005 (0.0011) [2023-12-28 04:02:28,754][106225] Updated weights for policy 1, policy_version 1225130 (0.0010) [2023-12-28 04:02:28,815][106225] Updated weights for policy 1, policy_version 1225140 (0.0007) [2023-12-28 04:02:28,872][106225] Updated weights for policy 1, policy_version 1225150 (0.0008) [2023-12-28 04:02:28,926][106225] Updated weights for policy 1, policy_version 1225160 (0.0008) [2023-12-28 04:02:29,463][106226] Updated weights for policy 0, policy_version 1222015 (0.0010) [2023-12-28 04:02:29,512][106226] Updated weights for policy 0, policy_version 1222025 (0.0010) [2023-12-28 04:02:29,570][106226] Updated weights for policy 0, policy_version 1222035 (0.0010) [2023-12-28 04:02:29,602][106225] Updated weights for policy 1, policy_version 1225170 (0.0008) [2023-12-28 04:02:29,661][106225] Updated weights for policy 1, policy_version 1225180 (0.0008) [2023-12-28 04:02:29,723][106225] Updated weights for policy 1, policy_version 1225190 (0.0008) [2023-12-28 04:02:30,295][106226] Updated weights for policy 0, policy_version 1222045 (0.0008) [2023-12-28 04:02:30,349][106226] Updated weights for policy 0, policy_version 1222055 (0.0005) [2023-12-28 04:02:30,410][106226] Updated weights for policy 0, policy_version 1222065 (0.0011) [2023-12-28 04:02:30,498][106225] Updated weights for policy 1, policy_version 1225200 (0.0007) [2023-12-28 04:02:30,544][106225] Updated weights for policy 1, policy_version 1225210 (0.0005) [2023-12-28 04:02:30,599][106225] Updated weights for policy 1, policy_version 1225220 (0.0005) [2023-12-28 04:02:31,025][106226] Updated weights for policy 0, policy_version 1222075 (0.0008) [2023-12-28 04:02:31,089][106226] Updated weights for policy 0, policy_version 1222085 (0.0009) [2023-12-28 04:02:31,151][106226] Updated weights for policy 0, policy_version 1222095 (0.0007) [2023-12-28 04:02:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 626614272. Throughput: 0: 9870.8, 1: 9702.8. Samples: 626609328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:31,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-4.959')] [2023-12-28 04:02:31,202][106225] Updated weights for policy 1, policy_version 1225230 (0.0005) [2023-12-28 04:02:31,267][106225] Updated weights for policy 1, policy_version 1225240 (0.0008) [2023-12-28 04:02:31,323][106225] Updated weights for policy 1, policy_version 1225250 (0.0008) [2023-12-28 04:02:31,911][106226] Updated weights for policy 0, policy_version 1222105 (0.0009) [2023-12-28 04:02:31,971][106226] Updated weights for policy 0, policy_version 1222115 (0.0009) [2023-12-28 04:02:32,026][106226] Updated weights for policy 0, policy_version 1222125 (0.0008) [2023-12-28 04:02:32,040][106225] Updated weights for policy 1, policy_version 1225260 (0.0008) [2023-12-28 04:02:32,080][106226] Updated weights for policy 0, policy_version 1222135 (0.0006) [2023-12-28 04:02:32,104][106225] Updated weights for policy 1, policy_version 1225270 (0.0008) [2023-12-28 04:02:32,165][106225] Updated weights for policy 1, policy_version 1225280 (0.0008) [2023-12-28 04:02:32,778][106226] Updated weights for policy 0, policy_version 1222145 (0.0008) [2023-12-28 04:02:32,826][106226] Updated weights for policy 0, policy_version 1222155 (0.0008) [2023-12-28 04:02:32,851][106225] Updated weights for policy 1, policy_version 1225290 (0.0008) [2023-12-28 04:02:32,885][106226] Updated weights for policy 0, policy_version 1222165 (0.0006) [2023-12-28 04:02:32,906][106225] Updated weights for policy 1, policy_version 1225300 (0.0007) [2023-12-28 04:02:32,961][106225] Updated weights for policy 1, policy_version 1225310 (0.0008) [2023-12-28 04:02:33,012][106225] Updated weights for policy 1, policy_version 1225320 (0.0008) [2023-12-28 04:02:33,566][106226] Updated weights for policy 0, policy_version 1222175 (0.0008) [2023-12-28 04:02:33,612][106225] Updated weights for policy 1, policy_version 1225330 (0.0005) [2023-12-28 04:02:33,615][106226] Updated weights for policy 0, policy_version 1222185 (0.0008) [2023-12-28 04:02:33,665][106226] Updated weights for policy 0, policy_version 1222195 (0.0005) [2023-12-28 04:02:33,670][106225] Updated weights for policy 1, policy_version 1225340 (0.0007) [2023-12-28 04:02:33,726][106225] Updated weights for policy 1, policy_version 1225350 (0.0007) [2023-12-28 04:02:34,318][106225] Updated weights for policy 1, policy_version 1225360 (0.0005) [2023-12-28 04:02:34,375][106226] Updated weights for policy 0, policy_version 1222205 (0.0008) [2023-12-28 04:02:34,378][106225] Updated weights for policy 1, policy_version 1225370 (0.0007) [2023-12-28 04:02:34,433][106226] Updated weights for policy 0, policy_version 1222215 (0.0008) [2023-12-28 04:02:34,436][106225] Updated weights for policy 1, policy_version 1225380 (0.0007) [2023-12-28 04:02:34,495][106226] Updated weights for policy 0, policy_version 1222225 (0.0010) [2023-12-28 04:02:35,118][106226] Updated weights for policy 0, policy_version 1222235 (0.0007) [2023-12-28 04:02:35,167][106225] Updated weights for policy 1, policy_version 1225390 (0.0008) [2023-12-28 04:02:35,177][106226] Updated weights for policy 0, policy_version 1222245 (0.0006) [2023-12-28 04:02:35,224][106225] Updated weights for policy 1, policy_version 1225400 (0.0006) [2023-12-28 04:02:35,233][106226] Updated weights for policy 0, policy_version 1222255 (0.0007) [2023-12-28 04:02:35,280][106225] Updated weights for policy 1, policy_version 1225410 (0.0007) [2023-12-28 04:02:35,771][106226] Updated weights for policy 0, policy_version 1222265 (0.0006) [2023-12-28 04:02:35,826][106226] Updated weights for policy 0, policy_version 1222275 (0.0005) [2023-12-28 04:02:35,874][106226] Updated weights for policy 0, policy_version 1222285 (0.0005) [2023-12-28 04:02:35,927][106226] Updated weights for policy 0, policy_version 1222295 (0.0006) [2023-12-28 04:02:36,085][106225] Updated weights for policy 1, policy_version 1225420 (0.0008) [2023-12-28 04:02:36,157][106225] Updated weights for policy 1, policy_version 1225430 (0.0008) [2023-12-28 04:02:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 626720768. Throughput: 0: 9914.4, 1: 9823.2. Samples: 626733200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:36,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.976')] [2023-12-28 04:02:36,218][106225] Updated weights for policy 1, policy_version 1225440 (0.0009) [2023-12-28 04:02:36,645][106226] Updated weights for policy 0, policy_version 1222305 (0.0009) [2023-12-28 04:02:36,695][106226] Updated weights for policy 0, policy_version 1222315 (0.0009) [2023-12-28 04:02:36,746][106226] Updated weights for policy 0, policy_version 1222325 (0.0009) [2023-12-28 04:02:36,942][106225] Updated weights for policy 1, policy_version 1225450 (0.0008) [2023-12-28 04:02:37,000][106225] Updated weights for policy 1, policy_version 1225460 (0.0008) [2023-12-28 04:02:37,049][106225] Updated weights for policy 1, policy_version 1225470 (0.0008) [2023-12-28 04:02:37,095][106225] Updated weights for policy 1, policy_version 1225480 (0.0009) [2023-12-28 04:02:37,483][106226] Updated weights for policy 0, policy_version 1222335 (0.0008) [2023-12-28 04:02:37,545][106226] Updated weights for policy 0, policy_version 1222345 (0.0008) [2023-12-28 04:02:37,607][106226] Updated weights for policy 0, policy_version 1222355 (0.0008) [2023-12-28 04:02:37,816][106225] Updated weights for policy 1, policy_version 1225490 (0.0005) [2023-12-28 04:02:37,885][106225] Updated weights for policy 1, policy_version 1225500 (0.0008) [2023-12-28 04:02:37,941][106225] Updated weights for policy 1, policy_version 1225510 (0.0008) [2023-12-28 04:02:38,310][106226] Updated weights for policy 0, policy_version 1222365 (0.0009) [2023-12-28 04:02:38,376][106226] Updated weights for policy 0, policy_version 1222375 (0.0008) [2023-12-28 04:02:38,440][106226] Updated weights for policy 0, policy_version 1222385 (0.0011) [2023-12-28 04:02:38,500][106225] Updated weights for policy 1, policy_version 1225520 (0.0007) [2023-12-28 04:02:38,567][106225] Updated weights for policy 1, policy_version 1225530 (0.0005) [2023-12-28 04:02:38,629][106225] Updated weights for policy 1, policy_version 1225540 (0.0007) [2023-12-28 04:02:39,016][106226] Updated weights for policy 0, policy_version 1222395 (0.0006) [2023-12-28 04:02:39,072][106226] Updated weights for policy 0, policy_version 1222405 (0.0006) [2023-12-28 04:02:39,123][106226] Updated weights for policy 0, policy_version 1222415 (0.0006) [2023-12-28 04:02:39,366][106225] Updated weights for policy 1, policy_version 1225550 (0.0008) [2023-12-28 04:02:39,439][106225] Updated weights for policy 1, policy_version 1225560 (0.0008) [2023-12-28 04:02:39,499][106225] Updated weights for policy 1, policy_version 1225570 (0.0006) [2023-12-28 04:02:39,810][106226] Updated weights for policy 0, policy_version 1222425 (0.0009) [2023-12-28 04:02:39,881][106226] Updated weights for policy 0, policy_version 1222435 (0.0016) [2023-12-28 04:02:39,954][106226] Updated weights for policy 0, policy_version 1222445 (0.0009) [2023-12-28 04:02:40,025][106226] Updated weights for policy 0, policy_version 1222455 (0.0009) [2023-12-28 04:02:40,234][106225] Updated weights for policy 1, policy_version 1225580 (0.0009) [2023-12-28 04:02:40,292][106225] Updated weights for policy 1, policy_version 1225590 (0.0006) [2023-12-28 04:02:40,345][106225] Updated weights for policy 1, policy_version 1225600 (0.0006) [2023-12-28 04:02:40,797][106226] Updated weights for policy 0, policy_version 1222465 (0.0011) [2023-12-28 04:02:40,848][106226] Updated weights for policy 0, policy_version 1222475 (0.0011) [2023-12-28 04:02:40,899][106226] Updated weights for policy 0, policy_version 1222485 (0.0010) [2023-12-28 04:02:41,002][106225] Updated weights for policy 1, policy_version 1225610 (0.0008) [2023-12-28 04:02:41,068][106225] Updated weights for policy 1, policy_version 1225620 (0.0009) [2023-12-28 04:02:41,143][106225] Updated weights for policy 1, policy_version 1225630 (0.0007) [2023-12-28 04:02:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 626819072. Throughput: 0: 9953.9, 1: 9867.7. Samples: 626793744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:41,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.851')] [2023-12-28 04:02:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001222488_313016320.pth... [2023-12-28 04:02:41,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001221336_312721408.pth [2023-12-28 04:02:41,212][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001225640_313810944.pth... [2023-12-28 04:02:41,216][106225] Updated weights for policy 1, policy_version 1225640 (0.0009) [2023-12-28 04:02:41,217][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001224456_313507840.pth [2023-12-28 04:02:41,626][106226] Updated weights for policy 0, policy_version 1222495 (0.0009) [2023-12-28 04:02:41,689][106226] Updated weights for policy 0, policy_version 1222505 (0.0008) [2023-12-28 04:02:41,756][106226] Updated weights for policy 0, policy_version 1222515 (0.0008) [2023-12-28 04:02:41,934][106225] Updated weights for policy 1, policy_version 1225650 (0.0007) [2023-12-28 04:02:41,993][106225] Updated weights for policy 1, policy_version 1225660 (0.0008) [2023-12-28 04:02:42,047][106225] Updated weights for policy 1, policy_version 1225670 (0.0008) [2023-12-28 04:02:42,458][106226] Updated weights for policy 0, policy_version 1222525 (0.0009) [2023-12-28 04:02:42,517][106226] Updated weights for policy 0, policy_version 1222535 (0.0008) [2023-12-28 04:02:42,576][106226] Updated weights for policy 0, policy_version 1222545 (0.0008) [2023-12-28 04:02:42,736][106225] Updated weights for policy 1, policy_version 1225680 (0.0009) [2023-12-28 04:02:42,803][106225] Updated weights for policy 1, policy_version 1225690 (0.0009) [2023-12-28 04:02:42,869][106225] Updated weights for policy 1, policy_version 1225700 (0.0008) [2023-12-28 04:02:43,296][106226] Updated weights for policy 0, policy_version 1222555 (0.0008) [2023-12-28 04:02:43,347][106226] Updated weights for policy 0, policy_version 1222565 (0.0009) [2023-12-28 04:02:43,401][106226] Updated weights for policy 0, policy_version 1222575 (0.0009) [2023-12-28 04:02:43,590][106225] Updated weights for policy 1, policy_version 1225710 (0.0008) [2023-12-28 04:02:43,649][106225] Updated weights for policy 1, policy_version 1225720 (0.0008) [2023-12-28 04:02:43,700][106225] Updated weights for policy 1, policy_version 1225730 (0.0008) [2023-12-28 04:02:44,147][106226] Updated weights for policy 0, policy_version 1222585 (0.0008) [2023-12-28 04:02:44,206][106226] Updated weights for policy 0, policy_version 1222595 (0.0008) [2023-12-28 04:02:44,260][106226] Updated weights for policy 0, policy_version 1222605 (0.0008) [2023-12-28 04:02:44,314][106226] Updated weights for policy 0, policy_version 1222615 (0.0008) [2023-12-28 04:02:44,397][106225] Updated weights for policy 1, policy_version 1225740 (0.0008) [2023-12-28 04:02:44,452][106225] Updated weights for policy 1, policy_version 1225750 (0.0008) [2023-12-28 04:02:44,515][106225] Updated weights for policy 1, policy_version 1225760 (0.0008) [2023-12-28 04:02:45,038][106226] Updated weights for policy 0, policy_version 1222625 (0.0009) [2023-12-28 04:02:45,105][106226] Updated weights for policy 0, policy_version 1222635 (0.0008) [2023-12-28 04:02:45,164][106226] Updated weights for policy 0, policy_version 1222645 (0.0007) [2023-12-28 04:02:45,286][106225] Updated weights for policy 1, policy_version 1225770 (0.0009) [2023-12-28 04:02:45,336][106225] Updated weights for policy 1, policy_version 1225780 (0.0009) [2023-12-28 04:02:45,390][106225] Updated weights for policy 1, policy_version 1225790 (0.0008) [2023-12-28 04:02:45,446][106225] Updated weights for policy 1, policy_version 1225800 (0.0008) [2023-12-28 04:02:45,878][106226] Updated weights for policy 0, policy_version 1222655 (0.0008) [2023-12-28 04:02:45,940][106226] Updated weights for policy 0, policy_version 1222665 (0.0009) [2023-12-28 04:02:46,003][106226] Updated weights for policy 0, policy_version 1222675 (0.0008) [2023-12-28 04:02:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 626917376. Throughput: 0: 9881.4, 1: 9879.7. Samples: 626907788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:46,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.823')] [2023-12-28 04:02:46,200][106225] Updated weights for policy 1, policy_version 1225810 (0.0008) [2023-12-28 04:02:46,267][106225] Updated weights for policy 1, policy_version 1225820 (0.0009) [2023-12-28 04:02:46,319][106225] Updated weights for policy 1, policy_version 1225830 (0.0008) [2023-12-28 04:02:46,654][106226] Updated weights for policy 0, policy_version 1222685 (0.0008) [2023-12-28 04:02:46,717][106226] Updated weights for policy 0, policy_version 1222695 (0.0005) [2023-12-28 04:02:46,772][106226] Updated weights for policy 0, policy_version 1222705 (0.0005) [2023-12-28 04:02:47,113][106225] Updated weights for policy 1, policy_version 1225840 (0.0009) [2023-12-28 04:02:47,180][106225] Updated weights for policy 1, policy_version 1225850 (0.0010) [2023-12-28 04:02:47,238][106225] Updated weights for policy 1, policy_version 1225860 (0.0008) [2023-12-28 04:02:47,400][106226] Updated weights for policy 0, policy_version 1222715 (0.0006) [2023-12-28 04:02:47,468][106226] Updated weights for policy 0, policy_version 1222725 (0.0010) [2023-12-28 04:02:47,535][106226] Updated weights for policy 0, policy_version 1222735 (0.0009) [2023-12-28 04:02:47,925][106225] Updated weights for policy 1, policy_version 1225870 (0.0008) [2023-12-28 04:02:47,970][106225] Updated weights for policy 1, policy_version 1225880 (0.0008) [2023-12-28 04:02:48,020][106225] Updated weights for policy 1, policy_version 1225890 (0.0007) [2023-12-28 04:02:48,225][106226] Updated weights for policy 0, policy_version 1222745 (0.0008) [2023-12-28 04:02:48,278][106226] Updated weights for policy 0, policy_version 1222755 (0.0007) [2023-12-28 04:02:48,335][106226] Updated weights for policy 0, policy_version 1222765 (0.0008) [2023-12-28 04:02:48,405][106226] Updated weights for policy 0, policy_version 1222775 (0.0009) [2023-12-28 04:02:48,776][106225] Updated weights for policy 1, policy_version 1225900 (0.0007) [2023-12-28 04:02:48,836][106225] Updated weights for policy 1, policy_version 1225910 (0.0009) [2023-12-28 04:02:48,893][106225] Updated weights for policy 1, policy_version 1225920 (0.0009) [2023-12-28 04:02:49,125][106226] Updated weights for policy 0, policy_version 1222785 (0.0008) [2023-12-28 04:02:49,173][106226] Updated weights for policy 0, policy_version 1222795 (0.0005) [2023-12-28 04:02:49,236][106226] Updated weights for policy 0, policy_version 1222805 (0.0007) [2023-12-28 04:02:49,612][106225] Updated weights for policy 1, policy_version 1225930 (0.0007) [2023-12-28 04:02:49,661][106225] Updated weights for policy 1, policy_version 1225940 (0.0005) [2023-12-28 04:02:49,725][106225] Updated weights for policy 1, policy_version 1225950 (0.0005) [2023-12-28 04:02:49,782][106225] Updated weights for policy 1, policy_version 1225960 (0.0005) [2023-12-28 04:02:50,063][106226] Updated weights for policy 0, policy_version 1222815 (0.0009) [2023-12-28 04:02:50,122][106226] Updated weights for policy 0, policy_version 1222825 (0.0007) [2023-12-28 04:02:50,175][106226] Updated weights for policy 0, policy_version 1222835 (0.0009) [2023-12-28 04:02:50,387][106225] Updated weights for policy 1, policy_version 1225970 (0.0008) [2023-12-28 04:02:50,456][106225] Updated weights for policy 1, policy_version 1225980 (0.0008) [2023-12-28 04:02:50,513][106225] Updated weights for policy 1, policy_version 1225990 (0.0008) [2023-12-28 04:02:50,869][106226] Updated weights for policy 0, policy_version 1222845 (0.0009) [2023-12-28 04:02:50,930][106226] Updated weights for policy 0, policy_version 1222855 (0.0008) [2023-12-28 04:02:50,990][106226] Updated weights for policy 0, policy_version 1222865 (0.0007) [2023-12-28 04:02:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 627015680. Throughput: 0: 9885.2, 1: 9856.3. Samples: 627024696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:51,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-4.831')] [2023-12-28 04:02:51,228][106225] Updated weights for policy 1, policy_version 1226000 (0.0006) [2023-12-28 04:02:51,299][106225] Updated weights for policy 1, policy_version 1226010 (0.0008) [2023-12-28 04:02:51,354][106225] Updated weights for policy 1, policy_version 1226020 (0.0008) [2023-12-28 04:02:51,728][106226] Updated weights for policy 0, policy_version 1222875 (0.0008) [2023-12-28 04:02:51,783][106226] Updated weights for policy 0, policy_version 1222885 (0.0009) [2023-12-28 04:02:51,844][106226] Updated weights for policy 0, policy_version 1222895 (0.0009) [2023-12-28 04:02:52,083][106225] Updated weights for policy 1, policy_version 1226030 (0.0009) [2023-12-28 04:02:52,134][106225] Updated weights for policy 1, policy_version 1226040 (0.0008) [2023-12-28 04:02:52,187][106225] Updated weights for policy 1, policy_version 1226050 (0.0008) [2023-12-28 04:02:52,593][106226] Updated weights for policy 0, policy_version 1222905 (0.0008) [2023-12-28 04:02:52,652][106226] Updated weights for policy 0, policy_version 1222915 (0.0005) [2023-12-28 04:02:52,713][106226] Updated weights for policy 0, policy_version 1222925 (0.0008) [2023-12-28 04:02:52,776][106226] Updated weights for policy 0, policy_version 1222935 (0.0008) [2023-12-28 04:02:52,981][106225] Updated weights for policy 1, policy_version 1226060 (0.0008) [2023-12-28 04:02:53,045][106225] Updated weights for policy 1, policy_version 1226070 (0.0009) [2023-12-28 04:02:53,107][106225] Updated weights for policy 1, policy_version 1226080 (0.0009) [2023-12-28 04:02:53,496][106226] Updated weights for policy 0, policy_version 1222945 (0.0008) [2023-12-28 04:02:53,550][106226] Updated weights for policy 0, policy_version 1222955 (0.0009) [2023-12-28 04:02:53,609][106226] Updated weights for policy 0, policy_version 1222965 (0.0007) [2023-12-28 04:02:53,749][106225] Updated weights for policy 1, policy_version 1226090 (0.0007) [2023-12-28 04:02:53,800][106225] Updated weights for policy 1, policy_version 1226100 (0.0007) [2023-12-28 04:02:53,850][106225] Updated weights for policy 1, policy_version 1226110 (0.0009) [2023-12-28 04:02:53,904][106225] Updated weights for policy 1, policy_version 1226120 (0.0009) [2023-12-28 04:02:54,274][106226] Updated weights for policy 0, policy_version 1222975 (0.0009) [2023-12-28 04:02:54,336][106226] Updated weights for policy 0, policy_version 1222985 (0.0011) [2023-12-28 04:02:54,392][106226] Updated weights for policy 0, policy_version 1222995 (0.0010) [2023-12-28 04:02:54,687][106225] Updated weights for policy 1, policy_version 1226130 (0.0009) [2023-12-28 04:02:54,740][106225] Updated weights for policy 1, policy_version 1226140 (0.0007) [2023-12-28 04:02:54,798][106225] Updated weights for policy 1, policy_version 1226150 (0.0008) [2023-12-28 04:02:55,051][106226] Updated weights for policy 0, policy_version 1223005 (0.0010) [2023-12-28 04:02:55,114][106226] Updated weights for policy 0, policy_version 1223015 (0.0011) [2023-12-28 04:02:55,179][106226] Updated weights for policy 0, policy_version 1223025 (0.0011) [2023-12-28 04:02:55,525][106225] Updated weights for policy 1, policy_version 1226160 (0.0007) [2023-12-28 04:02:55,591][106225] Updated weights for policy 1, policy_version 1226170 (0.0008) [2023-12-28 04:02:55,641][106225] Updated weights for policy 1, policy_version 1226180 (0.0008) [2023-12-28 04:02:55,812][106226] Updated weights for policy 0, policy_version 1223035 (0.0010) [2023-12-28 04:02:55,880][106226] Updated weights for policy 0, policy_version 1223045 (0.0009) [2023-12-28 04:02:55,942][106226] Updated weights for policy 0, policy_version 1223055 (0.0008) [2023-12-28 04:02:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19688.6). Total num frames: 627113984. Throughput: 0: 9856.8, 1: 9872.4. Samples: 627082944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:02:56,176][105115] Avg episode reward: [(0, '-4.151'), (1, '-4.928')] [2023-12-28 04:02:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001223064_313163776.pth... [2023-12-28 04:02:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001226184_313950208.pth... [2023-12-28 04:02:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001221912_312868864.pth [2023-12-28 04:02:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001225032_313655296.pth [2023-12-28 04:02:56,363][106225] Updated weights for policy 1, policy_version 1226190 (0.0009) [2023-12-28 04:02:56,424][106225] Updated weights for policy 1, policy_version 1226200 (0.0008) [2023-12-28 04:02:56,488][106225] Updated weights for policy 1, policy_version 1226210 (0.0009) [2023-12-28 04:02:56,581][106226] Updated weights for policy 0, policy_version 1223065 (0.0009) [2023-12-28 04:02:56,637][106226] Updated weights for policy 0, policy_version 1223075 (0.0008) [2023-12-28 04:02:56,685][106226] Updated weights for policy 0, policy_version 1223085 (0.0008) [2023-12-28 04:02:56,728][106226] Updated weights for policy 0, policy_version 1223095 (0.0007) [2023-12-28 04:02:57,227][106225] Updated weights for policy 1, policy_version 1226220 (0.0009) [2023-12-28 04:02:57,281][106225] Updated weights for policy 1, policy_version 1226230 (0.0007) [2023-12-28 04:02:57,334][106225] Updated weights for policy 1, policy_version 1226240 (0.0008) [2023-12-28 04:02:57,387][106226] Updated weights for policy 0, policy_version 1223105 (0.0006) [2023-12-28 04:02:57,445][106226] Updated weights for policy 0, policy_version 1223115 (0.0008) [2023-12-28 04:02:57,501][106226] Updated weights for policy 0, policy_version 1223125 (0.0008) [2023-12-28 04:02:57,913][106225] Updated weights for policy 1, policy_version 1226250 (0.0010) [2023-12-28 04:02:57,962][106225] Updated weights for policy 1, policy_version 1226260 (0.0009) [2023-12-28 04:02:58,016][106225] Updated weights for policy 1, policy_version 1226270 (0.0010) [2023-12-28 04:02:58,066][106225] Updated weights for policy 1, policy_version 1226280 (0.0010) [2023-12-28 04:02:58,076][106226] Updated weights for policy 0, policy_version 1223135 (0.0007) [2023-12-28 04:02:58,125][106226] Updated weights for policy 0, policy_version 1223145 (0.0005) [2023-12-28 04:02:58,171][106226] Updated weights for policy 0, policy_version 1223155 (0.0005) [2023-12-28 04:02:58,847][106225] Updated weights for policy 1, policy_version 1226290 (0.0007) [2023-12-28 04:02:58,929][106225] Updated weights for policy 1, policy_version 1226300 (0.0008) [2023-12-28 04:02:59,004][106226] Updated weights for policy 0, policy_version 1223165 (0.0008) [2023-12-28 04:02:59,007][106225] Updated weights for policy 1, policy_version 1226310 (0.0010) [2023-12-28 04:02:59,062][106226] Updated weights for policy 0, policy_version 1223175 (0.0009) [2023-12-28 04:02:59,127][106226] Updated weights for policy 0, policy_version 1223185 (0.0009) [2023-12-28 04:02:59,815][106225] Updated weights for policy 1, policy_version 1226320 (0.0008) [2023-12-28 04:02:59,880][106225] Updated weights for policy 1, policy_version 1226330 (0.0008) [2023-12-28 04:02:59,947][106225] Updated weights for policy 1, policy_version 1226340 (0.0008) [2023-12-28 04:02:59,974][106226] Updated weights for policy 0, policy_version 1223195 (0.0008) [2023-12-28 04:03:00,035][106226] Updated weights for policy 0, policy_version 1223205 (0.0008) [2023-12-28 04:03:00,093][106226] Updated weights for policy 0, policy_version 1223215 (0.0008) [2023-12-28 04:03:00,620][106225] Updated weights for policy 1, policy_version 1226350 (0.0007) [2023-12-28 04:03:00,674][106225] Updated weights for policy 1, policy_version 1226360 (0.0005) [2023-12-28 04:03:00,727][106225] Updated weights for policy 1, policy_version 1226370 (0.0007) [2023-12-28 04:03:00,904][106226] Updated weights for policy 0, policy_version 1223225 (0.0009) [2023-12-28 04:03:00,965][106226] Updated weights for policy 0, policy_version 1223235 (0.0008) [2023-12-28 04:03:01,041][106226] Updated weights for policy 0, policy_version 1223246 (0.0007) [2023-12-28 04:03:01,111][106226] Updated weights for policy 0, policy_version 1223256 (0.0009) [2023-12-28 04:03:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 627212288. Throughput: 0: 9822.3, 1: 9861.5. Samples: 627199352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:03:01,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.739')] [2023-12-28 04:03:01,480][106225] Updated weights for policy 1, policy_version 1226380 (0.0007) [2023-12-28 04:03:01,545][106225] Updated weights for policy 1, policy_version 1226390 (0.0008) [2023-12-28 04:03:01,613][106225] Updated weights for policy 1, policy_version 1226400 (0.0009) [2023-12-28 04:03:01,821][106226] Updated weights for policy 0, policy_version 1223266 (0.0006) [2023-12-28 04:03:01,873][106226] Updated weights for policy 0, policy_version 1223276 (0.0007) [2023-12-28 04:03:01,937][106226] Updated weights for policy 0, policy_version 1223286 (0.0008) [2023-12-28 04:03:02,369][106225] Updated weights for policy 1, policy_version 1226410 (0.0009) [2023-12-28 04:03:02,439][106225] Updated weights for policy 1, policy_version 1226420 (0.0009) [2023-12-28 04:03:02,501][106225] Updated weights for policy 1, policy_version 1226430 (0.0008) [2023-12-28 04:03:02,568][106225] Updated weights for policy 1, policy_version 1226440 (0.0007) [2023-12-28 04:03:02,674][106226] Updated weights for policy 0, policy_version 1223296 (0.0010) [2023-12-28 04:03:02,743][106226] Updated weights for policy 0, policy_version 1223306 (0.0011) [2023-12-28 04:03:02,805][106226] Updated weights for policy 0, policy_version 1223316 (0.0011) [2023-12-28 04:03:03,295][106225] Updated weights for policy 1, policy_version 1226450 (0.0008) [2023-12-28 04:03:03,350][106225] Updated weights for policy 1, policy_version 1226460 (0.0008) [2023-12-28 04:03:03,405][106225] Updated weights for policy 1, policy_version 1226470 (0.0007) [2023-12-28 04:03:03,424][106226] Updated weights for policy 0, policy_version 1223326 (0.0010) [2023-12-28 04:03:03,486][106226] Updated weights for policy 0, policy_version 1223336 (0.0006) [2023-12-28 04:03:03,537][106226] Updated weights for policy 0, policy_version 1223346 (0.0008) [2023-12-28 04:03:04,129][106225] Updated weights for policy 1, policy_version 1226480 (0.0008) [2023-12-28 04:03:04,189][106226] Updated weights for policy 0, policy_version 1223356 (0.0008) [2023-12-28 04:03:04,193][106225] Updated weights for policy 1, policy_version 1226490 (0.0008) [2023-12-28 04:03:04,251][106226] Updated weights for policy 0, policy_version 1223366 (0.0006) [2023-12-28 04:03:04,265][106225] Updated weights for policy 1, policy_version 1226500 (0.0008) [2023-12-28 04:03:04,321][106226] Updated weights for policy 0, policy_version 1223376 (0.0007) [2023-12-28 04:03:04,894][106225] Updated weights for policy 1, policy_version 1226510 (0.0007) [2023-12-28 04:03:04,962][106225] Updated weights for policy 1, policy_version 1226520 (0.0005) [2023-12-28 04:03:05,024][106225] Updated weights for policy 1, policy_version 1226530 (0.0008) [2023-12-28 04:03:05,097][106226] Updated weights for policy 0, policy_version 1223386 (0.0010) [2023-12-28 04:03:05,154][106226] Updated weights for policy 0, policy_version 1223396 (0.0009) [2023-12-28 04:03:05,206][106226] Updated weights for policy 0, policy_version 1223406 (0.0007) [2023-12-28 04:03:05,264][106226] Updated weights for policy 0, policy_version 1223416 (0.0008) [2023-12-28 04:03:05,591][106225] Updated weights for policy 1, policy_version 1226540 (0.0007) [2023-12-28 04:03:05,656][106225] Updated weights for policy 1, policy_version 1226550 (0.0005) [2023-12-28 04:03:05,719][106225] Updated weights for policy 1, policy_version 1226560 (0.0005) [2023-12-28 04:03:06,086][106226] Updated weights for policy 0, policy_version 1223426 (0.0010) [2023-12-28 04:03:06,153][106226] Updated weights for policy 0, policy_version 1223436 (0.0008) [2023-12-28 04:03:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 627302400. Throughput: 0: 9817.0, 1: 9847.1. Samples: 627315704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:03:06,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.915')] [2023-12-28 04:03:06,215][106226] Updated weights for policy 0, policy_version 1223446 (0.0008) [2023-12-28 04:03:06,279][106225] Updated weights for policy 1, policy_version 1226570 (0.0008) [2023-12-28 04:03:06,343][106225] Updated weights for policy 1, policy_version 1226580 (0.0006) [2023-12-28 04:03:06,405][106225] Updated weights for policy 1, policy_version 1226590 (0.0008) [2023-12-28 04:03:06,466][106225] Updated weights for policy 1, policy_version 1226600 (0.0009) [2023-12-28 04:03:06,908][106226] Updated weights for policy 0, policy_version 1223456 (0.0006) [2023-12-28 04:03:06,975][106226] Updated weights for policy 0, policy_version 1223466 (0.0005) [2023-12-28 04:03:07,034][106226] Updated weights for policy 0, policy_version 1223476 (0.0005) [2023-12-28 04:03:07,158][106225] Updated weights for policy 1, policy_version 1226610 (0.0009) [2023-12-28 04:03:07,204][106225] Updated weights for policy 1, policy_version 1226620 (0.0008) [2023-12-28 04:03:07,257][106225] Updated weights for policy 1, policy_version 1226630 (0.0008) [2023-12-28 04:03:07,684][106226] Updated weights for policy 0, policy_version 1223486 (0.0007) [2023-12-28 04:03:07,738][106226] Updated weights for policy 0, policy_version 1223496 (0.0008) [2023-12-28 04:03:07,796][106226] Updated weights for policy 0, policy_version 1223506 (0.0008) [2023-12-28 04:03:07,898][106225] Updated weights for policy 1, policy_version 1226640 (0.0008) [2023-12-28 04:03:07,956][106225] Updated weights for policy 1, policy_version 1226650 (0.0008) [2023-12-28 04:03:08,015][106225] Updated weights for policy 1, policy_version 1226660 (0.0009) [2023-12-28 04:03:08,552][106226] Updated weights for policy 0, policy_version 1223516 (0.0008) [2023-12-28 04:03:08,604][106226] Updated weights for policy 0, policy_version 1223526 (0.0008) [2023-12-28 04:03:08,669][106226] Updated weights for policy 0, policy_version 1223536 (0.0006) [2023-12-28 04:03:08,746][106225] Updated weights for policy 1, policy_version 1226670 (0.0008) [2023-12-28 04:03:08,817][106225] Updated weights for policy 1, policy_version 1226680 (0.0008) [2023-12-28 04:03:08,876][106225] Updated weights for policy 1, policy_version 1226690 (0.0008) [2023-12-28 04:03:09,366][106226] Updated weights for policy 0, policy_version 1223546 (0.0007) [2023-12-28 04:03:09,429][106226] Updated weights for policy 0, policy_version 1223556 (0.0008) [2023-12-28 04:03:09,488][106226] Updated weights for policy 0, policy_version 1223566 (0.0009) [2023-12-28 04:03:09,551][106226] Updated weights for policy 0, policy_version 1223576 (0.0008) [2023-12-28 04:03:09,578][106225] Updated weights for policy 1, policy_version 1226700 (0.0008) [2023-12-28 04:03:09,635][106225] Updated weights for policy 1, policy_version 1226710 (0.0009) [2023-12-28 04:03:09,696][106225] Updated weights for policy 1, policy_version 1226720 (0.0008) [2023-12-28 04:03:10,348][106226] Updated weights for policy 0, policy_version 1223586 (0.0008) [2023-12-28 04:03:10,409][106226] Updated weights for policy 0, policy_version 1223596 (0.0008) [2023-12-28 04:03:10,474][106226] Updated weights for policy 0, policy_version 1223606 (0.0009) [2023-12-28 04:03:10,484][106225] Updated weights for policy 1, policy_version 1226730 (0.0008) [2023-12-28 04:03:10,541][106225] Updated weights for policy 1, policy_version 1226740 (0.0008) [2023-12-28 04:03:10,597][106225] Updated weights for policy 1, policy_version 1226750 (0.0009) [2023-12-28 04:03:10,659][106225] Updated weights for policy 1, policy_version 1226760 (0.0010) [2023-12-28 04:03:11,170][106226] Updated weights for policy 0, policy_version 1223616 (0.0008) [2023-12-28 04:03:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 627400704. Throughput: 0: 9831.2, 1: 9881.0. Samples: 627376444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:03:11,175][105115] Avg episode reward: [(0, '-4.161'), (1, '-5.231')] [2023-12-28 04:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001226760_314097664.pth... [2023-12-28 04:03:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001225640_313810944.pth [2023-12-28 04:03:11,233][106226] Updated weights for policy 0, policy_version 1223626 (0.0006) [2023-12-28 04:03:11,299][106226] Updated weights for policy 0, policy_version 1223636 (0.0008) [2023-12-28 04:03:11,323][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001223640_313311232.pth... [2023-12-28 04:03:11,328][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001222488_313016320.pth [2023-12-28 04:03:11,477][106225] Updated weights for policy 1, policy_version 1226770 (0.0008) [2023-12-28 04:03:11,531][106225] Updated weights for policy 1, policy_version 1226780 (0.0008) [2023-12-28 04:03:11,592][106225] Updated weights for policy 1, policy_version 1226790 (0.0009) [2023-12-28 04:03:12,056][106226] Updated weights for policy 0, policy_version 1223646 (0.0007) [2023-12-28 04:03:12,124][106226] Updated weights for policy 0, policy_version 1223656 (0.0006) [2023-12-28 04:03:12,194][106226] Updated weights for policy 0, policy_version 1223666 (0.0006) [2023-12-28 04:03:12,305][106225] Updated weights for policy 1, policy_version 1226800 (0.0009) [2023-12-28 04:03:12,371][106225] Updated weights for policy 1, policy_version 1226810 (0.0008) [2023-12-28 04:03:12,438][106225] Updated weights for policy 1, policy_version 1226820 (0.0010) [2023-12-28 04:03:12,748][106226] Updated weights for policy 0, policy_version 1223676 (0.0006) [2023-12-28 04:03:12,797][106226] Updated weights for policy 0, policy_version 1223686 (0.0008) [2023-12-28 04:03:12,847][106226] Updated weights for policy 0, policy_version 1223696 (0.0008) [2023-12-28 04:03:13,198][106225] Updated weights for policy 1, policy_version 1226830 (0.0009) [2023-12-28 04:03:13,250][106225] Updated weights for policy 1, policy_version 1226840 (0.0006) [2023-12-28 04:03:13,304][106225] Updated weights for policy 1, policy_version 1226850 (0.0008) [2023-12-28 04:03:13,596][106226] Updated weights for policy 0, policy_version 1223706 (0.0009) [2023-12-28 04:03:13,652][106226] Updated weights for policy 0, policy_version 1223716 (0.0008) [2023-12-28 04:03:13,701][106226] Updated weights for policy 0, policy_version 1223726 (0.0008) [2023-12-28 04:03:13,754][106226] Updated weights for policy 0, policy_version 1223736 (0.0009) [2023-12-28 04:03:13,981][106225] Updated weights for policy 1, policy_version 1226860 (0.0008) [2023-12-28 04:03:14,033][106225] Updated weights for policy 1, policy_version 1226870 (0.0009) [2023-12-28 04:03:14,082][106225] Updated weights for policy 1, policy_version 1226880 (0.0009) [2023-12-28 04:03:14,416][106226] Updated weights for policy 0, policy_version 1223746 (0.0005) [2023-12-28 04:03:14,475][106226] Updated weights for policy 0, policy_version 1223756 (0.0005) [2023-12-28 04:03:14,534][106226] Updated weights for policy 0, policy_version 1223766 (0.0005) [2023-12-28 04:03:14,914][106225] Updated weights for policy 1, policy_version 1226890 (0.0008) [2023-12-28 04:03:14,975][106225] Updated weights for policy 1, policy_version 1226900 (0.0008) [2023-12-28 04:03:15,031][106225] Updated weights for policy 1, policy_version 1226910 (0.0007) [2023-12-28 04:03:15,088][106225] Updated weights for policy 1, policy_version 1226920 (0.0007) [2023-12-28 04:03:15,156][106226] Updated weights for policy 0, policy_version 1223776 (0.0010) [2023-12-28 04:03:15,217][106226] Updated weights for policy 0, policy_version 1223786 (0.0011) [2023-12-28 04:03:15,281][106226] Updated weights for policy 0, policy_version 1223796 (0.0011) [2023-12-28 04:03:15,808][106225] Updated weights for policy 1, policy_version 1226930 (0.0006) [2023-12-28 04:03:15,863][106225] Updated weights for policy 1, policy_version 1226940 (0.0008) [2023-12-28 04:03:15,908][106225] Updated weights for policy 1, policy_version 1226950 (0.0009) [2023-12-28 04:03:15,951][106226] Updated weights for policy 0, policy_version 1223806 (0.0009) [2023-12-28 04:03:16,010][106226] Updated weights for policy 0, policy_version 1223816 (0.0009) [2023-12-28 04:03:16,058][106226] Updated weights for policy 0, policy_version 1223826 (0.0008) [2023-12-28 04:03:16,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 627507200. Throughput: 0: 9854.8, 1: 9774.8. Samples: 627492664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:03:16,175][105115] Avg episode reward: [(0, '-4.223'), (1, '-4.795')] [2023-12-28 04:03:16,669][106225] Updated weights for policy 1, policy_version 1226960 (0.0008) [2023-12-28 04:03:16,679][106226] Updated weights for policy 0, policy_version 1223836 (0.0006) [2023-12-28 04:03:16,723][106225] Updated weights for policy 1, policy_version 1226970 (0.0006) [2023-12-28 04:03:16,737][106226] Updated weights for policy 0, policy_version 1223846 (0.0006) [2023-12-28 04:03:16,781][106225] Updated weights for policy 1, policy_version 1226980 (0.0007) [2023-12-28 04:03:16,795][106226] Updated weights for policy 0, policy_version 1223856 (0.0006) [2023-12-28 04:03:17,504][106226] Updated weights for policy 0, policy_version 1223866 (0.0008) [2023-12-28 04:03:17,511][106225] Updated weights for policy 1, policy_version 1226990 (0.0009) [2023-12-28 04:03:17,566][106225] Updated weights for policy 1, policy_version 1227000 (0.0010) [2023-12-28 04:03:17,568][106226] Updated weights for policy 0, policy_version 1223876 (0.0010) [2023-12-28 04:03:17,627][106225] Updated weights for policy 1, policy_version 1227010 (0.0010) [2023-12-28 04:03:17,630][106226] Updated weights for policy 0, policy_version 1223886 (0.0011) [2023-12-28 04:03:17,681][106226] Updated weights for policy 0, policy_version 1223896 (0.0010) [2023-12-28 04:03:18,326][106225] Updated weights for policy 1, policy_version 1227020 (0.0010) [2023-12-28 04:03:18,373][106226] Updated weights for policy 0, policy_version 1223906 (0.0011) [2023-12-28 04:03:18,393][106225] Updated weights for policy 1, policy_version 1227030 (0.0009) [2023-12-28 04:03:18,429][106226] Updated weights for policy 0, policy_version 1223916 (0.0009) [2023-12-28 04:03:18,455][106225] Updated weights for policy 1, policy_version 1227040 (0.0011) [2023-12-28 04:03:18,494][106226] Updated weights for policy 0, policy_version 1223926 (0.0006) [2023-12-28 04:03:19,078][106226] Updated weights for policy 0, policy_version 1223936 (0.0005) [2023-12-28 04:03:19,124][106226] Updated weights for policy 0, policy_version 1223946 (0.0005) [2023-12-28 04:03:19,163][106225] Updated weights for policy 1, policy_version 1227050 (0.0011) [2023-12-28 04:03:19,173][106226] Updated weights for policy 0, policy_version 1223956 (0.0005) [2023-12-28 04:03:19,223][106225] Updated weights for policy 1, policy_version 1227060 (0.0011) [2023-12-28 04:03:19,287][106225] Updated weights for policy 1, policy_version 1227070 (0.0009) [2023-12-28 04:03:19,355][106225] Updated weights for policy 1, policy_version 1227080 (0.0007) [2023-12-28 04:03:19,871][106226] Updated weights for policy 0, policy_version 1223966 (0.0008) [2023-12-28 04:03:19,927][106226] Updated weights for policy 0, policy_version 1223976 (0.0009) [2023-12-28 04:03:19,993][106226] Updated weights for policy 0, policy_version 1223986 (0.0008) [2023-12-28 04:03:20,136][106225] Updated weights for policy 1, policy_version 1227090 (0.0010) [2023-12-28 04:03:20,202][106225] Updated weights for policy 1, policy_version 1227100 (0.0010) [2023-12-28 04:03:20,264][106225] Updated weights for policy 1, policy_version 1227110 (0.0011) [2023-12-28 04:03:20,734][106226] Updated weights for policy 0, policy_version 1223996 (0.0007) [2023-12-28 04:03:20,797][106226] Updated weights for policy 0, policy_version 1224006 (0.0008) [2023-12-28 04:03:20,865][106226] Updated weights for policy 0, policy_version 1224016 (0.0008) [2023-12-28 04:03:20,924][106225] Updated weights for policy 1, policy_version 1227120 (0.0006) [2023-12-28 04:03:20,991][106225] Updated weights for policy 1, policy_version 1227130 (0.0008) [2023-12-28 04:03:21,057][106225] Updated weights for policy 1, policy_version 1227140 (0.0011) [2023-12-28 04:03:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 627605504. Throughput: 0: 9807.8, 1: 9681.2. Samples: 627610208. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:21,175][105115] Avg episode reward: [(0, '-4.111'), (1, '-5.102')] [2023-12-28 04:03:21,626][106226] Updated weights for policy 0, policy_version 1224026 (0.0010) [2023-12-28 04:03:21,691][106226] Updated weights for policy 0, policy_version 1224036 (0.0008) [2023-12-28 04:03:21,724][106225] Updated weights for policy 1, policy_version 1227150 (0.0008) [2023-12-28 04:03:21,757][106226] Updated weights for policy 0, policy_version 1224046 (0.0008) [2023-12-28 04:03:21,788][106225] Updated weights for policy 1, policy_version 1227160 (0.0010) [2023-12-28 04:03:21,810][106226] Updated weights for policy 0, policy_version 1224056 (0.0006) [2023-12-28 04:03:21,854][106225] Updated weights for policy 1, policy_version 1227170 (0.0011) [2023-12-28 04:03:22,545][106226] Updated weights for policy 0, policy_version 1224066 (0.0007) [2023-12-28 04:03:22,588][106225] Updated weights for policy 1, policy_version 1227180 (0.0011) [2023-12-28 04:03:22,613][106226] Updated weights for policy 0, policy_version 1224076 (0.0007) [2023-12-28 04:03:22,654][106225] Updated weights for policy 1, policy_version 1227190 (0.0011) [2023-12-28 04:03:22,672][106226] Updated weights for policy 0, policy_version 1224086 (0.0006) [2023-12-28 04:03:22,725][106225] Updated weights for policy 1, policy_version 1227200 (0.0010) [2023-12-28 04:03:23,263][106226] Updated weights for policy 0, policy_version 1224096 (0.0005) [2023-12-28 04:03:23,318][106226] Updated weights for policy 0, policy_version 1224106 (0.0005) [2023-12-28 04:03:23,368][106226] Updated weights for policy 0, policy_version 1224116 (0.0005) [2023-12-28 04:03:23,390][106225] Updated weights for policy 1, policy_version 1227210 (0.0007) [2023-12-28 04:03:23,438][106225] Updated weights for policy 1, policy_version 1227220 (0.0005) [2023-12-28 04:03:23,484][106225] Updated weights for policy 1, policy_version 1227230 (0.0005) [2023-12-28 04:03:23,535][106225] Updated weights for policy 1, policy_version 1227240 (0.0006) [2023-12-28 04:03:24,024][106226] Updated weights for policy 0, policy_version 1224126 (0.0009) [2023-12-28 04:03:24,078][106226] Updated weights for policy 0, policy_version 1224136 (0.0009) [2023-12-28 04:03:24,131][106226] Updated weights for policy 0, policy_version 1224146 (0.0008) [2023-12-28 04:03:24,167][106225] Updated weights for policy 1, policy_version 1227250 (0.0006) [2023-12-28 04:03:24,227][106225] Updated weights for policy 1, policy_version 1227260 (0.0006) [2023-12-28 04:03:24,285][106225] Updated weights for policy 1, policy_version 1227270 (0.0006) [2023-12-28 04:03:24,859][106226] Updated weights for policy 0, policy_version 1224156 (0.0009) [2023-12-28 04:03:24,913][106226] Updated weights for policy 0, policy_version 1224166 (0.0008) [2023-12-28 04:03:24,962][106226] Updated weights for policy 0, policy_version 1224176 (0.0006) [2023-12-28 04:03:24,966][106225] Updated weights for policy 1, policy_version 1227280 (0.0008) [2023-12-28 04:03:25,026][106225] Updated weights for policy 1, policy_version 1227290 (0.0010) [2023-12-28 04:03:25,079][106225] Updated weights for policy 1, policy_version 1227300 (0.0009) [2023-12-28 04:03:25,652][106226] Updated weights for policy 0, policy_version 1224186 (0.0006) [2023-12-28 04:03:25,708][106226] Updated weights for policy 0, policy_version 1224196 (0.0008) [2023-12-28 04:03:25,768][106226] Updated weights for policy 0, policy_version 1224206 (0.0009) [2023-12-28 04:03:25,777][106225] Updated weights for policy 1, policy_version 1227310 (0.0007) [2023-12-28 04:03:25,828][106226] Updated weights for policy 0, policy_version 1224216 (0.0008) [2023-12-28 04:03:25,830][106225] Updated weights for policy 1, policy_version 1227320 (0.0006) [2023-12-28 04:03:25,880][106225] Updated weights for policy 1, policy_version 1227330 (0.0005) [2023-12-28 04:03:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 627703808. Throughput: 0: 9803.7, 1: 9681.2. Samples: 627670564. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:26,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.799')] [2023-12-28 04:03:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001227336_314245120.pth... [2023-12-28 04:03:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001224216_313458688.pth... [2023-12-28 04:03:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001223064_313163776.pth [2023-12-28 04:03:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001226184_313950208.pth [2023-12-28 04:03:26,543][106225] Updated weights for policy 1, policy_version 1227340 (0.0007) [2023-12-28 04:03:26,572][106226] Updated weights for policy 0, policy_version 1224226 (0.0006) [2023-12-28 04:03:26,596][106225] Updated weights for policy 1, policy_version 1227350 (0.0010) [2023-12-28 04:03:26,617][106226] Updated weights for policy 0, policy_version 1224236 (0.0007) [2023-12-28 04:03:26,650][106225] Updated weights for policy 1, policy_version 1227360 (0.0010) [2023-12-28 04:03:26,678][106226] Updated weights for policy 0, policy_version 1224246 (0.0005) [2023-12-28 04:03:27,387][106225] Updated weights for policy 1, policy_version 1227370 (0.0010) [2023-12-28 04:03:27,409][106226] Updated weights for policy 0, policy_version 1224256 (0.0007) [2023-12-28 04:03:27,439][106225] Updated weights for policy 1, policy_version 1227380 (0.0010) [2023-12-28 04:03:27,463][106226] Updated weights for policy 0, policy_version 1224266 (0.0007) [2023-12-28 04:03:27,495][106225] Updated weights for policy 1, policy_version 1227390 (0.0010) [2023-12-28 04:03:27,519][106226] Updated weights for policy 0, policy_version 1224276 (0.0005) [2023-12-28 04:03:27,544][106225] Updated weights for policy 1, policy_version 1227400 (0.0010) [2023-12-28 04:03:28,199][106225] Updated weights for policy 1, policy_version 1227410 (0.0010) [2023-12-28 04:03:28,227][106226] Updated weights for policy 0, policy_version 1224286 (0.0007) [2023-12-28 04:03:28,262][106225] Updated weights for policy 1, policy_version 1227420 (0.0008) [2023-12-28 04:03:28,284][106226] Updated weights for policy 0, policy_version 1224296 (0.0006) [2023-12-28 04:03:28,320][106225] Updated weights for policy 1, policy_version 1227430 (0.0006) [2023-12-28 04:03:28,340][106226] Updated weights for policy 0, policy_version 1224306 (0.0009) [2023-12-28 04:03:29,007][106225] Updated weights for policy 1, policy_version 1227440 (0.0006) [2023-12-28 04:03:29,056][106226] Updated weights for policy 0, policy_version 1224316 (0.0007) [2023-12-28 04:03:29,064][106225] Updated weights for policy 1, policy_version 1227450 (0.0005) [2023-12-28 04:03:29,117][106226] Updated weights for policy 0, policy_version 1224326 (0.0010) [2023-12-28 04:03:29,122][106225] Updated weights for policy 1, policy_version 1227460 (0.0006) [2023-12-28 04:03:29,174][106226] Updated weights for policy 0, policy_version 1224336 (0.0010) [2023-12-28 04:03:29,810][106225] Updated weights for policy 1, policy_version 1227470 (0.0007) [2023-12-28 04:03:29,876][106225] Updated weights for policy 1, policy_version 1227480 (0.0009) [2023-12-28 04:03:29,878][106226] Updated weights for policy 0, policy_version 1224346 (0.0009) [2023-12-28 04:03:29,938][106225] Updated weights for policy 1, policy_version 1227490 (0.0008) [2023-12-28 04:03:29,943][106226] Updated weights for policy 0, policy_version 1224356 (0.0010) [2023-12-28 04:03:30,003][106226] Updated weights for policy 0, policy_version 1224366 (0.0011) [2023-12-28 04:03:30,059][106226] Updated weights for policy 0, policy_version 1224376 (0.0007) [2023-12-28 04:03:30,657][106225] Updated weights for policy 1, policy_version 1227500 (0.0008) [2023-12-28 04:03:30,708][106225] Updated weights for policy 1, policy_version 1227510 (0.0008) [2023-12-28 04:03:30,762][106225] Updated weights for policy 1, policy_version 1227520 (0.0007) [2023-12-28 04:03:30,779][106226] Updated weights for policy 0, policy_version 1224386 (0.0007) [2023-12-28 04:03:30,827][106226] Updated weights for policy 0, policy_version 1224396 (0.0007) [2023-12-28 04:03:30,885][106226] Updated weights for policy 0, policy_version 1224406 (0.0009) [2023-12-28 04:03:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 627802112. Throughput: 0: 9847.8, 1: 9767.2. Samples: 627790460. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:31,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-5.001')] [2023-12-28 04:03:31,534][106225] Updated weights for policy 1, policy_version 1227530 (0.0007) [2023-12-28 04:03:31,591][106225] Updated weights for policy 1, policy_version 1227540 (0.0008) [2023-12-28 04:03:31,628][106226] Updated weights for policy 0, policy_version 1224416 (0.0009) [2023-12-28 04:03:31,658][106225] Updated weights for policy 1, policy_version 1227550 (0.0009) [2023-12-28 04:03:31,696][106226] Updated weights for policy 0, policy_version 1224426 (0.0008) [2023-12-28 04:03:31,708][106225] Updated weights for policy 1, policy_version 1227560 (0.0007) [2023-12-28 04:03:31,759][106226] Updated weights for policy 0, policy_version 1224436 (0.0008) [2023-12-28 04:03:32,437][106225] Updated weights for policy 1, policy_version 1227570 (0.0009) [2023-12-28 04:03:32,437][106226] Updated weights for policy 0, policy_version 1224446 (0.0009) [2023-12-28 04:03:32,505][106225] Updated weights for policy 1, policy_version 1227580 (0.0007) [2023-12-28 04:03:32,509][106226] Updated weights for policy 0, policy_version 1224456 (0.0008) [2023-12-28 04:03:32,570][106225] Updated weights for policy 1, policy_version 1227590 (0.0006) [2023-12-28 04:03:32,571][106226] Updated weights for policy 0, policy_version 1224466 (0.0006) [2023-12-28 04:03:33,267][106226] Updated weights for policy 0, policy_version 1224476 (0.0007) [2023-12-28 04:03:33,280][106225] Updated weights for policy 1, policy_version 1227600 (0.0008) [2023-12-28 04:03:33,320][106226] Updated weights for policy 0, policy_version 1224486 (0.0006) [2023-12-28 04:03:33,328][106225] Updated weights for policy 1, policy_version 1227610 (0.0005) [2023-12-28 04:03:33,378][106226] Updated weights for policy 0, policy_version 1224496 (0.0008) [2023-12-28 04:03:33,389][106225] Updated weights for policy 1, policy_version 1227620 (0.0005) [2023-12-28 04:03:33,934][106225] Updated weights for policy 1, policy_version 1227630 (0.0005) [2023-12-28 04:03:33,992][106225] Updated weights for policy 1, policy_version 1227640 (0.0005) [2023-12-28 04:03:34,050][106225] Updated weights for policy 1, policy_version 1227650 (0.0005) [2023-12-28 04:03:34,183][106226] Updated weights for policy 0, policy_version 1224506 (0.0008) [2023-12-28 04:03:34,239][106226] Updated weights for policy 0, policy_version 1224516 (0.0009) [2023-12-28 04:03:34,299][106226] Updated weights for policy 0, policy_version 1224526 (0.0009) [2023-12-28 04:03:34,355][106226] Updated weights for policy 0, policy_version 1224536 (0.0008) [2023-12-28 04:03:34,700][106225] Updated weights for policy 1, policy_version 1227660 (0.0005) [2023-12-28 04:03:34,768][106225] Updated weights for policy 1, policy_version 1227670 (0.0007) [2023-12-28 04:03:34,834][106225] Updated weights for policy 1, policy_version 1227680 (0.0009) [2023-12-28 04:03:35,035][106226] Updated weights for policy 0, policy_version 1224546 (0.0007) [2023-12-28 04:03:35,109][106226] Updated weights for policy 0, policy_version 1224556 (0.0005) [2023-12-28 04:03:35,176][106226] Updated weights for policy 0, policy_version 1224566 (0.0006) [2023-12-28 04:03:35,464][106225] Updated weights for policy 1, policy_version 1227690 (0.0009) [2023-12-28 04:03:35,512][106225] Updated weights for policy 1, policy_version 1227700 (0.0006) [2023-12-28 04:03:35,563][106225] Updated weights for policy 1, policy_version 1227710 (0.0005) [2023-12-28 04:03:35,611][106225] Updated weights for policy 1, policy_version 1227720 (0.0006) [2023-12-28 04:03:35,733][106226] Updated weights for policy 0, policy_version 1224576 (0.0008) [2023-12-28 04:03:35,790][106226] Updated weights for policy 0, policy_version 1224586 (0.0005) [2023-12-28 04:03:35,844][106226] Updated weights for policy 0, policy_version 1224596 (0.0005) [2023-12-28 04:03:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 627900416. Throughput: 0: 9869.1, 1: 9810.6. Samples: 627910280. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:36,175][105115] Avg episode reward: [(0, '-4.198'), (1, '-5.102')] [2023-12-28 04:03:36,262][106225] Updated weights for policy 1, policy_version 1227730 (0.0009) [2023-12-28 04:03:36,325][106225] Updated weights for policy 1, policy_version 1227740 (0.0009) [2023-12-28 04:03:36,392][106225] Updated weights for policy 1, policy_version 1227750 (0.0010) [2023-12-28 04:03:36,531][106226] Updated weights for policy 0, policy_version 1224606 (0.0008) [2023-12-28 04:03:36,598][106226] Updated weights for policy 0, policy_version 1224616 (0.0008) [2023-12-28 04:03:36,667][106226] Updated weights for policy 0, policy_version 1224626 (0.0009) [2023-12-28 04:03:37,093][106225] Updated weights for policy 1, policy_version 1227760 (0.0008) [2023-12-28 04:03:37,146][106225] Updated weights for policy 1, policy_version 1227770 (0.0007) [2023-12-28 04:03:37,212][106225] Updated weights for policy 1, policy_version 1227780 (0.0008) [2023-12-28 04:03:37,297][106226] Updated weights for policy 0, policy_version 1224636 (0.0008) [2023-12-28 04:03:37,359][106226] Updated weights for policy 0, policy_version 1224646 (0.0008) [2023-12-28 04:03:37,417][106226] Updated weights for policy 0, policy_version 1224656 (0.0009) [2023-12-28 04:03:37,810][106225] Updated weights for policy 1, policy_version 1227790 (0.0006) [2023-12-28 04:03:37,874][106225] Updated weights for policy 1, policy_version 1227800 (0.0005) [2023-12-28 04:03:37,942][106225] Updated weights for policy 1, policy_version 1227810 (0.0006) [2023-12-28 04:03:38,124][106226] Updated weights for policy 0, policy_version 1224666 (0.0008) [2023-12-28 04:03:38,172][106226] Updated weights for policy 0, policy_version 1224676 (0.0005) [2023-12-28 04:03:38,221][106226] Updated weights for policy 0, policy_version 1224686 (0.0005) [2023-12-28 04:03:38,273][106226] Updated weights for policy 0, policy_version 1224696 (0.0009) [2023-12-28 04:03:38,623][106225] Updated weights for policy 1, policy_version 1227820 (0.0009) [2023-12-28 04:03:38,674][106225] Updated weights for policy 1, policy_version 1227830 (0.0010) [2023-12-28 04:03:38,728][106225] Updated weights for policy 1, policy_version 1227840 (0.0010) [2023-12-28 04:03:38,992][106226] Updated weights for policy 0, policy_version 1224706 (0.0010) [2023-12-28 04:03:39,048][106226] Updated weights for policy 0, policy_version 1224716 (0.0010) [2023-12-28 04:03:39,109][106226] Updated weights for policy 0, policy_version 1224726 (0.0008) [2023-12-28 04:03:39,458][106225] Updated weights for policy 1, policy_version 1227850 (0.0009) [2023-12-28 04:03:39,522][106225] Updated weights for policy 1, policy_version 1227860 (0.0011) [2023-12-28 04:03:39,591][106225] Updated weights for policy 1, policy_version 1227870 (0.0009) [2023-12-28 04:03:39,653][106225] Updated weights for policy 1, policy_version 1227880 (0.0008) [2023-12-28 04:03:39,848][106226] Updated weights for policy 0, policy_version 1224736 (0.0010) [2023-12-28 04:03:39,924][106226] Updated weights for policy 0, policy_version 1224746 (0.0010) [2023-12-28 04:03:39,989][106226] Updated weights for policy 0, policy_version 1224756 (0.0007) [2023-12-28 04:03:40,379][106225] Updated weights for policy 1, policy_version 1227890 (0.0008) [2023-12-28 04:03:40,450][106225] Updated weights for policy 1, policy_version 1227900 (0.0009) [2023-12-28 04:03:40,520][106225] Updated weights for policy 1, policy_version 1227910 (0.0009) [2023-12-28 04:03:40,576][106226] Updated weights for policy 0, policy_version 1224766 (0.0006) [2023-12-28 04:03:40,640][106226] Updated weights for policy 0, policy_version 1224776 (0.0005) [2023-12-28 04:03:40,701][106226] Updated weights for policy 0, policy_version 1224786 (0.0006) [2023-12-28 04:03:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 627998720. Throughput: 0: 9894.5, 1: 9852.1. Samples: 627971536. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:41,175][105115] Avg episode reward: [(0, '-3.975'), (1, '-5.020')] [2023-12-28 04:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001227912_314392576.pth... [2023-12-28 04:03:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001224792_313606144.pth... [2023-12-28 04:03:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001226760_314097664.pth [2023-12-28 04:03:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001223640_313311232.pth [2023-12-28 04:03:41,283][106225] Updated weights for policy 1, policy_version 1227920 (0.0007) [2023-12-28 04:03:41,329][106226] Updated weights for policy 0, policy_version 1224796 (0.0007) [2023-12-28 04:03:41,340][106225] Updated weights for policy 1, policy_version 1227930 (0.0008) [2023-12-28 04:03:41,400][106226] Updated weights for policy 0, policy_version 1224806 (0.0008) [2023-12-28 04:03:41,415][106225] Updated weights for policy 1, policy_version 1227940 (0.0008) [2023-12-28 04:03:41,458][106226] Updated weights for policy 0, policy_version 1224816 (0.0008) [2023-12-28 04:03:42,196][106225] Updated weights for policy 1, policy_version 1227950 (0.0006) [2023-12-28 04:03:42,234][106226] Updated weights for policy 0, policy_version 1224826 (0.0008) [2023-12-28 04:03:42,262][106225] Updated weights for policy 1, policy_version 1227960 (0.0008) [2023-12-28 04:03:42,301][106226] Updated weights for policy 0, policy_version 1224836 (0.0007) [2023-12-28 04:03:42,330][106225] Updated weights for policy 1, policy_version 1227970 (0.0008) [2023-12-28 04:03:42,379][106226] Updated weights for policy 0, policy_version 1224846 (0.0008) [2023-12-28 04:03:42,437][106226] Updated weights for policy 0, policy_version 1224856 (0.0006) [2023-12-28 04:03:42,989][106225] Updated weights for policy 1, policy_version 1227980 (0.0009) [2023-12-28 04:03:43,053][106225] Updated weights for policy 1, policy_version 1227990 (0.0005) [2023-12-28 04:03:43,116][106225] Updated weights for policy 1, policy_version 1228000 (0.0005) [2023-12-28 04:03:43,189][106226] Updated weights for policy 0, policy_version 1224866 (0.0006) [2023-12-28 04:03:43,246][106226] Updated weights for policy 0, policy_version 1224876 (0.0007) [2023-12-28 04:03:43,303][106226] Updated weights for policy 0, policy_version 1224886 (0.0005) [2023-12-28 04:03:43,617][106225] Updated weights for policy 1, policy_version 1228010 (0.0006) [2023-12-28 04:03:43,676][106225] Updated weights for policy 1, policy_version 1228020 (0.0005) [2023-12-28 04:03:43,736][106225] Updated weights for policy 1, policy_version 1228030 (0.0005) [2023-12-28 04:03:43,800][106225] Updated weights for policy 1, policy_version 1228040 (0.0008) [2023-12-28 04:03:43,988][106226] Updated weights for policy 0, policy_version 1224896 (0.0008) [2023-12-28 04:03:44,055][106226] Updated weights for policy 0, policy_version 1224906 (0.0008) [2023-12-28 04:03:44,110][106226] Updated weights for policy 0, policy_version 1224916 (0.0009) [2023-12-28 04:03:44,343][106225] Updated weights for policy 1, policy_version 1228050 (0.0008) [2023-12-28 04:03:44,412][106225] Updated weights for policy 1, policy_version 1228060 (0.0008) [2023-12-28 04:03:44,479][106225] Updated weights for policy 1, policy_version 1228070 (0.0008) [2023-12-28 04:03:44,823][106226] Updated weights for policy 0, policy_version 1224926 (0.0008) [2023-12-28 04:03:44,889][106226] Updated weights for policy 0, policy_version 1224936 (0.0011) [2023-12-28 04:03:44,956][106226] Updated weights for policy 0, policy_version 1224946 (0.0010) [2023-12-28 04:03:45,077][106225] Updated weights for policy 1, policy_version 1228080 (0.0010) [2023-12-28 04:03:45,124][106225] Updated weights for policy 1, policy_version 1228090 (0.0010) [2023-12-28 04:03:45,173][106225] Updated weights for policy 1, policy_version 1228100 (0.0010) [2023-12-28 04:03:45,665][106226] Updated weights for policy 0, policy_version 1224956 (0.0007) [2023-12-28 04:03:45,734][106226] Updated weights for policy 0, policy_version 1224966 (0.0005) [2023-12-28 04:03:45,795][106226] Updated weights for policy 0, policy_version 1224976 (0.0006) [2023-12-28 04:03:45,903][106225] Updated weights for policy 1, policy_version 1228110 (0.0011) [2023-12-28 04:03:45,951][106225] Updated weights for policy 1, policy_version 1228120 (0.0007) [2023-12-28 04:03:46,008][106225] Updated weights for policy 1, policy_version 1228130 (0.0005) [2023-12-28 04:03:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 628105216. Throughput: 0: 9877.9, 1: 9951.5. Samples: 628091680. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:46,175][105115] Avg episode reward: [(0, '-4.140'), (1, '-4.833')] [2023-12-28 04:03:46,463][106226] Updated weights for policy 0, policy_version 1224986 (0.0008) [2023-12-28 04:03:46,511][106226] Updated weights for policy 0, policy_version 1224996 (0.0005) [2023-12-28 04:03:46,561][106226] Updated weights for policy 0, policy_version 1225006 (0.0009) [2023-12-28 04:03:46,589][106225] Updated weights for policy 1, policy_version 1228140 (0.0007) [2023-12-28 04:03:46,620][106226] Updated weights for policy 0, policy_version 1225016 (0.0008) [2023-12-28 04:03:46,641][106225] Updated weights for policy 1, policy_version 1228150 (0.0005) [2023-12-28 04:03:46,698][106225] Updated weights for policy 1, policy_version 1228160 (0.0005) [2023-12-28 04:03:47,300][106225] Updated weights for policy 1, policy_version 1228170 (0.0006) [2023-12-28 04:03:47,332][106226] Updated weights for policy 0, policy_version 1225026 (0.0005) [2023-12-28 04:03:47,370][106225] Updated weights for policy 1, policy_version 1228180 (0.0010) [2023-12-28 04:03:47,395][106226] Updated weights for policy 0, policy_version 1225036 (0.0005) [2023-12-28 04:03:47,420][106225] Updated weights for policy 1, policy_version 1228190 (0.0010) [2023-12-28 04:03:47,449][106226] Updated weights for policy 0, policy_version 1225046 (0.0007) [2023-12-28 04:03:47,479][106225] Updated weights for policy 1, policy_version 1228200 (0.0010) [2023-12-28 04:03:48,190][106226] Updated weights for policy 0, policy_version 1225056 (0.0006) [2023-12-28 04:03:48,195][106225] Updated weights for policy 1, policy_version 1228210 (0.0011) [2023-12-28 04:03:48,248][106226] Updated weights for policy 0, policy_version 1225066 (0.0006) [2023-12-28 04:03:48,253][106225] Updated weights for policy 1, policy_version 1228220 (0.0010) [2023-12-28 04:03:48,303][106226] Updated weights for policy 0, policy_version 1225076 (0.0009) [2023-12-28 04:03:48,313][106225] Updated weights for policy 1, policy_version 1228230 (0.0010) [2023-12-28 04:03:49,032][106225] Updated weights for policy 1, policy_version 1228240 (0.0010) [2023-12-28 04:03:49,053][106226] Updated weights for policy 0, policy_version 1225086 (0.0006) [2023-12-28 04:03:49,094][106225] Updated weights for policy 1, policy_version 1228250 (0.0010) [2023-12-28 04:03:49,098][106226] Updated weights for policy 0, policy_version 1225096 (0.0007) [2023-12-28 04:03:49,152][106226] Updated weights for policy 0, policy_version 1225106 (0.0007) [2023-12-28 04:03:49,157][106225] Updated weights for policy 1, policy_version 1228260 (0.0010) [2023-12-28 04:03:49,860][106225] Updated weights for policy 1, policy_version 1228270 (0.0010) [2023-12-28 04:03:49,921][106225] Updated weights for policy 1, policy_version 1228280 (0.0008) [2023-12-28 04:03:49,928][106226] Updated weights for policy 0, policy_version 1225116 (0.0009) [2023-12-28 04:03:49,983][106226] Updated weights for policy 0, policy_version 1225126 (0.0008) [2023-12-28 04:03:49,986][106225] Updated weights for policy 1, policy_version 1228290 (0.0010) [2023-12-28 04:03:50,042][106226] Updated weights for policy 0, policy_version 1225136 (0.0007) [2023-12-28 04:03:50,710][106226] Updated weights for policy 0, policy_version 1225146 (0.0006) [2023-12-28 04:03:50,726][106225] Updated weights for policy 1, policy_version 1228300 (0.0010) [2023-12-28 04:03:50,767][106226] Updated weights for policy 0, policy_version 1225156 (0.0006) [2023-12-28 04:03:50,791][106225] Updated weights for policy 1, policy_version 1228310 (0.0010) [2023-12-28 04:03:50,828][106226] Updated weights for policy 0, policy_version 1225166 (0.0006) [2023-12-28 04:03:50,855][106225] Updated weights for policy 1, policy_version 1228320 (0.0010) [2023-12-28 04:03:50,892][106226] Updated weights for policy 0, policy_version 1225176 (0.0008) [2023-12-28 04:03:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 628203520. Throughput: 0: 9912.6, 1: 9979.4. Samples: 628210844. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:51,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.991')] [2023-12-28 04:03:51,612][106225] Updated weights for policy 1, policy_version 1228330 (0.0010) [2023-12-28 04:03:51,644][106226] Updated weights for policy 0, policy_version 1225186 (0.0008) [2023-12-28 04:03:51,680][106225] Updated weights for policy 1, policy_version 1228340 (0.0006) [2023-12-28 04:03:51,710][106226] Updated weights for policy 0, policy_version 1225196 (0.0008) [2023-12-28 04:03:51,741][106225] Updated weights for policy 1, policy_version 1228350 (0.0006) [2023-12-28 04:03:51,777][106226] Updated weights for policy 0, policy_version 1225206 (0.0008) [2023-12-28 04:03:51,808][106225] Updated weights for policy 1, policy_version 1228360 (0.0008) [2023-12-28 04:03:52,498][106225] Updated weights for policy 1, policy_version 1228370 (0.0008) [2023-12-28 04:03:52,552][106226] Updated weights for policy 0, policy_version 1225216 (0.0006) [2023-12-28 04:03:52,562][106225] Updated weights for policy 1, policy_version 1228380 (0.0007) [2023-12-28 04:03:52,616][106226] Updated weights for policy 0, policy_version 1225226 (0.0006) [2023-12-28 04:03:52,622][106225] Updated weights for policy 1, policy_version 1228390 (0.0008) [2023-12-28 04:03:52,676][106226] Updated weights for policy 0, policy_version 1225236 (0.0006) [2023-12-28 04:03:53,231][106226] Updated weights for policy 0, policy_version 1225246 (0.0007) [2023-12-28 04:03:53,286][106226] Updated weights for policy 0, policy_version 1225256 (0.0008) [2023-12-28 04:03:53,343][106226] Updated weights for policy 0, policy_version 1225266 (0.0010) [2023-12-28 04:03:53,384][106225] Updated weights for policy 1, policy_version 1228400 (0.0005) [2023-12-28 04:03:53,434][106225] Updated weights for policy 1, policy_version 1228410 (0.0008) [2023-12-28 04:03:53,494][106225] Updated weights for policy 1, policy_version 1228420 (0.0008) [2023-12-28 04:03:54,072][106226] Updated weights for policy 0, policy_version 1225276 (0.0007) [2023-12-28 04:03:54,136][106226] Updated weights for policy 0, policy_version 1225286 (0.0005) [2023-12-28 04:03:54,166][106225] Updated weights for policy 1, policy_version 1228430 (0.0010) [2023-12-28 04:03:54,198][106226] Updated weights for policy 0, policy_version 1225296 (0.0006) [2023-12-28 04:03:54,223][106225] Updated weights for policy 1, policy_version 1228440 (0.0010) [2023-12-28 04:03:54,281][106225] Updated weights for policy 1, policy_version 1228450 (0.0009) [2023-12-28 04:03:54,822][106226] Updated weights for policy 0, policy_version 1225306 (0.0006) [2023-12-28 04:03:54,882][106226] Updated weights for policy 0, policy_version 1225316 (0.0008) [2023-12-28 04:03:54,941][106226] Updated weights for policy 0, policy_version 1225326 (0.0007) [2023-12-28 04:03:54,996][106225] Updated weights for policy 1, policy_version 1228460 (0.0010) [2023-12-28 04:03:55,008][106226] Updated weights for policy 0, policy_version 1225336 (0.0008) [2023-12-28 04:03:55,047][106225] Updated weights for policy 1, policy_version 1228470 (0.0007) [2023-12-28 04:03:55,102][106225] Updated weights for policy 1, policy_version 1228480 (0.0007) [2023-12-28 04:03:55,669][106226] Updated weights for policy 0, policy_version 1225346 (0.0010) [2023-12-28 04:03:55,731][106226] Updated weights for policy 0, policy_version 1225356 (0.0007) [2023-12-28 04:03:55,743][106225] Updated weights for policy 1, policy_version 1228490 (0.0010) [2023-12-28 04:03:55,797][106226] Updated weights for policy 0, policy_version 1225366 (0.0010) [2023-12-28 04:03:55,799][106225] Updated weights for policy 1, policy_version 1228500 (0.0010) [2023-12-28 04:03:55,852][106225] Updated weights for policy 1, policy_version 1228510 (0.0010) [2023-12-28 04:03:55,906][106225] Updated weights for policy 1, policy_version 1228520 (0.0008) [2023-12-28 04:03:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 628301824. Throughput: 0: 9921.5, 1: 9920.6. Samples: 628269340. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:03:56,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-5.299')] [2023-12-28 04:03:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001228520_314548224.pth... [2023-12-28 04:03:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001225368_313753600.pth... [2023-12-28 04:03:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001227336_314245120.pth [2023-12-28 04:03:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001224216_313458688.pth [2023-12-28 04:03:56,393][106226] Updated weights for policy 0, policy_version 1225376 (0.0008) [2023-12-28 04:03:56,443][106226] Updated weights for policy 0, policy_version 1225386 (0.0008) [2023-12-28 04:03:56,510][106226] Updated weights for policy 0, policy_version 1225396 (0.0006) [2023-12-28 04:03:56,553][106225] Updated weights for policy 1, policy_version 1228530 (0.0010) [2023-12-28 04:03:56,611][106225] Updated weights for policy 1, policy_version 1228540 (0.0010) [2023-12-28 04:03:56,663][106225] Updated weights for policy 1, policy_version 1228550 (0.0008) [2023-12-28 04:03:57,245][106226] Updated weights for policy 0, policy_version 1225406 (0.0007) [2023-12-28 04:03:57,301][106226] Updated weights for policy 0, policy_version 1225416 (0.0005) [2023-12-28 04:03:57,366][106226] Updated weights for policy 0, policy_version 1225426 (0.0006) [2023-12-28 04:03:57,382][106225] Updated weights for policy 1, policy_version 1228560 (0.0008) [2023-12-28 04:03:57,436][106225] Updated weights for policy 1, policy_version 1228570 (0.0007) [2023-12-28 04:03:57,488][106225] Updated weights for policy 1, policy_version 1228580 (0.0005) [2023-12-28 04:03:58,065][106225] Updated weights for policy 1, policy_version 1228590 (0.0007) [2023-12-28 04:03:58,085][106226] Updated weights for policy 0, policy_version 1225436 (0.0007) [2023-12-28 04:03:58,118][106225] Updated weights for policy 1, policy_version 1228600 (0.0008) [2023-12-28 04:03:58,132][106226] Updated weights for policy 0, policy_version 1225446 (0.0006) [2023-12-28 04:03:58,160][106225] Updated weights for policy 1, policy_version 1228610 (0.0005) [2023-12-28 04:03:58,179][106226] Updated weights for policy 0, policy_version 1225456 (0.0008) [2023-12-28 04:03:58,946][106225] Updated weights for policy 1, policy_version 1228620 (0.0008) [2023-12-28 04:03:59,009][106226] Updated weights for policy 0, policy_version 1225466 (0.0008) [2023-12-28 04:03:59,013][106225] Updated weights for policy 1, policy_version 1228630 (0.0008) [2023-12-28 04:03:59,072][106226] Updated weights for policy 0, policy_version 1225476 (0.0008) [2023-12-28 04:03:59,079][106225] Updated weights for policy 1, policy_version 1228640 (0.0007) [2023-12-28 04:03:59,142][106226] Updated weights for policy 0, policy_version 1225486 (0.0008) [2023-12-28 04:03:59,205][106226] Updated weights for policy 0, policy_version 1225496 (0.0009) [2023-12-28 04:03:59,800][106225] Updated weights for policy 1, policy_version 1228650 (0.0007) [2023-12-28 04:03:59,864][106225] Updated weights for policy 1, policy_version 1228660 (0.0009) [2023-12-28 04:03:59,890][106226] Updated weights for policy 0, policy_version 1225506 (0.0007) [2023-12-28 04:03:59,925][106225] Updated weights for policy 1, policy_version 1228670 (0.0008) [2023-12-28 04:03:59,954][106226] Updated weights for policy 0, policy_version 1225516 (0.0008) [2023-12-28 04:03:59,982][106225] Updated weights for policy 1, policy_version 1228680 (0.0006) [2023-12-28 04:04:00,016][106226] Updated weights for policy 0, policy_version 1225526 (0.0008) [2023-12-28 04:04:00,584][106225] Updated weights for policy 1, policy_version 1228690 (0.0008) [2023-12-28 04:04:00,638][106225] Updated weights for policy 1, policy_version 1228700 (0.0008) [2023-12-28 04:04:00,682][106225] Updated weights for policy 1, policy_version 1228710 (0.0008) [2023-12-28 04:04:00,791][106226] Updated weights for policy 0, policy_version 1225536 (0.0009) [2023-12-28 04:04:00,843][106226] Updated weights for policy 0, policy_version 1225546 (0.0008) [2023-12-28 04:04:00,895][106226] Updated weights for policy 0, policy_version 1225556 (0.0009) [2023-12-28 04:04:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 628400128. Throughput: 0: 9886.1, 1: 10025.3. Samples: 628388676. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:01,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-5.002')] [2023-12-28 04:04:01,418][106225] Updated weights for policy 1, policy_version 1228720 (0.0008) [2023-12-28 04:04:01,473][106225] Updated weights for policy 1, policy_version 1228730 (0.0010) [2023-12-28 04:04:01,539][106225] Updated weights for policy 1, policy_version 1228740 (0.0008) [2023-12-28 04:04:01,626][106226] Updated weights for policy 0, policy_version 1225566 (0.0009) [2023-12-28 04:04:01,694][106226] Updated weights for policy 0, policy_version 1225576 (0.0009) [2023-12-28 04:04:01,766][106226] Updated weights for policy 0, policy_version 1225586 (0.0010) [2023-12-28 04:04:02,252][106225] Updated weights for policy 1, policy_version 1228750 (0.0009) [2023-12-28 04:04:02,314][106225] Updated weights for policy 1, policy_version 1228760 (0.0008) [2023-12-28 04:04:02,406][106225] Updated weights for policy 1, policy_version 1228770 (0.0009) [2023-12-28 04:04:02,467][106226] Updated weights for policy 0, policy_version 1225596 (0.0007) [2023-12-28 04:04:02,523][106226] Updated weights for policy 0, policy_version 1225606 (0.0009) [2023-12-28 04:04:02,586][106226] Updated weights for policy 0, policy_version 1225616 (0.0007) [2023-12-28 04:04:03,050][106225] Updated weights for policy 1, policy_version 1228780 (0.0009) [2023-12-28 04:04:03,103][106225] Updated weights for policy 1, policy_version 1228790 (0.0008) [2023-12-28 04:04:03,155][106225] Updated weights for policy 1, policy_version 1228800 (0.0009) [2023-12-28 04:04:03,275][106226] Updated weights for policy 0, policy_version 1225626 (0.0009) [2023-12-28 04:04:03,323][106226] Updated weights for policy 0, policy_version 1225636 (0.0008) [2023-12-28 04:04:03,372][106226] Updated weights for policy 0, policy_version 1225646 (0.0009) [2023-12-28 04:04:03,419][106226] Updated weights for policy 0, policy_version 1225656 (0.0008) [2023-12-28 04:04:03,882][106225] Updated weights for policy 1, policy_version 1228810 (0.0008) [2023-12-28 04:04:03,945][106225] Updated weights for policy 1, policy_version 1228820 (0.0009) [2023-12-28 04:04:04,010][106225] Updated weights for policy 1, policy_version 1228830 (0.0008) [2023-12-28 04:04:04,068][106225] Updated weights for policy 1, policy_version 1228840 (0.0008) [2023-12-28 04:04:04,163][106226] Updated weights for policy 0, policy_version 1225666 (0.0008) [2023-12-28 04:04:04,232][106226] Updated weights for policy 0, policy_version 1225676 (0.0007) [2023-12-28 04:04:04,299][106226] Updated weights for policy 0, policy_version 1225686 (0.0008) [2023-12-28 04:04:04,801][106225] Updated weights for policy 1, policy_version 1228850 (0.0008) [2023-12-28 04:04:04,846][106225] Updated weights for policy 1, policy_version 1228860 (0.0008) [2023-12-28 04:04:04,897][106225] Updated weights for policy 1, policy_version 1228870 (0.0009) [2023-12-28 04:04:04,985][106226] Updated weights for policy 0, policy_version 1225696 (0.0009) [2023-12-28 04:04:05,047][106226] Updated weights for policy 0, policy_version 1225706 (0.0009) [2023-12-28 04:04:05,108][106226] Updated weights for policy 0, policy_version 1225716 (0.0008) [2023-12-28 04:04:05,608][106225] Updated weights for policy 1, policy_version 1228880 (0.0007) [2023-12-28 04:04:05,673][106225] Updated weights for policy 1, policy_version 1228890 (0.0010) [2023-12-28 04:04:05,740][106225] Updated weights for policy 1, policy_version 1228900 (0.0005) [2023-12-28 04:04:05,784][106226] Updated weights for policy 0, policy_version 1225726 (0.0006) [2023-12-28 04:04:05,846][106226] Updated weights for policy 0, policy_version 1225736 (0.0009) [2023-12-28 04:04:05,912][106226] Updated weights for policy 0, policy_version 1225746 (0.0010) [2023-12-28 04:04:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 628498432. Throughput: 0: 9844.1, 1: 10074.3. Samples: 628506536. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:06,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-5.003')] [2023-12-28 04:04:06,370][106225] Updated weights for policy 1, policy_version 1228910 (0.0008) [2023-12-28 04:04:06,426][106225] Updated weights for policy 1, policy_version 1228920 (0.0008) [2023-12-28 04:04:06,476][106225] Updated weights for policy 1, policy_version 1228930 (0.0009) [2023-12-28 04:04:06,588][106226] Updated weights for policy 0, policy_version 1225756 (0.0008) [2023-12-28 04:04:06,649][106226] Updated weights for policy 0, policy_version 1225766 (0.0006) [2023-12-28 04:04:06,717][106226] Updated weights for policy 0, policy_version 1225776 (0.0009) [2023-12-28 04:04:07,236][106225] Updated weights for policy 1, policy_version 1228940 (0.0008) [2023-12-28 04:04:07,296][106225] Updated weights for policy 1, policy_version 1228950 (0.0005) [2023-12-28 04:04:07,360][106225] Updated weights for policy 1, policy_version 1228960 (0.0005) [2023-12-28 04:04:07,408][106226] Updated weights for policy 0, policy_version 1225786 (0.0009) [2023-12-28 04:04:07,460][106226] Updated weights for policy 0, policy_version 1225796 (0.0006) [2023-12-28 04:04:07,522][106226] Updated weights for policy 0, policy_version 1225806 (0.0005) [2023-12-28 04:04:07,578][106226] Updated weights for policy 0, policy_version 1225816 (0.0008) [2023-12-28 04:04:08,028][106225] Updated weights for policy 1, policy_version 1228970 (0.0007) [2023-12-28 04:04:08,083][106225] Updated weights for policy 1, policy_version 1228980 (0.0007) [2023-12-28 04:04:08,141][106225] Updated weights for policy 1, policy_version 1228990 (0.0009) [2023-12-28 04:04:08,156][106226] Updated weights for policy 0, policy_version 1225826 (0.0005) [2023-12-28 04:04:08,202][106225] Updated weights for policy 1, policy_version 1229000 (0.0010) [2023-12-28 04:04:08,210][106226] Updated weights for policy 0, policy_version 1225836 (0.0006) [2023-12-28 04:04:08,267][106226] Updated weights for policy 0, policy_version 1225846 (0.0006) [2023-12-28 04:04:08,843][106225] Updated weights for policy 1, policy_version 1229010 (0.0011) [2023-12-28 04:04:08,909][106225] Updated weights for policy 1, policy_version 1229020 (0.0010) [2023-12-28 04:04:08,933][106226] Updated weights for policy 0, policy_version 1225856 (0.0007) [2023-12-28 04:04:08,963][106225] Updated weights for policy 1, policy_version 1229030 (0.0010) [2023-12-28 04:04:08,990][106226] Updated weights for policy 0, policy_version 1225866 (0.0005) [2023-12-28 04:04:09,038][106226] Updated weights for policy 0, policy_version 1225876 (0.0005) [2023-12-28 04:04:09,702][106225] Updated weights for policy 1, policy_version 1229040 (0.0008) [2023-12-28 04:04:09,757][106225] Updated weights for policy 1, policy_version 1229050 (0.0006) [2023-12-28 04:04:09,771][106226] Updated weights for policy 0, policy_version 1225886 (0.0007) [2023-12-28 04:04:09,827][106225] Updated weights for policy 1, policy_version 1229060 (0.0007) [2023-12-28 04:04:09,836][106226] Updated weights for policy 0, policy_version 1225896 (0.0009) [2023-12-28 04:04:09,907][106226] Updated weights for policy 0, policy_version 1225906 (0.0009) [2023-12-28 04:04:10,568][106225] Updated weights for policy 1, policy_version 1229070 (0.0008) [2023-12-28 04:04:10,631][106225] Updated weights for policy 1, policy_version 1229080 (0.0008) [2023-12-28 04:04:10,665][106226] Updated weights for policy 0, policy_version 1225916 (0.0008) [2023-12-28 04:04:10,694][106225] Updated weights for policy 1, policy_version 1229090 (0.0008) [2023-12-28 04:04:10,720][106226] Updated weights for policy 0, policy_version 1225926 (0.0006) [2023-12-28 04:04:10,786][106226] Updated weights for policy 0, policy_version 1225936 (0.0009) [2023-12-28 04:04:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 628596736. Throughput: 0: 9877.1, 1: 10087.0. Samples: 628568948. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:11,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.853')] [2023-12-28 04:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001229096_314695680.pth... [2023-12-28 04:04:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001225944_313901056.pth... [2023-12-28 04:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001227912_314392576.pth [2023-12-28 04:04:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001224792_313606144.pth [2023-12-28 04:04:11,452][106225] Updated weights for policy 1, policy_version 1229100 (0.0008) [2023-12-28 04:04:11,518][106225] Updated weights for policy 1, policy_version 1229110 (0.0008) [2023-12-28 04:04:11,561][106226] Updated weights for policy 0, policy_version 1225946 (0.0008) [2023-12-28 04:04:11,587][106225] Updated weights for policy 1, policy_version 1229120 (0.0008) [2023-12-28 04:04:11,628][106226] Updated weights for policy 0, policy_version 1225956 (0.0007) [2023-12-28 04:04:11,696][106226] Updated weights for policy 0, policy_version 1225966 (0.0008) [2023-12-28 04:04:11,768][106226] Updated weights for policy 0, policy_version 1225976 (0.0009) [2023-12-28 04:04:12,226][106225] Updated weights for policy 1, policy_version 1229130 (0.0008) [2023-12-28 04:04:12,286][106225] Updated weights for policy 1, policy_version 1229140 (0.0009) [2023-12-28 04:04:12,353][106225] Updated weights for policy 1, policy_version 1229150 (0.0008) [2023-12-28 04:04:12,417][106225] Updated weights for policy 1, policy_version 1229160 (0.0007) [2023-12-28 04:04:12,539][106226] Updated weights for policy 0, policy_version 1225986 (0.0009) [2023-12-28 04:04:12,590][106226] Updated weights for policy 0, policy_version 1225996 (0.0008) [2023-12-28 04:04:12,650][106226] Updated weights for policy 0, policy_version 1226006 (0.0006) [2023-12-28 04:04:13,181][106225] Updated weights for policy 1, policy_version 1229170 (0.0008) [2023-12-28 04:04:13,231][106225] Updated weights for policy 1, policy_version 1229180 (0.0008) [2023-12-28 04:04:13,296][106225] Updated weights for policy 1, policy_version 1229190 (0.0008) [2023-12-28 04:04:13,327][106226] Updated weights for policy 0, policy_version 1226016 (0.0006) [2023-12-28 04:04:13,386][106226] Updated weights for policy 0, policy_version 1226026 (0.0005) [2023-12-28 04:04:13,442][106226] Updated weights for policy 0, policy_version 1226036 (0.0005) [2023-12-28 04:04:13,988][106226] Updated weights for policy 0, policy_version 1226046 (0.0007) [2023-12-28 04:04:14,040][106226] Updated weights for policy 0, policy_version 1226056 (0.0006) [2023-12-28 04:04:14,053][106225] Updated weights for policy 1, policy_version 1229200 (0.0009) [2023-12-28 04:04:14,102][106226] Updated weights for policy 0, policy_version 1226066 (0.0007) [2023-12-28 04:04:14,110][106225] Updated weights for policy 1, policy_version 1229210 (0.0007) [2023-12-28 04:04:14,166][106225] Updated weights for policy 1, policy_version 1229220 (0.0005) [2023-12-28 04:04:14,754][106225] Updated weights for policy 1, policy_version 1229230 (0.0005) [2023-12-28 04:04:14,814][106225] Updated weights for policy 1, policy_version 1229240 (0.0007) [2023-12-28 04:04:14,869][106225] Updated weights for policy 1, policy_version 1229250 (0.0006) [2023-12-28 04:04:14,894][106226] Updated weights for policy 0, policy_version 1226076 (0.0007) [2023-12-28 04:04:14,958][106226] Updated weights for policy 0, policy_version 1226086 (0.0008) [2023-12-28 04:04:15,021][106226] Updated weights for policy 0, policy_version 1226096 (0.0009) [2023-12-28 04:04:15,542][106225] Updated weights for policy 1, policy_version 1229260 (0.0009) [2023-12-28 04:04:15,596][106225] Updated weights for policy 1, policy_version 1229270 (0.0006) [2023-12-28 04:04:15,646][106225] Updated weights for policy 1, policy_version 1229280 (0.0009) [2023-12-28 04:04:15,782][106226] Updated weights for policy 0, policy_version 1226106 (0.0009) [2023-12-28 04:04:15,832][106226] Updated weights for policy 0, policy_version 1226116 (0.0008) [2023-12-28 04:04:15,897][106226] Updated weights for policy 0, policy_version 1226126 (0.0009) [2023-12-28 04:04:15,952][106226] Updated weights for policy 0, policy_version 1226136 (0.0008) [2023-12-28 04:04:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 628695040. Throughput: 0: 9845.6, 1: 10006.4. Samples: 628683808. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:16,176][105115] Avg episode reward: [(0, '-4.194'), (1, '-4.859')] [2023-12-28 04:04:16,310][106225] Updated weights for policy 1, policy_version 1229290 (0.0007) [2023-12-28 04:04:16,377][106225] Updated weights for policy 1, policy_version 1229300 (0.0005) [2023-12-28 04:04:16,439][106225] Updated weights for policy 1, policy_version 1229310 (0.0008) [2023-12-28 04:04:16,494][106225] Updated weights for policy 1, policy_version 1229320 (0.0008) [2023-12-28 04:04:16,672][106226] Updated weights for policy 0, policy_version 1226146 (0.0009) [2023-12-28 04:04:16,719][106226] Updated weights for policy 0, policy_version 1226156 (0.0008) [2023-12-28 04:04:16,777][106226] Updated weights for policy 0, policy_version 1226166 (0.0010) [2023-12-28 04:04:17,129][106225] Updated weights for policy 1, policy_version 1229330 (0.0008) [2023-12-28 04:04:17,185][106225] Updated weights for policy 1, policy_version 1229340 (0.0008) [2023-12-28 04:04:17,243][106225] Updated weights for policy 1, policy_version 1229350 (0.0009) [2023-12-28 04:04:17,495][106226] Updated weights for policy 0, policy_version 1226176 (0.0008) [2023-12-28 04:04:17,547][106226] Updated weights for policy 0, policy_version 1226186 (0.0010) [2023-12-28 04:04:17,599][106226] Updated weights for policy 0, policy_version 1226196 (0.0008) [2023-12-28 04:04:17,951][106225] Updated weights for policy 1, policy_version 1229360 (0.0009) [2023-12-28 04:04:18,008][106225] Updated weights for policy 1, policy_version 1229370 (0.0008) [2023-12-28 04:04:18,071][106225] Updated weights for policy 1, policy_version 1229380 (0.0009) [2023-12-28 04:04:18,313][106226] Updated weights for policy 0, policy_version 1226206 (0.0007) [2023-12-28 04:04:18,388][106226] Updated weights for policy 0, policy_version 1226216 (0.0009) [2023-12-28 04:04:18,451][106226] Updated weights for policy 0, policy_version 1226226 (0.0009) [2023-12-28 04:04:18,818][106225] Updated weights for policy 1, policy_version 1229390 (0.0007) [2023-12-28 04:04:18,881][106225] Updated weights for policy 1, policy_version 1229400 (0.0006) [2023-12-28 04:04:18,948][106225] Updated weights for policy 1, policy_version 1229410 (0.0006) [2023-12-28 04:04:19,197][106226] Updated weights for policy 0, policy_version 1226236 (0.0009) [2023-12-28 04:04:19,264][106226] Updated weights for policy 0, policy_version 1226246 (0.0009) [2023-12-28 04:04:19,333][106226] Updated weights for policy 0, policy_version 1226256 (0.0009) [2023-12-28 04:04:19,534][106225] Updated weights for policy 1, policy_version 1229420 (0.0006) [2023-12-28 04:04:19,599][106225] Updated weights for policy 1, policy_version 1229430 (0.0006) [2023-12-28 04:04:19,662][106225] Updated weights for policy 1, policy_version 1229440 (0.0006) [2023-12-28 04:04:20,101][106226] Updated weights for policy 0, policy_version 1226266 (0.0007) [2023-12-28 04:04:20,164][106226] Updated weights for policy 0, policy_version 1226276 (0.0008) [2023-12-28 04:04:20,225][106226] Updated weights for policy 0, policy_version 1226286 (0.0009) [2023-12-28 04:04:20,288][106226] Updated weights for policy 0, policy_version 1226296 (0.0008) [2023-12-28 04:04:20,382][106225] Updated weights for policy 1, policy_version 1229450 (0.0008) [2023-12-28 04:04:20,436][106225] Updated weights for policy 1, policy_version 1229460 (0.0006) [2023-12-28 04:04:20,495][106225] Updated weights for policy 1, policy_version 1229470 (0.0008) [2023-12-28 04:04:20,561][106225] Updated weights for policy 1, policy_version 1229480 (0.0009) [2023-12-28 04:04:20,979][106226] Updated weights for policy 0, policy_version 1226306 (0.0008) [2023-12-28 04:04:21,048][106226] Updated weights for policy 0, policy_version 1226316 (0.0008) [2023-12-28 04:04:21,121][106226] Updated weights for policy 0, policy_version 1226326 (0.0010) [2023-12-28 04:04:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 628793344. Throughput: 0: 9787.1, 1: 10011.9. Samples: 628801236. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:21,175][105115] Avg episode reward: [(0, '-4.212'), (1, '-4.701')] [2023-12-28 04:04:21,252][106225] Updated weights for policy 1, policy_version 1229490 (0.0010) [2023-12-28 04:04:21,319][106225] Updated weights for policy 1, policy_version 1229500 (0.0008) [2023-12-28 04:04:21,385][106225] Updated weights for policy 1, policy_version 1229510 (0.0008) [2023-12-28 04:04:21,892][106226] Updated weights for policy 0, policy_version 1226336 (0.0007) [2023-12-28 04:04:21,954][106226] Updated weights for policy 0, policy_version 1226346 (0.0009) [2023-12-28 04:04:22,004][106226] Updated weights for policy 0, policy_version 1226356 (0.0010) [2023-12-28 04:04:22,109][106225] Updated weights for policy 1, policy_version 1229520 (0.0010) [2023-12-28 04:04:22,166][106225] Updated weights for policy 1, policy_version 1229530 (0.0009) [2023-12-28 04:04:22,220][106225] Updated weights for policy 1, policy_version 1229540 (0.0005) [2023-12-28 04:04:22,784][106226] Updated weights for policy 0, policy_version 1226366 (0.0006) [2023-12-28 04:04:22,845][106226] Updated weights for policy 0, policy_version 1226376 (0.0006) [2023-12-28 04:04:22,906][106226] Updated weights for policy 0, policy_version 1226386 (0.0005) [2023-12-28 04:04:22,987][106225] Updated weights for policy 1, policy_version 1229550 (0.0006) [2023-12-28 04:04:23,052][106225] Updated weights for policy 1, policy_version 1229560 (0.0005) [2023-12-28 04:04:23,114][106225] Updated weights for policy 1, policy_version 1229570 (0.0006) [2023-12-28 04:04:23,622][106226] Updated weights for policy 0, policy_version 1226396 (0.0007) [2023-12-28 04:04:23,680][106226] Updated weights for policy 0, policy_version 1226406 (0.0008) [2023-12-28 04:04:23,699][106225] Updated weights for policy 1, policy_version 1229580 (0.0009) [2023-12-28 04:04:23,739][106226] Updated weights for policy 0, policy_version 1226416 (0.0006) [2023-12-28 04:04:23,759][106225] Updated weights for policy 1, policy_version 1229590 (0.0010) [2023-12-28 04:04:23,820][106225] Updated weights for policy 1, policy_version 1229600 (0.0010) [2023-12-28 04:04:24,453][106226] Updated weights for policy 0, policy_version 1226426 (0.0006) [2023-12-28 04:04:24,462][106225] Updated weights for policy 1, policy_version 1229610 (0.0010) [2023-12-28 04:04:24,508][106226] Updated weights for policy 0, policy_version 1226436 (0.0007) [2023-12-28 04:04:24,510][106225] Updated weights for policy 1, policy_version 1229620 (0.0010) [2023-12-28 04:04:24,561][106225] Updated weights for policy 1, policy_version 1229630 (0.0010) [2023-12-28 04:04:24,565][106226] Updated weights for policy 0, policy_version 1226446 (0.0006) [2023-12-28 04:04:24,615][106225] Updated weights for policy 1, policy_version 1229640 (0.0010) [2023-12-28 04:04:24,634][106226] Updated weights for policy 0, policy_version 1226456 (0.0005) [2023-12-28 04:04:25,300][106226] Updated weights for policy 0, policy_version 1226466 (0.0007) [2023-12-28 04:04:25,328][106225] Updated weights for policy 1, policy_version 1229650 (0.0010) [2023-12-28 04:04:25,361][106226] Updated weights for policy 0, policy_version 1226476 (0.0005) [2023-12-28 04:04:25,378][106225] Updated weights for policy 1, policy_version 1229660 (0.0010) [2023-12-28 04:04:25,418][106226] Updated weights for policy 0, policy_version 1226486 (0.0005) [2023-12-28 04:04:25,431][106225] Updated weights for policy 1, policy_version 1229670 (0.0010) [2023-12-28 04:04:26,154][106225] Updated weights for policy 1, policy_version 1229680 (0.0010) [2023-12-28 04:04:26,155][106226] Updated weights for policy 0, policy_version 1226496 (0.0008) [2023-12-28 04:04:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 628883456. Throughput: 0: 9748.4, 1: 10000.8. Samples: 628860252. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:26,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-5.100')] [2023-12-28 04:04:26,209][106225] Updated weights for policy 1, policy_version 1229690 (0.0008) [2023-12-28 04:04:26,215][106226] Updated weights for policy 0, policy_version 1226506 (0.0007) [2023-12-28 04:04:26,260][106225] Updated weights for policy 1, policy_version 1229700 (0.0010) [2023-12-28 04:04:26,274][106226] Updated weights for policy 0, policy_version 1226516 (0.0005) [2023-12-28 04:04:26,279][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001229704_314851328.pth... [2023-12-28 04:04:26,283][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001228520_314548224.pth [2023-12-28 04:04:26,295][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001226520_314048512.pth... [2023-12-28 04:04:26,299][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001225368_313753600.pth [2023-12-28 04:04:26,910][106226] Updated weights for policy 0, policy_version 1226526 (0.0007) [2023-12-28 04:04:26,964][106226] Updated weights for policy 0, policy_version 1226536 (0.0007) [2023-12-28 04:04:26,977][106225] Updated weights for policy 1, policy_version 1229710 (0.0010) [2023-12-28 04:04:27,016][106226] Updated weights for policy 0, policy_version 1226546 (0.0009) [2023-12-28 04:04:27,030][106225] Updated weights for policy 1, policy_version 1229720 (0.0010) [2023-12-28 04:04:27,091][106225] Updated weights for policy 1, policy_version 1229730 (0.0010) [2023-12-28 04:04:27,593][106226] Updated weights for policy 0, policy_version 1226556 (0.0006) [2023-12-28 04:04:27,656][106226] Updated weights for policy 0, policy_version 1226566 (0.0008) [2023-12-28 04:04:27,718][106226] Updated weights for policy 0, policy_version 1226576 (0.0009) [2023-12-28 04:04:27,778][106225] Updated weights for policy 1, policy_version 1229740 (0.0010) [2023-12-28 04:04:27,828][106225] Updated weights for policy 1, policy_version 1229750 (0.0007) [2023-12-28 04:04:27,888][106225] Updated weights for policy 1, policy_version 1229760 (0.0006) [2023-12-28 04:04:28,399][106226] Updated weights for policy 0, policy_version 1226586 (0.0006) [2023-12-28 04:04:28,460][106226] Updated weights for policy 0, policy_version 1226596 (0.0009) [2023-12-28 04:04:28,467][106225] Updated weights for policy 1, policy_version 1229770 (0.0006) [2023-12-28 04:04:28,519][106226] Updated weights for policy 0, policy_version 1226606 (0.0007) [2023-12-28 04:04:28,530][106225] Updated weights for policy 1, policy_version 1229780 (0.0007) [2023-12-28 04:04:28,586][106226] Updated weights for policy 0, policy_version 1226616 (0.0010) [2023-12-28 04:04:28,593][106225] Updated weights for policy 1, policy_version 1229790 (0.0007) [2023-12-28 04:04:28,653][106225] Updated weights for policy 1, policy_version 1229800 (0.0008) [2023-12-28 04:04:29,198][106226] Updated weights for policy 0, policy_version 1226626 (0.0008) [2023-12-28 04:04:29,266][106226] Updated weights for policy 0, policy_version 1226636 (0.0008) [2023-12-28 04:04:29,330][106226] Updated weights for policy 0, policy_version 1226646 (0.0005) [2023-12-28 04:04:29,450][106225] Updated weights for policy 1, policy_version 1229810 (0.0009) [2023-12-28 04:04:29,509][106225] Updated weights for policy 1, policy_version 1229820 (0.0010) [2023-12-28 04:04:29,572][106225] Updated weights for policy 1, policy_version 1229830 (0.0010) [2023-12-28 04:04:30,032][106226] Updated weights for policy 0, policy_version 1226656 (0.0009) [2023-12-28 04:04:30,086][106226] Updated weights for policy 0, policy_version 1226667 (0.0010) [2023-12-28 04:04:30,150][106226] Updated weights for policy 0, policy_version 1226677 (0.0011) [2023-12-28 04:04:30,214][106225] Updated weights for policy 1, policy_version 1229840 (0.0008) [2023-12-28 04:04:30,279][106225] Updated weights for policy 1, policy_version 1229850 (0.0005) [2023-12-28 04:04:30,344][106225] Updated weights for policy 1, policy_version 1229860 (0.0006) [2023-12-28 04:04:30,864][106226] Updated weights for policy 0, policy_version 1226687 (0.0008) [2023-12-28 04:04:30,920][106226] Updated weights for policy 0, policy_version 1226697 (0.0010) [2023-12-28 04:04:30,975][106226] Updated weights for policy 0, policy_version 1226707 (0.0010) [2023-12-28 04:04:31,001][106225] Updated weights for policy 1, policy_version 1229870 (0.0010) [2023-12-28 04:04:31,064][106225] Updated weights for policy 1, policy_version 1229880 (0.0010) [2023-12-28 04:04:31,121][106225] Updated weights for policy 1, policy_version 1229890 (0.0010) [2023-12-28 04:04:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 628998144. Throughput: 0: 9794.1, 1: 9973.5. Samples: 628981224. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:31,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.688')] [2023-12-28 04:04:31,678][106226] Updated weights for policy 0, policy_version 1226717 (0.0009) [2023-12-28 04:04:31,739][106226] Updated weights for policy 0, policy_version 1226727 (0.0007) [2023-12-28 04:04:31,802][106226] Updated weights for policy 0, policy_version 1226737 (0.0008) [2023-12-28 04:04:31,854][106225] Updated weights for policy 1, policy_version 1229900 (0.0010) [2023-12-28 04:04:31,917][106225] Updated weights for policy 1, policy_version 1229910 (0.0010) [2023-12-28 04:04:31,971][106225] Updated weights for policy 1, policy_version 1229920 (0.0009) [2023-12-28 04:04:32,556][106226] Updated weights for policy 0, policy_version 1226747 (0.0008) [2023-12-28 04:04:32,606][106226] Updated weights for policy 0, policy_version 1226757 (0.0008) [2023-12-28 04:04:32,659][106226] Updated weights for policy 0, policy_version 1226767 (0.0010) [2023-12-28 04:04:32,666][106225] Updated weights for policy 1, policy_version 1229930 (0.0005) [2023-12-28 04:04:32,720][106225] Updated weights for policy 1, policy_version 1229940 (0.0006) [2023-12-28 04:04:32,775][106225] Updated weights for policy 1, policy_version 1229950 (0.0006) [2023-12-28 04:04:32,830][106225] Updated weights for policy 1, policy_version 1229960 (0.0005) [2023-12-28 04:04:33,387][106225] Updated weights for policy 1, policy_version 1229970 (0.0009) [2023-12-28 04:04:33,448][106225] Updated weights for policy 1, policy_version 1229980 (0.0008) [2023-12-28 04:04:33,489][106226] Updated weights for policy 0, policy_version 1226777 (0.0008) [2023-12-28 04:04:33,505][106225] Updated weights for policy 1, policy_version 1229990 (0.0009) [2023-12-28 04:04:33,552][106226] Updated weights for policy 0, policy_version 1226787 (0.0008) [2023-12-28 04:04:33,612][106226] Updated weights for policy 0, policy_version 1226797 (0.0009) [2023-12-28 04:04:33,662][106226] Updated weights for policy 0, policy_version 1226808 (0.0010) [2023-12-28 04:04:34,214][106225] Updated weights for policy 1, policy_version 1230000 (0.0008) [2023-12-28 04:04:34,280][106225] Updated weights for policy 1, policy_version 1230010 (0.0008) [2023-12-28 04:04:34,336][106225] Updated weights for policy 1, policy_version 1230020 (0.0008) [2023-12-28 04:04:34,351][106226] Updated weights for policy 0, policy_version 1226818 (0.0008) [2023-12-28 04:04:34,413][106226] Updated weights for policy 0, policy_version 1226828 (0.0007) [2023-12-28 04:04:34,481][106226] Updated weights for policy 0, policy_version 1226838 (0.0008) [2023-12-28 04:04:35,026][106225] Updated weights for policy 1, policy_version 1230030 (0.0008) [2023-12-28 04:04:35,090][106225] Updated weights for policy 1, policy_version 1230040 (0.0007) [2023-12-28 04:04:35,151][106225] Updated weights for policy 1, policy_version 1230050 (0.0009) [2023-12-28 04:04:35,168][106226] Updated weights for policy 0, policy_version 1226848 (0.0007) [2023-12-28 04:04:35,231][106226] Updated weights for policy 0, policy_version 1226858 (0.0011) [2023-12-28 04:04:35,294][106226] Updated weights for policy 0, policy_version 1226868 (0.0010) [2023-12-28 04:04:35,771][106225] Updated weights for policy 1, policy_version 1230060 (0.0007) [2023-12-28 04:04:35,823][106225] Updated weights for policy 1, policy_version 1230070 (0.0008) [2023-12-28 04:04:35,848][106226] Updated weights for policy 0, policy_version 1226878 (0.0008) [2023-12-28 04:04:35,869][106225] Updated weights for policy 1, policy_version 1230080 (0.0009) [2023-12-28 04:04:35,905][106226] Updated weights for policy 0, policy_version 1226888 (0.0006) [2023-12-28 04:04:35,967][106226] Updated weights for policy 0, policy_version 1226898 (0.0009) [2023-12-28 04:04:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 629096448. Throughput: 0: 9819.7, 1: 9995.9. Samples: 629102544. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:36,175][105115] Avg episode reward: [(0, '-4.155'), (1, '-5.047')] [2023-12-28 04:04:36,593][106225] Updated weights for policy 1, policy_version 1230090 (0.0006) [2023-12-28 04:04:36,608][106226] Updated weights for policy 0, policy_version 1226908 (0.0009) [2023-12-28 04:04:36,661][106225] Updated weights for policy 1, policy_version 1230100 (0.0008) [2023-12-28 04:04:36,670][106226] Updated weights for policy 0, policy_version 1226918 (0.0008) [2023-12-28 04:04:36,731][106225] Updated weights for policy 1, policy_version 1230110 (0.0008) [2023-12-28 04:04:36,734][106226] Updated weights for policy 0, policy_version 1226928 (0.0008) [2023-12-28 04:04:36,798][106225] Updated weights for policy 1, policy_version 1230120 (0.0009) [2023-12-28 04:04:37,348][106225] Updated weights for policy 1, policy_version 1230130 (0.0007) [2023-12-28 04:04:37,399][106225] Updated weights for policy 1, policy_version 1230140 (0.0005) [2023-12-28 04:04:37,454][106225] Updated weights for policy 1, policy_version 1230150 (0.0006) [2023-12-28 04:04:37,537][106226] Updated weights for policy 0, policy_version 1226938 (0.0009) [2023-12-28 04:04:37,594][106226] Updated weights for policy 0, policy_version 1226948 (0.0009) [2023-12-28 04:04:37,655][106226] Updated weights for policy 0, policy_version 1226958 (0.0008) [2023-12-28 04:04:37,714][106226] Updated weights for policy 0, policy_version 1226968 (0.0006) [2023-12-28 04:04:38,175][106225] Updated weights for policy 1, policy_version 1230160 (0.0008) [2023-12-28 04:04:38,227][106225] Updated weights for policy 1, policy_version 1230170 (0.0007) [2023-12-28 04:04:38,294][106225] Updated weights for policy 1, policy_version 1230180 (0.0005) [2023-12-28 04:04:38,380][106226] Updated weights for policy 0, policy_version 1226978 (0.0008) [2023-12-28 04:04:38,437][106226] Updated weights for policy 0, policy_version 1226988 (0.0009) [2023-12-28 04:04:38,507][106226] Updated weights for policy 0, policy_version 1226998 (0.0009) [2023-12-28 04:04:38,928][106225] Updated weights for policy 1, policy_version 1230190 (0.0006) [2023-12-28 04:04:38,985][106225] Updated weights for policy 1, policy_version 1230200 (0.0006) [2023-12-28 04:04:39,035][106225] Updated weights for policy 1, policy_version 1230210 (0.0008) [2023-12-28 04:04:39,311][106226] Updated weights for policy 0, policy_version 1227008 (0.0007) [2023-12-28 04:04:39,375][106226] Updated weights for policy 0, policy_version 1227018 (0.0008) [2023-12-28 04:04:39,441][106226] Updated weights for policy 0, policy_version 1227028 (0.0008) [2023-12-28 04:04:39,808][106225] Updated weights for policy 1, policy_version 1230220 (0.0008) [2023-12-28 04:04:39,877][106225] Updated weights for policy 1, policy_version 1230230 (0.0009) [2023-12-28 04:04:39,939][106225] Updated weights for policy 1, policy_version 1230240 (0.0010) [2023-12-28 04:04:40,176][106226] Updated weights for policy 0, policy_version 1227038 (0.0008) [2023-12-28 04:04:40,234][106226] Updated weights for policy 0, policy_version 1227048 (0.0009) [2023-12-28 04:04:40,296][106226] Updated weights for policy 0, policy_version 1227058 (0.0010) [2023-12-28 04:04:40,566][106225] Updated weights for policy 1, policy_version 1230250 (0.0009) [2023-12-28 04:04:40,620][106225] Updated weights for policy 1, policy_version 1230260 (0.0005) [2023-12-28 04:04:40,675][106225] Updated weights for policy 1, policy_version 1230270 (0.0005) [2023-12-28 04:04:40,737][106225] Updated weights for policy 1, policy_version 1230280 (0.0006) [2023-12-28 04:04:41,120][106226] Updated weights for policy 0, policy_version 1227068 (0.0009) [2023-12-28 04:04:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 629186560. Throughput: 0: 9784.8, 1: 10046.9. Samples: 629161764. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:41,175][105115] Avg episode reward: [(0, '-4.235'), (1, '-5.218')] [2023-12-28 04:04:41,176][106226] Updated weights for policy 0, policy_version 1227078 (0.0008) [2023-12-28 04:04:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001230280_314998784.pth... [2023-12-28 04:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001229096_314695680.pth [2023-12-28 04:04:41,223][106226] Updated weights for policy 0, policy_version 1227088 (0.0008) [2023-12-28 04:04:41,274][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001227096_314195968.pth... [2023-12-28 04:04:41,278][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001225944_313901056.pth [2023-12-28 04:04:41,400][106225] Updated weights for policy 1, policy_version 1230290 (0.0009) [2023-12-28 04:04:41,466][106225] Updated weights for policy 1, policy_version 1230300 (0.0008) [2023-12-28 04:04:41,525][106225] Updated weights for policy 1, policy_version 1230310 (0.0008) [2023-12-28 04:04:42,057][106226] Updated weights for policy 0, policy_version 1227098 (0.0008) [2023-12-28 04:04:42,122][106226] Updated weights for policy 0, policy_version 1227108 (0.0011) [2023-12-28 04:04:42,183][106226] Updated weights for policy 0, policy_version 1227118 (0.0011) [2023-12-28 04:04:42,243][106226] Updated weights for policy 0, policy_version 1227128 (0.0009) [2023-12-28 04:04:42,282][106225] Updated weights for policy 1, policy_version 1230320 (0.0008) [2023-12-28 04:04:42,339][106225] Updated weights for policy 1, policy_version 1230330 (0.0009) [2023-12-28 04:04:42,399][106225] Updated weights for policy 1, policy_version 1230340 (0.0009) [2023-12-28 04:04:42,947][106226] Updated weights for policy 0, policy_version 1227138 (0.0008) [2023-12-28 04:04:42,994][106226] Updated weights for policy 0, policy_version 1227148 (0.0006) [2023-12-28 04:04:43,047][106226] Updated weights for policy 0, policy_version 1227158 (0.0006) [2023-12-28 04:04:43,067][106225] Updated weights for policy 1, policy_version 1230350 (0.0007) [2023-12-28 04:04:43,134][106225] Updated weights for policy 1, policy_version 1230360 (0.0008) [2023-12-28 04:04:43,187][106225] Updated weights for policy 1, policy_version 1230370 (0.0008) [2023-12-28 04:04:43,641][106226] Updated weights for policy 0, policy_version 1227168 (0.0006) [2023-12-28 04:04:43,708][106226] Updated weights for policy 0, policy_version 1227178 (0.0009) [2023-12-28 04:04:43,765][106226] Updated weights for policy 0, policy_version 1227188 (0.0006) [2023-12-28 04:04:43,794][106225] Updated weights for policy 1, policy_version 1230380 (0.0007) [2023-12-28 04:04:43,847][106225] Updated weights for policy 1, policy_version 1230390 (0.0005) [2023-12-28 04:04:43,897][106225] Updated weights for policy 1, policy_version 1230400 (0.0009) [2023-12-28 04:04:44,384][106226] Updated weights for policy 0, policy_version 1227198 (0.0009) [2023-12-28 04:04:44,445][106226] Updated weights for policy 0, policy_version 1227208 (0.0011) [2023-12-28 04:04:44,510][106226] Updated weights for policy 0, policy_version 1227218 (0.0010) [2023-12-28 04:04:44,626][106225] Updated weights for policy 1, policy_version 1230411 (0.0008) [2023-12-28 04:04:44,677][106225] Updated weights for policy 1, policy_version 1230421 (0.0008) [2023-12-28 04:04:44,720][106225] Updated weights for policy 1, policy_version 1230431 (0.0008) [2023-12-28 04:04:45,196][106226] Updated weights for policy 0, policy_version 1227228 (0.0011) [2023-12-28 04:04:45,254][106226] Updated weights for policy 0, policy_version 1227238 (0.0011) [2023-12-28 04:04:45,318][106226] Updated weights for policy 0, policy_version 1227248 (0.0011) [2023-12-28 04:04:45,483][106225] Updated weights for policy 1, policy_version 1230441 (0.0008) [2023-12-28 04:04:45,550][106225] Updated weights for policy 1, policy_version 1230451 (0.0008) [2023-12-28 04:04:45,592][106225] Updated weights for policy 1, policy_version 1230461 (0.0007) [2023-12-28 04:04:45,649][106225] Updated weights for policy 1, policy_version 1230471 (0.0008) [2023-12-28 04:04:46,021][106226] Updated weights for policy 0, policy_version 1227258 (0.0011) [2023-12-28 04:04:46,067][106226] Updated weights for policy 0, policy_version 1227268 (0.0010) [2023-12-28 04:04:46,117][106226] Updated weights for policy 0, policy_version 1227278 (0.0010) [2023-12-28 04:04:46,164][106226] Updated weights for policy 0, policy_version 1227288 (0.0010) [2023-12-28 04:04:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 629293056. Throughput: 0: 9767.0, 1: 10042.1. Samples: 629280088. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:46,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-5.000')] [2023-12-28 04:04:46,323][106225] Updated weights for policy 1, policy_version 1230481 (0.0010) [2023-12-28 04:04:46,383][106225] Updated weights for policy 1, policy_version 1230491 (0.0010) [2023-12-28 04:04:46,432][106225] Updated weights for policy 1, policy_version 1230501 (0.0010) [2023-12-28 04:04:46,876][106226] Updated weights for policy 0, policy_version 1227298 (0.0011) [2023-12-28 04:04:46,932][106226] Updated weights for policy 0, policy_version 1227308 (0.0010) [2023-12-28 04:04:47,001][106226] Updated weights for policy 0, policy_version 1227318 (0.0011) [2023-12-28 04:04:47,087][106225] Updated weights for policy 1, policy_version 1230511 (0.0008) [2023-12-28 04:04:47,139][106225] Updated weights for policy 1, policy_version 1230521 (0.0006) [2023-12-28 04:04:47,197][106225] Updated weights for policy 1, policy_version 1230531 (0.0005) [2023-12-28 04:04:47,665][106226] Updated weights for policy 0, policy_version 1227328 (0.0011) [2023-12-28 04:04:47,721][106226] Updated weights for policy 0, policy_version 1227338 (0.0010) [2023-12-28 04:04:47,787][106226] Updated weights for policy 0, policy_version 1227348 (0.0011) [2023-12-28 04:04:47,810][106225] Updated weights for policy 1, policy_version 1230541 (0.0007) [2023-12-28 04:04:47,857][106225] Updated weights for policy 1, policy_version 1230551 (0.0008) [2023-12-28 04:04:47,910][106225] Updated weights for policy 1, policy_version 1230561 (0.0008) [2023-12-28 04:04:48,466][106226] Updated weights for policy 0, policy_version 1227358 (0.0009) [2023-12-28 04:04:48,526][106226] Updated weights for policy 0, policy_version 1227368 (0.0009) [2023-12-28 04:04:48,589][106226] Updated weights for policy 0, policy_version 1227378 (0.0009) [2023-12-28 04:04:48,687][106225] Updated weights for policy 1, policy_version 1230571 (0.0008) [2023-12-28 04:04:48,747][106225] Updated weights for policy 1, policy_version 1230581 (0.0009) [2023-12-28 04:04:48,799][106225] Updated weights for policy 1, policy_version 1230591 (0.0008) [2023-12-28 04:04:49,259][106226] Updated weights for policy 0, policy_version 1227388 (0.0008) [2023-12-28 04:04:49,317][106226] Updated weights for policy 0, policy_version 1227398 (0.0007) [2023-12-28 04:04:49,390][106226] Updated weights for policy 0, policy_version 1227408 (0.0008) [2023-12-28 04:04:49,548][106225] Updated weights for policy 1, policy_version 1230601 (0.0009) [2023-12-28 04:04:49,614][106225] Updated weights for policy 1, policy_version 1230611 (0.0011) [2023-12-28 04:04:49,672][106225] Updated weights for policy 1, policy_version 1230621 (0.0010) [2023-12-28 04:04:49,731][106225] Updated weights for policy 1, policy_version 1230631 (0.0011) [2023-12-28 04:04:50,149][106226] Updated weights for policy 0, policy_version 1227418 (0.0007) [2023-12-28 04:04:50,207][106226] Updated weights for policy 0, policy_version 1227428 (0.0006) [2023-12-28 04:04:50,268][106226] Updated weights for policy 0, policy_version 1227438 (0.0007) [2023-12-28 04:04:50,327][106226] Updated weights for policy 0, policy_version 1227448 (0.0006) [2023-12-28 04:04:50,435][106225] Updated weights for policy 1, policy_version 1230641 (0.0010) [2023-12-28 04:04:50,495][106225] Updated weights for policy 1, policy_version 1230651 (0.0010) [2023-12-28 04:04:50,555][106225] Updated weights for policy 1, policy_version 1230661 (0.0010) [2023-12-28 04:04:51,037][106226] Updated weights for policy 0, policy_version 1227458 (0.0010) [2023-12-28 04:04:51,103][106226] Updated weights for policy 0, policy_version 1227468 (0.0010) [2023-12-28 04:04:51,167][106226] Updated weights for policy 0, policy_version 1227478 (0.0009) [2023-12-28 04:04:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 629383168. Throughput: 0: 9778.7, 1: 10043.7. Samples: 629398540. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:51,175][105115] Avg episode reward: [(0, '-4.316'), (1, '-5.084')] [2023-12-28 04:04:51,284][106225] Updated weights for policy 1, policy_version 1230671 (0.0009) [2023-12-28 04:04:51,339][106225] Updated weights for policy 1, policy_version 1230681 (0.0008) [2023-12-28 04:04:51,408][106225] Updated weights for policy 1, policy_version 1230691 (0.0009) [2023-12-28 04:04:51,991][106226] Updated weights for policy 0, policy_version 1227488 (0.0008) [2023-12-28 04:04:52,048][106226] Updated weights for policy 0, policy_version 1227498 (0.0011) [2023-12-28 04:04:52,114][106226] Updated weights for policy 0, policy_version 1227508 (0.0006) [2023-12-28 04:04:52,203][106225] Updated weights for policy 1, policy_version 1230701 (0.0010) [2023-12-28 04:04:52,278][106225] Updated weights for policy 1, policy_version 1230711 (0.0009) [2023-12-28 04:04:52,332][106225] Updated weights for policy 1, policy_version 1230721 (0.0008) [2023-12-28 04:04:52,822][106226] Updated weights for policy 0, policy_version 1227518 (0.0011) [2023-12-28 04:04:52,885][106226] Updated weights for policy 0, policy_version 1227528 (0.0010) [2023-12-28 04:04:52,946][106226] Updated weights for policy 0, policy_version 1227538 (0.0011) [2023-12-28 04:04:53,036][106225] Updated weights for policy 1, policy_version 1230731 (0.0007) [2023-12-28 04:04:53,084][106225] Updated weights for policy 1, policy_version 1230741 (0.0007) [2023-12-28 04:04:53,137][106225] Updated weights for policy 1, policy_version 1230751 (0.0007) [2023-12-28 04:04:53,643][106226] Updated weights for policy 0, policy_version 1227548 (0.0008) [2023-12-28 04:04:53,690][106226] Updated weights for policy 0, policy_version 1227558 (0.0005) [2023-12-28 04:04:53,716][106225] Updated weights for policy 1, policy_version 1230761 (0.0005) [2023-12-28 04:04:53,738][106226] Updated weights for policy 0, policy_version 1227568 (0.0006) [2023-12-28 04:04:53,770][106225] Updated weights for policy 1, policy_version 1230771 (0.0005) [2023-12-28 04:04:53,822][106225] Updated weights for policy 1, policy_version 1230781 (0.0005) [2023-12-28 04:04:53,892][106225] Updated weights for policy 1, policy_version 1230791 (0.0006) [2023-12-28 04:04:54,363][106226] Updated weights for policy 0, policy_version 1227578 (0.0011) [2023-12-28 04:04:54,414][106225] Updated weights for policy 1, policy_version 1230801 (0.0010) [2023-12-28 04:04:54,414][106226] Updated weights for policy 0, policy_version 1227588 (0.0010) [2023-12-28 04:04:54,462][106226] Updated weights for policy 0, policy_version 1227598 (0.0010) [2023-12-28 04:04:54,464][106225] Updated weights for policy 1, policy_version 1230811 (0.0010) [2023-12-28 04:04:54,511][106226] Updated weights for policy 0, policy_version 1227608 (0.0010) [2023-12-28 04:04:54,514][106225] Updated weights for policy 1, policy_version 1230821 (0.0010) [2023-12-28 04:04:55,179][106226] Updated weights for policy 0, policy_version 1227618 (0.0006) [2023-12-28 04:04:55,181][106225] Updated weights for policy 1, policy_version 1230831 (0.0010) [2023-12-28 04:04:55,238][106225] Updated weights for policy 1, policy_version 1230841 (0.0010) [2023-12-28 04:04:55,242][106226] Updated weights for policy 0, policy_version 1227628 (0.0008) [2023-12-28 04:04:55,297][106225] Updated weights for policy 1, policy_version 1230851 (0.0010) [2023-12-28 04:04:55,298][106226] Updated weights for policy 0, policy_version 1227638 (0.0010) [2023-12-28 04:04:55,861][106226] Updated weights for policy 0, policy_version 1227648 (0.0009) [2023-12-28 04:04:55,911][106226] Updated weights for policy 0, policy_version 1227658 (0.0010) [2023-12-28 04:04:55,958][106225] Updated weights for policy 1, policy_version 1230861 (0.0008) [2023-12-28 04:04:55,960][106226] Updated weights for policy 0, policy_version 1227668 (0.0010) [2023-12-28 04:04:56,027][106225] Updated weights for policy 1, policy_version 1230871 (0.0007) [2023-12-28 04:04:56,080][106225] Updated weights for policy 1, policy_version 1230881 (0.0008) [2023-12-28 04:04:56,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 629497856. Throughput: 0: 9718.6, 1: 10027.7. Samples: 629457536. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:04:56,176][105115] Avg episode reward: [(0, '-4.536'), (1, '-4.847')] [2023-12-28 04:04:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001227672_314343424.pth... [2023-12-28 04:04:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001230888_315154432.pth... [2023-12-28 04:04:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001226520_314048512.pth [2023-12-28 04:04:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001229704_314851328.pth [2023-12-28 04:04:56,676][106226] Updated weights for policy 0, policy_version 1227678 (0.0010) [2023-12-28 04:04:56,722][106226] Updated weights for policy 0, policy_version 1227688 (0.0010) [2023-12-28 04:04:56,768][106226] Updated weights for policy 0, policy_version 1227698 (0.0010) [2023-12-28 04:04:56,793][106225] Updated weights for policy 1, policy_version 1230891 (0.0007) [2023-12-28 04:04:56,838][106225] Updated weights for policy 1, policy_version 1230901 (0.0008) [2023-12-28 04:04:56,892][106225] Updated weights for policy 1, policy_version 1230911 (0.0008) [2023-12-28 04:04:57,519][106226] Updated weights for policy 0, policy_version 1227708 (0.0009) [2023-12-28 04:04:57,575][106226] Updated weights for policy 0, policy_version 1227718 (0.0009) [2023-12-28 04:04:57,623][106225] Updated weights for policy 1, policy_version 1230921 (0.0008) [2023-12-28 04:04:57,629][106226] Updated weights for policy 0, policy_version 1227728 (0.0007) [2023-12-28 04:04:57,673][106225] Updated weights for policy 1, policy_version 1230931 (0.0006) [2023-12-28 04:04:57,727][106225] Updated weights for policy 1, policy_version 1230941 (0.0007) [2023-12-28 04:04:57,770][106225] Updated weights for policy 1, policy_version 1230951 (0.0008) [2023-12-28 04:04:58,336][106226] Updated weights for policy 0, policy_version 1227738 (0.0006) [2023-12-28 04:04:58,405][106226] Updated weights for policy 0, policy_version 1227748 (0.0008) [2023-12-28 04:04:58,471][106226] Updated weights for policy 0, policy_version 1227758 (0.0011) [2023-12-28 04:04:58,540][106226] Updated weights for policy 0, policy_version 1227768 (0.0008) [2023-12-28 04:04:58,569][106225] Updated weights for policy 1, policy_version 1230961 (0.0010) [2023-12-28 04:04:58,639][106225] Updated weights for policy 1, policy_version 1230971 (0.0010) [2023-12-28 04:04:58,698][106225] Updated weights for policy 1, policy_version 1230981 (0.0007) [2023-12-28 04:04:59,451][106226] Updated weights for policy 0, policy_version 1227778 (0.0008) [2023-12-28 04:04:59,516][106226] Updated weights for policy 0, policy_version 1227788 (0.0009) [2023-12-28 04:04:59,573][106225] Updated weights for policy 1, policy_version 1230991 (0.0009) [2023-12-28 04:04:59,575][106226] Updated weights for policy 0, policy_version 1227798 (0.0008) [2023-12-28 04:04:59,629][106225] Updated weights for policy 1, policy_version 1231001 (0.0008) [2023-12-28 04:04:59,688][106225] Updated weights for policy 1, policy_version 1231011 (0.0009) [2023-12-28 04:05:00,296][106226] Updated weights for policy 0, policy_version 1227808 (0.0008) [2023-12-28 04:05:00,364][106226] Updated weights for policy 0, policy_version 1227818 (0.0009) [2023-12-28 04:05:00,429][106226] Updated weights for policy 0, policy_version 1227828 (0.0009) [2023-12-28 04:05:00,479][106225] Updated weights for policy 1, policy_version 1231021 (0.0009) [2023-12-28 04:05:00,539][106225] Updated weights for policy 1, policy_version 1231031 (0.0008) [2023-12-28 04:05:00,597][106225] Updated weights for policy 1, policy_version 1231041 (0.0006) [2023-12-28 04:05:01,141][106226] Updated weights for policy 0, policy_version 1227838 (0.0008) [2023-12-28 04:05:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 629579776. Throughput: 0: 9747.8, 1: 10046.3. Samples: 629574536. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:05:01,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.998')] [2023-12-28 04:05:01,206][106226] Updated weights for policy 0, policy_version 1227848 (0.0007) [2023-12-28 04:05:01,228][106225] Updated weights for policy 1, policy_version 1231051 (0.0006) [2023-12-28 04:05:01,270][106226] Updated weights for policy 0, policy_version 1227858 (0.0006) [2023-12-28 04:05:01,296][106225] Updated weights for policy 1, policy_version 1231061 (0.0008) [2023-12-28 04:05:01,358][106225] Updated weights for policy 1, policy_version 1231071 (0.0009) [2023-12-28 04:05:01,984][106226] Updated weights for policy 0, policy_version 1227868 (0.0008) [2023-12-28 04:05:02,049][106226] Updated weights for policy 0, policy_version 1227878 (0.0005) [2023-12-28 04:05:02,099][106225] Updated weights for policy 1, policy_version 1231081 (0.0007) [2023-12-28 04:05:02,117][106226] Updated weights for policy 0, policy_version 1227888 (0.0008) [2023-12-28 04:05:02,151][106225] Updated weights for policy 1, policy_version 1231091 (0.0006) [2023-12-28 04:05:02,212][106225] Updated weights for policy 1, policy_version 1231101 (0.0009) [2023-12-28 04:05:02,276][106225] Updated weights for policy 1, policy_version 1231111 (0.0008) [2023-12-28 04:05:02,700][106226] Updated weights for policy 0, policy_version 1227898 (0.0009) [2023-12-28 04:05:02,757][106226] Updated weights for policy 0, policy_version 1227908 (0.0011) [2023-12-28 04:05:02,820][106226] Updated weights for policy 0, policy_version 1227918 (0.0011) [2023-12-28 04:05:02,874][106226] Updated weights for policy 0, policy_version 1227928 (0.0010) [2023-12-28 04:05:03,029][106225] Updated weights for policy 1, policy_version 1231121 (0.0007) [2023-12-28 04:05:03,078][106225] Updated weights for policy 1, policy_version 1231131 (0.0007) [2023-12-28 04:05:03,135][106225] Updated weights for policy 1, policy_version 1231141 (0.0008) [2023-12-28 04:05:03,573][106226] Updated weights for policy 0, policy_version 1227938 (0.0005) [2023-12-28 04:05:03,628][106226] Updated weights for policy 0, policy_version 1227948 (0.0006) [2023-12-28 04:05:03,682][106226] Updated weights for policy 0, policy_version 1227958 (0.0005) [2023-12-28 04:05:03,898][106225] Updated weights for policy 1, policy_version 1231151 (0.0007) [2023-12-28 04:05:03,966][106225] Updated weights for policy 1, policy_version 1231161 (0.0006) [2023-12-28 04:05:04,035][106225] Updated weights for policy 1, policy_version 1231171 (0.0006) [2023-12-28 04:05:04,313][106226] Updated weights for policy 0, policy_version 1227968 (0.0007) [2023-12-28 04:05:04,372][106226] Updated weights for policy 0, policy_version 1227978 (0.0010) [2023-12-28 04:05:04,436][106226] Updated weights for policy 0, policy_version 1227988 (0.0009) [2023-12-28 04:05:04,586][106225] Updated weights for policy 1, policy_version 1231181 (0.0006) [2023-12-28 04:05:04,659][106225] Updated weights for policy 1, policy_version 1231191 (0.0006) [2023-12-28 04:05:04,708][106225] Updated weights for policy 1, policy_version 1231201 (0.0005) [2023-12-28 04:05:05,021][106226] Updated weights for policy 0, policy_version 1227998 (0.0010) [2023-12-28 04:05:05,070][106226] Updated weights for policy 0, policy_version 1228008 (0.0010) [2023-12-28 04:05:05,128][106226] Updated weights for policy 0, policy_version 1228018 (0.0010) [2023-12-28 04:05:05,243][106225] Updated weights for policy 1, policy_version 1231211 (0.0006) [2023-12-28 04:05:05,303][106225] Updated weights for policy 1, policy_version 1231221 (0.0007) [2023-12-28 04:05:05,359][106225] Updated weights for policy 1, policy_version 1231231 (0.0008) [2023-12-28 04:05:05,847][106226] Updated weights for policy 0, policy_version 1228028 (0.0010) [2023-12-28 04:05:05,911][106226] Updated weights for policy 0, policy_version 1228038 (0.0009) [2023-12-28 04:05:05,948][106225] Updated weights for policy 1, policy_version 1231241 (0.0007) [2023-12-28 04:05:06,003][106226] Updated weights for policy 0, policy_version 1228048 (0.0010) [2023-12-28 04:05:06,007][106225] Updated weights for policy 1, policy_version 1231251 (0.0009) [2023-12-28 04:05:06,070][106225] Updated weights for policy 1, policy_version 1231261 (0.0010) [2023-12-28 04:05:06,131][106225] Updated weights for policy 1, policy_version 1231271 (0.0009) [2023-12-28 04:05:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 629694464. Throughput: 0: 9850.2, 1: 10074.7. Samples: 629697856. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:05:06,175][105115] Avg episode reward: [(0, '-4.157'), (1, '-4.553')] [2023-12-28 04:05:06,620][106226] Updated weights for policy 0, policy_version 1228058 (0.0011) [2023-12-28 04:05:06,692][106226] Updated weights for policy 0, policy_version 1228068 (0.0011) [2023-12-28 04:05:06,759][106226] Updated weights for policy 0, policy_version 1228078 (0.0011) [2023-12-28 04:05:06,822][106226] Updated weights for policy 0, policy_version 1228088 (0.0011) [2023-12-28 04:05:06,854][106225] Updated weights for policy 1, policy_version 1231281 (0.0007) [2023-12-28 04:05:06,903][106225] Updated weights for policy 1, policy_version 1231291 (0.0008) [2023-12-28 04:05:06,955][106225] Updated weights for policy 1, policy_version 1231301 (0.0008) [2023-12-28 04:05:07,500][106226] Updated weights for policy 0, policy_version 1228098 (0.0011) [2023-12-28 04:05:07,560][106226] Updated weights for policy 0, policy_version 1228108 (0.0010) [2023-12-28 04:05:07,614][106226] Updated weights for policy 0, policy_version 1228118 (0.0011) [2023-12-28 04:05:07,720][106225] Updated weights for policy 1, policy_version 1231311 (0.0006) [2023-12-28 04:05:07,774][106225] Updated weights for policy 1, policy_version 1231321 (0.0005) [2023-12-28 04:05:07,823][106225] Updated weights for policy 1, policy_version 1231331 (0.0007) [2023-12-28 04:05:08,293][106226] Updated weights for policy 0, policy_version 1228128 (0.0011) [2023-12-28 04:05:08,365][106226] Updated weights for policy 0, policy_version 1228138 (0.0010) [2023-12-28 04:05:08,428][106226] Updated weights for policy 0, policy_version 1228148 (0.0011) [2023-12-28 04:05:08,533][106225] Updated weights for policy 1, policy_version 1231341 (0.0008) [2023-12-28 04:05:08,584][106225] Updated weights for policy 1, policy_version 1231351 (0.0008) [2023-12-28 04:05:08,645][106225] Updated weights for policy 1, policy_version 1231361 (0.0009) [2023-12-28 04:05:09,106][106226] Updated weights for policy 0, policy_version 1228158 (0.0008) [2023-12-28 04:05:09,178][106226] Updated weights for policy 0, policy_version 1228168 (0.0007) [2023-12-28 04:05:09,237][106226] Updated weights for policy 0, policy_version 1228178 (0.0009) [2023-12-28 04:05:09,481][106225] Updated weights for policy 1, policy_version 1231371 (0.0008) [2023-12-28 04:05:09,540][106225] Updated weights for policy 1, policy_version 1231381 (0.0008) [2023-12-28 04:05:09,599][106225] Updated weights for policy 1, policy_version 1231391 (0.0008) [2023-12-28 04:05:09,954][106226] Updated weights for policy 0, policy_version 1228188 (0.0010) [2023-12-28 04:05:10,015][106226] Updated weights for policy 0, policy_version 1228198 (0.0011) [2023-12-28 04:05:10,077][106226] Updated weights for policy 0, policy_version 1228208 (0.0011) [2023-12-28 04:05:10,406][106225] Updated weights for policy 1, policy_version 1231401 (0.0008) [2023-12-28 04:05:10,464][106225] Updated weights for policy 1, policy_version 1231411 (0.0009) [2023-12-28 04:05:10,525][106225] Updated weights for policy 1, policy_version 1231421 (0.0008) [2023-12-28 04:05:10,582][106225] Updated weights for policy 1, policy_version 1231431 (0.0009) [2023-12-28 04:05:10,714][106226] Updated weights for policy 0, policy_version 1228218 (0.0010) [2023-12-28 04:05:10,780][106226] Updated weights for policy 0, policy_version 1228228 (0.0006) [2023-12-28 04:05:10,850][106226] Updated weights for policy 0, policy_version 1228238 (0.0008) [2023-12-28 04:05:10,914][106226] Updated weights for policy 0, policy_version 1228248 (0.0011) [2023-12-28 04:05:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 629784576. Throughput: 0: 9898.6, 1: 10034.5. Samples: 629757240. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:05:11,175][105115] Avg episode reward: [(0, '-4.002'), (1, '-4.830')] [2023-12-28 04:05:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001231432_315293696.pth... [2023-12-28 04:05:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001228248_314490880.pth... [2023-12-28 04:05:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001227096_314195968.pth [2023-12-28 04:05:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001230280_314998784.pth [2023-12-28 04:05:11,388][106225] Updated weights for policy 1, policy_version 1231441 (0.0013) [2023-12-28 04:05:11,456][106225] Updated weights for policy 1, policy_version 1231451 (0.0008) [2023-12-28 04:05:11,518][106225] Updated weights for policy 1, policy_version 1231461 (0.0008) [2023-12-28 04:05:11,579][106226] Updated weights for policy 0, policy_version 1228258 (0.0009) [2023-12-28 04:05:11,641][106226] Updated weights for policy 0, policy_version 1228268 (0.0010) [2023-12-28 04:05:11,697][106226] Updated weights for policy 0, policy_version 1228278 (0.0006) [2023-12-28 04:05:12,305][106225] Updated weights for policy 1, policy_version 1231471 (0.0008) [2023-12-28 04:05:12,368][106225] Updated weights for policy 1, policy_version 1231481 (0.0008) [2023-12-28 04:05:12,430][106225] Updated weights for policy 1, policy_version 1231491 (0.0008) [2023-12-28 04:05:12,455][106226] Updated weights for policy 0, policy_version 1228288 (0.0010) [2023-12-28 04:05:12,517][106226] Updated weights for policy 0, policy_version 1228298 (0.0011) [2023-12-28 04:05:12,577][106226] Updated weights for policy 0, policy_version 1228308 (0.0011) [2023-12-28 04:05:13,184][106225] Updated weights for policy 1, policy_version 1231501 (0.0007) [2023-12-28 04:05:13,226][106225] Updated weights for policy 1, policy_version 1231511 (0.0005) [2023-12-28 04:05:13,269][106225] Updated weights for policy 1, policy_version 1231521 (0.0005) [2023-12-28 04:05:13,302][106226] Updated weights for policy 0, policy_version 1228318 (0.0011) [2023-12-28 04:05:13,362][106226] Updated weights for policy 0, policy_version 1228328 (0.0011) [2023-12-28 04:05:13,421][106226] Updated weights for policy 0, policy_version 1228338 (0.0010) [2023-12-28 04:05:13,842][106225] Updated weights for policy 1, policy_version 1231531 (0.0005) [2023-12-28 04:05:13,894][106225] Updated weights for policy 1, policy_version 1231541 (0.0005) [2023-12-28 04:05:13,949][106225] Updated weights for policy 1, policy_version 1231551 (0.0005) [2023-12-28 04:05:14,124][106226] Updated weights for policy 0, policy_version 1228348 (0.0010) [2023-12-28 04:05:14,177][106226] Updated weights for policy 0, policy_version 1228358 (0.0010) [2023-12-28 04:05:14,236][106226] Updated weights for policy 0, policy_version 1228368 (0.0010) [2023-12-28 04:05:14,570][106225] Updated weights for policy 1, policy_version 1231561 (0.0006) [2023-12-28 04:05:14,622][106225] Updated weights for policy 1, policy_version 1231571 (0.0005) [2023-12-28 04:05:14,674][106225] Updated weights for policy 1, policy_version 1231581 (0.0006) [2023-12-28 04:05:14,728][106225] Updated weights for policy 1, policy_version 1231591 (0.0005) [2023-12-28 04:05:14,954][106226] Updated weights for policy 0, policy_version 1228378 (0.0010) [2023-12-28 04:05:15,020][106226] Updated weights for policy 0, policy_version 1228388 (0.0009) [2023-12-28 04:05:15,066][106226] Updated weights for policy 0, policy_version 1228398 (0.0008) [2023-12-28 04:05:15,120][106226] Updated weights for policy 0, policy_version 1228408 (0.0007) [2023-12-28 04:05:15,431][106225] Updated weights for policy 1, policy_version 1231601 (0.0008) [2023-12-28 04:05:15,483][106225] Updated weights for policy 1, policy_version 1231611 (0.0009) [2023-12-28 04:05:15,546][106225] Updated weights for policy 1, policy_version 1231621 (0.0009) [2023-12-28 04:05:15,755][106226] Updated weights for policy 0, policy_version 1228418 (0.0008) [2023-12-28 04:05:15,802][106226] Updated weights for policy 0, policy_version 1228428 (0.0008) [2023-12-28 04:05:15,854][106226] Updated weights for policy 0, policy_version 1228438 (0.0009) [2023-12-28 04:05:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 629882880. Throughput: 0: 9841.6, 1: 9980.9. Samples: 629873236. Policy #0 lag: (min: 31.0, avg: 35.1, max: 63.0) [2023-12-28 04:05:16,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-5.039')] [2023-12-28 04:05:16,324][106225] Updated weights for policy 1, policy_version 1231631 (0.0008) [2023-12-28 04:05:16,389][106225] Updated weights for policy 1, policy_version 1231641 (0.0009) [2023-12-28 04:05:16,452][106225] Updated weights for policy 1, policy_version 1231651 (0.0008) [2023-12-28 04:05:16,457][106226] Updated weights for policy 0, policy_version 1228448 (0.0005) [2023-12-28 04:05:16,512][106226] Updated weights for policy 0, policy_version 1228458 (0.0005) [2023-12-28 04:05:16,564][106226] Updated weights for policy 0, policy_version 1228468 (0.0006) [2023-12-28 04:05:17,108][106226] Updated weights for policy 0, policy_version 1228478 (0.0007) [2023-12-28 04:05:17,156][106226] Updated weights for policy 0, policy_version 1228488 (0.0008) [2023-12-28 04:05:17,187][106225] Updated weights for policy 1, policy_version 1231661 (0.0007) [2023-12-28 04:05:17,205][106226] Updated weights for policy 0, policy_version 1228498 (0.0008) [2023-12-28 04:05:17,244][106225] Updated weights for policy 1, policy_version 1231671 (0.0008) [2023-12-28 04:05:17,291][106225] Updated weights for policy 1, policy_version 1231681 (0.0008) [2023-12-28 04:05:17,890][106226] Updated weights for policy 0, policy_version 1228508 (0.0008) [2023-12-28 04:05:17,943][106226] Updated weights for policy 0, policy_version 1228518 (0.0010) [2023-12-28 04:05:17,975][106225] Updated weights for policy 1, policy_version 1231691 (0.0008) [2023-12-28 04:05:18,006][106226] Updated weights for policy 0, policy_version 1228528 (0.0011) [2023-12-28 04:05:18,039][106225] Updated weights for policy 1, policy_version 1231701 (0.0006) [2023-12-28 04:05:18,090][106225] Updated weights for policy 1, policy_version 1231711 (0.0009) [2023-12-28 04:05:18,744][106226] Updated weights for policy 0, policy_version 1228538 (0.0007) [2023-12-28 04:05:18,763][106225] Updated weights for policy 1, policy_version 1231721 (0.0010) [2023-12-28 04:05:18,798][106226] Updated weights for policy 0, policy_version 1228548 (0.0008) [2023-12-28 04:05:18,826][106225] Updated weights for policy 1, policy_version 1231731 (0.0009) [2023-12-28 04:05:18,858][106226] Updated weights for policy 0, policy_version 1228558 (0.0010) [2023-12-28 04:05:18,885][106225] Updated weights for policy 1, policy_version 1231741 (0.0009) [2023-12-28 04:05:18,914][106226] Updated weights for policy 0, policy_version 1228568 (0.0010) [2023-12-28 04:05:18,950][106225] Updated weights for policy 1, policy_version 1231751 (0.0008) [2023-12-28 04:05:19,692][106226] Updated weights for policy 0, policy_version 1228578 (0.0006) [2023-12-28 04:05:19,715][106225] Updated weights for policy 1, policy_version 1231761 (0.0009) [2023-12-28 04:05:19,754][106226] Updated weights for policy 0, policy_version 1228588 (0.0010) [2023-12-28 04:05:19,767][106225] Updated weights for policy 1, policy_version 1231771 (0.0007) [2023-12-28 04:05:19,811][106226] Updated weights for policy 0, policy_version 1228598 (0.0010) [2023-12-28 04:05:19,826][106225] Updated weights for policy 1, policy_version 1231781 (0.0007) [2023-12-28 04:05:20,525][106226] Updated weights for policy 0, policy_version 1228608 (0.0008) [2023-12-28 04:05:20,588][106225] Updated weights for policy 1, policy_version 1231791 (0.0010) [2023-12-28 04:05:20,596][106226] Updated weights for policy 0, policy_version 1228618 (0.0009) [2023-12-28 04:05:20,647][106225] Updated weights for policy 1, policy_version 1231801 (0.0008) [2023-12-28 04:05:20,653][106226] Updated weights for policy 0, policy_version 1228628 (0.0006) [2023-12-28 04:05:20,708][106225] Updated weights for policy 1, policy_version 1231811 (0.0010) [2023-12-28 04:05:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 629981184. Throughput: 0: 9882.2, 1: 9868.7. Samples: 629991336. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:21,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-4.970')] [2023-12-28 04:05:21,457][106225] Updated weights for policy 1, policy_version 1231821 (0.0008) [2023-12-28 04:05:21,520][106225] Updated weights for policy 1, policy_version 1231831 (0.0011) [2023-12-28 04:05:21,540][106226] Updated weights for policy 0, policy_version 1228638 (0.0008) [2023-12-28 04:05:21,577][106225] Updated weights for policy 1, policy_version 1231841 (0.0010) [2023-12-28 04:05:21,600][106226] Updated weights for policy 0, policy_version 1228648 (0.0008) [2023-12-28 04:05:21,671][106226] Updated weights for policy 0, policy_version 1228658 (0.0008) [2023-12-28 04:05:22,263][106225] Updated weights for policy 1, policy_version 1231851 (0.0009) [2023-12-28 04:05:22,323][106225] Updated weights for policy 1, policy_version 1231861 (0.0009) [2023-12-28 04:05:22,388][106225] Updated weights for policy 1, policy_version 1231871 (0.0009) [2023-12-28 04:05:22,412][106226] Updated weights for policy 0, policy_version 1228668 (0.0008) [2023-12-28 04:05:22,477][106226] Updated weights for policy 0, policy_version 1228678 (0.0007) [2023-12-28 04:05:22,538][106226] Updated weights for policy 0, policy_version 1228688 (0.0009) [2023-12-28 04:05:23,147][106225] Updated weights for policy 1, policy_version 1231881 (0.0008) [2023-12-28 04:05:23,166][106226] Updated weights for policy 0, policy_version 1228698 (0.0007) [2023-12-28 04:05:23,207][106225] Updated weights for policy 1, policy_version 1231891 (0.0005) [2023-12-28 04:05:23,214][106226] Updated weights for policy 0, policy_version 1228708 (0.0011) [2023-12-28 04:05:23,253][106225] Updated weights for policy 1, policy_version 1231901 (0.0007) [2023-12-28 04:05:23,258][106226] Updated weights for policy 0, policy_version 1228718 (0.0007) [2023-12-28 04:05:23,309][106225] Updated weights for policy 1, policy_version 1231911 (0.0008) [2023-12-28 04:05:23,321][106226] Updated weights for policy 0, policy_version 1228728 (0.0011) [2023-12-28 04:05:24,006][106226] Updated weights for policy 0, policy_version 1228738 (0.0011) [2023-12-28 04:05:24,020][106225] Updated weights for policy 1, policy_version 1231921 (0.0006) [2023-12-28 04:05:24,063][106226] Updated weights for policy 0, policy_version 1228748 (0.0010) [2023-12-28 04:05:24,073][106225] Updated weights for policy 1, policy_version 1231931 (0.0007) [2023-12-28 04:05:24,123][106226] Updated weights for policy 0, policy_version 1228758 (0.0010) [2023-12-28 04:05:24,127][106225] Updated weights for policy 1, policy_version 1231941 (0.0008) [2023-12-28 04:05:24,757][106226] Updated weights for policy 0, policy_version 1228768 (0.0006) [2023-12-28 04:05:24,811][106226] Updated weights for policy 0, policy_version 1228778 (0.0005) [2023-12-28 04:05:24,845][106225] Updated weights for policy 1, policy_version 1231951 (0.0007) [2023-12-28 04:05:24,870][106226] Updated weights for policy 0, policy_version 1228788 (0.0010) [2023-12-28 04:05:24,910][106225] Updated weights for policy 1, policy_version 1231961 (0.0006) [2023-12-28 04:05:24,970][106225] Updated weights for policy 1, policy_version 1231971 (0.0005) [2023-12-28 04:05:25,508][106226] Updated weights for policy 0, policy_version 1228798 (0.0011) [2023-12-28 04:05:25,564][106226] Updated weights for policy 0, policy_version 1228808 (0.0010) [2023-12-28 04:05:25,594][106225] Updated weights for policy 1, policy_version 1231981 (0.0008) [2023-12-28 04:05:25,611][106226] Updated weights for policy 0, policy_version 1228818 (0.0006) [2023-12-28 04:05:25,646][106225] Updated weights for policy 1, policy_version 1231992 (0.0009) [2023-12-28 04:05:25,697][106225] Updated weights for policy 1, policy_version 1232002 (0.0008) [2023-12-28 04:05:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 630079488. Throughput: 0: 9899.6, 1: 9829.2. Samples: 630049556. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:26,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.127')] [2023-12-28 04:05:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001232008_315441152.pth... [2023-12-28 04:05:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001228824_314638336.pth... [2023-12-28 04:05:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001227672_314343424.pth [2023-12-28 04:05:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001230888_315154432.pth [2023-12-28 04:05:26,328][106226] Updated weights for policy 0, policy_version 1228828 (0.0008) [2023-12-28 04:05:26,371][106225] Updated weights for policy 1, policy_version 1232012 (0.0007) [2023-12-28 04:05:26,374][106226] Updated weights for policy 0, policy_version 1228838 (0.0010) [2023-12-28 04:05:26,420][106226] Updated weights for policy 0, policy_version 1228848 (0.0010) [2023-12-28 04:05:26,426][106225] Updated weights for policy 1, policy_version 1232022 (0.0005) [2023-12-28 04:05:26,483][106225] Updated weights for policy 1, policy_version 1232032 (0.0007) [2023-12-28 04:05:27,032][106226] Updated weights for policy 0, policy_version 1228858 (0.0009) [2023-12-28 04:05:27,095][106226] Updated weights for policy 0, policy_version 1228868 (0.0005) [2023-12-28 04:05:27,157][106226] Updated weights for policy 0, policy_version 1228878 (0.0005) [2023-12-28 04:05:27,166][106225] Updated weights for policy 1, policy_version 1232042 (0.0009) [2023-12-28 04:05:27,214][106226] Updated weights for policy 0, policy_version 1228888 (0.0006) [2023-12-28 04:05:27,227][106225] Updated weights for policy 1, policy_version 1232052 (0.0005) [2023-12-28 04:05:27,296][106225] Updated weights for policy 1, policy_version 1232062 (0.0005) [2023-12-28 04:05:27,356][106225] Updated weights for policy 1, policy_version 1232072 (0.0005) [2023-12-28 04:05:27,750][106226] Updated weights for policy 0, policy_version 1228898 (0.0006) [2023-12-28 04:05:27,802][106226] Updated weights for policy 0, policy_version 1228908 (0.0010) [2023-12-28 04:05:27,861][106226] Updated weights for policy 0, policy_version 1228918 (0.0010) [2023-12-28 04:05:27,972][106225] Updated weights for policy 1, policy_version 1232082 (0.0005) [2023-12-28 04:05:28,026][106225] Updated weights for policy 1, policy_version 1232092 (0.0005) [2023-12-28 04:05:28,080][106225] Updated weights for policy 1, policy_version 1232102 (0.0007) [2023-12-28 04:05:28,568][106226] Updated weights for policy 0, policy_version 1228928 (0.0011) [2023-12-28 04:05:28,626][106226] Updated weights for policy 0, policy_version 1228938 (0.0011) [2023-12-28 04:05:28,683][106226] Updated weights for policy 0, policy_version 1228948 (0.0010) [2023-12-28 04:05:28,706][106225] Updated weights for policy 1, policy_version 1232112 (0.0010) [2023-12-28 04:05:28,769][106225] Updated weights for policy 1, policy_version 1232122 (0.0010) [2023-12-28 04:05:28,822][106225] Updated weights for policy 1, policy_version 1232132 (0.0010) [2023-12-28 04:05:29,407][106226] Updated weights for policy 0, policy_version 1228958 (0.0010) [2023-12-28 04:05:29,472][106226] Updated weights for policy 0, policy_version 1228968 (0.0007) [2023-12-28 04:05:29,535][106226] Updated weights for policy 0, policy_version 1228978 (0.0009) [2023-12-28 04:05:29,579][106225] Updated weights for policy 1, policy_version 1232142 (0.0009) [2023-12-28 04:05:29,647][106225] Updated weights for policy 1, policy_version 1232152 (0.0008) [2023-12-28 04:05:29,717][106225] Updated weights for policy 1, policy_version 1232162 (0.0008) [2023-12-28 04:05:30,277][106226] Updated weights for policy 0, policy_version 1228988 (0.0008) [2023-12-28 04:05:30,335][106226] Updated weights for policy 0, policy_version 1228998 (0.0011) [2023-12-28 04:05:30,398][106226] Updated weights for policy 0, policy_version 1229008 (0.0011) [2023-12-28 04:05:30,445][106225] Updated weights for policy 1, policy_version 1232172 (0.0007) [2023-12-28 04:05:30,499][106225] Updated weights for policy 1, policy_version 1232182 (0.0007) [2023-12-28 04:05:30,548][106225] Updated weights for policy 1, policy_version 1232192 (0.0008) [2023-12-28 04:05:30,967][106226] Updated weights for policy 0, policy_version 1229018 (0.0009) [2023-12-28 04:05:31,034][106226] Updated weights for policy 0, policy_version 1229028 (0.0006) [2023-12-28 04:05:31,099][106226] Updated weights for policy 0, policy_version 1229038 (0.0007) [2023-12-28 04:05:31,169][106226] Updated weights for policy 0, policy_version 1229048 (0.0010) [2023-12-28 04:05:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 630185984. Throughput: 0: 9999.6, 1: 9852.5. Samples: 630173436. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:31,175][105115] Avg episode reward: [(0, '-4.286'), (1, '-4.967')] [2023-12-28 04:05:31,329][106225] Updated weights for policy 1, policy_version 1232202 (0.0009) [2023-12-28 04:05:31,399][106225] Updated weights for policy 1, policy_version 1232212 (0.0009) [2023-12-28 04:05:31,462][106225] Updated weights for policy 1, policy_version 1232222 (0.0009) [2023-12-28 04:05:31,527][106225] Updated weights for policy 1, policy_version 1232232 (0.0010) [2023-12-28 04:05:31,806][106226] Updated weights for policy 0, policy_version 1229058 (0.0011) [2023-12-28 04:05:31,864][106226] Updated weights for policy 0, policy_version 1229068 (0.0011) [2023-12-28 04:05:31,915][106226] Updated weights for policy 0, policy_version 1229078 (0.0009) [2023-12-28 04:05:32,319][106225] Updated weights for policy 1, policy_version 1232242 (0.0009) [2023-12-28 04:05:32,385][106225] Updated weights for policy 1, policy_version 1232252 (0.0011) [2023-12-28 04:05:32,436][106225] Updated weights for policy 1, policy_version 1232262 (0.0009) [2023-12-28 04:05:32,622][106226] Updated weights for policy 0, policy_version 1229088 (0.0011) [2023-12-28 04:05:32,673][106226] Updated weights for policy 0, policy_version 1229098 (0.0010) [2023-12-28 04:05:32,729][106226] Updated weights for policy 0, policy_version 1229108 (0.0010) [2023-12-28 04:05:33,218][106225] Updated weights for policy 1, policy_version 1232272 (0.0010) [2023-12-28 04:05:33,274][106225] Updated weights for policy 1, policy_version 1232282 (0.0010) [2023-12-28 04:05:33,296][106226] Updated weights for policy 0, policy_version 1229118 (0.0006) [2023-12-28 04:05:33,324][106225] Updated weights for policy 1, policy_version 1232292 (0.0010) [2023-12-28 04:05:33,344][106226] Updated weights for policy 0, policy_version 1229128 (0.0006) [2023-12-28 04:05:33,392][106226] Updated weights for policy 0, policy_version 1229138 (0.0007) [2023-12-28 04:05:33,920][106225] Updated weights for policy 1, policy_version 1232302 (0.0010) [2023-12-28 04:05:33,980][106225] Updated weights for policy 1, policy_version 1232312 (0.0010) [2023-12-28 04:05:34,032][106226] Updated weights for policy 0, policy_version 1229148 (0.0009) [2023-12-28 04:05:34,044][106225] Updated weights for policy 1, policy_version 1232322 (0.0010) [2023-12-28 04:05:34,093][106226] Updated weights for policy 0, policy_version 1229158 (0.0006) [2023-12-28 04:05:34,150][106226] Updated weights for policy 0, policy_version 1229168 (0.0006) [2023-12-28 04:05:34,763][106225] Updated weights for policy 1, policy_version 1232332 (0.0010) [2023-12-28 04:05:34,814][106226] Updated weights for policy 0, policy_version 1229178 (0.0008) [2023-12-28 04:05:34,820][106225] Updated weights for policy 1, policy_version 1232342 (0.0010) [2023-12-28 04:05:34,870][106226] Updated weights for policy 0, policy_version 1229188 (0.0010) [2023-12-28 04:05:34,879][106225] Updated weights for policy 1, policy_version 1232352 (0.0010) [2023-12-28 04:05:34,929][106226] Updated weights for policy 0, policy_version 1229198 (0.0010) [2023-12-28 04:05:34,982][106226] Updated weights for policy 0, policy_version 1229208 (0.0010) [2023-12-28 04:05:35,498][106225] Updated weights for policy 1, policy_version 1232362 (0.0010) [2023-12-28 04:05:35,554][106225] Updated weights for policy 1, policy_version 1232372 (0.0006) [2023-12-28 04:05:35,590][106226] Updated weights for policy 0, policy_version 1229218 (0.0006) [2023-12-28 04:05:35,604][106225] Updated weights for policy 1, policy_version 1232382 (0.0005) [2023-12-28 04:05:35,650][106226] Updated weights for policy 0, policy_version 1229228 (0.0010) [2023-12-28 04:05:35,654][106225] Updated weights for policy 1, policy_version 1232392 (0.0005) [2023-12-28 04:05:35,711][106226] Updated weights for policy 0, policy_version 1229238 (0.0009) [2023-12-28 04:05:36,175][105115] Fps is (10 sec: 20478.8, 60 sec: 19797.2, 300 sec: 19688.5). Total num frames: 630284288. Throughput: 0: 10123.4, 1: 9823.9. Samples: 630296180. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:36,176][105115] Avg episode reward: [(0, '-4.161'), (1, '-5.083')] [2023-12-28 04:05:36,357][106225] Updated weights for policy 1, policy_version 1232402 (0.0008) [2023-12-28 04:05:36,360][106226] Updated weights for policy 0, policy_version 1229248 (0.0007) [2023-12-28 04:05:36,416][106226] Updated weights for policy 0, policy_version 1229258 (0.0008) [2023-12-28 04:05:36,422][106225] Updated weights for policy 1, policy_version 1232412 (0.0010) [2023-12-28 04:05:36,477][106226] Updated weights for policy 0, policy_version 1229268 (0.0006) [2023-12-28 04:05:36,486][106225] Updated weights for policy 1, policy_version 1232422 (0.0011) [2023-12-28 04:05:37,083][106225] Updated weights for policy 1, policy_version 1232432 (0.0009) [2023-12-28 04:05:37,134][106225] Updated weights for policy 1, policy_version 1232442 (0.0010) [2023-12-28 04:05:37,188][106225] Updated weights for policy 1, policy_version 1232452 (0.0009) [2023-12-28 04:05:37,270][106226] Updated weights for policy 0, policy_version 1229278 (0.0008) [2023-12-28 04:05:37,326][106226] Updated weights for policy 0, policy_version 1229288 (0.0008) [2023-12-28 04:05:37,397][106226] Updated weights for policy 0, policy_version 1229298 (0.0010) [2023-12-28 04:05:37,826][106225] Updated weights for policy 1, policy_version 1232462 (0.0007) [2023-12-28 04:05:37,897][106225] Updated weights for policy 1, policy_version 1232472 (0.0005) [2023-12-28 04:05:37,968][106225] Updated weights for policy 1, policy_version 1232482 (0.0005) [2023-12-28 04:05:38,026][106226] Updated weights for policy 0, policy_version 1229308 (0.0007) [2023-12-28 04:05:38,074][106226] Updated weights for policy 0, policy_version 1229318 (0.0008) [2023-12-28 04:05:38,127][106226] Updated weights for policy 0, policy_version 1229328 (0.0010) [2023-12-28 04:05:38,496][106225] Updated weights for policy 1, policy_version 1232492 (0.0006) [2023-12-28 04:05:38,561][106225] Updated weights for policy 1, policy_version 1232502 (0.0006) [2023-12-28 04:05:38,625][106225] Updated weights for policy 1, policy_version 1232512 (0.0007) [2023-12-28 04:05:38,815][106226] Updated weights for policy 0, policy_version 1229338 (0.0009) [2023-12-28 04:05:38,881][106226] Updated weights for policy 0, policy_version 1229348 (0.0006) [2023-12-28 04:05:38,938][106226] Updated weights for policy 0, policy_version 1229358 (0.0005) [2023-12-28 04:05:39,003][106226] Updated weights for policy 0, policy_version 1229368 (0.0005) [2023-12-28 04:05:39,240][106225] Updated weights for policy 1, policy_version 1232522 (0.0007) [2023-12-28 04:05:39,294][106225] Updated weights for policy 1, policy_version 1232532 (0.0007) [2023-12-28 04:05:39,352][106225] Updated weights for policy 1, policy_version 1232542 (0.0009) [2023-12-28 04:05:39,429][106225] Updated weights for policy 1, policy_version 1232552 (0.0008) [2023-12-28 04:05:39,635][106226] Updated weights for policy 0, policy_version 1229378 (0.0011) [2023-12-28 04:05:39,702][106226] Updated weights for policy 0, policy_version 1229388 (0.0011) [2023-12-28 04:05:39,763][106226] Updated weights for policy 0, policy_version 1229398 (0.0011) [2023-12-28 04:05:40,202][106225] Updated weights for policy 1, policy_version 1232562 (0.0006) [2023-12-28 04:05:40,268][106225] Updated weights for policy 1, policy_version 1232572 (0.0006) [2023-12-28 04:05:40,324][106225] Updated weights for policy 1, policy_version 1232582 (0.0006) [2023-12-28 04:05:40,517][106226] Updated weights for policy 0, policy_version 1229408 (0.0009) [2023-12-28 04:05:40,580][106226] Updated weights for policy 0, policy_version 1229418 (0.0011) [2023-12-28 04:05:40,638][106226] Updated weights for policy 0, policy_version 1229428 (0.0011) [2023-12-28 04:05:40,897][106225] Updated weights for policy 1, policy_version 1232592 (0.0006) [2023-12-28 04:05:40,965][106225] Updated weights for policy 1, policy_version 1232602 (0.0010) [2023-12-28 04:05:41,039][106225] Updated weights for policy 1, policy_version 1232612 (0.0010) [2023-12-28 04:05:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 630390784. Throughput: 0: 10150.0, 1: 9885.8. Samples: 630359144. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:41,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.912')] [2023-12-28 04:05:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001232616_315596800.pth... [2023-12-28 04:05:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001229432_314793984.pth... [2023-12-28 04:05:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001231432_315293696.pth [2023-12-28 04:05:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001228248_314490880.pth [2023-12-28 04:05:41,342][106226] Updated weights for policy 0, policy_version 1229438 (0.0007) [2023-12-28 04:05:41,411][106226] Updated weights for policy 0, policy_version 1229448 (0.0008) [2023-12-28 04:05:41,469][106226] Updated weights for policy 0, policy_version 1229458 (0.0008) [2023-12-28 04:05:41,825][106225] Updated weights for policy 1, policy_version 1232622 (0.0009) [2023-12-28 04:05:41,892][106225] Updated weights for policy 1, policy_version 1232632 (0.0008) [2023-12-28 04:05:41,953][106225] Updated weights for policy 1, policy_version 1232642 (0.0007) [2023-12-28 04:05:42,285][106226] Updated weights for policy 0, policy_version 1229468 (0.0009) [2023-12-28 04:05:42,349][106226] Updated weights for policy 0, policy_version 1229478 (0.0008) [2023-12-28 04:05:42,424][106226] Updated weights for policy 0, policy_version 1229488 (0.0009) [2023-12-28 04:05:42,735][106225] Updated weights for policy 1, policy_version 1232652 (0.0008) [2023-12-28 04:05:42,794][106225] Updated weights for policy 1, policy_version 1232662 (0.0008) [2023-12-28 04:05:42,856][106225] Updated weights for policy 1, policy_version 1232672 (0.0010) [2023-12-28 04:05:43,115][106226] Updated weights for policy 0, policy_version 1229498 (0.0008) [2023-12-28 04:05:43,175][106226] Updated weights for policy 0, policy_version 1229508 (0.0005) [2023-12-28 04:05:43,235][106226] Updated weights for policy 0, policy_version 1229518 (0.0005) [2023-12-28 04:05:43,286][106226] Updated weights for policy 0, policy_version 1229528 (0.0006) [2023-12-28 04:05:43,492][106225] Updated weights for policy 1, policy_version 1232682 (0.0008) [2023-12-28 04:05:43,541][106225] Updated weights for policy 1, policy_version 1232692 (0.0008) [2023-12-28 04:05:43,590][106225] Updated weights for policy 1, policy_version 1232702 (0.0006) [2023-12-28 04:05:43,657][106225] Updated weights for policy 1, policy_version 1232712 (0.0005) [2023-12-28 04:05:43,920][106226] Updated weights for policy 0, policy_version 1229538 (0.0011) [2023-12-28 04:05:43,981][106226] Updated weights for policy 0, policy_version 1229548 (0.0008) [2023-12-28 04:05:44,031][106226] Updated weights for policy 0, policy_version 1229558 (0.0010) [2023-12-28 04:05:44,222][106225] Updated weights for policy 1, policy_version 1232722 (0.0010) [2023-12-28 04:05:44,279][106225] Updated weights for policy 1, policy_version 1232732 (0.0010) [2023-12-28 04:05:44,330][106225] Updated weights for policy 1, policy_version 1232742 (0.0010) [2023-12-28 04:05:44,677][106226] Updated weights for policy 0, policy_version 1229568 (0.0010) [2023-12-28 04:05:44,727][106226] Updated weights for policy 0, policy_version 1229578 (0.0010) [2023-12-28 04:05:44,787][106226] Updated weights for policy 0, policy_version 1229588 (0.0010) [2023-12-28 04:05:45,035][106225] Updated weights for policy 1, policy_version 1232752 (0.0009) [2023-12-28 04:05:45,107][106225] Updated weights for policy 1, policy_version 1232762 (0.0008) [2023-12-28 04:05:45,177][106225] Updated weights for policy 1, policy_version 1232772 (0.0009) [2023-12-28 04:05:45,485][106226] Updated weights for policy 0, policy_version 1229598 (0.0011) [2023-12-28 04:05:45,535][106226] Updated weights for policy 0, policy_version 1229608 (0.0010) [2023-12-28 04:05:45,585][106226] Updated weights for policy 0, policy_version 1229618 (0.0010) [2023-12-28 04:05:45,843][106225] Updated weights for policy 1, policy_version 1232782 (0.0008) [2023-12-28 04:05:45,893][106225] Updated weights for policy 1, policy_version 1232792 (0.0006) [2023-12-28 04:05:45,946][106225] Updated weights for policy 1, policy_version 1232802 (0.0008) [2023-12-28 04:05:46,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 630489088. Throughput: 0: 10149.0, 1: 9941.0. Samples: 630478592. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:46,176][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.755')] [2023-12-28 04:05:46,316][106226] Updated weights for policy 0, policy_version 1229628 (0.0010) [2023-12-28 04:05:46,370][106226] Updated weights for policy 0, policy_version 1229638 (0.0010) [2023-12-28 04:05:46,419][106226] Updated weights for policy 0, policy_version 1229648 (0.0010) [2023-12-28 04:05:46,562][106225] Updated weights for policy 1, policy_version 1232812 (0.0007) [2023-12-28 04:05:46,620][106225] Updated weights for policy 1, policy_version 1232822 (0.0005) [2023-12-28 04:05:46,685][106225] Updated weights for policy 1, policy_version 1232832 (0.0005) [2023-12-28 04:05:47,116][106226] Updated weights for policy 0, policy_version 1229658 (0.0010) [2023-12-28 04:05:47,172][106226] Updated weights for policy 0, policy_version 1229668 (0.0009) [2023-12-28 04:05:47,229][106226] Updated weights for policy 0, policy_version 1229678 (0.0007) [2023-12-28 04:05:47,289][106226] Updated weights for policy 0, policy_version 1229688 (0.0005) [2023-12-28 04:05:47,315][106225] Updated weights for policy 1, policy_version 1232842 (0.0006) [2023-12-28 04:05:47,380][106225] Updated weights for policy 1, policy_version 1232852 (0.0009) [2023-12-28 04:05:47,446][106225] Updated weights for policy 1, policy_version 1232862 (0.0008) [2023-12-28 04:05:47,496][106225] Updated weights for policy 1, policy_version 1232872 (0.0008) [2023-12-28 04:05:47,816][106226] Updated weights for policy 0, policy_version 1229698 (0.0005) [2023-12-28 04:05:47,870][106226] Updated weights for policy 0, policy_version 1229708 (0.0006) [2023-12-28 04:05:47,924][106226] Updated weights for policy 0, policy_version 1229718 (0.0006) [2023-12-28 04:05:48,214][106225] Updated weights for policy 1, policy_version 1232882 (0.0011) [2023-12-28 04:05:48,261][106225] Updated weights for policy 1, policy_version 1232892 (0.0010) [2023-12-28 04:05:48,309][106225] Updated weights for policy 1, policy_version 1232902 (0.0010) [2023-12-28 04:05:48,502][106226] Updated weights for policy 0, policy_version 1229728 (0.0005) [2023-12-28 04:05:48,559][106226] Updated weights for policy 0, policy_version 1229738 (0.0006) [2023-12-28 04:05:48,623][106226] Updated weights for policy 0, policy_version 1229748 (0.0007) [2023-12-28 04:05:49,057][106225] Updated weights for policy 1, policy_version 1232912 (0.0008) [2023-12-28 04:05:49,107][106225] Updated weights for policy 1, policy_version 1232922 (0.0008) [2023-12-28 04:05:49,167][106225] Updated weights for policy 1, policy_version 1232932 (0.0007) [2023-12-28 04:05:49,203][106226] Updated weights for policy 0, policy_version 1229758 (0.0009) [2023-12-28 04:05:49,270][106226] Updated weights for policy 0, policy_version 1229768 (0.0008) [2023-12-28 04:05:49,325][106226] Updated weights for policy 0, policy_version 1229778 (0.0008) [2023-12-28 04:05:49,963][106225] Updated weights for policy 1, policy_version 1232942 (0.0008) [2023-12-28 04:05:50,001][106226] Updated weights for policy 0, policy_version 1229788 (0.0009) [2023-12-28 04:05:50,031][106225] Updated weights for policy 1, policy_version 1232952 (0.0008) [2023-12-28 04:05:50,061][106226] Updated weights for policy 0, policy_version 1229798 (0.0007) [2023-12-28 04:05:50,095][106225] Updated weights for policy 1, policy_version 1232962 (0.0008) [2023-12-28 04:05:50,132][106226] Updated weights for policy 0, policy_version 1229808 (0.0007) [2023-12-28 04:05:50,751][106226] Updated weights for policy 0, policy_version 1229818 (0.0006) [2023-12-28 04:05:50,814][106226] Updated weights for policy 0, policy_version 1229828 (0.0007) [2023-12-28 04:05:50,829][106225] Updated weights for policy 1, policy_version 1232972 (0.0009) [2023-12-28 04:05:50,871][106226] Updated weights for policy 0, policy_version 1229838 (0.0008) [2023-12-28 04:05:50,877][106225] Updated weights for policy 1, policy_version 1232982 (0.0008) [2023-12-28 04:05:50,927][106226] Updated weights for policy 0, policy_version 1229848 (0.0007) [2023-12-28 04:05:50,936][106225] Updated weights for policy 1, policy_version 1232992 (0.0007) [2023-12-28 04:05:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20206.9, 300 sec: 19716.3). Total num frames: 630595584. Throughput: 0: 10219.1, 1: 9868.3. Samples: 630601788. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:51,175][105115] Avg episode reward: [(0, '-4.212'), (1, '-5.135')] [2023-12-28 04:05:51,658][106226] Updated weights for policy 0, policy_version 1229858 (0.0008) [2023-12-28 04:05:51,678][106225] Updated weights for policy 1, policy_version 1233002 (0.0008) [2023-12-28 04:05:51,729][106226] Updated weights for policy 0, policy_version 1229868 (0.0006) [2023-12-28 04:05:51,747][106225] Updated weights for policy 1, policy_version 1233012 (0.0007) [2023-12-28 04:05:51,793][106226] Updated weights for policy 0, policy_version 1229878 (0.0008) [2023-12-28 04:05:51,803][106225] Updated weights for policy 1, policy_version 1233022 (0.0008) [2023-12-28 04:05:51,852][106225] Updated weights for policy 1, policy_version 1233032 (0.0009) [2023-12-28 04:05:52,486][106226] Updated weights for policy 0, policy_version 1229888 (0.0009) [2023-12-28 04:05:52,552][106226] Updated weights for policy 0, policy_version 1229898 (0.0010) [2023-12-28 04:05:52,579][106225] Updated weights for policy 1, policy_version 1233042 (0.0006) [2023-12-28 04:05:52,612][106226] Updated weights for policy 0, policy_version 1229908 (0.0008) [2023-12-28 04:05:52,637][106225] Updated weights for policy 1, policy_version 1233052 (0.0007) [2023-12-28 04:05:52,703][106225] Updated weights for policy 1, policy_version 1233062 (0.0008) [2023-12-28 04:05:53,297][106226] Updated weights for policy 0, policy_version 1229918 (0.0009) [2023-12-28 04:05:53,346][106226] Updated weights for policy 0, policy_version 1229928 (0.0010) [2023-12-28 04:05:53,382][106225] Updated weights for policy 1, policy_version 1233072 (0.0006) [2023-12-28 04:05:53,396][106226] Updated weights for policy 0, policy_version 1229938 (0.0007) [2023-12-28 04:05:53,439][106225] Updated weights for policy 1, policy_version 1233082 (0.0008) [2023-12-28 04:05:53,498][106225] Updated weights for policy 1, policy_version 1233092 (0.0010) [2023-12-28 04:05:54,096][106226] Updated weights for policy 0, policy_version 1229948 (0.0007) [2023-12-28 04:05:54,166][106226] Updated weights for policy 0, policy_version 1229958 (0.0005) [2023-12-28 04:05:54,173][106225] Updated weights for policy 1, policy_version 1233102 (0.0010) [2023-12-28 04:05:54,223][106226] Updated weights for policy 0, policy_version 1229968 (0.0006) [2023-12-28 04:05:54,233][106225] Updated weights for policy 1, policy_version 1233112 (0.0010) [2023-12-28 04:05:54,287][106225] Updated weights for policy 1, policy_version 1233122 (0.0010) [2023-12-28 04:05:54,778][106226] Updated weights for policy 0, policy_version 1229978 (0.0006) [2023-12-28 04:05:54,843][106226] Updated weights for policy 0, policy_version 1229988 (0.0009) [2023-12-28 04:05:54,905][106226] Updated weights for policy 0, policy_version 1229998 (0.0010) [2023-12-28 04:05:54,936][106225] Updated weights for policy 1, policy_version 1233132 (0.0008) [2023-12-28 04:05:54,962][106226] Updated weights for policy 0, policy_version 1230008 (0.0010) [2023-12-28 04:05:55,002][106225] Updated weights for policy 1, policy_version 1233142 (0.0008) [2023-12-28 04:05:55,053][106225] Updated weights for policy 1, policy_version 1233152 (0.0010) [2023-12-28 04:05:55,593][106226] Updated weights for policy 0, policy_version 1230018 (0.0010) [2023-12-28 04:05:55,649][106226] Updated weights for policy 0, policy_version 1230028 (0.0010) [2023-12-28 04:05:55,671][106225] Updated weights for policy 1, policy_version 1233162 (0.0009) [2023-12-28 04:05:55,702][106226] Updated weights for policy 0, policy_version 1230038 (0.0006) [2023-12-28 04:05:55,720][106225] Updated weights for policy 1, policy_version 1233172 (0.0005) [2023-12-28 04:05:55,767][106225] Updated weights for policy 1, policy_version 1233182 (0.0005) [2023-12-28 04:05:55,830][106225] Updated weights for policy 1, policy_version 1233192 (0.0009) [2023-12-28 04:05:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 630693888. Throughput: 0: 10195.3, 1: 9877.9. Samples: 630660532. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:05:56,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.889')] [2023-12-28 04:05:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001233192_315744256.pth... [2023-12-28 04:05:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001230040_314949632.pth... [2023-12-28 04:05:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001232008_315441152.pth [2023-12-28 04:05:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001228824_314638336.pth [2023-12-28 04:05:56,303][106226] Updated weights for policy 0, policy_version 1230048 (0.0010) [2023-12-28 04:05:56,360][106226] Updated weights for policy 0, policy_version 1230058 (0.0010) [2023-12-28 04:05:56,413][106226] Updated weights for policy 0, policy_version 1230068 (0.0010) [2023-12-28 04:05:56,431][106225] Updated weights for policy 1, policy_version 1233202 (0.0010) [2023-12-28 04:05:56,494][106225] Updated weights for policy 1, policy_version 1233212 (0.0010) [2023-12-28 04:05:56,558][106225] Updated weights for policy 1, policy_version 1233222 (0.0010) [2023-12-28 04:05:57,012][106226] Updated weights for policy 0, policy_version 1230078 (0.0010) [2023-12-28 04:05:57,064][106226] Updated weights for policy 0, policy_version 1230088 (0.0010) [2023-12-28 04:05:57,111][106226] Updated weights for policy 0, policy_version 1230098 (0.0010) [2023-12-28 04:05:57,246][106225] Updated weights for policy 1, policy_version 1233232 (0.0010) [2023-12-28 04:05:57,295][106225] Updated weights for policy 1, policy_version 1233242 (0.0010) [2023-12-28 04:05:57,356][106225] Updated weights for policy 1, policy_version 1233252 (0.0006) [2023-12-28 04:05:57,781][106226] Updated weights for policy 0, policy_version 1230108 (0.0008) [2023-12-28 04:05:57,829][106226] Updated weights for policy 0, policy_version 1230118 (0.0005) [2023-12-28 04:05:57,874][106226] Updated weights for policy 0, policy_version 1230128 (0.0005) [2023-12-28 04:05:57,999][106225] Updated weights for policy 1, policy_version 1233262 (0.0007) [2023-12-28 04:05:58,062][106225] Updated weights for policy 1, policy_version 1233272 (0.0006) [2023-12-28 04:05:58,126][106225] Updated weights for policy 1, policy_version 1233282 (0.0009) [2023-12-28 04:05:58,546][106226] Updated weights for policy 0, policy_version 1230138 (0.0006) [2023-12-28 04:05:58,608][106226] Updated weights for policy 0, policy_version 1230148 (0.0009) [2023-12-28 04:05:58,673][106226] Updated weights for policy 0, policy_version 1230158 (0.0008) [2023-12-28 04:05:58,739][106226] Updated weights for policy 0, policy_version 1230168 (0.0008) [2023-12-28 04:05:58,864][106225] Updated weights for policy 1, policy_version 1233292 (0.0008) [2023-12-28 04:05:58,930][106225] Updated weights for policy 1, policy_version 1233302 (0.0007) [2023-12-28 04:05:58,997][106225] Updated weights for policy 1, policy_version 1233312 (0.0007) [2023-12-28 04:05:59,508][106226] Updated weights for policy 0, policy_version 1230178 (0.0006) [2023-12-28 04:05:59,575][106226] Updated weights for policy 0, policy_version 1230188 (0.0005) [2023-12-28 04:05:59,633][106226] Updated weights for policy 0, policy_version 1230198 (0.0007) [2023-12-28 04:05:59,831][106225] Updated weights for policy 1, policy_version 1233322 (0.0008) [2023-12-28 04:05:59,894][106225] Updated weights for policy 1, policy_version 1233332 (0.0010) [2023-12-28 04:05:59,964][106225] Updated weights for policy 1, policy_version 1233342 (0.0008) [2023-12-28 04:06:00,026][106225] Updated weights for policy 1, policy_version 1233352 (0.0007) [2023-12-28 04:06:00,371][106226] Updated weights for policy 0, policy_version 1230208 (0.0008) [2023-12-28 04:06:00,431][106226] Updated weights for policy 0, policy_version 1230218 (0.0006) [2023-12-28 04:06:00,497][106226] Updated weights for policy 0, policy_version 1230228 (0.0008) [2023-12-28 04:06:00,747][106225] Updated weights for policy 1, policy_version 1233362 (0.0008) [2023-12-28 04:06:00,800][106225] Updated weights for policy 1, policy_version 1233372 (0.0008) [2023-12-28 04:06:00,858][106225] Updated weights for policy 1, policy_version 1233382 (0.0008) [2023-12-28 04:06:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20206.9, 300 sec: 19744.1). Total num frames: 630792192. Throughput: 0: 10296.8, 1: 9945.1. Samples: 630784120. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:01,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-5.014')] [2023-12-28 04:06:01,210][106226] Updated weights for policy 0, policy_version 1230238 (0.0009) [2023-12-28 04:06:01,274][106226] Updated weights for policy 0, policy_version 1230248 (0.0009) [2023-12-28 04:06:01,318][106226] Updated weights for policy 0, policy_version 1230258 (0.0008) [2023-12-28 04:06:01,571][106225] Updated weights for policy 1, policy_version 1233392 (0.0008) [2023-12-28 04:06:01,631][106225] Updated weights for policy 1, policy_version 1233402 (0.0008) [2023-12-28 04:06:01,703][106225] Updated weights for policy 1, policy_version 1233412 (0.0009) [2023-12-28 04:06:02,059][106226] Updated weights for policy 0, policy_version 1230268 (0.0009) [2023-12-28 04:06:02,114][106226] Updated weights for policy 0, policy_version 1230278 (0.0008) [2023-12-28 04:06:02,176][106226] Updated weights for policy 0, policy_version 1230288 (0.0009) [2023-12-28 04:06:02,395][106225] Updated weights for policy 1, policy_version 1233422 (0.0009) [2023-12-28 04:06:02,452][106225] Updated weights for policy 1, policy_version 1233432 (0.0011) [2023-12-28 04:06:02,508][106225] Updated weights for policy 1, policy_version 1233442 (0.0010) [2023-12-28 04:06:02,885][106226] Updated weights for policy 0, policy_version 1230298 (0.0008) [2023-12-28 04:06:02,939][106226] Updated weights for policy 0, policy_version 1230308 (0.0011) [2023-12-28 04:06:02,993][106226] Updated weights for policy 0, policy_version 1230318 (0.0011) [2023-12-28 04:06:03,051][106226] Updated weights for policy 0, policy_version 1230328 (0.0011) [2023-12-28 04:06:03,263][106225] Updated weights for policy 1, policy_version 1233452 (0.0010) [2023-12-28 04:06:03,316][106225] Updated weights for policy 1, policy_version 1233462 (0.0009) [2023-12-28 04:06:03,367][106225] Updated weights for policy 1, policy_version 1233472 (0.0005) [2023-12-28 04:06:03,771][106226] Updated weights for policy 0, policy_version 1230338 (0.0011) [2023-12-28 04:06:03,841][106226] Updated weights for policy 0, policy_version 1230348 (0.0010) [2023-12-28 04:06:03,908][106226] Updated weights for policy 0, policy_version 1230358 (0.0009) [2023-12-28 04:06:03,987][106225] Updated weights for policy 1, policy_version 1233482 (0.0005) [2023-12-28 04:06:04,051][106225] Updated weights for policy 1, policy_version 1233492 (0.0006) [2023-12-28 04:06:04,111][106225] Updated weights for policy 1, policy_version 1233502 (0.0008) [2023-12-28 04:06:04,173][106225] Updated weights for policy 1, policy_version 1233512 (0.0008) [2023-12-28 04:06:04,592][106226] Updated weights for policy 0, policy_version 1230368 (0.0011) [2023-12-28 04:06:04,650][106226] Updated weights for policy 0, policy_version 1230378 (0.0011) [2023-12-28 04:06:04,695][106226] Updated weights for policy 0, policy_version 1230388 (0.0010) [2023-12-28 04:06:04,905][106225] Updated weights for policy 1, policy_version 1233522 (0.0005) [2023-12-28 04:06:04,972][106225] Updated weights for policy 1, policy_version 1233532 (0.0005) [2023-12-28 04:06:05,039][106225] Updated weights for policy 1, policy_version 1233542 (0.0005) [2023-12-28 04:06:05,394][106226] Updated weights for policy 0, policy_version 1230398 (0.0010) [2023-12-28 04:06:05,450][106226] Updated weights for policy 0, policy_version 1230408 (0.0010) [2023-12-28 04:06:05,509][106226] Updated weights for policy 0, policy_version 1230418 (0.0010) [2023-12-28 04:06:05,639][106225] Updated weights for policy 1, policy_version 1233552 (0.0010) [2023-12-28 04:06:05,697][106225] Updated weights for policy 1, policy_version 1233562 (0.0010) [2023-12-28 04:06:05,751][106225] Updated weights for policy 1, policy_version 1233572 (0.0010) [2023-12-28 04:06:06,051][106226] Updated weights for policy 0, policy_version 1230428 (0.0008) [2023-12-28 04:06:06,127][106226] Updated weights for policy 0, policy_version 1230438 (0.0010) [2023-12-28 04:06:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 630890496. Throughput: 0: 10268.1, 1: 10004.5. Samples: 630903600. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:06,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-5.004')] [2023-12-28 04:06:06,192][106226] Updated weights for policy 0, policy_version 1230448 (0.0009) [2023-12-28 04:06:06,475][106225] Updated weights for policy 1, policy_version 1233582 (0.0010) [2023-12-28 04:06:06,539][106225] Updated weights for policy 1, policy_version 1233592 (0.0010) [2023-12-28 04:06:06,605][106225] Updated weights for policy 1, policy_version 1233602 (0.0009) [2023-12-28 04:06:06,898][106226] Updated weights for policy 0, policy_version 1230458 (0.0011) [2023-12-28 04:06:06,962][106226] Updated weights for policy 0, policy_version 1230468 (0.0011) [2023-12-28 04:06:07,033][106226] Updated weights for policy 0, policy_version 1230478 (0.0011) [2023-12-28 04:06:07,097][106226] Updated weights for policy 0, policy_version 1230488 (0.0011) [2023-12-28 04:06:07,309][106225] Updated weights for policy 1, policy_version 1233612 (0.0009) [2023-12-28 04:06:07,369][106225] Updated weights for policy 1, policy_version 1233622 (0.0008) [2023-12-28 04:06:07,434][106225] Updated weights for policy 1, policy_version 1233632 (0.0007) [2023-12-28 04:06:07,736][106226] Updated weights for policy 0, policy_version 1230498 (0.0009) [2023-12-28 04:06:07,790][106226] Updated weights for policy 0, policy_version 1230508 (0.0011) [2023-12-28 04:06:07,846][106226] Updated weights for policy 0, policy_version 1230518 (0.0010) [2023-12-28 04:06:08,127][106225] Updated weights for policy 1, policy_version 1233642 (0.0006) [2023-12-28 04:06:08,179][106225] Updated weights for policy 1, policy_version 1233652 (0.0005) [2023-12-28 04:06:08,226][106225] Updated weights for policy 1, policy_version 1233662 (0.0005) [2023-12-28 04:06:08,288][106225] Updated weights for policy 1, policy_version 1233672 (0.0006) [2023-12-28 04:06:08,505][106226] Updated weights for policy 0, policy_version 1230528 (0.0007) [2023-12-28 04:06:08,571][106226] Updated weights for policy 0, policy_version 1230538 (0.0006) [2023-12-28 04:06:08,640][106226] Updated weights for policy 0, policy_version 1230548 (0.0005) [2023-12-28 04:06:08,984][106225] Updated weights for policy 1, policy_version 1233682 (0.0009) [2023-12-28 04:06:09,041][106225] Updated weights for policy 1, policy_version 1233692 (0.0007) [2023-12-28 04:06:09,108][106225] Updated weights for policy 1, policy_version 1233702 (0.0006) [2023-12-28 04:06:09,315][106226] Updated weights for policy 0, policy_version 1230558 (0.0007) [2023-12-28 04:06:09,397][106226] Updated weights for policy 0, policy_version 1230568 (0.0009) [2023-12-28 04:06:09,466][106226] Updated weights for policy 0, policy_version 1230578 (0.0009) [2023-12-28 04:06:09,872][106225] Updated weights for policy 1, policy_version 1233712 (0.0007) [2023-12-28 04:06:09,934][106225] Updated weights for policy 1, policy_version 1233722 (0.0009) [2023-12-28 04:06:09,991][106225] Updated weights for policy 1, policy_version 1233732 (0.0009) [2023-12-28 04:06:10,092][106226] Updated weights for policy 0, policy_version 1230588 (0.0009) [2023-12-28 04:06:10,147][106226] Updated weights for policy 0, policy_version 1230598 (0.0007) [2023-12-28 04:06:10,209][106226] Updated weights for policy 0, policy_version 1230608 (0.0008) [2023-12-28 04:06:10,698][106225] Updated weights for policy 1, policy_version 1233742 (0.0007) [2023-12-28 04:06:10,753][106225] Updated weights for policy 1, policy_version 1233752 (0.0005) [2023-12-28 04:06:10,799][106225] Updated weights for policy 1, policy_version 1233762 (0.0005) [2023-12-28 04:06:10,961][106226] Updated weights for policy 0, policy_version 1230618 (0.0009) [2023-12-28 04:06:11,015][106226] Updated weights for policy 0, policy_version 1230628 (0.0007) [2023-12-28 04:06:11,087][106226] Updated weights for policy 0, policy_version 1230638 (0.0008) [2023-12-28 04:06:11,156][106226] Updated weights for policy 0, policy_version 1230648 (0.0008) [2023-12-28 04:06:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20207.0, 300 sec: 19799.6). Total num frames: 630996992. Throughput: 0: 10291.4, 1: 10019.8. Samples: 630963564. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:11,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-4.952')] [2023-12-28 04:06:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001233768_315891712.pth... [2023-12-28 04:06:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001230648_315105280.pth... [2023-12-28 04:06:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001229432_314793984.pth [2023-12-28 04:06:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001232616_315596800.pth [2023-12-28 04:06:11,481][106225] Updated weights for policy 1, policy_version 1233772 (0.0007) [2023-12-28 04:06:11,545][106225] Updated weights for policy 1, policy_version 1233782 (0.0009) [2023-12-28 04:06:11,609][106225] Updated weights for policy 1, policy_version 1233792 (0.0007) [2023-12-28 04:06:11,938][106226] Updated weights for policy 0, policy_version 1230658 (0.0009) [2023-12-28 04:06:11,996][106226] Updated weights for policy 0, policy_version 1230668 (0.0009) [2023-12-28 04:06:12,058][106226] Updated weights for policy 0, policy_version 1230678 (0.0009) [2023-12-28 04:06:12,343][106225] Updated weights for policy 1, policy_version 1233802 (0.0008) [2023-12-28 04:06:12,412][106225] Updated weights for policy 1, policy_version 1233812 (0.0008) [2023-12-28 04:06:12,464][106225] Updated weights for policy 1, policy_version 1233822 (0.0008) [2023-12-28 04:06:12,519][106225] Updated weights for policy 1, policy_version 1233832 (0.0008) [2023-12-28 04:06:12,736][106226] Updated weights for policy 0, policy_version 1230688 (0.0009) [2023-12-28 04:06:12,788][106226] Updated weights for policy 0, policy_version 1230698 (0.0008) [2023-12-28 04:06:12,848][106226] Updated weights for policy 0, policy_version 1230708 (0.0009) [2023-12-28 04:06:13,257][106225] Updated weights for policy 1, policy_version 1233842 (0.0010) [2023-12-28 04:06:13,322][106225] Updated weights for policy 1, policy_version 1233852 (0.0008) [2023-12-28 04:06:13,385][106225] Updated weights for policy 1, policy_version 1233862 (0.0007) [2023-12-28 04:06:13,502][106226] Updated weights for policy 0, policy_version 1230718 (0.0007) [2023-12-28 04:06:13,558][106226] Updated weights for policy 0, policy_version 1230728 (0.0007) [2023-12-28 04:06:13,617][106226] Updated weights for policy 0, policy_version 1230738 (0.0006) [2023-12-28 04:06:14,008][106225] Updated weights for policy 1, policy_version 1233872 (0.0009) [2023-12-28 04:06:14,066][106225] Updated weights for policy 1, policy_version 1233882 (0.0010) [2023-12-28 04:06:14,127][106225] Updated weights for policy 1, policy_version 1233892 (0.0010) [2023-12-28 04:06:14,207][106226] Updated weights for policy 0, policy_version 1230748 (0.0006) [2023-12-28 04:06:14,265][106226] Updated weights for policy 0, policy_version 1230758 (0.0005) [2023-12-28 04:06:14,319][106226] Updated weights for policy 0, policy_version 1230768 (0.0008) [2023-12-28 04:06:14,849][106225] Updated weights for policy 1, policy_version 1233902 (0.0007) [2023-12-28 04:06:14,914][106225] Updated weights for policy 1, policy_version 1233912 (0.0009) [2023-12-28 04:06:14,986][106225] Updated weights for policy 1, policy_version 1233922 (0.0010) [2023-12-28 04:06:14,999][106226] Updated weights for policy 0, policy_version 1230778 (0.0010) [2023-12-28 04:06:15,067][106226] Updated weights for policy 0, policy_version 1230788 (0.0010) [2023-12-28 04:06:15,129][106226] Updated weights for policy 0, policy_version 1230798 (0.0010) [2023-12-28 04:06:15,198][106226] Updated weights for policy 0, policy_version 1230808 (0.0005) [2023-12-28 04:06:15,641][106225] Updated weights for policy 1, policy_version 1233932 (0.0009) [2023-12-28 04:06:15,696][106225] Updated weights for policy 1, policy_version 1233942 (0.0005) [2023-12-28 04:06:15,744][106225] Updated weights for policy 1, policy_version 1233952 (0.0005) [2023-12-28 04:06:15,834][106226] Updated weights for policy 0, policy_version 1230818 (0.0008) [2023-12-28 04:06:15,894][106226] Updated weights for policy 0, policy_version 1230828 (0.0008) [2023-12-28 04:06:15,953][106226] Updated weights for policy 0, policy_version 1230838 (0.0008) [2023-12-28 04:06:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20207.0, 300 sec: 19799.6). Total num frames: 631095296. Throughput: 0: 10247.2, 1: 9955.9. Samples: 631082576. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:16,175][105115] Avg episode reward: [(0, '-4.221'), (1, '-4.944')] [2023-12-28 04:06:16,361][106225] Updated weights for policy 1, policy_version 1233962 (0.0008) [2023-12-28 04:06:16,427][106225] Updated weights for policy 1, policy_version 1233972 (0.0010) [2023-12-28 04:06:16,491][106225] Updated weights for policy 1, policy_version 1233982 (0.0010) [2023-12-28 04:06:16,551][106225] Updated weights for policy 1, policy_version 1233992 (0.0007) [2023-12-28 04:06:16,567][106226] Updated weights for policy 0, policy_version 1230848 (0.0009) [2023-12-28 04:06:16,625][106226] Updated weights for policy 0, policy_version 1230858 (0.0008) [2023-12-28 04:06:16,682][106226] Updated weights for policy 0, policy_version 1230868 (0.0007) [2023-12-28 04:06:17,170][106225] Updated weights for policy 1, policy_version 1234002 (0.0010) [2023-12-28 04:06:17,235][106225] Updated weights for policy 1, policy_version 1234012 (0.0010) [2023-12-28 04:06:17,298][106225] Updated weights for policy 1, policy_version 1234022 (0.0010) [2023-12-28 04:06:17,424][106226] Updated weights for policy 0, policy_version 1230878 (0.0008) [2023-12-28 04:06:17,483][106226] Updated weights for policy 0, policy_version 1230888 (0.0006) [2023-12-28 04:06:17,533][106226] Updated weights for policy 0, policy_version 1230898 (0.0005) [2023-12-28 04:06:17,911][106225] Updated weights for policy 1, policy_version 1234032 (0.0010) [2023-12-28 04:06:17,966][106225] Updated weights for policy 1, policy_version 1234042 (0.0010) [2023-12-28 04:06:18,026][106225] Updated weights for policy 1, policy_version 1234052 (0.0010) [2023-12-28 04:06:18,222][106226] Updated weights for policy 0, policy_version 1230908 (0.0009) [2023-12-28 04:06:18,273][106226] Updated weights for policy 0, policy_version 1230918 (0.0010) [2023-12-28 04:06:18,332][106226] Updated weights for policy 0, policy_version 1230928 (0.0010) [2023-12-28 04:06:18,668][106225] Updated weights for policy 1, policy_version 1234062 (0.0007) [2023-12-28 04:06:18,726][106225] Updated weights for policy 1, policy_version 1234072 (0.0006) [2023-12-28 04:06:18,786][106225] Updated weights for policy 1, policy_version 1234082 (0.0005) [2023-12-28 04:06:19,068][106226] Updated weights for policy 0, policy_version 1230938 (0.0010) [2023-12-28 04:06:19,128][106226] Updated weights for policy 0, policy_version 1230948 (0.0009) [2023-12-28 04:06:19,185][106226] Updated weights for policy 0, policy_version 1230958 (0.0008) [2023-12-28 04:06:19,244][106226] Updated weights for policy 0, policy_version 1230968 (0.0008) [2023-12-28 04:06:19,438][106225] Updated weights for policy 1, policy_version 1234092 (0.0007) [2023-12-28 04:06:19,498][106225] Updated weights for policy 1, policy_version 1234102 (0.0008) [2023-12-28 04:06:19,558][106225] Updated weights for policy 1, policy_version 1234112 (0.0009) [2023-12-28 04:06:19,999][106226] Updated weights for policy 0, policy_version 1230978 (0.0008) [2023-12-28 04:06:20,061][106226] Updated weights for policy 0, policy_version 1230988 (0.0008) [2023-12-28 04:06:20,122][106226] Updated weights for policy 0, policy_version 1230998 (0.0008) [2023-12-28 04:06:20,332][106225] Updated weights for policy 1, policy_version 1234122 (0.0008) [2023-12-28 04:06:20,396][106225] Updated weights for policy 1, policy_version 1234132 (0.0008) [2023-12-28 04:06:20,460][106225] Updated weights for policy 1, policy_version 1234142 (0.0008) [2023-12-28 04:06:20,523][106225] Updated weights for policy 1, policy_version 1234152 (0.0008) [2023-12-28 04:06:20,871][106226] Updated weights for policy 0, policy_version 1231008 (0.0008) [2023-12-28 04:06:20,937][106226] Updated weights for policy 0, policy_version 1231018 (0.0009) [2023-12-28 04:06:21,000][106226] Updated weights for policy 0, policy_version 1231028 (0.0008) [2023-12-28 04:06:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 631193600. Throughput: 0: 10108.8, 1: 10030.4. Samples: 631202436. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:21,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.926')] [2023-12-28 04:06:21,347][106225] Updated weights for policy 1, policy_version 1234162 (0.0007) [2023-12-28 04:06:21,421][106225] Updated weights for policy 1, policy_version 1234172 (0.0008) [2023-12-28 04:06:21,483][106225] Updated weights for policy 1, policy_version 1234182 (0.0008) [2023-12-28 04:06:21,737][106226] Updated weights for policy 0, policy_version 1231038 (0.0008) [2023-12-28 04:06:21,805][106226] Updated weights for policy 0, policy_version 1231048 (0.0010) [2023-12-28 04:06:21,867][106226] Updated weights for policy 0, policy_version 1231058 (0.0009) [2023-12-28 04:06:22,175][106225] Updated weights for policy 1, policy_version 1234192 (0.0007) [2023-12-28 04:06:22,234][106225] Updated weights for policy 1, policy_version 1234202 (0.0008) [2023-12-28 04:06:22,294][106225] Updated weights for policy 1, policy_version 1234212 (0.0008) [2023-12-28 04:06:22,690][106226] Updated weights for policy 0, policy_version 1231068 (0.0009) [2023-12-28 04:06:22,756][106226] Updated weights for policy 0, policy_version 1231078 (0.0008) [2023-12-28 04:06:22,820][106226] Updated weights for policy 0, policy_version 1231088 (0.0009) [2023-12-28 04:06:23,061][106225] Updated weights for policy 1, policy_version 1234222 (0.0008) [2023-12-28 04:06:23,124][106225] Updated weights for policy 1, policy_version 1234232 (0.0009) [2023-12-28 04:06:23,171][106225] Updated weights for policy 1, policy_version 1234242 (0.0009) [2023-12-28 04:06:23,439][106226] Updated weights for policy 0, policy_version 1231098 (0.0008) [2023-12-28 04:06:23,488][106226] Updated weights for policy 0, policy_version 1231108 (0.0008) [2023-12-28 04:06:23,554][106226] Updated weights for policy 0, policy_version 1231118 (0.0008) [2023-12-28 04:06:23,609][106226] Updated weights for policy 0, policy_version 1231128 (0.0008) [2023-12-28 04:06:23,911][106225] Updated weights for policy 1, policy_version 1234252 (0.0009) [2023-12-28 04:06:23,968][106225] Updated weights for policy 1, policy_version 1234262 (0.0008) [2023-12-28 04:06:24,027][106225] Updated weights for policy 1, policy_version 1234272 (0.0008) [2023-12-28 04:06:24,268][106226] Updated weights for policy 0, policy_version 1231138 (0.0010) [2023-12-28 04:06:24,332][106226] Updated weights for policy 0, policy_version 1231148 (0.0009) [2023-12-28 04:06:24,397][106226] Updated weights for policy 0, policy_version 1231158 (0.0006) [2023-12-28 04:06:24,777][106225] Updated weights for policy 1, policy_version 1234282 (0.0007) [2023-12-28 04:06:24,834][106225] Updated weights for policy 1, policy_version 1234292 (0.0008) [2023-12-28 04:06:24,896][106225] Updated weights for policy 1, policy_version 1234302 (0.0006) [2023-12-28 04:06:24,955][106225] Updated weights for policy 1, policy_version 1234312 (0.0008) [2023-12-28 04:06:25,037][106226] Updated weights for policy 0, policy_version 1231168 (0.0007) [2023-12-28 04:06:25,103][106226] Updated weights for policy 0, policy_version 1231178 (0.0005) [2023-12-28 04:06:25,159][106226] Updated weights for policy 0, policy_version 1231188 (0.0009) [2023-12-28 04:06:25,679][106225] Updated weights for policy 1, policy_version 1234322 (0.0008) [2023-12-28 04:06:25,726][106225] Updated weights for policy 1, policy_version 1234332 (0.0006) [2023-12-28 04:06:25,728][106226] Updated weights for policy 0, policy_version 1231198 (0.0007) [2023-12-28 04:06:25,775][106225] Updated weights for policy 1, policy_version 1234342 (0.0005) [2023-12-28 04:06:25,784][106226] Updated weights for policy 0, policy_version 1231208 (0.0008) [2023-12-28 04:06:25,842][106226] Updated weights for policy 0, policy_version 1231218 (0.0008) [2023-12-28 04:06:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 631291904. Throughput: 0: 10091.4, 1: 9914.7. Samples: 631259416. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:26,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-5.027')] [2023-12-28 04:06:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001231224_315252736.pth... [2023-12-28 04:06:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001234344_316039168.pth... [2023-12-28 04:06:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001230040_314949632.pth [2023-12-28 04:06:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001233192_315744256.pth [2023-12-28 04:06:26,511][106225] Updated weights for policy 1, policy_version 1234352 (0.0008) [2023-12-28 04:06:26,566][106226] Updated weights for policy 0, policy_version 1231228 (0.0008) [2023-12-28 04:06:26,576][106225] Updated weights for policy 1, policy_version 1234362 (0.0008) [2023-12-28 04:06:26,620][106226] Updated weights for policy 0, policy_version 1231238 (0.0005) [2023-12-28 04:06:26,639][106225] Updated weights for policy 1, policy_version 1234372 (0.0009) [2023-12-28 04:06:26,671][106226] Updated weights for policy 0, policy_version 1231248 (0.0008) [2023-12-28 04:06:27,345][106225] Updated weights for policy 1, policy_version 1234382 (0.0008) [2023-12-28 04:06:27,375][106226] Updated weights for policy 0, policy_version 1231258 (0.0008) [2023-12-28 04:06:27,397][106225] Updated weights for policy 1, policy_version 1234392 (0.0007) [2023-12-28 04:06:27,419][106226] Updated weights for policy 0, policy_version 1231268 (0.0006) [2023-12-28 04:06:27,440][106225] Updated weights for policy 1, policy_version 1234402 (0.0005) [2023-12-28 04:06:27,477][106226] Updated weights for policy 0, policy_version 1231278 (0.0007) [2023-12-28 04:06:27,535][106226] Updated weights for policy 0, policy_version 1231288 (0.0008) [2023-12-28 04:06:28,102][106225] Updated weights for policy 1, policy_version 1234412 (0.0007) [2023-12-28 04:06:28,153][106225] Updated weights for policy 1, policy_version 1234422 (0.0008) [2023-12-28 04:06:28,198][106225] Updated weights for policy 1, policy_version 1234432 (0.0008) [2023-12-28 04:06:28,300][106226] Updated weights for policy 0, policy_version 1231298 (0.0008) [2023-12-28 04:06:28,366][106226] Updated weights for policy 0, policy_version 1231308 (0.0008) [2023-12-28 04:06:28,430][106226] Updated weights for policy 0, policy_version 1231318 (0.0007) [2023-12-28 04:06:28,976][106225] Updated weights for policy 1, policy_version 1234442 (0.0008) [2023-12-28 04:06:29,023][106225] Updated weights for policy 1, policy_version 1234452 (0.0009) [2023-12-28 04:06:29,040][106226] Updated weights for policy 0, policy_version 1231328 (0.0006) [2023-12-28 04:06:29,080][106225] Updated weights for policy 1, policy_version 1234462 (0.0008) [2023-12-28 04:06:29,087][106226] Updated weights for policy 0, policy_version 1231338 (0.0007) [2023-12-28 04:06:29,136][106226] Updated weights for policy 0, policy_version 1231348 (0.0007) [2023-12-28 04:06:29,141][106225] Updated weights for policy 1, policy_version 1234472 (0.0009) [2023-12-28 04:06:29,777][106225] Updated weights for policy 1, policy_version 1234482 (0.0005) [2023-12-28 04:06:29,839][106225] Updated weights for policy 1, policy_version 1234492 (0.0010) [2023-12-28 04:06:29,903][106225] Updated weights for policy 1, policy_version 1234502 (0.0011) [2023-12-28 04:06:29,921][106226] Updated weights for policy 0, policy_version 1231358 (0.0008) [2023-12-28 04:06:29,989][106226] Updated weights for policy 0, policy_version 1231368 (0.0009) [2023-12-28 04:06:30,057][106226] Updated weights for policy 0, policy_version 1231378 (0.0009) [2023-12-28 04:06:30,616][106225] Updated weights for policy 1, policy_version 1234512 (0.0010) [2023-12-28 04:06:30,671][106225] Updated weights for policy 1, policy_version 1234522 (0.0010) [2023-12-28 04:06:30,728][106225] Updated weights for policy 1, policy_version 1234532 (0.0010) [2023-12-28 04:06:30,846][106226] Updated weights for policy 0, policy_version 1231388 (0.0008) [2023-12-28 04:06:30,906][106226] Updated weights for policy 0, policy_version 1231398 (0.0008) [2023-12-28 04:06:30,958][106226] Updated weights for policy 0, policy_version 1231408 (0.0008) [2023-12-28 04:06:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 631390208. Throughput: 0: 10125.8, 1: 9868.1. Samples: 631378316. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:31,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-5.187')] [2023-12-28 04:06:31,449][106225] Updated weights for policy 1, policy_version 1234542 (0.0010) [2023-12-28 04:06:31,507][106225] Updated weights for policy 1, policy_version 1234552 (0.0010) [2023-12-28 04:06:31,569][106225] Updated weights for policy 1, policy_version 1234562 (0.0010) [2023-12-28 04:06:31,687][106226] Updated weights for policy 0, policy_version 1231418 (0.0008) [2023-12-28 04:06:31,758][106226] Updated weights for policy 0, policy_version 1231428 (0.0008) [2023-12-28 04:06:31,816][106226] Updated weights for policy 0, policy_version 1231438 (0.0008) [2023-12-28 04:06:31,876][106226] Updated weights for policy 0, policy_version 1231448 (0.0008) [2023-12-28 04:06:32,266][106225] Updated weights for policy 1, policy_version 1234572 (0.0010) [2023-12-28 04:06:32,320][106225] Updated weights for policy 1, policy_version 1234582 (0.0010) [2023-12-28 04:06:32,379][106225] Updated weights for policy 1, policy_version 1234592 (0.0009) [2023-12-28 04:06:32,580][106226] Updated weights for policy 0, policy_version 1231458 (0.0008) [2023-12-28 04:06:32,645][106226] Updated weights for policy 0, policy_version 1231468 (0.0009) [2023-12-28 04:06:32,706][106226] Updated weights for policy 0, policy_version 1231478 (0.0005) [2023-12-28 04:06:33,130][106225] Updated weights for policy 1, policy_version 1234602 (0.0008) [2023-12-28 04:06:33,189][106225] Updated weights for policy 1, policy_version 1234612 (0.0009) [2023-12-28 04:06:33,246][106225] Updated weights for policy 1, policy_version 1234622 (0.0008) [2023-12-28 04:06:33,305][106225] Updated weights for policy 1, policy_version 1234632 (0.0007) [2023-12-28 04:06:33,323][106226] Updated weights for policy 0, policy_version 1231488 (0.0007) [2023-12-28 04:06:33,375][106226] Updated weights for policy 0, policy_version 1231498 (0.0008) [2023-12-28 04:06:33,419][106226] Updated weights for policy 0, policy_version 1231508 (0.0008) [2023-12-28 04:06:33,977][106225] Updated weights for policy 1, policy_version 1234642 (0.0010) [2023-12-28 04:06:34,023][106225] Updated weights for policy 1, policy_version 1234652 (0.0010) [2023-12-28 04:06:34,076][106225] Updated weights for policy 1, policy_version 1234662 (0.0010) [2023-12-28 04:06:34,092][106226] Updated weights for policy 0, policy_version 1231518 (0.0007) [2023-12-28 04:06:34,154][106226] Updated weights for policy 0, policy_version 1231528 (0.0007) [2023-12-28 04:06:34,229][106226] Updated weights for policy 0, policy_version 1231538 (0.0007) [2023-12-28 04:06:34,819][106225] Updated weights for policy 1, policy_version 1234672 (0.0009) [2023-12-28 04:06:34,869][106225] Updated weights for policy 1, policy_version 1234682 (0.0010) [2023-12-28 04:06:34,908][106226] Updated weights for policy 0, policy_version 1231548 (0.0006) [2023-12-28 04:06:34,920][106225] Updated weights for policy 1, policy_version 1234692 (0.0010) [2023-12-28 04:06:34,970][106226] Updated weights for policy 0, policy_version 1231558 (0.0007) [2023-12-28 04:06:35,029][106226] Updated weights for policy 0, policy_version 1231568 (0.0008) [2023-12-28 04:06:35,551][106225] Updated weights for policy 1, policy_version 1234702 (0.0007) [2023-12-28 04:06:35,614][106225] Updated weights for policy 1, policy_version 1234712 (0.0005) [2023-12-28 04:06:35,675][106225] Updated weights for policy 1, policy_version 1234722 (0.0005) [2023-12-28 04:06:35,818][106226] Updated weights for policy 0, policy_version 1231578 (0.0008) [2023-12-28 04:06:35,881][106226] Updated weights for policy 0, policy_version 1231588 (0.0008) [2023-12-28 04:06:35,928][106226] Updated weights for policy 0, policy_version 1231598 (0.0008) [2023-12-28 04:06:35,971][106226] Updated weights for policy 0, policy_version 1231608 (0.0007) [2023-12-28 04:06:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.6, 300 sec: 19827.4). Total num frames: 631488512. Throughput: 0: 9988.2, 1: 9888.2. Samples: 631496224. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:36,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.993')] [2023-12-28 04:06:36,315][106225] Updated weights for policy 1, policy_version 1234732 (0.0009) [2023-12-28 04:06:36,362][106225] Updated weights for policy 1, policy_version 1234742 (0.0009) [2023-12-28 04:06:36,430][106225] Updated weights for policy 1, policy_version 1234752 (0.0009) [2023-12-28 04:06:36,770][106226] Updated weights for policy 0, policy_version 1231618 (0.0010) [2023-12-28 04:06:36,835][106226] Updated weights for policy 0, policy_version 1231628 (0.0010) [2023-12-28 04:06:36,904][106226] Updated weights for policy 0, policy_version 1231638 (0.0008) [2023-12-28 04:06:37,049][106225] Updated weights for policy 1, policy_version 1234762 (0.0007) [2023-12-28 04:06:37,119][106225] Updated weights for policy 1, policy_version 1234772 (0.0005) [2023-12-28 04:06:37,184][106225] Updated weights for policy 1, policy_version 1234782 (0.0005) [2023-12-28 04:06:37,240][106225] Updated weights for policy 1, policy_version 1234792 (0.0005) [2023-12-28 04:06:37,713][106226] Updated weights for policy 0, policy_version 1231648 (0.0009) [2023-12-28 04:06:37,769][106226] Updated weights for policy 0, policy_version 1231658 (0.0005) [2023-12-28 04:06:37,783][106225] Updated weights for policy 1, policy_version 1234802 (0.0008) [2023-12-28 04:06:37,828][106226] Updated weights for policy 0, policy_version 1231668 (0.0005) [2023-12-28 04:06:37,829][106225] Updated weights for policy 1, policy_version 1234812 (0.0008) [2023-12-28 04:06:37,889][106225] Updated weights for policy 1, policy_version 1234822 (0.0005) [2023-12-28 04:06:38,540][106225] Updated weights for policy 1, policy_version 1234832 (0.0007) [2023-12-28 04:06:38,571][106226] Updated weights for policy 0, policy_version 1231678 (0.0007) [2023-12-28 04:06:38,595][106225] Updated weights for policy 1, policy_version 1234842 (0.0007) [2023-12-28 04:06:38,626][106226] Updated weights for policy 0, policy_version 1231688 (0.0008) [2023-12-28 04:06:38,657][106225] Updated weights for policy 1, policy_version 1234852 (0.0007) [2023-12-28 04:06:38,689][106226] Updated weights for policy 0, policy_version 1231698 (0.0010) [2023-12-28 04:06:39,345][106225] Updated weights for policy 1, policy_version 1234862 (0.0010) [2023-12-28 04:06:39,416][106225] Updated weights for policy 1, policy_version 1234872 (0.0007) [2023-12-28 04:06:39,437][106226] Updated weights for policy 0, policy_version 1231708 (0.0008) [2023-12-28 04:06:39,476][106225] Updated weights for policy 1, policy_version 1234882 (0.0006) [2023-12-28 04:06:39,494][106226] Updated weights for policy 0, policy_version 1231718 (0.0007) [2023-12-28 04:06:39,554][106226] Updated weights for policy 0, policy_version 1231728 (0.0008) [2023-12-28 04:06:40,247][106225] Updated weights for policy 1, policy_version 1234892 (0.0007) [2023-12-28 04:06:40,296][106226] Updated weights for policy 0, policy_version 1231738 (0.0008) [2023-12-28 04:06:40,313][106225] Updated weights for policy 1, policy_version 1234902 (0.0008) [2023-12-28 04:06:40,360][106226] Updated weights for policy 0, policy_version 1231748 (0.0008) [2023-12-28 04:06:40,384][106225] Updated weights for policy 1, policy_version 1234912 (0.0007) [2023-12-28 04:06:40,423][106226] Updated weights for policy 0, policy_version 1231758 (0.0008) [2023-12-28 04:06:40,483][106226] Updated weights for policy 0, policy_version 1231768 (0.0008) [2023-12-28 04:06:41,130][106225] Updated weights for policy 1, policy_version 1234922 (0.0008) [2023-12-28 04:06:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 631578624. Throughput: 0: 9925.8, 1: 9958.8. Samples: 631555340. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:41,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-5.193')] [2023-12-28 04:06:41,191][106225] Updated weights for policy 1, policy_version 1234932 (0.0009) [2023-12-28 04:06:41,225][106226] Updated weights for policy 0, policy_version 1231778 (0.0008) [2023-12-28 04:06:41,255][106225] Updated weights for policy 1, policy_version 1234942 (0.0009) [2023-12-28 04:06:41,292][106226] Updated weights for policy 0, policy_version 1231788 (0.0008) [2023-12-28 04:06:41,311][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001234952_316194816.pth... [2023-12-28 04:06:41,312][106225] Updated weights for policy 1, policy_version 1234952 (0.0007) [2023-12-28 04:06:41,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001233768_315891712.pth [2023-12-28 04:06:41,362][106226] Updated weights for policy 0, policy_version 1231798 (0.0007) [2023-12-28 04:06:41,376][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001231800_315400192.pth... [2023-12-28 04:06:41,380][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001230648_315105280.pth [2023-12-28 04:06:42,078][106225] Updated weights for policy 1, policy_version 1234962 (0.0009) [2023-12-28 04:06:42,079][106226] Updated weights for policy 0, policy_version 1231808 (0.0006) [2023-12-28 04:06:42,140][106225] Updated weights for policy 1, policy_version 1234972 (0.0007) [2023-12-28 04:06:42,146][106226] Updated weights for policy 0, policy_version 1231818 (0.0008) [2023-12-28 04:06:42,196][106225] Updated weights for policy 1, policy_version 1234982 (0.0005) [2023-12-28 04:06:42,202][106226] Updated weights for policy 0, policy_version 1231828 (0.0007) [2023-12-28 04:06:42,940][106225] Updated weights for policy 1, policy_version 1234992 (0.0006) [2023-12-28 04:06:42,942][106226] Updated weights for policy 0, policy_version 1231838 (0.0007) [2023-12-28 04:06:42,994][106225] Updated weights for policy 1, policy_version 1235002 (0.0005) [2023-12-28 04:06:43,000][106226] Updated weights for policy 0, policy_version 1231848 (0.0007) [2023-12-28 04:06:43,044][106225] Updated weights for policy 1, policy_version 1235012 (0.0007) [2023-12-28 04:06:43,059][106226] Updated weights for policy 0, policy_version 1231858 (0.0008) [2023-12-28 04:06:43,628][106225] Updated weights for policy 1, policy_version 1235022 (0.0005) [2023-12-28 04:06:43,666][106226] Updated weights for policy 0, policy_version 1231868 (0.0009) [2023-12-28 04:06:43,684][106225] Updated weights for policy 1, policy_version 1235032 (0.0005) [2023-12-28 04:06:43,726][106226] Updated weights for policy 0, policy_version 1231878 (0.0011) [2023-12-28 04:06:43,737][106225] Updated weights for policy 1, policy_version 1235042 (0.0010) [2023-12-28 04:06:43,783][106226] Updated weights for policy 0, policy_version 1231888 (0.0010) [2023-12-28 04:06:44,354][106225] Updated weights for policy 1, policy_version 1235052 (0.0008) [2023-12-28 04:06:44,407][106225] Updated weights for policy 1, policy_version 1235062 (0.0010) [2023-12-28 04:06:44,460][106225] Updated weights for policy 1, policy_version 1235072 (0.0010) [2023-12-28 04:06:44,472][106226] Updated weights for policy 0, policy_version 1231898 (0.0008) [2023-12-28 04:06:44,517][106226] Updated weights for policy 0, policy_version 1231908 (0.0006) [2023-12-28 04:06:44,564][106226] Updated weights for policy 0, policy_version 1231918 (0.0005) [2023-12-28 04:06:44,624][106226] Updated weights for policy 0, policy_version 1231928 (0.0006) [2023-12-28 04:06:45,230][106225] Updated weights for policy 1, policy_version 1235082 (0.0010) [2023-12-28 04:06:45,297][106225] Updated weights for policy 1, policy_version 1235092 (0.0005) [2023-12-28 04:06:45,320][106226] Updated weights for policy 0, policy_version 1231938 (0.0006) [2023-12-28 04:06:45,357][106225] Updated weights for policy 1, policy_version 1235102 (0.0006) [2023-12-28 04:06:45,379][106226] Updated weights for policy 0, policy_version 1231948 (0.0006) [2023-12-28 04:06:45,414][106225] Updated weights for policy 1, policy_version 1235112 (0.0010) [2023-12-28 04:06:45,433][106226] Updated weights for policy 0, policy_version 1231958 (0.0007) [2023-12-28 04:06:46,072][106225] Updated weights for policy 1, policy_version 1235122 (0.0006) [2023-12-28 04:06:46,128][106225] Updated weights for policy 1, policy_version 1235132 (0.0009) [2023-12-28 04:06:46,170][106226] Updated weights for policy 0, policy_version 1231968 (0.0007) [2023-12-28 04:06:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 631676928. Throughput: 0: 9835.5, 1: 9913.3. Samples: 631672812. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:46,175][105115] Avg episode reward: [(0, '-3.962'), (1, '-4.896')] [2023-12-28 04:06:46,176][106225] Updated weights for policy 1, policy_version 1235142 (0.0006) [2023-12-28 04:06:46,227][106226] Updated weights for policy 0, policy_version 1231978 (0.0008) [2023-12-28 04:06:46,285][106226] Updated weights for policy 0, policy_version 1231988 (0.0008) [2023-12-28 04:06:46,826][106225] Updated weights for policy 1, policy_version 1235152 (0.0009) [2023-12-28 04:06:46,884][106225] Updated weights for policy 1, policy_version 1235162 (0.0010) [2023-12-28 04:06:46,934][106225] Updated weights for policy 1, policy_version 1235172 (0.0010) [2023-12-28 04:06:47,056][106226] Updated weights for policy 0, policy_version 1231998 (0.0007) [2023-12-28 04:06:47,110][106226] Updated weights for policy 0, policy_version 1232008 (0.0005) [2023-12-28 04:06:47,172][106226] Updated weights for policy 0, policy_version 1232018 (0.0005) [2023-12-28 04:06:47,625][106225] Updated weights for policy 1, policy_version 1235182 (0.0007) [2023-12-28 04:06:47,693][106225] Updated weights for policy 1, policy_version 1235192 (0.0005) [2023-12-28 04:06:47,720][106226] Updated weights for policy 0, policy_version 1232028 (0.0007) [2023-12-28 04:06:47,754][106225] Updated weights for policy 1, policy_version 1235202 (0.0005) [2023-12-28 04:06:47,776][106226] Updated weights for policy 0, policy_version 1232038 (0.0007) [2023-12-28 04:06:47,842][106226] Updated weights for policy 0, policy_version 1232048 (0.0006) [2023-12-28 04:06:48,309][106225] Updated weights for policy 1, policy_version 1235212 (0.0006) [2023-12-28 04:06:48,370][106225] Updated weights for policy 1, policy_version 1235222 (0.0007) [2023-12-28 04:06:48,427][106225] Updated weights for policy 1, policy_version 1235232 (0.0006) [2023-12-28 04:06:48,490][106226] Updated weights for policy 0, policy_version 1232058 (0.0007) [2023-12-28 04:06:48,544][106226] Updated weights for policy 0, policy_version 1232068 (0.0010) [2023-12-28 04:06:48,598][106226] Updated weights for policy 0, policy_version 1232078 (0.0011) [2023-12-28 04:06:48,649][106226] Updated weights for policy 0, policy_version 1232088 (0.0011) [2023-12-28 04:06:49,055][106225] Updated weights for policy 1, policy_version 1235242 (0.0007) [2023-12-28 04:06:49,125][106225] Updated weights for policy 1, policy_version 1235252 (0.0007) [2023-12-28 04:06:49,174][106225] Updated weights for policy 1, policy_version 1235262 (0.0009) [2023-12-28 04:06:49,233][106225] Updated weights for policy 1, policy_version 1235272 (0.0008) [2023-12-28 04:06:49,311][106226] Updated weights for policy 0, policy_version 1232098 (0.0008) [2023-12-28 04:06:49,378][106226] Updated weights for policy 0, policy_version 1232108 (0.0009) [2023-12-28 04:06:49,438][106226] Updated weights for policy 0, policy_version 1232118 (0.0008) [2023-12-28 04:06:49,968][106225] Updated weights for policy 1, policy_version 1235282 (0.0007) [2023-12-28 04:06:50,023][106225] Updated weights for policy 1, policy_version 1235292 (0.0008) [2023-12-28 04:06:50,078][106225] Updated weights for policy 1, policy_version 1235302 (0.0008) [2023-12-28 04:06:50,141][106226] Updated weights for policy 0, policy_version 1232128 (0.0007) [2023-12-28 04:06:50,197][106226] Updated weights for policy 0, policy_version 1232138 (0.0006) [2023-12-28 04:06:50,252][106226] Updated weights for policy 0, policy_version 1232148 (0.0005) [2023-12-28 04:06:50,857][106225] Updated weights for policy 1, policy_version 1235312 (0.0008) [2023-12-28 04:06:50,917][106225] Updated weights for policy 1, policy_version 1235322 (0.0007) [2023-12-28 04:06:50,926][106226] Updated weights for policy 0, policy_version 1232158 (0.0009) [2023-12-28 04:06:50,976][106225] Updated weights for policy 1, policy_version 1235332 (0.0005) [2023-12-28 04:06:50,981][106226] Updated weights for policy 0, policy_version 1232168 (0.0011) [2023-12-28 04:06:51,045][106226] Updated weights for policy 0, policy_version 1232178 (0.0010) [2023-12-28 04:06:51,174][105115] Fps is (10 sec: 21299.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 631791616. Throughput: 0: 9845.1, 1: 9958.7. Samples: 631794768. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:51,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.963')] [2023-12-28 04:06:51,759][106226] Updated weights for policy 0, policy_version 1232188 (0.0007) [2023-12-28 04:06:51,803][106225] Updated weights for policy 1, policy_version 1235342 (0.0006) [2023-12-28 04:06:51,813][106226] Updated weights for policy 0, policy_version 1232198 (0.0007) [2023-12-28 04:06:51,859][106225] Updated weights for policy 1, policy_version 1235352 (0.0008) [2023-12-28 04:06:51,880][106226] Updated weights for policy 0, policy_version 1232208 (0.0007) [2023-12-28 04:06:51,919][106225] Updated weights for policy 1, policy_version 1235362 (0.0007) [2023-12-28 04:06:52,500][106226] Updated weights for policy 0, policy_version 1232218 (0.0007) [2023-12-28 04:06:52,567][106226] Updated weights for policy 0, policy_version 1232228 (0.0006) [2023-12-28 04:06:52,631][106226] Updated weights for policy 0, policy_version 1232238 (0.0006) [2023-12-28 04:06:52,686][106226] Updated weights for policy 0, policy_version 1232248 (0.0007) [2023-12-28 04:06:52,721][106225] Updated weights for policy 1, policy_version 1235372 (0.0006) [2023-12-28 04:06:52,784][106225] Updated weights for policy 1, policy_version 1235382 (0.0005) [2023-12-28 04:06:52,848][106225] Updated weights for policy 1, policy_version 1235392 (0.0010) [2023-12-28 04:06:53,305][106226] Updated weights for policy 0, policy_version 1232258 (0.0008) [2023-12-28 04:06:53,351][106226] Updated weights for policy 0, policy_version 1232268 (0.0005) [2023-12-28 04:06:53,409][106226] Updated weights for policy 0, policy_version 1232278 (0.0005) [2023-12-28 04:06:53,486][106225] Updated weights for policy 1, policy_version 1235402 (0.0009) [2023-12-28 04:06:53,546][106225] Updated weights for policy 1, policy_version 1235412 (0.0005) [2023-12-28 04:06:53,611][106225] Updated weights for policy 1, policy_version 1235422 (0.0006) [2023-12-28 04:06:53,660][106225] Updated weights for policy 1, policy_version 1235432 (0.0008) [2023-12-28 04:06:53,940][106226] Updated weights for policy 0, policy_version 1232288 (0.0009) [2023-12-28 04:06:54,003][106226] Updated weights for policy 0, policy_version 1232298 (0.0011) [2023-12-28 04:06:54,060][106226] Updated weights for policy 0, policy_version 1232308 (0.0010) [2023-12-28 04:06:54,239][106225] Updated weights for policy 1, policy_version 1235442 (0.0009) [2023-12-28 04:06:54,302][106225] Updated weights for policy 1, policy_version 1235452 (0.0010) [2023-12-28 04:06:54,361][106225] Updated weights for policy 1, policy_version 1235462 (0.0009) [2023-12-28 04:06:54,763][106226] Updated weights for policy 0, policy_version 1232318 (0.0010) [2023-12-28 04:06:54,814][106226] Updated weights for policy 0, policy_version 1232328 (0.0009) [2023-12-28 04:06:54,874][106226] Updated weights for policy 0, policy_version 1232338 (0.0009) [2023-12-28 04:06:55,007][106225] Updated weights for policy 1, policy_version 1235472 (0.0006) [2023-12-28 04:06:55,062][106225] Updated weights for policy 1, policy_version 1235482 (0.0008) [2023-12-28 04:06:55,113][106225] Updated weights for policy 1, policy_version 1235492 (0.0008) [2023-12-28 04:06:55,518][106226] Updated weights for policy 0, policy_version 1232348 (0.0007) [2023-12-28 04:06:55,567][106226] Updated weights for policy 0, policy_version 1232358 (0.0008) [2023-12-28 04:06:55,615][106226] Updated weights for policy 0, policy_version 1232368 (0.0005) [2023-12-28 04:06:55,811][106225] Updated weights for policy 1, policy_version 1235502 (0.0008) [2023-12-28 04:06:55,863][106225] Updated weights for policy 1, policy_version 1235512 (0.0008) [2023-12-28 04:06:55,924][106225] Updated weights for policy 1, policy_version 1235522 (0.0005) [2023-12-28 04:06:56,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 631889920. Throughput: 0: 9903.7, 1: 9925.2. Samples: 631855864. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:06:56,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.920')] [2023-12-28 04:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001235528_316342272.pth... [2023-12-28 04:06:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001232376_315547648.pth... [2023-12-28 04:06:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001234344_316039168.pth [2023-12-28 04:06:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001231224_315252736.pth [2023-12-28 04:06:56,282][106226] Updated weights for policy 0, policy_version 1232378 (0.0006) [2023-12-28 04:06:56,339][106226] Updated weights for policy 0, policy_version 1232388 (0.0010) [2023-12-28 04:06:56,393][106226] Updated weights for policy 0, policy_version 1232398 (0.0011) [2023-12-28 04:06:56,451][106226] Updated weights for policy 0, policy_version 1232408 (0.0009) [2023-12-28 04:06:56,503][106225] Updated weights for policy 1, policy_version 1235532 (0.0005) [2023-12-28 04:06:56,565][106225] Updated weights for policy 1, policy_version 1235542 (0.0006) [2023-12-28 04:06:56,618][106225] Updated weights for policy 1, policy_version 1235552 (0.0006) [2023-12-28 04:06:57,125][106225] Updated weights for policy 1, policy_version 1235562 (0.0005) [2023-12-28 04:06:57,171][106225] Updated weights for policy 1, policy_version 1235572 (0.0005) [2023-12-28 04:06:57,173][106226] Updated weights for policy 0, policy_version 1232418 (0.0007) [2023-12-28 04:06:57,220][106226] Updated weights for policy 0, policy_version 1232428 (0.0007) [2023-12-28 04:06:57,221][106225] Updated weights for policy 1, policy_version 1235582 (0.0005) [2023-12-28 04:06:57,270][106225] Updated weights for policy 1, policy_version 1235592 (0.0005) [2023-12-28 04:06:57,276][106226] Updated weights for policy 0, policy_version 1232438 (0.0009) [2023-12-28 04:06:57,815][106225] Updated weights for policy 1, policy_version 1235602 (0.0006) [2023-12-28 04:06:57,869][106225] Updated weights for policy 1, policy_version 1235612 (0.0007) [2023-12-28 04:06:57,905][106226] Updated weights for policy 0, policy_version 1232448 (0.0009) [2023-12-28 04:06:57,934][106225] Updated weights for policy 1, policy_version 1235622 (0.0005) [2023-12-28 04:06:57,966][106226] Updated weights for policy 0, policy_version 1232458 (0.0010) [2023-12-28 04:06:58,019][106226] Updated weights for policy 0, policy_version 1232468 (0.0008) [2023-12-28 04:06:58,521][106225] Updated weights for policy 1, policy_version 1235632 (0.0008) [2023-12-28 04:06:58,587][106225] Updated weights for policy 1, policy_version 1235642 (0.0010) [2023-12-28 04:06:58,648][106225] Updated weights for policy 1, policy_version 1235652 (0.0008) [2023-12-28 04:06:58,801][106226] Updated weights for policy 0, policy_version 1232478 (0.0009) [2023-12-28 04:06:58,880][106226] Updated weights for policy 0, policy_version 1232488 (0.0009) [2023-12-28 04:06:58,939][106226] Updated weights for policy 0, policy_version 1232498 (0.0008) [2023-12-28 04:06:59,530][106225] Updated weights for policy 1, policy_version 1235662 (0.0008) [2023-12-28 04:06:59,589][106225] Updated weights for policy 1, policy_version 1235672 (0.0007) [2023-12-28 04:06:59,660][106225] Updated weights for policy 1, policy_version 1235682 (0.0007) [2023-12-28 04:06:59,696][106226] Updated weights for policy 0, policy_version 1232508 (0.0007) [2023-12-28 04:06:59,760][106226] Updated weights for policy 0, policy_version 1232518 (0.0009) [2023-12-28 04:06:59,817][106226] Updated weights for policy 0, policy_version 1232528 (0.0008) [2023-12-28 04:07:00,345][106225] Updated weights for policy 1, policy_version 1235692 (0.0008) [2023-12-28 04:07:00,410][106225] Updated weights for policy 1, policy_version 1235702 (0.0009) [2023-12-28 04:07:00,474][106225] Updated weights for policy 1, policy_version 1235712 (0.0008) [2023-12-28 04:07:00,503][106226] Updated weights for policy 0, policy_version 1232538 (0.0008) [2023-12-28 04:07:00,554][106226] Updated weights for policy 0, policy_version 1232548 (0.0008) [2023-12-28 04:07:00,615][106226] Updated weights for policy 0, policy_version 1232558 (0.0006) [2023-12-28 04:07:00,671][106226] Updated weights for policy 0, policy_version 1232568 (0.0005) [2023-12-28 04:07:01,109][106225] Updated weights for policy 1, policy_version 1235722 (0.0006) [2023-12-28 04:07:01,172][106225] Updated weights for policy 1, policy_version 1235732 (0.0008) [2023-12-28 04:07:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 631988224. Throughput: 0: 9886.1, 1: 10069.4. Samples: 631980572. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:07:01,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.936')] [2023-12-28 04:07:01,240][106225] Updated weights for policy 1, policy_version 1235742 (0.0007) [2023-12-28 04:07:01,303][106225] Updated weights for policy 1, policy_version 1235752 (0.0007) [2023-12-28 04:07:01,333][106226] Updated weights for policy 0, policy_version 1232578 (0.0008) [2023-12-28 04:07:01,403][106226] Updated weights for policy 0, policy_version 1232588 (0.0008) [2023-12-28 04:07:01,465][106226] Updated weights for policy 0, policy_version 1232598 (0.0008) [2023-12-28 04:07:02,060][106225] Updated weights for policy 1, policy_version 1235762 (0.0009) [2023-12-28 04:07:02,122][106225] Updated weights for policy 1, policy_version 1235772 (0.0009) [2023-12-28 04:07:02,174][106225] Updated weights for policy 1, policy_version 1235782 (0.0009) [2023-12-28 04:07:02,294][106226] Updated weights for policy 0, policy_version 1232608 (0.0009) [2023-12-28 04:07:02,359][106226] Updated weights for policy 0, policy_version 1232618 (0.0009) [2023-12-28 04:07:02,420][106226] Updated weights for policy 0, policy_version 1232628 (0.0008) [2023-12-28 04:07:02,964][106225] Updated weights for policy 1, policy_version 1235792 (0.0006) [2023-12-28 04:07:03,030][106225] Updated weights for policy 1, policy_version 1235802 (0.0005) [2023-12-28 04:07:03,059][106226] Updated weights for policy 0, policy_version 1232638 (0.0009) [2023-12-28 04:07:03,092][106225] Updated weights for policy 1, policy_version 1235812 (0.0006) [2023-12-28 04:07:03,105][106226] Updated weights for policy 0, policy_version 1232648 (0.0010) [2023-12-28 04:07:03,163][106226] Updated weights for policy 0, policy_version 1232658 (0.0010) [2023-12-28 04:07:03,763][106225] Updated weights for policy 1, policy_version 1235822 (0.0008) [2023-12-28 04:07:03,793][106226] Updated weights for policy 0, policy_version 1232668 (0.0009) [2023-12-28 04:07:03,819][106225] Updated weights for policy 1, policy_version 1235832 (0.0008) [2023-12-28 04:07:03,861][106226] Updated weights for policy 0, policy_version 1232678 (0.0007) [2023-12-28 04:07:03,884][106225] Updated weights for policy 1, policy_version 1235842 (0.0007) [2023-12-28 04:07:03,925][106226] Updated weights for policy 0, policy_version 1232688 (0.0009) [2023-12-28 04:07:04,522][106225] Updated weights for policy 1, policy_version 1235852 (0.0007) [2023-12-28 04:07:04,591][106225] Updated weights for policy 1, policy_version 1235862 (0.0009) [2023-12-28 04:07:04,667][106225] Updated weights for policy 1, policy_version 1235872 (0.0007) [2023-12-28 04:07:04,714][106226] Updated weights for policy 0, policy_version 1232698 (0.0009) [2023-12-28 04:07:04,770][106226] Updated weights for policy 0, policy_version 1232708 (0.0008) [2023-12-28 04:07:04,830][106226] Updated weights for policy 0, policy_version 1232718 (0.0009) [2023-12-28 04:07:04,892][106226] Updated weights for policy 0, policy_version 1232728 (0.0009) [2023-12-28 04:07:05,321][106225] Updated weights for policy 1, policy_version 1235882 (0.0007) [2023-12-28 04:07:05,369][106225] Updated weights for policy 1, policy_version 1235892 (0.0005) [2023-12-28 04:07:05,413][106225] Updated weights for policy 1, policy_version 1235902 (0.0006) [2023-12-28 04:07:05,457][106225] Updated weights for policy 1, policy_version 1235912 (0.0008) [2023-12-28 04:07:05,631][106226] Updated weights for policy 0, policy_version 1232738 (0.0008) [2023-12-28 04:07:05,687][106226] Updated weights for policy 0, policy_version 1232748 (0.0008) [2023-12-28 04:07:05,741][106226] Updated weights for policy 0, policy_version 1232758 (0.0008) [2023-12-28 04:07:06,172][106225] Updated weights for policy 1, policy_version 1235922 (0.0008) [2023-12-28 04:07:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 632086528. Throughput: 0: 9881.0, 1: 10022.2. Samples: 632098076. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:07:06,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-5.151')] [2023-12-28 04:07:06,237][106225] Updated weights for policy 1, policy_version 1235932 (0.0008) [2023-12-28 04:07:06,297][106225] Updated weights for policy 1, policy_version 1235942 (0.0008) [2023-12-28 04:07:06,488][106226] Updated weights for policy 0, policy_version 1232768 (0.0009) [2023-12-28 04:07:06,558][106226] Updated weights for policy 0, policy_version 1232778 (0.0009) [2023-12-28 04:07:06,626][106226] Updated weights for policy 0, policy_version 1232788 (0.0009) [2023-12-28 04:07:07,065][106225] Updated weights for policy 1, policy_version 1235952 (0.0008) [2023-12-28 04:07:07,127][106225] Updated weights for policy 1, policy_version 1235962 (0.0006) [2023-12-28 04:07:07,194][106225] Updated weights for policy 1, policy_version 1235972 (0.0008) [2023-12-28 04:07:07,278][106226] Updated weights for policy 0, policy_version 1232798 (0.0008) [2023-12-28 04:07:07,334][106226] Updated weights for policy 0, policy_version 1232808 (0.0009) [2023-12-28 04:07:07,397][106226] Updated weights for policy 0, policy_version 1232818 (0.0009) [2023-12-28 04:07:07,888][106225] Updated weights for policy 1, policy_version 1235982 (0.0008) [2023-12-28 04:07:07,944][106225] Updated weights for policy 1, policy_version 1235992 (0.0008) [2023-12-28 04:07:08,003][106225] Updated weights for policy 1, policy_version 1236002 (0.0009) [2023-12-28 04:07:08,058][106226] Updated weights for policy 0, policy_version 1232828 (0.0008) [2023-12-28 04:07:08,118][106226] Updated weights for policy 0, policy_version 1232838 (0.0005) [2023-12-28 04:07:08,169][106226] Updated weights for policy 0, policy_version 1232848 (0.0005) [2023-12-28 04:07:08,696][106225] Updated weights for policy 1, policy_version 1236012 (0.0008) [2023-12-28 04:07:08,710][106226] Updated weights for policy 0, policy_version 1232858 (0.0006) [2023-12-28 04:07:08,749][106225] Updated weights for policy 1, policy_version 1236022 (0.0006) [2023-12-28 04:07:08,761][106226] Updated weights for policy 0, policy_version 1232868 (0.0006) [2023-12-28 04:07:08,809][106225] Updated weights for policy 1, policy_version 1236032 (0.0006) [2023-12-28 04:07:08,819][106226] Updated weights for policy 0, policy_version 1232878 (0.0008) [2023-12-28 04:07:08,877][106226] Updated weights for policy 0, policy_version 1232888 (0.0007) [2023-12-28 04:07:09,606][106226] Updated weights for policy 0, policy_version 1232898 (0.0008) [2023-12-28 04:07:09,609][106225] Updated weights for policy 1, policy_version 1236042 (0.0007) [2023-12-28 04:07:09,665][106225] Updated weights for policy 1, policy_version 1236052 (0.0011) [2023-12-28 04:07:09,671][106226] Updated weights for policy 0, policy_version 1232908 (0.0007) [2023-12-28 04:07:09,721][106225] Updated weights for policy 1, policy_version 1236062 (0.0011) [2023-12-28 04:07:09,735][106226] Updated weights for policy 0, policy_version 1232918 (0.0006) [2023-12-28 04:07:09,777][106225] Updated weights for policy 1, policy_version 1236072 (0.0010) [2023-12-28 04:07:10,442][106226] Updated weights for policy 0, policy_version 1232928 (0.0007) [2023-12-28 04:07:10,501][106226] Updated weights for policy 0, policy_version 1232938 (0.0006) [2023-12-28 04:07:10,562][106225] Updated weights for policy 1, policy_version 1236082 (0.0006) [2023-12-28 04:07:10,569][106226] Updated weights for policy 0, policy_version 1232948 (0.0008) [2023-12-28 04:07:10,615][106225] Updated weights for policy 1, policy_version 1236092 (0.0008) [2023-12-28 04:07:10,675][106225] Updated weights for policy 1, policy_version 1236102 (0.0005) [2023-12-28 04:07:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 632184832. Throughput: 0: 9929.3, 1: 10049.8. Samples: 632158476. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:07:11,175][105115] Avg episode reward: [(0, '-4.673'), (1, '-4.933')] [2023-12-28 04:07:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001236104_316489728.pth... [2023-12-28 04:07:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001232952_315695104.pth... [2023-12-28 04:07:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001234952_316194816.pth [2023-12-28 04:07:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001231800_315400192.pth [2023-12-28 04:07:11,294][106226] Updated weights for policy 0, policy_version 1232958 (0.0008) [2023-12-28 04:07:11,359][106226] Updated weights for policy 0, policy_version 1232968 (0.0008) [2023-12-28 04:07:11,444][106226] Updated weights for policy 0, policy_version 1232978 (0.0007) [2023-12-28 04:07:11,459][106225] Updated weights for policy 1, policy_version 1236112 (0.0008) [2023-12-28 04:07:11,517][106225] Updated weights for policy 1, policy_version 1236122 (0.0007) [2023-12-28 04:07:11,584][106225] Updated weights for policy 1, policy_version 1236132 (0.0008) [2023-12-28 04:07:12,252][106226] Updated weights for policy 0, policy_version 1232988 (0.0007) [2023-12-28 04:07:12,314][106226] Updated weights for policy 0, policy_version 1232998 (0.0008) [2023-12-28 04:07:12,376][106225] Updated weights for policy 1, policy_version 1236142 (0.0008) [2023-12-28 04:07:12,390][106226] Updated weights for policy 0, policy_version 1233008 (0.0009) [2023-12-28 04:07:12,440][106225] Updated weights for policy 1, policy_version 1236152 (0.0006) [2023-12-28 04:07:12,490][106225] Updated weights for policy 1, policy_version 1236162 (0.0009) [2023-12-28 04:07:13,012][106226] Updated weights for policy 0, policy_version 1233018 (0.0008) [2023-12-28 04:07:13,079][106226] Updated weights for policy 0, policy_version 1233028 (0.0006) [2023-12-28 04:07:13,140][106226] Updated weights for policy 0, policy_version 1233038 (0.0006) [2023-12-28 04:07:13,198][106226] Updated weights for policy 0, policy_version 1233048 (0.0005) [2023-12-28 04:07:13,280][106225] Updated weights for policy 1, policy_version 1236172 (0.0008) [2023-12-28 04:07:13,330][106225] Updated weights for policy 1, policy_version 1236182 (0.0009) [2023-12-28 04:07:13,375][106225] Updated weights for policy 1, policy_version 1236192 (0.0008) [2023-12-28 04:07:13,807][106226] Updated weights for policy 0, policy_version 1233058 (0.0005) [2023-12-28 04:07:13,860][106226] Updated weights for policy 0, policy_version 1233068 (0.0008) [2023-12-28 04:07:13,912][106226] Updated weights for policy 0, policy_version 1233078 (0.0008) [2023-12-28 04:07:14,122][106225] Updated weights for policy 1, policy_version 1236202 (0.0008) [2023-12-28 04:07:14,186][106225] Updated weights for policy 1, policy_version 1236212 (0.0007) [2023-12-28 04:07:14,250][106225] Updated weights for policy 1, policy_version 1236222 (0.0007) [2023-12-28 04:07:14,315][106225] Updated weights for policy 1, policy_version 1236232 (0.0007) [2023-12-28 04:07:14,563][106226] Updated weights for policy 0, policy_version 1233088 (0.0006) [2023-12-28 04:07:14,632][106226] Updated weights for policy 0, policy_version 1233098 (0.0005) [2023-12-28 04:07:14,690][106226] Updated weights for policy 0, policy_version 1233108 (0.0007) [2023-12-28 04:07:15,120][106225] Updated weights for policy 1, policy_version 1236242 (0.0009) [2023-12-28 04:07:15,178][106225] Updated weights for policy 1, policy_version 1236252 (0.0008) [2023-12-28 04:07:15,241][106225] Updated weights for policy 1, policy_version 1236262 (0.0009) [2023-12-28 04:07:15,272][106226] Updated weights for policy 0, policy_version 1233118 (0.0006) [2023-12-28 04:07:15,341][106226] Updated weights for policy 0, policy_version 1233128 (0.0006) [2023-12-28 04:07:15,404][106226] Updated weights for policy 0, policy_version 1233138 (0.0006) [2023-12-28 04:07:15,992][106225] Updated weights for policy 1, policy_version 1236272 (0.0008) [2023-12-28 04:07:16,043][106226] Updated weights for policy 0, policy_version 1233148 (0.0006) [2023-12-28 04:07:16,048][106225] Updated weights for policy 1, policy_version 1236282 (0.0007) [2023-12-28 04:07:16,097][106225] Updated weights for policy 1, policy_version 1236292 (0.0006) [2023-12-28 04:07:16,099][106226] Updated weights for policy 0, policy_version 1233158 (0.0006) [2023-12-28 04:07:16,150][106226] Updated weights for policy 0, policy_version 1233168 (0.0009) [2023-12-28 04:07:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 632283136. Throughput: 0: 9938.0, 1: 9952.7. Samples: 632273396. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 04:07:16,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-5.087')] [2023-12-28 04:07:16,829][106226] Updated weights for policy 0, policy_version 1233178 (0.0009) [2023-12-28 04:07:16,867][106225] Updated weights for policy 1, policy_version 1236302 (0.0007) [2023-12-28 04:07:16,890][106226] Updated weights for policy 0, policy_version 1233188 (0.0007) [2023-12-28 04:07:16,924][106225] Updated weights for policy 1, policy_version 1236312 (0.0007) [2023-12-28 04:07:16,939][106226] Updated weights for policy 0, policy_version 1233198 (0.0007) [2023-12-28 04:07:16,985][106225] Updated weights for policy 1, policy_version 1236322 (0.0007) [2023-12-28 04:07:16,994][106226] Updated weights for policy 0, policy_version 1233208 (0.0009) [2023-12-28 04:07:17,655][106226] Updated weights for policy 0, policy_version 1233218 (0.0008) [2023-12-28 04:07:17,713][106226] Updated weights for policy 0, policy_version 1233228 (0.0007) [2023-12-28 04:07:17,720][106225] Updated weights for policy 1, policy_version 1236332 (0.0007) [2023-12-28 04:07:17,773][106226] Updated weights for policy 0, policy_version 1233238 (0.0007) [2023-12-28 04:07:17,783][106225] Updated weights for policy 1, policy_version 1236342 (0.0006) [2023-12-28 04:07:17,845][106225] Updated weights for policy 1, policy_version 1236352 (0.0008) [2023-12-28 04:07:18,405][106226] Updated weights for policy 0, policy_version 1233248 (0.0008) [2023-12-28 04:07:18,463][106226] Updated weights for policy 0, policy_version 1233258 (0.0008) [2023-12-28 04:07:18,529][106226] Updated weights for policy 0, policy_version 1233268 (0.0009) [2023-12-28 04:07:18,618][106225] Updated weights for policy 1, policy_version 1236362 (0.0010) [2023-12-28 04:07:18,693][106225] Updated weights for policy 1, policy_version 1236372 (0.0009) [2023-12-28 04:07:18,753][106225] Updated weights for policy 1, policy_version 1236382 (0.0010) [2023-12-28 04:07:18,814][106225] Updated weights for policy 1, policy_version 1236392 (0.0010) [2023-12-28 04:07:19,259][106226] Updated weights for policy 0, policy_version 1233278 (0.0009) [2023-12-28 04:07:19,319][106226] Updated weights for policy 0, policy_version 1233288 (0.0008) [2023-12-28 04:07:19,392][106226] Updated weights for policy 0, policy_version 1233298 (0.0007) [2023-12-28 04:07:19,428][106225] Updated weights for policy 1, policy_version 1236402 (0.0010) [2023-12-28 04:07:19,497][106225] Updated weights for policy 1, policy_version 1236412 (0.0007) [2023-12-28 04:07:19,563][106225] Updated weights for policy 1, policy_version 1236422 (0.0010) [2023-12-28 04:07:20,131][106226] Updated weights for policy 0, policy_version 1233308 (0.0006) [2023-12-28 04:07:20,192][106226] Updated weights for policy 0, policy_version 1233318 (0.0006) [2023-12-28 04:07:20,249][106226] Updated weights for policy 0, policy_version 1233328 (0.0009) [2023-12-28 04:07:20,295][106225] Updated weights for policy 1, policy_version 1236432 (0.0008) [2023-12-28 04:07:20,358][106225] Updated weights for policy 1, policy_version 1236442 (0.0008) [2023-12-28 04:07:20,424][106225] Updated weights for policy 1, policy_version 1236452 (0.0005) [2023-12-28 04:07:20,926][106226] Updated weights for policy 0, policy_version 1233338 (0.0009) [2023-12-28 04:07:20,993][106226] Updated weights for policy 0, policy_version 1233348 (0.0009) [2023-12-28 04:07:21,082][106226] Updated weights for policy 0, policy_version 1233358 (0.0010) [2023-12-28 04:07:21,135][106225] Updated weights for policy 1, policy_version 1236462 (0.0007) [2023-12-28 04:07:21,145][106226] Updated weights for policy 0, policy_version 1233368 (0.0008) [2023-12-28 04:07:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 632381440. Throughput: 0: 9985.6, 1: 9893.0. Samples: 632390760. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:21,175][105115] Avg episode reward: [(0, '-4.038'), (1, '-4.967')] [2023-12-28 04:07:21,200][106225] Updated weights for policy 1, policy_version 1236472 (0.0007) [2023-12-28 04:07:21,265][106225] Updated weights for policy 1, policy_version 1236482 (0.0008) [2023-12-28 04:07:21,873][106226] Updated weights for policy 0, policy_version 1233378 (0.0006) [2023-12-28 04:07:21,929][106226] Updated weights for policy 0, policy_version 1233388 (0.0005) [2023-12-28 04:07:21,984][106226] Updated weights for policy 0, policy_version 1233398 (0.0006) [2023-12-28 04:07:22,034][106225] Updated weights for policy 1, policy_version 1236492 (0.0009) [2023-12-28 04:07:22,089][106225] Updated weights for policy 1, policy_version 1236502 (0.0010) [2023-12-28 04:07:22,141][106225] Updated weights for policy 1, policy_version 1236512 (0.0010) [2023-12-28 04:07:22,711][106226] Updated weights for policy 0, policy_version 1233408 (0.0007) [2023-12-28 04:07:22,777][106226] Updated weights for policy 0, policy_version 1233418 (0.0010) [2023-12-28 04:07:22,846][106226] Updated weights for policy 0, policy_version 1233428 (0.0010) [2023-12-28 04:07:22,900][106225] Updated weights for policy 1, policy_version 1236522 (0.0010) [2023-12-28 04:07:22,957][106225] Updated weights for policy 1, policy_version 1236532 (0.0007) [2023-12-28 04:07:23,013][106225] Updated weights for policy 1, policy_version 1236542 (0.0008) [2023-12-28 04:07:23,061][106225] Updated weights for policy 1, policy_version 1236552 (0.0007) [2023-12-28 04:07:23,555][106226] Updated weights for policy 0, policy_version 1233438 (0.0011) [2023-12-28 04:07:23,608][106226] Updated weights for policy 0, policy_version 1233448 (0.0010) [2023-12-28 04:07:23,661][106226] Updated weights for policy 0, policy_version 1233458 (0.0010) [2023-12-28 04:07:23,771][106225] Updated weights for policy 1, policy_version 1236562 (0.0008) [2023-12-28 04:07:23,823][106225] Updated weights for policy 1, policy_version 1236572 (0.0009) [2023-12-28 04:07:23,883][106225] Updated weights for policy 1, policy_version 1236582 (0.0009) [2023-12-28 04:07:24,368][106226] Updated weights for policy 0, policy_version 1233468 (0.0008) [2023-12-28 04:07:24,415][106226] Updated weights for policy 0, policy_version 1233478 (0.0006) [2023-12-28 04:07:24,470][106226] Updated weights for policy 0, policy_version 1233488 (0.0005) [2023-12-28 04:07:24,597][106225] Updated weights for policy 1, policy_version 1236592 (0.0007) [2023-12-28 04:07:24,651][106225] Updated weights for policy 1, policy_version 1236602 (0.0008) [2023-12-28 04:07:24,711][106225] Updated weights for policy 1, policy_version 1236612 (0.0005) [2023-12-28 04:07:25,055][106226] Updated weights for policy 0, policy_version 1233498 (0.0005) [2023-12-28 04:07:25,113][106226] Updated weights for policy 0, policy_version 1233508 (0.0007) [2023-12-28 04:07:25,168][106226] Updated weights for policy 0, policy_version 1233518 (0.0010) [2023-12-28 04:07:25,225][106226] Updated weights for policy 0, policy_version 1233528 (0.0010) [2023-12-28 04:07:25,365][106225] Updated weights for policy 1, policy_version 1236622 (0.0007) [2023-12-28 04:07:25,412][106225] Updated weights for policy 1, policy_version 1236632 (0.0007) [2023-12-28 04:07:25,462][106225] Updated weights for policy 1, policy_version 1236642 (0.0008) [2023-12-28 04:07:25,870][106226] Updated weights for policy 0, policy_version 1233538 (0.0009) [2023-12-28 04:07:25,929][106226] Updated weights for policy 0, policy_version 1233548 (0.0010) [2023-12-28 04:07:25,993][106226] Updated weights for policy 0, policy_version 1233558 (0.0005) [2023-12-28 04:07:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 632479744. Throughput: 0: 10028.0, 1: 9794.8. Samples: 632447364. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:26,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-5.039')] [2023-12-28 04:07:26,179][106225] Updated weights for policy 1, policy_version 1236652 (0.0008) [2023-12-28 04:07:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001233560_315850752.pth... [2023-12-28 04:07:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001232376_315547648.pth [2023-12-28 04:07:26,237][106225] Updated weights for policy 1, policy_version 1236662 (0.0005) [2023-12-28 04:07:26,294][106225] Updated weights for policy 1, policy_version 1236672 (0.0007) [2023-12-28 04:07:26,335][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001236680_316637184.pth... [2023-12-28 04:07:26,339][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001235528_316342272.pth [2023-12-28 04:07:26,528][106226] Updated weights for policy 0, policy_version 1233568 (0.0005) [2023-12-28 04:07:26,578][106226] Updated weights for policy 0, policy_version 1233578 (0.0005) [2023-12-28 04:07:26,630][106226] Updated weights for policy 0, policy_version 1233588 (0.0009) [2023-12-28 04:07:27,076][106225] Updated weights for policy 1, policy_version 1236682 (0.0009) [2023-12-28 04:07:27,125][106225] Updated weights for policy 1, policy_version 1236692 (0.0008) [2023-12-28 04:07:27,185][106225] Updated weights for policy 1, policy_version 1236702 (0.0008) [2023-12-28 04:07:27,215][106226] Updated weights for policy 0, policy_version 1233598 (0.0010) [2023-12-28 04:07:27,236][106225] Updated weights for policy 1, policy_version 1236712 (0.0005) [2023-12-28 04:07:27,264][106226] Updated weights for policy 0, policy_version 1233608 (0.0010) [2023-12-28 04:07:27,326][106226] Updated weights for policy 0, policy_version 1233618 (0.0008) [2023-12-28 04:07:27,866][106226] Updated weights for policy 0, policy_version 1233628 (0.0005) [2023-12-28 04:07:27,875][106225] Updated weights for policy 1, policy_version 1236722 (0.0006) [2023-12-28 04:07:27,914][106226] Updated weights for policy 0, policy_version 1233638 (0.0005) [2023-12-28 04:07:27,921][106225] Updated weights for policy 1, policy_version 1236732 (0.0005) [2023-12-28 04:07:27,969][106226] Updated weights for policy 0, policy_version 1233648 (0.0005) [2023-12-28 04:07:27,974][106225] Updated weights for policy 1, policy_version 1236742 (0.0005) [2023-12-28 04:07:28,540][106226] Updated weights for policy 0, policy_version 1233658 (0.0006) [2023-12-28 04:07:28,581][106225] Updated weights for policy 1, policy_version 1236752 (0.0005) [2023-12-28 04:07:28,603][106226] Updated weights for policy 0, policy_version 1233668 (0.0011) [2023-12-28 04:07:28,638][106225] Updated weights for policy 1, policy_version 1236762 (0.0005) [2023-12-28 04:07:28,670][106226] Updated weights for policy 0, policy_version 1233678 (0.0011) [2023-12-28 04:07:28,697][106225] Updated weights for policy 1, policy_version 1236772 (0.0007) [2023-12-28 04:07:28,730][106226] Updated weights for policy 0, policy_version 1233688 (0.0010) [2023-12-28 04:07:29,272][106225] Updated weights for policy 1, policy_version 1236782 (0.0008) [2023-12-28 04:07:29,330][106225] Updated weights for policy 1, policy_version 1236792 (0.0008) [2023-12-28 04:07:29,339][106226] Updated weights for policy 0, policy_version 1233698 (0.0010) [2023-12-28 04:07:29,397][106225] Updated weights for policy 1, policy_version 1236802 (0.0010) [2023-12-28 04:07:29,406][106226] Updated weights for policy 0, policy_version 1233708 (0.0010) [2023-12-28 04:07:29,466][106226] Updated weights for policy 0, policy_version 1233718 (0.0010) [2023-12-28 04:07:30,017][106225] Updated weights for policy 1, policy_version 1236812 (0.0008) [2023-12-28 04:07:30,067][106225] Updated weights for policy 1, policy_version 1236822 (0.0010) [2023-12-28 04:07:30,120][106225] Updated weights for policy 1, policy_version 1236832 (0.0010) [2023-12-28 04:07:30,211][106226] Updated weights for policy 0, policy_version 1233728 (0.0011) [2023-12-28 04:07:30,274][106226] Updated weights for policy 0, policy_version 1233738 (0.0011) [2023-12-28 04:07:30,337][106226] Updated weights for policy 0, policy_version 1233748 (0.0010) [2023-12-28 04:07:30,809][106225] Updated weights for policy 1, policy_version 1236842 (0.0010) [2023-12-28 04:07:30,869][106225] Updated weights for policy 1, policy_version 1236852 (0.0007) [2023-12-28 04:07:30,923][106225] Updated weights for policy 1, policy_version 1236862 (0.0008) [2023-12-28 04:07:30,972][106225] Updated weights for policy 1, policy_version 1236872 (0.0007) [2023-12-28 04:07:31,033][106226] Updated weights for policy 0, policy_version 1233758 (0.0009) [2023-12-28 04:07:31,092][106226] Updated weights for policy 0, policy_version 1233768 (0.0011) [2023-12-28 04:07:31,152][106226] Updated weights for policy 0, policy_version 1233778 (0.0013) [2023-12-28 04:07:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 632586240. Throughput: 0: 10218.1, 1: 9878.9. Samples: 632577180. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:31,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-5.196')] [2023-12-28 04:07:31,713][106225] Updated weights for policy 1, policy_version 1236882 (0.0005) [2023-12-28 04:07:31,780][106225] Updated weights for policy 1, policy_version 1236892 (0.0008) [2023-12-28 04:07:31,836][106225] Updated weights for policy 1, policy_version 1236902 (0.0009) [2023-12-28 04:07:31,873][106226] Updated weights for policy 0, policy_version 1233788 (0.0008) [2023-12-28 04:07:31,935][106226] Updated weights for policy 0, policy_version 1233798 (0.0008) [2023-12-28 04:07:31,994][106226] Updated weights for policy 0, policy_version 1233808 (0.0008) [2023-12-28 04:07:32,589][106225] Updated weights for policy 1, policy_version 1236912 (0.0008) [2023-12-28 04:07:32,650][106225] Updated weights for policy 1, policy_version 1236922 (0.0008) [2023-12-28 04:07:32,702][106225] Updated weights for policy 1, policy_version 1236932 (0.0008) [2023-12-28 04:07:32,737][106226] Updated weights for policy 0, policy_version 1233818 (0.0007) [2023-12-28 04:07:32,800][106226] Updated weights for policy 0, policy_version 1233828 (0.0008) [2023-12-28 04:07:32,864][106226] Updated weights for policy 0, policy_version 1233838 (0.0009) [2023-12-28 04:07:32,921][106226] Updated weights for policy 0, policy_version 1233848 (0.0008) [2023-12-28 04:07:33,397][106225] Updated weights for policy 1, policy_version 1236942 (0.0007) [2023-12-28 04:07:33,446][106225] Updated weights for policy 1, policy_version 1236952 (0.0008) [2023-12-28 04:07:33,494][106225] Updated weights for policy 1, policy_version 1236962 (0.0008) [2023-12-28 04:07:33,630][106226] Updated weights for policy 0, policy_version 1233858 (0.0009) [2023-12-28 04:07:33,689][106226] Updated weights for policy 0, policy_version 1233868 (0.0008) [2023-12-28 04:07:33,745][106226] Updated weights for policy 0, policy_version 1233878 (0.0008) [2023-12-28 04:07:34,169][106225] Updated weights for policy 1, policy_version 1236972 (0.0008) [2023-12-28 04:07:34,230][106225] Updated weights for policy 1, policy_version 1236982 (0.0010) [2023-12-28 04:07:34,293][106225] Updated weights for policy 1, policy_version 1236992 (0.0009) [2023-12-28 04:07:34,451][106226] Updated weights for policy 0, policy_version 1233888 (0.0008) [2023-12-28 04:07:34,513][106226] Updated weights for policy 0, policy_version 1233898 (0.0008) [2023-12-28 04:07:34,577][106226] Updated weights for policy 0, policy_version 1233908 (0.0006) [2023-12-28 04:07:35,023][106225] Updated weights for policy 1, policy_version 1237002 (0.0006) [2023-12-28 04:07:35,079][106225] Updated weights for policy 1, policy_version 1237012 (0.0009) [2023-12-28 04:07:35,130][106225] Updated weights for policy 1, policy_version 1237022 (0.0010) [2023-12-28 04:07:35,190][106225] Updated weights for policy 1, policy_version 1237032 (0.0010) [2023-12-28 04:07:35,298][106226] Updated weights for policy 0, policy_version 1233918 (0.0007) [2023-12-28 04:07:35,358][106226] Updated weights for policy 0, policy_version 1233928 (0.0007) [2023-12-28 04:07:35,409][106226] Updated weights for policy 0, policy_version 1233938 (0.0009) [2023-12-28 04:07:35,811][106225] Updated weights for policy 1, policy_version 1237042 (0.0007) [2023-12-28 04:07:35,867][106225] Updated weights for policy 1, policy_version 1237052 (0.0005) [2023-12-28 04:07:35,926][106225] Updated weights for policy 1, policy_version 1237062 (0.0009) [2023-12-28 04:07:36,145][106226] Updated weights for policy 0, policy_version 1233948 (0.0008) [2023-12-28 04:07:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 632684544. Throughput: 0: 10151.0, 1: 9849.3. Samples: 632694784. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:36,175][105115] Avg episode reward: [(0, '-4.134'), (1, '-4.953')] [2023-12-28 04:07:36,200][106226] Updated weights for policy 0, policy_version 1233958 (0.0010) [2023-12-28 04:07:36,261][106226] Updated weights for policy 0, policy_version 1233968 (0.0010) [2023-12-28 04:07:36,640][106225] Updated weights for policy 1, policy_version 1237072 (0.0011) [2023-12-28 04:07:36,694][106225] Updated weights for policy 1, policy_version 1237082 (0.0010) [2023-12-28 04:07:36,752][106225] Updated weights for policy 1, policy_version 1237092 (0.0010) [2023-12-28 04:07:36,952][106226] Updated weights for policy 0, policy_version 1233978 (0.0011) [2023-12-28 04:07:37,011][106226] Updated weights for policy 0, policy_version 1233988 (0.0011) [2023-12-28 04:07:37,072][106226] Updated weights for policy 0, policy_version 1233998 (0.0011) [2023-12-28 04:07:37,133][106226] Updated weights for policy 0, policy_version 1234008 (0.0011) [2023-12-28 04:07:37,370][106225] Updated weights for policy 1, policy_version 1237102 (0.0009) [2023-12-28 04:07:37,418][106225] Updated weights for policy 1, policy_version 1237112 (0.0008) [2023-12-28 04:07:37,480][106225] Updated weights for policy 1, policy_version 1237122 (0.0007) [2023-12-28 04:07:37,849][106226] Updated weights for policy 0, policy_version 1234018 (0.0005) [2023-12-28 04:07:37,925][106226] Updated weights for policy 0, policy_version 1234028 (0.0008) [2023-12-28 04:07:37,984][106226] Updated weights for policy 0, policy_version 1234038 (0.0010) [2023-12-28 04:07:38,195][106225] Updated weights for policy 1, policy_version 1237132 (0.0007) [2023-12-28 04:07:38,261][106225] Updated weights for policy 1, policy_version 1237142 (0.0006) [2023-12-28 04:07:38,322][106225] Updated weights for policy 1, policy_version 1237152 (0.0008) [2023-12-28 04:07:38,605][106226] Updated weights for policy 0, policy_version 1234048 (0.0011) [2023-12-28 04:07:38,664][106226] Updated weights for policy 0, policy_version 1234058 (0.0011) [2023-12-28 04:07:38,723][106226] Updated weights for policy 0, policy_version 1234068 (0.0011) [2023-12-28 04:07:39,052][106225] Updated weights for policy 1, policy_version 1237162 (0.0008) [2023-12-28 04:07:39,101][106225] Updated weights for policy 1, policy_version 1237172 (0.0007) [2023-12-28 04:07:39,158][106225] Updated weights for policy 1, policy_version 1237182 (0.0007) [2023-12-28 04:07:39,217][106225] Updated weights for policy 1, policy_version 1237192 (0.0006) [2023-12-28 04:07:39,493][106226] Updated weights for policy 0, policy_version 1234078 (0.0009) [2023-12-28 04:07:39,548][106226] Updated weights for policy 0, policy_version 1234088 (0.0009) [2023-12-28 04:07:39,606][106226] Updated weights for policy 0, policy_version 1234098 (0.0009) [2023-12-28 04:07:39,926][106225] Updated weights for policy 1, policy_version 1237202 (0.0008) [2023-12-28 04:07:39,993][106225] Updated weights for policy 1, policy_version 1237212 (0.0009) [2023-12-28 04:07:40,057][106225] Updated weights for policy 1, policy_version 1237222 (0.0010) [2023-12-28 04:07:40,412][106226] Updated weights for policy 0, policy_version 1234108 (0.0009) [2023-12-28 04:07:40,481][106226] Updated weights for policy 0, policy_version 1234118 (0.0008) [2023-12-28 04:07:40,545][106226] Updated weights for policy 0, policy_version 1234128 (0.0009) [2023-12-28 04:07:40,685][106225] Updated weights for policy 1, policy_version 1237232 (0.0006) [2023-12-28 04:07:40,738][106225] Updated weights for policy 1, policy_version 1237242 (0.0005) [2023-12-28 04:07:40,787][106225] Updated weights for policy 1, policy_version 1237252 (0.0005) [2023-12-28 04:07:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 632782848. Throughput: 0: 10077.1, 1: 9887.9. Samples: 632754292. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:41,175][105115] Avg episode reward: [(0, '-4.116'), (1, '-4.996')] [2023-12-28 04:07:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001237256_316784640.pth... [2023-12-28 04:07:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001234136_315998208.pth... [2023-12-28 04:07:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001232952_315695104.pth [2023-12-28 04:07:41,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001236104_316489728.pth [2023-12-28 04:07:41,358][106226] Updated weights for policy 0, policy_version 1234138 (0.0008) [2023-12-28 04:07:41,429][106226] Updated weights for policy 0, policy_version 1234148 (0.0009) [2023-12-28 04:07:41,482][106225] Updated weights for policy 1, policy_version 1237262 (0.0008) [2023-12-28 04:07:41,492][106226] Updated weights for policy 0, policy_version 1234158 (0.0008) [2023-12-28 04:07:41,544][106225] Updated weights for policy 1, policy_version 1237272 (0.0010) [2023-12-28 04:07:41,555][106226] Updated weights for policy 0, policy_version 1234168 (0.0007) [2023-12-28 04:07:41,609][106225] Updated weights for policy 1, policy_version 1237282 (0.0009) [2023-12-28 04:07:42,232][106226] Updated weights for policy 0, policy_version 1234178 (0.0007) [2023-12-28 04:07:42,304][106226] Updated weights for policy 0, policy_version 1234188 (0.0007) [2023-12-28 04:07:42,372][106226] Updated weights for policy 0, policy_version 1234198 (0.0008) [2023-12-28 04:07:42,389][106225] Updated weights for policy 1, policy_version 1237292 (0.0007) [2023-12-28 04:07:42,457][106225] Updated weights for policy 1, policy_version 1237302 (0.0006) [2023-12-28 04:07:42,521][106225] Updated weights for policy 1, policy_version 1237312 (0.0007) [2023-12-28 04:07:43,024][106226] Updated weights for policy 0, policy_version 1234208 (0.0008) [2023-12-28 04:07:43,088][106226] Updated weights for policy 0, policy_version 1234218 (0.0009) [2023-12-28 04:07:43,143][106226] Updated weights for policy 0, policy_version 1234228 (0.0008) [2023-12-28 04:07:43,172][106225] Updated weights for policy 1, policy_version 1237322 (0.0008) [2023-12-28 04:07:43,239][106225] Updated weights for policy 1, policy_version 1237332 (0.0005) [2023-12-28 04:07:43,305][106225] Updated weights for policy 1, policy_version 1237342 (0.0005) [2023-12-28 04:07:43,368][106225] Updated weights for policy 1, policy_version 1237352 (0.0005) [2023-12-28 04:07:43,798][106226] Updated weights for policy 0, policy_version 1234238 (0.0009) [2023-12-28 04:07:43,864][106226] Updated weights for policy 0, policy_version 1234248 (0.0011) [2023-12-28 04:07:43,904][106225] Updated weights for policy 1, policy_version 1237362 (0.0006) [2023-12-28 04:07:43,922][106226] Updated weights for policy 0, policy_version 1234258 (0.0010) [2023-12-28 04:07:43,959][106225] Updated weights for policy 1, policy_version 1237372 (0.0006) [2023-12-28 04:07:44,022][106225] Updated weights for policy 1, policy_version 1237382 (0.0008) [2023-12-28 04:07:44,552][106226] Updated weights for policy 0, policy_version 1234268 (0.0010) [2023-12-28 04:07:44,600][106226] Updated weights for policy 0, policy_version 1234278 (0.0005) [2023-12-28 04:07:44,626][106225] Updated weights for policy 1, policy_version 1237392 (0.0006) [2023-12-28 04:07:44,655][106226] Updated weights for policy 0, policy_version 1234288 (0.0005) [2023-12-28 04:07:44,683][106225] Updated weights for policy 1, policy_version 1237402 (0.0007) [2023-12-28 04:07:44,744][106225] Updated weights for policy 1, policy_version 1237412 (0.0008) [2023-12-28 04:07:45,266][106226] Updated weights for policy 0, policy_version 1234298 (0.0007) [2023-12-28 04:07:45,331][106226] Updated weights for policy 0, policy_version 1234308 (0.0011) [2023-12-28 04:07:45,396][106226] Updated weights for policy 0, policy_version 1234318 (0.0011) [2023-12-28 04:07:45,456][106226] Updated weights for policy 0, policy_version 1234328 (0.0010) [2023-12-28 04:07:45,514][106225] Updated weights for policy 1, policy_version 1237422 (0.0008) [2023-12-28 04:07:45,564][106225] Updated weights for policy 1, policy_version 1237432 (0.0008) [2023-12-28 04:07:45,621][106225] Updated weights for policy 1, policy_version 1237442 (0.0009) [2023-12-28 04:07:46,051][106226] Updated weights for policy 0, policy_version 1234338 (0.0005) [2023-12-28 04:07:46,121][106226] Updated weights for policy 0, policy_version 1234348 (0.0005) [2023-12-28 04:07:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 632881152. Throughput: 0: 10060.9, 1: 9814.1. Samples: 632874948. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:46,175][105115] Avg episode reward: [(0, '-3.966'), (1, '-4.888')] [2023-12-28 04:07:46,188][106226] Updated weights for policy 0, policy_version 1234358 (0.0005) [2023-12-28 04:07:46,354][106225] Updated weights for policy 1, policy_version 1237452 (0.0007) [2023-12-28 04:07:46,403][106225] Updated weights for policy 1, policy_version 1237462 (0.0005) [2023-12-28 04:07:46,467][106225] Updated weights for policy 1, policy_version 1237472 (0.0005) [2023-12-28 04:07:46,662][106226] Updated weights for policy 0, policy_version 1234368 (0.0006) [2023-12-28 04:07:46,715][106226] Updated weights for policy 0, policy_version 1234378 (0.0010) [2023-12-28 04:07:46,778][106226] Updated weights for policy 0, policy_version 1234388 (0.0007) [2023-12-28 04:07:47,154][106225] Updated weights for policy 1, policy_version 1237482 (0.0006) [2023-12-28 04:07:47,224][106225] Updated weights for policy 1, policy_version 1237492 (0.0006) [2023-12-28 04:07:47,280][106225] Updated weights for policy 1, policy_version 1237502 (0.0007) [2023-12-28 04:07:47,297][106226] Updated weights for policy 0, policy_version 1234398 (0.0009) [2023-12-28 04:07:47,337][106225] Updated weights for policy 1, policy_version 1237512 (0.0006) [2023-12-28 04:07:47,347][106226] Updated weights for policy 0, policy_version 1234408 (0.0010) [2023-12-28 04:07:47,397][106226] Updated weights for policy 0, policy_version 1234418 (0.0010) [2023-12-28 04:07:47,954][106225] Updated weights for policy 1, policy_version 1237522 (0.0008) [2023-12-28 04:07:48,017][106225] Updated weights for policy 1, policy_version 1237532 (0.0009) [2023-12-28 04:07:48,081][106225] Updated weights for policy 1, policy_version 1237542 (0.0008) [2023-12-28 04:07:48,087][106226] Updated weights for policy 0, policy_version 1234428 (0.0009) [2023-12-28 04:07:48,144][106226] Updated weights for policy 0, policy_version 1234438 (0.0009) [2023-12-28 04:07:48,191][106226] Updated weights for policy 0, policy_version 1234448 (0.0009) [2023-12-28 04:07:48,786][106225] Updated weights for policy 1, policy_version 1237552 (0.0006) [2023-12-28 04:07:48,847][106225] Updated weights for policy 1, policy_version 1237562 (0.0006) [2023-12-28 04:07:48,908][106225] Updated weights for policy 1, policy_version 1237572 (0.0005) [2023-12-28 04:07:48,957][106226] Updated weights for policy 0, policy_version 1234458 (0.0008) [2023-12-28 04:07:49,019][106226] Updated weights for policy 0, policy_version 1234468 (0.0010) [2023-12-28 04:07:49,081][106226] Updated weights for policy 0, policy_version 1234478 (0.0010) [2023-12-28 04:07:49,147][106226] Updated weights for policy 0, policy_version 1234488 (0.0009) [2023-12-28 04:07:49,520][106225] Updated weights for policy 1, policy_version 1237582 (0.0005) [2023-12-28 04:07:49,578][106225] Updated weights for policy 1, policy_version 1237592 (0.0007) [2023-12-28 04:07:49,626][106225] Updated weights for policy 1, policy_version 1237602 (0.0007) [2023-12-28 04:07:49,915][106226] Updated weights for policy 0, policy_version 1234498 (0.0009) [2023-12-28 04:07:49,984][106226] Updated weights for policy 0, policy_version 1234508 (0.0009) [2023-12-28 04:07:50,048][106226] Updated weights for policy 0, policy_version 1234518 (0.0007) [2023-12-28 04:07:50,356][106225] Updated weights for policy 1, policy_version 1237612 (0.0009) [2023-12-28 04:07:50,422][106225] Updated weights for policy 1, policy_version 1237622 (0.0009) [2023-12-28 04:07:50,484][106225] Updated weights for policy 1, policy_version 1237632 (0.0008) [2023-12-28 04:07:50,689][106226] Updated weights for policy 0, policy_version 1234528 (0.0007) [2023-12-28 04:07:50,753][106226] Updated weights for policy 0, policy_version 1234538 (0.0009) [2023-12-28 04:07:50,814][106226] Updated weights for policy 0, policy_version 1234548 (0.0008) [2023-12-28 04:07:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 632987648. Throughput: 0: 10162.7, 1: 9812.5. Samples: 632996964. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:51,175][105115] Avg episode reward: [(0, '-4.160'), (1, '-5.118')] [2023-12-28 04:07:51,211][106225] Updated weights for policy 1, policy_version 1237642 (0.0007) [2023-12-28 04:07:51,275][106225] Updated weights for policy 1, policy_version 1237652 (0.0007) [2023-12-28 04:07:51,336][106225] Updated weights for policy 1, policy_version 1237662 (0.0007) [2023-12-28 04:07:51,408][106225] Updated weights for policy 1, policy_version 1237672 (0.0008) [2023-12-28 04:07:51,643][106226] Updated weights for policy 0, policy_version 1234558 (0.0008) [2023-12-28 04:07:51,698][106226] Updated weights for policy 0, policy_version 1234568 (0.0008) [2023-12-28 04:07:51,773][106226] Updated weights for policy 0, policy_version 1234578 (0.0009) [2023-12-28 04:07:52,134][106225] Updated weights for policy 1, policy_version 1237682 (0.0006) [2023-12-28 04:07:52,192][106225] Updated weights for policy 1, policy_version 1237692 (0.0006) [2023-12-28 04:07:52,255][106225] Updated weights for policy 1, policy_version 1237702 (0.0007) [2023-12-28 04:07:52,472][106226] Updated weights for policy 0, policy_version 1234588 (0.0009) [2023-12-28 04:07:52,525][106226] Updated weights for policy 0, policy_version 1234598 (0.0007) [2023-12-28 04:07:52,575][106226] Updated weights for policy 0, policy_version 1234608 (0.0005) [2023-12-28 04:07:52,971][106225] Updated weights for policy 1, policy_version 1237712 (0.0008) [2023-12-28 04:07:53,022][106225] Updated weights for policy 1, policy_version 1237722 (0.0008) [2023-12-28 04:07:53,079][106225] Updated weights for policy 1, policy_version 1237732 (0.0008) [2023-12-28 04:07:53,273][106226] Updated weights for policy 0, policy_version 1234618 (0.0006) [2023-12-28 04:07:53,334][106226] Updated weights for policy 0, policy_version 1234628 (0.0008) [2023-12-28 04:07:53,390][106226] Updated weights for policy 0, policy_version 1234638 (0.0008) [2023-12-28 04:07:53,449][106226] Updated weights for policy 0, policy_version 1234648 (0.0008) [2023-12-28 04:07:53,824][106225] Updated weights for policy 1, policy_version 1237742 (0.0008) [2023-12-28 04:07:53,886][106225] Updated weights for policy 1, policy_version 1237752 (0.0009) [2023-12-28 04:07:53,945][106225] Updated weights for policy 1, policy_version 1237762 (0.0008) [2023-12-28 04:07:54,147][106226] Updated weights for policy 0, policy_version 1234658 (0.0009) [2023-12-28 04:07:54,199][106226] Updated weights for policy 0, policy_version 1234668 (0.0009) [2023-12-28 04:07:54,252][106226] Updated weights for policy 0, policy_version 1234678 (0.0009) [2023-12-28 04:07:54,693][106225] Updated weights for policy 1, policy_version 1237772 (0.0008) [2023-12-28 04:07:54,742][106225] Updated weights for policy 1, policy_version 1237782 (0.0008) [2023-12-28 04:07:54,790][106225] Updated weights for policy 1, policy_version 1237792 (0.0008) [2023-12-28 04:07:54,924][106226] Updated weights for policy 0, policy_version 1234688 (0.0007) [2023-12-28 04:07:54,991][106226] Updated weights for policy 0, policy_version 1234698 (0.0006) [2023-12-28 04:07:55,044][106226] Updated weights for policy 0, policy_version 1234708 (0.0006) [2023-12-28 04:07:55,524][106225] Updated weights for policy 1, policy_version 1237802 (0.0008) [2023-12-28 04:07:55,580][106225] Updated weights for policy 1, policy_version 1237812 (0.0008) [2023-12-28 04:07:55,637][106225] Updated weights for policy 1, policy_version 1237822 (0.0007) [2023-12-28 04:07:55,663][106226] Updated weights for policy 0, policy_version 1234718 (0.0007) [2023-12-28 04:07:55,699][106225] Updated weights for policy 1, policy_version 1237832 (0.0008) [2023-12-28 04:07:55,719][106226] Updated weights for policy 0, policy_version 1234728 (0.0007) [2023-12-28 04:07:55,778][106226] Updated weights for policy 0, policy_version 1234738 (0.0010) [2023-12-28 04:07:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 633085952. Throughput: 0: 10111.0, 1: 9806.7. Samples: 633054768. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:07:56,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-5.300')] [2023-12-28 04:07:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001237832_316932096.pth... [2023-12-28 04:07:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001234744_316153856.pth... [2023-12-28 04:07:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001236680_316637184.pth [2023-12-28 04:07:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001233560_315850752.pth [2023-12-28 04:07:56,373][106226] Updated weights for policy 0, policy_version 1234748 (0.0008) [2023-12-28 04:07:56,410][106225] Updated weights for policy 1, policy_version 1237842 (0.0008) [2023-12-28 04:07:56,434][106226] Updated weights for policy 0, policy_version 1234758 (0.0007) [2023-12-28 04:07:56,466][106225] Updated weights for policy 1, policy_version 1237852 (0.0010) [2023-12-28 04:07:56,487][106226] Updated weights for policy 0, policy_version 1234768 (0.0008) [2023-12-28 04:07:56,530][106225] Updated weights for policy 1, policy_version 1237862 (0.0007) [2023-12-28 04:07:57,171][106226] Updated weights for policy 0, policy_version 1234778 (0.0008) [2023-12-28 04:07:57,229][106226] Updated weights for policy 0, policy_version 1234788 (0.0007) [2023-12-28 04:07:57,243][106225] Updated weights for policy 1, policy_version 1237872 (0.0008) [2023-12-28 04:07:57,280][106226] Updated weights for policy 0, policy_version 1234798 (0.0006) [2023-12-28 04:07:57,298][106225] Updated weights for policy 1, policy_version 1237882 (0.0006) [2023-12-28 04:07:57,335][106226] Updated weights for policy 0, policy_version 1234808 (0.0007) [2023-12-28 04:07:57,349][106225] Updated weights for policy 1, policy_version 1237892 (0.0006) [2023-12-28 04:07:58,026][106226] Updated weights for policy 0, policy_version 1234818 (0.0005) [2023-12-28 04:07:58,077][106226] Updated weights for policy 0, policy_version 1234828 (0.0005) [2023-12-28 04:07:58,092][106225] Updated weights for policy 1, policy_version 1237902 (0.0008) [2023-12-28 04:07:58,135][106226] Updated weights for policy 0, policy_version 1234838 (0.0009) [2023-12-28 04:07:58,149][106225] Updated weights for policy 1, policy_version 1237912 (0.0009) [2023-12-28 04:07:58,204][106225] Updated weights for policy 1, policy_version 1237922 (0.0009) [2023-12-28 04:07:58,863][106226] Updated weights for policy 0, policy_version 1234848 (0.0008) [2023-12-28 04:07:58,933][106226] Updated weights for policy 0, policy_version 1234858 (0.0008) [2023-12-28 04:07:58,994][106226] Updated weights for policy 0, policy_version 1234868 (0.0008) [2023-12-28 04:07:59,094][106225] Updated weights for policy 1, policy_version 1237932 (0.0008) [2023-12-28 04:07:59,157][106225] Updated weights for policy 1, policy_version 1237942 (0.0008) [2023-12-28 04:07:59,219][106225] Updated weights for policy 1, policy_version 1237952 (0.0008) [2023-12-28 04:07:59,708][106226] Updated weights for policy 0, policy_version 1234878 (0.0007) [2023-12-28 04:07:59,775][106226] Updated weights for policy 0, policy_version 1234888 (0.0008) [2023-12-28 04:07:59,839][106226] Updated weights for policy 0, policy_version 1234898 (0.0007) [2023-12-28 04:07:59,979][106225] Updated weights for policy 1, policy_version 1237962 (0.0008) [2023-12-28 04:08:00,039][106225] Updated weights for policy 1, policy_version 1237972 (0.0008) [2023-12-28 04:08:00,099][106225] Updated weights for policy 1, policy_version 1237982 (0.0008) [2023-12-28 04:08:00,158][106225] Updated weights for policy 1, policy_version 1237992 (0.0008) [2023-12-28 04:08:00,512][106226] Updated weights for policy 0, policy_version 1234908 (0.0009) [2023-12-28 04:08:00,561][106226] Updated weights for policy 0, policy_version 1234918 (0.0010) [2023-12-28 04:08:00,614][106226] Updated weights for policy 0, policy_version 1234928 (0.0010) [2023-12-28 04:08:00,781][106225] Updated weights for policy 1, policy_version 1238002 (0.0008) [2023-12-28 04:08:00,830][106225] Updated weights for policy 1, policy_version 1238012 (0.0009) [2023-12-28 04:08:00,899][106225] Updated weights for policy 1, policy_version 1238022 (0.0010) [2023-12-28 04:08:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 633184256. Throughput: 0: 10121.6, 1: 9832.0. Samples: 633171308. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:01,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-5.119')] [2023-12-28 04:08:01,279][106226] Updated weights for policy 0, policy_version 1234938 (0.0010) [2023-12-28 04:08:01,337][106226] Updated weights for policy 0, policy_version 1234948 (0.0010) [2023-12-28 04:08:01,407][106226] Updated weights for policy 0, policy_version 1234958 (0.0011) [2023-12-28 04:08:01,463][106226] Updated weights for policy 0, policy_version 1234968 (0.0010) [2023-12-28 04:08:01,648][106225] Updated weights for policy 1, policy_version 1238032 (0.0010) [2023-12-28 04:08:01,707][106225] Updated weights for policy 1, policy_version 1238042 (0.0008) [2023-12-28 04:08:01,771][106225] Updated weights for policy 1, policy_version 1238052 (0.0008) [2023-12-28 04:08:02,231][106226] Updated weights for policy 0, policy_version 1234978 (0.0007) [2023-12-28 04:08:02,297][106226] Updated weights for policy 0, policy_version 1234988 (0.0009) [2023-12-28 04:08:02,365][106226] Updated weights for policy 0, policy_version 1234998 (0.0010) [2023-12-28 04:08:02,540][106225] Updated weights for policy 1, policy_version 1238062 (0.0009) [2023-12-28 04:08:02,594][106225] Updated weights for policy 1, policy_version 1238072 (0.0010) [2023-12-28 04:08:02,651][106225] Updated weights for policy 1, policy_version 1238082 (0.0010) [2023-12-28 04:08:03,060][106226] Updated weights for policy 0, policy_version 1235008 (0.0012) [2023-12-28 04:08:03,106][106226] Updated weights for policy 0, policy_version 1235018 (0.0007) [2023-12-28 04:08:03,164][106226] Updated weights for policy 0, policy_version 1235028 (0.0008) [2023-12-28 04:08:03,285][106225] Updated weights for policy 1, policy_version 1238092 (0.0010) [2023-12-28 04:08:03,338][106225] Updated weights for policy 1, policy_version 1238102 (0.0010) [2023-12-28 04:08:03,391][106225] Updated weights for policy 1, policy_version 1238112 (0.0010) [2023-12-28 04:08:03,895][106226] Updated weights for policy 0, policy_version 1235038 (0.0007) [2023-12-28 04:08:03,956][106226] Updated weights for policy 0, policy_version 1235048 (0.0006) [2023-12-28 04:08:04,021][106226] Updated weights for policy 0, policy_version 1235058 (0.0006) [2023-12-28 04:08:04,050][106225] Updated weights for policy 1, policy_version 1238122 (0.0009) [2023-12-28 04:08:04,117][106225] Updated weights for policy 1, policy_version 1238132 (0.0008) [2023-12-28 04:08:04,184][106225] Updated weights for policy 1, policy_version 1238142 (0.0009) [2023-12-28 04:08:04,252][106225] Updated weights for policy 1, policy_version 1238152 (0.0008) [2023-12-28 04:08:04,660][106226] Updated weights for policy 0, policy_version 1235068 (0.0007) [2023-12-28 04:08:04,717][106226] Updated weights for policy 0, policy_version 1235078 (0.0009) [2023-12-28 04:08:04,786][106226] Updated weights for policy 0, policy_version 1235088 (0.0008) [2023-12-28 04:08:04,945][106225] Updated weights for policy 1, policy_version 1238162 (0.0008) [2023-12-28 04:08:04,998][106225] Updated weights for policy 1, policy_version 1238172 (0.0008) [2023-12-28 04:08:05,067][106225] Updated weights for policy 1, policy_version 1238182 (0.0008) [2023-12-28 04:08:05,453][106226] Updated weights for policy 0, policy_version 1235098 (0.0008) [2023-12-28 04:08:05,506][106226] Updated weights for policy 0, policy_version 1235108 (0.0007) [2023-12-28 04:08:05,562][106226] Updated weights for policy 0, policy_version 1235118 (0.0009) [2023-12-28 04:08:05,610][106226] Updated weights for policy 0, policy_version 1235128 (0.0007) [2023-12-28 04:08:05,827][106225] Updated weights for policy 1, policy_version 1238192 (0.0009) [2023-12-28 04:08:05,887][106225] Updated weights for policy 1, policy_version 1238202 (0.0007) [2023-12-28 04:08:05,938][106225] Updated weights for policy 1, policy_version 1238212 (0.0008) [2023-12-28 04:08:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 633282560. Throughput: 0: 10124.1, 1: 9887.7. Samples: 633291288. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:06,175][105115] Avg episode reward: [(0, '-4.294'), (1, '-4.910')] [2023-12-28 04:08:06,283][106226] Updated weights for policy 0, policy_version 1235138 (0.0006) [2023-12-28 04:08:06,345][106226] Updated weights for policy 0, policy_version 1235148 (0.0008) [2023-12-28 04:08:06,408][106226] Updated weights for policy 0, policy_version 1235158 (0.0008) [2023-12-28 04:08:06,698][106225] Updated weights for policy 1, policy_version 1238222 (0.0007) [2023-12-28 04:08:06,763][106225] Updated weights for policy 1, policy_version 1238232 (0.0006) [2023-12-28 04:08:06,832][106225] Updated weights for policy 1, policy_version 1238242 (0.0006) [2023-12-28 04:08:07,116][106226] Updated weights for policy 0, policy_version 1235168 (0.0006) [2023-12-28 04:08:07,170][106226] Updated weights for policy 0, policy_version 1235178 (0.0008) [2023-12-28 04:08:07,226][106226] Updated weights for policy 0, policy_version 1235188 (0.0008) [2023-12-28 04:08:07,477][106225] Updated weights for policy 1, policy_version 1238252 (0.0006) [2023-12-28 04:08:07,527][106225] Updated weights for policy 1, policy_version 1238262 (0.0008) [2023-12-28 04:08:07,576][106225] Updated weights for policy 1, policy_version 1238272 (0.0008) [2023-12-28 04:08:07,885][106226] Updated weights for policy 0, policy_version 1235198 (0.0006) [2023-12-28 04:08:07,931][106226] Updated weights for policy 0, policy_version 1235208 (0.0005) [2023-12-28 04:08:07,982][106226] Updated weights for policy 0, policy_version 1235218 (0.0006) [2023-12-28 04:08:08,356][106225] Updated weights for policy 1, policy_version 1238282 (0.0008) [2023-12-28 04:08:08,420][106225] Updated weights for policy 1, policy_version 1238292 (0.0006) [2023-12-28 04:08:08,493][106225] Updated weights for policy 1, policy_version 1238302 (0.0006) [2023-12-28 04:08:08,557][106225] Updated weights for policy 1, policy_version 1238312 (0.0006) [2023-12-28 04:08:08,654][106226] Updated weights for policy 0, policy_version 1235228 (0.0007) [2023-12-28 04:08:08,708][106226] Updated weights for policy 0, policy_version 1235238 (0.0005) [2023-12-28 04:08:08,766][106226] Updated weights for policy 0, policy_version 1235248 (0.0006) [2023-12-28 04:08:09,185][106225] Updated weights for policy 1, policy_version 1238322 (0.0010) [2023-12-28 04:08:09,243][106225] Updated weights for policy 1, policy_version 1238332 (0.0014) [2023-12-28 04:08:09,311][106225] Updated weights for policy 1, policy_version 1238343 (0.0009) [2023-12-28 04:08:09,475][106226] Updated weights for policy 0, policy_version 1235258 (0.0007) [2023-12-28 04:08:09,537][106226] Updated weights for policy 0, policy_version 1235268 (0.0008) [2023-12-28 04:08:09,597][106226] Updated weights for policy 0, policy_version 1235278 (0.0006) [2023-12-28 04:08:09,658][106226] Updated weights for policy 0, policy_version 1235288 (0.0009) [2023-12-28 04:08:10,224][106225] Updated weights for policy 1, policy_version 1238353 (0.0008) [2023-12-28 04:08:10,288][106225] Updated weights for policy 1, policy_version 1238363 (0.0006) [2023-12-28 04:08:10,350][106225] Updated weights for policy 1, policy_version 1238373 (0.0008) [2023-12-28 04:08:10,459][106226] Updated weights for policy 0, policy_version 1235298 (0.0011) [2023-12-28 04:08:10,531][106226] Updated weights for policy 0, policy_version 1235308 (0.0011) [2023-12-28 04:08:10,591][106226] Updated weights for policy 0, policy_version 1235318 (0.0011) [2023-12-28 04:08:11,062][106225] Updated weights for policy 1, policy_version 1238383 (0.0009) [2023-12-28 04:08:11,127][106225] Updated weights for policy 1, policy_version 1238393 (0.0010) [2023-12-28 04:08:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 633372672. Throughput: 0: 10163.2, 1: 9914.0. Samples: 633350840. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:11,175][105115] Avg episode reward: [(0, '-4.051'), (1, '-5.084')] [2023-12-28 04:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001235320_316301312.pth... [2023-12-28 04:08:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001234136_315998208.pth [2023-12-28 04:08:11,193][106225] Updated weights for policy 1, policy_version 1238403 (0.0009) [2023-12-28 04:08:11,222][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001238408_317079552.pth... [2023-12-28 04:08:11,226][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001237256_316784640.pth [2023-12-28 04:08:11,318][106226] Updated weights for policy 0, policy_version 1235328 (0.0009) [2023-12-28 04:08:11,379][106226] Updated weights for policy 0, policy_version 1235338 (0.0008) [2023-12-28 04:08:11,441][106226] Updated weights for policy 0, policy_version 1235348 (0.0008) [2023-12-28 04:08:11,960][106225] Updated weights for policy 1, policy_version 1238413 (0.0010) [2023-12-28 04:08:12,019][106225] Updated weights for policy 1, policy_version 1238423 (0.0009) [2023-12-28 04:08:12,074][106225] Updated weights for policy 1, policy_version 1238433 (0.0009) [2023-12-28 04:08:12,192][106226] Updated weights for policy 0, policy_version 1235358 (0.0009) [2023-12-28 04:08:12,261][106226] Updated weights for policy 0, policy_version 1235368 (0.0009) [2023-12-28 04:08:12,326][106226] Updated weights for policy 0, policy_version 1235378 (0.0007) [2023-12-28 04:08:12,757][106225] Updated weights for policy 1, policy_version 1238443 (0.0007) [2023-12-28 04:08:12,824][106225] Updated weights for policy 1, policy_version 1238453 (0.0007) [2023-12-28 04:08:12,890][106225] Updated weights for policy 1, policy_version 1238463 (0.0009) [2023-12-28 04:08:13,026][106226] Updated weights for policy 0, policy_version 1235388 (0.0009) [2023-12-28 04:08:13,080][106226] Updated weights for policy 0, policy_version 1235398 (0.0009) [2023-12-28 04:08:13,132][106226] Updated weights for policy 0, policy_version 1235408 (0.0008) [2023-12-28 04:08:13,611][106225] Updated weights for policy 1, policy_version 1238473 (0.0009) [2023-12-28 04:08:13,663][106225] Updated weights for policy 1, policy_version 1238483 (0.0008) [2023-12-28 04:08:13,721][106225] Updated weights for policy 1, policy_version 1238493 (0.0008) [2023-12-28 04:08:13,770][106225] Updated weights for policy 1, policy_version 1238503 (0.0008) [2023-12-28 04:08:13,877][106226] Updated weights for policy 0, policy_version 1235418 (0.0008) [2023-12-28 04:08:13,927][106226] Updated weights for policy 0, policy_version 1235428 (0.0009) [2023-12-28 04:08:13,975][106226] Updated weights for policy 0, policy_version 1235438 (0.0008) [2023-12-28 04:08:14,022][106226] Updated weights for policy 0, policy_version 1235448 (0.0009) [2023-12-28 04:08:14,422][106225] Updated weights for policy 1, policy_version 1238513 (0.0008) [2023-12-28 04:08:14,478][106225] Updated weights for policy 1, policy_version 1238523 (0.0005) [2023-12-28 04:08:14,531][106225] Updated weights for policy 1, policy_version 1238533 (0.0005) [2023-12-28 04:08:14,902][106226] Updated weights for policy 0, policy_version 1235458 (0.0006) [2023-12-28 04:08:14,964][106226] Updated weights for policy 0, policy_version 1235468 (0.0006) [2023-12-28 04:08:15,026][106226] Updated weights for policy 0, policy_version 1235478 (0.0007) [2023-12-28 04:08:15,145][106225] Updated weights for policy 1, policy_version 1238543 (0.0006) [2023-12-28 04:08:15,208][106225] Updated weights for policy 1, policy_version 1238553 (0.0008) [2023-12-28 04:08:15,276][106225] Updated weights for policy 1, policy_version 1238563 (0.0007) [2023-12-28 04:08:15,711][106226] Updated weights for policy 0, policy_version 1235488 (0.0008) [2023-12-28 04:08:15,761][106226] Updated weights for policy 0, policy_version 1235498 (0.0009) [2023-12-28 04:08:15,825][106226] Updated weights for policy 0, policy_version 1235508 (0.0010) [2023-12-28 04:08:15,885][106225] Updated weights for policy 1, policy_version 1238573 (0.0006) [2023-12-28 04:08:15,942][106225] Updated weights for policy 1, policy_version 1238583 (0.0005) [2023-12-28 04:08:15,996][106225] Updated weights for policy 1, policy_version 1238593 (0.0005) [2023-12-28 04:08:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 633479168. Throughput: 0: 9898.4, 1: 9811.7. Samples: 633464132. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:16,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.797')] [2023-12-28 04:08:16,583][106226] Updated weights for policy 0, policy_version 1235518 (0.0010) [2023-12-28 04:08:16,613][106225] Updated weights for policy 1, policy_version 1238603 (0.0006) [2023-12-28 04:08:16,646][106226] Updated weights for policy 0, policy_version 1235528 (0.0011) [2023-12-28 04:08:16,671][106225] Updated weights for policy 1, policy_version 1238613 (0.0006) [2023-12-28 04:08:16,702][106226] Updated weights for policy 0, policy_version 1235538 (0.0010) [2023-12-28 04:08:16,730][106225] Updated weights for policy 1, policy_version 1238623 (0.0006) [2023-12-28 04:08:17,368][106225] Updated weights for policy 1, policy_version 1238633 (0.0008) [2023-12-28 04:08:17,377][106226] Updated weights for policy 0, policy_version 1235548 (0.0011) [2023-12-28 04:08:17,420][106225] Updated weights for policy 1, policy_version 1238643 (0.0008) [2023-12-28 04:08:17,434][106226] Updated weights for policy 0, policy_version 1235558 (0.0010) [2023-12-28 04:08:17,473][106225] Updated weights for policy 1, policy_version 1238653 (0.0005) [2023-12-28 04:08:17,493][106226] Updated weights for policy 0, policy_version 1235568 (0.0010) [2023-12-28 04:08:17,537][106225] Updated weights for policy 1, policy_version 1238663 (0.0006) [2023-12-28 04:08:18,140][106226] Updated weights for policy 0, policy_version 1235578 (0.0010) [2023-12-28 04:08:18,198][106226] Updated weights for policy 0, policy_version 1235588 (0.0006) [2023-12-28 04:08:18,220][106225] Updated weights for policy 1, policy_version 1238673 (0.0006) [2023-12-28 04:08:18,263][106226] Updated weights for policy 0, policy_version 1235598 (0.0007) [2023-12-28 04:08:18,279][106225] Updated weights for policy 1, policy_version 1238683 (0.0006) [2023-12-28 04:08:18,332][106226] Updated weights for policy 0, policy_version 1235608 (0.0007) [2023-12-28 04:08:18,345][106225] Updated weights for policy 1, policy_version 1238693 (0.0007) [2023-12-28 04:08:18,877][106226] Updated weights for policy 0, policy_version 1235618 (0.0008) [2023-12-28 04:08:18,943][106226] Updated weights for policy 0, policy_version 1235628 (0.0007) [2023-12-28 04:08:19,005][106226] Updated weights for policy 0, policy_version 1235638 (0.0008) [2023-12-28 04:08:19,105][106225] Updated weights for policy 1, policy_version 1238703 (0.0009) [2023-12-28 04:08:19,161][106225] Updated weights for policy 1, policy_version 1238713 (0.0009) [2023-12-28 04:08:19,242][106225] Updated weights for policy 1, policy_version 1238723 (0.0008) [2023-12-28 04:08:19,720][106226] Updated weights for policy 0, policy_version 1235648 (0.0010) [2023-12-28 04:08:19,791][106226] Updated weights for policy 0, policy_version 1235658 (0.0010) [2023-12-28 04:08:19,860][106226] Updated weights for policy 0, policy_version 1235668 (0.0008) [2023-12-28 04:08:19,977][106225] Updated weights for policy 1, policy_version 1238733 (0.0007) [2023-12-28 04:08:20,040][106225] Updated weights for policy 1, policy_version 1238743 (0.0008) [2023-12-28 04:08:20,111][106225] Updated weights for policy 1, policy_version 1238753 (0.0007) [2023-12-28 04:08:20,526][106226] Updated weights for policy 0, policy_version 1235678 (0.0007) [2023-12-28 04:08:20,597][106226] Updated weights for policy 0, policy_version 1235688 (0.0010) [2023-12-28 04:08:20,674][106226] Updated weights for policy 0, policy_version 1235698 (0.0008) [2023-12-28 04:08:20,763][106225] Updated weights for policy 1, policy_version 1238763 (0.0006) [2023-12-28 04:08:20,836][106225] Updated weights for policy 1, policy_version 1238773 (0.0009) [2023-12-28 04:08:20,908][106225] Updated weights for policy 1, policy_version 1238783 (0.0009) [2023-12-28 04:08:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 633577472. Throughput: 0: 9962.8, 1: 9836.6. Samples: 633585760. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:21,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.709')] [2023-12-28 04:08:21,396][106226] Updated weights for policy 0, policy_version 1235708 (0.0008) [2023-12-28 04:08:21,470][106226] Updated weights for policy 0, policy_version 1235718 (0.0006) [2023-12-28 04:08:21,542][106226] Updated weights for policy 0, policy_version 1235728 (0.0006) [2023-12-28 04:08:21,734][106225] Updated weights for policy 1, policy_version 1238793 (0.0009) [2023-12-28 04:08:21,788][106225] Updated weights for policy 1, policy_version 1238803 (0.0008) [2023-12-28 04:08:21,854][106225] Updated weights for policy 1, policy_version 1238813 (0.0008) [2023-12-28 04:08:21,925][106225] Updated weights for policy 1, policy_version 1238823 (0.0009) [2023-12-28 04:08:22,227][106226] Updated weights for policy 0, policy_version 1235738 (0.0008) [2023-12-28 04:08:22,296][106226] Updated weights for policy 0, policy_version 1235748 (0.0010) [2023-12-28 04:08:22,362][106226] Updated weights for policy 0, policy_version 1235758 (0.0009) [2023-12-28 04:08:22,422][106226] Updated weights for policy 0, policy_version 1235768 (0.0009) [2023-12-28 04:08:22,700][106225] Updated weights for policy 1, policy_version 1238833 (0.0010) [2023-12-28 04:08:22,766][106225] Updated weights for policy 1, policy_version 1238843 (0.0010) [2023-12-28 04:08:22,832][106225] Updated weights for policy 1, policy_version 1238853 (0.0011) [2023-12-28 04:08:23,114][106226] Updated weights for policy 0, policy_version 1235778 (0.0010) [2023-12-28 04:08:23,164][106226] Updated weights for policy 0, policy_version 1235788 (0.0010) [2023-12-28 04:08:23,232][106226] Updated weights for policy 0, policy_version 1235798 (0.0011) [2023-12-28 04:08:23,499][106225] Updated weights for policy 1, policy_version 1238863 (0.0007) [2023-12-28 04:08:23,547][106225] Updated weights for policy 1, policy_version 1238873 (0.0007) [2023-12-28 04:08:23,593][106225] Updated weights for policy 1, policy_version 1238883 (0.0010) [2023-12-28 04:08:23,857][106226] Updated weights for policy 0, policy_version 1235808 (0.0007) [2023-12-28 04:08:23,918][106226] Updated weights for policy 0, policy_version 1235818 (0.0005) [2023-12-28 04:08:23,980][106226] Updated weights for policy 0, policy_version 1235828 (0.0006) [2023-12-28 04:08:24,320][106225] Updated weights for policy 1, policy_version 1238893 (0.0009) [2023-12-28 04:08:24,372][106225] Updated weights for policy 1, policy_version 1238903 (0.0008) [2023-12-28 04:08:24,431][106225] Updated weights for policy 1, policy_version 1238913 (0.0008) [2023-12-28 04:08:24,570][106226] Updated weights for policy 0, policy_version 1235838 (0.0008) [2023-12-28 04:08:24,628][106226] Updated weights for policy 0, policy_version 1235848 (0.0005) [2023-12-28 04:08:24,683][106226] Updated weights for policy 0, policy_version 1235858 (0.0007) [2023-12-28 04:08:25,202][106225] Updated weights for policy 1, policy_version 1238923 (0.0009) [2023-12-28 04:08:25,248][106225] Updated weights for policy 1, policy_version 1238933 (0.0009) [2023-12-28 04:08:25,295][106225] Updated weights for policy 1, policy_version 1238943 (0.0008) [2023-12-28 04:08:25,312][106226] Updated weights for policy 0, policy_version 1235868 (0.0008) [2023-12-28 04:08:25,362][106226] Updated weights for policy 0, policy_version 1235878 (0.0007) [2023-12-28 04:08:25,414][106226] Updated weights for policy 0, policy_version 1235888 (0.0009) [2023-12-28 04:08:26,015][106226] Updated weights for policy 0, policy_version 1235898 (0.0008) [2023-12-28 04:08:26,071][106226] Updated weights for policy 0, policy_version 1235908 (0.0008) [2023-12-28 04:08:26,097][106225] Updated weights for policy 1, policy_version 1238953 (0.0006) [2023-12-28 04:08:26,131][106226] Updated weights for policy 0, policy_version 1235918 (0.0007) [2023-12-28 04:08:26,156][106225] Updated weights for policy 1, policy_version 1238963 (0.0006) [2023-12-28 04:08:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 633667584. Throughput: 0: 9987.1, 1: 9784.1. Samples: 633643996. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:26,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-4.904')] [2023-12-28 04:08:26,190][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001235928_316456960.pth... [2023-12-28 04:08:26,191][106226] Updated weights for policy 0, policy_version 1235928 (0.0008) [2023-12-28 04:08:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001234744_316153856.pth [2023-12-28 04:08:26,215][106225] Updated weights for policy 1, policy_version 1238973 (0.0008) [2023-12-28 04:08:26,271][106225] Updated weights for policy 1, policy_version 1238983 (0.0008) [2023-12-28 04:08:26,274][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001238984_317227008.pth... [2023-12-28 04:08:26,279][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001237832_316932096.pth [2023-12-28 04:08:26,900][106226] Updated weights for policy 0, policy_version 1235938 (0.0008) [2023-12-28 04:08:26,951][106226] Updated weights for policy 0, policy_version 1235948 (0.0005) [2023-12-28 04:08:27,002][106226] Updated weights for policy 0, policy_version 1235958 (0.0009) [2023-12-28 04:08:27,019][106225] Updated weights for policy 1, policy_version 1238993 (0.0006) [2023-12-28 04:08:27,067][106225] Updated weights for policy 1, policy_version 1239003 (0.0006) [2023-12-28 04:08:27,116][106225] Updated weights for policy 1, policy_version 1239013 (0.0005) [2023-12-28 04:08:27,685][106226] Updated weights for policy 0, policy_version 1235968 (0.0011) [2023-12-28 04:08:27,735][106226] Updated weights for policy 0, policy_version 1235978 (0.0010) [2023-12-28 04:08:27,749][106225] Updated weights for policy 1, policy_version 1239023 (0.0007) [2023-12-28 04:08:27,792][106226] Updated weights for policy 0, policy_version 1235988 (0.0011) [2023-12-28 04:08:27,806][106225] Updated weights for policy 1, policy_version 1239033 (0.0007) [2023-12-28 04:08:27,864][106225] Updated weights for policy 1, policy_version 1239043 (0.0010) [2023-12-28 04:08:28,484][106226] Updated weights for policy 0, policy_version 1235998 (0.0008) [2023-12-28 04:08:28,540][106226] Updated weights for policy 0, policy_version 1236008 (0.0010) [2023-12-28 04:08:28,556][106225] Updated weights for policy 1, policy_version 1239053 (0.0010) [2023-12-28 04:08:28,595][106226] Updated weights for policy 0, policy_version 1236018 (0.0010) [2023-12-28 04:08:28,610][106225] Updated weights for policy 1, policy_version 1239063 (0.0010) [2023-12-28 04:08:28,676][106225] Updated weights for policy 1, policy_version 1239073 (0.0010) [2023-12-28 04:08:29,170][106226] Updated weights for policy 0, policy_version 1236028 (0.0008) [2023-12-28 04:08:29,232][106226] Updated weights for policy 0, policy_version 1236038 (0.0007) [2023-12-28 04:08:29,296][106226] Updated weights for policy 0, policy_version 1236048 (0.0008) [2023-12-28 04:08:29,372][106225] Updated weights for policy 1, policy_version 1239083 (0.0009) [2023-12-28 04:08:29,442][106225] Updated weights for policy 1, policy_version 1239093 (0.0009) [2023-12-28 04:08:29,505][106225] Updated weights for policy 1, policy_version 1239103 (0.0009) [2023-12-28 04:08:29,998][106226] Updated weights for policy 0, policy_version 1236058 (0.0008) [2023-12-28 04:08:30,054][106226] Updated weights for policy 0, policy_version 1236068 (0.0010) [2023-12-28 04:08:30,105][106226] Updated weights for policy 0, policy_version 1236078 (0.0010) [2023-12-28 04:08:30,155][106226] Updated weights for policy 0, policy_version 1236088 (0.0010) [2023-12-28 04:08:30,162][106225] Updated weights for policy 1, policy_version 1239113 (0.0007) [2023-12-28 04:08:30,210][106225] Updated weights for policy 1, policy_version 1239123 (0.0010) [2023-12-28 04:08:30,257][106225] Updated weights for policy 1, policy_version 1239133 (0.0010) [2023-12-28 04:08:30,310][106225] Updated weights for policy 1, policy_version 1239143 (0.0010) [2023-12-28 04:08:30,780][106226] Updated weights for policy 0, policy_version 1236098 (0.0010) [2023-12-28 04:08:30,839][106226] Updated weights for policy 0, policy_version 1236108 (0.0010) [2023-12-28 04:08:30,896][106226] Updated weights for policy 0, policy_version 1236118 (0.0010) [2023-12-28 04:08:31,035][106225] Updated weights for policy 1, policy_version 1239153 (0.0008) [2023-12-28 04:08:31,093][106225] Updated weights for policy 1, policy_version 1239163 (0.0008) [2023-12-28 04:08:31,149][106225] Updated weights for policy 1, policy_version 1239173 (0.0008) [2023-12-28 04:08:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 633782272. Throughput: 0: 10088.7, 1: 9704.3. Samples: 633765632. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:31,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-5.020')] [2023-12-28 04:08:31,623][106226] Updated weights for policy 0, policy_version 1236128 (0.0011) [2023-12-28 04:08:31,685][106226] Updated weights for policy 0, policy_version 1236138 (0.0011) [2023-12-28 04:08:31,755][106226] Updated weights for policy 0, policy_version 1236148 (0.0009) [2023-12-28 04:08:31,889][106225] Updated weights for policy 1, policy_version 1239183 (0.0006) [2023-12-28 04:08:31,941][106225] Updated weights for policy 1, policy_version 1239193 (0.0005) [2023-12-28 04:08:31,995][106225] Updated weights for policy 1, policy_version 1239203 (0.0007) [2023-12-28 04:08:32,397][106226] Updated weights for policy 0, policy_version 1236158 (0.0009) [2023-12-28 04:08:32,455][106226] Updated weights for policy 0, policy_version 1236168 (0.0011) [2023-12-28 04:08:32,515][106226] Updated weights for policy 0, policy_version 1236178 (0.0011) [2023-12-28 04:08:32,645][106225] Updated weights for policy 1, policy_version 1239213 (0.0007) [2023-12-28 04:08:32,694][106225] Updated weights for policy 1, policy_version 1239223 (0.0007) [2023-12-28 04:08:32,750][106225] Updated weights for policy 1, policy_version 1239233 (0.0008) [2023-12-28 04:08:33,187][106226] Updated weights for policy 0, policy_version 1236188 (0.0008) [2023-12-28 04:08:33,247][106226] Updated weights for policy 0, policy_version 1236198 (0.0005) [2023-12-28 04:08:33,311][106226] Updated weights for policy 0, policy_version 1236208 (0.0005) [2023-12-28 04:08:33,343][106225] Updated weights for policy 1, policy_version 1239243 (0.0008) [2023-12-28 04:08:33,398][106225] Updated weights for policy 1, policy_version 1239253 (0.0008) [2023-12-28 04:08:33,447][106225] Updated weights for policy 1, policy_version 1239263 (0.0008) [2023-12-28 04:08:33,803][106226] Updated weights for policy 0, policy_version 1236218 (0.0006) [2023-12-28 04:08:33,847][106226] Updated weights for policy 0, policy_version 1236228 (0.0009) [2023-12-28 04:08:33,897][106226] Updated weights for policy 0, policy_version 1236238 (0.0005) [2023-12-28 04:08:33,950][106226] Updated weights for policy 0, policy_version 1236248 (0.0005) [2023-12-28 04:08:34,313][106225] Updated weights for policy 1, policy_version 1239273 (0.0008) [2023-12-28 04:08:34,374][106225] Updated weights for policy 1, policy_version 1239283 (0.0008) [2023-12-28 04:08:34,434][106225] Updated weights for policy 1, policy_version 1239293 (0.0008) [2023-12-28 04:08:34,497][106225] Updated weights for policy 1, policy_version 1239303 (0.0008) [2023-12-28 04:08:34,623][106226] Updated weights for policy 0, policy_version 1236258 (0.0011) [2023-12-28 04:08:34,693][106226] Updated weights for policy 0, policy_version 1236268 (0.0011) [2023-12-28 04:08:34,756][106226] Updated weights for policy 0, policy_version 1236278 (0.0010) [2023-12-28 04:08:35,275][106225] Updated weights for policy 1, policy_version 1239313 (0.0008) [2023-12-28 04:08:35,333][106225] Updated weights for policy 1, policy_version 1239323 (0.0007) [2023-12-28 04:08:35,397][106225] Updated weights for policy 1, policy_version 1239333 (0.0007) [2023-12-28 04:08:35,436][106226] Updated weights for policy 0, policy_version 1236288 (0.0011) [2023-12-28 04:08:35,500][106226] Updated weights for policy 0, policy_version 1236298 (0.0011) [2023-12-28 04:08:35,564][106226] Updated weights for policy 0, policy_version 1236308 (0.0011) [2023-12-28 04:08:36,120][106225] Updated weights for policy 1, policy_version 1239343 (0.0008) [2023-12-28 04:08:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 633872384. Throughput: 0: 10096.7, 1: 9690.5. Samples: 633887384. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:36,175][105115] Avg episode reward: [(0, '-4.294'), (1, '-5.076')] [2023-12-28 04:08:36,184][106225] Updated weights for policy 1, policy_version 1239353 (0.0008) [2023-12-28 04:08:36,232][106226] Updated weights for policy 0, policy_version 1236318 (0.0009) [2023-12-28 04:08:36,244][106225] Updated weights for policy 1, policy_version 1239363 (0.0007) [2023-12-28 04:08:36,284][106226] Updated weights for policy 0, policy_version 1236328 (0.0008) [2023-12-28 04:08:36,345][106226] Updated weights for policy 0, policy_version 1236338 (0.0007) [2023-12-28 04:08:37,006][106226] Updated weights for policy 0, policy_version 1236348 (0.0007) [2023-12-28 04:08:37,036][106225] Updated weights for policy 1, policy_version 1239373 (0.0008) [2023-12-28 04:08:37,058][106226] Updated weights for policy 0, policy_version 1236358 (0.0007) [2023-12-28 04:08:37,105][106225] Updated weights for policy 1, policy_version 1239383 (0.0009) [2023-12-28 04:08:37,113][106226] Updated weights for policy 0, policy_version 1236368 (0.0008) [2023-12-28 04:08:37,172][106225] Updated weights for policy 1, policy_version 1239393 (0.0007) [2023-12-28 04:08:37,741][106226] Updated weights for policy 0, policy_version 1236378 (0.0007) [2023-12-28 04:08:37,801][106226] Updated weights for policy 0, policy_version 1236388 (0.0005) [2023-12-28 04:08:37,856][106226] Updated weights for policy 0, policy_version 1236398 (0.0005) [2023-12-28 04:08:37,902][106225] Updated weights for policy 1, policy_version 1239403 (0.0007) [2023-12-28 04:08:37,907][106226] Updated weights for policy 0, policy_version 1236408 (0.0005) [2023-12-28 04:08:37,956][106225] Updated weights for policy 1, policy_version 1239413 (0.0007) [2023-12-28 04:08:38,012][106225] Updated weights for policy 1, policy_version 1239423 (0.0009) [2023-12-28 04:08:38,542][106226] Updated weights for policy 0, policy_version 1236418 (0.0008) [2023-12-28 04:08:38,587][106226] Updated weights for policy 0, policy_version 1236428 (0.0008) [2023-12-28 04:08:38,636][106226] Updated weights for policy 0, policy_version 1236438 (0.0009) [2023-12-28 04:08:38,716][106225] Updated weights for policy 1, policy_version 1239433 (0.0009) [2023-12-28 04:08:38,783][106225] Updated weights for policy 1, policy_version 1239443 (0.0008) [2023-12-28 04:08:38,846][106225] Updated weights for policy 1, policy_version 1239453 (0.0008) [2023-12-28 04:08:38,909][106225] Updated weights for policy 1, policy_version 1239463 (0.0010) [2023-12-28 04:08:39,332][106226] Updated weights for policy 0, policy_version 1236448 (0.0011) [2023-12-28 04:08:39,410][106226] Updated weights for policy 0, policy_version 1236458 (0.0010) [2023-12-28 04:08:39,480][106226] Updated weights for policy 0, policy_version 1236468 (0.0008) [2023-12-28 04:08:39,673][106225] Updated weights for policy 1, policy_version 1239473 (0.0006) [2023-12-28 04:08:39,731][106225] Updated weights for policy 1, policy_version 1239483 (0.0008) [2023-12-28 04:08:39,797][106225] Updated weights for policy 1, policy_version 1239493 (0.0007) [2023-12-28 04:08:40,230][106226] Updated weights for policy 0, policy_version 1236478 (0.0010) [2023-12-28 04:08:40,289][106226] Updated weights for policy 0, policy_version 1236488 (0.0008) [2023-12-28 04:08:40,348][106226] Updated weights for policy 0, policy_version 1236498 (0.0008) [2023-12-28 04:08:40,496][106225] Updated weights for policy 1, policy_version 1239503 (0.0009) [2023-12-28 04:08:40,554][106225] Updated weights for policy 1, policy_version 1239513 (0.0006) [2023-12-28 04:08:40,602][106225] Updated weights for policy 1, policy_version 1239523 (0.0008) [2023-12-28 04:08:41,114][106226] Updated weights for policy 0, policy_version 1236508 (0.0010) [2023-12-28 04:08:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 633970688. Throughput: 0: 10157.8, 1: 9681.6. Samples: 633947548. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:41,176][105115] Avg episode reward: [(0, '-4.184'), (1, '-4.994')] [2023-12-28 04:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001239528_317366272.pth... [2023-12-28 04:08:41,184][106226] Updated weights for policy 0, policy_version 1236518 (0.0008) [2023-12-28 04:08:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001238408_317079552.pth [2023-12-28 04:08:41,247][106226] Updated weights for policy 0, policy_version 1236528 (0.0008) [2023-12-28 04:08:41,296][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001236536_316612608.pth... [2023-12-28 04:08:41,300][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001235320_316301312.pth [2023-12-28 04:08:41,369][106225] Updated weights for policy 1, policy_version 1239533 (0.0008) [2023-12-28 04:08:41,436][106225] Updated weights for policy 1, policy_version 1239543 (0.0008) [2023-12-28 04:08:41,504][106225] Updated weights for policy 1, policy_version 1239553 (0.0008) [2023-12-28 04:08:42,045][106226] Updated weights for policy 0, policy_version 1236538 (0.0008) [2023-12-28 04:08:42,113][106226] Updated weights for policy 0, policy_version 1236548 (0.0008) [2023-12-28 04:08:42,180][106226] Updated weights for policy 0, policy_version 1236558 (0.0009) [2023-12-28 04:08:42,249][106226] Updated weights for policy 0, policy_version 1236568 (0.0009) [2023-12-28 04:08:42,255][106225] Updated weights for policy 1, policy_version 1239563 (0.0008) [2023-12-28 04:08:42,318][106225] Updated weights for policy 1, policy_version 1239573 (0.0009) [2023-12-28 04:08:42,386][106225] Updated weights for policy 1, policy_version 1239583 (0.0008) [2023-12-28 04:08:42,948][106226] Updated weights for policy 0, policy_version 1236578 (0.0005) [2023-12-28 04:08:43,005][106226] Updated weights for policy 0, policy_version 1236588 (0.0006) [2023-12-28 04:08:43,065][106226] Updated weights for policy 0, policy_version 1236598 (0.0009) [2023-12-28 04:08:43,080][106225] Updated weights for policy 1, policy_version 1239593 (0.0009) [2023-12-28 04:08:43,144][106225] Updated weights for policy 1, policy_version 1239603 (0.0008) [2023-12-28 04:08:43,199][106225] Updated weights for policy 1, policy_version 1239613 (0.0008) [2023-12-28 04:08:43,260][106225] Updated weights for policy 1, policy_version 1239623 (0.0007) [2023-12-28 04:08:43,738][106226] Updated weights for policy 0, policy_version 1236608 (0.0010) [2023-12-28 04:08:43,794][106226] Updated weights for policy 0, policy_version 1236618 (0.0008) [2023-12-28 04:08:43,843][106226] Updated weights for policy 0, policy_version 1236628 (0.0006) [2023-12-28 04:08:43,988][106225] Updated weights for policy 1, policy_version 1239633 (0.0007) [2023-12-28 04:08:44,044][106225] Updated weights for policy 1, policy_version 1239643 (0.0008) [2023-12-28 04:08:44,102][106225] Updated weights for policy 1, policy_version 1239653 (0.0008) [2023-12-28 04:08:44,545][106226] Updated weights for policy 0, policy_version 1236638 (0.0007) [2023-12-28 04:08:44,608][106226] Updated weights for policy 0, policy_version 1236648 (0.0006) [2023-12-28 04:08:44,662][106226] Updated weights for policy 0, policy_version 1236658 (0.0007) [2023-12-28 04:08:44,898][106225] Updated weights for policy 1, policy_version 1239663 (0.0008) [2023-12-28 04:08:44,963][106225] Updated weights for policy 1, policy_version 1239673 (0.0008) [2023-12-28 04:08:45,025][106225] Updated weights for policy 1, policy_version 1239683 (0.0008) [2023-12-28 04:08:45,391][106226] Updated weights for policy 0, policy_version 1236668 (0.0010) [2023-12-28 04:08:45,458][106226] Updated weights for policy 0, policy_version 1236678 (0.0011) [2023-12-28 04:08:45,508][106226] Updated weights for policy 0, policy_version 1236688 (0.0010) [2023-12-28 04:08:45,750][106225] Updated weights for policy 1, policy_version 1239693 (0.0008) [2023-12-28 04:08:45,810][106225] Updated weights for policy 1, policy_version 1239703 (0.0007) [2023-12-28 04:08:45,862][106225] Updated weights for policy 1, policy_version 1239713 (0.0007) [2023-12-28 04:08:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 634068992. Throughput: 0: 10070.7, 1: 9694.9. Samples: 634060756. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:46,175][105115] Avg episode reward: [(0, '-4.281'), (1, '-5.061')] [2023-12-28 04:08:46,201][106226] Updated weights for policy 0, policy_version 1236698 (0.0010) [2023-12-28 04:08:46,245][106226] Updated weights for policy 0, policy_version 1236708 (0.0011) [2023-12-28 04:08:46,292][106226] Updated weights for policy 0, policy_version 1236718 (0.0010) [2023-12-28 04:08:46,338][106226] Updated weights for policy 0, policy_version 1236728 (0.0010) [2023-12-28 04:08:46,480][106225] Updated weights for policy 1, policy_version 1239723 (0.0007) [2023-12-28 04:08:46,526][106225] Updated weights for policy 1, policy_version 1239733 (0.0007) [2023-12-28 04:08:46,569][106225] Updated weights for policy 1, policy_version 1239743 (0.0007) [2023-12-28 04:08:47,069][106226] Updated weights for policy 0, policy_version 1236738 (0.0010) [2023-12-28 04:08:47,124][106226] Updated weights for policy 0, policy_version 1236748 (0.0009) [2023-12-28 04:08:47,174][106226] Updated weights for policy 0, policy_version 1236758 (0.0010) [2023-12-28 04:08:47,294][106225] Updated weights for policy 1, policy_version 1239753 (0.0008) [2023-12-28 04:08:47,353][106225] Updated weights for policy 1, policy_version 1239763 (0.0010) [2023-12-28 04:08:47,407][106225] Updated weights for policy 1, policy_version 1239773 (0.0010) [2023-12-28 04:08:47,471][106225] Updated weights for policy 1, policy_version 1239783 (0.0010) [2023-12-28 04:08:47,845][106226] Updated weights for policy 0, policy_version 1236768 (0.0010) [2023-12-28 04:08:47,897][106226] Updated weights for policy 0, policy_version 1236778 (0.0010) [2023-12-28 04:08:47,946][106226] Updated weights for policy 0, policy_version 1236788 (0.0010) [2023-12-28 04:08:48,190][106225] Updated weights for policy 1, policy_version 1239793 (0.0010) [2023-12-28 04:08:48,242][106225] Updated weights for policy 1, policy_version 1239803 (0.0010) [2023-12-28 04:08:48,302][106225] Updated weights for policy 1, policy_version 1239813 (0.0010) [2023-12-28 04:08:48,549][106226] Updated weights for policy 0, policy_version 1236798 (0.0009) [2023-12-28 04:08:48,612][106226] Updated weights for policy 0, policy_version 1236808 (0.0011) [2023-12-28 04:08:48,679][106226] Updated weights for policy 0, policy_version 1236818 (0.0009) [2023-12-28 04:08:49,000][106225] Updated weights for policy 1, policy_version 1239823 (0.0008) [2023-12-28 04:08:49,055][106225] Updated weights for policy 1, policy_version 1239833 (0.0007) [2023-12-28 04:08:49,108][106225] Updated weights for policy 1, policy_version 1239843 (0.0007) [2023-12-28 04:08:49,361][106226] Updated weights for policy 0, policy_version 1236828 (0.0008) [2023-12-28 04:08:49,425][106226] Updated weights for policy 0, policy_version 1236838 (0.0009) [2023-12-28 04:08:49,489][106226] Updated weights for policy 0, policy_version 1236848 (0.0011) [2023-12-28 04:08:49,850][106225] Updated weights for policy 1, policy_version 1239853 (0.0008) [2023-12-28 04:08:49,909][106225] Updated weights for policy 1, policy_version 1239863 (0.0008) [2023-12-28 04:08:49,981][106225] Updated weights for policy 1, policy_version 1239873 (0.0008) [2023-12-28 04:08:50,149][106226] Updated weights for policy 0, policy_version 1236858 (0.0009) [2023-12-28 04:08:50,205][106226] Updated weights for policy 0, policy_version 1236868 (0.0008) [2023-12-28 04:08:50,263][106226] Updated weights for policy 0, policy_version 1236878 (0.0009) [2023-12-28 04:08:50,323][106226] Updated weights for policy 0, policy_version 1236888 (0.0008) [2023-12-28 04:08:50,744][106225] Updated weights for policy 1, policy_version 1239883 (0.0008) [2023-12-28 04:08:50,806][106225] Updated weights for policy 1, policy_version 1239893 (0.0008) [2023-12-28 04:08:50,868][106225] Updated weights for policy 1, policy_version 1239903 (0.0009) [2023-12-28 04:08:51,043][106226] Updated weights for policy 0, policy_version 1236898 (0.0007) [2023-12-28 04:08:51,112][106226] Updated weights for policy 0, policy_version 1236908 (0.0010) [2023-12-28 04:08:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 634167296. Throughput: 0: 10076.4, 1: 9667.7. Samples: 634179776. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:51,175][105115] Avg episode reward: [(0, '-4.304'), (1, '-5.001')] [2023-12-28 04:08:51,176][106226] Updated weights for policy 0, policy_version 1236918 (0.0006) [2023-12-28 04:08:51,655][106225] Updated weights for policy 1, policy_version 1239913 (0.0009) [2023-12-28 04:08:51,722][106225] Updated weights for policy 1, policy_version 1239923 (0.0009) [2023-12-28 04:08:51,784][106225] Updated weights for policy 1, policy_version 1239933 (0.0008) [2023-12-28 04:08:51,849][106226] Updated weights for policy 0, policy_version 1236928 (0.0007) [2023-12-28 04:08:51,851][106225] Updated weights for policy 1, policy_version 1239943 (0.0006) [2023-12-28 04:08:51,904][106226] Updated weights for policy 0, policy_version 1236938 (0.0008) [2023-12-28 04:08:51,961][106226] Updated weights for policy 0, policy_version 1236948 (0.0008) [2023-12-28 04:08:52,605][106225] Updated weights for policy 1, policy_version 1239953 (0.0008) [2023-12-28 04:08:52,663][106225] Updated weights for policy 1, policy_version 1239963 (0.0009) [2023-12-28 04:08:52,702][106226] Updated weights for policy 0, policy_version 1236958 (0.0007) [2023-12-28 04:08:52,720][106225] Updated weights for policy 1, policy_version 1239973 (0.0007) [2023-12-28 04:08:52,760][106226] Updated weights for policy 0, policy_version 1236968 (0.0006) [2023-12-28 04:08:52,820][106226] Updated weights for policy 0, policy_version 1236978 (0.0009) [2023-12-28 04:08:53,394][106225] Updated weights for policy 1, policy_version 1239983 (0.0009) [2023-12-28 04:08:53,447][106225] Updated weights for policy 1, policy_version 1239993 (0.0010) [2023-12-28 04:08:53,497][106226] Updated weights for policy 0, policy_version 1236988 (0.0007) [2023-12-28 04:08:53,497][106225] Updated weights for policy 1, policy_version 1240003 (0.0010) [2023-12-28 04:08:53,553][106226] Updated weights for policy 0, policy_version 1236998 (0.0005) [2023-12-28 04:08:53,606][106226] Updated weights for policy 0, policy_version 1237008 (0.0007) [2023-12-28 04:08:54,187][106226] Updated weights for policy 0, policy_version 1237018 (0.0009) [2023-12-28 04:08:54,207][106225] Updated weights for policy 1, policy_version 1240013 (0.0010) [2023-12-28 04:08:54,246][106226] Updated weights for policy 0, policy_version 1237028 (0.0006) [2023-12-28 04:08:54,270][106225] Updated weights for policy 1, policy_version 1240023 (0.0010) [2023-12-28 04:08:54,302][106226] Updated weights for policy 0, policy_version 1237038 (0.0010) [2023-12-28 04:08:54,336][106225] Updated weights for policy 1, policy_version 1240033 (0.0006) [2023-12-28 04:08:54,362][106226] Updated weights for policy 0, policy_version 1237048 (0.0007) [2023-12-28 04:08:55,009][106225] Updated weights for policy 1, policy_version 1240043 (0.0007) [2023-12-28 04:08:55,054][106226] Updated weights for policy 0, policy_version 1237058 (0.0011) [2023-12-28 04:08:55,057][106225] Updated weights for policy 1, policy_version 1240053 (0.0010) [2023-12-28 04:08:55,101][106226] Updated weights for policy 0, policy_version 1237068 (0.0010) [2023-12-28 04:08:55,107][106225] Updated weights for policy 1, policy_version 1240063 (0.0010) [2023-12-28 04:08:55,148][106226] Updated weights for policy 0, policy_version 1237078 (0.0010) [2023-12-28 04:08:55,792][106225] Updated weights for policy 1, policy_version 1240073 (0.0010) [2023-12-28 04:08:55,839][106225] Updated weights for policy 1, policy_version 1240083 (0.0010) [2023-12-28 04:08:55,891][106226] Updated weights for policy 0, policy_version 1237088 (0.0010) [2023-12-28 04:08:55,891][106225] Updated weights for policy 1, policy_version 1240093 (0.0010) [2023-12-28 04:08:55,949][106226] Updated weights for policy 0, policy_version 1237098 (0.0010) [2023-12-28 04:08:55,950][106225] Updated weights for policy 1, policy_version 1240103 (0.0010) [2023-12-28 04:08:56,002][106226] Updated weights for policy 0, policy_version 1237108 (0.0006) [2023-12-28 04:08:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 634273792. Throughput: 0: 10073.8, 1: 9652.5. Samples: 634238528. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:08:56,176][105115] Avg episode reward: [(0, '-4.287'), (1, '-5.049')] [2023-12-28 04:08:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001240104_317513728.pth... [2023-12-28 04:08:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001237112_316760064.pth... [2023-12-28 04:08:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001238984_317227008.pth [2023-12-28 04:08:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001235928_316456960.pth [2023-12-28 04:08:56,596][106226] Updated weights for policy 0, policy_version 1237118 (0.0010) [2023-12-28 04:08:56,651][106226] Updated weights for policy 0, policy_version 1237128 (0.0010) [2023-12-28 04:08:56,682][106225] Updated weights for policy 1, policy_version 1240113 (0.0010) [2023-12-28 04:08:56,704][106226] Updated weights for policy 0, policy_version 1237138 (0.0010) [2023-12-28 04:08:56,737][106225] Updated weights for policy 1, policy_version 1240123 (0.0009) [2023-12-28 04:08:56,799][106225] Updated weights for policy 1, policy_version 1240133 (0.0010) [2023-12-28 04:08:57,341][106226] Updated weights for policy 0, policy_version 1237148 (0.0009) [2023-12-28 04:08:57,394][106226] Updated weights for policy 0, policy_version 1237158 (0.0008) [2023-12-28 04:08:57,440][106226] Updated weights for policy 0, policy_version 1237168 (0.0007) [2023-12-28 04:08:57,493][106225] Updated weights for policy 1, policy_version 1240143 (0.0010) [2023-12-28 04:08:57,551][106225] Updated weights for policy 1, policy_version 1240153 (0.0010) [2023-12-28 04:08:57,613][106225] Updated weights for policy 1, policy_version 1240163 (0.0010) [2023-12-28 04:08:58,114][106226] Updated weights for policy 0, policy_version 1237178 (0.0006) [2023-12-28 04:08:58,159][106226] Updated weights for policy 0, policy_version 1237188 (0.0005) [2023-12-28 04:08:58,206][106226] Updated weights for policy 0, policy_version 1237198 (0.0005) [2023-12-28 04:08:58,270][106226] Updated weights for policy 0, policy_version 1237208 (0.0008) [2023-12-28 04:08:58,322][106225] Updated weights for policy 1, policy_version 1240173 (0.0009) [2023-12-28 04:08:58,392][106225] Updated weights for policy 1, policy_version 1240183 (0.0009) [2023-12-28 04:08:58,459][106225] Updated weights for policy 1, policy_version 1240193 (0.0009) [2023-12-28 04:08:59,113][106226] Updated weights for policy 0, policy_version 1237218 (0.0007) [2023-12-28 04:08:59,184][106226] Updated weights for policy 0, policy_version 1237228 (0.0007) [2023-12-28 04:08:59,248][106225] Updated weights for policy 1, policy_version 1240203 (0.0011) [2023-12-28 04:08:59,249][106226] Updated weights for policy 0, policy_version 1237238 (0.0007) [2023-12-28 04:08:59,313][106225] Updated weights for policy 1, policy_version 1240213 (0.0009) [2023-12-28 04:08:59,381][106225] Updated weights for policy 1, policy_version 1240223 (0.0010) [2023-12-28 04:08:59,963][106226] Updated weights for policy 0, policy_version 1237248 (0.0009) [2023-12-28 04:09:00,025][106226] Updated weights for policy 0, policy_version 1237258 (0.0006) [2023-12-28 04:09:00,088][106226] Updated weights for policy 0, policy_version 1237268 (0.0008) [2023-12-28 04:09:00,107][106225] Updated weights for policy 1, policy_version 1240233 (0.0010) [2023-12-28 04:09:00,157][106225] Updated weights for policy 1, policy_version 1240243 (0.0005) [2023-12-28 04:09:00,209][106225] Updated weights for policy 1, policy_version 1240253 (0.0005) [2023-12-28 04:09:00,271][106225] Updated weights for policy 1, policy_version 1240263 (0.0005) [2023-12-28 04:09:00,732][106226] Updated weights for policy 0, policy_version 1237278 (0.0007) [2023-12-28 04:09:00,787][106226] Updated weights for policy 0, policy_version 1237288 (0.0005) [2023-12-28 04:09:00,846][106226] Updated weights for policy 0, policy_version 1237298 (0.0005) [2023-12-28 04:09:00,873][106225] Updated weights for policy 1, policy_version 1240273 (0.0010) [2023-12-28 04:09:00,923][106225] Updated weights for policy 1, policy_version 1240283 (0.0010) [2023-12-28 04:09:00,979][106225] Updated weights for policy 1, policy_version 1240293 (0.0010) [2023-12-28 04:09:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 634372096. Throughput: 0: 10167.3, 1: 9659.4. Samples: 634356336. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:09:01,175][105115] Avg episode reward: [(0, '-4.030'), (1, '-4.878')] [2023-12-28 04:09:01,488][106226] Updated weights for policy 0, policy_version 1237308 (0.0005) [2023-12-28 04:09:01,549][106226] Updated weights for policy 0, policy_version 1237318 (0.0009) [2023-12-28 04:09:01,608][106226] Updated weights for policy 0, policy_version 1237328 (0.0009) [2023-12-28 04:09:01,685][106225] Updated weights for policy 1, policy_version 1240303 (0.0010) [2023-12-28 04:09:01,750][106225] Updated weights for policy 1, policy_version 1240313 (0.0009) [2023-12-28 04:09:01,801][106225] Updated weights for policy 1, policy_version 1240323 (0.0008) [2023-12-28 04:09:02,219][106226] Updated weights for policy 0, policy_version 1237338 (0.0011) [2023-12-28 04:09:02,281][106226] Updated weights for policy 0, policy_version 1237348 (0.0011) [2023-12-28 04:09:02,344][106226] Updated weights for policy 0, policy_version 1237358 (0.0009) [2023-12-28 04:09:02,406][106226] Updated weights for policy 0, policy_version 1237368 (0.0011) [2023-12-28 04:09:02,439][106225] Updated weights for policy 1, policy_version 1240333 (0.0008) [2023-12-28 04:09:02,501][106225] Updated weights for policy 1, policy_version 1240343 (0.0007) [2023-12-28 04:09:02,557][106225] Updated weights for policy 1, policy_version 1240353 (0.0007) [2023-12-28 04:09:03,046][106226] Updated weights for policy 0, policy_version 1237378 (0.0005) [2023-12-28 04:09:03,097][106226] Updated weights for policy 0, policy_version 1237388 (0.0006) [2023-12-28 04:09:03,155][106226] Updated weights for policy 0, policy_version 1237398 (0.0006) [2023-12-28 04:09:03,328][106225] Updated weights for policy 1, policy_version 1240363 (0.0008) [2023-12-28 04:09:03,397][106225] Updated weights for policy 1, policy_version 1240373 (0.0010) [2023-12-28 04:09:03,445][106225] Updated weights for policy 1, policy_version 1240383 (0.0009) [2023-12-28 04:09:03,687][106226] Updated weights for policy 0, policy_version 1237408 (0.0006) [2023-12-28 04:09:03,741][106226] Updated weights for policy 0, policy_version 1237418 (0.0007) [2023-12-28 04:09:03,793][106226] Updated weights for policy 0, policy_version 1237428 (0.0008) [2023-12-28 04:09:04,233][106225] Updated weights for policy 1, policy_version 1240393 (0.0008) [2023-12-28 04:09:04,294][106225] Updated weights for policy 1, policy_version 1240403 (0.0007) [2023-12-28 04:09:04,353][106225] Updated weights for policy 1, policy_version 1240413 (0.0006) [2023-12-28 04:09:04,390][106226] Updated weights for policy 0, policy_version 1237438 (0.0006) [2023-12-28 04:09:04,417][106225] Updated weights for policy 1, policy_version 1240423 (0.0008) [2023-12-28 04:09:04,456][106226] Updated weights for policy 0, policy_version 1237448 (0.0007) [2023-12-28 04:09:04,519][106226] Updated weights for policy 0, policy_version 1237458 (0.0006) [2023-12-28 04:09:05,025][106225] Updated weights for policy 1, policy_version 1240433 (0.0007) [2023-12-28 04:09:05,059][106226] Updated weights for policy 0, policy_version 1237468 (0.0006) [2023-12-28 04:09:05,079][106225] Updated weights for policy 1, policy_version 1240443 (0.0008) [2023-12-28 04:09:05,118][106226] Updated weights for policy 0, policy_version 1237478 (0.0006) [2023-12-28 04:09:05,146][106225] Updated weights for policy 1, policy_version 1240453 (0.0008) [2023-12-28 04:09:05,187][106226] Updated weights for policy 0, policy_version 1237488 (0.0009) [2023-12-28 04:09:05,895][106226] Updated weights for policy 0, policy_version 1237498 (0.0011) [2023-12-28 04:09:05,903][106225] Updated weights for policy 1, policy_version 1240463 (0.0008) [2023-12-28 04:09:05,957][106226] Updated weights for policy 0, policy_version 1237508 (0.0011) [2023-12-28 04:09:05,967][106225] Updated weights for policy 1, policy_version 1240473 (0.0006) [2023-12-28 04:09:06,013][106226] Updated weights for policy 0, policy_version 1237518 (0.0011) [2023-12-28 04:09:06,033][106225] Updated weights for policy 1, policy_version 1240483 (0.0007) [2023-12-28 04:09:06,072][106226] Updated weights for policy 0, policy_version 1237528 (0.0011) [2023-12-28 04:09:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 634478592. Throughput: 0: 10286.7, 1: 9626.2. Samples: 634481844. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:09:06,175][105115] Avg episode reward: [(0, '-4.116'), (1, '-4.972')] [2023-12-28 04:09:06,786][106225] Updated weights for policy 1, policy_version 1240493 (0.0006) [2023-12-28 04:09:06,804][106226] Updated weights for policy 0, policy_version 1237538 (0.0011) [2023-12-28 04:09:06,844][106225] Updated weights for policy 1, policy_version 1240503 (0.0005) [2023-12-28 04:09:06,858][106226] Updated weights for policy 0, policy_version 1237548 (0.0011) [2023-12-28 04:09:06,901][106225] Updated weights for policy 1, policy_version 1240513 (0.0007) [2023-12-28 04:09:06,917][106226] Updated weights for policy 0, policy_version 1237558 (0.0006) [2023-12-28 04:09:07,579][106226] Updated weights for policy 0, policy_version 1237568 (0.0006) [2023-12-28 04:09:07,632][106226] Updated weights for policy 0, policy_version 1237578 (0.0006) [2023-12-28 04:09:07,660][106225] Updated weights for policy 1, policy_version 1240523 (0.0008) [2023-12-28 04:09:07,687][106226] Updated weights for policy 0, policy_version 1237588 (0.0008) [2023-12-28 04:09:07,718][106225] Updated weights for policy 1, policy_version 1240533 (0.0006) [2023-12-28 04:09:07,777][106225] Updated weights for policy 1, policy_version 1240543 (0.0008) [2023-12-28 04:09:08,428][106226] Updated weights for policy 0, policy_version 1237598 (0.0008) [2023-12-28 04:09:08,448][106225] Updated weights for policy 1, policy_version 1240553 (0.0008) [2023-12-28 04:09:08,488][106226] Updated weights for policy 0, policy_version 1237608 (0.0008) [2023-12-28 04:09:08,510][106225] Updated weights for policy 1, policy_version 1240563 (0.0007) [2023-12-28 04:09:08,552][106226] Updated weights for policy 0, policy_version 1237618 (0.0008) [2023-12-28 04:09:08,562][106225] Updated weights for policy 1, policy_version 1240573 (0.0008) [2023-12-28 04:09:08,630][106225] Updated weights for policy 1, policy_version 1240583 (0.0009) [2023-12-28 04:09:09,257][106226] Updated weights for policy 0, policy_version 1237628 (0.0007) [2023-12-28 04:09:09,327][106226] Updated weights for policy 0, policy_version 1237638 (0.0008) [2023-12-28 04:09:09,385][106225] Updated weights for policy 1, policy_version 1240593 (0.0008) [2023-12-28 04:09:09,398][106226] Updated weights for policy 0, policy_version 1237648 (0.0009) [2023-12-28 04:09:09,454][106225] Updated weights for policy 1, policy_version 1240603 (0.0008) [2023-12-28 04:09:09,519][106225] Updated weights for policy 1, policy_version 1240613 (0.0005) [2023-12-28 04:09:10,162][106226] Updated weights for policy 0, policy_version 1237658 (0.0008) [2023-12-28 04:09:10,226][106226] Updated weights for policy 0, policy_version 1237668 (0.0008) [2023-12-28 04:09:10,248][106225] Updated weights for policy 1, policy_version 1240623 (0.0008) [2023-12-28 04:09:10,290][106226] Updated weights for policy 0, policy_version 1237678 (0.0008) [2023-12-28 04:09:10,309][106225] Updated weights for policy 1, policy_version 1240633 (0.0006) [2023-12-28 04:09:10,358][106226] Updated weights for policy 0, policy_version 1237688 (0.0008) [2023-12-28 04:09:10,368][106225] Updated weights for policy 1, policy_version 1240643 (0.0007) [2023-12-28 04:09:11,044][106225] Updated weights for policy 1, policy_version 1240653 (0.0009) [2023-12-28 04:09:11,097][106226] Updated weights for policy 0, policy_version 1237698 (0.0009) [2023-12-28 04:09:11,113][106225] Updated weights for policy 1, policy_version 1240663 (0.0008) [2023-12-28 04:09:11,165][106226] Updated weights for policy 0, policy_version 1237708 (0.0009) [2023-12-28 04:09:11,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 634560512. Throughput: 0: 10257.2, 1: 9645.0. Samples: 634539592. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:09:11,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.749')] [2023-12-28 04:09:11,184][106225] Updated weights for policy 1, policy_version 1240673 (0.0008) [2023-12-28 04:09:11,221][106226] Updated weights for policy 0, policy_version 1237718 (0.0007) [2023-12-28 04:09:11,227][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001240680_317661184.pth... [2023-12-28 04:09:11,232][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001237720_316915712.pth... [2023-12-28 04:09:11,232][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001239528_317366272.pth [2023-12-28 04:09:11,235][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001236536_316612608.pth [2023-12-28 04:09:11,922][106225] Updated weights for policy 1, policy_version 1240683 (0.0008) [2023-12-28 04:09:11,992][106225] Updated weights for policy 1, policy_version 1240693 (0.0007) [2023-12-28 04:09:12,003][106226] Updated weights for policy 0, policy_version 1237728 (0.0009) [2023-12-28 04:09:12,052][106225] Updated weights for policy 1, policy_version 1240703 (0.0007) [2023-12-28 04:09:12,063][106226] Updated weights for policy 0, policy_version 1237738 (0.0008) [2023-12-28 04:09:12,124][106226] Updated weights for policy 0, policy_version 1237748 (0.0008) [2023-12-28 04:09:12,661][106225] Updated weights for policy 1, policy_version 1240713 (0.0008) [2023-12-28 04:09:12,720][106225] Updated weights for policy 1, policy_version 1240723 (0.0009) [2023-12-28 04:09:12,779][106225] Updated weights for policy 1, policy_version 1240733 (0.0009) [2023-12-28 04:09:12,830][106225] Updated weights for policy 1, policy_version 1240743 (0.0007) [2023-12-28 04:09:12,865][106226] Updated weights for policy 0, policy_version 1237758 (0.0007) [2023-12-28 04:09:12,924][106226] Updated weights for policy 0, policy_version 1237768 (0.0009) [2023-12-28 04:09:12,976][106226] Updated weights for policy 0, policy_version 1237778 (0.0009) [2023-12-28 04:09:13,518][106225] Updated weights for policy 1, policy_version 1240753 (0.0006) [2023-12-28 04:09:13,569][106225] Updated weights for policy 1, policy_version 1240763 (0.0008) [2023-12-28 04:09:13,622][106225] Updated weights for policy 1, policy_version 1240773 (0.0008) [2023-12-28 04:09:13,737][106226] Updated weights for policy 0, policy_version 1237788 (0.0009) [2023-12-28 04:09:13,790][106226] Updated weights for policy 0, policy_version 1237798 (0.0009) [2023-12-28 04:09:13,847][106226] Updated weights for policy 0, policy_version 1237808 (0.0008) [2023-12-28 04:09:14,324][106225] Updated weights for policy 1, policy_version 1240783 (0.0009) [2023-12-28 04:09:14,380][106225] Updated weights for policy 1, policy_version 1240793 (0.0008) [2023-12-28 04:09:14,435][106225] Updated weights for policy 1, policy_version 1240803 (0.0009) [2023-12-28 04:09:14,580][106226] Updated weights for policy 0, policy_version 1237818 (0.0008) [2023-12-28 04:09:14,631][106226] Updated weights for policy 0, policy_version 1237828 (0.0009) [2023-12-28 04:09:14,685][106226] Updated weights for policy 0, policy_version 1237838 (0.0008) [2023-12-28 04:09:14,729][106226] Updated weights for policy 0, policy_version 1237848 (0.0006) [2023-12-28 04:09:15,202][106225] Updated weights for policy 1, policy_version 1240813 (0.0008) [2023-12-28 04:09:15,265][106225] Updated weights for policy 1, policy_version 1240823 (0.0008) [2023-12-28 04:09:15,324][106225] Updated weights for policy 1, policy_version 1240833 (0.0008) [2023-12-28 04:09:15,470][106226] Updated weights for policy 0, policy_version 1237858 (0.0011) [2023-12-28 04:09:15,528][106226] Updated weights for policy 0, policy_version 1237868 (0.0010) [2023-12-28 04:09:15,584][106226] Updated weights for policy 0, policy_version 1237878 (0.0010) [2023-12-28 04:09:16,047][106225] Updated weights for policy 1, policy_version 1240843 (0.0007) [2023-12-28 04:09:16,106][106225] Updated weights for policy 1, policy_version 1240853 (0.0008) [2023-12-28 04:09:16,158][106225] Updated weights for policy 1, policy_version 1240863 (0.0008) [2023-12-28 04:09:16,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 634658816. Throughput: 0: 10089.9, 1: 9659.0. Samples: 634654336. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:09:16,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.769')] [2023-12-28 04:09:16,291][106226] Updated weights for policy 0, policy_version 1237888 (0.0007) [2023-12-28 04:09:16,346][106226] Updated weights for policy 0, policy_version 1237898 (0.0006) [2023-12-28 04:09:16,396][106226] Updated weights for policy 0, policy_version 1237908 (0.0010) [2023-12-28 04:09:16,901][106225] Updated weights for policy 1, policy_version 1240873 (0.0008) [2023-12-28 04:09:16,952][106225] Updated weights for policy 1, policy_version 1240883 (0.0005) [2023-12-28 04:09:17,000][106225] Updated weights for policy 1, policy_version 1240893 (0.0005) [2023-12-28 04:09:17,052][106225] Updated weights for policy 1, policy_version 1240903 (0.0007) [2023-12-28 04:09:17,082][106226] Updated weights for policy 0, policy_version 1237918 (0.0009) [2023-12-28 04:09:17,142][106226] Updated weights for policy 0, policy_version 1237928 (0.0006) [2023-12-28 04:09:17,203][106226] Updated weights for policy 0, policy_version 1237938 (0.0005) [2023-12-28 04:09:17,792][106225] Updated weights for policy 1, policy_version 1240913 (0.0008) [2023-12-28 04:09:17,798][106226] Updated weights for policy 0, policy_version 1237948 (0.0006) [2023-12-28 04:09:17,841][106225] Updated weights for policy 1, policy_version 1240923 (0.0007) [2023-12-28 04:09:17,860][106226] Updated weights for policy 0, policy_version 1237958 (0.0005) [2023-12-28 04:09:17,898][106225] Updated weights for policy 1, policy_version 1240933 (0.0008) [2023-12-28 04:09:17,923][106226] Updated weights for policy 0, policy_version 1237968 (0.0006) [2023-12-28 04:09:18,492][106226] Updated weights for policy 0, policy_version 1237978 (0.0006) [2023-12-28 04:09:18,545][106226] Updated weights for policy 0, policy_version 1237988 (0.0008) [2023-12-28 04:09:18,603][106226] Updated weights for policy 0, policy_version 1237998 (0.0008) [2023-12-28 04:09:18,664][106226] Updated weights for policy 0, policy_version 1238008 (0.0007) [2023-12-28 04:09:18,670][106225] Updated weights for policy 1, policy_version 1240943 (0.0007) [2023-12-28 04:09:18,737][106225] Updated weights for policy 1, policy_version 1240953 (0.0008) [2023-12-28 04:09:18,793][106225] Updated weights for policy 1, policy_version 1240963 (0.0008) [2023-12-28 04:09:19,437][106226] Updated weights for policy 0, policy_version 1238018 (0.0008) [2023-12-28 04:09:19,505][106226] Updated weights for policy 0, policy_version 1238028 (0.0009) [2023-12-28 04:09:19,518][106225] Updated weights for policy 1, policy_version 1240973 (0.0007) [2023-12-28 04:09:19,578][106226] Updated weights for policy 0, policy_version 1238038 (0.0008) [2023-12-28 04:09:19,584][106225] Updated weights for policy 1, policy_version 1240983 (0.0007) [2023-12-28 04:09:19,650][106225] Updated weights for policy 1, policy_version 1240993 (0.0009) [2023-12-28 04:09:20,291][106226] Updated weights for policy 0, policy_version 1238048 (0.0009) [2023-12-28 04:09:20,348][106226] Updated weights for policy 0, policy_version 1238058 (0.0008) [2023-12-28 04:09:20,382][106225] Updated weights for policy 1, policy_version 1241003 (0.0009) [2023-12-28 04:09:20,405][106226] Updated weights for policy 0, policy_version 1238068 (0.0005) [2023-12-28 04:09:20,437][106225] Updated weights for policy 1, policy_version 1241013 (0.0008) [2023-12-28 04:09:20,502][106225] Updated weights for policy 1, policy_version 1241023 (0.0009) [2023-12-28 04:09:21,153][106226] Updated weights for policy 0, policy_version 1238078 (0.0007) [2023-12-28 04:09:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 634757120. Throughput: 0: 10017.9, 1: 9604.8. Samples: 634770408. Policy #0 lag: (min: 11.0, avg: 20.6, max: 43.0) [2023-12-28 04:09:21,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.158')] [2023-12-28 04:09:21,218][106226] Updated weights for policy 0, policy_version 1238088 (0.0008) [2023-12-28 04:09:21,273][106225] Updated weights for policy 1, policy_version 1241033 (0.0009) [2023-12-28 04:09:21,287][106226] Updated weights for policy 0, policy_version 1238098 (0.0009) [2023-12-28 04:09:21,337][106225] Updated weights for policy 1, policy_version 1241043 (0.0008) [2023-12-28 04:09:21,415][106225] Updated weights for policy 1, policy_version 1241053 (0.0008) [2023-12-28 04:09:21,483][106225] Updated weights for policy 1, policy_version 1241063 (0.0009) [2023-12-28 04:09:22,033][106226] Updated weights for policy 0, policy_version 1238108 (0.0007) [2023-12-28 04:09:22,095][106226] Updated weights for policy 0, policy_version 1238118 (0.0006) [2023-12-28 04:09:22,162][106226] Updated weights for policy 0, policy_version 1238128 (0.0008) [2023-12-28 04:09:22,196][106225] Updated weights for policy 1, policy_version 1241073 (0.0006) [2023-12-28 04:09:22,259][106225] Updated weights for policy 1, policy_version 1241083 (0.0008) [2023-12-28 04:09:22,324][106225] Updated weights for policy 1, policy_version 1241093 (0.0008) [2023-12-28 04:09:22,919][106226] Updated weights for policy 0, policy_version 1238138 (0.0008) [2023-12-28 04:09:22,985][106226] Updated weights for policy 0, policy_version 1238148 (0.0008) [2023-12-28 04:09:23,009][106225] Updated weights for policy 1, policy_version 1241103 (0.0009) [2023-12-28 04:09:23,043][106226] Updated weights for policy 0, policy_version 1238158 (0.0006) [2023-12-28 04:09:23,067][106225] Updated weights for policy 1, policy_version 1241113 (0.0008) [2023-12-28 04:09:23,105][106226] Updated weights for policy 0, policy_version 1238168 (0.0008) [2023-12-28 04:09:23,131][106225] Updated weights for policy 1, policy_version 1241123 (0.0009) [2023-12-28 04:09:23,698][106226] Updated weights for policy 0, policy_version 1238178 (0.0008) [2023-12-28 04:09:23,763][106226] Updated weights for policy 0, policy_version 1238188 (0.0006) [2023-12-28 04:09:23,826][106226] Updated weights for policy 0, policy_version 1238198 (0.0005) [2023-12-28 04:09:23,828][106225] Updated weights for policy 1, policy_version 1241133 (0.0008) [2023-12-28 04:09:23,879][106225] Updated weights for policy 1, policy_version 1241143 (0.0008) [2023-12-28 04:09:23,937][106225] Updated weights for policy 1, policy_version 1241153 (0.0009) [2023-12-28 04:09:24,456][106226] Updated weights for policy 0, policy_version 1238208 (0.0006) [2023-12-28 04:09:24,516][106226] Updated weights for policy 0, policy_version 1238218 (0.0005) [2023-12-28 04:09:24,577][106226] Updated weights for policy 0, policy_version 1238228 (0.0009) [2023-12-28 04:09:24,622][106225] Updated weights for policy 1, policy_version 1241163 (0.0008) [2023-12-28 04:09:24,670][106225] Updated weights for policy 1, policy_version 1241173 (0.0006) [2023-12-28 04:09:24,726][106225] Updated weights for policy 1, policy_version 1241183 (0.0009) [2023-12-28 04:09:25,291][106226] Updated weights for policy 0, policy_version 1238238 (0.0008) [2023-12-28 04:09:25,345][106225] Updated weights for policy 1, policy_version 1241193 (0.0008) [2023-12-28 04:09:25,346][106226] Updated weights for policy 0, policy_version 1238248 (0.0008) [2023-12-28 04:09:25,393][106225] Updated weights for policy 1, policy_version 1241203 (0.0005) [2023-12-28 04:09:25,405][106226] Updated weights for policy 0, policy_version 1238258 (0.0008) [2023-12-28 04:09:25,442][106225] Updated weights for policy 1, policy_version 1241213 (0.0005) [2023-12-28 04:09:25,497][106225] Updated weights for policy 1, policy_version 1241223 (0.0007) [2023-12-28 04:09:26,106][106225] Updated weights for policy 1, policy_version 1241233 (0.0006) [2023-12-28 04:09:26,155][106225] Updated weights for policy 1, policy_version 1241243 (0.0006) [2023-12-28 04:09:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 634855424. Throughput: 0: 9969.8, 1: 9625.5. Samples: 634829332. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:26,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.987')] [2023-12-28 04:09:26,191][106226] Updated weights for policy 0, policy_version 1238268 (0.0008) [2023-12-28 04:09:26,212][106225] Updated weights for policy 1, policy_version 1241253 (0.0006) [2023-12-28 04:09:26,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001241256_317808640.pth... [2023-12-28 04:09:26,231][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001240104_317513728.pth [2023-12-28 04:09:26,251][106226] Updated weights for policy 0, policy_version 1238278 (0.0009) [2023-12-28 04:09:26,321][106226] Updated weights for policy 0, policy_version 1238289 (0.0009) [2023-12-28 04:09:26,356][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001238296_317063168.pth... [2023-12-28 04:09:26,360][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001237112_316760064.pth [2023-12-28 04:09:26,905][106225] Updated weights for policy 1, policy_version 1241263 (0.0007) [2023-12-28 04:09:26,955][106225] Updated weights for policy 1, policy_version 1241273 (0.0008) [2023-12-28 04:09:26,999][106225] Updated weights for policy 1, policy_version 1241283 (0.0008) [2023-12-28 04:09:27,034][106226] Updated weights for policy 0, policy_version 1238299 (0.0008) [2023-12-28 04:09:27,101][106226] Updated weights for policy 0, policy_version 1238309 (0.0009) [2023-12-28 04:09:27,157][106226] Updated weights for policy 0, policy_version 1238319 (0.0009) [2023-12-28 04:09:27,621][106225] Updated weights for policy 1, policy_version 1241293 (0.0007) [2023-12-28 04:09:27,677][106225] Updated weights for policy 1, policy_version 1241303 (0.0005) [2023-12-28 04:09:27,730][106225] Updated weights for policy 1, policy_version 1241313 (0.0007) [2023-12-28 04:09:27,963][106226] Updated weights for policy 0, policy_version 1238329 (0.0008) [2023-12-28 04:09:28,027][106226] Updated weights for policy 0, policy_version 1238339 (0.0008) [2023-12-28 04:09:28,081][106226] Updated weights for policy 0, policy_version 1238349 (0.0009) [2023-12-28 04:09:28,141][106226] Updated weights for policy 0, policy_version 1238359 (0.0008) [2023-12-28 04:09:28,289][106225] Updated weights for policy 1, policy_version 1241323 (0.0007) [2023-12-28 04:09:28,354][106225] Updated weights for policy 1, policy_version 1241333 (0.0008) [2023-12-28 04:09:28,414][106225] Updated weights for policy 1, policy_version 1241343 (0.0009) [2023-12-28 04:09:28,842][106226] Updated weights for policy 0, policy_version 1238369 (0.0006) [2023-12-28 04:09:28,900][106226] Updated weights for policy 0, policy_version 1238379 (0.0005) [2023-12-28 04:09:28,949][106226] Updated weights for policy 0, policy_version 1238389 (0.0005) [2023-12-28 04:09:29,171][106225] Updated weights for policy 1, policy_version 1241353 (0.0008) [2023-12-28 04:09:29,238][106225] Updated weights for policy 1, policy_version 1241363 (0.0008) [2023-12-28 04:09:29,304][106225] Updated weights for policy 1, policy_version 1241373 (0.0009) [2023-12-28 04:09:29,371][106225] Updated weights for policy 1, policy_version 1241383 (0.0008) [2023-12-28 04:09:29,618][106226] Updated weights for policy 0, policy_version 1238399 (0.0009) [2023-12-28 04:09:29,665][106226] Updated weights for policy 0, policy_version 1238409 (0.0011) [2023-12-28 04:09:29,716][106226] Updated weights for policy 0, policy_version 1238419 (0.0011) [2023-12-28 04:09:30,113][106225] Updated weights for policy 1, policy_version 1241393 (0.0010) [2023-12-28 04:09:30,173][106225] Updated weights for policy 1, policy_version 1241403 (0.0007) [2023-12-28 04:09:30,233][106225] Updated weights for policy 1, policy_version 1241413 (0.0006) [2023-12-28 04:09:30,482][106226] Updated weights for policy 0, policy_version 1238429 (0.0011) [2023-12-28 04:09:30,537][106226] Updated weights for policy 0, policy_version 1238439 (0.0010) [2023-12-28 04:09:30,589][106226] Updated weights for policy 0, policy_version 1238449 (0.0010) [2023-12-28 04:09:30,815][106225] Updated weights for policy 1, policy_version 1241423 (0.0009) [2023-12-28 04:09:30,865][106225] Updated weights for policy 1, policy_version 1241433 (0.0009) [2023-12-28 04:09:30,924][106225] Updated weights for policy 1, policy_version 1241443 (0.0006) [2023-12-28 04:09:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 634961920. Throughput: 0: 9979.0, 1: 9788.5. Samples: 634950296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:31,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.035')] [2023-12-28 04:09:31,274][106226] Updated weights for policy 0, policy_version 1238459 (0.0010) [2023-12-28 04:09:31,336][106226] Updated weights for policy 0, policy_version 1238469 (0.0006) [2023-12-28 04:09:31,404][106226] Updated weights for policy 0, policy_version 1238479 (0.0007) [2023-12-28 04:09:31,631][106225] Updated weights for policy 1, policy_version 1241453 (0.0010) [2023-12-28 04:09:31,688][106225] Updated weights for policy 1, policy_version 1241463 (0.0013) [2023-12-28 04:09:31,757][106225] Updated weights for policy 1, policy_version 1241473 (0.0009) [2023-12-28 04:09:32,097][106226] Updated weights for policy 0, policy_version 1238489 (0.0011) [2023-12-28 04:09:32,165][106226] Updated weights for policy 0, policy_version 1238499 (0.0011) [2023-12-28 04:09:32,224][106226] Updated weights for policy 0, policy_version 1238509 (0.0011) [2023-12-28 04:09:32,288][106226] Updated weights for policy 0, policy_version 1238519 (0.0011) [2023-12-28 04:09:32,474][106225] Updated weights for policy 1, policy_version 1241483 (0.0006) [2023-12-28 04:09:32,531][106225] Updated weights for policy 1, policy_version 1241493 (0.0005) [2023-12-28 04:09:32,583][106225] Updated weights for policy 1, policy_version 1241503 (0.0006) [2023-12-28 04:09:32,917][106226] Updated weights for policy 0, policy_version 1238529 (0.0006) [2023-12-28 04:09:32,969][106226] Updated weights for policy 0, policy_version 1238539 (0.0005) [2023-12-28 04:09:33,024][106226] Updated weights for policy 0, policy_version 1238549 (0.0005) [2023-12-28 04:09:33,361][106225] Updated weights for policy 1, policy_version 1241513 (0.0008) [2023-12-28 04:09:33,414][106225] Updated weights for policy 1, policy_version 1241523 (0.0008) [2023-12-28 04:09:33,466][106225] Updated weights for policy 1, policy_version 1241533 (0.0007) [2023-12-28 04:09:33,529][106225] Updated weights for policy 1, policy_version 1241543 (0.0007) [2023-12-28 04:09:33,643][106226] Updated weights for policy 0, policy_version 1238559 (0.0009) [2023-12-28 04:09:33,692][106226] Updated weights for policy 0, policy_version 1238569 (0.0010) [2023-12-28 04:09:33,740][106226] Updated weights for policy 0, policy_version 1238579 (0.0010) [2023-12-28 04:09:34,184][106225] Updated weights for policy 1, policy_version 1241553 (0.0007) [2023-12-28 04:09:34,254][106225] Updated weights for policy 1, policy_version 1241563 (0.0006) [2023-12-28 04:09:34,314][106225] Updated weights for policy 1, policy_version 1241573 (0.0008) [2023-12-28 04:09:34,492][106226] Updated weights for policy 0, policy_version 1238589 (0.0010) [2023-12-28 04:09:34,561][106226] Updated weights for policy 0, policy_version 1238599 (0.0007) [2023-12-28 04:09:34,624][106226] Updated weights for policy 0, policy_version 1238609 (0.0008) [2023-12-28 04:09:34,963][106225] Updated weights for policy 1, policy_version 1241583 (0.0009) [2023-12-28 04:09:35,012][106225] Updated weights for policy 1, policy_version 1241593 (0.0009) [2023-12-28 04:09:35,061][106225] Updated weights for policy 1, policy_version 1241603 (0.0008) [2023-12-28 04:09:35,317][106226] Updated weights for policy 0, policy_version 1238619 (0.0007) [2023-12-28 04:09:35,370][106226] Updated weights for policy 0, policy_version 1238629 (0.0006) [2023-12-28 04:09:35,416][106226] Updated weights for policy 0, policy_version 1238639 (0.0005) [2023-12-28 04:09:35,833][106225] Updated weights for policy 1, policy_version 1241613 (0.0009) [2023-12-28 04:09:35,893][106225] Updated weights for policy 1, policy_version 1241623 (0.0008) [2023-12-28 04:09:35,963][106225] Updated weights for policy 1, policy_version 1241633 (0.0008) [2023-12-28 04:09:36,163][106226] Updated weights for policy 0, policy_version 1238649 (0.0008) [2023-12-28 04:09:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 635060224. Throughput: 0: 9966.5, 1: 9842.8. Samples: 635071196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:36,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.918')] [2023-12-28 04:09:36,237][106226] Updated weights for policy 0, policy_version 1238659 (0.0008) [2023-12-28 04:09:36,300][106226] Updated weights for policy 0, policy_version 1238669 (0.0008) [2023-12-28 04:09:36,363][106226] Updated weights for policy 0, policy_version 1238679 (0.0008) [2023-12-28 04:09:36,727][106225] Updated weights for policy 1, policy_version 1241643 (0.0009) [2023-12-28 04:09:36,786][106225] Updated weights for policy 1, policy_version 1241653 (0.0009) [2023-12-28 04:09:36,853][106225] Updated weights for policy 1, policy_version 1241663 (0.0008) [2023-12-28 04:09:36,996][106226] Updated weights for policy 0, policy_version 1238689 (0.0010) [2023-12-28 04:09:37,060][106226] Updated weights for policy 0, policy_version 1238699 (0.0011) [2023-12-28 04:09:37,114][106226] Updated weights for policy 0, policy_version 1238709 (0.0011) [2023-12-28 04:09:37,615][106225] Updated weights for policy 1, policy_version 1241673 (0.0009) [2023-12-28 04:09:37,669][106225] Updated weights for policy 1, policy_version 1241683 (0.0008) [2023-12-28 04:09:37,720][106225] Updated weights for policy 1, policy_version 1241693 (0.0008) [2023-12-28 04:09:37,776][106225] Updated weights for policy 1, policy_version 1241703 (0.0008) [2023-12-28 04:09:37,805][106226] Updated weights for policy 0, policy_version 1238719 (0.0009) [2023-12-28 04:09:37,866][106226] Updated weights for policy 0, policy_version 1238729 (0.0008) [2023-12-28 04:09:37,923][106226] Updated weights for policy 0, policy_version 1238739 (0.0005) [2023-12-28 04:09:38,362][106225] Updated weights for policy 1, policy_version 1241713 (0.0007) [2023-12-28 04:09:38,421][106225] Updated weights for policy 1, policy_version 1241723 (0.0008) [2023-12-28 04:09:38,484][106225] Updated weights for policy 1, policy_version 1241733 (0.0009) [2023-12-28 04:09:38,569][106226] Updated weights for policy 0, policy_version 1238749 (0.0007) [2023-12-28 04:09:38,624][106226] Updated weights for policy 0, policy_version 1238759 (0.0008) [2023-12-28 04:09:38,681][106226] Updated weights for policy 0, policy_version 1238769 (0.0009) [2023-12-28 04:09:39,132][106225] Updated weights for policy 1, policy_version 1241743 (0.0008) [2023-12-28 04:09:39,201][106225] Updated weights for policy 1, policy_version 1241753 (0.0009) [2023-12-28 04:09:39,266][106225] Updated weights for policy 1, policy_version 1241763 (0.0008) [2023-12-28 04:09:39,442][106226] Updated weights for policy 0, policy_version 1238779 (0.0008) [2023-12-28 04:09:39,503][106226] Updated weights for policy 0, policy_version 1238789 (0.0009) [2023-12-28 04:09:39,561][106226] Updated weights for policy 0, policy_version 1238799 (0.0009) [2023-12-28 04:09:40,016][106225] Updated weights for policy 1, policy_version 1241773 (0.0009) [2023-12-28 04:09:40,073][106225] Updated weights for policy 1, policy_version 1241783 (0.0008) [2023-12-28 04:09:40,137][106225] Updated weights for policy 1, policy_version 1241793 (0.0009) [2023-12-28 04:09:40,307][106226] Updated weights for policy 0, policy_version 1238809 (0.0008) [2023-12-28 04:09:40,364][106226] Updated weights for policy 0, policy_version 1238819 (0.0009) [2023-12-28 04:09:40,418][106226] Updated weights for policy 0, policy_version 1238829 (0.0008) [2023-12-28 04:09:40,476][106226] Updated weights for policy 0, policy_version 1238839 (0.0007) [2023-12-28 04:09:40,869][106225] Updated weights for policy 1, policy_version 1241803 (0.0007) [2023-12-28 04:09:40,925][106225] Updated weights for policy 1, policy_version 1241813 (0.0008) [2023-12-28 04:09:40,974][106225] Updated weights for policy 1, policy_version 1241823 (0.0007) [2023-12-28 04:09:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 635158528. Throughput: 0: 9960.2, 1: 9856.9. Samples: 635130296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:41,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.946')] [2023-12-28 04:09:41,176][106226] Updated weights for policy 0, policy_version 1238849 (0.0007) [2023-12-28 04:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001241832_317956096.pth... [2023-12-28 04:09:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001240680_317661184.pth [2023-12-28 04:09:41,243][106226] Updated weights for policy 0, policy_version 1238859 (0.0008) [2023-12-28 04:09:41,318][106226] Updated weights for policy 0, policy_version 1238869 (0.0009) [2023-12-28 04:09:41,333][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001238872_317210624.pth... [2023-12-28 04:09:41,336][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001237720_316915712.pth [2023-12-28 04:09:41,762][106225] Updated weights for policy 1, policy_version 1241833 (0.0007) [2023-12-28 04:09:41,816][106225] Updated weights for policy 1, policy_version 1241843 (0.0007) [2023-12-28 04:09:41,882][106225] Updated weights for policy 1, policy_version 1241853 (0.0006) [2023-12-28 04:09:41,945][106225] Updated weights for policy 1, policy_version 1241863 (0.0008) [2023-12-28 04:09:41,968][106226] Updated weights for policy 0, policy_version 1238879 (0.0008) [2023-12-28 04:09:42,036][106226] Updated weights for policy 0, policy_version 1238889 (0.0010) [2023-12-28 04:09:42,102][106226] Updated weights for policy 0, policy_version 1238899 (0.0010) [2023-12-28 04:09:42,659][106225] Updated weights for policy 1, policy_version 1241873 (0.0008) [2023-12-28 04:09:42,713][106225] Updated weights for policy 1, policy_version 1241883 (0.0010) [2023-12-28 04:09:42,769][106225] Updated weights for policy 1, policy_version 1241893 (0.0010) [2023-12-28 04:09:42,792][106226] Updated weights for policy 0, policy_version 1238909 (0.0008) [2023-12-28 04:09:42,849][106226] Updated weights for policy 0, policy_version 1238919 (0.0011) [2023-12-28 04:09:42,902][106226] Updated weights for policy 0, policy_version 1238929 (0.0010) [2023-12-28 04:09:43,415][106225] Updated weights for policy 1, policy_version 1241903 (0.0007) [2023-12-28 04:09:43,468][106225] Updated weights for policy 1, policy_version 1241913 (0.0005) [2023-12-28 04:09:43,528][106225] Updated weights for policy 1, policy_version 1241923 (0.0006) [2023-12-28 04:09:43,563][106226] Updated weights for policy 0, policy_version 1238939 (0.0010) [2023-12-28 04:09:43,623][106226] Updated weights for policy 0, policy_version 1238949 (0.0009) [2023-12-28 04:09:43,688][106226] Updated weights for policy 0, policy_version 1238959 (0.0005) [2023-12-28 04:09:44,049][106225] Updated weights for policy 1, policy_version 1241933 (0.0006) [2023-12-28 04:09:44,107][106225] Updated weights for policy 1, policy_version 1241943 (0.0006) [2023-12-28 04:09:44,163][106225] Updated weights for policy 1, policy_version 1241953 (0.0006) [2023-12-28 04:09:44,355][106226] Updated weights for policy 0, policy_version 1238969 (0.0006) [2023-12-28 04:09:44,416][106226] Updated weights for policy 0, policy_version 1238979 (0.0010) [2023-12-28 04:09:44,480][106226] Updated weights for policy 0, policy_version 1238989 (0.0011) [2023-12-28 04:09:44,537][106226] Updated weights for policy 0, policy_version 1238999 (0.0011) [2023-12-28 04:09:44,856][106225] Updated weights for policy 1, policy_version 1241963 (0.0007) [2023-12-28 04:09:44,919][106225] Updated weights for policy 1, policy_version 1241973 (0.0008) [2023-12-28 04:09:44,983][106225] Updated weights for policy 1, policy_version 1241983 (0.0007) [2023-12-28 04:09:45,320][106226] Updated weights for policy 0, policy_version 1239009 (0.0010) [2023-12-28 04:09:45,383][106226] Updated weights for policy 0, policy_version 1239019 (0.0011) [2023-12-28 04:09:45,449][106226] Updated weights for policy 0, policy_version 1239029 (0.0010) [2023-12-28 04:09:45,674][106225] Updated weights for policy 1, policy_version 1241993 (0.0008) [2023-12-28 04:09:45,734][106225] Updated weights for policy 1, policy_version 1242003 (0.0008) [2023-12-28 04:09:45,780][106225] Updated weights for policy 1, policy_version 1242013 (0.0010) [2023-12-28 04:09:45,826][106225] Updated weights for policy 1, policy_version 1242023 (0.0010) [2023-12-28 04:09:46,125][106226] Updated weights for policy 0, policy_version 1239039 (0.0010) [2023-12-28 04:09:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 635256832. Throughput: 0: 9946.5, 1: 9899.1. Samples: 635249388. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:46,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-5.062')] [2023-12-28 04:09:46,180][106226] Updated weights for policy 0, policy_version 1239049 (0.0010) [2023-12-28 04:09:46,231][106226] Updated weights for policy 0, policy_version 1239059 (0.0010) [2023-12-28 04:09:46,562][106225] Updated weights for policy 1, policy_version 1242033 (0.0009) [2023-12-28 04:09:46,612][106225] Updated weights for policy 1, policy_version 1242043 (0.0009) [2023-12-28 04:09:46,670][106225] Updated weights for policy 1, policy_version 1242053 (0.0008) [2023-12-28 04:09:46,893][106226] Updated weights for policy 0, policy_version 1239069 (0.0008) [2023-12-28 04:09:46,947][106226] Updated weights for policy 0, policy_version 1239079 (0.0007) [2023-12-28 04:09:46,998][106226] Updated weights for policy 0, policy_version 1239089 (0.0005) [2023-12-28 04:09:47,422][106225] Updated weights for policy 1, policy_version 1242063 (0.0010) [2023-12-28 04:09:47,485][106225] Updated weights for policy 1, policy_version 1242073 (0.0010) [2023-12-28 04:09:47,544][106226] Updated weights for policy 0, policy_version 1239099 (0.0005) [2023-12-28 04:09:47,550][106225] Updated weights for policy 1, policy_version 1242083 (0.0010) [2023-12-28 04:09:47,603][106226] Updated weights for policy 0, policy_version 1239109 (0.0007) [2023-12-28 04:09:47,661][106226] Updated weights for policy 0, policy_version 1239119 (0.0009) [2023-12-28 04:09:48,223][106226] Updated weights for policy 0, policy_version 1239129 (0.0007) [2023-12-28 04:09:48,257][106225] Updated weights for policy 1, policy_version 1242093 (0.0009) [2023-12-28 04:09:48,287][106226] Updated weights for policy 0, policy_version 1239139 (0.0005) [2023-12-28 04:09:48,313][106225] Updated weights for policy 1, policy_version 1242103 (0.0007) [2023-12-28 04:09:48,350][106226] Updated weights for policy 0, policy_version 1239149 (0.0007) [2023-12-28 04:09:48,378][106225] Updated weights for policy 1, policy_version 1242113 (0.0007) [2023-12-28 04:09:48,404][106226] Updated weights for policy 0, policy_version 1239159 (0.0009) [2023-12-28 04:09:49,090][106226] Updated weights for policy 0, policy_version 1239169 (0.0009) [2023-12-28 04:09:49,129][106225] Updated weights for policy 1, policy_version 1242123 (0.0006) [2023-12-28 04:09:49,143][106226] Updated weights for policy 0, policy_version 1239179 (0.0007) [2023-12-28 04:09:49,174][106225] Updated weights for policy 1, policy_version 1242133 (0.0005) [2023-12-28 04:09:49,197][106226] Updated weights for policy 0, policy_version 1239189 (0.0006) [2023-12-28 04:09:49,223][106225] Updated weights for policy 1, policy_version 1242143 (0.0007) [2023-12-28 04:09:49,948][106226] Updated weights for policy 0, policy_version 1239199 (0.0009) [2023-12-28 04:09:49,968][106225] Updated weights for policy 1, policy_version 1242153 (0.0009) [2023-12-28 04:09:50,018][106226] Updated weights for policy 0, policy_version 1239209 (0.0007) [2023-12-28 04:09:50,026][106225] Updated weights for policy 1, policy_version 1242163 (0.0008) [2023-12-28 04:09:50,070][106226] Updated weights for policy 0, policy_version 1239219 (0.0007) [2023-12-28 04:09:50,084][106225] Updated weights for policy 1, policy_version 1242173 (0.0008) [2023-12-28 04:09:50,147][106225] Updated weights for policy 1, policy_version 1242183 (0.0008) [2023-12-28 04:09:50,820][106226] Updated weights for policy 0, policy_version 1239229 (0.0008) [2023-12-28 04:09:50,878][106226] Updated weights for policy 0, policy_version 1239239 (0.0009) [2023-12-28 04:09:50,919][106225] Updated weights for policy 1, policy_version 1242193 (0.0007) [2023-12-28 04:09:50,940][106226] Updated weights for policy 0, policy_version 1239249 (0.0009) [2023-12-28 04:09:50,978][106225] Updated weights for policy 1, policy_version 1242203 (0.0006) [2023-12-28 04:09:51,044][106225] Updated weights for policy 1, policy_version 1242213 (0.0008) [2023-12-28 04:09:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 635363328. Throughput: 0: 9847.3, 1: 9840.1. Samples: 635367776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:51,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.701')] [2023-12-28 04:09:51,667][106226] Updated weights for policy 0, policy_version 1239259 (0.0008) [2023-12-28 04:09:51,724][106226] Updated weights for policy 0, policy_version 1239269 (0.0009) [2023-12-28 04:09:51,791][106226] Updated weights for policy 0, policy_version 1239279 (0.0007) [2023-12-28 04:09:51,796][106225] Updated weights for policy 1, policy_version 1242223 (0.0008) [2023-12-28 04:09:51,856][106225] Updated weights for policy 1, policy_version 1242233 (0.0008) [2023-12-28 04:09:51,918][106225] Updated weights for policy 1, policy_version 1242243 (0.0009) [2023-12-28 04:09:52,572][106226] Updated weights for policy 0, policy_version 1239289 (0.0008) [2023-12-28 04:09:52,633][106225] Updated weights for policy 1, policy_version 1242253 (0.0007) [2023-12-28 04:09:52,637][106226] Updated weights for policy 0, policy_version 1239299 (0.0009) [2023-12-28 04:09:52,689][106226] Updated weights for policy 0, policy_version 1239309 (0.0008) [2023-12-28 04:09:52,691][106225] Updated weights for policy 1, policy_version 1242263 (0.0007) [2023-12-28 04:09:52,745][106225] Updated weights for policy 1, policy_version 1242273 (0.0007) [2023-12-28 04:09:52,745][106226] Updated weights for policy 0, policy_version 1239319 (0.0008) [2023-12-28 04:09:53,403][106225] Updated weights for policy 1, policy_version 1242283 (0.0006) [2023-12-28 04:09:53,464][106225] Updated weights for policy 1, policy_version 1242293 (0.0005) [2023-12-28 04:09:53,520][106225] Updated weights for policy 1, policy_version 1242303 (0.0005) [2023-12-28 04:09:53,558][106226] Updated weights for policy 0, policy_version 1239329 (0.0008) [2023-12-28 04:09:53,611][106226] Updated weights for policy 0, policy_version 1239339 (0.0008) [2023-12-28 04:09:53,668][106226] Updated weights for policy 0, policy_version 1239349 (0.0009) [2023-12-28 04:09:54,162][106225] Updated weights for policy 1, policy_version 1242313 (0.0006) [2023-12-28 04:09:54,227][106225] Updated weights for policy 1, policy_version 1242323 (0.0008) [2023-12-28 04:09:54,284][106225] Updated weights for policy 1, policy_version 1242333 (0.0008) [2023-12-28 04:09:54,339][106225] Updated weights for policy 1, policy_version 1242343 (0.0007) [2023-12-28 04:09:54,375][106226] Updated weights for policy 0, policy_version 1239359 (0.0008) [2023-12-28 04:09:54,428][106226] Updated weights for policy 0, policy_version 1239369 (0.0009) [2023-12-28 04:09:54,482][106226] Updated weights for policy 0, policy_version 1239379 (0.0008) [2023-12-28 04:09:54,948][106225] Updated weights for policy 1, policy_version 1242353 (0.0006) [2023-12-28 04:09:55,012][106225] Updated weights for policy 1, policy_version 1242363 (0.0009) [2023-12-28 04:09:55,059][106225] Updated weights for policy 1, policy_version 1242373 (0.0010) [2023-12-28 04:09:55,257][106226] Updated weights for policy 0, policy_version 1239389 (0.0009) [2023-12-28 04:09:55,310][106226] Updated weights for policy 0, policy_version 1239399 (0.0007) [2023-12-28 04:09:55,373][106226] Updated weights for policy 0, policy_version 1239409 (0.0007) [2023-12-28 04:09:55,602][106225] Updated weights for policy 1, policy_version 1242383 (0.0007) [2023-12-28 04:09:55,649][106225] Updated weights for policy 1, policy_version 1242393 (0.0005) [2023-12-28 04:09:55,698][106225] Updated weights for policy 1, policy_version 1242403 (0.0005) [2023-12-28 04:09:56,114][106226] Updated weights for policy 0, policy_version 1239419 (0.0009) [2023-12-28 04:09:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 635453440. Throughput: 0: 9815.4, 1: 9873.5. Samples: 635425596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:09:56,175][105115] Avg episode reward: [(0, '-4.118'), (1, '-5.148')] [2023-12-28 04:09:56,178][106226] Updated weights for policy 0, policy_version 1239429 (0.0009) [2023-12-28 04:09:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001242408_318103552.pth... [2023-12-28 04:09:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001241256_317808640.pth [2023-12-28 04:09:56,237][106226] Updated weights for policy 0, policy_version 1239439 (0.0005) [2023-12-28 04:09:56,285][106225] Updated weights for policy 1, policy_version 1242413 (0.0005) [2023-12-28 04:09:56,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001239448_317358080.pth... [2023-12-28 04:09:56,304][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001238296_317063168.pth [2023-12-28 04:09:56,336][106225] Updated weights for policy 1, policy_version 1242423 (0.0005) [2023-12-28 04:09:56,398][106225] Updated weights for policy 1, policy_version 1242433 (0.0007) [2023-12-28 04:09:56,800][106226] Updated weights for policy 0, policy_version 1239449 (0.0006) [2023-12-28 04:09:56,863][106226] Updated weights for policy 0, policy_version 1239460 (0.0009) [2023-12-28 04:09:56,923][106226] Updated weights for policy 0, policy_version 1239470 (0.0005) [2023-12-28 04:09:56,971][106226] Updated weights for policy 0, policy_version 1239480 (0.0005) [2023-12-28 04:09:57,120][106225] Updated weights for policy 1, policy_version 1242443 (0.0008) [2023-12-28 04:09:57,167][106225] Updated weights for policy 1, policy_version 1242453 (0.0008) [2023-12-28 04:09:57,215][106225] Updated weights for policy 1, policy_version 1242463 (0.0007) [2023-12-28 04:09:57,543][106226] Updated weights for policy 0, policy_version 1239490 (0.0009) [2023-12-28 04:09:57,600][106226] Updated weights for policy 0, policy_version 1239500 (0.0010) [2023-12-28 04:09:57,657][106226] Updated weights for policy 0, policy_version 1239510 (0.0009) [2023-12-28 04:09:57,933][106225] Updated weights for policy 1, policy_version 1242473 (0.0006) [2023-12-28 04:09:57,990][106225] Updated weights for policy 1, policy_version 1242483 (0.0010) [2023-12-28 04:09:58,052][106225] Updated weights for policy 1, policy_version 1242493 (0.0010) [2023-12-28 04:09:58,099][106225] Updated weights for policy 1, policy_version 1242503 (0.0010) [2023-12-28 04:09:58,259][106226] Updated weights for policy 0, policy_version 1239520 (0.0010) [2023-12-28 04:09:58,316][106226] Updated weights for policy 0, policy_version 1239530 (0.0010) [2023-12-28 04:09:58,397][106226] Updated weights for policy 0, policy_version 1239540 (0.0009) [2023-12-28 04:09:58,887][106225] Updated weights for policy 1, policy_version 1242513 (0.0010) [2023-12-28 04:09:58,951][106225] Updated weights for policy 1, policy_version 1242523 (0.0009) [2023-12-28 04:09:59,016][106225] Updated weights for policy 1, policy_version 1242533 (0.0009) [2023-12-28 04:09:59,211][106226] Updated weights for policy 0, policy_version 1239550 (0.0009) [2023-12-28 04:09:59,278][106226] Updated weights for policy 0, policy_version 1239560 (0.0009) [2023-12-28 04:09:59,350][106226] Updated weights for policy 0, policy_version 1239570 (0.0009) [2023-12-28 04:09:59,804][106225] Updated weights for policy 1, policy_version 1242543 (0.0010) [2023-12-28 04:09:59,868][106225] Updated weights for policy 1, policy_version 1242553 (0.0009) [2023-12-28 04:09:59,928][106225] Updated weights for policy 1, policy_version 1242563 (0.0008) [2023-12-28 04:10:00,105][106226] Updated weights for policy 0, policy_version 1239580 (0.0009) [2023-12-28 04:10:00,154][106226] Updated weights for policy 0, policy_version 1239590 (0.0008) [2023-12-28 04:10:00,205][106226] Updated weights for policy 0, policy_version 1239600 (0.0008) [2023-12-28 04:10:00,650][106225] Updated weights for policy 1, policy_version 1242573 (0.0010) [2023-12-28 04:10:00,707][106225] Updated weights for policy 1, policy_version 1242583 (0.0010) [2023-12-28 04:10:00,768][106225] Updated weights for policy 1, policy_version 1242593 (0.0010) [2023-12-28 04:10:00,964][106226] Updated weights for policy 0, policy_version 1239610 (0.0008) [2023-12-28 04:10:01,018][106226] Updated weights for policy 0, policy_version 1239620 (0.0009) [2023-12-28 04:10:01,081][106226] Updated weights for policy 0, policy_version 1239630 (0.0009) [2023-12-28 04:10:01,150][106226] Updated weights for policy 0, policy_version 1239640 (0.0009) [2023-12-28 04:10:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 635559936. Throughput: 0: 9913.6, 1: 9921.6. Samples: 635546920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:01,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.986')] [2023-12-28 04:10:01,450][106225] Updated weights for policy 1, policy_version 1242603 (0.0009) [2023-12-28 04:10:01,497][106225] Updated weights for policy 1, policy_version 1242613 (0.0005) [2023-12-28 04:10:01,552][106225] Updated weights for policy 1, policy_version 1242623 (0.0005) [2023-12-28 04:10:01,835][106226] Updated weights for policy 0, policy_version 1239650 (0.0009) [2023-12-28 04:10:01,890][106226] Updated weights for policy 0, policy_version 1239660 (0.0009) [2023-12-28 04:10:01,946][106226] Updated weights for policy 0, policy_version 1239670 (0.0008) [2023-12-28 04:10:02,210][106225] Updated weights for policy 1, policy_version 1242633 (0.0006) [2023-12-28 04:10:02,274][106225] Updated weights for policy 1, policy_version 1242643 (0.0007) [2023-12-28 04:10:02,337][106225] Updated weights for policy 1, policy_version 1242653 (0.0008) [2023-12-28 04:10:02,401][106225] Updated weights for policy 1, policy_version 1242663 (0.0006) [2023-12-28 04:10:02,716][106226] Updated weights for policy 0, policy_version 1239680 (0.0009) [2023-12-28 04:10:02,772][106226] Updated weights for policy 0, policy_version 1239690 (0.0008) [2023-12-28 04:10:02,829][106226] Updated weights for policy 0, policy_version 1239700 (0.0009) [2023-12-28 04:10:03,033][106225] Updated weights for policy 1, policy_version 1242673 (0.0007) [2023-12-28 04:10:03,090][106225] Updated weights for policy 1, policy_version 1242683 (0.0008) [2023-12-28 04:10:03,137][106225] Updated weights for policy 1, policy_version 1242693 (0.0007) [2023-12-28 04:10:03,480][106226] Updated weights for policy 0, policy_version 1239710 (0.0007) [2023-12-28 04:10:03,531][106226] Updated weights for policy 0, policy_version 1239720 (0.0005) [2023-12-28 04:10:03,581][106226] Updated weights for policy 0, policy_version 1239730 (0.0007) [2023-12-28 04:10:03,894][106225] Updated weights for policy 1, policy_version 1242703 (0.0007) [2023-12-28 04:10:03,958][106225] Updated weights for policy 1, policy_version 1242713 (0.0009) [2023-12-28 04:10:04,017][106225] Updated weights for policy 1, policy_version 1242723 (0.0009) [2023-12-28 04:10:04,279][106226] Updated weights for policy 0, policy_version 1239740 (0.0009) [2023-12-28 04:10:04,340][106226] Updated weights for policy 0, policy_version 1239750 (0.0009) [2023-12-28 04:10:04,397][106226] Updated weights for policy 0, policy_version 1239760 (0.0009) [2023-12-28 04:10:04,734][106225] Updated weights for policy 1, policy_version 1242733 (0.0009) [2023-12-28 04:10:04,796][106225] Updated weights for policy 1, policy_version 1242743 (0.0009) [2023-12-28 04:10:04,859][106225] Updated weights for policy 1, policy_version 1242753 (0.0008) [2023-12-28 04:10:05,132][106226] Updated weights for policy 0, policy_version 1239770 (0.0009) [2023-12-28 04:10:05,180][106226] Updated weights for policy 0, policy_version 1239780 (0.0008) [2023-12-28 04:10:05,231][106226] Updated weights for policy 0, policy_version 1239790 (0.0008) [2023-12-28 04:10:05,293][106226] Updated weights for policy 0, policy_version 1239800 (0.0009) [2023-12-28 04:10:05,549][106225] Updated weights for policy 1, policy_version 1242763 (0.0008) [2023-12-28 04:10:05,606][106225] Updated weights for policy 1, policy_version 1242773 (0.0009) [2023-12-28 04:10:05,662][106225] Updated weights for policy 1, policy_version 1242783 (0.0008) [2023-12-28 04:10:06,048][106226] Updated weights for policy 0, policy_version 1239810 (0.0008) [2023-12-28 04:10:06,118][106226] Updated weights for policy 0, policy_version 1239820 (0.0007) [2023-12-28 04:10:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19883.0). Total num frames: 635650048. Throughput: 0: 9874.1, 1: 9984.9. Samples: 635664064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:06,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-5.150')] [2023-12-28 04:10:06,195][106226] Updated weights for policy 0, policy_version 1239830 (0.0008) [2023-12-28 04:10:06,423][106225] Updated weights for policy 1, policy_version 1242793 (0.0008) [2023-12-28 04:10:06,488][106225] Updated weights for policy 1, policy_version 1242803 (0.0008) [2023-12-28 04:10:06,559][106225] Updated weights for policy 1, policy_version 1242813 (0.0008) [2023-12-28 04:10:06,623][106225] Updated weights for policy 1, policy_version 1242823 (0.0008) [2023-12-28 04:10:06,946][106226] Updated weights for policy 0, policy_version 1239840 (0.0007) [2023-12-28 04:10:07,013][106226] Updated weights for policy 0, policy_version 1239850 (0.0006) [2023-12-28 04:10:07,081][106226] Updated weights for policy 0, policy_version 1239860 (0.0006) [2023-12-28 04:10:07,392][106225] Updated weights for policy 1, policy_version 1242833 (0.0009) [2023-12-28 04:10:07,446][106225] Updated weights for policy 1, policy_version 1242843 (0.0008) [2023-12-28 04:10:07,499][106225] Updated weights for policy 1, policy_version 1242853 (0.0009) [2023-12-28 04:10:07,722][106226] Updated weights for policy 0, policy_version 1239870 (0.0009) [2023-12-28 04:10:07,779][106226] Updated weights for policy 0, policy_version 1239880 (0.0010) [2023-12-28 04:10:07,845][106226] Updated weights for policy 0, policy_version 1239890 (0.0009) [2023-12-28 04:10:08,075][106225] Updated weights for policy 1, policy_version 1242863 (0.0010) [2023-12-28 04:10:08,136][106225] Updated weights for policy 1, policy_version 1242873 (0.0010) [2023-12-28 04:10:08,201][106225] Updated weights for policy 1, policy_version 1242883 (0.0011) [2023-12-28 04:10:08,576][106226] Updated weights for policy 0, policy_version 1239900 (0.0008) [2023-12-28 04:10:08,634][106226] Updated weights for policy 0, policy_version 1239910 (0.0008) [2023-12-28 04:10:08,693][106226] Updated weights for policy 0, policy_version 1239920 (0.0008) [2023-12-28 04:10:08,914][106225] Updated weights for policy 1, policy_version 1242893 (0.0008) [2023-12-28 04:10:08,962][106225] Updated weights for policy 1, policy_version 1242903 (0.0008) [2023-12-28 04:10:09,014][106225] Updated weights for policy 1, policy_version 1242913 (0.0011) [2023-12-28 04:10:09,459][106226] Updated weights for policy 0, policy_version 1239930 (0.0007) [2023-12-28 04:10:09,524][106226] Updated weights for policy 0, policy_version 1239940 (0.0008) [2023-12-28 04:10:09,589][106226] Updated weights for policy 0, policy_version 1239950 (0.0008) [2023-12-28 04:10:09,649][106226] Updated weights for policy 0, policy_version 1239960 (0.0008) [2023-12-28 04:10:09,829][106225] Updated weights for policy 1, policy_version 1242923 (0.0009) [2023-12-28 04:10:09,900][106225] Updated weights for policy 1, policy_version 1242933 (0.0008) [2023-12-28 04:10:09,968][106225] Updated weights for policy 1, policy_version 1242943 (0.0008) [2023-12-28 04:10:10,448][106226] Updated weights for policy 0, policy_version 1239970 (0.0008) [2023-12-28 04:10:10,509][106226] Updated weights for policy 0, policy_version 1239980 (0.0009) [2023-12-28 04:10:10,574][106226] Updated weights for policy 0, policy_version 1239990 (0.0009) [2023-12-28 04:10:10,583][106225] Updated weights for policy 1, policy_version 1242953 (0.0006) [2023-12-28 04:10:10,647][106225] Updated weights for policy 1, policy_version 1242963 (0.0008) [2023-12-28 04:10:10,713][106225] Updated weights for policy 1, policy_version 1242973 (0.0008) [2023-12-28 04:10:10,778][106225] Updated weights for policy 1, policy_version 1242983 (0.0008) [2023-12-28 04:10:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 635748352. Throughput: 0: 9849.3, 1: 9993.0. Samples: 635722240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:11,175][105115] Avg episode reward: [(0, '-4.185'), (1, '-5.283')] [2023-12-28 04:10:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001242984_318251008.pth... [2023-12-28 04:10:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001239992_317497344.pth... [2023-12-28 04:10:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001238872_317210624.pth [2023-12-28 04:10:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001241832_317956096.pth [2023-12-28 04:10:11,321][106226] Updated weights for policy 0, policy_version 1240000 (0.0008) [2023-12-28 04:10:11,398][106226] Updated weights for policy 0, policy_version 1240010 (0.0009) [2023-12-28 04:10:11,458][106226] Updated weights for policy 0, policy_version 1240020 (0.0007) [2023-12-28 04:10:11,502][106225] Updated weights for policy 1, policy_version 1242993 (0.0006) [2023-12-28 04:10:11,552][106225] Updated weights for policy 1, policy_version 1243003 (0.0005) [2023-12-28 04:10:11,607][106225] Updated weights for policy 1, policy_version 1243013 (0.0006) [2023-12-28 04:10:12,179][106226] Updated weights for policy 0, policy_version 1240030 (0.0008) [2023-12-28 04:10:12,229][106226] Updated weights for policy 0, policy_version 1240040 (0.0009) [2023-12-28 04:10:12,292][106226] Updated weights for policy 0, policy_version 1240050 (0.0009) [2023-12-28 04:10:12,347][106225] Updated weights for policy 1, policy_version 1243023 (0.0008) [2023-12-28 04:10:12,405][106225] Updated weights for policy 1, policy_version 1243033 (0.0007) [2023-12-28 04:10:12,464][106225] Updated weights for policy 1, policy_version 1243043 (0.0008) [2023-12-28 04:10:13,014][106226] Updated weights for policy 0, policy_version 1240060 (0.0008) [2023-12-28 04:10:13,060][106226] Updated weights for policy 0, policy_version 1240070 (0.0008) [2023-12-28 04:10:13,111][106226] Updated weights for policy 0, policy_version 1240080 (0.0008) [2023-12-28 04:10:13,197][106225] Updated weights for policy 1, policy_version 1243053 (0.0006) [2023-12-28 04:10:13,255][106225] Updated weights for policy 1, policy_version 1243063 (0.0008) [2023-12-28 04:10:13,303][106225] Updated weights for policy 1, policy_version 1243073 (0.0008) [2023-12-28 04:10:13,806][106226] Updated weights for policy 0, policy_version 1240090 (0.0008) [2023-12-28 04:10:13,874][106226] Updated weights for policy 0, policy_version 1240100 (0.0005) [2023-12-28 04:10:13,901][106225] Updated weights for policy 1, policy_version 1243083 (0.0009) [2023-12-28 04:10:13,926][106226] Updated weights for policy 0, policy_version 1240110 (0.0005) [2023-12-28 04:10:13,961][106225] Updated weights for policy 1, policy_version 1243093 (0.0010) [2023-12-28 04:10:13,983][106226] Updated weights for policy 0, policy_version 1240120 (0.0005) [2023-12-28 04:10:14,014][106225] Updated weights for policy 1, policy_version 1243103 (0.0010) [2023-12-28 04:10:14,522][106226] Updated weights for policy 0, policy_version 1240130 (0.0008) [2023-12-28 04:10:14,574][106226] Updated weights for policy 0, policy_version 1240140 (0.0007) [2023-12-28 04:10:14,624][106226] Updated weights for policy 0, policy_version 1240150 (0.0005) [2023-12-28 04:10:14,711][106225] Updated weights for policy 1, policy_version 1243113 (0.0010) [2023-12-28 04:10:14,771][106225] Updated weights for policy 1, policy_version 1243123 (0.0010) [2023-12-28 04:10:14,834][106225] Updated weights for policy 1, policy_version 1243133 (0.0010) [2023-12-28 04:10:14,894][106225] Updated weights for policy 1, policy_version 1243143 (0.0009) [2023-12-28 04:10:15,288][106226] Updated weights for policy 0, policy_version 1240160 (0.0008) [2023-12-28 04:10:15,345][106226] Updated weights for policy 0, policy_version 1240170 (0.0009) [2023-12-28 04:10:15,397][106226] Updated weights for policy 0, policy_version 1240180 (0.0008) [2023-12-28 04:10:15,654][106225] Updated weights for policy 1, policy_version 1243153 (0.0008) [2023-12-28 04:10:15,718][106225] Updated weights for policy 1, policy_version 1243163 (0.0008) [2023-12-28 04:10:15,779][106225] Updated weights for policy 1, policy_version 1243173 (0.0008) [2023-12-28 04:10:16,148][106226] Updated weights for policy 0, policy_version 1240190 (0.0008) [2023-12-28 04:10:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 635846656. Throughput: 0: 9883.5, 1: 9881.0. Samples: 635839704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:16,176][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.753')] [2023-12-28 04:10:16,199][106226] Updated weights for policy 0, policy_version 1240200 (0.0008) [2023-12-28 04:10:16,266][106226] Updated weights for policy 0, policy_version 1240210 (0.0011) [2023-12-28 04:10:16,431][106225] Updated weights for policy 1, policy_version 1243183 (0.0006) [2023-12-28 04:10:16,481][106225] Updated weights for policy 1, policy_version 1243193 (0.0007) [2023-12-28 04:10:16,535][106225] Updated weights for policy 1, policy_version 1243203 (0.0006) [2023-12-28 04:10:17,044][106226] Updated weights for policy 0, policy_version 1240220 (0.0008) [2023-12-28 04:10:17,092][106226] Updated weights for policy 0, policy_version 1240230 (0.0007) [2023-12-28 04:10:17,143][106226] Updated weights for policy 0, policy_version 1240240 (0.0009) [2023-12-28 04:10:17,242][106225] Updated weights for policy 1, policy_version 1243213 (0.0007) [2023-12-28 04:10:17,294][106225] Updated weights for policy 1, policy_version 1243223 (0.0005) [2023-12-28 04:10:17,352][106225] Updated weights for policy 1, policy_version 1243233 (0.0005) [2023-12-28 04:10:17,938][106226] Updated weights for policy 0, policy_version 1240250 (0.0009) [2023-12-28 04:10:17,968][106225] Updated weights for policy 1, policy_version 1243243 (0.0007) [2023-12-28 04:10:18,000][106226] Updated weights for policy 0, policy_version 1240260 (0.0008) [2023-12-28 04:10:18,032][106225] Updated weights for policy 1, policy_version 1243253 (0.0006) [2023-12-28 04:10:18,056][106226] Updated weights for policy 0, policy_version 1240270 (0.0009) [2023-12-28 04:10:18,080][106225] Updated weights for policy 1, policy_version 1243263 (0.0005) [2023-12-28 04:10:18,107][106226] Updated weights for policy 0, policy_version 1240280 (0.0007) [2023-12-28 04:10:18,769][106225] Updated weights for policy 1, policy_version 1243273 (0.0007) [2023-12-28 04:10:18,788][106226] Updated weights for policy 0, policy_version 1240290 (0.0009) [2023-12-28 04:10:18,826][106225] Updated weights for policy 1, policy_version 1243283 (0.0010) [2023-12-28 04:10:18,852][106226] Updated weights for policy 0, policy_version 1240300 (0.0009) [2023-12-28 04:10:18,884][106225] Updated weights for policy 1, policy_version 1243293 (0.0010) [2023-12-28 04:10:18,913][106226] Updated weights for policy 0, policy_version 1240310 (0.0006) [2023-12-28 04:10:18,941][106225] Updated weights for policy 1, policy_version 1243303 (0.0009) [2023-12-28 04:10:19,674][106225] Updated weights for policy 1, policy_version 1243313 (0.0010) [2023-12-28 04:10:19,710][106226] Updated weights for policy 0, policy_version 1240320 (0.0008) [2023-12-28 04:10:19,722][106225] Updated weights for policy 1, policy_version 1243323 (0.0010) [2023-12-28 04:10:19,764][106226] Updated weights for policy 0, policy_version 1240330 (0.0007) [2023-12-28 04:10:19,770][106225] Updated weights for policy 1, policy_version 1243333 (0.0010) [2023-12-28 04:10:19,824][106226] Updated weights for policy 0, policy_version 1240340 (0.0007) [2023-12-28 04:10:20,533][106225] Updated weights for policy 1, policy_version 1243343 (0.0010) [2023-12-28 04:10:20,593][106226] Updated weights for policy 0, policy_version 1240350 (0.0009) [2023-12-28 04:10:20,620][106225] Updated weights for policy 1, policy_version 1243353 (0.0011) [2023-12-28 04:10:20,657][106226] Updated weights for policy 0, policy_version 1240360 (0.0006) [2023-12-28 04:10:20,686][106225] Updated weights for policy 1, policy_version 1243363 (0.0010) [2023-12-28 04:10:20,716][106226] Updated weights for policy 0, policy_version 1240370 (0.0006) [2023-12-28 04:10:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 635944960. Throughput: 0: 9784.5, 1: 9855.3. Samples: 635954984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:21,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.940')] [2023-12-28 04:10:21,430][106225] Updated weights for policy 1, policy_version 1243373 (0.0008) [2023-12-28 04:10:21,481][106226] Updated weights for policy 0, policy_version 1240380 (0.0009) [2023-12-28 04:10:21,497][106225] Updated weights for policy 1, policy_version 1243383 (0.0006) [2023-12-28 04:10:21,544][106226] Updated weights for policy 0, policy_version 1240390 (0.0006) [2023-12-28 04:10:21,565][106225] Updated weights for policy 1, policy_version 1243393 (0.0008) [2023-12-28 04:10:21,617][106226] Updated weights for policy 0, policy_version 1240400 (0.0006) [2023-12-28 04:10:22,210][106225] Updated weights for policy 1, policy_version 1243403 (0.0007) [2023-12-28 04:10:22,275][106225] Updated weights for policy 1, policy_version 1243413 (0.0007) [2023-12-28 04:10:22,344][106225] Updated weights for policy 1, policy_version 1243423 (0.0008) [2023-12-28 04:10:22,419][106226] Updated weights for policy 0, policy_version 1240410 (0.0007) [2023-12-28 04:10:22,472][106226] Updated weights for policy 0, policy_version 1240420 (0.0008) [2023-12-28 04:10:22,533][106226] Updated weights for policy 0, policy_version 1240430 (0.0008) [2023-12-28 04:10:22,586][106226] Updated weights for policy 0, policy_version 1240440 (0.0009) [2023-12-28 04:10:23,061][106225] Updated weights for policy 1, policy_version 1243433 (0.0008) [2023-12-28 04:10:23,118][106225] Updated weights for policy 1, policy_version 1243443 (0.0007) [2023-12-28 04:10:23,169][106225] Updated weights for policy 1, policy_version 1243453 (0.0010) [2023-12-28 04:10:23,219][106225] Updated weights for policy 1, policy_version 1243463 (0.0009) [2023-12-28 04:10:23,328][106226] Updated weights for policy 0, policy_version 1240450 (0.0005) [2023-12-28 04:10:23,383][106226] Updated weights for policy 0, policy_version 1240460 (0.0006) [2023-12-28 04:10:23,436][106226] Updated weights for policy 0, policy_version 1240470 (0.0005) [2023-12-28 04:10:23,943][106225] Updated weights for policy 1, policy_version 1243473 (0.0010) [2023-12-28 04:10:24,001][106225] Updated weights for policy 1, policy_version 1243483 (0.0010) [2023-12-28 04:10:24,014][106226] Updated weights for policy 0, policy_version 1240480 (0.0006) [2023-12-28 04:10:24,060][106225] Updated weights for policy 1, policy_version 1243493 (0.0010) [2023-12-28 04:10:24,071][106226] Updated weights for policy 0, policy_version 1240490 (0.0007) [2023-12-28 04:10:24,131][106226] Updated weights for policy 0, policy_version 1240500 (0.0008) [2023-12-28 04:10:24,773][106225] Updated weights for policy 1, policy_version 1243503 (0.0010) [2023-12-28 04:10:24,833][106225] Updated weights for policy 1, policy_version 1243513 (0.0010) [2023-12-28 04:10:24,876][106226] Updated weights for policy 0, policy_version 1240510 (0.0007) [2023-12-28 04:10:24,890][106225] Updated weights for policy 1, policy_version 1243523 (0.0010) [2023-12-28 04:10:24,923][106226] Updated weights for policy 0, policy_version 1240520 (0.0006) [2023-12-28 04:10:24,975][106226] Updated weights for policy 0, policy_version 1240530 (0.0007) [2023-12-28 04:10:25,487][106225] Updated weights for policy 1, policy_version 1243533 (0.0008) [2023-12-28 04:10:25,515][106226] Updated weights for policy 0, policy_version 1240540 (0.0007) [2023-12-28 04:10:25,534][106225] Updated weights for policy 1, policy_version 1243543 (0.0006) [2023-12-28 04:10:25,580][106226] Updated weights for policy 0, policy_version 1240550 (0.0008) [2023-12-28 04:10:25,583][106225] Updated weights for policy 1, policy_version 1243553 (0.0006) [2023-12-28 04:10:25,639][106226] Updated weights for policy 0, policy_version 1240560 (0.0006) [2023-12-28 04:10:26,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 636043264. Throughput: 0: 9753.7, 1: 9859.6. Samples: 636012892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:26,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-4.862')] [2023-12-28 04:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001240568_317644800.pth... [2023-12-28 04:10:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001239448_317358080.pth [2023-12-28 04:10:26,206][106225] Updated weights for policy 1, policy_version 1243563 (0.0007) [2023-12-28 04:10:26,216][106226] Updated weights for policy 0, policy_version 1240570 (0.0006) [2023-12-28 04:10:26,256][106225] Updated weights for policy 1, policy_version 1243573 (0.0005) [2023-12-28 04:10:26,269][106226] Updated weights for policy 0, policy_version 1240580 (0.0008) [2023-12-28 04:10:26,307][106225] Updated weights for policy 1, policy_version 1243583 (0.0005) [2023-12-28 04:10:26,322][106226] Updated weights for policy 0, policy_version 1240590 (0.0008) [2023-12-28 04:10:26,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001243592_318406656.pth... [2023-12-28 04:10:26,365][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001242408_318103552.pth [2023-12-28 04:10:26,369][106226] Updated weights for policy 0, policy_version 1240600 (0.0008) [2023-12-28 04:10:26,835][106225] Updated weights for policy 1, policy_version 1243593 (0.0005) [2023-12-28 04:10:26,883][106225] Updated weights for policy 1, policy_version 1243603 (0.0006) [2023-12-28 04:10:26,933][106225] Updated weights for policy 1, policy_version 1243613 (0.0007) [2023-12-28 04:10:26,983][106225] Updated weights for policy 1, policy_version 1243623 (0.0008) [2023-12-28 04:10:27,148][106226] Updated weights for policy 0, policy_version 1240610 (0.0011) [2023-12-28 04:10:27,211][106226] Updated weights for policy 0, policy_version 1240620 (0.0009) [2023-12-28 04:10:27,278][106226] Updated weights for policy 0, policy_version 1240630 (0.0008) [2023-12-28 04:10:27,589][106225] Updated weights for policy 1, policy_version 1243633 (0.0008) [2023-12-28 04:10:27,637][106225] Updated weights for policy 1, policy_version 1243643 (0.0008) [2023-12-28 04:10:27,689][106225] Updated weights for policy 1, policy_version 1243653 (0.0008) [2023-12-28 04:10:27,882][106226] Updated weights for policy 0, policy_version 1240640 (0.0006) [2023-12-28 04:10:27,954][106226] Updated weights for policy 0, policy_version 1240650 (0.0005) [2023-12-28 04:10:28,013][106226] Updated weights for policy 0, policy_version 1240660 (0.0005) [2023-12-28 04:10:28,447][106225] Updated weights for policy 1, policy_version 1243663 (0.0008) [2023-12-28 04:10:28,507][106225] Updated weights for policy 1, policy_version 1243673 (0.0009) [2023-12-28 04:10:28,562][106225] Updated weights for policy 1, policy_version 1243683 (0.0005) [2023-12-28 04:10:28,563][106226] Updated weights for policy 0, policy_version 1240670 (0.0005) [2023-12-28 04:10:28,630][106226] Updated weights for policy 0, policy_version 1240680 (0.0006) [2023-12-28 04:10:28,693][106226] Updated weights for policy 0, policy_version 1240690 (0.0008) [2023-12-28 04:10:29,198][106225] Updated weights for policy 1, policy_version 1243693 (0.0008) [2023-12-28 04:10:29,267][106225] Updated weights for policy 1, policy_version 1243703 (0.0009) [2023-12-28 04:10:29,326][106225] Updated weights for policy 1, policy_version 1243713 (0.0009) [2023-12-28 04:10:29,403][106226] Updated weights for policy 0, policy_version 1240700 (0.0010) [2023-12-28 04:10:29,459][106226] Updated weights for policy 0, policy_version 1240710 (0.0008) [2023-12-28 04:10:29,515][106226] Updated weights for policy 0, policy_version 1240720 (0.0007) [2023-12-28 04:10:30,071][106225] Updated weights for policy 1, policy_version 1243723 (0.0007) [2023-12-28 04:10:30,126][106225] Updated weights for policy 1, policy_version 1243733 (0.0008) [2023-12-28 04:10:30,180][106225] Updated weights for policy 1, policy_version 1243743 (0.0008) [2023-12-28 04:10:30,242][106226] Updated weights for policy 0, policy_version 1240730 (0.0008) [2023-12-28 04:10:30,301][106226] Updated weights for policy 0, policy_version 1240740 (0.0009) [2023-12-28 04:10:30,358][106226] Updated weights for policy 0, policy_version 1240750 (0.0009) [2023-12-28 04:10:30,422][106226] Updated weights for policy 0, policy_version 1240760 (0.0009) [2023-12-28 04:10:30,851][106225] Updated weights for policy 1, policy_version 1243753 (0.0006) [2023-12-28 04:10:30,897][106225] Updated weights for policy 1, policy_version 1243763 (0.0006) [2023-12-28 04:10:30,944][106225] Updated weights for policy 1, policy_version 1243773 (0.0009) [2023-12-28 04:10:30,989][106225] Updated weights for policy 1, policy_version 1243783 (0.0008) [2023-12-28 04:10:31,171][106226] Updated weights for policy 0, policy_version 1240770 (0.0009) [2023-12-28 04:10:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 636149760. Throughput: 0: 9835.2, 1: 9952.4. Samples: 636139828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:31,175][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.981')] [2023-12-28 04:10:31,225][106226] Updated weights for policy 0, policy_version 1240780 (0.0008) [2023-12-28 04:10:31,279][106226] Updated weights for policy 0, policy_version 1240790 (0.0009) [2023-12-28 04:10:31,693][106225] Updated weights for policy 1, policy_version 1243793 (0.0006) [2023-12-28 04:10:31,763][106225] Updated weights for policy 1, policy_version 1243803 (0.0007) [2023-12-28 04:10:31,828][106225] Updated weights for policy 1, policy_version 1243813 (0.0007) [2023-12-28 04:10:32,068][106226] Updated weights for policy 0, policy_version 1240800 (0.0009) [2023-12-28 04:10:32,140][106226] Updated weights for policy 0, policy_version 1240810 (0.0009) [2023-12-28 04:10:32,204][106226] Updated weights for policy 0, policy_version 1240820 (0.0008) [2023-12-28 04:10:32,475][106225] Updated weights for policy 1, policy_version 1243823 (0.0008) [2023-12-28 04:10:32,525][106225] Updated weights for policy 1, policy_version 1243833 (0.0008) [2023-12-28 04:10:32,577][106225] Updated weights for policy 1, policy_version 1243843 (0.0008) [2023-12-28 04:10:32,952][106226] Updated weights for policy 0, policy_version 1240830 (0.0007) [2023-12-28 04:10:33,010][106226] Updated weights for policy 0, policy_version 1240840 (0.0005) [2023-12-28 04:10:33,062][106226] Updated weights for policy 0, policy_version 1240850 (0.0006) [2023-12-28 04:10:33,327][106225] Updated weights for policy 1, policy_version 1243853 (0.0009) [2023-12-28 04:10:33,374][106225] Updated weights for policy 1, policy_version 1243863 (0.0008) [2023-12-28 04:10:33,421][106225] Updated weights for policy 1, policy_version 1243873 (0.0008) [2023-12-28 04:10:33,753][106226] Updated weights for policy 0, policy_version 1240860 (0.0009) [2023-12-28 04:10:33,814][106226] Updated weights for policy 0, policy_version 1240870 (0.0007) [2023-12-28 04:10:33,872][106226] Updated weights for policy 0, policy_version 1240880 (0.0008) [2023-12-28 04:10:34,120][106225] Updated weights for policy 1, policy_version 1243883 (0.0007) [2023-12-28 04:10:34,193][106225] Updated weights for policy 1, policy_version 1243893 (0.0008) [2023-12-28 04:10:34,259][106225] Updated weights for policy 1, policy_version 1243903 (0.0008) [2023-12-28 04:10:34,551][106226] Updated weights for policy 0, policy_version 1240890 (0.0008) [2023-12-28 04:10:34,605][106226] Updated weights for policy 0, policy_version 1240900 (0.0008) [2023-12-28 04:10:34,666][106226] Updated weights for policy 0, policy_version 1240910 (0.0007) [2023-12-28 04:10:34,710][106226] Updated weights for policy 0, policy_version 1240920 (0.0008) [2023-12-28 04:10:34,924][106225] Updated weights for policy 1, policy_version 1243913 (0.0009) [2023-12-28 04:10:34,978][106225] Updated weights for policy 1, policy_version 1243923 (0.0010) [2023-12-28 04:10:35,035][106225] Updated weights for policy 1, policy_version 1243933 (0.0010) [2023-12-28 04:10:35,098][106225] Updated weights for policy 1, policy_version 1243943 (0.0010) [2023-12-28 04:10:35,448][106226] Updated weights for policy 0, policy_version 1240930 (0.0007) [2023-12-28 04:10:35,494][106226] Updated weights for policy 0, policy_version 1240940 (0.0008) [2023-12-28 04:10:35,541][106226] Updated weights for policy 0, policy_version 1240950 (0.0008) [2023-12-28 04:10:35,807][106225] Updated weights for policy 1, policy_version 1243953 (0.0010) [2023-12-28 04:10:35,869][106225] Updated weights for policy 1, policy_version 1243963 (0.0010) [2023-12-28 04:10:35,925][106225] Updated weights for policy 1, policy_version 1243973 (0.0010) [2023-12-28 04:10:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 636248064. Throughput: 0: 9760.8, 1: 10020.7. Samples: 636257944. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:36,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.780')] [2023-12-28 04:10:36,223][106226] Updated weights for policy 0, policy_version 1240960 (0.0008) [2023-12-28 04:10:36,297][106226] Updated weights for policy 0, policy_version 1240970 (0.0009) [2023-12-28 04:10:36,351][106226] Updated weights for policy 0, policy_version 1240980 (0.0007) [2023-12-28 04:10:36,662][106225] Updated weights for policy 1, policy_version 1243983 (0.0011) [2023-12-28 04:10:36,729][106225] Updated weights for policy 1, policy_version 1243993 (0.0011) [2023-12-28 04:10:36,789][106225] Updated weights for policy 1, policy_version 1244003 (0.0010) [2023-12-28 04:10:37,051][106226] Updated weights for policy 0, policy_version 1240990 (0.0007) [2023-12-28 04:10:37,117][106226] Updated weights for policy 0, policy_version 1241000 (0.0006) [2023-12-28 04:10:37,179][106226] Updated weights for policy 0, policy_version 1241010 (0.0008) [2023-12-28 04:10:37,507][106225] Updated weights for policy 1, policy_version 1244013 (0.0010) [2023-12-28 04:10:37,561][106225] Updated weights for policy 1, policy_version 1244023 (0.0010) [2023-12-28 04:10:37,613][106225] Updated weights for policy 1, policy_version 1244033 (0.0010) [2023-12-28 04:10:37,913][106226] Updated weights for policy 0, policy_version 1241020 (0.0007) [2023-12-28 04:10:37,962][106226] Updated weights for policy 0, policy_version 1241030 (0.0008) [2023-12-28 04:10:38,011][106226] Updated weights for policy 0, policy_version 1241040 (0.0005) [2023-12-28 04:10:38,359][106225] Updated weights for policy 1, policy_version 1244043 (0.0010) [2023-12-28 04:10:38,423][106225] Updated weights for policy 1, policy_version 1244053 (0.0009) [2023-12-28 04:10:38,489][106225] Updated weights for policy 1, policy_version 1244063 (0.0008) [2023-12-28 04:10:38,761][106226] Updated weights for policy 0, policy_version 1241050 (0.0007) [2023-12-28 04:10:38,812][106226] Updated weights for policy 0, policy_version 1241060 (0.0005) [2023-12-28 04:10:38,869][106226] Updated weights for policy 0, policy_version 1241070 (0.0006) [2023-12-28 04:10:38,926][106226] Updated weights for policy 0, policy_version 1241080 (0.0008) [2023-12-28 04:10:39,247][106225] Updated weights for policy 1, policy_version 1244073 (0.0008) [2023-12-28 04:10:39,312][106225] Updated weights for policy 1, policy_version 1244083 (0.0008) [2023-12-28 04:10:39,380][106225] Updated weights for policy 1, policy_version 1244093 (0.0009) [2023-12-28 04:10:39,458][106225] Updated weights for policy 1, policy_version 1244103 (0.0009) [2023-12-28 04:10:39,652][106226] Updated weights for policy 0, policy_version 1241090 (0.0008) [2023-12-28 04:10:39,723][106226] Updated weights for policy 0, policy_version 1241100 (0.0007) [2023-12-28 04:10:39,793][106226] Updated weights for policy 0, policy_version 1241110 (0.0008) [2023-12-28 04:10:40,284][106225] Updated weights for policy 1, policy_version 1244113 (0.0009) [2023-12-28 04:10:40,349][106225] Updated weights for policy 1, policy_version 1244123 (0.0008) [2023-12-28 04:10:40,404][106225] Updated weights for policy 1, policy_version 1244133 (0.0008) [2023-12-28 04:10:40,504][106226] Updated weights for policy 0, policy_version 1241120 (0.0008) [2023-12-28 04:10:40,567][106226] Updated weights for policy 0, policy_version 1241130 (0.0009) [2023-12-28 04:10:40,622][106226] Updated weights for policy 0, policy_version 1241140 (0.0008) [2023-12-28 04:10:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 636338176. Throughput: 0: 9782.9, 1: 9981.9. Samples: 636315016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:41,175][106225] Updated weights for policy 1, policy_version 1244143 (0.0010) [2023-12-28 04:10:41,176][105115] Avg episode reward: [(0, '-4.280'), (1, '-4.877')] [2023-12-28 04:10:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001241144_317792256.pth... [2023-12-28 04:10:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001239992_317497344.pth [2023-12-28 04:10:41,245][106225] Updated weights for policy 1, policy_version 1244153 (0.0010) [2023-12-28 04:10:41,261][106226] Updated weights for policy 0, policy_version 1241150 (0.0008) [2023-12-28 04:10:41,309][106225] Updated weights for policy 1, policy_version 1244163 (0.0007) [2023-12-28 04:10:41,320][106226] Updated weights for policy 0, policy_version 1241160 (0.0008) [2023-12-28 04:10:41,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001244168_318554112.pth... [2023-12-28 04:10:41,354][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001242984_318251008.pth [2023-12-28 04:10:41,401][106226] Updated weights for policy 0, policy_version 1241170 (0.0009) [2023-12-28 04:10:42,027][106225] Updated weights for policy 1, policy_version 1244173 (0.0009) [2023-12-28 04:10:42,076][106225] Updated weights for policy 1, policy_version 1244183 (0.0009) [2023-12-28 04:10:42,087][106226] Updated weights for policy 0, policy_version 1241180 (0.0007) [2023-12-28 04:10:42,128][106225] Updated weights for policy 1, policy_version 1244193 (0.0008) [2023-12-28 04:10:42,148][106226] Updated weights for policy 0, policy_version 1241190 (0.0007) [2023-12-28 04:10:42,213][106226] Updated weights for policy 0, policy_version 1241200 (0.0008) [2023-12-28 04:10:42,836][106225] Updated weights for policy 1, policy_version 1244203 (0.0008) [2023-12-28 04:10:42,895][106225] Updated weights for policy 1, policy_version 1244213 (0.0006) [2023-12-28 04:10:42,902][106226] Updated weights for policy 0, policy_version 1241210 (0.0008) [2023-12-28 04:10:42,956][106225] Updated weights for policy 1, policy_version 1244223 (0.0007) [2023-12-28 04:10:42,968][106226] Updated weights for policy 0, policy_version 1241220 (0.0006) [2023-12-28 04:10:43,037][106226] Updated weights for policy 0, policy_version 1241230 (0.0006) [2023-12-28 04:10:43,104][106226] Updated weights for policy 0, policy_version 1241240 (0.0005) [2023-12-28 04:10:43,574][106225] Updated weights for policy 1, policy_version 1244233 (0.0007) [2023-12-28 04:10:43,644][106225] Updated weights for policy 1, policy_version 1244243 (0.0011) [2023-12-28 04:10:43,697][106225] Updated weights for policy 1, policy_version 1244253 (0.0010) [2023-12-28 04:10:43,750][106225] Updated weights for policy 1, policy_version 1244263 (0.0010) [2023-12-28 04:10:43,779][106226] Updated weights for policy 0, policy_version 1241250 (0.0006) [2023-12-28 04:10:43,833][106226] Updated weights for policy 0, policy_version 1241260 (0.0008) [2023-12-28 04:10:43,898][106226] Updated weights for policy 0, policy_version 1241270 (0.0007) [2023-12-28 04:10:44,417][106225] Updated weights for policy 1, policy_version 1244273 (0.0007) [2023-12-28 04:10:44,472][106225] Updated weights for policy 1, policy_version 1244283 (0.0005) [2023-12-28 04:10:44,523][106225] Updated weights for policy 1, policy_version 1244293 (0.0005) [2023-12-28 04:10:44,681][106226] Updated weights for policy 0, policy_version 1241280 (0.0007) [2023-12-28 04:10:44,748][106226] Updated weights for policy 0, policy_version 1241290 (0.0007) [2023-12-28 04:10:44,821][106226] Updated weights for policy 0, policy_version 1241302 (0.0009) [2023-12-28 04:10:45,133][106225] Updated weights for policy 1, policy_version 1244303 (0.0008) [2023-12-28 04:10:45,190][106225] Updated weights for policy 1, policy_version 1244313 (0.0010) [2023-12-28 04:10:45,254][106225] Updated weights for policy 1, policy_version 1244323 (0.0007) [2023-12-28 04:10:45,638][106226] Updated weights for policy 0, policy_version 1241312 (0.0009) [2023-12-28 04:10:45,695][106226] Updated weights for policy 0, policy_version 1241322 (0.0009) [2023-12-28 04:10:45,765][106226] Updated weights for policy 0, policy_version 1241332 (0.0010) [2023-12-28 04:10:45,831][106225] Updated weights for policy 1, policy_version 1244333 (0.0008) [2023-12-28 04:10:45,899][106225] Updated weights for policy 1, policy_version 1244343 (0.0006) [2023-12-28 04:10:45,953][106225] Updated weights for policy 1, policy_version 1244353 (0.0008) [2023-12-28 04:10:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 636444672. Throughput: 0: 9727.4, 1: 9925.9. Samples: 636431316. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:46,175][105115] Avg episode reward: [(0, '-4.200'), (1, '-5.045')] [2023-12-28 04:10:46,479][106226] Updated weights for policy 0, policy_version 1241342 (0.0008) [2023-12-28 04:10:46,517][106225] Updated weights for policy 1, policy_version 1244363 (0.0006) [2023-12-28 04:10:46,537][106226] Updated weights for policy 0, policy_version 1241352 (0.0006) [2023-12-28 04:10:46,576][106225] Updated weights for policy 1, policy_version 1244373 (0.0008) [2023-12-28 04:10:46,590][106226] Updated weights for policy 0, policy_version 1241362 (0.0010) [2023-12-28 04:10:46,630][106225] Updated weights for policy 1, policy_version 1244383 (0.0006) [2023-12-28 04:10:47,284][106226] Updated weights for policy 0, policy_version 1241372 (0.0009) [2023-12-28 04:10:47,329][106225] Updated weights for policy 1, policy_version 1244393 (0.0008) [2023-12-28 04:10:47,340][106226] Updated weights for policy 0, policy_version 1241382 (0.0010) [2023-12-28 04:10:47,388][106225] Updated weights for policy 1, policy_version 1244403 (0.0006) [2023-12-28 04:10:47,411][106226] Updated weights for policy 0, policy_version 1241392 (0.0011) [2023-12-28 04:10:47,444][106225] Updated weights for policy 1, policy_version 1244413 (0.0007) [2023-12-28 04:10:47,505][106225] Updated weights for policy 1, policy_version 1244423 (0.0007) [2023-12-28 04:10:48,061][106226] Updated weights for policy 0, policy_version 1241402 (0.0010) [2023-12-28 04:10:48,117][106226] Updated weights for policy 0, policy_version 1241412 (0.0007) [2023-12-28 04:10:48,157][106225] Updated weights for policy 1, policy_version 1244433 (0.0010) [2023-12-28 04:10:48,167][106226] Updated weights for policy 0, policy_version 1241422 (0.0006) [2023-12-28 04:10:48,214][106225] Updated weights for policy 1, policy_version 1244443 (0.0010) [2023-12-28 04:10:48,224][106226] Updated weights for policy 0, policy_version 1241432 (0.0005) [2023-12-28 04:10:48,267][106225] Updated weights for policy 1, policy_version 1244453 (0.0010) [2023-12-28 04:10:48,925][106225] Updated weights for policy 1, policy_version 1244463 (0.0007) [2023-12-28 04:10:48,956][106226] Updated weights for policy 0, policy_version 1241442 (0.0008) [2023-12-28 04:10:48,983][106225] Updated weights for policy 1, policy_version 1244473 (0.0008) [2023-12-28 04:10:49,007][106226] Updated weights for policy 0, policy_version 1241452 (0.0008) [2023-12-28 04:10:49,040][106225] Updated weights for policy 1, policy_version 1244483 (0.0006) [2023-12-28 04:10:49,066][106226] Updated weights for policy 0, policy_version 1241462 (0.0008) [2023-12-28 04:10:49,771][106225] Updated weights for policy 1, policy_version 1244493 (0.0008) [2023-12-28 04:10:49,818][106226] Updated weights for policy 0, policy_version 1241472 (0.0009) [2023-12-28 04:10:49,832][106225] Updated weights for policy 1, policy_version 1244503 (0.0007) [2023-12-28 04:10:49,882][106226] Updated weights for policy 0, policy_version 1241482 (0.0008) [2023-12-28 04:10:49,896][106225] Updated weights for policy 1, policy_version 1244513 (0.0008) [2023-12-28 04:10:49,949][106226] Updated weights for policy 0, policy_version 1241492 (0.0008) [2023-12-28 04:10:50,624][106226] Updated weights for policy 0, policy_version 1241502 (0.0009) [2023-12-28 04:10:50,677][106226] Updated weights for policy 0, policy_version 1241512 (0.0009) [2023-12-28 04:10:50,683][106225] Updated weights for policy 1, policy_version 1244523 (0.0008) [2023-12-28 04:10:50,727][106226] Updated weights for policy 0, policy_version 1241522 (0.0008) [2023-12-28 04:10:50,752][106225] Updated weights for policy 1, policy_version 1244533 (0.0005) [2023-12-28 04:10:50,813][106225] Updated weights for policy 1, policy_version 1244543 (0.0007) [2023-12-28 04:10:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 636542976. Throughput: 0: 9720.4, 1: 9987.9. Samples: 636550936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:51,175][105115] Avg episode reward: [(0, '-4.164'), (1, '-5.186')] [2023-12-28 04:10:51,482][106225] Updated weights for policy 1, policy_version 1244553 (0.0009) [2023-12-28 04:10:51,541][106225] Updated weights for policy 1, policy_version 1244563 (0.0008) [2023-12-28 04:10:51,560][106226] Updated weights for policy 0, policy_version 1241532 (0.0007) [2023-12-28 04:10:51,600][106225] Updated weights for policy 1, policy_version 1244573 (0.0008) [2023-12-28 04:10:51,611][106226] Updated weights for policy 0, policy_version 1241542 (0.0008) [2023-12-28 04:10:51,667][106225] Updated weights for policy 1, policy_version 1244583 (0.0008) [2023-12-28 04:10:51,686][106226] Updated weights for policy 0, policy_version 1241552 (0.0009) [2023-12-28 04:10:52,354][106225] Updated weights for policy 1, policy_version 1244593 (0.0008) [2023-12-28 04:10:52,423][106225] Updated weights for policy 1, policy_version 1244603 (0.0008) [2023-12-28 04:10:52,453][106226] Updated weights for policy 0, policy_version 1241562 (0.0008) [2023-12-28 04:10:52,477][106225] Updated weights for policy 1, policy_version 1244613 (0.0009) [2023-12-28 04:10:52,511][106226] Updated weights for policy 0, policy_version 1241572 (0.0007) [2023-12-28 04:10:52,569][106226] Updated weights for policy 0, policy_version 1241582 (0.0007) [2023-12-28 04:10:52,625][106226] Updated weights for policy 0, policy_version 1241592 (0.0008) [2023-12-28 04:10:53,261][106225] Updated weights for policy 1, policy_version 1244623 (0.0006) [2023-12-28 04:10:53,329][106225] Updated weights for policy 1, policy_version 1244633 (0.0006) [2023-12-28 04:10:53,335][106226] Updated weights for policy 0, policy_version 1241602 (0.0007) [2023-12-28 04:10:53,385][106226] Updated weights for policy 0, policy_version 1241612 (0.0006) [2023-12-28 04:10:53,392][106225] Updated weights for policy 1, policy_version 1244643 (0.0005) [2023-12-28 04:10:53,441][106226] Updated weights for policy 0, policy_version 1241622 (0.0007) [2023-12-28 04:10:53,911][106225] Updated weights for policy 1, policy_version 1244653 (0.0005) [2023-12-28 04:10:53,963][106225] Updated weights for policy 1, policy_version 1244663 (0.0006) [2023-12-28 04:10:54,025][106225] Updated weights for policy 1, policy_version 1244673 (0.0009) [2023-12-28 04:10:54,199][106226] Updated weights for policy 0, policy_version 1241632 (0.0008) [2023-12-28 04:10:54,258][106226] Updated weights for policy 0, policy_version 1241642 (0.0007) [2023-12-28 04:10:54,318][106226] Updated weights for policy 0, policy_version 1241652 (0.0008) [2023-12-28 04:10:54,626][106225] Updated weights for policy 1, policy_version 1244683 (0.0010) [2023-12-28 04:10:54,673][106225] Updated weights for policy 1, policy_version 1244693 (0.0006) [2023-12-28 04:10:54,723][106225] Updated weights for policy 1, policy_version 1244703 (0.0010) [2023-12-28 04:10:55,065][106226] Updated weights for policy 0, policy_version 1241662 (0.0008) [2023-12-28 04:10:55,127][106226] Updated weights for policy 0, policy_version 1241672 (0.0008) [2023-12-28 04:10:55,190][106226] Updated weights for policy 0, policy_version 1241682 (0.0008) [2023-12-28 04:10:55,427][106225] Updated weights for policy 1, policy_version 1244713 (0.0010) [2023-12-28 04:10:55,484][106225] Updated weights for policy 1, policy_version 1244723 (0.0005) [2023-12-28 04:10:55,545][106225] Updated weights for policy 1, policy_version 1244733 (0.0005) [2023-12-28 04:10:55,607][106225] Updated weights for policy 1, policy_version 1244743 (0.0005) [2023-12-28 04:10:55,963][106226] Updated weights for policy 0, policy_version 1241692 (0.0008) [2023-12-28 04:10:56,010][106226] Updated weights for policy 0, policy_version 1241702 (0.0008) [2023-12-28 04:10:56,068][106226] Updated weights for policy 0, policy_version 1241712 (0.0008) [2023-12-28 04:10:56,142][106225] Updated weights for policy 1, policy_version 1244753 (0.0006) [2023-12-28 04:10:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 636641280. Throughput: 0: 9705.1, 1: 10004.0. Samples: 636609148. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:10:56,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-5.050')] [2023-12-28 04:10:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001241720_317939712.pth... [2023-12-28 04:10:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001240568_317644800.pth [2023-12-28 04:10:56,194][106225] Updated weights for policy 1, policy_version 1244763 (0.0008) [2023-12-28 04:10:56,253][106225] Updated weights for policy 1, policy_version 1244773 (0.0005) [2023-12-28 04:10:56,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001244776_318709760.pth... [2023-12-28 04:10:56,268][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001243592_318406656.pth [2023-12-28 04:10:56,850][106225] Updated weights for policy 1, policy_version 1244783 (0.0007) [2023-12-28 04:10:56,867][106226] Updated weights for policy 0, policy_version 1241722 (0.0008) [2023-12-28 04:10:56,910][106225] Updated weights for policy 1, policy_version 1244793 (0.0007) [2023-12-28 04:10:56,934][106226] Updated weights for policy 0, policy_version 1241732 (0.0008) [2023-12-28 04:10:56,967][106225] Updated weights for policy 1, policy_version 1244803 (0.0006) [2023-12-28 04:10:56,988][106226] Updated weights for policy 0, policy_version 1241742 (0.0006) [2023-12-28 04:10:57,039][106226] Updated weights for policy 0, policy_version 1241752 (0.0008) [2023-12-28 04:10:57,646][106225] Updated weights for policy 1, policy_version 1244813 (0.0006) [2023-12-28 04:10:57,694][106225] Updated weights for policy 1, policy_version 1244823 (0.0005) [2023-12-28 04:10:57,728][106226] Updated weights for policy 0, policy_version 1241762 (0.0007) [2023-12-28 04:10:57,751][106225] Updated weights for policy 1, policy_version 1244833 (0.0007) [2023-12-28 04:10:57,785][106226] Updated weights for policy 0, policy_version 1241772 (0.0006) [2023-12-28 04:10:57,841][106226] Updated weights for policy 0, policy_version 1241782 (0.0007) [2023-12-28 04:10:58,402][106225] Updated weights for policy 1, policy_version 1244843 (0.0008) [2023-12-28 04:10:58,462][106225] Updated weights for policy 1, policy_version 1244853 (0.0009) [2023-12-28 04:10:58,522][106225] Updated weights for policy 1, policy_version 1244863 (0.0008) [2023-12-28 04:10:58,585][106226] Updated weights for policy 0, policy_version 1241792 (0.0008) [2023-12-28 04:10:58,649][106226] Updated weights for policy 0, policy_version 1241802 (0.0008) [2023-12-28 04:10:58,710][106226] Updated weights for policy 0, policy_version 1241812 (0.0008) [2023-12-28 04:10:59,278][106225] Updated weights for policy 1, policy_version 1244873 (0.0008) [2023-12-28 04:10:59,344][106225] Updated weights for policy 1, policy_version 1244883 (0.0008) [2023-12-28 04:10:59,418][106225] Updated weights for policy 1, policy_version 1244893 (0.0008) [2023-12-28 04:10:59,478][106225] Updated weights for policy 1, policy_version 1244903 (0.0008) [2023-12-28 04:10:59,624][106226] Updated weights for policy 0, policy_version 1241822 (0.0009) [2023-12-28 04:10:59,689][106226] Updated weights for policy 0, policy_version 1241832 (0.0011) [2023-12-28 04:10:59,752][106226] Updated weights for policy 0, policy_version 1241842 (0.0008) [2023-12-28 04:11:00,247][106225] Updated weights for policy 1, policy_version 1244913 (0.0006) [2023-12-28 04:11:00,301][106225] Updated weights for policy 1, policy_version 1244923 (0.0009) [2023-12-28 04:11:00,344][106225] Updated weights for policy 1, policy_version 1244933 (0.0007) [2023-12-28 04:11:00,476][106226] Updated weights for policy 0, policy_version 1241852 (0.0008) [2023-12-28 04:11:00,520][106226] Updated weights for policy 0, policy_version 1241862 (0.0006) [2023-12-28 04:11:00,566][106226] Updated weights for policy 0, policy_version 1241872 (0.0005) [2023-12-28 04:11:00,945][106225] Updated weights for policy 1, policy_version 1244943 (0.0007) [2023-12-28 04:11:01,008][106225] Updated weights for policy 1, policy_version 1244953 (0.0005) [2023-12-28 04:11:01,077][106225] Updated weights for policy 1, policy_version 1244963 (0.0007) [2023-12-28 04:11:01,148][106226] Updated weights for policy 0, policy_version 1241882 (0.0006) [2023-12-28 04:11:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 636739584. Throughput: 0: 9609.2, 1: 10105.1. Samples: 636726844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:01,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-5.163')] [2023-12-28 04:11:01,212][106226] Updated weights for policy 0, policy_version 1241892 (0.0009) [2023-12-28 04:11:01,270][106226] Updated weights for policy 0, policy_version 1241902 (0.0009) [2023-12-28 04:11:01,342][106226] Updated weights for policy 0, policy_version 1241912 (0.0009) [2023-12-28 04:11:01,816][106225] Updated weights for policy 1, policy_version 1244973 (0.0007) [2023-12-28 04:11:01,867][106225] Updated weights for policy 1, policy_version 1244983 (0.0008) [2023-12-28 04:11:01,923][106225] Updated weights for policy 1, policy_version 1244993 (0.0008) [2023-12-28 04:11:02,043][106226] Updated weights for policy 0, policy_version 1241922 (0.0008) [2023-12-28 04:11:02,103][106226] Updated weights for policy 0, policy_version 1241932 (0.0009) [2023-12-28 04:11:02,163][106226] Updated weights for policy 0, policy_version 1241942 (0.0009) [2023-12-28 04:11:02,679][106225] Updated weights for policy 1, policy_version 1245003 (0.0007) [2023-12-28 04:11:02,749][106225] Updated weights for policy 1, policy_version 1245014 (0.0008) [2023-12-28 04:11:02,810][106225] Updated weights for policy 1, policy_version 1245024 (0.0009) [2023-12-28 04:11:02,829][106226] Updated weights for policy 0, policy_version 1241952 (0.0006) [2023-12-28 04:11:02,892][106226] Updated weights for policy 0, policy_version 1241962 (0.0009) [2023-12-28 04:11:02,950][106226] Updated weights for policy 0, policy_version 1241972 (0.0006) [2023-12-28 04:11:03,364][106225] Updated weights for policy 1, policy_version 1245034 (0.0007) [2023-12-28 04:11:03,421][106225] Updated weights for policy 1, policy_version 1245044 (0.0005) [2023-12-28 04:11:03,482][106225] Updated weights for policy 1, policy_version 1245054 (0.0005) [2023-12-28 04:11:03,509][106226] Updated weights for policy 0, policy_version 1241982 (0.0005) [2023-12-28 04:11:03,538][106225] Updated weights for policy 1, policy_version 1245064 (0.0005) [2023-12-28 04:11:03,560][106226] Updated weights for policy 0, policy_version 1241992 (0.0005) [2023-12-28 04:11:03,613][106226] Updated weights for policy 0, policy_version 1242002 (0.0006) [2023-12-28 04:11:04,153][106225] Updated weights for policy 1, policy_version 1245074 (0.0008) [2023-12-28 04:11:04,209][106225] Updated weights for policy 1, policy_version 1245084 (0.0008) [2023-12-28 04:11:04,264][106225] Updated weights for policy 1, policy_version 1245094 (0.0008) [2023-12-28 04:11:04,293][106226] Updated weights for policy 0, policy_version 1242012 (0.0008) [2023-12-28 04:11:04,357][106226] Updated weights for policy 0, policy_version 1242022 (0.0008) [2023-12-28 04:11:04,416][106226] Updated weights for policy 0, policy_version 1242032 (0.0008) [2023-12-28 04:11:04,978][106225] Updated weights for policy 1, policy_version 1245104 (0.0007) [2023-12-28 04:11:05,040][106225] Updated weights for policy 1, policy_version 1245114 (0.0006) [2023-12-28 04:11:05,097][106225] Updated weights for policy 1, policy_version 1245124 (0.0009) [2023-12-28 04:11:05,150][106226] Updated weights for policy 0, policy_version 1242042 (0.0008) [2023-12-28 04:11:05,205][106226] Updated weights for policy 0, policy_version 1242052 (0.0005) [2023-12-28 04:11:05,269][106226] Updated weights for policy 0, policy_version 1242062 (0.0006) [2023-12-28 04:11:05,318][106226] Updated weights for policy 0, policy_version 1242072 (0.0009) [2023-12-28 04:11:05,727][106225] Updated weights for policy 1, policy_version 1245134 (0.0009) [2023-12-28 04:11:05,776][106225] Updated weights for policy 1, policy_version 1245144 (0.0007) [2023-12-28 04:11:05,832][106225] Updated weights for policy 1, policy_version 1245154 (0.0008) [2023-12-28 04:11:06,013][106226] Updated weights for policy 0, policy_version 1242082 (0.0010) [2023-12-28 04:11:06,065][106226] Updated weights for policy 0, policy_version 1242092 (0.0010) [2023-12-28 04:11:06,128][106226] Updated weights for policy 0, policy_version 1242102 (0.0010) [2023-12-28 04:11:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 636846080. Throughput: 0: 9748.3, 1: 10169.5. Samples: 636851288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:06,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.782')] [2023-12-28 04:11:06,501][106225] Updated weights for policy 1, policy_version 1245164 (0.0007) [2023-12-28 04:11:06,556][106225] Updated weights for policy 1, policy_version 1245174 (0.0010) [2023-12-28 04:11:06,621][106225] Updated weights for policy 1, policy_version 1245184 (0.0011) [2023-12-28 04:11:06,854][106226] Updated weights for policy 0, policy_version 1242112 (0.0009) [2023-12-28 04:11:06,926][106226] Updated weights for policy 0, policy_version 1242122 (0.0010) [2023-12-28 04:11:06,991][106226] Updated weights for policy 0, policy_version 1242132 (0.0009) [2023-12-28 04:11:07,286][106225] Updated weights for policy 1, policy_version 1245194 (0.0010) [2023-12-28 04:11:07,339][106225] Updated weights for policy 1, policy_version 1245204 (0.0009) [2023-12-28 04:11:07,390][106225] Updated weights for policy 1, policy_version 1245214 (0.0006) [2023-12-28 04:11:07,453][106225] Updated weights for policy 1, policy_version 1245224 (0.0006) [2023-12-28 04:11:07,601][106226] Updated weights for policy 0, policy_version 1242142 (0.0006) [2023-12-28 04:11:07,659][106226] Updated weights for policy 0, policy_version 1242152 (0.0008) [2023-12-28 04:11:07,724][106226] Updated weights for policy 0, policy_version 1242162 (0.0008) [2023-12-28 04:11:08,077][106225] Updated weights for policy 1, policy_version 1245234 (0.0005) [2023-12-28 04:11:08,139][106225] Updated weights for policy 1, policy_version 1245244 (0.0005) [2023-12-28 04:11:08,202][106225] Updated weights for policy 1, policy_version 1245254 (0.0006) [2023-12-28 04:11:08,452][106226] Updated weights for policy 0, policy_version 1242172 (0.0007) [2023-12-28 04:11:08,508][106226] Updated weights for policy 0, policy_version 1242182 (0.0008) [2023-12-28 04:11:08,565][106226] Updated weights for policy 0, policy_version 1242192 (0.0007) [2023-12-28 04:11:08,838][106225] Updated weights for policy 1, policy_version 1245264 (0.0009) [2023-12-28 04:11:08,907][106225] Updated weights for policy 1, policy_version 1245274 (0.0005) [2023-12-28 04:11:08,968][106225] Updated weights for policy 1, policy_version 1245284 (0.0005) [2023-12-28 04:11:09,262][106226] Updated weights for policy 0, policy_version 1242202 (0.0006) [2023-12-28 04:11:09,317][106226] Updated weights for policy 0, policy_version 1242212 (0.0010) [2023-12-28 04:11:09,401][106226] Updated weights for policy 0, policy_version 1242222 (0.0008) [2023-12-28 04:11:09,466][106226] Updated weights for policy 0, policy_version 1242232 (0.0007) [2023-12-28 04:11:09,595][106225] Updated weights for policy 1, policy_version 1245294 (0.0007) [2023-12-28 04:11:09,652][106225] Updated weights for policy 1, policy_version 1245304 (0.0010) [2023-12-28 04:11:09,713][106225] Updated weights for policy 1, policy_version 1245314 (0.0011) [2023-12-28 04:11:10,169][106226] Updated weights for policy 0, policy_version 1242242 (0.0008) [2023-12-28 04:11:10,230][106226] Updated weights for policy 0, policy_version 1242252 (0.0008) [2023-12-28 04:11:10,297][106226] Updated weights for policy 0, policy_version 1242262 (0.0008) [2023-12-28 04:11:10,524][106225] Updated weights for policy 1, policy_version 1245324 (0.0009) [2023-12-28 04:11:10,598][106225] Updated weights for policy 1, policy_version 1245334 (0.0005) [2023-12-28 04:11:10,652][106225] Updated weights for policy 1, policy_version 1245344 (0.0005) [2023-12-28 04:11:11,092][106226] Updated weights for policy 0, policy_version 1242272 (0.0009) [2023-12-28 04:11:11,155][106226] Updated weights for policy 0, policy_version 1242282 (0.0008) [2023-12-28 04:11:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 636936192. Throughput: 0: 9780.0, 1: 10223.5. Samples: 636913056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:11,175][105115] Avg episode reward: [(0, '-4.133'), (1, '-4.844')] [2023-12-28 04:11:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001245352_318857216.pth... [2023-12-28 04:11:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001244168_318554112.pth [2023-12-28 04:11:11,216][106226] Updated weights for policy 0, policy_version 1242292 (0.0008) [2023-12-28 04:11:11,236][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001242296_318087168.pth... [2023-12-28 04:11:11,240][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001241144_317792256.pth [2023-12-28 04:11:11,242][106225] Updated weights for policy 1, policy_version 1245354 (0.0006) [2023-12-28 04:11:11,310][106225] Updated weights for policy 1, policy_version 1245364 (0.0009) [2023-12-28 04:11:11,373][106225] Updated weights for policy 1, policy_version 1245374 (0.0008) [2023-12-28 04:11:11,428][106225] Updated weights for policy 1, policy_version 1245384 (0.0008) [2023-12-28 04:11:11,983][106226] Updated weights for policy 0, policy_version 1242302 (0.0010) [2023-12-28 04:11:12,035][106226] Updated weights for policy 0, policy_version 1242312 (0.0011) [2023-12-28 04:11:12,087][106226] Updated weights for policy 0, policy_version 1242322 (0.0010) [2023-12-28 04:11:12,193][106225] Updated weights for policy 1, policy_version 1245394 (0.0008) [2023-12-28 04:11:12,244][106225] Updated weights for policy 1, policy_version 1245404 (0.0007) [2023-12-28 04:11:12,305][106225] Updated weights for policy 1, policy_version 1245414 (0.0008) [2023-12-28 04:11:12,830][106226] Updated weights for policy 0, policy_version 1242332 (0.0010) [2023-12-28 04:11:12,890][106226] Updated weights for policy 0, policy_version 1242342 (0.0009) [2023-12-28 04:11:12,940][106226] Updated weights for policy 0, policy_version 1242352 (0.0009) [2023-12-28 04:11:13,004][106225] Updated weights for policy 1, policy_version 1245424 (0.0009) [2023-12-28 04:11:13,057][106225] Updated weights for policy 1, policy_version 1245434 (0.0008) [2023-12-28 04:11:13,109][106225] Updated weights for policy 1, policy_version 1245444 (0.0008) [2023-12-28 04:11:13,674][106226] Updated weights for policy 0, policy_version 1242362 (0.0007) [2023-12-28 04:11:13,719][106225] Updated weights for policy 1, policy_version 1245454 (0.0007) [2023-12-28 04:11:13,741][106226] Updated weights for policy 0, policy_version 1242372 (0.0009) [2023-12-28 04:11:13,779][106225] Updated weights for policy 1, policy_version 1245464 (0.0005) [2023-12-28 04:11:13,801][106226] Updated weights for policy 0, policy_version 1242382 (0.0010) [2023-12-28 04:11:13,840][106225] Updated weights for policy 1, policy_version 1245474 (0.0005) [2023-12-28 04:11:13,858][106226] Updated weights for policy 0, policy_version 1242392 (0.0010) [2023-12-28 04:11:14,466][106225] Updated weights for policy 1, policy_version 1245484 (0.0009) [2023-12-28 04:11:14,500][106226] Updated weights for policy 0, policy_version 1242402 (0.0011) [2023-12-28 04:11:14,519][106225] Updated weights for policy 1, policy_version 1245494 (0.0010) [2023-12-28 04:11:14,552][106226] Updated weights for policy 0, policy_version 1242412 (0.0010) [2023-12-28 04:11:14,569][106225] Updated weights for policy 1, policy_version 1245504 (0.0010) [2023-12-28 04:11:14,608][106226] Updated weights for policy 0, policy_version 1242422 (0.0010) [2023-12-28 04:11:15,272][106225] Updated weights for policy 1, policy_version 1245514 (0.0010) [2023-12-28 04:11:15,330][106226] Updated weights for policy 0, policy_version 1242432 (0.0011) [2023-12-28 04:11:15,334][106225] Updated weights for policy 1, policy_version 1245524 (0.0011) [2023-12-28 04:11:15,391][106226] Updated weights for policy 0, policy_version 1242442 (0.0010) [2023-12-28 04:11:15,398][106225] Updated weights for policy 1, policy_version 1245534 (0.0010) [2023-12-28 04:11:15,451][106225] Updated weights for policy 1, policy_version 1245544 (0.0010) [2023-12-28 04:11:15,454][106226] Updated weights for policy 0, policy_version 1242452 (0.0010) [2023-12-28 04:11:16,095][106226] Updated weights for policy 0, policy_version 1242462 (0.0010) [2023-12-28 04:11:16,155][106226] Updated weights for policy 0, policy_version 1242472 (0.0005) [2023-12-28 04:11:16,164][106225] Updated weights for policy 1, policy_version 1245554 (0.0010) [2023-12-28 04:11:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 637034496. Throughput: 0: 9625.2, 1: 10154.1. Samples: 637029896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:16,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-5.069')] [2023-12-28 04:11:16,215][106226] Updated weights for policy 0, policy_version 1242482 (0.0006) [2023-12-28 04:11:16,222][106225] Updated weights for policy 1, policy_version 1245564 (0.0010) [2023-12-28 04:11:16,288][106225] Updated weights for policy 1, policy_version 1245574 (0.0006) [2023-12-28 04:11:16,796][106226] Updated weights for policy 0, policy_version 1242492 (0.0009) [2023-12-28 04:11:16,853][106226] Updated weights for policy 0, policy_version 1242502 (0.0011) [2023-12-28 04:11:16,878][106225] Updated weights for policy 1, policy_version 1245584 (0.0009) [2023-12-28 04:11:16,917][106226] Updated weights for policy 0, policy_version 1242512 (0.0011) [2023-12-28 04:11:16,930][106225] Updated weights for policy 1, policy_version 1245594 (0.0009) [2023-12-28 04:11:16,984][106225] Updated weights for policy 1, policy_version 1245604 (0.0010) [2023-12-28 04:11:17,621][106226] Updated weights for policy 0, policy_version 1242522 (0.0010) [2023-12-28 04:11:17,671][106225] Updated weights for policy 1, policy_version 1245614 (0.0007) [2023-12-28 04:11:17,681][106226] Updated weights for policy 0, policy_version 1242532 (0.0011) [2023-12-28 04:11:17,739][106226] Updated weights for policy 0, policy_version 1242542 (0.0011) [2023-12-28 04:11:17,740][106225] Updated weights for policy 1, policy_version 1245624 (0.0008) [2023-12-28 04:11:17,796][106226] Updated weights for policy 0, policy_version 1242552 (0.0011) [2023-12-28 04:11:17,801][106225] Updated weights for policy 1, policy_version 1245634 (0.0010) [2023-12-28 04:11:18,458][106225] Updated weights for policy 1, policy_version 1245644 (0.0010) [2023-12-28 04:11:18,516][106225] Updated weights for policy 1, policy_version 1245654 (0.0010) [2023-12-28 04:11:18,517][106226] Updated weights for policy 0, policy_version 1242562 (0.0011) [2023-12-28 04:11:18,568][106225] Updated weights for policy 1, policy_version 1245664 (0.0010) [2023-12-28 04:11:18,572][106226] Updated weights for policy 0, policy_version 1242572 (0.0011) [2023-12-28 04:11:18,627][106226] Updated weights for policy 0, policy_version 1242582 (0.0009) [2023-12-28 04:11:19,281][106225] Updated weights for policy 1, policy_version 1245674 (0.0009) [2023-12-28 04:11:19,326][106226] Updated weights for policy 0, policy_version 1242592 (0.0007) [2023-12-28 04:11:19,350][106225] Updated weights for policy 1, policy_version 1245684 (0.0007) [2023-12-28 04:11:19,398][106226] Updated weights for policy 0, policy_version 1242603 (0.0009) [2023-12-28 04:11:19,411][106225] Updated weights for policy 1, policy_version 1245694 (0.0010) [2023-12-28 04:11:19,461][106226] Updated weights for policy 0, policy_version 1242613 (0.0006) [2023-12-28 04:11:19,470][106225] Updated weights for policy 1, policy_version 1245704 (0.0010) [2023-12-28 04:11:20,170][106225] Updated weights for policy 1, policy_version 1245714 (0.0008) [2023-12-28 04:11:20,215][106226] Updated weights for policy 0, policy_version 1242623 (0.0007) [2023-12-28 04:11:20,232][106225] Updated weights for policy 1, policy_version 1245724 (0.0007) [2023-12-28 04:11:20,273][106226] Updated weights for policy 0, policy_version 1242633 (0.0008) [2023-12-28 04:11:20,287][106225] Updated weights for policy 1, policy_version 1245734 (0.0007) [2023-12-28 04:11:20,336][106226] Updated weights for policy 0, policy_version 1242643 (0.0009) [2023-12-28 04:11:20,956][106225] Updated weights for policy 1, policy_version 1245744 (0.0008) [2023-12-28 04:11:21,021][106225] Updated weights for policy 1, policy_version 1245754 (0.0009) [2023-12-28 04:11:21,088][106226] Updated weights for policy 0, policy_version 1242653 (0.0008) [2023-12-28 04:11:21,090][106225] Updated weights for policy 1, policy_version 1245764 (0.0007) [2023-12-28 04:11:21,148][106226] Updated weights for policy 0, policy_version 1242663 (0.0008) [2023-12-28 04:11:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 637140992. Throughput: 0: 9657.7, 1: 10165.1. Samples: 637149968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:21,176][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.906')] [2023-12-28 04:11:21,214][106226] Updated weights for policy 0, policy_version 1242673 (0.0008) [2023-12-28 04:11:21,819][106225] Updated weights for policy 1, policy_version 1245774 (0.0007) [2023-12-28 04:11:21,870][106225] Updated weights for policy 1, policy_version 1245784 (0.0008) [2023-12-28 04:11:21,921][106225] Updated weights for policy 1, policy_version 1245794 (0.0007) [2023-12-28 04:11:21,995][106226] Updated weights for policy 0, policy_version 1242683 (0.0008) [2023-12-28 04:11:22,062][106226] Updated weights for policy 0, policy_version 1242693 (0.0006) [2023-12-28 04:11:22,127][106226] Updated weights for policy 0, policy_version 1242703 (0.0007) [2023-12-28 04:11:22,713][106225] Updated weights for policy 1, policy_version 1245804 (0.0010) [2023-12-28 04:11:22,779][106225] Updated weights for policy 1, policy_version 1245814 (0.0010) [2023-12-28 04:11:22,839][106226] Updated weights for policy 0, policy_version 1242713 (0.0008) [2023-12-28 04:11:22,840][106225] Updated weights for policy 1, policy_version 1245824 (0.0011) [2023-12-28 04:11:22,900][106226] Updated weights for policy 0, policy_version 1242723 (0.0006) [2023-12-28 04:11:22,954][106226] Updated weights for policy 0, policy_version 1242733 (0.0008) [2023-12-28 04:11:23,006][106226] Updated weights for policy 0, policy_version 1242743 (0.0008) [2023-12-28 04:11:23,562][106225] Updated weights for policy 1, policy_version 1245834 (0.0010) [2023-12-28 04:11:23,609][106225] Updated weights for policy 1, policy_version 1245844 (0.0010) [2023-12-28 04:11:23,659][106225] Updated weights for policy 1, policy_version 1245854 (0.0010) [2023-12-28 04:11:23,665][106226] Updated weights for policy 0, policy_version 1242753 (0.0006) [2023-12-28 04:11:23,707][106225] Updated weights for policy 1, policy_version 1245864 (0.0010) [2023-12-28 04:11:23,714][106226] Updated weights for policy 0, policy_version 1242763 (0.0005) [2023-12-28 04:11:23,768][106226] Updated weights for policy 0, policy_version 1242773 (0.0005) [2023-12-28 04:11:24,398][106226] Updated weights for policy 0, policy_version 1242783 (0.0007) [2023-12-28 04:11:24,450][106225] Updated weights for policy 1, policy_version 1245874 (0.0010) [2023-12-28 04:11:24,455][106226] Updated weights for policy 0, policy_version 1242793 (0.0010) [2023-12-28 04:11:24,501][106225] Updated weights for policy 1, policy_version 1245884 (0.0010) [2023-12-28 04:11:24,505][106226] Updated weights for policy 0, policy_version 1242803 (0.0010) [2023-12-28 04:11:24,555][106225] Updated weights for policy 1, policy_version 1245894 (0.0010) [2023-12-28 04:11:25,168][106226] Updated weights for policy 0, policy_version 1242813 (0.0008) [2023-12-28 04:11:25,237][106226] Updated weights for policy 0, policy_version 1242823 (0.0006) [2023-12-28 04:11:25,280][106226] Updated weights for policy 0, policy_version 1242833 (0.0007) [2023-12-28 04:11:25,290][106225] Updated weights for policy 1, policy_version 1245904 (0.0010) [2023-12-28 04:11:25,354][106225] Updated weights for policy 1, policy_version 1245914 (0.0010) [2023-12-28 04:11:25,422][106225] Updated weights for policy 1, policy_version 1245924 (0.0010) [2023-12-28 04:11:25,844][106226] Updated weights for policy 0, policy_version 1242843 (0.0007) [2023-12-28 04:11:25,905][106226] Updated weights for policy 0, policy_version 1242853 (0.0005) [2023-12-28 04:11:25,965][106226] Updated weights for policy 0, policy_version 1242863 (0.0005) [2023-12-28 04:11:26,074][106225] Updated weights for policy 1, policy_version 1245934 (0.0010) [2023-12-28 04:11:26,131][106225] Updated weights for policy 1, policy_version 1245944 (0.0010) [2023-12-28 04:11:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 637239296. Throughput: 0: 9674.7, 1: 10157.0. Samples: 637207440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:26,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.062')] [2023-12-28 04:11:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001242872_318234624.pth... [2023-12-28 04:11:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001241720_317939712.pth [2023-12-28 04:11:26,190][106225] Updated weights for policy 1, policy_version 1245954 (0.0010) [2023-12-28 04:11:26,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001245960_319012864.pth... [2023-12-28 04:11:26,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001244776_318709760.pth [2023-12-28 04:11:26,544][106226] Updated weights for policy 0, policy_version 1242873 (0.0006) [2023-12-28 04:11:26,604][106226] Updated weights for policy 0, policy_version 1242883 (0.0005) [2023-12-28 04:11:26,652][106226] Updated weights for policy 0, policy_version 1242893 (0.0007) [2023-12-28 04:11:26,708][106226] Updated weights for policy 0, policy_version 1242903 (0.0010) [2023-12-28 04:11:26,903][106225] Updated weights for policy 1, policy_version 1245964 (0.0008) [2023-12-28 04:11:26,958][106225] Updated weights for policy 1, policy_version 1245974 (0.0009) [2023-12-28 04:11:27,010][106225] Updated weights for policy 1, policy_version 1245984 (0.0006) [2023-12-28 04:11:27,316][106226] Updated weights for policy 0, policy_version 1242913 (0.0008) [2023-12-28 04:11:27,368][106226] Updated weights for policy 0, policy_version 1242923 (0.0009) [2023-12-28 04:11:27,417][106226] Updated weights for policy 0, policy_version 1242933 (0.0008) [2023-12-28 04:11:27,632][106225] Updated weights for policy 1, policy_version 1245994 (0.0007) [2023-12-28 04:11:27,694][106225] Updated weights for policy 1, policy_version 1246004 (0.0006) [2023-12-28 04:11:27,753][106225] Updated weights for policy 1, policy_version 1246014 (0.0006) [2023-12-28 04:11:27,802][106225] Updated weights for policy 1, policy_version 1246024 (0.0005) [2023-12-28 04:11:28,021][106226] Updated weights for policy 0, policy_version 1242943 (0.0006) [2023-12-28 04:11:28,074][106226] Updated weights for policy 0, policy_version 1242953 (0.0005) [2023-12-28 04:11:28,131][106226] Updated weights for policy 0, policy_version 1242963 (0.0006) [2023-12-28 04:11:28,446][106225] Updated weights for policy 1, policy_version 1246034 (0.0008) [2023-12-28 04:11:28,511][106225] Updated weights for policy 1, policy_version 1246044 (0.0009) [2023-12-28 04:11:28,576][106225] Updated weights for policy 1, policy_version 1246054 (0.0006) [2023-12-28 04:11:28,737][106226] Updated weights for policy 0, policy_version 1242973 (0.0008) [2023-12-28 04:11:28,796][106226] Updated weights for policy 0, policy_version 1242983 (0.0009) [2023-12-28 04:11:28,853][106226] Updated weights for policy 0, policy_version 1242993 (0.0009) [2023-12-28 04:11:29,147][106225] Updated weights for policy 1, policy_version 1246064 (0.0007) [2023-12-28 04:11:29,204][106225] Updated weights for policy 1, policy_version 1246074 (0.0008) [2023-12-28 04:11:29,270][106225] Updated weights for policy 1, policy_version 1246084 (0.0008) [2023-12-28 04:11:29,705][106226] Updated weights for policy 0, policy_version 1243003 (0.0008) [2023-12-28 04:11:29,768][106226] Updated weights for policy 0, policy_version 1243013 (0.0008) [2023-12-28 04:11:29,830][106226] Updated weights for policy 0, policy_version 1243023 (0.0008) [2023-12-28 04:11:29,914][106225] Updated weights for policy 1, policy_version 1246094 (0.0009) [2023-12-28 04:11:29,983][106225] Updated weights for policy 1, policy_version 1246104 (0.0011) [2023-12-28 04:11:30,035][106225] Updated weights for policy 1, policy_version 1246114 (0.0010) [2023-12-28 04:11:30,525][106226] Updated weights for policy 0, policy_version 1243033 (0.0007) [2023-12-28 04:11:30,585][106226] Updated weights for policy 0, policy_version 1243043 (0.0007) [2023-12-28 04:11:30,631][106226] Updated weights for policy 0, policy_version 1243053 (0.0007) [2023-12-28 04:11:30,677][106226] Updated weights for policy 0, policy_version 1243063 (0.0007) [2023-12-28 04:11:30,760][106225] Updated weights for policy 1, policy_version 1246124 (0.0010) [2023-12-28 04:11:30,807][106225] Updated weights for policy 1, policy_version 1246134 (0.0010) [2023-12-28 04:11:30,852][106225] Updated weights for policy 1, policy_version 1246144 (0.0010) [2023-12-28 04:11:31,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 637345792. Throughput: 0: 9823.8, 1: 10240.2. Samples: 637334192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:31,175][105115] Avg episode reward: [(0, '-4.228'), (1, '-4.977')] [2023-12-28 04:11:31,404][106226] Updated weights for policy 0, policy_version 1243073 (0.0008) [2023-12-28 04:11:31,462][106226] Updated weights for policy 0, policy_version 1243083 (0.0009) [2023-12-28 04:11:31,529][106226] Updated weights for policy 0, policy_version 1243093 (0.0008) [2023-12-28 04:11:31,629][106225] Updated weights for policy 1, policy_version 1246154 (0.0010) [2023-12-28 04:11:31,691][106225] Updated weights for policy 1, policy_version 1246164 (0.0009) [2023-12-28 04:11:31,756][106225] Updated weights for policy 1, policy_version 1246174 (0.0008) [2023-12-28 04:11:31,812][106225] Updated weights for policy 1, policy_version 1246184 (0.0009) [2023-12-28 04:11:32,241][106226] Updated weights for policy 0, policy_version 1243103 (0.0008) [2023-12-28 04:11:32,307][106226] Updated weights for policy 0, policy_version 1243113 (0.0006) [2023-12-28 04:11:32,376][106226] Updated weights for policy 0, policy_version 1243123 (0.0007) [2023-12-28 04:11:32,566][106225] Updated weights for policy 1, policy_version 1246194 (0.0008) [2023-12-28 04:11:32,619][106225] Updated weights for policy 1, policy_version 1246204 (0.0008) [2023-12-28 04:11:32,665][106225] Updated weights for policy 1, policy_version 1246214 (0.0009) [2023-12-28 04:11:33,070][106226] Updated weights for policy 0, policy_version 1243133 (0.0008) [2023-12-28 04:11:33,121][106226] Updated weights for policy 0, policy_version 1243143 (0.0008) [2023-12-28 04:11:33,173][106226] Updated weights for policy 0, policy_version 1243153 (0.0009) [2023-12-28 04:11:33,346][106225] Updated weights for policy 1, policy_version 1246224 (0.0006) [2023-12-28 04:11:33,394][106225] Updated weights for policy 1, policy_version 1246234 (0.0008) [2023-12-28 04:11:33,449][106225] Updated weights for policy 1, policy_version 1246244 (0.0009) [2023-12-28 04:11:33,948][106226] Updated weights for policy 0, policy_version 1243163 (0.0008) [2023-12-28 04:11:34,009][106226] Updated weights for policy 0, policy_version 1243173 (0.0008) [2023-12-28 04:11:34,062][106226] Updated weights for policy 0, policy_version 1243183 (0.0009) [2023-12-28 04:11:34,078][106225] Updated weights for policy 1, policy_version 1246254 (0.0006) [2023-12-28 04:11:34,136][106225] Updated weights for policy 1, policy_version 1246264 (0.0008) [2023-12-28 04:11:34,205][106225] Updated weights for policy 1, policy_version 1246274 (0.0009) [2023-12-28 04:11:34,814][106226] Updated weights for policy 0, policy_version 1243193 (0.0007) [2023-12-28 04:11:34,866][106226] Updated weights for policy 0, policy_version 1243203 (0.0009) [2023-12-28 04:11:34,925][106226] Updated weights for policy 0, policy_version 1243213 (0.0008) [2023-12-28 04:11:34,936][106225] Updated weights for policy 1, policy_version 1246284 (0.0009) [2023-12-28 04:11:34,974][106226] Updated weights for policy 0, policy_version 1243223 (0.0009) [2023-12-28 04:11:34,991][106225] Updated weights for policy 1, policy_version 1246294 (0.0005) [2023-12-28 04:11:35,040][106225] Updated weights for policy 1, policy_version 1246304 (0.0005) [2023-12-28 04:11:35,634][106225] Updated weights for policy 1, policy_version 1246314 (0.0006) [2023-12-28 04:11:35,685][106225] Updated weights for policy 1, policy_version 1246324 (0.0008) [2023-12-28 04:11:35,733][106225] Updated weights for policy 1, policy_version 1246334 (0.0007) [2023-12-28 04:11:35,774][106226] Updated weights for policy 0, policy_version 1243233 (0.0007) [2023-12-28 04:11:35,784][106225] Updated weights for policy 1, policy_version 1246344 (0.0006) [2023-12-28 04:11:35,824][106226] Updated weights for policy 0, policy_version 1243243 (0.0008) [2023-12-28 04:11:35,889][106226] Updated weights for policy 0, policy_version 1243253 (0.0008) [2023-12-28 04:11:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 637444096. Throughput: 0: 9801.5, 1: 10186.6. Samples: 637450400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:36,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.975')] [2023-12-28 04:11:36,463][106225] Updated weights for policy 1, policy_version 1246354 (0.0011) [2023-12-28 04:11:36,526][106225] Updated weights for policy 1, policy_version 1246364 (0.0010) [2023-12-28 04:11:36,592][106225] Updated weights for policy 1, policy_version 1246374 (0.0010) [2023-12-28 04:11:36,718][106226] Updated weights for policy 0, policy_version 1243263 (0.0009) [2023-12-28 04:11:36,787][106226] Updated weights for policy 0, policy_version 1243273 (0.0010) [2023-12-28 04:11:36,840][106226] Updated weights for policy 0, policy_version 1243283 (0.0008) [2023-12-28 04:11:37,197][106225] Updated weights for policy 1, policy_version 1246384 (0.0007) [2023-12-28 04:11:37,253][106225] Updated weights for policy 1, policy_version 1246394 (0.0007) [2023-12-28 04:11:37,309][106225] Updated weights for policy 1, policy_version 1246404 (0.0005) [2023-12-28 04:11:37,666][106226] Updated weights for policy 0, policy_version 1243293 (0.0008) [2023-12-28 04:11:37,724][106226] Updated weights for policy 0, policy_version 1243303 (0.0008) [2023-12-28 04:11:37,789][106226] Updated weights for policy 0, policy_version 1243313 (0.0008) [2023-12-28 04:11:37,956][106225] Updated weights for policy 1, policy_version 1246414 (0.0008) [2023-12-28 04:11:38,023][106225] Updated weights for policy 1, policy_version 1246424 (0.0010) [2023-12-28 04:11:38,095][106225] Updated weights for policy 1, policy_version 1246434 (0.0010) [2023-12-28 04:11:38,516][106226] Updated weights for policy 0, policy_version 1243323 (0.0008) [2023-12-28 04:11:38,581][106226] Updated weights for policy 0, policy_version 1243333 (0.0008) [2023-12-28 04:11:38,650][106226] Updated weights for policy 0, policy_version 1243343 (0.0009) [2023-12-28 04:11:38,852][106225] Updated weights for policy 1, policy_version 1246444 (0.0010) [2023-12-28 04:11:38,910][106225] Updated weights for policy 1, policy_version 1246454 (0.0010) [2023-12-28 04:11:38,964][106225] Updated weights for policy 1, policy_version 1246464 (0.0010) [2023-12-28 04:11:39,359][106226] Updated weights for policy 0, policy_version 1243353 (0.0010) [2023-12-28 04:11:39,426][106226] Updated weights for policy 0, policy_version 1243363 (0.0008) [2023-12-28 04:11:39,489][106226] Updated weights for policy 0, policy_version 1243373 (0.0008) [2023-12-28 04:11:39,547][106226] Updated weights for policy 0, policy_version 1243383 (0.0008) [2023-12-28 04:11:39,726][106225] Updated weights for policy 1, policy_version 1246474 (0.0010) [2023-12-28 04:11:39,787][106225] Updated weights for policy 1, policy_version 1246484 (0.0011) [2023-12-28 04:11:39,844][106225] Updated weights for policy 1, policy_version 1246494 (0.0009) [2023-12-28 04:11:39,914][106225] Updated weights for policy 1, policy_version 1246504 (0.0006) [2023-12-28 04:11:40,293][106226] Updated weights for policy 0, policy_version 1243393 (0.0006) [2023-12-28 04:11:40,343][106226] Updated weights for policy 0, policy_version 1243403 (0.0006) [2023-12-28 04:11:40,398][106226] Updated weights for policy 0, policy_version 1243413 (0.0008) [2023-12-28 04:11:40,621][106225] Updated weights for policy 1, policy_version 1246514 (0.0007) [2023-12-28 04:11:40,682][106225] Updated weights for policy 1, policy_version 1246524 (0.0005) [2023-12-28 04:11:40,744][106225] Updated weights for policy 1, policy_version 1246534 (0.0005) [2023-12-28 04:11:41,013][106226] Updated weights for policy 0, policy_version 1243423 (0.0009) [2023-12-28 04:11:41,084][106226] Updated weights for policy 0, policy_version 1243433 (0.0009) [2023-12-28 04:11:41,150][106226] Updated weights for policy 0, policy_version 1243443 (0.0008) [2023-12-28 04:11:41,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 637534208. Throughput: 0: 9779.7, 1: 10210.5. Samples: 637508712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:41,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-5.058')] [2023-12-28 04:11:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001246536_319160320.pth... [2023-12-28 04:11:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001243448_318382080.pth... [2023-12-28 04:11:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001245352_318857216.pth [2023-12-28 04:11:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001242296_318087168.pth [2023-12-28 04:11:41,380][106225] Updated weights for policy 1, policy_version 1246544 (0.0009) [2023-12-28 04:11:41,452][106225] Updated weights for policy 1, policy_version 1246554 (0.0006) [2023-12-28 04:11:41,524][106225] Updated weights for policy 1, policy_version 1246564 (0.0006) [2023-12-28 04:11:41,949][106226] Updated weights for policy 0, policy_version 1243453 (0.0009) [2023-12-28 04:11:42,023][106226] Updated weights for policy 0, policy_version 1243463 (0.0008) [2023-12-28 04:11:42,092][106226] Updated weights for policy 0, policy_version 1243473 (0.0009) [2023-12-28 04:11:42,203][106225] Updated weights for policy 1, policy_version 1246574 (0.0007) [2023-12-28 04:11:42,271][106225] Updated weights for policy 1, policy_version 1246584 (0.0008) [2023-12-28 04:11:42,333][106225] Updated weights for policy 1, policy_version 1246594 (0.0008) [2023-12-28 04:11:42,860][106226] Updated weights for policy 0, policy_version 1243483 (0.0008) [2023-12-28 04:11:42,909][106226] Updated weights for policy 0, policy_version 1243493 (0.0009) [2023-12-28 04:11:42,957][106226] Updated weights for policy 0, policy_version 1243503 (0.0008) [2023-12-28 04:11:43,043][106225] Updated weights for policy 1, policy_version 1246604 (0.0008) [2023-12-28 04:11:43,096][106225] Updated weights for policy 1, policy_version 1246614 (0.0006) [2023-12-28 04:11:43,161][106225] Updated weights for policy 1, policy_version 1246624 (0.0009) [2023-12-28 04:11:43,695][106226] Updated weights for policy 0, policy_version 1243513 (0.0009) [2023-12-28 04:11:43,761][106226] Updated weights for policy 0, policy_version 1243523 (0.0006) [2023-12-28 04:11:43,826][106225] Updated weights for policy 1, policy_version 1246634 (0.0008) [2023-12-28 04:11:43,827][106226] Updated weights for policy 0, policy_version 1243533 (0.0009) [2023-12-28 04:11:43,873][106225] Updated weights for policy 1, policy_version 1246644 (0.0007) [2023-12-28 04:11:43,890][106226] Updated weights for policy 0, policy_version 1243543 (0.0008) [2023-12-28 04:11:43,921][106225] Updated weights for policy 1, policy_version 1246654 (0.0007) [2023-12-28 04:11:43,977][106225] Updated weights for policy 1, policy_version 1246664 (0.0008) [2023-12-28 04:11:44,587][106226] Updated weights for policy 0, policy_version 1243553 (0.0008) [2023-12-28 04:11:44,641][106226] Updated weights for policy 0, policy_version 1243563 (0.0008) [2023-12-28 04:11:44,651][106225] Updated weights for policy 1, policy_version 1246674 (0.0005) [2023-12-28 04:11:44,686][106226] Updated weights for policy 0, policy_version 1243573 (0.0008) [2023-12-28 04:11:44,715][106225] Updated weights for policy 1, policy_version 1246684 (0.0005) [2023-12-28 04:11:44,793][106225] Updated weights for policy 1, policy_version 1246694 (0.0006) [2023-12-28 04:11:45,428][106225] Updated weights for policy 1, policy_version 1246704 (0.0010) [2023-12-28 04:11:45,452][106226] Updated weights for policy 0, policy_version 1243583 (0.0007) [2023-12-28 04:11:45,484][106225] Updated weights for policy 1, policy_version 1246714 (0.0008) [2023-12-28 04:11:45,512][106226] Updated weights for policy 0, policy_version 1243593 (0.0006) [2023-12-28 04:11:45,541][106225] Updated weights for policy 1, policy_version 1246724 (0.0007) [2023-12-28 04:11:45,569][106226] Updated weights for policy 0, policy_version 1243603 (0.0006) [2023-12-28 04:11:46,128][106226] Updated weights for policy 0, policy_version 1243613 (0.0008) [2023-12-28 04:11:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 637632512. Throughput: 0: 9838.4, 1: 10130.5. Samples: 637625444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:46,175][106225] Updated weights for policy 1, policy_version 1246734 (0.0006) [2023-12-28 04:11:46,175][106226] Updated weights for policy 0, policy_version 1243623 (0.0009) [2023-12-28 04:11:46,175][105115] Avg episode reward: [(0, '-4.006'), (1, '-4.784')] [2023-12-28 04:11:46,232][106226] Updated weights for policy 0, policy_version 1243633 (0.0007) [2023-12-28 04:11:46,237][106225] Updated weights for policy 1, policy_version 1246744 (0.0008) [2023-12-28 04:11:46,298][106225] Updated weights for policy 1, policy_version 1246754 (0.0007) [2023-12-28 04:11:46,920][106225] Updated weights for policy 1, policy_version 1246764 (0.0009) [2023-12-28 04:11:46,942][106226] Updated weights for policy 0, policy_version 1243643 (0.0007) [2023-12-28 04:11:46,971][106225] Updated weights for policy 1, policy_version 1246774 (0.0006) [2023-12-28 04:11:46,993][106226] Updated weights for policy 0, policy_version 1243653 (0.0006) [2023-12-28 04:11:47,023][106225] Updated weights for policy 1, policy_version 1246784 (0.0006) [2023-12-28 04:11:47,047][106226] Updated weights for policy 0, policy_version 1243663 (0.0006) [2023-12-28 04:11:47,721][106226] Updated weights for policy 0, policy_version 1243673 (0.0006) [2023-12-28 04:11:47,773][106226] Updated weights for policy 0, policy_version 1243683 (0.0009) [2023-12-28 04:11:47,780][106225] Updated weights for policy 1, policy_version 1246794 (0.0008) [2023-12-28 04:11:47,826][106225] Updated weights for policy 1, policy_version 1246804 (0.0007) [2023-12-28 04:11:47,828][106226] Updated weights for policy 0, policy_version 1243693 (0.0007) [2023-12-28 04:11:47,881][106225] Updated weights for policy 1, policy_version 1246814 (0.0008) [2023-12-28 04:11:47,887][106226] Updated weights for policy 0, policy_version 1243703 (0.0006) [2023-12-28 04:11:47,931][106225] Updated weights for policy 1, policy_version 1246824 (0.0008) [2023-12-28 04:11:48,575][106226] Updated weights for policy 0, policy_version 1243713 (0.0008) [2023-12-28 04:11:48,631][106226] Updated weights for policy 0, policy_version 1243723 (0.0008) [2023-12-28 04:11:48,692][106226] Updated weights for policy 0, policy_version 1243733 (0.0009) [2023-12-28 04:11:48,723][106225] Updated weights for policy 1, policy_version 1246834 (0.0006) [2023-12-28 04:11:48,785][106225] Updated weights for policy 1, policy_version 1246844 (0.0008) [2023-12-28 04:11:48,844][106225] Updated weights for policy 1, policy_version 1246854 (0.0008) [2023-12-28 04:11:49,421][106226] Updated weights for policy 0, policy_version 1243743 (0.0006) [2023-12-28 04:11:49,481][106226] Updated weights for policy 0, policy_version 1243753 (0.0008) [2023-12-28 04:11:49,543][106226] Updated weights for policy 0, policy_version 1243763 (0.0008) [2023-12-28 04:11:49,616][106225] Updated weights for policy 1, policy_version 1246864 (0.0009) [2023-12-28 04:11:49,669][106225] Updated weights for policy 1, policy_version 1246874 (0.0009) [2023-12-28 04:11:49,722][106225] Updated weights for policy 1, policy_version 1246884 (0.0008) [2023-12-28 04:11:50,190][106226] Updated weights for policy 0, policy_version 1243773 (0.0008) [2023-12-28 04:11:50,247][106226] Updated weights for policy 0, policy_version 1243783 (0.0007) [2023-12-28 04:11:50,305][106226] Updated weights for policy 0, policy_version 1243793 (0.0009) [2023-12-28 04:11:50,486][106225] Updated weights for policy 1, policy_version 1246894 (0.0007) [2023-12-28 04:11:50,547][106225] Updated weights for policy 1, policy_version 1246904 (0.0007) [2023-12-28 04:11:50,611][106225] Updated weights for policy 1, policy_version 1246914 (0.0008) [2023-12-28 04:11:51,045][106226] Updated weights for policy 0, policy_version 1243803 (0.0009) [2023-12-28 04:11:51,109][106226] Updated weights for policy 0, policy_version 1243813 (0.0008) [2023-12-28 04:11:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 637730816. Throughput: 0: 9811.3, 1: 10048.2. Samples: 637744964. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:51,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.935')] [2023-12-28 04:11:51,176][106226] Updated weights for policy 0, policy_version 1243823 (0.0009) [2023-12-28 04:11:51,340][106225] Updated weights for policy 1, policy_version 1246924 (0.0007) [2023-12-28 04:11:51,407][106225] Updated weights for policy 1, policy_version 1246934 (0.0008) [2023-12-28 04:11:51,461][106225] Updated weights for policy 1, policy_version 1246944 (0.0008) [2023-12-28 04:11:51,939][106226] Updated weights for policy 0, policy_version 1243833 (0.0009) [2023-12-28 04:11:51,997][106226] Updated weights for policy 0, policy_version 1243843 (0.0008) [2023-12-28 04:11:52,044][106226] Updated weights for policy 0, policy_version 1243853 (0.0009) [2023-12-28 04:11:52,100][106226] Updated weights for policy 0, policy_version 1243863 (0.0008) [2023-12-28 04:11:52,188][106225] Updated weights for policy 1, policy_version 1246954 (0.0007) [2023-12-28 04:11:52,236][106225] Updated weights for policy 1, policy_version 1246964 (0.0005) [2023-12-28 04:11:52,295][106225] Updated weights for policy 1, policy_version 1246974 (0.0007) [2023-12-28 04:11:52,356][106225] Updated weights for policy 1, policy_version 1246984 (0.0008) [2023-12-28 04:11:52,894][106226] Updated weights for policy 0, policy_version 1243873 (0.0008) [2023-12-28 04:11:52,942][106226] Updated weights for policy 0, policy_version 1243883 (0.0008) [2023-12-28 04:11:52,999][106226] Updated weights for policy 0, policy_version 1243893 (0.0006) [2023-12-28 04:11:53,017][106225] Updated weights for policy 1, policy_version 1246994 (0.0007) [2023-12-28 04:11:53,065][106225] Updated weights for policy 1, policy_version 1247004 (0.0008) [2023-12-28 04:11:53,121][106225] Updated weights for policy 1, policy_version 1247014 (0.0007) [2023-12-28 04:11:53,690][106226] Updated weights for policy 0, policy_version 1243903 (0.0005) [2023-12-28 04:11:53,756][106226] Updated weights for policy 0, policy_version 1243913 (0.0006) [2023-12-28 04:11:53,807][106226] Updated weights for policy 0, policy_version 1243923 (0.0005) [2023-12-28 04:11:53,866][106225] Updated weights for policy 1, policy_version 1247024 (0.0007) [2023-12-28 04:11:53,921][106225] Updated weights for policy 1, policy_version 1247034 (0.0009) [2023-12-28 04:11:53,979][106225] Updated weights for policy 1, policy_version 1247044 (0.0009) [2023-12-28 04:11:54,453][106226] Updated weights for policy 0, policy_version 1243933 (0.0005) [2023-12-28 04:11:54,509][106226] Updated weights for policy 0, policy_version 1243943 (0.0007) [2023-12-28 04:11:54,569][106226] Updated weights for policy 0, policy_version 1243953 (0.0006) [2023-12-28 04:11:54,747][106225] Updated weights for policy 1, policy_version 1247054 (0.0007) [2023-12-28 04:11:54,803][106225] Updated weights for policy 1, policy_version 1247065 (0.0009) [2023-12-28 04:11:54,861][106225] Updated weights for policy 1, policy_version 1247075 (0.0005) [2023-12-28 04:11:55,151][106226] Updated weights for policy 0, policy_version 1243963 (0.0006) [2023-12-28 04:11:55,201][106226] Updated weights for policy 0, policy_version 1243973 (0.0010) [2023-12-28 04:11:55,251][106226] Updated weights for policy 0, policy_version 1243983 (0.0007) [2023-12-28 04:11:55,565][106225] Updated weights for policy 1, policy_version 1247085 (0.0008) [2023-12-28 04:11:55,619][106225] Updated weights for policy 1, policy_version 1247095 (0.0010) [2023-12-28 04:11:55,675][106225] Updated weights for policy 1, policy_version 1247105 (0.0010) [2023-12-28 04:11:55,843][106226] Updated weights for policy 0, policy_version 1243993 (0.0006) [2023-12-28 04:11:55,904][106226] Updated weights for policy 0, policy_version 1244003 (0.0008) [2023-12-28 04:11:55,965][106226] Updated weights for policy 0, policy_version 1244013 (0.0005) [2023-12-28 04:11:56,025][106226] Updated weights for policy 0, policy_version 1244023 (0.0006) [2023-12-28 04:11:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 637837312. Throughput: 0: 9781.3, 1: 9994.5. Samples: 637802964. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:11:56,175][105115] Avg episode reward: [(0, '-4.057'), (1, '-4.571')] [2023-12-28 04:11:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001247112_319307776.pth... [2023-12-28 04:11:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001244024_318529536.pth... [2023-12-28 04:11:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001245960_319012864.pth [2023-12-28 04:11:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001242872_318234624.pth [2023-12-28 04:11:56,378][106225] Updated weights for policy 1, policy_version 1247115 (0.0009) [2023-12-28 04:11:56,428][106225] Updated weights for policy 1, policy_version 1247125 (0.0005) [2023-12-28 04:11:56,482][106225] Updated weights for policy 1, policy_version 1247135 (0.0005) [2023-12-28 04:11:56,721][106226] Updated weights for policy 0, policy_version 1244033 (0.0009) [2023-12-28 04:11:56,778][106226] Updated weights for policy 0, policy_version 1244043 (0.0008) [2023-12-28 04:11:56,842][106226] Updated weights for policy 0, policy_version 1244053 (0.0008) [2023-12-28 04:11:57,040][106225] Updated weights for policy 1, policy_version 1247145 (0.0005) [2023-12-28 04:11:57,101][106225] Updated weights for policy 1, policy_version 1247155 (0.0005) [2023-12-28 04:11:57,166][106225] Updated weights for policy 1, policy_version 1247165 (0.0005) [2023-12-28 04:11:57,221][106225] Updated weights for policy 1, policy_version 1247175 (0.0005) [2023-12-28 04:11:57,521][106226] Updated weights for policy 0, policy_version 1244063 (0.0010) [2023-12-28 04:11:57,582][106226] Updated weights for policy 0, policy_version 1244073 (0.0010) [2023-12-28 04:11:57,648][106226] Updated weights for policy 0, policy_version 1244083 (0.0009) [2023-12-28 04:11:57,729][106225] Updated weights for policy 1, policy_version 1247185 (0.0005) [2023-12-28 04:11:57,790][106225] Updated weights for policy 1, policy_version 1247195 (0.0005) [2023-12-28 04:11:57,851][106225] Updated weights for policy 1, policy_version 1247205 (0.0005) [2023-12-28 04:11:58,341][106226] Updated weights for policy 0, policy_version 1244093 (0.0008) [2023-12-28 04:11:58,406][106226] Updated weights for policy 0, policy_version 1244103 (0.0008) [2023-12-28 04:11:58,417][106225] Updated weights for policy 1, policy_version 1247215 (0.0006) [2023-12-28 04:11:58,472][106226] Updated weights for policy 0, policy_version 1244113 (0.0008) [2023-12-28 04:11:58,478][106225] Updated weights for policy 1, policy_version 1247225 (0.0007) [2023-12-28 04:11:58,539][106225] Updated weights for policy 1, policy_version 1247235 (0.0008) [2023-12-28 04:11:59,272][106226] Updated weights for policy 0, policy_version 1244124 (0.0008) [2023-12-28 04:11:59,327][106225] Updated weights for policy 1, policy_version 1247245 (0.0009) [2023-12-28 04:11:59,340][106226] Updated weights for policy 0, policy_version 1244134 (0.0009) [2023-12-28 04:11:59,393][106225] Updated weights for policy 1, policy_version 1247255 (0.0008) [2023-12-28 04:11:59,408][106226] Updated weights for policy 0, policy_version 1244144 (0.0009) [2023-12-28 04:11:59,447][106225] Updated weights for policy 1, policy_version 1247265 (0.0005) [2023-12-28 04:12:00,149][106225] Updated weights for policy 1, policy_version 1247275 (0.0006) [2023-12-28 04:12:00,169][106226] Updated weights for policy 0, policy_version 1244154 (0.0008) [2023-12-28 04:12:00,208][106225] Updated weights for policy 1, policy_version 1247285 (0.0008) [2023-12-28 04:12:00,231][106226] Updated weights for policy 0, policy_version 1244164 (0.0006) [2023-12-28 04:12:00,267][106225] Updated weights for policy 1, policy_version 1247295 (0.0008) [2023-12-28 04:12:00,282][106226] Updated weights for policy 0, policy_version 1244174 (0.0005) [2023-12-28 04:12:00,338][106226] Updated weights for policy 0, policy_version 1244184 (0.0007) [2023-12-28 04:12:00,951][106226] Updated weights for policy 0, policy_version 1244194 (0.0005) [2023-12-28 04:12:01,010][106226] Updated weights for policy 0, policy_version 1244204 (0.0005) [2023-12-28 04:12:01,011][106225] Updated weights for policy 1, policy_version 1247305 (0.0006) [2023-12-28 04:12:01,069][106225] Updated weights for policy 1, policy_version 1247315 (0.0008) [2023-12-28 04:12:01,071][106226] Updated weights for policy 0, policy_version 1244214 (0.0008) [2023-12-28 04:12:01,127][106225] Updated weights for policy 1, policy_version 1247325 (0.0008) [2023-12-28 04:12:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 637935616. Throughput: 0: 9876.3, 1: 10036.0. Samples: 637925952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:01,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-5.122')] [2023-12-28 04:12:01,190][106225] Updated weights for policy 1, policy_version 1247335 (0.0008) [2023-12-28 04:12:01,819][106226] Updated weights for policy 0, policy_version 1244224 (0.0009) [2023-12-28 04:12:01,874][106226] Updated weights for policy 0, policy_version 1244234 (0.0008) [2023-12-28 04:12:01,929][106226] Updated weights for policy 0, policy_version 1244244 (0.0008) [2023-12-28 04:12:01,969][106225] Updated weights for policy 1, policy_version 1247345 (0.0008) [2023-12-28 04:12:02,023][106225] Updated weights for policy 1, policy_version 1247355 (0.0008) [2023-12-28 04:12:02,072][106225] Updated weights for policy 1, policy_version 1247365 (0.0008) [2023-12-28 04:12:02,710][106226] Updated weights for policy 0, policy_version 1244254 (0.0008) [2023-12-28 04:12:02,764][106225] Updated weights for policy 1, policy_version 1247375 (0.0007) [2023-12-28 04:12:02,770][106226] Updated weights for policy 0, policy_version 1244264 (0.0008) [2023-12-28 04:12:02,821][106226] Updated weights for policy 0, policy_version 1244274 (0.0007) [2023-12-28 04:12:02,826][106225] Updated weights for policy 1, policy_version 1247385 (0.0007) [2023-12-28 04:12:02,886][106225] Updated weights for policy 1, policy_version 1247395 (0.0009) [2023-12-28 04:12:03,562][106226] Updated weights for policy 0, policy_version 1244284 (0.0006) [2023-12-28 04:12:03,599][106225] Updated weights for policy 1, policy_version 1247405 (0.0007) [2023-12-28 04:12:03,617][106226] Updated weights for policy 0, policy_version 1244294 (0.0006) [2023-12-28 04:12:03,656][106225] Updated weights for policy 1, policy_version 1247415 (0.0006) [2023-12-28 04:12:03,670][106226] Updated weights for policy 0, policy_version 1244304 (0.0008) [2023-12-28 04:12:03,708][106225] Updated weights for policy 1, policy_version 1247425 (0.0006) [2023-12-28 04:12:04,337][106225] Updated weights for policy 1, policy_version 1247435 (0.0009) [2023-12-28 04:12:04,382][106226] Updated weights for policy 0, policy_version 1244314 (0.0007) [2023-12-28 04:12:04,394][106225] Updated weights for policy 1, policy_version 1247445 (0.0010) [2023-12-28 04:12:04,439][106226] Updated weights for policy 0, policy_version 1244324 (0.0007) [2023-12-28 04:12:04,449][106225] Updated weights for policy 1, policy_version 1247455 (0.0010) [2023-12-28 04:12:04,494][106226] Updated weights for policy 0, policy_version 1244334 (0.0006) [2023-12-28 04:12:04,549][106226] Updated weights for policy 0, policy_version 1244344 (0.0005) [2023-12-28 04:12:05,159][106226] Updated weights for policy 0, policy_version 1244354 (0.0008) [2023-12-28 04:12:05,178][106225] Updated weights for policy 1, policy_version 1247465 (0.0010) [2023-12-28 04:12:05,215][106226] Updated weights for policy 0, policy_version 1244364 (0.0006) [2023-12-28 04:12:05,224][106225] Updated weights for policy 1, policy_version 1247475 (0.0009) [2023-12-28 04:12:05,263][106226] Updated weights for policy 0, policy_version 1244374 (0.0008) [2023-12-28 04:12:05,270][106225] Updated weights for policy 1, policy_version 1247485 (0.0005) [2023-12-28 04:12:05,313][106225] Updated weights for policy 1, policy_version 1247495 (0.0005) [2023-12-28 04:12:05,985][106225] Updated weights for policy 1, policy_version 1247505 (0.0010) [2023-12-28 04:12:06,003][106226] Updated weights for policy 0, policy_version 1244384 (0.0006) [2023-12-28 04:12:06,035][106225] Updated weights for policy 1, policy_version 1247515 (0.0007) [2023-12-28 04:12:06,059][106226] Updated weights for policy 0, policy_version 1244394 (0.0007) [2023-12-28 04:12:06,088][106225] Updated weights for policy 1, policy_version 1247525 (0.0008) [2023-12-28 04:12:06,116][106226] Updated weights for policy 0, policy_version 1244404 (0.0007) [2023-12-28 04:12:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 638042112. Throughput: 0: 9882.8, 1: 10006.7. Samples: 638044996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:06,175][105115] Avg episode reward: [(0, '-4.916'), (1, '-4.508')] [2023-12-28 04:12:06,850][106225] Updated weights for policy 1, policy_version 1247535 (0.0008) [2023-12-28 04:12:06,879][106226] Updated weights for policy 0, policy_version 1244414 (0.0007) [2023-12-28 04:12:06,923][106225] Updated weights for policy 1, policy_version 1247545 (0.0008) [2023-12-28 04:12:06,937][106226] Updated weights for policy 0, policy_version 1244424 (0.0007) [2023-12-28 04:12:06,987][106225] Updated weights for policy 1, policy_version 1247555 (0.0007) [2023-12-28 04:12:06,992][106226] Updated weights for policy 0, policy_version 1244434 (0.0006) [2023-12-28 04:12:07,682][106226] Updated weights for policy 0, policy_version 1244444 (0.0008) [2023-12-28 04:12:07,746][106226] Updated weights for policy 0, policy_version 1244454 (0.0009) [2023-12-28 04:12:07,751][106225] Updated weights for policy 1, policy_version 1247565 (0.0008) [2023-12-28 04:12:07,793][106226] Updated weights for policy 0, policy_version 1244464 (0.0007) [2023-12-28 04:12:07,795][106225] Updated weights for policy 1, policy_version 1247575 (0.0005) [2023-12-28 04:12:07,848][106225] Updated weights for policy 1, policy_version 1247585 (0.0006) [2023-12-28 04:12:08,533][106226] Updated weights for policy 0, policy_version 1244474 (0.0007) [2023-12-28 04:12:08,585][106226] Updated weights for policy 0, policy_version 1244484 (0.0008) [2023-12-28 04:12:08,603][106225] Updated weights for policy 1, policy_version 1247595 (0.0008) [2023-12-28 04:12:08,644][106226] Updated weights for policy 0, policy_version 1244494 (0.0008) [2023-12-28 04:12:08,664][106225] Updated weights for policy 1, policy_version 1247605 (0.0007) [2023-12-28 04:12:08,707][106226] Updated weights for policy 0, policy_version 1244504 (0.0007) [2023-12-28 04:12:08,727][106225] Updated weights for policy 1, policy_version 1247615 (0.0009) [2023-12-28 04:12:09,427][106225] Updated weights for policy 1, policy_version 1247625 (0.0009) [2023-12-28 04:12:09,491][106226] Updated weights for policy 0, policy_version 1244514 (0.0008) [2023-12-28 04:12:09,498][106225] Updated weights for policy 1, policy_version 1247635 (0.0006) [2023-12-28 04:12:09,554][106226] Updated weights for policy 0, policy_version 1244524 (0.0008) [2023-12-28 04:12:09,565][106225] Updated weights for policy 1, policy_version 1247645 (0.0006) [2023-12-28 04:12:09,618][106226] Updated weights for policy 0, policy_version 1244534 (0.0008) [2023-12-28 04:12:09,629][106225] Updated weights for policy 1, policy_version 1247655 (0.0006) [2023-12-28 04:12:10,377][106226] Updated weights for policy 0, policy_version 1244544 (0.0008) [2023-12-28 04:12:10,403][106225] Updated weights for policy 1, policy_version 1247665 (0.0009) [2023-12-28 04:12:10,429][106226] Updated weights for policy 0, policy_version 1244554 (0.0006) [2023-12-28 04:12:10,463][106225] Updated weights for policy 1, policy_version 1247675 (0.0006) [2023-12-28 04:12:10,496][106226] Updated weights for policy 0, policy_version 1244564 (0.0007) [2023-12-28 04:12:10,519][106225] Updated weights for policy 1, policy_version 1247685 (0.0007) [2023-12-28 04:12:11,158][106226] Updated weights for policy 0, policy_version 1244574 (0.0007) [2023-12-28 04:12:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 638124032. Throughput: 0: 9859.7, 1: 10013.2. Samples: 638101724. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:11,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.015')] [2023-12-28 04:12:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001247688_319455232.pth... [2023-12-28 04:12:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001246536_319160320.pth [2023-12-28 04:12:11,219][106226] Updated weights for policy 0, policy_version 1244584 (0.0008) [2023-12-28 04:12:11,274][106226] Updated weights for policy 0, policy_version 1244594 (0.0008) [2023-12-28 04:12:11,303][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001244600_318676992.pth... [2023-12-28 04:12:11,308][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001243448_318382080.pth [2023-12-28 04:12:11,377][106225] Updated weights for policy 1, policy_version 1247695 (0.0008) [2023-12-28 04:12:11,445][106225] Updated weights for policy 1, policy_version 1247705 (0.0008) [2023-12-28 04:12:11,505][106225] Updated weights for policy 1, policy_version 1247715 (0.0008) [2023-12-28 04:12:12,040][106226] Updated weights for policy 0, policy_version 1244604 (0.0008) [2023-12-28 04:12:12,099][106226] Updated weights for policy 0, policy_version 1244614 (0.0009) [2023-12-28 04:12:12,157][106226] Updated weights for policy 0, policy_version 1244624 (0.0009) [2023-12-28 04:12:12,225][106225] Updated weights for policy 1, policy_version 1247725 (0.0008) [2023-12-28 04:12:12,286][106225] Updated weights for policy 1, policy_version 1247735 (0.0008) [2023-12-28 04:12:12,353][106225] Updated weights for policy 1, policy_version 1247745 (0.0009) [2023-12-28 04:12:12,850][106226] Updated weights for policy 0, policy_version 1244634 (0.0007) [2023-12-28 04:12:12,915][106226] Updated weights for policy 0, policy_version 1244644 (0.0008) [2023-12-28 04:12:12,978][106226] Updated weights for policy 0, policy_version 1244654 (0.0008) [2023-12-28 04:12:13,042][106226] Updated weights for policy 0, policy_version 1244664 (0.0009) [2023-12-28 04:12:13,110][106225] Updated weights for policy 1, policy_version 1247755 (0.0007) [2023-12-28 04:12:13,155][106225] Updated weights for policy 1, policy_version 1247765 (0.0005) [2023-12-28 04:12:13,206][106225] Updated weights for policy 1, policy_version 1247775 (0.0005) [2023-12-28 04:12:13,784][106226] Updated weights for policy 0, policy_version 1244674 (0.0009) [2023-12-28 04:12:13,846][106226] Updated weights for policy 0, policy_version 1244684 (0.0009) [2023-12-28 04:12:13,854][106225] Updated weights for policy 1, policy_version 1247785 (0.0006) [2023-12-28 04:12:13,907][106226] Updated weights for policy 0, policy_version 1244694 (0.0010) [2023-12-28 04:12:13,913][106225] Updated weights for policy 1, policy_version 1247795 (0.0007) [2023-12-28 04:12:13,970][106225] Updated weights for policy 1, policy_version 1247805 (0.0008) [2023-12-28 04:12:14,028][106225] Updated weights for policy 1, policy_version 1247815 (0.0005) [2023-12-28 04:12:14,638][106225] Updated weights for policy 1, policy_version 1247825 (0.0008) [2023-12-28 04:12:14,679][106226] Updated weights for policy 0, policy_version 1244704 (0.0008) [2023-12-28 04:12:14,696][106225] Updated weights for policy 1, policy_version 1247835 (0.0007) [2023-12-28 04:12:14,735][106226] Updated weights for policy 0, policy_version 1244714 (0.0007) [2023-12-28 04:12:14,748][106225] Updated weights for policy 1, policy_version 1247845 (0.0008) [2023-12-28 04:12:14,815][106226] Updated weights for policy 0, policy_version 1244724 (0.0009) [2023-12-28 04:12:15,498][106225] Updated weights for policy 1, policy_version 1247855 (0.0010) [2023-12-28 04:12:15,501][106226] Updated weights for policy 0, policy_version 1244734 (0.0010) [2023-12-28 04:12:15,547][106225] Updated weights for policy 1, policy_version 1247865 (0.0010) [2023-12-28 04:12:15,555][106226] Updated weights for policy 0, policy_version 1244744 (0.0010) [2023-12-28 04:12:15,594][106225] Updated weights for policy 1, policy_version 1247875 (0.0010) [2023-12-28 04:12:15,608][106226] Updated weights for policy 0, policy_version 1244754 (0.0010) [2023-12-28 04:12:16,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 638222336. Throughput: 0: 9669.3, 1: 9897.1. Samples: 638214684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:16,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-5.179')] [2023-12-28 04:12:16,223][106226] Updated weights for policy 0, policy_version 1244764 (0.0009) [2023-12-28 04:12:16,289][106226] Updated weights for policy 0, policy_version 1244774 (0.0010) [2023-12-28 04:12:16,315][106225] Updated weights for policy 1, policy_version 1247885 (0.0010) [2023-12-28 04:12:16,345][106226] Updated weights for policy 0, policy_version 1244784 (0.0010) [2023-12-28 04:12:16,365][106225] Updated weights for policy 1, policy_version 1247895 (0.0010) [2023-12-28 04:12:16,414][106225] Updated weights for policy 1, policy_version 1247905 (0.0010) [2023-12-28 04:12:17,020][106226] Updated weights for policy 0, policy_version 1244794 (0.0007) [2023-12-28 04:12:17,076][106226] Updated weights for policy 0, policy_version 1244804 (0.0010) [2023-12-28 04:12:17,138][106226] Updated weights for policy 0, policy_version 1244814 (0.0010) [2023-12-28 04:12:17,145][106225] Updated weights for policy 1, policy_version 1247915 (0.0010) [2023-12-28 04:12:17,192][106225] Updated weights for policy 1, policy_version 1247925 (0.0010) [2023-12-28 04:12:17,194][106226] Updated weights for policy 0, policy_version 1244824 (0.0010) [2023-12-28 04:12:17,244][106225] Updated weights for policy 1, policy_version 1247935 (0.0010) [2023-12-28 04:12:17,784][106226] Updated weights for policy 0, policy_version 1244834 (0.0010) [2023-12-28 04:12:17,850][106226] Updated weights for policy 0, policy_version 1244844 (0.0011) [2023-12-28 04:12:17,910][106226] Updated weights for policy 0, policy_version 1244854 (0.0010) [2023-12-28 04:12:17,978][106225] Updated weights for policy 1, policy_version 1247945 (0.0010) [2023-12-28 04:12:18,038][106225] Updated weights for policy 1, policy_version 1247955 (0.0010) [2023-12-28 04:12:18,097][106225] Updated weights for policy 1, policy_version 1247965 (0.0010) [2023-12-28 04:12:18,153][106225] Updated weights for policy 1, policy_version 1247975 (0.0010) [2023-12-28 04:12:18,509][106226] Updated weights for policy 0, policy_version 1244864 (0.0011) [2023-12-28 04:12:18,575][106226] Updated weights for policy 0, policy_version 1244874 (0.0011) [2023-12-28 04:12:18,633][106226] Updated weights for policy 0, policy_version 1244884 (0.0011) [2023-12-28 04:12:18,908][106225] Updated weights for policy 1, policy_version 1247985 (0.0011) [2023-12-28 04:12:18,973][106225] Updated weights for policy 1, policy_version 1247995 (0.0011) [2023-12-28 04:12:19,033][106225] Updated weights for policy 1, policy_version 1248005 (0.0010) [2023-12-28 04:12:19,287][106226] Updated weights for policy 0, policy_version 1244894 (0.0007) [2023-12-28 04:12:19,356][106226] Updated weights for policy 0, policy_version 1244904 (0.0008) [2023-12-28 04:12:19,420][106226] Updated weights for policy 0, policy_version 1244914 (0.0009) [2023-12-28 04:12:19,774][106225] Updated weights for policy 1, policy_version 1248015 (0.0009) [2023-12-28 04:12:19,839][106225] Updated weights for policy 1, policy_version 1248025 (0.0009) [2023-12-28 04:12:19,909][106225] Updated weights for policy 1, policy_version 1248035 (0.0009) [2023-12-28 04:12:20,149][106226] Updated weights for policy 0, policy_version 1244924 (0.0011) [2023-12-28 04:12:20,216][106226] Updated weights for policy 0, policy_version 1244934 (0.0009) [2023-12-28 04:12:20,286][106226] Updated weights for policy 0, policy_version 1244944 (0.0008) [2023-12-28 04:12:20,668][106225] Updated weights for policy 1, policy_version 1248045 (0.0008) [2023-12-28 04:12:20,730][106225] Updated weights for policy 1, policy_version 1248055 (0.0008) [2023-12-28 04:12:20,787][106225] Updated weights for policy 1, policy_version 1248065 (0.0008) [2023-12-28 04:12:20,984][106226] Updated weights for policy 0, policy_version 1244954 (0.0008) [2023-12-28 04:12:21,057][106226] Updated weights for policy 0, policy_version 1244964 (0.0008) [2023-12-28 04:12:21,124][106226] Updated weights for policy 0, policy_version 1244974 (0.0009) [2023-12-28 04:12:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 638320640. Throughput: 0: 9791.4, 1: 9845.0. Samples: 638334044. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:21,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-5.050')] [2023-12-28 04:12:21,189][106226] Updated weights for policy 0, policy_version 1244984 (0.0008) [2023-12-28 04:12:21,574][106225] Updated weights for policy 1, policy_version 1248075 (0.0008) [2023-12-28 04:12:21,643][106225] Updated weights for policy 1, policy_version 1248085 (0.0012) [2023-12-28 04:12:21,707][106225] Updated weights for policy 1, policy_version 1248095 (0.0008) [2023-12-28 04:12:21,887][106226] Updated weights for policy 0, policy_version 1244994 (0.0008) [2023-12-28 04:12:21,952][106226] Updated weights for policy 0, policy_version 1245004 (0.0008) [2023-12-28 04:12:22,015][106226] Updated weights for policy 0, policy_version 1245014 (0.0008) [2023-12-28 04:12:22,438][106225] Updated weights for policy 1, policy_version 1248105 (0.0007) [2023-12-28 04:12:22,510][106225] Updated weights for policy 1, policy_version 1248115 (0.0008) [2023-12-28 04:12:22,579][106225] Updated weights for policy 1, policy_version 1248125 (0.0008) [2023-12-28 04:12:22,646][106225] Updated weights for policy 1, policy_version 1248135 (0.0008) [2023-12-28 04:12:22,775][106226] Updated weights for policy 0, policy_version 1245024 (0.0008) [2023-12-28 04:12:22,824][106226] Updated weights for policy 0, policy_version 1245034 (0.0008) [2023-12-28 04:12:22,887][106226] Updated weights for policy 0, policy_version 1245044 (0.0007) [2023-12-28 04:12:23,266][106225] Updated weights for policy 1, policy_version 1248145 (0.0006) [2023-12-28 04:12:23,321][106225] Updated weights for policy 1, policy_version 1248155 (0.0005) [2023-12-28 04:12:23,367][106225] Updated weights for policy 1, policy_version 1248165 (0.0008) [2023-12-28 04:12:23,561][106226] Updated weights for policy 0, policy_version 1245054 (0.0007) [2023-12-28 04:12:23,619][106226] Updated weights for policy 0, policy_version 1245064 (0.0008) [2023-12-28 04:12:23,675][106226] Updated weights for policy 0, policy_version 1245074 (0.0009) [2023-12-28 04:12:24,011][106225] Updated weights for policy 1, policy_version 1248175 (0.0008) [2023-12-28 04:12:24,075][106225] Updated weights for policy 1, policy_version 1248185 (0.0008) [2023-12-28 04:12:24,131][106225] Updated weights for policy 1, policy_version 1248195 (0.0008) [2023-12-28 04:12:24,454][106226] Updated weights for policy 0, policy_version 1245084 (0.0009) [2023-12-28 04:12:24,513][106226] Updated weights for policy 0, policy_version 1245094 (0.0008) [2023-12-28 04:12:24,580][106226] Updated weights for policy 0, policy_version 1245104 (0.0005) [2023-12-28 04:12:24,700][106225] Updated weights for policy 1, policy_version 1248205 (0.0007) [2023-12-28 04:12:24,747][106225] Updated weights for policy 1, policy_version 1248215 (0.0010) [2023-12-28 04:12:24,800][106225] Updated weights for policy 1, policy_version 1248225 (0.0010) [2023-12-28 04:12:25,211][106226] Updated weights for policy 0, policy_version 1245114 (0.0005) [2023-12-28 04:12:25,273][106226] Updated weights for policy 0, policy_version 1245124 (0.0009) [2023-12-28 04:12:25,327][106226] Updated weights for policy 0, policy_version 1245134 (0.0007) [2023-12-28 04:12:25,375][106226] Updated weights for policy 0, policy_version 1245144 (0.0007) [2023-12-28 04:12:25,532][106225] Updated weights for policy 1, policy_version 1248235 (0.0010) [2023-12-28 04:12:25,585][106225] Updated weights for policy 1, policy_version 1248245 (0.0010) [2023-12-28 04:12:25,635][106225] Updated weights for policy 1, policy_version 1248255 (0.0010) [2023-12-28 04:12:26,043][106226] Updated weights for policy 0, policy_version 1245154 (0.0006) [2023-12-28 04:12:26,089][106226] Updated weights for policy 0, policy_version 1245164 (0.0010) [2023-12-28 04:12:26,136][106226] Updated weights for policy 0, policy_version 1245174 (0.0010) [2023-12-28 04:12:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 638427136. Throughput: 0: 9821.8, 1: 9790.3. Samples: 638391252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:26,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.853')] [2023-12-28 04:12:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001248264_319602688.pth... [2023-12-28 04:12:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001245176_318824448.pth... [2023-12-28 04:12:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001247112_319307776.pth [2023-12-28 04:12:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001244024_318529536.pth [2023-12-28 04:12:26,332][106225] Updated weights for policy 1, policy_version 1248265 (0.0009) [2023-12-28 04:12:26,386][106225] Updated weights for policy 1, policy_version 1248275 (0.0009) [2023-12-28 04:12:26,436][106225] Updated weights for policy 1, policy_version 1248285 (0.0010) [2023-12-28 04:12:26,486][106225] Updated weights for policy 1, policy_version 1248295 (0.0010) [2023-12-28 04:12:26,752][106226] Updated weights for policy 0, policy_version 1245185 (0.0009) [2023-12-28 04:12:26,807][106226] Updated weights for policy 0, policy_version 1245195 (0.0005) [2023-12-28 04:12:26,873][106226] Updated weights for policy 0, policy_version 1245205 (0.0005) [2023-12-28 04:12:27,195][106225] Updated weights for policy 1, policy_version 1248305 (0.0010) [2023-12-28 04:12:27,244][106225] Updated weights for policy 1, policy_version 1248315 (0.0010) [2023-12-28 04:12:27,293][106225] Updated weights for policy 1, policy_version 1248325 (0.0010) [2023-12-28 04:12:27,547][106226] Updated weights for policy 0, policy_version 1245215 (0.0007) [2023-12-28 04:12:27,600][106226] Updated weights for policy 0, policy_version 1245225 (0.0007) [2023-12-28 04:12:27,659][106226] Updated weights for policy 0, policy_version 1245235 (0.0005) [2023-12-28 04:12:28,033][106225] Updated weights for policy 1, policy_version 1248335 (0.0010) [2023-12-28 04:12:28,096][106225] Updated weights for policy 1, policy_version 1248345 (0.0010) [2023-12-28 04:12:28,147][106225] Updated weights for policy 1, policy_version 1248355 (0.0010) [2023-12-28 04:12:28,242][106226] Updated weights for policy 0, policy_version 1245245 (0.0005) [2023-12-28 04:12:28,284][106226] Updated weights for policy 0, policy_version 1245255 (0.0008) [2023-12-28 04:12:28,340][106226] Updated weights for policy 0, policy_version 1245265 (0.0007) [2023-12-28 04:12:28,866][106225] Updated weights for policy 1, policy_version 1248365 (0.0009) [2023-12-28 04:12:28,926][106225] Updated weights for policy 1, policy_version 1248375 (0.0008) [2023-12-28 04:12:28,982][106225] Updated weights for policy 1, policy_version 1248385 (0.0009) [2023-12-28 04:12:29,034][106226] Updated weights for policy 0, policy_version 1245275 (0.0009) [2023-12-28 04:12:29,086][106226] Updated weights for policy 0, policy_version 1245285 (0.0008) [2023-12-28 04:12:29,140][106226] Updated weights for policy 0, policy_version 1245295 (0.0008) [2023-12-28 04:12:29,694][106225] Updated weights for policy 1, policy_version 1248395 (0.0007) [2023-12-28 04:12:29,743][106225] Updated weights for policy 1, policy_version 1248405 (0.0008) [2023-12-28 04:12:29,801][106225] Updated weights for policy 1, policy_version 1248415 (0.0008) [2023-12-28 04:12:29,921][106226] Updated weights for policy 0, policy_version 1245305 (0.0008) [2023-12-28 04:12:30,006][106226] Updated weights for policy 0, policy_version 1245315 (0.0008) [2023-12-28 04:12:30,063][106226] Updated weights for policy 0, policy_version 1245325 (0.0008) [2023-12-28 04:12:30,112][106226] Updated weights for policy 0, policy_version 1245335 (0.0008) [2023-12-28 04:12:30,501][106225] Updated weights for policy 1, policy_version 1248425 (0.0008) [2023-12-28 04:12:30,556][106225] Updated weights for policy 1, policy_version 1248435 (0.0008) [2023-12-28 04:12:30,610][106225] Updated weights for policy 1, policy_version 1248445 (0.0008) [2023-12-28 04:12:30,668][106225] Updated weights for policy 1, policy_version 1248455 (0.0008) [2023-12-28 04:12:30,857][106226] Updated weights for policy 0, policy_version 1245345 (0.0009) [2023-12-28 04:12:30,908][106226] Updated weights for policy 0, policy_version 1245355 (0.0009) [2023-12-28 04:12:30,955][106226] Updated weights for policy 0, policy_version 1245365 (0.0008) [2023-12-28 04:12:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 638525440. Throughput: 0: 9924.6, 1: 9814.3. Samples: 638513692. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:31,175][105115] Avg episode reward: [(0, '-4.076'), (1, '-4.850')] [2023-12-28 04:12:31,380][106225] Updated weights for policy 1, policy_version 1248465 (0.0008) [2023-12-28 04:12:31,425][106225] Updated weights for policy 1, policy_version 1248475 (0.0008) [2023-12-28 04:12:31,472][106225] Updated weights for policy 1, policy_version 1248485 (0.0009) [2023-12-28 04:12:31,698][106226] Updated weights for policy 0, policy_version 1245375 (0.0006) [2023-12-28 04:12:31,762][106226] Updated weights for policy 0, policy_version 1245385 (0.0007) [2023-12-28 04:12:31,821][106226] Updated weights for policy 0, policy_version 1245395 (0.0008) [2023-12-28 04:12:32,218][106225] Updated weights for policy 1, policy_version 1248495 (0.0008) [2023-12-28 04:12:32,281][106225] Updated weights for policy 1, policy_version 1248505 (0.0009) [2023-12-28 04:12:32,349][106225] Updated weights for policy 1, policy_version 1248515 (0.0009) [2023-12-28 04:12:32,548][106226] Updated weights for policy 0, policy_version 1245405 (0.0008) [2023-12-28 04:12:32,616][106226] Updated weights for policy 0, policy_version 1245415 (0.0008) [2023-12-28 04:12:32,674][106226] Updated weights for policy 0, policy_version 1245425 (0.0007) [2023-12-28 04:12:33,061][106225] Updated weights for policy 1, policy_version 1248525 (0.0008) [2023-12-28 04:12:33,107][106225] Updated weights for policy 1, policy_version 1248535 (0.0005) [2023-12-28 04:12:33,152][106225] Updated weights for policy 1, policy_version 1248545 (0.0005) [2023-12-28 04:12:33,413][106226] Updated weights for policy 0, policy_version 1245435 (0.0008) [2023-12-28 04:12:33,474][106226] Updated weights for policy 0, policy_version 1245445 (0.0009) [2023-12-28 04:12:33,521][106226] Updated weights for policy 0, policy_version 1245455 (0.0007) [2023-12-28 04:12:33,739][106225] Updated weights for policy 1, policy_version 1248555 (0.0006) [2023-12-28 04:12:33,792][106225] Updated weights for policy 1, policy_version 1248565 (0.0005) [2023-12-28 04:12:33,844][106225] Updated weights for policy 1, policy_version 1248575 (0.0005) [2023-12-28 04:12:34,348][106226] Updated weights for policy 0, policy_version 1245465 (0.0008) [2023-12-28 04:12:34,411][106226] Updated weights for policy 0, policy_version 1245475 (0.0009) [2023-12-28 04:12:34,472][106226] Updated weights for policy 0, policy_version 1245485 (0.0007) [2023-12-28 04:12:34,473][106225] Updated weights for policy 1, policy_version 1248585 (0.0006) [2023-12-28 04:12:34,530][106226] Updated weights for policy 0, policy_version 1245495 (0.0007) [2023-12-28 04:12:34,543][106225] Updated weights for policy 1, policy_version 1248595 (0.0007) [2023-12-28 04:12:34,612][106225] Updated weights for policy 1, policy_version 1248605 (0.0009) [2023-12-28 04:12:34,682][106225] Updated weights for policy 1, policy_version 1248615 (0.0009) [2023-12-28 04:12:35,184][106226] Updated weights for policy 0, policy_version 1245505 (0.0007) [2023-12-28 04:12:35,232][106226] Updated weights for policy 0, policy_version 1245515 (0.0009) [2023-12-28 04:12:35,258][106225] Updated weights for policy 1, policy_version 1248625 (0.0006) [2023-12-28 04:12:35,282][106226] Updated weights for policy 0, policy_version 1245525 (0.0009) [2023-12-28 04:12:35,314][106225] Updated weights for policy 1, policy_version 1248635 (0.0005) [2023-12-28 04:12:35,363][106225] Updated weights for policy 1, policy_version 1248645 (0.0005) [2023-12-28 04:12:35,940][106226] Updated weights for policy 0, policy_version 1245535 (0.0008) [2023-12-28 04:12:35,999][106226] Updated weights for policy 0, policy_version 1245545 (0.0009) [2023-12-28 04:12:36,062][106226] Updated weights for policy 0, policy_version 1245555 (0.0008) [2023-12-28 04:12:36,085][106225] Updated weights for policy 1, policy_version 1248655 (0.0006) [2023-12-28 04:12:36,163][106225] Updated weights for policy 1, policy_version 1248665 (0.0008) [2023-12-28 04:12:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 638623744. Throughput: 0: 9848.4, 1: 9887.9. Samples: 638633096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:36,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.931')] [2023-12-28 04:12:36,231][106225] Updated weights for policy 1, policy_version 1248675 (0.0008) [2023-12-28 04:12:36,802][106226] Updated weights for policy 0, policy_version 1245565 (0.0009) [2023-12-28 04:12:36,865][106226] Updated weights for policy 0, policy_version 1245575 (0.0009) [2023-12-28 04:12:36,903][106225] Updated weights for policy 1, policy_version 1248685 (0.0007) [2023-12-28 04:12:36,931][106226] Updated weights for policy 0, policy_version 1245585 (0.0008) [2023-12-28 04:12:36,964][106225] Updated weights for policy 1, policy_version 1248695 (0.0006) [2023-12-28 04:12:37,025][106225] Updated weights for policy 1, policy_version 1248705 (0.0008) [2023-12-28 04:12:37,723][106226] Updated weights for policy 0, policy_version 1245595 (0.0008) [2023-12-28 04:12:37,738][106225] Updated weights for policy 1, policy_version 1248715 (0.0008) [2023-12-28 04:12:37,777][106226] Updated weights for policy 0, policy_version 1245605 (0.0006) [2023-12-28 04:12:37,791][106225] Updated weights for policy 1, policy_version 1248725 (0.0006) [2023-12-28 04:12:37,825][106226] Updated weights for policy 0, policy_version 1245615 (0.0006) [2023-12-28 04:12:37,850][106225] Updated weights for policy 1, policy_version 1248735 (0.0007) [2023-12-28 04:12:38,507][106225] Updated weights for policy 1, policy_version 1248745 (0.0006) [2023-12-28 04:12:38,532][106226] Updated weights for policy 0, policy_version 1245625 (0.0006) [2023-12-28 04:12:38,565][106225] Updated weights for policy 1, policy_version 1248755 (0.0009) [2023-12-28 04:12:38,590][106226] Updated weights for policy 0, policy_version 1245635 (0.0008) [2023-12-28 04:12:38,620][106225] Updated weights for policy 1, policy_version 1248765 (0.0006) [2023-12-28 04:12:38,647][106226] Updated weights for policy 0, policy_version 1245645 (0.0006) [2023-12-28 04:12:38,680][106225] Updated weights for policy 1, policy_version 1248775 (0.0007) [2023-12-28 04:12:38,710][106226] Updated weights for policy 0, policy_version 1245655 (0.0008) [2023-12-28 04:12:39,358][106225] Updated weights for policy 1, policy_version 1248785 (0.0009) [2023-12-28 04:12:39,428][106225] Updated weights for policy 1, policy_version 1248795 (0.0008) [2023-12-28 04:12:39,477][106226] Updated weights for policy 0, policy_version 1245665 (0.0008) [2023-12-28 04:12:39,491][106225] Updated weights for policy 1, policy_version 1248805 (0.0006) [2023-12-28 04:12:39,536][106226] Updated weights for policy 0, policy_version 1245675 (0.0009) [2023-12-28 04:12:39,602][106226] Updated weights for policy 0, policy_version 1245685 (0.0008) [2023-12-28 04:12:40,143][106225] Updated weights for policy 1, policy_version 1248815 (0.0009) [2023-12-28 04:12:40,213][106225] Updated weights for policy 1, policy_version 1248825 (0.0011) [2023-12-28 04:12:40,282][106225] Updated weights for policy 1, policy_version 1248835 (0.0011) [2023-12-28 04:12:40,449][106226] Updated weights for policy 0, policy_version 1245695 (0.0008) [2023-12-28 04:12:40,511][106226] Updated weights for policy 0, policy_version 1245705 (0.0008) [2023-12-28 04:12:40,571][106226] Updated weights for policy 0, policy_version 1245715 (0.0008) [2023-12-28 04:12:40,983][106225] Updated weights for policy 1, policy_version 1248845 (0.0010) [2023-12-28 04:12:41,053][106225] Updated weights for policy 1, policy_version 1248855 (0.0010) [2023-12-28 04:12:41,145][106225] Updated weights for policy 1, policy_version 1248865 (0.0009) [2023-12-28 04:12:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 638713856. Throughput: 0: 9829.2, 1: 9901.9. Samples: 638690860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:41,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.893')] [2023-12-28 04:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001245720_318963712.pth... [2023-12-28 04:12:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001248872_319758336.pth... [2023-12-28 04:12:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001244600_318676992.pth [2023-12-28 04:12:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001247688_319455232.pth [2023-12-28 04:12:41,320][106226] Updated weights for policy 0, policy_version 1245725 (0.0007) [2023-12-28 04:12:41,398][106226] Updated weights for policy 0, policy_version 1245735 (0.0008) [2023-12-28 04:12:41,461][106226] Updated weights for policy 0, policy_version 1245745 (0.0008) [2023-12-28 04:12:41,873][106225] Updated weights for policy 1, policy_version 1248875 (0.0008) [2023-12-28 04:12:41,920][106225] Updated weights for policy 1, policy_version 1248885 (0.0005) [2023-12-28 04:12:41,979][106225] Updated weights for policy 1, policy_version 1248895 (0.0006) [2023-12-28 04:12:42,211][106226] Updated weights for policy 0, policy_version 1245755 (0.0008) [2023-12-28 04:12:42,268][106226] Updated weights for policy 0, policy_version 1245765 (0.0009) [2023-12-28 04:12:42,338][106226] Updated weights for policy 0, policy_version 1245775 (0.0010) [2023-12-28 04:12:42,700][106225] Updated weights for policy 1, policy_version 1248905 (0.0006) [2023-12-28 04:12:42,748][106225] Updated weights for policy 1, policy_version 1248915 (0.0008) [2023-12-28 04:12:42,794][106225] Updated weights for policy 1, policy_version 1248925 (0.0008) [2023-12-28 04:12:42,844][106225] Updated weights for policy 1, policy_version 1248935 (0.0008) [2023-12-28 04:12:43,056][106226] Updated weights for policy 0, policy_version 1245785 (0.0007) [2023-12-28 04:12:43,126][106226] Updated weights for policy 0, policy_version 1245795 (0.0011) [2023-12-28 04:12:43,191][106226] Updated weights for policy 0, policy_version 1245805 (0.0011) [2023-12-28 04:12:43,256][106226] Updated weights for policy 0, policy_version 1245815 (0.0011) [2023-12-28 04:12:43,514][106225] Updated weights for policy 1, policy_version 1248945 (0.0007) [2023-12-28 04:12:43,575][106225] Updated weights for policy 1, policy_version 1248955 (0.0008) [2023-12-28 04:12:43,638][106225] Updated weights for policy 1, policy_version 1248965 (0.0007) [2023-12-28 04:12:43,943][106226] Updated weights for policy 0, policy_version 1245825 (0.0009) [2023-12-28 04:12:43,998][106226] Updated weights for policy 0, policy_version 1245835 (0.0005) [2023-12-28 04:12:44,056][106226] Updated weights for policy 0, policy_version 1245845 (0.0005) [2023-12-28 04:12:44,330][106225] Updated weights for policy 1, policy_version 1248975 (0.0008) [2023-12-28 04:12:44,386][106225] Updated weights for policy 1, policy_version 1248985 (0.0008) [2023-12-28 04:12:44,437][106225] Updated weights for policy 1, policy_version 1248995 (0.0006) [2023-12-28 04:12:44,704][106226] Updated weights for policy 0, policy_version 1245855 (0.0009) [2023-12-28 04:12:44,760][106226] Updated weights for policy 0, policy_version 1245865 (0.0010) [2023-12-28 04:12:44,823][106226] Updated weights for policy 0, policy_version 1245875 (0.0011) [2023-12-28 04:12:45,098][106225] Updated weights for policy 1, policy_version 1249005 (0.0007) [2023-12-28 04:12:45,163][106225] Updated weights for policy 1, policy_version 1249015 (0.0008) [2023-12-28 04:12:45,230][106225] Updated weights for policy 1, policy_version 1249025 (0.0008) [2023-12-28 04:12:45,581][106226] Updated weights for policy 0, policy_version 1245885 (0.0011) [2023-12-28 04:12:45,642][106226] Updated weights for policy 0, policy_version 1245895 (0.0011) [2023-12-28 04:12:45,705][106226] Updated weights for policy 0, policy_version 1245905 (0.0011) [2023-12-28 04:12:45,874][106225] Updated weights for policy 1, policy_version 1249035 (0.0008) [2023-12-28 04:12:45,934][106225] Updated weights for policy 1, policy_version 1249045 (0.0008) [2023-12-28 04:12:45,988][106225] Updated weights for policy 1, policy_version 1249055 (0.0008) [2023-12-28 04:12:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 638820352. Throughput: 0: 9746.4, 1: 9841.4. Samples: 638807404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:46,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-4.884')] [2023-12-28 04:12:46,412][106226] Updated weights for policy 0, policy_version 1245915 (0.0009) [2023-12-28 04:12:46,476][106226] Updated weights for policy 0, policy_version 1245925 (0.0006) [2023-12-28 04:12:46,523][106226] Updated weights for policy 0, policy_version 1245935 (0.0010) [2023-12-28 04:12:46,688][106225] Updated weights for policy 1, policy_version 1249065 (0.0008) [2023-12-28 04:12:46,734][106225] Updated weights for policy 1, policy_version 1249075 (0.0010) [2023-12-28 04:12:46,787][106225] Updated weights for policy 1, policy_version 1249085 (0.0010) [2023-12-28 04:12:46,833][106225] Updated weights for policy 1, policy_version 1249095 (0.0010) [2023-12-28 04:12:47,121][106226] Updated weights for policy 0, policy_version 1245945 (0.0010) [2023-12-28 04:12:47,176][106226] Updated weights for policy 0, policy_version 1245955 (0.0005) [2023-12-28 04:12:47,229][106226] Updated weights for policy 0, policy_version 1245965 (0.0010) [2023-12-28 04:12:47,279][106226] Updated weights for policy 0, policy_version 1245975 (0.0010) [2023-12-28 04:12:47,596][106225] Updated weights for policy 1, policy_version 1249105 (0.0006) [2023-12-28 04:12:47,662][106225] Updated weights for policy 1, policy_version 1249115 (0.0007) [2023-12-28 04:12:47,713][106225] Updated weights for policy 1, policy_version 1249125 (0.0010) [2023-12-28 04:12:47,903][106226] Updated weights for policy 0, policy_version 1245985 (0.0006) [2023-12-28 04:12:47,959][106226] Updated weights for policy 0, policy_version 1245995 (0.0006) [2023-12-28 04:12:48,015][106226] Updated weights for policy 0, policy_version 1246005 (0.0006) [2023-12-28 04:12:48,338][106225] Updated weights for policy 1, policy_version 1249135 (0.0010) [2023-12-28 04:12:48,402][106225] Updated weights for policy 1, policy_version 1249145 (0.0008) [2023-12-28 04:12:48,457][106225] Updated weights for policy 1, policy_version 1249155 (0.0006) [2023-12-28 04:12:48,643][106226] Updated weights for policy 0, policy_version 1246015 (0.0008) [2023-12-28 04:12:48,696][106226] Updated weights for policy 0, policy_version 1246025 (0.0009) [2023-12-28 04:12:48,760][106226] Updated weights for policy 0, policy_version 1246035 (0.0007) [2023-12-28 04:12:49,165][106225] Updated weights for policy 1, policy_version 1249165 (0.0009) [2023-12-28 04:12:49,217][106225] Updated weights for policy 1, policy_version 1249175 (0.0010) [2023-12-28 04:12:49,278][106225] Updated weights for policy 1, policy_version 1249185 (0.0010) [2023-12-28 04:12:49,490][106226] Updated weights for policy 0, policy_version 1246045 (0.0008) [2023-12-28 04:12:49,544][106226] Updated weights for policy 0, policy_version 1246055 (0.0007) [2023-12-28 04:12:49,599][106226] Updated weights for policy 0, policy_version 1246065 (0.0008) [2023-12-28 04:12:50,056][106225] Updated weights for policy 1, policy_version 1249195 (0.0010) [2023-12-28 04:12:50,115][106225] Updated weights for policy 1, policy_version 1249205 (0.0008) [2023-12-28 04:12:50,206][106225] Updated weights for policy 1, policy_version 1249215 (0.0008) [2023-12-28 04:12:50,309][106226] Updated weights for policy 0, policy_version 1246075 (0.0007) [2023-12-28 04:12:50,369][106226] Updated weights for policy 0, policy_version 1246085 (0.0008) [2023-12-28 04:12:50,435][106226] Updated weights for policy 0, policy_version 1246095 (0.0008) [2023-12-28 04:12:50,974][106225] Updated weights for policy 1, policy_version 1249225 (0.0010) [2023-12-28 04:12:51,029][106225] Updated weights for policy 1, policy_version 1249235 (0.0009) [2023-12-28 04:12:51,062][106226] Updated weights for policy 0, policy_version 1246105 (0.0007) [2023-12-28 04:12:51,094][106225] Updated weights for policy 1, policy_version 1249245 (0.0008) [2023-12-28 04:12:51,131][106226] Updated weights for policy 0, policy_version 1246115 (0.0008) [2023-12-28 04:12:51,155][106225] Updated weights for policy 1, policy_version 1249255 (0.0008) [2023-12-28 04:12:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 638918656. Throughput: 0: 9794.8, 1: 9822.6. Samples: 638927780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:51,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.751')] [2023-12-28 04:12:51,200][106226] Updated weights for policy 0, policy_version 1246125 (0.0007) [2023-12-28 04:12:51,269][106226] Updated weights for policy 0, policy_version 1246135 (0.0008) [2023-12-28 04:12:51,940][106225] Updated weights for policy 1, policy_version 1249265 (0.0006) [2023-12-28 04:12:51,953][106226] Updated weights for policy 0, policy_version 1246145 (0.0008) [2023-12-28 04:12:51,999][106225] Updated weights for policy 1, policy_version 1249275 (0.0007) [2023-12-28 04:12:52,016][106226] Updated weights for policy 0, policy_version 1246155 (0.0008) [2023-12-28 04:12:52,049][106225] Updated weights for policy 1, policy_version 1249285 (0.0007) [2023-12-28 04:12:52,082][106226] Updated weights for policy 0, policy_version 1246165 (0.0006) [2023-12-28 04:12:52,739][106225] Updated weights for policy 1, policy_version 1249295 (0.0009) [2023-12-28 04:12:52,742][106226] Updated weights for policy 0, policy_version 1246175 (0.0005) [2023-12-28 04:12:52,798][106226] Updated weights for policy 0, policy_version 1246185 (0.0006) [2023-12-28 04:12:52,804][106225] Updated weights for policy 1, policy_version 1249305 (0.0007) [2023-12-28 04:12:52,850][106226] Updated weights for policy 0, policy_version 1246195 (0.0007) [2023-12-28 04:12:52,861][106225] Updated weights for policy 1, policy_version 1249315 (0.0009) [2023-12-28 04:12:53,536][106225] Updated weights for policy 1, policy_version 1249325 (0.0005) [2023-12-28 04:12:53,583][106226] Updated weights for policy 0, policy_version 1246205 (0.0009) [2023-12-28 04:12:53,589][106225] Updated weights for policy 1, policy_version 1249335 (0.0005) [2023-12-28 04:12:53,633][106226] Updated weights for policy 0, policy_version 1246215 (0.0008) [2023-12-28 04:12:53,648][106225] Updated weights for policy 1, policy_version 1249345 (0.0005) [2023-12-28 04:12:53,688][106226] Updated weights for policy 0, policy_version 1246225 (0.0008) [2023-12-28 04:12:54,165][106225] Updated weights for policy 1, policy_version 1249355 (0.0005) [2023-12-28 04:12:54,233][106225] Updated weights for policy 1, policy_version 1249365 (0.0005) [2023-12-28 04:12:54,293][106225] Updated weights for policy 1, policy_version 1249375 (0.0005) [2023-12-28 04:12:54,574][106226] Updated weights for policy 0, policy_version 1246235 (0.0007) [2023-12-28 04:12:54,625][106226] Updated weights for policy 0, policy_version 1246245 (0.0008) [2023-12-28 04:12:54,672][106226] Updated weights for policy 0, policy_version 1246255 (0.0008) [2023-12-28 04:12:54,902][106225] Updated weights for policy 1, policy_version 1249385 (0.0006) [2023-12-28 04:12:54,949][106225] Updated weights for policy 1, policy_version 1249395 (0.0010) [2023-12-28 04:12:54,997][106225] Updated weights for policy 1, policy_version 1249405 (0.0010) [2023-12-28 04:12:55,043][106225] Updated weights for policy 1, policy_version 1249415 (0.0005) [2023-12-28 04:12:55,440][106226] Updated weights for policy 0, policy_version 1246265 (0.0006) [2023-12-28 04:12:55,498][106226] Updated weights for policy 0, policy_version 1246275 (0.0009) [2023-12-28 04:12:55,548][106226] Updated weights for policy 0, policy_version 1246285 (0.0008) [2023-12-28 04:12:55,598][106226] Updated weights for policy 0, policy_version 1246296 (0.0010) [2023-12-28 04:12:55,643][106225] Updated weights for policy 1, policy_version 1249425 (0.0009) [2023-12-28 04:12:55,689][106225] Updated weights for policy 1, policy_version 1249435 (0.0010) [2023-12-28 04:12:55,743][106225] Updated weights for policy 1, policy_version 1249445 (0.0010) [2023-12-28 04:12:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 639016960. Throughput: 0: 9793.6, 1: 9850.1. Samples: 638985692. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:12:56,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-4.899')] [2023-12-28 04:12:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001249448_319905792.pth... [2023-12-28 04:12:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001246296_319111168.pth... [2023-12-28 04:12:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001248264_319602688.pth [2023-12-28 04:12:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001245176_318824448.pth [2023-12-28 04:12:56,397][106226] Updated weights for policy 0, policy_version 1246306 (0.0009) [2023-12-28 04:12:56,433][106225] Updated weights for policy 1, policy_version 1249455 (0.0010) [2023-12-28 04:12:56,455][106226] Updated weights for policy 0, policy_version 1246316 (0.0008) [2023-12-28 04:12:56,490][106225] Updated weights for policy 1, policy_version 1249465 (0.0006) [2023-12-28 04:12:56,515][106226] Updated weights for policy 0, policy_version 1246326 (0.0008) [2023-12-28 04:12:56,539][106225] Updated weights for policy 1, policy_version 1249475 (0.0005) [2023-12-28 04:12:57,043][106225] Updated weights for policy 1, policy_version 1249485 (0.0005) [2023-12-28 04:12:57,088][106225] Updated weights for policy 1, policy_version 1249495 (0.0010) [2023-12-28 04:12:57,134][106225] Updated weights for policy 1, policy_version 1249505 (0.0010) [2023-12-28 04:12:57,320][106226] Updated weights for policy 0, policy_version 1246336 (0.0010) [2023-12-28 04:12:57,377][106226] Updated weights for policy 0, policy_version 1246346 (0.0008) [2023-12-28 04:12:57,430][106226] Updated weights for policy 0, policy_version 1246356 (0.0009) [2023-12-28 04:12:57,798][106225] Updated weights for policy 1, policy_version 1249515 (0.0010) [2023-12-28 04:12:57,842][106225] Updated weights for policy 1, policy_version 1249525 (0.0008) [2023-12-28 04:12:57,890][106225] Updated weights for policy 1, policy_version 1249535 (0.0008) [2023-12-28 04:12:58,173][106226] Updated weights for policy 0, policy_version 1246366 (0.0009) [2023-12-28 04:12:58,229][106226] Updated weights for policy 0, policy_version 1246376 (0.0011) [2023-12-28 04:12:58,294][106226] Updated weights for policy 0, policy_version 1246386 (0.0011) [2023-12-28 04:12:58,684][106225] Updated weights for policy 1, policy_version 1249545 (0.0008) [2023-12-28 04:12:58,747][106225] Updated weights for policy 1, policy_version 1249555 (0.0007) [2023-12-28 04:12:58,812][106225] Updated weights for policy 1, policy_version 1249565 (0.0008) [2023-12-28 04:12:58,880][106225] Updated weights for policy 1, policy_version 1249575 (0.0008) [2023-12-28 04:12:59,165][106226] Updated weights for policy 0, policy_version 1246396 (0.0009) [2023-12-28 04:12:59,229][106226] Updated weights for policy 0, policy_version 1246406 (0.0008) [2023-12-28 04:12:59,301][106226] Updated weights for policy 0, policy_version 1246416 (0.0007) [2023-12-28 04:12:59,688][106225] Updated weights for policy 1, policy_version 1249585 (0.0006) [2023-12-28 04:12:59,740][106225] Updated weights for policy 1, policy_version 1249595 (0.0005) [2023-12-28 04:12:59,801][106225] Updated weights for policy 1, policy_version 1249605 (0.0006) [2023-12-28 04:13:00,055][106226] Updated weights for policy 0, policy_version 1246426 (0.0008) [2023-12-28 04:13:00,117][106226] Updated weights for policy 0, policy_version 1246436 (0.0005) [2023-12-28 04:13:00,172][106226] Updated weights for policy 0, policy_version 1246446 (0.0005) [2023-12-28 04:13:00,234][106226] Updated weights for policy 0, policy_version 1246456 (0.0008) [2023-12-28 04:13:00,561][106225] Updated weights for policy 1, policy_version 1249615 (0.0008) [2023-12-28 04:13:00,608][106225] Updated weights for policy 1, policy_version 1249625 (0.0007) [2023-12-28 04:13:00,651][106225] Updated weights for policy 1, policy_version 1249635 (0.0008) [2023-12-28 04:13:00,840][106226] Updated weights for policy 0, policy_version 1246466 (0.0005) [2023-12-28 04:13:00,898][106226] Updated weights for policy 0, policy_version 1246476 (0.0005) [2023-12-28 04:13:00,954][106226] Updated weights for policy 0, policy_version 1246486 (0.0005) [2023-12-28 04:13:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 639115264. Throughput: 0: 9756.5, 1: 9998.5. Samples: 639103656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:13:01,175][105115] Avg episode reward: [(0, '-4.132'), (1, '-4.722')] [2023-12-28 04:13:01,410][106225] Updated weights for policy 1, policy_version 1249645 (0.0009) [2023-12-28 04:13:01,472][106225] Updated weights for policy 1, policy_version 1249655 (0.0012) [2023-12-28 04:13:01,534][106225] Updated weights for policy 1, policy_version 1249665 (0.0008) [2023-12-28 04:13:01,614][106226] Updated weights for policy 0, policy_version 1246496 (0.0008) [2023-12-28 04:13:01,690][106226] Updated weights for policy 0, policy_version 1246506 (0.0009) [2023-12-28 04:13:01,753][106226] Updated weights for policy 0, policy_version 1246516 (0.0008) [2023-12-28 04:13:02,201][106225] Updated weights for policy 1, policy_version 1249675 (0.0008) [2023-12-28 04:13:02,257][106225] Updated weights for policy 1, policy_version 1249685 (0.0010) [2023-12-28 04:13:02,320][106225] Updated weights for policy 1, policy_version 1249695 (0.0010) [2023-12-28 04:13:02,393][106226] Updated weights for policy 0, policy_version 1246526 (0.0010) [2023-12-28 04:13:02,462][106226] Updated weights for policy 0, policy_version 1246536 (0.0005) [2023-12-28 04:13:02,530][106226] Updated weights for policy 0, policy_version 1246546 (0.0008) [2023-12-28 04:13:02,931][106225] Updated weights for policy 1, policy_version 1249705 (0.0008) [2023-12-28 04:13:02,989][106225] Updated weights for policy 1, policy_version 1249715 (0.0010) [2023-12-28 04:13:03,048][106225] Updated weights for policy 1, policy_version 1249725 (0.0010) [2023-12-28 04:13:03,110][106226] Updated weights for policy 0, policy_version 1246556 (0.0008) [2023-12-28 04:13:03,111][106225] Updated weights for policy 1, policy_version 1249735 (0.0010) [2023-12-28 04:13:03,163][106226] Updated weights for policy 0, policy_version 1246566 (0.0005) [2023-12-28 04:13:03,211][106226] Updated weights for policy 0, policy_version 1246576 (0.0005) [2023-12-28 04:13:03,724][106226] Updated weights for policy 0, policy_version 1246586 (0.0005) [2023-12-28 04:13:03,758][106225] Updated weights for policy 1, policy_version 1249745 (0.0010) [2023-12-28 04:13:03,792][106226] Updated weights for policy 0, policy_version 1246596 (0.0005) [2023-12-28 04:13:03,820][106225] Updated weights for policy 1, policy_version 1249755 (0.0010) [2023-12-28 04:13:03,851][106226] Updated weights for policy 0, policy_version 1246606 (0.0006) [2023-12-28 04:13:03,898][106225] Updated weights for policy 1, policy_version 1249765 (0.0008) [2023-12-28 04:13:03,911][106226] Updated weights for policy 0, policy_version 1246616 (0.0009) [2023-12-28 04:13:04,514][106225] Updated weights for policy 1, policy_version 1249775 (0.0008) [2023-12-28 04:13:04,578][106225] Updated weights for policy 1, policy_version 1249785 (0.0010) [2023-12-28 04:13:04,582][106226] Updated weights for policy 0, policy_version 1246626 (0.0011) [2023-12-28 04:13:04,636][106226] Updated weights for policy 0, policy_version 1246636 (0.0010) [2023-12-28 04:13:04,638][106225] Updated weights for policy 1, policy_version 1249795 (0.0010) [2023-12-28 04:13:04,689][106226] Updated weights for policy 0, policy_version 1246646 (0.0010) [2023-12-28 04:13:05,327][106225] Updated weights for policy 1, policy_version 1249805 (0.0010) [2023-12-28 04:13:05,345][106226] Updated weights for policy 0, policy_version 1246656 (0.0006) [2023-12-28 04:13:05,387][106225] Updated weights for policy 1, policy_version 1249815 (0.0010) [2023-12-28 04:13:05,414][106226] Updated weights for policy 0, policy_version 1246666 (0.0005) [2023-12-28 04:13:05,447][106225] Updated weights for policy 1, policy_version 1249825 (0.0010) [2023-12-28 04:13:05,474][106226] Updated weights for policy 0, policy_version 1246676 (0.0005) [2023-12-28 04:13:06,122][106226] Updated weights for policy 0, policy_version 1246686 (0.0008) [2023-12-28 04:13:06,157][106225] Updated weights for policy 1, policy_version 1249835 (0.0009) [2023-12-28 04:13:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 639213568. Throughput: 0: 9812.5, 1: 10079.0. Samples: 639229164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:13:06,175][105115] Avg episode reward: [(0, '-4.017'), (1, '-4.728')] [2023-12-28 04:13:06,189][106226] Updated weights for policy 0, policy_version 1246696 (0.0011) [2023-12-28 04:13:06,217][106225] Updated weights for policy 1, policy_version 1249845 (0.0010) [2023-12-28 04:13:06,251][106226] Updated weights for policy 0, policy_version 1246706 (0.0011) [2023-12-28 04:13:06,279][106225] Updated weights for policy 1, policy_version 1249855 (0.0010) [2023-12-28 04:13:06,938][106225] Updated weights for policy 1, policy_version 1249865 (0.0010) [2023-12-28 04:13:06,974][106226] Updated weights for policy 0, policy_version 1246716 (0.0011) [2023-12-28 04:13:06,984][106225] Updated weights for policy 1, policy_version 1249875 (0.0007) [2023-12-28 04:13:07,029][106225] Updated weights for policy 1, policy_version 1249885 (0.0008) [2023-12-28 04:13:07,041][106226] Updated weights for policy 0, policy_version 1246726 (0.0011) [2023-12-28 04:13:07,085][106225] Updated weights for policy 1, policy_version 1249895 (0.0007) [2023-12-28 04:13:07,098][106226] Updated weights for policy 0, policy_version 1246736 (0.0011) [2023-12-28 04:13:07,799][106226] Updated weights for policy 0, policy_version 1246746 (0.0010) [2023-12-28 04:13:07,807][106225] Updated weights for policy 1, policy_version 1249905 (0.0006) [2023-12-28 04:13:07,863][106226] Updated weights for policy 0, policy_version 1246756 (0.0009) [2023-12-28 04:13:07,865][106225] Updated weights for policy 1, policy_version 1249915 (0.0008) [2023-12-28 04:13:07,919][106225] Updated weights for policy 1, policy_version 1249925 (0.0006) [2023-12-28 04:13:07,924][106226] Updated weights for policy 0, policy_version 1246766 (0.0008) [2023-12-28 04:13:07,973][106226] Updated weights for policy 0, policy_version 1246776 (0.0009) [2023-12-28 04:13:08,599][106225] Updated weights for policy 1, policy_version 1249935 (0.0006) [2023-12-28 04:13:08,663][106225] Updated weights for policy 1, policy_version 1249945 (0.0008) [2023-12-28 04:13:08,718][106226] Updated weights for policy 0, policy_version 1246786 (0.0008) [2023-12-28 04:13:08,720][106225] Updated weights for policy 1, policy_version 1249955 (0.0007) [2023-12-28 04:13:08,781][106226] Updated weights for policy 0, policy_version 1246796 (0.0006) [2023-12-28 04:13:08,841][106226] Updated weights for policy 0, policy_version 1246806 (0.0009) [2023-12-28 04:13:09,459][106225] Updated weights for policy 1, policy_version 1249965 (0.0007) [2023-12-28 04:13:09,520][106225] Updated weights for policy 1, policy_version 1249975 (0.0006) [2023-12-28 04:13:09,587][106226] Updated weights for policy 0, policy_version 1246816 (0.0008) [2023-12-28 04:13:09,587][106225] Updated weights for policy 1, policy_version 1249985 (0.0007) [2023-12-28 04:13:09,650][106226] Updated weights for policy 0, policy_version 1246826 (0.0008) [2023-12-28 04:13:09,717][106226] Updated weights for policy 0, policy_version 1246836 (0.0008) [2023-12-28 04:13:10,273][106225] Updated weights for policy 1, policy_version 1249995 (0.0008) [2023-12-28 04:13:10,338][106225] Updated weights for policy 1, policy_version 1250005 (0.0009) [2023-12-28 04:13:10,399][106225] Updated weights for policy 1, policy_version 1250015 (0.0008) [2023-12-28 04:13:10,481][106226] Updated weights for policy 0, policy_version 1246846 (0.0007) [2023-12-28 04:13:10,537][106226] Updated weights for policy 0, policy_version 1246856 (0.0008) [2023-12-28 04:13:10,592][106226] Updated weights for policy 0, policy_version 1246866 (0.0009) [2023-12-28 04:13:11,090][106225] Updated weights for policy 1, policy_version 1250025 (0.0008) [2023-12-28 04:13:11,158][106225] Updated weights for policy 1, policy_version 1250035 (0.0007) [2023-12-28 04:13:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 639311872. Throughput: 0: 9810.6, 1: 10118.0. Samples: 639288040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:13:11,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-5.027')] [2023-12-28 04:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001246872_319258624.pth... [2023-12-28 04:13:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001245720_318963712.pth [2023-12-28 04:13:11,229][106225] Updated weights for policy 1, policy_version 1250045 (0.0009) [2023-12-28 04:13:11,294][106225] Updated weights for policy 1, policy_version 1250055 (0.0010) [2023-12-28 04:13:11,296][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001250056_320061440.pth... [2023-12-28 04:13:11,299][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001248872_319758336.pth [2023-12-28 04:13:11,422][106226] Updated weights for policy 0, policy_version 1246876 (0.0009) [2023-12-28 04:13:11,484][106226] Updated weights for policy 0, policy_version 1246886 (0.0007) [2023-12-28 04:13:11,549][106226] Updated weights for policy 0, policy_version 1246896 (0.0007) [2023-12-28 04:13:12,105][106225] Updated weights for policy 1, policy_version 1250065 (0.0008) [2023-12-28 04:13:12,165][106225] Updated weights for policy 1, policy_version 1250075 (0.0008) [2023-12-28 04:13:12,220][106225] Updated weights for policy 1, policy_version 1250085 (0.0008) [2023-12-28 04:13:12,233][106226] Updated weights for policy 0, policy_version 1246906 (0.0009) [2023-12-28 04:13:12,299][106226] Updated weights for policy 0, policy_version 1246916 (0.0008) [2023-12-28 04:13:12,366][106226] Updated weights for policy 0, policy_version 1246926 (0.0010) [2023-12-28 04:13:12,432][106226] Updated weights for policy 0, policy_version 1246936 (0.0008) [2023-12-28 04:13:12,985][106225] Updated weights for policy 1, policy_version 1250095 (0.0006) [2023-12-28 04:13:13,043][106225] Updated weights for policy 1, policy_version 1250105 (0.0010) [2023-12-28 04:13:13,103][106225] Updated weights for policy 1, policy_version 1250115 (0.0010) [2023-12-28 04:13:13,165][106226] Updated weights for policy 0, policy_version 1246946 (0.0009) [2023-12-28 04:13:13,215][106226] Updated weights for policy 0, policy_version 1246956 (0.0010) [2023-12-28 04:13:13,269][106226] Updated weights for policy 0, policy_version 1246966 (0.0010) [2023-12-28 04:13:13,808][106225] Updated weights for policy 1, policy_version 1250125 (0.0010) [2023-12-28 04:13:13,876][106225] Updated weights for policy 1, policy_version 1250135 (0.0010) [2023-12-28 04:13:13,906][106226] Updated weights for policy 0, policy_version 1246976 (0.0007) [2023-12-28 04:13:13,939][106225] Updated weights for policy 1, policy_version 1250145 (0.0010) [2023-12-28 04:13:13,967][106226] Updated weights for policy 0, policy_version 1246986 (0.0005) [2023-12-28 04:13:14,023][106226] Updated weights for policy 0, policy_version 1246996 (0.0005) [2023-12-28 04:13:14,608][106225] Updated weights for policy 1, policy_version 1250155 (0.0010) [2023-12-28 04:13:14,618][106226] Updated weights for policy 0, policy_version 1247006 (0.0005) [2023-12-28 04:13:14,669][106225] Updated weights for policy 1, policy_version 1250165 (0.0010) [2023-12-28 04:13:14,687][106226] Updated weights for policy 0, policy_version 1247016 (0.0005) [2023-12-28 04:13:14,724][106225] Updated weights for policy 1, policy_version 1250175 (0.0010) [2023-12-28 04:13:14,755][106226] Updated weights for policy 0, policy_version 1247026 (0.0006) [2023-12-28 04:13:15,341][106225] Updated weights for policy 1, policy_version 1250185 (0.0008) [2023-12-28 04:13:15,367][106226] Updated weights for policy 0, policy_version 1247036 (0.0011) [2023-12-28 04:13:15,400][106225] Updated weights for policy 1, policy_version 1250195 (0.0006) [2023-12-28 04:13:15,428][106226] Updated weights for policy 0, policy_version 1247046 (0.0011) [2023-12-28 04:13:15,458][106225] Updated weights for policy 1, policy_version 1250205 (0.0006) [2023-12-28 04:13:15,490][106226] Updated weights for policy 0, policy_version 1247056 (0.0011) [2023-12-28 04:13:15,519][106225] Updated weights for policy 1, policy_version 1250215 (0.0006) [2023-12-28 04:13:16,128][106225] Updated weights for policy 1, policy_version 1250225 (0.0005) [2023-12-28 04:13:16,159][106226] Updated weights for policy 0, policy_version 1247066 (0.0010) [2023-12-28 04:13:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 639410176. Throughput: 0: 9745.9, 1: 10036.1. Samples: 639403884. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:13:16,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.907')] [2023-12-28 04:13:16,184][106225] Updated weights for policy 1, policy_version 1250235 (0.0005) [2023-12-28 04:13:16,218][106226] Updated weights for policy 0, policy_version 1247076 (0.0005) [2023-12-28 04:13:16,239][106225] Updated weights for policy 1, policy_version 1250245 (0.0006) [2023-12-28 04:13:16,283][106226] Updated weights for policy 0, policy_version 1247086 (0.0005) [2023-12-28 04:13:16,343][106226] Updated weights for policy 0, policy_version 1247096 (0.0006) [2023-12-28 04:13:16,778][106225] Updated weights for policy 1, policy_version 1250255 (0.0005) [2023-12-28 04:13:16,844][106225] Updated weights for policy 1, policy_version 1250265 (0.0006) [2023-12-28 04:13:16,897][106225] Updated weights for policy 1, policy_version 1250275 (0.0006) [2023-12-28 04:13:16,942][106226] Updated weights for policy 0, policy_version 1247106 (0.0006) [2023-12-28 04:13:17,003][106226] Updated weights for policy 0, policy_version 1247116 (0.0009) [2023-12-28 04:13:17,061][106226] Updated weights for policy 0, policy_version 1247126 (0.0009) [2023-12-28 04:13:17,472][106225] Updated weights for policy 1, policy_version 1250285 (0.0006) [2023-12-28 04:13:17,520][106225] Updated weights for policy 1, policy_version 1250295 (0.0005) [2023-12-28 04:13:17,572][106225] Updated weights for policy 1, policy_version 1250305 (0.0005) [2023-12-28 04:13:17,846][106226] Updated weights for policy 0, policy_version 1247136 (0.0006) [2023-12-28 04:13:17,892][106226] Updated weights for policy 0, policy_version 1247146 (0.0005) [2023-12-28 04:13:17,941][106226] Updated weights for policy 0, policy_version 1247156 (0.0005) [2023-12-28 04:13:18,154][106225] Updated weights for policy 1, policy_version 1250315 (0.0005) [2023-12-28 04:13:18,213][106225] Updated weights for policy 1, policy_version 1250325 (0.0006) [2023-12-28 04:13:18,268][106225] Updated weights for policy 1, policy_version 1250335 (0.0008) [2023-12-28 04:13:18,631][106226] Updated weights for policy 0, policy_version 1247166 (0.0008) [2023-12-28 04:13:18,692][106226] Updated weights for policy 0, policy_version 1247176 (0.0009) [2023-12-28 04:13:18,745][106226] Updated weights for policy 0, policy_version 1247186 (0.0009) [2023-12-28 04:13:18,988][106225] Updated weights for policy 1, policy_version 1250345 (0.0009) [2023-12-28 04:13:19,049][106225] Updated weights for policy 1, policy_version 1250355 (0.0009) [2023-12-28 04:13:19,099][106225] Updated weights for policy 1, policy_version 1250365 (0.0008) [2023-12-28 04:13:19,147][106225] Updated weights for policy 1, policy_version 1250375 (0.0008) [2023-12-28 04:13:19,448][106226] Updated weights for policy 0, policy_version 1247196 (0.0006) [2023-12-28 04:13:19,514][106226] Updated weights for policy 0, policy_version 1247206 (0.0008) [2023-12-28 04:13:19,583][106226] Updated weights for policy 0, policy_version 1247216 (0.0007) [2023-12-28 04:13:19,995][106225] Updated weights for policy 1, policy_version 1250385 (0.0008) [2023-12-28 04:13:20,059][106225] Updated weights for policy 1, policy_version 1250395 (0.0009) [2023-12-28 04:13:20,117][106225] Updated weights for policy 1, policy_version 1250405 (0.0008) [2023-12-28 04:13:20,234][106226] Updated weights for policy 0, policy_version 1247226 (0.0006) [2023-12-28 04:13:20,298][106226] Updated weights for policy 0, policy_version 1247236 (0.0009) [2023-12-28 04:13:20,375][106226] Updated weights for policy 0, policy_version 1247246 (0.0007) [2023-12-28 04:13:20,436][106226] Updated weights for policy 0, policy_version 1247256 (0.0009) [2023-12-28 04:13:20,909][106225] Updated weights for policy 1, policy_version 1250415 (0.0009) [2023-12-28 04:13:20,975][106225] Updated weights for policy 1, policy_version 1250425 (0.0009) [2023-12-28 04:13:21,039][106225] Updated weights for policy 1, policy_version 1250435 (0.0008) [2023-12-28 04:13:21,162][106226] Updated weights for policy 0, policy_version 1247266 (0.0009) [2023-12-28 04:13:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 639516672. Throughput: 0: 9807.3, 1: 10069.2. Samples: 639527540. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-28 04:13:21,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.973')] [2023-12-28 04:13:21,226][106226] Updated weights for policy 0, policy_version 1247276 (0.0008) [2023-12-28 04:13:21,292][106226] Updated weights for policy 0, policy_version 1247286 (0.0009) [2023-12-28 04:13:21,780][106225] Updated weights for policy 1, policy_version 1250445 (0.0006) [2023-12-28 04:13:21,848][106225] Updated weights for policy 1, policy_version 1250455 (0.0007) [2023-12-28 04:13:21,914][106225] Updated weights for policy 1, policy_version 1250465 (0.0006) [2023-12-28 04:13:22,089][106226] Updated weights for policy 0, policy_version 1247296 (0.0007) [2023-12-28 04:13:22,155][106226] Updated weights for policy 0, policy_version 1247306 (0.0008) [2023-12-28 04:13:22,217][106226] Updated weights for policy 0, policy_version 1247316 (0.0006) [2023-12-28 04:13:22,678][106225] Updated weights for policy 1, policy_version 1250475 (0.0006) [2023-12-28 04:13:22,745][106225] Updated weights for policy 1, policy_version 1250485 (0.0005) [2023-12-28 04:13:22,799][106225] Updated weights for policy 1, policy_version 1250495 (0.0008) [2023-12-28 04:13:22,926][106226] Updated weights for policy 0, policy_version 1247326 (0.0007) [2023-12-28 04:13:22,975][106226] Updated weights for policy 0, policy_version 1247336 (0.0009) [2023-12-28 04:13:23,028][106226] Updated weights for policy 0, policy_version 1247346 (0.0009) [2023-12-28 04:13:23,408][106225] Updated weights for policy 1, policy_version 1250505 (0.0009) [2023-12-28 04:13:23,463][106225] Updated weights for policy 1, policy_version 1250515 (0.0008) [2023-12-28 04:13:23,513][106225] Updated weights for policy 1, policy_version 1250525 (0.0008) [2023-12-28 04:13:23,570][106225] Updated weights for policy 1, policy_version 1250535 (0.0005) [2023-12-28 04:13:23,709][106226] Updated weights for policy 0, policy_version 1247356 (0.0007) [2023-12-28 04:13:23,770][106226] Updated weights for policy 0, policy_version 1247366 (0.0005) [2023-12-28 04:13:23,832][106226] Updated weights for policy 0, policy_version 1247376 (0.0010) [2023-12-28 04:13:24,191][106225] Updated weights for policy 1, policy_version 1250545 (0.0005) [2023-12-28 04:13:24,250][106225] Updated weights for policy 1, policy_version 1250555 (0.0005) [2023-12-28 04:13:24,316][106225] Updated weights for policy 1, policy_version 1250565 (0.0006) [2023-12-28 04:13:24,501][106226] Updated weights for policy 0, policy_version 1247386 (0.0008) [2023-12-28 04:13:24,561][106226] Updated weights for policy 0, policy_version 1247396 (0.0008) [2023-12-28 04:13:24,613][106226] Updated weights for policy 0, policy_version 1247406 (0.0008) [2023-12-28 04:13:24,667][106226] Updated weights for policy 0, policy_version 1247416 (0.0009) [2023-12-28 04:13:24,931][106225] Updated weights for policy 1, policy_version 1250575 (0.0006) [2023-12-28 04:13:24,990][106225] Updated weights for policy 1, policy_version 1250585 (0.0005) [2023-12-28 04:13:25,054][106225] Updated weights for policy 1, policy_version 1250595 (0.0006) [2023-12-28 04:13:25,360][106226] Updated weights for policy 0, policy_version 1247426 (0.0009) [2023-12-28 04:13:25,411][106226] Updated weights for policy 0, policy_version 1247436 (0.0008) [2023-12-28 04:13:25,472][106226] Updated weights for policy 0, policy_version 1247446 (0.0009) [2023-12-28 04:13:25,679][106225] Updated weights for policy 1, policy_version 1250605 (0.0007) [2023-12-28 04:13:25,728][106225] Updated weights for policy 1, policy_version 1250615 (0.0007) [2023-12-28 04:13:25,783][106225] Updated weights for policy 1, policy_version 1250625 (0.0006) [2023-12-28 04:13:26,169][106226] Updated weights for policy 0, policy_version 1247456 (0.0006) [2023-12-28 04:13:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 639614976. Throughput: 0: 9826.6, 1: 10055.0. Samples: 639585532. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:26,175][105115] Avg episode reward: [(0, '-4.142'), (1, '-4.849')] [2023-12-28 04:13:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001250632_320208896.pth... [2023-12-28 04:13:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001249448_319905792.pth [2023-12-28 04:13:26,232][106226] Updated weights for policy 0, policy_version 1247466 (0.0006) [2023-12-28 04:13:26,299][106226] Updated weights for policy 0, policy_version 1247476 (0.0005) [2023-12-28 04:13:26,325][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001247480_319414272.pth... [2023-12-28 04:13:26,330][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001246296_319111168.pth [2023-12-28 04:13:26,372][106225] Updated weights for policy 1, policy_version 1250635 (0.0006) [2023-12-28 04:13:26,423][106225] Updated weights for policy 1, policy_version 1250645 (0.0008) [2023-12-28 04:13:26,473][106225] Updated weights for policy 1, policy_version 1250656 (0.0009) [2023-12-28 04:13:26,869][106226] Updated weights for policy 0, policy_version 1247486 (0.0009) [2023-12-28 04:13:26,923][106226] Updated weights for policy 0, policy_version 1247496 (0.0010) [2023-12-28 04:13:26,974][106226] Updated weights for policy 0, policy_version 1247506 (0.0010) [2023-12-28 04:13:27,216][106225] Updated weights for policy 1, policy_version 1250666 (0.0007) [2023-12-28 04:13:27,272][106225] Updated weights for policy 1, policy_version 1250676 (0.0005) [2023-12-28 04:13:27,332][106225] Updated weights for policy 1, policy_version 1250686 (0.0009) [2023-12-28 04:13:27,382][106225] Updated weights for policy 1, policy_version 1250696 (0.0008) [2023-12-28 04:13:27,567][106226] Updated weights for policy 0, policy_version 1247516 (0.0010) [2023-12-28 04:13:27,621][106226] Updated weights for policy 0, policy_version 1247526 (0.0010) [2023-12-28 04:13:27,674][106226] Updated weights for policy 0, policy_version 1247536 (0.0007) [2023-12-28 04:13:27,922][106225] Updated weights for policy 1, policy_version 1250706 (0.0006) [2023-12-28 04:13:27,977][106225] Updated weights for policy 1, policy_version 1250716 (0.0005) [2023-12-28 04:13:28,028][106225] Updated weights for policy 1, policy_version 1250726 (0.0005) [2023-12-28 04:13:28,343][106226] Updated weights for policy 0, policy_version 1247546 (0.0009) [2023-12-28 04:13:28,405][106226] Updated weights for policy 0, policy_version 1247556 (0.0006) [2023-12-28 04:13:28,470][106226] Updated weights for policy 0, policy_version 1247566 (0.0005) [2023-12-28 04:13:28,539][106226] Updated weights for policy 0, policy_version 1247576 (0.0006) [2023-12-28 04:13:28,589][106225] Updated weights for policy 1, policy_version 1250736 (0.0007) [2023-12-28 04:13:28,642][106225] Updated weights for policy 1, policy_version 1250746 (0.0008) [2023-12-28 04:13:28,706][106225] Updated weights for policy 1, policy_version 1250756 (0.0009) [2023-12-28 04:13:29,104][106226] Updated weights for policy 0, policy_version 1247586 (0.0005) [2023-12-28 04:13:29,173][106226] Updated weights for policy 0, policy_version 1247596 (0.0005) [2023-12-28 04:13:29,247][106226] Updated weights for policy 0, policy_version 1247606 (0.0006) [2023-12-28 04:13:29,482][106225] Updated weights for policy 1, policy_version 1250766 (0.0009) [2023-12-28 04:13:29,540][106225] Updated weights for policy 1, policy_version 1250776 (0.0007) [2023-12-28 04:13:29,587][106225] Updated weights for policy 1, policy_version 1250786 (0.0010) [2023-12-28 04:13:29,811][106226] Updated weights for policy 0, policy_version 1247616 (0.0007) [2023-12-28 04:13:29,883][106226] Updated weights for policy 0, policy_version 1247626 (0.0008) [2023-12-28 04:13:29,971][106226] Updated weights for policy 0, policy_version 1247636 (0.0008) [2023-12-28 04:13:30,357][106225] Updated weights for policy 1, policy_version 1250796 (0.0009) [2023-12-28 04:13:30,425][106225] Updated weights for policy 1, policy_version 1250806 (0.0005) [2023-12-28 04:13:30,487][106225] Updated weights for policy 1, policy_version 1250816 (0.0007) [2023-12-28 04:13:30,600][106226] Updated weights for policy 0, policy_version 1247646 (0.0006) [2023-12-28 04:13:30,654][106226] Updated weights for policy 0, policy_version 1247656 (0.0005) [2023-12-28 04:13:30,712][106226] Updated weights for policy 0, policy_version 1247666 (0.0005) [2023-12-28 04:13:31,065][106225] Updated weights for policy 1, policy_version 1250826 (0.0007) [2023-12-28 04:13:31,118][106225] Updated weights for policy 1, policy_version 1250836 (0.0009) [2023-12-28 04:13:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 639721472. Throughput: 0: 9996.4, 1: 10150.6. Samples: 639714020. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:31,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.937')] [2023-12-28 04:13:31,184][106225] Updated weights for policy 1, policy_version 1250846 (0.0008) [2023-12-28 04:13:31,227][106225] Updated weights for policy 1, policy_version 1250856 (0.0006) [2023-12-28 04:13:31,271][106226] Updated weights for policy 0, policy_version 1247676 (0.0007) [2023-12-28 04:13:31,345][106226] Updated weights for policy 0, policy_version 1247686 (0.0009) [2023-12-28 04:13:31,418][106226] Updated weights for policy 0, policy_version 1247696 (0.0007) [2023-12-28 04:13:32,040][106225] Updated weights for policy 1, policy_version 1250866 (0.0010) [2023-12-28 04:13:32,094][106225] Updated weights for policy 1, policy_version 1250876 (0.0008) [2023-12-28 04:13:32,096][106226] Updated weights for policy 0, policy_version 1247706 (0.0006) [2023-12-28 04:13:32,156][106226] Updated weights for policy 0, policy_version 1247716 (0.0006) [2023-12-28 04:13:32,157][106225] Updated weights for policy 1, policy_version 1250886 (0.0008) [2023-12-28 04:13:32,211][106226] Updated weights for policy 0, policy_version 1247726 (0.0007) [2023-12-28 04:13:32,272][106226] Updated weights for policy 0, policy_version 1247736 (0.0009) [2023-12-28 04:13:32,854][106225] Updated weights for policy 1, policy_version 1250896 (0.0008) [2023-12-28 04:13:32,907][106225] Updated weights for policy 1, policy_version 1250906 (0.0008) [2023-12-28 04:13:32,972][106225] Updated weights for policy 1, policy_version 1250916 (0.0008) [2023-12-28 04:13:33,019][106226] Updated weights for policy 0, policy_version 1247746 (0.0008) [2023-12-28 04:13:33,068][106226] Updated weights for policy 0, policy_version 1247756 (0.0008) [2023-12-28 04:13:33,125][106226] Updated weights for policy 0, policy_version 1247766 (0.0008) [2023-12-28 04:13:33,689][106225] Updated weights for policy 1, policy_version 1250926 (0.0007) [2023-12-28 04:13:33,740][106225] Updated weights for policy 1, policy_version 1250936 (0.0008) [2023-12-28 04:13:33,793][106225] Updated weights for policy 1, policy_version 1250946 (0.0008) [2023-12-28 04:13:33,852][106226] Updated weights for policy 0, policy_version 1247776 (0.0007) [2023-12-28 04:13:33,898][106226] Updated weights for policy 0, policy_version 1247786 (0.0008) [2023-12-28 04:13:33,943][106226] Updated weights for policy 0, policy_version 1247796 (0.0008) [2023-12-28 04:13:34,429][106225] Updated weights for policy 1, policy_version 1250956 (0.0007) [2023-12-28 04:13:34,484][106225] Updated weights for policy 1, policy_version 1250966 (0.0009) [2023-12-28 04:13:34,545][106225] Updated weights for policy 1, policy_version 1250976 (0.0009) [2023-12-28 04:13:34,749][106226] Updated weights for policy 0, policy_version 1247806 (0.0009) [2023-12-28 04:13:34,810][106226] Updated weights for policy 0, policy_version 1247816 (0.0007) [2023-12-28 04:13:34,866][106226] Updated weights for policy 0, policy_version 1247826 (0.0007) [2023-12-28 04:13:35,308][106225] Updated weights for policy 1, policy_version 1250986 (0.0009) [2023-12-28 04:13:35,370][106225] Updated weights for policy 1, policy_version 1250996 (0.0008) [2023-12-28 04:13:35,435][106225] Updated weights for policy 1, policy_version 1251006 (0.0009) [2023-12-28 04:13:35,490][106225] Updated weights for policy 1, policy_version 1251016 (0.0008) [2023-12-28 04:13:35,491][106226] Updated weights for policy 0, policy_version 1247836 (0.0008) [2023-12-28 04:13:35,542][106226] Updated weights for policy 0, policy_version 1247846 (0.0005) [2023-12-28 04:13:35,595][106226] Updated weights for policy 0, policy_version 1247856 (0.0005) [2023-12-28 04:13:36,135][106226] Updated weights for policy 0, policy_version 1247866 (0.0006) [2023-12-28 04:13:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 639819776. Throughput: 0: 10014.5, 1: 10148.0. Samples: 639835092. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:36,175][105115] Avg episode reward: [(0, '-4.131'), (1, '-4.734')] [2023-12-28 04:13:36,179][106225] Updated weights for policy 1, policy_version 1251026 (0.0006) [2023-12-28 04:13:36,201][106226] Updated weights for policy 0, policy_version 1247876 (0.0010) [2023-12-28 04:13:36,240][106225] Updated weights for policy 1, policy_version 1251036 (0.0006) [2023-12-28 04:13:36,261][106226] Updated weights for policy 0, policy_version 1247886 (0.0009) [2023-12-28 04:13:36,297][106225] Updated weights for policy 1, policy_version 1251046 (0.0005) [2023-12-28 04:13:36,322][106226] Updated weights for policy 0, policy_version 1247896 (0.0009) [2023-12-28 04:13:36,929][106225] Updated weights for policy 1, policy_version 1251056 (0.0008) [2023-12-28 04:13:36,989][106225] Updated weights for policy 1, policy_version 1251066 (0.0009) [2023-12-28 04:13:37,047][106225] Updated weights for policy 1, policy_version 1251076 (0.0008) [2023-12-28 04:13:37,053][106226] Updated weights for policy 0, policy_version 1247906 (0.0007) [2023-12-28 04:13:37,110][106226] Updated weights for policy 0, policy_version 1247916 (0.0008) [2023-12-28 04:13:37,170][106226] Updated weights for policy 0, policy_version 1247926 (0.0009) [2023-12-28 04:13:37,715][106225] Updated weights for policy 1, policy_version 1251086 (0.0007) [2023-12-28 04:13:37,783][106225] Updated weights for policy 1, policy_version 1251096 (0.0008) [2023-12-28 04:13:37,842][106225] Updated weights for policy 1, policy_version 1251106 (0.0008) [2023-12-28 04:13:37,931][106226] Updated weights for policy 0, policy_version 1247936 (0.0008) [2023-12-28 04:13:38,001][106226] Updated weights for policy 0, policy_version 1247946 (0.0008) [2023-12-28 04:13:38,076][106226] Updated weights for policy 0, policy_version 1247956 (0.0010) [2023-12-28 04:13:38,513][106225] Updated weights for policy 1, policy_version 1251116 (0.0007) [2023-12-28 04:13:38,576][106225] Updated weights for policy 1, policy_version 1251126 (0.0007) [2023-12-28 04:13:38,635][106225] Updated weights for policy 1, policy_version 1251136 (0.0006) [2023-12-28 04:13:38,828][106226] Updated weights for policy 0, policy_version 1247966 (0.0008) [2023-12-28 04:13:38,894][106226] Updated weights for policy 0, policy_version 1247976 (0.0010) [2023-12-28 04:13:38,949][106226] Updated weights for policy 0, policy_version 1247986 (0.0009) [2023-12-28 04:13:39,218][106225] Updated weights for policy 1, policy_version 1251146 (0.0007) [2023-12-28 04:13:39,282][106225] Updated weights for policy 1, policy_version 1251156 (0.0008) [2023-12-28 04:13:39,354][106225] Updated weights for policy 1, policy_version 1251166 (0.0007) [2023-12-28 04:13:39,431][106225] Updated weights for policy 1, policy_version 1251176 (0.0009) [2023-12-28 04:13:39,724][106226] Updated weights for policy 0, policy_version 1247996 (0.0008) [2023-12-28 04:13:39,787][106226] Updated weights for policy 0, policy_version 1248006 (0.0009) [2023-12-28 04:13:39,859][106226] Updated weights for policy 0, policy_version 1248016 (0.0010) [2023-12-28 04:13:40,147][106225] Updated weights for policy 1, policy_version 1251186 (0.0008) [2023-12-28 04:13:40,212][106225] Updated weights for policy 1, policy_version 1251196 (0.0008) [2023-12-28 04:13:40,273][106225] Updated weights for policy 1, policy_version 1251206 (0.0008) [2023-12-28 04:13:40,644][106226] Updated weights for policy 0, policy_version 1248026 (0.0008) [2023-12-28 04:13:40,692][106226] Updated weights for policy 0, policy_version 1248036 (0.0009) [2023-12-28 04:13:40,754][106226] Updated weights for policy 0, policy_version 1248046 (0.0010) [2023-12-28 04:13:40,815][106226] Updated weights for policy 0, policy_version 1248056 (0.0008) [2023-12-28 04:13:40,898][106225] Updated weights for policy 1, policy_version 1251216 (0.0008) [2023-12-28 04:13:40,957][106225] Updated weights for policy 1, policy_version 1251226 (0.0008) [2023-12-28 04:13:41,029][106225] Updated weights for policy 1, policy_version 1251236 (0.0008) [2023-12-28 04:13:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 639926272. Throughput: 0: 9985.2, 1: 10200.3. Samples: 639894036. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:41,176][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.795')] [2023-12-28 04:13:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001251240_320364544.pth... [2023-12-28 04:13:41,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001248056_319561728.pth... [2023-12-28 04:13:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001250056_320061440.pth [2023-12-28 04:13:41,190][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001251240_320364544.pth [2023-12-28 04:13:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001246872_319258624.pth [2023-12-28 04:13:41,191][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001248056_319561728.pth [2023-12-28 04:13:41,597][106226] Updated weights for policy 0, policy_version 1248066 (0.0008) [2023-12-28 04:13:41,663][106226] Updated weights for policy 0, policy_version 1248076 (0.0009) [2023-12-28 04:13:41,732][106226] Updated weights for policy 0, policy_version 1248086 (0.0010) [2023-12-28 04:13:41,845][106225] Updated weights for policy 1, policy_version 1251246 (0.0009) [2023-12-28 04:13:41,902][106225] Updated weights for policy 1, policy_version 1251256 (0.0009) [2023-12-28 04:13:41,962][106225] Updated weights for policy 1, policy_version 1251266 (0.0007) [2023-12-28 04:13:42,573][106226] Updated weights for policy 0, policy_version 1248096 (0.0010) [2023-12-28 04:13:42,617][106225] Updated weights for policy 1, policy_version 1251276 (0.0005) [2023-12-28 04:13:42,637][106226] Updated weights for policy 0, policy_version 1248106 (0.0008) [2023-12-28 04:13:42,680][106225] Updated weights for policy 1, policy_version 1251286 (0.0006) [2023-12-28 04:13:42,698][106226] Updated weights for policy 0, policy_version 1248116 (0.0008) [2023-12-28 04:13:42,739][106225] Updated weights for policy 1, policy_version 1251296 (0.0006) [2023-12-28 04:13:43,288][106226] Updated weights for policy 0, policy_version 1248126 (0.0006) [2023-12-28 04:13:43,340][106226] Updated weights for policy 0, policy_version 1248136 (0.0005) [2023-12-28 04:13:43,390][106226] Updated weights for policy 0, policy_version 1248146 (0.0005) [2023-12-28 04:13:43,439][106225] Updated weights for policy 1, policy_version 1251306 (0.0005) [2023-12-28 04:13:43,496][106225] Updated weights for policy 1, policy_version 1251316 (0.0007) [2023-12-28 04:13:43,548][106225] Updated weights for policy 1, policy_version 1251326 (0.0009) [2023-12-28 04:13:43,604][106225] Updated weights for policy 1, policy_version 1251336 (0.0008) [2023-12-28 04:13:44,077][106226] Updated weights for policy 0, policy_version 1248156 (0.0006) [2023-12-28 04:13:44,138][106226] Updated weights for policy 0, policy_version 1248166 (0.0005) [2023-12-28 04:13:44,207][106226] Updated weights for policy 0, policy_version 1248176 (0.0007) [2023-12-28 04:13:44,255][106225] Updated weights for policy 1, policy_version 1251346 (0.0008) [2023-12-28 04:13:44,302][106225] Updated weights for policy 1, policy_version 1251356 (0.0008) [2023-12-28 04:13:44,353][106225] Updated weights for policy 1, policy_version 1251366 (0.0008) [2023-12-28 04:13:44,876][106226] Updated weights for policy 0, policy_version 1248186 (0.0008) [2023-12-28 04:13:44,936][106226] Updated weights for policy 0, policy_version 1248196 (0.0009) [2023-12-28 04:13:44,993][106226] Updated weights for policy 0, policy_version 1248206 (0.0005) [2023-12-28 04:13:45,059][106226] Updated weights for policy 0, policy_version 1248216 (0.0005) [2023-12-28 04:13:45,090][106225] Updated weights for policy 1, policy_version 1251376 (0.0008) [2023-12-28 04:13:45,149][106225] Updated weights for policy 1, policy_version 1251386 (0.0010) [2023-12-28 04:13:45,212][106225] Updated weights for policy 1, policy_version 1251396 (0.0010) [2023-12-28 04:13:45,686][106226] Updated weights for policy 0, policy_version 1248226 (0.0007) [2023-12-28 04:13:45,741][106226] Updated weights for policy 0, policy_version 1248236 (0.0008) [2023-12-28 04:13:45,791][106226] Updated weights for policy 0, policy_version 1248246 (0.0009) [2023-12-28 04:13:45,946][106225] Updated weights for policy 1, policy_version 1251406 (0.0007) [2023-12-28 04:13:46,010][106225] Updated weights for policy 1, policy_version 1251416 (0.0006) [2023-12-28 04:13:46,071][106225] Updated weights for policy 1, policy_version 1251426 (0.0005) [2023-12-28 04:13:46,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 640024576. Throughput: 0: 10051.3, 1: 10119.1. Samples: 640011332. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:46,176][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.621')] [2023-12-28 04:13:46,402][106226] Updated weights for policy 0, policy_version 1248256 (0.0008) [2023-12-28 04:13:46,464][106226] Updated weights for policy 0, policy_version 1248266 (0.0007) [2023-12-28 04:13:46,522][106226] Updated weights for policy 0, policy_version 1248276 (0.0009) [2023-12-28 04:13:46,623][106225] Updated weights for policy 1, policy_version 1251436 (0.0008) [2023-12-28 04:13:46,684][106225] Updated weights for policy 1, policy_version 1251446 (0.0005) [2023-12-28 04:13:46,738][106225] Updated weights for policy 1, policy_version 1251456 (0.0005) [2023-12-28 04:13:47,237][106225] Updated weights for policy 1, policy_version 1251466 (0.0005) [2023-12-28 04:13:47,286][106225] Updated weights for policy 1, policy_version 1251476 (0.0009) [2023-12-28 04:13:47,312][106226] Updated weights for policy 0, policy_version 1248286 (0.0009) [2023-12-28 04:13:47,334][106225] Updated weights for policy 1, policy_version 1251486 (0.0007) [2023-12-28 04:13:47,383][106225] Updated weights for policy 1, policy_version 1251496 (0.0005) [2023-12-28 04:13:47,383][106226] Updated weights for policy 0, policy_version 1248296 (0.0006) [2023-12-28 04:13:47,453][106226] Updated weights for policy 0, policy_version 1248306 (0.0009) [2023-12-28 04:13:48,070][106225] Updated weights for policy 1, policy_version 1251506 (0.0010) [2023-12-28 04:13:48,105][106226] Updated weights for policy 0, policy_version 1248316 (0.0007) [2023-12-28 04:13:48,126][106225] Updated weights for policy 1, policy_version 1251516 (0.0010) [2023-12-28 04:13:48,166][106226] Updated weights for policy 0, policy_version 1248326 (0.0005) [2023-12-28 04:13:48,192][106225] Updated weights for policy 1, policy_version 1251526 (0.0010) [2023-12-28 04:13:48,229][106226] Updated weights for policy 0, policy_version 1248336 (0.0009) [2023-12-28 04:13:48,855][106225] Updated weights for policy 1, policy_version 1251536 (0.0006) [2023-12-28 04:13:48,906][106226] Updated weights for policy 0, policy_version 1248346 (0.0007) [2023-12-28 04:13:48,915][106225] Updated weights for policy 1, policy_version 1251546 (0.0007) [2023-12-28 04:13:48,960][106226] Updated weights for policy 0, policy_version 1248356 (0.0005) [2023-12-28 04:13:48,975][106225] Updated weights for policy 1, policy_version 1251556 (0.0008) [2023-12-28 04:13:49,008][106226] Updated weights for policy 0, policy_version 1248366 (0.0005) [2023-12-28 04:13:49,055][106226] Updated weights for policy 0, policy_version 1248376 (0.0006) [2023-12-28 04:13:49,714][106225] Updated weights for policy 1, policy_version 1251566 (0.0008) [2023-12-28 04:13:49,758][106226] Updated weights for policy 0, policy_version 1248386 (0.0008) [2023-12-28 04:13:49,770][106225] Updated weights for policy 1, policy_version 1251576 (0.0010) [2023-12-28 04:13:49,824][106226] Updated weights for policy 0, policy_version 1248396 (0.0007) [2023-12-28 04:13:49,834][106225] Updated weights for policy 1, policy_version 1251586 (0.0006) [2023-12-28 04:13:49,893][106226] Updated weights for policy 0, policy_version 1248406 (0.0007) [2023-12-28 04:13:50,607][106225] Updated weights for policy 1, policy_version 1251596 (0.0008) [2023-12-28 04:13:50,624][106226] Updated weights for policy 0, policy_version 1248416 (0.0008) [2023-12-28 04:13:50,657][106225] Updated weights for policy 1, policy_version 1251606 (0.0007) [2023-12-28 04:13:50,683][106226] Updated weights for policy 0, policy_version 1248426 (0.0008) [2023-12-28 04:13:50,716][106225] Updated weights for policy 1, policy_version 1251616 (0.0007) [2023-12-28 04:13:50,746][106226] Updated weights for policy 0, policy_version 1248436 (0.0008) [2023-12-28 04:13:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 640122880. Throughput: 0: 9942.6, 1: 10141.3. Samples: 640132940. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:51,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.019')] [2023-12-28 04:13:51,485][106225] Updated weights for policy 1, policy_version 1251626 (0.0006) [2023-12-28 04:13:51,505][106226] Updated weights for policy 0, policy_version 1248446 (0.0010) [2023-12-28 04:13:51,543][106225] Updated weights for policy 1, policy_version 1251636 (0.0006) [2023-12-28 04:13:51,560][106226] Updated weights for policy 0, policy_version 1248456 (0.0011) [2023-12-28 04:13:51,594][106225] Updated weights for policy 1, policy_version 1251646 (0.0007) [2023-12-28 04:13:51,616][106226] Updated weights for policy 0, policy_version 1248466 (0.0007) [2023-12-28 04:13:51,675][106225] Updated weights for policy 1, policy_version 1251656 (0.0008) [2023-12-28 04:13:52,370][106226] Updated weights for policy 0, policy_version 1248476 (0.0011) [2023-12-28 04:13:52,389][106225] Updated weights for policy 1, policy_version 1251666 (0.0007) [2023-12-28 04:13:52,433][106226] Updated weights for policy 0, policy_version 1248486 (0.0011) [2023-12-28 04:13:52,451][106225] Updated weights for policy 1, policy_version 1251676 (0.0007) [2023-12-28 04:13:52,494][106226] Updated weights for policy 0, policy_version 1248496 (0.0011) [2023-12-28 04:13:52,509][106225] Updated weights for policy 1, policy_version 1251686 (0.0010) [2023-12-28 04:13:53,211][106225] Updated weights for policy 1, policy_version 1251696 (0.0008) [2023-12-28 04:13:53,227][106226] Updated weights for policy 0, policy_version 1248506 (0.0010) [2023-12-28 04:13:53,273][106225] Updated weights for policy 1, policy_version 1251706 (0.0007) [2023-12-28 04:13:53,290][106226] Updated weights for policy 0, policy_version 1248516 (0.0010) [2023-12-28 04:13:53,330][106225] Updated weights for policy 1, policy_version 1251716 (0.0009) [2023-12-28 04:13:53,355][106226] Updated weights for policy 0, policy_version 1248526 (0.0011) [2023-12-28 04:13:53,423][106226] Updated weights for policy 0, policy_version 1248536 (0.0010) [2023-12-28 04:13:53,988][106226] Updated weights for policy 0, policy_version 1248546 (0.0006) [2023-12-28 04:13:54,052][106226] Updated weights for policy 0, policy_version 1248556 (0.0006) [2023-12-28 04:13:54,088][106225] Updated weights for policy 1, policy_version 1251726 (0.0006) [2023-12-28 04:13:54,100][106226] Updated weights for policy 0, policy_version 1248566 (0.0010) [2023-12-28 04:13:54,145][106225] Updated weights for policy 1, policy_version 1251736 (0.0006) [2023-12-28 04:13:54,199][106225] Updated weights for policy 1, policy_version 1251746 (0.0007) [2023-12-28 04:13:54,652][106226] Updated weights for policy 0, policy_version 1248576 (0.0006) [2023-12-28 04:13:54,718][106226] Updated weights for policy 0, policy_version 1248586 (0.0005) [2023-12-28 04:13:54,777][106226] Updated weights for policy 0, policy_version 1248596 (0.0005) [2023-12-28 04:13:54,841][106225] Updated weights for policy 1, policy_version 1251756 (0.0009) [2023-12-28 04:13:54,896][106225] Updated weights for policy 1, policy_version 1251766 (0.0010) [2023-12-28 04:13:54,964][106225] Updated weights for policy 1, policy_version 1251776 (0.0005) [2023-12-28 04:13:55,291][106226] Updated weights for policy 0, policy_version 1248606 (0.0008) [2023-12-28 04:13:55,352][106226] Updated weights for policy 0, policy_version 1248616 (0.0011) [2023-12-28 04:13:55,411][106226] Updated weights for policy 0, policy_version 1248626 (0.0009) [2023-12-28 04:13:55,525][106225] Updated weights for policy 1, policy_version 1251786 (0.0006) [2023-12-28 04:13:55,580][106225] Updated weights for policy 1, policy_version 1251796 (0.0007) [2023-12-28 04:13:55,633][106225] Updated weights for policy 1, policy_version 1251806 (0.0008) [2023-12-28 04:13:55,696][106225] Updated weights for policy 1, policy_version 1251816 (0.0007) [2023-12-28 04:13:56,109][106226] Updated weights for policy 0, policy_version 1248636 (0.0009) [2023-12-28 04:13:56,160][106226] Updated weights for policy 0, policy_version 1248646 (0.0011) [2023-12-28 04:13:56,175][105115] Fps is (10 sec: 19661.3, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 640221184. Throughput: 0: 9976.2, 1: 10096.0. Samples: 640191288. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:13:56,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.959')] [2023-12-28 04:13:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001251816_320512000.pth... [2023-12-28 04:13:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001250632_320208896.pth [2023-12-28 04:13:56,218][106226] Updated weights for policy 0, policy_version 1248656 (0.0011) [2023-12-28 04:13:56,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001248664_319717376.pth... [2023-12-28 04:13:56,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001247480_319414272.pth [2023-12-28 04:13:56,389][106225] Updated weights for policy 1, policy_version 1251826 (0.0006) [2023-12-28 04:13:56,452][106225] Updated weights for policy 1, policy_version 1251836 (0.0007) [2023-12-28 04:13:56,517][106225] Updated weights for policy 1, policy_version 1251846 (0.0010) [2023-12-28 04:13:56,924][106226] Updated weights for policy 0, policy_version 1248666 (0.0010) [2023-12-28 04:13:56,970][106226] Updated weights for policy 0, policy_version 1248676 (0.0005) [2023-12-28 04:13:57,024][106226] Updated weights for policy 0, policy_version 1248686 (0.0008) [2023-12-28 04:13:57,076][106226] Updated weights for policy 0, policy_version 1248696 (0.0009) [2023-12-28 04:13:57,116][106225] Updated weights for policy 1, policy_version 1251856 (0.0006) [2023-12-28 04:13:57,164][106225] Updated weights for policy 1, policy_version 1251866 (0.0005) [2023-12-28 04:13:57,219][106225] Updated weights for policy 1, policy_version 1251876 (0.0005) [2023-12-28 04:13:57,788][106226] Updated weights for policy 0, policy_version 1248706 (0.0010) [2023-12-28 04:13:57,837][106226] Updated weights for policy 0, policy_version 1248716 (0.0010) [2023-12-28 04:13:57,869][106225] Updated weights for policy 1, policy_version 1251886 (0.0009) [2023-12-28 04:13:57,890][106226] Updated weights for policy 0, policy_version 1248726 (0.0010) [2023-12-28 04:13:57,924][106225] Updated weights for policy 1, policy_version 1251896 (0.0006) [2023-12-28 04:13:57,980][106225] Updated weights for policy 1, policy_version 1251906 (0.0006) [2023-12-28 04:13:58,700][106226] Updated weights for policy 0, policy_version 1248736 (0.0009) [2023-12-28 04:13:58,728][106225] Updated weights for policy 1, policy_version 1251916 (0.0007) [2023-12-28 04:13:58,769][106226] Updated weights for policy 0, policy_version 1248746 (0.0009) [2023-12-28 04:13:58,791][106225] Updated weights for policy 1, policy_version 1251926 (0.0007) [2023-12-28 04:13:58,847][106226] Updated weights for policy 0, policy_version 1248756 (0.0008) [2023-12-28 04:13:58,865][106225] Updated weights for policy 1, policy_version 1251936 (0.0008) [2023-12-28 04:13:59,577][106226] Updated weights for policy 0, policy_version 1248766 (0.0007) [2023-12-28 04:13:59,637][106226] Updated weights for policy 0, policy_version 1248776 (0.0007) [2023-12-28 04:13:59,659][106225] Updated weights for policy 1, policy_version 1251946 (0.0009) [2023-12-28 04:13:59,699][106226] Updated weights for policy 0, policy_version 1248786 (0.0006) [2023-12-28 04:13:59,717][106225] Updated weights for policy 1, policy_version 1251956 (0.0010) [2023-12-28 04:13:59,771][106225] Updated weights for policy 1, policy_version 1251966 (0.0010) [2023-12-28 04:13:59,822][106225] Updated weights for policy 1, policy_version 1251976 (0.0010) [2023-12-28 04:14:00,347][106226] Updated weights for policy 0, policy_version 1248796 (0.0007) [2023-12-28 04:14:00,412][106226] Updated weights for policy 0, policy_version 1248806 (0.0008) [2023-12-28 04:14:00,474][106226] Updated weights for policy 0, policy_version 1248816 (0.0005) [2023-12-28 04:14:00,548][106225] Updated weights for policy 1, policy_version 1251986 (0.0010) [2023-12-28 04:14:00,605][106225] Updated weights for policy 1, policy_version 1251996 (0.0009) [2023-12-28 04:14:00,660][106225] Updated weights for policy 1, policy_version 1252006 (0.0005) [2023-12-28 04:14:01,171][106226] Updated weights for policy 0, policy_version 1248826 (0.0006) [2023-12-28 04:14:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 640319488. Throughput: 0: 10022.3, 1: 10181.7. Samples: 640313064. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:01,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-5.018')] [2023-12-28 04:14:01,229][106226] Updated weights for policy 0, policy_version 1248836 (0.0008) [2023-12-28 04:14:01,269][106225] Updated weights for policy 1, policy_version 1252016 (0.0008) [2023-12-28 04:14:01,292][106226] Updated weights for policy 0, policy_version 1248846 (0.0008) [2023-12-28 04:14:01,338][106225] Updated weights for policy 1, policy_version 1252026 (0.0008) [2023-12-28 04:14:01,354][106226] Updated weights for policy 0, policy_version 1248856 (0.0008) [2023-12-28 04:14:01,406][106225] Updated weights for policy 1, policy_version 1252036 (0.0008) [2023-12-28 04:14:02,046][106225] Updated weights for policy 1, policy_version 1252046 (0.0007) [2023-12-28 04:14:02,058][106226] Updated weights for policy 0, policy_version 1248866 (0.0007) [2023-12-28 04:14:02,093][106225] Updated weights for policy 1, policy_version 1252056 (0.0007) [2023-12-28 04:14:02,124][106226] Updated weights for policy 0, policy_version 1248876 (0.0007) [2023-12-28 04:14:02,141][106225] Updated weights for policy 1, policy_version 1252066 (0.0005) [2023-12-28 04:14:02,192][106226] Updated weights for policy 0, policy_version 1248886 (0.0008) [2023-12-28 04:14:02,802][106226] Updated weights for policy 0, policy_version 1248896 (0.0007) [2023-12-28 04:14:02,849][106226] Updated weights for policy 0, policy_version 1248906 (0.0008) [2023-12-28 04:14:02,902][106226] Updated weights for policy 0, policy_version 1248916 (0.0007) [2023-12-28 04:14:02,914][106225] Updated weights for policy 1, policy_version 1252076 (0.0008) [2023-12-28 04:14:02,960][106225] Updated weights for policy 1, policy_version 1252086 (0.0010) [2023-12-28 04:14:03,016][106225] Updated weights for policy 1, policy_version 1252096 (0.0010) [2023-12-28 04:14:03,504][106226] Updated weights for policy 0, policy_version 1248926 (0.0008) [2023-12-28 04:14:03,560][106226] Updated weights for policy 0, policy_version 1248936 (0.0006) [2023-12-28 04:14:03,583][106225] Updated weights for policy 1, policy_version 1252106 (0.0009) [2023-12-28 04:14:03,620][106226] Updated weights for policy 0, policy_version 1248946 (0.0005) [2023-12-28 04:14:03,632][106225] Updated weights for policy 1, policy_version 1252116 (0.0006) [2023-12-28 04:14:03,684][106225] Updated weights for policy 1, policy_version 1252126 (0.0010) [2023-12-28 04:14:03,747][106225] Updated weights for policy 1, policy_version 1252136 (0.0010) [2023-12-28 04:14:04,253][106226] Updated weights for policy 0, policy_version 1248956 (0.0009) [2023-12-28 04:14:04,317][106226] Updated weights for policy 0, policy_version 1248966 (0.0011) [2023-12-28 04:14:04,373][106225] Updated weights for policy 1, policy_version 1252146 (0.0007) [2023-12-28 04:14:04,378][106226] Updated weights for policy 0, policy_version 1248976 (0.0008) [2023-12-28 04:14:04,439][106225] Updated weights for policy 1, policy_version 1252156 (0.0005) [2023-12-28 04:14:04,503][106225] Updated weights for policy 1, policy_version 1252166 (0.0010) [2023-12-28 04:14:05,031][106226] Updated weights for policy 0, policy_version 1248986 (0.0011) [2023-12-28 04:14:05,091][106226] Updated weights for policy 0, policy_version 1248996 (0.0011) [2023-12-28 04:14:05,142][106226] Updated weights for policy 0, policy_version 1249006 (0.0006) [2023-12-28 04:14:05,192][106226] Updated weights for policy 0, policy_version 1249016 (0.0010) [2023-12-28 04:14:05,192][106225] Updated weights for policy 1, policy_version 1252176 (0.0010) [2023-12-28 04:14:05,251][106225] Updated weights for policy 1, policy_version 1252186 (0.0010) [2023-12-28 04:14:05,297][106225] Updated weights for policy 1, policy_version 1252196 (0.0010) [2023-12-28 04:14:05,878][106226] Updated weights for policy 0, policy_version 1249026 (0.0006) [2023-12-28 04:14:05,943][106226] Updated weights for policy 0, policy_version 1249036 (0.0008) [2023-12-28 04:14:05,998][106226] Updated weights for policy 0, policy_version 1249046 (0.0007) [2023-12-28 04:14:05,998][106225] Updated weights for policy 1, policy_version 1252206 (0.0010) [2023-12-28 04:14:06,055][106225] Updated weights for policy 1, policy_version 1252216 (0.0010) [2023-12-28 04:14:06,108][106225] Updated weights for policy 1, policy_version 1252226 (0.0010) [2023-12-28 04:14:06,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20343.4, 300 sec: 19910.7). Total num frames: 640434176. Throughput: 0: 10076.2, 1: 10160.1. Samples: 640438180. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:06,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.958')] [2023-12-28 04:14:06,770][106226] Updated weights for policy 0, policy_version 1249056 (0.0010) [2023-12-28 04:14:06,792][106225] Updated weights for policy 1, policy_version 1252236 (0.0008) [2023-12-28 04:14:06,824][106226] Updated weights for policy 0, policy_version 1249066 (0.0008) [2023-12-28 04:14:06,844][106225] Updated weights for policy 1, policy_version 1252246 (0.0006) [2023-12-28 04:14:06,885][106226] Updated weights for policy 0, policy_version 1249076 (0.0006) [2023-12-28 04:14:06,898][106225] Updated weights for policy 1, policy_version 1252256 (0.0010) [2023-12-28 04:14:07,576][106225] Updated weights for policy 1, policy_version 1252266 (0.0010) [2023-12-28 04:14:07,629][106225] Updated weights for policy 1, policy_version 1252276 (0.0007) [2023-12-28 04:14:07,649][106226] Updated weights for policy 0, policy_version 1249086 (0.0006) [2023-12-28 04:14:07,675][106225] Updated weights for policy 1, policy_version 1252286 (0.0008) [2023-12-28 04:14:07,708][106226] Updated weights for policy 0, policy_version 1249096 (0.0006) [2023-12-28 04:14:07,728][106225] Updated weights for policy 1, policy_version 1252296 (0.0008) [2023-12-28 04:14:07,765][106226] Updated weights for policy 0, policy_version 1249106 (0.0009) [2023-12-28 04:14:08,387][106225] Updated weights for policy 1, policy_version 1252306 (0.0009) [2023-12-28 04:14:08,439][106225] Updated weights for policy 1, policy_version 1252316 (0.0008) [2023-12-28 04:14:08,498][106225] Updated weights for policy 1, policy_version 1252326 (0.0008) [2023-12-28 04:14:08,570][106226] Updated weights for policy 0, policy_version 1249116 (0.0009) [2023-12-28 04:14:08,622][106226] Updated weights for policy 0, policy_version 1249126 (0.0009) [2023-12-28 04:14:08,679][106226] Updated weights for policy 0, policy_version 1249136 (0.0007) [2023-12-28 04:14:09,261][106225] Updated weights for policy 1, policy_version 1252336 (0.0008) [2023-12-28 04:14:09,325][106225] Updated weights for policy 1, policy_version 1252346 (0.0008) [2023-12-28 04:14:09,345][106226] Updated weights for policy 0, policy_version 1249146 (0.0007) [2023-12-28 04:14:09,394][106225] Updated weights for policy 1, policy_version 1252356 (0.0012) [2023-12-28 04:14:09,413][106226] Updated weights for policy 0, policy_version 1249156 (0.0012) [2023-12-28 04:14:09,479][106226] Updated weights for policy 0, policy_version 1249166 (0.0010) [2023-12-28 04:14:09,545][106226] Updated weights for policy 0, policy_version 1249176 (0.0011) [2023-12-28 04:14:10,076][106225] Updated weights for policy 1, policy_version 1252366 (0.0008) [2023-12-28 04:14:10,132][106225] Updated weights for policy 1, policy_version 1252376 (0.0008) [2023-12-28 04:14:10,179][106225] Updated weights for policy 1, policy_version 1252386 (0.0008) [2023-12-28 04:14:10,262][106226] Updated weights for policy 0, policy_version 1249186 (0.0011) [2023-12-28 04:14:10,331][106226] Updated weights for policy 0, policy_version 1249196 (0.0010) [2023-12-28 04:14:10,395][106226] Updated weights for policy 0, policy_version 1249206 (0.0011) [2023-12-28 04:14:10,947][106225] Updated weights for policy 1, policy_version 1252396 (0.0008) [2023-12-28 04:14:11,010][106225] Updated weights for policy 1, policy_version 1252406 (0.0009) [2023-12-28 04:14:11,072][106226] Updated weights for policy 0, policy_version 1249216 (0.0010) [2023-12-28 04:14:11,074][106225] Updated weights for policy 1, policy_version 1252416 (0.0007) [2023-12-28 04:14:11,135][106226] Updated weights for policy 0, policy_version 1249226 (0.0010) [2023-12-28 04:14:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 640524288. Throughput: 0: 10061.2, 1: 10190.8. Samples: 640496868. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:11,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.919')] [2023-12-28 04:14:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001252424_320667648.pth... [2023-12-28 04:14:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001251240_320364544.pth [2023-12-28 04:14:11,198][106226] Updated weights for policy 0, policy_version 1249236 (0.0008) [2023-12-28 04:14:11,223][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001249240_319864832.pth... [2023-12-28 04:14:11,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001248056_319561728.pth [2023-12-28 04:14:11,906][106225] Updated weights for policy 1, policy_version 1252426 (0.0007) [2023-12-28 04:14:11,942][106226] Updated weights for policy 0, policy_version 1249246 (0.0008) [2023-12-28 04:14:11,966][106225] Updated weights for policy 1, policy_version 1252436 (0.0007) [2023-12-28 04:14:12,010][106226] Updated weights for policy 0, policy_version 1249256 (0.0008) [2023-12-28 04:14:12,027][106225] Updated weights for policy 1, policy_version 1252446 (0.0007) [2023-12-28 04:14:12,077][106226] Updated weights for policy 0, policy_version 1249266 (0.0008) [2023-12-28 04:14:12,096][106225] Updated weights for policy 1, policy_version 1252456 (0.0007) [2023-12-28 04:14:12,786][106225] Updated weights for policy 1, policy_version 1252466 (0.0008) [2023-12-28 04:14:12,845][106225] Updated weights for policy 1, policy_version 1252476 (0.0008) [2023-12-28 04:14:12,859][106226] Updated weights for policy 0, policy_version 1249276 (0.0009) [2023-12-28 04:14:12,907][106225] Updated weights for policy 1, policy_version 1252486 (0.0007) [2023-12-28 04:14:12,917][106226] Updated weights for policy 0, policy_version 1249286 (0.0010) [2023-12-28 04:14:12,965][106226] Updated weights for policy 0, policy_version 1249296 (0.0006) [2023-12-28 04:14:13,626][106226] Updated weights for policy 0, policy_version 1249306 (0.0009) [2023-12-28 04:14:13,628][106225] Updated weights for policy 1, policy_version 1252496 (0.0007) [2023-12-28 04:14:13,679][106225] Updated weights for policy 1, policy_version 1252506 (0.0007) [2023-12-28 04:14:13,692][106226] Updated weights for policy 0, policy_version 1249316 (0.0006) [2023-12-28 04:14:13,733][106225] Updated weights for policy 1, policy_version 1252516 (0.0006) [2023-12-28 04:14:13,754][106226] Updated weights for policy 0, policy_version 1249326 (0.0007) [2023-12-28 04:14:13,810][106226] Updated weights for policy 0, policy_version 1249336 (0.0009) [2023-12-28 04:14:14,477][106225] Updated weights for policy 1, policy_version 1252526 (0.0007) [2023-12-28 04:14:14,508][106226] Updated weights for policy 0, policy_version 1249346 (0.0006) [2023-12-28 04:14:14,533][106225] Updated weights for policy 1, policy_version 1252536 (0.0008) [2023-12-28 04:14:14,566][106226] Updated weights for policy 0, policy_version 1249356 (0.0007) [2023-12-28 04:14:14,595][106225] Updated weights for policy 1, policy_version 1252546 (0.0007) [2023-12-28 04:14:14,618][106226] Updated weights for policy 0, policy_version 1249366 (0.0006) [2023-12-28 04:14:15,285][106226] Updated weights for policy 0, policy_version 1249376 (0.0008) [2023-12-28 04:14:15,349][106226] Updated weights for policy 0, policy_version 1249386 (0.0008) [2023-12-28 04:14:15,355][106225] Updated weights for policy 1, policy_version 1252556 (0.0008) [2023-12-28 04:14:15,412][106226] Updated weights for policy 0, policy_version 1249396 (0.0007) [2023-12-28 04:14:15,415][106225] Updated weights for policy 1, policy_version 1252566 (0.0005) [2023-12-28 04:14:15,474][106225] Updated weights for policy 1, policy_version 1252576 (0.0009) [2023-12-28 04:14:16,118][106225] Updated weights for policy 1, policy_version 1252586 (0.0007) [2023-12-28 04:14:16,141][106226] Updated weights for policy 0, policy_version 1249406 (0.0006) [2023-12-28 04:14:16,174][105115] Fps is (10 sec: 18022.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 640614400. Throughput: 0: 9928.0, 1: 9993.1. Samples: 640610468. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:16,175][105115] Avg episode reward: [(0, '-4.185'), (1, '-4.987')] [2023-12-28 04:14:16,176][106225] Updated weights for policy 1, policy_version 1252596 (0.0006) [2023-12-28 04:14:16,198][106226] Updated weights for policy 0, policy_version 1249416 (0.0008) [2023-12-28 04:14:16,235][106225] Updated weights for policy 1, policy_version 1252606 (0.0005) [2023-12-28 04:14:16,254][106226] Updated weights for policy 0, policy_version 1249426 (0.0008) [2023-12-28 04:14:16,291][106225] Updated weights for policy 1, policy_version 1252616 (0.0005) [2023-12-28 04:14:16,890][106225] Updated weights for policy 1, policy_version 1252626 (0.0009) [2023-12-28 04:14:16,950][106226] Updated weights for policy 0, policy_version 1249436 (0.0007) [2023-12-28 04:14:16,954][106225] Updated weights for policy 1, policy_version 1252636 (0.0008) [2023-12-28 04:14:17,008][106226] Updated weights for policy 0, policy_version 1249446 (0.0005) [2023-12-28 04:14:17,015][106225] Updated weights for policy 1, policy_version 1252646 (0.0008) [2023-12-28 04:14:17,068][106226] Updated weights for policy 0, policy_version 1249456 (0.0005) [2023-12-28 04:14:17,695][106226] Updated weights for policy 0, policy_version 1249466 (0.0007) [2023-12-28 04:14:17,744][106225] Updated weights for policy 1, policy_version 1252656 (0.0006) [2023-12-28 04:14:17,758][106226] Updated weights for policy 0, policy_version 1249476 (0.0008) [2023-12-28 04:14:17,791][106225] Updated weights for policy 1, policy_version 1252666 (0.0007) [2023-12-28 04:14:17,814][106226] Updated weights for policy 0, policy_version 1249486 (0.0008) [2023-12-28 04:14:17,839][106225] Updated weights for policy 1, policy_version 1252676 (0.0005) [2023-12-28 04:14:17,871][106226] Updated weights for policy 0, policy_version 1249496 (0.0007) [2023-12-28 04:14:18,551][106226] Updated weights for policy 0, policy_version 1249506 (0.0006) [2023-12-28 04:14:18,606][106226] Updated weights for policy 0, policy_version 1249516 (0.0007) [2023-12-28 04:14:18,630][106225] Updated weights for policy 1, policy_version 1252686 (0.0007) [2023-12-28 04:14:18,661][106226] Updated weights for policy 0, policy_version 1249526 (0.0009) [2023-12-28 04:14:18,688][106225] Updated weights for policy 1, policy_version 1252696 (0.0007) [2023-12-28 04:14:18,745][106225] Updated weights for policy 1, policy_version 1252706 (0.0009) [2023-12-28 04:14:19,394][106226] Updated weights for policy 0, policy_version 1249536 (0.0008) [2023-12-28 04:14:19,450][106226] Updated weights for policy 0, policy_version 1249546 (0.0008) [2023-12-28 04:14:19,462][106225] Updated weights for policy 1, policy_version 1252716 (0.0008) [2023-12-28 04:14:19,515][106226] Updated weights for policy 0, policy_version 1249556 (0.0008) [2023-12-28 04:14:19,530][106225] Updated weights for policy 1, policy_version 1252726 (0.0007) [2023-12-28 04:14:19,594][106225] Updated weights for policy 1, policy_version 1252736 (0.0006) [2023-12-28 04:14:20,241][106226] Updated weights for policy 0, policy_version 1249566 (0.0006) [2023-12-28 04:14:20,291][106225] Updated weights for policy 1, policy_version 1252746 (0.0007) [2023-12-28 04:14:20,306][106226] Updated weights for policy 0, policy_version 1249576 (0.0007) [2023-12-28 04:14:20,351][106225] Updated weights for policy 1, policy_version 1252756 (0.0009) [2023-12-28 04:14:20,362][106226] Updated weights for policy 0, policy_version 1249586 (0.0007) [2023-12-28 04:14:20,417][106225] Updated weights for policy 1, policy_version 1252766 (0.0007) [2023-12-28 04:14:20,482][106225] Updated weights for policy 1, policy_version 1252776 (0.0008) [2023-12-28 04:14:21,074][106226] Updated weights for policy 0, policy_version 1249596 (0.0009) [2023-12-28 04:14:21,133][106226] Updated weights for policy 0, policy_version 1249606 (0.0010) [2023-12-28 04:14:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 640712704. Throughput: 0: 9838.0, 1: 10001.9. Samples: 640727884. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:21,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.797')] [2023-12-28 04:14:21,203][106226] Updated weights for policy 0, policy_version 1249616 (0.0011) [2023-12-28 04:14:21,257][106225] Updated weights for policy 1, policy_version 1252786 (0.0006) [2023-12-28 04:14:21,323][106225] Updated weights for policy 1, policy_version 1252796 (0.0008) [2023-12-28 04:14:21,400][106225] Updated weights for policy 1, policy_version 1252806 (0.0008) [2023-12-28 04:14:22,004][106226] Updated weights for policy 0, policy_version 1249626 (0.0010) [2023-12-28 04:14:22,068][106225] Updated weights for policy 1, policy_version 1252816 (0.0008) [2023-12-28 04:14:22,068][106226] Updated weights for policy 0, policy_version 1249636 (0.0007) [2023-12-28 04:14:22,128][106226] Updated weights for policy 0, policy_version 1249646 (0.0008) [2023-12-28 04:14:22,133][106225] Updated weights for policy 1, policy_version 1252826 (0.0007) [2023-12-28 04:14:22,191][106226] Updated weights for policy 0, policy_version 1249656 (0.0008) [2023-12-28 04:14:22,193][106225] Updated weights for policy 1, policy_version 1252836 (0.0006) [2023-12-28 04:14:22,834][106226] Updated weights for policy 0, policy_version 1249666 (0.0005) [2023-12-28 04:14:22,896][106226] Updated weights for policy 0, policy_version 1249676 (0.0006) [2023-12-28 04:14:22,950][106226] Updated weights for policy 0, policy_version 1249686 (0.0009) [2023-12-28 04:14:22,993][106225] Updated weights for policy 1, policy_version 1252846 (0.0009) [2023-12-28 04:14:23,050][106225] Updated weights for policy 1, policy_version 1252856 (0.0010) [2023-12-28 04:14:23,109][106225] Updated weights for policy 1, policy_version 1252866 (0.0009) [2023-12-28 04:14:23,648][106226] Updated weights for policy 0, policy_version 1249696 (0.0010) [2023-12-28 04:14:23,712][106226] Updated weights for policy 0, policy_version 1249706 (0.0011) [2023-12-28 04:14:23,723][106225] Updated weights for policy 1, policy_version 1252876 (0.0009) [2023-12-28 04:14:23,773][106226] Updated weights for policy 0, policy_version 1249716 (0.0011) [2023-12-28 04:14:23,786][106225] Updated weights for policy 1, policy_version 1252886 (0.0009) [2023-12-28 04:14:23,842][106225] Updated weights for policy 1, policy_version 1252896 (0.0010) [2023-12-28 04:14:24,432][106226] Updated weights for policy 0, policy_version 1249726 (0.0011) [2023-12-28 04:14:24,486][106225] Updated weights for policy 1, policy_version 1252906 (0.0007) [2023-12-28 04:14:24,490][106226] Updated weights for policy 0, policy_version 1249736 (0.0011) [2023-12-28 04:14:24,541][106226] Updated weights for policy 0, policy_version 1249746 (0.0011) [2023-12-28 04:14:24,548][106225] Updated weights for policy 1, policy_version 1252916 (0.0005) [2023-12-28 04:14:24,615][106225] Updated weights for policy 1, policy_version 1252926 (0.0007) [2023-12-28 04:14:24,675][106225] Updated weights for policy 1, policy_version 1252936 (0.0007) [2023-12-28 04:14:25,213][106226] Updated weights for policy 0, policy_version 1249756 (0.0008) [2023-12-28 04:14:25,267][106226] Updated weights for policy 0, policy_version 1249766 (0.0005) [2023-12-28 04:14:25,320][106226] Updated weights for policy 0, policy_version 1249776 (0.0005) [2023-12-28 04:14:25,363][106225] Updated weights for policy 1, policy_version 1252946 (0.0008) [2023-12-28 04:14:25,419][106225] Updated weights for policy 1, policy_version 1252956 (0.0007) [2023-12-28 04:14:25,472][106225] Updated weights for policy 1, policy_version 1252966 (0.0007) [2023-12-28 04:14:25,833][106226] Updated weights for policy 0, policy_version 1249786 (0.0007) [2023-12-28 04:14:25,895][106226] Updated weights for policy 0, policy_version 1249796 (0.0007) [2023-12-28 04:14:25,944][106226] Updated weights for policy 0, policy_version 1249806 (0.0005) [2023-12-28 04:14:26,005][106226] Updated weights for policy 0, policy_version 1249816 (0.0005) [2023-12-28 04:14:26,175][105115] Fps is (10 sec: 20479.4, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 640819200. Throughput: 0: 9881.5, 1: 9954.6. Samples: 640786664. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:26,176][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.033')] [2023-12-28 04:14:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001252968_320806912.pth... [2023-12-28 04:14:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001249816_320012288.pth... [2023-12-28 04:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001251816_320512000.pth [2023-12-28 04:14:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001248664_319717376.pth [2023-12-28 04:14:26,276][106225] Updated weights for policy 1, policy_version 1252976 (0.0008) [2023-12-28 04:14:26,335][106225] Updated weights for policy 1, policy_version 1252986 (0.0008) [2023-12-28 04:14:26,387][106225] Updated weights for policy 1, policy_version 1252996 (0.0008) [2023-12-28 04:14:26,632][106226] Updated weights for policy 0, policy_version 1249826 (0.0007) [2023-12-28 04:14:26,688][106226] Updated weights for policy 0, policy_version 1249836 (0.0005) [2023-12-28 04:14:26,740][106226] Updated weights for policy 0, policy_version 1249846 (0.0007) [2023-12-28 04:14:27,133][106225] Updated weights for policy 1, policy_version 1253006 (0.0008) [2023-12-28 04:14:27,188][106225] Updated weights for policy 1, policy_version 1253016 (0.0008) [2023-12-28 04:14:27,235][106225] Updated weights for policy 1, policy_version 1253026 (0.0008) [2023-12-28 04:14:27,399][106226] Updated weights for policy 0, policy_version 1249856 (0.0006) [2023-12-28 04:14:27,445][106226] Updated weights for policy 0, policy_version 1249866 (0.0005) [2023-12-28 04:14:27,493][106226] Updated weights for policy 0, policy_version 1249876 (0.0006) [2023-12-28 04:14:28,021][106226] Updated weights for policy 0, policy_version 1249886 (0.0005) [2023-12-28 04:14:28,073][106226] Updated weights for policy 0, policy_version 1249896 (0.0007) [2023-12-28 04:14:28,083][106225] Updated weights for policy 1, policy_version 1253036 (0.0008) [2023-12-28 04:14:28,121][106226] Updated weights for policy 0, policy_version 1249906 (0.0007) [2023-12-28 04:14:28,134][106225] Updated weights for policy 1, policy_version 1253046 (0.0006) [2023-12-28 04:14:28,191][106225] Updated weights for policy 1, policy_version 1253056 (0.0008) [2023-12-28 04:14:28,836][106226] Updated weights for policy 0, policy_version 1249916 (0.0008) [2023-12-28 04:14:28,898][106226] Updated weights for policy 0, policy_version 1249926 (0.0011) [2023-12-28 04:14:28,955][106226] Updated weights for policy 0, policy_version 1249936 (0.0010) [2023-12-28 04:14:28,969][106225] Updated weights for policy 1, policy_version 1253066 (0.0008) [2023-12-28 04:14:29,026][106225] Updated weights for policy 1, policy_version 1253076 (0.0007) [2023-12-28 04:14:29,080][106225] Updated weights for policy 1, policy_version 1253086 (0.0008) [2023-12-28 04:14:29,143][106225] Updated weights for policy 1, policy_version 1253096 (0.0008) [2023-12-28 04:14:29,653][106226] Updated weights for policy 0, policy_version 1249946 (0.0007) [2023-12-28 04:14:29,705][106226] Updated weights for policy 0, policy_version 1249956 (0.0008) [2023-12-28 04:14:29,761][106226] Updated weights for policy 0, policy_version 1249966 (0.0006) [2023-12-28 04:14:29,823][106226] Updated weights for policy 0, policy_version 1249976 (0.0007) [2023-12-28 04:14:29,867][106225] Updated weights for policy 1, policy_version 1253106 (0.0008) [2023-12-28 04:14:29,927][106225] Updated weights for policy 1, policy_version 1253116 (0.0006) [2023-12-28 04:14:29,991][106225] Updated weights for policy 1, policy_version 1253126 (0.0007) [2023-12-28 04:14:30,514][106226] Updated weights for policy 0, policy_version 1249986 (0.0009) [2023-12-28 04:14:30,562][106226] Updated weights for policy 0, policy_version 1249996 (0.0007) [2023-12-28 04:14:30,618][106226] Updated weights for policy 0, policy_version 1250006 (0.0005) [2023-12-28 04:14:30,650][106225] Updated weights for policy 1, policy_version 1253136 (0.0008) [2023-12-28 04:14:30,710][106225] Updated weights for policy 1, policy_version 1253146 (0.0007) [2023-12-28 04:14:30,760][106225] Updated weights for policy 1, policy_version 1253156 (0.0008) [2023-12-28 04:14:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 640917504. Throughput: 0: 10053.1, 1: 9869.2. Samples: 640907832. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:31,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.759')] [2023-12-28 04:14:31,405][106226] Updated weights for policy 0, policy_version 1250016 (0.0007) [2023-12-28 04:14:31,437][106225] Updated weights for policy 1, policy_version 1253166 (0.0007) [2023-12-28 04:14:31,459][106226] Updated weights for policy 0, policy_version 1250026 (0.0006) [2023-12-28 04:14:31,489][106225] Updated weights for policy 1, policy_version 1253176 (0.0006) [2023-12-28 04:14:31,517][106226] Updated weights for policy 0, policy_version 1250036 (0.0008) [2023-12-28 04:14:31,539][106225] Updated weights for policy 1, policy_version 1253186 (0.0006) [2023-12-28 04:14:32,195][106225] Updated weights for policy 1, policy_version 1253196 (0.0005) [2023-12-28 04:14:32,252][106225] Updated weights for policy 1, policy_version 1253206 (0.0007) [2023-12-28 04:14:32,310][106225] Updated weights for policy 1, policy_version 1253216 (0.0008) [2023-12-28 04:14:32,336][106226] Updated weights for policy 0, policy_version 1250046 (0.0007) [2023-12-28 04:14:32,407][106226] Updated weights for policy 0, policy_version 1250056 (0.0006) [2023-12-28 04:14:32,475][106226] Updated weights for policy 0, policy_version 1250066 (0.0009) [2023-12-28 04:14:32,968][106225] Updated weights for policy 1, policy_version 1253226 (0.0008) [2023-12-28 04:14:33,006][106226] Updated weights for policy 0, policy_version 1250076 (0.0005) [2023-12-28 04:14:33,012][106225] Updated weights for policy 1, policy_version 1253236 (0.0008) [2023-12-28 04:14:33,062][106225] Updated weights for policy 1, policy_version 1253246 (0.0005) [2023-12-28 04:14:33,070][106226] Updated weights for policy 0, policy_version 1250086 (0.0006) [2023-12-28 04:14:33,112][106225] Updated weights for policy 1, policy_version 1253256 (0.0007) [2023-12-28 04:14:33,130][106226] Updated weights for policy 0, policy_version 1250096 (0.0008) [2023-12-28 04:14:33,767][106225] Updated weights for policy 1, policy_version 1253266 (0.0008) [2023-12-28 04:14:33,821][106225] Updated weights for policy 1, policy_version 1253276 (0.0008) [2023-12-28 04:14:33,836][106226] Updated weights for policy 0, policy_version 1250106 (0.0008) [2023-12-28 04:14:33,865][106225] Updated weights for policy 1, policy_version 1253286 (0.0007) [2023-12-28 04:14:33,884][106226] Updated weights for policy 0, policy_version 1250116 (0.0006) [2023-12-28 04:14:33,942][106226] Updated weights for policy 0, policy_version 1250126 (0.0008) [2023-12-28 04:14:33,989][106226] Updated weights for policy 0, policy_version 1250136 (0.0007) [2023-12-28 04:14:34,557][106225] Updated weights for policy 1, policy_version 1253296 (0.0007) [2023-12-28 04:14:34,615][106225] Updated weights for policy 1, policy_version 1253306 (0.0008) [2023-12-28 04:14:34,677][106225] Updated weights for policy 1, policy_version 1253316 (0.0009) [2023-12-28 04:14:34,764][106226] Updated weights for policy 0, policy_version 1250146 (0.0010) [2023-12-28 04:14:34,822][106226] Updated weights for policy 0, policy_version 1250156 (0.0009) [2023-12-28 04:14:34,875][106226] Updated weights for policy 0, policy_version 1250166 (0.0009) [2023-12-28 04:14:35,340][106225] Updated weights for policy 1, policy_version 1253326 (0.0006) [2023-12-28 04:14:35,393][106225] Updated weights for policy 1, policy_version 1253336 (0.0007) [2023-12-28 04:14:35,443][106225] Updated weights for policy 1, policy_version 1253346 (0.0009) [2023-12-28 04:14:35,572][106226] Updated weights for policy 0, policy_version 1250176 (0.0006) [2023-12-28 04:14:35,633][106226] Updated weights for policy 0, policy_version 1250186 (0.0005) [2023-12-28 04:14:35,693][106226] Updated weights for policy 0, policy_version 1250196 (0.0005) [2023-12-28 04:14:36,072][106225] Updated weights for policy 1, policy_version 1253356 (0.0008) [2023-12-28 04:14:36,143][106225] Updated weights for policy 1, policy_version 1253366 (0.0009) [2023-12-28 04:14:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 641015808. Throughput: 0: 10047.3, 1: 9893.5. Samples: 641030276. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:36,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.164')] [2023-12-28 04:14:36,207][106225] Updated weights for policy 1, policy_version 1253376 (0.0009) [2023-12-28 04:14:36,327][106226] Updated weights for policy 0, policy_version 1250206 (0.0007) [2023-12-28 04:14:36,392][106226] Updated weights for policy 0, policy_version 1250216 (0.0007) [2023-12-28 04:14:36,455][106226] Updated weights for policy 0, policy_version 1250226 (0.0008) [2023-12-28 04:14:37,012][106226] Updated weights for policy 0, policy_version 1250236 (0.0008) [2023-12-28 04:14:37,014][106225] Updated weights for policy 1, policy_version 1253386 (0.0008) [2023-12-28 04:14:37,074][106226] Updated weights for policy 0, policy_version 1250246 (0.0008) [2023-12-28 04:14:37,080][106225] Updated weights for policy 1, policy_version 1253396 (0.0005) [2023-12-28 04:14:37,119][106226] Updated weights for policy 0, policy_version 1250256 (0.0005) [2023-12-28 04:14:37,138][106225] Updated weights for policy 1, policy_version 1253406 (0.0008) [2023-12-28 04:14:37,194][106225] Updated weights for policy 1, policy_version 1253416 (0.0007) [2023-12-28 04:14:37,845][106226] Updated weights for policy 0, policy_version 1250266 (0.0008) [2023-12-28 04:14:37,888][106225] Updated weights for policy 1, policy_version 1253426 (0.0005) [2023-12-28 04:14:37,897][106226] Updated weights for policy 0, policy_version 1250276 (0.0005) [2023-12-28 04:14:37,952][106225] Updated weights for policy 1, policy_version 1253436 (0.0006) [2023-12-28 04:14:37,955][106226] Updated weights for policy 0, policy_version 1250286 (0.0008) [2023-12-28 04:14:38,009][106226] Updated weights for policy 0, policy_version 1250296 (0.0007) [2023-12-28 04:14:38,013][106225] Updated weights for policy 1, policy_version 1253446 (0.0007) [2023-12-28 04:14:38,613][106226] Updated weights for policy 0, policy_version 1250306 (0.0007) [2023-12-28 04:14:38,675][106226] Updated weights for policy 0, policy_version 1250316 (0.0006) [2023-12-28 04:14:38,684][106225] Updated weights for policy 1, policy_version 1253456 (0.0010) [2023-12-28 04:14:38,725][106226] Updated weights for policy 0, policy_version 1250326 (0.0006) [2023-12-28 04:14:38,739][106225] Updated weights for policy 1, policy_version 1253466 (0.0010) [2023-12-28 04:14:38,800][106225] Updated weights for policy 1, policy_version 1253476 (0.0010) [2023-12-28 04:14:39,394][106226] Updated weights for policy 0, policy_version 1250336 (0.0010) [2023-12-28 04:14:39,462][106226] Updated weights for policy 0, policy_version 1250346 (0.0008) [2023-12-28 04:14:39,530][106226] Updated weights for policy 0, policy_version 1250356 (0.0009) [2023-12-28 04:14:39,563][106225] Updated weights for policy 1, policy_version 1253486 (0.0008) [2023-12-28 04:14:39,625][106225] Updated weights for policy 1, policy_version 1253496 (0.0009) [2023-12-28 04:14:39,688][106225] Updated weights for policy 1, policy_version 1253506 (0.0009) [2023-12-28 04:14:40,294][106226] Updated weights for policy 0, policy_version 1250366 (0.0007) [2023-12-28 04:14:40,356][106226] Updated weights for policy 0, policy_version 1250376 (0.0008) [2023-12-28 04:14:40,423][106226] Updated weights for policy 0, policy_version 1250386 (0.0009) [2023-12-28 04:14:40,490][106225] Updated weights for policy 1, policy_version 1253516 (0.0009) [2023-12-28 04:14:40,546][106225] Updated weights for policy 1, policy_version 1253526 (0.0008) [2023-12-28 04:14:40,598][106225] Updated weights for policy 1, policy_version 1253536 (0.0008) [2023-12-28 04:14:41,156][106226] Updated weights for policy 0, policy_version 1250396 (0.0008) [2023-12-28 04:14:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 641114112. Throughput: 0: 10093.9, 1: 9898.6. Samples: 641090948. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:41,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-4.914')] [2023-12-28 04:14:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001253544_320954368.pth... [2023-12-28 04:14:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001252424_320667648.pth [2023-12-28 04:14:41,204][106226] Updated weights for policy 0, policy_version 1250406 (0.0008) [2023-12-28 04:14:41,269][106226] Updated weights for policy 0, policy_version 1250416 (0.0008) [2023-12-28 04:14:41,318][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001250424_320167936.pth... [2023-12-28 04:14:41,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001249240_319864832.pth [2023-12-28 04:14:41,383][106225] Updated weights for policy 1, policy_version 1253546 (0.0009) [2023-12-28 04:14:41,447][106225] Updated weights for policy 1, policy_version 1253556 (0.0008) [2023-12-28 04:14:41,505][106225] Updated weights for policy 1, policy_version 1253566 (0.0007) [2023-12-28 04:14:41,559][106225] Updated weights for policy 1, policy_version 1253576 (0.0007) [2023-12-28 04:14:42,073][106226] Updated weights for policy 0, policy_version 1250426 (0.0008) [2023-12-28 04:14:42,136][106226] Updated weights for policy 0, policy_version 1250436 (0.0008) [2023-12-28 04:14:42,198][106226] Updated weights for policy 0, policy_version 1250446 (0.0008) [2023-12-28 04:14:42,262][106226] Updated weights for policy 0, policy_version 1250456 (0.0007) [2023-12-28 04:14:42,331][106225] Updated weights for policy 1, policy_version 1253586 (0.0011) [2023-12-28 04:14:42,399][106225] Updated weights for policy 1, policy_version 1253596 (0.0008) [2023-12-28 04:14:42,464][106225] Updated weights for policy 1, policy_version 1253606 (0.0011) [2023-12-28 04:14:42,994][106226] Updated weights for policy 0, policy_version 1250466 (0.0011) [2023-12-28 04:14:43,059][106226] Updated weights for policy 0, policy_version 1250476 (0.0011) [2023-12-28 04:14:43,126][106226] Updated weights for policy 0, policy_version 1250486 (0.0011) [2023-12-28 04:14:43,164][106225] Updated weights for policy 1, policy_version 1253616 (0.0007) [2023-12-28 04:14:43,224][106225] Updated weights for policy 1, policy_version 1253626 (0.0007) [2023-12-28 04:14:43,282][106225] Updated weights for policy 1, policy_version 1253636 (0.0008) [2023-12-28 04:14:43,772][106226] Updated weights for policy 0, policy_version 1250496 (0.0007) [2023-12-28 04:14:43,824][106226] Updated weights for policy 0, policy_version 1250506 (0.0005) [2023-12-28 04:14:43,872][106226] Updated weights for policy 0, policy_version 1250516 (0.0006) [2023-12-28 04:14:43,957][106225] Updated weights for policy 1, policy_version 1253646 (0.0008) [2023-12-28 04:14:44,015][106225] Updated weights for policy 1, policy_version 1253656 (0.0009) [2023-12-28 04:14:44,077][106225] Updated weights for policy 1, policy_version 1253666 (0.0009) [2023-12-28 04:14:44,479][106226] Updated weights for policy 0, policy_version 1250526 (0.0009) [2023-12-28 04:14:44,540][106226] Updated weights for policy 0, policy_version 1250536 (0.0008) [2023-12-28 04:14:44,592][106226] Updated weights for policy 0, policy_version 1250546 (0.0009) [2023-12-28 04:14:44,867][106225] Updated weights for policy 1, policy_version 1253676 (0.0008) [2023-12-28 04:14:44,935][106225] Updated weights for policy 1, policy_version 1253686 (0.0009) [2023-12-28 04:14:45,005][106225] Updated weights for policy 1, policy_version 1253696 (0.0008) [2023-12-28 04:14:45,314][106226] Updated weights for policy 0, policy_version 1250556 (0.0009) [2023-12-28 04:14:45,378][106226] Updated weights for policy 0, policy_version 1250566 (0.0011) [2023-12-28 04:14:45,436][106226] Updated weights for policy 0, policy_version 1250576 (0.0010) [2023-12-28 04:14:45,670][106225] Updated weights for policy 1, policy_version 1253706 (0.0008) [2023-12-28 04:14:45,720][106225] Updated weights for policy 1, policy_version 1253716 (0.0008) [2023-12-28 04:14:45,772][106225] Updated weights for policy 1, policy_version 1253726 (0.0007) [2023-12-28 04:14:45,825][106225] Updated weights for policy 1, policy_version 1253736 (0.0007) [2023-12-28 04:14:46,127][106226] Updated weights for policy 0, policy_version 1250586 (0.0010) [2023-12-28 04:14:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 641212416. Throughput: 0: 10024.0, 1: 9790.3. Samples: 641204708. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:46,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.823')] [2023-12-28 04:14:46,187][106226] Updated weights for policy 0, policy_version 1250596 (0.0009) [2023-12-28 04:14:46,243][106226] Updated weights for policy 0, policy_version 1250606 (0.0007) [2023-12-28 04:14:46,302][106226] Updated weights for policy 0, policy_version 1250616 (0.0008) [2023-12-28 04:14:46,526][106225] Updated weights for policy 1, policy_version 1253746 (0.0005) [2023-12-28 04:14:46,576][106225] Updated weights for policy 1, policy_version 1253756 (0.0007) [2023-12-28 04:14:46,625][106225] Updated weights for policy 1, policy_version 1253766 (0.0007) [2023-12-28 04:14:47,023][106226] Updated weights for policy 0, policy_version 1250626 (0.0005) [2023-12-28 04:14:47,090][106226] Updated weights for policy 0, policy_version 1250636 (0.0006) [2023-12-28 04:14:47,137][106226] Updated weights for policy 0, policy_version 1250646 (0.0008) [2023-12-28 04:14:47,334][106225] Updated weights for policy 1, policy_version 1253776 (0.0010) [2023-12-28 04:14:47,392][106225] Updated weights for policy 1, policy_version 1253786 (0.0010) [2023-12-28 04:14:47,438][106225] Updated weights for policy 1, policy_version 1253796 (0.0010) [2023-12-28 04:14:47,776][106226] Updated weights for policy 0, policy_version 1250656 (0.0006) [2023-12-28 04:14:47,834][106226] Updated weights for policy 0, policy_version 1250666 (0.0006) [2023-12-28 04:14:47,898][106226] Updated weights for policy 0, policy_version 1250676 (0.0005) [2023-12-28 04:14:48,144][106225] Updated weights for policy 1, policy_version 1253806 (0.0010) [2023-12-28 04:14:48,203][106225] Updated weights for policy 1, policy_version 1253816 (0.0010) [2023-12-28 04:14:48,252][106225] Updated weights for policy 1, policy_version 1253826 (0.0010) [2023-12-28 04:14:48,547][106226] Updated weights for policy 0, policy_version 1250686 (0.0009) [2023-12-28 04:14:48,603][106226] Updated weights for policy 0, policy_version 1250696 (0.0009) [2023-12-28 04:14:48,665][106226] Updated weights for policy 0, policy_version 1250706 (0.0009) [2023-12-28 04:14:48,945][106225] Updated weights for policy 1, policy_version 1253836 (0.0008) [2023-12-28 04:14:49,006][106225] Updated weights for policy 1, policy_version 1253846 (0.0006) [2023-12-28 04:14:49,067][106225] Updated weights for policy 1, policy_version 1253856 (0.0008) [2023-12-28 04:14:49,427][106226] Updated weights for policy 0, policy_version 1250716 (0.0008) [2023-12-28 04:14:49,493][106226] Updated weights for policy 0, policy_version 1250726 (0.0005) [2023-12-28 04:14:49,551][106226] Updated weights for policy 0, policy_version 1250736 (0.0006) [2023-12-28 04:14:49,779][106225] Updated weights for policy 1, policy_version 1253866 (0.0008) [2023-12-28 04:14:49,841][106225] Updated weights for policy 1, policy_version 1253876 (0.0009) [2023-12-28 04:14:49,905][106225] Updated weights for policy 1, policy_version 1253886 (0.0008) [2023-12-28 04:14:49,968][106225] Updated weights for policy 1, policy_version 1253896 (0.0008) [2023-12-28 04:14:50,162][106226] Updated weights for policy 0, policy_version 1250746 (0.0006) [2023-12-28 04:14:50,217][106226] Updated weights for policy 0, policy_version 1250756 (0.0009) [2023-12-28 04:14:50,276][106226] Updated weights for policy 0, policy_version 1250766 (0.0010) [2023-12-28 04:14:50,343][106226] Updated weights for policy 0, policy_version 1250776 (0.0009) [2023-12-28 04:14:50,615][106225] Updated weights for policy 1, policy_version 1253906 (0.0007) [2023-12-28 04:14:50,667][106225] Updated weights for policy 1, policy_version 1253916 (0.0009) [2023-12-28 04:14:50,716][106225] Updated weights for policy 1, policy_version 1253926 (0.0008) [2023-12-28 04:14:51,073][106226] Updated weights for policy 0, policy_version 1250786 (0.0009) [2023-12-28 04:14:51,138][106226] Updated weights for policy 0, policy_version 1250796 (0.0008) [2023-12-28 04:14:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 641310720. Throughput: 0: 9961.2, 1: 9740.3. Samples: 641324744. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:51,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.860')] [2023-12-28 04:14:51,201][106226] Updated weights for policy 0, policy_version 1250806 (0.0007) [2023-12-28 04:14:51,586][106225] Updated weights for policy 1, policy_version 1253936 (0.0007) [2023-12-28 04:14:51,664][106225] Updated weights for policy 1, policy_version 1253946 (0.0008) [2023-12-28 04:14:51,725][106225] Updated weights for policy 1, policy_version 1253956 (0.0009) [2023-12-28 04:14:51,940][106226] Updated weights for policy 0, policy_version 1250816 (0.0008) [2023-12-28 04:14:51,999][106226] Updated weights for policy 0, policy_version 1250826 (0.0005) [2023-12-28 04:14:52,060][106226] Updated weights for policy 0, policy_version 1250836 (0.0005) [2023-12-28 04:14:52,486][106225] Updated weights for policy 1, policy_version 1253966 (0.0008) [2023-12-28 04:14:52,551][106225] Updated weights for policy 1, policy_version 1253976 (0.0008) [2023-12-28 04:14:52,611][106225] Updated weights for policy 1, policy_version 1253986 (0.0009) [2023-12-28 04:14:52,763][106226] Updated weights for policy 0, policy_version 1250846 (0.0009) [2023-12-28 04:14:52,824][106226] Updated weights for policy 0, policy_version 1250856 (0.0009) [2023-12-28 04:14:52,873][106226] Updated weights for policy 0, policy_version 1250866 (0.0008) [2023-12-28 04:14:53,343][106225] Updated weights for policy 1, policy_version 1253996 (0.0008) [2023-12-28 04:14:53,398][106225] Updated weights for policy 1, policy_version 1254006 (0.0008) [2023-12-28 04:14:53,457][106225] Updated weights for policy 1, policy_version 1254016 (0.0010) [2023-12-28 04:14:53,628][106226] Updated weights for policy 0, policy_version 1250876 (0.0009) [2023-12-28 04:14:53,689][106226] Updated weights for policy 0, policy_version 1250886 (0.0008) [2023-12-28 04:14:53,749][106226] Updated weights for policy 0, policy_version 1250896 (0.0008) [2023-12-28 04:14:54,225][106225] Updated weights for policy 1, policy_version 1254026 (0.0009) [2023-12-28 04:14:54,287][106225] Updated weights for policy 1, policy_version 1254036 (0.0005) [2023-12-28 04:14:54,349][106225] Updated weights for policy 1, policy_version 1254046 (0.0005) [2023-12-28 04:14:54,401][106225] Updated weights for policy 1, policy_version 1254056 (0.0006) [2023-12-28 04:14:54,445][106226] Updated weights for policy 0, policy_version 1250906 (0.0008) [2023-12-28 04:14:54,497][106226] Updated weights for policy 0, policy_version 1250916 (0.0008) [2023-12-28 04:14:54,548][106226] Updated weights for policy 0, policy_version 1250926 (0.0009) [2023-12-28 04:14:54,607][106226] Updated weights for policy 0, policy_version 1250936 (0.0009) [2023-12-28 04:14:55,059][106225] Updated weights for policy 1, policy_version 1254066 (0.0010) [2023-12-28 04:14:55,120][106225] Updated weights for policy 1, policy_version 1254076 (0.0010) [2023-12-28 04:14:55,177][106225] Updated weights for policy 1, policy_version 1254086 (0.0010) [2023-12-28 04:14:55,370][106226] Updated weights for policy 0, policy_version 1250946 (0.0008) [2023-12-28 04:14:55,434][106226] Updated weights for policy 0, policy_version 1250956 (0.0011) [2023-12-28 04:14:55,494][106226] Updated weights for policy 0, policy_version 1250966 (0.0010) [2023-12-28 04:14:55,904][106225] Updated weights for policy 1, policy_version 1254096 (0.0010) [2023-12-28 04:14:55,954][106225] Updated weights for policy 1, policy_version 1254106 (0.0008) [2023-12-28 04:14:56,002][106225] Updated weights for policy 1, policy_version 1254116 (0.0005) [2023-12-28 04:14:56,158][106226] Updated weights for policy 0, policy_version 1250976 (0.0008) [2023-12-28 04:14:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 641409024. Throughput: 0: 9971.1, 1: 9660.9. Samples: 641380308. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:14:56,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.948')] [2023-12-28 04:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001254120_321101824.pth... [2023-12-28 04:14:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001252968_320806912.pth [2023-12-28 04:14:56,222][106226] Updated weights for policy 0, policy_version 1250986 (0.0009) [2023-12-28 04:14:56,286][106226] Updated weights for policy 0, policy_version 1250996 (0.0008) [2023-12-28 04:14:56,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001251000_320315392.pth... [2023-12-28 04:14:56,316][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001249816_320012288.pth [2023-12-28 04:14:56,670][106225] Updated weights for policy 1, policy_version 1254126 (0.0006) [2023-12-28 04:14:56,714][106225] Updated weights for policy 1, policy_version 1254136 (0.0005) [2023-12-28 04:14:56,764][106225] Updated weights for policy 1, policy_version 1254146 (0.0005) [2023-12-28 04:14:57,049][106226] Updated weights for policy 0, policy_version 1251006 (0.0008) [2023-12-28 04:14:57,109][106226] Updated weights for policy 0, policy_version 1251016 (0.0007) [2023-12-28 04:14:57,165][106226] Updated weights for policy 0, policy_version 1251026 (0.0008) [2023-12-28 04:14:57,401][106225] Updated weights for policy 1, policy_version 1254156 (0.0007) [2023-12-28 04:14:57,465][106225] Updated weights for policy 1, policy_version 1254166 (0.0010) [2023-12-28 04:14:57,520][106225] Updated weights for policy 1, policy_version 1254176 (0.0010) [2023-12-28 04:14:57,858][106226] Updated weights for policy 0, policy_version 1251036 (0.0007) [2023-12-28 04:14:57,909][106226] Updated weights for policy 0, policy_version 1251047 (0.0009) [2023-12-28 04:14:57,958][106226] Updated weights for policy 0, policy_version 1251057 (0.0007) [2023-12-28 04:14:58,235][106225] Updated weights for policy 1, policy_version 1254186 (0.0010) [2023-12-28 04:14:58,290][106225] Updated weights for policy 1, policy_version 1254196 (0.0011) [2023-12-28 04:14:58,364][106225] Updated weights for policy 1, policy_version 1254206 (0.0011) [2023-12-28 04:14:58,429][106225] Updated weights for policy 1, policy_version 1254216 (0.0009) [2023-12-28 04:14:58,740][106226] Updated weights for policy 0, policy_version 1251067 (0.0010) [2023-12-28 04:14:58,805][106226] Updated weights for policy 0, policy_version 1251077 (0.0009) [2023-12-28 04:14:58,878][106226] Updated weights for policy 0, policy_version 1251087 (0.0010) [2023-12-28 04:14:59,217][106225] Updated weights for policy 1, policy_version 1254226 (0.0009) [2023-12-28 04:14:59,312][106225] Updated weights for policy 1, policy_version 1254240 (0.0009) [2023-12-28 04:14:59,654][106226] Updated weights for policy 0, policy_version 1251097 (0.0009) [2023-12-28 04:14:59,712][106226] Updated weights for policy 0, policy_version 1251107 (0.0006) [2023-12-28 04:14:59,780][106226] Updated weights for policy 0, policy_version 1251117 (0.0007) [2023-12-28 04:14:59,846][106226] Updated weights for policy 0, policy_version 1251127 (0.0011) [2023-12-28 04:15:00,092][106225] Updated weights for policy 1, policy_version 1254250 (0.0009) [2023-12-28 04:15:00,148][106225] Updated weights for policy 1, policy_version 1254260 (0.0009) [2023-12-28 04:15:00,202][106225] Updated weights for policy 1, policy_version 1254270 (0.0010) [2023-12-28 04:15:00,260][106225] Updated weights for policy 1, policy_version 1254280 (0.0010) [2023-12-28 04:15:00,561][106226] Updated weights for policy 0, policy_version 1251137 (0.0011) [2023-12-28 04:15:00,613][106226] Updated weights for policy 0, policy_version 1251147 (0.0010) [2023-12-28 04:15:00,669][106226] Updated weights for policy 0, policy_version 1251157 (0.0010) [2023-12-28 04:15:00,970][106225] Updated weights for policy 1, policy_version 1254290 (0.0009) [2023-12-28 04:15:01,028][106225] Updated weights for policy 1, policy_version 1254300 (0.0009) [2023-12-28 04:15:01,095][106225] Updated weights for policy 1, policy_version 1254310 (0.0007) [2023-12-28 04:15:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 641507328. Throughput: 0: 9939.5, 1: 9732.8. Samples: 641495724. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:15:01,175][105115] Avg episode reward: [(0, '-4.194'), (1, '-5.016')] [2023-12-28 04:15:01,329][106226] Updated weights for policy 0, policy_version 1251167 (0.0009) [2023-12-28 04:15:01,392][106226] Updated weights for policy 0, policy_version 1251177 (0.0008) [2023-12-28 04:15:01,456][106226] Updated weights for policy 0, policy_version 1251187 (0.0009) [2023-12-28 04:15:01,797][106225] Updated weights for policy 1, policy_version 1254320 (0.0008) [2023-12-28 04:15:01,858][106225] Updated weights for policy 1, policy_version 1254330 (0.0007) [2023-12-28 04:15:01,919][106225] Updated weights for policy 1, policy_version 1254340 (0.0010) [2023-12-28 04:15:02,243][106226] Updated weights for policy 0, policy_version 1251197 (0.0009) [2023-12-28 04:15:02,300][106226] Updated weights for policy 0, policy_version 1251207 (0.0008) [2023-12-28 04:15:02,367][106226] Updated weights for policy 0, policy_version 1251217 (0.0008) [2023-12-28 04:15:02,600][106225] Updated weights for policy 1, policy_version 1254350 (0.0010) [2023-12-28 04:15:02,664][106225] Updated weights for policy 1, policy_version 1254360 (0.0008) [2023-12-28 04:15:02,730][106225] Updated weights for policy 1, policy_version 1254370 (0.0006) [2023-12-28 04:15:03,121][106226] Updated weights for policy 0, policy_version 1251227 (0.0009) [2023-12-28 04:15:03,177][106226] Updated weights for policy 0, policy_version 1251237 (0.0009) [2023-12-28 04:15:03,236][106226] Updated weights for policy 0, policy_version 1251247 (0.0008) [2023-12-28 04:15:03,377][106225] Updated weights for policy 1, policy_version 1254380 (0.0008) [2023-12-28 04:15:03,426][106225] Updated weights for policy 1, policy_version 1254390 (0.0005) [2023-12-28 04:15:03,477][106225] Updated weights for policy 1, policy_version 1254400 (0.0005) [2023-12-28 04:15:03,920][106226] Updated weights for policy 0, policy_version 1251257 (0.0009) [2023-12-28 04:15:03,979][106226] Updated weights for policy 0, policy_version 1251267 (0.0008) [2023-12-28 04:15:04,038][106226] Updated weights for policy 0, policy_version 1251277 (0.0008) [2023-12-28 04:15:04,091][106226] Updated weights for policy 0, policy_version 1251287 (0.0008) [2023-12-28 04:15:04,170][106225] Updated weights for policy 1, policy_version 1254410 (0.0008) [2023-12-28 04:15:04,229][106225] Updated weights for policy 1, policy_version 1254420 (0.0010) [2023-12-28 04:15:04,279][106225] Updated weights for policy 1, policy_version 1254430 (0.0010) [2023-12-28 04:15:04,334][106225] Updated weights for policy 1, policy_version 1254440 (0.0010) [2023-12-28 04:15:04,788][106226] Updated weights for policy 0, policy_version 1251297 (0.0005) [2023-12-28 04:15:04,834][106226] Updated weights for policy 0, policy_version 1251307 (0.0005) [2023-12-28 04:15:04,882][106226] Updated weights for policy 0, policy_version 1251317 (0.0005) [2023-12-28 04:15:05,069][106225] Updated weights for policy 1, policy_version 1254450 (0.0011) [2023-12-28 04:15:05,119][106225] Updated weights for policy 1, policy_version 1254460 (0.0010) [2023-12-28 04:15:05,170][106225] Updated weights for policy 1, policy_version 1254470 (0.0010) [2023-12-28 04:15:05,487][106226] Updated weights for policy 0, policy_version 1251327 (0.0007) [2023-12-28 04:15:05,544][106226] Updated weights for policy 0, policy_version 1251337 (0.0008) [2023-12-28 04:15:05,605][106226] Updated weights for policy 0, policy_version 1251347 (0.0008) [2023-12-28 04:15:05,922][106225] Updated weights for policy 1, policy_version 1254480 (0.0006) [2023-12-28 04:15:05,995][106225] Updated weights for policy 1, policy_version 1254490 (0.0007) [2023-12-28 04:15:06,055][106225] Updated weights for policy 1, policy_version 1254500 (0.0007) [2023-12-28 04:15:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 641605632. Throughput: 0: 9960.8, 1: 9741.3. Samples: 641614480. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:15:06,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.210')] [2023-12-28 04:15:06,308][106226] Updated weights for policy 0, policy_version 1251357 (0.0007) [2023-12-28 04:15:06,375][106226] Updated weights for policy 0, policy_version 1251367 (0.0008) [2023-12-28 04:15:06,433][106226] Updated weights for policy 0, policy_version 1251377 (0.0009) [2023-12-28 04:15:06,700][106225] Updated weights for policy 1, policy_version 1254510 (0.0008) [2023-12-28 04:15:06,756][106225] Updated weights for policy 1, policy_version 1254520 (0.0009) [2023-12-28 04:15:06,823][106225] Updated weights for policy 1, policy_version 1254530 (0.0010) [2023-12-28 04:15:07,144][106226] Updated weights for policy 0, policy_version 1251387 (0.0008) [2023-12-28 04:15:07,199][106226] Updated weights for policy 0, policy_version 1251397 (0.0006) [2023-12-28 04:15:07,269][106226] Updated weights for policy 0, policy_version 1251407 (0.0006) [2023-12-28 04:15:07,530][106225] Updated weights for policy 1, policy_version 1254540 (0.0010) [2023-12-28 04:15:07,576][106225] Updated weights for policy 1, policy_version 1254550 (0.0010) [2023-12-28 04:15:07,629][106225] Updated weights for policy 1, policy_version 1254560 (0.0009) [2023-12-28 04:15:07,877][106226] Updated weights for policy 0, policy_version 1251417 (0.0006) [2023-12-28 04:15:07,930][106226] Updated weights for policy 0, policy_version 1251427 (0.0010) [2023-12-28 04:15:07,992][106226] Updated weights for policy 0, policy_version 1251437 (0.0011) [2023-12-28 04:15:08,053][106226] Updated weights for policy 0, policy_version 1251447 (0.0011) [2023-12-28 04:15:08,367][106225] Updated weights for policy 1, policy_version 1254570 (0.0008) [2023-12-28 04:15:08,425][106225] Updated weights for policy 1, policy_version 1254580 (0.0006) [2023-12-28 04:15:08,481][106225] Updated weights for policy 1, policy_version 1254590 (0.0007) [2023-12-28 04:15:08,543][106225] Updated weights for policy 1, policy_version 1254600 (0.0009) [2023-12-28 04:15:08,808][106226] Updated weights for policy 0, policy_version 1251457 (0.0009) [2023-12-28 04:15:08,862][106226] Updated weights for policy 0, policy_version 1251467 (0.0010) [2023-12-28 04:15:08,915][106226] Updated weights for policy 0, policy_version 1251477 (0.0009) [2023-12-28 04:15:09,252][106225] Updated weights for policy 1, policy_version 1254610 (0.0012) [2023-12-28 04:15:09,306][106225] Updated weights for policy 1, policy_version 1254620 (0.0008) [2023-12-28 04:15:09,371][106225] Updated weights for policy 1, policy_version 1254630 (0.0007) [2023-12-28 04:15:09,689][106226] Updated weights for policy 0, policy_version 1251487 (0.0006) [2023-12-28 04:15:09,752][106226] Updated weights for policy 0, policy_version 1251497 (0.0006) [2023-12-28 04:15:09,818][106226] Updated weights for policy 0, policy_version 1251507 (0.0008) [2023-12-28 04:15:10,125][106225] Updated weights for policy 1, policy_version 1254640 (0.0006) [2023-12-28 04:15:10,190][106225] Updated weights for policy 1, policy_version 1254650 (0.0006) [2023-12-28 04:15:10,261][106225] Updated weights for policy 1, policy_version 1254660 (0.0006) [2023-12-28 04:15:10,496][106226] Updated weights for policy 0, policy_version 1251517 (0.0008) [2023-12-28 04:15:10,560][106226] Updated weights for policy 0, policy_version 1251527 (0.0008) [2023-12-28 04:15:10,622][106226] Updated weights for policy 0, policy_version 1251537 (0.0009) [2023-12-28 04:15:10,944][106225] Updated weights for policy 1, policy_version 1254670 (0.0009) [2023-12-28 04:15:10,995][106225] Updated weights for policy 1, policy_version 1254680 (0.0010) [2023-12-28 04:15:11,061][106225] Updated weights for policy 1, policy_version 1254690 (0.0011) [2023-12-28 04:15:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 641703936. Throughput: 0: 9958.4, 1: 9738.4. Samples: 641673016. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:15:11,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.841')] [2023-12-28 04:15:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001254696_321249280.pth... [2023-12-28 04:15:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001251544_320454656.pth... [2023-12-28 04:15:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001250424_320167936.pth [2023-12-28 04:15:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001253544_320954368.pth [2023-12-28 04:15:11,449][106226] Updated weights for policy 0, policy_version 1251547 (0.0008) [2023-12-28 04:15:11,511][106226] Updated weights for policy 0, policy_version 1251557 (0.0007) [2023-12-28 04:15:11,572][106226] Updated weights for policy 0, policy_version 1251567 (0.0008) [2023-12-28 04:15:11,838][106225] Updated weights for policy 1, policy_version 1254700 (0.0009) [2023-12-28 04:15:11,907][106225] Updated weights for policy 1, policy_version 1254710 (0.0007) [2023-12-28 04:15:11,975][106225] Updated weights for policy 1, policy_version 1254720 (0.0008) [2023-12-28 04:15:12,356][106226] Updated weights for policy 0, policy_version 1251577 (0.0009) [2023-12-28 04:15:12,419][106226] Updated weights for policy 0, policy_version 1251587 (0.0008) [2023-12-28 04:15:12,478][106226] Updated weights for policy 0, policy_version 1251597 (0.0008) [2023-12-28 04:15:12,529][106226] Updated weights for policy 0, policy_version 1251607 (0.0008) [2023-12-28 04:15:12,668][106225] Updated weights for policy 1, policy_version 1254730 (0.0011) [2023-12-28 04:15:12,723][106225] Updated weights for policy 1, policy_version 1254740 (0.0006) [2023-12-28 04:15:12,784][106225] Updated weights for policy 1, policy_version 1254750 (0.0007) [2023-12-28 04:15:12,847][106225] Updated weights for policy 1, policy_version 1254760 (0.0009) [2023-12-28 04:15:13,270][106226] Updated weights for policy 0, policy_version 1251617 (0.0008) [2023-12-28 04:15:13,345][106226] Updated weights for policy 0, policy_version 1251627 (0.0006) [2023-12-28 04:15:13,415][106226] Updated weights for policy 0, policy_version 1251637 (0.0007) [2023-12-28 04:15:13,441][106225] Updated weights for policy 1, policy_version 1254770 (0.0010) [2023-12-28 04:15:13,505][106225] Updated weights for policy 1, policy_version 1254780 (0.0011) [2023-12-28 04:15:13,573][106225] Updated weights for policy 1, policy_version 1254790 (0.0008) [2023-12-28 04:15:14,073][106226] Updated weights for policy 0, policy_version 1251647 (0.0009) [2023-12-28 04:15:14,137][106226] Updated weights for policy 0, policy_version 1251657 (0.0010) [2023-12-28 04:15:14,190][106226] Updated weights for policy 0, policy_version 1251667 (0.0010) [2023-12-28 04:15:14,199][106225] Updated weights for policy 1, policy_version 1254800 (0.0006) [2023-12-28 04:15:14,261][106225] Updated weights for policy 1, policy_version 1254810 (0.0006) [2023-12-28 04:15:14,321][106225] Updated weights for policy 1, policy_version 1254820 (0.0005) [2023-12-28 04:15:14,878][106225] Updated weights for policy 1, policy_version 1254830 (0.0008) [2023-12-28 04:15:14,904][106226] Updated weights for policy 0, policy_version 1251677 (0.0009) [2023-12-28 04:15:14,936][106225] Updated weights for policy 1, policy_version 1254840 (0.0006) [2023-12-28 04:15:14,970][106226] Updated weights for policy 0, policy_version 1251687 (0.0008) [2023-12-28 04:15:15,003][106225] Updated weights for policy 1, policy_version 1254850 (0.0008) [2023-12-28 04:15:15,037][106226] Updated weights for policy 0, policy_version 1251697 (0.0008) [2023-12-28 04:15:15,605][106225] Updated weights for policy 1, policy_version 1254860 (0.0007) [2023-12-28 04:15:15,661][106225] Updated weights for policy 1, policy_version 1254870 (0.0006) [2023-12-28 04:15:15,720][106225] Updated weights for policy 1, policy_version 1254880 (0.0005) [2023-12-28 04:15:15,765][106226] Updated weights for policy 0, policy_version 1251707 (0.0006) [2023-12-28 04:15:15,821][106226] Updated weights for policy 0, policy_version 1251717 (0.0007) [2023-12-28 04:15:15,879][106226] Updated weights for policy 0, policy_version 1251727 (0.0008) [2023-12-28 04:15:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 641802240. Throughput: 0: 9779.9, 1: 9832.4. Samples: 641790392. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:15:16,176][105115] Avg episode reward: [(0, '-4.124'), (1, '-4.847')] [2023-12-28 04:15:16,378][106225] Updated weights for policy 1, policy_version 1254890 (0.0006) [2023-12-28 04:15:16,424][106225] Updated weights for policy 1, policy_version 1254900 (0.0005) [2023-12-28 04:15:16,484][106225] Updated weights for policy 1, policy_version 1254910 (0.0008) [2023-12-28 04:15:16,500][106226] Updated weights for policy 0, policy_version 1251737 (0.0009) [2023-12-28 04:15:16,536][106225] Updated weights for policy 1, policy_version 1254920 (0.0009) [2023-12-28 04:15:16,561][106226] Updated weights for policy 0, policy_version 1251747 (0.0010) [2023-12-28 04:15:16,621][106226] Updated weights for policy 0, policy_version 1251757 (0.0010) [2023-12-28 04:15:16,672][106226] Updated weights for policy 0, policy_version 1251767 (0.0008) [2023-12-28 04:15:17,134][106225] Updated weights for policy 1, policy_version 1254930 (0.0005) [2023-12-28 04:15:17,191][106225] Updated weights for policy 1, policy_version 1254940 (0.0005) [2023-12-28 04:15:17,246][106225] Updated weights for policy 1, policy_version 1254950 (0.0005) [2023-12-28 04:15:17,436][106226] Updated weights for policy 0, policy_version 1251777 (0.0010) [2023-12-28 04:15:17,497][106226] Updated weights for policy 0, policy_version 1251787 (0.0008) [2023-12-28 04:15:17,560][106226] Updated weights for policy 0, policy_version 1251797 (0.0008) [2023-12-28 04:15:17,799][106225] Updated weights for policy 1, policy_version 1254960 (0.0005) [2023-12-28 04:15:17,855][106225] Updated weights for policy 1, policy_version 1254970 (0.0005) [2023-12-28 04:15:17,919][106225] Updated weights for policy 1, policy_version 1254980 (0.0005) [2023-12-28 04:15:18,410][106226] Updated weights for policy 0, policy_version 1251807 (0.0007) [2023-12-28 04:15:18,454][106225] Updated weights for policy 1, policy_version 1254990 (0.0007) [2023-12-28 04:15:18,469][106226] Updated weights for policy 0, policy_version 1251817 (0.0008) [2023-12-28 04:15:18,519][106225] Updated weights for policy 1, policy_version 1255000 (0.0007) [2023-12-28 04:15:18,532][106226] Updated weights for policy 0, policy_version 1251827 (0.0008) [2023-12-28 04:15:18,587][106225] Updated weights for policy 1, policy_version 1255010 (0.0007) [2023-12-28 04:15:19,257][106226] Updated weights for policy 0, policy_version 1251837 (0.0008) [2023-12-28 04:15:19,292][106225] Updated weights for policy 1, policy_version 1255020 (0.0008) [2023-12-28 04:15:19,318][106226] Updated weights for policy 0, policy_version 1251847 (0.0006) [2023-12-28 04:15:19,357][106225] Updated weights for policy 1, policy_version 1255030 (0.0008) [2023-12-28 04:15:19,385][106226] Updated weights for policy 0, policy_version 1251857 (0.0007) [2023-12-28 04:15:19,421][106225] Updated weights for policy 1, policy_version 1255040 (0.0010) [2023-12-28 04:15:20,047][106226] Updated weights for policy 0, policy_version 1251867 (0.0008) [2023-12-28 04:15:20,114][106226] Updated weights for policy 0, policy_version 1251877 (0.0007) [2023-12-28 04:15:20,171][106226] Updated weights for policy 0, policy_version 1251887 (0.0006) [2023-12-28 04:15:20,214][106225] Updated weights for policy 1, policy_version 1255050 (0.0009) [2023-12-28 04:15:20,277][106225] Updated weights for policy 1, policy_version 1255060 (0.0008) [2023-12-28 04:15:20,332][106225] Updated weights for policy 1, policy_version 1255070 (0.0009) [2023-12-28 04:15:20,387][106225] Updated weights for policy 1, policy_version 1255080 (0.0008) [2023-12-28 04:15:20,875][106226] Updated weights for policy 0, policy_version 1251897 (0.0006) [2023-12-28 04:15:20,947][106226] Updated weights for policy 0, policy_version 1251907 (0.0006) [2023-12-28 04:15:21,015][106226] Updated weights for policy 0, policy_version 1251917 (0.0006) [2023-12-28 04:15:21,085][106226] Updated weights for policy 0, policy_version 1251927 (0.0008) [2023-12-28 04:15:21,139][106225] Updated weights for policy 1, policy_version 1255090 (0.0007) [2023-12-28 04:15:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 641900544. Throughput: 0: 9736.6, 1: 9841.5. Samples: 641911288. Policy #0 lag: (min: 31.0, avg: 32.2, max: 58.0) [2023-12-28 04:15:21,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.807')] [2023-12-28 04:15:21,202][106225] Updated weights for policy 1, policy_version 1255100 (0.0008) [2023-12-28 04:15:21,265][106225] Updated weights for policy 1, policy_version 1255110 (0.0009) [2023-12-28 04:15:21,783][106226] Updated weights for policy 0, policy_version 1251937 (0.0008) [2023-12-28 04:15:21,846][106226] Updated weights for policy 0, policy_version 1251947 (0.0011) [2023-12-28 04:15:21,905][106226] Updated weights for policy 0, policy_version 1251957 (0.0011) [2023-12-28 04:15:22,017][106225] Updated weights for policy 1, policy_version 1255120 (0.0009) [2023-12-28 04:15:22,081][106225] Updated weights for policy 1, policy_version 1255130 (0.0008) [2023-12-28 04:15:22,144][106225] Updated weights for policy 1, policy_version 1255140 (0.0008) [2023-12-28 04:15:22,656][106226] Updated weights for policy 0, policy_version 1251967 (0.0008) [2023-12-28 04:15:22,716][106226] Updated weights for policy 0, policy_version 1251977 (0.0006) [2023-12-28 04:15:22,785][106226] Updated weights for policy 0, policy_version 1251987 (0.0006) [2023-12-28 04:15:22,912][106225] Updated weights for policy 1, policy_version 1255150 (0.0008) [2023-12-28 04:15:22,962][106225] Updated weights for policy 1, policy_version 1255160 (0.0008) [2023-12-28 04:15:23,012][106225] Updated weights for policy 1, policy_version 1255170 (0.0009) [2023-12-28 04:15:23,325][106226] Updated weights for policy 0, policy_version 1251997 (0.0006) [2023-12-28 04:15:23,390][106226] Updated weights for policy 0, policy_version 1252007 (0.0006) [2023-12-28 04:15:23,454][106226] Updated weights for policy 0, policy_version 1252017 (0.0005) [2023-12-28 04:15:23,792][106225] Updated weights for policy 1, policy_version 1255181 (0.0009) [2023-12-28 04:15:23,878][106225] Updated weights for policy 1, policy_version 1255191 (0.0010) [2023-12-28 04:15:23,934][106225] Updated weights for policy 1, policy_version 1255201 (0.0009) [2023-12-28 04:15:24,016][106226] Updated weights for policy 0, policy_version 1252027 (0.0008) [2023-12-28 04:15:24,077][106226] Updated weights for policy 0, policy_version 1252037 (0.0010) [2023-12-28 04:15:24,140][106226] Updated weights for policy 0, policy_version 1252047 (0.0006) [2023-12-28 04:15:24,710][106225] Updated weights for policy 1, policy_version 1255211 (0.0007) [2023-12-28 04:15:24,757][106225] Updated weights for policy 1, policy_version 1255221 (0.0008) [2023-12-28 04:15:24,759][106226] Updated weights for policy 0, policy_version 1252057 (0.0007) [2023-12-28 04:15:24,804][106225] Updated weights for policy 1, policy_version 1255231 (0.0006) [2023-12-28 04:15:24,809][106226] Updated weights for policy 0, policy_version 1252067 (0.0011) [2023-12-28 04:15:24,861][106226] Updated weights for policy 0, policy_version 1252077 (0.0008) [2023-12-28 04:15:24,919][106226] Updated weights for policy 0, policy_version 1252087 (0.0005) [2023-12-28 04:15:25,516][106226] Updated weights for policy 0, policy_version 1252097 (0.0010) [2023-12-28 04:15:25,523][106225] Updated weights for policy 1, policy_version 1255241 (0.0009) [2023-12-28 04:15:25,571][106225] Updated weights for policy 1, policy_version 1255251 (0.0008) [2023-12-28 04:15:25,576][106226] Updated weights for policy 0, policy_version 1252107 (0.0010) [2023-12-28 04:15:25,615][106225] Updated weights for policy 1, policy_version 1255261 (0.0007) [2023-12-28 04:15:25,632][106226] Updated weights for policy 0, policy_version 1252117 (0.0010) [2023-12-28 04:15:25,670][106225] Updated weights for policy 1, policy_version 1255271 (0.0006) [2023-12-28 04:15:26,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 641998848. Throughput: 0: 9725.6, 1: 9817.3. Samples: 641970380. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:26,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-4.889')] [2023-12-28 04:15:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001255272_321396736.pth... [2023-12-28 04:15:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001252120_320602112.pth... [2023-12-28 04:15:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001254120_321101824.pth [2023-12-28 04:15:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001251000_320315392.pth [2023-12-28 04:15:26,260][106226] Updated weights for policy 0, policy_version 1252127 (0.0007) [2023-12-28 04:15:26,313][106226] Updated weights for policy 0, policy_version 1252137 (0.0007) [2023-12-28 04:15:26,372][106226] Updated weights for policy 0, policy_version 1252147 (0.0009) [2023-12-28 04:15:26,476][106225] Updated weights for policy 1, policy_version 1255281 (0.0007) [2023-12-28 04:15:26,534][106225] Updated weights for policy 1, policy_version 1255291 (0.0008) [2023-12-28 04:15:26,585][106225] Updated weights for policy 1, policy_version 1255301 (0.0008) [2023-12-28 04:15:26,970][106226] Updated weights for policy 0, policy_version 1252157 (0.0008) [2023-12-28 04:15:27,023][106226] Updated weights for policy 0, policy_version 1252167 (0.0005) [2023-12-28 04:15:27,071][106226] Updated weights for policy 0, policy_version 1252177 (0.0005) [2023-12-28 04:15:27,408][106225] Updated weights for policy 1, policy_version 1255311 (0.0008) [2023-12-28 04:15:27,459][106225] Updated weights for policy 1, policy_version 1255321 (0.0009) [2023-12-28 04:15:27,507][106225] Updated weights for policy 1, policy_version 1255331 (0.0008) [2023-12-28 04:15:27,646][106226] Updated weights for policy 0, policy_version 1252187 (0.0006) [2023-12-28 04:15:27,701][106226] Updated weights for policy 0, policy_version 1252197 (0.0006) [2023-12-28 04:15:27,750][106226] Updated weights for policy 0, policy_version 1252207 (0.0005) [2023-12-28 04:15:28,145][106225] Updated weights for policy 1, policy_version 1255341 (0.0007) [2023-12-28 04:15:28,201][106225] Updated weights for policy 1, policy_version 1255351 (0.0005) [2023-12-28 04:15:28,260][106225] Updated weights for policy 1, policy_version 1255361 (0.0005) [2023-12-28 04:15:28,311][106226] Updated weights for policy 0, policy_version 1252217 (0.0005) [2023-12-28 04:15:28,374][106226] Updated weights for policy 0, policy_version 1252227 (0.0009) [2023-12-28 04:15:28,436][106226] Updated weights for policy 0, policy_version 1252237 (0.0008) [2023-12-28 04:15:28,484][106226] Updated weights for policy 0, policy_version 1252247 (0.0008) [2023-12-28 04:15:28,902][106225] Updated weights for policy 1, policy_version 1255371 (0.0006) [2023-12-28 04:15:28,947][106225] Updated weights for policy 1, policy_version 1255381 (0.0008) [2023-12-28 04:15:29,001][106225] Updated weights for policy 1, policy_version 1255391 (0.0008) [2023-12-28 04:15:29,203][106226] Updated weights for policy 0, policy_version 1252257 (0.0008) [2023-12-28 04:15:29,269][106226] Updated weights for policy 0, policy_version 1252267 (0.0008) [2023-12-28 04:15:29,323][106226] Updated weights for policy 0, policy_version 1252277 (0.0009) [2023-12-28 04:15:29,786][106225] Updated weights for policy 1, policy_version 1255401 (0.0009) [2023-12-28 04:15:29,854][106225] Updated weights for policy 1, policy_version 1255411 (0.0010) [2023-12-28 04:15:29,913][106225] Updated weights for policy 1, policy_version 1255421 (0.0008) [2023-12-28 04:15:29,980][106225] Updated weights for policy 1, policy_version 1255431 (0.0008) [2023-12-28 04:15:30,035][106226] Updated weights for policy 0, policy_version 1252287 (0.0008) [2023-12-28 04:15:30,099][106226] Updated weights for policy 0, policy_version 1252297 (0.0007) [2023-12-28 04:15:30,159][106226] Updated weights for policy 0, policy_version 1252307 (0.0010) [2023-12-28 04:15:30,610][106225] Updated weights for policy 1, policy_version 1255441 (0.0008) [2023-12-28 04:15:30,670][106225] Updated weights for policy 1, policy_version 1255451 (0.0007) [2023-12-28 04:15:30,724][106225] Updated weights for policy 1, policy_version 1255461 (0.0008) [2023-12-28 04:15:30,866][106226] Updated weights for policy 0, policy_version 1252317 (0.0010) [2023-12-28 04:15:30,925][106226] Updated weights for policy 0, policy_version 1252327 (0.0010) [2023-12-28 04:15:30,988][106226] Updated weights for policy 0, policy_version 1252337 (0.0010) [2023-12-28 04:15:31,174][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 642105344. Throughput: 0: 9897.2, 1: 9836.1. Samples: 642092704. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:31,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.798')] [2023-12-28 04:15:31,358][106225] Updated weights for policy 1, policy_version 1255471 (0.0008) [2023-12-28 04:15:31,432][106225] Updated weights for policy 1, policy_version 1255481 (0.0008) [2023-12-28 04:15:31,489][106225] Updated weights for policy 1, policy_version 1255491 (0.0005) [2023-12-28 04:15:31,760][106226] Updated weights for policy 0, policy_version 1252347 (0.0010) [2023-12-28 04:15:31,822][106226] Updated weights for policy 0, policy_version 1252357 (0.0011) [2023-12-28 04:15:31,879][106226] Updated weights for policy 0, policy_version 1252367 (0.0010) [2023-12-28 04:15:32,224][106225] Updated weights for policy 1, policy_version 1255501 (0.0006) [2023-12-28 04:15:32,279][106225] Updated weights for policy 1, policy_version 1255511 (0.0008) [2023-12-28 04:15:32,338][106225] Updated weights for policy 1, policy_version 1255521 (0.0008) [2023-12-28 04:15:32,624][106226] Updated weights for policy 0, policy_version 1252377 (0.0009) [2023-12-28 04:15:32,684][106226] Updated weights for policy 0, policy_version 1252387 (0.0010) [2023-12-28 04:15:32,740][106226] Updated weights for policy 0, policy_version 1252397 (0.0010) [2023-12-28 04:15:32,797][106226] Updated weights for policy 0, policy_version 1252407 (0.0010) [2023-12-28 04:15:33,074][106225] Updated weights for policy 1, policy_version 1255531 (0.0007) [2023-12-28 04:15:33,130][106225] Updated weights for policy 1, policy_version 1255541 (0.0008) [2023-12-28 04:15:33,173][106225] Updated weights for policy 1, policy_version 1255551 (0.0007) [2023-12-28 04:15:33,449][106226] Updated weights for policy 0, policy_version 1252417 (0.0006) [2023-12-28 04:15:33,504][106226] Updated weights for policy 0, policy_version 1252427 (0.0005) [2023-12-28 04:15:33,559][106226] Updated weights for policy 0, policy_version 1252437 (0.0005) [2023-12-28 04:15:34,015][106225] Updated weights for policy 1, policy_version 1255561 (0.0007) [2023-12-28 04:15:34,081][106225] Updated weights for policy 1, policy_version 1255571 (0.0005) [2023-12-28 04:15:34,086][106226] Updated weights for policy 0, policy_version 1252447 (0.0006) [2023-12-28 04:15:34,150][106225] Updated weights for policy 1, policy_version 1255581 (0.0006) [2023-12-28 04:15:34,154][106226] Updated weights for policy 0, policy_version 1252457 (0.0007) [2023-12-28 04:15:34,215][106225] Updated weights for policy 1, policy_version 1255591 (0.0009) [2023-12-28 04:15:34,215][106226] Updated weights for policy 0, policy_version 1252467 (0.0007) [2023-12-28 04:15:34,915][106225] Updated weights for policy 1, policy_version 1255601 (0.0007) [2023-12-28 04:15:34,931][106226] Updated weights for policy 0, policy_version 1252477 (0.0006) [2023-12-28 04:15:34,974][106225] Updated weights for policy 1, policy_version 1255611 (0.0005) [2023-12-28 04:15:34,987][106226] Updated weights for policy 0, policy_version 1252487 (0.0005) [2023-12-28 04:15:35,040][106225] Updated weights for policy 1, policy_version 1255621 (0.0007) [2023-12-28 04:15:35,047][106226] Updated weights for policy 0, policy_version 1252497 (0.0006) [2023-12-28 04:15:35,656][106225] Updated weights for policy 1, policy_version 1255631 (0.0006) [2023-12-28 04:15:35,681][106226] Updated weights for policy 0, policy_version 1252507 (0.0011) [2023-12-28 04:15:35,704][106225] Updated weights for policy 1, policy_version 1255641 (0.0005) [2023-12-28 04:15:35,748][106226] Updated weights for policy 0, policy_version 1252517 (0.0010) [2023-12-28 04:15:35,754][106225] Updated weights for policy 1, policy_version 1255651 (0.0005) [2023-12-28 04:15:35,804][106226] Updated weights for policy 0, policy_version 1252527 (0.0010) [2023-12-28 04:15:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 642203648. Throughput: 0: 9905.8, 1: 9810.8. Samples: 642211992. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:36,175][105115] Avg episode reward: [(0, '-4.299'), (1, '-4.714')] [2023-12-28 04:15:36,404][106225] Updated weights for policy 1, policy_version 1255661 (0.0007) [2023-12-28 04:15:36,470][106225] Updated weights for policy 1, policy_version 1255671 (0.0008) [2023-12-28 04:15:36,523][106226] Updated weights for policy 0, policy_version 1252537 (0.0010) [2023-12-28 04:15:36,533][106225] Updated weights for policy 1, policy_version 1255681 (0.0007) [2023-12-28 04:15:36,581][106226] Updated weights for policy 0, policy_version 1252547 (0.0010) [2023-12-28 04:15:36,646][106226] Updated weights for policy 0, policy_version 1252557 (0.0011) [2023-12-28 04:15:36,707][106226] Updated weights for policy 0, policy_version 1252567 (0.0011) [2023-12-28 04:15:37,308][106226] Updated weights for policy 0, policy_version 1252577 (0.0010) [2023-12-28 04:15:37,327][106225] Updated weights for policy 1, policy_version 1255691 (0.0007) [2023-12-28 04:15:37,358][106226] Updated weights for policy 0, policy_version 1252587 (0.0011) [2023-12-28 04:15:37,384][106225] Updated weights for policy 1, policy_version 1255701 (0.0006) [2023-12-28 04:15:37,416][106226] Updated weights for policy 0, policy_version 1252597 (0.0011) [2023-12-28 04:15:37,441][106225] Updated weights for policy 1, policy_version 1255711 (0.0006) [2023-12-28 04:15:38,050][106225] Updated weights for policy 1, policy_version 1255721 (0.0007) [2023-12-28 04:15:38,114][106225] Updated weights for policy 1, policy_version 1255731 (0.0005) [2023-12-28 04:15:38,148][106226] Updated weights for policy 0, policy_version 1252607 (0.0011) [2023-12-28 04:15:38,168][106225] Updated weights for policy 1, policy_version 1255741 (0.0006) [2023-12-28 04:15:38,198][106226] Updated weights for policy 0, policy_version 1252617 (0.0010) [2023-12-28 04:15:38,228][106225] Updated weights for policy 1, policy_version 1255751 (0.0007) [2023-12-28 04:15:38,242][106226] Updated weights for policy 0, policy_version 1252627 (0.0010) [2023-12-28 04:15:38,885][106225] Updated weights for policy 1, policy_version 1255761 (0.0008) [2023-12-28 04:15:38,948][106225] Updated weights for policy 1, policy_version 1255771 (0.0009) [2023-12-28 04:15:38,988][106226] Updated weights for policy 0, policy_version 1252637 (0.0010) [2023-12-28 04:15:39,007][106225] Updated weights for policy 1, policy_version 1255781 (0.0009) [2023-12-28 04:15:39,046][106226] Updated weights for policy 0, policy_version 1252647 (0.0008) [2023-12-28 04:15:39,103][106226] Updated weights for policy 0, policy_version 1252657 (0.0005) [2023-12-28 04:15:39,776][106226] Updated weights for policy 0, policy_version 1252667 (0.0009) [2023-12-28 04:15:39,795][106225] Updated weights for policy 1, policy_version 1255791 (0.0007) [2023-12-28 04:15:39,841][106226] Updated weights for policy 0, policy_version 1252677 (0.0008) [2023-12-28 04:15:39,864][106225] Updated weights for policy 1, policy_version 1255801 (0.0007) [2023-12-28 04:15:39,905][106226] Updated weights for policy 0, policy_version 1252687 (0.0008) [2023-12-28 04:15:39,933][106225] Updated weights for policy 1, policy_version 1255811 (0.0008) [2023-12-28 04:15:40,575][106226] Updated weights for policy 0, policy_version 1252697 (0.0008) [2023-12-28 04:15:40,633][106226] Updated weights for policy 0, policy_version 1252707 (0.0006) [2023-12-28 04:15:40,665][106225] Updated weights for policy 1, policy_version 1255821 (0.0007) [2023-12-28 04:15:40,688][106226] Updated weights for policy 0, policy_version 1252717 (0.0006) [2023-12-28 04:15:40,720][106225] Updated weights for policy 1, policy_version 1255831 (0.0009) [2023-12-28 04:15:40,743][106226] Updated weights for policy 0, policy_version 1252727 (0.0007) [2023-12-28 04:15:40,768][106225] Updated weights for policy 1, policy_version 1255841 (0.0010) [2023-12-28 04:15:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 642301952. Throughput: 0: 9936.8, 1: 9886.5. Samples: 642272364. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:41,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-4.990')] [2023-12-28 04:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001255848_321544192.pth... [2023-12-28 04:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001252728_320757760.pth... [2023-12-28 04:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001254696_321249280.pth [2023-12-28 04:15:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001251544_320454656.pth [2023-12-28 04:15:41,404][106226] Updated weights for policy 0, policy_version 1252737 (0.0009) [2023-12-28 04:15:41,471][106226] Updated weights for policy 0, policy_version 1252747 (0.0009) [2023-12-28 04:15:41,502][106225] Updated weights for policy 1, policy_version 1255851 (0.0010) [2023-12-28 04:15:41,543][106226] Updated weights for policy 0, policy_version 1252757 (0.0008) [2023-12-28 04:15:41,558][106225] Updated weights for policy 1, policy_version 1255861 (0.0011) [2023-12-28 04:15:41,622][106225] Updated weights for policy 1, policy_version 1255871 (0.0010) [2023-12-28 04:15:42,237][106226] Updated weights for policy 0, policy_version 1252767 (0.0010) [2023-12-28 04:15:42,303][106226] Updated weights for policy 0, policy_version 1252777 (0.0011) [2023-12-28 04:15:42,324][106225] Updated weights for policy 1, policy_version 1255881 (0.0009) [2023-12-28 04:15:42,372][106226] Updated weights for policy 0, policy_version 1252787 (0.0010) [2023-12-28 04:15:42,395][106225] Updated weights for policy 1, policy_version 1255891 (0.0008) [2023-12-28 04:15:42,443][106225] Updated weights for policy 1, policy_version 1255901 (0.0008) [2023-12-28 04:15:42,495][106225] Updated weights for policy 1, policy_version 1255911 (0.0009) [2023-12-28 04:15:43,046][106226] Updated weights for policy 0, policy_version 1252797 (0.0007) [2023-12-28 04:15:43,098][106226] Updated weights for policy 0, policy_version 1252807 (0.0005) [2023-12-28 04:15:43,154][106225] Updated weights for policy 1, policy_version 1255921 (0.0006) [2023-12-28 04:15:43,157][106226] Updated weights for policy 0, policy_version 1252817 (0.0005) [2023-12-28 04:15:43,205][106225] Updated weights for policy 1, policy_version 1255931 (0.0005) [2023-12-28 04:15:43,260][106225] Updated weights for policy 1, policy_version 1255941 (0.0006) [2023-12-28 04:15:43,769][106226] Updated weights for policy 0, policy_version 1252827 (0.0007) [2023-12-28 04:15:43,826][106226] Updated weights for policy 0, policy_version 1252837 (0.0008) [2023-12-28 04:15:43,879][106226] Updated weights for policy 0, policy_version 1252847 (0.0008) [2023-12-28 04:15:43,941][106225] Updated weights for policy 1, policy_version 1255951 (0.0006) [2023-12-28 04:15:44,001][106225] Updated weights for policy 1, policy_version 1255961 (0.0009) [2023-12-28 04:15:44,063][106225] Updated weights for policy 1, policy_version 1255971 (0.0008) [2023-12-28 04:15:44,523][106226] Updated weights for policy 0, policy_version 1252857 (0.0008) [2023-12-28 04:15:44,589][106226] Updated weights for policy 0, policy_version 1252867 (0.0005) [2023-12-28 04:15:44,647][106226] Updated weights for policy 0, policy_version 1252877 (0.0005) [2023-12-28 04:15:44,713][106226] Updated weights for policy 0, policy_version 1252887 (0.0005) [2023-12-28 04:15:44,783][106225] Updated weights for policy 1, policy_version 1255981 (0.0008) [2023-12-28 04:15:44,850][106225] Updated weights for policy 1, policy_version 1255991 (0.0008) [2023-12-28 04:15:44,912][106225] Updated weights for policy 1, policy_version 1256001 (0.0008) [2023-12-28 04:15:45,370][106226] Updated weights for policy 0, policy_version 1252897 (0.0008) [2023-12-28 04:15:45,422][106226] Updated weights for policy 0, policy_version 1252907 (0.0008) [2023-12-28 04:15:45,469][106226] Updated weights for policy 0, policy_version 1252917 (0.0008) [2023-12-28 04:15:45,632][106225] Updated weights for policy 1, policy_version 1256011 (0.0007) [2023-12-28 04:15:45,689][106225] Updated weights for policy 1, policy_version 1256021 (0.0005) [2023-12-28 04:15:45,750][106225] Updated weights for policy 1, policy_version 1256031 (0.0008) [2023-12-28 04:15:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 642400256. Throughput: 0: 10056.5, 1: 9864.1. Samples: 642392152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:46,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.760')] [2023-12-28 04:15:46,226][106226] Updated weights for policy 0, policy_version 1252927 (0.0010) [2023-12-28 04:15:46,279][106226] Updated weights for policy 0, policy_version 1252937 (0.0010) [2023-12-28 04:15:46,340][106226] Updated weights for policy 0, policy_version 1252947 (0.0009) [2023-12-28 04:15:46,421][106225] Updated weights for policy 1, policy_version 1256041 (0.0008) [2023-12-28 04:15:46,477][106225] Updated weights for policy 1, policy_version 1256051 (0.0006) [2023-12-28 04:15:46,532][106225] Updated weights for policy 1, policy_version 1256061 (0.0005) [2023-12-28 04:15:46,577][106225] Updated weights for policy 1, policy_version 1256071 (0.0005) [2023-12-28 04:15:47,026][106226] Updated weights for policy 0, policy_version 1252957 (0.0007) [2023-12-28 04:15:47,082][106226] Updated weights for policy 0, policy_version 1252967 (0.0005) [2023-12-28 04:15:47,132][106225] Updated weights for policy 1, policy_version 1256081 (0.0008) [2023-12-28 04:15:47,141][106226] Updated weights for policy 0, policy_version 1252977 (0.0005) [2023-12-28 04:15:47,193][106225] Updated weights for policy 1, policy_version 1256091 (0.0009) [2023-12-28 04:15:47,243][106225] Updated weights for policy 1, policy_version 1256101 (0.0010) [2023-12-28 04:15:47,656][106226] Updated weights for policy 0, policy_version 1252987 (0.0005) [2023-12-28 04:15:47,700][106226] Updated weights for policy 0, policy_version 1252997 (0.0005) [2023-12-28 04:15:47,752][106226] Updated weights for policy 0, policy_version 1253007 (0.0009) [2023-12-28 04:15:47,958][106225] Updated weights for policy 1, policy_version 1256111 (0.0010) [2023-12-28 04:15:48,018][106225] Updated weights for policy 1, policy_version 1256121 (0.0010) [2023-12-28 04:15:48,075][106225] Updated weights for policy 1, policy_version 1256131 (0.0010) [2023-12-28 04:15:48,291][106226] Updated weights for policy 0, policy_version 1253017 (0.0005) [2023-12-28 04:15:48,358][106226] Updated weights for policy 0, policy_version 1253027 (0.0008) [2023-12-28 04:15:48,422][106226] Updated weights for policy 0, policy_version 1253037 (0.0011) [2023-12-28 04:15:48,476][106226] Updated weights for policy 0, policy_version 1253047 (0.0011) [2023-12-28 04:15:48,814][106225] Updated weights for policy 1, policy_version 1256141 (0.0011) [2023-12-28 04:15:48,865][106225] Updated weights for policy 1, policy_version 1256151 (0.0010) [2023-12-28 04:15:48,925][106225] Updated weights for policy 1, policy_version 1256161 (0.0010) [2023-12-28 04:15:49,194][106226] Updated weights for policy 0, policy_version 1253057 (0.0008) [2023-12-28 04:15:49,263][106226] Updated weights for policy 0, policy_version 1253067 (0.0009) [2023-12-28 04:15:49,327][106226] Updated weights for policy 0, policy_version 1253077 (0.0011) [2023-12-28 04:15:49,648][106225] Updated weights for policy 1, policy_version 1256171 (0.0010) [2023-12-28 04:15:49,706][106225] Updated weights for policy 1, policy_version 1256181 (0.0010) [2023-12-28 04:15:49,764][106225] Updated weights for policy 1, policy_version 1256191 (0.0010) [2023-12-28 04:15:50,070][106226] Updated weights for policy 0, policy_version 1253087 (0.0008) [2023-12-28 04:15:50,128][106226] Updated weights for policy 0, policy_version 1253097 (0.0006) [2023-12-28 04:15:50,191][106226] Updated weights for policy 0, policy_version 1253107 (0.0006) [2023-12-28 04:15:50,529][106225] Updated weights for policy 1, policy_version 1256201 (0.0010) [2023-12-28 04:15:50,593][106225] Updated weights for policy 1, policy_version 1256211 (0.0010) [2023-12-28 04:15:50,651][106225] Updated weights for policy 1, policy_version 1256221 (0.0007) [2023-12-28 04:15:50,707][106225] Updated weights for policy 1, policy_version 1256231 (0.0007) [2023-12-28 04:15:50,860][106226] Updated weights for policy 0, policy_version 1253117 (0.0008) [2023-12-28 04:15:50,910][106226] Updated weights for policy 0, policy_version 1253127 (0.0008) [2023-12-28 04:15:50,961][106226] Updated weights for policy 0, policy_version 1253137 (0.0009) [2023-12-28 04:15:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 642506752. Throughput: 0: 10098.1, 1: 9883.6. Samples: 642513660. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:51,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.812')] [2023-12-28 04:15:51,361][106225] Updated weights for policy 1, policy_version 1256242 (0.0011) [2023-12-28 04:15:51,426][106225] Updated weights for policy 1, policy_version 1256252 (0.0006) [2023-12-28 04:15:51,486][106225] Updated weights for policy 1, policy_version 1256262 (0.0006) [2023-12-28 04:15:51,807][106226] Updated weights for policy 0, policy_version 1253147 (0.0009) [2023-12-28 04:15:51,875][106226] Updated weights for policy 0, policy_version 1253157 (0.0007) [2023-12-28 04:15:51,944][106226] Updated weights for policy 0, policy_version 1253167 (0.0006) [2023-12-28 04:15:52,232][106225] Updated weights for policy 1, policy_version 1256272 (0.0009) [2023-12-28 04:15:52,301][106225] Updated weights for policy 1, policy_version 1256282 (0.0007) [2023-12-28 04:15:52,372][106225] Updated weights for policy 1, policy_version 1256292 (0.0009) [2023-12-28 04:15:52,591][106226] Updated weights for policy 0, policy_version 1253177 (0.0009) [2023-12-28 04:15:52,655][106226] Updated weights for policy 0, policy_version 1253187 (0.0007) [2023-12-28 04:15:52,728][106226] Updated weights for policy 0, policy_version 1253197 (0.0006) [2023-12-28 04:15:52,796][106226] Updated weights for policy 0, policy_version 1253207 (0.0007) [2023-12-28 04:15:53,011][106225] Updated weights for policy 1, policy_version 1256302 (0.0009) [2023-12-28 04:15:53,073][106225] Updated weights for policy 1, policy_version 1256312 (0.0008) [2023-12-28 04:15:53,127][106225] Updated weights for policy 1, policy_version 1256322 (0.0008) [2023-12-28 04:15:53,440][106226] Updated weights for policy 0, policy_version 1253217 (0.0009) [2023-12-28 04:15:53,496][106226] Updated weights for policy 0, policy_version 1253227 (0.0008) [2023-12-28 04:15:53,552][106226] Updated weights for policy 0, policy_version 1253237 (0.0009) [2023-12-28 04:15:53,845][106225] Updated weights for policy 1, policy_version 1256332 (0.0008) [2023-12-28 04:15:53,899][106225] Updated weights for policy 1, policy_version 1256342 (0.0008) [2023-12-28 04:15:53,961][106225] Updated weights for policy 1, policy_version 1256352 (0.0009) [2023-12-28 04:15:54,267][106226] Updated weights for policy 0, policy_version 1253247 (0.0010) [2023-12-28 04:15:54,332][106226] Updated weights for policy 0, policy_version 1253257 (0.0009) [2023-12-28 04:15:54,394][106226] Updated weights for policy 0, policy_version 1253267 (0.0010) [2023-12-28 04:15:54,673][106225] Updated weights for policy 1, policy_version 1256362 (0.0009) [2023-12-28 04:15:54,732][106225] Updated weights for policy 1, policy_version 1256372 (0.0008) [2023-12-28 04:15:54,792][106225] Updated weights for policy 1, policy_version 1256382 (0.0006) [2023-12-28 04:15:54,860][106225] Updated weights for policy 1, policy_version 1256392 (0.0005) [2023-12-28 04:15:55,163][106226] Updated weights for policy 0, policy_version 1253277 (0.0008) [2023-12-28 04:15:55,211][106226] Updated weights for policy 0, policy_version 1253287 (0.0009) [2023-12-28 04:15:55,263][106226] Updated weights for policy 0, policy_version 1253297 (0.0008) [2023-12-28 04:15:55,455][106225] Updated weights for policy 1, policy_version 1256402 (0.0008) [2023-12-28 04:15:55,510][106225] Updated weights for policy 1, policy_version 1256412 (0.0008) [2023-12-28 04:15:55,565][106225] Updated weights for policy 1, policy_version 1256422 (0.0008) [2023-12-28 04:15:56,025][106226] Updated weights for policy 0, policy_version 1253307 (0.0009) [2023-12-28 04:15:56,079][106226] Updated weights for policy 0, policy_version 1253317 (0.0008) [2023-12-28 04:15:56,132][106226] Updated weights for policy 0, policy_version 1253327 (0.0009) [2023-12-28 04:15:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 642596864. Throughput: 0: 10098.1, 1: 9903.0. Samples: 642573068. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:15:56,176][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.829')] [2023-12-28 04:15:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001256424_321691648.pth... [2023-12-28 04:15:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001253336_320913408.pth... [2023-12-28 04:15:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001255272_321396736.pth [2023-12-28 04:15:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001252120_320602112.pth [2023-12-28 04:15:56,297][106225] Updated weights for policy 1, policy_version 1256432 (0.0008) [2023-12-28 04:15:56,366][106225] Updated weights for policy 1, policy_version 1256442 (0.0008) [2023-12-28 04:15:56,419][106225] Updated weights for policy 1, policy_version 1256452 (0.0010) [2023-12-28 04:15:56,881][106226] Updated weights for policy 0, policy_version 1253337 (0.0008) [2023-12-28 04:15:56,933][106226] Updated weights for policy 0, policy_version 1253347 (0.0007) [2023-12-28 04:15:56,998][106226] Updated weights for policy 0, policy_version 1253357 (0.0007) [2023-12-28 04:15:57,055][106226] Updated weights for policy 0, policy_version 1253367 (0.0009) [2023-12-28 04:15:57,073][106225] Updated weights for policy 1, policy_version 1256462 (0.0009) [2023-12-28 04:15:57,140][106225] Updated weights for policy 1, policy_version 1256472 (0.0006) [2023-12-28 04:15:57,207][106225] Updated weights for policy 1, policy_version 1256482 (0.0005) [2023-12-28 04:15:57,765][106226] Updated weights for policy 0, policy_version 1253377 (0.0005) [2023-12-28 04:15:57,818][106226] Updated weights for policy 0, policy_version 1253387 (0.0005) [2023-12-28 04:15:57,872][106225] Updated weights for policy 1, policy_version 1256492 (0.0007) [2023-12-28 04:15:57,876][106226] Updated weights for policy 0, policy_version 1253397 (0.0005) [2023-12-28 04:15:57,939][106225] Updated weights for policy 1, policy_version 1256502 (0.0010) [2023-12-28 04:15:57,998][106225] Updated weights for policy 1, policy_version 1256512 (0.0011) [2023-12-28 04:15:58,553][106226] Updated weights for policy 0, policy_version 1253407 (0.0007) [2023-12-28 04:15:58,618][106226] Updated weights for policy 0, policy_version 1253417 (0.0007) [2023-12-28 04:15:58,676][106226] Updated weights for policy 0, policy_version 1253427 (0.0006) [2023-12-28 04:15:58,741][106225] Updated weights for policy 1, policy_version 1256522 (0.0010) [2023-12-28 04:15:58,807][106225] Updated weights for policy 1, policy_version 1256532 (0.0008) [2023-12-28 04:15:58,880][106225] Updated weights for policy 1, policy_version 1256542 (0.0008) [2023-12-28 04:15:58,953][106225] Updated weights for policy 1, policy_version 1256552 (0.0009) [2023-12-28 04:15:59,506][106226] Updated weights for policy 0, policy_version 1253437 (0.0007) [2023-12-28 04:15:59,567][106226] Updated weights for policy 0, policy_version 1253447 (0.0006) [2023-12-28 04:15:59,619][106226] Updated weights for policy 0, policy_version 1253457 (0.0008) [2023-12-28 04:15:59,775][106225] Updated weights for policy 1, policy_version 1256562 (0.0009) [2023-12-28 04:15:59,841][106225] Updated weights for policy 1, policy_version 1256572 (0.0008) [2023-12-28 04:15:59,901][106225] Updated weights for policy 1, policy_version 1256582 (0.0008) [2023-12-28 04:16:00,363][106226] Updated weights for policy 0, policy_version 1253467 (0.0008) [2023-12-28 04:16:00,418][106226] Updated weights for policy 0, policy_version 1253477 (0.0008) [2023-12-28 04:16:00,462][106226] Updated weights for policy 0, policy_version 1253487 (0.0008) [2023-12-28 04:16:00,671][106225] Updated weights for policy 1, policy_version 1256592 (0.0008) [2023-12-28 04:16:00,729][106225] Updated weights for policy 1, policy_version 1256602 (0.0008) [2023-12-28 04:16:00,788][106225] Updated weights for policy 1, policy_version 1256612 (0.0008) [2023-12-28 04:16:01,164][106226] Updated weights for policy 0, policy_version 1253497 (0.0007) [2023-12-28 04:16:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 642695168. Throughput: 0: 10087.4, 1: 9860.4. Samples: 642688040. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:01,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.063')] [2023-12-28 04:16:01,216][106226] Updated weights for policy 0, policy_version 1253507 (0.0010) [2023-12-28 04:16:01,286][106226] Updated weights for policy 0, policy_version 1253517 (0.0009) [2023-12-28 04:16:01,337][106226] Updated weights for policy 0, policy_version 1253527 (0.0010) [2023-12-28 04:16:01,495][106225] Updated weights for policy 1, policy_version 1256622 (0.0007) [2023-12-28 04:16:01,552][106225] Updated weights for policy 1, policy_version 1256632 (0.0005) [2023-12-28 04:16:01,613][106225] Updated weights for policy 1, policy_version 1256642 (0.0007) [2023-12-28 04:16:02,095][106226] Updated weights for policy 0, policy_version 1253537 (0.0009) [2023-12-28 04:16:02,154][106226] Updated weights for policy 0, policy_version 1253547 (0.0009) [2023-12-28 04:16:02,208][106226] Updated weights for policy 0, policy_version 1253557 (0.0008) [2023-12-28 04:16:02,301][106225] Updated weights for policy 1, policy_version 1256652 (0.0008) [2023-12-28 04:16:02,354][106225] Updated weights for policy 1, policy_version 1256662 (0.0008) [2023-12-28 04:16:02,416][106225] Updated weights for policy 1, policy_version 1256672 (0.0008) [2023-12-28 04:16:02,891][106226] Updated weights for policy 0, policy_version 1253567 (0.0009) [2023-12-28 04:16:02,944][106226] Updated weights for policy 0, policy_version 1253577 (0.0008) [2023-12-28 04:16:02,994][106226] Updated weights for policy 0, policy_version 1253587 (0.0008) [2023-12-28 04:16:03,173][106225] Updated weights for policy 1, policy_version 1256682 (0.0010) [2023-12-28 04:16:03,233][106225] Updated weights for policy 1, policy_version 1256692 (0.0010) [2023-12-28 04:16:03,294][106225] Updated weights for policy 1, policy_version 1256702 (0.0006) [2023-12-28 04:16:03,354][106225] Updated weights for policy 1, policy_version 1256712 (0.0005) [2023-12-28 04:16:03,819][106226] Updated weights for policy 0, policy_version 1253597 (0.0009) [2023-12-28 04:16:03,880][106226] Updated weights for policy 0, policy_version 1253607 (0.0008) [2023-12-28 04:16:03,907][106225] Updated weights for policy 1, policy_version 1256722 (0.0010) [2023-12-28 04:16:03,944][106226] Updated weights for policy 0, policy_version 1253617 (0.0006) [2023-12-28 04:16:03,966][106225] Updated weights for policy 1, policy_version 1256732 (0.0011) [2023-12-28 04:16:04,022][106225] Updated weights for policy 1, policy_version 1256742 (0.0007) [2023-12-28 04:16:04,618][106225] Updated weights for policy 1, policy_version 1256752 (0.0005) [2023-12-28 04:16:04,680][106225] Updated weights for policy 1, policy_version 1256762 (0.0009) [2023-12-28 04:16:04,737][106225] Updated weights for policy 1, policy_version 1256772 (0.0010) [2023-12-28 04:16:04,755][106226] Updated weights for policy 0, policy_version 1253627 (0.0006) [2023-12-28 04:16:04,809][106226] Updated weights for policy 0, policy_version 1253637 (0.0008) [2023-12-28 04:16:04,852][106226] Updated weights for policy 0, policy_version 1253647 (0.0008) [2023-12-28 04:16:05,344][106225] Updated weights for policy 1, policy_version 1256782 (0.0007) [2023-12-28 04:16:05,397][106225] Updated weights for policy 1, policy_version 1256792 (0.0005) [2023-12-28 04:16:05,447][106225] Updated weights for policy 1, policy_version 1256802 (0.0005) [2023-12-28 04:16:05,673][106226] Updated weights for policy 0, policy_version 1253657 (0.0008) [2023-12-28 04:16:05,726][106226] Updated weights for policy 0, policy_version 1253667 (0.0008) [2023-12-28 04:16:05,778][106226] Updated weights for policy 0, policy_version 1253677 (0.0008) [2023-12-28 04:16:05,835][106226] Updated weights for policy 0, policy_version 1253687 (0.0008) [2023-12-28 04:16:06,115][106225] Updated weights for policy 1, policy_version 1256812 (0.0007) [2023-12-28 04:16:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 642793472. Throughput: 0: 10029.9, 1: 9829.2. Samples: 642804948. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:06,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-5.169')] [2023-12-28 04:16:06,179][106225] Updated weights for policy 1, policy_version 1256822 (0.0010) [2023-12-28 04:16:06,245][106225] Updated weights for policy 1, policy_version 1256832 (0.0011) [2023-12-28 04:16:06,555][106226] Updated weights for policy 0, policy_version 1253697 (0.0008) [2023-12-28 04:16:06,616][106226] Updated weights for policy 0, policy_version 1253707 (0.0008) [2023-12-28 04:16:06,679][106226] Updated weights for policy 0, policy_version 1253717 (0.0008) [2023-12-28 04:16:06,962][106225] Updated weights for policy 1, policy_version 1256842 (0.0011) [2023-12-28 04:16:07,020][106225] Updated weights for policy 1, policy_version 1256852 (0.0010) [2023-12-28 04:16:07,078][106225] Updated weights for policy 1, policy_version 1256862 (0.0010) [2023-12-28 04:16:07,139][106225] Updated weights for policy 1, policy_version 1256872 (0.0010) [2023-12-28 04:16:07,393][106226] Updated weights for policy 0, policy_version 1253727 (0.0007) [2023-12-28 04:16:07,455][106226] Updated weights for policy 0, policy_version 1253737 (0.0008) [2023-12-28 04:16:07,524][106226] Updated weights for policy 0, policy_version 1253747 (0.0008) [2023-12-28 04:16:07,836][106225] Updated weights for policy 1, policy_version 1256882 (0.0007) [2023-12-28 04:16:07,897][106225] Updated weights for policy 1, policy_version 1256892 (0.0005) [2023-12-28 04:16:07,950][106225] Updated weights for policy 1, policy_version 1256902 (0.0006) [2023-12-28 04:16:08,314][106226] Updated weights for policy 0, policy_version 1253757 (0.0009) [2023-12-28 04:16:08,379][106226] Updated weights for policy 0, policy_version 1253767 (0.0008) [2023-12-28 04:16:08,437][106226] Updated weights for policy 0, policy_version 1253777 (0.0008) [2023-12-28 04:16:08,624][106225] Updated weights for policy 1, policy_version 1256912 (0.0008) [2023-12-28 04:16:08,687][106225] Updated weights for policy 1, policy_version 1256922 (0.0008) [2023-12-28 04:16:08,747][106225] Updated weights for policy 1, policy_version 1256932 (0.0008) [2023-12-28 04:16:09,163][106226] Updated weights for policy 0, policy_version 1253787 (0.0008) [2023-12-28 04:16:09,238][106226] Updated weights for policy 0, policy_version 1253797 (0.0009) [2023-12-28 04:16:09,304][106226] Updated weights for policy 0, policy_version 1253807 (0.0008) [2023-12-28 04:16:09,478][106225] Updated weights for policy 1, policy_version 1256942 (0.0009) [2023-12-28 04:16:09,529][106225] Updated weights for policy 1, policy_version 1256952 (0.0007) [2023-12-28 04:16:09,588][106225] Updated weights for policy 1, policy_version 1256962 (0.0008) [2023-12-28 04:16:10,110][106226] Updated weights for policy 0, policy_version 1253817 (0.0007) [2023-12-28 04:16:10,177][106226] Updated weights for policy 0, policy_version 1253827 (0.0008) [2023-12-28 04:16:10,245][106226] Updated weights for policy 0, policy_version 1253837 (0.0008) [2023-12-28 04:16:10,317][106226] Updated weights for policy 0, policy_version 1253847 (0.0008) [2023-12-28 04:16:10,341][106225] Updated weights for policy 1, policy_version 1256972 (0.0007) [2023-12-28 04:16:10,412][106225] Updated weights for policy 1, policy_version 1256982 (0.0006) [2023-12-28 04:16:10,480][106225] Updated weights for policy 1, policy_version 1256992 (0.0008) [2023-12-28 04:16:11,022][106226] Updated weights for policy 0, policy_version 1253857 (0.0009) [2023-12-28 04:16:11,089][106226] Updated weights for policy 0, policy_version 1253867 (0.0008) [2023-12-28 04:16:11,162][106226] Updated weights for policy 0, policy_version 1253877 (0.0008) [2023-12-28 04:16:11,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 642883584. Throughput: 0: 9955.2, 1: 9866.7. Samples: 642862368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:11,175][106225] Updated weights for policy 1, policy_version 1257002 (0.0007) [2023-12-28 04:16:11,176][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.971')] [2023-12-28 04:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001253880_321052672.pth... [2023-12-28 04:16:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001252728_320757760.pth [2023-12-28 04:16:11,245][106225] Updated weights for policy 1, policy_version 1257012 (0.0009) [2023-12-28 04:16:11,312][106225] Updated weights for policy 1, policy_version 1257022 (0.0009) [2023-12-28 04:16:11,390][106225] Updated weights for policy 1, policy_version 1257032 (0.0009) [2023-12-28 04:16:11,390][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001257032_321847296.pth... [2023-12-28 04:16:11,396][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001255848_321544192.pth [2023-12-28 04:16:11,968][106226] Updated weights for policy 0, policy_version 1253887 (0.0009) [2023-12-28 04:16:12,037][106226] Updated weights for policy 0, policy_version 1253897 (0.0011) [2023-12-28 04:16:12,100][106226] Updated weights for policy 0, policy_version 1253907 (0.0011) [2023-12-28 04:16:12,206][106225] Updated weights for policy 1, policy_version 1257042 (0.0007) [2023-12-28 04:16:12,273][106225] Updated weights for policy 1, policy_version 1257052 (0.0009) [2023-12-28 04:16:12,338][106225] Updated weights for policy 1, policy_version 1257062 (0.0008) [2023-12-28 04:16:12,903][106226] Updated weights for policy 0, policy_version 1253917 (0.0007) [2023-12-28 04:16:12,967][106226] Updated weights for policy 0, policy_version 1253927 (0.0009) [2023-12-28 04:16:13,016][106225] Updated weights for policy 1, policy_version 1257072 (0.0009) [2023-12-28 04:16:13,028][106226] Updated weights for policy 0, policy_version 1253937 (0.0008) [2023-12-28 04:16:13,078][106225] Updated weights for policy 1, policy_version 1257082 (0.0008) [2023-12-28 04:16:13,131][106225] Updated weights for policy 1, policy_version 1257092 (0.0008) [2023-12-28 04:16:13,788][106225] Updated weights for policy 1, policy_version 1257102 (0.0008) [2023-12-28 04:16:13,807][106226] Updated weights for policy 0, policy_version 1253947 (0.0009) [2023-12-28 04:16:13,843][106225] Updated weights for policy 1, policy_version 1257112 (0.0007) [2023-12-28 04:16:13,854][106226] Updated weights for policy 0, policy_version 1253957 (0.0005) [2023-12-28 04:16:13,900][106225] Updated weights for policy 1, policy_version 1257122 (0.0008) [2023-12-28 04:16:13,902][106226] Updated weights for policy 0, policy_version 1253967 (0.0005) [2023-12-28 04:16:14,608][106226] Updated weights for policy 0, policy_version 1253977 (0.0008) [2023-12-28 04:16:14,667][106226] Updated weights for policy 0, policy_version 1253987 (0.0008) [2023-12-28 04:16:14,675][106225] Updated weights for policy 1, policy_version 1257132 (0.0008) [2023-12-28 04:16:14,724][106226] Updated weights for policy 0, policy_version 1253997 (0.0008) [2023-12-28 04:16:14,735][106225] Updated weights for policy 1, policy_version 1257142 (0.0006) [2023-12-28 04:16:14,794][106226] Updated weights for policy 0, policy_version 1254007 (0.0008) [2023-12-28 04:16:14,798][106225] Updated weights for policy 1, policy_version 1257152 (0.0008) [2023-12-28 04:16:15,562][106225] Updated weights for policy 1, policy_version 1257162 (0.0007) [2023-12-28 04:16:15,606][106226] Updated weights for policy 0, policy_version 1254017 (0.0008) [2023-12-28 04:16:15,626][106225] Updated weights for policy 1, policy_version 1257172 (0.0005) [2023-12-28 04:16:15,659][106226] Updated weights for policy 0, policy_version 1254027 (0.0005) [2023-12-28 04:16:15,692][106225] Updated weights for policy 1, policy_version 1257182 (0.0009) [2023-12-28 04:16:15,706][106226] Updated weights for policy 0, policy_version 1254037 (0.0005) [2023-12-28 04:16:15,750][106225] Updated weights for policy 1, policy_version 1257192 (0.0010) [2023-12-28 04:16:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 642981888. Throughput: 0: 9699.0, 1: 9857.5. Samples: 642972748. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:16,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.929')] [2023-12-28 04:16:16,362][106226] Updated weights for policy 0, policy_version 1254047 (0.0006) [2023-12-28 04:16:16,386][106225] Updated weights for policy 1, policy_version 1257202 (0.0007) [2023-12-28 04:16:16,410][106226] Updated weights for policy 0, policy_version 1254057 (0.0006) [2023-12-28 04:16:16,449][106225] Updated weights for policy 1, policy_version 1257212 (0.0007) [2023-12-28 04:16:16,471][106226] Updated weights for policy 0, policy_version 1254067 (0.0006) [2023-12-28 04:16:16,515][106225] Updated weights for policy 1, policy_version 1257222 (0.0008) [2023-12-28 04:16:17,112][106225] Updated weights for policy 1, policy_version 1257232 (0.0010) [2023-12-28 04:16:17,168][106226] Updated weights for policy 0, policy_version 1254077 (0.0007) [2023-12-28 04:16:17,177][106225] Updated weights for policy 1, policy_version 1257242 (0.0011) [2023-12-28 04:16:17,218][106226] Updated weights for policy 0, policy_version 1254087 (0.0006) [2023-12-28 04:16:17,232][106225] Updated weights for policy 1, policy_version 1257252 (0.0010) [2023-12-28 04:16:17,270][106226] Updated weights for policy 0, policy_version 1254097 (0.0008) [2023-12-28 04:16:17,942][106225] Updated weights for policy 1, policy_version 1257262 (0.0010) [2023-12-28 04:16:17,955][106226] Updated weights for policy 0, policy_version 1254107 (0.0009) [2023-12-28 04:16:17,993][106225] Updated weights for policy 1, policy_version 1257272 (0.0010) [2023-12-28 04:16:18,012][106226] Updated weights for policy 0, policy_version 1254117 (0.0010) [2023-12-28 04:16:18,040][106225] Updated weights for policy 1, policy_version 1257282 (0.0007) [2023-12-28 04:16:18,073][106226] Updated weights for policy 0, policy_version 1254127 (0.0010) [2023-12-28 04:16:18,781][106226] Updated weights for policy 0, policy_version 1254137 (0.0010) [2023-12-28 04:16:18,787][106225] Updated weights for policy 1, policy_version 1257292 (0.0010) [2023-12-28 04:16:18,839][106225] Updated weights for policy 1, policy_version 1257302 (0.0007) [2023-12-28 04:16:18,840][106226] Updated weights for policy 0, policy_version 1254147 (0.0011) [2023-12-28 04:16:18,894][106225] Updated weights for policy 1, policy_version 1257312 (0.0006) [2023-12-28 04:16:18,901][106226] Updated weights for policy 0, policy_version 1254157 (0.0011) [2023-12-28 04:16:18,964][106226] Updated weights for policy 0, policy_version 1254167 (0.0011) [2023-12-28 04:16:19,619][106225] Updated weights for policy 1, policy_version 1257322 (0.0007) [2023-12-28 04:16:19,679][106225] Updated weights for policy 1, policy_version 1257332 (0.0010) [2023-12-28 04:16:19,715][106226] Updated weights for policy 0, policy_version 1254177 (0.0006) [2023-12-28 04:16:19,748][106225] Updated weights for policy 1, policy_version 1257342 (0.0010) [2023-12-28 04:16:19,774][106226] Updated weights for policy 0, policy_version 1254187 (0.0006) [2023-12-28 04:16:19,810][106225] Updated weights for policy 1, policy_version 1257352 (0.0010) [2023-12-28 04:16:19,839][106226] Updated weights for policy 0, policy_version 1254197 (0.0008) [2023-12-28 04:16:20,534][106226] Updated weights for policy 0, policy_version 1254207 (0.0008) [2023-12-28 04:16:20,558][106225] Updated weights for policy 1, policy_version 1257362 (0.0008) [2023-12-28 04:16:20,600][106226] Updated weights for policy 0, policy_version 1254217 (0.0007) [2023-12-28 04:16:20,625][106225] Updated weights for policy 1, policy_version 1257372 (0.0009) [2023-12-28 04:16:20,662][106226] Updated weights for policy 0, policy_version 1254227 (0.0008) [2023-12-28 04:16:20,689][106225] Updated weights for policy 1, policy_version 1257382 (0.0006) [2023-12-28 04:16:21,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 643080192. Throughput: 0: 9690.2, 1: 9859.4. Samples: 643091724. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:21,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.911')] [2023-12-28 04:16:21,451][106226] Updated weights for policy 0, policy_version 1254237 (0.0007) [2023-12-28 04:16:21,461][106225] Updated weights for policy 1, policy_version 1257392 (0.0008) [2023-12-28 04:16:21,511][106226] Updated weights for policy 0, policy_version 1254247 (0.0005) [2023-12-28 04:16:21,524][106225] Updated weights for policy 1, policy_version 1257402 (0.0008) [2023-12-28 04:16:21,574][106226] Updated weights for policy 0, policy_version 1254257 (0.0007) [2023-12-28 04:16:21,587][106225] Updated weights for policy 1, policy_version 1257412 (0.0008) [2023-12-28 04:16:22,258][106226] Updated weights for policy 0, policy_version 1254267 (0.0008) [2023-12-28 04:16:22,291][106225] Updated weights for policy 1, policy_version 1257422 (0.0008) [2023-12-28 04:16:22,315][106226] Updated weights for policy 0, policy_version 1254277 (0.0007) [2023-12-28 04:16:22,357][106225] Updated weights for policy 1, policy_version 1257432 (0.0009) [2023-12-28 04:16:22,393][106226] Updated weights for policy 0, policy_version 1254287 (0.0007) [2023-12-28 04:16:22,420][106225] Updated weights for policy 1, policy_version 1257442 (0.0008) [2023-12-28 04:16:23,070][106225] Updated weights for policy 1, policy_version 1257452 (0.0010) [2023-12-28 04:16:23,128][106225] Updated weights for policy 1, policy_version 1257462 (0.0011) [2023-12-28 04:16:23,156][106226] Updated weights for policy 0, policy_version 1254297 (0.0006) [2023-12-28 04:16:23,179][106225] Updated weights for policy 1, policy_version 1257472 (0.0010) [2023-12-28 04:16:23,209][106226] Updated weights for policy 0, policy_version 1254307 (0.0009) [2023-12-28 04:16:23,267][106226] Updated weights for policy 0, policy_version 1254317 (0.0008) [2023-12-28 04:16:23,328][106226] Updated weights for policy 0, policy_version 1254327 (0.0008) [2023-12-28 04:16:23,851][106225] Updated weights for policy 1, policy_version 1257482 (0.0009) [2023-12-28 04:16:23,903][106225] Updated weights for policy 1, policy_version 1257492 (0.0005) [2023-12-28 04:16:23,956][106225] Updated weights for policy 1, policy_version 1257502 (0.0007) [2023-12-28 04:16:24,014][106225] Updated weights for policy 1, policy_version 1257512 (0.0009) [2023-12-28 04:16:24,101][106226] Updated weights for policy 0, policy_version 1254337 (0.0007) [2023-12-28 04:16:24,170][106226] Updated weights for policy 0, policy_version 1254347 (0.0006) [2023-12-28 04:16:24,225][106226] Updated weights for policy 0, policy_version 1254357 (0.0008) [2023-12-28 04:16:24,647][106225] Updated weights for policy 1, policy_version 1257522 (0.0010) [2023-12-28 04:16:24,701][106225] Updated weights for policy 1, policy_version 1257532 (0.0010) [2023-12-28 04:16:24,755][106225] Updated weights for policy 1, policy_version 1257542 (0.0010) [2023-12-28 04:16:24,937][106226] Updated weights for policy 0, policy_version 1254367 (0.0011) [2023-12-28 04:16:24,995][106226] Updated weights for policy 0, policy_version 1254377 (0.0011) [2023-12-28 04:16:25,063][106226] Updated weights for policy 0, policy_version 1254387 (0.0011) [2023-12-28 04:16:25,479][106225] Updated weights for policy 1, policy_version 1257552 (0.0010) [2023-12-28 04:16:25,524][106225] Updated weights for policy 1, policy_version 1257562 (0.0010) [2023-12-28 04:16:25,571][106225] Updated weights for policy 1, policy_version 1257572 (0.0010) [2023-12-28 04:16:25,675][106226] Updated weights for policy 0, policy_version 1254397 (0.0010) [2023-12-28 04:16:25,746][106226] Updated weights for policy 0, policy_version 1254407 (0.0008) [2023-12-28 04:16:25,805][106226] Updated weights for policy 0, policy_version 1254417 (0.0010) [2023-12-28 04:16:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 643178496. Throughput: 0: 9641.9, 1: 9829.6. Samples: 643148584. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:26,176][105115] Avg episode reward: [(0, '-4.187'), (1, '-5.086')] [2023-12-28 04:16:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001254424_321191936.pth... [2023-12-28 04:16:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001257576_321986560.pth... [2023-12-28 04:16:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001256424_321691648.pth [2023-12-28 04:16:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001253336_320913408.pth [2023-12-28 04:16:26,324][106225] Updated weights for policy 1, policy_version 1257582 (0.0010) [2023-12-28 04:16:26,371][106225] Updated weights for policy 1, policy_version 1257592 (0.0010) [2023-12-28 04:16:26,417][106225] Updated weights for policy 1, policy_version 1257602 (0.0010) [2023-12-28 04:16:26,486][106226] Updated weights for policy 0, policy_version 1254427 (0.0010) [2023-12-28 04:16:26,543][106226] Updated weights for policy 0, policy_version 1254437 (0.0008) [2023-12-28 04:16:26,592][106226] Updated weights for policy 0, policy_version 1254447 (0.0008) [2023-12-28 04:16:27,071][106225] Updated weights for policy 1, policy_version 1257612 (0.0005) [2023-12-28 04:16:27,123][106225] Updated weights for policy 1, policy_version 1257622 (0.0010) [2023-12-28 04:16:27,173][106225] Updated weights for policy 1, policy_version 1257632 (0.0010) [2023-12-28 04:16:27,292][106226] Updated weights for policy 0, policy_version 1254457 (0.0006) [2023-12-28 04:16:27,349][106226] Updated weights for policy 0, policy_version 1254467 (0.0007) [2023-12-28 04:16:27,408][106226] Updated weights for policy 0, policy_version 1254477 (0.0006) [2023-12-28 04:16:27,466][106226] Updated weights for policy 0, policy_version 1254487 (0.0006) [2023-12-28 04:16:27,824][106225] Updated weights for policy 1, policy_version 1257642 (0.0009) [2023-12-28 04:16:27,874][106225] Updated weights for policy 1, policy_version 1257652 (0.0005) [2023-12-28 04:16:27,926][106225] Updated weights for policy 1, policy_version 1257662 (0.0005) [2023-12-28 04:16:27,986][106225] Updated weights for policy 1, policy_version 1257672 (0.0005) [2023-12-28 04:16:28,211][106226] Updated weights for policy 0, policy_version 1254497 (0.0005) [2023-12-28 04:16:28,275][106226] Updated weights for policy 0, policy_version 1254507 (0.0005) [2023-12-28 04:16:28,334][106226] Updated weights for policy 0, policy_version 1254517 (0.0006) [2023-12-28 04:16:28,601][106225] Updated weights for policy 1, policy_version 1257682 (0.0008) [2023-12-28 04:16:28,658][106225] Updated weights for policy 1, policy_version 1257692 (0.0005) [2023-12-28 04:16:28,711][106225] Updated weights for policy 1, policy_version 1257702 (0.0005) [2023-12-28 04:16:28,991][106226] Updated weights for policy 0, policy_version 1254527 (0.0007) [2023-12-28 04:16:29,053][106226] Updated weights for policy 0, policy_version 1254537 (0.0010) [2023-12-28 04:16:29,109][106226] Updated weights for policy 0, policy_version 1254547 (0.0009) [2023-12-28 04:16:29,319][106225] Updated weights for policy 1, policy_version 1257712 (0.0006) [2023-12-28 04:16:29,390][106225] Updated weights for policy 1, policy_version 1257722 (0.0007) [2023-12-28 04:16:29,454][106225] Updated weights for policy 1, policy_version 1257732 (0.0007) [2023-12-28 04:16:29,834][106226] Updated weights for policy 0, policy_version 1254557 (0.0007) [2023-12-28 04:16:29,900][106226] Updated weights for policy 0, policy_version 1254567 (0.0009) [2023-12-28 04:16:29,966][106226] Updated weights for policy 0, policy_version 1254577 (0.0007) [2023-12-28 04:16:30,179][106225] Updated weights for policy 1, policy_version 1257742 (0.0008) [2023-12-28 04:16:30,239][106225] Updated weights for policy 1, policy_version 1257752 (0.0009) [2023-12-28 04:16:30,291][106225] Updated weights for policy 1, policy_version 1257762 (0.0009) [2023-12-28 04:16:30,603][106226] Updated weights for policy 0, policy_version 1254587 (0.0005) [2023-12-28 04:16:30,655][106226] Updated weights for policy 0, policy_version 1254597 (0.0006) [2023-12-28 04:16:30,714][106226] Updated weights for policy 0, policy_version 1254607 (0.0005) [2023-12-28 04:16:30,975][106225] Updated weights for policy 1, policy_version 1257772 (0.0007) [2023-12-28 04:16:31,033][106225] Updated weights for policy 1, policy_version 1257782 (0.0006) [2023-12-28 04:16:31,102][106225] Updated weights for policy 1, policy_version 1257792 (0.0005) [2023-12-28 04:16:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 643284992. Throughput: 0: 9591.6, 1: 9948.0. Samples: 643271436. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:31,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.993')] [2023-12-28 04:16:31,324][106226] Updated weights for policy 0, policy_version 1254617 (0.0005) [2023-12-28 04:16:31,396][106226] Updated weights for policy 0, policy_version 1254627 (0.0010) [2023-12-28 04:16:31,462][106226] Updated weights for policy 0, policy_version 1254637 (0.0006) [2023-12-28 04:16:31,530][106226] Updated weights for policy 0, policy_version 1254647 (0.0006) [2023-12-28 04:16:31,797][106225] Updated weights for policy 1, policy_version 1257802 (0.0007) [2023-12-28 04:16:31,849][106225] Updated weights for policy 1, policy_version 1257812 (0.0009) [2023-12-28 04:16:31,899][106225] Updated weights for policy 1, policy_version 1257822 (0.0009) [2023-12-28 04:16:31,943][106225] Updated weights for policy 1, policy_version 1257832 (0.0008) [2023-12-28 04:16:32,144][106226] Updated weights for policy 0, policy_version 1254657 (0.0006) [2023-12-28 04:16:32,208][106226] Updated weights for policy 0, policy_version 1254667 (0.0008) [2023-12-28 04:16:32,271][106226] Updated weights for policy 0, policy_version 1254677 (0.0009) [2023-12-28 04:16:32,761][106225] Updated weights for policy 1, policy_version 1257843 (0.0011) [2023-12-28 04:16:32,816][106225] Updated weights for policy 1, policy_version 1257853 (0.0010) [2023-12-28 04:16:32,854][106226] Updated weights for policy 0, policy_version 1254687 (0.0006) [2023-12-28 04:16:32,871][106225] Updated weights for policy 1, policy_version 1257863 (0.0008) [2023-12-28 04:16:32,917][106226] Updated weights for policy 0, policy_version 1254697 (0.0005) [2023-12-28 04:16:32,974][106226] Updated weights for policy 0, policy_version 1254707 (0.0005) [2023-12-28 04:16:33,566][106226] Updated weights for policy 0, policy_version 1254717 (0.0009) [2023-12-28 04:16:33,616][106225] Updated weights for policy 1, policy_version 1257873 (0.0006) [2023-12-28 04:16:33,625][106226] Updated weights for policy 0, policy_version 1254727 (0.0010) [2023-12-28 04:16:33,677][106226] Updated weights for policy 0, policy_version 1254737 (0.0009) [2023-12-28 04:16:33,681][106225] Updated weights for policy 1, policy_version 1257883 (0.0006) [2023-12-28 04:16:33,736][106225] Updated weights for policy 1, policy_version 1257893 (0.0006) [2023-12-28 04:16:34,339][106226] Updated weights for policy 0, policy_version 1254747 (0.0009) [2023-12-28 04:16:34,407][106226] Updated weights for policy 0, policy_version 1254757 (0.0006) [2023-12-28 04:16:34,464][106225] Updated weights for policy 1, policy_version 1257903 (0.0007) [2023-12-28 04:16:34,474][106226] Updated weights for policy 0, policy_version 1254767 (0.0008) [2023-12-28 04:16:34,527][106225] Updated weights for policy 1, policy_version 1257913 (0.0007) [2023-12-28 04:16:34,583][106225] Updated weights for policy 1, policy_version 1257923 (0.0009) [2023-12-28 04:16:35,155][106226] Updated weights for policy 0, policy_version 1254777 (0.0007) [2023-12-28 04:16:35,227][106226] Updated weights for policy 0, policy_version 1254787 (0.0005) [2023-12-28 04:16:35,297][106226] Updated weights for policy 0, policy_version 1254797 (0.0006) [2023-12-28 04:16:35,297][106225] Updated weights for policy 1, policy_version 1257933 (0.0008) [2023-12-28 04:16:35,351][106226] Updated weights for policy 0, policy_version 1254807 (0.0010) [2023-12-28 04:16:35,357][106225] Updated weights for policy 1, policy_version 1257943 (0.0008) [2023-12-28 04:16:35,423][106225] Updated weights for policy 1, policy_version 1257953 (0.0007) [2023-12-28 04:16:35,995][106226] Updated weights for policy 0, policy_version 1254817 (0.0008) [2023-12-28 04:16:36,042][106226] Updated weights for policy 0, policy_version 1254827 (0.0007) [2023-12-28 04:16:36,096][106226] Updated weights for policy 0, policy_version 1254837 (0.0008) [2023-12-28 04:16:36,124][106225] Updated weights for policy 1, policy_version 1257963 (0.0007) [2023-12-28 04:16:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 643383296. Throughput: 0: 9649.7, 1: 9895.0. Samples: 643393172. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:36,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.989')] [2023-12-28 04:16:36,186][106225] Updated weights for policy 1, policy_version 1257973 (0.0008) [2023-12-28 04:16:36,250][106225] Updated weights for policy 1, policy_version 1257983 (0.0007) [2023-12-28 04:16:36,842][106226] Updated weights for policy 0, policy_version 1254847 (0.0009) [2023-12-28 04:16:36,897][106226] Updated weights for policy 0, policy_version 1254857 (0.0005) [2023-12-28 04:16:36,966][106226] Updated weights for policy 0, policy_version 1254867 (0.0009) [2023-12-28 04:16:36,988][106225] Updated weights for policy 1, policy_version 1257993 (0.0008) [2023-12-28 04:16:37,042][106225] Updated weights for policy 1, policy_version 1258003 (0.0006) [2023-12-28 04:16:37,091][106225] Updated weights for policy 1, policy_version 1258013 (0.0005) [2023-12-28 04:16:37,140][106225] Updated weights for policy 1, policy_version 1258023 (0.0005) [2023-12-28 04:16:37,658][106226] Updated weights for policy 0, policy_version 1254877 (0.0011) [2023-12-28 04:16:37,726][106226] Updated weights for policy 0, policy_version 1254887 (0.0006) [2023-12-28 04:16:37,788][106226] Updated weights for policy 0, policy_version 1254897 (0.0006) [2023-12-28 04:16:37,835][106225] Updated weights for policy 1, policy_version 1258033 (0.0008) [2023-12-28 04:16:37,891][106225] Updated weights for policy 1, policy_version 1258043 (0.0008) [2023-12-28 04:16:37,947][106225] Updated weights for policy 1, policy_version 1258053 (0.0009) [2023-12-28 04:16:38,499][106226] Updated weights for policy 0, policy_version 1254907 (0.0007) [2023-12-28 04:16:38,551][106226] Updated weights for policy 0, policy_version 1254917 (0.0009) [2023-12-28 04:16:38,604][106226] Updated weights for policy 0, policy_version 1254927 (0.0008) [2023-12-28 04:16:38,643][106225] Updated weights for policy 1, policy_version 1258063 (0.0006) [2023-12-28 04:16:38,702][106225] Updated weights for policy 1, policy_version 1258073 (0.0005) [2023-12-28 04:16:38,759][106225] Updated weights for policy 1, policy_version 1258083 (0.0005) [2023-12-28 04:16:39,358][106226] Updated weights for policy 0, policy_version 1254937 (0.0008) [2023-12-28 04:16:39,433][106226] Updated weights for policy 0, policy_version 1254947 (0.0009) [2023-12-28 04:16:39,478][106225] Updated weights for policy 1, policy_version 1258093 (0.0006) [2023-12-28 04:16:39,506][106226] Updated weights for policy 0, policy_version 1254957 (0.0008) [2023-12-28 04:16:39,545][106225] Updated weights for policy 1, policy_version 1258103 (0.0006) [2023-12-28 04:16:39,573][106226] Updated weights for policy 0, policy_version 1254967 (0.0008) [2023-12-28 04:16:39,611][106225] Updated weights for policy 1, policy_version 1258113 (0.0006) [2023-12-28 04:16:40,226][106226] Updated weights for policy 0, policy_version 1254977 (0.0007) [2023-12-28 04:16:40,286][106226] Updated weights for policy 0, policy_version 1254987 (0.0009) [2023-12-28 04:16:40,321][106225] Updated weights for policy 1, policy_version 1258123 (0.0007) [2023-12-28 04:16:40,348][106226] Updated weights for policy 0, policy_version 1254997 (0.0009) [2023-12-28 04:16:40,384][106225] Updated weights for policy 1, policy_version 1258133 (0.0006) [2023-12-28 04:16:40,444][106225] Updated weights for policy 1, policy_version 1258143 (0.0009) [2023-12-28 04:16:41,017][106226] Updated weights for policy 0, policy_version 1255007 (0.0007) [2023-12-28 04:16:41,087][106226] Updated weights for policy 0, policy_version 1255017 (0.0008) [2023-12-28 04:16:41,146][106226] Updated weights for policy 0, policy_version 1255027 (0.0009) [2023-12-28 04:16:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 643473408. Throughput: 0: 9648.0, 1: 9880.4. Samples: 643451844. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:41,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.976')] [2023-12-28 04:16:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001255032_321347584.pth... [2023-12-28 04:16:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001253880_321052672.pth [2023-12-28 04:16:41,193][106225] Updated weights for policy 1, policy_version 1258153 (0.0008) [2023-12-28 04:16:41,263][106225] Updated weights for policy 1, policy_version 1258163 (0.0008) [2023-12-28 04:16:41,328][106225] Updated weights for policy 1, policy_version 1258173 (0.0008) [2023-12-28 04:16:41,391][106225] Updated weights for policy 1, policy_version 1258183 (0.0008) [2023-12-28 04:16:41,398][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001258184_322142208.pth... [2023-12-28 04:16:41,402][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001257032_321847296.pth [2023-12-28 04:16:41,877][106226] Updated weights for policy 0, policy_version 1255037 (0.0010) [2023-12-28 04:16:41,939][106226] Updated weights for policy 0, policy_version 1255047 (0.0008) [2023-12-28 04:16:42,001][106226] Updated weights for policy 0, policy_version 1255057 (0.0008) [2023-12-28 04:16:42,156][106225] Updated weights for policy 1, policy_version 1258193 (0.0009) [2023-12-28 04:16:42,216][106225] Updated weights for policy 1, policy_version 1258203 (0.0010) [2023-12-28 04:16:42,278][106225] Updated weights for policy 1, policy_version 1258213 (0.0010) [2023-12-28 04:16:42,772][106226] Updated weights for policy 0, policy_version 1255067 (0.0008) [2023-12-28 04:16:42,828][106226] Updated weights for policy 0, policy_version 1255077 (0.0009) [2023-12-28 04:16:42,890][106226] Updated weights for policy 0, policy_version 1255087 (0.0009) [2023-12-28 04:16:42,907][106225] Updated weights for policy 1, policy_version 1258223 (0.0010) [2023-12-28 04:16:42,957][106225] Updated weights for policy 1, policy_version 1258233 (0.0010) [2023-12-28 04:16:43,003][106225] Updated weights for policy 1, policy_version 1258243 (0.0010) [2023-12-28 04:16:43,601][106226] Updated weights for policy 0, policy_version 1255097 (0.0008) [2023-12-28 04:16:43,647][106226] Updated weights for policy 0, policy_version 1255107 (0.0007) [2023-12-28 04:16:43,694][106225] Updated weights for policy 1, policy_version 1258253 (0.0010) [2023-12-28 04:16:43,696][106226] Updated weights for policy 0, policy_version 1255117 (0.0007) [2023-12-28 04:16:43,746][106226] Updated weights for policy 0, policy_version 1255127 (0.0005) [2023-12-28 04:16:43,751][106225] Updated weights for policy 1, policy_version 1258263 (0.0010) [2023-12-28 04:16:43,810][106225] Updated weights for policy 1, policy_version 1258273 (0.0010) [2023-12-28 04:16:44,405][106226] Updated weights for policy 0, policy_version 1255137 (0.0008) [2023-12-28 04:16:44,462][106226] Updated weights for policy 0, policy_version 1255147 (0.0008) [2023-12-28 04:16:44,521][106226] Updated weights for policy 0, policy_version 1255157 (0.0006) [2023-12-28 04:16:44,534][106225] Updated weights for policy 1, policy_version 1258283 (0.0010) [2023-12-28 04:16:44,581][106225] Updated weights for policy 1, policy_version 1258293 (0.0010) [2023-12-28 04:16:44,633][106225] Updated weights for policy 1, policy_version 1258303 (0.0010) [2023-12-28 04:16:45,121][106226] Updated weights for policy 0, policy_version 1255167 (0.0006) [2023-12-28 04:16:45,189][106226] Updated weights for policy 0, policy_version 1255177 (0.0006) [2023-12-28 04:16:45,260][106226] Updated weights for policy 0, policy_version 1255187 (0.0007) [2023-12-28 04:16:45,402][106225] Updated weights for policy 1, policy_version 1258313 (0.0010) [2023-12-28 04:16:45,463][106225] Updated weights for policy 1, policy_version 1258323 (0.0011) [2023-12-28 04:16:45,524][106225] Updated weights for policy 1, policy_version 1258333 (0.0010) [2023-12-28 04:16:45,582][106225] Updated weights for policy 1, policy_version 1258343 (0.0011) [2023-12-28 04:16:45,862][106226] Updated weights for policy 0, policy_version 1255197 (0.0007) [2023-12-28 04:16:45,920][106226] Updated weights for policy 0, policy_version 1255207 (0.0006) [2023-12-28 04:16:45,982][106226] Updated weights for policy 0, policy_version 1255217 (0.0006) [2023-12-28 04:16:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 643579904. Throughput: 0: 9720.2, 1: 9860.9. Samples: 643569192. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:46,176][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.974')] [2023-12-28 04:16:46,309][106225] Updated weights for policy 1, policy_version 1258353 (0.0011) [2023-12-28 04:16:46,369][106225] Updated weights for policy 1, policy_version 1258363 (0.0010) [2023-12-28 04:16:46,422][106225] Updated weights for policy 1, policy_version 1258373 (0.0010) [2023-12-28 04:16:46,489][106226] Updated weights for policy 0, policy_version 1255227 (0.0005) [2023-12-28 04:16:46,551][106226] Updated weights for policy 0, policy_version 1255237 (0.0005) [2023-12-28 04:16:46,607][106226] Updated weights for policy 0, policy_version 1255247 (0.0005) [2023-12-28 04:16:47,161][106226] Updated weights for policy 0, policy_version 1255257 (0.0008) [2023-12-28 04:16:47,192][106225] Updated weights for policy 1, policy_version 1258383 (0.0010) [2023-12-28 04:16:47,221][106226] Updated weights for policy 0, policy_version 1255267 (0.0008) [2023-12-28 04:16:47,243][106225] Updated weights for policy 1, policy_version 1258393 (0.0007) [2023-12-28 04:16:47,280][106226] Updated weights for policy 0, policy_version 1255277 (0.0008) [2023-12-28 04:16:47,294][106225] Updated weights for policy 1, policy_version 1258403 (0.0006) [2023-12-28 04:16:47,334][106226] Updated weights for policy 0, policy_version 1255287 (0.0007) [2023-12-28 04:16:48,025][106225] Updated weights for policy 1, policy_version 1258413 (0.0009) [2023-12-28 04:16:48,035][106226] Updated weights for policy 0, policy_version 1255297 (0.0006) [2023-12-28 04:16:48,076][106225] Updated weights for policy 1, policy_version 1258423 (0.0010) [2023-12-28 04:16:48,090][106226] Updated weights for policy 0, policy_version 1255307 (0.0006) [2023-12-28 04:16:48,126][106225] Updated weights for policy 1, policy_version 1258433 (0.0010) [2023-12-28 04:16:48,147][106226] Updated weights for policy 0, policy_version 1255317 (0.0005) [2023-12-28 04:16:48,873][106225] Updated weights for policy 1, policy_version 1258443 (0.0010) [2023-12-28 04:16:48,905][106226] Updated weights for policy 0, policy_version 1255327 (0.0008) [2023-12-28 04:16:48,937][106225] Updated weights for policy 1, policy_version 1258453 (0.0011) [2023-12-28 04:16:48,958][106226] Updated weights for policy 0, policy_version 1255337 (0.0010) [2023-12-28 04:16:48,998][106225] Updated weights for policy 1, policy_version 1258463 (0.0010) [2023-12-28 04:16:49,012][106226] Updated weights for policy 0, policy_version 1255347 (0.0010) [2023-12-28 04:16:49,735][106225] Updated weights for policy 1, policy_version 1258473 (0.0010) [2023-12-28 04:16:49,753][106226] Updated weights for policy 0, policy_version 1255357 (0.0010) [2023-12-28 04:16:49,798][106225] Updated weights for policy 1, policy_version 1258483 (0.0006) [2023-12-28 04:16:49,813][106226] Updated weights for policy 0, policy_version 1255367 (0.0007) [2023-12-28 04:16:49,858][106225] Updated weights for policy 1, policy_version 1258493 (0.0008) [2023-12-28 04:16:49,875][106226] Updated weights for policy 0, policy_version 1255377 (0.0008) [2023-12-28 04:16:49,918][106225] Updated weights for policy 1, policy_version 1258503 (0.0007) [2023-12-28 04:16:50,563][106226] Updated weights for policy 0, policy_version 1255387 (0.0009) [2023-12-28 04:16:50,623][106225] Updated weights for policy 1, policy_version 1258513 (0.0008) [2023-12-28 04:16:50,625][106226] Updated weights for policy 0, policy_version 1255397 (0.0007) [2023-12-28 04:16:50,686][106225] Updated weights for policy 1, policy_version 1258523 (0.0008) [2023-12-28 04:16:50,686][106226] Updated weights for policy 0, policy_version 1255407 (0.0008) [2023-12-28 04:16:50,743][106225] Updated weights for policy 1, policy_version 1258533 (0.0008) [2023-12-28 04:16:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 643678208. Throughput: 0: 9872.4, 1: 9749.7. Samples: 643687940. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:51,175][105115] Avg episode reward: [(0, '-4.124'), (1, '-5.092')] [2023-12-28 04:16:51,420][106226] Updated weights for policy 0, policy_version 1255417 (0.0007) [2023-12-28 04:16:51,479][106226] Updated weights for policy 0, policy_version 1255427 (0.0007) [2023-12-28 04:16:51,532][106225] Updated weights for policy 1, policy_version 1258543 (0.0006) [2023-12-28 04:16:51,540][106226] Updated weights for policy 0, policy_version 1255437 (0.0010) [2023-12-28 04:16:51,598][106225] Updated weights for policy 1, policy_version 1258553 (0.0005) [2023-12-28 04:16:51,598][106226] Updated weights for policy 0, policy_version 1255447 (0.0011) [2023-12-28 04:16:51,670][106225] Updated weights for policy 1, policy_version 1258563 (0.0007) [2023-12-28 04:16:52,338][106225] Updated weights for policy 1, policy_version 1258573 (0.0008) [2023-12-28 04:16:52,381][106226] Updated weights for policy 0, policy_version 1255457 (0.0009) [2023-12-28 04:16:52,403][106225] Updated weights for policy 1, policy_version 1258583 (0.0008) [2023-12-28 04:16:52,437][106226] Updated weights for policy 0, policy_version 1255467 (0.0008) [2023-12-28 04:16:52,463][106225] Updated weights for policy 1, policy_version 1258593 (0.0005) [2023-12-28 04:16:52,493][106226] Updated weights for policy 0, policy_version 1255477 (0.0007) [2023-12-28 04:16:53,163][106226] Updated weights for policy 0, policy_version 1255487 (0.0008) [2023-12-28 04:16:53,182][106225] Updated weights for policy 1, policy_version 1258603 (0.0006) [2023-12-28 04:16:53,216][106226] Updated weights for policy 0, policy_version 1255497 (0.0008) [2023-12-28 04:16:53,230][106225] Updated weights for policy 1, policy_version 1258613 (0.0005) [2023-12-28 04:16:53,271][106226] Updated weights for policy 0, policy_version 1255507 (0.0006) [2023-12-28 04:16:53,286][106225] Updated weights for policy 1, policy_version 1258623 (0.0005) [2023-12-28 04:16:53,818][106225] Updated weights for policy 1, policy_version 1258633 (0.0006) [2023-12-28 04:16:53,872][106225] Updated weights for policy 1, policy_version 1258643 (0.0005) [2023-12-28 04:16:53,873][106226] Updated weights for policy 0, policy_version 1255517 (0.0008) [2023-12-28 04:16:53,926][106226] Updated weights for policy 0, policy_version 1255527 (0.0010) [2023-12-28 04:16:53,935][106225] Updated weights for policy 1, policy_version 1258653 (0.0005) [2023-12-28 04:16:53,980][106226] Updated weights for policy 0, policy_version 1255537 (0.0011) [2023-12-28 04:16:54,000][106225] Updated weights for policy 1, policy_version 1258663 (0.0005) [2023-12-28 04:16:54,578][106225] Updated weights for policy 1, policy_version 1258673 (0.0006) [2023-12-28 04:16:54,625][106226] Updated weights for policy 0, policy_version 1255547 (0.0010) [2023-12-28 04:16:54,642][106225] Updated weights for policy 1, policy_version 1258683 (0.0007) [2023-12-28 04:16:54,693][106226] Updated weights for policy 0, policy_version 1255557 (0.0009) [2023-12-28 04:16:54,704][106225] Updated weights for policy 1, policy_version 1258693 (0.0007) [2023-12-28 04:16:54,766][106226] Updated weights for policy 0, policy_version 1255567 (0.0011) [2023-12-28 04:16:55,359][106225] Updated weights for policy 1, policy_version 1258703 (0.0007) [2023-12-28 04:16:55,417][106225] Updated weights for policy 1, policy_version 1258713 (0.0008) [2023-12-28 04:16:55,471][106225] Updated weights for policy 1, policy_version 1258723 (0.0008) [2023-12-28 04:16:55,483][106226] Updated weights for policy 0, policy_version 1255577 (0.0010) [2023-12-28 04:16:55,533][106226] Updated weights for policy 0, policy_version 1255587 (0.0008) [2023-12-28 04:16:55,582][106226] Updated weights for policy 0, policy_version 1255597 (0.0009) [2023-12-28 04:16:55,639][106226] Updated weights for policy 0, policy_version 1255607 (0.0009) [2023-12-28 04:16:56,088][106225] Updated weights for policy 1, policy_version 1258733 (0.0009) [2023-12-28 04:16:56,135][106225] Updated weights for policy 1, policy_version 1258743 (0.0010) [2023-12-28 04:16:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 643776512. Throughput: 0: 9910.8, 1: 9770.9. Samples: 643748040. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:16:56,175][105115] Avg episode reward: [(0, '-4.029'), (1, '-5.131')] [2023-12-28 04:16:56,179][106225] Updated weights for policy 1, policy_version 1258753 (0.0010) [2023-12-28 04:16:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001255608_321495040.pth... [2023-12-28 04:16:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001254424_321191936.pth [2023-12-28 04:16:56,216][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001258760_322289664.pth... [2023-12-28 04:16:56,220][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001257576_321986560.pth [2023-12-28 04:16:56,461][106226] Updated weights for policy 0, policy_version 1255617 (0.0009) [2023-12-28 04:16:56,509][106226] Updated weights for policy 0, policy_version 1255627 (0.0008) [2023-12-28 04:16:56,552][106226] Updated weights for policy 0, policy_version 1255637 (0.0007) [2023-12-28 04:16:56,839][106225] Updated weights for policy 1, policy_version 1258763 (0.0008) [2023-12-28 04:16:56,885][106225] Updated weights for policy 1, policy_version 1258773 (0.0010) [2023-12-28 04:16:56,927][106225] Updated weights for policy 1, policy_version 1258783 (0.0010) [2023-12-28 04:16:57,341][106226] Updated weights for policy 0, policy_version 1255647 (0.0008) [2023-12-28 04:16:57,390][106226] Updated weights for policy 0, policy_version 1255657 (0.0009) [2023-12-28 04:16:57,440][106226] Updated weights for policy 0, policy_version 1255667 (0.0009) [2023-12-28 04:16:57,579][106225] Updated weights for policy 1, policy_version 1258793 (0.0010) [2023-12-28 04:16:57,635][106225] Updated weights for policy 1, policy_version 1258803 (0.0010) [2023-12-28 04:16:57,694][106225] Updated weights for policy 1, policy_version 1258813 (0.0010) [2023-12-28 04:16:57,757][106225] Updated weights for policy 1, policy_version 1258823 (0.0010) [2023-12-28 04:16:58,213][106226] Updated weights for policy 0, policy_version 1255677 (0.0009) [2023-12-28 04:16:58,267][106226] Updated weights for policy 0, policy_version 1255687 (0.0009) [2023-12-28 04:16:58,329][106225] Updated weights for policy 1, policy_version 1258833 (0.0008) [2023-12-28 04:16:58,329][106226] Updated weights for policy 0, policy_version 1255697 (0.0007) [2023-12-28 04:16:58,395][106225] Updated weights for policy 1, policy_version 1258843 (0.0009) [2023-12-28 04:16:58,459][106225] Updated weights for policy 1, policy_version 1258853 (0.0009) [2023-12-28 04:16:59,164][106226] Updated weights for policy 0, policy_version 1255707 (0.0012) [2023-12-28 04:16:59,243][106226] Updated weights for policy 0, policy_version 1255717 (0.0008) [2023-12-28 04:16:59,247][106225] Updated weights for policy 1, policy_version 1258863 (0.0008) [2023-12-28 04:16:59,309][106225] Updated weights for policy 1, policy_version 1258873 (0.0006) [2023-12-28 04:16:59,311][106226] Updated weights for policy 0, policy_version 1255727 (0.0009) [2023-12-28 04:16:59,382][106225] Updated weights for policy 1, policy_version 1258883 (0.0009) [2023-12-28 04:17:00,117][106226] Updated weights for policy 0, policy_version 1255737 (0.0008) [2023-12-28 04:17:00,118][106225] Updated weights for policy 1, policy_version 1258893 (0.0008) [2023-12-28 04:17:00,175][106226] Updated weights for policy 0, policy_version 1255747 (0.0011) [2023-12-28 04:17:00,178][106225] Updated weights for policy 1, policy_version 1258903 (0.0007) [2023-12-28 04:17:00,225][106226] Updated weights for policy 0, policy_version 1255757 (0.0009) [2023-12-28 04:17:00,238][106225] Updated weights for policy 1, policy_version 1258913 (0.0007) [2023-12-28 04:17:00,281][106226] Updated weights for policy 0, policy_version 1255767 (0.0010) [2023-12-28 04:17:00,783][106225] Updated weights for policy 1, policy_version 1258923 (0.0005) [2023-12-28 04:17:00,838][106225] Updated weights for policy 1, policy_version 1258933 (0.0005) [2023-12-28 04:17:00,881][106225] Updated weights for policy 1, policy_version 1258943 (0.0005) [2023-12-28 04:17:00,991][106226] Updated weights for policy 0, policy_version 1255777 (0.0009) [2023-12-28 04:17:01,053][106226] Updated weights for policy 0, policy_version 1255787 (0.0010) [2023-12-28 04:17:01,113][106226] Updated weights for policy 0, policy_version 1255797 (0.0009) [2023-12-28 04:17:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 643883008. Throughput: 0: 9926.6, 1: 9920.8. Samples: 643865880. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:17:01,175][105115] Avg episode reward: [(0, '-4.135'), (1, '-4.984')] [2023-12-28 04:17:01,586][106225] Updated weights for policy 1, policy_version 1258953 (0.0006) [2023-12-28 04:17:01,653][106225] Updated weights for policy 1, policy_version 1258963 (0.0008) [2023-12-28 04:17:01,711][106225] Updated weights for policy 1, policy_version 1258973 (0.0006) [2023-12-28 04:17:01,783][106225] Updated weights for policy 1, policy_version 1258983 (0.0008) [2023-12-28 04:17:01,917][106226] Updated weights for policy 0, policy_version 1255807 (0.0010) [2023-12-28 04:17:01,974][106226] Updated weights for policy 0, policy_version 1255817 (0.0010) [2023-12-28 04:17:02,027][106226] Updated weights for policy 0, policy_version 1255827 (0.0010) [2023-12-28 04:17:02,439][106225] Updated weights for policy 1, policy_version 1258993 (0.0007) [2023-12-28 04:17:02,502][106225] Updated weights for policy 1, policy_version 1259003 (0.0006) [2023-12-28 04:17:02,565][106225] Updated weights for policy 1, policy_version 1259013 (0.0008) [2023-12-28 04:17:02,759][106226] Updated weights for policy 0, policy_version 1255837 (0.0011) [2023-12-28 04:17:02,819][106226] Updated weights for policy 0, policy_version 1255847 (0.0010) [2023-12-28 04:17:02,875][106226] Updated weights for policy 0, policy_version 1255857 (0.0010) [2023-12-28 04:17:03,268][106225] Updated weights for policy 1, policy_version 1259023 (0.0007) [2023-12-28 04:17:03,326][106225] Updated weights for policy 1, policy_version 1259033 (0.0008) [2023-12-28 04:17:03,379][106225] Updated weights for policy 1, policy_version 1259043 (0.0007) [2023-12-28 04:17:03,582][106226] Updated weights for policy 0, policy_version 1255867 (0.0010) [2023-12-28 04:17:03,634][106226] Updated weights for policy 0, policy_version 1255877 (0.0010) [2023-12-28 04:17:03,697][106226] Updated weights for policy 0, policy_version 1255887 (0.0007) [2023-12-28 04:17:04,097][106225] Updated weights for policy 1, policy_version 1259053 (0.0008) [2023-12-28 04:17:04,158][106225] Updated weights for policy 1, policy_version 1259063 (0.0008) [2023-12-28 04:17:04,214][106225] Updated weights for policy 1, policy_version 1259073 (0.0008) [2023-12-28 04:17:04,387][106226] Updated weights for policy 0, policy_version 1255897 (0.0006) [2023-12-28 04:17:04,455][106226] Updated weights for policy 0, policy_version 1255907 (0.0011) [2023-12-28 04:17:04,519][106226] Updated weights for policy 0, policy_version 1255917 (0.0011) [2023-12-28 04:17:04,590][106226] Updated weights for policy 0, policy_version 1255927 (0.0009) [2023-12-28 04:17:04,923][106225] Updated weights for policy 1, policy_version 1259083 (0.0007) [2023-12-28 04:17:04,976][106225] Updated weights for policy 1, policy_version 1259093 (0.0008) [2023-12-28 04:17:05,025][106225] Updated weights for policy 1, policy_version 1259103 (0.0008) [2023-12-28 04:17:05,192][106226] Updated weights for policy 0, policy_version 1255937 (0.0006) [2023-12-28 04:17:05,255][106226] Updated weights for policy 0, policy_version 1255947 (0.0007) [2023-12-28 04:17:05,314][106226] Updated weights for policy 0, policy_version 1255957 (0.0005) [2023-12-28 04:17:05,652][106225] Updated weights for policy 1, policy_version 1259113 (0.0008) [2023-12-28 04:17:05,712][106225] Updated weights for policy 1, policy_version 1259123 (0.0005) [2023-12-28 04:17:05,766][106225] Updated weights for policy 1, policy_version 1259133 (0.0006) [2023-12-28 04:17:05,815][106225] Updated weights for policy 1, policy_version 1259143 (0.0008) [2023-12-28 04:17:05,892][106226] Updated weights for policy 0, policy_version 1255967 (0.0008) [2023-12-28 04:17:05,952][106226] Updated weights for policy 0, policy_version 1255977 (0.0009) [2023-12-28 04:17:06,009][106226] Updated weights for policy 0, policy_version 1255987 (0.0009) [2023-12-28 04:17:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 643981312. Throughput: 0: 9917.1, 1: 9981.9. Samples: 643987184. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:17:06,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.975')] [2023-12-28 04:17:06,501][106225] Updated weights for policy 1, policy_version 1259153 (0.0008) [2023-12-28 04:17:06,567][106225] Updated weights for policy 1, policy_version 1259163 (0.0008) [2023-12-28 04:17:06,618][106225] Updated weights for policy 1, policy_version 1259173 (0.0008) [2023-12-28 04:17:06,782][106226] Updated weights for policy 0, policy_version 1255997 (0.0009) [2023-12-28 04:17:06,837][106226] Updated weights for policy 0, policy_version 1256007 (0.0008) [2023-12-28 04:17:06,894][106226] Updated weights for policy 0, policy_version 1256017 (0.0009) [2023-12-28 04:17:07,357][106225] Updated weights for policy 1, policy_version 1259183 (0.0008) [2023-12-28 04:17:07,406][106225] Updated weights for policy 1, policy_version 1259193 (0.0009) [2023-12-28 04:17:07,454][106225] Updated weights for policy 1, policy_version 1259203 (0.0006) [2023-12-28 04:17:07,600][106226] Updated weights for policy 0, policy_version 1256027 (0.0009) [2023-12-28 04:17:07,658][106226] Updated weights for policy 0, policy_version 1256037 (0.0008) [2023-12-28 04:17:07,712][106226] Updated weights for policy 0, policy_version 1256047 (0.0006) [2023-12-28 04:17:08,038][106225] Updated weights for policy 1, policy_version 1259213 (0.0008) [2023-12-28 04:17:08,093][106225] Updated weights for policy 1, policy_version 1259223 (0.0010) [2023-12-28 04:17:08,144][106225] Updated weights for policy 1, policy_version 1259233 (0.0010) [2023-12-28 04:17:08,395][106226] Updated weights for policy 0, policy_version 1256057 (0.0008) [2023-12-28 04:17:08,455][106226] Updated weights for policy 0, policy_version 1256067 (0.0008) [2023-12-28 04:17:08,521][106226] Updated weights for policy 0, policy_version 1256077 (0.0008) [2023-12-28 04:17:08,578][106226] Updated weights for policy 0, policy_version 1256087 (0.0007) [2023-12-28 04:17:08,853][106225] Updated weights for policy 1, policy_version 1259243 (0.0009) [2023-12-28 04:17:08,904][106225] Updated weights for policy 1, policy_version 1259253 (0.0010) [2023-12-28 04:17:08,957][106225] Updated weights for policy 1, policy_version 1259263 (0.0010) [2023-12-28 04:17:09,268][106226] Updated weights for policy 0, policy_version 1256097 (0.0008) [2023-12-28 04:17:09,332][106226] Updated weights for policy 0, policy_version 1256107 (0.0009) [2023-12-28 04:17:09,398][106226] Updated weights for policy 0, policy_version 1256117 (0.0012) [2023-12-28 04:17:09,679][106225] Updated weights for policy 1, policy_version 1259273 (0.0010) [2023-12-28 04:17:09,745][106225] Updated weights for policy 1, policy_version 1259283 (0.0011) [2023-12-28 04:17:09,814][106225] Updated weights for policy 1, policy_version 1259293 (0.0011) [2023-12-28 04:17:09,875][106225] Updated weights for policy 1, policy_version 1259303 (0.0009) [2023-12-28 04:17:10,187][106226] Updated weights for policy 0, policy_version 1256127 (0.0008) [2023-12-28 04:17:10,243][106226] Updated weights for policy 0, policy_version 1256137 (0.0008) [2023-12-28 04:17:10,299][106226] Updated weights for policy 0, policy_version 1256147 (0.0008) [2023-12-28 04:17:10,634][106225] Updated weights for policy 1, policy_version 1259313 (0.0010) [2023-12-28 04:17:10,702][106225] Updated weights for policy 1, policy_version 1259323 (0.0011) [2023-12-28 04:17:10,763][106225] Updated weights for policy 1, policy_version 1259333 (0.0011) [2023-12-28 04:17:11,075][106226] Updated weights for policy 0, policy_version 1256157 (0.0007) [2023-12-28 04:17:11,170][106226] Updated weights for policy 0, policy_version 1256167 (0.0008) [2023-12-28 04:17:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 644071424. Throughput: 0: 9953.6, 1: 10022.3. Samples: 644047500. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:17:11,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-4.857')] [2023-12-28 04:17:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001259336_322437120.pth... [2023-12-28 04:17:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001258184_322142208.pth [2023-12-28 04:17:11,236][106226] Updated weights for policy 0, policy_version 1256177 (0.0008) [2023-12-28 04:17:11,278][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001256184_321642496.pth... [2023-12-28 04:17:11,283][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001255032_321347584.pth [2023-12-28 04:17:11,521][106225] Updated weights for policy 1, policy_version 1259343 (0.0010) [2023-12-28 04:17:11,586][106225] Updated weights for policy 1, policy_version 1259353 (0.0010) [2023-12-28 04:17:11,657][106225] Updated weights for policy 1, policy_version 1259363 (0.0008) [2023-12-28 04:17:11,966][106226] Updated weights for policy 0, policy_version 1256187 (0.0008) [2023-12-28 04:17:12,032][106226] Updated weights for policy 0, policy_version 1256197 (0.0009) [2023-12-28 04:17:12,096][106226] Updated weights for policy 0, policy_version 1256207 (0.0008) [2023-12-28 04:17:12,330][106225] Updated weights for policy 1, policy_version 1259373 (0.0008) [2023-12-28 04:17:12,396][106225] Updated weights for policy 1, policy_version 1259383 (0.0010) [2023-12-28 04:17:12,452][106225] Updated weights for policy 1, policy_version 1259393 (0.0008) [2023-12-28 04:17:12,866][106226] Updated weights for policy 0, policy_version 1256217 (0.0009) [2023-12-28 04:17:12,919][106226] Updated weights for policy 0, policy_version 1256227 (0.0010) [2023-12-28 04:17:12,973][106226] Updated weights for policy 0, policy_version 1256237 (0.0010) [2023-12-28 04:17:13,026][106226] Updated weights for policy 0, policy_version 1256247 (0.0010) [2023-12-28 04:17:13,187][106225] Updated weights for policy 1, policy_version 1259403 (0.0009) [2023-12-28 04:17:13,239][106225] Updated weights for policy 1, policy_version 1259413 (0.0009) [2023-12-28 04:17:13,294][106225] Updated weights for policy 1, policy_version 1259423 (0.0006) [2023-12-28 04:17:13,681][106226] Updated weights for policy 0, policy_version 1256257 (0.0010) [2023-12-28 04:17:13,734][106226] Updated weights for policy 0, policy_version 1256267 (0.0010) [2023-12-28 04:17:13,801][106226] Updated weights for policy 0, policy_version 1256277 (0.0008) [2023-12-28 04:17:13,947][106225] Updated weights for policy 1, policy_version 1259433 (0.0007) [2023-12-28 04:17:13,998][106225] Updated weights for policy 1, policy_version 1259443 (0.0005) [2023-12-28 04:17:14,044][106225] Updated weights for policy 1, policy_version 1259453 (0.0010) [2023-12-28 04:17:14,094][106225] Updated weights for policy 1, policy_version 1259463 (0.0010) [2023-12-28 04:17:14,450][106226] Updated weights for policy 0, policy_version 1256287 (0.0008) [2023-12-28 04:17:14,505][106226] Updated weights for policy 0, policy_version 1256297 (0.0008) [2023-12-28 04:17:14,561][106226] Updated weights for policy 0, policy_version 1256307 (0.0008) [2023-12-28 04:17:14,806][106225] Updated weights for policy 1, policy_version 1259473 (0.0009) [2023-12-28 04:17:14,867][106225] Updated weights for policy 1, policy_version 1259483 (0.0007) [2023-12-28 04:17:14,928][106225] Updated weights for policy 1, policy_version 1259493 (0.0008) [2023-12-28 04:17:15,313][106226] Updated weights for policy 0, policy_version 1256317 (0.0009) [2023-12-28 04:17:15,376][106226] Updated weights for policy 0, policy_version 1256327 (0.0009) [2023-12-28 04:17:15,429][106226] Updated weights for policy 0, policy_version 1256337 (0.0008) [2023-12-28 04:17:15,691][106225] Updated weights for policy 1, policy_version 1259503 (0.0008) [2023-12-28 04:17:15,744][106225] Updated weights for policy 1, policy_version 1259513 (0.0005) [2023-12-28 04:17:15,814][106225] Updated weights for policy 1, policy_version 1259523 (0.0009) [2023-12-28 04:17:16,049][106226] Updated weights for policy 0, policy_version 1256347 (0.0007) [2023-12-28 04:17:16,100][106226] Updated weights for policy 0, policy_version 1256357 (0.0007) [2023-12-28 04:17:16,147][106226] Updated weights for policy 0, policy_version 1256367 (0.0008) [2023-12-28 04:17:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 644169728. Throughput: 0: 9892.5, 1: 9902.6. Samples: 644162212. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:17:16,175][105115] Avg episode reward: [(0, '-4.249'), (1, '-4.939')] [2023-12-28 04:17:16,513][106225] Updated weights for policy 1, policy_version 1259533 (0.0008) [2023-12-28 04:17:16,566][106225] Updated weights for policy 1, policy_version 1259543 (0.0005) [2023-12-28 04:17:16,631][106225] Updated weights for policy 1, policy_version 1259553 (0.0007) [2023-12-28 04:17:16,974][106226] Updated weights for policy 0, policy_version 1256377 (0.0008) [2023-12-28 04:17:17,023][106226] Updated weights for policy 0, policy_version 1256387 (0.0007) [2023-12-28 04:17:17,070][106226] Updated weights for policy 0, policy_version 1256397 (0.0008) [2023-12-28 04:17:17,113][106226] Updated weights for policy 0, policy_version 1256407 (0.0008) [2023-12-28 04:17:17,224][106225] Updated weights for policy 1, policy_version 1259563 (0.0009) [2023-12-28 04:17:17,275][106225] Updated weights for policy 1, policy_version 1259573 (0.0008) [2023-12-28 04:17:17,327][106225] Updated weights for policy 1, policy_version 1259583 (0.0008) [2023-12-28 04:17:17,909][106226] Updated weights for policy 0, policy_version 1256417 (0.0009) [2023-12-28 04:17:17,955][106225] Updated weights for policy 1, policy_version 1259593 (0.0008) [2023-12-28 04:17:17,960][106226] Updated weights for policy 0, policy_version 1256427 (0.0008) [2023-12-28 04:17:18,014][106226] Updated weights for policy 0, policy_version 1256437 (0.0008) [2023-12-28 04:17:18,016][106225] Updated weights for policy 1, policy_version 1259603 (0.0010) [2023-12-28 04:17:18,076][106225] Updated weights for policy 1, policy_version 1259613 (0.0010) [2023-12-28 04:17:18,136][106225] Updated weights for policy 1, policy_version 1259623 (0.0006) [2023-12-28 04:17:18,803][106226] Updated weights for policy 0, policy_version 1256447 (0.0008) [2023-12-28 04:17:18,832][106225] Updated weights for policy 1, policy_version 1259633 (0.0010) [2023-12-28 04:17:18,858][106226] Updated weights for policy 0, policy_version 1256457 (0.0006) [2023-12-28 04:17:18,886][106225] Updated weights for policy 1, policy_version 1259643 (0.0010) [2023-12-28 04:17:18,916][106226] Updated weights for policy 0, policy_version 1256467 (0.0006) [2023-12-28 04:17:18,944][106225] Updated weights for policy 1, policy_version 1259653 (0.0010) [2023-12-28 04:17:19,675][106226] Updated weights for policy 0, policy_version 1256477 (0.0009) [2023-12-28 04:17:19,709][106225] Updated weights for policy 1, policy_version 1259663 (0.0009) [2023-12-28 04:17:19,738][106226] Updated weights for policy 0, policy_version 1256487 (0.0008) [2023-12-28 04:17:19,769][106225] Updated weights for policy 1, policy_version 1259673 (0.0007) [2023-12-28 04:17:19,798][106226] Updated weights for policy 0, policy_version 1256497 (0.0007) [2023-12-28 04:17:19,829][106225] Updated weights for policy 1, policy_version 1259683 (0.0008) [2023-12-28 04:17:20,491][106225] Updated weights for policy 1, policy_version 1259693 (0.0008) [2023-12-28 04:17:20,544][106225] Updated weights for policy 1, policy_version 1259703 (0.0008) [2023-12-28 04:17:20,596][106226] Updated weights for policy 0, policy_version 1256507 (0.0008) [2023-12-28 04:17:20,607][106225] Updated weights for policy 1, policy_version 1259713 (0.0008) [2023-12-28 04:17:20,662][106226] Updated weights for policy 0, policy_version 1256517 (0.0007) [2023-12-28 04:17:20,726][106226] Updated weights for policy 0, policy_version 1256527 (0.0009) [2023-12-28 04:17:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 644268032. Throughput: 0: 9693.0, 1: 9955.4. Samples: 644277348. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 04:17:21,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-5.007')] [2023-12-28 04:17:21,314][106225] Updated weights for policy 1, policy_version 1259723 (0.0008) [2023-12-28 04:17:21,387][106225] Updated weights for policy 1, policy_version 1259733 (0.0008) [2023-12-28 04:17:21,445][106225] Updated weights for policy 1, policy_version 1259743 (0.0009) [2023-12-28 04:17:21,523][106226] Updated weights for policy 0, policy_version 1256537 (0.0008) [2023-12-28 04:17:21,597][106226] Updated weights for policy 0, policy_version 1256547 (0.0006) [2023-12-28 04:17:21,664][106226] Updated weights for policy 0, policy_version 1256557 (0.0008) [2023-12-28 04:17:21,727][106226] Updated weights for policy 0, policy_version 1256567 (0.0007) [2023-12-28 04:17:22,219][106225] Updated weights for policy 1, policy_version 1259753 (0.0007) [2023-12-28 04:17:22,288][106225] Updated weights for policy 1, policy_version 1259763 (0.0007) [2023-12-28 04:17:22,353][106225] Updated weights for policy 1, policy_version 1259773 (0.0008) [2023-12-28 04:17:22,398][106226] Updated weights for policy 0, policy_version 1256577 (0.0007) [2023-12-28 04:17:22,418][106225] Updated weights for policy 1, policy_version 1259783 (0.0008) [2023-12-28 04:17:22,460][106226] Updated weights for policy 0, policy_version 1256587 (0.0007) [2023-12-28 04:17:22,523][106226] Updated weights for policy 0, policy_version 1256597 (0.0008) [2023-12-28 04:17:23,142][106225] Updated weights for policy 1, policy_version 1259793 (0.0007) [2023-12-28 04:17:23,206][106225] Updated weights for policy 1, policy_version 1259803 (0.0006) [2023-12-28 04:17:23,268][106225] Updated weights for policy 1, policy_version 1259813 (0.0007) [2023-12-28 04:17:23,282][106226] Updated weights for policy 0, policy_version 1256607 (0.0009) [2023-12-28 04:17:23,344][106226] Updated weights for policy 0, policy_version 1256617 (0.0009) [2023-12-28 04:17:23,395][106226] Updated weights for policy 0, policy_version 1256627 (0.0010) [2023-12-28 04:17:23,893][106225] Updated weights for policy 1, policy_version 1259823 (0.0007) [2023-12-28 04:17:23,941][106225] Updated weights for policy 1, policy_version 1259833 (0.0008) [2023-12-28 04:17:23,989][106225] Updated weights for policy 1, policy_version 1259843 (0.0008) [2023-12-28 04:17:24,138][106226] Updated weights for policy 0, policy_version 1256637 (0.0008) [2023-12-28 04:17:24,200][106226] Updated weights for policy 0, policy_version 1256647 (0.0008) [2023-12-28 04:17:24,255][106226] Updated weights for policy 0, policy_version 1256657 (0.0008) [2023-12-28 04:17:24,720][106225] Updated weights for policy 1, policy_version 1259853 (0.0009) [2023-12-28 04:17:24,781][106225] Updated weights for policy 1, policy_version 1259863 (0.0009) [2023-12-28 04:17:24,849][106225] Updated weights for policy 1, policy_version 1259873 (0.0007) [2023-12-28 04:17:24,992][106226] Updated weights for policy 0, policy_version 1256667 (0.0008) [2023-12-28 04:17:25,052][106226] Updated weights for policy 0, policy_version 1256677 (0.0006) [2023-12-28 04:17:25,117][106226] Updated weights for policy 0, policy_version 1256687 (0.0006) [2023-12-28 04:17:25,464][106225] Updated weights for policy 1, policy_version 1259883 (0.0008) [2023-12-28 04:17:25,510][106225] Updated weights for policy 1, policy_version 1259893 (0.0005) [2023-12-28 04:17:25,561][106225] Updated weights for policy 1, policy_version 1259903 (0.0005) [2023-12-28 04:17:25,768][106226] Updated weights for policy 0, policy_version 1256697 (0.0009) [2023-12-28 04:17:25,829][106226] Updated weights for policy 0, policy_version 1256707 (0.0005) [2023-12-28 04:17:25,896][106226] Updated weights for policy 0, policy_version 1256717 (0.0005) [2023-12-28 04:17:25,959][106226] Updated weights for policy 0, policy_version 1256727 (0.0008) [2023-12-28 04:17:26,145][106225] Updated weights for policy 1, policy_version 1259913 (0.0006) [2023-12-28 04:17:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 644366336. Throughput: 0: 9679.2, 1: 9949.0. Samples: 644335112. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:26,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.785')] [2023-12-28 04:17:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001256728_321781760.pth... [2023-12-28 04:17:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001255608_321495040.pth [2023-12-28 04:17:26,194][106225] Updated weights for policy 1, policy_version 1259923 (0.0008) [2023-12-28 04:17:26,248][106225] Updated weights for policy 1, policy_version 1259933 (0.0010) [2023-12-28 04:17:26,301][106225] Updated weights for policy 1, policy_version 1259943 (0.0008) [2023-12-28 04:17:26,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001259944_322592768.pth... [2023-12-28 04:17:26,308][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001258760_322289664.pth [2023-12-28 04:17:26,610][106226] Updated weights for policy 0, policy_version 1256737 (0.0009) [2023-12-28 04:17:26,663][106226] Updated weights for policy 0, policy_version 1256747 (0.0009) [2023-12-28 04:17:26,708][106226] Updated weights for policy 0, policy_version 1256757 (0.0008) [2023-12-28 04:17:26,987][106225] Updated weights for policy 1, policy_version 1259953 (0.0006) [2023-12-28 04:17:27,041][106225] Updated weights for policy 1, policy_version 1259963 (0.0005) [2023-12-28 04:17:27,095][106225] Updated weights for policy 1, policy_version 1259973 (0.0005) [2023-12-28 04:17:27,538][106226] Updated weights for policy 0, policy_version 1256767 (0.0009) [2023-12-28 04:17:27,586][106226] Updated weights for policy 0, policy_version 1256777 (0.0009) [2023-12-28 04:17:27,642][106226] Updated weights for policy 0, policy_version 1256787 (0.0008) [2023-12-28 04:17:27,656][106225] Updated weights for policy 1, policy_version 1259983 (0.0005) [2023-12-28 04:17:27,703][106225] Updated weights for policy 1, policy_version 1259993 (0.0007) [2023-12-28 04:17:27,761][106225] Updated weights for policy 1, policy_version 1260003 (0.0009) [2023-12-28 04:17:28,226][106226] Updated weights for policy 0, policy_version 1256797 (0.0008) [2023-12-28 04:17:28,274][106226] Updated weights for policy 0, policy_version 1256807 (0.0005) [2023-12-28 04:17:28,331][106226] Updated weights for policy 0, policy_version 1256817 (0.0009) [2023-12-28 04:17:28,589][106225] Updated weights for policy 1, policy_version 1260013 (0.0008) [2023-12-28 04:17:28,652][106225] Updated weights for policy 1, policy_version 1260023 (0.0009) [2023-12-28 04:17:28,711][106225] Updated weights for policy 1, policy_version 1260033 (0.0006) [2023-12-28 04:17:28,966][106226] Updated weights for policy 0, policy_version 1256827 (0.0008) [2023-12-28 04:17:29,020][106226] Updated weights for policy 0, policy_version 1256837 (0.0005) [2023-12-28 04:17:29,083][106226] Updated weights for policy 0, policy_version 1256847 (0.0005) [2023-12-28 04:17:29,436][106225] Updated weights for policy 1, policy_version 1260043 (0.0006) [2023-12-28 04:17:29,495][106225] Updated weights for policy 1, policy_version 1260053 (0.0008) [2023-12-28 04:17:29,545][106225] Updated weights for policy 1, policy_version 1260063 (0.0010) [2023-12-28 04:17:29,683][106226] Updated weights for policy 0, policy_version 1256857 (0.0006) [2023-12-28 04:17:29,745][106226] Updated weights for policy 0, policy_version 1256867 (0.0008) [2023-12-28 04:17:29,808][106226] Updated weights for policy 0, policy_version 1256877 (0.0009) [2023-12-28 04:17:29,873][106226] Updated weights for policy 0, policy_version 1256887 (0.0008) [2023-12-28 04:17:30,242][106225] Updated weights for policy 1, policy_version 1260073 (0.0008) [2023-12-28 04:17:30,294][106225] Updated weights for policy 1, policy_version 1260083 (0.0008) [2023-12-28 04:17:30,352][106225] Updated weights for policy 1, policy_version 1260093 (0.0008) [2023-12-28 04:17:30,417][106225] Updated weights for policy 1, policy_version 1260103 (0.0005) [2023-12-28 04:17:30,595][106226] Updated weights for policy 0, policy_version 1256897 (0.0009) [2023-12-28 04:17:30,660][106226] Updated weights for policy 0, policy_version 1256907 (0.0007) [2023-12-28 04:17:30,715][106226] Updated weights for policy 0, policy_version 1256917 (0.0008) [2023-12-28 04:17:30,975][106225] Updated weights for policy 1, policy_version 1260113 (0.0008) [2023-12-28 04:17:31,039][106225] Updated weights for policy 1, policy_version 1260123 (0.0008) [2023-12-28 04:17:31,104][106225] Updated weights for policy 1, policy_version 1260133 (0.0008) [2023-12-28 04:17:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 644472832. Throughput: 0: 9718.3, 1: 10032.6. Samples: 644457976. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:31,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-5.002')] [2023-12-28 04:17:31,429][106226] Updated weights for policy 0, policy_version 1256927 (0.0009) [2023-12-28 04:17:31,495][106226] Updated weights for policy 0, policy_version 1256937 (0.0006) [2023-12-28 04:17:31,562][106226] Updated weights for policy 0, policy_version 1256947 (0.0005) [2023-12-28 04:17:31,823][106225] Updated weights for policy 1, policy_version 1260143 (0.0008) [2023-12-28 04:17:31,868][106225] Updated weights for policy 1, policy_version 1260153 (0.0008) [2023-12-28 04:17:31,919][106225] Updated weights for policy 1, policy_version 1260163 (0.0008) [2023-12-28 04:17:32,242][106226] Updated weights for policy 0, policy_version 1256957 (0.0007) [2023-12-28 04:17:32,306][106226] Updated weights for policy 0, policy_version 1256967 (0.0008) [2023-12-28 04:17:32,370][106226] Updated weights for policy 0, policy_version 1256977 (0.0008) [2023-12-28 04:17:32,701][106225] Updated weights for policy 1, policy_version 1260173 (0.0010) [2023-12-28 04:17:32,765][106225] Updated weights for policy 1, policy_version 1260183 (0.0006) [2023-12-28 04:17:32,822][106225] Updated weights for policy 1, policy_version 1260193 (0.0006) [2023-12-28 04:17:33,071][106226] Updated weights for policy 0, policy_version 1256987 (0.0008) [2023-12-28 04:17:33,120][106226] Updated weights for policy 0, policy_version 1256997 (0.0009) [2023-12-28 04:17:33,164][106226] Updated weights for policy 0, policy_version 1257007 (0.0007) [2023-12-28 04:17:33,387][106225] Updated weights for policy 1, policy_version 1260203 (0.0005) [2023-12-28 04:17:33,438][106225] Updated weights for policy 1, policy_version 1260213 (0.0005) [2023-12-28 04:17:33,496][106225] Updated weights for policy 1, policy_version 1260223 (0.0005) [2023-12-28 04:17:33,713][106226] Updated weights for policy 0, policy_version 1257017 (0.0005) [2023-12-28 04:17:33,768][106226] Updated weights for policy 0, policy_version 1257027 (0.0005) [2023-12-28 04:17:33,826][106226] Updated weights for policy 0, policy_version 1257037 (0.0005) [2023-12-28 04:17:33,879][106226] Updated weights for policy 0, policy_version 1257047 (0.0005) [2023-12-28 04:17:34,010][106225] Updated weights for policy 1, policy_version 1260233 (0.0005) [2023-12-28 04:17:34,070][106225] Updated weights for policy 1, policy_version 1260243 (0.0005) [2023-12-28 04:17:34,124][106225] Updated weights for policy 1, policy_version 1260253 (0.0007) [2023-12-28 04:17:34,180][106225] Updated weights for policy 1, policy_version 1260263 (0.0008) [2023-12-28 04:17:34,525][106226] Updated weights for policy 0, policy_version 1257057 (0.0008) [2023-12-28 04:17:34,587][106226] Updated weights for policy 0, policy_version 1257067 (0.0006) [2023-12-28 04:17:34,650][106226] Updated weights for policy 0, policy_version 1257077 (0.0005) [2023-12-28 04:17:34,877][106225] Updated weights for policy 1, policy_version 1260273 (0.0009) [2023-12-28 04:17:34,932][106225] Updated weights for policy 1, policy_version 1260283 (0.0008) [2023-12-28 04:17:34,976][106225] Updated weights for policy 1, policy_version 1260293 (0.0008) [2023-12-28 04:17:35,231][106226] Updated weights for policy 0, policy_version 1257087 (0.0008) [2023-12-28 04:17:35,279][106226] Updated weights for policy 0, policy_version 1257097 (0.0008) [2023-12-28 04:17:35,332][106226] Updated weights for policy 0, policy_version 1257107 (0.0008) [2023-12-28 04:17:35,712][106225] Updated weights for policy 1, policy_version 1260303 (0.0006) [2023-12-28 04:17:35,763][106225] Updated weights for policy 1, policy_version 1260313 (0.0005) [2023-12-28 04:17:35,814][106225] Updated weights for policy 1, policy_version 1260323 (0.0005) [2023-12-28 04:17:36,066][106226] Updated weights for policy 0, policy_version 1257117 (0.0009) [2023-12-28 04:17:36,129][106226] Updated weights for policy 0, policy_version 1257127 (0.0009) [2023-12-28 04:17:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 644571136. Throughput: 0: 9721.1, 1: 10177.1. Samples: 644583364. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:36,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.973')] [2023-12-28 04:17:36,195][106226] Updated weights for policy 0, policy_version 1257137 (0.0008) [2023-12-28 04:17:36,396][106225] Updated weights for policy 1, policy_version 1260333 (0.0006) [2023-12-28 04:17:36,454][106225] Updated weights for policy 1, policy_version 1260343 (0.0008) [2023-12-28 04:17:36,518][106225] Updated weights for policy 1, policy_version 1260353 (0.0008) [2023-12-28 04:17:36,893][106226] Updated weights for policy 0, policy_version 1257147 (0.0007) [2023-12-28 04:17:36,957][106226] Updated weights for policy 0, policy_version 1257157 (0.0008) [2023-12-28 04:17:37,017][106226] Updated weights for policy 0, policy_version 1257167 (0.0009) [2023-12-28 04:17:37,281][106225] Updated weights for policy 1, policy_version 1260363 (0.0009) [2023-12-28 04:17:37,337][106225] Updated weights for policy 1, policy_version 1260373 (0.0008) [2023-12-28 04:17:37,401][106225] Updated weights for policy 1, policy_version 1260383 (0.0009) [2023-12-28 04:17:37,755][106226] Updated weights for policy 0, policy_version 1257177 (0.0009) [2023-12-28 04:17:37,822][106226] Updated weights for policy 0, policy_version 1257187 (0.0009) [2023-12-28 04:17:37,894][106226] Updated weights for policy 0, policy_version 1257197 (0.0008) [2023-12-28 04:17:37,957][106226] Updated weights for policy 0, policy_version 1257207 (0.0008) [2023-12-28 04:17:38,094][106225] Updated weights for policy 1, policy_version 1260393 (0.0009) [2023-12-28 04:17:38,163][106225] Updated weights for policy 1, policy_version 1260403 (0.0009) [2023-12-28 04:17:38,228][106225] Updated weights for policy 1, policy_version 1260413 (0.0008) [2023-12-28 04:17:38,283][106225] Updated weights for policy 1, policy_version 1260423 (0.0008) [2023-12-28 04:17:38,644][106226] Updated weights for policy 0, policy_version 1257217 (0.0009) [2023-12-28 04:17:38,709][106226] Updated weights for policy 0, policy_version 1257227 (0.0008) [2023-12-28 04:17:38,778][106226] Updated weights for policy 0, policy_version 1257237 (0.0006) [2023-12-28 04:17:38,973][106225] Updated weights for policy 1, policy_version 1260433 (0.0007) [2023-12-28 04:17:39,022][106225] Updated weights for policy 1, policy_version 1260443 (0.0005) [2023-12-28 04:17:39,083][106225] Updated weights for policy 1, policy_version 1260453 (0.0006) [2023-12-28 04:17:39,510][106226] Updated weights for policy 0, policy_version 1257247 (0.0008) [2023-12-28 04:17:39,576][106226] Updated weights for policy 0, policy_version 1257257 (0.0009) [2023-12-28 04:17:39,644][106226] Updated weights for policy 0, policy_version 1257267 (0.0008) [2023-12-28 04:17:39,823][106225] Updated weights for policy 1, policy_version 1260463 (0.0008) [2023-12-28 04:17:39,889][106225] Updated weights for policy 1, policy_version 1260473 (0.0007) [2023-12-28 04:17:39,955][106225] Updated weights for policy 1, policy_version 1260483 (0.0009) [2023-12-28 04:17:40,392][106226] Updated weights for policy 0, policy_version 1257277 (0.0009) [2023-12-28 04:17:40,449][106226] Updated weights for policy 0, policy_version 1257287 (0.0009) [2023-12-28 04:17:40,505][106226] Updated weights for policy 0, policy_version 1257297 (0.0008) [2023-12-28 04:17:40,697][106225] Updated weights for policy 1, policy_version 1260493 (0.0009) [2023-12-28 04:17:40,762][106225] Updated weights for policy 1, policy_version 1260503 (0.0011) [2023-12-28 04:17:40,826][106225] Updated weights for policy 1, policy_version 1260513 (0.0006) [2023-12-28 04:17:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 644669440. Throughput: 0: 9695.4, 1: 10176.8. Samples: 644642288. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:41,175][105115] Avg episode reward: [(0, '-4.206'), (1, '-4.703')] [2023-12-28 04:17:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001260520_322740224.pth... [2023-12-28 04:17:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001257304_321929216.pth... [2023-12-28 04:17:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001256184_321642496.pth [2023-12-28 04:17:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001259336_322437120.pth [2023-12-28 04:17:41,294][106226] Updated weights for policy 0, policy_version 1257307 (0.0008) [2023-12-28 04:17:41,356][106226] Updated weights for policy 0, policy_version 1257317 (0.0008) [2023-12-28 04:17:41,423][106226] Updated weights for policy 0, policy_version 1257327 (0.0007) [2023-12-28 04:17:41,515][106225] Updated weights for policy 1, policy_version 1260523 (0.0006) [2023-12-28 04:17:41,584][106225] Updated weights for policy 1, policy_version 1260533 (0.0007) [2023-12-28 04:17:41,653][106225] Updated weights for policy 1, policy_version 1260543 (0.0009) [2023-12-28 04:17:42,217][106226] Updated weights for policy 0, policy_version 1257337 (0.0008) [2023-12-28 04:17:42,280][106226] Updated weights for policy 0, policy_version 1257347 (0.0008) [2023-12-28 04:17:42,346][106226] Updated weights for policy 0, policy_version 1257357 (0.0008) [2023-12-28 04:17:42,396][106225] Updated weights for policy 1, policy_version 1260553 (0.0009) [2023-12-28 04:17:42,412][106226] Updated weights for policy 0, policy_version 1257367 (0.0010) [2023-12-28 04:17:42,451][106225] Updated weights for policy 1, policy_version 1260563 (0.0010) [2023-12-28 04:17:42,514][106225] Updated weights for policy 1, policy_version 1260573 (0.0010) [2023-12-28 04:17:42,574][106225] Updated weights for policy 1, policy_version 1260583 (0.0007) [2023-12-28 04:17:43,102][106226] Updated weights for policy 0, policy_version 1257377 (0.0006) [2023-12-28 04:17:43,154][106226] Updated weights for policy 0, policy_version 1257387 (0.0007) [2023-12-28 04:17:43,207][106226] Updated weights for policy 0, policy_version 1257397 (0.0010) [2023-12-28 04:17:43,240][106225] Updated weights for policy 1, policy_version 1260593 (0.0010) [2023-12-28 04:17:43,303][106225] Updated weights for policy 1, policy_version 1260603 (0.0010) [2023-12-28 04:17:43,363][106225] Updated weights for policy 1, policy_version 1260613 (0.0010) [2023-12-28 04:17:43,770][106226] Updated weights for policy 0, policy_version 1257407 (0.0008) [2023-12-28 04:17:43,821][106226] Updated weights for policy 0, policy_version 1257417 (0.0007) [2023-12-28 04:17:43,874][106226] Updated weights for policy 0, policy_version 1257427 (0.0005) [2023-12-28 04:17:44,029][106225] Updated weights for policy 1, policy_version 1260623 (0.0010) [2023-12-28 04:17:44,082][106225] Updated weights for policy 1, policy_version 1260633 (0.0010) [2023-12-28 04:17:44,135][106225] Updated weights for policy 1, policy_version 1260643 (0.0010) [2023-12-28 04:17:44,479][106226] Updated weights for policy 0, policy_version 1257437 (0.0005) [2023-12-28 04:17:44,549][106226] Updated weights for policy 0, policy_version 1257447 (0.0006) [2023-12-28 04:17:44,611][106226] Updated weights for policy 0, policy_version 1257457 (0.0005) [2023-12-28 04:17:44,848][106225] Updated weights for policy 1, policy_version 1260653 (0.0010) [2023-12-28 04:17:44,911][106225] Updated weights for policy 1, policy_version 1260663 (0.0007) [2023-12-28 04:17:44,978][106225] Updated weights for policy 1, policy_version 1260673 (0.0005) [2023-12-28 04:17:45,246][106226] Updated weights for policy 0, policy_version 1257467 (0.0007) [2023-12-28 04:17:45,314][106226] Updated weights for policy 0, policy_version 1257477 (0.0011) [2023-12-28 04:17:45,379][106226] Updated weights for policy 0, policy_version 1257487 (0.0011) [2023-12-28 04:17:45,540][106225] Updated weights for policy 1, policy_version 1260683 (0.0006) [2023-12-28 04:17:45,605][106225] Updated weights for policy 1, policy_version 1260693 (0.0008) [2023-12-28 04:17:45,668][106225] Updated weights for policy 1, policy_version 1260703 (0.0010) [2023-12-28 04:17:46,117][106226] Updated weights for policy 0, policy_version 1257497 (0.0010) [2023-12-28 04:17:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 644767744. Throughput: 0: 9812.3, 1: 10066.1. Samples: 644760412. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:46,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.151')] [2023-12-28 04:17:46,182][106226] Updated weights for policy 0, policy_version 1257507 (0.0008) [2023-12-28 04:17:46,238][106226] Updated weights for policy 0, policy_version 1257517 (0.0006) [2023-12-28 04:17:46,284][106225] Updated weights for policy 1, policy_version 1260713 (0.0010) [2023-12-28 04:17:46,297][106226] Updated weights for policy 0, policy_version 1257527 (0.0007) [2023-12-28 04:17:46,338][106225] Updated weights for policy 1, policy_version 1260723 (0.0007) [2023-12-28 04:17:46,394][106225] Updated weights for policy 1, policy_version 1260733 (0.0010) [2023-12-28 04:17:46,442][106225] Updated weights for policy 1, policy_version 1260743 (0.0010) [2023-12-28 04:17:46,952][106226] Updated weights for policy 0, policy_version 1257537 (0.0010) [2023-12-28 04:17:47,016][106226] Updated weights for policy 0, policy_version 1257547 (0.0005) [2023-12-28 04:17:47,075][106226] Updated weights for policy 0, policy_version 1257557 (0.0007) [2023-12-28 04:17:47,197][106225] Updated weights for policy 1, policy_version 1260753 (0.0010) [2023-12-28 04:17:47,253][106225] Updated weights for policy 1, policy_version 1260763 (0.0010) [2023-12-28 04:17:47,303][106225] Updated weights for policy 1, policy_version 1260773 (0.0010) [2023-12-28 04:17:47,751][106226] Updated weights for policy 0, policy_version 1257567 (0.0010) [2023-12-28 04:17:47,795][106226] Updated weights for policy 0, policy_version 1257577 (0.0010) [2023-12-28 04:17:47,841][106226] Updated weights for policy 0, policy_version 1257587 (0.0010) [2023-12-28 04:17:47,968][106225] Updated weights for policy 1, policy_version 1260783 (0.0007) [2023-12-28 04:17:48,033][106225] Updated weights for policy 1, policy_version 1260793 (0.0005) [2023-12-28 04:17:48,086][106225] Updated weights for policy 1, policy_version 1260803 (0.0005) [2023-12-28 04:17:48,603][106226] Updated weights for policy 0, policy_version 1257597 (0.0009) [2023-12-28 04:17:48,666][106226] Updated weights for policy 0, policy_version 1257607 (0.0008) [2023-12-28 04:17:48,703][106225] Updated weights for policy 1, policy_version 1260813 (0.0005) [2023-12-28 04:17:48,717][106226] Updated weights for policy 0, policy_version 1257617 (0.0008) [2023-12-28 04:17:48,755][106225] Updated weights for policy 1, policy_version 1260823 (0.0006) [2023-12-28 04:17:48,804][106225] Updated weights for policy 1, policy_version 1260833 (0.0008) [2023-12-28 04:17:49,496][106225] Updated weights for policy 1, policy_version 1260843 (0.0007) [2023-12-28 04:17:49,503][106226] Updated weights for policy 0, policy_version 1257627 (0.0007) [2023-12-28 04:17:49,552][106225] Updated weights for policy 1, policy_version 1260853 (0.0006) [2023-12-28 04:17:49,562][106226] Updated weights for policy 0, policy_version 1257637 (0.0008) [2023-12-28 04:17:49,614][106225] Updated weights for policy 1, policy_version 1260863 (0.0007) [2023-12-28 04:17:49,619][106226] Updated weights for policy 0, policy_version 1257647 (0.0006) [2023-12-28 04:17:50,347][106226] Updated weights for policy 0, policy_version 1257657 (0.0006) [2023-12-28 04:17:50,379][106225] Updated weights for policy 1, policy_version 1260873 (0.0008) [2023-12-28 04:17:50,412][106226] Updated weights for policy 0, policy_version 1257667 (0.0008) [2023-12-28 04:17:50,435][106225] Updated weights for policy 1, policy_version 1260883 (0.0009) [2023-12-28 04:17:50,465][106226] Updated weights for policy 0, policy_version 1257677 (0.0008) [2023-12-28 04:17:50,486][106225] Updated weights for policy 1, policy_version 1260893 (0.0008) [2023-12-28 04:17:50,520][106226] Updated weights for policy 0, policy_version 1257687 (0.0007) [2023-12-28 04:17:50,534][106225] Updated weights for policy 1, policy_version 1260903 (0.0007) [2023-12-28 04:17:51,170][106226] Updated weights for policy 0, policy_version 1257697 (0.0009) [2023-12-28 04:17:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 644866048. Throughput: 0: 9787.9, 1: 10066.6. Samples: 644880636. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:51,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-5.149')] [2023-12-28 04:17:51,231][106226] Updated weights for policy 0, policy_version 1257707 (0.0009) [2023-12-28 04:17:51,292][106226] Updated weights for policy 0, policy_version 1257717 (0.0007) [2023-12-28 04:17:51,299][106225] Updated weights for policy 1, policy_version 1260913 (0.0009) [2023-12-28 04:17:51,357][106225] Updated weights for policy 1, policy_version 1260923 (0.0009) [2023-12-28 04:17:51,431][106225] Updated weights for policy 1, policy_version 1260933 (0.0009) [2023-12-28 04:17:52,030][106226] Updated weights for policy 0, policy_version 1257727 (0.0009) [2023-12-28 04:17:52,082][106226] Updated weights for policy 0, policy_version 1257737 (0.0008) [2023-12-28 04:17:52,135][106226] Updated weights for policy 0, policy_version 1257747 (0.0008) [2023-12-28 04:17:52,203][106225] Updated weights for policy 1, policy_version 1260943 (0.0008) [2023-12-28 04:17:52,266][106225] Updated weights for policy 1, policy_version 1260953 (0.0009) [2023-12-28 04:17:52,323][106225] Updated weights for policy 1, policy_version 1260963 (0.0009) [2023-12-28 04:17:52,879][106226] Updated weights for policy 0, policy_version 1257757 (0.0009) [2023-12-28 04:17:52,931][106226] Updated weights for policy 0, policy_version 1257767 (0.0008) [2023-12-28 04:17:52,990][106226] Updated weights for policy 0, policy_version 1257777 (0.0009) [2023-12-28 04:17:53,086][106225] Updated weights for policy 1, policy_version 1260973 (0.0009) [2023-12-28 04:17:53,141][106225] Updated weights for policy 1, policy_version 1260983 (0.0008) [2023-12-28 04:17:53,196][106225] Updated weights for policy 1, policy_version 1260993 (0.0008) [2023-12-28 04:17:53,727][106226] Updated weights for policy 0, policy_version 1257787 (0.0008) [2023-12-28 04:17:53,783][106226] Updated weights for policy 0, policy_version 1257797 (0.0008) [2023-12-28 04:17:53,828][106226] Updated weights for policy 0, policy_version 1257807 (0.0008) [2023-12-28 04:17:53,938][106225] Updated weights for policy 1, policy_version 1261003 (0.0009) [2023-12-28 04:17:53,990][106225] Updated weights for policy 1, policy_version 1261013 (0.0008) [2023-12-28 04:17:54,042][106225] Updated weights for policy 1, policy_version 1261023 (0.0008) [2023-12-28 04:17:54,531][106226] Updated weights for policy 0, policy_version 1257817 (0.0009) [2023-12-28 04:17:54,584][106226] Updated weights for policy 0, policy_version 1257827 (0.0008) [2023-12-28 04:17:54,642][106226] Updated weights for policy 0, policy_version 1257837 (0.0007) [2023-12-28 04:17:54,697][106226] Updated weights for policy 0, policy_version 1257847 (0.0006) [2023-12-28 04:17:54,800][106225] Updated weights for policy 1, policy_version 1261033 (0.0008) [2023-12-28 04:17:54,849][106225] Updated weights for policy 1, policy_version 1261043 (0.0008) [2023-12-28 04:17:54,896][106225] Updated weights for policy 1, policy_version 1261054 (0.0006) [2023-12-28 04:17:54,947][106225] Updated weights for policy 1, policy_version 1261064 (0.0005) [2023-12-28 04:17:55,369][106226] Updated weights for policy 0, policy_version 1257857 (0.0010) [2023-12-28 04:17:55,436][106226] Updated weights for policy 0, policy_version 1257867 (0.0006) [2023-12-28 04:17:55,499][106226] Updated weights for policy 0, policy_version 1257877 (0.0006) [2023-12-28 04:17:55,668][106225] Updated weights for policy 1, policy_version 1261074 (0.0006) [2023-12-28 04:17:55,731][106225] Updated weights for policy 1, policy_version 1261084 (0.0008) [2023-12-28 04:17:55,792][106225] Updated weights for policy 1, policy_version 1261094 (0.0005) [2023-12-28 04:17:56,089][106226] Updated weights for policy 0, policy_version 1257887 (0.0005) [2023-12-28 04:17:56,152][106226] Updated weights for policy 0, policy_version 1257897 (0.0005) [2023-12-28 04:17:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 644964352. Throughput: 0: 9759.3, 1: 9995.3. Samples: 644936456. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:17:56,176][105115] Avg episode reward: [(0, '-4.179'), (1, '-5.082')] [2023-12-28 04:17:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001261096_322887680.pth... [2023-12-28 04:17:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001259944_322592768.pth [2023-12-28 04:17:56,212][106226] Updated weights for policy 0, policy_version 1257907 (0.0006) [2023-12-28 04:17:56,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001257912_322084864.pth... [2023-12-28 04:17:56,243][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001256728_321781760.pth [2023-12-28 04:17:56,443][106225] Updated weights for policy 1, policy_version 1261104 (0.0008) [2023-12-28 04:17:56,500][106225] Updated weights for policy 1, policy_version 1261114 (0.0009) [2023-12-28 04:17:56,557][106225] Updated weights for policy 1, policy_version 1261124 (0.0009) [2023-12-28 04:17:56,797][106226] Updated weights for policy 0, policy_version 1257917 (0.0007) [2023-12-28 04:17:56,853][106226] Updated weights for policy 0, policy_version 1257927 (0.0008) [2023-12-28 04:17:56,909][106226] Updated weights for policy 0, policy_version 1257937 (0.0007) [2023-12-28 04:17:57,306][106225] Updated weights for policy 1, policy_version 1261134 (0.0008) [2023-12-28 04:17:57,356][106225] Updated weights for policy 1, policy_version 1261144 (0.0010) [2023-12-28 04:17:57,410][106225] Updated weights for policy 1, policy_version 1261154 (0.0010) [2023-12-28 04:17:57,506][106226] Updated weights for policy 0, policy_version 1257947 (0.0005) [2023-12-28 04:17:57,568][106226] Updated weights for policy 0, policy_version 1257957 (0.0005) [2023-12-28 04:17:57,627][106226] Updated weights for policy 0, policy_version 1257967 (0.0005) [2023-12-28 04:17:58,011][106225] Updated weights for policy 1, policy_version 1261164 (0.0009) [2023-12-28 04:17:58,058][106225] Updated weights for policy 1, policy_version 1261174 (0.0008) [2023-12-28 04:17:58,104][106225] Updated weights for policy 1, policy_version 1261184 (0.0006) [2023-12-28 04:17:58,223][106226] Updated weights for policy 0, policy_version 1257977 (0.0006) [2023-12-28 04:17:58,293][106226] Updated weights for policy 0, policy_version 1257987 (0.0011) [2023-12-28 04:17:58,362][106226] Updated weights for policy 0, policy_version 1257997 (0.0010) [2023-12-28 04:17:58,429][106226] Updated weights for policy 0, policy_version 1258007 (0.0009) [2023-12-28 04:17:58,790][106225] Updated weights for policy 1, policy_version 1261194 (0.0007) [2023-12-28 04:17:58,851][106225] Updated weights for policy 1, policy_version 1261204 (0.0009) [2023-12-28 04:17:58,925][106225] Updated weights for policy 1, policy_version 1261214 (0.0007) [2023-12-28 04:17:58,997][106225] Updated weights for policy 1, policy_version 1261224 (0.0007) [2023-12-28 04:17:59,196][106226] Updated weights for policy 0, policy_version 1258017 (0.0010) [2023-12-28 04:17:59,284][106226] Updated weights for policy 0, policy_version 1258027 (0.0007) [2023-12-28 04:17:59,353][106226] Updated weights for policy 0, policy_version 1258037 (0.0008) [2023-12-28 04:17:59,800][106225] Updated weights for policy 1, policy_version 1261234 (0.0009) [2023-12-28 04:17:59,870][106225] Updated weights for policy 1, policy_version 1261244 (0.0008) [2023-12-28 04:17:59,930][106225] Updated weights for policy 1, policy_version 1261254 (0.0010) [2023-12-28 04:18:00,070][106226] Updated weights for policy 0, policy_version 1258047 (0.0010) [2023-12-28 04:18:00,124][106226] Updated weights for policy 0, policy_version 1258057 (0.0010) [2023-12-28 04:18:00,178][106226] Updated weights for policy 0, policy_version 1258067 (0.0010) [2023-12-28 04:18:00,669][106225] Updated weights for policy 1, policy_version 1261264 (0.0010) [2023-12-28 04:18:00,722][106225] Updated weights for policy 1, policy_version 1261274 (0.0010) [2023-12-28 04:18:00,775][106225] Updated weights for policy 1, policy_version 1261284 (0.0010) [2023-12-28 04:18:00,915][106226] Updated weights for policy 0, policy_version 1258077 (0.0009) [2023-12-28 04:18:00,971][106226] Updated weights for policy 0, policy_version 1258087 (0.0008) [2023-12-28 04:18:01,025][106226] Updated weights for policy 0, policy_version 1258097 (0.0008) [2023-12-28 04:18:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 645070848. Throughput: 0: 9880.9, 1: 10033.4. Samples: 645058356. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:01,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.765')] [2023-12-28 04:18:01,474][106225] Updated weights for policy 1, policy_version 1261294 (0.0007) [2023-12-28 04:18:01,538][106225] Updated weights for policy 1, policy_version 1261304 (0.0005) [2023-12-28 04:18:01,604][106225] Updated weights for policy 1, policy_version 1261314 (0.0006) [2023-12-28 04:18:01,847][106226] Updated weights for policy 0, policy_version 1258107 (0.0008) [2023-12-28 04:18:01,914][106226] Updated weights for policy 0, policy_version 1258117 (0.0008) [2023-12-28 04:18:01,983][106226] Updated weights for policy 0, policy_version 1258127 (0.0009) [2023-12-28 04:18:02,231][106225] Updated weights for policy 1, policy_version 1261324 (0.0010) [2023-12-28 04:18:02,297][106225] Updated weights for policy 1, policy_version 1261334 (0.0007) [2023-12-28 04:18:02,369][106225] Updated weights for policy 1, policy_version 1261344 (0.0008) [2023-12-28 04:18:02,711][106226] Updated weights for policy 0, policy_version 1258137 (0.0009) [2023-12-28 04:18:02,773][106226] Updated weights for policy 0, policy_version 1258147 (0.0008) [2023-12-28 04:18:02,840][106226] Updated weights for policy 0, policy_version 1258157 (0.0008) [2023-12-28 04:18:02,896][106226] Updated weights for policy 0, policy_version 1258167 (0.0008) [2023-12-28 04:18:03,015][106225] Updated weights for policy 1, policy_version 1261354 (0.0008) [2023-12-28 04:18:03,079][106225] Updated weights for policy 1, policy_version 1261364 (0.0005) [2023-12-28 04:18:03,137][106225] Updated weights for policy 1, policy_version 1261374 (0.0005) [2023-12-28 04:18:03,196][106225] Updated weights for policy 1, policy_version 1261384 (0.0005) [2023-12-28 04:18:03,483][106226] Updated weights for policy 0, policy_version 1258177 (0.0005) [2023-12-28 04:18:03,538][106226] Updated weights for policy 0, policy_version 1258187 (0.0005) [2023-12-28 04:18:03,598][106226] Updated weights for policy 0, policy_version 1258197 (0.0008) [2023-12-28 04:18:03,772][106225] Updated weights for policy 1, policy_version 1261394 (0.0006) [2023-12-28 04:18:03,822][106225] Updated weights for policy 1, policy_version 1261404 (0.0010) [2023-12-28 04:18:03,879][106225] Updated weights for policy 1, policy_version 1261414 (0.0008) [2023-12-28 04:18:04,287][106226] Updated weights for policy 0, policy_version 1258207 (0.0011) [2023-12-28 04:18:04,355][106226] Updated weights for policy 0, policy_version 1258217 (0.0011) [2023-12-28 04:18:04,422][106226] Updated weights for policy 0, policy_version 1258227 (0.0011) [2023-12-28 04:18:04,604][106225] Updated weights for policy 1, policy_version 1261424 (0.0008) [2023-12-28 04:18:04,659][106225] Updated weights for policy 1, policy_version 1261434 (0.0007) [2023-12-28 04:18:04,717][106225] Updated weights for policy 1, policy_version 1261444 (0.0009) [2023-12-28 04:18:05,116][106226] Updated weights for policy 0, policy_version 1258237 (0.0010) [2023-12-28 04:18:05,176][106226] Updated weights for policy 0, policy_version 1258247 (0.0010) [2023-12-28 04:18:05,235][106226] Updated weights for policy 0, policy_version 1258257 (0.0008) [2023-12-28 04:18:05,334][106225] Updated weights for policy 1, policy_version 1261454 (0.0010) [2023-12-28 04:18:05,393][106225] Updated weights for policy 1, policy_version 1261464 (0.0010) [2023-12-28 04:18:05,452][106225] Updated weights for policy 1, policy_version 1261474 (0.0010) [2023-12-28 04:18:05,934][106226] Updated weights for policy 0, policy_version 1258267 (0.0010) [2023-12-28 04:18:05,994][106226] Updated weights for policy 0, policy_version 1258277 (0.0010) [2023-12-28 04:18:06,054][106226] Updated weights for policy 0, policy_version 1258287 (0.0010) [2023-12-28 04:18:06,166][106225] Updated weights for policy 1, policy_version 1261484 (0.0010) [2023-12-28 04:18:06,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 645169152. Throughput: 0: 9954.0, 1: 10064.5. Samples: 645178180. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:06,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-5.047')] [2023-12-28 04:18:06,227][106225] Updated weights for policy 1, policy_version 1261494 (0.0010) [2023-12-28 04:18:06,285][106225] Updated weights for policy 1, policy_version 1261504 (0.0010) [2023-12-28 04:18:06,785][106226] Updated weights for policy 0, policy_version 1258297 (0.0010) [2023-12-28 04:18:06,845][106226] Updated weights for policy 0, policy_version 1258307 (0.0011) [2023-12-28 04:18:06,911][106226] Updated weights for policy 0, policy_version 1258317 (0.0011) [2023-12-28 04:18:06,958][106226] Updated weights for policy 0, policy_version 1258327 (0.0010) [2023-12-28 04:18:07,019][106225] Updated weights for policy 1, policy_version 1261514 (0.0011) [2023-12-28 04:18:07,079][106225] Updated weights for policy 1, policy_version 1261524 (0.0010) [2023-12-28 04:18:07,136][106225] Updated weights for policy 1, policy_version 1261534 (0.0010) [2023-12-28 04:18:07,191][106225] Updated weights for policy 1, policy_version 1261544 (0.0010) [2023-12-28 04:18:07,583][106226] Updated weights for policy 0, policy_version 1258337 (0.0006) [2023-12-28 04:18:07,643][106226] Updated weights for policy 0, policy_version 1258347 (0.0005) [2023-12-28 04:18:07,699][106226] Updated weights for policy 0, policy_version 1258357 (0.0005) [2023-12-28 04:18:07,799][106225] Updated weights for policy 1, policy_version 1261554 (0.0005) [2023-12-28 04:18:07,852][106225] Updated weights for policy 1, policy_version 1261564 (0.0010) [2023-12-28 04:18:07,901][106225] Updated weights for policy 1, policy_version 1261574 (0.0010) [2023-12-28 04:18:08,311][106226] Updated weights for policy 0, policy_version 1258367 (0.0009) [2023-12-28 04:18:08,380][106226] Updated weights for policy 0, policy_version 1258377 (0.0011) [2023-12-28 04:18:08,448][106226] Updated weights for policy 0, policy_version 1258387 (0.0011) [2023-12-28 04:18:08,600][106225] Updated weights for policy 1, policy_version 1261584 (0.0010) [2023-12-28 04:18:08,654][106225] Updated weights for policy 1, policy_version 1261594 (0.0010) [2023-12-28 04:18:08,712][106225] Updated weights for policy 1, policy_version 1261604 (0.0010) [2023-12-28 04:18:09,179][106226] Updated weights for policy 0, policy_version 1258397 (0.0011) [2023-12-28 04:18:09,267][106226] Updated weights for policy 0, policy_version 1258407 (0.0011) [2023-12-28 04:18:09,336][106226] Updated weights for policy 0, policy_version 1258417 (0.0011) [2023-12-28 04:18:09,472][106225] Updated weights for policy 1, policy_version 1261614 (0.0008) [2023-12-28 04:18:09,538][106225] Updated weights for policy 1, policy_version 1261624 (0.0006) [2023-12-28 04:18:09,602][106225] Updated weights for policy 1, policy_version 1261634 (0.0006) [2023-12-28 04:18:10,157][106226] Updated weights for policy 0, policy_version 1258427 (0.0010) [2023-12-28 04:18:10,228][106226] Updated weights for policy 0, policy_version 1258437 (0.0008) [2023-12-28 04:18:10,258][106225] Updated weights for policy 1, policy_version 1261644 (0.0006) [2023-12-28 04:18:10,292][106226] Updated weights for policy 0, policy_version 1258447 (0.0008) [2023-12-28 04:18:10,311][106225] Updated weights for policy 1, policy_version 1261654 (0.0006) [2023-12-28 04:18:10,367][106225] Updated weights for policy 1, policy_version 1261664 (0.0007) [2023-12-28 04:18:11,007][106226] Updated weights for policy 0, policy_version 1258457 (0.0008) [2023-12-28 04:18:11,045][106225] Updated weights for policy 1, policy_version 1261674 (0.0010) [2023-12-28 04:18:11,084][106226] Updated weights for policy 0, policy_version 1258467 (0.0009) [2023-12-28 04:18:11,108][106225] Updated weights for policy 1, policy_version 1261684 (0.0010) [2023-12-28 04:18:11,158][106226] Updated weights for policy 0, policy_version 1258477 (0.0007) [2023-12-28 04:18:11,175][106225] Updated weights for policy 1, policy_version 1261694 (0.0009) [2023-12-28 04:18:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 645259264. Throughput: 0: 10001.4, 1: 10078.5. Samples: 645238708. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:11,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-4.920')] [2023-12-28 04:18:11,218][106226] Updated weights for policy 0, policy_version 1258487 (0.0007) [2023-12-28 04:18:11,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001258488_322232320.pth... [2023-12-28 04:18:11,227][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001261704_323043328.pth... [2023-12-28 04:18:11,229][106225] Updated weights for policy 1, policy_version 1261704 (0.0007) [2023-12-28 04:18:11,229][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001257304_321929216.pth [2023-12-28 04:18:11,230][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001260520_322740224.pth [2023-12-28 04:18:11,961][106225] Updated weights for policy 1, policy_version 1261714 (0.0010) [2023-12-28 04:18:11,975][106226] Updated weights for policy 0, policy_version 1258497 (0.0006) [2023-12-28 04:18:12,023][106225] Updated weights for policy 1, policy_version 1261724 (0.0011) [2023-12-28 04:18:12,033][106226] Updated weights for policy 0, policy_version 1258507 (0.0006) [2023-12-28 04:18:12,081][106225] Updated weights for policy 1, policy_version 1261734 (0.0011) [2023-12-28 04:18:12,094][106226] Updated weights for policy 0, policy_version 1258517 (0.0008) [2023-12-28 04:18:12,834][106225] Updated weights for policy 1, policy_version 1261744 (0.0009) [2023-12-28 04:18:12,843][106226] Updated weights for policy 0, policy_version 1258527 (0.0006) [2023-12-28 04:18:12,893][106225] Updated weights for policy 1, policy_version 1261754 (0.0007) [2023-12-28 04:18:12,911][106226] Updated weights for policy 0, policy_version 1258537 (0.0009) [2023-12-28 04:18:12,948][106225] Updated weights for policy 1, policy_version 1261764 (0.0010) [2023-12-28 04:18:12,976][106226] Updated weights for policy 0, policy_version 1258547 (0.0005) [2023-12-28 04:18:13,599][106226] Updated weights for policy 0, policy_version 1258557 (0.0008) [2023-12-28 04:18:13,653][106226] Updated weights for policy 0, policy_version 1258567 (0.0008) [2023-12-28 04:18:13,671][106225] Updated weights for policy 1, policy_version 1261774 (0.0007) [2023-12-28 04:18:13,710][106226] Updated weights for policy 0, policy_version 1258577 (0.0009) [2023-12-28 04:18:13,727][106225] Updated weights for policy 1, policy_version 1261784 (0.0005) [2023-12-28 04:18:13,795][106225] Updated weights for policy 1, policy_version 1261794 (0.0005) [2023-12-28 04:18:14,271][106226] Updated weights for policy 0, policy_version 1258587 (0.0005) [2023-12-28 04:18:14,308][106225] Updated weights for policy 1, policy_version 1261804 (0.0007) [2023-12-28 04:18:14,325][106226] Updated weights for policy 0, policy_version 1258597 (0.0007) [2023-12-28 04:18:14,368][106225] Updated weights for policy 1, policy_version 1261814 (0.0010) [2023-12-28 04:18:14,382][106226] Updated weights for policy 0, policy_version 1258607 (0.0006) [2023-12-28 04:18:14,425][106225] Updated weights for policy 1, policy_version 1261824 (0.0010) [2023-12-28 04:18:15,055][106226] Updated weights for policy 0, policy_version 1258617 (0.0006) [2023-12-28 04:18:15,124][106226] Updated weights for policy 0, policy_version 1258627 (0.0008) [2023-12-28 04:18:15,150][106225] Updated weights for policy 1, policy_version 1261834 (0.0010) [2023-12-28 04:18:15,188][106226] Updated weights for policy 0, policy_version 1258637 (0.0008) [2023-12-28 04:18:15,209][106225] Updated weights for policy 1, policy_version 1261844 (0.0010) [2023-12-28 04:18:15,247][106226] Updated weights for policy 0, policy_version 1258647 (0.0006) [2023-12-28 04:18:15,262][106225] Updated weights for policy 1, policy_version 1261854 (0.0011) [2023-12-28 04:18:15,327][106225] Updated weights for policy 1, policy_version 1261864 (0.0010) [2023-12-28 04:18:15,967][106226] Updated weights for policy 0, policy_version 1258657 (0.0005) [2023-12-28 04:18:16,029][106226] Updated weights for policy 0, policy_version 1258667 (0.0005) [2023-12-28 04:18:16,057][106225] Updated weights for policy 1, policy_version 1261874 (0.0010) [2023-12-28 04:18:16,078][106226] Updated weights for policy 0, policy_version 1258677 (0.0006) [2023-12-28 04:18:16,104][106225] Updated weights for policy 1, policy_version 1261884 (0.0010) [2023-12-28 04:18:16,157][106225] Updated weights for policy 1, policy_version 1261894 (0.0010) [2023-12-28 04:18:16,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 645373952. Throughput: 0: 9943.2, 1: 10054.5. Samples: 645357880. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:16,176][105115] Avg episode reward: [(0, '-4.345'), (1, '-4.853')] [2023-12-28 04:18:16,788][106226] Updated weights for policy 0, policy_version 1258687 (0.0007) [2023-12-28 04:18:16,844][106226] Updated weights for policy 0, policy_version 1258697 (0.0008) [2023-12-28 04:18:16,880][106225] Updated weights for policy 1, policy_version 1261904 (0.0010) [2023-12-28 04:18:16,898][106226] Updated weights for policy 0, policy_version 1258707 (0.0006) [2023-12-28 04:18:16,935][106225] Updated weights for policy 1, policy_version 1261914 (0.0010) [2023-12-28 04:18:16,998][106225] Updated weights for policy 1, policy_version 1261924 (0.0010) [2023-12-28 04:18:17,512][106226] Updated weights for policy 0, policy_version 1258717 (0.0005) [2023-12-28 04:18:17,584][106226] Updated weights for policy 0, policy_version 1258727 (0.0006) [2023-12-28 04:18:17,641][106226] Updated weights for policy 0, policy_version 1258737 (0.0007) [2023-12-28 04:18:17,718][106225] Updated weights for policy 1, policy_version 1261934 (0.0011) [2023-12-28 04:18:17,783][106225] Updated weights for policy 1, policy_version 1261944 (0.0010) [2023-12-28 04:18:17,853][106225] Updated weights for policy 1, policy_version 1261954 (0.0011) [2023-12-28 04:18:18,211][106226] Updated weights for policy 0, policy_version 1258747 (0.0008) [2023-12-28 04:18:18,264][106226] Updated weights for policy 0, policy_version 1258757 (0.0005) [2023-12-28 04:18:18,328][106226] Updated weights for policy 0, policy_version 1258767 (0.0007) [2023-12-28 04:18:18,583][106225] Updated weights for policy 1, policy_version 1261964 (0.0009) [2023-12-28 04:18:18,642][106225] Updated weights for policy 1, policy_version 1261974 (0.0007) [2023-12-28 04:18:18,703][106225] Updated weights for policy 1, policy_version 1261984 (0.0007) [2023-12-28 04:18:19,086][106226] Updated weights for policy 0, policy_version 1258777 (0.0009) [2023-12-28 04:18:19,151][106226] Updated weights for policy 0, policy_version 1258787 (0.0009) [2023-12-28 04:18:19,204][106226] Updated weights for policy 0, policy_version 1258797 (0.0008) [2023-12-28 04:18:19,274][106226] Updated weights for policy 0, policy_version 1258807 (0.0008) [2023-12-28 04:18:19,312][106225] Updated weights for policy 1, policy_version 1261994 (0.0008) [2023-12-28 04:18:19,375][106225] Updated weights for policy 1, policy_version 1262004 (0.0008) [2023-12-28 04:18:19,439][106225] Updated weights for policy 1, policy_version 1262014 (0.0009) [2023-12-28 04:18:19,506][106225] Updated weights for policy 1, policy_version 1262024 (0.0007) [2023-12-28 04:18:20,018][106226] Updated weights for policy 0, policy_version 1258817 (0.0006) [2023-12-28 04:18:20,076][106226] Updated weights for policy 0, policy_version 1258827 (0.0008) [2023-12-28 04:18:20,132][106226] Updated weights for policy 0, policy_version 1258837 (0.0008) [2023-12-28 04:18:20,224][106225] Updated weights for policy 1, policy_version 1262034 (0.0008) [2023-12-28 04:18:20,280][106225] Updated weights for policy 1, policy_version 1262044 (0.0008) [2023-12-28 04:18:20,334][106225] Updated weights for policy 1, policy_version 1262054 (0.0007) [2023-12-28 04:18:20,914][106226] Updated weights for policy 0, policy_version 1258847 (0.0009) [2023-12-28 04:18:20,983][106226] Updated weights for policy 0, policy_version 1258857 (0.0008) [2023-12-28 04:18:21,021][106225] Updated weights for policy 1, policy_version 1262064 (0.0008) [2023-12-28 04:18:21,046][106226] Updated weights for policy 0, policy_version 1258867 (0.0007) [2023-12-28 04:18:21,090][106225] Updated weights for policy 1, policy_version 1262074 (0.0007) [2023-12-28 04:18:21,156][106225] Updated weights for policy 1, policy_version 1262084 (0.0008) [2023-12-28 04:18:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 645464064. Throughput: 0: 9871.5, 1: 9954.5. Samples: 645475532. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:21,175][105115] Avg episode reward: [(0, '-4.302'), (1, '-5.305')] [2023-12-28 04:18:21,767][106226] Updated weights for policy 0, policy_version 1258877 (0.0008) [2023-12-28 04:18:21,832][106226] Updated weights for policy 0, policy_version 1258887 (0.0008) [2023-12-28 04:18:21,894][106226] Updated weights for policy 0, policy_version 1258897 (0.0008) [2023-12-28 04:18:21,936][106225] Updated weights for policy 1, policy_version 1262094 (0.0008) [2023-12-28 04:18:21,995][106225] Updated weights for policy 1, policy_version 1262104 (0.0008) [2023-12-28 04:18:22,054][106225] Updated weights for policy 1, policy_version 1262114 (0.0008) [2023-12-28 04:18:22,650][106226] Updated weights for policy 0, policy_version 1258907 (0.0007) [2023-12-28 04:18:22,715][106226] Updated weights for policy 0, policy_version 1258917 (0.0009) [2023-12-28 04:18:22,780][106225] Updated weights for policy 1, policy_version 1262124 (0.0008) [2023-12-28 04:18:22,783][106226] Updated weights for policy 0, policy_version 1258927 (0.0008) [2023-12-28 04:18:22,831][106225] Updated weights for policy 1, policy_version 1262134 (0.0006) [2023-12-28 04:18:22,877][106225] Updated weights for policy 1, policy_version 1262144 (0.0005) [2023-12-28 04:18:23,481][106226] Updated weights for policy 0, policy_version 1258937 (0.0008) [2023-12-28 04:18:23,534][106226] Updated weights for policy 0, policy_version 1258947 (0.0010) [2023-12-28 04:18:23,577][106225] Updated weights for policy 1, policy_version 1262154 (0.0006) [2023-12-28 04:18:23,592][106226] Updated weights for policy 0, policy_version 1258957 (0.0010) [2023-12-28 04:18:23,628][106225] Updated weights for policy 1, policy_version 1262164 (0.0005) [2023-12-28 04:18:23,651][106226] Updated weights for policy 0, policy_version 1258967 (0.0010) [2023-12-28 04:18:23,683][106225] Updated weights for policy 1, policy_version 1262174 (0.0005) [2023-12-28 04:18:23,742][106225] Updated weights for policy 1, policy_version 1262184 (0.0006) [2023-12-28 04:18:24,282][106226] Updated weights for policy 0, policy_version 1258977 (0.0006) [2023-12-28 04:18:24,332][106226] Updated weights for policy 0, policy_version 1258987 (0.0009) [2023-12-28 04:18:24,370][106225] Updated weights for policy 1, policy_version 1262194 (0.0006) [2023-12-28 04:18:24,380][106226] Updated weights for policy 0, policy_version 1258997 (0.0009) [2023-12-28 04:18:24,423][106225] Updated weights for policy 1, policy_version 1262204 (0.0006) [2023-12-28 04:18:24,485][106225] Updated weights for policy 1, policy_version 1262214 (0.0008) [2023-12-28 04:18:25,049][106226] Updated weights for policy 0, policy_version 1259007 (0.0010) [2023-12-28 04:18:25,096][106226] Updated weights for policy 0, policy_version 1259017 (0.0010) [2023-12-28 04:18:25,152][106226] Updated weights for policy 0, policy_version 1259027 (0.0005) [2023-12-28 04:18:25,222][106225] Updated weights for policy 1, policy_version 1262224 (0.0006) [2023-12-28 04:18:25,288][106225] Updated weights for policy 1, policy_version 1262234 (0.0009) [2023-12-28 04:18:25,354][106225] Updated weights for policy 1, policy_version 1262244 (0.0008) [2023-12-28 04:18:25,791][106226] Updated weights for policy 0, policy_version 1259037 (0.0006) [2023-12-28 04:18:25,846][106226] Updated weights for policy 0, policy_version 1259047 (0.0005) [2023-12-28 04:18:25,910][106226] Updated weights for policy 0, policy_version 1259057 (0.0006) [2023-12-28 04:18:26,033][106225] Updated weights for policy 1, policy_version 1262254 (0.0007) [2023-12-28 04:18:26,091][106225] Updated weights for policy 1, policy_version 1262264 (0.0006) [2023-12-28 04:18:26,152][106225] Updated weights for policy 1, policy_version 1262274 (0.0008) [2023-12-28 04:18:26,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 645562368. Throughput: 0: 9873.6, 1: 9924.1. Samples: 645533180. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:26,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.828')] [2023-12-28 04:18:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001259064_322379776.pth... [2023-12-28 04:18:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001257912_322084864.pth [2023-12-28 04:18:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001262280_323190784.pth... [2023-12-28 04:18:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001261096_322887680.pth [2023-12-28 04:18:26,504][106226] Updated weights for policy 0, policy_version 1259067 (0.0007) [2023-12-28 04:18:26,563][106226] Updated weights for policy 0, policy_version 1259077 (0.0010) [2023-12-28 04:18:26,628][106226] Updated weights for policy 0, policy_version 1259087 (0.0010) [2023-12-28 04:18:26,878][106225] Updated weights for policy 1, policy_version 1262284 (0.0009) [2023-12-28 04:18:26,931][106225] Updated weights for policy 1, policy_version 1262294 (0.0007) [2023-12-28 04:18:26,985][106225] Updated weights for policy 1, policy_version 1262304 (0.0008) [2023-12-28 04:18:27,320][106226] Updated weights for policy 0, policy_version 1259097 (0.0010) [2023-12-28 04:18:27,378][106226] Updated weights for policy 0, policy_version 1259107 (0.0008) [2023-12-28 04:18:27,438][106226] Updated weights for policy 0, policy_version 1259117 (0.0008) [2023-12-28 04:18:27,499][106226] Updated weights for policy 0, policy_version 1259127 (0.0008) [2023-12-28 04:18:27,716][106225] Updated weights for policy 1, policy_version 1262314 (0.0008) [2023-12-28 04:18:27,763][106225] Updated weights for policy 1, policy_version 1262324 (0.0008) [2023-12-28 04:18:27,814][106225] Updated weights for policy 1, policy_version 1262334 (0.0007) [2023-12-28 04:18:27,860][106225] Updated weights for policy 1, policy_version 1262344 (0.0006) [2023-12-28 04:18:28,117][106226] Updated weights for policy 0, policy_version 1259137 (0.0008) [2023-12-28 04:18:28,162][106226] Updated weights for policy 0, policy_version 1259147 (0.0008) [2023-12-28 04:18:28,206][106226] Updated weights for policy 0, policy_version 1259157 (0.0008) [2023-12-28 04:18:28,649][106225] Updated weights for policy 1, policy_version 1262354 (0.0009) [2023-12-28 04:18:28,708][106225] Updated weights for policy 1, policy_version 1262364 (0.0008) [2023-12-28 04:18:28,762][106225] Updated weights for policy 1, policy_version 1262374 (0.0007) [2023-12-28 04:18:28,833][106226] Updated weights for policy 0, policy_version 1259167 (0.0007) [2023-12-28 04:18:28,879][106226] Updated weights for policy 0, policy_version 1259177 (0.0009) [2023-12-28 04:18:28,927][106226] Updated weights for policy 0, policy_version 1259187 (0.0008) [2023-12-28 04:18:29,490][106225] Updated weights for policy 1, policy_version 1262384 (0.0007) [2023-12-28 04:18:29,546][106225] Updated weights for policy 1, policy_version 1262394 (0.0008) [2023-12-28 04:18:29,606][106225] Updated weights for policy 1, policy_version 1262404 (0.0009) [2023-12-28 04:18:29,730][106226] Updated weights for policy 0, policy_version 1259197 (0.0008) [2023-12-28 04:18:29,795][106226] Updated weights for policy 0, policy_version 1259207 (0.0008) [2023-12-28 04:18:29,860][106226] Updated weights for policy 0, policy_version 1259217 (0.0008) [2023-12-28 04:18:30,269][106225] Updated weights for policy 1, policy_version 1262414 (0.0008) [2023-12-28 04:18:30,326][106225] Updated weights for policy 1, policy_version 1262424 (0.0007) [2023-12-28 04:18:30,388][106225] Updated weights for policy 1, policy_version 1262434 (0.0008) [2023-12-28 04:18:30,595][106226] Updated weights for policy 0, policy_version 1259227 (0.0008) [2023-12-28 04:18:30,642][106226] Updated weights for policy 0, policy_version 1259237 (0.0008) [2023-12-28 04:18:30,697][106226] Updated weights for policy 0, policy_version 1259247 (0.0008) [2023-12-28 04:18:31,129][106225] Updated weights for policy 1, policy_version 1262444 (0.0008) [2023-12-28 04:18:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 645660672. Throughput: 0: 9933.9, 1: 9925.1. Samples: 645654064. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:31,175][105115] Avg episode reward: [(0, '-4.037'), (1, '-4.948')] [2023-12-28 04:18:31,190][106225] Updated weights for policy 1, policy_version 1262454 (0.0008) [2023-12-28 04:18:31,242][106225] Updated weights for policy 1, policy_version 1262464 (0.0008) [2023-12-28 04:18:31,342][106226] Updated weights for policy 0, policy_version 1259257 (0.0009) [2023-12-28 04:18:31,411][106226] Updated weights for policy 0, policy_version 1259267 (0.0008) [2023-12-28 04:18:31,471][106226] Updated weights for policy 0, policy_version 1259277 (0.0008) [2023-12-28 04:18:31,531][106226] Updated weights for policy 0, policy_version 1259287 (0.0008) [2023-12-28 04:18:32,012][106225] Updated weights for policy 1, policy_version 1262474 (0.0008) [2023-12-28 04:18:32,066][106225] Updated weights for policy 1, policy_version 1262484 (0.0008) [2023-12-28 04:18:32,124][106225] Updated weights for policy 1, policy_version 1262494 (0.0008) [2023-12-28 04:18:32,179][106225] Updated weights for policy 1, policy_version 1262504 (0.0009) [2023-12-28 04:18:32,220][106226] Updated weights for policy 0, policy_version 1259297 (0.0009) [2023-12-28 04:18:32,282][106226] Updated weights for policy 0, policy_version 1259307 (0.0008) [2023-12-28 04:18:32,327][106226] Updated weights for policy 0, policy_version 1259317 (0.0009) [2023-12-28 04:18:32,879][106225] Updated weights for policy 1, policy_version 1262514 (0.0008) [2023-12-28 04:18:32,941][106225] Updated weights for policy 1, policy_version 1262524 (0.0010) [2023-12-28 04:18:33,005][106225] Updated weights for policy 1, policy_version 1262534 (0.0007) [2023-12-28 04:18:33,033][106226] Updated weights for policy 0, policy_version 1259327 (0.0010) [2023-12-28 04:18:33,103][106226] Updated weights for policy 0, policy_version 1259337 (0.0007) [2023-12-28 04:18:33,166][106226] Updated weights for policy 0, policy_version 1259347 (0.0005) [2023-12-28 04:18:33,686][106226] Updated weights for policy 0, policy_version 1259357 (0.0005) [2023-12-28 04:18:33,749][106226] Updated weights for policy 0, policy_version 1259367 (0.0006) [2023-12-28 04:18:33,789][106225] Updated weights for policy 1, policy_version 1262544 (0.0007) [2023-12-28 04:18:33,810][106226] Updated weights for policy 0, policy_version 1259377 (0.0006) [2023-12-28 04:18:33,831][106225] Updated weights for policy 1, policy_version 1262554 (0.0007) [2023-12-28 04:18:33,885][106225] Updated weights for policy 1, policy_version 1262564 (0.0007) [2023-12-28 04:18:34,487][106226] Updated weights for policy 0, policy_version 1259387 (0.0010) [2023-12-28 04:18:34,538][106226] Updated weights for policy 0, policy_version 1259397 (0.0009) [2023-12-28 04:18:34,593][106226] Updated weights for policy 0, policy_version 1259407 (0.0009) [2023-12-28 04:18:34,660][106225] Updated weights for policy 1, policy_version 1262574 (0.0007) [2023-12-28 04:18:34,719][106225] Updated weights for policy 1, policy_version 1262584 (0.0006) [2023-12-28 04:18:34,765][106225] Updated weights for policy 1, policy_version 1262594 (0.0005) [2023-12-28 04:18:35,338][106225] Updated weights for policy 1, policy_version 1262604 (0.0007) [2023-12-28 04:18:35,361][106226] Updated weights for policy 0, policy_version 1259417 (0.0009) [2023-12-28 04:18:35,389][106225] Updated weights for policy 1, policy_version 1262614 (0.0010) [2023-12-28 04:18:35,423][106226] Updated weights for policy 0, policy_version 1259427 (0.0005) [2023-12-28 04:18:35,442][106225] Updated weights for policy 1, policy_version 1262624 (0.0010) [2023-12-28 04:18:35,486][106226] Updated weights for policy 0, policy_version 1259437 (0.0006) [2023-12-28 04:18:35,546][106226] Updated weights for policy 0, policy_version 1259447 (0.0006) [2023-12-28 04:18:36,049][106225] Updated weights for policy 1, policy_version 1262634 (0.0011) [2023-12-28 04:18:36,115][106225] Updated weights for policy 1, policy_version 1262644 (0.0010) [2023-12-28 04:18:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 645758976. Throughput: 0: 9989.7, 1: 9852.5. Samples: 645773536. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:36,175][105115] Avg episode reward: [(0, '-4.220'), (1, '-4.971')] [2023-12-28 04:18:36,184][106225] Updated weights for policy 1, policy_version 1262654 (0.0007) [2023-12-28 04:18:36,245][106225] Updated weights for policy 1, policy_version 1262664 (0.0010) [2023-12-28 04:18:36,316][106226] Updated weights for policy 0, policy_version 1259457 (0.0008) [2023-12-28 04:18:36,383][106226] Updated weights for policy 0, policy_version 1259467 (0.0008) [2023-12-28 04:18:36,450][106226] Updated weights for policy 0, policy_version 1259477 (0.0009) [2023-12-28 04:18:36,908][106225] Updated weights for policy 1, policy_version 1262674 (0.0006) [2023-12-28 04:18:36,974][106225] Updated weights for policy 1, policy_version 1262684 (0.0005) [2023-12-28 04:18:37,033][106225] Updated weights for policy 1, policy_version 1262694 (0.0005) [2023-12-28 04:18:37,123][106226] Updated weights for policy 0, policy_version 1259487 (0.0006) [2023-12-28 04:18:37,183][106226] Updated weights for policy 0, policy_version 1259497 (0.0005) [2023-12-28 04:18:37,230][106226] Updated weights for policy 0, policy_version 1259507 (0.0005) [2023-12-28 04:18:37,702][106225] Updated weights for policy 1, policy_version 1262704 (0.0010) [2023-12-28 04:18:37,759][106225] Updated weights for policy 1, policy_version 1262714 (0.0010) [2023-12-28 04:18:37,818][106226] Updated weights for policy 0, policy_version 1259517 (0.0006) [2023-12-28 04:18:37,819][106225] Updated weights for policy 1, policy_version 1262724 (0.0011) [2023-12-28 04:18:37,873][106226] Updated weights for policy 0, policy_version 1259527 (0.0007) [2023-12-28 04:18:37,921][106226] Updated weights for policy 0, policy_version 1259537 (0.0008) [2023-12-28 04:18:38,503][106225] Updated weights for policy 1, policy_version 1262734 (0.0008) [2023-12-28 04:18:38,569][106225] Updated weights for policy 1, policy_version 1262744 (0.0005) [2023-12-28 04:18:38,605][106226] Updated weights for policy 0, policy_version 1259547 (0.0007) [2023-12-28 04:18:38,636][106225] Updated weights for policy 1, policy_version 1262754 (0.0006) [2023-12-28 04:18:38,663][106226] Updated weights for policy 0, policy_version 1259557 (0.0008) [2023-12-28 04:18:38,716][106226] Updated weights for policy 0, policy_version 1259567 (0.0010) [2023-12-28 04:18:39,208][106225] Updated weights for policy 1, policy_version 1262764 (0.0007) [2023-12-28 04:18:39,281][106225] Updated weights for policy 1, policy_version 1262774 (0.0008) [2023-12-28 04:18:39,340][106225] Updated weights for policy 1, policy_version 1262784 (0.0010) [2023-12-28 04:18:39,545][106226] Updated weights for policy 0, policy_version 1259577 (0.0009) [2023-12-28 04:18:39,601][106226] Updated weights for policy 0, policy_version 1259587 (0.0008) [2023-12-28 04:18:39,665][106226] Updated weights for policy 0, policy_version 1259597 (0.0008) [2023-12-28 04:18:39,729][106226] Updated weights for policy 0, policy_version 1259607 (0.0008) [2023-12-28 04:18:40,072][106225] Updated weights for policy 1, policy_version 1262794 (0.0008) [2023-12-28 04:18:40,134][106225] Updated weights for policy 1, policy_version 1262804 (0.0007) [2023-12-28 04:18:40,203][106225] Updated weights for policy 1, policy_version 1262814 (0.0006) [2023-12-28 04:18:40,264][106225] Updated weights for policy 1, policy_version 1262824 (0.0008) [2023-12-28 04:18:40,522][106226] Updated weights for policy 0, policy_version 1259617 (0.0011) [2023-12-28 04:18:40,588][106226] Updated weights for policy 0, policy_version 1259627 (0.0011) [2023-12-28 04:18:40,648][106226] Updated weights for policy 0, policy_version 1259637 (0.0011) [2023-12-28 04:18:40,997][106225] Updated weights for policy 1, policy_version 1262834 (0.0006) [2023-12-28 04:18:41,069][106225] Updated weights for policy 1, policy_version 1262844 (0.0008) [2023-12-28 04:18:41,133][106225] Updated weights for policy 1, policy_version 1262854 (0.0008) [2023-12-28 04:18:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 645865472. Throughput: 0: 10035.7, 1: 9937.4. Samples: 645835248. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:41,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-5.011')] [2023-12-28 04:18:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001262856_323338240.pth... [2023-12-28 04:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001259640_322527232.pth... [2023-12-28 04:18:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001258488_322232320.pth [2023-12-28 04:18:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001261704_323043328.pth [2023-12-28 04:18:41,358][106226] Updated weights for policy 0, policy_version 1259647 (0.0010) [2023-12-28 04:18:41,433][106226] Updated weights for policy 0, policy_version 1259657 (0.0009) [2023-12-28 04:18:41,493][106226] Updated weights for policy 0, policy_version 1259667 (0.0011) [2023-12-28 04:18:41,869][106225] Updated weights for policy 1, policy_version 1262864 (0.0008) [2023-12-28 04:18:41,915][106225] Updated weights for policy 1, policy_version 1262874 (0.0006) [2023-12-28 04:18:41,973][106225] Updated weights for policy 1, policy_version 1262884 (0.0005) [2023-12-28 04:18:42,192][106226] Updated weights for policy 0, policy_version 1259677 (0.0011) [2023-12-28 04:18:42,257][106226] Updated weights for policy 0, policy_version 1259687 (0.0011) [2023-12-28 04:18:42,323][106226] Updated weights for policy 0, policy_version 1259697 (0.0010) [2023-12-28 04:18:42,719][106225] Updated weights for policy 1, policy_version 1262894 (0.0007) [2023-12-28 04:18:42,782][106225] Updated weights for policy 1, policy_version 1262904 (0.0009) [2023-12-28 04:18:42,843][106225] Updated weights for policy 1, policy_version 1262914 (0.0008) [2023-12-28 04:18:42,993][106226] Updated weights for policy 0, policy_version 1259707 (0.0009) [2023-12-28 04:18:43,058][106226] Updated weights for policy 0, policy_version 1259717 (0.0008) [2023-12-28 04:18:43,125][106226] Updated weights for policy 0, policy_version 1259727 (0.0009) [2023-12-28 04:18:43,463][106225] Updated weights for policy 1, policy_version 1262924 (0.0009) [2023-12-28 04:18:43,527][106225] Updated weights for policy 1, policy_version 1262934 (0.0010) [2023-12-28 04:18:43,588][106225] Updated weights for policy 1, policy_version 1262944 (0.0008) [2023-12-28 04:18:43,878][106226] Updated weights for policy 0, policy_version 1259737 (0.0009) [2023-12-28 04:18:43,934][106226] Updated weights for policy 0, policy_version 1259747 (0.0008) [2023-12-28 04:18:43,984][106226] Updated weights for policy 0, policy_version 1259757 (0.0008) [2023-12-28 04:18:44,032][106226] Updated weights for policy 0, policy_version 1259767 (0.0007) [2023-12-28 04:18:44,208][106225] Updated weights for policy 1, policy_version 1262954 (0.0005) [2023-12-28 04:18:44,265][106225] Updated weights for policy 1, policy_version 1262964 (0.0007) [2023-12-28 04:18:44,325][106225] Updated weights for policy 1, policy_version 1262974 (0.0010) [2023-12-28 04:18:44,388][106225] Updated weights for policy 1, policy_version 1262984 (0.0010) [2023-12-28 04:18:44,724][106226] Updated weights for policy 0, policy_version 1259777 (0.0006) [2023-12-28 04:18:44,781][106226] Updated weights for policy 0, policy_version 1259787 (0.0008) [2023-12-28 04:18:44,848][106226] Updated weights for policy 0, policy_version 1259797 (0.0010) [2023-12-28 04:18:45,044][106225] Updated weights for policy 1, policy_version 1262994 (0.0007) [2023-12-28 04:18:45,092][106225] Updated weights for policy 1, policy_version 1263004 (0.0007) [2023-12-28 04:18:45,146][106225] Updated weights for policy 1, policy_version 1263014 (0.0007) [2023-12-28 04:18:45,564][106226] Updated weights for policy 0, policy_version 1259807 (0.0011) [2023-12-28 04:18:45,618][106226] Updated weights for policy 0, policy_version 1259817 (0.0010) [2023-12-28 04:18:45,665][106226] Updated weights for policy 0, policy_version 1259827 (0.0010) [2023-12-28 04:18:45,841][106225] Updated weights for policy 1, policy_version 1263024 (0.0010) [2023-12-28 04:18:45,897][106225] Updated weights for policy 1, policy_version 1263034 (0.0010) [2023-12-28 04:18:45,959][106225] Updated weights for policy 1, policy_version 1263044 (0.0005) [2023-12-28 04:18:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 645963776. Throughput: 0: 9921.0, 1: 9955.5. Samples: 645952804. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:46,176][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.885')] [2023-12-28 04:18:46,332][106226] Updated weights for policy 0, policy_version 1259837 (0.0010) [2023-12-28 04:18:46,394][106226] Updated weights for policy 0, policy_version 1259847 (0.0010) [2023-12-28 04:18:46,450][106226] Updated weights for policy 0, policy_version 1259857 (0.0010) [2023-12-28 04:18:46,610][106225] Updated weights for policy 1, policy_version 1263054 (0.0008) [2023-12-28 04:18:46,670][106225] Updated weights for policy 1, policy_version 1263064 (0.0010) [2023-12-28 04:18:46,736][106225] Updated weights for policy 1, policy_version 1263074 (0.0009) [2023-12-28 04:18:47,181][106226] Updated weights for policy 0, policy_version 1259867 (0.0010) [2023-12-28 04:18:47,230][106226] Updated weights for policy 0, policy_version 1259877 (0.0008) [2023-12-28 04:18:47,278][106226] Updated weights for policy 0, policy_version 1259887 (0.0009) [2023-12-28 04:18:47,304][106225] Updated weights for policy 1, policy_version 1263084 (0.0007) [2023-12-28 04:18:47,357][106225] Updated weights for policy 1, policy_version 1263094 (0.0007) [2023-12-28 04:18:47,411][106225] Updated weights for policy 1, policy_version 1263104 (0.0009) [2023-12-28 04:18:47,901][106226] Updated weights for policy 0, policy_version 1259897 (0.0007) [2023-12-28 04:18:47,960][106226] Updated weights for policy 0, policy_version 1259907 (0.0010) [2023-12-28 04:18:48,023][106226] Updated weights for policy 0, policy_version 1259917 (0.0010) [2023-12-28 04:18:48,087][106226] Updated weights for policy 0, policy_version 1259927 (0.0010) [2023-12-28 04:18:48,148][106225] Updated weights for policy 1, policy_version 1263114 (0.0008) [2023-12-28 04:18:48,210][106225] Updated weights for policy 1, policy_version 1263124 (0.0008) [2023-12-28 04:18:48,270][106225] Updated weights for policy 1, policy_version 1263134 (0.0008) [2023-12-28 04:18:48,335][106225] Updated weights for policy 1, policy_version 1263144 (0.0008) [2023-12-28 04:18:48,797][106226] Updated weights for policy 0, policy_version 1259937 (0.0009) [2023-12-28 04:18:48,861][106226] Updated weights for policy 0, policy_version 1259947 (0.0009) [2023-12-28 04:18:48,924][106226] Updated weights for policy 0, policy_version 1259957 (0.0009) [2023-12-28 04:18:49,085][106225] Updated weights for policy 1, policy_version 1263154 (0.0008) [2023-12-28 04:18:49,147][106225] Updated weights for policy 1, policy_version 1263164 (0.0009) [2023-12-28 04:18:49,203][106225] Updated weights for policy 1, policy_version 1263174 (0.0009) [2023-12-28 04:18:49,616][106226] Updated weights for policy 0, policy_version 1259967 (0.0009) [2023-12-28 04:18:49,676][106226] Updated weights for policy 0, policy_version 1259977 (0.0009) [2023-12-28 04:18:49,728][106226] Updated weights for policy 0, policy_version 1259987 (0.0008) [2023-12-28 04:18:49,933][106225] Updated weights for policy 1, policy_version 1263184 (0.0009) [2023-12-28 04:18:49,995][106225] Updated weights for policy 1, policy_version 1263194 (0.0009) [2023-12-28 04:18:50,061][106225] Updated weights for policy 1, policy_version 1263204 (0.0008) [2023-12-28 04:18:50,486][106226] Updated weights for policy 0, policy_version 1259997 (0.0008) [2023-12-28 04:18:50,544][106226] Updated weights for policy 0, policy_version 1260007 (0.0009) [2023-12-28 04:18:50,613][106226] Updated weights for policy 0, policy_version 1260017 (0.0008) [2023-12-28 04:18:50,802][106225] Updated weights for policy 1, policy_version 1263214 (0.0009) [2023-12-28 04:18:50,869][106225] Updated weights for policy 1, policy_version 1263224 (0.0010) [2023-12-28 04:18:50,930][106225] Updated weights for policy 1, policy_version 1263234 (0.0010) [2023-12-28 04:18:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 646062080. Throughput: 0: 9943.3, 1: 9907.7. Samples: 646071476. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:51,175][105115] Avg episode reward: [(0, '-4.246'), (1, '-5.077')] [2023-12-28 04:18:51,314][106226] Updated weights for policy 0, policy_version 1260027 (0.0008) [2023-12-28 04:18:51,377][106226] Updated weights for policy 0, policy_version 1260037 (0.0010) [2023-12-28 04:18:51,446][106226] Updated weights for policy 0, policy_version 1260047 (0.0007) [2023-12-28 04:18:51,665][106225] Updated weights for policy 1, policy_version 1263244 (0.0010) [2023-12-28 04:18:51,720][106225] Updated weights for policy 1, policy_version 1263254 (0.0009) [2023-12-28 04:18:51,787][106225] Updated weights for policy 1, policy_version 1263264 (0.0008) [2023-12-28 04:18:52,173][106226] Updated weights for policy 0, policy_version 1260057 (0.0010) [2023-12-28 04:18:52,224][106226] Updated weights for policy 0, policy_version 1260067 (0.0006) [2023-12-28 04:18:52,294][106226] Updated weights for policy 0, policy_version 1260077 (0.0010) [2023-12-28 04:18:52,363][106226] Updated weights for policy 0, policy_version 1260087 (0.0011) [2023-12-28 04:18:52,543][106225] Updated weights for policy 1, policy_version 1263274 (0.0007) [2023-12-28 04:18:52,609][106225] Updated weights for policy 1, policy_version 1263284 (0.0006) [2023-12-28 04:18:52,673][106225] Updated weights for policy 1, policy_version 1263294 (0.0009) [2023-12-28 04:18:52,739][106225] Updated weights for policy 1, policy_version 1263304 (0.0009) [2023-12-28 04:18:52,999][106226] Updated weights for policy 0, policy_version 1260097 (0.0006) [2023-12-28 04:18:53,055][106226] Updated weights for policy 0, policy_version 1260107 (0.0007) [2023-12-28 04:18:53,117][106226] Updated weights for policy 0, policy_version 1260117 (0.0006) [2023-12-28 04:18:53,351][106225] Updated weights for policy 1, policy_version 1263314 (0.0008) [2023-12-28 04:18:53,409][106225] Updated weights for policy 1, policy_version 1263324 (0.0009) [2023-12-28 04:18:53,465][106225] Updated weights for policy 1, policy_version 1263334 (0.0008) [2023-12-28 04:18:53,750][106226] Updated weights for policy 0, policy_version 1260127 (0.0005) [2023-12-28 04:18:53,796][106226] Updated weights for policy 0, policy_version 1260137 (0.0005) [2023-12-28 04:18:53,853][106226] Updated weights for policy 0, policy_version 1260147 (0.0006) [2023-12-28 04:18:54,245][106225] Updated weights for policy 1, policy_version 1263344 (0.0006) [2023-12-28 04:18:54,296][106225] Updated weights for policy 1, policy_version 1263354 (0.0005) [2023-12-28 04:18:54,362][106225] Updated weights for policy 1, policy_version 1263364 (0.0006) [2023-12-28 04:18:54,514][106226] Updated weights for policy 0, policy_version 1260157 (0.0009) [2023-12-28 04:18:54,584][106226] Updated weights for policy 0, policy_version 1260167 (0.0011) [2023-12-28 04:18:54,648][106226] Updated weights for policy 0, policy_version 1260177 (0.0008) [2023-12-28 04:18:55,031][106225] Updated weights for policy 1, policy_version 1263374 (0.0007) [2023-12-28 04:18:55,094][106225] Updated weights for policy 1, policy_version 1263384 (0.0009) [2023-12-28 04:18:55,163][106225] Updated weights for policy 1, policy_version 1263394 (0.0009) [2023-12-28 04:18:55,218][106226] Updated weights for policy 0, policy_version 1260187 (0.0008) [2023-12-28 04:18:55,270][106226] Updated weights for policy 0, policy_version 1260197 (0.0009) [2023-12-28 04:18:55,327][106226] Updated weights for policy 0, policy_version 1260207 (0.0008) [2023-12-28 04:18:55,887][106225] Updated weights for policy 1, policy_version 1263404 (0.0008) [2023-12-28 04:18:55,944][106225] Updated weights for policy 1, policy_version 1263414 (0.0008) [2023-12-28 04:18:56,004][106225] Updated weights for policy 1, policy_version 1263424 (0.0009) [2023-12-28 04:18:56,085][106226] Updated weights for policy 0, policy_version 1260217 (0.0008) [2023-12-28 04:18:56,147][106226] Updated weights for policy 0, policy_version 1260227 (0.0008) [2023-12-28 04:18:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 646160384. Throughput: 0: 9943.6, 1: 9873.2. Samples: 646130468. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:18:56,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-5.064')] [2023-12-28 04:18:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001263432_323485696.pth... [2023-12-28 04:18:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001262280_323190784.pth [2023-12-28 04:18:56,214][106226] Updated weights for policy 0, policy_version 1260237 (0.0008) [2023-12-28 04:18:56,272][106226] Updated weights for policy 0, policy_version 1260247 (0.0008) [2023-12-28 04:18:56,278][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001260248_322682880.pth... [2023-12-28 04:18:56,282][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001259064_322379776.pth [2023-12-28 04:18:56,757][106225] Updated weights for policy 1, policy_version 1263434 (0.0009) [2023-12-28 04:18:56,812][106225] Updated weights for policy 1, policy_version 1263444 (0.0008) [2023-12-28 04:18:56,870][106225] Updated weights for policy 1, policy_version 1263454 (0.0008) [2023-12-28 04:18:56,924][106225] Updated weights for policy 1, policy_version 1263464 (0.0009) [2023-12-28 04:18:56,951][106226] Updated weights for policy 0, policy_version 1260257 (0.0010) [2023-12-28 04:18:57,010][106226] Updated weights for policy 0, policy_version 1260267 (0.0009) [2023-12-28 04:18:57,076][106226] Updated weights for policy 0, policy_version 1260277 (0.0005) [2023-12-28 04:18:57,676][106226] Updated weights for policy 0, policy_version 1260287 (0.0006) [2023-12-28 04:18:57,700][106225] Updated weights for policy 1, policy_version 1263474 (0.0008) [2023-12-28 04:18:57,730][106226] Updated weights for policy 0, policy_version 1260297 (0.0006) [2023-12-28 04:18:57,757][106225] Updated weights for policy 1, policy_version 1263484 (0.0008) [2023-12-28 04:18:57,789][106226] Updated weights for policy 0, policy_version 1260307 (0.0005) [2023-12-28 04:18:57,814][106225] Updated weights for policy 1, policy_version 1263494 (0.0007) [2023-12-28 04:18:58,468][106226] Updated weights for policy 0, policy_version 1260317 (0.0009) [2023-12-28 04:18:58,502][106225] Updated weights for policy 1, policy_version 1263504 (0.0008) [2023-12-28 04:18:58,532][106226] Updated weights for policy 0, policy_version 1260327 (0.0007) [2023-12-28 04:18:58,561][106225] Updated weights for policy 1, policy_version 1263514 (0.0008) [2023-12-28 04:18:58,594][106226] Updated weights for policy 0, policy_version 1260337 (0.0007) [2023-12-28 04:18:58,639][106225] Updated weights for policy 1, policy_version 1263524 (0.0007) [2023-12-28 04:18:59,397][106225] Updated weights for policy 1, policy_version 1263534 (0.0008) [2023-12-28 04:18:59,433][106226] Updated weights for policy 0, policy_version 1260347 (0.0008) [2023-12-28 04:18:59,458][106225] Updated weights for policy 1, policy_version 1263544 (0.0007) [2023-12-28 04:18:59,487][106226] Updated weights for policy 0, policy_version 1260357 (0.0006) [2023-12-28 04:18:59,508][106225] Updated weights for policy 1, policy_version 1263554 (0.0005) [2023-12-28 04:18:59,548][106226] Updated weights for policy 0, policy_version 1260367 (0.0006) [2023-12-28 04:19:00,206][106226] Updated weights for policy 0, policy_version 1260377 (0.0006) [2023-12-28 04:19:00,212][106225] Updated weights for policy 1, policy_version 1263564 (0.0006) [2023-12-28 04:19:00,269][106226] Updated weights for policy 0, policy_version 1260387 (0.0006) [2023-12-28 04:19:00,273][106225] Updated weights for policy 1, policy_version 1263574 (0.0008) [2023-12-28 04:19:00,329][106226] Updated weights for policy 0, policy_version 1260397 (0.0007) [2023-12-28 04:19:00,335][106225] Updated weights for policy 1, policy_version 1263584 (0.0006) [2023-12-28 04:19:00,385][106226] Updated weights for policy 0, policy_version 1260407 (0.0005) [2023-12-28 04:19:01,037][106225] Updated weights for policy 1, policy_version 1263594 (0.0008) [2023-12-28 04:19:01,082][106226] Updated weights for policy 0, policy_version 1260417 (0.0010) [2023-12-28 04:19:01,099][106225] Updated weights for policy 1, policy_version 1263604 (0.0007) [2023-12-28 04:19:01,148][106226] Updated weights for policy 0, policy_version 1260427 (0.0009) [2023-12-28 04:19:01,160][106225] Updated weights for policy 1, policy_version 1263614 (0.0007) [2023-12-28 04:19:01,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 646250496. Throughput: 0: 9979.7, 1: 9814.3. Samples: 646248604. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:19:01,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.941')] [2023-12-28 04:19:01,204][106226] Updated weights for policy 0, policy_version 1260437 (0.0009) [2023-12-28 04:19:01,214][106225] Updated weights for policy 1, policy_version 1263624 (0.0005) [2023-12-28 04:19:01,934][106226] Updated weights for policy 0, policy_version 1260447 (0.0007) [2023-12-28 04:19:01,982][106225] Updated weights for policy 1, policy_version 1263634 (0.0007) [2023-12-28 04:19:01,998][106226] Updated weights for policy 0, policy_version 1260457 (0.0007) [2023-12-28 04:19:02,043][106225] Updated weights for policy 1, policy_version 1263644 (0.0008) [2023-12-28 04:19:02,057][106226] Updated weights for policy 0, policy_version 1260467 (0.0005) [2023-12-28 04:19:02,102][106225] Updated weights for policy 1, policy_version 1263654 (0.0007) [2023-12-28 04:19:02,649][106226] Updated weights for policy 0, policy_version 1260477 (0.0006) [2023-12-28 04:19:02,697][106226] Updated weights for policy 0, policy_version 1260487 (0.0008) [2023-12-28 04:19:02,754][106226] Updated weights for policy 0, policy_version 1260497 (0.0010) [2023-12-28 04:19:02,852][106225] Updated weights for policy 1, policy_version 1263664 (0.0008) [2023-12-28 04:19:02,899][106225] Updated weights for policy 1, policy_version 1263674 (0.0008) [2023-12-28 04:19:02,948][106225] Updated weights for policy 1, policy_version 1263684 (0.0008) [2023-12-28 04:19:03,428][106226] Updated weights for policy 0, policy_version 1260507 (0.0009) [2023-12-28 04:19:03,477][106226] Updated weights for policy 0, policy_version 1260517 (0.0009) [2023-12-28 04:19:03,527][106226] Updated weights for policy 0, policy_version 1260527 (0.0009) [2023-12-28 04:19:03,656][106225] Updated weights for policy 1, policy_version 1263694 (0.0007) [2023-12-28 04:19:03,713][106225] Updated weights for policy 1, policy_version 1263704 (0.0005) [2023-12-28 04:19:03,768][106225] Updated weights for policy 1, policy_version 1263714 (0.0005) [2023-12-28 04:19:04,360][106225] Updated weights for policy 1, policy_version 1263724 (0.0006) [2023-12-28 04:19:04,370][106226] Updated weights for policy 0, policy_version 1260537 (0.0009) [2023-12-28 04:19:04,417][106225] Updated weights for policy 1, policy_version 1263734 (0.0009) [2023-12-28 04:19:04,432][106226] Updated weights for policy 0, policy_version 1260547 (0.0010) [2023-12-28 04:19:04,478][106225] Updated weights for policy 1, policy_version 1263744 (0.0010) [2023-12-28 04:19:04,484][106226] Updated weights for policy 0, policy_version 1260557 (0.0007) [2023-12-28 04:19:04,541][106226] Updated weights for policy 0, policy_version 1260567 (0.0007) [2023-12-28 04:19:05,054][106225] Updated weights for policy 1, policy_version 1263754 (0.0010) [2023-12-28 04:19:05,104][106225] Updated weights for policy 1, policy_version 1263764 (0.0007) [2023-12-28 04:19:05,149][106226] Updated weights for policy 0, policy_version 1260577 (0.0006) [2023-12-28 04:19:05,162][106225] Updated weights for policy 1, policy_version 1263774 (0.0005) [2023-12-28 04:19:05,204][106226] Updated weights for policy 0, policy_version 1260587 (0.0006) [2023-12-28 04:19:05,218][106225] Updated weights for policy 1, policy_version 1263784 (0.0005) [2023-12-28 04:19:05,261][106226] Updated weights for policy 0, policy_version 1260597 (0.0009) [2023-12-28 04:19:05,845][106225] Updated weights for policy 1, policy_version 1263794 (0.0011) [2023-12-28 04:19:05,894][106225] Updated weights for policy 1, policy_version 1263804 (0.0010) [2023-12-28 04:19:05,955][106225] Updated weights for policy 1, policy_version 1263814 (0.0010) [2023-12-28 04:19:05,958][106226] Updated weights for policy 0, policy_version 1260607 (0.0006) [2023-12-28 04:19:06,015][106226] Updated weights for policy 0, policy_version 1260617 (0.0008) [2023-12-28 04:19:06,074][106226] Updated weights for policy 0, policy_version 1260627 (0.0008) [2023-12-28 04:19:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 646365184. Throughput: 0: 10007.8, 1: 9865.4. Samples: 646369828. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:19:06,175][105115] Avg episode reward: [(0, '-4.126'), (1, '-5.075')] [2023-12-28 04:19:06,734][106225] Updated weights for policy 1, policy_version 1263824 (0.0009) [2023-12-28 04:19:06,796][106225] Updated weights for policy 1, policy_version 1263834 (0.0009) [2023-12-28 04:19:06,806][106226] Updated weights for policy 0, policy_version 1260637 (0.0008) [2023-12-28 04:19:06,855][106225] Updated weights for policy 1, policy_version 1263844 (0.0007) [2023-12-28 04:19:06,865][106226] Updated weights for policy 0, policy_version 1260647 (0.0006) [2023-12-28 04:19:06,922][106226] Updated weights for policy 0, policy_version 1260657 (0.0008) [2023-12-28 04:19:07,526][106226] Updated weights for policy 0, policy_version 1260667 (0.0008) [2023-12-28 04:19:07,581][106226] Updated weights for policy 0, policy_version 1260677 (0.0005) [2023-12-28 04:19:07,592][106225] Updated weights for policy 1, policy_version 1263854 (0.0007) [2023-12-28 04:19:07,635][106226] Updated weights for policy 0, policy_version 1260687 (0.0005) [2023-12-28 04:19:07,642][106225] Updated weights for policy 1, policy_version 1263864 (0.0008) [2023-12-28 04:19:07,700][106225] Updated weights for policy 1, policy_version 1263874 (0.0008) [2023-12-28 04:19:08,164][106226] Updated weights for policy 0, policy_version 1260697 (0.0005) [2023-12-28 04:19:08,233][106226] Updated weights for policy 0, policy_version 1260707 (0.0008) [2023-12-28 04:19:08,292][106226] Updated weights for policy 0, policy_version 1260717 (0.0010) [2023-12-28 04:19:08,359][106226] Updated weights for policy 0, policy_version 1260727 (0.0009) [2023-12-28 04:19:08,532][106225] Updated weights for policy 1, policy_version 1263884 (0.0009) [2023-12-28 04:19:08,581][106225] Updated weights for policy 1, policy_version 1263894 (0.0008) [2023-12-28 04:19:08,637][106225] Updated weights for policy 1, policy_version 1263904 (0.0008) [2023-12-28 04:19:09,044][106226] Updated weights for policy 0, policy_version 1260737 (0.0007) [2023-12-28 04:19:09,099][106226] Updated weights for policy 0, policy_version 1260747 (0.0006) [2023-12-28 04:19:09,150][106226] Updated weights for policy 0, policy_version 1260757 (0.0007) [2023-12-28 04:19:09,223][106225] Updated weights for policy 1, policy_version 1263914 (0.0008) [2023-12-28 04:19:09,283][106225] Updated weights for policy 1, policy_version 1263924 (0.0006) [2023-12-28 04:19:09,334][106225] Updated weights for policy 1, policy_version 1263934 (0.0006) [2023-12-28 04:19:09,400][106225] Updated weights for policy 1, policy_version 1263944 (0.0007) [2023-12-28 04:19:09,948][106226] Updated weights for policy 0, policy_version 1260767 (0.0008) [2023-12-28 04:19:10,010][106225] Updated weights for policy 1, policy_version 1263954 (0.0007) [2023-12-28 04:19:10,020][106226] Updated weights for policy 0, policy_version 1260777 (0.0008) [2023-12-28 04:19:10,068][106225] Updated weights for policy 1, policy_version 1263964 (0.0008) [2023-12-28 04:19:10,084][106226] Updated weights for policy 0, policy_version 1260787 (0.0008) [2023-12-28 04:19:10,128][106225] Updated weights for policy 1, policy_version 1263974 (0.0006) [2023-12-28 04:19:10,857][106226] Updated weights for policy 0, policy_version 1260797 (0.0009) [2023-12-28 04:19:10,912][106225] Updated weights for policy 1, policy_version 1263984 (0.0008) [2023-12-28 04:19:10,921][106226] Updated weights for policy 0, policy_version 1260807 (0.0006) [2023-12-28 04:19:10,965][106225] Updated weights for policy 1, policy_version 1263994 (0.0008) [2023-12-28 04:19:10,979][106226] Updated weights for policy 0, policy_version 1260817 (0.0007) [2023-12-28 04:19:11,034][106225] Updated weights for policy 1, policy_version 1264004 (0.0007) [2023-12-28 04:19:11,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 646463488. Throughput: 0: 10082.9, 1: 9821.1. Samples: 646428864. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:19:11,175][105115] Avg episode reward: [(0, '-4.093'), (1, '-4.845')] [2023-12-28 04:19:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001264008_323633152.pth... [2023-12-28 04:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001260824_322830336.pth... [2023-12-28 04:19:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001262856_323338240.pth [2023-12-28 04:19:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001259640_322527232.pth [2023-12-28 04:19:11,752][106226] Updated weights for policy 0, policy_version 1260827 (0.0008) [2023-12-28 04:19:11,773][106225] Updated weights for policy 1, policy_version 1264014 (0.0009) [2023-12-28 04:19:11,817][106226] Updated weights for policy 0, policy_version 1260837 (0.0007) [2023-12-28 04:19:11,843][106225] Updated weights for policy 1, policy_version 1264024 (0.0008) [2023-12-28 04:19:11,882][106226] Updated weights for policy 0, policy_version 1260847 (0.0007) [2023-12-28 04:19:11,909][106225] Updated weights for policy 1, policy_version 1264034 (0.0007) [2023-12-28 04:19:12,617][106226] Updated weights for policy 0, policy_version 1260857 (0.0006) [2023-12-28 04:19:12,669][106225] Updated weights for policy 1, policy_version 1264044 (0.0010) [2023-12-28 04:19:12,675][106226] Updated weights for policy 0, policy_version 1260867 (0.0011) [2023-12-28 04:19:12,716][106225] Updated weights for policy 1, policy_version 1264054 (0.0010) [2023-12-28 04:19:12,723][106226] Updated weights for policy 0, policy_version 1260877 (0.0010) [2023-12-28 04:19:12,763][106225] Updated weights for policy 1, policy_version 1264064 (0.0009) [2023-12-28 04:19:12,775][106226] Updated weights for policy 0, policy_version 1260887 (0.0010) [2023-12-28 04:19:13,368][106225] Updated weights for policy 1, policy_version 1264074 (0.0007) [2023-12-28 04:19:13,418][106225] Updated weights for policy 1, policy_version 1264084 (0.0010) [2023-12-28 04:19:13,461][106226] Updated weights for policy 0, policy_version 1260897 (0.0006) [2023-12-28 04:19:13,478][106225] Updated weights for policy 1, policy_version 1264094 (0.0010) [2023-12-28 04:19:13,513][106226] Updated weights for policy 0, policy_version 1260907 (0.0005) [2023-12-28 04:19:13,535][106225] Updated weights for policy 1, policy_version 1264104 (0.0010) [2023-12-28 04:19:13,564][106226] Updated weights for policy 0, policy_version 1260917 (0.0005) [2023-12-28 04:19:14,092][106226] Updated weights for policy 0, policy_version 1260927 (0.0005) [2023-12-28 04:19:14,148][106226] Updated weights for policy 0, policy_version 1260937 (0.0006) [2023-12-28 04:19:14,212][106226] Updated weights for policy 0, policy_version 1260947 (0.0006) [2023-12-28 04:19:14,249][106225] Updated weights for policy 1, policy_version 1264114 (0.0010) [2023-12-28 04:19:14,308][106225] Updated weights for policy 1, policy_version 1264124 (0.0010) [2023-12-28 04:19:14,364][106225] Updated weights for policy 1, policy_version 1264134 (0.0005) [2023-12-28 04:19:14,810][106226] Updated weights for policy 0, policy_version 1260957 (0.0008) [2023-12-28 04:19:14,875][106226] Updated weights for policy 0, policy_version 1260967 (0.0008) [2023-12-28 04:19:14,942][106226] Updated weights for policy 0, policy_version 1260977 (0.0008) [2023-12-28 04:19:14,981][106225] Updated weights for policy 1, policy_version 1264144 (0.0007) [2023-12-28 04:19:15,046][106225] Updated weights for policy 1, policy_version 1264154 (0.0008) [2023-12-28 04:19:15,114][106225] Updated weights for policy 1, policy_version 1264164 (0.0008) [2023-12-28 04:19:15,712][106225] Updated weights for policy 1, policy_version 1264174 (0.0008) [2023-12-28 04:19:15,743][106226] Updated weights for policy 0, policy_version 1260987 (0.0008) [2023-12-28 04:19:15,765][106225] Updated weights for policy 1, policy_version 1264184 (0.0008) [2023-12-28 04:19:15,794][106226] Updated weights for policy 0, policy_version 1260997 (0.0006) [2023-12-28 04:19:15,823][106225] Updated weights for policy 1, policy_version 1264194 (0.0005) [2023-12-28 04:19:15,856][106226] Updated weights for policy 0, policy_version 1261007 (0.0007) [2023-12-28 04:19:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 646561792. Throughput: 0: 9992.8, 1: 9900.5. Samples: 646549264. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:19:16,176][105115] Avg episode reward: [(0, '-4.156'), (1, '-4.815')] [2023-12-28 04:19:16,401][106226] Updated weights for policy 0, policy_version 1261017 (0.0006) [2023-12-28 04:19:16,463][106226] Updated weights for policy 0, policy_version 1261027 (0.0009) [2023-12-28 04:19:16,515][106226] Updated weights for policy 0, policy_version 1261037 (0.0008) [2023-12-28 04:19:16,574][106226] Updated weights for policy 0, policy_version 1261047 (0.0008) [2023-12-28 04:19:16,580][106225] Updated weights for policy 1, policy_version 1264204 (0.0006) [2023-12-28 04:19:16,634][106225] Updated weights for policy 1, policy_version 1264214 (0.0007) [2023-12-28 04:19:16,690][106225] Updated weights for policy 1, policy_version 1264224 (0.0008) [2023-12-28 04:19:17,200][106226] Updated weights for policy 0, policy_version 1261057 (0.0007) [2023-12-28 04:19:17,253][106226] Updated weights for policy 0, policy_version 1261067 (0.0008) [2023-12-28 04:19:17,309][106226] Updated weights for policy 0, policy_version 1261077 (0.0010) [2023-12-28 04:19:17,462][106225] Updated weights for policy 1, policy_version 1264234 (0.0008) [2023-12-28 04:19:17,512][106225] Updated weights for policy 1, policy_version 1264244 (0.0006) [2023-12-28 04:19:17,559][106225] Updated weights for policy 1, policy_version 1264254 (0.0005) [2023-12-28 04:19:17,604][106225] Updated weights for policy 1, policy_version 1264264 (0.0005) [2023-12-28 04:19:17,949][106226] Updated weights for policy 0, policy_version 1261087 (0.0010) [2023-12-28 04:19:18,005][106226] Updated weights for policy 0, policy_version 1261097 (0.0009) [2023-12-28 04:19:18,064][106226] Updated weights for policy 0, policy_version 1261107 (0.0010) [2023-12-28 04:19:18,290][106225] Updated weights for policy 1, policy_version 1264274 (0.0005) [2023-12-28 04:19:18,346][106225] Updated weights for policy 1, policy_version 1264284 (0.0008) [2023-12-28 04:19:18,406][106225] Updated weights for policy 1, policy_version 1264294 (0.0008) [2023-12-28 04:19:18,798][106226] Updated weights for policy 0, policy_version 1261117 (0.0011) [2023-12-28 04:19:18,849][106226] Updated weights for policy 0, policy_version 1261127 (0.0011) [2023-12-28 04:19:18,908][106226] Updated weights for policy 0, policy_version 1261137 (0.0011) [2023-12-28 04:19:19,170][106225] Updated weights for policy 1, policy_version 1264304 (0.0008) [2023-12-28 04:19:19,236][106225] Updated weights for policy 1, policy_version 1264314 (0.0008) [2023-12-28 04:19:19,295][106225] Updated weights for policy 1, policy_version 1264324 (0.0007) [2023-12-28 04:19:19,583][106226] Updated weights for policy 0, policy_version 1261147 (0.0008) [2023-12-28 04:19:19,656][106226] Updated weights for policy 0, policy_version 1261157 (0.0006) [2023-12-28 04:19:19,725][106226] Updated weights for policy 0, policy_version 1261167 (0.0006) [2023-12-28 04:19:20,116][106225] Updated weights for policy 1, policy_version 1264334 (0.0008) [2023-12-28 04:19:20,180][106225] Updated weights for policy 1, policy_version 1264344 (0.0009) [2023-12-28 04:19:20,237][106225] Updated weights for policy 1, policy_version 1264354 (0.0008) [2023-12-28 04:19:20,393][106226] Updated weights for policy 0, policy_version 1261177 (0.0008) [2023-12-28 04:19:20,455][106226] Updated weights for policy 0, policy_version 1261187 (0.0008) [2023-12-28 04:19:20,513][106226] Updated weights for policy 0, policy_version 1261197 (0.0009) [2023-12-28 04:19:20,575][106226] Updated weights for policy 0, policy_version 1261207 (0.0008) [2023-12-28 04:19:20,981][106225] Updated weights for policy 1, policy_version 1264364 (0.0009) [2023-12-28 04:19:21,045][106225] Updated weights for policy 1, policy_version 1264374 (0.0008) [2023-12-28 04:19:21,107][106225] Updated weights for policy 1, policy_version 1264384 (0.0007) [2023-12-28 04:19:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 646660096. Throughput: 0: 10008.6, 1: 9871.2. Samples: 646668124. Policy #0 lag: (min: 18.0, avg: 38.4, max: 40.0) [2023-12-28 04:19:21,175][105115] Avg episode reward: [(0, '-4.155'), (1, '-5.134')] [2023-12-28 04:19:21,316][106226] Updated weights for policy 0, policy_version 1261217 (0.0009) [2023-12-28 04:19:21,386][106226] Updated weights for policy 0, policy_version 1261227 (0.0009) [2023-12-28 04:19:21,451][106226] Updated weights for policy 0, policy_version 1261237 (0.0008) [2023-12-28 04:19:21,914][106225] Updated weights for policy 1, policy_version 1264394 (0.0009) [2023-12-28 04:19:21,974][106225] Updated weights for policy 1, policy_version 1264404 (0.0009) [2023-12-28 04:19:22,038][106225] Updated weights for policy 1, policy_version 1264414 (0.0008) [2023-12-28 04:19:22,093][106225] Updated weights for policy 1, policy_version 1264424 (0.0009) [2023-12-28 04:19:22,248][106226] Updated weights for policy 0, policy_version 1261247 (0.0008) [2023-12-28 04:19:22,314][106226] Updated weights for policy 0, policy_version 1261257 (0.0009) [2023-12-28 04:19:22,384][106226] Updated weights for policy 0, policy_version 1261267 (0.0008) [2023-12-28 04:19:22,783][106225] Updated weights for policy 1, policy_version 1264434 (0.0009) [2023-12-28 04:19:22,831][106225] Updated weights for policy 1, policy_version 1264444 (0.0008) [2023-12-28 04:19:22,885][106225] Updated weights for policy 1, policy_version 1264454 (0.0006) [2023-12-28 04:19:23,102][106226] Updated weights for policy 0, policy_version 1261277 (0.0008) [2023-12-28 04:19:23,163][106226] Updated weights for policy 0, policy_version 1261287 (0.0009) [2023-12-28 04:19:23,217][106226] Updated weights for policy 0, policy_version 1261297 (0.0009) [2023-12-28 04:19:23,506][106225] Updated weights for policy 1, policy_version 1264464 (0.0007) [2023-12-28 04:19:23,564][106225] Updated weights for policy 1, policy_version 1264474 (0.0006) [2023-12-28 04:19:23,622][106225] Updated weights for policy 1, policy_version 1264484 (0.0006) [2023-12-28 04:19:23,898][106226] Updated weights for policy 0, policy_version 1261307 (0.0009) [2023-12-28 04:19:23,962][106226] Updated weights for policy 0, policy_version 1261317 (0.0008) [2023-12-28 04:19:24,018][106226] Updated weights for policy 0, policy_version 1261327 (0.0008) [2023-12-28 04:19:24,316][106225] Updated weights for policy 1, policy_version 1264494 (0.0009) [2023-12-28 04:19:24,379][106225] Updated weights for policy 1, policy_version 1264504 (0.0010) [2023-12-28 04:19:24,442][106225] Updated weights for policy 1, policy_version 1264514 (0.0010) [2023-12-28 04:19:24,754][106226] Updated weights for policy 0, policy_version 1261337 (0.0008) [2023-12-28 04:19:24,816][106226] Updated weights for policy 0, policy_version 1261347 (0.0008) [2023-12-28 04:19:24,882][106226] Updated weights for policy 0, policy_version 1261357 (0.0009) [2023-12-28 04:19:24,942][106226] Updated weights for policy 0, policy_version 1261367 (0.0009) [2023-12-28 04:19:25,111][106225] Updated weights for policy 1, policy_version 1264524 (0.0008) [2023-12-28 04:19:25,164][106225] Updated weights for policy 1, policy_version 1264534 (0.0008) [2023-12-28 04:19:25,213][106225] Updated weights for policy 1, policy_version 1264544 (0.0010) [2023-12-28 04:19:25,550][106226] Updated weights for policy 0, policy_version 1261377 (0.0006) [2023-12-28 04:19:25,597][106226] Updated weights for policy 0, policy_version 1261387 (0.0006) [2023-12-28 04:19:25,646][106226] Updated weights for policy 0, policy_version 1261397 (0.0008) [2023-12-28 04:19:25,924][106225] Updated weights for policy 1, policy_version 1264554 (0.0010) [2023-12-28 04:19:25,983][106225] Updated weights for policy 1, policy_version 1264564 (0.0010) [2023-12-28 04:19:26,040][106225] Updated weights for policy 1, policy_version 1264574 (0.0010) [2023-12-28 04:19:26,101][106225] Updated weights for policy 1, policy_version 1264584 (0.0010) [2023-12-28 04:19:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 646758400. Throughput: 0: 9965.0, 1: 9824.1. Samples: 646725756. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:26,175][105115] Avg episode reward: [(0, '-4.183'), (1, '-5.272')] [2023-12-28 04:19:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001264584_323780608.pth... [2023-12-28 04:19:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001261400_322977792.pth... [2023-12-28 04:19:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001260248_322682880.pth [2023-12-28 04:19:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001263432_323485696.pth [2023-12-28 04:19:26,363][106226] Updated weights for policy 0, policy_version 1261407 (0.0010) [2023-12-28 04:19:26,428][106226] Updated weights for policy 0, policy_version 1261417 (0.0007) [2023-12-28 04:19:26,492][106226] Updated weights for policy 0, policy_version 1261427 (0.0009) [2023-12-28 04:19:26,825][106225] Updated weights for policy 1, policy_version 1264594 (0.0010) [2023-12-28 04:19:26,872][106225] Updated weights for policy 1, policy_version 1264604 (0.0010) [2023-12-28 04:19:26,928][106225] Updated weights for policy 1, policy_version 1264614 (0.0010) [2023-12-28 04:19:27,137][106226] Updated weights for policy 0, policy_version 1261437 (0.0008) [2023-12-28 04:19:27,189][106226] Updated weights for policy 0, policy_version 1261447 (0.0005) [2023-12-28 04:19:27,242][106226] Updated weights for policy 0, policy_version 1261457 (0.0005) [2023-12-28 04:19:27,643][106225] Updated weights for policy 1, policy_version 1264624 (0.0006) [2023-12-28 04:19:27,712][106225] Updated weights for policy 1, policy_version 1264634 (0.0005) [2023-12-28 04:19:27,778][106225] Updated weights for policy 1, policy_version 1264644 (0.0005) [2023-12-28 04:19:27,865][106226] Updated weights for policy 0, policy_version 1261467 (0.0008) [2023-12-28 04:19:27,930][106226] Updated weights for policy 0, policy_version 1261477 (0.0009) [2023-12-28 04:19:27,992][106226] Updated weights for policy 0, policy_version 1261487 (0.0010) [2023-12-28 04:19:28,357][106225] Updated weights for policy 1, policy_version 1264654 (0.0008) [2023-12-28 04:19:28,421][106225] Updated weights for policy 1, policy_version 1264664 (0.0009) [2023-12-28 04:19:28,485][106225] Updated weights for policy 1, policy_version 1264674 (0.0008) [2023-12-28 04:19:28,706][106226] Updated weights for policy 0, policy_version 1261497 (0.0010) [2023-12-28 04:19:28,760][106226] Updated weights for policy 0, policy_version 1261507 (0.0008) [2023-12-28 04:19:28,821][106226] Updated weights for policy 0, policy_version 1261517 (0.0008) [2023-12-28 04:19:28,887][106226] Updated weights for policy 0, policy_version 1261527 (0.0008) [2023-12-28 04:19:29,164][106225] Updated weights for policy 1, policy_version 1264684 (0.0007) [2023-12-28 04:19:29,224][106225] Updated weights for policy 1, policy_version 1264694 (0.0007) [2023-12-28 04:19:29,287][106225] Updated weights for policy 1, policy_version 1264704 (0.0007) [2023-12-28 04:19:29,631][106226] Updated weights for policy 0, policy_version 1261537 (0.0010) [2023-12-28 04:19:29,689][106226] Updated weights for policy 0, policy_version 1261547 (0.0009) [2023-12-28 04:19:29,754][106226] Updated weights for policy 0, policy_version 1261557 (0.0008) [2023-12-28 04:19:30,053][106225] Updated weights for policy 1, policy_version 1264714 (0.0010) [2023-12-28 04:19:30,125][106225] Updated weights for policy 1, policy_version 1264724 (0.0010) [2023-12-28 04:19:30,182][106225] Updated weights for policy 1, policy_version 1264734 (0.0010) [2023-12-28 04:19:30,236][106225] Updated weights for policy 1, policy_version 1264744 (0.0010) [2023-12-28 04:19:30,384][106226] Updated weights for policy 0, policy_version 1261567 (0.0007) [2023-12-28 04:19:30,440][106226] Updated weights for policy 0, policy_version 1261577 (0.0010) [2023-12-28 04:19:30,497][106226] Updated weights for policy 0, policy_version 1261587 (0.0010) [2023-12-28 04:19:30,892][106225] Updated weights for policy 1, policy_version 1264754 (0.0010) [2023-12-28 04:19:30,948][106225] Updated weights for policy 1, policy_version 1264764 (0.0010) [2023-12-28 04:19:31,010][106225] Updated weights for policy 1, policy_version 1264774 (0.0010) [2023-12-28 04:19:31,125][106226] Updated weights for policy 0, policy_version 1261597 (0.0008) [2023-12-28 04:19:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 646856704. Throughput: 0: 10032.7, 1: 9825.5. Samples: 646846420. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:31,175][105115] Avg episode reward: [(0, '-4.087'), (1, '-5.038')] [2023-12-28 04:19:31,197][106226] Updated weights for policy 0, policy_version 1261607 (0.0007) [2023-12-28 04:19:31,264][106226] Updated weights for policy 0, policy_version 1261617 (0.0007) [2023-12-28 04:19:31,743][106225] Updated weights for policy 1, policy_version 1264784 (0.0008) [2023-12-28 04:19:31,808][106225] Updated weights for policy 1, policy_version 1264794 (0.0010) [2023-12-28 04:19:31,866][106225] Updated weights for policy 1, policy_version 1264804 (0.0010) [2023-12-28 04:19:31,941][106226] Updated weights for policy 0, policy_version 1261627 (0.0006) [2023-12-28 04:19:32,010][106226] Updated weights for policy 0, policy_version 1261637 (0.0006) [2023-12-28 04:19:32,080][106226] Updated weights for policy 0, policy_version 1261647 (0.0006) [2023-12-28 04:19:32,470][106225] Updated weights for policy 1, policy_version 1264814 (0.0010) [2023-12-28 04:19:32,535][106225] Updated weights for policy 1, policy_version 1264824 (0.0010) [2023-12-28 04:19:32,601][106225] Updated weights for policy 1, policy_version 1264834 (0.0011) [2023-12-28 04:19:32,716][106226] Updated weights for policy 0, policy_version 1261657 (0.0006) [2023-12-28 04:19:32,767][106226] Updated weights for policy 0, policy_version 1261667 (0.0008) [2023-12-28 04:19:32,817][106226] Updated weights for policy 0, policy_version 1261677 (0.0008) [2023-12-28 04:19:32,865][106226] Updated weights for policy 0, policy_version 1261687 (0.0008) [2023-12-28 04:19:33,237][106225] Updated weights for policy 1, policy_version 1264844 (0.0008) [2023-12-28 04:19:33,292][106225] Updated weights for policy 1, policy_version 1264854 (0.0010) [2023-12-28 04:19:33,338][106225] Updated weights for policy 1, policy_version 1264864 (0.0010) [2023-12-28 04:19:33,570][106226] Updated weights for policy 0, policy_version 1261697 (0.0010) [2023-12-28 04:19:33,619][106226] Updated weights for policy 0, policy_version 1261707 (0.0010) [2023-12-28 04:19:33,672][106226] Updated weights for policy 0, policy_version 1261717 (0.0010) [2023-12-28 04:19:34,021][106225] Updated weights for policy 1, policy_version 1264874 (0.0010) [2023-12-28 04:19:34,084][106225] Updated weights for policy 1, policy_version 1264884 (0.0010) [2023-12-28 04:19:34,152][106225] Updated weights for policy 1, policy_version 1264894 (0.0010) [2023-12-28 04:19:34,217][106225] Updated weights for policy 1, policy_version 1264904 (0.0010) [2023-12-28 04:19:34,423][106226] Updated weights for policy 0, policy_version 1261727 (0.0007) [2023-12-28 04:19:34,474][106226] Updated weights for policy 0, policy_version 1261737 (0.0006) [2023-12-28 04:19:34,521][106226] Updated weights for policy 0, policy_version 1261747 (0.0007) [2023-12-28 04:19:34,932][106225] Updated weights for policy 1, policy_version 1264914 (0.0010) [2023-12-28 04:19:34,986][106225] Updated weights for policy 1, policy_version 1264924 (0.0006) [2023-12-28 04:19:35,058][106225] Updated weights for policy 1, policy_version 1264934 (0.0009) [2023-12-28 04:19:35,091][106226] Updated weights for policy 0, policy_version 1261757 (0.0008) [2023-12-28 04:19:35,149][106226] Updated weights for policy 0, policy_version 1261767 (0.0006) [2023-12-28 04:19:35,202][106226] Updated weights for policy 0, policy_version 1261777 (0.0006) [2023-12-28 04:19:35,650][106225] Updated weights for policy 1, policy_version 1264944 (0.0010) [2023-12-28 04:19:35,703][106225] Updated weights for policy 1, policy_version 1264954 (0.0008) [2023-12-28 04:19:35,754][106225] Updated weights for policy 1, policy_version 1264964 (0.0010) [2023-12-28 04:19:35,860][106226] Updated weights for policy 0, policy_version 1261787 (0.0009) [2023-12-28 04:19:35,919][106226] Updated weights for policy 0, policy_version 1261797 (0.0010) [2023-12-28 04:19:35,976][106226] Updated weights for policy 0, policy_version 1261807 (0.0010) [2023-12-28 04:19:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 646963200. Throughput: 0: 10109.1, 1: 9869.7. Samples: 646970524. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:36,175][105115] Avg episode reward: [(0, '-4.278'), (1, '-5.032')] [2023-12-28 04:19:36,396][106225] Updated weights for policy 1, policy_version 1264974 (0.0010) [2023-12-28 04:19:36,464][106225] Updated weights for policy 1, policy_version 1264984 (0.0011) [2023-12-28 04:19:36,526][106225] Updated weights for policy 1, policy_version 1264994 (0.0011) [2023-12-28 04:19:36,665][106226] Updated weights for policy 0, policy_version 1261817 (0.0008) [2023-12-28 04:19:36,723][106226] Updated weights for policy 0, policy_version 1261827 (0.0011) [2023-12-28 04:19:36,784][106226] Updated weights for policy 0, policy_version 1261837 (0.0011) [2023-12-28 04:19:36,846][106226] Updated weights for policy 0, policy_version 1261847 (0.0011) [2023-12-28 04:19:37,252][106225] Updated weights for policy 1, policy_version 1265004 (0.0010) [2023-12-28 04:19:37,313][106225] Updated weights for policy 1, policy_version 1265014 (0.0010) [2023-12-28 04:19:37,367][106225] Updated weights for policy 1, policy_version 1265024 (0.0010) [2023-12-28 04:19:37,522][106226] Updated weights for policy 0, policy_version 1261857 (0.0008) [2023-12-28 04:19:37,581][106226] Updated weights for policy 0, policy_version 1261867 (0.0008) [2023-12-28 04:19:37,632][106226] Updated weights for policy 0, policy_version 1261877 (0.0008) [2023-12-28 04:19:38,090][106225] Updated weights for policy 1, policy_version 1265034 (0.0010) [2023-12-28 04:19:38,153][106225] Updated weights for policy 1, policy_version 1265044 (0.0010) [2023-12-28 04:19:38,210][106225] Updated weights for policy 1, policy_version 1265054 (0.0010) [2023-12-28 04:19:38,260][106226] Updated weights for policy 0, policy_version 1261887 (0.0009) [2023-12-28 04:19:38,270][106225] Updated weights for policy 1, policy_version 1265064 (0.0010) [2023-12-28 04:19:38,313][106226] Updated weights for policy 0, policy_version 1261897 (0.0010) [2023-12-28 04:19:38,373][106226] Updated weights for policy 0, policy_version 1261907 (0.0009) [2023-12-28 04:19:39,000][106225] Updated weights for policy 1, policy_version 1265074 (0.0010) [2023-12-28 04:19:39,023][106226] Updated weights for policy 0, policy_version 1261917 (0.0007) [2023-12-28 04:19:39,051][106225] Updated weights for policy 1, policy_version 1265084 (0.0010) [2023-12-28 04:19:39,079][106226] Updated weights for policy 0, policy_version 1261927 (0.0005) [2023-12-28 04:19:39,098][106225] Updated weights for policy 1, policy_version 1265094 (0.0010) [2023-12-28 04:19:39,130][106226] Updated weights for policy 0, policy_version 1261937 (0.0006) [2023-12-28 04:19:39,778][106225] Updated weights for policy 1, policy_version 1265104 (0.0010) [2023-12-28 04:19:39,835][106225] Updated weights for policy 1, policy_version 1265114 (0.0010) [2023-12-28 04:19:39,883][106226] Updated weights for policy 0, policy_version 1261947 (0.0007) [2023-12-28 04:19:39,898][106225] Updated weights for policy 1, policy_version 1265124 (0.0011) [2023-12-28 04:19:39,951][106226] Updated weights for policy 0, policy_version 1261957 (0.0009) [2023-12-28 04:19:40,006][106226] Updated weights for policy 0, policy_version 1261967 (0.0009) [2023-12-28 04:19:40,649][106225] Updated weights for policy 1, policy_version 1265134 (0.0010) [2023-12-28 04:19:40,715][106225] Updated weights for policy 1, policy_version 1265144 (0.0011) [2023-12-28 04:19:40,746][106226] Updated weights for policy 0, policy_version 1261977 (0.0007) [2023-12-28 04:19:40,783][106225] Updated weights for policy 1, policy_version 1265154 (0.0010) [2023-12-28 04:19:40,791][106226] Updated weights for policy 0, policy_version 1261987 (0.0007) [2023-12-28 04:19:40,851][106226] Updated weights for policy 0, policy_version 1261997 (0.0006) [2023-12-28 04:19:40,907][106226] Updated weights for policy 0, policy_version 1262007 (0.0006) [2023-12-28 04:19:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 647061504. Throughput: 0: 10127.6, 1: 9890.7. Samples: 647031292. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:41,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.722')] [2023-12-28 04:19:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001265160_323928064.pth... [2023-12-28 04:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001262008_323133440.pth... [2023-12-28 04:19:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001260824_322830336.pth [2023-12-28 04:19:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001264008_323633152.pth [2023-12-28 04:19:41,504][106225] Updated weights for policy 1, policy_version 1265164 (0.0010) [2023-12-28 04:19:41,571][106225] Updated weights for policy 1, policy_version 1265174 (0.0008) [2023-12-28 04:19:41,593][106226] Updated weights for policy 0, policy_version 1262017 (0.0008) [2023-12-28 04:19:41,636][106225] Updated weights for policy 1, policy_version 1265184 (0.0007) [2023-12-28 04:19:41,670][106226] Updated weights for policy 0, policy_version 1262027 (0.0008) [2023-12-28 04:19:41,732][106226] Updated weights for policy 0, policy_version 1262037 (0.0007) [2023-12-28 04:19:42,430][106226] Updated weights for policy 0, policy_version 1262047 (0.0008) [2023-12-28 04:19:42,449][106225] Updated weights for policy 1, policy_version 1265194 (0.0008) [2023-12-28 04:19:42,487][106226] Updated weights for policy 0, policy_version 1262057 (0.0006) [2023-12-28 04:19:42,504][106225] Updated weights for policy 1, policy_version 1265204 (0.0008) [2023-12-28 04:19:42,547][106226] Updated weights for policy 0, policy_version 1262067 (0.0007) [2023-12-28 04:19:42,563][106225] Updated weights for policy 1, policy_version 1265214 (0.0008) [2023-12-28 04:19:42,626][106225] Updated weights for policy 1, policy_version 1265224 (0.0011) [2023-12-28 04:19:43,322][106225] Updated weights for policy 1, policy_version 1265234 (0.0008) [2023-12-28 04:19:43,335][106226] Updated weights for policy 0, policy_version 1262077 (0.0007) [2023-12-28 04:19:43,386][106225] Updated weights for policy 1, policy_version 1265244 (0.0007) [2023-12-28 04:19:43,400][106226] Updated weights for policy 0, policy_version 1262087 (0.0006) [2023-12-28 04:19:43,434][106225] Updated weights for policy 1, policy_version 1265254 (0.0006) [2023-12-28 04:19:43,455][106226] Updated weights for policy 0, policy_version 1262097 (0.0006) [2023-12-28 04:19:44,080][106225] Updated weights for policy 1, policy_version 1265264 (0.0010) [2023-12-28 04:19:44,143][106226] Updated weights for policy 0, policy_version 1262107 (0.0009) [2023-12-28 04:19:44,148][106225] Updated weights for policy 1, policy_version 1265274 (0.0010) [2023-12-28 04:19:44,190][106226] Updated weights for policy 0, policy_version 1262117 (0.0011) [2023-12-28 04:19:44,202][106225] Updated weights for policy 1, policy_version 1265284 (0.0010) [2023-12-28 04:19:44,241][106226] Updated weights for policy 0, policy_version 1262127 (0.0011) [2023-12-28 04:19:44,898][106225] Updated weights for policy 1, policy_version 1265294 (0.0009) [2023-12-28 04:19:44,945][106225] Updated weights for policy 1, policy_version 1265304 (0.0008) [2023-12-28 04:19:44,979][106226] Updated weights for policy 0, policy_version 1262137 (0.0010) [2023-12-28 04:19:45,000][106225] Updated weights for policy 1, policy_version 1265314 (0.0008) [2023-12-28 04:19:45,038][106226] Updated weights for policy 0, policy_version 1262147 (0.0010) [2023-12-28 04:19:45,104][106226] Updated weights for policy 0, policy_version 1262157 (0.0010) [2023-12-28 04:19:45,165][106226] Updated weights for policy 0, policy_version 1262167 (0.0011) [2023-12-28 04:19:45,763][106225] Updated weights for policy 1, policy_version 1265324 (0.0008) [2023-12-28 04:19:45,816][106225] Updated weights for policy 1, policy_version 1265334 (0.0010) [2023-12-28 04:19:45,859][106226] Updated weights for policy 0, policy_version 1262177 (0.0006) [2023-12-28 04:19:45,862][106225] Updated weights for policy 1, policy_version 1265344 (0.0010) [2023-12-28 04:19:45,915][106226] Updated weights for policy 0, policy_version 1262187 (0.0007) [2023-12-28 04:19:45,961][106226] Updated weights for policy 0, policy_version 1262197 (0.0008) [2023-12-28 04:19:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 647159808. Throughput: 0: 10052.7, 1: 9895.9. Samples: 647146292. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:46,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.893')] [2023-12-28 04:19:46,524][106225] Updated weights for policy 1, policy_version 1265354 (0.0008) [2023-12-28 04:19:46,580][106225] Updated weights for policy 1, policy_version 1265364 (0.0005) [2023-12-28 04:19:46,639][106225] Updated weights for policy 1, policy_version 1265374 (0.0006) [2023-12-28 04:19:46,699][106225] Updated weights for policy 1, policy_version 1265384 (0.0007) [2023-12-28 04:19:46,735][106226] Updated weights for policy 0, policy_version 1262207 (0.0007) [2023-12-28 04:19:46,785][106226] Updated weights for policy 0, policy_version 1262217 (0.0009) [2023-12-28 04:19:46,843][106226] Updated weights for policy 0, policy_version 1262227 (0.0006) [2023-12-28 04:19:47,307][106225] Updated weights for policy 1, policy_version 1265394 (0.0006) [2023-12-28 04:19:47,367][106225] Updated weights for policy 1, policy_version 1265404 (0.0006) [2023-12-28 04:19:47,418][106225] Updated weights for policy 1, policy_version 1265414 (0.0008) [2023-12-28 04:19:47,536][106226] Updated weights for policy 0, policy_version 1262237 (0.0005) [2023-12-28 04:19:47,591][106226] Updated weights for policy 0, policy_version 1262247 (0.0005) [2023-12-28 04:19:47,655][106226] Updated weights for policy 0, policy_version 1262257 (0.0007) [2023-12-28 04:19:47,992][106225] Updated weights for policy 1, policy_version 1265424 (0.0009) [2023-12-28 04:19:48,049][106225] Updated weights for policy 1, policy_version 1265434 (0.0009) [2023-12-28 04:19:48,118][106225] Updated weights for policy 1, policy_version 1265444 (0.0008) [2023-12-28 04:19:48,195][106226] Updated weights for policy 0, policy_version 1262267 (0.0006) [2023-12-28 04:19:48,244][106226] Updated weights for policy 0, policy_version 1262277 (0.0005) [2023-12-28 04:19:48,293][106226] Updated weights for policy 0, policy_version 1262287 (0.0005) [2023-12-28 04:19:48,861][106225] Updated weights for policy 1, policy_version 1265454 (0.0010) [2023-12-28 04:19:48,919][106225] Updated weights for policy 1, policy_version 1265464 (0.0010) [2023-12-28 04:19:48,987][106225] Updated weights for policy 1, policy_version 1265474 (0.0009) [2023-12-28 04:19:48,990][106226] Updated weights for policy 0, policy_version 1262297 (0.0008) [2023-12-28 04:19:49,044][106226] Updated weights for policy 0, policy_version 1262307 (0.0007) [2023-12-28 04:19:49,105][106226] Updated weights for policy 0, policy_version 1262317 (0.0007) [2023-12-28 04:19:49,156][106226] Updated weights for policy 0, policy_version 1262327 (0.0008) [2023-12-28 04:19:49,787][106225] Updated weights for policy 1, policy_version 1265484 (0.0009) [2023-12-28 04:19:49,852][106225] Updated weights for policy 1, policy_version 1265494 (0.0011) [2023-12-28 04:19:49,923][106225] Updated weights for policy 1, policy_version 1265504 (0.0008) [2023-12-28 04:19:49,929][106226] Updated weights for policy 0, policy_version 1262337 (0.0007) [2023-12-28 04:19:49,979][106226] Updated weights for policy 0, policy_version 1262347 (0.0007) [2023-12-28 04:19:50,029][106226] Updated weights for policy 0, policy_version 1262357 (0.0007) [2023-12-28 04:19:50,627][106225] Updated weights for policy 1, policy_version 1265514 (0.0009) [2023-12-28 04:19:50,687][106225] Updated weights for policy 1, policy_version 1265524 (0.0008) [2023-12-28 04:19:50,742][106225] Updated weights for policy 1, policy_version 1265534 (0.0009) [2023-12-28 04:19:50,787][106226] Updated weights for policy 0, policy_version 1262367 (0.0007) [2023-12-28 04:19:50,802][106225] Updated weights for policy 1, policy_version 1265544 (0.0008) [2023-12-28 04:19:50,833][106226] Updated weights for policy 0, policy_version 1262377 (0.0008) [2023-12-28 04:19:50,883][106226] Updated weights for policy 0, policy_version 1262387 (0.0005) [2023-12-28 04:19:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 647258112. Throughput: 0: 10045.0, 1: 9864.2. Samples: 647265740. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:51,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-5.245')] [2023-12-28 04:19:51,519][106225] Updated weights for policy 1, policy_version 1265554 (0.0010) [2023-12-28 04:19:51,588][106225] Updated weights for policy 1, policy_version 1265564 (0.0011) [2023-12-28 04:19:51,633][106226] Updated weights for policy 0, policy_version 1262397 (0.0006) [2023-12-28 04:19:51,659][106225] Updated weights for policy 1, policy_version 1265574 (0.0010) [2023-12-28 04:19:51,700][106226] Updated weights for policy 0, policy_version 1262407 (0.0007) [2023-12-28 04:19:51,770][106226] Updated weights for policy 0, policy_version 1262417 (0.0009) [2023-12-28 04:19:52,321][106225] Updated weights for policy 1, policy_version 1265584 (0.0008) [2023-12-28 04:19:52,391][106225] Updated weights for policy 1, policy_version 1265594 (0.0011) [2023-12-28 04:19:52,446][106225] Updated weights for policy 1, policy_version 1265604 (0.0009) [2023-12-28 04:19:52,459][106226] Updated weights for policy 0, policy_version 1262427 (0.0007) [2023-12-28 04:19:52,516][106226] Updated weights for policy 0, policy_version 1262437 (0.0007) [2023-12-28 04:19:52,568][106226] Updated weights for policy 0, policy_version 1262447 (0.0006) [2023-12-28 04:19:53,162][106225] Updated weights for policy 1, policy_version 1265614 (0.0010) [2023-12-28 04:19:53,218][106225] Updated weights for policy 1, policy_version 1265624 (0.0010) [2023-12-28 04:19:53,281][106225] Updated weights for policy 1, policy_version 1265634 (0.0010) [2023-12-28 04:19:53,289][106226] Updated weights for policy 0, policy_version 1262457 (0.0009) [2023-12-28 04:19:53,345][106226] Updated weights for policy 0, policy_version 1262467 (0.0007) [2023-12-28 04:19:53,397][106226] Updated weights for policy 0, policy_version 1262477 (0.0007) [2023-12-28 04:19:53,457][106226] Updated weights for policy 0, policy_version 1262487 (0.0008) [2023-12-28 04:19:53,990][106225] Updated weights for policy 1, policy_version 1265644 (0.0009) [2023-12-28 04:19:54,048][106225] Updated weights for policy 1, policy_version 1265654 (0.0006) [2023-12-28 04:19:54,109][106225] Updated weights for policy 1, policy_version 1265664 (0.0009) [2023-12-28 04:19:54,200][106226] Updated weights for policy 0, policy_version 1262497 (0.0007) [2023-12-28 04:19:54,263][106226] Updated weights for policy 0, policy_version 1262507 (0.0010) [2023-12-28 04:19:54,331][106226] Updated weights for policy 0, policy_version 1262517 (0.0006) [2023-12-28 04:19:54,728][106225] Updated weights for policy 1, policy_version 1265674 (0.0007) [2023-12-28 04:19:54,783][106225] Updated weights for policy 1, policy_version 1265684 (0.0008) [2023-12-28 04:19:54,843][106225] Updated weights for policy 1, policy_version 1265694 (0.0008) [2023-12-28 04:19:54,983][106226] Updated weights for policy 0, policy_version 1262527 (0.0007) [2023-12-28 04:19:55,051][106226] Updated weights for policy 0, policy_version 1262537 (0.0007) [2023-12-28 04:19:55,109][106226] Updated weights for policy 0, policy_version 1262547 (0.0006) [2023-12-28 04:19:55,538][106225] Updated weights for policy 1, policy_version 1265705 (0.0009) [2023-12-28 04:19:55,594][106225] Updated weights for policy 1, policy_version 1265715 (0.0010) [2023-12-28 04:19:55,657][106225] Updated weights for policy 1, policy_version 1265725 (0.0010) [2023-12-28 04:19:55,708][106226] Updated weights for policy 0, policy_version 1262557 (0.0010) [2023-12-28 04:19:55,713][106225] Updated weights for policy 1, policy_version 1265735 (0.0010) [2023-12-28 04:19:55,759][106226] Updated weights for policy 0, policy_version 1262567 (0.0010) [2023-12-28 04:19:55,816][106226] Updated weights for policy 0, policy_version 1262577 (0.0010) [2023-12-28 04:19:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 647356416. Throughput: 0: 9957.3, 1: 9917.8. Samples: 647323244. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:19:56,175][105115] Avg episode reward: [(0, '-4.167'), (1, '-5.023')] [2023-12-28 04:19:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001262584_323280896.pth... [2023-12-28 04:19:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001265736_324075520.pth... [2023-12-28 04:19:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001261400_322977792.pth [2023-12-28 04:19:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001264584_323780608.pth [2023-12-28 04:19:56,437][106225] Updated weights for policy 1, policy_version 1265745 (0.0011) [2023-12-28 04:19:56,488][106226] Updated weights for policy 0, policy_version 1262587 (0.0010) [2023-12-28 04:19:56,493][106225] Updated weights for policy 1, policy_version 1265755 (0.0010) [2023-12-28 04:19:56,539][106226] Updated weights for policy 0, policy_version 1262597 (0.0010) [2023-12-28 04:19:56,544][106225] Updated weights for policy 1, policy_version 1265765 (0.0010) [2023-12-28 04:19:56,588][106226] Updated weights for policy 0, policy_version 1262607 (0.0010) [2023-12-28 04:19:57,265][106225] Updated weights for policy 1, policy_version 1265775 (0.0010) [2023-12-28 04:19:57,307][106226] Updated weights for policy 0, policy_version 1262617 (0.0007) [2023-12-28 04:19:57,320][106225] Updated weights for policy 1, policy_version 1265785 (0.0009) [2023-12-28 04:19:57,366][106226] Updated weights for policy 0, policy_version 1262627 (0.0007) [2023-12-28 04:19:57,371][106225] Updated weights for policy 1, policy_version 1265795 (0.0009) [2023-12-28 04:19:57,420][106226] Updated weights for policy 0, policy_version 1262637 (0.0007) [2023-12-28 04:19:57,465][106226] Updated weights for policy 0, policy_version 1262647 (0.0007) [2023-12-28 04:19:58,070][106225] Updated weights for policy 1, policy_version 1265805 (0.0010) [2023-12-28 04:19:58,101][106226] Updated weights for policy 0, policy_version 1262657 (0.0010) [2023-12-28 04:19:58,116][106225] Updated weights for policy 1, policy_version 1265815 (0.0010) [2023-12-28 04:19:58,161][106226] Updated weights for policy 0, policy_version 1262667 (0.0007) [2023-12-28 04:19:58,162][106225] Updated weights for policy 1, policy_version 1265825 (0.0010) [2023-12-28 04:19:58,226][106226] Updated weights for policy 0, policy_version 1262677 (0.0006) [2023-12-28 04:19:59,044][106226] Updated weights for policy 0, policy_version 1262687 (0.0008) [2023-12-28 04:19:59,061][106225] Updated weights for policy 1, policy_version 1265835 (0.0010) [2023-12-28 04:19:59,112][106226] Updated weights for policy 0, policy_version 1262697 (0.0008) [2023-12-28 04:19:59,127][106225] Updated weights for policy 1, policy_version 1265845 (0.0009) [2023-12-28 04:19:59,180][106226] Updated weights for policy 0, policy_version 1262707 (0.0008) [2023-12-28 04:19:59,198][106225] Updated weights for policy 1, policy_version 1265855 (0.0009) [2023-12-28 04:19:59,930][106225] Updated weights for policy 1, policy_version 1265865 (0.0008) [2023-12-28 04:19:59,991][106226] Updated weights for policy 0, policy_version 1262717 (0.0007) [2023-12-28 04:19:59,998][106225] Updated weights for policy 1, policy_version 1265875 (0.0008) [2023-12-28 04:20:00,053][106226] Updated weights for policy 0, policy_version 1262727 (0.0008) [2023-12-28 04:20:00,056][106225] Updated weights for policy 1, policy_version 1265885 (0.0006) [2023-12-28 04:20:00,113][106226] Updated weights for policy 0, policy_version 1262737 (0.0009) [2023-12-28 04:20:00,115][106225] Updated weights for policy 1, policy_version 1265895 (0.0008) [2023-12-28 04:20:00,731][106226] Updated weights for policy 0, policy_version 1262747 (0.0008) [2023-12-28 04:20:00,759][106225] Updated weights for policy 1, policy_version 1265905 (0.0010) [2023-12-28 04:20:00,789][106226] Updated weights for policy 0, policy_version 1262757 (0.0005) [2023-12-28 04:20:00,817][106225] Updated weights for policy 1, policy_version 1265915 (0.0008) [2023-12-28 04:20:00,844][106226] Updated weights for policy 0, policy_version 1262767 (0.0005) [2023-12-28 04:20:00,875][106225] Updated weights for policy 1, policy_version 1265925 (0.0005) [2023-12-28 04:20:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 647454720. Throughput: 0: 9976.7, 1: 9831.1. Samples: 647440616. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:01,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.255')] [2023-12-28 04:20:01,564][106226] Updated weights for policy 0, policy_version 1262777 (0.0006) [2023-12-28 04:20:01,597][106225] Updated weights for policy 1, policy_version 1265935 (0.0009) [2023-12-28 04:20:01,622][106226] Updated weights for policy 0, policy_version 1262787 (0.0007) [2023-12-28 04:20:01,665][106225] Updated weights for policy 1, policy_version 1265945 (0.0008) [2023-12-28 04:20:01,690][106226] Updated weights for policy 0, policy_version 1262797 (0.0007) [2023-12-28 04:20:01,730][106225] Updated weights for policy 1, policy_version 1265955 (0.0009) [2023-12-28 04:20:01,756][106226] Updated weights for policy 0, policy_version 1262807 (0.0008) [2023-12-28 04:20:02,393][106225] Updated weights for policy 1, policy_version 1265965 (0.0005) [2023-12-28 04:20:02,440][106225] Updated weights for policy 1, policy_version 1265975 (0.0007) [2023-12-28 04:20:02,483][106226] Updated weights for policy 0, policy_version 1262817 (0.0009) [2023-12-28 04:20:02,495][106225] Updated weights for policy 1, policy_version 1265985 (0.0006) [2023-12-28 04:20:02,548][106226] Updated weights for policy 0, policy_version 1262827 (0.0007) [2023-12-28 04:20:02,597][106226] Updated weights for policy 0, policy_version 1262837 (0.0005) [2023-12-28 04:20:03,173][106226] Updated weights for policy 0, policy_version 1262847 (0.0005) [2023-12-28 04:20:03,230][106226] Updated weights for policy 0, policy_version 1262857 (0.0006) [2023-12-28 04:20:03,281][106226] Updated weights for policy 0, policy_version 1262867 (0.0009) [2023-12-28 04:20:03,282][106225] Updated weights for policy 1, policy_version 1265995 (0.0007) [2023-12-28 04:20:03,329][106225] Updated weights for policy 1, policy_version 1266005 (0.0006) [2023-12-28 04:20:03,385][106225] Updated weights for policy 1, policy_version 1266015 (0.0007) [2023-12-28 04:20:03,942][106226] Updated weights for policy 0, policy_version 1262877 (0.0010) [2023-12-28 04:20:03,996][106226] Updated weights for policy 0, policy_version 1262887 (0.0009) [2023-12-28 04:20:04,051][106226] Updated weights for policy 0, policy_version 1262897 (0.0008) [2023-12-28 04:20:04,091][106225] Updated weights for policy 1, policy_version 1266025 (0.0008) [2023-12-28 04:20:04,146][106225] Updated weights for policy 1, policy_version 1266035 (0.0009) [2023-12-28 04:20:04,202][106225] Updated weights for policy 1, policy_version 1266045 (0.0009) [2023-12-28 04:20:04,271][106225] Updated weights for policy 1, policy_version 1266055 (0.0008) [2023-12-28 04:20:04,736][106226] Updated weights for policy 0, policy_version 1262907 (0.0009) [2023-12-28 04:20:04,793][106226] Updated weights for policy 0, policy_version 1262917 (0.0008) [2023-12-28 04:20:04,838][106226] Updated weights for policy 0, policy_version 1262927 (0.0008) [2023-12-28 04:20:05,026][106225] Updated weights for policy 1, policy_version 1266065 (0.0008) [2023-12-28 04:20:05,077][106225] Updated weights for policy 1, policy_version 1266075 (0.0008) [2023-12-28 04:20:05,128][106225] Updated weights for policy 1, policy_version 1266085 (0.0008) [2023-12-28 04:20:05,467][106226] Updated weights for policy 0, policy_version 1262937 (0.0008) [2023-12-28 04:20:05,515][106226] Updated weights for policy 0, policy_version 1262947 (0.0008) [2023-12-28 04:20:05,562][106226] Updated weights for policy 0, policy_version 1262957 (0.0008) [2023-12-28 04:20:05,624][106226] Updated weights for policy 0, policy_version 1262967 (0.0005) [2023-12-28 04:20:05,932][106225] Updated weights for policy 1, policy_version 1266095 (0.0008) [2023-12-28 04:20:05,984][106225] Updated weights for policy 1, policy_version 1266105 (0.0007) [2023-12-28 04:20:06,048][106225] Updated weights for policy 1, policy_version 1266115 (0.0008) [2023-12-28 04:20:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 647553024. Throughput: 0: 10012.5, 1: 9849.6. Samples: 647561920. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:06,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-5.045')] [2023-12-28 04:20:06,283][106226] Updated weights for policy 0, policy_version 1262977 (0.0010) [2023-12-28 04:20:06,347][106226] Updated weights for policy 0, policy_version 1262987 (0.0010) [2023-12-28 04:20:06,418][106226] Updated weights for policy 0, policy_version 1262997 (0.0010) [2023-12-28 04:20:06,778][106225] Updated weights for policy 1, policy_version 1266125 (0.0008) [2023-12-28 04:20:06,835][106225] Updated weights for policy 1, policy_version 1266135 (0.0008) [2023-12-28 04:20:06,893][106225] Updated weights for policy 1, policy_version 1266145 (0.0008) [2023-12-28 04:20:07,117][106226] Updated weights for policy 0, policy_version 1263007 (0.0011) [2023-12-28 04:20:07,176][106226] Updated weights for policy 0, policy_version 1263017 (0.0011) [2023-12-28 04:20:07,241][106226] Updated weights for policy 0, policy_version 1263027 (0.0011) [2023-12-28 04:20:07,567][106225] Updated weights for policy 1, policy_version 1266155 (0.0008) [2023-12-28 04:20:07,614][106225] Updated weights for policy 1, policy_version 1266165 (0.0008) [2023-12-28 04:20:07,666][106225] Updated weights for policy 1, policy_version 1266175 (0.0008) [2023-12-28 04:20:07,923][106226] Updated weights for policy 0, policy_version 1263037 (0.0010) [2023-12-28 04:20:07,980][106226] Updated weights for policy 0, policy_version 1263047 (0.0010) [2023-12-28 04:20:08,031][106226] Updated weights for policy 0, policy_version 1263057 (0.0011) [2023-12-28 04:20:08,331][106225] Updated weights for policy 1, policy_version 1266185 (0.0008) [2023-12-28 04:20:08,397][106225] Updated weights for policy 1, policy_version 1266195 (0.0009) [2023-12-28 04:20:08,448][106225] Updated weights for policy 1, policy_version 1266205 (0.0009) [2023-12-28 04:20:08,499][106225] Updated weights for policy 1, policy_version 1266215 (0.0008) [2023-12-28 04:20:08,672][106226] Updated weights for policy 0, policy_version 1263067 (0.0011) [2023-12-28 04:20:08,727][106226] Updated weights for policy 0, policy_version 1263077 (0.0010) [2023-12-28 04:20:08,780][106226] Updated weights for policy 0, policy_version 1263087 (0.0010) [2023-12-28 04:20:09,332][106225] Updated weights for policy 1, policy_version 1266225 (0.0008) [2023-12-28 04:20:09,397][106225] Updated weights for policy 1, policy_version 1266235 (0.0008) [2023-12-28 04:20:09,467][106225] Updated weights for policy 1, policy_version 1266245 (0.0007) [2023-12-28 04:20:09,512][106226] Updated weights for policy 0, policy_version 1263097 (0.0006) [2023-12-28 04:20:09,575][106226] Updated weights for policy 0, policy_version 1263107 (0.0008) [2023-12-28 04:20:09,636][106226] Updated weights for policy 0, policy_version 1263117 (0.0008) [2023-12-28 04:20:09,702][106226] Updated weights for policy 0, policy_version 1263127 (0.0006) [2023-12-28 04:20:10,231][106225] Updated weights for policy 1, policy_version 1266255 (0.0008) [2023-12-28 04:20:10,297][106225] Updated weights for policy 1, policy_version 1266265 (0.0010) [2023-12-28 04:20:10,356][106225] Updated weights for policy 1, policy_version 1266275 (0.0009) [2023-12-28 04:20:10,434][106226] Updated weights for policy 0, policy_version 1263137 (0.0008) [2023-12-28 04:20:10,498][106226] Updated weights for policy 0, policy_version 1263147 (0.0008) [2023-12-28 04:20:10,563][106226] Updated weights for policy 0, policy_version 1263157 (0.0006) [2023-12-28 04:20:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 647643136. Throughput: 0: 10074.5, 1: 9846.8. Samples: 647622216. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:11,175][105115] Avg episode reward: [(0, '-4.092'), (1, '-5.253')] [2023-12-28 04:20:11,179][106226] Updated weights for policy 0, policy_version 1263167 (0.0009) [2023-12-28 04:20:11,196][106225] Updated weights for policy 1, policy_version 1266285 (0.0007) [2023-12-28 04:20:11,257][106226] Updated weights for policy 0, policy_version 1263177 (0.0009) [2023-12-28 04:20:11,266][106225] Updated weights for policy 1, policy_version 1266295 (0.0008) [2023-12-28 04:20:11,327][106226] Updated weights for policy 0, policy_version 1263187 (0.0009) [2023-12-28 04:20:11,334][106225] Updated weights for policy 1, policy_version 1266305 (0.0007) [2023-12-28 04:20:11,360][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001263192_323436544.pth... [2023-12-28 04:20:11,369][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001262008_323133440.pth [2023-12-28 04:20:11,381][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001266312_324222976.pth... [2023-12-28 04:20:11,385][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001265160_323928064.pth [2023-12-28 04:20:11,994][106226] Updated weights for policy 0, policy_version 1263197 (0.0008) [2023-12-28 04:20:12,028][106225] Updated weights for policy 1, policy_version 1266315 (0.0007) [2023-12-28 04:20:12,056][106226] Updated weights for policy 0, policy_version 1263207 (0.0007) [2023-12-28 04:20:12,094][106225] Updated weights for policy 1, policy_version 1266325 (0.0008) [2023-12-28 04:20:12,125][106226] Updated weights for policy 0, policy_version 1263217 (0.0006) [2023-12-28 04:20:12,156][106225] Updated weights for policy 1, policy_version 1266335 (0.0008) [2023-12-28 04:20:12,813][106226] Updated weights for policy 0, policy_version 1263227 (0.0008) [2023-12-28 04:20:12,868][106226] Updated weights for policy 0, policy_version 1263237 (0.0008) [2023-12-28 04:20:12,900][106225] Updated weights for policy 1, policy_version 1266345 (0.0007) [2023-12-28 04:20:12,920][106226] Updated weights for policy 0, policy_version 1263247 (0.0009) [2023-12-28 04:20:12,958][106225] Updated weights for policy 1, policy_version 1266355 (0.0007) [2023-12-28 04:20:13,016][106225] Updated weights for policy 1, policy_version 1266365 (0.0008) [2023-12-28 04:20:13,073][106225] Updated weights for policy 1, policy_version 1266375 (0.0008) [2023-12-28 04:20:13,633][106226] Updated weights for policy 0, policy_version 1263257 (0.0007) [2023-12-28 04:20:13,694][106226] Updated weights for policy 0, policy_version 1263267 (0.0008) [2023-12-28 04:20:13,754][106226] Updated weights for policy 0, policy_version 1263277 (0.0008) [2023-12-28 04:20:13,798][106225] Updated weights for policy 1, policy_version 1266385 (0.0010) [2023-12-28 04:20:13,801][106226] Updated weights for policy 0, policy_version 1263287 (0.0005) [2023-12-28 04:20:13,858][106225] Updated weights for policy 1, policy_version 1266395 (0.0010) [2023-12-28 04:20:13,920][106225] Updated weights for policy 1, policy_version 1266405 (0.0010) [2023-12-28 04:20:14,542][106226] Updated weights for policy 0, policy_version 1263297 (0.0008) [2023-12-28 04:20:14,596][106226] Updated weights for policy 0, policy_version 1263307 (0.0007) [2023-12-28 04:20:14,639][106225] Updated weights for policy 1, policy_version 1266415 (0.0007) [2023-12-28 04:20:14,659][106226] Updated weights for policy 0, policy_version 1263317 (0.0008) [2023-12-28 04:20:14,701][106225] Updated weights for policy 1, policy_version 1266425 (0.0005) [2023-12-28 04:20:14,769][106225] Updated weights for policy 1, policy_version 1266435 (0.0008) [2023-12-28 04:20:15,373][106226] Updated weights for policy 0, policy_version 1263327 (0.0009) [2023-12-28 04:20:15,426][106226] Updated weights for policy 0, policy_version 1263337 (0.0009) [2023-12-28 04:20:15,462][106225] Updated weights for policy 1, policy_version 1266445 (0.0007) [2023-12-28 04:20:15,483][106226] Updated weights for policy 0, policy_version 1263347 (0.0008) [2023-12-28 04:20:15,513][106225] Updated weights for policy 1, policy_version 1266455 (0.0006) [2023-12-28 04:20:15,567][106225] Updated weights for policy 1, policy_version 1266465 (0.0008) [2023-12-28 04:20:16,141][106226] Updated weights for policy 0, policy_version 1263357 (0.0008) [2023-12-28 04:20:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 647741440. Throughput: 0: 10032.7, 1: 9750.3. Samples: 647736656. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:16,175][105115] Avg episode reward: [(0, '-4.030'), (1, '-5.259')] [2023-12-28 04:20:16,189][106226] Updated weights for policy 0, policy_version 1263367 (0.0008) [2023-12-28 04:20:16,239][106226] Updated weights for policy 0, policy_version 1263377 (0.0008) [2023-12-28 04:20:16,325][106225] Updated weights for policy 1, policy_version 1266475 (0.0009) [2023-12-28 04:20:16,373][106225] Updated weights for policy 1, policy_version 1266485 (0.0008) [2023-12-28 04:20:16,425][106225] Updated weights for policy 1, policy_version 1266495 (0.0008) [2023-12-28 04:20:16,899][106226] Updated weights for policy 0, policy_version 1263387 (0.0008) [2023-12-28 04:20:16,954][106226] Updated weights for policy 0, policy_version 1263397 (0.0008) [2023-12-28 04:20:17,022][106226] Updated weights for policy 0, policy_version 1263407 (0.0006) [2023-12-28 04:20:17,167][106225] Updated weights for policy 1, policy_version 1266505 (0.0008) [2023-12-28 04:20:17,228][106225] Updated weights for policy 1, policy_version 1266515 (0.0008) [2023-12-28 04:20:17,288][106225] Updated weights for policy 1, policy_version 1266525 (0.0006) [2023-12-28 04:20:17,353][106225] Updated weights for policy 1, policy_version 1266535 (0.0005) [2023-12-28 04:20:17,726][106226] Updated weights for policy 0, policy_version 1263417 (0.0008) [2023-12-28 04:20:17,773][106226] Updated weights for policy 0, policy_version 1263427 (0.0005) [2023-12-28 04:20:17,826][106226] Updated weights for policy 0, policy_version 1263437 (0.0005) [2023-12-28 04:20:17,888][106226] Updated weights for policy 0, policy_version 1263447 (0.0005) [2023-12-28 04:20:17,942][106225] Updated weights for policy 1, policy_version 1266545 (0.0008) [2023-12-28 04:20:17,991][106225] Updated weights for policy 1, policy_version 1266555 (0.0008) [2023-12-28 04:20:18,040][106225] Updated weights for policy 1, policy_version 1266565 (0.0008) [2023-12-28 04:20:18,581][106226] Updated weights for policy 0, policy_version 1263457 (0.0008) [2023-12-28 04:20:18,637][106226] Updated weights for policy 0, policy_version 1263467 (0.0008) [2023-12-28 04:20:18,697][106226] Updated weights for policy 0, policy_version 1263477 (0.0009) [2023-12-28 04:20:18,740][106225] Updated weights for policy 1, policy_version 1266575 (0.0007) [2023-12-28 04:20:18,800][106225] Updated weights for policy 1, policy_version 1266585 (0.0008) [2023-12-28 04:20:18,862][106225] Updated weights for policy 1, policy_version 1266595 (0.0009) [2023-12-28 04:20:19,470][106226] Updated weights for policy 0, policy_version 1263487 (0.0006) [2023-12-28 04:20:19,538][106226] Updated weights for policy 0, policy_version 1263497 (0.0007) [2023-12-28 04:20:19,592][106225] Updated weights for policy 1, policy_version 1266605 (0.0009) [2023-12-28 04:20:19,598][106226] Updated weights for policy 0, policy_version 1263507 (0.0006) [2023-12-28 04:20:19,660][106225] Updated weights for policy 1, policy_version 1266615 (0.0010) [2023-12-28 04:20:19,723][106225] Updated weights for policy 1, policy_version 1266625 (0.0010) [2023-12-28 04:20:20,308][106226] Updated weights for policy 0, policy_version 1263517 (0.0007) [2023-12-28 04:20:20,375][106226] Updated weights for policy 0, policy_version 1263527 (0.0009) [2023-12-28 04:20:20,420][106225] Updated weights for policy 1, policy_version 1266635 (0.0008) [2023-12-28 04:20:20,434][106226] Updated weights for policy 0, policy_version 1263537 (0.0008) [2023-12-28 04:20:20,482][106225] Updated weights for policy 1, policy_version 1266645 (0.0007) [2023-12-28 04:20:20,545][106225] Updated weights for policy 1, policy_version 1266655 (0.0008) [2023-12-28 04:20:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 647839744. Throughput: 0: 9939.9, 1: 9678.3. Samples: 647853344. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:21,175][105115] Avg episode reward: [(0, '-4.066'), (1, '-4.804')] [2023-12-28 04:20:21,187][106226] Updated weights for policy 0, policy_version 1263547 (0.0010) [2023-12-28 04:20:21,247][106226] Updated weights for policy 0, policy_version 1263557 (0.0009) [2023-12-28 04:20:21,283][106225] Updated weights for policy 1, policy_version 1266665 (0.0006) [2023-12-28 04:20:21,315][106226] Updated weights for policy 0, policy_version 1263567 (0.0008) [2023-12-28 04:20:21,344][106225] Updated weights for policy 1, policy_version 1266675 (0.0007) [2023-12-28 04:20:21,412][106225] Updated weights for policy 1, policy_version 1266685 (0.0007) [2023-12-28 04:20:21,462][106225] Updated weights for policy 1, policy_version 1266695 (0.0006) [2023-12-28 04:20:22,116][106226] Updated weights for policy 0, policy_version 1263577 (0.0008) [2023-12-28 04:20:22,122][106225] Updated weights for policy 1, policy_version 1266705 (0.0008) [2023-12-28 04:20:22,175][106226] Updated weights for policy 0, policy_version 1263587 (0.0008) [2023-12-28 04:20:22,183][106225] Updated weights for policy 1, policy_version 1266715 (0.0006) [2023-12-28 04:20:22,231][106226] Updated weights for policy 0, policy_version 1263597 (0.0006) [2023-12-28 04:20:22,241][106225] Updated weights for policy 1, policy_version 1266725 (0.0008) [2023-12-28 04:20:22,304][106226] Updated weights for policy 0, policy_version 1263607 (0.0009) [2023-12-28 04:20:22,969][106226] Updated weights for policy 0, policy_version 1263617 (0.0010) [2023-12-28 04:20:23,017][106225] Updated weights for policy 1, policy_version 1266735 (0.0006) [2023-12-28 04:20:23,027][106226] Updated weights for policy 0, policy_version 1263627 (0.0011) [2023-12-28 04:20:23,077][106225] Updated weights for policy 1, policy_version 1266745 (0.0006) [2023-12-28 04:20:23,083][106226] Updated weights for policy 0, policy_version 1263637 (0.0011) [2023-12-28 04:20:23,131][106225] Updated weights for policy 1, policy_version 1266755 (0.0007) [2023-12-28 04:20:23,781][106225] Updated weights for policy 1, policy_version 1266765 (0.0007) [2023-12-28 04:20:23,802][106226] Updated weights for policy 0, policy_version 1263647 (0.0010) [2023-12-28 04:20:23,835][106225] Updated weights for policy 1, policy_version 1266775 (0.0005) [2023-12-28 04:20:23,855][106226] Updated weights for policy 0, policy_version 1263657 (0.0011) [2023-12-28 04:20:23,888][106225] Updated weights for policy 1, policy_version 1266785 (0.0006) [2023-12-28 04:20:23,908][106226] Updated weights for policy 0, policy_version 1263667 (0.0011) [2023-12-28 04:20:24,511][106225] Updated weights for policy 1, policy_version 1266795 (0.0006) [2023-12-28 04:20:24,550][106226] Updated weights for policy 0, policy_version 1263677 (0.0010) [2023-12-28 04:20:24,564][106225] Updated weights for policy 1, policy_version 1266805 (0.0007) [2023-12-28 04:20:24,598][106226] Updated weights for policy 0, policy_version 1263687 (0.0010) [2023-12-28 04:20:24,619][106225] Updated weights for policy 1, policy_version 1266815 (0.0005) [2023-12-28 04:20:24,647][106226] Updated weights for policy 0, policy_version 1263697 (0.0010) [2023-12-28 04:20:25,282][106225] Updated weights for policy 1, policy_version 1266825 (0.0006) [2023-12-28 04:20:25,308][106226] Updated weights for policy 0, policy_version 1263707 (0.0009) [2023-12-28 04:20:25,342][106225] Updated weights for policy 1, policy_version 1266835 (0.0008) [2023-12-28 04:20:25,359][106226] Updated weights for policy 0, policy_version 1263717 (0.0005) [2023-12-28 04:20:25,386][106225] Updated weights for policy 1, policy_version 1266845 (0.0009) [2023-12-28 04:20:25,408][106226] Updated weights for policy 0, policy_version 1263727 (0.0005) [2023-12-28 04:20:25,433][106225] Updated weights for policy 1, policy_version 1266855 (0.0010) [2023-12-28 04:20:26,044][106226] Updated weights for policy 0, policy_version 1263737 (0.0005) [2023-12-28 04:20:26,101][106226] Updated weights for policy 0, policy_version 1263747 (0.0007) [2023-12-28 04:20:26,135][106225] Updated weights for policy 1, policy_version 1266865 (0.0006) [2023-12-28 04:20:26,160][106226] Updated weights for policy 0, policy_version 1263757 (0.0005) [2023-12-28 04:20:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 647938048. Throughput: 0: 9862.8, 1: 9682.2. Samples: 647910820. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:26,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-5.027')] [2023-12-28 04:20:26,182][106225] Updated weights for policy 1, policy_version 1266875 (0.0005) [2023-12-28 04:20:26,219][106226] Updated weights for policy 0, policy_version 1263767 (0.0006) [2023-12-28 04:20:26,223][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001263768_323584000.pth... [2023-12-28 04:20:26,226][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001262584_323280896.pth [2023-12-28 04:20:26,229][106225] Updated weights for policy 1, policy_version 1266885 (0.0006) [2023-12-28 04:20:26,248][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001266888_324370432.pth... [2023-12-28 04:20:26,253][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001265736_324075520.pth [2023-12-28 04:20:26,930][106226] Updated weights for policy 0, policy_version 1263777 (0.0010) [2023-12-28 04:20:26,949][106225] Updated weights for policy 1, policy_version 1266895 (0.0009) [2023-12-28 04:20:26,997][106226] Updated weights for policy 0, policy_version 1263787 (0.0009) [2023-12-28 04:20:27,010][106225] Updated weights for policy 1, policy_version 1266905 (0.0010) [2023-12-28 04:20:27,054][106226] Updated weights for policy 0, policy_version 1263797 (0.0008) [2023-12-28 04:20:27,064][106225] Updated weights for policy 1, policy_version 1266915 (0.0007) [2023-12-28 04:20:27,671][106225] Updated weights for policy 1, policy_version 1266925 (0.0007) [2023-12-28 04:20:27,707][106226] Updated weights for policy 0, policy_version 1263807 (0.0009) [2023-12-28 04:20:27,722][106225] Updated weights for policy 1, policy_version 1266935 (0.0010) [2023-12-28 04:20:27,757][106226] Updated weights for policy 0, policy_version 1263817 (0.0010) [2023-12-28 04:20:27,771][106225] Updated weights for policy 1, policy_version 1266945 (0.0010) [2023-12-28 04:20:27,809][106226] Updated weights for policy 0, policy_version 1263827 (0.0010) [2023-12-28 04:20:28,444][106225] Updated weights for policy 1, policy_version 1266955 (0.0010) [2023-12-28 04:20:28,503][106225] Updated weights for policy 1, policy_version 1266965 (0.0010) [2023-12-28 04:20:28,530][106226] Updated weights for policy 0, policy_version 1263837 (0.0010) [2023-12-28 04:20:28,556][106225] Updated weights for policy 1, policy_version 1266975 (0.0010) [2023-12-28 04:20:28,587][106226] Updated weights for policy 0, policy_version 1263847 (0.0010) [2023-12-28 04:20:28,637][106226] Updated weights for policy 0, policy_version 1263857 (0.0010) [2023-12-28 04:20:29,270][106225] Updated weights for policy 1, policy_version 1266985 (0.0010) [2023-12-28 04:20:29,324][106225] Updated weights for policy 1, policy_version 1266995 (0.0008) [2023-12-28 04:20:29,390][106225] Updated weights for policy 1, policy_version 1267005 (0.0006) [2023-12-28 04:20:29,391][106226] Updated weights for policy 0, policy_version 1263867 (0.0010) [2023-12-28 04:20:29,443][106225] Updated weights for policy 1, policy_version 1267015 (0.0005) [2023-12-28 04:20:29,449][106226] Updated weights for policy 0, policy_version 1263877 (0.0008) [2023-12-28 04:20:29,504][106226] Updated weights for policy 0, policy_version 1263887 (0.0008) [2023-12-28 04:20:30,160][106225] Updated weights for policy 1, policy_version 1267025 (0.0009) [2023-12-28 04:20:30,216][106225] Updated weights for policy 1, policy_version 1267035 (0.0008) [2023-12-28 04:20:30,243][106226] Updated weights for policy 0, policy_version 1263897 (0.0008) [2023-12-28 04:20:30,277][106225] Updated weights for policy 1, policy_version 1267045 (0.0008) [2023-12-28 04:20:30,308][106226] Updated weights for policy 0, policy_version 1263907 (0.0006) [2023-12-28 04:20:30,377][106226] Updated weights for policy 0, policy_version 1263917 (0.0009) [2023-12-28 04:20:30,439][106226] Updated weights for policy 0, policy_version 1263927 (0.0009) [2023-12-28 04:20:30,924][106225] Updated weights for policy 1, policy_version 1267055 (0.0008) [2023-12-28 04:20:30,977][106225] Updated weights for policy 1, policy_version 1267065 (0.0008) [2023-12-28 04:20:31,048][106225] Updated weights for policy 1, policy_version 1267075 (0.0006) [2023-12-28 04:20:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 648044544. Throughput: 0: 9960.1, 1: 9770.8. Samples: 648034184. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:31,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-4.949')] [2023-12-28 04:20:31,207][106226] Updated weights for policy 0, policy_version 1263937 (0.0007) [2023-12-28 04:20:31,284][106226] Updated weights for policy 0, policy_version 1263947 (0.0008) [2023-12-28 04:20:31,344][106226] Updated weights for policy 0, policy_version 1263957 (0.0008) [2023-12-28 04:20:31,759][106225] Updated weights for policy 1, policy_version 1267085 (0.0007) [2023-12-28 04:20:31,823][106225] Updated weights for policy 1, policy_version 1267095 (0.0010) [2023-12-28 04:20:31,871][106225] Updated weights for policy 1, policy_version 1267105 (0.0008) [2023-12-28 04:20:32,016][106226] Updated weights for policy 0, policy_version 1263967 (0.0007) [2023-12-28 04:20:32,071][106226] Updated weights for policy 0, policy_version 1263977 (0.0009) [2023-12-28 04:20:32,132][106226] Updated weights for policy 0, policy_version 1263987 (0.0009) [2023-12-28 04:20:32,528][106225] Updated weights for policy 1, policy_version 1267115 (0.0006) [2023-12-28 04:20:32,592][106225] Updated weights for policy 1, policy_version 1267125 (0.0008) [2023-12-28 04:20:32,649][106225] Updated weights for policy 1, policy_version 1267135 (0.0007) [2023-12-28 04:20:32,865][106226] Updated weights for policy 0, policy_version 1263997 (0.0009) [2023-12-28 04:20:32,925][106226] Updated weights for policy 0, policy_version 1264007 (0.0009) [2023-12-28 04:20:32,983][106226] Updated weights for policy 0, policy_version 1264017 (0.0008) [2023-12-28 04:20:33,324][106225] Updated weights for policy 1, policy_version 1267145 (0.0006) [2023-12-28 04:20:33,383][106225] Updated weights for policy 1, policy_version 1267155 (0.0008) [2023-12-28 04:20:33,439][106225] Updated weights for policy 1, policy_version 1267165 (0.0009) [2023-12-28 04:20:33,497][106225] Updated weights for policy 1, policy_version 1267175 (0.0008) [2023-12-28 04:20:33,717][106226] Updated weights for policy 0, policy_version 1264027 (0.0008) [2023-12-28 04:20:33,772][106226] Updated weights for policy 0, policy_version 1264037 (0.0008) [2023-12-28 04:20:33,827][106226] Updated weights for policy 0, policy_version 1264047 (0.0008) [2023-12-28 04:20:34,165][106225] Updated weights for policy 1, policy_version 1267185 (0.0008) [2023-12-28 04:20:34,223][106225] Updated weights for policy 1, policy_version 1267195 (0.0008) [2023-12-28 04:20:34,275][106225] Updated weights for policy 1, policy_version 1267205 (0.0008) [2023-12-28 04:20:34,504][106226] Updated weights for policy 0, policy_version 1264057 (0.0006) [2023-12-28 04:20:34,569][106226] Updated weights for policy 0, policy_version 1264067 (0.0007) [2023-12-28 04:20:34,622][106226] Updated weights for policy 0, policy_version 1264077 (0.0010) [2023-12-28 04:20:34,689][106226] Updated weights for policy 0, policy_version 1264087 (0.0007) [2023-12-28 04:20:34,962][106225] Updated weights for policy 1, policy_version 1267215 (0.0008) [2023-12-28 04:20:35,015][106225] Updated weights for policy 1, policy_version 1267225 (0.0008) [2023-12-28 04:20:35,074][106225] Updated weights for policy 1, policy_version 1267235 (0.0008) [2023-12-28 04:20:35,356][106226] Updated weights for policy 0, policy_version 1264097 (0.0009) [2023-12-28 04:20:35,421][106226] Updated weights for policy 0, policy_version 1264107 (0.0005) [2023-12-28 04:20:35,482][106226] Updated weights for policy 0, policy_version 1264117 (0.0005) [2023-12-28 04:20:35,780][106225] Updated weights for policy 1, policy_version 1267245 (0.0007) [2023-12-28 04:20:35,842][106225] Updated weights for policy 1, policy_version 1267255 (0.0007) [2023-12-28 04:20:35,904][106225] Updated weights for policy 1, policy_version 1267265 (0.0005) [2023-12-28 04:20:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 648142848. Throughput: 0: 9917.9, 1: 9796.4. Samples: 648152884. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:36,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.991')] [2023-12-28 04:20:36,215][106226] Updated weights for policy 0, policy_version 1264127 (0.0007) [2023-12-28 04:20:36,266][106226] Updated weights for policy 0, policy_version 1264137 (0.0008) [2023-12-28 04:20:36,317][106226] Updated weights for policy 0, policy_version 1264147 (0.0008) [2023-12-28 04:20:36,565][106225] Updated weights for policy 1, policy_version 1267275 (0.0006) [2023-12-28 04:20:36,632][106225] Updated weights for policy 1, policy_version 1267285 (0.0008) [2023-12-28 04:20:36,698][106225] Updated weights for policy 1, policy_version 1267295 (0.0008) [2023-12-28 04:20:37,079][106226] Updated weights for policy 0, policy_version 1264157 (0.0006) [2023-12-28 04:20:37,137][106226] Updated weights for policy 0, policy_version 1264167 (0.0008) [2023-12-28 04:20:37,184][106226] Updated weights for policy 0, policy_version 1264177 (0.0010) [2023-12-28 04:20:37,350][106225] Updated weights for policy 1, policy_version 1267305 (0.0007) [2023-12-28 04:20:37,407][106225] Updated weights for policy 1, policy_version 1267315 (0.0005) [2023-12-28 04:20:37,465][106225] Updated weights for policy 1, policy_version 1267325 (0.0005) [2023-12-28 04:20:37,522][106225] Updated weights for policy 1, policy_version 1267335 (0.0007) [2023-12-28 04:20:37,932][106226] Updated weights for policy 0, policy_version 1264187 (0.0009) [2023-12-28 04:20:37,989][106226] Updated weights for policy 0, policy_version 1264197 (0.0008) [2023-12-28 04:20:38,052][106226] Updated weights for policy 0, policy_version 1264207 (0.0009) [2023-12-28 04:20:38,206][106225] Updated weights for policy 1, policy_version 1267345 (0.0008) [2023-12-28 04:20:38,251][106225] Updated weights for policy 1, policy_version 1267355 (0.0007) [2023-12-28 04:20:38,303][106225] Updated weights for policy 1, policy_version 1267365 (0.0008) [2023-12-28 04:20:38,766][106226] Updated weights for policy 0, policy_version 1264217 (0.0008) [2023-12-28 04:20:38,830][106226] Updated weights for policy 0, policy_version 1264227 (0.0008) [2023-12-28 04:20:38,900][106226] Updated weights for policy 0, policy_version 1264237 (0.0005) [2023-12-28 04:20:38,965][106226] Updated weights for policy 0, policy_version 1264247 (0.0006) [2023-12-28 04:20:39,007][106225] Updated weights for policy 1, policy_version 1267375 (0.0006) [2023-12-28 04:20:39,068][106225] Updated weights for policy 1, policy_version 1267385 (0.0005) [2023-12-28 04:20:39,117][106225] Updated weights for policy 1, policy_version 1267395 (0.0005) [2023-12-28 04:20:39,677][106226] Updated weights for policy 0, policy_version 1264257 (0.0009) [2023-12-28 04:20:39,744][106226] Updated weights for policy 0, policy_version 1264267 (0.0007) [2023-12-28 04:20:39,785][106225] Updated weights for policy 1, policy_version 1267405 (0.0006) [2023-12-28 04:20:39,812][106226] Updated weights for policy 0, policy_version 1264277 (0.0006) [2023-12-28 04:20:39,852][106225] Updated weights for policy 1, policy_version 1267415 (0.0009) [2023-12-28 04:20:39,911][106225] Updated weights for policy 1, policy_version 1267425 (0.0009) [2023-12-28 04:20:40,548][106226] Updated weights for policy 0, policy_version 1264287 (0.0009) [2023-12-28 04:20:40,598][106226] Updated weights for policy 0, policy_version 1264297 (0.0009) [2023-12-28 04:20:40,648][106225] Updated weights for policy 1, policy_version 1267435 (0.0006) [2023-12-28 04:20:40,654][106226] Updated weights for policy 0, policy_version 1264307 (0.0008) [2023-12-28 04:20:40,701][106225] Updated weights for policy 1, policy_version 1267445 (0.0007) [2023-12-28 04:20:40,753][106225] Updated weights for policy 1, policy_version 1267455 (0.0008) [2023-12-28 04:20:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 648241152. Throughput: 0: 9930.5, 1: 9812.5. Samples: 648211676. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:41,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-5.151')] [2023-12-28 04:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001267464_324517888.pth... [2023-12-28 04:20:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001264312_323723264.pth... [2023-12-28 04:20:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001263192_323436544.pth [2023-12-28 04:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001266312_324222976.pth [2023-12-28 04:20:41,348][106226] Updated weights for policy 0, policy_version 1264317 (0.0007) [2023-12-28 04:20:41,422][106226] Updated weights for policy 0, policy_version 1264327 (0.0009) [2023-12-28 04:20:41,477][106226] Updated weights for policy 0, policy_version 1264337 (0.0009) [2023-12-28 04:20:41,587][106225] Updated weights for policy 1, policy_version 1267465 (0.0008) [2023-12-28 04:20:41,655][106225] Updated weights for policy 1, policy_version 1267475 (0.0009) [2023-12-28 04:20:41,721][106225] Updated weights for policy 1, policy_version 1267485 (0.0008) [2023-12-28 04:20:41,784][106225] Updated weights for policy 1, policy_version 1267495 (0.0009) [2023-12-28 04:20:42,277][106226] Updated weights for policy 0, policy_version 1264347 (0.0009) [2023-12-28 04:20:42,345][106226] Updated weights for policy 0, policy_version 1264357 (0.0008) [2023-12-28 04:20:42,408][106226] Updated weights for policy 0, policy_version 1264367 (0.0009) [2023-12-28 04:20:42,584][106225] Updated weights for policy 1, policy_version 1267505 (0.0009) [2023-12-28 04:20:42,644][106225] Updated weights for policy 1, policy_version 1267515 (0.0007) [2023-12-28 04:20:42,711][106225] Updated weights for policy 1, policy_version 1267525 (0.0008) [2023-12-28 04:20:43,178][106226] Updated weights for policy 0, policy_version 1264377 (0.0009) [2023-12-28 04:20:43,227][106226] Updated weights for policy 0, policy_version 1264387 (0.0008) [2023-12-28 04:20:43,275][106226] Updated weights for policy 0, policy_version 1264397 (0.0009) [2023-12-28 04:20:43,322][106225] Updated weights for policy 1, policy_version 1267535 (0.0005) [2023-12-28 04:20:43,340][106226] Updated weights for policy 0, policy_version 1264407 (0.0008) [2023-12-28 04:20:43,379][106225] Updated weights for policy 1, policy_version 1267545 (0.0005) [2023-12-28 04:20:43,433][106225] Updated weights for policy 1, policy_version 1267555 (0.0008) [2023-12-28 04:20:44,002][106225] Updated weights for policy 1, policy_version 1267565 (0.0010) [2023-12-28 04:20:44,060][106225] Updated weights for policy 1, policy_version 1267575 (0.0011) [2023-12-28 04:20:44,093][106226] Updated weights for policy 0, policy_version 1264417 (0.0006) [2023-12-28 04:20:44,118][106225] Updated weights for policy 1, policy_version 1267585 (0.0010) [2023-12-28 04:20:44,155][106226] Updated weights for policy 0, policy_version 1264427 (0.0007) [2023-12-28 04:20:44,212][106226] Updated weights for policy 0, policy_version 1264437 (0.0008) [2023-12-28 04:20:44,840][106225] Updated weights for policy 1, policy_version 1267595 (0.0010) [2023-12-28 04:20:44,897][106225] Updated weights for policy 1, policy_version 1267605 (0.0010) [2023-12-28 04:20:44,899][106226] Updated weights for policy 0, policy_version 1264447 (0.0008) [2023-12-28 04:20:44,948][106225] Updated weights for policy 1, policy_version 1267615 (0.0010) [2023-12-28 04:20:44,968][106226] Updated weights for policy 0, policy_version 1264457 (0.0009) [2023-12-28 04:20:45,038][106226] Updated weights for policy 0, policy_version 1264467 (0.0009) [2023-12-28 04:20:45,683][106225] Updated weights for policy 1, policy_version 1267625 (0.0011) [2023-12-28 04:20:45,706][106226] Updated weights for policy 0, policy_version 1264477 (0.0007) [2023-12-28 04:20:45,742][106225] Updated weights for policy 1, policy_version 1267635 (0.0010) [2023-12-28 04:20:45,759][106226] Updated weights for policy 0, policy_version 1264487 (0.0005) [2023-12-28 04:20:45,797][106225] Updated weights for policy 1, policy_version 1267645 (0.0010) [2023-12-28 04:20:45,810][106226] Updated weights for policy 0, policy_version 1264497 (0.0008) [2023-12-28 04:20:45,847][106225] Updated weights for policy 1, policy_version 1267655 (0.0010) [2023-12-28 04:20:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 648339456. Throughput: 0: 9857.2, 1: 9860.5. Samples: 648327916. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:46,176][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.768')] [2023-12-28 04:20:46,560][106226] Updated weights for policy 0, policy_version 1264507 (0.0006) [2023-12-28 04:20:46,562][106225] Updated weights for policy 1, policy_version 1267665 (0.0010) [2023-12-28 04:20:46,615][106225] Updated weights for policy 1, policy_version 1267675 (0.0010) [2023-12-28 04:20:46,621][106226] Updated weights for policy 0, policy_version 1264517 (0.0006) [2023-12-28 04:20:46,669][106225] Updated weights for policy 1, policy_version 1267685 (0.0010) [2023-12-28 04:20:46,687][106226] Updated weights for policy 0, policy_version 1264527 (0.0006) [2023-12-28 04:20:47,323][106225] Updated weights for policy 1, policy_version 1267695 (0.0010) [2023-12-28 04:20:47,336][106226] Updated weights for policy 0, policy_version 1264537 (0.0007) [2023-12-28 04:20:47,380][106225] Updated weights for policy 1, policy_version 1267705 (0.0010) [2023-12-28 04:20:47,390][106226] Updated weights for policy 0, policy_version 1264547 (0.0005) [2023-12-28 04:20:47,435][106226] Updated weights for policy 0, policy_version 1264557 (0.0005) [2023-12-28 04:20:47,436][106225] Updated weights for policy 1, policy_version 1267715 (0.0010) [2023-12-28 04:20:47,478][106226] Updated weights for policy 0, policy_version 1264567 (0.0005) [2023-12-28 04:20:48,063][106226] Updated weights for policy 0, policy_version 1264577 (0.0005) [2023-12-28 04:20:48,117][106226] Updated weights for policy 0, policy_version 1264587 (0.0005) [2023-12-28 04:20:48,176][106226] Updated weights for policy 0, policy_version 1264597 (0.0008) [2023-12-28 04:20:48,206][106225] Updated weights for policy 1, policy_version 1267725 (0.0010) [2023-12-28 04:20:48,268][106225] Updated weights for policy 1, policy_version 1267735 (0.0010) [2023-12-28 04:20:48,321][106225] Updated weights for policy 1, policy_version 1267745 (0.0010) [2023-12-28 04:20:48,858][106226] Updated weights for policy 0, policy_version 1264607 (0.0008) [2023-12-28 04:20:48,910][106226] Updated weights for policy 0, policy_version 1264617 (0.0008) [2023-12-28 04:20:48,939][106225] Updated weights for policy 1, policy_version 1267755 (0.0009) [2023-12-28 04:20:48,958][106226] Updated weights for policy 0, policy_version 1264627 (0.0007) [2023-12-28 04:20:48,993][106225] Updated weights for policy 1, policy_version 1267765 (0.0010) [2023-12-28 04:20:49,049][106225] Updated weights for policy 1, policy_version 1267775 (0.0010) [2023-12-28 04:20:49,743][106226] Updated weights for policy 0, policy_version 1264637 (0.0010) [2023-12-28 04:20:49,805][106226] Updated weights for policy 0, policy_version 1264647 (0.0009) [2023-12-28 04:20:49,821][106225] Updated weights for policy 1, policy_version 1267785 (0.0009) [2023-12-28 04:20:49,871][106226] Updated weights for policy 0, policy_version 1264657 (0.0010) [2023-12-28 04:20:49,885][106225] Updated weights for policy 1, policy_version 1267795 (0.0007) [2023-12-28 04:20:49,944][106225] Updated weights for policy 1, policy_version 1267805 (0.0007) [2023-12-28 04:20:50,005][106225] Updated weights for policy 1, policy_version 1267815 (0.0007) [2023-12-28 04:20:50,660][106226] Updated weights for policy 0, policy_version 1264667 (0.0010) [2023-12-28 04:20:50,726][106226] Updated weights for policy 0, policy_version 1264677 (0.0008) [2023-12-28 04:20:50,733][106225] Updated weights for policy 1, policy_version 1267825 (0.0008) [2023-12-28 04:20:50,789][106225] Updated weights for policy 1, policy_version 1267835 (0.0007) [2023-12-28 04:20:50,790][106226] Updated weights for policy 0, policy_version 1264687 (0.0009) [2023-12-28 04:20:50,851][106225] Updated weights for policy 1, policy_version 1267845 (0.0007) [2023-12-28 04:20:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 648437760. Throughput: 0: 9774.9, 1: 9862.7. Samples: 648445608. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:51,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.866')] [2023-12-28 04:20:51,542][106226] Updated weights for policy 0, policy_version 1264697 (0.0007) [2023-12-28 04:20:51,613][106226] Updated weights for policy 0, policy_version 1264707 (0.0008) [2023-12-28 04:20:51,680][106226] Updated weights for policy 0, policy_version 1264717 (0.0007) [2023-12-28 04:20:51,688][106225] Updated weights for policy 1, policy_version 1267855 (0.0009) [2023-12-28 04:20:51,748][106226] Updated weights for policy 0, policy_version 1264727 (0.0008) [2023-12-28 04:20:51,751][106225] Updated weights for policy 1, policy_version 1267865 (0.0009) [2023-12-28 04:20:51,810][106225] Updated weights for policy 1, policy_version 1267875 (0.0008) [2023-12-28 04:20:52,412][106226] Updated weights for policy 0, policy_version 1264737 (0.0007) [2023-12-28 04:20:52,472][106226] Updated weights for policy 0, policy_version 1264747 (0.0006) [2023-12-28 04:20:52,536][106226] Updated weights for policy 0, policy_version 1264757 (0.0006) [2023-12-28 04:20:52,571][106225] Updated weights for policy 1, policy_version 1267885 (0.0007) [2023-12-28 04:20:52,634][106225] Updated weights for policy 1, policy_version 1267895 (0.0007) [2023-12-28 04:20:52,701][106225] Updated weights for policy 1, policy_version 1267905 (0.0006) [2023-12-28 04:20:53,145][106226] Updated weights for policy 0, policy_version 1264767 (0.0008) [2023-12-28 04:20:53,202][106226] Updated weights for policy 0, policy_version 1264777 (0.0009) [2023-12-28 04:20:53,267][106226] Updated weights for policy 0, policy_version 1264787 (0.0009) [2023-12-28 04:20:53,299][106225] Updated weights for policy 1, policy_version 1267915 (0.0006) [2023-12-28 04:20:53,351][106225] Updated weights for policy 1, policy_version 1267925 (0.0008) [2023-12-28 04:20:53,406][106225] Updated weights for policy 1, policy_version 1267935 (0.0008) [2023-12-28 04:20:53,938][106226] Updated weights for policy 0, policy_version 1264797 (0.0010) [2023-12-28 04:20:53,992][106226] Updated weights for policy 0, policy_version 1264807 (0.0010) [2023-12-28 04:20:54,042][106226] Updated weights for policy 0, policy_version 1264817 (0.0010) [2023-12-28 04:20:54,123][106225] Updated weights for policy 1, policy_version 1267945 (0.0008) [2023-12-28 04:20:54,181][106225] Updated weights for policy 1, policy_version 1267955 (0.0008) [2023-12-28 04:20:54,235][106225] Updated weights for policy 1, policy_version 1267965 (0.0008) [2023-12-28 04:20:54,282][106225] Updated weights for policy 1, policy_version 1267975 (0.0006) [2023-12-28 04:20:54,735][106226] Updated weights for policy 0, policy_version 1264827 (0.0010) [2023-12-28 04:20:54,795][106226] Updated weights for policy 0, policy_version 1264837 (0.0011) [2023-12-28 04:20:54,855][106226] Updated weights for policy 0, policy_version 1264847 (0.0010) [2023-12-28 04:20:54,948][106225] Updated weights for policy 1, policy_version 1267985 (0.0005) [2023-12-28 04:20:55,002][106225] Updated weights for policy 1, policy_version 1267995 (0.0006) [2023-12-28 04:20:55,065][106225] Updated weights for policy 1, policy_version 1268005 (0.0006) [2023-12-28 04:20:55,487][106226] Updated weights for policy 0, policy_version 1264857 (0.0010) [2023-12-28 04:20:55,544][106226] Updated weights for policy 0, policy_version 1264867 (0.0005) [2023-12-28 04:20:55,602][106226] Updated weights for policy 0, policy_version 1264877 (0.0005) [2023-12-28 04:20:55,616][106225] Updated weights for policy 1, policy_version 1268015 (0.0009) [2023-12-28 04:20:55,667][106226] Updated weights for policy 0, policy_version 1264887 (0.0009) [2023-12-28 04:20:55,670][106225] Updated weights for policy 1, policy_version 1268025 (0.0008) [2023-12-28 04:20:55,719][106225] Updated weights for policy 1, policy_version 1268035 (0.0007) [2023-12-28 04:20:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 648536064. Throughput: 0: 9758.2, 1: 9840.2. Samples: 648504144. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:20:56,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-4.863')] [2023-12-28 04:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001268040_324665344.pth... [2023-12-28 04:20:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001264888_323870720.pth... [2023-12-28 04:20:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001266888_324370432.pth [2023-12-28 04:20:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001263768_323584000.pth [2023-12-28 04:20:56,266][106226] Updated weights for policy 0, policy_version 1264897 (0.0010) [2023-12-28 04:20:56,316][106226] Updated weights for policy 0, policy_version 1264907 (0.0010) [2023-12-28 04:20:56,349][106225] Updated weights for policy 1, policy_version 1268045 (0.0006) [2023-12-28 04:20:56,368][106226] Updated weights for policy 0, policy_version 1264917 (0.0010) [2023-12-28 04:20:56,400][106225] Updated weights for policy 1, policy_version 1268055 (0.0005) [2023-12-28 04:20:56,453][106225] Updated weights for policy 1, policy_version 1268065 (0.0005) [2023-12-28 04:20:56,994][106225] Updated weights for policy 1, policy_version 1268075 (0.0005) [2023-12-28 04:20:57,034][106226] Updated weights for policy 0, policy_version 1264927 (0.0011) [2023-12-28 04:20:57,052][106225] Updated weights for policy 1, policy_version 1268085 (0.0005) [2023-12-28 04:20:57,103][106226] Updated weights for policy 0, policy_version 1264937 (0.0010) [2023-12-28 04:20:57,112][106225] Updated weights for policy 1, policy_version 1268095 (0.0007) [2023-12-28 04:20:57,168][106226] Updated weights for policy 0, policy_version 1264947 (0.0010) [2023-12-28 04:20:57,788][106225] Updated weights for policy 1, policy_version 1268105 (0.0007) [2023-12-28 04:20:57,837][106225] Updated weights for policy 1, policy_version 1268115 (0.0005) [2023-12-28 04:20:57,862][106226] Updated weights for policy 0, policy_version 1264957 (0.0011) [2023-12-28 04:20:57,888][106225] Updated weights for policy 1, policy_version 1268125 (0.0005) [2023-12-28 04:20:57,919][106226] Updated weights for policy 0, policy_version 1264967 (0.0010) [2023-12-28 04:20:57,939][106225] Updated weights for policy 1, policy_version 1268135 (0.0005) [2023-12-28 04:20:57,972][106226] Updated weights for policy 0, policy_version 1264977 (0.0010) [2023-12-28 04:20:58,596][106225] Updated weights for policy 1, policy_version 1268145 (0.0007) [2023-12-28 04:20:58,658][106225] Updated weights for policy 1, policy_version 1268155 (0.0007) [2023-12-28 04:20:58,708][106226] Updated weights for policy 0, policy_version 1264987 (0.0009) [2023-12-28 04:20:58,725][106225] Updated weights for policy 1, policy_version 1268165 (0.0008) [2023-12-28 04:20:58,775][106226] Updated weights for policy 0, policy_version 1264997 (0.0008) [2023-12-28 04:20:58,843][106226] Updated weights for policy 0, policy_version 1265007 (0.0008) [2023-12-28 04:20:59,457][106225] Updated weights for policy 1, policy_version 1268175 (0.0008) [2023-12-28 04:20:59,508][106225] Updated weights for policy 1, policy_version 1268185 (0.0008) [2023-12-28 04:20:59,556][106225] Updated weights for policy 1, policy_version 1268195 (0.0008) [2023-12-28 04:20:59,600][106226] Updated weights for policy 0, policy_version 1265017 (0.0007) [2023-12-28 04:20:59,654][106226] Updated weights for policy 0, policy_version 1265027 (0.0007) [2023-12-28 04:20:59,706][106226] Updated weights for policy 0, policy_version 1265037 (0.0008) [2023-12-28 04:20:59,755][106226] Updated weights for policy 0, policy_version 1265047 (0.0007) [2023-12-28 04:21:00,323][106225] Updated weights for policy 1, policy_version 1268205 (0.0008) [2023-12-28 04:21:00,385][106225] Updated weights for policy 1, policy_version 1268215 (0.0008) [2023-12-28 04:21:00,399][106226] Updated weights for policy 0, policy_version 1265057 (0.0006) [2023-12-28 04:21:00,444][106225] Updated weights for policy 1, policy_version 1268225 (0.0008) [2023-12-28 04:21:00,453][106226] Updated weights for policy 0, policy_version 1265067 (0.0007) [2023-12-28 04:21:00,514][106226] Updated weights for policy 0, policy_version 1265077 (0.0008) [2023-12-28 04:21:01,059][106225] Updated weights for policy 1, policy_version 1268235 (0.0007) [2023-12-28 04:21:01,123][106225] Updated weights for policy 1, policy_version 1268245 (0.0008) [2023-12-28 04:21:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 648634368. Throughput: 0: 9804.0, 1: 10014.2. Samples: 648628476. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:21:01,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.767')] [2023-12-28 04:21:01,196][106225] Updated weights for policy 1, policy_version 1268255 (0.0008) [2023-12-28 04:21:01,315][106226] Updated weights for policy 0, policy_version 1265087 (0.0008) [2023-12-28 04:21:01,395][106226] Updated weights for policy 0, policy_version 1265097 (0.0008) [2023-12-28 04:21:01,456][106226] Updated weights for policy 0, policy_version 1265107 (0.0008) [2023-12-28 04:21:01,921][106225] Updated weights for policy 1, policy_version 1268265 (0.0008) [2023-12-28 04:21:01,978][106225] Updated weights for policy 1, policy_version 1268275 (0.0008) [2023-12-28 04:21:02,042][106225] Updated weights for policy 1, policy_version 1268285 (0.0008) [2023-12-28 04:21:02,108][106225] Updated weights for policy 1, policy_version 1268295 (0.0009) [2023-12-28 04:21:02,198][106226] Updated weights for policy 0, policy_version 1265117 (0.0007) [2023-12-28 04:21:02,259][106226] Updated weights for policy 0, policy_version 1265127 (0.0007) [2023-12-28 04:21:02,313][106226] Updated weights for policy 0, policy_version 1265137 (0.0010) [2023-12-28 04:21:02,839][106225] Updated weights for policy 1, policy_version 1268305 (0.0006) [2023-12-28 04:21:02,889][106225] Updated weights for policy 1, policy_version 1268315 (0.0007) [2023-12-28 04:21:02,937][106225] Updated weights for policy 1, policy_version 1268325 (0.0007) [2023-12-28 04:21:03,033][106226] Updated weights for policy 0, policy_version 1265147 (0.0008) [2023-12-28 04:21:03,095][106226] Updated weights for policy 0, policy_version 1265157 (0.0007) [2023-12-28 04:21:03,149][106226] Updated weights for policy 0, policy_version 1265167 (0.0008) [2023-12-28 04:21:03,688][106225] Updated weights for policy 1, policy_version 1268335 (0.0007) [2023-12-28 04:21:03,738][106225] Updated weights for policy 1, policy_version 1268345 (0.0008) [2023-12-28 04:21:03,739][106226] Updated weights for policy 0, policy_version 1265177 (0.0005) [2023-12-28 04:21:03,788][106225] Updated weights for policy 1, policy_version 1268355 (0.0008) [2023-12-28 04:21:03,788][106226] Updated weights for policy 0, policy_version 1265187 (0.0005) [2023-12-28 04:21:03,838][106226] Updated weights for policy 0, policy_version 1265197 (0.0006) [2023-12-28 04:21:03,899][106226] Updated weights for policy 0, policy_version 1265207 (0.0008) [2023-12-28 04:21:04,505][106225] Updated weights for policy 1, policy_version 1268365 (0.0009) [2023-12-28 04:21:04,568][106225] Updated weights for policy 1, policy_version 1268375 (0.0008) [2023-12-28 04:21:04,626][106225] Updated weights for policy 1, policy_version 1268385 (0.0008) [2023-12-28 04:21:04,671][106226] Updated weights for policy 0, policy_version 1265217 (0.0008) [2023-12-28 04:21:04,727][106226] Updated weights for policy 0, policy_version 1265227 (0.0008) [2023-12-28 04:21:04,777][106226] Updated weights for policy 0, policy_version 1265237 (0.0009) [2023-12-28 04:21:05,231][106225] Updated weights for policy 1, policy_version 1268395 (0.0006) [2023-12-28 04:21:05,286][106225] Updated weights for policy 1, policy_version 1268405 (0.0009) [2023-12-28 04:21:05,338][106225] Updated weights for policy 1, policy_version 1268415 (0.0009) [2023-12-28 04:21:05,550][106226] Updated weights for policy 0, policy_version 1265247 (0.0006) [2023-12-28 04:21:05,607][106226] Updated weights for policy 0, policy_version 1265257 (0.0005) [2023-12-28 04:21:05,665][106226] Updated weights for policy 0, policy_version 1265267 (0.0005) [2023-12-28 04:21:06,047][106225] Updated weights for policy 1, policy_version 1268425 (0.0007) [2023-12-28 04:21:06,107][106225] Updated weights for policy 1, policy_version 1268435 (0.0007) [2023-12-28 04:21:06,166][106225] Updated weights for policy 1, policy_version 1268445 (0.0010) [2023-12-28 04:21:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 648732672. Throughput: 0: 9832.6, 1: 10045.9. Samples: 648747876. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:21:06,175][105115] Avg episode reward: [(0, '-4.196'), (1, '-4.858')] [2023-12-28 04:21:06,214][106226] Updated weights for policy 0, policy_version 1265277 (0.0007) [2023-12-28 04:21:06,220][106225] Updated weights for policy 1, policy_version 1268455 (0.0008) [2023-12-28 04:21:06,276][106226] Updated weights for policy 0, policy_version 1265287 (0.0009) [2023-12-28 04:21:06,339][106226] Updated weights for policy 0, policy_version 1265297 (0.0009) [2023-12-28 04:21:06,876][106225] Updated weights for policy 1, policy_version 1268465 (0.0008) [2023-12-28 04:21:06,940][106225] Updated weights for policy 1, policy_version 1268475 (0.0009) [2023-12-28 04:21:06,992][106225] Updated weights for policy 1, policy_version 1268485 (0.0009) [2023-12-28 04:21:07,074][106226] Updated weights for policy 0, policy_version 1265307 (0.0009) [2023-12-28 04:21:07,131][106226] Updated weights for policy 0, policy_version 1265317 (0.0008) [2023-12-28 04:21:07,176][106226] Updated weights for policy 0, policy_version 1265327 (0.0009) [2023-12-28 04:21:07,667][106225] Updated weights for policy 1, policy_version 1268495 (0.0007) [2023-12-28 04:21:07,731][106225] Updated weights for policy 1, policy_version 1268505 (0.0009) [2023-12-28 04:21:07,786][106225] Updated weights for policy 1, policy_version 1268515 (0.0008) [2023-12-28 04:21:07,950][106226] Updated weights for policy 0, policy_version 1265337 (0.0009) [2023-12-28 04:21:07,998][106226] Updated weights for policy 0, policy_version 1265347 (0.0007) [2023-12-28 04:21:08,054][106226] Updated weights for policy 0, policy_version 1265357 (0.0007) [2023-12-28 04:21:08,108][106226] Updated weights for policy 0, policy_version 1265367 (0.0007) [2023-12-28 04:21:08,465][106225] Updated weights for policy 1, policy_version 1268525 (0.0008) [2023-12-28 04:21:08,529][106225] Updated weights for policy 1, policy_version 1268535 (0.0011) [2023-12-28 04:21:08,584][106225] Updated weights for policy 1, policy_version 1268545 (0.0010) [2023-12-28 04:21:08,828][106226] Updated weights for policy 0, policy_version 1265377 (0.0010) [2023-12-28 04:21:08,893][106226] Updated weights for policy 0, policy_version 1265387 (0.0011) [2023-12-28 04:21:08,954][106226] Updated weights for policy 0, policy_version 1265397 (0.0010) [2023-12-28 04:21:09,313][106225] Updated weights for policy 1, policy_version 1268555 (0.0010) [2023-12-28 04:21:09,379][106225] Updated weights for policy 1, policy_version 1268565 (0.0009) [2023-12-28 04:21:09,448][106225] Updated weights for policy 1, policy_version 1268575 (0.0009) [2023-12-28 04:21:09,703][106226] Updated weights for policy 0, policy_version 1265407 (0.0009) [2023-12-28 04:21:09,751][106226] Updated weights for policy 0, policy_version 1265417 (0.0009) [2023-12-28 04:21:09,803][106226] Updated weights for policy 0, policy_version 1265427 (0.0008) [2023-12-28 04:21:10,324][106225] Updated weights for policy 1, policy_version 1268585 (0.0009) [2023-12-28 04:21:10,387][106225] Updated weights for policy 1, policy_version 1268595 (0.0008) [2023-12-28 04:21:10,452][106225] Updated weights for policy 1, policy_version 1268605 (0.0007) [2023-12-28 04:21:10,460][106226] Updated weights for policy 0, policy_version 1265437 (0.0008) [2023-12-28 04:21:10,514][106225] Updated weights for policy 1, policy_version 1268615 (0.0007) [2023-12-28 04:21:10,520][106226] Updated weights for policy 0, policy_version 1265447 (0.0007) [2023-12-28 04:21:10,584][106226] Updated weights for policy 0, policy_version 1265457 (0.0010) [2023-12-28 04:21:11,095][106225] Updated weights for policy 1, policy_version 1268625 (0.0009) [2023-12-28 04:21:11,162][106225] Updated weights for policy 1, policy_version 1268635 (0.0008) [2023-12-28 04:21:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 648830976. Throughput: 0: 9839.9, 1: 10065.9. Samples: 648806580. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:21:11,176][105115] Avg episode reward: [(0, '-4.071'), (1, '-4.765')] [2023-12-28 04:21:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001265464_324018176.pth... [2023-12-28 04:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001264312_323723264.pth [2023-12-28 04:21:11,220][106225] Updated weights for policy 1, policy_version 1268645 (0.0008) [2023-12-28 04:21:11,234][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001268648_324820992.pth... [2023-12-28 04:21:11,237][106226] Updated weights for policy 0, policy_version 1265467 (0.0009) [2023-12-28 04:21:11,238][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001267464_324517888.pth [2023-12-28 04:21:11,300][106226] Updated weights for policy 0, policy_version 1265477 (0.0010) [2023-12-28 04:21:11,371][106226] Updated weights for policy 0, policy_version 1265487 (0.0007) [2023-12-28 04:21:12,031][106225] Updated weights for policy 1, policy_version 1268655 (0.0009) [2023-12-28 04:21:12,057][106226] Updated weights for policy 0, policy_version 1265497 (0.0008) [2023-12-28 04:21:12,087][106225] Updated weights for policy 1, policy_version 1268665 (0.0007) [2023-12-28 04:21:12,117][106226] Updated weights for policy 0, policy_version 1265507 (0.0006) [2023-12-28 04:21:12,145][106225] Updated weights for policy 1, policy_version 1268675 (0.0008) [2023-12-28 04:21:12,181][106226] Updated weights for policy 0, policy_version 1265517 (0.0008) [2023-12-28 04:21:12,248][106226] Updated weights for policy 0, policy_version 1265527 (0.0009) [2023-12-28 04:21:12,889][106225] Updated weights for policy 1, policy_version 1268685 (0.0005) [2023-12-28 04:21:12,954][106225] Updated weights for policy 1, policy_version 1268695 (0.0007) [2023-12-28 04:21:12,957][106226] Updated weights for policy 0, policy_version 1265537 (0.0006) [2023-12-28 04:21:13,010][106225] Updated weights for policy 1, policy_version 1268705 (0.0007) [2023-12-28 04:21:13,016][106226] Updated weights for policy 0, policy_version 1265547 (0.0007) [2023-12-28 04:21:13,081][106226] Updated weights for policy 0, policy_version 1265557 (0.0009) [2023-12-28 04:21:13,555][106225] Updated weights for policy 1, policy_version 1268715 (0.0007) [2023-12-28 04:21:13,614][106225] Updated weights for policy 1, policy_version 1268725 (0.0008) [2023-12-28 04:21:13,666][106225] Updated weights for policy 1, policy_version 1268735 (0.0008) [2023-12-28 04:21:13,723][106226] Updated weights for policy 0, policy_version 1265567 (0.0008) [2023-12-28 04:21:13,775][106226] Updated weights for policy 0, policy_version 1265577 (0.0008) [2023-12-28 04:21:13,828][106226] Updated weights for policy 0, policy_version 1265587 (0.0009) [2023-12-28 04:21:14,296][106225] Updated weights for policy 1, policy_version 1268745 (0.0007) [2023-12-28 04:21:14,364][106225] Updated weights for policy 1, policy_version 1268755 (0.0006) [2023-12-28 04:21:14,425][106225] Updated weights for policy 1, policy_version 1268765 (0.0009) [2023-12-28 04:21:14,479][106225] Updated weights for policy 1, policy_version 1268775 (0.0009) [2023-12-28 04:21:14,530][106226] Updated weights for policy 0, policy_version 1265597 (0.0008) [2023-12-28 04:21:14,585][106226] Updated weights for policy 0, policy_version 1265607 (0.0008) [2023-12-28 04:21:14,637][106226] Updated weights for policy 0, policy_version 1265617 (0.0009) [2023-12-28 04:21:15,212][106225] Updated weights for policy 1, policy_version 1268785 (0.0008) [2023-12-28 04:21:15,265][106225] Updated weights for policy 1, policy_version 1268795 (0.0008) [2023-12-28 04:21:15,322][106225] Updated weights for policy 1, policy_version 1268805 (0.0008) [2023-12-28 04:21:15,328][106226] Updated weights for policy 0, policy_version 1265627 (0.0008) [2023-12-28 04:21:15,375][106226] Updated weights for policy 0, policy_version 1265637 (0.0008) [2023-12-28 04:21:15,425][106226] Updated weights for policy 0, policy_version 1265647 (0.0009) [2023-12-28 04:21:15,992][106225] Updated weights for policy 1, policy_version 1268815 (0.0006) [2023-12-28 04:21:16,045][106225] Updated weights for policy 1, policy_version 1268825 (0.0009) [2023-12-28 04:21:16,102][106225] Updated weights for policy 1, policy_version 1268835 (0.0010) [2023-12-28 04:21:16,172][106226] Updated weights for policy 0, policy_version 1265657 (0.0008) [2023-12-28 04:21:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 648937472. Throughput: 0: 9808.0, 1: 10008.0. Samples: 648925904. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:21:16,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.053')] [2023-12-28 04:21:16,241][106226] Updated weights for policy 0, policy_version 1265667 (0.0008) [2023-12-28 04:21:16,296][106226] Updated weights for policy 0, policy_version 1265677 (0.0005) [2023-12-28 04:21:16,354][106226] Updated weights for policy 0, policy_version 1265687 (0.0008) [2023-12-28 04:21:16,759][106225] Updated weights for policy 1, policy_version 1268845 (0.0010) [2023-12-28 04:21:16,826][106225] Updated weights for policy 1, policy_version 1268855 (0.0007) [2023-12-28 04:21:16,896][106225] Updated weights for policy 1, policy_version 1268865 (0.0009) [2023-12-28 04:21:16,954][106226] Updated weights for policy 0, policy_version 1265697 (0.0007) [2023-12-28 04:21:17,007][106226] Updated weights for policy 0, policy_version 1265707 (0.0007) [2023-12-28 04:21:17,061][106226] Updated weights for policy 0, policy_version 1265717 (0.0008) [2023-12-28 04:21:17,529][106225] Updated weights for policy 1, policy_version 1268875 (0.0010) [2023-12-28 04:21:17,584][106225] Updated weights for policy 1, policy_version 1268885 (0.0010) [2023-12-28 04:21:17,647][106225] Updated weights for policy 1, policy_version 1268895 (0.0010) [2023-12-28 04:21:17,806][106226] Updated weights for policy 0, policy_version 1265727 (0.0008) [2023-12-28 04:21:17,858][106226] Updated weights for policy 0, policy_version 1265737 (0.0005) [2023-12-28 04:21:17,913][106226] Updated weights for policy 0, policy_version 1265747 (0.0007) [2023-12-28 04:21:18,333][106225] Updated weights for policy 1, policy_version 1268905 (0.0010) [2023-12-28 04:21:18,396][106225] Updated weights for policy 1, policy_version 1268915 (0.0007) [2023-12-28 04:21:18,455][106225] Updated weights for policy 1, policy_version 1268925 (0.0006) [2023-12-28 04:21:18,503][106225] Updated weights for policy 1, policy_version 1268935 (0.0008) [2023-12-28 04:21:18,650][106226] Updated weights for policy 0, policy_version 1265757 (0.0008) [2023-12-28 04:21:18,713][106226] Updated weights for policy 0, policy_version 1265767 (0.0008) [2023-12-28 04:21:18,775][106226] Updated weights for policy 0, policy_version 1265777 (0.0007) [2023-12-28 04:21:19,234][106225] Updated weights for policy 1, policy_version 1268945 (0.0009) [2023-12-28 04:21:19,291][106225] Updated weights for policy 1, policy_version 1268955 (0.0008) [2023-12-28 04:21:19,350][106225] Updated weights for policy 1, policy_version 1268965 (0.0008) [2023-12-28 04:21:19,519][106226] Updated weights for policy 0, policy_version 1265787 (0.0008) [2023-12-28 04:21:19,580][106226] Updated weights for policy 0, policy_version 1265797 (0.0008) [2023-12-28 04:21:19,642][106226] Updated weights for policy 0, policy_version 1265807 (0.0009) [2023-12-28 04:21:20,031][106225] Updated weights for policy 1, policy_version 1268975 (0.0008) [2023-12-28 04:21:20,083][106225] Updated weights for policy 1, policy_version 1268985 (0.0008) [2023-12-28 04:21:20,146][106225] Updated weights for policy 1, policy_version 1268995 (0.0008) [2023-12-28 04:21:20,316][106226] Updated weights for policy 0, policy_version 1265817 (0.0008) [2023-12-28 04:21:20,372][106226] Updated weights for policy 0, policy_version 1265827 (0.0008) [2023-12-28 04:21:20,431][106226] Updated weights for policy 0, policy_version 1265837 (0.0008) [2023-12-28 04:21:20,488][106226] Updated weights for policy 0, policy_version 1265847 (0.0008) [2023-12-28 04:21:20,896][106225] Updated weights for policy 1, policy_version 1269005 (0.0008) [2023-12-28 04:21:20,949][106225] Updated weights for policy 1, policy_version 1269015 (0.0008) [2023-12-28 04:21:20,998][106225] Updated weights for policy 1, policy_version 1269025 (0.0008) [2023-12-28 04:21:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 649035776. Throughput: 0: 9820.1, 1: 9986.6. Samples: 649044188. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 04:21:21,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.872')] [2023-12-28 04:21:21,254][106226] Updated weights for policy 0, policy_version 1265857 (0.0009) [2023-12-28 04:21:21,323][106226] Updated weights for policy 0, policy_version 1265867 (0.0008) [2023-12-28 04:21:21,393][106226] Updated weights for policy 0, policy_version 1265877 (0.0009) [2023-12-28 04:21:21,953][106225] Updated weights for policy 1, policy_version 1269035 (0.0009) [2023-12-28 04:21:22,013][106225] Updated weights for policy 1, policy_version 1269045 (0.0008) [2023-12-28 04:21:22,074][106225] Updated weights for policy 1, policy_version 1269055 (0.0008) [2023-12-28 04:21:22,227][106226] Updated weights for policy 0, policy_version 1265887 (0.0009) [2023-12-28 04:21:22,294][106226] Updated weights for policy 0, policy_version 1265897 (0.0008) [2023-12-28 04:21:22,363][106226] Updated weights for policy 0, policy_version 1265907 (0.0008) [2023-12-28 04:21:22,822][106225] Updated weights for policy 1, policy_version 1269065 (0.0008) [2023-12-28 04:21:22,888][106225] Updated weights for policy 1, policy_version 1269075 (0.0006) [2023-12-28 04:21:22,946][106225] Updated weights for policy 1, policy_version 1269085 (0.0006) [2023-12-28 04:21:23,003][106225] Updated weights for policy 1, policy_version 1269095 (0.0009) [2023-12-28 04:21:23,078][106226] Updated weights for policy 0, policy_version 1265917 (0.0010) [2023-12-28 04:21:23,139][106226] Updated weights for policy 0, policy_version 1265927 (0.0010) [2023-12-28 04:21:23,201][106226] Updated weights for policy 0, policy_version 1265937 (0.0008) [2023-12-28 04:21:23,627][106225] Updated weights for policy 1, policy_version 1269105 (0.0009) [2023-12-28 04:21:23,683][106225] Updated weights for policy 1, policy_version 1269115 (0.0008) [2023-12-28 04:21:23,743][106225] Updated weights for policy 1, policy_version 1269125 (0.0008) [2023-12-28 04:21:23,888][106226] Updated weights for policy 0, policy_version 1265947 (0.0009) [2023-12-28 04:21:23,953][106226] Updated weights for policy 0, policy_version 1265957 (0.0009) [2023-12-28 04:21:24,014][106226] Updated weights for policy 0, policy_version 1265967 (0.0009) [2023-12-28 04:21:24,486][106225] Updated weights for policy 1, policy_version 1269135 (0.0008) [2023-12-28 04:21:24,545][106225] Updated weights for policy 1, policy_version 1269145 (0.0008) [2023-12-28 04:21:24,600][106225] Updated weights for policy 1, policy_version 1269155 (0.0008) [2023-12-28 04:21:24,714][106226] Updated weights for policy 0, policy_version 1265977 (0.0008) [2023-12-28 04:21:24,773][106226] Updated weights for policy 0, policy_version 1265987 (0.0005) [2023-12-28 04:21:24,827][106226] Updated weights for policy 0, policy_version 1265997 (0.0005) [2023-12-28 04:21:24,881][106226] Updated weights for policy 0, policy_version 1266007 (0.0005) [2023-12-28 04:21:25,420][106225] Updated weights for policy 1, policy_version 1269165 (0.0009) [2023-12-28 04:21:25,425][106226] Updated weights for policy 0, policy_version 1266017 (0.0005) [2023-12-28 04:21:25,472][106225] Updated weights for policy 1, policy_version 1269175 (0.0008) [2023-12-28 04:21:25,487][106226] Updated weights for policy 0, policy_version 1266027 (0.0006) [2023-12-28 04:21:25,515][106225] Updated weights for policy 1, policy_version 1269185 (0.0006) [2023-12-28 04:21:25,542][106226] Updated weights for policy 0, policy_version 1266037 (0.0010) [2023-12-28 04:21:26,131][106226] Updated weights for policy 0, policy_version 1266047 (0.0007) [2023-12-28 04:21:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 649125888. Throughput: 0: 9788.8, 1: 9936.5. Samples: 649099316. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:26,175][105115] Avg episode reward: [(0, '-4.220'), (1, '-4.921')] [2023-12-28 04:21:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001269192_324960256.pth... [2023-12-28 04:21:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001268040_324665344.pth [2023-12-28 04:21:26,195][106226] Updated weights for policy 0, policy_version 1266057 (0.0006) [2023-12-28 04:21:26,261][106226] Updated weights for policy 0, policy_version 1266067 (0.0005) [2023-12-28 04:21:26,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001266072_324173824.pth... [2023-12-28 04:21:26,299][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001264888_323870720.pth [2023-12-28 04:21:26,315][106225] Updated weights for policy 1, policy_version 1269195 (0.0008) [2023-12-28 04:21:26,372][106225] Updated weights for policy 1, policy_version 1269205 (0.0008) [2023-12-28 04:21:26,429][106225] Updated weights for policy 1, policy_version 1269215 (0.0009) [2023-12-28 04:21:26,839][106226] Updated weights for policy 0, policy_version 1266077 (0.0005) [2023-12-28 04:21:26,892][106226] Updated weights for policy 0, policy_version 1266087 (0.0005) [2023-12-28 04:21:26,940][106226] Updated weights for policy 0, policy_version 1266097 (0.0005) [2023-12-28 04:21:27,152][106225] Updated weights for policy 1, policy_version 1269225 (0.0009) [2023-12-28 04:21:27,209][106225] Updated weights for policy 1, policy_version 1269235 (0.0005) [2023-12-28 04:21:27,261][106225] Updated weights for policy 1, policy_version 1269245 (0.0005) [2023-12-28 04:21:27,324][106225] Updated weights for policy 1, policy_version 1269255 (0.0005) [2023-12-28 04:21:27,676][106226] Updated weights for policy 0, policy_version 1266107 (0.0005) [2023-12-28 04:21:27,741][106226] Updated weights for policy 0, policy_version 1266117 (0.0006) [2023-12-28 04:21:27,793][106226] Updated weights for policy 0, policy_version 1266127 (0.0007) [2023-12-28 04:21:28,017][106225] Updated weights for policy 1, policy_version 1269265 (0.0008) [2023-12-28 04:21:28,073][106225] Updated weights for policy 1, policy_version 1269275 (0.0010) [2023-12-28 04:21:28,132][106225] Updated weights for policy 1, policy_version 1269285 (0.0009) [2023-12-28 04:21:28,339][106226] Updated weights for policy 0, policy_version 1266137 (0.0006) [2023-12-28 04:21:28,406][106226] Updated weights for policy 0, policy_version 1266147 (0.0007) [2023-12-28 04:21:28,472][106226] Updated weights for policy 0, policy_version 1266157 (0.0007) [2023-12-28 04:21:28,535][106226] Updated weights for policy 0, policy_version 1266167 (0.0008) [2023-12-28 04:21:28,836][106225] Updated weights for policy 1, policy_version 1269295 (0.0010) [2023-12-28 04:21:28,903][106225] Updated weights for policy 1, policy_version 1269305 (0.0011) [2023-12-28 04:21:28,975][106225] Updated weights for policy 1, policy_version 1269315 (0.0008) [2023-12-28 04:21:29,179][106226] Updated weights for policy 0, policy_version 1266177 (0.0008) [2023-12-28 04:21:29,244][106226] Updated weights for policy 0, policy_version 1266187 (0.0009) [2023-12-28 04:21:29,301][106226] Updated weights for policy 0, policy_version 1266197 (0.0009) [2023-12-28 04:21:29,674][106225] Updated weights for policy 1, policy_version 1269325 (0.0008) [2023-12-28 04:21:29,723][106225] Updated weights for policy 1, policy_version 1269335 (0.0008) [2023-12-28 04:21:29,781][106225] Updated weights for policy 1, policy_version 1269345 (0.0007) [2023-12-28 04:21:30,087][106226] Updated weights for policy 0, policy_version 1266207 (0.0007) [2023-12-28 04:21:30,152][106226] Updated weights for policy 0, policy_version 1266217 (0.0007) [2023-12-28 04:21:30,215][106226] Updated weights for policy 0, policy_version 1266227 (0.0009) [2023-12-28 04:21:30,451][106225] Updated weights for policy 1, policy_version 1269355 (0.0008) [2023-12-28 04:21:30,497][106225] Updated weights for policy 1, policy_version 1269365 (0.0007) [2023-12-28 04:21:30,546][106225] Updated weights for policy 1, policy_version 1269375 (0.0007) [2023-12-28 04:21:30,886][106226] Updated weights for policy 0, policy_version 1266237 (0.0008) [2023-12-28 04:21:30,937][106226] Updated weights for policy 0, policy_version 1266247 (0.0005) [2023-12-28 04:21:30,988][106226] Updated weights for policy 0, policy_version 1266257 (0.0005) [2023-12-28 04:21:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 649232384. Throughput: 0: 9974.7, 1: 9861.5. Samples: 649220544. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:31,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.817')] [2023-12-28 04:21:31,285][106225] Updated weights for policy 1, policy_version 1269385 (0.0008) [2023-12-28 04:21:31,340][106225] Updated weights for policy 1, policy_version 1269395 (0.0008) [2023-12-28 04:21:31,406][106225] Updated weights for policy 1, policy_version 1269405 (0.0008) [2023-12-28 04:21:31,466][106225] Updated weights for policy 1, policy_version 1269415 (0.0009) [2023-12-28 04:21:31,647][106226] Updated weights for policy 0, policy_version 1266267 (0.0007) [2023-12-28 04:21:31,706][106226] Updated weights for policy 0, policy_version 1266277 (0.0009) [2023-12-28 04:21:31,774][106226] Updated weights for policy 0, policy_version 1266287 (0.0008) [2023-12-28 04:21:32,138][106225] Updated weights for policy 1, policy_version 1269425 (0.0006) [2023-12-28 04:21:32,185][106225] Updated weights for policy 1, policy_version 1269435 (0.0005) [2023-12-28 04:21:32,240][106225] Updated weights for policy 1, policy_version 1269445 (0.0008) [2023-12-28 04:21:32,584][106226] Updated weights for policy 0, policy_version 1266297 (0.0010) [2023-12-28 04:21:32,629][106226] Updated weights for policy 0, policy_version 1266307 (0.0008) [2023-12-28 04:21:32,688][106226] Updated weights for policy 0, policy_version 1266317 (0.0009) [2023-12-28 04:21:32,739][106226] Updated weights for policy 0, policy_version 1266327 (0.0009) [2023-12-28 04:21:32,898][106225] Updated weights for policy 1, policy_version 1269455 (0.0006) [2023-12-28 04:21:32,954][106225] Updated weights for policy 1, policy_version 1269465 (0.0005) [2023-12-28 04:21:33,009][106225] Updated weights for policy 1, policy_version 1269475 (0.0005) [2023-12-28 04:21:33,520][106225] Updated weights for policy 1, policy_version 1269485 (0.0006) [2023-12-28 04:21:33,566][106226] Updated weights for policy 0, policy_version 1266337 (0.0007) [2023-12-28 04:21:33,583][106225] Updated weights for policy 1, policy_version 1269495 (0.0007) [2023-12-28 04:21:33,623][106226] Updated weights for policy 0, policy_version 1266347 (0.0007) [2023-12-28 04:21:33,633][106225] Updated weights for policy 1, policy_version 1269505 (0.0007) [2023-12-28 04:21:33,679][106226] Updated weights for policy 0, policy_version 1266357 (0.0008) [2023-12-28 04:21:34,299][106225] Updated weights for policy 1, policy_version 1269515 (0.0007) [2023-12-28 04:21:34,349][106225] Updated weights for policy 1, policy_version 1269525 (0.0006) [2023-12-28 04:21:34,410][106225] Updated weights for policy 1, policy_version 1269535 (0.0008) [2023-12-28 04:21:34,496][106226] Updated weights for policy 0, policy_version 1266367 (0.0008) [2023-12-28 04:21:34,562][106226] Updated weights for policy 0, policy_version 1266377 (0.0010) [2023-12-28 04:21:34,628][106226] Updated weights for policy 0, policy_version 1266387 (0.0009) [2023-12-28 04:21:35,082][106225] Updated weights for policy 1, policy_version 1269545 (0.0009) [2023-12-28 04:21:35,141][106225] Updated weights for policy 1, policy_version 1269555 (0.0009) [2023-12-28 04:21:35,199][106225] Updated weights for policy 1, policy_version 1269565 (0.0008) [2023-12-28 04:21:35,260][106225] Updated weights for policy 1, policy_version 1269575 (0.0009) [2023-12-28 04:21:35,346][106226] Updated weights for policy 0, policy_version 1266397 (0.0009) [2023-12-28 04:21:35,409][106226] Updated weights for policy 0, policy_version 1266407 (0.0009) [2023-12-28 04:21:35,471][106226] Updated weights for policy 0, policy_version 1266417 (0.0009) [2023-12-28 04:21:35,897][106225] Updated weights for policy 1, policy_version 1269585 (0.0008) [2023-12-28 04:21:35,956][106225] Updated weights for policy 1, policy_version 1269595 (0.0009) [2023-12-28 04:21:36,022][106225] Updated weights for policy 1, policy_version 1269605 (0.0008) [2023-12-28 04:21:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 649330688. Throughput: 0: 9906.3, 1: 9985.1. Samples: 649340724. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:36,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.924')] [2023-12-28 04:21:36,220][106226] Updated weights for policy 0, policy_version 1266427 (0.0008) [2023-12-28 04:21:36,282][106226] Updated weights for policy 0, policy_version 1266437 (0.0009) [2023-12-28 04:21:36,343][106226] Updated weights for policy 0, policy_version 1266447 (0.0009) [2023-12-28 04:21:36,746][106225] Updated weights for policy 1, policy_version 1269615 (0.0008) [2023-12-28 04:21:36,797][106225] Updated weights for policy 1, policy_version 1269625 (0.0008) [2023-12-28 04:21:36,857][106225] Updated weights for policy 1, policy_version 1269635 (0.0008) [2023-12-28 04:21:37,049][106226] Updated weights for policy 0, policy_version 1266457 (0.0009) [2023-12-28 04:21:37,108][106226] Updated weights for policy 0, policy_version 1266467 (0.0009) [2023-12-28 04:21:37,162][106226] Updated weights for policy 0, policy_version 1266477 (0.0009) [2023-12-28 04:21:37,212][106226] Updated weights for policy 0, policy_version 1266487 (0.0008) [2023-12-28 04:21:37,574][106225] Updated weights for policy 1, policy_version 1269645 (0.0009) [2023-12-28 04:21:37,622][106225] Updated weights for policy 1, policy_version 1269655 (0.0008) [2023-12-28 04:21:37,674][106225] Updated weights for policy 1, policy_version 1269665 (0.0008) [2023-12-28 04:21:37,974][106226] Updated weights for policy 0, policy_version 1266497 (0.0008) [2023-12-28 04:21:38,023][106226] Updated weights for policy 0, policy_version 1266507 (0.0008) [2023-12-28 04:21:38,087][106226] Updated weights for policy 0, policy_version 1266517 (0.0009) [2023-12-28 04:21:38,367][106225] Updated weights for policy 1, policy_version 1269675 (0.0007) [2023-12-28 04:21:38,424][106225] Updated weights for policy 1, policy_version 1269685 (0.0008) [2023-12-28 04:21:38,472][106225] Updated weights for policy 1, policy_version 1269695 (0.0008) [2023-12-28 04:21:38,859][106226] Updated weights for policy 0, policy_version 1266527 (0.0008) [2023-12-28 04:21:38,908][106226] Updated weights for policy 0, policy_version 1266537 (0.0008) [2023-12-28 04:21:38,967][106226] Updated weights for policy 0, policy_version 1266547 (0.0008) [2023-12-28 04:21:39,199][106225] Updated weights for policy 1, policy_version 1269705 (0.0008) [2023-12-28 04:21:39,264][106225] Updated weights for policy 1, policy_version 1269715 (0.0010) [2023-12-28 04:21:39,333][106225] Updated weights for policy 1, policy_version 1269725 (0.0009) [2023-12-28 04:21:39,409][106225] Updated weights for policy 1, policy_version 1269735 (0.0009) [2023-12-28 04:21:39,813][106226] Updated weights for policy 0, policy_version 1266557 (0.0008) [2023-12-28 04:21:39,877][106226] Updated weights for policy 0, policy_version 1266567 (0.0008) [2023-12-28 04:21:39,933][106226] Updated weights for policy 0, policy_version 1266577 (0.0008) [2023-12-28 04:21:40,124][106225] Updated weights for policy 1, policy_version 1269745 (0.0008) [2023-12-28 04:21:40,186][106225] Updated weights for policy 1, policy_version 1269755 (0.0008) [2023-12-28 04:21:40,247][106225] Updated weights for policy 1, policy_version 1269765 (0.0008) [2023-12-28 04:21:40,679][106226] Updated weights for policy 0, policy_version 1266587 (0.0009) [2023-12-28 04:21:40,735][106226] Updated weights for policy 0, policy_version 1266597 (0.0010) [2023-12-28 04:21:40,790][106226] Updated weights for policy 0, policy_version 1266607 (0.0010) [2023-12-28 04:21:40,975][106225] Updated weights for policy 1, policy_version 1269775 (0.0007) [2023-12-28 04:21:41,033][106225] Updated weights for policy 1, policy_version 1269785 (0.0007) [2023-12-28 04:21:41,095][106225] Updated weights for policy 1, policy_version 1269795 (0.0009) [2023-12-28 04:21:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 649428992. Throughput: 0: 9856.0, 1: 9997.3. Samples: 649397544. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:41,176][105115] Avg episode reward: [(0, '-4.185'), (1, '-5.021')] [2023-12-28 04:21:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001266616_324313088.pth... [2023-12-28 04:21:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001269800_325115904.pth... [2023-12-28 04:21:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001265464_324018176.pth [2023-12-28 04:21:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001268648_324820992.pth [2023-12-28 04:21:41,581][106226] Updated weights for policy 0, policy_version 1266617 (0.0010) [2023-12-28 04:21:41,651][106226] Updated weights for policy 0, policy_version 1266627 (0.0009) [2023-12-28 04:21:41,718][106226] Updated weights for policy 0, policy_version 1266637 (0.0008) [2023-12-28 04:21:41,780][106226] Updated weights for policy 0, policy_version 1266647 (0.0008) [2023-12-28 04:21:41,814][106225] Updated weights for policy 1, policy_version 1269805 (0.0007) [2023-12-28 04:21:41,873][106225] Updated weights for policy 1, policy_version 1269815 (0.0007) [2023-12-28 04:21:41,940][106225] Updated weights for policy 1, policy_version 1269825 (0.0006) [2023-12-28 04:21:42,605][106226] Updated weights for policy 0, policy_version 1266657 (0.0008) [2023-12-28 04:21:42,647][106225] Updated weights for policy 1, policy_version 1269835 (0.0006) [2023-12-28 04:21:42,656][106226] Updated weights for policy 0, policy_version 1266667 (0.0008) [2023-12-28 04:21:42,698][106225] Updated weights for policy 1, policy_version 1269845 (0.0005) [2023-12-28 04:21:42,707][106226] Updated weights for policy 0, policy_version 1266677 (0.0007) [2023-12-28 04:21:42,758][106225] Updated weights for policy 1, policy_version 1269855 (0.0006) [2023-12-28 04:21:43,364][106225] Updated weights for policy 1, policy_version 1269865 (0.0008) [2023-12-28 04:21:43,431][106225] Updated weights for policy 1, policy_version 1269875 (0.0006) [2023-12-28 04:21:43,450][106226] Updated weights for policy 0, policy_version 1266687 (0.0009) [2023-12-28 04:21:43,497][106225] Updated weights for policy 1, policy_version 1269885 (0.0005) [2023-12-28 04:21:43,513][106226] Updated weights for policy 0, policy_version 1266697 (0.0006) [2023-12-28 04:21:43,570][106225] Updated weights for policy 1, policy_version 1269895 (0.0006) [2023-12-28 04:21:43,570][106226] Updated weights for policy 0, policy_version 1266707 (0.0007) [2023-12-28 04:21:44,080][106225] Updated weights for policy 1, policy_version 1269905 (0.0005) [2023-12-28 04:21:44,143][106225] Updated weights for policy 1, policy_version 1269915 (0.0005) [2023-12-28 04:21:44,201][106225] Updated weights for policy 1, policy_version 1269925 (0.0005) [2023-12-28 04:21:44,394][106226] Updated weights for policy 0, policy_version 1266717 (0.0008) [2023-12-28 04:21:44,448][106226] Updated weights for policy 0, policy_version 1266727 (0.0008) [2023-12-28 04:21:44,498][106226] Updated weights for policy 0, policy_version 1266737 (0.0008) [2023-12-28 04:21:44,705][106225] Updated weights for policy 1, policy_version 1269935 (0.0007) [2023-12-28 04:21:44,772][106225] Updated weights for policy 1, policy_version 1269945 (0.0009) [2023-12-28 04:21:44,836][106225] Updated weights for policy 1, policy_version 1269955 (0.0007) [2023-12-28 04:21:45,351][106226] Updated weights for policy 0, policy_version 1266747 (0.0009) [2023-12-28 04:21:45,417][106226] Updated weights for policy 0, policy_version 1266757 (0.0010) [2023-12-28 04:21:45,441][106225] Updated weights for policy 1, policy_version 1269965 (0.0006) [2023-12-28 04:21:45,466][106226] Updated weights for policy 0, policy_version 1266767 (0.0008) [2023-12-28 04:21:45,488][106225] Updated weights for policy 1, policy_version 1269975 (0.0005) [2023-12-28 04:21:45,542][106225] Updated weights for policy 1, policy_version 1269985 (0.0007) [2023-12-28 04:21:46,165][106226] Updated weights for policy 0, policy_version 1266777 (0.0008) [2023-12-28 04:21:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 649519104. Throughput: 0: 9704.3, 1: 9975.1. Samples: 649514048. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:46,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-5.057')] [2023-12-28 04:21:46,219][106225] Updated weights for policy 1, policy_version 1269995 (0.0007) [2023-12-28 04:21:46,223][106226] Updated weights for policy 0, policy_version 1266787 (0.0008) [2023-12-28 04:21:46,273][106225] Updated weights for policy 1, policy_version 1270005 (0.0007) [2023-12-28 04:21:46,287][106226] Updated weights for policy 0, policy_version 1266797 (0.0011) [2023-12-28 04:21:46,320][106225] Updated weights for policy 1, policy_version 1270015 (0.0006) [2023-12-28 04:21:46,343][106226] Updated weights for policy 0, policy_version 1266807 (0.0010) [2023-12-28 04:21:46,911][106226] Updated weights for policy 0, policy_version 1266817 (0.0006) [2023-12-28 04:21:46,927][106225] Updated weights for policy 1, policy_version 1270025 (0.0010) [2023-12-28 04:21:46,962][106226] Updated weights for policy 0, policy_version 1266827 (0.0005) [2023-12-28 04:21:46,978][106225] Updated weights for policy 1, policy_version 1270035 (0.0010) [2023-12-28 04:21:47,019][106226] Updated weights for policy 0, policy_version 1266837 (0.0006) [2023-12-28 04:21:47,022][106225] Updated weights for policy 1, policy_version 1270045 (0.0010) [2023-12-28 04:21:47,073][106225] Updated weights for policy 1, policy_version 1270055 (0.0010) [2023-12-28 04:21:47,614][106226] Updated weights for policy 0, policy_version 1266847 (0.0005) [2023-12-28 04:21:47,668][106226] Updated weights for policy 0, policy_version 1266857 (0.0005) [2023-12-28 04:21:47,721][106226] Updated weights for policy 0, policy_version 1266867 (0.0010) [2023-12-28 04:21:47,847][106225] Updated weights for policy 1, policy_version 1270065 (0.0008) [2023-12-28 04:21:47,905][106225] Updated weights for policy 1, policy_version 1270075 (0.0008) [2023-12-28 04:21:47,967][106225] Updated weights for policy 1, policy_version 1270085 (0.0008) [2023-12-28 04:21:48,308][106226] Updated weights for policy 0, policy_version 1266877 (0.0008) [2023-12-28 04:21:48,373][106226] Updated weights for policy 0, policy_version 1266887 (0.0009) [2023-12-28 04:21:48,431][106226] Updated weights for policy 0, policy_version 1266897 (0.0010) [2023-12-28 04:21:48,730][106225] Updated weights for policy 1, policy_version 1270095 (0.0008) [2023-12-28 04:21:48,784][106225] Updated weights for policy 1, policy_version 1270105 (0.0009) [2023-12-28 04:21:48,842][106225] Updated weights for policy 1, policy_version 1270115 (0.0009) [2023-12-28 04:21:49,041][106226] Updated weights for policy 0, policy_version 1266907 (0.0008) [2023-12-28 04:21:49,109][106226] Updated weights for policy 0, policy_version 1266917 (0.0006) [2023-12-28 04:21:49,177][106226] Updated weights for policy 0, policy_version 1266927 (0.0005) [2023-12-28 04:21:49,665][106225] Updated weights for policy 1, policy_version 1270125 (0.0008) [2023-12-28 04:21:49,718][106225] Updated weights for policy 1, policy_version 1270135 (0.0010) [2023-12-28 04:21:49,766][106225] Updated weights for policy 1, policy_version 1270145 (0.0010) [2023-12-28 04:21:49,863][106226] Updated weights for policy 0, policy_version 1266937 (0.0008) [2023-12-28 04:21:49,933][106226] Updated weights for policy 0, policy_version 1266947 (0.0011) [2023-12-28 04:21:49,998][106226] Updated weights for policy 0, policy_version 1266957 (0.0008) [2023-12-28 04:21:50,061][106226] Updated weights for policy 0, policy_version 1266967 (0.0007) [2023-12-28 04:21:50,517][106225] Updated weights for policy 1, policy_version 1270155 (0.0008) [2023-12-28 04:21:50,579][106225] Updated weights for policy 1, policy_version 1270165 (0.0008) [2023-12-28 04:21:50,648][106225] Updated weights for policy 1, policy_version 1270175 (0.0010) [2023-12-28 04:21:50,799][106226] Updated weights for policy 0, policy_version 1266977 (0.0009) [2023-12-28 04:21:50,850][106226] Updated weights for policy 0, policy_version 1266987 (0.0010) [2023-12-28 04:21:50,905][106226] Updated weights for policy 0, policy_version 1266997 (0.0008) [2023-12-28 04:21:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 649625600. Throughput: 0: 9750.4, 1: 9963.8. Samples: 649635016. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:51,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-5.206')] [2023-12-28 04:21:51,320][106225] Updated weights for policy 1, policy_version 1270185 (0.0010) [2023-12-28 04:21:51,388][106225] Updated weights for policy 1, policy_version 1270195 (0.0010) [2023-12-28 04:21:51,455][106225] Updated weights for policy 1, policy_version 1270205 (0.0008) [2023-12-28 04:21:51,528][106225] Updated weights for policy 1, policy_version 1270215 (0.0006) [2023-12-28 04:21:51,580][106226] Updated weights for policy 0, policy_version 1267007 (0.0005) [2023-12-28 04:21:51,644][106226] Updated weights for policy 0, policy_version 1267017 (0.0007) [2023-12-28 04:21:51,713][106226] Updated weights for policy 0, policy_version 1267027 (0.0007) [2023-12-28 04:21:52,205][106225] Updated weights for policy 1, policy_version 1270225 (0.0010) [2023-12-28 04:21:52,270][106225] Updated weights for policy 1, policy_version 1270235 (0.0008) [2023-12-28 04:21:52,329][106225] Updated weights for policy 1, policy_version 1270245 (0.0008) [2023-12-28 04:21:52,383][106226] Updated weights for policy 0, policy_version 1267037 (0.0008) [2023-12-28 04:21:52,447][106226] Updated weights for policy 0, policy_version 1267047 (0.0009) [2023-12-28 04:21:52,517][106226] Updated weights for policy 0, policy_version 1267057 (0.0009) [2023-12-28 04:21:53,073][106225] Updated weights for policy 1, policy_version 1270255 (0.0008) [2023-12-28 04:21:53,127][106225] Updated weights for policy 1, policy_version 1270265 (0.0008) [2023-12-28 04:21:53,177][106225] Updated weights for policy 1, policy_version 1270275 (0.0007) [2023-12-28 04:21:53,231][106226] Updated weights for policy 0, policy_version 1267067 (0.0009) [2023-12-28 04:21:53,281][106226] Updated weights for policy 0, policy_version 1267077 (0.0008) [2023-12-28 04:21:53,337][106226] Updated weights for policy 0, policy_version 1267087 (0.0009) [2023-12-28 04:21:53,840][106225] Updated weights for policy 1, policy_version 1270285 (0.0007) [2023-12-28 04:21:53,898][106225] Updated weights for policy 1, policy_version 1270295 (0.0008) [2023-12-28 04:21:53,956][106225] Updated weights for policy 1, policy_version 1270305 (0.0008) [2023-12-28 04:21:54,075][106226] Updated weights for policy 0, policy_version 1267097 (0.0009) [2023-12-28 04:21:54,126][106226] Updated weights for policy 0, policy_version 1267107 (0.0009) [2023-12-28 04:21:54,182][106226] Updated weights for policy 0, policy_version 1267117 (0.0009) [2023-12-28 04:21:54,239][106226] Updated weights for policy 0, policy_version 1267127 (0.0008) [2023-12-28 04:21:54,548][106225] Updated weights for policy 1, policy_version 1270315 (0.0008) [2023-12-28 04:21:54,603][106225] Updated weights for policy 1, policy_version 1270325 (0.0008) [2023-12-28 04:21:54,665][106225] Updated weights for policy 1, policy_version 1270335 (0.0008) [2023-12-28 04:21:55,039][106226] Updated weights for policy 0, policy_version 1267137 (0.0006) [2023-12-28 04:21:55,102][106226] Updated weights for policy 0, policy_version 1267147 (0.0005) [2023-12-28 04:21:55,164][106226] Updated weights for policy 0, policy_version 1267157 (0.0006) [2023-12-28 04:21:55,363][106225] Updated weights for policy 1, policy_version 1270345 (0.0008) [2023-12-28 04:21:55,419][106225] Updated weights for policy 1, policy_version 1270355 (0.0008) [2023-12-28 04:21:55,480][106225] Updated weights for policy 1, policy_version 1270365 (0.0010) [2023-12-28 04:21:55,528][106225] Updated weights for policy 1, policy_version 1270375 (0.0008) [2023-12-28 04:21:55,744][106226] Updated weights for policy 0, policy_version 1267167 (0.0009) [2023-12-28 04:21:55,794][106226] Updated weights for policy 0, policy_version 1267177 (0.0010) [2023-12-28 04:21:55,844][106226] Updated weights for policy 0, policy_version 1267187 (0.0006) [2023-12-28 04:21:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 649723904. Throughput: 0: 9778.0, 1: 9947.2. Samples: 649694212. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:21:56,175][105115] Avg episode reward: [(0, '-3.848'), (1, '-5.041')] [2023-12-28 04:21:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001267192_324460544.pth... [2023-12-28 04:21:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001270376_325263360.pth... [2023-12-28 04:21:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001269192_324960256.pth [2023-12-28 04:21:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001266072_324173824.pth [2023-12-28 04:21:56,186][106140] Saving new best policy, reward=-3.848! [2023-12-28 04:21:56,261][106225] Updated weights for policy 1, policy_version 1270385 (0.0007) [2023-12-28 04:21:56,319][106225] Updated weights for policy 1, policy_version 1270395 (0.0005) [2023-12-28 04:21:56,380][106225] Updated weights for policy 1, policy_version 1270405 (0.0005) [2023-12-28 04:21:56,570][106226] Updated weights for policy 0, policy_version 1267197 (0.0007) [2023-12-28 04:21:56,619][106226] Updated weights for policy 0, policy_version 1267207 (0.0005) [2023-12-28 04:21:56,672][106226] Updated weights for policy 0, policy_version 1267217 (0.0005) [2023-12-28 04:21:56,937][106225] Updated weights for policy 1, policy_version 1270415 (0.0006) [2023-12-28 04:21:56,989][106225] Updated weights for policy 1, policy_version 1270425 (0.0006) [2023-12-28 04:21:57,037][106225] Updated weights for policy 1, policy_version 1270435 (0.0008) [2023-12-28 04:21:57,325][106226] Updated weights for policy 0, policy_version 1267227 (0.0006) [2023-12-28 04:21:57,386][106226] Updated weights for policy 0, policy_version 1267237 (0.0006) [2023-12-28 04:21:57,443][106226] Updated weights for policy 0, policy_version 1267247 (0.0007) [2023-12-28 04:21:57,791][106225] Updated weights for policy 1, policy_version 1270445 (0.0008) [2023-12-28 04:21:57,847][106225] Updated weights for policy 1, policy_version 1270455 (0.0008) [2023-12-28 04:21:57,910][106225] Updated weights for policy 1, policy_version 1270465 (0.0005) [2023-12-28 04:21:58,086][106226] Updated weights for policy 0, policy_version 1267257 (0.0006) [2023-12-28 04:21:58,140][106226] Updated weights for policy 0, policy_version 1267267 (0.0008) [2023-12-28 04:21:58,184][106226] Updated weights for policy 0, policy_version 1267277 (0.0008) [2023-12-28 04:21:58,244][106226] Updated weights for policy 0, policy_version 1267287 (0.0008) [2023-12-28 04:21:58,678][106225] Updated weights for policy 1, policy_version 1270475 (0.0007) [2023-12-28 04:21:58,741][106225] Updated weights for policy 1, policy_version 1270485 (0.0007) [2023-12-28 04:21:58,809][106225] Updated weights for policy 1, policy_version 1270495 (0.0007) [2023-12-28 04:21:59,080][106226] Updated weights for policy 0, policy_version 1267297 (0.0010) [2023-12-28 04:21:59,133][106226] Updated weights for policy 0, policy_version 1267307 (0.0010) [2023-12-28 04:21:59,193][106226] Updated weights for policy 0, policy_version 1267317 (0.0010) [2023-12-28 04:21:59,544][106225] Updated weights for policy 1, policy_version 1270505 (0.0007) [2023-12-28 04:21:59,603][106225] Updated weights for policy 1, policy_version 1270515 (0.0006) [2023-12-28 04:21:59,661][106225] Updated weights for policy 1, policy_version 1270525 (0.0007) [2023-12-28 04:21:59,721][106225] Updated weights for policy 1, policy_version 1270535 (0.0010) [2023-12-28 04:22:00,044][106226] Updated weights for policy 0, policy_version 1267327 (0.0010) [2023-12-28 04:22:00,101][106226] Updated weights for policy 0, policy_version 1267337 (0.0010) [2023-12-28 04:22:00,168][106226] Updated weights for policy 0, policy_version 1267347 (0.0010) [2023-12-28 04:22:00,424][106225] Updated weights for policy 1, policy_version 1270545 (0.0008) [2023-12-28 04:22:00,471][106225] Updated weights for policy 1, policy_version 1270555 (0.0007) [2023-12-28 04:22:00,529][106225] Updated weights for policy 1, policy_version 1270565 (0.0007) [2023-12-28 04:22:00,855][106226] Updated weights for policy 0, policy_version 1267357 (0.0008) [2023-12-28 04:22:00,909][106226] Updated weights for policy 0, policy_version 1267367 (0.0005) [2023-12-28 04:22:00,952][106226] Updated weights for policy 0, policy_version 1267377 (0.0005) [2023-12-28 04:22:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 649822208. Throughput: 0: 9734.5, 1: 9962.9. Samples: 649812288. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:01,175][105115] Avg episode reward: [(0, '-3.944'), (1, '-5.189')] [2023-12-28 04:22:01,356][106225] Updated weights for policy 1, policy_version 1270575 (0.0008) [2023-12-28 04:22:01,417][106225] Updated weights for policy 1, policy_version 1270585 (0.0008) [2023-12-28 04:22:01,467][106225] Updated weights for policy 1, policy_version 1270595 (0.0009) [2023-12-28 04:22:01,564][106226] Updated weights for policy 0, policy_version 1267387 (0.0007) [2023-12-28 04:22:01,619][106226] Updated weights for policy 0, policy_version 1267397 (0.0012) [2023-12-28 04:22:01,689][106226] Updated weights for policy 0, policy_version 1267407 (0.0009) [2023-12-28 04:22:02,246][106225] Updated weights for policy 1, policy_version 1270605 (0.0008) [2023-12-28 04:22:02,310][106225] Updated weights for policy 1, policy_version 1270615 (0.0009) [2023-12-28 04:22:02,372][106225] Updated weights for policy 1, policy_version 1270625 (0.0009) [2023-12-28 04:22:02,464][106226] Updated weights for policy 0, policy_version 1267417 (0.0009) [2023-12-28 04:22:02,537][106226] Updated weights for policy 0, policy_version 1267427 (0.0011) [2023-12-28 04:22:02,608][106226] Updated weights for policy 0, policy_version 1267437 (0.0010) [2023-12-28 04:22:02,674][106226] Updated weights for policy 0, policy_version 1267447 (0.0009) [2023-12-28 04:22:02,972][106225] Updated weights for policy 1, policy_version 1270635 (0.0008) [2023-12-28 04:22:03,036][106225] Updated weights for policy 1, policy_version 1270645 (0.0008) [2023-12-28 04:22:03,089][106225] Updated weights for policy 1, policy_version 1270655 (0.0009) [2023-12-28 04:22:03,360][106226] Updated weights for policy 0, policy_version 1267457 (0.0008) [2023-12-28 04:22:03,408][106226] Updated weights for policy 0, policy_version 1267467 (0.0008) [2023-12-28 04:22:03,454][106226] Updated weights for policy 0, policy_version 1267477 (0.0008) [2023-12-28 04:22:03,801][106225] Updated weights for policy 1, policy_version 1270665 (0.0009) [2023-12-28 04:22:03,861][106225] Updated weights for policy 1, policy_version 1270675 (0.0010) [2023-12-28 04:22:03,931][106225] Updated weights for policy 1, policy_version 1270685 (0.0011) [2023-12-28 04:22:03,995][106225] Updated weights for policy 1, policy_version 1270695 (0.0010) [2023-12-28 04:22:04,112][106226] Updated weights for policy 0, policy_version 1267487 (0.0008) [2023-12-28 04:22:04,177][106226] Updated weights for policy 0, policy_version 1267497 (0.0008) [2023-12-28 04:22:04,235][106226] Updated weights for policy 0, policy_version 1267507 (0.0008) [2023-12-28 04:22:04,681][106225] Updated weights for policy 1, policy_version 1270705 (0.0006) [2023-12-28 04:22:04,737][106225] Updated weights for policy 1, policy_version 1270715 (0.0005) [2023-12-28 04:22:04,803][106225] Updated weights for policy 1, policy_version 1270725 (0.0005) [2023-12-28 04:22:05,031][106226] Updated weights for policy 0, policy_version 1267517 (0.0008) [2023-12-28 04:22:05,099][106226] Updated weights for policy 0, policy_version 1267527 (0.0009) [2023-12-28 04:22:05,160][106226] Updated weights for policy 0, policy_version 1267537 (0.0009) [2023-12-28 04:22:05,355][106225] Updated weights for policy 1, policy_version 1270735 (0.0005) [2023-12-28 04:22:05,410][106225] Updated weights for policy 1, policy_version 1270745 (0.0005) [2023-12-28 04:22:05,458][106225] Updated weights for policy 1, policy_version 1270755 (0.0005) [2023-12-28 04:22:05,960][106226] Updated weights for policy 0, policy_version 1267547 (0.0009) [2023-12-28 04:22:06,014][106226] Updated weights for policy 0, policy_version 1267557 (0.0007) [2023-12-28 04:22:06,023][106225] Updated weights for policy 1, policy_version 1270765 (0.0007) [2023-12-28 04:22:06,065][106226] Updated weights for policy 0, policy_version 1267567 (0.0005) [2023-12-28 04:22:06,075][106225] Updated weights for policy 1, policy_version 1270775 (0.0007) [2023-12-28 04:22:06,143][106225] Updated weights for policy 1, policy_version 1270785 (0.0008) [2023-12-28 04:22:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 649920512. Throughput: 0: 9718.1, 1: 9981.3. Samples: 649930660. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:06,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-5.243')] [2023-12-28 04:22:06,820][106225] Updated weights for policy 1, policy_version 1270795 (0.0008) [2023-12-28 04:22:06,871][106226] Updated weights for policy 0, policy_version 1267577 (0.0006) [2023-12-28 04:22:06,877][106225] Updated weights for policy 1, policy_version 1270805 (0.0009) [2023-12-28 04:22:06,932][106226] Updated weights for policy 0, policy_version 1267587 (0.0008) [2023-12-28 04:22:06,939][106225] Updated weights for policy 1, policy_version 1270815 (0.0007) [2023-12-28 04:22:06,991][106226] Updated weights for policy 0, policy_version 1267597 (0.0007) [2023-12-28 04:22:07,053][106226] Updated weights for policy 0, policy_version 1267607 (0.0009) [2023-12-28 04:22:07,636][106225] Updated weights for policy 1, policy_version 1270825 (0.0006) [2023-12-28 04:22:07,698][106225] Updated weights for policy 1, policy_version 1270835 (0.0009) [2023-12-28 04:22:07,757][106225] Updated weights for policy 1, policy_version 1270845 (0.0008) [2023-12-28 04:22:07,789][106226] Updated weights for policy 0, policy_version 1267617 (0.0009) [2023-12-28 04:22:07,813][106225] Updated weights for policy 1, policy_version 1270855 (0.0005) [2023-12-28 04:22:07,840][106226] Updated weights for policy 0, policy_version 1267627 (0.0008) [2023-12-28 04:22:07,893][106226] Updated weights for policy 0, policy_version 1267637 (0.0008) [2023-12-28 04:22:08,463][106225] Updated weights for policy 1, policy_version 1270865 (0.0005) [2023-12-28 04:22:08,530][106225] Updated weights for policy 1, policy_version 1270875 (0.0005) [2023-12-28 04:22:08,589][106225] Updated weights for policy 1, policy_version 1270885 (0.0008) [2023-12-28 04:22:08,645][106226] Updated weights for policy 0, policy_version 1267647 (0.0006) [2023-12-28 04:22:08,707][106226] Updated weights for policy 0, policy_version 1267657 (0.0008) [2023-12-28 04:22:08,771][106226] Updated weights for policy 0, policy_version 1267667 (0.0009) [2023-12-28 04:22:09,158][106225] Updated weights for policy 1, policy_version 1270895 (0.0009) [2023-12-28 04:22:09,219][106225] Updated weights for policy 1, policy_version 1270905 (0.0008) [2023-12-28 04:22:09,291][106225] Updated weights for policy 1, policy_version 1270915 (0.0010) [2023-12-28 04:22:09,399][106226] Updated weights for policy 0, policy_version 1267677 (0.0008) [2023-12-28 04:22:09,460][106226] Updated weights for policy 0, policy_version 1267687 (0.0008) [2023-12-28 04:22:09,519][106226] Updated weights for policy 0, policy_version 1267697 (0.0008) [2023-12-28 04:22:10,055][106225] Updated weights for policy 1, policy_version 1270925 (0.0007) [2023-12-28 04:22:10,107][106225] Updated weights for policy 1, policy_version 1270935 (0.0008) [2023-12-28 04:22:10,168][106225] Updated weights for policy 1, policy_version 1270945 (0.0008) [2023-12-28 04:22:10,305][106226] Updated weights for policy 0, policy_version 1267707 (0.0008) [2023-12-28 04:22:10,374][106226] Updated weights for policy 0, policy_version 1267717 (0.0008) [2023-12-28 04:22:10,443][106226] Updated weights for policy 0, policy_version 1267727 (0.0008) [2023-12-28 04:22:10,891][106225] Updated weights for policy 1, policy_version 1270955 (0.0008) [2023-12-28 04:22:10,948][106225] Updated weights for policy 1, policy_version 1270965 (0.0009) [2023-12-28 04:22:11,008][106225] Updated weights for policy 1, policy_version 1270975 (0.0008) [2023-12-28 04:22:11,115][106226] Updated weights for policy 0, policy_version 1267737 (0.0009) [2023-12-28 04:22:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 650018816. Throughput: 0: 9745.2, 1: 10060.8. Samples: 649990584. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:11,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-5.108')] [2023-12-28 04:22:11,180][106226] Updated weights for policy 0, policy_version 1267747 (0.0009) [2023-12-28 04:22:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001270984_325419008.pth... [2023-12-28 04:22:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001269800_325115904.pth [2023-12-28 04:22:11,244][106226] Updated weights for policy 0, policy_version 1267757 (0.0010) [2023-12-28 04:22:11,313][106226] Updated weights for policy 0, policy_version 1267767 (0.0008) [2023-12-28 04:22:11,318][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001267768_324608000.pth... [2023-12-28 04:22:11,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001266616_324313088.pth [2023-12-28 04:22:11,835][106225] Updated weights for policy 1, policy_version 1270985 (0.0009) [2023-12-28 04:22:11,892][106225] Updated weights for policy 1, policy_version 1270995 (0.0008) [2023-12-28 04:22:11,951][106225] Updated weights for policy 1, policy_version 1271005 (0.0009) [2023-12-28 04:22:12,007][106225] Updated weights for policy 1, policy_version 1271015 (0.0007) [2023-12-28 04:22:12,042][106226] Updated weights for policy 0, policy_version 1267777 (0.0007) [2023-12-28 04:22:12,101][106226] Updated weights for policy 0, policy_version 1267787 (0.0009) [2023-12-28 04:22:12,163][106226] Updated weights for policy 0, policy_version 1267797 (0.0008) [2023-12-28 04:22:12,783][106225] Updated weights for policy 1, policy_version 1271025 (0.0010) [2023-12-28 04:22:12,855][106225] Updated weights for policy 1, policy_version 1271035 (0.0010) [2023-12-28 04:22:12,886][106226] Updated weights for policy 0, policy_version 1267807 (0.0006) [2023-12-28 04:22:12,916][106225] Updated weights for policy 1, policy_version 1271045 (0.0008) [2023-12-28 04:22:12,939][106226] Updated weights for policy 0, policy_version 1267817 (0.0006) [2023-12-28 04:22:12,991][106226] Updated weights for policy 0, policy_version 1267827 (0.0008) [2023-12-28 04:22:13,530][106225] Updated weights for policy 1, policy_version 1271055 (0.0008) [2023-12-28 04:22:13,585][106225] Updated weights for policy 1, policy_version 1271065 (0.0010) [2023-12-28 04:22:13,646][106225] Updated weights for policy 1, policy_version 1271075 (0.0005) [2023-12-28 04:22:13,737][106226] Updated weights for policy 0, policy_version 1267837 (0.0007) [2023-12-28 04:22:13,795][106226] Updated weights for policy 0, policy_version 1267847 (0.0008) [2023-12-28 04:22:13,845][106226] Updated weights for policy 0, policy_version 1267857 (0.0008) [2023-12-28 04:22:14,344][106225] Updated weights for policy 1, policy_version 1271085 (0.0008) [2023-12-28 04:22:14,396][106225] Updated weights for policy 1, policy_version 1271095 (0.0008) [2023-12-28 04:22:14,450][106225] Updated weights for policy 1, policy_version 1271105 (0.0008) [2023-12-28 04:22:14,508][106226] Updated weights for policy 0, policy_version 1267867 (0.0008) [2023-12-28 04:22:14,574][106226] Updated weights for policy 0, policy_version 1267877 (0.0005) [2023-12-28 04:22:14,642][106226] Updated weights for policy 0, policy_version 1267887 (0.0006) [2023-12-28 04:22:15,183][106225] Updated weights for policy 1, policy_version 1271115 (0.0008) [2023-12-28 04:22:15,225][106226] Updated weights for policy 0, policy_version 1267897 (0.0005) [2023-12-28 04:22:15,245][106225] Updated weights for policy 1, policy_version 1271125 (0.0007) [2023-12-28 04:22:15,276][106226] Updated weights for policy 0, policy_version 1267907 (0.0005) [2023-12-28 04:22:15,303][106225] Updated weights for policy 1, policy_version 1271135 (0.0007) [2023-12-28 04:22:15,328][106226] Updated weights for policy 0, policy_version 1267917 (0.0006) [2023-12-28 04:22:15,388][106226] Updated weights for policy 0, policy_version 1267927 (0.0007) [2023-12-28 04:22:15,980][106225] Updated weights for policy 1, policy_version 1271145 (0.0006) [2023-12-28 04:22:16,025][106226] Updated weights for policy 0, policy_version 1267937 (0.0005) [2023-12-28 04:22:16,027][106225] Updated weights for policy 1, policy_version 1271155 (0.0008) [2023-12-28 04:22:16,072][106225] Updated weights for policy 1, policy_version 1271165 (0.0007) [2023-12-28 04:22:16,090][106226] Updated weights for policy 0, policy_version 1267947 (0.0005) [2023-12-28 04:22:16,120][106225] Updated weights for policy 1, policy_version 1271175 (0.0007) [2023-12-28 04:22:16,155][106226] Updated weights for policy 0, policy_version 1267957 (0.0006) [2023-12-28 04:22:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 650117120. Throughput: 0: 9613.0, 1: 10092.8. Samples: 650107304. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:16,175][105115] Avg episode reward: [(0, '-4.302'), (1, '-5.221')] [2023-12-28 04:22:16,770][106226] Updated weights for policy 0, policy_version 1267967 (0.0006) [2023-12-28 04:22:16,824][106226] Updated weights for policy 0, policy_version 1267977 (0.0005) [2023-12-28 04:22:16,884][106226] Updated weights for policy 0, policy_version 1267987 (0.0006) [2023-12-28 04:22:16,899][106225] Updated weights for policy 1, policy_version 1271185 (0.0008) [2023-12-28 04:22:16,949][106225] Updated weights for policy 1, policy_version 1271195 (0.0007) [2023-12-28 04:22:16,997][106225] Updated weights for policy 1, policy_version 1271205 (0.0008) [2023-12-28 04:22:17,574][106226] Updated weights for policy 0, policy_version 1267997 (0.0008) [2023-12-28 04:22:17,637][106226] Updated weights for policy 0, policy_version 1268007 (0.0005) [2023-12-28 04:22:17,689][106226] Updated weights for policy 0, policy_version 1268017 (0.0006) [2023-12-28 04:22:17,689][106225] Updated weights for policy 1, policy_version 1271215 (0.0008) [2023-12-28 04:22:17,743][106225] Updated weights for policy 1, policy_version 1271225 (0.0007) [2023-12-28 04:22:17,796][106225] Updated weights for policy 1, policy_version 1271235 (0.0008) [2023-12-28 04:22:18,334][106226] Updated weights for policy 0, policy_version 1268027 (0.0009) [2023-12-28 04:22:18,389][106226] Updated weights for policy 0, policy_version 1268037 (0.0009) [2023-12-28 04:22:18,451][106226] Updated weights for policy 0, policy_version 1268047 (0.0011) [2023-12-28 04:22:18,511][106225] Updated weights for policy 1, policy_version 1271245 (0.0007) [2023-12-28 04:22:18,571][106225] Updated weights for policy 1, policy_version 1271255 (0.0008) [2023-12-28 04:22:18,632][106225] Updated weights for policy 1, policy_version 1271265 (0.0008) [2023-12-28 04:22:19,177][106226] Updated weights for policy 0, policy_version 1268057 (0.0010) [2023-12-28 04:22:19,233][106226] Updated weights for policy 0, policy_version 1268067 (0.0007) [2023-12-28 04:22:19,287][106226] Updated weights for policy 0, policy_version 1268077 (0.0006) [2023-12-28 04:22:19,342][106226] Updated weights for policy 0, policy_version 1268087 (0.0006) [2023-12-28 04:22:19,398][106225] Updated weights for policy 1, policy_version 1271275 (0.0007) [2023-12-28 04:22:19,462][106225] Updated weights for policy 1, policy_version 1271285 (0.0006) [2023-12-28 04:22:19,527][106225] Updated weights for policy 1, policy_version 1271295 (0.0009) [2023-12-28 04:22:20,030][106226] Updated weights for policy 0, policy_version 1268097 (0.0008) [2023-12-28 04:22:20,090][106226] Updated weights for policy 0, policy_version 1268107 (0.0009) [2023-12-28 04:22:20,146][106226] Updated weights for policy 0, policy_version 1268117 (0.0009) [2023-12-28 04:22:20,300][106225] Updated weights for policy 1, policy_version 1271305 (0.0008) [2023-12-28 04:22:20,370][106225] Updated weights for policy 1, policy_version 1271315 (0.0008) [2023-12-28 04:22:20,437][106225] Updated weights for policy 1, policy_version 1271325 (0.0009) [2023-12-28 04:22:20,495][106225] Updated weights for policy 1, policy_version 1271335 (0.0009) [2023-12-28 04:22:20,799][106226] Updated weights for policy 0, policy_version 1268127 (0.0009) [2023-12-28 04:22:20,861][106226] Updated weights for policy 0, policy_version 1268137 (0.0008) [2023-12-28 04:22:20,920][106226] Updated weights for policy 0, policy_version 1268147 (0.0008) [2023-12-28 04:22:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 650215424. Throughput: 0: 9721.4, 1: 9927.3. Samples: 650224916. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:21,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-4.971')] [2023-12-28 04:22:21,255][106225] Updated weights for policy 1, policy_version 1271345 (0.0008) [2023-12-28 04:22:21,319][106225] Updated weights for policy 1, policy_version 1271355 (0.0011) [2023-12-28 04:22:21,387][106225] Updated weights for policy 1, policy_version 1271365 (0.0008) [2023-12-28 04:22:21,749][106226] Updated weights for policy 0, policy_version 1268157 (0.0008) [2023-12-28 04:22:21,823][106226] Updated weights for policy 0, policy_version 1268167 (0.0009) [2023-12-28 04:22:21,891][106226] Updated weights for policy 0, policy_version 1268177 (0.0006) [2023-12-28 04:22:22,136][106225] Updated weights for policy 1, policy_version 1271375 (0.0006) [2023-12-28 04:22:22,202][106225] Updated weights for policy 1, policy_version 1271385 (0.0006) [2023-12-28 04:22:22,266][106225] Updated weights for policy 1, policy_version 1271395 (0.0008) [2023-12-28 04:22:22,674][106226] Updated weights for policy 0, policy_version 1268187 (0.0008) [2023-12-28 04:22:22,741][106226] Updated weights for policy 0, policy_version 1268197 (0.0011) [2023-12-28 04:22:22,803][106226] Updated weights for policy 0, policy_version 1268207 (0.0011) [2023-12-28 04:22:22,932][106225] Updated weights for policy 1, policy_version 1271405 (0.0011) [2023-12-28 04:22:22,987][106225] Updated weights for policy 1, policy_version 1271415 (0.0010) [2023-12-28 04:22:23,047][106225] Updated weights for policy 1, policy_version 1271425 (0.0010) [2023-12-28 04:22:23,516][106226] Updated weights for policy 0, policy_version 1268217 (0.0011) [2023-12-28 04:22:23,569][106226] Updated weights for policy 0, policy_version 1268227 (0.0010) [2023-12-28 04:22:23,623][106226] Updated weights for policy 0, policy_version 1268237 (0.0010) [2023-12-28 04:22:23,677][106226] Updated weights for policy 0, policy_version 1268247 (0.0010) [2023-12-28 04:22:23,738][106225] Updated weights for policy 1, policy_version 1271435 (0.0009) [2023-12-28 04:22:23,790][106225] Updated weights for policy 1, policy_version 1271445 (0.0007) [2023-12-28 04:22:23,836][106225] Updated weights for policy 1, policy_version 1271455 (0.0007) [2023-12-28 04:22:24,373][106226] Updated weights for policy 0, policy_version 1268257 (0.0006) [2023-12-28 04:22:24,425][106226] Updated weights for policy 0, policy_version 1268267 (0.0008) [2023-12-28 04:22:24,479][106226] Updated weights for policy 0, policy_version 1268277 (0.0006) [2023-12-28 04:22:24,515][106225] Updated weights for policy 1, policy_version 1271465 (0.0008) [2023-12-28 04:22:24,561][106225] Updated weights for policy 1, policy_version 1271475 (0.0010) [2023-12-28 04:22:24,611][106225] Updated weights for policy 1, policy_version 1271485 (0.0010) [2023-12-28 04:22:24,660][106225] Updated weights for policy 1, policy_version 1271495 (0.0010) [2023-12-28 04:22:25,101][106226] Updated weights for policy 0, policy_version 1268287 (0.0007) [2023-12-28 04:22:25,160][106226] Updated weights for policy 0, policy_version 1268297 (0.0008) [2023-12-28 04:22:25,219][106226] Updated weights for policy 0, policy_version 1268307 (0.0008) [2023-12-28 04:22:25,316][106225] Updated weights for policy 1, policy_version 1271505 (0.0010) [2023-12-28 04:22:25,373][106225] Updated weights for policy 1, policy_version 1271515 (0.0008) [2023-12-28 04:22:25,431][106225] Updated weights for policy 1, policy_version 1271525 (0.0005) [2023-12-28 04:22:25,979][106226] Updated weights for policy 0, policy_version 1268317 (0.0008) [2023-12-28 04:22:26,039][106226] Updated weights for policy 0, policy_version 1268327 (0.0007) [2023-12-28 04:22:26,061][106225] Updated weights for policy 1, policy_version 1271535 (0.0009) [2023-12-28 04:22:26,102][106226] Updated weights for policy 0, policy_version 1268337 (0.0005) [2023-12-28 04:22:26,112][106225] Updated weights for policy 1, policy_version 1271545 (0.0010) [2023-12-28 04:22:26,168][106225] Updated weights for policy 1, policy_version 1271555 (0.0010) [2023-12-28 04:22:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 650313728. Throughput: 0: 9708.9, 1: 9942.4. Samples: 650281852. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:26,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.208')] [2023-12-28 04:22:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001268344_324755456.pth... [2023-12-28 04:22:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001267192_324460544.pth [2023-12-28 04:22:26,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001271560_325566464.pth... [2023-12-28 04:22:26,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001270376_325263360.pth [2023-12-28 04:22:26,791][106226] Updated weights for policy 0, policy_version 1268347 (0.0006) [2023-12-28 04:22:26,850][106226] Updated weights for policy 0, policy_version 1268357 (0.0007) [2023-12-28 04:22:26,894][106225] Updated weights for policy 1, policy_version 1271565 (0.0010) [2023-12-28 04:22:26,900][106226] Updated weights for policy 0, policy_version 1268367 (0.0006) [2023-12-28 04:22:26,943][106225] Updated weights for policy 1, policy_version 1271575 (0.0010) [2023-12-28 04:22:26,988][106225] Updated weights for policy 1, policy_version 1271585 (0.0010) [2023-12-28 04:22:27,619][106225] Updated weights for policy 1, policy_version 1271595 (0.0010) [2023-12-28 04:22:27,674][106226] Updated weights for policy 0, policy_version 1268377 (0.0006) [2023-12-28 04:22:27,686][106225] Updated weights for policy 1, policy_version 1271605 (0.0008) [2023-12-28 04:22:27,738][106226] Updated weights for policy 0, policy_version 1268387 (0.0011) [2023-12-28 04:22:27,754][106225] Updated weights for policy 1, policy_version 1271615 (0.0008) [2023-12-28 04:22:27,795][106226] Updated weights for policy 0, policy_version 1268397 (0.0010) [2023-12-28 04:22:27,849][106226] Updated weights for policy 0, policy_version 1268407 (0.0010) [2023-12-28 04:22:28,342][106225] Updated weights for policy 1, policy_version 1271625 (0.0008) [2023-12-28 04:22:28,403][106225] Updated weights for policy 1, policy_version 1271635 (0.0007) [2023-12-28 04:22:28,467][106225] Updated weights for policy 1, policy_version 1271645 (0.0007) [2023-12-28 04:22:28,517][106225] Updated weights for policy 1, policy_version 1271655 (0.0010) [2023-12-28 04:22:28,584][106226] Updated weights for policy 0, policy_version 1268417 (0.0010) [2023-12-28 04:22:28,646][106226] Updated weights for policy 0, policy_version 1268427 (0.0009) [2023-12-28 04:22:28,699][106226] Updated weights for policy 0, policy_version 1268437 (0.0010) [2023-12-28 04:22:29,128][106225] Updated weights for policy 1, policy_version 1271665 (0.0006) [2023-12-28 04:22:29,184][106225] Updated weights for policy 1, policy_version 1271675 (0.0005) [2023-12-28 04:22:29,243][106225] Updated weights for policy 1, policy_version 1271685 (0.0007) [2023-12-28 04:22:29,496][106226] Updated weights for policy 0, policy_version 1268447 (0.0010) [2023-12-28 04:22:29,553][106226] Updated weights for policy 0, policy_version 1268457 (0.0008) [2023-12-28 04:22:29,610][106226] Updated weights for policy 0, policy_version 1268467 (0.0010) [2023-12-28 04:22:29,819][106225] Updated weights for policy 1, policy_version 1271695 (0.0007) [2023-12-28 04:22:29,896][106225] Updated weights for policy 1, policy_version 1271705 (0.0008) [2023-12-28 04:22:29,965][106225] Updated weights for policy 1, policy_version 1271715 (0.0008) [2023-12-28 04:22:30,348][106226] Updated weights for policy 0, policy_version 1268477 (0.0007) [2023-12-28 04:22:30,409][106226] Updated weights for policy 0, policy_version 1268487 (0.0007) [2023-12-28 04:22:30,472][106226] Updated weights for policy 0, policy_version 1268497 (0.0008) [2023-12-28 04:22:30,594][106225] Updated weights for policy 1, policy_version 1271725 (0.0008) [2023-12-28 04:22:30,651][106225] Updated weights for policy 1, policy_version 1271735 (0.0006) [2023-12-28 04:22:30,702][106225] Updated weights for policy 1, policy_version 1271745 (0.0005) [2023-12-28 04:22:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 650412032. Throughput: 0: 9792.6, 1: 9982.5. Samples: 650403928. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:31,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-4.912')] [2023-12-28 04:22:31,180][106226] Updated weights for policy 0, policy_version 1268507 (0.0008) [2023-12-28 04:22:31,239][106226] Updated weights for policy 0, policy_version 1268517 (0.0006) [2023-12-28 04:22:31,276][106225] Updated weights for policy 1, policy_version 1271755 (0.0006) [2023-12-28 04:22:31,299][106226] Updated weights for policy 0, policy_version 1268527 (0.0008) [2023-12-28 04:22:31,334][106225] Updated weights for policy 1, policy_version 1271765 (0.0006) [2023-12-28 04:22:31,402][106225] Updated weights for policy 1, policy_version 1271775 (0.0007) [2023-12-28 04:22:31,920][106226] Updated weights for policy 0, policy_version 1268537 (0.0005) [2023-12-28 04:22:31,980][106226] Updated weights for policy 0, policy_version 1268547 (0.0006) [2023-12-28 04:22:32,035][106226] Updated weights for policy 0, policy_version 1268557 (0.0005) [2023-12-28 04:22:32,035][106225] Updated weights for policy 1, policy_version 1271785 (0.0006) [2023-12-28 04:22:32,091][106226] Updated weights for policy 0, policy_version 1268567 (0.0007) [2023-12-28 04:22:32,100][106225] Updated weights for policy 1, policy_version 1271795 (0.0007) [2023-12-28 04:22:32,159][106225] Updated weights for policy 1, policy_version 1271805 (0.0008) [2023-12-28 04:22:32,215][106225] Updated weights for policy 1, policy_version 1271815 (0.0008) [2023-12-28 04:22:32,840][106226] Updated weights for policy 0, policy_version 1268577 (0.0007) [2023-12-28 04:22:32,876][106225] Updated weights for policy 1, policy_version 1271825 (0.0010) [2023-12-28 04:22:32,905][106226] Updated weights for policy 0, policy_version 1268587 (0.0006) [2023-12-28 04:22:32,934][106225] Updated weights for policy 1, policy_version 1271835 (0.0009) [2023-12-28 04:22:32,965][106226] Updated weights for policy 0, policy_version 1268597 (0.0007) [2023-12-28 04:22:32,990][106225] Updated weights for policy 1, policy_version 1271845 (0.0005) [2023-12-28 04:22:33,563][106225] Updated weights for policy 1, policy_version 1271855 (0.0006) [2023-12-28 04:22:33,614][106226] Updated weights for policy 0, policy_version 1268607 (0.0007) [2023-12-28 04:22:33,619][106225] Updated weights for policy 1, policy_version 1271865 (0.0005) [2023-12-28 04:22:33,673][106226] Updated weights for policy 0, policy_version 1268617 (0.0005) [2023-12-28 04:22:33,678][106225] Updated weights for policy 1, policy_version 1271875 (0.0010) [2023-12-28 04:22:33,726][106226] Updated weights for policy 0, policy_version 1268627 (0.0005) [2023-12-28 04:22:34,342][106225] Updated weights for policy 1, policy_version 1271885 (0.0008) [2023-12-28 04:22:34,348][106226] Updated weights for policy 0, policy_version 1268637 (0.0008) [2023-12-28 04:22:34,397][106225] Updated weights for policy 1, policy_version 1271895 (0.0005) [2023-12-28 04:22:34,413][106226] Updated weights for policy 0, policy_version 1268647 (0.0010) [2023-12-28 04:22:34,452][106225] Updated weights for policy 1, policy_version 1271905 (0.0008) [2023-12-28 04:22:34,477][106226] Updated weights for policy 0, policy_version 1268657 (0.0011) [2023-12-28 04:22:35,075][106225] Updated weights for policy 1, policy_version 1271915 (0.0009) [2023-12-28 04:22:35,133][106225] Updated weights for policy 1, policy_version 1271925 (0.0008) [2023-12-28 04:22:35,173][106226] Updated weights for policy 0, policy_version 1268667 (0.0006) [2023-12-28 04:22:35,194][106225] Updated weights for policy 1, policy_version 1271935 (0.0007) [2023-12-28 04:22:35,231][106226] Updated weights for policy 0, policy_version 1268677 (0.0005) [2023-12-28 04:22:35,288][106226] Updated weights for policy 0, policy_version 1268687 (0.0005) [2023-12-28 04:22:35,808][106226] Updated weights for policy 0, policy_version 1268697 (0.0005) [2023-12-28 04:22:35,861][106226] Updated weights for policy 0, policy_version 1268707 (0.0005) [2023-12-28 04:22:35,913][106226] Updated weights for policy 0, policy_version 1268717 (0.0005) [2023-12-28 04:22:35,980][106226] Updated weights for policy 0, policy_version 1268727 (0.0010) [2023-12-28 04:22:36,005][106225] Updated weights for policy 1, policy_version 1271945 (0.0009) [2023-12-28 04:22:36,077][106225] Updated weights for policy 1, policy_version 1271955 (0.0008) [2023-12-28 04:22:36,151][106225] Updated weights for policy 1, policy_version 1271965 (0.0008) [2023-12-28 04:22:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 650518528. Throughput: 0: 9818.1, 1: 10084.7. Samples: 650530644. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:36,175][105115] Avg episode reward: [(0, '-4.179'), (1, '-5.237')] [2023-12-28 04:22:36,217][106225] Updated weights for policy 1, policy_version 1271975 (0.0008) [2023-12-28 04:22:36,669][106226] Updated weights for policy 0, policy_version 1268737 (0.0009) [2023-12-28 04:22:36,722][106226] Updated weights for policy 0, policy_version 1268747 (0.0008) [2023-12-28 04:22:36,786][106226] Updated weights for policy 0, policy_version 1268757 (0.0008) [2023-12-28 04:22:36,816][106225] Updated weights for policy 1, policy_version 1271985 (0.0006) [2023-12-28 04:22:36,869][106225] Updated weights for policy 1, policy_version 1271995 (0.0005) [2023-12-28 04:22:36,923][106225] Updated weights for policy 1, policy_version 1272005 (0.0005) [2023-12-28 04:22:37,546][106226] Updated weights for policy 0, policy_version 1268767 (0.0009) [2023-12-28 04:22:37,592][106226] Updated weights for policy 0, policy_version 1268777 (0.0005) [2023-12-28 04:22:37,622][106225] Updated weights for policy 1, policy_version 1272015 (0.0008) [2023-12-28 04:22:37,651][106226] Updated weights for policy 0, policy_version 1268787 (0.0006) [2023-12-28 04:22:37,676][106225] Updated weights for policy 1, policy_version 1272025 (0.0008) [2023-12-28 04:22:37,730][106225] Updated weights for policy 1, policy_version 1272035 (0.0008) [2023-12-28 04:22:38,328][106226] Updated weights for policy 0, policy_version 1268797 (0.0007) [2023-12-28 04:22:38,395][106226] Updated weights for policy 0, policy_version 1268807 (0.0008) [2023-12-28 04:22:38,453][106226] Updated weights for policy 0, policy_version 1268817 (0.0009) [2023-12-28 04:22:38,497][106225] Updated weights for policy 1, policy_version 1272045 (0.0008) [2023-12-28 04:22:38,554][106225] Updated weights for policy 1, policy_version 1272055 (0.0008) [2023-12-28 04:22:38,609][106225] Updated weights for policy 1, policy_version 1272065 (0.0008) [2023-12-28 04:22:39,189][106226] Updated weights for policy 0, policy_version 1268827 (0.0010) [2023-12-28 04:22:39,245][106226] Updated weights for policy 0, policy_version 1268837 (0.0010) [2023-12-28 04:22:39,304][106225] Updated weights for policy 1, policy_version 1272075 (0.0006) [2023-12-28 04:22:39,309][106226] Updated weights for policy 0, policy_version 1268847 (0.0011) [2023-12-28 04:22:39,370][106225] Updated weights for policy 1, policy_version 1272085 (0.0008) [2023-12-28 04:22:39,440][106225] Updated weights for policy 1, policy_version 1272095 (0.0008) [2023-12-28 04:22:40,087][106226] Updated weights for policy 0, policy_version 1268857 (0.0009) [2023-12-28 04:22:40,131][106225] Updated weights for policy 1, policy_version 1272105 (0.0008) [2023-12-28 04:22:40,145][106226] Updated weights for policy 0, policy_version 1268867 (0.0009) [2023-12-28 04:22:40,194][106225] Updated weights for policy 1, policy_version 1272115 (0.0007) [2023-12-28 04:22:40,209][106226] Updated weights for policy 0, policy_version 1268877 (0.0007) [2023-12-28 04:22:40,249][106225] Updated weights for policy 1, policy_version 1272125 (0.0006) [2023-12-28 04:22:40,275][106226] Updated weights for policy 0, policy_version 1268887 (0.0008) [2023-12-28 04:22:40,310][106225] Updated weights for policy 1, policy_version 1272135 (0.0008) [2023-12-28 04:22:40,864][106226] Updated weights for policy 0, policy_version 1268897 (0.0005) [2023-12-28 04:22:40,891][106225] Updated weights for policy 1, policy_version 1272145 (0.0010) [2023-12-28 04:22:40,922][106226] Updated weights for policy 0, policy_version 1268907 (0.0009) [2023-12-28 04:22:40,954][106225] Updated weights for policy 1, policy_version 1272155 (0.0010) [2023-12-28 04:22:40,980][106226] Updated weights for policy 0, policy_version 1268917 (0.0011) [2023-12-28 04:22:41,010][106225] Updated weights for policy 1, policy_version 1272165 (0.0010) [2023-12-28 04:22:41,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 650625024. Throughput: 0: 9804.9, 1: 10086.9. Samples: 650589344. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:41,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.891')] [2023-12-28 04:22:41,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001268920_324902912.pth... [2023-12-28 04:22:41,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001272168_325722112.pth... [2023-12-28 04:22:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001270984_325419008.pth [2023-12-28 04:22:41,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001267768_324608000.pth [2023-12-28 04:22:41,730][106225] Updated weights for policy 1, policy_version 1272175 (0.0009) [2023-12-28 04:22:41,741][106226] Updated weights for policy 0, policy_version 1268927 (0.0009) [2023-12-28 04:22:41,799][106225] Updated weights for policy 1, policy_version 1272185 (0.0011) [2023-12-28 04:22:41,812][106226] Updated weights for policy 0, policy_version 1268937 (0.0009) [2023-12-28 04:22:41,867][106225] Updated weights for policy 1, policy_version 1272195 (0.0011) [2023-12-28 04:22:41,871][106226] Updated weights for policy 0, policy_version 1268947 (0.0007) [2023-12-28 04:22:42,545][106226] Updated weights for policy 0, policy_version 1268957 (0.0007) [2023-12-28 04:22:42,599][106225] Updated weights for policy 1, policy_version 1272205 (0.0009) [2023-12-28 04:22:42,600][106226] Updated weights for policy 0, policy_version 1268967 (0.0006) [2023-12-28 04:22:42,650][106226] Updated weights for policy 0, policy_version 1268977 (0.0005) [2023-12-28 04:22:42,666][106225] Updated weights for policy 1, policy_version 1272215 (0.0008) [2023-12-28 04:22:42,729][106225] Updated weights for policy 1, policy_version 1272225 (0.0008) [2023-12-28 04:22:43,259][106226] Updated weights for policy 0, policy_version 1268987 (0.0007) [2023-12-28 04:22:43,319][106226] Updated weights for policy 0, policy_version 1268997 (0.0006) [2023-12-28 04:22:43,390][106226] Updated weights for policy 0, policy_version 1269007 (0.0006) [2023-12-28 04:22:43,547][106225] Updated weights for policy 1, policy_version 1272235 (0.0008) [2023-12-28 04:22:43,602][106225] Updated weights for policy 1, policy_version 1272245 (0.0008) [2023-12-28 04:22:43,656][106225] Updated weights for policy 1, policy_version 1272255 (0.0009) [2023-12-28 04:22:43,988][106226] Updated weights for policy 0, policy_version 1269017 (0.0005) [2023-12-28 04:22:44,049][106226] Updated weights for policy 0, policy_version 1269027 (0.0009) [2023-12-28 04:22:44,108][106226] Updated weights for policy 0, policy_version 1269037 (0.0010) [2023-12-28 04:22:44,162][106226] Updated weights for policy 0, policy_version 1269047 (0.0010) [2023-12-28 04:22:44,419][106225] Updated weights for policy 1, policy_version 1272265 (0.0008) [2023-12-28 04:22:44,468][106225] Updated weights for policy 1, policy_version 1272275 (0.0007) [2023-12-28 04:22:44,518][106225] Updated weights for policy 1, policy_version 1272285 (0.0006) [2023-12-28 04:22:44,579][106225] Updated weights for policy 1, policy_version 1272295 (0.0008) [2023-12-28 04:22:44,813][106226] Updated weights for policy 0, policy_version 1269057 (0.0008) [2023-12-28 04:22:44,860][106226] Updated weights for policy 0, policy_version 1269067 (0.0011) [2023-12-28 04:22:44,911][106226] Updated weights for policy 0, policy_version 1269077 (0.0010) [2023-12-28 04:22:45,335][106225] Updated weights for policy 1, policy_version 1272305 (0.0008) [2023-12-28 04:22:45,393][106225] Updated weights for policy 1, policy_version 1272315 (0.0007) [2023-12-28 04:22:45,454][106225] Updated weights for policy 1, policy_version 1272325 (0.0008) [2023-12-28 04:22:45,611][106226] Updated weights for policy 0, policy_version 1269087 (0.0007) [2023-12-28 04:22:45,672][106226] Updated weights for policy 0, policy_version 1269097 (0.0009) [2023-12-28 04:22:45,724][106226] Updated weights for policy 0, policy_version 1269107 (0.0010) [2023-12-28 04:22:46,140][106225] Updated weights for policy 1, policy_version 1272335 (0.0009) [2023-12-28 04:22:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 650715136. Throughput: 0: 9868.2, 1: 10025.5. Samples: 650707500. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:46,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-5.109')] [2023-12-28 04:22:46,199][106225] Updated weights for policy 1, policy_version 1272345 (0.0010) [2023-12-28 04:22:46,263][106225] Updated weights for policy 1, policy_version 1272355 (0.0010) [2023-12-28 04:22:46,322][106226] Updated weights for policy 0, policy_version 1269117 (0.0009) [2023-12-28 04:22:46,382][106226] Updated weights for policy 0, policy_version 1269127 (0.0010) [2023-12-28 04:22:46,435][106226] Updated weights for policy 0, policy_version 1269137 (0.0008) [2023-12-28 04:22:46,924][106225] Updated weights for policy 1, policy_version 1272365 (0.0009) [2023-12-28 04:22:46,970][106225] Updated weights for policy 1, policy_version 1272375 (0.0007) [2023-12-28 04:22:47,017][106225] Updated weights for policy 1, policy_version 1272385 (0.0007) [2023-12-28 04:22:47,159][106226] Updated weights for policy 0, policy_version 1269147 (0.0011) [2023-12-28 04:22:47,205][106226] Updated weights for policy 0, policy_version 1269157 (0.0010) [2023-12-28 04:22:47,250][106226] Updated weights for policy 0, policy_version 1269167 (0.0006) [2023-12-28 04:22:47,771][106225] Updated weights for policy 1, policy_version 1272395 (0.0007) [2023-12-28 04:22:47,827][106225] Updated weights for policy 1, policy_version 1272405 (0.0007) [2023-12-28 04:22:47,880][106226] Updated weights for policy 0, policy_version 1269177 (0.0010) [2023-12-28 04:22:47,890][106225] Updated weights for policy 1, policy_version 1272415 (0.0006) [2023-12-28 04:22:47,929][106226] Updated weights for policy 0, policy_version 1269187 (0.0010) [2023-12-28 04:22:47,989][106226] Updated weights for policy 0, policy_version 1269197 (0.0010) [2023-12-28 04:22:48,055][106226] Updated weights for policy 0, policy_version 1269207 (0.0010) [2023-12-28 04:22:48,601][106225] Updated weights for policy 1, policy_version 1272425 (0.0006) [2023-12-28 04:22:48,661][106225] Updated weights for policy 1, policy_version 1272435 (0.0007) [2023-12-28 04:22:48,718][106225] Updated weights for policy 1, policy_version 1272445 (0.0008) [2023-12-28 04:22:48,774][106225] Updated weights for policy 1, policy_version 1272455 (0.0007) [2023-12-28 04:22:48,799][106226] Updated weights for policy 0, policy_version 1269217 (0.0011) [2023-12-28 04:22:48,863][106226] Updated weights for policy 0, policy_version 1269227 (0.0010) [2023-12-28 04:22:48,920][106226] Updated weights for policy 0, policy_version 1269237 (0.0011) [2023-12-28 04:22:49,444][106225] Updated weights for policy 1, policy_version 1272465 (0.0009) [2023-12-28 04:22:49,503][106225] Updated weights for policy 1, policy_version 1272475 (0.0008) [2023-12-28 04:22:49,567][106225] Updated weights for policy 1, policy_version 1272485 (0.0009) [2023-12-28 04:22:49,625][106226] Updated weights for policy 0, policy_version 1269247 (0.0009) [2023-12-28 04:22:49,673][106226] Updated weights for policy 0, policy_version 1269257 (0.0008) [2023-12-28 04:22:49,726][106226] Updated weights for policy 0, policy_version 1269267 (0.0008) [2023-12-28 04:22:50,301][106225] Updated weights for policy 1, policy_version 1272495 (0.0009) [2023-12-28 04:22:50,358][106225] Updated weights for policy 1, policy_version 1272505 (0.0009) [2023-12-28 04:22:50,414][106225] Updated weights for policy 1, policy_version 1272515 (0.0008) [2023-12-28 04:22:50,480][106226] Updated weights for policy 0, policy_version 1269277 (0.0008) [2023-12-28 04:22:50,539][106226] Updated weights for policy 0, policy_version 1269287 (0.0009) [2023-12-28 04:22:50,604][106226] Updated weights for policy 0, policy_version 1269297 (0.0007) [2023-12-28 04:22:51,168][106225] Updated weights for policy 1, policy_version 1272525 (0.0008) [2023-12-28 04:22:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 650813440. Throughput: 0: 9908.7, 1: 9983.6. Samples: 650825816. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:51,175][105115] Avg episode reward: [(0, '-4.184'), (1, '-4.848')] [2023-12-28 04:22:51,226][106225] Updated weights for policy 1, policy_version 1272535 (0.0009) [2023-12-28 04:22:51,289][106225] Updated weights for policy 1, policy_version 1272545 (0.0008) [2023-12-28 04:22:51,391][106226] Updated weights for policy 0, policy_version 1269307 (0.0013) [2023-12-28 04:22:51,457][106226] Updated weights for policy 0, policy_version 1269317 (0.0009) [2023-12-28 04:22:51,520][106226] Updated weights for policy 0, policy_version 1269327 (0.0008) [2023-12-28 04:22:52,044][106225] Updated weights for policy 1, policy_version 1272555 (0.0009) [2023-12-28 04:22:52,094][106225] Updated weights for policy 1, policy_version 1272565 (0.0008) [2023-12-28 04:22:52,147][106225] Updated weights for policy 1, policy_version 1272575 (0.0009) [2023-12-28 04:22:52,224][106226] Updated weights for policy 0, policy_version 1269337 (0.0009) [2023-12-28 04:22:52,302][106226] Updated weights for policy 0, policy_version 1269347 (0.0007) [2023-12-28 04:22:52,377][106226] Updated weights for policy 0, policy_version 1269357 (0.0008) [2023-12-28 04:22:52,439][106226] Updated weights for policy 0, policy_version 1269367 (0.0011) [2023-12-28 04:22:52,870][106225] Updated weights for policy 1, policy_version 1272585 (0.0008) [2023-12-28 04:22:52,926][106225] Updated weights for policy 1, policy_version 1272595 (0.0008) [2023-12-28 04:22:52,975][106225] Updated weights for policy 1, policy_version 1272605 (0.0008) [2023-12-28 04:22:53,023][106225] Updated weights for policy 1, policy_version 1272615 (0.0008) [2023-12-28 04:22:53,105][106226] Updated weights for policy 0, policy_version 1269377 (0.0009) [2023-12-28 04:22:53,166][106226] Updated weights for policy 0, policy_version 1269387 (0.0008) [2023-12-28 04:22:53,226][106226] Updated weights for policy 0, policy_version 1269397 (0.0008) [2023-12-28 04:22:53,803][106225] Updated weights for policy 1, policy_version 1272625 (0.0006) [2023-12-28 04:22:53,863][106225] Updated weights for policy 1, policy_version 1272635 (0.0005) [2023-12-28 04:22:53,915][106226] Updated weights for policy 0, policy_version 1269407 (0.0006) [2023-12-28 04:22:53,920][106225] Updated weights for policy 1, policy_version 1272645 (0.0007) [2023-12-28 04:22:53,969][106226] Updated weights for policy 0, policy_version 1269417 (0.0008) [2023-12-28 04:22:54,028][106226] Updated weights for policy 0, policy_version 1269427 (0.0007) [2023-12-28 04:22:54,633][106226] Updated weights for policy 0, policy_version 1269437 (0.0008) [2023-12-28 04:22:54,641][106225] Updated weights for policy 1, policy_version 1272655 (0.0007) [2023-12-28 04:22:54,689][106226] Updated weights for policy 0, policy_version 1269447 (0.0010) [2023-12-28 04:22:54,706][106225] Updated weights for policy 1, policy_version 1272665 (0.0006) [2023-12-28 04:22:54,749][106226] Updated weights for policy 0, policy_version 1269457 (0.0010) [2023-12-28 04:22:54,769][106225] Updated weights for policy 1, policy_version 1272675 (0.0005) [2023-12-28 04:22:55,466][106225] Updated weights for policy 1, policy_version 1272685 (0.0008) [2023-12-28 04:22:55,480][106226] Updated weights for policy 0, policy_version 1269467 (0.0009) [2023-12-28 04:22:55,520][106225] Updated weights for policy 1, policy_version 1272695 (0.0007) [2023-12-28 04:22:55,534][106226] Updated weights for policy 0, policy_version 1269477 (0.0006) [2023-12-28 04:22:55,581][106225] Updated weights for policy 1, policy_version 1272705 (0.0007) [2023-12-28 04:22:55,582][106226] Updated weights for policy 0, policy_version 1269487 (0.0007) [2023-12-28 04:22:56,140][106225] Updated weights for policy 1, policy_version 1272715 (0.0005) [2023-12-28 04:22:56,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 650911744. Throughput: 0: 9935.2, 1: 9919.2. Samples: 650884040. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:22:56,176][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.460')] [2023-12-28 04:22:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001269496_325050368.pth... [2023-12-28 04:22:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001268344_324755456.pth [2023-12-28 04:22:56,190][106225] Updated weights for policy 1, policy_version 1272725 (0.0006) [2023-12-28 04:22:56,244][106225] Updated weights for policy 1, policy_version 1272735 (0.0005) [2023-12-28 04:22:56,281][106226] Updated weights for policy 0, policy_version 1269497 (0.0008) [2023-12-28 04:22:56,301][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001272744_325869568.pth... [2023-12-28 04:22:56,306][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001271560_325566464.pth [2023-12-28 04:22:56,343][106226] Updated weights for policy 0, policy_version 1269507 (0.0007) [2023-12-28 04:22:56,402][106226] Updated weights for policy 0, policy_version 1269517 (0.0009) [2023-12-28 04:22:56,456][106226] Updated weights for policy 0, policy_version 1269527 (0.0009) [2023-12-28 04:22:56,803][106225] Updated weights for policy 1, policy_version 1272745 (0.0005) [2023-12-28 04:22:56,857][106225] Updated weights for policy 1, policy_version 1272755 (0.0005) [2023-12-28 04:22:56,919][106225] Updated weights for policy 1, policy_version 1272765 (0.0007) [2023-12-28 04:22:56,979][106225] Updated weights for policy 1, policy_version 1272775 (0.0010) [2023-12-28 04:22:57,174][106226] Updated weights for policy 0, policy_version 1269537 (0.0010) [2023-12-28 04:22:57,235][106226] Updated weights for policy 0, policy_version 1269547 (0.0010) [2023-12-28 04:22:57,291][106226] Updated weights for policy 0, policy_version 1269557 (0.0010) [2023-12-28 04:22:57,665][106225] Updated weights for policy 1, policy_version 1272785 (0.0010) [2023-12-28 04:22:57,722][106225] Updated weights for policy 1, policy_version 1272795 (0.0010) [2023-12-28 04:22:57,778][106225] Updated weights for policy 1, policy_version 1272805 (0.0010) [2023-12-28 04:22:57,892][106226] Updated weights for policy 0, policy_version 1269567 (0.0010) [2023-12-28 04:22:57,952][106226] Updated weights for policy 0, policy_version 1269577 (0.0010) [2023-12-28 04:22:58,005][106226] Updated weights for policy 0, policy_version 1269587 (0.0010) [2023-12-28 04:22:58,564][106225] Updated weights for policy 1, policy_version 1272815 (0.0010) [2023-12-28 04:22:58,628][106225] Updated weights for policy 1, policy_version 1272825 (0.0010) [2023-12-28 04:22:58,684][106225] Updated weights for policy 1, policy_version 1272835 (0.0007) [2023-12-28 04:22:58,762][106226] Updated weights for policy 0, policy_version 1269597 (0.0009) [2023-12-28 04:22:58,832][106226] Updated weights for policy 0, policy_version 1269607 (0.0009) [2023-12-28 04:22:58,902][106226] Updated weights for policy 0, policy_version 1269617 (0.0009) [2023-12-28 04:22:59,446][106225] Updated weights for policy 1, policy_version 1272845 (0.0008) [2023-12-28 04:22:59,495][106225] Updated weights for policy 1, policy_version 1272855 (0.0009) [2023-12-28 04:22:59,551][106225] Updated weights for policy 1, policy_version 1272865 (0.0008) [2023-12-28 04:22:59,642][106226] Updated weights for policy 0, policy_version 1269627 (0.0009) [2023-12-28 04:22:59,706][106226] Updated weights for policy 0, policy_version 1269637 (0.0009) [2023-12-28 04:22:59,770][106226] Updated weights for policy 0, policy_version 1269647 (0.0008) [2023-12-28 04:23:00,247][106225] Updated weights for policy 1, policy_version 1272875 (0.0009) [2023-12-28 04:23:00,302][106225] Updated weights for policy 1, policy_version 1272885 (0.0008) [2023-12-28 04:23:00,358][106225] Updated weights for policy 1, policy_version 1272895 (0.0006) [2023-12-28 04:23:00,473][106226] Updated weights for policy 0, policy_version 1269657 (0.0008) [2023-12-28 04:23:00,535][106226] Updated weights for policy 0, policy_version 1269667 (0.0009) [2023-12-28 04:23:00,589][106226] Updated weights for policy 0, policy_version 1269677 (0.0006) [2023-12-28 04:23:00,640][106226] Updated weights for policy 0, policy_version 1269687 (0.0005) [2023-12-28 04:23:01,073][106225] Updated weights for policy 1, policy_version 1272905 (0.0006) [2023-12-28 04:23:01,127][106225] Updated weights for policy 1, policy_version 1272915 (0.0008) [2023-12-28 04:23:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 651010048. Throughput: 0: 9952.9, 1: 9976.4. Samples: 651004124. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:23:01,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-4.902')] [2023-12-28 04:23:01,196][106225] Updated weights for policy 1, policy_version 1272925 (0.0007) [2023-12-28 04:23:01,256][106225] Updated weights for policy 1, policy_version 1272935 (0.0007) [2023-12-28 04:23:01,277][106226] Updated weights for policy 0, policy_version 1269697 (0.0009) [2023-12-28 04:23:01,341][106226] Updated weights for policy 0, policy_version 1269707 (0.0009) [2023-12-28 04:23:01,419][106226] Updated weights for policy 0, policy_version 1269717 (0.0007) [2023-12-28 04:23:01,925][106225] Updated weights for policy 1, policy_version 1272945 (0.0005) [2023-12-28 04:23:01,978][106225] Updated weights for policy 1, policy_version 1272955 (0.0005) [2023-12-28 04:23:02,031][106225] Updated weights for policy 1, policy_version 1272965 (0.0005) [2023-12-28 04:23:02,140][106226] Updated weights for policy 0, policy_version 1269727 (0.0006) [2023-12-28 04:23:02,204][106226] Updated weights for policy 0, policy_version 1269737 (0.0005) [2023-12-28 04:23:02,273][106226] Updated weights for policy 0, policy_version 1269747 (0.0007) [2023-12-28 04:23:02,767][106225] Updated weights for policy 1, policy_version 1272975 (0.0008) [2023-12-28 04:23:02,837][106225] Updated weights for policy 1, policy_version 1272985 (0.0009) [2023-12-28 04:23:02,851][106226] Updated weights for policy 0, policy_version 1269757 (0.0007) [2023-12-28 04:23:02,901][106225] Updated weights for policy 1, policy_version 1272995 (0.0008) [2023-12-28 04:23:02,902][106226] Updated weights for policy 0, policy_version 1269767 (0.0005) [2023-12-28 04:23:02,958][106226] Updated weights for policy 0, policy_version 1269777 (0.0005) [2023-12-28 04:23:03,528][106226] Updated weights for policy 0, policy_version 1269787 (0.0005) [2023-12-28 04:23:03,588][106226] Updated weights for policy 0, policy_version 1269797 (0.0007) [2023-12-28 04:23:03,642][106226] Updated weights for policy 0, policy_version 1269807 (0.0009) [2023-12-28 04:23:03,675][106225] Updated weights for policy 1, policy_version 1273005 (0.0008) [2023-12-28 04:23:03,735][106225] Updated weights for policy 1, policy_version 1273015 (0.0007) [2023-12-28 04:23:03,793][106225] Updated weights for policy 1, policy_version 1273025 (0.0008) [2023-12-28 04:23:04,388][106226] Updated weights for policy 0, policy_version 1269817 (0.0007) [2023-12-28 04:23:04,446][106226] Updated weights for policy 0, policy_version 1269827 (0.0008) [2023-12-28 04:23:04,463][106225] Updated weights for policy 1, policy_version 1273035 (0.0008) [2023-12-28 04:23:04,510][106226] Updated weights for policy 0, policy_version 1269837 (0.0007) [2023-12-28 04:23:04,520][106225] Updated weights for policy 1, policy_version 1273045 (0.0007) [2023-12-28 04:23:04,570][106226] Updated weights for policy 0, policy_version 1269847 (0.0007) [2023-12-28 04:23:04,579][106225] Updated weights for policy 1, policy_version 1273055 (0.0007) [2023-12-28 04:23:05,196][106225] Updated weights for policy 1, policy_version 1273065 (0.0009) [2023-12-28 04:23:05,253][106225] Updated weights for policy 1, policy_version 1273075 (0.0010) [2023-12-28 04:23:05,312][106226] Updated weights for policy 0, policy_version 1269857 (0.0006) [2023-12-28 04:23:05,316][106225] Updated weights for policy 1, policy_version 1273085 (0.0010) [2023-12-28 04:23:05,376][106225] Updated weights for policy 1, policy_version 1273095 (0.0010) [2023-12-28 04:23:05,383][106226] Updated weights for policy 0, policy_version 1269867 (0.0007) [2023-12-28 04:23:05,450][106226] Updated weights for policy 0, policy_version 1269877 (0.0008) [2023-12-28 04:23:06,061][106225] Updated weights for policy 1, policy_version 1273105 (0.0010) [2023-12-28 04:23:06,084][106226] Updated weights for policy 0, policy_version 1269887 (0.0008) [2023-12-28 04:23:06,123][106225] Updated weights for policy 1, policy_version 1273115 (0.0009) [2023-12-28 04:23:06,140][106226] Updated weights for policy 0, policy_version 1269897 (0.0008) [2023-12-28 04:23:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 651108352. Throughput: 0: 9962.6, 1: 10063.0. Samples: 651126068. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:23:06,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-5.069')] [2023-12-28 04:23:06,189][106225] Updated weights for policy 1, policy_version 1273125 (0.0009) [2023-12-28 04:23:06,204][106226] Updated weights for policy 0, policy_version 1269907 (0.0008) [2023-12-28 04:23:06,897][106226] Updated weights for policy 0, policy_version 1269917 (0.0009) [2023-12-28 04:23:06,919][106225] Updated weights for policy 1, policy_version 1273135 (0.0008) [2023-12-28 04:23:06,955][106226] Updated weights for policy 0, policy_version 1269927 (0.0007) [2023-12-28 04:23:06,974][106225] Updated weights for policy 1, policy_version 1273145 (0.0006) [2023-12-28 04:23:07,021][106226] Updated weights for policy 0, policy_version 1269937 (0.0007) [2023-12-28 04:23:07,038][106225] Updated weights for policy 1, policy_version 1273155 (0.0007) [2023-12-28 04:23:07,576][106225] Updated weights for policy 1, policy_version 1273165 (0.0006) [2023-12-28 04:23:07,622][106225] Updated weights for policy 1, policy_version 1273175 (0.0005) [2023-12-28 04:23:07,662][106226] Updated weights for policy 0, policy_version 1269947 (0.0008) [2023-12-28 04:23:07,679][106225] Updated weights for policy 1, policy_version 1273185 (0.0005) [2023-12-28 04:23:07,714][106226] Updated weights for policy 0, policy_version 1269957 (0.0005) [2023-12-28 04:23:07,773][106226] Updated weights for policy 0, policy_version 1269967 (0.0008) [2023-12-28 04:23:08,348][106225] Updated weights for policy 1, policy_version 1273195 (0.0007) [2023-12-28 04:23:08,416][106225] Updated weights for policy 1, policy_version 1273205 (0.0006) [2023-12-28 04:23:08,445][106226] Updated weights for policy 0, policy_version 1269977 (0.0010) [2023-12-28 04:23:08,479][106225] Updated weights for policy 1, policy_version 1273215 (0.0007) [2023-12-28 04:23:08,506][106226] Updated weights for policy 0, policy_version 1269987 (0.0011) [2023-12-28 04:23:08,567][106226] Updated weights for policy 0, policy_version 1269997 (0.0011) [2023-12-28 04:23:08,625][106226] Updated weights for policy 0, policy_version 1270007 (0.0008) [2023-12-28 04:23:09,186][106225] Updated weights for policy 1, policy_version 1273225 (0.0006) [2023-12-28 04:23:09,191][106226] Updated weights for policy 0, policy_version 1270017 (0.0005) [2023-12-28 04:23:09,246][106225] Updated weights for policy 1, policy_version 1273235 (0.0008) [2023-12-28 04:23:09,260][106226] Updated weights for policy 0, policy_version 1270027 (0.0007) [2023-12-28 04:23:09,316][106225] Updated weights for policy 1, policy_version 1273245 (0.0007) [2023-12-28 04:23:09,334][106226] Updated weights for policy 0, policy_version 1270037 (0.0011) [2023-12-28 04:23:09,384][106225] Updated weights for policy 1, policy_version 1273255 (0.0013) [2023-12-28 04:23:10,015][106226] Updated weights for policy 0, policy_version 1270047 (0.0006) [2023-12-28 04:23:10,079][106226] Updated weights for policy 0, policy_version 1270057 (0.0006) [2023-12-28 04:23:10,144][106226] Updated weights for policy 0, policy_version 1270067 (0.0009) [2023-12-28 04:23:10,162][106225] Updated weights for policy 1, policy_version 1273265 (0.0008) [2023-12-28 04:23:10,228][106225] Updated weights for policy 1, policy_version 1273275 (0.0008) [2023-12-28 04:23:10,288][106225] Updated weights for policy 1, policy_version 1273285 (0.0005) [2023-12-28 04:23:10,806][106226] Updated weights for policy 0, policy_version 1270077 (0.0008) [2023-12-28 04:23:10,872][106226] Updated weights for policy 0, policy_version 1270087 (0.0009) [2023-12-28 04:23:10,927][106226] Updated weights for policy 0, policy_version 1270097 (0.0009) [2023-12-28 04:23:10,956][106225] Updated weights for policy 1, policy_version 1273295 (0.0006) [2023-12-28 04:23:11,020][106225] Updated weights for policy 1, policy_version 1273305 (0.0008) [2023-12-28 04:23:11,085][106225] Updated weights for policy 1, policy_version 1273315 (0.0008) [2023-12-28 04:23:11,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 651223040. Throughput: 0: 10056.7, 1: 10108.6. Samples: 651189292. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:23:11,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.989')] [2023-12-28 04:23:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001273320_326017024.pth... [2023-12-28 04:23:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001270104_325206016.pth... [2023-12-28 04:23:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001268920_324902912.pth [2023-12-28 04:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001272168_325722112.pth [2023-12-28 04:23:11,718][106226] Updated weights for policy 0, policy_version 1270107 (0.0008) [2023-12-28 04:23:11,789][106226] Updated weights for policy 0, policy_version 1270117 (0.0008) [2023-12-28 04:23:11,833][106225] Updated weights for policy 1, policy_version 1273325 (0.0008) [2023-12-28 04:23:11,860][106226] Updated weights for policy 0, policy_version 1270127 (0.0006) [2023-12-28 04:23:11,896][106225] Updated weights for policy 1, policy_version 1273335 (0.0008) [2023-12-28 04:23:11,955][106225] Updated weights for policy 1, policy_version 1273345 (0.0007) [2023-12-28 04:23:12,545][106226] Updated weights for policy 0, policy_version 1270137 (0.0006) [2023-12-28 04:23:12,604][106226] Updated weights for policy 0, policy_version 1270147 (0.0008) [2023-12-28 04:23:12,667][106226] Updated weights for policy 0, policy_version 1270157 (0.0009) [2023-12-28 04:23:12,685][106225] Updated weights for policy 1, policy_version 1273355 (0.0006) [2023-12-28 04:23:12,730][106226] Updated weights for policy 0, policy_version 1270167 (0.0009) [2023-12-28 04:23:12,746][106225] Updated weights for policy 1, policy_version 1273365 (0.0007) [2023-12-28 04:23:12,808][106225] Updated weights for policy 1, policy_version 1273375 (0.0009) [2023-12-28 04:23:13,452][106225] Updated weights for policy 1, policy_version 1273385 (0.0009) [2023-12-28 04:23:13,504][106226] Updated weights for policy 0, policy_version 1270177 (0.0007) [2023-12-28 04:23:13,515][106225] Updated weights for policy 1, policy_version 1273395 (0.0006) [2023-12-28 04:23:13,564][106226] Updated weights for policy 0, policy_version 1270187 (0.0007) [2023-12-28 04:23:13,572][106225] Updated weights for policy 1, policy_version 1273405 (0.0007) [2023-12-28 04:23:13,617][106225] Updated weights for policy 1, policy_version 1273415 (0.0007) [2023-12-28 04:23:13,618][106226] Updated weights for policy 0, policy_version 1270197 (0.0007) [2023-12-28 04:23:14,308][106225] Updated weights for policy 1, policy_version 1273425 (0.0008) [2023-12-28 04:23:14,349][106226] Updated weights for policy 0, policy_version 1270207 (0.0008) [2023-12-28 04:23:14,360][106225] Updated weights for policy 1, policy_version 1273435 (0.0007) [2023-12-28 04:23:14,402][106226] Updated weights for policy 0, policy_version 1270217 (0.0006) [2023-12-28 04:23:14,408][106225] Updated weights for policy 1, policy_version 1273445 (0.0006) [2023-12-28 04:23:14,449][106226] Updated weights for policy 0, policy_version 1270227 (0.0007) [2023-12-28 04:23:15,170][106226] Updated weights for policy 0, policy_version 1270237 (0.0007) [2023-12-28 04:23:15,182][106225] Updated weights for policy 1, policy_version 1273455 (0.0008) [2023-12-28 04:23:15,231][106226] Updated weights for policy 0, policy_version 1270247 (0.0008) [2023-12-28 04:23:15,245][106225] Updated weights for policy 1, policy_version 1273465 (0.0006) [2023-12-28 04:23:15,283][106226] Updated weights for policy 0, policy_version 1270257 (0.0006) [2023-12-28 04:23:15,306][106225] Updated weights for policy 1, policy_version 1273475 (0.0009) [2023-12-28 04:23:16,010][106226] Updated weights for policy 0, policy_version 1270267 (0.0008) [2023-12-28 04:23:16,016][106225] Updated weights for policy 1, policy_version 1273485 (0.0007) [2023-12-28 04:23:16,065][106225] Updated weights for policy 1, policy_version 1273495 (0.0006) [2023-12-28 04:23:16,067][106226] Updated weights for policy 0, policy_version 1270277 (0.0007) [2023-12-28 04:23:16,109][106225] Updated weights for policy 1, policy_version 1273505 (0.0005) [2023-12-28 04:23:16,121][106226] Updated weights for policy 0, policy_version 1270287 (0.0007) [2023-12-28 04:23:16,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 651321344. Throughput: 0: 10057.1, 1: 9937.3. Samples: 651303680. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:23:16,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-5.297')] [2023-12-28 04:23:16,745][106225] Updated weights for policy 1, policy_version 1273515 (0.0007) [2023-12-28 04:23:16,793][106225] Updated weights for policy 1, policy_version 1273525 (0.0008) [2023-12-28 04:23:16,842][106225] Updated weights for policy 1, policy_version 1273535 (0.0008) [2023-12-28 04:23:16,881][106226] Updated weights for policy 0, policy_version 1270297 (0.0007) [2023-12-28 04:23:16,940][106226] Updated weights for policy 0, policy_version 1270307 (0.0008) [2023-12-28 04:23:17,000][106226] Updated weights for policy 0, policy_version 1270317 (0.0009) [2023-12-28 04:23:17,062][106226] Updated weights for policy 0, policy_version 1270327 (0.0008) [2023-12-28 04:23:17,581][106225] Updated weights for policy 1, policy_version 1273545 (0.0008) [2023-12-28 04:23:17,630][106225] Updated weights for policy 1, policy_version 1273555 (0.0009) [2023-12-28 04:23:17,676][106225] Updated weights for policy 1, policy_version 1273565 (0.0008) [2023-12-28 04:23:17,732][106225] Updated weights for policy 1, policy_version 1273575 (0.0008) [2023-12-28 04:23:17,755][106226] Updated weights for policy 0, policy_version 1270337 (0.0008) [2023-12-28 04:23:17,810][106226] Updated weights for policy 0, policy_version 1270347 (0.0009) [2023-12-28 04:23:17,858][106226] Updated weights for policy 0, policy_version 1270357 (0.0008) [2023-12-28 04:23:18,507][106225] Updated weights for policy 1, policy_version 1273585 (0.0007) [2023-12-28 04:23:18,569][106225] Updated weights for policy 1, policy_version 1273595 (0.0007) [2023-12-28 04:23:18,601][106226] Updated weights for policy 0, policy_version 1270367 (0.0008) [2023-12-28 04:23:18,624][106225] Updated weights for policy 1, policy_version 1273605 (0.0008) [2023-12-28 04:23:18,664][106226] Updated weights for policy 0, policy_version 1270377 (0.0007) [2023-12-28 04:23:18,726][106226] Updated weights for policy 0, policy_version 1270387 (0.0007) [2023-12-28 04:23:19,336][106225] Updated weights for policy 1, policy_version 1273615 (0.0009) [2023-12-28 04:23:19,398][106225] Updated weights for policy 1, policy_version 1273625 (0.0008) [2023-12-28 04:23:19,446][106225] Updated weights for policy 1, policy_version 1273635 (0.0008) [2023-12-28 04:23:19,478][106226] Updated weights for policy 0, policy_version 1270397 (0.0008) [2023-12-28 04:23:19,550][106226] Updated weights for policy 0, policy_version 1270407 (0.0008) [2023-12-28 04:23:19,609][106226] Updated weights for policy 0, policy_version 1270417 (0.0008) [2023-12-28 04:23:20,252][106225] Updated weights for policy 1, policy_version 1273645 (0.0008) [2023-12-28 04:23:20,299][106226] Updated weights for policy 0, policy_version 1270427 (0.0008) [2023-12-28 04:23:20,311][106225] Updated weights for policy 1, policy_version 1273655 (0.0008) [2023-12-28 04:23:20,361][106225] Updated weights for policy 1, policy_version 1273665 (0.0008) [2023-12-28 04:23:20,363][106226] Updated weights for policy 0, policy_version 1270437 (0.0009) [2023-12-28 04:23:20,428][106226] Updated weights for policy 0, policy_version 1270447 (0.0008) [2023-12-28 04:23:21,122][106225] Updated weights for policy 1, policy_version 1273675 (0.0007) [2023-12-28 04:23:21,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 651403264. Throughput: 0: 9918.0, 1: 9806.5. Samples: 651418248. Policy #0 lag: (min: 31.0, avg: 50.6, max: 63.0) [2023-12-28 04:23:21,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-5.305')] [2023-12-28 04:23:21,188][106225] Updated weights for policy 1, policy_version 1273685 (0.0008) [2023-12-28 04:23:21,225][106226] Updated weights for policy 0, policy_version 1270457 (0.0008) [2023-12-28 04:23:21,255][106225] Updated weights for policy 1, policy_version 1273695 (0.0009) [2023-12-28 04:23:21,292][106226] Updated weights for policy 0, policy_version 1270467 (0.0006) [2023-12-28 04:23:21,352][106226] Updated weights for policy 0, policy_version 1270477 (0.0008) [2023-12-28 04:23:21,427][106226] Updated weights for policy 0, policy_version 1270487 (0.0008) [2023-12-28 04:23:22,043][106225] Updated weights for policy 1, policy_version 1273705 (0.0007) [2023-12-28 04:23:22,081][106226] Updated weights for policy 0, policy_version 1270497 (0.0010) [2023-12-28 04:23:22,109][106225] Updated weights for policy 1, policy_version 1273715 (0.0009) [2023-12-28 04:23:22,151][106226] Updated weights for policy 0, policy_version 1270507 (0.0011) [2023-12-28 04:23:22,165][106225] Updated weights for policy 1, policy_version 1273725 (0.0008) [2023-12-28 04:23:22,213][106226] Updated weights for policy 0, policy_version 1270517 (0.0011) [2023-12-28 04:23:22,224][106225] Updated weights for policy 1, policy_version 1273735 (0.0006) [2023-12-28 04:23:22,929][106225] Updated weights for policy 1, policy_version 1273745 (0.0010) [2023-12-28 04:23:22,933][106226] Updated weights for policy 0, policy_version 1270527 (0.0008) [2023-12-28 04:23:22,988][106225] Updated weights for policy 1, policy_version 1273755 (0.0010) [2023-12-28 04:23:22,990][106226] Updated weights for policy 0, policy_version 1270537 (0.0005) [2023-12-28 04:23:23,044][106226] Updated weights for policy 0, policy_version 1270547 (0.0005) [2023-12-28 04:23:23,045][106225] Updated weights for policy 1, policy_version 1273765 (0.0010) [2023-12-28 04:23:23,568][106226] Updated weights for policy 0, policy_version 1270557 (0.0006) [2023-12-28 04:23:23,626][106226] Updated weights for policy 0, policy_version 1270567 (0.0005) [2023-12-28 04:23:23,685][106226] Updated weights for policy 0, policy_version 1270577 (0.0005) [2023-12-28 04:23:23,689][106225] Updated weights for policy 1, policy_version 1273775 (0.0007) [2023-12-28 04:23:23,748][106225] Updated weights for policy 1, policy_version 1273785 (0.0007) [2023-12-28 04:23:23,800][106225] Updated weights for policy 1, policy_version 1273795 (0.0006) [2023-12-28 04:23:24,281][106226] Updated weights for policy 0, policy_version 1270587 (0.0007) [2023-12-28 04:23:24,332][106226] Updated weights for policy 0, policy_version 1270597 (0.0011) [2023-12-28 04:23:24,395][106226] Updated weights for policy 0, policy_version 1270607 (0.0011) [2023-12-28 04:23:24,498][106225] Updated weights for policy 1, policy_version 1273805 (0.0007) [2023-12-28 04:23:24,553][106225] Updated weights for policy 1, policy_version 1273815 (0.0008) [2023-12-28 04:23:24,614][106225] Updated weights for policy 1, policy_version 1273825 (0.0008) [2023-12-28 04:23:25,117][106226] Updated weights for policy 0, policy_version 1270617 (0.0010) [2023-12-28 04:23:25,177][106226] Updated weights for policy 0, policy_version 1270627 (0.0008) [2023-12-28 04:23:25,226][106226] Updated weights for policy 0, policy_version 1270637 (0.0009) [2023-12-28 04:23:25,298][106225] Updated weights for policy 1, policy_version 1273835 (0.0007) [2023-12-28 04:23:25,308][106226] Updated weights for policy 0, policy_version 1270647 (0.0009) [2023-12-28 04:23:25,353][106225] Updated weights for policy 1, policy_version 1273845 (0.0006) [2023-12-28 04:23:25,405][106225] Updated weights for policy 1, policy_version 1273855 (0.0005) [2023-12-28 04:23:26,001][106225] Updated weights for policy 1, policy_version 1273865 (0.0007) [2023-12-28 04:23:26,002][106226] Updated weights for policy 0, policy_version 1270657 (0.0010) [2023-12-28 04:23:26,058][106225] Updated weights for policy 1, policy_version 1273875 (0.0006) [2023-12-28 04:23:26,066][106226] Updated weights for policy 0, policy_version 1270667 (0.0011) [2023-12-28 04:23:26,113][106225] Updated weights for policy 1, policy_version 1273885 (0.0006) [2023-12-28 04:23:26,119][106226] Updated weights for policy 0, policy_version 1270677 (0.0010) [2023-12-28 04:23:26,156][106225] Updated weights for policy 1, policy_version 1273895 (0.0005) [2023-12-28 04:23:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 651517952. Throughput: 0: 9982.8, 1: 9796.3. Samples: 651479400. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:26,175][105115] Avg episode reward: [(0, '-3.962'), (1, '-5.342')] [2023-12-28 04:23:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001273896_326164480.pth... [2023-12-28 04:23:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001270680_325353472.pth... [2023-12-28 04:23:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001272744_325869568.pth [2023-12-28 04:23:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001269496_325050368.pth [2023-12-28 04:23:26,796][106226] Updated weights for policy 0, policy_version 1270687 (0.0007) [2023-12-28 04:23:26,851][106226] Updated weights for policy 0, policy_version 1270697 (0.0005) [2023-12-28 04:23:26,894][106225] Updated weights for policy 1, policy_version 1273905 (0.0007) [2023-12-28 04:23:26,912][106226] Updated weights for policy 0, policy_version 1270707 (0.0007) [2023-12-28 04:23:26,949][106225] Updated weights for policy 1, policy_version 1273915 (0.0008) [2023-12-28 04:23:27,010][106225] Updated weights for policy 1, policy_version 1273925 (0.0009) [2023-12-28 04:23:27,532][106226] Updated weights for policy 0, policy_version 1270717 (0.0007) [2023-12-28 04:23:27,576][106226] Updated weights for policy 0, policy_version 1270727 (0.0006) [2023-12-28 04:23:27,619][106226] Updated weights for policy 0, policy_version 1270737 (0.0005) [2023-12-28 04:23:27,654][106225] Updated weights for policy 1, policy_version 1273935 (0.0009) [2023-12-28 04:23:27,705][106225] Updated weights for policy 1, policy_version 1273945 (0.0008) [2023-12-28 04:23:27,765][106225] Updated weights for policy 1, policy_version 1273955 (0.0008) [2023-12-28 04:23:28,317][106226] Updated weights for policy 0, policy_version 1270747 (0.0006) [2023-12-28 04:23:28,378][106226] Updated weights for policy 0, policy_version 1270757 (0.0008) [2023-12-28 04:23:28,437][106226] Updated weights for policy 0, policy_version 1270767 (0.0007) [2023-12-28 04:23:28,507][106225] Updated weights for policy 1, policy_version 1273965 (0.0008) [2023-12-28 04:23:28,572][106225] Updated weights for policy 1, policy_version 1273975 (0.0008) [2023-12-28 04:23:28,635][106225] Updated weights for policy 1, policy_version 1273985 (0.0009) [2023-12-28 04:23:29,112][106226] Updated weights for policy 0, policy_version 1270777 (0.0006) [2023-12-28 04:23:29,159][106226] Updated weights for policy 0, policy_version 1270787 (0.0008) [2023-12-28 04:23:29,207][106226] Updated weights for policy 0, policy_version 1270797 (0.0008) [2023-12-28 04:23:29,271][106226] Updated weights for policy 0, policy_version 1270807 (0.0008) [2023-12-28 04:23:29,341][106225] Updated weights for policy 1, policy_version 1273995 (0.0008) [2023-12-28 04:23:29,412][106225] Updated weights for policy 1, policy_version 1274005 (0.0009) [2023-12-28 04:23:29,465][106225] Updated weights for policy 1, policy_version 1274015 (0.0009) [2023-12-28 04:23:29,989][106226] Updated weights for policy 0, policy_version 1270817 (0.0009) [2023-12-28 04:23:30,047][106226] Updated weights for policy 0, policy_version 1270827 (0.0008) [2023-12-28 04:23:30,106][106226] Updated weights for policy 0, policy_version 1270837 (0.0009) [2023-12-28 04:23:30,187][106225] Updated weights for policy 1, policy_version 1274025 (0.0008) [2023-12-28 04:23:30,245][106225] Updated weights for policy 1, policy_version 1274035 (0.0008) [2023-12-28 04:23:30,299][106225] Updated weights for policy 1, policy_version 1274045 (0.0005) [2023-12-28 04:23:30,360][106225] Updated weights for policy 1, policy_version 1274055 (0.0005) [2023-12-28 04:23:30,867][106226] Updated weights for policy 0, policy_version 1270847 (0.0009) [2023-12-28 04:23:30,915][106226] Updated weights for policy 0, policy_version 1270857 (0.0008) [2023-12-28 04:23:30,969][106226] Updated weights for policy 0, policy_version 1270867 (0.0008) [2023-12-28 04:23:31,032][106225] Updated weights for policy 1, policy_version 1274065 (0.0007) [2023-12-28 04:23:31,096][106225] Updated weights for policy 1, policy_version 1274075 (0.0008) [2023-12-28 04:23:31,164][106225] Updated weights for policy 1, policy_version 1274085 (0.0007) [2023-12-28 04:23:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 651608064. Throughput: 0: 9974.7, 1: 9857.1. Samples: 651599936. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:31,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.457')] [2023-12-28 04:23:31,739][106226] Updated weights for policy 0, policy_version 1270877 (0.0007) [2023-12-28 04:23:31,796][106226] Updated weights for policy 0, policy_version 1270887 (0.0005) [2023-12-28 04:23:31,854][106226] Updated weights for policy 0, policy_version 1270897 (0.0005) [2023-12-28 04:23:31,914][106225] Updated weights for policy 1, policy_version 1274095 (0.0008) [2023-12-28 04:23:31,966][106225] Updated weights for policy 1, policy_version 1274105 (0.0007) [2023-12-28 04:23:32,022][106225] Updated weights for policy 1, policy_version 1274115 (0.0009) [2023-12-28 04:23:32,499][106226] Updated weights for policy 0, policy_version 1270907 (0.0005) [2023-12-28 04:23:32,556][106226] Updated weights for policy 0, policy_version 1270917 (0.0005) [2023-12-28 04:23:32,626][106226] Updated weights for policy 0, policy_version 1270927 (0.0005) [2023-12-28 04:23:32,773][106225] Updated weights for policy 1, policy_version 1274125 (0.0008) [2023-12-28 04:23:32,831][106225] Updated weights for policy 1, policy_version 1274135 (0.0010) [2023-12-28 04:23:32,895][106225] Updated weights for policy 1, policy_version 1274145 (0.0009) [2023-12-28 04:23:33,129][106226] Updated weights for policy 0, policy_version 1270937 (0.0006) [2023-12-28 04:23:33,183][106226] Updated weights for policy 0, policy_version 1270947 (0.0006) [2023-12-28 04:23:33,239][106226] Updated weights for policy 0, policy_version 1270957 (0.0006) [2023-12-28 04:23:33,297][106226] Updated weights for policy 0, policy_version 1270967 (0.0008) [2023-12-28 04:23:33,626][106225] Updated weights for policy 1, policy_version 1274155 (0.0009) [2023-12-28 04:23:33,677][106225] Updated weights for policy 1, policy_version 1274165 (0.0009) [2023-12-28 04:23:33,726][106225] Updated weights for policy 1, policy_version 1274175 (0.0010) [2023-12-28 04:23:33,877][106226] Updated weights for policy 0, policy_version 1270977 (0.0009) [2023-12-28 04:23:33,933][106226] Updated weights for policy 0, policy_version 1270987 (0.0009) [2023-12-28 04:23:33,994][106226] Updated weights for policy 0, policy_version 1270997 (0.0008) [2023-12-28 04:23:34,496][106225] Updated weights for policy 1, policy_version 1274185 (0.0010) [2023-12-28 04:23:34,567][106225] Updated weights for policy 1, policy_version 1274195 (0.0006) [2023-12-28 04:23:34,631][106225] Updated weights for policy 1, policy_version 1274205 (0.0006) [2023-12-28 04:23:34,692][106225] Updated weights for policy 1, policy_version 1274215 (0.0005) [2023-12-28 04:23:34,748][106226] Updated weights for policy 0, policy_version 1271007 (0.0009) [2023-12-28 04:23:34,796][106226] Updated weights for policy 0, policy_version 1271017 (0.0008) [2023-12-28 04:23:34,851][106226] Updated weights for policy 0, policy_version 1271027 (0.0009) [2023-12-28 04:23:35,315][106225] Updated weights for policy 1, policy_version 1274225 (0.0005) [2023-12-28 04:23:35,373][106225] Updated weights for policy 1, policy_version 1274235 (0.0008) [2023-12-28 04:23:35,425][106225] Updated weights for policy 1, policy_version 1274245 (0.0010) [2023-12-28 04:23:35,483][106226] Updated weights for policy 0, policy_version 1271037 (0.0008) [2023-12-28 04:23:35,531][106226] Updated weights for policy 0, policy_version 1271047 (0.0006) [2023-12-28 04:23:35,574][106226] Updated weights for policy 0, policy_version 1271057 (0.0008) [2023-12-28 04:23:36,155][106225] Updated weights for policy 1, policy_version 1274255 (0.0010) [2023-12-28 04:23:36,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 651706368. Throughput: 0: 10033.1, 1: 9847.0. Samples: 651720420. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:36,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-5.301')] [2023-12-28 04:23:36,220][106225] Updated weights for policy 1, policy_version 1274265 (0.0010) [2023-12-28 04:23:36,281][106225] Updated weights for policy 1, policy_version 1274275 (0.0011) [2023-12-28 04:23:36,328][106226] Updated weights for policy 0, policy_version 1271067 (0.0008) [2023-12-28 04:23:36,386][106226] Updated weights for policy 0, policy_version 1271077 (0.0008) [2023-12-28 04:23:36,443][106226] Updated weights for policy 0, policy_version 1271087 (0.0008) [2023-12-28 04:23:37,003][106225] Updated weights for policy 1, policy_version 1274285 (0.0009) [2023-12-28 04:23:37,058][106225] Updated weights for policy 1, policy_version 1274295 (0.0007) [2023-12-28 04:23:37,108][106225] Updated weights for policy 1, policy_version 1274305 (0.0009) [2023-12-28 04:23:37,180][106226] Updated weights for policy 0, policy_version 1271097 (0.0008) [2023-12-28 04:23:37,237][106226] Updated weights for policy 0, policy_version 1271107 (0.0008) [2023-12-28 04:23:37,296][106226] Updated weights for policy 0, policy_version 1271117 (0.0008) [2023-12-28 04:23:37,354][106226] Updated weights for policy 0, policy_version 1271127 (0.0008) [2023-12-28 04:23:37,762][106225] Updated weights for policy 1, policy_version 1274315 (0.0009) [2023-12-28 04:23:37,828][106225] Updated weights for policy 1, policy_version 1274325 (0.0008) [2023-12-28 04:23:37,891][106225] Updated weights for policy 1, policy_version 1274335 (0.0008) [2023-12-28 04:23:38,111][106226] Updated weights for policy 0, policy_version 1271137 (0.0006) [2023-12-28 04:23:38,166][106226] Updated weights for policy 0, policy_version 1271147 (0.0005) [2023-12-28 04:23:38,226][106226] Updated weights for policy 0, policy_version 1271157 (0.0005) [2023-12-28 04:23:38,663][106225] Updated weights for policy 1, policy_version 1274345 (0.0008) [2023-12-28 04:23:38,723][106225] Updated weights for policy 1, policy_version 1274355 (0.0007) [2023-12-28 04:23:38,784][106225] Updated weights for policy 1, policy_version 1274365 (0.0005) [2023-12-28 04:23:38,840][106225] Updated weights for policy 1, policy_version 1274375 (0.0007) [2023-12-28 04:23:38,873][106226] Updated weights for policy 0, policy_version 1271167 (0.0010) [2023-12-28 04:23:38,943][106226] Updated weights for policy 0, policy_version 1271177 (0.0010) [2023-12-28 04:23:39,010][106226] Updated weights for policy 0, policy_version 1271187 (0.0007) [2023-12-28 04:23:39,457][106225] Updated weights for policy 1, policy_version 1274385 (0.0008) [2023-12-28 04:23:39,518][106225] Updated weights for policy 1, policy_version 1274395 (0.0008) [2023-12-28 04:23:39,577][106225] Updated weights for policy 1, policy_version 1274405 (0.0009) [2023-12-28 04:23:39,679][106226] Updated weights for policy 0, policy_version 1271197 (0.0010) [2023-12-28 04:23:39,743][106226] Updated weights for policy 0, policy_version 1271207 (0.0009) [2023-12-28 04:23:39,810][106226] Updated weights for policy 0, policy_version 1271217 (0.0009) [2023-12-28 04:23:40,351][106225] Updated weights for policy 1, policy_version 1274415 (0.0008) [2023-12-28 04:23:40,409][106225] Updated weights for policy 1, policy_version 1274425 (0.0009) [2023-12-28 04:23:40,469][106225] Updated weights for policy 1, policy_version 1274435 (0.0009) [2023-12-28 04:23:40,573][106226] Updated weights for policy 0, policy_version 1271227 (0.0009) [2023-12-28 04:23:40,631][106226] Updated weights for policy 0, policy_version 1271237 (0.0009) [2023-12-28 04:23:40,682][106226] Updated weights for policy 0, policy_version 1271247 (0.0008) [2023-12-28 04:23:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 651804672. Throughput: 0: 10015.9, 1: 9852.2. Samples: 651778100. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:41,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.678')] [2023-12-28 04:23:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001271256_325500928.pth... [2023-12-28 04:23:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001270104_325206016.pth [2023-12-28 04:23:41,203][106225] Updated weights for policy 1, policy_version 1274445 (0.0008) [2023-12-28 04:23:41,271][106225] Updated weights for policy 1, policy_version 1274455 (0.0009) [2023-12-28 04:23:41,331][106225] Updated weights for policy 1, policy_version 1274465 (0.0009) [2023-12-28 04:23:41,383][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001274472_326311936.pth... [2023-12-28 04:23:41,388][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001273320_326017024.pth [2023-12-28 04:23:41,444][106226] Updated weights for policy 0, policy_version 1271257 (0.0009) [2023-12-28 04:23:41,512][106226] Updated weights for policy 0, policy_version 1271267 (0.0009) [2023-12-28 04:23:41,582][106226] Updated weights for policy 0, policy_version 1271277 (0.0009) [2023-12-28 04:23:41,650][106226] Updated weights for policy 0, policy_version 1271287 (0.0008) [2023-12-28 04:23:42,132][106225] Updated weights for policy 1, policy_version 1274475 (0.0008) [2023-12-28 04:23:42,187][106225] Updated weights for policy 1, policy_version 1274485 (0.0007) [2023-12-28 04:23:42,249][106225] Updated weights for policy 1, policy_version 1274495 (0.0008) [2023-12-28 04:23:42,434][106226] Updated weights for policy 0, policy_version 1271297 (0.0008) [2023-12-28 04:23:42,497][106226] Updated weights for policy 0, policy_version 1271307 (0.0008) [2023-12-28 04:23:42,552][106226] Updated weights for policy 0, policy_version 1271317 (0.0011) [2023-12-28 04:23:42,958][106225] Updated weights for policy 1, policy_version 1274505 (0.0007) [2023-12-28 04:23:43,018][106225] Updated weights for policy 1, policy_version 1274515 (0.0007) [2023-12-28 04:23:43,071][106225] Updated weights for policy 1, policy_version 1274525 (0.0005) [2023-12-28 04:23:43,127][106225] Updated weights for policy 1, policy_version 1274535 (0.0009) [2023-12-28 04:23:43,265][106226] Updated weights for policy 0, policy_version 1271327 (0.0011) [2023-12-28 04:23:43,332][106226] Updated weights for policy 0, policy_version 1271337 (0.0008) [2023-12-28 04:23:43,394][106226] Updated weights for policy 0, policy_version 1271347 (0.0008) [2023-12-28 04:23:43,830][106225] Updated weights for policy 1, policy_version 1274545 (0.0010) [2023-12-28 04:23:43,890][106225] Updated weights for policy 1, policy_version 1274555 (0.0010) [2023-12-28 04:23:43,946][106225] Updated weights for policy 1, policy_version 1274565 (0.0010) [2023-12-28 04:23:44,121][106226] Updated weights for policy 0, policy_version 1271357 (0.0008) [2023-12-28 04:23:44,171][106226] Updated weights for policy 0, policy_version 1271367 (0.0008) [2023-12-28 04:23:44,231][106226] Updated weights for policy 0, policy_version 1271377 (0.0008) [2023-12-28 04:23:44,660][106225] Updated weights for policy 1, policy_version 1274575 (0.0010) [2023-12-28 04:23:44,708][106225] Updated weights for policy 1, policy_version 1274585 (0.0010) [2023-12-28 04:23:44,755][106225] Updated weights for policy 1, policy_version 1274595 (0.0010) [2023-12-28 04:23:44,969][106226] Updated weights for policy 0, policy_version 1271387 (0.0007) [2023-12-28 04:23:45,022][106226] Updated weights for policy 0, policy_version 1271397 (0.0007) [2023-12-28 04:23:45,075][106226] Updated weights for policy 0, policy_version 1271407 (0.0005) [2023-12-28 04:23:45,515][106225] Updated weights for policy 1, policy_version 1274605 (0.0010) [2023-12-28 04:23:45,578][106225] Updated weights for policy 1, policy_version 1274615 (0.0008) [2023-12-28 04:23:45,637][106225] Updated weights for policy 1, policy_version 1274625 (0.0008) [2023-12-28 04:23:45,803][106226] Updated weights for policy 0, policy_version 1271417 (0.0007) [2023-12-28 04:23:45,861][106226] Updated weights for policy 0, policy_version 1271427 (0.0008) [2023-12-28 04:23:45,924][106226] Updated weights for policy 0, policy_version 1271437 (0.0009) [2023-12-28 04:23:45,989][106226] Updated weights for policy 0, policy_version 1271447 (0.0009) [2023-12-28 04:23:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 651902976. Throughput: 0: 9944.1, 1: 9790.0. Samples: 651892156. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:46,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.150')] [2023-12-28 04:23:46,321][106225] Updated weights for policy 1, policy_version 1274635 (0.0009) [2023-12-28 04:23:46,380][106225] Updated weights for policy 1, policy_version 1274645 (0.0009) [2023-12-28 04:23:46,439][106225] Updated weights for policy 1, policy_version 1274655 (0.0008) [2023-12-28 04:23:46,636][106226] Updated weights for policy 0, policy_version 1271457 (0.0010) [2023-12-28 04:23:46,699][106226] Updated weights for policy 0, policy_version 1271467 (0.0009) [2023-12-28 04:23:46,759][106226] Updated weights for policy 0, policy_version 1271477 (0.0009) [2023-12-28 04:23:47,189][106225] Updated weights for policy 1, policy_version 1274665 (0.0008) [2023-12-28 04:23:47,236][106225] Updated weights for policy 1, policy_version 1274675 (0.0008) [2023-12-28 04:23:47,281][106225] Updated weights for policy 1, policy_version 1274685 (0.0008) [2023-12-28 04:23:47,328][106225] Updated weights for policy 1, policy_version 1274695 (0.0007) [2023-12-28 04:23:47,397][106226] Updated weights for policy 0, policy_version 1271487 (0.0008) [2023-12-28 04:23:47,447][106226] Updated weights for policy 0, policy_version 1271498 (0.0009) [2023-12-28 04:23:47,498][106226] Updated weights for policy 0, policy_version 1271509 (0.0009) [2023-12-28 04:23:47,956][106225] Updated weights for policy 1, policy_version 1274705 (0.0009) [2023-12-28 04:23:48,019][106225] Updated weights for policy 1, policy_version 1274715 (0.0009) [2023-12-28 04:23:48,082][106225] Updated weights for policy 1, policy_version 1274725 (0.0008) [2023-12-28 04:23:48,130][106226] Updated weights for policy 0, policy_version 1271519 (0.0008) [2023-12-28 04:23:48,189][106226] Updated weights for policy 0, policy_version 1271529 (0.0009) [2023-12-28 04:23:48,247][106226] Updated weights for policy 0, policy_version 1271539 (0.0008) [2023-12-28 04:23:48,796][106225] Updated weights for policy 1, policy_version 1274735 (0.0008) [2023-12-28 04:23:48,864][106225] Updated weights for policy 1, policy_version 1274745 (0.0009) [2023-12-28 04:23:48,927][106225] Updated weights for policy 1, policy_version 1274755 (0.0007) [2023-12-28 04:23:48,974][106226] Updated weights for policy 0, policy_version 1271549 (0.0008) [2023-12-28 04:23:49,035][106226] Updated weights for policy 0, policy_version 1271559 (0.0008) [2023-12-28 04:23:49,085][106226] Updated weights for policy 0, policy_version 1271569 (0.0008) [2023-12-28 04:23:49,669][106225] Updated weights for policy 1, policy_version 1274765 (0.0008) [2023-12-28 04:23:49,728][106225] Updated weights for policy 1, policy_version 1274775 (0.0008) [2023-12-28 04:23:49,787][106225] Updated weights for policy 1, policy_version 1274785 (0.0009) [2023-12-28 04:23:49,813][106226] Updated weights for policy 0, policy_version 1271579 (0.0009) [2023-12-28 04:23:49,887][106226] Updated weights for policy 0, policy_version 1271589 (0.0009) [2023-12-28 04:23:49,959][106226] Updated weights for policy 0, policy_version 1271599 (0.0009) [2023-12-28 04:23:50,581][106225] Updated weights for policy 1, policy_version 1274795 (0.0008) [2023-12-28 04:23:50,636][106225] Updated weights for policy 1, policy_version 1274805 (0.0010) [2023-12-28 04:23:50,690][106225] Updated weights for policy 1, policy_version 1274815 (0.0010) [2023-12-28 04:23:50,706][106226] Updated weights for policy 0, policy_version 1271609 (0.0008) [2023-12-28 04:23:50,763][106226] Updated weights for policy 0, policy_version 1271619 (0.0006) [2023-12-28 04:23:50,810][106226] Updated weights for policy 0, policy_version 1271629 (0.0008) [2023-12-28 04:23:50,861][106226] Updated weights for policy 0, policy_version 1271639 (0.0008) [2023-12-28 04:23:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 652001280. Throughput: 0: 9892.6, 1: 9737.6. Samples: 652009428. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:51,175][105115] Avg episode reward: [(0, '-4.017'), (1, '-4.982')] [2023-12-28 04:23:51,516][106225] Updated weights for policy 1, policy_version 1274825 (0.0010) [2023-12-28 04:23:51,587][106225] Updated weights for policy 1, policy_version 1274835 (0.0007) [2023-12-28 04:23:51,598][106226] Updated weights for policy 0, policy_version 1271649 (0.0008) [2023-12-28 04:23:51,652][106225] Updated weights for policy 1, policy_version 1274845 (0.0008) [2023-12-28 04:23:51,664][106226] Updated weights for policy 0, policy_version 1271659 (0.0008) [2023-12-28 04:23:51,717][106225] Updated weights for policy 1, policy_version 1274855 (0.0008) [2023-12-28 04:23:51,725][106226] Updated weights for policy 0, policy_version 1271669 (0.0008) [2023-12-28 04:23:52,459][106225] Updated weights for policy 1, policy_version 1274865 (0.0010) [2023-12-28 04:23:52,496][106226] Updated weights for policy 0, policy_version 1271679 (0.0007) [2023-12-28 04:23:52,523][106225] Updated weights for policy 1, policy_version 1274875 (0.0011) [2023-12-28 04:23:52,560][106226] Updated weights for policy 0, policy_version 1271689 (0.0005) [2023-12-28 04:23:52,588][106225] Updated weights for policy 1, policy_version 1274885 (0.0010) [2023-12-28 04:23:52,615][106226] Updated weights for policy 0, policy_version 1271699 (0.0008) [2023-12-28 04:23:53,254][106225] Updated weights for policy 1, policy_version 1274895 (0.0010) [2023-12-28 04:23:53,257][106226] Updated weights for policy 0, policy_version 1271709 (0.0008) [2023-12-28 04:23:53,311][106225] Updated weights for policy 1, policy_version 1274905 (0.0008) [2023-12-28 04:23:53,312][106226] Updated weights for policy 0, policy_version 1271719 (0.0006) [2023-12-28 04:23:53,365][106225] Updated weights for policy 1, policy_version 1274915 (0.0005) [2023-12-28 04:23:53,369][106226] Updated weights for policy 0, policy_version 1271729 (0.0008) [2023-12-28 04:23:53,927][106225] Updated weights for policy 1, policy_version 1274925 (0.0008) [2023-12-28 04:23:53,977][106225] Updated weights for policy 1, policy_version 1274935 (0.0010) [2023-12-28 04:23:54,030][106225] Updated weights for policy 1, policy_version 1274945 (0.0010) [2023-12-28 04:23:54,056][106226] Updated weights for policy 0, policy_version 1271739 (0.0009) [2023-12-28 04:23:54,122][106226] Updated weights for policy 0, policy_version 1271749 (0.0007) [2023-12-28 04:23:54,181][106226] Updated weights for policy 0, policy_version 1271759 (0.0007) [2023-12-28 04:23:54,753][106225] Updated weights for policy 1, policy_version 1274955 (0.0010) [2023-12-28 04:23:54,810][106225] Updated weights for policy 1, policy_version 1274965 (0.0010) [2023-12-28 04:23:54,874][106225] Updated weights for policy 1, policy_version 1274975 (0.0011) [2023-12-28 04:23:54,904][106226] Updated weights for policy 0, policy_version 1271769 (0.0008) [2023-12-28 04:23:54,971][106226] Updated weights for policy 0, policy_version 1271779 (0.0008) [2023-12-28 04:23:55,032][106226] Updated weights for policy 0, policy_version 1271789 (0.0009) [2023-12-28 04:23:55,086][106226] Updated weights for policy 0, policy_version 1271799 (0.0010) [2023-12-28 04:23:55,598][106225] Updated weights for policy 1, policy_version 1274985 (0.0010) [2023-12-28 04:23:55,644][106225] Updated weights for policy 1, policy_version 1274995 (0.0007) [2023-12-28 04:23:55,690][106225] Updated weights for policy 1, policy_version 1275005 (0.0008) [2023-12-28 04:23:55,736][106225] Updated weights for policy 1, policy_version 1275015 (0.0008) [2023-12-28 04:23:55,806][106226] Updated weights for policy 0, policy_version 1271809 (0.0010) [2023-12-28 04:23:55,868][106226] Updated weights for policy 0, policy_version 1271819 (0.0007) [2023-12-28 04:23:55,921][106226] Updated weights for policy 0, policy_version 1271829 (0.0010) [2023-12-28 04:23:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 652099584. Throughput: 0: 9848.0, 1: 9688.5. Samples: 652068436. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:23:56,175][105115] Avg episode reward: [(0, '-4.254'), (1, '-5.153')] [2023-12-28 04:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001271832_325648384.pth... [2023-12-28 04:23:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001275016_326451200.pth... [2023-12-28 04:23:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001270680_325353472.pth [2023-12-28 04:23:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001273896_326164480.pth [2023-12-28 04:23:56,507][106225] Updated weights for policy 1, policy_version 1275025 (0.0009) [2023-12-28 04:23:56,564][106225] Updated weights for policy 1, policy_version 1275035 (0.0010) [2023-12-28 04:23:56,571][106226] Updated weights for policy 0, policy_version 1271839 (0.0009) [2023-12-28 04:23:56,617][106225] Updated weights for policy 1, policy_version 1275045 (0.0010) [2023-12-28 04:23:56,624][106226] Updated weights for policy 0, policy_version 1271849 (0.0010) [2023-12-28 04:23:56,681][106226] Updated weights for policy 0, policy_version 1271859 (0.0010) [2023-12-28 04:23:57,297][106225] Updated weights for policy 1, policy_version 1275055 (0.0009) [2023-12-28 04:23:57,332][106226] Updated weights for policy 0, policy_version 1271869 (0.0009) [2023-12-28 04:23:57,353][106225] Updated weights for policy 1, policy_version 1275065 (0.0007) [2023-12-28 04:23:57,380][106226] Updated weights for policy 0, policy_version 1271879 (0.0006) [2023-12-28 04:23:57,411][106225] Updated weights for policy 1, policy_version 1275075 (0.0008) [2023-12-28 04:23:57,430][106226] Updated weights for policy 0, policy_version 1271889 (0.0007) [2023-12-28 04:23:58,057][106225] Updated weights for policy 1, policy_version 1275085 (0.0009) [2023-12-28 04:23:58,115][106225] Updated weights for policy 1, policy_version 1275095 (0.0008) [2023-12-28 04:23:58,175][106225] Updated weights for policy 1, policy_version 1275105 (0.0007) [2023-12-28 04:23:58,188][106226] Updated weights for policy 0, policy_version 1271899 (0.0008) [2023-12-28 04:23:58,256][106226] Updated weights for policy 0, policy_version 1271909 (0.0008) [2023-12-28 04:23:58,318][106226] Updated weights for policy 0, policy_version 1271919 (0.0008) [2023-12-28 04:23:59,047][106225] Updated weights for policy 1, policy_version 1275115 (0.0009) [2023-12-28 04:23:59,054][106226] Updated weights for policy 0, policy_version 1271929 (0.0008) [2023-12-28 04:23:59,114][106225] Updated weights for policy 1, policy_version 1275125 (0.0011) [2023-12-28 04:23:59,115][106226] Updated weights for policy 0, policy_version 1271939 (0.0008) [2023-12-28 04:23:59,173][106226] Updated weights for policy 0, policy_version 1271949 (0.0008) [2023-12-28 04:23:59,176][106225] Updated weights for policy 1, policy_version 1275135 (0.0010) [2023-12-28 04:23:59,241][106226] Updated weights for policy 0, policy_version 1271959 (0.0008) [2023-12-28 04:23:59,912][106225] Updated weights for policy 1, policy_version 1275145 (0.0009) [2023-12-28 04:23:59,931][106226] Updated weights for policy 0, policy_version 1271969 (0.0009) [2023-12-28 04:23:59,980][106225] Updated weights for policy 1, policy_version 1275155 (0.0008) [2023-12-28 04:23:59,990][106226] Updated weights for policy 0, policy_version 1271979 (0.0006) [2023-12-28 04:24:00,045][106225] Updated weights for policy 1, policy_version 1275165 (0.0007) [2023-12-28 04:24:00,052][106226] Updated weights for policy 0, policy_version 1271989 (0.0007) [2023-12-28 04:24:00,106][106225] Updated weights for policy 1, policy_version 1275175 (0.0008) [2023-12-28 04:24:00,722][106226] Updated weights for policy 0, policy_version 1271999 (0.0007) [2023-12-28 04:24:00,787][106226] Updated weights for policy 0, policy_version 1272009 (0.0008) [2023-12-28 04:24:00,807][106225] Updated weights for policy 1, policy_version 1275185 (0.0010) [2023-12-28 04:24:00,852][106226] Updated weights for policy 0, policy_version 1272019 (0.0006) [2023-12-28 04:24:00,856][106225] Updated weights for policy 1, policy_version 1275195 (0.0009) [2023-12-28 04:24:00,905][106225] Updated weights for policy 1, policy_version 1275205 (0.0005) [2023-12-28 04:24:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 652197888. Throughput: 0: 9867.2, 1: 9704.9. Samples: 652184424. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:01,175][105115] Avg episode reward: [(0, '-4.151'), (1, '-5.364')] [2023-12-28 04:24:01,612][106225] Updated weights for policy 1, policy_version 1275215 (0.0007) [2023-12-28 04:24:01,639][106226] Updated weights for policy 0, policy_version 1272029 (0.0008) [2023-12-28 04:24:01,680][106225] Updated weights for policy 1, policy_version 1275225 (0.0007) [2023-12-28 04:24:01,704][106226] Updated weights for policy 0, policy_version 1272039 (0.0008) [2023-12-28 04:24:01,750][106225] Updated weights for policy 1, policy_version 1275235 (0.0008) [2023-12-28 04:24:01,773][106226] Updated weights for policy 0, policy_version 1272049 (0.0009) [2023-12-28 04:24:02,417][106225] Updated weights for policy 1, policy_version 1275245 (0.0008) [2023-12-28 04:24:02,470][106225] Updated weights for policy 1, policy_version 1275255 (0.0008) [2023-12-28 04:24:02,525][106225] Updated weights for policy 1, policy_version 1275265 (0.0009) [2023-12-28 04:24:02,543][106226] Updated weights for policy 0, policy_version 1272059 (0.0009) [2023-12-28 04:24:02,607][106226] Updated weights for policy 0, policy_version 1272069 (0.0008) [2023-12-28 04:24:02,668][106226] Updated weights for policy 0, policy_version 1272079 (0.0005) [2023-12-28 04:24:03,231][106225] Updated weights for policy 1, policy_version 1275275 (0.0007) [2023-12-28 04:24:03,279][106225] Updated weights for policy 1, policy_version 1275285 (0.0008) [2023-12-28 04:24:03,325][106225] Updated weights for policy 1, policy_version 1275295 (0.0008) [2023-12-28 04:24:03,370][106226] Updated weights for policy 0, policy_version 1272089 (0.0008) [2023-12-28 04:24:03,423][106226] Updated weights for policy 0, policy_version 1272099 (0.0008) [2023-12-28 04:24:03,470][106226] Updated weights for policy 0, policy_version 1272109 (0.0007) [2023-12-28 04:24:03,519][106226] Updated weights for policy 0, policy_version 1272119 (0.0007) [2023-12-28 04:24:03,927][106225] Updated weights for policy 1, policy_version 1275305 (0.0005) [2023-12-28 04:24:03,992][106225] Updated weights for policy 1, policy_version 1275315 (0.0008) [2023-12-28 04:24:04,060][106225] Updated weights for policy 1, policy_version 1275325 (0.0009) [2023-12-28 04:24:04,126][106225] Updated weights for policy 1, policy_version 1275335 (0.0008) [2023-12-28 04:24:04,214][106226] Updated weights for policy 0, policy_version 1272129 (0.0008) [2023-12-28 04:24:04,272][106226] Updated weights for policy 0, policy_version 1272139 (0.0009) [2023-12-28 04:24:04,334][106226] Updated weights for policy 0, policy_version 1272149 (0.0008) [2023-12-28 04:24:04,860][106225] Updated weights for policy 1, policy_version 1275345 (0.0008) [2023-12-28 04:24:04,917][106225] Updated weights for policy 1, policy_version 1275355 (0.0009) [2023-12-28 04:24:04,970][106225] Updated weights for policy 1, policy_version 1275365 (0.0008) [2023-12-28 04:24:05,065][106226] Updated weights for policy 0, policy_version 1272159 (0.0009) [2023-12-28 04:24:05,121][106226] Updated weights for policy 0, policy_version 1272169 (0.0009) [2023-12-28 04:24:05,169][106226] Updated weights for policy 0, policy_version 1272179 (0.0008) [2023-12-28 04:24:05,655][106225] Updated weights for policy 1, policy_version 1275375 (0.0008) [2023-12-28 04:24:05,703][106225] Updated weights for policy 1, policy_version 1275385 (0.0007) [2023-12-28 04:24:05,751][106225] Updated weights for policy 1, policy_version 1275395 (0.0008) [2023-12-28 04:24:05,920][106226] Updated weights for policy 0, policy_version 1272189 (0.0009) [2023-12-28 04:24:05,981][106226] Updated weights for policy 0, policy_version 1272199 (0.0010) [2023-12-28 04:24:06,035][106226] Updated weights for policy 0, policy_version 1272209 (0.0010) [2023-12-28 04:24:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 652296192. Throughput: 0: 9880.9, 1: 9756.1. Samples: 652301912. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:06,175][105115] Avg episode reward: [(0, '-3.968'), (1, '-5.113')] [2023-12-28 04:24:06,503][106225] Updated weights for policy 1, policy_version 1275405 (0.0007) [2023-12-28 04:24:06,562][106225] Updated weights for policy 1, policy_version 1275415 (0.0008) [2023-12-28 04:24:06,627][106225] Updated weights for policy 1, policy_version 1275425 (0.0008) [2023-12-28 04:24:06,798][106226] Updated weights for policy 0, policy_version 1272219 (0.0010) [2023-12-28 04:24:06,858][106226] Updated weights for policy 0, policy_version 1272229 (0.0009) [2023-12-28 04:24:06,923][106226] Updated weights for policy 0, policy_version 1272239 (0.0009) [2023-12-28 04:24:07,353][106225] Updated weights for policy 1, policy_version 1275435 (0.0008) [2023-12-28 04:24:07,415][106225] Updated weights for policy 1, policy_version 1275445 (0.0009) [2023-12-28 04:24:07,478][106225] Updated weights for policy 1, policy_version 1275455 (0.0008) [2023-12-28 04:24:07,637][106226] Updated weights for policy 0, policy_version 1272249 (0.0009) [2023-12-28 04:24:07,696][106226] Updated weights for policy 0, policy_version 1272259 (0.0008) [2023-12-28 04:24:07,762][106226] Updated weights for policy 0, policy_version 1272269 (0.0008) [2023-12-28 04:24:07,821][106226] Updated weights for policy 0, policy_version 1272279 (0.0006) [2023-12-28 04:24:08,216][106225] Updated weights for policy 1, policy_version 1275465 (0.0007) [2023-12-28 04:24:08,274][106225] Updated weights for policy 1, policy_version 1275475 (0.0008) [2023-12-28 04:24:08,332][106225] Updated weights for policy 1, policy_version 1275485 (0.0009) [2023-12-28 04:24:08,399][106225] Updated weights for policy 1, policy_version 1275495 (0.0009) [2023-12-28 04:24:08,462][106226] Updated weights for policy 0, policy_version 1272289 (0.0008) [2023-12-28 04:24:08,510][106226] Updated weights for policy 0, policy_version 1272299 (0.0008) [2023-12-28 04:24:08,574][106226] Updated weights for policy 0, policy_version 1272309 (0.0009) [2023-12-28 04:24:09,092][106225] Updated weights for policy 1, policy_version 1275505 (0.0006) [2023-12-28 04:24:09,148][106225] Updated weights for policy 1, policy_version 1275515 (0.0005) [2023-12-28 04:24:09,217][106225] Updated weights for policy 1, policy_version 1275525 (0.0006) [2023-12-28 04:24:09,424][106226] Updated weights for policy 0, policy_version 1272320 (0.0008) [2023-12-28 04:24:09,480][106226] Updated weights for policy 0, policy_version 1272330 (0.0007) [2023-12-28 04:24:09,537][106226] Updated weights for policy 0, policy_version 1272340 (0.0007) [2023-12-28 04:24:09,914][106225] Updated weights for policy 1, policy_version 1275535 (0.0008) [2023-12-28 04:24:09,979][106225] Updated weights for policy 1, policy_version 1275545 (0.0007) [2023-12-28 04:24:10,035][106225] Updated weights for policy 1, policy_version 1275555 (0.0007) [2023-12-28 04:24:10,225][106226] Updated weights for policy 0, policy_version 1272350 (0.0007) [2023-12-28 04:24:10,291][106226] Updated weights for policy 0, policy_version 1272360 (0.0006) [2023-12-28 04:24:10,364][106226] Updated weights for policy 0, policy_version 1272370 (0.0009) [2023-12-28 04:24:10,706][106225] Updated weights for policy 1, policy_version 1275565 (0.0008) [2023-12-28 04:24:10,770][106225] Updated weights for policy 1, policy_version 1275575 (0.0010) [2023-12-28 04:24:10,825][106225] Updated weights for policy 1, policy_version 1275585 (0.0008) [2023-12-28 04:24:10,995][106226] Updated weights for policy 0, policy_version 1272380 (0.0008) [2023-12-28 04:24:11,058][106226] Updated weights for policy 0, policy_version 1272390 (0.0008) [2023-12-28 04:24:11,127][106226] Updated weights for policy 0, policy_version 1272400 (0.0008) [2023-12-28 04:24:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 652386304. Throughput: 0: 9817.0, 1: 9730.6. Samples: 652359040. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:11,175][105115] Avg episode reward: [(0, '-4.088'), (1, '-5.190')] [2023-12-28 04:24:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001275592_326598656.pth... [2023-12-28 04:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001272408_325795840.pth... [2023-12-28 04:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001274472_326311936.pth [2023-12-28 04:24:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001271256_325500928.pth [2023-12-28 04:24:11,630][106225] Updated weights for policy 1, policy_version 1275595 (0.0009) [2023-12-28 04:24:11,702][106225] Updated weights for policy 1, policy_version 1275605 (0.0008) [2023-12-28 04:24:11,765][106225] Updated weights for policy 1, policy_version 1275615 (0.0008) [2023-12-28 04:24:11,836][106226] Updated weights for policy 0, policy_version 1272410 (0.0008) [2023-12-28 04:24:11,895][106226] Updated weights for policy 0, policy_version 1272420 (0.0008) [2023-12-28 04:24:11,957][106226] Updated weights for policy 0, policy_version 1272430 (0.0009) [2023-12-28 04:24:12,018][106226] Updated weights for policy 0, policy_version 1272440 (0.0009) [2023-12-28 04:24:12,585][106225] Updated weights for policy 1, policy_version 1275625 (0.0009) [2023-12-28 04:24:12,645][106225] Updated weights for policy 1, policy_version 1275635 (0.0008) [2023-12-28 04:24:12,669][106226] Updated weights for policy 0, policy_version 1272450 (0.0009) [2023-12-28 04:24:12,699][106225] Updated weights for policy 1, policy_version 1275645 (0.0009) [2023-12-28 04:24:12,732][106226] Updated weights for policy 0, policy_version 1272460 (0.0006) [2023-12-28 04:24:12,761][106225] Updated weights for policy 1, policy_version 1275655 (0.0009) [2023-12-28 04:24:12,792][106226] Updated weights for policy 0, policy_version 1272470 (0.0008) [2023-12-28 04:24:13,471][106226] Updated weights for policy 0, policy_version 1272480 (0.0007) [2023-12-28 04:24:13,497][106225] Updated weights for policy 1, policy_version 1275665 (0.0007) [2023-12-28 04:24:13,517][106226] Updated weights for policy 0, policy_version 1272490 (0.0007) [2023-12-28 04:24:13,557][106225] Updated weights for policy 1, policy_version 1275675 (0.0007) [2023-12-28 04:24:13,581][106226] Updated weights for policy 0, policy_version 1272500 (0.0007) [2023-12-28 04:24:13,616][106225] Updated weights for policy 1, policy_version 1275685 (0.0008) [2023-12-28 04:24:14,214][106226] Updated weights for policy 0, policy_version 1272510 (0.0008) [2023-12-28 04:24:14,280][106226] Updated weights for policy 0, policy_version 1272520 (0.0008) [2023-12-28 04:24:14,343][106226] Updated weights for policy 0, policy_version 1272530 (0.0009) [2023-12-28 04:24:14,361][106225] Updated weights for policy 1, policy_version 1275695 (0.0008) [2023-12-28 04:24:14,423][106225] Updated weights for policy 1, policy_version 1275705 (0.0008) [2023-12-28 04:24:14,479][106225] Updated weights for policy 1, policy_version 1275715 (0.0008) [2023-12-28 04:24:15,098][106226] Updated weights for policy 0, policy_version 1272540 (0.0008) [2023-12-28 04:24:15,103][106225] Updated weights for policy 1, policy_version 1275725 (0.0006) [2023-12-28 04:24:15,163][106226] Updated weights for policy 0, policy_version 1272550 (0.0007) [2023-12-28 04:24:15,165][106225] Updated weights for policy 1, policy_version 1275735 (0.0006) [2023-12-28 04:24:15,224][106226] Updated weights for policy 0, policy_version 1272560 (0.0007) [2023-12-28 04:24:15,229][106225] Updated weights for policy 1, policy_version 1275745 (0.0006) [2023-12-28 04:24:15,775][106225] Updated weights for policy 1, policy_version 1275755 (0.0006) [2023-12-28 04:24:15,830][106225] Updated weights for policy 1, policy_version 1275765 (0.0005) [2023-12-28 04:24:15,893][106225] Updated weights for policy 1, policy_version 1275775 (0.0005) [2023-12-28 04:24:16,019][106226] Updated weights for policy 0, policy_version 1272570 (0.0008) [2023-12-28 04:24:16,072][106226] Updated weights for policy 0, policy_version 1272580 (0.0006) [2023-12-28 04:24:16,139][106226] Updated weights for policy 0, policy_version 1272590 (0.0007) [2023-12-28 04:24:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 652484608. Throughput: 0: 9797.1, 1: 9662.5. Samples: 652475616. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:16,175][105115] Avg episode reward: [(0, '-3.951'), (1, '-5.044')] [2023-12-28 04:24:16,202][106226] Updated weights for policy 0, policy_version 1272600 (0.0009) [2023-12-28 04:24:16,497][106225] Updated weights for policy 1, policy_version 1275785 (0.0006) [2023-12-28 04:24:16,554][106225] Updated weights for policy 1, policy_version 1275795 (0.0009) [2023-12-28 04:24:16,609][106225] Updated weights for policy 1, policy_version 1275805 (0.0008) [2023-12-28 04:24:16,668][106225] Updated weights for policy 1, policy_version 1275815 (0.0008) [2023-12-28 04:24:16,918][106226] Updated weights for policy 0, policy_version 1272610 (0.0008) [2023-12-28 04:24:16,970][106226] Updated weights for policy 0, policy_version 1272620 (0.0008) [2023-12-28 04:24:17,026][106226] Updated weights for policy 0, policy_version 1272630 (0.0008) [2023-12-28 04:24:17,376][106225] Updated weights for policy 1, policy_version 1275825 (0.0008) [2023-12-28 04:24:17,432][106225] Updated weights for policy 1, policy_version 1275835 (0.0008) [2023-12-28 04:24:17,485][106225] Updated weights for policy 1, policy_version 1275845 (0.0008) [2023-12-28 04:24:17,718][106226] Updated weights for policy 0, policy_version 1272640 (0.0008) [2023-12-28 04:24:17,768][106226] Updated weights for policy 0, policy_version 1272650 (0.0007) [2023-12-28 04:24:17,817][106226] Updated weights for policy 0, policy_version 1272660 (0.0008) [2023-12-28 04:24:18,229][106225] Updated weights for policy 1, policy_version 1275855 (0.0009) [2023-12-28 04:24:18,280][106225] Updated weights for policy 1, policy_version 1275865 (0.0009) [2023-12-28 04:24:18,334][106225] Updated weights for policy 1, policy_version 1275875 (0.0008) [2023-12-28 04:24:18,558][106226] Updated weights for policy 0, policy_version 1272670 (0.0009) [2023-12-28 04:24:18,609][106226] Updated weights for policy 0, policy_version 1272680 (0.0008) [2023-12-28 04:24:18,667][106226] Updated weights for policy 0, policy_version 1272690 (0.0006) [2023-12-28 04:24:19,115][106225] Updated weights for policy 1, policy_version 1275885 (0.0007) [2023-12-28 04:24:19,183][106225] Updated weights for policy 1, policy_version 1275895 (0.0005) [2023-12-28 04:24:19,253][106225] Updated weights for policy 1, policy_version 1275905 (0.0008) [2023-12-28 04:24:19,371][106226] Updated weights for policy 0, policy_version 1272700 (0.0008) [2023-12-28 04:24:19,436][106226] Updated weights for policy 0, policy_version 1272710 (0.0008) [2023-12-28 04:24:19,496][106226] Updated weights for policy 0, policy_version 1272720 (0.0009) [2023-12-28 04:24:19,996][106225] Updated weights for policy 1, policy_version 1275915 (0.0010) [2023-12-28 04:24:20,060][106225] Updated weights for policy 1, policy_version 1275925 (0.0008) [2023-12-28 04:24:20,123][106225] Updated weights for policy 1, policy_version 1275935 (0.0009) [2023-12-28 04:24:20,265][106226] Updated weights for policy 0, policy_version 1272730 (0.0008) [2023-12-28 04:24:20,325][106226] Updated weights for policy 0, policy_version 1272740 (0.0008) [2023-12-28 04:24:20,391][106226] Updated weights for policy 0, policy_version 1272750 (0.0008) [2023-12-28 04:24:20,450][106226] Updated weights for policy 0, policy_version 1272760 (0.0008) [2023-12-28 04:24:20,842][106225] Updated weights for policy 1, policy_version 1275945 (0.0009) [2023-12-28 04:24:20,901][106225] Updated weights for policy 1, policy_version 1275955 (0.0010) [2023-12-28 04:24:20,959][106225] Updated weights for policy 1, policy_version 1275965 (0.0011) [2023-12-28 04:24:21,024][106225] Updated weights for policy 1, policy_version 1275975 (0.0010) [2023-12-28 04:24:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 652582912. Throughput: 0: 9677.1, 1: 9712.6. Samples: 652592960. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:21,175][105115] Avg episode reward: [(0, '-4.164'), (1, '-4.996')] [2023-12-28 04:24:21,202][106226] Updated weights for policy 0, policy_version 1272770 (0.0007) [2023-12-28 04:24:21,279][106226] Updated weights for policy 0, policy_version 1272780 (0.0007) [2023-12-28 04:24:21,347][106226] Updated weights for policy 0, policy_version 1272790 (0.0008) [2023-12-28 04:24:21,691][106225] Updated weights for policy 1, policy_version 1275985 (0.0008) [2023-12-28 04:24:21,759][106225] Updated weights for policy 1, policy_version 1275995 (0.0008) [2023-12-28 04:24:21,825][106225] Updated weights for policy 1, policy_version 1276005 (0.0008) [2023-12-28 04:24:22,028][106226] Updated weights for policy 0, policy_version 1272800 (0.0008) [2023-12-28 04:24:22,094][106226] Updated weights for policy 0, policy_version 1272810 (0.0007) [2023-12-28 04:24:22,152][106226] Updated weights for policy 0, policy_version 1272820 (0.0007) [2023-12-28 04:24:22,525][106225] Updated weights for policy 1, policy_version 1276015 (0.0007) [2023-12-28 04:24:22,586][106225] Updated weights for policy 1, policy_version 1276025 (0.0009) [2023-12-28 04:24:22,656][106225] Updated weights for policy 1, policy_version 1276035 (0.0008) [2023-12-28 04:24:22,810][106226] Updated weights for policy 0, policy_version 1272830 (0.0007) [2023-12-28 04:24:22,870][106226] Updated weights for policy 0, policy_version 1272840 (0.0009) [2023-12-28 04:24:22,939][106226] Updated weights for policy 0, policy_version 1272850 (0.0010) [2023-12-28 04:24:23,305][106225] Updated weights for policy 1, policy_version 1276045 (0.0007) [2023-12-28 04:24:23,357][106225] Updated weights for policy 1, policy_version 1276055 (0.0008) [2023-12-28 04:24:23,412][106225] Updated weights for policy 1, policy_version 1276065 (0.0008) [2023-12-28 04:24:23,670][106226] Updated weights for policy 0, policy_version 1272860 (0.0009) [2023-12-28 04:24:23,720][106226] Updated weights for policy 0, policy_version 1272870 (0.0008) [2023-12-28 04:24:23,774][106226] Updated weights for policy 0, policy_version 1272880 (0.0009) [2023-12-28 04:24:24,134][106225] Updated weights for policy 1, policy_version 1276075 (0.0008) [2023-12-28 04:24:24,177][106225] Updated weights for policy 1, policy_version 1276085 (0.0008) [2023-12-28 04:24:24,240][106225] Updated weights for policy 1, policy_version 1276095 (0.0008) [2023-12-28 04:24:24,503][106226] Updated weights for policy 0, policy_version 1272890 (0.0009) [2023-12-28 04:24:24,559][106226] Updated weights for policy 0, policy_version 1272900 (0.0008) [2023-12-28 04:24:24,610][106226] Updated weights for policy 0, policy_version 1272910 (0.0008) [2023-12-28 04:24:24,668][106226] Updated weights for policy 0, policy_version 1272920 (0.0008) [2023-12-28 04:24:24,971][106225] Updated weights for policy 1, policy_version 1276105 (0.0008) [2023-12-28 04:24:25,026][106225] Updated weights for policy 1, policy_version 1276115 (0.0008) [2023-12-28 04:24:25,113][106225] Updated weights for policy 1, policy_version 1276125 (0.0007) [2023-12-28 04:24:25,184][106225] Updated weights for policy 1, policy_version 1276135 (0.0010) [2023-12-28 04:24:25,342][106226] Updated weights for policy 0, policy_version 1272930 (0.0006) [2023-12-28 04:24:25,392][106226] Updated weights for policy 0, policy_version 1272940 (0.0005) [2023-12-28 04:24:25,456][106226] Updated weights for policy 0, policy_version 1272950 (0.0007) [2023-12-28 04:24:25,932][106225] Updated weights for policy 1, policy_version 1276145 (0.0008) [2023-12-28 04:24:25,987][106225] Updated weights for policy 1, policy_version 1276155 (0.0008) [2023-12-28 04:24:26,047][106225] Updated weights for policy 1, policy_version 1276165 (0.0009) [2023-12-28 04:24:26,082][106226] Updated weights for policy 0, policy_version 1272960 (0.0008) [2023-12-28 04:24:26,144][106226] Updated weights for policy 0, policy_version 1272970 (0.0009) [2023-12-28 04:24:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 652681216. Throughput: 0: 9674.3, 1: 9727.7. Samples: 652651192. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:26,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-5.098')] [2023-12-28 04:24:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001276168_326746112.pth... [2023-12-28 04:24:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001275016_326451200.pth [2023-12-28 04:24:26,199][106226] Updated weights for policy 0, policy_version 1272980 (0.0006) [2023-12-28 04:24:26,218][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001272984_325943296.pth... [2023-12-28 04:24:26,221][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001271832_325648384.pth [2023-12-28 04:24:26,770][106225] Updated weights for policy 1, policy_version 1276175 (0.0010) [2023-12-28 04:24:26,802][106226] Updated weights for policy 0, policy_version 1272990 (0.0006) [2023-12-28 04:24:26,818][106225] Updated weights for policy 1, policy_version 1276185 (0.0008) [2023-12-28 04:24:26,852][106226] Updated weights for policy 0, policy_version 1273000 (0.0005) [2023-12-28 04:24:26,875][106225] Updated weights for policy 1, policy_version 1276195 (0.0007) [2023-12-28 04:24:26,912][106226] Updated weights for policy 0, policy_version 1273010 (0.0005) [2023-12-28 04:24:27,487][106226] Updated weights for policy 0, policy_version 1273020 (0.0007) [2023-12-28 04:24:27,549][106226] Updated weights for policy 0, policy_version 1273030 (0.0010) [2023-12-28 04:24:27,611][106226] Updated weights for policy 0, policy_version 1273040 (0.0011) [2023-12-28 04:24:27,666][106225] Updated weights for policy 1, policy_version 1276205 (0.0009) [2023-12-28 04:24:27,720][106225] Updated weights for policy 1, policy_version 1276215 (0.0008) [2023-12-28 04:24:27,781][106225] Updated weights for policy 1, policy_version 1276225 (0.0008) [2023-12-28 04:24:28,255][106226] Updated weights for policy 0, policy_version 1273050 (0.0011) [2023-12-28 04:24:28,318][106226] Updated weights for policy 0, policy_version 1273060 (0.0011) [2023-12-28 04:24:28,385][106226] Updated weights for policy 0, policy_version 1273070 (0.0011) [2023-12-28 04:24:28,453][106226] Updated weights for policy 0, policy_version 1273080 (0.0005) [2023-12-28 04:24:28,535][106225] Updated weights for policy 1, policy_version 1276235 (0.0008) [2023-12-28 04:24:28,596][106225] Updated weights for policy 1, policy_version 1276245 (0.0009) [2023-12-28 04:24:28,655][106225] Updated weights for policy 1, policy_version 1276255 (0.0008) [2023-12-28 04:24:29,006][106226] Updated weights for policy 0, policy_version 1273090 (0.0005) [2023-12-28 04:24:29,075][106226] Updated weights for policy 0, policy_version 1273100 (0.0008) [2023-12-28 04:24:29,144][106226] Updated weights for policy 0, policy_version 1273110 (0.0008) [2023-12-28 04:24:29,505][106225] Updated weights for policy 1, policy_version 1276265 (0.0007) [2023-12-28 04:24:29,571][106225] Updated weights for policy 1, policy_version 1276275 (0.0010) [2023-12-28 04:24:29,625][106225] Updated weights for policy 1, policy_version 1276285 (0.0008) [2023-12-28 04:24:29,679][106225] Updated weights for policy 1, policy_version 1276295 (0.0008) [2023-12-28 04:24:29,743][106226] Updated weights for policy 0, policy_version 1273120 (0.0010) [2023-12-28 04:24:29,806][106226] Updated weights for policy 0, policy_version 1273130 (0.0010) [2023-12-28 04:24:29,876][106226] Updated weights for policy 0, policy_version 1273140 (0.0011) [2023-12-28 04:24:30,445][106225] Updated weights for policy 1, policy_version 1276305 (0.0008) [2023-12-28 04:24:30,492][106225] Updated weights for policy 1, policy_version 1276315 (0.0008) [2023-12-28 04:24:30,539][106225] Updated weights for policy 1, policy_version 1276325 (0.0009) [2023-12-28 04:24:30,557][106226] Updated weights for policy 0, policy_version 1273150 (0.0008) [2023-12-28 04:24:30,615][106226] Updated weights for policy 0, policy_version 1273160 (0.0008) [2023-12-28 04:24:30,672][106226] Updated weights for policy 0, policy_version 1273170 (0.0008) [2023-12-28 04:24:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 652779520. Throughput: 0: 9873.3, 1: 9675.8. Samples: 652771868. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:31,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-5.364')] [2023-12-28 04:24:31,229][106225] Updated weights for policy 1, policy_version 1276335 (0.0006) [2023-12-28 04:24:31,290][106225] Updated weights for policy 1, policy_version 1276345 (0.0008) [2023-12-28 04:24:31,351][106225] Updated weights for policy 1, policy_version 1276355 (0.0008) [2023-12-28 04:24:31,362][106226] Updated weights for policy 0, policy_version 1273180 (0.0008) [2023-12-28 04:24:31,431][106226] Updated weights for policy 0, policy_version 1273190 (0.0009) [2023-12-28 04:24:31,498][106226] Updated weights for policy 0, policy_version 1273200 (0.0009) [2023-12-28 04:24:32,076][106225] Updated weights for policy 1, policy_version 1276365 (0.0008) [2023-12-28 04:24:32,136][106225] Updated weights for policy 1, policy_version 1276375 (0.0008) [2023-12-28 04:24:32,189][106225] Updated weights for policy 1, policy_version 1276385 (0.0009) [2023-12-28 04:24:32,290][106226] Updated weights for policy 0, policy_version 1273210 (0.0008) [2023-12-28 04:24:32,359][106226] Updated weights for policy 0, policy_version 1273220 (0.0008) [2023-12-28 04:24:32,438][106226] Updated weights for policy 0, policy_version 1273230 (0.0008) [2023-12-28 04:24:32,503][106226] Updated weights for policy 0, policy_version 1273240 (0.0007) [2023-12-28 04:24:32,889][106225] Updated weights for policy 1, policy_version 1276395 (0.0008) [2023-12-28 04:24:32,938][106225] Updated weights for policy 1, policy_version 1276405 (0.0007) [2023-12-28 04:24:33,005][106225] Updated weights for policy 1, policy_version 1276415 (0.0007) [2023-12-28 04:24:33,247][106226] Updated weights for policy 0, policy_version 1273250 (0.0010) [2023-12-28 04:24:33,298][106226] Updated weights for policy 0, policy_version 1273260 (0.0010) [2023-12-28 04:24:33,348][106226] Updated weights for policy 0, policy_version 1273270 (0.0010) [2023-12-28 04:24:33,723][106225] Updated weights for policy 1, policy_version 1276425 (0.0008) [2023-12-28 04:24:33,769][106225] Updated weights for policy 1, policy_version 1276435 (0.0008) [2023-12-28 04:24:33,825][106225] Updated weights for policy 1, policy_version 1276445 (0.0007) [2023-12-28 04:24:33,893][106225] Updated weights for policy 1, policy_version 1276455 (0.0008) [2023-12-28 04:24:34,063][106226] Updated weights for policy 0, policy_version 1273280 (0.0011) [2023-12-28 04:24:34,119][106226] Updated weights for policy 0, policy_version 1273290 (0.0011) [2023-12-28 04:24:34,188][106226] Updated weights for policy 0, policy_version 1273300 (0.0011) [2023-12-28 04:24:34,634][106225] Updated weights for policy 1, policy_version 1276465 (0.0008) [2023-12-28 04:24:34,696][106225] Updated weights for policy 1, policy_version 1276475 (0.0008) [2023-12-28 04:24:34,761][106225] Updated weights for policy 1, policy_version 1276485 (0.0008) [2023-12-28 04:24:34,928][106226] Updated weights for policy 0, policy_version 1273310 (0.0009) [2023-12-28 04:24:34,975][106226] Updated weights for policy 0, policy_version 1273320 (0.0008) [2023-12-28 04:24:35,028][106226] Updated weights for policy 0, policy_version 1273330 (0.0005) [2023-12-28 04:24:35,537][106225] Updated weights for policy 1, policy_version 1276495 (0.0009) [2023-12-28 04:24:35,586][106225] Updated weights for policy 1, policy_version 1276505 (0.0008) [2023-12-28 04:24:35,607][106226] Updated weights for policy 0, policy_version 1273340 (0.0007) [2023-12-28 04:24:35,642][106225] Updated weights for policy 1, policy_version 1276515 (0.0008) [2023-12-28 04:24:35,659][106226] Updated weights for policy 0, policy_version 1273350 (0.0005) [2023-12-28 04:24:35,716][106226] Updated weights for policy 0, policy_version 1273360 (0.0005) [2023-12-28 04:24:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 652877824. Throughput: 0: 9897.2, 1: 9657.0. Samples: 652889368. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:36,175][105115] Avg episode reward: [(0, '-4.058'), (1, '-5.339')] [2023-12-28 04:24:36,315][106226] Updated weights for policy 0, policy_version 1273370 (0.0006) [2023-12-28 04:24:36,361][106226] Updated weights for policy 0, policy_version 1273380 (0.0009) [2023-12-28 04:24:36,420][106226] Updated weights for policy 0, policy_version 1273390 (0.0009) [2023-12-28 04:24:36,447][106225] Updated weights for policy 1, policy_version 1276525 (0.0008) [2023-12-28 04:24:36,488][106226] Updated weights for policy 0, policy_version 1273400 (0.0007) [2023-12-28 04:24:36,510][106225] Updated weights for policy 1, policy_version 1276535 (0.0009) [2023-12-28 04:24:36,570][106225] Updated weights for policy 1, policy_version 1276545 (0.0009) [2023-12-28 04:24:37,148][106226] Updated weights for policy 0, policy_version 1273410 (0.0009) [2023-12-28 04:24:37,197][106226] Updated weights for policy 0, policy_version 1273420 (0.0008) [2023-12-28 04:24:37,247][106226] Updated weights for policy 0, policy_version 1273430 (0.0009) [2023-12-28 04:24:37,324][106225] Updated weights for policy 1, policy_version 1276555 (0.0008) [2023-12-28 04:24:37,380][106225] Updated weights for policy 1, policy_version 1276565 (0.0008) [2023-12-28 04:24:37,441][106225] Updated weights for policy 1, policy_version 1276575 (0.0008) [2023-12-28 04:24:37,967][106226] Updated weights for policy 0, policy_version 1273440 (0.0010) [2023-12-28 04:24:38,025][106226] Updated weights for policy 0, policy_version 1273450 (0.0011) [2023-12-28 04:24:38,089][106226] Updated weights for policy 0, policy_version 1273460 (0.0011) [2023-12-28 04:24:38,186][106225] Updated weights for policy 1, policy_version 1276585 (0.0008) [2023-12-28 04:24:38,243][106225] Updated weights for policy 1, policy_version 1276595 (0.0008) [2023-12-28 04:24:38,293][106225] Updated weights for policy 1, policy_version 1276605 (0.0008) [2023-12-28 04:24:38,351][106225] Updated weights for policy 1, policy_version 1276615 (0.0008) [2023-12-28 04:24:38,755][106226] Updated weights for policy 0, policy_version 1273470 (0.0008) [2023-12-28 04:24:38,812][106226] Updated weights for policy 0, policy_version 1273480 (0.0009) [2023-12-28 04:24:38,861][106226] Updated weights for policy 0, policy_version 1273490 (0.0008) [2023-12-28 04:24:39,127][106225] Updated weights for policy 1, policy_version 1276625 (0.0008) [2023-12-28 04:24:39,180][106225] Updated weights for policy 1, policy_version 1276635 (0.0008) [2023-12-28 04:24:39,244][106225] Updated weights for policy 1, policy_version 1276645 (0.0010) [2023-12-28 04:24:39,628][106226] Updated weights for policy 0, policy_version 1273500 (0.0009) [2023-12-28 04:24:39,689][106226] Updated weights for policy 0, policy_version 1273510 (0.0009) [2023-12-28 04:24:39,744][106226] Updated weights for policy 0, policy_version 1273520 (0.0008) [2023-12-28 04:24:40,021][106225] Updated weights for policy 1, policy_version 1276655 (0.0008) [2023-12-28 04:24:40,091][106225] Updated weights for policy 1, policy_version 1276665 (0.0007) [2023-12-28 04:24:40,158][106225] Updated weights for policy 1, policy_version 1276675 (0.0008) [2023-12-28 04:24:40,510][106226] Updated weights for policy 0, policy_version 1273530 (0.0009) [2023-12-28 04:24:40,574][106226] Updated weights for policy 0, policy_version 1273540 (0.0009) [2023-12-28 04:24:40,637][106226] Updated weights for policy 0, policy_version 1273550 (0.0009) [2023-12-28 04:24:40,703][106226] Updated weights for policy 0, policy_version 1273560 (0.0008) [2023-12-28 04:24:40,821][106225] Updated weights for policy 1, policy_version 1276685 (0.0007) [2023-12-28 04:24:40,876][106225] Updated weights for policy 1, policy_version 1276695 (0.0006) [2023-12-28 04:24:40,933][106225] Updated weights for policy 1, policy_version 1276705 (0.0008) [2023-12-28 04:24:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 652976128. Throughput: 0: 9898.6, 1: 9615.9. Samples: 652946588. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:41,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.895')] [2023-12-28 04:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001273560_326090752.pth... [2023-12-28 04:24:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001276712_326885376.pth... [2023-12-28 04:24:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001272408_325795840.pth [2023-12-28 04:24:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001275592_326598656.pth [2023-12-28 04:24:41,479][106226] Updated weights for policy 0, policy_version 1273570 (0.0007) [2023-12-28 04:24:41,533][106226] Updated weights for policy 0, policy_version 1273580 (0.0008) [2023-12-28 04:24:41,588][106226] Updated weights for policy 0, policy_version 1273590 (0.0008) [2023-12-28 04:24:41,750][106225] Updated weights for policy 1, policy_version 1276715 (0.0007) [2023-12-28 04:24:41,814][106225] Updated weights for policy 1, policy_version 1276725 (0.0008) [2023-12-28 04:24:41,878][106225] Updated weights for policy 1, policy_version 1276735 (0.0008) [2023-12-28 04:24:42,397][106226] Updated weights for policy 0, policy_version 1273600 (0.0008) [2023-12-28 04:24:42,459][106226] Updated weights for policy 0, policy_version 1273610 (0.0008) [2023-12-28 04:24:42,508][106225] Updated weights for policy 1, policy_version 1276745 (0.0008) [2023-12-28 04:24:42,524][106226] Updated weights for policy 0, policy_version 1273620 (0.0008) [2023-12-28 04:24:42,563][106225] Updated weights for policy 1, policy_version 1276755 (0.0006) [2023-12-28 04:24:42,622][106225] Updated weights for policy 1, policy_version 1276765 (0.0008) [2023-12-28 04:24:42,678][106225] Updated weights for policy 1, policy_version 1276775 (0.0009) [2023-12-28 04:24:43,265][106226] Updated weights for policy 0, policy_version 1273630 (0.0008) [2023-12-28 04:24:43,320][106226] Updated weights for policy 0, policy_version 1273640 (0.0008) [2023-12-28 04:24:43,371][106226] Updated weights for policy 0, policy_version 1273650 (0.0008) [2023-12-28 04:24:43,406][106225] Updated weights for policy 1, policy_version 1276785 (0.0008) [2023-12-28 04:24:43,458][106225] Updated weights for policy 1, policy_version 1276795 (0.0008) [2023-12-28 04:24:43,513][106225] Updated weights for policy 1, policy_version 1276805 (0.0008) [2023-12-28 04:24:44,123][106226] Updated weights for policy 0, policy_version 1273660 (0.0007) [2023-12-28 04:24:44,191][106226] Updated weights for policy 0, policy_version 1273670 (0.0006) [2023-12-28 04:24:44,237][106225] Updated weights for policy 1, policy_version 1276815 (0.0008) [2023-12-28 04:24:44,258][106226] Updated weights for policy 0, policy_version 1273680 (0.0007) [2023-12-28 04:24:44,301][106225] Updated weights for policy 1, policy_version 1276825 (0.0007) [2023-12-28 04:24:44,368][106225] Updated weights for policy 1, policy_version 1276835 (0.0008) [2023-12-28 04:24:44,977][106226] Updated weights for policy 0, policy_version 1273690 (0.0008) [2023-12-28 04:24:45,045][106226] Updated weights for policy 0, policy_version 1273700 (0.0011) [2023-12-28 04:24:45,108][106226] Updated weights for policy 0, policy_version 1273710 (0.0011) [2023-12-28 04:24:45,117][106225] Updated weights for policy 1, policy_version 1276845 (0.0008) [2023-12-28 04:24:45,166][106226] Updated weights for policy 0, policy_version 1273720 (0.0010) [2023-12-28 04:24:45,187][106225] Updated weights for policy 1, policy_version 1276855 (0.0008) [2023-12-28 04:24:45,252][106225] Updated weights for policy 1, policy_version 1276865 (0.0008) [2023-12-28 04:24:45,892][106225] Updated weights for policy 1, policy_version 1276875 (0.0007) [2023-12-28 04:24:45,892][106226] Updated weights for policy 0, policy_version 1273730 (0.0011) [2023-12-28 04:24:45,949][106226] Updated weights for policy 0, policy_version 1273740 (0.0010) [2023-12-28 04:24:45,952][106225] Updated weights for policy 1, policy_version 1276885 (0.0007) [2023-12-28 04:24:46,007][106225] Updated weights for policy 1, policy_version 1276895 (0.0007) [2023-12-28 04:24:46,008][106226] Updated weights for policy 0, policy_version 1273750 (0.0010) [2023-12-28 04:24:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 653074432. Throughput: 0: 9819.4, 1: 9619.4. Samples: 653059172. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:46,175][105115] Avg episode reward: [(0, '-4.164'), (1, '-4.915')] [2023-12-28 04:24:46,697][106226] Updated weights for policy 0, policy_version 1273760 (0.0010) [2023-12-28 04:24:46,729][106225] Updated weights for policy 1, policy_version 1276905 (0.0007) [2023-12-28 04:24:46,747][106226] Updated weights for policy 0, policy_version 1273770 (0.0010) [2023-12-28 04:24:46,777][106225] Updated weights for policy 1, policy_version 1276915 (0.0006) [2023-12-28 04:24:46,797][106226] Updated weights for policy 0, policy_version 1273780 (0.0010) [2023-12-28 04:24:46,825][106225] Updated weights for policy 1, policy_version 1276925 (0.0007) [2023-12-28 04:24:46,881][106225] Updated weights for policy 1, policy_version 1276935 (0.0007) [2023-12-28 04:24:47,511][106226] Updated weights for policy 0, policy_version 1273790 (0.0008) [2023-12-28 04:24:47,517][106225] Updated weights for policy 1, policy_version 1276945 (0.0010) [2023-12-28 04:24:47,567][106226] Updated weights for policy 0, policy_version 1273800 (0.0009) [2023-12-28 04:24:47,567][106225] Updated weights for policy 1, policy_version 1276955 (0.0010) [2023-12-28 04:24:47,617][106226] Updated weights for policy 0, policy_version 1273810 (0.0010) [2023-12-28 04:24:47,618][106225] Updated weights for policy 1, policy_version 1276965 (0.0010) [2023-12-28 04:24:48,267][106226] Updated weights for policy 0, policy_version 1273820 (0.0010) [2023-12-28 04:24:48,323][106226] Updated weights for policy 0, policy_version 1273830 (0.0010) [2023-12-28 04:24:48,363][106225] Updated weights for policy 1, policy_version 1276975 (0.0009) [2023-12-28 04:24:48,386][106226] Updated weights for policy 0, policy_version 1273840 (0.0008) [2023-12-28 04:24:48,421][106225] Updated weights for policy 1, policy_version 1276985 (0.0010) [2023-12-28 04:24:48,481][106225] Updated weights for policy 1, policy_version 1276995 (0.0008) [2023-12-28 04:24:48,985][106226] Updated weights for policy 0, policy_version 1273850 (0.0009) [2023-12-28 04:24:49,047][106226] Updated weights for policy 0, policy_version 1273860 (0.0005) [2023-12-28 04:24:49,102][106226] Updated weights for policy 0, policy_version 1273870 (0.0006) [2023-12-28 04:24:49,141][106225] Updated weights for policy 1, policy_version 1277005 (0.0010) [2023-12-28 04:24:49,157][106226] Updated weights for policy 0, policy_version 1273880 (0.0010) [2023-12-28 04:24:49,201][106225] Updated weights for policy 1, policy_version 1277015 (0.0010) [2023-12-28 04:24:49,271][106225] Updated weights for policy 1, policy_version 1277025 (0.0008) [2023-12-28 04:24:49,885][106226] Updated weights for policy 0, policy_version 1273890 (0.0010) [2023-12-28 04:24:49,957][106226] Updated weights for policy 0, policy_version 1273900 (0.0010) [2023-12-28 04:24:49,967][106225] Updated weights for policy 1, policy_version 1277035 (0.0009) [2023-12-28 04:24:50,025][106226] Updated weights for policy 0, policy_version 1273910 (0.0010) [2023-12-28 04:24:50,027][106225] Updated weights for policy 1, policy_version 1277045 (0.0006) [2023-12-28 04:24:50,091][106225] Updated weights for policy 1, policy_version 1277055 (0.0007) [2023-12-28 04:24:50,738][106226] Updated weights for policy 0, policy_version 1273920 (0.0008) [2023-12-28 04:24:50,796][106226] Updated weights for policy 0, policy_version 1273930 (0.0009) [2023-12-28 04:24:50,858][106225] Updated weights for policy 1, policy_version 1277065 (0.0008) [2023-12-28 04:24:50,860][106226] Updated weights for policy 0, policy_version 1273940 (0.0011) [2023-12-28 04:24:50,905][106225] Updated weights for policy 1, policy_version 1277075 (0.0006) [2023-12-28 04:24:50,957][106225] Updated weights for policy 1, policy_version 1277085 (0.0008) [2023-12-28 04:24:51,018][106225] Updated weights for policy 1, policy_version 1277095 (0.0008) [2023-12-28 04:24:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 653172736. Throughput: 0: 9874.6, 1: 9619.6. Samples: 653179152. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:51,175][105115] Avg episode reward: [(0, '-4.216'), (1, '-4.944')] [2023-12-28 04:24:51,567][106226] Updated weights for policy 0, policy_version 1273950 (0.0011) [2023-12-28 04:24:51,627][106226] Updated weights for policy 0, policy_version 1273960 (0.0010) [2023-12-28 04:24:51,693][106226] Updated weights for policy 0, policy_version 1273970 (0.0011) [2023-12-28 04:24:51,840][106225] Updated weights for policy 1, policy_version 1277105 (0.0008) [2023-12-28 04:24:51,903][106225] Updated weights for policy 1, policy_version 1277115 (0.0008) [2023-12-28 04:24:51,961][106225] Updated weights for policy 1, policy_version 1277125 (0.0008) [2023-12-28 04:24:52,399][106226] Updated weights for policy 0, policy_version 1273980 (0.0008) [2023-12-28 04:24:52,454][106226] Updated weights for policy 0, policy_version 1273990 (0.0006) [2023-12-28 04:24:52,509][106226] Updated weights for policy 0, policy_version 1274000 (0.0006) [2023-12-28 04:24:52,724][106225] Updated weights for policy 1, policy_version 1277135 (0.0008) [2023-12-28 04:24:52,779][106225] Updated weights for policy 1, policy_version 1277145 (0.0008) [2023-12-28 04:24:52,836][106225] Updated weights for policy 1, policy_version 1277155 (0.0007) [2023-12-28 04:24:53,199][106226] Updated weights for policy 0, policy_version 1274010 (0.0009) [2023-12-28 04:24:53,268][106226] Updated weights for policy 0, policy_version 1274020 (0.0010) [2023-12-28 04:24:53,343][106226] Updated weights for policy 0, policy_version 1274030 (0.0005) [2023-12-28 04:24:53,405][106226] Updated weights for policy 0, policy_version 1274040 (0.0005) [2023-12-28 04:24:53,555][106225] Updated weights for policy 1, policy_version 1277165 (0.0008) [2023-12-28 04:24:53,615][106225] Updated weights for policy 1, policy_version 1277175 (0.0010) [2023-12-28 04:24:53,672][106225] Updated weights for policy 1, policy_version 1277185 (0.0010) [2023-12-28 04:24:53,939][106226] Updated weights for policy 0, policy_version 1274050 (0.0011) [2023-12-28 04:24:53,992][106226] Updated weights for policy 0, policy_version 1274060 (0.0010) [2023-12-28 04:24:54,042][106226] Updated weights for policy 0, policy_version 1274070 (0.0010) [2023-12-28 04:24:54,395][106225] Updated weights for policy 1, policy_version 1277195 (0.0009) [2023-12-28 04:24:54,450][106225] Updated weights for policy 1, policy_version 1277205 (0.0007) [2023-12-28 04:24:54,498][106225] Updated weights for policy 1, policy_version 1277215 (0.0005) [2023-12-28 04:24:54,763][106226] Updated weights for policy 0, policy_version 1274080 (0.0010) [2023-12-28 04:24:54,810][106226] Updated weights for policy 0, policy_version 1274090 (0.0010) [2023-12-28 04:24:54,859][106226] Updated weights for policy 0, policy_version 1274100 (0.0010) [2023-12-28 04:24:55,139][106225] Updated weights for policy 1, policy_version 1277225 (0.0005) [2023-12-28 04:24:55,201][106225] Updated weights for policy 1, policy_version 1277235 (0.0006) [2023-12-28 04:24:55,263][106225] Updated weights for policy 1, policy_version 1277245 (0.0007) [2023-12-28 04:24:55,316][106225] Updated weights for policy 1, policy_version 1277255 (0.0006) [2023-12-28 04:24:55,599][106226] Updated weights for policy 0, policy_version 1274110 (0.0010) [2023-12-28 04:24:55,655][106226] Updated weights for policy 0, policy_version 1274120 (0.0010) [2023-12-28 04:24:55,705][106226] Updated weights for policy 0, policy_version 1274130 (0.0010) [2023-12-28 04:24:55,895][106225] Updated weights for policy 1, policy_version 1277265 (0.0005) [2023-12-28 04:24:55,952][106225] Updated weights for policy 1, policy_version 1277275 (0.0008) [2023-12-28 04:24:56,006][106225] Updated weights for policy 1, policy_version 1277285 (0.0009) [2023-12-28 04:24:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 653271040. Throughput: 0: 9916.3, 1: 9598.2. Samples: 653237196. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:24:56,176][105115] Avg episode reward: [(0, '-4.236'), (1, '-4.998')] [2023-12-28 04:24:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001277288_327032832.pth... [2023-12-28 04:24:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001274136_326238208.pth... [2023-12-28 04:24:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001276168_326746112.pth [2023-12-28 04:24:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001272984_325943296.pth [2023-12-28 04:24:56,379][106226] Updated weights for policy 0, policy_version 1274140 (0.0008) [2023-12-28 04:24:56,438][106226] Updated weights for policy 0, policy_version 1274150 (0.0006) [2023-12-28 04:24:56,500][106226] Updated weights for policy 0, policy_version 1274160 (0.0010) [2023-12-28 04:24:56,669][106225] Updated weights for policy 1, policy_version 1277295 (0.0008) [2023-12-28 04:24:56,728][106225] Updated weights for policy 1, policy_version 1277305 (0.0007) [2023-12-28 04:24:56,784][106225] Updated weights for policy 1, policy_version 1277315 (0.0009) [2023-12-28 04:24:57,149][106226] Updated weights for policy 0, policy_version 1274170 (0.0009) [2023-12-28 04:24:57,207][106226] Updated weights for policy 0, policy_version 1274180 (0.0005) [2023-12-28 04:24:57,255][106226] Updated weights for policy 0, policy_version 1274190 (0.0005) [2023-12-28 04:24:57,320][106226] Updated weights for policy 0, policy_version 1274200 (0.0008) [2023-12-28 04:24:57,397][106225] Updated weights for policy 1, policy_version 1277326 (0.0009) [2023-12-28 04:24:57,446][106225] Updated weights for policy 1, policy_version 1277336 (0.0010) [2023-12-28 04:24:57,505][106225] Updated weights for policy 1, policy_version 1277346 (0.0010) [2023-12-28 04:24:57,851][106226] Updated weights for policy 0, policy_version 1274210 (0.0005) [2023-12-28 04:24:57,915][106226] Updated weights for policy 0, policy_version 1274220 (0.0010) [2023-12-28 04:24:57,978][106226] Updated weights for policy 0, policy_version 1274230 (0.0010) [2023-12-28 04:24:58,188][106225] Updated weights for policy 1, policy_version 1277356 (0.0010) [2023-12-28 04:24:58,246][106225] Updated weights for policy 1, policy_version 1277366 (0.0010) [2023-12-28 04:24:58,309][106225] Updated weights for policy 1, policy_version 1277376 (0.0010) [2023-12-28 04:24:58,635][106226] Updated weights for policy 0, policy_version 1274240 (0.0009) [2023-12-28 04:24:58,715][106226] Updated weights for policy 0, policy_version 1274250 (0.0008) [2023-12-28 04:24:58,784][106226] Updated weights for policy 0, policy_version 1274260 (0.0008) [2023-12-28 04:24:59,207][106225] Updated weights for policy 1, policy_version 1277386 (0.0009) [2023-12-28 04:24:59,282][106225] Updated weights for policy 1, policy_version 1277396 (0.0008) [2023-12-28 04:24:59,354][106225] Updated weights for policy 1, policy_version 1277406 (0.0009) [2023-12-28 04:24:59,422][106225] Updated weights for policy 1, policy_version 1277416 (0.0008) [2023-12-28 04:24:59,607][106226] Updated weights for policy 0, policy_version 1274270 (0.0010) [2023-12-28 04:24:59,665][106226] Updated weights for policy 0, policy_version 1274280 (0.0011) [2023-12-28 04:24:59,728][106226] Updated weights for policy 0, policy_version 1274290 (0.0009) [2023-12-28 04:25:00,163][106225] Updated weights for policy 1, policy_version 1277426 (0.0010) [2023-12-28 04:25:00,210][106225] Updated weights for policy 1, policy_version 1277436 (0.0010) [2023-12-28 04:25:00,263][106225] Updated weights for policy 1, policy_version 1277446 (0.0008) [2023-12-28 04:25:00,443][106226] Updated weights for policy 0, policy_version 1274300 (0.0011) [2023-12-28 04:25:00,500][106226] Updated weights for policy 0, policy_version 1274310 (0.0011) [2023-12-28 04:25:00,564][106226] Updated weights for policy 0, policy_version 1274320 (0.0010) [2023-12-28 04:25:00,936][106225] Updated weights for policy 1, policy_version 1277456 (0.0008) [2023-12-28 04:25:01,000][106225] Updated weights for policy 1, policy_version 1277466 (0.0010) [2023-12-28 04:25:01,068][106225] Updated weights for policy 1, policy_version 1277476 (0.0009) [2023-12-28 04:25:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 653369344. Throughput: 0: 9928.9, 1: 9665.4. Samples: 653357360. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:01,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-5.101')] [2023-12-28 04:25:01,250][106226] Updated weights for policy 0, policy_version 1274330 (0.0007) [2023-12-28 04:25:01,302][106226] Updated weights for policy 0, policy_version 1274340 (0.0008) [2023-12-28 04:25:01,371][106226] Updated weights for policy 0, policy_version 1274350 (0.0009) [2023-12-28 04:25:01,424][106226] Updated weights for policy 0, policy_version 1274360 (0.0009) [2023-12-28 04:25:01,727][106225] Updated weights for policy 1, policy_version 1277486 (0.0007) [2023-12-28 04:25:01,786][106225] Updated weights for policy 1, policy_version 1277496 (0.0008) [2023-12-28 04:25:01,842][106225] Updated weights for policy 1, policy_version 1277506 (0.0005) [2023-12-28 04:25:02,188][106226] Updated weights for policy 0, policy_version 1274370 (0.0009) [2023-12-28 04:25:02,236][106226] Updated weights for policy 0, policy_version 1274380 (0.0009) [2023-12-28 04:25:02,291][106226] Updated weights for policy 0, policy_version 1274390 (0.0009) [2023-12-28 04:25:02,544][106225] Updated weights for policy 1, policy_version 1277516 (0.0007) [2023-12-28 04:25:02,604][106225] Updated weights for policy 1, policy_version 1277526 (0.0008) [2023-12-28 04:25:02,666][106225] Updated weights for policy 1, policy_version 1277536 (0.0008) [2023-12-28 04:25:03,075][106226] Updated weights for policy 0, policy_version 1274400 (0.0006) [2023-12-28 04:25:03,124][106226] Updated weights for policy 0, policy_version 1274410 (0.0005) [2023-12-28 04:25:03,178][106226] Updated weights for policy 0, policy_version 1274420 (0.0005) [2023-12-28 04:25:03,333][106225] Updated weights for policy 1, policy_version 1277546 (0.0010) [2023-12-28 04:25:03,393][106225] Updated weights for policy 1, policy_version 1277556 (0.0007) [2023-12-28 04:25:03,457][106225] Updated weights for policy 1, policy_version 1277566 (0.0008) [2023-12-28 04:25:03,517][106225] Updated weights for policy 1, policy_version 1277576 (0.0009) [2023-12-28 04:25:03,761][106226] Updated weights for policy 0, policy_version 1274430 (0.0007) [2023-12-28 04:25:03,808][106226] Updated weights for policy 0, policy_version 1274440 (0.0008) [2023-12-28 04:25:03,878][106226] Updated weights for policy 0, policy_version 1274450 (0.0008) [2023-12-28 04:25:04,153][106225] Updated weights for policy 1, policy_version 1277586 (0.0008) [2023-12-28 04:25:04,222][106225] Updated weights for policy 1, policy_version 1277596 (0.0008) [2023-12-28 04:25:04,286][106225] Updated weights for policy 1, policy_version 1277606 (0.0008) [2023-12-28 04:25:04,652][106226] Updated weights for policy 0, policy_version 1274460 (0.0009) [2023-12-28 04:25:04,701][106226] Updated weights for policy 0, policy_version 1274470 (0.0008) [2023-12-28 04:25:04,750][106226] Updated weights for policy 0, policy_version 1274480 (0.0009) [2023-12-28 04:25:04,849][106225] Updated weights for policy 1, policy_version 1277616 (0.0009) [2023-12-28 04:25:04,909][106225] Updated weights for policy 1, policy_version 1277626 (0.0008) [2023-12-28 04:25:04,967][106225] Updated weights for policy 1, policy_version 1277636 (0.0005) [2023-12-28 04:25:05,472][106226] Updated weights for policy 0, policy_version 1274490 (0.0008) [2023-12-28 04:25:05,529][106226] Updated weights for policy 0, policy_version 1274500 (0.0008) [2023-12-28 04:25:05,551][106225] Updated weights for policy 1, policy_version 1277646 (0.0006) [2023-12-28 04:25:05,579][106226] Updated weights for policy 0, policy_version 1274510 (0.0006) [2023-12-28 04:25:05,600][106225] Updated weights for policy 1, policy_version 1277657 (0.0008) [2023-12-28 04:25:05,635][106226] Updated weights for policy 0, policy_version 1274520 (0.0006) [2023-12-28 04:25:05,654][106225] Updated weights for policy 1, policy_version 1277667 (0.0007) [2023-12-28 04:25:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 653467648. Throughput: 0: 9979.4, 1: 9718.2. Samples: 653479352. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:06,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.051')] [2023-12-28 04:25:06,341][106226] Updated weights for policy 0, policy_version 1274530 (0.0006) [2023-12-28 04:25:06,385][106225] Updated weights for policy 1, policy_version 1277677 (0.0010) [2023-12-28 04:25:06,407][106226] Updated weights for policy 0, policy_version 1274540 (0.0006) [2023-12-28 04:25:06,452][106225] Updated weights for policy 1, policy_version 1277687 (0.0010) [2023-12-28 04:25:06,468][106226] Updated weights for policy 0, policy_version 1274550 (0.0010) [2023-12-28 04:25:06,515][106225] Updated weights for policy 1, policy_version 1277697 (0.0010) [2023-12-28 04:25:07,064][106226] Updated weights for policy 0, policy_version 1274560 (0.0009) [2023-12-28 04:25:07,126][106226] Updated weights for policy 0, policy_version 1274570 (0.0008) [2023-12-28 04:25:07,166][106225] Updated weights for policy 1, policy_version 1277707 (0.0010) [2023-12-28 04:25:07,184][106226] Updated weights for policy 0, policy_version 1274580 (0.0008) [2023-12-28 04:25:07,221][106225] Updated weights for policy 1, policy_version 1277717 (0.0007) [2023-12-28 04:25:07,272][106225] Updated weights for policy 1, policy_version 1277727 (0.0010) [2023-12-28 04:25:07,899][106226] Updated weights for policy 0, policy_version 1274590 (0.0008) [2023-12-28 04:25:07,951][106226] Updated weights for policy 0, policy_version 1274600 (0.0007) [2023-12-28 04:25:07,995][106225] Updated weights for policy 1, policy_version 1277737 (0.0009) [2023-12-28 04:25:08,007][106226] Updated weights for policy 0, policy_version 1274610 (0.0008) [2023-12-28 04:25:08,052][106225] Updated weights for policy 1, policy_version 1277747 (0.0010) [2023-12-28 04:25:08,107][106225] Updated weights for policy 1, policy_version 1277757 (0.0010) [2023-12-28 04:25:08,162][106225] Updated weights for policy 1, policy_version 1277767 (0.0010) [2023-12-28 04:25:08,782][106226] Updated weights for policy 0, policy_version 1274620 (0.0006) [2023-12-28 04:25:08,839][106226] Updated weights for policy 0, policy_version 1274630 (0.0008) [2023-12-28 04:25:08,896][106226] Updated weights for policy 0, policy_version 1274640 (0.0007) [2023-12-28 04:25:08,915][106225] Updated weights for policy 1, policy_version 1277777 (0.0010) [2023-12-28 04:25:08,976][106225] Updated weights for policy 1, policy_version 1277787 (0.0010) [2023-12-28 04:25:09,032][106225] Updated weights for policy 1, policy_version 1277797 (0.0010) [2023-12-28 04:25:09,642][106226] Updated weights for policy 0, policy_version 1274650 (0.0007) [2023-12-28 04:25:09,695][106226] Updated weights for policy 0, policy_version 1274660 (0.0007) [2023-12-28 04:25:09,761][106226] Updated weights for policy 0, policy_version 1274670 (0.0008) [2023-12-28 04:25:09,762][106225] Updated weights for policy 1, policy_version 1277807 (0.0010) [2023-12-28 04:25:09,822][106226] Updated weights for policy 0, policy_version 1274680 (0.0006) [2023-12-28 04:25:09,831][106225] Updated weights for policy 1, policy_version 1277817 (0.0011) [2023-12-28 04:25:09,894][106225] Updated weights for policy 1, policy_version 1277827 (0.0011) [2023-12-28 04:25:10,593][106226] Updated weights for policy 0, policy_version 1274690 (0.0008) [2023-12-28 04:25:10,635][106225] Updated weights for policy 1, policy_version 1277837 (0.0010) [2023-12-28 04:25:10,652][106226] Updated weights for policy 0, policy_version 1274700 (0.0006) [2023-12-28 04:25:10,693][106225] Updated weights for policy 1, policy_version 1277847 (0.0011) [2023-12-28 04:25:10,715][106226] Updated weights for policy 0, policy_version 1274710 (0.0006) [2023-12-28 04:25:10,754][106225] Updated weights for policy 1, policy_version 1277857 (0.0011) [2023-12-28 04:25:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 653565952. Throughput: 0: 9994.9, 1: 9726.7. Samples: 653538664. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:11,176][105115] Avg episode reward: [(0, '-4.087'), (1, '-5.240')] [2023-12-28 04:25:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001277864_327180288.pth... [2023-12-28 04:25:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001274712_326385664.pth... [2023-12-28 04:25:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001273560_326090752.pth [2023-12-28 04:25:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001276712_326885376.pth [2023-12-28 04:25:11,437][106225] Updated weights for policy 1, policy_version 1277867 (0.0009) [2023-12-28 04:25:11,498][106225] Updated weights for policy 1, policy_version 1277877 (0.0006) [2023-12-28 04:25:11,506][106226] Updated weights for policy 0, policy_version 1274720 (0.0007) [2023-12-28 04:25:11,560][106225] Updated weights for policy 1, policy_version 1277887 (0.0006) [2023-12-28 04:25:11,566][106226] Updated weights for policy 0, policy_version 1274730 (0.0011) [2023-12-28 04:25:11,620][106226] Updated weights for policy 0, policy_version 1274740 (0.0011) [2023-12-28 04:25:12,264][106225] Updated weights for policy 1, policy_version 1277897 (0.0006) [2023-12-28 04:25:12,332][106225] Updated weights for policy 1, policy_version 1277907 (0.0006) [2023-12-28 04:25:12,403][106225] Updated weights for policy 1, policy_version 1277917 (0.0007) [2023-12-28 04:25:12,410][106226] Updated weights for policy 0, policy_version 1274750 (0.0008) [2023-12-28 04:25:12,460][106226] Updated weights for policy 0, policy_version 1274760 (0.0007) [2023-12-28 04:25:12,461][106225] Updated weights for policy 1, policy_version 1277927 (0.0008) [2023-12-28 04:25:12,509][106226] Updated weights for policy 0, policy_version 1274770 (0.0008) [2023-12-28 04:25:13,106][106225] Updated weights for policy 1, policy_version 1277937 (0.0006) [2023-12-28 04:25:13,161][106225] Updated weights for policy 1, policy_version 1277947 (0.0007) [2023-12-28 04:25:13,208][106225] Updated weights for policy 1, policy_version 1277957 (0.0009) [2023-12-28 04:25:13,279][106226] Updated weights for policy 0, policy_version 1274780 (0.0008) [2023-12-28 04:25:13,327][106226] Updated weights for policy 0, policy_version 1274790 (0.0005) [2023-12-28 04:25:13,381][106226] Updated weights for policy 0, policy_version 1274800 (0.0007) [2023-12-28 04:25:13,878][106225] Updated weights for policy 1, policy_version 1277967 (0.0009) [2023-12-28 04:25:13,940][106225] Updated weights for policy 1, policy_version 1277977 (0.0009) [2023-12-28 04:25:13,994][106225] Updated weights for policy 1, policy_version 1277987 (0.0008) [2023-12-28 04:25:14,110][106226] Updated weights for policy 0, policy_version 1274810 (0.0008) [2023-12-28 04:25:14,175][106226] Updated weights for policy 0, policy_version 1274820 (0.0009) [2023-12-28 04:25:14,247][106226] Updated weights for policy 0, policy_version 1274830 (0.0010) [2023-12-28 04:25:14,313][106226] Updated weights for policy 0, policy_version 1274840 (0.0011) [2023-12-28 04:25:14,758][106225] Updated weights for policy 1, policy_version 1277997 (0.0008) [2023-12-28 04:25:14,823][106225] Updated weights for policy 1, policy_version 1278007 (0.0008) [2023-12-28 04:25:14,884][106225] Updated weights for policy 1, policy_version 1278017 (0.0008) [2023-12-28 04:25:15,071][106226] Updated weights for policy 0, policy_version 1274850 (0.0007) [2023-12-28 04:25:15,128][106226] Updated weights for policy 0, policy_version 1274860 (0.0005) [2023-12-28 04:25:15,178][106226] Updated weights for policy 0, policy_version 1274870 (0.0007) [2023-12-28 04:25:15,509][106225] Updated weights for policy 1, policy_version 1278027 (0.0007) [2023-12-28 04:25:15,567][106225] Updated weights for policy 1, policy_version 1278037 (0.0005) [2023-12-28 04:25:15,625][106225] Updated weights for policy 1, policy_version 1278047 (0.0007) [2023-12-28 04:25:15,877][106226] Updated weights for policy 0, policy_version 1274880 (0.0011) [2023-12-28 04:25:15,936][106226] Updated weights for policy 0, policy_version 1274890 (0.0010) [2023-12-28 04:25:15,992][106226] Updated weights for policy 0, policy_version 1274900 (0.0010) [2023-12-28 04:25:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 653664256. Throughput: 0: 9763.0, 1: 9799.3. Samples: 653652172. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:16,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-4.802')] [2023-12-28 04:25:16,296][106225] Updated weights for policy 1, policy_version 1278057 (0.0007) [2023-12-28 04:25:16,355][106225] Updated weights for policy 1, policy_version 1278067 (0.0010) [2023-12-28 04:25:16,408][106225] Updated weights for policy 1, policy_version 1278077 (0.0010) [2023-12-28 04:25:16,470][106225] Updated weights for policy 1, policy_version 1278087 (0.0008) [2023-12-28 04:25:16,711][106226] Updated weights for policy 0, policy_version 1274910 (0.0011) [2023-12-28 04:25:16,769][106226] Updated weights for policy 0, policy_version 1274920 (0.0011) [2023-12-28 04:25:16,826][106226] Updated weights for policy 0, policy_version 1274930 (0.0011) [2023-12-28 04:25:17,120][106225] Updated weights for policy 1, policy_version 1278097 (0.0006) [2023-12-28 04:25:17,170][106225] Updated weights for policy 1, policy_version 1278107 (0.0008) [2023-12-28 04:25:17,221][106225] Updated weights for policy 1, policy_version 1278117 (0.0009) [2023-12-28 04:25:17,402][106226] Updated weights for policy 0, policy_version 1274940 (0.0008) [2023-12-28 04:25:17,460][106226] Updated weights for policy 0, policy_version 1274950 (0.0005) [2023-12-28 04:25:17,509][106226] Updated weights for policy 0, policy_version 1274960 (0.0005) [2023-12-28 04:25:17,908][106225] Updated weights for policy 1, policy_version 1278127 (0.0006) [2023-12-28 04:25:17,958][106225] Updated weights for policy 1, policy_version 1278137 (0.0005) [2023-12-28 04:25:18,017][106225] Updated weights for policy 1, policy_version 1278147 (0.0008) [2023-12-28 04:25:18,090][106226] Updated weights for policy 0, policy_version 1274970 (0.0006) [2023-12-28 04:25:18,156][106226] Updated weights for policy 0, policy_version 1274980 (0.0008) [2023-12-28 04:25:18,221][106226] Updated weights for policy 0, policy_version 1274990 (0.0008) [2023-12-28 04:25:18,284][106226] Updated weights for policy 0, policy_version 1275000 (0.0008) [2023-12-28 04:25:18,696][106225] Updated weights for policy 1, policy_version 1278157 (0.0007) [2023-12-28 04:25:18,760][106225] Updated weights for policy 1, policy_version 1278167 (0.0005) [2023-12-28 04:25:18,828][106225] Updated weights for policy 1, policy_version 1278177 (0.0006) [2023-12-28 04:25:18,979][106226] Updated weights for policy 0, policy_version 1275010 (0.0011) [2023-12-28 04:25:19,046][106226] Updated weights for policy 0, policy_version 1275020 (0.0011) [2023-12-28 04:25:19,096][106226] Updated weights for policy 0, policy_version 1275030 (0.0011) [2023-12-28 04:25:19,460][106225] Updated weights for policy 1, policy_version 1278187 (0.0008) [2023-12-28 04:25:19,524][106225] Updated weights for policy 1, policy_version 1278197 (0.0008) [2023-12-28 04:25:19,592][106225] Updated weights for policy 1, policy_version 1278207 (0.0008) [2023-12-28 04:25:19,785][106226] Updated weights for policy 0, policy_version 1275040 (0.0008) [2023-12-28 04:25:19,851][106226] Updated weights for policy 0, policy_version 1275050 (0.0007) [2023-12-28 04:25:19,913][106226] Updated weights for policy 0, policy_version 1275060 (0.0009) [2023-12-28 04:25:20,270][106225] Updated weights for policy 1, policy_version 1278217 (0.0008) [2023-12-28 04:25:20,326][106225] Updated weights for policy 1, policy_version 1278227 (0.0008) [2023-12-28 04:25:20,389][106225] Updated weights for policy 1, policy_version 1278237 (0.0009) [2023-12-28 04:25:20,455][106225] Updated weights for policy 1, policy_version 1278247 (0.0009) [2023-12-28 04:25:20,684][106226] Updated weights for policy 0, policy_version 1275070 (0.0009) [2023-12-28 04:25:20,749][106226] Updated weights for policy 0, policy_version 1275080 (0.0009) [2023-12-28 04:25:20,810][106226] Updated weights for policy 0, policy_version 1275090 (0.0009) [2023-12-28 04:25:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 653762560. Throughput: 0: 9756.8, 1: 9890.3. Samples: 653773488. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:21,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-5.266')] [2023-12-28 04:25:21,205][106225] Updated weights for policy 1, policy_version 1278257 (0.0009) [2023-12-28 04:25:21,267][106225] Updated weights for policy 1, policy_version 1278267 (0.0008) [2023-12-28 04:25:21,330][106225] Updated weights for policy 1, policy_version 1278277 (0.0008) [2023-12-28 04:25:21,547][106226] Updated weights for policy 0, policy_version 1275100 (0.0008) [2023-12-28 04:25:21,610][106226] Updated weights for policy 0, policy_version 1275110 (0.0008) [2023-12-28 04:25:21,676][106226] Updated weights for policy 0, policy_version 1275120 (0.0009) [2023-12-28 04:25:22,168][106225] Updated weights for policy 1, policy_version 1278287 (0.0010) [2023-12-28 04:25:22,232][106225] Updated weights for policy 1, policy_version 1278297 (0.0010) [2023-12-28 04:25:22,297][106225] Updated weights for policy 1, policy_version 1278307 (0.0010) [2023-12-28 04:25:22,489][106226] Updated weights for policy 0, policy_version 1275130 (0.0008) [2023-12-28 04:25:22,556][106226] Updated weights for policy 0, policy_version 1275140 (0.0008) [2023-12-28 04:25:22,621][106226] Updated weights for policy 0, policy_version 1275150 (0.0007) [2023-12-28 04:25:22,681][106226] Updated weights for policy 0, policy_version 1275160 (0.0008) [2023-12-28 04:25:23,031][106225] Updated weights for policy 1, policy_version 1278317 (0.0008) [2023-12-28 04:25:23,083][106225] Updated weights for policy 1, policy_version 1278327 (0.0006) [2023-12-28 04:25:23,139][106225] Updated weights for policy 1, policy_version 1278337 (0.0005) [2023-12-28 04:25:23,474][106226] Updated weights for policy 0, policy_version 1275170 (0.0008) [2023-12-28 04:25:23,534][106226] Updated weights for policy 0, policy_version 1275180 (0.0009) [2023-12-28 04:25:23,594][106226] Updated weights for policy 0, policy_version 1275190 (0.0009) [2023-12-28 04:25:23,731][106225] Updated weights for policy 1, policy_version 1278347 (0.0007) [2023-12-28 04:25:23,780][106225] Updated weights for policy 1, policy_version 1278357 (0.0009) [2023-12-28 04:25:23,838][106225] Updated weights for policy 1, policy_version 1278367 (0.0008) [2023-12-28 04:25:24,331][106226] Updated weights for policy 0, policy_version 1275200 (0.0008) [2023-12-28 04:25:24,390][106226] Updated weights for policy 0, policy_version 1275210 (0.0008) [2023-12-28 04:25:24,450][106226] Updated weights for policy 0, policy_version 1275220 (0.0008) [2023-12-28 04:25:24,536][106225] Updated weights for policy 1, policy_version 1278377 (0.0007) [2023-12-28 04:25:24,585][106225] Updated weights for policy 1, policy_version 1278387 (0.0008) [2023-12-28 04:25:24,637][106225] Updated weights for policy 1, policy_version 1278397 (0.0008) [2023-12-28 04:25:24,694][106225] Updated weights for policy 1, policy_version 1278407 (0.0008) [2023-12-28 04:25:25,223][106226] Updated weights for policy 0, policy_version 1275230 (0.0009) [2023-12-28 04:25:25,285][106226] Updated weights for policy 0, policy_version 1275240 (0.0009) [2023-12-28 04:25:25,302][106225] Updated weights for policy 1, policy_version 1278417 (0.0005) [2023-12-28 04:25:25,345][106226] Updated weights for policy 0, policy_version 1275250 (0.0008) [2023-12-28 04:25:25,356][106225] Updated weights for policy 1, policy_version 1278427 (0.0005) [2023-12-28 04:25:25,413][106225] Updated weights for policy 1, policy_version 1278437 (0.0005) [2023-12-28 04:25:25,912][106225] Updated weights for policy 1, policy_version 1278447 (0.0005) [2023-12-28 04:25:25,970][106225] Updated weights for policy 1, policy_version 1278457 (0.0006) [2023-12-28 04:25:26,028][106225] Updated weights for policy 1, policy_version 1278467 (0.0007) [2023-12-28 04:25:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 653860864. Throughput: 0: 9697.0, 1: 9920.4. Samples: 653829372. Policy #0 lag: (min: 28.0, avg: 35.8, max: 60.0) [2023-12-28 04:25:26,175][105115] Avg episode reward: [(0, '-3.935'), (1, '-5.354')] [2023-12-28 04:25:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001278472_327335936.pth... [2023-12-28 04:25:26,184][106226] Updated weights for policy 0, policy_version 1275260 (0.0009) [2023-12-28 04:25:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001277288_327032832.pth [2023-12-28 04:25:26,233][106226] Updated weights for policy 0, policy_version 1275270 (0.0008) [2023-12-28 04:25:26,281][106226] Updated weights for policy 0, policy_version 1275280 (0.0009) [2023-12-28 04:25:26,321][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001275288_326533120.pth... [2023-12-28 04:25:26,324][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001274136_326238208.pth [2023-12-28 04:25:26,604][106225] Updated weights for policy 1, policy_version 1278477 (0.0007) [2023-12-28 04:25:26,664][106225] Updated weights for policy 1, policy_version 1278487 (0.0008) [2023-12-28 04:25:26,714][106225] Updated weights for policy 1, policy_version 1278497 (0.0008) [2023-12-28 04:25:27,045][106226] Updated weights for policy 0, policy_version 1275290 (0.0009) [2023-12-28 04:25:27,094][106226] Updated weights for policy 0, policy_version 1275300 (0.0010) [2023-12-28 04:25:27,146][106226] Updated weights for policy 0, policy_version 1275310 (0.0011) [2023-12-28 04:25:27,200][106226] Updated weights for policy 0, policy_version 1275320 (0.0011) [2023-12-28 04:25:27,395][106225] Updated weights for policy 1, policy_version 1278507 (0.0007) [2023-12-28 04:25:27,451][106225] Updated weights for policy 1, policy_version 1278517 (0.0005) [2023-12-28 04:25:27,502][106225] Updated weights for policy 1, policy_version 1278527 (0.0005) [2023-12-28 04:25:27,870][106226] Updated weights for policy 0, policy_version 1275330 (0.0011) [2023-12-28 04:25:27,932][106226] Updated weights for policy 0, policy_version 1275340 (0.0010) [2023-12-28 04:25:27,993][106226] Updated weights for policy 0, policy_version 1275350 (0.0010) [2023-12-28 04:25:28,089][106225] Updated weights for policy 1, policy_version 1278537 (0.0005) [2023-12-28 04:25:28,135][106225] Updated weights for policy 1, policy_version 1278547 (0.0008) [2023-12-28 04:25:28,180][106225] Updated weights for policy 1, policy_version 1278557 (0.0007) [2023-12-28 04:25:28,239][106225] Updated weights for policy 1, policy_version 1278567 (0.0007) [2023-12-28 04:25:28,696][106226] Updated weights for policy 0, policy_version 1275360 (0.0011) [2023-12-28 04:25:28,762][106226] Updated weights for policy 0, policy_version 1275370 (0.0010) [2023-12-28 04:25:28,823][106226] Updated weights for policy 0, policy_version 1275380 (0.0011) [2023-12-28 04:25:28,836][106225] Updated weights for policy 1, policy_version 1278577 (0.0005) [2023-12-28 04:25:28,896][106225] Updated weights for policy 1, policy_version 1278587 (0.0007) [2023-12-28 04:25:28,952][106225] Updated weights for policy 1, policy_version 1278597 (0.0007) [2023-12-28 04:25:29,554][106226] Updated weights for policy 0, policy_version 1275390 (0.0009) [2023-12-28 04:25:29,612][106226] Updated weights for policy 0, policy_version 1275400 (0.0008) [2023-12-28 04:25:29,615][106225] Updated weights for policy 1, policy_version 1278607 (0.0006) [2023-12-28 04:25:29,667][106226] Updated weights for policy 0, policy_version 1275410 (0.0008) [2023-12-28 04:25:29,679][106225] Updated weights for policy 1, policy_version 1278617 (0.0007) [2023-12-28 04:25:29,745][106225] Updated weights for policy 1, policy_version 1278627 (0.0008) [2023-12-28 04:25:30,345][106226] Updated weights for policy 0, policy_version 1275420 (0.0007) [2023-12-28 04:25:30,402][106226] Updated weights for policy 0, policy_version 1275430 (0.0005) [2023-12-28 04:25:30,409][106225] Updated weights for policy 1, policy_version 1278637 (0.0008) [2023-12-28 04:25:30,461][106225] Updated weights for policy 1, policy_version 1278647 (0.0008) [2023-12-28 04:25:30,463][106226] Updated weights for policy 0, policy_version 1275440 (0.0006) [2023-12-28 04:25:30,514][106225] Updated weights for policy 1, policy_version 1278657 (0.0008) [2023-12-28 04:25:30,966][106226] Updated weights for policy 0, policy_version 1275450 (0.0005) [2023-12-28 04:25:31,017][106226] Updated weights for policy 0, policy_version 1275460 (0.0006) [2023-12-28 04:25:31,093][106226] Updated weights for policy 0, policy_version 1275470 (0.0011) [2023-12-28 04:25:31,159][106226] Updated weights for policy 0, policy_version 1275480 (0.0010) [2023-12-28 04:25:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 653967360. Throughput: 0: 9724.0, 1: 10117.5. Samples: 653952040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:31,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.991')] [2023-12-28 04:25:31,285][106225] Updated weights for policy 1, policy_version 1278667 (0.0008) [2023-12-28 04:25:31,352][106225] Updated weights for policy 1, policy_version 1278677 (0.0007) [2023-12-28 04:25:31,417][106225] Updated weights for policy 1, policy_version 1278687 (0.0008) [2023-12-28 04:25:31,845][106226] Updated weights for policy 0, policy_version 1275490 (0.0008) [2023-12-28 04:25:31,899][106226] Updated weights for policy 0, policy_version 1275500 (0.0008) [2023-12-28 04:25:31,966][106226] Updated weights for policy 0, policy_version 1275510 (0.0008) [2023-12-28 04:25:32,069][106225] Updated weights for policy 1, policy_version 1278697 (0.0009) [2023-12-28 04:25:32,139][106225] Updated weights for policy 1, policy_version 1278707 (0.0008) [2023-12-28 04:25:32,202][106225] Updated weights for policy 1, policy_version 1278717 (0.0008) [2023-12-28 04:25:32,264][106225] Updated weights for policy 1, policy_version 1278727 (0.0009) [2023-12-28 04:25:32,692][106226] Updated weights for policy 0, policy_version 1275520 (0.0008) [2023-12-28 04:25:32,741][106226] Updated weights for policy 0, policy_version 1275530 (0.0005) [2023-12-28 04:25:32,800][106226] Updated weights for policy 0, policy_version 1275540 (0.0006) [2023-12-28 04:25:32,952][106225] Updated weights for policy 1, policy_version 1278737 (0.0005) [2023-12-28 04:25:33,006][106225] Updated weights for policy 1, policy_version 1278747 (0.0005) [2023-12-28 04:25:33,052][106225] Updated weights for policy 1, policy_version 1278757 (0.0006) [2023-12-28 04:25:33,374][106226] Updated weights for policy 0, policy_version 1275550 (0.0007) [2023-12-28 04:25:33,440][106226] Updated weights for policy 0, policy_version 1275560 (0.0011) [2023-12-28 04:25:33,495][106226] Updated weights for policy 0, policy_version 1275570 (0.0010) [2023-12-28 04:25:33,573][106225] Updated weights for policy 1, policy_version 1278767 (0.0005) [2023-12-28 04:25:33,624][106225] Updated weights for policy 1, policy_version 1278777 (0.0005) [2023-12-28 04:25:33,675][106225] Updated weights for policy 1, policy_version 1278787 (0.0005) [2023-12-28 04:25:34,152][106226] Updated weights for policy 0, policy_version 1275580 (0.0010) [2023-12-28 04:25:34,214][106226] Updated weights for policy 0, policy_version 1275590 (0.0009) [2023-12-28 04:25:34,222][106225] Updated weights for policy 1, policy_version 1278797 (0.0008) [2023-12-28 04:25:34,276][106226] Updated weights for policy 0, policy_version 1275600 (0.0008) [2023-12-28 04:25:34,290][106225] Updated weights for policy 1, policy_version 1278807 (0.0010) [2023-12-28 04:25:34,354][106225] Updated weights for policy 1, policy_version 1278817 (0.0010) [2023-12-28 04:25:34,871][106226] Updated weights for policy 0, policy_version 1275610 (0.0007) [2023-12-28 04:25:34,916][106226] Updated weights for policy 0, policy_version 1275620 (0.0006) [2023-12-28 04:25:34,963][106226] Updated weights for policy 0, policy_version 1275630 (0.0005) [2023-12-28 04:25:35,014][106226] Updated weights for policy 0, policy_version 1275640 (0.0007) [2023-12-28 04:25:35,051][106225] Updated weights for policy 1, policy_version 1278827 (0.0010) [2023-12-28 04:25:35,108][106225] Updated weights for policy 1, policy_version 1278837 (0.0010) [2023-12-28 04:25:35,162][106225] Updated weights for policy 1, policy_version 1278847 (0.0010) [2023-12-28 04:25:35,613][106226] Updated weights for policy 0, policy_version 1275650 (0.0006) [2023-12-28 04:25:35,668][106226] Updated weights for policy 0, policy_version 1275660 (0.0005) [2023-12-28 04:25:35,716][106226] Updated weights for policy 0, policy_version 1275670 (0.0005) [2023-12-28 04:25:35,784][106225] Updated weights for policy 1, policy_version 1278857 (0.0009) [2023-12-28 04:25:35,832][106225] Updated weights for policy 1, policy_version 1278867 (0.0008) [2023-12-28 04:25:35,884][106225] Updated weights for policy 1, policy_version 1278877 (0.0009) [2023-12-28 04:25:35,942][106225] Updated weights for policy 1, policy_version 1278887 (0.0010) [2023-12-28 04:25:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654073856. Throughput: 0: 9859.1, 1: 10192.1. Samples: 654081456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:36,175][105115] Avg episode reward: [(0, '-4.232'), (1, '-5.320')] [2023-12-28 04:25:36,358][106226] Updated weights for policy 0, policy_version 1275680 (0.0010) [2023-12-28 04:25:36,422][106226] Updated weights for policy 0, policy_version 1275690 (0.0008) [2023-12-28 04:25:36,483][106226] Updated weights for policy 0, policy_version 1275700 (0.0011) [2023-12-28 04:25:36,682][106225] Updated weights for policy 1, policy_version 1278897 (0.0011) [2023-12-28 04:25:36,733][106225] Updated weights for policy 1, policy_version 1278907 (0.0010) [2023-12-28 04:25:36,797][106225] Updated weights for policy 1, policy_version 1278917 (0.0010) [2023-12-28 04:25:37,164][106226] Updated weights for policy 0, policy_version 1275710 (0.0010) [2023-12-28 04:25:37,221][106226] Updated weights for policy 0, policy_version 1275720 (0.0010) [2023-12-28 04:25:37,281][106226] Updated weights for policy 0, policy_version 1275730 (0.0010) [2023-12-28 04:25:37,537][106225] Updated weights for policy 1, policy_version 1278927 (0.0011) [2023-12-28 04:25:37,595][106225] Updated weights for policy 1, policy_version 1278937 (0.0010) [2023-12-28 04:25:37,660][106225] Updated weights for policy 1, policy_version 1278947 (0.0010) [2023-12-28 04:25:37,936][106226] Updated weights for policy 0, policy_version 1275740 (0.0008) [2023-12-28 04:25:37,993][106226] Updated weights for policy 0, policy_version 1275750 (0.0005) [2023-12-28 04:25:38,054][106226] Updated weights for policy 0, policy_version 1275760 (0.0009) [2023-12-28 04:25:38,396][106225] Updated weights for policy 1, policy_version 1278957 (0.0007) [2023-12-28 04:25:38,466][106225] Updated weights for policy 1, policy_version 1278967 (0.0006) [2023-12-28 04:25:38,531][106225] Updated weights for policy 1, policy_version 1278977 (0.0006) [2023-12-28 04:25:38,635][106226] Updated weights for policy 0, policy_version 1275770 (0.0005) [2023-12-28 04:25:38,692][106226] Updated weights for policy 0, policy_version 1275780 (0.0006) [2023-12-28 04:25:38,750][106226] Updated weights for policy 0, policy_version 1275790 (0.0005) [2023-12-28 04:25:38,805][106226] Updated weights for policy 0, policy_version 1275800 (0.0009) [2023-12-28 04:25:39,201][106225] Updated weights for policy 1, policy_version 1278987 (0.0010) [2023-12-28 04:25:39,267][106225] Updated weights for policy 1, policy_version 1278997 (0.0008) [2023-12-28 04:25:39,331][106225] Updated weights for policy 1, policy_version 1279007 (0.0008) [2023-12-28 04:25:39,495][106226] Updated weights for policy 0, policy_version 1275810 (0.0010) [2023-12-28 04:25:39,552][106226] Updated weights for policy 0, policy_version 1275820 (0.0008) [2023-12-28 04:25:39,609][106226] Updated weights for policy 0, policy_version 1275830 (0.0009) [2023-12-28 04:25:40,187][106225] Updated weights for policy 1, policy_version 1279017 (0.0009) [2023-12-28 04:25:40,242][106225] Updated weights for policy 1, policy_version 1279027 (0.0008) [2023-12-28 04:25:40,302][106225] Updated weights for policy 1, policy_version 1279037 (0.0008) [2023-12-28 04:25:40,304][106226] Updated weights for policy 0, policy_version 1275840 (0.0007) [2023-12-28 04:25:40,364][106225] Updated weights for policy 1, policy_version 1279047 (0.0008) [2023-12-28 04:25:40,376][106226] Updated weights for policy 0, policy_version 1275850 (0.0009) [2023-12-28 04:25:40,449][106226] Updated weights for policy 0, policy_version 1275860 (0.0009) [2023-12-28 04:25:41,011][106225] Updated weights for policy 1, policy_version 1279057 (0.0007) [2023-12-28 04:25:41,078][106225] Updated weights for policy 1, policy_version 1279067 (0.0008) [2023-12-28 04:25:41,147][106225] Updated weights for policy 1, policy_version 1279077 (0.0008) [2023-12-28 04:25:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654172160. Throughput: 0: 9879.0, 1: 10218.1. Samples: 654141560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:41,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-5.084')] [2023-12-28 04:25:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001275864_326680576.pth... [2023-12-28 04:25:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001279080_327491584.pth... [2023-12-28 04:25:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001274712_326385664.pth [2023-12-28 04:25:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001277864_327180288.pth [2023-12-28 04:25:41,272][106226] Updated weights for policy 0, policy_version 1275870 (0.0010) [2023-12-28 04:25:41,319][106226] Updated weights for policy 0, policy_version 1275880 (0.0007) [2023-12-28 04:25:41,384][106226] Updated weights for policy 0, policy_version 1275890 (0.0008) [2023-12-28 04:25:41,927][106225] Updated weights for policy 1, policy_version 1279087 (0.0008) [2023-12-28 04:25:41,988][106225] Updated weights for policy 1, policy_version 1279097 (0.0009) [2023-12-28 04:25:42,038][106225] Updated weights for policy 1, policy_version 1279107 (0.0008) [2023-12-28 04:25:42,084][106226] Updated weights for policy 0, policy_version 1275900 (0.0007) [2023-12-28 04:25:42,150][106226] Updated weights for policy 0, policy_version 1275910 (0.0006) [2023-12-28 04:25:42,212][106226] Updated weights for policy 0, policy_version 1275920 (0.0005) [2023-12-28 04:25:42,789][106225] Updated weights for policy 1, policy_version 1279117 (0.0008) [2023-12-28 04:25:42,846][106225] Updated weights for policy 1, policy_version 1279127 (0.0007) [2023-12-28 04:25:42,870][106226] Updated weights for policy 0, policy_version 1275930 (0.0007) [2023-12-28 04:25:42,898][106225] Updated weights for policy 1, policy_version 1279137 (0.0008) [2023-12-28 04:25:42,929][106226] Updated weights for policy 0, policy_version 1275940 (0.0007) [2023-12-28 04:25:42,980][106226] Updated weights for policy 0, policy_version 1275950 (0.0009) [2023-12-28 04:25:43,025][106226] Updated weights for policy 0, policy_version 1275960 (0.0006) [2023-12-28 04:25:43,474][106225] Updated weights for policy 1, policy_version 1279147 (0.0006) [2023-12-28 04:25:43,526][106225] Updated weights for policy 1, policy_version 1279157 (0.0007) [2023-12-28 04:25:43,576][106225] Updated weights for policy 1, policy_version 1279167 (0.0009) [2023-12-28 04:25:43,698][106226] Updated weights for policy 0, policy_version 1275970 (0.0007) [2023-12-28 04:25:43,748][106226] Updated weights for policy 0, policy_version 1275980 (0.0010) [2023-12-28 04:25:43,807][106226] Updated weights for policy 0, policy_version 1275990 (0.0010) [2023-12-28 04:25:44,224][106225] Updated weights for policy 1, policy_version 1279177 (0.0006) [2023-12-28 04:25:44,279][106225] Updated weights for policy 1, policy_version 1279187 (0.0006) [2023-12-28 04:25:44,330][106225] Updated weights for policy 1, policy_version 1279197 (0.0006) [2023-12-28 04:25:44,387][106226] Updated weights for policy 0, policy_version 1276000 (0.0008) [2023-12-28 04:25:44,400][106225] Updated weights for policy 1, policy_version 1279207 (0.0008) [2023-12-28 04:25:44,450][106226] Updated weights for policy 0, policy_version 1276010 (0.0008) [2023-12-28 04:25:44,508][106226] Updated weights for policy 0, policy_version 1276020 (0.0010) [2023-12-28 04:25:45,144][106225] Updated weights for policy 1, policy_version 1279217 (0.0008) [2023-12-28 04:25:45,200][106225] Updated weights for policy 1, policy_version 1279227 (0.0008) [2023-12-28 04:25:45,232][106226] Updated weights for policy 0, policy_version 1276030 (0.0010) [2023-12-28 04:25:45,255][106225] Updated weights for policy 1, policy_version 1279237 (0.0008) [2023-12-28 04:25:45,280][106226] Updated weights for policy 0, policy_version 1276040 (0.0010) [2023-12-28 04:25:45,330][106226] Updated weights for policy 0, policy_version 1276050 (0.0010) [2023-12-28 04:25:46,011][106225] Updated weights for policy 1, policy_version 1279247 (0.0007) [2023-12-28 04:25:46,062][106226] Updated weights for policy 0, policy_version 1276060 (0.0011) [2023-12-28 04:25:46,068][106225] Updated weights for policy 1, policy_version 1279257 (0.0007) [2023-12-28 04:25:46,112][106226] Updated weights for policy 0, policy_version 1276070 (0.0010) [2023-12-28 04:25:46,118][106225] Updated weights for policy 1, policy_version 1279267 (0.0006) [2023-12-28 04:25:46,158][106226] Updated weights for policy 0, policy_version 1276080 (0.0010) [2023-12-28 04:25:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654270464. Throughput: 0: 9874.1, 1: 10196.1. Samples: 654260516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:46,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-5.010')] [2023-12-28 04:25:46,825][106225] Updated weights for policy 1, policy_version 1279277 (0.0007) [2023-12-28 04:25:46,872][106225] Updated weights for policy 1, policy_version 1279287 (0.0008) [2023-12-28 04:25:46,894][106226] Updated weights for policy 0, policy_version 1276090 (0.0010) [2023-12-28 04:25:46,923][106225] Updated weights for policy 1, policy_version 1279297 (0.0006) [2023-12-28 04:25:46,944][106226] Updated weights for policy 0, policy_version 1276100 (0.0010) [2023-12-28 04:25:46,997][106226] Updated weights for policy 0, policy_version 1276110 (0.0010) [2023-12-28 04:25:47,049][106226] Updated weights for policy 0, policy_version 1276120 (0.0006) [2023-12-28 04:25:47,695][106225] Updated weights for policy 1, policy_version 1279307 (0.0006) [2023-12-28 04:25:47,740][106226] Updated weights for policy 0, policy_version 1276130 (0.0010) [2023-12-28 04:25:47,746][106225] Updated weights for policy 1, policy_version 1279317 (0.0007) [2023-12-28 04:25:47,796][106226] Updated weights for policy 0, policy_version 1276140 (0.0008) [2023-12-28 04:25:47,803][106225] Updated weights for policy 1, policy_version 1279327 (0.0007) [2023-12-28 04:25:47,862][106226] Updated weights for policy 0, policy_version 1276150 (0.0007) [2023-12-28 04:25:48,469][106225] Updated weights for policy 1, policy_version 1279337 (0.0008) [2023-12-28 04:25:48,531][106225] Updated weights for policy 1, policy_version 1279347 (0.0006) [2023-12-28 04:25:48,532][106226] Updated weights for policy 0, policy_version 1276160 (0.0009) [2023-12-28 04:25:48,592][106225] Updated weights for policy 1, policy_version 1279357 (0.0008) [2023-12-28 04:25:48,592][106226] Updated weights for policy 0, policy_version 1276170 (0.0010) [2023-12-28 04:25:48,655][106225] Updated weights for policy 1, policy_version 1279367 (0.0010) [2023-12-28 04:25:48,655][106226] Updated weights for policy 0, policy_version 1276180 (0.0009) [2023-12-28 04:25:49,264][106226] Updated weights for policy 0, policy_version 1276190 (0.0008) [2023-12-28 04:25:49,327][106226] Updated weights for policy 0, policy_version 1276200 (0.0010) [2023-12-28 04:25:49,353][106225] Updated weights for policy 1, policy_version 1279377 (0.0008) [2023-12-28 04:25:49,393][106226] Updated weights for policy 0, policy_version 1276210 (0.0008) [2023-12-28 04:25:49,414][106225] Updated weights for policy 1, policy_version 1279387 (0.0006) [2023-12-28 04:25:49,474][106225] Updated weights for policy 1, policy_version 1279397 (0.0005) [2023-12-28 04:25:50,135][106226] Updated weights for policy 0, policy_version 1276220 (0.0007) [2023-12-28 04:25:50,160][106225] Updated weights for policy 1, policy_version 1279407 (0.0009) [2023-12-28 04:25:50,200][106226] Updated weights for policy 0, policy_version 1276230 (0.0008) [2023-12-28 04:25:50,225][106225] Updated weights for policy 1, policy_version 1279417 (0.0010) [2023-12-28 04:25:50,260][106226] Updated weights for policy 0, policy_version 1276240 (0.0006) [2023-12-28 04:25:50,289][106225] Updated weights for policy 1, policy_version 1279427 (0.0011) [2023-12-28 04:25:50,874][106226] Updated weights for policy 0, policy_version 1276250 (0.0007) [2023-12-28 04:25:50,935][106226] Updated weights for policy 0, policy_version 1276260 (0.0011) [2023-12-28 04:25:50,971][106225] Updated weights for policy 1, policy_version 1279437 (0.0008) [2023-12-28 04:25:50,994][106226] Updated weights for policy 0, policy_version 1276270 (0.0010) [2023-12-28 04:25:51,034][106225] Updated weights for policy 1, policy_version 1279447 (0.0007) [2023-12-28 04:25:51,065][106226] Updated weights for policy 0, policy_version 1276280 (0.0009) [2023-12-28 04:25:51,098][106225] Updated weights for policy 1, policy_version 1279457 (0.0007) [2023-12-28 04:25:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 654376960. Throughput: 0: 9903.9, 1: 10096.7. Samples: 654379384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:51,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-5.300')] [2023-12-28 04:25:51,778][106226] Updated weights for policy 0, policy_version 1276290 (0.0008) [2023-12-28 04:25:51,801][106225] Updated weights for policy 1, policy_version 1279467 (0.0008) [2023-12-28 04:25:51,840][106226] Updated weights for policy 0, policy_version 1276300 (0.0007) [2023-12-28 04:25:51,866][106225] Updated weights for policy 1, policy_version 1279477 (0.0008) [2023-12-28 04:25:51,898][106226] Updated weights for policy 0, policy_version 1276310 (0.0005) [2023-12-28 04:25:51,933][106225] Updated weights for policy 1, policy_version 1279487 (0.0009) [2023-12-28 04:25:52,540][106226] Updated weights for policy 0, policy_version 1276320 (0.0010) [2023-12-28 04:25:52,608][106226] Updated weights for policy 0, policy_version 1276330 (0.0011) [2023-12-28 04:25:52,676][106226] Updated weights for policy 0, policy_version 1276340 (0.0010) [2023-12-28 04:25:52,708][106225] Updated weights for policy 1, policy_version 1279497 (0.0009) [2023-12-28 04:25:52,767][106225] Updated weights for policy 1, policy_version 1279507 (0.0008) [2023-12-28 04:25:52,827][106225] Updated weights for policy 1, policy_version 1279517 (0.0009) [2023-12-28 04:25:52,888][106225] Updated weights for policy 1, policy_version 1279527 (0.0008) [2023-12-28 04:25:53,265][106226] Updated weights for policy 0, policy_version 1276350 (0.0011) [2023-12-28 04:25:53,324][106226] Updated weights for policy 0, policy_version 1276360 (0.0011) [2023-12-28 04:25:53,378][106226] Updated weights for policy 0, policy_version 1276370 (0.0008) [2023-12-28 04:25:53,584][106225] Updated weights for policy 1, policy_version 1279537 (0.0008) [2023-12-28 04:25:53,632][106225] Updated weights for policy 1, policy_version 1279547 (0.0008) [2023-12-28 04:25:53,679][106225] Updated weights for policy 1, policy_version 1279557 (0.0007) [2023-12-28 04:25:54,005][106226] Updated weights for policy 0, policy_version 1276380 (0.0008) [2023-12-28 04:25:54,071][106226] Updated weights for policy 0, policy_version 1276390 (0.0005) [2023-12-28 04:25:54,125][106226] Updated weights for policy 0, policy_version 1276400 (0.0005) [2023-12-28 04:25:54,480][106225] Updated weights for policy 1, policy_version 1279567 (0.0008) [2023-12-28 04:25:54,545][106225] Updated weights for policy 1, policy_version 1279577 (0.0007) [2023-12-28 04:25:54,606][106225] Updated weights for policy 1, policy_version 1279587 (0.0006) [2023-12-28 04:25:54,737][106226] Updated weights for policy 0, policy_version 1276410 (0.0007) [2023-12-28 04:25:54,791][106226] Updated weights for policy 0, policy_version 1276420 (0.0010) [2023-12-28 04:25:54,846][106226] Updated weights for policy 0, policy_version 1276430 (0.0011) [2023-12-28 04:25:54,898][106226] Updated weights for policy 0, policy_version 1276440 (0.0010) [2023-12-28 04:25:55,261][106225] Updated weights for policy 1, policy_version 1279597 (0.0008) [2023-12-28 04:25:55,308][106225] Updated weights for policy 1, policy_version 1279607 (0.0010) [2023-12-28 04:25:55,369][106225] Updated weights for policy 1, policy_version 1279617 (0.0010) [2023-12-28 04:25:55,570][106226] Updated weights for policy 0, policy_version 1276450 (0.0008) [2023-12-28 04:25:55,622][106226] Updated weights for policy 0, policy_version 1276460 (0.0008) [2023-12-28 04:25:55,679][106226] Updated weights for policy 0, policy_version 1276470 (0.0009) [2023-12-28 04:25:56,039][106225] Updated weights for policy 1, policy_version 1279627 (0.0010) [2023-12-28 04:25:56,105][106225] Updated weights for policy 1, policy_version 1279637 (0.0009) [2023-12-28 04:25:56,159][106225] Updated weights for policy 1, policy_version 1279647 (0.0008) [2023-12-28 04:25:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654467072. Throughput: 0: 9965.4, 1: 10057.2. Samples: 654439684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:25:56,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.909')] [2023-12-28 04:25:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001276472_326836224.pth... [2023-12-28 04:25:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001275288_326533120.pth [2023-12-28 04:25:56,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001279656_327639040.pth... [2023-12-28 04:25:56,221][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001278472_327335936.pth [2023-12-28 04:25:56,343][106226] Updated weights for policy 0, policy_version 1276480 (0.0008) [2023-12-28 04:25:56,392][106226] Updated weights for policy 0, policy_version 1276490 (0.0008) [2023-12-28 04:25:56,446][106226] Updated weights for policy 0, policy_version 1276500 (0.0009) [2023-12-28 04:25:56,881][106225] Updated weights for policy 1, policy_version 1279657 (0.0010) [2023-12-28 04:25:56,930][106225] Updated weights for policy 1, policy_version 1279667 (0.0008) [2023-12-28 04:25:56,992][106225] Updated weights for policy 1, policy_version 1279677 (0.0009) [2023-12-28 04:25:57,053][106225] Updated weights for policy 1, policy_version 1279687 (0.0008) [2023-12-28 04:25:57,104][106226] Updated weights for policy 0, policy_version 1276510 (0.0009) [2023-12-28 04:25:57,163][106226] Updated weights for policy 0, policy_version 1276520 (0.0009) [2023-12-28 04:25:57,222][106226] Updated weights for policy 0, policy_version 1276530 (0.0008) [2023-12-28 04:25:57,782][106225] Updated weights for policy 1, policy_version 1279697 (0.0010) [2023-12-28 04:25:57,846][106225] Updated weights for policy 1, policy_version 1279707 (0.0008) [2023-12-28 04:25:57,907][106225] Updated weights for policy 1, policy_version 1279717 (0.0010) [2023-12-28 04:25:57,963][106226] Updated weights for policy 0, policy_version 1276540 (0.0008) [2023-12-28 04:25:58,020][106226] Updated weights for policy 0, policy_version 1276550 (0.0005) [2023-12-28 04:25:58,073][106226] Updated weights for policy 0, policy_version 1276560 (0.0005) [2023-12-28 04:25:58,669][106225] Updated weights for policy 1, policy_version 1279727 (0.0009) [2023-12-28 04:25:58,731][106225] Updated weights for policy 1, policy_version 1279737 (0.0009) [2023-12-28 04:25:58,759][106226] Updated weights for policy 0, policy_version 1276570 (0.0006) [2023-12-28 04:25:58,798][106225] Updated weights for policy 1, policy_version 1279747 (0.0008) [2023-12-28 04:25:58,831][106226] Updated weights for policy 0, policy_version 1276580 (0.0007) [2023-12-28 04:25:58,897][106226] Updated weights for policy 0, policy_version 1276590 (0.0008) [2023-12-28 04:25:58,964][106226] Updated weights for policy 0, policy_version 1276600 (0.0009) [2023-12-28 04:25:59,603][106225] Updated weights for policy 1, policy_version 1279757 (0.0009) [2023-12-28 04:25:59,663][106225] Updated weights for policy 1, policy_version 1279767 (0.0009) [2023-12-28 04:25:59,713][106226] Updated weights for policy 0, policy_version 1276610 (0.0005) [2023-12-28 04:25:59,724][106225] Updated weights for policy 1, policy_version 1279777 (0.0008) [2023-12-28 04:25:59,773][106226] Updated weights for policy 0, policy_version 1276620 (0.0008) [2023-12-28 04:25:59,840][106226] Updated weights for policy 0, policy_version 1276630 (0.0008) [2023-12-28 04:26:00,429][106225] Updated weights for policy 1, policy_version 1279787 (0.0007) [2023-12-28 04:26:00,483][106225] Updated weights for policy 1, policy_version 1279797 (0.0005) [2023-12-28 04:26:00,506][106226] Updated weights for policy 0, policy_version 1276640 (0.0008) [2023-12-28 04:26:00,534][106225] Updated weights for policy 1, policy_version 1279807 (0.0005) [2023-12-28 04:26:00,566][106226] Updated weights for policy 0, policy_version 1276650 (0.0008) [2023-12-28 04:26:00,621][106226] Updated weights for policy 0, policy_version 1276660 (0.0008) [2023-12-28 04:26:01,075][106225] Updated weights for policy 1, policy_version 1279817 (0.0007) [2023-12-28 04:26:01,140][106225] Updated weights for policy 1, policy_version 1279828 (0.0008) [2023-12-28 04:26:01,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654565376. Throughput: 0: 10096.5, 1: 10010.8. Samples: 654557000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:01,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-4.922')] [2023-12-28 04:26:01,204][106225] Updated weights for policy 1, policy_version 1279838 (0.0008) [2023-12-28 04:26:01,276][106225] Updated weights for policy 1, policy_version 1279848 (0.0008) [2023-12-28 04:26:01,485][106226] Updated weights for policy 0, policy_version 1276670 (0.0008) [2023-12-28 04:26:01,536][106226] Updated weights for policy 0, policy_version 1276680 (0.0008) [2023-12-28 04:26:01,591][106226] Updated weights for policy 0, policy_version 1276690 (0.0008) [2023-12-28 04:26:02,001][106225] Updated weights for policy 1, policy_version 1279858 (0.0005) [2023-12-28 04:26:02,064][106225] Updated weights for policy 1, policy_version 1279868 (0.0008) [2023-12-28 04:26:02,122][106225] Updated weights for policy 1, policy_version 1279878 (0.0008) [2023-12-28 04:26:02,364][106226] Updated weights for policy 0, policy_version 1276700 (0.0008) [2023-12-28 04:26:02,430][106226] Updated weights for policy 0, policy_version 1276710 (0.0009) [2023-12-28 04:26:02,496][106226] Updated weights for policy 0, policy_version 1276720 (0.0009) [2023-12-28 04:26:02,712][106225] Updated weights for policy 1, policy_version 1279888 (0.0008) [2023-12-28 04:26:02,767][106225] Updated weights for policy 1, policy_version 1279898 (0.0007) [2023-12-28 04:26:02,832][106225] Updated weights for policy 1, policy_version 1279908 (0.0006) [2023-12-28 04:26:03,289][106226] Updated weights for policy 0, policy_version 1276730 (0.0008) [2023-12-28 04:26:03,350][106226] Updated weights for policy 0, policy_version 1276740 (0.0008) [2023-12-28 04:26:03,409][106226] Updated weights for policy 0, policy_version 1276750 (0.0008) [2023-12-28 04:26:03,458][106226] Updated weights for policy 0, policy_version 1276760 (0.0008) [2023-12-28 04:26:03,490][106225] Updated weights for policy 1, policy_version 1279918 (0.0008) [2023-12-28 04:26:03,546][106225] Updated weights for policy 1, policy_version 1279928 (0.0007) [2023-12-28 04:26:03,608][106225] Updated weights for policy 1, policy_version 1279938 (0.0008) [2023-12-28 04:26:04,193][106226] Updated weights for policy 0, policy_version 1276770 (0.0008) [2023-12-28 04:26:04,259][106226] Updated weights for policy 0, policy_version 1276780 (0.0008) [2023-12-28 04:26:04,322][106226] Updated weights for policy 0, policy_version 1276790 (0.0007) [2023-12-28 04:26:04,367][106225] Updated weights for policy 1, policy_version 1279948 (0.0008) [2023-12-28 04:26:04,429][106225] Updated weights for policy 1, policy_version 1279958 (0.0010) [2023-12-28 04:26:04,483][106225] Updated weights for policy 1, policy_version 1279968 (0.0010) [2023-12-28 04:26:04,982][106226] Updated weights for policy 0, policy_version 1276800 (0.0006) [2023-12-28 04:26:05,041][106226] Updated weights for policy 0, policy_version 1276810 (0.0006) [2023-12-28 04:26:05,088][106226] Updated weights for policy 0, policy_version 1276820 (0.0005) [2023-12-28 04:26:05,283][106225] Updated weights for policy 1, policy_version 1279978 (0.0009) [2023-12-28 04:26:05,346][106225] Updated weights for policy 1, policy_version 1279988 (0.0008) [2023-12-28 04:26:05,390][106225] Updated weights for policy 1, policy_version 1279998 (0.0008) [2023-12-28 04:26:05,439][106225] Updated weights for policy 1, policy_version 1280008 (0.0008) [2023-12-28 04:26:05,698][106226] Updated weights for policy 0, policy_version 1276830 (0.0007) [2023-12-28 04:26:05,749][106226] Updated weights for policy 0, policy_version 1276840 (0.0009) [2023-12-28 04:26:05,801][106226] Updated weights for policy 0, policy_version 1276850 (0.0009) [2023-12-28 04:26:06,160][106225] Updated weights for policy 1, policy_version 1280018 (0.0008) [2023-12-28 04:26:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 654663680. Throughput: 0: 10020.4, 1: 9998.8. Samples: 654674348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:06,175][105115] Avg episode reward: [(0, '-4.181'), (1, '-5.255')] [2023-12-28 04:26:06,222][106225] Updated weights for policy 1, policy_version 1280028 (0.0008) [2023-12-28 04:26:06,285][106225] Updated weights for policy 1, policy_version 1280038 (0.0008) [2023-12-28 04:26:06,560][106226] Updated weights for policy 0, policy_version 1276860 (0.0007) [2023-12-28 04:26:06,610][106226] Updated weights for policy 0, policy_version 1276870 (0.0005) [2023-12-28 04:26:06,665][106226] Updated weights for policy 0, policy_version 1276880 (0.0005) [2023-12-28 04:26:07,049][106225] Updated weights for policy 1, policy_version 1280048 (0.0008) [2023-12-28 04:26:07,109][106225] Updated weights for policy 1, policy_version 1280058 (0.0008) [2023-12-28 04:26:07,165][106225] Updated weights for policy 1, policy_version 1280068 (0.0008) [2023-12-28 04:26:07,368][106226] Updated weights for policy 0, policy_version 1276890 (0.0008) [2023-12-28 04:26:07,417][106226] Updated weights for policy 0, policy_version 1276900 (0.0009) [2023-12-28 04:26:07,466][106226] Updated weights for policy 0, policy_version 1276910 (0.0007) [2023-12-28 04:26:07,521][106226] Updated weights for policy 0, policy_version 1276920 (0.0005) [2023-12-28 04:26:07,833][106225] Updated weights for policy 1, policy_version 1280078 (0.0009) [2023-12-28 04:26:07,897][106225] Updated weights for policy 1, policy_version 1280088 (0.0008) [2023-12-28 04:26:07,953][106225] Updated weights for policy 1, policy_version 1280098 (0.0009) [2023-12-28 04:26:08,120][106226] Updated weights for policy 0, policy_version 1276930 (0.0008) [2023-12-28 04:26:08,168][106226] Updated weights for policy 0, policy_version 1276940 (0.0008) [2023-12-28 04:26:08,214][106226] Updated weights for policy 0, policy_version 1276950 (0.0009) [2023-12-28 04:26:08,643][106225] Updated weights for policy 1, policy_version 1280108 (0.0009) [2023-12-28 04:26:08,715][106225] Updated weights for policy 1, policy_version 1280118 (0.0010) [2023-12-28 04:26:08,776][106225] Updated weights for policy 1, policy_version 1280128 (0.0009) [2023-12-28 04:26:08,866][106226] Updated weights for policy 0, policy_version 1276960 (0.0008) [2023-12-28 04:26:08,931][106226] Updated weights for policy 0, policy_version 1276970 (0.0008) [2023-12-28 04:26:08,986][106226] Updated weights for policy 0, policy_version 1276980 (0.0007) [2023-12-28 04:26:09,511][106225] Updated weights for policy 1, policy_version 1280138 (0.0009) [2023-12-28 04:26:09,576][106225] Updated weights for policy 1, policy_version 1280148 (0.0009) [2023-12-28 04:26:09,645][106225] Updated weights for policy 1, policy_version 1280158 (0.0009) [2023-12-28 04:26:09,716][106225] Updated weights for policy 1, policy_version 1280168 (0.0010) [2023-12-28 04:26:09,801][106226] Updated weights for policy 0, policy_version 1276990 (0.0008) [2023-12-28 04:26:09,870][106226] Updated weights for policy 0, policy_version 1277000 (0.0007) [2023-12-28 04:26:09,939][106226] Updated weights for policy 0, policy_version 1277010 (0.0008) [2023-12-28 04:26:10,414][106225] Updated weights for policy 1, policy_version 1280178 (0.0009) [2023-12-28 04:26:10,466][106225] Updated weights for policy 1, policy_version 1280188 (0.0008) [2023-12-28 04:26:10,523][106225] Updated weights for policy 1, policy_version 1280198 (0.0008) [2023-12-28 04:26:10,728][106226] Updated weights for policy 0, policy_version 1277020 (0.0008) [2023-12-28 04:26:10,792][106226] Updated weights for policy 0, policy_version 1277030 (0.0007) [2023-12-28 04:26:10,853][106226] Updated weights for policy 0, policy_version 1277040 (0.0008) [2023-12-28 04:26:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 654761984. Throughput: 0: 10115.8, 1: 10014.6. Samples: 654735240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:11,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.034')] [2023-12-28 04:26:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001280200_327778304.pth... [2023-12-28 04:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001277048_326983680.pth... [2023-12-28 04:26:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001279080_327491584.pth [2023-12-28 04:26:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001275864_326680576.pth [2023-12-28 04:26:11,268][106225] Updated weights for policy 1, policy_version 1280208 (0.0010) [2023-12-28 04:26:11,333][106225] Updated weights for policy 1, policy_version 1280218 (0.0011) [2023-12-28 04:26:11,407][106225] Updated weights for policy 1, policy_version 1280228 (0.0011) [2023-12-28 04:26:11,617][106226] Updated weights for policy 0, policy_version 1277050 (0.0007) [2023-12-28 04:26:11,677][106226] Updated weights for policy 0, policy_version 1277060 (0.0008) [2023-12-28 04:26:11,752][106226] Updated weights for policy 0, policy_version 1277070 (0.0008) [2023-12-28 04:26:11,815][106226] Updated weights for policy 0, policy_version 1277080 (0.0006) [2023-12-28 04:26:12,115][106225] Updated weights for policy 1, policy_version 1280238 (0.0009) [2023-12-28 04:26:12,180][106225] Updated weights for policy 1, policy_version 1280248 (0.0006) [2023-12-28 04:26:12,253][106225] Updated weights for policy 1, policy_version 1280258 (0.0008) [2023-12-28 04:26:12,560][106226] Updated weights for policy 0, policy_version 1277090 (0.0008) [2023-12-28 04:26:12,618][106226] Updated weights for policy 0, policy_version 1277100 (0.0008) [2023-12-28 04:26:12,680][106226] Updated weights for policy 0, policy_version 1277110 (0.0008) [2023-12-28 04:26:12,917][106225] Updated weights for policy 1, policy_version 1280268 (0.0010) [2023-12-28 04:26:12,974][106225] Updated weights for policy 1, policy_version 1280278 (0.0005) [2023-12-28 04:26:13,028][106225] Updated weights for policy 1, policy_version 1280288 (0.0005) [2023-12-28 04:26:13,349][106226] Updated weights for policy 0, policy_version 1277120 (0.0008) [2023-12-28 04:26:13,411][106226] Updated weights for policy 0, policy_version 1277130 (0.0008) [2023-12-28 04:26:13,467][106226] Updated weights for policy 0, policy_version 1277140 (0.0009) [2023-12-28 04:26:13,584][106225] Updated weights for policy 1, policy_version 1280298 (0.0005) [2023-12-28 04:26:13,651][106225] Updated weights for policy 1, policy_version 1280308 (0.0005) [2023-12-28 04:26:13,716][106225] Updated weights for policy 1, policy_version 1280318 (0.0005) [2023-12-28 04:26:13,781][106225] Updated weights for policy 1, policy_version 1280328 (0.0006) [2023-12-28 04:26:14,172][106226] Updated weights for policy 0, policy_version 1277150 (0.0010) [2023-12-28 04:26:14,222][106226] Updated weights for policy 0, policy_version 1277160 (0.0010) [2023-12-28 04:26:14,279][106226] Updated weights for policy 0, policy_version 1277170 (0.0011) [2023-12-28 04:26:14,307][106225] Updated weights for policy 1, policy_version 1280338 (0.0005) [2023-12-28 04:26:14,370][106225] Updated weights for policy 1, policy_version 1280348 (0.0005) [2023-12-28 04:26:14,432][106225] Updated weights for policy 1, policy_version 1280358 (0.0006) [2023-12-28 04:26:15,054][106226] Updated weights for policy 0, policy_version 1277180 (0.0010) [2023-12-28 04:26:15,073][106225] Updated weights for policy 1, policy_version 1280368 (0.0007) [2023-12-28 04:26:15,119][106226] Updated weights for policy 0, policy_version 1277190 (0.0011) [2023-12-28 04:26:15,131][106225] Updated weights for policy 1, policy_version 1280378 (0.0010) [2023-12-28 04:26:15,181][106226] Updated weights for policy 0, policy_version 1277200 (0.0011) [2023-12-28 04:26:15,193][106225] Updated weights for policy 1, policy_version 1280388 (0.0010) [2023-12-28 04:26:15,846][106226] Updated weights for policy 0, policy_version 1277210 (0.0011) [2023-12-28 04:26:15,880][106225] Updated weights for policy 1, policy_version 1280398 (0.0010) [2023-12-28 04:26:15,892][106226] Updated weights for policy 0, policy_version 1277220 (0.0010) [2023-12-28 04:26:15,933][106225] Updated weights for policy 1, policy_version 1280408 (0.0010) [2023-12-28 04:26:15,942][106226] Updated weights for policy 0, policy_version 1277230 (0.0010) [2023-12-28 04:26:15,986][106225] Updated weights for policy 1, policy_version 1280418 (0.0010) [2023-12-28 04:26:15,996][106226] Updated weights for policy 0, policy_version 1277240 (0.0010) [2023-12-28 04:26:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 654868480. Throughput: 0: 10117.3, 1: 9910.2. Samples: 654853276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:16,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-5.196')] [2023-12-28 04:26:16,644][106226] Updated weights for policy 0, policy_version 1277250 (0.0011) [2023-12-28 04:26:16,707][106226] Updated weights for policy 0, policy_version 1277260 (0.0010) [2023-12-28 04:26:16,719][106225] Updated weights for policy 1, policy_version 1280428 (0.0010) [2023-12-28 04:26:16,764][106226] Updated weights for policy 0, policy_version 1277270 (0.0011) [2023-12-28 04:26:16,776][106225] Updated weights for policy 1, policy_version 1280438 (0.0010) [2023-12-28 04:26:16,832][106225] Updated weights for policy 1, policy_version 1280448 (0.0008) [2023-12-28 04:26:17,379][106226] Updated weights for policy 0, policy_version 1277280 (0.0009) [2023-12-28 04:26:17,428][106226] Updated weights for policy 0, policy_version 1277290 (0.0008) [2023-12-28 04:26:17,478][106225] Updated weights for policy 1, policy_version 1280458 (0.0006) [2023-12-28 04:26:17,480][106226] Updated weights for policy 0, policy_version 1277300 (0.0007) [2023-12-28 04:26:17,533][106225] Updated weights for policy 1, policy_version 1280468 (0.0010) [2023-12-28 04:26:17,596][106225] Updated weights for policy 1, policy_version 1280478 (0.0007) [2023-12-28 04:26:17,652][106225] Updated weights for policy 1, policy_version 1280488 (0.0008) [2023-12-28 04:26:18,187][106226] Updated weights for policy 0, policy_version 1277310 (0.0008) [2023-12-28 04:26:18,245][106226] Updated weights for policy 0, policy_version 1277320 (0.0011) [2023-12-28 04:26:18,270][106225] Updated weights for policy 1, policy_version 1280498 (0.0006) [2023-12-28 04:26:18,306][106226] Updated weights for policy 0, policy_version 1277330 (0.0010) [2023-12-28 04:26:18,320][106225] Updated weights for policy 1, policy_version 1280508 (0.0005) [2023-12-28 04:26:18,385][106225] Updated weights for policy 1, policy_version 1280518 (0.0007) [2023-12-28 04:26:19,031][106226] Updated weights for policy 0, policy_version 1277340 (0.0011) [2023-12-28 04:26:19,079][106225] Updated weights for policy 1, policy_version 1280528 (0.0007) [2023-12-28 04:26:19,086][106226] Updated weights for policy 0, policy_version 1277350 (0.0010) [2023-12-28 04:26:19,136][106225] Updated weights for policy 1, policy_version 1280538 (0.0008) [2023-12-28 04:26:19,137][106226] Updated weights for policy 0, policy_version 1277360 (0.0005) [2023-12-28 04:26:19,188][106225] Updated weights for policy 1, policy_version 1280548 (0.0007) [2023-12-28 04:26:19,848][106226] Updated weights for policy 0, policy_version 1277370 (0.0006) [2023-12-28 04:26:19,911][106226] Updated weights for policy 0, policy_version 1277380 (0.0008) [2023-12-28 04:26:19,983][106225] Updated weights for policy 1, policy_version 1280558 (0.0006) [2023-12-28 04:26:19,984][106226] Updated weights for policy 0, policy_version 1277390 (0.0008) [2023-12-28 04:26:20,040][106225] Updated weights for policy 1, policy_version 1280568 (0.0006) [2023-12-28 04:26:20,050][106226] Updated weights for policy 0, policy_version 1277400 (0.0008) [2023-12-28 04:26:20,103][106225] Updated weights for policy 1, policy_version 1280578 (0.0008) [2023-12-28 04:26:20,776][106226] Updated weights for policy 0, policy_version 1277410 (0.0008) [2023-12-28 04:26:20,834][106226] Updated weights for policy 0, policy_version 1277420 (0.0008) [2023-12-28 04:26:20,850][106225] Updated weights for policy 1, policy_version 1280588 (0.0009) [2023-12-28 04:26:20,893][106226] Updated weights for policy 0, policy_version 1277430 (0.0007) [2023-12-28 04:26:20,907][106225] Updated weights for policy 1, policy_version 1280598 (0.0006) [2023-12-28 04:26:20,973][106225] Updated weights for policy 1, policy_version 1280608 (0.0009) [2023-12-28 04:26:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 654966784. Throughput: 0: 9978.7, 1: 9824.5. Samples: 654972600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:21,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.169')] [2023-12-28 04:26:21,715][106226] Updated weights for policy 0, policy_version 1277440 (0.0008) [2023-12-28 04:26:21,755][106225] Updated weights for policy 1, policy_version 1280618 (0.0007) [2023-12-28 04:26:21,785][106226] Updated weights for policy 0, policy_version 1277450 (0.0008) [2023-12-28 04:26:21,821][106225] Updated weights for policy 1, policy_version 1280628 (0.0007) [2023-12-28 04:26:21,850][106226] Updated weights for policy 0, policy_version 1277460 (0.0006) [2023-12-28 04:26:21,885][106225] Updated weights for policy 1, policy_version 1280638 (0.0008) [2023-12-28 04:26:21,947][106225] Updated weights for policy 1, policy_version 1280648 (0.0009) [2023-12-28 04:26:22,555][106226] Updated weights for policy 0, policy_version 1277470 (0.0008) [2023-12-28 04:26:22,609][106226] Updated weights for policy 0, policy_version 1277480 (0.0008) [2023-12-28 04:26:22,660][106225] Updated weights for policy 1, policy_version 1280658 (0.0006) [2023-12-28 04:26:22,668][106226] Updated weights for policy 0, policy_version 1277490 (0.0008) [2023-12-28 04:26:22,722][106225] Updated weights for policy 1, policy_version 1280668 (0.0006) [2023-12-28 04:26:22,777][106225] Updated weights for policy 1, policy_version 1280678 (0.0005) [2023-12-28 04:26:23,337][106225] Updated weights for policy 1, policy_version 1280688 (0.0008) [2023-12-28 04:26:23,385][106225] Updated weights for policy 1, policy_version 1280698 (0.0008) [2023-12-28 04:26:23,443][106225] Updated weights for policy 1, policy_version 1280708 (0.0008) [2023-12-28 04:26:23,490][106226] Updated weights for policy 0, policy_version 1277500 (0.0008) [2023-12-28 04:26:23,546][106226] Updated weights for policy 0, policy_version 1277510 (0.0009) [2023-12-28 04:26:23,609][106226] Updated weights for policy 0, policy_version 1277520 (0.0009) [2023-12-28 04:26:24,104][106225] Updated weights for policy 1, policy_version 1280718 (0.0009) [2023-12-28 04:26:24,165][106225] Updated weights for policy 1, policy_version 1280728 (0.0008) [2023-12-28 04:26:24,221][106225] Updated weights for policy 1, policy_version 1280738 (0.0005) [2023-12-28 04:26:24,397][106226] Updated weights for policy 0, policy_version 1277530 (0.0008) [2023-12-28 04:26:24,455][106226] Updated weights for policy 0, policy_version 1277540 (0.0008) [2023-12-28 04:26:24,517][106226] Updated weights for policy 0, policy_version 1277550 (0.0008) [2023-12-28 04:26:24,574][106226] Updated weights for policy 0, policy_version 1277560 (0.0008) [2023-12-28 04:26:24,911][106225] Updated weights for policy 1, policy_version 1280748 (0.0007) [2023-12-28 04:26:24,965][106225] Updated weights for policy 1, policy_version 1280758 (0.0010) [2023-12-28 04:26:25,019][106225] Updated weights for policy 1, policy_version 1280768 (0.0009) [2023-12-28 04:26:25,338][106226] Updated weights for policy 0, policy_version 1277570 (0.0008) [2023-12-28 04:26:25,395][106226] Updated weights for policy 0, policy_version 1277580 (0.0007) [2023-12-28 04:26:25,450][106226] Updated weights for policy 0, policy_version 1277590 (0.0008) [2023-12-28 04:26:25,635][106225] Updated weights for policy 1, policy_version 1280778 (0.0005) [2023-12-28 04:26:25,686][106225] Updated weights for policy 1, policy_version 1280788 (0.0005) [2023-12-28 04:26:25,743][106225] Updated weights for policy 1, policy_version 1280798 (0.0005) [2023-12-28 04:26:25,799][106225] Updated weights for policy 1, policy_version 1280808 (0.0007) [2023-12-28 04:26:26,175][105115] Fps is (10 sec: 18840.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 655056896. Throughput: 0: 9865.0, 1: 9861.6. Samples: 655029260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:26,176][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.773')] [2023-12-28 04:26:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001280808_327933952.pth... [2023-12-28 04:26:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001279656_327639040.pth [2023-12-28 04:26:26,221][106226] Updated weights for policy 0, policy_version 1277600 (0.0007) [2023-12-28 04:26:26,271][106226] Updated weights for policy 0, policy_version 1277610 (0.0009) [2023-12-28 04:26:26,326][106226] Updated weights for policy 0, policy_version 1277620 (0.0006) [2023-12-28 04:26:26,348][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001277624_327131136.pth... [2023-12-28 04:26:26,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001276472_326836224.pth [2023-12-28 04:26:26,462][106225] Updated weights for policy 1, policy_version 1280818 (0.0008) [2023-12-28 04:26:26,509][106225] Updated weights for policy 1, policy_version 1280828 (0.0007) [2023-12-28 04:26:26,554][106225] Updated weights for policy 1, policy_version 1280838 (0.0009) [2023-12-28 04:26:26,966][106226] Updated weights for policy 0, policy_version 1277630 (0.0007) [2023-12-28 04:26:27,025][106226] Updated weights for policy 0, policy_version 1277640 (0.0008) [2023-12-28 04:26:27,084][106226] Updated weights for policy 0, policy_version 1277650 (0.0008) [2023-12-28 04:26:27,316][106225] Updated weights for policy 1, policy_version 1280848 (0.0007) [2023-12-28 04:26:27,365][106225] Updated weights for policy 1, policy_version 1280858 (0.0008) [2023-12-28 04:26:27,408][106225] Updated weights for policy 1, policy_version 1280868 (0.0008) [2023-12-28 04:26:27,795][106226] Updated weights for policy 0, policy_version 1277660 (0.0009) [2023-12-28 04:26:27,846][106226] Updated weights for policy 0, policy_version 1277670 (0.0007) [2023-12-28 04:26:27,899][106226] Updated weights for policy 0, policy_version 1277680 (0.0006) [2023-12-28 04:26:28,112][106225] Updated weights for policy 1, policy_version 1280878 (0.0009) [2023-12-28 04:26:28,173][106225] Updated weights for policy 1, policy_version 1280888 (0.0010) [2023-12-28 04:26:28,226][106225] Updated weights for policy 1, policy_version 1280898 (0.0010) [2023-12-28 04:26:28,605][106226] Updated weights for policy 0, policy_version 1277690 (0.0008) [2023-12-28 04:26:28,667][106226] Updated weights for policy 0, policy_version 1277700 (0.0009) [2023-12-28 04:26:28,728][106226] Updated weights for policy 0, policy_version 1277710 (0.0011) [2023-12-28 04:26:28,789][106226] Updated weights for policy 0, policy_version 1277720 (0.0010) [2023-12-28 04:26:28,971][106225] Updated weights for policy 1, policy_version 1280908 (0.0010) [2023-12-28 04:26:29,026][106225] Updated weights for policy 1, policy_version 1280918 (0.0010) [2023-12-28 04:26:29,069][106225] Updated weights for policy 1, policy_version 1280928 (0.0010) [2023-12-28 04:26:29,509][106226] Updated weights for policy 0, policy_version 1277730 (0.0010) [2023-12-28 04:26:29,565][106226] Updated weights for policy 0, policy_version 1277740 (0.0010) [2023-12-28 04:26:29,622][106226] Updated weights for policy 0, policy_version 1277750 (0.0010) [2023-12-28 04:26:29,753][106225] Updated weights for policy 1, policy_version 1280938 (0.0010) [2023-12-28 04:26:29,813][106225] Updated weights for policy 1, policy_version 1280948 (0.0010) [2023-12-28 04:26:29,887][106225] Updated weights for policy 1, policy_version 1280958 (0.0009) [2023-12-28 04:26:29,951][106225] Updated weights for policy 1, policy_version 1280968 (0.0010) [2023-12-28 04:26:30,336][106226] Updated weights for policy 0, policy_version 1277760 (0.0007) [2023-12-28 04:26:30,402][106226] Updated weights for policy 0, policy_version 1277770 (0.0006) [2023-12-28 04:26:30,461][106226] Updated weights for policy 0, policy_version 1277780 (0.0005) [2023-12-28 04:26:30,639][106225] Updated weights for policy 1, policy_version 1280978 (0.0008) [2023-12-28 04:26:30,693][106225] Updated weights for policy 1, policy_version 1280988 (0.0008) [2023-12-28 04:26:30,738][106225] Updated weights for policy 1, policy_version 1280998 (0.0007) [2023-12-28 04:26:31,091][106226] Updated weights for policy 0, policy_version 1277790 (0.0009) [2023-12-28 04:26:31,160][106226] Updated weights for policy 0, policy_version 1277800 (0.0011) [2023-12-28 04:26:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 655155200. Throughput: 0: 9811.3, 1: 9914.8. Samples: 655148188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:31,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-5.061')] [2023-12-28 04:26:31,215][106226] Updated weights for policy 0, policy_version 1277810 (0.0010) [2023-12-28 04:26:31,493][106225] Updated weights for policy 1, policy_version 1281008 (0.0008) [2023-12-28 04:26:31,555][106225] Updated weights for policy 1, policy_version 1281018 (0.0008) [2023-12-28 04:26:31,619][106225] Updated weights for policy 1, policy_version 1281028 (0.0008) [2023-12-28 04:26:31,934][106226] Updated weights for policy 0, policy_version 1277820 (0.0011) [2023-12-28 04:26:31,992][106226] Updated weights for policy 0, policy_version 1277830 (0.0011) [2023-12-28 04:26:32,048][106226] Updated weights for policy 0, policy_version 1277840 (0.0010) [2023-12-28 04:26:32,282][106225] Updated weights for policy 1, policy_version 1281038 (0.0007) [2023-12-28 04:26:32,341][106225] Updated weights for policy 1, policy_version 1281048 (0.0007) [2023-12-28 04:26:32,406][106225] Updated weights for policy 1, policy_version 1281058 (0.0007) [2023-12-28 04:26:32,728][106226] Updated weights for policy 0, policy_version 1277850 (0.0010) [2023-12-28 04:26:32,782][106226] Updated weights for policy 0, policy_version 1277860 (0.0008) [2023-12-28 04:26:32,836][106226] Updated weights for policy 0, policy_version 1277870 (0.0009) [2023-12-28 04:26:32,901][106226] Updated weights for policy 0, policy_version 1277880 (0.0010) [2023-12-28 04:26:33,086][106225] Updated weights for policy 1, policy_version 1281068 (0.0009) [2023-12-28 04:26:33,143][106225] Updated weights for policy 1, policy_version 1281078 (0.0010) [2023-12-28 04:26:33,199][106225] Updated weights for policy 1, policy_version 1281088 (0.0010) [2023-12-28 04:26:33,512][106226] Updated weights for policy 0, policy_version 1277890 (0.0005) [2023-12-28 04:26:33,567][106226] Updated weights for policy 0, policy_version 1277900 (0.0006) [2023-12-28 04:26:33,617][106226] Updated weights for policy 0, policy_version 1277910 (0.0010) [2023-12-28 04:26:33,923][106225] Updated weights for policy 1, policy_version 1281098 (0.0010) [2023-12-28 04:26:33,971][106225] Updated weights for policy 1, policy_version 1281108 (0.0010) [2023-12-28 04:26:34,020][106225] Updated weights for policy 1, policy_version 1281118 (0.0007) [2023-12-28 04:26:34,077][106225] Updated weights for policy 1, policy_version 1281128 (0.0005) [2023-12-28 04:26:34,338][106226] Updated weights for policy 0, policy_version 1277920 (0.0009) [2023-12-28 04:26:34,403][106226] Updated weights for policy 0, policy_version 1277930 (0.0008) [2023-12-28 04:26:34,470][106226] Updated weights for policy 0, policy_version 1277940 (0.0007) [2023-12-28 04:26:34,798][106225] Updated weights for policy 1, policy_version 1281138 (0.0010) [2023-12-28 04:26:34,851][106225] Updated weights for policy 1, policy_version 1281148 (0.0010) [2023-12-28 04:26:34,908][106225] Updated weights for policy 1, policy_version 1281158 (0.0010) [2023-12-28 04:26:35,089][106226] Updated weights for policy 0, policy_version 1277950 (0.0007) [2023-12-28 04:26:35,146][106226] Updated weights for policy 0, policy_version 1277960 (0.0008) [2023-12-28 04:26:35,199][106226] Updated weights for policy 0, policy_version 1277970 (0.0007) [2023-12-28 04:26:35,648][106225] Updated weights for policy 1, policy_version 1281168 (0.0009) [2023-12-28 04:26:35,696][106225] Updated weights for policy 1, policy_version 1281178 (0.0008) [2023-12-28 04:26:35,752][106225] Updated weights for policy 1, policy_version 1281188 (0.0009) [2023-12-28 04:26:35,946][106226] Updated weights for policy 0, policy_version 1277980 (0.0008) [2023-12-28 04:26:35,993][106226] Updated weights for policy 0, policy_version 1277990 (0.0009) [2023-12-28 04:26:36,039][106226] Updated weights for policy 0, policy_version 1278000 (0.0008) [2023-12-28 04:26:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 655261696. Throughput: 0: 9827.3, 1: 9899.3. Samples: 655267080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:36,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.042')] [2023-12-28 04:26:36,379][106225] Updated weights for policy 1, policy_version 1281198 (0.0007) [2023-12-28 04:26:36,438][106225] Updated weights for policy 1, policy_version 1281208 (0.0005) [2023-12-28 04:26:36,495][106225] Updated weights for policy 1, policy_version 1281218 (0.0008) [2023-12-28 04:26:36,848][106226] Updated weights for policy 0, policy_version 1278010 (0.0008) [2023-12-28 04:26:36,897][106226] Updated weights for policy 0, policy_version 1278020 (0.0008) [2023-12-28 04:26:36,950][106226] Updated weights for policy 0, policy_version 1278030 (0.0009) [2023-12-28 04:26:37,001][106226] Updated weights for policy 0, policy_version 1278040 (0.0009) [2023-12-28 04:26:37,161][106225] Updated weights for policy 1, policy_version 1281228 (0.0006) [2023-12-28 04:26:37,230][106225] Updated weights for policy 1, policy_version 1281238 (0.0006) [2023-12-28 04:26:37,288][106225] Updated weights for policy 1, policy_version 1281248 (0.0008) [2023-12-28 04:26:37,791][106226] Updated weights for policy 0, policy_version 1278050 (0.0007) [2023-12-28 04:26:37,822][106225] Updated weights for policy 1, policy_version 1281258 (0.0008) [2023-12-28 04:26:37,840][106226] Updated weights for policy 0, policy_version 1278060 (0.0009) [2023-12-28 04:26:37,876][106225] Updated weights for policy 1, policy_version 1281268 (0.0005) [2023-12-28 04:26:37,896][106226] Updated weights for policy 0, policy_version 1278070 (0.0008) [2023-12-28 04:26:37,935][106225] Updated weights for policy 1, policy_version 1281278 (0.0006) [2023-12-28 04:26:37,996][106225] Updated weights for policy 1, policy_version 1281288 (0.0006) [2023-12-28 04:26:38,605][106225] Updated weights for policy 1, policy_version 1281298 (0.0009) [2023-12-28 04:26:38,640][106226] Updated weights for policy 0, policy_version 1278080 (0.0007) [2023-12-28 04:26:38,661][106225] Updated weights for policy 1, policy_version 1281308 (0.0006) [2023-12-28 04:26:38,689][106226] Updated weights for policy 0, policy_version 1278090 (0.0006) [2023-12-28 04:26:38,715][106225] Updated weights for policy 1, policy_version 1281318 (0.0007) [2023-12-28 04:26:38,753][106226] Updated weights for policy 0, policy_version 1278100 (0.0009) [2023-12-28 04:26:39,312][106225] Updated weights for policy 1, policy_version 1281328 (0.0006) [2023-12-28 04:26:39,377][106225] Updated weights for policy 1, policy_version 1281338 (0.0010) [2023-12-28 04:26:39,444][106225] Updated weights for policy 1, policy_version 1281348 (0.0009) [2023-12-28 04:26:39,463][106226] Updated weights for policy 0, policy_version 1278110 (0.0007) [2023-12-28 04:26:39,522][106226] Updated weights for policy 0, policy_version 1278120 (0.0008) [2023-12-28 04:26:39,582][106226] Updated weights for policy 0, policy_version 1278130 (0.0008) [2023-12-28 04:26:40,218][106225] Updated weights for policy 1, policy_version 1281358 (0.0008) [2023-12-28 04:26:40,284][106225] Updated weights for policy 1, policy_version 1281368 (0.0007) [2023-12-28 04:26:40,345][106225] Updated weights for policy 1, policy_version 1281378 (0.0007) [2023-12-28 04:26:40,357][106226] Updated weights for policy 0, policy_version 1278140 (0.0009) [2023-12-28 04:26:40,412][106226] Updated weights for policy 0, policy_version 1278150 (0.0010) [2023-12-28 04:26:40,462][106226] Updated weights for policy 0, policy_version 1278160 (0.0008) [2023-12-28 04:26:41,021][106225] Updated weights for policy 1, policy_version 1281388 (0.0006) [2023-12-28 04:26:41,092][106225] Updated weights for policy 1, policy_version 1281398 (0.0008) [2023-12-28 04:26:41,159][106225] Updated weights for policy 1, policy_version 1281408 (0.0008) [2023-12-28 04:26:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 655351808. Throughput: 0: 9730.7, 1: 10008.3. Samples: 655327936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:41,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-5.136')] [2023-12-28 04:26:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001278168_327270400.pth... [2023-12-28 04:26:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001277048_326983680.pth [2023-12-28 04:26:41,203][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001281416_328089600.pth... [2023-12-28 04:26:41,206][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001280200_327778304.pth [2023-12-28 04:26:41,217][106226] Updated weights for policy 0, policy_version 1278170 (0.0008) [2023-12-28 04:26:41,278][106226] Updated weights for policy 0, policy_version 1278180 (0.0010) [2023-12-28 04:26:41,337][106226] Updated weights for policy 0, policy_version 1278190 (0.0011) [2023-12-28 04:26:41,408][106226] Updated weights for policy 0, policy_version 1278200 (0.0013) [2023-12-28 04:26:41,989][106225] Updated weights for policy 1, policy_version 1281418 (0.0008) [2023-12-28 04:26:42,051][106225] Updated weights for policy 1, policy_version 1281428 (0.0007) [2023-12-28 04:26:42,115][106225] Updated weights for policy 1, policy_version 1281438 (0.0007) [2023-12-28 04:26:42,139][106226] Updated weights for policy 0, policy_version 1278210 (0.0010) [2023-12-28 04:26:42,180][106225] Updated weights for policy 1, policy_version 1281448 (0.0006) [2023-12-28 04:26:42,204][106226] Updated weights for policy 0, policy_version 1278220 (0.0011) [2023-12-28 04:26:42,274][106226] Updated weights for policy 0, policy_version 1278230 (0.0011) [2023-12-28 04:26:42,920][106225] Updated weights for policy 1, policy_version 1281458 (0.0008) [2023-12-28 04:26:42,974][106225] Updated weights for policy 1, policy_version 1281468 (0.0008) [2023-12-28 04:26:43,000][106226] Updated weights for policy 0, policy_version 1278240 (0.0011) [2023-12-28 04:26:43,036][106225] Updated weights for policy 1, policy_version 1281478 (0.0006) [2023-12-28 04:26:43,051][106226] Updated weights for policy 0, policy_version 1278250 (0.0010) [2023-12-28 04:26:43,101][106226] Updated weights for policy 0, policy_version 1278260 (0.0010) [2023-12-28 04:26:43,613][106225] Updated weights for policy 1, policy_version 1281488 (0.0006) [2023-12-28 04:26:43,675][106225] Updated weights for policy 1, policy_version 1281498 (0.0007) [2023-12-28 04:26:43,728][106225] Updated weights for policy 1, policy_version 1281508 (0.0008) [2023-12-28 04:26:43,820][106226] Updated weights for policy 0, policy_version 1278270 (0.0010) [2023-12-28 04:26:43,884][106226] Updated weights for policy 0, policy_version 1278280 (0.0011) [2023-12-28 04:26:43,946][106226] Updated weights for policy 0, policy_version 1278290 (0.0010) [2023-12-28 04:26:44,332][106225] Updated weights for policy 1, policy_version 1281518 (0.0006) [2023-12-28 04:26:44,378][106225] Updated weights for policy 1, policy_version 1281528 (0.0005) [2023-12-28 04:26:44,426][106225] Updated weights for policy 1, policy_version 1281538 (0.0005) [2023-12-28 04:26:44,634][106226] Updated weights for policy 0, policy_version 1278300 (0.0010) [2023-12-28 04:26:44,692][106226] Updated weights for policy 0, policy_version 1278310 (0.0010) [2023-12-28 04:26:44,755][106226] Updated weights for policy 0, policy_version 1278320 (0.0010) [2023-12-28 04:26:44,983][106225] Updated weights for policy 1, policy_version 1281548 (0.0005) [2023-12-28 04:26:45,038][106225] Updated weights for policy 1, policy_version 1281558 (0.0006) [2023-12-28 04:26:45,103][106225] Updated weights for policy 1, policy_version 1281568 (0.0010) [2023-12-28 04:26:45,512][106226] Updated weights for policy 0, policy_version 1278330 (0.0009) [2023-12-28 04:26:45,580][106226] Updated weights for policy 0, policy_version 1278340 (0.0008) [2023-12-28 04:26:45,640][106226] Updated weights for policy 0, policy_version 1278350 (0.0010) [2023-12-28 04:26:45,696][106226] Updated weights for policy 0, policy_version 1278360 (0.0010) [2023-12-28 04:26:45,790][106225] Updated weights for policy 1, policy_version 1281578 (0.0010) [2023-12-28 04:26:45,840][106225] Updated weights for policy 1, policy_version 1281588 (0.0010) [2023-12-28 04:26:45,894][106225] Updated weights for policy 1, policy_version 1281598 (0.0010) [2023-12-28 04:26:45,951][106225] Updated weights for policy 1, policy_version 1281608 (0.0010) [2023-12-28 04:26:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 655458304. Throughput: 0: 9632.1, 1: 10121.1. Samples: 655445896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:46,176][105115] Avg episode reward: [(0, '-4.404'), (1, '-5.322')] [2023-12-28 04:26:46,263][106226] Updated weights for policy 0, policy_version 1278370 (0.0005) [2023-12-28 04:26:46,321][106226] Updated weights for policy 0, policy_version 1278380 (0.0009) [2023-12-28 04:26:46,389][106226] Updated weights for policy 0, policy_version 1278390 (0.0009) [2023-12-28 04:26:46,757][106225] Updated weights for policy 1, policy_version 1281618 (0.0008) [2023-12-28 04:26:46,816][106225] Updated weights for policy 1, policy_version 1281628 (0.0006) [2023-12-28 04:26:46,876][106225] Updated weights for policy 1, policy_version 1281638 (0.0005) [2023-12-28 04:26:46,979][106226] Updated weights for policy 0, policy_version 1278400 (0.0009) [2023-12-28 04:26:47,042][106226] Updated weights for policy 0, policy_version 1278410 (0.0010) [2023-12-28 04:26:47,099][106226] Updated weights for policy 0, policy_version 1278420 (0.0010) [2023-12-28 04:26:47,551][106225] Updated weights for policy 1, policy_version 1281648 (0.0009) [2023-12-28 04:26:47,610][106225] Updated weights for policy 1, policy_version 1281658 (0.0010) [2023-12-28 04:26:47,667][106225] Updated weights for policy 1, policy_version 1281668 (0.0010) [2023-12-28 04:26:47,760][106226] Updated weights for policy 0, policy_version 1278430 (0.0007) [2023-12-28 04:26:47,806][106226] Updated weights for policy 0, policy_version 1278440 (0.0008) [2023-12-28 04:26:47,860][106226] Updated weights for policy 0, policy_version 1278450 (0.0010) [2023-12-28 04:26:48,363][106225] Updated weights for policy 1, policy_version 1281678 (0.0010) [2023-12-28 04:26:48,416][106225] Updated weights for policy 1, policy_version 1281688 (0.0010) [2023-12-28 04:26:48,466][106225] Updated weights for policy 1, policy_version 1281698 (0.0010) [2023-12-28 04:26:48,470][106226] Updated weights for policy 0, policy_version 1278460 (0.0011) [2023-12-28 04:26:48,528][106226] Updated weights for policy 0, policy_version 1278470 (0.0011) [2023-12-28 04:26:48,582][106226] Updated weights for policy 0, policy_version 1278480 (0.0010) [2023-12-28 04:26:49,196][106225] Updated weights for policy 1, policy_version 1281708 (0.0010) [2023-12-28 04:26:49,262][106225] Updated weights for policy 1, policy_version 1281718 (0.0010) [2023-12-28 04:26:49,305][106226] Updated weights for policy 0, policy_version 1278490 (0.0010) [2023-12-28 04:26:49,330][106225] Updated weights for policy 1, policy_version 1281728 (0.0010) [2023-12-28 04:26:49,369][106226] Updated weights for policy 0, policy_version 1278500 (0.0009) [2023-12-28 04:26:49,426][106226] Updated weights for policy 0, policy_version 1278510 (0.0009) [2023-12-28 04:26:49,487][106226] Updated weights for policy 0, policy_version 1278520 (0.0010) [2023-12-28 04:26:50,100][106225] Updated weights for policy 1, policy_version 1281738 (0.0010) [2023-12-28 04:26:50,148][106225] Updated weights for policy 1, policy_version 1281748 (0.0010) [2023-12-28 04:26:50,203][106225] Updated weights for policy 1, policy_version 1281758 (0.0010) [2023-12-28 04:26:50,249][106226] Updated weights for policy 0, policy_version 1278530 (0.0008) [2023-12-28 04:26:50,263][106225] Updated weights for policy 1, policy_version 1281768 (0.0011) [2023-12-28 04:26:50,309][106226] Updated weights for policy 0, policy_version 1278540 (0.0008) [2023-12-28 04:26:50,372][106226] Updated weights for policy 0, policy_version 1278550 (0.0009) [2023-12-28 04:26:50,912][106225] Updated weights for policy 1, policy_version 1281778 (0.0011) [2023-12-28 04:26:50,977][106225] Updated weights for policy 1, policy_version 1281788 (0.0010) [2023-12-28 04:26:51,040][106225] Updated weights for policy 1, policy_version 1281798 (0.0010) [2023-12-28 04:26:51,045][106226] Updated weights for policy 0, policy_version 1278560 (0.0007) [2023-12-28 04:26:51,114][106226] Updated weights for policy 0, policy_version 1278570 (0.0008) [2023-12-28 04:26:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 655556608. Throughput: 0: 9751.8, 1: 10079.1. Samples: 655566740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:51,175][105115] Avg episode reward: [(0, '-3.849'), (1, '-5.206')] [2023-12-28 04:26:51,178][106226] Updated weights for policy 0, policy_version 1278580 (0.0007) [2023-12-28 04:26:51,843][106225] Updated weights for policy 1, policy_version 1281808 (0.0009) [2023-12-28 04:26:51,900][106225] Updated weights for policy 1, policy_version 1281818 (0.0009) [2023-12-28 04:26:51,955][106225] Updated weights for policy 1, policy_version 1281828 (0.0008) [2023-12-28 04:26:51,981][106226] Updated weights for policy 0, policy_version 1278590 (0.0006) [2023-12-28 04:26:52,037][106226] Updated weights for policy 0, policy_version 1278600 (0.0006) [2023-12-28 04:26:52,108][106226] Updated weights for policy 0, policy_version 1278610 (0.0006) [2023-12-28 04:26:52,658][106225] Updated weights for policy 1, policy_version 1281838 (0.0009) [2023-12-28 04:26:52,672][106226] Updated weights for policy 0, policy_version 1278620 (0.0005) [2023-12-28 04:26:52,719][106225] Updated weights for policy 1, policy_version 1281848 (0.0010) [2023-12-28 04:26:52,735][106226] Updated weights for policy 0, policy_version 1278630 (0.0009) [2023-12-28 04:26:52,781][106225] Updated weights for policy 1, policy_version 1281858 (0.0006) [2023-12-28 04:26:52,790][106226] Updated weights for policy 0, policy_version 1278640 (0.0011) [2023-12-28 04:26:53,445][106226] Updated weights for policy 0, policy_version 1278650 (0.0010) [2023-12-28 04:26:53,498][106226] Updated weights for policy 0, policy_version 1278660 (0.0005) [2023-12-28 04:26:53,518][106225] Updated weights for policy 1, policy_version 1281868 (0.0007) [2023-12-28 04:26:53,554][106226] Updated weights for policy 0, policy_version 1278670 (0.0005) [2023-12-28 04:26:53,578][106225] Updated weights for policy 1, policy_version 1281878 (0.0007) [2023-12-28 04:26:53,602][106226] Updated weights for policy 0, policy_version 1278680 (0.0005) [2023-12-28 04:26:53,633][106225] Updated weights for policy 1, policy_version 1281888 (0.0007) [2023-12-28 04:26:54,183][106226] Updated weights for policy 0, policy_version 1278690 (0.0008) [2023-12-28 04:26:54,240][106226] Updated weights for policy 0, policy_version 1278700 (0.0009) [2023-12-28 04:26:54,292][106226] Updated weights for policy 0, policy_version 1278710 (0.0008) [2023-12-28 04:26:54,372][106225] Updated weights for policy 1, policy_version 1281898 (0.0007) [2023-12-28 04:26:54,421][106225] Updated weights for policy 1, policy_version 1281908 (0.0008) [2023-12-28 04:26:54,484][106225] Updated weights for policy 1, policy_version 1281918 (0.0007) [2023-12-28 04:26:54,537][106225] Updated weights for policy 1, policy_version 1281928 (0.0008) [2023-12-28 04:26:55,029][106226] Updated weights for policy 0, policy_version 1278720 (0.0008) [2023-12-28 04:26:55,081][106226] Updated weights for policy 0, policy_version 1278730 (0.0008) [2023-12-28 04:26:55,132][106226] Updated weights for policy 0, policy_version 1278740 (0.0008) [2023-12-28 04:26:55,256][106225] Updated weights for policy 1, policy_version 1281938 (0.0008) [2023-12-28 04:26:55,301][106225] Updated weights for policy 1, policy_version 1281948 (0.0008) [2023-12-28 04:26:55,349][106225] Updated weights for policy 1, policy_version 1281958 (0.0008) [2023-12-28 04:26:55,871][106226] Updated weights for policy 0, policy_version 1278750 (0.0006) [2023-12-28 04:26:55,921][106226] Updated weights for policy 0, policy_version 1278760 (0.0005) [2023-12-28 04:26:55,983][106226] Updated weights for policy 0, policy_version 1278770 (0.0005) [2023-12-28 04:26:56,091][106225] Updated weights for policy 1, policy_version 1281968 (0.0009) [2023-12-28 04:26:56,145][106225] Updated weights for policy 1, policy_version 1281978 (0.0009) [2023-12-28 04:26:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 655654912. Throughput: 0: 9764.9, 1: 10042.5. Samples: 655626580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:26:56,176][105115] Avg episode reward: [(0, '-4.232'), (1, '-5.409')] [2023-12-28 04:26:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001278776_327426048.pth... [2023-12-28 04:26:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001277624_327131136.pth [2023-12-28 04:26:56,201][106225] Updated weights for policy 1, policy_version 1281988 (0.0008) [2023-12-28 04:26:56,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001281992_328237056.pth... [2023-12-28 04:26:56,225][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001280808_327933952.pth [2023-12-28 04:26:56,593][106226] Updated weights for policy 0, policy_version 1278780 (0.0006) [2023-12-28 04:26:56,645][106226] Updated weights for policy 0, policy_version 1278790 (0.0008) [2023-12-28 04:26:56,698][106226] Updated weights for policy 0, policy_version 1278800 (0.0008) [2023-12-28 04:26:56,929][106225] Updated weights for policy 1, policy_version 1281998 (0.0008) [2023-12-28 04:26:56,977][106225] Updated weights for policy 1, policy_version 1282008 (0.0008) [2023-12-28 04:26:57,029][106225] Updated weights for policy 1, policy_version 1282018 (0.0009) [2023-12-28 04:26:57,445][106226] Updated weights for policy 0, policy_version 1278810 (0.0008) [2023-12-28 04:26:57,495][106226] Updated weights for policy 0, policy_version 1278820 (0.0008) [2023-12-28 04:26:57,554][106226] Updated weights for policy 0, policy_version 1278830 (0.0008) [2023-12-28 04:26:57,606][106226] Updated weights for policy 0, policy_version 1278840 (0.0008) [2023-12-28 04:26:57,756][106225] Updated weights for policy 1, policy_version 1282028 (0.0008) [2023-12-28 04:26:57,806][106225] Updated weights for policy 1, policy_version 1282038 (0.0009) [2023-12-28 04:26:57,859][106225] Updated weights for policy 1, policy_version 1282048 (0.0008) [2023-12-28 04:26:58,256][106226] Updated weights for policy 0, policy_version 1278850 (0.0008) [2023-12-28 04:26:58,314][106226] Updated weights for policy 0, policy_version 1278860 (0.0008) [2023-12-28 04:26:58,383][106226] Updated weights for policy 0, policy_version 1278870 (0.0008) [2023-12-28 04:26:58,648][106225] Updated weights for policy 1, policy_version 1282059 (0.0009) [2023-12-28 04:26:58,723][106225] Updated weights for policy 1, policy_version 1282069 (0.0008) [2023-12-28 04:26:58,799][106225] Updated weights for policy 1, policy_version 1282079 (0.0009) [2023-12-28 04:26:59,232][106226] Updated weights for policy 0, policy_version 1278880 (0.0009) [2023-12-28 04:26:59,304][106226] Updated weights for policy 0, policy_version 1278890 (0.0008) [2023-12-28 04:26:59,372][106226] Updated weights for policy 0, policy_version 1278900 (0.0008) [2023-12-28 04:26:59,708][106225] Updated weights for policy 1, policy_version 1282089 (0.0009) [2023-12-28 04:26:59,790][106225] Updated weights for policy 1, policy_version 1282099 (0.0007) [2023-12-28 04:26:59,856][106225] Updated weights for policy 1, policy_version 1282109 (0.0008) [2023-12-28 04:26:59,922][106225] Updated weights for policy 1, policy_version 1282119 (0.0007) [2023-12-28 04:27:00,177][106226] Updated weights for policy 0, policy_version 1278910 (0.0012) [2023-12-28 04:27:00,238][106226] Updated weights for policy 0, policy_version 1278920 (0.0008) [2023-12-28 04:27:00,300][106226] Updated weights for policy 0, policy_version 1278930 (0.0009) [2023-12-28 04:27:00,567][106225] Updated weights for policy 1, policy_version 1282129 (0.0007) [2023-12-28 04:27:00,629][106225] Updated weights for policy 1, policy_version 1282139 (0.0005) [2023-12-28 04:27:00,682][106225] Updated weights for policy 1, policy_version 1282149 (0.0005) [2023-12-28 04:27:00,994][106226] Updated weights for policy 0, policy_version 1278940 (0.0008) [2023-12-28 04:27:01,061][106226] Updated weights for policy 0, policy_version 1278950 (0.0009) [2023-12-28 04:27:01,112][106226] Updated weights for policy 0, policy_version 1278960 (0.0008) [2023-12-28 04:27:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 655753216. Throughput: 0: 9793.7, 1: 9906.7. Samples: 655739796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:01,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.957')] [2023-12-28 04:27:01,376][106225] Updated weights for policy 1, policy_version 1282159 (0.0007) [2023-12-28 04:27:01,437][106225] Updated weights for policy 1, policy_version 1282169 (0.0008) [2023-12-28 04:27:01,491][106225] Updated weights for policy 1, policy_version 1282179 (0.0008) [2023-12-28 04:27:01,869][106226] Updated weights for policy 0, policy_version 1278970 (0.0008) [2023-12-28 04:27:01,936][106226] Updated weights for policy 0, policy_version 1278980 (0.0009) [2023-12-28 04:27:02,004][106226] Updated weights for policy 0, policy_version 1278990 (0.0007) [2023-12-28 04:27:02,070][106226] Updated weights for policy 0, policy_version 1279000 (0.0008) [2023-12-28 04:27:02,197][106225] Updated weights for policy 1, policy_version 1282189 (0.0008) [2023-12-28 04:27:02,255][106225] Updated weights for policy 1, policy_version 1282199 (0.0008) [2023-12-28 04:27:02,317][106225] Updated weights for policy 1, policy_version 1282209 (0.0008) [2023-12-28 04:27:02,760][106226] Updated weights for policy 0, policy_version 1279010 (0.0009) [2023-12-28 04:27:02,819][106226] Updated weights for policy 0, policy_version 1279020 (0.0008) [2023-12-28 04:27:02,880][106226] Updated weights for policy 0, policy_version 1279030 (0.0008) [2023-12-28 04:27:03,050][106225] Updated weights for policy 1, policy_version 1282219 (0.0008) [2023-12-28 04:27:03,102][106225] Updated weights for policy 1, policy_version 1282229 (0.0007) [2023-12-28 04:27:03,154][106225] Updated weights for policy 1, policy_version 1282239 (0.0010) [2023-12-28 04:27:03,493][106226] Updated weights for policy 0, policy_version 1279040 (0.0006) [2023-12-28 04:27:03,545][106226] Updated weights for policy 0, policy_version 1279050 (0.0005) [2023-12-28 04:27:03,594][106226] Updated weights for policy 0, policy_version 1279060 (0.0009) [2023-12-28 04:27:03,849][106225] Updated weights for policy 1, policy_version 1282249 (0.0010) [2023-12-28 04:27:03,912][106225] Updated weights for policy 1, policy_version 1282259 (0.0009) [2023-12-28 04:27:03,976][106225] Updated weights for policy 1, policy_version 1282269 (0.0009) [2023-12-28 04:27:04,039][106225] Updated weights for policy 1, policy_version 1282279 (0.0008) [2023-12-28 04:27:04,222][106226] Updated weights for policy 0, policy_version 1279070 (0.0008) [2023-12-28 04:27:04,284][106226] Updated weights for policy 0, policy_version 1279080 (0.0011) [2023-12-28 04:27:04,342][106226] Updated weights for policy 0, policy_version 1279090 (0.0011) [2023-12-28 04:27:04,834][106225] Updated weights for policy 1, policy_version 1282289 (0.0009) [2023-12-28 04:27:04,886][106225] Updated weights for policy 1, policy_version 1282299 (0.0008) [2023-12-28 04:27:04,935][106225] Updated weights for policy 1, policy_version 1282309 (0.0008) [2023-12-28 04:27:04,961][106226] Updated weights for policy 0, policy_version 1279100 (0.0007) [2023-12-28 04:27:05,025][106226] Updated weights for policy 0, policy_version 1279110 (0.0009) [2023-12-28 04:27:05,083][106226] Updated weights for policy 0, policy_version 1279120 (0.0011) [2023-12-28 04:27:05,575][106225] Updated weights for policy 1, policy_version 1282319 (0.0008) [2023-12-28 04:27:05,632][106225] Updated weights for policy 1, policy_version 1282329 (0.0008) [2023-12-28 04:27:05,690][106225] Updated weights for policy 1, policy_version 1282339 (0.0008) [2023-12-28 04:27:05,762][106226] Updated weights for policy 0, policy_version 1279130 (0.0011) [2023-12-28 04:27:05,828][106226] Updated weights for policy 0, policy_version 1279140 (0.0011) [2023-12-28 04:27:05,896][106226] Updated weights for policy 0, policy_version 1279150 (0.0011) [2023-12-28 04:27:05,956][106226] Updated weights for policy 0, policy_version 1279160 (0.0011) [2023-12-28 04:27:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 655851520. Throughput: 0: 9825.6, 1: 9884.4. Samples: 655859552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:06,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.163')] [2023-12-28 04:27:06,516][106225] Updated weights for policy 1, policy_version 1282349 (0.0008) [2023-12-28 04:27:06,552][106226] Updated weights for policy 0, policy_version 1279170 (0.0006) [2023-12-28 04:27:06,577][106225] Updated weights for policy 1, policy_version 1282359 (0.0009) [2023-12-28 04:27:06,614][106226] Updated weights for policy 0, policy_version 1279180 (0.0006) [2023-12-28 04:27:06,635][106225] Updated weights for policy 1, policy_version 1282369 (0.0007) [2023-12-28 04:27:06,680][106226] Updated weights for policy 0, policy_version 1279190 (0.0009) [2023-12-28 04:27:07,335][106226] Updated weights for policy 0, policy_version 1279200 (0.0009) [2023-12-28 04:27:07,387][106226] Updated weights for policy 0, policy_version 1279210 (0.0011) [2023-12-28 04:27:07,414][106225] Updated weights for policy 1, policy_version 1282379 (0.0008) [2023-12-28 04:27:07,439][106226] Updated weights for policy 0, policy_version 1279220 (0.0011) [2023-12-28 04:27:07,476][106225] Updated weights for policy 1, policy_version 1282389 (0.0006) [2023-12-28 04:27:07,534][106225] Updated weights for policy 1, policy_version 1282399 (0.0008) [2023-12-28 04:27:08,169][106226] Updated weights for policy 0, policy_version 1279230 (0.0011) [2023-12-28 04:27:08,222][106226] Updated weights for policy 0, policy_version 1279240 (0.0011) [2023-12-28 04:27:08,272][106225] Updated weights for policy 1, policy_version 1282409 (0.0008) [2023-12-28 04:27:08,272][106226] Updated weights for policy 0, policy_version 1279250 (0.0011) [2023-12-28 04:27:08,335][106225] Updated weights for policy 1, policy_version 1282419 (0.0007) [2023-12-28 04:27:08,400][106225] Updated weights for policy 1, policy_version 1282429 (0.0009) [2023-12-28 04:27:08,465][106225] Updated weights for policy 1, policy_version 1282439 (0.0007) [2023-12-28 04:27:08,940][106226] Updated weights for policy 0, policy_version 1279260 (0.0011) [2023-12-28 04:27:08,994][106226] Updated weights for policy 0, policy_version 1279270 (0.0011) [2023-12-28 04:27:09,063][106226] Updated weights for policy 0, policy_version 1279280 (0.0011) [2023-12-28 04:27:09,109][106225] Updated weights for policy 1, policy_version 1282449 (0.0005) [2023-12-28 04:27:09,174][106225] Updated weights for policy 1, policy_version 1282459 (0.0005) [2023-12-28 04:27:09,245][106225] Updated weights for policy 1, policy_version 1282469 (0.0007) [2023-12-28 04:27:09,852][106226] Updated weights for policy 0, policy_version 1279290 (0.0011) [2023-12-28 04:27:09,918][106226] Updated weights for policy 0, policy_version 1279300 (0.0009) [2023-12-28 04:27:09,947][106225] Updated weights for policy 1, policy_version 1282479 (0.0010) [2023-12-28 04:27:09,985][106226] Updated weights for policy 0, policy_version 1279310 (0.0009) [2023-12-28 04:27:10,009][106225] Updated weights for policy 1, policy_version 1282489 (0.0011) [2023-12-28 04:27:10,040][106226] Updated weights for policy 0, policy_version 1279320 (0.0009) [2023-12-28 04:27:10,069][106225] Updated weights for policy 1, policy_version 1282499 (0.0011) [2023-12-28 04:27:10,799][106225] Updated weights for policy 1, policy_version 1282509 (0.0009) [2023-12-28 04:27:10,835][106226] Updated weights for policy 0, policy_version 1279330 (0.0011) [2023-12-28 04:27:10,849][106225] Updated weights for policy 1, policy_version 1282519 (0.0010) [2023-12-28 04:27:10,898][106226] Updated weights for policy 0, policy_version 1279340 (0.0009) [2023-12-28 04:27:10,903][106225] Updated weights for policy 1, policy_version 1282529 (0.0010) [2023-12-28 04:27:10,954][106226] Updated weights for policy 0, policy_version 1279350 (0.0008) [2023-12-28 04:27:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 655949824. Throughput: 0: 9923.6, 1: 9837.9. Samples: 655918524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:11,176][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.262')] [2023-12-28 04:27:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001279352_327573504.pth... [2023-12-28 04:27:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001282536_328376320.pth... [2023-12-28 04:27:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001281416_328089600.pth [2023-12-28 04:27:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001278168_327270400.pth [2023-12-28 04:27:11,686][106226] Updated weights for policy 0, policy_version 1279360 (0.0010) [2023-12-28 04:27:11,704][106225] Updated weights for policy 1, policy_version 1282539 (0.0009) [2023-12-28 04:27:11,761][106226] Updated weights for policy 0, policy_version 1279370 (0.0011) [2023-12-28 04:27:11,773][106225] Updated weights for policy 1, policy_version 1282549 (0.0008) [2023-12-28 04:27:11,827][106226] Updated weights for policy 0, policy_version 1279380 (0.0011) [2023-12-28 04:27:11,830][106225] Updated weights for policy 1, policy_version 1282559 (0.0006) [2023-12-28 04:27:12,539][106225] Updated weights for policy 1, policy_version 1282569 (0.0006) [2023-12-28 04:27:12,559][106226] Updated weights for policy 0, policy_version 1279390 (0.0009) [2023-12-28 04:27:12,599][106225] Updated weights for policy 1, policy_version 1282579 (0.0007) [2023-12-28 04:27:12,612][106226] Updated weights for policy 0, policy_version 1279400 (0.0008) [2023-12-28 04:27:12,659][106225] Updated weights for policy 1, policy_version 1282589 (0.0007) [2023-12-28 04:27:12,664][106226] Updated weights for policy 0, policy_version 1279410 (0.0008) [2023-12-28 04:27:12,716][106225] Updated weights for policy 1, policy_version 1282599 (0.0007) [2023-12-28 04:27:13,371][106226] Updated weights for policy 0, policy_version 1279420 (0.0009) [2023-12-28 04:27:13,396][106225] Updated weights for policy 1, policy_version 1282609 (0.0006) [2023-12-28 04:27:13,429][106226] Updated weights for policy 0, policy_version 1279430 (0.0010) [2023-12-28 04:27:13,458][106225] Updated weights for policy 1, policy_version 1282619 (0.0005) [2023-12-28 04:27:13,486][106226] Updated weights for policy 0, policy_version 1279440 (0.0010) [2023-12-28 04:27:13,516][106225] Updated weights for policy 1, policy_version 1282629 (0.0005) [2023-12-28 04:27:14,118][106226] Updated weights for policy 0, policy_version 1279450 (0.0009) [2023-12-28 04:27:14,137][106225] Updated weights for policy 1, policy_version 1282639 (0.0006) [2023-12-28 04:27:14,174][106226] Updated weights for policy 0, policy_version 1279460 (0.0008) [2023-12-28 04:27:14,191][106225] Updated weights for policy 1, policy_version 1282649 (0.0007) [2023-12-28 04:27:14,231][106226] Updated weights for policy 0, policy_version 1279470 (0.0006) [2023-12-28 04:27:14,245][106225] Updated weights for policy 1, policy_version 1282659 (0.0006) [2023-12-28 04:27:14,291][106226] Updated weights for policy 0, policy_version 1279480 (0.0007) [2023-12-28 04:27:14,930][106225] Updated weights for policy 1, policy_version 1282669 (0.0008) [2023-12-28 04:27:14,998][106225] Updated weights for policy 1, policy_version 1282679 (0.0010) [2023-12-28 04:27:15,001][106226] Updated weights for policy 0, policy_version 1279490 (0.0007) [2023-12-28 04:27:15,069][106226] Updated weights for policy 0, policy_version 1279500 (0.0009) [2023-12-28 04:27:15,070][106225] Updated weights for policy 1, policy_version 1282689 (0.0010) [2023-12-28 04:27:15,139][106226] Updated weights for policy 0, policy_version 1279510 (0.0007) [2023-12-28 04:27:15,793][106225] Updated weights for policy 1, policy_version 1282699 (0.0010) [2023-12-28 04:27:15,814][106226] Updated weights for policy 0, policy_version 1279520 (0.0006) [2023-12-28 04:27:15,857][106225] Updated weights for policy 1, policy_version 1282709 (0.0010) [2023-12-28 04:27:15,878][106226] Updated weights for policy 0, policy_version 1279530 (0.0005) [2023-12-28 04:27:15,905][106225] Updated weights for policy 1, policy_version 1282719 (0.0010) [2023-12-28 04:27:15,944][106226] Updated weights for policy 0, policy_version 1279540 (0.0007) [2023-12-28 04:27:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 656048128. Throughput: 0: 9917.9, 1: 9772.4. Samples: 656034256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:16,176][105115] Avg episode reward: [(0, '-4.396'), (1, '-5.016')] [2023-12-28 04:27:16,529][106225] Updated weights for policy 1, policy_version 1282729 (0.0010) [2023-12-28 04:27:16,541][106226] Updated weights for policy 0, policy_version 1279550 (0.0008) [2023-12-28 04:27:16,589][106225] Updated weights for policy 1, policy_version 1282739 (0.0006) [2023-12-28 04:27:16,604][106226] Updated weights for policy 0, policy_version 1279560 (0.0008) [2023-12-28 04:27:16,652][106225] Updated weights for policy 1, policy_version 1282749 (0.0005) [2023-12-28 04:27:16,663][106226] Updated weights for policy 0, policy_version 1279570 (0.0007) [2023-12-28 04:27:16,707][106225] Updated weights for policy 1, policy_version 1282759 (0.0006) [2023-12-28 04:27:17,333][106225] Updated weights for policy 1, policy_version 1282769 (0.0010) [2023-12-28 04:27:17,397][106225] Updated weights for policy 1, policy_version 1282779 (0.0007) [2023-12-28 04:27:17,411][106226] Updated weights for policy 0, policy_version 1279580 (0.0007) [2023-12-28 04:27:17,444][106225] Updated weights for policy 1, policy_version 1282789 (0.0008) [2023-12-28 04:27:17,459][106226] Updated weights for policy 0, policy_version 1279590 (0.0010) [2023-12-28 04:27:17,505][106226] Updated weights for policy 0, policy_version 1279600 (0.0008) [2023-12-28 04:27:18,136][106225] Updated weights for policy 1, policy_version 1282799 (0.0009) [2023-12-28 04:27:18,189][106225] Updated weights for policy 1, policy_version 1282809 (0.0009) [2023-12-28 04:27:18,217][106226] Updated weights for policy 0, policy_version 1279610 (0.0008) [2023-12-28 04:27:18,251][106225] Updated weights for policy 1, policy_version 1282819 (0.0006) [2023-12-28 04:27:18,275][106226] Updated weights for policy 0, policy_version 1279620 (0.0008) [2023-12-28 04:27:18,332][106226] Updated weights for policy 0, policy_version 1279630 (0.0008) [2023-12-28 04:27:18,391][106226] Updated weights for policy 0, policy_version 1279640 (0.0008) [2023-12-28 04:27:18,935][106225] Updated weights for policy 1, policy_version 1282829 (0.0007) [2023-12-28 04:27:18,983][106225] Updated weights for policy 1, policy_version 1282839 (0.0008) [2023-12-28 04:27:19,035][106225] Updated weights for policy 1, policy_version 1282849 (0.0008) [2023-12-28 04:27:19,158][106226] Updated weights for policy 0, policy_version 1279650 (0.0008) [2023-12-28 04:27:19,226][106226] Updated weights for policy 0, policy_version 1279660 (0.0008) [2023-12-28 04:27:19,289][106226] Updated weights for policy 0, policy_version 1279670 (0.0009) [2023-12-28 04:27:19,845][106225] Updated weights for policy 1, policy_version 1282859 (0.0008) [2023-12-28 04:27:19,904][106225] Updated weights for policy 1, policy_version 1282869 (0.0006) [2023-12-28 04:27:19,970][106225] Updated weights for policy 1, policy_version 1282879 (0.0008) [2023-12-28 04:27:20,023][106226] Updated weights for policy 0, policy_version 1279680 (0.0009) [2023-12-28 04:27:20,081][106226] Updated weights for policy 0, policy_version 1279690 (0.0007) [2023-12-28 04:27:20,145][106226] Updated weights for policy 0, policy_version 1279700 (0.0006) [2023-12-28 04:27:20,690][106225] Updated weights for policy 1, policy_version 1282889 (0.0008) [2023-12-28 04:27:20,751][106225] Updated weights for policy 1, policy_version 1282899 (0.0006) [2023-12-28 04:27:20,812][106225] Updated weights for policy 1, policy_version 1282909 (0.0007) [2023-12-28 04:27:20,863][106226] Updated weights for policy 0, policy_version 1279710 (0.0006) [2023-12-28 04:27:20,875][106225] Updated weights for policy 1, policy_version 1282919 (0.0010) [2023-12-28 04:27:20,928][106226] Updated weights for policy 0, policy_version 1279720 (0.0008) [2023-12-28 04:27:20,988][106226] Updated weights for policy 0, policy_version 1279730 (0.0008) [2023-12-28 04:27:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 656146432. Throughput: 0: 9859.8, 1: 9822.5. Samples: 656152780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:21,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-5.118')] [2023-12-28 04:27:21,589][106225] Updated weights for policy 1, policy_version 1282929 (0.0006) [2023-12-28 04:27:21,656][106225] Updated weights for policy 1, policy_version 1282939 (0.0007) [2023-12-28 04:27:21,682][106226] Updated weights for policy 0, policy_version 1279740 (0.0008) [2023-12-28 04:27:21,714][106225] Updated weights for policy 1, policy_version 1282949 (0.0008) [2023-12-28 04:27:21,751][106226] Updated weights for policy 0, policy_version 1279750 (0.0009) [2023-12-28 04:27:21,820][106226] Updated weights for policy 0, policy_version 1279760 (0.0009) [2023-12-28 04:27:22,386][106225] Updated weights for policy 1, policy_version 1282959 (0.0008) [2023-12-28 04:27:22,455][106225] Updated weights for policy 1, policy_version 1282969 (0.0008) [2023-12-28 04:27:22,511][106225] Updated weights for policy 1, policy_version 1282979 (0.0008) [2023-12-28 04:27:22,556][106226] Updated weights for policy 0, policy_version 1279770 (0.0008) [2023-12-28 04:27:22,618][106226] Updated weights for policy 0, policy_version 1279780 (0.0008) [2023-12-28 04:27:22,678][106226] Updated weights for policy 0, policy_version 1279790 (0.0009) [2023-12-28 04:27:22,738][106226] Updated weights for policy 0, policy_version 1279800 (0.0009) [2023-12-28 04:27:23,244][106225] Updated weights for policy 1, policy_version 1282989 (0.0008) [2023-12-28 04:27:23,306][106225] Updated weights for policy 1, policy_version 1282999 (0.0007) [2023-12-28 04:27:23,368][106225] Updated weights for policy 1, policy_version 1283009 (0.0008) [2023-12-28 04:27:23,493][106226] Updated weights for policy 0, policy_version 1279810 (0.0006) [2023-12-28 04:27:23,555][106226] Updated weights for policy 0, policy_version 1279820 (0.0009) [2023-12-28 04:27:23,613][106226] Updated weights for policy 0, policy_version 1279830 (0.0010) [2023-12-28 04:27:24,092][106225] Updated weights for policy 1, policy_version 1283019 (0.0008) [2023-12-28 04:27:24,149][106225] Updated weights for policy 1, policy_version 1283029 (0.0007) [2023-12-28 04:27:24,197][106225] Updated weights for policy 1, policy_version 1283039 (0.0008) [2023-12-28 04:27:24,256][106226] Updated weights for policy 0, policy_version 1279840 (0.0010) [2023-12-28 04:27:24,307][106226] Updated weights for policy 0, policy_version 1279850 (0.0010) [2023-12-28 04:27:24,364][106226] Updated weights for policy 0, policy_version 1279860 (0.0010) [2023-12-28 04:27:24,915][106225] Updated weights for policy 1, policy_version 1283049 (0.0008) [2023-12-28 04:27:24,974][106225] Updated weights for policy 1, policy_version 1283059 (0.0007) [2023-12-28 04:27:25,037][106225] Updated weights for policy 1, policy_version 1283069 (0.0007) [2023-12-28 04:27:25,052][106226] Updated weights for policy 0, policy_version 1279870 (0.0010) [2023-12-28 04:27:25,097][106225] Updated weights for policy 1, policy_version 1283079 (0.0005) [2023-12-28 04:27:25,109][106226] Updated weights for policy 0, policy_version 1279880 (0.0010) [2023-12-28 04:27:25,162][106226] Updated weights for policy 0, policy_version 1279890 (0.0011) [2023-12-28 04:27:25,711][106225] Updated weights for policy 1, policy_version 1283089 (0.0005) [2023-12-28 04:27:25,773][106225] Updated weights for policy 1, policy_version 1283099 (0.0007) [2023-12-28 04:27:25,824][106225] Updated weights for policy 1, policy_version 1283109 (0.0010) [2023-12-28 04:27:25,871][106226] Updated weights for policy 0, policy_version 1279900 (0.0010) [2023-12-28 04:27:25,937][106226] Updated weights for policy 0, policy_version 1279910 (0.0011) [2023-12-28 04:27:26,004][106226] Updated weights for policy 0, policy_version 1279920 (0.0010) [2023-12-28 04:27:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 656244736. Throughput: 0: 9881.1, 1: 9727.8. Samples: 656210332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:27:26,175][105115] Avg episode reward: [(0, '-4.212'), (1, '-4.912')] [2023-12-28 04:27:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001279928_327720960.pth... [2023-12-28 04:27:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001283112_328523776.pth... [2023-12-28 04:27:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001278776_327426048.pth [2023-12-28 04:27:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001281992_328237056.pth [2023-12-28 04:27:26,369][106225] Updated weights for policy 1, policy_version 1283119 (0.0007) [2023-12-28 04:27:26,415][106225] Updated weights for policy 1, policy_version 1283129 (0.0005) [2023-12-28 04:27:26,473][106225] Updated weights for policy 1, policy_version 1283139 (0.0006) [2023-12-28 04:27:26,684][106226] Updated weights for policy 0, policy_version 1279930 (0.0011) [2023-12-28 04:27:26,733][106226] Updated weights for policy 0, policy_version 1279940 (0.0010) [2023-12-28 04:27:26,779][106226] Updated weights for policy 0, policy_version 1279950 (0.0010) [2023-12-28 04:27:26,832][106226] Updated weights for policy 0, policy_version 1279960 (0.0010) [2023-12-28 04:27:27,043][106225] Updated weights for policy 1, policy_version 1283149 (0.0006) [2023-12-28 04:27:27,098][106225] Updated weights for policy 1, policy_version 1283159 (0.0005) [2023-12-28 04:27:27,150][106225] Updated weights for policy 1, policy_version 1283169 (0.0005) [2023-12-28 04:27:27,548][106226] Updated weights for policy 0, policy_version 1279970 (0.0010) [2023-12-28 04:27:27,607][106226] Updated weights for policy 0, policy_version 1279980 (0.0010) [2023-12-28 04:27:27,662][106226] Updated weights for policy 0, policy_version 1279990 (0.0010) [2023-12-28 04:27:27,799][106225] Updated weights for policy 1, policy_version 1283179 (0.0007) [2023-12-28 04:27:27,857][106225] Updated weights for policy 1, policy_version 1283189 (0.0010) [2023-12-28 04:27:27,906][106225] Updated weights for policy 1, policy_version 1283199 (0.0010) [2023-12-28 04:27:28,374][106226] Updated weights for policy 0, policy_version 1280000 (0.0009) [2023-12-28 04:27:28,435][106226] Updated weights for policy 0, policy_version 1280010 (0.0007) [2023-12-28 04:27:28,493][106226] Updated weights for policy 0, policy_version 1280020 (0.0006) [2023-12-28 04:27:28,623][106225] Updated weights for policy 1, policy_version 1283209 (0.0009) [2023-12-28 04:27:28,674][106225] Updated weights for policy 1, policy_version 1283219 (0.0005) [2023-12-28 04:27:28,735][106225] Updated weights for policy 1, policy_version 1283229 (0.0006) [2023-12-28 04:27:28,795][106225] Updated weights for policy 1, policy_version 1283239 (0.0009) [2023-12-28 04:27:29,150][106226] Updated weights for policy 0, policy_version 1280030 (0.0008) [2023-12-28 04:27:29,208][106226] Updated weights for policy 0, policy_version 1280040 (0.0010) [2023-12-28 04:27:29,280][106226] Updated weights for policy 0, policy_version 1280050 (0.0008) [2023-12-28 04:27:29,431][106225] Updated weights for policy 1, policy_version 1283249 (0.0006) [2023-12-28 04:27:29,488][106225] Updated weights for policy 1, policy_version 1283259 (0.0006) [2023-12-28 04:27:29,550][106225] Updated weights for policy 1, policy_version 1283269 (0.0007) [2023-12-28 04:27:30,047][106226] Updated weights for policy 0, policy_version 1280060 (0.0010) [2023-12-28 04:27:30,117][106226] Updated weights for policy 0, policy_version 1280070 (0.0011) [2023-12-28 04:27:30,184][106226] Updated weights for policy 0, policy_version 1280080 (0.0010) [2023-12-28 04:27:30,188][106225] Updated weights for policy 1, policy_version 1283279 (0.0007) [2023-12-28 04:27:30,247][106225] Updated weights for policy 1, policy_version 1283289 (0.0008) [2023-12-28 04:27:30,312][106225] Updated weights for policy 1, policy_version 1283299 (0.0008) [2023-12-28 04:27:30,897][106226] Updated weights for policy 0, policy_version 1280090 (0.0008) [2023-12-28 04:27:30,965][106226] Updated weights for policy 0, policy_version 1280100 (0.0009) [2023-12-28 04:27:30,976][106225] Updated weights for policy 1, policy_version 1283309 (0.0007) [2023-12-28 04:27:31,032][106225] Updated weights for policy 1, policy_version 1283319 (0.0006) [2023-12-28 04:27:31,035][106226] Updated weights for policy 0, policy_version 1280110 (0.0008) [2023-12-28 04:27:31,094][106225] Updated weights for policy 1, policy_version 1283329 (0.0007) [2023-12-28 04:27:31,102][106226] Updated weights for policy 0, policy_version 1280120 (0.0008) [2023-12-28 04:27:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 656351232. Throughput: 0: 9951.1, 1: 9795.0. Samples: 656334468. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:31,175][105115] Avg episode reward: [(0, '-4.233'), (1, '-5.101')] [2023-12-28 04:27:31,830][106225] Updated weights for policy 1, policy_version 1283339 (0.0008) [2023-12-28 04:27:31,875][106226] Updated weights for policy 0, policy_version 1280130 (0.0006) [2023-12-28 04:27:31,891][106225] Updated weights for policy 1, policy_version 1283349 (0.0008) [2023-12-28 04:27:31,935][106226] Updated weights for policy 0, policy_version 1280140 (0.0005) [2023-12-28 04:27:31,948][106225] Updated weights for policy 1, policy_version 1283359 (0.0009) [2023-12-28 04:27:31,996][106226] Updated weights for policy 0, policy_version 1280150 (0.0006) [2023-12-28 04:27:32,638][106225] Updated weights for policy 1, policy_version 1283369 (0.0010) [2023-12-28 04:27:32,690][106225] Updated weights for policy 1, policy_version 1283379 (0.0007) [2023-12-28 04:27:32,704][106226] Updated weights for policy 0, policy_version 1280160 (0.0008) [2023-12-28 04:27:32,741][106225] Updated weights for policy 1, policy_version 1283389 (0.0007) [2023-12-28 04:27:32,765][106226] Updated weights for policy 0, policy_version 1280170 (0.0008) [2023-12-28 04:27:32,789][106225] Updated weights for policy 1, policy_version 1283399 (0.0009) [2023-12-28 04:27:32,823][106226] Updated weights for policy 0, policy_version 1280180 (0.0007) [2023-12-28 04:27:33,476][106225] Updated weights for policy 1, policy_version 1283409 (0.0008) [2023-12-28 04:27:33,535][106225] Updated weights for policy 1, policy_version 1283419 (0.0008) [2023-12-28 04:27:33,548][106226] Updated weights for policy 0, policy_version 1280190 (0.0009) [2023-12-28 04:27:33,596][106225] Updated weights for policy 1, policy_version 1283429 (0.0005) [2023-12-28 04:27:33,611][106226] Updated weights for policy 0, policy_version 1280200 (0.0009) [2023-12-28 04:27:33,676][106226] Updated weights for policy 0, policy_version 1280210 (0.0008) [2023-12-28 04:27:34,264][106225] Updated weights for policy 1, policy_version 1283439 (0.0009) [2023-12-28 04:27:34,313][106226] Updated weights for policy 0, policy_version 1280220 (0.0008) [2023-12-28 04:27:34,316][106225] Updated weights for policy 1, policy_version 1283449 (0.0010) [2023-12-28 04:27:34,368][106225] Updated weights for policy 1, policy_version 1283459 (0.0010) [2023-12-28 04:27:34,372][106226] Updated weights for policy 0, policy_version 1280230 (0.0006) [2023-12-28 04:27:34,433][106226] Updated weights for policy 0, policy_version 1280240 (0.0007) [2023-12-28 04:27:35,003][106225] Updated weights for policy 1, policy_version 1283469 (0.0007) [2023-12-28 04:27:35,057][106225] Updated weights for policy 1, policy_version 1283479 (0.0009) [2023-12-28 04:27:35,091][106226] Updated weights for policy 0, policy_version 1280250 (0.0006) [2023-12-28 04:27:35,104][106225] Updated weights for policy 1, policy_version 1283489 (0.0009) [2023-12-28 04:27:35,143][106226] Updated weights for policy 0, policy_version 1280260 (0.0005) [2023-12-28 04:27:35,204][106226] Updated weights for policy 0, policy_version 1280270 (0.0007) [2023-12-28 04:27:35,261][106226] Updated weights for policy 0, policy_version 1280280 (0.0009) [2023-12-28 04:27:35,698][106225] Updated weights for policy 1, policy_version 1283499 (0.0006) [2023-12-28 04:27:35,749][106225] Updated weights for policy 1, policy_version 1283509 (0.0007) [2023-12-28 04:27:35,801][106225] Updated weights for policy 1, policy_version 1283519 (0.0008) [2023-12-28 04:27:35,896][106226] Updated weights for policy 0, policy_version 1280290 (0.0009) [2023-12-28 04:27:35,947][106226] Updated weights for policy 0, policy_version 1280300 (0.0006) [2023-12-28 04:27:35,993][106226] Updated weights for policy 0, policy_version 1280310 (0.0010) [2023-12-28 04:27:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 656449536. Throughput: 0: 9888.4, 1: 9868.9. Samples: 656455816. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:36,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.933')] [2023-12-28 04:27:36,501][106225] Updated weights for policy 1, policy_version 1283529 (0.0008) [2023-12-28 04:27:36,562][106225] Updated weights for policy 1, policy_version 1283539 (0.0008) [2023-12-28 04:27:36,625][106225] Updated weights for policy 1, policy_version 1283549 (0.0008) [2023-12-28 04:27:36,655][106226] Updated weights for policy 0, policy_version 1280320 (0.0009) [2023-12-28 04:27:36,683][106225] Updated weights for policy 1, policy_version 1283559 (0.0006) [2023-12-28 04:27:36,721][106226] Updated weights for policy 0, policy_version 1280330 (0.0007) [2023-12-28 04:27:36,788][106226] Updated weights for policy 0, policy_version 1280340 (0.0009) [2023-12-28 04:27:37,413][106226] Updated weights for policy 0, policy_version 1280350 (0.0009) [2023-12-28 04:27:37,470][106226] Updated weights for policy 0, policy_version 1280360 (0.0005) [2023-12-28 04:27:37,471][106225] Updated weights for policy 1, policy_version 1283569 (0.0008) [2023-12-28 04:27:37,532][106226] Updated weights for policy 0, policy_version 1280370 (0.0005) [2023-12-28 04:27:37,533][106225] Updated weights for policy 1, policy_version 1283579 (0.0008) [2023-12-28 04:27:37,597][106225] Updated weights for policy 1, policy_version 1283589 (0.0007) [2023-12-28 04:27:38,159][106226] Updated weights for policy 0, policy_version 1280380 (0.0007) [2023-12-28 04:27:38,210][106226] Updated weights for policy 0, policy_version 1280390 (0.0008) [2023-12-28 04:27:38,265][106226] Updated weights for policy 0, policy_version 1280400 (0.0009) [2023-12-28 04:27:38,310][106225] Updated weights for policy 1, policy_version 1283599 (0.0005) [2023-12-28 04:27:38,374][106225] Updated weights for policy 1, policy_version 1283609 (0.0008) [2023-12-28 04:27:38,433][106225] Updated weights for policy 1, policy_version 1283619 (0.0008) [2023-12-28 04:27:39,024][106226] Updated weights for policy 0, policy_version 1280410 (0.0008) [2023-12-28 04:27:39,086][106226] Updated weights for policy 0, policy_version 1280420 (0.0009) [2023-12-28 04:27:39,141][106226] Updated weights for policy 0, policy_version 1280430 (0.0008) [2023-12-28 04:27:39,172][106225] Updated weights for policy 1, policy_version 1283629 (0.0007) [2023-12-28 04:27:39,186][106226] Updated weights for policy 0, policy_version 1280440 (0.0006) [2023-12-28 04:27:39,233][106225] Updated weights for policy 1, policy_version 1283639 (0.0008) [2023-12-28 04:27:39,298][106225] Updated weights for policy 1, policy_version 1283649 (0.0008) [2023-12-28 04:27:39,997][106226] Updated weights for policy 0, policy_version 1280450 (0.0008) [2023-12-28 04:27:40,057][106226] Updated weights for policy 0, policy_version 1280460 (0.0008) [2023-12-28 04:27:40,086][106225] Updated weights for policy 1, policy_version 1283659 (0.0009) [2023-12-28 04:27:40,120][106226] Updated weights for policy 0, policy_version 1280470 (0.0007) [2023-12-28 04:27:40,153][106225] Updated weights for policy 1, policy_version 1283669 (0.0008) [2023-12-28 04:27:40,215][106225] Updated weights for policy 1, policy_version 1283679 (0.0008) [2023-12-28 04:27:40,876][106226] Updated weights for policy 0, policy_version 1280480 (0.0008) [2023-12-28 04:27:40,880][106225] Updated weights for policy 1, policy_version 1283689 (0.0008) [2023-12-28 04:27:40,931][106225] Updated weights for policy 1, policy_version 1283699 (0.0007) [2023-12-28 04:27:40,936][106226] Updated weights for policy 0, policy_version 1280490 (0.0008) [2023-12-28 04:27:40,988][106225] Updated weights for policy 1, policy_version 1283709 (0.0008) [2023-12-28 04:27:40,993][106226] Updated weights for policy 0, policy_version 1280500 (0.0010) [2023-12-28 04:27:41,055][106225] Updated weights for policy 1, policy_version 1283719 (0.0008) [2023-12-28 04:27:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 656547840. Throughput: 0: 9865.7, 1: 9869.3. Samples: 656514652. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:41,175][105115] Avg episode reward: [(0, '-4.100'), (1, '-4.940')] [2023-12-28 04:27:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001283720_328679424.pth... [2023-12-28 04:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001280504_327868416.pth... [2023-12-28 04:27:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001282536_328376320.pth [2023-12-28 04:27:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001279352_327573504.pth [2023-12-28 04:27:41,774][106226] Updated weights for policy 0, policy_version 1280510 (0.0008) [2023-12-28 04:27:41,832][106226] Updated weights for policy 0, policy_version 1280520 (0.0009) [2023-12-28 04:27:41,894][106226] Updated weights for policy 0, policy_version 1280530 (0.0009) [2023-12-28 04:27:41,912][106225] Updated weights for policy 1, policy_version 1283729 (0.0006) [2023-12-28 04:27:41,968][106225] Updated weights for policy 1, policy_version 1283739 (0.0005) [2023-12-28 04:27:42,031][106225] Updated weights for policy 1, policy_version 1283749 (0.0006) [2023-12-28 04:27:42,570][106226] Updated weights for policy 0, policy_version 1280540 (0.0006) [2023-12-28 04:27:42,633][106226] Updated weights for policy 0, policy_version 1280550 (0.0006) [2023-12-28 04:27:42,696][106226] Updated weights for policy 0, policy_version 1280560 (0.0007) [2023-12-28 04:27:42,764][106225] Updated weights for policy 1, policy_version 1283759 (0.0008) [2023-12-28 04:27:42,816][106225] Updated weights for policy 1, policy_version 1283769 (0.0008) [2023-12-28 04:27:42,860][106225] Updated weights for policy 1, policy_version 1283779 (0.0007) [2023-12-28 04:27:43,301][106226] Updated weights for policy 0, policy_version 1280570 (0.0010) [2023-12-28 04:27:43,349][106226] Updated weights for policy 0, policy_version 1280580 (0.0005) [2023-12-28 04:27:43,404][106226] Updated weights for policy 0, policy_version 1280590 (0.0005) [2023-12-28 04:27:43,453][106226] Updated weights for policy 0, policy_version 1280600 (0.0005) [2023-12-28 04:27:43,638][106225] Updated weights for policy 1, policy_version 1283789 (0.0008) [2023-12-28 04:27:43,697][106225] Updated weights for policy 1, policy_version 1283799 (0.0008) [2023-12-28 04:27:43,755][106225] Updated weights for policy 1, policy_version 1283809 (0.0009) [2023-12-28 04:27:44,028][106226] Updated weights for policy 0, policy_version 1280610 (0.0009) [2023-12-28 04:27:44,075][106226] Updated weights for policy 0, policy_version 1280620 (0.0009) [2023-12-28 04:27:44,128][106226] Updated weights for policy 0, policy_version 1280630 (0.0008) [2023-12-28 04:27:44,517][106225] Updated weights for policy 1, policy_version 1283819 (0.0008) [2023-12-28 04:27:44,572][106225] Updated weights for policy 1, policy_version 1283829 (0.0010) [2023-12-28 04:27:44,626][106225] Updated weights for policy 1, policy_version 1283839 (0.0010) [2023-12-28 04:27:44,838][106226] Updated weights for policy 0, policy_version 1280640 (0.0008) [2023-12-28 04:27:44,900][106226] Updated weights for policy 0, policy_version 1280650 (0.0007) [2023-12-28 04:27:44,966][106226] Updated weights for policy 0, policy_version 1280660 (0.0009) [2023-12-28 04:27:45,340][106225] Updated weights for policy 1, policy_version 1283849 (0.0010) [2023-12-28 04:27:45,401][106225] Updated weights for policy 1, policy_version 1283859 (0.0008) [2023-12-28 04:27:45,454][106225] Updated weights for policy 1, policy_version 1283869 (0.0007) [2023-12-28 04:27:45,511][106225] Updated weights for policy 1, policy_version 1283879 (0.0005) [2023-12-28 04:27:45,744][106226] Updated weights for policy 0, policy_version 1280670 (0.0010) [2023-12-28 04:27:45,801][106226] Updated weights for policy 0, policy_version 1280680 (0.0008) [2023-12-28 04:27:45,861][106226] Updated weights for policy 0, policy_version 1280690 (0.0009) [2023-12-28 04:27:46,116][106225] Updated weights for policy 1, policy_version 1283889 (0.0007) [2023-12-28 04:27:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 656637952. Throughput: 0: 9901.1, 1: 9870.6. Samples: 656629524. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:46,175][105115] Avg episode reward: [(0, '-4.036'), (1, '-4.866')] [2023-12-28 04:27:46,178][106225] Updated weights for policy 1, policy_version 1283899 (0.0008) [2023-12-28 04:27:46,243][106225] Updated weights for policy 1, policy_version 1283909 (0.0009) [2023-12-28 04:27:46,543][106226] Updated weights for policy 0, policy_version 1280700 (0.0005) [2023-12-28 04:27:46,604][106226] Updated weights for policy 0, policy_version 1280710 (0.0005) [2023-12-28 04:27:46,668][106226] Updated weights for policy 0, policy_version 1280720 (0.0006) [2023-12-28 04:27:46,835][106225] Updated weights for policy 1, policy_version 1283919 (0.0007) [2023-12-28 04:27:46,886][106225] Updated weights for policy 1, policy_version 1283929 (0.0005) [2023-12-28 04:27:46,953][106225] Updated weights for policy 1, policy_version 1283939 (0.0005) [2023-12-28 04:27:47,266][106226] Updated weights for policy 0, policy_version 1280730 (0.0007) [2023-12-28 04:27:47,310][106226] Updated weights for policy 0, policy_version 1280740 (0.0009) [2023-12-28 04:27:47,363][106226] Updated weights for policy 0, policy_version 1280750 (0.0005) [2023-12-28 04:27:47,414][106226] Updated weights for policy 0, policy_version 1280760 (0.0008) [2023-12-28 04:27:47,528][106225] Updated weights for policy 1, policy_version 1283949 (0.0008) [2023-12-28 04:27:47,578][106225] Updated weights for policy 1, policy_version 1283959 (0.0010) [2023-12-28 04:27:47,634][106225] Updated weights for policy 1, policy_version 1283969 (0.0010) [2023-12-28 04:27:48,063][106226] Updated weights for policy 0, policy_version 1280770 (0.0010) [2023-12-28 04:27:48,112][106226] Updated weights for policy 0, policy_version 1280780 (0.0010) [2023-12-28 04:27:48,169][106226] Updated weights for policy 0, policy_version 1280790 (0.0011) [2023-12-28 04:27:48,198][106225] Updated weights for policy 1, policy_version 1283979 (0.0009) [2023-12-28 04:27:48,260][106225] Updated weights for policy 1, policy_version 1283989 (0.0005) [2023-12-28 04:27:48,330][106225] Updated weights for policy 1, policy_version 1283999 (0.0006) [2023-12-28 04:27:48,907][106226] Updated weights for policy 0, policy_version 1280800 (0.0008) [2023-12-28 04:27:48,951][106226] Updated weights for policy 0, policy_version 1280810 (0.0008) [2023-12-28 04:27:48,977][106225] Updated weights for policy 1, policy_version 1284009 (0.0006) [2023-12-28 04:27:48,999][106226] Updated weights for policy 0, policy_version 1280820 (0.0006) [2023-12-28 04:27:49,028][106225] Updated weights for policy 1, policy_version 1284019 (0.0010) [2023-12-28 04:27:49,094][106225] Updated weights for policy 1, policy_version 1284029 (0.0010) [2023-12-28 04:27:49,144][106225] Updated weights for policy 1, policy_version 1284039 (0.0010) [2023-12-28 04:27:49,798][106226] Updated weights for policy 0, policy_version 1280830 (0.0007) [2023-12-28 04:27:49,868][106226] Updated weights for policy 0, policy_version 1280840 (0.0008) [2023-12-28 04:27:49,910][106225] Updated weights for policy 1, policy_version 1284049 (0.0009) [2023-12-28 04:27:49,933][106226] Updated weights for policy 0, policy_version 1280850 (0.0009) [2023-12-28 04:27:49,979][106225] Updated weights for policy 1, policy_version 1284059 (0.0010) [2023-12-28 04:27:50,038][106225] Updated weights for policy 1, policy_version 1284069 (0.0010) [2023-12-28 04:27:50,613][106226] Updated weights for policy 0, policy_version 1280860 (0.0008) [2023-12-28 04:27:50,672][106226] Updated weights for policy 0, policy_version 1280870 (0.0009) [2023-12-28 04:27:50,730][106226] Updated weights for policy 0, policy_version 1280880 (0.0009) [2023-12-28 04:27:50,821][106225] Updated weights for policy 1, policy_version 1284079 (0.0008) [2023-12-28 04:27:50,879][106225] Updated weights for policy 1, policy_version 1284089 (0.0009) [2023-12-28 04:27:50,936][106225] Updated weights for policy 1, policy_version 1284099 (0.0009) [2023-12-28 04:27:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 656744448. Throughput: 0: 9861.9, 1: 9959.2. Samples: 656751500. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:51,175][105115] Avg episode reward: [(0, '-4.166'), (1, '-5.395')] [2023-12-28 04:27:51,457][106226] Updated weights for policy 0, policy_version 1280891 (0.0008) [2023-12-28 04:27:51,516][106226] Updated weights for policy 0, policy_version 1280901 (0.0005) [2023-12-28 04:27:51,579][106226] Updated weights for policy 0, policy_version 1280911 (0.0007) [2023-12-28 04:27:51,717][106225] Updated weights for policy 1, policy_version 1284109 (0.0009) [2023-12-28 04:27:51,786][106225] Updated weights for policy 1, policy_version 1284119 (0.0010) [2023-12-28 04:27:51,849][106225] Updated weights for policy 1, policy_version 1284129 (0.0009) [2023-12-28 04:27:52,252][106226] Updated weights for policy 0, policy_version 1280921 (0.0008) [2023-12-28 04:27:52,321][106226] Updated weights for policy 0, policy_version 1280931 (0.0009) [2023-12-28 04:27:52,395][106226] Updated weights for policy 0, policy_version 1280941 (0.0009) [2023-12-28 04:27:52,464][106226] Updated weights for policy 0, policy_version 1280951 (0.0008) [2023-12-28 04:27:52,625][106225] Updated weights for policy 1, policy_version 1284139 (0.0008) [2023-12-28 04:27:52,685][106225] Updated weights for policy 1, policy_version 1284149 (0.0008) [2023-12-28 04:27:52,750][106225] Updated weights for policy 1, policy_version 1284159 (0.0008) [2023-12-28 04:27:53,125][106226] Updated weights for policy 0, policy_version 1280961 (0.0008) [2023-12-28 04:27:53,172][106226] Updated weights for policy 0, policy_version 1280971 (0.0008) [2023-12-28 04:27:53,233][106226] Updated weights for policy 0, policy_version 1280981 (0.0009) [2023-12-28 04:27:53,415][106225] Updated weights for policy 1, policy_version 1284169 (0.0008) [2023-12-28 04:27:53,465][106225] Updated weights for policy 1, policy_version 1284179 (0.0005) [2023-12-28 04:27:53,524][106225] Updated weights for policy 1, policy_version 1284189 (0.0006) [2023-12-28 04:27:53,581][106225] Updated weights for policy 1, policy_version 1284199 (0.0008) [2023-12-28 04:27:53,995][106226] Updated weights for policy 0, policy_version 1280991 (0.0009) [2023-12-28 04:27:54,046][106226] Updated weights for policy 0, policy_version 1281001 (0.0008) [2023-12-28 04:27:54,102][106226] Updated weights for policy 0, policy_version 1281011 (0.0009) [2023-12-28 04:27:54,233][106225] Updated weights for policy 1, policy_version 1284209 (0.0006) [2023-12-28 04:27:54,282][106225] Updated weights for policy 1, policy_version 1284219 (0.0005) [2023-12-28 04:27:54,346][106225] Updated weights for policy 1, policy_version 1284229 (0.0008) [2023-12-28 04:27:54,942][106225] Updated weights for policy 1, policy_version 1284239 (0.0007) [2023-12-28 04:27:54,947][106226] Updated weights for policy 0, policy_version 1281021 (0.0009) [2023-12-28 04:27:54,995][106225] Updated weights for policy 1, policy_version 1284249 (0.0007) [2023-12-28 04:27:55,003][106226] Updated weights for policy 0, policy_version 1281031 (0.0007) [2023-12-28 04:27:55,048][106225] Updated weights for policy 1, policy_version 1284259 (0.0008) [2023-12-28 04:27:55,060][106226] Updated weights for policy 0, policy_version 1281041 (0.0005) [2023-12-28 04:27:55,753][106226] Updated weights for policy 0, policy_version 1281051 (0.0007) [2023-12-28 04:27:55,762][106225] Updated weights for policy 1, policy_version 1284269 (0.0008) [2023-12-28 04:27:55,807][106225] Updated weights for policy 1, policy_version 1284279 (0.0007) [2023-12-28 04:27:55,813][106226] Updated weights for policy 0, policy_version 1281061 (0.0006) [2023-12-28 04:27:55,855][106225] Updated weights for policy 1, policy_version 1284289 (0.0006) [2023-12-28 04:27:55,875][106226] Updated weights for policy 0, policy_version 1281071 (0.0008) [2023-12-28 04:27:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 656842752. Throughput: 0: 9819.3, 1: 9972.0. Samples: 656809132. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:27:56,175][105115] Avg episode reward: [(0, '-4.258'), (1, '-5.302')] [2023-12-28 04:27:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001281080_328015872.pth... [2023-12-28 04:27:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001284296_328826880.pth... [2023-12-28 04:27:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001283112_328523776.pth [2023-12-28 04:27:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001279928_327720960.pth [2023-12-28 04:27:56,464][106225] Updated weights for policy 1, policy_version 1284299 (0.0007) [2023-12-28 04:27:56,512][106225] Updated weights for policy 1, policy_version 1284309 (0.0008) [2023-12-28 04:27:56,562][106225] Updated weights for policy 1, policy_version 1284319 (0.0007) [2023-12-28 04:27:56,630][106226] Updated weights for policy 0, policy_version 1281081 (0.0009) [2023-12-28 04:27:56,691][106226] Updated weights for policy 0, policy_version 1281091 (0.0008) [2023-12-28 04:27:56,745][106226] Updated weights for policy 0, policy_version 1281101 (0.0008) [2023-12-28 04:27:56,793][106226] Updated weights for policy 0, policy_version 1281111 (0.0008) [2023-12-28 04:27:57,199][106225] Updated weights for policy 1, policy_version 1284329 (0.0008) [2023-12-28 04:27:57,251][106225] Updated weights for policy 1, policy_version 1284339 (0.0008) [2023-12-28 04:27:57,303][106225] Updated weights for policy 1, policy_version 1284349 (0.0008) [2023-12-28 04:27:57,348][106225] Updated weights for policy 1, policy_version 1284359 (0.0006) [2023-12-28 04:27:57,567][106226] Updated weights for policy 0, policy_version 1281121 (0.0009) [2023-12-28 04:27:57,611][106226] Updated weights for policy 0, policy_version 1281131 (0.0008) [2023-12-28 04:27:57,655][106226] Updated weights for policy 0, policy_version 1281141 (0.0008) [2023-12-28 04:27:58,023][106225] Updated weights for policy 1, policy_version 1284369 (0.0005) [2023-12-28 04:27:58,086][106225] Updated weights for policy 1, policy_version 1284379 (0.0005) [2023-12-28 04:27:58,141][106225] Updated weights for policy 1, policy_version 1284389 (0.0008) [2023-12-28 04:27:58,464][106226] Updated weights for policy 0, policy_version 1281151 (0.0007) [2023-12-28 04:27:58,530][106226] Updated weights for policy 0, policy_version 1281161 (0.0008) [2023-12-28 04:27:58,596][106226] Updated weights for policy 0, policy_version 1281171 (0.0008) [2023-12-28 04:27:58,929][106225] Updated weights for policy 1, policy_version 1284400 (0.0010) [2023-12-28 04:27:58,991][106225] Updated weights for policy 1, policy_version 1284410 (0.0007) [2023-12-28 04:27:59,052][106225] Updated weights for policy 1, policy_version 1284420 (0.0008) [2023-12-28 04:27:59,426][106226] Updated weights for policy 0, policy_version 1281181 (0.0008) [2023-12-28 04:27:59,493][106226] Updated weights for policy 0, policy_version 1281191 (0.0009) [2023-12-28 04:27:59,555][106226] Updated weights for policy 0, policy_version 1281201 (0.0010) [2023-12-28 04:27:59,776][106225] Updated weights for policy 1, policy_version 1284430 (0.0007) [2023-12-28 04:27:59,848][106225] Updated weights for policy 1, policy_version 1284440 (0.0006) [2023-12-28 04:27:59,905][106225] Updated weights for policy 1, policy_version 1284450 (0.0007) [2023-12-28 04:28:00,432][106226] Updated weights for policy 0, policy_version 1281211 (0.0008) [2023-12-28 04:28:00,499][106226] Updated weights for policy 0, policy_version 1281221 (0.0009) [2023-12-28 04:28:00,561][106226] Updated weights for policy 0, policy_version 1281231 (0.0008) [2023-12-28 04:28:00,569][106225] Updated weights for policy 1, policy_version 1284460 (0.0009) [2023-12-28 04:28:00,620][106225] Updated weights for policy 1, policy_version 1284470 (0.0008) [2023-12-28 04:28:00,673][106225] Updated weights for policy 1, policy_version 1284480 (0.0009) [2023-12-28 04:28:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 656932864. Throughput: 0: 9759.8, 1: 10055.8. Samples: 656925952. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:01,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-5.067')] [2023-12-28 04:28:01,341][106226] Updated weights for policy 0, policy_version 1281241 (0.0008) [2023-12-28 04:28:01,360][106225] Updated weights for policy 1, policy_version 1284490 (0.0007) [2023-12-28 04:28:01,415][106226] Updated weights for policy 0, policy_version 1281251 (0.0009) [2023-12-28 04:28:01,427][106225] Updated weights for policy 1, policy_version 1284500 (0.0007) [2023-12-28 04:28:01,471][106226] Updated weights for policy 0, policy_version 1281261 (0.0010) [2023-12-28 04:28:01,489][106225] Updated weights for policy 1, policy_version 1284510 (0.0006) [2023-12-28 04:28:01,529][106226] Updated weights for policy 0, policy_version 1281271 (0.0010) [2023-12-28 04:28:01,547][106225] Updated weights for policy 1, policy_version 1284520 (0.0006) [2023-12-28 04:28:02,233][106225] Updated weights for policy 1, policy_version 1284530 (0.0007) [2023-12-28 04:28:02,253][106226] Updated weights for policy 0, policy_version 1281281 (0.0010) [2023-12-28 04:28:02,300][106225] Updated weights for policy 1, policy_version 1284540 (0.0007) [2023-12-28 04:28:02,316][106226] Updated weights for policy 0, policy_version 1281291 (0.0007) [2023-12-28 04:28:02,362][106225] Updated weights for policy 1, policy_version 1284550 (0.0007) [2023-12-28 04:28:02,379][106226] Updated weights for policy 0, policy_version 1281301 (0.0009) [2023-12-28 04:28:03,076][106226] Updated weights for policy 0, policy_version 1281311 (0.0006) [2023-12-28 04:28:03,081][106225] Updated weights for policy 1, policy_version 1284560 (0.0009) [2023-12-28 04:28:03,132][106226] Updated weights for policy 0, policy_version 1281321 (0.0005) [2023-12-28 04:28:03,137][106225] Updated weights for policy 1, policy_version 1284570 (0.0010) [2023-12-28 04:28:03,186][106226] Updated weights for policy 0, policy_version 1281331 (0.0006) [2023-12-28 04:28:03,196][106225] Updated weights for policy 1, policy_version 1284580 (0.0010) [2023-12-28 04:28:03,893][106225] Updated weights for policy 1, policy_version 1284590 (0.0010) [2023-12-28 04:28:03,942][106226] Updated weights for policy 0, policy_version 1281341 (0.0005) [2023-12-28 04:28:03,948][106225] Updated weights for policy 1, policy_version 1284600 (0.0010) [2023-12-28 04:28:04,001][106226] Updated weights for policy 0, policy_version 1281351 (0.0007) [2023-12-28 04:28:04,013][106225] Updated weights for policy 1, policy_version 1284610 (0.0010) [2023-12-28 04:28:04,058][106226] Updated weights for policy 0, policy_version 1281361 (0.0007) [2023-12-28 04:28:04,714][106225] Updated weights for policy 1, policy_version 1284620 (0.0010) [2023-12-28 04:28:04,770][106225] Updated weights for policy 1, policy_version 1284630 (0.0010) [2023-12-28 04:28:04,774][106226] Updated weights for policy 0, policy_version 1281371 (0.0007) [2023-12-28 04:28:04,820][106225] Updated weights for policy 1, policy_version 1284640 (0.0010) [2023-12-28 04:28:04,841][106226] Updated weights for policy 0, policy_version 1281381 (0.0007) [2023-12-28 04:28:04,899][106226] Updated weights for policy 0, policy_version 1281391 (0.0005) [2023-12-28 04:28:05,541][106226] Updated weights for policy 0, policy_version 1281401 (0.0005) [2023-12-28 04:28:05,552][106225] Updated weights for policy 1, policy_version 1284650 (0.0010) [2023-12-28 04:28:05,600][106226] Updated weights for policy 0, policy_version 1281411 (0.0006) [2023-12-28 04:28:05,609][106225] Updated weights for policy 1, policy_version 1284660 (0.0010) [2023-12-28 04:28:05,658][106225] Updated weights for policy 1, policy_version 1284670 (0.0010) [2023-12-28 04:28:05,660][106226] Updated weights for policy 0, policy_version 1281421 (0.0006) [2023-12-28 04:28:05,716][106225] Updated weights for policy 1, policy_version 1284680 (0.0010) [2023-12-28 04:28:05,718][106226] Updated weights for policy 0, policy_version 1281431 (0.0005) [2023-12-28 04:28:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 657031168. Throughput: 0: 9737.5, 1: 10032.1. Samples: 657042412. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:06,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.725')] [2023-12-28 04:28:06,367][106226] Updated weights for policy 0, policy_version 1281441 (0.0006) [2023-12-28 04:28:06,388][106225] Updated weights for policy 1, policy_version 1284690 (0.0008) [2023-12-28 04:28:06,428][106226] Updated weights for policy 0, policy_version 1281451 (0.0008) [2023-12-28 04:28:06,451][106225] Updated weights for policy 1, policy_version 1284700 (0.0006) [2023-12-28 04:28:06,484][106226] Updated weights for policy 0, policy_version 1281461 (0.0008) [2023-12-28 04:28:06,513][106225] Updated weights for policy 1, policy_version 1284710 (0.0007) [2023-12-28 04:28:07,139][106226] Updated weights for policy 0, policy_version 1281471 (0.0007) [2023-12-28 04:28:07,200][106226] Updated weights for policy 0, policy_version 1281481 (0.0007) [2023-12-28 04:28:07,209][106225] Updated weights for policy 1, policy_version 1284720 (0.0006) [2023-12-28 04:28:07,264][106226] Updated weights for policy 0, policy_version 1281491 (0.0007) [2023-12-28 04:28:07,272][106225] Updated weights for policy 1, policy_version 1284730 (0.0007) [2023-12-28 04:28:07,332][106225] Updated weights for policy 1, policy_version 1284740 (0.0009) [2023-12-28 04:28:07,862][106226] Updated weights for policy 0, policy_version 1281501 (0.0006) [2023-12-28 04:28:07,918][106226] Updated weights for policy 0, policy_version 1281511 (0.0009) [2023-12-28 04:28:07,924][106225] Updated weights for policy 1, policy_version 1284750 (0.0006) [2023-12-28 04:28:07,978][106226] Updated weights for policy 0, policy_version 1281521 (0.0011) [2023-12-28 04:28:07,982][106225] Updated weights for policy 1, policy_version 1284760 (0.0005) [2023-12-28 04:28:08,042][106225] Updated weights for policy 1, policy_version 1284770 (0.0006) [2023-12-28 04:28:08,642][106225] Updated weights for policy 1, policy_version 1284780 (0.0006) [2023-12-28 04:28:08,702][106225] Updated weights for policy 1, policy_version 1284790 (0.0006) [2023-12-28 04:28:08,734][106226] Updated weights for policy 0, policy_version 1281531 (0.0009) [2023-12-28 04:28:08,757][106225] Updated weights for policy 1, policy_version 1284800 (0.0006) [2023-12-28 04:28:08,795][106226] Updated weights for policy 0, policy_version 1281541 (0.0008) [2023-12-28 04:28:08,850][106226] Updated weights for policy 0, policy_version 1281551 (0.0008) [2023-12-28 04:28:09,520][106225] Updated weights for policy 1, policy_version 1284810 (0.0007) [2023-12-28 04:28:09,589][106225] Updated weights for policy 1, policy_version 1284820 (0.0006) [2023-12-28 04:28:09,660][106225] Updated weights for policy 1, policy_version 1284830 (0.0005) [2023-12-28 04:28:09,662][106226] Updated weights for policy 0, policy_version 1281561 (0.0008) [2023-12-28 04:28:09,721][106225] Updated weights for policy 1, policy_version 1284840 (0.0006) [2023-12-28 04:28:09,727][106226] Updated weights for policy 0, policy_version 1281571 (0.0009) [2023-12-28 04:28:09,795][106226] Updated weights for policy 0, policy_version 1281581 (0.0009) [2023-12-28 04:28:09,862][106226] Updated weights for policy 0, policy_version 1281591 (0.0009) [2023-12-28 04:28:10,416][106225] Updated weights for policy 1, policy_version 1284850 (0.0008) [2023-12-28 04:28:10,481][106225] Updated weights for policy 1, policy_version 1284860 (0.0008) [2023-12-28 04:28:10,542][106226] Updated weights for policy 0, policy_version 1281601 (0.0009) [2023-12-28 04:28:10,544][106225] Updated weights for policy 1, policy_version 1284870 (0.0007) [2023-12-28 04:28:10,592][106226] Updated weights for policy 0, policy_version 1281611 (0.0007) [2023-12-28 04:28:10,655][106226] Updated weights for policy 0, policy_version 1281621 (0.0008) [2023-12-28 04:28:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 657129472. Throughput: 0: 9766.8, 1: 10119.9. Samples: 657105232. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:11,175][105115] Avg episode reward: [(0, '-4.074'), (1, '-5.013')] [2023-12-28 04:28:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001281624_328155136.pth... [2023-12-28 04:28:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001280504_327868416.pth [2023-12-28 04:28:11,213][106225] Updated weights for policy 1, policy_version 1284880 (0.0009) [2023-12-28 04:28:11,285][106225] Updated weights for policy 1, policy_version 1284890 (0.0008) [2023-12-28 04:28:11,355][106225] Updated weights for policy 1, policy_version 1284900 (0.0007) [2023-12-28 04:28:11,387][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001284904_328982528.pth... [2023-12-28 04:28:11,392][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001283720_328679424.pth [2023-12-28 04:28:11,440][106226] Updated weights for policy 0, policy_version 1281631 (0.0008) [2023-12-28 04:28:11,506][106226] Updated weights for policy 0, policy_version 1281641 (0.0009) [2023-12-28 04:28:11,563][106226] Updated weights for policy 0, policy_version 1281651 (0.0009) [2023-12-28 04:28:12,187][106225] Updated weights for policy 1, policy_version 1284910 (0.0008) [2023-12-28 04:28:12,227][106226] Updated weights for policy 0, policy_version 1281661 (0.0008) [2023-12-28 04:28:12,244][106225] Updated weights for policy 1, policy_version 1284920 (0.0009) [2023-12-28 04:28:12,293][106226] Updated weights for policy 0, policy_version 1281671 (0.0009) [2023-12-28 04:28:12,308][106225] Updated weights for policy 1, policy_version 1284930 (0.0008) [2023-12-28 04:28:12,358][106226] Updated weights for policy 0, policy_version 1281681 (0.0007) [2023-12-28 04:28:13,045][106225] Updated weights for policy 1, policy_version 1284940 (0.0006) [2023-12-28 04:28:13,080][106226] Updated weights for policy 0, policy_version 1281691 (0.0007) [2023-12-28 04:28:13,098][106225] Updated weights for policy 1, policy_version 1284950 (0.0005) [2023-12-28 04:28:13,132][106226] Updated weights for policy 0, policy_version 1281701 (0.0009) [2023-12-28 04:28:13,146][106225] Updated weights for policy 1, policy_version 1284960 (0.0005) [2023-12-28 04:28:13,184][106226] Updated weights for policy 0, policy_version 1281711 (0.0007) [2023-12-28 04:28:13,826][106225] Updated weights for policy 1, policy_version 1284970 (0.0006) [2023-12-28 04:28:13,883][106226] Updated weights for policy 0, policy_version 1281721 (0.0009) [2023-12-28 04:28:13,889][106225] Updated weights for policy 1, policy_version 1284980 (0.0008) [2023-12-28 04:28:13,936][106225] Updated weights for policy 1, policy_version 1284990 (0.0005) [2023-12-28 04:28:13,948][106226] Updated weights for policy 0, policy_version 1281731 (0.0008) [2023-12-28 04:28:13,981][106225] Updated weights for policy 1, policy_version 1285000 (0.0005) [2023-12-28 04:28:14,009][106226] Updated weights for policy 0, policy_version 1281741 (0.0006) [2023-12-28 04:28:14,063][106226] Updated weights for policy 0, policy_version 1281751 (0.0005) [2023-12-28 04:28:14,631][106225] Updated weights for policy 1, policy_version 1285010 (0.0006) [2023-12-28 04:28:14,648][106226] Updated weights for policy 0, policy_version 1281761 (0.0008) [2023-12-28 04:28:14,692][106225] Updated weights for policy 1, policy_version 1285020 (0.0005) [2023-12-28 04:28:14,702][106226] Updated weights for policy 0, policy_version 1281771 (0.0009) [2023-12-28 04:28:14,750][106225] Updated weights for policy 1, policy_version 1285030 (0.0005) [2023-12-28 04:28:14,760][106226] Updated weights for policy 0, policy_version 1281781 (0.0007) [2023-12-28 04:28:15,342][106225] Updated weights for policy 1, policy_version 1285040 (0.0009) [2023-12-28 04:28:15,393][106225] Updated weights for policy 1, policy_version 1285050 (0.0008) [2023-12-28 04:28:15,454][106225] Updated weights for policy 1, policy_version 1285060 (0.0007) [2023-12-28 04:28:15,462][106226] Updated weights for policy 0, policy_version 1281791 (0.0008) [2023-12-28 04:28:15,526][106226] Updated weights for policy 0, policy_version 1281801 (0.0008) [2023-12-28 04:28:15,586][106226] Updated weights for policy 0, policy_version 1281811 (0.0008) [2023-12-28 04:28:16,141][106225] Updated weights for policy 1, policy_version 1285070 (0.0007) [2023-12-28 04:28:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 657227776. Throughput: 0: 9743.1, 1: 9981.5. Samples: 657222076. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:16,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.000')] [2023-12-28 04:28:16,203][106225] Updated weights for policy 1, policy_version 1285080 (0.0008) [2023-12-28 04:28:16,266][106226] Updated weights for policy 0, policy_version 1281821 (0.0009) [2023-12-28 04:28:16,268][106225] Updated weights for policy 1, policy_version 1285090 (0.0007) [2023-12-28 04:28:16,322][106226] Updated weights for policy 0, policy_version 1281831 (0.0010) [2023-12-28 04:28:16,382][106226] Updated weights for policy 0, policy_version 1281841 (0.0011) [2023-12-28 04:28:17,028][106225] Updated weights for policy 1, policy_version 1285100 (0.0006) [2023-12-28 04:28:17,033][106226] Updated weights for policy 0, policy_version 1281851 (0.0011) [2023-12-28 04:28:17,076][106225] Updated weights for policy 1, policy_version 1285110 (0.0006) [2023-12-28 04:28:17,088][106226] Updated weights for policy 0, policy_version 1281861 (0.0006) [2023-12-28 04:28:17,124][106225] Updated weights for policy 1, policy_version 1285120 (0.0007) [2023-12-28 04:28:17,139][106226] Updated weights for policy 0, policy_version 1281871 (0.0008) [2023-12-28 04:28:17,796][106225] Updated weights for policy 1, policy_version 1285130 (0.0007) [2023-12-28 04:28:17,847][106225] Updated weights for policy 1, policy_version 1285140 (0.0008) [2023-12-28 04:28:17,885][106226] Updated weights for policy 0, policy_version 1281881 (0.0007) [2023-12-28 04:28:17,903][106225] Updated weights for policy 1, policy_version 1285150 (0.0007) [2023-12-28 04:28:17,939][106226] Updated weights for policy 0, policy_version 1281891 (0.0006) [2023-12-28 04:28:17,951][106225] Updated weights for policy 1, policy_version 1285160 (0.0006) [2023-12-28 04:28:17,995][106226] Updated weights for policy 0, policy_version 1281901 (0.0006) [2023-12-28 04:28:18,044][106226] Updated weights for policy 0, policy_version 1281911 (0.0008) [2023-12-28 04:28:18,690][106226] Updated weights for policy 0, policy_version 1281921 (0.0009) [2023-12-28 04:28:18,755][106226] Updated weights for policy 0, policy_version 1281931 (0.0008) [2023-12-28 04:28:18,769][106225] Updated weights for policy 1, policy_version 1285170 (0.0006) [2023-12-28 04:28:18,811][106226] Updated weights for policy 0, policy_version 1281941 (0.0007) [2023-12-28 04:28:18,824][106225] Updated weights for policy 1, policy_version 1285180 (0.0006) [2023-12-28 04:28:18,884][106225] Updated weights for policy 1, policy_version 1285190 (0.0008) [2023-12-28 04:28:19,560][106226] Updated weights for policy 0, policy_version 1281951 (0.0008) [2023-12-28 04:28:19,571][106225] Updated weights for policy 1, policy_version 1285200 (0.0007) [2023-12-28 04:28:19,620][106225] Updated weights for policy 1, policy_version 1285210 (0.0006) [2023-12-28 04:28:19,623][106226] Updated weights for policy 0, policy_version 1281961 (0.0008) [2023-12-28 04:28:19,667][106225] Updated weights for policy 1, policy_version 1285220 (0.0007) [2023-12-28 04:28:19,683][106226] Updated weights for policy 0, policy_version 1281971 (0.0008) [2023-12-28 04:28:20,295][106226] Updated weights for policy 0, policy_version 1281981 (0.0007) [2023-12-28 04:28:20,360][106226] Updated weights for policy 0, policy_version 1281991 (0.0009) [2023-12-28 04:28:20,423][106226] Updated weights for policy 0, policy_version 1282001 (0.0009) [2023-12-28 04:28:20,462][106225] Updated weights for policy 1, policy_version 1285230 (0.0007) [2023-12-28 04:28:20,522][106225] Updated weights for policy 1, policy_version 1285240 (0.0008) [2023-12-28 04:28:20,588][106225] Updated weights for policy 1, policy_version 1285250 (0.0010) [2023-12-28 04:28:21,156][106226] Updated weights for policy 0, policy_version 1282011 (0.0008) [2023-12-28 04:28:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 657326080. Throughput: 0: 9765.7, 1: 9887.1. Samples: 657340192. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:21,175][105115] Avg episode reward: [(0, '-4.070'), (1, '-4.916')] [2023-12-28 04:28:21,215][106226] Updated weights for policy 0, policy_version 1282021 (0.0009) [2023-12-28 04:28:21,282][106226] Updated weights for policy 0, policy_version 1282031 (0.0008) [2023-12-28 04:28:21,334][106225] Updated weights for policy 1, policy_version 1285260 (0.0008) [2023-12-28 04:28:21,405][106225] Updated weights for policy 1, policy_version 1285270 (0.0008) [2023-12-28 04:28:21,467][106225] Updated weights for policy 1, policy_version 1285280 (0.0008) [2023-12-28 04:28:22,063][106226] Updated weights for policy 0, policy_version 1282041 (0.0008) [2023-12-28 04:28:22,121][106226] Updated weights for policy 0, policy_version 1282051 (0.0006) [2023-12-28 04:28:22,173][106226] Updated weights for policy 0, policy_version 1282061 (0.0008) [2023-12-28 04:28:22,229][106226] Updated weights for policy 0, policy_version 1282071 (0.0008) [2023-12-28 04:28:22,231][106225] Updated weights for policy 1, policy_version 1285290 (0.0008) [2023-12-28 04:28:22,300][106225] Updated weights for policy 1, policy_version 1285300 (0.0008) [2023-12-28 04:28:22,365][106225] Updated weights for policy 1, policy_version 1285310 (0.0009) [2023-12-28 04:28:22,419][106225] Updated weights for policy 1, policy_version 1285320 (0.0009) [2023-12-28 04:28:22,858][106226] Updated weights for policy 0, policy_version 1282081 (0.0008) [2023-12-28 04:28:22,938][106226] Updated weights for policy 0, policy_version 1282091 (0.0009) [2023-12-28 04:28:23,004][106226] Updated weights for policy 0, policy_version 1282101 (0.0008) [2023-12-28 04:28:23,222][106225] Updated weights for policy 1, policy_version 1285330 (0.0008) [2023-12-28 04:28:23,271][106225] Updated weights for policy 1, policy_version 1285340 (0.0009) [2023-12-28 04:28:23,324][106225] Updated weights for policy 1, policy_version 1285350 (0.0009) [2023-12-28 04:28:23,586][106226] Updated weights for policy 0, policy_version 1282111 (0.0006) [2023-12-28 04:28:23,644][106226] Updated weights for policy 0, policy_version 1282121 (0.0005) [2023-12-28 04:28:23,710][106226] Updated weights for policy 0, policy_version 1282131 (0.0010) [2023-12-28 04:28:24,092][106225] Updated weights for policy 1, policy_version 1285360 (0.0008) [2023-12-28 04:28:24,143][106225] Updated weights for policy 1, policy_version 1285370 (0.0008) [2023-12-28 04:28:24,202][106225] Updated weights for policy 1, policy_version 1285380 (0.0009) [2023-12-28 04:28:24,348][106226] Updated weights for policy 0, policy_version 1282141 (0.0008) [2023-12-28 04:28:24,398][106226] Updated weights for policy 0, policy_version 1282151 (0.0009) [2023-12-28 04:28:24,453][106226] Updated weights for policy 0, policy_version 1282161 (0.0009) [2023-12-28 04:28:24,958][106225] Updated weights for policy 1, policy_version 1285390 (0.0008) [2023-12-28 04:28:25,015][106225] Updated weights for policy 1, policy_version 1285400 (0.0008) [2023-12-28 04:28:25,066][106225] Updated weights for policy 1, policy_version 1285410 (0.0008) [2023-12-28 04:28:25,155][106226] Updated weights for policy 0, policy_version 1282171 (0.0008) [2023-12-28 04:28:25,204][106226] Updated weights for policy 0, policy_version 1282181 (0.0008) [2023-12-28 04:28:25,256][106226] Updated weights for policy 0, policy_version 1282191 (0.0008) [2023-12-28 04:28:25,725][106225] Updated weights for policy 1, policy_version 1285420 (0.0008) [2023-12-28 04:28:25,769][106225] Updated weights for policy 1, policy_version 1285430 (0.0008) [2023-12-28 04:28:25,813][106225] Updated weights for policy 1, policy_version 1285440 (0.0008) [2023-12-28 04:28:25,988][106226] Updated weights for policy 0, policy_version 1282201 (0.0008) [2023-12-28 04:28:26,041][106226] Updated weights for policy 0, policy_version 1282211 (0.0005) [2023-12-28 04:28:26,088][106226] Updated weights for policy 0, policy_version 1282221 (0.0005) [2023-12-28 04:28:26,136][106226] Updated weights for policy 0, policy_version 1282231 (0.0007) [2023-12-28 04:28:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 657432576. Throughput: 0: 9774.3, 1: 9859.7. Samples: 657398180. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:26,175][105115] Avg episode reward: [(0, '-3.946'), (1, '-4.886')] [2023-12-28 04:28:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001285448_329121792.pth... [2023-12-28 04:28:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001282232_328310784.pth... [2023-12-28 04:28:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001284296_328826880.pth [2023-12-28 04:28:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001281080_328015872.pth [2023-12-28 04:28:26,628][106225] Updated weights for policy 1, policy_version 1285450 (0.0008) [2023-12-28 04:28:26,681][106225] Updated weights for policy 1, policy_version 1285460 (0.0007) [2023-12-28 04:28:26,702][106226] Updated weights for policy 0, policy_version 1282241 (0.0006) [2023-12-28 04:28:26,731][106225] Updated weights for policy 1, policy_version 1285470 (0.0006) [2023-12-28 04:28:26,755][106226] Updated weights for policy 0, policy_version 1282251 (0.0008) [2023-12-28 04:28:26,788][106225] Updated weights for policy 1, policy_version 1285480 (0.0006) [2023-12-28 04:28:26,818][106226] Updated weights for policy 0, policy_version 1282261 (0.0006) [2023-12-28 04:28:27,463][106226] Updated weights for policy 0, policy_version 1282271 (0.0007) [2023-12-28 04:28:27,523][106226] Updated weights for policy 0, policy_version 1282281 (0.0009) [2023-12-28 04:28:27,543][106225] Updated weights for policy 1, policy_version 1285490 (0.0006) [2023-12-28 04:28:27,582][106226] Updated weights for policy 0, policy_version 1282291 (0.0010) [2023-12-28 04:28:27,592][106225] Updated weights for policy 1, policy_version 1285500 (0.0006) [2023-12-28 04:28:27,641][106225] Updated weights for policy 1, policy_version 1285510 (0.0007) [2023-12-28 04:28:28,141][106226] Updated weights for policy 0, policy_version 1282301 (0.0008) [2023-12-28 04:28:28,204][106226] Updated weights for policy 0, policy_version 1282311 (0.0005) [2023-12-28 04:28:28,254][106226] Updated weights for policy 0, policy_version 1282321 (0.0008) [2023-12-28 04:28:28,485][106225] Updated weights for policy 1, policy_version 1285520 (0.0008) [2023-12-28 04:28:28,546][106225] Updated weights for policy 1, policy_version 1285530 (0.0008) [2023-12-28 04:28:28,603][106225] Updated weights for policy 1, policy_version 1285540 (0.0008) [2023-12-28 04:28:28,923][106226] Updated weights for policy 0, policy_version 1282331 (0.0010) [2023-12-28 04:28:28,979][106226] Updated weights for policy 0, policy_version 1282341 (0.0010) [2023-12-28 04:28:29,025][106226] Updated weights for policy 0, policy_version 1282351 (0.0010) [2023-12-28 04:28:29,353][106225] Updated weights for policy 1, policy_version 1285550 (0.0007) [2023-12-28 04:28:29,413][106225] Updated weights for policy 1, policy_version 1285560 (0.0009) [2023-12-28 04:28:29,478][106225] Updated weights for policy 1, policy_version 1285570 (0.0008) [2023-12-28 04:28:29,784][106226] Updated weights for policy 0, policy_version 1282361 (0.0009) [2023-12-28 04:28:29,848][106226] Updated weights for policy 0, policy_version 1282371 (0.0006) [2023-12-28 04:28:29,903][106226] Updated weights for policy 0, policy_version 1282381 (0.0008) [2023-12-28 04:28:29,970][106226] Updated weights for policy 0, policy_version 1282391 (0.0007) [2023-12-28 04:28:30,204][106225] Updated weights for policy 1, policy_version 1285580 (0.0008) [2023-12-28 04:28:30,267][106225] Updated weights for policy 1, policy_version 1285590 (0.0009) [2023-12-28 04:28:30,330][106225] Updated weights for policy 1, policy_version 1285600 (0.0009) [2023-12-28 04:28:30,595][106226] Updated weights for policy 0, policy_version 1282401 (0.0010) [2023-12-28 04:28:30,656][106226] Updated weights for policy 0, policy_version 1282411 (0.0008) [2023-12-28 04:28:30,714][106226] Updated weights for policy 0, policy_version 1282421 (0.0009) [2023-12-28 04:28:31,020][106225] Updated weights for policy 1, policy_version 1285610 (0.0009) [2023-12-28 04:28:31,089][106225] Updated weights for policy 1, policy_version 1285620 (0.0008) [2023-12-28 04:28:31,154][106225] Updated weights for policy 1, policy_version 1285630 (0.0008) [2023-12-28 04:28:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 657522688. Throughput: 0: 9858.0, 1: 9880.2. Samples: 657517740. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:31,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.971')] [2023-12-28 04:28:31,216][106225] Updated weights for policy 1, policy_version 1285640 (0.0009) [2023-12-28 04:28:31,475][106226] Updated weights for policy 0, policy_version 1282431 (0.0008) [2023-12-28 04:28:31,537][106226] Updated weights for policy 0, policy_version 1282441 (0.0009) [2023-12-28 04:28:31,603][106226] Updated weights for policy 0, policy_version 1282451 (0.0008) [2023-12-28 04:28:32,013][106225] Updated weights for policy 1, policy_version 1285650 (0.0009) [2023-12-28 04:28:32,074][106225] Updated weights for policy 1, policy_version 1285660 (0.0008) [2023-12-28 04:28:32,124][106225] Updated weights for policy 1, policy_version 1285670 (0.0009) [2023-12-28 04:28:32,307][106226] Updated weights for policy 0, policy_version 1282461 (0.0009) [2023-12-28 04:28:32,364][106226] Updated weights for policy 0, policy_version 1282471 (0.0008) [2023-12-28 04:28:32,430][106226] Updated weights for policy 0, policy_version 1282481 (0.0007) [2023-12-28 04:28:32,819][106225] Updated weights for policy 1, policy_version 1285680 (0.0005) [2023-12-28 04:28:32,872][106225] Updated weights for policy 1, policy_version 1285690 (0.0008) [2023-12-28 04:28:32,935][106225] Updated weights for policy 1, policy_version 1285700 (0.0009) [2023-12-28 04:28:33,081][106226] Updated weights for policy 0, policy_version 1282491 (0.0006) [2023-12-28 04:28:33,128][106226] Updated weights for policy 0, policy_version 1282501 (0.0008) [2023-12-28 04:28:33,172][106226] Updated weights for policy 0, policy_version 1282511 (0.0008) [2023-12-28 04:28:33,608][106225] Updated weights for policy 1, policy_version 1285710 (0.0008) [2023-12-28 04:28:33,665][106225] Updated weights for policy 1, policy_version 1285720 (0.0008) [2023-12-28 04:28:33,722][106225] Updated weights for policy 1, policy_version 1285730 (0.0008) [2023-12-28 04:28:33,905][106226] Updated weights for policy 0, policy_version 1282521 (0.0008) [2023-12-28 04:28:33,958][106226] Updated weights for policy 0, policy_version 1282531 (0.0008) [2023-12-28 04:28:34,009][106226] Updated weights for policy 0, policy_version 1282541 (0.0006) [2023-12-28 04:28:34,063][106226] Updated weights for policy 0, policy_version 1282551 (0.0008) [2023-12-28 04:28:34,406][106225] Updated weights for policy 1, policy_version 1285740 (0.0009) [2023-12-28 04:28:34,458][106225] Updated weights for policy 1, policy_version 1285750 (0.0011) [2023-12-28 04:28:34,520][106225] Updated weights for policy 1, policy_version 1285760 (0.0011) [2023-12-28 04:28:34,820][106226] Updated weights for policy 0, policy_version 1282561 (0.0008) [2023-12-28 04:28:34,874][106226] Updated weights for policy 0, policy_version 1282571 (0.0007) [2023-12-28 04:28:34,924][106226] Updated weights for policy 0, policy_version 1282581 (0.0007) [2023-12-28 04:28:35,206][106225] Updated weights for policy 1, policy_version 1285770 (0.0010) [2023-12-28 04:28:35,260][106225] Updated weights for policy 1, policy_version 1285780 (0.0008) [2023-12-28 04:28:35,310][106225] Updated weights for policy 1, policy_version 1285790 (0.0010) [2023-12-28 04:28:35,359][106225] Updated weights for policy 1, policy_version 1285800 (0.0010) [2023-12-28 04:28:35,580][106226] Updated weights for policy 0, policy_version 1282591 (0.0010) [2023-12-28 04:28:35,626][106226] Updated weights for policy 0, policy_version 1282601 (0.0010) [2023-12-28 04:28:35,680][106226] Updated weights for policy 0, policy_version 1282611 (0.0010) [2023-12-28 04:28:35,963][106225] Updated weights for policy 1, policy_version 1285810 (0.0010) [2023-12-28 04:28:36,020][106225] Updated weights for policy 1, policy_version 1285820 (0.0010) [2023-12-28 04:28:36,080][106225] Updated weights for policy 1, policy_version 1285830 (0.0010) [2023-12-28 04:28:36,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 657629184. Throughput: 0: 9864.3, 1: 9805.2. Samples: 657636624. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:36,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.783')] [2023-12-28 04:28:36,382][106226] Updated weights for policy 0, policy_version 1282621 (0.0010) [2023-12-28 04:28:36,447][106226] Updated weights for policy 0, policy_version 1282631 (0.0011) [2023-12-28 04:28:36,511][106226] Updated weights for policy 0, policy_version 1282641 (0.0011) [2023-12-28 04:28:36,816][106225] Updated weights for policy 1, policy_version 1285840 (0.0010) [2023-12-28 04:28:36,883][106225] Updated weights for policy 1, policy_version 1285850 (0.0011) [2023-12-28 04:28:36,944][106225] Updated weights for policy 1, policy_version 1285860 (0.0011) [2023-12-28 04:28:37,182][106226] Updated weights for policy 0, policy_version 1282651 (0.0009) [2023-12-28 04:28:37,254][106226] Updated weights for policy 0, policy_version 1282661 (0.0009) [2023-12-28 04:28:37,308][106226] Updated weights for policy 0, policy_version 1282671 (0.0011) [2023-12-28 04:28:37,626][106225] Updated weights for policy 1, policy_version 1285870 (0.0010) [2023-12-28 04:28:37,684][106225] Updated weights for policy 1, policy_version 1285880 (0.0011) [2023-12-28 04:28:37,741][106225] Updated weights for policy 1, policy_version 1285890 (0.0010) [2023-12-28 04:28:37,869][106226] Updated weights for policy 0, policy_version 1282681 (0.0010) [2023-12-28 04:28:37,922][106226] Updated weights for policy 0, policy_version 1282691 (0.0005) [2023-12-28 04:28:37,979][106226] Updated weights for policy 0, policy_version 1282701 (0.0007) [2023-12-28 04:28:38,032][106226] Updated weights for policy 0, policy_version 1282711 (0.0009) [2023-12-28 04:28:38,486][106225] Updated weights for policy 1, policy_version 1285900 (0.0010) [2023-12-28 04:28:38,551][106225] Updated weights for policy 1, policy_version 1285910 (0.0008) [2023-12-28 04:28:38,615][106225] Updated weights for policy 1, policy_version 1285920 (0.0008) [2023-12-28 04:28:38,724][106226] Updated weights for policy 0, policy_version 1282721 (0.0009) [2023-12-28 04:28:38,784][106226] Updated weights for policy 0, policy_version 1282731 (0.0009) [2023-12-28 04:28:38,846][106226] Updated weights for policy 0, policy_version 1282741 (0.0009) [2023-12-28 04:28:39,330][106225] Updated weights for policy 1, policy_version 1285930 (0.0008) [2023-12-28 04:28:39,394][106225] Updated weights for policy 1, policy_version 1285940 (0.0009) [2023-12-28 04:28:39,464][106225] Updated weights for policy 1, policy_version 1285950 (0.0007) [2023-12-28 04:28:39,525][106225] Updated weights for policy 1, policy_version 1285960 (0.0007) [2023-12-28 04:28:39,649][106226] Updated weights for policy 0, policy_version 1282751 (0.0008) [2023-12-28 04:28:39,716][106226] Updated weights for policy 0, policy_version 1282761 (0.0008) [2023-12-28 04:28:39,769][106226] Updated weights for policy 0, policy_version 1282771 (0.0008) [2023-12-28 04:28:40,211][106225] Updated weights for policy 1, policy_version 1285970 (0.0008) [2023-12-28 04:28:40,276][106225] Updated weights for policy 1, policy_version 1285980 (0.0006) [2023-12-28 04:28:40,340][106225] Updated weights for policy 1, policy_version 1285990 (0.0009) [2023-12-28 04:28:40,470][106226] Updated weights for policy 0, policy_version 1282781 (0.0007) [2023-12-28 04:28:40,527][106226] Updated weights for policy 0, policy_version 1282791 (0.0007) [2023-12-28 04:28:40,586][106226] Updated weights for policy 0, policy_version 1282801 (0.0007) [2023-12-28 04:28:41,090][106225] Updated weights for policy 1, policy_version 1286001 (0.0008) [2023-12-28 04:28:41,155][106225] Updated weights for policy 1, policy_version 1286011 (0.0008) [2023-12-28 04:28:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 657719296. Throughput: 0: 9901.3, 1: 9817.4. Samples: 657696476. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:41,175][105115] Avg episode reward: [(0, '-4.038'), (1, '-5.194')] [2023-12-28 04:28:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001282808_328458240.pth... [2023-12-28 04:28:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001281624_328155136.pth [2023-12-28 04:28:41,223][106225] Updated weights for policy 1, policy_version 1286021 (0.0007) [2023-12-28 04:28:41,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001286024_329269248.pth... [2023-12-28 04:28:41,250][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001284904_328982528.pth [2023-12-28 04:28:41,353][106226] Updated weights for policy 0, policy_version 1282811 (0.0009) [2023-12-28 04:28:41,424][106226] Updated weights for policy 0, policy_version 1282821 (0.0009) [2023-12-28 04:28:41,495][106226] Updated weights for policy 0, policy_version 1282831 (0.0008) [2023-12-28 04:28:42,023][106225] Updated weights for policy 1, policy_version 1286031 (0.0008) [2023-12-28 04:28:42,082][106225] Updated weights for policy 1, policy_version 1286041 (0.0008) [2023-12-28 04:28:42,141][106225] Updated weights for policy 1, policy_version 1286051 (0.0009) [2023-12-28 04:28:42,198][106226] Updated weights for policy 0, policy_version 1282841 (0.0009) [2023-12-28 04:28:42,271][106226] Updated weights for policy 0, policy_version 1282851 (0.0008) [2023-12-28 04:28:42,340][106226] Updated weights for policy 0, policy_version 1282861 (0.0009) [2023-12-28 04:28:42,409][106226] Updated weights for policy 0, policy_version 1282871 (0.0008) [2023-12-28 04:28:42,774][106225] Updated weights for policy 1, policy_version 1286061 (0.0007) [2023-12-28 04:28:42,823][106225] Updated weights for policy 1, policy_version 1286071 (0.0007) [2023-12-28 04:28:42,879][106225] Updated weights for policy 1, policy_version 1286081 (0.0007) [2023-12-28 04:28:43,155][106226] Updated weights for policy 0, policy_version 1282881 (0.0007) [2023-12-28 04:28:43,203][106226] Updated weights for policy 0, policy_version 1282891 (0.0008) [2023-12-28 04:28:43,249][106226] Updated weights for policy 0, policy_version 1282901 (0.0005) [2023-12-28 04:28:43,594][106225] Updated weights for policy 1, policy_version 1286091 (0.0008) [2023-12-28 04:28:43,649][106225] Updated weights for policy 1, policy_version 1286101 (0.0007) [2023-12-28 04:28:43,710][106225] Updated weights for policy 1, policy_version 1286111 (0.0008) [2023-12-28 04:28:43,874][106226] Updated weights for policy 0, policy_version 1282911 (0.0007) [2023-12-28 04:28:43,930][106226] Updated weights for policy 0, policy_version 1282921 (0.0009) [2023-12-28 04:28:43,988][106226] Updated weights for policy 0, policy_version 1282931 (0.0009) [2023-12-28 04:28:44,377][106225] Updated weights for policy 1, policy_version 1286121 (0.0008) [2023-12-28 04:28:44,438][106225] Updated weights for policy 1, policy_version 1286131 (0.0006) [2023-12-28 04:28:44,494][106225] Updated weights for policy 1, policy_version 1286141 (0.0008) [2023-12-28 04:28:44,542][106225] Updated weights for policy 1, policy_version 1286151 (0.0008) [2023-12-28 04:28:44,753][106226] Updated weights for policy 0, policy_version 1282941 (0.0009) [2023-12-28 04:28:44,814][106226] Updated weights for policy 0, policy_version 1282951 (0.0008) [2023-12-28 04:28:44,884][106226] Updated weights for policy 0, policy_version 1282961 (0.0006) [2023-12-28 04:28:45,291][106225] Updated weights for policy 1, policy_version 1286161 (0.0008) [2023-12-28 04:28:45,352][106225] Updated weights for policy 1, policy_version 1286171 (0.0008) [2023-12-28 04:28:45,405][106225] Updated weights for policy 1, policy_version 1286181 (0.0008) [2023-12-28 04:28:45,504][106226] Updated weights for policy 0, policy_version 1282971 (0.0008) [2023-12-28 04:28:45,562][106226] Updated weights for policy 0, policy_version 1282981 (0.0009) [2023-12-28 04:28:45,620][106226] Updated weights for policy 0, policy_version 1282991 (0.0008) [2023-12-28 04:28:46,160][106225] Updated weights for policy 1, policy_version 1286191 (0.0008) [2023-12-28 04:28:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 657817600. Throughput: 0: 9966.1, 1: 9742.8. Samples: 657812852. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:46,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-5.116')] [2023-12-28 04:28:46,221][106225] Updated weights for policy 1, policy_version 1286201 (0.0007) [2023-12-28 04:28:46,282][106225] Updated weights for policy 1, policy_version 1286211 (0.0005) [2023-12-28 04:28:46,404][106226] Updated weights for policy 0, policy_version 1283001 (0.0009) [2023-12-28 04:28:46,465][106226] Updated weights for policy 0, policy_version 1283011 (0.0011) [2023-12-28 04:28:46,523][106226] Updated weights for policy 0, policy_version 1283021 (0.0011) [2023-12-28 04:28:46,575][106226] Updated weights for policy 0, policy_version 1283031 (0.0010) [2023-12-28 04:28:46,867][106225] Updated weights for policy 1, policy_version 1286221 (0.0006) [2023-12-28 04:28:46,924][106225] Updated weights for policy 1, policy_version 1286231 (0.0007) [2023-12-28 04:28:46,988][106225] Updated weights for policy 1, policy_version 1286241 (0.0007) [2023-12-28 04:28:47,294][106226] Updated weights for policy 0, policy_version 1283041 (0.0006) [2023-12-28 04:28:47,345][106226] Updated weights for policy 0, policy_version 1283051 (0.0005) [2023-12-28 04:28:47,393][106226] Updated weights for policy 0, policy_version 1283061 (0.0005) [2023-12-28 04:28:47,594][106225] Updated weights for policy 1, policy_version 1286251 (0.0008) [2023-12-28 04:28:47,651][106225] Updated weights for policy 1, policy_version 1286261 (0.0008) [2023-12-28 04:28:47,709][106225] Updated weights for policy 1, policy_version 1286271 (0.0008) [2023-12-28 04:28:48,039][106226] Updated weights for policy 0, policy_version 1283071 (0.0010) [2023-12-28 04:28:48,092][106226] Updated weights for policy 0, policy_version 1283081 (0.0010) [2023-12-28 04:28:48,145][106226] Updated weights for policy 0, policy_version 1283091 (0.0010) [2023-12-28 04:28:48,431][106225] Updated weights for policy 1, policy_version 1286281 (0.0008) [2023-12-28 04:28:48,495][106225] Updated weights for policy 1, policy_version 1286291 (0.0009) [2023-12-28 04:28:48,550][106225] Updated weights for policy 1, policy_version 1286301 (0.0010) [2023-12-28 04:28:48,607][106225] Updated weights for policy 1, policy_version 1286311 (0.0008) [2023-12-28 04:28:48,817][106226] Updated weights for policy 0, policy_version 1283101 (0.0008) [2023-12-28 04:28:48,878][106226] Updated weights for policy 0, policy_version 1283111 (0.0009) [2023-12-28 04:28:48,938][106226] Updated weights for policy 0, policy_version 1283121 (0.0006) [2023-12-28 04:28:49,327][106225] Updated weights for policy 1, policy_version 1286321 (0.0006) [2023-12-28 04:28:49,398][106225] Updated weights for policy 1, policy_version 1286331 (0.0009) [2023-12-28 04:28:49,457][106225] Updated weights for policy 1, policy_version 1286341 (0.0010) [2023-12-28 04:28:49,534][106226] Updated weights for policy 0, policy_version 1283131 (0.0006) [2023-12-28 04:28:49,602][106226] Updated weights for policy 0, policy_version 1283141 (0.0008) [2023-12-28 04:28:49,669][106226] Updated weights for policy 0, policy_version 1283151 (0.0008) [2023-12-28 04:28:50,133][106225] Updated weights for policy 1, policy_version 1286351 (0.0007) [2023-12-28 04:28:50,196][106225] Updated weights for policy 1, policy_version 1286361 (0.0005) [2023-12-28 04:28:50,249][106225] Updated weights for policy 1, policy_version 1286371 (0.0008) [2023-12-28 04:28:50,327][106226] Updated weights for policy 0, policy_version 1283161 (0.0008) [2023-12-28 04:28:50,384][106226] Updated weights for policy 0, policy_version 1283171 (0.0008) [2023-12-28 04:28:50,443][106226] Updated weights for policy 0, policy_version 1283181 (0.0009) [2023-12-28 04:28:50,504][106226] Updated weights for policy 0, policy_version 1283191 (0.0008) [2023-12-28 04:28:50,898][106225] Updated weights for policy 1, policy_version 1286381 (0.0010) [2023-12-28 04:28:50,956][106225] Updated weights for policy 1, policy_version 1286391 (0.0010) [2023-12-28 04:28:51,022][106225] Updated weights for policy 1, policy_version 1286401 (0.0009) [2023-12-28 04:28:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 657924096. Throughput: 0: 10047.8, 1: 9775.0. Samples: 657934440. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:51,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.881')] [2023-12-28 04:28:51,194][106226] Updated weights for policy 0, policy_version 1283201 (0.0009) [2023-12-28 04:28:51,255][106226] Updated weights for policy 0, policy_version 1283211 (0.0007) [2023-12-28 04:28:51,318][106226] Updated weights for policy 0, policy_version 1283221 (0.0008) [2023-12-28 04:28:51,776][106225] Updated weights for policy 1, policy_version 1286411 (0.0008) [2023-12-28 04:28:51,834][106225] Updated weights for policy 1, policy_version 1286421 (0.0006) [2023-12-28 04:28:51,886][106225] Updated weights for policy 1, policy_version 1286431 (0.0007) [2023-12-28 04:28:52,054][106226] Updated weights for policy 0, policy_version 1283231 (0.0008) [2023-12-28 04:28:52,112][106226] Updated weights for policy 0, policy_version 1283241 (0.0008) [2023-12-28 04:28:52,181][106226] Updated weights for policy 0, policy_version 1283251 (0.0005) [2023-12-28 04:28:52,577][106225] Updated weights for policy 1, policy_version 1286441 (0.0006) [2023-12-28 04:28:52,632][106225] Updated weights for policy 1, policy_version 1286451 (0.0008) [2023-12-28 04:28:52,688][106225] Updated weights for policy 1, policy_version 1286461 (0.0008) [2023-12-28 04:28:52,748][106225] Updated weights for policy 1, policy_version 1286471 (0.0008) [2023-12-28 04:28:52,833][106226] Updated weights for policy 0, policy_version 1283261 (0.0007) [2023-12-28 04:28:52,895][106226] Updated weights for policy 0, policy_version 1283271 (0.0008) [2023-12-28 04:28:52,953][106226] Updated weights for policy 0, policy_version 1283281 (0.0007) [2023-12-28 04:28:53,392][106225] Updated weights for policy 1, policy_version 1286481 (0.0006) [2023-12-28 04:28:53,445][106225] Updated weights for policy 1, policy_version 1286491 (0.0005) [2023-12-28 04:28:53,500][106225] Updated weights for policy 1, policy_version 1286501 (0.0005) [2023-12-28 04:28:53,745][106226] Updated weights for policy 0, policy_version 1283291 (0.0007) [2023-12-28 04:28:53,794][106226] Updated weights for policy 0, policy_version 1283302 (0.0008) [2023-12-28 04:28:53,840][106226] Updated weights for policy 0, policy_version 1283312 (0.0009) [2023-12-28 04:28:54,092][106225] Updated weights for policy 1, policy_version 1286511 (0.0007) [2023-12-28 04:28:54,150][106225] Updated weights for policy 1, policy_version 1286521 (0.0009) [2023-12-28 04:28:54,210][106225] Updated weights for policy 1, policy_version 1286531 (0.0010) [2023-12-28 04:28:54,565][106226] Updated weights for policy 0, policy_version 1283322 (0.0008) [2023-12-28 04:28:54,632][106226] Updated weights for policy 0, policy_version 1283332 (0.0008) [2023-12-28 04:28:54,703][106226] Updated weights for policy 0, policy_version 1283342 (0.0009) [2023-12-28 04:28:54,772][106226] Updated weights for policy 0, policy_version 1283352 (0.0009) [2023-12-28 04:28:54,847][106225] Updated weights for policy 1, policy_version 1286541 (0.0007) [2023-12-28 04:28:54,911][106225] Updated weights for policy 1, policy_version 1286551 (0.0007) [2023-12-28 04:28:54,963][106225] Updated weights for policy 1, policy_version 1286561 (0.0006) [2023-12-28 04:28:55,520][106226] Updated weights for policy 0, policy_version 1283362 (0.0005) [2023-12-28 04:28:55,543][106225] Updated weights for policy 1, policy_version 1286571 (0.0009) [2023-12-28 04:28:55,577][106226] Updated weights for policy 0, policy_version 1283372 (0.0007) [2023-12-28 04:28:55,601][106225] Updated weights for policy 1, policy_version 1286581 (0.0007) [2023-12-28 04:28:55,642][106226] Updated weights for policy 0, policy_version 1283382 (0.0007) [2023-12-28 04:28:55,660][106225] Updated weights for policy 1, policy_version 1286591 (0.0006) [2023-12-28 04:28:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 658022400. Throughput: 0: 10000.2, 1: 9739.6. Samples: 657993520. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:28:56,175][105115] Avg episode reward: [(0, '-4.185'), (1, '-5.036')] [2023-12-28 04:28:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001286600_329416704.pth... [2023-12-28 04:28:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001283384_328605696.pth... [2023-12-28 04:28:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001285448_329121792.pth [2023-12-28 04:28:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001282232_328310784.pth [2023-12-28 04:28:56,314][106226] Updated weights for policy 0, policy_version 1283392 (0.0009) [2023-12-28 04:28:56,378][106226] Updated weights for policy 0, policy_version 1283402 (0.0009) [2023-12-28 04:28:56,392][106225] Updated weights for policy 1, policy_version 1286601 (0.0010) [2023-12-28 04:28:56,443][106225] Updated weights for policy 1, policy_version 1286611 (0.0006) [2023-12-28 04:28:56,443][106226] Updated weights for policy 0, policy_version 1283412 (0.0009) [2023-12-28 04:28:56,498][106225] Updated weights for policy 1, policy_version 1286621 (0.0008) [2023-12-28 04:28:56,552][106225] Updated weights for policy 1, policy_version 1286631 (0.0009) [2023-12-28 04:28:57,151][106226] Updated weights for policy 0, policy_version 1283422 (0.0009) [2023-12-28 04:28:57,210][106226] Updated weights for policy 0, policy_version 1283432 (0.0008) [2023-12-28 04:28:57,269][106226] Updated weights for policy 0, policy_version 1283442 (0.0006) [2023-12-28 04:28:57,277][106225] Updated weights for policy 1, policy_version 1286641 (0.0007) [2023-12-28 04:28:57,342][106225] Updated weights for policy 1, policy_version 1286651 (0.0007) [2023-12-28 04:28:57,400][106225] Updated weights for policy 1, policy_version 1286661 (0.0008) [2023-12-28 04:28:57,957][106226] Updated weights for policy 0, policy_version 1283452 (0.0006) [2023-12-28 04:28:58,003][106226] Updated weights for policy 0, policy_version 1283462 (0.0009) [2023-12-28 04:28:58,047][106226] Updated weights for policy 0, policy_version 1283472 (0.0009) [2023-12-28 04:28:58,077][106225] Updated weights for policy 1, policy_version 1286671 (0.0008) [2023-12-28 04:28:58,128][106225] Updated weights for policy 1, policy_version 1286681 (0.0008) [2023-12-28 04:28:58,176][106225] Updated weights for policy 1, policy_version 1286691 (0.0008) [2023-12-28 04:28:58,858][106226] Updated weights for policy 0, policy_version 1283482 (0.0007) [2023-12-28 04:28:58,922][106226] Updated weights for policy 0, policy_version 1283492 (0.0008) [2023-12-28 04:28:58,997][106226] Updated weights for policy 0, policy_version 1283502 (0.0008) [2023-12-28 04:28:59,034][106225] Updated weights for policy 1, policy_version 1286701 (0.0008) [2023-12-28 04:28:59,060][106226] Updated weights for policy 0, policy_version 1283512 (0.0008) [2023-12-28 04:28:59,088][106225] Updated weights for policy 1, policy_version 1286711 (0.0008) [2023-12-28 04:28:59,157][106225] Updated weights for policy 1, policy_version 1286721 (0.0008) [2023-12-28 04:28:59,835][106226] Updated weights for policy 0, policy_version 1283522 (0.0006) [2023-12-28 04:28:59,883][106225] Updated weights for policy 1, policy_version 1286731 (0.0008) [2023-12-28 04:28:59,905][106226] Updated weights for policy 0, policy_version 1283532 (0.0007) [2023-12-28 04:28:59,941][106225] Updated weights for policy 1, policy_version 1286741 (0.0007) [2023-12-28 04:28:59,970][106226] Updated weights for policy 0, policy_version 1283542 (0.0011) [2023-12-28 04:29:00,000][106225] Updated weights for policy 1, policy_version 1286751 (0.0006) [2023-12-28 04:29:00,572][106225] Updated weights for policy 1, policy_version 1286761 (0.0005) [2023-12-28 04:29:00,585][106226] Updated weights for policy 0, policy_version 1283552 (0.0011) [2023-12-28 04:29:00,627][106225] Updated weights for policy 1, policy_version 1286771 (0.0005) [2023-12-28 04:29:00,646][106226] Updated weights for policy 0, policy_version 1283562 (0.0010) [2023-12-28 04:29:00,670][106225] Updated weights for policy 1, policy_version 1286781 (0.0005) [2023-12-28 04:29:00,705][106226] Updated weights for policy 0, policy_version 1283572 (0.0010) [2023-12-28 04:29:00,714][106225] Updated weights for policy 1, policy_version 1286791 (0.0005) [2023-12-28 04:29:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 658120704. Throughput: 0: 9973.2, 1: 9756.9. Samples: 658109932. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:01,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.950')] [2023-12-28 04:29:01,348][106226] Updated weights for policy 0, policy_version 1283582 (0.0009) [2023-12-28 04:29:01,415][106226] Updated weights for policy 0, policy_version 1283592 (0.0008) [2023-12-28 04:29:01,436][106225] Updated weights for policy 1, policy_version 1286801 (0.0007) [2023-12-28 04:29:01,475][106226] Updated weights for policy 0, policy_version 1283602 (0.0007) [2023-12-28 04:29:01,495][106225] Updated weights for policy 1, policy_version 1286811 (0.0008) [2023-12-28 04:29:01,546][106225] Updated weights for policy 1, policy_version 1286821 (0.0008) [2023-12-28 04:29:02,154][106226] Updated weights for policy 0, policy_version 1283612 (0.0009) [2023-12-28 04:29:02,212][106226] Updated weights for policy 0, policy_version 1283622 (0.0008) [2023-12-28 04:29:02,270][106226] Updated weights for policy 0, policy_version 1283632 (0.0008) [2023-12-28 04:29:02,340][106225] Updated weights for policy 1, policy_version 1286831 (0.0009) [2023-12-28 04:29:02,410][106225] Updated weights for policy 1, policy_version 1286841 (0.0009) [2023-12-28 04:29:02,469][106225] Updated weights for policy 1, policy_version 1286851 (0.0008) [2023-12-28 04:29:02,934][106226] Updated weights for policy 0, policy_version 1283642 (0.0006) [2023-12-28 04:29:02,998][106226] Updated weights for policy 0, policy_version 1283652 (0.0008) [2023-12-28 04:29:03,051][106226] Updated weights for policy 0, policy_version 1283662 (0.0008) [2023-12-28 04:29:03,105][106226] Updated weights for policy 0, policy_version 1283672 (0.0006) [2023-12-28 04:29:03,129][106225] Updated weights for policy 1, policy_version 1286861 (0.0007) [2023-12-28 04:29:03,187][106225] Updated weights for policy 1, policy_version 1286871 (0.0009) [2023-12-28 04:29:03,244][106225] Updated weights for policy 1, policy_version 1286881 (0.0011) [2023-12-28 04:29:03,780][106226] Updated weights for policy 0, policy_version 1283682 (0.0006) [2023-12-28 04:29:03,835][106226] Updated weights for policy 0, policy_version 1283692 (0.0007) [2023-12-28 04:29:03,883][106225] Updated weights for policy 1, policy_version 1286891 (0.0009) [2023-12-28 04:29:03,903][106226] Updated weights for policy 0, policy_version 1283702 (0.0009) [2023-12-28 04:29:03,949][106225] Updated weights for policy 1, policy_version 1286901 (0.0007) [2023-12-28 04:29:04,010][106225] Updated weights for policy 1, policy_version 1286911 (0.0011) [2023-12-28 04:29:04,628][106226] Updated weights for policy 0, policy_version 1283712 (0.0008) [2023-12-28 04:29:04,694][106226] Updated weights for policy 0, policy_version 1283722 (0.0008) [2023-12-28 04:29:04,724][106225] Updated weights for policy 1, policy_version 1286921 (0.0010) [2023-12-28 04:29:04,756][106226] Updated weights for policy 0, policy_version 1283732 (0.0008) [2023-12-28 04:29:04,783][106225] Updated weights for policy 1, policy_version 1286931 (0.0006) [2023-12-28 04:29:04,845][106225] Updated weights for policy 1, policy_version 1286941 (0.0005) [2023-12-28 04:29:04,905][106225] Updated weights for policy 1, policy_version 1286951 (0.0005) [2023-12-28 04:29:05,465][106225] Updated weights for policy 1, policy_version 1286961 (0.0005) [2023-12-28 04:29:05,476][106226] Updated weights for policy 0, policy_version 1283742 (0.0008) [2023-12-28 04:29:05,520][106225] Updated weights for policy 1, policy_version 1286971 (0.0006) [2023-12-28 04:29:05,534][106226] Updated weights for policy 0, policy_version 1283752 (0.0007) [2023-12-28 04:29:05,577][106225] Updated weights for policy 1, policy_version 1286981 (0.0008) [2023-12-28 04:29:05,585][106226] Updated weights for policy 0, policy_version 1283762 (0.0008) [2023-12-28 04:29:06,160][106225] Updated weights for policy 1, policy_version 1286993 (0.0008) [2023-12-28 04:29:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 658219008. Throughput: 0: 9961.8, 1: 9835.7. Samples: 658231080. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:06,175][105115] Avg episode reward: [(0, '-4.165'), (1, '-5.089')] [2023-12-28 04:29:06,222][106225] Updated weights for policy 1, policy_version 1287003 (0.0006) [2023-12-28 04:29:06,286][106225] Updated weights for policy 1, policy_version 1287013 (0.0006) [2023-12-28 04:29:06,367][106226] Updated weights for policy 0, policy_version 1283772 (0.0008) [2023-12-28 04:29:06,426][106226] Updated weights for policy 0, policy_version 1283782 (0.0011) [2023-12-28 04:29:06,496][106226] Updated weights for policy 0, policy_version 1283792 (0.0011) [2023-12-28 04:29:06,938][106225] Updated weights for policy 1, policy_version 1287023 (0.0009) [2023-12-28 04:29:06,992][106225] Updated weights for policy 1, policy_version 1287033 (0.0008) [2023-12-28 04:29:07,050][106225] Updated weights for policy 1, policy_version 1287043 (0.0007) [2023-12-28 04:29:07,189][106226] Updated weights for policy 0, policy_version 1283802 (0.0010) [2023-12-28 04:29:07,253][106226] Updated weights for policy 0, policy_version 1283812 (0.0006) [2023-12-28 04:29:07,307][106226] Updated weights for policy 0, policy_version 1283822 (0.0005) [2023-12-28 04:29:07,374][106226] Updated weights for policy 0, policy_version 1283832 (0.0005) [2023-12-28 04:29:07,654][106225] Updated weights for policy 1, policy_version 1287053 (0.0010) [2023-12-28 04:29:07,707][106225] Updated weights for policy 1, policy_version 1287063 (0.0010) [2023-12-28 04:29:07,772][106225] Updated weights for policy 1, policy_version 1287073 (0.0010) [2023-12-28 04:29:07,945][106226] Updated weights for policy 0, policy_version 1283842 (0.0010) [2023-12-28 04:29:08,007][106226] Updated weights for policy 0, policy_version 1283852 (0.0010) [2023-12-28 04:29:08,060][106226] Updated weights for policy 0, policy_version 1283862 (0.0006) [2023-12-28 04:29:08,487][106225] Updated weights for policy 1, policy_version 1287083 (0.0011) [2023-12-28 04:29:08,549][106225] Updated weights for policy 1, policy_version 1287093 (0.0010) [2023-12-28 04:29:08,613][106225] Updated weights for policy 1, policy_version 1287103 (0.0010) [2023-12-28 04:29:08,780][106226] Updated weights for policy 0, policy_version 1283872 (0.0008) [2023-12-28 04:29:08,848][106226] Updated weights for policy 0, policy_version 1283882 (0.0008) [2023-12-28 04:29:08,917][106226] Updated weights for policy 0, policy_version 1283892 (0.0008) [2023-12-28 04:29:09,330][106225] Updated weights for policy 1, policy_version 1287113 (0.0010) [2023-12-28 04:29:09,399][106225] Updated weights for policy 1, policy_version 1287123 (0.0008) [2023-12-28 04:29:09,467][106225] Updated weights for policy 1, policy_version 1287133 (0.0007) [2023-12-28 04:29:09,521][106225] Updated weights for policy 1, policy_version 1287143 (0.0006) [2023-12-28 04:29:09,682][106226] Updated weights for policy 0, policy_version 1283902 (0.0009) [2023-12-28 04:29:09,757][106226] Updated weights for policy 0, policy_version 1283912 (0.0009) [2023-12-28 04:29:09,831][106226] Updated weights for policy 0, policy_version 1283922 (0.0010) [2023-12-28 04:29:10,306][106225] Updated weights for policy 1, policy_version 1287153 (0.0010) [2023-12-28 04:29:10,366][106225] Updated weights for policy 1, policy_version 1287163 (0.0011) [2023-12-28 04:29:10,427][106225] Updated weights for policy 1, policy_version 1287173 (0.0010) [2023-12-28 04:29:10,582][106226] Updated weights for policy 0, policy_version 1283932 (0.0007) [2023-12-28 04:29:10,651][106226] Updated weights for policy 0, policy_version 1283942 (0.0007) [2023-12-28 04:29:10,714][106226] Updated weights for policy 0, policy_version 1283952 (0.0008) [2023-12-28 04:29:11,136][106225] Updated weights for policy 1, policy_version 1287183 (0.0010) [2023-12-28 04:29:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 658317312. Throughput: 0: 9934.2, 1: 9945.5. Samples: 658292768. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:11,175][105115] Avg episode reward: [(0, '-4.143'), (1, '-5.159')] [2023-12-28 04:29:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001283960_328753152.pth... [2023-12-28 04:29:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001282808_328458240.pth [2023-12-28 04:29:11,200][106225] Updated weights for policy 1, policy_version 1287193 (0.0011) [2023-12-28 04:29:11,264][106225] Updated weights for policy 1, policy_version 1287203 (0.0011) [2023-12-28 04:29:11,297][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001287208_329572352.pth... [2023-12-28 04:29:11,300][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001286024_329269248.pth [2023-12-28 04:29:11,436][106226] Updated weights for policy 0, policy_version 1283962 (0.0008) [2023-12-28 04:29:11,498][106226] Updated weights for policy 0, policy_version 1283972 (0.0008) [2023-12-28 04:29:11,564][106226] Updated weights for policy 0, policy_version 1283982 (0.0009) [2023-12-28 04:29:11,633][106226] Updated weights for policy 0, policy_version 1283992 (0.0008) [2023-12-28 04:29:12,042][106225] Updated weights for policy 1, policy_version 1287213 (0.0010) [2023-12-28 04:29:12,114][106225] Updated weights for policy 1, policy_version 1287223 (0.0009) [2023-12-28 04:29:12,180][106225] Updated weights for policy 1, policy_version 1287233 (0.0009) [2023-12-28 04:29:12,449][106226] Updated weights for policy 0, policy_version 1284002 (0.0008) [2023-12-28 04:29:12,512][106226] Updated weights for policy 0, policy_version 1284012 (0.0007) [2023-12-28 04:29:12,578][106226] Updated weights for policy 0, policy_version 1284022 (0.0007) [2023-12-28 04:29:12,935][106225] Updated weights for policy 1, policy_version 1287243 (0.0009) [2023-12-28 04:29:12,996][106225] Updated weights for policy 1, policy_version 1287253 (0.0009) [2023-12-28 04:29:13,061][106225] Updated weights for policy 1, policy_version 1287263 (0.0009) [2023-12-28 04:29:13,231][106226] Updated weights for policy 0, policy_version 1284032 (0.0006) [2023-12-28 04:29:13,283][106226] Updated weights for policy 0, policy_version 1284042 (0.0008) [2023-12-28 04:29:13,327][106226] Updated weights for policy 0, policy_version 1284052 (0.0008) [2023-12-28 04:29:13,771][106225] Updated weights for policy 1, policy_version 1287273 (0.0009) [2023-12-28 04:29:13,839][106225] Updated weights for policy 1, policy_version 1287283 (0.0010) [2023-12-28 04:29:13,905][106225] Updated weights for policy 1, policy_version 1287293 (0.0009) [2023-12-28 04:29:13,964][106225] Updated weights for policy 1, policy_version 1287303 (0.0006) [2023-12-28 04:29:13,973][106226] Updated weights for policy 0, policy_version 1284062 (0.0007) [2023-12-28 04:29:14,028][106226] Updated weights for policy 0, policy_version 1284072 (0.0009) [2023-12-28 04:29:14,088][106226] Updated weights for policy 0, policy_version 1284082 (0.0011) [2023-12-28 04:29:14,641][106225] Updated weights for policy 1, policy_version 1287313 (0.0008) [2023-12-28 04:29:14,697][106225] Updated weights for policy 1, policy_version 1287323 (0.0007) [2023-12-28 04:29:14,721][106226] Updated weights for policy 0, policy_version 1284092 (0.0011) [2023-12-28 04:29:14,750][106225] Updated weights for policy 1, policy_version 1287333 (0.0006) [2023-12-28 04:29:14,784][106226] Updated weights for policy 0, policy_version 1284102 (0.0010) [2023-12-28 04:29:14,845][106226] Updated weights for policy 0, policy_version 1284112 (0.0007) [2023-12-28 04:29:15,432][106225] Updated weights for policy 1, policy_version 1287343 (0.0006) [2023-12-28 04:29:15,484][106225] Updated weights for policy 1, policy_version 1287353 (0.0005) [2023-12-28 04:29:15,538][106225] Updated weights for policy 1, policy_version 1287363 (0.0005) [2023-12-28 04:29:15,567][106226] Updated weights for policy 0, policy_version 1284122 (0.0007) [2023-12-28 04:29:15,630][106226] Updated weights for policy 0, policy_version 1284132 (0.0011) [2023-12-28 04:29:15,683][106226] Updated weights for policy 0, policy_version 1284142 (0.0010) [2023-12-28 04:29:15,739][106226] Updated weights for policy 0, policy_version 1284152 (0.0010) [2023-12-28 04:29:16,070][106225] Updated weights for policy 1, policy_version 1287373 (0.0005) [2023-12-28 04:29:16,122][106225] Updated weights for policy 1, policy_version 1287383 (0.0006) [2023-12-28 04:29:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 658415616. Throughput: 0: 9816.1, 1: 9946.3. Samples: 658407048. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:16,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.809')] [2023-12-28 04:29:16,188][106225] Updated weights for policy 1, policy_version 1287393 (0.0009) [2023-12-28 04:29:16,462][106226] Updated weights for policy 0, policy_version 1284162 (0.0010) [2023-12-28 04:29:16,533][106226] Updated weights for policy 0, policy_version 1284172 (0.0011) [2023-12-28 04:29:16,595][106226] Updated weights for policy 0, policy_version 1284182 (0.0011) [2023-12-28 04:29:16,856][106225] Updated weights for policy 1, policy_version 1287403 (0.0010) [2023-12-28 04:29:16,913][106225] Updated weights for policy 1, policy_version 1287413 (0.0010) [2023-12-28 04:29:16,968][106225] Updated weights for policy 1, policy_version 1287423 (0.0009) [2023-12-28 04:29:17,266][106226] Updated weights for policy 0, policy_version 1284192 (0.0010) [2023-12-28 04:29:17,316][106226] Updated weights for policy 0, policy_version 1284202 (0.0007) [2023-12-28 04:29:17,371][106226] Updated weights for policy 0, policy_version 1284212 (0.0008) [2023-12-28 04:29:17,644][106225] Updated weights for policy 1, policy_version 1287433 (0.0005) [2023-12-28 04:29:17,706][106225] Updated weights for policy 1, policy_version 1287443 (0.0006) [2023-12-28 04:29:17,754][106225] Updated weights for policy 1, policy_version 1287453 (0.0008) [2023-12-28 04:29:17,810][106225] Updated weights for policy 1, policy_version 1287463 (0.0008) [2023-12-28 04:29:18,006][106226] Updated weights for policy 0, policy_version 1284222 (0.0007) [2023-12-28 04:29:18,070][106226] Updated weights for policy 0, policy_version 1284232 (0.0007) [2023-12-28 04:29:18,135][106226] Updated weights for policy 0, policy_version 1284242 (0.0007) [2023-12-28 04:29:18,502][106225] Updated weights for policy 1, policy_version 1287473 (0.0008) [2023-12-28 04:29:18,564][106225] Updated weights for policy 1, policy_version 1287483 (0.0008) [2023-12-28 04:29:18,625][106225] Updated weights for policy 1, policy_version 1287493 (0.0008) [2023-12-28 04:29:18,756][106226] Updated weights for policy 0, policy_version 1284252 (0.0008) [2023-12-28 04:29:18,823][106226] Updated weights for policy 0, policy_version 1284262 (0.0011) [2023-12-28 04:29:18,889][106226] Updated weights for policy 0, policy_version 1284272 (0.0011) [2023-12-28 04:29:19,250][106225] Updated weights for policy 1, policy_version 1287503 (0.0008) [2023-12-28 04:29:19,310][106225] Updated weights for policy 1, policy_version 1287513 (0.0007) [2023-12-28 04:29:19,375][106225] Updated weights for policy 1, policy_version 1287523 (0.0008) [2023-12-28 04:29:19,577][106226] Updated weights for policy 0, policy_version 1284282 (0.0010) [2023-12-28 04:29:19,640][106226] Updated weights for policy 0, policy_version 1284292 (0.0006) [2023-12-28 04:29:19,705][106226] Updated weights for policy 0, policy_version 1284302 (0.0008) [2023-12-28 04:29:19,798][106226] Updated weights for policy 0, policy_version 1284312 (0.0009) [2023-12-28 04:29:20,109][106225] Updated weights for policy 1, policy_version 1287533 (0.0009) [2023-12-28 04:29:20,159][106225] Updated weights for policy 1, policy_version 1287543 (0.0007) [2023-12-28 04:29:20,217][106225] Updated weights for policy 1, policy_version 1287553 (0.0009) [2023-12-28 04:29:20,501][106226] Updated weights for policy 0, policy_version 1284322 (0.0005) [2023-12-28 04:29:20,553][106226] Updated weights for policy 0, policy_version 1284332 (0.0005) [2023-12-28 04:29:20,639][106226] Updated weights for policy 0, policy_version 1284342 (0.0008) [2023-12-28 04:29:20,969][106225] Updated weights for policy 1, policy_version 1287563 (0.0008) [2023-12-28 04:29:21,053][106225] Updated weights for policy 1, policy_version 1287573 (0.0008) [2023-12-28 04:29:21,117][106225] Updated weights for policy 1, policy_version 1287583 (0.0007) [2023-12-28 04:29:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 658522112. Throughput: 0: 9826.8, 1: 10014.2. Samples: 658529468. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:21,175][105115] Avg episode reward: [(0, '-4.220'), (1, '-5.270')] [2023-12-28 04:29:21,456][106226] Updated weights for policy 0, policy_version 1284352 (0.0009) [2023-12-28 04:29:21,517][106226] Updated weights for policy 0, policy_version 1284362 (0.0009) [2023-12-28 04:29:21,578][106226] Updated weights for policy 0, policy_version 1284372 (0.0007) [2023-12-28 04:29:21,868][106225] Updated weights for policy 1, policy_version 1287593 (0.0008) [2023-12-28 04:29:21,937][106225] Updated weights for policy 1, policy_version 1287603 (0.0006) [2023-12-28 04:29:21,991][106225] Updated weights for policy 1, policy_version 1287613 (0.0006) [2023-12-28 04:29:22,052][106225] Updated weights for policy 1, policy_version 1287623 (0.0008) [2023-12-28 04:29:22,335][106226] Updated weights for policy 0, policy_version 1284382 (0.0009) [2023-12-28 04:29:22,406][106226] Updated weights for policy 0, policy_version 1284392 (0.0009) [2023-12-28 04:29:22,477][106226] Updated weights for policy 0, policy_version 1284402 (0.0008) [2023-12-28 04:29:22,699][106225] Updated weights for policy 1, policy_version 1287633 (0.0009) [2023-12-28 04:29:22,759][106225] Updated weights for policy 1, policy_version 1287643 (0.0008) [2023-12-28 04:29:22,821][106225] Updated weights for policy 1, policy_version 1287653 (0.0008) [2023-12-28 04:29:23,215][106226] Updated weights for policy 0, policy_version 1284412 (0.0008) [2023-12-28 04:29:23,277][106226] Updated weights for policy 0, policy_version 1284422 (0.0008) [2023-12-28 04:29:23,337][106226] Updated weights for policy 0, policy_version 1284432 (0.0008) [2023-12-28 04:29:23,559][106225] Updated weights for policy 1, policy_version 1287663 (0.0009) [2023-12-28 04:29:23,620][106225] Updated weights for policy 1, policy_version 1287673 (0.0008) [2023-12-28 04:29:23,685][106225] Updated weights for policy 1, policy_version 1287683 (0.0007) [2023-12-28 04:29:24,014][106226] Updated weights for policy 0, policy_version 1284442 (0.0008) [2023-12-28 04:29:24,068][106226] Updated weights for policy 0, policy_version 1284452 (0.0010) [2023-12-28 04:29:24,124][106226] Updated weights for policy 0, policy_version 1284462 (0.0010) [2023-12-28 04:29:24,191][106226] Updated weights for policy 0, policy_version 1284472 (0.0008) [2023-12-28 04:29:24,419][106225] Updated weights for policy 1, policy_version 1287693 (0.0007) [2023-12-28 04:29:24,474][106225] Updated weights for policy 1, policy_version 1287703 (0.0007) [2023-12-28 04:29:24,533][106225] Updated weights for policy 1, policy_version 1287713 (0.0008) [2023-12-28 04:29:24,890][106226] Updated weights for policy 0, policy_version 1284482 (0.0011) [2023-12-28 04:29:24,943][106226] Updated weights for policy 0, policy_version 1284492 (0.0010) [2023-12-28 04:29:24,991][106226] Updated weights for policy 0, policy_version 1284502 (0.0010) [2023-12-28 04:29:25,205][106225] Updated weights for policy 1, policy_version 1287723 (0.0007) [2023-12-28 04:29:25,272][106225] Updated weights for policy 1, policy_version 1287733 (0.0006) [2023-12-28 04:29:25,334][106225] Updated weights for policy 1, policy_version 1287743 (0.0010) [2023-12-28 04:29:25,729][106226] Updated weights for policy 0, policy_version 1284512 (0.0010) [2023-12-28 04:29:25,786][106226] Updated weights for policy 0, policy_version 1284522 (0.0010) [2023-12-28 04:29:25,848][106226] Updated weights for policy 0, policy_version 1284532 (0.0010) [2023-12-28 04:29:26,018][106225] Updated weights for policy 1, policy_version 1287753 (0.0010) [2023-12-28 04:29:26,075][106225] Updated weights for policy 1, policy_version 1287763 (0.0010) [2023-12-28 04:29:26,139][106225] Updated weights for policy 1, policy_version 1287773 (0.0006) [2023-12-28 04:29:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 658612224. Throughput: 0: 9769.0, 1: 10011.6. Samples: 658586600. Policy #0 lag: (min: 14.0, avg: 22.4, max: 46.0) [2023-12-28 04:29:26,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.959')] [2023-12-28 04:29:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001284536_328900608.pth... [2023-12-28 04:29:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001283384_328605696.pth [2023-12-28 04:29:26,205][106225] Updated weights for policy 1, policy_version 1287783 (0.0005) [2023-12-28 04:29:26,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001287784_329719808.pth... [2023-12-28 04:29:26,212][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001286600_329416704.pth [2023-12-28 04:29:26,554][106226] Updated weights for policy 0, policy_version 1284542 (0.0010) [2023-12-28 04:29:26,616][106226] Updated weights for policy 0, policy_version 1284552 (0.0010) [2023-12-28 04:29:26,671][106226] Updated weights for policy 0, policy_version 1284562 (0.0010) [2023-12-28 04:29:26,877][106225] Updated weights for policy 1, policy_version 1287793 (0.0010) [2023-12-28 04:29:26,934][106225] Updated weights for policy 1, policy_version 1287803 (0.0010) [2023-12-28 04:29:26,987][106225] Updated weights for policy 1, policy_version 1287813 (0.0010) [2023-12-28 04:29:27,267][106226] Updated weights for policy 0, policy_version 1284572 (0.0008) [2023-12-28 04:29:27,328][106226] Updated weights for policy 0, policy_version 1284582 (0.0008) [2023-12-28 04:29:27,376][106226] Updated weights for policy 0, policy_version 1284592 (0.0005) [2023-12-28 04:29:27,688][106225] Updated weights for policy 1, policy_version 1287823 (0.0010) [2023-12-28 04:29:27,738][106225] Updated weights for policy 1, policy_version 1287833 (0.0010) [2023-12-28 04:29:27,794][106225] Updated weights for policy 1, policy_version 1287843 (0.0010) [2023-12-28 04:29:27,989][106226] Updated weights for policy 0, policy_version 1284602 (0.0006) [2023-12-28 04:29:28,051][106226] Updated weights for policy 0, policy_version 1284612 (0.0009) [2023-12-28 04:29:28,119][106226] Updated weights for policy 0, policy_version 1284622 (0.0006) [2023-12-28 04:29:28,189][106226] Updated weights for policy 0, policy_version 1284632 (0.0005) [2023-12-28 04:29:28,444][106225] Updated weights for policy 1, policy_version 1287853 (0.0009) [2023-12-28 04:29:28,510][106225] Updated weights for policy 1, policy_version 1287863 (0.0008) [2023-12-28 04:29:28,569][106225] Updated weights for policy 1, policy_version 1287873 (0.0006) [2023-12-28 04:29:28,770][106226] Updated weights for policy 0, policy_version 1284642 (0.0011) [2023-12-28 04:29:28,834][106226] Updated weights for policy 0, policy_version 1284652 (0.0011) [2023-12-28 04:29:28,897][106226] Updated weights for policy 0, policy_version 1284662 (0.0010) [2023-12-28 04:29:29,193][106225] Updated weights for policy 1, policy_version 1287883 (0.0007) [2023-12-28 04:29:29,257][106225] Updated weights for policy 1, policy_version 1287893 (0.0009) [2023-12-28 04:29:29,323][106225] Updated weights for policy 1, policy_version 1287903 (0.0008) [2023-12-28 04:29:29,566][106226] Updated weights for policy 0, policy_version 1284672 (0.0008) [2023-12-28 04:29:29,631][106226] Updated weights for policy 0, policy_version 1284682 (0.0009) [2023-12-28 04:29:29,690][106226] Updated weights for policy 0, policy_version 1284692 (0.0011) [2023-12-28 04:29:30,014][106225] Updated weights for policy 1, policy_version 1287913 (0.0008) [2023-12-28 04:29:30,076][106225] Updated weights for policy 1, policy_version 1287923 (0.0010) [2023-12-28 04:29:30,131][106225] Updated weights for policy 1, policy_version 1287933 (0.0010) [2023-12-28 04:29:30,185][106225] Updated weights for policy 1, policy_version 1287943 (0.0010) [2023-12-28 04:29:30,413][106226] Updated weights for policy 0, policy_version 1284702 (0.0011) [2023-12-28 04:29:30,463][106226] Updated weights for policy 0, policy_version 1284712 (0.0010) [2023-12-28 04:29:30,509][106226] Updated weights for policy 0, policy_version 1284722 (0.0010) [2023-12-28 04:29:30,891][106225] Updated weights for policy 1, policy_version 1287953 (0.0010) [2023-12-28 04:29:30,963][106225] Updated weights for policy 1, policy_version 1287963 (0.0010) [2023-12-28 04:29:31,029][106225] Updated weights for policy 1, policy_version 1287973 (0.0009) [2023-12-28 04:29:31,112][106226] Updated weights for policy 0, policy_version 1284732 (0.0009) [2023-12-28 04:29:31,175][106226] Updated weights for policy 0, policy_version 1284742 (0.0009) [2023-12-28 04:29:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 658718720. Throughput: 0: 9863.2, 1: 10058.5. Samples: 658709328. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:31,175][105115] Avg episode reward: [(0, '-4.142'), (1, '-5.017')] [2023-12-28 04:29:31,223][106226] Updated weights for policy 0, policy_version 1284752 (0.0009) [2023-12-28 04:29:31,708][106225] Updated weights for policy 1, policy_version 1287983 (0.0006) [2023-12-28 04:29:31,779][106225] Updated weights for policy 1, policy_version 1287993 (0.0006) [2023-12-28 04:29:31,843][106225] Updated weights for policy 1, policy_version 1288003 (0.0006) [2023-12-28 04:29:32,055][106226] Updated weights for policy 0, policy_version 1284762 (0.0008) [2023-12-28 04:29:32,106][106226] Updated weights for policy 0, policy_version 1284772 (0.0009) [2023-12-28 04:29:32,158][106226] Updated weights for policy 0, policy_version 1284782 (0.0009) [2023-12-28 04:29:32,215][106226] Updated weights for policy 0, policy_version 1284792 (0.0008) [2023-12-28 04:29:32,430][106225] Updated weights for policy 1, policy_version 1288013 (0.0006) [2023-12-28 04:29:32,496][106225] Updated weights for policy 1, policy_version 1288023 (0.0007) [2023-12-28 04:29:32,558][106225] Updated weights for policy 1, policy_version 1288033 (0.0008) [2023-12-28 04:29:32,948][106226] Updated weights for policy 0, policy_version 1284802 (0.0006) [2023-12-28 04:29:33,014][106226] Updated weights for policy 0, policy_version 1284812 (0.0011) [2023-12-28 04:29:33,075][106226] Updated weights for policy 0, policy_version 1284822 (0.0010) [2023-12-28 04:29:33,308][106225] Updated weights for policy 1, policy_version 1288043 (0.0007) [2023-12-28 04:29:33,366][106225] Updated weights for policy 1, policy_version 1288053 (0.0005) [2023-12-28 04:29:33,430][106225] Updated weights for policy 1, policy_version 1288063 (0.0005) [2023-12-28 04:29:33,717][106226] Updated weights for policy 0, policy_version 1284832 (0.0011) [2023-12-28 04:29:33,789][106226] Updated weights for policy 0, policy_version 1284842 (0.0010) [2023-12-28 04:29:33,848][106226] Updated weights for policy 0, policy_version 1284852 (0.0010) [2023-12-28 04:29:33,994][106225] Updated weights for policy 1, policy_version 1288073 (0.0006) [2023-12-28 04:29:34,078][106225] Updated weights for policy 1, policy_version 1288083 (0.0010) [2023-12-28 04:29:34,139][106225] Updated weights for policy 1, policy_version 1288093 (0.0009) [2023-12-28 04:29:34,207][106225] Updated weights for policy 1, policy_version 1288103 (0.0007) [2023-12-28 04:29:34,534][106226] Updated weights for policy 0, policy_version 1284862 (0.0011) [2023-12-28 04:29:34,595][106226] Updated weights for policy 0, policy_version 1284872 (0.0011) [2023-12-28 04:29:34,656][106226] Updated weights for policy 0, policy_version 1284882 (0.0011) [2023-12-28 04:29:34,856][106225] Updated weights for policy 1, policy_version 1288113 (0.0010) [2023-12-28 04:29:34,912][106225] Updated weights for policy 1, policy_version 1288123 (0.0010) [2023-12-28 04:29:34,971][106225] Updated weights for policy 1, policy_version 1288133 (0.0010) [2023-12-28 04:29:35,292][106226] Updated weights for policy 0, policy_version 1284892 (0.0010) [2023-12-28 04:29:35,353][106226] Updated weights for policy 0, policy_version 1284902 (0.0011) [2023-12-28 04:29:35,414][106226] Updated weights for policy 0, policy_version 1284912 (0.0011) [2023-12-28 04:29:35,693][106225] Updated weights for policy 1, policy_version 1288143 (0.0010) [2023-12-28 04:29:35,746][106225] Updated weights for policy 1, policy_version 1288153 (0.0010) [2023-12-28 04:29:35,802][106225] Updated weights for policy 1, policy_version 1288163 (0.0010) [2023-12-28 04:29:36,134][106226] Updated weights for policy 0, policy_version 1284922 (0.0011) [2023-12-28 04:29:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 658817024. Throughput: 0: 9826.8, 1: 10061.5. Samples: 658829416. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:36,175][105115] Avg episode reward: [(0, '-4.200'), (1, '-5.037')] [2023-12-28 04:29:36,196][106226] Updated weights for policy 0, policy_version 1284932 (0.0010) [2023-12-28 04:29:36,262][106226] Updated weights for policy 0, policy_version 1284942 (0.0011) [2023-12-28 04:29:36,330][106226] Updated weights for policy 0, policy_version 1284952 (0.0011) [2023-12-28 04:29:36,536][106225] Updated weights for policy 1, policy_version 1288173 (0.0010) [2023-12-28 04:29:36,605][106225] Updated weights for policy 1, policy_version 1288183 (0.0011) [2023-12-28 04:29:36,662][106225] Updated weights for policy 1, policy_version 1288193 (0.0009) [2023-12-28 04:29:37,052][106226] Updated weights for policy 0, policy_version 1284962 (0.0011) [2023-12-28 04:29:37,119][106226] Updated weights for policy 0, policy_version 1284972 (0.0011) [2023-12-28 04:29:37,179][106226] Updated weights for policy 0, policy_version 1284982 (0.0011) [2023-12-28 04:29:37,348][106225] Updated weights for policy 1, policy_version 1288203 (0.0008) [2023-12-28 04:29:37,408][106225] Updated weights for policy 1, policy_version 1288213 (0.0010) [2023-12-28 04:29:37,466][106225] Updated weights for policy 1, policy_version 1288223 (0.0010) [2023-12-28 04:29:37,884][106226] Updated weights for policy 0, policy_version 1284992 (0.0010) [2023-12-28 04:29:37,927][106226] Updated weights for policy 0, policy_version 1285002 (0.0010) [2023-12-28 04:29:37,974][106226] Updated weights for policy 0, policy_version 1285012 (0.0010) [2023-12-28 04:29:38,167][106225] Updated weights for policy 1, policy_version 1288233 (0.0010) [2023-12-28 04:29:38,213][106225] Updated weights for policy 1, policy_version 1288243 (0.0010) [2023-12-28 04:29:38,267][106225] Updated weights for policy 1, policy_version 1288253 (0.0010) [2023-12-28 04:29:38,320][106225] Updated weights for policy 1, policy_version 1288263 (0.0010) [2023-12-28 04:29:38,773][106226] Updated weights for policy 0, policy_version 1285022 (0.0011) [2023-12-28 04:29:38,843][106226] Updated weights for policy 0, policy_version 1285032 (0.0011) [2023-12-28 04:29:38,907][106226] Updated weights for policy 0, policy_version 1285042 (0.0011) [2023-12-28 04:29:39,047][106225] Updated weights for policy 1, policy_version 1288273 (0.0010) [2023-12-28 04:29:39,108][106225] Updated weights for policy 1, policy_version 1288283 (0.0011) [2023-12-28 04:29:39,169][106225] Updated weights for policy 1, policy_version 1288293 (0.0010) [2023-12-28 04:29:39,695][106226] Updated weights for policy 0, policy_version 1285052 (0.0011) [2023-12-28 04:29:39,760][106226] Updated weights for policy 0, policy_version 1285062 (0.0011) [2023-12-28 04:29:39,827][106226] Updated weights for policy 0, policy_version 1285072 (0.0009) [2023-12-28 04:29:39,918][106225] Updated weights for policy 1, policy_version 1288303 (0.0008) [2023-12-28 04:29:39,976][106225] Updated weights for policy 1, policy_version 1288313 (0.0008) [2023-12-28 04:29:40,035][106225] Updated weights for policy 1, policy_version 1288323 (0.0008) [2023-12-28 04:29:40,600][106226] Updated weights for policy 0, policy_version 1285082 (0.0008) [2023-12-28 04:29:40,665][106226] Updated weights for policy 0, policy_version 1285092 (0.0009) [2023-12-28 04:29:40,701][106225] Updated weights for policy 1, policy_version 1288333 (0.0008) [2023-12-28 04:29:40,726][106226] Updated weights for policy 0, policy_version 1285102 (0.0009) [2023-12-28 04:29:40,761][106225] Updated weights for policy 1, policy_version 1288343 (0.0006) [2023-12-28 04:29:40,791][106226] Updated weights for policy 0, policy_version 1285112 (0.0008) [2023-12-28 04:29:40,809][106225] Updated weights for policy 1, policy_version 1288353 (0.0007) [2023-12-28 04:29:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 658915328. Throughput: 0: 9833.6, 1: 10018.5. Samples: 658886872. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:41,175][105115] Avg episode reward: [(0, '-4.135'), (1, '-4.793')] [2023-12-28 04:29:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001288360_329867264.pth... [2023-12-28 04:29:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001285112_329048064.pth... [2023-12-28 04:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001287208_329572352.pth [2023-12-28 04:29:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001283960_328753152.pth [2023-12-28 04:29:41,585][106226] Updated weights for policy 0, policy_version 1285122 (0.0010) [2023-12-28 04:29:41,645][106226] Updated weights for policy 0, policy_version 1285132 (0.0009) [2023-12-28 04:29:41,652][106225] Updated weights for policy 1, policy_version 1288363 (0.0008) [2023-12-28 04:29:41,709][106226] Updated weights for policy 0, policy_version 1285142 (0.0008) [2023-12-28 04:29:41,715][106225] Updated weights for policy 1, policy_version 1288373 (0.0008) [2023-12-28 04:29:41,785][106225] Updated weights for policy 1, policy_version 1288383 (0.0008) [2023-12-28 04:29:42,309][106226] Updated weights for policy 0, policy_version 1285152 (0.0008) [2023-12-28 04:29:42,374][106226] Updated weights for policy 0, policy_version 1285162 (0.0007) [2023-12-28 04:29:42,442][106226] Updated weights for policy 0, policy_version 1285172 (0.0008) [2023-12-28 04:29:42,587][106225] Updated weights for policy 1, policy_version 1288393 (0.0009) [2023-12-28 04:29:42,652][106225] Updated weights for policy 1, policy_version 1288403 (0.0010) [2023-12-28 04:29:42,716][106225] Updated weights for policy 1, policy_version 1288413 (0.0010) [2023-12-28 04:29:42,770][106225] Updated weights for policy 1, policy_version 1288423 (0.0010) [2023-12-28 04:29:43,214][106226] Updated weights for policy 0, policy_version 1285182 (0.0008) [2023-12-28 04:29:43,271][106226] Updated weights for policy 0, policy_version 1285192 (0.0008) [2023-12-28 04:29:43,328][106226] Updated weights for policy 0, policy_version 1285202 (0.0006) [2023-12-28 04:29:43,465][106225] Updated weights for policy 1, policy_version 1288433 (0.0009) [2023-12-28 04:29:43,533][106225] Updated weights for policy 1, policy_version 1288443 (0.0008) [2023-12-28 04:29:43,601][106225] Updated weights for policy 1, policy_version 1288453 (0.0009) [2023-12-28 04:29:43,894][106226] Updated weights for policy 0, policy_version 1285212 (0.0006) [2023-12-28 04:29:43,952][106226] Updated weights for policy 0, policy_version 1285222 (0.0007) [2023-12-28 04:29:44,014][106226] Updated weights for policy 0, policy_version 1285232 (0.0005) [2023-12-28 04:29:44,264][106225] Updated weights for policy 1, policy_version 1288463 (0.0010) [2023-12-28 04:29:44,310][106225] Updated weights for policy 1, policy_version 1288473 (0.0010) [2023-12-28 04:29:44,373][106225] Updated weights for policy 1, policy_version 1288483 (0.0010) [2023-12-28 04:29:44,583][106226] Updated weights for policy 0, policy_version 1285242 (0.0006) [2023-12-28 04:29:44,645][106226] Updated weights for policy 0, policy_version 1285252 (0.0005) [2023-12-28 04:29:44,697][106226] Updated weights for policy 0, policy_version 1285262 (0.0010) [2023-12-28 04:29:44,743][106226] Updated weights for policy 0, policy_version 1285272 (0.0010) [2023-12-28 04:29:45,094][106225] Updated weights for policy 1, policy_version 1288493 (0.0009) [2023-12-28 04:29:45,152][106225] Updated weights for policy 1, policy_version 1288503 (0.0008) [2023-12-28 04:29:45,217][106225] Updated weights for policy 1, policy_version 1288513 (0.0010) [2023-12-28 04:29:45,432][106226] Updated weights for policy 0, policy_version 1285282 (0.0011) [2023-12-28 04:29:45,489][106226] Updated weights for policy 0, policy_version 1285292 (0.0008) [2023-12-28 04:29:45,550][106226] Updated weights for policy 0, policy_version 1285302 (0.0005) [2023-12-28 04:29:45,954][106225] Updated weights for policy 1, policy_version 1288523 (0.0010) [2023-12-28 04:29:46,014][106225] Updated weights for policy 1, policy_version 1288533 (0.0010) [2023-12-28 04:29:46,070][106225] Updated weights for policy 1, policy_version 1288543 (0.0010) [2023-12-28 04:29:46,163][106226] Updated weights for policy 0, policy_version 1285312 (0.0006) [2023-12-28 04:29:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 659013632. Throughput: 0: 9907.6, 1: 9961.0. Samples: 659004020. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:46,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-5.064')] [2023-12-28 04:29:46,227][106226] Updated weights for policy 0, policy_version 1285322 (0.0005) [2023-12-28 04:29:46,286][106226] Updated weights for policy 0, policy_version 1285332 (0.0006) [2023-12-28 04:29:46,731][106225] Updated weights for policy 1, policy_version 1288553 (0.0010) [2023-12-28 04:29:46,802][106225] Updated weights for policy 1, policy_version 1288563 (0.0005) [2023-12-28 04:29:46,867][106225] Updated weights for policy 1, policy_version 1288573 (0.0006) [2023-12-28 04:29:46,930][106225] Updated weights for policy 1, policy_version 1288583 (0.0006) [2023-12-28 04:29:46,985][106226] Updated weights for policy 0, policy_version 1285342 (0.0007) [2023-12-28 04:29:47,033][106226] Updated weights for policy 0, policy_version 1285352 (0.0008) [2023-12-28 04:29:47,082][106226] Updated weights for policy 0, policy_version 1285362 (0.0008) [2023-12-28 04:29:47,495][106225] Updated weights for policy 1, policy_version 1288593 (0.0005) [2023-12-28 04:29:47,550][106225] Updated weights for policy 1, policy_version 1288603 (0.0008) [2023-12-28 04:29:47,602][106225] Updated weights for policy 1, policy_version 1288613 (0.0008) [2023-12-28 04:29:47,842][106226] Updated weights for policy 0, policy_version 1285372 (0.0008) [2023-12-28 04:29:47,903][106226] Updated weights for policy 0, policy_version 1285382 (0.0005) [2023-12-28 04:29:47,972][106226] Updated weights for policy 0, policy_version 1285392 (0.0005) [2023-12-28 04:29:48,200][106225] Updated weights for policy 1, policy_version 1288623 (0.0007) [2023-12-28 04:29:48,260][106225] Updated weights for policy 1, policy_version 1288633 (0.0009) [2023-12-28 04:29:48,323][106225] Updated weights for policy 1, policy_version 1288643 (0.0008) [2023-12-28 04:29:48,614][106226] Updated weights for policy 0, policy_version 1285402 (0.0006) [2023-12-28 04:29:48,681][106226] Updated weights for policy 0, policy_version 1285412 (0.0009) [2023-12-28 04:29:48,747][106226] Updated weights for policy 0, policy_version 1285422 (0.0008) [2023-12-28 04:29:48,806][106226] Updated weights for policy 0, policy_version 1285432 (0.0008) [2023-12-28 04:29:49,023][106225] Updated weights for policy 1, policy_version 1288653 (0.0007) [2023-12-28 04:29:49,080][106225] Updated weights for policy 1, policy_version 1288663 (0.0005) [2023-12-28 04:29:49,136][106225] Updated weights for policy 1, policy_version 1288673 (0.0005) [2023-12-28 04:29:49,565][106226] Updated weights for policy 0, policy_version 1285442 (0.0006) [2023-12-28 04:29:49,619][106226] Updated weights for policy 0, policy_version 1285452 (0.0007) [2023-12-28 04:29:49,673][106226] Updated weights for policy 0, policy_version 1285462 (0.0008) [2023-12-28 04:29:49,829][106225] Updated weights for policy 1, policy_version 1288683 (0.0007) [2023-12-28 04:29:49,892][106225] Updated weights for policy 1, policy_version 1288693 (0.0008) [2023-12-28 04:29:49,953][106225] Updated weights for policy 1, policy_version 1288703 (0.0008) [2023-12-28 04:29:50,389][106226] Updated weights for policy 0, policy_version 1285472 (0.0010) [2023-12-28 04:29:50,448][106226] Updated weights for policy 0, policy_version 1285482 (0.0011) [2023-12-28 04:29:50,498][106226] Updated weights for policy 0, policy_version 1285492 (0.0010) [2023-12-28 04:29:50,668][106225] Updated weights for policy 1, policy_version 1288713 (0.0009) [2023-12-28 04:29:50,732][106225] Updated weights for policy 1, policy_version 1288723 (0.0010) [2023-12-28 04:29:50,789][106225] Updated weights for policy 1, policy_version 1288733 (0.0010) [2023-12-28 04:29:50,850][106225] Updated weights for policy 1, policy_version 1288743 (0.0009) [2023-12-28 04:29:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 659111936. Throughput: 0: 9888.4, 1: 9951.8. Samples: 659123888. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:51,175][105115] Avg episode reward: [(0, '-4.209'), (1, '-5.102')] [2023-12-28 04:29:51,261][106226] Updated weights for policy 0, policy_version 1285502 (0.0009) [2023-12-28 04:29:51,312][106226] Updated weights for policy 0, policy_version 1285512 (0.0008) [2023-12-28 04:29:51,376][106226] Updated weights for policy 0, policy_version 1285522 (0.0008) [2023-12-28 04:29:51,603][106225] Updated weights for policy 1, policy_version 1288753 (0.0009) [2023-12-28 04:29:51,669][106225] Updated weights for policy 1, policy_version 1288763 (0.0007) [2023-12-28 04:29:51,734][106225] Updated weights for policy 1, policy_version 1288773 (0.0006) [2023-12-28 04:29:52,144][106226] Updated weights for policy 0, policy_version 1285532 (0.0007) [2023-12-28 04:29:52,204][106226] Updated weights for policy 0, policy_version 1285542 (0.0005) [2023-12-28 04:29:52,260][106226] Updated weights for policy 0, policy_version 1285552 (0.0006) [2023-12-28 04:29:52,453][106225] Updated weights for policy 1, policy_version 1288783 (0.0009) [2023-12-28 04:29:52,511][106225] Updated weights for policy 1, policy_version 1288793 (0.0008) [2023-12-28 04:29:52,575][106225] Updated weights for policy 1, policy_version 1288803 (0.0008) [2023-12-28 04:29:52,922][106226] Updated weights for policy 0, policy_version 1285562 (0.0009) [2023-12-28 04:29:52,978][106226] Updated weights for policy 0, policy_version 1285572 (0.0010) [2023-12-28 04:29:53,035][106226] Updated weights for policy 0, policy_version 1285582 (0.0010) [2023-12-28 04:29:53,082][106226] Updated weights for policy 0, policy_version 1285592 (0.0010) [2023-12-28 04:29:53,309][106225] Updated weights for policy 1, policy_version 1288813 (0.0008) [2023-12-28 04:29:53,356][106225] Updated weights for policy 1, policy_version 1288823 (0.0008) [2023-12-28 04:29:53,417][106225] Updated weights for policy 1, policy_version 1288833 (0.0008) [2023-12-28 04:29:53,783][106226] Updated weights for policy 0, policy_version 1285602 (0.0010) [2023-12-28 04:29:53,837][106226] Updated weights for policy 0, policy_version 1285612 (0.0010) [2023-12-28 04:29:53,889][106226] Updated weights for policy 0, policy_version 1285622 (0.0010) [2023-12-28 04:29:54,160][106225] Updated weights for policy 1, policy_version 1288843 (0.0007) [2023-12-28 04:29:54,213][106225] Updated weights for policy 1, policy_version 1288853 (0.0007) [2023-12-28 04:29:54,263][106225] Updated weights for policy 1, policy_version 1288863 (0.0008) [2023-12-28 04:29:54,622][106226] Updated weights for policy 0, policy_version 1285632 (0.0010) [2023-12-28 04:29:54,690][106226] Updated weights for policy 0, policy_version 1285642 (0.0011) [2023-12-28 04:29:54,754][106226] Updated weights for policy 0, policy_version 1285652 (0.0011) [2023-12-28 04:29:55,032][106225] Updated weights for policy 1, policy_version 1288873 (0.0008) [2023-12-28 04:29:55,092][106225] Updated weights for policy 1, policy_version 1288883 (0.0008) [2023-12-28 04:29:55,150][106225] Updated weights for policy 1, policy_version 1288893 (0.0009) [2023-12-28 04:29:55,199][106225] Updated weights for policy 1, policy_version 1288903 (0.0008) [2023-12-28 04:29:55,333][106226] Updated weights for policy 0, policy_version 1285662 (0.0007) [2023-12-28 04:29:55,397][106226] Updated weights for policy 0, policy_version 1285672 (0.0007) [2023-12-28 04:29:55,460][106226] Updated weights for policy 0, policy_version 1285682 (0.0010) [2023-12-28 04:29:55,989][106225] Updated weights for policy 1, policy_version 1288913 (0.0008) [2023-12-28 04:29:56,050][106225] Updated weights for policy 1, policy_version 1288923 (0.0007) [2023-12-28 04:29:56,104][106226] Updated weights for policy 0, policy_version 1285692 (0.0008) [2023-12-28 04:29:56,110][106225] Updated weights for policy 1, policy_version 1288933 (0.0007) [2023-12-28 04:29:56,155][106226] Updated weights for policy 0, policy_version 1285702 (0.0010) [2023-12-28 04:29:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 659210240. Throughput: 0: 9862.8, 1: 9875.6. Samples: 659180996. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:29:56,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-5.047')] [2023-12-28 04:29:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001288936_330014720.pth... [2023-12-28 04:29:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001287784_329719808.pth [2023-12-28 04:29:56,216][106226] Updated weights for policy 0, policy_version 1285712 (0.0010) [2023-12-28 04:29:56,263][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001285720_329203712.pth... [2023-12-28 04:29:56,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001284536_328900608.pth [2023-12-28 04:29:56,837][106225] Updated weights for policy 1, policy_version 1288943 (0.0008) [2023-12-28 04:29:56,901][106225] Updated weights for policy 1, policy_version 1288953 (0.0008) [2023-12-28 04:29:56,923][106226] Updated weights for policy 0, policy_version 1285722 (0.0010) [2023-12-28 04:29:56,955][106225] Updated weights for policy 1, policy_version 1288963 (0.0007) [2023-12-28 04:29:56,976][106226] Updated weights for policy 0, policy_version 1285732 (0.0007) [2023-12-28 04:29:57,038][106226] Updated weights for policy 0, policy_version 1285742 (0.0010) [2023-12-28 04:29:57,106][106226] Updated weights for policy 0, policy_version 1285752 (0.0010) [2023-12-28 04:29:57,598][106225] Updated weights for policy 1, policy_version 1288973 (0.0007) [2023-12-28 04:29:57,658][106225] Updated weights for policy 1, policy_version 1288983 (0.0010) [2023-12-28 04:29:57,693][106226] Updated weights for policy 0, policy_version 1285762 (0.0005) [2023-12-28 04:29:57,711][106225] Updated weights for policy 1, policy_version 1288993 (0.0010) [2023-12-28 04:29:57,748][106226] Updated weights for policy 0, policy_version 1285772 (0.0005) [2023-12-28 04:29:57,812][106226] Updated weights for policy 0, policy_version 1285782 (0.0005) [2023-12-28 04:29:58,320][106225] Updated weights for policy 1, policy_version 1289003 (0.0007) [2023-12-28 04:29:58,351][106226] Updated weights for policy 0, policy_version 1285792 (0.0009) [2023-12-28 04:29:58,389][106225] Updated weights for policy 1, policy_version 1289013 (0.0009) [2023-12-28 04:29:58,415][106226] Updated weights for policy 0, policy_version 1285802 (0.0008) [2023-12-28 04:29:58,451][106225] Updated weights for policy 1, policy_version 1289023 (0.0008) [2023-12-28 04:29:58,488][106226] Updated weights for policy 0, policy_version 1285812 (0.0008) [2023-12-28 04:29:59,266][106226] Updated weights for policy 0, policy_version 1285823 (0.0008) [2023-12-28 04:29:59,289][106225] Updated weights for policy 1, policy_version 1289033 (0.0006) [2023-12-28 04:29:59,327][106226] Updated weights for policy 0, policy_version 1285833 (0.0007) [2023-12-28 04:29:59,355][106225] Updated weights for policy 1, policy_version 1289043 (0.0008) [2023-12-28 04:29:59,397][106226] Updated weights for policy 0, policy_version 1285843 (0.0011) [2023-12-28 04:29:59,427][106225] Updated weights for policy 1, policy_version 1289053 (0.0008) [2023-12-28 04:29:59,492][106225] Updated weights for policy 1, policy_version 1289063 (0.0007) [2023-12-28 04:30:00,175][106226] Updated weights for policy 0, policy_version 1285853 (0.0009) [2023-12-28 04:30:00,205][106225] Updated weights for policy 1, policy_version 1289073 (0.0006) [2023-12-28 04:30:00,233][106226] Updated weights for policy 0, policy_version 1285863 (0.0009) [2023-12-28 04:30:00,266][106225] Updated weights for policy 1, policy_version 1289083 (0.0009) [2023-12-28 04:30:00,294][106226] Updated weights for policy 0, policy_version 1285873 (0.0008) [2023-12-28 04:30:00,315][106225] Updated weights for policy 1, policy_version 1289093 (0.0008) [2023-12-28 04:30:01,005][106226] Updated weights for policy 0, policy_version 1285883 (0.0007) [2023-12-28 04:30:01,020][106225] Updated weights for policy 1, policy_version 1289103 (0.0010) [2023-12-28 04:30:01,074][106226] Updated weights for policy 0, policy_version 1285893 (0.0008) [2023-12-28 04:30:01,086][106225] Updated weights for policy 1, policy_version 1289114 (0.0010) [2023-12-28 04:30:01,136][106226] Updated weights for policy 0, policy_version 1285903 (0.0007) [2023-12-28 04:30:01,148][106225] Updated weights for policy 1, policy_version 1289124 (0.0007) [2023-12-28 04:30:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 659308544. Throughput: 0: 9951.6, 1: 9877.3. Samples: 659299352. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:01,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-5.067')] [2023-12-28 04:30:01,867][106226] Updated weights for policy 0, policy_version 1285913 (0.0007) [2023-12-28 04:30:01,881][106225] Updated weights for policy 1, policy_version 1289134 (0.0011) [2023-12-28 04:30:01,927][106226] Updated weights for policy 0, policy_version 1285923 (0.0006) [2023-12-28 04:30:01,929][106225] Updated weights for policy 1, policy_version 1289144 (0.0010) [2023-12-28 04:30:01,978][106225] Updated weights for policy 1, policy_version 1289154 (0.0010) [2023-12-28 04:30:01,979][106226] Updated weights for policy 0, policy_version 1285933 (0.0011) [2023-12-28 04:30:02,033][106226] Updated weights for policy 0, policy_version 1285943 (0.0011) [2023-12-28 04:30:02,715][106225] Updated weights for policy 1, policy_version 1289164 (0.0010) [2023-12-28 04:30:02,773][106225] Updated weights for policy 1, policy_version 1289174 (0.0010) [2023-12-28 04:30:02,776][106226] Updated weights for policy 0, policy_version 1285953 (0.0006) [2023-12-28 04:30:02,829][106226] Updated weights for policy 0, policy_version 1285963 (0.0008) [2023-12-28 04:30:02,832][106225] Updated weights for policy 1, policy_version 1289184 (0.0008) [2023-12-28 04:30:02,880][106226] Updated weights for policy 0, policy_version 1285973 (0.0006) [2023-12-28 04:30:03,546][106225] Updated weights for policy 1, policy_version 1289194 (0.0008) [2023-12-28 04:30:03,604][106225] Updated weights for policy 1, policy_version 1289204 (0.0009) [2023-12-28 04:30:03,633][106226] Updated weights for policy 0, policy_version 1285983 (0.0007) [2023-12-28 04:30:03,651][106225] Updated weights for policy 1, policy_version 1289214 (0.0010) [2023-12-28 04:30:03,686][106226] Updated weights for policy 0, policy_version 1285993 (0.0007) [2023-12-28 04:30:03,705][106225] Updated weights for policy 1, policy_version 1289224 (0.0010) [2023-12-28 04:30:03,736][106226] Updated weights for policy 0, policy_version 1286003 (0.0007) [2023-12-28 04:30:04,407][106225] Updated weights for policy 1, policy_version 1289234 (0.0009) [2023-12-28 04:30:04,420][106226] Updated weights for policy 0, policy_version 1286013 (0.0007) [2023-12-28 04:30:04,471][106225] Updated weights for policy 1, policy_version 1289244 (0.0008) [2023-12-28 04:30:04,478][106226] Updated weights for policy 0, policy_version 1286023 (0.0007) [2023-12-28 04:30:04,536][106225] Updated weights for policy 1, policy_version 1289254 (0.0008) [2023-12-28 04:30:04,544][106226] Updated weights for policy 0, policy_version 1286033 (0.0005) [2023-12-28 04:30:05,180][106226] Updated weights for policy 0, policy_version 1286043 (0.0007) [2023-12-28 04:30:05,228][106226] Updated weights for policy 0, policy_version 1286053 (0.0008) [2023-12-28 04:30:05,242][106225] Updated weights for policy 1, policy_version 1289264 (0.0007) [2023-12-28 04:30:05,287][106226] Updated weights for policy 0, policy_version 1286063 (0.0009) [2023-12-28 04:30:05,297][106225] Updated weights for policy 1, policy_version 1289274 (0.0007) [2023-12-28 04:30:05,349][106225] Updated weights for policy 1, policy_version 1289284 (0.0007) [2023-12-28 04:30:05,922][106225] Updated weights for policy 1, policy_version 1289294 (0.0007) [2023-12-28 04:30:05,981][106225] Updated weights for policy 1, policy_version 1289304 (0.0006) [2023-12-28 04:30:06,037][106225] Updated weights for policy 1, policy_version 1289314 (0.0007) [2023-12-28 04:30:06,103][106226] Updated weights for policy 0, policy_version 1286073 (0.0006) [2023-12-28 04:30:06,173][106226] Updated weights for policy 0, policy_version 1286083 (0.0010) [2023-12-28 04:30:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 659406848. Throughput: 0: 9896.2, 1: 9811.9. Samples: 659416336. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:06,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-4.835')] [2023-12-28 04:30:06,226][106226] Updated weights for policy 0, policy_version 1286093 (0.0009) [2023-12-28 04:30:06,281][106226] Updated weights for policy 0, policy_version 1286103 (0.0010) [2023-12-28 04:30:06,665][106225] Updated weights for policy 1, policy_version 1289324 (0.0008) [2023-12-28 04:30:06,735][106225] Updated weights for policy 1, policy_version 1289334 (0.0006) [2023-12-28 04:30:06,800][106225] Updated weights for policy 1, policy_version 1289344 (0.0009) [2023-12-28 04:30:07,038][106226] Updated weights for policy 0, policy_version 1286113 (0.0009) [2023-12-28 04:30:07,102][106226] Updated weights for policy 0, policy_version 1286123 (0.0009) [2023-12-28 04:30:07,166][106226] Updated weights for policy 0, policy_version 1286133 (0.0009) [2023-12-28 04:30:07,415][106225] Updated weights for policy 1, policy_version 1289354 (0.0006) [2023-12-28 04:30:07,481][106225] Updated weights for policy 1, policy_version 1289364 (0.0008) [2023-12-28 04:30:07,541][106225] Updated weights for policy 1, policy_version 1289374 (0.0005) [2023-12-28 04:30:07,598][106225] Updated weights for policy 1, policy_version 1289384 (0.0005) [2023-12-28 04:30:07,760][106226] Updated weights for policy 0, policy_version 1286143 (0.0008) [2023-12-28 04:30:07,813][106226] Updated weights for policy 0, policy_version 1286153 (0.0005) [2023-12-28 04:30:07,875][106226] Updated weights for policy 0, policy_version 1286163 (0.0007) [2023-12-28 04:30:08,113][106225] Updated weights for policy 1, policy_version 1289394 (0.0005) [2023-12-28 04:30:08,165][106225] Updated weights for policy 1, policy_version 1289404 (0.0005) [2023-12-28 04:30:08,216][106225] Updated weights for policy 1, policy_version 1289414 (0.0007) [2023-12-28 04:30:08,583][106226] Updated weights for policy 0, policy_version 1286173 (0.0007) [2023-12-28 04:30:08,640][106226] Updated weights for policy 0, policy_version 1286183 (0.0008) [2023-12-28 04:30:08,707][106226] Updated weights for policy 0, policy_version 1286193 (0.0006) [2023-12-28 04:30:08,913][106225] Updated weights for policy 1, policy_version 1289424 (0.0008) [2023-12-28 04:30:08,982][106225] Updated weights for policy 1, policy_version 1289434 (0.0009) [2023-12-28 04:30:09,040][106225] Updated weights for policy 1, policy_version 1289444 (0.0007) [2023-12-28 04:30:09,455][106226] Updated weights for policy 0, policy_version 1286203 (0.0009) [2023-12-28 04:30:09,521][106226] Updated weights for policy 0, policy_version 1286213 (0.0011) [2023-12-28 04:30:09,589][106226] Updated weights for policy 0, policy_version 1286223 (0.0011) [2023-12-28 04:30:09,772][106225] Updated weights for policy 1, policy_version 1289454 (0.0009) [2023-12-28 04:30:09,824][106225] Updated weights for policy 1, policy_version 1289464 (0.0010) [2023-12-28 04:30:09,899][106225] Updated weights for policy 1, policy_version 1289474 (0.0010) [2023-12-28 04:30:10,331][106226] Updated weights for policy 0, policy_version 1286233 (0.0011) [2023-12-28 04:30:10,388][106226] Updated weights for policy 0, policy_version 1286243 (0.0011) [2023-12-28 04:30:10,447][106226] Updated weights for policy 0, policy_version 1286253 (0.0011) [2023-12-28 04:30:10,501][106226] Updated weights for policy 0, policy_version 1286263 (0.0011) [2023-12-28 04:30:10,572][106225] Updated weights for policy 1, policy_version 1289484 (0.0010) [2023-12-28 04:30:10,633][106225] Updated weights for policy 1, policy_version 1289494 (0.0010) [2023-12-28 04:30:10,688][106225] Updated weights for policy 1, policy_version 1289504 (0.0009) [2023-12-28 04:30:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 659505152. Throughput: 0: 9928.7, 1: 9922.8. Samples: 659479916. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:11,175][105115] Avg episode reward: [(0, '-4.000'), (1, '-4.649')] [2023-12-28 04:30:11,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001289512_330162176.pth... [2023-12-28 04:30:11,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001288360_329867264.pth [2023-12-28 04:30:11,254][106226] Updated weights for policy 0, policy_version 1286273 (0.0007) [2023-12-28 04:30:11,324][106226] Updated weights for policy 0, policy_version 1286283 (0.0009) [2023-12-28 04:30:11,403][106226] Updated weights for policy 0, policy_version 1286293 (0.0009) [2023-12-28 04:30:11,424][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001286296_329351168.pth... [2023-12-28 04:30:11,427][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001285112_329048064.pth [2023-12-28 04:30:11,492][106225] Updated weights for policy 1, policy_version 1289514 (0.0008) [2023-12-28 04:30:11,551][106225] Updated weights for policy 1, policy_version 1289524 (0.0008) [2023-12-28 04:30:11,616][106225] Updated weights for policy 1, policy_version 1289534 (0.0009) [2023-12-28 04:30:11,677][106225] Updated weights for policy 1, policy_version 1289544 (0.0008) [2023-12-28 04:30:12,236][106226] Updated weights for policy 0, policy_version 1286303 (0.0009) [2023-12-28 04:30:12,306][106226] Updated weights for policy 0, policy_version 1286313 (0.0009) [2023-12-28 04:30:12,349][106225] Updated weights for policy 1, policy_version 1289554 (0.0011) [2023-12-28 04:30:12,373][106226] Updated weights for policy 0, policy_version 1286323 (0.0007) [2023-12-28 04:30:12,417][106225] Updated weights for policy 1, policy_version 1289564 (0.0008) [2023-12-28 04:30:12,475][106225] Updated weights for policy 1, policy_version 1289574 (0.0007) [2023-12-28 04:30:13,010][106226] Updated weights for policy 0, policy_version 1286333 (0.0008) [2023-12-28 04:30:13,071][106226] Updated weights for policy 0, policy_version 1286343 (0.0009) [2023-12-28 04:30:13,132][106226] Updated weights for policy 0, policy_version 1286353 (0.0008) [2023-12-28 04:30:13,222][106225] Updated weights for policy 1, policy_version 1289584 (0.0008) [2023-12-28 04:30:13,277][106225] Updated weights for policy 1, policy_version 1289594 (0.0009) [2023-12-28 04:30:13,339][106225] Updated weights for policy 1, policy_version 1289604 (0.0008) [2023-12-28 04:30:13,705][106226] Updated weights for policy 0, policy_version 1286363 (0.0008) [2023-12-28 04:30:13,752][106226] Updated weights for policy 0, policy_version 1286373 (0.0007) [2023-12-28 04:30:13,805][106226] Updated weights for policy 0, policy_version 1286383 (0.0005) [2023-12-28 04:30:14,140][106225] Updated weights for policy 1, policy_version 1289614 (0.0009) [2023-12-28 04:30:14,192][106225] Updated weights for policy 1, policy_version 1289624 (0.0008) [2023-12-28 04:30:14,245][106225] Updated weights for policy 1, policy_version 1289634 (0.0008) [2023-12-28 04:30:14,525][106226] Updated weights for policy 0, policy_version 1286393 (0.0008) [2023-12-28 04:30:14,585][106226] Updated weights for policy 0, policy_version 1286403 (0.0009) [2023-12-28 04:30:14,639][106226] Updated weights for policy 0, policy_version 1286413 (0.0005) [2023-12-28 04:30:14,690][106226] Updated weights for policy 0, policy_version 1286423 (0.0005) [2023-12-28 04:30:14,986][106225] Updated weights for policy 1, policy_version 1289644 (0.0007) [2023-12-28 04:30:15,058][106225] Updated weights for policy 1, policy_version 1289654 (0.0006) [2023-12-28 04:30:15,120][106225] Updated weights for policy 1, policy_version 1289664 (0.0009) [2023-12-28 04:30:15,396][106226] Updated weights for policy 0, policy_version 1286433 (0.0010) [2023-12-28 04:30:15,460][106226] Updated weights for policy 0, policy_version 1286443 (0.0011) [2023-12-28 04:30:15,520][106226] Updated weights for policy 0, policy_version 1286453 (0.0011) [2023-12-28 04:30:15,847][106225] Updated weights for policy 1, policy_version 1289674 (0.0009) [2023-12-28 04:30:15,896][106225] Updated weights for policy 1, policy_version 1289684 (0.0009) [2023-12-28 04:30:15,953][106225] Updated weights for policy 1, policy_version 1289694 (0.0007) [2023-12-28 04:30:16,011][106225] Updated weights for policy 1, policy_version 1289704 (0.0008) [2023-12-28 04:30:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 659603456. Throughput: 0: 9851.7, 1: 9823.8. Samples: 659594728. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:16,175][105115] Avg episode reward: [(0, '-4.012'), (1, '-5.401')] [2023-12-28 04:30:16,218][106226] Updated weights for policy 0, policy_version 1286463 (0.0011) [2023-12-28 04:30:16,278][106226] Updated weights for policy 0, policy_version 1286473 (0.0010) [2023-12-28 04:30:16,338][106226] Updated weights for policy 0, policy_version 1286483 (0.0010) [2023-12-28 04:30:16,794][106225] Updated weights for policy 1, policy_version 1289714 (0.0008) [2023-12-28 04:30:16,858][106225] Updated weights for policy 1, policy_version 1289724 (0.0005) [2023-12-28 04:30:16,916][106225] Updated weights for policy 1, policy_version 1289734 (0.0006) [2023-12-28 04:30:17,015][106226] Updated weights for policy 0, policy_version 1286493 (0.0008) [2023-12-28 04:30:17,075][106226] Updated weights for policy 0, policy_version 1286503 (0.0008) [2023-12-28 04:30:17,148][106226] Updated weights for policy 0, policy_version 1286513 (0.0010) [2023-12-28 04:30:17,525][106225] Updated weights for policy 1, policy_version 1289744 (0.0010) [2023-12-28 04:30:17,586][106225] Updated weights for policy 1, policy_version 1289754 (0.0010) [2023-12-28 04:30:17,644][106225] Updated weights for policy 1, policy_version 1289764 (0.0007) [2023-12-28 04:30:17,827][106226] Updated weights for policy 0, policy_version 1286523 (0.0008) [2023-12-28 04:30:17,891][106226] Updated weights for policy 0, policy_version 1286533 (0.0006) [2023-12-28 04:30:17,956][106226] Updated weights for policy 0, policy_version 1286543 (0.0008) [2023-12-28 04:30:18,356][106225] Updated weights for policy 1, policy_version 1289774 (0.0009) [2023-12-28 04:30:18,408][106225] Updated weights for policy 1, policy_version 1289784 (0.0010) [2023-12-28 04:30:18,481][106225] Updated weights for policy 1, policy_version 1289794 (0.0008) [2023-12-28 04:30:18,529][106226] Updated weights for policy 0, policy_version 1286553 (0.0008) [2023-12-28 04:30:18,585][106226] Updated weights for policy 0, policy_version 1286563 (0.0008) [2023-12-28 04:30:18,640][106226] Updated weights for policy 0, policy_version 1286573 (0.0007) [2023-12-28 04:30:18,699][106226] Updated weights for policy 0, policy_version 1286583 (0.0009) [2023-12-28 04:30:19,150][106225] Updated weights for policy 1, policy_version 1289804 (0.0007) [2023-12-28 04:30:19,196][106225] Updated weights for policy 1, policy_version 1289814 (0.0005) [2023-12-28 04:30:19,259][106225] Updated weights for policy 1, policy_version 1289824 (0.0008) [2023-12-28 04:30:19,384][106226] Updated weights for policy 0, policy_version 1286593 (0.0008) [2023-12-28 04:30:19,447][106226] Updated weights for policy 0, policy_version 1286603 (0.0009) [2023-12-28 04:30:19,514][106226] Updated weights for policy 0, policy_version 1286613 (0.0008) [2023-12-28 04:30:19,944][106225] Updated weights for policy 1, policy_version 1289834 (0.0006) [2023-12-28 04:30:20,010][106225] Updated weights for policy 1, policy_version 1289844 (0.0008) [2023-12-28 04:30:20,074][106225] Updated weights for policy 1, policy_version 1289854 (0.0007) [2023-12-28 04:30:20,141][106225] Updated weights for policy 1, policy_version 1289864 (0.0007) [2023-12-28 04:30:20,265][106226] Updated weights for policy 0, policy_version 1286623 (0.0010) [2023-12-28 04:30:20,317][106226] Updated weights for policy 0, policy_version 1286633 (0.0011) [2023-12-28 04:30:20,384][106226] Updated weights for policy 0, policy_version 1286643 (0.0011) [2023-12-28 04:30:20,818][106225] Updated weights for policy 1, policy_version 1289874 (0.0008) [2023-12-28 04:30:20,883][106225] Updated weights for policy 1, policy_version 1289884 (0.0008) [2023-12-28 04:30:20,948][106225] Updated weights for policy 1, policy_version 1289894 (0.0006) [2023-12-28 04:30:21,104][106226] Updated weights for policy 0, policy_version 1286653 (0.0010) [2023-12-28 04:30:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 659701760. Throughput: 0: 9850.6, 1: 9802.1. Samples: 659713788. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:21,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-5.160')] [2023-12-28 04:30:21,176][106226] Updated weights for policy 0, policy_version 1286663 (0.0009) [2023-12-28 04:30:21,242][106226] Updated weights for policy 0, policy_version 1286673 (0.0009) [2023-12-28 04:30:21,753][106225] Updated weights for policy 1, policy_version 1289904 (0.0009) [2023-12-28 04:30:21,822][106225] Updated weights for policy 1, policy_version 1289914 (0.0008) [2023-12-28 04:30:21,884][106225] Updated weights for policy 1, policy_version 1289924 (0.0008) [2023-12-28 04:30:21,931][106226] Updated weights for policy 0, policy_version 1286683 (0.0009) [2023-12-28 04:30:22,000][106226] Updated weights for policy 0, policy_version 1286693 (0.0011) [2023-12-28 04:30:22,064][106226] Updated weights for policy 0, policy_version 1286703 (0.0010) [2023-12-28 04:30:22,556][106225] Updated weights for policy 1, policy_version 1289934 (0.0009) [2023-12-28 04:30:22,618][106225] Updated weights for policy 1, policy_version 1289944 (0.0011) [2023-12-28 04:30:22,678][106225] Updated weights for policy 1, policy_version 1289954 (0.0010) [2023-12-28 04:30:22,753][106226] Updated weights for policy 0, policy_version 1286713 (0.0010) [2023-12-28 04:30:22,812][106226] Updated weights for policy 0, policy_version 1286723 (0.0011) [2023-12-28 04:30:22,867][106226] Updated weights for policy 0, policy_version 1286733 (0.0010) [2023-12-28 04:30:22,918][106226] Updated weights for policy 0, policy_version 1286743 (0.0010) [2023-12-28 04:30:23,395][106225] Updated weights for policy 1, policy_version 1289964 (0.0011) [2023-12-28 04:30:23,461][106225] Updated weights for policy 1, policy_version 1289974 (0.0010) [2023-12-28 04:30:23,506][106225] Updated weights for policy 1, policy_version 1289984 (0.0010) [2023-12-28 04:30:23,624][106226] Updated weights for policy 0, policy_version 1286753 (0.0011) [2023-12-28 04:30:23,684][106226] Updated weights for policy 0, policy_version 1286763 (0.0010) [2023-12-28 04:30:23,744][106226] Updated weights for policy 0, policy_version 1286773 (0.0010) [2023-12-28 04:30:24,159][106225] Updated weights for policy 1, policy_version 1289994 (0.0008) [2023-12-28 04:30:24,220][106225] Updated weights for policy 1, policy_version 1290004 (0.0008) [2023-12-28 04:30:24,276][106225] Updated weights for policy 1, policy_version 1290014 (0.0007) [2023-12-28 04:30:24,333][106225] Updated weights for policy 1, policy_version 1290024 (0.0007) [2023-12-28 04:30:24,466][106226] Updated weights for policy 0, policy_version 1286783 (0.0011) [2023-12-28 04:30:24,536][106226] Updated weights for policy 0, policy_version 1286793 (0.0011) [2023-12-28 04:30:24,602][106226] Updated weights for policy 0, policy_version 1286803 (0.0010) [2023-12-28 04:30:24,909][106225] Updated weights for policy 1, policy_version 1290034 (0.0006) [2023-12-28 04:30:24,959][106225] Updated weights for policy 1, policy_version 1290044 (0.0007) [2023-12-28 04:30:25,009][106225] Updated weights for policy 1, policy_version 1290054 (0.0008) [2023-12-28 04:30:25,291][106226] Updated weights for policy 0, policy_version 1286813 (0.0010) [2023-12-28 04:30:25,340][106226] Updated weights for policy 0, policy_version 1286823 (0.0005) [2023-12-28 04:30:25,387][106226] Updated weights for policy 0, policy_version 1286833 (0.0005) [2023-12-28 04:30:25,702][106225] Updated weights for policy 1, policy_version 1290064 (0.0008) [2023-12-28 04:30:25,750][106225] Updated weights for policy 1, policy_version 1290074 (0.0009) [2023-12-28 04:30:25,799][106225] Updated weights for policy 1, policy_version 1290084 (0.0010) [2023-12-28 04:30:26,007][106226] Updated weights for policy 0, policy_version 1286843 (0.0006) [2023-12-28 04:30:26,065][106226] Updated weights for policy 0, policy_version 1286853 (0.0009) [2023-12-28 04:30:26,129][106226] Updated weights for policy 0, policy_version 1286863 (0.0008) [2023-12-28 04:30:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 659808256. Throughput: 0: 9862.7, 1: 9784.7. Samples: 659771000. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:26,175][105115] Avg episode reward: [(0, '-4.104'), (1, '-5.240')] [2023-12-28 04:30:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001286872_329498624.pth... [2023-12-28 04:30:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001290088_330309632.pth... [2023-12-28 04:30:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001285720_329203712.pth [2023-12-28 04:30:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001288936_330014720.pth [2023-12-28 04:30:26,523][106225] Updated weights for policy 1, policy_version 1290094 (0.0009) [2023-12-28 04:30:26,581][106225] Updated weights for policy 1, policy_version 1290104 (0.0008) [2023-12-28 04:30:26,640][106225] Updated weights for policy 1, policy_version 1290114 (0.0008) [2023-12-28 04:30:26,821][106226] Updated weights for policy 0, policy_version 1286873 (0.0009) [2023-12-28 04:30:26,880][106226] Updated weights for policy 0, policy_version 1286883 (0.0009) [2023-12-28 04:30:26,937][106226] Updated weights for policy 0, policy_version 1286893 (0.0007) [2023-12-28 04:30:26,993][106226] Updated weights for policy 0, policy_version 1286903 (0.0007) [2023-12-28 04:30:27,330][106225] Updated weights for policy 1, policy_version 1290124 (0.0007) [2023-12-28 04:30:27,394][106225] Updated weights for policy 1, policy_version 1290134 (0.0005) [2023-12-28 04:30:27,450][106225] Updated weights for policy 1, policy_version 1290144 (0.0005) [2023-12-28 04:30:27,707][106226] Updated weights for policy 0, policy_version 1286913 (0.0009) [2023-12-28 04:30:27,767][106226] Updated weights for policy 0, policy_version 1286924 (0.0009) [2023-12-28 04:30:27,841][106226] Updated weights for policy 0, policy_version 1286934 (0.0005) [2023-12-28 04:30:27,946][106225] Updated weights for policy 1, policy_version 1290154 (0.0005) [2023-12-28 04:30:28,005][106225] Updated weights for policy 1, policy_version 1290164 (0.0006) [2023-12-28 04:30:28,057][106225] Updated weights for policy 1, policy_version 1290174 (0.0005) [2023-12-28 04:30:28,113][106225] Updated weights for policy 1, policy_version 1290184 (0.0009) [2023-12-28 04:30:28,466][106226] Updated weights for policy 0, policy_version 1286944 (0.0008) [2023-12-28 04:30:28,533][106226] Updated weights for policy 0, policy_version 1286954 (0.0009) [2023-12-28 04:30:28,593][106226] Updated weights for policy 0, policy_version 1286964 (0.0008) [2023-12-28 04:30:28,718][106225] Updated weights for policy 1, policy_version 1290194 (0.0008) [2023-12-28 04:30:28,770][106225] Updated weights for policy 1, policy_version 1290204 (0.0008) [2023-12-28 04:30:28,821][106225] Updated weights for policy 1, policy_version 1290214 (0.0008) [2023-12-28 04:30:29,368][106226] Updated weights for policy 0, policy_version 1286974 (0.0008) [2023-12-28 04:30:29,429][106226] Updated weights for policy 0, policy_version 1286984 (0.0007) [2023-12-28 04:30:29,486][106226] Updated weights for policy 0, policy_version 1286994 (0.0008) [2023-12-28 04:30:29,537][106225] Updated weights for policy 1, policy_version 1290224 (0.0008) [2023-12-28 04:30:29,600][106225] Updated weights for policy 1, policy_version 1290234 (0.0008) [2023-12-28 04:30:29,657][106225] Updated weights for policy 1, policy_version 1290244 (0.0008) [2023-12-28 04:30:30,165][106226] Updated weights for policy 0, policy_version 1287004 (0.0007) [2023-12-28 04:30:30,213][106226] Updated weights for policy 0, policy_version 1287014 (0.0009) [2023-12-28 04:30:30,269][106226] Updated weights for policy 0, policy_version 1287024 (0.0006) [2023-12-28 04:30:30,339][106225] Updated weights for policy 1, policy_version 1290254 (0.0008) [2023-12-28 04:30:30,396][106225] Updated weights for policy 1, policy_version 1290264 (0.0008) [2023-12-28 04:30:30,457][106225] Updated weights for policy 1, policy_version 1290274 (0.0008) [2023-12-28 04:30:30,976][106226] Updated weights for policy 0, policy_version 1287034 (0.0007) [2023-12-28 04:30:31,029][106226] Updated weights for policy 0, policy_version 1287044 (0.0010) [2023-12-28 04:30:31,094][106226] Updated weights for policy 0, policy_version 1287054 (0.0011) [2023-12-28 04:30:31,161][106226] Updated weights for policy 0, policy_version 1287064 (0.0012) [2023-12-28 04:30:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 659906560. Throughput: 0: 9862.7, 1: 9954.2. Samples: 659895780. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:31,175][105115] Avg episode reward: [(0, '-4.015'), (1, '-5.248')] [2023-12-28 04:30:31,245][106225] Updated weights for policy 1, policy_version 1290284 (0.0008) [2023-12-28 04:30:31,303][106225] Updated weights for policy 1, policy_version 1290294 (0.0007) [2023-12-28 04:30:31,362][106225] Updated weights for policy 1, policy_version 1290304 (0.0008) [2023-12-28 04:30:31,910][106226] Updated weights for policy 0, policy_version 1287074 (0.0011) [2023-12-28 04:30:31,967][106226] Updated weights for policy 0, policy_version 1287084 (0.0011) [2023-12-28 04:30:32,018][106226] Updated weights for policy 0, policy_version 1287094 (0.0010) [2023-12-28 04:30:32,104][106225] Updated weights for policy 1, policy_version 1290314 (0.0008) [2023-12-28 04:30:32,157][106225] Updated weights for policy 1, policy_version 1290324 (0.0007) [2023-12-28 04:30:32,213][106225] Updated weights for policy 1, policy_version 1290334 (0.0008) [2023-12-28 04:30:32,268][106225] Updated weights for policy 1, policy_version 1290344 (0.0009) [2023-12-28 04:30:32,733][106226] Updated weights for policy 0, policy_version 1287104 (0.0009) [2023-12-28 04:30:32,784][106226] Updated weights for policy 0, policy_version 1287114 (0.0006) [2023-12-28 04:30:32,830][106226] Updated weights for policy 0, policy_version 1287124 (0.0005) [2023-12-28 04:30:33,066][106225] Updated weights for policy 1, policy_version 1290354 (0.0008) [2023-12-28 04:30:33,120][106225] Updated weights for policy 1, policy_version 1290364 (0.0009) [2023-12-28 04:30:33,170][106225] Updated weights for policy 1, policy_version 1290374 (0.0009) [2023-12-28 04:30:33,352][106226] Updated weights for policy 0, policy_version 1287134 (0.0005) [2023-12-28 04:30:33,410][106226] Updated weights for policy 0, policy_version 1287144 (0.0005) [2023-12-28 04:30:33,463][106226] Updated weights for policy 0, policy_version 1287154 (0.0005) [2023-12-28 04:30:33,970][106225] Updated weights for policy 1, policy_version 1290384 (0.0007) [2023-12-28 04:30:34,026][106225] Updated weights for policy 1, policy_version 1290394 (0.0007) [2023-12-28 04:30:34,079][106225] Updated weights for policy 1, policy_version 1290404 (0.0008) [2023-12-28 04:30:34,084][106226] Updated weights for policy 0, policy_version 1287164 (0.0010) [2023-12-28 04:30:34,148][106226] Updated weights for policy 0, policy_version 1287174 (0.0011) [2023-12-28 04:30:34,216][106226] Updated weights for policy 0, policy_version 1287184 (0.0011) [2023-12-28 04:30:34,828][106225] Updated weights for policy 1, policy_version 1290414 (0.0007) [2023-12-28 04:30:34,876][106225] Updated weights for policy 1, policy_version 1290424 (0.0008) [2023-12-28 04:30:34,928][106225] Updated weights for policy 1, policy_version 1290434 (0.0007) [2023-12-28 04:30:34,967][106226] Updated weights for policy 0, policy_version 1287194 (0.0009) [2023-12-28 04:30:35,015][106226] Updated weights for policy 0, policy_version 1287204 (0.0006) [2023-12-28 04:30:35,064][106226] Updated weights for policy 0, policy_version 1287214 (0.0005) [2023-12-28 04:30:35,117][106226] Updated weights for policy 0, policy_version 1287224 (0.0009) [2023-12-28 04:30:35,601][106225] Updated weights for policy 1, policy_version 1290444 (0.0007) [2023-12-28 04:30:35,659][106225] Updated weights for policy 1, policy_version 1290454 (0.0008) [2023-12-28 04:30:35,688][106226] Updated weights for policy 0, policy_version 1287234 (0.0006) [2023-12-28 04:30:35,707][106225] Updated weights for policy 1, policy_version 1290464 (0.0006) [2023-12-28 04:30:35,738][106226] Updated weights for policy 0, policy_version 1287244 (0.0007) [2023-12-28 04:30:35,796][106226] Updated weights for policy 0, policy_version 1287254 (0.0008) [2023-12-28 04:30:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 660004864. Throughput: 0: 9928.3, 1: 9865.1. Samples: 660014592. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:36,175][105115] Avg episode reward: [(0, '-4.292'), (1, '-5.381')] [2023-12-28 04:30:36,381][106225] Updated weights for policy 1, policy_version 1290474 (0.0007) [2023-12-28 04:30:36,448][106225] Updated weights for policy 1, policy_version 1290484 (0.0007) [2023-12-28 04:30:36,510][106225] Updated weights for policy 1, policy_version 1290494 (0.0008) [2023-12-28 04:30:36,572][106226] Updated weights for policy 0, policy_version 1287264 (0.0008) [2023-12-28 04:30:36,574][106225] Updated weights for policy 1, policy_version 1290504 (0.0008) [2023-12-28 04:30:36,641][106226] Updated weights for policy 0, policy_version 1287274 (0.0008) [2023-12-28 04:30:36,709][106226] Updated weights for policy 0, policy_version 1287284 (0.0008) [2023-12-28 04:30:37,142][106225] Updated weights for policy 1, policy_version 1290514 (0.0005) [2023-12-28 04:30:37,193][106225] Updated weights for policy 1, policy_version 1290524 (0.0005) [2023-12-28 04:30:37,257][106225] Updated weights for policy 1, policy_version 1290534 (0.0005) [2023-12-28 04:30:37,508][106226] Updated weights for policy 0, policy_version 1287294 (0.0009) [2023-12-28 04:30:37,566][106226] Updated weights for policy 0, policy_version 1287304 (0.0008) [2023-12-28 04:30:37,631][106226] Updated weights for policy 0, policy_version 1287314 (0.0005) [2023-12-28 04:30:37,859][106225] Updated weights for policy 1, policy_version 1290544 (0.0006) [2023-12-28 04:30:37,919][106225] Updated weights for policy 1, policy_version 1290554 (0.0005) [2023-12-28 04:30:37,978][106225] Updated weights for policy 1, policy_version 1290564 (0.0006) [2023-12-28 04:30:38,337][106226] Updated weights for policy 0, policy_version 1287324 (0.0006) [2023-12-28 04:30:38,404][106226] Updated weights for policy 0, policy_version 1287334 (0.0008) [2023-12-28 04:30:38,458][106226] Updated weights for policy 0, policy_version 1287344 (0.0008) [2023-12-28 04:30:38,577][106225] Updated weights for policy 1, policy_version 1290574 (0.0007) [2023-12-28 04:30:38,648][106225] Updated weights for policy 1, policy_version 1290584 (0.0009) [2023-12-28 04:30:38,710][106225] Updated weights for policy 1, policy_version 1290594 (0.0008) [2023-12-28 04:30:38,741][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000005 [2023-12-28 04:30:39,156][106226] Updated weights for policy 0, policy_version 1287354 (0.0009) [2023-12-28 04:30:39,206][106226] Updated weights for policy 0, policy_version 1287364 (0.0010) [2023-12-28 04:30:39,274][106226] Updated weights for policy 0, policy_version 1287374 (0.0008) [2023-12-28 04:30:39,343][106226] Updated weights for policy 0, policy_version 1287384 (0.0010) [2023-12-28 04:30:39,470][106225] Updated weights for policy 1, policy_version 1290604 (0.0009) [2023-12-28 04:30:39,531][106225] Updated weights for policy 1, policy_version 1290614 (0.0010) [2023-12-28 04:30:39,589][106225] Updated weights for policy 1, policy_version 1290624 (0.0006) [2023-12-28 04:30:40,168][106226] Updated weights for policy 0, policy_version 1287394 (0.0008) [2023-12-28 04:30:40,229][106226] Updated weights for policy 0, policy_version 1287404 (0.0009) [2023-12-28 04:30:40,247][106225] Updated weights for policy 1, policy_version 1290634 (0.0007) [2023-12-28 04:30:40,295][106226] Updated weights for policy 0, policy_version 1287414 (0.0006) [2023-12-28 04:30:40,308][106225] Updated weights for policy 1, policy_version 1290644 (0.0010) [2023-12-28 04:30:40,369][106225] Updated weights for policy 1, policy_version 1290654 (0.0010) [2023-12-28 04:30:40,435][106225] Updated weights for policy 1, policy_version 1290664 (0.0010) [2023-12-28 04:30:40,973][106226] Updated weights for policy 0, policy_version 1287424 (0.0007) [2023-12-28 04:30:41,036][106226] Updated weights for policy 0, policy_version 1287434 (0.0008) [2023-12-28 04:30:41,099][106226] Updated weights for policy 0, policy_version 1287444 (0.0008) [2023-12-28 04:30:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 660103168. Throughput: 0: 9905.8, 1: 9971.1. Samples: 660075456. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:41,175][105115] Avg episode reward: [(0, '-4.138'), (1, '-5.036')] [2023-12-28 04:30:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001287448_329646080.pth... [2023-12-28 04:30:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001286296_329351168.pth [2023-12-28 04:30:41,219][106225] Updated weights for policy 1, policy_version 1290674 (0.0010) [2023-12-28 04:30:41,283][106225] Updated weights for policy 1, policy_version 1290684 (0.0007) [2023-12-28 04:30:41,347][106225] Updated weights for policy 1, policy_version 1290694 (0.0007) [2023-12-28 04:30:41,358][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001290696_330465280.pth... [2023-12-28 04:30:41,363][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001289512_330162176.pth [2023-12-28 04:30:41,911][106226] Updated weights for policy 0, policy_version 1287454 (0.0008) [2023-12-28 04:30:41,976][106226] Updated weights for policy 0, policy_version 1287464 (0.0007) [2023-12-28 04:30:42,036][106226] Updated weights for policy 0, policy_version 1287474 (0.0006) [2023-12-28 04:30:42,039][106225] Updated weights for policy 1, policy_version 1290704 (0.0009) [2023-12-28 04:30:42,107][106225] Updated weights for policy 1, policy_version 1290714 (0.0008) [2023-12-28 04:30:42,177][106225] Updated weights for policy 1, policy_version 1290724 (0.0008) [2023-12-28 04:30:42,717][106226] Updated weights for policy 0, policy_version 1287484 (0.0008) [2023-12-28 04:30:42,778][106226] Updated weights for policy 0, policy_version 1287494 (0.0011) [2023-12-28 04:30:42,841][106226] Updated weights for policy 0, policy_version 1287504 (0.0010) [2023-12-28 04:30:42,872][106225] Updated weights for policy 1, policy_version 1290734 (0.0006) [2023-12-28 04:30:42,920][106225] Updated weights for policy 1, policy_version 1290744 (0.0010) [2023-12-28 04:30:42,966][106225] Updated weights for policy 1, policy_version 1290754 (0.0010) [2023-12-28 04:30:43,463][106226] Updated weights for policy 0, policy_version 1287514 (0.0009) [2023-12-28 04:30:43,527][106226] Updated weights for policy 0, policy_version 1287524 (0.0005) [2023-12-28 04:30:43,594][106226] Updated weights for policy 0, policy_version 1287534 (0.0005) [2023-12-28 04:30:43,656][106225] Updated weights for policy 1, policy_version 1290764 (0.0009) [2023-12-28 04:30:43,660][106226] Updated weights for policy 0, policy_version 1287544 (0.0005) [2023-12-28 04:30:43,704][106225] Updated weights for policy 1, policy_version 1290774 (0.0008) [2023-12-28 04:30:43,763][106225] Updated weights for policy 1, policy_version 1290784 (0.0007) [2023-12-28 04:30:44,304][106226] Updated weights for policy 0, policy_version 1287554 (0.0010) [2023-12-28 04:30:44,367][106226] Updated weights for policy 0, policy_version 1287564 (0.0010) [2023-12-28 04:30:44,423][106226] Updated weights for policy 0, policy_version 1287574 (0.0010) [2023-12-28 04:30:44,435][106225] Updated weights for policy 1, policy_version 1290794 (0.0006) [2023-12-28 04:30:44,492][106225] Updated weights for policy 1, policy_version 1290804 (0.0008) [2023-12-28 04:30:44,549][106225] Updated weights for policy 1, policy_version 1290814 (0.0008) [2023-12-28 04:30:44,606][106225] Updated weights for policy 1, policy_version 1290824 (0.0008) [2023-12-28 04:30:45,056][106226] Updated weights for policy 0, policy_version 1287584 (0.0008) [2023-12-28 04:30:45,123][106226] Updated weights for policy 0, policy_version 1287594 (0.0008) [2023-12-28 04:30:45,190][106226] Updated weights for policy 0, policy_version 1287604 (0.0009) [2023-12-28 04:30:45,333][106225] Updated weights for policy 1, policy_version 1290834 (0.0009) [2023-12-28 04:30:45,396][106225] Updated weights for policy 1, policy_version 1290844 (0.0008) [2023-12-28 04:30:45,457][106225] Updated weights for policy 1, policy_version 1290854 (0.0009) [2023-12-28 04:30:45,937][106226] Updated weights for policy 0, policy_version 1287614 (0.0008) [2023-12-28 04:30:45,988][106226] Updated weights for policy 0, policy_version 1287624 (0.0007) [2023-12-28 04:30:46,038][106226] Updated weights for policy 0, policy_version 1287634 (0.0008) [2023-12-28 04:30:46,127][106225] Updated weights for policy 1, policy_version 1290864 (0.0009) [2023-12-28 04:30:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 660201472. Throughput: 0: 9843.0, 1: 10006.9. Samples: 660192596. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:46,175][105115] Avg episode reward: [(0, '-4.040'), (1, '-5.415')] [2023-12-28 04:30:46,184][106225] Updated weights for policy 1, policy_version 1290874 (0.0010) [2023-12-28 04:30:46,234][106225] Updated weights for policy 1, policy_version 1290884 (0.0010) [2023-12-28 04:30:46,713][106226] Updated weights for policy 0, policy_version 1287644 (0.0008) [2023-12-28 04:30:46,778][106226] Updated weights for policy 0, policy_version 1287654 (0.0008) [2023-12-28 04:30:46,846][106226] Updated weights for policy 0, policy_version 1287664 (0.0006) [2023-12-28 04:30:46,959][106225] Updated weights for policy 1, policy_version 1290894 (0.0010) [2023-12-28 04:30:47,025][106225] Updated weights for policy 1, policy_version 1290904 (0.0011) [2023-12-28 04:30:47,093][106225] Updated weights for policy 1, policy_version 1290914 (0.0011) [2023-12-28 04:30:47,564][106226] Updated weights for policy 0, policy_version 1287674 (0.0009) [2023-12-28 04:30:47,627][106226] Updated weights for policy 0, policy_version 1287684 (0.0007) [2023-12-28 04:30:47,686][106226] Updated weights for policy 0, policy_version 1287694 (0.0010) [2023-12-28 04:30:47,740][106226] Updated weights for policy 0, policy_version 1287704 (0.0007) [2023-12-28 04:30:47,751][106225] Updated weights for policy 1, policy_version 1290924 (0.0009) [2023-12-28 04:30:47,809][106225] Updated weights for policy 1, policy_version 1290934 (0.0006) [2023-12-28 04:30:47,864][106225] Updated weights for policy 1, policy_version 1290944 (0.0005) [2023-12-28 04:30:48,485][106225] Updated weights for policy 1, policy_version 1290954 (0.0006) [2023-12-28 04:30:48,504][106226] Updated weights for policy 0, policy_version 1287714 (0.0009) [2023-12-28 04:30:48,541][106225] Updated weights for policy 1, policy_version 1290964 (0.0008) [2023-12-28 04:30:48,559][106226] Updated weights for policy 0, policy_version 1287724 (0.0008) [2023-12-28 04:30:48,600][106225] Updated weights for policy 1, policy_version 1290974 (0.0008) [2023-12-28 04:30:48,622][106226] Updated weights for policy 0, policy_version 1287734 (0.0007) [2023-12-28 04:30:48,659][106225] Updated weights for policy 1, policy_version 1290984 (0.0009) [2023-12-28 04:30:49,283][106226] Updated weights for policy 0, policy_version 1287744 (0.0007) [2023-12-28 04:30:49,336][106226] Updated weights for policy 0, policy_version 1287754 (0.0008) [2023-12-28 04:30:49,402][106226] Updated weights for policy 0, policy_version 1287764 (0.0007) [2023-12-28 04:30:49,433][106225] Updated weights for policy 1, policy_version 1290994 (0.0011) [2023-12-28 04:30:49,481][106225] Updated weights for policy 1, policy_version 1291004 (0.0010) [2023-12-28 04:30:49,528][106225] Updated weights for policy 1, policy_version 1291014 (0.0010) [2023-12-28 04:30:50,165][106226] Updated weights for policy 0, policy_version 1287774 (0.0008) [2023-12-28 04:30:50,232][106226] Updated weights for policy 0, policy_version 1287784 (0.0006) [2023-12-28 04:30:50,253][106225] Updated weights for policy 1, policy_version 1291024 (0.0008) [2023-12-28 04:30:50,296][106226] Updated weights for policy 0, policy_version 1287794 (0.0006) [2023-12-28 04:30:50,312][106225] Updated weights for policy 1, policy_version 1291034 (0.0008) [2023-12-28 04:30:50,375][106225] Updated weights for policy 1, policy_version 1291044 (0.0009) [2023-12-28 04:30:50,923][106226] Updated weights for policy 0, policy_version 1287804 (0.0006) [2023-12-28 04:30:50,985][106226] Updated weights for policy 0, policy_version 1287814 (0.0006) [2023-12-28 04:30:51,053][106226] Updated weights for policy 0, policy_version 1287824 (0.0007) [2023-12-28 04:30:51,076][106225] Updated weights for policy 1, policy_version 1291054 (0.0009) [2023-12-28 04:30:51,137][106225] Updated weights for policy 1, policy_version 1291064 (0.0006) [2023-12-28 04:30:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 660299776. Throughput: 0: 9846.9, 1: 10006.3. Samples: 660309724. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:51,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-5.175')] [2023-12-28 04:30:51,197][106225] Updated weights for policy 1, policy_version 1291074 (0.0008) [2023-12-28 04:30:51,839][106226] Updated weights for policy 0, policy_version 1287834 (0.0008) [2023-12-28 04:30:51,898][106226] Updated weights for policy 0, policy_version 1287844 (0.0010) [2023-12-28 04:30:51,951][106225] Updated weights for policy 1, policy_version 1291084 (0.0009) [2023-12-28 04:30:51,962][106226] Updated weights for policy 0, policy_version 1287854 (0.0008) [2023-12-28 04:30:52,019][106226] Updated weights for policy 0, policy_version 1287864 (0.0006) [2023-12-28 04:30:52,020][106225] Updated weights for policy 1, policy_version 1291094 (0.0008) [2023-12-28 04:30:52,088][106225] Updated weights for policy 1, policy_version 1291104 (0.0009) [2023-12-28 04:30:52,762][106225] Updated weights for policy 1, policy_version 1291114 (0.0008) [2023-12-28 04:30:52,818][106226] Updated weights for policy 0, policy_version 1287874 (0.0009) [2023-12-28 04:30:52,827][106225] Updated weights for policy 1, policy_version 1291124 (0.0008) [2023-12-28 04:30:52,876][106226] Updated weights for policy 0, policy_version 1287884 (0.0007) [2023-12-28 04:30:52,889][106225] Updated weights for policy 1, policy_version 1291134 (0.0006) [2023-12-28 04:30:52,934][106226] Updated weights for policy 0, policy_version 1287894 (0.0008) [2023-12-28 04:30:52,954][106225] Updated weights for policy 1, policy_version 1291144 (0.0008) [2023-12-28 04:30:53,528][106226] Updated weights for policy 0, policy_version 1287904 (0.0006) [2023-12-28 04:30:53,593][106226] Updated weights for policy 0, policy_version 1287914 (0.0008) [2023-12-28 04:30:53,660][106226] Updated weights for policy 0, policy_version 1287924 (0.0009) [2023-12-28 04:30:53,707][106225] Updated weights for policy 1, policy_version 1291154 (0.0007) [2023-12-28 04:30:53,766][106225] Updated weights for policy 1, policy_version 1291164 (0.0008) [2023-12-28 04:30:53,810][106225] Updated weights for policy 1, policy_version 1291174 (0.0008) [2023-12-28 04:30:54,341][106226] Updated weights for policy 0, policy_version 1287934 (0.0008) [2023-12-28 04:30:54,403][106226] Updated weights for policy 0, policy_version 1287944 (0.0008) [2023-12-28 04:30:54,463][106226] Updated weights for policy 0, policy_version 1287954 (0.0009) [2023-12-28 04:30:54,531][106225] Updated weights for policy 1, policy_version 1291184 (0.0009) [2023-12-28 04:30:54,591][106225] Updated weights for policy 1, policy_version 1291194 (0.0009) [2023-12-28 04:30:54,645][106225] Updated weights for policy 1, policy_version 1291204 (0.0008) [2023-12-28 04:30:55,176][106226] Updated weights for policy 0, policy_version 1287964 (0.0008) [2023-12-28 04:30:55,234][106226] Updated weights for policy 0, policy_version 1287974 (0.0008) [2023-12-28 04:30:55,292][106226] Updated weights for policy 0, policy_version 1287984 (0.0009) [2023-12-28 04:30:55,360][106225] Updated weights for policy 1, policy_version 1291214 (0.0008) [2023-12-28 04:30:55,414][106225] Updated weights for policy 1, policy_version 1291224 (0.0008) [2023-12-28 04:30:55,471][106225] Updated weights for policy 1, policy_version 1291234 (0.0008) [2023-12-28 04:30:56,052][106226] Updated weights for policy 0, policy_version 1287994 (0.0007) [2023-12-28 04:30:56,103][106226] Updated weights for policy 0, policy_version 1288004 (0.0008) [2023-12-28 04:30:56,135][106225] Updated weights for policy 1, policy_version 1291244 (0.0008) [2023-12-28 04:30:56,165][106226] Updated weights for policy 0, policy_version 1288014 (0.0008) [2023-12-28 04:30:56,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 660389888. Throughput: 0: 9844.3, 1: 9886.7. Samples: 660367808. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:30:56,175][105115] Avg episode reward: [(0, '-4.148'), (1, '-5.016')] [2023-12-28 04:30:56,191][106225] Updated weights for policy 1, policy_version 1291254 (0.0010) [2023-12-28 04:30:56,215][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001288024_329793536.pth... [2023-12-28 04:30:56,216][106226] Updated weights for policy 0, policy_version 1288024 (0.0006) [2023-12-28 04:30:56,219][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001286872_329498624.pth [2023-12-28 04:30:56,248][106225] Updated weights for policy 1, policy_version 1291264 (0.0010) [2023-12-28 04:30:56,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001291272_330612736.pth... [2023-12-28 04:30:56,295][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001290088_330309632.pth [2023-12-28 04:30:56,913][106225] Updated weights for policy 1, policy_version 1291274 (0.0010) [2023-12-28 04:30:56,926][106226] Updated weights for policy 0, policy_version 1288034 (0.0007) [2023-12-28 04:30:56,955][106225] Updated weights for policy 1, policy_version 1291284 (0.0010) [2023-12-28 04:30:56,973][106226] Updated weights for policy 0, policy_version 1288044 (0.0005) [2023-12-28 04:30:57,000][106225] Updated weights for policy 1, policy_version 1291294 (0.0009) [2023-12-28 04:30:57,018][106226] Updated weights for policy 0, policy_version 1288054 (0.0007) [2023-12-28 04:30:57,054][106225] Updated weights for policy 1, policy_version 1291304 (0.0005) [2023-12-28 04:30:57,604][106225] Updated weights for policy 1, policy_version 1291314 (0.0005) [2023-12-28 04:30:57,654][106225] Updated weights for policy 1, policy_version 1291324 (0.0005) [2023-12-28 04:30:57,705][106225] Updated weights for policy 1, policy_version 1291334 (0.0005) [2023-12-28 04:30:57,873][106226] Updated weights for policy 0, policy_version 1288064 (0.0008) [2023-12-28 04:30:57,922][106226] Updated weights for policy 0, policy_version 1288074 (0.0007) [2023-12-28 04:30:57,971][106226] Updated weights for policy 0, policy_version 1288084 (0.0007) [2023-12-28 04:30:58,344][106225] Updated weights for policy 1, policy_version 1291344 (0.0006) [2023-12-28 04:30:58,411][106225] Updated weights for policy 1, policy_version 1291354 (0.0008) [2023-12-28 04:30:58,479][106225] Updated weights for policy 1, policy_version 1291364 (0.0008) [2023-12-28 04:30:58,679][106226] Updated weights for policy 0, policy_version 1288094 (0.0009) [2023-12-28 04:30:58,755][106226] Updated weights for policy 0, policy_version 1288104 (0.0010) [2023-12-28 04:30:58,828][106226] Updated weights for policy 0, policy_version 1288114 (0.0010) [2023-12-28 04:30:59,372][106225] Updated weights for policy 1, policy_version 1291374 (0.0009) [2023-12-28 04:30:59,430][106225] Updated weights for policy 1, policy_version 1291384 (0.0008) [2023-12-28 04:30:59,483][106225] Updated weights for policy 1, policy_version 1291394 (0.0008) [2023-12-28 04:30:59,665][106226] Updated weights for policy 0, policy_version 1288124 (0.0008) [2023-12-28 04:30:59,725][106226] Updated weights for policy 0, policy_version 1288134 (0.0009) [2023-12-28 04:30:59,777][106226] Updated weights for policy 0, policy_version 1288144 (0.0011) [2023-12-28 04:31:00,206][106225] Updated weights for policy 1, policy_version 1291404 (0.0009) [2023-12-28 04:31:00,262][106225] Updated weights for policy 1, policy_version 1291414 (0.0011) [2023-12-28 04:31:00,318][106225] Updated weights for policy 1, policy_version 1291424 (0.0010) [2023-12-28 04:31:00,439][106226] Updated weights for policy 0, policy_version 1288154 (0.0010) [2023-12-28 04:31:00,495][106226] Updated weights for policy 0, policy_version 1288164 (0.0005) [2023-12-28 04:31:00,542][106226] Updated weights for policy 0, policy_version 1288174 (0.0005) [2023-12-28 04:31:00,587][106226] Updated weights for policy 0, policy_version 1288184 (0.0005) [2023-12-28 04:31:00,896][106225] Updated weights for policy 1, policy_version 1291434 (0.0010) [2023-12-28 04:31:00,957][106225] Updated weights for policy 1, policy_version 1291444 (0.0010) [2023-12-28 04:31:01,013][106225] Updated weights for policy 1, policy_version 1291454 (0.0010) [2023-12-28 04:31:01,081][106225] Updated weights for policy 1, policy_version 1291464 (0.0010) [2023-12-28 04:31:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 660496384. Throughput: 0: 9781.6, 1: 9963.0. Samples: 660483236. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:01,175][105115] Avg episode reward: [(0, '-4.042'), (1, '-5.126')] [2023-12-28 04:31:01,230][106226] Updated weights for policy 0, policy_version 1288194 (0.0007) [2023-12-28 04:31:01,294][106226] Updated weights for policy 0, policy_version 1288204 (0.0007) [2023-12-28 04:31:01,346][106226] Updated weights for policy 0, policy_version 1288214 (0.0006) [2023-12-28 04:31:01,818][106225] Updated weights for policy 1, policy_version 1291474 (0.0009) [2023-12-28 04:31:01,881][106225] Updated weights for policy 1, policy_version 1291484 (0.0009) [2023-12-28 04:31:01,943][106225] Updated weights for policy 1, policy_version 1291494 (0.0008) [2023-12-28 04:31:02,024][106226] Updated weights for policy 0, policy_version 1288224 (0.0008) [2023-12-28 04:31:02,081][106226] Updated weights for policy 0, policy_version 1288234 (0.0009) [2023-12-28 04:31:02,154][106226] Updated weights for policy 0, policy_version 1288244 (0.0007) [2023-12-28 04:31:02,671][106225] Updated weights for policy 1, policy_version 1291504 (0.0006) [2023-12-28 04:31:02,724][106225] Updated weights for policy 1, policy_version 1291514 (0.0008) [2023-12-28 04:31:02,786][106225] Updated weights for policy 1, policy_version 1291524 (0.0008) [2023-12-28 04:31:02,869][106226] Updated weights for policy 0, policy_version 1288254 (0.0009) [2023-12-28 04:31:02,934][106226] Updated weights for policy 0, policy_version 1288264 (0.0009) [2023-12-28 04:31:02,992][106226] Updated weights for policy 0, policy_version 1288274 (0.0008) [2023-12-28 04:31:03,375][106225] Updated weights for policy 1, policy_version 1291534 (0.0005) [2023-12-28 04:31:03,433][106225] Updated weights for policy 1, policy_version 1291544 (0.0008) [2023-12-28 04:31:03,492][106225] Updated weights for policy 1, policy_version 1291554 (0.0008) [2023-12-28 04:31:03,750][106226] Updated weights for policy 0, policy_version 1288284 (0.0009) [2023-12-28 04:31:03,806][106226] Updated weights for policy 0, policy_version 1288294 (0.0008) [2023-12-28 04:31:03,867][106226] Updated weights for policy 0, policy_version 1288304 (0.0008) [2023-12-28 04:31:04,234][106225] Updated weights for policy 1, policy_version 1291564 (0.0009) [2023-12-28 04:31:04,302][106225] Updated weights for policy 1, policy_version 1291574 (0.0010) [2023-12-28 04:31:04,367][106225] Updated weights for policy 1, policy_version 1291584 (0.0008) [2023-12-28 04:31:04,628][106226] Updated weights for policy 0, policy_version 1288314 (0.0008) [2023-12-28 04:31:04,698][106226] Updated weights for policy 0, policy_version 1288324 (0.0009) [2023-12-28 04:31:04,770][106226] Updated weights for policy 0, policy_version 1288334 (0.0009) [2023-12-28 04:31:04,841][106226] Updated weights for policy 0, policy_version 1288344 (0.0009) [2023-12-28 04:31:05,039][106225] Updated weights for policy 1, policy_version 1291594 (0.0008) [2023-12-28 04:31:05,111][106225] Updated weights for policy 1, policy_version 1291604 (0.0006) [2023-12-28 04:31:05,164][106225] Updated weights for policy 1, policy_version 1291614 (0.0007) [2023-12-28 04:31:05,215][106225] Updated weights for policy 1, policy_version 1291624 (0.0009) [2023-12-28 04:31:05,469][106226] Updated weights for policy 0, policy_version 1288354 (0.0005) [2023-12-28 04:31:05,513][106226] Updated weights for policy 0, policy_version 1288364 (0.0005) [2023-12-28 04:31:05,561][106226] Updated weights for policy 0, policy_version 1288374 (0.0006) [2023-12-28 04:31:05,973][106225] Updated weights for policy 1, policy_version 1291634 (0.0009) [2023-12-28 04:31:06,034][106225] Updated weights for policy 1, policy_version 1291644 (0.0009) [2023-12-28 04:31:06,083][106225] Updated weights for policy 1, policy_version 1291654 (0.0009) [2023-12-28 04:31:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 660594688. Throughput: 0: 9809.8, 1: 9988.4. Samples: 660604704. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:06,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.211')] [2023-12-28 04:31:06,208][106226] Updated weights for policy 0, policy_version 1288384 (0.0007) [2023-12-28 04:31:06,281][106226] Updated weights for policy 0, policy_version 1288394 (0.0011) [2023-12-28 04:31:06,351][106226] Updated weights for policy 0, policy_version 1288404 (0.0009) [2023-12-28 04:31:06,869][106225] Updated weights for policy 1, policy_version 1291664 (0.0008) [2023-12-28 04:31:06,932][106225] Updated weights for policy 1, policy_version 1291674 (0.0007) [2023-12-28 04:31:06,997][106225] Updated weights for policy 1, policy_version 1291684 (0.0006) [2023-12-28 04:31:07,060][106226] Updated weights for policy 0, policy_version 1288414 (0.0009) [2023-12-28 04:31:07,117][106226] Updated weights for policy 0, policy_version 1288424 (0.0010) [2023-12-28 04:31:07,179][106226] Updated weights for policy 0, policy_version 1288434 (0.0011) [2023-12-28 04:31:07,685][106225] Updated weights for policy 1, policy_version 1291694 (0.0009) [2023-12-28 04:31:07,746][106225] Updated weights for policy 1, policy_version 1291704 (0.0010) [2023-12-28 04:31:07,809][106225] Updated weights for policy 1, policy_version 1291714 (0.0008) [2023-12-28 04:31:07,908][106226] Updated weights for policy 0, policy_version 1288444 (0.0011) [2023-12-28 04:31:07,956][106226] Updated weights for policy 0, policy_version 1288454 (0.0010) [2023-12-28 04:31:08,017][106226] Updated weights for policy 0, policy_version 1288464 (0.0011) [2023-12-28 04:31:08,594][106225] Updated weights for policy 1, policy_version 1291724 (0.0008) [2023-12-28 04:31:08,657][106225] Updated weights for policy 1, policy_version 1291734 (0.0006) [2023-12-28 04:31:08,717][106225] Updated weights for policy 1, policy_version 1291744 (0.0006) [2023-12-28 04:31:08,734][106226] Updated weights for policy 0, policy_version 1288474 (0.0010) [2023-12-28 04:31:08,795][106226] Updated weights for policy 0, policy_version 1288484 (0.0007) [2023-12-28 04:31:08,859][106226] Updated weights for policy 0, policy_version 1288494 (0.0007) [2023-12-28 04:31:08,919][106226] Updated weights for policy 0, policy_version 1288504 (0.0006) [2023-12-28 04:31:09,412][106225] Updated weights for policy 1, policy_version 1291754 (0.0007) [2023-12-28 04:31:09,489][106225] Updated weights for policy 1, policy_version 1291764 (0.0007) [2023-12-28 04:31:09,559][106225] Updated weights for policy 1, policy_version 1291774 (0.0006) [2023-12-28 04:31:09,607][106226] Updated weights for policy 0, policy_version 1288514 (0.0006) [2023-12-28 04:31:09,628][106225] Updated weights for policy 1, policy_version 1291784 (0.0007) [2023-12-28 04:31:09,677][106226] Updated weights for policy 0, policy_version 1288524 (0.0008) [2023-12-28 04:31:09,743][106226] Updated weights for policy 0, policy_version 1288534 (0.0007) [2023-12-28 04:31:10,310][106225] Updated weights for policy 1, policy_version 1291794 (0.0011) [2023-12-28 04:31:10,377][106225] Updated weights for policy 1, policy_version 1291804 (0.0010) [2023-12-28 04:31:10,444][106225] Updated weights for policy 1, policy_version 1291814 (0.0011) [2023-12-28 04:31:10,487][106226] Updated weights for policy 0, policy_version 1288544 (0.0007) [2023-12-28 04:31:10,551][106226] Updated weights for policy 0, policy_version 1288554 (0.0008) [2023-12-28 04:31:10,608][106226] Updated weights for policy 0, policy_version 1288564 (0.0009) [2023-12-28 04:31:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 660684800. Throughput: 0: 9811.3, 1: 9986.3. Samples: 660661892. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:11,175][105115] Avg episode reward: [(0, '-4.283'), (1, '-5.292')] [2023-12-28 04:31:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001291816_330752000.pth... [2023-12-28 04:31:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001288568_329932800.pth... [2023-12-28 04:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001287448_329646080.pth [2023-12-28 04:31:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001290696_330465280.pth [2023-12-28 04:31:11,285][106225] Updated weights for policy 1, policy_version 1291824 (0.0008) [2023-12-28 04:31:11,353][106225] Updated weights for policy 1, policy_version 1291834 (0.0007) [2023-12-28 04:31:11,431][106225] Updated weights for policy 1, policy_version 1291844 (0.0008) [2023-12-28 04:31:11,452][106226] Updated weights for policy 0, policy_version 1288574 (0.0008) [2023-12-28 04:31:11,515][106226] Updated weights for policy 0, policy_version 1288584 (0.0008) [2023-12-28 04:31:11,582][106226] Updated weights for policy 0, policy_version 1288594 (0.0009) [2023-12-28 04:31:12,250][106225] Updated weights for policy 1, policy_version 1291854 (0.0008) [2023-12-28 04:31:12,320][106225] Updated weights for policy 1, policy_version 1291864 (0.0008) [2023-12-28 04:31:12,338][106226] Updated weights for policy 0, policy_version 1288604 (0.0008) [2023-12-28 04:31:12,396][106225] Updated weights for policy 1, policy_version 1291874 (0.0008) [2023-12-28 04:31:12,410][106226] Updated weights for policy 0, policy_version 1288614 (0.0009) [2023-12-28 04:31:12,472][106226] Updated weights for policy 0, policy_version 1288624 (0.0010) [2023-12-28 04:31:13,112][106225] Updated weights for policy 1, policy_version 1291884 (0.0008) [2023-12-28 04:31:13,165][106225] Updated weights for policy 1, policy_version 1291894 (0.0008) [2023-12-28 04:31:13,202][106226] Updated weights for policy 0, policy_version 1288634 (0.0011) [2023-12-28 04:31:13,215][106225] Updated weights for policy 1, policy_version 1291904 (0.0007) [2023-12-28 04:31:13,260][106226] Updated weights for policy 0, policy_version 1288644 (0.0011) [2023-12-28 04:31:13,315][106226] Updated weights for policy 0, policy_version 1288654 (0.0010) [2023-12-28 04:31:13,372][106226] Updated weights for policy 0, policy_version 1288664 (0.0011) [2023-12-28 04:31:13,961][106225] Updated weights for policy 1, policy_version 1291914 (0.0007) [2023-12-28 04:31:14,022][106225] Updated weights for policy 1, policy_version 1291924 (0.0006) [2023-12-28 04:31:14,078][106225] Updated weights for policy 1, policy_version 1291934 (0.0007) [2023-12-28 04:31:14,099][106226] Updated weights for policy 0, policy_version 1288674 (0.0010) [2023-12-28 04:31:14,125][106225] Updated weights for policy 1, policy_version 1291944 (0.0006) [2023-12-28 04:31:14,152][106226] Updated weights for policy 0, policy_version 1288684 (0.0010) [2023-12-28 04:31:14,217][106226] Updated weights for policy 0, policy_version 1288694 (0.0010) [2023-12-28 04:31:14,893][106225] Updated weights for policy 1, policy_version 1291954 (0.0008) [2023-12-28 04:31:14,951][106225] Updated weights for policy 1, policy_version 1291964 (0.0009) [2023-12-28 04:31:14,985][106226] Updated weights for policy 0, policy_version 1288704 (0.0007) [2023-12-28 04:31:15,015][106225] Updated weights for policy 1, policy_version 1291974 (0.0008) [2023-12-28 04:31:15,053][106226] Updated weights for policy 0, policy_version 1288714 (0.0006) [2023-12-28 04:31:15,117][106226] Updated weights for policy 0, policy_version 1288724 (0.0008) [2023-12-28 04:31:15,800][106225] Updated weights for policy 1, policy_version 1291984 (0.0009) [2023-12-28 04:31:15,810][106226] Updated weights for policy 0, policy_version 1288734 (0.0007) [2023-12-28 04:31:15,849][106225] Updated weights for policy 1, policy_version 1291994 (0.0008) [2023-12-28 04:31:15,865][106226] Updated weights for policy 0, policy_version 1288744 (0.0006) [2023-12-28 04:31:15,901][106225] Updated weights for policy 1, policy_version 1292004 (0.0009) [2023-12-28 04:31:15,931][106226] Updated weights for policy 0, policy_version 1288754 (0.0009) [2023-12-28 04:31:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 660783104. Throughput: 0: 9688.2, 1: 9775.8. Samples: 660771660. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:16,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-5.158')] [2023-12-28 04:31:16,561][106226] Updated weights for policy 0, policy_version 1288764 (0.0006) [2023-12-28 04:31:16,612][106225] Updated weights for policy 1, policy_version 1292014 (0.0008) [2023-12-28 04:31:16,618][106226] Updated weights for policy 0, policy_version 1288774 (0.0006) [2023-12-28 04:31:16,664][106226] Updated weights for policy 0, policy_version 1288784 (0.0007) [2023-12-28 04:31:16,666][106225] Updated weights for policy 1, policy_version 1292024 (0.0007) [2023-12-28 04:31:16,719][106225] Updated weights for policy 1, policy_version 1292034 (0.0007) [2023-12-28 04:31:17,344][106226] Updated weights for policy 0, policy_version 1288794 (0.0006) [2023-12-28 04:31:17,403][106226] Updated weights for policy 0, policy_version 1288804 (0.0009) [2023-12-28 04:31:17,428][106225] Updated weights for policy 1, policy_version 1292044 (0.0009) [2023-12-28 04:31:17,454][106226] Updated weights for policy 0, policy_version 1288814 (0.0009) [2023-12-28 04:31:17,483][106225] Updated weights for policy 1, policy_version 1292054 (0.0009) [2023-12-28 04:31:17,514][106226] Updated weights for policy 0, policy_version 1288824 (0.0009) [2023-12-28 04:31:17,540][106225] Updated weights for policy 1, policy_version 1292064 (0.0010) [2023-12-28 04:31:18,269][106225] Updated weights for policy 1, policy_version 1292074 (0.0009) [2023-12-28 04:31:18,323][106225] Updated weights for policy 1, policy_version 1292084 (0.0006) [2023-12-28 04:31:18,334][106226] Updated weights for policy 0, policy_version 1288834 (0.0008) [2023-12-28 04:31:18,391][106225] Updated weights for policy 1, policy_version 1292094 (0.0007) [2023-12-28 04:31:18,396][106226] Updated weights for policy 0, policy_version 1288844 (0.0010) [2023-12-28 04:31:18,454][106226] Updated weights for policy 0, policy_version 1288854 (0.0009) [2023-12-28 04:31:18,458][106225] Updated weights for policy 1, policy_version 1292104 (0.0006) [2023-12-28 04:31:19,063][106225] Updated weights for policy 1, policy_version 1292114 (0.0005) [2023-12-28 04:31:19,115][106225] Updated weights for policy 1, policy_version 1292124 (0.0006) [2023-12-28 04:31:19,160][106225] Updated weights for policy 1, policy_version 1292134 (0.0008) [2023-12-28 04:31:19,260][106226] Updated weights for policy 0, policy_version 1288864 (0.0008) [2023-12-28 04:31:19,325][106226] Updated weights for policy 0, policy_version 1288874 (0.0009) [2023-12-28 04:31:19,391][106226] Updated weights for policy 0, policy_version 1288884 (0.0008) [2023-12-28 04:31:19,913][106225] Updated weights for policy 1, policy_version 1292144 (0.0008) [2023-12-28 04:31:19,976][106225] Updated weights for policy 1, policy_version 1292154 (0.0008) [2023-12-28 04:31:20,032][106225] Updated weights for policy 1, policy_version 1292164 (0.0008) [2023-12-28 04:31:20,179][106226] Updated weights for policy 0, policy_version 1288894 (0.0008) [2023-12-28 04:31:20,227][106226] Updated weights for policy 0, policy_version 1288904 (0.0008) [2023-12-28 04:31:20,279][106226] Updated weights for policy 0, policy_version 1288914 (0.0011) [2023-12-28 04:31:20,800][106225] Updated weights for policy 1, policy_version 1292174 (0.0009) [2023-12-28 04:31:20,858][106225] Updated weights for policy 1, policy_version 1292184 (0.0009) [2023-12-28 04:31:20,919][106225] Updated weights for policy 1, policy_version 1292194 (0.0009) [2023-12-28 04:31:21,045][106226] Updated weights for policy 0, policy_version 1288924 (0.0010) [2023-12-28 04:31:21,100][106226] Updated weights for policy 0, policy_version 1288934 (0.0009) [2023-12-28 04:31:21,168][106226] Updated weights for policy 0, policy_version 1288944 (0.0008) [2023-12-28 04:31:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.2, 300 sec: 19716.4). Total num frames: 660873216. Throughput: 0: 9564.0, 1: 9791.4. Samples: 660885584. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:21,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-5.133')] [2023-12-28 04:31:21,771][106225] Updated weights for policy 1, policy_version 1292204 (0.0009) [2023-12-28 04:31:21,820][106225] Updated weights for policy 1, policy_version 1292214 (0.0008) [2023-12-28 04:31:21,873][106225] Updated weights for policy 1, policy_version 1292224 (0.0008) [2023-12-28 04:31:21,950][106226] Updated weights for policy 0, policy_version 1288954 (0.0008) [2023-12-28 04:31:22,018][106226] Updated weights for policy 0, policy_version 1288964 (0.0009) [2023-12-28 04:31:22,078][106226] Updated weights for policy 0, policy_version 1288974 (0.0008) [2023-12-28 04:31:22,132][106226] Updated weights for policy 0, policy_version 1288984 (0.0009) [2023-12-28 04:31:22,548][106225] Updated weights for policy 1, policy_version 1292234 (0.0009) [2023-12-28 04:31:22,612][106225] Updated weights for policy 1, policy_version 1292244 (0.0009) [2023-12-28 04:31:22,669][106225] Updated weights for policy 1, policy_version 1292254 (0.0009) [2023-12-28 04:31:22,729][106225] Updated weights for policy 1, policy_version 1292264 (0.0009) [2023-12-28 04:31:22,916][106226] Updated weights for policy 0, policy_version 1288994 (0.0009) [2023-12-28 04:31:22,975][106226] Updated weights for policy 0, policy_version 1289004 (0.0009) [2023-12-28 04:31:23,037][106226] Updated weights for policy 0, policy_version 1289014 (0.0008) [2023-12-28 04:31:23,447][106225] Updated weights for policy 1, policy_version 1292274 (0.0010) [2023-12-28 04:31:23,500][106225] Updated weights for policy 1, policy_version 1292284 (0.0010) [2023-12-28 04:31:23,554][106225] Updated weights for policy 1, policy_version 1292294 (0.0009) [2023-12-28 04:31:23,771][106226] Updated weights for policy 0, policy_version 1289024 (0.0008) [2023-12-28 04:31:23,819][106226] Updated weights for policy 0, policy_version 1289034 (0.0008) [2023-12-28 04:31:23,867][106226] Updated weights for policy 0, policy_version 1289044 (0.0008) [2023-12-28 04:31:24,212][106225] Updated weights for policy 1, policy_version 1292304 (0.0008) [2023-12-28 04:31:24,268][106225] Updated weights for policy 1, policy_version 1292314 (0.0009) [2023-12-28 04:31:24,328][106225] Updated weights for policy 1, policy_version 1292324 (0.0009) [2023-12-28 04:31:24,595][106226] Updated weights for policy 0, policy_version 1289054 (0.0009) [2023-12-28 04:31:24,661][106226] Updated weights for policy 0, policy_version 1289064 (0.0009) [2023-12-28 04:31:24,721][106226] Updated weights for policy 0, policy_version 1289074 (0.0009) [2023-12-28 04:31:24,981][106225] Updated weights for policy 1, policy_version 1292334 (0.0009) [2023-12-28 04:31:25,036][106225] Updated weights for policy 1, policy_version 1292344 (0.0008) [2023-12-28 04:31:25,087][106225] Updated weights for policy 1, policy_version 1292354 (0.0005) [2023-12-28 04:31:25,443][106226] Updated weights for policy 0, policy_version 1289085 (0.0008) [2023-12-28 04:31:25,496][106226] Updated weights for policy 0, policy_version 1289095 (0.0005) [2023-12-28 04:31:25,553][106226] Updated weights for policy 0, policy_version 1289105 (0.0007) [2023-12-28 04:31:25,640][106225] Updated weights for policy 1, policy_version 1292364 (0.0007) [2023-12-28 04:31:25,686][106225] Updated weights for policy 1, policy_version 1292374 (0.0010) [2023-12-28 04:31:25,742][106225] Updated weights for policy 1, policy_version 1292384 (0.0010) [2023-12-28 04:31:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 660971520. Throughput: 0: 9543.7, 1: 9676.2. Samples: 660940352. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-28 04:31:26,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-5.357')] [2023-12-28 04:31:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001292392_330899456.pth... [2023-12-28 04:31:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001289112_330072064.pth... [2023-12-28 04:31:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001291272_330612736.pth [2023-12-28 04:31:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001288024_329793536.pth [2023-12-28 04:31:26,244][106226] Updated weights for policy 0, policy_version 1289115 (0.0008) [2023-12-28 04:31:26,295][106226] Updated weights for policy 0, policy_version 1289125 (0.0009) [2023-12-28 04:31:26,345][106226] Updated weights for policy 0, policy_version 1289135 (0.0009) [2023-12-28 04:31:26,351][106225] Updated weights for policy 1, policy_version 1292394 (0.0009) [2023-12-28 04:31:26,406][106225] Updated weights for policy 1, policy_version 1292404 (0.0005) [2023-12-28 04:31:26,457][106225] Updated weights for policy 1, policy_version 1292414 (0.0007) [2023-12-28 04:31:26,510][106225] Updated weights for policy 1, policy_version 1292424 (0.0008) [2023-12-28 04:31:27,069][106225] Updated weights for policy 1, policy_version 1292434 (0.0006) [2023-12-28 04:31:27,126][106225] Updated weights for policy 1, policy_version 1292445 (0.0009) [2023-12-28 04:31:27,127][106226] Updated weights for policy 0, policy_version 1289145 (0.0008) [2023-12-28 04:31:27,175][106225] Updated weights for policy 1, policy_version 1292455 (0.0007) [2023-12-28 04:31:27,180][106226] Updated weights for policy 0, policy_version 1289155 (0.0005) [2023-12-28 04:31:27,228][106226] Updated weights for policy 0, policy_version 1289165 (0.0006) [2023-12-28 04:31:27,289][106226] Updated weights for policy 0, policy_version 1289175 (0.0006) [2023-12-28 04:31:27,843][106225] Updated weights for policy 1, policy_version 1292465 (0.0008) [2023-12-28 04:31:27,899][106225] Updated weights for policy 1, policy_version 1292475 (0.0009) [2023-12-28 04:31:27,950][106225] Updated weights for policy 1, policy_version 1292485 (0.0007) [2023-12-28 04:31:27,977][106226] Updated weights for policy 0, policy_version 1289185 (0.0008) [2023-12-28 04:31:28,034][106226] Updated weights for policy 0, policy_version 1289195 (0.0006) [2023-12-28 04:31:28,091][106226] Updated weights for policy 0, policy_version 1289205 (0.0006) [2023-12-28 04:31:28,690][106225] Updated weights for policy 1, policy_version 1292495 (0.0007) [2023-12-28 04:31:28,738][106225] Updated weights for policy 1, policy_version 1292505 (0.0008) [2023-12-28 04:31:28,782][106226] Updated weights for policy 0, policy_version 1289215 (0.0007) [2023-12-28 04:31:28,799][106225] Updated weights for policy 1, policy_version 1292515 (0.0009) [2023-12-28 04:31:28,844][106226] Updated weights for policy 0, policy_version 1289225 (0.0008) [2023-12-28 04:31:28,910][106226] Updated weights for policy 0, policy_version 1289235 (0.0009) [2023-12-28 04:31:29,568][106226] Updated weights for policy 0, policy_version 1289245 (0.0007) [2023-12-28 04:31:29,573][106225] Updated weights for policy 1, policy_version 1292525 (0.0008) [2023-12-28 04:31:29,626][106226] Updated weights for policy 0, policy_version 1289255 (0.0007) [2023-12-28 04:31:29,634][106225] Updated weights for policy 1, policy_version 1292535 (0.0008) [2023-12-28 04:31:29,684][106226] Updated weights for policy 0, policy_version 1289265 (0.0008) [2023-12-28 04:31:29,690][106225] Updated weights for policy 1, policy_version 1292545 (0.0006) [2023-12-28 04:31:30,401][106226] Updated weights for policy 0, policy_version 1289275 (0.0007) [2023-12-28 04:31:30,437][106225] Updated weights for policy 1, policy_version 1292555 (0.0006) [2023-12-28 04:31:30,447][106226] Updated weights for policy 0, policy_version 1289285 (0.0008) [2023-12-28 04:31:30,493][106225] Updated weights for policy 1, policy_version 1292565 (0.0007) [2023-12-28 04:31:30,500][106226] Updated weights for policy 0, policy_version 1289295 (0.0008) [2023-12-28 04:31:30,547][106225] Updated weights for policy 1, policy_version 1292575 (0.0005) [2023-12-28 04:31:31,152][106225] Updated weights for policy 1, policy_version 1292585 (0.0008) [2023-12-28 04:31:31,154][106226] Updated weights for policy 0, policy_version 1289305 (0.0006) [2023-12-28 04:31:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 661069824. Throughput: 0: 9560.3, 1: 9790.5. Samples: 661063388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:31,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.936')] [2023-12-28 04:31:31,213][106225] Updated weights for policy 1, policy_version 1292595 (0.0007) [2023-12-28 04:31:31,215][106226] Updated weights for policy 0, policy_version 1289315 (0.0007) [2023-12-28 04:31:31,279][106226] Updated weights for policy 0, policy_version 1289325 (0.0008) [2023-12-28 04:31:31,279][106225] Updated weights for policy 1, policy_version 1292605 (0.0007) [2023-12-28 04:31:31,345][106226] Updated weights for policy 0, policy_version 1289335 (0.0009) [2023-12-28 04:31:31,359][106225] Updated weights for policy 1, policy_version 1292615 (0.0006) [2023-12-28 04:31:32,087][106226] Updated weights for policy 0, policy_version 1289345 (0.0011) [2023-12-28 04:31:32,111][106225] Updated weights for policy 1, policy_version 1292625 (0.0007) [2023-12-28 04:31:32,155][106226] Updated weights for policy 0, policy_version 1289355 (0.0011) [2023-12-28 04:31:32,172][106225] Updated weights for policy 1, policy_version 1292635 (0.0005) [2023-12-28 04:31:32,218][106226] Updated weights for policy 0, policy_version 1289365 (0.0009) [2023-12-28 04:31:32,235][106225] Updated weights for policy 1, policy_version 1292645 (0.0007) [2023-12-28 04:31:32,841][106226] Updated weights for policy 0, policy_version 1289375 (0.0006) [2023-12-28 04:31:32,884][106225] Updated weights for policy 1, policy_version 1292655 (0.0006) [2023-12-28 04:31:32,899][106226] Updated weights for policy 0, policy_version 1289385 (0.0010) [2023-12-28 04:31:32,941][106225] Updated weights for policy 1, policy_version 1292665 (0.0005) [2023-12-28 04:31:32,962][106226] Updated weights for policy 0, policy_version 1289395 (0.0011) [2023-12-28 04:31:32,997][106225] Updated weights for policy 1, policy_version 1292675 (0.0008) [2023-12-28 04:31:33,523][106225] Updated weights for policy 1, policy_version 1292685 (0.0008) [2023-12-28 04:31:33,572][106225] Updated weights for policy 1, policy_version 1292695 (0.0008) [2023-12-28 04:31:33,628][106225] Updated weights for policy 1, policy_version 1292705 (0.0007) [2023-12-28 04:31:33,632][106226] Updated weights for policy 0, policy_version 1289405 (0.0008) [2023-12-28 04:31:33,683][106226] Updated weights for policy 0, policy_version 1289415 (0.0005) [2023-12-28 04:31:33,727][106226] Updated weights for policy 0, policy_version 1289425 (0.0005) [2023-12-28 04:31:34,310][106226] Updated weights for policy 0, policy_version 1289435 (0.0005) [2023-12-28 04:31:34,330][106225] Updated weights for policy 1, policy_version 1292715 (0.0008) [2023-12-28 04:31:34,371][106226] Updated weights for policy 0, policy_version 1289445 (0.0010) [2023-12-28 04:31:34,392][106225] Updated weights for policy 1, policy_version 1292725 (0.0005) [2023-12-28 04:31:34,432][106226] Updated weights for policy 0, policy_version 1289455 (0.0011) [2023-12-28 04:31:34,455][106225] Updated weights for policy 1, policy_version 1292735 (0.0008) [2023-12-28 04:31:35,015][106226] Updated weights for policy 0, policy_version 1289465 (0.0010) [2023-12-28 04:31:35,075][106226] Updated weights for policy 0, policy_version 1289475 (0.0008) [2023-12-28 04:31:35,138][106226] Updated weights for policy 0, policy_version 1289485 (0.0005) [2023-12-28 04:31:35,167][106225] Updated weights for policy 1, policy_version 1292745 (0.0006) [2023-12-28 04:31:35,200][106226] Updated weights for policy 0, policy_version 1289495 (0.0008) [2023-12-28 04:31:35,226][106225] Updated weights for policy 1, policy_version 1292755 (0.0006) [2023-12-28 04:31:35,285][106225] Updated weights for policy 1, policy_version 1292765 (0.0008) [2023-12-28 04:31:35,348][106225] Updated weights for policy 1, policy_version 1292775 (0.0008) [2023-12-28 04:31:35,851][106226] Updated weights for policy 0, policy_version 1289505 (0.0010) [2023-12-28 04:31:35,904][106226] Updated weights for policy 0, policy_version 1289515 (0.0010) [2023-12-28 04:31:35,963][106226] Updated weights for policy 0, policy_version 1289525 (0.0010) [2023-12-28 04:31:36,079][106225] Updated weights for policy 1, policy_version 1292785 (0.0008) [2023-12-28 04:31:36,147][106225] Updated weights for policy 1, policy_version 1292795 (0.0008) [2023-12-28 04:31:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 661176320. Throughput: 0: 9667.9, 1: 9833.9. Samples: 661187308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:36,175][105115] Avg episode reward: [(0, '-4.224'), (1, '-5.109')] [2023-12-28 04:31:36,198][106225] Updated weights for policy 1, policy_version 1292805 (0.0008) [2023-12-28 04:31:36,686][106226] Updated weights for policy 0, policy_version 1289535 (0.0008) [2023-12-28 04:31:36,756][106226] Updated weights for policy 0, policy_version 1289545 (0.0006) [2023-12-28 04:31:36,811][106226] Updated weights for policy 0, policy_version 1289555 (0.0006) [2023-12-28 04:31:36,990][106225] Updated weights for policy 1, policy_version 1292815 (0.0008) [2023-12-28 04:31:37,037][106225] Updated weights for policy 1, policy_version 1292825 (0.0008) [2023-12-28 04:31:37,090][106225] Updated weights for policy 1, policy_version 1292835 (0.0007) [2023-12-28 04:31:37,462][106226] Updated weights for policy 0, policy_version 1289565 (0.0010) [2023-12-28 04:31:37,508][106226] Updated weights for policy 0, policy_version 1289575 (0.0010) [2023-12-28 04:31:37,560][106226] Updated weights for policy 0, policy_version 1289585 (0.0011) [2023-12-28 04:31:37,805][106225] Updated weights for policy 1, policy_version 1292845 (0.0007) [2023-12-28 04:31:37,871][106225] Updated weights for policy 1, policy_version 1292855 (0.0008) [2023-12-28 04:31:37,935][106225] Updated weights for policy 1, policy_version 1292865 (0.0008) [2023-12-28 04:31:38,230][106226] Updated weights for policy 0, policy_version 1289595 (0.0011) [2023-12-28 04:31:38,297][106226] Updated weights for policy 0, policy_version 1289605 (0.0011) [2023-12-28 04:31:38,361][106226] Updated weights for policy 0, policy_version 1289615 (0.0011) [2023-12-28 04:31:38,716][106225] Updated weights for policy 1, policy_version 1292875 (0.0008) [2023-12-28 04:31:38,774][106225] Updated weights for policy 1, policy_version 1292885 (0.0008) [2023-12-28 04:31:38,840][106225] Updated weights for policy 1, policy_version 1292895 (0.0008) [2023-12-28 04:31:39,095][106226] Updated weights for policy 0, policy_version 1289625 (0.0010) [2023-12-28 04:31:39,148][106226] Updated weights for policy 0, policy_version 1289635 (0.0010) [2023-12-28 04:31:39,198][106226] Updated weights for policy 0, policy_version 1289645 (0.0010) [2023-12-28 04:31:39,269][106226] Updated weights for policy 0, policy_version 1289655 (0.0009) [2023-12-28 04:31:39,609][106225] Updated weights for policy 1, policy_version 1292905 (0.0008) [2023-12-28 04:31:39,669][106225] Updated weights for policy 1, policy_version 1292915 (0.0009) [2023-12-28 04:31:39,729][106225] Updated weights for policy 1, policy_version 1292925 (0.0010) [2023-12-28 04:31:39,793][106225] Updated weights for policy 1, policy_version 1292935 (0.0008) [2023-12-28 04:31:40,082][106226] Updated weights for policy 0, policy_version 1289665 (0.0008) [2023-12-28 04:31:40,137][106226] Updated weights for policy 0, policy_version 1289675 (0.0008) [2023-12-28 04:31:40,190][106226] Updated weights for policy 0, policy_version 1289685 (0.0008) [2023-12-28 04:31:40,534][106225] Updated weights for policy 1, policy_version 1292945 (0.0006) [2023-12-28 04:31:40,590][106225] Updated weights for policy 1, policy_version 1292955 (0.0005) [2023-12-28 04:31:40,650][106225] Updated weights for policy 1, policy_version 1292965 (0.0005) [2023-12-28 04:31:40,916][106226] Updated weights for policy 0, policy_version 1289695 (0.0008) [2023-12-28 04:31:40,974][106226] Updated weights for policy 0, policy_version 1289705 (0.0008) [2023-12-28 04:31:41,034][106226] Updated weights for policy 0, policy_version 1289715 (0.0008) [2023-12-28 04:31:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 661274624. Throughput: 0: 9689.0, 1: 9823.2. Samples: 661245860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:41,175][105115] Avg episode reward: [(0, '-4.146'), (1, '-5.320')] [2023-12-28 04:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001292968_331046912.pth... [2023-12-28 04:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001289720_330227712.pth... [2023-12-28 04:31:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001291816_330752000.pth [2023-12-28 04:31:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001288568_329932800.pth [2023-12-28 04:31:41,367][106225] Updated weights for policy 1, policy_version 1292975 (0.0009) [2023-12-28 04:31:41,436][106225] Updated weights for policy 1, policy_version 1292985 (0.0008) [2023-12-28 04:31:41,487][106225] Updated weights for policy 1, policy_version 1292995 (0.0007) [2023-12-28 04:31:41,826][106226] Updated weights for policy 0, policy_version 1289725 (0.0010) [2023-12-28 04:31:41,898][106226] Updated weights for policy 0, policy_version 1289735 (0.0008) [2023-12-28 04:31:41,960][106226] Updated weights for policy 0, policy_version 1289745 (0.0010) [2023-12-28 04:31:42,171][106225] Updated weights for policy 1, policy_version 1293005 (0.0007) [2023-12-28 04:31:42,222][106225] Updated weights for policy 1, policy_version 1293015 (0.0008) [2023-12-28 04:31:42,280][106225] Updated weights for policy 1, policy_version 1293025 (0.0008) [2023-12-28 04:31:42,677][106226] Updated weights for policy 0, policy_version 1289755 (0.0009) [2023-12-28 04:31:42,736][106226] Updated weights for policy 0, policy_version 1289765 (0.0005) [2023-12-28 04:31:42,794][106226] Updated weights for policy 0, policy_version 1289775 (0.0006) [2023-12-28 04:31:43,069][106225] Updated weights for policy 1, policy_version 1293035 (0.0008) [2023-12-28 04:31:43,122][106225] Updated weights for policy 1, policy_version 1293045 (0.0008) [2023-12-28 04:31:43,178][106225] Updated weights for policy 1, policy_version 1293055 (0.0009) [2023-12-28 04:31:43,341][106226] Updated weights for policy 0, policy_version 1289785 (0.0009) [2023-12-28 04:31:43,403][106226] Updated weights for policy 0, policy_version 1289795 (0.0008) [2023-12-28 04:31:43,465][106226] Updated weights for policy 0, policy_version 1289805 (0.0009) [2023-12-28 04:31:43,521][106226] Updated weights for policy 0, policy_version 1289815 (0.0008) [2023-12-28 04:31:43,927][106225] Updated weights for policy 1, policy_version 1293065 (0.0008) [2023-12-28 04:31:43,979][106225] Updated weights for policy 1, policy_version 1293075 (0.0008) [2023-12-28 04:31:44,029][106225] Updated weights for policy 1, policy_version 1293085 (0.0010) [2023-12-28 04:31:44,086][106225] Updated weights for policy 1, policy_version 1293095 (0.0009) [2023-12-28 04:31:44,197][106226] Updated weights for policy 0, policy_version 1289825 (0.0008) [2023-12-28 04:31:44,256][106226] Updated weights for policy 0, policy_version 1289835 (0.0006) [2023-12-28 04:31:44,309][106226] Updated weights for policy 0, policy_version 1289845 (0.0007) [2023-12-28 04:31:44,801][106225] Updated weights for policy 1, policy_version 1293105 (0.0008) [2023-12-28 04:31:44,868][106225] Updated weights for policy 1, policy_version 1293115 (0.0007) [2023-12-28 04:31:44,935][106225] Updated weights for policy 1, policy_version 1293125 (0.0008) [2023-12-28 04:31:45,053][106226] Updated weights for policy 0, policy_version 1289855 (0.0010) [2023-12-28 04:31:45,119][106226] Updated weights for policy 0, policy_version 1289865 (0.0011) [2023-12-28 04:31:45,180][106226] Updated weights for policy 0, policy_version 1289875 (0.0010) [2023-12-28 04:31:45,594][106225] Updated weights for policy 1, policy_version 1293135 (0.0007) [2023-12-28 04:31:45,654][106225] Updated weights for policy 1, policy_version 1293145 (0.0005) [2023-12-28 04:31:45,715][106225] Updated weights for policy 1, policy_version 1293155 (0.0005) [2023-12-28 04:31:45,886][106226] Updated weights for policy 0, policy_version 1289885 (0.0011) [2023-12-28 04:31:45,930][106226] Updated weights for policy 0, policy_version 1289895 (0.0010) [2023-12-28 04:31:45,976][106226] Updated weights for policy 0, policy_version 1289905 (0.0010) [2023-12-28 04:31:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 661372928. Throughput: 0: 9755.5, 1: 9743.2. Samples: 661360676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:46,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-5.175')] [2023-12-28 04:31:46,365][106225] Updated weights for policy 1, policy_version 1293165 (0.0008) [2023-12-28 04:31:46,420][106225] Updated weights for policy 1, policy_version 1293175 (0.0010) [2023-12-28 04:31:46,467][106225] Updated weights for policy 1, policy_version 1293185 (0.0010) [2023-12-28 04:31:46,636][106226] Updated weights for policy 0, policy_version 1289915 (0.0009) [2023-12-28 04:31:46,699][106226] Updated weights for policy 0, policy_version 1289925 (0.0006) [2023-12-28 04:31:46,756][106226] Updated weights for policy 0, policy_version 1289935 (0.0005) [2023-12-28 04:31:47,190][106225] Updated weights for policy 1, policy_version 1293195 (0.0010) [2023-12-28 04:31:47,251][106225] Updated weights for policy 1, policy_version 1293205 (0.0008) [2023-12-28 04:31:47,302][106225] Updated weights for policy 1, policy_version 1293215 (0.0008) [2023-12-28 04:31:47,368][106226] Updated weights for policy 0, policy_version 1289945 (0.0009) [2023-12-28 04:31:47,427][106226] Updated weights for policy 0, policy_version 1289955 (0.0010) [2023-12-28 04:31:47,499][106226] Updated weights for policy 0, policy_version 1289965 (0.0010) [2023-12-28 04:31:47,559][106226] Updated weights for policy 0, policy_version 1289975 (0.0006) [2023-12-28 04:31:48,012][106225] Updated weights for policy 1, policy_version 1293225 (0.0007) [2023-12-28 04:31:48,066][106225] Updated weights for policy 1, policy_version 1293235 (0.0009) [2023-12-28 04:31:48,117][106225] Updated weights for policy 1, policy_version 1293245 (0.0010) [2023-12-28 04:31:48,157][106226] Updated weights for policy 0, policy_version 1289985 (0.0010) [2023-12-28 04:31:48,177][106225] Updated weights for policy 1, policy_version 1293255 (0.0010) [2023-12-28 04:31:48,214][106226] Updated weights for policy 0, policy_version 1289995 (0.0011) [2023-12-28 04:31:48,277][106226] Updated weights for policy 0, policy_version 1290005 (0.0011) [2023-12-28 04:31:48,911][106226] Updated weights for policy 0, policy_version 1290015 (0.0011) [2023-12-28 04:31:48,913][106225] Updated weights for policy 1, policy_version 1293265 (0.0007) [2023-12-28 04:31:48,964][106226] Updated weights for policy 0, policy_version 1290025 (0.0011) [2023-12-28 04:31:48,970][106225] Updated weights for policy 1, policy_version 1293275 (0.0005) [2023-12-28 04:31:49,011][106226] Updated weights for policy 0, policy_version 1290035 (0.0010) [2023-12-28 04:31:49,017][106225] Updated weights for policy 1, policy_version 1293285 (0.0005) [2023-12-28 04:31:49,749][106226] Updated weights for policy 0, policy_version 1290045 (0.0008) [2023-12-28 04:31:49,811][106226] Updated weights for policy 0, policy_version 1290055 (0.0006) [2023-12-28 04:31:49,814][106225] Updated weights for policy 1, policy_version 1293295 (0.0007) [2023-12-28 04:31:49,881][106225] Updated weights for policy 1, policy_version 1293305 (0.0009) [2023-12-28 04:31:49,887][106226] Updated weights for policy 0, policy_version 1290065 (0.0008) [2023-12-28 04:31:49,947][106225] Updated weights for policy 1, policy_version 1293315 (0.0008) [2023-12-28 04:31:50,546][106226] Updated weights for policy 0, policy_version 1290075 (0.0008) [2023-12-28 04:31:50,609][106226] Updated weights for policy 0, policy_version 1290085 (0.0009) [2023-12-28 04:31:50,665][106226] Updated weights for policy 0, policy_version 1290095 (0.0008) [2023-12-28 04:31:50,680][106225] Updated weights for policy 1, policy_version 1293325 (0.0007) [2023-12-28 04:31:50,724][106225] Updated weights for policy 1, policy_version 1293335 (0.0008) [2023-12-28 04:31:50,785][106225] Updated weights for policy 1, policy_version 1293345 (0.0009) [2023-12-28 04:31:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19716.4). Total num frames: 661471232. Throughput: 0: 9772.5, 1: 9684.6. Samples: 661480276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:51,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-5.275')] [2023-12-28 04:31:51,455][106226] Updated weights for policy 0, policy_version 1290105 (0.0007) [2023-12-28 04:31:51,516][106226] Updated weights for policy 0, policy_version 1290115 (0.0008) [2023-12-28 04:31:51,543][106225] Updated weights for policy 1, policy_version 1293355 (0.0008) [2023-12-28 04:31:51,570][106226] Updated weights for policy 0, policy_version 1290125 (0.0006) [2023-12-28 04:31:51,601][106225] Updated weights for policy 1, policy_version 1293365 (0.0007) [2023-12-28 04:31:51,631][106226] Updated weights for policy 0, policy_version 1290135 (0.0008) [2023-12-28 04:31:51,667][106225] Updated weights for policy 1, policy_version 1293375 (0.0007) [2023-12-28 04:31:52,331][106225] Updated weights for policy 1, policy_version 1293385 (0.0009) [2023-12-28 04:31:52,387][106226] Updated weights for policy 0, policy_version 1290145 (0.0007) [2023-12-28 04:31:52,412][106225] Updated weights for policy 1, policy_version 1293395 (0.0008) [2023-12-28 04:31:52,455][106226] Updated weights for policy 0, policy_version 1290155 (0.0007) [2023-12-28 04:31:52,473][106225] Updated weights for policy 1, policy_version 1293405 (0.0008) [2023-12-28 04:31:52,522][106226] Updated weights for policy 0, policy_version 1290165 (0.0007) [2023-12-28 04:31:52,540][106225] Updated weights for policy 1, policy_version 1293415 (0.0007) [2023-12-28 04:31:53,104][106226] Updated weights for policy 0, policy_version 1290175 (0.0009) [2023-12-28 04:31:53,157][106226] Updated weights for policy 0, policy_version 1290185 (0.0009) [2023-12-28 04:31:53,215][106226] Updated weights for policy 0, policy_version 1290195 (0.0005) [2023-12-28 04:31:53,326][106225] Updated weights for policy 1, policy_version 1293425 (0.0010) [2023-12-28 04:31:53,384][106225] Updated weights for policy 1, policy_version 1293435 (0.0010) [2023-12-28 04:31:53,437][106225] Updated weights for policy 1, policy_version 1293445 (0.0010) [2023-12-28 04:31:53,884][106226] Updated weights for policy 0, policy_version 1290205 (0.0006) [2023-12-28 04:31:53,944][106226] Updated weights for policy 0, policy_version 1290215 (0.0010) [2023-12-28 04:31:54,000][106226] Updated weights for policy 0, policy_version 1290225 (0.0010) [2023-12-28 04:31:54,050][106225] Updated weights for policy 1, policy_version 1293455 (0.0007) [2023-12-28 04:31:54,112][106225] Updated weights for policy 1, policy_version 1293465 (0.0006) [2023-12-28 04:31:54,167][106225] Updated weights for policy 1, policy_version 1293475 (0.0008) [2023-12-28 04:31:54,702][106226] Updated weights for policy 0, policy_version 1290235 (0.0011) [2023-12-28 04:31:54,731][106225] Updated weights for policy 1, policy_version 1293485 (0.0006) [2023-12-28 04:31:54,762][106226] Updated weights for policy 0, policy_version 1290245 (0.0011) [2023-12-28 04:31:54,783][106225] Updated weights for policy 1, policy_version 1293495 (0.0008) [2023-12-28 04:31:54,818][106226] Updated weights for policy 0, policy_version 1290255 (0.0011) [2023-12-28 04:31:54,839][106225] Updated weights for policy 1, policy_version 1293505 (0.0010) [2023-12-28 04:31:55,531][106226] Updated weights for policy 0, policy_version 1290265 (0.0010) [2023-12-28 04:31:55,547][106225] Updated weights for policy 1, policy_version 1293515 (0.0009) [2023-12-28 04:31:55,582][106226] Updated weights for policy 0, policy_version 1290275 (0.0010) [2023-12-28 04:31:55,600][106225] Updated weights for policy 1, policy_version 1293525 (0.0006) [2023-12-28 04:31:55,641][106226] Updated weights for policy 0, policy_version 1290285 (0.0006) [2023-12-28 04:31:55,661][106225] Updated weights for policy 1, policy_version 1293535 (0.0006) [2023-12-28 04:31:55,728][106226] Updated weights for policy 0, policy_version 1290295 (0.0009) [2023-12-28 04:31:56,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 661569536. Throughput: 0: 9789.8, 1: 9695.4. Samples: 661538732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:31:56,176][105115] Avg episode reward: [(0, '-4.423'), (1, '-5.043')] [2023-12-28 04:31:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001293544_331194368.pth... [2023-12-28 04:31:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001290296_330375168.pth... [2023-12-28 04:31:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001289112_330072064.pth [2023-12-28 04:31:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001292392_330899456.pth [2023-12-28 04:31:56,298][106225] Updated weights for policy 1, policy_version 1293545 (0.0006) [2023-12-28 04:31:56,343][106225] Updated weights for policy 1, policy_version 1293555 (0.0007) [2023-12-28 04:31:56,384][106226] Updated weights for policy 0, policy_version 1290305 (0.0010) [2023-12-28 04:31:56,389][106225] Updated weights for policy 1, policy_version 1293565 (0.0008) [2023-12-28 04:31:56,434][106225] Updated weights for policy 1, policy_version 1293575 (0.0005) [2023-12-28 04:31:56,445][106226] Updated weights for policy 0, policy_version 1290315 (0.0011) [2023-12-28 04:31:56,503][106226] Updated weights for policy 0, policy_version 1290325 (0.0010) [2023-12-28 04:31:57,128][106225] Updated weights for policy 1, policy_version 1293585 (0.0006) [2023-12-28 04:31:57,181][106225] Updated weights for policy 1, policy_version 1293595 (0.0005) [2023-12-28 04:31:57,223][106226] Updated weights for policy 0, policy_version 1290335 (0.0010) [2023-12-28 04:31:57,247][106225] Updated weights for policy 1, policy_version 1293605 (0.0005) [2023-12-28 04:31:57,290][106226] Updated weights for policy 0, policy_version 1290345 (0.0010) [2023-12-28 04:31:57,358][106226] Updated weights for policy 0, policy_version 1290355 (0.0011) [2023-12-28 04:31:57,798][106225] Updated weights for policy 1, policy_version 1293615 (0.0007) [2023-12-28 04:31:57,865][106225] Updated weights for policy 1, policy_version 1293625 (0.0009) [2023-12-28 04:31:57,918][106225] Updated weights for policy 1, policy_version 1293635 (0.0009) [2023-12-28 04:31:57,960][106226] Updated weights for policy 0, policy_version 1290365 (0.0008) [2023-12-28 04:31:58,017][106226] Updated weights for policy 0, policy_version 1290375 (0.0007) [2023-12-28 04:31:58,074][106226] Updated weights for policy 0, policy_version 1290385 (0.0010) [2023-12-28 04:31:58,711][106225] Updated weights for policy 1, policy_version 1293645 (0.0009) [2023-12-28 04:31:58,782][106225] Updated weights for policy 1, policy_version 1293655 (0.0008) [2023-12-28 04:31:58,846][106226] Updated weights for policy 0, policy_version 1290395 (0.0010) [2023-12-28 04:31:58,856][106225] Updated weights for policy 1, policy_version 1293665 (0.0010) [2023-12-28 04:31:58,919][106226] Updated weights for policy 0, policy_version 1290405 (0.0007) [2023-12-28 04:31:58,981][106226] Updated weights for policy 0, policy_version 1290415 (0.0007) [2023-12-28 04:31:59,634][106225] Updated weights for policy 1, policy_version 1293675 (0.0008) [2023-12-28 04:31:59,679][106225] Updated weights for policy 1, policy_version 1293685 (0.0008) [2023-12-28 04:31:59,729][106225] Updated weights for policy 1, policy_version 1293695 (0.0008) [2023-12-28 04:31:59,739][106226] Updated weights for policy 0, policy_version 1290425 (0.0008) [2023-12-28 04:31:59,806][106226] Updated weights for policy 0, policy_version 1290435 (0.0007) [2023-12-28 04:31:59,872][106226] Updated weights for policy 0, policy_version 1290445 (0.0009) [2023-12-28 04:31:59,936][106226] Updated weights for policy 0, policy_version 1290455 (0.0011) [2023-12-28 04:32:00,400][106225] Updated weights for policy 1, policy_version 1293705 (0.0006) [2023-12-28 04:32:00,469][106225] Updated weights for policy 1, policy_version 1293715 (0.0005) [2023-12-28 04:32:00,535][106225] Updated weights for policy 1, policy_version 1293725 (0.0005) [2023-12-28 04:32:00,575][106226] Updated weights for policy 0, policy_version 1290465 (0.0010) [2023-12-28 04:32:00,602][106225] Updated weights for policy 1, policy_version 1293735 (0.0006) [2023-12-28 04:32:00,629][106226] Updated weights for policy 0, policy_version 1290475 (0.0010) [2023-12-28 04:32:00,676][106226] Updated weights for policy 0, policy_version 1290485 (0.0010) [2023-12-28 04:32:01,168][106225] Updated weights for policy 1, policy_version 1293745 (0.0008) [2023-12-28 04:32:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 661667840. Throughput: 0: 9863.1, 1: 9852.1. Samples: 661658844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:01,175][105115] Avg episode reward: [(0, '-4.308'), (1, '-5.033')] [2023-12-28 04:32:01,233][106225] Updated weights for policy 1, policy_version 1293755 (0.0006) [2023-12-28 04:32:01,296][106225] Updated weights for policy 1, policy_version 1293765 (0.0006) [2023-12-28 04:32:01,433][106226] Updated weights for policy 0, policy_version 1290495 (0.0010) [2023-12-28 04:32:01,491][106226] Updated weights for policy 0, policy_version 1290505 (0.0008) [2023-12-28 04:32:01,550][106226] Updated weights for policy 0, policy_version 1290515 (0.0007) [2023-12-28 04:32:02,017][106225] Updated weights for policy 1, policy_version 1293775 (0.0009) [2023-12-28 04:32:02,075][106225] Updated weights for policy 1, policy_version 1293785 (0.0008) [2023-12-28 04:32:02,138][106225] Updated weights for policy 1, policy_version 1293795 (0.0009) [2023-12-28 04:32:02,211][106226] Updated weights for policy 0, policy_version 1290525 (0.0006) [2023-12-28 04:32:02,281][106226] Updated weights for policy 0, policy_version 1290535 (0.0009) [2023-12-28 04:32:02,344][106226] Updated weights for policy 0, policy_version 1290545 (0.0011) [2023-12-28 04:32:02,942][106225] Updated weights for policy 1, policy_version 1293805 (0.0008) [2023-12-28 04:32:03,000][106225] Updated weights for policy 1, policy_version 1293815 (0.0007) [2023-12-28 04:32:03,002][106226] Updated weights for policy 0, policy_version 1290555 (0.0010) [2023-12-28 04:32:03,051][106225] Updated weights for policy 1, policy_version 1293825 (0.0005) [2023-12-28 04:32:03,061][106226] Updated weights for policy 0, policy_version 1290565 (0.0010) [2023-12-28 04:32:03,118][106226] Updated weights for policy 0, policy_version 1290575 (0.0007) [2023-12-28 04:32:03,654][106226] Updated weights for policy 0, policy_version 1290585 (0.0008) [2023-12-28 04:32:03,703][106226] Updated weights for policy 0, policy_version 1290595 (0.0010) [2023-12-28 04:32:03,749][106226] Updated weights for policy 0, policy_version 1290605 (0.0010) [2023-12-28 04:32:03,768][106225] Updated weights for policy 1, policy_version 1293835 (0.0006) [2023-12-28 04:32:03,801][106226] Updated weights for policy 0, policy_version 1290615 (0.0006) [2023-12-28 04:32:03,818][106225] Updated weights for policy 1, policy_version 1293845 (0.0008) [2023-12-28 04:32:03,879][106225] Updated weights for policy 1, policy_version 1293855 (0.0009) [2023-12-28 04:32:04,492][106226] Updated weights for policy 0, policy_version 1290625 (0.0009) [2023-12-28 04:32:04,554][106226] Updated weights for policy 0, policy_version 1290635 (0.0007) [2023-12-28 04:32:04,617][106226] Updated weights for policy 0, policy_version 1290645 (0.0005) [2023-12-28 04:32:04,683][106225] Updated weights for policy 1, policy_version 1293865 (0.0008) [2023-12-28 04:32:04,731][106225] Updated weights for policy 1, policy_version 1293875 (0.0009) [2023-12-28 04:32:04,790][106225] Updated weights for policy 1, policy_version 1293885 (0.0009) [2023-12-28 04:32:04,850][106225] Updated weights for policy 1, policy_version 1293895 (0.0008) [2023-12-28 04:32:05,248][106226] Updated weights for policy 0, policy_version 1290655 (0.0009) [2023-12-28 04:32:05,307][106226] Updated weights for policy 0, policy_version 1290665 (0.0010) [2023-12-28 04:32:05,367][106226] Updated weights for policy 0, policy_version 1290675 (0.0010) [2023-12-28 04:32:05,583][106225] Updated weights for policy 1, policy_version 1293905 (0.0010) [2023-12-28 04:32:05,641][106225] Updated weights for policy 1, policy_version 1293915 (0.0011) [2023-12-28 04:32:05,699][106225] Updated weights for policy 1, policy_version 1293925 (0.0010) [2023-12-28 04:32:06,094][106226] Updated weights for policy 0, policy_version 1290685 (0.0011) [2023-12-28 04:32:06,168][106226] Updated weights for policy 0, policy_version 1290695 (0.0011) [2023-12-28 04:32:06,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 661766144. Throughput: 0: 9998.6, 1: 9860.8. Samples: 661779256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:06,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.808')] [2023-12-28 04:32:06,238][106226] Updated weights for policy 0, policy_version 1290705 (0.0011) [2023-12-28 04:32:06,450][106225] Updated weights for policy 1, policy_version 1293935 (0.0008) [2023-12-28 04:32:06,509][106225] Updated weights for policy 1, policy_version 1293945 (0.0008) [2023-12-28 04:32:06,575][106225] Updated weights for policy 1, policy_version 1293955 (0.0008) [2023-12-28 04:32:06,952][106226] Updated weights for policy 0, policy_version 1290715 (0.0011) [2023-12-28 04:32:07,009][106226] Updated weights for policy 0, policy_version 1290725 (0.0010) [2023-12-28 04:32:07,072][106226] Updated weights for policy 0, policy_version 1290735 (0.0011) [2023-12-28 04:32:07,221][106225] Updated weights for policy 1, policy_version 1293965 (0.0007) [2023-12-28 04:32:07,284][106225] Updated weights for policy 1, policy_version 1293975 (0.0007) [2023-12-28 04:32:07,339][106225] Updated weights for policy 1, policy_version 1293985 (0.0008) [2023-12-28 04:32:07,778][106226] Updated weights for policy 0, policy_version 1290745 (0.0011) [2023-12-28 04:32:07,828][106226] Updated weights for policy 0, policy_version 1290755 (0.0006) [2023-12-28 04:32:07,889][106226] Updated weights for policy 0, policy_version 1290765 (0.0005) [2023-12-28 04:32:07,940][106226] Updated weights for policy 0, policy_version 1290775 (0.0005) [2023-12-28 04:32:07,974][106225] Updated weights for policy 1, policy_version 1293995 (0.0008) [2023-12-28 04:32:08,028][106225] Updated weights for policy 1, policy_version 1294005 (0.0007) [2023-12-28 04:32:08,075][106225] Updated weights for policy 1, policy_version 1294015 (0.0009) [2023-12-28 04:32:08,521][106226] Updated weights for policy 0, policy_version 1290785 (0.0010) [2023-12-28 04:32:08,576][106226] Updated weights for policy 0, policy_version 1290795 (0.0010) [2023-12-28 04:32:08,628][106226] Updated weights for policy 0, policy_version 1290805 (0.0010) [2023-12-28 04:32:08,862][106225] Updated weights for policy 1, policy_version 1294025 (0.0010) [2023-12-28 04:32:08,925][106225] Updated weights for policy 1, policy_version 1294035 (0.0010) [2023-12-28 04:32:08,985][106225] Updated weights for policy 1, policy_version 1294045 (0.0010) [2023-12-28 04:32:09,041][106225] Updated weights for policy 1, policy_version 1294055 (0.0010) [2023-12-28 04:32:09,402][106226] Updated weights for policy 0, policy_version 1290815 (0.0010) [2023-12-28 04:32:09,468][106226] Updated weights for policy 0, policy_version 1290825 (0.0008) [2023-12-28 04:32:09,532][106226] Updated weights for policy 0, policy_version 1290835 (0.0008) [2023-12-28 04:32:09,759][106225] Updated weights for policy 1, policy_version 1294065 (0.0009) [2023-12-28 04:32:09,819][106225] Updated weights for policy 1, policy_version 1294075 (0.0008) [2023-12-28 04:32:09,887][106225] Updated weights for policy 1, policy_version 1294085 (0.0007) [2023-12-28 04:32:10,311][106226] Updated weights for policy 0, policy_version 1290845 (0.0010) [2023-12-28 04:32:10,369][106226] Updated weights for policy 0, policy_version 1290855 (0.0008) [2023-12-28 04:32:10,428][106226] Updated weights for policy 0, policy_version 1290865 (0.0009) [2023-12-28 04:32:10,577][106225] Updated weights for policy 1, policy_version 1294095 (0.0008) [2023-12-28 04:32:10,636][106225] Updated weights for policy 1, policy_version 1294105 (0.0009) [2023-12-28 04:32:10,695][106225] Updated weights for policy 1, policy_version 1294115 (0.0008) [2023-12-28 04:32:11,130][106226] Updated weights for policy 0, policy_version 1290875 (0.0009) [2023-12-28 04:32:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 661864448. Throughput: 0: 10067.0, 1: 9910.9. Samples: 661839360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:11,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-5.001')] [2023-12-28 04:32:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001294120_331341824.pth... [2023-12-28 04:32:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001292968_331046912.pth [2023-12-28 04:32:11,201][106226] Updated weights for policy 0, policy_version 1290885 (0.0009) [2023-12-28 04:32:11,261][106226] Updated weights for policy 0, policy_version 1290895 (0.0009) [2023-12-28 04:32:11,313][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001290904_330530816.pth... [2023-12-28 04:32:11,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001289720_330227712.pth [2023-12-28 04:32:11,518][106225] Updated weights for policy 1, policy_version 1294125 (0.0009) [2023-12-28 04:32:11,587][106225] Updated weights for policy 1, policy_version 1294135 (0.0006) [2023-12-28 04:32:11,661][106225] Updated weights for policy 1, policy_version 1294145 (0.0007) [2023-12-28 04:32:12,022][106226] Updated weights for policy 0, policy_version 1290905 (0.0009) [2023-12-28 04:32:12,080][106226] Updated weights for policy 0, policy_version 1290915 (0.0007) [2023-12-28 04:32:12,137][106226] Updated weights for policy 0, policy_version 1290925 (0.0008) [2023-12-28 04:32:12,197][106226] Updated weights for policy 0, policy_version 1290935 (0.0008) [2023-12-28 04:32:12,442][106225] Updated weights for policy 1, policy_version 1294155 (0.0009) [2023-12-28 04:32:12,503][106225] Updated weights for policy 1, policy_version 1294165 (0.0011) [2023-12-28 04:32:12,565][106225] Updated weights for policy 1, policy_version 1294175 (0.0011) [2023-12-28 04:32:12,969][106226] Updated weights for policy 0, policy_version 1290945 (0.0008) [2023-12-28 04:32:13,022][106226] Updated weights for policy 0, policy_version 1290955 (0.0007) [2023-12-28 04:32:13,072][106226] Updated weights for policy 0, policy_version 1290965 (0.0008) [2023-12-28 04:32:13,256][106225] Updated weights for policy 1, policy_version 1294185 (0.0010) [2023-12-28 04:32:13,314][106225] Updated weights for policy 1, policy_version 1294195 (0.0005) [2023-12-28 04:32:13,374][106225] Updated weights for policy 1, policy_version 1294205 (0.0006) [2023-12-28 04:32:13,422][106225] Updated weights for policy 1, policy_version 1294215 (0.0005) [2023-12-28 04:32:13,812][106226] Updated weights for policy 0, policy_version 1290975 (0.0006) [2023-12-28 04:32:13,861][106226] Updated weights for policy 0, policy_version 1290985 (0.0005) [2023-12-28 04:32:13,909][106226] Updated weights for policy 0, policy_version 1290995 (0.0005) [2023-12-28 04:32:13,990][106225] Updated weights for policy 1, policy_version 1294225 (0.0005) [2023-12-28 04:32:14,044][106225] Updated weights for policy 1, policy_version 1294235 (0.0005) [2023-12-28 04:32:14,097][106225] Updated weights for policy 1, policy_version 1294245 (0.0008) [2023-12-28 04:32:14,555][106226] Updated weights for policy 0, policy_version 1291005 (0.0008) [2023-12-28 04:32:14,606][106226] Updated weights for policy 0, policy_version 1291015 (0.0008) [2023-12-28 04:32:14,656][106226] Updated weights for policy 0, policy_version 1291025 (0.0008) [2023-12-28 04:32:14,777][106225] Updated weights for policy 1, policy_version 1294255 (0.0010) [2023-12-28 04:32:14,841][106225] Updated weights for policy 1, policy_version 1294265 (0.0011) [2023-12-28 04:32:14,901][106225] Updated weights for policy 1, policy_version 1294275 (0.0011) [2023-12-28 04:32:15,481][106226] Updated weights for policy 0, policy_version 1291035 (0.0007) [2023-12-28 04:32:15,532][106226] Updated weights for policy 0, policy_version 1291045 (0.0008) [2023-12-28 04:32:15,597][106226] Updated weights for policy 0, policy_version 1291055 (0.0008) [2023-12-28 04:32:15,640][106225] Updated weights for policy 1, policy_version 1294285 (0.0011) [2023-12-28 04:32:15,702][106225] Updated weights for policy 1, policy_version 1294295 (0.0009) [2023-12-28 04:32:15,764][106225] Updated weights for policy 1, policy_version 1294305 (0.0005) [2023-12-28 04:32:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 661962752. Throughput: 0: 10004.0, 1: 9793.8. Samples: 661954288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:16,176][105115] Avg episode reward: [(0, '-4.167'), (1, '-4.949')] [2023-12-28 04:32:16,253][106226] Updated weights for policy 0, policy_version 1291065 (0.0009) [2023-12-28 04:32:16,317][106226] Updated weights for policy 0, policy_version 1291075 (0.0008) [2023-12-28 04:32:16,378][106226] Updated weights for policy 0, policy_version 1291085 (0.0008) [2023-12-28 04:32:16,419][106225] Updated weights for policy 1, policy_version 1294315 (0.0007) [2023-12-28 04:32:16,444][106226] Updated weights for policy 0, policy_version 1291095 (0.0006) [2023-12-28 04:32:16,476][106225] Updated weights for policy 1, policy_version 1294325 (0.0006) [2023-12-28 04:32:16,523][106225] Updated weights for policy 1, policy_version 1294335 (0.0005) [2023-12-28 04:32:16,985][106226] Updated weights for policy 0, policy_version 1291105 (0.0006) [2023-12-28 04:32:17,041][106226] Updated weights for policy 0, policy_version 1291115 (0.0005) [2023-12-28 04:32:17,087][106225] Updated weights for policy 1, policy_version 1294345 (0.0006) [2023-12-28 04:32:17,091][106226] Updated weights for policy 0, policy_version 1291125 (0.0006) [2023-12-28 04:32:17,144][106225] Updated weights for policy 1, policy_version 1294355 (0.0009) [2023-12-28 04:32:17,197][106225] Updated weights for policy 1, policy_version 1294365 (0.0010) [2023-12-28 04:32:17,253][106225] Updated weights for policy 1, policy_version 1294375 (0.0010) [2023-12-28 04:32:17,659][106226] Updated weights for policy 0, policy_version 1291135 (0.0005) [2023-12-28 04:32:17,729][106226] Updated weights for policy 0, policy_version 1291145 (0.0008) [2023-12-28 04:32:17,795][106226] Updated weights for policy 0, policy_version 1291155 (0.0006) [2023-12-28 04:32:17,939][106225] Updated weights for policy 1, policy_version 1294385 (0.0010) [2023-12-28 04:32:18,000][106225] Updated weights for policy 1, policy_version 1294395 (0.0009) [2023-12-28 04:32:18,060][106225] Updated weights for policy 1, policy_version 1294405 (0.0010) [2023-12-28 04:32:18,459][106226] Updated weights for policy 0, policy_version 1291165 (0.0006) [2023-12-28 04:32:18,524][106226] Updated weights for policy 0, policy_version 1291175 (0.0005) [2023-12-28 04:32:18,589][106226] Updated weights for policy 0, policy_version 1291185 (0.0007) [2023-12-28 04:32:18,785][106225] Updated weights for policy 1, policy_version 1294415 (0.0011) [2023-12-28 04:32:18,843][106225] Updated weights for policy 1, policy_version 1294425 (0.0010) [2023-12-28 04:32:18,904][106225] Updated weights for policy 1, policy_version 1294435 (0.0010) [2023-12-28 04:32:19,262][106226] Updated weights for policy 0, policy_version 1291195 (0.0010) [2023-12-28 04:32:19,314][106226] Updated weights for policy 0, policy_version 1291205 (0.0009) [2023-12-28 04:32:19,375][106226] Updated weights for policy 0, policy_version 1291215 (0.0009) [2023-12-28 04:32:19,678][106225] Updated weights for policy 1, policy_version 1294445 (0.0010) [2023-12-28 04:32:19,743][106225] Updated weights for policy 1, policy_version 1294455 (0.0010) [2023-12-28 04:32:19,810][106225] Updated weights for policy 1, policy_version 1294465 (0.0010) [2023-12-28 04:32:20,099][106226] Updated weights for policy 0, policy_version 1291225 (0.0009) [2023-12-28 04:32:20,151][106226] Updated weights for policy 0, policy_version 1291235 (0.0008) [2023-12-28 04:32:20,212][106226] Updated weights for policy 0, policy_version 1291245 (0.0009) [2023-12-28 04:32:20,273][106226] Updated weights for policy 0, policy_version 1291255 (0.0009) [2023-12-28 04:32:20,513][106225] Updated weights for policy 1, policy_version 1294475 (0.0009) [2023-12-28 04:32:20,595][106225] Updated weights for policy 1, policy_version 1294485 (0.0008) [2023-12-28 04:32:20,657][106225] Updated weights for policy 1, policy_version 1294495 (0.0006) [2023-12-28 04:32:21,118][106226] Updated weights for policy 0, policy_version 1291265 (0.0010) [2023-12-28 04:32:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 662061056. Throughput: 0: 9974.9, 1: 9751.9. Samples: 662075016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:21,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-5.381')] [2023-12-28 04:32:21,190][106226] Updated weights for policy 0, policy_version 1291275 (0.0008) [2023-12-28 04:32:21,253][106226] Updated weights for policy 0, policy_version 1291285 (0.0009) [2023-12-28 04:32:21,340][106225] Updated weights for policy 1, policy_version 1294505 (0.0008) [2023-12-28 04:32:21,410][106225] Updated weights for policy 1, policy_version 1294515 (0.0009) [2023-12-28 04:32:21,466][106225] Updated weights for policy 1, policy_version 1294525 (0.0008) [2023-12-28 04:32:21,531][106225] Updated weights for policy 1, policy_version 1294535 (0.0009) [2023-12-28 04:32:22,061][106226] Updated weights for policy 0, policy_version 1291295 (0.0009) [2023-12-28 04:32:22,128][106226] Updated weights for policy 0, policy_version 1291305 (0.0009) [2023-12-28 04:32:22,191][106226] Updated weights for policy 0, policy_version 1291315 (0.0008) [2023-12-28 04:32:22,219][106225] Updated weights for policy 1, policy_version 1294545 (0.0007) [2023-12-28 04:32:22,284][106225] Updated weights for policy 1, policy_version 1294555 (0.0008) [2023-12-28 04:32:22,349][106225] Updated weights for policy 1, policy_version 1294565 (0.0008) [2023-12-28 04:32:23,006][106225] Updated weights for policy 1, policy_version 1294575 (0.0006) [2023-12-28 04:32:23,013][106226] Updated weights for policy 0, policy_version 1291325 (0.0007) [2023-12-28 04:32:23,064][106226] Updated weights for policy 0, policy_version 1291335 (0.0008) [2023-12-28 04:32:23,065][106225] Updated weights for policy 1, policy_version 1294585 (0.0008) [2023-12-28 04:32:23,118][106226] Updated weights for policy 0, policy_version 1291345 (0.0009) [2023-12-28 04:32:23,122][106225] Updated weights for policy 1, policy_version 1294595 (0.0005) [2023-12-28 04:32:23,705][106225] Updated weights for policy 1, policy_version 1294605 (0.0005) [2023-12-28 04:32:23,766][106225] Updated weights for policy 1, policy_version 1294615 (0.0009) [2023-12-28 04:32:23,829][106225] Updated weights for policy 1, policy_version 1294625 (0.0006) [2023-12-28 04:32:23,895][106226] Updated weights for policy 0, policy_version 1291355 (0.0009) [2023-12-28 04:32:23,964][106226] Updated weights for policy 0, policy_version 1291365 (0.0006) [2023-12-28 04:32:24,018][106226] Updated weights for policy 0, policy_version 1291375 (0.0007) [2023-12-28 04:32:24,533][106225] Updated weights for policy 1, policy_version 1294635 (0.0007) [2023-12-28 04:32:24,578][106226] Updated weights for policy 0, policy_version 1291385 (0.0007) [2023-12-28 04:32:24,584][106225] Updated weights for policy 1, policy_version 1294645 (0.0008) [2023-12-28 04:32:24,637][106226] Updated weights for policy 0, policy_version 1291395 (0.0006) [2023-12-28 04:32:24,643][106225] Updated weights for policy 1, policy_version 1294655 (0.0007) [2023-12-28 04:32:24,685][106226] Updated weights for policy 0, policy_version 1291405 (0.0006) [2023-12-28 04:32:24,729][106226] Updated weights for policy 0, policy_version 1291415 (0.0008) [2023-12-28 04:32:25,364][106225] Updated weights for policy 1, policy_version 1294665 (0.0009) [2023-12-28 04:32:25,414][106225] Updated weights for policy 1, policy_version 1294675 (0.0008) [2023-12-28 04:32:25,463][106226] Updated weights for policy 0, policy_version 1291425 (0.0009) [2023-12-28 04:32:25,465][106225] Updated weights for policy 1, policy_version 1294685 (0.0009) [2023-12-28 04:32:25,512][106226] Updated weights for policy 0, policy_version 1291435 (0.0008) [2023-12-28 04:32:25,514][106225] Updated weights for policy 1, policy_version 1294695 (0.0007) [2023-12-28 04:32:25,562][106226] Updated weights for policy 0, policy_version 1291445 (0.0008) [2023-12-28 04:32:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 662159360. Throughput: 0: 9881.6, 1: 9828.0. Samples: 662132792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:26,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-5.182')] [2023-12-28 04:32:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001291448_330670080.pth... [2023-12-28 04:32:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001294696_331489280.pth... [2023-12-28 04:32:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001290296_330375168.pth [2023-12-28 04:32:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001293544_331194368.pth [2023-12-28 04:32:26,264][106225] Updated weights for policy 1, policy_version 1294705 (0.0008) [2023-12-28 04:32:26,305][106226] Updated weights for policy 0, policy_version 1291455 (0.0006) [2023-12-28 04:32:26,326][106225] Updated weights for policy 1, policy_version 1294715 (0.0008) [2023-12-28 04:32:26,360][106226] Updated weights for policy 0, policy_version 1291465 (0.0005) [2023-12-28 04:32:26,381][106225] Updated weights for policy 1, policy_version 1294725 (0.0008) [2023-12-28 04:32:26,415][106226] Updated weights for policy 0, policy_version 1291475 (0.0006) [2023-12-28 04:32:27,037][106225] Updated weights for policy 1, policy_version 1294735 (0.0006) [2023-12-28 04:32:27,102][106225] Updated weights for policy 1, policy_version 1294745 (0.0005) [2023-12-28 04:32:27,121][106226] Updated weights for policy 0, policy_version 1291485 (0.0008) [2023-12-28 04:32:27,152][106225] Updated weights for policy 1, policy_version 1294755 (0.0006) [2023-12-28 04:32:27,173][106226] Updated weights for policy 0, policy_version 1291495 (0.0006) [2023-12-28 04:32:27,225][106226] Updated weights for policy 0, policy_version 1291505 (0.0007) [2023-12-28 04:32:27,787][106225] Updated weights for policy 1, policy_version 1294765 (0.0010) [2023-12-28 04:32:27,846][106225] Updated weights for policy 1, policy_version 1294775 (0.0010) [2023-12-28 04:32:27,898][106225] Updated weights for policy 1, policy_version 1294785 (0.0010) [2023-12-28 04:32:27,929][106226] Updated weights for policy 0, policy_version 1291515 (0.0008) [2023-12-28 04:32:27,984][106226] Updated weights for policy 0, policy_version 1291525 (0.0008) [2023-12-28 04:32:28,041][106226] Updated weights for policy 0, policy_version 1291535 (0.0007) [2023-12-28 04:32:28,665][106225] Updated weights for policy 1, policy_version 1294795 (0.0010) [2023-12-28 04:32:28,668][106226] Updated weights for policy 0, policy_version 1291545 (0.0008) [2023-12-28 04:32:28,724][106225] Updated weights for policy 1, policy_version 1294805 (0.0007) [2023-12-28 04:32:28,734][106226] Updated weights for policy 0, policy_version 1291555 (0.0006) [2023-12-28 04:32:28,778][106225] Updated weights for policy 1, policy_version 1294815 (0.0009) [2023-12-28 04:32:28,788][106226] Updated weights for policy 0, policy_version 1291565 (0.0008) [2023-12-28 04:32:28,842][106226] Updated weights for policy 0, policy_version 1291575 (0.0006) [2023-12-28 04:32:29,503][106226] Updated weights for policy 0, policy_version 1291585 (0.0008) [2023-12-28 04:32:29,545][106225] Updated weights for policy 1, policy_version 1294825 (0.0008) [2023-12-28 04:32:29,563][106226] Updated weights for policy 0, policy_version 1291595 (0.0008) [2023-12-28 04:32:29,596][106225] Updated weights for policy 1, policy_version 1294835 (0.0007) [2023-12-28 04:32:29,618][106226] Updated weights for policy 0, policy_version 1291605 (0.0006) [2023-12-28 04:32:29,659][106225] Updated weights for policy 1, policy_version 1294845 (0.0007) [2023-12-28 04:32:29,709][106225] Updated weights for policy 1, policy_version 1294855 (0.0008) [2023-12-28 04:32:30,333][106226] Updated weights for policy 0, policy_version 1291615 (0.0006) [2023-12-28 04:32:30,393][106226] Updated weights for policy 0, policy_version 1291625 (0.0006) [2023-12-28 04:32:30,448][106226] Updated weights for policy 0, policy_version 1291635 (0.0005) [2023-12-28 04:32:30,489][106225] Updated weights for policy 1, policy_version 1294865 (0.0010) [2023-12-28 04:32:30,541][106225] Updated weights for policy 1, policy_version 1294875 (0.0010) [2023-12-28 04:32:30,591][106225] Updated weights for policy 1, policy_version 1294885 (0.0010) [2023-12-28 04:32:30,971][106226] Updated weights for policy 0, policy_version 1291645 (0.0005) [2023-12-28 04:32:31,038][106226] Updated weights for policy 0, policy_version 1291655 (0.0006) [2023-12-28 04:32:31,097][106226] Updated weights for policy 0, policy_version 1291665 (0.0008) [2023-12-28 04:32:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 662265856. Throughput: 0: 9938.1, 1: 9870.0. Samples: 662252044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:31,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-5.141')] [2023-12-28 04:32:31,252][106225] Updated weights for policy 1, policy_version 1294895 (0.0009) [2023-12-28 04:32:31,305][106225] Updated weights for policy 1, policy_version 1294905 (0.0007) [2023-12-28 04:32:31,373][106225] Updated weights for policy 1, policy_version 1294915 (0.0007) [2023-12-28 04:32:31,868][106226] Updated weights for policy 0, policy_version 1291675 (0.0009) [2023-12-28 04:32:31,923][106226] Updated weights for policy 0, policy_version 1291685 (0.0008) [2023-12-28 04:32:31,987][106226] Updated weights for policy 0, policy_version 1291695 (0.0005) [2023-12-28 04:32:32,100][106225] Updated weights for policy 1, policy_version 1294925 (0.0008) [2023-12-28 04:32:32,159][106225] Updated weights for policy 1, policy_version 1294935 (0.0009) [2023-12-28 04:32:32,221][106225] Updated weights for policy 1, policy_version 1294945 (0.0008) [2023-12-28 04:32:32,610][106226] Updated weights for policy 0, policy_version 1291705 (0.0009) [2023-12-28 04:32:32,679][106226] Updated weights for policy 0, policy_version 1291715 (0.0008) [2023-12-28 04:32:32,740][106226] Updated weights for policy 0, policy_version 1291725 (0.0008) [2023-12-28 04:32:32,798][106226] Updated weights for policy 0, policy_version 1291735 (0.0008) [2023-12-28 04:32:33,003][106225] Updated weights for policy 1, policy_version 1294955 (0.0009) [2023-12-28 04:32:33,057][106225] Updated weights for policy 1, policy_version 1294965 (0.0010) [2023-12-28 04:32:33,115][106225] Updated weights for policy 1, policy_version 1294975 (0.0010) [2023-12-28 04:32:33,518][106226] Updated weights for policy 0, policy_version 1291745 (0.0008) [2023-12-28 04:32:33,560][106226] Updated weights for policy 0, policy_version 1291755 (0.0007) [2023-12-28 04:32:33,613][106226] Updated weights for policy 0, policy_version 1291765 (0.0007) [2023-12-28 04:32:33,837][106225] Updated weights for policy 1, policy_version 1294985 (0.0010) [2023-12-28 04:32:33,887][106225] Updated weights for policy 1, policy_version 1294995 (0.0008) [2023-12-28 04:32:33,931][106225] Updated weights for policy 1, policy_version 1295005 (0.0008) [2023-12-28 04:32:33,979][106225] Updated weights for policy 1, policy_version 1295015 (0.0007) [2023-12-28 04:32:34,393][106226] Updated weights for policy 0, policy_version 1291775 (0.0008) [2023-12-28 04:32:34,461][106226] Updated weights for policy 0, policy_version 1291785 (0.0010) [2023-12-28 04:32:34,525][106226] Updated weights for policy 0, policy_version 1291795 (0.0011) [2023-12-28 04:32:34,651][106225] Updated weights for policy 1, policy_version 1295025 (0.0007) [2023-12-28 04:32:34,711][106225] Updated weights for policy 1, policy_version 1295035 (0.0007) [2023-12-28 04:32:34,772][106225] Updated weights for policy 1, policy_version 1295045 (0.0007) [2023-12-28 04:32:35,229][106226] Updated weights for policy 0, policy_version 1291805 (0.0010) [2023-12-28 04:32:35,292][106226] Updated weights for policy 0, policy_version 1291815 (0.0010) [2023-12-28 04:32:35,345][106226] Updated weights for policy 0, policy_version 1291825 (0.0010) [2023-12-28 04:32:35,437][106225] Updated weights for policy 1, policy_version 1295055 (0.0007) [2023-12-28 04:32:35,487][106225] Updated weights for policy 1, policy_version 1295065 (0.0008) [2023-12-28 04:32:35,532][106225] Updated weights for policy 1, policy_version 1295075 (0.0007) [2023-12-28 04:32:35,990][106226] Updated weights for policy 0, policy_version 1291835 (0.0009) [2023-12-28 04:32:36,047][106226] Updated weights for policy 0, policy_version 1291845 (0.0005) [2023-12-28 04:32:36,105][106226] Updated weights for policy 0, policy_version 1291855 (0.0006) [2023-12-28 04:32:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 662364160. Throughput: 0: 9925.2, 1: 9890.0. Samples: 662371956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:36,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.956')] [2023-12-28 04:32:36,334][106225] Updated weights for policy 1, policy_version 1295085 (0.0007) [2023-12-28 04:32:36,397][106225] Updated weights for policy 1, policy_version 1295095 (0.0009) [2023-12-28 04:32:36,461][106225] Updated weights for policy 1, policy_version 1295105 (0.0008) [2023-12-28 04:32:36,831][106226] Updated weights for policy 0, policy_version 1291865 (0.0008) [2023-12-28 04:32:36,896][106226] Updated weights for policy 0, policy_version 1291875 (0.0008) [2023-12-28 04:32:36,960][106226] Updated weights for policy 0, policy_version 1291885 (0.0008) [2023-12-28 04:32:37,018][106226] Updated weights for policy 0, policy_version 1291895 (0.0008) [2023-12-28 04:32:37,188][106225] Updated weights for policy 1, policy_version 1295115 (0.0008) [2023-12-28 04:32:37,245][106225] Updated weights for policy 1, policy_version 1295125 (0.0009) [2023-12-28 04:32:37,301][106225] Updated weights for policy 1, policy_version 1295135 (0.0010) [2023-12-28 04:32:37,690][106226] Updated weights for policy 0, policy_version 1291905 (0.0006) [2023-12-28 04:32:37,750][106226] Updated weights for policy 0, policy_version 1291915 (0.0006) [2023-12-28 04:32:37,808][106226] Updated weights for policy 0, policy_version 1291925 (0.0007) [2023-12-28 04:32:38,042][106225] Updated weights for policy 1, policy_version 1295145 (0.0010) [2023-12-28 04:32:38,092][106225] Updated weights for policy 1, policy_version 1295155 (0.0008) [2023-12-28 04:32:38,141][106225] Updated weights for policy 1, policy_version 1295165 (0.0007) [2023-12-28 04:32:38,201][106225] Updated weights for policy 1, policy_version 1295175 (0.0007) [2023-12-28 04:32:38,480][106226] Updated weights for policy 0, policy_version 1291935 (0.0012) [2023-12-28 04:32:38,538][106226] Updated weights for policy 0, policy_version 1291945 (0.0009) [2023-12-28 04:32:38,599][106226] Updated weights for policy 0, policy_version 1291955 (0.0010) [2023-12-28 04:32:38,955][106225] Updated weights for policy 1, policy_version 1295185 (0.0008) [2023-12-28 04:32:39,013][106225] Updated weights for policy 1, policy_version 1295195 (0.0008) [2023-12-28 04:32:39,088][106225] Updated weights for policy 1, policy_version 1295205 (0.0008) [2023-12-28 04:32:39,279][106226] Updated weights for policy 0, policy_version 1291965 (0.0010) [2023-12-28 04:32:39,336][106226] Updated weights for policy 0, policy_version 1291975 (0.0011) [2023-12-28 04:32:39,414][106226] Updated weights for policy 0, policy_version 1291985 (0.0011) [2023-12-28 04:32:39,947][106225] Updated weights for policy 1, policy_version 1295215 (0.0008) [2023-12-28 04:32:40,017][106225] Updated weights for policy 1, policy_version 1295225 (0.0008) [2023-12-28 04:32:40,075][106225] Updated weights for policy 1, policy_version 1295235 (0.0010) [2023-12-28 04:32:40,166][106226] Updated weights for policy 0, policy_version 1291995 (0.0011) [2023-12-28 04:32:40,228][106226] Updated weights for policy 0, policy_version 1292005 (0.0011) [2023-12-28 04:32:40,282][106226] Updated weights for policy 0, policy_version 1292015 (0.0011) [2023-12-28 04:32:40,831][106225] Updated weights for policy 1, policy_version 1295245 (0.0009) [2023-12-28 04:32:40,881][106225] Updated weights for policy 1, policy_version 1295255 (0.0009) [2023-12-28 04:32:40,923][106226] Updated weights for policy 0, policy_version 1292025 (0.0006) [2023-12-28 04:32:40,945][106225] Updated weights for policy 1, policy_version 1295265 (0.0008) [2023-12-28 04:32:40,979][106226] Updated weights for policy 0, policy_version 1292035 (0.0010) [2023-12-28 04:32:41,036][106226] Updated weights for policy 0, policy_version 1292045 (0.0010) [2023-12-28 04:32:41,106][106226] Updated weights for policy 0, policy_version 1292055 (0.0007) [2023-12-28 04:32:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 662462464. Throughput: 0: 9915.1, 1: 9881.1. Samples: 662429556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:41,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.893')] [2023-12-28 04:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001295272_331636736.pth... [2023-12-28 04:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001292056_330825728.pth... [2023-12-28 04:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001294120_331341824.pth [2023-12-28 04:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001290904_330530816.pth [2023-12-28 04:32:41,689][106225] Updated weights for policy 1, policy_version 1295275 (0.0008) [2023-12-28 04:32:41,758][106225] Updated weights for policy 1, policy_version 1295285 (0.0009) [2023-12-28 04:32:41,769][106226] Updated weights for policy 0, policy_version 1292065 (0.0010) [2023-12-28 04:32:41,810][106225] Updated weights for policy 1, policy_version 1295295 (0.0006) [2023-12-28 04:32:41,827][106226] Updated weights for policy 0, policy_version 1292075 (0.0010) [2023-12-28 04:32:41,891][106226] Updated weights for policy 0, policy_version 1292085 (0.0011) [2023-12-28 04:32:42,531][106225] Updated weights for policy 1, policy_version 1295305 (0.0008) [2023-12-28 04:32:42,595][106225] Updated weights for policy 1, policy_version 1295315 (0.0006) [2023-12-28 04:32:42,654][106226] Updated weights for policy 0, policy_version 1292095 (0.0009) [2023-12-28 04:32:42,661][106225] Updated weights for policy 1, policy_version 1295325 (0.0008) [2023-12-28 04:32:42,717][106226] Updated weights for policy 0, policy_version 1292105 (0.0007) [2023-12-28 04:32:42,724][106225] Updated weights for policy 1, policy_version 1295335 (0.0010) [2023-12-28 04:32:42,781][106226] Updated weights for policy 0, policy_version 1292115 (0.0011) [2023-12-28 04:32:43,353][106225] Updated weights for policy 1, policy_version 1295345 (0.0005) [2023-12-28 04:32:43,403][106225] Updated weights for policy 1, policy_version 1295355 (0.0005) [2023-12-28 04:32:43,450][106226] Updated weights for policy 0, policy_version 1292125 (0.0010) [2023-12-28 04:32:43,461][106225] Updated weights for policy 1, policy_version 1295365 (0.0005) [2023-12-28 04:32:43,512][106226] Updated weights for policy 0, policy_version 1292135 (0.0010) [2023-12-28 04:32:43,568][106226] Updated weights for policy 0, policy_version 1292145 (0.0007) [2023-12-28 04:32:44,094][106225] Updated weights for policy 1, policy_version 1295375 (0.0007) [2023-12-28 04:32:44,154][106225] Updated weights for policy 1, policy_version 1295385 (0.0006) [2023-12-28 04:32:44,156][106226] Updated weights for policy 0, policy_version 1292155 (0.0007) [2023-12-28 04:32:44,212][106225] Updated weights for policy 1, policy_version 1295395 (0.0007) [2023-12-28 04:32:44,218][106226] Updated weights for policy 0, policy_version 1292165 (0.0011) [2023-12-28 04:32:44,272][106226] Updated weights for policy 0, policy_version 1292175 (0.0010) [2023-12-28 04:32:44,953][106225] Updated weights for policy 1, policy_version 1295405 (0.0007) [2023-12-28 04:32:44,959][106226] Updated weights for policy 0, policy_version 1292185 (0.0011) [2023-12-28 04:32:45,020][106225] Updated weights for policy 1, policy_version 1295415 (0.0007) [2023-12-28 04:32:45,025][106226] Updated weights for policy 0, policy_version 1292195 (0.0011) [2023-12-28 04:32:45,082][106225] Updated weights for policy 1, policy_version 1295425 (0.0007) [2023-12-28 04:32:45,095][106226] Updated weights for policy 0, policy_version 1292205 (0.0011) [2023-12-28 04:32:45,157][106226] Updated weights for policy 0, policy_version 1292215 (0.0011) [2023-12-28 04:32:45,774][106225] Updated weights for policy 1, policy_version 1295435 (0.0006) [2023-12-28 04:32:45,826][106226] Updated weights for policy 0, policy_version 1292225 (0.0008) [2023-12-28 04:32:45,829][106225] Updated weights for policy 1, policy_version 1295445 (0.0009) [2023-12-28 04:32:45,890][106226] Updated weights for policy 0, policy_version 1292235 (0.0009) [2023-12-28 04:32:45,891][106225] Updated weights for policy 1, policy_version 1295455 (0.0006) [2023-12-28 04:32:45,953][106226] Updated weights for policy 0, policy_version 1292245 (0.0009) [2023-12-28 04:32:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 662560768. Throughput: 0: 9978.4, 1: 9774.9. Samples: 662547744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:46,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.937')] [2023-12-28 04:32:46,449][106225] Updated weights for policy 1, policy_version 1295465 (0.0005) [2023-12-28 04:32:46,495][106225] Updated weights for policy 1, policy_version 1295475 (0.0005) [2023-12-28 04:32:46,548][106225] Updated weights for policy 1, policy_version 1295485 (0.0006) [2023-12-28 04:32:46,597][106225] Updated weights for policy 1, policy_version 1295495 (0.0005) [2023-12-28 04:32:46,673][106226] Updated weights for policy 0, policy_version 1292255 (0.0007) [2023-12-28 04:32:46,724][106226] Updated weights for policy 0, policy_version 1292266 (0.0009) [2023-12-28 04:32:46,771][106226] Updated weights for policy 0, policy_version 1292276 (0.0006) [2023-12-28 04:32:47,276][106225] Updated weights for policy 1, policy_version 1295505 (0.0010) [2023-12-28 04:32:47,344][106225] Updated weights for policy 1, policy_version 1295515 (0.0010) [2023-12-28 04:32:47,401][106225] Updated weights for policy 1, policy_version 1295525 (0.0010) [2023-12-28 04:32:47,479][106226] Updated weights for policy 0, policy_version 1292286 (0.0008) [2023-12-28 04:32:47,543][106226] Updated weights for policy 0, policy_version 1292296 (0.0010) [2023-12-28 04:32:47,605][106226] Updated weights for policy 0, policy_version 1292306 (0.0011) [2023-12-28 04:32:48,055][106225] Updated weights for policy 1, policy_version 1295535 (0.0009) [2023-12-28 04:32:48,112][106225] Updated weights for policy 1, policy_version 1295545 (0.0008) [2023-12-28 04:32:48,170][106225] Updated weights for policy 1, policy_version 1295555 (0.0008) [2023-12-28 04:32:48,319][106226] Updated weights for policy 0, policy_version 1292316 (0.0011) [2023-12-28 04:32:48,385][106226] Updated weights for policy 0, policy_version 1292326 (0.0010) [2023-12-28 04:32:48,446][106226] Updated weights for policy 0, policy_version 1292336 (0.0011) [2023-12-28 04:32:48,860][106225] Updated weights for policy 1, policy_version 1295565 (0.0009) [2023-12-28 04:32:48,926][106225] Updated weights for policy 1, policy_version 1295575 (0.0009) [2023-12-28 04:32:48,987][106225] Updated weights for policy 1, policy_version 1295585 (0.0007) [2023-12-28 04:32:49,046][106226] Updated weights for policy 0, policy_version 1292346 (0.0010) [2023-12-28 04:32:49,093][106226] Updated weights for policy 0, policy_version 1292356 (0.0005) [2023-12-28 04:32:49,142][106226] Updated weights for policy 0, policy_version 1292366 (0.0006) [2023-12-28 04:32:49,197][106226] Updated weights for policy 0, policy_version 1292376 (0.0006) [2023-12-28 04:32:49,747][106225] Updated weights for policy 1, policy_version 1295595 (0.0010) [2023-12-28 04:32:49,808][106225] Updated weights for policy 1, policy_version 1295605 (0.0010) [2023-12-28 04:32:49,876][106225] Updated weights for policy 1, policy_version 1295615 (0.0008) [2023-12-28 04:32:49,910][106226] Updated weights for policy 0, policy_version 1292386 (0.0007) [2023-12-28 04:32:49,975][106226] Updated weights for policy 0, policy_version 1292396 (0.0008) [2023-12-28 04:32:50,034][106226] Updated weights for policy 0, policy_version 1292406 (0.0008) [2023-12-28 04:32:50,576][106225] Updated weights for policy 1, policy_version 1295625 (0.0009) [2023-12-28 04:32:50,634][106225] Updated weights for policy 1, policy_version 1295635 (0.0009) [2023-12-28 04:32:50,696][106225] Updated weights for policy 1, policy_version 1295645 (0.0007) [2023-12-28 04:32:50,758][106225] Updated weights for policy 1, policy_version 1295655 (0.0008) [2023-12-28 04:32:50,768][106226] Updated weights for policy 0, policy_version 1292416 (0.0008) [2023-12-28 04:32:50,835][106226] Updated weights for policy 0, policy_version 1292426 (0.0008) [2023-12-28 04:32:50,890][106226] Updated weights for policy 0, policy_version 1292436 (0.0007) [2023-12-28 04:32:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 662659072. Throughput: 0: 9915.7, 1: 9826.5. Samples: 662667652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:51,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.802')] [2023-12-28 04:32:51,482][106225] Updated weights for policy 1, policy_version 1295665 (0.0006) [2023-12-28 04:32:51,528][106225] Updated weights for policy 1, policy_version 1295675 (0.0007) [2023-12-28 04:32:51,587][106225] Updated weights for policy 1, policy_version 1295685 (0.0008) [2023-12-28 04:32:51,640][106226] Updated weights for policy 0, policy_version 1292446 (0.0008) [2023-12-28 04:32:51,696][106226] Updated weights for policy 0, policy_version 1292456 (0.0008) [2023-12-28 04:32:51,763][106226] Updated weights for policy 0, policy_version 1292466 (0.0008) [2023-12-28 04:32:52,384][106225] Updated weights for policy 1, policy_version 1295695 (0.0008) [2023-12-28 04:32:52,445][106225] Updated weights for policy 1, policy_version 1295705 (0.0008) [2023-12-28 04:32:52,453][106226] Updated weights for policy 0, policy_version 1292476 (0.0008) [2023-12-28 04:32:52,498][106225] Updated weights for policy 1, policy_version 1295715 (0.0009) [2023-12-28 04:32:52,512][106226] Updated weights for policy 0, policy_version 1292486 (0.0007) [2023-12-28 04:32:52,575][106226] Updated weights for policy 0, policy_version 1292496 (0.0008) [2023-12-28 04:32:53,166][106225] Updated weights for policy 1, policy_version 1295725 (0.0008) [2023-12-28 04:32:53,216][106225] Updated weights for policy 1, policy_version 1295735 (0.0008) [2023-12-28 04:32:53,272][106225] Updated weights for policy 1, policy_version 1295745 (0.0008) [2023-12-28 04:32:53,336][106226] Updated weights for policy 0, policy_version 1292506 (0.0009) [2023-12-28 04:32:53,393][106226] Updated weights for policy 0, policy_version 1292516 (0.0010) [2023-12-28 04:32:53,457][106226] Updated weights for policy 0, policy_version 1292526 (0.0010) [2023-12-28 04:32:53,513][106226] Updated weights for policy 0, policy_version 1292536 (0.0011) [2023-12-28 04:32:53,967][106225] Updated weights for policy 1, policy_version 1295755 (0.0007) [2023-12-28 04:32:54,027][106225] Updated weights for policy 1, policy_version 1295765 (0.0008) [2023-12-28 04:32:54,087][106225] Updated weights for policy 1, policy_version 1295775 (0.0008) [2023-12-28 04:32:54,225][106226] Updated weights for policy 0, policy_version 1292546 (0.0011) [2023-12-28 04:32:54,278][106226] Updated weights for policy 0, policy_version 1292556 (0.0010) [2023-12-28 04:32:54,329][106226] Updated weights for policy 0, policy_version 1292566 (0.0010) [2023-12-28 04:32:54,787][106225] Updated weights for policy 1, policy_version 1295785 (0.0007) [2023-12-28 04:32:54,845][106225] Updated weights for policy 1, policy_version 1295795 (0.0005) [2023-12-28 04:32:54,904][106225] Updated weights for policy 1, policy_version 1295805 (0.0006) [2023-12-28 04:32:54,952][106225] Updated weights for policy 1, policy_version 1295815 (0.0009) [2023-12-28 04:32:55,049][106226] Updated weights for policy 0, policy_version 1292576 (0.0008) [2023-12-28 04:32:55,108][106226] Updated weights for policy 0, policy_version 1292586 (0.0010) [2023-12-28 04:32:55,180][106226] Updated weights for policy 0, policy_version 1292596 (0.0009) [2023-12-28 04:32:55,500][106225] Updated weights for policy 1, policy_version 1295825 (0.0009) [2023-12-28 04:32:55,557][106225] Updated weights for policy 1, policy_version 1295835 (0.0010) [2023-12-28 04:32:55,607][106225] Updated weights for policy 1, policy_version 1295845 (0.0006) [2023-12-28 04:32:55,998][106226] Updated weights for policy 0, policy_version 1292606 (0.0010) [2023-12-28 04:32:56,052][106226] Updated weights for policy 0, policy_version 1292616 (0.0008) [2023-12-28 04:32:56,096][106226] Updated weights for policy 0, policy_version 1292626 (0.0008) [2023-12-28 04:32:56,173][106225] Updated weights for policy 1, policy_version 1295855 (0.0007) [2023-12-28 04:32:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.5, 300 sec: 19744.1). Total num frames: 662757376. Throughput: 0: 9883.7, 1: 9812.5. Samples: 662725684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:32:56,175][105115] Avg episode reward: [(0, '-3.942'), (1, '-4.880')] [2023-12-28 04:32:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001292632_330973184.pth... [2023-12-28 04:32:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001291448_330670080.pth [2023-12-28 04:32:56,236][106225] Updated weights for policy 1, policy_version 1295865 (0.0008) [2023-12-28 04:32:56,295][106225] Updated weights for policy 1, policy_version 1295875 (0.0009) [2023-12-28 04:32:56,321][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001295880_331792384.pth... [2023-12-28 04:32:56,325][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001294696_331489280.pth [2023-12-28 04:32:56,862][106226] Updated weights for policy 0, policy_version 1292636 (0.0008) [2023-12-28 04:32:56,912][106226] Updated weights for policy 0, policy_version 1292646 (0.0007) [2023-12-28 04:32:56,917][106225] Updated weights for policy 1, policy_version 1295885 (0.0008) [2023-12-28 04:32:56,968][106226] Updated weights for policy 0, policy_version 1292656 (0.0007) [2023-12-28 04:32:56,977][106225] Updated weights for policy 1, policy_version 1295895 (0.0006) [2023-12-28 04:32:57,025][106225] Updated weights for policy 1, policy_version 1295905 (0.0005) [2023-12-28 04:32:57,653][106225] Updated weights for policy 1, policy_version 1295915 (0.0006) [2023-12-28 04:32:57,667][106226] Updated weights for policy 0, policy_version 1292666 (0.0008) [2023-12-28 04:32:57,706][106225] Updated weights for policy 1, policy_version 1295925 (0.0005) [2023-12-28 04:32:57,715][106226] Updated weights for policy 0, policy_version 1292676 (0.0007) [2023-12-28 04:32:57,763][106226] Updated weights for policy 0, policy_version 1292686 (0.0005) [2023-12-28 04:32:57,773][106225] Updated weights for policy 1, policy_version 1295935 (0.0005) [2023-12-28 04:32:57,822][106226] Updated weights for policy 0, policy_version 1292696 (0.0005) [2023-12-28 04:32:58,313][106225] Updated weights for policy 1, policy_version 1295945 (0.0006) [2023-12-28 04:32:58,389][106225] Updated weights for policy 1, policy_version 1295955 (0.0008) [2023-12-28 04:32:58,442][106225] Updated weights for policy 1, policy_version 1295965 (0.0008) [2023-12-28 04:32:58,504][106225] Updated weights for policy 1, policy_version 1295975 (0.0008) [2023-12-28 04:32:58,517][106226] Updated weights for policy 0, policy_version 1292706 (0.0008) [2023-12-28 04:32:58,583][106226] Updated weights for policy 0, policy_version 1292716 (0.0008) [2023-12-28 04:32:58,645][106226] Updated weights for policy 0, policy_version 1292726 (0.0008) [2023-12-28 04:32:59,313][106226] Updated weights for policy 0, policy_version 1292736 (0.0008) [2023-12-28 04:32:59,360][106225] Updated weights for policy 1, policy_version 1295985 (0.0008) [2023-12-28 04:32:59,381][106226] Updated weights for policy 0, policy_version 1292746 (0.0012) [2023-12-28 04:32:59,421][106225] Updated weights for policy 1, policy_version 1295995 (0.0009) [2023-12-28 04:32:59,444][106226] Updated weights for policy 0, policy_version 1292756 (0.0011) [2023-12-28 04:32:59,479][106225] Updated weights for policy 1, policy_version 1296005 (0.0010) [2023-12-28 04:33:00,139][106226] Updated weights for policy 0, policy_version 1292766 (0.0010) [2023-12-28 04:33:00,202][106226] Updated weights for policy 0, policy_version 1292776 (0.0011) [2023-12-28 04:33:00,208][106225] Updated weights for policy 1, policy_version 1296015 (0.0007) [2023-12-28 04:33:00,264][106226] Updated weights for policy 0, policy_version 1292786 (0.0011) [2023-12-28 04:33:00,268][106225] Updated weights for policy 1, policy_version 1296025 (0.0005) [2023-12-28 04:33:00,329][106225] Updated weights for policy 1, policy_version 1296035 (0.0005) [2023-12-28 04:33:00,910][106225] Updated weights for policy 1, policy_version 1296045 (0.0008) [2023-12-28 04:33:00,943][106226] Updated weights for policy 0, policy_version 1292796 (0.0011) [2023-12-28 04:33:00,967][106225] Updated weights for policy 1, policy_version 1296055 (0.0006) [2023-12-28 04:33:00,995][106226] Updated weights for policy 0, policy_version 1292806 (0.0010) [2023-12-28 04:33:01,028][106225] Updated weights for policy 1, policy_version 1296065 (0.0006) [2023-12-28 04:33:01,059][106226] Updated weights for policy 0, policy_version 1292816 (0.0009) [2023-12-28 04:33:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 662863872. Throughput: 0: 9910.6, 1: 9920.6. Samples: 662846688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:01,175][105115] Avg episode reward: [(0, '-3.975'), (1, '-4.764')] [2023-12-28 04:33:01,718][106225] Updated weights for policy 1, policy_version 1296075 (0.0008) [2023-12-28 04:33:01,775][106225] Updated weights for policy 1, policy_version 1296085 (0.0006) [2023-12-28 04:33:01,840][106225] Updated weights for policy 1, policy_version 1296095 (0.0005) [2023-12-28 04:33:01,847][106226] Updated weights for policy 0, policy_version 1292826 (0.0010) [2023-12-28 04:33:01,905][106226] Updated weights for policy 0, policy_version 1292836 (0.0008) [2023-12-28 04:33:01,974][106226] Updated weights for policy 0, policy_version 1292846 (0.0008) [2023-12-28 04:33:02,042][106226] Updated weights for policy 0, policy_version 1292856 (0.0008) [2023-12-28 04:33:02,483][106225] Updated weights for policy 1, policy_version 1296105 (0.0007) [2023-12-28 04:33:02,549][106225] Updated weights for policy 1, policy_version 1296115 (0.0009) [2023-12-28 04:33:02,601][106225] Updated weights for policy 1, policy_version 1296125 (0.0009) [2023-12-28 04:33:02,650][106225] Updated weights for policy 1, policy_version 1296135 (0.0007) [2023-12-28 04:33:02,735][106226] Updated weights for policy 0, policy_version 1292866 (0.0008) [2023-12-28 04:33:02,810][106226] Updated weights for policy 0, policy_version 1292876 (0.0006) [2023-12-28 04:33:02,875][106226] Updated weights for policy 0, policy_version 1292886 (0.0009) [2023-12-28 04:33:03,318][106225] Updated weights for policy 1, policy_version 1296145 (0.0006) [2023-12-28 04:33:03,384][106225] Updated weights for policy 1, policy_version 1296155 (0.0008) [2023-12-28 04:33:03,440][106225] Updated weights for policy 1, policy_version 1296165 (0.0008) [2023-12-28 04:33:03,453][106226] Updated weights for policy 0, policy_version 1292896 (0.0008) [2023-12-28 04:33:03,515][106226] Updated weights for policy 0, policy_version 1292906 (0.0009) [2023-12-28 04:33:03,578][106226] Updated weights for policy 0, policy_version 1292916 (0.0008) [2023-12-28 04:33:04,117][106225] Updated weights for policy 1, policy_version 1296175 (0.0007) [2023-12-28 04:33:04,171][106225] Updated weights for policy 1, policy_version 1296185 (0.0008) [2023-12-28 04:33:04,237][106225] Updated weights for policy 1, policy_version 1296195 (0.0009) [2023-12-28 04:33:04,285][106226] Updated weights for policy 0, policy_version 1292926 (0.0010) [2023-12-28 04:33:04,346][106226] Updated weights for policy 0, policy_version 1292936 (0.0010) [2023-12-28 04:33:04,410][106226] Updated weights for policy 0, policy_version 1292946 (0.0011) [2023-12-28 04:33:05,004][106225] Updated weights for policy 1, policy_version 1296205 (0.0008) [2023-12-28 04:33:05,026][106226] Updated weights for policy 0, policy_version 1292956 (0.0009) [2023-12-28 04:33:05,067][106225] Updated weights for policy 1, policy_version 1296215 (0.0007) [2023-12-28 04:33:05,088][106226] Updated weights for policy 0, policy_version 1292966 (0.0006) [2023-12-28 04:33:05,126][106225] Updated weights for policy 1, policy_version 1296225 (0.0008) [2023-12-28 04:33:05,140][106226] Updated weights for policy 0, policy_version 1292976 (0.0007) [2023-12-28 04:33:05,807][106226] Updated weights for policy 0, policy_version 1292986 (0.0006) [2023-12-28 04:33:05,827][106225] Updated weights for policy 1, policy_version 1296235 (0.0008) [2023-12-28 04:33:05,873][106225] Updated weights for policy 1, policy_version 1296245 (0.0006) [2023-12-28 04:33:05,877][106226] Updated weights for policy 0, policy_version 1292996 (0.0009) [2023-12-28 04:33:05,919][106225] Updated weights for policy 1, policy_version 1296255 (0.0007) [2023-12-28 04:33:05,944][106226] Updated weights for policy 0, policy_version 1293006 (0.0006) [2023-12-28 04:33:06,011][106226] Updated weights for policy 0, policy_version 1293016 (0.0007) [2023-12-28 04:33:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 662962176. Throughput: 0: 9881.6, 1: 9960.0. Samples: 662967888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:06,175][105115] Avg episode reward: [(0, '-4.178'), (1, '-5.105')] [2023-12-28 04:33:06,654][106225] Updated weights for policy 1, policy_version 1296265 (0.0007) [2023-12-28 04:33:06,715][106225] Updated weights for policy 1, policy_version 1296275 (0.0007) [2023-12-28 04:33:06,729][106226] Updated weights for policy 0, policy_version 1293026 (0.0006) [2023-12-28 04:33:06,774][106225] Updated weights for policy 1, policy_version 1296285 (0.0007) [2023-12-28 04:33:06,788][106226] Updated weights for policy 0, policy_version 1293036 (0.0005) [2023-12-28 04:33:06,827][106225] Updated weights for policy 1, policy_version 1296295 (0.0006) [2023-12-28 04:33:06,842][106226] Updated weights for policy 0, policy_version 1293046 (0.0006) [2023-12-28 04:33:07,486][106225] Updated weights for policy 1, policy_version 1296305 (0.0009) [2023-12-28 04:33:07,526][106226] Updated weights for policy 0, policy_version 1293056 (0.0009) [2023-12-28 04:33:07,536][106225] Updated weights for policy 1, policy_version 1296315 (0.0005) [2023-12-28 04:33:07,581][106226] Updated weights for policy 0, policy_version 1293066 (0.0008) [2023-12-28 04:33:07,588][106225] Updated weights for policy 1, policy_version 1296325 (0.0007) [2023-12-28 04:33:07,636][106226] Updated weights for policy 0, policy_version 1293076 (0.0007) [2023-12-28 04:33:08,183][106225] Updated weights for policy 1, policy_version 1296335 (0.0008) [2023-12-28 04:33:08,231][106225] Updated weights for policy 1, policy_version 1296345 (0.0007) [2023-12-28 04:33:08,285][106226] Updated weights for policy 0, policy_version 1293086 (0.0007) [2023-12-28 04:33:08,293][106225] Updated weights for policy 1, policy_version 1296355 (0.0008) [2023-12-28 04:33:08,347][106226] Updated weights for policy 0, policy_version 1293096 (0.0007) [2023-12-28 04:33:08,408][106226] Updated weights for policy 0, policy_version 1293106 (0.0008) [2023-12-28 04:33:09,025][106225] Updated weights for policy 1, policy_version 1296365 (0.0008) [2023-12-28 04:33:09,082][106225] Updated weights for policy 1, policy_version 1296375 (0.0008) [2023-12-28 04:33:09,141][106225] Updated weights for policy 1, policy_version 1296385 (0.0008) [2023-12-28 04:33:09,161][106226] Updated weights for policy 0, policy_version 1293116 (0.0009) [2023-12-28 04:33:09,216][106226] Updated weights for policy 0, policy_version 1293126 (0.0008) [2023-12-28 04:33:09,279][106226] Updated weights for policy 0, policy_version 1293136 (0.0010) [2023-12-28 04:33:09,916][106225] Updated weights for policy 1, policy_version 1296395 (0.0007) [2023-12-28 04:33:09,983][106225] Updated weights for policy 1, policy_version 1296405 (0.0006) [2023-12-28 04:33:10,046][106225] Updated weights for policy 1, policy_version 1296415 (0.0008) [2023-12-28 04:33:10,076][106226] Updated weights for policy 0, policy_version 1293146 (0.0008) [2023-12-28 04:33:10,138][106226] Updated weights for policy 0, policy_version 1293156 (0.0007) [2023-12-28 04:33:10,201][106226] Updated weights for policy 0, policy_version 1293166 (0.0009) [2023-12-28 04:33:10,267][106226] Updated weights for policy 0, policy_version 1293176 (0.0008) [2023-12-28 04:33:10,799][106225] Updated weights for policy 1, policy_version 1296425 (0.0007) [2023-12-28 04:33:10,854][106225] Updated weights for policy 1, policy_version 1296435 (0.0008) [2023-12-28 04:33:10,912][106225] Updated weights for policy 1, policy_version 1296445 (0.0008) [2023-12-28 04:33:10,914][106226] Updated weights for policy 0, policy_version 1293186 (0.0008) [2023-12-28 04:33:10,965][106225] Updated weights for policy 1, policy_version 1296455 (0.0007) [2023-12-28 04:33:10,967][106226] Updated weights for policy 0, policy_version 1293196 (0.0007) [2023-12-28 04:33:11,020][106226] Updated weights for policy 0, policy_version 1293206 (0.0008) [2023-12-28 04:33:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 663060480. Throughput: 0: 9952.4, 1: 9942.4. Samples: 663028056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:11,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-5.046')] [2023-12-28 04:33:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001296456_331939840.pth... [2023-12-28 04:33:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001293208_331120640.pth... [2023-12-28 04:33:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001295272_331636736.pth [2023-12-28 04:33:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001292056_330825728.pth [2023-12-28 04:33:11,739][106225] Updated weights for policy 1, policy_version 1296465 (0.0009) [2023-12-28 04:33:11,811][106225] Updated weights for policy 1, policy_version 1296475 (0.0009) [2023-12-28 04:33:11,863][106226] Updated weights for policy 0, policy_version 1293216 (0.0011) [2023-12-28 04:33:11,875][106225] Updated weights for policy 1, policy_version 1296485 (0.0006) [2023-12-28 04:33:11,922][106226] Updated weights for policy 0, policy_version 1293226 (0.0011) [2023-12-28 04:33:11,982][106226] Updated weights for policy 0, policy_version 1293236 (0.0010) [2023-12-28 04:33:12,533][106225] Updated weights for policy 1, policy_version 1296495 (0.0006) [2023-12-28 04:33:12,585][106225] Updated weights for policy 1, policy_version 1296505 (0.0006) [2023-12-28 04:33:12,647][106225] Updated weights for policy 1, policy_version 1296515 (0.0008) [2023-12-28 04:33:12,728][106226] Updated weights for policy 0, policy_version 1293246 (0.0009) [2023-12-28 04:33:12,786][106226] Updated weights for policy 0, policy_version 1293256 (0.0006) [2023-12-28 04:33:12,843][106226] Updated weights for policy 0, policy_version 1293266 (0.0007) [2023-12-28 04:33:13,340][106225] Updated weights for policy 1, policy_version 1296525 (0.0009) [2023-12-28 04:33:13,391][106225] Updated weights for policy 1, policy_version 1296535 (0.0005) [2023-12-28 04:33:13,439][106225] Updated weights for policy 1, policy_version 1296545 (0.0005) [2023-12-28 04:33:13,483][106226] Updated weights for policy 0, policy_version 1293276 (0.0009) [2023-12-28 04:33:13,543][106226] Updated weights for policy 0, policy_version 1293286 (0.0008) [2023-12-28 04:33:13,604][106226] Updated weights for policy 0, policy_version 1293296 (0.0010) [2023-12-28 04:33:14,065][106225] Updated weights for policy 1, policy_version 1296555 (0.0006) [2023-12-28 04:33:14,129][106225] Updated weights for policy 1, policy_version 1296565 (0.0007) [2023-12-28 04:33:14,191][106225] Updated weights for policy 1, policy_version 1296575 (0.0010) [2023-12-28 04:33:14,219][106226] Updated weights for policy 0, policy_version 1293306 (0.0010) [2023-12-28 04:33:14,272][106226] Updated weights for policy 0, policy_version 1293316 (0.0010) [2023-12-28 04:33:14,328][106226] Updated weights for policy 0, policy_version 1293326 (0.0008) [2023-12-28 04:33:14,384][106226] Updated weights for policy 0, policy_version 1293336 (0.0007) [2023-12-28 04:33:14,865][106225] Updated weights for policy 1, policy_version 1296585 (0.0010) [2023-12-28 04:33:14,932][106225] Updated weights for policy 1, policy_version 1296595 (0.0011) [2023-12-28 04:33:14,996][106225] Updated weights for policy 1, policy_version 1296605 (0.0010) [2023-12-28 04:33:15,059][106225] Updated weights for policy 1, policy_version 1296615 (0.0010) [2023-12-28 04:33:15,081][106226] Updated weights for policy 0, policy_version 1293346 (0.0011) [2023-12-28 04:33:15,144][106226] Updated weights for policy 0, policy_version 1293356 (0.0008) [2023-12-28 04:33:15,210][106226] Updated weights for policy 0, policy_version 1293366 (0.0010) [2023-12-28 04:33:15,786][106225] Updated weights for policy 1, policy_version 1296625 (0.0010) [2023-12-28 04:33:15,832][106225] Updated weights for policy 1, policy_version 1296635 (0.0010) [2023-12-28 04:33:15,886][106225] Updated weights for policy 1, policy_version 1296645 (0.0010) [2023-12-28 04:33:15,907][106226] Updated weights for policy 0, policy_version 1293376 (0.0011) [2023-12-28 04:33:15,960][106226] Updated weights for policy 0, policy_version 1293386 (0.0007) [2023-12-28 04:33:16,021][106226] Updated weights for policy 0, policy_version 1293396 (0.0006) [2023-12-28 04:33:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 663158784. Throughput: 0: 9895.4, 1: 9953.7. Samples: 663145260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:16,176][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.859')] [2023-12-28 04:33:16,527][106225] Updated weights for policy 1, policy_version 1296655 (0.0006) [2023-12-28 04:33:16,564][106226] Updated weights for policy 0, policy_version 1293406 (0.0006) [2023-12-28 04:33:16,575][106225] Updated weights for policy 1, policy_version 1296665 (0.0009) [2023-12-28 04:33:16,622][106225] Updated weights for policy 1, policy_version 1296675 (0.0010) [2023-12-28 04:33:16,625][106226] Updated weights for policy 0, policy_version 1293416 (0.0005) [2023-12-28 04:33:16,678][106226] Updated weights for policy 0, policy_version 1293426 (0.0005) [2023-12-28 04:33:17,339][106225] Updated weights for policy 1, policy_version 1296685 (0.0010) [2023-12-28 04:33:17,350][106226] Updated weights for policy 0, policy_version 1293436 (0.0008) [2023-12-28 04:33:17,389][106225] Updated weights for policy 1, policy_version 1296695 (0.0010) [2023-12-28 04:33:17,410][106226] Updated weights for policy 0, policy_version 1293446 (0.0011) [2023-12-28 04:33:17,438][106225] Updated weights for policy 1, policy_version 1296705 (0.0010) [2023-12-28 04:33:17,468][106226] Updated weights for policy 0, policy_version 1293456 (0.0011) [2023-12-28 04:33:18,166][106225] Updated weights for policy 1, policy_version 1296715 (0.0010) [2023-12-28 04:33:18,183][106226] Updated weights for policy 0, policy_version 1293466 (0.0011) [2023-12-28 04:33:18,232][106225] Updated weights for policy 1, policy_version 1296725 (0.0010) [2023-12-28 04:33:18,245][106226] Updated weights for policy 0, policy_version 1293476 (0.0008) [2023-12-28 04:33:18,294][106225] Updated weights for policy 1, policy_version 1296735 (0.0009) [2023-12-28 04:33:18,304][106226] Updated weights for policy 0, policy_version 1293486 (0.0008) [2023-12-28 04:33:18,956][106225] Updated weights for policy 1, policy_version 1296745 (0.0008) [2023-12-28 04:33:19,017][106225] Updated weights for policy 1, policy_version 1296755 (0.0006) [2023-12-28 04:33:19,044][106226] Updated weights for policy 0, policy_version 1293497 (0.0008) [2023-12-28 04:33:19,070][106225] Updated weights for policy 1, policy_version 1296765 (0.0006) [2023-12-28 04:33:19,104][106226] Updated weights for policy 0, policy_version 1293507 (0.0011) [2023-12-28 04:33:19,122][106225] Updated weights for policy 1, policy_version 1296775 (0.0006) [2023-12-28 04:33:19,165][106226] Updated weights for policy 0, policy_version 1293517 (0.0008) [2023-12-28 04:33:19,227][106226] Updated weights for policy 0, policy_version 1293527 (0.0010) [2023-12-28 04:33:19,791][106225] Updated weights for policy 1, policy_version 1296785 (0.0010) [2023-12-28 04:33:19,858][106225] Updated weights for policy 1, policy_version 1296795 (0.0009) [2023-12-28 04:33:19,914][106225] Updated weights for policy 1, policy_version 1296805 (0.0007) [2023-12-28 04:33:19,948][106226] Updated weights for policy 0, policy_version 1293537 (0.0007) [2023-12-28 04:33:20,009][106226] Updated weights for policy 0, policy_version 1293547 (0.0008) [2023-12-28 04:33:20,074][106226] Updated weights for policy 0, policy_version 1293557 (0.0009) [2023-12-28 04:33:20,638][106225] Updated weights for policy 1, policy_version 1296815 (0.0008) [2023-12-28 04:33:20,700][106225] Updated weights for policy 1, policy_version 1296825 (0.0008) [2023-12-28 04:33:20,762][106225] Updated weights for policy 1, policy_version 1296835 (0.0008) [2023-12-28 04:33:20,844][106226] Updated weights for policy 0, policy_version 1293567 (0.0008) [2023-12-28 04:33:20,911][106226] Updated weights for policy 0, policy_version 1293577 (0.0008) [2023-12-28 04:33:20,979][106226] Updated weights for policy 0, policy_version 1293587 (0.0007) [2023-12-28 04:33:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 663257088. Throughput: 0: 9850.1, 1: 9959.5. Samples: 663263388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:21,175][105115] Avg episode reward: [(0, '-4.154'), (1, '-5.034')] [2023-12-28 04:33:21,516][106225] Updated weights for policy 1, policy_version 1296845 (0.0008) [2023-12-28 04:33:21,578][106225] Updated weights for policy 1, policy_version 1296855 (0.0008) [2023-12-28 04:33:21,644][106225] Updated weights for policy 1, policy_version 1296865 (0.0008) [2023-12-28 04:33:21,732][106226] Updated weights for policy 0, policy_version 1293597 (0.0008) [2023-12-28 04:33:21,794][106226] Updated weights for policy 0, policy_version 1293607 (0.0009) [2023-12-28 04:33:21,854][106226] Updated weights for policy 0, policy_version 1293618 (0.0009) [2023-12-28 04:33:22,296][106225] Updated weights for policy 1, policy_version 1296875 (0.0007) [2023-12-28 04:33:22,374][106225] Updated weights for policy 1, policy_version 1296885 (0.0007) [2023-12-28 04:33:22,424][106225] Updated weights for policy 1, policy_version 1296895 (0.0007) [2023-12-28 04:33:22,651][106226] Updated weights for policy 0, policy_version 1293628 (0.0007) [2023-12-28 04:33:22,710][106226] Updated weights for policy 0, policy_version 1293638 (0.0008) [2023-12-28 04:33:22,767][106226] Updated weights for policy 0, policy_version 1293648 (0.0009) [2023-12-28 04:33:23,103][106225] Updated weights for policy 1, policy_version 1296905 (0.0006) [2023-12-28 04:33:23,160][106225] Updated weights for policy 1, policy_version 1296915 (0.0008) [2023-12-28 04:33:23,214][106225] Updated weights for policy 1, policy_version 1296925 (0.0010) [2023-12-28 04:33:23,262][106225] Updated weights for policy 1, policy_version 1296935 (0.0007) [2023-12-28 04:33:23,449][106226] Updated weights for policy 0, policy_version 1293658 (0.0008) [2023-12-28 04:33:23,510][106226] Updated weights for policy 0, policy_version 1293668 (0.0007) [2023-12-28 04:33:23,564][106226] Updated weights for policy 0, policy_version 1293678 (0.0005) [2023-12-28 04:33:23,633][106226] Updated weights for policy 0, policy_version 1293688 (0.0006) [2023-12-28 04:33:23,912][106225] Updated weights for policy 1, policy_version 1296945 (0.0006) [2023-12-28 04:33:23,969][106225] Updated weights for policy 1, policy_version 1296955 (0.0006) [2023-12-28 04:33:24,030][106225] Updated weights for policy 1, policy_version 1296965 (0.0008) [2023-12-28 04:33:24,205][106226] Updated weights for policy 0, policy_version 1293698 (0.0008) [2023-12-28 04:33:24,274][106226] Updated weights for policy 0, policy_version 1293708 (0.0009) [2023-12-28 04:33:24,340][106226] Updated weights for policy 0, policy_version 1293718 (0.0009) [2023-12-28 04:33:24,669][106225] Updated weights for policy 1, policy_version 1296975 (0.0007) [2023-12-28 04:33:24,735][106225] Updated weights for policy 1, policy_version 1296985 (0.0005) [2023-12-28 04:33:24,786][106225] Updated weights for policy 1, policy_version 1296995 (0.0005) [2023-12-28 04:33:24,946][106226] Updated weights for policy 0, policy_version 1293728 (0.0007) [2023-12-28 04:33:25,011][106226] Updated weights for policy 0, policy_version 1293738 (0.0006) [2023-12-28 04:33:25,062][106226] Updated weights for policy 0, policy_version 1293748 (0.0006) [2023-12-28 04:33:25,393][106225] Updated weights for policy 1, policy_version 1297005 (0.0006) [2023-12-28 04:33:25,441][106225] Updated weights for policy 1, policy_version 1297015 (0.0005) [2023-12-28 04:33:25,487][106225] Updated weights for policy 1, policy_version 1297025 (0.0005) [2023-12-28 04:33:25,734][106226] Updated weights for policy 0, policy_version 1293758 (0.0008) [2023-12-28 04:33:25,783][106226] Updated weights for policy 0, policy_version 1293768 (0.0007) [2023-12-28 04:33:25,837][106226] Updated weights for policy 0, policy_version 1293778 (0.0008) [2023-12-28 04:33:26,142][106225] Updated weights for policy 1, policy_version 1297035 (0.0009) [2023-12-28 04:33:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 663355392. Throughput: 0: 9854.6, 1: 9998.7. Samples: 663322952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:33:26,175][105115] Avg episode reward: [(0, '-4.117'), (1, '-5.293')] [2023-12-28 04:33:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001293784_331268096.pth... [2023-12-28 04:33:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001292632_330973184.pth [2023-12-28 04:33:26,197][106225] Updated weights for policy 1, policy_version 1297045 (0.0006) [2023-12-28 04:33:26,262][106225] Updated weights for policy 1, policy_version 1297055 (0.0011) [2023-12-28 04:33:26,308][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001297064_332095488.pth... [2023-12-28 04:33:26,311][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001295880_331792384.pth [2023-12-28 04:33:26,648][106226] Updated weights for policy 0, policy_version 1293788 (0.0009) [2023-12-28 04:33:26,700][106226] Updated weights for policy 0, policy_version 1293798 (0.0008) [2023-12-28 04:33:26,749][106226] Updated weights for policy 0, policy_version 1293808 (0.0007) [2023-12-28 04:33:26,831][106225] Updated weights for policy 1, policy_version 1297065 (0.0009) [2023-12-28 04:33:26,893][106225] Updated weights for policy 1, policy_version 1297075 (0.0005) [2023-12-28 04:33:26,955][106225] Updated weights for policy 1, policy_version 1297085 (0.0008) [2023-12-28 04:33:27,005][106225] Updated weights for policy 1, policy_version 1297095 (0.0010) [2023-12-28 04:33:27,549][106226] Updated weights for policy 0, policy_version 1293818 (0.0008) [2023-12-28 04:33:27,562][106225] Updated weights for policy 1, policy_version 1297105 (0.0010) [2023-12-28 04:33:27,606][106226] Updated weights for policy 0, policy_version 1293828 (0.0007) [2023-12-28 04:33:27,618][106225] Updated weights for policy 1, policy_version 1297115 (0.0009) [2023-12-28 04:33:27,667][106226] Updated weights for policy 0, policy_version 1293838 (0.0006) [2023-12-28 04:33:27,680][106225] Updated weights for policy 1, policy_version 1297125 (0.0010) [2023-12-28 04:33:27,728][106226] Updated weights for policy 0, policy_version 1293848 (0.0006) [2023-12-28 04:33:28,370][106225] Updated weights for policy 1, policy_version 1297135 (0.0009) [2023-12-28 04:33:28,429][106225] Updated weights for policy 1, policy_version 1297145 (0.0008) [2023-12-28 04:33:28,478][106225] Updated weights for policy 1, policy_version 1297155 (0.0006) [2023-12-28 04:33:28,479][106226] Updated weights for policy 0, policy_version 1293858 (0.0008) [2023-12-28 04:33:28,539][106226] Updated weights for policy 0, policy_version 1293868 (0.0009) [2023-12-28 04:33:28,600][106226] Updated weights for policy 0, policy_version 1293878 (0.0008) [2023-12-28 04:33:29,065][106225] Updated weights for policy 1, policy_version 1297165 (0.0005) [2023-12-28 04:33:29,110][106225] Updated weights for policy 1, policy_version 1297175 (0.0005) [2023-12-28 04:33:29,159][106225] Updated weights for policy 1, policy_version 1297185 (0.0005) [2023-12-28 04:33:29,398][106226] Updated weights for policy 0, policy_version 1293888 (0.0008) [2023-12-28 04:33:29,459][106226] Updated weights for policy 0, policy_version 1293898 (0.0008) [2023-12-28 04:33:29,521][106226] Updated weights for policy 0, policy_version 1293908 (0.0009) [2023-12-28 04:33:29,879][106225] Updated weights for policy 1, policy_version 1297195 (0.0007) [2023-12-28 04:33:29,943][106225] Updated weights for policy 1, policy_version 1297205 (0.0009) [2023-12-28 04:33:30,009][106225] Updated weights for policy 1, policy_version 1297215 (0.0006) [2023-12-28 04:33:30,180][106226] Updated weights for policy 0, policy_version 1293918 (0.0009) [2023-12-28 04:33:30,242][106226] Updated weights for policy 0, policy_version 1293928 (0.0005) [2023-12-28 04:33:30,303][106226] Updated weights for policy 0, policy_version 1293938 (0.0009) [2023-12-28 04:33:30,607][106225] Updated weights for policy 1, policy_version 1297225 (0.0005) [2023-12-28 04:33:30,662][106225] Updated weights for policy 1, policy_version 1297235 (0.0005) [2023-12-28 04:33:30,718][106225] Updated weights for policy 1, policy_version 1297245 (0.0005) [2023-12-28 04:33:30,773][106225] Updated weights for policy 1, policy_version 1297255 (0.0005) [2023-12-28 04:33:30,943][106226] Updated weights for policy 0, policy_version 1293948 (0.0009) [2023-12-28 04:33:31,010][106226] Updated weights for policy 0, policy_version 1293958 (0.0008) [2023-12-28 04:33:31,078][106226] Updated weights for policy 0, policy_version 1293968 (0.0008) [2023-12-28 04:33:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 663461888. Throughput: 0: 9768.1, 1: 10199.4. Samples: 663446284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:31,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-5.074')] [2023-12-28 04:33:31,456][106225] Updated weights for policy 1, policy_version 1297265 (0.0008) [2023-12-28 04:33:31,508][106225] Updated weights for policy 1, policy_version 1297275 (0.0008) [2023-12-28 04:33:31,564][106225] Updated weights for policy 1, policy_version 1297286 (0.0007) [2023-12-28 04:33:31,792][106226] Updated weights for policy 0, policy_version 1293978 (0.0008) [2023-12-28 04:33:31,842][106226] Updated weights for policy 0, policy_version 1293988 (0.0008) [2023-12-28 04:33:31,895][106226] Updated weights for policy 0, policy_version 1293998 (0.0008) [2023-12-28 04:33:31,953][106226] Updated weights for policy 0, policy_version 1294008 (0.0008) [2023-12-28 04:33:32,306][106225] Updated weights for policy 1, policy_version 1297296 (0.0009) [2023-12-28 04:33:32,369][106225] Updated weights for policy 1, policy_version 1297306 (0.0006) [2023-12-28 04:33:32,437][106225] Updated weights for policy 1, policy_version 1297316 (0.0007) [2023-12-28 04:33:32,773][106226] Updated weights for policy 0, policy_version 1294018 (0.0008) [2023-12-28 04:33:32,840][106226] Updated weights for policy 0, policy_version 1294028 (0.0007) [2023-12-28 04:33:32,907][106226] Updated weights for policy 0, policy_version 1294038 (0.0008) [2023-12-28 04:33:33,031][106225] Updated weights for policy 1, policy_version 1297326 (0.0008) [2023-12-28 04:33:33,084][106225] Updated weights for policy 1, policy_version 1297336 (0.0005) [2023-12-28 04:33:33,135][106225] Updated weights for policy 1, policy_version 1297346 (0.0005) [2023-12-28 04:33:33,623][106226] Updated weights for policy 0, policy_version 1294048 (0.0010) [2023-12-28 04:33:33,680][106226] Updated weights for policy 0, policy_version 1294058 (0.0011) [2023-12-28 04:33:33,738][106226] Updated weights for policy 0, policy_version 1294068 (0.0011) [2023-12-28 04:33:33,756][106225] Updated weights for policy 1, policy_version 1297356 (0.0007) [2023-12-28 04:33:33,812][106225] Updated weights for policy 1, policy_version 1297366 (0.0008) [2023-12-28 04:33:33,879][106225] Updated weights for policy 1, policy_version 1297376 (0.0009) [2023-12-28 04:33:34,376][106226] Updated weights for policy 0, policy_version 1294078 (0.0009) [2023-12-28 04:33:34,431][106226] Updated weights for policy 0, policy_version 1294088 (0.0008) [2023-12-28 04:33:34,483][106226] Updated weights for policy 0, policy_version 1294098 (0.0008) [2023-12-28 04:33:34,529][106225] Updated weights for policy 1, policy_version 1297386 (0.0009) [2023-12-28 04:33:34,593][106225] Updated weights for policy 1, policy_version 1297396 (0.0010) [2023-12-28 04:33:34,664][106225] Updated weights for policy 1, policy_version 1297406 (0.0010) [2023-12-28 04:33:34,729][106225] Updated weights for policy 1, policy_version 1297416 (0.0009) [2023-12-28 04:33:35,123][106226] Updated weights for policy 0, policy_version 1294108 (0.0007) [2023-12-28 04:33:35,178][106226] Updated weights for policy 0, policy_version 1294118 (0.0009) [2023-12-28 04:33:35,243][106226] Updated weights for policy 0, policy_version 1294128 (0.0009) [2023-12-28 04:33:35,446][106225] Updated weights for policy 1, policy_version 1297426 (0.0008) [2023-12-28 04:33:35,501][106225] Updated weights for policy 1, policy_version 1297436 (0.0008) [2023-12-28 04:33:35,553][106225] Updated weights for policy 1, policy_version 1297446 (0.0008) [2023-12-28 04:33:35,955][106226] Updated weights for policy 0, policy_version 1294138 (0.0009) [2023-12-28 04:33:36,014][106226] Updated weights for policy 0, policy_version 1294148 (0.0005) [2023-12-28 04:33:36,068][106226] Updated weights for policy 0, policy_version 1294158 (0.0007) [2023-12-28 04:33:36,133][106226] Updated weights for policy 0, policy_version 1294168 (0.0008) [2023-12-28 04:33:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 663560192. Throughput: 0: 9776.4, 1: 10223.8. Samples: 663567664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:36,178][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.820')] [2023-12-28 04:33:36,299][106225] Updated weights for policy 1, policy_version 1297456 (0.0006) [2023-12-28 04:33:36,358][106225] Updated weights for policy 1, policy_version 1297466 (0.0006) [2023-12-28 04:33:36,423][106225] Updated weights for policy 1, policy_version 1297476 (0.0005) [2023-12-28 04:33:36,846][106226] Updated weights for policy 0, policy_version 1294178 (0.0008) [2023-12-28 04:33:36,900][106226] Updated weights for policy 0, policy_version 1294188 (0.0008) [2023-12-28 04:33:36,962][106226] Updated weights for policy 0, policy_version 1294198 (0.0008) [2023-12-28 04:33:37,087][106225] Updated weights for policy 1, policy_version 1297486 (0.0005) [2023-12-28 04:33:37,146][106225] Updated weights for policy 1, policy_version 1297496 (0.0005) [2023-12-28 04:33:37,196][106225] Updated weights for policy 1, policy_version 1297506 (0.0006) [2023-12-28 04:33:37,763][106226] Updated weights for policy 0, policy_version 1294208 (0.0009) [2023-12-28 04:33:37,815][106225] Updated weights for policy 1, policy_version 1297516 (0.0010) [2023-12-28 04:33:37,821][106226] Updated weights for policy 0, policy_version 1294218 (0.0007) [2023-12-28 04:33:37,874][106225] Updated weights for policy 1, policy_version 1297526 (0.0010) [2023-12-28 04:33:37,880][106226] Updated weights for policy 0, policy_version 1294228 (0.0007) [2023-12-28 04:33:37,935][106225] Updated weights for policy 1, policy_version 1297536 (0.0010) [2023-12-28 04:33:38,609][106226] Updated weights for policy 0, policy_version 1294238 (0.0007) [2023-12-28 04:33:38,621][106225] Updated weights for policy 1, policy_version 1297546 (0.0010) [2023-12-28 04:33:38,671][106226] Updated weights for policy 0, policy_version 1294248 (0.0006) [2023-12-28 04:33:38,675][106225] Updated weights for policy 1, policy_version 1297556 (0.0010) [2023-12-28 04:33:38,730][106226] Updated weights for policy 0, policy_version 1294258 (0.0006) [2023-12-28 04:33:38,734][106225] Updated weights for policy 1, policy_version 1297566 (0.0010) [2023-12-28 04:33:38,792][106225] Updated weights for policy 1, policy_version 1297576 (0.0010) [2023-12-28 04:33:39,393][106226] Updated weights for policy 0, policy_version 1294268 (0.0007) [2023-12-28 04:33:39,464][106226] Updated weights for policy 0, policy_version 1294278 (0.0007) [2023-12-28 04:33:39,525][106226] Updated weights for policy 0, policy_version 1294288 (0.0008) [2023-12-28 04:33:39,529][106225] Updated weights for policy 1, policy_version 1297586 (0.0006) [2023-12-28 04:33:39,593][106225] Updated weights for policy 1, policy_version 1297596 (0.0007) [2023-12-28 04:33:39,645][106225] Updated weights for policy 1, policy_version 1297606 (0.0008) [2023-12-28 04:33:40,292][106225] Updated weights for policy 1, policy_version 1297616 (0.0008) [2023-12-28 04:33:40,346][106225] Updated weights for policy 1, policy_version 1297626 (0.0007) [2023-12-28 04:33:40,379][106226] Updated weights for policy 0, policy_version 1294298 (0.0008) [2023-12-28 04:33:40,399][106225] Updated weights for policy 1, policy_version 1297636 (0.0006) [2023-12-28 04:33:40,426][106226] Updated weights for policy 0, policy_version 1294308 (0.0008) [2023-12-28 04:33:40,480][106226] Updated weights for policy 0, policy_version 1294318 (0.0009) [2023-12-28 04:33:40,531][106226] Updated weights for policy 0, policy_version 1294328 (0.0009) [2023-12-28 04:33:40,976][106225] Updated weights for policy 1, policy_version 1297646 (0.0005) [2023-12-28 04:33:41,037][106225] Updated weights for policy 1, policy_version 1297656 (0.0006) [2023-12-28 04:33:41,100][106225] Updated weights for policy 1, policy_version 1297666 (0.0008) [2023-12-28 04:33:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 663658496. Throughput: 0: 9784.1, 1: 10251.5. Samples: 663627292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:41,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-5.091')] [2023-12-28 04:33:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001297672_332251136.pth... [2023-12-28 04:33:41,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001294328_331407360.pth... [2023-12-28 04:33:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001296456_331939840.pth [2023-12-28 04:33:41,190][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001297672_332251136.pth [2023-12-28 04:33:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001293208_331120640.pth [2023-12-28 04:33:41,191][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001294328_331407360.pth [2023-12-28 04:33:41,398][106226] Updated weights for policy 0, policy_version 1294338 (0.0009) [2023-12-28 04:33:41,464][106226] Updated weights for policy 0, policy_version 1294348 (0.0009) [2023-12-28 04:33:41,531][106226] Updated weights for policy 0, policy_version 1294358 (0.0009) [2023-12-28 04:33:41,847][106225] Updated weights for policy 1, policy_version 1297676 (0.0008) [2023-12-28 04:33:41,910][106225] Updated weights for policy 1, policy_version 1297686 (0.0008) [2023-12-28 04:33:41,969][106225] Updated weights for policy 1, policy_version 1297696 (0.0008) [2023-12-28 04:33:42,326][106226] Updated weights for policy 0, policy_version 1294368 (0.0008) [2023-12-28 04:33:42,396][106226] Updated weights for policy 0, policy_version 1294378 (0.0008) [2023-12-28 04:33:42,447][106226] Updated weights for policy 0, policy_version 1294388 (0.0009) [2023-12-28 04:33:42,748][106225] Updated weights for policy 1, policy_version 1297706 (0.0008) [2023-12-28 04:33:42,807][106225] Updated weights for policy 1, policy_version 1297716 (0.0008) [2023-12-28 04:33:42,867][106225] Updated weights for policy 1, policy_version 1297726 (0.0008) [2023-12-28 04:33:42,916][106225] Updated weights for policy 1, policy_version 1297736 (0.0008) [2023-12-28 04:33:43,213][106226] Updated weights for policy 0, policy_version 1294398 (0.0009) [2023-12-28 04:33:43,265][106226] Updated weights for policy 0, policy_version 1294408 (0.0009) [2023-12-28 04:33:43,314][106226] Updated weights for policy 0, policy_version 1294418 (0.0007) [2023-12-28 04:33:43,493][106225] Updated weights for policy 1, policy_version 1297746 (0.0005) [2023-12-28 04:33:43,543][106225] Updated weights for policy 1, policy_version 1297756 (0.0005) [2023-12-28 04:33:43,609][106225] Updated weights for policy 1, policy_version 1297766 (0.0007) [2023-12-28 04:33:43,923][106226] Updated weights for policy 0, policy_version 1294428 (0.0009) [2023-12-28 04:33:43,981][106226] Updated weights for policy 0, policy_version 1294438 (0.0005) [2023-12-28 04:33:44,045][106226] Updated weights for policy 0, policy_version 1294448 (0.0005) [2023-12-28 04:33:44,351][106225] Updated weights for policy 1, policy_version 1297776 (0.0008) [2023-12-28 04:33:44,411][106225] Updated weights for policy 1, policy_version 1297786 (0.0007) [2023-12-28 04:33:44,471][106225] Updated weights for policy 1, policy_version 1297796 (0.0008) [2023-12-28 04:33:44,613][106226] Updated weights for policy 0, policy_version 1294458 (0.0006) [2023-12-28 04:33:44,675][106226] Updated weights for policy 0, policy_version 1294468 (0.0010) [2023-12-28 04:33:44,731][106226] Updated weights for policy 0, policy_version 1294478 (0.0010) [2023-12-28 04:33:44,794][106226] Updated weights for policy 0, policy_version 1294488 (0.0009) [2023-12-28 04:33:45,254][106225] Updated weights for policy 1, policy_version 1297806 (0.0009) [2023-12-28 04:33:45,316][106225] Updated weights for policy 1, policy_version 1297816 (0.0008) [2023-12-28 04:33:45,375][106225] Updated weights for policy 1, policy_version 1297826 (0.0008) [2023-12-28 04:33:45,445][106226] Updated weights for policy 0, policy_version 1294498 (0.0006) [2023-12-28 04:33:45,498][106226] Updated weights for policy 0, policy_version 1294508 (0.0010) [2023-12-28 04:33:45,559][106226] Updated weights for policy 0, policy_version 1294518 (0.0011) [2023-12-28 04:33:46,113][106225] Updated weights for policy 1, policy_version 1297836 (0.0008) [2023-12-28 04:33:46,163][106225] Updated weights for policy 1, policy_version 1297846 (0.0007) [2023-12-28 04:33:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 663748608. Throughput: 0: 9768.0, 1: 10190.0. Samples: 663744800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:46,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.837')] [2023-12-28 04:33:46,224][106225] Updated weights for policy 1, policy_version 1297856 (0.0008) [2023-12-28 04:33:46,256][106226] Updated weights for policy 0, policy_version 1294528 (0.0011) [2023-12-28 04:33:46,318][106226] Updated weights for policy 0, policy_version 1294538 (0.0011) [2023-12-28 04:33:46,380][106226] Updated weights for policy 0, policy_version 1294548 (0.0010) [2023-12-28 04:33:46,822][106225] Updated weights for policy 1, policy_version 1297866 (0.0005) [2023-12-28 04:33:46,876][106225] Updated weights for policy 1, policy_version 1297876 (0.0005) [2023-12-28 04:33:46,933][106225] Updated weights for policy 1, policy_version 1297886 (0.0005) [2023-12-28 04:33:46,983][106225] Updated weights for policy 1, policy_version 1297896 (0.0005) [2023-12-28 04:33:47,074][106226] Updated weights for policy 0, policy_version 1294558 (0.0011) [2023-12-28 04:33:47,120][106226] Updated weights for policy 0, policy_version 1294568 (0.0010) [2023-12-28 04:33:47,169][106226] Updated weights for policy 0, policy_version 1294578 (0.0010) [2023-12-28 04:33:47,614][106225] Updated weights for policy 1, policy_version 1297906 (0.0005) [2023-12-28 04:33:47,666][106225] Updated weights for policy 1, policy_version 1297916 (0.0005) [2023-12-28 04:33:47,721][106225] Updated weights for policy 1, policy_version 1297926 (0.0006) [2023-12-28 04:33:47,886][106226] Updated weights for policy 0, policy_version 1294588 (0.0008) [2023-12-28 04:33:47,946][106226] Updated weights for policy 0, policy_version 1294598 (0.0006) [2023-12-28 04:33:48,018][106226] Updated weights for policy 0, policy_version 1294608 (0.0007) [2023-12-28 04:33:48,417][106225] Updated weights for policy 1, policy_version 1297936 (0.0009) [2023-12-28 04:33:48,482][106225] Updated weights for policy 1, policy_version 1297946 (0.0007) [2023-12-28 04:33:48,546][106225] Updated weights for policy 1, policy_version 1297956 (0.0008) [2023-12-28 04:33:48,654][106226] Updated weights for policy 0, policy_version 1294618 (0.0006) [2023-12-28 04:33:48,724][106226] Updated weights for policy 0, policy_version 1294628 (0.0007) [2023-12-28 04:33:48,784][106226] Updated weights for policy 0, policy_version 1294638 (0.0006) [2023-12-28 04:33:48,845][106226] Updated weights for policy 0, policy_version 1294648 (0.0008) [2023-12-28 04:33:49,227][106225] Updated weights for policy 1, policy_version 1297966 (0.0008) [2023-12-28 04:33:49,283][106225] Updated weights for policy 1, policy_version 1297976 (0.0008) [2023-12-28 04:33:49,342][106225] Updated weights for policy 1, policy_version 1297986 (0.0008) [2023-12-28 04:33:49,538][106226] Updated weights for policy 0, policy_version 1294658 (0.0011) [2023-12-28 04:33:49,602][106226] Updated weights for policy 0, policy_version 1294668 (0.0011) [2023-12-28 04:33:49,666][106226] Updated weights for policy 0, policy_version 1294678 (0.0011) [2023-12-28 04:33:50,039][106225] Updated weights for policy 1, policy_version 1297996 (0.0009) [2023-12-28 04:33:50,100][106225] Updated weights for policy 1, policy_version 1298006 (0.0011) [2023-12-28 04:33:50,160][106225] Updated weights for policy 1, policy_version 1298016 (0.0010) [2023-12-28 04:33:50,380][106226] Updated weights for policy 0, policy_version 1294688 (0.0008) [2023-12-28 04:33:50,440][106226] Updated weights for policy 0, policy_version 1294698 (0.0007) [2023-12-28 04:33:50,499][106226] Updated weights for policy 0, policy_version 1294708 (0.0010) [2023-12-28 04:33:50,880][106225] Updated weights for policy 1, policy_version 1298026 (0.0009) [2023-12-28 04:33:50,934][106225] Updated weights for policy 1, policy_version 1298036 (0.0010) [2023-12-28 04:33:50,988][106225] Updated weights for policy 1, policy_version 1298046 (0.0010) [2023-12-28 04:33:51,047][106225] Updated weights for policy 1, policy_version 1298056 (0.0009) [2023-12-28 04:33:51,155][106226] Updated weights for policy 0, policy_version 1294718 (0.0009) [2023-12-28 04:33:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 663855104. Throughput: 0: 9766.6, 1: 10173.3. Samples: 663865188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:51,175][105115] Avg episode reward: [(0, '-4.032'), (1, '-5.060')] [2023-12-28 04:33:51,218][106226] Updated weights for policy 0, policy_version 1294728 (0.0007) [2023-12-28 04:33:51,287][106226] Updated weights for policy 0, policy_version 1294738 (0.0007) [2023-12-28 04:33:51,857][106225] Updated weights for policy 1, policy_version 1298066 (0.0009) [2023-12-28 04:33:51,920][106225] Updated weights for policy 1, policy_version 1298076 (0.0008) [2023-12-28 04:33:51,978][106226] Updated weights for policy 0, policy_version 1294748 (0.0006) [2023-12-28 04:33:51,980][106225] Updated weights for policy 1, policy_version 1298086 (0.0009) [2023-12-28 04:33:52,039][106226] Updated weights for policy 0, policy_version 1294758 (0.0006) [2023-12-28 04:33:52,098][106226] Updated weights for policy 0, policy_version 1294768 (0.0007) [2023-12-28 04:33:52,751][106226] Updated weights for policy 0, policy_version 1294778 (0.0008) [2023-12-28 04:33:52,799][106225] Updated weights for policy 1, policy_version 1298096 (0.0008) [2023-12-28 04:33:52,812][106226] Updated weights for policy 0, policy_version 1294788 (0.0007) [2023-12-28 04:33:52,852][106225] Updated weights for policy 1, policy_version 1298106 (0.0008) [2023-12-28 04:33:52,870][106226] Updated weights for policy 0, policy_version 1294798 (0.0009) [2023-12-28 04:33:52,907][106225] Updated weights for policy 1, policy_version 1298116 (0.0006) [2023-12-28 04:33:52,931][106226] Updated weights for policy 0, policy_version 1294808 (0.0007) [2023-12-28 04:33:53,569][106225] Updated weights for policy 1, policy_version 1298126 (0.0008) [2023-12-28 04:33:53,575][106226] Updated weights for policy 0, policy_version 1294818 (0.0007) [2023-12-28 04:33:53,623][106225] Updated weights for policy 1, policy_version 1298136 (0.0006) [2023-12-28 04:33:53,632][106226] Updated weights for policy 0, policy_version 1294828 (0.0010) [2023-12-28 04:33:53,686][106225] Updated weights for policy 1, policy_version 1298146 (0.0007) [2023-12-28 04:33:53,690][106226] Updated weights for policy 0, policy_version 1294838 (0.0006) [2023-12-28 04:33:54,240][106226] Updated weights for policy 0, policy_version 1294848 (0.0005) [2023-12-28 04:33:54,288][106226] Updated weights for policy 0, policy_version 1294858 (0.0005) [2023-12-28 04:33:54,334][106225] Updated weights for policy 1, policy_version 1298156 (0.0010) [2023-12-28 04:33:54,336][106226] Updated weights for policy 0, policy_version 1294868 (0.0005) [2023-12-28 04:33:54,388][106225] Updated weights for policy 1, policy_version 1298166 (0.0010) [2023-12-28 04:33:54,438][106225] Updated weights for policy 1, policy_version 1298176 (0.0010) [2023-12-28 04:33:55,007][106226] Updated weights for policy 0, policy_version 1294878 (0.0009) [2023-12-28 04:33:55,062][106226] Updated weights for policy 0, policy_version 1294888 (0.0011) [2023-12-28 04:33:55,119][106226] Updated weights for policy 0, policy_version 1294898 (0.0011) [2023-12-28 04:33:55,148][106225] Updated weights for policy 1, policy_version 1298186 (0.0009) [2023-12-28 04:33:55,210][106225] Updated weights for policy 1, policy_version 1298196 (0.0005) [2023-12-28 04:33:55,270][106225] Updated weights for policy 1, policy_version 1298206 (0.0006) [2023-12-28 04:33:55,318][106225] Updated weights for policy 1, policy_version 1298216 (0.0006) [2023-12-28 04:33:55,826][106226] Updated weights for policy 0, policy_version 1294908 (0.0011) [2023-12-28 04:33:55,881][106225] Updated weights for policy 1, policy_version 1298226 (0.0005) [2023-12-28 04:33:55,889][106226] Updated weights for policy 0, policy_version 1294918 (0.0011) [2023-12-28 04:33:55,945][106225] Updated weights for policy 1, policy_version 1298236 (0.0007) [2023-12-28 04:33:55,952][106226] Updated weights for policy 0, policy_version 1294928 (0.0011) [2023-12-28 04:33:56,012][106225] Updated weights for policy 1, policy_version 1298246 (0.0008) [2023-12-28 04:33:56,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 663961600. Throughput: 0: 9810.1, 1: 10110.7. Samples: 663924492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:33:56,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.853')] [2023-12-28 04:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001294936_331563008.pth... [2023-12-28 04:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001298248_332398592.pth... [2023-12-28 04:33:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001293784_331268096.pth [2023-12-28 04:33:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001297064_332095488.pth [2023-12-28 04:33:56,650][106226] Updated weights for policy 0, policy_version 1294938 (0.0010) [2023-12-28 04:33:56,682][106225] Updated weights for policy 1, policy_version 1298256 (0.0006) [2023-12-28 04:33:56,694][106226] Updated weights for policy 0, policy_version 1294948 (0.0010) [2023-12-28 04:33:56,728][106225] Updated weights for policy 1, policy_version 1298266 (0.0005) [2023-12-28 04:33:56,740][106226] Updated weights for policy 0, policy_version 1294958 (0.0010) [2023-12-28 04:33:56,780][106225] Updated weights for policy 1, policy_version 1298276 (0.0005) [2023-12-28 04:33:56,785][106226] Updated weights for policy 0, policy_version 1294968 (0.0010) [2023-12-28 04:33:57,423][106225] Updated weights for policy 1, policy_version 1298286 (0.0008) [2023-12-28 04:33:57,469][106225] Updated weights for policy 1, policy_version 1298296 (0.0007) [2023-12-28 04:33:57,519][106225] Updated weights for policy 1, policy_version 1298306 (0.0008) [2023-12-28 04:33:57,529][106226] Updated weights for policy 0, policy_version 1294978 (0.0010) [2023-12-28 04:33:57,577][106226] Updated weights for policy 0, policy_version 1294988 (0.0010) [2023-12-28 04:33:57,626][106226] Updated weights for policy 0, policy_version 1294998 (0.0010) [2023-12-28 04:33:58,262][106225] Updated weights for policy 1, policy_version 1298316 (0.0007) [2023-12-28 04:33:58,316][106225] Updated weights for policy 1, policy_version 1298326 (0.0009) [2023-12-28 04:33:58,362][106226] Updated weights for policy 0, policy_version 1295008 (0.0009) [2023-12-28 04:33:58,391][106225] Updated weights for policy 1, policy_version 1298336 (0.0008) [2023-12-28 04:33:58,431][106226] Updated weights for policy 0, policy_version 1295018 (0.0010) [2023-12-28 04:33:58,500][106226] Updated weights for policy 0, policy_version 1295028 (0.0010) [2023-12-28 04:33:59,162][106225] Updated weights for policy 1, policy_version 1298346 (0.0007) [2023-12-28 04:33:59,228][106225] Updated weights for policy 1, policy_version 1298356 (0.0008) [2023-12-28 04:33:59,290][106225] Updated weights for policy 1, policy_version 1298366 (0.0008) [2023-12-28 04:33:59,344][106226] Updated weights for policy 0, policy_version 1295038 (0.0008) [2023-12-28 04:33:59,361][106225] Updated weights for policy 1, policy_version 1298376 (0.0008) [2023-12-28 04:33:59,419][106226] Updated weights for policy 0, policy_version 1295048 (0.0008) [2023-12-28 04:33:59,477][106226] Updated weights for policy 0, policy_version 1295058 (0.0006) [2023-12-28 04:34:00,035][106225] Updated weights for policy 1, policy_version 1298386 (0.0008) [2023-12-28 04:34:00,089][106225] Updated weights for policy 1, policy_version 1298396 (0.0007) [2023-12-28 04:34:00,149][106225] Updated weights for policy 1, policy_version 1298406 (0.0010) [2023-12-28 04:34:00,206][106226] Updated weights for policy 0, policy_version 1295068 (0.0007) [2023-12-28 04:34:00,267][106226] Updated weights for policy 0, policy_version 1295078 (0.0008) [2023-12-28 04:34:00,325][106226] Updated weights for policy 0, policy_version 1295088 (0.0007) [2023-12-28 04:34:00,776][106225] Updated weights for policy 1, policy_version 1298416 (0.0006) [2023-12-28 04:34:00,812][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000010 [2023-12-28 04:34:00,961][106226] Updated weights for policy 0, policy_version 1295098 (0.0008) [2023-12-28 04:34:01,018][106226] Updated weights for policy 0, policy_version 1295108 (0.0007) [2023-12-28 04:34:01,080][106226] Updated weights for policy 0, policy_version 1295118 (0.0008) [2023-12-28 04:34:01,138][106226] Updated weights for policy 0, policy_version 1295128 (0.0008) [2023-12-28 04:34:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 664059904. Throughput: 0: 9800.7, 1: 10154.9. Samples: 664043260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:01,175][105115] Avg episode reward: [(0, '-4.055'), (1, '-5.083')] [2023-12-28 04:34:01,566][106225] Updated weights for policy 1, policy_version 1298426 (0.0006) [2023-12-28 04:34:01,640][106225] Updated weights for policy 1, policy_version 1298436 (0.0008) [2023-12-28 04:34:01,707][106225] Updated weights for policy 1, policy_version 1298446 (0.0008) [2023-12-28 04:34:01,775][106225] Updated weights for policy 1, policy_version 1298456 (0.0009) [2023-12-28 04:34:01,862][106226] Updated weights for policy 0, policy_version 1295138 (0.0009) [2023-12-28 04:34:01,914][106226] Updated weights for policy 0, policy_version 1295148 (0.0009) [2023-12-28 04:34:01,970][106226] Updated weights for policy 0, policy_version 1295158 (0.0009) [2023-12-28 04:34:02,379][106225] Updated weights for policy 1, policy_version 1298466 (0.0007) [2023-12-28 04:34:02,447][106225] Updated weights for policy 1, policy_version 1298476 (0.0005) [2023-12-28 04:34:02,507][106225] Updated weights for policy 1, policy_version 1298486 (0.0007) [2023-12-28 04:34:02,616][106226] Updated weights for policy 0, policy_version 1295168 (0.0008) [2023-12-28 04:34:02,675][106226] Updated weights for policy 0, policy_version 1295178 (0.0009) [2023-12-28 04:34:02,731][106226] Updated weights for policy 0, policy_version 1295189 (0.0009) [2023-12-28 04:34:03,072][106225] Updated weights for policy 1, policy_version 1298496 (0.0006) [2023-12-28 04:34:03,126][106225] Updated weights for policy 1, policy_version 1298506 (0.0010) [2023-12-28 04:34:03,172][106225] Updated weights for policy 1, policy_version 1298516 (0.0006) [2023-12-28 04:34:03,394][106226] Updated weights for policy 0, policy_version 1295199 (0.0006) [2023-12-28 04:34:03,446][106226] Updated weights for policy 0, policy_version 1295209 (0.0005) [2023-12-28 04:34:03,507][106226] Updated weights for policy 0, policy_version 1295219 (0.0005) [2023-12-28 04:34:03,798][106225] Updated weights for policy 1, policy_version 1298526 (0.0008) [2023-12-28 04:34:03,861][106225] Updated weights for policy 1, policy_version 1298536 (0.0010) [2023-12-28 04:34:03,918][106225] Updated weights for policy 1, policy_version 1298546 (0.0008) [2023-12-28 04:34:04,172][106226] Updated weights for policy 0, policy_version 1295229 (0.0008) [2023-12-28 04:34:04,243][106226] Updated weights for policy 0, policy_version 1295239 (0.0009) [2023-12-28 04:34:04,315][106226] Updated weights for policy 0, policy_version 1295249 (0.0010) [2023-12-28 04:34:04,563][106225] Updated weights for policy 1, policy_version 1298556 (0.0008) [2023-12-28 04:34:04,632][106225] Updated weights for policy 1, policy_version 1298566 (0.0009) [2023-12-28 04:34:04,699][106225] Updated weights for policy 1, policy_version 1298576 (0.0009) [2023-12-28 04:34:05,017][106226] Updated weights for policy 0, policy_version 1295259 (0.0008) [2023-12-28 04:34:05,082][106226] Updated weights for policy 0, policy_version 1295269 (0.0006) [2023-12-28 04:34:05,131][106226] Updated weights for policy 0, policy_version 1295279 (0.0007) [2023-12-28 04:34:05,297][106225] Updated weights for policy 1, policy_version 1298586 (0.0008) [2023-12-28 04:34:05,356][106225] Updated weights for policy 1, policy_version 1298596 (0.0008) [2023-12-28 04:34:05,405][106225] Updated weights for policy 1, policy_version 1298606 (0.0008) [2023-12-28 04:34:05,456][106225] Updated weights for policy 1, policy_version 1298616 (0.0008) [2023-12-28 04:34:05,848][106226] Updated weights for policy 0, policy_version 1295289 (0.0009) [2023-12-28 04:34:05,908][106226] Updated weights for policy 0, policy_version 1295299 (0.0009) [2023-12-28 04:34:05,963][106226] Updated weights for policy 0, policy_version 1295309 (0.0008) [2023-12-28 04:34:06,015][106226] Updated weights for policy 0, policy_version 1295319 (0.0009) [2023-12-28 04:34:06,143][106225] Updated weights for policy 1, policy_version 1298626 (0.0008) [2023-12-28 04:34:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 664158208. Throughput: 0: 9827.6, 1: 10278.4. Samples: 664168160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:06,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-4.982')] [2023-12-28 04:34:06,200][106225] Updated weights for policy 1, policy_version 1298636 (0.0009) [2023-12-28 04:34:06,264][106225] Updated weights for policy 1, policy_version 1298646 (0.0010) [2023-12-28 04:34:06,776][106226] Updated weights for policy 0, policy_version 1295329 (0.0010) [2023-12-28 04:34:06,843][106226] Updated weights for policy 0, policy_version 1295339 (0.0011) [2023-12-28 04:34:06,913][106226] Updated weights for policy 0, policy_version 1295349 (0.0006) [2023-12-28 04:34:06,968][106225] Updated weights for policy 1, policy_version 1298656 (0.0011) [2023-12-28 04:34:07,028][106225] Updated weights for policy 1, policy_version 1298666 (0.0010) [2023-12-28 04:34:07,085][106225] Updated weights for policy 1, policy_version 1298676 (0.0009) [2023-12-28 04:34:07,427][106226] Updated weights for policy 0, policy_version 1295359 (0.0006) [2023-12-28 04:34:07,480][106226] Updated weights for policy 0, policy_version 1295369 (0.0008) [2023-12-28 04:34:07,537][106226] Updated weights for policy 0, policy_version 1295379 (0.0011) [2023-12-28 04:34:07,805][106225] Updated weights for policy 1, policy_version 1298686 (0.0008) [2023-12-28 04:34:07,855][106225] Updated weights for policy 1, policy_version 1298696 (0.0008) [2023-12-28 04:34:07,911][106225] Updated weights for policy 1, policy_version 1298706 (0.0007) [2023-12-28 04:34:08,233][106226] Updated weights for policy 0, policy_version 1295389 (0.0009) [2023-12-28 04:34:08,280][106226] Updated weights for policy 0, policy_version 1295399 (0.0008) [2023-12-28 04:34:08,334][106226] Updated weights for policy 0, policy_version 1295409 (0.0008) [2023-12-28 04:34:08,653][106225] Updated weights for policy 1, policy_version 1298716 (0.0008) [2023-12-28 04:34:08,717][106225] Updated weights for policy 1, policy_version 1298726 (0.0011) [2023-12-28 04:34:08,782][106225] Updated weights for policy 1, policy_version 1298736 (0.0010) [2023-12-28 04:34:09,043][106226] Updated weights for policy 0, policy_version 1295419 (0.0008) [2023-12-28 04:34:09,098][106226] Updated weights for policy 0, policy_version 1295429 (0.0010) [2023-12-28 04:34:09,154][106226] Updated weights for policy 0, policy_version 1295439 (0.0006) [2023-12-28 04:34:09,429][106225] Updated weights for policy 1, policy_version 1298746 (0.0010) [2023-12-28 04:34:09,491][106225] Updated weights for policy 1, policy_version 1298756 (0.0008) [2023-12-28 04:34:09,552][106225] Updated weights for policy 1, policy_version 1298766 (0.0008) [2023-12-28 04:34:09,613][106225] Updated weights for policy 1, policy_version 1298776 (0.0007) [2023-12-28 04:34:09,907][106226] Updated weights for policy 0, policy_version 1295449 (0.0008) [2023-12-28 04:34:09,973][106226] Updated weights for policy 0, policy_version 1295459 (0.0008) [2023-12-28 04:34:10,042][106226] Updated weights for policy 0, policy_version 1295469 (0.0009) [2023-12-28 04:34:10,109][106226] Updated weights for policy 0, policy_version 1295479 (0.0010) [2023-12-28 04:34:10,256][106225] Updated weights for policy 1, policy_version 1298786 (0.0009) [2023-12-28 04:34:10,322][106225] Updated weights for policy 1, policy_version 1298796 (0.0008) [2023-12-28 04:34:10,379][106225] Updated weights for policy 1, policy_version 1298806 (0.0009) [2023-12-28 04:34:10,817][106226] Updated weights for policy 0, policy_version 1295489 (0.0006) [2023-12-28 04:34:10,880][106226] Updated weights for policy 0, policy_version 1295499 (0.0008) [2023-12-28 04:34:10,954][106226] Updated weights for policy 0, policy_version 1295509 (0.0009) [2023-12-28 04:34:11,076][106225] Updated weights for policy 1, policy_version 1298816 (0.0008) [2023-12-28 04:34:11,139][106225] Updated weights for policy 1, policy_version 1298826 (0.0008) [2023-12-28 04:34:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 664256512. Throughput: 0: 9870.1, 1: 10261.2. Samples: 664228864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:11,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.798')] [2023-12-28 04:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001295512_331710464.pth... [2023-12-28 04:34:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001294328_331407360.pth [2023-12-28 04:34:11,207][106225] Updated weights for policy 1, policy_version 1298836 (0.0008) [2023-12-28 04:34:11,236][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001298840_332554240.pth... [2023-12-28 04:34:11,241][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001297672_332251136.pth [2023-12-28 04:34:11,722][106226] Updated weights for policy 0, policy_version 1295519 (0.0007) [2023-12-28 04:34:11,791][106226] Updated weights for policy 0, policy_version 1295529 (0.0007) [2023-12-28 04:34:11,853][106226] Updated weights for policy 0, policy_version 1295539 (0.0008) [2023-12-28 04:34:12,004][106225] Updated weights for policy 1, policy_version 1298846 (0.0009) [2023-12-28 04:34:12,066][106225] Updated weights for policy 1, policy_version 1298856 (0.0011) [2023-12-28 04:34:12,128][106225] Updated weights for policy 1, policy_version 1298866 (0.0010) [2023-12-28 04:34:12,626][106226] Updated weights for policy 0, policy_version 1295549 (0.0008) [2023-12-28 04:34:12,686][106226] Updated weights for policy 0, policy_version 1295559 (0.0008) [2023-12-28 04:34:12,749][106226] Updated weights for policy 0, policy_version 1295569 (0.0008) [2023-12-28 04:34:12,869][106225] Updated weights for policy 1, policy_version 1298876 (0.0010) [2023-12-28 04:34:12,928][106225] Updated weights for policy 1, policy_version 1298886 (0.0010) [2023-12-28 04:34:12,993][106225] Updated weights for policy 1, policy_version 1298896 (0.0010) [2023-12-28 04:34:13,460][106226] Updated weights for policy 0, policy_version 1295579 (0.0009) [2023-12-28 04:34:13,516][106226] Updated weights for policy 0, policy_version 1295589 (0.0010) [2023-12-28 04:34:13,572][106226] Updated weights for policy 0, policy_version 1295599 (0.0010) [2023-12-28 04:34:13,705][106225] Updated weights for policy 1, policy_version 1298906 (0.0010) [2023-12-28 04:34:13,770][106225] Updated weights for policy 1, policy_version 1298916 (0.0010) [2023-12-28 04:34:13,833][106225] Updated weights for policy 1, policy_version 1298926 (0.0010) [2023-12-28 04:34:13,892][106225] Updated weights for policy 1, policy_version 1298936 (0.0010) [2023-12-28 04:34:14,264][106226] Updated weights for policy 0, policy_version 1295609 (0.0010) [2023-12-28 04:34:14,316][106226] Updated weights for policy 0, policy_version 1295619 (0.0005) [2023-12-28 04:34:14,375][106226] Updated weights for policy 0, policy_version 1295629 (0.0005) [2023-12-28 04:34:14,440][106226] Updated weights for policy 0, policy_version 1295639 (0.0009) [2023-12-28 04:34:14,578][106225] Updated weights for policy 1, policy_version 1298946 (0.0005) [2023-12-28 04:34:14,622][106225] Updated weights for policy 1, policy_version 1298956 (0.0005) [2023-12-28 04:34:14,672][106225] Updated weights for policy 1, policy_version 1298966 (0.0009) [2023-12-28 04:34:15,130][106226] Updated weights for policy 0, policy_version 1295649 (0.0011) [2023-12-28 04:34:15,193][106226] Updated weights for policy 0, policy_version 1295659 (0.0011) [2023-12-28 04:34:15,255][106226] Updated weights for policy 0, policy_version 1295669 (0.0011) [2023-12-28 04:34:15,368][106225] Updated weights for policy 1, policy_version 1298976 (0.0007) [2023-12-28 04:34:15,424][106225] Updated weights for policy 1, policy_version 1298986 (0.0006) [2023-12-28 04:34:15,492][106225] Updated weights for policy 1, policy_version 1298996 (0.0005) [2023-12-28 04:34:15,969][106226] Updated weights for policy 0, policy_version 1295679 (0.0008) [2023-12-28 04:34:16,027][106226] Updated weights for policy 0, policy_version 1295689 (0.0009) [2023-12-28 04:34:16,084][106226] Updated weights for policy 0, policy_version 1295699 (0.0010) [2023-12-28 04:34:16,106][106225] Updated weights for policy 1, policy_version 1299006 (0.0009) [2023-12-28 04:34:16,170][106225] Updated weights for policy 1, policy_version 1299016 (0.0010) [2023-12-28 04:34:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 664354816. Throughput: 0: 9866.9, 1: 10088.5. Samples: 664344280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:16,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-5.181')] [2023-12-28 04:34:16,229][106225] Updated weights for policy 1, policy_version 1299026 (0.0010) [2023-12-28 04:34:16,773][106226] Updated weights for policy 0, policy_version 1295709 (0.0010) [2023-12-28 04:34:16,828][106226] Updated weights for policy 0, policy_version 1295719 (0.0008) [2023-12-28 04:34:16,875][106226] Updated weights for policy 0, policy_version 1295729 (0.0008) [2023-12-28 04:34:16,888][106225] Updated weights for policy 1, policy_version 1299036 (0.0008) [2023-12-28 04:34:16,934][106225] Updated weights for policy 1, policy_version 1299046 (0.0005) [2023-12-28 04:34:16,996][106225] Updated weights for policy 1, policy_version 1299056 (0.0005) [2023-12-28 04:34:17,542][106225] Updated weights for policy 1, policy_version 1299066 (0.0006) [2023-12-28 04:34:17,544][106226] Updated weights for policy 0, policy_version 1295739 (0.0008) [2023-12-28 04:34:17,597][106225] Updated weights for policy 1, policy_version 1299076 (0.0007) [2023-12-28 04:34:17,606][106226] Updated weights for policy 0, policy_version 1295749 (0.0007) [2023-12-28 04:34:17,650][106225] Updated weights for policy 1, policy_version 1299086 (0.0007) [2023-12-28 04:34:17,663][106226] Updated weights for policy 0, policy_version 1295759 (0.0006) [2023-12-28 04:34:17,699][106225] Updated weights for policy 1, policy_version 1299096 (0.0008) [2023-12-28 04:34:18,366][106226] Updated weights for policy 0, policy_version 1295769 (0.0006) [2023-12-28 04:34:18,423][106225] Updated weights for policy 1, policy_version 1299106 (0.0006) [2023-12-28 04:34:18,434][106226] Updated weights for policy 0, policy_version 1295779 (0.0007) [2023-12-28 04:34:18,482][106225] Updated weights for policy 1, policy_version 1299116 (0.0009) [2023-12-28 04:34:18,496][106226] Updated weights for policy 0, policy_version 1295789 (0.0006) [2023-12-28 04:34:18,544][106225] Updated weights for policy 1, policy_version 1299126 (0.0007) [2023-12-28 04:34:18,554][106226] Updated weights for policy 0, policy_version 1295799 (0.0007) [2023-12-28 04:34:19,243][106225] Updated weights for policy 1, policy_version 1299136 (0.0007) [2023-12-28 04:34:19,306][106225] Updated weights for policy 1, policy_version 1299146 (0.0007) [2023-12-28 04:34:19,335][106226] Updated weights for policy 0, policy_version 1295809 (0.0008) [2023-12-28 04:34:19,375][106225] Updated weights for policy 1, policy_version 1299156 (0.0007) [2023-12-28 04:34:19,401][106226] Updated weights for policy 0, policy_version 1295819 (0.0008) [2023-12-28 04:34:19,465][106226] Updated weights for policy 0, policy_version 1295829 (0.0011) [2023-12-28 04:34:20,101][106225] Updated weights for policy 1, policy_version 1299166 (0.0007) [2023-12-28 04:34:20,134][106226] Updated weights for policy 0, policy_version 1295839 (0.0008) [2023-12-28 04:34:20,160][106225] Updated weights for policy 1, policy_version 1299176 (0.0007) [2023-12-28 04:34:20,197][106226] Updated weights for policy 0, policy_version 1295849 (0.0008) [2023-12-28 04:34:20,218][106225] Updated weights for policy 1, policy_version 1299186 (0.0008) [2023-12-28 04:34:20,264][106226] Updated weights for policy 0, policy_version 1295859 (0.0008) [2023-12-28 04:34:20,918][106225] Updated weights for policy 1, policy_version 1299196 (0.0008) [2023-12-28 04:34:20,979][106225] Updated weights for policy 1, policy_version 1299206 (0.0010) [2023-12-28 04:34:20,986][106226] Updated weights for policy 0, policy_version 1295869 (0.0009) [2023-12-28 04:34:21,047][106226] Updated weights for policy 0, policy_version 1295879 (0.0010) [2023-12-28 04:34:21,048][106225] Updated weights for policy 1, policy_version 1299216 (0.0006) [2023-12-28 04:34:21,112][106226] Updated weights for policy 0, policy_version 1295889 (0.0009) [2023-12-28 04:34:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 664461312. Throughput: 0: 9822.6, 1: 10083.0. Samples: 664463412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:21,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-5.119')] [2023-12-28 04:34:21,841][106225] Updated weights for policy 1, policy_version 1299226 (0.0008) [2023-12-28 04:34:21,886][106226] Updated weights for policy 0, policy_version 1295899 (0.0008) [2023-12-28 04:34:21,908][106225] Updated weights for policy 1, policy_version 1299236 (0.0007) [2023-12-28 04:34:21,945][106226] Updated weights for policy 0, policy_version 1295909 (0.0007) [2023-12-28 04:34:21,973][106225] Updated weights for policy 1, policy_version 1299246 (0.0006) [2023-12-28 04:34:22,006][106226] Updated weights for policy 0, policy_version 1295919 (0.0008) [2023-12-28 04:34:22,039][106225] Updated weights for policy 1, policy_version 1299256 (0.0006) [2023-12-28 04:34:22,663][106225] Updated weights for policy 1, policy_version 1299266 (0.0006) [2023-12-28 04:34:22,731][106225] Updated weights for policy 1, policy_version 1299276 (0.0006) [2023-12-28 04:34:22,769][106226] Updated weights for policy 0, policy_version 1295929 (0.0008) [2023-12-28 04:34:22,794][106225] Updated weights for policy 1, policy_version 1299286 (0.0009) [2023-12-28 04:34:22,835][106226] Updated weights for policy 0, policy_version 1295939 (0.0006) [2023-12-28 04:34:22,899][106226] Updated weights for policy 0, policy_version 1295949 (0.0008) [2023-12-28 04:34:22,953][106226] Updated weights for policy 0, policy_version 1295959 (0.0007) [2023-12-28 04:34:23,440][106225] Updated weights for policy 1, policy_version 1299296 (0.0006) [2023-12-28 04:34:23,498][106225] Updated weights for policy 1, policy_version 1299306 (0.0005) [2023-12-28 04:34:23,556][106225] Updated weights for policy 1, policy_version 1299316 (0.0008) [2023-12-28 04:34:23,717][106226] Updated weights for policy 0, policy_version 1295969 (0.0007) [2023-12-28 04:34:23,777][106226] Updated weights for policy 0, policy_version 1295979 (0.0006) [2023-12-28 04:34:23,835][106226] Updated weights for policy 0, policy_version 1295989 (0.0008) [2023-12-28 04:34:24,175][106225] Updated weights for policy 1, policy_version 1299326 (0.0009) [2023-12-28 04:34:24,229][106225] Updated weights for policy 1, policy_version 1299336 (0.0008) [2023-12-28 04:34:24,292][106225] Updated weights for policy 1, policy_version 1299346 (0.0009) [2023-12-28 04:34:24,510][106226] Updated weights for policy 0, policy_version 1295999 (0.0008) [2023-12-28 04:34:24,556][106226] Updated weights for policy 0, policy_version 1296009 (0.0008) [2023-12-28 04:34:24,606][106226] Updated weights for policy 0, policy_version 1296019 (0.0008) [2023-12-28 04:34:24,986][106225] Updated weights for policy 1, policy_version 1299356 (0.0007) [2023-12-28 04:34:25,051][106225] Updated weights for policy 1, policy_version 1299366 (0.0008) [2023-12-28 04:34:25,110][106225] Updated weights for policy 1, policy_version 1299376 (0.0007) [2023-12-28 04:34:25,241][106226] Updated weights for policy 0, policy_version 1296029 (0.0009) [2023-12-28 04:34:25,299][106226] Updated weights for policy 0, policy_version 1296039 (0.0008) [2023-12-28 04:34:25,357][106226] Updated weights for policy 0, policy_version 1296049 (0.0009) [2023-12-28 04:34:25,681][106225] Updated weights for policy 1, policy_version 1299386 (0.0005) [2023-12-28 04:34:25,733][106225] Updated weights for policy 1, policy_version 1299396 (0.0006) [2023-12-28 04:34:25,790][106225] Updated weights for policy 1, policy_version 1299406 (0.0009) [2023-12-28 04:34:25,850][106225] Updated weights for policy 1, policy_version 1299416 (0.0008) [2023-12-28 04:34:26,121][106226] Updated weights for policy 0, policy_version 1296059 (0.0008) [2023-12-28 04:34:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 664551424. Throughput: 0: 9790.2, 1: 10069.8. Samples: 664520988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:26,175][105115] Avg episode reward: [(0, '-4.017'), (1, '-4.907')] [2023-12-28 04:34:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001299416_332701696.pth... [2023-12-28 04:34:26,180][106226] Updated weights for policy 0, policy_version 1296069 (0.0009) [2023-12-28 04:34:26,182][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001298248_332398592.pth [2023-12-28 04:34:26,231][106226] Updated weights for policy 0, policy_version 1296079 (0.0008) [2023-12-28 04:34:26,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001296088_331857920.pth... [2023-12-28 04:34:26,274][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001294936_331563008.pth [2023-12-28 04:34:26,510][106225] Updated weights for policy 1, policy_version 1299426 (0.0005) [2023-12-28 04:34:26,555][106225] Updated weights for policy 1, policy_version 1299436 (0.0005) [2023-12-28 04:34:26,606][106225] Updated weights for policy 1, policy_version 1299446 (0.0005) [2023-12-28 04:34:27,044][106226] Updated weights for policy 0, policy_version 1296089 (0.0008) [2023-12-28 04:34:27,094][106226] Updated weights for policy 0, policy_version 1296099 (0.0008) [2023-12-28 04:34:27,149][106226] Updated weights for policy 0, policy_version 1296109 (0.0007) [2023-12-28 04:34:27,171][106225] Updated weights for policy 1, policy_version 1299456 (0.0006) [2023-12-28 04:34:27,201][106226] Updated weights for policy 0, policy_version 1296119 (0.0007) [2023-12-28 04:34:27,224][106225] Updated weights for policy 1, policy_version 1299466 (0.0006) [2023-12-28 04:34:27,275][106225] Updated weights for policy 1, policy_version 1299476 (0.0009) [2023-12-28 04:34:27,920][106226] Updated weights for policy 0, policy_version 1296129 (0.0009) [2023-12-28 04:34:27,971][106226] Updated weights for policy 0, policy_version 1296139 (0.0008) [2023-12-28 04:34:28,011][106225] Updated weights for policy 1, policy_version 1299486 (0.0007) [2023-12-28 04:34:28,029][106226] Updated weights for policy 0, policy_version 1296149 (0.0006) [2023-12-28 04:34:28,066][106225] Updated weights for policy 1, policy_version 1299496 (0.0008) [2023-12-28 04:34:28,125][106225] Updated weights for policy 1, policy_version 1299506 (0.0009) [2023-12-28 04:34:28,736][106226] Updated weights for policy 0, policy_version 1296159 (0.0008) [2023-12-28 04:34:28,795][106226] Updated weights for policy 0, policy_version 1296169 (0.0008) [2023-12-28 04:34:28,850][106225] Updated weights for policy 1, policy_version 1299516 (0.0008) [2023-12-28 04:34:28,856][106226] Updated weights for policy 0, policy_version 1296179 (0.0009) [2023-12-28 04:34:28,907][106225] Updated weights for policy 1, policy_version 1299526 (0.0007) [2023-12-28 04:34:28,964][106225] Updated weights for policy 1, policy_version 1299536 (0.0008) [2023-12-28 04:34:29,598][106226] Updated weights for policy 0, policy_version 1296189 (0.0008) [2023-12-28 04:34:29,650][106226] Updated weights for policy 0, policy_version 1296199 (0.0008) [2023-12-28 04:34:29,694][106225] Updated weights for policy 1, policy_version 1299546 (0.0007) [2023-12-28 04:34:29,704][106226] Updated weights for policy 0, policy_version 1296209 (0.0007) [2023-12-28 04:34:29,751][106225] Updated weights for policy 1, policy_version 1299556 (0.0007) [2023-12-28 04:34:29,808][106225] Updated weights for policy 1, policy_version 1299566 (0.0008) [2023-12-28 04:34:29,874][106225] Updated weights for policy 1, policy_version 1299576 (0.0008) [2023-12-28 04:34:30,439][106226] Updated weights for policy 0, policy_version 1296219 (0.0008) [2023-12-28 04:34:30,498][106226] Updated weights for policy 0, policy_version 1296229 (0.0009) [2023-12-28 04:34:30,552][106226] Updated weights for policy 0, policy_version 1296239 (0.0008) [2023-12-28 04:34:30,573][106225] Updated weights for policy 1, policy_version 1299586 (0.0007) [2023-12-28 04:34:30,626][106225] Updated weights for policy 1, policy_version 1299596 (0.0007) [2023-12-28 04:34:30,678][106225] Updated weights for policy 1, policy_version 1299606 (0.0007) [2023-12-28 04:34:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 664649728. Throughput: 0: 9819.7, 1: 10119.6. Samples: 664642064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:31,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.995')] [2023-12-28 04:34:31,259][106226] Updated weights for policy 0, policy_version 1296249 (0.0010) [2023-12-28 04:34:31,323][106226] Updated weights for policy 0, policy_version 1296259 (0.0006) [2023-12-28 04:34:31,398][106226] Updated weights for policy 0, policy_version 1296269 (0.0008) [2023-12-28 04:34:31,455][106226] Updated weights for policy 0, policy_version 1296279 (0.0007) [2023-12-28 04:34:31,474][106225] Updated weights for policy 1, policy_version 1299616 (0.0006) [2023-12-28 04:34:31,521][106225] Updated weights for policy 1, policy_version 1299626 (0.0005) [2023-12-28 04:34:31,574][106225] Updated weights for policy 1, policy_version 1299636 (0.0005) [2023-12-28 04:34:32,162][106226] Updated weights for policy 0, policy_version 1296289 (0.0008) [2023-12-28 04:34:32,204][106225] Updated weights for policy 1, policy_version 1299646 (0.0006) [2023-12-28 04:34:32,224][106226] Updated weights for policy 0, policy_version 1296299 (0.0008) [2023-12-28 04:34:32,262][106225] Updated weights for policy 1, policy_version 1299656 (0.0008) [2023-12-28 04:34:32,289][106226] Updated weights for policy 0, policy_version 1296309 (0.0007) [2023-12-28 04:34:32,326][106225] Updated weights for policy 1, policy_version 1299666 (0.0008) [2023-12-28 04:34:32,997][106225] Updated weights for policy 1, policy_version 1299676 (0.0007) [2023-12-28 04:34:32,999][106226] Updated weights for policy 0, policy_version 1296319 (0.0008) [2023-12-28 04:34:33,051][106225] Updated weights for policy 1, policy_version 1299686 (0.0006) [2023-12-28 04:34:33,056][106226] Updated weights for policy 0, policy_version 1296329 (0.0008) [2023-12-28 04:34:33,105][106225] Updated weights for policy 1, policy_version 1299696 (0.0005) [2023-12-28 04:34:33,112][106226] Updated weights for policy 0, policy_version 1296339 (0.0008) [2023-12-28 04:34:33,676][106225] Updated weights for policy 1, policy_version 1299706 (0.0005) [2023-12-28 04:34:33,727][106225] Updated weights for policy 1, policy_version 1299716 (0.0006) [2023-12-28 04:34:33,775][106225] Updated weights for policy 1, policy_version 1299726 (0.0007) [2023-12-28 04:34:33,829][106226] Updated weights for policy 0, policy_version 1296349 (0.0008) [2023-12-28 04:34:33,837][106225] Updated weights for policy 1, policy_version 1299736 (0.0008) [2023-12-28 04:34:33,890][106226] Updated weights for policy 0, policy_version 1296359 (0.0006) [2023-12-28 04:34:33,958][106226] Updated weights for policy 0, policy_version 1296369 (0.0006) [2023-12-28 04:34:34,545][106225] Updated weights for policy 1, policy_version 1299746 (0.0009) [2023-12-28 04:34:34,613][106225] Updated weights for policy 1, policy_version 1299756 (0.0008) [2023-12-28 04:34:34,616][106226] Updated weights for policy 0, policy_version 1296379 (0.0006) [2023-12-28 04:34:34,669][106225] Updated weights for policy 1, policy_version 1299766 (0.0008) [2023-12-28 04:34:34,673][106226] Updated weights for policy 0, policy_version 1296389 (0.0005) [2023-12-28 04:34:34,737][106226] Updated weights for policy 0, policy_version 1296399 (0.0005) [2023-12-28 04:34:35,308][106225] Updated weights for policy 1, policy_version 1299776 (0.0006) [2023-12-28 04:34:35,353][106226] Updated weights for policy 0, policy_version 1296409 (0.0009) [2023-12-28 04:34:35,359][106225] Updated weights for policy 1, policy_version 1299786 (0.0007) [2023-12-28 04:34:35,412][106226] Updated weights for policy 0, policy_version 1296419 (0.0009) [2023-12-28 04:34:35,430][106225] Updated weights for policy 1, policy_version 1299796 (0.0007) [2023-12-28 04:34:35,475][106226] Updated weights for policy 0, policy_version 1296429 (0.0007) [2023-12-28 04:34:35,537][106226] Updated weights for policy 0, policy_version 1296439 (0.0008) [2023-12-28 04:34:36,073][106225] Updated weights for policy 1, policy_version 1299806 (0.0009) [2023-12-28 04:34:36,150][106225] Updated weights for policy 1, policy_version 1299816 (0.0008) [2023-12-28 04:34:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 664748032. Throughput: 0: 9798.8, 1: 10148.4. Samples: 664762816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:36,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-5.081')] [2023-12-28 04:34:36,214][106225] Updated weights for policy 1, policy_version 1299826 (0.0008) [2023-12-28 04:34:36,249][106226] Updated weights for policy 0, policy_version 1296449 (0.0008) [2023-12-28 04:34:36,309][106226] Updated weights for policy 0, policy_version 1296459 (0.0008) [2023-12-28 04:34:36,375][106226] Updated weights for policy 0, policy_version 1296469 (0.0008) [2023-12-28 04:34:36,929][106225] Updated weights for policy 1, policy_version 1299836 (0.0007) [2023-12-28 04:34:36,992][106225] Updated weights for policy 1, policy_version 1299846 (0.0005) [2023-12-28 04:34:37,062][106225] Updated weights for policy 1, policy_version 1299856 (0.0006) [2023-12-28 04:34:37,104][106226] Updated weights for policy 0, policy_version 1296479 (0.0010) [2023-12-28 04:34:37,162][106226] Updated weights for policy 0, policy_version 1296489 (0.0011) [2023-12-28 04:34:37,222][106226] Updated weights for policy 0, policy_version 1296499 (0.0011) [2023-12-28 04:34:37,735][106225] Updated weights for policy 1, policy_version 1299866 (0.0006) [2023-12-28 04:34:37,779][106225] Updated weights for policy 1, policy_version 1299876 (0.0008) [2023-12-28 04:34:37,824][106225] Updated weights for policy 1, policy_version 1299886 (0.0007) [2023-12-28 04:34:37,872][106225] Updated weights for policy 1, policy_version 1299896 (0.0009) [2023-12-28 04:34:37,934][106226] Updated weights for policy 0, policy_version 1296509 (0.0009) [2023-12-28 04:34:37,997][106226] Updated weights for policy 0, policy_version 1296519 (0.0006) [2023-12-28 04:34:38,059][106226] Updated weights for policy 0, policy_version 1296529 (0.0005) [2023-12-28 04:34:38,677][106226] Updated weights for policy 0, policy_version 1296539 (0.0006) [2023-12-28 04:34:38,700][106225] Updated weights for policy 1, policy_version 1299906 (0.0009) [2023-12-28 04:34:38,734][106226] Updated weights for policy 0, policy_version 1296549 (0.0008) [2023-12-28 04:34:38,756][106225] Updated weights for policy 1, policy_version 1299916 (0.0007) [2023-12-28 04:34:38,796][106226] Updated weights for policy 0, policy_version 1296559 (0.0006) [2023-12-28 04:34:38,816][106225] Updated weights for policy 1, policy_version 1299926 (0.0008) [2023-12-28 04:34:39,511][106225] Updated weights for policy 1, policy_version 1299936 (0.0008) [2023-12-28 04:34:39,573][106225] Updated weights for policy 1, policy_version 1299946 (0.0008) [2023-12-28 04:34:39,608][106226] Updated weights for policy 0, policy_version 1296569 (0.0006) [2023-12-28 04:34:39,640][106225] Updated weights for policy 1, policy_version 1299956 (0.0007) [2023-12-28 04:34:39,671][106226] Updated weights for policy 0, policy_version 1296579 (0.0008) [2023-12-28 04:34:39,734][106226] Updated weights for policy 0, policy_version 1296589 (0.0008) [2023-12-28 04:34:39,805][106226] Updated weights for policy 0, policy_version 1296599 (0.0008) [2023-12-28 04:34:40,406][106225] Updated weights for policy 1, policy_version 1299966 (0.0007) [2023-12-28 04:34:40,471][106225] Updated weights for policy 1, policy_version 1299976 (0.0009) [2023-12-28 04:34:40,531][106225] Updated weights for policy 1, policy_version 1299986 (0.0009) [2023-12-28 04:34:40,546][106226] Updated weights for policy 0, policy_version 1296609 (0.0007) [2023-12-28 04:34:40,606][106226] Updated weights for policy 0, policy_version 1296619 (0.0007) [2023-12-28 04:34:40,666][106226] Updated weights for policy 0, policy_version 1296629 (0.0009) [2023-12-28 04:34:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 664846336. Throughput: 0: 9768.7, 1: 10169.4. Samples: 664821708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:41,175][105115] Avg episode reward: [(0, '-4.260'), (1, '-5.069')] [2023-12-28 04:34:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001299992_332849152.pth... [2023-12-28 04:34:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001296632_331997184.pth... [2023-12-28 04:34:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001298840_332554240.pth [2023-12-28 04:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001295512_331710464.pth [2023-12-28 04:34:41,263][106225] Updated weights for policy 1, policy_version 1299996 (0.0008) [2023-12-28 04:34:41,327][106225] Updated weights for policy 1, policy_version 1300006 (0.0009) [2023-12-28 04:34:41,406][106225] Updated weights for policy 1, policy_version 1300016 (0.0008) [2023-12-28 04:34:41,422][106226] Updated weights for policy 0, policy_version 1296639 (0.0007) [2023-12-28 04:34:41,482][106226] Updated weights for policy 0, policy_version 1296649 (0.0006) [2023-12-28 04:34:41,545][106226] Updated weights for policy 0, policy_version 1296659 (0.0006) [2023-12-28 04:34:42,163][106225] Updated weights for policy 1, policy_version 1300026 (0.0008) [2023-12-28 04:34:42,218][106225] Updated weights for policy 1, policy_version 1300036 (0.0008) [2023-12-28 04:34:42,256][106226] Updated weights for policy 0, policy_version 1296669 (0.0006) [2023-12-28 04:34:42,280][106225] Updated weights for policy 1, policy_version 1300046 (0.0010) [2023-12-28 04:34:42,322][106226] Updated weights for policy 0, policy_version 1296679 (0.0007) [2023-12-28 04:34:42,346][106225] Updated weights for policy 1, policy_version 1300056 (0.0010) [2023-12-28 04:34:42,389][106226] Updated weights for policy 0, policy_version 1296689 (0.0009) [2023-12-28 04:34:43,011][106225] Updated weights for policy 1, policy_version 1300066 (0.0010) [2023-12-28 04:34:43,058][106225] Updated weights for policy 1, policy_version 1300076 (0.0010) [2023-12-28 04:34:43,122][106225] Updated weights for policy 1, policy_version 1300086 (0.0010) [2023-12-28 04:34:43,155][106226] Updated weights for policy 0, policy_version 1296699 (0.0008) [2023-12-28 04:34:43,202][106226] Updated weights for policy 0, policy_version 1296709 (0.0009) [2023-12-28 04:34:43,256][106226] Updated weights for policy 0, policy_version 1296719 (0.0008) [2023-12-28 04:34:43,800][106225] Updated weights for policy 1, policy_version 1300096 (0.0010) [2023-12-28 04:34:43,851][106225] Updated weights for policy 1, policy_version 1300106 (0.0010) [2023-12-28 04:34:43,898][106225] Updated weights for policy 1, policy_version 1300116 (0.0010) [2023-12-28 04:34:44,025][106226] Updated weights for policy 0, policy_version 1296729 (0.0008) [2023-12-28 04:34:44,078][106226] Updated weights for policy 0, policy_version 1296739 (0.0008) [2023-12-28 04:34:44,135][106226] Updated weights for policy 0, policy_version 1296749 (0.0008) [2023-12-28 04:34:44,198][106226] Updated weights for policy 0, policy_version 1296759 (0.0009) [2023-12-28 04:34:44,587][106225] Updated weights for policy 1, policy_version 1300126 (0.0010) [2023-12-28 04:34:44,638][106225] Updated weights for policy 1, policy_version 1300136 (0.0008) [2023-12-28 04:34:44,687][106225] Updated weights for policy 1, policy_version 1300146 (0.0007) [2023-12-28 04:34:44,923][106226] Updated weights for policy 0, policy_version 1296769 (0.0007) [2023-12-28 04:34:44,989][106226] Updated weights for policy 0, policy_version 1296779 (0.0009) [2023-12-28 04:34:45,044][106226] Updated weights for policy 0, policy_version 1296789 (0.0008) [2023-12-28 04:34:45,444][106225] Updated weights for policy 1, policy_version 1300156 (0.0007) [2023-12-28 04:34:45,498][106225] Updated weights for policy 1, policy_version 1300166 (0.0010) [2023-12-28 04:34:45,547][106225] Updated weights for policy 1, policy_version 1300176 (0.0008) [2023-12-28 04:34:45,701][106226] Updated weights for policy 0, policy_version 1296799 (0.0007) [2023-12-28 04:34:45,760][106226] Updated weights for policy 0, policy_version 1296809 (0.0008) [2023-12-28 04:34:45,820][106226] Updated weights for policy 0, policy_version 1296819 (0.0009) [2023-12-28 04:34:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 664944640. Throughput: 0: 9703.6, 1: 10115.6. Samples: 664935120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:46,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-5.035')] [2023-12-28 04:34:46,281][106225] Updated weights for policy 1, policy_version 1300186 (0.0009) [2023-12-28 04:34:46,339][106225] Updated weights for policy 1, policy_version 1300196 (0.0008) [2023-12-28 04:34:46,393][106225] Updated weights for policy 1, policy_version 1300206 (0.0008) [2023-12-28 04:34:46,448][106225] Updated weights for policy 1, policy_version 1300216 (0.0008) [2023-12-28 04:34:46,535][106226] Updated weights for policy 0, policy_version 1296829 (0.0009) [2023-12-28 04:34:46,594][106226] Updated weights for policy 0, policy_version 1296839 (0.0008) [2023-12-28 04:34:46,649][106226] Updated weights for policy 0, policy_version 1296849 (0.0008) [2023-12-28 04:34:47,068][106225] Updated weights for policy 1, policy_version 1300226 (0.0005) [2023-12-28 04:34:47,131][106225] Updated weights for policy 1, policy_version 1300236 (0.0006) [2023-12-28 04:34:47,183][106225] Updated weights for policy 1, policy_version 1300246 (0.0005) [2023-12-28 04:34:47,400][106226] Updated weights for policy 0, policy_version 1296859 (0.0006) [2023-12-28 04:34:47,454][106226] Updated weights for policy 0, policy_version 1296869 (0.0009) [2023-12-28 04:34:47,505][106226] Updated weights for policy 0, policy_version 1296879 (0.0009) [2023-12-28 04:34:47,688][106225] Updated weights for policy 1, policy_version 1300256 (0.0005) [2023-12-28 04:34:47,745][106225] Updated weights for policy 1, policy_version 1300266 (0.0007) [2023-12-28 04:34:47,807][106225] Updated weights for policy 1, policy_version 1300276 (0.0008) [2023-12-28 04:34:48,221][106226] Updated weights for policy 0, policy_version 1296889 (0.0008) [2023-12-28 04:34:48,275][106226] Updated weights for policy 0, policy_version 1296899 (0.0010) [2023-12-28 04:34:48,337][106226] Updated weights for policy 0, policy_version 1296909 (0.0010) [2023-12-28 04:34:48,393][106226] Updated weights for policy 0, policy_version 1296919 (0.0010) [2023-12-28 04:34:48,546][106225] Updated weights for policy 1, policy_version 1300286 (0.0007) [2023-12-28 04:34:48,625][106225] Updated weights for policy 1, policy_version 1300296 (0.0007) [2023-12-28 04:34:48,683][106225] Updated weights for policy 1, policy_version 1300306 (0.0009) [2023-12-28 04:34:49,018][106226] Updated weights for policy 0, policy_version 1296929 (0.0006) [2023-12-28 04:34:49,082][106226] Updated weights for policy 0, policy_version 1296939 (0.0009) [2023-12-28 04:34:49,145][106226] Updated weights for policy 0, policy_version 1296949 (0.0010) [2023-12-28 04:34:49,391][106225] Updated weights for policy 1, policy_version 1300316 (0.0009) [2023-12-28 04:34:49,437][106225] Updated weights for policy 1, policy_version 1300326 (0.0010) [2023-12-28 04:34:49,484][106225] Updated weights for policy 1, policy_version 1300336 (0.0010) [2023-12-28 04:34:49,871][106226] Updated weights for policy 0, policy_version 1296959 (0.0008) [2023-12-28 04:34:49,936][106226] Updated weights for policy 0, policy_version 1296969 (0.0009) [2023-12-28 04:34:49,999][106226] Updated weights for policy 0, policy_version 1296979 (0.0010) [2023-12-28 04:34:50,196][106225] Updated weights for policy 1, policy_version 1300346 (0.0009) [2023-12-28 04:34:50,257][106225] Updated weights for policy 1, policy_version 1300356 (0.0010) [2023-12-28 04:34:50,308][106225] Updated weights for policy 1, policy_version 1300366 (0.0010) [2023-12-28 04:34:50,368][106225] Updated weights for policy 1, policy_version 1300376 (0.0010) [2023-12-28 04:34:50,714][106226] Updated weights for policy 0, policy_version 1296989 (0.0009) [2023-12-28 04:34:50,782][106226] Updated weights for policy 0, policy_version 1296999 (0.0008) [2023-12-28 04:34:50,844][106226] Updated weights for policy 0, policy_version 1297009 (0.0008) [2023-12-28 04:34:51,122][106225] Updated weights for policy 1, policy_version 1300386 (0.0010) [2023-12-28 04:34:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 665042944. Throughput: 0: 9676.8, 1: 10029.4. Samples: 665054940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:51,175][105115] Avg episode reward: [(0, '-4.131'), (1, '-5.240')] [2023-12-28 04:34:51,193][106225] Updated weights for policy 1, policy_version 1300396 (0.0008) [2023-12-28 04:34:51,253][106225] Updated weights for policy 1, policy_version 1300406 (0.0008) [2023-12-28 04:34:51,557][106226] Updated weights for policy 0, policy_version 1297019 (0.0007) [2023-12-28 04:34:51,616][106226] Updated weights for policy 0, policy_version 1297029 (0.0006) [2023-12-28 04:34:51,682][106226] Updated weights for policy 0, policy_version 1297039 (0.0007) [2023-12-28 04:34:51,942][106225] Updated weights for policy 1, policy_version 1300416 (0.0007) [2023-12-28 04:34:52,007][106225] Updated weights for policy 1, policy_version 1300426 (0.0008) [2023-12-28 04:34:52,070][106225] Updated weights for policy 1, policy_version 1300436 (0.0007) [2023-12-28 04:34:52,365][106226] Updated weights for policy 0, policy_version 1297049 (0.0009) [2023-12-28 04:34:52,425][106226] Updated weights for policy 0, policy_version 1297059 (0.0009) [2023-12-28 04:34:52,483][106226] Updated weights for policy 0, policy_version 1297069 (0.0008) [2023-12-28 04:34:52,544][106226] Updated weights for policy 0, policy_version 1297079 (0.0009) [2023-12-28 04:34:52,812][106225] Updated weights for policy 1, policy_version 1300446 (0.0008) [2023-12-28 04:34:52,872][106225] Updated weights for policy 1, policy_version 1300456 (0.0009) [2023-12-28 04:34:52,927][106225] Updated weights for policy 1, policy_version 1300466 (0.0005) [2023-12-28 04:34:53,290][106226] Updated weights for policy 0, policy_version 1297089 (0.0008) [2023-12-28 04:34:53,336][106226] Updated weights for policy 0, policy_version 1297099 (0.0008) [2023-12-28 04:34:53,387][106226] Updated weights for policy 0, policy_version 1297109 (0.0008) [2023-12-28 04:34:53,602][106225] Updated weights for policy 1, policy_version 1300476 (0.0006) [2023-12-28 04:34:53,662][106225] Updated weights for policy 1, policy_version 1300486 (0.0005) [2023-12-28 04:34:53,709][106225] Updated weights for policy 1, policy_version 1300496 (0.0005) [2023-12-28 04:34:53,995][106226] Updated weights for policy 0, policy_version 1297119 (0.0006) [2023-12-28 04:34:54,056][106226] Updated weights for policy 0, policy_version 1297129 (0.0005) [2023-12-28 04:34:54,124][106226] Updated weights for policy 0, policy_version 1297139 (0.0007) [2023-12-28 04:34:54,319][106225] Updated weights for policy 1, policy_version 1300506 (0.0005) [2023-12-28 04:34:54,375][106225] Updated weights for policy 1, policy_version 1300516 (0.0005) [2023-12-28 04:34:54,431][106225] Updated weights for policy 1, policy_version 1300526 (0.0007) [2023-12-28 04:34:54,490][106225] Updated weights for policy 1, policy_version 1300536 (0.0006) [2023-12-28 04:34:54,897][106226] Updated weights for policy 0, policy_version 1297149 (0.0008) [2023-12-28 04:34:54,948][106226] Updated weights for policy 0, policy_version 1297159 (0.0009) [2023-12-28 04:34:55,011][106226] Updated weights for policy 0, policy_version 1297169 (0.0008) [2023-12-28 04:34:55,011][106225] Updated weights for policy 1, policy_version 1300546 (0.0010) [2023-12-28 04:34:55,072][106225] Updated weights for policy 1, policy_version 1300556 (0.0010) [2023-12-28 04:34:55,139][106225] Updated weights for policy 1, policy_version 1300566 (0.0010) [2023-12-28 04:34:55,644][106226] Updated weights for policy 0, policy_version 1297179 (0.0008) [2023-12-28 04:34:55,697][106226] Updated weights for policy 0, policy_version 1297189 (0.0010) [2023-12-28 04:34:55,749][106225] Updated weights for policy 1, policy_version 1300576 (0.0010) [2023-12-28 04:34:55,757][106226] Updated weights for policy 0, policy_version 1297199 (0.0010) [2023-12-28 04:34:55,802][106225] Updated weights for policy 1, policy_version 1300586 (0.0010) [2023-12-28 04:34:55,856][106225] Updated weights for policy 1, policy_version 1300596 (0.0010) [2023-12-28 04:34:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 665149440. Throughput: 0: 9658.1, 1: 10025.1. Samples: 665114608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:34:56,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.152')] [2023-12-28 04:34:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001300600_333004800.pth... [2023-12-28 04:34:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001297208_332144640.pth... [2023-12-28 04:34:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001299416_332701696.pth [2023-12-28 04:34:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001296088_331857920.pth [2023-12-28 04:34:56,428][106226] Updated weights for policy 0, policy_version 1297209 (0.0010) [2023-12-28 04:34:56,489][106226] Updated weights for policy 0, policy_version 1297219 (0.0005) [2023-12-28 04:34:56,545][106226] Updated weights for policy 0, policy_version 1297229 (0.0006) [2023-12-28 04:34:56,594][106225] Updated weights for policy 1, policy_version 1300606 (0.0007) [2023-12-28 04:34:56,601][106226] Updated weights for policy 0, policy_version 1297239 (0.0005) [2023-12-28 04:34:56,647][106225] Updated weights for policy 1, policy_version 1300616 (0.0006) [2023-12-28 04:34:56,702][106225] Updated weights for policy 1, policy_version 1300626 (0.0007) [2023-12-28 04:34:57,161][106226] Updated weights for policy 0, policy_version 1297249 (0.0008) [2023-12-28 04:34:57,220][106226] Updated weights for policy 0, policy_version 1297259 (0.0007) [2023-12-28 04:34:57,277][106226] Updated weights for policy 0, policy_version 1297269 (0.0005) [2023-12-28 04:34:57,329][106225] Updated weights for policy 1, policy_version 1300636 (0.0010) [2023-12-28 04:34:57,385][106225] Updated weights for policy 1, policy_version 1300646 (0.0010) [2023-12-28 04:34:57,430][106225] Updated weights for policy 1, policy_version 1300656 (0.0010) [2023-12-28 04:34:57,925][106226] Updated weights for policy 0, policy_version 1297279 (0.0007) [2023-12-28 04:34:57,982][106226] Updated weights for policy 0, policy_version 1297289 (0.0007) [2023-12-28 04:34:58,042][106226] Updated weights for policy 0, policy_version 1297299 (0.0006) [2023-12-28 04:34:58,151][106225] Updated weights for policy 1, policy_version 1300666 (0.0010) [2023-12-28 04:34:58,204][106225] Updated weights for policy 1, policy_version 1300676 (0.0010) [2023-12-28 04:34:58,275][106225] Updated weights for policy 1, policy_version 1300686 (0.0010) [2023-12-28 04:34:58,345][106225] Updated weights for policy 1, policy_version 1300696 (0.0009) [2023-12-28 04:34:58,736][106226] Updated weights for policy 0, policy_version 1297309 (0.0006) [2023-12-28 04:34:58,806][106226] Updated weights for policy 0, policy_version 1297319 (0.0008) [2023-12-28 04:34:58,877][106226] Updated weights for policy 0, policy_version 1297329 (0.0009) [2023-12-28 04:34:59,214][106225] Updated weights for policy 1, policy_version 1300706 (0.0008) [2023-12-28 04:34:59,292][106225] Updated weights for policy 1, policy_version 1300716 (0.0008) [2023-12-28 04:34:59,350][106225] Updated weights for policy 1, policy_version 1300726 (0.0009) [2023-12-28 04:34:59,786][106226] Updated weights for policy 0, policy_version 1297339 (0.0009) [2023-12-28 04:34:59,857][106226] Updated weights for policy 0, policy_version 1297349 (0.0007) [2023-12-28 04:34:59,924][106226] Updated weights for policy 0, policy_version 1297359 (0.0009) [2023-12-28 04:35:00,135][106225] Updated weights for policy 1, policy_version 1300736 (0.0006) [2023-12-28 04:35:00,192][106225] Updated weights for policy 1, policy_version 1300746 (0.0005) [2023-12-28 04:35:00,245][106225] Updated weights for policy 1, policy_version 1300756 (0.0005) [2023-12-28 04:35:00,651][106226] Updated weights for policy 0, policy_version 1297369 (0.0012) [2023-12-28 04:35:00,713][106226] Updated weights for policy 0, policy_version 1297379 (0.0010) [2023-12-28 04:35:00,768][106226] Updated weights for policy 0, policy_version 1297389 (0.0010) [2023-12-28 04:35:00,782][106225] Updated weights for policy 1, policy_version 1300766 (0.0006) [2023-12-28 04:35:00,824][106226] Updated weights for policy 0, policy_version 1297399 (0.0009) [2023-12-28 04:35:00,832][106225] Updated weights for policy 1, policy_version 1300776 (0.0006) [2023-12-28 04:35:00,880][106225] Updated weights for policy 1, policy_version 1300786 (0.0009) [2023-12-28 04:35:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 665247744. Throughput: 0: 9704.2, 1: 10067.7. Samples: 665234016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:01,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.789')] [2023-12-28 04:35:01,467][106226] Updated weights for policy 0, policy_version 1297409 (0.0010) [2023-12-28 04:35:01,532][106226] Updated weights for policy 0, policy_version 1297419 (0.0011) [2023-12-28 04:35:01,588][106226] Updated weights for policy 0, policy_version 1297429 (0.0010) [2023-12-28 04:35:01,656][106225] Updated weights for policy 1, policy_version 1300796 (0.0009) [2023-12-28 04:35:01,717][106225] Updated weights for policy 1, policy_version 1300806 (0.0008) [2023-12-28 04:35:01,786][106225] Updated weights for policy 1, policy_version 1300816 (0.0008) [2023-12-28 04:35:02,307][106226] Updated weights for policy 0, policy_version 1297439 (0.0011) [2023-12-28 04:35:02,369][106226] Updated weights for policy 0, policy_version 1297449 (0.0011) [2023-12-28 04:35:02,426][106226] Updated weights for policy 0, policy_version 1297459 (0.0011) [2023-12-28 04:35:02,548][106225] Updated weights for policy 1, policy_version 1300826 (0.0008) [2023-12-28 04:35:02,610][106225] Updated weights for policy 1, policy_version 1300836 (0.0008) [2023-12-28 04:35:02,671][106225] Updated weights for policy 1, policy_version 1300846 (0.0008) [2023-12-28 04:35:02,733][106225] Updated weights for policy 1, policy_version 1300856 (0.0008) [2023-12-28 04:35:03,126][106226] Updated weights for policy 0, policy_version 1297469 (0.0010) [2023-12-28 04:35:03,184][106226] Updated weights for policy 0, policy_version 1297479 (0.0006) [2023-12-28 04:35:03,238][106226] Updated weights for policy 0, policy_version 1297489 (0.0005) [2023-12-28 04:35:03,431][106225] Updated weights for policy 1, policy_version 1300866 (0.0005) [2023-12-28 04:35:03,477][106225] Updated weights for policy 1, policy_version 1300876 (0.0005) [2023-12-28 04:35:03,527][106225] Updated weights for policy 1, policy_version 1300886 (0.0005) [2023-12-28 04:35:03,897][106226] Updated weights for policy 0, policy_version 1297499 (0.0007) [2023-12-28 04:35:03,954][106226] Updated weights for policy 0, policy_version 1297509 (0.0009) [2023-12-28 04:35:04,008][106226] Updated weights for policy 0, policy_version 1297519 (0.0009) [2023-12-28 04:35:04,096][106225] Updated weights for policy 1, policy_version 1300896 (0.0008) [2023-12-28 04:35:04,156][106225] Updated weights for policy 1, policy_version 1300906 (0.0009) [2023-12-28 04:35:04,215][106225] Updated weights for policy 1, policy_version 1300916 (0.0008) [2023-12-28 04:35:04,778][106226] Updated weights for policy 0, policy_version 1297529 (0.0008) [2023-12-28 04:35:04,826][106226] Updated weights for policy 0, policy_version 1297539 (0.0005) [2023-12-28 04:35:04,873][106226] Updated weights for policy 0, policy_version 1297549 (0.0007) [2023-12-28 04:35:04,899][106225] Updated weights for policy 1, policy_version 1300926 (0.0009) [2023-12-28 04:35:04,919][106226] Updated weights for policy 0, policy_version 1297559 (0.0008) [2023-12-28 04:35:04,945][106225] Updated weights for policy 1, policy_version 1300936 (0.0010) [2023-12-28 04:35:05,006][106225] Updated weights for policy 1, policy_version 1300946 (0.0005) [2023-12-28 04:35:05,554][106226] Updated weights for policy 0, policy_version 1297569 (0.0008) [2023-12-28 04:35:05,603][106226] Updated weights for policy 0, policy_version 1297580 (0.0008) [2023-12-28 04:35:05,615][106225] Updated weights for policy 1, policy_version 1300956 (0.0005) [2023-12-28 04:35:05,651][106226] Updated weights for policy 0, policy_version 1297590 (0.0005) [2023-12-28 04:35:05,671][106225] Updated weights for policy 1, policy_version 1300966 (0.0005) [2023-12-28 04:35:05,734][106225] Updated weights for policy 1, policy_version 1300976 (0.0005) [2023-12-28 04:35:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 665346048. Throughput: 0: 9770.8, 1: 10103.9. Samples: 665357776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:06,176][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.897')] [2023-12-28 04:35:06,358][106225] Updated weights for policy 1, policy_version 1300986 (0.0007) [2023-12-28 04:35:06,366][106226] Updated weights for policy 0, policy_version 1297600 (0.0011) [2023-12-28 04:35:06,420][106225] Updated weights for policy 1, policy_version 1300996 (0.0011) [2023-12-28 04:35:06,428][106226] Updated weights for policy 0, policy_version 1297610 (0.0011) [2023-12-28 04:35:06,487][106225] Updated weights for policy 1, policy_version 1301006 (0.0011) [2023-12-28 04:35:06,494][106226] Updated weights for policy 0, policy_version 1297620 (0.0011) [2023-12-28 04:35:06,552][106225] Updated weights for policy 1, policy_version 1301016 (0.0011) [2023-12-28 04:35:07,236][106226] Updated weights for policy 0, policy_version 1297630 (0.0011) [2023-12-28 04:35:07,244][106225] Updated weights for policy 1, policy_version 1301026 (0.0008) [2023-12-28 04:35:07,299][106225] Updated weights for policy 1, policy_version 1301036 (0.0006) [2023-12-28 04:35:07,301][106226] Updated weights for policy 0, policy_version 1297640 (0.0011) [2023-12-28 04:35:07,351][106225] Updated weights for policy 1, policy_version 1301046 (0.0007) [2023-12-28 04:35:07,356][106226] Updated weights for policy 0, policy_version 1297650 (0.0011) [2023-12-28 04:35:07,958][106226] Updated weights for policy 0, policy_version 1297660 (0.0009) [2023-12-28 04:35:08,025][106226] Updated weights for policy 0, policy_version 1297670 (0.0007) [2023-12-28 04:35:08,026][106225] Updated weights for policy 1, policy_version 1301056 (0.0006) [2023-12-28 04:35:08,075][106226] Updated weights for policy 0, policy_version 1297680 (0.0009) [2023-12-28 04:35:08,088][106225] Updated weights for policy 1, policy_version 1301066 (0.0005) [2023-12-28 04:35:08,150][106225] Updated weights for policy 1, policy_version 1301076 (0.0007) [2023-12-28 04:35:08,730][106226] Updated weights for policy 0, policy_version 1297690 (0.0007) [2023-12-28 04:35:08,792][106226] Updated weights for policy 0, policy_version 1297700 (0.0005) [2023-12-28 04:35:08,848][106226] Updated weights for policy 0, policy_version 1297710 (0.0005) [2023-12-28 04:35:08,856][106225] Updated weights for policy 1, policy_version 1301086 (0.0009) [2023-12-28 04:35:08,904][106226] Updated weights for policy 0, policy_version 1297720 (0.0006) [2023-12-28 04:35:08,909][106225] Updated weights for policy 1, policy_version 1301096 (0.0008) [2023-12-28 04:35:08,968][106225] Updated weights for policy 1, policy_version 1301106 (0.0009) [2023-12-28 04:35:09,556][106226] Updated weights for policy 0, policy_version 1297730 (0.0011) [2023-12-28 04:35:09,613][106226] Updated weights for policy 0, policy_version 1297740 (0.0011) [2023-12-28 04:35:09,686][106226] Updated weights for policy 0, policy_version 1297750 (0.0011) [2023-12-28 04:35:09,737][106225] Updated weights for policy 1, policy_version 1301116 (0.0009) [2023-12-28 04:35:09,801][106225] Updated weights for policy 1, policy_version 1301126 (0.0010) [2023-12-28 04:35:09,870][106225] Updated weights for policy 1, policy_version 1301136 (0.0011) [2023-12-28 04:35:10,400][106226] Updated weights for policy 0, policy_version 1297760 (0.0007) [2023-12-28 04:35:10,468][106226] Updated weights for policy 0, policy_version 1297770 (0.0009) [2023-12-28 04:35:10,532][106226] Updated weights for policy 0, policy_version 1297780 (0.0009) [2023-12-28 04:35:10,579][106225] Updated weights for policy 1, policy_version 1301146 (0.0011) [2023-12-28 04:35:10,628][106225] Updated weights for policy 1, policy_version 1301156 (0.0010) [2023-12-28 04:35:10,683][106225] Updated weights for policy 1, policy_version 1301166 (0.0008) [2023-12-28 04:35:10,738][106225] Updated weights for policy 1, policy_version 1301176 (0.0007) [2023-12-28 04:35:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 665444352. Throughput: 0: 9849.5, 1: 10116.2. Samples: 665419444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:11,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.927')] [2023-12-28 04:35:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001297784_332292096.pth... [2023-12-28 04:35:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001301176_333152256.pth... [2023-12-28 04:35:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001296632_331997184.pth [2023-12-28 04:35:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001299992_332849152.pth [2023-12-28 04:35:11,279][106226] Updated weights for policy 0, policy_version 1297790 (0.0008) [2023-12-28 04:35:11,345][106226] Updated weights for policy 0, policy_version 1297800 (0.0008) [2023-12-28 04:35:11,420][106226] Updated weights for policy 0, policy_version 1297810 (0.0008) [2023-12-28 04:35:11,544][106225] Updated weights for policy 1, policy_version 1301186 (0.0009) [2023-12-28 04:35:11,609][106225] Updated weights for policy 1, policy_version 1301196 (0.0010) [2023-12-28 04:35:11,675][106225] Updated weights for policy 1, policy_version 1301206 (0.0008) [2023-12-28 04:35:12,169][106226] Updated weights for policy 0, policy_version 1297820 (0.0008) [2023-12-28 04:35:12,223][106226] Updated weights for policy 0, policy_version 1297830 (0.0008) [2023-12-28 04:35:12,286][106226] Updated weights for policy 0, policy_version 1297840 (0.0007) [2023-12-28 04:35:12,431][106225] Updated weights for policy 1, policy_version 1301216 (0.0008) [2023-12-28 04:35:12,486][106225] Updated weights for policy 1, policy_version 1301226 (0.0008) [2023-12-28 04:35:12,547][106225] Updated weights for policy 1, policy_version 1301236 (0.0008) [2023-12-28 04:35:13,024][106226] Updated weights for policy 0, policy_version 1297850 (0.0009) [2023-12-28 04:35:13,084][106226] Updated weights for policy 0, policy_version 1297860 (0.0008) [2023-12-28 04:35:13,136][106226] Updated weights for policy 0, policy_version 1297870 (0.0008) [2023-12-28 04:35:13,193][106226] Updated weights for policy 0, policy_version 1297880 (0.0008) [2023-12-28 04:35:13,293][106225] Updated weights for policy 1, policy_version 1301246 (0.0007) [2023-12-28 04:35:13,353][106225] Updated weights for policy 1, policy_version 1301256 (0.0008) [2023-12-28 04:35:13,401][106225] Updated weights for policy 1, policy_version 1301266 (0.0009) [2023-12-28 04:35:13,916][106226] Updated weights for policy 0, policy_version 1297890 (0.0009) [2023-12-28 04:35:13,982][106226] Updated weights for policy 0, policy_version 1297900 (0.0010) [2023-12-28 04:35:14,049][106226] Updated weights for policy 0, policy_version 1297910 (0.0011) [2023-12-28 04:35:14,088][106225] Updated weights for policy 1, policy_version 1301276 (0.0007) [2023-12-28 04:35:14,138][106225] Updated weights for policy 1, policy_version 1301286 (0.0008) [2023-12-28 04:35:14,184][106225] Updated weights for policy 1, policy_version 1301296 (0.0007) [2023-12-28 04:35:14,766][106226] Updated weights for policy 0, policy_version 1297920 (0.0007) [2023-12-28 04:35:14,782][106225] Updated weights for policy 1, policy_version 1301306 (0.0007) [2023-12-28 04:35:14,833][106226] Updated weights for policy 0, policy_version 1297930 (0.0008) [2023-12-28 04:35:14,843][106225] Updated weights for policy 1, policy_version 1301316 (0.0007) [2023-12-28 04:35:14,896][106226] Updated weights for policy 0, policy_version 1297940 (0.0007) [2023-12-28 04:35:14,898][106225] Updated weights for policy 1, policy_version 1301326 (0.0006) [2023-12-28 04:35:14,954][106225] Updated weights for policy 1, policy_version 1301336 (0.0008) [2023-12-28 04:35:15,618][106226] Updated weights for policy 0, policy_version 1297950 (0.0007) [2023-12-28 04:35:15,672][106226] Updated weights for policy 0, policy_version 1297960 (0.0007) [2023-12-28 04:35:15,694][106225] Updated weights for policy 1, policy_version 1301346 (0.0006) [2023-12-28 04:35:15,723][106226] Updated weights for policy 0, policy_version 1297970 (0.0010) [2023-12-28 04:35:15,751][106225] Updated weights for policy 1, policy_version 1301356 (0.0006) [2023-12-28 04:35:15,807][106225] Updated weights for policy 1, policy_version 1301366 (0.0005) [2023-12-28 04:35:16,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 665542656. Throughput: 0: 9801.2, 1: 9998.2. Samples: 665533036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:16,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.889')] [2023-12-28 04:35:16,390][106226] Updated weights for policy 0, policy_version 1297980 (0.0008) [2023-12-28 04:35:16,419][106225] Updated weights for policy 1, policy_version 1301376 (0.0009) [2023-12-28 04:35:16,445][106226] Updated weights for policy 0, policy_version 1297990 (0.0006) [2023-12-28 04:35:16,470][106225] Updated weights for policy 1, policy_version 1301386 (0.0008) [2023-12-28 04:35:16,495][106226] Updated weights for policy 0, policy_version 1298000 (0.0008) [2023-12-28 04:35:16,514][106225] Updated weights for policy 1, policy_version 1301396 (0.0008) [2023-12-28 04:35:17,184][106226] Updated weights for policy 0, policy_version 1298010 (0.0008) [2023-12-28 04:35:17,218][106225] Updated weights for policy 1, policy_version 1301406 (0.0008) [2023-12-28 04:35:17,248][106226] Updated weights for policy 0, policy_version 1298020 (0.0007) [2023-12-28 04:35:17,282][106225] Updated weights for policy 1, policy_version 1301416 (0.0008) [2023-12-28 04:35:17,303][106226] Updated weights for policy 0, policy_version 1298030 (0.0005) [2023-12-28 04:35:17,349][106225] Updated weights for policy 1, policy_version 1301426 (0.0009) [2023-12-28 04:35:17,359][106226] Updated weights for policy 0, policy_version 1298040 (0.0005) [2023-12-28 04:35:17,967][106225] Updated weights for policy 1, policy_version 1301436 (0.0009) [2023-12-28 04:35:18,020][106225] Updated weights for policy 1, policy_version 1301446 (0.0006) [2023-12-28 04:35:18,046][106226] Updated weights for policy 0, policy_version 1298050 (0.0008) [2023-12-28 04:35:18,068][106225] Updated weights for policy 1, policy_version 1301456 (0.0005) [2023-12-28 04:35:18,108][106226] Updated weights for policy 0, policy_version 1298060 (0.0008) [2023-12-28 04:35:18,167][106226] Updated weights for policy 0, policy_version 1298070 (0.0008) [2023-12-28 04:35:18,685][106225] Updated weights for policy 1, policy_version 1301466 (0.0006) [2023-12-28 04:35:18,750][106225] Updated weights for policy 1, policy_version 1301476 (0.0008) [2023-12-28 04:35:18,810][106225] Updated weights for policy 1, policy_version 1301486 (0.0008) [2023-12-28 04:35:18,872][106225] Updated weights for policy 1, policy_version 1301496 (0.0008) [2023-12-28 04:35:18,920][106226] Updated weights for policy 0, policy_version 1298080 (0.0008) [2023-12-28 04:35:18,988][106226] Updated weights for policy 0, policy_version 1298090 (0.0009) [2023-12-28 04:35:19,058][106226] Updated weights for policy 0, policy_version 1298100 (0.0009) [2023-12-28 04:35:19,539][106225] Updated weights for policy 1, policy_version 1301506 (0.0009) [2023-12-28 04:35:19,598][106225] Updated weights for policy 1, policy_version 1301516 (0.0009) [2023-12-28 04:35:19,657][106225] Updated weights for policy 1, policy_version 1301526 (0.0009) [2023-12-28 04:35:19,822][106226] Updated weights for policy 0, policy_version 1298110 (0.0009) [2023-12-28 04:35:19,902][106226] Updated weights for policy 0, policy_version 1298120 (0.0008) [2023-12-28 04:35:19,975][106226] Updated weights for policy 0, policy_version 1298130 (0.0008) [2023-12-28 04:35:20,372][106225] Updated weights for policy 1, policy_version 1301536 (0.0008) [2023-12-28 04:35:20,435][106225] Updated weights for policy 1, policy_version 1301546 (0.0009) [2023-12-28 04:35:20,489][106225] Updated weights for policy 1, policy_version 1301556 (0.0009) [2023-12-28 04:35:20,731][106226] Updated weights for policy 0, policy_version 1298140 (0.0008) [2023-12-28 04:35:20,791][106226] Updated weights for policy 0, policy_version 1298150 (0.0009) [2023-12-28 04:35:20,848][106226] Updated weights for policy 0, policy_version 1298160 (0.0009) [2023-12-28 04:35:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 665640960. Throughput: 0: 9764.7, 1: 9988.9. Samples: 665651728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:21,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.994')] [2023-12-28 04:35:21,261][106225] Updated weights for policy 1, policy_version 1301566 (0.0009) [2023-12-28 04:35:21,323][106225] Updated weights for policy 1, policy_version 1301576 (0.0008) [2023-12-28 04:35:21,389][106225] Updated weights for policy 1, policy_version 1301586 (0.0008) [2023-12-28 04:35:21,618][106226] Updated weights for policy 0, policy_version 1298170 (0.0008) [2023-12-28 04:35:21,689][106226] Updated weights for policy 0, policy_version 1298180 (0.0008) [2023-12-28 04:35:21,757][106226] Updated weights for policy 0, policy_version 1298190 (0.0008) [2023-12-28 04:35:21,814][106226] Updated weights for policy 0, policy_version 1298200 (0.0006) [2023-12-28 04:35:22,173][106225] Updated weights for policy 1, policy_version 1301596 (0.0008) [2023-12-28 04:35:22,232][106225] Updated weights for policy 1, policy_version 1301606 (0.0008) [2023-12-28 04:35:22,303][106225] Updated weights for policy 1, policy_version 1301616 (0.0009) [2023-12-28 04:35:22,498][106226] Updated weights for policy 0, policy_version 1298210 (0.0009) [2023-12-28 04:35:22,568][106226] Updated weights for policy 0, policy_version 1298220 (0.0009) [2023-12-28 04:35:22,634][106226] Updated weights for policy 0, policy_version 1298230 (0.0008) [2023-12-28 04:35:23,102][106225] Updated weights for policy 1, policy_version 1301626 (0.0008) [2023-12-28 04:35:23,154][106225] Updated weights for policy 1, policy_version 1301636 (0.0005) [2023-12-28 04:35:23,207][106225] Updated weights for policy 1, policy_version 1301646 (0.0006) [2023-12-28 04:35:23,258][106225] Updated weights for policy 1, policy_version 1301656 (0.0005) [2023-12-28 04:35:23,293][106226] Updated weights for policy 0, policy_version 1298240 (0.0007) [2023-12-28 04:35:23,349][106226] Updated weights for policy 0, policy_version 1298250 (0.0005) [2023-12-28 04:35:23,402][106226] Updated weights for policy 0, policy_version 1298260 (0.0005) [2023-12-28 04:35:23,946][106226] Updated weights for policy 0, policy_version 1298270 (0.0008) [2023-12-28 04:35:23,971][106225] Updated weights for policy 1, policy_version 1301666 (0.0005) [2023-12-28 04:35:23,996][106226] Updated weights for policy 0, policy_version 1298280 (0.0010) [2023-12-28 04:35:24,023][106225] Updated weights for policy 1, policy_version 1301676 (0.0006) [2023-12-28 04:35:24,048][106226] Updated weights for policy 0, policy_version 1298290 (0.0011) [2023-12-28 04:35:24,074][106225] Updated weights for policy 1, policy_version 1301686 (0.0006) [2023-12-28 04:35:24,788][106226] Updated weights for policy 0, policy_version 1298300 (0.0010) [2023-12-28 04:35:24,821][106225] Updated weights for policy 1, policy_version 1301696 (0.0006) [2023-12-28 04:35:24,845][106226] Updated weights for policy 0, policy_version 1298310 (0.0010) [2023-12-28 04:35:24,866][106225] Updated weights for policy 1, policy_version 1301706 (0.0005) [2023-12-28 04:35:24,894][106226] Updated weights for policy 0, policy_version 1298320 (0.0010) [2023-12-28 04:35:24,915][106225] Updated weights for policy 1, policy_version 1301716 (0.0006) [2023-12-28 04:35:25,463][106226] Updated weights for policy 0, policy_version 1298330 (0.0009) [2023-12-28 04:35:25,510][106226] Updated weights for policy 0, policy_version 1298340 (0.0010) [2023-12-28 04:35:25,557][106226] Updated weights for policy 0, policy_version 1298350 (0.0010) [2023-12-28 04:35:25,603][106226] Updated weights for policy 0, policy_version 1298360 (0.0010) [2023-12-28 04:35:25,646][106225] Updated weights for policy 1, policy_version 1301726 (0.0008) [2023-12-28 04:35:25,693][106225] Updated weights for policy 1, policy_version 1301736 (0.0010) [2023-12-28 04:35:25,744][106225] Updated weights for policy 1, policy_version 1301746 (0.0010) [2023-12-28 04:35:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19771.8). Total num frames: 665739264. Throughput: 0: 9774.6, 1: 9967.0. Samples: 665710088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-28 04:35:26,176][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.999')] [2023-12-28 04:35:26,182][106226] Updated weights for policy 0, policy_version 1298370 (0.0006) [2023-12-28 04:35:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001301752_333299712.pth... [2023-12-28 04:35:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001300600_333004800.pth [2023-12-28 04:35:26,242][106226] Updated weights for policy 0, policy_version 1298380 (0.0007) [2023-12-28 04:35:26,306][106226] Updated weights for policy 0, policy_version 1298390 (0.0006) [2023-12-28 04:35:26,319][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001298392_332447744.pth... [2023-12-28 04:35:26,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001297208_332144640.pth [2023-12-28 04:35:26,484][106225] Updated weights for policy 1, policy_version 1301756 (0.0010) [2023-12-28 04:35:26,536][106225] Updated weights for policy 1, policy_version 1301766 (0.0010) [2023-12-28 04:35:26,592][106225] Updated weights for policy 1, policy_version 1301776 (0.0010) [2023-12-28 04:35:26,953][106226] Updated weights for policy 0, policy_version 1298400 (0.0007) [2023-12-28 04:35:27,006][106226] Updated weights for policy 0, policy_version 1298410 (0.0008) [2023-12-28 04:35:27,069][106226] Updated weights for policy 0, policy_version 1298420 (0.0007) [2023-12-28 04:35:27,201][106225] Updated weights for policy 1, policy_version 1301786 (0.0006) [2023-12-28 04:35:27,261][106225] Updated weights for policy 1, policy_version 1301796 (0.0006) [2023-12-28 04:35:27,323][106225] Updated weights for policy 1, policy_version 1301806 (0.0008) [2023-12-28 04:35:27,379][106225] Updated weights for policy 1, policy_version 1301816 (0.0008) [2023-12-28 04:35:27,725][106226] Updated weights for policy 0, policy_version 1298430 (0.0007) [2023-12-28 04:35:27,790][106226] Updated weights for policy 0, policy_version 1298440 (0.0005) [2023-12-28 04:35:27,847][106226] Updated weights for policy 0, policy_version 1298450 (0.0005) [2023-12-28 04:35:28,073][106225] Updated weights for policy 1, policy_version 1301826 (0.0007) [2023-12-28 04:35:28,123][106225] Updated weights for policy 1, policy_version 1301836 (0.0007) [2023-12-28 04:35:28,175][106225] Updated weights for policy 1, policy_version 1301846 (0.0007) [2023-12-28 04:35:28,422][106226] Updated weights for policy 0, policy_version 1298460 (0.0007) [2023-12-28 04:35:28,478][106226] Updated weights for policy 0, policy_version 1298470 (0.0010) [2023-12-28 04:35:28,532][106226] Updated weights for policy 0, policy_version 1298480 (0.0010) [2023-12-28 04:35:28,934][106225] Updated weights for policy 1, policy_version 1301856 (0.0007) [2023-12-28 04:35:28,986][106225] Updated weights for policy 1, policy_version 1301866 (0.0007) [2023-12-28 04:35:29,040][106225] Updated weights for policy 1, policy_version 1301876 (0.0005) [2023-12-28 04:35:29,245][106226] Updated weights for policy 0, policy_version 1298490 (0.0010) [2023-12-28 04:35:29,325][106226] Updated weights for policy 0, policy_version 1298500 (0.0011) [2023-12-28 04:35:29,406][106226] Updated weights for policy 0, policy_version 1298510 (0.0010) [2023-12-28 04:35:29,477][106226] Updated weights for policy 0, policy_version 1298520 (0.0008) [2023-12-28 04:35:29,746][106225] Updated weights for policy 1, policy_version 1301886 (0.0007) [2023-12-28 04:35:29,811][106225] Updated weights for policy 1, policy_version 1301896 (0.0008) [2023-12-28 04:35:29,877][106225] Updated weights for policy 1, policy_version 1301906 (0.0009) [2023-12-28 04:35:30,180][106226] Updated weights for policy 0, policy_version 1298530 (0.0005) [2023-12-28 04:35:30,237][106226] Updated weights for policy 0, policy_version 1298540 (0.0007) [2023-12-28 04:35:30,302][106226] Updated weights for policy 0, policy_version 1298550 (0.0011) [2023-12-28 04:35:30,638][106225] Updated weights for policy 1, policy_version 1301916 (0.0007) [2023-12-28 04:35:30,700][106225] Updated weights for policy 1, policy_version 1301926 (0.0005) [2023-12-28 04:35:30,758][106225] Updated weights for policy 1, policy_version 1301936 (0.0005) [2023-12-28 04:35:30,971][106226] Updated weights for policy 0, policy_version 1298560 (0.0011) [2023-12-28 04:35:31,032][106226] Updated weights for policy 0, policy_version 1298570 (0.0010) [2023-12-28 04:35:31,104][106226] Updated weights for policy 0, policy_version 1298580 (0.0010) [2023-12-28 04:35:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 665845760. Throughput: 0: 9973.0, 1: 9978.6. Samples: 665832940. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:31,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-4.804')] [2023-12-28 04:35:31,369][106225] Updated weights for policy 1, policy_version 1301946 (0.0006) [2023-12-28 04:35:31,433][106225] Updated weights for policy 1, policy_version 1301956 (0.0010) [2023-12-28 04:35:31,494][106225] Updated weights for policy 1, policy_version 1301966 (0.0009) [2023-12-28 04:35:31,547][106225] Updated weights for policy 1, policy_version 1301976 (0.0008) [2023-12-28 04:35:31,853][106226] Updated weights for policy 0, policy_version 1298590 (0.0008) [2023-12-28 04:35:31,910][106226] Updated weights for policy 0, policy_version 1298600 (0.0008) [2023-12-28 04:35:31,970][106226] Updated weights for policy 0, policy_version 1298610 (0.0008) [2023-12-28 04:35:32,241][106225] Updated weights for policy 1, policy_version 1301986 (0.0009) [2023-12-28 04:35:32,305][106225] Updated weights for policy 1, policy_version 1301996 (0.0008) [2023-12-28 04:35:32,366][106225] Updated weights for policy 1, policy_version 1302006 (0.0008) [2023-12-28 04:35:32,669][106226] Updated weights for policy 0, policy_version 1298620 (0.0008) [2023-12-28 04:35:32,734][106226] Updated weights for policy 0, policy_version 1298630 (0.0008) [2023-12-28 04:35:32,795][106226] Updated weights for policy 0, policy_version 1298640 (0.0008) [2023-12-28 04:35:33,053][106225] Updated weights for policy 1, policy_version 1302016 (0.0009) [2023-12-28 04:35:33,106][106225] Updated weights for policy 1, policy_version 1302026 (0.0008) [2023-12-28 04:35:33,151][106225] Updated weights for policy 1, policy_version 1302036 (0.0008) [2023-12-28 04:35:33,507][106226] Updated weights for policy 0, policy_version 1298650 (0.0008) [2023-12-28 04:35:33,565][106226] Updated weights for policy 0, policy_version 1298660 (0.0009) [2023-12-28 04:35:33,624][106226] Updated weights for policy 0, policy_version 1298670 (0.0007) [2023-12-28 04:35:33,685][106226] Updated weights for policy 0, policy_version 1298680 (0.0008) [2023-12-28 04:35:33,891][106225] Updated weights for policy 1, policy_version 1302046 (0.0009) [2023-12-28 04:35:33,944][106225] Updated weights for policy 1, policy_version 1302056 (0.0008) [2023-12-28 04:35:33,993][106225] Updated weights for policy 1, policy_version 1302066 (0.0009) [2023-12-28 04:35:34,394][106226] Updated weights for policy 0, policy_version 1298690 (0.0008) [2023-12-28 04:35:34,464][106226] Updated weights for policy 0, policy_version 1298700 (0.0008) [2023-12-28 04:35:34,522][106226] Updated weights for policy 0, policy_version 1298710 (0.0008) [2023-12-28 04:35:34,727][106225] Updated weights for policy 1, policy_version 1302076 (0.0009) [2023-12-28 04:35:34,785][106225] Updated weights for policy 1, policy_version 1302086 (0.0008) [2023-12-28 04:35:34,846][106225] Updated weights for policy 1, policy_version 1302096 (0.0008) [2023-12-28 04:35:35,237][106226] Updated weights for policy 0, policy_version 1298720 (0.0007) [2023-12-28 04:35:35,294][106226] Updated weights for policy 0, policy_version 1298730 (0.0008) [2023-12-28 04:35:35,355][106226] Updated weights for policy 0, policy_version 1298740 (0.0009) [2023-12-28 04:35:35,616][106225] Updated weights for policy 1, policy_version 1302106 (0.0009) [2023-12-28 04:35:35,668][106225] Updated weights for policy 1, policy_version 1302116 (0.0009) [2023-12-28 04:35:35,724][106225] Updated weights for policy 1, policy_version 1302126 (0.0009) [2023-12-28 04:35:35,778][106225] Updated weights for policy 1, policy_version 1302136 (0.0009) [2023-12-28 04:35:35,950][106226] Updated weights for policy 0, policy_version 1298750 (0.0008) [2023-12-28 04:35:36,008][106226] Updated weights for policy 0, policy_version 1298760 (0.0007) [2023-12-28 04:35:36,073][106226] Updated weights for policy 0, policy_version 1298770 (0.0009) [2023-12-28 04:35:36,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 665944064. Throughput: 0: 9974.1, 1: 9917.3. Samples: 665950056. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:36,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-5.113')] [2023-12-28 04:35:36,591][106225] Updated weights for policy 1, policy_version 1302146 (0.0010) [2023-12-28 04:35:36,656][106225] Updated weights for policy 1, policy_version 1302156 (0.0011) [2023-12-28 04:35:36,721][106225] Updated weights for policy 1, policy_version 1302166 (0.0011) [2023-12-28 04:35:36,722][106226] Updated weights for policy 0, policy_version 1298780 (0.0009) [2023-12-28 04:35:36,777][106226] Updated weights for policy 0, policy_version 1298790 (0.0008) [2023-12-28 04:35:36,823][106226] Updated weights for policy 0, policy_version 1298800 (0.0007) [2023-12-28 04:35:37,425][106225] Updated weights for policy 1, policy_version 1302176 (0.0006) [2023-12-28 04:35:37,434][106226] Updated weights for policy 0, policy_version 1298810 (0.0008) [2023-12-28 04:35:37,487][106225] Updated weights for policy 1, policy_version 1302186 (0.0006) [2023-12-28 04:35:37,499][106226] Updated weights for policy 0, policy_version 1298820 (0.0009) [2023-12-28 04:35:37,546][106225] Updated weights for policy 1, policy_version 1302196 (0.0010) [2023-12-28 04:35:37,559][106226] Updated weights for policy 0, policy_version 1298830 (0.0007) [2023-12-28 04:35:37,621][106226] Updated weights for policy 0, policy_version 1298840 (0.0008) [2023-12-28 04:35:38,132][106225] Updated weights for policy 1, policy_version 1302206 (0.0007) [2023-12-28 04:35:38,190][106225] Updated weights for policy 1, policy_version 1302216 (0.0006) [2023-12-28 04:35:38,243][106225] Updated weights for policy 1, policy_version 1302226 (0.0010) [2023-12-28 04:35:38,341][106226] Updated weights for policy 0, policy_version 1298850 (0.0006) [2023-12-28 04:35:38,400][106226] Updated weights for policy 0, policy_version 1298860 (0.0008) [2023-12-28 04:35:38,469][106226] Updated weights for policy 0, policy_version 1298870 (0.0008) [2023-12-28 04:35:38,937][106225] Updated weights for policy 1, policy_version 1302236 (0.0010) [2023-12-28 04:35:39,004][106225] Updated weights for policy 1, policy_version 1302246 (0.0006) [2023-12-28 04:35:39,056][106225] Updated weights for policy 1, policy_version 1302256 (0.0008) [2023-12-28 04:35:39,143][106226] Updated weights for policy 0, policy_version 1298880 (0.0008) [2023-12-28 04:35:39,211][106226] Updated weights for policy 0, policy_version 1298890 (0.0008) [2023-12-28 04:35:39,278][106226] Updated weights for policy 0, policy_version 1298900 (0.0010) [2023-12-28 04:35:39,740][106225] Updated weights for policy 1, policy_version 1302266 (0.0008) [2023-12-28 04:35:39,803][106225] Updated weights for policy 1, policy_version 1302276 (0.0006) [2023-12-28 04:35:39,872][106225] Updated weights for policy 1, policy_version 1302286 (0.0008) [2023-12-28 04:35:39,931][106225] Updated weights for policy 1, policy_version 1302296 (0.0008) [2023-12-28 04:35:40,042][106226] Updated weights for policy 0, policy_version 1298910 (0.0010) [2023-12-28 04:35:40,116][106226] Updated weights for policy 0, policy_version 1298920 (0.0009) [2023-12-28 04:35:40,180][106226] Updated weights for policy 0, policy_version 1298930 (0.0009) [2023-12-28 04:35:40,634][106225] Updated weights for policy 1, policy_version 1302306 (0.0006) [2023-12-28 04:35:40,696][106225] Updated weights for policy 1, policy_version 1302316 (0.0008) [2023-12-28 04:35:40,764][106225] Updated weights for policy 1, policy_version 1302326 (0.0006) [2023-12-28 04:35:40,916][106226] Updated weights for policy 0, policy_version 1298940 (0.0008) [2023-12-28 04:35:40,973][106226] Updated weights for policy 0, policy_version 1298950 (0.0008) [2023-12-28 04:35:41,038][106226] Updated weights for policy 0, policy_version 1298960 (0.0009) [2023-12-28 04:35:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 666042368. Throughput: 0: 9986.8, 1: 9941.2. Samples: 666011368. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:41,175][105115] Avg episode reward: [(0, '-4.234'), (1, '-5.041')] [2023-12-28 04:35:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001302328_333447168.pth... [2023-12-28 04:35:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001298968_332595200.pth... [2023-12-28 04:35:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001297784_332292096.pth [2023-12-28 04:35:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001301176_333152256.pth [2023-12-28 04:35:41,459][106225] Updated weights for policy 1, policy_version 1302336 (0.0007) [2023-12-28 04:35:41,521][106225] Updated weights for policy 1, policy_version 1302346 (0.0006) [2023-12-28 04:35:41,588][106225] Updated weights for policy 1, policy_version 1302356 (0.0007) [2023-12-28 04:35:41,913][106226] Updated weights for policy 0, policy_version 1298970 (0.0009) [2023-12-28 04:35:41,977][106226] Updated weights for policy 0, policy_version 1298980 (0.0009) [2023-12-28 04:35:42,041][106226] Updated weights for policy 0, policy_version 1298990 (0.0009) [2023-12-28 04:35:42,103][106226] Updated weights for policy 0, policy_version 1299000 (0.0009) [2023-12-28 04:35:42,372][106225] Updated weights for policy 1, policy_version 1302366 (0.0008) [2023-12-28 04:35:42,427][106225] Updated weights for policy 1, policy_version 1302376 (0.0009) [2023-12-28 04:35:42,483][106225] Updated weights for policy 1, policy_version 1302386 (0.0009) [2023-12-28 04:35:42,859][106226] Updated weights for policy 0, policy_version 1299010 (0.0009) [2023-12-28 04:35:42,917][106226] Updated weights for policy 0, policy_version 1299020 (0.0010) [2023-12-28 04:35:42,978][106226] Updated weights for policy 0, policy_version 1299030 (0.0009) [2023-12-28 04:35:43,128][106225] Updated weights for policy 1, policy_version 1302396 (0.0008) [2023-12-28 04:35:43,191][106225] Updated weights for policy 1, policy_version 1302406 (0.0005) [2023-12-28 04:35:43,252][106225] Updated weights for policy 1, policy_version 1302416 (0.0005) [2023-12-28 04:35:43,704][106226] Updated weights for policy 0, policy_version 1299040 (0.0009) [2023-12-28 04:35:43,762][106226] Updated weights for policy 0, policy_version 1299050 (0.0008) [2023-12-28 04:35:43,773][106225] Updated weights for policy 1, policy_version 1302426 (0.0006) [2023-12-28 04:35:43,821][106226] Updated weights for policy 0, policy_version 1299060 (0.0005) [2023-12-28 04:35:43,823][106225] Updated weights for policy 1, policy_version 1302436 (0.0008) [2023-12-28 04:35:43,879][106225] Updated weights for policy 1, policy_version 1302446 (0.0009) [2023-12-28 04:35:43,934][106225] Updated weights for policy 1, policy_version 1302456 (0.0009) [2023-12-28 04:35:44,445][106226] Updated weights for policy 0, policy_version 1299070 (0.0007) [2023-12-28 04:35:44,493][106226] Updated weights for policy 0, policy_version 1299080 (0.0008) [2023-12-28 04:35:44,540][106226] Updated weights for policy 0, policy_version 1299090 (0.0008) [2023-12-28 04:35:44,676][106225] Updated weights for policy 1, policy_version 1302466 (0.0008) [2023-12-28 04:35:44,738][106225] Updated weights for policy 1, policy_version 1302476 (0.0008) [2023-12-28 04:35:44,802][106225] Updated weights for policy 1, policy_version 1302486 (0.0008) [2023-12-28 04:35:45,325][106226] Updated weights for policy 0, policy_version 1299100 (0.0009) [2023-12-28 04:35:45,390][106226] Updated weights for policy 0, policy_version 1299110 (0.0011) [2023-12-28 04:35:45,448][106226] Updated weights for policy 0, policy_version 1299120 (0.0011) [2023-12-28 04:35:45,522][106225] Updated weights for policy 1, policy_version 1302496 (0.0010) [2023-12-28 04:35:45,575][106225] Updated weights for policy 1, policy_version 1302506 (0.0010) [2023-12-28 04:35:45,634][106225] Updated weights for policy 1, policy_version 1302516 (0.0010) [2023-12-28 04:35:46,132][106226] Updated weights for policy 0, policy_version 1299130 (0.0011) [2023-12-28 04:35:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 666132480. Throughput: 0: 9904.8, 1: 9933.8. Samples: 666126752. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:46,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.959')] [2023-12-28 04:35:46,192][106226] Updated weights for policy 0, policy_version 1299140 (0.0011) [2023-12-28 04:35:46,254][106226] Updated weights for policy 0, policy_version 1299150 (0.0010) [2023-12-28 04:35:46,318][106226] Updated weights for policy 0, policy_version 1299160 (0.0006) [2023-12-28 04:35:46,363][106225] Updated weights for policy 1, policy_version 1302526 (0.0010) [2023-12-28 04:35:46,420][106225] Updated weights for policy 1, policy_version 1302536 (0.0010) [2023-12-28 04:35:46,480][106225] Updated weights for policy 1, policy_version 1302546 (0.0010) [2023-12-28 04:35:46,944][106226] Updated weights for policy 0, policy_version 1299170 (0.0010) [2023-12-28 04:35:46,997][106226] Updated weights for policy 0, policy_version 1299180 (0.0010) [2023-12-28 04:35:47,057][106226] Updated weights for policy 0, policy_version 1299190 (0.0010) [2023-12-28 04:35:47,204][106225] Updated weights for policy 1, policy_version 1302556 (0.0008) [2023-12-28 04:35:47,263][106225] Updated weights for policy 1, policy_version 1302566 (0.0005) [2023-12-28 04:35:47,318][106225] Updated weights for policy 1, policy_version 1302576 (0.0006) [2023-12-28 04:35:47,740][106226] Updated weights for policy 0, policy_version 1299200 (0.0009) [2023-12-28 04:35:47,794][106226] Updated weights for policy 0, policy_version 1299210 (0.0009) [2023-12-28 04:35:47,851][106226] Updated weights for policy 0, policy_version 1299220 (0.0008) [2023-12-28 04:35:47,858][106225] Updated weights for policy 1, policy_version 1302586 (0.0009) [2023-12-28 04:35:47,919][106225] Updated weights for policy 1, policy_version 1302596 (0.0009) [2023-12-28 04:35:47,962][106225] Updated weights for policy 1, policy_version 1302606 (0.0010) [2023-12-28 04:35:48,023][106225] Updated weights for policy 1, policy_version 1302616 (0.0010) [2023-12-28 04:35:48,652][106226] Updated weights for policy 0, policy_version 1299230 (0.0009) [2023-12-28 04:35:48,720][106226] Updated weights for policy 0, policy_version 1299240 (0.0008) [2023-12-28 04:35:48,730][106225] Updated weights for policy 1, policy_version 1302626 (0.0007) [2023-12-28 04:35:48,779][106226] Updated weights for policy 0, policy_version 1299250 (0.0006) [2023-12-28 04:35:48,793][106225] Updated weights for policy 1, policy_version 1302636 (0.0008) [2023-12-28 04:35:48,860][106225] Updated weights for policy 1, policy_version 1302646 (0.0008) [2023-12-28 04:35:49,460][106226] Updated weights for policy 0, policy_version 1299260 (0.0006) [2023-12-28 04:35:49,524][106226] Updated weights for policy 0, policy_version 1299270 (0.0007) [2023-12-28 04:35:49,593][106225] Updated weights for policy 1, policy_version 1302656 (0.0008) [2023-12-28 04:35:49,594][106226] Updated weights for policy 0, policy_version 1299280 (0.0008) [2023-12-28 04:35:49,650][106225] Updated weights for policy 1, policy_version 1302666 (0.0006) [2023-12-28 04:35:49,712][106225] Updated weights for policy 1, policy_version 1302676 (0.0006) [2023-12-28 04:35:50,370][106226] Updated weights for policy 0, policy_version 1299290 (0.0006) [2023-12-28 04:35:50,433][106225] Updated weights for policy 1, policy_version 1302686 (0.0006) [2023-12-28 04:35:50,435][106226] Updated weights for policy 0, policy_version 1299300 (0.0009) [2023-12-28 04:35:50,493][106225] Updated weights for policy 1, policy_version 1302696 (0.0006) [2023-12-28 04:35:50,498][106226] Updated weights for policy 0, policy_version 1299310 (0.0008) [2023-12-28 04:35:50,549][106225] Updated weights for policy 1, policy_version 1302706 (0.0006) [2023-12-28 04:35:50,563][106226] Updated weights for policy 0, policy_version 1299320 (0.0007) [2023-12-28 04:35:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 666230784. Throughput: 0: 9838.0, 1: 9855.0. Samples: 666243956. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:51,175][105115] Avg episode reward: [(0, '-4.317'), (1, '-5.110')] [2023-12-28 04:35:51,331][106226] Updated weights for policy 0, policy_version 1299330 (0.0011) [2023-12-28 04:35:51,368][106225] Updated weights for policy 1, policy_version 1302716 (0.0009) [2023-12-28 04:35:51,408][106226] Updated weights for policy 0, policy_version 1299340 (0.0008) [2023-12-28 04:35:51,440][106225] Updated weights for policy 1, policy_version 1302726 (0.0008) [2023-12-28 04:35:51,475][106226] Updated weights for policy 0, policy_version 1299350 (0.0006) [2023-12-28 04:35:51,498][106225] Updated weights for policy 1, policy_version 1302736 (0.0007) [2023-12-28 04:35:52,140][106226] Updated weights for policy 0, policy_version 1299360 (0.0006) [2023-12-28 04:35:52,201][106226] Updated weights for policy 0, policy_version 1299370 (0.0006) [2023-12-28 04:35:52,259][106226] Updated weights for policy 0, policy_version 1299380 (0.0007) [2023-12-28 04:35:52,266][106225] Updated weights for policy 1, policy_version 1302746 (0.0007) [2023-12-28 04:35:52,321][106225] Updated weights for policy 1, policy_version 1302756 (0.0008) [2023-12-28 04:35:52,379][106225] Updated weights for policy 1, policy_version 1302766 (0.0008) [2023-12-28 04:35:52,442][106225] Updated weights for policy 1, policy_version 1302776 (0.0008) [2023-12-28 04:35:52,899][106226] Updated weights for policy 0, policy_version 1299390 (0.0006) [2023-12-28 04:35:52,959][106226] Updated weights for policy 0, policy_version 1299400 (0.0007) [2023-12-28 04:35:53,008][106226] Updated weights for policy 0, policy_version 1299410 (0.0009) [2023-12-28 04:35:53,165][106225] Updated weights for policy 1, policy_version 1302786 (0.0008) [2023-12-28 04:35:53,220][106225] Updated weights for policy 1, policy_version 1302796 (0.0005) [2023-12-28 04:35:53,272][106225] Updated weights for policy 1, policy_version 1302806 (0.0010) [2023-12-28 04:35:53,620][106226] Updated weights for policy 0, policy_version 1299420 (0.0008) [2023-12-28 04:35:53,669][106226] Updated weights for policy 0, policy_version 1299430 (0.0009) [2023-12-28 04:35:53,733][106226] Updated weights for policy 0, policy_version 1299440 (0.0008) [2023-12-28 04:35:53,947][106225] Updated weights for policy 1, policy_version 1302816 (0.0009) [2023-12-28 04:35:54,010][106225] Updated weights for policy 1, policy_version 1302826 (0.0007) [2023-12-28 04:35:54,058][106225] Updated weights for policy 1, policy_version 1302836 (0.0008) [2023-12-28 04:35:54,472][106226] Updated weights for policy 0, policy_version 1299450 (0.0008) [2023-12-28 04:35:54,535][106226] Updated weights for policy 0, policy_version 1299460 (0.0009) [2023-12-28 04:35:54,582][106226] Updated weights for policy 0, policy_version 1299470 (0.0008) [2023-12-28 04:35:54,632][106226] Updated weights for policy 0, policy_version 1299480 (0.0008) [2023-12-28 04:35:54,755][106225] Updated weights for policy 1, policy_version 1302846 (0.0007) [2023-12-28 04:35:54,819][106225] Updated weights for policy 1, policy_version 1302856 (0.0007) [2023-12-28 04:35:54,876][106225] Updated weights for policy 1, policy_version 1302866 (0.0010) [2023-12-28 04:35:55,405][106226] Updated weights for policy 0, policy_version 1299490 (0.0010) [2023-12-28 04:35:55,425][106225] Updated weights for policy 1, policy_version 1302876 (0.0008) [2023-12-28 04:35:55,463][106226] Updated weights for policy 0, policy_version 1299500 (0.0009) [2023-12-28 04:35:55,473][106225] Updated weights for policy 1, policy_version 1302886 (0.0005) [2023-12-28 04:35:55,525][106226] Updated weights for policy 0, policy_version 1299510 (0.0008) [2023-12-28 04:35:55,527][106225] Updated weights for policy 1, policy_version 1302896 (0.0005) [2023-12-28 04:35:56,140][106226] Updated weights for policy 0, policy_version 1299520 (0.0010) [2023-12-28 04:35:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 666329088. Throughput: 0: 9820.1, 1: 9807.0. Samples: 666302664. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:35:56,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.898')] [2023-12-28 04:35:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001302904_333594624.pth... [2023-12-28 04:35:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001301752_333299712.pth [2023-12-28 04:35:56,193][106226] Updated weights for policy 0, policy_version 1299530 (0.0011) [2023-12-28 04:35:56,244][106226] Updated weights for policy 0, policy_version 1299540 (0.0011) [2023-12-28 04:35:56,263][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001299544_332742656.pth... [2023-12-28 04:35:56,266][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001298392_332447744.pth [2023-12-28 04:35:56,297][106225] Updated weights for policy 1, policy_version 1302906 (0.0009) [2023-12-28 04:35:56,356][106225] Updated weights for policy 1, policy_version 1302916 (0.0010) [2023-12-28 04:35:56,410][106225] Updated weights for policy 1, policy_version 1302926 (0.0010) [2023-12-28 04:35:56,466][106225] Updated weights for policy 1, policy_version 1302936 (0.0007) [2023-12-28 04:35:56,867][106226] Updated weights for policy 0, policy_version 1299550 (0.0010) [2023-12-28 04:35:56,929][106226] Updated weights for policy 0, policy_version 1299560 (0.0007) [2023-12-28 04:35:56,987][106226] Updated weights for policy 0, policy_version 1299570 (0.0010) [2023-12-28 04:35:57,111][106225] Updated weights for policy 1, policy_version 1302946 (0.0008) [2023-12-28 04:35:57,166][106225] Updated weights for policy 1, policy_version 1302956 (0.0007) [2023-12-28 04:35:57,221][106225] Updated weights for policy 1, policy_version 1302966 (0.0006) [2023-12-28 04:35:57,604][106226] Updated weights for policy 0, policy_version 1299580 (0.0008) [2023-12-28 04:35:57,652][106226] Updated weights for policy 0, policy_version 1299590 (0.0010) [2023-12-28 04:35:57,704][106226] Updated weights for policy 0, policy_version 1299600 (0.0010) [2023-12-28 04:35:57,863][106225] Updated weights for policy 1, policy_version 1302976 (0.0005) [2023-12-28 04:35:57,916][106225] Updated weights for policy 1, policy_version 1302986 (0.0005) [2023-12-28 04:35:57,976][106225] Updated weights for policy 1, policy_version 1302996 (0.0006) [2023-12-28 04:35:58,400][106226] Updated weights for policy 0, policy_version 1299610 (0.0009) [2023-12-28 04:35:58,462][106226] Updated weights for policy 0, policy_version 1299620 (0.0011) [2023-12-28 04:35:58,531][106226] Updated weights for policy 0, policy_version 1299630 (0.0011) [2023-12-28 04:35:58,597][106226] Updated weights for policy 0, policy_version 1299640 (0.0010) [2023-12-28 04:35:58,702][106225] Updated weights for policy 1, policy_version 1303006 (0.0009) [2023-12-28 04:35:58,769][106225] Updated weights for policy 1, policy_version 1303016 (0.0012) [2023-12-28 04:35:58,837][106225] Updated weights for policy 1, policy_version 1303026 (0.0008) [2023-12-28 04:35:59,491][106226] Updated weights for policy 0, policy_version 1299650 (0.0008) [2023-12-28 04:35:59,540][106226] Updated weights for policy 0, policy_version 1299660 (0.0008) [2023-12-28 04:35:59,569][106225] Updated weights for policy 1, policy_version 1303036 (0.0009) [2023-12-28 04:35:59,588][106226] Updated weights for policy 0, policy_version 1299670 (0.0007) [2023-12-28 04:35:59,627][106225] Updated weights for policy 1, policy_version 1303046 (0.0009) [2023-12-28 04:35:59,687][106225] Updated weights for policy 1, policy_version 1303056 (0.0006) [2023-12-28 04:36:00,368][106225] Updated weights for policy 1, policy_version 1303066 (0.0006) [2023-12-28 04:36:00,396][106226] Updated weights for policy 0, policy_version 1299680 (0.0008) [2023-12-28 04:36:00,419][106225] Updated weights for policy 1, policy_version 1303076 (0.0006) [2023-12-28 04:36:00,456][106226] Updated weights for policy 0, policy_version 1299690 (0.0008) [2023-12-28 04:36:00,471][106225] Updated weights for policy 1, policy_version 1303086 (0.0006) [2023-12-28 04:36:00,509][106226] Updated weights for policy 0, policy_version 1299700 (0.0006) [2023-12-28 04:36:00,522][106225] Updated weights for policy 1, policy_version 1303096 (0.0007) [2023-12-28 04:36:01,129][106226] Updated weights for policy 0, policy_version 1299710 (0.0009) [2023-12-28 04:36:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 666427392. Throughput: 0: 9889.3, 1: 9876.1. Samples: 666422480. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:01,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.956')] [2023-12-28 04:36:01,197][106226] Updated weights for policy 0, policy_version 1299720 (0.0007) [2023-12-28 04:36:01,231][106225] Updated weights for policy 1, policy_version 1303106 (0.0011) [2023-12-28 04:36:01,265][106226] Updated weights for policy 0, policy_version 1299730 (0.0008) [2023-12-28 04:36:01,299][106225] Updated weights for policy 1, policy_version 1303116 (0.0008) [2023-12-28 04:36:01,368][106225] Updated weights for policy 1, policy_version 1303126 (0.0007) [2023-12-28 04:36:01,974][106226] Updated weights for policy 0, policy_version 1299740 (0.0008) [2023-12-28 04:36:02,035][106226] Updated weights for policy 0, policy_version 1299750 (0.0008) [2023-12-28 04:36:02,089][106226] Updated weights for policy 0, policy_version 1299760 (0.0008) [2023-12-28 04:36:02,142][106225] Updated weights for policy 1, policy_version 1303136 (0.0009) [2023-12-28 04:36:02,193][106225] Updated weights for policy 1, policy_version 1303146 (0.0008) [2023-12-28 04:36:02,252][106225] Updated weights for policy 1, policy_version 1303156 (0.0009) [2023-12-28 04:36:02,799][106226] Updated weights for policy 0, policy_version 1299770 (0.0007) [2023-12-28 04:36:02,851][106226] Updated weights for policy 0, policy_version 1299780 (0.0009) [2023-12-28 04:36:02,906][106226] Updated weights for policy 0, policy_version 1299790 (0.0008) [2023-12-28 04:36:02,927][106225] Updated weights for policy 1, policy_version 1303166 (0.0008) [2023-12-28 04:36:02,963][106226] Updated weights for policy 0, policy_version 1299800 (0.0008) [2023-12-28 04:36:02,982][106225] Updated weights for policy 1, policy_version 1303176 (0.0006) [2023-12-28 04:36:03,028][106225] Updated weights for policy 1, policy_version 1303186 (0.0008) [2023-12-28 04:36:03,695][106226] Updated weights for policy 0, policy_version 1299810 (0.0008) [2023-12-28 04:36:03,746][106226] Updated weights for policy 0, policy_version 1299820 (0.0008) [2023-12-28 04:36:03,759][106225] Updated weights for policy 1, policy_version 1303196 (0.0007) [2023-12-28 04:36:03,804][106226] Updated weights for policy 0, policy_version 1299830 (0.0006) [2023-12-28 04:36:03,813][106225] Updated weights for policy 1, policy_version 1303206 (0.0007) [2023-12-28 04:36:03,873][106225] Updated weights for policy 1, policy_version 1303216 (0.0009) [2023-12-28 04:36:04,617][106226] Updated weights for policy 0, policy_version 1299840 (0.0008) [2023-12-28 04:36:04,621][106225] Updated weights for policy 1, policy_version 1303226 (0.0008) [2023-12-28 04:36:04,674][106226] Updated weights for policy 0, policy_version 1299850 (0.0007) [2023-12-28 04:36:04,676][106225] Updated weights for policy 1, policy_version 1303236 (0.0009) [2023-12-28 04:36:04,743][106225] Updated weights for policy 1, policy_version 1303246 (0.0008) [2023-12-28 04:36:04,744][106226] Updated weights for policy 0, policy_version 1299860 (0.0006) [2023-12-28 04:36:04,805][106225] Updated weights for policy 1, policy_version 1303256 (0.0006) [2023-12-28 04:36:05,448][106225] Updated weights for policy 1, policy_version 1303266 (0.0005) [2023-12-28 04:36:05,476][106226] Updated weights for policy 0, policy_version 1299870 (0.0008) [2023-12-28 04:36:05,501][106225] Updated weights for policy 1, policy_version 1303276 (0.0005) [2023-12-28 04:36:05,537][106226] Updated weights for policy 0, policy_version 1299880 (0.0008) [2023-12-28 04:36:05,560][106225] Updated weights for policy 1, policy_version 1303286 (0.0006) [2023-12-28 04:36:05,594][106226] Updated weights for policy 0, policy_version 1299890 (0.0008) [2023-12-28 04:36:06,099][106225] Updated weights for policy 1, policy_version 1303296 (0.0006) [2023-12-28 04:36:06,169][106225] Updated weights for policy 1, policy_version 1303306 (0.0007) [2023-12-28 04:36:06,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 666525696. Throughput: 0: 9880.0, 1: 9840.1. Samples: 666539132. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:06,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.897')] [2023-12-28 04:36:06,229][106225] Updated weights for policy 1, policy_version 1303316 (0.0008) [2023-12-28 04:36:06,381][106226] Updated weights for policy 0, policy_version 1299900 (0.0008) [2023-12-28 04:36:06,446][106226] Updated weights for policy 0, policy_version 1299910 (0.0009) [2023-12-28 04:36:06,508][106226] Updated weights for policy 0, policy_version 1299920 (0.0009) [2023-12-28 04:36:06,933][106225] Updated weights for policy 1, policy_version 1303326 (0.0009) [2023-12-28 04:36:06,987][106225] Updated weights for policy 1, policy_version 1303336 (0.0009) [2023-12-28 04:36:07,038][106225] Updated weights for policy 1, policy_version 1303346 (0.0008) [2023-12-28 04:36:07,253][106226] Updated weights for policy 0, policy_version 1299930 (0.0008) [2023-12-28 04:36:07,313][106226] Updated weights for policy 0, policy_version 1299940 (0.0010) [2023-12-28 04:36:07,370][106226] Updated weights for policy 0, policy_version 1299950 (0.0009) [2023-12-28 04:36:07,416][106226] Updated weights for policy 0, policy_version 1299960 (0.0009) [2023-12-28 04:36:07,738][106225] Updated weights for policy 1, policy_version 1303356 (0.0009) [2023-12-28 04:36:07,791][106225] Updated weights for policy 1, policy_version 1303366 (0.0008) [2023-12-28 04:36:07,847][106225] Updated weights for policy 1, policy_version 1303376 (0.0009) [2023-12-28 04:36:08,164][106226] Updated weights for policy 0, policy_version 1299970 (0.0009) [2023-12-28 04:36:08,220][106226] Updated weights for policy 0, policy_version 1299980 (0.0009) [2023-12-28 04:36:08,277][106226] Updated weights for policy 0, policy_version 1299990 (0.0009) [2023-12-28 04:36:08,572][106225] Updated weights for policy 1, policy_version 1303386 (0.0009) [2023-12-28 04:36:08,631][106225] Updated weights for policy 1, policy_version 1303396 (0.0009) [2023-12-28 04:36:08,691][106225] Updated weights for policy 1, policy_version 1303406 (0.0009) [2023-12-28 04:36:08,748][106225] Updated weights for policy 1, policy_version 1303416 (0.0008) [2023-12-28 04:36:09,011][106226] Updated weights for policy 0, policy_version 1300000 (0.0009) [2023-12-28 04:36:09,074][106226] Updated weights for policy 0, policy_version 1300010 (0.0009) [2023-12-28 04:36:09,135][106226] Updated weights for policy 0, policy_version 1300020 (0.0008) [2023-12-28 04:36:09,528][106225] Updated weights for policy 1, policy_version 1303426 (0.0008) [2023-12-28 04:36:09,584][106225] Updated weights for policy 1, policy_version 1303436 (0.0007) [2023-12-28 04:36:09,642][106225] Updated weights for policy 1, policy_version 1303446 (0.0007) [2023-12-28 04:36:09,846][106226] Updated weights for policy 0, policy_version 1300030 (0.0008) [2023-12-28 04:36:09,915][106226] Updated weights for policy 0, policy_version 1300040 (0.0010) [2023-12-28 04:36:09,979][106226] Updated weights for policy 0, policy_version 1300050 (0.0009) [2023-12-28 04:36:10,418][106225] Updated weights for policy 1, policy_version 1303456 (0.0009) [2023-12-28 04:36:10,482][106225] Updated weights for policy 1, policy_version 1303466 (0.0008) [2023-12-28 04:36:10,536][106225] Updated weights for policy 1, policy_version 1303476 (0.0008) [2023-12-28 04:36:10,692][106226] Updated weights for policy 0, policy_version 1300060 (0.0011) [2023-12-28 04:36:10,752][106226] Updated weights for policy 0, policy_version 1300070 (0.0011) [2023-12-28 04:36:10,810][106226] Updated weights for policy 0, policy_version 1300080 (0.0010) [2023-12-28 04:36:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 666624000. Throughput: 0: 9833.6, 1: 9897.7. Samples: 666597996. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:11,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.748')] [2023-12-28 04:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001300088_332881920.pth... [2023-12-28 04:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001303480_333742080.pth... [2023-12-28 04:36:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001298968_332595200.pth [2023-12-28 04:36:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001302328_333447168.pth [2023-12-28 04:36:11,306][106225] Updated weights for policy 1, policy_version 1303486 (0.0007) [2023-12-28 04:36:11,370][106225] Updated weights for policy 1, policy_version 1303496 (0.0008) [2023-12-28 04:36:11,440][106225] Updated weights for policy 1, policy_version 1303506 (0.0008) [2023-12-28 04:36:11,591][106226] Updated weights for policy 0, policy_version 1300090 (0.0011) [2023-12-28 04:36:11,668][106226] Updated weights for policy 0, policy_version 1300100 (0.0010) [2023-12-28 04:36:11,734][106226] Updated weights for policy 0, policy_version 1300110 (0.0008) [2023-12-28 04:36:11,808][106226] Updated weights for policy 0, policy_version 1300120 (0.0008) [2023-12-28 04:36:12,206][106225] Updated weights for policy 1, policy_version 1303516 (0.0008) [2023-12-28 04:36:12,273][106225] Updated weights for policy 1, policy_version 1303526 (0.0009) [2023-12-28 04:36:12,334][106225] Updated weights for policy 1, policy_version 1303536 (0.0008) [2023-12-28 04:36:12,588][106226] Updated weights for policy 0, policy_version 1300130 (0.0005) [2023-12-28 04:36:12,658][106226] Updated weights for policy 0, policy_version 1300140 (0.0006) [2023-12-28 04:36:12,726][106226] Updated weights for policy 0, policy_version 1300150 (0.0005) [2023-12-28 04:36:13,129][106225] Updated weights for policy 1, policy_version 1303546 (0.0009) [2023-12-28 04:36:13,183][106225] Updated weights for policy 1, policy_version 1303556 (0.0008) [2023-12-28 04:36:13,235][106225] Updated weights for policy 1, policy_version 1303566 (0.0008) [2023-12-28 04:36:13,284][106225] Updated weights for policy 1, policy_version 1303576 (0.0008) [2023-12-28 04:36:13,370][106226] Updated weights for policy 0, policy_version 1300160 (0.0005) [2023-12-28 04:36:13,432][106226] Updated weights for policy 0, policy_version 1300170 (0.0008) [2023-12-28 04:36:13,489][106226] Updated weights for policy 0, policy_version 1300180 (0.0009) [2023-12-28 04:36:14,051][106225] Updated weights for policy 1, policy_version 1303586 (0.0007) [2023-12-28 04:36:14,114][106225] Updated weights for policy 1, policy_version 1303596 (0.0008) [2023-12-28 04:36:14,174][106226] Updated weights for policy 0, policy_version 1300190 (0.0010) [2023-12-28 04:36:14,180][106225] Updated weights for policy 1, policy_version 1303606 (0.0007) [2023-12-28 04:36:14,227][106226] Updated weights for policy 0, policy_version 1300200 (0.0010) [2023-12-28 04:36:14,281][106226] Updated weights for policy 0, policy_version 1300210 (0.0010) [2023-12-28 04:36:14,822][106225] Updated weights for policy 1, policy_version 1303616 (0.0008) [2023-12-28 04:36:14,880][106225] Updated weights for policy 1, policy_version 1303627 (0.0009) [2023-12-28 04:36:14,942][106225] Updated weights for policy 1, policy_version 1303637 (0.0006) [2023-12-28 04:36:14,945][106226] Updated weights for policy 0, policy_version 1300220 (0.0008) [2023-12-28 04:36:15,016][106226] Updated weights for policy 0, policy_version 1300230 (0.0009) [2023-12-28 04:36:15,071][106226] Updated weights for policy 0, policy_version 1300240 (0.0010) [2023-12-28 04:36:15,731][106225] Updated weights for policy 1, policy_version 1303647 (0.0009) [2023-12-28 04:36:15,731][106226] Updated weights for policy 0, policy_version 1300250 (0.0009) [2023-12-28 04:36:15,785][106226] Updated weights for policy 0, policy_version 1300260 (0.0005) [2023-12-28 04:36:15,786][106225] Updated weights for policy 1, policy_version 1303657 (0.0008) [2023-12-28 04:36:15,833][106226] Updated weights for policy 0, policy_version 1300270 (0.0005) [2023-12-28 04:36:15,838][106225] Updated weights for policy 1, policy_version 1303667 (0.0008) [2023-12-28 04:36:15,890][106226] Updated weights for policy 0, policy_version 1300280 (0.0007) [2023-12-28 04:36:16,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 666722304. Throughput: 0: 9691.3, 1: 9824.2. Samples: 666711136. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:16,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-5.080')] [2023-12-28 04:36:16,514][106226] Updated weights for policy 0, policy_version 1300290 (0.0005) [2023-12-28 04:36:16,565][106226] Updated weights for policy 0, policy_version 1300300 (0.0005) [2023-12-28 04:36:16,579][106225] Updated weights for policy 1, policy_version 1303677 (0.0010) [2023-12-28 04:36:16,620][106226] Updated weights for policy 0, policy_version 1300310 (0.0005) [2023-12-28 04:36:16,639][106225] Updated weights for policy 1, policy_version 1303687 (0.0010) [2023-12-28 04:36:16,695][106225] Updated weights for policy 1, policy_version 1303697 (0.0010) [2023-12-28 04:36:17,247][106226] Updated weights for policy 0, policy_version 1300320 (0.0010) [2023-12-28 04:36:17,300][106226] Updated weights for policy 0, policy_version 1300330 (0.0010) [2023-12-28 04:36:17,355][106226] Updated weights for policy 0, policy_version 1300340 (0.0010) [2023-12-28 04:36:17,360][106225] Updated weights for policy 1, policy_version 1303707 (0.0010) [2023-12-28 04:36:17,407][106225] Updated weights for policy 1, policy_version 1303717 (0.0010) [2023-12-28 04:36:17,464][106225] Updated weights for policy 1, policy_version 1303727 (0.0010) [2023-12-28 04:36:18,075][106226] Updated weights for policy 0, policy_version 1300350 (0.0010) [2023-12-28 04:36:18,109][106225] Updated weights for policy 1, policy_version 1303737 (0.0009) [2023-12-28 04:36:18,132][106226] Updated weights for policy 0, policy_version 1300360 (0.0010) [2023-12-28 04:36:18,176][106225] Updated weights for policy 1, policy_version 1303747 (0.0010) [2023-12-28 04:36:18,184][106226] Updated weights for policy 0, policy_version 1300370 (0.0007) [2023-12-28 04:36:18,239][106225] Updated weights for policy 1, policy_version 1303757 (0.0010) [2023-12-28 04:36:18,299][106225] Updated weights for policy 1, policy_version 1303767 (0.0010) [2023-12-28 04:36:18,912][106226] Updated weights for policy 0, policy_version 1300380 (0.0008) [2023-12-28 04:36:18,971][106226] Updated weights for policy 0, policy_version 1300390 (0.0011) [2023-12-28 04:36:19,022][106225] Updated weights for policy 1, policy_version 1303777 (0.0007) [2023-12-28 04:36:19,034][106226] Updated weights for policy 0, policy_version 1300400 (0.0011) [2023-12-28 04:36:19,088][106225] Updated weights for policy 1, policy_version 1303787 (0.0005) [2023-12-28 04:36:19,144][106225] Updated weights for policy 1, policy_version 1303797 (0.0007) [2023-12-28 04:36:19,706][106226] Updated weights for policy 0, policy_version 1300410 (0.0010) [2023-12-28 04:36:19,772][106226] Updated weights for policy 0, policy_version 1300420 (0.0007) [2023-12-28 04:36:19,842][106226] Updated weights for policy 0, policy_version 1300430 (0.0010) [2023-12-28 04:36:19,905][106225] Updated weights for policy 1, policy_version 1303807 (0.0006) [2023-12-28 04:36:19,907][106226] Updated weights for policy 0, policy_version 1300440 (0.0011) [2023-12-28 04:36:19,973][106225] Updated weights for policy 1, policy_version 1303817 (0.0008) [2023-12-28 04:36:20,037][106225] Updated weights for policy 1, policy_version 1303827 (0.0008) [2023-12-28 04:36:20,640][106226] Updated weights for policy 0, policy_version 1300450 (0.0009) [2023-12-28 04:36:20,699][106226] Updated weights for policy 0, policy_version 1300460 (0.0010) [2023-12-28 04:36:20,760][106226] Updated weights for policy 0, policy_version 1300470 (0.0005) [2023-12-28 04:36:20,801][106225] Updated weights for policy 1, policy_version 1303837 (0.0008) [2023-12-28 04:36:20,863][106225] Updated weights for policy 1, policy_version 1303847 (0.0008) [2023-12-28 04:36:20,926][106225] Updated weights for policy 1, policy_version 1303857 (0.0008) [2023-12-28 04:36:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 666820608. Throughput: 0: 9736.9, 1: 9814.7. Samples: 666829880. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:21,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-5.030')] [2023-12-28 04:36:21,502][106226] Updated weights for policy 0, policy_version 1300480 (0.0008) [2023-12-28 04:36:21,569][106226] Updated weights for policy 0, policy_version 1300490 (0.0008) [2023-12-28 04:36:21,647][106226] Updated weights for policy 0, policy_version 1300500 (0.0009) [2023-12-28 04:36:21,660][106225] Updated weights for policy 1, policy_version 1303867 (0.0008) [2023-12-28 04:36:21,728][106225] Updated weights for policy 1, policy_version 1303877 (0.0008) [2023-12-28 04:36:21,797][106225] Updated weights for policy 1, policy_version 1303887 (0.0008) [2023-12-28 04:36:22,431][106226] Updated weights for policy 0, policy_version 1300510 (0.0011) [2023-12-28 04:36:22,492][106226] Updated weights for policy 0, policy_version 1300520 (0.0009) [2023-12-28 04:36:22,557][106226] Updated weights for policy 0, policy_version 1300530 (0.0008) [2023-12-28 04:36:22,578][106225] Updated weights for policy 1, policy_version 1303897 (0.0008) [2023-12-28 04:36:22,636][106225] Updated weights for policy 1, policy_version 1303907 (0.0009) [2023-12-28 04:36:22,684][106225] Updated weights for policy 1, policy_version 1303917 (0.0009) [2023-12-28 04:36:22,748][106225] Updated weights for policy 1, policy_version 1303927 (0.0008) [2023-12-28 04:36:23,151][106226] Updated weights for policy 0, policy_version 1300540 (0.0008) [2023-12-28 04:36:23,202][106226] Updated weights for policy 0, policy_version 1300550 (0.0009) [2023-12-28 04:36:23,256][106226] Updated weights for policy 0, policy_version 1300560 (0.0009) [2023-12-28 04:36:23,544][106225] Updated weights for policy 1, policy_version 1303937 (0.0009) [2023-12-28 04:36:23,594][106225] Updated weights for policy 1, policy_version 1303947 (0.0008) [2023-12-28 04:36:23,645][106225] Updated weights for policy 1, policy_version 1303957 (0.0009) [2023-12-28 04:36:23,932][106226] Updated weights for policy 0, policy_version 1300570 (0.0009) [2023-12-28 04:36:23,985][106226] Updated weights for policy 0, policy_version 1300580 (0.0010) [2023-12-28 04:36:24,044][106226] Updated weights for policy 0, policy_version 1300590 (0.0010) [2023-12-28 04:36:24,109][106226] Updated weights for policy 0, policy_version 1300600 (0.0009) [2023-12-28 04:36:24,386][106225] Updated weights for policy 1, policy_version 1303967 (0.0008) [2023-12-28 04:36:24,441][106225] Updated weights for policy 1, policy_version 1303977 (0.0008) [2023-12-28 04:36:24,506][106225] Updated weights for policy 1, policy_version 1303987 (0.0009) [2023-12-28 04:36:24,831][106226] Updated weights for policy 0, policy_version 1300610 (0.0008) [2023-12-28 04:36:24,878][106226] Updated weights for policy 0, policy_version 1300620 (0.0008) [2023-12-28 04:36:24,922][106226] Updated weights for policy 0, policy_version 1300630 (0.0008) [2023-12-28 04:36:25,227][106225] Updated weights for policy 1, policy_version 1303997 (0.0008) [2023-12-28 04:36:25,276][106225] Updated weights for policy 1, policy_version 1304007 (0.0008) [2023-12-28 04:36:25,323][106225] Updated weights for policy 1, policy_version 1304017 (0.0008) [2023-12-28 04:36:25,659][106226] Updated weights for policy 0, policy_version 1300640 (0.0009) [2023-12-28 04:36:25,711][106226] Updated weights for policy 0, policy_version 1300650 (0.0009) [2023-12-28 04:36:25,772][106226] Updated weights for policy 0, policy_version 1300660 (0.0008) [2023-12-28 04:36:26,081][106225] Updated weights for policy 1, policy_version 1304027 (0.0007) [2023-12-28 04:36:26,145][106225] Updated weights for policy 1, policy_version 1304037 (0.0008) [2023-12-28 04:36:26,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 666910720. Throughput: 0: 9687.7, 1: 9731.2. Samples: 666885220. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:26,176][105115] Avg episode reward: [(0, '-4.468'), (1, '-5.039')] [2023-12-28 04:36:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001300664_333029376.pth... [2023-12-28 04:36:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001299544_332742656.pth [2023-12-28 04:36:26,203][106225] Updated weights for policy 1, policy_version 1304047 (0.0010) [2023-12-28 04:36:26,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001304056_333889536.pth... [2023-12-28 04:36:26,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001302904_333594624.pth [2023-12-28 04:36:26,356][106226] Updated weights for policy 0, policy_version 1300670 (0.0006) [2023-12-28 04:36:26,406][106226] Updated weights for policy 0, policy_version 1300680 (0.0005) [2023-12-28 04:36:26,459][106226] Updated weights for policy 0, policy_version 1300690 (0.0006) [2023-12-28 04:36:26,960][106226] Updated weights for policy 0, policy_version 1300700 (0.0005) [2023-12-28 04:36:27,017][106226] Updated weights for policy 0, policy_version 1300710 (0.0006) [2023-12-28 04:36:27,040][106225] Updated weights for policy 1, policy_version 1304057 (0.0008) [2023-12-28 04:36:27,070][106226] Updated weights for policy 0, policy_version 1300720 (0.0005) [2023-12-28 04:36:27,094][106225] Updated weights for policy 1, policy_version 1304067 (0.0008) [2023-12-28 04:36:27,147][106225] Updated weights for policy 1, policy_version 1304077 (0.0009) [2023-12-28 04:36:27,200][106225] Updated weights for policy 1, policy_version 1304087 (0.0008) [2023-12-28 04:36:27,608][106226] Updated weights for policy 0, policy_version 1300730 (0.0005) [2023-12-28 04:36:27,664][106226] Updated weights for policy 0, policy_version 1300740 (0.0006) [2023-12-28 04:36:27,712][106226] Updated weights for policy 0, policy_version 1300750 (0.0005) [2023-12-28 04:36:27,759][106226] Updated weights for policy 0, policy_version 1300760 (0.0005) [2023-12-28 04:36:28,048][106225] Updated weights for policy 1, policy_version 1304097 (0.0008) [2023-12-28 04:36:28,112][106225] Updated weights for policy 1, policy_version 1304107 (0.0010) [2023-12-28 04:36:28,173][106225] Updated weights for policy 1, policy_version 1304117 (0.0009) [2023-12-28 04:36:28,293][106226] Updated weights for policy 0, policy_version 1300770 (0.0005) [2023-12-28 04:36:28,362][106226] Updated weights for policy 0, policy_version 1300780 (0.0007) [2023-12-28 04:36:28,423][106226] Updated weights for policy 0, policy_version 1300790 (0.0008) [2023-12-28 04:36:28,941][106226] Updated weights for policy 0, policy_version 1300800 (0.0009) [2023-12-28 04:36:29,004][106226] Updated weights for policy 0, policy_version 1300810 (0.0010) [2023-12-28 04:36:29,021][106225] Updated weights for policy 1, policy_version 1304127 (0.0006) [2023-12-28 04:36:29,063][106226] Updated weights for policy 0, policy_version 1300820 (0.0010) [2023-12-28 04:36:29,068][106225] Updated weights for policy 1, policy_version 1304137 (0.0008) [2023-12-28 04:36:29,115][106225] Updated weights for policy 1, policy_version 1304147 (0.0005) [2023-12-28 04:36:29,709][106226] Updated weights for policy 0, policy_version 1300830 (0.0010) [2023-12-28 04:36:29,773][106226] Updated weights for policy 0, policy_version 1300840 (0.0011) [2023-12-28 04:36:29,789][106225] Updated weights for policy 1, policy_version 1304157 (0.0007) [2023-12-28 04:36:29,837][106226] Updated weights for policy 0, policy_version 1300850 (0.0009) [2023-12-28 04:36:29,857][106225] Updated weights for policy 1, policy_version 1304167 (0.0008) [2023-12-28 04:36:29,918][106225] Updated weights for policy 1, policy_version 1304177 (0.0011) [2023-12-28 04:36:30,495][106226] Updated weights for policy 0, policy_version 1300860 (0.0008) [2023-12-28 04:36:30,551][106226] Updated weights for policy 0, policy_version 1300870 (0.0010) [2023-12-28 04:36:30,598][106225] Updated weights for policy 1, policy_version 1304187 (0.0009) [2023-12-28 04:36:30,607][106226] Updated weights for policy 0, policy_version 1300880 (0.0010) [2023-12-28 04:36:30,648][106225] Updated weights for policy 1, policy_version 1304197 (0.0010) [2023-12-28 04:36:30,704][106225] Updated weights for policy 1, policy_version 1304207 (0.0010) [2023-12-28 04:36:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 667017216. Throughput: 0: 9961.2, 1: 9630.3. Samples: 667008368. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:31,175][105115] Avg episode reward: [(0, '-4.235'), (1, '-4.948')] [2023-12-28 04:36:31,290][106226] Updated weights for policy 0, policy_version 1300890 (0.0010) [2023-12-28 04:36:31,341][106226] Updated weights for policy 0, policy_version 1300900 (0.0008) [2023-12-28 04:36:31,404][106226] Updated weights for policy 0, policy_version 1300910 (0.0008) [2023-12-28 04:36:31,423][106225] Updated weights for policy 1, policy_version 1304217 (0.0010) [2023-12-28 04:36:31,465][106226] Updated weights for policy 0, policy_version 1300920 (0.0008) [2023-12-28 04:36:31,490][106225] Updated weights for policy 1, policy_version 1304227 (0.0005) [2023-12-28 04:36:31,555][106225] Updated weights for policy 1, policy_version 1304237 (0.0005) [2023-12-28 04:36:31,621][106225] Updated weights for policy 1, policy_version 1304247 (0.0006) [2023-12-28 04:36:32,233][106226] Updated weights for policy 0, policy_version 1300930 (0.0007) [2023-12-28 04:36:32,239][106225] Updated weights for policy 1, policy_version 1304257 (0.0007) [2023-12-28 04:36:32,296][106225] Updated weights for policy 1, policy_version 1304267 (0.0007) [2023-12-28 04:36:32,298][106226] Updated weights for policy 0, policy_version 1300940 (0.0007) [2023-12-28 04:36:32,350][106226] Updated weights for policy 0, policy_version 1300950 (0.0007) [2023-12-28 04:36:32,351][106225] Updated weights for policy 1, policy_version 1304277 (0.0006) [2023-12-28 04:36:32,949][106226] Updated weights for policy 0, policy_version 1300960 (0.0008) [2023-12-28 04:36:33,009][106226] Updated weights for policy 0, policy_version 1300970 (0.0008) [2023-12-28 04:36:33,069][106226] Updated weights for policy 0, policy_version 1300980 (0.0009) [2023-12-28 04:36:33,154][106225] Updated weights for policy 1, policy_version 1304287 (0.0008) [2023-12-28 04:36:33,202][106225] Updated weights for policy 1, policy_version 1304297 (0.0008) [2023-12-28 04:36:33,259][106225] Updated weights for policy 1, policy_version 1304307 (0.0008) [2023-12-28 04:36:33,725][106226] Updated weights for policy 0, policy_version 1300990 (0.0009) [2023-12-28 04:36:33,776][106226] Updated weights for policy 0, policy_version 1301000 (0.0006) [2023-12-28 04:36:33,831][106226] Updated weights for policy 0, policy_version 1301010 (0.0005) [2023-12-28 04:36:34,080][106225] Updated weights for policy 1, policy_version 1304317 (0.0007) [2023-12-28 04:36:34,129][106225] Updated weights for policy 1, policy_version 1304327 (0.0009) [2023-12-28 04:36:34,197][106225] Updated weights for policy 1, policy_version 1304337 (0.0008) [2023-12-28 04:36:34,469][106226] Updated weights for policy 0, policy_version 1301020 (0.0008) [2023-12-28 04:36:34,527][106226] Updated weights for policy 0, policy_version 1301030 (0.0011) [2023-12-28 04:36:34,585][106226] Updated weights for policy 0, policy_version 1301040 (0.0010) [2023-12-28 04:36:34,928][106225] Updated weights for policy 1, policy_version 1304347 (0.0008) [2023-12-28 04:36:34,992][106225] Updated weights for policy 1, policy_version 1304357 (0.0008) [2023-12-28 04:36:35,052][106225] Updated weights for policy 1, policy_version 1304367 (0.0009) [2023-12-28 04:36:35,303][106226] Updated weights for policy 0, policy_version 1301050 (0.0011) [2023-12-28 04:36:35,369][106226] Updated weights for policy 0, policy_version 1301060 (0.0006) [2023-12-28 04:36:35,430][106226] Updated weights for policy 0, policy_version 1301070 (0.0011) [2023-12-28 04:36:35,492][106226] Updated weights for policy 0, policy_version 1301080 (0.0011) [2023-12-28 04:36:35,757][106225] Updated weights for policy 1, policy_version 1304377 (0.0008) [2023-12-28 04:36:35,810][106225] Updated weights for policy 1, policy_version 1304387 (0.0008) [2023-12-28 04:36:35,866][106225] Updated weights for policy 1, policy_version 1304397 (0.0007) [2023-12-28 04:36:35,916][106225] Updated weights for policy 1, policy_version 1304407 (0.0007) [2023-12-28 04:36:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 667115520. Throughput: 0: 10031.3, 1: 9589.0. Samples: 667126872. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:36,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.778')] [2023-12-28 04:36:36,179][106226] Updated weights for policy 0, policy_version 1301090 (0.0009) [2023-12-28 04:36:36,239][106226] Updated weights for policy 0, policy_version 1301100 (0.0009) [2023-12-28 04:36:36,308][106226] Updated weights for policy 0, policy_version 1301110 (0.0008) [2023-12-28 04:36:36,690][106225] Updated weights for policy 1, policy_version 1304417 (0.0009) [2023-12-28 04:36:36,751][106225] Updated weights for policy 1, policy_version 1304427 (0.0007) [2023-12-28 04:36:36,812][106225] Updated weights for policy 1, policy_version 1304437 (0.0008) [2023-12-28 04:36:36,941][106226] Updated weights for policy 0, policy_version 1301120 (0.0007) [2023-12-28 04:36:37,005][106226] Updated weights for policy 0, policy_version 1301130 (0.0008) [2023-12-28 04:36:37,063][106226] Updated weights for policy 0, policy_version 1301140 (0.0009) [2023-12-28 04:36:37,566][106225] Updated weights for policy 1, policy_version 1304447 (0.0008) [2023-12-28 04:36:37,626][106225] Updated weights for policy 1, policy_version 1304457 (0.0009) [2023-12-28 04:36:37,687][106225] Updated weights for policy 1, policy_version 1304467 (0.0008) [2023-12-28 04:36:37,753][106226] Updated weights for policy 0, policy_version 1301150 (0.0006) [2023-12-28 04:36:37,812][106226] Updated weights for policy 0, policy_version 1301160 (0.0005) [2023-12-28 04:36:37,869][106226] Updated weights for policy 0, policy_version 1301170 (0.0005) [2023-12-28 04:36:38,468][106225] Updated weights for policy 1, policy_version 1304477 (0.0007) [2023-12-28 04:36:38,519][106226] Updated weights for policy 0, policy_version 1301180 (0.0009) [2023-12-28 04:36:38,521][106225] Updated weights for policy 1, policy_version 1304487 (0.0006) [2023-12-28 04:36:38,572][106226] Updated weights for policy 0, policy_version 1301190 (0.0008) [2023-12-28 04:36:38,578][106225] Updated weights for policy 1, policy_version 1304497 (0.0006) [2023-12-28 04:36:38,631][106226] Updated weights for policy 0, policy_version 1301200 (0.0008) [2023-12-28 04:36:39,254][106225] Updated weights for policy 1, policy_version 1304507 (0.0007) [2023-12-28 04:36:39,317][106225] Updated weights for policy 1, policy_version 1304517 (0.0009) [2023-12-28 04:36:39,385][106225] Updated weights for policy 1, policy_version 1304527 (0.0008) [2023-12-28 04:36:39,457][106226] Updated weights for policy 0, policy_version 1301210 (0.0008) [2023-12-28 04:36:39,521][106226] Updated weights for policy 0, policy_version 1301220 (0.0009) [2023-12-28 04:36:39,587][106226] Updated weights for policy 0, policy_version 1301230 (0.0009) [2023-12-28 04:36:39,652][106226] Updated weights for policy 0, policy_version 1301240 (0.0006) [2023-12-28 04:36:40,206][106225] Updated weights for policy 1, policy_version 1304537 (0.0008) [2023-12-28 04:36:40,268][106225] Updated weights for policy 1, policy_version 1304547 (0.0009) [2023-12-28 04:36:40,313][106226] Updated weights for policy 0, policy_version 1301250 (0.0006) [2023-12-28 04:36:40,327][106225] Updated weights for policy 1, policy_version 1304557 (0.0009) [2023-12-28 04:36:40,374][106226] Updated weights for policy 0, policy_version 1301260 (0.0007) [2023-12-28 04:36:40,389][106225] Updated weights for policy 1, policy_version 1304567 (0.0007) [2023-12-28 04:36:40,443][106226] Updated weights for policy 0, policy_version 1301270 (0.0006) [2023-12-28 04:36:41,063][106226] Updated weights for policy 0, policy_version 1301280 (0.0008) [2023-12-28 04:36:41,119][106226] Updated weights for policy 0, policy_version 1301290 (0.0011) [2023-12-28 04:36:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 667205632. Throughput: 0: 10020.7, 1: 9566.2. Samples: 667184076. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:41,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-5.081')] [2023-12-28 04:36:41,195][106226] Updated weights for policy 0, policy_version 1301300 (0.0011) [2023-12-28 04:36:41,199][106225] Updated weights for policy 1, policy_version 1304577 (0.0007) [2023-12-28 04:36:41,217][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001301304_333193216.pth... [2023-12-28 04:36:41,221][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001300088_332881920.pth [2023-12-28 04:36:41,257][106225] Updated weights for policy 1, policy_version 1304587 (0.0009) [2023-12-28 04:36:41,322][106225] Updated weights for policy 1, policy_version 1304597 (0.0008) [2023-12-28 04:36:41,338][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001304600_334028800.pth... [2023-12-28 04:36:41,342][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001303480_333742080.pth [2023-12-28 04:36:41,945][106226] Updated weights for policy 0, policy_version 1301310 (0.0008) [2023-12-28 04:36:42,006][106226] Updated weights for policy 0, policy_version 1301320 (0.0009) [2023-12-28 04:36:42,070][106226] Updated weights for policy 0, policy_version 1301330 (0.0008) [2023-12-28 04:36:42,125][106225] Updated weights for policy 1, policy_version 1304607 (0.0008) [2023-12-28 04:36:42,194][106225] Updated weights for policy 1, policy_version 1304617 (0.0006) [2023-12-28 04:36:42,269][106225] Updated weights for policy 1, policy_version 1304627 (0.0008) [2023-12-28 04:36:42,854][106226] Updated weights for policy 0, policy_version 1301340 (0.0009) [2023-12-28 04:36:42,894][106225] Updated weights for policy 1, policy_version 1304637 (0.0009) [2023-12-28 04:36:42,922][106226] Updated weights for policy 0, policy_version 1301350 (0.0006) [2023-12-28 04:36:42,956][106225] Updated weights for policy 1, policy_version 1304647 (0.0007) [2023-12-28 04:36:42,992][106226] Updated weights for policy 0, policy_version 1301360 (0.0006) [2023-12-28 04:36:43,018][106225] Updated weights for policy 1, policy_version 1304657 (0.0008) [2023-12-28 04:36:43,639][106226] Updated weights for policy 0, policy_version 1301370 (0.0007) [2023-12-28 04:36:43,691][106226] Updated weights for policy 0, policy_version 1301380 (0.0008) [2023-12-28 04:36:43,695][106225] Updated weights for policy 1, policy_version 1304667 (0.0006) [2023-12-28 04:36:43,736][106226] Updated weights for policy 0, policy_version 1301390 (0.0007) [2023-12-28 04:36:43,740][106225] Updated weights for policy 1, policy_version 1304677 (0.0005) [2023-12-28 04:36:43,782][106226] Updated weights for policy 0, policy_version 1301400 (0.0007) [2023-12-28 04:36:43,785][106225] Updated weights for policy 1, policy_version 1304687 (0.0005) [2023-12-28 04:36:44,377][106225] Updated weights for policy 1, policy_version 1304697 (0.0006) [2023-12-28 04:36:44,436][106225] Updated weights for policy 1, policy_version 1304707 (0.0005) [2023-12-28 04:36:44,486][106225] Updated weights for policy 1, policy_version 1304717 (0.0010) [2023-12-28 04:36:44,532][106225] Updated weights for policy 1, policy_version 1304727 (0.0010) [2023-12-28 04:36:44,580][106226] Updated weights for policy 0, policy_version 1301410 (0.0005) [2023-12-28 04:36:44,643][106226] Updated weights for policy 0, policy_version 1301420 (0.0009) [2023-12-28 04:36:44,694][106226] Updated weights for policy 0, policy_version 1301430 (0.0009) [2023-12-28 04:36:45,230][106225] Updated weights for policy 1, policy_version 1304737 (0.0011) [2023-12-28 04:36:45,293][106225] Updated weights for policy 1, policy_version 1304747 (0.0010) [2023-12-28 04:36:45,354][106225] Updated weights for policy 1, policy_version 1304757 (0.0010) [2023-12-28 04:36:45,362][106226] Updated weights for policy 0, policy_version 1301440 (0.0007) [2023-12-28 04:36:45,422][106226] Updated weights for policy 0, policy_version 1301450 (0.0007) [2023-12-28 04:36:45,479][106226] Updated weights for policy 0, policy_version 1301460 (0.0008) [2023-12-28 04:36:45,919][106225] Updated weights for policy 1, policy_version 1304767 (0.0007) [2023-12-28 04:36:45,973][106225] Updated weights for policy 1, policy_version 1304777 (0.0007) [2023-12-28 04:36:46,024][106225] Updated weights for policy 1, policy_version 1304787 (0.0007) [2023-12-28 04:36:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 667312128. Throughput: 0: 10000.1, 1: 9526.7. Samples: 667301188. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:46,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.967')] [2023-12-28 04:36:46,242][106226] Updated weights for policy 0, policy_version 1301470 (0.0009) [2023-12-28 04:36:46,299][106226] Updated weights for policy 0, policy_version 1301480 (0.0007) [2023-12-28 04:36:46,350][106226] Updated weights for policy 0, policy_version 1301490 (0.0006) [2023-12-28 04:36:46,672][106225] Updated weights for policy 1, policy_version 1304797 (0.0008) [2023-12-28 04:36:46,729][106225] Updated weights for policy 1, policy_version 1304807 (0.0010) [2023-12-28 04:36:46,780][106225] Updated weights for policy 1, policy_version 1304817 (0.0010) [2023-12-28 04:36:46,963][106226] Updated weights for policy 0, policy_version 1301500 (0.0007) [2023-12-28 04:36:47,022][106226] Updated weights for policy 0, policy_version 1301510 (0.0008) [2023-12-28 04:36:47,080][106226] Updated weights for policy 0, policy_version 1301520 (0.0009) [2023-12-28 04:36:47,366][106225] Updated weights for policy 1, policy_version 1304827 (0.0010) [2023-12-28 04:36:47,425][106225] Updated weights for policy 1, policy_version 1304837 (0.0010) [2023-12-28 04:36:47,484][106225] Updated weights for policy 1, policy_version 1304847 (0.0010) [2023-12-28 04:36:47,857][106226] Updated weights for policy 0, policy_version 1301530 (0.0009) [2023-12-28 04:36:47,914][106226] Updated weights for policy 0, policy_version 1301540 (0.0010) [2023-12-28 04:36:47,967][106226] Updated weights for policy 0, policy_version 1301550 (0.0010) [2023-12-28 04:36:48,021][106226] Updated weights for policy 0, policy_version 1301560 (0.0010) [2023-12-28 04:36:48,140][106225] Updated weights for policy 1, policy_version 1304857 (0.0010) [2023-12-28 04:36:48,205][106225] Updated weights for policy 1, policy_version 1304867 (0.0010) [2023-12-28 04:36:48,268][106225] Updated weights for policy 1, policy_version 1304877 (0.0010) [2023-12-28 04:36:48,324][106225] Updated weights for policy 1, policy_version 1304887 (0.0007) [2023-12-28 04:36:48,731][106226] Updated weights for policy 0, policy_version 1301570 (0.0010) [2023-12-28 04:36:48,793][106226] Updated weights for policy 0, policy_version 1301580 (0.0009) [2023-12-28 04:36:48,850][106226] Updated weights for policy 0, policy_version 1301590 (0.0005) [2023-12-28 04:36:49,070][106225] Updated weights for policy 1, policy_version 1304897 (0.0010) [2023-12-28 04:36:49,130][106225] Updated weights for policy 1, policy_version 1304907 (0.0010) [2023-12-28 04:36:49,193][106225] Updated weights for policy 1, policy_version 1304917 (0.0010) [2023-12-28 04:36:49,535][106226] Updated weights for policy 0, policy_version 1301600 (0.0008) [2023-12-28 04:36:49,614][106226] Updated weights for policy 0, policy_version 1301611 (0.0008) [2023-12-28 04:36:49,674][106226] Updated weights for policy 0, policy_version 1301621 (0.0008) [2023-12-28 04:36:49,964][106225] Updated weights for policy 1, policy_version 1304927 (0.0008) [2023-12-28 04:36:50,025][106225] Updated weights for policy 1, policy_version 1304937 (0.0007) [2023-12-28 04:36:50,075][106225] Updated weights for policy 1, policy_version 1304947 (0.0005) [2023-12-28 04:36:50,349][106226] Updated weights for policy 0, policy_version 1301631 (0.0006) [2023-12-28 04:36:50,406][106226] Updated weights for policy 0, policy_version 1301641 (0.0007) [2023-12-28 04:36:50,467][106226] Updated weights for policy 0, policy_version 1301651 (0.0009) [2023-12-28 04:36:50,805][106225] Updated weights for policy 1, policy_version 1304957 (0.0007) [2023-12-28 04:36:50,852][106225] Updated weights for policy 1, policy_version 1304967 (0.0008) [2023-12-28 04:36:50,906][106225] Updated weights for policy 1, policy_version 1304977 (0.0007) [2023-12-28 04:36:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 667410432. Throughput: 0: 10048.8, 1: 9561.0. Samples: 667421572. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:51,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.883')] [2023-12-28 04:36:51,187][106226] Updated weights for policy 0, policy_version 1301661 (0.0009) [2023-12-28 04:36:51,254][106226] Updated weights for policy 0, policy_version 1301671 (0.0009) [2023-12-28 04:36:51,320][106226] Updated weights for policy 0, policy_version 1301681 (0.0011) [2023-12-28 04:36:51,715][106225] Updated weights for policy 1, policy_version 1304987 (0.0008) [2023-12-28 04:36:51,789][106225] Updated weights for policy 1, policy_version 1304997 (0.0007) [2023-12-28 04:36:51,857][106225] Updated weights for policy 1, policy_version 1305007 (0.0005) [2023-12-28 04:36:52,020][106226] Updated weights for policy 0, policy_version 1301691 (0.0010) [2023-12-28 04:36:52,083][106226] Updated weights for policy 0, policy_version 1301701 (0.0008) [2023-12-28 04:36:52,149][106226] Updated weights for policy 0, policy_version 1301711 (0.0009) [2023-12-28 04:36:52,511][106225] Updated weights for policy 1, policy_version 1305017 (0.0005) [2023-12-28 04:36:52,570][106225] Updated weights for policy 1, policy_version 1305027 (0.0006) [2023-12-28 04:36:52,631][106225] Updated weights for policy 1, policy_version 1305037 (0.0006) [2023-12-28 04:36:52,695][106225] Updated weights for policy 1, policy_version 1305047 (0.0006) [2023-12-28 04:36:52,932][106226] Updated weights for policy 0, policy_version 1301721 (0.0006) [2023-12-28 04:36:52,999][106226] Updated weights for policy 0, policy_version 1301731 (0.0005) [2023-12-28 04:36:53,063][106226] Updated weights for policy 0, policy_version 1301741 (0.0005) [2023-12-28 04:36:53,132][106226] Updated weights for policy 0, policy_version 1301751 (0.0005) [2023-12-28 04:36:53,360][106225] Updated weights for policy 1, policy_version 1305057 (0.0009) [2023-12-28 04:36:53,407][106225] Updated weights for policy 1, policy_version 1305067 (0.0008) [2023-12-28 04:36:53,459][106225] Updated weights for policy 1, policy_version 1305077 (0.0008) [2023-12-28 04:36:53,669][106226] Updated weights for policy 0, policy_version 1301761 (0.0008) [2023-12-28 04:36:53,723][106226] Updated weights for policy 0, policy_version 1301771 (0.0008) [2023-12-28 04:36:53,782][106226] Updated weights for policy 0, policy_version 1301781 (0.0008) [2023-12-28 04:36:54,208][106225] Updated weights for policy 1, policy_version 1305087 (0.0007) [2023-12-28 04:36:54,263][106225] Updated weights for policy 1, policy_version 1305097 (0.0009) [2023-12-28 04:36:54,325][106225] Updated weights for policy 1, policy_version 1305107 (0.0009) [2023-12-28 04:36:54,528][106226] Updated weights for policy 0, policy_version 1301791 (0.0008) [2023-12-28 04:36:54,593][106226] Updated weights for policy 0, policy_version 1301801 (0.0009) [2023-12-28 04:36:54,659][106226] Updated weights for policy 0, policy_version 1301811 (0.0009) [2023-12-28 04:36:54,958][106225] Updated weights for policy 1, policy_version 1305117 (0.0007) [2023-12-28 04:36:55,022][106225] Updated weights for policy 1, policy_version 1305127 (0.0008) [2023-12-28 04:36:55,073][106225] Updated weights for policy 1, policy_version 1305137 (0.0010) [2023-12-28 04:36:55,378][106226] Updated weights for policy 0, policy_version 1301821 (0.0007) [2023-12-28 04:36:55,428][106226] Updated weights for policy 0, policy_version 1301831 (0.0005) [2023-12-28 04:36:55,489][106226] Updated weights for policy 0, policy_version 1301841 (0.0005) [2023-12-28 04:36:55,737][106225] Updated weights for policy 1, policy_version 1305147 (0.0008) [2023-12-28 04:36:55,790][106225] Updated weights for policy 1, policy_version 1305157 (0.0005) [2023-12-28 04:36:55,841][106225] Updated weights for policy 1, policy_version 1305167 (0.0005) [2023-12-28 04:36:56,115][106226] Updated weights for policy 0, policy_version 1301851 (0.0006) [2023-12-28 04:36:56,168][106226] Updated weights for policy 0, policy_version 1301861 (0.0010) [2023-12-28 04:36:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 667508736. Throughput: 0: 10069.6, 1: 9519.8. Samples: 667479520. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:36:56,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-5.089')] [2023-12-28 04:36:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001305176_334176256.pth... [2023-12-28 04:36:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001304056_333889536.pth [2023-12-28 04:36:56,221][106226] Updated weights for policy 0, policy_version 1301871 (0.0010) [2023-12-28 04:36:56,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001301880_333340672.pth... [2023-12-28 04:36:56,269][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001300664_333029376.pth [2023-12-28 04:36:56,471][106225] Updated weights for policy 1, policy_version 1305177 (0.0006) [2023-12-28 04:36:56,532][106225] Updated weights for policy 1, policy_version 1305187 (0.0010) [2023-12-28 04:36:56,590][106225] Updated weights for policy 1, policy_version 1305197 (0.0010) [2023-12-28 04:36:56,645][106225] Updated weights for policy 1, policy_version 1305207 (0.0010) [2023-12-28 04:36:56,916][106226] Updated weights for policy 0, policy_version 1301881 (0.0010) [2023-12-28 04:36:56,974][106226] Updated weights for policy 0, policy_version 1301891 (0.0005) [2023-12-28 04:36:57,025][106226] Updated weights for policy 0, policy_version 1301901 (0.0005) [2023-12-28 04:36:57,083][106226] Updated weights for policy 0, policy_version 1301911 (0.0009) [2023-12-28 04:36:57,354][106225] Updated weights for policy 1, policy_version 1305217 (0.0007) [2023-12-28 04:36:57,401][106225] Updated weights for policy 1, policy_version 1305227 (0.0005) [2023-12-28 04:36:57,451][106225] Updated weights for policy 1, policy_version 1305237 (0.0005) [2023-12-28 04:36:57,724][106226] Updated weights for policy 0, policy_version 1301921 (0.0006) [2023-12-28 04:36:57,775][106226] Updated weights for policy 0, policy_version 1301931 (0.0009) [2023-12-28 04:36:57,826][106226] Updated weights for policy 0, policy_version 1301941 (0.0008) [2023-12-28 04:36:58,094][106225] Updated weights for policy 1, policy_version 1305247 (0.0009) [2023-12-28 04:36:58,153][106225] Updated weights for policy 1, policy_version 1305257 (0.0010) [2023-12-28 04:36:58,205][106225] Updated weights for policy 1, policy_version 1305267 (0.0010) [2023-12-28 04:36:58,443][106226] Updated weights for policy 0, policy_version 1301951 (0.0009) [2023-12-28 04:36:58,509][106226] Updated weights for policy 0, policy_version 1301961 (0.0011) [2023-12-28 04:36:58,575][106226] Updated weights for policy 0, policy_version 1301971 (0.0011) [2023-12-28 04:36:58,985][106225] Updated weights for policy 1, policy_version 1305277 (0.0008) [2023-12-28 04:36:59,049][106225] Updated weights for policy 1, policy_version 1305287 (0.0008) [2023-12-28 04:36:59,107][106225] Updated weights for policy 1, policy_version 1305297 (0.0008) [2023-12-28 04:36:59,368][106226] Updated weights for policy 0, policy_version 1301981 (0.0009) [2023-12-28 04:36:59,431][106226] Updated weights for policy 0, policy_version 1301991 (0.0006) [2023-12-28 04:36:59,487][106226] Updated weights for policy 0, policy_version 1302001 (0.0006) [2023-12-28 04:36:59,918][106225] Updated weights for policy 1, policy_version 1305307 (0.0010) [2023-12-28 04:36:59,985][106225] Updated weights for policy 1, policy_version 1305317 (0.0008) [2023-12-28 04:37:00,039][106225] Updated weights for policy 1, policy_version 1305327 (0.0008) [2023-12-28 04:37:00,170][106226] Updated weights for policy 0, policy_version 1302011 (0.0006) [2023-12-28 04:37:00,220][106226] Updated weights for policy 0, policy_version 1302021 (0.0008) [2023-12-28 04:37:00,276][106226] Updated weights for policy 0, policy_version 1302031 (0.0006) [2023-12-28 04:37:00,815][106225] Updated weights for policy 1, policy_version 1305337 (0.0009) [2023-12-28 04:37:00,865][106225] Updated weights for policy 1, policy_version 1305347 (0.0005) [2023-12-28 04:37:00,910][106225] Updated weights for policy 1, policy_version 1305357 (0.0005) [2023-12-28 04:37:00,932][106226] Updated weights for policy 0, policy_version 1302041 (0.0006) [2023-12-28 04:37:00,953][106225] Updated weights for policy 1, policy_version 1305367 (0.0005) [2023-12-28 04:37:00,985][106226] Updated weights for policy 0, policy_version 1302051 (0.0010) [2023-12-28 04:37:01,045][106226] Updated weights for policy 0, policy_version 1302061 (0.0011) [2023-12-28 04:37:01,107][106226] Updated weights for policy 0, policy_version 1302071 (0.0011) [2023-12-28 04:37:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 667615232. Throughput: 0: 10134.4, 1: 9615.3. Samples: 667599872. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:01,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-5.029')] [2023-12-28 04:37:01,654][106225] Updated weights for policy 1, policy_version 1305377 (0.0008) [2023-12-28 04:37:01,718][106225] Updated weights for policy 1, policy_version 1305387 (0.0009) [2023-12-28 04:37:01,774][106225] Updated weights for policy 1, policy_version 1305397 (0.0010) [2023-12-28 04:37:01,886][106226] Updated weights for policy 0, policy_version 1302081 (0.0007) [2023-12-28 04:37:01,936][106226] Updated weights for policy 0, policy_version 1302091 (0.0010) [2023-12-28 04:37:01,993][106226] Updated weights for policy 0, policy_version 1302101 (0.0010) [2023-12-28 04:37:02,524][106225] Updated weights for policy 1, policy_version 1305407 (0.0008) [2023-12-28 04:37:02,574][106225] Updated weights for policy 1, policy_version 1305417 (0.0008) [2023-12-28 04:37:02,628][106225] Updated weights for policy 1, policy_version 1305427 (0.0008) [2023-12-28 04:37:02,697][106226] Updated weights for policy 0, policy_version 1302111 (0.0010) [2023-12-28 04:37:02,760][106226] Updated weights for policy 0, policy_version 1302121 (0.0010) [2023-12-28 04:37:02,832][106226] Updated weights for policy 0, policy_version 1302131 (0.0011) [2023-12-28 04:37:03,314][106225] Updated weights for policy 1, policy_version 1305437 (0.0009) [2023-12-28 04:37:03,359][106225] Updated weights for policy 1, policy_version 1305447 (0.0007) [2023-12-28 04:37:03,407][106225] Updated weights for policy 1, policy_version 1305457 (0.0007) [2023-12-28 04:37:03,474][106226] Updated weights for policy 0, policy_version 1302141 (0.0007) [2023-12-28 04:37:03,529][106226] Updated weights for policy 0, policy_version 1302151 (0.0010) [2023-12-28 04:37:03,599][106226] Updated weights for policy 0, policy_version 1302161 (0.0010) [2023-12-28 04:37:04,110][106225] Updated weights for policy 1, policy_version 1305467 (0.0008) [2023-12-28 04:37:04,171][106225] Updated weights for policy 1, policy_version 1305477 (0.0009) [2023-12-28 04:37:04,220][106225] Updated weights for policy 1, policy_version 1305487 (0.0009) [2023-12-28 04:37:04,240][106226] Updated weights for policy 0, policy_version 1302171 (0.0009) [2023-12-28 04:37:04,297][106226] Updated weights for policy 0, policy_version 1302181 (0.0008) [2023-12-28 04:37:04,358][106226] Updated weights for policy 0, policy_version 1302191 (0.0008) [2023-12-28 04:37:04,959][106225] Updated weights for policy 1, policy_version 1305497 (0.0009) [2023-12-28 04:37:05,018][106225] Updated weights for policy 1, policy_version 1305507 (0.0006) [2023-12-28 04:37:05,074][106225] Updated weights for policy 1, policy_version 1305517 (0.0006) [2023-12-28 04:37:05,088][106226] Updated weights for policy 0, policy_version 1302201 (0.0009) [2023-12-28 04:37:05,124][106225] Updated weights for policy 1, policy_version 1305527 (0.0005) [2023-12-28 04:37:05,144][106226] Updated weights for policy 0, policy_version 1302211 (0.0007) [2023-12-28 04:37:05,203][106226] Updated weights for policy 0, policy_version 1302221 (0.0010) [2023-12-28 04:37:05,260][106226] Updated weights for policy 0, policy_version 1302231 (0.0008) [2023-12-28 04:37:05,773][106225] Updated weights for policy 1, policy_version 1305537 (0.0008) [2023-12-28 04:37:05,831][106225] Updated weights for policy 1, policy_version 1305547 (0.0009) [2023-12-28 04:37:05,882][106225] Updated weights for policy 1, policy_version 1305557 (0.0007) [2023-12-28 04:37:06,057][106226] Updated weights for policy 0, policy_version 1302241 (0.0009) [2023-12-28 04:37:06,157][106226] Updated weights for policy 0, policy_version 1302251 (0.0008) [2023-12-28 04:37:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 667705344. Throughput: 0: 10088.8, 1: 9649.0. Samples: 667718080. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:06,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-5.195')] [2023-12-28 04:37:06,225][106226] Updated weights for policy 0, policy_version 1302261 (0.0006) [2023-12-28 04:37:06,599][106225] Updated weights for policy 1, policy_version 1305567 (0.0009) [2023-12-28 04:37:06,656][106225] Updated weights for policy 1, policy_version 1305577 (0.0009) [2023-12-28 04:37:06,701][106225] Updated weights for policy 1, policy_version 1305587 (0.0008) [2023-12-28 04:37:06,833][106226] Updated weights for policy 0, policy_version 1302271 (0.0008) [2023-12-28 04:37:06,879][106226] Updated weights for policy 0, policy_version 1302281 (0.0008) [2023-12-28 04:37:06,940][106226] Updated weights for policy 0, policy_version 1302291 (0.0008) [2023-12-28 04:37:07,456][106225] Updated weights for policy 1, policy_version 1305597 (0.0007) [2023-12-28 04:37:07,512][106225] Updated weights for policy 1, policy_version 1305607 (0.0005) [2023-12-28 04:37:07,565][106225] Updated weights for policy 1, policy_version 1305617 (0.0010) [2023-12-28 04:37:07,587][106226] Updated weights for policy 0, policy_version 1302301 (0.0005) [2023-12-28 04:37:07,640][106226] Updated weights for policy 0, policy_version 1302311 (0.0005) [2023-12-28 04:37:07,696][106226] Updated weights for policy 0, policy_version 1302321 (0.0005) [2023-12-28 04:37:08,189][106225] Updated weights for policy 1, policy_version 1305627 (0.0008) [2023-12-28 04:37:08,254][106225] Updated weights for policy 1, policy_version 1305637 (0.0007) [2023-12-28 04:37:08,305][106226] Updated weights for policy 0, policy_version 1302331 (0.0006) [2023-12-28 04:37:08,321][106225] Updated weights for policy 1, policy_version 1305647 (0.0007) [2023-12-28 04:37:08,374][106226] Updated weights for policy 0, policy_version 1302341 (0.0007) [2023-12-28 04:37:08,439][106226] Updated weights for policy 0, policy_version 1302351 (0.0007) [2023-12-28 04:37:08,963][106225] Updated weights for policy 1, policy_version 1305657 (0.0008) [2023-12-28 04:37:09,029][106225] Updated weights for policy 1, policy_version 1305667 (0.0005) [2023-12-28 04:37:09,091][106225] Updated weights for policy 1, policy_version 1305677 (0.0007) [2023-12-28 04:37:09,121][106226] Updated weights for policy 0, policy_version 1302361 (0.0008) [2023-12-28 04:37:09,152][106225] Updated weights for policy 1, policy_version 1305687 (0.0009) [2023-12-28 04:37:09,179][106226] Updated weights for policy 0, policy_version 1302371 (0.0006) [2023-12-28 04:37:09,249][106226] Updated weights for policy 0, policy_version 1302381 (0.0007) [2023-12-28 04:37:09,316][106226] Updated weights for policy 0, policy_version 1302391 (0.0009) [2023-12-28 04:37:09,872][106225] Updated weights for policy 1, policy_version 1305697 (0.0007) [2023-12-28 04:37:09,941][106225] Updated weights for policy 1, policy_version 1305707 (0.0010) [2023-12-28 04:37:09,993][106225] Updated weights for policy 1, policy_version 1305717 (0.0006) [2023-12-28 04:37:10,075][106226] Updated weights for policy 0, policy_version 1302401 (0.0009) [2023-12-28 04:37:10,133][106226] Updated weights for policy 0, policy_version 1302411 (0.0009) [2023-12-28 04:37:10,185][106226] Updated weights for policy 0, policy_version 1302421 (0.0009) [2023-12-28 04:37:10,665][106225] Updated weights for policy 1, policy_version 1305727 (0.0008) [2023-12-28 04:37:10,721][106225] Updated weights for policy 1, policy_version 1305737 (0.0008) [2023-12-28 04:37:10,777][106225] Updated weights for policy 1, policy_version 1305747 (0.0009) [2023-12-28 04:37:10,957][106226] Updated weights for policy 0, policy_version 1302431 (0.0007) [2023-12-28 04:37:11,027][106226] Updated weights for policy 0, policy_version 1302441 (0.0006) [2023-12-28 04:37:11,097][106226] Updated weights for policy 0, policy_version 1302451 (0.0007) [2023-12-28 04:37:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 667811840. Throughput: 0: 10149.7, 1: 9725.5. Samples: 667779604. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:11,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-4.854')] [2023-12-28 04:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001305752_334323712.pth... [2023-12-28 04:37:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001302456_333488128.pth... [2023-12-28 04:37:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001301304_333193216.pth [2023-12-28 04:37:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001304600_334028800.pth [2023-12-28 04:37:11,561][106225] Updated weights for policy 1, policy_version 1305757 (0.0008) [2023-12-28 04:37:11,626][106225] Updated weights for policy 1, policy_version 1305767 (0.0007) [2023-12-28 04:37:11,696][106225] Updated weights for policy 1, policy_version 1305777 (0.0009) [2023-12-28 04:37:11,807][106226] Updated weights for policy 0, policy_version 1302461 (0.0007) [2023-12-28 04:37:11,870][106226] Updated weights for policy 0, policy_version 1302471 (0.0008) [2023-12-28 04:37:11,941][106226] Updated weights for policy 0, policy_version 1302481 (0.0009) [2023-12-28 04:37:12,405][106225] Updated weights for policy 1, policy_version 1305787 (0.0008) [2023-12-28 04:37:12,473][106225] Updated weights for policy 1, policy_version 1305797 (0.0009) [2023-12-28 04:37:12,532][106225] Updated weights for policy 1, policy_version 1305807 (0.0005) [2023-12-28 04:37:12,678][106226] Updated weights for policy 0, policy_version 1302491 (0.0009) [2023-12-28 04:37:12,744][106226] Updated weights for policy 0, policy_version 1302501 (0.0006) [2023-12-28 04:37:12,807][106226] Updated weights for policy 0, policy_version 1302511 (0.0008) [2023-12-28 04:37:13,170][106225] Updated weights for policy 1, policy_version 1305817 (0.0006) [2023-12-28 04:37:13,227][106225] Updated weights for policy 1, policy_version 1305827 (0.0008) [2023-12-28 04:37:13,277][106225] Updated weights for policy 1, policy_version 1305837 (0.0009) [2023-12-28 04:37:13,339][106225] Updated weights for policy 1, policy_version 1305847 (0.0009) [2023-12-28 04:37:13,497][106226] Updated weights for policy 0, policy_version 1302521 (0.0009) [2023-12-28 04:37:13,556][106226] Updated weights for policy 0, policy_version 1302531 (0.0005) [2023-12-28 04:37:13,618][106226] Updated weights for policy 0, policy_version 1302541 (0.0005) [2023-12-28 04:37:13,687][106226] Updated weights for policy 0, policy_version 1302551 (0.0006) [2023-12-28 04:37:13,987][106225] Updated weights for policy 1, policy_version 1305857 (0.0010) [2023-12-28 04:37:14,033][106225] Updated weights for policy 1, policy_version 1305867 (0.0010) [2023-12-28 04:37:14,079][106225] Updated weights for policy 1, policy_version 1305877 (0.0010) [2023-12-28 04:37:14,233][106226] Updated weights for policy 0, policy_version 1302561 (0.0007) [2023-12-28 04:37:14,298][106226] Updated weights for policy 0, policy_version 1302571 (0.0006) [2023-12-28 04:37:14,364][106226] Updated weights for policy 0, policy_version 1302581 (0.0008) [2023-12-28 04:37:14,813][106225] Updated weights for policy 1, policy_version 1305887 (0.0008) [2023-12-28 04:37:14,883][106225] Updated weights for policy 1, policy_version 1305897 (0.0006) [2023-12-28 04:37:14,948][106225] Updated weights for policy 1, policy_version 1305907 (0.0009) [2023-12-28 04:37:15,100][106226] Updated weights for policy 0, policy_version 1302591 (0.0008) [2023-12-28 04:37:15,167][106226] Updated weights for policy 0, policy_version 1302601 (0.0009) [2023-12-28 04:37:15,234][106226] Updated weights for policy 0, policy_version 1302611 (0.0008) [2023-12-28 04:37:15,589][106225] Updated weights for policy 1, policy_version 1305917 (0.0006) [2023-12-28 04:37:15,643][106225] Updated weights for policy 1, policy_version 1305927 (0.0005) [2023-12-28 04:37:15,695][106225] Updated weights for policy 1, policy_version 1305937 (0.0006) [2023-12-28 04:37:16,015][106226] Updated weights for policy 0, policy_version 1302621 (0.0008) [2023-12-28 04:37:16,066][106226] Updated weights for policy 0, policy_version 1302631 (0.0007) [2023-12-28 04:37:16,112][106226] Updated weights for policy 0, policy_version 1302641 (0.0008) [2023-12-28 04:37:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 667910144. Throughput: 0: 9934.6, 1: 9813.3. Samples: 667897028. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:16,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.872')] [2023-12-28 04:37:16,369][106225] Updated weights for policy 1, policy_version 1305947 (0.0010) [2023-12-28 04:37:16,416][106225] Updated weights for policy 1, policy_version 1305957 (0.0010) [2023-12-28 04:37:16,465][106225] Updated weights for policy 1, policy_version 1305967 (0.0010) [2023-12-28 04:37:16,884][106226] Updated weights for policy 0, policy_version 1302651 (0.0008) [2023-12-28 04:37:16,932][106226] Updated weights for policy 0, policy_version 1302661 (0.0008) [2023-12-28 04:37:16,982][106226] Updated weights for policy 0, policy_version 1302671 (0.0008) [2023-12-28 04:37:17,153][106225] Updated weights for policy 1, policy_version 1305977 (0.0010) [2023-12-28 04:37:17,205][106225] Updated weights for policy 1, policy_version 1305987 (0.0005) [2023-12-28 04:37:17,257][106225] Updated weights for policy 1, policy_version 1305997 (0.0005) [2023-12-28 04:37:17,312][106225] Updated weights for policy 1, policy_version 1306007 (0.0008) [2023-12-28 04:37:17,829][106226] Updated weights for policy 0, policy_version 1302681 (0.0009) [2023-12-28 04:37:17,882][106226] Updated weights for policy 0, policy_version 1302691 (0.0008) [2023-12-28 04:37:17,888][106225] Updated weights for policy 1, policy_version 1306017 (0.0005) [2023-12-28 04:37:17,944][106226] Updated weights for policy 0, policy_version 1302701 (0.0008) [2023-12-28 04:37:17,946][106225] Updated weights for policy 1, policy_version 1306027 (0.0005) [2023-12-28 04:37:17,996][106226] Updated weights for policy 0, policy_version 1302711 (0.0007) [2023-12-28 04:37:17,997][106225] Updated weights for policy 1, policy_version 1306037 (0.0005) [2023-12-28 04:37:18,631][106225] Updated weights for policy 1, policy_version 1306047 (0.0006) [2023-12-28 04:37:18,690][106225] Updated weights for policy 1, policy_version 1306057 (0.0006) [2023-12-28 04:37:18,723][106226] Updated weights for policy 0, policy_version 1302721 (0.0009) [2023-12-28 04:37:18,748][106225] Updated weights for policy 1, policy_version 1306067 (0.0006) [2023-12-28 04:37:18,785][106226] Updated weights for policy 0, policy_version 1302731 (0.0011) [2023-12-28 04:37:18,836][106226] Updated weights for policy 0, policy_version 1302741 (0.0010) [2023-12-28 04:37:19,472][106225] Updated weights for policy 1, policy_version 1306077 (0.0008) [2023-12-28 04:37:19,541][106225] Updated weights for policy 1, policy_version 1306087 (0.0009) [2023-12-28 04:37:19,563][106226] Updated weights for policy 0, policy_version 1302751 (0.0008) [2023-12-28 04:37:19,603][106225] Updated weights for policy 1, policy_version 1306097 (0.0010) [2023-12-28 04:37:19,625][106226] Updated weights for policy 0, policy_version 1302761 (0.0006) [2023-12-28 04:37:19,688][106226] Updated weights for policy 0, policy_version 1302771 (0.0008) [2023-12-28 04:37:20,262][106225] Updated weights for policy 1, policy_version 1306107 (0.0010) [2023-12-28 04:37:20,331][106225] Updated weights for policy 1, policy_version 1306117 (0.0009) [2023-12-28 04:37:20,395][106226] Updated weights for policy 0, policy_version 1302781 (0.0009) [2023-12-28 04:37:20,410][106225] Updated weights for policy 1, policy_version 1306127 (0.0008) [2023-12-28 04:37:20,460][106226] Updated weights for policy 0, policy_version 1302791 (0.0008) [2023-12-28 04:37:20,529][106226] Updated weights for policy 0, policy_version 1302801 (0.0008) [2023-12-28 04:37:21,123][106225] Updated weights for policy 1, policy_version 1306137 (0.0008) [2023-12-28 04:37:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 668000256. Throughput: 0: 9796.3, 1: 9919.5. Samples: 668014088. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:21,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.225')] [2023-12-28 04:37:21,183][106225] Updated weights for policy 1, policy_version 1306147 (0.0008) [2023-12-28 04:37:21,249][106225] Updated weights for policy 1, policy_version 1306157 (0.0008) [2023-12-28 04:37:21,302][106226] Updated weights for policy 0, policy_version 1302811 (0.0009) [2023-12-28 04:37:21,314][106225] Updated weights for policy 1, policy_version 1306167 (0.0009) [2023-12-28 04:37:21,366][106226] Updated weights for policy 0, policy_version 1302821 (0.0009) [2023-12-28 04:37:21,430][106226] Updated weights for policy 0, policy_version 1302831 (0.0009) [2023-12-28 04:37:22,094][106225] Updated weights for policy 1, policy_version 1306177 (0.0010) [2023-12-28 04:37:22,125][106226] Updated weights for policy 0, policy_version 1302841 (0.0009) [2023-12-28 04:37:22,149][106225] Updated weights for policy 1, policy_version 1306187 (0.0011) [2023-12-28 04:37:22,179][106226] Updated weights for policy 0, policy_version 1302851 (0.0006) [2023-12-28 04:37:22,204][106225] Updated weights for policy 1, policy_version 1306197 (0.0009) [2023-12-28 04:37:22,231][106226] Updated weights for policy 0, policy_version 1302861 (0.0006) [2023-12-28 04:37:22,297][106226] Updated weights for policy 0, policy_version 1302871 (0.0009) [2023-12-28 04:37:22,928][106226] Updated weights for policy 0, policy_version 1302881 (0.0008) [2023-12-28 04:37:22,986][106226] Updated weights for policy 0, policy_version 1302891 (0.0008) [2023-12-28 04:37:23,039][106225] Updated weights for policy 1, policy_version 1306207 (0.0008) [2023-12-28 04:37:23,051][106226] Updated weights for policy 0, policy_version 1302901 (0.0006) [2023-12-28 04:37:23,099][106225] Updated weights for policy 1, policy_version 1306217 (0.0008) [2023-12-28 04:37:23,162][106225] Updated weights for policy 1, policy_version 1306227 (0.0009) [2023-12-28 04:37:23,724][106226] Updated weights for policy 0, policy_version 1302911 (0.0009) [2023-12-28 04:37:23,784][106226] Updated weights for policy 0, policy_version 1302921 (0.0010) [2023-12-28 04:37:23,835][106225] Updated weights for policy 1, policy_version 1306237 (0.0009) [2023-12-28 04:37:23,845][106226] Updated weights for policy 0, policy_version 1302931 (0.0011) [2023-12-28 04:37:23,891][106225] Updated weights for policy 1, policy_version 1306247 (0.0008) [2023-12-28 04:37:23,945][106225] Updated weights for policy 1, policy_version 1306257 (0.0005) [2023-12-28 04:37:24,523][106225] Updated weights for policy 1, policy_version 1306267 (0.0005) [2023-12-28 04:37:24,523][106226] Updated weights for policy 0, policy_version 1302941 (0.0011) [2023-12-28 04:37:24,582][106225] Updated weights for policy 1, policy_version 1306277 (0.0005) [2023-12-28 04:37:24,583][106226] Updated weights for policy 0, policy_version 1302951 (0.0009) [2023-12-28 04:37:24,631][106225] Updated weights for policy 1, policy_version 1306287 (0.0006) [2023-12-28 04:37:24,643][106226] Updated weights for policy 0, policy_version 1302961 (0.0011) [2023-12-28 04:37:25,236][106225] Updated weights for policy 1, policy_version 1306297 (0.0007) [2023-12-28 04:37:25,287][106225] Updated weights for policy 1, policy_version 1306307 (0.0007) [2023-12-28 04:37:25,337][106226] Updated weights for policy 0, policy_version 1302971 (0.0011) [2023-12-28 04:37:25,340][106225] Updated weights for policy 1, policy_version 1306317 (0.0005) [2023-12-28 04:37:25,394][106226] Updated weights for policy 0, policy_version 1302981 (0.0010) [2023-12-28 04:37:25,396][106225] Updated weights for policy 1, policy_version 1306327 (0.0006) [2023-12-28 04:37:25,451][106226] Updated weights for policy 0, policy_version 1302991 (0.0010) [2023-12-28 04:37:25,956][106225] Updated weights for policy 1, policy_version 1306337 (0.0008) [2023-12-28 04:37:26,011][106225] Updated weights for policy 1, policy_version 1306347 (0.0007) [2023-12-28 04:37:26,064][106225] Updated weights for policy 1, policy_version 1306357 (0.0006) [2023-12-28 04:37:26,143][106226] Updated weights for policy 0, policy_version 1303001 (0.0010) [2023-12-28 04:37:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19799.6). Total num frames: 668106752. Throughput: 0: 9821.5, 1: 9910.4. Samples: 668072012. Policy #0 lag: (min: 1.0, avg: 12.6, max: 33.0) [2023-12-28 04:37:26,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.793')] [2023-12-28 04:37:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001306360_334479360.pth... [2023-12-28 04:37:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001305176_334176256.pth [2023-12-28 04:37:26,201][106226] Updated weights for policy 0, policy_version 1303011 (0.0011) [2023-12-28 04:37:26,259][106226] Updated weights for policy 0, policy_version 1303021 (0.0011) [2023-12-28 04:37:26,320][106226] Updated weights for policy 0, policy_version 1303031 (0.0011) [2023-12-28 04:37:26,325][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001303032_333635584.pth... [2023-12-28 04:37:26,329][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001301880_333340672.pth [2023-12-28 04:37:26,696][106225] Updated weights for policy 1, policy_version 1306367 (0.0006) [2023-12-28 04:37:26,752][106225] Updated weights for policy 1, policy_version 1306377 (0.0005) [2023-12-28 04:37:26,797][106225] Updated weights for policy 1, policy_version 1306387 (0.0005) [2023-12-28 04:37:27,038][106226] Updated weights for policy 0, policy_version 1303041 (0.0011) [2023-12-28 04:37:27,085][106226] Updated weights for policy 0, policy_version 1303051 (0.0010) [2023-12-28 04:37:27,134][106226] Updated weights for policy 0, policy_version 1303061 (0.0010) [2023-12-28 04:37:27,314][106225] Updated weights for policy 1, policy_version 1306397 (0.0005) [2023-12-28 04:37:27,374][106225] Updated weights for policy 1, policy_version 1306407 (0.0005) [2023-12-28 04:37:27,423][106225] Updated weights for policy 1, policy_version 1306417 (0.0006) [2023-12-28 04:37:27,830][106226] Updated weights for policy 0, policy_version 1303071 (0.0010) [2023-12-28 04:37:27,876][106226] Updated weights for policy 0, policy_version 1303081 (0.0010) [2023-12-28 04:37:27,922][106226] Updated weights for policy 0, policy_version 1303091 (0.0010) [2023-12-28 04:37:28,003][106225] Updated weights for policy 1, policy_version 1306427 (0.0006) [2023-12-28 04:37:28,048][106225] Updated weights for policy 1, policy_version 1306437 (0.0005) [2023-12-28 04:37:28,097][106225] Updated weights for policy 1, policy_version 1306447 (0.0006) [2023-12-28 04:37:28,655][106226] Updated weights for policy 0, policy_version 1303101 (0.0009) [2023-12-28 04:37:28,684][106225] Updated weights for policy 1, policy_version 1306457 (0.0007) [2023-12-28 04:37:28,713][106226] Updated weights for policy 0, policy_version 1303111 (0.0009) [2023-12-28 04:37:28,736][106225] Updated weights for policy 1, policy_version 1306467 (0.0006) [2023-12-28 04:37:28,772][106226] Updated weights for policy 0, policy_version 1303121 (0.0010) [2023-12-28 04:37:28,786][106225] Updated weights for policy 1, policy_version 1306477 (0.0005) [2023-12-28 04:37:28,848][106225] Updated weights for policy 1, policy_version 1306487 (0.0007) [2023-12-28 04:37:29,418][106226] Updated weights for policy 0, policy_version 1303131 (0.0009) [2023-12-28 04:37:29,485][106226] Updated weights for policy 0, policy_version 1303141 (0.0005) [2023-12-28 04:37:29,555][106226] Updated weights for policy 0, policy_version 1303151 (0.0006) [2023-12-28 04:37:29,593][106225] Updated weights for policy 1, policy_version 1306497 (0.0006) [2023-12-28 04:37:29,657][106225] Updated weights for policy 1, policy_version 1306507 (0.0005) [2023-12-28 04:37:29,721][106225] Updated weights for policy 1, policy_version 1306517 (0.0010) [2023-12-28 04:37:30,154][106226] Updated weights for policy 0, policy_version 1303161 (0.0006) [2023-12-28 04:37:30,222][106226] Updated weights for policy 0, policy_version 1303171 (0.0010) [2023-12-28 04:37:30,293][106226] Updated weights for policy 0, policy_version 1303181 (0.0008) [2023-12-28 04:37:30,349][106226] Updated weights for policy 0, policy_version 1303191 (0.0011) [2023-12-28 04:37:30,395][106225] Updated weights for policy 1, policy_version 1306527 (0.0008) [2023-12-28 04:37:30,459][106225] Updated weights for policy 1, policy_version 1306537 (0.0007) [2023-12-28 04:37:30,508][106225] Updated weights for policy 1, policy_version 1306547 (0.0005) [2023-12-28 04:37:31,027][106226] Updated weights for policy 0, policy_version 1303201 (0.0011) [2023-12-28 04:37:31,101][106226] Updated weights for policy 0, policy_version 1303211 (0.0009) [2023-12-28 04:37:31,161][106225] Updated weights for policy 1, policy_version 1306557 (0.0006) [2023-12-28 04:37:31,172][106226] Updated weights for policy 0, policy_version 1303221 (0.0008) [2023-12-28 04:37:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 668205056. Throughput: 0: 9874.7, 1: 10128.4. Samples: 668201324. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:31,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.788')] [2023-12-28 04:37:31,228][106225] Updated weights for policy 1, policy_version 1306567 (0.0008) [2023-12-28 04:37:31,292][106225] Updated weights for policy 1, policy_version 1306577 (0.0008) [2023-12-28 04:37:31,847][106226] Updated weights for policy 0, policy_version 1303231 (0.0007) [2023-12-28 04:37:31,904][106226] Updated weights for policy 0, policy_version 1303241 (0.0005) [2023-12-28 04:37:31,965][106226] Updated weights for policy 0, policy_version 1303251 (0.0005) [2023-12-28 04:37:32,007][106225] Updated weights for policy 1, policy_version 1306587 (0.0008) [2023-12-28 04:37:32,059][106225] Updated weights for policy 1, policy_version 1306597 (0.0008) [2023-12-28 04:37:32,105][106225] Updated weights for policy 1, policy_version 1306607 (0.0008) [2023-12-28 04:37:32,608][106226] Updated weights for policy 0, policy_version 1303261 (0.0009) [2023-12-28 04:37:32,661][106226] Updated weights for policy 0, policy_version 1303271 (0.0006) [2023-12-28 04:37:32,716][106226] Updated weights for policy 0, policy_version 1303281 (0.0005) [2023-12-28 04:37:32,885][106225] Updated weights for policy 1, policy_version 1306617 (0.0008) [2023-12-28 04:37:32,948][106225] Updated weights for policy 1, policy_version 1306627 (0.0005) [2023-12-28 04:37:33,010][106225] Updated weights for policy 1, policy_version 1306637 (0.0005) [2023-12-28 04:37:33,066][106225] Updated weights for policy 1, policy_version 1306647 (0.0007) [2023-12-28 04:37:33,382][106226] Updated weights for policy 0, policy_version 1303291 (0.0006) [2023-12-28 04:37:33,431][106226] Updated weights for policy 0, policy_version 1303301 (0.0007) [2023-12-28 04:37:33,486][106226] Updated weights for policy 0, policy_version 1303311 (0.0005) [2023-12-28 04:37:33,667][106225] Updated weights for policy 1, policy_version 1306657 (0.0006) [2023-12-28 04:37:33,718][106225] Updated weights for policy 1, policy_version 1306667 (0.0006) [2023-12-28 04:37:33,777][106225] Updated weights for policy 1, policy_version 1306678 (0.0007) [2023-12-28 04:37:34,087][106226] Updated weights for policy 0, policy_version 1303321 (0.0007) [2023-12-28 04:37:34,156][106226] Updated weights for policy 0, policy_version 1303331 (0.0006) [2023-12-28 04:37:34,219][106226] Updated weights for policy 0, policy_version 1303341 (0.0008) [2023-12-28 04:37:34,276][106226] Updated weights for policy 0, policy_version 1303351 (0.0008) [2023-12-28 04:37:34,545][106225] Updated weights for policy 1, policy_version 1306688 (0.0009) [2023-12-28 04:37:34,608][106225] Updated weights for policy 1, policy_version 1306698 (0.0008) [2023-12-28 04:37:34,673][106225] Updated weights for policy 1, policy_version 1306708 (0.0009) [2023-12-28 04:37:34,890][106226] Updated weights for policy 0, policy_version 1303361 (0.0008) [2023-12-28 04:37:34,934][106226] Updated weights for policy 0, policy_version 1303371 (0.0008) [2023-12-28 04:37:34,980][106226] Updated weights for policy 0, policy_version 1303381 (0.0009) [2023-12-28 04:37:35,395][106225] Updated weights for policy 1, policy_version 1306718 (0.0008) [2023-12-28 04:37:35,447][106225] Updated weights for policy 1, policy_version 1306728 (0.0008) [2023-12-28 04:37:35,494][106225] Updated weights for policy 1, policy_version 1306738 (0.0007) [2023-12-28 04:37:35,775][106226] Updated weights for policy 0, policy_version 1303391 (0.0009) [2023-12-28 04:37:35,836][106226] Updated weights for policy 0, policy_version 1303401 (0.0006) [2023-12-28 04:37:35,900][106226] Updated weights for policy 0, policy_version 1303411 (0.0009) [2023-12-28 04:37:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 668311552. Throughput: 0: 9929.3, 1: 10087.4. Samples: 668322324. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:36,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-5.073')] [2023-12-28 04:37:36,252][106225] Updated weights for policy 1, policy_version 1306748 (0.0008) [2023-12-28 04:37:36,314][106225] Updated weights for policy 1, policy_version 1306758 (0.0008) [2023-12-28 04:37:36,375][106225] Updated weights for policy 1, policy_version 1306768 (0.0009) [2023-12-28 04:37:36,607][106226] Updated weights for policy 0, policy_version 1303421 (0.0010) [2023-12-28 04:37:36,678][106226] Updated weights for policy 0, policy_version 1303431 (0.0009) [2023-12-28 04:37:36,748][106226] Updated weights for policy 0, policy_version 1303441 (0.0009) [2023-12-28 04:37:37,075][106225] Updated weights for policy 1, policy_version 1306778 (0.0008) [2023-12-28 04:37:37,127][106225] Updated weights for policy 1, policy_version 1306788 (0.0009) [2023-12-28 04:37:37,179][106225] Updated weights for policy 1, policy_version 1306798 (0.0009) [2023-12-28 04:37:37,242][106225] Updated weights for policy 1, policy_version 1306808 (0.0007) [2023-12-28 04:37:37,487][106226] Updated weights for policy 0, policy_version 1303451 (0.0009) [2023-12-28 04:37:37,545][106226] Updated weights for policy 0, policy_version 1303461 (0.0009) [2023-12-28 04:37:37,603][106226] Updated weights for policy 0, policy_version 1303471 (0.0010) [2023-12-28 04:37:37,884][106225] Updated weights for policy 1, policy_version 1306818 (0.0005) [2023-12-28 04:37:37,946][106225] Updated weights for policy 1, policy_version 1306828 (0.0009) [2023-12-28 04:37:38,016][106225] Updated weights for policy 1, policy_version 1306838 (0.0010) [2023-12-28 04:37:38,392][106226] Updated weights for policy 0, policy_version 1303481 (0.0009) [2023-12-28 04:37:38,456][106226] Updated weights for policy 0, policy_version 1303491 (0.0009) [2023-12-28 04:37:38,509][106226] Updated weights for policy 0, policy_version 1303501 (0.0010) [2023-12-28 04:37:38,569][106226] Updated weights for policy 0, policy_version 1303511 (0.0009) [2023-12-28 04:37:38,642][106225] Updated weights for policy 1, policy_version 1306848 (0.0007) [2023-12-28 04:37:38,709][106225] Updated weights for policy 1, policy_version 1306858 (0.0007) [2023-12-28 04:37:38,782][106225] Updated weights for policy 1, policy_version 1306868 (0.0006) [2023-12-28 04:37:39,293][106226] Updated weights for policy 0, policy_version 1303521 (0.0008) [2023-12-28 04:37:39,314][106225] Updated weights for policy 1, policy_version 1306878 (0.0006) [2023-12-28 04:37:39,362][106226] Updated weights for policy 0, policy_version 1303531 (0.0007) [2023-12-28 04:37:39,383][106225] Updated weights for policy 1, policy_version 1306888 (0.0009) [2023-12-28 04:37:39,435][106226] Updated weights for policy 0, policy_version 1303541 (0.0008) [2023-12-28 04:37:39,453][106225] Updated weights for policy 1, policy_version 1306898 (0.0007) [2023-12-28 04:37:40,163][106225] Updated weights for policy 1, policy_version 1306908 (0.0006) [2023-12-28 04:37:40,198][106226] Updated weights for policy 0, policy_version 1303551 (0.0007) [2023-12-28 04:37:40,224][106225] Updated weights for policy 1, policy_version 1306918 (0.0007) [2023-12-28 04:37:40,257][106226] Updated weights for policy 0, policy_version 1303561 (0.0008) [2023-12-28 04:37:40,278][106225] Updated weights for policy 1, policy_version 1306928 (0.0006) [2023-12-28 04:37:40,319][106226] Updated weights for policy 0, policy_version 1303571 (0.0007) [2023-12-28 04:37:40,912][106226] Updated weights for policy 0, policy_version 1303581 (0.0007) [2023-12-28 04:37:40,941][106225] Updated weights for policy 1, policy_version 1306938 (0.0006) [2023-12-28 04:37:40,972][106226] Updated weights for policy 0, policy_version 1303591 (0.0007) [2023-12-28 04:37:40,998][106225] Updated weights for policy 1, policy_version 1306948 (0.0007) [2023-12-28 04:37:41,040][106226] Updated weights for policy 0, policy_version 1303601 (0.0009) [2023-12-28 04:37:41,062][106225] Updated weights for policy 1, policy_version 1306958 (0.0008) [2023-12-28 04:37:41,126][106225] Updated weights for policy 1, policy_version 1306968 (0.0008) [2023-12-28 04:37:41,176][105115] Fps is (10 sec: 21295.7, 60 sec: 20206.4, 300 sec: 19855.1). Total num frames: 668418048. Throughput: 0: 9902.2, 1: 10137.0. Samples: 668381312. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:41,177][105115] Avg episode reward: [(0, '-4.265'), (1, '-5.048')] [2023-12-28 04:37:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001303608_333783040.pth... [2023-12-28 04:37:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001306968_334635008.pth... [2023-12-28 04:37:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001302456_333488128.pth [2023-12-28 04:37:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001305752_334323712.pth [2023-12-28 04:37:41,819][106226] Updated weights for policy 0, policy_version 1303611 (0.0010) [2023-12-28 04:37:41,881][106226] Updated weights for policy 0, policy_version 1303621 (0.0009) [2023-12-28 04:37:41,907][106225] Updated weights for policy 1, policy_version 1306978 (0.0008) [2023-12-28 04:37:41,945][106226] Updated weights for policy 0, policy_version 1303631 (0.0010) [2023-12-28 04:37:41,971][106225] Updated weights for policy 1, policy_version 1306988 (0.0008) [2023-12-28 04:37:42,034][106225] Updated weights for policy 1, policy_version 1306998 (0.0008) [2023-12-28 04:37:42,676][106226] Updated weights for policy 0, policy_version 1303641 (0.0011) [2023-12-28 04:37:42,726][106225] Updated weights for policy 1, policy_version 1307008 (0.0006) [2023-12-28 04:37:42,734][106226] Updated weights for policy 0, policy_version 1303651 (0.0011) [2023-12-28 04:37:42,786][106226] Updated weights for policy 0, policy_version 1303661 (0.0010) [2023-12-28 04:37:42,788][106225] Updated weights for policy 1, policy_version 1307018 (0.0010) [2023-12-28 04:37:42,845][106225] Updated weights for policy 1, policy_version 1307028 (0.0010) [2023-12-28 04:37:42,850][106226] Updated weights for policy 0, policy_version 1303671 (0.0011) [2023-12-28 04:37:43,481][106225] Updated weights for policy 1, policy_version 1307038 (0.0009) [2023-12-28 04:37:43,488][106226] Updated weights for policy 0, policy_version 1303681 (0.0006) [2023-12-28 04:37:43,538][106226] Updated weights for policy 0, policy_version 1303691 (0.0006) [2023-12-28 04:37:43,543][106225] Updated weights for policy 1, policy_version 1307048 (0.0010) [2023-12-28 04:37:43,592][106226] Updated weights for policy 0, policy_version 1303701 (0.0007) [2023-12-28 04:37:43,599][106225] Updated weights for policy 1, policy_version 1307058 (0.0007) [2023-12-28 04:37:44,280][106225] Updated weights for policy 1, policy_version 1307068 (0.0006) [2023-12-28 04:37:44,289][106226] Updated weights for policy 0, policy_version 1303711 (0.0006) [2023-12-28 04:37:44,333][106225] Updated weights for policy 1, policy_version 1307078 (0.0008) [2023-12-28 04:37:44,343][106226] Updated weights for policy 0, policy_version 1303721 (0.0006) [2023-12-28 04:37:44,384][106225] Updated weights for policy 1, policy_version 1307088 (0.0007) [2023-12-28 04:37:44,398][106226] Updated weights for policy 0, policy_version 1303731 (0.0005) [2023-12-28 04:37:45,069][106226] Updated weights for policy 0, policy_version 1303741 (0.0007) [2023-12-28 04:37:45,088][106225] Updated weights for policy 1, policy_version 1307098 (0.0008) [2023-12-28 04:37:45,129][106226] Updated weights for policy 0, policy_version 1303751 (0.0009) [2023-12-28 04:37:45,147][106225] Updated weights for policy 1, policy_version 1307108 (0.0007) [2023-12-28 04:37:45,193][106226] Updated weights for policy 0, policy_version 1303761 (0.0007) [2023-12-28 04:37:45,206][106225] Updated weights for policy 1, policy_version 1307118 (0.0006) [2023-12-28 04:37:45,268][106225] Updated weights for policy 1, policy_version 1307128 (0.0006) [2023-12-28 04:37:45,863][106225] Updated weights for policy 1, policy_version 1307138 (0.0006) [2023-12-28 04:37:45,883][106226] Updated weights for policy 0, policy_version 1303771 (0.0007) [2023-12-28 04:37:45,922][106225] Updated weights for policy 1, policy_version 1307148 (0.0006) [2023-12-28 04:37:45,943][106226] Updated weights for policy 0, policy_version 1303781 (0.0009) [2023-12-28 04:37:45,978][106225] Updated weights for policy 1, policy_version 1307158 (0.0005) [2023-12-28 04:37:45,993][106226] Updated weights for policy 0, policy_version 1303791 (0.0005) [2023-12-28 04:37:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 668516352. Throughput: 0: 9866.6, 1: 10142.2. Samples: 668500272. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:46,176][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.565')] [2023-12-28 04:37:46,581][106226] Updated weights for policy 0, policy_version 1303801 (0.0006) [2023-12-28 04:37:46,621][106225] Updated weights for policy 1, policy_version 1307168 (0.0005) [2023-12-28 04:37:46,638][106226] Updated weights for policy 0, policy_version 1303811 (0.0010) [2023-12-28 04:37:46,678][106225] Updated weights for policy 1, policy_version 1307178 (0.0005) [2023-12-28 04:37:46,701][106226] Updated weights for policy 0, policy_version 1303821 (0.0010) [2023-12-28 04:37:46,734][106225] Updated weights for policy 1, policy_version 1307188 (0.0005) [2023-12-28 04:37:46,759][106226] Updated weights for policy 0, policy_version 1303831 (0.0009) [2023-12-28 04:37:47,348][106225] Updated weights for policy 1, policy_version 1307198 (0.0007) [2023-12-28 04:37:47,400][106225] Updated weights for policy 1, policy_version 1307208 (0.0009) [2023-12-28 04:37:47,410][106226] Updated weights for policy 0, policy_version 1303841 (0.0010) [2023-12-28 04:37:47,454][106225] Updated weights for policy 1, policy_version 1307218 (0.0005) [2023-12-28 04:37:47,470][106226] Updated weights for policy 0, policy_version 1303851 (0.0011) [2023-12-28 04:37:47,530][106226] Updated weights for policy 0, policy_version 1303861 (0.0011) [2023-12-28 04:37:48,067][106225] Updated weights for policy 1, policy_version 1307228 (0.0009) [2023-12-28 04:37:48,123][106225] Updated weights for policy 1, policy_version 1307238 (0.0010) [2023-12-28 04:37:48,171][106225] Updated weights for policy 1, policy_version 1307248 (0.0009) [2023-12-28 04:37:48,233][106226] Updated weights for policy 0, policy_version 1303871 (0.0011) [2023-12-28 04:37:48,286][106226] Updated weights for policy 0, policy_version 1303881 (0.0010) [2023-12-28 04:37:48,351][106226] Updated weights for policy 0, policy_version 1303891 (0.0009) [2023-12-28 04:37:48,899][106225] Updated weights for policy 1, policy_version 1307258 (0.0007) [2023-12-28 04:37:48,962][106225] Updated weights for policy 1, policy_version 1307268 (0.0010) [2023-12-28 04:37:49,025][106225] Updated weights for policy 1, policy_version 1307278 (0.0010) [2023-12-28 04:37:49,040][106226] Updated weights for policy 0, policy_version 1303901 (0.0008) [2023-12-28 04:37:49,075][106225] Updated weights for policy 1, policy_version 1307288 (0.0010) [2023-12-28 04:37:49,099][106226] Updated weights for policy 0, policy_version 1303911 (0.0007) [2023-12-28 04:37:49,154][106226] Updated weights for policy 0, policy_version 1303921 (0.0010) [2023-12-28 04:37:49,753][106225] Updated weights for policy 1, policy_version 1307298 (0.0009) [2023-12-28 04:37:49,802][106226] Updated weights for policy 0, policy_version 1303931 (0.0009) [2023-12-28 04:37:49,804][106225] Updated weights for policy 1, policy_version 1307308 (0.0008) [2023-12-28 04:37:49,867][106225] Updated weights for policy 1, policy_version 1307318 (0.0007) [2023-12-28 04:37:49,870][106226] Updated weights for policy 0, policy_version 1303941 (0.0008) [2023-12-28 04:37:49,929][106226] Updated weights for policy 0, policy_version 1303951 (0.0008) [2023-12-28 04:37:50,594][106225] Updated weights for policy 1, policy_version 1307328 (0.0007) [2023-12-28 04:37:50,657][106225] Updated weights for policy 1, policy_version 1307338 (0.0006) [2023-12-28 04:37:50,659][106226] Updated weights for policy 0, policy_version 1303961 (0.0009) [2023-12-28 04:37:50,726][106225] Updated weights for policy 1, policy_version 1307348 (0.0009) [2023-12-28 04:37:50,729][106226] Updated weights for policy 0, policy_version 1303971 (0.0007) [2023-12-28 04:37:50,779][106226] Updated weights for policy 0, policy_version 1303981 (0.0007) [2023-12-28 04:37:50,828][106226] Updated weights for policy 0, policy_version 1303991 (0.0008) [2023-12-28 04:37:51,175][105115] Fps is (10 sec: 19664.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 668614656. Throughput: 0: 9901.8, 1: 10218.9. Samples: 668623512. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:51,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-5.056')] [2023-12-28 04:37:51,461][106225] Updated weights for policy 1, policy_version 1307358 (0.0008) [2023-12-28 04:37:51,521][106225] Updated weights for policy 1, policy_version 1307368 (0.0009) [2023-12-28 04:37:51,584][106225] Updated weights for policy 1, policy_version 1307378 (0.0007) [2023-12-28 04:37:51,587][106226] Updated weights for policy 0, policy_version 1304001 (0.0007) [2023-12-28 04:37:51,657][106226] Updated weights for policy 0, policy_version 1304011 (0.0009) [2023-12-28 04:37:51,722][106226] Updated weights for policy 0, policy_version 1304021 (0.0009) [2023-12-28 04:37:52,269][106225] Updated weights for policy 1, policy_version 1307388 (0.0008) [2023-12-28 04:37:52,330][106225] Updated weights for policy 1, policy_version 1307398 (0.0008) [2023-12-28 04:37:52,394][106225] Updated weights for policy 1, policy_version 1307408 (0.0009) [2023-12-28 04:37:52,428][106226] Updated weights for policy 0, policy_version 1304031 (0.0007) [2023-12-28 04:37:52,501][106226] Updated weights for policy 0, policy_version 1304041 (0.0006) [2023-12-28 04:37:52,567][106226] Updated weights for policy 0, policy_version 1304051 (0.0008) [2023-12-28 04:37:53,065][106225] Updated weights for policy 1, policy_version 1307418 (0.0008) [2023-12-28 04:37:53,127][106225] Updated weights for policy 1, policy_version 1307428 (0.0010) [2023-12-28 04:37:53,177][106225] Updated weights for policy 1, policy_version 1307438 (0.0010) [2023-12-28 04:37:53,225][106226] Updated weights for policy 0, policy_version 1304061 (0.0009) [2023-12-28 04:37:53,230][106225] Updated weights for policy 1, policy_version 1307448 (0.0009) [2023-12-28 04:37:53,284][106226] Updated weights for policy 0, policy_version 1304071 (0.0008) [2023-12-28 04:37:53,336][106226] Updated weights for policy 0, policy_version 1304081 (0.0009) [2023-12-28 04:37:53,888][106225] Updated weights for policy 1, policy_version 1307458 (0.0006) [2023-12-28 04:37:53,942][106225] Updated weights for policy 1, policy_version 1307468 (0.0009) [2023-12-28 04:37:53,960][106226] Updated weights for policy 0, policy_version 1304091 (0.0007) [2023-12-28 04:37:54,004][106225] Updated weights for policy 1, policy_version 1307478 (0.0007) [2023-12-28 04:37:54,023][106226] Updated weights for policy 0, policy_version 1304101 (0.0007) [2023-12-28 04:37:54,084][106226] Updated weights for policy 0, policy_version 1304111 (0.0009) [2023-12-28 04:37:54,686][106225] Updated weights for policy 1, policy_version 1307488 (0.0005) [2023-12-28 04:37:54,745][106225] Updated weights for policy 1, policy_version 1307498 (0.0005) [2023-12-28 04:37:54,745][106226] Updated weights for policy 0, policy_version 1304121 (0.0007) [2023-12-28 04:37:54,801][106226] Updated weights for policy 0, policy_version 1304131 (0.0008) [2023-12-28 04:37:54,803][106225] Updated weights for policy 1, policy_version 1307508 (0.0005) [2023-12-28 04:37:54,847][106226] Updated weights for policy 0, policy_version 1304141 (0.0007) [2023-12-28 04:37:54,894][106226] Updated weights for policy 0, policy_version 1304151 (0.0008) [2023-12-28 04:37:55,417][106225] Updated weights for policy 1, policy_version 1307518 (0.0006) [2023-12-28 04:37:55,481][106225] Updated weights for policy 1, policy_version 1307528 (0.0008) [2023-12-28 04:37:55,535][106225] Updated weights for policy 1, policy_version 1307538 (0.0009) [2023-12-28 04:37:55,671][106226] Updated weights for policy 0, policy_version 1304161 (0.0006) [2023-12-28 04:37:55,719][106226] Updated weights for policy 0, policy_version 1304171 (0.0008) [2023-12-28 04:37:55,764][106226] Updated weights for policy 0, policy_version 1304181 (0.0008) [2023-12-28 04:37:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 668712960. Throughput: 0: 9869.6, 1: 10218.5. Samples: 668683568. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:37:56,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-5.151')] [2023-12-28 04:37:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001304184_333930496.pth... [2023-12-28 04:37:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001303032_333635584.pth [2023-12-28 04:37:56,191][106225] Updated weights for policy 1, policy_version 1307548 (0.0010) [2023-12-28 04:37:56,248][106225] Updated weights for policy 1, policy_version 1307558 (0.0010) [2023-12-28 04:37:56,306][106225] Updated weights for policy 1, policy_version 1307568 (0.0007) [2023-12-28 04:37:56,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001307576_334790656.pth... [2023-12-28 04:37:56,364][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001306360_334479360.pth [2023-12-28 04:37:56,417][106226] Updated weights for policy 0, policy_version 1304191 (0.0006) [2023-12-28 04:37:56,471][106226] Updated weights for policy 0, policy_version 1304201 (0.0005) [2023-12-28 04:37:56,522][106226] Updated weights for policy 0, policy_version 1304211 (0.0005) [2023-12-28 04:37:56,840][106225] Updated weights for policy 1, policy_version 1307578 (0.0005) [2023-12-28 04:37:56,886][106225] Updated weights for policy 1, policy_version 1307588 (0.0005) [2023-12-28 04:37:56,940][106225] Updated weights for policy 1, policy_version 1307598 (0.0006) [2023-12-28 04:37:57,001][106225] Updated weights for policy 1, policy_version 1307608 (0.0009) [2023-12-28 04:37:57,019][106226] Updated weights for policy 0, policy_version 1304221 (0.0006) [2023-12-28 04:37:57,071][106226] Updated weights for policy 0, policy_version 1304231 (0.0006) [2023-12-28 04:37:57,124][106226] Updated weights for policy 0, policy_version 1304241 (0.0007) [2023-12-28 04:37:57,676][106226] Updated weights for policy 0, policy_version 1304251 (0.0007) [2023-12-28 04:37:57,714][106225] Updated weights for policy 1, policy_version 1307618 (0.0005) [2023-12-28 04:37:57,731][106226] Updated weights for policy 0, policy_version 1304261 (0.0007) [2023-12-28 04:37:57,775][106225] Updated weights for policy 1, policy_version 1307628 (0.0006) [2023-12-28 04:37:57,795][106226] Updated weights for policy 0, policy_version 1304271 (0.0007) [2023-12-28 04:37:57,833][106225] Updated weights for policy 1, policy_version 1307638 (0.0006) [2023-12-28 04:37:58,529][106226] Updated weights for policy 0, policy_version 1304281 (0.0009) [2023-12-28 04:37:58,571][106225] Updated weights for policy 1, policy_version 1307648 (0.0007) [2023-12-28 04:37:58,601][106226] Updated weights for policy 0, policy_version 1304291 (0.0008) [2023-12-28 04:37:58,639][106225] Updated weights for policy 1, policy_version 1307658 (0.0009) [2023-12-28 04:37:58,672][106226] Updated weights for policy 0, policy_version 1304301 (0.0009) [2023-12-28 04:37:58,717][106225] Updated weights for policy 1, policy_version 1307668 (0.0008) [2023-12-28 04:37:58,735][106226] Updated weights for policy 0, policy_version 1304311 (0.0008) [2023-12-28 04:37:59,408][106225] Updated weights for policy 1, policy_version 1307678 (0.0009) [2023-12-28 04:37:59,458][106225] Updated weights for policy 1, policy_version 1307688 (0.0010) [2023-12-28 04:37:59,512][106225] Updated weights for policy 1, policy_version 1307698 (0.0010) [2023-12-28 04:37:59,550][106226] Updated weights for policy 0, policy_version 1304321 (0.0007) [2023-12-28 04:37:59,595][106226] Updated weights for policy 0, policy_version 1304331 (0.0007) [2023-12-28 04:37:59,656][106226] Updated weights for policy 0, policy_version 1304341 (0.0008) [2023-12-28 04:38:00,300][106225] Updated weights for policy 1, policy_version 1307708 (0.0010) [2023-12-28 04:38:00,321][106226] Updated weights for policy 0, policy_version 1304351 (0.0007) [2023-12-28 04:38:00,352][106225] Updated weights for policy 1, policy_version 1307718 (0.0010) [2023-12-28 04:38:00,374][106226] Updated weights for policy 0, policy_version 1304361 (0.0008) [2023-12-28 04:38:00,406][106225] Updated weights for policy 1, policy_version 1307728 (0.0010) [2023-12-28 04:38:00,431][106226] Updated weights for policy 0, policy_version 1304371 (0.0005) [2023-12-28 04:38:01,082][106226] Updated weights for policy 0, policy_version 1304381 (0.0006) [2023-12-28 04:38:01,113][106225] Updated weights for policy 1, policy_version 1307738 (0.0010) [2023-12-28 04:38:01,148][106226] Updated weights for policy 0, policy_version 1304391 (0.0007) [2023-12-28 04:38:01,174][106225] Updated weights for policy 1, policy_version 1307748 (0.0008) [2023-12-28 04:38:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 668811264. Throughput: 0: 9955.7, 1: 10265.5. Samples: 668806980. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:01,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-5.002')] [2023-12-28 04:38:01,199][106226] Updated weights for policy 0, policy_version 1304401 (0.0008) [2023-12-28 04:38:01,226][106225] Updated weights for policy 1, policy_version 1307758 (0.0007) [2023-12-28 04:38:01,284][106225] Updated weights for policy 1, policy_version 1307768 (0.0007) [2023-12-28 04:38:01,911][106226] Updated weights for policy 0, policy_version 1304411 (0.0009) [2023-12-28 04:38:01,957][106226] Updated weights for policy 0, policy_version 1304421 (0.0008) [2023-12-28 04:38:02,020][106226] Updated weights for policy 0, policy_version 1304431 (0.0006) [2023-12-28 04:38:02,031][106225] Updated weights for policy 1, policy_version 1307778 (0.0006) [2023-12-28 04:38:02,096][106225] Updated weights for policy 1, policy_version 1307788 (0.0005) [2023-12-28 04:38:02,161][106225] Updated weights for policy 1, policy_version 1307798 (0.0006) [2023-12-28 04:38:02,667][106226] Updated weights for policy 0, policy_version 1304441 (0.0007) [2023-12-28 04:38:02,707][106225] Updated weights for policy 1, policy_version 1307808 (0.0007) [2023-12-28 04:38:02,730][106226] Updated weights for policy 0, policy_version 1304451 (0.0008) [2023-12-28 04:38:02,771][106225] Updated weights for policy 1, policy_version 1307818 (0.0008) [2023-12-28 04:38:02,787][106226] Updated weights for policy 0, policy_version 1304461 (0.0011) [2023-12-28 04:38:02,828][106225] Updated weights for policy 1, policy_version 1307828 (0.0010) [2023-12-28 04:38:02,863][106226] Updated weights for policy 0, policy_version 1304471 (0.0010) [2023-12-28 04:38:03,450][106225] Updated weights for policy 1, policy_version 1307838 (0.0007) [2023-12-28 04:38:03,501][106225] Updated weights for policy 1, policy_version 1307848 (0.0005) [2023-12-28 04:38:03,515][106226] Updated weights for policy 0, policy_version 1304481 (0.0008) [2023-12-28 04:38:03,555][106225] Updated weights for policy 1, policy_version 1307858 (0.0006) [2023-12-28 04:38:03,576][106226] Updated weights for policy 0, policy_version 1304491 (0.0006) [2023-12-28 04:38:03,628][106226] Updated weights for policy 0, policy_version 1304501 (0.0009) [2023-12-28 04:38:04,258][106225] Updated weights for policy 1, policy_version 1307868 (0.0007) [2023-12-28 04:38:04,264][106226] Updated weights for policy 0, policy_version 1304511 (0.0007) [2023-12-28 04:38:04,328][106225] Updated weights for policy 1, policy_version 1307878 (0.0007) [2023-12-28 04:38:04,329][106226] Updated weights for policy 0, policy_version 1304521 (0.0006) [2023-12-28 04:38:04,386][106225] Updated weights for policy 1, policy_version 1307888 (0.0006) [2023-12-28 04:38:04,395][106226] Updated weights for policy 0, policy_version 1304531 (0.0006) [2023-12-28 04:38:04,974][106226] Updated weights for policy 0, policy_version 1304541 (0.0009) [2023-12-28 04:38:05,009][106225] Updated weights for policy 1, policy_version 1307898 (0.0006) [2023-12-28 04:38:05,041][106226] Updated weights for policy 0, policy_version 1304551 (0.0009) [2023-12-28 04:38:05,065][106225] Updated weights for policy 1, policy_version 1307908 (0.0005) [2023-12-28 04:38:05,104][106226] Updated weights for policy 0, policy_version 1304561 (0.0008) [2023-12-28 04:38:05,123][106225] Updated weights for policy 1, policy_version 1307918 (0.0005) [2023-12-28 04:38:05,177][106225] Updated weights for policy 1, policy_version 1307928 (0.0005) [2023-12-28 04:38:05,807][106225] Updated weights for policy 1, policy_version 1307938 (0.0008) [2023-12-28 04:38:05,808][106226] Updated weights for policy 0, policy_version 1304571 (0.0009) [2023-12-28 04:38:05,867][106226] Updated weights for policy 0, policy_version 1304581 (0.0008) [2023-12-28 04:38:05,870][106225] Updated weights for policy 1, policy_version 1307948 (0.0007) [2023-12-28 04:38:05,927][106225] Updated weights for policy 1, policy_version 1307958 (0.0006) [2023-12-28 04:38:05,927][106226] Updated weights for policy 0, policy_version 1304591 (0.0008) [2023-12-28 04:38:06,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20343.4, 300 sec: 19883.0). Total num frames: 668925952. Throughput: 0: 10103.3, 1: 10266.9. Samples: 668930744. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:06,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.958')] [2023-12-28 04:38:06,616][106226] Updated weights for policy 0, policy_version 1304601 (0.0008) [2023-12-28 04:38:06,677][106226] Updated weights for policy 0, policy_version 1304611 (0.0007) [2023-12-28 04:38:06,686][106225] Updated weights for policy 1, policy_version 1307968 (0.0007) [2023-12-28 04:38:06,732][106226] Updated weights for policy 0, policy_version 1304621 (0.0006) [2023-12-28 04:38:06,743][106225] Updated weights for policy 1, policy_version 1307978 (0.0008) [2023-12-28 04:38:06,786][106226] Updated weights for policy 0, policy_version 1304631 (0.0006) [2023-12-28 04:38:06,792][106225] Updated weights for policy 1, policy_version 1307988 (0.0007) [2023-12-28 04:38:07,490][106226] Updated weights for policy 0, policy_version 1304641 (0.0007) [2023-12-28 04:38:07,509][106225] Updated weights for policy 1, policy_version 1307998 (0.0010) [2023-12-28 04:38:07,552][106226] Updated weights for policy 0, policy_version 1304651 (0.0008) [2023-12-28 04:38:07,575][106225] Updated weights for policy 1, policy_version 1308008 (0.0005) [2023-12-28 04:38:07,609][106226] Updated weights for policy 0, policy_version 1304661 (0.0008) [2023-12-28 04:38:07,643][106225] Updated weights for policy 1, policy_version 1308018 (0.0009) [2023-12-28 04:38:08,203][106225] Updated weights for policy 1, policy_version 1308028 (0.0008) [2023-12-28 04:38:08,263][106225] Updated weights for policy 1, policy_version 1308038 (0.0007) [2023-12-28 04:38:08,313][106226] Updated weights for policy 0, policy_version 1304671 (0.0010) [2023-12-28 04:38:08,341][106225] Updated weights for policy 1, policy_version 1308048 (0.0008) [2023-12-28 04:38:08,381][106226] Updated weights for policy 0, policy_version 1304681 (0.0008) [2023-12-28 04:38:08,441][106226] Updated weights for policy 0, policy_version 1304691 (0.0009) [2023-12-28 04:38:09,051][106226] Updated weights for policy 0, policy_version 1304701 (0.0007) [2023-12-28 04:38:09,064][106225] Updated weights for policy 1, policy_version 1308058 (0.0007) [2023-12-28 04:38:09,106][106226] Updated weights for policy 0, policy_version 1304711 (0.0006) [2023-12-28 04:38:09,123][106225] Updated weights for policy 1, policy_version 1308068 (0.0007) [2023-12-28 04:38:09,164][106226] Updated weights for policy 0, policy_version 1304721 (0.0009) [2023-12-28 04:38:09,178][106225] Updated weights for policy 1, policy_version 1308078 (0.0006) [2023-12-28 04:38:09,236][106225] Updated weights for policy 1, policy_version 1308088 (0.0007) [2023-12-28 04:38:09,919][106226] Updated weights for policy 0, policy_version 1304731 (0.0008) [2023-12-28 04:38:09,985][106226] Updated weights for policy 0, policy_version 1304741 (0.0010) [2023-12-28 04:38:09,996][106225] Updated weights for policy 1, policy_version 1308098 (0.0010) [2023-12-28 04:38:10,052][106226] Updated weights for policy 0, policy_version 1304751 (0.0009) [2023-12-28 04:38:10,056][106225] Updated weights for policy 1, policy_version 1308108 (0.0010) [2023-12-28 04:38:10,118][106225] Updated weights for policy 1, policy_version 1308118 (0.0010) [2023-12-28 04:38:10,722][106226] Updated weights for policy 0, policy_version 1304761 (0.0008) [2023-12-28 04:38:10,785][106226] Updated weights for policy 0, policy_version 1304771 (0.0005) [2023-12-28 04:38:10,841][106225] Updated weights for policy 1, policy_version 1308128 (0.0010) [2023-12-28 04:38:10,841][106226] Updated weights for policy 0, policy_version 1304781 (0.0005) [2023-12-28 04:38:10,896][106225] Updated weights for policy 1, policy_version 1308138 (0.0010) [2023-12-28 04:38:10,899][106226] Updated weights for policy 0, policy_version 1304791 (0.0010) [2023-12-28 04:38:10,950][106225] Updated weights for policy 1, policy_version 1308148 (0.0010) [2023-12-28 04:38:11,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 669024256. Throughput: 0: 10107.7, 1: 10328.2. Samples: 668991628. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:11,175][105115] Avg episode reward: [(0, '-4.302'), (1, '-5.201')] [2023-12-28 04:38:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001308152_334938112.pth... [2023-12-28 04:38:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001304792_334086144.pth... [2023-12-28 04:38:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001306968_334635008.pth [2023-12-28 04:38:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001303608_333783040.pth [2023-12-28 04:38:11,682][106226] Updated weights for policy 0, policy_version 1304801 (0.0010) [2023-12-28 04:38:11,688][106225] Updated weights for policy 1, policy_version 1308158 (0.0011) [2023-12-28 04:38:11,743][106226] Updated weights for policy 0, policy_version 1304811 (0.0011) [2023-12-28 04:38:11,752][106225] Updated weights for policy 1, policy_version 1308168 (0.0009) [2023-12-28 04:38:11,810][106226] Updated weights for policy 0, policy_version 1304821 (0.0008) [2023-12-28 04:38:11,815][106225] Updated weights for policy 1, policy_version 1308178 (0.0008) [2023-12-28 04:38:12,544][106226] Updated weights for policy 0, policy_version 1304831 (0.0010) [2023-12-28 04:38:12,599][106226] Updated weights for policy 0, policy_version 1304841 (0.0010) [2023-12-28 04:38:12,631][106225] Updated weights for policy 1, policy_version 1308188 (0.0009) [2023-12-28 04:38:12,655][106226] Updated weights for policy 0, policy_version 1304851 (0.0011) [2023-12-28 04:38:12,693][106225] Updated weights for policy 1, policy_version 1308198 (0.0008) [2023-12-28 04:38:12,759][106225] Updated weights for policy 1, policy_version 1308208 (0.0008) [2023-12-28 04:38:13,314][106226] Updated weights for policy 0, policy_version 1304861 (0.0009) [2023-12-28 04:38:13,360][106226] Updated weights for policy 0, policy_version 1304871 (0.0010) [2023-12-28 04:38:13,406][106226] Updated weights for policy 0, policy_version 1304881 (0.0010) [2023-12-28 04:38:13,543][106225] Updated weights for policy 1, policy_version 1308218 (0.0009) [2023-12-28 04:38:13,596][106225] Updated weights for policy 1, policy_version 1308228 (0.0007) [2023-12-28 04:38:13,650][106225] Updated weights for policy 1, policy_version 1308238 (0.0008) [2023-12-28 04:38:13,701][106225] Updated weights for policy 1, policy_version 1308248 (0.0007) [2023-12-28 04:38:14,154][106226] Updated weights for policy 0, policy_version 1304891 (0.0010) [2023-12-28 04:38:14,212][106226] Updated weights for policy 0, policy_version 1304901 (0.0011) [2023-12-28 04:38:14,261][106226] Updated weights for policy 0, policy_version 1304911 (0.0011) [2023-12-28 04:38:14,438][106225] Updated weights for policy 1, policy_version 1308258 (0.0008) [2023-12-28 04:38:14,498][106225] Updated weights for policy 1, policy_version 1308268 (0.0007) [2023-12-28 04:38:14,559][106225] Updated weights for policy 1, policy_version 1308278 (0.0008) [2023-12-28 04:38:15,013][106226] Updated weights for policy 0, policy_version 1304921 (0.0011) [2023-12-28 04:38:15,077][106226] Updated weights for policy 0, policy_version 1304931 (0.0011) [2023-12-28 04:38:15,138][106226] Updated weights for policy 0, policy_version 1304941 (0.0011) [2023-12-28 04:38:15,196][106226] Updated weights for policy 0, policy_version 1304951 (0.0011) [2023-12-28 04:38:15,349][106225] Updated weights for policy 1, policy_version 1308288 (0.0008) [2023-12-28 04:38:15,398][106225] Updated weights for policy 1, policy_version 1308298 (0.0007) [2023-12-28 04:38:15,449][106225] Updated weights for policy 1, policy_version 1308308 (0.0007) [2023-12-28 04:38:15,864][106226] Updated weights for policy 0, policy_version 1304961 (0.0009) [2023-12-28 04:38:15,929][106226] Updated weights for policy 0, policy_version 1304971 (0.0006) [2023-12-28 04:38:15,990][106226] Updated weights for policy 0, policy_version 1304981 (0.0005) [2023-12-28 04:38:16,109][106225] Updated weights for policy 1, policy_version 1308318 (0.0008) [2023-12-28 04:38:16,165][106225] Updated weights for policy 1, policy_version 1308328 (0.0010) [2023-12-28 04:38:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 669114368. Throughput: 0: 10032.3, 1: 10040.5. Samples: 669104596. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:16,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-5.180')] [2023-12-28 04:38:16,212][106225] Updated weights for policy 1, policy_version 1308338 (0.0010) [2023-12-28 04:38:16,580][106226] Updated weights for policy 0, policy_version 1304991 (0.0009) [2023-12-28 04:38:16,629][106226] Updated weights for policy 0, policy_version 1305001 (0.0010) [2023-12-28 04:38:16,682][106226] Updated weights for policy 0, policy_version 1305011 (0.0010) [2023-12-28 04:38:16,930][106225] Updated weights for policy 1, policy_version 1308348 (0.0010) [2023-12-28 04:38:16,993][106225] Updated weights for policy 1, policy_version 1308358 (0.0009) [2023-12-28 04:38:17,047][106225] Updated weights for policy 1, policy_version 1308368 (0.0010) [2023-12-28 04:38:17,401][106226] Updated weights for policy 0, policy_version 1305021 (0.0010) [2023-12-28 04:38:17,460][106226] Updated weights for policy 0, policy_version 1305031 (0.0010) [2023-12-28 04:38:17,519][106226] Updated weights for policy 0, policy_version 1305041 (0.0010) [2023-12-28 04:38:17,630][106225] Updated weights for policy 1, policy_version 1308378 (0.0009) [2023-12-28 04:38:17,694][106225] Updated weights for policy 1, policy_version 1308388 (0.0005) [2023-12-28 04:38:17,757][106225] Updated weights for policy 1, policy_version 1308398 (0.0005) [2023-12-28 04:38:17,817][106225] Updated weights for policy 1, policy_version 1308408 (0.0007) [2023-12-28 04:38:18,238][106226] Updated weights for policy 0, policy_version 1305051 (0.0011) [2023-12-28 04:38:18,299][106226] Updated weights for policy 0, policy_version 1305061 (0.0009) [2023-12-28 04:38:18,370][106226] Updated weights for policy 0, policy_version 1305071 (0.0010) [2023-12-28 04:38:18,427][106225] Updated weights for policy 1, policy_version 1308418 (0.0010) [2023-12-28 04:38:18,496][106225] Updated weights for policy 1, policy_version 1308428 (0.0011) [2023-12-28 04:38:18,563][106225] Updated weights for policy 1, policy_version 1308438 (0.0010) [2023-12-28 04:38:18,946][106226] Updated weights for policy 0, policy_version 1305081 (0.0007) [2023-12-28 04:38:19,009][106226] Updated weights for policy 0, policy_version 1305091 (0.0006) [2023-12-28 04:38:19,069][106226] Updated weights for policy 0, policy_version 1305101 (0.0005) [2023-12-28 04:38:19,132][106226] Updated weights for policy 0, policy_version 1305111 (0.0005) [2023-12-28 04:38:19,285][106225] Updated weights for policy 1, policy_version 1308448 (0.0010) [2023-12-28 04:38:19,353][106225] Updated weights for policy 1, policy_version 1308458 (0.0010) [2023-12-28 04:38:19,416][106225] Updated weights for policy 1, policy_version 1308468 (0.0009) [2023-12-28 04:38:19,749][106226] Updated weights for policy 0, policy_version 1305121 (0.0006) [2023-12-28 04:38:19,817][106226] Updated weights for policy 0, policy_version 1305131 (0.0008) [2023-12-28 04:38:19,893][106226] Updated weights for policy 0, policy_version 1305141 (0.0006) [2023-12-28 04:38:20,241][106225] Updated weights for policy 1, policy_version 1308478 (0.0009) [2023-12-28 04:38:20,304][106225] Updated weights for policy 1, policy_version 1308488 (0.0010) [2023-12-28 04:38:20,361][106225] Updated weights for policy 1, policy_version 1308498 (0.0009) [2023-12-28 04:38:20,555][106226] Updated weights for policy 0, policy_version 1305151 (0.0008) [2023-12-28 04:38:20,620][106226] Updated weights for policy 0, policy_version 1305161 (0.0009) [2023-12-28 04:38:20,681][106226] Updated weights for policy 0, policy_version 1305171 (0.0009) [2023-12-28 04:38:21,135][106225] Updated weights for policy 1, policy_version 1308508 (0.0009) [2023-12-28 04:38:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 669212672. Throughput: 0: 10034.4, 1: 10041.0. Samples: 669225716. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:21,175][105115] Avg episode reward: [(0, '-4.007'), (1, '-5.232')] [2023-12-28 04:38:21,199][106225] Updated weights for policy 1, policy_version 1308518 (0.0009) [2023-12-28 04:38:21,258][106225] Updated weights for policy 1, policy_version 1308528 (0.0008) [2023-12-28 04:38:21,424][106226] Updated weights for policy 0, policy_version 1305181 (0.0008) [2023-12-28 04:38:21,487][106226] Updated weights for policy 0, policy_version 1305191 (0.0009) [2023-12-28 04:38:21,540][106226] Updated weights for policy 0, policy_version 1305201 (0.0008) [2023-12-28 04:38:21,982][106225] Updated weights for policy 1, policy_version 1308538 (0.0008) [2023-12-28 04:38:22,031][106225] Updated weights for policy 1, policy_version 1308548 (0.0008) [2023-12-28 04:38:22,087][106225] Updated weights for policy 1, policy_version 1308558 (0.0009) [2023-12-28 04:38:22,146][106225] Updated weights for policy 1, policy_version 1308568 (0.0009) [2023-12-28 04:38:22,287][106226] Updated weights for policy 0, policy_version 1305211 (0.0007) [2023-12-28 04:38:22,356][106226] Updated weights for policy 0, policy_version 1305221 (0.0008) [2023-12-28 04:38:22,416][106226] Updated weights for policy 0, policy_version 1305231 (0.0008) [2023-12-28 04:38:22,836][106225] Updated weights for policy 1, policy_version 1308578 (0.0006) [2023-12-28 04:38:22,902][106225] Updated weights for policy 1, policy_version 1308588 (0.0006) [2023-12-28 04:38:22,954][106225] Updated weights for policy 1, policy_version 1308598 (0.0008) [2023-12-28 04:38:23,192][106226] Updated weights for policy 0, policy_version 1305241 (0.0008) [2023-12-28 04:38:23,246][106226] Updated weights for policy 0, policy_version 1305251 (0.0006) [2023-12-28 04:38:23,302][106226] Updated weights for policy 0, policy_version 1305261 (0.0005) [2023-12-28 04:38:23,359][106226] Updated weights for policy 0, policy_version 1305271 (0.0007) [2023-12-28 04:38:23,601][106225] Updated weights for policy 1, policy_version 1308608 (0.0008) [2023-12-28 04:38:23,652][106225] Updated weights for policy 1, policy_version 1308618 (0.0008) [2023-12-28 04:38:23,697][106225] Updated weights for policy 1, policy_version 1308628 (0.0008) [2023-12-28 04:38:24,032][106226] Updated weights for policy 0, policy_version 1305281 (0.0008) [2023-12-28 04:38:24,097][106226] Updated weights for policy 0, policy_version 1305291 (0.0009) [2023-12-28 04:38:24,156][106226] Updated weights for policy 0, policy_version 1305301 (0.0005) [2023-12-28 04:38:24,410][106225] Updated weights for policy 1, policy_version 1308638 (0.0007) [2023-12-28 04:38:24,471][106225] Updated weights for policy 1, policy_version 1308648 (0.0006) [2023-12-28 04:38:24,536][106225] Updated weights for policy 1, policy_version 1308658 (0.0007) [2023-12-28 04:38:24,894][106226] Updated weights for policy 0, policy_version 1305311 (0.0008) [2023-12-28 04:38:24,950][106226] Updated weights for policy 0, policy_version 1305321 (0.0008) [2023-12-28 04:38:25,006][106226] Updated weights for policy 0, policy_version 1305331 (0.0009) [2023-12-28 04:38:25,188][106225] Updated weights for policy 1, policy_version 1308668 (0.0008) [2023-12-28 04:38:25,250][106225] Updated weights for policy 1, policy_version 1308678 (0.0008) [2023-12-28 04:38:25,315][106225] Updated weights for policy 1, policy_version 1308688 (0.0008) [2023-12-28 04:38:25,723][106226] Updated weights for policy 0, policy_version 1305341 (0.0008) [2023-12-28 04:38:25,774][106226] Updated weights for policy 0, policy_version 1305351 (0.0008) [2023-12-28 04:38:25,826][106226] Updated weights for policy 0, policy_version 1305361 (0.0008) [2023-12-28 04:38:26,043][106225] Updated weights for policy 1, policy_version 1308698 (0.0008) [2023-12-28 04:38:26,105][106225] Updated weights for policy 1, policy_version 1308708 (0.0009) [2023-12-28 04:38:26,165][106225] Updated weights for policy 1, policy_version 1308718 (0.0009) [2023-12-28 04:38:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 669310976. Throughput: 0: 10036.3, 1: 10001.8. Samples: 669283000. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:26,176][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.974')] [2023-12-28 04:38:26,188][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001305368_334233600.pth... [2023-12-28 04:38:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001304184_333930496.pth [2023-12-28 04:38:26,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001308728_335085568.pth... [2023-12-28 04:38:26,231][106225] Updated weights for policy 1, policy_version 1308728 (0.0008) [2023-12-28 04:38:26,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001307576_334790656.pth [2023-12-28 04:38:26,499][106226] Updated weights for policy 0, policy_version 1305371 (0.0008) [2023-12-28 04:38:26,561][106226] Updated weights for policy 0, policy_version 1305381 (0.0009) [2023-12-28 04:38:26,622][106226] Updated weights for policy 0, policy_version 1305391 (0.0009) [2023-12-28 04:38:26,950][106225] Updated weights for policy 1, policy_version 1308738 (0.0008) [2023-12-28 04:38:26,995][106225] Updated weights for policy 1, policy_version 1308748 (0.0007) [2023-12-28 04:38:27,055][106225] Updated weights for policy 1, policy_version 1308758 (0.0008) [2023-12-28 04:38:27,333][106226] Updated weights for policy 0, policy_version 1305401 (0.0008) [2023-12-28 04:38:27,388][106226] Updated weights for policy 0, policy_version 1305411 (0.0009) [2023-12-28 04:38:27,440][106226] Updated weights for policy 0, policy_version 1305421 (0.0009) [2023-12-28 04:38:27,492][106226] Updated weights for policy 0, policy_version 1305431 (0.0009) [2023-12-28 04:38:27,774][106225] Updated weights for policy 1, policy_version 1308768 (0.0008) [2023-12-28 04:38:27,835][106225] Updated weights for policy 1, policy_version 1308778 (0.0008) [2023-12-28 04:38:27,893][106225] Updated weights for policy 1, policy_version 1308788 (0.0006) [2023-12-28 04:38:28,246][106226] Updated weights for policy 0, policy_version 1305441 (0.0008) [2023-12-28 04:38:28,296][106226] Updated weights for policy 0, policy_version 1305451 (0.0008) [2023-12-28 04:38:28,352][106226] Updated weights for policy 0, policy_version 1305461 (0.0008) [2023-12-28 04:38:28,591][106225] Updated weights for policy 1, policy_version 1308798 (0.0008) [2023-12-28 04:38:28,650][106225] Updated weights for policy 1, policy_version 1308808 (0.0008) [2023-12-28 04:38:28,699][106225] Updated weights for policy 1, policy_version 1308818 (0.0009) [2023-12-28 04:38:29,078][106226] Updated weights for policy 0, policy_version 1305471 (0.0008) [2023-12-28 04:38:29,139][106226] Updated weights for policy 0, policy_version 1305481 (0.0009) [2023-12-28 04:38:29,197][106226] Updated weights for policy 0, policy_version 1305491 (0.0006) [2023-12-28 04:38:29,438][106225] Updated weights for policy 1, policy_version 1308828 (0.0007) [2023-12-28 04:38:29,499][106225] Updated weights for policy 1, policy_version 1308838 (0.0005) [2023-12-28 04:38:29,555][106225] Updated weights for policy 1, policy_version 1308848 (0.0006) [2023-12-28 04:38:30,007][106226] Updated weights for policy 0, policy_version 1305501 (0.0009) [2023-12-28 04:38:30,060][106226] Updated weights for policy 0, policy_version 1305511 (0.0009) [2023-12-28 04:38:30,111][106226] Updated weights for policy 0, policy_version 1305521 (0.0008) [2023-12-28 04:38:30,137][106225] Updated weights for policy 1, policy_version 1308858 (0.0006) [2023-12-28 04:38:30,186][106225] Updated weights for policy 1, policy_version 1308868 (0.0009) [2023-12-28 04:38:30,236][106225] Updated weights for policy 1, policy_version 1308878 (0.0008) [2023-12-28 04:38:30,298][106225] Updated weights for policy 1, policy_version 1308888 (0.0009) [2023-12-28 04:38:30,793][106226] Updated weights for policy 0, policy_version 1305531 (0.0007) [2023-12-28 04:38:30,840][106226] Updated weights for policy 0, policy_version 1305541 (0.0008) [2023-12-28 04:38:30,887][106226] Updated weights for policy 0, policy_version 1305551 (0.0008) [2023-12-28 04:38:31,003][106225] Updated weights for policy 1, policy_version 1308898 (0.0008) [2023-12-28 04:38:31,069][106225] Updated weights for policy 1, policy_version 1308908 (0.0008) [2023-12-28 04:38:31,118][106225] Updated weights for policy 1, policy_version 1308918 (0.0009) [2023-12-28 04:38:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 669417472. Throughput: 0: 10007.1, 1: 9993.1. Samples: 669400280. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:31,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-5.170')] [2023-12-28 04:38:31,663][106226] Updated weights for policy 0, policy_version 1305561 (0.0008) [2023-12-28 04:38:31,724][106226] Updated weights for policy 0, policy_version 1305571 (0.0007) [2023-12-28 04:38:31,786][106226] Updated weights for policy 0, policy_version 1305581 (0.0006) [2023-12-28 04:38:31,850][106226] Updated weights for policy 0, policy_version 1305591 (0.0007) [2023-12-28 04:38:31,911][106225] Updated weights for policy 1, policy_version 1308928 (0.0008) [2023-12-28 04:38:31,976][106225] Updated weights for policy 1, policy_version 1308938 (0.0008) [2023-12-28 04:38:32,038][106225] Updated weights for policy 1, policy_version 1308948 (0.0008) [2023-12-28 04:38:32,427][106226] Updated weights for policy 0, policy_version 1305601 (0.0006) [2023-12-28 04:38:32,490][106226] Updated weights for policy 0, policy_version 1305611 (0.0009) [2023-12-28 04:38:32,547][106226] Updated weights for policy 0, policy_version 1305621 (0.0008) [2023-12-28 04:38:32,855][106225] Updated weights for policy 1, policy_version 1308958 (0.0008) [2023-12-28 04:38:32,921][106225] Updated weights for policy 1, policy_version 1308968 (0.0009) [2023-12-28 04:38:32,978][106225] Updated weights for policy 1, policy_version 1308978 (0.0007) [2023-12-28 04:38:33,151][106226] Updated weights for policy 0, policy_version 1305631 (0.0006) [2023-12-28 04:38:33,204][106226] Updated weights for policy 0, policy_version 1305641 (0.0006) [2023-12-28 04:38:33,264][106226] Updated weights for policy 0, policy_version 1305651 (0.0005) [2023-12-28 04:38:33,755][106226] Updated weights for policy 0, policy_version 1305661 (0.0005) [2023-12-28 04:38:33,811][106226] Updated weights for policy 0, policy_version 1305671 (0.0006) [2023-12-28 04:38:33,827][106225] Updated weights for policy 1, policy_version 1308988 (0.0009) [2023-12-28 04:38:33,868][106226] Updated weights for policy 0, policy_version 1305681 (0.0005) [2023-12-28 04:38:33,883][106225] Updated weights for policy 1, policy_version 1308998 (0.0008) [2023-12-28 04:38:33,939][106225] Updated weights for policy 1, policy_version 1309008 (0.0009) [2023-12-28 04:38:34,451][106226] Updated weights for policy 0, policy_version 1305691 (0.0007) [2023-12-28 04:38:34,513][106226] Updated weights for policy 0, policy_version 1305701 (0.0010) [2023-12-28 04:38:34,575][106226] Updated weights for policy 0, policy_version 1305711 (0.0010) [2023-12-28 04:38:34,749][106225] Updated weights for policy 1, policy_version 1309019 (0.0008) [2023-12-28 04:38:34,804][106225] Updated weights for policy 1, policy_version 1309029 (0.0008) [2023-12-28 04:38:34,863][106225] Updated weights for policy 1, policy_version 1309039 (0.0008) [2023-12-28 04:38:35,294][106226] Updated weights for policy 0, policy_version 1305721 (0.0010) [2023-12-28 04:38:35,350][106226] Updated weights for policy 0, policy_version 1305731 (0.0006) [2023-12-28 04:38:35,409][106226] Updated weights for policy 0, policy_version 1305741 (0.0005) [2023-12-28 04:38:35,471][106226] Updated weights for policy 0, policy_version 1305751 (0.0006) [2023-12-28 04:38:35,527][106225] Updated weights for policy 1, policy_version 1309049 (0.0007) [2023-12-28 04:38:35,590][106225] Updated weights for policy 1, policy_version 1309059 (0.0010) [2023-12-28 04:38:35,647][106225] Updated weights for policy 1, policy_version 1309069 (0.0009) [2023-12-28 04:38:35,705][106225] Updated weights for policy 1, policy_version 1309079 (0.0009) [2023-12-28 04:38:36,004][106226] Updated weights for policy 0, policy_version 1305761 (0.0006) [2023-12-28 04:38:36,058][106226] Updated weights for policy 0, policy_version 1305771 (0.0005) [2023-12-28 04:38:36,122][106226] Updated weights for policy 0, policy_version 1305781 (0.0007) [2023-12-28 04:38:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 669515776. Throughput: 0: 10131.6, 1: 9821.2. Samples: 669521392. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:36,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-5.068')] [2023-12-28 04:38:36,550][106225] Updated weights for policy 1, policy_version 1309089 (0.0007) [2023-12-28 04:38:36,613][106225] Updated weights for policy 1, policy_version 1309099 (0.0006) [2023-12-28 04:38:36,676][106225] Updated weights for policy 1, policy_version 1309109 (0.0006) [2023-12-28 04:38:36,790][106226] Updated weights for policy 0, policy_version 1305791 (0.0008) [2023-12-28 04:38:36,843][106226] Updated weights for policy 0, policy_version 1305801 (0.0009) [2023-12-28 04:38:36,899][106226] Updated weights for policy 0, policy_version 1305811 (0.0006) [2023-12-28 04:38:37,269][106225] Updated weights for policy 1, policy_version 1309119 (0.0010) [2023-12-28 04:38:37,331][106225] Updated weights for policy 1, policy_version 1309129 (0.0008) [2023-12-28 04:38:37,394][106225] Updated weights for policy 1, policy_version 1309139 (0.0010) [2023-12-28 04:38:37,634][106226] Updated weights for policy 0, policy_version 1305821 (0.0008) [2023-12-28 04:38:37,689][106226] Updated weights for policy 0, policy_version 1305831 (0.0009) [2023-12-28 04:38:37,736][106226] Updated weights for policy 0, policy_version 1305841 (0.0007) [2023-12-28 04:38:38,038][106225] Updated weights for policy 1, policy_version 1309149 (0.0010) [2023-12-28 04:38:38,101][106225] Updated weights for policy 1, policy_version 1309159 (0.0010) [2023-12-28 04:38:38,147][106225] Updated weights for policy 1, policy_version 1309169 (0.0010) [2023-12-28 04:38:38,489][106226] Updated weights for policy 0, policy_version 1305851 (0.0007) [2023-12-28 04:38:38,552][106226] Updated weights for policy 0, policy_version 1305861 (0.0006) [2023-12-28 04:38:38,620][106226] Updated weights for policy 0, policy_version 1305871 (0.0007) [2023-12-28 04:38:38,881][106225] Updated weights for policy 1, policy_version 1309179 (0.0010) [2023-12-28 04:38:38,938][106225] Updated weights for policy 1, policy_version 1309189 (0.0010) [2023-12-28 04:38:38,984][106225] Updated weights for policy 1, policy_version 1309199 (0.0010) [2023-12-28 04:38:39,276][106226] Updated weights for policy 0, policy_version 1305881 (0.0005) [2023-12-28 04:38:39,342][106226] Updated weights for policy 0, policy_version 1305891 (0.0009) [2023-12-28 04:38:39,412][106226] Updated weights for policy 0, policy_version 1305901 (0.0009) [2023-12-28 04:38:39,481][106226] Updated weights for policy 0, policy_version 1305911 (0.0008) [2023-12-28 04:38:39,761][106225] Updated weights for policy 1, policy_version 1309209 (0.0010) [2023-12-28 04:38:39,832][106225] Updated weights for policy 1, policy_version 1309219 (0.0007) [2023-12-28 04:38:39,896][106225] Updated weights for policy 1, policy_version 1309229 (0.0009) [2023-12-28 04:38:39,964][106225] Updated weights for policy 1, policy_version 1309239 (0.0008) [2023-12-28 04:38:40,163][106226] Updated weights for policy 0, policy_version 1305921 (0.0008) [2023-12-28 04:38:40,226][106226] Updated weights for policy 0, policy_version 1305931 (0.0008) [2023-12-28 04:38:40,289][106226] Updated weights for policy 0, policy_version 1305941 (0.0008) [2023-12-28 04:38:40,689][106225] Updated weights for policy 1, policy_version 1309249 (0.0009) [2023-12-28 04:38:40,744][106225] Updated weights for policy 1, policy_version 1309259 (0.0006) [2023-12-28 04:38:40,794][106225] Updated weights for policy 1, policy_version 1309269 (0.0006) [2023-12-28 04:38:40,933][106226] Updated weights for policy 0, policy_version 1305951 (0.0010) [2023-12-28 04:38:40,983][106226] Updated weights for policy 0, policy_version 1305961 (0.0010) [2023-12-28 04:38:41,041][106226] Updated weights for policy 0, policy_version 1305971 (0.0010) [2023-12-28 04:38:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19934.4, 300 sec: 19883.0). Total num frames: 669614080. Throughput: 0: 10121.0, 1: 9822.7. Samples: 669581032. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:41,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.901')] [2023-12-28 04:38:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001309272_335224832.pth... [2023-12-28 04:38:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001305976_334389248.pth... [2023-12-28 04:38:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001304792_334086144.pth [2023-12-28 04:38:41,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001308152_334938112.pth [2023-12-28 04:38:41,546][106225] Updated weights for policy 1, policy_version 1309279 (0.0008) [2023-12-28 04:38:41,600][106225] Updated weights for policy 1, policy_version 1309289 (0.0008) [2023-12-28 04:38:41,669][106225] Updated weights for policy 1, policy_version 1309299 (0.0008) [2023-12-28 04:38:41,802][106226] Updated weights for policy 0, policy_version 1305981 (0.0007) [2023-12-28 04:38:41,864][106226] Updated weights for policy 0, policy_version 1305991 (0.0006) [2023-12-28 04:38:41,925][106226] Updated weights for policy 0, policy_version 1306001 (0.0007) [2023-12-28 04:38:42,376][106225] Updated weights for policy 1, policy_version 1309309 (0.0008) [2023-12-28 04:38:42,442][106225] Updated weights for policy 1, policy_version 1309319 (0.0010) [2023-12-28 04:38:42,501][106225] Updated weights for policy 1, policy_version 1309329 (0.0011) [2023-12-28 04:38:42,646][106226] Updated weights for policy 0, policy_version 1306011 (0.0006) [2023-12-28 04:38:42,708][106226] Updated weights for policy 0, policy_version 1306021 (0.0009) [2023-12-28 04:38:42,764][106226] Updated weights for policy 0, policy_version 1306031 (0.0006) [2023-12-28 04:38:43,216][106225] Updated weights for policy 1, policy_version 1309339 (0.0011) [2023-12-28 04:38:43,267][106225] Updated weights for policy 1, policy_version 1309349 (0.0010) [2023-12-28 04:38:43,328][106225] Updated weights for policy 1, policy_version 1309359 (0.0010) [2023-12-28 04:38:43,442][106226] Updated weights for policy 0, policy_version 1306041 (0.0007) [2023-12-28 04:38:43,512][106226] Updated weights for policy 0, policy_version 1306051 (0.0011) [2023-12-28 04:38:43,566][106226] Updated weights for policy 0, policy_version 1306061 (0.0008) [2023-12-28 04:38:43,615][106226] Updated weights for policy 0, policy_version 1306071 (0.0008) [2023-12-28 04:38:44,046][106225] Updated weights for policy 1, policy_version 1309369 (0.0010) [2023-12-28 04:38:44,110][106225] Updated weights for policy 1, policy_version 1309379 (0.0010) [2023-12-28 04:38:44,160][106225] Updated weights for policy 1, policy_version 1309389 (0.0009) [2023-12-28 04:38:44,228][106225] Updated weights for policy 1, policy_version 1309399 (0.0006) [2023-12-28 04:38:44,336][106226] Updated weights for policy 0, policy_version 1306081 (0.0009) [2023-12-28 04:38:44,393][106226] Updated weights for policy 0, policy_version 1306091 (0.0008) [2023-12-28 04:38:44,455][106226] Updated weights for policy 0, policy_version 1306101 (0.0010) [2023-12-28 04:38:44,875][106225] Updated weights for policy 1, policy_version 1309409 (0.0007) [2023-12-28 04:38:44,937][106225] Updated weights for policy 1, policy_version 1309419 (0.0006) [2023-12-28 04:38:45,011][106225] Updated weights for policy 1, policy_version 1309429 (0.0007) [2023-12-28 04:38:45,228][106226] Updated weights for policy 0, policy_version 1306111 (0.0011) [2023-12-28 04:38:45,292][106226] Updated weights for policy 0, policy_version 1306121 (0.0011) [2023-12-28 04:38:45,358][106226] Updated weights for policy 0, policy_version 1306131 (0.0007) [2023-12-28 04:38:45,714][106225] Updated weights for policy 1, policy_version 1309439 (0.0009) [2023-12-28 04:38:45,773][106225] Updated weights for policy 1, policy_version 1309449 (0.0010) [2023-12-28 04:38:45,832][106225] Updated weights for policy 1, policy_version 1309459 (0.0010) [2023-12-28 04:38:45,967][106226] Updated weights for policy 0, policy_version 1306141 (0.0007) [2023-12-28 04:38:46,024][106226] Updated weights for policy 0, policy_version 1306151 (0.0006) [2023-12-28 04:38:46,081][106226] Updated weights for policy 0, policy_version 1306161 (0.0010) [2023-12-28 04:38:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 669712384. Throughput: 0: 10033.0, 1: 9743.9. Samples: 669696940. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:46,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-5.109')] [2023-12-28 04:38:46,397][106225] Updated weights for policy 1, policy_version 1309469 (0.0009) [2023-12-28 04:38:46,450][106225] Updated weights for policy 1, policy_version 1309479 (0.0010) [2023-12-28 04:38:46,516][106225] Updated weights for policy 1, policy_version 1309489 (0.0010) [2023-12-28 04:38:46,714][106226] Updated weights for policy 0, policy_version 1306171 (0.0010) [2023-12-28 04:38:46,760][106226] Updated weights for policy 0, policy_version 1306181 (0.0010) [2023-12-28 04:38:46,806][106226] Updated weights for policy 0, policy_version 1306191 (0.0010) [2023-12-28 04:38:47,182][106225] Updated weights for policy 1, policy_version 1309499 (0.0011) [2023-12-28 04:38:47,232][106225] Updated weights for policy 1, policy_version 1309509 (0.0007) [2023-12-28 04:38:47,295][106225] Updated weights for policy 1, policy_version 1309519 (0.0006) [2023-12-28 04:38:47,446][106226] Updated weights for policy 0, policy_version 1306201 (0.0008) [2023-12-28 04:38:47,498][106226] Updated weights for policy 0, policy_version 1306211 (0.0005) [2023-12-28 04:38:47,561][106226] Updated weights for policy 0, policy_version 1306221 (0.0007) [2023-12-28 04:38:47,609][106226] Updated weights for policy 0, policy_version 1306231 (0.0007) [2023-12-28 04:38:47,980][106225] Updated weights for policy 1, policy_version 1309529 (0.0010) [2023-12-28 04:38:48,038][106225] Updated weights for policy 1, policy_version 1309539 (0.0008) [2023-12-28 04:38:48,102][106225] Updated weights for policy 1, policy_version 1309549 (0.0008) [2023-12-28 04:38:48,158][106225] Updated weights for policy 1, policy_version 1309559 (0.0005) [2023-12-28 04:38:48,282][106226] Updated weights for policy 0, policy_version 1306241 (0.0008) [2023-12-28 04:38:48,336][106226] Updated weights for policy 0, policy_version 1306251 (0.0006) [2023-12-28 04:38:48,407][106226] Updated weights for policy 0, policy_version 1306261 (0.0008) [2023-12-28 04:38:48,877][106225] Updated weights for policy 1, policy_version 1309569 (0.0008) [2023-12-28 04:38:48,936][106225] Updated weights for policy 1, policy_version 1309579 (0.0008) [2023-12-28 04:38:48,990][106225] Updated weights for policy 1, policy_version 1309589 (0.0008) [2023-12-28 04:38:49,071][106226] Updated weights for policy 0, policy_version 1306271 (0.0008) [2023-12-28 04:38:49,129][106226] Updated weights for policy 0, policy_version 1306281 (0.0008) [2023-12-28 04:38:49,192][106226] Updated weights for policy 0, policy_version 1306291 (0.0008) [2023-12-28 04:38:49,779][106225] Updated weights for policy 1, policy_version 1309599 (0.0010) [2023-12-28 04:38:49,837][106225] Updated weights for policy 1, policy_version 1309609 (0.0009) [2023-12-28 04:38:49,895][106225] Updated weights for policy 1, policy_version 1309619 (0.0007) [2023-12-28 04:38:49,913][106226] Updated weights for policy 0, policy_version 1306301 (0.0008) [2023-12-28 04:38:49,982][106226] Updated weights for policy 0, policy_version 1306311 (0.0008) [2023-12-28 04:38:50,041][106226] Updated weights for policy 0, policy_version 1306321 (0.0008) [2023-12-28 04:38:50,573][106225] Updated weights for policy 1, policy_version 1309629 (0.0007) [2023-12-28 04:38:50,637][106225] Updated weights for policy 1, policy_version 1309639 (0.0008) [2023-12-28 04:38:50,700][106225] Updated weights for policy 1, policy_version 1309649 (0.0006) [2023-12-28 04:38:50,804][106226] Updated weights for policy 0, policy_version 1306331 (0.0007) [2023-12-28 04:38:50,868][106226] Updated weights for policy 0, policy_version 1306341 (0.0009) [2023-12-28 04:38:50,938][106226] Updated weights for policy 0, policy_version 1306351 (0.0007) [2023-12-28 04:38:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 669810688. Throughput: 0: 10014.6, 1: 9696.1. Samples: 669817724. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:51,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.868')] [2023-12-28 04:38:51,415][106225] Updated weights for policy 1, policy_version 1309659 (0.0008) [2023-12-28 04:38:51,474][106225] Updated weights for policy 1, policy_version 1309669 (0.0007) [2023-12-28 04:38:51,538][106225] Updated weights for policy 1, policy_version 1309679 (0.0008) [2023-12-28 04:38:51,673][106226] Updated weights for policy 0, policy_version 1306361 (0.0007) [2023-12-28 04:38:51,741][106226] Updated weights for policy 0, policy_version 1306371 (0.0008) [2023-12-28 04:38:51,797][106226] Updated weights for policy 0, policy_version 1306381 (0.0010) [2023-12-28 04:38:51,846][106226] Updated weights for policy 0, policy_version 1306391 (0.0008) [2023-12-28 04:38:52,286][106225] Updated weights for policy 1, policy_version 1309689 (0.0008) [2023-12-28 04:38:52,350][106225] Updated weights for policy 1, policy_version 1309699 (0.0009) [2023-12-28 04:38:52,412][106225] Updated weights for policy 1, policy_version 1309709 (0.0008) [2023-12-28 04:38:52,470][106225] Updated weights for policy 1, policy_version 1309719 (0.0008) [2023-12-28 04:38:52,612][106226] Updated weights for policy 0, policy_version 1306401 (0.0006) [2023-12-28 04:38:52,676][106226] Updated weights for policy 0, policy_version 1306411 (0.0005) [2023-12-28 04:38:52,737][106226] Updated weights for policy 0, policy_version 1306421 (0.0007) [2023-12-28 04:38:53,202][106225] Updated weights for policy 1, policy_version 1309729 (0.0010) [2023-12-28 04:38:53,255][106225] Updated weights for policy 1, policy_version 1309739 (0.0010) [2023-12-28 04:38:53,316][106225] Updated weights for policy 1, policy_version 1309749 (0.0010) [2023-12-28 04:38:53,385][106226] Updated weights for policy 0, policy_version 1306431 (0.0008) [2023-12-28 04:38:53,442][106226] Updated weights for policy 0, policy_version 1306441 (0.0005) [2023-12-28 04:38:53,500][106226] Updated weights for policy 0, policy_version 1306451 (0.0005) [2023-12-28 04:38:53,986][106225] Updated weights for policy 1, policy_version 1309759 (0.0010) [2023-12-28 04:38:54,040][106225] Updated weights for policy 1, policy_version 1309769 (0.0009) [2023-12-28 04:38:54,040][106226] Updated weights for policy 0, policy_version 1306461 (0.0008) [2023-12-28 04:38:54,093][106225] Updated weights for policy 1, policy_version 1309779 (0.0010) [2023-12-28 04:38:54,094][106226] Updated weights for policy 0, policy_version 1306471 (0.0010) [2023-12-28 04:38:54,161][106226] Updated weights for policy 0, policy_version 1306481 (0.0010) [2023-12-28 04:38:54,716][106225] Updated weights for policy 1, policy_version 1309789 (0.0010) [2023-12-28 04:38:54,786][106225] Updated weights for policy 1, policy_version 1309799 (0.0010) [2023-12-28 04:38:54,851][106225] Updated weights for policy 1, policy_version 1309809 (0.0010) [2023-12-28 04:38:54,890][106226] Updated weights for policy 0, policy_version 1306491 (0.0009) [2023-12-28 04:38:54,951][106226] Updated weights for policy 0, policy_version 1306501 (0.0007) [2023-12-28 04:38:55,015][106226] Updated weights for policy 0, policy_version 1306511 (0.0009) [2023-12-28 04:38:55,476][106225] Updated weights for policy 1, policy_version 1309819 (0.0009) [2023-12-28 04:38:55,536][106225] Updated weights for policy 1, policy_version 1309829 (0.0010) [2023-12-28 04:38:55,591][106225] Updated weights for policy 1, policy_version 1309839 (0.0010) [2023-12-28 04:38:55,658][106226] Updated weights for policy 0, policy_version 1306521 (0.0008) [2023-12-28 04:38:55,718][106226] Updated weights for policy 0, policy_version 1306531 (0.0007) [2023-12-28 04:38:55,768][106226] Updated weights for policy 0, policy_version 1306541 (0.0007) [2023-12-28 04:38:55,820][106226] Updated weights for policy 0, policy_version 1306551 (0.0008) [2023-12-28 04:38:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 669908992. Throughput: 0: 10008.9, 1: 9682.5. Samples: 669877740. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:38:56,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-4.751')] [2023-12-28 04:38:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001306552_334536704.pth... [2023-12-28 04:38:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001309848_335372288.pth... [2023-12-28 04:38:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001305368_334233600.pth [2023-12-28 04:38:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001308728_335085568.pth [2023-12-28 04:38:56,213][106225] Updated weights for policy 1, policy_version 1309849 (0.0009) [2023-12-28 04:38:56,280][106225] Updated weights for policy 1, policy_version 1309859 (0.0006) [2023-12-28 04:38:56,350][106225] Updated weights for policy 1, policy_version 1309869 (0.0006) [2023-12-28 04:38:56,417][106225] Updated weights for policy 1, policy_version 1309879 (0.0010) [2023-12-28 04:38:56,507][106226] Updated weights for policy 0, policy_version 1306561 (0.0005) [2023-12-28 04:38:56,557][106226] Updated weights for policy 0, policy_version 1306571 (0.0005) [2023-12-28 04:38:56,610][106226] Updated weights for policy 0, policy_version 1306581 (0.0005) [2023-12-28 04:38:57,029][106225] Updated weights for policy 1, policy_version 1309889 (0.0009) [2023-12-28 04:38:57,090][106225] Updated weights for policy 1, policy_version 1309899 (0.0005) [2023-12-28 04:38:57,141][106225] Updated weights for policy 1, policy_version 1309909 (0.0005) [2023-12-28 04:38:57,239][106226] Updated weights for policy 0, policy_version 1306591 (0.0009) [2023-12-28 04:38:57,298][106226] Updated weights for policy 0, policy_version 1306601 (0.0010) [2023-12-28 04:38:57,349][106226] Updated weights for policy 0, policy_version 1306611 (0.0009) [2023-12-28 04:38:57,839][106225] Updated weights for policy 1, policy_version 1309919 (0.0010) [2023-12-28 04:38:57,884][106225] Updated weights for policy 1, policy_version 1309929 (0.0007) [2023-12-28 04:38:57,932][106225] Updated weights for policy 1, policy_version 1309939 (0.0008) [2023-12-28 04:38:57,984][106226] Updated weights for policy 0, policy_version 1306621 (0.0008) [2023-12-28 04:38:58,040][106226] Updated weights for policy 0, policy_version 1306631 (0.0010) [2023-12-28 04:38:58,090][106226] Updated weights for policy 0, policy_version 1306641 (0.0010) [2023-12-28 04:38:58,615][106225] Updated weights for policy 1, policy_version 1309949 (0.0008) [2023-12-28 04:38:58,671][106225] Updated weights for policy 1, policy_version 1309959 (0.0007) [2023-12-28 04:38:58,737][106225] Updated weights for policy 1, policy_version 1309969 (0.0009) [2023-12-28 04:38:58,830][106226] Updated weights for policy 0, policy_version 1306651 (0.0010) [2023-12-28 04:38:58,907][106226] Updated weights for policy 0, policy_version 1306661 (0.0007) [2023-12-28 04:38:58,977][106226] Updated weights for policy 0, policy_version 1306671 (0.0008) [2023-12-28 04:38:59,552][106225] Updated weights for policy 1, policy_version 1309979 (0.0007) [2023-12-28 04:38:59,616][106225] Updated weights for policy 1, policy_version 1309989 (0.0008) [2023-12-28 04:38:59,683][106225] Updated weights for policy 1, policy_version 1309999 (0.0005) [2023-12-28 04:38:59,698][106226] Updated weights for policy 0, policy_version 1306681 (0.0007) [2023-12-28 04:38:59,746][106226] Updated weights for policy 0, policy_version 1306691 (0.0008) [2023-12-28 04:38:59,803][106226] Updated weights for policy 0, policy_version 1306701 (0.0009) [2023-12-28 04:38:59,875][106226] Updated weights for policy 0, policy_version 1306711 (0.0007) [2023-12-28 04:39:00,306][106225] Updated weights for policy 1, policy_version 1310009 (0.0005) [2023-12-28 04:39:00,363][106225] Updated weights for policy 1, policy_version 1310019 (0.0005) [2023-12-28 04:39:00,423][106225] Updated weights for policy 1, policy_version 1310029 (0.0010) [2023-12-28 04:39:00,487][106225] Updated weights for policy 1, policy_version 1310039 (0.0010) [2023-12-28 04:39:00,612][106226] Updated weights for policy 0, policy_version 1306721 (0.0008) [2023-12-28 04:39:00,667][106226] Updated weights for policy 0, policy_version 1306731 (0.0008) [2023-12-28 04:39:00,721][106226] Updated weights for policy 0, policy_version 1306741 (0.0008) [2023-12-28 04:39:01,111][106225] Updated weights for policy 1, policy_version 1310049 (0.0009) [2023-12-28 04:39:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 670007296. Throughput: 0: 10068.3, 1: 9817.4. Samples: 669999452. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:01,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.057')] [2023-12-28 04:39:01,179][106225] Updated weights for policy 1, policy_version 1310059 (0.0008) [2023-12-28 04:39:01,240][106225] Updated weights for policy 1, policy_version 1310069 (0.0009) [2023-12-28 04:39:01,534][106226] Updated weights for policy 0, policy_version 1306751 (0.0009) [2023-12-28 04:39:01,593][106226] Updated weights for policy 0, policy_version 1306761 (0.0008) [2023-12-28 04:39:01,660][106226] Updated weights for policy 0, policy_version 1306771 (0.0009) [2023-12-28 04:39:01,972][106225] Updated weights for policy 1, policy_version 1310079 (0.0007) [2023-12-28 04:39:02,022][106225] Updated weights for policy 1, policy_version 1310089 (0.0009) [2023-12-28 04:39:02,071][106225] Updated weights for policy 1, policy_version 1310099 (0.0008) [2023-12-28 04:39:02,370][106226] Updated weights for policy 0, policy_version 1306781 (0.0010) [2023-12-28 04:39:02,420][106226] Updated weights for policy 0, policy_version 1306791 (0.0010) [2023-12-28 04:39:02,467][106226] Updated weights for policy 0, policy_version 1306801 (0.0010) [2023-12-28 04:39:02,857][106225] Updated weights for policy 1, policy_version 1310109 (0.0008) [2023-12-28 04:39:02,911][106225] Updated weights for policy 1, policy_version 1310120 (0.0009) [2023-12-28 04:39:02,970][106225] Updated weights for policy 1, policy_version 1310130 (0.0009) [2023-12-28 04:39:03,097][106226] Updated weights for policy 0, policy_version 1306811 (0.0009) [2023-12-28 04:39:03,153][106226] Updated weights for policy 0, policy_version 1306821 (0.0005) [2023-12-28 04:39:03,220][106226] Updated weights for policy 0, policy_version 1306831 (0.0007) [2023-12-28 04:39:03,558][106225] Updated weights for policy 1, policy_version 1310140 (0.0007) [2023-12-28 04:39:03,607][106225] Updated weights for policy 1, policy_version 1310150 (0.0007) [2023-12-28 04:39:03,674][106225] Updated weights for policy 1, policy_version 1310160 (0.0007) [2023-12-28 04:39:03,745][106226] Updated weights for policy 0, policy_version 1306841 (0.0006) [2023-12-28 04:39:03,812][106226] Updated weights for policy 0, policy_version 1306851 (0.0007) [2023-12-28 04:39:03,882][106226] Updated weights for policy 0, policy_version 1306861 (0.0010) [2023-12-28 04:39:03,943][106226] Updated weights for policy 0, policy_version 1306871 (0.0011) [2023-12-28 04:39:04,354][106225] Updated weights for policy 1, policy_version 1310170 (0.0007) [2023-12-28 04:39:04,408][106225] Updated weights for policy 1, policy_version 1310180 (0.0007) [2023-12-28 04:39:04,466][106225] Updated weights for policy 1, policy_version 1310190 (0.0008) [2023-12-28 04:39:04,523][106225] Updated weights for policy 1, policy_version 1310200 (0.0009) [2023-12-28 04:39:04,664][106226] Updated weights for policy 0, policy_version 1306881 (0.0006) [2023-12-28 04:39:04,721][106226] Updated weights for policy 0, policy_version 1306891 (0.0010) [2023-12-28 04:39:04,780][106226] Updated weights for policy 0, policy_version 1306901 (0.0010) [2023-12-28 04:39:05,282][106225] Updated weights for policy 1, policy_version 1310210 (0.0006) [2023-12-28 04:39:05,337][106225] Updated weights for policy 1, policy_version 1310220 (0.0006) [2023-12-28 04:39:05,384][106225] Updated weights for policy 1, policy_version 1310230 (0.0007) [2023-12-28 04:39:05,389][106226] Updated weights for policy 0, policy_version 1306911 (0.0007) [2023-12-28 04:39:05,451][106226] Updated weights for policy 0, policy_version 1306921 (0.0005) [2023-12-28 04:39:05,514][106226] Updated weights for policy 0, policy_version 1306931 (0.0005) [2023-12-28 04:39:06,016][106225] Updated weights for policy 1, policy_version 1310240 (0.0009) [2023-12-28 04:39:06,065][106225] Updated weights for policy 1, policy_version 1310250 (0.0007) [2023-12-28 04:39:06,107][106226] Updated weights for policy 0, policy_version 1306941 (0.0008) [2023-12-28 04:39:06,124][106225] Updated weights for policy 1, policy_version 1310260 (0.0008) [2023-12-28 04:39:06,166][106226] Updated weights for policy 0, policy_version 1306951 (0.0010) [2023-12-28 04:39:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 670113792. Throughput: 0: 10083.8, 1: 9850.1. Samples: 670122744. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:06,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.846')] [2023-12-28 04:39:06,214][106226] Updated weights for policy 0, policy_version 1306961 (0.0011) [2023-12-28 04:39:06,907][106225] Updated weights for policy 1, policy_version 1310270 (0.0009) [2023-12-28 04:39:06,965][106225] Updated weights for policy 1, policy_version 1310280 (0.0008) [2023-12-28 04:39:06,988][106226] Updated weights for policy 0, policy_version 1306971 (0.0009) [2023-12-28 04:39:07,023][106225] Updated weights for policy 1, policy_version 1310290 (0.0007) [2023-12-28 04:39:07,049][106226] Updated weights for policy 0, policy_version 1306981 (0.0007) [2023-12-28 04:39:07,111][106226] Updated weights for policy 0, policy_version 1306991 (0.0010) [2023-12-28 04:39:07,712][106225] Updated weights for policy 1, policy_version 1310300 (0.0007) [2023-12-28 04:39:07,778][106225] Updated weights for policy 1, policy_version 1310310 (0.0010) [2023-12-28 04:39:07,794][106226] Updated weights for policy 0, policy_version 1307001 (0.0008) [2023-12-28 04:39:07,839][106225] Updated weights for policy 1, policy_version 1310320 (0.0008) [2023-12-28 04:39:07,848][106226] Updated weights for policy 0, policy_version 1307011 (0.0005) [2023-12-28 04:39:07,904][106226] Updated weights for policy 0, policy_version 1307021 (0.0007) [2023-12-28 04:39:07,968][106226] Updated weights for policy 0, policy_version 1307031 (0.0009) [2023-12-28 04:39:08,604][106225] Updated weights for policy 1, policy_version 1310330 (0.0008) [2023-12-28 04:39:08,632][106226] Updated weights for policy 0, policy_version 1307041 (0.0007) [2023-12-28 04:39:08,658][106225] Updated weights for policy 1, policy_version 1310340 (0.0007) [2023-12-28 04:39:08,693][106226] Updated weights for policy 0, policy_version 1307051 (0.0007) [2023-12-28 04:39:08,711][106225] Updated weights for policy 1, policy_version 1310350 (0.0007) [2023-12-28 04:39:08,746][106226] Updated weights for policy 0, policy_version 1307061 (0.0005) [2023-12-28 04:39:08,773][106225] Updated weights for policy 1, policy_version 1310360 (0.0009) [2023-12-28 04:39:09,337][106226] Updated weights for policy 0, policy_version 1307071 (0.0006) [2023-12-28 04:39:09,404][106226] Updated weights for policy 0, policy_version 1307081 (0.0009) [2023-12-28 04:39:09,465][106226] Updated weights for policy 0, policy_version 1307091 (0.0008) [2023-12-28 04:39:09,560][106225] Updated weights for policy 1, policy_version 1310370 (0.0010) [2023-12-28 04:39:09,619][106225] Updated weights for policy 1, policy_version 1310380 (0.0011) [2023-12-28 04:39:09,680][106225] Updated weights for policy 1, policy_version 1310390 (0.0010) [2023-12-28 04:39:10,273][106226] Updated weights for policy 0, policy_version 1307101 (0.0009) [2023-12-28 04:39:10,336][106226] Updated weights for policy 0, policy_version 1307111 (0.0008) [2023-12-28 04:39:10,387][106225] Updated weights for policy 1, policy_version 1310400 (0.0007) [2023-12-28 04:39:10,401][106226] Updated weights for policy 0, policy_version 1307121 (0.0008) [2023-12-28 04:39:10,455][106225] Updated weights for policy 1, policy_version 1310410 (0.0006) [2023-12-28 04:39:10,516][106225] Updated weights for policy 1, policy_version 1310420 (0.0006) [2023-12-28 04:39:11,135][106225] Updated weights for policy 1, policy_version 1310430 (0.0008) [2023-12-28 04:39:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 670203904. Throughput: 0: 10126.1, 1: 9834.4. Samples: 670181220. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:11,175][105115] Avg episode reward: [(0, '-4.049'), (1, '-5.058')] [2023-12-28 04:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001307128_334684160.pth... [2023-12-28 04:39:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001305976_334389248.pth [2023-12-28 04:39:11,203][106225] Updated weights for policy 1, policy_version 1310440 (0.0008) [2023-12-28 04:39:11,222][106226] Updated weights for policy 0, policy_version 1307131 (0.0009) [2023-12-28 04:39:11,265][106225] Updated weights for policy 1, policy_version 1310450 (0.0008) [2023-12-28 04:39:11,287][106226] Updated weights for policy 0, policy_version 1307141 (0.0009) [2023-12-28 04:39:11,300][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001310456_335527936.pth... [2023-12-28 04:39:11,303][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001309272_335224832.pth [2023-12-28 04:39:11,362][106226] Updated weights for policy 0, policy_version 1307151 (0.0008) [2023-12-28 04:39:11,988][106225] Updated weights for policy 1, policy_version 1310460 (0.0008) [2023-12-28 04:39:12,060][106225] Updated weights for policy 1, policy_version 1310470 (0.0006) [2023-12-28 04:39:12,123][106226] Updated weights for policy 0, policy_version 1307161 (0.0008) [2023-12-28 04:39:12,129][106225] Updated weights for policy 1, policy_version 1310480 (0.0006) [2023-12-28 04:39:12,187][106226] Updated weights for policy 0, policy_version 1307171 (0.0008) [2023-12-28 04:39:12,254][106226] Updated weights for policy 0, policy_version 1307181 (0.0009) [2023-12-28 04:39:12,315][106226] Updated weights for policy 0, policy_version 1307191 (0.0008) [2023-12-28 04:39:12,827][106225] Updated weights for policy 1, policy_version 1310490 (0.0006) [2023-12-28 04:39:12,891][106225] Updated weights for policy 1, policy_version 1310500 (0.0008) [2023-12-28 04:39:12,955][106225] Updated weights for policy 1, policy_version 1310510 (0.0009) [2023-12-28 04:39:12,965][106226] Updated weights for policy 0, policy_version 1307201 (0.0006) [2023-12-28 04:39:13,015][106225] Updated weights for policy 1, policy_version 1310520 (0.0010) [2023-12-28 04:39:13,017][106226] Updated weights for policy 0, policy_version 1307211 (0.0007) [2023-12-28 04:39:13,077][106226] Updated weights for policy 0, policy_version 1307221 (0.0008) [2023-12-28 04:39:13,720][106225] Updated weights for policy 1, policy_version 1310530 (0.0006) [2023-12-28 04:39:13,740][106226] Updated weights for policy 0, policy_version 1307231 (0.0006) [2023-12-28 04:39:13,773][106225] Updated weights for policy 1, policy_version 1310540 (0.0007) [2023-12-28 04:39:13,798][106226] Updated weights for policy 0, policy_version 1307241 (0.0006) [2023-12-28 04:39:13,831][106225] Updated weights for policy 1, policy_version 1310550 (0.0007) [2023-12-28 04:39:13,856][106226] Updated weights for policy 0, policy_version 1307251 (0.0007) [2023-12-28 04:39:14,504][106225] Updated weights for policy 1, policy_version 1310560 (0.0008) [2023-12-28 04:39:14,558][106225] Updated weights for policy 1, policy_version 1310570 (0.0007) [2023-12-28 04:39:14,561][106226] Updated weights for policy 0, policy_version 1307261 (0.0009) [2023-12-28 04:39:14,618][106225] Updated weights for policy 1, policy_version 1310580 (0.0008) [2023-12-28 04:39:14,619][106226] Updated weights for policy 0, policy_version 1307271 (0.0005) [2023-12-28 04:39:14,677][106226] Updated weights for policy 0, policy_version 1307281 (0.0008) [2023-12-28 04:39:15,399][106226] Updated weights for policy 0, policy_version 1307291 (0.0009) [2023-12-28 04:39:15,401][106225] Updated weights for policy 1, policy_version 1310590 (0.0006) [2023-12-28 04:39:15,454][106225] Updated weights for policy 1, policy_version 1310600 (0.0006) [2023-12-28 04:39:15,459][106226] Updated weights for policy 0, policy_version 1307301 (0.0008) [2023-12-28 04:39:15,513][106225] Updated weights for policy 1, policy_version 1310610 (0.0009) [2023-12-28 04:39:15,523][106226] Updated weights for policy 0, policy_version 1307311 (0.0009) [2023-12-28 04:39:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 670302208. Throughput: 0: 10105.6, 1: 9807.3. Samples: 670296360. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:16,175][106225] Updated weights for policy 1, policy_version 1310620 (0.0007) [2023-12-28 04:39:16,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.860')] [2023-12-28 04:39:16,232][106225] Updated weights for policy 1, policy_version 1310630 (0.0008) [2023-12-28 04:39:16,261][106226] Updated weights for policy 0, policy_version 1307321 (0.0009) [2023-12-28 04:39:16,291][106225] Updated weights for policy 1, policy_version 1310640 (0.0008) [2023-12-28 04:39:16,320][106226] Updated weights for policy 0, policy_version 1307331 (0.0009) [2023-12-28 04:39:16,377][106226] Updated weights for policy 0, policy_version 1307341 (0.0008) [2023-12-28 04:39:16,435][106226] Updated weights for policy 0, policy_version 1307351 (0.0009) [2023-12-28 04:39:16,957][106225] Updated weights for policy 1, policy_version 1310650 (0.0007) [2023-12-28 04:39:17,014][106225] Updated weights for policy 1, policy_version 1310660 (0.0007) [2023-12-28 04:39:17,069][106225] Updated weights for policy 1, policy_version 1310670 (0.0008) [2023-12-28 04:39:17,121][106225] Updated weights for policy 1, policy_version 1310680 (0.0008) [2023-12-28 04:39:17,186][106226] Updated weights for policy 0, policy_version 1307361 (0.0008) [2023-12-28 04:39:17,249][106226] Updated weights for policy 0, policy_version 1307371 (0.0009) [2023-12-28 04:39:17,316][106226] Updated weights for policy 0, policy_version 1307381 (0.0009) [2023-12-28 04:39:17,832][106225] Updated weights for policy 1, policy_version 1310690 (0.0009) [2023-12-28 04:39:17,883][106225] Updated weights for policy 1, policy_version 1310700 (0.0008) [2023-12-28 04:39:17,929][106226] Updated weights for policy 0, policy_version 1307391 (0.0008) [2023-12-28 04:39:17,934][106225] Updated weights for policy 1, policy_version 1310710 (0.0007) [2023-12-28 04:39:17,984][106226] Updated weights for policy 0, policy_version 1307401 (0.0008) [2023-12-28 04:39:18,050][106226] Updated weights for policy 0, policy_version 1307411 (0.0009) [2023-12-28 04:39:18,668][106225] Updated weights for policy 1, policy_version 1310720 (0.0007) [2023-12-28 04:39:18,731][106225] Updated weights for policy 1, policy_version 1310730 (0.0008) [2023-12-28 04:39:18,782][106226] Updated weights for policy 0, policy_version 1307421 (0.0007) [2023-12-28 04:39:18,795][106225] Updated weights for policy 1, policy_version 1310740 (0.0006) [2023-12-28 04:39:18,842][106226] Updated weights for policy 0, policy_version 1307431 (0.0007) [2023-12-28 04:39:18,908][106226] Updated weights for policy 0, policy_version 1307441 (0.0009) [2023-12-28 04:39:19,502][106225] Updated weights for policy 1, policy_version 1310750 (0.0008) [2023-12-28 04:39:19,568][106225] Updated weights for policy 1, policy_version 1310760 (0.0007) [2023-12-28 04:39:19,643][106225] Updated weights for policy 1, policy_version 1310770 (0.0008) [2023-12-28 04:39:19,698][106226] Updated weights for policy 0, policy_version 1307451 (0.0008) [2023-12-28 04:39:19,758][106226] Updated weights for policy 0, policy_version 1307461 (0.0010) [2023-12-28 04:39:19,826][106226] Updated weights for policy 0, policy_version 1307471 (0.0009) [2023-12-28 04:39:20,353][106225] Updated weights for policy 1, policy_version 1310780 (0.0008) [2023-12-28 04:39:20,406][106225] Updated weights for policy 1, policy_version 1310790 (0.0009) [2023-12-28 04:39:20,458][106225] Updated weights for policy 1, policy_version 1310800 (0.0008) [2023-12-28 04:39:20,569][106226] Updated weights for policy 0, policy_version 1307481 (0.0009) [2023-12-28 04:39:20,628][106226] Updated weights for policy 0, policy_version 1307491 (0.0008) [2023-12-28 04:39:20,677][106226] Updated weights for policy 0, policy_version 1307501 (0.0009) [2023-12-28 04:39:20,734][106226] Updated weights for policy 0, policy_version 1307511 (0.0010) [2023-12-28 04:39:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 670400512. Throughput: 0: 9900.7, 1: 9887.8. Samples: 670411868. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:21,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.794')] [2023-12-28 04:39:21,182][106225] Updated weights for policy 1, policy_version 1310810 (0.0008) [2023-12-28 04:39:21,244][106225] Updated weights for policy 1, policy_version 1310820 (0.0008) [2023-12-28 04:39:21,305][106225] Updated weights for policy 1, policy_version 1310830 (0.0006) [2023-12-28 04:39:21,376][106225] Updated weights for policy 1, policy_version 1310840 (0.0009) [2023-12-28 04:39:21,593][106226] Updated weights for policy 0, policy_version 1307521 (0.0008) [2023-12-28 04:39:21,667][106226] Updated weights for policy 0, policy_version 1307531 (0.0008) [2023-12-28 04:39:21,730][106226] Updated weights for policy 0, policy_version 1307541 (0.0006) [2023-12-28 04:39:22,130][106225] Updated weights for policy 1, policy_version 1310850 (0.0008) [2023-12-28 04:39:22,194][106225] Updated weights for policy 1, policy_version 1310860 (0.0008) [2023-12-28 04:39:22,250][106225] Updated weights for policy 1, policy_version 1310870 (0.0008) [2023-12-28 04:39:22,424][106226] Updated weights for policy 0, policy_version 1307551 (0.0009) [2023-12-28 04:39:22,492][106226] Updated weights for policy 0, policy_version 1307561 (0.0008) [2023-12-28 04:39:22,561][106226] Updated weights for policy 0, policy_version 1307571 (0.0011) [2023-12-28 04:39:23,039][106225] Updated weights for policy 1, policy_version 1310880 (0.0007) [2023-12-28 04:39:23,106][106225] Updated weights for policy 1, policy_version 1310890 (0.0009) [2023-12-28 04:39:23,169][106225] Updated weights for policy 1, policy_version 1310900 (0.0008) [2023-12-28 04:39:23,212][106226] Updated weights for policy 0, policy_version 1307581 (0.0010) [2023-12-28 04:39:23,265][106226] Updated weights for policy 0, policy_version 1307591 (0.0006) [2023-12-28 04:39:23,331][106226] Updated weights for policy 0, policy_version 1307601 (0.0008) [2023-12-28 04:39:23,923][106225] Updated weights for policy 1, policy_version 1310910 (0.0008) [2023-12-28 04:39:23,976][106226] Updated weights for policy 0, policy_version 1307611 (0.0008) [2023-12-28 04:39:23,979][106225] Updated weights for policy 1, policy_version 1310920 (0.0007) [2023-12-28 04:39:24,027][106225] Updated weights for policy 1, policy_version 1310930 (0.0007) [2023-12-28 04:39:24,037][106226] Updated weights for policy 0, policy_version 1307621 (0.0008) [2023-12-28 04:39:24,087][106226] Updated weights for policy 0, policy_version 1307631 (0.0007) [2023-12-28 04:39:24,765][106225] Updated weights for policy 1, policy_version 1310940 (0.0007) [2023-12-28 04:39:24,812][106225] Updated weights for policy 1, policy_version 1310950 (0.0008) [2023-12-28 04:39:24,819][106226] Updated weights for policy 0, policy_version 1307641 (0.0009) [2023-12-28 04:39:24,860][106225] Updated weights for policy 1, policy_version 1310960 (0.0006) [2023-12-28 04:39:24,878][106226] Updated weights for policy 0, policy_version 1307651 (0.0006) [2023-12-28 04:39:24,939][106226] Updated weights for policy 0, policy_version 1307661 (0.0007) [2023-12-28 04:39:24,995][106226] Updated weights for policy 0, policy_version 1307671 (0.0008) [2023-12-28 04:39:25,609][106225] Updated weights for policy 1, policy_version 1310970 (0.0006) [2023-12-28 04:39:25,676][106225] Updated weights for policy 1, policy_version 1310980 (0.0005) [2023-12-28 04:39:25,691][106226] Updated weights for policy 0, policy_version 1307681 (0.0008) [2023-12-28 04:39:25,741][106225] Updated weights for policy 1, policy_version 1310990 (0.0005) [2023-12-28 04:39:25,750][106226] Updated weights for policy 0, policy_version 1307691 (0.0008) [2023-12-28 04:39:25,797][106225] Updated weights for policy 1, policy_version 1311000 (0.0009) [2023-12-28 04:39:25,801][106226] Updated weights for policy 0, policy_version 1307701 (0.0006) [2023-12-28 04:39:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 670498816. Throughput: 0: 9897.4, 1: 9837.3. Samples: 670469092. Policy #0 lag: (min: 15.0, avg: 15.1, max: 21.0) [2023-12-28 04:39:26,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-5.029')] [2023-12-28 04:39:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001307704_334831616.pth... [2023-12-28 04:39:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001311000_335667200.pth... [2023-12-28 04:39:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001306552_334536704.pth [2023-12-28 04:39:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001309848_335372288.pth [2023-12-28 04:39:26,440][106225] Updated weights for policy 1, policy_version 1311010 (0.0009) [2023-12-28 04:39:26,491][106225] Updated weights for policy 1, policy_version 1311020 (0.0009) [2023-12-28 04:39:26,492][106226] Updated weights for policy 0, policy_version 1307711 (0.0006) [2023-12-28 04:39:26,536][106225] Updated weights for policy 1, policy_version 1311030 (0.0008) [2023-12-28 04:39:26,547][106226] Updated weights for policy 0, policy_version 1307721 (0.0005) [2023-12-28 04:39:26,601][106226] Updated weights for policy 0, policy_version 1307731 (0.0005) [2023-12-28 04:39:27,263][106225] Updated weights for policy 1, policy_version 1311040 (0.0007) [2023-12-28 04:39:27,269][106226] Updated weights for policy 0, policy_version 1307741 (0.0010) [2023-12-28 04:39:27,317][106225] Updated weights for policy 1, policy_version 1311050 (0.0006) [2023-12-28 04:39:27,318][106226] Updated weights for policy 0, policy_version 1307751 (0.0006) [2023-12-28 04:39:27,372][106226] Updated weights for policy 0, policy_version 1307761 (0.0005) [2023-12-28 04:39:27,376][106225] Updated weights for policy 1, policy_version 1311060 (0.0008) [2023-12-28 04:39:27,977][106225] Updated weights for policy 1, policy_version 1311071 (0.0008) [2023-12-28 04:39:28,024][106225] Updated weights for policy 1, policy_version 1311081 (0.0007) [2023-12-28 04:39:28,077][106225] Updated weights for policy 1, policy_version 1311091 (0.0007) [2023-12-28 04:39:28,079][106226] Updated weights for policy 0, policy_version 1307772 (0.0007) [2023-12-28 04:39:28,134][106226] Updated weights for policy 0, policy_version 1307782 (0.0008) [2023-12-28 04:39:28,182][106226] Updated weights for policy 0, policy_version 1307792 (0.0008) [2023-12-28 04:39:28,721][106225] Updated weights for policy 1, policy_version 1311101 (0.0007) [2023-12-28 04:39:28,785][106225] Updated weights for policy 1, policy_version 1311111 (0.0010) [2023-12-28 04:39:28,845][106225] Updated weights for policy 1, policy_version 1311121 (0.0010) [2023-12-28 04:39:28,969][106226] Updated weights for policy 0, policy_version 1307802 (0.0008) [2023-12-28 04:39:29,022][106226] Updated weights for policy 0, policy_version 1307812 (0.0007) [2023-12-28 04:39:29,071][106226] Updated weights for policy 0, policy_version 1307822 (0.0008) [2023-12-28 04:39:29,114][106226] Updated weights for policy 0, policy_version 1307832 (0.0007) [2023-12-28 04:39:29,474][106225] Updated weights for policy 1, policy_version 1311131 (0.0009) [2023-12-28 04:39:29,525][106225] Updated weights for policy 1, policy_version 1311141 (0.0005) [2023-12-28 04:39:29,585][106225] Updated weights for policy 1, policy_version 1311151 (0.0007) [2023-12-28 04:39:29,974][106226] Updated weights for policy 0, policy_version 1307842 (0.0008) [2023-12-28 04:39:30,036][106226] Updated weights for policy 0, policy_version 1307852 (0.0009) [2023-12-28 04:39:30,102][106226] Updated weights for policy 0, policy_version 1307862 (0.0009) [2023-12-28 04:39:30,233][106225] Updated weights for policy 1, policy_version 1311161 (0.0010) [2023-12-28 04:39:30,289][106225] Updated weights for policy 1, policy_version 1311171 (0.0009) [2023-12-28 04:39:30,344][106225] Updated weights for policy 1, policy_version 1311181 (0.0008) [2023-12-28 04:39:30,406][106225] Updated weights for policy 1, policy_version 1311191 (0.0008) [2023-12-28 04:39:30,826][106226] Updated weights for policy 0, policy_version 1307872 (0.0008) [2023-12-28 04:39:30,878][106226] Updated weights for policy 0, policy_version 1307882 (0.0008) [2023-12-28 04:39:30,932][106226] Updated weights for policy 0, policy_version 1307892 (0.0008) [2023-12-28 04:39:31,116][106225] Updated weights for policy 1, policy_version 1311201 (0.0008) [2023-12-28 04:39:31,172][106225] Updated weights for policy 1, policy_version 1311211 (0.0009) [2023-12-28 04:39:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 670597120. Throughput: 0: 9888.8, 1: 9917.1. Samples: 670588204. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:31,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-5.041')] [2023-12-28 04:39:31,238][106225] Updated weights for policy 1, policy_version 1311221 (0.0007) [2023-12-28 04:39:31,736][106226] Updated weights for policy 0, policy_version 1307902 (0.0008) [2023-12-28 04:39:31,784][106226] Updated weights for policy 0, policy_version 1307912 (0.0008) [2023-12-28 04:39:31,849][106226] Updated weights for policy 0, policy_version 1307922 (0.0008) [2023-12-28 04:39:31,926][106225] Updated weights for policy 1, policy_version 1311231 (0.0007) [2023-12-28 04:39:31,993][106225] Updated weights for policy 1, policy_version 1311241 (0.0008) [2023-12-28 04:39:32,048][106225] Updated weights for policy 1, policy_version 1311251 (0.0007) [2023-12-28 04:39:32,592][106226] Updated weights for policy 0, policy_version 1307932 (0.0009) [2023-12-28 04:39:32,658][106226] Updated weights for policy 0, policy_version 1307942 (0.0009) [2023-12-28 04:39:32,719][106225] Updated weights for policy 1, policy_version 1311261 (0.0008) [2023-12-28 04:39:32,726][106226] Updated weights for policy 0, policy_version 1307952 (0.0008) [2023-12-28 04:39:32,776][106225] Updated weights for policy 1, policy_version 1311271 (0.0006) [2023-12-28 04:39:32,840][106225] Updated weights for policy 1, policy_version 1311281 (0.0008) [2023-12-28 04:39:33,470][106226] Updated weights for policy 0, policy_version 1307962 (0.0008) [2023-12-28 04:39:33,519][106226] Updated weights for policy 0, policy_version 1307972 (0.0008) [2023-12-28 04:39:33,559][106225] Updated weights for policy 1, policy_version 1311291 (0.0007) [2023-12-28 04:39:33,566][106226] Updated weights for policy 0, policy_version 1307982 (0.0008) [2023-12-28 04:39:33,615][106226] Updated weights for policy 0, policy_version 1307992 (0.0007) [2023-12-28 04:39:33,617][106225] Updated weights for policy 1, policy_version 1311301 (0.0007) [2023-12-28 04:39:33,664][106225] Updated weights for policy 1, policy_version 1311311 (0.0008) [2023-12-28 04:39:34,376][106226] Updated weights for policy 0, policy_version 1308002 (0.0008) [2023-12-28 04:39:34,397][106225] Updated weights for policy 1, policy_version 1311321 (0.0008) [2023-12-28 04:39:34,439][106226] Updated weights for policy 0, policy_version 1308012 (0.0007) [2023-12-28 04:39:34,456][106225] Updated weights for policy 1, policy_version 1311331 (0.0008) [2023-12-28 04:39:34,506][106226] Updated weights for policy 0, policy_version 1308022 (0.0007) [2023-12-28 04:39:34,516][106225] Updated weights for policy 1, policy_version 1311341 (0.0006) [2023-12-28 04:39:34,578][106225] Updated weights for policy 1, policy_version 1311351 (0.0008) [2023-12-28 04:39:35,217][106226] Updated weights for policy 0, policy_version 1308032 (0.0008) [2023-12-28 04:39:35,270][106226] Updated weights for policy 0, policy_version 1308042 (0.0007) [2023-12-28 04:39:35,279][106225] Updated weights for policy 1, policy_version 1311361 (0.0007) [2023-12-28 04:39:35,324][106226] Updated weights for policy 0, policy_version 1308052 (0.0005) [2023-12-28 04:39:35,334][106225] Updated weights for policy 1, policy_version 1311371 (0.0006) [2023-12-28 04:39:35,385][106225] Updated weights for policy 1, policy_version 1311381 (0.0006) [2023-12-28 04:39:36,038][106225] Updated weights for policy 1, policy_version 1311391 (0.0005) [2023-12-28 04:39:36,047][106226] Updated weights for policy 0, policy_version 1308062 (0.0008) [2023-12-28 04:39:36,092][106225] Updated weights for policy 1, policy_version 1311401 (0.0005) [2023-12-28 04:39:36,102][106226] Updated weights for policy 0, policy_version 1308072 (0.0008) [2023-12-28 04:39:36,152][106225] Updated weights for policy 1, policy_version 1311411 (0.0008) [2023-12-28 04:39:36,167][106226] Updated weights for policy 0, policy_version 1308082 (0.0008) [2023-12-28 04:39:36,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 670687232. Throughput: 0: 9790.5, 1: 9907.9. Samples: 670704152. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:36,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-5.074')] [2023-12-28 04:39:36,785][106225] Updated weights for policy 1, policy_version 1311421 (0.0007) [2023-12-28 04:39:36,842][106225] Updated weights for policy 1, policy_version 1311431 (0.0007) [2023-12-28 04:39:36,899][106225] Updated weights for policy 1, policy_version 1311441 (0.0007) [2023-12-28 04:39:36,945][106226] Updated weights for policy 0, policy_version 1308092 (0.0007) [2023-12-28 04:39:37,003][106226] Updated weights for policy 0, policy_version 1308102 (0.0006) [2023-12-28 04:39:37,065][106226] Updated weights for policy 0, policy_version 1308112 (0.0008) [2023-12-28 04:39:37,563][106225] Updated weights for policy 1, policy_version 1311451 (0.0009) [2023-12-28 04:39:37,613][106225] Updated weights for policy 1, policy_version 1311461 (0.0008) [2023-12-28 04:39:37,672][106225] Updated weights for policy 1, policy_version 1311471 (0.0008) [2023-12-28 04:39:37,801][106226] Updated weights for policy 0, policy_version 1308122 (0.0008) [2023-12-28 04:39:37,858][106226] Updated weights for policy 0, policy_version 1308132 (0.0008) [2023-12-28 04:39:37,923][106226] Updated weights for policy 0, policy_version 1308142 (0.0009) [2023-12-28 04:39:37,980][106226] Updated weights for policy 0, policy_version 1308152 (0.0008) [2023-12-28 04:39:38,238][106225] Updated weights for policy 1, policy_version 1311481 (0.0009) [2023-12-28 04:39:38,293][106225] Updated weights for policy 1, policy_version 1311491 (0.0005) [2023-12-28 04:39:38,368][106225] Updated weights for policy 1, policy_version 1311501 (0.0007) [2023-12-28 04:39:38,428][106225] Updated weights for policy 1, policy_version 1311511 (0.0006) [2023-12-28 04:39:38,801][106226] Updated weights for policy 0, policy_version 1308162 (0.0008) [2023-12-28 04:39:38,867][106226] Updated weights for policy 0, policy_version 1308172 (0.0009) [2023-12-28 04:39:38,934][106226] Updated weights for policy 0, policy_version 1308182 (0.0009) [2023-12-28 04:39:39,049][106225] Updated weights for policy 1, policy_version 1311521 (0.0005) [2023-12-28 04:39:39,098][106225] Updated weights for policy 1, policy_version 1311531 (0.0005) [2023-12-28 04:39:39,145][106225] Updated weights for policy 1, policy_version 1311541 (0.0005) [2023-12-28 04:39:39,774][106226] Updated weights for policy 0, policy_version 1308192 (0.0007) [2023-12-28 04:39:39,821][106225] Updated weights for policy 1, policy_version 1311551 (0.0009) [2023-12-28 04:39:39,836][106226] Updated weights for policy 0, policy_version 1308202 (0.0007) [2023-12-28 04:39:39,885][106225] Updated weights for policy 1, policy_version 1311561 (0.0009) [2023-12-28 04:39:39,894][106226] Updated weights for policy 0, policy_version 1308212 (0.0008) [2023-12-28 04:39:39,947][106225] Updated weights for policy 1, policy_version 1311571 (0.0008) [2023-12-28 04:39:40,642][106226] Updated weights for policy 0, policy_version 1308222 (0.0008) [2023-12-28 04:39:40,695][106225] Updated weights for policy 1, policy_version 1311581 (0.0009) [2023-12-28 04:39:40,697][106226] Updated weights for policy 0, policy_version 1308232 (0.0007) [2023-12-28 04:39:40,747][106225] Updated weights for policy 1, policy_version 1311591 (0.0006) [2023-12-28 04:39:40,753][106226] Updated weights for policy 0, policy_version 1308242 (0.0006) [2023-12-28 04:39:40,800][106225] Updated weights for policy 1, policy_version 1311601 (0.0007) [2023-12-28 04:39:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 670793728. Throughput: 0: 9695.5, 1: 9988.1. Samples: 670763500. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:41,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-5.095')] [2023-12-28 04:39:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001311608_335822848.pth... [2023-12-28 04:39:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001308248_334970880.pth... [2023-12-28 04:39:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001310456_335527936.pth [2023-12-28 04:39:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001307128_334684160.pth [2023-12-28 04:39:41,489][106226] Updated weights for policy 0, policy_version 1308252 (0.0007) [2023-12-28 04:39:41,541][106226] Updated weights for policy 0, policy_version 1308262 (0.0008) [2023-12-28 04:39:41,600][106226] Updated weights for policy 0, policy_version 1308272 (0.0008) [2023-12-28 04:39:41,608][106225] Updated weights for policy 1, policy_version 1311611 (0.0008) [2023-12-28 04:39:41,683][106225] Updated weights for policy 1, policy_version 1311621 (0.0007) [2023-12-28 04:39:41,756][106225] Updated weights for policy 1, policy_version 1311631 (0.0009) [2023-12-28 04:39:42,380][106226] Updated weights for policy 0, policy_version 1308282 (0.0009) [2023-12-28 04:39:42,444][106226] Updated weights for policy 0, policy_version 1308292 (0.0009) [2023-12-28 04:39:42,448][106225] Updated weights for policy 1, policy_version 1311641 (0.0008) [2023-12-28 04:39:42,500][106226] Updated weights for policy 0, policy_version 1308302 (0.0006) [2023-12-28 04:39:42,501][106225] Updated weights for policy 1, policy_version 1311651 (0.0008) [2023-12-28 04:39:42,555][106226] Updated weights for policy 0, policy_version 1308312 (0.0006) [2023-12-28 04:39:42,561][106225] Updated weights for policy 1, policy_version 1311661 (0.0006) [2023-12-28 04:39:42,618][106225] Updated weights for policy 1, policy_version 1311671 (0.0009) [2023-12-28 04:39:43,299][106225] Updated weights for policy 1, policy_version 1311681 (0.0009) [2023-12-28 04:39:43,326][106226] Updated weights for policy 0, policy_version 1308322 (0.0010) [2023-12-28 04:39:43,359][106225] Updated weights for policy 1, policy_version 1311691 (0.0008) [2023-12-28 04:39:43,386][106226] Updated weights for policy 0, policy_version 1308332 (0.0007) [2023-12-28 04:39:43,420][106225] Updated weights for policy 1, policy_version 1311701 (0.0009) [2023-12-28 04:39:43,447][106226] Updated weights for policy 0, policy_version 1308342 (0.0008) [2023-12-28 04:39:44,125][106226] Updated weights for policy 0, policy_version 1308352 (0.0007) [2023-12-28 04:39:44,161][106225] Updated weights for policy 1, policy_version 1311711 (0.0007) [2023-12-28 04:39:44,181][106226] Updated weights for policy 0, policy_version 1308362 (0.0007) [2023-12-28 04:39:44,214][106225] Updated weights for policy 1, policy_version 1311721 (0.0008) [2023-12-28 04:39:44,243][106226] Updated weights for policy 0, policy_version 1308372 (0.0006) [2023-12-28 04:39:44,271][106225] Updated weights for policy 1, policy_version 1311731 (0.0008) [2023-12-28 04:39:44,808][106226] Updated weights for policy 0, policy_version 1308382 (0.0010) [2023-12-28 04:39:44,862][106226] Updated weights for policy 0, policy_version 1308392 (0.0011) [2023-12-28 04:39:44,924][106226] Updated weights for policy 0, policy_version 1308402 (0.0011) [2023-12-28 04:39:45,078][106225] Updated weights for policy 1, policy_version 1311741 (0.0010) [2023-12-28 04:39:45,140][106225] Updated weights for policy 1, policy_version 1311751 (0.0008) [2023-12-28 04:39:45,206][106225] Updated weights for policy 1, policy_version 1311761 (0.0008) [2023-12-28 04:39:45,632][106226] Updated weights for policy 0, policy_version 1308412 (0.0011) [2023-12-28 04:39:45,682][106226] Updated weights for policy 0, policy_version 1308422 (0.0011) [2023-12-28 04:39:45,732][106226] Updated weights for policy 0, policy_version 1308432 (0.0010) [2023-12-28 04:39:45,897][106225] Updated weights for policy 1, policy_version 1311771 (0.0009) [2023-12-28 04:39:45,950][106225] Updated weights for policy 1, policy_version 1311781 (0.0006) [2023-12-28 04:39:46,011][106225] Updated weights for policy 1, policy_version 1311791 (0.0005) [2023-12-28 04:39:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 670892032. Throughput: 0: 9640.2, 1: 9886.4. Samples: 670878148. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:46,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-5.148')] [2023-12-28 04:39:46,394][106226] Updated weights for policy 0, policy_version 1308442 (0.0009) [2023-12-28 04:39:46,459][106226] Updated weights for policy 0, policy_version 1308452 (0.0006) [2023-12-28 04:39:46,517][106226] Updated weights for policy 0, policy_version 1308462 (0.0006) [2023-12-28 04:39:46,574][106226] Updated weights for policy 0, policy_version 1308472 (0.0005) [2023-12-28 04:39:46,784][106225] Updated weights for policy 1, policy_version 1311801 (0.0008) [2023-12-28 04:39:46,842][106225] Updated weights for policy 1, policy_version 1311811 (0.0010) [2023-12-28 04:39:46,896][106225] Updated weights for policy 1, policy_version 1311821 (0.0010) [2023-12-28 04:39:46,954][106225] Updated weights for policy 1, policy_version 1311831 (0.0010) [2023-12-28 04:39:47,079][106226] Updated weights for policy 0, policy_version 1308482 (0.0006) [2023-12-28 04:39:47,136][106226] Updated weights for policy 0, policy_version 1308492 (0.0010) [2023-12-28 04:39:47,193][106226] Updated weights for policy 0, policy_version 1308502 (0.0010) [2023-12-28 04:39:47,564][106225] Updated weights for policy 1, policy_version 1311841 (0.0010) [2023-12-28 04:39:47,622][106225] Updated weights for policy 1, policy_version 1311851 (0.0010) [2023-12-28 04:39:47,672][106225] Updated weights for policy 1, policy_version 1311861 (0.0010) [2023-12-28 04:39:47,863][106226] Updated weights for policy 0, policy_version 1308512 (0.0008) [2023-12-28 04:39:47,926][106226] Updated weights for policy 0, policy_version 1308522 (0.0010) [2023-12-28 04:39:47,987][106226] Updated weights for policy 0, policy_version 1308532 (0.0011) [2023-12-28 04:39:48,426][106225] Updated weights for policy 1, policy_version 1311871 (0.0009) [2023-12-28 04:39:48,491][106225] Updated weights for policy 1, policy_version 1311881 (0.0008) [2023-12-28 04:39:48,550][106225] Updated weights for policy 1, policy_version 1311891 (0.0007) [2023-12-28 04:39:48,649][106226] Updated weights for policy 0, policy_version 1308542 (0.0011) [2023-12-28 04:39:48,712][106226] Updated weights for policy 0, policy_version 1308552 (0.0011) [2023-12-28 04:39:48,770][106226] Updated weights for policy 0, policy_version 1308562 (0.0011) [2023-12-28 04:39:49,262][106225] Updated weights for policy 1, policy_version 1311901 (0.0008) [2023-12-28 04:39:49,325][106225] Updated weights for policy 1, policy_version 1311911 (0.0007) [2023-12-28 04:39:49,387][106225] Updated weights for policy 1, policy_version 1311921 (0.0008) [2023-12-28 04:39:49,461][106226] Updated weights for policy 0, policy_version 1308572 (0.0011) [2023-12-28 04:39:49,530][106226] Updated weights for policy 0, policy_version 1308582 (0.0010) [2023-12-28 04:39:49,594][106226] Updated weights for policy 0, policy_version 1308592 (0.0010) [2023-12-28 04:39:50,142][106225] Updated weights for policy 1, policy_version 1311931 (0.0008) [2023-12-28 04:39:50,211][106225] Updated weights for policy 1, policy_version 1311941 (0.0008) [2023-12-28 04:39:50,271][106225] Updated weights for policy 1, policy_version 1311951 (0.0008) [2023-12-28 04:39:50,309][106226] Updated weights for policy 0, policy_version 1308602 (0.0006) [2023-12-28 04:39:50,366][106226] Updated weights for policy 0, policy_version 1308612 (0.0007) [2023-12-28 04:39:50,415][106226] Updated weights for policy 0, policy_version 1308622 (0.0005) [2023-12-28 04:39:50,477][106226] Updated weights for policy 0, policy_version 1308632 (0.0007) [2023-12-28 04:39:51,018][106225] Updated weights for policy 1, policy_version 1311961 (0.0007) [2023-12-28 04:39:51,085][106225] Updated weights for policy 1, policy_version 1311971 (0.0009) [2023-12-28 04:39:51,152][106225] Updated weights for policy 1, policy_version 1311981 (0.0008) [2023-12-28 04:39:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 670982144. Throughput: 0: 9632.5, 1: 9829.8. Samples: 670998544. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:51,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.592')] [2023-12-28 04:39:51,195][106226] Updated weights for policy 0, policy_version 1308642 (0.0009) [2023-12-28 04:39:51,209][106225] Updated weights for policy 1, policy_version 1311991 (0.0006) [2023-12-28 04:39:51,259][106226] Updated weights for policy 0, policy_version 1308652 (0.0009) [2023-12-28 04:39:51,328][106226] Updated weights for policy 0, policy_version 1308662 (0.0006) [2023-12-28 04:39:51,902][106225] Updated weights for policy 1, policy_version 1312001 (0.0008) [2023-12-28 04:39:51,959][106225] Updated weights for policy 1, policy_version 1312011 (0.0009) [2023-12-28 04:39:52,007][106225] Updated weights for policy 1, policy_version 1312021 (0.0008) [2023-12-28 04:39:52,064][106226] Updated weights for policy 0, policy_version 1308672 (0.0006) [2023-12-28 04:39:52,123][106226] Updated weights for policy 0, policy_version 1308682 (0.0007) [2023-12-28 04:39:52,179][106226] Updated weights for policy 0, policy_version 1308692 (0.0009) [2023-12-28 04:39:52,807][106225] Updated weights for policy 1, policy_version 1312031 (0.0008) [2023-12-28 04:39:52,833][106226] Updated weights for policy 0, policy_version 1308702 (0.0008) [2023-12-28 04:39:52,859][106225] Updated weights for policy 1, policy_version 1312041 (0.0005) [2023-12-28 04:39:52,892][106226] Updated weights for policy 0, policy_version 1308712 (0.0007) [2023-12-28 04:39:52,910][106225] Updated weights for policy 1, policy_version 1312051 (0.0005) [2023-12-28 04:39:52,946][106226] Updated weights for policy 0, policy_version 1308722 (0.0008) [2023-12-28 04:39:53,561][106226] Updated weights for policy 0, policy_version 1308732 (0.0007) [2023-12-28 04:39:53,570][106225] Updated weights for policy 1, policy_version 1312061 (0.0006) [2023-12-28 04:39:53,624][106225] Updated weights for policy 1, policy_version 1312071 (0.0007) [2023-12-28 04:39:53,626][106226] Updated weights for policy 0, policy_version 1308742 (0.0005) [2023-12-28 04:39:53,674][106225] Updated weights for policy 1, policy_version 1312081 (0.0006) [2023-12-28 04:39:53,680][106226] Updated weights for policy 0, policy_version 1308752 (0.0007) [2023-12-28 04:39:54,333][106225] Updated weights for policy 1, policy_version 1312091 (0.0006) [2023-12-28 04:39:54,354][106226] Updated weights for policy 0, policy_version 1308762 (0.0008) [2023-12-28 04:39:54,390][106225] Updated weights for policy 1, policy_version 1312101 (0.0007) [2023-12-28 04:39:54,413][106226] Updated weights for policy 0, policy_version 1308772 (0.0008) [2023-12-28 04:39:54,450][106225] Updated weights for policy 1, policy_version 1312111 (0.0008) [2023-12-28 04:39:54,475][106226] Updated weights for policy 0, policy_version 1308782 (0.0007) [2023-12-28 04:39:54,537][106226] Updated weights for policy 0, policy_version 1308792 (0.0005) [2023-12-28 04:39:55,130][106225] Updated weights for policy 1, policy_version 1312121 (0.0007) [2023-12-28 04:39:55,186][106225] Updated weights for policy 1, policy_version 1312131 (0.0007) [2023-12-28 04:39:55,224][106226] Updated weights for policy 0, policy_version 1308802 (0.0006) [2023-12-28 04:39:55,243][106225] Updated weights for policy 1, policy_version 1312141 (0.0007) [2023-12-28 04:39:55,286][106226] Updated weights for policy 0, policy_version 1308812 (0.0005) [2023-12-28 04:39:55,304][106225] Updated weights for policy 1, policy_version 1312151 (0.0008) [2023-12-28 04:39:55,351][106226] Updated weights for policy 0, policy_version 1308822 (0.0006) [2023-12-28 04:39:55,892][106225] Updated weights for policy 1, policy_version 1312161 (0.0006) [2023-12-28 04:39:55,951][106225] Updated weights for policy 1, policy_version 1312171 (0.0006) [2023-12-28 04:39:56,007][106225] Updated weights for policy 1, policy_version 1312181 (0.0005) [2023-12-28 04:39:56,052][106226] Updated weights for policy 0, policy_version 1308832 (0.0008) [2023-12-28 04:39:56,105][106226] Updated weights for policy 0, policy_version 1308842 (0.0007) [2023-12-28 04:39:56,159][106226] Updated weights for policy 0, policy_version 1308852 (0.0008) [2023-12-28 04:39:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 671088640. Throughput: 0: 9641.5, 1: 9847.7. Samples: 671058236. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:39:56,175][105115] Avg episode reward: [(0, '-4.611'), (1, '-5.090')] [2023-12-28 04:39:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001312184_335970304.pth... [2023-12-28 04:39:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001308856_335126528.pth... [2023-12-28 04:39:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001311000_335667200.pth [2023-12-28 04:39:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001307704_334831616.pth [2023-12-28 04:39:56,625][106225] Updated weights for policy 1, policy_version 1312191 (0.0006) [2023-12-28 04:39:56,680][106225] Updated weights for policy 1, policy_version 1312201 (0.0006) [2023-12-28 04:39:56,736][106225] Updated weights for policy 1, policy_version 1312211 (0.0008) [2023-12-28 04:39:56,910][106226] Updated weights for policy 0, policy_version 1308862 (0.0008) [2023-12-28 04:39:56,972][106226] Updated weights for policy 0, policy_version 1308872 (0.0008) [2023-12-28 04:39:57,027][106226] Updated weights for policy 0, policy_version 1308882 (0.0007) [2023-12-28 04:39:57,366][106225] Updated weights for policy 1, policy_version 1312221 (0.0008) [2023-12-28 04:39:57,421][106225] Updated weights for policy 1, policy_version 1312231 (0.0005) [2023-12-28 04:39:57,479][106225] Updated weights for policy 1, policy_version 1312241 (0.0005) [2023-12-28 04:39:57,803][106226] Updated weights for policy 0, policy_version 1308892 (0.0007) [2023-12-28 04:39:57,863][106226] Updated weights for policy 0, policy_version 1308902 (0.0005) [2023-12-28 04:39:57,921][106226] Updated weights for policy 0, policy_version 1308912 (0.0005) [2023-12-28 04:39:58,077][106225] Updated weights for policy 1, policy_version 1312251 (0.0007) [2023-12-28 04:39:58,122][106225] Updated weights for policy 1, policy_version 1312261 (0.0010) [2023-12-28 04:39:58,165][106225] Updated weights for policy 1, policy_version 1312271 (0.0005) [2023-12-28 04:39:58,540][106226] Updated weights for policy 0, policy_version 1308922 (0.0006) [2023-12-28 04:39:58,603][106226] Updated weights for policy 0, policy_version 1308932 (0.0008) [2023-12-28 04:39:58,672][106226] Updated weights for policy 0, policy_version 1308942 (0.0008) [2023-12-28 04:39:58,736][106226] Updated weights for policy 0, policy_version 1308952 (0.0008) [2023-12-28 04:39:58,944][106225] Updated weights for policy 1, policy_version 1312281 (0.0006) [2023-12-28 04:39:59,004][106225] Updated weights for policy 1, policy_version 1312291 (0.0010) [2023-12-28 04:39:59,065][106225] Updated weights for policy 1, policy_version 1312301 (0.0011) [2023-12-28 04:39:59,133][106225] Updated weights for policy 1, policy_version 1312311 (0.0010) [2023-12-28 04:39:59,537][106226] Updated weights for policy 0, policy_version 1308962 (0.0010) [2023-12-28 04:39:59,594][106226] Updated weights for policy 0, policy_version 1308972 (0.0008) [2023-12-28 04:39:59,653][106226] Updated weights for policy 0, policy_version 1308982 (0.0010) [2023-12-28 04:39:59,829][106225] Updated weights for policy 1, policy_version 1312321 (0.0007) [2023-12-28 04:39:59,899][106225] Updated weights for policy 1, policy_version 1312331 (0.0011) [2023-12-28 04:39:59,967][106225] Updated weights for policy 1, policy_version 1312341 (0.0009) [2023-12-28 04:40:00,415][106226] Updated weights for policy 0, policy_version 1308992 (0.0008) [2023-12-28 04:40:00,462][106226] Updated weights for policy 0, policy_version 1309002 (0.0008) [2023-12-28 04:40:00,510][106226] Updated weights for policy 0, policy_version 1309012 (0.0007) [2023-12-28 04:40:00,651][106225] Updated weights for policy 1, policy_version 1312351 (0.0009) [2023-12-28 04:40:00,710][106225] Updated weights for policy 1, policy_version 1312361 (0.0009) [2023-12-28 04:40:00,772][106225] Updated weights for policy 1, policy_version 1312371 (0.0005) [2023-12-28 04:40:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 671186944. Throughput: 0: 9651.2, 1: 9939.2. Samples: 671177928. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:01,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.821')] [2023-12-28 04:40:01,366][106226] Updated weights for policy 0, policy_version 1309022 (0.0008) [2023-12-28 04:40:01,401][106225] Updated weights for policy 1, policy_version 1312381 (0.0007) [2023-12-28 04:40:01,435][106226] Updated weights for policy 0, policy_version 1309032 (0.0008) [2023-12-28 04:40:01,473][106225] Updated weights for policy 1, policy_version 1312391 (0.0007) [2023-12-28 04:40:01,491][106226] Updated weights for policy 0, policy_version 1309042 (0.0008) [2023-12-28 04:40:01,532][106225] Updated weights for policy 1, policy_version 1312401 (0.0007) [2023-12-28 04:40:02,219][106225] Updated weights for policy 1, policy_version 1312411 (0.0007) [2023-12-28 04:40:02,270][106226] Updated weights for policy 0, policy_version 1309052 (0.0008) [2023-12-28 04:40:02,281][106225] Updated weights for policy 1, policy_version 1312421 (0.0008) [2023-12-28 04:40:02,328][106226] Updated weights for policy 0, policy_version 1309062 (0.0006) [2023-12-28 04:40:02,341][106225] Updated weights for policy 1, policy_version 1312431 (0.0008) [2023-12-28 04:40:02,391][106226] Updated weights for policy 0, policy_version 1309072 (0.0008) [2023-12-28 04:40:03,036][106226] Updated weights for policy 0, policy_version 1309082 (0.0006) [2023-12-28 04:40:03,093][106226] Updated weights for policy 0, policy_version 1309092 (0.0007) [2023-12-28 04:40:03,096][106225] Updated weights for policy 1, policy_version 1312441 (0.0007) [2023-12-28 04:40:03,152][106226] Updated weights for policy 0, policy_version 1309102 (0.0008) [2023-12-28 04:40:03,155][106225] Updated weights for policy 1, policy_version 1312451 (0.0005) [2023-12-28 04:40:03,201][106225] Updated weights for policy 1, policy_version 1312461 (0.0005) [2023-12-28 04:40:03,211][106226] Updated weights for policy 0, policy_version 1309112 (0.0008) [2023-12-28 04:40:03,248][106225] Updated weights for policy 1, policy_version 1312471 (0.0005) [2023-12-28 04:40:03,793][106225] Updated weights for policy 1, policy_version 1312481 (0.0006) [2023-12-28 04:40:03,848][106225] Updated weights for policy 1, policy_version 1312491 (0.0008) [2023-12-28 04:40:03,912][106225] Updated weights for policy 1, policy_version 1312501 (0.0008) [2023-12-28 04:40:03,990][106226] Updated weights for policy 0, policy_version 1309122 (0.0008) [2023-12-28 04:40:04,055][106226] Updated weights for policy 0, policy_version 1309132 (0.0008) [2023-12-28 04:40:04,123][106226] Updated weights for policy 0, policy_version 1309142 (0.0009) [2023-12-28 04:40:04,658][106225] Updated weights for policy 1, policy_version 1312511 (0.0009) [2023-12-28 04:40:04,718][106225] Updated weights for policy 1, policy_version 1312521 (0.0009) [2023-12-28 04:40:04,769][106225] Updated weights for policy 1, policy_version 1312531 (0.0008) [2023-12-28 04:40:04,800][106226] Updated weights for policy 0, policy_version 1309152 (0.0007) [2023-12-28 04:40:04,857][106226] Updated weights for policy 0, policy_version 1309162 (0.0009) [2023-12-28 04:40:04,910][106226] Updated weights for policy 0, policy_version 1309172 (0.0010) [2023-12-28 04:40:05,392][106225] Updated weights for policy 1, policy_version 1312541 (0.0008) [2023-12-28 04:40:05,454][106225] Updated weights for policy 1, policy_version 1312551 (0.0006) [2023-12-28 04:40:05,517][106225] Updated weights for policy 1, policy_version 1312561 (0.0007) [2023-12-28 04:40:05,575][106226] Updated weights for policy 0, policy_version 1309182 (0.0007) [2023-12-28 04:40:05,630][106226] Updated weights for policy 0, policy_version 1309192 (0.0005) [2023-12-28 04:40:05,682][106226] Updated weights for policy 0, policy_version 1309202 (0.0009) [2023-12-28 04:40:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 671285248. Throughput: 0: 9689.7, 1: 10001.9. Samples: 671297992. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:06,175][105115] Avg episode reward: [(0, '-4.236'), (1, '-4.837')] [2023-12-28 04:40:06,189][106225] Updated weights for policy 1, policy_version 1312571 (0.0009) [2023-12-28 04:40:06,245][106225] Updated weights for policy 1, policy_version 1312581 (0.0006) [2023-12-28 04:40:06,295][106225] Updated weights for policy 1, policy_version 1312591 (0.0006) [2023-12-28 04:40:06,337][106226] Updated weights for policy 0, policy_version 1309212 (0.0011) [2023-12-28 04:40:06,394][106226] Updated weights for policy 0, policy_version 1309222 (0.0009) [2023-12-28 04:40:06,462][106226] Updated weights for policy 0, policy_version 1309232 (0.0010) [2023-12-28 04:40:06,914][106225] Updated weights for policy 1, policy_version 1312601 (0.0008) [2023-12-28 04:40:06,994][106225] Updated weights for policy 1, policy_version 1312611 (0.0007) [2023-12-28 04:40:07,058][106225] Updated weights for policy 1, policy_version 1312621 (0.0007) [2023-12-28 04:40:07,123][106225] Updated weights for policy 1, policy_version 1312631 (0.0006) [2023-12-28 04:40:07,309][106226] Updated weights for policy 0, policy_version 1309242 (0.0009) [2023-12-28 04:40:07,367][106226] Updated weights for policy 0, policy_version 1309252 (0.0009) [2023-12-28 04:40:07,438][106226] Updated weights for policy 0, policy_version 1309262 (0.0009) [2023-12-28 04:40:07,507][106226] Updated weights for policy 0, policy_version 1309272 (0.0009) [2023-12-28 04:40:07,689][106225] Updated weights for policy 1, policy_version 1312641 (0.0007) [2023-12-28 04:40:07,749][106225] Updated weights for policy 1, policy_version 1312651 (0.0006) [2023-12-28 04:40:07,804][106225] Updated weights for policy 1, policy_version 1312661 (0.0005) [2023-12-28 04:40:08,150][106226] Updated weights for policy 0, policy_version 1309282 (0.0010) [2023-12-28 04:40:08,197][106226] Updated weights for policy 0, policy_version 1309292 (0.0010) [2023-12-28 04:40:08,246][106226] Updated weights for policy 0, policy_version 1309302 (0.0010) [2023-12-28 04:40:08,383][106225] Updated weights for policy 1, policy_version 1312671 (0.0007) [2023-12-28 04:40:08,434][106225] Updated weights for policy 1, policy_version 1312681 (0.0007) [2023-12-28 04:40:08,487][106225] Updated weights for policy 1, policy_version 1312691 (0.0009) [2023-12-28 04:40:08,988][106226] Updated weights for policy 0, policy_version 1309312 (0.0011) [2023-12-28 04:40:09,046][106226] Updated weights for policy 0, policy_version 1309322 (0.0011) [2023-12-28 04:40:09,104][106226] Updated weights for policy 0, policy_version 1309332 (0.0010) [2023-12-28 04:40:09,265][106225] Updated weights for policy 1, policy_version 1312701 (0.0008) [2023-12-28 04:40:09,327][106225] Updated weights for policy 1, policy_version 1312711 (0.0010) [2023-12-28 04:40:09,411][106225] Updated weights for policy 1, policy_version 1312721 (0.0010) [2023-12-28 04:40:09,803][106226] Updated weights for policy 0, policy_version 1309342 (0.0008) [2023-12-28 04:40:09,876][106226] Updated weights for policy 0, policy_version 1309352 (0.0008) [2023-12-28 04:40:09,946][106226] Updated weights for policy 0, policy_version 1309362 (0.0008) [2023-12-28 04:40:10,197][106225] Updated weights for policy 1, policy_version 1312731 (0.0010) [2023-12-28 04:40:10,252][106225] Updated weights for policy 1, policy_version 1312741 (0.0009) [2023-12-28 04:40:10,312][106225] Updated weights for policy 1, policy_version 1312751 (0.0009) [2023-12-28 04:40:10,595][106226] Updated weights for policy 0, policy_version 1309372 (0.0009) [2023-12-28 04:40:10,652][106226] Updated weights for policy 0, policy_version 1309382 (0.0011) [2023-12-28 04:40:10,719][106226] Updated weights for policy 0, policy_version 1309392 (0.0011) [2023-12-28 04:40:11,128][106225] Updated weights for policy 1, policy_version 1312761 (0.0008) [2023-12-28 04:40:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 671383552. Throughput: 0: 9659.6, 1: 10104.7. Samples: 671358484. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:11,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-5.042')] [2023-12-28 04:40:11,181][106225] Updated weights for policy 1, policy_version 1312771 (0.0007) [2023-12-28 04:40:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001309400_335265792.pth... [2023-12-28 04:40:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001308248_334970880.pth [2023-12-28 04:40:11,236][106225] Updated weights for policy 1, policy_version 1312781 (0.0008) [2023-12-28 04:40:11,306][106225] Updated weights for policy 1, policy_version 1312791 (0.0008) [2023-12-28 04:40:11,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001312792_336125952.pth... [2023-12-28 04:40:11,314][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001311608_335822848.pth [2023-12-28 04:40:11,467][106226] Updated weights for policy 0, policy_version 1309402 (0.0010) [2023-12-28 04:40:11,525][106226] Updated weights for policy 0, policy_version 1309412 (0.0008) [2023-12-28 04:40:11,590][106226] Updated weights for policy 0, policy_version 1309422 (0.0009) [2023-12-28 04:40:11,657][106226] Updated weights for policy 0, policy_version 1309432 (0.0007) [2023-12-28 04:40:11,998][106225] Updated weights for policy 1, policy_version 1312801 (0.0006) [2023-12-28 04:40:12,067][106225] Updated weights for policy 1, policy_version 1312811 (0.0006) [2023-12-28 04:40:12,134][106225] Updated weights for policy 1, policy_version 1312821 (0.0006) [2023-12-28 04:40:12,456][106226] Updated weights for policy 0, policy_version 1309442 (0.0006) [2023-12-28 04:40:12,528][106226] Updated weights for policy 0, policy_version 1309452 (0.0005) [2023-12-28 04:40:12,595][106226] Updated weights for policy 0, policy_version 1309462 (0.0007) [2023-12-28 04:40:12,812][106225] Updated weights for policy 1, policy_version 1312831 (0.0008) [2023-12-28 04:40:12,871][106225] Updated weights for policy 1, policy_version 1312841 (0.0008) [2023-12-28 04:40:12,917][106225] Updated weights for policy 1, policy_version 1312851 (0.0009) [2023-12-28 04:40:13,232][106226] Updated weights for policy 0, policy_version 1309472 (0.0008) [2023-12-28 04:40:13,281][106226] Updated weights for policy 0, policy_version 1309482 (0.0006) [2023-12-28 04:40:13,343][106226] Updated weights for policy 0, policy_version 1309492 (0.0008) [2023-12-28 04:40:13,645][106225] Updated weights for policy 1, policy_version 1312861 (0.0007) [2023-12-28 04:40:13,700][106225] Updated weights for policy 1, policy_version 1312871 (0.0005) [2023-12-28 04:40:13,756][106225] Updated weights for policy 1, policy_version 1312881 (0.0006) [2023-12-28 04:40:14,104][106226] Updated weights for policy 0, policy_version 1309502 (0.0009) [2023-12-28 04:40:14,174][106226] Updated weights for policy 0, policy_version 1309512 (0.0010) [2023-12-28 04:40:14,240][106226] Updated weights for policy 0, policy_version 1309522 (0.0009) [2023-12-28 04:40:14,363][106225] Updated weights for policy 1, policy_version 1312891 (0.0008) [2023-12-28 04:40:14,426][106225] Updated weights for policy 1, policy_version 1312901 (0.0008) [2023-12-28 04:40:14,492][106225] Updated weights for policy 1, policy_version 1312911 (0.0008) [2023-12-28 04:40:14,989][106226] Updated weights for policy 0, policy_version 1309532 (0.0009) [2023-12-28 04:40:15,050][106226] Updated weights for policy 0, policy_version 1309542 (0.0008) [2023-12-28 04:40:15,111][106226] Updated weights for policy 0, policy_version 1309552 (0.0008) [2023-12-28 04:40:15,249][106225] Updated weights for policy 1, policy_version 1312921 (0.0008) [2023-12-28 04:40:15,308][106225] Updated weights for policy 1, policy_version 1312931 (0.0009) [2023-12-28 04:40:15,362][106225] Updated weights for policy 1, policy_version 1312941 (0.0010) [2023-12-28 04:40:15,413][106225] Updated weights for policy 1, policy_version 1312951 (0.0010) [2023-12-28 04:40:15,863][106226] Updated weights for policy 0, policy_version 1309562 (0.0009) [2023-12-28 04:40:15,920][106226] Updated weights for policy 0, policy_version 1309572 (0.0009) [2023-12-28 04:40:15,976][106226] Updated weights for policy 0, policy_version 1309582 (0.0010) [2023-12-28 04:40:16,037][106226] Updated weights for policy 0, policy_version 1309592 (0.0010) [2023-12-28 04:40:16,146][106225] Updated weights for policy 1, policy_version 1312961 (0.0006) [2023-12-28 04:40:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 671481856. Throughput: 0: 9643.8, 1: 10016.0. Samples: 671472896. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:16,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.760')] [2023-12-28 04:40:16,200][106225] Updated weights for policy 1, policy_version 1312971 (0.0005) [2023-12-28 04:40:16,254][106225] Updated weights for policy 1, policy_version 1312981 (0.0005) [2023-12-28 04:40:16,705][106226] Updated weights for policy 0, policy_version 1309602 (0.0008) [2023-12-28 04:40:16,767][106226] Updated weights for policy 0, policy_version 1309612 (0.0007) [2023-12-28 04:40:16,833][106226] Updated weights for policy 0, policy_version 1309622 (0.0009) [2023-12-28 04:40:16,852][106225] Updated weights for policy 1, policy_version 1312991 (0.0007) [2023-12-28 04:40:16,910][106225] Updated weights for policy 1, policy_version 1313001 (0.0008) [2023-12-28 04:40:16,970][106225] Updated weights for policy 1, policy_version 1313011 (0.0007) [2023-12-28 04:40:17,527][106226] Updated weights for policy 0, policy_version 1309632 (0.0011) [2023-12-28 04:40:17,585][106226] Updated weights for policy 0, policy_version 1309642 (0.0010) [2023-12-28 04:40:17,639][106226] Updated weights for policy 0, policy_version 1309652 (0.0011) [2023-12-28 04:40:17,645][106225] Updated weights for policy 1, policy_version 1313021 (0.0006) [2023-12-28 04:40:17,699][106225] Updated weights for policy 1, policy_version 1313031 (0.0007) [2023-12-28 04:40:17,748][106225] Updated weights for policy 1, policy_version 1313041 (0.0009) [2023-12-28 04:40:18,364][106226] Updated weights for policy 0, policy_version 1309662 (0.0009) [2023-12-28 04:40:18,416][106225] Updated weights for policy 1, policy_version 1313051 (0.0007) [2023-12-28 04:40:18,422][106226] Updated weights for policy 0, policy_version 1309672 (0.0008) [2023-12-28 04:40:18,475][106225] Updated weights for policy 1, policy_version 1313061 (0.0006) [2023-12-28 04:40:18,477][106226] Updated weights for policy 0, policy_version 1309682 (0.0010) [2023-12-28 04:40:18,531][106225] Updated weights for policy 1, policy_version 1313071 (0.0006) [2023-12-28 04:40:19,218][106226] Updated weights for policy 0, policy_version 1309692 (0.0010) [2023-12-28 04:40:19,280][106225] Updated weights for policy 1, policy_version 1313081 (0.0008) [2023-12-28 04:40:19,284][106226] Updated weights for policy 0, policy_version 1309702 (0.0010) [2023-12-28 04:40:19,341][106225] Updated weights for policy 1, policy_version 1313091 (0.0008) [2023-12-28 04:40:19,348][106226] Updated weights for policy 0, policy_version 1309712 (0.0009) [2023-12-28 04:40:19,392][106225] Updated weights for policy 1, policy_version 1313101 (0.0007) [2023-12-28 04:40:19,442][106225] Updated weights for policy 1, policy_version 1313111 (0.0009) [2023-12-28 04:40:20,070][106226] Updated weights for policy 0, policy_version 1309722 (0.0007) [2023-12-28 04:40:20,130][106226] Updated weights for policy 0, policy_version 1309732 (0.0009) [2023-12-28 04:40:20,195][106226] Updated weights for policy 0, policy_version 1309742 (0.0009) [2023-12-28 04:40:20,260][106226] Updated weights for policy 0, policy_version 1309752 (0.0006) [2023-12-28 04:40:20,266][106225] Updated weights for policy 1, policy_version 1313121 (0.0009) [2023-12-28 04:40:20,328][106225] Updated weights for policy 1, policy_version 1313131 (0.0009) [2023-12-28 04:40:20,384][106225] Updated weights for policy 1, policy_version 1313141 (0.0010) [2023-12-28 04:40:21,000][106226] Updated weights for policy 0, policy_version 1309762 (0.0007) [2023-12-28 04:40:21,080][106226] Updated weights for policy 0, policy_version 1309772 (0.0009) [2023-12-28 04:40:21,144][106226] Updated weights for policy 0, policy_version 1309782 (0.0008) [2023-12-28 04:40:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 671580160. Throughput: 0: 9673.7, 1: 9987.5. Samples: 671588908. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:21,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-5.020')] [2023-12-28 04:40:21,200][106225] Updated weights for policy 1, policy_version 1313151 (0.0009) [2023-12-28 04:40:21,264][106225] Updated weights for policy 1, policy_version 1313161 (0.0009) [2023-12-28 04:40:21,327][106225] Updated weights for policy 1, policy_version 1313171 (0.0008) [2023-12-28 04:40:21,901][106226] Updated weights for policy 0, policy_version 1309792 (0.0009) [2023-12-28 04:40:21,964][106226] Updated weights for policy 0, policy_version 1309802 (0.0008) [2023-12-28 04:40:22,016][106226] Updated weights for policy 0, policy_version 1309812 (0.0009) [2023-12-28 04:40:22,104][106225] Updated weights for policy 1, policy_version 1313181 (0.0009) [2023-12-28 04:40:22,159][106225] Updated weights for policy 1, policy_version 1313191 (0.0009) [2023-12-28 04:40:22,217][106225] Updated weights for policy 1, policy_version 1313201 (0.0008) [2023-12-28 04:40:22,732][106226] Updated weights for policy 0, policy_version 1309822 (0.0009) [2023-12-28 04:40:22,796][106226] Updated weights for policy 0, policy_version 1309832 (0.0010) [2023-12-28 04:40:22,858][106226] Updated weights for policy 0, policy_version 1309842 (0.0007) [2023-12-28 04:40:22,936][106225] Updated weights for policy 1, policy_version 1313211 (0.0007) [2023-12-28 04:40:22,988][106225] Updated weights for policy 1, policy_version 1313221 (0.0007) [2023-12-28 04:40:23,048][106225] Updated weights for policy 1, policy_version 1313231 (0.0009) [2023-12-28 04:40:23,483][106226] Updated weights for policy 0, policy_version 1309852 (0.0009) [2023-12-28 04:40:23,548][106226] Updated weights for policy 0, policy_version 1309862 (0.0005) [2023-12-28 04:40:23,617][106226] Updated weights for policy 0, policy_version 1309872 (0.0006) [2023-12-28 04:40:23,860][106225] Updated weights for policy 1, policy_version 1313241 (0.0008) [2023-12-28 04:40:23,909][106225] Updated weights for policy 1, policy_version 1313251 (0.0008) [2023-12-28 04:40:23,966][106225] Updated weights for policy 1, policy_version 1313261 (0.0009) [2023-12-28 04:40:24,021][106225] Updated weights for policy 1, policy_version 1313271 (0.0008) [2023-12-28 04:40:24,182][106226] Updated weights for policy 0, policy_version 1309882 (0.0008) [2023-12-28 04:40:24,247][106226] Updated weights for policy 0, policy_version 1309892 (0.0008) [2023-12-28 04:40:24,309][106226] Updated weights for policy 0, policy_version 1309902 (0.0009) [2023-12-28 04:40:24,376][106226] Updated weights for policy 0, policy_version 1309912 (0.0008) [2023-12-28 04:40:24,758][106225] Updated weights for policy 1, policy_version 1313281 (0.0008) [2023-12-28 04:40:24,822][106225] Updated weights for policy 1, policy_version 1313291 (0.0008) [2023-12-28 04:40:24,885][106225] Updated weights for policy 1, policy_version 1313301 (0.0008) [2023-12-28 04:40:25,082][106226] Updated weights for policy 0, policy_version 1309922 (0.0008) [2023-12-28 04:40:25,140][106226] Updated weights for policy 0, policy_version 1309932 (0.0009) [2023-12-28 04:40:25,200][106226] Updated weights for policy 0, policy_version 1309942 (0.0009) [2023-12-28 04:40:25,580][106225] Updated weights for policy 1, policy_version 1313311 (0.0009) [2023-12-28 04:40:25,641][106225] Updated weights for policy 1, policy_version 1313321 (0.0008) [2023-12-28 04:40:25,702][106225] Updated weights for policy 1, policy_version 1313331 (0.0008) [2023-12-28 04:40:25,941][106226] Updated weights for policy 0, policy_version 1309952 (0.0008) [2023-12-28 04:40:26,001][106226] Updated weights for policy 0, policy_version 1309962 (0.0010) [2023-12-28 04:40:26,073][106226] Updated weights for policy 0, policy_version 1309972 (0.0010) [2023-12-28 04:40:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 671678464. Throughput: 0: 9755.6, 1: 9870.3. Samples: 671646668. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:26,176][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.949')] [2023-12-28 04:40:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001309976_335413248.pth... [2023-12-28 04:40:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001313336_336265216.pth... [2023-12-28 04:40:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001308856_335126528.pth [2023-12-28 04:40:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001312184_335970304.pth [2023-12-28 04:40:26,327][106225] Updated weights for policy 1, policy_version 1313341 (0.0007) [2023-12-28 04:40:26,379][106225] Updated weights for policy 1, policy_version 1313351 (0.0005) [2023-12-28 04:40:26,432][106225] Updated weights for policy 1, policy_version 1313361 (0.0008) [2023-12-28 04:40:26,856][106226] Updated weights for policy 0, policy_version 1309982 (0.0008) [2023-12-28 04:40:26,916][106226] Updated weights for policy 0, policy_version 1309992 (0.0009) [2023-12-28 04:40:26,981][106226] Updated weights for policy 0, policy_version 1310002 (0.0009) [2023-12-28 04:40:27,072][106225] Updated weights for policy 1, policy_version 1313371 (0.0008) [2023-12-28 04:40:27,122][106225] Updated weights for policy 1, policy_version 1313381 (0.0008) [2023-12-28 04:40:27,174][106225] Updated weights for policy 1, policy_version 1313391 (0.0008) [2023-12-28 04:40:27,706][106226] Updated weights for policy 0, policy_version 1310012 (0.0008) [2023-12-28 04:40:27,761][106226] Updated weights for policy 0, policy_version 1310022 (0.0005) [2023-12-28 04:40:27,809][106226] Updated weights for policy 0, policy_version 1310032 (0.0005) [2023-12-28 04:40:27,850][106225] Updated weights for policy 1, policy_version 1313401 (0.0008) [2023-12-28 04:40:27,910][106225] Updated weights for policy 1, policy_version 1313411 (0.0006) [2023-12-28 04:40:27,959][106225] Updated weights for policy 1, policy_version 1313421 (0.0007) [2023-12-28 04:40:28,010][106225] Updated weights for policy 1, policy_version 1313431 (0.0007) [2023-12-28 04:40:28,402][106226] Updated weights for policy 0, policy_version 1310042 (0.0006) [2023-12-28 04:40:28,459][106226] Updated weights for policy 0, policy_version 1310052 (0.0011) [2023-12-28 04:40:28,516][106226] Updated weights for policy 0, policy_version 1310062 (0.0011) [2023-12-28 04:40:28,566][106226] Updated weights for policy 0, policy_version 1310072 (0.0011) [2023-12-28 04:40:28,651][106225] Updated weights for policy 1, policy_version 1313441 (0.0005) [2023-12-28 04:40:28,714][106225] Updated weights for policy 1, policy_version 1313451 (0.0005) [2023-12-28 04:40:28,772][106225] Updated weights for policy 1, policy_version 1313461 (0.0005) [2023-12-28 04:40:29,272][106225] Updated weights for policy 1, policy_version 1313471 (0.0007) [2023-12-28 04:40:29,331][106225] Updated weights for policy 1, policy_version 1313481 (0.0006) [2023-12-28 04:40:29,345][106226] Updated weights for policy 0, policy_version 1310082 (0.0008) [2023-12-28 04:40:29,393][106225] Updated weights for policy 1, policy_version 1313491 (0.0007) [2023-12-28 04:40:29,408][106226] Updated weights for policy 0, policy_version 1310092 (0.0007) [2023-12-28 04:40:29,475][106226] Updated weights for policy 0, policy_version 1310102 (0.0006) [2023-12-28 04:40:30,087][106226] Updated weights for policy 0, policy_version 1310112 (0.0006) [2023-12-28 04:40:30,113][106225] Updated weights for policy 1, policy_version 1313501 (0.0007) [2023-12-28 04:40:30,151][106226] Updated weights for policy 0, policy_version 1310122 (0.0007) [2023-12-28 04:40:30,175][106225] Updated weights for policy 1, policy_version 1313511 (0.0008) [2023-12-28 04:40:30,208][106226] Updated weights for policy 0, policy_version 1310132 (0.0007) [2023-12-28 04:40:30,235][106225] Updated weights for policy 1, policy_version 1313521 (0.0007) [2023-12-28 04:40:30,770][106226] Updated weights for policy 0, policy_version 1310142 (0.0008) [2023-12-28 04:40:30,835][106226] Updated weights for policy 0, policy_version 1310152 (0.0010) [2023-12-28 04:40:30,903][106225] Updated weights for policy 1, policy_version 1313531 (0.0008) [2023-12-28 04:40:30,915][106226] Updated weights for policy 0, policy_version 1310162 (0.0008) [2023-12-28 04:40:30,958][106225] Updated weights for policy 1, policy_version 1313541 (0.0009) [2023-12-28 04:40:31,008][106225] Updated weights for policy 1, policy_version 1313551 (0.0010) [2023-12-28 04:40:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 671784960. Throughput: 0: 9787.5, 1: 9987.8. Samples: 671768036. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:31,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.886')] [2023-12-28 04:40:31,698][106226] Updated weights for policy 0, policy_version 1310172 (0.0007) [2023-12-28 04:40:31,744][106225] Updated weights for policy 1, policy_version 1313561 (0.0008) [2023-12-28 04:40:31,773][106226] Updated weights for policy 0, policy_version 1310182 (0.0007) [2023-12-28 04:40:31,798][106225] Updated weights for policy 1, policy_version 1313571 (0.0008) [2023-12-28 04:40:31,838][106226] Updated weights for policy 0, policy_version 1310192 (0.0007) [2023-12-28 04:40:31,853][106225] Updated weights for policy 1, policy_version 1313581 (0.0008) [2023-12-28 04:40:31,909][106225] Updated weights for policy 1, policy_version 1313591 (0.0007) [2023-12-28 04:40:32,479][106226] Updated weights for policy 0, policy_version 1310202 (0.0006) [2023-12-28 04:40:32,544][106226] Updated weights for policy 0, policy_version 1310212 (0.0009) [2023-12-28 04:40:32,560][106225] Updated weights for policy 1, policy_version 1313601 (0.0005) [2023-12-28 04:40:32,597][106226] Updated weights for policy 0, policy_version 1310222 (0.0008) [2023-12-28 04:40:32,611][106225] Updated weights for policy 1, policy_version 1313611 (0.0006) [2023-12-28 04:40:32,649][106226] Updated weights for policy 0, policy_version 1310232 (0.0006) [2023-12-28 04:40:32,664][106225] Updated weights for policy 1, policy_version 1313621 (0.0007) [2023-12-28 04:40:33,280][106225] Updated weights for policy 1, policy_version 1313631 (0.0007) [2023-12-28 04:40:33,348][106225] Updated weights for policy 1, policy_version 1313641 (0.0005) [2023-12-28 04:40:33,403][106225] Updated weights for policy 1, policy_version 1313651 (0.0005) [2023-12-28 04:40:33,422][106226] Updated weights for policy 0, policy_version 1310242 (0.0008) [2023-12-28 04:40:33,480][106226] Updated weights for policy 0, policy_version 1310252 (0.0008) [2023-12-28 04:40:33,540][106226] Updated weights for policy 0, policy_version 1310262 (0.0008) [2023-12-28 04:40:34,065][106225] Updated weights for policy 1, policy_version 1313661 (0.0007) [2023-12-28 04:40:34,117][106225] Updated weights for policy 1, policy_version 1313671 (0.0008) [2023-12-28 04:40:34,181][106225] Updated weights for policy 1, policy_version 1313681 (0.0008) [2023-12-28 04:40:34,201][106226] Updated weights for policy 0, policy_version 1310272 (0.0008) [2023-12-28 04:40:34,266][106226] Updated weights for policy 0, policy_version 1310282 (0.0009) [2023-12-28 04:40:34,330][106226] Updated weights for policy 0, policy_version 1310292 (0.0009) [2023-12-28 04:40:34,947][106225] Updated weights for policy 1, policy_version 1313691 (0.0006) [2023-12-28 04:40:34,996][106225] Updated weights for policy 1, policy_version 1313701 (0.0008) [2023-12-28 04:40:35,028][106226] Updated weights for policy 0, policy_version 1310302 (0.0007) [2023-12-28 04:40:35,048][106225] Updated weights for policy 1, policy_version 1313711 (0.0008) [2023-12-28 04:40:35,085][106226] Updated weights for policy 0, policy_version 1310312 (0.0005) [2023-12-28 04:40:35,147][106226] Updated weights for policy 0, policy_version 1310322 (0.0008) [2023-12-28 04:40:35,733][106226] Updated weights for policy 0, policy_version 1310332 (0.0008) [2023-12-28 04:40:35,793][106226] Updated weights for policy 0, policy_version 1310342 (0.0005) [2023-12-28 04:40:35,845][106226] Updated weights for policy 0, policy_version 1310352 (0.0006) [2023-12-28 04:40:35,848][106225] Updated weights for policy 1, policy_version 1313721 (0.0008) [2023-12-28 04:40:35,909][106225] Updated weights for policy 1, policy_version 1313731 (0.0006) [2023-12-28 04:40:35,968][106225] Updated weights for policy 1, policy_version 1313741 (0.0008) [2023-12-28 04:40:36,037][106225] Updated weights for policy 1, policy_version 1313751 (0.0006) [2023-12-28 04:40:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 671883264. Throughput: 0: 9765.3, 1: 10038.2. Samples: 671889704. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:36,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.811')] [2023-12-28 04:40:36,546][106226] Updated weights for policy 0, policy_version 1310362 (0.0009) [2023-12-28 04:40:36,613][106226] Updated weights for policy 0, policy_version 1310372 (0.0011) [2023-12-28 04:40:36,675][106226] Updated weights for policy 0, policy_version 1310382 (0.0011) [2023-12-28 04:40:36,692][106225] Updated weights for policy 1, policy_version 1313761 (0.0006) [2023-12-28 04:40:36,737][106226] Updated weights for policy 0, policy_version 1310392 (0.0011) [2023-12-28 04:40:36,748][106225] Updated weights for policy 1, policy_version 1313771 (0.0006) [2023-12-28 04:40:36,810][106225] Updated weights for policy 1, policy_version 1313781 (0.0006) [2023-12-28 04:40:37,438][106225] Updated weights for policy 1, policy_version 1313791 (0.0007) [2023-12-28 04:40:37,474][106226] Updated weights for policy 0, policy_version 1310402 (0.0011) [2023-12-28 04:40:37,496][106225] Updated weights for policy 1, policy_version 1313801 (0.0006) [2023-12-28 04:40:37,532][106226] Updated weights for policy 0, policy_version 1310412 (0.0011) [2023-12-28 04:40:37,558][106225] Updated weights for policy 1, policy_version 1313811 (0.0005) [2023-12-28 04:40:37,591][106226] Updated weights for policy 0, policy_version 1310422 (0.0010) [2023-12-28 04:40:38,250][106226] Updated weights for policy 0, policy_version 1310432 (0.0006) [2023-12-28 04:40:38,311][106226] Updated weights for policy 0, policy_version 1310442 (0.0005) [2023-12-28 04:40:38,322][106225] Updated weights for policy 1, policy_version 1313821 (0.0007) [2023-12-28 04:40:38,374][106226] Updated weights for policy 0, policy_version 1310452 (0.0007) [2023-12-28 04:40:38,394][106225] Updated weights for policy 1, policy_version 1313832 (0.0012) [2023-12-28 04:40:38,454][106225] Updated weights for policy 1, policy_version 1313842 (0.0009) [2023-12-28 04:40:38,982][106226] Updated weights for policy 0, policy_version 1310462 (0.0006) [2023-12-28 04:40:39,039][106226] Updated weights for policy 0, policy_version 1310472 (0.0008) [2023-12-28 04:40:39,090][106226] Updated weights for policy 0, policy_version 1310482 (0.0008) [2023-12-28 04:40:39,243][106225] Updated weights for policy 1, policy_version 1313853 (0.0008) [2023-12-28 04:40:39,303][106225] Updated weights for policy 1, policy_version 1313863 (0.0008) [2023-12-28 04:40:39,377][106225] Updated weights for policy 1, policy_version 1313873 (0.0008) [2023-12-28 04:40:39,851][106226] Updated weights for policy 0, policy_version 1310492 (0.0008) [2023-12-28 04:40:39,917][106226] Updated weights for policy 0, policy_version 1310502 (0.0010) [2023-12-28 04:40:39,983][106226] Updated weights for policy 0, policy_version 1310512 (0.0009) [2023-12-28 04:40:40,153][106225] Updated weights for policy 1, policy_version 1313883 (0.0007) [2023-12-28 04:40:40,205][106225] Updated weights for policy 1, policy_version 1313893 (0.0005) [2023-12-28 04:40:40,261][106225] Updated weights for policy 1, policy_version 1313903 (0.0007) [2023-12-28 04:40:40,737][106226] Updated weights for policy 0, policy_version 1310522 (0.0009) [2023-12-28 04:40:40,809][106226] Updated weights for policy 0, policy_version 1310532 (0.0011) [2023-12-28 04:40:40,865][106225] Updated weights for policy 1, policy_version 1313913 (0.0008) [2023-12-28 04:40:40,871][106226] Updated weights for policy 0, policy_version 1310542 (0.0009) [2023-12-28 04:40:40,924][106225] Updated weights for policy 1, policy_version 1313923 (0.0006) [2023-12-28 04:40:40,935][106226] Updated weights for policy 0, policy_version 1310552 (0.0011) [2023-12-28 04:40:40,984][106225] Updated weights for policy 1, policy_version 1313933 (0.0005) [2023-12-28 04:40:41,051][106225] Updated weights for policy 1, policy_version 1313943 (0.0008) [2023-12-28 04:40:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 671981568. Throughput: 0: 9757.2, 1: 10045.7. Samples: 671949364. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:41,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.656')] [2023-12-28 04:40:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001310552_335560704.pth... [2023-12-28 04:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001313944_336420864.pth... [2023-12-28 04:40:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001309400_335265792.pth [2023-12-28 04:40:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001312792_336125952.pth [2023-12-28 04:40:41,714][106226] Updated weights for policy 0, policy_version 1310562 (0.0007) [2023-12-28 04:40:41,783][106226] Updated weights for policy 0, policy_version 1310572 (0.0009) [2023-12-28 04:40:41,794][106225] Updated weights for policy 1, policy_version 1313953 (0.0007) [2023-12-28 04:40:41,844][106226] Updated weights for policy 0, policy_version 1310582 (0.0007) [2023-12-28 04:40:41,858][106225] Updated weights for policy 1, policy_version 1313963 (0.0007) [2023-12-28 04:40:41,921][106225] Updated weights for policy 1, policy_version 1313973 (0.0008) [2023-12-28 04:40:42,597][106225] Updated weights for policy 1, policy_version 1313983 (0.0006) [2023-12-28 04:40:42,600][106226] Updated weights for policy 0, policy_version 1310592 (0.0007) [2023-12-28 04:40:42,657][106225] Updated weights for policy 1, policy_version 1313993 (0.0006) [2023-12-28 04:40:42,664][106226] Updated weights for policy 0, policy_version 1310602 (0.0008) [2023-12-28 04:40:42,715][106225] Updated weights for policy 1, policy_version 1314003 (0.0006) [2023-12-28 04:40:42,728][106226] Updated weights for policy 0, policy_version 1310612 (0.0008) [2023-12-28 04:40:43,288][106225] Updated weights for policy 1, policy_version 1314013 (0.0007) [2023-12-28 04:40:43,342][106225] Updated weights for policy 1, policy_version 1314023 (0.0008) [2023-12-28 04:40:43,395][106226] Updated weights for policy 0, policy_version 1310622 (0.0007) [2023-12-28 04:40:43,398][106225] Updated weights for policy 1, policy_version 1314033 (0.0006) [2023-12-28 04:40:43,447][106226] Updated weights for policy 0, policy_version 1310632 (0.0007) [2023-12-28 04:40:43,495][106226] Updated weights for policy 0, policy_version 1310642 (0.0008) [2023-12-28 04:40:44,152][106226] Updated weights for policy 0, policy_version 1310652 (0.0009) [2023-12-28 04:40:44,168][106225] Updated weights for policy 1, policy_version 1314043 (0.0006) [2023-12-28 04:40:44,203][106226] Updated weights for policy 0, policy_version 1310662 (0.0010) [2023-12-28 04:40:44,218][106225] Updated weights for policy 1, policy_version 1314053 (0.0005) [2023-12-28 04:40:44,256][106226] Updated weights for policy 0, policy_version 1310672 (0.0010) [2023-12-28 04:40:44,271][106225] Updated weights for policy 1, policy_version 1314063 (0.0008) [2023-12-28 04:40:44,948][106225] Updated weights for policy 1, policy_version 1314073 (0.0006) [2023-12-28 04:40:44,980][106226] Updated weights for policy 0, policy_version 1310682 (0.0010) [2023-12-28 04:40:45,015][106225] Updated weights for policy 1, policy_version 1314083 (0.0010) [2023-12-28 04:40:45,039][106226] Updated weights for policy 0, policy_version 1310692 (0.0011) [2023-12-28 04:40:45,081][106225] Updated weights for policy 1, policy_version 1314093 (0.0011) [2023-12-28 04:40:45,102][106226] Updated weights for policy 0, policy_version 1310702 (0.0010) [2023-12-28 04:40:45,139][106225] Updated weights for policy 1, policy_version 1314103 (0.0010) [2023-12-28 04:40:45,163][106226] Updated weights for policy 0, policy_version 1310712 (0.0010) [2023-12-28 04:40:45,821][106225] Updated weights for policy 1, policy_version 1314113 (0.0008) [2023-12-28 04:40:45,856][106226] Updated weights for policy 0, policy_version 1310722 (0.0005) [2023-12-28 04:40:45,871][106225] Updated weights for policy 1, policy_version 1314123 (0.0008) [2023-12-28 04:40:45,904][106226] Updated weights for policy 0, policy_version 1310732 (0.0005) [2023-12-28 04:40:45,945][106225] Updated weights for policy 1, policy_version 1314133 (0.0008) [2023-12-28 04:40:45,954][106226] Updated weights for policy 0, policy_version 1310742 (0.0005) [2023-12-28 04:40:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 672079872. Throughput: 0: 9747.9, 1: 9995.6. Samples: 672066388. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:46,175][105115] Avg episode reward: [(0, '-4.345'), (1, '-5.421')] [2023-12-28 04:40:46,570][106226] Updated weights for policy 0, policy_version 1310752 (0.0009) [2023-12-28 04:40:46,631][106226] Updated weights for policy 0, policy_version 1310762 (0.0007) [2023-12-28 04:40:46,638][106225] Updated weights for policy 1, policy_version 1314143 (0.0007) [2023-12-28 04:40:46,688][106225] Updated weights for policy 1, policy_version 1314153 (0.0008) [2023-12-28 04:40:46,692][106226] Updated weights for policy 0, policy_version 1310772 (0.0005) [2023-12-28 04:40:46,744][106225] Updated weights for policy 1, policy_version 1314163 (0.0007) [2023-12-28 04:40:47,335][106226] Updated weights for policy 0, policy_version 1310782 (0.0007) [2023-12-28 04:40:47,399][106226] Updated weights for policy 0, policy_version 1310792 (0.0009) [2023-12-28 04:40:47,450][106226] Updated weights for policy 0, policy_version 1310802 (0.0006) [2023-12-28 04:40:47,481][106225] Updated weights for policy 1, policy_version 1314173 (0.0008) [2023-12-28 04:40:47,540][106225] Updated weights for policy 1, policy_version 1314183 (0.0008) [2023-12-28 04:40:47,594][106225] Updated weights for policy 1, policy_version 1314193 (0.0008) [2023-12-28 04:40:48,202][106226] Updated weights for policy 0, policy_version 1310812 (0.0007) [2023-12-28 04:40:48,259][106226] Updated weights for policy 0, policy_version 1310822 (0.0007) [2023-12-28 04:40:48,295][106225] Updated weights for policy 1, policy_version 1314203 (0.0009) [2023-12-28 04:40:48,316][106226] Updated weights for policy 0, policy_version 1310832 (0.0006) [2023-12-28 04:40:48,370][106225] Updated weights for policy 1, policy_version 1314213 (0.0009) [2023-12-28 04:40:48,432][106225] Updated weights for policy 1, policy_version 1314223 (0.0011) [2023-12-28 04:40:49,057][106226] Updated weights for policy 0, policy_version 1310842 (0.0008) [2023-12-28 04:40:49,115][106226] Updated weights for policy 0, policy_version 1310852 (0.0005) [2023-12-28 04:40:49,131][106225] Updated weights for policy 1, policy_version 1314233 (0.0011) [2023-12-28 04:40:49,176][106226] Updated weights for policy 0, policy_version 1310862 (0.0006) [2023-12-28 04:40:49,199][106225] Updated weights for policy 1, policy_version 1314243 (0.0011) [2023-12-28 04:40:49,245][106226] Updated weights for policy 0, policy_version 1310872 (0.0007) [2023-12-28 04:40:49,268][106225] Updated weights for policy 1, policy_version 1314253 (0.0010) [2023-12-28 04:40:49,329][106225] Updated weights for policy 1, policy_version 1314263 (0.0010) [2023-12-28 04:40:49,949][106226] Updated weights for policy 0, policy_version 1310882 (0.0011) [2023-12-28 04:40:50,014][106226] Updated weights for policy 0, policy_version 1310892 (0.0011) [2023-12-28 04:40:50,082][106226] Updated weights for policy 0, policy_version 1310902 (0.0006) [2023-12-28 04:40:50,100][106225] Updated weights for policy 1, policy_version 1314273 (0.0007) [2023-12-28 04:40:50,158][106225] Updated weights for policy 1, policy_version 1314283 (0.0008) [2023-12-28 04:40:50,227][106225] Updated weights for policy 1, policy_version 1314293 (0.0011) [2023-12-28 04:40:50,711][106226] Updated weights for policy 0, policy_version 1310912 (0.0008) [2023-12-28 04:40:50,773][106226] Updated weights for policy 0, policy_version 1310922 (0.0008) [2023-12-28 04:40:50,835][106226] Updated weights for policy 0, policy_version 1310932 (0.0008) [2023-12-28 04:40:50,882][106225] Updated weights for policy 1, policy_version 1314303 (0.0008) [2023-12-28 04:40:50,941][106225] Updated weights for policy 1, policy_version 1314313 (0.0006) [2023-12-28 04:40:51,005][106225] Updated weights for policy 1, policy_version 1314323 (0.0009) [2023-12-28 04:40:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 672178176. Throughput: 0: 9779.2, 1: 9932.4. Samples: 672185016. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:51,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.963')] [2023-12-28 04:40:51,633][106226] Updated weights for policy 0, policy_version 1310942 (0.0009) [2023-12-28 04:40:51,692][106226] Updated weights for policy 0, policy_version 1310952 (0.0007) [2023-12-28 04:40:51,736][106225] Updated weights for policy 1, policy_version 1314333 (0.0008) [2023-12-28 04:40:51,753][106226] Updated weights for policy 0, policy_version 1310962 (0.0008) [2023-12-28 04:40:51,795][106225] Updated weights for policy 1, policy_version 1314343 (0.0008) [2023-12-28 04:40:51,843][106225] Updated weights for policy 1, policy_version 1314353 (0.0008) [2023-12-28 04:40:52,491][106226] Updated weights for policy 0, policy_version 1310972 (0.0010) [2023-12-28 04:40:52,525][106225] Updated weights for policy 1, policy_version 1314363 (0.0009) [2023-12-28 04:40:52,556][106226] Updated weights for policy 0, policy_version 1310982 (0.0011) [2023-12-28 04:40:52,577][106225] Updated weights for policy 1, policy_version 1314373 (0.0010) [2023-12-28 04:40:52,617][106226] Updated weights for policy 0, policy_version 1310992 (0.0010) [2023-12-28 04:40:52,632][106225] Updated weights for policy 1, policy_version 1314383 (0.0010) [2023-12-28 04:40:53,238][106226] Updated weights for policy 0, policy_version 1311002 (0.0009) [2023-12-28 04:40:53,301][106226] Updated weights for policy 0, policy_version 1311012 (0.0005) [2023-12-28 04:40:53,318][106225] Updated weights for policy 1, policy_version 1314393 (0.0010) [2023-12-28 04:40:53,365][106226] Updated weights for policy 0, policy_version 1311022 (0.0005) [2023-12-28 04:40:53,377][106225] Updated weights for policy 1, policy_version 1314403 (0.0007) [2023-12-28 04:40:53,425][106226] Updated weights for policy 0, policy_version 1311032 (0.0006) [2023-12-28 04:40:53,427][106225] Updated weights for policy 1, policy_version 1314413 (0.0008) [2023-12-28 04:40:53,474][106225] Updated weights for policy 1, policy_version 1314423 (0.0009) [2023-12-28 04:40:54,090][106226] Updated weights for policy 0, policy_version 1311042 (0.0008) [2023-12-28 04:40:54,101][106225] Updated weights for policy 1, policy_version 1314433 (0.0006) [2023-12-28 04:40:54,136][106226] Updated weights for policy 0, policy_version 1311052 (0.0006) [2023-12-28 04:40:54,149][106225] Updated weights for policy 1, policy_version 1314443 (0.0008) [2023-12-28 04:40:54,194][106226] Updated weights for policy 0, policy_version 1311062 (0.0005) [2023-12-28 04:40:54,203][106225] Updated weights for policy 1, policy_version 1314453 (0.0008) [2023-12-28 04:40:54,851][106226] Updated weights for policy 0, policy_version 1311072 (0.0008) [2023-12-28 04:40:54,911][106226] Updated weights for policy 0, policy_version 1311082 (0.0008) [2023-12-28 04:40:54,928][106225] Updated weights for policy 1, policy_version 1314463 (0.0007) [2023-12-28 04:40:54,970][106226] Updated weights for policy 0, policy_version 1311092 (0.0007) [2023-12-28 04:40:54,991][106225] Updated weights for policy 1, policy_version 1314473 (0.0008) [2023-12-28 04:40:55,047][106225] Updated weights for policy 1, policy_version 1314483 (0.0006) [2023-12-28 04:40:55,693][106226] Updated weights for policy 0, policy_version 1311102 (0.0009) [2023-12-28 04:40:55,737][106225] Updated weights for policy 1, policy_version 1314493 (0.0008) [2023-12-28 04:40:55,754][106226] Updated weights for policy 0, policy_version 1311112 (0.0007) [2023-12-28 04:40:55,801][106225] Updated weights for policy 1, policy_version 1314503 (0.0007) [2023-12-28 04:40:55,810][106226] Updated weights for policy 0, policy_version 1311122 (0.0007) [2023-12-28 04:40:55,861][106225] Updated weights for policy 1, policy_version 1314513 (0.0007) [2023-12-28 04:40:56,175][105115] Fps is (10 sec: 19659.7, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 672276480. Throughput: 0: 9812.9, 1: 9880.2. Samples: 672244680. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:40:56,176][105115] Avg episode reward: [(0, '-4.233'), (1, '-4.743')] [2023-12-28 04:40:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001314520_336568320.pth... [2023-12-28 04:40:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001311128_335708160.pth... [2023-12-28 04:40:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001309976_335413248.pth [2023-12-28 04:40:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001313336_336265216.pth [2023-12-28 04:40:56,399][106226] Updated weights for policy 0, policy_version 1311132 (0.0006) [2023-12-28 04:40:56,452][106226] Updated weights for policy 0, policy_version 1311142 (0.0010) [2023-12-28 04:40:56,459][106225] Updated weights for policy 1, policy_version 1314523 (0.0008) [2023-12-28 04:40:56,513][106225] Updated weights for policy 1, policy_version 1314533 (0.0006) [2023-12-28 04:40:56,519][106226] Updated weights for policy 0, policy_version 1311152 (0.0006) [2023-12-28 04:40:56,576][106225] Updated weights for policy 1, policy_version 1314543 (0.0010) [2023-12-28 04:40:57,204][106226] Updated weights for policy 0, policy_version 1311162 (0.0005) [2023-12-28 04:40:57,224][106225] Updated weights for policy 1, policy_version 1314553 (0.0010) [2023-12-28 04:40:57,262][106226] Updated weights for policy 0, policy_version 1311172 (0.0007) [2023-12-28 04:40:57,283][106225] Updated weights for policy 1, policy_version 1314563 (0.0005) [2023-12-28 04:40:57,318][106226] Updated weights for policy 0, policy_version 1311182 (0.0006) [2023-12-28 04:40:57,349][106225] Updated weights for policy 1, policy_version 1314573 (0.0007) [2023-12-28 04:40:57,377][106226] Updated weights for policy 0, policy_version 1311192 (0.0008) [2023-12-28 04:40:57,397][106225] Updated weights for policy 1, policy_version 1314583 (0.0008) [2023-12-28 04:40:57,978][106226] Updated weights for policy 0, policy_version 1311202 (0.0009) [2023-12-28 04:40:57,995][106225] Updated weights for policy 1, policy_version 1314593 (0.0010) [2023-12-28 04:40:58,039][106226] Updated weights for policy 0, policy_version 1311212 (0.0006) [2023-12-28 04:40:58,045][106225] Updated weights for policy 1, policy_version 1314603 (0.0010) [2023-12-28 04:40:58,096][106226] Updated weights for policy 0, policy_version 1311222 (0.0006) [2023-12-28 04:40:58,098][106225] Updated weights for policy 1, policy_version 1314613 (0.0010) [2023-12-28 04:40:58,836][106226] Updated weights for policy 0, policy_version 1311232 (0.0007) [2023-12-28 04:40:58,906][106226] Updated weights for policy 0, policy_version 1311242 (0.0008) [2023-12-28 04:40:58,929][106225] Updated weights for policy 1, policy_version 1314623 (0.0008) [2023-12-28 04:40:58,967][106226] Updated weights for policy 0, policy_version 1311252 (0.0009) [2023-12-28 04:40:58,990][106225] Updated weights for policy 1, policy_version 1314633 (0.0007) [2023-12-28 04:40:59,045][106225] Updated weights for policy 1, policy_version 1314643 (0.0008) [2023-12-28 04:40:59,664][106226] Updated weights for policy 0, policy_version 1311262 (0.0007) [2023-12-28 04:40:59,721][106226] Updated weights for policy 0, policy_version 1311272 (0.0005) [2023-12-28 04:40:59,782][106226] Updated weights for policy 0, policy_version 1311282 (0.0007) [2023-12-28 04:40:59,852][106225] Updated weights for policy 1, policy_version 1314653 (0.0009) [2023-12-28 04:40:59,907][106225] Updated weights for policy 1, policy_version 1314663 (0.0010) [2023-12-28 04:40:59,966][106225] Updated weights for policy 1, policy_version 1314673 (0.0010) [2023-12-28 04:41:00,490][106226] Updated weights for policy 0, policy_version 1311292 (0.0008) [2023-12-28 04:41:00,548][106226] Updated weights for policy 0, policy_version 1311302 (0.0008) [2023-12-28 04:41:00,619][106226] Updated weights for policy 0, policy_version 1311312 (0.0008) [2023-12-28 04:41:00,694][106225] Updated weights for policy 1, policy_version 1314683 (0.0010) [2023-12-28 04:41:00,744][106225] Updated weights for policy 1, policy_version 1314693 (0.0010) [2023-12-28 04:41:00,806][106225] Updated weights for policy 1, policy_version 1314703 (0.0010) [2023-12-28 04:41:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 672374784. Throughput: 0: 9908.8, 1: 9944.3. Samples: 672366288. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:01,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-4.833')] [2023-12-28 04:41:01,390][106226] Updated weights for policy 0, policy_version 1311322 (0.0008) [2023-12-28 04:41:01,443][106226] Updated weights for policy 0, policy_version 1311332 (0.0008) [2023-12-28 04:41:01,488][106226] Updated weights for policy 0, policy_version 1311342 (0.0007) [2023-12-28 04:41:01,543][106225] Updated weights for policy 1, policy_version 1314713 (0.0010) [2023-12-28 04:41:01,544][106226] Updated weights for policy 0, policy_version 1311352 (0.0010) [2023-12-28 04:41:01,590][106225] Updated weights for policy 1, policy_version 1314723 (0.0008) [2023-12-28 04:41:01,655][106225] Updated weights for policy 1, policy_version 1314733 (0.0009) [2023-12-28 04:41:01,722][106225] Updated weights for policy 1, policy_version 1314743 (0.0008) [2023-12-28 04:41:02,323][106226] Updated weights for policy 0, policy_version 1311363 (0.0008) [2023-12-28 04:41:02,386][106226] Updated weights for policy 0, policy_version 1311373 (0.0013) [2023-12-28 04:41:02,430][106225] Updated weights for policy 1, policy_version 1314753 (0.0006) [2023-12-28 04:41:02,435][106226] Updated weights for policy 0, policy_version 1311383 (0.0012) [2023-12-28 04:41:02,476][106225] Updated weights for policy 1, policy_version 1314763 (0.0005) [2023-12-28 04:41:02,521][106225] Updated weights for policy 1, policy_version 1314773 (0.0006) [2023-12-28 04:41:03,152][106225] Updated weights for policy 1, policy_version 1314783 (0.0006) [2023-12-28 04:41:03,208][106225] Updated weights for policy 1, policy_version 1314793 (0.0006) [2023-12-28 04:41:03,252][106226] Updated weights for policy 0, policy_version 1311393 (0.0007) [2023-12-28 04:41:03,256][106225] Updated weights for policy 1, policy_version 1314803 (0.0007) [2023-12-28 04:41:03,309][106226] Updated weights for policy 0, policy_version 1311403 (0.0008) [2023-12-28 04:41:03,363][106226] Updated weights for policy 0, policy_version 1311413 (0.0007) [2023-12-28 04:41:03,906][106225] Updated weights for policy 1, policy_version 1314813 (0.0006) [2023-12-28 04:41:03,939][106226] Updated weights for policy 0, policy_version 1311423 (0.0008) [2023-12-28 04:41:03,971][106225] Updated weights for policy 1, policy_version 1314823 (0.0006) [2023-12-28 04:41:03,999][106226] Updated weights for policy 0, policy_version 1311433 (0.0008) [2023-12-28 04:41:04,036][106225] Updated weights for policy 1, policy_version 1314833 (0.0006) [2023-12-28 04:41:04,057][106226] Updated weights for policy 0, policy_version 1311443 (0.0007) [2023-12-28 04:41:04,732][106225] Updated weights for policy 1, policy_version 1314843 (0.0006) [2023-12-28 04:41:04,780][106225] Updated weights for policy 1, policy_version 1314853 (0.0005) [2023-12-28 04:41:04,803][106226] Updated weights for policy 0, policy_version 1311453 (0.0006) [2023-12-28 04:41:04,832][106225] Updated weights for policy 1, policy_version 1314863 (0.0005) [2023-12-28 04:41:04,854][106226] Updated weights for policy 0, policy_version 1311463 (0.0007) [2023-12-28 04:41:04,899][106226] Updated weights for policy 0, policy_version 1311473 (0.0008) [2023-12-28 04:41:05,410][106225] Updated weights for policy 1, policy_version 1314873 (0.0005) [2023-12-28 04:41:05,462][106225] Updated weights for policy 1, policy_version 1314883 (0.0006) [2023-12-28 04:41:05,526][106225] Updated weights for policy 1, policy_version 1314893 (0.0006) [2023-12-28 04:41:05,583][106225] Updated weights for policy 1, policy_version 1314903 (0.0007) [2023-12-28 04:41:05,606][106226] Updated weights for policy 0, policy_version 1311483 (0.0009) [2023-12-28 04:41:05,663][106226] Updated weights for policy 0, policy_version 1311493 (0.0011) [2023-12-28 04:41:05,725][106226] Updated weights for policy 0, policy_version 1311503 (0.0010) [2023-12-28 04:41:06,174][105115] Fps is (10 sec: 19661.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 672473088. Throughput: 0: 9924.7, 1: 10015.2. Samples: 672486204. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:06,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.861')] [2023-12-28 04:41:06,267][106225] Updated weights for policy 1, policy_version 1314913 (0.0009) [2023-12-28 04:41:06,327][106226] Updated weights for policy 0, policy_version 1311513 (0.0009) [2023-12-28 04:41:06,332][106225] Updated weights for policy 1, policy_version 1314923 (0.0009) [2023-12-28 04:41:06,387][106226] Updated weights for policy 0, policy_version 1311523 (0.0007) [2023-12-28 04:41:06,392][106225] Updated weights for policy 1, policy_version 1314933 (0.0006) [2023-12-28 04:41:06,450][106226] Updated weights for policy 0, policy_version 1311533 (0.0008) [2023-12-28 04:41:06,515][106226] Updated weights for policy 0, policy_version 1311543 (0.0009) [2023-12-28 04:41:07,024][106225] Updated weights for policy 1, policy_version 1314943 (0.0007) [2023-12-28 04:41:07,079][106225] Updated weights for policy 1, policy_version 1314953 (0.0005) [2023-12-28 04:41:07,139][106225] Updated weights for policy 1, policy_version 1314963 (0.0005) [2023-12-28 04:41:07,336][106226] Updated weights for policy 0, policy_version 1311553 (0.0009) [2023-12-28 04:41:07,397][106226] Updated weights for policy 0, policy_version 1311563 (0.0009) [2023-12-28 04:41:07,478][106226] Updated weights for policy 0, policy_version 1311573 (0.0007) [2023-12-28 04:41:07,782][106225] Updated weights for policy 1, policy_version 1314973 (0.0005) [2023-12-28 04:41:07,839][106225] Updated weights for policy 1, policy_version 1314983 (0.0005) [2023-12-28 04:41:07,900][106225] Updated weights for policy 1, policy_version 1314993 (0.0005) [2023-12-28 04:41:08,168][106226] Updated weights for policy 0, policy_version 1311583 (0.0006) [2023-12-28 04:41:08,220][106226] Updated weights for policy 0, policy_version 1311593 (0.0005) [2023-12-28 04:41:08,271][106226] Updated weights for policy 0, policy_version 1311603 (0.0005) [2023-12-28 04:41:08,592][106225] Updated weights for policy 1, policy_version 1315003 (0.0006) [2023-12-28 04:41:08,651][106225] Updated weights for policy 1, policy_version 1315013 (0.0008) [2023-12-28 04:41:08,704][106225] Updated weights for policy 1, policy_version 1315023 (0.0008) [2023-12-28 04:41:08,943][106226] Updated weights for policy 0, policy_version 1311613 (0.0007) [2023-12-28 04:41:09,007][106226] Updated weights for policy 0, policy_version 1311623 (0.0009) [2023-12-28 04:41:09,068][106226] Updated weights for policy 0, policy_version 1311633 (0.0008) [2023-12-28 04:41:09,448][106225] Updated weights for policy 1, policy_version 1315033 (0.0008) [2023-12-28 04:41:09,514][106225] Updated weights for policy 1, policy_version 1315043 (0.0009) [2023-12-28 04:41:09,580][106225] Updated weights for policy 1, policy_version 1315053 (0.0008) [2023-12-28 04:41:09,637][106225] Updated weights for policy 1, policy_version 1315063 (0.0009) [2023-12-28 04:41:09,791][106226] Updated weights for policy 0, policy_version 1311643 (0.0009) [2023-12-28 04:41:09,852][106226] Updated weights for policy 0, policy_version 1311653 (0.0008) [2023-12-28 04:41:09,913][106226] Updated weights for policy 0, policy_version 1311663 (0.0007) [2023-12-28 04:41:10,370][106225] Updated weights for policy 1, policy_version 1315073 (0.0008) [2023-12-28 04:41:10,433][106225] Updated weights for policy 1, policy_version 1315083 (0.0008) [2023-12-28 04:41:10,495][106225] Updated weights for policy 1, policy_version 1315093 (0.0007) [2023-12-28 04:41:10,693][106226] Updated weights for policy 0, policy_version 1311673 (0.0009) [2023-12-28 04:41:10,756][106226] Updated weights for policy 0, policy_version 1311683 (0.0009) [2023-12-28 04:41:10,812][106226] Updated weights for policy 0, policy_version 1311693 (0.0009) [2023-12-28 04:41:10,861][106226] Updated weights for policy 0, policy_version 1311703 (0.0009) [2023-12-28 04:41:11,174][106225] Updated weights for policy 1, policy_version 1315104 (0.0007) [2023-12-28 04:41:11,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 672571392. Throughput: 0: 9895.8, 1: 10070.1. Samples: 672545128. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:11,175][105115] Avg episode reward: [(0, '-4.192'), (1, '-4.772')] [2023-12-28 04:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001311704_335855616.pth... [2023-12-28 04:41:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001310552_335560704.pth [2023-12-28 04:41:11,235][106225] Updated weights for policy 1, policy_version 1315114 (0.0008) [2023-12-28 04:41:11,305][106225] Updated weights for policy 1, policy_version 1315124 (0.0009) [2023-12-28 04:41:11,327][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001315128_336723968.pth... [2023-12-28 04:41:11,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001313944_336420864.pth [2023-12-28 04:41:11,661][106226] Updated weights for policy 0, policy_version 1311713 (0.0009) [2023-12-28 04:41:11,730][106226] Updated weights for policy 0, policy_version 1311723 (0.0009) [2023-12-28 04:41:11,800][106226] Updated weights for policy 0, policy_version 1311733 (0.0010) [2023-12-28 04:41:12,097][106225] Updated weights for policy 1, policy_version 1315134 (0.0009) [2023-12-28 04:41:12,156][106225] Updated weights for policy 1, policy_version 1315144 (0.0008) [2023-12-28 04:41:12,216][106225] Updated weights for policy 1, policy_version 1315154 (0.0008) [2023-12-28 04:41:12,556][106226] Updated weights for policy 0, policy_version 1311743 (0.0008) [2023-12-28 04:41:12,625][106226] Updated weights for policy 0, policy_version 1311753 (0.0008) [2023-12-28 04:41:12,698][106226] Updated weights for policy 0, policy_version 1311763 (0.0008) [2023-12-28 04:41:12,913][106225] Updated weights for policy 1, policy_version 1315164 (0.0007) [2023-12-28 04:41:12,980][106225] Updated weights for policy 1, policy_version 1315174 (0.0005) [2023-12-28 04:41:13,044][106225] Updated weights for policy 1, policy_version 1315184 (0.0008) [2023-12-28 04:41:13,425][106226] Updated weights for policy 0, policy_version 1311773 (0.0009) [2023-12-28 04:41:13,484][106226] Updated weights for policy 0, policy_version 1311783 (0.0009) [2023-12-28 04:41:13,539][106226] Updated weights for policy 0, policy_version 1311793 (0.0008) [2023-12-28 04:41:13,632][106225] Updated weights for policy 1, policy_version 1315194 (0.0008) [2023-12-28 04:41:13,695][106225] Updated weights for policy 1, policy_version 1315204 (0.0009) [2023-12-28 04:41:13,748][106225] Updated weights for policy 1, policy_version 1315214 (0.0008) [2023-12-28 04:41:13,803][106225] Updated weights for policy 1, policy_version 1315224 (0.0009) [2023-12-28 04:41:14,230][106226] Updated weights for policy 0, policy_version 1311803 (0.0007) [2023-12-28 04:41:14,289][106226] Updated weights for policy 0, policy_version 1311813 (0.0008) [2023-12-28 04:41:14,350][106226] Updated weights for policy 0, policy_version 1311823 (0.0008) [2023-12-28 04:41:14,527][106225] Updated weights for policy 1, policy_version 1315234 (0.0008) [2023-12-28 04:41:14,574][106225] Updated weights for policy 1, policy_version 1315244 (0.0008) [2023-12-28 04:41:14,625][106225] Updated weights for policy 1, policy_version 1315254 (0.0008) [2023-12-28 04:41:15,073][106226] Updated weights for policy 0, policy_version 1311833 (0.0009) [2023-12-28 04:41:15,138][106226] Updated weights for policy 0, policy_version 1311843 (0.0008) [2023-12-28 04:41:15,200][106226] Updated weights for policy 0, policy_version 1311853 (0.0008) [2023-12-28 04:41:15,261][106226] Updated weights for policy 0, policy_version 1311863 (0.0009) [2023-12-28 04:41:15,386][106225] Updated weights for policy 1, policy_version 1315264 (0.0008) [2023-12-28 04:41:15,453][106225] Updated weights for policy 1, policy_version 1315274 (0.0009) [2023-12-28 04:41:15,514][106225] Updated weights for policy 1, policy_version 1315284 (0.0009) [2023-12-28 04:41:16,001][106226] Updated weights for policy 0, policy_version 1311873 (0.0008) [2023-12-28 04:41:16,061][106226] Updated weights for policy 0, policy_version 1311883 (0.0007) [2023-12-28 04:41:16,127][106226] Updated weights for policy 0, policy_version 1311893 (0.0005) [2023-12-28 04:41:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 672669696. Throughput: 0: 9829.6, 1: 9983.0. Samples: 672659604. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:16,175][105115] Avg episode reward: [(0, '-4.079'), (1, '-4.710')] [2023-12-28 04:41:16,256][106225] Updated weights for policy 1, policy_version 1315294 (0.0008) [2023-12-28 04:41:16,301][106225] Updated weights for policy 1, policy_version 1315304 (0.0008) [2023-12-28 04:41:16,359][106225] Updated weights for policy 1, policy_version 1315314 (0.0008) [2023-12-28 04:41:16,797][106226] Updated weights for policy 0, policy_version 1311903 (0.0007) [2023-12-28 04:41:16,853][106226] Updated weights for policy 0, policy_version 1311913 (0.0009) [2023-12-28 04:41:16,909][106226] Updated weights for policy 0, policy_version 1311923 (0.0009) [2023-12-28 04:41:17,098][106225] Updated weights for policy 1, policy_version 1315324 (0.0008) [2023-12-28 04:41:17,160][106225] Updated weights for policy 1, policy_version 1315334 (0.0008) [2023-12-28 04:41:17,221][106225] Updated weights for policy 1, policy_version 1315344 (0.0008) [2023-12-28 04:41:17,654][106226] Updated weights for policy 0, policy_version 1311933 (0.0008) [2023-12-28 04:41:17,717][106226] Updated weights for policy 0, policy_version 1311943 (0.0009) [2023-12-28 04:41:17,784][106226] Updated weights for policy 0, policy_version 1311953 (0.0008) [2023-12-28 04:41:17,940][106225] Updated weights for policy 1, policy_version 1315354 (0.0008) [2023-12-28 04:41:18,004][106225] Updated weights for policy 1, policy_version 1315364 (0.0008) [2023-12-28 04:41:18,066][106225] Updated weights for policy 1, policy_version 1315374 (0.0006) [2023-12-28 04:41:18,121][106225] Updated weights for policy 1, policy_version 1315384 (0.0006) [2023-12-28 04:41:18,605][106226] Updated weights for policy 0, policy_version 1311963 (0.0008) [2023-12-28 04:41:18,669][106226] Updated weights for policy 0, policy_version 1311973 (0.0009) [2023-12-28 04:41:18,733][106226] Updated weights for policy 0, policy_version 1311983 (0.0008) [2023-12-28 04:41:18,778][106225] Updated weights for policy 1, policy_version 1315394 (0.0007) [2023-12-28 04:41:18,844][106225] Updated weights for policy 1, policy_version 1315404 (0.0009) [2023-12-28 04:41:18,911][106225] Updated weights for policy 1, policy_version 1315414 (0.0006) [2023-12-28 04:41:19,481][106226] Updated weights for policy 0, policy_version 1311993 (0.0009) [2023-12-28 04:41:19,536][106226] Updated weights for policy 0, policy_version 1312003 (0.0009) [2023-12-28 04:41:19,599][106226] Updated weights for policy 0, policy_version 1312013 (0.0008) [2023-12-28 04:41:19,637][106225] Updated weights for policy 1, policy_version 1315424 (0.0008) [2023-12-28 04:41:19,658][106226] Updated weights for policy 0, policy_version 1312023 (0.0009) [2023-12-28 04:41:19,701][106225] Updated weights for policy 1, policy_version 1315434 (0.0008) [2023-12-28 04:41:19,763][106225] Updated weights for policy 1, policy_version 1315444 (0.0008) [2023-12-28 04:41:20,384][106226] Updated weights for policy 0, policy_version 1312033 (0.0008) [2023-12-28 04:41:20,442][106226] Updated weights for policy 0, policy_version 1312043 (0.0006) [2023-12-28 04:41:20,498][106226] Updated weights for policy 0, policy_version 1312053 (0.0005) [2023-12-28 04:41:20,499][106225] Updated weights for policy 1, policy_version 1315454 (0.0008) [2023-12-28 04:41:20,556][106225] Updated weights for policy 1, policy_version 1315464 (0.0008) [2023-12-28 04:41:20,630][106225] Updated weights for policy 1, policy_version 1315474 (0.0009) [2023-12-28 04:41:21,110][106226] Updated weights for policy 0, policy_version 1312063 (0.0008) [2023-12-28 04:41:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 672759808. Throughput: 0: 9746.4, 1: 9923.1. Samples: 672774832. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:21,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.661')] [2023-12-28 04:41:21,179][106226] Updated weights for policy 0, policy_version 1312073 (0.0008) [2023-12-28 04:41:21,244][106226] Updated weights for policy 0, policy_version 1312083 (0.0007) [2023-12-28 04:41:21,440][106225] Updated weights for policy 1, policy_version 1315484 (0.0010) [2023-12-28 04:41:21,505][106225] Updated weights for policy 1, policy_version 1315494 (0.0011) [2023-12-28 04:41:21,567][106225] Updated weights for policy 1, policy_version 1315504 (0.0007) [2023-12-28 04:41:21,990][106226] Updated weights for policy 0, policy_version 1312093 (0.0008) [2023-12-28 04:41:22,054][106226] Updated weights for policy 0, policy_version 1312103 (0.0008) [2023-12-28 04:41:22,124][106226] Updated weights for policy 0, policy_version 1312113 (0.0006) [2023-12-28 04:41:22,356][106225] Updated weights for policy 1, policy_version 1315514 (0.0010) [2023-12-28 04:41:22,423][106225] Updated weights for policy 1, policy_version 1315524 (0.0012) [2023-12-28 04:41:22,481][106225] Updated weights for policy 1, policy_version 1315534 (0.0011) [2023-12-28 04:41:22,535][106225] Updated weights for policy 1, policy_version 1315544 (0.0010) [2023-12-28 04:41:22,807][106226] Updated weights for policy 0, policy_version 1312123 (0.0008) [2023-12-28 04:41:22,871][106226] Updated weights for policy 0, policy_version 1312133 (0.0006) [2023-12-28 04:41:22,937][106226] Updated weights for policy 0, policy_version 1312143 (0.0006) [2023-12-28 04:41:23,319][106225] Updated weights for policy 1, policy_version 1315554 (0.0008) [2023-12-28 04:41:23,378][106225] Updated weights for policy 1, policy_version 1315564 (0.0006) [2023-12-28 04:41:23,435][106225] Updated weights for policy 1, policy_version 1315574 (0.0009) [2023-12-28 04:41:23,573][106226] Updated weights for policy 0, policy_version 1312153 (0.0006) [2023-12-28 04:41:23,635][106226] Updated weights for policy 0, policy_version 1312163 (0.0010) [2023-12-28 04:41:23,690][106226] Updated weights for policy 0, policy_version 1312173 (0.0010) [2023-12-28 04:41:23,750][106226] Updated weights for policy 0, policy_version 1312183 (0.0010) [2023-12-28 04:41:24,113][106225] Updated weights for policy 1, policy_version 1315584 (0.0007) [2023-12-28 04:41:24,162][106225] Updated weights for policy 1, policy_version 1315594 (0.0007) [2023-12-28 04:41:24,218][106225] Updated weights for policy 1, policy_version 1315604 (0.0008) [2023-12-28 04:41:24,424][106226] Updated weights for policy 0, policy_version 1312193 (0.0010) [2023-12-28 04:41:24,485][106226] Updated weights for policy 0, policy_version 1312203 (0.0010) [2023-12-28 04:41:24,536][106226] Updated weights for policy 0, policy_version 1312213 (0.0006) [2023-12-28 04:41:24,873][106225] Updated weights for policy 1, policy_version 1315614 (0.0007) [2023-12-28 04:41:24,932][106225] Updated weights for policy 1, policy_version 1315624 (0.0005) [2023-12-28 04:41:24,997][106225] Updated weights for policy 1, policy_version 1315634 (0.0005) [2023-12-28 04:41:25,231][106226] Updated weights for policy 0, policy_version 1312223 (0.0009) [2023-12-28 04:41:25,289][106226] Updated weights for policy 0, policy_version 1312233 (0.0010) [2023-12-28 04:41:25,338][106226] Updated weights for policy 0, policy_version 1312243 (0.0010) [2023-12-28 04:41:25,543][106225] Updated weights for policy 1, policy_version 1315644 (0.0006) [2023-12-28 04:41:25,592][106225] Updated weights for policy 1, policy_version 1315654 (0.0008) [2023-12-28 04:41:25,638][106225] Updated weights for policy 1, policy_version 1315664 (0.0007) [2023-12-28 04:41:26,060][106226] Updated weights for policy 0, policy_version 1312253 (0.0009) [2023-12-28 04:41:26,112][106226] Updated weights for policy 0, policy_version 1312263 (0.0009) [2023-12-28 04:41:26,168][106226] Updated weights for policy 0, policy_version 1312273 (0.0008) [2023-12-28 04:41:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 672858112. Throughput: 0: 9732.3, 1: 9867.8. Samples: 672831372. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-28 04:41:26,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-5.033')] [2023-12-28 04:41:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001315672_336863232.pth... [2023-12-28 04:41:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001314520_336568320.pth [2023-12-28 04:41:26,209][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001312280_336003072.pth... [2023-12-28 04:41:26,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001311128_335708160.pth [2023-12-28 04:41:26,253][106225] Updated weights for policy 1, policy_version 1315674 (0.0007) [2023-12-28 04:41:26,310][106225] Updated weights for policy 1, policy_version 1315684 (0.0008) [2023-12-28 04:41:26,363][106225] Updated weights for policy 1, policy_version 1315694 (0.0009) [2023-12-28 04:41:26,416][106225] Updated weights for policy 1, policy_version 1315704 (0.0008) [2023-12-28 04:41:26,877][106226] Updated weights for policy 0, policy_version 1312283 (0.0007) [2023-12-28 04:41:26,923][106226] Updated weights for policy 0, policy_version 1312293 (0.0005) [2023-12-28 04:41:26,971][106226] Updated weights for policy 0, policy_version 1312303 (0.0006) [2023-12-28 04:41:27,022][106225] Updated weights for policy 1, policy_version 1315714 (0.0007) [2023-12-28 04:41:27,078][106225] Updated weights for policy 1, policy_version 1315724 (0.0010) [2023-12-28 04:41:27,128][106225] Updated weights for policy 1, policy_version 1315734 (0.0010) [2023-12-28 04:41:27,666][106226] Updated weights for policy 0, policy_version 1312313 (0.0008) [2023-12-28 04:41:27,721][106226] Updated weights for policy 0, policy_version 1312323 (0.0010) [2023-12-28 04:41:27,768][106226] Updated weights for policy 0, policy_version 1312333 (0.0010) [2023-12-28 04:41:27,776][106225] Updated weights for policy 1, policy_version 1315744 (0.0009) [2023-12-28 04:41:27,810][106226] Updated weights for policy 0, policy_version 1312343 (0.0007) [2023-12-28 04:41:27,830][106225] Updated weights for policy 1, policy_version 1315754 (0.0010) [2023-12-28 04:41:27,886][106225] Updated weights for policy 1, policy_version 1315764 (0.0010) [2023-12-28 04:41:28,523][106226] Updated weights for policy 0, policy_version 1312353 (0.0008) [2023-12-28 04:41:28,530][106225] Updated weights for policy 1, policy_version 1315774 (0.0010) [2023-12-28 04:41:28,578][106226] Updated weights for policy 0, policy_version 1312363 (0.0008) [2023-12-28 04:41:28,582][106225] Updated weights for policy 1, policy_version 1315784 (0.0010) [2023-12-28 04:41:28,637][106225] Updated weights for policy 1, policy_version 1315794 (0.0010) [2023-12-28 04:41:28,639][106226] Updated weights for policy 0, policy_version 1312373 (0.0010) [2023-12-28 04:41:29,338][106226] Updated weights for policy 0, policy_version 1312383 (0.0011) [2023-12-28 04:41:29,364][106225] Updated weights for policy 1, policy_version 1315804 (0.0009) [2023-12-28 04:41:29,403][106226] Updated weights for policy 0, policy_version 1312393 (0.0007) [2023-12-28 04:41:29,430][106225] Updated weights for policy 1, policy_version 1315814 (0.0008) [2023-12-28 04:41:29,460][106226] Updated weights for policy 0, policy_version 1312403 (0.0007) [2023-12-28 04:41:29,495][106225] Updated weights for policy 1, policy_version 1315824 (0.0008) [2023-12-28 04:41:30,096][106226] Updated weights for policy 0, policy_version 1312413 (0.0008) [2023-12-28 04:41:30,163][106226] Updated weights for policy 0, policy_version 1312423 (0.0010) [2023-12-28 04:41:30,171][106225] Updated weights for policy 1, policy_version 1315834 (0.0008) [2023-12-28 04:41:30,223][106226] Updated weights for policy 0, policy_version 1312433 (0.0011) [2023-12-28 04:41:30,234][106225] Updated weights for policy 1, policy_version 1315844 (0.0006) [2023-12-28 04:41:30,285][106225] Updated weights for policy 1, policy_version 1315854 (0.0008) [2023-12-28 04:41:30,343][106225] Updated weights for policy 1, policy_version 1315864 (0.0008) [2023-12-28 04:41:30,909][106226] Updated weights for policy 0, policy_version 1312443 (0.0007) [2023-12-28 04:41:30,957][106226] Updated weights for policy 0, policy_version 1312453 (0.0010) [2023-12-28 04:41:31,010][106226] Updated weights for policy 0, policy_version 1312463 (0.0010) [2023-12-28 04:41:31,074][106225] Updated weights for policy 1, policy_version 1315874 (0.0008) [2023-12-28 04:41:31,128][106225] Updated weights for policy 1, policy_version 1315884 (0.0008) [2023-12-28 04:41:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 672964608. Throughput: 0: 9813.9, 1: 9954.8. Samples: 672955984. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:31,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.761')] [2023-12-28 04:41:31,192][106225] Updated weights for policy 1, policy_version 1315894 (0.0009) [2023-12-28 04:41:31,766][106226] Updated weights for policy 0, policy_version 1312473 (0.0010) [2023-12-28 04:41:31,821][106226] Updated weights for policy 0, policy_version 1312483 (0.0006) [2023-12-28 04:41:31,891][106226] Updated weights for policy 0, policy_version 1312493 (0.0006) [2023-12-28 04:41:31,942][106225] Updated weights for policy 1, policy_version 1315904 (0.0009) [2023-12-28 04:41:31,945][106226] Updated weights for policy 0, policy_version 1312503 (0.0005) [2023-12-28 04:41:31,992][106225] Updated weights for policy 1, policy_version 1315914 (0.0008) [2023-12-28 04:41:32,049][106225] Updated weights for policy 1, policy_version 1315924 (0.0010) [2023-12-28 04:41:32,678][106226] Updated weights for policy 0, policy_version 1312513 (0.0007) [2023-12-28 04:41:32,724][106225] Updated weights for policy 1, policy_version 1315934 (0.0008) [2023-12-28 04:41:32,737][106226] Updated weights for policy 0, policy_version 1312523 (0.0008) [2023-12-28 04:41:32,774][106225] Updated weights for policy 1, policy_version 1315944 (0.0010) [2023-12-28 04:41:32,795][106226] Updated weights for policy 0, policy_version 1312533 (0.0005) [2023-12-28 04:41:32,830][106225] Updated weights for policy 1, policy_version 1315954 (0.0010) [2023-12-28 04:41:33,359][106226] Updated weights for policy 0, policy_version 1312543 (0.0007) [2023-12-28 04:41:33,409][106226] Updated weights for policy 0, policy_version 1312553 (0.0005) [2023-12-28 04:41:33,475][106226] Updated weights for policy 0, policy_version 1312563 (0.0005) [2023-12-28 04:41:33,547][106225] Updated weights for policy 1, policy_version 1315964 (0.0010) [2023-12-28 04:41:33,614][106225] Updated weights for policy 1, policy_version 1315974 (0.0010) [2023-12-28 04:41:33,672][106225] Updated weights for policy 1, policy_version 1315984 (0.0010) [2023-12-28 04:41:34,038][106226] Updated weights for policy 0, policy_version 1312573 (0.0005) [2023-12-28 04:41:34,101][106226] Updated weights for policy 0, policy_version 1312583 (0.0005) [2023-12-28 04:41:34,171][106226] Updated weights for policy 0, policy_version 1312593 (0.0008) [2023-12-28 04:41:34,355][106225] Updated weights for policy 1, policy_version 1315994 (0.0010) [2023-12-28 04:41:34,426][106225] Updated weights for policy 1, policy_version 1316004 (0.0011) [2023-12-28 04:41:34,492][106225] Updated weights for policy 1, policy_version 1316014 (0.0011) [2023-12-28 04:41:34,558][106225] Updated weights for policy 1, policy_version 1316024 (0.0011) [2023-12-28 04:41:34,816][106226] Updated weights for policy 0, policy_version 1312603 (0.0009) [2023-12-28 04:41:34,874][106226] Updated weights for policy 0, policy_version 1312613 (0.0006) [2023-12-28 04:41:34,939][106226] Updated weights for policy 0, policy_version 1312623 (0.0010) [2023-12-28 04:41:35,261][106225] Updated weights for policy 1, policy_version 1316034 (0.0005) [2023-12-28 04:41:35,311][106225] Updated weights for policy 1, policy_version 1316044 (0.0005) [2023-12-28 04:41:35,363][106225] Updated weights for policy 1, policy_version 1316054 (0.0007) [2023-12-28 04:41:35,619][106226] Updated weights for policy 0, policy_version 1312633 (0.0011) [2023-12-28 04:41:35,682][106226] Updated weights for policy 0, policy_version 1312643 (0.0011) [2023-12-28 04:41:35,736][106226] Updated weights for policy 0, policy_version 1312653 (0.0010) [2023-12-28 04:41:35,799][106226] Updated weights for policy 0, policy_version 1312663 (0.0009) [2023-12-28 04:41:36,032][106225] Updated weights for policy 1, policy_version 1316064 (0.0010) [2023-12-28 04:41:36,091][106225] Updated weights for policy 1, policy_version 1316074 (0.0010) [2023-12-28 04:41:36,156][106225] Updated weights for policy 1, policy_version 1316084 (0.0009) [2023-12-28 04:41:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 673062912. Throughput: 0: 9863.0, 1: 9986.6. Samples: 673078248. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:36,175][105115] Avg episode reward: [(0, '-4.216'), (1, '-4.920')] [2023-12-28 04:41:36,432][106226] Updated weights for policy 0, policy_version 1312673 (0.0009) [2023-12-28 04:41:36,494][106226] Updated weights for policy 0, policy_version 1312683 (0.0009) [2023-12-28 04:41:36,555][106226] Updated weights for policy 0, policy_version 1312693 (0.0009) [2023-12-28 04:41:36,919][106225] Updated weights for policy 1, policy_version 1316094 (0.0008) [2023-12-28 04:41:36,985][106225] Updated weights for policy 1, policy_version 1316104 (0.0005) [2023-12-28 04:41:37,041][106225] Updated weights for policy 1, policy_version 1316114 (0.0005) [2023-12-28 04:41:37,291][106226] Updated weights for policy 0, policy_version 1312703 (0.0009) [2023-12-28 04:41:37,336][106226] Updated weights for policy 0, policy_version 1312713 (0.0009) [2023-12-28 04:41:37,389][106226] Updated weights for policy 0, policy_version 1312723 (0.0009) [2023-12-28 04:41:37,648][106225] Updated weights for policy 1, policy_version 1316124 (0.0007) [2023-12-28 04:41:37,716][106225] Updated weights for policy 1, policy_version 1316134 (0.0008) [2023-12-28 04:41:37,776][106225] Updated weights for policy 1, policy_version 1316144 (0.0008) [2023-12-28 04:41:38,112][106226] Updated weights for policy 0, policy_version 1312733 (0.0008) [2023-12-28 04:41:38,164][106226] Updated weights for policy 0, policy_version 1312743 (0.0007) [2023-12-28 04:41:38,221][106226] Updated weights for policy 0, policy_version 1312753 (0.0008) [2023-12-28 04:41:38,484][106225] Updated weights for policy 1, policy_version 1316154 (0.0008) [2023-12-28 04:41:38,544][106225] Updated weights for policy 1, policy_version 1316164 (0.0008) [2023-12-28 04:41:38,603][106225] Updated weights for policy 1, policy_version 1316174 (0.0008) [2023-12-28 04:41:38,666][106225] Updated weights for policy 1, policy_version 1316184 (0.0008) [2023-12-28 04:41:38,953][106226] Updated weights for policy 0, policy_version 1312763 (0.0009) [2023-12-28 04:41:39,005][106226] Updated weights for policy 0, policy_version 1312773 (0.0009) [2023-12-28 04:41:39,062][106226] Updated weights for policy 0, policy_version 1312783 (0.0008) [2023-12-28 04:41:39,390][106225] Updated weights for policy 1, policy_version 1316194 (0.0008) [2023-12-28 04:41:39,460][106225] Updated weights for policy 1, policy_version 1316204 (0.0007) [2023-12-28 04:41:39,519][106225] Updated weights for policy 1, policy_version 1316214 (0.0008) [2023-12-28 04:41:39,813][106226] Updated weights for policy 0, policy_version 1312793 (0.0009) [2023-12-28 04:41:39,886][106226] Updated weights for policy 0, policy_version 1312803 (0.0009) [2023-12-28 04:41:39,953][106226] Updated weights for policy 0, policy_version 1312813 (0.0009) [2023-12-28 04:41:40,015][106226] Updated weights for policy 0, policy_version 1312823 (0.0010) [2023-12-28 04:41:40,200][106225] Updated weights for policy 1, policy_version 1316224 (0.0006) [2023-12-28 04:41:40,261][106225] Updated weights for policy 1, policy_version 1316234 (0.0008) [2023-12-28 04:41:40,316][106225] Updated weights for policy 1, policy_version 1316244 (0.0010) [2023-12-28 04:41:40,779][106226] Updated weights for policy 0, policy_version 1312833 (0.0008) [2023-12-28 04:41:40,828][106226] Updated weights for policy 0, policy_version 1312843 (0.0007) [2023-12-28 04:41:40,895][106226] Updated weights for policy 0, policy_version 1312853 (0.0008) [2023-12-28 04:41:40,995][106225] Updated weights for policy 1, policy_version 1316254 (0.0007) [2023-12-28 04:41:41,060][106225] Updated weights for policy 1, policy_version 1316264 (0.0009) [2023-12-28 04:41:41,112][106225] Updated weights for policy 1, policy_version 1316274 (0.0010) [2023-12-28 04:41:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 673169408. Throughput: 0: 9837.5, 1: 9967.8. Samples: 673135912. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:41,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.663')] [2023-12-28 04:41:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001316280_337018880.pth... [2023-12-28 04:41:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001312856_336150528.pth... [2023-12-28 04:41:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001315128_336723968.pth [2023-12-28 04:41:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001311704_335855616.pth [2023-12-28 04:41:41,748][106226] Updated weights for policy 0, policy_version 1312863 (0.0009) [2023-12-28 04:41:41,809][106226] Updated weights for policy 0, policy_version 1312873 (0.0009) [2023-12-28 04:41:41,867][106226] Updated weights for policy 0, policy_version 1312883 (0.0008) [2023-12-28 04:41:41,868][106225] Updated weights for policy 1, policy_version 1316284 (0.0009) [2023-12-28 04:41:41,926][106225] Updated weights for policy 1, policy_version 1316294 (0.0005) [2023-12-28 04:41:41,985][106225] Updated weights for policy 1, policy_version 1316304 (0.0006) [2023-12-28 04:41:42,632][106226] Updated weights for policy 0, policy_version 1312893 (0.0008) [2023-12-28 04:41:42,684][106226] Updated weights for policy 0, policy_version 1312903 (0.0008) [2023-12-28 04:41:42,691][106225] Updated weights for policy 1, policy_version 1316314 (0.0006) [2023-12-28 04:41:42,740][106226] Updated weights for policy 0, policy_version 1312913 (0.0006) [2023-12-28 04:41:42,751][106225] Updated weights for policy 1, policy_version 1316324 (0.0006) [2023-12-28 04:41:42,808][106225] Updated weights for policy 1, policy_version 1316334 (0.0008) [2023-12-28 04:41:42,868][106225] Updated weights for policy 1, policy_version 1316344 (0.0008) [2023-12-28 04:41:43,458][106225] Updated weights for policy 1, policy_version 1316354 (0.0005) [2023-12-28 04:41:43,506][106225] Updated weights for policy 1, policy_version 1316364 (0.0005) [2023-12-28 04:41:43,553][106226] Updated weights for policy 0, policy_version 1312923 (0.0009) [2023-12-28 04:41:43,557][106225] Updated weights for policy 1, policy_version 1316374 (0.0005) [2023-12-28 04:41:43,608][106226] Updated weights for policy 0, policy_version 1312933 (0.0008) [2023-12-28 04:41:43,678][106226] Updated weights for policy 0, policy_version 1312943 (0.0010) [2023-12-28 04:41:44,127][106225] Updated weights for policy 1, policy_version 1316384 (0.0005) [2023-12-28 04:41:44,185][106225] Updated weights for policy 1, policy_version 1316394 (0.0005) [2023-12-28 04:41:44,250][106225] Updated weights for policy 1, policy_version 1316404 (0.0007) [2023-12-28 04:41:44,483][106226] Updated weights for policy 0, policy_version 1312953 (0.0009) [2023-12-28 04:41:44,554][106226] Updated weights for policy 0, policy_version 1312963 (0.0008) [2023-12-28 04:41:44,615][106226] Updated weights for policy 0, policy_version 1312973 (0.0009) [2023-12-28 04:41:44,684][106226] Updated weights for policy 0, policy_version 1312983 (0.0006) [2023-12-28 04:41:44,806][106225] Updated weights for policy 1, policy_version 1316414 (0.0008) [2023-12-28 04:41:44,867][106225] Updated weights for policy 1, policy_version 1316424 (0.0008) [2023-12-28 04:41:44,927][106225] Updated weights for policy 1, policy_version 1316434 (0.0007) [2023-12-28 04:41:45,386][106226] Updated weights for policy 0, policy_version 1312993 (0.0008) [2023-12-28 04:41:45,452][106226] Updated weights for policy 0, policy_version 1313003 (0.0009) [2023-12-28 04:41:45,514][106226] Updated weights for policy 0, policy_version 1313013 (0.0009) [2023-12-28 04:41:45,635][106225] Updated weights for policy 1, policy_version 1316444 (0.0008) [2023-12-28 04:41:45,694][106225] Updated weights for policy 1, policy_version 1316454 (0.0008) [2023-12-28 04:41:45,743][106225] Updated weights for policy 1, policy_version 1316464 (0.0008) [2023-12-28 04:41:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 673259520. Throughput: 0: 9680.8, 1: 10020.5. Samples: 673252840. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:46,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.756')] [2023-12-28 04:41:46,208][106226] Updated weights for policy 0, policy_version 1313023 (0.0008) [2023-12-28 04:41:46,271][106226] Updated weights for policy 0, policy_version 1313033 (0.0009) [2023-12-28 04:41:46,341][106226] Updated weights for policy 0, policy_version 1313043 (0.0009) [2023-12-28 04:41:46,465][106225] Updated weights for policy 1, policy_version 1316474 (0.0008) [2023-12-28 04:41:46,526][106225] Updated weights for policy 1, policy_version 1316484 (0.0008) [2023-12-28 04:41:46,584][106225] Updated weights for policy 1, policy_version 1316494 (0.0008) [2023-12-28 04:41:46,640][106225] Updated weights for policy 1, policy_version 1316504 (0.0008) [2023-12-28 04:41:47,037][106226] Updated weights for policy 0, policy_version 1313053 (0.0010) [2023-12-28 04:41:47,099][106226] Updated weights for policy 0, policy_version 1313063 (0.0009) [2023-12-28 04:41:47,163][106226] Updated weights for policy 0, policy_version 1313073 (0.0009) [2023-12-28 04:41:47,332][106225] Updated weights for policy 1, policy_version 1316514 (0.0009) [2023-12-28 04:41:47,394][106225] Updated weights for policy 1, policy_version 1316524 (0.0008) [2023-12-28 04:41:47,444][106225] Updated weights for policy 1, policy_version 1316534 (0.0008) [2023-12-28 04:41:47,876][106226] Updated weights for policy 0, policy_version 1313083 (0.0009) [2023-12-28 04:41:47,939][106226] Updated weights for policy 0, policy_version 1313093 (0.0009) [2023-12-28 04:41:48,005][106226] Updated weights for policy 0, policy_version 1313103 (0.0009) [2023-12-28 04:41:48,170][106225] Updated weights for policy 1, policy_version 1316544 (0.0009) [2023-12-28 04:41:48,232][106225] Updated weights for policy 1, policy_version 1316554 (0.0008) [2023-12-28 04:41:48,297][106225] Updated weights for policy 1, policy_version 1316564 (0.0008) [2023-12-28 04:41:48,624][106226] Updated weights for policy 0, policy_version 1313113 (0.0008) [2023-12-28 04:41:48,694][106226] Updated weights for policy 0, policy_version 1313123 (0.0006) [2023-12-28 04:41:48,761][106226] Updated weights for policy 0, policy_version 1313133 (0.0006) [2023-12-28 04:41:48,828][106226] Updated weights for policy 0, policy_version 1313143 (0.0006) [2023-12-28 04:41:49,131][106225] Updated weights for policy 1, policy_version 1316574 (0.0009) [2023-12-28 04:41:49,197][106225] Updated weights for policy 1, policy_version 1316584 (0.0008) [2023-12-28 04:41:49,274][106225] Updated weights for policy 1, policy_version 1316594 (0.0008) [2023-12-28 04:41:49,481][106226] Updated weights for policy 0, policy_version 1313153 (0.0008) [2023-12-28 04:41:49,548][106226] Updated weights for policy 0, policy_version 1313163 (0.0008) [2023-12-28 04:41:49,614][106226] Updated weights for policy 0, policy_version 1313173 (0.0006) [2023-12-28 04:41:50,070][106225] Updated weights for policy 1, policy_version 1316604 (0.0006) [2023-12-28 04:41:50,137][106225] Updated weights for policy 1, policy_version 1316614 (0.0005) [2023-12-28 04:41:50,201][106225] Updated weights for policy 1, policy_version 1316624 (0.0007) [2023-12-28 04:41:50,324][106226] Updated weights for policy 0, policy_version 1313183 (0.0007) [2023-12-28 04:41:50,387][106226] Updated weights for policy 0, policy_version 1313193 (0.0006) [2023-12-28 04:41:50,453][106226] Updated weights for policy 0, policy_version 1313203 (0.0009) [2023-12-28 04:41:50,950][106225] Updated weights for policy 1, policy_version 1316634 (0.0008) [2023-12-28 04:41:51,011][106225] Updated weights for policy 1, policy_version 1316644 (0.0009) [2023-12-28 04:41:51,075][106225] Updated weights for policy 1, policy_version 1316654 (0.0008) [2023-12-28 04:41:51,081][106226] Updated weights for policy 0, policy_version 1313213 (0.0008) [2023-12-28 04:41:51,134][106225] Updated weights for policy 1, policy_version 1316664 (0.0007) [2023-12-28 04:41:51,148][106226] Updated weights for policy 0, policy_version 1313223 (0.0007) [2023-12-28 04:41:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 673357824. Throughput: 0: 9702.0, 1: 9895.1. Samples: 673368076. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:51,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.656')] [2023-12-28 04:41:51,215][106226] Updated weights for policy 0, policy_version 1313233 (0.0006) [2023-12-28 04:41:51,873][106225] Updated weights for policy 1, policy_version 1316674 (0.0009) [2023-12-28 04:41:51,934][106225] Updated weights for policy 1, policy_version 1316684 (0.0008) [2023-12-28 04:41:51,945][106226] Updated weights for policy 0, policy_version 1313243 (0.0007) [2023-12-28 04:41:51,991][106225] Updated weights for policy 1, policy_version 1316694 (0.0008) [2023-12-28 04:41:51,997][106226] Updated weights for policy 0, policy_version 1313253 (0.0006) [2023-12-28 04:41:52,058][106226] Updated weights for policy 0, policy_version 1313263 (0.0009) [2023-12-28 04:41:52,681][106225] Updated weights for policy 1, policy_version 1316704 (0.0008) [2023-12-28 04:41:52,733][106225] Updated weights for policy 1, policy_version 1316714 (0.0008) [2023-12-28 04:41:52,790][106225] Updated weights for policy 1, policy_version 1316724 (0.0008) [2023-12-28 04:41:52,854][106226] Updated weights for policy 0, policy_version 1313273 (0.0009) [2023-12-28 04:41:52,921][106226] Updated weights for policy 0, policy_version 1313283 (0.0008) [2023-12-28 04:41:52,985][106226] Updated weights for policy 0, policy_version 1313293 (0.0009) [2023-12-28 04:41:53,046][106226] Updated weights for policy 0, policy_version 1313303 (0.0008) [2023-12-28 04:41:53,588][106225] Updated weights for policy 1, policy_version 1316734 (0.0008) [2023-12-28 04:41:53,647][106225] Updated weights for policy 1, policy_version 1316744 (0.0008) [2023-12-28 04:41:53,710][106225] Updated weights for policy 1, policy_version 1316754 (0.0008) [2023-12-28 04:41:53,733][106226] Updated weights for policy 0, policy_version 1313313 (0.0007) [2023-12-28 04:41:53,786][106226] Updated weights for policy 0, policy_version 1313323 (0.0008) [2023-12-28 04:41:53,834][106226] Updated weights for policy 0, policy_version 1313333 (0.0008) [2023-12-28 04:41:54,474][106226] Updated weights for policy 0, policy_version 1313343 (0.0007) [2023-12-28 04:41:54,476][106225] Updated weights for policy 1, policy_version 1316764 (0.0008) [2023-12-28 04:41:54,533][106225] Updated weights for policy 1, policy_version 1316774 (0.0008) [2023-12-28 04:41:54,534][106226] Updated weights for policy 0, policy_version 1313353 (0.0006) [2023-12-28 04:41:54,591][106225] Updated weights for policy 1, policy_version 1316784 (0.0006) [2023-12-28 04:41:54,593][106226] Updated weights for policy 0, policy_version 1313363 (0.0009) [2023-12-28 04:41:55,258][106226] Updated weights for policy 0, policy_version 1313373 (0.0009) [2023-12-28 04:41:55,319][106226] Updated weights for policy 0, policy_version 1313383 (0.0008) [2023-12-28 04:41:55,321][106225] Updated weights for policy 1, policy_version 1316794 (0.0008) [2023-12-28 04:41:55,374][106225] Updated weights for policy 1, policy_version 1316804 (0.0006) [2023-12-28 04:41:55,376][106226] Updated weights for policy 0, policy_version 1313393 (0.0006) [2023-12-28 04:41:55,423][106225] Updated weights for policy 1, policy_version 1316814 (0.0008) [2023-12-28 04:41:55,485][106225] Updated weights for policy 1, policy_version 1316824 (0.0009) [2023-12-28 04:41:56,078][106225] Updated weights for policy 1, policy_version 1316834 (0.0005) [2023-12-28 04:41:56,119][106226] Updated weights for policy 0, policy_version 1313403 (0.0008) [2023-12-28 04:41:56,129][106225] Updated weights for policy 1, policy_version 1316844 (0.0005) [2023-12-28 04:41:56,168][106226] Updated weights for policy 0, policy_version 1313413 (0.0009) [2023-12-28 04:41:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.4, 300 sec: 19771.9). Total num frames: 673447936. Throughput: 0: 9683.9, 1: 9845.4. Samples: 673423948. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:41:56,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.754')] [2023-12-28 04:41:56,178][106225] Updated weights for policy 1, policy_version 1316854 (0.0005) [2023-12-28 04:41:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001316856_337166336.pth... [2023-12-28 04:41:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001315672_336863232.pth [2023-12-28 04:41:56,218][106226] Updated weights for policy 0, policy_version 1313423 (0.0007) [2023-12-28 04:41:56,257][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001313432_336297984.pth... [2023-12-28 04:41:56,260][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001312280_336003072.pth [2023-12-28 04:41:56,840][106225] Updated weights for policy 1, policy_version 1316864 (0.0008) [2023-12-28 04:41:56,886][106225] Updated weights for policy 1, policy_version 1316874 (0.0006) [2023-12-28 04:41:56,938][106225] Updated weights for policy 1, policy_version 1316884 (0.0005) [2023-12-28 04:41:56,966][106226] Updated weights for policy 0, policy_version 1313433 (0.0008) [2023-12-28 04:41:57,016][106226] Updated weights for policy 0, policy_version 1313443 (0.0009) [2023-12-28 04:41:57,079][106226] Updated weights for policy 0, policy_version 1313453 (0.0010) [2023-12-28 04:41:57,144][106226] Updated weights for policy 0, policy_version 1313463 (0.0009) [2023-12-28 04:41:57,531][106225] Updated weights for policy 1, policy_version 1316894 (0.0007) [2023-12-28 04:41:57,576][106225] Updated weights for policy 1, policy_version 1316904 (0.0008) [2023-12-28 04:41:57,619][106225] Updated weights for policy 1, policy_version 1316914 (0.0008) [2023-12-28 04:41:57,850][106226] Updated weights for policy 0, policy_version 1313473 (0.0008) [2023-12-28 04:41:57,909][106226] Updated weights for policy 0, policy_version 1313483 (0.0009) [2023-12-28 04:41:57,970][106226] Updated weights for policy 0, policy_version 1313493 (0.0008) [2023-12-28 04:41:58,322][106225] Updated weights for policy 1, policy_version 1316924 (0.0008) [2023-12-28 04:41:58,396][106225] Updated weights for policy 1, policy_version 1316934 (0.0008) [2023-12-28 04:41:58,460][106225] Updated weights for policy 1, policy_version 1316944 (0.0009) [2023-12-28 04:41:58,752][106226] Updated weights for policy 0, policy_version 1313503 (0.0007) [2023-12-28 04:41:58,816][106226] Updated weights for policy 0, policy_version 1313513 (0.0007) [2023-12-28 04:41:58,889][106226] Updated weights for policy 0, policy_version 1313523 (0.0007) [2023-12-28 04:41:59,286][106225] Updated weights for policy 1, policy_version 1316954 (0.0009) [2023-12-28 04:41:59,373][106225] Updated weights for policy 1, policy_version 1316964 (0.0012) [2023-12-28 04:41:59,433][106225] Updated weights for policy 1, policy_version 1316974 (0.0009) [2023-12-28 04:41:59,490][106225] Updated weights for policy 1, policy_version 1316984 (0.0009) [2023-12-28 04:41:59,691][106226] Updated weights for policy 0, policy_version 1313533 (0.0009) [2023-12-28 04:41:59,754][106226] Updated weights for policy 0, policy_version 1313543 (0.0010) [2023-12-28 04:41:59,811][106226] Updated weights for policy 0, policy_version 1313553 (0.0010) [2023-12-28 04:42:00,257][106225] Updated weights for policy 1, policy_version 1316994 (0.0005) [2023-12-28 04:42:00,315][106225] Updated weights for policy 1, policy_version 1317004 (0.0006) [2023-12-28 04:42:00,372][106225] Updated weights for policy 1, policy_version 1317014 (0.0008) [2023-12-28 04:42:00,527][106226] Updated weights for policy 0, policy_version 1313563 (0.0010) [2023-12-28 04:42:00,586][106226] Updated weights for policy 0, policy_version 1313573 (0.0008) [2023-12-28 04:42:00,630][106226] Updated weights for policy 0, policy_version 1313583 (0.0008) [2023-12-28 04:42:01,056][106225] Updated weights for policy 1, policy_version 1317024 (0.0008) [2023-12-28 04:42:01,117][106225] Updated weights for policy 1, policy_version 1317034 (0.0006) [2023-12-28 04:42:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 673546240. Throughput: 0: 9714.7, 1: 9871.5. Samples: 673540980. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:01,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.983')] [2023-12-28 04:42:01,183][106225] Updated weights for policy 1, policy_version 1317044 (0.0007) [2023-12-28 04:42:01,360][106226] Updated weights for policy 0, policy_version 1313593 (0.0008) [2023-12-28 04:42:01,432][106226] Updated weights for policy 0, policy_version 1313603 (0.0008) [2023-12-28 04:42:01,498][106226] Updated weights for policy 0, policy_version 1313613 (0.0006) [2023-12-28 04:42:01,563][106226] Updated weights for policy 0, policy_version 1313623 (0.0008) [2023-12-28 04:42:01,914][106225] Updated weights for policy 1, policy_version 1317054 (0.0006) [2023-12-28 04:42:01,970][106225] Updated weights for policy 1, policy_version 1317064 (0.0009) [2023-12-28 04:42:02,036][106225] Updated weights for policy 1, policy_version 1317074 (0.0011) [2023-12-28 04:42:02,269][106226] Updated weights for policy 0, policy_version 1313633 (0.0009) [2023-12-28 04:42:02,326][106226] Updated weights for policy 0, policy_version 1313643 (0.0010) [2023-12-28 04:42:02,389][106226] Updated weights for policy 0, policy_version 1313653 (0.0008) [2023-12-28 04:42:02,715][106225] Updated weights for policy 1, policy_version 1317084 (0.0011) [2023-12-28 04:42:02,781][106225] Updated weights for policy 1, policy_version 1317094 (0.0007) [2023-12-28 04:42:02,839][106225] Updated weights for policy 1, policy_version 1317104 (0.0008) [2023-12-28 04:42:03,126][106226] Updated weights for policy 0, policy_version 1313663 (0.0008) [2023-12-28 04:42:03,179][106226] Updated weights for policy 0, policy_version 1313673 (0.0007) [2023-12-28 04:42:03,239][106226] Updated weights for policy 0, policy_version 1313683 (0.0009) [2023-12-28 04:42:03,445][106225] Updated weights for policy 1, policy_version 1317114 (0.0007) [2023-12-28 04:42:03,502][106225] Updated weights for policy 1, policy_version 1317124 (0.0008) [2023-12-28 04:42:03,553][106225] Updated weights for policy 1, policy_version 1317134 (0.0008) [2023-12-28 04:42:03,602][106225] Updated weights for policy 1, policy_version 1317144 (0.0008) [2023-12-28 04:42:03,960][106226] Updated weights for policy 0, policy_version 1313693 (0.0009) [2023-12-28 04:42:04,018][106226] Updated weights for policy 0, policy_version 1313703 (0.0010) [2023-12-28 04:42:04,078][106226] Updated weights for policy 0, policy_version 1313713 (0.0011) [2023-12-28 04:42:04,351][106225] Updated weights for policy 1, policy_version 1317154 (0.0009) [2023-12-28 04:42:04,413][106225] Updated weights for policy 1, policy_version 1317164 (0.0007) [2023-12-28 04:42:04,472][106225] Updated weights for policy 1, policy_version 1317174 (0.0008) [2023-12-28 04:42:04,760][106226] Updated weights for policy 0, policy_version 1313723 (0.0010) [2023-12-28 04:42:04,814][106226] Updated weights for policy 0, policy_version 1313733 (0.0008) [2023-12-28 04:42:04,877][106226] Updated weights for policy 0, policy_version 1313743 (0.0006) [2023-12-28 04:42:05,225][106225] Updated weights for policy 1, policy_version 1317184 (0.0010) [2023-12-28 04:42:05,283][106225] Updated weights for policy 1, policy_version 1317194 (0.0010) [2023-12-28 04:42:05,340][106225] Updated weights for policy 1, policy_version 1317204 (0.0010) [2023-12-28 04:42:05,515][106226] Updated weights for policy 0, policy_version 1313753 (0.0005) [2023-12-28 04:42:05,565][106226] Updated weights for policy 0, policy_version 1313763 (0.0008) [2023-12-28 04:42:05,620][106226] Updated weights for policy 0, policy_version 1313773 (0.0009) [2023-12-28 04:42:05,675][106226] Updated weights for policy 0, policy_version 1313783 (0.0005) [2023-12-28 04:42:05,976][106225] Updated weights for policy 1, policy_version 1317214 (0.0007) [2023-12-28 04:42:06,034][106225] Updated weights for policy 1, policy_version 1317224 (0.0005) [2023-12-28 04:42:06,094][106225] Updated weights for policy 1, policy_version 1317234 (0.0008) [2023-12-28 04:42:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 673652736. Throughput: 0: 9752.4, 1: 9920.8. Samples: 673660124. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:06,175][105115] Avg episode reward: [(0, '-4.397'), (1, '-4.758')] [2023-12-28 04:42:06,343][106226] Updated weights for policy 0, policy_version 1313793 (0.0009) [2023-12-28 04:42:06,401][106226] Updated weights for policy 0, policy_version 1313803 (0.0009) [2023-12-28 04:42:06,463][106226] Updated weights for policy 0, policy_version 1313813 (0.0010) [2023-12-28 04:42:06,714][106225] Updated weights for policy 1, policy_version 1317244 (0.0008) [2023-12-28 04:42:06,772][106225] Updated weights for policy 1, policy_version 1317254 (0.0007) [2023-12-28 04:42:06,821][106225] Updated weights for policy 1, policy_version 1317264 (0.0007) [2023-12-28 04:42:07,116][106226] Updated weights for policy 0, policy_version 1313823 (0.0008) [2023-12-28 04:42:07,182][106226] Updated weights for policy 0, policy_version 1313833 (0.0009) [2023-12-28 04:42:07,242][106226] Updated weights for policy 0, policy_version 1313843 (0.0009) [2023-12-28 04:42:07,458][106225] Updated weights for policy 1, policy_version 1317274 (0.0007) [2023-12-28 04:42:07,531][106225] Updated weights for policy 1, policy_version 1317284 (0.0009) [2023-12-28 04:42:07,577][106225] Updated weights for policy 1, policy_version 1317294 (0.0009) [2023-12-28 04:42:07,638][106225] Updated weights for policy 1, policy_version 1317304 (0.0009) [2023-12-28 04:42:07,915][106226] Updated weights for policy 0, policy_version 1313853 (0.0008) [2023-12-28 04:42:07,978][106226] Updated weights for policy 0, policy_version 1313863 (0.0010) [2023-12-28 04:42:08,042][106226] Updated weights for policy 0, policy_version 1313873 (0.0007) [2023-12-28 04:42:08,399][106225] Updated weights for policy 1, policy_version 1317314 (0.0010) [2023-12-28 04:42:08,457][106225] Updated weights for policy 1, policy_version 1317324 (0.0010) [2023-12-28 04:42:08,514][106225] Updated weights for policy 1, policy_version 1317334 (0.0010) [2023-12-28 04:42:08,783][106226] Updated weights for policy 0, policy_version 1313883 (0.0010) [2023-12-28 04:42:08,841][106226] Updated weights for policy 0, policy_version 1313893 (0.0010) [2023-12-28 04:42:08,899][106226] Updated weights for policy 0, policy_version 1313903 (0.0010) [2023-12-28 04:42:08,903][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000003 [2023-12-28 04:42:09,203][106225] Updated weights for policy 1, policy_version 1317344 (0.0010) [2023-12-28 04:42:09,272][106225] Updated weights for policy 1, policy_version 1317354 (0.0008) [2023-12-28 04:42:09,333][106225] Updated weights for policy 1, policy_version 1317364 (0.0010) [2023-12-28 04:42:09,709][106226] Updated weights for policy 0, policy_version 1313913 (0.0010) [2023-12-28 04:42:09,775][106226] Updated weights for policy 0, policy_version 1313923 (0.0006) [2023-12-28 04:42:09,849][106226] Updated weights for policy 0, policy_version 1313933 (0.0007) [2023-12-28 04:42:10,011][106225] Updated weights for policy 1, policy_version 1317374 (0.0010) [2023-12-28 04:42:10,079][106225] Updated weights for policy 1, policy_version 1317384 (0.0011) [2023-12-28 04:42:10,147][106225] Updated weights for policy 1, policy_version 1317394 (0.0011) [2023-12-28 04:42:10,463][106226] Updated weights for policy 0, policy_version 1313943 (0.0009) [2023-12-28 04:42:10,514][106226] Updated weights for policy 0, policy_version 1313953 (0.0010) [2023-12-28 04:42:10,571][106226] Updated weights for policy 0, policy_version 1313963 (0.0011) [2023-12-28 04:42:10,774][106225] Updated weights for policy 1, policy_version 1317404 (0.0009) [2023-12-28 04:42:10,834][106225] Updated weights for policy 1, policy_version 1317414 (0.0006) [2023-12-28 04:42:10,892][106225] Updated weights for policy 1, policy_version 1317424 (0.0010) [2023-12-28 04:42:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 673751040. Throughput: 0: 9765.9, 1: 9992.7. Samples: 673720508. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:11,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-4.785')] [2023-12-28 04:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001317432_337313792.pth... [2023-12-28 04:42:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001313968_336437248.pth... [2023-12-28 04:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001316280_337018880.pth [2023-12-28 04:42:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001312856_336150528.pth [2023-12-28 04:42:11,305][106226] Updated weights for policy 0, policy_version 1313973 (0.0009) [2023-12-28 04:42:11,376][106226] Updated weights for policy 0, policy_version 1313983 (0.0007) [2023-12-28 04:42:11,440][106226] Updated weights for policy 0, policy_version 1313993 (0.0006) [2023-12-28 04:42:11,636][106225] Updated weights for policy 1, policy_version 1317434 (0.0009) [2023-12-28 04:42:11,698][106225] Updated weights for policy 1, policy_version 1317444 (0.0009) [2023-12-28 04:42:11,767][106225] Updated weights for policy 1, policy_version 1317454 (0.0009) [2023-12-28 04:42:11,833][106225] Updated weights for policy 1, policy_version 1317464 (0.0010) [2023-12-28 04:42:12,095][106226] Updated weights for policy 0, policy_version 1314003 (0.0007) [2023-12-28 04:42:12,152][106226] Updated weights for policy 0, policy_version 1314013 (0.0008) [2023-12-28 04:42:12,209][106226] Updated weights for policy 0, policy_version 1314023 (0.0009) [2023-12-28 04:42:12,655][106225] Updated weights for policy 1, policy_version 1317474 (0.0009) [2023-12-28 04:42:12,710][106225] Updated weights for policy 1, policy_version 1317484 (0.0008) [2023-12-28 04:42:12,774][106225] Updated weights for policy 1, policy_version 1317494 (0.0006) [2023-12-28 04:42:12,955][106226] Updated weights for policy 0, policy_version 1314033 (0.0009) [2023-12-28 04:42:13,018][106226] Updated weights for policy 0, policy_version 1314043 (0.0006) [2023-12-28 04:42:13,068][106226] Updated weights for policy 0, policy_version 1314053 (0.0007) [2023-12-28 04:42:13,117][106226] Updated weights for policy 0, policy_version 1314063 (0.0008) [2023-12-28 04:42:13,495][106225] Updated weights for policy 1, policy_version 1317504 (0.0009) [2023-12-28 04:42:13,560][106225] Updated weights for policy 1, policy_version 1317514 (0.0005) [2023-12-28 04:42:13,616][106225] Updated weights for policy 1, policy_version 1317524 (0.0005) [2023-12-28 04:42:13,790][106226] Updated weights for policy 0, policy_version 1314073 (0.0005) [2023-12-28 04:42:13,846][106226] Updated weights for policy 0, policy_version 1314083 (0.0008) [2023-12-28 04:42:13,908][106226] Updated weights for policy 0, policy_version 1314093 (0.0006) [2023-12-28 04:42:14,286][106225] Updated weights for policy 1, policy_version 1317534 (0.0008) [2023-12-28 04:42:14,340][106225] Updated weights for policy 1, policy_version 1317544 (0.0009) [2023-12-28 04:42:14,397][106225] Updated weights for policy 1, policy_version 1317554 (0.0009) [2023-12-28 04:42:14,503][106226] Updated weights for policy 0, policy_version 1314103 (0.0008) [2023-12-28 04:42:14,551][106226] Updated weights for policy 0, policy_version 1314113 (0.0008) [2023-12-28 04:42:14,596][106226] Updated weights for policy 0, policy_version 1314123 (0.0008) [2023-12-28 04:42:15,162][106225] Updated weights for policy 1, policy_version 1317564 (0.0008) [2023-12-28 04:42:15,219][106225] Updated weights for policy 1, policy_version 1317574 (0.0009) [2023-12-28 04:42:15,278][106225] Updated weights for policy 1, policy_version 1317584 (0.0008) [2023-12-28 04:42:15,328][106226] Updated weights for policy 0, policy_version 1314133 (0.0009) [2023-12-28 04:42:15,394][106226] Updated weights for policy 0, policy_version 1314143 (0.0007) [2023-12-28 04:42:15,463][106226] Updated weights for policy 0, policy_version 1314153 (0.0008) [2023-12-28 04:42:15,914][106225] Updated weights for policy 1, policy_version 1317594 (0.0008) [2023-12-28 04:42:15,976][106225] Updated weights for policy 1, policy_version 1317604 (0.0009) [2023-12-28 04:42:16,035][106225] Updated weights for policy 1, policy_version 1317614 (0.0008) [2023-12-28 04:42:16,096][106225] Updated weights for policy 1, policy_version 1317624 (0.0009) [2023-12-28 04:42:16,161][106226] Updated weights for policy 0, policy_version 1314163 (0.0007) [2023-12-28 04:42:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 673849344. Throughput: 0: 9764.7, 1: 9839.6. Samples: 673838176. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:16,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.704')] [2023-12-28 04:42:16,228][106226] Updated weights for policy 0, policy_version 1314173 (0.0006) [2023-12-28 04:42:16,293][106226] Updated weights for policy 0, policy_version 1314183 (0.0008) [2023-12-28 04:42:16,818][106225] Updated weights for policy 1, policy_version 1317634 (0.0008) [2023-12-28 04:42:16,883][106225] Updated weights for policy 1, policy_version 1317644 (0.0008) [2023-12-28 04:42:16,945][106225] Updated weights for policy 1, policy_version 1317654 (0.0009) [2023-12-28 04:42:16,983][106226] Updated weights for policy 0, policy_version 1314193 (0.0008) [2023-12-28 04:42:17,037][106226] Updated weights for policy 0, policy_version 1314203 (0.0007) [2023-12-28 04:42:17,097][106226] Updated weights for policy 0, policy_version 1314213 (0.0009) [2023-12-28 04:42:17,160][106226] Updated weights for policy 0, policy_version 1314223 (0.0008) [2023-12-28 04:42:17,683][106225] Updated weights for policy 1, policy_version 1317664 (0.0008) [2023-12-28 04:42:17,738][106225] Updated weights for policy 1, policy_version 1317674 (0.0008) [2023-12-28 04:42:17,801][106225] Updated weights for policy 1, policy_version 1317684 (0.0008) [2023-12-28 04:42:17,818][106226] Updated weights for policy 0, policy_version 1314233 (0.0008) [2023-12-28 04:42:17,882][106226] Updated weights for policy 0, policy_version 1314243 (0.0009) [2023-12-28 04:42:17,941][106226] Updated weights for policy 0, policy_version 1314253 (0.0009) [2023-12-28 04:42:18,532][106225] Updated weights for policy 1, policy_version 1317694 (0.0007) [2023-12-28 04:42:18,589][106225] Updated weights for policy 1, policy_version 1317704 (0.0007) [2023-12-28 04:42:18,648][106226] Updated weights for policy 0, policy_version 1314263 (0.0008) [2023-12-28 04:42:18,651][106225] Updated weights for policy 1, policy_version 1317714 (0.0008) [2023-12-28 04:42:18,706][106226] Updated weights for policy 0, policy_version 1314273 (0.0011) [2023-12-28 04:42:18,767][106226] Updated weights for policy 0, policy_version 1314283 (0.0011) [2023-12-28 04:42:19,437][106225] Updated weights for policy 1, policy_version 1317724 (0.0006) [2023-12-28 04:42:19,456][106226] Updated weights for policy 0, policy_version 1314293 (0.0009) [2023-12-28 04:42:19,499][106225] Updated weights for policy 1, policy_version 1317734 (0.0008) [2023-12-28 04:42:19,529][106226] Updated weights for policy 0, policy_version 1314303 (0.0008) [2023-12-28 04:42:19,562][106225] Updated weights for policy 1, policy_version 1317744 (0.0008) [2023-12-28 04:42:19,592][106226] Updated weights for policy 0, policy_version 1314313 (0.0009) [2023-12-28 04:42:20,339][106225] Updated weights for policy 1, policy_version 1317754 (0.0008) [2023-12-28 04:42:20,349][106226] Updated weights for policy 0, policy_version 1314323 (0.0010) [2023-12-28 04:42:20,404][106225] Updated weights for policy 1, policy_version 1317764 (0.0006) [2023-12-28 04:42:20,409][106226] Updated weights for policy 0, policy_version 1314333 (0.0007) [2023-12-28 04:42:20,474][106225] Updated weights for policy 1, policy_version 1317774 (0.0008) [2023-12-28 04:42:20,477][106226] Updated weights for policy 0, policy_version 1314343 (0.0007) [2023-12-28 04:42:20,542][106225] Updated weights for policy 1, policy_version 1317784 (0.0008) [2023-12-28 04:42:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 673939456. Throughput: 0: 9659.2, 1: 9760.7. Samples: 673952144. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:21,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-4.655')] [2023-12-28 04:42:21,246][106225] Updated weights for policy 1, policy_version 1317794 (0.0008) [2023-12-28 04:42:21,261][106226] Updated weights for policy 0, policy_version 1314353 (0.0006) [2023-12-28 04:42:21,313][106225] Updated weights for policy 1, policy_version 1317804 (0.0008) [2023-12-28 04:42:21,325][106226] Updated weights for policy 0, policy_version 1314363 (0.0008) [2023-12-28 04:42:21,382][106225] Updated weights for policy 1, policy_version 1317814 (0.0009) [2023-12-28 04:42:21,399][106226] Updated weights for policy 0, policy_version 1314373 (0.0009) [2023-12-28 04:42:21,473][106226] Updated weights for policy 0, policy_version 1314383 (0.0006) [2023-12-28 04:42:22,180][106225] Updated weights for policy 1, policy_version 1317824 (0.0011) [2023-12-28 04:42:22,238][106225] Updated weights for policy 1, policy_version 1317834 (0.0011) [2023-12-28 04:42:22,255][106226] Updated weights for policy 0, policy_version 1314393 (0.0009) [2023-12-28 04:42:22,300][106225] Updated weights for policy 1, policy_version 1317844 (0.0009) [2023-12-28 04:42:22,321][106226] Updated weights for policy 0, policy_version 1314403 (0.0008) [2023-12-28 04:42:22,388][106226] Updated weights for policy 0, policy_version 1314413 (0.0008) [2023-12-28 04:42:22,962][106225] Updated weights for policy 1, policy_version 1317854 (0.0006) [2023-12-28 04:42:23,020][106225] Updated weights for policy 1, policy_version 1317864 (0.0006) [2023-12-28 04:42:23,086][106225] Updated weights for policy 1, policy_version 1317874 (0.0007) [2023-12-28 04:42:23,208][106226] Updated weights for policy 0, policy_version 1314423 (0.0007) [2023-12-28 04:42:23,268][106226] Updated weights for policy 0, policy_version 1314433 (0.0008) [2023-12-28 04:42:23,327][106226] Updated weights for policy 0, policy_version 1314443 (0.0008) [2023-12-28 04:42:23,713][106225] Updated weights for policy 1, policy_version 1317884 (0.0006) [2023-12-28 04:42:23,769][106225] Updated weights for policy 1, policy_version 1317894 (0.0006) [2023-12-28 04:42:23,820][106225] Updated weights for policy 1, policy_version 1317904 (0.0006) [2023-12-28 04:42:24,006][106226] Updated weights for policy 0, policy_version 1314453 (0.0006) [2023-12-28 04:42:24,060][106226] Updated weights for policy 0, policy_version 1314464 (0.0008) [2023-12-28 04:42:24,117][106226] Updated weights for policy 0, policy_version 1314474 (0.0009) [2023-12-28 04:42:24,400][106225] Updated weights for policy 1, policy_version 1317914 (0.0006) [2023-12-28 04:42:24,456][106225] Updated weights for policy 1, policy_version 1317924 (0.0005) [2023-12-28 04:42:24,505][106225] Updated weights for policy 1, policy_version 1317934 (0.0005) [2023-12-28 04:42:24,573][106225] Updated weights for policy 1, policy_version 1317944 (0.0005) [2023-12-28 04:42:24,933][106226] Updated weights for policy 0, policy_version 1314484 (0.0009) [2023-12-28 04:42:24,992][106226] Updated weights for policy 0, policy_version 1314494 (0.0009) [2023-12-28 04:42:25,050][106226] Updated weights for policy 0, policy_version 1314504 (0.0008) [2023-12-28 04:42:25,096][106225] Updated weights for policy 1, policy_version 1317954 (0.0007) [2023-12-28 04:42:25,139][106225] Updated weights for policy 1, policy_version 1317964 (0.0008) [2023-12-28 04:42:25,187][106225] Updated weights for policy 1, policy_version 1317974 (0.0008) [2023-12-28 04:42:25,780][106226] Updated weights for policy 0, policy_version 1314514 (0.0008) [2023-12-28 04:42:25,835][106226] Updated weights for policy 0, policy_version 1314524 (0.0009) [2023-12-28 04:42:25,894][106226] Updated weights for policy 0, policy_version 1314534 (0.0008) [2023-12-28 04:42:25,937][106225] Updated weights for policy 1, policy_version 1317984 (0.0007) [2023-12-28 04:42:25,947][106226] Updated weights for policy 0, policy_version 1314544 (0.0007) [2023-12-28 04:42:25,991][106225] Updated weights for policy 1, policy_version 1317994 (0.0008) [2023-12-28 04:42:26,044][106225] Updated weights for policy 1, policy_version 1318004 (0.0008) [2023-12-28 04:42:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 674045952. Throughput: 0: 9636.3, 1: 9767.5. Samples: 674009080. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:26,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-4.671')] [2023-12-28 04:42:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001314544_336584704.pth... [2023-12-28 04:42:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001318008_337461248.pth... [2023-12-28 04:42:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001313432_336297984.pth [2023-12-28 04:42:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001316856_337166336.pth [2023-12-28 04:42:26,639][106226] Updated weights for policy 0, policy_version 1314554 (0.0009) [2023-12-28 04:42:26,691][106226] Updated weights for policy 0, policy_version 1314564 (0.0009) [2023-12-28 04:42:26,741][106226] Updated weights for policy 0, policy_version 1314574 (0.0007) [2023-12-28 04:42:26,776][106225] Updated weights for policy 1, policy_version 1318014 (0.0008) [2023-12-28 04:42:26,836][106225] Updated weights for policy 1, policy_version 1318024 (0.0008) [2023-12-28 04:42:26,886][106225] Updated weights for policy 1, policy_version 1318034 (0.0008) [2023-12-28 04:42:27,488][106226] Updated weights for policy 0, policy_version 1314584 (0.0008) [2023-12-28 04:42:27,541][106226] Updated weights for policy 0, policy_version 1314594 (0.0008) [2023-12-28 04:42:27,595][106225] Updated weights for policy 1, policy_version 1318044 (0.0009) [2023-12-28 04:42:27,601][106226] Updated weights for policy 0, policy_version 1314604 (0.0008) [2023-12-28 04:42:27,645][106225] Updated weights for policy 1, policy_version 1318054 (0.0007) [2023-12-28 04:42:27,688][106225] Updated weights for policy 1, policy_version 1318064 (0.0008) [2023-12-28 04:42:28,328][106226] Updated weights for policy 0, policy_version 1314614 (0.0008) [2023-12-28 04:42:28,394][106226] Updated weights for policy 0, policy_version 1314624 (0.0008) [2023-12-28 04:42:28,428][106225] Updated weights for policy 1, policy_version 1318074 (0.0008) [2023-12-28 04:42:28,457][106226] Updated weights for policy 0, policy_version 1314634 (0.0006) [2023-12-28 04:42:28,489][106225] Updated weights for policy 1, policy_version 1318084 (0.0008) [2023-12-28 04:42:28,556][106225] Updated weights for policy 1, policy_version 1318094 (0.0008) [2023-12-28 04:42:28,615][106225] Updated weights for policy 1, policy_version 1318104 (0.0009) [2023-12-28 04:42:29,075][106226] Updated weights for policy 0, policy_version 1314644 (0.0006) [2023-12-28 04:42:29,136][106226] Updated weights for policy 0, policy_version 1314654 (0.0005) [2023-12-28 04:42:29,196][106226] Updated weights for policy 0, policy_version 1314664 (0.0005) [2023-12-28 04:42:29,360][106225] Updated weights for policy 1, policy_version 1318114 (0.0008) [2023-12-28 04:42:29,419][106225] Updated weights for policy 1, policy_version 1318124 (0.0008) [2023-12-28 04:42:29,465][106225] Updated weights for policy 1, policy_version 1318134 (0.0009) [2023-12-28 04:42:29,916][106226] Updated weights for policy 0, policy_version 1314674 (0.0009) [2023-12-28 04:42:29,985][106226] Updated weights for policy 0, policy_version 1314684 (0.0008) [2023-12-28 04:42:30,041][106226] Updated weights for policy 0, policy_version 1314694 (0.0008) [2023-12-28 04:42:30,103][106226] Updated weights for policy 0, policy_version 1314704 (0.0008) [2023-12-28 04:42:30,229][106225] Updated weights for policy 1, policy_version 1318144 (0.0009) [2023-12-28 04:42:30,279][106225] Updated weights for policy 1, policy_version 1318154 (0.0008) [2023-12-28 04:42:30,344][106225] Updated weights for policy 1, policy_version 1318164 (0.0008) [2023-12-28 04:42:30,790][106226] Updated weights for policy 0, policy_version 1314714 (0.0005) [2023-12-28 04:42:30,835][106226] Updated weights for policy 0, policy_version 1314724 (0.0005) [2023-12-28 04:42:30,880][106226] Updated weights for policy 0, policy_version 1314734 (0.0005) [2023-12-28 04:42:31,088][106225] Updated weights for policy 1, policy_version 1318174 (0.0008) [2023-12-28 04:42:31,146][106225] Updated weights for policy 1, policy_version 1318184 (0.0008) [2023-12-28 04:42:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 674136064. Throughput: 0: 9712.5, 1: 9725.7. Samples: 674127564. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:31,176][105115] Avg episode reward: [(0, '-4.480'), (1, '-5.111')] [2023-12-28 04:42:31,197][106225] Updated weights for policy 1, policy_version 1318194 (0.0008) [2023-12-28 04:42:31,574][106226] Updated weights for policy 0, policy_version 1314744 (0.0005) [2023-12-28 04:42:31,640][106226] Updated weights for policy 0, policy_version 1314754 (0.0007) [2023-12-28 04:42:31,704][106226] Updated weights for policy 0, policy_version 1314764 (0.0007) [2023-12-28 04:42:32,025][106225] Updated weights for policy 1, policy_version 1318204 (0.0009) [2023-12-28 04:42:32,082][106225] Updated weights for policy 1, policy_version 1318214 (0.0010) [2023-12-28 04:42:32,140][106225] Updated weights for policy 1, policy_version 1318224 (0.0010) [2023-12-28 04:42:32,355][106226] Updated weights for policy 0, policy_version 1314774 (0.0010) [2023-12-28 04:42:32,421][106226] Updated weights for policy 0, policy_version 1314784 (0.0011) [2023-12-28 04:42:32,487][106226] Updated weights for policy 0, policy_version 1314794 (0.0010) [2023-12-28 04:42:32,861][106225] Updated weights for policy 1, policy_version 1318234 (0.0010) [2023-12-28 04:42:32,917][106225] Updated weights for policy 1, policy_version 1318244 (0.0010) [2023-12-28 04:42:32,967][106225] Updated weights for policy 1, policy_version 1318254 (0.0010) [2023-12-28 04:42:33,016][106225] Updated weights for policy 1, policy_version 1318264 (0.0010) [2023-12-28 04:42:33,131][106226] Updated weights for policy 0, policy_version 1314804 (0.0009) [2023-12-28 04:42:33,194][106226] Updated weights for policy 0, policy_version 1314814 (0.0010) [2023-12-28 04:42:33,243][106226] Updated weights for policy 0, policy_version 1314824 (0.0010) [2023-12-28 04:42:33,661][106225] Updated weights for policy 1, policy_version 1318274 (0.0006) [2023-12-28 04:42:33,713][106225] Updated weights for policy 1, policy_version 1318284 (0.0010) [2023-12-28 04:42:33,759][106225] Updated weights for policy 1, policy_version 1318294 (0.0010) [2023-12-28 04:42:33,849][106226] Updated weights for policy 0, policy_version 1314834 (0.0009) [2023-12-28 04:42:33,894][106226] Updated weights for policy 0, policy_version 1314844 (0.0005) [2023-12-28 04:42:33,939][106226] Updated weights for policy 0, policy_version 1314854 (0.0005) [2023-12-28 04:42:33,999][106226] Updated weights for policy 0, policy_version 1314864 (0.0006) [2023-12-28 04:42:34,445][106225] Updated weights for policy 1, policy_version 1318304 (0.0008) [2023-12-28 04:42:34,496][106225] Updated weights for policy 1, policy_version 1318314 (0.0008) [2023-12-28 04:42:34,563][106225] Updated weights for policy 1, policy_version 1318324 (0.0009) [2023-12-28 04:42:34,636][106226] Updated weights for policy 0, policy_version 1314874 (0.0009) [2023-12-28 04:42:34,699][106226] Updated weights for policy 0, policy_version 1314884 (0.0010) [2023-12-28 04:42:34,764][106226] Updated weights for policy 0, policy_version 1314894 (0.0009) [2023-12-28 04:42:35,241][106225] Updated weights for policy 1, policy_version 1318334 (0.0006) [2023-12-28 04:42:35,298][106225] Updated weights for policy 1, policy_version 1318344 (0.0005) [2023-12-28 04:42:35,358][106225] Updated weights for policy 1, policy_version 1318354 (0.0006) [2023-12-28 04:42:35,512][106226] Updated weights for policy 0, policy_version 1314904 (0.0006) [2023-12-28 04:42:35,568][106226] Updated weights for policy 0, policy_version 1314914 (0.0007) [2023-12-28 04:42:35,619][106226] Updated weights for policy 0, policy_version 1314924 (0.0008) [2023-12-28 04:42:35,895][106225] Updated weights for policy 1, policy_version 1318364 (0.0005) [2023-12-28 04:42:35,950][106225] Updated weights for policy 1, policy_version 1318374 (0.0007) [2023-12-28 04:42:36,001][106225] Updated weights for policy 1, policy_version 1318384 (0.0008) [2023-12-28 04:42:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.2). Total num frames: 674242560. Throughput: 0: 9771.0, 1: 9821.9. Samples: 674249760. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:36,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-4.764')] [2023-12-28 04:42:36,367][106226] Updated weights for policy 0, policy_version 1314934 (0.0010) [2023-12-28 04:42:36,425][106226] Updated weights for policy 0, policy_version 1314944 (0.0008) [2023-12-28 04:42:36,493][106226] Updated weights for policy 0, policy_version 1314954 (0.0009) [2023-12-28 04:42:36,667][106225] Updated weights for policy 1, policy_version 1318394 (0.0008) [2023-12-28 04:42:36,723][106225] Updated weights for policy 1, policy_version 1318404 (0.0009) [2023-12-28 04:42:36,783][106225] Updated weights for policy 1, policy_version 1318414 (0.0008) [2023-12-28 04:42:36,844][106225] Updated weights for policy 1, policy_version 1318424 (0.0008) [2023-12-28 04:42:37,186][106226] Updated weights for policy 0, policy_version 1314964 (0.0010) [2023-12-28 04:42:37,245][106226] Updated weights for policy 0, policy_version 1314974 (0.0008) [2023-12-28 04:42:37,307][106226] Updated weights for policy 0, policy_version 1314984 (0.0009) [2023-12-28 04:42:37,539][106225] Updated weights for policy 1, policy_version 1318434 (0.0008) [2023-12-28 04:42:37,595][106225] Updated weights for policy 1, policy_version 1318444 (0.0008) [2023-12-28 04:42:37,654][106225] Updated weights for policy 1, policy_version 1318454 (0.0009) [2023-12-28 04:42:37,919][106226] Updated weights for policy 0, policy_version 1314994 (0.0008) [2023-12-28 04:42:37,984][106226] Updated weights for policy 0, policy_version 1315004 (0.0009) [2023-12-28 04:42:38,039][106226] Updated weights for policy 0, policy_version 1315014 (0.0009) [2023-12-28 04:42:38,089][106226] Updated weights for policy 0, policy_version 1315024 (0.0009) [2023-12-28 04:42:38,408][106225] Updated weights for policy 1, policy_version 1318464 (0.0008) [2023-12-28 04:42:38,466][106225] Updated weights for policy 1, policy_version 1318474 (0.0008) [2023-12-28 04:42:38,519][106225] Updated weights for policy 1, policy_version 1318484 (0.0009) [2023-12-28 04:42:38,877][106226] Updated weights for policy 0, policy_version 1315034 (0.0009) [2023-12-28 04:42:38,926][106226] Updated weights for policy 0, policy_version 1315044 (0.0006) [2023-12-28 04:42:38,986][106226] Updated weights for policy 0, policy_version 1315054 (0.0005) [2023-12-28 04:42:39,307][106225] Updated weights for policy 1, policy_version 1318494 (0.0008) [2023-12-28 04:42:39,377][106225] Updated weights for policy 1, policy_version 1318504 (0.0009) [2023-12-28 04:42:39,443][106225] Updated weights for policy 1, policy_version 1318514 (0.0007) [2023-12-28 04:42:39,651][106226] Updated weights for policy 0, policy_version 1315064 (0.0006) [2023-12-28 04:42:39,713][106226] Updated weights for policy 0, policy_version 1315074 (0.0009) [2023-12-28 04:42:39,777][106226] Updated weights for policy 0, policy_version 1315084 (0.0009) [2023-12-28 04:42:40,222][106225] Updated weights for policy 1, policy_version 1318524 (0.0008) [2023-12-28 04:42:40,281][106225] Updated weights for policy 1, policy_version 1318534 (0.0008) [2023-12-28 04:42:40,340][106225] Updated weights for policy 1, policy_version 1318544 (0.0007) [2023-12-28 04:42:40,515][106226] Updated weights for policy 0, policy_version 1315094 (0.0010) [2023-12-28 04:42:40,562][106226] Updated weights for policy 0, policy_version 1315104 (0.0011) [2023-12-28 04:42:40,610][106226] Updated weights for policy 0, policy_version 1315114 (0.0011) [2023-12-28 04:42:41,095][106225] Updated weights for policy 1, policy_version 1318554 (0.0008) [2023-12-28 04:42:41,161][106225] Updated weights for policy 1, policy_version 1318564 (0.0008) [2023-12-28 04:42:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 674332672. Throughput: 0: 9809.5, 1: 9851.7. Samples: 674308704. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:41,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.748')] [2023-12-28 04:42:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001315120_336732160.pth... [2023-12-28 04:42:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001313968_336437248.pth [2023-12-28 04:42:41,225][106225] Updated weights for policy 1, policy_version 1318574 (0.0008) [2023-12-28 04:42:41,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001318584_337608704.pth... [2023-12-28 04:42:41,296][106225] Updated weights for policy 1, policy_version 1318584 (0.0009) [2023-12-28 04:42:41,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001317432_337313792.pth [2023-12-28 04:42:41,299][106226] Updated weights for policy 0, policy_version 1315124 (0.0009) [2023-12-28 04:42:41,348][106226] Updated weights for policy 0, policy_version 1315134 (0.0009) [2023-12-28 04:42:41,410][106226] Updated weights for policy 0, policy_version 1315144 (0.0009) [2023-12-28 04:42:42,038][106225] Updated weights for policy 1, policy_version 1318594 (0.0010) [2023-12-28 04:42:42,088][106225] Updated weights for policy 1, policy_version 1318604 (0.0010) [2023-12-28 04:42:42,147][106225] Updated weights for policy 1, policy_version 1318614 (0.0009) [2023-12-28 04:42:42,157][106226] Updated weights for policy 0, policy_version 1315154 (0.0009) [2023-12-28 04:42:42,214][106226] Updated weights for policy 0, policy_version 1315164 (0.0006) [2023-12-28 04:42:42,283][106226] Updated weights for policy 0, policy_version 1315174 (0.0006) [2023-12-28 04:42:42,347][106226] Updated weights for policy 0, policy_version 1315184 (0.0007) [2023-12-28 04:42:42,992][106226] Updated weights for policy 0, policy_version 1315194 (0.0008) [2023-12-28 04:42:43,005][106225] Updated weights for policy 1, policy_version 1318624 (0.0007) [2023-12-28 04:42:43,056][106225] Updated weights for policy 1, policy_version 1318634 (0.0006) [2023-12-28 04:42:43,057][106226] Updated weights for policy 0, policy_version 1315204 (0.0009) [2023-12-28 04:42:43,107][106225] Updated weights for policy 1, policy_version 1318644 (0.0006) [2023-12-28 04:42:43,112][106226] Updated weights for policy 0, policy_version 1315214 (0.0008) [2023-12-28 04:42:43,769][106226] Updated weights for policy 0, policy_version 1315224 (0.0009) [2023-12-28 04:42:43,772][106225] Updated weights for policy 1, policy_version 1318654 (0.0006) [2023-12-28 04:42:43,826][106225] Updated weights for policy 1, policy_version 1318664 (0.0006) [2023-12-28 04:42:43,830][106226] Updated weights for policy 0, policy_version 1315234 (0.0006) [2023-12-28 04:42:43,876][106225] Updated weights for policy 1, policy_version 1318674 (0.0008) [2023-12-28 04:42:43,886][106226] Updated weights for policy 0, policy_version 1315244 (0.0008) [2023-12-28 04:42:44,491][106225] Updated weights for policy 1, policy_version 1318684 (0.0006) [2023-12-28 04:42:44,541][106225] Updated weights for policy 1, policy_version 1318694 (0.0005) [2023-12-28 04:42:44,567][106226] Updated weights for policy 0, policy_version 1315254 (0.0009) [2023-12-28 04:42:44,591][106225] Updated weights for policy 1, policy_version 1318704 (0.0005) [2023-12-28 04:42:44,621][106226] Updated weights for policy 0, policy_version 1315264 (0.0008) [2023-12-28 04:42:44,684][106226] Updated weights for policy 0, policy_version 1315274 (0.0008) [2023-12-28 04:42:45,284][106225] Updated weights for policy 1, policy_version 1318714 (0.0009) [2023-12-28 04:42:45,332][106225] Updated weights for policy 1, policy_version 1318724 (0.0010) [2023-12-28 04:42:45,382][106225] Updated weights for policy 1, policy_version 1318734 (0.0008) [2023-12-28 04:42:45,431][106225] Updated weights for policy 1, policy_version 1318744 (0.0010) [2023-12-28 04:42:45,457][106226] Updated weights for policy 0, policy_version 1315284 (0.0009) [2023-12-28 04:42:45,507][106226] Updated weights for policy 0, policy_version 1315294 (0.0008) [2023-12-28 04:42:45,561][106226] Updated weights for policy 0, policy_version 1315304 (0.0009) [2023-12-28 04:42:46,039][106225] Updated weights for policy 1, policy_version 1318754 (0.0008) [2023-12-28 04:42:46,103][106225] Updated weights for policy 1, policy_version 1318764 (0.0009) [2023-12-28 04:42:46,159][106225] Updated weights for policy 1, policy_version 1318774 (0.0008) [2023-12-28 04:42:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 674439168. Throughput: 0: 9850.1, 1: 9802.3. Samples: 674425340. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:46,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-5.141')] [2023-12-28 04:42:46,342][106226] Updated weights for policy 0, policy_version 1315314 (0.0008) [2023-12-28 04:42:46,394][106226] Updated weights for policy 0, policy_version 1315324 (0.0009) [2023-12-28 04:42:46,445][106226] Updated weights for policy 0, policy_version 1315334 (0.0008) [2023-12-28 04:42:46,498][106226] Updated weights for policy 0, policy_version 1315344 (0.0009) [2023-12-28 04:42:46,814][106225] Updated weights for policy 1, policy_version 1318784 (0.0008) [2023-12-28 04:42:46,876][106225] Updated weights for policy 1, policy_version 1318794 (0.0007) [2023-12-28 04:42:46,935][106225] Updated weights for policy 1, policy_version 1318804 (0.0008) [2023-12-28 04:42:47,268][106226] Updated weights for policy 0, policy_version 1315354 (0.0009) [2023-12-28 04:42:47,337][106226] Updated weights for policy 0, policy_version 1315364 (0.0009) [2023-12-28 04:42:47,406][106226] Updated weights for policy 0, policy_version 1315374 (0.0009) [2023-12-28 04:42:47,559][106225] Updated weights for policy 1, policy_version 1318814 (0.0008) [2023-12-28 04:42:47,612][106225] Updated weights for policy 1, policy_version 1318824 (0.0008) [2023-12-28 04:42:47,666][106225] Updated weights for policy 1, policy_version 1318834 (0.0009) [2023-12-28 04:42:48,132][106226] Updated weights for policy 0, policy_version 1315384 (0.0009) [2023-12-28 04:42:48,185][106226] Updated weights for policy 0, policy_version 1315394 (0.0008) [2023-12-28 04:42:48,234][106226] Updated weights for policy 0, policy_version 1315404 (0.0008) [2023-12-28 04:42:48,376][106225] Updated weights for policy 1, policy_version 1318844 (0.0009) [2023-12-28 04:42:48,443][106225] Updated weights for policy 1, policy_version 1318854 (0.0007) [2023-12-28 04:42:48,502][106225] Updated weights for policy 1, policy_version 1318864 (0.0007) [2023-12-28 04:42:49,014][106226] Updated weights for policy 0, policy_version 1315414 (0.0008) [2023-12-28 04:42:49,078][106226] Updated weights for policy 0, policy_version 1315424 (0.0007) [2023-12-28 04:42:49,142][106226] Updated weights for policy 0, policy_version 1315434 (0.0007) [2023-12-28 04:42:49,161][106225] Updated weights for policy 1, policy_version 1318874 (0.0009) [2023-12-28 04:42:49,224][106225] Updated weights for policy 1, policy_version 1318884 (0.0006) [2023-12-28 04:42:49,289][106225] Updated weights for policy 1, policy_version 1318894 (0.0007) [2023-12-28 04:42:49,351][106225] Updated weights for policy 1, policy_version 1318904 (0.0006) [2023-12-28 04:42:49,909][106226] Updated weights for policy 0, policy_version 1315444 (0.0008) [2023-12-28 04:42:49,975][106226] Updated weights for policy 0, policy_version 1315454 (0.0008) [2023-12-28 04:42:50,039][106226] Updated weights for policy 0, policy_version 1315464 (0.0009) [2023-12-28 04:42:50,041][106225] Updated weights for policy 1, policy_version 1318914 (0.0006) [2023-12-28 04:42:50,096][106225] Updated weights for policy 1, policy_version 1318924 (0.0006) [2023-12-28 04:42:50,166][106225] Updated weights for policy 1, policy_version 1318934 (0.0009) [2023-12-28 04:42:50,811][106226] Updated weights for policy 0, policy_version 1315474 (0.0008) [2023-12-28 04:42:50,877][106226] Updated weights for policy 0, policy_version 1315484 (0.0008) [2023-12-28 04:42:50,931][106225] Updated weights for policy 1, policy_version 1318944 (0.0008) [2023-12-28 04:42:50,937][106226] Updated weights for policy 0, policy_version 1315494 (0.0006) [2023-12-28 04:42:50,991][106225] Updated weights for policy 1, policy_version 1318954 (0.0006) [2023-12-28 04:42:51,001][106226] Updated weights for policy 0, policy_version 1315504 (0.0007) [2023-12-28 04:42:51,055][106225] Updated weights for policy 1, policy_version 1318964 (0.0008) [2023-12-28 04:42:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 674537472. Throughput: 0: 9752.9, 1: 9824.5. Samples: 674541104. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:51,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.714')] [2023-12-28 04:42:51,741][106225] Updated weights for policy 1, policy_version 1318974 (0.0007) [2023-12-28 04:42:51,802][106225] Updated weights for policy 1, policy_version 1318984 (0.0007) [2023-12-28 04:42:51,830][106226] Updated weights for policy 0, policy_version 1315514 (0.0008) [2023-12-28 04:42:51,862][106225] Updated weights for policy 1, policy_version 1318994 (0.0007) [2023-12-28 04:42:51,885][106226] Updated weights for policy 0, policy_version 1315524 (0.0008) [2023-12-28 04:42:51,940][106226] Updated weights for policy 0, policy_version 1315534 (0.0007) [2023-12-28 04:42:52,563][106225] Updated weights for policy 1, policy_version 1319004 (0.0006) [2023-12-28 04:42:52,629][106225] Updated weights for policy 1, policy_version 1319014 (0.0005) [2023-12-28 04:42:52,648][106226] Updated weights for policy 0, policy_version 1315544 (0.0006) [2023-12-28 04:42:52,694][106225] Updated weights for policy 1, policy_version 1319024 (0.0007) [2023-12-28 04:42:52,705][106226] Updated weights for policy 0, policy_version 1315554 (0.0006) [2023-12-28 04:42:52,766][106226] Updated weights for policy 0, policy_version 1315564 (0.0007) [2023-12-28 04:42:53,349][106226] Updated weights for policy 0, policy_version 1315574 (0.0007) [2023-12-28 04:42:53,408][106226] Updated weights for policy 0, policy_version 1315584 (0.0008) [2023-12-28 04:42:53,437][106225] Updated weights for policy 1, policy_version 1319034 (0.0009) [2023-12-28 04:42:53,469][106226] Updated weights for policy 0, policy_version 1315594 (0.0011) [2023-12-28 04:42:53,500][106225] Updated weights for policy 1, policy_version 1319044 (0.0006) [2023-12-28 04:42:53,561][106225] Updated weights for policy 1, policy_version 1319054 (0.0008) [2023-12-28 04:42:53,619][106225] Updated weights for policy 1, policy_version 1319064 (0.0008) [2023-12-28 04:42:54,178][106226] Updated weights for policy 0, policy_version 1315604 (0.0010) [2023-12-28 04:42:54,238][106226] Updated weights for policy 0, policy_version 1315614 (0.0010) [2023-12-28 04:42:54,287][106225] Updated weights for policy 1, policy_version 1319074 (0.0008) [2023-12-28 04:42:54,293][106226] Updated weights for policy 0, policy_version 1315624 (0.0007) [2023-12-28 04:42:54,337][106225] Updated weights for policy 1, policy_version 1319084 (0.0010) [2023-12-28 04:42:54,388][106225] Updated weights for policy 1, policy_version 1319094 (0.0010) [2023-12-28 04:42:54,991][106225] Updated weights for policy 1, policy_version 1319104 (0.0008) [2023-12-28 04:42:55,012][106226] Updated weights for policy 0, policy_version 1315634 (0.0008) [2023-12-28 04:42:55,049][106225] Updated weights for policy 1, policy_version 1319114 (0.0010) [2023-12-28 04:42:55,073][106226] Updated weights for policy 0, policy_version 1315644 (0.0010) [2023-12-28 04:42:55,096][106225] Updated weights for policy 1, policy_version 1319124 (0.0010) [2023-12-28 04:42:55,136][106226] Updated weights for policy 0, policy_version 1315654 (0.0010) [2023-12-28 04:42:55,186][106226] Updated weights for policy 0, policy_version 1315664 (0.0010) [2023-12-28 04:42:55,748][106225] Updated weights for policy 1, policy_version 1319134 (0.0010) [2023-12-28 04:42:55,795][106225] Updated weights for policy 1, policy_version 1319144 (0.0010) [2023-12-28 04:42:55,842][106225] Updated weights for policy 1, policy_version 1319154 (0.0010) [2023-12-28 04:42:55,857][106226] Updated weights for policy 0, policy_version 1315674 (0.0007) [2023-12-28 04:42:55,902][106226] Updated weights for policy 0, policy_version 1315684 (0.0005) [2023-12-28 04:42:55,949][106226] Updated weights for policy 0, policy_version 1315694 (0.0005) [2023-12-28 04:42:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 674635776. Throughput: 0: 9744.6, 1: 9785.0. Samples: 674599344. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:42:56,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.923')] [2023-12-28 04:42:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001319160_337756160.pth... [2023-12-28 04:42:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001315696_336879616.pth... [2023-12-28 04:42:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001314544_336584704.pth [2023-12-28 04:42:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001318008_337461248.pth [2023-12-28 04:42:56,583][106226] Updated weights for policy 0, policy_version 1315704 (0.0007) [2023-12-28 04:42:56,596][106225] Updated weights for policy 1, policy_version 1319164 (0.0010) [2023-12-28 04:42:56,639][106226] Updated weights for policy 0, policy_version 1315714 (0.0008) [2023-12-28 04:42:56,657][106225] Updated weights for policy 1, policy_version 1319174 (0.0005) [2023-12-28 04:42:56,695][106226] Updated weights for policy 0, policy_version 1315724 (0.0010) [2023-12-28 04:42:56,708][106225] Updated weights for policy 1, policy_version 1319184 (0.0005) [2023-12-28 04:42:57,298][106226] Updated weights for policy 0, policy_version 1315734 (0.0007) [2023-12-28 04:42:57,350][106225] Updated weights for policy 1, policy_version 1319194 (0.0007) [2023-12-28 04:42:57,361][106226] Updated weights for policy 0, policy_version 1315744 (0.0006) [2023-12-28 04:42:57,410][106225] Updated weights for policy 1, policy_version 1319204 (0.0010) [2023-12-28 04:42:57,421][106226] Updated weights for policy 0, policy_version 1315754 (0.0005) [2023-12-28 04:42:57,470][106225] Updated weights for policy 1, policy_version 1319214 (0.0010) [2023-12-28 04:42:57,526][106225] Updated weights for policy 1, policy_version 1319224 (0.0010) [2023-12-28 04:42:57,955][106226] Updated weights for policy 0, policy_version 1315764 (0.0005) [2023-12-28 04:42:58,004][106226] Updated weights for policy 0, policy_version 1315774 (0.0005) [2023-12-28 04:42:58,056][106226] Updated weights for policy 0, policy_version 1315784 (0.0005) [2023-12-28 04:42:58,220][106225] Updated weights for policy 1, policy_version 1319234 (0.0007) [2023-12-28 04:42:58,280][106225] Updated weights for policy 1, policy_version 1319244 (0.0008) [2023-12-28 04:42:58,353][106225] Updated weights for policy 1, policy_version 1319255 (0.0008) [2023-12-28 04:42:58,811][106226] Updated weights for policy 0, policy_version 1315794 (0.0007) [2023-12-28 04:42:58,885][106226] Updated weights for policy 0, policy_version 1315805 (0.0008) [2023-12-28 04:42:58,949][106226] Updated weights for policy 0, policy_version 1315815 (0.0006) [2023-12-28 04:42:59,210][106225] Updated weights for policy 1, policy_version 1319265 (0.0008) [2023-12-28 04:42:59,288][106225] Updated weights for policy 1, policy_version 1319275 (0.0008) [2023-12-28 04:42:59,352][106225] Updated weights for policy 1, policy_version 1319285 (0.0007) [2023-12-28 04:42:59,763][106226] Updated weights for policy 0, policy_version 1315825 (0.0009) [2023-12-28 04:42:59,829][106226] Updated weights for policy 0, policy_version 1315835 (0.0008) [2023-12-28 04:42:59,889][106226] Updated weights for policy 0, policy_version 1315845 (0.0009) [2023-12-28 04:42:59,956][106226] Updated weights for policy 0, policy_version 1315855 (0.0009) [2023-12-28 04:43:00,016][106225] Updated weights for policy 1, policy_version 1319295 (0.0007) [2023-12-28 04:43:00,073][106225] Updated weights for policy 1, policy_version 1319305 (0.0005) [2023-12-28 04:43:00,133][106225] Updated weights for policy 1, policy_version 1319315 (0.0006) [2023-12-28 04:43:00,689][106226] Updated weights for policy 0, policy_version 1315865 (0.0008) [2023-12-28 04:43:00,732][106225] Updated weights for policy 1, policy_version 1319325 (0.0007) [2023-12-28 04:43:00,745][106226] Updated weights for policy 0, policy_version 1315875 (0.0007) [2023-12-28 04:43:00,786][106225] Updated weights for policy 1, policy_version 1319335 (0.0006) [2023-12-28 04:43:00,792][106226] Updated weights for policy 0, policy_version 1315885 (0.0005) [2023-12-28 04:43:00,836][106225] Updated weights for policy 1, policy_version 1319345 (0.0008) [2023-12-28 04:43:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 674734080. Throughput: 0: 9758.1, 1: 9839.9. Samples: 674720088. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:01,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.834')] [2023-12-28 04:43:01,528][106226] Updated weights for policy 0, policy_version 1315895 (0.0006) [2023-12-28 04:43:01,558][106225] Updated weights for policy 1, policy_version 1319356 (0.0008) [2023-12-28 04:43:01,582][106226] Updated weights for policy 0, policy_version 1315905 (0.0005) [2023-12-28 04:43:01,620][106225] Updated weights for policy 1, policy_version 1319366 (0.0008) [2023-12-28 04:43:01,657][106226] Updated weights for policy 0, policy_version 1315915 (0.0006) [2023-12-28 04:43:01,691][106225] Updated weights for policy 1, policy_version 1319376 (0.0010) [2023-12-28 04:43:02,345][106226] Updated weights for policy 0, policy_version 1315925 (0.0008) [2023-12-28 04:43:02,394][106225] Updated weights for policy 1, policy_version 1319386 (0.0007) [2023-12-28 04:43:02,408][106226] Updated weights for policy 0, policy_version 1315935 (0.0009) [2023-12-28 04:43:02,446][106225] Updated weights for policy 1, policy_version 1319396 (0.0007) [2023-12-28 04:43:02,467][106226] Updated weights for policy 0, policy_version 1315945 (0.0006) [2023-12-28 04:43:02,504][106225] Updated weights for policy 1, policy_version 1319406 (0.0008) [2023-12-28 04:43:02,562][106225] Updated weights for policy 1, policy_version 1319416 (0.0008) [2023-12-28 04:43:03,120][106226] Updated weights for policy 0, policy_version 1315955 (0.0007) [2023-12-28 04:43:03,171][106226] Updated weights for policy 0, policy_version 1315965 (0.0008) [2023-12-28 04:43:03,221][106226] Updated weights for policy 0, policy_version 1315975 (0.0006) [2023-12-28 04:43:03,253][106225] Updated weights for policy 1, policy_version 1319426 (0.0006) [2023-12-28 04:43:03,304][106225] Updated weights for policy 1, policy_version 1319436 (0.0005) [2023-12-28 04:43:03,354][106225] Updated weights for policy 1, policy_version 1319446 (0.0005) [2023-12-28 04:43:03,925][106226] Updated weights for policy 0, policy_version 1315985 (0.0006) [2023-12-28 04:43:03,990][106226] Updated weights for policy 0, policy_version 1315995 (0.0011) [2023-12-28 04:43:04,050][106226] Updated weights for policy 0, policy_version 1316005 (0.0011) [2023-12-28 04:43:04,060][106225] Updated weights for policy 1, policy_version 1319456 (0.0006) [2023-12-28 04:43:04,106][106226] Updated weights for policy 0, policy_version 1316015 (0.0009) [2023-12-28 04:43:04,120][106225] Updated weights for policy 1, policy_version 1319466 (0.0007) [2023-12-28 04:43:04,179][106225] Updated weights for policy 1, policy_version 1319476 (0.0007) [2023-12-28 04:43:04,790][106226] Updated weights for policy 0, policy_version 1316025 (0.0008) [2023-12-28 04:43:04,835][106226] Updated weights for policy 0, policy_version 1316035 (0.0008) [2023-12-28 04:43:04,880][106226] Updated weights for policy 0, policy_version 1316045 (0.0008) [2023-12-28 04:43:04,932][106225] Updated weights for policy 1, policy_version 1319486 (0.0008) [2023-12-28 04:43:04,987][106225] Updated weights for policy 1, policy_version 1319496 (0.0008) [2023-12-28 04:43:05,051][106225] Updated weights for policy 1, policy_version 1319506 (0.0009) [2023-12-28 04:43:05,632][106226] Updated weights for policy 0, policy_version 1316055 (0.0007) [2023-12-28 04:43:05,694][106226] Updated weights for policy 0, policy_version 1316065 (0.0006) [2023-12-28 04:43:05,746][106226] Updated weights for policy 0, policy_version 1316075 (0.0006) [2023-12-28 04:43:05,785][106225] Updated weights for policy 1, policy_version 1319516 (0.0008) [2023-12-28 04:43:05,839][106225] Updated weights for policy 1, policy_version 1319526 (0.0006) [2023-12-28 04:43:05,898][106225] Updated weights for policy 1, policy_version 1319536 (0.0005) [2023-12-28 04:43:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 674832384. Throughput: 0: 9820.3, 1: 9912.1. Samples: 674840104. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:06,176][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.751')] [2023-12-28 04:43:06,344][106226] Updated weights for policy 0, policy_version 1316085 (0.0006) [2023-12-28 04:43:06,415][106226] Updated weights for policy 0, policy_version 1316095 (0.0010) [2023-12-28 04:43:06,486][106226] Updated weights for policy 0, policy_version 1316105 (0.0009) [2023-12-28 04:43:06,508][106225] Updated weights for policy 1, policy_version 1319546 (0.0006) [2023-12-28 04:43:06,571][106225] Updated weights for policy 1, policy_version 1319556 (0.0007) [2023-12-28 04:43:06,642][106225] Updated weights for policy 1, policy_version 1319566 (0.0009) [2023-12-28 04:43:06,705][106225] Updated weights for policy 1, policy_version 1319576 (0.0008) [2023-12-28 04:43:07,202][106226] Updated weights for policy 0, policy_version 1316115 (0.0008) [2023-12-28 04:43:07,253][106226] Updated weights for policy 0, policy_version 1316125 (0.0008) [2023-12-28 04:43:07,300][106226] Updated weights for policy 0, policy_version 1316135 (0.0008) [2023-12-28 04:43:07,355][106225] Updated weights for policy 1, policy_version 1319586 (0.0010) [2023-12-28 04:43:07,402][106225] Updated weights for policy 1, policy_version 1319596 (0.0010) [2023-12-28 04:43:07,455][106225] Updated weights for policy 1, policy_version 1319606 (0.0009) [2023-12-28 04:43:08,020][106226] Updated weights for policy 0, policy_version 1316145 (0.0005) [2023-12-28 04:43:08,078][106226] Updated weights for policy 0, policy_version 1316155 (0.0005) [2023-12-28 04:43:08,133][106226] Updated weights for policy 0, policy_version 1316165 (0.0006) [2023-12-28 04:43:08,182][106226] Updated weights for policy 0, policy_version 1316175 (0.0008) [2023-12-28 04:43:08,195][106225] Updated weights for policy 1, policy_version 1319616 (0.0007) [2023-12-28 04:43:08,256][106225] Updated weights for policy 1, policy_version 1319626 (0.0008) [2023-12-28 04:43:08,312][106225] Updated weights for policy 1, policy_version 1319636 (0.0008) [2023-12-28 04:43:08,900][106226] Updated weights for policy 0, policy_version 1316185 (0.0008) [2023-12-28 04:43:08,949][106226] Updated weights for policy 0, policy_version 1316195 (0.0008) [2023-12-28 04:43:09,000][106226] Updated weights for policy 0, policy_version 1316205 (0.0009) [2023-12-28 04:43:09,003][106225] Updated weights for policy 1, policy_version 1319647 (0.0007) [2023-12-28 04:43:09,051][106225] Updated weights for policy 1, policy_version 1319657 (0.0005) [2023-12-28 04:43:09,108][106225] Updated weights for policy 1, policy_version 1319667 (0.0005) [2023-12-28 04:43:09,838][106226] Updated weights for policy 0, policy_version 1316215 (0.0007) [2023-12-28 04:43:09,895][106225] Updated weights for policy 1, policy_version 1319677 (0.0006) [2023-12-28 04:43:09,902][106226] Updated weights for policy 0, policy_version 1316225 (0.0007) [2023-12-28 04:43:09,960][106225] Updated weights for policy 1, policy_version 1319687 (0.0009) [2023-12-28 04:43:09,965][106226] Updated weights for policy 0, policy_version 1316235 (0.0008) [2023-12-28 04:43:10,021][106225] Updated weights for policy 1, policy_version 1319697 (0.0007) [2023-12-28 04:43:10,692][106226] Updated weights for policy 0, policy_version 1316245 (0.0009) [2023-12-28 04:43:10,751][106226] Updated weights for policy 0, policy_version 1316255 (0.0009) [2023-12-28 04:43:10,778][106225] Updated weights for policy 1, policy_version 1319707 (0.0007) [2023-12-28 04:43:10,815][106226] Updated weights for policy 0, policy_version 1316265 (0.0007) [2023-12-28 04:43:10,841][106225] Updated weights for policy 1, policy_version 1319717 (0.0007) [2023-12-28 04:43:10,888][106225] Updated weights for policy 1, policy_version 1319727 (0.0007) [2023-12-28 04:43:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 674930688. Throughput: 0: 9844.9, 1: 9929.4. Samples: 674898924. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:11,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-5.180')] [2023-12-28 04:43:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001319736_337903616.pth... [2023-12-28 04:43:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001316272_337027072.pth... [2023-12-28 04:43:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001318584_337608704.pth [2023-12-28 04:43:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001315120_336732160.pth [2023-12-28 04:43:11,492][106226] Updated weights for policy 0, policy_version 1316275 (0.0008) [2023-12-28 04:43:11,553][106226] Updated weights for policy 0, policy_version 1316285 (0.0009) [2023-12-28 04:43:11,620][106226] Updated weights for policy 0, policy_version 1316295 (0.0008) [2023-12-28 04:43:11,752][106225] Updated weights for policy 1, policy_version 1319737 (0.0009) [2023-12-28 04:43:11,811][106225] Updated weights for policy 1, policy_version 1319747 (0.0009) [2023-12-28 04:43:11,863][106225] Updated weights for policy 1, policy_version 1319757 (0.0009) [2023-12-28 04:43:11,913][106225] Updated weights for policy 1, policy_version 1319767 (0.0008) [2023-12-28 04:43:12,294][106226] Updated weights for policy 0, policy_version 1316305 (0.0007) [2023-12-28 04:43:12,358][106226] Updated weights for policy 0, policy_version 1316315 (0.0008) [2023-12-28 04:43:12,421][106226] Updated weights for policy 0, policy_version 1316325 (0.0008) [2023-12-28 04:43:12,476][106226] Updated weights for policy 0, policy_version 1316335 (0.0008) [2023-12-28 04:43:12,776][106225] Updated weights for policy 1, policy_version 1319777 (0.0009) [2023-12-28 04:43:12,825][106225] Updated weights for policy 1, policy_version 1319787 (0.0009) [2023-12-28 04:43:12,877][106225] Updated weights for policy 1, policy_version 1319797 (0.0009) [2023-12-28 04:43:13,084][106226] Updated weights for policy 0, policy_version 1316345 (0.0006) [2023-12-28 04:43:13,135][106226] Updated weights for policy 0, policy_version 1316355 (0.0005) [2023-12-28 04:43:13,192][106226] Updated weights for policy 0, policy_version 1316365 (0.0005) [2023-12-28 04:43:13,576][106225] Updated weights for policy 1, policy_version 1319807 (0.0009) [2023-12-28 04:43:13,638][106225] Updated weights for policy 1, policy_version 1319817 (0.0008) [2023-12-28 04:43:13,691][106225] Updated weights for policy 1, policy_version 1319827 (0.0008) [2023-12-28 04:43:13,779][106226] Updated weights for policy 0, policy_version 1316375 (0.0007) [2023-12-28 04:43:13,831][106226] Updated weights for policy 0, policy_version 1316385 (0.0008) [2023-12-28 04:43:13,892][106226] Updated weights for policy 0, policy_version 1316395 (0.0009) [2023-12-28 04:43:14,433][106225] Updated weights for policy 1, policy_version 1319837 (0.0007) [2023-12-28 04:43:14,486][106225] Updated weights for policy 1, policy_version 1319847 (0.0007) [2023-12-28 04:43:14,538][106225] Updated weights for policy 1, policy_version 1319857 (0.0009) [2023-12-28 04:43:14,555][106226] Updated weights for policy 0, policy_version 1316405 (0.0009) [2023-12-28 04:43:14,618][106226] Updated weights for policy 0, policy_version 1316415 (0.0007) [2023-12-28 04:43:14,680][106226] Updated weights for policy 0, policy_version 1316425 (0.0010) [2023-12-28 04:43:15,231][106225] Updated weights for policy 1, policy_version 1319867 (0.0008) [2023-12-28 04:43:15,286][106225] Updated weights for policy 1, policy_version 1319877 (0.0006) [2023-12-28 04:43:15,347][106225] Updated weights for policy 1, policy_version 1319887 (0.0009) [2023-12-28 04:43:15,415][106226] Updated weights for policy 0, policy_version 1316435 (0.0010) [2023-12-28 04:43:15,464][106226] Updated weights for policy 0, policy_version 1316445 (0.0010) [2023-12-28 04:43:15,524][106226] Updated weights for policy 0, policy_version 1316455 (0.0011) [2023-12-28 04:43:16,136][106226] Updated weights for policy 0, policy_version 1316465 (0.0010) [2023-12-28 04:43:16,137][106225] Updated weights for policy 1, policy_version 1319897 (0.0008) [2023-12-28 04:43:16,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 675020800. Throughput: 0: 9913.4, 1: 9833.4. Samples: 675016168. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:16,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.679')] [2023-12-28 04:43:16,186][106225] Updated weights for policy 1, policy_version 1319907 (0.0006) [2023-12-28 04:43:16,190][106226] Updated weights for policy 0, policy_version 1316475 (0.0011) [2023-12-28 04:43:16,233][106225] Updated weights for policy 1, policy_version 1319917 (0.0005) [2023-12-28 04:43:16,250][106226] Updated weights for policy 0, policy_version 1316485 (0.0008) [2023-12-28 04:43:16,287][106225] Updated weights for policy 1, policy_version 1319927 (0.0005) [2023-12-28 04:43:16,318][106226] Updated weights for policy 0, policy_version 1316495 (0.0009) [2023-12-28 04:43:16,901][106225] Updated weights for policy 1, policy_version 1319937 (0.0008) [2023-12-28 04:43:16,962][106225] Updated weights for policy 1, policy_version 1319947 (0.0007) [2023-12-28 04:43:17,006][106226] Updated weights for policy 0, policy_version 1316505 (0.0010) [2023-12-28 04:43:17,016][106225] Updated weights for policy 1, policy_version 1319957 (0.0005) [2023-12-28 04:43:17,063][106226] Updated weights for policy 0, policy_version 1316515 (0.0011) [2023-12-28 04:43:17,110][106226] Updated weights for policy 0, policy_version 1316525 (0.0010) [2023-12-28 04:43:17,733][106225] Updated weights for policy 1, policy_version 1319967 (0.0008) [2023-12-28 04:43:17,785][106225] Updated weights for policy 1, policy_version 1319977 (0.0008) [2023-12-28 04:43:17,815][106226] Updated weights for policy 0, policy_version 1316535 (0.0007) [2023-12-28 04:43:17,842][106225] Updated weights for policy 1, policy_version 1319987 (0.0009) [2023-12-28 04:43:17,873][106226] Updated weights for policy 0, policy_version 1316545 (0.0005) [2023-12-28 04:43:17,924][106226] Updated weights for policy 0, policy_version 1316555 (0.0005) [2023-12-28 04:43:18,486][106226] Updated weights for policy 0, policy_version 1316565 (0.0008) [2023-12-28 04:43:18,536][106226] Updated weights for policy 0, policy_version 1316575 (0.0011) [2023-12-28 04:43:18,587][106226] Updated weights for policy 0, policy_version 1316585 (0.0009) [2023-12-28 04:43:18,631][106225] Updated weights for policy 1, policy_version 1319997 (0.0007) [2023-12-28 04:43:18,690][106225] Updated weights for policy 1, policy_version 1320007 (0.0009) [2023-12-28 04:43:18,756][106225] Updated weights for policy 1, policy_version 1320017 (0.0010) [2023-12-28 04:43:19,174][106226] Updated weights for policy 0, policy_version 1316595 (0.0007) [2023-12-28 04:43:19,241][106226] Updated weights for policy 0, policy_version 1316605 (0.0008) [2023-12-28 04:43:19,309][106226] Updated weights for policy 0, policy_version 1316615 (0.0011) [2023-12-28 04:43:19,468][106225] Updated weights for policy 1, policy_version 1320027 (0.0009) [2023-12-28 04:43:19,535][106225] Updated weights for policy 1, policy_version 1320037 (0.0008) [2023-12-28 04:43:19,594][106225] Updated weights for policy 1, policy_version 1320047 (0.0007) [2023-12-28 04:43:20,072][106226] Updated weights for policy 0, policy_version 1316625 (0.0010) [2023-12-28 04:43:20,131][106226] Updated weights for policy 0, policy_version 1316635 (0.0011) [2023-12-28 04:43:20,200][106226] Updated weights for policy 0, policy_version 1316645 (0.0011) [2023-12-28 04:43:20,255][106226] Updated weights for policy 0, policy_version 1316655 (0.0011) [2023-12-28 04:43:20,322][106225] Updated weights for policy 1, policy_version 1320057 (0.0008) [2023-12-28 04:43:20,388][106225] Updated weights for policy 1, policy_version 1320067 (0.0007) [2023-12-28 04:43:20,446][106225] Updated weights for policy 1, policy_version 1320077 (0.0008) [2023-12-28 04:43:20,496][106225] Updated weights for policy 1, policy_version 1320087 (0.0007) [2023-12-28 04:43:21,009][106226] Updated weights for policy 0, policy_version 1316665 (0.0011) [2023-12-28 04:43:21,082][106226] Updated weights for policy 0, policy_version 1316675 (0.0009) [2023-12-28 04:43:21,157][106226] Updated weights for policy 0, policy_version 1316685 (0.0009) [2023-12-28 04:43:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 675127296. Throughput: 0: 9912.0, 1: 9766.0. Samples: 675135268. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:21,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.769')] [2023-12-28 04:43:21,300][106225] Updated weights for policy 1, policy_version 1320097 (0.0008) [2023-12-28 04:43:21,378][106225] Updated weights for policy 1, policy_version 1320107 (0.0009) [2023-12-28 04:43:21,456][106225] Updated weights for policy 1, policy_version 1320117 (0.0008) [2023-12-28 04:43:21,944][106226] Updated weights for policy 0, policy_version 1316695 (0.0010) [2023-12-28 04:43:21,998][106226] Updated weights for policy 0, policy_version 1316705 (0.0008) [2023-12-28 04:43:22,046][106226] Updated weights for policy 0, policy_version 1316715 (0.0007) [2023-12-28 04:43:22,246][106225] Updated weights for policy 1, policy_version 1320127 (0.0008) [2023-12-28 04:43:22,305][106225] Updated weights for policy 1, policy_version 1320137 (0.0008) [2023-12-28 04:43:22,374][106225] Updated weights for policy 1, policy_version 1320147 (0.0008) [2023-12-28 04:43:22,791][106226] Updated weights for policy 0, policy_version 1316725 (0.0009) [2023-12-28 04:43:22,852][106226] Updated weights for policy 0, policy_version 1316735 (0.0011) [2023-12-28 04:43:22,905][106226] Updated weights for policy 0, policy_version 1316745 (0.0007) [2023-12-28 04:43:23,104][106225] Updated weights for policy 1, policy_version 1320157 (0.0008) [2023-12-28 04:43:23,156][106225] Updated weights for policy 1, policy_version 1320167 (0.0009) [2023-12-28 04:43:23,211][106225] Updated weights for policy 1, policy_version 1320177 (0.0009) [2023-12-28 04:43:23,559][106226] Updated weights for policy 0, policy_version 1316755 (0.0006) [2023-12-28 04:43:23,617][106226] Updated weights for policy 0, policy_version 1316765 (0.0008) [2023-12-28 04:43:23,685][106226] Updated weights for policy 0, policy_version 1316775 (0.0009) [2023-12-28 04:43:23,978][106225] Updated weights for policy 1, policy_version 1320187 (0.0009) [2023-12-28 04:43:24,034][106225] Updated weights for policy 1, policy_version 1320197 (0.0008) [2023-12-28 04:43:24,095][106225] Updated weights for policy 1, policy_version 1320207 (0.0008) [2023-12-28 04:43:24,420][106226] Updated weights for policy 0, policy_version 1316785 (0.0011) [2023-12-28 04:43:24,473][106226] Updated weights for policy 0, policy_version 1316795 (0.0010) [2023-12-28 04:43:24,527][106226] Updated weights for policy 0, policy_version 1316805 (0.0010) [2023-12-28 04:43:24,582][106226] Updated weights for policy 0, policy_version 1316815 (0.0007) [2023-12-28 04:43:24,808][106225] Updated weights for policy 1, policy_version 1320217 (0.0008) [2023-12-28 04:43:24,855][106225] Updated weights for policy 1, policy_version 1320227 (0.0007) [2023-12-28 04:43:24,909][106225] Updated weights for policy 1, policy_version 1320237 (0.0008) [2023-12-28 04:43:24,969][106225] Updated weights for policy 1, policy_version 1320247 (0.0007) [2023-12-28 04:43:25,221][106226] Updated weights for policy 0, policy_version 1316825 (0.0006) [2023-12-28 04:43:25,278][106226] Updated weights for policy 0, policy_version 1316835 (0.0007) [2023-12-28 04:43:25,337][106226] Updated weights for policy 0, policy_version 1316845 (0.0010) [2023-12-28 04:43:25,729][106225] Updated weights for policy 1, policy_version 1320257 (0.0007) [2023-12-28 04:43:25,787][106225] Updated weights for policy 1, policy_version 1320267 (0.0008) [2023-12-28 04:43:25,839][106225] Updated weights for policy 1, policy_version 1320277 (0.0008) [2023-12-28 04:43:25,994][106226] Updated weights for policy 0, policy_version 1316855 (0.0007) [2023-12-28 04:43:26,049][106226] Updated weights for policy 0, policy_version 1316865 (0.0005) [2023-12-28 04:43:26,114][106226] Updated weights for policy 0, policy_version 1316875 (0.0005) [2023-12-28 04:43:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 675225600. Throughput: 0: 9875.1, 1: 9714.5. Samples: 675190236. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:26,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.737')] [2023-12-28 04:43:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001320280_338042880.pth... [2023-12-28 04:43:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001316880_337182720.pth... [2023-12-28 04:43:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001319160_337756160.pth [2023-12-28 04:43:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001315696_336879616.pth [2023-12-28 04:43:26,542][106225] Updated weights for policy 1, policy_version 1320287 (0.0006) [2023-12-28 04:43:26,585][106225] Updated weights for policy 1, policy_version 1320297 (0.0006) [2023-12-28 04:43:26,632][106225] Updated weights for policy 1, policy_version 1320307 (0.0009) [2023-12-28 04:43:26,684][106226] Updated weights for policy 0, policy_version 1316885 (0.0005) [2023-12-28 04:43:26,738][106226] Updated weights for policy 0, policy_version 1316895 (0.0005) [2023-12-28 04:43:26,799][106226] Updated weights for policy 0, policy_version 1316905 (0.0008) [2023-12-28 04:43:27,373][106225] Updated weights for policy 1, policy_version 1320317 (0.0007) [2023-12-28 04:43:27,432][106225] Updated weights for policy 1, policy_version 1320327 (0.0009) [2023-12-28 04:43:27,436][106226] Updated weights for policy 0, policy_version 1316915 (0.0007) [2023-12-28 04:43:27,487][106225] Updated weights for policy 1, policy_version 1320337 (0.0007) [2023-12-28 04:43:27,488][106226] Updated weights for policy 0, policy_version 1316925 (0.0005) [2023-12-28 04:43:27,535][106226] Updated weights for policy 0, policy_version 1316935 (0.0005) [2023-12-28 04:43:28,187][106225] Updated weights for policy 1, policy_version 1320347 (0.0008) [2023-12-28 04:43:28,207][106226] Updated weights for policy 0, policy_version 1316945 (0.0006) [2023-12-28 04:43:28,237][106225] Updated weights for policy 1, policy_version 1320357 (0.0010) [2023-12-28 04:43:28,259][106226] Updated weights for policy 0, policy_version 1316955 (0.0007) [2023-12-28 04:43:28,281][106225] Updated weights for policy 1, policy_version 1320367 (0.0010) [2023-12-28 04:43:28,302][106226] Updated weights for policy 0, policy_version 1316965 (0.0005) [2023-12-28 04:43:28,364][106226] Updated weights for policy 0, policy_version 1316975 (0.0008) [2023-12-28 04:43:28,974][106225] Updated weights for policy 1, policy_version 1320377 (0.0009) [2023-12-28 04:43:29,018][106226] Updated weights for policy 0, policy_version 1316985 (0.0006) [2023-12-28 04:43:29,038][106225] Updated weights for policy 1, policy_version 1320387 (0.0005) [2023-12-28 04:43:29,076][106226] Updated weights for policy 0, policy_version 1316995 (0.0005) [2023-12-28 04:43:29,091][106225] Updated weights for policy 1, policy_version 1320397 (0.0005) [2023-12-28 04:43:29,124][106226] Updated weights for policy 0, policy_version 1317005 (0.0005) [2023-12-28 04:43:29,140][106225] Updated weights for policy 1, policy_version 1320407 (0.0010) [2023-12-28 04:43:29,763][106226] Updated weights for policy 0, policy_version 1317015 (0.0009) [2023-12-28 04:43:29,820][106226] Updated weights for policy 0, policy_version 1317025 (0.0010) [2023-12-28 04:43:29,860][106225] Updated weights for policy 1, policy_version 1320417 (0.0010) [2023-12-28 04:43:29,884][106226] Updated weights for policy 0, policy_version 1317035 (0.0010) [2023-12-28 04:43:29,915][106225] Updated weights for policy 1, policy_version 1320427 (0.0009) [2023-12-28 04:43:29,974][106225] Updated weights for policy 1, policy_version 1320437 (0.0009) [2023-12-28 04:43:30,598][106226] Updated weights for policy 0, policy_version 1317045 (0.0008) [2023-12-28 04:43:30,652][106226] Updated weights for policy 0, policy_version 1317055 (0.0006) [2023-12-28 04:43:30,709][106226] Updated weights for policy 0, policy_version 1317065 (0.0006) [2023-12-28 04:43:30,737][106225] Updated weights for policy 1, policy_version 1320447 (0.0009) [2023-12-28 04:43:30,786][106225] Updated weights for policy 1, policy_version 1320457 (0.0008) [2023-12-28 04:43:30,840][106225] Updated weights for policy 1, policy_version 1320467 (0.0008) [2023-12-28 04:43:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 675323904. Throughput: 0: 9980.5, 1: 9741.3. Samples: 675312820. Policy #0 lag: (min: 30.0, avg: 35.1, max: 62.0) [2023-12-28 04:43:31,175][105115] Avg episode reward: [(0, '-4.665'), (1, '-4.674')] [2023-12-28 04:43:31,406][106226] Updated weights for policy 0, policy_version 1317075 (0.0006) [2023-12-28 04:43:31,470][106226] Updated weights for policy 0, policy_version 1317085 (0.0006) [2023-12-28 04:43:31,540][106226] Updated weights for policy 0, policy_version 1317095 (0.0006) [2023-12-28 04:43:31,622][106225] Updated weights for policy 1, policy_version 1320477 (0.0008) [2023-12-28 04:43:31,691][106225] Updated weights for policy 1, policy_version 1320487 (0.0007) [2023-12-28 04:43:31,762][106225] Updated weights for policy 1, policy_version 1320497 (0.0008) [2023-12-28 04:43:32,237][106226] Updated weights for policy 0, policy_version 1317105 (0.0010) [2023-12-28 04:43:32,298][106226] Updated weights for policy 0, policy_version 1317115 (0.0010) [2023-12-28 04:43:32,360][106226] Updated weights for policy 0, policy_version 1317125 (0.0008) [2023-12-28 04:43:32,360][106225] Updated weights for policy 1, policy_version 1320507 (0.0008) [2023-12-28 04:43:32,425][106225] Updated weights for policy 1, policy_version 1320517 (0.0006) [2023-12-28 04:43:32,427][106226] Updated weights for policy 0, policy_version 1317135 (0.0008) [2023-12-28 04:43:32,482][106225] Updated weights for policy 1, policy_version 1320527 (0.0005) [2023-12-28 04:43:33,153][106226] Updated weights for policy 0, policy_version 1317145 (0.0008) [2023-12-28 04:43:33,160][106225] Updated weights for policy 1, policy_version 1320537 (0.0006) [2023-12-28 04:43:33,209][106226] Updated weights for policy 0, policy_version 1317155 (0.0007) [2023-12-28 04:43:33,218][106225] Updated weights for policy 1, policy_version 1320547 (0.0007) [2023-12-28 04:43:33,255][106226] Updated weights for policy 0, policy_version 1317165 (0.0007) [2023-12-28 04:43:33,265][106225] Updated weights for policy 1, policy_version 1320557 (0.0006) [2023-12-28 04:43:33,313][106225] Updated weights for policy 1, policy_version 1320567 (0.0008) [2023-12-28 04:43:33,866][106226] Updated weights for policy 0, policy_version 1317175 (0.0005) [2023-12-28 04:43:33,933][106226] Updated weights for policy 0, policy_version 1317185 (0.0005) [2023-12-28 04:43:33,981][106226] Updated weights for policy 0, policy_version 1317195 (0.0006) [2023-12-28 04:43:34,032][106225] Updated weights for policy 1, policy_version 1320577 (0.0006) [2023-12-28 04:43:34,076][106225] Updated weights for policy 1, policy_version 1320587 (0.0006) [2023-12-28 04:43:34,143][106225] Updated weights for policy 1, policy_version 1320597 (0.0009) [2023-12-28 04:43:34,575][106226] Updated weights for policy 0, policy_version 1317205 (0.0006) [2023-12-28 04:43:34,629][106226] Updated weights for policy 0, policy_version 1317215 (0.0011) [2023-12-28 04:43:34,687][106226] Updated weights for policy 0, policy_version 1317225 (0.0007) [2023-12-28 04:43:34,837][106225] Updated weights for policy 1, policy_version 1320607 (0.0007) [2023-12-28 04:43:34,894][106225] Updated weights for policy 1, policy_version 1320617 (0.0005) [2023-12-28 04:43:34,939][106225] Updated weights for policy 1, policy_version 1320627 (0.0007) [2023-12-28 04:43:35,309][106226] Updated weights for policy 0, policy_version 1317235 (0.0011) [2023-12-28 04:43:35,356][106226] Updated weights for policy 0, policy_version 1317245 (0.0010) [2023-12-28 04:43:35,405][106226] Updated weights for policy 0, policy_version 1317255 (0.0010) [2023-12-28 04:43:35,621][106225] Updated weights for policy 1, policy_version 1320637 (0.0010) [2023-12-28 04:43:35,674][106225] Updated weights for policy 1, policy_version 1320647 (0.0010) [2023-12-28 04:43:35,732][106225] Updated weights for policy 1, policy_version 1320657 (0.0008) [2023-12-28 04:43:36,144][106226] Updated weights for policy 0, policy_version 1317265 (0.0010) [2023-12-28 04:43:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 675422208. Throughput: 0: 10133.1, 1: 9706.4. Samples: 675433880. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:43:36,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.789')] [2023-12-28 04:43:36,204][106226] Updated weights for policy 0, policy_version 1317275 (0.0008) [2023-12-28 04:43:36,263][106226] Updated weights for policy 0, policy_version 1317285 (0.0010) [2023-12-28 04:43:36,317][106226] Updated weights for policy 0, policy_version 1317295 (0.0009) [2023-12-28 04:43:36,413][106225] Updated weights for policy 1, policy_version 1320667 (0.0007) [2023-12-28 04:43:36,475][106225] Updated weights for policy 1, policy_version 1320677 (0.0008) [2023-12-28 04:43:36,533][106225] Updated weights for policy 1, policy_version 1320687 (0.0007) [2023-12-28 04:43:36,994][106226] Updated weights for policy 0, policy_version 1317305 (0.0008) [2023-12-28 04:43:37,044][106226] Updated weights for policy 0, policy_version 1317315 (0.0007) [2023-12-28 04:43:37,101][106226] Updated weights for policy 0, policy_version 1317325 (0.0008) [2023-12-28 04:43:37,253][106225] Updated weights for policy 1, policy_version 1320697 (0.0008) [2023-12-28 04:43:37,319][106225] Updated weights for policy 1, policy_version 1320707 (0.0005) [2023-12-28 04:43:37,385][106225] Updated weights for policy 1, policy_version 1320717 (0.0005) [2023-12-28 04:43:37,444][106225] Updated weights for policy 1, policy_version 1320727 (0.0005) [2023-12-28 04:43:37,773][106226] Updated weights for policy 0, policy_version 1317335 (0.0006) [2023-12-28 04:43:37,821][106226] Updated weights for policy 0, policy_version 1317345 (0.0005) [2023-12-28 04:43:37,879][106226] Updated weights for policy 0, policy_version 1317355 (0.0005) [2023-12-28 04:43:38,019][106225] Updated weights for policy 1, policy_version 1320737 (0.0005) [2023-12-28 04:43:38,087][106225] Updated weights for policy 1, policy_version 1320747 (0.0008) [2023-12-28 04:43:38,140][106225] Updated weights for policy 1, policy_version 1320757 (0.0010) [2023-12-28 04:43:38,617][106226] Updated weights for policy 0, policy_version 1317365 (0.0007) [2023-12-28 04:43:38,678][106226] Updated weights for policy 0, policy_version 1317375 (0.0008) [2023-12-28 04:43:38,719][106225] Updated weights for policy 1, policy_version 1320767 (0.0010) [2023-12-28 04:43:38,737][106226] Updated weights for policy 0, policy_version 1317385 (0.0006) [2023-12-28 04:43:38,788][106225] Updated weights for policy 1, policy_version 1320777 (0.0010) [2023-12-28 04:43:38,853][106225] Updated weights for policy 1, policy_version 1320787 (0.0009) [2023-12-28 04:43:39,538][106226] Updated weights for policy 0, policy_version 1317395 (0.0007) [2023-12-28 04:43:39,610][106226] Updated weights for policy 0, policy_version 1317405 (0.0007) [2023-12-28 04:43:39,667][106226] Updated weights for policy 0, policy_version 1317415 (0.0009) [2023-12-28 04:43:39,676][106225] Updated weights for policy 1, policy_version 1320797 (0.0007) [2023-12-28 04:43:39,736][106225] Updated weights for policy 1, policy_version 1320807 (0.0006) [2023-12-28 04:43:39,791][106225] Updated weights for policy 1, policy_version 1320817 (0.0006) [2023-12-28 04:43:40,390][106226] Updated weights for policy 0, policy_version 1317425 (0.0009) [2023-12-28 04:43:40,400][106225] Updated weights for policy 1, policy_version 1320827 (0.0008) [2023-12-28 04:43:40,454][106226] Updated weights for policy 0, policy_version 1317435 (0.0007) [2023-12-28 04:43:40,461][106225] Updated weights for policy 1, policy_version 1320837 (0.0010) [2023-12-28 04:43:40,515][106226] Updated weights for policy 0, policy_version 1317445 (0.0006) [2023-12-28 04:43:40,530][106225] Updated weights for policy 1, policy_version 1320847 (0.0011) [2023-12-28 04:43:40,574][106226] Updated weights for policy 0, policy_version 1317455 (0.0006) [2023-12-28 04:43:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 675520512. Throughput: 0: 10130.2, 1: 9779.4. Samples: 675495276. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:43:41,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.932')] [2023-12-28 04:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001317456_337330176.pth... [2023-12-28 04:43:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001316272_337027072.pth [2023-12-28 04:43:41,193][106225] Updated weights for policy 1, policy_version 1320857 (0.0010) [2023-12-28 04:43:41,258][106225] Updated weights for policy 1, policy_version 1320867 (0.0008) [2023-12-28 04:43:41,262][106226] Updated weights for policy 0, policy_version 1317465 (0.0007) [2023-12-28 04:43:41,319][106225] Updated weights for policy 1, policy_version 1320877 (0.0007) [2023-12-28 04:43:41,333][106226] Updated weights for policy 0, policy_version 1317475 (0.0007) [2023-12-28 04:43:41,395][106225] Updated weights for policy 1, policy_version 1320887 (0.0008) [2023-12-28 04:43:41,399][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001320888_338198528.pth... [2023-12-28 04:43:41,403][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001319736_337903616.pth [2023-12-28 04:43:41,406][106226] Updated weights for policy 0, policy_version 1317485 (0.0009) [2023-12-28 04:43:42,143][106226] Updated weights for policy 0, policy_version 1317495 (0.0007) [2023-12-28 04:43:42,211][106226] Updated weights for policy 0, policy_version 1317505 (0.0006) [2023-12-28 04:43:42,234][106225] Updated weights for policy 1, policy_version 1320897 (0.0007) [2023-12-28 04:43:42,281][106226] Updated weights for policy 0, policy_version 1317515 (0.0007) [2023-12-28 04:43:42,295][106225] Updated weights for policy 1, policy_version 1320907 (0.0008) [2023-12-28 04:43:42,357][106225] Updated weights for policy 1, policy_version 1320917 (0.0007) [2023-12-28 04:43:42,985][106226] Updated weights for policy 0, policy_version 1317525 (0.0007) [2023-12-28 04:43:43,036][106225] Updated weights for policy 1, policy_version 1320927 (0.0009) [2023-12-28 04:43:43,046][106226] Updated weights for policy 0, policy_version 1317535 (0.0008) [2023-12-28 04:43:43,090][106225] Updated weights for policy 1, policy_version 1320937 (0.0006) [2023-12-28 04:43:43,111][106226] Updated weights for policy 0, policy_version 1317545 (0.0009) [2023-12-28 04:43:43,150][106225] Updated weights for policy 1, policy_version 1320947 (0.0006) [2023-12-28 04:43:43,763][106226] Updated weights for policy 0, policy_version 1317555 (0.0007) [2023-12-28 04:43:43,811][106226] Updated weights for policy 0, policy_version 1317565 (0.0005) [2023-12-28 04:43:43,869][106226] Updated weights for policy 0, policy_version 1317575 (0.0006) [2023-12-28 04:43:43,880][106225] Updated weights for policy 1, policy_version 1320957 (0.0009) [2023-12-28 04:43:43,930][106225] Updated weights for policy 1, policy_version 1320967 (0.0008) [2023-12-28 04:43:43,979][106225] Updated weights for policy 1, policy_version 1320977 (0.0009) [2023-12-28 04:43:44,460][106226] Updated weights for policy 0, policy_version 1317585 (0.0006) [2023-12-28 04:43:44,527][106226] Updated weights for policy 0, policy_version 1317595 (0.0009) [2023-12-28 04:43:44,588][106226] Updated weights for policy 0, policy_version 1317605 (0.0008) [2023-12-28 04:43:44,650][106226] Updated weights for policy 0, policy_version 1317615 (0.0009) [2023-12-28 04:43:44,784][106225] Updated weights for policy 1, policy_version 1320987 (0.0009) [2023-12-28 04:43:44,843][106225] Updated weights for policy 1, policy_version 1320997 (0.0009) [2023-12-28 04:43:44,907][106225] Updated weights for policy 1, policy_version 1321007 (0.0010) [2023-12-28 04:43:45,378][106226] Updated weights for policy 0, policy_version 1317625 (0.0007) [2023-12-28 04:43:45,438][106226] Updated weights for policy 0, policy_version 1317635 (0.0008) [2023-12-28 04:43:45,498][106226] Updated weights for policy 0, policy_version 1317645 (0.0008) [2023-12-28 04:43:45,630][106225] Updated weights for policy 1, policy_version 1321017 (0.0010) [2023-12-28 04:43:45,696][106225] Updated weights for policy 1, policy_version 1321027 (0.0010) [2023-12-28 04:43:45,750][106225] Updated weights for policy 1, policy_version 1321037 (0.0010) [2023-12-28 04:43:45,797][106225] Updated weights for policy 1, policy_version 1321047 (0.0009) [2023-12-28 04:43:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 675618816. Throughput: 0: 10091.1, 1: 9720.7. Samples: 675611620. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:43:46,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.539')] [2023-12-28 04:43:46,257][106226] Updated weights for policy 0, policy_version 1317655 (0.0006) [2023-12-28 04:43:46,322][106226] Updated weights for policy 0, policy_version 1317665 (0.0005) [2023-12-28 04:43:46,382][106226] Updated weights for policy 0, policy_version 1317675 (0.0005) [2023-12-28 04:43:46,458][106225] Updated weights for policy 1, policy_version 1321057 (0.0010) [2023-12-28 04:43:46,511][106225] Updated weights for policy 1, policy_version 1321067 (0.0010) [2023-12-28 04:43:46,564][106225] Updated weights for policy 1, policy_version 1321077 (0.0006) [2023-12-28 04:43:47,048][106226] Updated weights for policy 0, policy_version 1317685 (0.0007) [2023-12-28 04:43:47,110][106226] Updated weights for policy 0, policy_version 1317695 (0.0008) [2023-12-28 04:43:47,171][106226] Updated weights for policy 0, policy_version 1317705 (0.0008) [2023-12-28 04:43:47,262][106225] Updated weights for policy 1, policy_version 1321087 (0.0009) [2023-12-28 04:43:47,319][106225] Updated weights for policy 1, policy_version 1321097 (0.0010) [2023-12-28 04:43:47,378][106225] Updated weights for policy 1, policy_version 1321107 (0.0010) [2023-12-28 04:43:47,912][106226] Updated weights for policy 0, policy_version 1317715 (0.0008) [2023-12-28 04:43:47,960][106226] Updated weights for policy 0, policy_version 1317725 (0.0008) [2023-12-28 04:43:47,994][106225] Updated weights for policy 1, policy_version 1321117 (0.0009) [2023-12-28 04:43:48,005][106226] Updated weights for policy 0, policy_version 1317735 (0.0006) [2023-12-28 04:43:48,059][106225] Updated weights for policy 1, policy_version 1321127 (0.0009) [2023-12-28 04:43:48,112][106225] Updated weights for policy 1, policy_version 1321137 (0.0010) [2023-12-28 04:43:48,788][106225] Updated weights for policy 1, policy_version 1321147 (0.0010) [2023-12-28 04:43:48,833][106226] Updated weights for policy 0, policy_version 1317745 (0.0007) [2023-12-28 04:43:48,849][106225] Updated weights for policy 1, policy_version 1321157 (0.0010) [2023-12-28 04:43:48,894][106226] Updated weights for policy 0, policy_version 1317755 (0.0006) [2023-12-28 04:43:48,910][106225] Updated weights for policy 1, policy_version 1321167 (0.0010) [2023-12-28 04:43:48,951][106226] Updated weights for policy 0, policy_version 1317765 (0.0006) [2023-12-28 04:43:49,000][106226] Updated weights for policy 0, policy_version 1317775 (0.0007) [2023-12-28 04:43:49,649][106225] Updated weights for policy 1, policy_version 1321177 (0.0011) [2023-12-28 04:43:49,712][106226] Updated weights for policy 0, policy_version 1317785 (0.0006) [2023-12-28 04:43:49,713][106225] Updated weights for policy 1, policy_version 1321187 (0.0010) [2023-12-28 04:43:49,780][106226] Updated weights for policy 0, policy_version 1317795 (0.0007) [2023-12-28 04:43:49,782][106225] Updated weights for policy 1, policy_version 1321197 (0.0009) [2023-12-28 04:43:49,844][106226] Updated weights for policy 0, policy_version 1317805 (0.0007) [2023-12-28 04:43:49,851][106225] Updated weights for policy 1, policy_version 1321207 (0.0010) [2023-12-28 04:43:50,483][106226] Updated weights for policy 0, policy_version 1317815 (0.0008) [2023-12-28 04:43:50,537][106226] Updated weights for policy 0, policy_version 1317825 (0.0006) [2023-12-28 04:43:50,557][106225] Updated weights for policy 1, policy_version 1321217 (0.0010) [2023-12-28 04:43:50,593][106226] Updated weights for policy 0, policy_version 1317835 (0.0008) [2023-12-28 04:43:50,618][106225] Updated weights for policy 1, policy_version 1321227 (0.0012) [2023-12-28 04:43:50,682][106225] Updated weights for policy 1, policy_version 1321237 (0.0009) [2023-12-28 04:43:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 675717120. Throughput: 0: 10050.7, 1: 9716.6. Samples: 675729632. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:43:51,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.698')] [2023-12-28 04:43:51,264][106226] Updated weights for policy 0, policy_version 1317845 (0.0007) [2023-12-28 04:43:51,325][106226] Updated weights for policy 0, policy_version 1317855 (0.0008) [2023-12-28 04:43:51,396][106226] Updated weights for policy 0, policy_version 1317865 (0.0008) [2023-12-28 04:43:51,453][106225] Updated weights for policy 1, policy_version 1321247 (0.0008) [2023-12-28 04:43:51,510][106225] Updated weights for policy 1, policy_version 1321257 (0.0010) [2023-12-28 04:43:51,568][106225] Updated weights for policy 1, policy_version 1321267 (0.0006) [2023-12-28 04:43:52,234][106225] Updated weights for policy 1, policy_version 1321277 (0.0009) [2023-12-28 04:43:52,236][106226] Updated weights for policy 0, policy_version 1317875 (0.0008) [2023-12-28 04:43:52,299][106226] Updated weights for policy 0, policy_version 1317885 (0.0007) [2023-12-28 04:43:52,300][106225] Updated weights for policy 1, policy_version 1321287 (0.0011) [2023-12-28 04:43:52,358][106226] Updated weights for policy 0, policy_version 1317895 (0.0006) [2023-12-28 04:43:52,362][106225] Updated weights for policy 1, policy_version 1321297 (0.0010) [2023-12-28 04:43:53,068][106225] Updated weights for policy 1, policy_version 1321307 (0.0010) [2023-12-28 04:43:53,099][106226] Updated weights for policy 0, policy_version 1317905 (0.0009) [2023-12-28 04:43:53,131][106225] Updated weights for policy 1, policy_version 1321317 (0.0010) [2023-12-28 04:43:53,181][106226] Updated weights for policy 0, policy_version 1317915 (0.0007) [2023-12-28 04:43:53,190][106225] Updated weights for policy 1, policy_version 1321327 (0.0010) [2023-12-28 04:43:53,238][106226] Updated weights for policy 0, policy_version 1317925 (0.0006) [2023-12-28 04:43:53,294][106226] Updated weights for policy 0, policy_version 1317935 (0.0008) [2023-12-28 04:43:53,813][106225] Updated weights for policy 1, policy_version 1321337 (0.0010) [2023-12-28 04:43:53,875][106225] Updated weights for policy 1, policy_version 1321347 (0.0010) [2023-12-28 04:43:53,939][106225] Updated weights for policy 1, policy_version 1321357 (0.0010) [2023-12-28 04:43:54,000][106225] Updated weights for policy 1, policy_version 1321367 (0.0010) [2023-12-28 04:43:54,049][106226] Updated weights for policy 0, policy_version 1317945 (0.0008) [2023-12-28 04:43:54,101][106226] Updated weights for policy 0, policy_version 1317956 (0.0008) [2023-12-28 04:43:54,169][106226] Updated weights for policy 0, policy_version 1317966 (0.0008) [2023-12-28 04:43:54,710][106225] Updated weights for policy 1, policy_version 1321377 (0.0010) [2023-12-28 04:43:54,761][106225] Updated weights for policy 1, policy_version 1321387 (0.0008) [2023-12-28 04:43:54,811][106225] Updated weights for policy 1, policy_version 1321397 (0.0010) [2023-12-28 04:43:54,952][106226] Updated weights for policy 0, policy_version 1317976 (0.0008) [2023-12-28 04:43:55,021][106226] Updated weights for policy 0, policy_version 1317986 (0.0008) [2023-12-28 04:43:55,086][106226] Updated weights for policy 0, policy_version 1317996 (0.0008) [2023-12-28 04:43:55,519][106225] Updated weights for policy 1, policy_version 1321407 (0.0009) [2023-12-28 04:43:55,575][106225] Updated weights for policy 1, policy_version 1321417 (0.0010) [2023-12-28 04:43:55,628][106225] Updated weights for policy 1, policy_version 1321427 (0.0010) [2023-12-28 04:43:55,817][106226] Updated weights for policy 0, policy_version 1318006 (0.0008) [2023-12-28 04:43:55,879][106226] Updated weights for policy 0, policy_version 1318016 (0.0008) [2023-12-28 04:43:55,934][106226] Updated weights for policy 0, policy_version 1318026 (0.0008) [2023-12-28 04:43:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 675815424. Throughput: 0: 10001.7, 1: 9717.1. Samples: 675786268. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:43:56,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.907')] [2023-12-28 04:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001321432_338337792.pth... [2023-12-28 04:43:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001318032_337477632.pth... [2023-12-28 04:43:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001320280_338042880.pth [2023-12-28 04:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001316880_337182720.pth [2023-12-28 04:43:56,302][106225] Updated weights for policy 1, policy_version 1321437 (0.0010) [2023-12-28 04:43:56,348][106225] Updated weights for policy 1, policy_version 1321447 (0.0010) [2023-12-28 04:43:56,404][106225] Updated weights for policy 1, policy_version 1321457 (0.0010) [2023-12-28 04:43:56,698][106226] Updated weights for policy 0, policy_version 1318036 (0.0008) [2023-12-28 04:43:56,755][106226] Updated weights for policy 0, policy_version 1318046 (0.0007) [2023-12-28 04:43:56,809][106226] Updated weights for policy 0, policy_version 1318056 (0.0008) [2023-12-28 04:43:57,116][106225] Updated weights for policy 1, policy_version 1321467 (0.0010) [2023-12-28 04:43:57,170][106225] Updated weights for policy 1, policy_version 1321477 (0.0010) [2023-12-28 04:43:57,233][106225] Updated weights for policy 1, policy_version 1321487 (0.0010) [2023-12-28 04:43:57,544][106226] Updated weights for policy 0, policy_version 1318066 (0.0008) [2023-12-28 04:43:57,591][106226] Updated weights for policy 0, policy_version 1318076 (0.0007) [2023-12-28 04:43:57,644][106226] Updated weights for policy 0, policy_version 1318086 (0.0008) [2023-12-28 04:43:57,696][106226] Updated weights for policy 0, policy_version 1318096 (0.0007) [2023-12-28 04:43:57,903][106225] Updated weights for policy 1, policy_version 1321497 (0.0010) [2023-12-28 04:43:57,955][106225] Updated weights for policy 1, policy_version 1321507 (0.0010) [2023-12-28 04:43:58,004][106225] Updated weights for policy 1, policy_version 1321517 (0.0010) [2023-12-28 04:43:58,053][106225] Updated weights for policy 1, policy_version 1321527 (0.0010) [2023-12-28 04:43:58,491][106226] Updated weights for policy 0, policy_version 1318106 (0.0008) [2023-12-28 04:43:58,555][106226] Updated weights for policy 0, policy_version 1318116 (0.0008) [2023-12-28 04:43:58,618][106226] Updated weights for policy 0, policy_version 1318126 (0.0008) [2023-12-28 04:43:58,899][106225] Updated weights for policy 1, policy_version 1321537 (0.0013) [2023-12-28 04:43:58,973][106225] Updated weights for policy 1, policy_version 1321547 (0.0009) [2023-12-28 04:43:59,030][106225] Updated weights for policy 1, policy_version 1321557 (0.0010) [2023-12-28 04:43:59,411][106226] Updated weights for policy 0, policy_version 1318136 (0.0009) [2023-12-28 04:43:59,474][106226] Updated weights for policy 0, policy_version 1318146 (0.0008) [2023-12-28 04:43:59,537][106226] Updated weights for policy 0, policy_version 1318156 (0.0007) [2023-12-28 04:43:59,807][106225] Updated weights for policy 1, policy_version 1321567 (0.0007) [2023-12-28 04:43:59,877][106225] Updated weights for policy 1, policy_version 1321577 (0.0010) [2023-12-28 04:43:59,939][106225] Updated weights for policy 1, policy_version 1321587 (0.0010) [2023-12-28 04:44:00,221][106226] Updated weights for policy 0, policy_version 1318166 (0.0008) [2023-12-28 04:44:00,282][106226] Updated weights for policy 0, policy_version 1318176 (0.0008) [2023-12-28 04:44:00,342][106226] Updated weights for policy 0, policy_version 1318186 (0.0008) [2023-12-28 04:44:00,625][106225] Updated weights for policy 1, policy_version 1321597 (0.0009) [2023-12-28 04:44:00,674][106225] Updated weights for policy 1, policy_version 1321607 (0.0010) [2023-12-28 04:44:00,723][106225] Updated weights for policy 1, policy_version 1321617 (0.0010) [2023-12-28 04:44:01,061][106226] Updated weights for policy 0, policy_version 1318196 (0.0008) [2023-12-28 04:44:01,122][106226] Updated weights for policy 0, policy_version 1318206 (0.0008) [2023-12-28 04:44:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 675905536. Throughput: 0: 9888.7, 1: 9751.7. Samples: 675899988. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:01,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.920')] [2023-12-28 04:44:01,182][106226] Updated weights for policy 0, policy_version 1318216 (0.0008) [2023-12-28 04:44:01,484][106225] Updated weights for policy 1, policy_version 1321627 (0.0010) [2023-12-28 04:44:01,538][106225] Updated weights for policy 1, policy_version 1321637 (0.0010) [2023-12-28 04:44:01,594][106225] Updated weights for policy 1, policy_version 1321647 (0.0010) [2023-12-28 04:44:01,910][106226] Updated weights for policy 0, policy_version 1318226 (0.0007) [2023-12-28 04:44:01,970][106226] Updated weights for policy 0, policy_version 1318236 (0.0005) [2023-12-28 04:44:02,033][106226] Updated weights for policy 0, policy_version 1318246 (0.0006) [2023-12-28 04:44:02,102][106226] Updated weights for policy 0, policy_version 1318256 (0.0009) [2023-12-28 04:44:02,280][106225] Updated weights for policy 1, policy_version 1321657 (0.0010) [2023-12-28 04:44:02,343][106225] Updated weights for policy 1, policy_version 1321667 (0.0009) [2023-12-28 04:44:02,414][106225] Updated weights for policy 1, policy_version 1321677 (0.0008) [2023-12-28 04:44:02,480][106225] Updated weights for policy 1, policy_version 1321687 (0.0009) [2023-12-28 04:44:02,760][106226] Updated weights for policy 0, policy_version 1318266 (0.0009) [2023-12-28 04:44:02,824][106226] Updated weights for policy 0, policy_version 1318276 (0.0009) [2023-12-28 04:44:02,875][106226] Updated weights for policy 0, policy_version 1318286 (0.0009) [2023-12-28 04:44:03,195][106225] Updated weights for policy 1, policy_version 1321697 (0.0008) [2023-12-28 04:44:03,243][106225] Updated weights for policy 1, policy_version 1321707 (0.0008) [2023-12-28 04:44:03,290][106225] Updated weights for policy 1, policy_version 1321717 (0.0008) [2023-12-28 04:44:03,610][106226] Updated weights for policy 0, policy_version 1318296 (0.0008) [2023-12-28 04:44:03,657][106226] Updated weights for policy 0, policy_version 1318306 (0.0008) [2023-12-28 04:44:03,709][106226] Updated weights for policy 0, policy_version 1318316 (0.0008) [2023-12-28 04:44:04,014][106225] Updated weights for policy 1, policy_version 1321727 (0.0007) [2023-12-28 04:44:04,074][106225] Updated weights for policy 1, policy_version 1321737 (0.0008) [2023-12-28 04:44:04,137][106225] Updated weights for policy 1, policy_version 1321747 (0.0008) [2023-12-28 04:44:04,438][106226] Updated weights for policy 0, policy_version 1318326 (0.0008) [2023-12-28 04:44:04,487][106226] Updated weights for policy 0, policy_version 1318336 (0.0007) [2023-12-28 04:44:04,537][106226] Updated weights for policy 0, policy_version 1318346 (0.0009) [2023-12-28 04:44:04,828][106225] Updated weights for policy 1, policy_version 1321757 (0.0008) [2023-12-28 04:44:04,884][106225] Updated weights for policy 1, policy_version 1321767 (0.0008) [2023-12-28 04:44:04,941][106225] Updated weights for policy 1, policy_version 1321777 (0.0008) [2023-12-28 04:44:05,300][106226] Updated weights for policy 0, policy_version 1318356 (0.0007) [2023-12-28 04:44:05,353][106226] Updated weights for policy 0, policy_version 1318366 (0.0006) [2023-12-28 04:44:05,401][106226] Updated weights for policy 0, policy_version 1318376 (0.0008) [2023-12-28 04:44:05,661][106225] Updated weights for policy 1, policy_version 1321787 (0.0008) [2023-12-28 04:44:05,717][106225] Updated weights for policy 1, policy_version 1321797 (0.0007) [2023-12-28 04:44:05,771][106225] Updated weights for policy 1, policy_version 1321807 (0.0008) [2023-12-28 04:44:06,080][106226] Updated weights for policy 0, policy_version 1318386 (0.0009) [2023-12-28 04:44:06,139][106226] Updated weights for policy 0, policy_version 1318396 (0.0008) [2023-12-28 04:44:06,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 676003840. Throughput: 0: 9806.9, 1: 9777.6. Samples: 676016572. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:06,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-4.820')] [2023-12-28 04:44:06,201][106226] Updated weights for policy 0, policy_version 1318406 (0.0008) [2023-12-28 04:44:06,265][106226] Updated weights for policy 0, policy_version 1318416 (0.0008) [2023-12-28 04:44:06,495][106225] Updated weights for policy 1, policy_version 1321817 (0.0008) [2023-12-28 04:44:06,552][106225] Updated weights for policy 1, policy_version 1321827 (0.0010) [2023-12-28 04:44:06,618][106225] Updated weights for policy 1, policy_version 1321837 (0.0010) [2023-12-28 04:44:06,672][106225] Updated weights for policy 1, policy_version 1321847 (0.0010) [2023-12-28 04:44:07,051][106226] Updated weights for policy 0, policy_version 1318426 (0.0008) [2023-12-28 04:44:07,110][106226] Updated weights for policy 0, policy_version 1318436 (0.0008) [2023-12-28 04:44:07,178][106226] Updated weights for policy 0, policy_version 1318446 (0.0008) [2023-12-28 04:44:07,365][106225] Updated weights for policy 1, policy_version 1321857 (0.0010) [2023-12-28 04:44:07,422][106225] Updated weights for policy 1, policy_version 1321867 (0.0010) [2023-12-28 04:44:07,475][106225] Updated weights for policy 1, policy_version 1321877 (0.0010) [2023-12-28 04:44:07,929][106226] Updated weights for policy 0, policy_version 1318456 (0.0007) [2023-12-28 04:44:07,998][106226] Updated weights for policy 0, policy_version 1318466 (0.0005) [2023-12-28 04:44:08,064][106226] Updated weights for policy 0, policy_version 1318476 (0.0006) [2023-12-28 04:44:08,135][106225] Updated weights for policy 1, policy_version 1321887 (0.0009) [2023-12-28 04:44:08,184][106225] Updated weights for policy 1, policy_version 1321897 (0.0007) [2023-12-28 04:44:08,238][106225] Updated weights for policy 1, policy_version 1321907 (0.0008) [2023-12-28 04:44:08,721][106226] Updated weights for policy 0, policy_version 1318486 (0.0005) [2023-12-28 04:44:08,779][106226] Updated weights for policy 0, policy_version 1318496 (0.0009) [2023-12-28 04:44:08,843][106226] Updated weights for policy 0, policy_version 1318506 (0.0010) [2023-12-28 04:44:09,003][106225] Updated weights for policy 1, policy_version 1321917 (0.0008) [2023-12-28 04:44:09,048][106225] Updated weights for policy 1, policy_version 1321927 (0.0010) [2023-12-28 04:44:09,115][106225] Updated weights for policy 1, policy_version 1321937 (0.0009) [2023-12-28 04:44:09,608][106226] Updated weights for policy 0, policy_version 1318516 (0.0009) [2023-12-28 04:44:09,667][106226] Updated weights for policy 0, policy_version 1318526 (0.0008) [2023-12-28 04:44:09,724][106226] Updated weights for policy 0, policy_version 1318536 (0.0008) [2023-12-28 04:44:09,817][106225] Updated weights for policy 1, policy_version 1321947 (0.0010) [2023-12-28 04:44:09,878][106225] Updated weights for policy 1, policy_version 1321957 (0.0008) [2023-12-28 04:44:09,942][106225] Updated weights for policy 1, policy_version 1321967 (0.0009) [2023-12-28 04:44:10,502][106226] Updated weights for policy 0, policy_version 1318546 (0.0007) [2023-12-28 04:44:10,554][106226] Updated weights for policy 0, policy_version 1318556 (0.0008) [2023-12-28 04:44:10,606][106226] Updated weights for policy 0, policy_version 1318566 (0.0009) [2023-12-28 04:44:10,659][106226] Updated weights for policy 0, policy_version 1318576 (0.0008) [2023-12-28 04:44:10,745][106225] Updated weights for policy 1, policy_version 1321977 (0.0008) [2023-12-28 04:44:10,801][106225] Updated weights for policy 1, policy_version 1321987 (0.0005) [2023-12-28 04:44:10,857][106225] Updated weights for policy 1, policy_version 1321997 (0.0005) [2023-12-28 04:44:10,911][106225] Updated weights for policy 1, policy_version 1322007 (0.0007) [2023-12-28 04:44:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 676102144. Throughput: 0: 9813.9, 1: 9837.8. Samples: 676074560. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:11,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.662')] [2023-12-28 04:44:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001318576_337616896.pth... [2023-12-28 04:44:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001322008_338485248.pth... [2023-12-28 04:44:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001317456_337330176.pth [2023-12-28 04:44:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001320888_338198528.pth [2023-12-28 04:44:11,451][106226] Updated weights for policy 0, policy_version 1318586 (0.0007) [2023-12-28 04:44:11,523][106226] Updated weights for policy 0, policy_version 1318596 (0.0006) [2023-12-28 04:44:11,590][106226] Updated weights for policy 0, policy_version 1318606 (0.0007) [2023-12-28 04:44:11,593][106225] Updated weights for policy 1, policy_version 1322017 (0.0009) [2023-12-28 04:44:11,660][106225] Updated weights for policy 1, policy_version 1322027 (0.0008) [2023-12-28 04:44:11,719][106225] Updated weights for policy 1, policy_version 1322037 (0.0011) [2023-12-28 04:44:12,280][106226] Updated weights for policy 0, policy_version 1318616 (0.0008) [2023-12-28 04:44:12,345][106226] Updated weights for policy 0, policy_version 1318626 (0.0010) [2023-12-28 04:44:12,417][106226] Updated weights for policy 0, policy_version 1318637 (0.0008) [2023-12-28 04:44:12,459][106225] Updated weights for policy 1, policy_version 1322047 (0.0008) [2023-12-28 04:44:12,509][106225] Updated weights for policy 1, policy_version 1322057 (0.0007) [2023-12-28 04:44:12,567][106225] Updated weights for policy 1, policy_version 1322067 (0.0007) [2023-12-28 04:44:13,123][106226] Updated weights for policy 0, policy_version 1318647 (0.0011) [2023-12-28 04:44:13,189][106226] Updated weights for policy 0, policy_version 1318657 (0.0009) [2023-12-28 04:44:13,251][106226] Updated weights for policy 0, policy_version 1318667 (0.0005) [2023-12-28 04:44:13,307][106225] Updated weights for policy 1, policy_version 1322077 (0.0006) [2023-12-28 04:44:13,359][106225] Updated weights for policy 1, policy_version 1322087 (0.0006) [2023-12-28 04:44:13,414][106225] Updated weights for policy 1, policy_version 1322097 (0.0005) [2023-12-28 04:44:13,853][106226] Updated weights for policy 0, policy_version 1318677 (0.0006) [2023-12-28 04:44:13,912][106226] Updated weights for policy 0, policy_version 1318687 (0.0006) [2023-12-28 04:44:13,972][106226] Updated weights for policy 0, policy_version 1318697 (0.0006) [2023-12-28 04:44:14,019][106225] Updated weights for policy 1, policy_version 1322107 (0.0006) [2023-12-28 04:44:14,079][106225] Updated weights for policy 1, policy_version 1322117 (0.0009) [2023-12-28 04:44:14,135][106225] Updated weights for policy 1, policy_version 1322127 (0.0008) [2023-12-28 04:44:14,660][106226] Updated weights for policy 0, policy_version 1318707 (0.0007) [2023-12-28 04:44:14,708][106226] Updated weights for policy 0, policy_version 1318717 (0.0008) [2023-12-28 04:44:14,760][106226] Updated weights for policy 0, policy_version 1318727 (0.0009) [2023-12-28 04:44:14,809][106225] Updated weights for policy 1, policy_version 1322137 (0.0007) [2023-12-28 04:44:14,858][106225] Updated weights for policy 1, policy_version 1322147 (0.0007) [2023-12-28 04:44:14,915][106225] Updated weights for policy 1, policy_version 1322157 (0.0007) [2023-12-28 04:44:14,979][106225] Updated weights for policy 1, policy_version 1322167 (0.0008) [2023-12-28 04:44:15,538][106226] Updated weights for policy 0, policy_version 1318737 (0.0008) [2023-12-28 04:44:15,595][106226] Updated weights for policy 0, policy_version 1318747 (0.0009) [2023-12-28 04:44:15,648][106226] Updated weights for policy 0, policy_version 1318757 (0.0009) [2023-12-28 04:44:15,701][106225] Updated weights for policy 1, policy_version 1322177 (0.0008) [2023-12-28 04:44:15,706][106226] Updated weights for policy 0, policy_version 1318767 (0.0008) [2023-12-28 04:44:15,750][106225] Updated weights for policy 1, policy_version 1322187 (0.0007) [2023-12-28 04:44:15,812][106225] Updated weights for policy 1, policy_version 1322197 (0.0008) [2023-12-28 04:44:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 676200448. Throughput: 0: 9670.4, 1: 9845.6. Samples: 676191040. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:16,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-5.231')] [2023-12-28 04:44:16,393][106226] Updated weights for policy 0, policy_version 1318777 (0.0010) [2023-12-28 04:44:16,457][106226] Updated weights for policy 0, policy_version 1318787 (0.0006) [2023-12-28 04:44:16,463][106225] Updated weights for policy 1, policy_version 1322207 (0.0007) [2023-12-28 04:44:16,517][106226] Updated weights for policy 0, policy_version 1318797 (0.0007) [2023-12-28 04:44:16,526][106225] Updated weights for policy 1, policy_version 1322217 (0.0008) [2023-12-28 04:44:16,576][106225] Updated weights for policy 1, policy_version 1322227 (0.0006) [2023-12-28 04:44:17,119][106226] Updated weights for policy 0, policy_version 1318807 (0.0006) [2023-12-28 04:44:17,178][106226] Updated weights for policy 0, policy_version 1318817 (0.0008) [2023-12-28 04:44:17,208][106225] Updated weights for policy 1, policy_version 1322237 (0.0007) [2023-12-28 04:44:17,234][106226] Updated weights for policy 0, policy_version 1318827 (0.0008) [2023-12-28 04:44:17,270][106225] Updated weights for policy 1, policy_version 1322247 (0.0008) [2023-12-28 04:44:17,322][106225] Updated weights for policy 1, policy_version 1322257 (0.0009) [2023-12-28 04:44:17,869][106226] Updated weights for policy 0, policy_version 1318837 (0.0005) [2023-12-28 04:44:17,929][106226] Updated weights for policy 0, policy_version 1318847 (0.0008) [2023-12-28 04:44:17,989][106226] Updated weights for policy 0, policy_version 1318857 (0.0006) [2023-12-28 04:44:17,996][106225] Updated weights for policy 1, policy_version 1322267 (0.0009) [2023-12-28 04:44:18,052][106225] Updated weights for policy 1, policy_version 1322277 (0.0009) [2023-12-28 04:44:18,100][106225] Updated weights for policy 1, policy_version 1322287 (0.0009) [2023-12-28 04:44:18,657][106226] Updated weights for policy 0, policy_version 1318867 (0.0007) [2023-12-28 04:44:18,724][106226] Updated weights for policy 0, policy_version 1318877 (0.0009) [2023-12-28 04:44:18,796][106226] Updated weights for policy 0, policy_version 1318887 (0.0010) [2023-12-28 04:44:18,819][106225] Updated weights for policy 1, policy_version 1322297 (0.0010) [2023-12-28 04:44:18,875][106225] Updated weights for policy 1, policy_version 1322307 (0.0005) [2023-12-28 04:44:18,925][106225] Updated weights for policy 1, policy_version 1322317 (0.0005) [2023-12-28 04:44:18,981][106225] Updated weights for policy 1, policy_version 1322327 (0.0005) [2023-12-28 04:44:19,451][106226] Updated weights for policy 0, policy_version 1318897 (0.0011) [2023-12-28 04:44:19,520][106226] Updated weights for policy 0, policy_version 1318907 (0.0009) [2023-12-28 04:44:19,574][106226] Updated weights for policy 0, policy_version 1318917 (0.0011) [2023-12-28 04:44:19,629][106226] Updated weights for policy 0, policy_version 1318927 (0.0011) [2023-12-28 04:44:19,692][106225] Updated weights for policy 1, policy_version 1322337 (0.0008) [2023-12-28 04:44:19,746][106225] Updated weights for policy 1, policy_version 1322347 (0.0007) [2023-12-28 04:44:19,806][106225] Updated weights for policy 1, policy_version 1322357 (0.0008) [2023-12-28 04:44:20,394][106226] Updated weights for policy 0, policy_version 1318937 (0.0008) [2023-12-28 04:44:20,449][106226] Updated weights for policy 0, policy_version 1318947 (0.0008) [2023-12-28 04:44:20,510][106226] Updated weights for policy 0, policy_version 1318957 (0.0007) [2023-12-28 04:44:20,541][106225] Updated weights for policy 1, policy_version 1322367 (0.0007) [2023-12-28 04:44:20,615][106225] Updated weights for policy 1, policy_version 1322377 (0.0008) [2023-12-28 04:44:20,674][106225] Updated weights for policy 1, policy_version 1322387 (0.0008) [2023-12-28 04:44:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 676298752. Throughput: 0: 9626.6, 1: 9852.9. Samples: 676310456. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:21,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-4.724')] [2023-12-28 04:44:21,274][106226] Updated weights for policy 0, policy_version 1318967 (0.0008) [2023-12-28 04:44:21,338][106226] Updated weights for policy 0, policy_version 1318977 (0.0008) [2023-12-28 04:44:21,402][106226] Updated weights for policy 0, policy_version 1318987 (0.0008) [2023-12-28 04:44:21,422][106225] Updated weights for policy 1, policy_version 1322397 (0.0008) [2023-12-28 04:44:21,478][106225] Updated weights for policy 1, policy_version 1322407 (0.0008) [2023-12-28 04:44:21,538][106225] Updated weights for policy 1, policy_version 1322417 (0.0007) [2023-12-28 04:44:22,214][106226] Updated weights for policy 0, policy_version 1318997 (0.0008) [2023-12-28 04:44:22,262][106225] Updated weights for policy 1, policy_version 1322427 (0.0008) [2023-12-28 04:44:22,276][106226] Updated weights for policy 0, policy_version 1319008 (0.0010) [2023-12-28 04:44:22,317][106225] Updated weights for policy 1, policy_version 1322437 (0.0008) [2023-12-28 04:44:22,345][106226] Updated weights for policy 0, policy_version 1319018 (0.0007) [2023-12-28 04:44:22,386][106225] Updated weights for policy 1, policy_version 1322448 (0.0008) [2023-12-28 04:44:23,081][106226] Updated weights for policy 0, policy_version 1319028 (0.0007) [2023-12-28 04:44:23,131][106225] Updated weights for policy 1, policy_version 1322458 (0.0010) [2023-12-28 04:44:23,133][106226] Updated weights for policy 0, policy_version 1319038 (0.0008) [2023-12-28 04:44:23,188][106225] Updated weights for policy 1, policy_version 1322468 (0.0008) [2023-12-28 04:44:23,190][106226] Updated weights for policy 0, policy_version 1319048 (0.0008) [2023-12-28 04:44:23,239][106225] Updated weights for policy 1, policy_version 1322478 (0.0006) [2023-12-28 04:44:23,292][106225] Updated weights for policy 1, policy_version 1322488 (0.0005) [2023-12-28 04:44:23,847][106225] Updated weights for policy 1, policy_version 1322498 (0.0005) [2023-12-28 04:44:23,899][106226] Updated weights for policy 0, policy_version 1319058 (0.0008) [2023-12-28 04:44:23,908][106225] Updated weights for policy 1, policy_version 1322508 (0.0005) [2023-12-28 04:44:23,957][106226] Updated weights for policy 0, policy_version 1319068 (0.0005) [2023-12-28 04:44:23,973][106225] Updated weights for policy 1, policy_version 1322518 (0.0005) [2023-12-28 04:44:24,011][106226] Updated weights for policy 0, policy_version 1319078 (0.0005) [2023-12-28 04:44:24,072][106226] Updated weights for policy 0, policy_version 1319088 (0.0005) [2023-12-28 04:44:24,638][106225] Updated weights for policy 1, policy_version 1322528 (0.0011) [2023-12-28 04:44:24,656][106226] Updated weights for policy 0, policy_version 1319098 (0.0006) [2023-12-28 04:44:24,692][106225] Updated weights for policy 1, policy_version 1322538 (0.0010) [2023-12-28 04:44:24,715][106226] Updated weights for policy 0, policy_version 1319108 (0.0009) [2023-12-28 04:44:24,749][106225] Updated weights for policy 1, policy_version 1322548 (0.0011) [2023-12-28 04:44:24,775][106226] Updated weights for policy 0, policy_version 1319118 (0.0006) [2023-12-28 04:44:25,360][106225] Updated weights for policy 1, policy_version 1322558 (0.0010) [2023-12-28 04:44:25,410][106225] Updated weights for policy 1, policy_version 1322568 (0.0010) [2023-12-28 04:44:25,467][106225] Updated weights for policy 1, policy_version 1322578 (0.0010) [2023-12-28 04:44:25,569][106226] Updated weights for policy 0, policy_version 1319128 (0.0008) [2023-12-28 04:44:25,623][106226] Updated weights for policy 0, policy_version 1319138 (0.0008) [2023-12-28 04:44:25,667][106226] Updated weights for policy 0, policy_version 1319148 (0.0008) [2023-12-28 04:44:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 676397056. Throughput: 0: 9593.5, 1: 9815.3. Samples: 676368672. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:26,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.679')] [2023-12-28 04:44:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001319152_337764352.pth... [2023-12-28 04:44:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001318032_337477632.pth [2023-12-28 04:44:26,190][106225] Updated weights for policy 1, policy_version 1322588 (0.0008) [2023-12-28 04:44:26,245][106225] Updated weights for policy 1, policy_version 1322598 (0.0006) [2023-12-28 04:44:26,291][106225] Updated weights for policy 1, policy_version 1322608 (0.0005) [2023-12-28 04:44:26,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001322616_338640896.pth... [2023-12-28 04:44:26,335][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001321432_338337792.pth [2023-12-28 04:44:26,385][106226] Updated weights for policy 0, policy_version 1319158 (0.0009) [2023-12-28 04:44:26,442][106226] Updated weights for policy 0, policy_version 1319168 (0.0010) [2023-12-28 04:44:26,503][106226] Updated weights for policy 0, policy_version 1319178 (0.0010) [2023-12-28 04:44:26,979][106225] Updated weights for policy 1, policy_version 1322618 (0.0006) [2023-12-28 04:44:27,035][106225] Updated weights for policy 1, policy_version 1322628 (0.0009) [2023-12-28 04:44:27,087][106225] Updated weights for policy 1, policy_version 1322638 (0.0008) [2023-12-28 04:44:27,134][106226] Updated weights for policy 0, policy_version 1319188 (0.0009) [2023-12-28 04:44:27,144][106225] Updated weights for policy 1, policy_version 1322648 (0.0008) [2023-12-28 04:44:27,184][106226] Updated weights for policy 0, policy_version 1319198 (0.0010) [2023-12-28 04:44:27,234][106226] Updated weights for policy 0, policy_version 1319208 (0.0010) [2023-12-28 04:44:27,865][106225] Updated weights for policy 1, policy_version 1322658 (0.0006) [2023-12-28 04:44:27,929][106225] Updated weights for policy 1, policy_version 1322668 (0.0008) [2023-12-28 04:44:27,940][106226] Updated weights for policy 0, policy_version 1319218 (0.0007) [2023-12-28 04:44:27,983][106225] Updated weights for policy 1, policy_version 1322678 (0.0005) [2023-12-28 04:44:27,992][106226] Updated weights for policy 0, policy_version 1319228 (0.0010) [2023-12-28 04:44:28,038][106226] Updated weights for policy 0, policy_version 1319238 (0.0010) [2023-12-28 04:44:28,084][106226] Updated weights for policy 0, policy_version 1319248 (0.0010) [2023-12-28 04:44:28,610][106225] Updated weights for policy 1, policy_version 1322688 (0.0007) [2023-12-28 04:44:28,671][106225] Updated weights for policy 1, policy_version 1322698 (0.0008) [2023-12-28 04:44:28,726][106225] Updated weights for policy 1, policy_version 1322708 (0.0008) [2023-12-28 04:44:28,767][106226] Updated weights for policy 0, policy_version 1319258 (0.0009) [2023-12-28 04:44:28,829][106226] Updated weights for policy 0, policy_version 1319268 (0.0011) [2023-12-28 04:44:28,896][106226] Updated weights for policy 0, policy_version 1319278 (0.0011) [2023-12-28 04:44:29,426][106225] Updated weights for policy 1, policy_version 1322718 (0.0008) [2023-12-28 04:44:29,485][106225] Updated weights for policy 1, policy_version 1322728 (0.0010) [2023-12-28 04:44:29,544][106225] Updated weights for policy 1, policy_version 1322738 (0.0008) [2023-12-28 04:44:29,599][106226] Updated weights for policy 0, policy_version 1319288 (0.0009) [2023-12-28 04:44:29,652][106226] Updated weights for policy 0, policy_version 1319298 (0.0009) [2023-12-28 04:44:29,710][106226] Updated weights for policy 0, policy_version 1319308 (0.0006) [2023-12-28 04:44:30,235][106225] Updated weights for policy 1, policy_version 1322748 (0.0008) [2023-12-28 04:44:30,289][106225] Updated weights for policy 1, policy_version 1322758 (0.0007) [2023-12-28 04:44:30,343][106225] Updated weights for policy 1, policy_version 1322768 (0.0010) [2023-12-28 04:44:30,379][106226] Updated weights for policy 0, policy_version 1319318 (0.0006) [2023-12-28 04:44:30,431][106226] Updated weights for policy 0, policy_version 1319328 (0.0005) [2023-12-28 04:44:30,484][106226] Updated weights for policy 0, policy_version 1319338 (0.0005) [2023-12-28 04:44:31,015][106226] Updated weights for policy 0, policy_version 1319348 (0.0005) [2023-12-28 04:44:31,049][106225] Updated weights for policy 1, policy_version 1322778 (0.0008) [2023-12-28 04:44:31,074][106226] Updated weights for policy 0, policy_version 1319358 (0.0007) [2023-12-28 04:44:31,109][106225] Updated weights for policy 1, policy_version 1322788 (0.0010) [2023-12-28 04:44:31,131][106226] Updated weights for policy 0, policy_version 1319368 (0.0006) [2023-12-28 04:44:31,173][106225] Updated weights for policy 1, policy_version 1322798 (0.0010) [2023-12-28 04:44:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 676495360. Throughput: 0: 9620.9, 1: 9892.7. Samples: 676489732. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:31,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-5.011')] [2023-12-28 04:44:31,234][106225] Updated weights for policy 1, policy_version 1322808 (0.0011) [2023-12-28 04:44:31,804][106226] Updated weights for policy 0, policy_version 1319378 (0.0010) [2023-12-28 04:44:31,870][106226] Updated weights for policy 0, policy_version 1319388 (0.0008) [2023-12-28 04:44:31,925][106226] Updated weights for policy 0, policy_version 1319398 (0.0009) [2023-12-28 04:44:31,983][106226] Updated weights for policy 0, policy_version 1319408 (0.0009) [2023-12-28 04:44:31,994][106225] Updated weights for policy 1, policy_version 1322818 (0.0007) [2023-12-28 04:44:32,054][106225] Updated weights for policy 1, policy_version 1322828 (0.0008) [2023-12-28 04:44:32,116][106225] Updated weights for policy 1, policy_version 1322838 (0.0008) [2023-12-28 04:44:32,713][106226] Updated weights for policy 0, policy_version 1319418 (0.0008) [2023-12-28 04:44:32,776][106226] Updated weights for policy 0, policy_version 1319428 (0.0009) [2023-12-28 04:44:32,841][106226] Updated weights for policy 0, policy_version 1319438 (0.0008) [2023-12-28 04:44:32,861][106225] Updated weights for policy 1, policy_version 1322848 (0.0009) [2023-12-28 04:44:32,916][106225] Updated weights for policy 1, policy_version 1322858 (0.0010) [2023-12-28 04:44:32,964][106225] Updated weights for policy 1, policy_version 1322868 (0.0009) [2023-12-28 04:44:33,492][106226] Updated weights for policy 0, policy_version 1319448 (0.0005) [2023-12-28 04:44:33,552][106226] Updated weights for policy 0, policy_version 1319458 (0.0007) [2023-12-28 04:44:33,609][106226] Updated weights for policy 0, policy_version 1319468 (0.0007) [2023-12-28 04:44:33,746][106225] Updated weights for policy 1, policy_version 1322878 (0.0009) [2023-12-28 04:44:33,800][106225] Updated weights for policy 1, policy_version 1322888 (0.0008) [2023-12-28 04:44:33,860][106225] Updated weights for policy 1, policy_version 1322898 (0.0009) [2023-12-28 04:44:34,185][106226] Updated weights for policy 0, policy_version 1319480 (0.0007) [2023-12-28 04:44:34,243][106226] Updated weights for policy 0, policy_version 1319490 (0.0008) [2023-12-28 04:44:34,306][106226] Updated weights for policy 0, policy_version 1319500 (0.0008) [2023-12-28 04:44:34,635][106225] Updated weights for policy 1, policy_version 1322908 (0.0007) [2023-12-28 04:44:34,706][106225] Updated weights for policy 1, policy_version 1322918 (0.0008) [2023-12-28 04:44:34,769][106225] Updated weights for policy 1, policy_version 1322928 (0.0010) [2023-12-28 04:44:35,035][106226] Updated weights for policy 0, policy_version 1319510 (0.0009) [2023-12-28 04:44:35,099][106226] Updated weights for policy 0, policy_version 1319520 (0.0006) [2023-12-28 04:44:35,152][106226] Updated weights for policy 0, policy_version 1319530 (0.0005) [2023-12-28 04:44:35,362][106225] Updated weights for policy 1, policy_version 1322938 (0.0008) [2023-12-28 04:44:35,408][106225] Updated weights for policy 1, policy_version 1322948 (0.0005) [2023-12-28 04:44:35,459][106225] Updated weights for policy 1, policy_version 1322958 (0.0006) [2023-12-28 04:44:35,517][106225] Updated weights for policy 1, policy_version 1322968 (0.0006) [2023-12-28 04:44:35,855][106226] Updated weights for policy 0, policy_version 1319540 (0.0007) [2023-12-28 04:44:35,910][106226] Updated weights for policy 0, policy_version 1319550 (0.0009) [2023-12-28 04:44:35,955][106226] Updated weights for policy 0, policy_version 1319560 (0.0008) [2023-12-28 04:44:36,071][106225] Updated weights for policy 1, policy_version 1322978 (0.0008) [2023-12-28 04:44:36,135][106225] Updated weights for policy 1, policy_version 1322988 (0.0009) [2023-12-28 04:44:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 676601856. Throughput: 0: 9712.1, 1: 9884.1. Samples: 676611460. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:36,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.857')] [2023-12-28 04:44:36,192][106225] Updated weights for policy 1, policy_version 1322998 (0.0008) [2023-12-28 04:44:36,717][106226] Updated weights for policy 0, policy_version 1319570 (0.0008) [2023-12-28 04:44:36,766][106226] Updated weights for policy 0, policy_version 1319580 (0.0008) [2023-12-28 04:44:36,815][106226] Updated weights for policy 0, policy_version 1319590 (0.0009) [2023-12-28 04:44:36,873][106226] Updated weights for policy 0, policy_version 1319600 (0.0007) [2023-12-28 04:44:36,913][106225] Updated weights for policy 1, policy_version 1323008 (0.0008) [2023-12-28 04:44:36,967][106225] Updated weights for policy 1, policy_version 1323018 (0.0010) [2023-12-28 04:44:37,034][106225] Updated weights for policy 1, policy_version 1323028 (0.0009) [2023-12-28 04:44:37,602][106226] Updated weights for policy 0, policy_version 1319610 (0.0006) [2023-12-28 04:44:37,663][106226] Updated weights for policy 0, policy_version 1319620 (0.0011) [2023-12-28 04:44:37,687][106225] Updated weights for policy 1, policy_version 1323038 (0.0010) [2023-12-28 04:44:37,721][106226] Updated weights for policy 0, policy_version 1319630 (0.0010) [2023-12-28 04:44:37,741][106225] Updated weights for policy 1, policy_version 1323048 (0.0010) [2023-12-28 04:44:37,794][106225] Updated weights for policy 1, policy_version 1323058 (0.0010) [2023-12-28 04:44:38,391][106226] Updated weights for policy 0, policy_version 1319640 (0.0009) [2023-12-28 04:44:38,446][106226] Updated weights for policy 0, policy_version 1319650 (0.0008) [2023-12-28 04:44:38,492][106225] Updated weights for policy 1, policy_version 1323068 (0.0010) [2023-12-28 04:44:38,504][106226] Updated weights for policy 0, policy_version 1319660 (0.0009) [2023-12-28 04:44:38,552][106225] Updated weights for policy 1, policy_version 1323078 (0.0010) [2023-12-28 04:44:38,610][106225] Updated weights for policy 1, policy_version 1323088 (0.0010) [2023-12-28 04:44:39,282][106226] Updated weights for policy 0, policy_version 1319670 (0.0007) [2023-12-28 04:44:39,350][106226] Updated weights for policy 0, policy_version 1319680 (0.0009) [2023-12-28 04:44:39,400][106225] Updated weights for policy 1, policy_version 1323098 (0.0009) [2023-12-28 04:44:39,420][106226] Updated weights for policy 0, policy_version 1319690 (0.0008) [2023-12-28 04:44:39,470][106225] Updated weights for policy 1, policy_version 1323108 (0.0007) [2023-12-28 04:44:39,524][106225] Updated weights for policy 1, policy_version 1323118 (0.0009) [2023-12-28 04:44:39,581][106225] Updated weights for policy 1, policy_version 1323128 (0.0009) [2023-12-28 04:44:40,196][106226] Updated weights for policy 0, policy_version 1319700 (0.0009) [2023-12-28 04:44:40,259][106226] Updated weights for policy 0, policy_version 1319710 (0.0008) [2023-12-28 04:44:40,315][106226] Updated weights for policy 0, policy_version 1319720 (0.0009) [2023-12-28 04:44:40,356][106225] Updated weights for policy 1, policy_version 1323138 (0.0008) [2023-12-28 04:44:40,422][106225] Updated weights for policy 1, policy_version 1323148 (0.0009) [2023-12-28 04:44:40,488][106225] Updated weights for policy 1, policy_version 1323158 (0.0006) [2023-12-28 04:44:40,978][106226] Updated weights for policy 0, policy_version 1319730 (0.0006) [2023-12-28 04:44:41,043][106226] Updated weights for policy 0, policy_version 1319740 (0.0013) [2023-12-28 04:44:41,049][106225] Updated weights for policy 1, policy_version 1323169 (0.0008) [2023-12-28 04:44:41,112][106225] Updated weights for policy 1, policy_version 1323179 (0.0010) [2023-12-28 04:44:41,123][106226] Updated weights for policy 0, policy_version 1319752 (0.0008) [2023-12-28 04:44:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 676691968. Throughput: 0: 9774.0, 1: 9884.7. Samples: 676670908. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:41,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.805')] [2023-12-28 04:44:41,177][106225] Updated weights for policy 1, policy_version 1323189 (0.0009) [2023-12-28 04:44:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001319760_337920000.pth... [2023-12-28 04:44:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001318576_337616896.pth [2023-12-28 04:44:41,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001323192_338788352.pth... [2023-12-28 04:44:41,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001322008_338485248.pth [2023-12-28 04:44:41,883][106226] Updated weights for policy 0, policy_version 1319762 (0.0008) [2023-12-28 04:44:41,928][106225] Updated weights for policy 1, policy_version 1323199 (0.0009) [2023-12-28 04:44:41,947][106226] Updated weights for policy 0, policy_version 1319772 (0.0009) [2023-12-28 04:44:41,990][106225] Updated weights for policy 1, policy_version 1323209 (0.0009) [2023-12-28 04:44:42,011][106226] Updated weights for policy 0, policy_version 1319782 (0.0007) [2023-12-28 04:44:42,049][106225] Updated weights for policy 1, policy_version 1323219 (0.0011) [2023-12-28 04:44:42,075][106226] Updated weights for policy 0, policy_version 1319792 (0.0006) [2023-12-28 04:44:42,754][106226] Updated weights for policy 0, policy_version 1319802 (0.0007) [2023-12-28 04:44:42,801][106225] Updated weights for policy 1, policy_version 1323229 (0.0011) [2023-12-28 04:44:42,806][106226] Updated weights for policy 0, policy_version 1319812 (0.0008) [2023-12-28 04:44:42,856][106225] Updated weights for policy 1, policy_version 1323239 (0.0008) [2023-12-28 04:44:42,858][106226] Updated weights for policy 0, policy_version 1319822 (0.0006) [2023-12-28 04:44:42,922][106225] Updated weights for policy 1, policy_version 1323249 (0.0010) [2023-12-28 04:44:43,528][106226] Updated weights for policy 0, policy_version 1319832 (0.0007) [2023-12-28 04:44:43,585][106226] Updated weights for policy 0, policy_version 1319842 (0.0008) [2023-12-28 04:44:43,628][106225] Updated weights for policy 1, policy_version 1323259 (0.0010) [2023-12-28 04:44:43,646][106226] Updated weights for policy 0, policy_version 1319852 (0.0007) [2023-12-28 04:44:43,691][106225] Updated weights for policy 1, policy_version 1323269 (0.0010) [2023-12-28 04:44:43,752][106225] Updated weights for policy 1, policy_version 1323279 (0.0009) [2023-12-28 04:44:44,400][106226] Updated weights for policy 0, policy_version 1319862 (0.0009) [2023-12-28 04:44:44,421][106225] Updated weights for policy 1, policy_version 1323289 (0.0010) [2023-12-28 04:44:44,446][106226] Updated weights for policy 0, policy_version 1319872 (0.0007) [2023-12-28 04:44:44,481][106225] Updated weights for policy 1, policy_version 1323299 (0.0009) [2023-12-28 04:44:44,496][106226] Updated weights for policy 0, policy_version 1319882 (0.0007) [2023-12-28 04:44:44,542][106225] Updated weights for policy 1, policy_version 1323309 (0.0007) [2023-12-28 04:44:44,604][106225] Updated weights for policy 1, policy_version 1323319 (0.0006) [2023-12-28 04:44:45,228][106226] Updated weights for policy 0, policy_version 1319892 (0.0007) [2023-12-28 04:44:45,267][106225] Updated weights for policy 1, policy_version 1323329 (0.0010) [2023-12-28 04:44:45,285][106226] Updated weights for policy 0, policy_version 1319902 (0.0006) [2023-12-28 04:44:45,326][106225] Updated weights for policy 1, policy_version 1323339 (0.0009) [2023-12-28 04:44:45,339][106226] Updated weights for policy 0, policy_version 1319912 (0.0009) [2023-12-28 04:44:45,384][106225] Updated weights for policy 1, policy_version 1323349 (0.0007) [2023-12-28 04:44:46,001][106226] Updated weights for policy 0, policy_version 1319922 (0.0008) [2023-12-28 04:44:46,058][106226] Updated weights for policy 0, policy_version 1319932 (0.0009) [2023-12-28 04:44:46,110][106226] Updated weights for policy 0, policy_version 1319942 (0.0008) [2023-12-28 04:44:46,152][106225] Updated weights for policy 1, policy_version 1323359 (0.0008) [2023-12-28 04:44:46,170][106226] Updated weights for policy 0, policy_version 1319952 (0.0007) [2023-12-28 04:44:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 676798464. Throughput: 0: 9822.9, 1: 9878.5. Samples: 676786556. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:46,176][105115] Avg episode reward: [(0, '-4.114'), (1, '-4.771')] [2023-12-28 04:44:46,211][106225] Updated weights for policy 1, policy_version 1323369 (0.0007) [2023-12-28 04:44:46,258][106225] Updated weights for policy 1, policy_version 1323379 (0.0007) [2023-12-28 04:44:46,845][106225] Updated weights for policy 1, policy_version 1323389 (0.0006) [2023-12-28 04:44:46,903][106225] Updated weights for policy 1, policy_version 1323399 (0.0005) [2023-12-28 04:44:46,914][106226] Updated weights for policy 0, policy_version 1319962 (0.0005) [2023-12-28 04:44:46,960][106225] Updated weights for policy 1, policy_version 1323409 (0.0006) [2023-12-28 04:44:46,965][106226] Updated weights for policy 0, policy_version 1319972 (0.0005) [2023-12-28 04:44:47,027][106226] Updated weights for policy 0, policy_version 1319982 (0.0005) [2023-12-28 04:44:47,502][106225] Updated weights for policy 1, policy_version 1323419 (0.0006) [2023-12-28 04:44:47,561][106225] Updated weights for policy 1, policy_version 1323429 (0.0006) [2023-12-28 04:44:47,620][106225] Updated weights for policy 1, policy_version 1323439 (0.0006) [2023-12-28 04:44:47,710][106226] Updated weights for policy 0, policy_version 1319992 (0.0005) [2023-12-28 04:44:47,766][106226] Updated weights for policy 0, policy_version 1320002 (0.0005) [2023-12-28 04:44:47,824][106226] Updated weights for policy 0, policy_version 1320012 (0.0005) [2023-12-28 04:44:48,207][106225] Updated weights for policy 1, policy_version 1323449 (0.0007) [2023-12-28 04:44:48,253][106225] Updated weights for policy 1, policy_version 1323459 (0.0007) [2023-12-28 04:44:48,299][106225] Updated weights for policy 1, policy_version 1323469 (0.0007) [2023-12-28 04:44:48,360][106225] Updated weights for policy 1, policy_version 1323479 (0.0008) [2023-12-28 04:44:48,478][106226] Updated weights for policy 0, policy_version 1320022 (0.0007) [2023-12-28 04:44:48,539][106226] Updated weights for policy 0, policy_version 1320032 (0.0006) [2023-12-28 04:44:48,603][106226] Updated weights for policy 0, policy_version 1320042 (0.0011) [2023-12-28 04:44:49,095][106225] Updated weights for policy 1, policy_version 1323489 (0.0007) [2023-12-28 04:44:49,145][106225] Updated weights for policy 1, policy_version 1323499 (0.0008) [2023-12-28 04:44:49,194][106225] Updated weights for policy 1, policy_version 1323509 (0.0008) [2023-12-28 04:44:49,292][106226] Updated weights for policy 0, policy_version 1320052 (0.0010) [2023-12-28 04:44:49,355][106226] Updated weights for policy 0, policy_version 1320062 (0.0007) [2023-12-28 04:44:49,424][106226] Updated weights for policy 0, policy_version 1320072 (0.0009) [2023-12-28 04:44:50,031][106225] Updated weights for policy 1, policy_version 1323519 (0.0007) [2023-12-28 04:44:50,082][106226] Updated weights for policy 0, policy_version 1320082 (0.0010) [2023-12-28 04:44:50,090][106225] Updated weights for policy 1, policy_version 1323529 (0.0006) [2023-12-28 04:44:50,143][106226] Updated weights for policy 0, policy_version 1320092 (0.0008) [2023-12-28 04:44:50,149][106225] Updated weights for policy 1, policy_version 1323539 (0.0007) [2023-12-28 04:44:50,206][106226] Updated weights for policy 0, policy_version 1320102 (0.0008) [2023-12-28 04:44:50,262][106226] Updated weights for policy 0, policy_version 1320112 (0.0008) [2023-12-28 04:44:50,836][106225] Updated weights for policy 1, policy_version 1323549 (0.0007) [2023-12-28 04:44:50,898][106225] Updated weights for policy 1, policy_version 1323559 (0.0008) [2023-12-28 04:44:50,948][106225] Updated weights for policy 1, policy_version 1323569 (0.0008) [2023-12-28 04:44:51,021][106226] Updated weights for policy 0, policy_version 1320122 (0.0011) [2023-12-28 04:44:51,088][106226] Updated weights for policy 0, policy_version 1320132 (0.0011) [2023-12-28 04:44:51,144][106226] Updated weights for policy 0, policy_version 1320142 (0.0010) [2023-12-28 04:44:51,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 676904960. Throughput: 0: 9857.3, 1: 9953.3. Samples: 676908052. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:51,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-5.031')] [2023-12-28 04:44:51,753][106225] Updated weights for policy 1, policy_version 1323579 (0.0007) [2023-12-28 04:44:51,813][106225] Updated weights for policy 1, policy_version 1323589 (0.0006) [2023-12-28 04:44:51,862][106226] Updated weights for policy 0, policy_version 1320152 (0.0010) [2023-12-28 04:44:51,872][106225] Updated weights for policy 1, policy_version 1323599 (0.0007) [2023-12-28 04:44:51,919][106226] Updated weights for policy 0, policy_version 1320162 (0.0010) [2023-12-28 04:44:51,979][106226] Updated weights for policy 0, policy_version 1320172 (0.0010) [2023-12-28 04:44:52,616][106225] Updated weights for policy 1, policy_version 1323609 (0.0008) [2023-12-28 04:44:52,677][106225] Updated weights for policy 1, policy_version 1323619 (0.0006) [2023-12-28 04:44:52,724][106226] Updated weights for policy 0, policy_version 1320182 (0.0008) [2023-12-28 04:44:52,734][106225] Updated weights for policy 1, policy_version 1323629 (0.0009) [2023-12-28 04:44:52,784][106226] Updated weights for policy 0, policy_version 1320192 (0.0006) [2023-12-28 04:44:52,793][106225] Updated weights for policy 1, policy_version 1323639 (0.0006) [2023-12-28 04:44:52,846][106226] Updated weights for policy 0, policy_version 1320202 (0.0008) [2023-12-28 04:44:53,497][106225] Updated weights for policy 1, policy_version 1323649 (0.0008) [2023-12-28 04:44:53,527][106226] Updated weights for policy 0, policy_version 1320212 (0.0009) [2023-12-28 04:44:53,549][106225] Updated weights for policy 1, policy_version 1323659 (0.0006) [2023-12-28 04:44:53,582][106226] Updated weights for policy 0, policy_version 1320222 (0.0008) [2023-12-28 04:44:53,596][106225] Updated weights for policy 1, policy_version 1323669 (0.0006) [2023-12-28 04:44:53,629][106226] Updated weights for policy 0, policy_version 1320232 (0.0007) [2023-12-28 04:44:54,308][106225] Updated weights for policy 1, policy_version 1323679 (0.0009) [2023-12-28 04:44:54,359][106225] Updated weights for policy 1, policy_version 1323689 (0.0008) [2023-12-28 04:44:54,398][106226] Updated weights for policy 0, policy_version 1320242 (0.0009) [2023-12-28 04:44:54,419][106225] Updated weights for policy 1, policy_version 1323699 (0.0008) [2023-12-28 04:44:54,460][106226] Updated weights for policy 0, policy_version 1320252 (0.0008) [2023-12-28 04:44:54,527][106226] Updated weights for policy 0, policy_version 1320262 (0.0008) [2023-12-28 04:44:54,585][106226] Updated weights for policy 0, policy_version 1320272 (0.0008) [2023-12-28 04:44:55,198][106226] Updated weights for policy 0, policy_version 1320282 (0.0007) [2023-12-28 04:44:55,237][106225] Updated weights for policy 1, policy_version 1323709 (0.0008) [2023-12-28 04:44:55,258][106226] Updated weights for policy 0, policy_version 1320292 (0.0007) [2023-12-28 04:44:55,294][106225] Updated weights for policy 1, policy_version 1323719 (0.0007) [2023-12-28 04:44:55,318][106226] Updated weights for policy 0, policy_version 1320302 (0.0010) [2023-12-28 04:44:55,343][106225] Updated weights for policy 1, policy_version 1323729 (0.0007) [2023-12-28 04:44:55,967][106226] Updated weights for policy 0, policy_version 1320312 (0.0006) [2023-12-28 04:44:55,979][106225] Updated weights for policy 1, policy_version 1323739 (0.0006) [2023-12-28 04:44:56,015][106226] Updated weights for policy 0, policy_version 1320322 (0.0005) [2023-12-28 04:44:56,034][106225] Updated weights for policy 1, policy_version 1323749 (0.0005) [2023-12-28 04:44:56,069][106226] Updated weights for policy 0, policy_version 1320332 (0.0008) [2023-12-28 04:44:56,092][106225] Updated weights for policy 1, policy_version 1323759 (0.0006) [2023-12-28 04:44:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 677003264. Throughput: 0: 9858.2, 1: 9931.9. Samples: 676965116. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:44:56,176][105115] Avg episode reward: [(0, '-4.713'), (1, '-5.098')] [2023-12-28 04:44:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001323768_338935808.pth... [2023-12-28 04:44:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001320336_338067456.pth... [2023-12-28 04:44:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001322616_338640896.pth [2023-12-28 04:44:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001319152_337764352.pth [2023-12-28 04:44:56,686][106225] Updated weights for policy 1, policy_version 1323769 (0.0008) [2023-12-28 04:44:56,730][106226] Updated weights for policy 0, policy_version 1320342 (0.0008) [2023-12-28 04:44:56,743][106225] Updated weights for policy 1, policy_version 1323779 (0.0007) [2023-12-28 04:44:56,774][106226] Updated weights for policy 0, policy_version 1320352 (0.0008) [2023-12-28 04:44:56,795][106225] Updated weights for policy 1, policy_version 1323789 (0.0010) [2023-12-28 04:44:56,832][106226] Updated weights for policy 0, policy_version 1320362 (0.0005) [2023-12-28 04:44:56,858][106225] Updated weights for policy 1, policy_version 1323799 (0.0010) [2023-12-28 04:44:57,527][106226] Updated weights for policy 0, policy_version 1320372 (0.0006) [2023-12-28 04:44:57,529][106225] Updated weights for policy 1, policy_version 1323809 (0.0010) [2023-12-28 04:44:57,576][106226] Updated weights for policy 0, policy_version 1320382 (0.0006) [2023-12-28 04:44:57,583][106225] Updated weights for policy 1, policy_version 1323819 (0.0007) [2023-12-28 04:44:57,625][106226] Updated weights for policy 0, policy_version 1320392 (0.0008) [2023-12-28 04:44:57,633][106225] Updated weights for policy 1, policy_version 1323829 (0.0005) [2023-12-28 04:44:58,183][106225] Updated weights for policy 1, policy_version 1323839 (0.0007) [2023-12-28 04:44:58,255][106225] Updated weights for policy 1, policy_version 1323849 (0.0009) [2023-12-28 04:44:58,309][106225] Updated weights for policy 1, policy_version 1323859 (0.0010) [2023-12-28 04:44:58,418][106226] Updated weights for policy 0, policy_version 1320402 (0.0007) [2023-12-28 04:44:58,485][106226] Updated weights for policy 0, policy_version 1320412 (0.0007) [2023-12-28 04:44:58,551][106226] Updated weights for policy 0, policy_version 1320422 (0.0008) [2023-12-28 04:44:58,615][106226] Updated weights for policy 0, policy_version 1320432 (0.0008) [2023-12-28 04:44:59,171][106225] Updated weights for policy 1, policy_version 1323869 (0.0009) [2023-12-28 04:44:59,236][106225] Updated weights for policy 1, policy_version 1323879 (0.0008) [2023-12-28 04:44:59,302][106225] Updated weights for policy 1, policy_version 1323889 (0.0008) [2023-12-28 04:44:59,454][106226] Updated weights for policy 0, policy_version 1320442 (0.0009) [2023-12-28 04:44:59,516][106226] Updated weights for policy 0, policy_version 1320452 (0.0008) [2023-12-28 04:44:59,576][106226] Updated weights for policy 0, policy_version 1320462 (0.0008) [2023-12-28 04:44:59,998][106225] Updated weights for policy 1, policy_version 1323899 (0.0009) [2023-12-28 04:45:00,056][106225] Updated weights for policy 1, policy_version 1323909 (0.0008) [2023-12-28 04:45:00,118][106225] Updated weights for policy 1, policy_version 1323919 (0.0008) [2023-12-28 04:45:00,344][106226] Updated weights for policy 0, policy_version 1320472 (0.0008) [2023-12-28 04:45:00,396][106226] Updated weights for policy 0, policy_version 1320482 (0.0009) [2023-12-28 04:45:00,454][106226] Updated weights for policy 0, policy_version 1320492 (0.0006) [2023-12-28 04:45:00,921][106225] Updated weights for policy 1, policy_version 1323929 (0.0008) [2023-12-28 04:45:00,978][106225] Updated weights for policy 1, policy_version 1323939 (0.0008) [2023-12-28 04:45:01,007][106226] Updated weights for policy 0, policy_version 1320502 (0.0007) [2023-12-28 04:45:01,028][106225] Updated weights for policy 1, policy_version 1323949 (0.0006) [2023-12-28 04:45:01,072][106226] Updated weights for policy 0, policy_version 1320512 (0.0006) [2023-12-28 04:45:01,094][106225] Updated weights for policy 1, policy_version 1323959 (0.0008) [2023-12-28 04:45:01,145][106226] Updated weights for policy 0, policy_version 1320522 (0.0007) [2023-12-28 04:45:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 677093376. Throughput: 0: 9872.8, 1: 9953.9. Samples: 677083240. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:01,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.791')] [2023-12-28 04:45:01,792][106226] Updated weights for policy 0, policy_version 1320532 (0.0008) [2023-12-28 04:45:01,842][106226] Updated weights for policy 0, policy_version 1320542 (0.0008) [2023-12-28 04:45:01,892][106226] Updated weights for policy 0, policy_version 1320552 (0.0008) [2023-12-28 04:45:01,931][106225] Updated weights for policy 1, policy_version 1323969 (0.0006) [2023-12-28 04:45:01,978][106225] Updated weights for policy 1, policy_version 1323979 (0.0007) [2023-12-28 04:45:02,028][106225] Updated weights for policy 1, policy_version 1323989 (0.0008) [2023-12-28 04:45:02,612][106226] Updated weights for policy 0, policy_version 1320562 (0.0008) [2023-12-28 04:45:02,661][106226] Updated weights for policy 0, policy_version 1320572 (0.0008) [2023-12-28 04:45:02,723][106226] Updated weights for policy 0, policy_version 1320582 (0.0009) [2023-12-28 04:45:02,787][106225] Updated weights for policy 1, policy_version 1323999 (0.0008) [2023-12-28 04:45:02,793][106226] Updated weights for policy 0, policy_version 1320592 (0.0007) [2023-12-28 04:45:02,842][106225] Updated weights for policy 1, policy_version 1324009 (0.0008) [2023-12-28 04:45:02,897][106225] Updated weights for policy 1, policy_version 1324019 (0.0008) [2023-12-28 04:45:03,494][106225] Updated weights for policy 1, policy_version 1324029 (0.0007) [2023-12-28 04:45:03,546][106225] Updated weights for policy 1, policy_version 1324039 (0.0005) [2023-12-28 04:45:03,550][106226] Updated weights for policy 0, policy_version 1320602 (0.0008) [2023-12-28 04:45:03,596][106226] Updated weights for policy 0, policy_version 1320612 (0.0008) [2023-12-28 04:45:03,597][106225] Updated weights for policy 1, policy_version 1324049 (0.0005) [2023-12-28 04:45:03,659][106226] Updated weights for policy 0, policy_version 1320622 (0.0008) [2023-12-28 04:45:04,281][106225] Updated weights for policy 1, policy_version 1324059 (0.0009) [2023-12-28 04:45:04,343][106225] Updated weights for policy 1, policy_version 1324069 (0.0011) [2023-12-28 04:45:04,405][106225] Updated weights for policy 1, policy_version 1324079 (0.0010) [2023-12-28 04:45:04,406][106226] Updated weights for policy 0, policy_version 1320632 (0.0008) [2023-12-28 04:45:04,464][106226] Updated weights for policy 0, policy_version 1320642 (0.0006) [2023-12-28 04:45:04,512][106226] Updated weights for policy 0, policy_version 1320652 (0.0008) [2023-12-28 04:45:05,131][106225] Updated weights for policy 1, policy_version 1324089 (0.0010) [2023-12-28 04:45:05,181][106225] Updated weights for policy 1, policy_version 1324099 (0.0010) [2023-12-28 04:45:05,231][106225] Updated weights for policy 1, policy_version 1324109 (0.0010) [2023-12-28 04:45:05,248][106226] Updated weights for policy 0, policy_version 1320662 (0.0008) [2023-12-28 04:45:05,278][106225] Updated weights for policy 1, policy_version 1324119 (0.0010) [2023-12-28 04:45:05,299][106226] Updated weights for policy 0, policy_version 1320672 (0.0007) [2023-12-28 04:45:05,345][106226] Updated weights for policy 0, policy_version 1320682 (0.0007) [2023-12-28 04:45:05,985][106225] Updated weights for policy 1, policy_version 1324129 (0.0009) [2023-12-28 04:45:06,038][106226] Updated weights for policy 0, policy_version 1320692 (0.0007) [2023-12-28 04:45:06,045][106225] Updated weights for policy 1, policy_version 1324139 (0.0010) [2023-12-28 04:45:06,092][106226] Updated weights for policy 0, policy_version 1320702 (0.0006) [2023-12-28 04:45:06,109][106225] Updated weights for policy 1, policy_version 1324149 (0.0009) [2023-12-28 04:45:06,159][106226] Updated weights for policy 0, policy_version 1320712 (0.0007) [2023-12-28 04:45:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 677191680. Throughput: 0: 9878.4, 1: 9913.9. Samples: 677201108. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:06,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.968')] [2023-12-28 04:45:06,821][106226] Updated weights for policy 0, policy_version 1320722 (0.0007) [2023-12-28 04:45:06,837][106225] Updated weights for policy 1, policy_version 1324159 (0.0010) [2023-12-28 04:45:06,888][106226] Updated weights for policy 0, policy_version 1320732 (0.0006) [2023-12-28 04:45:06,897][106225] Updated weights for policy 1, policy_version 1324169 (0.0011) [2023-12-28 04:45:06,947][106226] Updated weights for policy 0, policy_version 1320742 (0.0006) [2023-12-28 04:45:06,958][106225] Updated weights for policy 1, policy_version 1324179 (0.0010) [2023-12-28 04:45:07,002][106226] Updated weights for policy 0, policy_version 1320752 (0.0005) [2023-12-28 04:45:07,640][106225] Updated weights for policy 1, policy_version 1324189 (0.0010) [2023-12-28 04:45:07,670][106226] Updated weights for policy 0, policy_version 1320762 (0.0006) [2023-12-28 04:45:07,697][106225] Updated weights for policy 1, policy_version 1324199 (0.0010) [2023-12-28 04:45:07,726][106226] Updated weights for policy 0, policy_version 1320772 (0.0005) [2023-12-28 04:45:07,750][106225] Updated weights for policy 1, policy_version 1324209 (0.0010) [2023-12-28 04:45:07,787][106226] Updated weights for policy 0, policy_version 1320782 (0.0006) [2023-12-28 04:45:08,412][106226] Updated weights for policy 0, policy_version 1320792 (0.0008) [2023-12-28 04:45:08,470][106226] Updated weights for policy 0, policy_version 1320802 (0.0008) [2023-12-28 04:45:08,480][106225] Updated weights for policy 1, policy_version 1324219 (0.0010) [2023-12-28 04:45:08,522][106226] Updated weights for policy 0, policy_version 1320812 (0.0008) [2023-12-28 04:45:08,536][106225] Updated weights for policy 1, policy_version 1324229 (0.0006) [2023-12-28 04:45:08,589][106225] Updated weights for policy 1, policy_version 1324239 (0.0007) [2023-12-28 04:45:09,292][106226] Updated weights for policy 0, policy_version 1320822 (0.0008) [2023-12-28 04:45:09,349][106225] Updated weights for policy 1, policy_version 1324249 (0.0007) [2023-12-28 04:45:09,351][106226] Updated weights for policy 0, policy_version 1320832 (0.0007) [2023-12-28 04:45:09,424][106225] Updated weights for policy 1, policy_version 1324259 (0.0008) [2023-12-28 04:45:09,424][106226] Updated weights for policy 0, policy_version 1320842 (0.0008) [2023-12-28 04:45:09,486][106225] Updated weights for policy 1, policy_version 1324269 (0.0008) [2023-12-28 04:45:09,550][106225] Updated weights for policy 1, policy_version 1324279 (0.0009) [2023-12-28 04:45:10,221][106226] Updated weights for policy 0, policy_version 1320852 (0.0010) [2023-12-28 04:45:10,254][106225] Updated weights for policy 1, policy_version 1324289 (0.0008) [2023-12-28 04:45:10,286][106226] Updated weights for policy 0, policy_version 1320862 (0.0011) [2023-12-28 04:45:10,313][106225] Updated weights for policy 1, policy_version 1324299 (0.0008) [2023-12-28 04:45:10,350][106226] Updated weights for policy 0, policy_version 1320872 (0.0011) [2023-12-28 04:45:10,369][106225] Updated weights for policy 1, policy_version 1324309 (0.0008) [2023-12-28 04:45:11,065][106225] Updated weights for policy 1, policy_version 1324319 (0.0008) [2023-12-28 04:45:11,080][106226] Updated weights for policy 0, policy_version 1320882 (0.0010) [2023-12-28 04:45:11,118][106225] Updated weights for policy 1, policy_version 1324329 (0.0006) [2023-12-28 04:45:11,131][106226] Updated weights for policy 0, policy_version 1320892 (0.0010) [2023-12-28 04:45:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 677281792. Throughput: 0: 9932.5, 1: 9888.0. Samples: 677260596. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:11,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-5.130')] [2023-12-28 04:45:11,189][106225] Updated weights for policy 1, policy_version 1324339 (0.0008) [2023-12-28 04:45:11,199][106226] Updated weights for policy 0, policy_version 1320902 (0.0009) [2023-12-28 04:45:11,212][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001324344_339083264.pth... [2023-12-28 04:45:11,216][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001323192_338788352.pth [2023-12-28 04:45:11,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001320912_338214912.pth... [2023-12-28 04:45:11,273][106226] Updated weights for policy 0, policy_version 1320912 (0.0007) [2023-12-28 04:45:11,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001319760_337920000.pth [2023-12-28 04:45:11,987][106225] Updated weights for policy 1, policy_version 1324349 (0.0008) [2023-12-28 04:45:12,041][106226] Updated weights for policy 0, policy_version 1320922 (0.0008) [2023-12-28 04:45:12,055][106225] Updated weights for policy 1, policy_version 1324359 (0.0007) [2023-12-28 04:45:12,104][106226] Updated weights for policy 0, policy_version 1320932 (0.0009) [2023-12-28 04:45:12,120][106225] Updated weights for policy 1, policy_version 1324369 (0.0006) [2023-12-28 04:45:12,169][106226] Updated weights for policy 0, policy_version 1320942 (0.0008) [2023-12-28 04:45:12,803][106225] Updated weights for policy 1, policy_version 1324379 (0.0007) [2023-12-28 04:45:12,857][106226] Updated weights for policy 0, policy_version 1320952 (0.0007) [2023-12-28 04:45:12,863][106225] Updated weights for policy 1, policy_version 1324389 (0.0009) [2023-12-28 04:45:12,906][106226] Updated weights for policy 0, policy_version 1320962 (0.0006) [2023-12-28 04:45:12,924][106225] Updated weights for policy 1, policy_version 1324399 (0.0008) [2023-12-28 04:45:12,954][106226] Updated weights for policy 0, policy_version 1320972 (0.0008) [2023-12-28 04:45:13,582][106226] Updated weights for policy 0, policy_version 1320982 (0.0009) [2023-12-28 04:45:13,635][106226] Updated weights for policy 0, policy_version 1320992 (0.0010) [2023-12-28 04:45:13,680][106225] Updated weights for policy 1, policy_version 1324409 (0.0009) [2023-12-28 04:45:13,691][106226] Updated weights for policy 0, policy_version 1321002 (0.0010) [2023-12-28 04:45:13,733][106225] Updated weights for policy 1, policy_version 1324419 (0.0005) [2023-12-28 04:45:13,793][106225] Updated weights for policy 1, policy_version 1324429 (0.0005) [2023-12-28 04:45:13,843][106225] Updated weights for policy 1, policy_version 1324439 (0.0005) [2023-12-28 04:45:14,457][106226] Updated weights for policy 0, policy_version 1321012 (0.0008) [2023-12-28 04:45:14,504][106225] Updated weights for policy 1, policy_version 1324449 (0.0006) [2023-12-28 04:45:14,510][106226] Updated weights for policy 0, policy_version 1321022 (0.0006) [2023-12-28 04:45:14,558][106225] Updated weights for policy 1, policy_version 1324459 (0.0006) [2023-12-28 04:45:14,570][106226] Updated weights for policy 0, policy_version 1321032 (0.0009) [2023-12-28 04:45:14,610][106225] Updated weights for policy 1, policy_version 1324469 (0.0006) [2023-12-28 04:45:15,334][106226] Updated weights for policy 0, policy_version 1321042 (0.0008) [2023-12-28 04:45:15,359][106225] Updated weights for policy 1, policy_version 1324479 (0.0008) [2023-12-28 04:45:15,400][106226] Updated weights for policy 0, policy_version 1321052 (0.0008) [2023-12-28 04:45:15,420][106225] Updated weights for policy 1, policy_version 1324489 (0.0007) [2023-12-28 04:45:15,458][106226] Updated weights for policy 0, policy_version 1321062 (0.0006) [2023-12-28 04:45:15,476][106225] Updated weights for policy 1, policy_version 1324499 (0.0006) [2023-12-28 04:45:15,516][106226] Updated weights for policy 0, policy_version 1321072 (0.0008) [2023-12-28 04:45:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 677380096. Throughput: 0: 9849.6, 1: 9815.2. Samples: 677374648. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:16,175][105115] Avg episode reward: [(0, '-4.390'), (1, '-4.499')] [2023-12-28 04:45:16,187][106225] Updated weights for policy 1, policy_version 1324509 (0.0008) [2023-12-28 04:45:16,240][106226] Updated weights for policy 0, policy_version 1321082 (0.0009) [2023-12-28 04:45:16,247][106225] Updated weights for policy 1, policy_version 1324519 (0.0009) [2023-12-28 04:45:16,295][106226] Updated weights for policy 0, policy_version 1321092 (0.0007) [2023-12-28 04:45:16,305][106225] Updated weights for policy 1, policy_version 1324529 (0.0007) [2023-12-28 04:45:16,361][106226] Updated weights for policy 0, policy_version 1321102 (0.0009) [2023-12-28 04:45:16,998][106226] Updated weights for policy 0, policy_version 1321112 (0.0009) [2023-12-28 04:45:17,059][106226] Updated weights for policy 0, policy_version 1321122 (0.0008) [2023-12-28 04:45:17,074][106225] Updated weights for policy 1, policy_version 1324539 (0.0008) [2023-12-28 04:45:17,111][106226] Updated weights for policy 0, policy_version 1321132 (0.0008) [2023-12-28 04:45:17,133][106225] Updated weights for policy 1, policy_version 1324549 (0.0006) [2023-12-28 04:45:17,194][106225] Updated weights for policy 1, policy_version 1324559 (0.0005) [2023-12-28 04:45:17,837][106226] Updated weights for policy 0, policy_version 1321142 (0.0010) [2023-12-28 04:45:17,890][106225] Updated weights for policy 1, policy_version 1324569 (0.0006) [2023-12-28 04:45:17,900][106226] Updated weights for policy 0, policy_version 1321152 (0.0011) [2023-12-28 04:45:17,947][106225] Updated weights for policy 1, policy_version 1324579 (0.0006) [2023-12-28 04:45:17,957][106226] Updated weights for policy 0, policy_version 1321162 (0.0010) [2023-12-28 04:45:17,994][106225] Updated weights for policy 1, policy_version 1324589 (0.0005) [2023-12-28 04:45:18,049][106225] Updated weights for policy 1, policy_version 1324599 (0.0008) [2023-12-28 04:45:18,645][106226] Updated weights for policy 0, policy_version 1321172 (0.0010) [2023-12-28 04:45:18,715][106226] Updated weights for policy 0, policy_version 1321182 (0.0009) [2023-12-28 04:45:18,773][106225] Updated weights for policy 1, policy_version 1324609 (0.0006) [2023-12-28 04:45:18,782][106226] Updated weights for policy 0, policy_version 1321192 (0.0011) [2023-12-28 04:45:18,835][106225] Updated weights for policy 1, policy_version 1324619 (0.0008) [2023-12-28 04:45:18,894][106225] Updated weights for policy 1, policy_version 1324629 (0.0008) [2023-12-28 04:45:19,525][106226] Updated weights for policy 0, policy_version 1321202 (0.0011) [2023-12-28 04:45:19,592][106226] Updated weights for policy 0, policy_version 1321212 (0.0006) [2023-12-28 04:45:19,647][106226] Updated weights for policy 0, policy_version 1321222 (0.0008) [2023-12-28 04:45:19,698][106226] Updated weights for policy 0, policy_version 1321232 (0.0007) [2023-12-28 04:45:19,699][106225] Updated weights for policy 1, policy_version 1324639 (0.0006) [2023-12-28 04:45:19,758][106225] Updated weights for policy 1, policy_version 1324649 (0.0008) [2023-12-28 04:45:19,820][106225] Updated weights for policy 1, policy_version 1324659 (0.0009) [2023-12-28 04:45:20,337][106226] Updated weights for policy 0, policy_version 1321242 (0.0008) [2023-12-28 04:45:20,405][106226] Updated weights for policy 0, policy_version 1321252 (0.0010) [2023-12-28 04:45:20,455][106226] Updated weights for policy 0, policy_version 1321262 (0.0009) [2023-12-28 04:45:20,595][106225] Updated weights for policy 1, policy_version 1324669 (0.0009) [2023-12-28 04:45:20,659][106225] Updated weights for policy 1, policy_version 1324679 (0.0007) [2023-12-28 04:45:20,716][106225] Updated weights for policy 1, policy_version 1324689 (0.0007) [2023-12-28 04:45:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 677478400. Throughput: 0: 9762.8, 1: 9748.1. Samples: 677489452. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:21,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.856')] [2023-12-28 04:45:21,243][106226] Updated weights for policy 0, policy_version 1321272 (0.0009) [2023-12-28 04:45:21,304][106226] Updated weights for policy 0, policy_version 1321282 (0.0009) [2023-12-28 04:45:21,372][106226] Updated weights for policy 0, policy_version 1321292 (0.0009) [2023-12-28 04:45:21,456][106225] Updated weights for policy 1, policy_version 1324699 (0.0008) [2023-12-28 04:45:21,520][106225] Updated weights for policy 1, policy_version 1324709 (0.0008) [2023-12-28 04:45:21,583][106225] Updated weights for policy 1, policy_version 1324719 (0.0005) [2023-12-28 04:45:22,160][106226] Updated weights for policy 0, policy_version 1321302 (0.0015) [2023-12-28 04:45:22,224][106226] Updated weights for policy 0, policy_version 1321312 (0.0011) [2023-12-28 04:45:22,249][106225] Updated weights for policy 1, policy_version 1324729 (0.0007) [2023-12-28 04:45:22,287][106226] Updated weights for policy 0, policy_version 1321322 (0.0011) [2023-12-28 04:45:22,308][106225] Updated weights for policy 1, policy_version 1324739 (0.0008) [2023-12-28 04:45:22,379][106225] Updated weights for policy 1, policy_version 1324749 (0.0008) [2023-12-28 04:45:22,438][106225] Updated weights for policy 1, policy_version 1324759 (0.0008) [2023-12-28 04:45:23,020][106226] Updated weights for policy 0, policy_version 1321332 (0.0010) [2023-12-28 04:45:23,080][106226] Updated weights for policy 0, policy_version 1321342 (0.0010) [2023-12-28 04:45:23,127][106226] Updated weights for policy 0, policy_version 1321352 (0.0010) [2023-12-28 04:45:23,209][106225] Updated weights for policy 1, policy_version 1324769 (0.0008) [2023-12-28 04:45:23,260][106225] Updated weights for policy 1, policy_version 1324779 (0.0009) [2023-12-28 04:45:23,310][106225] Updated weights for policy 1, policy_version 1324789 (0.0008) [2023-12-28 04:45:23,766][106226] Updated weights for policy 0, policy_version 1321362 (0.0010) [2023-12-28 04:45:23,822][106226] Updated weights for policy 0, policy_version 1321372 (0.0010) [2023-12-28 04:45:23,878][106226] Updated weights for policy 0, policy_version 1321382 (0.0010) [2023-12-28 04:45:23,928][106226] Updated weights for policy 0, policy_version 1321392 (0.0010) [2023-12-28 04:45:24,088][106225] Updated weights for policy 1, policy_version 1324799 (0.0008) [2023-12-28 04:45:24,152][106225] Updated weights for policy 1, policy_version 1324809 (0.0008) [2023-12-28 04:45:24,210][106225] Updated weights for policy 1, policy_version 1324819 (0.0008) [2023-12-28 04:45:24,660][106226] Updated weights for policy 0, policy_version 1321402 (0.0011) [2023-12-28 04:45:24,735][106226] Updated weights for policy 0, policy_version 1321412 (0.0010) [2023-12-28 04:45:24,803][106226] Updated weights for policy 0, policy_version 1321422 (0.0011) [2023-12-28 04:45:24,916][106225] Updated weights for policy 1, policy_version 1324829 (0.0008) [2023-12-28 04:45:24,977][106225] Updated weights for policy 1, policy_version 1324839 (0.0008) [2023-12-28 04:45:25,034][106225] Updated weights for policy 1, policy_version 1324849 (0.0009) [2023-12-28 04:45:25,534][106226] Updated weights for policy 0, policy_version 1321432 (0.0007) [2023-12-28 04:45:25,587][106226] Updated weights for policy 0, policy_version 1321442 (0.0009) [2023-12-28 04:45:25,636][106226] Updated weights for policy 0, policy_version 1321452 (0.0009) [2023-12-28 04:45:25,688][106225] Updated weights for policy 1, policy_version 1324859 (0.0008) [2023-12-28 04:45:25,752][106225] Updated weights for policy 1, policy_version 1324869 (0.0005) [2023-12-28 04:45:25,802][106225] Updated weights for policy 1, policy_version 1324879 (0.0005) [2023-12-28 04:45:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 677576704. Throughput: 0: 9750.3, 1: 9713.1. Samples: 677546764. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:26,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.727')] [2023-12-28 04:45:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001321456_338354176.pth... [2023-12-28 04:45:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001324888_339222528.pth... [2023-12-28 04:45:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001320336_338067456.pth [2023-12-28 04:45:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001323768_338935808.pth [2023-12-28 04:45:26,300][106226] Updated weights for policy 0, policy_version 1321462 (0.0007) [2023-12-28 04:45:26,354][106226] Updated weights for policy 0, policy_version 1321472 (0.0008) [2023-12-28 04:45:26,414][106226] Updated weights for policy 0, policy_version 1321482 (0.0008) [2023-12-28 04:45:26,431][106225] Updated weights for policy 1, policy_version 1324889 (0.0005) [2023-12-28 04:45:26,488][106225] Updated weights for policy 1, policy_version 1324899 (0.0005) [2023-12-28 04:45:26,547][106225] Updated weights for policy 1, policy_version 1324909 (0.0006) [2023-12-28 04:45:26,609][106225] Updated weights for policy 1, policy_version 1324919 (0.0005) [2023-12-28 04:45:27,150][106225] Updated weights for policy 1, policy_version 1324929 (0.0005) [2023-12-28 04:45:27,174][106226] Updated weights for policy 0, policy_version 1321492 (0.0009) [2023-12-28 04:45:27,204][106225] Updated weights for policy 1, policy_version 1324939 (0.0005) [2023-12-28 04:45:27,226][106226] Updated weights for policy 0, policy_version 1321502 (0.0008) [2023-12-28 04:45:27,259][106225] Updated weights for policy 1, policy_version 1324949 (0.0008) [2023-12-28 04:45:27,272][106226] Updated weights for policy 0, policy_version 1321512 (0.0007) [2023-12-28 04:45:27,852][106226] Updated weights for policy 0, policy_version 1321522 (0.0007) [2023-12-28 04:45:27,888][106225] Updated weights for policy 1, policy_version 1324959 (0.0009) [2023-12-28 04:45:27,905][106226] Updated weights for policy 0, policy_version 1321532 (0.0005) [2023-12-28 04:45:27,942][106225] Updated weights for policy 1, policy_version 1324969 (0.0006) [2023-12-28 04:45:27,972][106226] Updated weights for policy 0, policy_version 1321542 (0.0005) [2023-12-28 04:45:28,004][106225] Updated weights for policy 1, policy_version 1324979 (0.0008) [2023-12-28 04:45:28,035][106226] Updated weights for policy 0, policy_version 1321552 (0.0005) [2023-12-28 04:45:28,582][106226] Updated weights for policy 0, policy_version 1321562 (0.0007) [2023-12-28 04:45:28,639][106226] Updated weights for policy 0, policy_version 1321572 (0.0006) [2023-12-28 04:45:28,696][106226] Updated weights for policy 0, policy_version 1321582 (0.0008) [2023-12-28 04:45:28,776][106225] Updated weights for policy 1, policy_version 1324989 (0.0009) [2023-12-28 04:45:28,834][106225] Updated weights for policy 1, policy_version 1324999 (0.0009) [2023-12-28 04:45:28,886][106225] Updated weights for policy 1, policy_version 1325010 (0.0011) [2023-12-28 04:45:29,290][106226] Updated weights for policy 0, policy_version 1321592 (0.0007) [2023-12-28 04:45:29,362][106226] Updated weights for policy 0, policy_version 1321602 (0.0008) [2023-12-28 04:45:29,417][106226] Updated weights for policy 0, policy_version 1321612 (0.0008) [2023-12-28 04:45:29,710][106225] Updated weights for policy 1, policy_version 1325020 (0.0009) [2023-12-28 04:45:29,768][106225] Updated weights for policy 1, policy_version 1325030 (0.0008) [2023-12-28 04:45:29,832][106225] Updated weights for policy 1, policy_version 1325040 (0.0009) [2023-12-28 04:45:30,194][106226] Updated weights for policy 0, policy_version 1321622 (0.0009) [2023-12-28 04:45:30,256][106226] Updated weights for policy 0, policy_version 1321632 (0.0008) [2023-12-28 04:45:30,317][106226] Updated weights for policy 0, policy_version 1321642 (0.0009) [2023-12-28 04:45:30,542][106225] Updated weights for policy 1, policy_version 1325050 (0.0008) [2023-12-28 04:45:30,603][106225] Updated weights for policy 1, policy_version 1325060 (0.0008) [2023-12-28 04:45:30,652][106225] Updated weights for policy 1, policy_version 1325070 (0.0005) [2023-12-28 04:45:30,697][106225] Updated weights for policy 1, policy_version 1325080 (0.0006) [2023-12-28 04:45:31,053][106226] Updated weights for policy 0, policy_version 1321652 (0.0008) [2023-12-28 04:45:31,116][106226] Updated weights for policy 0, policy_version 1321662 (0.0010) [2023-12-28 04:45:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 677675008. Throughput: 0: 9832.5, 1: 9782.2. Samples: 677669212. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-28 04:45:31,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.913')] [2023-12-28 04:45:31,180][106226] Updated weights for policy 0, policy_version 1321672 (0.0008) [2023-12-28 04:45:31,356][106225] Updated weights for policy 1, policy_version 1325090 (0.0008) [2023-12-28 04:45:31,422][106225] Updated weights for policy 1, policy_version 1325100 (0.0010) [2023-12-28 04:45:31,486][106225] Updated weights for policy 1, policy_version 1325110 (0.0010) [2023-12-28 04:45:31,895][106226] Updated weights for policy 0, policy_version 1321682 (0.0008) [2023-12-28 04:45:31,952][106226] Updated weights for policy 0, policy_version 1321692 (0.0005) [2023-12-28 04:45:32,006][106226] Updated weights for policy 0, policy_version 1321702 (0.0005) [2023-12-28 04:45:32,088][106226] Updated weights for policy 0, policy_version 1321712 (0.0006) [2023-12-28 04:45:32,316][106225] Updated weights for policy 1, policy_version 1325120 (0.0008) [2023-12-28 04:45:32,384][106225] Updated weights for policy 1, policy_version 1325130 (0.0009) [2023-12-28 04:45:32,446][106225] Updated weights for policy 1, policy_version 1325140 (0.0008) [2023-12-28 04:45:32,729][106226] Updated weights for policy 0, policy_version 1321722 (0.0008) [2023-12-28 04:45:32,790][106226] Updated weights for policy 0, policy_version 1321732 (0.0008) [2023-12-28 04:45:32,853][106226] Updated weights for policy 0, policy_version 1321742 (0.0008) [2023-12-28 04:45:33,133][106225] Updated weights for policy 1, policy_version 1325150 (0.0007) [2023-12-28 04:45:33,195][106225] Updated weights for policy 1, policy_version 1325160 (0.0005) [2023-12-28 04:45:33,242][106225] Updated weights for policy 1, policy_version 1325170 (0.0005) [2023-12-28 04:45:33,556][106226] Updated weights for policy 0, policy_version 1321752 (0.0006) [2023-12-28 04:45:33,612][106226] Updated weights for policy 0, policy_version 1321762 (0.0008) [2023-12-28 04:45:33,677][106226] Updated weights for policy 0, policy_version 1321772 (0.0008) [2023-12-28 04:45:33,886][106225] Updated weights for policy 1, policy_version 1325180 (0.0006) [2023-12-28 04:45:33,939][106225] Updated weights for policy 1, policy_version 1325190 (0.0008) [2023-12-28 04:45:33,993][106225] Updated weights for policy 1, policy_version 1325200 (0.0008) [2023-12-28 04:45:34,377][106226] Updated weights for policy 0, policy_version 1321782 (0.0008) [2023-12-28 04:45:34,439][106226] Updated weights for policy 0, policy_version 1321792 (0.0009) [2023-12-28 04:45:34,496][106226] Updated weights for policy 0, policy_version 1321802 (0.0009) [2023-12-28 04:45:34,739][106225] Updated weights for policy 1, policy_version 1325210 (0.0008) [2023-12-28 04:45:34,804][106225] Updated weights for policy 1, policy_version 1325220 (0.0008) [2023-12-28 04:45:34,861][106225] Updated weights for policy 1, policy_version 1325230 (0.0009) [2023-12-28 04:45:34,923][106225] Updated weights for policy 1, policy_version 1325240 (0.0008) [2023-12-28 04:45:35,213][106226] Updated weights for policy 0, policy_version 1321812 (0.0008) [2023-12-28 04:45:35,266][106226] Updated weights for policy 0, policy_version 1321822 (0.0008) [2023-12-28 04:45:35,311][106226] Updated weights for policy 0, policy_version 1321832 (0.0008) [2023-12-28 04:45:35,515][106225] Updated weights for policy 1, policy_version 1325250 (0.0009) [2023-12-28 04:45:35,569][106225] Updated weights for policy 1, policy_version 1325260 (0.0008) [2023-12-28 04:45:35,620][106225] Updated weights for policy 1, policy_version 1325270 (0.0008) [2023-12-28 04:45:36,083][106226] Updated weights for policy 0, policy_version 1321842 (0.0008) [2023-12-28 04:45:36,148][106226] Updated weights for policy 0, policy_version 1321852 (0.0009) [2023-12-28 04:45:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 677773312. Throughput: 0: 9798.2, 1: 9723.9. Samples: 677786548. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:45:36,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.729')] [2023-12-28 04:45:36,216][106226] Updated weights for policy 0, policy_version 1321862 (0.0009) [2023-12-28 04:45:36,279][106226] Updated weights for policy 0, policy_version 1321872 (0.0008) [2023-12-28 04:45:36,330][106225] Updated weights for policy 1, policy_version 1325280 (0.0008) [2023-12-28 04:45:36,376][106225] Updated weights for policy 1, policy_version 1325290 (0.0009) [2023-12-28 04:45:36,428][106225] Updated weights for policy 1, policy_version 1325300 (0.0009) [2023-12-28 04:45:37,074][106226] Updated weights for policy 0, policy_version 1321882 (0.0009) [2023-12-28 04:45:37,087][106225] Updated weights for policy 1, policy_version 1325310 (0.0007) [2023-12-28 04:45:37,136][106225] Updated weights for policy 1, policy_version 1325320 (0.0005) [2023-12-28 04:45:37,138][106226] Updated weights for policy 0, policy_version 1321892 (0.0007) [2023-12-28 04:45:37,189][106225] Updated weights for policy 1, policy_version 1325330 (0.0005) [2023-12-28 04:45:37,195][106226] Updated weights for policy 0, policy_version 1321902 (0.0008) [2023-12-28 04:45:37,792][106225] Updated weights for policy 1, policy_version 1325340 (0.0005) [2023-12-28 04:45:37,853][106225] Updated weights for policy 1, policy_version 1325350 (0.0006) [2023-12-28 04:45:37,902][106225] Updated weights for policy 1, policy_version 1325360 (0.0005) [2023-12-28 04:45:37,983][106226] Updated weights for policy 0, policy_version 1321912 (0.0010) [2023-12-28 04:45:38,033][106226] Updated weights for policy 0, policy_version 1321922 (0.0007) [2023-12-28 04:45:38,082][106226] Updated weights for policy 0, policy_version 1321932 (0.0005) [2023-12-28 04:45:38,492][106225] Updated weights for policy 1, policy_version 1325370 (0.0005) [2023-12-28 04:45:38,552][106225] Updated weights for policy 1, policy_version 1325380 (0.0006) [2023-12-28 04:45:38,612][106225] Updated weights for policy 1, policy_version 1325390 (0.0005) [2023-12-28 04:45:38,680][106225] Updated weights for policy 1, policy_version 1325400 (0.0005) [2023-12-28 04:45:38,839][106226] Updated weights for policy 0, policy_version 1321942 (0.0010) [2023-12-28 04:45:38,900][106226] Updated weights for policy 0, policy_version 1321952 (0.0009) [2023-12-28 04:45:38,967][106226] Updated weights for policy 0, policy_version 1321962 (0.0005) [2023-12-28 04:45:39,391][106225] Updated weights for policy 1, policy_version 1325410 (0.0008) [2023-12-28 04:45:39,456][106225] Updated weights for policy 1, policy_version 1325420 (0.0007) [2023-12-28 04:45:39,511][106225] Updated weights for policy 1, policy_version 1325430 (0.0008) [2023-12-28 04:45:39,605][106226] Updated weights for policy 0, policy_version 1321972 (0.0006) [2023-12-28 04:45:39,661][106226] Updated weights for policy 0, policy_version 1321982 (0.0009) [2023-12-28 04:45:39,724][106226] Updated weights for policy 0, policy_version 1321992 (0.0008) [2023-12-28 04:45:40,246][106225] Updated weights for policy 1, policy_version 1325440 (0.0006) [2023-12-28 04:45:40,303][106225] Updated weights for policy 1, policy_version 1325450 (0.0005) [2023-12-28 04:45:40,368][106225] Updated weights for policy 1, policy_version 1325460 (0.0006) [2023-12-28 04:45:40,460][106226] Updated weights for policy 0, policy_version 1322002 (0.0008) [2023-12-28 04:45:40,528][106226] Updated weights for policy 0, policy_version 1322012 (0.0009) [2023-12-28 04:45:40,596][106226] Updated weights for policy 0, policy_version 1322022 (0.0008) [2023-12-28 04:45:40,651][106226] Updated weights for policy 0, policy_version 1322032 (0.0008) [2023-12-28 04:45:40,956][106225] Updated weights for policy 1, policy_version 1325470 (0.0005) [2023-12-28 04:45:41,018][106225] Updated weights for policy 1, policy_version 1325480 (0.0006) [2023-12-28 04:45:41,091][106225] Updated weights for policy 1, policy_version 1325490 (0.0008) [2023-12-28 04:45:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 677879808. Throughput: 0: 9775.3, 1: 9827.9. Samples: 677847256. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:45:41,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.890')] [2023-12-28 04:45:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001325496_339378176.pth... [2023-12-28 04:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001322032_338501632.pth... [2023-12-28 04:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001324344_339083264.pth [2023-12-28 04:45:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001320912_338214912.pth [2023-12-28 04:45:41,431][106226] Updated weights for policy 0, policy_version 1322042 (0.0008) [2023-12-28 04:45:41,483][106226] Updated weights for policy 0, policy_version 1322052 (0.0006) [2023-12-28 04:45:41,547][106226] Updated weights for policy 0, policy_version 1322062 (0.0006) [2023-12-28 04:45:41,898][106225] Updated weights for policy 1, policy_version 1325500 (0.0007) [2023-12-28 04:45:41,965][106225] Updated weights for policy 1, policy_version 1325510 (0.0009) [2023-12-28 04:45:42,032][106225] Updated weights for policy 1, policy_version 1325520 (0.0008) [2023-12-28 04:45:42,296][106226] Updated weights for policy 0, policy_version 1322072 (0.0008) [2023-12-28 04:45:42,365][106226] Updated weights for policy 0, policy_version 1322082 (0.0009) [2023-12-28 04:45:42,418][106226] Updated weights for policy 0, policy_version 1322092 (0.0009) [2023-12-28 04:45:42,763][106225] Updated weights for policy 1, policy_version 1325530 (0.0009) [2023-12-28 04:45:42,822][106225] Updated weights for policy 1, policy_version 1325540 (0.0006) [2023-12-28 04:45:42,879][106225] Updated weights for policy 1, policy_version 1325550 (0.0008) [2023-12-28 04:45:42,943][106225] Updated weights for policy 1, policy_version 1325560 (0.0009) [2023-12-28 04:45:43,140][106226] Updated weights for policy 0, policy_version 1322102 (0.0010) [2023-12-28 04:45:43,200][106226] Updated weights for policy 0, policy_version 1322112 (0.0011) [2023-12-28 04:45:43,262][106226] Updated weights for policy 0, policy_version 1322122 (0.0011) [2023-12-28 04:45:43,671][106225] Updated weights for policy 1, policy_version 1325570 (0.0007) [2023-12-28 04:45:43,721][106225] Updated weights for policy 1, policy_version 1325580 (0.0008) [2023-12-28 04:45:43,774][106225] Updated weights for policy 1, policy_version 1325590 (0.0007) [2023-12-28 04:45:43,970][106226] Updated weights for policy 0, policy_version 1322132 (0.0011) [2023-12-28 04:45:44,029][106226] Updated weights for policy 0, policy_version 1322142 (0.0010) [2023-12-28 04:45:44,082][106226] Updated weights for policy 0, policy_version 1322152 (0.0010) [2023-12-28 04:45:44,451][106225] Updated weights for policy 1, policy_version 1325600 (0.0007) [2023-12-28 04:45:44,501][106225] Updated weights for policy 1, policy_version 1325610 (0.0008) [2023-12-28 04:45:44,553][106225] Updated weights for policy 1, policy_version 1325620 (0.0008) [2023-12-28 04:45:44,765][106226] Updated weights for policy 0, policy_version 1322162 (0.0010) [2023-12-28 04:45:44,825][106226] Updated weights for policy 0, policy_version 1322172 (0.0008) [2023-12-28 04:45:44,882][106226] Updated weights for policy 0, policy_version 1322182 (0.0008) [2023-12-28 04:45:44,940][106226] Updated weights for policy 0, policy_version 1322192 (0.0008) [2023-12-28 04:45:45,244][106225] Updated weights for policy 1, policy_version 1325630 (0.0009) [2023-12-28 04:45:45,306][106225] Updated weights for policy 1, policy_version 1325640 (0.0009) [2023-12-28 04:45:45,374][106225] Updated weights for policy 1, policy_version 1325650 (0.0009) [2023-12-28 04:45:45,595][106226] Updated weights for policy 0, policy_version 1322202 (0.0005) [2023-12-28 04:45:45,655][106226] Updated weights for policy 0, policy_version 1322212 (0.0005) [2023-12-28 04:45:45,711][106226] Updated weights for policy 0, policy_version 1322222 (0.0005) [2023-12-28 04:45:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 677969920. Throughput: 0: 9759.0, 1: 9785.8. Samples: 677962756. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:45:46,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-4.979')] [2023-12-28 04:45:46,214][106226] Updated weights for policy 0, policy_version 1322232 (0.0009) [2023-12-28 04:45:46,221][106225] Updated weights for policy 1, policy_version 1325660 (0.0008) [2023-12-28 04:45:46,275][106226] Updated weights for policy 0, policy_version 1322242 (0.0011) [2023-12-28 04:45:46,284][106225] Updated weights for policy 1, policy_version 1325670 (0.0006) [2023-12-28 04:45:46,331][106226] Updated weights for policy 0, policy_version 1322252 (0.0011) [2023-12-28 04:45:46,348][106225] Updated weights for policy 1, policy_version 1325680 (0.0006) [2023-12-28 04:45:46,991][106226] Updated weights for policy 0, policy_version 1322262 (0.0008) [2023-12-28 04:45:47,050][106226] Updated weights for policy 0, policy_version 1322272 (0.0009) [2023-12-28 04:45:47,096][106225] Updated weights for policy 1, policy_version 1325690 (0.0008) [2023-12-28 04:45:47,110][106226] Updated weights for policy 0, policy_version 1322282 (0.0008) [2023-12-28 04:45:47,152][106225] Updated weights for policy 1, policy_version 1325700 (0.0007) [2023-12-28 04:45:47,208][106225] Updated weights for policy 1, policy_version 1325710 (0.0008) [2023-12-28 04:45:47,261][106225] Updated weights for policy 1, policy_version 1325720 (0.0007) [2023-12-28 04:45:47,708][106226] Updated weights for policy 0, policy_version 1322292 (0.0007) [2023-12-28 04:45:47,756][106226] Updated weights for policy 0, policy_version 1322302 (0.0010) [2023-12-28 04:45:47,809][106226] Updated weights for policy 0, policy_version 1322312 (0.0008) [2023-12-28 04:45:47,854][106225] Updated weights for policy 1, policy_version 1325730 (0.0007) [2023-12-28 04:45:47,918][106225] Updated weights for policy 1, policy_version 1325740 (0.0008) [2023-12-28 04:45:47,982][106225] Updated weights for policy 1, policy_version 1325750 (0.0008) [2023-12-28 04:45:48,519][106226] Updated weights for policy 0, policy_version 1322322 (0.0008) [2023-12-28 04:45:48,569][106226] Updated weights for policy 0, policy_version 1322332 (0.0010) [2023-12-28 04:45:48,634][106226] Updated weights for policy 0, policy_version 1322342 (0.0011) [2023-12-28 04:45:48,670][106225] Updated weights for policy 1, policy_version 1325760 (0.0006) [2023-12-28 04:45:48,685][106226] Updated weights for policy 0, policy_version 1322352 (0.0010) [2023-12-28 04:45:48,715][106225] Updated weights for policy 1, policy_version 1325770 (0.0007) [2023-12-28 04:45:48,770][106225] Updated weights for policy 1, policy_version 1325780 (0.0006) [2023-12-28 04:45:49,367][106226] Updated weights for policy 0, policy_version 1322362 (0.0008) [2023-12-28 04:45:49,427][106226] Updated weights for policy 0, policy_version 1322372 (0.0008) [2023-12-28 04:45:49,477][106226] Updated weights for policy 0, policy_version 1322382 (0.0009) [2023-12-28 04:45:49,477][106225] Updated weights for policy 1, policy_version 1325790 (0.0009) [2023-12-28 04:45:49,538][106225] Updated weights for policy 1, policy_version 1325800 (0.0008) [2023-12-28 04:45:49,587][106225] Updated weights for policy 1, policy_version 1325810 (0.0008) [2023-12-28 04:45:50,258][106226] Updated weights for policy 0, policy_version 1322392 (0.0011) [2023-12-28 04:45:50,320][106226] Updated weights for policy 0, policy_version 1322402 (0.0010) [2023-12-28 04:45:50,364][106225] Updated weights for policy 1, policy_version 1325820 (0.0008) [2023-12-28 04:45:50,383][106226] Updated weights for policy 0, policy_version 1322412 (0.0007) [2023-12-28 04:45:50,417][106225] Updated weights for policy 1, policy_version 1325830 (0.0008) [2023-12-28 04:45:50,470][106225] Updated weights for policy 1, policy_version 1325840 (0.0007) [2023-12-28 04:45:51,045][106226] Updated weights for policy 0, policy_version 1322422 (0.0008) [2023-12-28 04:45:51,116][106226] Updated weights for policy 0, policy_version 1322432 (0.0010) [2023-12-28 04:45:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19633.1). Total num frames: 678068224. Throughput: 0: 9842.3, 1: 9761.8. Samples: 678083292. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:45:51,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-4.545')] [2023-12-28 04:45:51,184][106226] Updated weights for policy 0, policy_version 1322442 (0.0010) [2023-12-28 04:45:51,262][106225] Updated weights for policy 1, policy_version 1325850 (0.0008) [2023-12-28 04:45:51,331][106225] Updated weights for policy 1, policy_version 1325860 (0.0006) [2023-12-28 04:45:51,403][106225] Updated weights for policy 1, policy_version 1325870 (0.0008) [2023-12-28 04:45:51,463][106225] Updated weights for policy 1, policy_version 1325880 (0.0007) [2023-12-28 04:45:51,903][106226] Updated weights for policy 0, policy_version 1322452 (0.0009) [2023-12-28 04:45:51,971][106226] Updated weights for policy 0, policy_version 1322462 (0.0009) [2023-12-28 04:45:52,035][106226] Updated weights for policy 0, policy_version 1322472 (0.0009) [2023-12-28 04:45:52,192][106225] Updated weights for policy 1, policy_version 1325890 (0.0008) [2023-12-28 04:45:52,257][106225] Updated weights for policy 1, policy_version 1325900 (0.0007) [2023-12-28 04:45:52,311][106225] Updated weights for policy 1, policy_version 1325910 (0.0007) [2023-12-28 04:45:52,810][106226] Updated weights for policy 0, policy_version 1322482 (0.0009) [2023-12-28 04:45:52,870][106226] Updated weights for policy 0, policy_version 1322492 (0.0010) [2023-12-28 04:45:52,930][106226] Updated weights for policy 0, policy_version 1322502 (0.0011) [2023-12-28 04:45:52,987][106226] Updated weights for policy 0, policy_version 1322512 (0.0010) [2023-12-28 04:45:53,026][106225] Updated weights for policy 1, policy_version 1325920 (0.0008) [2023-12-28 04:45:53,075][106225] Updated weights for policy 1, policy_version 1325930 (0.0008) [2023-12-28 04:45:53,124][106225] Updated weights for policy 1, policy_version 1325940 (0.0008) [2023-12-28 04:45:53,559][106226] Updated weights for policy 0, policy_version 1322522 (0.0009) [2023-12-28 04:45:53,619][106226] Updated weights for policy 0, policy_version 1322532 (0.0009) [2023-12-28 04:45:53,672][106226] Updated weights for policy 0, policy_version 1322542 (0.0008) [2023-12-28 04:45:53,917][106225] Updated weights for policy 1, policy_version 1325950 (0.0008) [2023-12-28 04:45:53,965][106225] Updated weights for policy 1, policy_version 1325960 (0.0008) [2023-12-28 04:45:54,017][106225] Updated weights for policy 1, policy_version 1325970 (0.0008) [2023-12-28 04:45:54,423][106226] Updated weights for policy 0, policy_version 1322552 (0.0009) [2023-12-28 04:45:54,480][106226] Updated weights for policy 0, policy_version 1322562 (0.0010) [2023-12-28 04:45:54,526][106226] Updated weights for policy 0, policy_version 1322572 (0.0010) [2023-12-28 04:45:54,722][106225] Updated weights for policy 1, policy_version 1325980 (0.0008) [2023-12-28 04:45:54,781][106225] Updated weights for policy 1, policy_version 1325990 (0.0008) [2023-12-28 04:45:54,841][106225] Updated weights for policy 1, policy_version 1326000 (0.0008) [2023-12-28 04:45:55,297][106226] Updated weights for policy 0, policy_version 1322582 (0.0011) [2023-12-28 04:45:55,363][106226] Updated weights for policy 0, policy_version 1322592 (0.0011) [2023-12-28 04:45:55,418][106226] Updated weights for policy 0, policy_version 1322602 (0.0011) [2023-12-28 04:45:55,593][106225] Updated weights for policy 1, policy_version 1326010 (0.0007) [2023-12-28 04:45:55,647][106225] Updated weights for policy 1, policy_version 1326020 (0.0008) [2023-12-28 04:45:55,699][106225] Updated weights for policy 1, policy_version 1326030 (0.0007) [2023-12-28 04:45:55,748][106225] Updated weights for policy 1, policy_version 1326040 (0.0007) [2023-12-28 04:45:56,134][106226] Updated weights for policy 0, policy_version 1322612 (0.0011) [2023-12-28 04:45:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 678166528. Throughput: 0: 9809.5, 1: 9742.3. Samples: 678140432. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:45:56,176][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.843')] [2023-12-28 04:45:56,184][106226] Updated weights for policy 0, policy_version 1322622 (0.0010) [2023-12-28 04:45:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001326040_339517440.pth... [2023-12-28 04:45:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001324888_339222528.pth [2023-12-28 04:45:56,230][106226] Updated weights for policy 0, policy_version 1322632 (0.0010) [2023-12-28 04:45:56,267][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001322640_338657280.pth... [2023-12-28 04:45:56,270][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001321456_338354176.pth [2023-12-28 04:45:56,500][106225] Updated weights for policy 1, policy_version 1326050 (0.0007) [2023-12-28 04:45:56,556][106225] Updated weights for policy 1, policy_version 1326060 (0.0008) [2023-12-28 04:45:56,612][106225] Updated weights for policy 1, policy_version 1326070 (0.0008) [2023-12-28 04:45:56,971][106226] Updated weights for policy 0, policy_version 1322642 (0.0011) [2023-12-28 04:45:57,021][106226] Updated weights for policy 0, policy_version 1322652 (0.0011) [2023-12-28 04:45:57,079][106226] Updated weights for policy 0, policy_version 1322662 (0.0010) [2023-12-28 04:45:57,125][106226] Updated weights for policy 0, policy_version 1322672 (0.0010) [2023-12-28 04:45:57,347][106225] Updated weights for policy 1, policy_version 1326080 (0.0007) [2023-12-28 04:45:57,423][106225] Updated weights for policy 1, policy_version 1326090 (0.0008) [2023-12-28 04:45:57,468][106225] Updated weights for policy 1, policy_version 1326100 (0.0007) [2023-12-28 04:45:57,837][106226] Updated weights for policy 0, policy_version 1322682 (0.0010) [2023-12-28 04:45:57,892][106226] Updated weights for policy 0, policy_version 1322692 (0.0010) [2023-12-28 04:45:57,942][106226] Updated weights for policy 0, policy_version 1322702 (0.0010) [2023-12-28 04:45:58,162][106225] Updated weights for policy 1, policy_version 1326110 (0.0007) [2023-12-28 04:45:58,213][106225] Updated weights for policy 1, policy_version 1326120 (0.0008) [2023-12-28 04:45:58,277][106225] Updated weights for policy 1, policy_version 1326130 (0.0008) [2023-12-28 04:45:58,705][106226] Updated weights for policy 0, policy_version 1322712 (0.0011) [2023-12-28 04:45:58,779][106226] Updated weights for policy 0, policy_version 1322722 (0.0009) [2023-12-28 04:45:58,863][106226] Updated weights for policy 0, policy_version 1322732 (0.0011) [2023-12-28 04:45:59,136][106225] Updated weights for policy 1, policy_version 1326140 (0.0008) [2023-12-28 04:45:59,195][106225] Updated weights for policy 1, policy_version 1326150 (0.0008) [2023-12-28 04:45:59,277][106225] Updated weights for policy 1, policy_version 1326160 (0.0009) [2023-12-28 04:45:59,661][106226] Updated weights for policy 0, policy_version 1322742 (0.0008) [2023-12-28 04:45:59,720][106226] Updated weights for policy 0, policy_version 1322752 (0.0008) [2023-12-28 04:45:59,781][106226] Updated weights for policy 0, policy_version 1322762 (0.0008) [2023-12-28 04:46:00,015][106225] Updated weights for policy 1, policy_version 1326170 (0.0008) [2023-12-28 04:46:00,063][106225] Updated weights for policy 1, policy_version 1326180 (0.0008) [2023-12-28 04:46:00,113][106225] Updated weights for policy 1, policy_version 1326190 (0.0008) [2023-12-28 04:46:00,162][106225] Updated weights for policy 1, policy_version 1326200 (0.0009) [2023-12-28 04:46:00,534][106226] Updated weights for policy 0, policy_version 1322772 (0.0009) [2023-12-28 04:46:00,589][106226] Updated weights for policy 0, policy_version 1322782 (0.0008) [2023-12-28 04:46:00,633][106226] Updated weights for policy 0, policy_version 1322792 (0.0008) [2023-12-28 04:46:00,836][106225] Updated weights for policy 1, policy_version 1326210 (0.0009) [2023-12-28 04:46:00,888][106225] Updated weights for policy 1, policy_version 1326220 (0.0008) [2023-12-28 04:46:00,935][106225] Updated weights for policy 1, policy_version 1326230 (0.0008) [2023-12-28 04:46:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 678264832. Throughput: 0: 9789.2, 1: 9705.1. Samples: 678251892. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:01,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.729')] [2023-12-28 04:46:01,438][106226] Updated weights for policy 0, policy_version 1322802 (0.0008) [2023-12-28 04:46:01,504][106226] Updated weights for policy 0, policy_version 1322812 (0.0008) [2023-12-28 04:46:01,572][106226] Updated weights for policy 0, policy_version 1322822 (0.0009) [2023-12-28 04:46:01,642][106226] Updated weights for policy 0, policy_version 1322832 (0.0008) [2023-12-28 04:46:01,759][106225] Updated weights for policy 1, policy_version 1326240 (0.0010) [2023-12-28 04:46:01,807][106225] Updated weights for policy 1, policy_version 1326250 (0.0010) [2023-12-28 04:46:01,864][106225] Updated weights for policy 1, policy_version 1326260 (0.0008) [2023-12-28 04:46:02,250][106226] Updated weights for policy 0, policy_version 1322842 (0.0006) [2023-12-28 04:46:02,322][106226] Updated weights for policy 0, policy_version 1322852 (0.0006) [2023-12-28 04:46:02,385][106226] Updated weights for policy 0, policy_version 1322862 (0.0008) [2023-12-28 04:46:02,547][106225] Updated weights for policy 1, policy_version 1326270 (0.0008) [2023-12-28 04:46:02,608][106225] Updated weights for policy 1, policy_version 1326280 (0.0008) [2023-12-28 04:46:02,667][106225] Updated weights for policy 1, policy_version 1326290 (0.0009) [2023-12-28 04:46:03,051][106226] Updated weights for policy 0, policy_version 1322872 (0.0008) [2023-12-28 04:46:03,104][106226] Updated weights for policy 0, policy_version 1322882 (0.0008) [2023-12-28 04:46:03,157][106226] Updated weights for policy 0, policy_version 1322892 (0.0009) [2023-12-28 04:46:03,395][106225] Updated weights for policy 1, policy_version 1326300 (0.0009) [2023-12-28 04:46:03,462][106225] Updated weights for policy 1, policy_version 1326310 (0.0008) [2023-12-28 04:46:03,533][106225] Updated weights for policy 1, policy_version 1326320 (0.0009) [2023-12-28 04:46:03,784][106226] Updated weights for policy 0, policy_version 1322903 (0.0008) [2023-12-28 04:46:03,838][106226] Updated weights for policy 0, policy_version 1322913 (0.0006) [2023-12-28 04:46:03,905][106226] Updated weights for policy 0, policy_version 1322923 (0.0007) [2023-12-28 04:46:04,219][106225] Updated weights for policy 1, policy_version 1326330 (0.0009) [2023-12-28 04:46:04,278][106225] Updated weights for policy 1, policy_version 1326340 (0.0008) [2023-12-28 04:46:04,341][106225] Updated weights for policy 1, policy_version 1326350 (0.0009) [2023-12-28 04:46:04,400][106225] Updated weights for policy 1, policy_version 1326360 (0.0009) [2023-12-28 04:46:04,580][106226] Updated weights for policy 0, policy_version 1322933 (0.0008) [2023-12-28 04:46:04,641][106226] Updated weights for policy 0, policy_version 1322943 (0.0008) [2023-12-28 04:46:04,701][106226] Updated weights for policy 0, policy_version 1322953 (0.0008) [2023-12-28 04:46:05,120][106225] Updated weights for policy 1, policy_version 1326370 (0.0005) [2023-12-28 04:46:05,180][106225] Updated weights for policy 1, policy_version 1326380 (0.0007) [2023-12-28 04:46:05,239][106225] Updated weights for policy 1, policy_version 1326390 (0.0007) [2023-12-28 04:46:05,463][106226] Updated weights for policy 0, policy_version 1322963 (0.0009) [2023-12-28 04:46:05,511][106226] Updated weights for policy 0, policy_version 1322973 (0.0008) [2023-12-28 04:46:05,563][106226] Updated weights for policy 0, policy_version 1322983 (0.0009) [2023-12-28 04:46:05,848][106225] Updated weights for policy 1, policy_version 1326400 (0.0007) [2023-12-28 04:46:05,900][106225] Updated weights for policy 1, policy_version 1326410 (0.0007) [2023-12-28 04:46:05,946][106225] Updated weights for policy 1, policy_version 1326420 (0.0007) [2023-12-28 04:46:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 678363136. Throughput: 0: 9797.8, 1: 9790.5. Samples: 678370924. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:06,175][105115] Avg episode reward: [(0, '-4.254'), (1, '-4.845')] [2023-12-28 04:46:06,348][106226] Updated weights for policy 0, policy_version 1322993 (0.0009) [2023-12-28 04:46:06,408][106226] Updated weights for policy 0, policy_version 1323003 (0.0011) [2023-12-28 04:46:06,471][106226] Updated weights for policy 0, policy_version 1323013 (0.0011) [2023-12-28 04:46:06,538][106226] Updated weights for policy 0, policy_version 1323023 (0.0011) [2023-12-28 04:46:06,719][106225] Updated weights for policy 1, policy_version 1326430 (0.0006) [2023-12-28 04:46:06,784][106225] Updated weights for policy 1, policy_version 1326440 (0.0006) [2023-12-28 04:46:06,841][106225] Updated weights for policy 1, policy_version 1326450 (0.0010) [2023-12-28 04:46:07,226][106226] Updated weights for policy 0, policy_version 1323033 (0.0006) [2023-12-28 04:46:07,290][106226] Updated weights for policy 0, policy_version 1323043 (0.0006) [2023-12-28 04:46:07,358][106226] Updated weights for policy 0, policy_version 1323053 (0.0008) [2023-12-28 04:46:07,440][106225] Updated weights for policy 1, policy_version 1326460 (0.0009) [2023-12-28 04:46:07,505][106225] Updated weights for policy 1, policy_version 1326470 (0.0007) [2023-12-28 04:46:07,568][106225] Updated weights for policy 1, policy_version 1326480 (0.0010) [2023-12-28 04:46:08,007][106226] Updated weights for policy 0, policy_version 1323063 (0.0007) [2023-12-28 04:46:08,066][106226] Updated weights for policy 0, policy_version 1323073 (0.0010) [2023-12-28 04:46:08,131][106226] Updated weights for policy 0, policy_version 1323083 (0.0007) [2023-12-28 04:46:08,192][106225] Updated weights for policy 1, policy_version 1326490 (0.0007) [2023-12-28 04:46:08,248][106225] Updated weights for policy 1, policy_version 1326500 (0.0008) [2023-12-28 04:46:08,310][106225] Updated weights for policy 1, policy_version 1326510 (0.0009) [2023-12-28 04:46:08,376][106225] Updated weights for policy 1, policy_version 1326520 (0.0009) [2023-12-28 04:46:08,785][106226] Updated weights for policy 0, policy_version 1323093 (0.0007) [2023-12-28 04:46:08,836][106226] Updated weights for policy 0, policy_version 1323103 (0.0009) [2023-12-28 04:46:08,891][106226] Updated weights for policy 0, policy_version 1323113 (0.0008) [2023-12-28 04:46:09,100][106225] Updated weights for policy 1, policy_version 1326530 (0.0008) [2023-12-28 04:46:09,156][106225] Updated weights for policy 1, policy_version 1326540 (0.0008) [2023-12-28 04:46:09,204][106225] Updated weights for policy 1, policy_version 1326550 (0.0009) [2023-12-28 04:46:09,747][106226] Updated weights for policy 0, policy_version 1323123 (0.0008) [2023-12-28 04:46:09,809][106226] Updated weights for policy 0, policy_version 1323133 (0.0008) [2023-12-28 04:46:09,881][106226] Updated weights for policy 0, policy_version 1323143 (0.0006) [2023-12-28 04:46:10,085][106225] Updated weights for policy 1, policy_version 1326560 (0.0009) [2023-12-28 04:46:10,154][106225] Updated weights for policy 1, policy_version 1326570 (0.0008) [2023-12-28 04:46:10,225][106225] Updated weights for policy 1, policy_version 1326580 (0.0011) [2023-12-28 04:46:10,623][106226] Updated weights for policy 0, policy_version 1323153 (0.0007) [2023-12-28 04:46:10,684][106226] Updated weights for policy 0, policy_version 1323163 (0.0006) [2023-12-28 04:46:10,748][106226] Updated weights for policy 0, policy_version 1323173 (0.0006) [2023-12-28 04:46:10,810][106226] Updated weights for policy 0, policy_version 1323183 (0.0007) [2023-12-28 04:46:10,895][106225] Updated weights for policy 1, policy_version 1326590 (0.0011) [2023-12-28 04:46:10,959][106225] Updated weights for policy 1, policy_version 1326600 (0.0010) [2023-12-28 04:46:11,023][106225] Updated weights for policy 1, policy_version 1326610 (0.0011) [2023-12-28 04:46:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 678461440. Throughput: 0: 9826.2, 1: 9822.0. Samples: 678430932. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:11,175][105115] Avg episode reward: [(0, '-4.317'), (1, '-4.848')] [2023-12-28 04:46:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001326616_339664896.pth... [2023-12-28 04:46:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001323184_338796544.pth... [2023-12-28 04:46:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001322032_338501632.pth [2023-12-28 04:46:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001325496_339378176.pth [2023-12-28 04:46:11,560][106226] Updated weights for policy 0, policy_version 1323193 (0.0008) [2023-12-28 04:46:11,622][106226] Updated weights for policy 0, policy_version 1323203 (0.0008) [2023-12-28 04:46:11,691][106226] Updated weights for policy 0, policy_version 1323213 (0.0009) [2023-12-28 04:46:11,773][106225] Updated weights for policy 1, policy_version 1326620 (0.0008) [2023-12-28 04:46:11,838][106225] Updated weights for policy 1, policy_version 1326630 (0.0009) [2023-12-28 04:46:11,905][106225] Updated weights for policy 1, policy_version 1326640 (0.0008) [2023-12-28 04:46:12,450][106226] Updated weights for policy 0, policy_version 1323223 (0.0007) [2023-12-28 04:46:12,516][106226] Updated weights for policy 0, policy_version 1323233 (0.0006) [2023-12-28 04:46:12,580][106226] Updated weights for policy 0, policy_version 1323243 (0.0006) [2023-12-28 04:46:12,638][106225] Updated weights for policy 1, policy_version 1326650 (0.0008) [2023-12-28 04:46:12,708][106225] Updated weights for policy 1, policy_version 1326660 (0.0009) [2023-12-28 04:46:12,777][106225] Updated weights for policy 1, policy_version 1326670 (0.0007) [2023-12-28 04:46:12,843][106225] Updated weights for policy 1, policy_version 1326680 (0.0005) [2023-12-28 04:46:13,239][106226] Updated weights for policy 0, policy_version 1323253 (0.0008) [2023-12-28 04:46:13,298][106226] Updated weights for policy 0, policy_version 1323263 (0.0009) [2023-12-28 04:46:13,360][106226] Updated weights for policy 0, policy_version 1323273 (0.0008) [2023-12-28 04:46:13,556][106225] Updated weights for policy 1, policy_version 1326690 (0.0009) [2023-12-28 04:46:13,618][106225] Updated weights for policy 1, policy_version 1326700 (0.0008) [2023-12-28 04:46:13,683][106225] Updated weights for policy 1, policy_version 1326710 (0.0008) [2023-12-28 04:46:13,967][106226] Updated weights for policy 0, policy_version 1323283 (0.0008) [2023-12-28 04:46:14,026][106226] Updated weights for policy 0, policy_version 1323293 (0.0009) [2023-12-28 04:46:14,086][106226] Updated weights for policy 0, policy_version 1323303 (0.0010) [2023-12-28 04:46:14,293][106225] Updated weights for policy 1, policy_version 1326720 (0.0008) [2023-12-28 04:46:14,359][106225] Updated weights for policy 1, policy_version 1326730 (0.0008) [2023-12-28 04:46:14,424][106225] Updated weights for policy 1, policy_version 1326740 (0.0008) [2023-12-28 04:46:14,765][106226] Updated weights for policy 0, policy_version 1323313 (0.0010) [2023-12-28 04:46:14,840][106226] Updated weights for policy 0, policy_version 1323323 (0.0010) [2023-12-28 04:46:14,901][106226] Updated weights for policy 0, policy_version 1323333 (0.0009) [2023-12-28 04:46:14,953][106226] Updated weights for policy 0, policy_version 1323343 (0.0011) [2023-12-28 04:46:15,259][106225] Updated weights for policy 1, policy_version 1326750 (0.0008) [2023-12-28 04:46:15,323][106225] Updated weights for policy 1, policy_version 1326760 (0.0008) [2023-12-28 04:46:15,382][106225] Updated weights for policy 1, policy_version 1326770 (0.0008) [2023-12-28 04:46:15,703][106226] Updated weights for policy 0, policy_version 1323353 (0.0009) [2023-12-28 04:46:15,771][106226] Updated weights for policy 0, policy_version 1323363 (0.0007) [2023-12-28 04:46:15,831][106226] Updated weights for policy 0, policy_version 1323373 (0.0005) [2023-12-28 04:46:16,145][106225] Updated weights for policy 1, policy_version 1326780 (0.0009) [2023-12-28 04:46:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 678551552. Throughput: 0: 9742.0, 1: 9726.6. Samples: 678545300. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:16,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.052')] [2023-12-28 04:46:16,203][106225] Updated weights for policy 1, policy_version 1326790 (0.0008) [2023-12-28 04:46:16,260][106225] Updated weights for policy 1, policy_version 1326800 (0.0009) [2023-12-28 04:46:16,404][106226] Updated weights for policy 0, policy_version 1323383 (0.0008) [2023-12-28 04:46:16,466][106226] Updated weights for policy 0, policy_version 1323393 (0.0005) [2023-12-28 04:46:16,533][106226] Updated weights for policy 0, policy_version 1323403 (0.0005) [2023-12-28 04:46:17,037][106225] Updated weights for policy 1, policy_version 1326810 (0.0008) [2023-12-28 04:46:17,094][106225] Updated weights for policy 1, policy_version 1326820 (0.0007) [2023-12-28 04:46:17,144][106226] Updated weights for policy 0, policy_version 1323413 (0.0006) [2023-12-28 04:46:17,153][106225] Updated weights for policy 1, policy_version 1326830 (0.0007) [2023-12-28 04:46:17,206][106226] Updated weights for policy 0, policy_version 1323423 (0.0007) [2023-12-28 04:46:17,207][106225] Updated weights for policy 1, policy_version 1326840 (0.0007) [2023-12-28 04:46:17,267][106226] Updated weights for policy 0, policy_version 1323433 (0.0007) [2023-12-28 04:46:17,820][106225] Updated weights for policy 1, policy_version 1326850 (0.0007) [2023-12-28 04:46:17,864][106225] Updated weights for policy 1, policy_version 1326860 (0.0008) [2023-12-28 04:46:17,917][106225] Updated weights for policy 1, policy_version 1326870 (0.0009) [2023-12-28 04:46:18,018][106226] Updated weights for policy 0, policy_version 1323443 (0.0007) [2023-12-28 04:46:18,079][106226] Updated weights for policy 0, policy_version 1323453 (0.0006) [2023-12-28 04:46:18,140][106226] Updated weights for policy 0, policy_version 1323463 (0.0006) [2023-12-28 04:46:18,667][106225] Updated weights for policy 1, policy_version 1326880 (0.0006) [2023-12-28 04:46:18,728][106225] Updated weights for policy 1, policy_version 1326890 (0.0005) [2023-12-28 04:46:18,784][106225] Updated weights for policy 1, policy_version 1326900 (0.0005) [2023-12-28 04:46:18,821][106226] Updated weights for policy 0, policy_version 1323473 (0.0007) [2023-12-28 04:46:18,887][106226] Updated weights for policy 0, policy_version 1323483 (0.0010) [2023-12-28 04:46:18,938][106226] Updated weights for policy 0, policy_version 1323493 (0.0007) [2023-12-28 04:46:18,992][106226] Updated weights for policy 0, policy_version 1323503 (0.0008) [2023-12-28 04:46:19,431][106225] Updated weights for policy 1, policy_version 1326910 (0.0006) [2023-12-28 04:46:19,499][106225] Updated weights for policy 1, policy_version 1326920 (0.0007) [2023-12-28 04:46:19,554][106225] Updated weights for policy 1, policy_version 1326930 (0.0007) [2023-12-28 04:46:19,787][106226] Updated weights for policy 0, policy_version 1323513 (0.0009) [2023-12-28 04:46:19,854][106226] Updated weights for policy 0, policy_version 1323523 (0.0008) [2023-12-28 04:46:19,917][106226] Updated weights for policy 0, policy_version 1323533 (0.0009) [2023-12-28 04:46:20,288][106225] Updated weights for policy 1, policy_version 1326940 (0.0007) [2023-12-28 04:46:20,352][106225] Updated weights for policy 1, policy_version 1326950 (0.0009) [2023-12-28 04:46:20,415][106225] Updated weights for policy 1, policy_version 1326960 (0.0008) [2023-12-28 04:46:20,678][106226] Updated weights for policy 0, policy_version 1323543 (0.0011) [2023-12-28 04:46:20,743][106226] Updated weights for policy 0, policy_version 1323553 (0.0011) [2023-12-28 04:46:20,812][106226] Updated weights for policy 0, policy_version 1323563 (0.0011) [2023-12-28 04:46:21,110][106225] Updated weights for policy 1, policy_version 1326970 (0.0008) [2023-12-28 04:46:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 678649856. Throughput: 0: 9753.1, 1: 9694.5. Samples: 678661688. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:21,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.628')] [2023-12-28 04:46:21,177][106225] Updated weights for policy 1, policy_version 1326980 (0.0009) [2023-12-28 04:46:21,243][106225] Updated weights for policy 1, policy_version 1326990 (0.0008) [2023-12-28 04:46:21,306][106225] Updated weights for policy 1, policy_version 1327000 (0.0009) [2023-12-28 04:46:21,531][106226] Updated weights for policy 0, policy_version 1323573 (0.0008) [2023-12-28 04:46:21,591][106226] Updated weights for policy 0, policy_version 1323583 (0.0009) [2023-12-28 04:46:21,660][106226] Updated weights for policy 0, policy_version 1323593 (0.0008) [2023-12-28 04:46:22,096][106225] Updated weights for policy 1, policy_version 1327010 (0.0008) [2023-12-28 04:46:22,152][106225] Updated weights for policy 1, policy_version 1327020 (0.0009) [2023-12-28 04:46:22,205][106225] Updated weights for policy 1, policy_version 1327030 (0.0008) [2023-12-28 04:46:22,424][106226] Updated weights for policy 0, policy_version 1323603 (0.0009) [2023-12-28 04:46:22,487][106226] Updated weights for policy 0, policy_version 1323613 (0.0008) [2023-12-28 04:46:22,550][106226] Updated weights for policy 0, policy_version 1323623 (0.0009) [2023-12-28 04:46:23,002][106225] Updated weights for policy 1, policy_version 1327040 (0.0009) [2023-12-28 04:46:23,055][106225] Updated weights for policy 1, policy_version 1327050 (0.0010) [2023-12-28 04:46:23,104][106225] Updated weights for policy 1, policy_version 1327060 (0.0006) [2023-12-28 04:46:23,180][106226] Updated weights for policy 0, policy_version 1323633 (0.0008) [2023-12-28 04:46:23,228][106226] Updated weights for policy 0, policy_version 1323643 (0.0010) [2023-12-28 04:46:23,282][106226] Updated weights for policy 0, policy_version 1323653 (0.0010) [2023-12-28 04:46:23,338][106226] Updated weights for policy 0, policy_version 1323663 (0.0010) [2023-12-28 04:46:23,706][106225] Updated weights for policy 1, policy_version 1327070 (0.0006) [2023-12-28 04:46:23,759][106225] Updated weights for policy 1, policy_version 1327080 (0.0006) [2023-12-28 04:46:23,821][106225] Updated weights for policy 1, policy_version 1327090 (0.0005) [2023-12-28 04:46:23,964][106226] Updated weights for policy 0, policy_version 1323673 (0.0007) [2023-12-28 04:46:24,021][106226] Updated weights for policy 0, policy_version 1323683 (0.0008) [2023-12-28 04:46:24,088][106226] Updated weights for policy 0, policy_version 1323693 (0.0010) [2023-12-28 04:46:24,470][106225] Updated weights for policy 1, policy_version 1327100 (0.0006) [2023-12-28 04:46:24,538][106225] Updated weights for policy 1, policy_version 1327110 (0.0010) [2023-12-28 04:46:24,593][106225] Updated weights for policy 1, policy_version 1327120 (0.0010) [2023-12-28 04:46:24,811][106226] Updated weights for policy 0, policy_version 1323703 (0.0009) [2023-12-28 04:46:24,865][106226] Updated weights for policy 0, policy_version 1323713 (0.0008) [2023-12-28 04:46:24,915][106226] Updated weights for policy 0, policy_version 1323723 (0.0008) [2023-12-28 04:46:25,288][106225] Updated weights for policy 1, policy_version 1327130 (0.0009) [2023-12-28 04:46:25,341][106225] Updated weights for policy 1, policy_version 1327140 (0.0007) [2023-12-28 04:46:25,400][106225] Updated weights for policy 1, policy_version 1327150 (0.0006) [2023-12-28 04:46:25,455][106225] Updated weights for policy 1, policy_version 1327160 (0.0007) [2023-12-28 04:46:25,651][106226] Updated weights for policy 0, policy_version 1323733 (0.0008) [2023-12-28 04:46:25,711][106226] Updated weights for policy 0, policy_version 1323743 (0.0008) [2023-12-28 04:46:25,779][106226] Updated weights for policy 0, policy_version 1323753 (0.0007) [2023-12-28 04:46:26,130][106225] Updated weights for policy 1, policy_version 1327170 (0.0005) [2023-12-28 04:46:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19605.3). Total num frames: 678748160. Throughput: 0: 9809.7, 1: 9612.3. Samples: 678721244. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:26,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.869')] [2023-12-28 04:46:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001323760_338944000.pth... [2023-12-28 04:46:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001322640_338657280.pth [2023-12-28 04:46:26,186][106225] Updated weights for policy 1, policy_version 1327180 (0.0005) [2023-12-28 04:46:26,245][106225] Updated weights for policy 1, policy_version 1327190 (0.0005) [2023-12-28 04:46:26,256][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001327192_339812352.pth... [2023-12-28 04:46:26,260][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001326040_339517440.pth [2023-12-28 04:46:26,506][106226] Updated weights for policy 0, policy_version 1323763 (0.0008) [2023-12-28 04:46:26,558][106226] Updated weights for policy 0, policy_version 1323773 (0.0009) [2023-12-28 04:46:26,612][106226] Updated weights for policy 0, policy_version 1323783 (0.0008) [2023-12-28 04:46:26,781][106225] Updated weights for policy 1, policy_version 1327200 (0.0009) [2023-12-28 04:46:26,829][106225] Updated weights for policy 1, policy_version 1327210 (0.0006) [2023-12-28 04:46:26,887][106225] Updated weights for policy 1, policy_version 1327220 (0.0005) [2023-12-28 04:46:27,277][106226] Updated weights for policy 0, policy_version 1323793 (0.0008) [2023-12-28 04:46:27,344][106226] Updated weights for policy 0, policy_version 1323803 (0.0007) [2023-12-28 04:46:27,414][106226] Updated weights for policy 0, policy_version 1323813 (0.0007) [2023-12-28 04:46:27,486][106226] Updated weights for policy 0, policy_version 1323823 (0.0010) [2023-12-28 04:46:27,506][106225] Updated weights for policy 1, policy_version 1327230 (0.0007) [2023-12-28 04:46:27,569][106225] Updated weights for policy 1, policy_version 1327240 (0.0010) [2023-12-28 04:46:27,622][106225] Updated weights for policy 1, policy_version 1327250 (0.0010) [2023-12-28 04:46:28,139][106225] Updated weights for policy 1, policy_version 1327260 (0.0006) [2023-12-28 04:46:28,165][106226] Updated weights for policy 0, policy_version 1323833 (0.0006) [2023-12-28 04:46:28,200][106225] Updated weights for policy 1, policy_version 1327270 (0.0008) [2023-12-28 04:46:28,224][106226] Updated weights for policy 0, policy_version 1323843 (0.0005) [2023-12-28 04:46:28,254][106225] Updated weights for policy 1, policy_version 1327280 (0.0010) [2023-12-28 04:46:28,280][106226] Updated weights for policy 0, policy_version 1323853 (0.0005) [2023-12-28 04:46:28,904][106225] Updated weights for policy 1, policy_version 1327290 (0.0010) [2023-12-28 04:46:28,914][106226] Updated weights for policy 0, policy_version 1323863 (0.0007) [2023-12-28 04:46:28,966][106225] Updated weights for policy 1, policy_version 1327300 (0.0006) [2023-12-28 04:46:28,978][106226] Updated weights for policy 0, policy_version 1323873 (0.0009) [2023-12-28 04:46:29,020][106225] Updated weights for policy 1, policy_version 1327310 (0.0006) [2023-12-28 04:46:29,034][106226] Updated weights for policy 0, policy_version 1323883 (0.0008) [2023-12-28 04:46:29,065][106225] Updated weights for policy 1, policy_version 1327320 (0.0007) [2023-12-28 04:46:29,728][106226] Updated weights for policy 0, policy_version 1323893 (0.0008) [2023-12-28 04:46:29,782][106225] Updated weights for policy 1, policy_version 1327330 (0.0008) [2023-12-28 04:46:29,792][106226] Updated weights for policy 0, policy_version 1323903 (0.0007) [2023-12-28 04:46:29,851][106225] Updated weights for policy 1, policy_version 1327340 (0.0008) [2023-12-28 04:46:29,853][106226] Updated weights for policy 0, policy_version 1323913 (0.0009) [2023-12-28 04:46:29,917][106225] Updated weights for policy 1, policy_version 1327350 (0.0008) [2023-12-28 04:46:30,499][106226] Updated weights for policy 0, policy_version 1323923 (0.0008) [2023-12-28 04:46:30,545][106225] Updated weights for policy 1, policy_version 1327360 (0.0006) [2023-12-28 04:46:30,547][106226] Updated weights for policy 0, policy_version 1323933 (0.0007) [2023-12-28 04:46:30,600][106226] Updated weights for policy 0, policy_version 1323943 (0.0008) [2023-12-28 04:46:30,603][106225] Updated weights for policy 1, policy_version 1327370 (0.0008) [2023-12-28 04:46:30,656][106225] Updated weights for policy 1, policy_version 1327380 (0.0007) [2023-12-28 04:46:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 678854656. Throughput: 0: 9853.4, 1: 9762.0. Samples: 678845448. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:31,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.724')] [2023-12-28 04:46:31,299][106226] Updated weights for policy 0, policy_version 1323953 (0.0007) [2023-12-28 04:46:31,359][106225] Updated weights for policy 1, policy_version 1327390 (0.0008) [2023-12-28 04:46:31,366][106226] Updated weights for policy 0, policy_version 1323963 (0.0008) [2023-12-28 04:46:31,418][106225] Updated weights for policy 1, policy_version 1327400 (0.0007) [2023-12-28 04:46:31,427][106226] Updated weights for policy 0, policy_version 1323973 (0.0006) [2023-12-28 04:46:31,470][106225] Updated weights for policy 1, policy_version 1327410 (0.0007) [2023-12-28 04:46:31,494][106226] Updated weights for policy 0, policy_version 1323983 (0.0006) [2023-12-28 04:46:32,203][106226] Updated weights for policy 0, policy_version 1323993 (0.0009) [2023-12-28 04:46:32,220][106225] Updated weights for policy 1, policy_version 1327420 (0.0007) [2023-12-28 04:46:32,269][106226] Updated weights for policy 0, policy_version 1324003 (0.0008) [2023-12-28 04:46:32,282][106225] Updated weights for policy 1, policy_version 1327430 (0.0007) [2023-12-28 04:46:32,328][106226] Updated weights for policy 0, policy_version 1324013 (0.0006) [2023-12-28 04:46:32,341][106225] Updated weights for policy 1, policy_version 1327440 (0.0008) [2023-12-28 04:46:32,972][106226] Updated weights for policy 0, policy_version 1324023 (0.0008) [2023-12-28 04:46:33,018][106225] Updated weights for policy 1, policy_version 1327450 (0.0008) [2023-12-28 04:46:33,028][106226] Updated weights for policy 0, policy_version 1324033 (0.0008) [2023-12-28 04:46:33,072][106225] Updated weights for policy 1, policy_version 1327460 (0.0006) [2023-12-28 04:46:33,091][106226] Updated weights for policy 0, policy_version 1324043 (0.0007) [2023-12-28 04:46:33,125][106225] Updated weights for policy 1, policy_version 1327470 (0.0008) [2023-12-28 04:46:33,177][106225] Updated weights for policy 1, policy_version 1327480 (0.0008) [2023-12-28 04:46:33,822][106225] Updated weights for policy 1, policy_version 1327490 (0.0008) [2023-12-28 04:46:33,864][106226] Updated weights for policy 0, policy_version 1324053 (0.0007) [2023-12-28 04:46:33,871][106225] Updated weights for policy 1, policy_version 1327500 (0.0007) [2023-12-28 04:46:33,916][106226] Updated weights for policy 0, policy_version 1324063 (0.0006) [2023-12-28 04:46:33,929][106225] Updated weights for policy 1, policy_version 1327510 (0.0006) [2023-12-28 04:46:33,969][106226] Updated weights for policy 0, policy_version 1324073 (0.0007) [2023-12-28 04:46:34,639][106225] Updated weights for policy 1, policy_version 1327520 (0.0007) [2023-12-28 04:46:34,648][106226] Updated weights for policy 0, policy_version 1324083 (0.0008) [2023-12-28 04:46:34,704][106225] Updated weights for policy 1, policy_version 1327530 (0.0006) [2023-12-28 04:46:34,711][106226] Updated weights for policy 0, policy_version 1324093 (0.0008) [2023-12-28 04:46:34,750][106225] Updated weights for policy 1, policy_version 1327540 (0.0008) [2023-12-28 04:46:34,770][106226] Updated weights for policy 0, policy_version 1324103 (0.0005) [2023-12-28 04:46:35,435][106226] Updated weights for policy 0, policy_version 1324113 (0.0008) [2023-12-28 04:46:35,486][106225] Updated weights for policy 1, policy_version 1327550 (0.0009) [2023-12-28 04:46:35,488][106226] Updated weights for policy 0, policy_version 1324123 (0.0011) [2023-12-28 04:46:35,542][106226] Updated weights for policy 0, policy_version 1324133 (0.0011) [2023-12-28 04:46:35,548][106225] Updated weights for policy 1, policy_version 1327560 (0.0010) [2023-12-28 04:46:35,595][106226] Updated weights for policy 0, policy_version 1324143 (0.0010) [2023-12-28 04:46:35,600][106225] Updated weights for policy 1, policy_version 1327570 (0.0010) [2023-12-28 04:46:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 678952960. Throughput: 0: 9790.4, 1: 9819.3. Samples: 678965728. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:36,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.774')] [2023-12-28 04:46:36,252][106226] Updated weights for policy 0, policy_version 1324153 (0.0008) [2023-12-28 04:46:36,321][106226] Updated weights for policy 0, policy_version 1324163 (0.0008) [2023-12-28 04:46:36,355][106225] Updated weights for policy 1, policy_version 1327580 (0.0009) [2023-12-28 04:46:36,388][106226] Updated weights for policy 0, policy_version 1324173 (0.0008) [2023-12-28 04:46:36,414][106225] Updated weights for policy 1, policy_version 1327590 (0.0007) [2023-12-28 04:46:36,480][106225] Updated weights for policy 1, policy_version 1327600 (0.0011) [2023-12-28 04:46:37,069][106226] Updated weights for policy 0, policy_version 1324183 (0.0009) [2023-12-28 04:46:37,128][106226] Updated weights for policy 0, policy_version 1324193 (0.0008) [2023-12-28 04:46:37,160][106225] Updated weights for policy 1, policy_version 1327610 (0.0010) [2023-12-28 04:46:37,189][106226] Updated weights for policy 0, policy_version 1324203 (0.0008) [2023-12-28 04:46:37,228][106225] Updated weights for policy 1, policy_version 1327620 (0.0005) [2023-12-28 04:46:37,293][106225] Updated weights for policy 1, policy_version 1327630 (0.0005) [2023-12-28 04:46:37,353][106225] Updated weights for policy 1, policy_version 1327640 (0.0010) [2023-12-28 04:46:37,950][106226] Updated weights for policy 0, policy_version 1324213 (0.0008) [2023-12-28 04:46:37,987][106225] Updated weights for policy 1, policy_version 1327650 (0.0007) [2023-12-28 04:46:38,006][106226] Updated weights for policy 0, policy_version 1324223 (0.0006) [2023-12-28 04:46:38,040][106225] Updated weights for policy 1, policy_version 1327660 (0.0005) [2023-12-28 04:46:38,053][106226] Updated weights for policy 0, policy_version 1324233 (0.0007) [2023-12-28 04:46:38,095][106225] Updated weights for policy 1, policy_version 1327670 (0.0006) [2023-12-28 04:46:38,791][106226] Updated weights for policy 0, policy_version 1324243 (0.0008) [2023-12-28 04:46:38,800][106225] Updated weights for policy 1, policy_version 1327680 (0.0008) [2023-12-28 04:46:38,856][106226] Updated weights for policy 0, policy_version 1324253 (0.0009) [2023-12-28 04:46:38,858][106225] Updated weights for policy 1, policy_version 1327690 (0.0006) [2023-12-28 04:46:38,917][106226] Updated weights for policy 0, policy_version 1324263 (0.0008) [2023-12-28 04:46:38,918][106225] Updated weights for policy 1, policy_version 1327700 (0.0007) [2023-12-28 04:46:39,657][106226] Updated weights for policy 0, policy_version 1324273 (0.0009) [2023-12-28 04:46:39,680][106225] Updated weights for policy 1, policy_version 1327710 (0.0009) [2023-12-28 04:46:39,718][106226] Updated weights for policy 0, policy_version 1324283 (0.0007) [2023-12-28 04:46:39,744][106225] Updated weights for policy 1, policy_version 1327720 (0.0007) [2023-12-28 04:46:39,780][106226] Updated weights for policy 0, policy_version 1324293 (0.0006) [2023-12-28 04:46:39,801][106225] Updated weights for policy 1, policy_version 1327730 (0.0009) [2023-12-28 04:46:39,844][106226] Updated weights for policy 0, policy_version 1324303 (0.0008) [2023-12-28 04:46:40,502][106225] Updated weights for policy 1, policy_version 1327740 (0.0006) [2023-12-28 04:46:40,563][106225] Updated weights for policy 1, policy_version 1327750 (0.0008) [2023-12-28 04:46:40,627][106225] Updated weights for policy 1, policy_version 1327760 (0.0006) [2023-12-28 04:46:40,637][106226] Updated weights for policy 0, policy_version 1324313 (0.0010) [2023-12-28 04:46:40,695][106226] Updated weights for policy 0, policy_version 1324323 (0.0011) [2023-12-28 04:46:40,760][106226] Updated weights for policy 0, policy_version 1324333 (0.0011) [2023-12-28 04:46:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 679051264. Throughput: 0: 9771.9, 1: 9869.1. Samples: 679024272. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:41,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.722')] [2023-12-28 04:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001324336_339091456.pth... [2023-12-28 04:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001327768_339959808.pth... [2023-12-28 04:46:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001323184_338796544.pth [2023-12-28 04:46:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001326616_339664896.pth [2023-12-28 04:46:41,361][106225] Updated weights for policy 1, policy_version 1327770 (0.0007) [2023-12-28 04:46:41,430][106225] Updated weights for policy 1, policy_version 1327780 (0.0007) [2023-12-28 04:46:41,468][106226] Updated weights for policy 0, policy_version 1324343 (0.0007) [2023-12-28 04:46:41,494][106225] Updated weights for policy 1, policy_version 1327790 (0.0006) [2023-12-28 04:46:41,531][106226] Updated weights for policy 0, policy_version 1324353 (0.0010) [2023-12-28 04:46:41,555][106225] Updated weights for policy 1, policy_version 1327800 (0.0006) [2023-12-28 04:46:41,593][106226] Updated weights for policy 0, policy_version 1324363 (0.0011) [2023-12-28 04:46:42,268][106225] Updated weights for policy 1, policy_version 1327810 (0.0007) [2023-12-28 04:46:42,280][106226] Updated weights for policy 0, policy_version 1324373 (0.0010) [2023-12-28 04:46:42,332][106225] Updated weights for policy 1, policy_version 1327820 (0.0010) [2023-12-28 04:46:42,339][106226] Updated weights for policy 0, policy_version 1324383 (0.0010) [2023-12-28 04:46:42,402][106225] Updated weights for policy 1, policy_version 1327830 (0.0007) [2023-12-28 04:46:42,408][106226] Updated weights for policy 0, policy_version 1324393 (0.0008) [2023-12-28 04:46:42,992][106226] Updated weights for policy 0, policy_version 1324403 (0.0009) [2023-12-28 04:46:43,029][106225] Updated weights for policy 1, policy_version 1327840 (0.0006) [2023-12-28 04:46:43,049][106226] Updated weights for policy 0, policy_version 1324413 (0.0010) [2023-12-28 04:46:43,079][106225] Updated weights for policy 1, policy_version 1327850 (0.0005) [2023-12-28 04:46:43,113][106226] Updated weights for policy 0, policy_version 1324423 (0.0011) [2023-12-28 04:46:43,137][106225] Updated weights for policy 1, policy_version 1327860 (0.0006) [2023-12-28 04:46:43,700][106225] Updated weights for policy 1, policy_version 1327870 (0.0005) [2023-12-28 04:46:43,708][106226] Updated weights for policy 0, policy_version 1324433 (0.0010) [2023-12-28 04:46:43,764][106226] Updated weights for policy 0, policy_version 1324443 (0.0010) [2023-12-28 04:46:43,765][106225] Updated weights for policy 1, policy_version 1327880 (0.0005) [2023-12-28 04:46:43,824][106226] Updated weights for policy 0, policy_version 1324453 (0.0010) [2023-12-28 04:46:43,833][106225] Updated weights for policy 1, policy_version 1327890 (0.0005) [2023-12-28 04:46:43,894][106226] Updated weights for policy 0, policy_version 1324463 (0.0011) [2023-12-28 04:46:44,425][106225] Updated weights for policy 1, policy_version 1327900 (0.0005) [2023-12-28 04:46:44,477][106225] Updated weights for policy 1, policy_version 1327910 (0.0006) [2023-12-28 04:46:44,535][106225] Updated weights for policy 1, policy_version 1327920 (0.0006) [2023-12-28 04:46:44,568][106226] Updated weights for policy 0, policy_version 1324473 (0.0008) [2023-12-28 04:46:44,634][106226] Updated weights for policy 0, policy_version 1324483 (0.0008) [2023-12-28 04:46:44,700][106226] Updated weights for policy 0, policy_version 1324493 (0.0007) [2023-12-28 04:46:45,152][106225] Updated weights for policy 1, policy_version 1327930 (0.0008) [2023-12-28 04:46:45,222][106225] Updated weights for policy 1, policy_version 1327940 (0.0007) [2023-12-28 04:46:45,289][106225] Updated weights for policy 1, policy_version 1327950 (0.0006) [2023-12-28 04:46:45,355][106225] Updated weights for policy 1, policy_version 1327960 (0.0008) [2023-12-28 04:46:45,449][106226] Updated weights for policy 0, policy_version 1324503 (0.0008) [2023-12-28 04:46:45,504][106226] Updated weights for policy 0, policy_version 1324513 (0.0008) [2023-12-28 04:46:45,565][106226] Updated weights for policy 0, policy_version 1324523 (0.0008) [2023-12-28 04:46:45,925][106225] Updated weights for policy 1, policy_version 1327970 (0.0008) [2023-12-28 04:46:45,992][106225] Updated weights for policy 1, policy_version 1327980 (0.0010) [2023-12-28 04:46:46,054][106225] Updated weights for policy 1, policy_version 1327990 (0.0008) [2023-12-28 04:46:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 679157760. Throughput: 0: 9851.6, 1: 9991.0. Samples: 679144808. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:46,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.982')] [2023-12-28 04:46:46,225][106226] Updated weights for policy 0, policy_version 1324533 (0.0009) [2023-12-28 04:46:46,277][106226] Updated weights for policy 0, policy_version 1324543 (0.0010) [2023-12-28 04:46:46,324][106226] Updated weights for policy 0, policy_version 1324553 (0.0010) [2023-12-28 04:46:46,732][106225] Updated weights for policy 1, policy_version 1328000 (0.0010) [2023-12-28 04:46:46,791][106225] Updated weights for policy 1, policy_version 1328010 (0.0010) [2023-12-28 04:46:46,847][106225] Updated weights for policy 1, policy_version 1328020 (0.0010) [2023-12-28 04:46:46,969][106226] Updated weights for policy 0, policy_version 1324563 (0.0009) [2023-12-28 04:46:47,034][106226] Updated weights for policy 0, policy_version 1324573 (0.0006) [2023-12-28 04:46:47,093][106226] Updated weights for policy 0, policy_version 1324583 (0.0010) [2023-12-28 04:46:47,490][106225] Updated weights for policy 1, policy_version 1328030 (0.0007) [2023-12-28 04:46:47,553][106225] Updated weights for policy 1, policy_version 1328040 (0.0006) [2023-12-28 04:46:47,617][106225] Updated weights for policy 1, policy_version 1328050 (0.0005) [2023-12-28 04:46:47,660][106226] Updated weights for policy 0, policy_version 1324593 (0.0008) [2023-12-28 04:46:47,716][106226] Updated weights for policy 0, policy_version 1324603 (0.0010) [2023-12-28 04:46:47,767][106226] Updated weights for policy 0, policy_version 1324613 (0.0008) [2023-12-28 04:46:47,826][106226] Updated weights for policy 0, policy_version 1324623 (0.0005) [2023-12-28 04:46:48,154][106225] Updated weights for policy 1, policy_version 1328060 (0.0006) [2023-12-28 04:46:48,215][106225] Updated weights for policy 1, policy_version 1328070 (0.0008) [2023-12-28 04:46:48,275][106225] Updated weights for policy 1, policy_version 1328080 (0.0008) [2023-12-28 04:46:48,462][106226] Updated weights for policy 0, policy_version 1324633 (0.0008) [2023-12-28 04:46:48,524][106226] Updated weights for policy 0, policy_version 1324643 (0.0008) [2023-12-28 04:46:48,578][106226] Updated weights for policy 0, policy_version 1324653 (0.0008) [2023-12-28 04:46:48,967][106225] Updated weights for policy 1, policy_version 1328090 (0.0006) [2023-12-28 04:46:49,031][106225] Updated weights for policy 1, policy_version 1328100 (0.0009) [2023-12-28 04:46:49,104][106225] Updated weights for policy 1, policy_version 1328110 (0.0009) [2023-12-28 04:46:49,168][106225] Updated weights for policy 1, policy_version 1328120 (0.0008) [2023-12-28 04:46:49,211][106226] Updated weights for policy 0, policy_version 1324663 (0.0010) [2023-12-28 04:46:49,279][106226] Updated weights for policy 0, policy_version 1324673 (0.0011) [2023-12-28 04:46:49,343][106226] Updated weights for policy 0, policy_version 1324683 (0.0011) [2023-12-28 04:46:49,968][106226] Updated weights for policy 0, policy_version 1324693 (0.0010) [2023-12-28 04:46:49,976][106225] Updated weights for policy 1, policy_version 1328130 (0.0006) [2023-12-28 04:46:50,028][106226] Updated weights for policy 0, policy_version 1324703 (0.0011) [2023-12-28 04:46:50,038][106225] Updated weights for policy 1, policy_version 1328140 (0.0006) [2023-12-28 04:46:50,086][106226] Updated weights for policy 0, policy_version 1324713 (0.0011) [2023-12-28 04:46:50,092][106225] Updated weights for policy 1, policy_version 1328150 (0.0007) [2023-12-28 04:46:50,808][106226] Updated weights for policy 0, policy_version 1324723 (0.0011) [2023-12-28 04:46:50,866][106226] Updated weights for policy 0, policy_version 1324733 (0.0011) [2023-12-28 04:46:50,872][106225] Updated weights for policy 1, policy_version 1328160 (0.0006) [2023-12-28 04:46:50,925][106226] Updated weights for policy 0, policy_version 1324743 (0.0011) [2023-12-28 04:46:50,927][106225] Updated weights for policy 1, policy_version 1328170 (0.0008) [2023-12-28 04:46:50,983][106225] Updated weights for policy 1, policy_version 1328180 (0.0006) [2023-12-28 04:46:51,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 679264256. Throughput: 0: 9940.9, 1: 10019.3. Samples: 679269132. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:51,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.789')] [2023-12-28 04:46:51,606][106226] Updated weights for policy 0, policy_version 1324753 (0.0010) [2023-12-28 04:46:51,666][106226] Updated weights for policy 0, policy_version 1324763 (0.0008) [2023-12-28 04:46:51,731][106226] Updated weights for policy 0, policy_version 1324773 (0.0007) [2023-12-28 04:46:51,748][106225] Updated weights for policy 1, policy_version 1328190 (0.0008) [2023-12-28 04:46:51,799][106226] Updated weights for policy 0, policy_version 1324783 (0.0007) [2023-12-28 04:46:51,814][106225] Updated weights for policy 1, policy_version 1328200 (0.0007) [2023-12-28 04:46:51,877][106225] Updated weights for policy 1, policy_version 1328210 (0.0008) [2023-12-28 04:46:52,541][106226] Updated weights for policy 0, policy_version 1324793 (0.0008) [2023-12-28 04:46:52,583][106225] Updated weights for policy 1, policy_version 1328220 (0.0007) [2023-12-28 04:46:52,597][106226] Updated weights for policy 0, policy_version 1324803 (0.0007) [2023-12-28 04:46:52,647][106225] Updated weights for policy 1, policy_version 1328230 (0.0007) [2023-12-28 04:46:52,657][106226] Updated weights for policy 0, policy_version 1324813 (0.0009) [2023-12-28 04:46:52,708][106225] Updated weights for policy 1, policy_version 1328240 (0.0007) [2023-12-28 04:46:53,350][106225] Updated weights for policy 1, policy_version 1328250 (0.0009) [2023-12-28 04:46:53,412][106225] Updated weights for policy 1, policy_version 1328260 (0.0009) [2023-12-28 04:46:53,421][106226] Updated weights for policy 0, policy_version 1324823 (0.0008) [2023-12-28 04:46:53,470][106225] Updated weights for policy 1, policy_version 1328270 (0.0006) [2023-12-28 04:46:53,484][106226] Updated weights for policy 0, policy_version 1324833 (0.0007) [2023-12-28 04:46:53,526][106225] Updated weights for policy 1, policy_version 1328280 (0.0005) [2023-12-28 04:46:53,532][106226] Updated weights for policy 0, policy_version 1324843 (0.0006) [2023-12-28 04:46:54,254][106225] Updated weights for policy 1, policy_version 1328290 (0.0009) [2023-12-28 04:46:54,287][106226] Updated weights for policy 0, policy_version 1324853 (0.0008) [2023-12-28 04:46:54,312][106225] Updated weights for policy 1, policy_version 1328300 (0.0006) [2023-12-28 04:46:54,345][106226] Updated weights for policy 0, policy_version 1324863 (0.0006) [2023-12-28 04:46:54,367][106225] Updated weights for policy 1, policy_version 1328310 (0.0006) [2023-12-28 04:46:54,406][106226] Updated weights for policy 0, policy_version 1324873 (0.0007) [2023-12-28 04:46:55,031][106226] Updated weights for policy 0, policy_version 1324883 (0.0008) [2023-12-28 04:46:55,091][106226] Updated weights for policy 0, policy_version 1324893 (0.0008) [2023-12-28 04:46:55,142][106226] Updated weights for policy 0, policy_version 1324903 (0.0006) [2023-12-28 04:46:55,155][106225] Updated weights for policy 1, policy_version 1328320 (0.0007) [2023-12-28 04:46:55,212][106225] Updated weights for policy 1, policy_version 1328330 (0.0008) [2023-12-28 04:46:55,267][106225] Updated weights for policy 1, policy_version 1328340 (0.0009) [2023-12-28 04:46:55,762][106226] Updated weights for policy 0, policy_version 1324913 (0.0006) [2023-12-28 04:46:55,825][106226] Updated weights for policy 0, policy_version 1324923 (0.0005) [2023-12-28 04:46:55,883][106226] Updated weights for policy 0, policy_version 1324933 (0.0008) [2023-12-28 04:46:55,944][106226] Updated weights for policy 0, policy_version 1324943 (0.0009) [2023-12-28 04:46:56,079][106225] Updated weights for policy 1, policy_version 1328350 (0.0009) [2023-12-28 04:46:56,133][106225] Updated weights for policy 1, policy_version 1328360 (0.0008) [2023-12-28 04:46:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 679354368. Throughput: 0: 9909.1, 1: 9988.8. Samples: 679326336. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:46:56,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-5.053')] [2023-12-28 04:46:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001324944_339247104.pth... [2023-12-28 04:46:56,186][106225] Updated weights for policy 1, policy_version 1328370 (0.0009) [2023-12-28 04:46:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001323760_338944000.pth [2023-12-28 04:46:56,215][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001328376_340115456.pth... [2023-12-28 04:46:56,219][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001327192_339812352.pth [2023-12-28 04:46:56,557][106226] Updated weights for policy 0, policy_version 1324953 (0.0006) [2023-12-28 04:46:56,608][106226] Updated weights for policy 0, policy_version 1324963 (0.0005) [2023-12-28 04:46:56,663][106226] Updated weights for policy 0, policy_version 1324973 (0.0005) [2023-12-28 04:46:56,989][106225] Updated weights for policy 1, policy_version 1328380 (0.0008) [2023-12-28 04:46:57,050][106225] Updated weights for policy 1, policy_version 1328390 (0.0008) [2023-12-28 04:46:57,098][106225] Updated weights for policy 1, policy_version 1328400 (0.0008) [2023-12-28 04:46:57,327][106226] Updated weights for policy 0, policy_version 1324983 (0.0006) [2023-12-28 04:46:57,379][106226] Updated weights for policy 0, policy_version 1324993 (0.0005) [2023-12-28 04:46:57,430][106226] Updated weights for policy 0, policy_version 1325003 (0.0006) [2023-12-28 04:46:57,746][106225] Updated weights for policy 1, policy_version 1328410 (0.0008) [2023-12-28 04:46:57,793][106225] Updated weights for policy 1, policy_version 1328420 (0.0008) [2023-12-28 04:46:57,848][106225] Updated weights for policy 1, policy_version 1328430 (0.0008) [2023-12-28 04:46:57,902][106225] Updated weights for policy 1, policy_version 1328440 (0.0010) [2023-12-28 04:46:58,155][106226] Updated weights for policy 0, policy_version 1325013 (0.0008) [2023-12-28 04:46:58,208][106226] Updated weights for policy 0, policy_version 1325023 (0.0009) [2023-12-28 04:46:58,275][106226] Updated weights for policy 0, policy_version 1325033 (0.0008) [2023-12-28 04:46:58,700][106225] Updated weights for policy 1, policy_version 1328450 (0.0010) [2023-12-28 04:46:58,767][106225] Updated weights for policy 1, policy_version 1328460 (0.0009) [2023-12-28 04:46:58,829][106225] Updated weights for policy 1, policy_version 1328470 (0.0009) [2023-12-28 04:46:59,100][106226] Updated weights for policy 0, policy_version 1325043 (0.0009) [2023-12-28 04:46:59,159][106226] Updated weights for policy 0, policy_version 1325053 (0.0009) [2023-12-28 04:46:59,220][106226] Updated weights for policy 0, policy_version 1325063 (0.0009) [2023-12-28 04:46:59,664][106225] Updated weights for policy 1, policy_version 1328480 (0.0008) [2023-12-28 04:46:59,724][106225] Updated weights for policy 1, policy_version 1328490 (0.0008) [2023-12-28 04:46:59,770][106225] Updated weights for policy 1, policy_version 1328500 (0.0008) [2023-12-28 04:47:00,014][106226] Updated weights for policy 0, policy_version 1325073 (0.0007) [2023-12-28 04:47:00,084][106226] Updated weights for policy 0, policy_version 1325083 (0.0008) [2023-12-28 04:47:00,146][106226] Updated weights for policy 0, policy_version 1325093 (0.0009) [2023-12-28 04:47:00,209][106226] Updated weights for policy 0, policy_version 1325103 (0.0009) [2023-12-28 04:47:00,485][106225] Updated weights for policy 1, policy_version 1328510 (0.0007) [2023-12-28 04:47:00,539][106225] Updated weights for policy 1, policy_version 1328520 (0.0007) [2023-12-28 04:47:00,588][106225] Updated weights for policy 1, policy_version 1328530 (0.0007) [2023-12-28 04:47:00,867][106226] Updated weights for policy 0, policy_version 1325113 (0.0009) [2023-12-28 04:47:00,925][106226] Updated weights for policy 0, policy_version 1325123 (0.0010) [2023-12-28 04:47:00,978][106226] Updated weights for policy 0, policy_version 1325133 (0.0009) [2023-12-28 04:47:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 679452672. Throughput: 0: 9957.6, 1: 9955.3. Samples: 679441380. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:01,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.438')] [2023-12-28 04:47:01,244][106225] Updated weights for policy 1, policy_version 1328540 (0.0008) [2023-12-28 04:47:01,302][106225] Updated weights for policy 1, policy_version 1328550 (0.0008) [2023-12-28 04:47:01,355][106225] Updated weights for policy 1, policy_version 1328560 (0.0008) [2023-12-28 04:47:01,774][106226] Updated weights for policy 0, policy_version 1325143 (0.0009) [2023-12-28 04:47:01,834][106226] Updated weights for policy 0, policy_version 1325153 (0.0010) [2023-12-28 04:47:01,901][106226] Updated weights for policy 0, policy_version 1325163 (0.0009) [2023-12-28 04:47:02,024][106225] Updated weights for policy 1, policy_version 1328570 (0.0008) [2023-12-28 04:47:02,088][106225] Updated weights for policy 1, policy_version 1328580 (0.0008) [2023-12-28 04:47:02,146][106225] Updated weights for policy 1, policy_version 1328590 (0.0008) [2023-12-28 04:47:02,209][106225] Updated weights for policy 1, policy_version 1328600 (0.0008) [2023-12-28 04:47:02,688][106226] Updated weights for policy 0, policy_version 1325173 (0.0008) [2023-12-28 04:47:02,745][106226] Updated weights for policy 0, policy_version 1325183 (0.0008) [2023-12-28 04:47:02,807][106226] Updated weights for policy 0, policy_version 1325193 (0.0008) [2023-12-28 04:47:02,852][106225] Updated weights for policy 1, policy_version 1328610 (0.0008) [2023-12-28 04:47:02,909][106225] Updated weights for policy 1, policy_version 1328620 (0.0007) [2023-12-28 04:47:02,975][106225] Updated weights for policy 1, policy_version 1328630 (0.0009) [2023-12-28 04:47:03,443][106226] Updated weights for policy 0, policy_version 1325203 (0.0007) [2023-12-28 04:47:03,502][106226] Updated weights for policy 0, policy_version 1325213 (0.0009) [2023-12-28 04:47:03,558][106226] Updated weights for policy 0, policy_version 1325223 (0.0007) [2023-12-28 04:47:03,725][106225] Updated weights for policy 1, policy_version 1328640 (0.0008) [2023-12-28 04:47:03,771][106225] Updated weights for policy 1, policy_version 1328650 (0.0009) [2023-12-28 04:47:03,820][106225] Updated weights for policy 1, policy_version 1328660 (0.0007) [2023-12-28 04:47:04,127][106226] Updated weights for policy 0, policy_version 1325233 (0.0005) [2023-12-28 04:47:04,189][106226] Updated weights for policy 0, policy_version 1325243 (0.0006) [2023-12-28 04:47:04,261][106226] Updated weights for policy 0, policy_version 1325253 (0.0009) [2023-12-28 04:47:04,330][106226] Updated weights for policy 0, policy_version 1325263 (0.0008) [2023-12-28 04:47:04,617][106225] Updated weights for policy 1, policy_version 1328670 (0.0009) [2023-12-28 04:47:04,669][106225] Updated weights for policy 1, policy_version 1328680 (0.0008) [2023-12-28 04:47:04,725][106225] Updated weights for policy 1, policy_version 1328690 (0.0009) [2023-12-28 04:47:04,946][106226] Updated weights for policy 0, policy_version 1325273 (0.0008) [2023-12-28 04:47:05,006][106226] Updated weights for policy 0, policy_version 1325283 (0.0009) [2023-12-28 04:47:05,066][106226] Updated weights for policy 0, policy_version 1325293 (0.0009) [2023-12-28 04:47:05,511][106225] Updated weights for policy 1, policy_version 1328700 (0.0008) [2023-12-28 04:47:05,566][106225] Updated weights for policy 1, policy_version 1328710 (0.0008) [2023-12-28 04:47:05,620][106225] Updated weights for policy 1, policy_version 1328720 (0.0007) [2023-12-28 04:47:05,767][106226] Updated weights for policy 0, policy_version 1325303 (0.0008) [2023-12-28 04:47:05,824][106226] Updated weights for policy 0, policy_version 1325313 (0.0010) [2023-12-28 04:47:05,871][106226] Updated weights for policy 0, policy_version 1325323 (0.0010) [2023-12-28 04:47:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 679550976. Throughput: 0: 9994.2, 1: 9970.1. Samples: 679560084. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:06,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.864')] [2023-12-28 04:47:06,289][106225] Updated weights for policy 1, policy_version 1328730 (0.0008) [2023-12-28 04:47:06,352][106225] Updated weights for policy 1, policy_version 1328740 (0.0007) [2023-12-28 04:47:06,416][106225] Updated weights for policy 1, policy_version 1328750 (0.0005) [2023-12-28 04:47:06,489][106225] Updated weights for policy 1, policy_version 1328760 (0.0006) [2023-12-28 04:47:06,594][106226] Updated weights for policy 0, policy_version 1325333 (0.0009) [2023-12-28 04:47:06,654][106226] Updated weights for policy 0, policy_version 1325343 (0.0008) [2023-12-28 04:47:06,718][106226] Updated weights for policy 0, policy_version 1325353 (0.0008) [2023-12-28 04:47:07,110][106225] Updated weights for policy 1, policy_version 1328770 (0.0010) [2023-12-28 04:47:07,176][106225] Updated weights for policy 1, policy_version 1328780 (0.0009) [2023-12-28 04:47:07,228][106225] Updated weights for policy 1, policy_version 1328790 (0.0008) [2023-12-28 04:47:07,318][106226] Updated weights for policy 0, policy_version 1325363 (0.0007) [2023-12-28 04:47:07,372][106226] Updated weights for policy 0, policy_version 1325373 (0.0005) [2023-12-28 04:47:07,429][106226] Updated weights for policy 0, policy_version 1325383 (0.0007) [2023-12-28 04:47:07,908][106225] Updated weights for policy 1, policy_version 1328800 (0.0006) [2023-12-28 04:47:07,981][106225] Updated weights for policy 1, policy_version 1328810 (0.0005) [2023-12-28 04:47:08,044][106226] Updated weights for policy 0, policy_version 1325393 (0.0008) [2023-12-28 04:47:08,047][106225] Updated weights for policy 1, policy_version 1328820 (0.0006) [2023-12-28 04:47:08,096][106226] Updated weights for policy 0, policy_version 1325403 (0.0005) [2023-12-28 04:47:08,144][106226] Updated weights for policy 0, policy_version 1325413 (0.0007) [2023-12-28 04:47:08,205][106226] Updated weights for policy 0, policy_version 1325423 (0.0008) [2023-12-28 04:47:08,643][106225] Updated weights for policy 1, policy_version 1328830 (0.0008) [2023-12-28 04:47:08,707][106225] Updated weights for policy 1, policy_version 1328840 (0.0008) [2023-12-28 04:47:08,759][106225] Updated weights for policy 1, policy_version 1328850 (0.0008) [2023-12-28 04:47:08,965][106226] Updated weights for policy 0, policy_version 1325433 (0.0009) [2023-12-28 04:47:09,019][106226] Updated weights for policy 0, policy_version 1325443 (0.0010) [2023-12-28 04:47:09,076][106226] Updated weights for policy 0, policy_version 1325453 (0.0009) [2023-12-28 04:47:09,481][106225] Updated weights for policy 1, policy_version 1328860 (0.0008) [2023-12-28 04:47:09,545][106225] Updated weights for policy 1, policy_version 1328870 (0.0009) [2023-12-28 04:47:09,605][106225] Updated weights for policy 1, policy_version 1328880 (0.0007) [2023-12-28 04:47:09,857][106226] Updated weights for policy 0, policy_version 1325463 (0.0007) [2023-12-28 04:47:09,920][106226] Updated weights for policy 0, policy_version 1325473 (0.0009) [2023-12-28 04:47:09,988][106226] Updated weights for policy 0, policy_version 1325483 (0.0008) [2023-12-28 04:47:10,355][106225] Updated weights for policy 1, policy_version 1328890 (0.0009) [2023-12-28 04:47:10,426][106225] Updated weights for policy 1, policy_version 1328900 (0.0010) [2023-12-28 04:47:10,491][106225] Updated weights for policy 1, policy_version 1328910 (0.0009) [2023-12-28 04:47:10,559][106225] Updated weights for policy 1, policy_version 1328920 (0.0009) [2023-12-28 04:47:10,659][106226] Updated weights for policy 0, policy_version 1325493 (0.0009) [2023-12-28 04:47:10,730][106226] Updated weights for policy 0, policy_version 1325503 (0.0008) [2023-12-28 04:47:10,793][106226] Updated weights for policy 0, policy_version 1325513 (0.0009) [2023-12-28 04:47:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 679649280. Throughput: 0: 10001.7, 1: 10022.9. Samples: 679622352. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:11,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.558')] [2023-12-28 04:47:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001328920_340254720.pth... [2023-12-28 04:47:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001325520_339394560.pth... [2023-12-28 04:47:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001324336_339091456.pth [2023-12-28 04:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001327768_339959808.pth [2023-12-28 04:47:11,268][106225] Updated weights for policy 1, policy_version 1328930 (0.0009) [2023-12-28 04:47:11,330][106225] Updated weights for policy 1, policy_version 1328940 (0.0008) [2023-12-28 04:47:11,404][106225] Updated weights for policy 1, policy_version 1328950 (0.0008) [2023-12-28 04:47:11,572][106226] Updated weights for policy 0, policy_version 1325523 (0.0010) [2023-12-28 04:47:11,632][106226] Updated weights for policy 0, policy_version 1325533 (0.0010) [2023-12-28 04:47:11,697][106226] Updated weights for policy 0, policy_version 1325543 (0.0008) [2023-12-28 04:47:12,064][106225] Updated weights for policy 1, policy_version 1328960 (0.0007) [2023-12-28 04:47:12,117][106225] Updated weights for policy 1, policy_version 1328970 (0.0008) [2023-12-28 04:47:12,178][106225] Updated weights for policy 1, policy_version 1328980 (0.0008) [2023-12-28 04:47:12,497][106226] Updated weights for policy 0, policy_version 1325553 (0.0010) [2023-12-28 04:47:12,545][106226] Updated weights for policy 0, policy_version 1325563 (0.0011) [2023-12-28 04:47:12,599][106226] Updated weights for policy 0, policy_version 1325573 (0.0010) [2023-12-28 04:47:12,675][106226] Updated weights for policy 0, policy_version 1325583 (0.0009) [2023-12-28 04:47:12,932][106225] Updated weights for policy 1, policy_version 1328990 (0.0007) [2023-12-28 04:47:12,994][106225] Updated weights for policy 1, policy_version 1329000 (0.0010) [2023-12-28 04:47:13,051][106225] Updated weights for policy 1, policy_version 1329010 (0.0010) [2023-12-28 04:47:13,317][106226] Updated weights for policy 0, policy_version 1325593 (0.0010) [2023-12-28 04:47:13,373][106226] Updated weights for policy 0, policy_version 1325603 (0.0010) [2023-12-28 04:47:13,426][106226] Updated weights for policy 0, policy_version 1325613 (0.0010) [2023-12-28 04:47:13,694][106225] Updated weights for policy 1, policy_version 1329020 (0.0010) [2023-12-28 04:47:13,761][106225] Updated weights for policy 1, policy_version 1329030 (0.0010) [2023-12-28 04:47:13,820][106225] Updated weights for policy 1, policy_version 1329040 (0.0010) [2023-12-28 04:47:14,087][106226] Updated weights for policy 0, policy_version 1325623 (0.0007) [2023-12-28 04:47:14,134][106226] Updated weights for policy 0, policy_version 1325633 (0.0006) [2023-12-28 04:47:14,191][106226] Updated weights for policy 0, policy_version 1325643 (0.0009) [2023-12-28 04:47:14,453][106225] Updated weights for policy 1, policy_version 1329050 (0.0010) [2023-12-28 04:47:14,504][106225] Updated weights for policy 1, policy_version 1329060 (0.0010) [2023-12-28 04:47:14,557][106225] Updated weights for policy 1, policy_version 1329070 (0.0010) [2023-12-28 04:47:14,616][106225] Updated weights for policy 1, policy_version 1329080 (0.0010) [2023-12-28 04:47:14,869][106226] Updated weights for policy 0, policy_version 1325653 (0.0008) [2023-12-28 04:47:14,918][106226] Updated weights for policy 0, policy_version 1325663 (0.0008) [2023-12-28 04:47:14,984][106226] Updated weights for policy 0, policy_version 1325673 (0.0008) [2023-12-28 04:47:15,356][106225] Updated weights for policy 1, policy_version 1329090 (0.0010) [2023-12-28 04:47:15,410][106225] Updated weights for policy 1, policy_version 1329100 (0.0010) [2023-12-28 04:47:15,465][106225] Updated weights for policy 1, policy_version 1329110 (0.0010) [2023-12-28 04:47:15,735][106226] Updated weights for policy 0, policy_version 1325683 (0.0009) [2023-12-28 04:47:15,788][106226] Updated weights for policy 0, policy_version 1325693 (0.0010) [2023-12-28 04:47:15,838][106226] Updated weights for policy 0, policy_version 1325703 (0.0010) [2023-12-28 04:47:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 679747584. Throughput: 0: 9963.2, 1: 9891.9. Samples: 679738932. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:16,176][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.993')] [2023-12-28 04:47:16,195][106225] Updated weights for policy 1, policy_version 1329120 (0.0008) [2023-12-28 04:47:16,257][106225] Updated weights for policy 1, policy_version 1329130 (0.0008) [2023-12-28 04:47:16,314][106225] Updated weights for policy 1, policy_version 1329140 (0.0007) [2023-12-28 04:47:16,495][106226] Updated weights for policy 0, policy_version 1325713 (0.0010) [2023-12-28 04:47:16,559][106226] Updated weights for policy 0, policy_version 1325723 (0.0005) [2023-12-28 04:47:16,616][106226] Updated weights for policy 0, policy_version 1325733 (0.0006) [2023-12-28 04:47:16,675][106226] Updated weights for policy 0, policy_version 1325743 (0.0006) [2023-12-28 04:47:17,057][106225] Updated weights for policy 1, policy_version 1329150 (0.0008) [2023-12-28 04:47:17,107][106225] Updated weights for policy 1, policy_version 1329160 (0.0009) [2023-12-28 04:47:17,153][106225] Updated weights for policy 1, policy_version 1329170 (0.0009) [2023-12-28 04:47:17,294][106226] Updated weights for policy 0, policy_version 1325753 (0.0006) [2023-12-28 04:47:17,352][106226] Updated weights for policy 0, policy_version 1325763 (0.0008) [2023-12-28 04:47:17,411][106226] Updated weights for policy 0, policy_version 1325773 (0.0011) [2023-12-28 04:47:17,944][106225] Updated weights for policy 1, policy_version 1329180 (0.0008) [2023-12-28 04:47:18,008][106225] Updated weights for policy 1, policy_version 1329190 (0.0009) [2023-12-28 04:47:18,063][106225] Updated weights for policy 1, policy_version 1329200 (0.0008) [2023-12-28 04:47:18,068][106226] Updated weights for policy 0, policy_version 1325783 (0.0009) [2023-12-28 04:47:18,128][106226] Updated weights for policy 0, policy_version 1325793 (0.0007) [2023-12-28 04:47:18,194][106226] Updated weights for policy 0, policy_version 1325803 (0.0005) [2023-12-28 04:47:18,841][106225] Updated weights for policy 1, policy_version 1329210 (0.0007) [2023-12-28 04:47:18,856][106226] Updated weights for policy 0, policy_version 1325813 (0.0007) [2023-12-28 04:47:18,889][106225] Updated weights for policy 1, policy_version 1329220 (0.0009) [2023-12-28 04:47:18,909][106226] Updated weights for policy 0, policy_version 1325823 (0.0008) [2023-12-28 04:47:18,950][106225] Updated weights for policy 1, policy_version 1329230 (0.0007) [2023-12-28 04:47:18,964][106226] Updated weights for policy 0, policy_version 1325833 (0.0006) [2023-12-28 04:47:19,010][106225] Updated weights for policy 1, policy_version 1329240 (0.0007) [2023-12-28 04:47:19,734][106226] Updated weights for policy 0, policy_version 1325843 (0.0008) [2023-12-28 04:47:19,769][106225] Updated weights for policy 1, policy_version 1329250 (0.0008) [2023-12-28 04:47:19,792][106226] Updated weights for policy 0, policy_version 1325853 (0.0007) [2023-12-28 04:47:19,835][106225] Updated weights for policy 1, policy_version 1329260 (0.0006) [2023-12-28 04:47:19,859][106226] Updated weights for policy 0, policy_version 1325863 (0.0008) [2023-12-28 04:47:19,901][106225] Updated weights for policy 1, policy_version 1329270 (0.0007) [2023-12-28 04:47:20,583][106225] Updated weights for policy 1, policy_version 1329280 (0.0008) [2023-12-28 04:47:20,640][106225] Updated weights for policy 1, policy_version 1329290 (0.0009) [2023-12-28 04:47:20,663][106226] Updated weights for policy 0, policy_version 1325873 (0.0007) [2023-12-28 04:47:20,693][106225] Updated weights for policy 1, policy_version 1329300 (0.0007) [2023-12-28 04:47:20,723][106226] Updated weights for policy 0, policy_version 1325883 (0.0009) [2023-12-28 04:47:20,780][106226] Updated weights for policy 0, policy_version 1325893 (0.0009) [2023-12-28 04:47:20,840][106226] Updated weights for policy 0, policy_version 1325903 (0.0009) [2023-12-28 04:47:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19660.8). Total num frames: 679845888. Throughput: 0: 9920.7, 1: 9831.5. Samples: 679854576. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:21,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.706')] [2023-12-28 04:47:21,423][106225] Updated weights for policy 1, policy_version 1329310 (0.0008) [2023-12-28 04:47:21,485][106225] Updated weights for policy 1, policy_version 1329320 (0.0009) [2023-12-28 04:47:21,549][106225] Updated weights for policy 1, policy_version 1329330 (0.0008) [2023-12-28 04:47:21,648][106226] Updated weights for policy 0, policy_version 1325913 (0.0008) [2023-12-28 04:47:21,713][106226] Updated weights for policy 0, policy_version 1325923 (0.0008) [2023-12-28 04:47:21,788][106226] Updated weights for policy 0, policy_version 1325933 (0.0008) [2023-12-28 04:47:22,267][106225] Updated weights for policy 1, policy_version 1329340 (0.0009) [2023-12-28 04:47:22,337][106225] Updated weights for policy 1, policy_version 1329350 (0.0008) [2023-12-28 04:47:22,402][106225] Updated weights for policy 1, policy_version 1329360 (0.0009) [2023-12-28 04:47:22,535][106226] Updated weights for policy 0, policy_version 1325943 (0.0008) [2023-12-28 04:47:22,595][106226] Updated weights for policy 0, policy_version 1325953 (0.0009) [2023-12-28 04:47:22,664][106226] Updated weights for policy 0, policy_version 1325963 (0.0010) [2023-12-28 04:47:23,122][106225] Updated weights for policy 1, policy_version 1329370 (0.0006) [2023-12-28 04:47:23,168][106225] Updated weights for policy 1, policy_version 1329380 (0.0006) [2023-12-28 04:47:23,217][106225] Updated weights for policy 1, policy_version 1329390 (0.0008) [2023-12-28 04:47:23,274][106225] Updated weights for policy 1, policy_version 1329400 (0.0009) [2023-12-28 04:47:23,312][106226] Updated weights for policy 0, policy_version 1325973 (0.0008) [2023-12-28 04:47:23,369][106226] Updated weights for policy 0, policy_version 1325983 (0.0011) [2023-12-28 04:47:23,427][106226] Updated weights for policy 0, policy_version 1325993 (0.0011) [2023-12-28 04:47:24,029][106225] Updated weights for policy 1, policy_version 1329410 (0.0008) [2023-12-28 04:47:24,090][106225] Updated weights for policy 1, policy_version 1329420 (0.0008) [2023-12-28 04:47:24,119][106226] Updated weights for policy 0, policy_version 1326003 (0.0010) [2023-12-28 04:47:24,145][106225] Updated weights for policy 1, policy_version 1329430 (0.0007) [2023-12-28 04:47:24,172][106226] Updated weights for policy 0, policy_version 1326013 (0.0007) [2023-12-28 04:47:24,232][106226] Updated weights for policy 0, policy_version 1326023 (0.0008) [2023-12-28 04:47:24,873][106226] Updated weights for policy 0, policy_version 1326033 (0.0009) [2023-12-28 04:47:24,897][106225] Updated weights for policy 1, policy_version 1329440 (0.0007) [2023-12-28 04:47:24,930][106226] Updated weights for policy 0, policy_version 1326043 (0.0007) [2023-12-28 04:47:24,960][106225] Updated weights for policy 1, policy_version 1329450 (0.0008) [2023-12-28 04:47:24,982][106226] Updated weights for policy 0, policy_version 1326053 (0.0005) [2023-12-28 04:47:25,019][106225] Updated weights for policy 1, policy_version 1329460 (0.0008) [2023-12-28 04:47:25,030][106226] Updated weights for policy 0, policy_version 1326063 (0.0005) [2023-12-28 04:47:25,679][106225] Updated weights for policy 1, policy_version 1329470 (0.0009) [2023-12-28 04:47:25,707][106226] Updated weights for policy 0, policy_version 1326073 (0.0006) [2023-12-28 04:47:25,733][106225] Updated weights for policy 1, policy_version 1329480 (0.0008) [2023-12-28 04:47:25,762][106226] Updated weights for policy 0, policy_version 1326083 (0.0005) [2023-12-28 04:47:25,777][106225] Updated weights for policy 1, policy_version 1329490 (0.0008) [2023-12-28 04:47:25,823][106226] Updated weights for policy 0, policy_version 1326093 (0.0006) [2023-12-28 04:47:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 679944192. Throughput: 0: 9940.3, 1: 9794.1. Samples: 679912324. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:26,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.570')] [2023-12-28 04:47:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001326096_339542016.pth... [2023-12-28 04:47:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001329496_340402176.pth... [2023-12-28 04:47:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001328376_340115456.pth [2023-12-28 04:47:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001324944_339247104.pth [2023-12-28 04:47:26,463][106226] Updated weights for policy 0, policy_version 1326103 (0.0006) [2023-12-28 04:47:26,525][106226] Updated weights for policy 0, policy_version 1326113 (0.0007) [2023-12-28 04:47:26,579][106225] Updated weights for policy 1, policy_version 1329500 (0.0010) [2023-12-28 04:47:26,588][106226] Updated weights for policy 0, policy_version 1326123 (0.0007) [2023-12-28 04:47:26,637][106225] Updated weights for policy 1, policy_version 1329510 (0.0008) [2023-12-28 04:47:26,692][106225] Updated weights for policy 1, policy_version 1329520 (0.0010) [2023-12-28 04:47:27,220][106226] Updated weights for policy 0, policy_version 1326133 (0.0009) [2023-12-28 04:47:27,270][106226] Updated weights for policy 0, policy_version 1326143 (0.0010) [2023-12-28 04:47:27,326][106226] Updated weights for policy 0, policy_version 1326153 (0.0010) [2023-12-28 04:47:27,382][106225] Updated weights for policy 1, policy_version 1329530 (0.0010) [2023-12-28 04:47:27,441][106225] Updated weights for policy 1, policy_version 1329540 (0.0010) [2023-12-28 04:47:27,490][106225] Updated weights for policy 1, policy_version 1329550 (0.0010) [2023-12-28 04:47:27,543][106225] Updated weights for policy 1, policy_version 1329560 (0.0010) [2023-12-28 04:47:27,972][106226] Updated weights for policy 0, policy_version 1326163 (0.0009) [2023-12-28 04:47:28,030][106226] Updated weights for policy 0, policy_version 1326173 (0.0005) [2023-12-28 04:47:28,094][106226] Updated weights for policy 0, policy_version 1326183 (0.0006) [2023-12-28 04:47:28,212][106225] Updated weights for policy 1, policy_version 1329570 (0.0011) [2023-12-28 04:47:28,266][106225] Updated weights for policy 1, policy_version 1329580 (0.0010) [2023-12-28 04:47:28,330][106225] Updated weights for policy 1, policy_version 1329590 (0.0010) [2023-12-28 04:47:28,712][106226] Updated weights for policy 0, policy_version 1326193 (0.0006) [2023-12-28 04:47:28,772][106226] Updated weights for policy 0, policy_version 1326203 (0.0008) [2023-12-28 04:47:28,837][106226] Updated weights for policy 0, policy_version 1326213 (0.0007) [2023-12-28 04:47:28,898][106226] Updated weights for policy 0, policy_version 1326223 (0.0007) [2023-12-28 04:47:29,055][106225] Updated weights for policy 1, policy_version 1329600 (0.0006) [2023-12-28 04:47:29,103][106225] Updated weights for policy 1, policy_version 1329610 (0.0005) [2023-12-28 04:47:29,147][106225] Updated weights for policy 1, policy_version 1329620 (0.0008) [2023-12-28 04:47:29,610][106226] Updated weights for policy 0, policy_version 1326233 (0.0008) [2023-12-28 04:47:29,664][106226] Updated weights for policy 0, policy_version 1326243 (0.0006) [2023-12-28 04:47:29,720][106226] Updated weights for policy 0, policy_version 1326253 (0.0007) [2023-12-28 04:47:29,909][106225] Updated weights for policy 1, policy_version 1329630 (0.0010) [2023-12-28 04:47:29,968][106225] Updated weights for policy 1, policy_version 1329640 (0.0007) [2023-12-28 04:47:30,031][106225] Updated weights for policy 1, policy_version 1329650 (0.0005) [2023-12-28 04:47:30,521][106226] Updated weights for policy 0, policy_version 1326263 (0.0008) [2023-12-28 04:47:30,575][106225] Updated weights for policy 1, policy_version 1329660 (0.0005) [2023-12-28 04:47:30,587][106226] Updated weights for policy 0, policy_version 1326273 (0.0008) [2023-12-28 04:47:30,624][106225] Updated weights for policy 1, policy_version 1329670 (0.0005) [2023-12-28 04:47:30,647][106226] Updated weights for policy 0, policy_version 1326283 (0.0009) [2023-12-28 04:47:30,682][106225] Updated weights for policy 1, policy_version 1329680 (0.0005) [2023-12-28 04:47:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 680042496. Throughput: 0: 10004.7, 1: 9733.3. Samples: 680033020. Policy #0 lag: (min: 29.0, avg: 33.5, max: 61.0) [2023-12-28 04:47:31,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.773')] [2023-12-28 04:47:31,282][106225] Updated weights for policy 1, policy_version 1329690 (0.0007) [2023-12-28 04:47:31,333][106225] Updated weights for policy 1, policy_version 1329700 (0.0007) [2023-12-28 04:47:31,396][106225] Updated weights for policy 1, policy_version 1329710 (0.0011) [2023-12-28 04:47:31,428][106226] Updated weights for policy 0, policy_version 1326293 (0.0008) [2023-12-28 04:47:31,460][106225] Updated weights for policy 1, policy_version 1329720 (0.0009) [2023-12-28 04:47:31,491][106226] Updated weights for policy 0, policy_version 1326303 (0.0008) [2023-12-28 04:47:31,552][106226] Updated weights for policy 0, policy_version 1326313 (0.0008) [2023-12-28 04:47:32,182][106225] Updated weights for policy 1, policy_version 1329730 (0.0010) [2023-12-28 04:47:32,245][106225] Updated weights for policy 1, policy_version 1329740 (0.0009) [2023-12-28 04:47:32,304][106225] Updated weights for policy 1, policy_version 1329750 (0.0006) [2023-12-28 04:47:32,322][106226] Updated weights for policy 0, policy_version 1326323 (0.0007) [2023-12-28 04:47:32,394][106226] Updated weights for policy 0, policy_version 1326333 (0.0007) [2023-12-28 04:47:32,450][106226] Updated weights for policy 0, policy_version 1326343 (0.0006) [2023-12-28 04:47:32,983][106225] Updated weights for policy 1, policy_version 1329760 (0.0007) [2023-12-28 04:47:33,047][106225] Updated weights for policy 1, policy_version 1329770 (0.0008) [2023-12-28 04:47:33,114][106225] Updated weights for policy 1, policy_version 1329780 (0.0008) [2023-12-28 04:47:33,126][106226] Updated weights for policy 0, policy_version 1326353 (0.0006) [2023-12-28 04:47:33,186][106226] Updated weights for policy 0, policy_version 1326363 (0.0010) [2023-12-28 04:47:33,244][106226] Updated weights for policy 0, policy_version 1326373 (0.0006) [2023-12-28 04:47:33,296][106226] Updated weights for policy 0, policy_version 1326383 (0.0005) [2023-12-28 04:47:33,770][106225] Updated weights for policy 1, policy_version 1329790 (0.0006) [2023-12-28 04:47:33,822][106225] Updated weights for policy 1, policy_version 1329800 (0.0005) [2023-12-28 04:47:33,876][106225] Updated weights for policy 1, policy_version 1329810 (0.0007) [2023-12-28 04:47:33,902][106226] Updated weights for policy 0, policy_version 1326393 (0.0010) [2023-12-28 04:47:33,955][106226] Updated weights for policy 0, policy_version 1326403 (0.0006) [2023-12-28 04:47:34,020][106226] Updated weights for policy 0, policy_version 1326413 (0.0005) [2023-12-28 04:47:34,521][106225] Updated weights for policy 1, policy_version 1329820 (0.0009) [2023-12-28 04:47:34,578][106225] Updated weights for policy 1, policy_version 1329830 (0.0011) [2023-12-28 04:47:34,608][106226] Updated weights for policy 0, policy_version 1326423 (0.0007) [2023-12-28 04:47:34,641][106225] Updated weights for policy 1, policy_version 1329840 (0.0009) [2023-12-28 04:47:34,674][106226] Updated weights for policy 0, policy_version 1326433 (0.0009) [2023-12-28 04:47:34,729][106226] Updated weights for policy 0, policy_version 1326443 (0.0009) [2023-12-28 04:47:35,294][106225] Updated weights for policy 1, policy_version 1329850 (0.0010) [2023-12-28 04:47:35,354][106225] Updated weights for policy 1, policy_version 1329860 (0.0010) [2023-12-28 04:47:35,370][106226] Updated weights for policy 0, policy_version 1326453 (0.0008) [2023-12-28 04:47:35,412][106225] Updated weights for policy 1, policy_version 1329870 (0.0008) [2023-12-28 04:47:35,432][106226] Updated weights for policy 0, policy_version 1326463 (0.0006) [2023-12-28 04:47:35,475][106225] Updated weights for policy 1, policy_version 1329880 (0.0005) [2023-12-28 04:47:35,485][106226] Updated weights for policy 0, policy_version 1326473 (0.0010) [2023-12-28 04:47:36,002][106225] Updated weights for policy 1, policy_version 1329890 (0.0008) [2023-12-28 04:47:36,056][106225] Updated weights for policy 1, policy_version 1329900 (0.0010) [2023-12-28 04:47:36,110][106225] Updated weights for policy 1, policy_version 1329910 (0.0010) [2023-12-28 04:47:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 680148992. Throughput: 0: 9941.8, 1: 9789.6. Samples: 680157044. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:47:36,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.473')] [2023-12-28 04:47:36,181][106226] Updated weights for policy 0, policy_version 1326483 (0.0009) [2023-12-28 04:47:36,247][106226] Updated weights for policy 0, policy_version 1326493 (0.0006) [2023-12-28 04:47:36,311][106226] Updated weights for policy 0, policy_version 1326503 (0.0007) [2023-12-28 04:47:36,859][106225] Updated weights for policy 1, policy_version 1329920 (0.0010) [2023-12-28 04:47:36,914][106225] Updated weights for policy 1, policy_version 1329930 (0.0010) [2023-12-28 04:47:36,969][106226] Updated weights for policy 0, policy_version 1326513 (0.0007) [2023-12-28 04:47:36,975][106225] Updated weights for policy 1, policy_version 1329940 (0.0010) [2023-12-28 04:47:37,036][106226] Updated weights for policy 0, policy_version 1326523 (0.0011) [2023-12-28 04:47:37,098][106226] Updated weights for policy 0, policy_version 1326533 (0.0011) [2023-12-28 04:47:37,150][106226] Updated weights for policy 0, policy_version 1326543 (0.0011) [2023-12-28 04:47:37,631][106225] Updated weights for policy 1, policy_version 1329950 (0.0010) [2023-12-28 04:47:37,682][106225] Updated weights for policy 1, policy_version 1329960 (0.0010) [2023-12-28 04:47:37,743][106225] Updated weights for policy 1, policy_version 1329970 (0.0010) [2023-12-28 04:47:37,891][106226] Updated weights for policy 0, policy_version 1326553 (0.0008) [2023-12-28 04:47:37,950][106226] Updated weights for policy 0, policy_version 1326563 (0.0008) [2023-12-28 04:47:38,012][106226] Updated weights for policy 0, policy_version 1326573 (0.0008) [2023-12-28 04:47:38,500][106225] Updated weights for policy 1, policy_version 1329980 (0.0010) [2023-12-28 04:47:38,557][106225] Updated weights for policy 1, policy_version 1329990 (0.0010) [2023-12-28 04:47:38,611][106225] Updated weights for policy 1, policy_version 1330000 (0.0010) [2023-12-28 04:47:38,762][106226] Updated weights for policy 0, policy_version 1326583 (0.0010) [2023-12-28 04:47:38,826][106226] Updated weights for policy 0, policy_version 1326593 (0.0011) [2023-12-28 04:47:38,886][106226] Updated weights for policy 0, policy_version 1326603 (0.0011) [2023-12-28 04:47:39,295][106225] Updated weights for policy 1, policy_version 1330010 (0.0010) [2023-12-28 04:47:39,348][106225] Updated weights for policy 1, policy_version 1330020 (0.0008) [2023-12-28 04:47:39,422][106225] Updated weights for policy 1, policy_version 1330030 (0.0008) [2023-12-28 04:47:39,474][106225] Updated weights for policy 1, policy_version 1330040 (0.0008) [2023-12-28 04:47:39,591][106226] Updated weights for policy 0, policy_version 1326613 (0.0010) [2023-12-28 04:47:39,657][106226] Updated weights for policy 0, policy_version 1326623 (0.0008) [2023-12-28 04:47:39,729][106226] Updated weights for policy 0, policy_version 1326633 (0.0008) [2023-12-28 04:47:40,245][106225] Updated weights for policy 1, policy_version 1330050 (0.0008) [2023-12-28 04:47:40,314][106225] Updated weights for policy 1, policy_version 1330060 (0.0008) [2023-12-28 04:47:40,380][106225] Updated weights for policy 1, policy_version 1330070 (0.0007) [2023-12-28 04:47:40,494][106226] Updated weights for policy 0, policy_version 1326643 (0.0009) [2023-12-28 04:47:40,553][106226] Updated weights for policy 0, policy_version 1326653 (0.0009) [2023-12-28 04:47:40,612][106226] Updated weights for policy 0, policy_version 1326663 (0.0006) [2023-12-28 04:47:41,063][106225] Updated weights for policy 1, policy_version 1330080 (0.0007) [2023-12-28 04:47:41,138][106225] Updated weights for policy 1, policy_version 1330090 (0.0008) [2023-12-28 04:47:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.2, 300 sec: 19660.8). Total num frames: 680239104. Throughput: 0: 9939.0, 1: 9818.0. Samples: 680215404. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:47:41,176][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.726')] [2023-12-28 04:47:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001326672_339689472.pth... [2023-12-28 04:47:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001325520_339394560.pth [2023-12-28 04:47:41,212][106225] Updated weights for policy 1, policy_version 1330100 (0.0008) [2023-12-28 04:47:41,234][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001330104_340557824.pth... [2023-12-28 04:47:41,238][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001328920_340254720.pth [2023-12-28 04:47:41,411][106226] Updated weights for policy 0, policy_version 1326673 (0.0008) [2023-12-28 04:47:41,465][106226] Updated weights for policy 0, policy_version 1326683 (0.0009) [2023-12-28 04:47:41,517][106226] Updated weights for policy 0, policy_version 1326693 (0.0008) [2023-12-28 04:47:41,576][106226] Updated weights for policy 0, policy_version 1326703 (0.0006) [2023-12-28 04:47:42,017][106225] Updated weights for policy 1, policy_version 1330110 (0.0010) [2023-12-28 04:47:42,083][106225] Updated weights for policy 1, policy_version 1330120 (0.0011) [2023-12-28 04:47:42,154][106225] Updated weights for policy 1, policy_version 1330130 (0.0010) [2023-12-28 04:47:42,331][106226] Updated weights for policy 0, policy_version 1326713 (0.0007) [2023-12-28 04:47:42,400][106226] Updated weights for policy 0, policy_version 1326723 (0.0007) [2023-12-28 04:47:42,466][106226] Updated weights for policy 0, policy_version 1326733 (0.0006) [2023-12-28 04:47:42,858][106225] Updated weights for policy 1, policy_version 1330140 (0.0007) [2023-12-28 04:47:42,918][106225] Updated weights for policy 1, policy_version 1330150 (0.0006) [2023-12-28 04:47:42,979][106225] Updated weights for policy 1, policy_version 1330160 (0.0008) [2023-12-28 04:47:43,102][106226] Updated weights for policy 0, policy_version 1326743 (0.0010) [2023-12-28 04:47:43,165][106226] Updated weights for policy 0, policy_version 1326753 (0.0006) [2023-12-28 04:47:43,223][106226] Updated weights for policy 0, policy_version 1326763 (0.0010) [2023-12-28 04:47:43,606][106225] Updated weights for policy 1, policy_version 1330170 (0.0007) [2023-12-28 04:47:43,663][106225] Updated weights for policy 1, policy_version 1330180 (0.0007) [2023-12-28 04:47:43,717][106225] Updated weights for policy 1, policy_version 1330190 (0.0005) [2023-12-28 04:47:43,771][106225] Updated weights for policy 1, policy_version 1330200 (0.0006) [2023-12-28 04:47:43,801][106226] Updated weights for policy 0, policy_version 1326773 (0.0010) [2023-12-28 04:47:43,865][106226] Updated weights for policy 0, policy_version 1326783 (0.0008) [2023-12-28 04:47:43,928][106226] Updated weights for policy 0, policy_version 1326793 (0.0008) [2023-12-28 04:47:44,430][106225] Updated weights for policy 1, policy_version 1330210 (0.0008) [2023-12-28 04:47:44,489][106225] Updated weights for policy 1, policy_version 1330220 (0.0008) [2023-12-28 04:47:44,546][106225] Updated weights for policy 1, policy_version 1330230 (0.0008) [2023-12-28 04:47:44,614][106226] Updated weights for policy 0, policy_version 1326803 (0.0008) [2023-12-28 04:47:44,676][106226] Updated weights for policy 0, policy_version 1326813 (0.0006) [2023-12-28 04:47:44,731][106226] Updated weights for policy 0, policy_version 1326823 (0.0005) [2023-12-28 04:47:45,277][106225] Updated weights for policy 1, policy_version 1330240 (0.0007) [2023-12-28 04:47:45,337][106225] Updated weights for policy 1, policy_version 1330250 (0.0006) [2023-12-28 04:47:45,398][106225] Updated weights for policy 1, policy_version 1330260 (0.0008) [2023-12-28 04:47:45,435][106226] Updated weights for policy 0, policy_version 1326833 (0.0008) [2023-12-28 04:47:45,501][106226] Updated weights for policy 0, policy_version 1326843 (0.0010) [2023-12-28 04:47:45,564][106226] Updated weights for policy 0, policy_version 1326853 (0.0011) [2023-12-28 04:47:45,636][106226] Updated weights for policy 0, policy_version 1326863 (0.0011) [2023-12-28 04:47:46,090][106225] Updated weights for policy 1, policy_version 1330270 (0.0007) [2023-12-28 04:47:46,146][106225] Updated weights for policy 1, policy_version 1330280 (0.0007) [2023-12-28 04:47:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 680337408. Throughput: 0: 9924.9, 1: 9886.0. Samples: 680332876. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:47:46,176][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.740')] [2023-12-28 04:47:46,202][106225] Updated weights for policy 1, policy_version 1330290 (0.0007) [2023-12-28 04:47:46,320][106226] Updated weights for policy 0, policy_version 1326873 (0.0011) [2023-12-28 04:47:46,382][106226] Updated weights for policy 0, policy_version 1326883 (0.0010) [2023-12-28 04:47:46,436][106226] Updated weights for policy 0, policy_version 1326893 (0.0005) [2023-12-28 04:47:46,967][106226] Updated weights for policy 0, policy_version 1326903 (0.0006) [2023-12-28 04:47:47,018][106225] Updated weights for policy 1, policy_version 1330300 (0.0008) [2023-12-28 04:47:47,025][106226] Updated weights for policy 0, policy_version 1326913 (0.0011) [2023-12-28 04:47:47,073][106225] Updated weights for policy 1, policy_version 1330310 (0.0007) [2023-12-28 04:47:47,082][106226] Updated weights for policy 0, policy_version 1326923 (0.0011) [2023-12-28 04:47:47,130][106225] Updated weights for policy 1, policy_version 1330320 (0.0005) [2023-12-28 04:47:47,794][106226] Updated weights for policy 0, policy_version 1326933 (0.0011) [2023-12-28 04:47:47,823][106225] Updated weights for policy 1, policy_version 1330330 (0.0006) [2023-12-28 04:47:47,851][106226] Updated weights for policy 0, policy_version 1326943 (0.0006) [2023-12-28 04:47:47,880][106225] Updated weights for policy 1, policy_version 1330340 (0.0009) [2023-12-28 04:47:47,907][106226] Updated weights for policy 0, policy_version 1326953 (0.0005) [2023-12-28 04:47:47,939][106225] Updated weights for policy 1, policy_version 1330350 (0.0008) [2023-12-28 04:47:47,991][106225] Updated weights for policy 1, policy_version 1330360 (0.0008) [2023-12-28 04:47:48,507][106226] Updated weights for policy 0, policy_version 1326963 (0.0007) [2023-12-28 04:47:48,562][106226] Updated weights for policy 0, policy_version 1326973 (0.0011) [2023-12-28 04:47:48,622][106226] Updated weights for policy 0, policy_version 1326983 (0.0011) [2023-12-28 04:47:48,763][106225] Updated weights for policy 1, policy_version 1330370 (0.0008) [2023-12-28 04:47:48,820][106225] Updated weights for policy 1, policy_version 1330380 (0.0007) [2023-12-28 04:47:48,874][106225] Updated weights for policy 1, policy_version 1330390 (0.0008) [2023-12-28 04:47:49,318][106226] Updated weights for policy 0, policy_version 1326993 (0.0010) [2023-12-28 04:47:49,387][106226] Updated weights for policy 0, policy_version 1327003 (0.0010) [2023-12-28 04:47:49,441][106226] Updated weights for policy 0, policy_version 1327013 (0.0010) [2023-12-28 04:47:49,502][106226] Updated weights for policy 0, policy_version 1327023 (0.0011) [2023-12-28 04:47:49,648][106225] Updated weights for policy 1, policy_version 1330400 (0.0008) [2023-12-28 04:47:49,708][106225] Updated weights for policy 1, policy_version 1330410 (0.0007) [2023-12-28 04:47:49,774][106225] Updated weights for policy 1, policy_version 1330420 (0.0008) [2023-12-28 04:47:50,289][106226] Updated weights for policy 0, policy_version 1327033 (0.0009) [2023-12-28 04:47:50,358][106226] Updated weights for policy 0, policy_version 1327043 (0.0009) [2023-12-28 04:47:50,422][106226] Updated weights for policy 0, policy_version 1327053 (0.0009) [2023-12-28 04:47:50,543][106225] Updated weights for policy 1, policy_version 1330430 (0.0009) [2023-12-28 04:47:50,626][106225] Updated weights for policy 1, policy_version 1330440 (0.0006) [2023-12-28 04:47:50,692][106225] Updated weights for policy 1, policy_version 1330450 (0.0008) [2023-12-28 04:47:51,063][106226] Updated weights for policy 0, policy_version 1327063 (0.0009) [2023-12-28 04:47:51,130][106226] Updated weights for policy 0, policy_version 1327073 (0.0008) [2023-12-28 04:47:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 680435712. Throughput: 0: 9948.6, 1: 9819.7. Samples: 680449660. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:47:51,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-5.078')] [2023-12-28 04:47:51,189][106226] Updated weights for policy 0, policy_version 1327083 (0.0008) [2023-12-28 04:47:51,435][106225] Updated weights for policy 1, policy_version 1330460 (0.0008) [2023-12-28 04:47:51,499][106225] Updated weights for policy 1, policy_version 1330470 (0.0007) [2023-12-28 04:47:51,556][106225] Updated weights for policy 1, policy_version 1330480 (0.0008) [2023-12-28 04:47:51,905][106226] Updated weights for policy 0, policy_version 1327093 (0.0008) [2023-12-28 04:47:51,967][106226] Updated weights for policy 0, policy_version 1327103 (0.0008) [2023-12-28 04:47:52,030][106226] Updated weights for policy 0, policy_version 1327113 (0.0008) [2023-12-28 04:47:52,281][106225] Updated weights for policy 1, policy_version 1330490 (0.0008) [2023-12-28 04:47:52,340][106225] Updated weights for policy 1, policy_version 1330500 (0.0009) [2023-12-28 04:47:52,401][106225] Updated weights for policy 1, policy_version 1330510 (0.0009) [2023-12-28 04:47:52,452][106225] Updated weights for policy 1, policy_version 1330520 (0.0008) [2023-12-28 04:47:52,685][106226] Updated weights for policy 0, policy_version 1327123 (0.0006) [2023-12-28 04:47:52,753][106226] Updated weights for policy 0, policy_version 1327133 (0.0010) [2023-12-28 04:47:52,823][106226] Updated weights for policy 0, policy_version 1327143 (0.0011) [2023-12-28 04:47:53,176][106225] Updated weights for policy 1, policy_version 1330530 (0.0008) [2023-12-28 04:47:53,240][106225] Updated weights for policy 1, policy_version 1330540 (0.0010) [2023-12-28 04:47:53,302][106225] Updated weights for policy 1, policy_version 1330550 (0.0008) [2023-12-28 04:47:53,478][106226] Updated weights for policy 0, policy_version 1327153 (0.0011) [2023-12-28 04:47:53,528][106226] Updated weights for policy 0, policy_version 1327163 (0.0010) [2023-12-28 04:47:53,593][106226] Updated weights for policy 0, policy_version 1327173 (0.0006) [2023-12-28 04:47:53,661][106226] Updated weights for policy 0, policy_version 1327183 (0.0005) [2023-12-28 04:47:54,088][106225] Updated weights for policy 1, policy_version 1330560 (0.0008) [2023-12-28 04:47:54,138][106225] Updated weights for policy 1, policy_version 1330570 (0.0008) [2023-12-28 04:47:54,198][106225] Updated weights for policy 1, policy_version 1330580 (0.0008) [2023-12-28 04:47:54,244][106226] Updated weights for policy 0, policy_version 1327193 (0.0009) [2023-12-28 04:47:54,300][106226] Updated weights for policy 0, policy_version 1327203 (0.0010) [2023-12-28 04:47:54,356][106226] Updated weights for policy 0, policy_version 1327213 (0.0010) [2023-12-28 04:47:54,788][106225] Updated weights for policy 1, policy_version 1330590 (0.0006) [2023-12-28 04:47:54,840][106225] Updated weights for policy 1, policy_version 1330600 (0.0005) [2023-12-28 04:47:54,901][106225] Updated weights for policy 1, policy_version 1330610 (0.0008) [2023-12-28 04:47:54,954][106226] Updated weights for policy 0, policy_version 1327223 (0.0010) [2023-12-28 04:47:55,023][106226] Updated weights for policy 0, policy_version 1327233 (0.0008) [2023-12-28 04:47:55,086][106226] Updated weights for policy 0, policy_version 1327243 (0.0006) [2023-12-28 04:47:55,605][106225] Updated weights for policy 1, policy_version 1330620 (0.0007) [2023-12-28 04:47:55,666][106225] Updated weights for policy 1, policy_version 1330630 (0.0008) [2023-12-28 04:47:55,719][106225] Updated weights for policy 1, policy_version 1330640 (0.0008) [2023-12-28 04:47:55,757][106226] Updated weights for policy 0, policy_version 1327253 (0.0011) [2023-12-28 04:47:55,808][106226] Updated weights for policy 0, policy_version 1327263 (0.0010) [2023-12-28 04:47:55,855][106226] Updated weights for policy 0, policy_version 1327273 (0.0010) [2023-12-28 04:47:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 680542208. Throughput: 0: 9963.0, 1: 9735.5. Samples: 680508784. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:47:56,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-5.015')] [2023-12-28 04:47:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001330648_340697088.pth... [2023-12-28 04:47:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001327280_339845120.pth... [2023-12-28 04:47:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001329496_340402176.pth [2023-12-28 04:47:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001326096_339542016.pth [2023-12-28 04:47:56,452][106225] Updated weights for policy 1, policy_version 1330650 (0.0007) [2023-12-28 04:47:56,503][106225] Updated weights for policy 1, policy_version 1330660 (0.0008) [2023-12-28 04:47:56,557][106225] Updated weights for policy 1, policy_version 1330670 (0.0007) [2023-12-28 04:47:56,584][106226] Updated weights for policy 0, policy_version 1327283 (0.0011) [2023-12-28 04:47:56,605][106225] Updated weights for policy 1, policy_version 1330680 (0.0006) [2023-12-28 04:47:56,644][106226] Updated weights for policy 0, policy_version 1327293 (0.0011) [2023-12-28 04:47:56,694][106226] Updated weights for policy 0, policy_version 1327303 (0.0010) [2023-12-28 04:47:57,348][106225] Updated weights for policy 1, policy_version 1330690 (0.0009) [2023-12-28 04:47:57,401][106225] Updated weights for policy 1, policy_version 1330700 (0.0008) [2023-12-28 04:47:57,402][106226] Updated weights for policy 0, policy_version 1327313 (0.0010) [2023-12-28 04:47:57,457][106225] Updated weights for policy 1, policy_version 1330710 (0.0009) [2023-12-28 04:47:57,461][106226] Updated weights for policy 0, policy_version 1327323 (0.0005) [2023-12-28 04:47:57,506][106226] Updated weights for policy 0, policy_version 1327333 (0.0005) [2023-12-28 04:47:57,559][106226] Updated weights for policy 0, policy_version 1327343 (0.0005) [2023-12-28 04:47:58,040][106225] Updated weights for policy 1, policy_version 1330720 (0.0008) [2023-12-28 04:47:58,067][106226] Updated weights for policy 0, policy_version 1327353 (0.0010) [2023-12-28 04:47:58,100][106225] Updated weights for policy 1, policy_version 1330730 (0.0006) [2023-12-28 04:47:58,125][106226] Updated weights for policy 0, policy_version 1327363 (0.0011) [2023-12-28 04:47:58,160][106225] Updated weights for policy 1, policy_version 1330740 (0.0005) [2023-12-28 04:47:58,184][106226] Updated weights for policy 0, policy_version 1327373 (0.0010) [2023-12-28 04:47:59,016][106225] Updated weights for policy 1, policy_version 1330750 (0.0009) [2023-12-28 04:47:59,019][106226] Updated weights for policy 0, policy_version 1327383 (0.0008) [2023-12-28 04:47:59,079][106225] Updated weights for policy 1, policy_version 1330760 (0.0008) [2023-12-28 04:47:59,083][106226] Updated weights for policy 0, policy_version 1327393 (0.0008) [2023-12-28 04:47:59,139][106225] Updated weights for policy 1, policy_version 1330770 (0.0008) [2023-12-28 04:47:59,142][106226] Updated weights for policy 0, policy_version 1327403 (0.0008) [2023-12-28 04:47:59,884][106226] Updated weights for policy 0, policy_version 1327413 (0.0008) [2023-12-28 04:47:59,942][106225] Updated weights for policy 1, policy_version 1330780 (0.0008) [2023-12-28 04:47:59,944][106226] Updated weights for policy 0, policy_version 1327423 (0.0008) [2023-12-28 04:47:59,999][106225] Updated weights for policy 1, policy_version 1330790 (0.0008) [2023-12-28 04:48:00,003][106226] Updated weights for policy 0, policy_version 1327433 (0.0008) [2023-12-28 04:48:00,053][106225] Updated weights for policy 1, policy_version 1330800 (0.0010) [2023-12-28 04:48:00,634][106226] Updated weights for policy 0, policy_version 1327443 (0.0007) [2023-12-28 04:48:00,695][106226] Updated weights for policy 0, policy_version 1327453 (0.0007) [2023-12-28 04:48:00,740][106225] Updated weights for policy 1, policy_version 1330810 (0.0010) [2023-12-28 04:48:00,756][106226] Updated weights for policy 0, policy_version 1327463 (0.0008) [2023-12-28 04:48:00,797][106225] Updated weights for policy 1, policy_version 1330820 (0.0005) [2023-12-28 04:48:00,855][106225] Updated weights for policy 1, policy_version 1330830 (0.0005) [2023-12-28 04:48:00,909][106225] Updated weights for policy 1, policy_version 1330840 (0.0006) [2023-12-28 04:48:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 680640512. Throughput: 0: 10020.6, 1: 9719.9. Samples: 680627248. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:01,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.818')] [2023-12-28 04:48:01,445][106226] Updated weights for policy 0, policy_version 1327473 (0.0008) [2023-12-28 04:48:01,506][106226] Updated weights for policy 0, policy_version 1327483 (0.0009) [2023-12-28 04:48:01,568][106226] Updated weights for policy 0, policy_version 1327493 (0.0007) [2023-12-28 04:48:01,593][106225] Updated weights for policy 1, policy_version 1330850 (0.0006) [2023-12-28 04:48:01,629][106226] Updated weights for policy 0, policy_version 1327503 (0.0007) [2023-12-28 04:48:01,661][106225] Updated weights for policy 1, policy_version 1330860 (0.0007) [2023-12-28 04:48:01,716][106225] Updated weights for policy 1, policy_version 1330870 (0.0009) [2023-12-28 04:48:02,369][106225] Updated weights for policy 1, policy_version 1330880 (0.0008) [2023-12-28 04:48:02,377][106226] Updated weights for policy 0, policy_version 1327513 (0.0008) [2023-12-28 04:48:02,431][106225] Updated weights for policy 1, policy_version 1330890 (0.0007) [2023-12-28 04:48:02,441][106226] Updated weights for policy 0, policy_version 1327523 (0.0007) [2023-12-28 04:48:02,492][106225] Updated weights for policy 1, policy_version 1330900 (0.0008) [2023-12-28 04:48:02,501][106226] Updated weights for policy 0, policy_version 1327533 (0.0006) [2023-12-28 04:48:03,142][106225] Updated weights for policy 1, policy_version 1330910 (0.0005) [2023-12-28 04:48:03,198][106225] Updated weights for policy 1, policy_version 1330920 (0.0005) [2023-12-28 04:48:03,239][106226] Updated weights for policy 0, policy_version 1327543 (0.0009) [2023-12-28 04:48:03,254][106225] Updated weights for policy 1, policy_version 1330930 (0.0005) [2023-12-28 04:48:03,305][106226] Updated weights for policy 0, policy_version 1327553 (0.0011) [2023-12-28 04:48:03,363][106226] Updated weights for policy 0, policy_version 1327563 (0.0010) [2023-12-28 04:48:03,757][106225] Updated weights for policy 1, policy_version 1330940 (0.0005) [2023-12-28 04:48:03,825][106225] Updated weights for policy 1, policy_version 1330950 (0.0005) [2023-12-28 04:48:03,890][106225] Updated weights for policy 1, policy_version 1330960 (0.0006) [2023-12-28 04:48:04,005][106226] Updated weights for policy 0, policy_version 1327573 (0.0009) [2023-12-28 04:48:04,073][106226] Updated weights for policy 0, policy_version 1327583 (0.0006) [2023-12-28 04:48:04,139][106226] Updated weights for policy 0, policy_version 1327593 (0.0008) [2023-12-28 04:48:04,502][106225] Updated weights for policy 1, policy_version 1330970 (0.0009) [2023-12-28 04:48:04,560][106225] Updated weights for policy 1, policy_version 1330980 (0.0008) [2023-12-28 04:48:04,627][106225] Updated weights for policy 1, policy_version 1330990 (0.0009) [2023-12-28 04:48:04,684][106225] Updated weights for policy 1, policy_version 1331000 (0.0009) [2023-12-28 04:48:04,836][106226] Updated weights for policy 0, policy_version 1327603 (0.0009) [2023-12-28 04:48:04,888][106226] Updated weights for policy 0, policy_version 1327613 (0.0008) [2023-12-28 04:48:04,946][106226] Updated weights for policy 0, policy_version 1327623 (0.0008) [2023-12-28 04:48:05,333][106225] Updated weights for policy 1, policy_version 1331010 (0.0005) [2023-12-28 04:48:05,380][106225] Updated weights for policy 1, policy_version 1331020 (0.0008) [2023-12-28 04:48:05,430][106225] Updated weights for policy 1, policy_version 1331030 (0.0008) [2023-12-28 04:48:05,724][106226] Updated weights for policy 0, policy_version 1327633 (0.0009) [2023-12-28 04:48:05,777][106226] Updated weights for policy 0, policy_version 1327643 (0.0008) [2023-12-28 04:48:05,826][106226] Updated weights for policy 0, policy_version 1327653 (0.0009) [2023-12-28 04:48:05,882][106226] Updated weights for policy 0, policy_version 1327663 (0.0009) [2023-12-28 04:48:06,048][106225] Updated weights for policy 1, policy_version 1331040 (0.0006) [2023-12-28 04:48:06,121][106225] Updated weights for policy 1, policy_version 1331051 (0.0006) [2023-12-28 04:48:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 680738816. Throughput: 0: 10010.0, 1: 9879.0. Samples: 680749576. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:06,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-4.856')] [2023-12-28 04:48:06,185][106225] Updated weights for policy 1, policy_version 1331061 (0.0007) [2023-12-28 04:48:06,695][106226] Updated weights for policy 0, policy_version 1327673 (0.0008) [2023-12-28 04:48:06,746][106226] Updated weights for policy 0, policy_version 1327683 (0.0008) [2023-12-28 04:48:06,827][106226] Updated weights for policy 0, policy_version 1327693 (0.0008) [2023-12-28 04:48:06,881][106225] Updated weights for policy 1, policy_version 1331071 (0.0009) [2023-12-28 04:48:06,936][106225] Updated weights for policy 1, policy_version 1331081 (0.0010) [2023-12-28 04:48:06,983][106225] Updated weights for policy 1, policy_version 1331091 (0.0010) [2023-12-28 04:48:07,555][106226] Updated weights for policy 0, policy_version 1327703 (0.0007) [2023-12-28 04:48:07,613][106226] Updated weights for policy 0, policy_version 1327713 (0.0008) [2023-12-28 04:48:07,660][106226] Updated weights for policy 0, policy_version 1327723 (0.0008) [2023-12-28 04:48:07,726][106225] Updated weights for policy 1, policy_version 1331101 (0.0011) [2023-12-28 04:48:07,777][106225] Updated weights for policy 1, policy_version 1331111 (0.0010) [2023-12-28 04:48:07,820][106225] Updated weights for policy 1, policy_version 1331121 (0.0010) [2023-12-28 04:48:08,436][106226] Updated weights for policy 0, policy_version 1327733 (0.0008) [2023-12-28 04:48:08,498][106226] Updated weights for policy 0, policy_version 1327743 (0.0008) [2023-12-28 04:48:08,545][106226] Updated weights for policy 0, policy_version 1327753 (0.0008) [2023-12-28 04:48:08,576][106225] Updated weights for policy 1, policy_version 1331131 (0.0010) [2023-12-28 04:48:08,630][106225] Updated weights for policy 1, policy_version 1331141 (0.0011) [2023-12-28 04:48:08,682][106225] Updated weights for policy 1, policy_version 1331151 (0.0010) [2023-12-28 04:48:09,305][106226] Updated weights for policy 0, policy_version 1327763 (0.0008) [2023-12-28 04:48:09,379][106226] Updated weights for policy 0, policy_version 1327773 (0.0007) [2023-12-28 04:48:09,441][106226] Updated weights for policy 0, policy_version 1327783 (0.0007) [2023-12-28 04:48:09,448][106225] Updated weights for policy 1, policy_version 1331161 (0.0010) [2023-12-28 04:48:09,494][106225] Updated weights for policy 1, policy_version 1331171 (0.0010) [2023-12-28 04:48:09,552][106225] Updated weights for policy 1, policy_version 1331181 (0.0010) [2023-12-28 04:48:09,610][106225] Updated weights for policy 1, policy_version 1331191 (0.0011) [2023-12-28 04:48:10,196][106226] Updated weights for policy 0, policy_version 1327793 (0.0008) [2023-12-28 04:48:10,261][106226] Updated weights for policy 0, policy_version 1327803 (0.0006) [2023-12-28 04:48:10,330][106226] Updated weights for policy 0, policy_version 1327813 (0.0006) [2023-12-28 04:48:10,331][106225] Updated weights for policy 1, policy_version 1331201 (0.0010) [2023-12-28 04:48:10,394][106226] Updated weights for policy 0, policy_version 1327823 (0.0007) [2023-12-28 04:48:10,397][106225] Updated weights for policy 1, policy_version 1331211 (0.0010) [2023-12-28 04:48:10,465][106225] Updated weights for policy 1, policy_version 1331221 (0.0011) [2023-12-28 04:48:11,007][106226] Updated weights for policy 0, policy_version 1327833 (0.0007) [2023-12-28 04:48:11,073][106226] Updated weights for policy 0, policy_version 1327843 (0.0009) [2023-12-28 04:48:11,138][106226] Updated weights for policy 0, policy_version 1327853 (0.0009) [2023-12-28 04:48:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 680837120. Throughput: 0: 9983.9, 1: 9896.6. Samples: 680806948. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:11,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.829')] [2023-12-28 04:48:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001327856_339992576.pth... [2023-12-28 04:48:11,185][106225] Updated weights for policy 1, policy_version 1331231 (0.0010) [2023-12-28 04:48:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001326672_339689472.pth [2023-12-28 04:48:11,244][106225] Updated weights for policy 1, policy_version 1331241 (0.0009) [2023-12-28 04:48:11,309][106225] Updated weights for policy 1, policy_version 1331251 (0.0009) [2023-12-28 04:48:11,341][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001331256_340852736.pth... [2023-12-28 04:48:11,345][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001330104_340557824.pth [2023-12-28 04:48:11,877][106226] Updated weights for policy 0, policy_version 1327863 (0.0007) [2023-12-28 04:48:11,933][106226] Updated weights for policy 0, policy_version 1327873 (0.0009) [2023-12-28 04:48:11,998][106226] Updated weights for policy 0, policy_version 1327883 (0.0009) [2023-12-28 04:48:12,068][106225] Updated weights for policy 1, policy_version 1331261 (0.0009) [2023-12-28 04:48:12,132][106225] Updated weights for policy 1, policy_version 1331271 (0.0008) [2023-12-28 04:48:12,192][106225] Updated weights for policy 1, policy_version 1331281 (0.0008) [2023-12-28 04:48:12,652][106226] Updated weights for policy 0, policy_version 1327893 (0.0008) [2023-12-28 04:48:12,707][106226] Updated weights for policy 0, policy_version 1327903 (0.0007) [2023-12-28 04:48:12,762][106226] Updated weights for policy 0, policy_version 1327913 (0.0008) [2023-12-28 04:48:12,911][106225] Updated weights for policy 1, policy_version 1331291 (0.0009) [2023-12-28 04:48:12,960][106225] Updated weights for policy 1, policy_version 1331301 (0.0008) [2023-12-28 04:48:13,019][106225] Updated weights for policy 1, policy_version 1331311 (0.0009) [2023-12-28 04:48:13,355][106226] Updated weights for policy 0, policy_version 1327923 (0.0008) [2023-12-28 04:48:13,405][106226] Updated weights for policy 0, policy_version 1327933 (0.0008) [2023-12-28 04:48:13,452][106226] Updated weights for policy 0, policy_version 1327943 (0.0008) [2023-12-28 04:48:13,714][106225] Updated weights for policy 1, policy_version 1331321 (0.0008) [2023-12-28 04:48:13,773][106225] Updated weights for policy 1, policy_version 1331331 (0.0006) [2023-12-28 04:48:13,830][106225] Updated weights for policy 1, policy_version 1331341 (0.0010) [2023-12-28 04:48:13,883][106225] Updated weights for policy 1, policy_version 1331351 (0.0010) [2023-12-28 04:48:14,216][106226] Updated weights for policy 0, policy_version 1327953 (0.0008) [2023-12-28 04:48:14,269][106226] Updated weights for policy 0, policy_version 1327963 (0.0007) [2023-12-28 04:48:14,320][106226] Updated weights for policy 0, policy_version 1327973 (0.0008) [2023-12-28 04:48:14,371][106226] Updated weights for policy 0, policy_version 1327983 (0.0007) [2023-12-28 04:48:14,565][106225] Updated weights for policy 1, policy_version 1331361 (0.0010) [2023-12-28 04:48:14,618][106225] Updated weights for policy 1, policy_version 1331371 (0.0010) [2023-12-28 04:48:14,674][106225] Updated weights for policy 1, policy_version 1331381 (0.0010) [2023-12-28 04:48:15,060][106226] Updated weights for policy 0, policy_version 1327993 (0.0007) [2023-12-28 04:48:15,121][106226] Updated weights for policy 0, policy_version 1328003 (0.0006) [2023-12-28 04:48:15,185][106226] Updated weights for policy 0, policy_version 1328013 (0.0007) [2023-12-28 04:48:15,432][106225] Updated weights for policy 1, policy_version 1331391 (0.0009) [2023-12-28 04:48:15,492][106225] Updated weights for policy 1, policy_version 1331401 (0.0007) [2023-12-28 04:48:15,555][106225] Updated weights for policy 1, policy_version 1331411 (0.0010) [2023-12-28 04:48:15,910][106226] Updated weights for policy 0, policy_version 1328023 (0.0008) [2023-12-28 04:48:15,973][106226] Updated weights for policy 0, policy_version 1328033 (0.0008) [2023-12-28 04:48:16,033][106226] Updated weights for policy 0, policy_version 1328043 (0.0008) [2023-12-28 04:48:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 680935424. Throughput: 0: 9932.9, 1: 9871.8. Samples: 680924232. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:16,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.728')] [2023-12-28 04:48:16,239][106225] Updated weights for policy 1, policy_version 1331421 (0.0010) [2023-12-28 04:48:16,296][106225] Updated weights for policy 1, policy_version 1331431 (0.0010) [2023-12-28 04:48:16,360][106225] Updated weights for policy 1, policy_version 1331441 (0.0008) [2023-12-28 04:48:16,686][106226] Updated weights for policy 0, policy_version 1328053 (0.0006) [2023-12-28 04:48:16,741][106226] Updated weights for policy 0, policy_version 1328063 (0.0007) [2023-12-28 04:48:16,793][106226] Updated weights for policy 0, policy_version 1328073 (0.0009) [2023-12-28 04:48:17,055][106225] Updated weights for policy 1, policy_version 1331451 (0.0009) [2023-12-28 04:48:17,107][106225] Updated weights for policy 1, policy_version 1331461 (0.0008) [2023-12-28 04:48:17,161][106225] Updated weights for policy 1, policy_version 1331471 (0.0008) [2023-12-28 04:48:17,485][106226] Updated weights for policy 0, policy_version 1328083 (0.0007) [2023-12-28 04:48:17,536][106226] Updated weights for policy 0, policy_version 1328093 (0.0005) [2023-12-28 04:48:17,594][106226] Updated weights for policy 0, policy_version 1328103 (0.0005) [2023-12-28 04:48:17,987][106225] Updated weights for policy 1, policy_version 1331481 (0.0008) [2023-12-28 04:48:18,039][106225] Updated weights for policy 1, policy_version 1331491 (0.0006) [2023-12-28 04:48:18,098][106225] Updated weights for policy 1, policy_version 1331501 (0.0005) [2023-12-28 04:48:18,156][106226] Updated weights for policy 0, policy_version 1328113 (0.0005) [2023-12-28 04:48:18,157][106225] Updated weights for policy 1, policy_version 1331511 (0.0005) [2023-12-28 04:48:18,211][106226] Updated weights for policy 0, policy_version 1328123 (0.0008) [2023-12-28 04:48:18,270][106226] Updated weights for policy 0, policy_version 1328133 (0.0009) [2023-12-28 04:48:18,332][106226] Updated weights for policy 0, policy_version 1328143 (0.0009) [2023-12-28 04:48:18,786][106225] Updated weights for policy 1, policy_version 1331521 (0.0008) [2023-12-28 04:48:18,842][106225] Updated weights for policy 1, policy_version 1331531 (0.0008) [2023-12-28 04:48:18,903][106225] Updated weights for policy 1, policy_version 1331541 (0.0008) [2023-12-28 04:48:19,069][106226] Updated weights for policy 0, policy_version 1328153 (0.0011) [2023-12-28 04:48:19,122][106226] Updated weights for policy 0, policy_version 1328163 (0.0011) [2023-12-28 04:48:19,169][106226] Updated weights for policy 0, policy_version 1328173 (0.0010) [2023-12-28 04:48:19,752][106225] Updated weights for policy 1, policy_version 1331551 (0.0008) [2023-12-28 04:48:19,806][106225] Updated weights for policy 1, policy_version 1331561 (0.0009) [2023-12-28 04:48:19,861][106226] Updated weights for policy 0, policy_version 1328183 (0.0009) [2023-12-28 04:48:19,883][106225] Updated weights for policy 1, policy_version 1331571 (0.0006) [2023-12-28 04:48:19,929][106226] Updated weights for policy 0, policy_version 1328193 (0.0009) [2023-12-28 04:48:20,000][106226] Updated weights for policy 0, policy_version 1328203 (0.0009) [2023-12-28 04:48:20,621][106225] Updated weights for policy 1, policy_version 1331581 (0.0008) [2023-12-28 04:48:20,680][106225] Updated weights for policy 1, policy_version 1331591 (0.0005) [2023-12-28 04:48:20,740][106225] Updated weights for policy 1, policy_version 1331601 (0.0007) [2023-12-28 04:48:20,745][106226] Updated weights for policy 0, policy_version 1328213 (0.0007) [2023-12-28 04:48:20,800][106226] Updated weights for policy 0, policy_version 1328223 (0.0009) [2023-12-28 04:48:20,859][106226] Updated weights for policy 0, policy_version 1328233 (0.0010) [2023-12-28 04:48:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 681033728. Throughput: 0: 9920.4, 1: 9718.6. Samples: 681040796. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:21,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.450')] [2023-12-28 04:48:21,514][106225] Updated weights for policy 1, policy_version 1331611 (0.0008) [2023-12-28 04:48:21,578][106225] Updated weights for policy 1, policy_version 1331621 (0.0009) [2023-12-28 04:48:21,646][106225] Updated weights for policy 1, policy_version 1331631 (0.0007) [2023-12-28 04:48:21,659][106226] Updated weights for policy 0, policy_version 1328243 (0.0009) [2023-12-28 04:48:21,711][106226] Updated weights for policy 0, policy_version 1328253 (0.0007) [2023-12-28 04:48:21,775][106226] Updated weights for policy 0, policy_version 1328263 (0.0008) [2023-12-28 04:48:22,365][106225] Updated weights for policy 1, policy_version 1331641 (0.0006) [2023-12-28 04:48:22,437][106225] Updated weights for policy 1, policy_version 1331651 (0.0010) [2023-12-28 04:48:22,497][106225] Updated weights for policy 1, policy_version 1331661 (0.0008) [2023-12-28 04:48:22,531][106226] Updated weights for policy 0, policy_version 1328273 (0.0008) [2023-12-28 04:48:22,557][106225] Updated weights for policy 1, policy_version 1331671 (0.0007) [2023-12-28 04:48:22,588][106226] Updated weights for policy 0, policy_version 1328283 (0.0009) [2023-12-28 04:48:22,650][106226] Updated weights for policy 0, policy_version 1328293 (0.0007) [2023-12-28 04:48:22,712][106226] Updated weights for policy 0, policy_version 1328303 (0.0006) [2023-12-28 04:48:23,333][106225] Updated weights for policy 1, policy_version 1331681 (0.0009) [2023-12-28 04:48:23,352][106226] Updated weights for policy 0, policy_version 1328313 (0.0005) [2023-12-28 04:48:23,386][106225] Updated weights for policy 1, policy_version 1331691 (0.0008) [2023-12-28 04:48:23,411][106226] Updated weights for policy 0, policy_version 1328323 (0.0006) [2023-12-28 04:48:23,435][106225] Updated weights for policy 1, policy_version 1331701 (0.0007) [2023-12-28 04:48:23,466][106226] Updated weights for policy 0, policy_version 1328333 (0.0005) [2023-12-28 04:48:23,964][106226] Updated weights for policy 0, policy_version 1328343 (0.0005) [2023-12-28 04:48:24,028][106226] Updated weights for policy 0, policy_version 1328353 (0.0005) [2023-12-28 04:48:24,092][106226] Updated weights for policy 0, policy_version 1328363 (0.0009) [2023-12-28 04:48:24,136][106225] Updated weights for policy 1, policy_version 1331711 (0.0010) [2023-12-28 04:48:24,196][106225] Updated weights for policy 1, policy_version 1331721 (0.0010) [2023-12-28 04:48:24,253][106225] Updated weights for policy 1, policy_version 1331731 (0.0010) [2023-12-28 04:48:24,748][106226] Updated weights for policy 0, policy_version 1328373 (0.0010) [2023-12-28 04:48:24,798][106226] Updated weights for policy 0, policy_version 1328383 (0.0010) [2023-12-28 04:48:24,841][106226] Updated weights for policy 0, policy_version 1328393 (0.0010) [2023-12-28 04:48:24,931][106225] Updated weights for policy 1, policy_version 1331741 (0.0009) [2023-12-28 04:48:24,987][106225] Updated weights for policy 1, policy_version 1331751 (0.0008) [2023-12-28 04:48:25,048][106225] Updated weights for policy 1, policy_version 1331761 (0.0008) [2023-12-28 04:48:25,581][106226] Updated weights for policy 0, policy_version 1328403 (0.0010) [2023-12-28 04:48:25,641][106226] Updated weights for policy 0, policy_version 1328413 (0.0011) [2023-12-28 04:48:25,647][106225] Updated weights for policy 1, policy_version 1331771 (0.0007) [2023-12-28 04:48:25,697][106225] Updated weights for policy 1, policy_version 1331781 (0.0006) [2023-12-28 04:48:25,697][106226] Updated weights for policy 0, policy_version 1328423 (0.0010) [2023-12-28 04:48:25,740][106225] Updated weights for policy 1, policy_version 1331791 (0.0007) [2023-12-28 04:48:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19688.5). Total num frames: 681132032. Throughput: 0: 9998.5, 1: 9666.5. Samples: 681100328. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:26,176][105115] Avg episode reward: [(0, '-4.691'), (1, '-5.051')] [2023-12-28 04:48:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001331800_340992000.pth... [2023-12-28 04:48:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001328432_340140032.pth... [2023-12-28 04:48:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001330648_340697088.pth [2023-12-28 04:48:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001327280_339845120.pth [2023-12-28 04:48:26,387][106226] Updated weights for policy 0, policy_version 1328433 (0.0011) [2023-12-28 04:48:26,452][106226] Updated weights for policy 0, policy_version 1328443 (0.0009) [2023-12-28 04:48:26,507][106226] Updated weights for policy 0, policy_version 1328453 (0.0011) [2023-12-28 04:48:26,508][106225] Updated weights for policy 1, policy_version 1331801 (0.0007) [2023-12-28 04:48:26,561][106226] Updated weights for policy 0, policy_version 1328463 (0.0010) [2023-12-28 04:48:26,568][106225] Updated weights for policy 1, policy_version 1331811 (0.0007) [2023-12-28 04:48:26,617][106225] Updated weights for policy 1, policy_version 1331821 (0.0007) [2023-12-28 04:48:26,668][106225] Updated weights for policy 1, policy_version 1331831 (0.0007) [2023-12-28 04:48:27,253][106226] Updated weights for policy 0, policy_version 1328473 (0.0008) [2023-12-28 04:48:27,315][106226] Updated weights for policy 0, policy_version 1328483 (0.0010) [2023-12-28 04:48:27,373][106226] Updated weights for policy 0, policy_version 1328493 (0.0011) [2023-12-28 04:48:27,406][106225] Updated weights for policy 1, policy_version 1331841 (0.0006) [2023-12-28 04:48:27,456][106225] Updated weights for policy 1, policy_version 1331851 (0.0008) [2023-12-28 04:48:27,504][106225] Updated weights for policy 1, policy_version 1331861 (0.0007) [2023-12-28 04:48:28,055][106226] Updated weights for policy 0, policy_version 1328503 (0.0011) [2023-12-28 04:48:28,114][106226] Updated weights for policy 0, policy_version 1328513 (0.0010) [2023-12-28 04:48:28,172][106226] Updated weights for policy 0, policy_version 1328523 (0.0010) [2023-12-28 04:48:28,232][106225] Updated weights for policy 1, policy_version 1331871 (0.0007) [2023-12-28 04:48:28,289][106225] Updated weights for policy 1, policy_version 1331881 (0.0008) [2023-12-28 04:48:28,349][106225] Updated weights for policy 1, policy_version 1331891 (0.0007) [2023-12-28 04:48:28,890][106226] Updated weights for policy 0, policy_version 1328533 (0.0011) [2023-12-28 04:48:28,950][106226] Updated weights for policy 0, policy_version 1328543 (0.0010) [2023-12-28 04:48:29,013][106226] Updated weights for policy 0, policy_version 1328553 (0.0011) [2023-12-28 04:48:29,031][106225] Updated weights for policy 1, policy_version 1331901 (0.0008) [2023-12-28 04:48:29,086][106225] Updated weights for policy 1, policy_version 1331911 (0.0007) [2023-12-28 04:48:29,145][106225] Updated weights for policy 1, policy_version 1331921 (0.0008) [2023-12-28 04:48:29,730][106226] Updated weights for policy 0, policy_version 1328563 (0.0010) [2023-12-28 04:48:29,790][106226] Updated weights for policy 0, policy_version 1328573 (0.0009) [2023-12-28 04:48:29,865][106226] Updated weights for policy 0, policy_version 1328583 (0.0008) [2023-12-28 04:48:29,908][106225] Updated weights for policy 1, policy_version 1331931 (0.0008) [2023-12-28 04:48:29,971][106225] Updated weights for policy 1, policy_version 1331941 (0.0009) [2023-12-28 04:48:30,024][106225] Updated weights for policy 1, policy_version 1331951 (0.0008) [2023-12-28 04:48:30,618][106226] Updated weights for policy 0, policy_version 1328593 (0.0008) [2023-12-28 04:48:30,671][106226] Updated weights for policy 0, policy_version 1328603 (0.0009) [2023-12-28 04:48:30,726][106226] Updated weights for policy 0, policy_version 1328613 (0.0008) [2023-12-28 04:48:30,777][106225] Updated weights for policy 1, policy_version 1331961 (0.0008) [2023-12-28 04:48:30,786][106226] Updated weights for policy 0, policy_version 1328623 (0.0008) [2023-12-28 04:48:30,836][106225] Updated weights for policy 1, policy_version 1331971 (0.0008) [2023-12-28 04:48:30,880][106225] Updated weights for policy 1, policy_version 1331981 (0.0008) [2023-12-28 04:48:30,931][106225] Updated weights for policy 1, policy_version 1331991 (0.0008) [2023-12-28 04:48:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 681230336. Throughput: 0: 9978.6, 1: 9700.8. Samples: 681218448. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:31,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.799')] [2023-12-28 04:48:31,514][106226] Updated weights for policy 0, policy_version 1328633 (0.0006) [2023-12-28 04:48:31,561][106226] Updated weights for policy 0, policy_version 1328643 (0.0005) [2023-12-28 04:48:31,617][106226] Updated weights for policy 0, policy_version 1328653 (0.0006) [2023-12-28 04:48:31,651][106225] Updated weights for policy 1, policy_version 1332001 (0.0007) [2023-12-28 04:48:31,717][106225] Updated weights for policy 1, policy_version 1332011 (0.0009) [2023-12-28 04:48:31,778][106225] Updated weights for policy 1, policy_version 1332021 (0.0010) [2023-12-28 04:48:32,249][106226] Updated weights for policy 0, policy_version 1328663 (0.0008) [2023-12-28 04:48:32,317][106226] Updated weights for policy 0, policy_version 1328673 (0.0007) [2023-12-28 04:48:32,383][106226] Updated weights for policy 0, policy_version 1328683 (0.0006) [2023-12-28 04:48:32,537][106225] Updated weights for policy 1, policy_version 1332031 (0.0009) [2023-12-28 04:48:32,596][106225] Updated weights for policy 1, policy_version 1332041 (0.0008) [2023-12-28 04:48:32,663][106225] Updated weights for policy 1, policy_version 1332051 (0.0008) [2023-12-28 04:48:32,995][106226] Updated weights for policy 0, policy_version 1328693 (0.0006) [2023-12-28 04:48:33,063][106226] Updated weights for policy 0, policy_version 1328703 (0.0005) [2023-12-28 04:48:33,130][106226] Updated weights for policy 0, policy_version 1328713 (0.0005) [2023-12-28 04:48:33,398][106225] Updated weights for policy 1, policy_version 1332061 (0.0008) [2023-12-28 04:48:33,457][106225] Updated weights for policy 1, policy_version 1332071 (0.0008) [2023-12-28 04:48:33,515][106225] Updated weights for policy 1, policy_version 1332081 (0.0008) [2023-12-28 04:48:33,787][106226] Updated weights for policy 0, policy_version 1328723 (0.0009) [2023-12-28 04:48:33,840][106226] Updated weights for policy 0, policy_version 1328733 (0.0008) [2023-12-28 04:48:33,896][106226] Updated weights for policy 0, policy_version 1328743 (0.0009) [2023-12-28 04:48:34,157][106225] Updated weights for policy 1, policy_version 1332091 (0.0009) [2023-12-28 04:48:34,214][106225] Updated weights for policy 1, policy_version 1332101 (0.0008) [2023-12-28 04:48:34,276][106225] Updated weights for policy 1, policy_version 1332111 (0.0009) [2023-12-28 04:48:34,629][106226] Updated weights for policy 0, policy_version 1328753 (0.0008) [2023-12-28 04:48:34,698][106226] Updated weights for policy 0, policy_version 1328763 (0.0009) [2023-12-28 04:48:34,751][106226] Updated weights for policy 0, policy_version 1328773 (0.0008) [2023-12-28 04:48:34,797][106226] Updated weights for policy 0, policy_version 1328783 (0.0008) [2023-12-28 04:48:35,017][106225] Updated weights for policy 1, policy_version 1332121 (0.0009) [2023-12-28 04:48:35,062][106225] Updated weights for policy 1, policy_version 1332131 (0.0009) [2023-12-28 04:48:35,113][106225] Updated weights for policy 1, policy_version 1332141 (0.0008) [2023-12-28 04:48:35,166][106225] Updated weights for policy 1, policy_version 1332151 (0.0008) [2023-12-28 04:48:35,509][106226] Updated weights for policy 0, policy_version 1328793 (0.0006) [2023-12-28 04:48:35,571][106226] Updated weights for policy 0, policy_version 1328803 (0.0008) [2023-12-28 04:48:35,629][106226] Updated weights for policy 0, policy_version 1328813 (0.0008) [2023-12-28 04:48:35,933][106225] Updated weights for policy 1, policy_version 1332161 (0.0008) [2023-12-28 04:48:35,991][106225] Updated weights for policy 1, policy_version 1332171 (0.0008) [2023-12-28 04:48:36,050][106225] Updated weights for policy 1, policy_version 1332181 (0.0009) [2023-12-28 04:48:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 681328640. Throughput: 0: 9957.8, 1: 9748.5. Samples: 681336444. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:36,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-4.826')] [2023-12-28 04:48:36,311][106226] Updated weights for policy 0, policy_version 1328823 (0.0008) [2023-12-28 04:48:36,371][106226] Updated weights for policy 0, policy_version 1328833 (0.0009) [2023-12-28 04:48:36,430][106226] Updated weights for policy 0, policy_version 1328843 (0.0008) [2023-12-28 04:48:36,824][106225] Updated weights for policy 1, policy_version 1332191 (0.0008) [2023-12-28 04:48:36,882][106225] Updated weights for policy 1, policy_version 1332201 (0.0007) [2023-12-28 04:48:36,938][106225] Updated weights for policy 1, policy_version 1332211 (0.0007) [2023-12-28 04:48:37,172][106226] Updated weights for policy 0, policy_version 1328853 (0.0009) [2023-12-28 04:48:37,225][106226] Updated weights for policy 0, policy_version 1328863 (0.0009) [2023-12-28 04:48:37,282][106226] Updated weights for policy 0, policy_version 1328873 (0.0009) [2023-12-28 04:48:37,647][106225] Updated weights for policy 1, policy_version 1332221 (0.0007) [2023-12-28 04:48:37,699][106225] Updated weights for policy 1, policy_version 1332231 (0.0006) [2023-12-28 04:48:37,756][106225] Updated weights for policy 1, policy_version 1332241 (0.0008) [2023-12-28 04:48:38,020][106226] Updated weights for policy 0, policy_version 1328883 (0.0009) [2023-12-28 04:48:38,078][106226] Updated weights for policy 0, policy_version 1328893 (0.0009) [2023-12-28 04:48:38,139][106226] Updated weights for policy 0, policy_version 1328903 (0.0009) [2023-12-28 04:48:38,443][106225] Updated weights for policy 1, policy_version 1332251 (0.0009) [2023-12-28 04:48:38,508][106225] Updated weights for policy 1, policy_version 1332261 (0.0010) [2023-12-28 04:48:38,562][106225] Updated weights for policy 1, policy_version 1332271 (0.0008) [2023-12-28 04:48:38,840][106226] Updated weights for policy 0, policy_version 1328913 (0.0008) [2023-12-28 04:48:38,904][106226] Updated weights for policy 0, policy_version 1328923 (0.0010) [2023-12-28 04:48:38,972][106226] Updated weights for policy 0, policy_version 1328933 (0.0008) [2023-12-28 04:48:39,030][106226] Updated weights for policy 0, policy_version 1328943 (0.0009) [2023-12-28 04:48:39,218][106225] Updated weights for policy 1, policy_version 1332281 (0.0008) [2023-12-28 04:48:39,288][106225] Updated weights for policy 1, policy_version 1332291 (0.0009) [2023-12-28 04:48:39,358][106225] Updated weights for policy 1, policy_version 1332301 (0.0009) [2023-12-28 04:48:39,431][106225] Updated weights for policy 1, policy_version 1332311 (0.0011) [2023-12-28 04:48:39,872][106226] Updated weights for policy 0, policy_version 1328953 (0.0009) [2023-12-28 04:48:39,933][106226] Updated weights for policy 0, policy_version 1328963 (0.0008) [2023-12-28 04:48:39,999][106226] Updated weights for policy 0, policy_version 1328973 (0.0008) [2023-12-28 04:48:40,198][106225] Updated weights for policy 1, policy_version 1332321 (0.0011) [2023-12-28 04:48:40,264][106225] Updated weights for policy 1, policy_version 1332331 (0.0011) [2023-12-28 04:48:40,331][106225] Updated weights for policy 1, policy_version 1332341 (0.0008) [2023-12-28 04:48:40,747][106226] Updated weights for policy 0, policy_version 1328983 (0.0008) [2023-12-28 04:48:40,800][106226] Updated weights for policy 0, policy_version 1328993 (0.0008) [2023-12-28 04:48:40,860][106226] Updated weights for policy 0, policy_version 1329003 (0.0008) [2023-12-28 04:48:41,002][106225] Updated weights for policy 1, policy_version 1332351 (0.0010) [2023-12-28 04:48:41,073][106225] Updated weights for policy 1, policy_version 1332362 (0.0009) [2023-12-28 04:48:41,148][106225] Updated weights for policy 1, policy_version 1332372 (0.0007) [2023-12-28 04:48:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 681418752. Throughput: 0: 9894.5, 1: 9762.2. Samples: 681393336. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:41,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.433')] [2023-12-28 04:48:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001332376_341139456.pth... [2023-12-28 04:48:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001329008_340287488.pth... [2023-12-28 04:48:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001331256_340852736.pth [2023-12-28 04:48:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001327856_339992576.pth [2023-12-28 04:48:41,700][106226] Updated weights for policy 0, policy_version 1329013 (0.0007) [2023-12-28 04:48:41,765][106226] Updated weights for policy 0, policy_version 1329023 (0.0008) [2023-12-28 04:48:41,819][106226] Updated weights for policy 0, policy_version 1329033 (0.0011) [2023-12-28 04:48:41,903][106225] Updated weights for policy 1, policy_version 1332382 (0.0009) [2023-12-28 04:48:41,970][106225] Updated weights for policy 1, policy_version 1332392 (0.0007) [2023-12-28 04:48:42,030][106225] Updated weights for policy 1, policy_version 1332402 (0.0008) [2023-12-28 04:48:42,497][106226] Updated weights for policy 0, policy_version 1329043 (0.0007) [2023-12-28 04:48:42,564][106226] Updated weights for policy 0, policy_version 1329053 (0.0009) [2023-12-28 04:48:42,626][106226] Updated weights for policy 0, policy_version 1329063 (0.0009) [2023-12-28 04:48:42,795][106225] Updated weights for policy 1, policy_version 1332412 (0.0009) [2023-12-28 04:48:42,865][106225] Updated weights for policy 1, policy_version 1332422 (0.0009) [2023-12-28 04:48:42,926][106225] Updated weights for policy 1, policy_version 1332432 (0.0008) [2023-12-28 04:48:43,364][106226] Updated weights for policy 0, policy_version 1329073 (0.0008) [2023-12-28 04:48:43,415][106226] Updated weights for policy 0, policy_version 1329083 (0.0009) [2023-12-28 04:48:43,470][106226] Updated weights for policy 0, policy_version 1329093 (0.0010) [2023-12-28 04:48:43,483][106225] Updated weights for policy 1, policy_version 1332442 (0.0007) [2023-12-28 04:48:43,517][106226] Updated weights for policy 0, policy_version 1329103 (0.0009) [2023-12-28 04:48:43,531][106225] Updated weights for policy 1, policy_version 1332452 (0.0006) [2023-12-28 04:48:43,581][106225] Updated weights for policy 1, policy_version 1332462 (0.0006) [2023-12-28 04:48:43,640][106225] Updated weights for policy 1, policy_version 1332472 (0.0005) [2023-12-28 04:48:44,212][106226] Updated weights for policy 0, policy_version 1329113 (0.0009) [2023-12-28 04:48:44,277][106226] Updated weights for policy 0, policy_version 1329123 (0.0009) [2023-12-28 04:48:44,329][106225] Updated weights for policy 1, policy_version 1332482 (0.0005) [2023-12-28 04:48:44,330][106226] Updated weights for policy 0, policy_version 1329133 (0.0008) [2023-12-28 04:48:44,382][106225] Updated weights for policy 1, policy_version 1332492 (0.0008) [2023-12-28 04:48:44,434][106225] Updated weights for policy 1, policy_version 1332502 (0.0008) [2023-12-28 04:48:45,087][106226] Updated weights for policy 0, policy_version 1329143 (0.0008) [2023-12-28 04:48:45,108][106225] Updated weights for policy 1, policy_version 1332512 (0.0009) [2023-12-28 04:48:45,146][106226] Updated weights for policy 0, policy_version 1329153 (0.0006) [2023-12-28 04:48:45,167][106225] Updated weights for policy 1, policy_version 1332522 (0.0008) [2023-12-28 04:48:45,212][106226] Updated weights for policy 0, policy_version 1329163 (0.0007) [2023-12-28 04:48:45,232][106225] Updated weights for policy 1, policy_version 1332532 (0.0009) [2023-12-28 04:48:45,852][106225] Updated weights for policy 1, policy_version 1332542 (0.0007) [2023-12-28 04:48:45,910][106225] Updated weights for policy 1, policy_version 1332552 (0.0006) [2023-12-28 04:48:45,945][106226] Updated weights for policy 0, policy_version 1329173 (0.0009) [2023-12-28 04:48:45,970][106225] Updated weights for policy 1, policy_version 1332562 (0.0007) [2023-12-28 04:48:46,017][106226] Updated weights for policy 0, policy_version 1329183 (0.0010) [2023-12-28 04:48:46,078][106226] Updated weights for policy 0, policy_version 1329193 (0.0007) [2023-12-28 04:48:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 681525248. Throughput: 0: 9797.0, 1: 9798.5. Samples: 681509052. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:46,176][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.867')] [2023-12-28 04:48:46,554][106225] Updated weights for policy 1, policy_version 1332572 (0.0010) [2023-12-28 04:48:46,617][106225] Updated weights for policy 1, policy_version 1332582 (0.0010) [2023-12-28 04:48:46,679][106225] Updated weights for policy 1, policy_version 1332592 (0.0010) [2023-12-28 04:48:46,764][106226] Updated weights for policy 0, policy_version 1329203 (0.0011) [2023-12-28 04:48:46,830][106226] Updated weights for policy 0, policy_version 1329213 (0.0011) [2023-12-28 04:48:46,889][106226] Updated weights for policy 0, policy_version 1329223 (0.0010) [2023-12-28 04:48:47,376][106225] Updated weights for policy 1, policy_version 1332602 (0.0010) [2023-12-28 04:48:47,436][106225] Updated weights for policy 1, policy_version 1332612 (0.0010) [2023-12-28 04:48:47,488][106225] Updated weights for policy 1, policy_version 1332622 (0.0010) [2023-12-28 04:48:47,535][106225] Updated weights for policy 1, policy_version 1332632 (0.0010) [2023-12-28 04:48:47,587][106226] Updated weights for policy 0, policy_version 1329233 (0.0010) [2023-12-28 04:48:47,650][106226] Updated weights for policy 0, policy_version 1329243 (0.0011) [2023-12-28 04:48:47,709][106226] Updated weights for policy 0, policy_version 1329253 (0.0010) [2023-12-28 04:48:47,767][106226] Updated weights for policy 0, policy_version 1329263 (0.0007) [2023-12-28 04:48:48,256][106225] Updated weights for policy 1, policy_version 1332642 (0.0010) [2023-12-28 04:48:48,309][106225] Updated weights for policy 1, policy_version 1332652 (0.0010) [2023-12-28 04:48:48,393][106225] Updated weights for policy 1, policy_version 1332662 (0.0007) [2023-12-28 04:48:48,494][106226] Updated weights for policy 0, policy_version 1329273 (0.0008) [2023-12-28 04:48:48,548][106226] Updated weights for policy 0, policy_version 1329283 (0.0009) [2023-12-28 04:48:48,611][106226] Updated weights for policy 0, policy_version 1329293 (0.0007) [2023-12-28 04:48:49,161][106225] Updated weights for policy 1, policy_version 1332672 (0.0009) [2023-12-28 04:48:49,227][106225] Updated weights for policy 1, policy_version 1332682 (0.0008) [2023-12-28 04:48:49,239][106226] Updated weights for policy 0, policy_version 1329303 (0.0008) [2023-12-28 04:48:49,293][106225] Updated weights for policy 1, policy_version 1332692 (0.0007) [2023-12-28 04:48:49,302][106226] Updated weights for policy 0, policy_version 1329313 (0.0009) [2023-12-28 04:48:49,368][106226] Updated weights for policy 0, policy_version 1329323 (0.0009) [2023-12-28 04:48:50,073][106225] Updated weights for policy 1, policy_version 1332702 (0.0009) [2023-12-28 04:48:50,096][106226] Updated weights for policy 0, policy_version 1329333 (0.0008) [2023-12-28 04:48:50,131][106225] Updated weights for policy 1, policy_version 1332712 (0.0011) [2023-12-28 04:48:50,155][106226] Updated weights for policy 0, policy_version 1329343 (0.0010) [2023-12-28 04:48:50,192][106225] Updated weights for policy 1, policy_version 1332722 (0.0010) [2023-12-28 04:48:50,217][106226] Updated weights for policy 0, policy_version 1329353 (0.0005) [2023-12-28 04:48:50,913][106226] Updated weights for policy 0, policy_version 1329363 (0.0007) [2023-12-28 04:48:50,927][106225] Updated weights for policy 1, policy_version 1332732 (0.0011) [2023-12-28 04:48:50,967][106226] Updated weights for policy 0, policy_version 1329373 (0.0007) [2023-12-28 04:48:50,989][106225] Updated weights for policy 1, policy_version 1332742 (0.0011) [2023-12-28 04:48:51,024][106226] Updated weights for policy 0, policy_version 1329383 (0.0006) [2023-12-28 04:48:51,051][106225] Updated weights for policy 1, policy_version 1332752 (0.0011) [2023-12-28 04:48:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 681623552. Throughput: 0: 9816.1, 1: 9703.7. Samples: 681627972. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:51,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.763')] [2023-12-28 04:48:51,695][106226] Updated weights for policy 0, policy_version 1329393 (0.0007) [2023-12-28 04:48:51,772][106226] Updated weights for policy 0, policy_version 1329403 (0.0007) [2023-12-28 04:48:51,777][106225] Updated weights for policy 1, policy_version 1332762 (0.0011) [2023-12-28 04:48:51,830][106225] Updated weights for policy 1, policy_version 1332772 (0.0007) [2023-12-28 04:48:51,832][106226] Updated weights for policy 0, policy_version 1329413 (0.0007) [2023-12-28 04:48:51,892][106225] Updated weights for policy 1, policy_version 1332782 (0.0008) [2023-12-28 04:48:51,895][106226] Updated weights for policy 0, policy_version 1329423 (0.0005) [2023-12-28 04:48:51,947][106225] Updated weights for policy 1, policy_version 1332792 (0.0008) [2023-12-28 04:48:52,641][106226] Updated weights for policy 0, policy_version 1329433 (0.0007) [2023-12-28 04:48:52,651][106225] Updated weights for policy 1, policy_version 1332802 (0.0007) [2023-12-28 04:48:52,707][106226] Updated weights for policy 0, policy_version 1329443 (0.0009) [2023-12-28 04:48:52,713][106225] Updated weights for policy 1, policy_version 1332812 (0.0006) [2023-12-28 04:48:52,767][106226] Updated weights for policy 0, policy_version 1329453 (0.0007) [2023-12-28 04:48:52,773][106225] Updated weights for policy 1, policy_version 1332822 (0.0008) [2023-12-28 04:48:53,415][106226] Updated weights for policy 0, policy_version 1329463 (0.0008) [2023-12-28 04:48:53,476][106226] Updated weights for policy 0, policy_version 1329473 (0.0007) [2023-12-28 04:48:53,513][106225] Updated weights for policy 1, policy_version 1332832 (0.0007) [2023-12-28 04:48:53,539][106226] Updated weights for policy 0, policy_version 1329483 (0.0006) [2023-12-28 04:48:53,569][106225] Updated weights for policy 1, policy_version 1332842 (0.0007) [2023-12-28 04:48:53,615][106225] Updated weights for policy 1, policy_version 1332852 (0.0008) [2023-12-28 04:48:54,204][106226] Updated weights for policy 0, policy_version 1329493 (0.0007) [2023-12-28 04:48:54,267][106226] Updated weights for policy 0, policy_version 1329503 (0.0008) [2023-12-28 04:48:54,324][106226] Updated weights for policy 0, policy_version 1329513 (0.0008) [2023-12-28 04:48:54,365][106225] Updated weights for policy 1, policy_version 1332862 (0.0009) [2023-12-28 04:48:54,423][106225] Updated weights for policy 1, policy_version 1332872 (0.0009) [2023-12-28 04:48:54,492][106225] Updated weights for policy 1, policy_version 1332882 (0.0008) [2023-12-28 04:48:54,990][106226] Updated weights for policy 0, policy_version 1329523 (0.0007) [2023-12-28 04:48:55,046][106226] Updated weights for policy 0, policy_version 1329533 (0.0008) [2023-12-28 04:48:55,103][106226] Updated weights for policy 0, policy_version 1329543 (0.0009) [2023-12-28 04:48:55,206][106225] Updated weights for policy 1, policy_version 1332892 (0.0008) [2023-12-28 04:48:55,267][106225] Updated weights for policy 1, policy_version 1332902 (0.0005) [2023-12-28 04:48:55,330][106225] Updated weights for policy 1, policy_version 1332912 (0.0005) [2023-12-28 04:48:55,883][106226] Updated weights for policy 0, policy_version 1329553 (0.0008) [2023-12-28 04:48:55,940][106226] Updated weights for policy 0, policy_version 1329563 (0.0009) [2023-12-28 04:48:55,969][106225] Updated weights for policy 1, policy_version 1332922 (0.0007) [2023-12-28 04:48:56,000][106226] Updated weights for policy 0, policy_version 1329573 (0.0007) [2023-12-28 04:48:56,025][106225] Updated weights for policy 1, policy_version 1332932 (0.0006) [2023-12-28 04:48:56,055][106226] Updated weights for policy 0, policy_version 1329583 (0.0005) [2023-12-28 04:48:56,082][106225] Updated weights for policy 1, policy_version 1332942 (0.0007) [2023-12-28 04:48:56,148][106225] Updated weights for policy 1, policy_version 1332952 (0.0008) [2023-12-28 04:48:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 681721856. Throughput: 0: 9846.7, 1: 9678.4. Samples: 681685580. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:48:56,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.980')] [2023-12-28 04:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001332952_341286912.pth... [2023-12-28 04:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001329584_340434944.pth... [2023-12-28 04:48:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001331800_340992000.pth [2023-12-28 04:48:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001328432_340140032.pth [2023-12-28 04:48:56,778][106226] Updated weights for policy 0, policy_version 1329593 (0.0008) [2023-12-28 04:48:56,842][106226] Updated weights for policy 0, policy_version 1329603 (0.0007) [2023-12-28 04:48:56,887][106225] Updated weights for policy 1, policy_version 1332962 (0.0008) [2023-12-28 04:48:56,903][106226] Updated weights for policy 0, policy_version 1329613 (0.0007) [2023-12-28 04:48:56,940][106225] Updated weights for policy 1, policy_version 1332972 (0.0007) [2023-12-28 04:48:56,996][106225] Updated weights for policy 1, policy_version 1332982 (0.0008) [2023-12-28 04:48:57,597][106226] Updated weights for policy 0, policy_version 1329623 (0.0007) [2023-12-28 04:48:57,647][106226] Updated weights for policy 0, policy_version 1329633 (0.0008) [2023-12-28 04:48:57,710][106226] Updated weights for policy 0, policy_version 1329643 (0.0006) [2023-12-28 04:48:57,725][106225] Updated weights for policy 1, policy_version 1332992 (0.0006) [2023-12-28 04:48:57,777][106225] Updated weights for policy 1, policy_version 1333002 (0.0005) [2023-12-28 04:48:57,828][106225] Updated weights for policy 1, policy_version 1333012 (0.0005) [2023-12-28 04:48:58,381][106226] Updated weights for policy 0, policy_version 1329653 (0.0006) [2023-12-28 04:48:58,453][106226] Updated weights for policy 0, policy_version 1329663 (0.0008) [2023-12-28 04:48:58,525][106226] Updated weights for policy 0, policy_version 1329673 (0.0010) [2023-12-28 04:48:58,550][106225] Updated weights for policy 1, policy_version 1333022 (0.0009) [2023-12-28 04:48:58,618][106225] Updated weights for policy 1, policy_version 1333032 (0.0008) [2023-12-28 04:48:58,689][106225] Updated weights for policy 1, policy_version 1333042 (0.0008) [2023-12-28 04:48:59,390][106226] Updated weights for policy 0, policy_version 1329683 (0.0008) [2023-12-28 04:48:59,457][106226] Updated weights for policy 0, policy_version 1329693 (0.0009) [2023-12-28 04:48:59,497][106225] Updated weights for policy 1, policy_version 1333052 (0.0009) [2023-12-28 04:48:59,508][106226] Updated weights for policy 0, policy_version 1329703 (0.0009) [2023-12-28 04:48:59,547][106225] Updated weights for policy 1, policy_version 1333062 (0.0009) [2023-12-28 04:48:59,603][106225] Updated weights for policy 1, policy_version 1333072 (0.0009) [2023-12-28 04:49:00,290][106226] Updated weights for policy 0, policy_version 1329713 (0.0009) [2023-12-28 04:49:00,349][106226] Updated weights for policy 0, policy_version 1329723 (0.0008) [2023-12-28 04:49:00,386][106225] Updated weights for policy 1, policy_version 1333082 (0.0009) [2023-12-28 04:49:00,407][106226] Updated weights for policy 0, policy_version 1329733 (0.0008) [2023-12-28 04:49:00,437][106225] Updated weights for policy 1, policy_version 1333092 (0.0010) [2023-12-28 04:49:00,463][106226] Updated weights for policy 0, policy_version 1329743 (0.0005) [2023-12-28 04:49:00,494][106225] Updated weights for policy 1, policy_version 1333102 (0.0010) [2023-12-28 04:49:00,558][106225] Updated weights for policy 1, policy_version 1333112 (0.0010) [2023-12-28 04:49:01,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 681803776. Throughput: 0: 9774.3, 1: 9669.5. Samples: 681799204. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:01,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.920')] [2023-12-28 04:49:01,211][106226] Updated weights for policy 0, policy_version 1329753 (0.0008) [2023-12-28 04:49:01,268][106226] Updated weights for policy 0, policy_version 1329763 (0.0007) [2023-12-28 04:49:01,301][106225] Updated weights for policy 1, policy_version 1333122 (0.0010) [2023-12-28 04:49:01,327][106226] Updated weights for policy 0, policy_version 1329773 (0.0006) [2023-12-28 04:49:01,364][106225] Updated weights for policy 1, policy_version 1333132 (0.0010) [2023-12-28 04:49:01,427][106225] Updated weights for policy 1, policy_version 1333142 (0.0010) [2023-12-28 04:49:02,102][106226] Updated weights for policy 0, policy_version 1329783 (0.0008) [2023-12-28 04:49:02,158][106226] Updated weights for policy 0, policy_version 1329793 (0.0007) [2023-12-28 04:49:02,164][106225] Updated weights for policy 1, policy_version 1333152 (0.0010) [2023-12-28 04:49:02,215][106226] Updated weights for policy 0, policy_version 1329803 (0.0006) [2023-12-28 04:49:02,221][106225] Updated weights for policy 1, policy_version 1333162 (0.0010) [2023-12-28 04:49:02,284][106225] Updated weights for policy 1, policy_version 1333172 (0.0010) [2023-12-28 04:49:02,958][106226] Updated weights for policy 0, policy_version 1329813 (0.0007) [2023-12-28 04:49:03,020][106225] Updated weights for policy 1, policy_version 1333182 (0.0010) [2023-12-28 04:49:03,026][106226] Updated weights for policy 0, policy_version 1329823 (0.0007) [2023-12-28 04:49:03,073][106225] Updated weights for policy 1, policy_version 1333192 (0.0010) [2023-12-28 04:49:03,086][106226] Updated weights for policy 0, policy_version 1329833 (0.0006) [2023-12-28 04:49:03,125][106225] Updated weights for policy 1, policy_version 1333202 (0.0010) [2023-12-28 04:49:03,785][106226] Updated weights for policy 0, policy_version 1329843 (0.0007) [2023-12-28 04:49:03,844][106226] Updated weights for policy 0, policy_version 1329853 (0.0010) [2023-12-28 04:49:03,863][106225] Updated weights for policy 1, policy_version 1333212 (0.0010) [2023-12-28 04:49:03,910][106226] Updated weights for policy 0, policy_version 1329863 (0.0009) [2023-12-28 04:49:03,918][106225] Updated weights for policy 1, policy_version 1333222 (0.0011) [2023-12-28 04:49:03,973][106225] Updated weights for policy 1, policy_version 1333232 (0.0011) [2023-12-28 04:49:04,506][106226] Updated weights for policy 0, policy_version 1329873 (0.0010) [2023-12-28 04:49:04,564][106226] Updated weights for policy 0, policy_version 1329883 (0.0011) [2023-12-28 04:49:04,615][106226] Updated weights for policy 0, policy_version 1329893 (0.0009) [2023-12-28 04:49:04,673][106226] Updated weights for policy 0, policy_version 1329903 (0.0007) [2023-12-28 04:49:04,701][106225] Updated weights for policy 1, policy_version 1333242 (0.0009) [2023-12-28 04:49:04,761][106225] Updated weights for policy 1, policy_version 1333252 (0.0005) [2023-12-28 04:49:04,822][106225] Updated weights for policy 1, policy_version 1333262 (0.0005) [2023-12-28 04:49:04,883][106225] Updated weights for policy 1, policy_version 1333272 (0.0005) [2023-12-28 04:49:05,276][106226] Updated weights for policy 0, policy_version 1329913 (0.0010) [2023-12-28 04:49:05,337][106226] Updated weights for policy 0, policy_version 1329923 (0.0010) [2023-12-28 04:49:05,390][106226] Updated weights for policy 0, policy_version 1329933 (0.0010) [2023-12-28 04:49:05,506][106225] Updated weights for policy 1, policy_version 1333282 (0.0008) [2023-12-28 04:49:05,552][106225] Updated weights for policy 1, policy_version 1333292 (0.0007) [2023-12-28 04:49:05,601][106225] Updated weights for policy 1, policy_version 1333302 (0.0009) [2023-12-28 04:49:06,059][106226] Updated weights for policy 0, policy_version 1329943 (0.0010) [2023-12-28 04:49:06,124][106226] Updated weights for policy 0, policy_version 1329953 (0.0011) [2023-12-28 04:49:06,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 681902080. Throughput: 0: 9771.9, 1: 9685.3. Samples: 681916372. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:06,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.932')] [2023-12-28 04:49:06,185][106226] Updated weights for policy 0, policy_version 1329963 (0.0011) [2023-12-28 04:49:06,419][106225] Updated weights for policy 1, policy_version 1333312 (0.0007) [2023-12-28 04:49:06,485][106225] Updated weights for policy 1, policy_version 1333322 (0.0006) [2023-12-28 04:49:06,550][106225] Updated weights for policy 1, policy_version 1333332 (0.0009) [2023-12-28 04:49:06,824][106226] Updated weights for policy 0, policy_version 1329973 (0.0010) [2023-12-28 04:49:06,892][106226] Updated weights for policy 0, policy_version 1329983 (0.0009) [2023-12-28 04:49:06,943][106226] Updated weights for policy 0, policy_version 1329993 (0.0010) [2023-12-28 04:49:07,253][106225] Updated weights for policy 1, policy_version 1333342 (0.0007) [2023-12-28 04:49:07,301][106225] Updated weights for policy 1, policy_version 1333352 (0.0008) [2023-12-28 04:49:07,351][106225] Updated weights for policy 1, policy_version 1333362 (0.0009) [2023-12-28 04:49:07,577][106226] Updated weights for policy 0, policy_version 1330003 (0.0009) [2023-12-28 04:49:07,632][106226] Updated weights for policy 0, policy_version 1330013 (0.0005) [2023-12-28 04:49:07,685][106226] Updated weights for policy 0, policy_version 1330023 (0.0010) [2023-12-28 04:49:08,066][106225] Updated weights for policy 1, policy_version 1333372 (0.0007) [2023-12-28 04:49:08,119][106225] Updated weights for policy 1, policy_version 1333382 (0.0005) [2023-12-28 04:49:08,170][106225] Updated weights for policy 1, policy_version 1333392 (0.0006) [2023-12-28 04:49:08,307][106226] Updated weights for policy 0, policy_version 1330033 (0.0010) [2023-12-28 04:49:08,376][106226] Updated weights for policy 0, policy_version 1330043 (0.0010) [2023-12-28 04:49:08,434][106226] Updated weights for policy 0, policy_version 1330053 (0.0011) [2023-12-28 04:49:08,491][106226] Updated weights for policy 0, policy_version 1330063 (0.0010) [2023-12-28 04:49:08,889][106225] Updated weights for policy 1, policy_version 1333402 (0.0007) [2023-12-28 04:49:08,943][106225] Updated weights for policy 1, policy_version 1333412 (0.0005) [2023-12-28 04:49:09,004][106225] Updated weights for policy 1, policy_version 1333422 (0.0009) [2023-12-28 04:49:09,071][106225] Updated weights for policy 1, policy_version 1333432 (0.0007) [2023-12-28 04:49:09,102][106226] Updated weights for policy 0, policy_version 1330073 (0.0009) [2023-12-28 04:49:09,162][106226] Updated weights for policy 0, policy_version 1330083 (0.0010) [2023-12-28 04:49:09,224][106226] Updated weights for policy 0, policy_version 1330093 (0.0010) [2023-12-28 04:49:09,837][106225] Updated weights for policy 1, policy_version 1333442 (0.0010) [2023-12-28 04:49:09,907][106226] Updated weights for policy 0, policy_version 1330103 (0.0009) [2023-12-28 04:49:09,907][106225] Updated weights for policy 1, policy_version 1333452 (0.0008) [2023-12-28 04:49:09,975][106226] Updated weights for policy 0, policy_version 1330113 (0.0010) [2023-12-28 04:49:09,975][106225] Updated weights for policy 1, policy_version 1333462 (0.0009) [2023-12-28 04:49:10,038][106226] Updated weights for policy 0, policy_version 1330123 (0.0008) [2023-12-28 04:49:10,681][106226] Updated weights for policy 0, policy_version 1330133 (0.0008) [2023-12-28 04:49:10,743][106226] Updated weights for policy 0, policy_version 1330143 (0.0008) [2023-12-28 04:49:10,754][106225] Updated weights for policy 1, policy_version 1333472 (0.0008) [2023-12-28 04:49:10,800][106226] Updated weights for policy 0, policy_version 1330153 (0.0008) [2023-12-28 04:49:10,811][106225] Updated weights for policy 1, policy_version 1333482 (0.0007) [2023-12-28 04:49:10,872][106225] Updated weights for policy 1, policy_version 1333492 (0.0008) [2023-12-28 04:49:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 682008576. Throughput: 0: 9793.0, 1: 9723.9. Samples: 681978584. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:11,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.823')] [2023-12-28 04:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001333496_341426176.pth... [2023-12-28 04:49:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001330160_340582400.pth... [2023-12-28 04:49:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001332376_341139456.pth [2023-12-28 04:49:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001329008_340287488.pth [2023-12-28 04:49:11,558][106226] Updated weights for policy 0, policy_version 1330163 (0.0009) [2023-12-28 04:49:11,623][106226] Updated weights for policy 0, policy_version 1330173 (0.0007) [2023-12-28 04:49:11,700][106226] Updated weights for policy 0, policy_version 1330183 (0.0007) [2023-12-28 04:49:11,715][106225] Updated weights for policy 1, policy_version 1333502 (0.0008) [2023-12-28 04:49:11,783][106225] Updated weights for policy 1, policy_version 1333512 (0.0007) [2023-12-28 04:49:11,854][106225] Updated weights for policy 1, policy_version 1333522 (0.0009) [2023-12-28 04:49:12,447][106226] Updated weights for policy 0, policy_version 1330193 (0.0008) [2023-12-28 04:49:12,506][106226] Updated weights for policy 0, policy_version 1330203 (0.0007) [2023-12-28 04:49:12,559][106226] Updated weights for policy 0, policy_version 1330213 (0.0005) [2023-12-28 04:49:12,611][106225] Updated weights for policy 1, policy_version 1333532 (0.0008) [2023-12-28 04:49:12,613][106226] Updated weights for policy 0, policy_version 1330223 (0.0007) [2023-12-28 04:49:12,663][106225] Updated weights for policy 1, policy_version 1333542 (0.0008) [2023-12-28 04:49:12,712][106225] Updated weights for policy 1, policy_version 1333552 (0.0009) [2023-12-28 04:49:13,280][106226] Updated weights for policy 0, policy_version 1330233 (0.0005) [2023-12-28 04:49:13,340][106226] Updated weights for policy 0, policy_version 1330243 (0.0006) [2023-12-28 04:49:13,393][106226] Updated weights for policy 0, policy_version 1330253 (0.0007) [2023-12-28 04:49:13,499][106225] Updated weights for policy 1, policy_version 1333562 (0.0008) [2023-12-28 04:49:13,554][106225] Updated weights for policy 1, policy_version 1333572 (0.0008) [2023-12-28 04:49:13,603][106225] Updated weights for policy 1, policy_version 1333582 (0.0007) [2023-12-28 04:49:13,662][106225] Updated weights for policy 1, policy_version 1333592 (0.0005) [2023-12-28 04:49:14,090][106226] Updated weights for policy 0, policy_version 1330263 (0.0007) [2023-12-28 04:49:14,146][106226] Updated weights for policy 0, policy_version 1330273 (0.0007) [2023-12-28 04:49:14,202][106226] Updated weights for policy 0, policy_version 1330283 (0.0010) [2023-12-28 04:49:14,370][106225] Updated weights for policy 1, policy_version 1333602 (0.0011) [2023-12-28 04:49:14,429][106225] Updated weights for policy 1, policy_version 1333612 (0.0011) [2023-12-28 04:49:14,500][106225] Updated weights for policy 1, policy_version 1333622 (0.0010) [2023-12-28 04:49:14,812][106226] Updated weights for policy 0, policy_version 1330293 (0.0009) [2023-12-28 04:49:14,880][106226] Updated weights for policy 0, policy_version 1330303 (0.0011) [2023-12-28 04:49:14,945][106226] Updated weights for policy 0, policy_version 1330313 (0.0011) [2023-12-28 04:49:15,146][106225] Updated weights for policy 1, policy_version 1333632 (0.0007) [2023-12-28 04:49:15,208][106225] Updated weights for policy 1, policy_version 1333642 (0.0008) [2023-12-28 04:49:15,276][106225] Updated weights for policy 1, policy_version 1333652 (0.0008) [2023-12-28 04:49:15,652][106226] Updated weights for policy 0, policy_version 1330323 (0.0011) [2023-12-28 04:49:15,698][106226] Updated weights for policy 0, policy_version 1330333 (0.0010) [2023-12-28 04:49:15,751][106226] Updated weights for policy 0, policy_version 1330343 (0.0010) [2023-12-28 04:49:15,942][106225] Updated weights for policy 1, policy_version 1333662 (0.0009) [2023-12-28 04:49:15,988][106225] Updated weights for policy 1, policy_version 1333672 (0.0010) [2023-12-28 04:49:16,055][106225] Updated weights for policy 1, policy_version 1333682 (0.0010) [2023-12-28 04:49:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 682106880. Throughput: 0: 9821.0, 1: 9600.1. Samples: 682092404. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:16,176][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.591')] [2023-12-28 04:49:16,379][106226] Updated weights for policy 0, policy_version 1330353 (0.0010) [2023-12-28 04:49:16,444][106226] Updated weights for policy 0, policy_version 1330363 (0.0006) [2023-12-28 04:49:16,508][106226] Updated weights for policy 0, policy_version 1330373 (0.0007) [2023-12-28 04:49:16,558][106226] Updated weights for policy 0, policy_version 1330383 (0.0008) [2023-12-28 04:49:16,838][106225] Updated weights for policy 1, policy_version 1333692 (0.0009) [2023-12-28 04:49:16,891][106225] Updated weights for policy 1, policy_version 1333702 (0.0008) [2023-12-28 04:49:16,953][106225] Updated weights for policy 1, policy_version 1333712 (0.0009) [2023-12-28 04:49:17,173][106226] Updated weights for policy 0, policy_version 1330393 (0.0010) [2023-12-28 04:49:17,219][106226] Updated weights for policy 0, policy_version 1330403 (0.0010) [2023-12-28 04:49:17,276][106226] Updated weights for policy 0, policy_version 1330413 (0.0010) [2023-12-28 04:49:17,557][106225] Updated weights for policy 1, policy_version 1333722 (0.0009) [2023-12-28 04:49:17,605][106225] Updated weights for policy 1, policy_version 1333732 (0.0005) [2023-12-28 04:49:17,656][106225] Updated weights for policy 1, policy_version 1333742 (0.0005) [2023-12-28 04:49:17,718][106225] Updated weights for policy 1, policy_version 1333752 (0.0005) [2023-12-28 04:49:17,972][106226] Updated weights for policy 0, policy_version 1330423 (0.0010) [2023-12-28 04:49:18,039][106226] Updated weights for policy 0, policy_version 1330433 (0.0007) [2023-12-28 04:49:18,107][106226] Updated weights for policy 0, policy_version 1330443 (0.0007) [2023-12-28 04:49:18,385][106225] Updated weights for policy 1, policy_version 1333762 (0.0007) [2023-12-28 04:49:18,444][106225] Updated weights for policy 1, policy_version 1333772 (0.0010) [2023-12-28 04:49:18,491][106225] Updated weights for policy 1, policy_version 1333782 (0.0010) [2023-12-28 04:49:18,738][106226] Updated weights for policy 0, policy_version 1330453 (0.0009) [2023-12-28 04:49:18,794][106226] Updated weights for policy 0, policy_version 1330463 (0.0008) [2023-12-28 04:49:18,852][106226] Updated weights for policy 0, policy_version 1330473 (0.0008) [2023-12-28 04:49:19,173][106225] Updated weights for policy 1, policy_version 1333792 (0.0010) [2023-12-28 04:49:19,244][106225] Updated weights for policy 1, policy_version 1333802 (0.0011) [2023-12-28 04:49:19,307][106225] Updated weights for policy 1, policy_version 1333812 (0.0011) [2023-12-28 04:49:19,646][106226] Updated weights for policy 0, policy_version 1330483 (0.0008) [2023-12-28 04:49:19,713][106226] Updated weights for policy 0, policy_version 1330493 (0.0008) [2023-12-28 04:49:19,770][106226] Updated weights for policy 0, policy_version 1330503 (0.0009) [2023-12-28 04:49:20,108][106225] Updated weights for policy 1, policy_version 1333822 (0.0008) [2023-12-28 04:49:20,175][106225] Updated weights for policy 1, policy_version 1333832 (0.0006) [2023-12-28 04:49:20,245][106225] Updated weights for policy 1, policy_version 1333842 (0.0006) [2023-12-28 04:49:20,606][106226] Updated weights for policy 0, policy_version 1330513 (0.0009) [2023-12-28 04:49:20,673][106226] Updated weights for policy 0, policy_version 1330523 (0.0008) [2023-12-28 04:49:20,739][106226] Updated weights for policy 0, policy_version 1330533 (0.0008) [2023-12-28 04:49:20,798][106226] Updated weights for policy 0, policy_version 1330543 (0.0008) [2023-12-28 04:49:20,834][106225] Updated weights for policy 1, policy_version 1333852 (0.0007) [2023-12-28 04:49:20,894][106225] Updated weights for policy 1, policy_version 1333862 (0.0008) [2023-12-28 04:49:20,961][106225] Updated weights for policy 1, policy_version 1333872 (0.0008) [2023-12-28 04:49:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 682205184. Throughput: 0: 9787.8, 1: 9675.5. Samples: 682212292. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:21,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.668')] [2023-12-28 04:49:21,551][106226] Updated weights for policy 0, policy_version 1330553 (0.0010) [2023-12-28 04:49:21,620][106226] Updated weights for policy 0, policy_version 1330563 (0.0008) [2023-12-28 04:49:21,686][106226] Updated weights for policy 0, policy_version 1330573 (0.0007) [2023-12-28 04:49:21,765][106225] Updated weights for policy 1, policy_version 1333882 (0.0009) [2023-12-28 04:49:21,822][106225] Updated weights for policy 1, policy_version 1333892 (0.0008) [2023-12-28 04:49:21,881][106225] Updated weights for policy 1, policy_version 1333902 (0.0008) [2023-12-28 04:49:21,948][106225] Updated weights for policy 1, policy_version 1333912 (0.0007) [2023-12-28 04:49:22,364][106226] Updated weights for policy 0, policy_version 1330583 (0.0009) [2023-12-28 04:49:22,427][106226] Updated weights for policy 0, policy_version 1330593 (0.0008) [2023-12-28 04:49:22,487][106226] Updated weights for policy 0, policy_version 1330603 (0.0009) [2023-12-28 04:49:22,764][106225] Updated weights for policy 1, policy_version 1333922 (0.0009) [2023-12-28 04:49:22,812][106225] Updated weights for policy 1, policy_version 1333932 (0.0008) [2023-12-28 04:49:22,864][106225] Updated weights for policy 1, policy_version 1333942 (0.0009) [2023-12-28 04:49:23,102][106226] Updated weights for policy 0, policy_version 1330613 (0.0008) [2023-12-28 04:49:23,165][106226] Updated weights for policy 0, policy_version 1330623 (0.0008) [2023-12-28 04:49:23,223][106226] Updated weights for policy 0, policy_version 1330633 (0.0008) [2023-12-28 04:49:23,516][106225] Updated weights for policy 1, policy_version 1333952 (0.0010) [2023-12-28 04:49:23,569][106225] Updated weights for policy 1, policy_version 1333962 (0.0010) [2023-12-28 04:49:23,626][106225] Updated weights for policy 1, policy_version 1333972 (0.0010) [2023-12-28 04:49:23,851][106226] Updated weights for policy 0, policy_version 1330643 (0.0008) [2023-12-28 04:49:23,912][106226] Updated weights for policy 0, policy_version 1330653 (0.0007) [2023-12-28 04:49:23,969][106226] Updated weights for policy 0, policy_version 1330663 (0.0010) [2023-12-28 04:49:24,318][106225] Updated weights for policy 1, policy_version 1333982 (0.0010) [2023-12-28 04:49:24,370][106225] Updated weights for policy 1, policy_version 1333992 (0.0009) [2023-12-28 04:49:24,432][106225] Updated weights for policy 1, policy_version 1334002 (0.0007) [2023-12-28 04:49:24,602][106226] Updated weights for policy 0, policy_version 1330673 (0.0010) [2023-12-28 04:49:24,667][106226] Updated weights for policy 0, policy_version 1330683 (0.0008) [2023-12-28 04:49:24,715][106226] Updated weights for policy 0, policy_version 1330693 (0.0007) [2023-12-28 04:49:24,768][106226] Updated weights for policy 0, policy_version 1330703 (0.0008) [2023-12-28 04:49:25,029][106225] Updated weights for policy 1, policy_version 1334012 (0.0011) [2023-12-28 04:49:25,098][106225] Updated weights for policy 1, policy_version 1334022 (0.0010) [2023-12-28 04:49:25,167][106225] Updated weights for policy 1, policy_version 1334032 (0.0008) [2023-12-28 04:49:25,468][106226] Updated weights for policy 0, policy_version 1330713 (0.0005) [2023-12-28 04:49:25,499][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000007 [2023-12-28 04:49:25,848][106225] Updated weights for policy 1, policy_version 1334042 (0.0010) [2023-12-28 04:49:25,898][106225] Updated weights for policy 1, policy_version 1334052 (0.0010) [2023-12-28 04:49:25,955][106225] Updated weights for policy 1, policy_version 1334062 (0.0010) [2023-12-28 04:49:26,007][106225] Updated weights for policy 1, policy_version 1334072 (0.0010) [2023-12-28 04:49:26,135][106226] Updated weights for policy 0, policy_version 1330723 (0.0008) [2023-12-28 04:49:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.4, 300 sec: 19688.6). Total num frames: 682303488. Throughput: 0: 9847.7, 1: 9660.7. Samples: 682271208. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:26,175][105115] Avg episode reward: [(0, '-4.802'), (1, '-4.517')] [2023-12-28 04:49:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001334072_341573632.pth... [2023-12-28 04:49:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001332952_341286912.pth [2023-12-28 04:49:26,189][106226] Updated weights for policy 0, policy_version 1330733 (0.0005) [2023-12-28 04:49:26,243][106226] Updated weights for policy 0, policy_version 1330743 (0.0005) [2023-12-28 04:49:26,287][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001330752_340738048.pth... [2023-12-28 04:49:26,290][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001329584_340434944.pth [2023-12-28 04:49:26,767][106225] Updated weights for policy 1, policy_version 1334082 (0.0005) [2023-12-28 04:49:26,819][106225] Updated weights for policy 1, policy_version 1334092 (0.0005) [2023-12-28 04:49:26,873][106226] Updated weights for policy 0, policy_version 1330753 (0.0006) [2023-12-28 04:49:26,873][106225] Updated weights for policy 1, policy_version 1334102 (0.0005) [2023-12-28 04:49:26,949][106226] Updated weights for policy 0, policy_version 1330763 (0.0008) [2023-12-28 04:49:27,007][106226] Updated weights for policy 0, policy_version 1330773 (0.0011) [2023-12-28 04:49:27,067][106226] Updated weights for policy 0, policy_version 1330783 (0.0010) [2023-12-28 04:49:27,491][106225] Updated weights for policy 1, policy_version 1334112 (0.0006) [2023-12-28 04:49:27,548][106225] Updated weights for policy 1, policy_version 1334122 (0.0005) [2023-12-28 04:49:27,613][106225] Updated weights for policy 1, policy_version 1334132 (0.0005) [2023-12-28 04:49:27,766][106226] Updated weights for policy 0, policy_version 1330793 (0.0010) [2023-12-28 04:49:27,825][106226] Updated weights for policy 0, policy_version 1330803 (0.0010) [2023-12-28 04:49:27,883][106226] Updated weights for policy 0, policy_version 1330813 (0.0010) [2023-12-28 04:49:28,244][106225] Updated weights for policy 1, policy_version 1334142 (0.0007) [2023-12-28 04:49:28,300][106225] Updated weights for policy 1, policy_version 1334152 (0.0007) [2023-12-28 04:49:28,362][106225] Updated weights for policy 1, policy_version 1334162 (0.0008) [2023-12-28 04:49:28,579][106226] Updated weights for policy 0, policy_version 1330823 (0.0010) [2023-12-28 04:49:28,639][106226] Updated weights for policy 0, policy_version 1330833 (0.0011) [2023-12-28 04:49:28,695][106226] Updated weights for policy 0, policy_version 1330843 (0.0010) [2023-12-28 04:49:29,126][106225] Updated weights for policy 1, policy_version 1334172 (0.0006) [2023-12-28 04:49:29,184][106225] Updated weights for policy 1, policy_version 1334182 (0.0006) [2023-12-28 04:49:29,247][106225] Updated weights for policy 1, policy_version 1334192 (0.0007) [2023-12-28 04:49:29,356][106226] Updated weights for policy 0, policy_version 1330853 (0.0010) [2023-12-28 04:49:29,419][106226] Updated weights for policy 0, policy_version 1330863 (0.0008) [2023-12-28 04:49:29,478][106226] Updated weights for policy 0, policy_version 1330873 (0.0008) [2023-12-28 04:49:29,821][106225] Updated weights for policy 1, policy_version 1334202 (0.0006) [2023-12-28 04:49:29,889][106225] Updated weights for policy 1, policy_version 1334212 (0.0008) [2023-12-28 04:49:29,952][106225] Updated weights for policy 1, policy_version 1334222 (0.0009) [2023-12-28 04:49:30,014][106225] Updated weights for policy 1, policy_version 1334232 (0.0008) [2023-12-28 04:49:30,162][106226] Updated weights for policy 0, policy_version 1330883 (0.0005) [2023-12-28 04:49:30,235][106226] Updated weights for policy 0, policy_version 1330893 (0.0010) [2023-12-28 04:49:30,293][106226] Updated weights for policy 0, policy_version 1330903 (0.0010) [2023-12-28 04:49:30,654][106225] Updated weights for policy 1, policy_version 1334242 (0.0005) [2023-12-28 04:49:30,707][106225] Updated weights for policy 1, policy_version 1334252 (0.0005) [2023-12-28 04:49:30,763][106225] Updated weights for policy 1, policy_version 1334262 (0.0005) [2023-12-28 04:49:30,983][106226] Updated weights for policy 0, policy_version 1330913 (0.0008) [2023-12-28 04:49:31,052][106226] Updated weights for policy 0, policy_version 1330923 (0.0007) [2023-12-28 04:49:31,116][106226] Updated weights for policy 0, policy_version 1330933 (0.0006) [2023-12-28 04:49:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 682401792. Throughput: 0: 9991.3, 1: 9711.7. Samples: 682395684. Policy #0 lag: (min: 9.0, avg: 29.6, max: 41.0) [2023-12-28 04:49:31,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.927')] [2023-12-28 04:49:31,184][106226] Updated weights for policy 0, policy_version 1330943 (0.0008) [2023-12-28 04:49:31,472][106225] Updated weights for policy 1, policy_version 1334272 (0.0007) [2023-12-28 04:49:31,542][106225] Updated weights for policy 1, policy_version 1334282 (0.0008) [2023-12-28 04:49:31,612][106225] Updated weights for policy 1, policy_version 1334292 (0.0008) [2023-12-28 04:49:31,879][106226] Updated weights for policy 0, policy_version 1330953 (0.0008) [2023-12-28 04:49:31,936][106226] Updated weights for policy 0, policy_version 1330963 (0.0008) [2023-12-28 04:49:31,990][106226] Updated weights for policy 0, policy_version 1330973 (0.0009) [2023-12-28 04:49:32,284][106225] Updated weights for policy 1, policy_version 1334302 (0.0010) [2023-12-28 04:49:32,345][106225] Updated weights for policy 1, policy_version 1334312 (0.0010) [2023-12-28 04:49:32,421][106225] Updated weights for policy 1, policy_version 1334322 (0.0008) [2023-12-28 04:49:32,714][106226] Updated weights for policy 0, policy_version 1330983 (0.0009) [2023-12-28 04:49:32,765][106226] Updated weights for policy 0, policy_version 1330993 (0.0007) [2023-12-28 04:49:32,820][106226] Updated weights for policy 0, policy_version 1331003 (0.0009) [2023-12-28 04:49:33,097][106225] Updated weights for policy 1, policy_version 1334332 (0.0009) [2023-12-28 04:49:33,160][106225] Updated weights for policy 1, policy_version 1334342 (0.0010) [2023-12-28 04:49:33,222][106225] Updated weights for policy 1, policy_version 1334352 (0.0010) [2023-12-28 04:49:33,477][106226] Updated weights for policy 0, policy_version 1331013 (0.0010) [2023-12-28 04:49:33,529][106226] Updated weights for policy 0, policy_version 1331023 (0.0010) [2023-12-28 04:49:33,582][106226] Updated weights for policy 0, policy_version 1331033 (0.0010) [2023-12-28 04:49:33,923][106225] Updated weights for policy 1, policy_version 1334362 (0.0010) [2023-12-28 04:49:33,981][106225] Updated weights for policy 1, policy_version 1334372 (0.0010) [2023-12-28 04:49:34,041][106225] Updated weights for policy 1, policy_version 1334382 (0.0010) [2023-12-28 04:49:34,100][106225] Updated weights for policy 1, policy_version 1334392 (0.0010) [2023-12-28 04:49:34,280][106226] Updated weights for policy 0, policy_version 1331043 (0.0010) [2023-12-28 04:49:34,338][106226] Updated weights for policy 0, policy_version 1331053 (0.0011) [2023-12-28 04:49:34,395][106226] Updated weights for policy 0, policy_version 1331063 (0.0010) [2023-12-28 04:49:34,833][106225] Updated weights for policy 1, policy_version 1334402 (0.0010) [2023-12-28 04:49:34,892][106225] Updated weights for policy 1, policy_version 1334412 (0.0010) [2023-12-28 04:49:34,953][106225] Updated weights for policy 1, policy_version 1334422 (0.0010) [2023-12-28 04:49:35,077][106226] Updated weights for policy 0, policy_version 1331073 (0.0010) [2023-12-28 04:49:35,132][106226] Updated weights for policy 0, policy_version 1331083 (0.0006) [2023-12-28 04:49:35,177][106226] Updated weights for policy 0, policy_version 1331093 (0.0005) [2023-12-28 04:49:35,231][106226] Updated weights for policy 0, policy_version 1331104 (0.0008) [2023-12-28 04:49:35,609][106225] Updated weights for policy 1, policy_version 1334432 (0.0008) [2023-12-28 04:49:35,666][106225] Updated weights for policy 1, policy_version 1334442 (0.0010) [2023-12-28 04:49:35,727][106225] Updated weights for policy 1, policy_version 1334452 (0.0010) [2023-12-28 04:49:35,860][106226] Updated weights for policy 0, policy_version 1331114 (0.0007) [2023-12-28 04:49:35,910][106226] Updated weights for policy 0, policy_version 1331124 (0.0008) [2023-12-28 04:49:35,970][106226] Updated weights for policy 0, policy_version 1331134 (0.0008) [2023-12-28 04:49:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 682508288. Throughput: 0: 10017.3, 1: 9720.0. Samples: 682516152. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:49:36,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.764')] [2023-12-28 04:49:36,375][106225] Updated weights for policy 1, policy_version 1334462 (0.0007) [2023-12-28 04:49:36,450][106225] Updated weights for policy 1, policy_version 1334472 (0.0009) [2023-12-28 04:49:36,523][106225] Updated weights for policy 1, policy_version 1334482 (0.0007) [2023-12-28 04:49:36,670][106226] Updated weights for policy 0, policy_version 1331144 (0.0006) [2023-12-28 04:49:36,736][106226] Updated weights for policy 0, policy_version 1331154 (0.0006) [2023-12-28 04:49:36,795][106226] Updated weights for policy 0, policy_version 1331164 (0.0006) [2023-12-28 04:49:37,219][106225] Updated weights for policy 1, policy_version 1334492 (0.0007) [2023-12-28 04:49:37,269][106225] Updated weights for policy 1, policy_version 1334502 (0.0008) [2023-12-28 04:49:37,318][106225] Updated weights for policy 1, policy_version 1334512 (0.0008) [2023-12-28 04:49:37,404][106226] Updated weights for policy 0, policy_version 1331174 (0.0007) [2023-12-28 04:49:37,469][106226] Updated weights for policy 0, policy_version 1331184 (0.0007) [2023-12-28 04:49:37,525][106226] Updated weights for policy 0, policy_version 1331194 (0.0008) [2023-12-28 04:49:38,079][106225] Updated weights for policy 1, policy_version 1334522 (0.0009) [2023-12-28 04:49:38,133][106225] Updated weights for policy 1, policy_version 1334532 (0.0008) [2023-12-28 04:49:38,192][106225] Updated weights for policy 1, policy_version 1334542 (0.0008) [2023-12-28 04:49:38,230][106226] Updated weights for policy 0, policy_version 1331204 (0.0008) [2023-12-28 04:49:38,247][106225] Updated weights for policy 1, policy_version 1334552 (0.0007) [2023-12-28 04:49:38,276][106226] Updated weights for policy 0, policy_version 1331214 (0.0007) [2023-12-28 04:49:38,326][106226] Updated weights for policy 0, policy_version 1331224 (0.0007) [2023-12-28 04:49:38,988][106225] Updated weights for policy 1, policy_version 1334562 (0.0010) [2023-12-28 04:49:39,007][106226] Updated weights for policy 0, policy_version 1331234 (0.0008) [2023-12-28 04:49:39,040][106225] Updated weights for policy 1, policy_version 1334572 (0.0010) [2023-12-28 04:49:39,061][106226] Updated weights for policy 0, policy_version 1331244 (0.0005) [2023-12-28 04:49:39,101][106225] Updated weights for policy 1, policy_version 1334582 (0.0010) [2023-12-28 04:49:39,120][106226] Updated weights for policy 0, policy_version 1331254 (0.0006) [2023-12-28 04:49:39,169][106226] Updated weights for policy 0, policy_version 1331264 (0.0007) [2023-12-28 04:49:39,852][106225] Updated weights for policy 1, policy_version 1334592 (0.0009) [2023-12-28 04:49:39,899][106226] Updated weights for policy 0, policy_version 1331274 (0.0007) [2023-12-28 04:49:39,912][106225] Updated weights for policy 1, policy_version 1334602 (0.0007) [2023-12-28 04:49:39,964][106226] Updated weights for policy 0, policy_version 1331284 (0.0008) [2023-12-28 04:49:39,978][106225] Updated weights for policy 1, policy_version 1334612 (0.0008) [2023-12-28 04:49:40,031][106226] Updated weights for policy 0, policy_version 1331294 (0.0008) [2023-12-28 04:49:40,680][106225] Updated weights for policy 1, policy_version 1334622 (0.0007) [2023-12-28 04:49:40,733][106225] Updated weights for policy 1, policy_version 1334632 (0.0006) [2023-12-28 04:49:40,791][106225] Updated weights for policy 1, policy_version 1334642 (0.0007) [2023-12-28 04:49:40,823][106226] Updated weights for policy 0, policy_version 1331304 (0.0008) [2023-12-28 04:49:40,893][106226] Updated weights for policy 0, policy_version 1331314 (0.0009) [2023-12-28 04:49:40,960][106226] Updated weights for policy 0, policy_version 1331324 (0.0009) [2023-12-28 04:49:41,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 682606592. Throughput: 0: 10056.0, 1: 9739.4. Samples: 682576372. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:49:41,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-4.848')] [2023-12-28 04:49:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001334648_341721088.pth... [2023-12-28 04:49:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001331328_340885504.pth... [2023-12-28 04:49:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001333496_341426176.pth [2023-12-28 04:49:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001330160_340582400.pth [2023-12-28 04:49:41,502][106225] Updated weights for policy 1, policy_version 1334652 (0.0008) [2023-12-28 04:49:41,560][106225] Updated weights for policy 1, policy_version 1334662 (0.0010) [2023-12-28 04:49:41,630][106225] Updated weights for policy 1, policy_version 1334672 (0.0011) [2023-12-28 04:49:41,776][106226] Updated weights for policy 0, policy_version 1331335 (0.0009) [2023-12-28 04:49:41,836][106226] Updated weights for policy 0, policy_version 1331345 (0.0008) [2023-12-28 04:49:41,906][106226] Updated weights for policy 0, policy_version 1331355 (0.0010) [2023-12-28 04:49:42,329][106225] Updated weights for policy 1, policy_version 1334682 (0.0011) [2023-12-28 04:49:42,399][106225] Updated weights for policy 1, policy_version 1334692 (0.0008) [2023-12-28 04:49:42,466][106225] Updated weights for policy 1, policy_version 1334702 (0.0006) [2023-12-28 04:49:42,525][106225] Updated weights for policy 1, policy_version 1334712 (0.0008) [2023-12-28 04:49:42,702][106226] Updated weights for policy 0, policy_version 1331365 (0.0010) [2023-12-28 04:49:42,766][106226] Updated weights for policy 0, policy_version 1331375 (0.0011) [2023-12-28 04:49:42,829][106226] Updated weights for policy 0, policy_version 1331385 (0.0010) [2023-12-28 04:49:43,208][106225] Updated weights for policy 1, policy_version 1334722 (0.0010) [2023-12-28 04:49:43,268][106225] Updated weights for policy 1, policy_version 1334732 (0.0010) [2023-12-28 04:49:43,321][106225] Updated weights for policy 1, policy_version 1334742 (0.0010) [2023-12-28 04:49:43,515][106226] Updated weights for policy 0, policy_version 1331395 (0.0009) [2023-12-28 04:49:43,565][106226] Updated weights for policy 0, policy_version 1331405 (0.0006) [2023-12-28 04:49:43,613][106226] Updated weights for policy 0, policy_version 1331415 (0.0007) [2023-12-28 04:49:44,005][106225] Updated weights for policy 1, policy_version 1334752 (0.0009) [2023-12-28 04:49:44,072][106225] Updated weights for policy 1, policy_version 1334762 (0.0009) [2023-12-28 04:49:44,137][106225] Updated weights for policy 1, policy_version 1334772 (0.0009) [2023-12-28 04:49:44,222][106226] Updated weights for policy 0, policy_version 1331425 (0.0010) [2023-12-28 04:49:44,280][106226] Updated weights for policy 0, policy_version 1331435 (0.0005) [2023-12-28 04:49:44,335][106226] Updated weights for policy 0, policy_version 1331445 (0.0005) [2023-12-28 04:49:44,387][106226] Updated weights for policy 0, policy_version 1331455 (0.0005) [2023-12-28 04:49:44,963][106226] Updated weights for policy 0, policy_version 1331465 (0.0006) [2023-12-28 04:49:44,971][106225] Updated weights for policy 1, policy_version 1334782 (0.0008) [2023-12-28 04:49:45,028][106226] Updated weights for policy 0, policy_version 1331475 (0.0006) [2023-12-28 04:49:45,030][106225] Updated weights for policy 1, policy_version 1334792 (0.0008) [2023-12-28 04:49:45,086][106226] Updated weights for policy 0, policy_version 1331485 (0.0008) [2023-12-28 04:49:45,091][106225] Updated weights for policy 1, policy_version 1334802 (0.0007) [2023-12-28 04:49:45,760][106226] Updated weights for policy 0, policy_version 1331495 (0.0006) [2023-12-28 04:49:45,767][106225] Updated weights for policy 1, policy_version 1334812 (0.0007) [2023-12-28 04:49:45,814][106225] Updated weights for policy 1, policy_version 1334822 (0.0007) [2023-12-28 04:49:45,824][106226] Updated weights for policy 0, policy_version 1331505 (0.0005) [2023-12-28 04:49:45,859][106225] Updated weights for policy 1, policy_version 1334832 (0.0007) [2023-12-28 04:49:45,898][106226] Updated weights for policy 0, policy_version 1331515 (0.0005) [2023-12-28 04:49:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 682704896. Throughput: 0: 10098.9, 1: 9752.9. Samples: 682692536. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:49:46,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.695')] [2023-12-28 04:49:46,464][106225] Updated weights for policy 1, policy_version 1334842 (0.0006) [2023-12-28 04:49:46,517][106225] Updated weights for policy 1, policy_version 1334852 (0.0007) [2023-12-28 04:49:46,533][106226] Updated weights for policy 0, policy_version 1331525 (0.0007) [2023-12-28 04:49:46,574][106225] Updated weights for policy 1, policy_version 1334862 (0.0007) [2023-12-28 04:49:46,582][106226] Updated weights for policy 0, policy_version 1331535 (0.0006) [2023-12-28 04:49:46,634][106225] Updated weights for policy 1, policy_version 1334872 (0.0006) [2023-12-28 04:49:46,645][106226] Updated weights for policy 0, policy_version 1331545 (0.0005) [2023-12-28 04:49:47,204][106225] Updated weights for policy 1, policy_version 1334882 (0.0008) [2023-12-28 04:49:47,251][106226] Updated weights for policy 0, policy_version 1331555 (0.0006) [2023-12-28 04:49:47,262][106225] Updated weights for policy 1, policy_version 1334892 (0.0008) [2023-12-28 04:49:47,310][106226] Updated weights for policy 0, policy_version 1331565 (0.0009) [2023-12-28 04:49:47,320][106225] Updated weights for policy 1, policy_version 1334902 (0.0008) [2023-12-28 04:49:47,371][106226] Updated weights for policy 0, policy_version 1331575 (0.0008) [2023-12-28 04:49:48,035][106225] Updated weights for policy 1, policy_version 1334912 (0.0009) [2023-12-28 04:49:48,062][106226] Updated weights for policy 0, policy_version 1331585 (0.0008) [2023-12-28 04:49:48,084][106225] Updated weights for policy 1, policy_version 1334922 (0.0008) [2023-12-28 04:49:48,120][106226] Updated weights for policy 0, policy_version 1331595 (0.0008) [2023-12-28 04:49:48,148][106225] Updated weights for policy 1, policy_version 1334932 (0.0007) [2023-12-28 04:49:48,178][106226] Updated weights for policy 0, policy_version 1331605 (0.0007) [2023-12-28 04:49:48,229][106226] Updated weights for policy 0, policy_version 1331615 (0.0009) [2023-12-28 04:49:48,884][106225] Updated weights for policy 1, policy_version 1334942 (0.0008) [2023-12-28 04:49:48,935][106225] Updated weights for policy 1, policy_version 1334952 (0.0006) [2023-12-28 04:49:48,973][106226] Updated weights for policy 0, policy_version 1331625 (0.0009) [2023-12-28 04:49:48,989][106225] Updated weights for policy 1, policy_version 1334962 (0.0005) [2023-12-28 04:49:49,025][106226] Updated weights for policy 0, policy_version 1331635 (0.0008) [2023-12-28 04:49:49,077][106226] Updated weights for policy 0, policy_version 1331645 (0.0008) [2023-12-28 04:49:49,697][106225] Updated weights for policy 1, policy_version 1334972 (0.0007) [2023-12-28 04:49:49,751][106225] Updated weights for policy 1, policy_version 1334982 (0.0009) [2023-12-28 04:49:49,800][106225] Updated weights for policy 1, policy_version 1334992 (0.0009) [2023-12-28 04:49:49,828][106226] Updated weights for policy 0, policy_version 1331655 (0.0008) [2023-12-28 04:49:49,889][106226] Updated weights for policy 0, policy_version 1331665 (0.0008) [2023-12-28 04:49:49,953][106226] Updated weights for policy 0, policy_version 1331675 (0.0009) [2023-12-28 04:49:50,619][106225] Updated weights for policy 1, policy_version 1335002 (0.0007) [2023-12-28 04:49:50,679][106225] Updated weights for policy 1, policy_version 1335012 (0.0008) [2023-12-28 04:49:50,684][106226] Updated weights for policy 0, policy_version 1331685 (0.0009) [2023-12-28 04:49:50,741][106225] Updated weights for policy 1, policy_version 1335022 (0.0008) [2023-12-28 04:49:50,750][106226] Updated weights for policy 0, policy_version 1331695 (0.0008) [2023-12-28 04:49:50,804][106225] Updated weights for policy 1, policy_version 1335032 (0.0006) [2023-12-28 04:49:50,814][106226] Updated weights for policy 0, policy_version 1331705 (0.0007) [2023-12-28 04:49:51,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 682803200. Throughput: 0: 10087.2, 1: 9811.5. Samples: 682811816. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:49:51,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.791')] [2023-12-28 04:49:51,556][106225] Updated weights for policy 1, policy_version 1335042 (0.0008) [2023-12-28 04:49:51,562][106226] Updated weights for policy 0, policy_version 1331715 (0.0008) [2023-12-28 04:49:51,620][106225] Updated weights for policy 1, policy_version 1335052 (0.0008) [2023-12-28 04:49:51,628][106226] Updated weights for policy 0, policy_version 1331725 (0.0006) [2023-12-28 04:49:51,680][106225] Updated weights for policy 1, policy_version 1335062 (0.0008) [2023-12-28 04:49:51,691][106226] Updated weights for policy 0, policy_version 1331735 (0.0008) [2023-12-28 04:49:52,411][106225] Updated weights for policy 1, policy_version 1335072 (0.0008) [2023-12-28 04:49:52,428][106226] Updated weights for policy 0, policy_version 1331745 (0.0008) [2023-12-28 04:49:52,466][106225] Updated weights for policy 1, policy_version 1335082 (0.0005) [2023-12-28 04:49:52,488][106226] Updated weights for policy 0, policy_version 1331755 (0.0008) [2023-12-28 04:49:52,525][106225] Updated weights for policy 1, policy_version 1335092 (0.0005) [2023-12-28 04:49:52,546][106226] Updated weights for policy 0, policy_version 1331765 (0.0007) [2023-12-28 04:49:52,607][106226] Updated weights for policy 0, policy_version 1331775 (0.0010) [2023-12-28 04:49:53,108][106225] Updated weights for policy 1, policy_version 1335102 (0.0007) [2023-12-28 04:49:53,154][106225] Updated weights for policy 1, policy_version 1335112 (0.0005) [2023-12-28 04:49:53,200][106225] Updated weights for policy 1, policy_version 1335122 (0.0005) [2023-12-28 04:49:53,418][106226] Updated weights for policy 0, policy_version 1331785 (0.0008) [2023-12-28 04:49:53,481][106226] Updated weights for policy 0, policy_version 1331795 (0.0008) [2023-12-28 04:49:53,545][106226] Updated weights for policy 0, policy_version 1331805 (0.0009) [2023-12-28 04:49:53,842][106225] Updated weights for policy 1, policy_version 1335132 (0.0007) [2023-12-28 04:49:53,895][106225] Updated weights for policy 1, policy_version 1335142 (0.0008) [2023-12-28 04:49:53,953][106225] Updated weights for policy 1, policy_version 1335152 (0.0009) [2023-12-28 04:49:54,243][106226] Updated weights for policy 0, policy_version 1331815 (0.0008) [2023-12-28 04:49:54,307][106226] Updated weights for policy 0, policy_version 1331825 (0.0008) [2023-12-28 04:49:54,361][106226] Updated weights for policy 0, policy_version 1331835 (0.0005) [2023-12-28 04:49:54,712][106225] Updated weights for policy 1, policy_version 1335162 (0.0008) [2023-12-28 04:49:54,771][106225] Updated weights for policy 1, policy_version 1335172 (0.0009) [2023-12-28 04:49:54,815][106225] Updated weights for policy 1, policy_version 1335182 (0.0008) [2023-12-28 04:49:54,867][106225] Updated weights for policy 1, policy_version 1335192 (0.0008) [2023-12-28 04:49:54,947][106226] Updated weights for policy 0, policy_version 1331845 (0.0005) [2023-12-28 04:49:55,016][106226] Updated weights for policy 0, policy_version 1331855 (0.0006) [2023-12-28 04:49:55,069][106226] Updated weights for policy 0, policy_version 1331865 (0.0005) [2023-12-28 04:49:55,586][106225] Updated weights for policy 1, policy_version 1335202 (0.0008) [2023-12-28 04:49:55,636][106225] Updated weights for policy 1, policy_version 1335212 (0.0008) [2023-12-28 04:49:55,645][106226] Updated weights for policy 0, policy_version 1331875 (0.0006) [2023-12-28 04:49:55,693][106225] Updated weights for policy 1, policy_version 1335222 (0.0008) [2023-12-28 04:49:55,704][106226] Updated weights for policy 0, policy_version 1331885 (0.0010) [2023-12-28 04:49:55,763][106226] Updated weights for policy 0, policy_version 1331895 (0.0008) [2023-12-28 04:49:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19688.5). Total num frames: 682901504. Throughput: 0: 9967.9, 1: 9833.6. Samples: 682869660. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:49:56,176][105115] Avg episode reward: [(0, '-4.835'), (1, '-4.877')] [2023-12-28 04:49:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001331904_341032960.pth... [2023-12-28 04:49:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001335224_341868544.pth... [2023-12-28 04:49:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001330752_340738048.pth [2023-12-28 04:49:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001334072_341573632.pth [2023-12-28 04:49:56,398][106225] Updated weights for policy 1, policy_version 1335232 (0.0009) [2023-12-28 04:49:56,448][106225] Updated weights for policy 1, policy_version 1335242 (0.0005) [2023-12-28 04:49:56,482][106226] Updated weights for policy 0, policy_version 1331905 (0.0009) [2023-12-28 04:49:56,501][106225] Updated weights for policy 1, policy_version 1335252 (0.0005) [2023-12-28 04:49:56,530][106226] Updated weights for policy 0, policy_version 1331915 (0.0008) [2023-12-28 04:49:56,579][106226] Updated weights for policy 0, policy_version 1331925 (0.0008) [2023-12-28 04:49:56,631][106226] Updated weights for policy 0, policy_version 1331935 (0.0008) [2023-12-28 04:49:57,110][106225] Updated weights for policy 1, policy_version 1335262 (0.0006) [2023-12-28 04:49:57,174][106225] Updated weights for policy 1, policy_version 1335272 (0.0005) [2023-12-28 04:49:57,237][106225] Updated weights for policy 1, policy_version 1335282 (0.0005) [2023-12-28 04:49:57,368][106226] Updated weights for policy 0, policy_version 1331945 (0.0010) [2023-12-28 04:49:57,438][106226] Updated weights for policy 0, policy_version 1331955 (0.0009) [2023-12-28 04:49:57,503][106226] Updated weights for policy 0, policy_version 1331965 (0.0009) [2023-12-28 04:49:57,826][106225] Updated weights for policy 1, policy_version 1335292 (0.0008) [2023-12-28 04:49:57,889][106225] Updated weights for policy 1, policy_version 1335302 (0.0009) [2023-12-28 04:49:57,957][106225] Updated weights for policy 1, policy_version 1335312 (0.0008) [2023-12-28 04:49:58,183][106226] Updated weights for policy 0, policy_version 1331975 (0.0009) [2023-12-28 04:49:58,261][106226] Updated weights for policy 0, policy_version 1331985 (0.0009) [2023-12-28 04:49:58,332][106226] Updated weights for policy 0, policy_version 1331995 (0.0010) [2023-12-28 04:49:58,787][106225] Updated weights for policy 1, policy_version 1335322 (0.0008) [2023-12-28 04:49:58,857][106225] Updated weights for policy 1, policy_version 1335332 (0.0009) [2023-12-28 04:49:58,917][106225] Updated weights for policy 1, policy_version 1335342 (0.0010) [2023-12-28 04:49:58,979][106225] Updated weights for policy 1, policy_version 1335352 (0.0010) [2023-12-28 04:49:59,172][106226] Updated weights for policy 0, policy_version 1332005 (0.0007) [2023-12-28 04:49:59,236][106226] Updated weights for policy 0, policy_version 1332015 (0.0008) [2023-12-28 04:49:59,298][106226] Updated weights for policy 0, policy_version 1332025 (0.0008) [2023-12-28 04:49:59,747][106225] Updated weights for policy 1, policy_version 1335362 (0.0010) [2023-12-28 04:49:59,795][106225] Updated weights for policy 1, policy_version 1335372 (0.0010) [2023-12-28 04:49:59,859][106225] Updated weights for policy 1, policy_version 1335382 (0.0010) [2023-12-28 04:50:00,042][106226] Updated weights for policy 0, policy_version 1332035 (0.0008) [2023-12-28 04:50:00,103][106226] Updated weights for policy 0, policy_version 1332045 (0.0008) [2023-12-28 04:50:00,159][106226] Updated weights for policy 0, policy_version 1332055 (0.0007) [2023-12-28 04:50:00,613][106225] Updated weights for policy 1, policy_version 1335392 (0.0007) [2023-12-28 04:50:00,671][106225] Updated weights for policy 1, policy_version 1335402 (0.0008) [2023-12-28 04:50:00,722][106225] Updated weights for policy 1, policy_version 1335412 (0.0008) [2023-12-28 04:50:00,904][106226] Updated weights for policy 0, policy_version 1332065 (0.0008) [2023-12-28 04:50:00,950][106226] Updated weights for policy 0, policy_version 1332075 (0.0006) [2023-12-28 04:50:01,006][106226] Updated weights for policy 0, policy_version 1332085 (0.0010) [2023-12-28 04:50:01,074][106226] Updated weights for policy 0, policy_version 1332095 (0.0008) [2023-12-28 04:50:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 682999808. Throughput: 0: 9965.6, 1: 9938.0. Samples: 682988064. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:01,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.747')] [2023-12-28 04:50:01,416][106225] Updated weights for policy 1, policy_version 1335422 (0.0008) [2023-12-28 04:50:01,475][106225] Updated weights for policy 1, policy_version 1335432 (0.0008) [2023-12-28 04:50:01,535][106225] Updated weights for policy 1, policy_version 1335442 (0.0006) [2023-12-28 04:50:01,819][106226] Updated weights for policy 0, policy_version 1332105 (0.0008) [2023-12-28 04:50:01,895][106226] Updated weights for policy 0, policy_version 1332115 (0.0009) [2023-12-28 04:50:01,960][106226] Updated weights for policy 0, policy_version 1332125 (0.0008) [2023-12-28 04:50:02,298][106225] Updated weights for policy 1, policy_version 1335452 (0.0007) [2023-12-28 04:50:02,370][106225] Updated weights for policy 1, policy_version 1335462 (0.0008) [2023-12-28 04:50:02,427][106225] Updated weights for policy 1, policy_version 1335472 (0.0010) [2023-12-28 04:50:02,650][106226] Updated weights for policy 0, policy_version 1332135 (0.0009) [2023-12-28 04:50:02,701][106226] Updated weights for policy 0, policy_version 1332145 (0.0009) [2023-12-28 04:50:02,757][106226] Updated weights for policy 0, policy_version 1332155 (0.0008) [2023-12-28 04:50:03,087][106225] Updated weights for policy 1, policy_version 1335482 (0.0009) [2023-12-28 04:50:03,147][106225] Updated weights for policy 1, policy_version 1335492 (0.0008) [2023-12-28 04:50:03,204][106225] Updated weights for policy 1, policy_version 1335502 (0.0008) [2023-12-28 04:50:03,261][106225] Updated weights for policy 1, policy_version 1335512 (0.0008) [2023-12-28 04:50:03,531][106226] Updated weights for policy 0, policy_version 1332165 (0.0009) [2023-12-28 04:50:03,578][106226] Updated weights for policy 0, policy_version 1332175 (0.0009) [2023-12-28 04:50:03,624][106226] Updated weights for policy 0, policy_version 1332185 (0.0008) [2023-12-28 04:50:03,922][106225] Updated weights for policy 1, policy_version 1335522 (0.0007) [2023-12-28 04:50:03,988][106225] Updated weights for policy 1, policy_version 1335532 (0.0007) [2023-12-28 04:50:04,053][106225] Updated weights for policy 1, policy_version 1335542 (0.0010) [2023-12-28 04:50:04,322][106226] Updated weights for policy 0, policy_version 1332195 (0.0008) [2023-12-28 04:50:04,389][106226] Updated weights for policy 0, policy_version 1332205 (0.0006) [2023-12-28 04:50:04,454][106226] Updated weights for policy 0, policy_version 1332215 (0.0007) [2023-12-28 04:50:04,716][106225] Updated weights for policy 1, policy_version 1335552 (0.0010) [2023-12-28 04:50:04,773][106225] Updated weights for policy 1, policy_version 1335562 (0.0010) [2023-12-28 04:50:04,839][106225] Updated weights for policy 1, policy_version 1335572 (0.0010) [2023-12-28 04:50:05,092][106226] Updated weights for policy 0, policy_version 1332225 (0.0009) [2023-12-28 04:50:05,139][106226] Updated weights for policy 0, policy_version 1332235 (0.0007) [2023-12-28 04:50:05,197][106226] Updated weights for policy 0, policy_version 1332245 (0.0007) [2023-12-28 04:50:05,251][106226] Updated weights for policy 0, policy_version 1332255 (0.0008) [2023-12-28 04:50:05,539][106225] Updated weights for policy 1, policy_version 1335582 (0.0008) [2023-12-28 04:50:05,596][106225] Updated weights for policy 1, policy_version 1335592 (0.0010) [2023-12-28 04:50:05,652][106225] Updated weights for policy 1, policy_version 1335602 (0.0010) [2023-12-28 04:50:06,016][106226] Updated weights for policy 0, policy_version 1332265 (0.0008) [2023-12-28 04:50:06,062][106226] Updated weights for policy 0, policy_version 1332275 (0.0008) [2023-12-28 04:50:06,117][106226] Updated weights for policy 0, policy_version 1332285 (0.0008) [2023-12-28 04:50:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 683098112. Throughput: 0: 9936.6, 1: 9891.3. Samples: 683104548. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:06,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.756')] [2023-12-28 04:50:06,360][106225] Updated weights for policy 1, policy_version 1335612 (0.0010) [2023-12-28 04:50:06,420][106225] Updated weights for policy 1, policy_version 1335622 (0.0010) [2023-12-28 04:50:06,481][106225] Updated weights for policy 1, policy_version 1335632 (0.0011) [2023-12-28 04:50:06,870][106226] Updated weights for policy 0, policy_version 1332295 (0.0010) [2023-12-28 04:50:06,922][106226] Updated weights for policy 0, policy_version 1332305 (0.0011) [2023-12-28 04:50:06,980][106226] Updated weights for policy 0, policy_version 1332315 (0.0008) [2023-12-28 04:50:07,218][106225] Updated weights for policy 1, policy_version 1335642 (0.0010) [2023-12-28 04:50:07,281][106225] Updated weights for policy 1, policy_version 1335652 (0.0010) [2023-12-28 04:50:07,345][106225] Updated weights for policy 1, policy_version 1335662 (0.0008) [2023-12-28 04:50:07,402][106225] Updated weights for policy 1, policy_version 1335672 (0.0008) [2023-12-28 04:50:07,699][106226] Updated weights for policy 0, policy_version 1332325 (0.0006) [2023-12-28 04:50:07,753][106226] Updated weights for policy 0, policy_version 1332335 (0.0009) [2023-12-28 04:50:07,800][106226] Updated weights for policy 0, policy_version 1332345 (0.0010) [2023-12-28 04:50:08,044][106225] Updated weights for policy 1, policy_version 1335682 (0.0006) [2023-12-28 04:50:08,118][106225] Updated weights for policy 1, policy_version 1335692 (0.0005) [2023-12-28 04:50:08,179][106225] Updated weights for policy 1, policy_version 1335702 (0.0008) [2023-12-28 04:50:08,441][106226] Updated weights for policy 0, policy_version 1332355 (0.0009) [2023-12-28 04:50:08,508][106226] Updated weights for policy 0, policy_version 1332365 (0.0005) [2023-12-28 04:50:08,577][106226] Updated weights for policy 0, policy_version 1332375 (0.0008) [2023-12-28 04:50:08,809][106225] Updated weights for policy 1, policy_version 1335712 (0.0007) [2023-12-28 04:50:08,870][106225] Updated weights for policy 1, policy_version 1335722 (0.0008) [2023-12-28 04:50:08,928][106225] Updated weights for policy 1, policy_version 1335732 (0.0008) [2023-12-28 04:50:09,243][106226] Updated weights for policy 0, policy_version 1332385 (0.0011) [2023-12-28 04:50:09,304][106226] Updated weights for policy 0, policy_version 1332395 (0.0010) [2023-12-28 04:50:09,371][106226] Updated weights for policy 0, policy_version 1332405 (0.0008) [2023-12-28 04:50:09,445][106226] Updated weights for policy 0, policy_version 1332415 (0.0009) [2023-12-28 04:50:09,679][106225] Updated weights for policy 1, policy_version 1335742 (0.0008) [2023-12-28 04:50:09,741][106225] Updated weights for policy 1, policy_version 1335752 (0.0007) [2023-12-28 04:50:09,810][106225] Updated weights for policy 1, policy_version 1335762 (0.0005) [2023-12-28 04:50:10,305][106226] Updated weights for policy 0, policy_version 1332425 (0.0009) [2023-12-28 04:50:10,374][106226] Updated weights for policy 0, policy_version 1332435 (0.0008) [2023-12-28 04:50:10,442][106226] Updated weights for policy 0, policy_version 1332445 (0.0009) [2023-12-28 04:50:10,507][106225] Updated weights for policy 1, policy_version 1335772 (0.0009) [2023-12-28 04:50:10,573][106225] Updated weights for policy 1, policy_version 1335782 (0.0005) [2023-12-28 04:50:10,629][106225] Updated weights for policy 1, policy_version 1335792 (0.0006) [2023-12-28 04:50:11,174][106226] Updated weights for policy 0, policy_version 1332455 (0.0009) [2023-12-28 04:50:11,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 683188224. Throughput: 0: 9920.6, 1: 9936.5. Samples: 683164780. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:11,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.684')] [2023-12-28 04:50:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001335800_342016000.pth... [2023-12-28 04:50:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001334648_341721088.pth [2023-12-28 04:50:11,247][106226] Updated weights for policy 0, policy_version 1332465 (0.0007) [2023-12-28 04:50:11,319][106226] Updated weights for policy 0, policy_version 1332475 (0.0008) [2023-12-28 04:50:11,351][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001332480_341180416.pth... [2023-12-28 04:50:11,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001331328_340885504.pth [2023-12-28 04:50:11,369][106225] Updated weights for policy 1, policy_version 1335802 (0.0007) [2023-12-28 04:50:11,433][106225] Updated weights for policy 1, policy_version 1335812 (0.0008) [2023-12-28 04:50:11,487][106225] Updated weights for policy 1, policy_version 1335822 (0.0008) [2023-12-28 04:50:11,535][106225] Updated weights for policy 1, policy_version 1335832 (0.0008) [2023-12-28 04:50:12,053][106226] Updated weights for policy 0, policy_version 1332485 (0.0009) [2023-12-28 04:50:12,118][106226] Updated weights for policy 0, policy_version 1332495 (0.0008) [2023-12-28 04:50:12,183][106226] Updated weights for policy 0, policy_version 1332505 (0.0008) [2023-12-28 04:50:12,333][106225] Updated weights for policy 1, policy_version 1335842 (0.0009) [2023-12-28 04:50:12,400][106225] Updated weights for policy 1, policy_version 1335852 (0.0009) [2023-12-28 04:50:12,464][106225] Updated weights for policy 1, policy_version 1335862 (0.0007) [2023-12-28 04:50:12,845][106226] Updated weights for policy 0, policy_version 1332515 (0.0006) [2023-12-28 04:50:12,906][106226] Updated weights for policy 0, policy_version 1332525 (0.0009) [2023-12-28 04:50:12,966][106226] Updated weights for policy 0, policy_version 1332535 (0.0009) [2023-12-28 04:50:13,221][106225] Updated weights for policy 1, policy_version 1335872 (0.0009) [2023-12-28 04:50:13,276][106225] Updated weights for policy 1, policy_version 1335882 (0.0009) [2023-12-28 04:50:13,325][106225] Updated weights for policy 1, policy_version 1335892 (0.0008) [2023-12-28 04:50:13,632][106226] Updated weights for policy 0, policy_version 1332545 (0.0009) [2023-12-28 04:50:13,685][106226] Updated weights for policy 0, policy_version 1332555 (0.0006) [2023-12-28 04:50:13,740][106226] Updated weights for policy 0, policy_version 1332565 (0.0005) [2023-12-28 04:50:13,796][106226] Updated weights for policy 0, policy_version 1332575 (0.0005) [2023-12-28 04:50:14,104][106225] Updated weights for policy 1, policy_version 1335902 (0.0009) [2023-12-28 04:50:14,150][106225] Updated weights for policy 1, policy_version 1335912 (0.0009) [2023-12-28 04:50:14,212][106225] Updated weights for policy 1, policy_version 1335922 (0.0008) [2023-12-28 04:50:14,455][106226] Updated weights for policy 0, policy_version 1332585 (0.0006) [2023-12-28 04:50:14,507][106226] Updated weights for policy 0, policy_version 1332595 (0.0005) [2023-12-28 04:50:14,564][106226] Updated weights for policy 0, policy_version 1332605 (0.0005) [2023-12-28 04:50:15,021][106225] Updated weights for policy 1, policy_version 1335932 (0.0008) [2023-12-28 04:50:15,077][106225] Updated weights for policy 1, policy_version 1335942 (0.0008) [2023-12-28 04:50:15,129][106225] Updated weights for policy 1, policy_version 1335952 (0.0008) [2023-12-28 04:50:15,306][106226] Updated weights for policy 0, policy_version 1332615 (0.0010) [2023-12-28 04:50:15,371][106226] Updated weights for policy 0, policy_version 1332625 (0.0011) [2023-12-28 04:50:15,429][106226] Updated weights for policy 0, policy_version 1332635 (0.0011) [2023-12-28 04:50:15,872][106225] Updated weights for policy 1, policy_version 1335962 (0.0008) [2023-12-28 04:50:15,922][106225] Updated weights for policy 1, policy_version 1335972 (0.0008) [2023-12-28 04:50:15,975][106225] Updated weights for policy 1, policy_version 1335982 (0.0008) [2023-12-28 04:50:16,035][106225] Updated weights for policy 1, policy_version 1335992 (0.0008) [2023-12-28 04:50:16,140][106226] Updated weights for policy 0, policy_version 1332645 (0.0011) [2023-12-28 04:50:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 683286528. Throughput: 0: 9821.4, 1: 9784.4. Samples: 683277944. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:16,175][105115] Avg episode reward: [(0, '-4.531'), (1, '-4.779')] [2023-12-28 04:50:16,190][106226] Updated weights for policy 0, policy_version 1332655 (0.0010) [2023-12-28 04:50:16,253][106226] Updated weights for policy 0, policy_version 1332665 (0.0010) [2023-12-28 04:50:16,784][106225] Updated weights for policy 1, policy_version 1336002 (0.0006) [2023-12-28 04:50:16,830][106225] Updated weights for policy 1, policy_version 1336012 (0.0007) [2023-12-28 04:50:16,886][106225] Updated weights for policy 1, policy_version 1336022 (0.0008) [2023-12-28 04:50:16,963][106226] Updated weights for policy 0, policy_version 1332675 (0.0010) [2023-12-28 04:50:17,023][106226] Updated weights for policy 0, policy_version 1332685 (0.0011) [2023-12-28 04:50:17,073][106226] Updated weights for policy 0, policy_version 1332695 (0.0010) [2023-12-28 04:50:17,620][106225] Updated weights for policy 1, policy_version 1336032 (0.0010) [2023-12-28 04:50:17,662][106226] Updated weights for policy 0, policy_version 1332705 (0.0010) [2023-12-28 04:50:17,678][106225] Updated weights for policy 1, policy_version 1336042 (0.0009) [2023-12-28 04:50:17,718][106226] Updated weights for policy 0, policy_version 1332715 (0.0011) [2023-12-28 04:50:17,735][106225] Updated weights for policy 1, policy_version 1336052 (0.0010) [2023-12-28 04:50:17,775][106226] Updated weights for policy 0, policy_version 1332725 (0.0011) [2023-12-28 04:50:17,829][106226] Updated weights for policy 0, policy_version 1332735 (0.0010) [2023-12-28 04:50:18,451][106225] Updated weights for policy 1, policy_version 1336062 (0.0010) [2023-12-28 04:50:18,472][106226] Updated weights for policy 0, policy_version 1332745 (0.0009) [2023-12-28 04:50:18,509][106225] Updated weights for policy 1, policy_version 1336072 (0.0010) [2023-12-28 04:50:18,538][106226] Updated weights for policy 0, policy_version 1332755 (0.0010) [2023-12-28 04:50:18,563][106225] Updated weights for policy 1, policy_version 1336082 (0.0010) [2023-12-28 04:50:18,599][106226] Updated weights for policy 0, policy_version 1332765 (0.0011) [2023-12-28 04:50:19,211][106226] Updated weights for policy 0, policy_version 1332775 (0.0010) [2023-12-28 04:50:19,222][106225] Updated weights for policy 1, policy_version 1336092 (0.0009) [2023-12-28 04:50:19,280][106226] Updated weights for policy 0, policy_version 1332785 (0.0008) [2023-12-28 04:50:19,291][106225] Updated weights for policy 1, policy_version 1336102 (0.0009) [2023-12-28 04:50:19,348][106226] Updated weights for policy 0, policy_version 1332795 (0.0011) [2023-12-28 04:50:19,365][106225] Updated weights for policy 1, policy_version 1336112 (0.0007) [2023-12-28 04:50:20,043][106225] Updated weights for policy 1, policy_version 1336122 (0.0006) [2023-12-28 04:50:20,050][106226] Updated weights for policy 0, policy_version 1332805 (0.0011) [2023-12-28 04:50:20,097][106225] Updated weights for policy 1, policy_version 1336132 (0.0009) [2023-12-28 04:50:20,113][106226] Updated weights for policy 0, policy_version 1332815 (0.0011) [2023-12-28 04:50:20,158][106225] Updated weights for policy 1, policy_version 1336142 (0.0008) [2023-12-28 04:50:20,172][106226] Updated weights for policy 0, policy_version 1332825 (0.0011) [2023-12-28 04:50:20,217][106225] Updated weights for policy 1, policy_version 1336152 (0.0006) [2023-12-28 04:50:20,904][106226] Updated weights for policy 0, policy_version 1332835 (0.0010) [2023-12-28 04:50:20,970][106226] Updated weights for policy 0, policy_version 1332845 (0.0006) [2023-12-28 04:50:20,983][106225] Updated weights for policy 1, policy_version 1336162 (0.0007) [2023-12-28 04:50:21,042][106226] Updated weights for policy 0, policy_version 1332855 (0.0009) [2023-12-28 04:50:21,045][106225] Updated weights for policy 1, policy_version 1336172 (0.0008) [2023-12-28 04:50:21,115][106225] Updated weights for policy 1, policy_version 1336182 (0.0009) [2023-12-28 04:50:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 683393024. Throughput: 0: 9813.7, 1: 9737.0. Samples: 683395932. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:21,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.539')] [2023-12-28 04:50:21,810][106226] Updated weights for policy 0, policy_version 1332865 (0.0008) [2023-12-28 04:50:21,878][106226] Updated weights for policy 0, policy_version 1332875 (0.0009) [2023-12-28 04:50:21,937][106226] Updated weights for policy 0, policy_version 1332885 (0.0009) [2023-12-28 04:50:21,946][106225] Updated weights for policy 1, policy_version 1336192 (0.0009) [2023-12-28 04:50:22,000][106226] Updated weights for policy 0, policy_version 1332895 (0.0006) [2023-12-28 04:50:22,002][106225] Updated weights for policy 1, policy_version 1336202 (0.0007) [2023-12-28 04:50:22,058][106225] Updated weights for policy 1, policy_version 1336212 (0.0009) [2023-12-28 04:50:22,692][106226] Updated weights for policy 0, policy_version 1332905 (0.0009) [2023-12-28 04:50:22,756][106226] Updated weights for policy 0, policy_version 1332915 (0.0009) [2023-12-28 04:50:22,799][106225] Updated weights for policy 1, policy_version 1336222 (0.0007) [2023-12-28 04:50:22,822][106226] Updated weights for policy 0, policy_version 1332925 (0.0008) [2023-12-28 04:50:22,863][106225] Updated weights for policy 1, policy_version 1336232 (0.0006) [2023-12-28 04:50:22,921][106225] Updated weights for policy 1, policy_version 1336242 (0.0006) [2023-12-28 04:50:23,516][106226] Updated weights for policy 0, policy_version 1332935 (0.0009) [2023-12-28 04:50:23,578][106226] Updated weights for policy 0, policy_version 1332945 (0.0009) [2023-12-28 04:50:23,591][106225] Updated weights for policy 1, policy_version 1336252 (0.0008) [2023-12-28 04:50:23,636][106226] Updated weights for policy 0, policy_version 1332955 (0.0006) [2023-12-28 04:50:23,650][106225] Updated weights for policy 1, policy_version 1336262 (0.0006) [2023-12-28 04:50:23,708][106225] Updated weights for policy 1, policy_version 1336272 (0.0007) [2023-12-28 04:50:24,375][106226] Updated weights for policy 0, policy_version 1332965 (0.0007) [2023-12-28 04:50:24,384][106225] Updated weights for policy 1, policy_version 1336282 (0.0007) [2023-12-28 04:50:24,430][106226] Updated weights for policy 0, policy_version 1332975 (0.0011) [2023-12-28 04:50:24,439][106225] Updated weights for policy 1, policy_version 1336292 (0.0006) [2023-12-28 04:50:24,481][106226] Updated weights for policy 0, policy_version 1332985 (0.0010) [2023-12-28 04:50:24,496][106225] Updated weights for policy 1, policy_version 1336302 (0.0007) [2023-12-28 04:50:24,555][106225] Updated weights for policy 1, policy_version 1336312 (0.0007) [2023-12-28 04:50:25,192][106226] Updated weights for policy 0, policy_version 1332995 (0.0009) [2023-12-28 04:50:25,249][106225] Updated weights for policy 1, policy_version 1336322 (0.0008) [2023-12-28 04:50:25,255][106226] Updated weights for policy 0, policy_version 1333005 (0.0005) [2023-12-28 04:50:25,312][106225] Updated weights for policy 1, policy_version 1336332 (0.0007) [2023-12-28 04:50:25,317][106226] Updated weights for policy 0, policy_version 1333015 (0.0005) [2023-12-28 04:50:25,382][106225] Updated weights for policy 1, policy_version 1336342 (0.0006) [2023-12-28 04:50:25,941][106226] Updated weights for policy 0, policy_version 1333025 (0.0005) [2023-12-28 04:50:25,994][106226] Updated weights for policy 0, policy_version 1333035 (0.0005) [2023-12-28 04:50:26,046][106226] Updated weights for policy 0, policy_version 1333045 (0.0007) [2023-12-28 04:50:26,052][106225] Updated weights for policy 1, policy_version 1336352 (0.0006) [2023-12-28 04:50:26,102][106225] Updated weights for policy 1, policy_version 1336362 (0.0007) [2023-12-28 04:50:26,104][106226] Updated weights for policy 0, policy_version 1333055 (0.0007) [2023-12-28 04:50:26,162][106225] Updated weights for policy 1, policy_version 1336372 (0.0008) [2023-12-28 04:50:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 683483136. Throughput: 0: 9753.3, 1: 9718.3. Samples: 683452596. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:26,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.822')] [2023-12-28 04:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001336376_342163456.pth... [2023-12-28 04:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001333056_341327872.pth... [2023-12-28 04:50:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001335224_341868544.pth [2023-12-28 04:50:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001331904_341032960.pth [2023-12-28 04:50:26,740][106225] Updated weights for policy 1, policy_version 1336382 (0.0008) [2023-12-28 04:50:26,788][106225] Updated weights for policy 1, policy_version 1336392 (0.0008) [2023-12-28 04:50:26,799][106226] Updated weights for policy 0, policy_version 1333065 (0.0009) [2023-12-28 04:50:26,843][106225] Updated weights for policy 1, policy_version 1336402 (0.0007) [2023-12-28 04:50:26,849][106226] Updated weights for policy 0, policy_version 1333075 (0.0007) [2023-12-28 04:50:26,904][106226] Updated weights for policy 0, policy_version 1333085 (0.0006) [2023-12-28 04:50:27,459][106225] Updated weights for policy 1, policy_version 1336412 (0.0008) [2023-12-28 04:50:27,515][106225] Updated weights for policy 1, policy_version 1336422 (0.0008) [2023-12-28 04:50:27,569][106225] Updated weights for policy 1, policy_version 1336432 (0.0009) [2023-12-28 04:50:27,573][106226] Updated weights for policy 0, policy_version 1333095 (0.0006) [2023-12-28 04:50:27,632][106226] Updated weights for policy 0, policy_version 1333105 (0.0007) [2023-12-28 04:50:27,683][106226] Updated weights for policy 0, policy_version 1333115 (0.0008) [2023-12-28 04:50:28,294][106225] Updated weights for policy 1, policy_version 1336442 (0.0008) [2023-12-28 04:50:28,364][106225] Updated weights for policy 1, policy_version 1336452 (0.0009) [2023-12-28 04:50:28,413][106225] Updated weights for policy 1, policy_version 1336462 (0.0008) [2023-12-28 04:50:28,420][106226] Updated weights for policy 0, policy_version 1333125 (0.0007) [2023-12-28 04:50:28,465][106225] Updated weights for policy 1, policy_version 1336472 (0.0009) [2023-12-28 04:50:28,476][106226] Updated weights for policy 0, policy_version 1333135 (0.0006) [2023-12-28 04:50:28,533][106226] Updated weights for policy 0, policy_version 1333145 (0.0007) [2023-12-28 04:50:29,185][106225] Updated weights for policy 1, policy_version 1336482 (0.0008) [2023-12-28 04:50:29,244][106225] Updated weights for policy 1, policy_version 1336492 (0.0007) [2023-12-28 04:50:29,272][106226] Updated weights for policy 0, policy_version 1333155 (0.0009) [2023-12-28 04:50:29,306][106225] Updated weights for policy 1, policy_version 1336502 (0.0007) [2023-12-28 04:50:29,337][106226] Updated weights for policy 0, policy_version 1333165 (0.0008) [2023-12-28 04:50:29,404][106226] Updated weights for policy 0, policy_version 1333175 (0.0008) [2023-12-28 04:50:30,035][106225] Updated weights for policy 1, policy_version 1336512 (0.0007) [2023-12-28 04:50:30,086][106225] Updated weights for policy 1, policy_version 1336522 (0.0008) [2023-12-28 04:50:30,110][106226] Updated weights for policy 0, policy_version 1333185 (0.0007) [2023-12-28 04:50:30,140][106225] Updated weights for policy 1, policy_version 1336532 (0.0008) [2023-12-28 04:50:30,168][106226] Updated weights for policy 0, policy_version 1333195 (0.0006) [2023-12-28 04:50:30,230][106226] Updated weights for policy 0, policy_version 1333205 (0.0008) [2023-12-28 04:50:30,290][106226] Updated weights for policy 0, policy_version 1333215 (0.0008) [2023-12-28 04:50:30,881][106225] Updated weights for policy 1, policy_version 1336542 (0.0009) [2023-12-28 04:50:30,938][106225] Updated weights for policy 1, policy_version 1336552 (0.0010) [2023-12-28 04:50:30,994][106225] Updated weights for policy 1, policy_version 1336562 (0.0010) [2023-12-28 04:50:31,012][106226] Updated weights for policy 0, policy_version 1333225 (0.0008) [2023-12-28 04:50:31,074][106226] Updated weights for policy 0, policy_version 1333235 (0.0008) [2023-12-28 04:50:31,140][106226] Updated weights for policy 0, policy_version 1333245 (0.0009) [2023-12-28 04:50:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 683589632. Throughput: 0: 9769.5, 1: 9815.5. Samples: 683573860. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:31,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.496')] [2023-12-28 04:50:31,705][106225] Updated weights for policy 1, policy_version 1336572 (0.0010) [2023-12-28 04:50:31,768][106225] Updated weights for policy 1, policy_version 1336582 (0.0011) [2023-12-28 04:50:31,824][106225] Updated weights for policy 1, policy_version 1336592 (0.0010) [2023-12-28 04:50:31,887][106226] Updated weights for policy 0, policy_version 1333255 (0.0007) [2023-12-28 04:50:31,938][106226] Updated weights for policy 0, policy_version 1333265 (0.0008) [2023-12-28 04:50:31,993][106226] Updated weights for policy 0, policy_version 1333275 (0.0008) [2023-12-28 04:50:32,519][106225] Updated weights for policy 1, policy_version 1336602 (0.0009) [2023-12-28 04:50:32,584][106225] Updated weights for policy 1, policy_version 1336612 (0.0006) [2023-12-28 04:50:32,645][106225] Updated weights for policy 1, policy_version 1336622 (0.0006) [2023-12-28 04:50:32,699][106225] Updated weights for policy 1, policy_version 1336632 (0.0005) [2023-12-28 04:50:32,765][106226] Updated weights for policy 0, policy_version 1333285 (0.0008) [2023-12-28 04:50:32,825][106226] Updated weights for policy 0, policy_version 1333295 (0.0009) [2023-12-28 04:50:32,887][106226] Updated weights for policy 0, policy_version 1333305 (0.0009) [2023-12-28 04:50:33,256][106225] Updated weights for policy 1, policy_version 1336642 (0.0008) [2023-12-28 04:50:33,311][106225] Updated weights for policy 1, policy_version 1336652 (0.0008) [2023-12-28 04:50:33,363][106225] Updated weights for policy 1, policy_version 1336662 (0.0006) [2023-12-28 04:50:33,688][106226] Updated weights for policy 0, policy_version 1333315 (0.0010) [2023-12-28 04:50:33,742][106226] Updated weights for policy 0, policy_version 1333325 (0.0009) [2023-12-28 04:50:33,796][106226] Updated weights for policy 0, policy_version 1333335 (0.0008) [2023-12-28 04:50:33,944][106225] Updated weights for policy 1, policy_version 1336672 (0.0008) [2023-12-28 04:50:34,001][106225] Updated weights for policy 1, policy_version 1336682 (0.0010) [2023-12-28 04:50:34,057][106225] Updated weights for policy 1, policy_version 1336692 (0.0009) [2023-12-28 04:50:34,479][106226] Updated weights for policy 0, policy_version 1333345 (0.0008) [2023-12-28 04:50:34,544][106226] Updated weights for policy 0, policy_version 1333355 (0.0009) [2023-12-28 04:50:34,601][106226] Updated weights for policy 0, policy_version 1333365 (0.0008) [2023-12-28 04:50:34,667][106226] Updated weights for policy 0, policy_version 1333375 (0.0007) [2023-12-28 04:50:34,760][106225] Updated weights for policy 1, policy_version 1336702 (0.0007) [2023-12-28 04:50:34,812][106225] Updated weights for policy 1, policy_version 1336712 (0.0009) [2023-12-28 04:50:34,861][106225] Updated weights for policy 1, policy_version 1336722 (0.0008) [2023-12-28 04:50:35,294][106226] Updated weights for policy 0, policy_version 1333385 (0.0008) [2023-12-28 04:50:35,355][106226] Updated weights for policy 0, policy_version 1333395 (0.0009) [2023-12-28 04:50:35,417][106226] Updated weights for policy 0, policy_version 1333405 (0.0009) [2023-12-28 04:50:35,584][106225] Updated weights for policy 1, policy_version 1336732 (0.0007) [2023-12-28 04:50:35,639][106225] Updated weights for policy 1, policy_version 1336742 (0.0009) [2023-12-28 04:50:35,688][106225] Updated weights for policy 1, policy_version 1336752 (0.0009) [2023-12-28 04:50:36,054][106226] Updated weights for policy 0, policy_version 1333415 (0.0007) [2023-12-28 04:50:36,119][106226] Updated weights for policy 0, policy_version 1333425 (0.0006) [2023-12-28 04:50:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 683679744. Throughput: 0: 9762.1, 1: 9834.6. Samples: 683693668. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:36,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.881')] [2023-12-28 04:50:36,180][106226] Updated weights for policy 0, policy_version 1333435 (0.0009) [2023-12-28 04:50:36,433][106225] Updated weights for policy 1, policy_version 1336762 (0.0009) [2023-12-28 04:50:36,500][106225] Updated weights for policy 1, policy_version 1336772 (0.0009) [2023-12-28 04:50:36,559][106225] Updated weights for policy 1, policy_version 1336782 (0.0008) [2023-12-28 04:50:36,619][106225] Updated weights for policy 1, policy_version 1336792 (0.0005) [2023-12-28 04:50:36,907][106226] Updated weights for policy 0, policy_version 1333445 (0.0011) [2023-12-28 04:50:36,967][106226] Updated weights for policy 0, policy_version 1333455 (0.0011) [2023-12-28 04:50:37,027][106226] Updated weights for policy 0, policy_version 1333465 (0.0011) [2023-12-28 04:50:37,346][106225] Updated weights for policy 1, policy_version 1336802 (0.0008) [2023-12-28 04:50:37,405][106225] Updated weights for policy 1, policy_version 1336812 (0.0007) [2023-12-28 04:50:37,468][106225] Updated weights for policy 1, policy_version 1336822 (0.0008) [2023-12-28 04:50:37,716][106226] Updated weights for policy 0, policy_version 1333475 (0.0010) [2023-12-28 04:50:37,766][106226] Updated weights for policy 0, policy_version 1333485 (0.0010) [2023-12-28 04:50:37,831][106226] Updated weights for policy 0, policy_version 1333495 (0.0011) [2023-12-28 04:50:38,206][106225] Updated weights for policy 1, policy_version 1336832 (0.0008) [2023-12-28 04:50:38,263][106225] Updated weights for policy 1, policy_version 1336842 (0.0008) [2023-12-28 04:50:38,320][106225] Updated weights for policy 1, policy_version 1336852 (0.0008) [2023-12-28 04:50:38,537][106226] Updated weights for policy 0, policy_version 1333505 (0.0011) [2023-12-28 04:50:38,592][106226] Updated weights for policy 0, policy_version 1333515 (0.0008) [2023-12-28 04:50:38,656][106226] Updated weights for policy 0, policy_version 1333525 (0.0009) [2023-12-28 04:50:38,715][106226] Updated weights for policy 0, policy_version 1333535 (0.0008) [2023-12-28 04:50:39,109][106225] Updated weights for policy 1, policy_version 1336862 (0.0009) [2023-12-28 04:50:39,158][106225] Updated weights for policy 1, policy_version 1336872 (0.0009) [2023-12-28 04:50:39,210][106225] Updated weights for policy 1, policy_version 1336882 (0.0008) [2023-12-28 04:50:39,379][106226] Updated weights for policy 0, policy_version 1333545 (0.0010) [2023-12-28 04:50:39,443][106226] Updated weights for policy 0, policy_version 1333555 (0.0008) [2023-12-28 04:50:39,511][106226] Updated weights for policy 0, policy_version 1333565 (0.0006) [2023-12-28 04:50:39,972][106225] Updated weights for policy 1, policy_version 1336892 (0.0007) [2023-12-28 04:50:40,031][106225] Updated weights for policy 1, policy_version 1336902 (0.0008) [2023-12-28 04:50:40,088][106225] Updated weights for policy 1, policy_version 1336912 (0.0009) [2023-12-28 04:50:40,182][106226] Updated weights for policy 0, policy_version 1333575 (0.0008) [2023-12-28 04:50:40,250][106226] Updated weights for policy 0, policy_version 1333585 (0.0009) [2023-12-28 04:50:40,317][106226] Updated weights for policy 0, policy_version 1333595 (0.0009) [2023-12-28 04:50:40,821][106225] Updated weights for policy 1, policy_version 1336922 (0.0008) [2023-12-28 04:50:40,882][106225] Updated weights for policy 1, policy_version 1336932 (0.0008) [2023-12-28 04:50:40,936][106225] Updated weights for policy 1, policy_version 1336942 (0.0008) [2023-12-28 04:50:40,985][106225] Updated weights for policy 1, policy_version 1336952 (0.0008) [2023-12-28 04:50:41,033][106226] Updated weights for policy 0, policy_version 1333605 (0.0009) [2023-12-28 04:50:41,103][106226] Updated weights for policy 0, policy_version 1333615 (0.0009) [2023-12-28 04:50:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 683778048. Throughput: 0: 9809.7, 1: 9793.1. Samples: 683751784. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:41,175][105115] Avg episode reward: [(0, '-4.029'), (1, '-4.546')] [2023-12-28 04:50:41,177][106226] Updated weights for policy 0, policy_version 1333625 (0.0009) [2023-12-28 04:50:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001336952_342310912.pth... [2023-12-28 04:50:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001335800_342016000.pth [2023-12-28 04:50:41,222][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001333632_341475328.pth... [2023-12-28 04:50:41,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001332480_341180416.pth [2023-12-28 04:50:41,809][106225] Updated weights for policy 1, policy_version 1336962 (0.0009) [2023-12-28 04:50:41,867][106225] Updated weights for policy 1, policy_version 1336972 (0.0009) [2023-12-28 04:50:41,918][106225] Updated weights for policy 1, policy_version 1336982 (0.0006) [2023-12-28 04:50:42,054][106226] Updated weights for policy 0, policy_version 1333635 (0.0009) [2023-12-28 04:50:42,118][106226] Updated weights for policy 0, policy_version 1333645 (0.0008) [2023-12-28 04:50:42,175][106226] Updated weights for policy 0, policy_version 1333655 (0.0009) [2023-12-28 04:50:42,659][106225] Updated weights for policy 1, policy_version 1336992 (0.0008) [2023-12-28 04:50:42,721][106225] Updated weights for policy 1, policy_version 1337002 (0.0009) [2023-12-28 04:50:42,782][106225] Updated weights for policy 1, policy_version 1337012 (0.0008) [2023-12-28 04:50:42,891][106226] Updated weights for policy 0, policy_version 1333665 (0.0009) [2023-12-28 04:50:42,955][106226] Updated weights for policy 0, policy_version 1333675 (0.0011) [2023-12-28 04:50:43,012][106226] Updated weights for policy 0, policy_version 1333685 (0.0010) [2023-12-28 04:50:43,069][106226] Updated weights for policy 0, policy_version 1333695 (0.0010) [2023-12-28 04:50:43,424][106225] Updated weights for policy 1, policy_version 1337022 (0.0009) [2023-12-28 04:50:43,474][106225] Updated weights for policy 1, policy_version 1337032 (0.0009) [2023-12-28 04:50:43,525][106225] Updated weights for policy 1, policy_version 1337042 (0.0008) [2023-12-28 04:50:43,720][106226] Updated weights for policy 0, policy_version 1333705 (0.0006) [2023-12-28 04:50:43,779][106226] Updated weights for policy 0, policy_version 1333715 (0.0008) [2023-12-28 04:50:43,831][106226] Updated weights for policy 0, policy_version 1333725 (0.0009) [2023-12-28 04:50:44,312][106225] Updated weights for policy 1, policy_version 1337052 (0.0009) [2023-12-28 04:50:44,370][106225] Updated weights for policy 1, policy_version 1337062 (0.0007) [2023-12-28 04:50:44,431][106225] Updated weights for policy 1, policy_version 1337072 (0.0005) [2023-12-28 04:50:44,488][106226] Updated weights for policy 0, policy_version 1333735 (0.0007) [2023-12-28 04:50:44,550][106226] Updated weights for policy 0, policy_version 1333745 (0.0008) [2023-12-28 04:50:44,608][106226] Updated weights for policy 0, policy_version 1333755 (0.0006) [2023-12-28 04:50:45,072][106225] Updated weights for policy 1, policy_version 1337082 (0.0007) [2023-12-28 04:50:45,141][106225] Updated weights for policy 1, policy_version 1337092 (0.0008) [2023-12-28 04:50:45,210][106225] Updated weights for policy 1, policy_version 1337102 (0.0009) [2023-12-28 04:50:45,278][106225] Updated weights for policy 1, policy_version 1337112 (0.0008) [2023-12-28 04:50:45,299][106226] Updated weights for policy 0, policy_version 1333765 (0.0008) [2023-12-28 04:50:45,363][106226] Updated weights for policy 0, policy_version 1333775 (0.0009) [2023-12-28 04:50:45,426][106226] Updated weights for policy 0, policy_version 1333785 (0.0008) [2023-12-28 04:50:45,957][106225] Updated weights for policy 1, policy_version 1337122 (0.0010) [2023-12-28 04:50:46,016][106225] Updated weights for policy 1, policy_version 1337132 (0.0007) [2023-12-28 04:50:46,079][106225] Updated weights for policy 1, policy_version 1337142 (0.0009) [2023-12-28 04:50:46,148][106226] Updated weights for policy 0, policy_version 1333795 (0.0008) [2023-12-28 04:50:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 683876352. Throughput: 0: 9796.4, 1: 9737.6. Samples: 683867092. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:46,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.814')] [2023-12-28 04:50:46,196][106226] Updated weights for policy 0, policy_version 1333805 (0.0008) [2023-12-28 04:50:46,254][106226] Updated weights for policy 0, policy_version 1333815 (0.0008) [2023-12-28 04:50:46,793][106225] Updated weights for policy 1, policy_version 1337152 (0.0010) [2023-12-28 04:50:46,839][106225] Updated weights for policy 1, policy_version 1337162 (0.0010) [2023-12-28 04:50:46,896][106225] Updated weights for policy 1, policy_version 1337172 (0.0010) [2023-12-28 04:50:46,988][106226] Updated weights for policy 0, policy_version 1333825 (0.0009) [2023-12-28 04:50:47,054][106226] Updated weights for policy 0, policy_version 1333835 (0.0011) [2023-12-28 04:50:47,111][106226] Updated weights for policy 0, policy_version 1333845 (0.0011) [2023-12-28 04:50:47,170][106226] Updated weights for policy 0, policy_version 1333855 (0.0006) [2023-12-28 04:50:47,646][106225] Updated weights for policy 1, policy_version 1337182 (0.0010) [2023-12-28 04:50:47,704][106225] Updated weights for policy 1, policy_version 1337192 (0.0008) [2023-12-28 04:50:47,708][106226] Updated weights for policy 0, policy_version 1333865 (0.0005) [2023-12-28 04:50:47,751][106225] Updated weights for policy 1, policy_version 1337202 (0.0008) [2023-12-28 04:50:47,769][106226] Updated weights for policy 0, policy_version 1333875 (0.0006) [2023-12-28 04:50:47,822][106226] Updated weights for policy 0, policy_version 1333885 (0.0007) [2023-12-28 04:50:48,378][106226] Updated weights for policy 0, policy_version 1333895 (0.0007) [2023-12-28 04:50:48,441][106226] Updated weights for policy 0, policy_version 1333905 (0.0008) [2023-12-28 04:50:48,506][106226] Updated weights for policy 0, policy_version 1333915 (0.0008) [2023-12-28 04:50:48,520][106225] Updated weights for policy 1, policy_version 1337212 (0.0007) [2023-12-28 04:50:48,580][106225] Updated weights for policy 1, policy_version 1337222 (0.0008) [2023-12-28 04:50:48,645][106225] Updated weights for policy 1, policy_version 1337232 (0.0005) [2023-12-28 04:50:49,113][106226] Updated weights for policy 0, policy_version 1333925 (0.0006) [2023-12-28 04:50:49,178][106226] Updated weights for policy 0, policy_version 1333935 (0.0006) [2023-12-28 04:50:49,241][106226] Updated weights for policy 0, policy_version 1333945 (0.0007) [2023-12-28 04:50:49,275][106225] Updated weights for policy 1, policy_version 1337242 (0.0007) [2023-12-28 04:50:49,341][106225] Updated weights for policy 1, policy_version 1337252 (0.0007) [2023-12-28 04:50:49,408][106225] Updated weights for policy 1, policy_version 1337262 (0.0008) [2023-12-28 04:50:49,477][106225] Updated weights for policy 1, policy_version 1337272 (0.0005) [2023-12-28 04:50:49,955][106226] Updated weights for policy 0, policy_version 1333955 (0.0007) [2023-12-28 04:50:50,019][106226] Updated weights for policy 0, policy_version 1333965 (0.0009) [2023-12-28 04:50:50,079][106226] Updated weights for policy 0, policy_version 1333975 (0.0009) [2023-12-28 04:50:50,200][106225] Updated weights for policy 1, policy_version 1337282 (0.0007) [2023-12-28 04:50:50,256][106225] Updated weights for policy 1, policy_version 1337292 (0.0009) [2023-12-28 04:50:50,322][106225] Updated weights for policy 1, policy_version 1337302 (0.0009) [2023-12-28 04:50:50,856][106226] Updated weights for policy 0, policy_version 1333985 (0.0009) [2023-12-28 04:50:50,918][106226] Updated weights for policy 0, policy_version 1333995 (0.0008) [2023-12-28 04:50:50,978][106226] Updated weights for policy 0, policy_version 1334005 (0.0008) [2023-12-28 04:50:50,984][106225] Updated weights for policy 1, policy_version 1337312 (0.0007) [2023-12-28 04:50:51,037][106226] Updated weights for policy 0, policy_version 1334015 (0.0008) [2023-12-28 04:50:51,047][106225] Updated weights for policy 1, policy_version 1337322 (0.0007) [2023-12-28 04:50:51,108][106225] Updated weights for policy 1, policy_version 1337332 (0.0007) [2023-12-28 04:50:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 683982848. Throughput: 0: 9869.8, 1: 9741.0. Samples: 683987032. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:51,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.588')] [2023-12-28 04:50:51,750][106225] Updated weights for policy 1, policy_version 1337342 (0.0008) [2023-12-28 04:50:51,815][106225] Updated weights for policy 1, policy_version 1337352 (0.0007) [2023-12-28 04:50:51,875][106225] Updated weights for policy 1, policy_version 1337362 (0.0007) [2023-12-28 04:50:51,892][106226] Updated weights for policy 0, policy_version 1334025 (0.0009) [2023-12-28 04:50:51,959][106226] Updated weights for policy 0, policy_version 1334035 (0.0008) [2023-12-28 04:50:52,021][106226] Updated weights for policy 0, policy_version 1334045 (0.0009) [2023-12-28 04:50:52,580][106225] Updated weights for policy 1, policy_version 1337372 (0.0008) [2023-12-28 04:50:52,637][106225] Updated weights for policy 1, policy_version 1337382 (0.0008) [2023-12-28 04:50:52,699][106225] Updated weights for policy 1, policy_version 1337392 (0.0010) [2023-12-28 04:50:52,753][106226] Updated weights for policy 0, policy_version 1334055 (0.0009) [2023-12-28 04:50:52,804][106226] Updated weights for policy 0, policy_version 1334065 (0.0008) [2023-12-28 04:50:52,859][106226] Updated weights for policy 0, policy_version 1334075 (0.0008) [2023-12-28 04:50:53,410][106225] Updated weights for policy 1, policy_version 1337402 (0.0011) [2023-12-28 04:50:53,469][106225] Updated weights for policy 1, policy_version 1337412 (0.0010) [2023-12-28 04:50:53,522][106225] Updated weights for policy 1, policy_version 1337422 (0.0006) [2023-12-28 04:50:53,585][106225] Updated weights for policy 1, policy_version 1337432 (0.0008) [2023-12-28 04:50:53,612][106226] Updated weights for policy 0, policy_version 1334085 (0.0009) [2023-12-28 04:50:53,663][106226] Updated weights for policy 0, policy_version 1334095 (0.0009) [2023-12-28 04:50:53,713][106226] Updated weights for policy 0, policy_version 1334105 (0.0008) [2023-12-28 04:50:54,244][106225] Updated weights for policy 1, policy_version 1337442 (0.0010) [2023-12-28 04:50:54,307][106225] Updated weights for policy 1, policy_version 1337452 (0.0010) [2023-12-28 04:50:54,363][106225] Updated weights for policy 1, policy_version 1337462 (0.0010) [2023-12-28 04:50:54,481][106226] Updated weights for policy 0, policy_version 1334115 (0.0008) [2023-12-28 04:50:54,537][106226] Updated weights for policy 0, policy_version 1334125 (0.0009) [2023-12-28 04:50:54,598][106226] Updated weights for policy 0, policy_version 1334135 (0.0008) [2023-12-28 04:50:55,064][106225] Updated weights for policy 1, policy_version 1337472 (0.0006) [2023-12-28 04:50:55,111][106225] Updated weights for policy 1, policy_version 1337482 (0.0006) [2023-12-28 04:50:55,162][106225] Updated weights for policy 1, policy_version 1337492 (0.0010) [2023-12-28 04:50:55,228][106226] Updated weights for policy 0, policy_version 1334145 (0.0008) [2023-12-28 04:50:55,287][106226] Updated weights for policy 0, policy_version 1334155 (0.0005) [2023-12-28 04:50:55,351][106226] Updated weights for policy 0, policy_version 1334165 (0.0006) [2023-12-28 04:50:55,416][106226] Updated weights for policy 0, policy_version 1334175 (0.0008) [2023-12-28 04:50:55,881][106225] Updated weights for policy 1, policy_version 1337502 (0.0010) [2023-12-28 04:50:55,931][106225] Updated weights for policy 1, policy_version 1337512 (0.0010) [2023-12-28 04:50:55,987][106225] Updated weights for policy 1, policy_version 1337522 (0.0010) [2023-12-28 04:50:56,003][106226] Updated weights for policy 0, policy_version 1334185 (0.0005) [2023-12-28 04:50:56,056][106226] Updated weights for policy 0, policy_version 1334195 (0.0005) [2023-12-28 04:50:56,105][106226] Updated weights for policy 0, policy_version 1334205 (0.0005) [2023-12-28 04:50:56,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 684081152. Throughput: 0: 9804.3, 1: 9751.8. Samples: 684044808. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:50:56,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-4.636')] [2023-12-28 04:50:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001337528_342458368.pth... [2023-12-28 04:50:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001334208_341622784.pth... [2023-12-28 04:50:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001336376_342163456.pth [2023-12-28 04:50:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001333056_341327872.pth [2023-12-28 04:50:56,657][106226] Updated weights for policy 0, policy_version 1334215 (0.0005) [2023-12-28 04:50:56,665][106225] Updated weights for policy 1, policy_version 1337532 (0.0008) [2023-12-28 04:50:56,711][106226] Updated weights for policy 0, policy_version 1334225 (0.0007) [2023-12-28 04:50:56,729][106225] Updated weights for policy 1, policy_version 1337542 (0.0006) [2023-12-28 04:50:56,764][106226] Updated weights for policy 0, policy_version 1334235 (0.0010) [2023-12-28 04:50:56,782][106225] Updated weights for policy 1, policy_version 1337552 (0.0010) [2023-12-28 04:50:57,368][106226] Updated weights for policy 0, policy_version 1334245 (0.0009) [2023-12-28 04:50:57,414][106225] Updated weights for policy 1, policy_version 1337562 (0.0010) [2023-12-28 04:50:57,424][106226] Updated weights for policy 0, policy_version 1334255 (0.0010) [2023-12-28 04:50:57,470][106225] Updated weights for policy 1, policy_version 1337572 (0.0008) [2023-12-28 04:50:57,472][106226] Updated weights for policy 0, policy_version 1334265 (0.0006) [2023-12-28 04:50:57,531][106225] Updated weights for policy 1, policy_version 1337582 (0.0005) [2023-12-28 04:50:57,587][106225] Updated weights for policy 1, policy_version 1337592 (0.0005) [2023-12-28 04:50:58,095][106226] Updated weights for policy 0, policy_version 1334275 (0.0006) [2023-12-28 04:50:58,141][106225] Updated weights for policy 1, policy_version 1337602 (0.0008) [2023-12-28 04:50:58,155][106226] Updated weights for policy 0, policy_version 1334285 (0.0006) [2023-12-28 04:50:58,191][106225] Updated weights for policy 1, policy_version 1337612 (0.0009) [2023-12-28 04:50:58,216][106226] Updated weights for policy 0, policy_version 1334295 (0.0006) [2023-12-28 04:50:58,258][106225] Updated weights for policy 1, policy_version 1337622 (0.0007) [2023-12-28 04:50:58,961][106226] Updated weights for policy 0, policy_version 1334305 (0.0010) [2023-12-28 04:50:59,009][106225] Updated weights for policy 1, policy_version 1337632 (0.0006) [2023-12-28 04:50:59,022][106226] Updated weights for policy 0, policy_version 1334315 (0.0011) [2023-12-28 04:50:59,073][106225] Updated weights for policy 1, policy_version 1337642 (0.0007) [2023-12-28 04:50:59,084][106226] Updated weights for policy 0, policy_version 1334325 (0.0011) [2023-12-28 04:50:59,131][106225] Updated weights for policy 1, policy_version 1337652 (0.0007) [2023-12-28 04:50:59,151][106226] Updated weights for policy 0, policy_version 1334335 (0.0010) [2023-12-28 04:50:59,871][106226] Updated weights for policy 0, policy_version 1334345 (0.0011) [2023-12-28 04:50:59,892][106225] Updated weights for policy 1, policy_version 1337662 (0.0007) [2023-12-28 04:50:59,939][106226] Updated weights for policy 0, policy_version 1334355 (0.0011) [2023-12-28 04:50:59,960][106225] Updated weights for policy 1, policy_version 1337672 (0.0007) [2023-12-28 04:50:59,994][106226] Updated weights for policy 0, policy_version 1334365 (0.0011) [2023-12-28 04:51:00,017][106225] Updated weights for policy 1, policy_version 1337682 (0.0007) [2023-12-28 04:51:00,705][106226] Updated weights for policy 0, policy_version 1334375 (0.0011) [2023-12-28 04:51:00,744][106225] Updated weights for policy 1, policy_version 1337692 (0.0007) [2023-12-28 04:51:00,750][106226] Updated weights for policy 0, policy_version 1334385 (0.0007) [2023-12-28 04:51:00,796][106226] Updated weights for policy 0, policy_version 1334395 (0.0007) [2023-12-28 04:51:00,801][106225] Updated weights for policy 1, policy_version 1337702 (0.0007) [2023-12-28 04:51:00,861][106225] Updated weights for policy 1, policy_version 1337712 (0.0007) [2023-12-28 04:51:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 684179456. Throughput: 0: 9924.1, 1: 9874.6. Samples: 684168884. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:01,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.930')] [2023-12-28 04:51:01,539][106226] Updated weights for policy 0, policy_version 1334405 (0.0009) [2023-12-28 04:51:01,601][106226] Updated weights for policy 0, policy_version 1334415 (0.0008) [2023-12-28 04:51:01,609][106225] Updated weights for policy 1, policy_version 1337722 (0.0009) [2023-12-28 04:51:01,666][106226] Updated weights for policy 0, policy_version 1334425 (0.0010) [2023-12-28 04:51:01,672][106225] Updated weights for policy 1, policy_version 1337732 (0.0008) [2023-12-28 04:51:01,732][106225] Updated weights for policy 1, policy_version 1337742 (0.0008) [2023-12-28 04:51:01,795][106225] Updated weights for policy 1, policy_version 1337752 (0.0008) [2023-12-28 04:51:02,414][106226] Updated weights for policy 0, policy_version 1334435 (0.0010) [2023-12-28 04:51:02,480][106226] Updated weights for policy 0, policy_version 1334445 (0.0008) [2023-12-28 04:51:02,541][106226] Updated weights for policy 0, policy_version 1334455 (0.0007) [2023-12-28 04:51:02,545][106225] Updated weights for policy 1, policy_version 1337762 (0.0006) [2023-12-28 04:51:02,602][106225] Updated weights for policy 1, policy_version 1337772 (0.0005) [2023-12-28 04:51:02,667][106225] Updated weights for policy 1, policy_version 1337782 (0.0007) [2023-12-28 04:51:03,246][106226] Updated weights for policy 0, policy_version 1334465 (0.0008) [2023-12-28 04:51:03,295][106225] Updated weights for policy 1, policy_version 1337792 (0.0009) [2023-12-28 04:51:03,305][106226] Updated weights for policy 0, policy_version 1334475 (0.0005) [2023-12-28 04:51:03,353][106225] Updated weights for policy 1, policy_version 1337802 (0.0007) [2023-12-28 04:51:03,364][106226] Updated weights for policy 0, policy_version 1334485 (0.0007) [2023-12-28 04:51:03,410][106225] Updated weights for policy 1, policy_version 1337812 (0.0007) [2023-12-28 04:51:03,420][106226] Updated weights for policy 0, policy_version 1334495 (0.0007) [2023-12-28 04:51:04,055][106225] Updated weights for policy 1, policy_version 1337822 (0.0009) [2023-12-28 04:51:04,057][106226] Updated weights for policy 0, policy_version 1334505 (0.0007) [2023-12-28 04:51:04,111][106226] Updated weights for policy 0, policy_version 1334515 (0.0009) [2023-12-28 04:51:04,118][106225] Updated weights for policy 1, policy_version 1337832 (0.0011) [2023-12-28 04:51:04,177][106225] Updated weights for policy 1, policy_version 1337842 (0.0011) [2023-12-28 04:51:04,178][106226] Updated weights for policy 0, policy_version 1334525 (0.0007) [2023-12-28 04:51:04,832][106226] Updated weights for policy 0, policy_version 1334535 (0.0006) [2023-12-28 04:51:04,880][106226] Updated weights for policy 0, policy_version 1334545 (0.0006) [2023-12-28 04:51:04,883][106225] Updated weights for policy 1, policy_version 1337852 (0.0008) [2023-12-28 04:51:04,934][106225] Updated weights for policy 1, policy_version 1337862 (0.0005) [2023-12-28 04:51:04,939][106226] Updated weights for policy 0, policy_version 1334555 (0.0007) [2023-12-28 04:51:04,989][106225] Updated weights for policy 1, policy_version 1337872 (0.0008) [2023-12-28 04:51:05,623][106225] Updated weights for policy 1, policy_version 1337882 (0.0010) [2023-12-28 04:51:05,679][106225] Updated weights for policy 1, policy_version 1337892 (0.0010) [2023-12-28 04:51:05,692][106226] Updated weights for policy 0, policy_version 1334565 (0.0007) [2023-12-28 04:51:05,738][106225] Updated weights for policy 1, policy_version 1337902 (0.0010) [2023-12-28 04:51:05,748][106226] Updated weights for policy 0, policy_version 1334575 (0.0007) [2023-12-28 04:51:05,796][106225] Updated weights for policy 1, policy_version 1337912 (0.0010) [2023-12-28 04:51:05,801][106226] Updated weights for policy 0, policy_version 1334585 (0.0007) [2023-12-28 04:51:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 684277760. Throughput: 0: 9886.6, 1: 9914.2. Samples: 684286968. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:06,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.715')] [2023-12-28 04:51:06,484][106225] Updated weights for policy 1, policy_version 1337922 (0.0011) [2023-12-28 04:51:06,488][106226] Updated weights for policy 0, policy_version 1334595 (0.0009) [2023-12-28 04:51:06,547][106226] Updated weights for policy 0, policy_version 1334605 (0.0006) [2023-12-28 04:51:06,549][106225] Updated weights for policy 1, policy_version 1337932 (0.0011) [2023-12-28 04:51:06,601][106226] Updated weights for policy 0, policy_version 1334615 (0.0008) [2023-12-28 04:51:06,608][106225] Updated weights for policy 1, policy_version 1337942 (0.0007) [2023-12-28 04:51:07,213][106225] Updated weights for policy 1, policy_version 1337952 (0.0006) [2023-12-28 04:51:07,263][106225] Updated weights for policy 1, policy_version 1337962 (0.0009) [2023-12-28 04:51:07,310][106225] Updated weights for policy 1, policy_version 1337972 (0.0010) [2023-12-28 04:51:07,396][106226] Updated weights for policy 0, policy_version 1334625 (0.0009) [2023-12-28 04:51:07,449][106226] Updated weights for policy 0, policy_version 1334635 (0.0008) [2023-12-28 04:51:07,499][106226] Updated weights for policy 0, policy_version 1334645 (0.0007) [2023-12-28 04:51:07,550][106226] Updated weights for policy 0, policy_version 1334655 (0.0008) [2023-12-28 04:51:07,949][106225] Updated weights for policy 1, policy_version 1337982 (0.0008) [2023-12-28 04:51:08,004][106225] Updated weights for policy 1, policy_version 1337992 (0.0006) [2023-12-28 04:51:08,067][106225] Updated weights for policy 1, policy_version 1338002 (0.0006) [2023-12-28 04:51:08,341][106226] Updated weights for policy 0, policy_version 1334665 (0.0006) [2023-12-28 04:51:08,411][106226] Updated weights for policy 0, policy_version 1334675 (0.0008) [2023-12-28 04:51:08,475][106226] Updated weights for policy 0, policy_version 1334685 (0.0008) [2023-12-28 04:51:08,744][106225] Updated weights for policy 1, policy_version 1338012 (0.0010) [2023-12-28 04:51:08,796][106225] Updated weights for policy 1, policy_version 1338022 (0.0009) [2023-12-28 04:51:08,854][106225] Updated weights for policy 1, policy_version 1338032 (0.0010) [2023-12-28 04:51:09,185][106226] Updated weights for policy 0, policy_version 1334695 (0.0008) [2023-12-28 04:51:09,265][106226] Updated weights for policy 0, policy_version 1334705 (0.0008) [2023-12-28 04:51:09,324][106226] Updated weights for policy 0, policy_version 1334715 (0.0008) [2023-12-28 04:51:09,574][106225] Updated weights for policy 1, policy_version 1338042 (0.0009) [2023-12-28 04:51:09,644][106225] Updated weights for policy 1, policy_version 1338052 (0.0010) [2023-12-28 04:51:09,714][106225] Updated weights for policy 1, policy_version 1338062 (0.0010) [2023-12-28 04:51:09,781][106225] Updated weights for policy 1, policy_version 1338072 (0.0009) [2023-12-28 04:51:10,051][106226] Updated weights for policy 0, policy_version 1334725 (0.0009) [2023-12-28 04:51:10,111][106226] Updated weights for policy 0, policy_version 1334735 (0.0008) [2023-12-28 04:51:10,170][106226] Updated weights for policy 0, policy_version 1334745 (0.0008) [2023-12-28 04:51:10,511][106225] Updated weights for policy 1, policy_version 1338082 (0.0007) [2023-12-28 04:51:10,561][106225] Updated weights for policy 1, policy_version 1338092 (0.0009) [2023-12-28 04:51:10,610][106225] Updated weights for policy 1, policy_version 1338102 (0.0009) [2023-12-28 04:51:10,873][106226] Updated weights for policy 0, policy_version 1334755 (0.0009) [2023-12-28 04:51:10,931][106226] Updated weights for policy 0, policy_version 1334765 (0.0009) [2023-12-28 04:51:10,995][106226] Updated weights for policy 0, policy_version 1334775 (0.0008) [2023-12-28 04:51:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 684376064. Throughput: 0: 9883.0, 1: 9993.0. Samples: 684347016. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:11,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.700')] [2023-12-28 04:51:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001334784_341770240.pth... [2023-12-28 04:51:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001338104_342605824.pth... [2023-12-28 04:51:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001333632_341475328.pth [2023-12-28 04:51:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001336952_342310912.pth [2023-12-28 04:51:11,305][106225] Updated weights for policy 1, policy_version 1338112 (0.0010) [2023-12-28 04:51:11,373][106225] Updated weights for policy 1, policy_version 1338122 (0.0010) [2023-12-28 04:51:11,440][106225] Updated weights for policy 1, policy_version 1338132 (0.0008) [2023-12-28 04:51:11,761][106226] Updated weights for policy 0, policy_version 1334785 (0.0009) [2023-12-28 04:51:11,817][106226] Updated weights for policy 0, policy_version 1334795 (0.0008) [2023-12-28 04:51:11,887][106226] Updated weights for policy 0, policy_version 1334805 (0.0008) [2023-12-28 04:51:11,954][106226] Updated weights for policy 0, policy_version 1334815 (0.0008) [2023-12-28 04:51:12,186][106225] Updated weights for policy 1, policy_version 1338142 (0.0009) [2023-12-28 04:51:12,236][106225] Updated weights for policy 1, policy_version 1338152 (0.0008) [2023-12-28 04:51:12,303][106225] Updated weights for policy 1, policy_version 1338162 (0.0009) [2023-12-28 04:51:12,703][106226] Updated weights for policy 0, policy_version 1334825 (0.0006) [2023-12-28 04:51:12,763][106226] Updated weights for policy 0, policy_version 1334835 (0.0009) [2023-12-28 04:51:12,820][106226] Updated weights for policy 0, policy_version 1334845 (0.0010) [2023-12-28 04:51:13,002][106225] Updated weights for policy 1, policy_version 1338172 (0.0008) [2023-12-28 04:51:13,060][106225] Updated weights for policy 1, policy_version 1338182 (0.0010) [2023-12-28 04:51:13,120][106225] Updated weights for policy 1, policy_version 1338192 (0.0010) [2023-12-28 04:51:13,577][106226] Updated weights for policy 0, policy_version 1334855 (0.0006) [2023-12-28 04:51:13,640][106226] Updated weights for policy 0, policy_version 1334865 (0.0007) [2023-12-28 04:51:13,696][106226] Updated weights for policy 0, policy_version 1334875 (0.0007) [2023-12-28 04:51:13,806][106225] Updated weights for policy 1, policy_version 1338202 (0.0009) [2023-12-28 04:51:13,871][106225] Updated weights for policy 1, policy_version 1338212 (0.0008) [2023-12-28 04:51:13,935][106225] Updated weights for policy 1, policy_version 1338222 (0.0008) [2023-12-28 04:51:13,995][106225] Updated weights for policy 1, policy_version 1338232 (0.0008) [2023-12-28 04:51:14,416][106226] Updated weights for policy 0, policy_version 1334885 (0.0008) [2023-12-28 04:51:14,476][106226] Updated weights for policy 0, policy_version 1334895 (0.0008) [2023-12-28 04:51:14,538][106226] Updated weights for policy 0, policy_version 1334905 (0.0008) [2023-12-28 04:51:14,637][106225] Updated weights for policy 1, policy_version 1338242 (0.0010) [2023-12-28 04:51:14,699][106225] Updated weights for policy 1, policy_version 1338252 (0.0010) [2023-12-28 04:51:14,756][106225] Updated weights for policy 1, policy_version 1338262 (0.0010) [2023-12-28 04:51:15,273][106226] Updated weights for policy 0, policy_version 1334915 (0.0009) [2023-12-28 04:51:15,331][106226] Updated weights for policy 0, policy_version 1334925 (0.0009) [2023-12-28 04:51:15,393][106226] Updated weights for policy 0, policy_version 1334935 (0.0009) [2023-12-28 04:51:15,501][106225] Updated weights for policy 1, policy_version 1338272 (0.0006) [2023-12-28 04:51:15,567][106225] Updated weights for policy 1, policy_version 1338282 (0.0005) [2023-12-28 04:51:15,627][106225] Updated weights for policy 1, policy_version 1338292 (0.0007) [2023-12-28 04:51:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 684466176. Throughput: 0: 9813.1, 1: 9906.5. Samples: 684461240. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:16,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.524')] [2023-12-28 04:51:16,176][106226] Updated weights for policy 0, policy_version 1334945 (0.0009) [2023-12-28 04:51:16,190][106225] Updated weights for policy 1, policy_version 1338302 (0.0007) [2023-12-28 04:51:16,237][106226] Updated weights for policy 0, policy_version 1334955 (0.0008) [2023-12-28 04:51:16,246][106225] Updated weights for policy 1, policy_version 1338312 (0.0006) [2023-12-28 04:51:16,298][106226] Updated weights for policy 0, policy_version 1334965 (0.0008) [2023-12-28 04:51:16,309][106225] Updated weights for policy 1, policy_version 1338322 (0.0005) [2023-12-28 04:51:16,346][106226] Updated weights for policy 0, policy_version 1334975 (0.0007) [2023-12-28 04:51:17,000][106225] Updated weights for policy 1, policy_version 1338332 (0.0007) [2023-12-28 04:51:17,052][106225] Updated weights for policy 1, policy_version 1338342 (0.0007) [2023-12-28 04:51:17,079][106226] Updated weights for policy 0, policy_version 1334985 (0.0007) [2023-12-28 04:51:17,100][106225] Updated weights for policy 1, policy_version 1338352 (0.0007) [2023-12-28 04:51:17,139][106226] Updated weights for policy 0, policy_version 1334995 (0.0006) [2023-12-28 04:51:17,197][106226] Updated weights for policy 0, policy_version 1335005 (0.0008) [2023-12-28 04:51:17,852][106225] Updated weights for policy 1, policy_version 1338362 (0.0008) [2023-12-28 04:51:17,913][106225] Updated weights for policy 1, policy_version 1338372 (0.0008) [2023-12-28 04:51:17,930][106226] Updated weights for policy 0, policy_version 1335015 (0.0008) [2023-12-28 04:51:17,971][106225] Updated weights for policy 1, policy_version 1338382 (0.0006) [2023-12-28 04:51:17,988][106226] Updated weights for policy 0, policy_version 1335025 (0.0009) [2023-12-28 04:51:18,033][106225] Updated weights for policy 1, policy_version 1338392 (0.0008) [2023-12-28 04:51:18,052][106226] Updated weights for policy 0, policy_version 1335035 (0.0006) [2023-12-28 04:51:18,729][106226] Updated weights for policy 0, policy_version 1335045 (0.0009) [2023-12-28 04:51:18,785][106226] Updated weights for policy 0, policy_version 1335055 (0.0006) [2023-12-28 04:51:18,802][106225] Updated weights for policy 1, policy_version 1338402 (0.0007) [2023-12-28 04:51:18,847][106226] Updated weights for policy 0, policy_version 1335065 (0.0007) [2023-12-28 04:51:18,858][106225] Updated weights for policy 1, policy_version 1338412 (0.0006) [2023-12-28 04:51:18,917][106225] Updated weights for policy 1, policy_version 1338422 (0.0008) [2023-12-28 04:51:19,570][106226] Updated weights for policy 0, policy_version 1335075 (0.0007) [2023-12-28 04:51:19,633][106226] Updated weights for policy 0, policy_version 1335085 (0.0008) [2023-12-28 04:51:19,689][106226] Updated weights for policy 0, policy_version 1335095 (0.0007) [2023-12-28 04:51:19,691][106225] Updated weights for policy 1, policy_version 1338432 (0.0009) [2023-12-28 04:51:19,749][106225] Updated weights for policy 1, policy_version 1338442 (0.0008) [2023-12-28 04:51:19,806][106225] Updated weights for policy 1, policy_version 1338452 (0.0009) [2023-12-28 04:51:20,502][106225] Updated weights for policy 1, policy_version 1338462 (0.0008) [2023-12-28 04:51:20,504][106226] Updated weights for policy 0, policy_version 1335105 (0.0007) [2023-12-28 04:51:20,559][106226] Updated weights for policy 0, policy_version 1335115 (0.0008) [2023-12-28 04:51:20,570][106225] Updated weights for policy 1, policy_version 1338472 (0.0008) [2023-12-28 04:51:20,625][106226] Updated weights for policy 0, policy_version 1335125 (0.0007) [2023-12-28 04:51:20,635][106225] Updated weights for policy 1, policy_version 1338482 (0.0008) [2023-12-28 04:51:20,686][106226] Updated weights for policy 0, policy_version 1335135 (0.0010) [2023-12-28 04:51:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 684564480. Throughput: 0: 9750.9, 1: 9856.4. Samples: 684575992. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:21,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.535')] [2023-12-28 04:51:21,342][106225] Updated weights for policy 1, policy_version 1338492 (0.0008) [2023-12-28 04:51:21,421][106225] Updated weights for policy 1, policy_version 1338502 (0.0008) [2023-12-28 04:51:21,460][106226] Updated weights for policy 0, policy_version 1335145 (0.0008) [2023-12-28 04:51:21,482][106225] Updated weights for policy 1, policy_version 1338512 (0.0008) [2023-12-28 04:51:21,525][106226] Updated weights for policy 0, policy_version 1335155 (0.0008) [2023-12-28 04:51:21,586][106226] Updated weights for policy 0, policy_version 1335165 (0.0008) [2023-12-28 04:51:22,170][106225] Updated weights for policy 1, policy_version 1338522 (0.0008) [2023-12-28 04:51:22,237][106225] Updated weights for policy 1, policy_version 1338532 (0.0005) [2023-12-28 04:51:22,300][106225] Updated weights for policy 1, policy_version 1338542 (0.0008) [2023-12-28 04:51:22,341][106226] Updated weights for policy 0, policy_version 1335175 (0.0007) [2023-12-28 04:51:22,382][106225] Updated weights for policy 1, policy_version 1338552 (0.0008) [2023-12-28 04:51:22,412][106226] Updated weights for policy 0, policy_version 1335185 (0.0007) [2023-12-28 04:51:22,475][106226] Updated weights for policy 0, policy_version 1335195 (0.0008) [2023-12-28 04:51:23,093][106225] Updated weights for policy 1, policy_version 1338562 (0.0009) [2023-12-28 04:51:23,140][106225] Updated weights for policy 1, policy_version 1338572 (0.0007) [2023-12-28 04:51:23,148][106226] Updated weights for policy 0, policy_version 1335205 (0.0007) [2023-12-28 04:51:23,192][106225] Updated weights for policy 1, policy_version 1338582 (0.0008) [2023-12-28 04:51:23,206][106226] Updated weights for policy 0, policy_version 1335215 (0.0006) [2023-12-28 04:51:23,265][106226] Updated weights for policy 0, policy_version 1335225 (0.0007) [2023-12-28 04:51:23,896][106226] Updated weights for policy 0, policy_version 1335235 (0.0006) [2023-12-28 04:51:23,896][106225] Updated weights for policy 1, policy_version 1338592 (0.0009) [2023-12-28 04:51:23,958][106225] Updated weights for policy 1, policy_version 1338602 (0.0009) [2023-12-28 04:51:23,959][106226] Updated weights for policy 0, policy_version 1335245 (0.0006) [2023-12-28 04:51:24,019][106226] Updated weights for policy 0, policy_version 1335255 (0.0006) [2023-12-28 04:51:24,019][106225] Updated weights for policy 1, policy_version 1338612 (0.0008) [2023-12-28 04:51:24,660][106225] Updated weights for policy 1, policy_version 1338622 (0.0008) [2023-12-28 04:51:24,715][106225] Updated weights for policy 1, policy_version 1338632 (0.0008) [2023-12-28 04:51:24,766][106226] Updated weights for policy 0, policy_version 1335265 (0.0009) [2023-12-28 04:51:24,770][106225] Updated weights for policy 1, policy_version 1338642 (0.0006) [2023-12-28 04:51:24,828][106226] Updated weights for policy 0, policy_version 1335275 (0.0007) [2023-12-28 04:51:24,885][106226] Updated weights for policy 0, policy_version 1335285 (0.0007) [2023-12-28 04:51:24,942][106226] Updated weights for policy 0, policy_version 1335295 (0.0010) [2023-12-28 04:51:25,494][106225] Updated weights for policy 1, policy_version 1338652 (0.0007) [2023-12-28 04:51:25,547][106225] Updated weights for policy 1, policy_version 1338662 (0.0008) [2023-12-28 04:51:25,577][106226] Updated weights for policy 0, policy_version 1335305 (0.0006) [2023-12-28 04:51:25,597][106225] Updated weights for policy 1, policy_version 1338672 (0.0007) [2023-12-28 04:51:25,625][106226] Updated weights for policy 0, policy_version 1335315 (0.0008) [2023-12-28 04:51:25,682][106226] Updated weights for policy 0, policy_version 1335325 (0.0008) [2023-12-28 04:51:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 684662784. Throughput: 0: 9742.6, 1: 9870.8. Samples: 684634388. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:26,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.857')] [2023-12-28 04:51:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001338680_342753280.pth... [2023-12-28 04:51:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001335328_341909504.pth... [2023-12-28 04:51:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001334208_341622784.pth [2023-12-28 04:51:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001337528_342458368.pth [2023-12-28 04:51:26,275][106225] Updated weights for policy 1, policy_version 1338682 (0.0008) [2023-12-28 04:51:26,331][106225] Updated weights for policy 1, policy_version 1338692 (0.0008) [2023-12-28 04:51:26,376][106225] Updated weights for policy 1, policy_version 1338702 (0.0008) [2023-12-28 04:51:26,408][106226] Updated weights for policy 0, policy_version 1335335 (0.0008) [2023-12-28 04:51:26,422][106225] Updated weights for policy 1, policy_version 1338712 (0.0006) [2023-12-28 04:51:26,466][106226] Updated weights for policy 0, policy_version 1335345 (0.0007) [2023-12-28 04:51:26,510][106226] Updated weights for policy 0, policy_version 1335355 (0.0008) [2023-12-28 04:51:27,064][106225] Updated weights for policy 1, policy_version 1338722 (0.0010) [2023-12-28 04:51:27,114][106225] Updated weights for policy 1, policy_version 1338732 (0.0008) [2023-12-28 04:51:27,164][106225] Updated weights for policy 1, policy_version 1338742 (0.0008) [2023-12-28 04:51:27,300][106226] Updated weights for policy 0, policy_version 1335365 (0.0008) [2023-12-28 04:51:27,349][106226] Updated weights for policy 0, policy_version 1335375 (0.0009) [2023-12-28 04:51:27,399][106226] Updated weights for policy 0, policy_version 1335385 (0.0009) [2023-12-28 04:51:27,796][106225] Updated weights for policy 1, policy_version 1338752 (0.0008) [2023-12-28 04:51:27,853][106225] Updated weights for policy 1, policy_version 1338762 (0.0008) [2023-12-28 04:51:27,908][106225] Updated weights for policy 1, policy_version 1338772 (0.0010) [2023-12-28 04:51:28,155][106226] Updated weights for policy 0, policy_version 1335396 (0.0008) [2023-12-28 04:51:28,207][106226] Updated weights for policy 0, policy_version 1335406 (0.0008) [2023-12-28 04:51:28,262][106226] Updated weights for policy 0, policy_version 1335416 (0.0008) [2023-12-28 04:51:28,645][106225] Updated weights for policy 1, policy_version 1338782 (0.0009) [2023-12-28 04:51:28,704][106225] Updated weights for policy 1, policy_version 1338792 (0.0010) [2023-12-28 04:51:28,770][106225] Updated weights for policy 1, policy_version 1338802 (0.0006) [2023-12-28 04:51:28,894][106226] Updated weights for policy 0, policy_version 1335426 (0.0007) [2023-12-28 04:51:28,952][106226] Updated weights for policy 0, policy_version 1335436 (0.0009) [2023-12-28 04:51:29,014][106226] Updated weights for policy 0, policy_version 1335446 (0.0008) [2023-12-28 04:51:29,071][106226] Updated weights for policy 0, policy_version 1335456 (0.0008) [2023-12-28 04:51:29,471][106225] Updated weights for policy 1, policy_version 1338812 (0.0008) [2023-12-28 04:51:29,537][106225] Updated weights for policy 1, policy_version 1338822 (0.0009) [2023-12-28 04:51:29,603][106225] Updated weights for policy 1, policy_version 1338832 (0.0009) [2023-12-28 04:51:29,686][106226] Updated weights for policy 0, policy_version 1335466 (0.0006) [2023-12-28 04:51:29,745][106226] Updated weights for policy 0, policy_version 1335476 (0.0005) [2023-12-28 04:51:29,799][106226] Updated weights for policy 0, policy_version 1335486 (0.0005) [2023-12-28 04:51:30,369][106225] Updated weights for policy 1, policy_version 1338842 (0.0008) [2023-12-28 04:51:30,429][106225] Updated weights for policy 1, policy_version 1338852 (0.0008) [2023-12-28 04:51:30,444][106226] Updated weights for policy 0, policy_version 1335496 (0.0006) [2023-12-28 04:51:30,480][106225] Updated weights for policy 1, policy_version 1338862 (0.0008) [2023-12-28 04:51:30,492][106226] Updated weights for policy 0, policy_version 1335506 (0.0008) [2023-12-28 04:51:30,536][106225] Updated weights for policy 1, policy_version 1338872 (0.0007) [2023-12-28 04:51:30,547][106226] Updated weights for policy 0, policy_version 1335516 (0.0006) [2023-12-28 04:51:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 684761088. Throughput: 0: 9772.4, 1: 9970.9. Samples: 684755544. Policy #0 lag: (min: 31.0, avg: 31.7, max: 54.0) [2023-12-28 04:51:31,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.527')] [2023-12-28 04:51:31,300][106225] Updated weights for policy 1, policy_version 1338882 (0.0009) [2023-12-28 04:51:31,371][106225] Updated weights for policy 1, policy_version 1338892 (0.0008) [2023-12-28 04:51:31,372][106226] Updated weights for policy 0, policy_version 1335526 (0.0008) [2023-12-28 04:51:31,420][106225] Updated weights for policy 1, policy_version 1338902 (0.0005) [2023-12-28 04:51:31,438][106226] Updated weights for policy 0, policy_version 1335536 (0.0007) [2023-12-28 04:51:31,501][106226] Updated weights for policy 0, policy_version 1335546 (0.0008) [2023-12-28 04:51:32,166][106225] Updated weights for policy 1, policy_version 1338912 (0.0006) [2023-12-28 04:51:32,215][106226] Updated weights for policy 0, policy_version 1335556 (0.0008) [2023-12-28 04:51:32,222][106225] Updated weights for policy 1, policy_version 1338922 (0.0005) [2023-12-28 04:51:32,274][106226] Updated weights for policy 0, policy_version 1335566 (0.0009) [2023-12-28 04:51:32,292][106225] Updated weights for policy 1, policy_version 1338932 (0.0008) [2023-12-28 04:51:32,329][106226] Updated weights for policy 0, policy_version 1335576 (0.0007) [2023-12-28 04:51:32,886][106225] Updated weights for policy 1, policy_version 1338942 (0.0006) [2023-12-28 04:51:32,933][106225] Updated weights for policy 1, policy_version 1338952 (0.0005) [2023-12-28 04:51:32,987][106225] Updated weights for policy 1, policy_version 1338962 (0.0005) [2023-12-28 04:51:33,176][106226] Updated weights for policy 0, policy_version 1335586 (0.0009) [2023-12-28 04:51:33,228][106226] Updated weights for policy 0, policy_version 1335596 (0.0009) [2023-12-28 04:51:33,291][106226] Updated weights for policy 0, policy_version 1335606 (0.0008) [2023-12-28 04:51:33,353][106226] Updated weights for policy 0, policy_version 1335616 (0.0008) [2023-12-28 04:51:33,657][106225] Updated weights for policy 1, policy_version 1338972 (0.0007) [2023-12-28 04:51:33,713][106225] Updated weights for policy 1, policy_version 1338982 (0.0005) [2023-12-28 04:51:33,773][106225] Updated weights for policy 1, policy_version 1338992 (0.0008) [2023-12-28 04:51:34,113][106226] Updated weights for policy 0, policy_version 1335626 (0.0008) [2023-12-28 04:51:34,175][106226] Updated weights for policy 0, policy_version 1335636 (0.0007) [2023-12-28 04:51:34,236][106226] Updated weights for policy 0, policy_version 1335646 (0.0009) [2023-12-28 04:51:34,453][106225] Updated weights for policy 1, policy_version 1339002 (0.0010) [2023-12-28 04:51:34,507][106225] Updated weights for policy 1, policy_version 1339012 (0.0008) [2023-12-28 04:51:34,561][106225] Updated weights for policy 1, policy_version 1339022 (0.0008) [2023-12-28 04:51:34,618][106225] Updated weights for policy 1, policy_version 1339032 (0.0008) [2023-12-28 04:51:34,966][106226] Updated weights for policy 0, policy_version 1335656 (0.0009) [2023-12-28 04:51:35,023][106226] Updated weights for policy 0, policy_version 1335666 (0.0009) [2023-12-28 04:51:35,084][106226] Updated weights for policy 0, policy_version 1335676 (0.0009) [2023-12-28 04:51:35,368][106225] Updated weights for policy 1, policy_version 1339042 (0.0009) [2023-12-28 04:51:35,432][106225] Updated weights for policy 1, policy_version 1339052 (0.0008) [2023-12-28 04:51:35,495][106225] Updated weights for policy 1, policy_version 1339062 (0.0009) [2023-12-28 04:51:35,774][106226] Updated weights for policy 0, policy_version 1335686 (0.0008) [2023-12-28 04:51:35,827][106226] Updated weights for policy 0, policy_version 1335696 (0.0008) [2023-12-28 04:51:35,881][106226] Updated weights for policy 0, policy_version 1335706 (0.0008) [2023-12-28 04:51:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 684859392. Throughput: 0: 9651.5, 1: 9972.3. Samples: 684870100. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:51:36,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.781')] [2023-12-28 04:51:36,200][106225] Updated weights for policy 1, policy_version 1339072 (0.0008) [2023-12-28 04:51:36,264][106225] Updated weights for policy 1, policy_version 1339082 (0.0008) [2023-12-28 04:51:36,322][106225] Updated weights for policy 1, policy_version 1339092 (0.0007) [2023-12-28 04:51:36,713][106226] Updated weights for policy 0, policy_version 1335716 (0.0009) [2023-12-28 04:51:36,770][106226] Updated weights for policy 0, policy_version 1335726 (0.0009) [2023-12-28 04:51:36,838][106226] Updated weights for policy 0, policy_version 1335736 (0.0008) [2023-12-28 04:51:36,935][106225] Updated weights for policy 1, policy_version 1339102 (0.0006) [2023-12-28 04:51:37,001][106225] Updated weights for policy 1, policy_version 1339112 (0.0006) [2023-12-28 04:51:37,064][106225] Updated weights for policy 1, policy_version 1339122 (0.0005) [2023-12-28 04:51:37,622][106226] Updated weights for policy 0, policy_version 1335746 (0.0008) [2023-12-28 04:51:37,674][106226] Updated weights for policy 0, policy_version 1335756 (0.0008) [2023-12-28 04:51:37,723][106225] Updated weights for policy 1, policy_version 1339132 (0.0006) [2023-12-28 04:51:37,733][106226] Updated weights for policy 0, policy_version 1335766 (0.0009) [2023-12-28 04:51:37,781][106225] Updated weights for policy 1, policy_version 1339142 (0.0007) [2023-12-28 04:51:37,794][106226] Updated weights for policy 0, policy_version 1335776 (0.0006) [2023-12-28 04:51:37,842][106225] Updated weights for policy 1, policy_version 1339152 (0.0009) [2023-12-28 04:51:38,546][106225] Updated weights for policy 1, policy_version 1339162 (0.0008) [2023-12-28 04:51:38,547][106226] Updated weights for policy 0, policy_version 1335786 (0.0009) [2023-12-28 04:51:38,606][106226] Updated weights for policy 0, policy_version 1335796 (0.0006) [2023-12-28 04:51:38,607][106225] Updated weights for policy 1, policy_version 1339172 (0.0010) [2023-12-28 04:51:38,662][106225] Updated weights for policy 1, policy_version 1339182 (0.0010) [2023-12-28 04:51:38,668][106226] Updated weights for policy 0, policy_version 1335806 (0.0005) [2023-12-28 04:51:38,717][106225] Updated weights for policy 1, policy_version 1339192 (0.0010) [2023-12-28 04:51:39,379][106225] Updated weights for policy 1, policy_version 1339202 (0.0010) [2023-12-28 04:51:39,441][106225] Updated weights for policy 1, policy_version 1339212 (0.0009) [2023-12-28 04:51:39,498][106226] Updated weights for policy 0, policy_version 1335816 (0.0006) [2023-12-28 04:51:39,505][106225] Updated weights for policy 1, policy_version 1339222 (0.0009) [2023-12-28 04:51:39,560][106226] Updated weights for policy 0, policy_version 1335826 (0.0009) [2023-12-28 04:51:39,616][106226] Updated weights for policy 0, policy_version 1335836 (0.0008) [2023-12-28 04:51:40,240][106225] Updated weights for policy 1, policy_version 1339232 (0.0008) [2023-12-28 04:51:40,289][106225] Updated weights for policy 1, policy_version 1339242 (0.0008) [2023-12-28 04:51:40,347][106225] Updated weights for policy 1, policy_version 1339252 (0.0008) [2023-12-28 04:51:40,389][106226] Updated weights for policy 0, policy_version 1335846 (0.0010) [2023-12-28 04:51:40,448][106226] Updated weights for policy 0, policy_version 1335856 (0.0010) [2023-12-28 04:51:40,512][106226] Updated weights for policy 0, policy_version 1335866 (0.0011) [2023-12-28 04:51:41,142][106226] Updated weights for policy 0, policy_version 1335876 (0.0011) [2023-12-28 04:51:41,158][106225] Updated weights for policy 1, policy_version 1339262 (0.0008) [2023-12-28 04:51:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 684949504. Throughput: 0: 9639.6, 1: 9973.2. Samples: 684927380. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:51:41,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.846')] [2023-12-28 04:51:41,206][106226] Updated weights for policy 0, policy_version 1335886 (0.0010) [2023-12-28 04:51:41,221][106225] Updated weights for policy 1, policy_version 1339272 (0.0011) [2023-12-28 04:51:41,277][106226] Updated weights for policy 0, policy_version 1335896 (0.0011) [2023-12-28 04:51:41,284][106225] Updated weights for policy 1, policy_version 1339282 (0.0008) [2023-12-28 04:51:41,319][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001339288_342908928.pth... [2023-12-28 04:51:41,319][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001335904_342056960.pth... [2023-12-28 04:51:41,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001334784_341770240.pth [2023-12-28 04:51:41,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001338104_342605824.pth [2023-12-28 04:51:41,997][106226] Updated weights for policy 0, policy_version 1335906 (0.0010) [2023-12-28 04:51:42,040][106225] Updated weights for policy 1, policy_version 1339292 (0.0007) [2023-12-28 04:51:42,063][106226] Updated weights for policy 0, policy_version 1335916 (0.0006) [2023-12-28 04:51:42,100][106225] Updated weights for policy 1, policy_version 1339302 (0.0008) [2023-12-28 04:51:42,128][106226] Updated weights for policy 0, policy_version 1335926 (0.0008) [2023-12-28 04:51:42,150][106225] Updated weights for policy 1, policy_version 1339312 (0.0009) [2023-12-28 04:51:42,186][106226] Updated weights for policy 0, policy_version 1335936 (0.0007) [2023-12-28 04:51:42,911][106226] Updated weights for policy 0, policy_version 1335946 (0.0008) [2023-12-28 04:51:42,925][106225] Updated weights for policy 1, policy_version 1339322 (0.0007) [2023-12-28 04:51:42,976][106226] Updated weights for policy 0, policy_version 1335956 (0.0007) [2023-12-28 04:51:42,984][106225] Updated weights for policy 1, policy_version 1339332 (0.0011) [2023-12-28 04:51:43,033][106226] Updated weights for policy 0, policy_version 1335966 (0.0008) [2023-12-28 04:51:43,037][106225] Updated weights for policy 1, policy_version 1339342 (0.0010) [2023-12-28 04:51:43,083][106225] Updated weights for policy 1, policy_version 1339352 (0.0010) [2023-12-28 04:51:43,763][106226] Updated weights for policy 0, policy_version 1335976 (0.0008) [2023-12-28 04:51:43,831][106226] Updated weights for policy 0, policy_version 1335986 (0.0007) [2023-12-28 04:51:43,833][106225] Updated weights for policy 1, policy_version 1339362 (0.0010) [2023-12-28 04:51:43,878][106226] Updated weights for policy 0, policy_version 1335996 (0.0008) [2023-12-28 04:51:43,884][106225] Updated weights for policy 1, policy_version 1339372 (0.0008) [2023-12-28 04:51:43,931][106225] Updated weights for policy 1, policy_version 1339382 (0.0010) [2023-12-28 04:51:44,511][106226] Updated weights for policy 0, policy_version 1336006 (0.0006) [2023-12-28 04:51:44,530][106225] Updated weights for policy 1, policy_version 1339392 (0.0009) [2023-12-28 04:51:44,572][106226] Updated weights for policy 0, policy_version 1336016 (0.0005) [2023-12-28 04:51:44,587][106225] Updated weights for policy 1, policy_version 1339402 (0.0010) [2023-12-28 04:51:44,635][106226] Updated weights for policy 0, policy_version 1336026 (0.0005) [2023-12-28 04:51:44,644][106225] Updated weights for policy 1, policy_version 1339412 (0.0010) [2023-12-28 04:51:45,292][106225] Updated weights for policy 1, policy_version 1339422 (0.0010) [2023-12-28 04:51:45,354][106225] Updated weights for policy 1, policy_version 1339432 (0.0009) [2023-12-28 04:51:45,366][106226] Updated weights for policy 0, policy_version 1336036 (0.0008) [2023-12-28 04:51:45,414][106225] Updated weights for policy 1, policy_version 1339442 (0.0008) [2023-12-28 04:51:45,429][106226] Updated weights for policy 0, policy_version 1336046 (0.0011) [2023-12-28 04:51:45,488][106226] Updated weights for policy 0, policy_version 1336056 (0.0007) [2023-12-28 04:51:46,023][106226] Updated weights for policy 0, policy_version 1336066 (0.0005) [2023-12-28 04:51:46,079][106226] Updated weights for policy 0, policy_version 1336076 (0.0006) [2023-12-28 04:51:46,093][106225] Updated weights for policy 1, policy_version 1339452 (0.0010) [2023-12-28 04:51:46,134][106226] Updated weights for policy 0, policy_version 1336086 (0.0010) [2023-12-28 04:51:46,150][106225] Updated weights for policy 1, policy_version 1339462 (0.0010) [2023-12-28 04:51:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19605.3). Total num frames: 685047808. Throughput: 0: 9519.8, 1: 9912.7. Samples: 685043348. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:51:46,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.753')] [2023-12-28 04:51:46,180][106226] Updated weights for policy 0, policy_version 1336096 (0.0010) [2023-12-28 04:51:46,211][106225] Updated weights for policy 1, policy_version 1339472 (0.0010) [2023-12-28 04:51:46,719][106226] Updated weights for policy 0, policy_version 1336106 (0.0005) [2023-12-28 04:51:46,774][106226] Updated weights for policy 0, policy_version 1336116 (0.0005) [2023-12-28 04:51:46,829][106226] Updated weights for policy 0, policy_version 1336126 (0.0005) [2023-12-28 04:51:46,926][106225] Updated weights for policy 1, policy_version 1339482 (0.0010) [2023-12-28 04:51:46,973][106225] Updated weights for policy 1, policy_version 1339492 (0.0007) [2023-12-28 04:51:47,032][106225] Updated weights for policy 1, policy_version 1339502 (0.0005) [2023-12-28 04:51:47,093][106225] Updated weights for policy 1, policy_version 1339512 (0.0005) [2023-12-28 04:51:47,424][106226] Updated weights for policy 0, policy_version 1336136 (0.0006) [2023-12-28 04:51:47,475][106226] Updated weights for policy 0, policy_version 1336146 (0.0006) [2023-12-28 04:51:47,523][106226] Updated weights for policy 0, policy_version 1336156 (0.0008) [2023-12-28 04:51:47,746][106225] Updated weights for policy 1, policy_version 1339522 (0.0010) [2023-12-28 04:51:47,803][106225] Updated weights for policy 1, policy_version 1339532 (0.0010) [2023-12-28 04:51:47,852][106225] Updated weights for policy 1, policy_version 1339542 (0.0010) [2023-12-28 04:51:48,280][106226] Updated weights for policy 0, policy_version 1336166 (0.0007) [2023-12-28 04:51:48,344][106226] Updated weights for policy 0, policy_version 1336176 (0.0008) [2023-12-28 04:51:48,416][106226] Updated weights for policy 0, policy_version 1336186 (0.0007) [2023-12-28 04:51:48,479][106225] Updated weights for policy 1, policy_version 1339552 (0.0010) [2023-12-28 04:51:48,541][106225] Updated weights for policy 1, policy_version 1339562 (0.0011) [2023-12-28 04:51:48,596][106225] Updated weights for policy 1, policy_version 1339572 (0.0010) [2023-12-28 04:51:49,102][106226] Updated weights for policy 0, policy_version 1336196 (0.0007) [2023-12-28 04:51:49,159][106226] Updated weights for policy 0, policy_version 1336206 (0.0007) [2023-12-28 04:51:49,209][106226] Updated weights for policy 0, policy_version 1336216 (0.0008) [2023-12-28 04:51:49,349][106225] Updated weights for policy 1, policy_version 1339582 (0.0009) [2023-12-28 04:51:49,417][106225] Updated weights for policy 1, policy_version 1339592 (0.0008) [2023-12-28 04:51:49,473][106225] Updated weights for policy 1, policy_version 1339602 (0.0009) [2023-12-28 04:51:49,991][106226] Updated weights for policy 0, policy_version 1336226 (0.0009) [2023-12-28 04:51:50,043][106226] Updated weights for policy 0, policy_version 1336236 (0.0007) [2023-12-28 04:51:50,095][106226] Updated weights for policy 0, policy_version 1336246 (0.0008) [2023-12-28 04:51:50,153][106226] Updated weights for policy 0, policy_version 1336256 (0.0006) [2023-12-28 04:51:50,180][106225] Updated weights for policy 1, policy_version 1339612 (0.0008) [2023-12-28 04:51:50,264][106225] Updated weights for policy 1, policy_version 1339622 (0.0008) [2023-12-28 04:51:50,328][106225] Updated weights for policy 1, policy_version 1339632 (0.0008) [2023-12-28 04:51:50,813][106226] Updated weights for policy 0, policy_version 1336266 (0.0009) [2023-12-28 04:51:50,865][106226] Updated weights for policy 0, policy_version 1336276 (0.0008) [2023-12-28 04:51:50,925][106226] Updated weights for policy 0, policy_version 1336286 (0.0009) [2023-12-28 04:51:51,047][106225] Updated weights for policy 1, policy_version 1339642 (0.0007) [2023-12-28 04:51:51,113][106225] Updated weights for policy 1, policy_version 1339652 (0.0006) [2023-12-28 04:51:51,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 685154304. Throughput: 0: 9610.8, 1: 9922.0. Samples: 685165944. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:51:51,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.617')] [2023-12-28 04:51:51,185][106225] Updated weights for policy 1, policy_version 1339662 (0.0006) [2023-12-28 04:51:51,250][106225] Updated weights for policy 1, policy_version 1339672 (0.0010) [2023-12-28 04:51:51,672][106226] Updated weights for policy 0, policy_version 1336296 (0.0009) [2023-12-28 04:51:51,738][106226] Updated weights for policy 0, policy_version 1336306 (0.0008) [2023-12-28 04:51:51,798][106226] Updated weights for policy 0, policy_version 1336316 (0.0006) [2023-12-28 04:51:51,947][106225] Updated weights for policy 1, policy_version 1339682 (0.0006) [2023-12-28 04:51:52,011][106225] Updated weights for policy 1, policy_version 1339692 (0.0007) [2023-12-28 04:51:52,071][106225] Updated weights for policy 1, policy_version 1339702 (0.0009) [2023-12-28 04:51:52,526][106226] Updated weights for policy 0, policy_version 1336326 (0.0007) [2023-12-28 04:51:52,588][106226] Updated weights for policy 0, policy_version 1336336 (0.0008) [2023-12-28 04:51:52,642][106226] Updated weights for policy 0, policy_version 1336346 (0.0008) [2023-12-28 04:51:52,777][106225] Updated weights for policy 1, policy_version 1339712 (0.0011) [2023-12-28 04:51:52,835][106225] Updated weights for policy 1, policy_version 1339722 (0.0008) [2023-12-28 04:51:52,886][106225] Updated weights for policy 1, policy_version 1339732 (0.0007) [2023-12-28 04:51:53,392][106226] Updated weights for policy 0, policy_version 1336356 (0.0008) [2023-12-28 04:51:53,446][106226] Updated weights for policy 0, policy_version 1336366 (0.0008) [2023-12-28 04:51:53,492][106226] Updated weights for policy 0, policy_version 1336376 (0.0008) [2023-12-28 04:51:53,591][106225] Updated weights for policy 1, policy_version 1339742 (0.0010) [2023-12-28 04:51:53,637][106225] Updated weights for policy 1, policy_version 1339752 (0.0010) [2023-12-28 04:51:53,690][106225] Updated weights for policy 1, policy_version 1339762 (0.0010) [2023-12-28 04:51:54,113][106226] Updated weights for policy 0, policy_version 1336386 (0.0007) [2023-12-28 04:51:54,171][106226] Updated weights for policy 0, policy_version 1336396 (0.0005) [2023-12-28 04:51:54,234][106226] Updated weights for policy 0, policy_version 1336406 (0.0006) [2023-12-28 04:51:54,286][106226] Updated weights for policy 0, policy_version 1336416 (0.0008) [2023-12-28 04:51:54,364][106225] Updated weights for policy 1, policy_version 1339772 (0.0010) [2023-12-28 04:51:54,416][106225] Updated weights for policy 1, policy_version 1339782 (0.0008) [2023-12-28 04:51:54,481][106225] Updated weights for policy 1, policy_version 1339792 (0.0006) [2023-12-28 04:51:55,046][106226] Updated weights for policy 0, policy_version 1336426 (0.0009) [2023-12-28 04:51:55,061][106225] Updated weights for policy 1, policy_version 1339802 (0.0006) [2023-12-28 04:51:55,102][106226] Updated weights for policy 0, policy_version 1336436 (0.0007) [2023-12-28 04:51:55,112][106225] Updated weights for policy 1, policy_version 1339812 (0.0006) [2023-12-28 04:51:55,163][106226] Updated weights for policy 0, policy_version 1336446 (0.0007) [2023-12-28 04:51:55,164][106225] Updated weights for policy 1, policy_version 1339822 (0.0005) [2023-12-28 04:51:55,216][106225] Updated weights for policy 1, policy_version 1339832 (0.0005) [2023-12-28 04:51:55,757][106226] Updated weights for policy 0, policy_version 1336456 (0.0011) [2023-12-28 04:51:55,821][106226] Updated weights for policy 0, policy_version 1336466 (0.0010) [2023-12-28 04:51:55,884][106226] Updated weights for policy 0, policy_version 1336476 (0.0010) [2023-12-28 04:51:55,926][106225] Updated weights for policy 1, policy_version 1339842 (0.0010) [2023-12-28 04:51:55,972][106225] Updated weights for policy 1, policy_version 1339852 (0.0010) [2023-12-28 04:51:56,022][106225] Updated weights for policy 1, policy_version 1339862 (0.0010) [2023-12-28 04:51:56,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 685260800. Throughput: 0: 9639.9, 1: 9858.1. Samples: 685224424. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:51:56,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.579')] [2023-12-28 04:51:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001339864_343056384.pth... [2023-12-28 04:51:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001336480_342204416.pth... [2023-12-28 04:51:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001338680_342753280.pth [2023-12-28 04:51:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001335328_341909504.pth [2023-12-28 04:51:56,519][106226] Updated weights for policy 0, policy_version 1336486 (0.0007) [2023-12-28 04:51:56,566][106226] Updated weights for policy 0, policy_version 1336496 (0.0005) [2023-12-28 04:51:56,619][106226] Updated weights for policy 0, policy_version 1336506 (0.0005) [2023-12-28 04:51:56,697][106225] Updated weights for policy 1, policy_version 1339872 (0.0010) [2023-12-28 04:51:56,747][106225] Updated weights for policy 1, policy_version 1339882 (0.0007) [2023-12-28 04:51:56,800][106225] Updated weights for policy 1, policy_version 1339892 (0.0005) [2023-12-28 04:51:57,159][106226] Updated weights for policy 0, policy_version 1336516 (0.0007) [2023-12-28 04:51:57,218][106226] Updated weights for policy 0, policy_version 1336526 (0.0005) [2023-12-28 04:51:57,279][106226] Updated weights for policy 0, policy_version 1336536 (0.0006) [2023-12-28 04:51:57,454][106225] Updated weights for policy 1, policy_version 1339902 (0.0008) [2023-12-28 04:51:57,503][106225] Updated weights for policy 1, policy_version 1339912 (0.0008) [2023-12-28 04:51:57,556][106225] Updated weights for policy 1, policy_version 1339923 (0.0007) [2023-12-28 04:51:57,820][106226] Updated weights for policy 0, policy_version 1336546 (0.0007) [2023-12-28 04:51:57,876][106226] Updated weights for policy 0, policy_version 1336556 (0.0008) [2023-12-28 04:51:57,933][106226] Updated weights for policy 0, policy_version 1336566 (0.0009) [2023-12-28 04:51:57,985][106226] Updated weights for policy 0, policy_version 1336576 (0.0008) [2023-12-28 04:51:58,330][106225] Updated weights for policy 1, policy_version 1339933 (0.0007) [2023-12-28 04:51:58,402][106225] Updated weights for policy 1, policy_version 1339943 (0.0008) [2023-12-28 04:51:58,468][106225] Updated weights for policy 1, policy_version 1339953 (0.0009) [2023-12-28 04:51:58,716][106226] Updated weights for policy 0, policy_version 1336586 (0.0009) [2023-12-28 04:51:58,782][106226] Updated weights for policy 0, policy_version 1336596 (0.0008) [2023-12-28 04:51:58,853][106226] Updated weights for policy 0, policy_version 1336606 (0.0007) [2023-12-28 04:51:59,394][106225] Updated weights for policy 1, policy_version 1339963 (0.0008) [2023-12-28 04:51:59,451][106225] Updated weights for policy 1, policy_version 1339973 (0.0008) [2023-12-28 04:51:59,494][106225] Updated weights for policy 1, policy_version 1339983 (0.0007) [2023-12-28 04:51:59,597][106226] Updated weights for policy 0, policy_version 1336616 (0.0008) [2023-12-28 04:51:59,662][106226] Updated weights for policy 0, policy_version 1336626 (0.0009) [2023-12-28 04:51:59,722][106226] Updated weights for policy 0, policy_version 1336636 (0.0008) [2023-12-28 04:52:00,226][106225] Updated weights for policy 1, policy_version 1339993 (0.0008) [2023-12-28 04:52:00,292][106225] Updated weights for policy 1, policy_version 1340003 (0.0008) [2023-12-28 04:52:00,344][106225] Updated weights for policy 1, policy_version 1340013 (0.0009) [2023-12-28 04:52:00,401][106225] Updated weights for policy 1, policy_version 1340023 (0.0008) [2023-12-28 04:52:00,496][106226] Updated weights for policy 0, policy_version 1336646 (0.0009) [2023-12-28 04:52:00,555][106226] Updated weights for policy 0, policy_version 1336656 (0.0008) [2023-12-28 04:52:00,606][106226] Updated weights for policy 0, policy_version 1336666 (0.0008) [2023-12-28 04:52:01,112][106225] Updated weights for policy 1, policy_version 1340033 (0.0009) [2023-12-28 04:52:01,174][106225] Updated weights for policy 1, policy_version 1340043 (0.0008) [2023-12-28 04:52:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 685350912. Throughput: 0: 9772.4, 1: 9895.6. Samples: 685346296. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:01,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.535')] [2023-12-28 04:52:01,237][106225] Updated weights for policy 1, policy_version 1340053 (0.0008) [2023-12-28 04:52:01,401][106226] Updated weights for policy 0, policy_version 1336676 (0.0009) [2023-12-28 04:52:01,458][106226] Updated weights for policy 0, policy_version 1336686 (0.0009) [2023-12-28 04:52:01,506][106226] Updated weights for policy 0, policy_version 1336696 (0.0009) [2023-12-28 04:52:02,063][106225] Updated weights for policy 1, policy_version 1340063 (0.0006) [2023-12-28 04:52:02,118][106225] Updated weights for policy 1, policy_version 1340073 (0.0005) [2023-12-28 04:52:02,177][106225] Updated weights for policy 1, policy_version 1340083 (0.0005) [2023-12-28 04:52:02,297][106226] Updated weights for policy 0, policy_version 1336706 (0.0009) [2023-12-28 04:52:02,359][106226] Updated weights for policy 0, policy_version 1336716 (0.0011) [2023-12-28 04:52:02,419][106226] Updated weights for policy 0, policy_version 1336726 (0.0011) [2023-12-28 04:52:02,479][106226] Updated weights for policy 0, policy_version 1336736 (0.0010) [2023-12-28 04:52:02,831][106225] Updated weights for policy 1, policy_version 1340093 (0.0007) [2023-12-28 04:52:02,890][106225] Updated weights for policy 1, policy_version 1340103 (0.0007) [2023-12-28 04:52:02,942][106225] Updated weights for policy 1, policy_version 1340113 (0.0008) [2023-12-28 04:52:03,184][106226] Updated weights for policy 0, policy_version 1336746 (0.0010) [2023-12-28 04:52:03,242][106226] Updated weights for policy 0, policy_version 1336756 (0.0011) [2023-12-28 04:52:03,302][106226] Updated weights for policy 0, policy_version 1336766 (0.0011) [2023-12-28 04:52:03,619][106225] Updated weights for policy 1, policy_version 1340123 (0.0007) [2023-12-28 04:52:03,679][106225] Updated weights for policy 1, policy_version 1340133 (0.0008) [2023-12-28 04:52:03,741][106225] Updated weights for policy 1, policy_version 1340143 (0.0008) [2023-12-28 04:52:04,027][106226] Updated weights for policy 0, policy_version 1336776 (0.0007) [2023-12-28 04:52:04,097][106226] Updated weights for policy 0, policy_version 1336786 (0.0007) [2023-12-28 04:52:04,163][106226] Updated weights for policy 0, policy_version 1336796 (0.0007) [2023-12-28 04:52:04,547][106225] Updated weights for policy 1, policy_version 1340153 (0.0008) [2023-12-28 04:52:04,606][106225] Updated weights for policy 1, policy_version 1340163 (0.0010) [2023-12-28 04:52:04,665][106225] Updated weights for policy 1, policy_version 1340173 (0.0011) [2023-12-28 04:52:04,723][106225] Updated weights for policy 1, policy_version 1340183 (0.0011) [2023-12-28 04:52:04,800][106226] Updated weights for policy 0, policy_version 1336806 (0.0008) [2023-12-28 04:52:04,860][106226] Updated weights for policy 0, policy_version 1336816 (0.0009) [2023-12-28 04:52:04,918][106226] Updated weights for policy 0, policy_version 1336826 (0.0008) [2023-12-28 04:52:05,396][106225] Updated weights for policy 1, policy_version 1340193 (0.0006) [2023-12-28 04:52:05,444][106225] Updated weights for policy 1, policy_version 1340203 (0.0005) [2023-12-28 04:52:05,500][106225] Updated weights for policy 1, policy_version 1340213 (0.0005) [2023-12-28 04:52:05,653][106226] Updated weights for policy 0, policy_version 1336836 (0.0008) [2023-12-28 04:52:05,709][106226] Updated weights for policy 0, policy_version 1336846 (0.0005) [2023-12-28 04:52:05,754][106226] Updated weights for policy 0, policy_version 1336856 (0.0005) [2023-12-28 04:52:06,139][106225] Updated weights for policy 1, policy_version 1340223 (0.0007) [2023-12-28 04:52:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 685449216. Throughput: 0: 9817.6, 1: 9893.0. Samples: 685462968. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:06,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.464')] [2023-12-28 04:52:06,204][106225] Updated weights for policy 1, policy_version 1340233 (0.0008) [2023-12-28 04:52:06,271][106225] Updated weights for policy 1, policy_version 1340243 (0.0008) [2023-12-28 04:52:06,404][106226] Updated weights for policy 0, policy_version 1336866 (0.0005) [2023-12-28 04:52:06,469][106226] Updated weights for policy 0, policy_version 1336876 (0.0008) [2023-12-28 04:52:06,530][106226] Updated weights for policy 0, policy_version 1336886 (0.0008) [2023-12-28 04:52:06,591][106226] Updated weights for policy 0, policy_version 1336896 (0.0008) [2023-12-28 04:52:06,982][106225] Updated weights for policy 1, policy_version 1340253 (0.0007) [2023-12-28 04:52:07,054][106225] Updated weights for policy 1, policy_version 1340263 (0.0011) [2023-12-28 04:52:07,126][106225] Updated weights for policy 1, policy_version 1340273 (0.0011) [2023-12-28 04:52:07,200][106226] Updated weights for policy 0, policy_version 1336906 (0.0007) [2023-12-28 04:52:07,255][106226] Updated weights for policy 0, policy_version 1336916 (0.0008) [2023-12-28 04:52:07,307][106226] Updated weights for policy 0, policy_version 1336926 (0.0008) [2023-12-28 04:52:07,748][106225] Updated weights for policy 1, policy_version 1340283 (0.0010) [2023-12-28 04:52:07,805][106225] Updated weights for policy 1, policy_version 1340293 (0.0006) [2023-12-28 04:52:07,865][106225] Updated weights for policy 1, policy_version 1340303 (0.0008) [2023-12-28 04:52:08,039][106226] Updated weights for policy 0, policy_version 1336936 (0.0006) [2023-12-28 04:52:08,086][106226] Updated weights for policy 0, policy_version 1336946 (0.0005) [2023-12-28 04:52:08,141][106226] Updated weights for policy 0, policy_version 1336956 (0.0005) [2023-12-28 04:52:08,491][106225] Updated weights for policy 1, policy_version 1340313 (0.0008) [2023-12-28 04:52:08,556][106225] Updated weights for policy 1, policy_version 1340323 (0.0008) [2023-12-28 04:52:08,616][106225] Updated weights for policy 1, policy_version 1340333 (0.0008) [2023-12-28 04:52:08,679][106225] Updated weights for policy 1, policy_version 1340343 (0.0008) [2023-12-28 04:52:08,789][106226] Updated weights for policy 0, policy_version 1336966 (0.0007) [2023-12-28 04:52:08,853][106226] Updated weights for policy 0, policy_version 1336976 (0.0009) [2023-12-28 04:52:08,914][106226] Updated weights for policy 0, policy_version 1336986 (0.0009) [2023-12-28 04:52:09,424][106225] Updated weights for policy 1, policy_version 1340353 (0.0009) [2023-12-28 04:52:09,486][106225] Updated weights for policy 1, policy_version 1340363 (0.0009) [2023-12-28 04:52:09,548][106225] Updated weights for policy 1, policy_version 1340373 (0.0008) [2023-12-28 04:52:09,718][106226] Updated weights for policy 0, policy_version 1336996 (0.0008) [2023-12-28 04:52:09,782][106226] Updated weights for policy 0, policy_version 1337006 (0.0006) [2023-12-28 04:52:09,856][106226] Updated weights for policy 0, policy_version 1337016 (0.0008) [2023-12-28 04:52:10,313][106225] Updated weights for policy 1, policy_version 1340383 (0.0008) [2023-12-28 04:52:10,380][106225] Updated weights for policy 1, policy_version 1340393 (0.0008) [2023-12-28 04:52:10,440][106225] Updated weights for policy 1, policy_version 1340403 (0.0008) [2023-12-28 04:52:10,550][106226] Updated weights for policy 0, policy_version 1337026 (0.0009) [2023-12-28 04:52:10,614][106226] Updated weights for policy 0, policy_version 1337036 (0.0009) [2023-12-28 04:52:10,676][106226] Updated weights for policy 0, policy_version 1337046 (0.0008) [2023-12-28 04:52:10,734][106226] Updated weights for policy 0, policy_version 1337056 (0.0009) [2023-12-28 04:52:11,130][106225] Updated weights for policy 1, policy_version 1340413 (0.0009) [2023-12-28 04:52:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 685547520. Throughput: 0: 9850.6, 1: 9906.8. Samples: 685523468. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:11,175][105115] Avg episode reward: [(0, '-4.831'), (1, '-4.703')] [2023-12-28 04:52:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001337056_342351872.pth... [2023-12-28 04:52:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001335904_342056960.pth [2023-12-28 04:52:11,192][106225] Updated weights for policy 1, policy_version 1340423 (0.0009) [2023-12-28 04:52:11,252][106225] Updated weights for policy 1, policy_version 1340433 (0.0010) [2023-12-28 04:52:11,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001340440_343203840.pth... [2023-12-28 04:52:11,296][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001339288_342908928.pth [2023-12-28 04:52:11,518][106226] Updated weights for policy 0, policy_version 1337066 (0.0008) [2023-12-28 04:52:11,583][106226] Updated weights for policy 0, policy_version 1337076 (0.0007) [2023-12-28 04:52:11,652][106226] Updated weights for policy 0, policy_version 1337086 (0.0007) [2023-12-28 04:52:12,090][106225] Updated weights for policy 1, policy_version 1340443 (0.0010) [2023-12-28 04:52:12,146][106225] Updated weights for policy 1, policy_version 1340453 (0.0009) [2023-12-28 04:52:12,207][106225] Updated weights for policy 1, policy_version 1340463 (0.0008) [2023-12-28 04:52:12,299][106226] Updated weights for policy 0, policy_version 1337096 (0.0010) [2023-12-28 04:52:12,362][106226] Updated weights for policy 0, policy_version 1337106 (0.0010) [2023-12-28 04:52:12,429][106226] Updated weights for policy 0, policy_version 1337116 (0.0009) [2023-12-28 04:52:12,936][106225] Updated weights for policy 1, policy_version 1340473 (0.0008) [2023-12-28 04:52:12,994][106225] Updated weights for policy 1, policy_version 1340483 (0.0008) [2023-12-28 04:52:13,053][106225] Updated weights for policy 1, policy_version 1340493 (0.0008) [2023-12-28 04:52:13,110][106225] Updated weights for policy 1, policy_version 1340503 (0.0009) [2023-12-28 04:52:13,179][106226] Updated weights for policy 0, policy_version 1337126 (0.0009) [2023-12-28 04:52:13,247][106226] Updated weights for policy 0, policy_version 1337136 (0.0009) [2023-12-28 04:52:13,298][106226] Updated weights for policy 0, policy_version 1337146 (0.0008) [2023-12-28 04:52:13,869][106225] Updated weights for policy 1, policy_version 1340513 (0.0008) [2023-12-28 04:52:13,930][106225] Updated weights for policy 1, policy_version 1340523 (0.0009) [2023-12-28 04:52:13,990][106225] Updated weights for policy 1, policy_version 1340533 (0.0008) [2023-12-28 04:52:14,047][106226] Updated weights for policy 0, policy_version 1337156 (0.0008) [2023-12-28 04:52:14,106][106226] Updated weights for policy 0, policy_version 1337166 (0.0008) [2023-12-28 04:52:14,158][106226] Updated weights for policy 0, policy_version 1337176 (0.0008) [2023-12-28 04:52:14,693][106225] Updated weights for policy 1, policy_version 1340543 (0.0006) [2023-12-28 04:52:14,760][106225] Updated weights for policy 1, policy_version 1340553 (0.0005) [2023-12-28 04:52:14,829][106225] Updated weights for policy 1, policy_version 1340563 (0.0008) [2023-12-28 04:52:14,925][106226] Updated weights for policy 0, policy_version 1337186 (0.0008) [2023-12-28 04:52:14,992][106226] Updated weights for policy 0, policy_version 1337196 (0.0008) [2023-12-28 04:52:15,056][106226] Updated weights for policy 0, policy_version 1337206 (0.0008) [2023-12-28 04:52:15,119][106226] Updated weights for policy 0, policy_version 1337216 (0.0009) [2023-12-28 04:52:15,486][106225] Updated weights for policy 1, policy_version 1340573 (0.0009) [2023-12-28 04:52:15,536][106225] Updated weights for policy 1, policy_version 1340583 (0.0010) [2023-12-28 04:52:15,598][106225] Updated weights for policy 1, policy_version 1340593 (0.0007) [2023-12-28 04:52:15,813][106226] Updated weights for policy 0, policy_version 1337226 (0.0008) [2023-12-28 04:52:15,873][106226] Updated weights for policy 0, policy_version 1337236 (0.0005) [2023-12-28 04:52:15,924][106226] Updated weights for policy 0, policy_version 1337246 (0.0005) [2023-12-28 04:52:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 685645824. Throughput: 0: 9764.2, 1: 9807.4. Samples: 685636264. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:16,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.439')] [2023-12-28 04:52:16,263][106225] Updated weights for policy 1, policy_version 1340603 (0.0006) [2023-12-28 04:52:16,321][106225] Updated weights for policy 1, policy_version 1340613 (0.0008) [2023-12-28 04:52:16,377][106225] Updated weights for policy 1, policy_version 1340623 (0.0008) [2023-12-28 04:52:16,575][106226] Updated weights for policy 0, policy_version 1337256 (0.0009) [2023-12-28 04:52:16,619][106226] Updated weights for policy 0, policy_version 1337266 (0.0010) [2023-12-28 04:52:16,668][106226] Updated weights for policy 0, policy_version 1337276 (0.0010) [2023-12-28 04:52:17,068][106225] Updated weights for policy 1, policy_version 1340633 (0.0008) [2023-12-28 04:52:17,128][106225] Updated weights for policy 1, policy_version 1340643 (0.0008) [2023-12-28 04:52:17,195][106225] Updated weights for policy 1, policy_version 1340653 (0.0007) [2023-12-28 04:52:17,248][106225] Updated weights for policy 1, policy_version 1340663 (0.0007) [2023-12-28 04:52:17,388][106226] Updated weights for policy 0, policy_version 1337286 (0.0010) [2023-12-28 04:52:17,447][106226] Updated weights for policy 0, policy_version 1337296 (0.0010) [2023-12-28 04:52:17,510][106226] Updated weights for policy 0, policy_version 1337306 (0.0011) [2023-12-28 04:52:17,893][106225] Updated weights for policy 1, policy_version 1340673 (0.0008) [2023-12-28 04:52:17,939][106225] Updated weights for policy 1, policy_version 1340683 (0.0007) [2023-12-28 04:52:17,992][106225] Updated weights for policy 1, policy_version 1340693 (0.0007) [2023-12-28 04:52:18,220][106226] Updated weights for policy 0, policy_version 1337316 (0.0011) [2023-12-28 04:52:18,280][106226] Updated weights for policy 0, policy_version 1337326 (0.0010) [2023-12-28 04:52:18,357][106226] Updated weights for policy 0, policy_version 1337336 (0.0010) [2023-12-28 04:52:18,714][106225] Updated weights for policy 1, policy_version 1340703 (0.0008) [2023-12-28 04:52:18,762][106225] Updated weights for policy 1, policy_version 1340713 (0.0006) [2023-12-28 04:52:18,823][106225] Updated weights for policy 1, policy_version 1340723 (0.0006) [2023-12-28 04:52:19,062][106226] Updated weights for policy 0, policy_version 1337346 (0.0011) [2023-12-28 04:52:19,113][106226] Updated weights for policy 0, policy_version 1337356 (0.0007) [2023-12-28 04:52:19,168][106226] Updated weights for policy 0, policy_version 1337366 (0.0005) [2023-12-28 04:52:19,225][106226] Updated weights for policy 0, policy_version 1337376 (0.0008) [2023-12-28 04:52:19,574][106225] Updated weights for policy 1, policy_version 1340733 (0.0007) [2023-12-28 04:52:19,636][106225] Updated weights for policy 1, policy_version 1340743 (0.0009) [2023-12-28 04:52:19,702][106225] Updated weights for policy 1, policy_version 1340753 (0.0008) [2023-12-28 04:52:19,898][106226] Updated weights for policy 0, policy_version 1337386 (0.0008) [2023-12-28 04:52:19,971][106226] Updated weights for policy 0, policy_version 1337396 (0.0008) [2023-12-28 04:52:20,040][106226] Updated weights for policy 0, policy_version 1337406 (0.0008) [2023-12-28 04:52:20,416][106225] Updated weights for policy 1, policy_version 1340763 (0.0009) [2023-12-28 04:52:20,476][106225] Updated weights for policy 1, policy_version 1340773 (0.0008) [2023-12-28 04:52:20,533][106225] Updated weights for policy 1, policy_version 1340783 (0.0008) [2023-12-28 04:52:20,835][106226] Updated weights for policy 0, policy_version 1337416 (0.0009) [2023-12-28 04:52:20,895][106226] Updated weights for policy 0, policy_version 1337426 (0.0009) [2023-12-28 04:52:20,963][106226] Updated weights for policy 0, policy_version 1337436 (0.0009) [2023-12-28 04:52:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 685744128. Throughput: 0: 9814.9, 1: 9806.7. Samples: 685753068. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:21,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.494')] [2023-12-28 04:52:21,258][106225] Updated weights for policy 1, policy_version 1340793 (0.0008) [2023-12-28 04:52:21,318][106225] Updated weights for policy 1, policy_version 1340803 (0.0007) [2023-12-28 04:52:21,385][106225] Updated weights for policy 1, policy_version 1340813 (0.0008) [2023-12-28 04:52:21,453][106225] Updated weights for policy 1, policy_version 1340823 (0.0008) [2023-12-28 04:52:21,782][106226] Updated weights for policy 0, policy_version 1337446 (0.0008) [2023-12-28 04:52:21,843][106226] Updated weights for policy 0, policy_version 1337456 (0.0010) [2023-12-28 04:52:21,913][106226] Updated weights for policy 0, policy_version 1337466 (0.0007) [2023-12-28 04:52:22,200][106225] Updated weights for policy 1, policy_version 1340833 (0.0010) [2023-12-28 04:52:22,266][106225] Updated weights for policy 1, policy_version 1340843 (0.0010) [2023-12-28 04:52:22,322][106225] Updated weights for policy 1, policy_version 1340853 (0.0010) [2023-12-28 04:52:22,669][106226] Updated weights for policy 0, policy_version 1337476 (0.0009) [2023-12-28 04:52:22,725][106226] Updated weights for policy 0, policy_version 1337486 (0.0008) [2023-12-28 04:52:22,775][106226] Updated weights for policy 0, policy_version 1337496 (0.0007) [2023-12-28 04:52:22,998][106225] Updated weights for policy 1, policy_version 1340863 (0.0010) [2023-12-28 04:52:23,061][106225] Updated weights for policy 1, policy_version 1340873 (0.0010) [2023-12-28 04:52:23,122][106225] Updated weights for policy 1, policy_version 1340883 (0.0010) [2023-12-28 04:52:23,530][106226] Updated weights for policy 0, policy_version 1337506 (0.0008) [2023-12-28 04:52:23,589][106226] Updated weights for policy 0, policy_version 1337516 (0.0006) [2023-12-28 04:52:23,654][106226] Updated weights for policy 0, policy_version 1337526 (0.0005) [2023-12-28 04:52:23,717][106226] Updated weights for policy 0, policy_version 1337536 (0.0006) [2023-12-28 04:52:23,832][106225] Updated weights for policy 1, policy_version 1340893 (0.0010) [2023-12-28 04:52:23,896][106225] Updated weights for policy 1, policy_version 1340903 (0.0010) [2023-12-28 04:52:23,956][106225] Updated weights for policy 1, policy_version 1340913 (0.0010) [2023-12-28 04:52:24,387][106226] Updated weights for policy 0, policy_version 1337546 (0.0007) [2023-12-28 04:52:24,441][106226] Updated weights for policy 0, policy_version 1337556 (0.0008) [2023-12-28 04:52:24,499][106226] Updated weights for policy 0, policy_version 1337566 (0.0008) [2023-12-28 04:52:24,681][106225] Updated weights for policy 1, policy_version 1340923 (0.0010) [2023-12-28 04:52:24,727][106225] Updated weights for policy 1, policy_version 1340933 (0.0010) [2023-12-28 04:52:24,774][106225] Updated weights for policy 1, policy_version 1340943 (0.0010) [2023-12-28 04:52:25,219][106226] Updated weights for policy 0, policy_version 1337576 (0.0008) [2023-12-28 04:52:25,274][106226] Updated weights for policy 0, policy_version 1337586 (0.0007) [2023-12-28 04:52:25,330][106226] Updated weights for policy 0, policy_version 1337596 (0.0007) [2023-12-28 04:52:25,514][106225] Updated weights for policy 1, policy_version 1340953 (0.0010) [2023-12-28 04:52:25,574][106225] Updated weights for policy 1, policy_version 1340963 (0.0010) [2023-12-28 04:52:25,630][106225] Updated weights for policy 1, policy_version 1340973 (0.0010) [2023-12-28 04:52:25,680][106225] Updated weights for policy 1, policy_version 1340983 (0.0010) [2023-12-28 04:52:26,055][106226] Updated weights for policy 0, policy_version 1337606 (0.0009) [2023-12-28 04:52:26,118][106226] Updated weights for policy 0, policy_version 1337616 (0.0011) [2023-12-28 04:52:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 685834240. Throughput: 0: 9850.0, 1: 9771.8. Samples: 685810356. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:26,175][106226] Updated weights for policy 0, policy_version 1337626 (0.0010) [2023-12-28 04:52:26,175][105115] Avg episode reward: [(0, '-4.220'), (1, '-4.731')] [2023-12-28 04:52:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001340984_343343104.pth... [2023-12-28 04:52:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001339864_343056384.pth [2023-12-28 04:52:26,207][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001337632_342499328.pth... [2023-12-28 04:52:26,212][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001336480_342204416.pth [2023-12-28 04:52:26,360][106225] Updated weights for policy 1, policy_version 1340993 (0.0010) [2023-12-28 04:52:26,419][106225] Updated weights for policy 1, policy_version 1341003 (0.0010) [2023-12-28 04:52:26,470][106225] Updated weights for policy 1, policy_version 1341013 (0.0010) [2023-12-28 04:52:26,805][106226] Updated weights for policy 0, policy_version 1337636 (0.0009) [2023-12-28 04:52:26,851][106226] Updated weights for policy 0, policy_version 1337646 (0.0006) [2023-12-28 04:52:26,906][106226] Updated weights for policy 0, policy_version 1337656 (0.0005) [2023-12-28 04:52:27,183][106225] Updated weights for policy 1, policy_version 1341023 (0.0010) [2023-12-28 04:52:27,248][106225] Updated weights for policy 1, policy_version 1341033 (0.0010) [2023-12-28 04:52:27,307][106225] Updated weights for policy 1, policy_version 1341043 (0.0010) [2023-12-28 04:52:27,578][106226] Updated weights for policy 0, policy_version 1337666 (0.0007) [2023-12-28 04:52:27,634][106226] Updated weights for policy 0, policy_version 1337676 (0.0007) [2023-12-28 04:52:27,684][106226] Updated weights for policy 0, policy_version 1337686 (0.0008) [2023-12-28 04:52:27,733][106226] Updated weights for policy 0, policy_version 1337696 (0.0007) [2023-12-28 04:52:28,009][106225] Updated weights for policy 1, policy_version 1341053 (0.0009) [2023-12-28 04:52:28,062][106225] Updated weights for policy 1, policy_version 1341063 (0.0010) [2023-12-28 04:52:28,118][106225] Updated weights for policy 1, policy_version 1341073 (0.0010) [2023-12-28 04:52:28,442][106226] Updated weights for policy 0, policy_version 1337706 (0.0008) [2023-12-28 04:52:28,495][106226] Updated weights for policy 0, policy_version 1337716 (0.0008) [2023-12-28 04:52:28,548][106226] Updated weights for policy 0, policy_version 1337726 (0.0007) [2023-12-28 04:52:28,832][106225] Updated weights for policy 1, policy_version 1341083 (0.0010) [2023-12-28 04:52:28,885][106225] Updated weights for policy 1, policy_version 1341093 (0.0010) [2023-12-28 04:52:28,938][106225] Updated weights for policy 1, policy_version 1341103 (0.0010) [2023-12-28 04:52:29,276][106226] Updated weights for policy 0, policy_version 1337736 (0.0008) [2023-12-28 04:52:29,344][106226] Updated weights for policy 0, policy_version 1337746 (0.0008) [2023-12-28 04:52:29,411][106226] Updated weights for policy 0, policy_version 1337756 (0.0008) [2023-12-28 04:52:29,629][106225] Updated weights for policy 1, policy_version 1341113 (0.0010) [2023-12-28 04:52:29,689][106225] Updated weights for policy 1, policy_version 1341123 (0.0009) [2023-12-28 04:52:29,751][106225] Updated weights for policy 1, policy_version 1341133 (0.0008) [2023-12-28 04:52:29,816][106225] Updated weights for policy 1, policy_version 1341143 (0.0009) [2023-12-28 04:52:30,155][106226] Updated weights for policy 0, policy_version 1337766 (0.0008) [2023-12-28 04:52:30,220][106226] Updated weights for policy 0, policy_version 1337776 (0.0008) [2023-12-28 04:52:30,277][106226] Updated weights for policy 0, policy_version 1337786 (0.0008) [2023-12-28 04:52:30,557][106225] Updated weights for policy 1, policy_version 1341153 (0.0009) [2023-12-28 04:52:30,611][106225] Updated weights for policy 1, policy_version 1341163 (0.0009) [2023-12-28 04:52:30,665][106225] Updated weights for policy 1, policy_version 1341173 (0.0008) [2023-12-28 04:52:30,892][106226] Updated weights for policy 0, policy_version 1337796 (0.0009) [2023-12-28 04:52:30,957][106226] Updated weights for policy 0, policy_version 1337806 (0.0009) [2023-12-28 04:52:31,016][106226] Updated weights for policy 0, policy_version 1337816 (0.0009) [2023-12-28 04:52:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 685940736. Throughput: 0: 9891.2, 1: 9789.3. Samples: 685928972. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:31,175][105115] Avg episode reward: [(0, '-4.392'), (1, '-4.836')] [2023-12-28 04:52:31,446][106225] Updated weights for policy 1, policy_version 1341183 (0.0007) [2023-12-28 04:52:31,514][106225] Updated weights for policy 1, policy_version 1341193 (0.0005) [2023-12-28 04:52:31,576][106225] Updated weights for policy 1, policy_version 1341203 (0.0006) [2023-12-28 04:52:31,776][106226] Updated weights for policy 0, policy_version 1337826 (0.0009) [2023-12-28 04:52:31,833][106226] Updated weights for policy 0, policy_version 1337836 (0.0007) [2023-12-28 04:52:31,881][106226] Updated weights for policy 0, policy_version 1337846 (0.0007) [2023-12-28 04:52:31,937][106226] Updated weights for policy 0, policy_version 1337856 (0.0007) [2023-12-28 04:52:32,255][106225] Updated weights for policy 1, policy_version 1341213 (0.0007) [2023-12-28 04:52:32,324][106225] Updated weights for policy 1, policy_version 1341223 (0.0011) [2023-12-28 04:52:32,389][106225] Updated weights for policy 1, policy_version 1341233 (0.0010) [2023-12-28 04:52:32,671][106226] Updated weights for policy 0, policy_version 1337866 (0.0008) [2023-12-28 04:52:32,731][106226] Updated weights for policy 0, policy_version 1337876 (0.0010) [2023-12-28 04:52:32,798][106226] Updated weights for policy 0, policy_version 1337886 (0.0006) [2023-12-28 04:52:32,986][106225] Updated weights for policy 1, policy_version 1341243 (0.0009) [2023-12-28 04:52:33,043][106225] Updated weights for policy 1, policy_version 1341253 (0.0005) [2023-12-28 04:52:33,100][106225] Updated weights for policy 1, policy_version 1341263 (0.0010) [2023-12-28 04:52:33,476][106226] Updated weights for policy 0, policy_version 1337896 (0.0007) [2023-12-28 04:52:33,534][106226] Updated weights for policy 0, policy_version 1337906 (0.0008) [2023-12-28 04:52:33,587][106226] Updated weights for policy 0, policy_version 1337916 (0.0008) [2023-12-28 04:52:33,734][106225] Updated weights for policy 1, policy_version 1341273 (0.0010) [2023-12-28 04:52:33,811][106225] Updated weights for policy 1, policy_version 1341283 (0.0005) [2023-12-28 04:52:33,866][106225] Updated weights for policy 1, policy_version 1341293 (0.0005) [2023-12-28 04:52:33,931][106225] Updated weights for policy 1, policy_version 1341303 (0.0005) [2023-12-28 04:52:34,305][106226] Updated weights for policy 0, policy_version 1337926 (0.0007) [2023-12-28 04:52:34,357][106226] Updated weights for policy 0, policy_version 1337936 (0.0008) [2023-12-28 04:52:34,418][106226] Updated weights for policy 0, policy_version 1337946 (0.0008) [2023-12-28 04:52:34,502][106225] Updated weights for policy 1, policy_version 1341313 (0.0008) [2023-12-28 04:52:34,559][106225] Updated weights for policy 1, policy_version 1341323 (0.0011) [2023-12-28 04:52:34,623][106225] Updated weights for policy 1, policy_version 1341333 (0.0009) [2023-12-28 04:52:35,202][106226] Updated weights for policy 0, policy_version 1337956 (0.0008) [2023-12-28 04:52:35,253][106226] Updated weights for policy 0, policy_version 1337966 (0.0008) [2023-12-28 04:52:35,300][106226] Updated weights for policy 0, policy_version 1337976 (0.0008) [2023-12-28 04:52:35,365][106225] Updated weights for policy 1, policy_version 1341343 (0.0010) [2023-12-28 04:52:35,427][106225] Updated weights for policy 1, policy_version 1341353 (0.0011) [2023-12-28 04:52:35,480][106225] Updated weights for policy 1, policy_version 1341363 (0.0010) [2023-12-28 04:52:36,083][106226] Updated weights for policy 0, policy_version 1337986 (0.0008) [2023-12-28 04:52:36,131][106225] Updated weights for policy 1, policy_version 1341373 (0.0010) [2023-12-28 04:52:36,152][106226] Updated weights for policy 0, policy_version 1337996 (0.0008) [2023-12-28 04:52:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19633.0). Total num frames: 686030848. Throughput: 0: 9785.4, 1: 9799.2. Samples: 686047252. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:36,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-4.518')] [2023-12-28 04:52:36,192][106225] Updated weights for policy 1, policy_version 1341383 (0.0008) [2023-12-28 04:52:36,216][106226] Updated weights for policy 0, policy_version 1338006 (0.0007) [2023-12-28 04:52:36,246][106225] Updated weights for policy 1, policy_version 1341393 (0.0007) [2023-12-28 04:52:36,271][106226] Updated weights for policy 0, policy_version 1338016 (0.0008) [2023-12-28 04:52:36,901][106225] Updated weights for policy 1, policy_version 1341403 (0.0007) [2023-12-28 04:52:36,964][106226] Updated weights for policy 0, policy_version 1338026 (0.0005) [2023-12-28 04:52:36,964][106225] Updated weights for policy 1, policy_version 1341413 (0.0009) [2023-12-28 04:52:37,022][106226] Updated weights for policy 0, policy_version 1338036 (0.0006) [2023-12-28 04:52:37,024][106225] Updated weights for policy 1, policy_version 1341423 (0.0008) [2023-12-28 04:52:37,082][106226] Updated weights for policy 0, policy_version 1338046 (0.0011) [2023-12-28 04:52:37,613][106226] Updated weights for policy 0, policy_version 1338056 (0.0007) [2023-12-28 04:52:37,663][106226] Updated weights for policy 0, policy_version 1338066 (0.0009) [2023-12-28 04:52:37,726][106226] Updated weights for policy 0, policy_version 1338076 (0.0011) [2023-12-28 04:52:37,847][106225] Updated weights for policy 1, policy_version 1341433 (0.0008) [2023-12-28 04:52:37,898][106225] Updated weights for policy 1, policy_version 1341443 (0.0008) [2023-12-28 04:52:37,961][106225] Updated weights for policy 1, policy_version 1341453 (0.0008) [2023-12-28 04:52:38,014][106225] Updated weights for policy 1, policy_version 1341463 (0.0008) [2023-12-28 04:52:38,369][106226] Updated weights for policy 0, policy_version 1338086 (0.0009) [2023-12-28 04:52:38,434][106226] Updated weights for policy 0, policy_version 1338096 (0.0009) [2023-12-28 04:52:38,491][106226] Updated weights for policy 0, policy_version 1338106 (0.0009) [2023-12-28 04:52:38,827][106225] Updated weights for policy 1, policy_version 1341473 (0.0010) [2023-12-28 04:52:38,885][106225] Updated weights for policy 1, policy_version 1341483 (0.0010) [2023-12-28 04:52:38,949][106225] Updated weights for policy 1, policy_version 1341493 (0.0007) [2023-12-28 04:52:39,235][106226] Updated weights for policy 0, policy_version 1338116 (0.0008) [2023-12-28 04:52:39,296][106226] Updated weights for policy 0, policy_version 1338126 (0.0009) [2023-12-28 04:52:39,365][106226] Updated weights for policy 0, policy_version 1338136 (0.0008) [2023-12-28 04:52:39,634][106225] Updated weights for policy 1, policy_version 1341503 (0.0006) [2023-12-28 04:52:39,694][106225] Updated weights for policy 1, policy_version 1341513 (0.0007) [2023-12-28 04:52:39,760][106225] Updated weights for policy 1, policy_version 1341523 (0.0009) [2023-12-28 04:52:40,149][106226] Updated weights for policy 0, policy_version 1338146 (0.0009) [2023-12-28 04:52:40,214][106226] Updated weights for policy 0, policy_version 1338156 (0.0007) [2023-12-28 04:52:40,277][106226] Updated weights for policy 0, policy_version 1338166 (0.0006) [2023-12-28 04:52:40,349][106226] Updated weights for policy 0, policy_version 1338176 (0.0007) [2023-12-28 04:52:40,434][106225] Updated weights for policy 1, policy_version 1341533 (0.0008) [2023-12-28 04:52:40,496][106225] Updated weights for policy 1, policy_version 1341543 (0.0006) [2023-12-28 04:52:40,563][106225] Updated weights for policy 1, policy_version 1341553 (0.0006) [2023-12-28 04:52:40,925][106226] Updated weights for policy 0, policy_version 1338186 (0.0008) [2023-12-28 04:52:40,983][106226] Updated weights for policy 0, policy_version 1338196 (0.0008) [2023-12-28 04:52:41,044][106226] Updated weights for policy 0, policy_version 1338206 (0.0009) [2023-12-28 04:52:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 686137344. Throughput: 0: 9823.8, 1: 9790.4. Samples: 686107064. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:41,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.491')] [2023-12-28 04:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001341560_343490560.pth... [2023-12-28 04:52:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001338208_342646784.pth... [2023-12-28 04:52:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001340440_343203840.pth [2023-12-28 04:52:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001337056_342351872.pth [2023-12-28 04:52:41,279][106225] Updated weights for policy 1, policy_version 1341563 (0.0010) [2023-12-28 04:52:41,345][106225] Updated weights for policy 1, policy_version 1341573 (0.0008) [2023-12-28 04:52:41,417][106225] Updated weights for policy 1, policy_version 1341583 (0.0008) [2023-12-28 04:52:41,785][106226] Updated weights for policy 0, policy_version 1338216 (0.0010) [2023-12-28 04:52:41,845][106226] Updated weights for policy 0, policy_version 1338226 (0.0009) [2023-12-28 04:52:41,899][106226] Updated weights for policy 0, policy_version 1338236 (0.0009) [2023-12-28 04:52:42,189][106225] Updated weights for policy 1, policy_version 1341593 (0.0009) [2023-12-28 04:52:42,253][106225] Updated weights for policy 1, policy_version 1341603 (0.0008) [2023-12-28 04:52:42,311][106225] Updated weights for policy 1, policy_version 1341613 (0.0010) [2023-12-28 04:52:42,382][106225] Updated weights for policy 1, policy_version 1341623 (0.0008) [2023-12-28 04:52:42,665][106226] Updated weights for policy 0, policy_version 1338246 (0.0009) [2023-12-28 04:52:42,718][106226] Updated weights for policy 0, policy_version 1338256 (0.0010) [2023-12-28 04:52:42,779][106226] Updated weights for policy 0, policy_version 1338266 (0.0011) [2023-12-28 04:52:43,074][106225] Updated weights for policy 1, policy_version 1341633 (0.0005) [2023-12-28 04:52:43,140][106225] Updated weights for policy 1, policy_version 1341643 (0.0005) [2023-12-28 04:52:43,200][106225] Updated weights for policy 1, policy_version 1341653 (0.0005) [2023-12-28 04:52:43,493][106226] Updated weights for policy 0, policy_version 1338276 (0.0010) [2023-12-28 04:52:43,549][106226] Updated weights for policy 0, policy_version 1338286 (0.0010) [2023-12-28 04:52:43,603][106226] Updated weights for policy 0, policy_version 1338296 (0.0010) [2023-12-28 04:52:43,795][106225] Updated weights for policy 1, policy_version 1341663 (0.0007) [2023-12-28 04:52:43,857][106225] Updated weights for policy 1, policy_version 1341673 (0.0009) [2023-12-28 04:52:43,919][106225] Updated weights for policy 1, policy_version 1341683 (0.0007) [2023-12-28 04:52:44,317][106226] Updated weights for policy 0, policy_version 1338306 (0.0008) [2023-12-28 04:52:44,372][106226] Updated weights for policy 0, policy_version 1338316 (0.0007) [2023-12-28 04:52:44,428][106226] Updated weights for policy 0, policy_version 1338326 (0.0008) [2023-12-28 04:52:44,487][106226] Updated weights for policy 0, policy_version 1338336 (0.0008) [2023-12-28 04:52:44,682][106225] Updated weights for policy 1, policy_version 1341693 (0.0007) [2023-12-28 04:52:44,748][106225] Updated weights for policy 1, policy_version 1341703 (0.0007) [2023-12-28 04:52:44,821][106225] Updated weights for policy 1, policy_version 1341714 (0.0022) [2023-12-28 04:52:45,227][106226] Updated weights for policy 0, policy_version 1338346 (0.0006) [2023-12-28 04:52:45,296][106226] Updated weights for policy 0, policy_version 1338356 (0.0008) [2023-12-28 04:52:45,363][106226] Updated weights for policy 0, policy_version 1338366 (0.0008) [2023-12-28 04:52:45,515][106225] Updated weights for policy 1, policy_version 1341724 (0.0007) [2023-12-28 04:52:45,582][106225] Updated weights for policy 1, policy_version 1341734 (0.0008) [2023-12-28 04:52:45,642][106225] Updated weights for policy 1, policy_version 1341744 (0.0007) [2023-12-28 04:52:45,976][106226] Updated weights for policy 0, policy_version 1338376 (0.0010) [2023-12-28 04:52:46,039][106226] Updated weights for policy 0, policy_version 1338386 (0.0011) [2023-12-28 04:52:46,095][106226] Updated weights for policy 0, policy_version 1338396 (0.0010) [2023-12-28 04:52:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 686235648. Throughput: 0: 9720.2, 1: 9765.0. Samples: 686223136. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:46,176][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.653')] [2023-12-28 04:52:46,304][106225] Updated weights for policy 1, policy_version 1341754 (0.0005) [2023-12-28 04:52:46,359][106225] Updated weights for policy 1, policy_version 1341764 (0.0007) [2023-12-28 04:52:46,418][106225] Updated weights for policy 1, policy_version 1341774 (0.0007) [2023-12-28 04:52:46,479][106225] Updated weights for policy 1, policy_version 1341784 (0.0010) [2023-12-28 04:52:46,716][106226] Updated weights for policy 0, policy_version 1338406 (0.0011) [2023-12-28 04:52:46,776][106226] Updated weights for policy 0, policy_version 1338416 (0.0011) [2023-12-28 04:52:46,828][106226] Updated weights for policy 0, policy_version 1338426 (0.0010) [2023-12-28 04:52:47,173][106225] Updated weights for policy 1, policy_version 1341794 (0.0010) [2023-12-28 04:52:47,235][106225] Updated weights for policy 1, policy_version 1341804 (0.0010) [2023-12-28 04:52:47,297][106225] Updated weights for policy 1, policy_version 1341814 (0.0006) [2023-12-28 04:52:47,488][106226] Updated weights for policy 0, policy_version 1338436 (0.0008) [2023-12-28 04:52:47,545][106226] Updated weights for policy 0, policy_version 1338446 (0.0005) [2023-12-28 04:52:47,603][106226] Updated weights for policy 0, policy_version 1338456 (0.0005) [2023-12-28 04:52:47,850][106225] Updated weights for policy 1, policy_version 1341824 (0.0005) [2023-12-28 04:52:47,912][106225] Updated weights for policy 1, policy_version 1341834 (0.0005) [2023-12-28 04:52:47,966][106225] Updated weights for policy 1, policy_version 1341844 (0.0005) [2023-12-28 04:52:48,151][106226] Updated weights for policy 0, policy_version 1338466 (0.0006) [2023-12-28 04:52:48,209][106226] Updated weights for policy 0, policy_version 1338476 (0.0011) [2023-12-28 04:52:48,269][106226] Updated weights for policy 0, policy_version 1338486 (0.0010) [2023-12-28 04:52:48,344][106226] Updated weights for policy 0, policy_version 1338496 (0.0007) [2023-12-28 04:52:48,642][106225] Updated weights for policy 1, policy_version 1341854 (0.0005) [2023-12-28 04:52:48,701][106225] Updated weights for policy 1, policy_version 1341864 (0.0005) [2023-12-28 04:52:48,764][106225] Updated weights for policy 1, policy_version 1341874 (0.0007) [2023-12-28 04:52:49,071][106226] Updated weights for policy 0, policy_version 1338506 (0.0010) [2023-12-28 04:52:49,133][106226] Updated weights for policy 0, policy_version 1338516 (0.0010) [2023-12-28 04:52:49,189][106226] Updated weights for policy 0, policy_version 1338526 (0.0010) [2023-12-28 04:52:49,401][106225] Updated weights for policy 1, policy_version 1341884 (0.0008) [2023-12-28 04:52:49,448][106225] Updated weights for policy 1, policy_version 1341894 (0.0008) [2023-12-28 04:52:49,509][106225] Updated weights for policy 1, policy_version 1341904 (0.0008) [2023-12-28 04:52:49,927][106226] Updated weights for policy 0, policy_version 1338536 (0.0010) [2023-12-28 04:52:49,982][106226] Updated weights for policy 0, policy_version 1338546 (0.0010) [2023-12-28 04:52:50,042][106226] Updated weights for policy 0, policy_version 1338556 (0.0008) [2023-12-28 04:52:50,283][106225] Updated weights for policy 1, policy_version 1341914 (0.0008) [2023-12-28 04:52:50,351][106225] Updated weights for policy 1, policy_version 1341924 (0.0006) [2023-12-28 04:52:50,410][106225] Updated weights for policy 1, policy_version 1341934 (0.0007) [2023-12-28 04:52:50,468][106225] Updated weights for policy 1, policy_version 1341944 (0.0008) [2023-12-28 04:52:50,705][106226] Updated weights for policy 0, policy_version 1338566 (0.0010) [2023-12-28 04:52:50,768][106226] Updated weights for policy 0, policy_version 1338576 (0.0011) [2023-12-28 04:52:50,831][106226] Updated weights for policy 0, policy_version 1338586 (0.0010) [2023-12-28 04:52:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 686333952. Throughput: 0: 9803.5, 1: 9812.3. Samples: 686345676. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:51,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.509')] [2023-12-28 04:52:51,223][106225] Updated weights for policy 1, policy_version 1341954 (0.0008) [2023-12-28 04:52:51,284][106225] Updated weights for policy 1, policy_version 1341964 (0.0008) [2023-12-28 04:52:51,340][106225] Updated weights for policy 1, policy_version 1341974 (0.0009) [2023-12-28 04:52:51,600][106226] Updated weights for policy 0, policy_version 1338596 (0.0008) [2023-12-28 04:52:51,669][106226] Updated weights for policy 0, policy_version 1338606 (0.0008) [2023-12-28 04:52:51,732][106226] Updated weights for policy 0, policy_version 1338616 (0.0008) [2023-12-28 04:52:52,156][106225] Updated weights for policy 1, policy_version 1341984 (0.0008) [2023-12-28 04:52:52,215][106225] Updated weights for policy 1, policy_version 1341994 (0.0008) [2023-12-28 04:52:52,284][106225] Updated weights for policy 1, policy_version 1342004 (0.0009) [2023-12-28 04:52:52,448][106226] Updated weights for policy 0, policy_version 1338626 (0.0006) [2023-12-28 04:52:52,511][106226] Updated weights for policy 0, policy_version 1338636 (0.0006) [2023-12-28 04:52:52,576][106226] Updated weights for policy 0, policy_version 1338646 (0.0006) [2023-12-28 04:52:52,640][106226] Updated weights for policy 0, policy_version 1338656 (0.0006) [2023-12-28 04:52:53,010][106225] Updated weights for policy 1, policy_version 1342014 (0.0007) [2023-12-28 04:52:53,059][106225] Updated weights for policy 1, policy_version 1342024 (0.0008) [2023-12-28 04:52:53,115][106225] Updated weights for policy 1, policy_version 1342034 (0.0008) [2023-12-28 04:52:53,234][106226] Updated weights for policy 0, policy_version 1338666 (0.0005) [2023-12-28 04:52:53,293][106226] Updated weights for policy 0, policy_version 1338676 (0.0005) [2023-12-28 04:52:53,355][106226] Updated weights for policy 0, policy_version 1338686 (0.0009) [2023-12-28 04:52:53,880][106226] Updated weights for policy 0, policy_version 1338696 (0.0008) [2023-12-28 04:52:53,910][106225] Updated weights for policy 1, policy_version 1342044 (0.0008) [2023-12-28 04:52:53,948][106226] Updated weights for policy 0, policy_version 1338706 (0.0006) [2023-12-28 04:52:53,962][106225] Updated weights for policy 1, policy_version 1342054 (0.0008) [2023-12-28 04:52:54,011][106226] Updated weights for policy 0, policy_version 1338716 (0.0005) [2023-12-28 04:52:54,014][106225] Updated weights for policy 1, policy_version 1342064 (0.0008) [2023-12-28 04:52:54,641][106226] Updated weights for policy 0, policy_version 1338726 (0.0006) [2023-12-28 04:52:54,703][106226] Updated weights for policy 0, policy_version 1338736 (0.0005) [2023-12-28 04:52:54,752][106225] Updated weights for policy 1, policy_version 1342074 (0.0008) [2023-12-28 04:52:54,761][106226] Updated weights for policy 0, policy_version 1338746 (0.0006) [2023-12-28 04:52:54,801][106225] Updated weights for policy 1, policy_version 1342084 (0.0010) [2023-12-28 04:52:54,848][106225] Updated weights for policy 1, policy_version 1342094 (0.0010) [2023-12-28 04:52:54,895][106225] Updated weights for policy 1, policy_version 1342104 (0.0010) [2023-12-28 04:52:55,431][106226] Updated weights for policy 0, policy_version 1338756 (0.0006) [2023-12-28 04:52:55,490][106226] Updated weights for policy 0, policy_version 1338766 (0.0005) [2023-12-28 04:52:55,545][106226] Updated weights for policy 0, policy_version 1338776 (0.0005) [2023-12-28 04:52:55,626][106225] Updated weights for policy 1, policy_version 1342114 (0.0005) [2023-12-28 04:52:55,683][106225] Updated weights for policy 1, policy_version 1342124 (0.0005) [2023-12-28 04:52:55,739][106225] Updated weights for policy 1, policy_version 1342134 (0.0008) [2023-12-28 04:52:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 686432256. Throughput: 0: 9821.2, 1: 9761.8. Samples: 686404704. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:52:56,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.634')] [2023-12-28 04:52:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001342136_343638016.pth... [2023-12-28 04:52:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001338784_342794240.pth... [2023-12-28 04:52:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001337632_342499328.pth [2023-12-28 04:52:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001340984_343343104.pth [2023-12-28 04:52:56,267][106226] Updated weights for policy 0, policy_version 1338786 (0.0008) [2023-12-28 04:52:56,327][106226] Updated weights for policy 0, policy_version 1338796 (0.0011) [2023-12-28 04:52:56,378][106226] Updated weights for policy 0, policy_version 1338806 (0.0011) [2023-12-28 04:52:56,380][106225] Updated weights for policy 1, policy_version 1342144 (0.0006) [2023-12-28 04:52:56,430][106225] Updated weights for policy 1, policy_version 1342154 (0.0006) [2023-12-28 04:52:56,438][106226] Updated weights for policy 0, policy_version 1338816 (0.0010) [2023-12-28 04:52:56,487][106225] Updated weights for policy 1, policy_version 1342164 (0.0005) [2023-12-28 04:52:57,037][106225] Updated weights for policy 1, policy_version 1342174 (0.0005) [2023-12-28 04:52:57,043][106226] Updated weights for policy 0, policy_version 1338826 (0.0009) [2023-12-28 04:52:57,092][106225] Updated weights for policy 1, policy_version 1342184 (0.0005) [2023-12-28 04:52:57,093][106226] Updated weights for policy 0, policy_version 1338836 (0.0010) [2023-12-28 04:52:57,143][106226] Updated weights for policy 0, policy_version 1338846 (0.0010) [2023-12-28 04:52:57,151][106225] Updated weights for policy 1, policy_version 1342194 (0.0005) [2023-12-28 04:52:57,695][106225] Updated weights for policy 1, policy_version 1342204 (0.0005) [2023-12-28 04:52:57,730][106226] Updated weights for policy 0, policy_version 1338856 (0.0011) [2023-12-28 04:52:57,752][106225] Updated weights for policy 1, policy_version 1342214 (0.0005) [2023-12-28 04:52:57,777][106226] Updated weights for policy 0, policy_version 1338866 (0.0010) [2023-12-28 04:52:57,802][106225] Updated weights for policy 1, policy_version 1342224 (0.0005) [2023-12-28 04:52:57,827][106226] Updated weights for policy 0, policy_version 1338876 (0.0010) [2023-12-28 04:52:58,405][106225] Updated weights for policy 1, policy_version 1342234 (0.0006) [2023-12-28 04:52:58,471][106225] Updated weights for policy 1, policy_version 1342244 (0.0008) [2023-12-28 04:52:58,521][106226] Updated weights for policy 0, policy_version 1338886 (0.0011) [2023-12-28 04:52:58,535][106225] Updated weights for policy 1, policy_version 1342254 (0.0008) [2023-12-28 04:52:58,593][106226] Updated weights for policy 0, policy_version 1338896 (0.0011) [2023-12-28 04:52:58,599][106225] Updated weights for policy 1, policy_version 1342264 (0.0010) [2023-12-28 04:52:58,661][106226] Updated weights for policy 0, policy_version 1338906 (0.0010) [2023-12-28 04:52:59,448][106225] Updated weights for policy 1, policy_version 1342274 (0.0008) [2023-12-28 04:52:59,484][106226] Updated weights for policy 0, policy_version 1338916 (0.0007) [2023-12-28 04:52:59,510][106225] Updated weights for policy 1, policy_version 1342284 (0.0008) [2023-12-28 04:52:59,545][106226] Updated weights for policy 0, policy_version 1338926 (0.0005) [2023-12-28 04:52:59,571][106225] Updated weights for policy 1, policy_version 1342294 (0.0008) [2023-12-28 04:52:59,601][106226] Updated weights for policy 0, policy_version 1338936 (0.0005) [2023-12-28 04:53:00,240][106226] Updated weights for policy 0, policy_version 1338946 (0.0006) [2023-12-28 04:53:00,304][106226] Updated weights for policy 0, policy_version 1338956 (0.0007) [2023-12-28 04:53:00,340][106225] Updated weights for policy 1, policy_version 1342304 (0.0010) [2023-12-28 04:53:00,358][106226] Updated weights for policy 0, policy_version 1338966 (0.0006) [2023-12-28 04:53:00,403][106225] Updated weights for policy 1, policy_version 1342314 (0.0010) [2023-12-28 04:53:00,413][106226] Updated weights for policy 0, policy_version 1338976 (0.0007) [2023-12-28 04:53:00,470][106225] Updated weights for policy 1, policy_version 1342324 (0.0010) [2023-12-28 04:53:01,141][106226] Updated weights for policy 0, policy_version 1338986 (0.0008) [2023-12-28 04:53:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 686530560. Throughput: 0: 9929.1, 1: 9882.8. Samples: 686527800. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:01,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.491')] [2023-12-28 04:53:01,200][106225] Updated weights for policy 1, policy_version 1342334 (0.0008) [2023-12-28 04:53:01,215][106226] Updated weights for policy 0, policy_version 1338996 (0.0009) [2023-12-28 04:53:01,268][106225] Updated weights for policy 1, policy_version 1342344 (0.0008) [2023-12-28 04:53:01,280][106226] Updated weights for policy 0, policy_version 1339006 (0.0008) [2023-12-28 04:53:01,332][106225] Updated weights for policy 1, policy_version 1342354 (0.0006) [2023-12-28 04:53:01,991][106226] Updated weights for policy 0, policy_version 1339016 (0.0007) [2023-12-28 04:53:02,016][106225] Updated weights for policy 1, policy_version 1342364 (0.0007) [2023-12-28 04:53:02,051][106226] Updated weights for policy 0, policy_version 1339026 (0.0005) [2023-12-28 04:53:02,071][106225] Updated weights for policy 1, policy_version 1342374 (0.0007) [2023-12-28 04:53:02,104][106226] Updated weights for policy 0, policy_version 1339036 (0.0006) [2023-12-28 04:53:02,124][106225] Updated weights for policy 1, policy_version 1342384 (0.0007) [2023-12-28 04:53:02,747][106226] Updated weights for policy 0, policy_version 1339046 (0.0008) [2023-12-28 04:53:02,808][106226] Updated weights for policy 0, policy_version 1339056 (0.0008) [2023-12-28 04:53:02,813][106225] Updated weights for policy 1, policy_version 1342394 (0.0006) [2023-12-28 04:53:02,866][106226] Updated weights for policy 0, policy_version 1339066 (0.0006) [2023-12-28 04:53:02,871][106225] Updated weights for policy 1, policy_version 1342404 (0.0006) [2023-12-28 04:53:02,926][106225] Updated weights for policy 1, policy_version 1342414 (0.0007) [2023-12-28 04:53:02,981][106225] Updated weights for policy 1, policy_version 1342424 (0.0006) [2023-12-28 04:53:03,611][106226] Updated weights for policy 0, policy_version 1339076 (0.0006) [2023-12-28 04:53:03,627][106225] Updated weights for policy 1, policy_version 1342434 (0.0007) [2023-12-28 04:53:03,676][106226] Updated weights for policy 0, policy_version 1339086 (0.0009) [2023-12-28 04:53:03,679][106225] Updated weights for policy 1, policy_version 1342444 (0.0005) [2023-12-28 04:53:03,731][106226] Updated weights for policy 0, policy_version 1339096 (0.0005) [2023-12-28 04:53:03,735][106225] Updated weights for policy 1, policy_version 1342454 (0.0005) [2023-12-28 04:53:04,404][106225] Updated weights for policy 1, policy_version 1342464 (0.0008) [2023-12-28 04:53:04,425][106226] Updated weights for policy 0, policy_version 1339106 (0.0006) [2023-12-28 04:53:04,461][106225] Updated weights for policy 1, policy_version 1342474 (0.0006) [2023-12-28 04:53:04,490][106226] Updated weights for policy 0, policy_version 1339116 (0.0009) [2023-12-28 04:53:04,523][106225] Updated weights for policy 1, policy_version 1342484 (0.0006) [2023-12-28 04:53:04,557][106226] Updated weights for policy 0, policy_version 1339126 (0.0009) [2023-12-28 04:53:04,617][106226] Updated weights for policy 0, policy_version 1339136 (0.0008) [2023-12-28 04:53:05,075][106225] Updated weights for policy 1, policy_version 1342494 (0.0005) [2023-12-28 04:53:05,142][106225] Updated weights for policy 1, policy_version 1342504 (0.0006) [2023-12-28 04:53:05,209][106225] Updated weights for policy 1, policy_version 1342514 (0.0005) [2023-12-28 04:53:05,409][106226] Updated weights for policy 0, policy_version 1339146 (0.0010) [2023-12-28 04:53:05,458][106226] Updated weights for policy 0, policy_version 1339156 (0.0008) [2023-12-28 04:53:05,512][106226] Updated weights for policy 0, policy_version 1339166 (0.0007) [2023-12-28 04:53:05,754][106225] Updated weights for policy 1, policy_version 1342524 (0.0006) [2023-12-28 04:53:05,806][106225] Updated weights for policy 1, policy_version 1342534 (0.0007) [2023-12-28 04:53:05,865][106225] Updated weights for policy 1, policy_version 1342544 (0.0005) [2023-12-28 04:53:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 686637056. Throughput: 0: 9926.1, 1: 9958.4. Samples: 686647876. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:06,176][105115] Avg episode reward: [(0, '-4.375'), (1, '-4.682')] [2023-12-28 04:53:06,316][106226] Updated weights for policy 0, policy_version 1339176 (0.0008) [2023-12-28 04:53:06,383][106226] Updated weights for policy 0, policy_version 1339186 (0.0009) [2023-12-28 04:53:06,443][106226] Updated weights for policy 0, policy_version 1339196 (0.0008) [2023-12-28 04:53:06,512][106225] Updated weights for policy 1, policy_version 1342554 (0.0006) [2023-12-28 04:53:06,582][106225] Updated weights for policy 1, policy_version 1342564 (0.0008) [2023-12-28 04:53:06,646][106225] Updated weights for policy 1, policy_version 1342574 (0.0008) [2023-12-28 04:53:06,709][106225] Updated weights for policy 1, policy_version 1342584 (0.0008) [2023-12-28 04:53:07,192][106226] Updated weights for policy 0, policy_version 1339206 (0.0008) [2023-12-28 04:53:07,256][106226] Updated weights for policy 0, policy_version 1339216 (0.0009) [2023-12-28 04:53:07,316][106226] Updated weights for policy 0, policy_version 1339226 (0.0009) [2023-12-28 04:53:07,370][106225] Updated weights for policy 1, policy_version 1342594 (0.0008) [2023-12-28 04:53:07,417][106225] Updated weights for policy 1, policy_version 1342604 (0.0009) [2023-12-28 04:53:07,476][106225] Updated weights for policy 1, policy_version 1342614 (0.0009) [2023-12-28 04:53:08,053][106226] Updated weights for policy 0, policy_version 1339236 (0.0008) [2023-12-28 04:53:08,109][106226] Updated weights for policy 0, policy_version 1339246 (0.0006) [2023-12-28 04:53:08,166][106226] Updated weights for policy 0, policy_version 1339256 (0.0005) [2023-12-28 04:53:08,181][106225] Updated weights for policy 1, policy_version 1342624 (0.0009) [2023-12-28 04:53:08,232][106225] Updated weights for policy 1, policy_version 1342634 (0.0010) [2023-12-28 04:53:08,290][106225] Updated weights for policy 1, policy_version 1342644 (0.0010) [2023-12-28 04:53:08,842][106226] Updated weights for policy 0, policy_version 1339266 (0.0006) [2023-12-28 04:53:08,896][106226] Updated weights for policy 0, policy_version 1339276 (0.0010) [2023-12-28 04:53:08,954][106226] Updated weights for policy 0, policy_version 1339286 (0.0007) [2023-12-28 04:53:09,009][106226] Updated weights for policy 0, policy_version 1339296 (0.0006) [2023-12-28 04:53:09,039][106225] Updated weights for policy 1, policy_version 1342654 (0.0010) [2023-12-28 04:53:09,102][106225] Updated weights for policy 1, policy_version 1342664 (0.0010) [2023-12-28 04:53:09,158][106225] Updated weights for policy 1, policy_version 1342674 (0.0010) [2023-12-28 04:53:09,753][106226] Updated weights for policy 0, policy_version 1339306 (0.0006) [2023-12-28 04:53:09,819][106226] Updated weights for policy 0, policy_version 1339316 (0.0008) [2023-12-28 04:53:09,885][106226] Updated weights for policy 0, policy_version 1339326 (0.0009) [2023-12-28 04:53:09,917][106225] Updated weights for policy 1, policy_version 1342684 (0.0010) [2023-12-28 04:53:09,973][106225] Updated weights for policy 1, policy_version 1342694 (0.0010) [2023-12-28 04:53:10,030][106225] Updated weights for policy 1, policy_version 1342704 (0.0010) [2023-12-28 04:53:10,566][106226] Updated weights for policy 0, policy_version 1339336 (0.0008) [2023-12-28 04:53:10,620][106226] Updated weights for policy 0, policy_version 1339346 (0.0007) [2023-12-28 04:53:10,677][106226] Updated weights for policy 0, policy_version 1339356 (0.0007) [2023-12-28 04:53:10,769][106225] Updated weights for policy 1, policy_version 1342714 (0.0009) [2023-12-28 04:53:10,833][106225] Updated weights for policy 1, policy_version 1342724 (0.0010) [2023-12-28 04:53:10,881][106225] Updated weights for policy 1, policy_version 1342734 (0.0010) [2023-12-28 04:53:10,936][106225] Updated weights for policy 1, policy_version 1342744 (0.0008) [2023-12-28 04:53:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 686735360. Throughput: 0: 9930.6, 1: 9982.0. Samples: 686706424. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:11,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.795')] [2023-12-28 04:53:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001342744_343793664.pth... [2023-12-28 04:53:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001339360_342941696.pth... [2023-12-28 04:53:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001341560_343490560.pth [2023-12-28 04:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001338208_342646784.pth [2023-12-28 04:53:11,391][106226] Updated weights for policy 0, policy_version 1339366 (0.0007) [2023-12-28 04:53:11,457][106226] Updated weights for policy 0, policy_version 1339376 (0.0009) [2023-12-28 04:53:11,517][106226] Updated weights for policy 0, policy_version 1339386 (0.0009) [2023-12-28 04:53:11,682][106225] Updated weights for policy 1, policy_version 1342754 (0.0009) [2023-12-28 04:53:11,750][106225] Updated weights for policy 1, policy_version 1342764 (0.0007) [2023-12-28 04:53:11,821][106225] Updated weights for policy 1, policy_version 1342774 (0.0007) [2023-12-28 04:53:12,333][106226] Updated weights for policy 0, policy_version 1339396 (0.0008) [2023-12-28 04:53:12,401][106226] Updated weights for policy 0, policy_version 1339406 (0.0008) [2023-12-28 04:53:12,462][106226] Updated weights for policy 0, policy_version 1339416 (0.0007) [2023-12-28 04:53:12,469][106225] Updated weights for policy 1, policy_version 1342784 (0.0006) [2023-12-28 04:53:12,528][106225] Updated weights for policy 1, policy_version 1342794 (0.0007) [2023-12-28 04:53:12,576][106225] Updated weights for policy 1, policy_version 1342804 (0.0008) [2023-12-28 04:53:13,188][106225] Updated weights for policy 1, policy_version 1342814 (0.0007) [2023-12-28 04:53:13,220][106226] Updated weights for policy 0, policy_version 1339426 (0.0009) [2023-12-28 04:53:13,243][106225] Updated weights for policy 1, policy_version 1342824 (0.0007) [2023-12-28 04:53:13,273][106226] Updated weights for policy 0, policy_version 1339436 (0.0009) [2023-12-28 04:53:13,305][106225] Updated weights for policy 1, policy_version 1342834 (0.0005) [2023-12-28 04:53:13,326][106226] Updated weights for policy 0, policy_version 1339446 (0.0008) [2023-12-28 04:53:13,380][106226] Updated weights for policy 0, policy_version 1339456 (0.0009) [2023-12-28 04:53:13,958][106225] Updated weights for policy 1, policy_version 1342844 (0.0007) [2023-12-28 04:53:14,009][106225] Updated weights for policy 1, policy_version 1342854 (0.0005) [2023-12-28 04:53:14,064][106225] Updated weights for policy 1, policy_version 1342864 (0.0006) [2023-12-28 04:53:14,169][106226] Updated weights for policy 0, policy_version 1339466 (0.0008) [2023-12-28 04:53:14,233][106226] Updated weights for policy 0, policy_version 1339476 (0.0009) [2023-12-28 04:53:14,300][106226] Updated weights for policy 0, policy_version 1339486 (0.0009) [2023-12-28 04:53:14,710][106225] Updated weights for policy 1, policy_version 1342874 (0.0008) [2023-12-28 04:53:14,784][106225] Updated weights for policy 1, policy_version 1342884 (0.0008) [2023-12-28 04:53:14,849][106225] Updated weights for policy 1, policy_version 1342894 (0.0007) [2023-12-28 04:53:14,900][106225] Updated weights for policy 1, policy_version 1342904 (0.0008) [2023-12-28 04:53:15,042][106226] Updated weights for policy 0, policy_version 1339496 (0.0009) [2023-12-28 04:53:15,108][106226] Updated weights for policy 0, policy_version 1339506 (0.0006) [2023-12-28 04:53:15,179][106226] Updated weights for policy 0, policy_version 1339516 (0.0006) [2023-12-28 04:53:15,676][106225] Updated weights for policy 1, policy_version 1342914 (0.0009) [2023-12-28 04:53:15,737][106225] Updated weights for policy 1, policy_version 1342924 (0.0010) [2023-12-28 04:53:15,808][106225] Updated weights for policy 1, policy_version 1342934 (0.0009) [2023-12-28 04:53:15,811][106226] Updated weights for policy 0, policy_version 1339526 (0.0007) [2023-12-28 04:53:15,866][106226] Updated weights for policy 0, policy_version 1339536 (0.0005) [2023-12-28 04:53:15,920][106226] Updated weights for policy 0, policy_version 1339546 (0.0005) [2023-12-28 04:53:16,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 686833664. Throughput: 0: 9843.1, 1: 10015.4. Samples: 686822604. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:16,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.385')] [2023-12-28 04:53:16,358][106225] Updated weights for policy 1, policy_version 1342944 (0.0009) [2023-12-28 04:53:16,412][106225] Updated weights for policy 1, policy_version 1342954 (0.0007) [2023-12-28 04:53:16,461][106225] Updated weights for policy 1, policy_version 1342964 (0.0005) [2023-12-28 04:53:16,535][106226] Updated weights for policy 0, policy_version 1339556 (0.0007) [2023-12-28 04:53:16,589][106226] Updated weights for policy 0, policy_version 1339566 (0.0010) [2023-12-28 04:53:16,636][106226] Updated weights for policy 0, policy_version 1339576 (0.0006) [2023-12-28 04:53:17,065][106225] Updated weights for policy 1, policy_version 1342974 (0.0006) [2023-12-28 04:53:17,124][106225] Updated weights for policy 1, policy_version 1342984 (0.0005) [2023-12-28 04:53:17,186][106225] Updated weights for policy 1, policy_version 1342994 (0.0005) [2023-12-28 04:53:17,273][106226] Updated weights for policy 0, policy_version 1339586 (0.0006) [2023-12-28 04:53:17,333][106226] Updated weights for policy 0, policy_version 1339596 (0.0007) [2023-12-28 04:53:17,393][106226] Updated weights for policy 0, policy_version 1339606 (0.0008) [2023-12-28 04:53:17,457][106226] Updated weights for policy 0, policy_version 1339616 (0.0008) [2023-12-28 04:53:17,834][106225] Updated weights for policy 1, policy_version 1343004 (0.0010) [2023-12-28 04:53:17,888][106225] Updated weights for policy 1, policy_version 1343014 (0.0010) [2023-12-28 04:53:17,937][106225] Updated weights for policy 1, policy_version 1343024 (0.0010) [2023-12-28 04:53:18,132][106226] Updated weights for policy 0, policy_version 1339626 (0.0008) [2023-12-28 04:53:18,178][106226] Updated weights for policy 0, policy_version 1339636 (0.0008) [2023-12-28 04:53:18,238][106226] Updated weights for policy 0, policy_version 1339646 (0.0007) [2023-12-28 04:53:18,657][106225] Updated weights for policy 1, policy_version 1343034 (0.0010) [2023-12-28 04:53:18,721][106225] Updated weights for policy 1, policy_version 1343044 (0.0010) [2023-12-28 04:53:18,781][106225] Updated weights for policy 1, policy_version 1343054 (0.0010) [2023-12-28 04:53:18,846][106225] Updated weights for policy 1, policy_version 1343064 (0.0009) [2023-12-28 04:53:18,991][106226] Updated weights for policy 0, policy_version 1339656 (0.0006) [2023-12-28 04:53:19,048][106226] Updated weights for policy 0, policy_version 1339666 (0.0006) [2023-12-28 04:53:19,103][106226] Updated weights for policy 0, policy_version 1339676 (0.0005) [2023-12-28 04:53:19,597][106225] Updated weights for policy 1, policy_version 1343074 (0.0010) [2023-12-28 04:53:19,664][106225] Updated weights for policy 1, policy_version 1343084 (0.0010) [2023-12-28 04:53:19,735][106225] Updated weights for policy 1, policy_version 1343094 (0.0011) [2023-12-28 04:53:19,771][106226] Updated weights for policy 0, policy_version 1339686 (0.0006) [2023-12-28 04:53:19,843][106226] Updated weights for policy 0, policy_version 1339696 (0.0007) [2023-12-28 04:53:19,916][106226] Updated weights for policy 0, policy_version 1339706 (0.0009) [2023-12-28 04:53:20,453][106225] Updated weights for policy 1, policy_version 1343104 (0.0007) [2023-12-28 04:53:20,513][106225] Updated weights for policy 1, policy_version 1343114 (0.0007) [2023-12-28 04:53:20,580][106226] Updated weights for policy 0, policy_version 1339716 (0.0008) [2023-12-28 04:53:20,581][106225] Updated weights for policy 1, policy_version 1343124 (0.0009) [2023-12-28 04:53:20,646][106226] Updated weights for policy 0, policy_version 1339726 (0.0007) [2023-12-28 04:53:20,717][106226] Updated weights for policy 0, policy_version 1339736 (0.0006) [2023-12-28 04:53:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 686931968. Throughput: 0: 9941.2, 1: 10009.5. Samples: 686945032. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:21,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.644')] [2023-12-28 04:53:21,297][106225] Updated weights for policy 1, policy_version 1343134 (0.0008) [2023-12-28 04:53:21,361][106226] Updated weights for policy 0, policy_version 1339746 (0.0007) [2023-12-28 04:53:21,367][106225] Updated weights for policy 1, policy_version 1343144 (0.0008) [2023-12-28 04:53:21,431][106225] Updated weights for policy 1, policy_version 1343154 (0.0006) [2023-12-28 04:53:21,431][106226] Updated weights for policy 0, policy_version 1339756 (0.0009) [2023-12-28 04:53:21,495][106226] Updated weights for policy 0, policy_version 1339766 (0.0009) [2023-12-28 04:53:21,560][106226] Updated weights for policy 0, policy_version 1339776 (0.0007) [2023-12-28 04:53:22,199][106225] Updated weights for policy 1, policy_version 1343164 (0.0008) [2023-12-28 04:53:22,262][106225] Updated weights for policy 1, policy_version 1343174 (0.0009) [2023-12-28 04:53:22,268][106226] Updated weights for policy 0, policy_version 1339786 (0.0008) [2023-12-28 04:53:22,327][106225] Updated weights for policy 1, policy_version 1343184 (0.0009) [2023-12-28 04:53:22,334][106226] Updated weights for policy 0, policy_version 1339796 (0.0011) [2023-12-28 04:53:22,403][106226] Updated weights for policy 0, policy_version 1339806 (0.0009) [2023-12-28 04:53:23,067][106225] Updated weights for policy 1, policy_version 1343194 (0.0008) [2023-12-28 04:53:23,104][106226] Updated weights for policy 0, policy_version 1339816 (0.0009) [2023-12-28 04:53:23,125][106225] Updated weights for policy 1, policy_version 1343204 (0.0008) [2023-12-28 04:53:23,155][106226] Updated weights for policy 0, policy_version 1339826 (0.0008) [2023-12-28 04:53:23,186][106225] Updated weights for policy 1, policy_version 1343214 (0.0009) [2023-12-28 04:53:23,217][106226] Updated weights for policy 0, policy_version 1339836 (0.0010) [2023-12-28 04:53:23,244][106225] Updated weights for policy 1, policy_version 1343224 (0.0010) [2023-12-28 04:53:23,870][106226] Updated weights for policy 0, policy_version 1339846 (0.0008) [2023-12-28 04:53:23,925][106226] Updated weights for policy 0, policy_version 1339856 (0.0007) [2023-12-28 04:53:23,954][106225] Updated weights for policy 1, policy_version 1343234 (0.0007) [2023-12-28 04:53:23,981][106226] Updated weights for policy 0, policy_version 1339866 (0.0006) [2023-12-28 04:53:24,010][106225] Updated weights for policy 1, policy_version 1343244 (0.0006) [2023-12-28 04:53:24,063][106225] Updated weights for policy 1, policy_version 1343254 (0.0008) [2023-12-28 04:53:24,645][106225] Updated weights for policy 1, policy_version 1343264 (0.0006) [2023-12-28 04:53:24,693][106225] Updated weights for policy 1, policy_version 1343274 (0.0005) [2023-12-28 04:53:24,751][106225] Updated weights for policy 1, policy_version 1343284 (0.0005) [2023-12-28 04:53:24,795][106226] Updated weights for policy 0, policy_version 1339876 (0.0009) [2023-12-28 04:53:24,853][106226] Updated weights for policy 0, policy_version 1339886 (0.0008) [2023-12-28 04:53:24,904][106226] Updated weights for policy 0, policy_version 1339896 (0.0009) [2023-12-28 04:53:25,280][106225] Updated weights for policy 1, policy_version 1343294 (0.0006) [2023-12-28 04:53:25,331][106225] Updated weights for policy 1, policy_version 1343304 (0.0005) [2023-12-28 04:53:25,374][106225] Updated weights for policy 1, policy_version 1343314 (0.0005) [2023-12-28 04:53:25,796][106226] Updated weights for policy 0, policy_version 1339906 (0.0008) [2023-12-28 04:53:25,846][106226] Updated weights for policy 0, policy_version 1339916 (0.0009) [2023-12-28 04:53:25,903][106226] Updated weights for policy 0, policy_version 1339926 (0.0009) [2023-12-28 04:53:25,927][106225] Updated weights for policy 1, policy_version 1343324 (0.0007) [2023-12-28 04:53:25,960][106226] Updated weights for policy 0, policy_version 1339936 (0.0008) [2023-12-28 04:53:25,987][106225] Updated weights for policy 1, policy_version 1343334 (0.0009) [2023-12-28 04:53:26,045][106225] Updated weights for policy 1, policy_version 1343344 (0.0008) [2023-12-28 04:53:26,175][105115] Fps is (10 sec: 20479.4, 60 sec: 20070.3, 300 sec: 19688.6). Total num frames: 687038464. Throughput: 0: 9890.0, 1: 9998.5. Samples: 687002048. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:26,176][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.585')] [2023-12-28 04:53:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001343352_343949312.pth... [2023-12-28 04:53:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001339936_343089152.pth... [2023-12-28 04:53:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001342136_343638016.pth [2023-12-28 04:53:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001338784_342794240.pth [2023-12-28 04:53:26,682][106226] Updated weights for policy 0, policy_version 1339946 (0.0009) [2023-12-28 04:53:26,688][106225] Updated weights for policy 1, policy_version 1343354 (0.0007) [2023-12-28 04:53:26,738][106226] Updated weights for policy 0, policy_version 1339956 (0.0008) [2023-12-28 04:53:26,753][106225] Updated weights for policy 1, policy_version 1343364 (0.0006) [2023-12-28 04:53:26,794][106226] Updated weights for policy 0, policy_version 1339966 (0.0008) [2023-12-28 04:53:26,816][106225] Updated weights for policy 1, policy_version 1343374 (0.0006) [2023-12-28 04:53:26,881][106225] Updated weights for policy 1, policy_version 1343384 (0.0005) [2023-12-28 04:53:27,380][106225] Updated weights for policy 1, policy_version 1343394 (0.0008) [2023-12-28 04:53:27,430][106225] Updated weights for policy 1, policy_version 1343404 (0.0005) [2023-12-28 04:53:27,479][106225] Updated weights for policy 1, policy_version 1343414 (0.0009) [2023-12-28 04:53:27,622][106226] Updated weights for policy 0, policy_version 1339976 (0.0008) [2023-12-28 04:53:27,677][106226] Updated weights for policy 0, policy_version 1339986 (0.0009) [2023-12-28 04:53:27,734][106226] Updated weights for policy 0, policy_version 1339996 (0.0009) [2023-12-28 04:53:28,054][106225] Updated weights for policy 1, policy_version 1343424 (0.0007) [2023-12-28 04:53:28,113][106225] Updated weights for policy 1, policy_version 1343434 (0.0006) [2023-12-28 04:53:28,157][106225] Updated weights for policy 1, policy_version 1343444 (0.0008) [2023-12-28 04:53:28,535][106226] Updated weights for policy 0, policy_version 1340006 (0.0010) [2023-12-28 04:53:28,595][106226] Updated weights for policy 0, policy_version 1340016 (0.0010) [2023-12-28 04:53:28,656][106226] Updated weights for policy 0, policy_version 1340026 (0.0011) [2023-12-28 04:53:28,875][106225] Updated weights for policy 1, policy_version 1343454 (0.0008) [2023-12-28 04:53:28,926][106225] Updated weights for policy 1, policy_version 1343464 (0.0008) [2023-12-28 04:53:28,981][106225] Updated weights for policy 1, policy_version 1343474 (0.0008) [2023-12-28 04:53:29,377][106226] Updated weights for policy 0, policy_version 1340036 (0.0011) [2023-12-28 04:53:29,427][106226] Updated weights for policy 0, policy_version 1340046 (0.0010) [2023-12-28 04:53:29,484][106226] Updated weights for policy 0, policy_version 1340056 (0.0010) [2023-12-28 04:53:29,747][106225] Updated weights for policy 1, policy_version 1343484 (0.0008) [2023-12-28 04:53:29,807][106225] Updated weights for policy 1, policy_version 1343494 (0.0008) [2023-12-28 04:53:29,869][106225] Updated weights for policy 1, policy_version 1343504 (0.0007) [2023-12-28 04:53:30,234][106226] Updated weights for policy 0, policy_version 1340066 (0.0010) [2023-12-28 04:53:30,291][106226] Updated weights for policy 0, policy_version 1340076 (0.0010) [2023-12-28 04:53:30,344][106226] Updated weights for policy 0, policy_version 1340086 (0.0010) [2023-12-28 04:53:30,397][106226] Updated weights for policy 0, policy_version 1340096 (0.0010) [2023-12-28 04:53:30,634][106225] Updated weights for policy 1, policy_version 1343514 (0.0008) [2023-12-28 04:53:30,687][106225] Updated weights for policy 1, policy_version 1343524 (0.0010) [2023-12-28 04:53:30,733][106225] Updated weights for policy 1, policy_version 1343534 (0.0010) [2023-12-28 04:53:30,775][106225] Updated weights for policy 1, policy_version 1343544 (0.0010) [2023-12-28 04:53:31,113][106226] Updated weights for policy 0, policy_version 1340106 (0.0008) [2023-12-28 04:53:31,173][106226] Updated weights for policy 0, policy_version 1340116 (0.0007) [2023-12-28 04:53:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 687128576. Throughput: 0: 9804.5, 1: 10183.9. Samples: 687122612. Policy #0 lag: (min: 26.0, avg: 32.3, max: 58.0) [2023-12-28 04:53:31,175][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.465')] [2023-12-28 04:53:31,235][106226] Updated weights for policy 0, policy_version 1340126 (0.0005) [2023-12-28 04:53:31,537][106225] Updated weights for policy 1, policy_version 1343554 (0.0008) [2023-12-28 04:53:31,597][106225] Updated weights for policy 1, policy_version 1343564 (0.0007) [2023-12-28 04:53:31,659][106225] Updated weights for policy 1, policy_version 1343574 (0.0011) [2023-12-28 04:53:31,922][106226] Updated weights for policy 0, policy_version 1340136 (0.0006) [2023-12-28 04:53:31,969][106226] Updated weights for policy 0, policy_version 1340146 (0.0008) [2023-12-28 04:53:32,036][106226] Updated weights for policy 0, policy_version 1340156 (0.0008) [2023-12-28 04:53:32,381][106225] Updated weights for policy 1, policy_version 1343584 (0.0010) [2023-12-28 04:53:32,447][106225] Updated weights for policy 1, policy_version 1343594 (0.0010) [2023-12-28 04:53:32,510][106225] Updated weights for policy 1, policy_version 1343604 (0.0010) [2023-12-28 04:53:32,729][106226] Updated weights for policy 0, policy_version 1340166 (0.0006) [2023-12-28 04:53:32,775][106226] Updated weights for policy 0, policy_version 1340176 (0.0005) [2023-12-28 04:53:32,840][106226] Updated weights for policy 0, policy_version 1340186 (0.0007) [2023-12-28 04:53:33,218][106225] Updated weights for policy 1, policy_version 1343614 (0.0010) [2023-12-28 04:53:33,283][106225] Updated weights for policy 1, policy_version 1343624 (0.0010) [2023-12-28 04:53:33,345][106225] Updated weights for policy 1, policy_version 1343634 (0.0010) [2023-12-28 04:53:33,556][106226] Updated weights for policy 0, policy_version 1340196 (0.0007) [2023-12-28 04:53:33,615][106226] Updated weights for policy 0, policy_version 1340206 (0.0007) [2023-12-28 04:53:33,680][106226] Updated weights for policy 0, policy_version 1340216 (0.0008) [2023-12-28 04:53:34,031][106225] Updated weights for policy 1, policy_version 1343644 (0.0009) [2023-12-28 04:53:34,084][106225] Updated weights for policy 1, policy_version 1343654 (0.0008) [2023-12-28 04:53:34,134][106225] Updated weights for policy 1, policy_version 1343664 (0.0009) [2023-12-28 04:53:34,346][106226] Updated weights for policy 0, policy_version 1340226 (0.0006) [2023-12-28 04:53:34,408][106226] Updated weights for policy 0, policy_version 1340236 (0.0008) [2023-12-28 04:53:34,463][106226] Updated weights for policy 0, policy_version 1340246 (0.0010) [2023-12-28 04:53:34,527][106226] Updated weights for policy 0, policy_version 1340256 (0.0011) [2023-12-28 04:53:34,915][106225] Updated weights for policy 1, policy_version 1343674 (0.0008) [2023-12-28 04:53:34,976][106225] Updated weights for policy 1, policy_version 1343684 (0.0006) [2023-12-28 04:53:35,026][106225] Updated weights for policy 1, policy_version 1343694 (0.0006) [2023-12-28 04:53:35,079][106225] Updated weights for policy 1, policy_version 1343704 (0.0008) [2023-12-28 04:53:35,207][106226] Updated weights for policy 0, policy_version 1340266 (0.0005) [2023-12-28 04:53:35,274][106226] Updated weights for policy 0, policy_version 1340276 (0.0006) [2023-12-28 04:53:35,331][106226] Updated weights for policy 0, policy_version 1340286 (0.0005) [2023-12-28 04:53:35,815][106225] Updated weights for policy 1, policy_version 1343714 (0.0009) [2023-12-28 04:53:35,880][106225] Updated weights for policy 1, policy_version 1343724 (0.0009) [2023-12-28 04:53:35,929][106226] Updated weights for policy 0, policy_version 1340296 (0.0005) [2023-12-28 04:53:35,940][106225] Updated weights for policy 1, policy_version 1343734 (0.0007) [2023-12-28 04:53:35,983][106226] Updated weights for policy 0, policy_version 1340306 (0.0006) [2023-12-28 04:53:36,046][106226] Updated weights for policy 0, policy_version 1340316 (0.0009) [2023-12-28 04:53:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 687235072. Throughput: 0: 9790.2, 1: 10098.4. Samples: 687240664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:53:36,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.688')] [2023-12-28 04:53:36,698][106225] Updated weights for policy 1, policy_version 1343744 (0.0006) [2023-12-28 04:53:36,761][106225] Updated weights for policy 1, policy_version 1343754 (0.0005) [2023-12-28 04:53:36,802][106226] Updated weights for policy 0, policy_version 1340326 (0.0010) [2023-12-28 04:53:36,819][106225] Updated weights for policy 1, policy_version 1343764 (0.0006) [2023-12-28 04:53:36,857][106226] Updated weights for policy 0, policy_version 1340336 (0.0007) [2023-12-28 04:53:36,910][106226] Updated weights for policy 0, policy_version 1340346 (0.0006) [2023-12-28 04:53:37,404][106225] Updated weights for policy 1, policy_version 1343774 (0.0008) [2023-12-28 04:53:37,465][106225] Updated weights for policy 1, policy_version 1343784 (0.0009) [2023-12-28 04:53:37,525][106225] Updated weights for policy 1, policy_version 1343794 (0.0008) [2023-12-28 04:53:37,620][106226] Updated weights for policy 0, policy_version 1340356 (0.0006) [2023-12-28 04:53:37,669][106226] Updated weights for policy 0, policy_version 1340366 (0.0009) [2023-12-28 04:53:37,719][106226] Updated weights for policy 0, policy_version 1340376 (0.0008) [2023-12-28 04:53:38,156][106225] Updated weights for policy 1, policy_version 1343804 (0.0008) [2023-12-28 04:53:38,217][106225] Updated weights for policy 1, policy_version 1343814 (0.0006) [2023-12-28 04:53:38,274][106225] Updated weights for policy 1, policy_version 1343824 (0.0010) [2023-12-28 04:53:38,486][106226] Updated weights for policy 0, policy_version 1340386 (0.0009) [2023-12-28 04:53:38,533][106226] Updated weights for policy 0, policy_version 1340396 (0.0008) [2023-12-28 04:53:38,583][106226] Updated weights for policy 0, policy_version 1340406 (0.0007) [2023-12-28 04:53:38,641][106226] Updated weights for policy 0, policy_version 1340416 (0.0008) [2023-12-28 04:53:39,031][106225] Updated weights for policy 1, policy_version 1343834 (0.0010) [2023-12-28 04:53:39,094][106225] Updated weights for policy 1, policy_version 1343844 (0.0008) [2023-12-28 04:53:39,151][106225] Updated weights for policy 1, policy_version 1343854 (0.0009) [2023-12-28 04:53:39,197][106225] Updated weights for policy 1, policy_version 1343864 (0.0009) [2023-12-28 04:53:39,378][106226] Updated weights for policy 0, policy_version 1340426 (0.0008) [2023-12-28 04:53:39,445][106226] Updated weights for policy 0, policy_version 1340436 (0.0008) [2023-12-28 04:53:39,508][106226] Updated weights for policy 0, policy_version 1340446 (0.0008) [2023-12-28 04:53:39,876][106225] Updated weights for policy 1, policy_version 1343874 (0.0008) [2023-12-28 04:53:39,950][106225] Updated weights for policy 1, policy_version 1343884 (0.0008) [2023-12-28 04:53:40,014][106225] Updated weights for policy 1, policy_version 1343894 (0.0010) [2023-12-28 04:53:40,319][106226] Updated weights for policy 0, policy_version 1340456 (0.0008) [2023-12-28 04:53:40,380][106226] Updated weights for policy 0, policy_version 1340466 (0.0009) [2023-12-28 04:53:40,445][106226] Updated weights for policy 0, policy_version 1340476 (0.0010) [2023-12-28 04:53:40,657][106225] Updated weights for policy 1, policy_version 1343904 (0.0009) [2023-12-28 04:53:40,709][106225] Updated weights for policy 1, policy_version 1343914 (0.0009) [2023-12-28 04:53:40,763][106225] Updated weights for policy 1, policy_version 1343924 (0.0006) [2023-12-28 04:53:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 687325184. Throughput: 0: 9714.4, 1: 10161.1. Samples: 687299100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:53:41,175][105115] Avg episode reward: [(0, '-4.794'), (1, '-4.763')] [2023-12-28 04:53:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001343928_344096768.pth... [2023-12-28 04:53:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001340480_343228416.pth... [2023-12-28 04:53:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001342744_343793664.pth [2023-12-28 04:53:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001343928_344096768.pth [2023-12-28 04:53:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001339360_342941696.pth [2023-12-28 04:53:41,189][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001340480_343228416.pth [2023-12-28 04:53:41,247][106226] Updated weights for policy 0, policy_version 1340486 (0.0008) [2023-12-28 04:53:41,309][106226] Updated weights for policy 0, policy_version 1340496 (0.0006) [2023-12-28 04:53:41,378][106226] Updated weights for policy 0, policy_version 1340506 (0.0008) [2023-12-28 04:53:41,498][106225] Updated weights for policy 1, policy_version 1343934 (0.0008) [2023-12-28 04:53:41,559][106225] Updated weights for policy 1, policy_version 1343944 (0.0007) [2023-12-28 04:53:41,638][106225] Updated weights for policy 1, policy_version 1343954 (0.0006) [2023-12-28 04:53:42,106][106226] Updated weights for policy 0, policy_version 1340516 (0.0007) [2023-12-28 04:53:42,165][106226] Updated weights for policy 0, policy_version 1340526 (0.0006) [2023-12-28 04:53:42,227][106226] Updated weights for policy 0, policy_version 1340536 (0.0009) [2023-12-28 04:53:42,306][106225] Updated weights for policy 1, policy_version 1343964 (0.0008) [2023-12-28 04:53:42,374][106225] Updated weights for policy 1, policy_version 1343974 (0.0007) [2023-12-28 04:53:42,433][106225] Updated weights for policy 1, policy_version 1343984 (0.0009) [2023-12-28 04:53:42,919][106226] Updated weights for policy 0, policy_version 1340546 (0.0008) [2023-12-28 04:53:42,984][106226] Updated weights for policy 0, policy_version 1340556 (0.0005) [2023-12-28 04:53:43,048][106226] Updated weights for policy 0, policy_version 1340566 (0.0007) [2023-12-28 04:53:43,105][106225] Updated weights for policy 1, policy_version 1343994 (0.0008) [2023-12-28 04:53:43,111][106226] Updated weights for policy 0, policy_version 1340576 (0.0007) [2023-12-28 04:53:43,167][106225] Updated weights for policy 1, policy_version 1344004 (0.0008) [2023-12-28 04:53:43,212][106225] Updated weights for policy 1, policy_version 1344014 (0.0009) [2023-12-28 04:53:43,271][106225] Updated weights for policy 1, policy_version 1344024 (0.0008) [2023-12-28 04:53:43,721][106226] Updated weights for policy 0, policy_version 1340586 (0.0006) [2023-12-28 04:53:43,782][106226] Updated weights for policy 0, policy_version 1340596 (0.0005) [2023-12-28 04:53:43,852][106226] Updated weights for policy 0, policy_version 1340606 (0.0005) [2023-12-28 04:53:43,944][106225] Updated weights for policy 1, policy_version 1344034 (0.0006) [2023-12-28 04:53:44,010][106225] Updated weights for policy 1, policy_version 1344044 (0.0006) [2023-12-28 04:53:44,078][106225] Updated weights for policy 1, policy_version 1344054 (0.0006) [2023-12-28 04:53:44,421][106226] Updated weights for policy 0, policy_version 1340616 (0.0008) [2023-12-28 04:53:44,484][106226] Updated weights for policy 0, policy_version 1340626 (0.0010) [2023-12-28 04:53:44,557][106226] Updated weights for policy 0, policy_version 1340636 (0.0010) [2023-12-28 04:53:44,646][106225] Updated weights for policy 1, policy_version 1344064 (0.0006) [2023-12-28 04:53:44,702][106225] Updated weights for policy 1, policy_version 1344074 (0.0010) [2023-12-28 04:53:44,772][106225] Updated weights for policy 1, policy_version 1344084 (0.0010) [2023-12-28 04:53:45,227][106226] Updated weights for policy 0, policy_version 1340646 (0.0010) [2023-12-28 04:53:45,298][106226] Updated weights for policy 0, policy_version 1340656 (0.0006) [2023-12-28 04:53:45,359][106226] Updated weights for policy 0, policy_version 1340666 (0.0010) [2023-12-28 04:53:45,405][106225] Updated weights for policy 1, policy_version 1344094 (0.0010) [2023-12-28 04:53:45,466][106225] Updated weights for policy 1, policy_version 1344104 (0.0007) [2023-12-28 04:53:45,535][106225] Updated weights for policy 1, policy_version 1344114 (0.0006) [2023-12-28 04:53:45,967][106226] Updated weights for policy 0, policy_version 1340676 (0.0007) [2023-12-28 04:53:46,021][106226] Updated weights for policy 0, policy_version 1340686 (0.0010) [2023-12-28 04:53:46,085][106226] Updated weights for policy 0, policy_version 1340696 (0.0010) [2023-12-28 04:53:46,153][106225] Updated weights for policy 1, policy_version 1344124 (0.0007) [2023-12-28 04:53:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 687431680. Throughput: 0: 9651.7, 1: 10129.5. Samples: 687417952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:53:46,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.469')] [2023-12-28 04:53:46,210][106225] Updated weights for policy 1, policy_version 1344134 (0.0005) [2023-12-28 04:53:46,261][106225] Updated weights for policy 1, policy_version 1344144 (0.0005) [2023-12-28 04:53:46,762][106226] Updated weights for policy 0, policy_version 1340706 (0.0010) [2023-12-28 04:53:46,818][106226] Updated weights for policy 0, policy_version 1340716 (0.0010) [2023-12-28 04:53:46,818][106225] Updated weights for policy 1, policy_version 1344154 (0.0005) [2023-12-28 04:53:46,869][106225] Updated weights for policy 1, policy_version 1344164 (0.0005) [2023-12-28 04:53:46,872][106226] Updated weights for policy 0, policy_version 1340726 (0.0010) [2023-12-28 04:53:46,926][106225] Updated weights for policy 1, policy_version 1344174 (0.0006) [2023-12-28 04:53:46,932][106226] Updated weights for policy 0, policy_version 1340736 (0.0011) [2023-12-28 04:53:46,987][106225] Updated weights for policy 1, policy_version 1344184 (0.0008) [2023-12-28 04:53:47,523][106226] Updated weights for policy 0, policy_version 1340746 (0.0005) [2023-12-28 04:53:47,573][106226] Updated weights for policy 0, policy_version 1340756 (0.0005) [2023-12-28 04:53:47,638][106226] Updated weights for policy 0, policy_version 1340766 (0.0006) [2023-12-28 04:53:47,658][106225] Updated weights for policy 1, policy_version 1344194 (0.0006) [2023-12-28 04:53:47,716][106225] Updated weights for policy 1, policy_version 1344204 (0.0005) [2023-12-28 04:53:47,774][106225] Updated weights for policy 1, policy_version 1344214 (0.0006) [2023-12-28 04:53:48,265][106226] Updated weights for policy 0, policy_version 1340776 (0.0010) [2023-12-28 04:53:48,298][106225] Updated weights for policy 1, policy_version 1344224 (0.0007) [2023-12-28 04:53:48,324][106226] Updated weights for policy 0, policy_version 1340786 (0.0010) [2023-12-28 04:53:48,362][106225] Updated weights for policy 1, policy_version 1344234 (0.0009) [2023-12-28 04:53:48,394][106226] Updated weights for policy 0, policy_version 1340796 (0.0008) [2023-12-28 04:53:48,423][106225] Updated weights for policy 1, policy_version 1344244 (0.0008) [2023-12-28 04:53:48,987][106226] Updated weights for policy 0, policy_version 1340806 (0.0010) [2023-12-28 04:53:49,038][106226] Updated weights for policy 0, policy_version 1340816 (0.0009) [2023-12-28 04:53:49,091][106226] Updated weights for policy 0, policy_version 1340826 (0.0009) [2023-12-28 04:53:49,107][106225] Updated weights for policy 1, policy_version 1344254 (0.0010) [2023-12-28 04:53:49,162][106225] Updated weights for policy 1, policy_version 1344264 (0.0007) [2023-12-28 04:53:49,211][106225] Updated weights for policy 1, policy_version 1344274 (0.0005) [2023-12-28 04:53:49,797][106226] Updated weights for policy 0, policy_version 1340836 (0.0009) [2023-12-28 04:53:49,829][106225] Updated weights for policy 1, policy_version 1344284 (0.0008) [2023-12-28 04:53:49,866][106226] Updated weights for policy 0, policy_version 1340846 (0.0008) [2023-12-28 04:53:49,888][106225] Updated weights for policy 1, policy_version 1344294 (0.0006) [2023-12-28 04:53:49,936][106226] Updated weights for policy 0, policy_version 1340856 (0.0008) [2023-12-28 04:53:49,962][106225] Updated weights for policy 1, policy_version 1344304 (0.0006) [2023-12-28 04:53:50,600][106225] Updated weights for policy 1, policy_version 1344314 (0.0007) [2023-12-28 04:53:50,602][106226] Updated weights for policy 0, policy_version 1340866 (0.0007) [2023-12-28 04:53:50,659][106226] Updated weights for policy 0, policy_version 1340876 (0.0008) [2023-12-28 04:53:50,660][106225] Updated weights for policy 1, policy_version 1344324 (0.0006) [2023-12-28 04:53:50,719][106226] Updated weights for policy 0, policy_version 1340886 (0.0008) [2023-12-28 04:53:50,724][106225] Updated weights for policy 1, policy_version 1344334 (0.0006) [2023-12-28 04:53:50,777][106226] Updated weights for policy 0, policy_version 1340896 (0.0006) [2023-12-28 04:53:50,791][106225] Updated weights for policy 1, policy_version 1344344 (0.0007) [2023-12-28 04:53:51,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 687538176. Throughput: 0: 9795.7, 1: 10192.4. Samples: 687547336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:53:51,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.660')] [2023-12-28 04:53:51,474][106226] Updated weights for policy 0, policy_version 1340906 (0.0007) [2023-12-28 04:53:51,487][106225] Updated weights for policy 1, policy_version 1344354 (0.0008) [2023-12-28 04:53:51,527][106226] Updated weights for policy 0, policy_version 1340916 (0.0006) [2023-12-28 04:53:51,539][106225] Updated weights for policy 1, policy_version 1344364 (0.0008) [2023-12-28 04:53:51,581][106226] Updated weights for policy 0, policy_version 1340926 (0.0008) [2023-12-28 04:53:51,592][106225] Updated weights for policy 1, policy_version 1344374 (0.0006) [2023-12-28 04:53:52,271][106225] Updated weights for policy 1, policy_version 1344384 (0.0007) [2023-12-28 04:53:52,327][106225] Updated weights for policy 1, policy_version 1344394 (0.0007) [2023-12-28 04:53:52,398][106225] Updated weights for policy 1, policy_version 1344404 (0.0007) [2023-12-28 04:53:52,436][106226] Updated weights for policy 0, policy_version 1340936 (0.0009) [2023-12-28 04:53:52,496][106226] Updated weights for policy 0, policy_version 1340946 (0.0009) [2023-12-28 04:53:52,560][106226] Updated weights for policy 0, policy_version 1340956 (0.0009) [2023-12-28 04:53:53,054][106225] Updated weights for policy 1, policy_version 1344414 (0.0008) [2023-12-28 04:53:53,110][106225] Updated weights for policy 1, policy_version 1344424 (0.0008) [2023-12-28 04:53:53,158][106225] Updated weights for policy 1, policy_version 1344434 (0.0008) [2023-12-28 04:53:53,315][106226] Updated weights for policy 0, policy_version 1340966 (0.0008) [2023-12-28 04:53:53,368][106226] Updated weights for policy 0, policy_version 1340976 (0.0008) [2023-12-28 04:53:53,416][106226] Updated weights for policy 0, policy_version 1340986 (0.0009) [2023-12-28 04:53:53,812][106225] Updated weights for policy 1, policy_version 1344444 (0.0008) [2023-12-28 04:53:53,862][106225] Updated weights for policy 1, policy_version 1344454 (0.0010) [2023-12-28 04:53:53,915][106225] Updated weights for policy 1, policy_version 1344464 (0.0010) [2023-12-28 04:53:54,202][106226] Updated weights for policy 0, policy_version 1340996 (0.0008) [2023-12-28 04:53:54,261][106226] Updated weights for policy 0, policy_version 1341006 (0.0006) [2023-12-28 04:53:54,316][106226] Updated weights for policy 0, policy_version 1341016 (0.0008) [2023-12-28 04:53:54,648][106225] Updated weights for policy 1, policy_version 1344474 (0.0010) [2023-12-28 04:53:54,699][106225] Updated weights for policy 1, policy_version 1344484 (0.0008) [2023-12-28 04:53:54,751][106225] Updated weights for policy 1, policy_version 1344494 (0.0008) [2023-12-28 04:53:54,799][106225] Updated weights for policy 1, policy_version 1344504 (0.0008) [2023-12-28 04:53:55,028][106226] Updated weights for policy 0, policy_version 1341026 (0.0008) [2023-12-28 04:53:55,079][106226] Updated weights for policy 0, policy_version 1341036 (0.0008) [2023-12-28 04:53:55,136][106226] Updated weights for policy 0, policy_version 1341046 (0.0008) [2023-12-28 04:53:55,192][106226] Updated weights for policy 0, policy_version 1341056 (0.0009) [2023-12-28 04:53:55,543][106225] Updated weights for policy 1, policy_version 1344514 (0.0009) [2023-12-28 04:53:55,598][106225] Updated weights for policy 1, policy_version 1344524 (0.0008) [2023-12-28 04:53:55,655][106225] Updated weights for policy 1, policy_version 1344534 (0.0009) [2023-12-28 04:53:55,951][106226] Updated weights for policy 0, policy_version 1341066 (0.0008) [2023-12-28 04:53:56,005][106226] Updated weights for policy 0, policy_version 1341076 (0.0008) [2023-12-28 04:53:56,064][106226] Updated weights for policy 0, policy_version 1341086 (0.0008) [2023-12-28 04:53:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 687636480. Throughput: 0: 9755.9, 1: 10215.5. Samples: 687605140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:53:56,176][105115] Avg episode reward: [(0, '-4.683'), (1, '-4.619')] [2023-12-28 04:53:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001341088_343384064.pth... [2023-12-28 04:53:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001344536_344252416.pth... [2023-12-28 04:53:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001343352_343949312.pth [2023-12-28 04:53:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001339936_343089152.pth [2023-12-28 04:53:56,395][106225] Updated weights for policy 1, policy_version 1344544 (0.0008) [2023-12-28 04:53:56,455][106225] Updated weights for policy 1, policy_version 1344554 (0.0008) [2023-12-28 04:53:56,502][106225] Updated weights for policy 1, policy_version 1344564 (0.0008) [2023-12-28 04:53:56,738][106226] Updated weights for policy 0, policy_version 1341096 (0.0007) [2023-12-28 04:53:56,794][106226] Updated weights for policy 0, policy_version 1341106 (0.0008) [2023-12-28 04:53:56,849][106226] Updated weights for policy 0, policy_version 1341116 (0.0008) [2023-12-28 04:53:57,209][106225] Updated weights for policy 1, policy_version 1344574 (0.0007) [2023-12-28 04:53:57,270][106225] Updated weights for policy 1, policy_version 1344584 (0.0007) [2023-12-28 04:53:57,336][106225] Updated weights for policy 1, policy_version 1344594 (0.0009) [2023-12-28 04:53:57,578][106226] Updated weights for policy 0, policy_version 1341126 (0.0007) [2023-12-28 04:53:57,638][106226] Updated weights for policy 0, policy_version 1341136 (0.0005) [2023-12-28 04:53:57,693][106226] Updated weights for policy 0, policy_version 1341146 (0.0005) [2023-12-28 04:53:58,010][106225] Updated weights for policy 1, policy_version 1344604 (0.0009) [2023-12-28 04:53:58,064][106225] Updated weights for policy 1, policy_version 1344614 (0.0010) [2023-12-28 04:53:58,128][106225] Updated weights for policy 1, policy_version 1344624 (0.0010) [2023-12-28 04:53:58,299][106226] Updated weights for policy 0, policy_version 1341156 (0.0005) [2023-12-28 04:53:58,379][106226] Updated weights for policy 0, policy_version 1341166 (0.0008) [2023-12-28 04:53:58,442][106226] Updated weights for policy 0, policy_version 1341176 (0.0008) [2023-12-28 04:53:58,895][106225] Updated weights for policy 1, policy_version 1344634 (0.0009) [2023-12-28 04:53:58,960][106225] Updated weights for policy 1, policy_version 1344644 (0.0007) [2023-12-28 04:53:59,023][106225] Updated weights for policy 1, policy_version 1344654 (0.0008) [2023-12-28 04:53:59,082][106225] Updated weights for policy 1, policy_version 1344664 (0.0007) [2023-12-28 04:53:59,284][106226] Updated weights for policy 0, policy_version 1341186 (0.0009) [2023-12-28 04:53:59,347][106226] Updated weights for policy 0, policy_version 1341196 (0.0009) [2023-12-28 04:53:59,416][106226] Updated weights for policy 0, policy_version 1341206 (0.0008) [2023-12-28 04:53:59,475][106226] Updated weights for policy 0, policy_version 1341216 (0.0008) [2023-12-28 04:53:59,770][106225] Updated weights for policy 1, policy_version 1344674 (0.0010) [2023-12-28 04:53:59,824][106225] Updated weights for policy 1, policy_version 1344684 (0.0010) [2023-12-28 04:53:59,888][106225] Updated weights for policy 1, policy_version 1344694 (0.0008) [2023-12-28 04:54:00,185][106226] Updated weights for policy 0, policy_version 1341226 (0.0008) [2023-12-28 04:54:00,247][106226] Updated weights for policy 0, policy_version 1341236 (0.0008) [2023-12-28 04:54:00,315][106226] Updated weights for policy 0, policy_version 1341246 (0.0008) [2023-12-28 04:54:00,639][106225] Updated weights for policy 1, policy_version 1344704 (0.0010) [2023-12-28 04:54:00,685][106225] Updated weights for policy 1, policy_version 1344714 (0.0010) [2023-12-28 04:54:00,731][106225] Updated weights for policy 1, policy_version 1344724 (0.0010) [2023-12-28 04:54:01,028][106226] Updated weights for policy 0, policy_version 1341256 (0.0008) [2023-12-28 04:54:01,097][106226] Updated weights for policy 0, policy_version 1341266 (0.0009) [2023-12-28 04:54:01,166][106226] Updated weights for policy 0, policy_version 1341276 (0.0007) [2023-12-28 04:54:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 687726592. Throughput: 0: 9799.3, 1: 10159.7. Samples: 687720764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:01,175][105115] Avg episode reward: [(0, '-4.683'), (1, '-4.638')] [2023-12-28 04:54:01,504][106225] Updated weights for policy 1, policy_version 1344734 (0.0010) [2023-12-28 04:54:01,558][106225] Updated weights for policy 1, policy_version 1344744 (0.0010) [2023-12-28 04:54:01,624][106225] Updated weights for policy 1, policy_version 1344754 (0.0008) [2023-12-28 04:54:01,895][106226] Updated weights for policy 0, policy_version 1341286 (0.0009) [2023-12-28 04:54:01,953][106226] Updated weights for policy 0, policy_version 1341296 (0.0006) [2023-12-28 04:54:02,016][106226] Updated weights for policy 0, policy_version 1341306 (0.0007) [2023-12-28 04:54:02,316][106225] Updated weights for policy 1, policy_version 1344764 (0.0010) [2023-12-28 04:54:02,379][106225] Updated weights for policy 1, policy_version 1344774 (0.0012) [2023-12-28 04:54:02,443][106225] Updated weights for policy 1, policy_version 1344784 (0.0009) [2023-12-28 04:54:02,630][106226] Updated weights for policy 0, policy_version 1341316 (0.0009) [2023-12-28 04:54:02,691][106226] Updated weights for policy 0, policy_version 1341326 (0.0010) [2023-12-28 04:54:02,749][106226] Updated weights for policy 0, policy_version 1341336 (0.0006) [2023-12-28 04:54:03,129][106225] Updated weights for policy 1, policy_version 1344794 (0.0007) [2023-12-28 04:54:03,183][106225] Updated weights for policy 1, policy_version 1344804 (0.0008) [2023-12-28 04:54:03,235][106225] Updated weights for policy 1, policy_version 1344814 (0.0005) [2023-12-28 04:54:03,288][106225] Updated weights for policy 1, policy_version 1344824 (0.0005) [2023-12-28 04:54:03,308][106226] Updated weights for policy 0, policy_version 1341346 (0.0008) [2023-12-28 04:54:03,355][106226] Updated weights for policy 0, policy_version 1341356 (0.0008) [2023-12-28 04:54:03,413][106226] Updated weights for policy 0, policy_version 1341366 (0.0007) [2023-12-28 04:54:03,463][106226] Updated weights for policy 0, policy_version 1341376 (0.0010) [2023-12-28 04:54:03,997][106225] Updated weights for policy 1, policy_version 1344834 (0.0007) [2023-12-28 04:54:04,066][106225] Updated weights for policy 1, policy_version 1344844 (0.0006) [2023-12-28 04:54:04,102][106226] Updated weights for policy 0, policy_version 1341386 (0.0011) [2023-12-28 04:54:04,128][106225] Updated weights for policy 1, policy_version 1344854 (0.0006) [2023-12-28 04:54:04,171][106226] Updated weights for policy 0, policy_version 1341396 (0.0011) [2023-12-28 04:54:04,234][106226] Updated weights for policy 0, policy_version 1341406 (0.0008) [2023-12-28 04:54:04,814][106225] Updated weights for policy 1, policy_version 1344864 (0.0007) [2023-12-28 04:54:04,867][106225] Updated weights for policy 1, policy_version 1344874 (0.0008) [2023-12-28 04:54:04,918][106226] Updated weights for policy 0, policy_version 1341416 (0.0009) [2023-12-28 04:54:04,924][106225] Updated weights for policy 1, policy_version 1344884 (0.0006) [2023-12-28 04:54:04,974][106226] Updated weights for policy 0, policy_version 1341426 (0.0010) [2023-12-28 04:54:05,037][106226] Updated weights for policy 0, policy_version 1341436 (0.0011) [2023-12-28 04:54:05,608][106225] Updated weights for policy 1, policy_version 1344894 (0.0007) [2023-12-28 04:54:05,653][106225] Updated weights for policy 1, policy_version 1344904 (0.0008) [2023-12-28 04:54:05,707][106225] Updated weights for policy 1, policy_version 1344914 (0.0007) [2023-12-28 04:54:05,707][106226] Updated weights for policy 0, policy_version 1341446 (0.0008) [2023-12-28 04:54:05,761][106226] Updated weights for policy 0, policy_version 1341456 (0.0007) [2023-12-28 04:54:05,811][106226] Updated weights for policy 0, policy_version 1341466 (0.0008) [2023-12-28 04:54:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 687833088. Throughput: 0: 9785.3, 1: 10131.2. Samples: 687841276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:06,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.603')] [2023-12-28 04:54:06,487][106225] Updated weights for policy 1, policy_version 1344924 (0.0008) [2023-12-28 04:54:06,533][106226] Updated weights for policy 0, policy_version 1341476 (0.0008) [2023-12-28 04:54:06,547][106225] Updated weights for policy 1, policy_version 1344934 (0.0007) [2023-12-28 04:54:06,596][106226] Updated weights for policy 0, policy_version 1341486 (0.0008) [2023-12-28 04:54:06,611][106225] Updated weights for policy 1, policy_version 1344944 (0.0006) [2023-12-28 04:54:06,665][106226] Updated weights for policy 0, policy_version 1341496 (0.0008) [2023-12-28 04:54:07,341][106226] Updated weights for policy 0, policy_version 1341506 (0.0009) [2023-12-28 04:54:07,381][106225] Updated weights for policy 1, policy_version 1344954 (0.0006) [2023-12-28 04:54:07,395][106226] Updated weights for policy 0, policy_version 1341516 (0.0008) [2023-12-28 04:54:07,438][106225] Updated weights for policy 1, policy_version 1344964 (0.0007) [2023-12-28 04:54:07,447][106226] Updated weights for policy 0, policy_version 1341526 (0.0008) [2023-12-28 04:54:07,486][106225] Updated weights for policy 1, policy_version 1344974 (0.0007) [2023-12-28 04:54:07,499][106226] Updated weights for policy 0, policy_version 1341536 (0.0008) [2023-12-28 04:54:07,542][106225] Updated weights for policy 1, policy_version 1344984 (0.0008) [2023-12-28 04:54:08,214][106226] Updated weights for policy 0, policy_version 1341546 (0.0008) [2023-12-28 04:54:08,272][106226] Updated weights for policy 0, policy_version 1341556 (0.0007) [2023-12-28 04:54:08,278][106225] Updated weights for policy 1, policy_version 1344994 (0.0007) [2023-12-28 04:54:08,334][106225] Updated weights for policy 1, policy_version 1345004 (0.0006) [2023-12-28 04:54:08,337][106226] Updated weights for policy 0, policy_version 1341566 (0.0008) [2023-12-28 04:54:08,400][106225] Updated weights for policy 1, policy_version 1345014 (0.0009) [2023-12-28 04:54:09,072][106226] Updated weights for policy 0, policy_version 1341576 (0.0008) [2023-12-28 04:54:09,139][106226] Updated weights for policy 0, policy_version 1341586 (0.0008) [2023-12-28 04:54:09,143][106225] Updated weights for policy 1, policy_version 1345024 (0.0006) [2023-12-28 04:54:09,198][106225] Updated weights for policy 1, policy_version 1345034 (0.0005) [2023-12-28 04:54:09,206][106226] Updated weights for policy 0, policy_version 1341596 (0.0009) [2023-12-28 04:54:09,263][106225] Updated weights for policy 1, policy_version 1345044 (0.0009) [2023-12-28 04:54:09,964][106226] Updated weights for policy 0, policy_version 1341606 (0.0009) [2023-12-28 04:54:10,028][106225] Updated weights for policy 1, policy_version 1345054 (0.0010) [2023-12-28 04:54:10,033][106226] Updated weights for policy 0, policy_version 1341616 (0.0007) [2023-12-28 04:54:10,087][106226] Updated weights for policy 0, policy_version 1341626 (0.0007) [2023-12-28 04:54:10,090][106225] Updated weights for policy 1, policy_version 1345064 (0.0010) [2023-12-28 04:54:10,152][106225] Updated weights for policy 1, policy_version 1345074 (0.0011) [2023-12-28 04:54:10,695][106226] Updated weights for policy 0, policy_version 1341636 (0.0007) [2023-12-28 04:54:10,749][106226] Updated weights for policy 0, policy_version 1341646 (0.0007) [2023-12-28 04:54:10,818][106226] Updated weights for policy 0, policy_version 1341656 (0.0007) [2023-12-28 04:54:10,860][106225] Updated weights for policy 1, policy_version 1345084 (0.0009) [2023-12-28 04:54:10,909][106225] Updated weights for policy 1, policy_version 1345094 (0.0010) [2023-12-28 04:54:10,961][106225] Updated weights for policy 1, policy_version 1345104 (0.0010) [2023-12-28 04:54:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 687931392. Throughput: 0: 9801.5, 1: 10128.0. Samples: 687898872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:11,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.592')] [2023-12-28 04:54:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001341664_343531520.pth... [2023-12-28 04:54:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001345112_344399872.pth... [2023-12-28 04:54:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001340480_343228416.pth [2023-12-28 04:54:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001343928_344096768.pth [2023-12-28 04:54:11,517][106226] Updated weights for policy 0, policy_version 1341666 (0.0007) [2023-12-28 04:54:11,576][106226] Updated weights for policy 0, policy_version 1341676 (0.0008) [2023-12-28 04:54:11,637][106226] Updated weights for policy 0, policy_version 1341686 (0.0009) [2023-12-28 04:54:11,702][106226] Updated weights for policy 0, policy_version 1341696 (0.0009) [2023-12-28 04:54:11,717][106225] Updated weights for policy 1, policy_version 1345114 (0.0010) [2023-12-28 04:54:11,791][106225] Updated weights for policy 1, policy_version 1345124 (0.0008) [2023-12-28 04:54:11,861][106225] Updated weights for policy 1, policy_version 1345134 (0.0006) [2023-12-28 04:54:11,929][106225] Updated weights for policy 1, policy_version 1345144 (0.0005) [2023-12-28 04:54:12,501][106225] Updated weights for policy 1, policy_version 1345154 (0.0007) [2023-12-28 04:54:12,553][106225] Updated weights for policy 1, policy_version 1345164 (0.0007) [2023-12-28 04:54:12,568][106226] Updated weights for policy 0, policy_version 1341706 (0.0007) [2023-12-28 04:54:12,607][106225] Updated weights for policy 1, policy_version 1345174 (0.0007) [2023-12-28 04:54:12,624][106226] Updated weights for policy 0, policy_version 1341716 (0.0007) [2023-12-28 04:54:12,685][106226] Updated weights for policy 0, policy_version 1341726 (0.0009) [2023-12-28 04:54:13,242][106225] Updated weights for policy 1, policy_version 1345184 (0.0007) [2023-12-28 04:54:13,303][106225] Updated weights for policy 1, policy_version 1345194 (0.0008) [2023-12-28 04:54:13,368][106225] Updated weights for policy 1, policy_version 1345204 (0.0007) [2023-12-28 04:54:13,404][106226] Updated weights for policy 0, policy_version 1341736 (0.0009) [2023-12-28 04:54:13,459][106226] Updated weights for policy 0, policy_version 1341746 (0.0009) [2023-12-28 04:54:13,514][106226] Updated weights for policy 0, policy_version 1341756 (0.0007) [2023-12-28 04:54:13,999][106225] Updated weights for policy 1, policy_version 1345214 (0.0007) [2023-12-28 04:54:14,055][106225] Updated weights for policy 1, policy_version 1345224 (0.0006) [2023-12-28 04:54:14,115][106225] Updated weights for policy 1, policy_version 1345234 (0.0005) [2023-12-28 04:54:14,213][106226] Updated weights for policy 0, policy_version 1341766 (0.0008) [2023-12-28 04:54:14,271][106226] Updated weights for policy 0, policy_version 1341776 (0.0009) [2023-12-28 04:54:14,319][106226] Updated weights for policy 0, policy_version 1341786 (0.0008) [2023-12-28 04:54:14,731][106225] Updated weights for policy 1, policy_version 1345244 (0.0007) [2023-12-28 04:54:14,793][106225] Updated weights for policy 1, policy_version 1345254 (0.0010) [2023-12-28 04:54:14,854][106225] Updated weights for policy 1, policy_version 1345265 (0.0010) [2023-12-28 04:54:15,084][106226] Updated weights for policy 0, policy_version 1341796 (0.0008) [2023-12-28 04:54:15,146][106226] Updated weights for policy 0, policy_version 1341806 (0.0008) [2023-12-28 04:54:15,196][106226] Updated weights for policy 0, policy_version 1341816 (0.0008) [2023-12-28 04:54:15,594][106225] Updated weights for policy 1, policy_version 1345275 (0.0010) [2023-12-28 04:54:15,647][106225] Updated weights for policy 1, policy_version 1345285 (0.0010) [2023-12-28 04:54:15,698][106225] Updated weights for policy 1, policy_version 1345295 (0.0009) [2023-12-28 04:54:15,944][106226] Updated weights for policy 0, policy_version 1341826 (0.0008) [2023-12-28 04:54:16,000][106226] Updated weights for policy 0, policy_version 1341836 (0.0007) [2023-12-28 04:54:16,053][106226] Updated weights for policy 0, policy_version 1341846 (0.0008) [2023-12-28 04:54:16,135][106226] Updated weights for policy 0, policy_version 1341856 (0.0008) [2023-12-28 04:54:16,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 688029696. Throughput: 0: 9860.7, 1: 10005.0. Samples: 688016568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:16,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.785')] [2023-12-28 04:54:16,415][106225] Updated weights for policy 1, policy_version 1345305 (0.0006) [2023-12-28 04:54:16,476][106225] Updated weights for policy 1, policy_version 1345315 (0.0008) [2023-12-28 04:54:16,530][106225] Updated weights for policy 1, policy_version 1345325 (0.0010) [2023-12-28 04:54:16,591][106225] Updated weights for policy 1, policy_version 1345335 (0.0009) [2023-12-28 04:54:16,810][106226] Updated weights for policy 0, policy_version 1341866 (0.0008) [2023-12-28 04:54:16,869][106226] Updated weights for policy 0, policy_version 1341876 (0.0005) [2023-12-28 04:54:16,923][106226] Updated weights for policy 0, policy_version 1341886 (0.0005) [2023-12-28 04:54:17,276][106225] Updated weights for policy 1, policy_version 1345345 (0.0010) [2023-12-28 04:54:17,326][106225] Updated weights for policy 1, policy_version 1345355 (0.0010) [2023-12-28 04:54:17,384][106225] Updated weights for policy 1, policy_version 1345365 (0.0010) [2023-12-28 04:54:17,545][106226] Updated weights for policy 0, policy_version 1341896 (0.0007) [2023-12-28 04:54:17,605][106226] Updated weights for policy 0, policy_version 1341906 (0.0009) [2023-12-28 04:54:17,663][106226] Updated weights for policy 0, policy_version 1341916 (0.0008) [2023-12-28 04:54:18,087][106225] Updated weights for policy 1, policy_version 1345375 (0.0010) [2023-12-28 04:54:18,153][106225] Updated weights for policy 1, policy_version 1345385 (0.0010) [2023-12-28 04:54:18,209][106225] Updated weights for policy 1, policy_version 1345395 (0.0010) [2023-12-28 04:54:18,344][106226] Updated weights for policy 0, policy_version 1341926 (0.0009) [2023-12-28 04:54:18,409][106226] Updated weights for policy 0, policy_version 1341936 (0.0008) [2023-12-28 04:54:18,473][106226] Updated weights for policy 0, policy_version 1341946 (0.0008) [2023-12-28 04:54:18,933][106225] Updated weights for policy 1, policy_version 1345405 (0.0010) [2023-12-28 04:54:18,989][106225] Updated weights for policy 1, policy_version 1345415 (0.0010) [2023-12-28 04:54:19,043][106225] Updated weights for policy 1, policy_version 1345425 (0.0010) [2023-12-28 04:54:19,191][106226] Updated weights for policy 0, policy_version 1341956 (0.0008) [2023-12-28 04:54:19,251][106226] Updated weights for policy 0, policy_version 1341966 (0.0008) [2023-12-28 04:54:19,302][106226] Updated weights for policy 0, policy_version 1341976 (0.0007) [2023-12-28 04:54:19,794][106225] Updated weights for policy 1, policy_version 1345435 (0.0010) [2023-12-28 04:54:19,859][106225] Updated weights for policy 1, policy_version 1345445 (0.0008) [2023-12-28 04:54:19,928][106225] Updated weights for policy 1, policy_version 1345455 (0.0010) [2023-12-28 04:54:20,079][106226] Updated weights for policy 0, policy_version 1341986 (0.0009) [2023-12-28 04:54:20,143][106226] Updated weights for policy 0, policy_version 1341996 (0.0010) [2023-12-28 04:54:20,210][106226] Updated weights for policy 0, policy_version 1342006 (0.0008) [2023-12-28 04:54:20,271][106226] Updated weights for policy 0, policy_version 1342016 (0.0009) [2023-12-28 04:54:20,610][106225] Updated weights for policy 1, policy_version 1345465 (0.0006) [2023-12-28 04:54:20,673][106225] Updated weights for policy 1, policy_version 1345475 (0.0006) [2023-12-28 04:54:20,740][106225] Updated weights for policy 1, policy_version 1345485 (0.0008) [2023-12-28 04:54:20,801][106225] Updated weights for policy 1, policy_version 1345495 (0.0008) [2023-12-28 04:54:21,080][106226] Updated weights for policy 0, policy_version 1342027 (0.0010) [2023-12-28 04:54:21,150][106226] Updated weights for policy 0, policy_version 1342037 (0.0009) [2023-12-28 04:54:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 688119808. Throughput: 0: 9792.3, 1: 10034.5. Samples: 688132868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:21,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.929')] [2023-12-28 04:54:21,220][106226] Updated weights for policy 0, policy_version 1342047 (0.0008) [2023-12-28 04:54:21,476][106225] Updated weights for policy 1, policy_version 1345505 (0.0008) [2023-12-28 04:54:21,535][106225] Updated weights for policy 1, policy_version 1345515 (0.0007) [2023-12-28 04:54:21,603][106225] Updated weights for policy 1, policy_version 1345525 (0.0008) [2023-12-28 04:54:21,957][106226] Updated weights for policy 0, policy_version 1342057 (0.0007) [2023-12-28 04:54:22,025][106226] Updated weights for policy 0, policy_version 1342067 (0.0007) [2023-12-28 04:54:22,088][106226] Updated weights for policy 0, policy_version 1342077 (0.0006) [2023-12-28 04:54:22,322][106225] Updated weights for policy 1, policy_version 1345535 (0.0006) [2023-12-28 04:54:22,392][106225] Updated weights for policy 1, policy_version 1345545 (0.0008) [2023-12-28 04:54:22,461][106225] Updated weights for policy 1, policy_version 1345555 (0.0006) [2023-12-28 04:54:22,778][106226] Updated weights for policy 0, policy_version 1342087 (0.0007) [2023-12-28 04:54:22,845][106226] Updated weights for policy 0, policy_version 1342097 (0.0006) [2023-12-28 04:54:22,903][106226] Updated weights for policy 0, policy_version 1342107 (0.0008) [2023-12-28 04:54:23,159][106225] Updated weights for policy 1, policy_version 1345565 (0.0007) [2023-12-28 04:54:23,217][106225] Updated weights for policy 1, policy_version 1345575 (0.0008) [2023-12-28 04:54:23,272][106225] Updated weights for policy 1, policy_version 1345585 (0.0008) [2023-12-28 04:54:23,554][106226] Updated weights for policy 0, policy_version 1342117 (0.0009) [2023-12-28 04:54:23,610][106226] Updated weights for policy 0, policy_version 1342127 (0.0008) [2023-12-28 04:54:23,662][106226] Updated weights for policy 0, policy_version 1342137 (0.0007) [2023-12-28 04:54:24,014][106225] Updated weights for policy 1, policy_version 1345595 (0.0008) [2023-12-28 04:54:24,100][106225] Updated weights for policy 1, policy_version 1345605 (0.0009) [2023-12-28 04:54:24,160][106225] Updated weights for policy 1, policy_version 1345615 (0.0009) [2023-12-28 04:54:24,359][106226] Updated weights for policy 0, policy_version 1342147 (0.0010) [2023-12-28 04:54:24,428][106226] Updated weights for policy 0, policy_version 1342157 (0.0010) [2023-12-28 04:54:24,482][106226] Updated weights for policy 0, policy_version 1342167 (0.0010) [2023-12-28 04:54:24,895][106225] Updated weights for policy 1, policy_version 1345625 (0.0008) [2023-12-28 04:54:24,945][106225] Updated weights for policy 1, policy_version 1345635 (0.0009) [2023-12-28 04:54:24,995][106225] Updated weights for policy 1, policy_version 1345645 (0.0009) [2023-12-28 04:54:25,053][106225] Updated weights for policy 1, policy_version 1345655 (0.0008) [2023-12-28 04:54:25,111][106226] Updated weights for policy 0, policy_version 1342177 (0.0010) [2023-12-28 04:54:25,166][106226] Updated weights for policy 0, policy_version 1342187 (0.0006) [2023-12-28 04:54:25,212][106226] Updated weights for policy 0, policy_version 1342197 (0.0006) [2023-12-28 04:54:25,258][106226] Updated weights for policy 0, policy_version 1342207 (0.0008) [2023-12-28 04:54:25,786][106225] Updated weights for policy 1, policy_version 1345665 (0.0009) [2023-12-28 04:54:25,841][106225] Updated weights for policy 1, policy_version 1345675 (0.0005) [2023-12-28 04:54:25,892][106225] Updated weights for policy 1, policy_version 1345685 (0.0006) [2023-12-28 04:54:25,926][106226] Updated weights for policy 0, policy_version 1342217 (0.0007) [2023-12-28 04:54:25,981][106226] Updated weights for policy 0, policy_version 1342227 (0.0006) [2023-12-28 04:54:26,036][106226] Updated weights for policy 0, policy_version 1342237 (0.0005) [2023-12-28 04:54:26,175][105115] Fps is (10 sec: 19659.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 688226304. Throughput: 0: 9813.1, 1: 10007.4. Samples: 688191028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:26,176][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.549')] [2023-12-28 04:54:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001345688_344547328.pth... [2023-12-28 04:54:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001342240_343678976.pth... [2023-12-28 04:54:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001341088_343384064.pth [2023-12-28 04:54:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001344536_344252416.pth [2023-12-28 04:54:26,527][106225] Updated weights for policy 1, policy_version 1345695 (0.0006) [2023-12-28 04:54:26,588][106225] Updated weights for policy 1, policy_version 1345705 (0.0008) [2023-12-28 04:54:26,646][106225] Updated weights for policy 1, policy_version 1345715 (0.0008) [2023-12-28 04:54:26,683][106226] Updated weights for policy 0, policy_version 1342247 (0.0006) [2023-12-28 04:54:26,739][106226] Updated weights for policy 0, policy_version 1342257 (0.0008) [2023-12-28 04:54:26,796][106226] Updated weights for policy 0, policy_version 1342267 (0.0008) [2023-12-28 04:54:27,345][106225] Updated weights for policy 1, policy_version 1345725 (0.0008) [2023-12-28 04:54:27,397][106225] Updated weights for policy 1, policy_version 1345735 (0.0008) [2023-12-28 04:54:27,440][106225] Updated weights for policy 1, policy_version 1345745 (0.0008) [2023-12-28 04:54:27,496][106226] Updated weights for policy 0, policy_version 1342277 (0.0006) [2023-12-28 04:54:27,547][106226] Updated weights for policy 0, policy_version 1342287 (0.0008) [2023-12-28 04:54:27,595][106226] Updated weights for policy 0, policy_version 1342297 (0.0008) [2023-12-28 04:54:28,067][106225] Updated weights for policy 1, policy_version 1345755 (0.0009) [2023-12-28 04:54:28,135][106225] Updated weights for policy 1, policy_version 1345765 (0.0006) [2023-12-28 04:54:28,195][106225] Updated weights for policy 1, policy_version 1345775 (0.0007) [2023-12-28 04:54:28,236][106226] Updated weights for policy 0, policy_version 1342307 (0.0008) [2023-12-28 04:54:28,294][106226] Updated weights for policy 0, policy_version 1342317 (0.0009) [2023-12-28 04:54:28,358][106226] Updated weights for policy 0, policy_version 1342327 (0.0010) [2023-12-28 04:54:28,874][106225] Updated weights for policy 1, policy_version 1345785 (0.0007) [2023-12-28 04:54:28,926][106225] Updated weights for policy 1, policy_version 1345795 (0.0008) [2023-12-28 04:54:28,975][106225] Updated weights for policy 1, policy_version 1345805 (0.0008) [2023-12-28 04:54:29,019][106225] Updated weights for policy 1, policy_version 1345815 (0.0007) [2023-12-28 04:54:29,094][106226] Updated weights for policy 0, policy_version 1342337 (0.0009) [2023-12-28 04:54:29,146][106226] Updated weights for policy 0, policy_version 1342347 (0.0006) [2023-12-28 04:54:29,211][106226] Updated weights for policy 0, policy_version 1342357 (0.0006) [2023-12-28 04:54:29,295][106226] Updated weights for policy 0, policy_version 1342367 (0.0008) [2023-12-28 04:54:29,836][106225] Updated weights for policy 1, policy_version 1345825 (0.0008) [2023-12-28 04:54:29,893][106225] Updated weights for policy 1, policy_version 1345835 (0.0007) [2023-12-28 04:54:29,960][106225] Updated weights for policy 1, policy_version 1345845 (0.0007) [2023-12-28 04:54:29,970][106226] Updated weights for policy 0, policy_version 1342377 (0.0009) [2023-12-28 04:54:30,034][106226] Updated weights for policy 0, policy_version 1342387 (0.0009) [2023-12-28 04:54:30,092][106226] Updated weights for policy 0, policy_version 1342397 (0.0009) [2023-12-28 04:54:30,722][106226] Updated weights for policy 0, policy_version 1342407 (0.0007) [2023-12-28 04:54:30,744][106225] Updated weights for policy 1, policy_version 1345855 (0.0009) [2023-12-28 04:54:30,771][106226] Updated weights for policy 0, policy_version 1342417 (0.0005) [2023-12-28 04:54:30,793][106225] Updated weights for policy 1, policy_version 1345865 (0.0008) [2023-12-28 04:54:30,823][106226] Updated weights for policy 0, policy_version 1342427 (0.0006) [2023-12-28 04:54:30,851][106225] Updated weights for policy 1, policy_version 1345875 (0.0008) [2023-12-28 04:54:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 688324608. Throughput: 0: 9883.9, 1: 9986.3. Samples: 688312112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:31,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.798')] [2023-12-28 04:54:31,556][106226] Updated weights for policy 0, policy_version 1342437 (0.0008) [2023-12-28 04:54:31,599][106225] Updated weights for policy 1, policy_version 1345885 (0.0009) [2023-12-28 04:54:31,616][106226] Updated weights for policy 0, policy_version 1342447 (0.0011) [2023-12-28 04:54:31,666][106225] Updated weights for policy 1, policy_version 1345895 (0.0009) [2023-12-28 04:54:31,680][106226] Updated weights for policy 0, policy_version 1342457 (0.0008) [2023-12-28 04:54:31,740][106225] Updated weights for policy 1, policy_version 1345905 (0.0007) [2023-12-28 04:54:32,275][106226] Updated weights for policy 0, policy_version 1342467 (0.0008) [2023-12-28 04:54:32,332][106226] Updated weights for policy 0, policy_version 1342477 (0.0008) [2023-12-28 04:54:32,395][106225] Updated weights for policy 1, policy_version 1345915 (0.0009) [2023-12-28 04:54:32,398][106226] Updated weights for policy 0, policy_version 1342487 (0.0009) [2023-12-28 04:54:32,457][106225] Updated weights for policy 1, policy_version 1345925 (0.0008) [2023-12-28 04:54:32,513][106225] Updated weights for policy 1, policy_version 1345935 (0.0007) [2023-12-28 04:54:32,973][106226] Updated weights for policy 0, policy_version 1342497 (0.0007) [2023-12-28 04:54:33,022][106226] Updated weights for policy 0, policy_version 1342507 (0.0005) [2023-12-28 04:54:33,067][106226] Updated weights for policy 0, policy_version 1342517 (0.0009) [2023-12-28 04:54:33,123][106226] Updated weights for policy 0, policy_version 1342527 (0.0010) [2023-12-28 04:54:33,254][106225] Updated weights for policy 1, policy_version 1345945 (0.0008) [2023-12-28 04:54:33,319][106225] Updated weights for policy 1, policy_version 1345955 (0.0009) [2023-12-28 04:54:33,381][106225] Updated weights for policy 1, policy_version 1345965 (0.0009) [2023-12-28 04:54:33,443][106225] Updated weights for policy 1, policy_version 1345975 (0.0009) [2023-12-28 04:54:33,749][106226] Updated weights for policy 0, policy_version 1342537 (0.0011) [2023-12-28 04:54:33,806][106226] Updated weights for policy 0, policy_version 1342547 (0.0010) [2023-12-28 04:54:33,874][106226] Updated weights for policy 0, policy_version 1342557 (0.0010) [2023-12-28 04:54:34,196][106225] Updated weights for policy 1, policy_version 1345985 (0.0008) [2023-12-28 04:54:34,255][106225] Updated weights for policy 1, policy_version 1345995 (0.0008) [2023-12-28 04:54:34,321][106225] Updated weights for policy 1, policy_version 1346005 (0.0008) [2023-12-28 04:54:34,585][106226] Updated weights for policy 0, policy_version 1342567 (0.0011) [2023-12-28 04:54:34,649][106226] Updated weights for policy 0, policy_version 1342577 (0.0011) [2023-12-28 04:54:34,710][106226] Updated weights for policy 0, policy_version 1342587 (0.0010) [2023-12-28 04:54:35,044][106225] Updated weights for policy 1, policy_version 1346015 (0.0008) [2023-12-28 04:54:35,105][106225] Updated weights for policy 1, policy_version 1346025 (0.0007) [2023-12-28 04:54:35,168][106225] Updated weights for policy 1, policy_version 1346035 (0.0008) [2023-12-28 04:54:35,419][106226] Updated weights for policy 0, policy_version 1342597 (0.0011) [2023-12-28 04:54:35,479][106226] Updated weights for policy 0, policy_version 1342607 (0.0011) [2023-12-28 04:54:35,535][106226] Updated weights for policy 0, policy_version 1342617 (0.0010) [2023-12-28 04:54:35,882][106225] Updated weights for policy 1, policy_version 1346045 (0.0008) [2023-12-28 04:54:35,943][106225] Updated weights for policy 1, policy_version 1346055 (0.0008) [2023-12-28 04:54:36,004][106225] Updated weights for policy 1, policy_version 1346065 (0.0008) [2023-12-28 04:54:36,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 688422912. Throughput: 0: 9850.9, 1: 9789.5. Samples: 688431148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:36,175][105115] Avg episode reward: [(0, '-4.162'), (1, '-4.752')] [2023-12-28 04:54:36,257][106226] Updated weights for policy 0, policy_version 1342627 (0.0011) [2023-12-28 04:54:36,318][106226] Updated weights for policy 0, policy_version 1342637 (0.0006) [2023-12-28 04:54:36,373][106226] Updated weights for policy 0, policy_version 1342647 (0.0010) [2023-12-28 04:54:36,723][106225] Updated weights for policy 1, policy_version 1346075 (0.0007) [2023-12-28 04:54:36,774][106225] Updated weights for policy 1, policy_version 1346085 (0.0008) [2023-12-28 04:54:36,828][106225] Updated weights for policy 1, policy_version 1346095 (0.0008) [2023-12-28 04:54:37,124][106226] Updated weights for policy 0, policy_version 1342657 (0.0011) [2023-12-28 04:54:37,188][106226] Updated weights for policy 0, policy_version 1342667 (0.0007) [2023-12-28 04:54:37,253][106226] Updated weights for policy 0, policy_version 1342677 (0.0011) [2023-12-28 04:54:37,315][106226] Updated weights for policy 0, policy_version 1342687 (0.0011) [2023-12-28 04:54:37,522][106225] Updated weights for policy 1, policy_version 1346105 (0.0008) [2023-12-28 04:54:37,583][106225] Updated weights for policy 1, policy_version 1346115 (0.0006) [2023-12-28 04:54:37,656][106225] Updated weights for policy 1, policy_version 1346125 (0.0007) [2023-12-28 04:54:37,726][106225] Updated weights for policy 1, policy_version 1346135 (0.0008) [2023-12-28 04:54:37,941][106226] Updated weights for policy 0, policy_version 1342697 (0.0006) [2023-12-28 04:54:38,008][106226] Updated weights for policy 0, policy_version 1342707 (0.0006) [2023-12-28 04:54:38,061][106226] Updated weights for policy 0, policy_version 1342717 (0.0005) [2023-12-28 04:54:38,366][106225] Updated weights for policy 1, policy_version 1346145 (0.0010) [2023-12-28 04:54:38,434][106225] Updated weights for policy 1, policy_version 1346155 (0.0011) [2023-12-28 04:54:38,490][106225] Updated weights for policy 1, policy_version 1346165 (0.0010) [2023-12-28 04:54:38,690][106226] Updated weights for policy 0, policy_version 1342727 (0.0009) [2023-12-28 04:54:38,744][106226] Updated weights for policy 0, policy_version 1342737 (0.0011) [2023-12-28 04:54:38,806][106226] Updated weights for policy 0, policy_version 1342747 (0.0011) [2023-12-28 04:54:39,081][106225] Updated weights for policy 1, policy_version 1346175 (0.0010) [2023-12-28 04:54:39,135][106225] Updated weights for policy 1, policy_version 1346185 (0.0010) [2023-12-28 04:54:39,191][106225] Updated weights for policy 1, policy_version 1346195 (0.0010) [2023-12-28 04:54:39,587][106226] Updated weights for policy 0, policy_version 1342757 (0.0009) [2023-12-28 04:54:39,645][106226] Updated weights for policy 0, policy_version 1342767 (0.0007) [2023-12-28 04:54:39,709][106226] Updated weights for policy 0, policy_version 1342777 (0.0006) [2023-12-28 04:54:39,979][106225] Updated weights for policy 1, policy_version 1346205 (0.0010) [2023-12-28 04:54:40,046][106225] Updated weights for policy 1, policy_version 1346215 (0.0008) [2023-12-28 04:54:40,113][106225] Updated weights for policy 1, policy_version 1346225 (0.0011) [2023-12-28 04:54:40,488][106226] Updated weights for policy 0, policy_version 1342787 (0.0008) [2023-12-28 04:54:40,545][106226] Updated weights for policy 0, policy_version 1342797 (0.0008) [2023-12-28 04:54:40,602][106226] Updated weights for policy 0, policy_version 1342807 (0.0008) [2023-12-28 04:54:40,839][106225] Updated weights for policy 1, policy_version 1346235 (0.0010) [2023-12-28 04:54:40,886][106225] Updated weights for policy 1, policy_version 1346245 (0.0010) [2023-12-28 04:54:40,929][106225] Updated weights for policy 1, policy_version 1346255 (0.0010) [2023-12-28 04:54:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 688521216. Throughput: 0: 9929.2, 1: 9771.4. Samples: 688491664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:41,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.646')] [2023-12-28 04:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001346264_344694784.pth... [2023-12-28 04:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001342816_343826432.pth... [2023-12-28 04:54:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001341664_343531520.pth [2023-12-28 04:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001345112_344399872.pth [2023-12-28 04:54:41,408][106226] Updated weights for policy 0, policy_version 1342817 (0.0008) [2023-12-28 04:54:41,475][106226] Updated weights for policy 0, policy_version 1342827 (0.0008) [2023-12-28 04:54:41,538][106226] Updated weights for policy 0, policy_version 1342837 (0.0008) [2023-12-28 04:54:41,598][106226] Updated weights for policy 0, policy_version 1342847 (0.0009) [2023-12-28 04:54:41,685][106225] Updated weights for policy 1, policy_version 1346265 (0.0010) [2023-12-28 04:54:41,770][106225] Updated weights for policy 1, policy_version 1346275 (0.0008) [2023-12-28 04:54:41,817][106225] Updated weights for policy 1, policy_version 1346285 (0.0008) [2023-12-28 04:54:41,875][106225] Updated weights for policy 1, policy_version 1346295 (0.0007) [2023-12-28 04:54:42,431][106226] Updated weights for policy 0, policy_version 1342857 (0.0006) [2023-12-28 04:54:42,499][106226] Updated weights for policy 0, policy_version 1342867 (0.0006) [2023-12-28 04:54:42,558][106225] Updated weights for policy 1, policy_version 1346305 (0.0008) [2023-12-28 04:54:42,563][106226] Updated weights for policy 0, policy_version 1342877 (0.0006) [2023-12-28 04:54:42,620][106225] Updated weights for policy 1, policy_version 1346315 (0.0008) [2023-12-28 04:54:42,680][106225] Updated weights for policy 1, policy_version 1346325 (0.0009) [2023-12-28 04:54:43,225][106226] Updated weights for policy 0, policy_version 1342887 (0.0009) [2023-12-28 04:54:43,286][106226] Updated weights for policy 0, policy_version 1342897 (0.0009) [2023-12-28 04:54:43,339][106226] Updated weights for policy 0, policy_version 1342907 (0.0009) [2023-12-28 04:54:43,400][106225] Updated weights for policy 1, policy_version 1346335 (0.0008) [2023-12-28 04:54:43,458][106225] Updated weights for policy 1, policy_version 1346345 (0.0008) [2023-12-28 04:54:43,516][106225] Updated weights for policy 1, policy_version 1346355 (0.0008) [2023-12-28 04:54:44,031][106226] Updated weights for policy 0, policy_version 1342917 (0.0008) [2023-12-28 04:54:44,080][106226] Updated weights for policy 0, policy_version 1342927 (0.0009) [2023-12-28 04:54:44,145][106226] Updated weights for policy 0, policy_version 1342937 (0.0009) [2023-12-28 04:54:44,258][106225] Updated weights for policy 1, policy_version 1346365 (0.0008) [2023-12-28 04:54:44,313][106225] Updated weights for policy 1, policy_version 1346375 (0.0008) [2023-12-28 04:54:44,363][106225] Updated weights for policy 1, policy_version 1346385 (0.0005) [2023-12-28 04:54:44,893][106226] Updated weights for policy 0, policy_version 1342947 (0.0009) [2023-12-28 04:54:44,955][106226] Updated weights for policy 0, policy_version 1342957 (0.0008) [2023-12-28 04:54:45,024][106226] Updated weights for policy 0, policy_version 1342967 (0.0008) [2023-12-28 04:54:45,063][106225] Updated weights for policy 1, policy_version 1346395 (0.0006) [2023-12-28 04:54:45,125][106225] Updated weights for policy 1, policy_version 1346405 (0.0007) [2023-12-28 04:54:45,190][106225] Updated weights for policy 1, policy_version 1346415 (0.0007) [2023-12-28 04:54:45,806][106226] Updated weights for policy 0, policy_version 1342977 (0.0010) [2023-12-28 04:54:45,870][106226] Updated weights for policy 0, policy_version 1342987 (0.0007) [2023-12-28 04:54:45,872][106225] Updated weights for policy 1, policy_version 1346425 (0.0008) [2023-12-28 04:54:45,927][106225] Updated weights for policy 1, policy_version 1346435 (0.0008) [2023-12-28 04:54:45,927][106226] Updated weights for policy 0, policy_version 1342997 (0.0005) [2023-12-28 04:54:45,980][106225] Updated weights for policy 1, policy_version 1346445 (0.0008) [2023-12-28 04:54:45,985][106226] Updated weights for policy 0, policy_version 1343007 (0.0005) [2023-12-28 04:54:46,032][106225] Updated weights for policy 1, policy_version 1346455 (0.0008) [2023-12-28 04:54:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 688619520. Throughput: 0: 9874.9, 1: 9789.6. Samples: 688605664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:46,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.515')] [2023-12-28 04:54:46,676][106226] Updated weights for policy 0, policy_version 1343017 (0.0008) [2023-12-28 04:54:46,724][106225] Updated weights for policy 1, policy_version 1346465 (0.0006) [2023-12-28 04:54:46,729][106226] Updated weights for policy 0, policy_version 1343027 (0.0008) [2023-12-28 04:54:46,780][106225] Updated weights for policy 1, policy_version 1346475 (0.0006) [2023-12-28 04:54:46,786][106226] Updated weights for policy 0, policy_version 1343037 (0.0008) [2023-12-28 04:54:46,837][106225] Updated weights for policy 1, policy_version 1346485 (0.0005) [2023-12-28 04:54:47,430][106225] Updated weights for policy 1, policy_version 1346495 (0.0008) [2023-12-28 04:54:47,481][106225] Updated weights for policy 1, policy_version 1346505 (0.0008) [2023-12-28 04:54:47,528][106225] Updated weights for policy 1, policy_version 1346515 (0.0007) [2023-12-28 04:54:47,559][106226] Updated weights for policy 0, policy_version 1343047 (0.0008) [2023-12-28 04:54:47,609][106226] Updated weights for policy 0, policy_version 1343057 (0.0009) [2023-12-28 04:54:47,663][106226] Updated weights for policy 0, policy_version 1343067 (0.0008) [2023-12-28 04:54:48,163][106225] Updated weights for policy 1, policy_version 1346525 (0.0009) [2023-12-28 04:54:48,211][106225] Updated weights for policy 1, policy_version 1346535 (0.0008) [2023-12-28 04:54:48,259][106225] Updated weights for policy 1, policy_version 1346545 (0.0008) [2023-12-28 04:54:48,444][106226] Updated weights for policy 0, policy_version 1343077 (0.0008) [2023-12-28 04:54:48,508][106226] Updated weights for policy 0, policy_version 1343087 (0.0008) [2023-12-28 04:54:48,569][106226] Updated weights for policy 0, policy_version 1343097 (0.0009) [2023-12-28 04:54:49,013][106225] Updated weights for policy 1, policy_version 1346555 (0.0009) [2023-12-28 04:54:49,065][106225] Updated weights for policy 1, policy_version 1346565 (0.0008) [2023-12-28 04:54:49,124][106225] Updated weights for policy 1, policy_version 1346575 (0.0008) [2023-12-28 04:54:49,345][106226] Updated weights for policy 0, policy_version 1343107 (0.0009) [2023-12-28 04:54:49,413][106226] Updated weights for policy 0, policy_version 1343117 (0.0009) [2023-12-28 04:54:49,466][106226] Updated weights for policy 0, policy_version 1343127 (0.0009) [2023-12-28 04:54:49,893][106225] Updated weights for policy 1, policy_version 1346585 (0.0008) [2023-12-28 04:54:49,963][106225] Updated weights for policy 1, policy_version 1346595 (0.0008) [2023-12-28 04:54:50,031][106225] Updated weights for policy 1, policy_version 1346605 (0.0009) [2023-12-28 04:54:50,093][106226] Updated weights for policy 0, policy_version 1343137 (0.0006) [2023-12-28 04:54:50,095][106225] Updated weights for policy 1, policy_version 1346615 (0.0007) [2023-12-28 04:54:50,156][106226] Updated weights for policy 0, policy_version 1343147 (0.0008) [2023-12-28 04:54:50,220][106226] Updated weights for policy 0, policy_version 1343157 (0.0008) [2023-12-28 04:54:50,292][106226] Updated weights for policy 0, policy_version 1343167 (0.0007) [2023-12-28 04:54:50,741][106225] Updated weights for policy 1, policy_version 1346625 (0.0007) [2023-12-28 04:54:50,798][106225] Updated weights for policy 1, policy_version 1346635 (0.0005) [2023-12-28 04:54:50,850][106225] Updated weights for policy 1, policy_version 1346645 (0.0005) [2023-12-28 04:54:51,009][106226] Updated weights for policy 0, policy_version 1343177 (0.0006) [2023-12-28 04:54:51,080][106226] Updated weights for policy 0, policy_version 1343187 (0.0009) [2023-12-28 04:54:51,149][106226] Updated weights for policy 0, policy_version 1343197 (0.0010) [2023-12-28 04:54:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 688717824. Throughput: 0: 9777.5, 1: 9822.3. Samples: 688723268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:51,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-4.699')] [2023-12-28 04:54:51,533][106225] Updated weights for policy 1, policy_version 1346655 (0.0007) [2023-12-28 04:54:51,595][106225] Updated weights for policy 1, policy_version 1346665 (0.0009) [2023-12-28 04:54:51,660][106225] Updated weights for policy 1, policy_version 1346675 (0.0007) [2023-12-28 04:54:51,926][106226] Updated weights for policy 0, policy_version 1343207 (0.0009) [2023-12-28 04:54:51,982][106226] Updated weights for policy 0, policy_version 1343217 (0.0008) [2023-12-28 04:54:52,038][106226] Updated weights for policy 0, policy_version 1343227 (0.0008) [2023-12-28 04:54:52,378][106225] Updated weights for policy 1, policy_version 1346685 (0.0006) [2023-12-28 04:54:52,432][106225] Updated weights for policy 1, policy_version 1346695 (0.0007) [2023-12-28 04:54:52,482][106225] Updated weights for policy 1, policy_version 1346705 (0.0008) [2023-12-28 04:54:52,828][106226] Updated weights for policy 0, policy_version 1343237 (0.0009) [2023-12-28 04:54:52,879][106226] Updated weights for policy 0, policy_version 1343247 (0.0009) [2023-12-28 04:54:52,932][106226] Updated weights for policy 0, policy_version 1343257 (0.0008) [2023-12-28 04:54:53,128][106225] Updated weights for policy 1, policy_version 1346715 (0.0008) [2023-12-28 04:54:53,179][106225] Updated weights for policy 1, policy_version 1346725 (0.0008) [2023-12-28 04:54:53,232][106225] Updated weights for policy 1, policy_version 1346735 (0.0009) [2023-12-28 04:54:53,701][106226] Updated weights for policy 0, policy_version 1343267 (0.0009) [2023-12-28 04:54:53,758][106226] Updated weights for policy 0, policy_version 1343277 (0.0008) [2023-12-28 04:54:53,815][106226] Updated weights for policy 0, policy_version 1343287 (0.0007) [2023-12-28 04:54:53,861][106225] Updated weights for policy 1, policy_version 1346745 (0.0008) [2023-12-28 04:54:53,923][106225] Updated weights for policy 1, policy_version 1346755 (0.0007) [2023-12-28 04:54:53,975][106225] Updated weights for policy 1, policy_version 1346765 (0.0006) [2023-12-28 04:54:54,030][106225] Updated weights for policy 1, policy_version 1346775 (0.0007) [2023-12-28 04:54:54,560][106225] Updated weights for policy 1, policy_version 1346785 (0.0005) [2023-12-28 04:54:54,608][106225] Updated weights for policy 1, policy_version 1346795 (0.0005) [2023-12-28 04:54:54,635][106226] Updated weights for policy 0, policy_version 1343297 (0.0008) [2023-12-28 04:54:54,662][106225] Updated weights for policy 1, policy_version 1346805 (0.0005) [2023-12-28 04:54:54,684][106226] Updated weights for policy 0, policy_version 1343307 (0.0008) [2023-12-28 04:54:54,741][106226] Updated weights for policy 0, policy_version 1343317 (0.0010) [2023-12-28 04:54:54,790][106226] Updated weights for policy 0, policy_version 1343327 (0.0008) [2023-12-28 04:54:55,300][106225] Updated weights for policy 1, policy_version 1346815 (0.0005) [2023-12-28 04:54:55,368][106225] Updated weights for policy 1, policy_version 1346825 (0.0006) [2023-12-28 04:54:55,431][106225] Updated weights for policy 1, policy_version 1346835 (0.0009) [2023-12-28 04:54:55,592][106226] Updated weights for policy 0, policy_version 1343337 (0.0010) [2023-12-28 04:54:55,654][106226] Updated weights for policy 0, policy_version 1343347 (0.0011) [2023-12-28 04:54:55,720][106226] Updated weights for policy 0, policy_version 1343357 (0.0010) [2023-12-28 04:54:56,147][106225] Updated weights for policy 1, policy_version 1346845 (0.0007) [2023-12-28 04:54:56,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.4, 300 sec: 19688.6). Total num frames: 688807936. Throughput: 0: 9711.9, 1: 9883.2. Samples: 688780644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:54:56,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.558')] [2023-12-28 04:54:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001343360_343965696.pth... [2023-12-28 04:54:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001342240_343678976.pth [2023-12-28 04:54:56,208][106225] Updated weights for policy 1, policy_version 1346855 (0.0009) [2023-12-28 04:54:56,263][106225] Updated weights for policy 1, policy_version 1346865 (0.0007) [2023-12-28 04:54:56,298][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001346872_344850432.pth... [2023-12-28 04:54:56,301][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001345688_344547328.pth [2023-12-28 04:54:56,404][106226] Updated weights for policy 0, policy_version 1343367 (0.0011) [2023-12-28 04:54:56,453][106226] Updated weights for policy 0, policy_version 1343377 (0.0010) [2023-12-28 04:54:56,503][106226] Updated weights for policy 0, policy_version 1343387 (0.0010) [2023-12-28 04:54:56,991][106225] Updated weights for policy 1, policy_version 1346875 (0.0007) [2023-12-28 04:54:57,044][106225] Updated weights for policy 1, policy_version 1346885 (0.0008) [2023-12-28 04:54:57,096][106225] Updated weights for policy 1, policy_version 1346895 (0.0007) [2023-12-28 04:54:57,234][106226] Updated weights for policy 0, policy_version 1343397 (0.0010) [2023-12-28 04:54:57,290][106226] Updated weights for policy 0, policy_version 1343407 (0.0010) [2023-12-28 04:54:57,349][106226] Updated weights for policy 0, policy_version 1343417 (0.0010) [2023-12-28 04:54:57,808][106225] Updated weights for policy 1, policy_version 1346905 (0.0008) [2023-12-28 04:54:57,874][106225] Updated weights for policy 1, policy_version 1346915 (0.0005) [2023-12-28 04:54:57,940][106225] Updated weights for policy 1, policy_version 1346925 (0.0006) [2023-12-28 04:54:57,980][106226] Updated weights for policy 0, policy_version 1343427 (0.0009) [2023-12-28 04:54:58,002][106225] Updated weights for policy 1, policy_version 1346935 (0.0005) [2023-12-28 04:54:58,037][106226] Updated weights for policy 0, policy_version 1343437 (0.0006) [2023-12-28 04:54:58,094][106226] Updated weights for policy 0, policy_version 1343447 (0.0005) [2023-12-28 04:54:58,689][106225] Updated weights for policy 1, policy_version 1346945 (0.0008) [2023-12-28 04:54:58,759][106225] Updated weights for policy 1, policy_version 1346955 (0.0008) [2023-12-28 04:54:58,832][106225] Updated weights for policy 1, policy_version 1346965 (0.0008) [2023-12-28 04:54:58,883][106226] Updated weights for policy 0, policy_version 1343457 (0.0007) [2023-12-28 04:54:58,950][106226] Updated weights for policy 0, policy_version 1343467 (0.0007) [2023-12-28 04:54:59,004][106226] Updated weights for policy 0, policy_version 1343477 (0.0006) [2023-12-28 04:54:59,070][106226] Updated weights for policy 0, policy_version 1343487 (0.0007) [2023-12-28 04:54:59,594][106225] Updated weights for policy 1, policy_version 1346975 (0.0008) [2023-12-28 04:54:59,658][106225] Updated weights for policy 1, policy_version 1346985 (0.0008) [2023-12-28 04:54:59,717][106225] Updated weights for policy 1, policy_version 1346995 (0.0008) [2023-12-28 04:54:59,778][106226] Updated weights for policy 0, policy_version 1343497 (0.0008) [2023-12-28 04:54:59,835][106226] Updated weights for policy 0, policy_version 1343507 (0.0009) [2023-12-28 04:54:59,906][106226] Updated weights for policy 0, policy_version 1343517 (0.0008) [2023-12-28 04:55:00,379][106225] Updated weights for policy 1, policy_version 1347005 (0.0009) [2023-12-28 04:55:00,447][106225] Updated weights for policy 1, policy_version 1347015 (0.0007) [2023-12-28 04:55:00,496][106225] Updated weights for policy 1, policy_version 1347025 (0.0005) [2023-12-28 04:55:00,609][106226] Updated weights for policy 0, policy_version 1343527 (0.0009) [2023-12-28 04:55:00,665][106226] Updated weights for policy 0, policy_version 1343537 (0.0009) [2023-12-28 04:55:00,711][106226] Updated weights for policy 0, policy_version 1343547 (0.0010) [2023-12-28 04:55:01,143][106225] Updated weights for policy 1, policy_version 1347035 (0.0007) [2023-12-28 04:55:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 688906240. Throughput: 0: 9726.5, 1: 9842.8. Samples: 688897188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:01,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.746')] [2023-12-28 04:55:01,209][106225] Updated weights for policy 1, policy_version 1347045 (0.0009) [2023-12-28 04:55:01,269][106225] Updated weights for policy 1, policy_version 1347055 (0.0008) [2023-12-28 04:55:01,380][106226] Updated weights for policy 0, policy_version 1343557 (0.0009) [2023-12-28 04:55:01,434][106226] Updated weights for policy 0, policy_version 1343567 (0.0006) [2023-12-28 04:55:01,491][106226] Updated weights for policy 0, policy_version 1343577 (0.0005) [2023-12-28 04:55:02,076][106225] Updated weights for policy 1, policy_version 1347065 (0.0007) [2023-12-28 04:55:02,132][106225] Updated weights for policy 1, policy_version 1347075 (0.0008) [2023-12-28 04:55:02,193][106225] Updated weights for policy 1, policy_version 1347085 (0.0008) [2023-12-28 04:55:02,207][106226] Updated weights for policy 0, policy_version 1343587 (0.0007) [2023-12-28 04:55:02,253][106225] Updated weights for policy 1, policy_version 1347095 (0.0008) [2023-12-28 04:55:02,264][106226] Updated weights for policy 0, policy_version 1343597 (0.0006) [2023-12-28 04:55:02,325][106226] Updated weights for policy 0, policy_version 1343607 (0.0008) [2023-12-28 04:55:02,887][106225] Updated weights for policy 1, policy_version 1347105 (0.0008) [2023-12-28 04:55:02,952][106225] Updated weights for policy 1, policy_version 1347115 (0.0009) [2023-12-28 04:55:03,017][106225] Updated weights for policy 1, policy_version 1347125 (0.0007) [2023-12-28 04:55:03,139][106226] Updated weights for policy 0, policy_version 1343617 (0.0008) [2023-12-28 04:55:03,189][106226] Updated weights for policy 0, policy_version 1343627 (0.0009) [2023-12-28 04:55:03,238][106226] Updated weights for policy 0, policy_version 1343637 (0.0008) [2023-12-28 04:55:03,287][106226] Updated weights for policy 0, policy_version 1343647 (0.0009) [2023-12-28 04:55:03,639][106225] Updated weights for policy 1, policy_version 1347135 (0.0009) [2023-12-28 04:55:03,695][106225] Updated weights for policy 1, policy_version 1347145 (0.0010) [2023-12-28 04:55:03,764][106225] Updated weights for policy 1, policy_version 1347155 (0.0005) [2023-12-28 04:55:03,962][106226] Updated weights for policy 0, policy_version 1343657 (0.0006) [2023-12-28 04:55:04,016][106226] Updated weights for policy 0, policy_version 1343667 (0.0010) [2023-12-28 04:55:04,063][106226] Updated weights for policy 0, policy_version 1343677 (0.0010) [2023-12-28 04:55:04,459][106225] Updated weights for policy 1, policy_version 1347165 (0.0008) [2023-12-28 04:55:04,513][106225] Updated weights for policy 1, policy_version 1347175 (0.0010) [2023-12-28 04:55:04,573][106225] Updated weights for policy 1, policy_version 1347185 (0.0010) [2023-12-28 04:55:04,767][106226] Updated weights for policy 0, policy_version 1343687 (0.0010) [2023-12-28 04:55:04,813][106226] Updated weights for policy 0, policy_version 1343697 (0.0010) [2023-12-28 04:55:04,861][106226] Updated weights for policy 0, policy_version 1343707 (0.0010) [2023-12-28 04:55:05,216][106225] Updated weights for policy 1, policy_version 1347195 (0.0009) [2023-12-28 04:55:05,271][106225] Updated weights for policy 1, policy_version 1347205 (0.0008) [2023-12-28 04:55:05,317][106225] Updated weights for policy 1, policy_version 1347215 (0.0005) [2023-12-28 04:55:05,526][106226] Updated weights for policy 0, policy_version 1343717 (0.0009) [2023-12-28 04:55:05,586][106226] Updated weights for policy 0, policy_version 1343727 (0.0008) [2023-12-28 04:55:05,634][106226] Updated weights for policy 0, policy_version 1343737 (0.0007) [2023-12-28 04:55:05,966][106225] Updated weights for policy 1, policy_version 1347225 (0.0006) [2023-12-28 04:55:06,018][106225] Updated weights for policy 1, policy_version 1347235 (0.0006) [2023-12-28 04:55:06,079][106225] Updated weights for policy 1, policy_version 1347245 (0.0010) [2023-12-28 04:55:06,147][106225] Updated weights for policy 1, policy_version 1347255 (0.0011) [2023-12-28 04:55:06,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 689012736. Throughput: 0: 9769.1, 1: 9920.7. Samples: 689018908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:06,176][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.921')] [2023-12-28 04:55:06,439][106226] Updated weights for policy 0, policy_version 1343747 (0.0009) [2023-12-28 04:55:06,510][106226] Updated weights for policy 0, policy_version 1343757 (0.0009) [2023-12-28 04:55:06,568][106226] Updated weights for policy 0, policy_version 1343767 (0.0009) [2023-12-28 04:55:06,752][106225] Updated weights for policy 1, policy_version 1347265 (0.0008) [2023-12-28 04:55:06,807][106225] Updated weights for policy 1, policy_version 1347275 (0.0008) [2023-12-28 04:55:06,871][106225] Updated weights for policy 1, policy_version 1347285 (0.0009) [2023-12-28 04:55:07,266][106226] Updated weights for policy 0, policy_version 1343777 (0.0008) [2023-12-28 04:55:07,335][106226] Updated weights for policy 0, policy_version 1343787 (0.0005) [2023-12-28 04:55:07,400][106226] Updated weights for policy 0, policy_version 1343797 (0.0010) [2023-12-28 04:55:07,461][106226] Updated weights for policy 0, policy_version 1343807 (0.0009) [2023-12-28 04:55:07,541][106225] Updated weights for policy 1, policy_version 1347295 (0.0009) [2023-12-28 04:55:07,600][106225] Updated weights for policy 1, policy_version 1347305 (0.0008) [2023-12-28 04:55:07,659][106225] Updated weights for policy 1, policy_version 1347315 (0.0009) [2023-12-28 04:55:08,103][106226] Updated weights for policy 0, policy_version 1343817 (0.0009) [2023-12-28 04:55:08,163][106226] Updated weights for policy 0, policy_version 1343827 (0.0007) [2023-12-28 04:55:08,221][106226] Updated weights for policy 0, policy_version 1343837 (0.0006) [2023-12-28 04:55:08,424][106225] Updated weights for policy 1, policy_version 1347325 (0.0008) [2023-12-28 04:55:08,487][106225] Updated weights for policy 1, policy_version 1347335 (0.0008) [2023-12-28 04:55:08,546][106225] Updated weights for policy 1, policy_version 1347345 (0.0009) [2023-12-28 04:55:08,996][106226] Updated weights for policy 0, policy_version 1343847 (0.0008) [2023-12-28 04:55:09,048][106226] Updated weights for policy 0, policy_version 1343857 (0.0008) [2023-12-28 04:55:09,108][106226] Updated weights for policy 0, policy_version 1343867 (0.0009) [2023-12-28 04:55:09,171][106225] Updated weights for policy 1, policy_version 1347355 (0.0007) [2023-12-28 04:55:09,230][106225] Updated weights for policy 1, policy_version 1347365 (0.0007) [2023-12-28 04:55:09,297][106225] Updated weights for policy 1, policy_version 1347375 (0.0008) [2023-12-28 04:55:09,824][106226] Updated weights for policy 0, policy_version 1343877 (0.0008) [2023-12-28 04:55:09,897][106226] Updated weights for policy 0, policy_version 1343887 (0.0009) [2023-12-28 04:55:09,964][106226] Updated weights for policy 0, policy_version 1343897 (0.0008) [2023-12-28 04:55:10,023][106225] Updated weights for policy 1, policy_version 1347385 (0.0007) [2023-12-28 04:55:10,085][106225] Updated weights for policy 1, policy_version 1347395 (0.0007) [2023-12-28 04:55:10,149][106225] Updated weights for policy 1, policy_version 1347405 (0.0007) [2023-12-28 04:55:10,209][106225] Updated weights for policy 1, policy_version 1347415 (0.0009) [2023-12-28 04:55:10,637][106226] Updated weights for policy 0, policy_version 1343907 (0.0008) [2023-12-28 04:55:10,692][106226] Updated weights for policy 0, policy_version 1343917 (0.0011) [2023-12-28 04:55:10,744][106226] Updated weights for policy 0, policy_version 1343927 (0.0011) [2023-12-28 04:55:10,966][106225] Updated weights for policy 1, policy_version 1347425 (0.0008) [2023-12-28 04:55:11,035][106225] Updated weights for policy 1, policy_version 1347435 (0.0008) [2023-12-28 04:55:11,102][106225] Updated weights for policy 1, policy_version 1347445 (0.0008) [2023-12-28 04:55:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 689111040. Throughput: 0: 9758.8, 1: 9949.4. Samples: 689077892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:11,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.520')] [2023-12-28 04:55:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001343936_344113152.pth... [2023-12-28 04:55:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001347448_344997888.pth... [2023-12-28 04:55:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001342816_343826432.pth [2023-12-28 04:55:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001346264_344694784.pth [2023-12-28 04:55:11,495][106226] Updated weights for policy 0, policy_version 1343937 (0.0010) [2023-12-28 04:55:11,550][106226] Updated weights for policy 0, policy_version 1343947 (0.0011) [2023-12-28 04:55:11,610][106226] Updated weights for policy 0, policy_version 1343957 (0.0011) [2023-12-28 04:55:11,677][106226] Updated weights for policy 0, policy_version 1343967 (0.0009) [2023-12-28 04:55:11,884][106225] Updated weights for policy 1, policy_version 1347455 (0.0006) [2023-12-28 04:55:11,950][106225] Updated weights for policy 1, policy_version 1347465 (0.0007) [2023-12-28 04:55:12,016][106225] Updated weights for policy 1, policy_version 1347475 (0.0008) [2023-12-28 04:55:12,490][106226] Updated weights for policy 0, policy_version 1343977 (0.0007) [2023-12-28 04:55:12,557][106226] Updated weights for policy 0, policy_version 1343987 (0.0007) [2023-12-28 04:55:12,615][106226] Updated weights for policy 0, policy_version 1343997 (0.0010) [2023-12-28 04:55:12,636][106225] Updated weights for policy 1, policy_version 1347485 (0.0007) [2023-12-28 04:55:12,704][106225] Updated weights for policy 1, policy_version 1347495 (0.0008) [2023-12-28 04:55:12,771][106225] Updated weights for policy 1, policy_version 1347505 (0.0008) [2023-12-28 04:55:13,248][106226] Updated weights for policy 0, policy_version 1344007 (0.0007) [2023-12-28 04:55:13,301][106226] Updated weights for policy 0, policy_version 1344017 (0.0008) [2023-12-28 04:55:13,360][106226] Updated weights for policy 0, policy_version 1344027 (0.0009) [2023-12-28 04:55:13,460][106225] Updated weights for policy 1, policy_version 1347515 (0.0007) [2023-12-28 04:55:13,515][106225] Updated weights for policy 1, policy_version 1347525 (0.0006) [2023-12-28 04:55:13,577][106225] Updated weights for policy 1, policy_version 1347535 (0.0005) [2023-12-28 04:55:13,999][106226] Updated weights for policy 0, policy_version 1344037 (0.0009) [2023-12-28 04:55:14,069][106226] Updated weights for policy 0, policy_version 1344047 (0.0008) [2023-12-28 04:55:14,095][106225] Updated weights for policy 1, policy_version 1347545 (0.0005) [2023-12-28 04:55:14,129][106226] Updated weights for policy 0, policy_version 1344057 (0.0010) [2023-12-28 04:55:14,148][106225] Updated weights for policy 1, policy_version 1347555 (0.0008) [2023-12-28 04:55:14,204][106225] Updated weights for policy 1, policy_version 1347565 (0.0008) [2023-12-28 04:55:14,255][106225] Updated weights for policy 1, policy_version 1347575 (0.0007) [2023-12-28 04:55:14,834][106226] Updated weights for policy 0, policy_version 1344067 (0.0010) [2023-12-28 04:55:14,888][106226] Updated weights for policy 0, policy_version 1344077 (0.0007) [2023-12-28 04:55:14,954][106226] Updated weights for policy 0, policy_version 1344087 (0.0007) [2023-12-28 04:55:14,962][106225] Updated weights for policy 1, policy_version 1347585 (0.0008) [2023-12-28 04:55:15,025][106225] Updated weights for policy 1, policy_version 1347595 (0.0009) [2023-12-28 04:55:15,084][106225] Updated weights for policy 1, policy_version 1347605 (0.0008) [2023-12-28 04:55:15,655][106226] Updated weights for policy 0, policy_version 1344097 (0.0006) [2023-12-28 04:55:15,709][106226] Updated weights for policy 0, policy_version 1344107 (0.0010) [2023-12-28 04:55:15,760][106226] Updated weights for policy 0, policy_version 1344117 (0.0010) [2023-12-28 04:55:15,786][106225] Updated weights for policy 1, policy_version 1347615 (0.0007) [2023-12-28 04:55:15,824][106226] Updated weights for policy 0, policy_version 1344127 (0.0010) [2023-12-28 04:55:15,846][106225] Updated weights for policy 1, policy_version 1347625 (0.0007) [2023-12-28 04:55:15,898][106225] Updated weights for policy 1, policy_version 1347635 (0.0008) [2023-12-28 04:55:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 689209344. Throughput: 0: 9700.4, 1: 9969.6. Samples: 689197260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:16,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.517')] [2023-12-28 04:55:16,479][106226] Updated weights for policy 0, policy_version 1344137 (0.0008) [2023-12-28 04:55:16,529][106226] Updated weights for policy 0, policy_version 1344147 (0.0007) [2023-12-28 04:55:16,580][106226] Updated weights for policy 0, policy_version 1344158 (0.0010) [2023-12-28 04:55:16,597][106225] Updated weights for policy 1, policy_version 1347645 (0.0006) [2023-12-28 04:55:16,653][106225] Updated weights for policy 1, policy_version 1347655 (0.0005) [2023-12-28 04:55:16,718][106225] Updated weights for policy 1, policy_version 1347665 (0.0008) [2023-12-28 04:55:17,306][106226] Updated weights for policy 0, policy_version 1344168 (0.0006) [2023-12-28 04:55:17,358][106226] Updated weights for policy 0, policy_version 1344178 (0.0008) [2023-12-28 04:55:17,406][106226] Updated weights for policy 0, policy_version 1344188 (0.0005) [2023-12-28 04:55:17,413][106225] Updated weights for policy 1, policy_version 1347675 (0.0010) [2023-12-28 04:55:17,479][106225] Updated weights for policy 1, policy_version 1347685 (0.0010) [2023-12-28 04:55:17,536][106225] Updated weights for policy 1, policy_version 1347695 (0.0010) [2023-12-28 04:55:18,097][106226] Updated weights for policy 0, policy_version 1344198 (0.0007) [2023-12-28 04:55:18,158][106226] Updated weights for policy 0, policy_version 1344208 (0.0008) [2023-12-28 04:55:18,214][106226] Updated weights for policy 0, policy_version 1344218 (0.0008) [2023-12-28 04:55:18,242][106225] Updated weights for policy 1, policy_version 1347705 (0.0010) [2023-12-28 04:55:18,309][106225] Updated weights for policy 1, policy_version 1347715 (0.0010) [2023-12-28 04:55:18,378][106225] Updated weights for policy 1, policy_version 1347725 (0.0009) [2023-12-28 04:55:18,441][106225] Updated weights for policy 1, policy_version 1347735 (0.0010) [2023-12-28 04:55:18,936][106226] Updated weights for policy 0, policy_version 1344228 (0.0006) [2023-12-28 04:55:18,995][106226] Updated weights for policy 0, policy_version 1344238 (0.0005) [2023-12-28 04:55:19,047][106226] Updated weights for policy 0, policy_version 1344248 (0.0005) [2023-12-28 04:55:19,135][106225] Updated weights for policy 1, policy_version 1347745 (0.0006) [2023-12-28 04:55:19,186][106225] Updated weights for policy 1, policy_version 1347755 (0.0005) [2023-12-28 04:55:19,270][106225] Updated weights for policy 1, policy_version 1347765 (0.0008) [2023-12-28 04:55:19,675][106226] Updated weights for policy 0, policy_version 1344258 (0.0006) [2023-12-28 04:55:19,750][106226] Updated weights for policy 0, policy_version 1344268 (0.0011) [2023-12-28 04:55:19,808][106226] Updated weights for policy 0, policy_version 1344278 (0.0011) [2023-12-28 04:55:19,879][106226] Updated weights for policy 0, policy_version 1344288 (0.0010) [2023-12-28 04:55:19,932][106225] Updated weights for policy 1, policy_version 1347775 (0.0008) [2023-12-28 04:55:19,994][106225] Updated weights for policy 1, policy_version 1347785 (0.0006) [2023-12-28 04:55:20,060][106225] Updated weights for policy 1, policy_version 1347795 (0.0006) [2023-12-28 04:55:20,596][106226] Updated weights for policy 0, policy_version 1344298 (0.0008) [2023-12-28 04:55:20,663][106226] Updated weights for policy 0, policy_version 1344308 (0.0009) [2023-12-28 04:55:20,721][106226] Updated weights for policy 0, policy_version 1344318 (0.0008) [2023-12-28 04:55:20,722][106225] Updated weights for policy 1, policy_version 1347805 (0.0008) [2023-12-28 04:55:20,783][106225] Updated weights for policy 1, policy_version 1347815 (0.0007) [2023-12-28 04:55:20,847][106225] Updated weights for policy 1, policy_version 1347825 (0.0009) [2023-12-28 04:55:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 689307648. Throughput: 0: 9626.8, 1: 10049.0. Samples: 689316560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:21,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.550')] [2023-12-28 04:55:21,515][106226] Updated weights for policy 0, policy_version 1344328 (0.0009) [2023-12-28 04:55:21,547][106225] Updated weights for policy 1, policy_version 1347835 (0.0008) [2023-12-28 04:55:21,578][106226] Updated weights for policy 0, policy_version 1344338 (0.0008) [2023-12-28 04:55:21,605][106225] Updated weights for policy 1, policy_version 1347845 (0.0006) [2023-12-28 04:55:21,647][106226] Updated weights for policy 0, policy_version 1344348 (0.0007) [2023-12-28 04:55:21,672][106225] Updated weights for policy 1, policy_version 1347855 (0.0008) [2023-12-28 04:55:22,375][106225] Updated weights for policy 1, policy_version 1347865 (0.0006) [2023-12-28 04:55:22,445][106225] Updated weights for policy 1, policy_version 1347875 (0.0007) [2023-12-28 04:55:22,475][106226] Updated weights for policy 0, policy_version 1344358 (0.0009) [2023-12-28 04:55:22,513][106225] Updated weights for policy 1, policy_version 1347885 (0.0007) [2023-12-28 04:55:22,531][106226] Updated weights for policy 0, policy_version 1344368 (0.0006) [2023-12-28 04:55:22,576][106225] Updated weights for policy 1, policy_version 1347895 (0.0008) [2023-12-28 04:55:22,588][106226] Updated weights for policy 0, policy_version 1344378 (0.0007) [2023-12-28 04:55:23,266][106226] Updated weights for policy 0, policy_version 1344388 (0.0008) [2023-12-28 04:55:23,314][106225] Updated weights for policy 1, policy_version 1347905 (0.0008) [2023-12-28 04:55:23,324][106226] Updated weights for policy 0, policy_version 1344398 (0.0006) [2023-12-28 04:55:23,375][106225] Updated weights for policy 1, policy_version 1347915 (0.0007) [2023-12-28 04:55:23,388][106226] Updated weights for policy 0, policy_version 1344408 (0.0007) [2023-12-28 04:55:23,433][106225] Updated weights for policy 1, policy_version 1347925 (0.0006) [2023-12-28 04:55:24,104][106226] Updated weights for policy 0, policy_version 1344418 (0.0009) [2023-12-28 04:55:24,168][106226] Updated weights for policy 0, policy_version 1344428 (0.0011) [2023-12-28 04:55:24,190][106225] Updated weights for policy 1, policy_version 1347935 (0.0007) [2023-12-28 04:55:24,222][106226] Updated weights for policy 0, policy_version 1344438 (0.0011) [2023-12-28 04:55:24,247][106225] Updated weights for policy 1, policy_version 1347945 (0.0005) [2023-12-28 04:55:24,275][106226] Updated weights for policy 0, policy_version 1344448 (0.0010) [2023-12-28 04:55:24,301][106225] Updated weights for policy 1, policy_version 1347955 (0.0006) [2023-12-28 04:55:24,939][106226] Updated weights for policy 0, policy_version 1344458 (0.0009) [2023-12-28 04:55:24,998][106226] Updated weights for policy 0, policy_version 1344468 (0.0005) [2023-12-28 04:55:25,050][106226] Updated weights for policy 0, policy_version 1344478 (0.0006) [2023-12-28 04:55:25,058][106225] Updated weights for policy 1, policy_version 1347965 (0.0008) [2023-12-28 04:55:25,111][106225] Updated weights for policy 1, policy_version 1347975 (0.0005) [2023-12-28 04:55:25,177][106225] Updated weights for policy 1, policy_version 1347985 (0.0005) [2023-12-28 04:55:25,692][106226] Updated weights for policy 0, policy_version 1344488 (0.0005) [2023-12-28 04:55:25,752][106226] Updated weights for policy 0, policy_version 1344498 (0.0006) [2023-12-28 04:55:25,774][106225] Updated weights for policy 1, policy_version 1347995 (0.0006) [2023-12-28 04:55:25,814][106226] Updated weights for policy 0, policy_version 1344508 (0.0007) [2023-12-28 04:55:25,830][106225] Updated weights for policy 1, policy_version 1348005 (0.0007) [2023-12-28 04:55:25,887][106225] Updated weights for policy 1, policy_version 1348015 (0.0009) [2023-12-28 04:55:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 689405952. Throughput: 0: 9579.0, 1: 10005.1. Samples: 689372948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:26,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-4.748')] [2023-12-28 04:55:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001348024_345145344.pth... [2023-12-28 04:55:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001344512_344260608.pth... [2023-12-28 04:55:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001343360_343965696.pth [2023-12-28 04:55:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001346872_344850432.pth [2023-12-28 04:55:26,333][106226] Updated weights for policy 0, policy_version 1344518 (0.0006) [2023-12-28 04:55:26,393][106226] Updated weights for policy 0, policy_version 1344528 (0.0005) [2023-12-28 04:55:26,445][106226] Updated weights for policy 0, policy_version 1344538 (0.0006) [2023-12-28 04:55:26,687][106225] Updated weights for policy 1, policy_version 1348025 (0.0009) [2023-12-28 04:55:26,746][106225] Updated weights for policy 1, policy_version 1348035 (0.0009) [2023-12-28 04:55:26,801][106225] Updated weights for policy 1, policy_version 1348045 (0.0008) [2023-12-28 04:55:26,858][106225] Updated weights for policy 1, policy_version 1348055 (0.0009) [2023-12-28 04:55:27,106][106226] Updated weights for policy 0, policy_version 1344548 (0.0009) [2023-12-28 04:55:27,168][106226] Updated weights for policy 0, policy_version 1344558 (0.0008) [2023-12-28 04:55:27,224][106226] Updated weights for policy 0, policy_version 1344568 (0.0008) [2023-12-28 04:55:27,565][106225] Updated weights for policy 1, policy_version 1348065 (0.0008) [2023-12-28 04:55:27,612][106225] Updated weights for policy 1, policy_version 1348075 (0.0008) [2023-12-28 04:55:27,664][106225] Updated weights for policy 1, policy_version 1348085 (0.0008) [2023-12-28 04:55:27,949][106226] Updated weights for policy 0, policy_version 1344578 (0.0008) [2023-12-28 04:55:28,008][106226] Updated weights for policy 0, policy_version 1344588 (0.0009) [2023-12-28 04:55:28,069][106226] Updated weights for policy 0, policy_version 1344598 (0.0009) [2023-12-28 04:55:28,118][106226] Updated weights for policy 0, policy_version 1344608 (0.0009) [2023-12-28 04:55:28,339][106225] Updated weights for policy 1, policy_version 1348095 (0.0008) [2023-12-28 04:55:28,404][106225] Updated weights for policy 1, policy_version 1348105 (0.0008) [2023-12-28 04:55:28,464][106225] Updated weights for policy 1, policy_version 1348115 (0.0009) [2023-12-28 04:55:28,830][106226] Updated weights for policy 0, policy_version 1344618 (0.0009) [2023-12-28 04:55:28,884][106226] Updated weights for policy 0, policy_version 1344628 (0.0007) [2023-12-28 04:55:28,942][106226] Updated weights for policy 0, policy_version 1344638 (0.0005) [2023-12-28 04:55:29,220][106225] Updated weights for policy 1, policy_version 1348125 (0.0009) [2023-12-28 04:55:29,288][106225] Updated weights for policy 1, policy_version 1348135 (0.0009) [2023-12-28 04:55:29,365][106225] Updated weights for policy 1, policy_version 1348145 (0.0008) [2023-12-28 04:55:29,667][106226] Updated weights for policy 0, policy_version 1344648 (0.0007) [2023-12-28 04:55:29,718][106226] Updated weights for policy 0, policy_version 1344658 (0.0008) [2023-12-28 04:55:29,769][106226] Updated weights for policy 0, policy_version 1344668 (0.0008) [2023-12-28 04:55:30,179][106225] Updated weights for policy 1, policy_version 1348155 (0.0009) [2023-12-28 04:55:30,241][106225] Updated weights for policy 1, policy_version 1348165 (0.0009) [2023-12-28 04:55:30,299][106225] Updated weights for policy 1, policy_version 1348175 (0.0009) [2023-12-28 04:55:30,453][106226] Updated weights for policy 0, policy_version 1344678 (0.0007) [2023-12-28 04:55:30,522][106226] Updated weights for policy 0, policy_version 1344688 (0.0008) [2023-12-28 04:55:30,578][106226] Updated weights for policy 0, policy_version 1344698 (0.0006) [2023-12-28 04:55:31,082][106225] Updated weights for policy 1, policy_version 1348185 (0.0008) [2023-12-28 04:55:31,141][106225] Updated weights for policy 1, policy_version 1348195 (0.0009) [2023-12-28 04:55:31,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 689496064. Throughput: 0: 9721.1, 1: 9982.2. Samples: 689492312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:55:31,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.516')] [2023-12-28 04:55:31,201][106225] Updated weights for policy 1, policy_version 1348205 (0.0007) [2023-12-28 04:55:31,218][106226] Updated weights for policy 0, policy_version 1344708 (0.0008) [2023-12-28 04:55:31,256][106225] Updated weights for policy 1, policy_version 1348215 (0.0005) [2023-12-28 04:55:31,280][106226] Updated weights for policy 0, policy_version 1344718 (0.0008) [2023-12-28 04:55:31,346][106226] Updated weights for policy 0, policy_version 1344728 (0.0009) [2023-12-28 04:55:31,968][106225] Updated weights for policy 1, policy_version 1348225 (0.0005) [2023-12-28 04:55:32,023][106225] Updated weights for policy 1, policy_version 1348235 (0.0005) [2023-12-28 04:55:32,077][106225] Updated weights for policy 1, policy_version 1348245 (0.0007) [2023-12-28 04:55:32,079][106226] Updated weights for policy 0, policy_version 1344738 (0.0008) [2023-12-28 04:55:32,139][106226] Updated weights for policy 0, policy_version 1344748 (0.0007) [2023-12-28 04:55:32,202][106226] Updated weights for policy 0, policy_version 1344758 (0.0007) [2023-12-28 04:55:32,256][106226] Updated weights for policy 0, policy_version 1344768 (0.0009) [2023-12-28 04:55:32,769][106225] Updated weights for policy 1, policy_version 1348255 (0.0007) [2023-12-28 04:55:32,822][106225] Updated weights for policy 1, policy_version 1348265 (0.0008) [2023-12-28 04:55:32,872][106225] Updated weights for policy 1, policy_version 1348275 (0.0008) [2023-12-28 04:55:32,984][106226] Updated weights for policy 0, policy_version 1344778 (0.0009) [2023-12-28 04:55:33,044][106226] Updated weights for policy 0, policy_version 1344788 (0.0008) [2023-12-28 04:55:33,105][106226] Updated weights for policy 0, policy_version 1344798 (0.0009) [2023-12-28 04:55:33,634][106225] Updated weights for policy 1, policy_version 1348285 (0.0008) [2023-12-28 04:55:33,687][106225] Updated weights for policy 1, policy_version 1348295 (0.0008) [2023-12-28 04:55:33,738][106225] Updated weights for policy 1, policy_version 1348305 (0.0006) [2023-12-28 04:55:33,744][106226] Updated weights for policy 0, policy_version 1344808 (0.0010) [2023-12-28 04:55:33,803][106226] Updated weights for policy 0, policy_version 1344818 (0.0010) [2023-12-28 04:55:33,856][106226] Updated weights for policy 0, policy_version 1344828 (0.0010) [2023-12-28 04:55:34,518][106225] Updated weights for policy 1, policy_version 1348315 (0.0006) [2023-12-28 04:55:34,546][106226] Updated weights for policy 0, policy_version 1344838 (0.0008) [2023-12-28 04:55:34,579][106225] Updated weights for policy 1, policy_version 1348325 (0.0009) [2023-12-28 04:55:34,608][106226] Updated weights for policy 0, policy_version 1344848 (0.0006) [2023-12-28 04:55:34,644][106225] Updated weights for policy 1, policy_version 1348335 (0.0006) [2023-12-28 04:55:34,677][106226] Updated weights for policy 0, policy_version 1344858 (0.0008) [2023-12-28 04:55:35,306][106225] Updated weights for policy 1, policy_version 1348345 (0.0007) [2023-12-28 04:55:35,334][106226] Updated weights for policy 0, policy_version 1344868 (0.0009) [2023-12-28 04:55:35,366][106225] Updated weights for policy 1, policy_version 1348355 (0.0005) [2023-12-28 04:55:35,394][106226] Updated weights for policy 0, policy_version 1344878 (0.0008) [2023-12-28 04:55:35,422][106225] Updated weights for policy 1, policy_version 1348365 (0.0005) [2023-12-28 04:55:35,440][106226] Updated weights for policy 0, policy_version 1344888 (0.0008) [2023-12-28 04:55:35,477][106225] Updated weights for policy 1, policy_version 1348375 (0.0006) [2023-12-28 04:55:36,134][106226] Updated weights for policy 0, policy_version 1344898 (0.0009) [2023-12-28 04:55:36,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 689594368. Throughput: 0: 9796.8, 1: 9913.1. Samples: 689610216. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:55:36,175][106225] Updated weights for policy 1, policy_version 1348385 (0.0008) [2023-12-28 04:55:36,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-4.836')] [2023-12-28 04:55:36,203][106226] Updated weights for policy 0, policy_version 1344908 (0.0009) [2023-12-28 04:55:36,242][106225] Updated weights for policy 1, policy_version 1348395 (0.0009) [2023-12-28 04:55:36,267][106226] Updated weights for policy 0, policy_version 1344918 (0.0007) [2023-12-28 04:55:36,312][106225] Updated weights for policy 1, policy_version 1348405 (0.0008) [2023-12-28 04:55:36,326][106226] Updated weights for policy 0, policy_version 1344928 (0.0007) [2023-12-28 04:55:36,961][106225] Updated weights for policy 1, policy_version 1348415 (0.0007) [2023-12-28 04:55:37,026][106225] Updated weights for policy 1, policy_version 1348425 (0.0008) [2023-12-28 04:55:37,056][106226] Updated weights for policy 0, policy_version 1344938 (0.0007) [2023-12-28 04:55:37,081][106225] Updated weights for policy 1, policy_version 1348435 (0.0007) [2023-12-28 04:55:37,117][106226] Updated weights for policy 0, policy_version 1344948 (0.0006) [2023-12-28 04:55:37,187][106226] Updated weights for policy 0, policy_version 1344958 (0.0009) [2023-12-28 04:55:37,727][106225] Updated weights for policy 1, policy_version 1348445 (0.0005) [2023-12-28 04:55:37,787][106225] Updated weights for policy 1, policy_version 1348455 (0.0005) [2023-12-28 04:55:37,793][106226] Updated weights for policy 0, policy_version 1344968 (0.0007) [2023-12-28 04:55:37,844][106225] Updated weights for policy 1, policy_version 1348465 (0.0006) [2023-12-28 04:55:37,853][106226] Updated weights for policy 0, policy_version 1344978 (0.0007) [2023-12-28 04:55:37,914][106226] Updated weights for policy 0, policy_version 1344988 (0.0006) [2023-12-28 04:55:38,452][106225] Updated weights for policy 1, policy_version 1348475 (0.0006) [2023-12-28 04:55:38,496][106226] Updated weights for policy 0, policy_version 1344998 (0.0007) [2023-12-28 04:55:38,513][106225] Updated weights for policy 1, policy_version 1348485 (0.0007) [2023-12-28 04:55:38,561][106226] Updated weights for policy 0, policy_version 1345008 (0.0007) [2023-12-28 04:55:38,565][106225] Updated weights for policy 1, policy_version 1348495 (0.0006) [2023-12-28 04:55:38,629][106226] Updated weights for policy 0, policy_version 1345018 (0.0008) [2023-12-28 04:55:39,279][106225] Updated weights for policy 1, policy_version 1348505 (0.0006) [2023-12-28 04:55:39,343][106225] Updated weights for policy 1, policy_version 1348515 (0.0009) [2023-12-28 04:55:39,364][106226] Updated weights for policy 0, policy_version 1345028 (0.0009) [2023-12-28 04:55:39,419][106225] Updated weights for policy 1, policy_version 1348525 (0.0008) [2023-12-28 04:55:39,438][106226] Updated weights for policy 0, policy_version 1345038 (0.0008) [2023-12-28 04:55:39,486][106225] Updated weights for policy 1, policy_version 1348535 (0.0008) [2023-12-28 04:55:39,499][106226] Updated weights for policy 0, policy_version 1345048 (0.0008) [2023-12-28 04:55:40,213][106225] Updated weights for policy 1, policy_version 1348545 (0.0008) [2023-12-28 04:55:40,235][106226] Updated weights for policy 0, policy_version 1345058 (0.0008) [2023-12-28 04:55:40,267][106225] Updated weights for policy 1, policy_version 1348555 (0.0008) [2023-12-28 04:55:40,299][106226] Updated weights for policy 0, policy_version 1345068 (0.0009) [2023-12-28 04:55:40,326][106225] Updated weights for policy 1, policy_version 1348565 (0.0006) [2023-12-28 04:55:40,360][106226] Updated weights for policy 0, policy_version 1345078 (0.0007) [2023-12-28 04:55:40,427][106226] Updated weights for policy 0, policy_version 1345088 (0.0010) [2023-12-28 04:55:40,962][106225] Updated weights for policy 1, policy_version 1348575 (0.0008) [2023-12-28 04:55:41,014][106225] Updated weights for policy 1, policy_version 1348585 (0.0008) [2023-12-28 04:55:41,081][106225] Updated weights for policy 1, policy_version 1348595 (0.0008) [2023-12-28 04:55:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 689700864. Throughput: 0: 9880.8, 1: 9928.7. Samples: 689672072. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:55:41,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.580')] [2023-12-28 04:55:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001348600_345292800.pth... [2023-12-28 04:55:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001347448_344997888.pth [2023-12-28 04:55:41,209][106226] Updated weights for policy 0, policy_version 1345098 (0.0008) [2023-12-28 04:55:41,275][106226] Updated weights for policy 0, policy_version 1345108 (0.0006) [2023-12-28 04:55:41,352][106226] Updated weights for policy 0, policy_version 1345118 (0.0007) [2023-12-28 04:55:41,363][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001345120_344416256.pth... [2023-12-28 04:55:41,367][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001343936_344113152.pth [2023-12-28 04:55:41,905][106225] Updated weights for policy 1, policy_version 1348605 (0.0009) [2023-12-28 04:55:41,964][106225] Updated weights for policy 1, policy_version 1348615 (0.0008) [2023-12-28 04:55:42,022][106225] Updated weights for policy 1, policy_version 1348625 (0.0008) [2023-12-28 04:55:42,107][106226] Updated weights for policy 0, policy_version 1345128 (0.0006) [2023-12-28 04:55:42,167][106226] Updated weights for policy 0, policy_version 1345138 (0.0006) [2023-12-28 04:55:42,231][106226] Updated weights for policy 0, policy_version 1345148 (0.0006) [2023-12-28 04:55:42,748][106225] Updated weights for policy 1, policy_version 1348635 (0.0008) [2023-12-28 04:55:42,805][106225] Updated weights for policy 1, policy_version 1348645 (0.0007) [2023-12-28 04:55:42,859][106225] Updated weights for policy 1, policy_version 1348655 (0.0007) [2023-12-28 04:55:42,955][106226] Updated weights for policy 0, policy_version 1345158 (0.0010) [2023-12-28 04:55:43,011][106226] Updated weights for policy 0, policy_version 1345168 (0.0010) [2023-12-28 04:55:43,055][106226] Updated weights for policy 0, policy_version 1345178 (0.0010) [2023-12-28 04:55:43,496][106225] Updated weights for policy 1, policy_version 1348665 (0.0007) [2023-12-28 04:55:43,555][106225] Updated weights for policy 1, policy_version 1348675 (0.0008) [2023-12-28 04:55:43,621][106225] Updated weights for policy 1, policy_version 1348685 (0.0009) [2023-12-28 04:55:43,654][106226] Updated weights for policy 0, policy_version 1345188 (0.0009) [2023-12-28 04:55:43,678][106225] Updated weights for policy 1, policy_version 1348695 (0.0008) [2023-12-28 04:55:43,708][106226] Updated weights for policy 0, policy_version 1345198 (0.0005) [2023-12-28 04:55:43,762][106226] Updated weights for policy 0, policy_version 1345208 (0.0005) [2023-12-28 04:55:44,295][106226] Updated weights for policy 0, policy_version 1345218 (0.0006) [2023-12-28 04:55:44,354][106226] Updated weights for policy 0, policy_version 1345228 (0.0011) [2023-12-28 04:55:44,412][106226] Updated weights for policy 0, policy_version 1345238 (0.0011) [2023-12-28 04:55:44,428][106225] Updated weights for policy 1, policy_version 1348705 (0.0006) [2023-12-28 04:55:44,465][106226] Updated weights for policy 0, policy_version 1345248 (0.0008) [2023-12-28 04:55:44,481][106225] Updated weights for policy 1, policy_version 1348715 (0.0005) [2023-12-28 04:55:44,544][106225] Updated weights for policy 1, policy_version 1348725 (0.0005) [2023-12-28 04:55:45,190][106226] Updated weights for policy 0, policy_version 1345258 (0.0008) [2023-12-28 04:55:45,225][106225] Updated weights for policy 1, policy_version 1348735 (0.0008) [2023-12-28 04:55:45,255][106226] Updated weights for policy 0, policy_version 1345268 (0.0009) [2023-12-28 04:55:45,287][106225] Updated weights for policy 1, policy_version 1348745 (0.0006) [2023-12-28 04:55:45,321][106226] Updated weights for policy 0, policy_version 1345278 (0.0007) [2023-12-28 04:55:45,345][106225] Updated weights for policy 1, policy_version 1348755 (0.0008) [2023-12-28 04:55:45,948][106226] Updated weights for policy 0, policy_version 1345288 (0.0008) [2023-12-28 04:55:46,009][106226] Updated weights for policy 0, policy_version 1345298 (0.0008) [2023-12-28 04:55:46,072][106226] Updated weights for policy 0, policy_version 1345308 (0.0010) [2023-12-28 04:55:46,119][106225] Updated weights for policy 1, policy_version 1348765 (0.0009) [2023-12-28 04:55:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 689799168. Throughput: 0: 9947.0, 1: 9885.1. Samples: 689789632. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:55:46,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.684')] [2023-12-28 04:55:46,175][106225] Updated weights for policy 1, policy_version 1348775 (0.0007) [2023-12-28 04:55:46,226][106225] Updated weights for policy 1, policy_version 1348785 (0.0008) [2023-12-28 04:55:46,810][106226] Updated weights for policy 0, policy_version 1345318 (0.0011) [2023-12-28 04:55:46,860][106226] Updated weights for policy 0, policy_version 1345328 (0.0010) [2023-12-28 04:55:46,900][106225] Updated weights for policy 1, policy_version 1348795 (0.0007) [2023-12-28 04:55:46,911][106226] Updated weights for policy 0, policy_version 1345338 (0.0010) [2023-12-28 04:55:46,966][106225] Updated weights for policy 1, policy_version 1348805 (0.0005) [2023-12-28 04:55:47,032][106225] Updated weights for policy 1, policy_version 1348815 (0.0006) [2023-12-28 04:55:47,534][106226] Updated weights for policy 0, policy_version 1345348 (0.0008) [2023-12-28 04:55:47,587][106226] Updated weights for policy 0, policy_version 1345358 (0.0005) [2023-12-28 04:55:47,638][106226] Updated weights for policy 0, policy_version 1345368 (0.0005) [2023-12-28 04:55:47,772][106225] Updated weights for policy 1, policy_version 1348825 (0.0008) [2023-12-28 04:55:47,835][106225] Updated weights for policy 1, policy_version 1348835 (0.0010) [2023-12-28 04:55:47,892][106225] Updated weights for policy 1, policy_version 1348845 (0.0005) [2023-12-28 04:55:47,955][106225] Updated weights for policy 1, policy_version 1348855 (0.0007) [2023-12-28 04:55:48,192][106226] Updated weights for policy 0, policy_version 1345378 (0.0006) [2023-12-28 04:55:48,251][106226] Updated weights for policy 0, policy_version 1345388 (0.0008) [2023-12-28 04:55:48,311][106226] Updated weights for policy 0, policy_version 1345398 (0.0008) [2023-12-28 04:55:48,381][106226] Updated weights for policy 0, policy_version 1345408 (0.0009) [2023-12-28 04:55:48,730][106225] Updated weights for policy 1, policy_version 1348865 (0.0009) [2023-12-28 04:55:48,790][106225] Updated weights for policy 1, policy_version 1348875 (0.0009) [2023-12-28 04:55:48,850][106225] Updated weights for policy 1, policy_version 1348885 (0.0009) [2023-12-28 04:55:49,023][106226] Updated weights for policy 0, policy_version 1345418 (0.0009) [2023-12-28 04:55:49,076][106226] Updated weights for policy 0, policy_version 1345428 (0.0008) [2023-12-28 04:55:49,127][106226] Updated weights for policy 0, policy_version 1345438 (0.0010) [2023-12-28 04:55:49,623][106225] Updated weights for policy 1, policy_version 1348895 (0.0009) [2023-12-28 04:55:49,678][106225] Updated weights for policy 1, policy_version 1348905 (0.0008) [2023-12-28 04:55:49,734][106225] Updated weights for policy 1, policy_version 1348915 (0.0008) [2023-12-28 04:55:49,757][106226] Updated weights for policy 0, policy_version 1345448 (0.0007) [2023-12-28 04:55:49,814][106226] Updated weights for policy 0, policy_version 1345458 (0.0011) [2023-12-28 04:55:49,880][106226] Updated weights for policy 0, policy_version 1345468 (0.0009) [2023-12-28 04:55:50,483][106225] Updated weights for policy 1, policy_version 1348925 (0.0008) [2023-12-28 04:55:50,543][106225] Updated weights for policy 1, policy_version 1348935 (0.0008) [2023-12-28 04:55:50,616][106225] Updated weights for policy 1, policy_version 1348945 (0.0008) [2023-12-28 04:55:50,636][106226] Updated weights for policy 0, policy_version 1345478 (0.0011) [2023-12-28 04:55:50,698][106226] Updated weights for policy 0, policy_version 1345488 (0.0008) [2023-12-28 04:55:50,760][106226] Updated weights for policy 0, policy_version 1345498 (0.0008) [2023-12-28 04:55:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 689897472. Throughput: 0: 9988.4, 1: 9755.6. Samples: 689907388. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:55:51,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.607')] [2023-12-28 04:55:51,353][106225] Updated weights for policy 1, policy_version 1348955 (0.0008) [2023-12-28 04:55:51,416][106225] Updated weights for policy 1, policy_version 1348965 (0.0008) [2023-12-28 04:55:51,463][106225] Updated weights for policy 1, policy_version 1348975 (0.0008) [2023-12-28 04:55:51,490][106226] Updated weights for policy 0, policy_version 1345508 (0.0007) [2023-12-28 04:55:51,550][106226] Updated weights for policy 0, policy_version 1345518 (0.0006) [2023-12-28 04:55:51,602][106226] Updated weights for policy 0, policy_version 1345528 (0.0006) [2023-12-28 04:55:52,264][106225] Updated weights for policy 1, policy_version 1348985 (0.0006) [2023-12-28 04:55:52,323][106225] Updated weights for policy 1, policy_version 1348995 (0.0010) [2023-12-28 04:55:52,366][106226] Updated weights for policy 0, policy_version 1345538 (0.0009) [2023-12-28 04:55:52,394][106225] Updated weights for policy 1, policy_version 1349005 (0.0010) [2023-12-28 04:55:52,434][106226] Updated weights for policy 0, policy_version 1345548 (0.0008) [2023-12-28 04:55:52,453][106225] Updated weights for policy 1, policy_version 1349015 (0.0010) [2023-12-28 04:55:52,499][106226] Updated weights for policy 0, policy_version 1345558 (0.0008) [2023-12-28 04:55:52,565][106226] Updated weights for policy 0, policy_version 1345568 (0.0008) [2023-12-28 04:55:53,109][106225] Updated weights for policy 1, policy_version 1349025 (0.0010) [2023-12-28 04:55:53,155][106225] Updated weights for policy 1, policy_version 1349035 (0.0010) [2023-12-28 04:55:53,202][106225] Updated weights for policy 1, policy_version 1349045 (0.0010) [2023-12-28 04:55:53,223][106226] Updated weights for policy 0, policy_version 1345578 (0.0011) [2023-12-28 04:55:53,286][106226] Updated weights for policy 0, policy_version 1345588 (0.0010) [2023-12-28 04:55:53,349][106226] Updated weights for policy 0, policy_version 1345598 (0.0011) [2023-12-28 04:55:53,882][106225] Updated weights for policy 1, policy_version 1349055 (0.0010) [2023-12-28 04:55:53,929][106225] Updated weights for policy 1, policy_version 1349065 (0.0010) [2023-12-28 04:55:53,981][106226] Updated weights for policy 0, policy_version 1345608 (0.0006) [2023-12-28 04:55:53,988][106225] Updated weights for policy 1, policy_version 1349075 (0.0010) [2023-12-28 04:55:54,034][106226] Updated weights for policy 0, policy_version 1345618 (0.0006) [2023-12-28 04:55:54,086][106226] Updated weights for policy 0, policy_version 1345628 (0.0006) [2023-12-28 04:55:54,697][106225] Updated weights for policy 1, policy_version 1349085 (0.0008) [2023-12-28 04:55:54,742][106226] Updated weights for policy 0, policy_version 1345638 (0.0006) [2023-12-28 04:55:54,748][106225] Updated weights for policy 1, policy_version 1349095 (0.0009) [2023-12-28 04:55:54,795][106225] Updated weights for policy 1, policy_version 1349105 (0.0010) [2023-12-28 04:55:54,798][106226] Updated weights for policy 0, policy_version 1345648 (0.0006) [2023-12-28 04:55:54,863][106226] Updated weights for policy 0, policy_version 1345658 (0.0006) [2023-12-28 04:55:55,446][106226] Updated weights for policy 0, policy_version 1345668 (0.0007) [2023-12-28 04:55:55,495][106225] Updated weights for policy 1, policy_version 1349115 (0.0010) [2023-12-28 04:55:55,503][106226] Updated weights for policy 0, policy_version 1345678 (0.0008) [2023-12-28 04:55:55,545][106225] Updated weights for policy 1, policy_version 1349125 (0.0010) [2023-12-28 04:55:55,561][106226] Updated weights for policy 0, policy_version 1345688 (0.0011) [2023-12-28 04:55:55,597][106225] Updated weights for policy 1, policy_version 1349135 (0.0010) [2023-12-28 04:55:56,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 689995776. Throughput: 0: 10025.0, 1: 9733.5. Samples: 689967020. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:55:56,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.539')] [2023-12-28 04:55:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001349144_345432064.pth... [2023-12-28 04:55:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001345696_344563712.pth... [2023-12-28 04:55:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001344512_344260608.pth [2023-12-28 04:55:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001348024_345145344.pth [2023-12-28 04:55:56,218][106226] Updated weights for policy 0, policy_version 1345698 (0.0010) [2023-12-28 04:55:56,273][106226] Updated weights for policy 0, policy_version 1345708 (0.0005) [2023-12-28 04:55:56,317][106225] Updated weights for policy 1, policy_version 1349145 (0.0008) [2023-12-28 04:55:56,324][106226] Updated weights for policy 0, policy_version 1345718 (0.0005) [2023-12-28 04:55:56,367][106225] Updated weights for policy 1, policy_version 1349155 (0.0010) [2023-12-28 04:55:56,377][106226] Updated weights for policy 0, policy_version 1345728 (0.0008) [2023-12-28 04:55:56,436][106225] Updated weights for policy 1, policy_version 1349165 (0.0010) [2023-12-28 04:55:56,499][106225] Updated weights for policy 1, policy_version 1349175 (0.0010) [2023-12-28 04:55:56,995][106226] Updated weights for policy 0, policy_version 1345738 (0.0006) [2023-12-28 04:55:57,049][106226] Updated weights for policy 0, policy_version 1345748 (0.0005) [2023-12-28 04:55:57,103][106226] Updated weights for policy 0, policy_version 1345758 (0.0005) [2023-12-28 04:55:57,159][106225] Updated weights for policy 1, policy_version 1349185 (0.0009) [2023-12-28 04:55:57,212][106225] Updated weights for policy 1, policy_version 1349195 (0.0009) [2023-12-28 04:55:57,254][106225] Updated weights for policy 1, policy_version 1349205 (0.0007) [2023-12-28 04:55:57,655][106226] Updated weights for policy 0, policy_version 1345768 (0.0005) [2023-12-28 04:55:57,700][106226] Updated weights for policy 0, policy_version 1345778 (0.0005) [2023-12-28 04:55:57,746][106226] Updated weights for policy 0, policy_version 1345788 (0.0005) [2023-12-28 04:55:58,064][106225] Updated weights for policy 1, policy_version 1349215 (0.0008) [2023-12-28 04:55:58,113][106225] Updated weights for policy 1, policy_version 1349225 (0.0008) [2023-12-28 04:55:58,167][106225] Updated weights for policy 1, policy_version 1349235 (0.0008) [2023-12-28 04:55:58,360][106226] Updated weights for policy 0, policy_version 1345798 (0.0007) [2023-12-28 04:55:58,430][106226] Updated weights for policy 0, policy_version 1345808 (0.0007) [2023-12-28 04:55:58,499][106226] Updated weights for policy 0, policy_version 1345818 (0.0008) [2023-12-28 04:55:58,995][106225] Updated weights for policy 1, policy_version 1349245 (0.0007) [2023-12-28 04:55:59,053][106225] Updated weights for policy 1, policy_version 1349255 (0.0008) [2023-12-28 04:55:59,103][106225] Updated weights for policy 1, policy_version 1349265 (0.0008) [2023-12-28 04:55:59,257][106226] Updated weights for policy 0, policy_version 1345828 (0.0008) [2023-12-28 04:55:59,325][106226] Updated weights for policy 0, policy_version 1345838 (0.0008) [2023-12-28 04:55:59,395][106226] Updated weights for policy 0, policy_version 1345848 (0.0007) [2023-12-28 04:55:59,798][106225] Updated weights for policy 1, policy_version 1349275 (0.0008) [2023-12-28 04:55:59,883][106225] Updated weights for policy 1, policy_version 1349285 (0.0008) [2023-12-28 04:55:59,949][106225] Updated weights for policy 1, policy_version 1349295 (0.0008) [2023-12-28 04:56:00,172][106226] Updated weights for policy 0, policy_version 1345858 (0.0007) [2023-12-28 04:56:00,232][106226] Updated weights for policy 0, policy_version 1345868 (0.0007) [2023-12-28 04:56:00,286][106226] Updated weights for policy 0, policy_version 1345878 (0.0005) [2023-12-28 04:56:00,359][106226] Updated weights for policy 0, policy_version 1345888 (0.0007) [2023-12-28 04:56:00,648][106225] Updated weights for policy 1, policy_version 1349305 (0.0010) [2023-12-28 04:56:00,717][106225] Updated weights for policy 1, policy_version 1349315 (0.0007) [2023-12-28 04:56:00,778][106225] Updated weights for policy 1, policy_version 1349325 (0.0009) [2023-12-28 04:56:00,835][106225] Updated weights for policy 1, policy_version 1349335 (0.0008) [2023-12-28 04:56:01,064][106226] Updated weights for policy 0, policy_version 1345898 (0.0009) [2023-12-28 04:56:01,128][106226] Updated weights for policy 0, policy_version 1345908 (0.0009) [2023-12-28 04:56:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 690094080. Throughput: 0: 10124.3, 1: 9665.7. Samples: 690087812. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:01,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.673')] [2023-12-28 04:56:01,189][106226] Updated weights for policy 0, policy_version 1345918 (0.0009) [2023-12-28 04:56:01,637][106225] Updated weights for policy 1, policy_version 1349345 (0.0009) [2023-12-28 04:56:01,700][106225] Updated weights for policy 1, policy_version 1349355 (0.0006) [2023-12-28 04:56:01,766][106225] Updated weights for policy 1, policy_version 1349365 (0.0009) [2023-12-28 04:56:01,879][106226] Updated weights for policy 0, policy_version 1345928 (0.0006) [2023-12-28 04:56:01,936][106226] Updated weights for policy 0, policy_version 1345938 (0.0007) [2023-12-28 04:56:02,000][106226] Updated weights for policy 0, policy_version 1345948 (0.0007) [2023-12-28 04:56:02,496][106225] Updated weights for policy 1, policy_version 1349375 (0.0010) [2023-12-28 04:56:02,553][106225] Updated weights for policy 1, policy_version 1349385 (0.0010) [2023-12-28 04:56:02,611][106225] Updated weights for policy 1, policy_version 1349395 (0.0007) [2023-12-28 04:56:02,746][106226] Updated weights for policy 0, policy_version 1345958 (0.0009) [2023-12-28 04:56:02,812][106226] Updated weights for policy 0, policy_version 1345968 (0.0008) [2023-12-28 04:56:02,876][106226] Updated weights for policy 0, policy_version 1345978 (0.0008) [2023-12-28 04:56:03,274][106225] Updated weights for policy 1, policy_version 1349405 (0.0008) [2023-12-28 04:56:03,321][106225] Updated weights for policy 1, policy_version 1349415 (0.0010) [2023-12-28 04:56:03,372][106225] Updated weights for policy 1, policy_version 1349425 (0.0010) [2023-12-28 04:56:03,538][106226] Updated weights for policy 0, policy_version 1345988 (0.0008) [2023-12-28 04:56:03,584][106226] Updated weights for policy 0, policy_version 1345998 (0.0008) [2023-12-28 04:56:03,633][106226] Updated weights for policy 0, policy_version 1346008 (0.0007) [2023-12-28 04:56:04,136][106225] Updated weights for policy 1, policy_version 1349435 (0.0009) [2023-12-28 04:56:04,198][106225] Updated weights for policy 1, policy_version 1349445 (0.0009) [2023-12-28 04:56:04,261][106225] Updated weights for policy 1, policy_version 1349455 (0.0009) [2023-12-28 04:56:04,401][106226] Updated weights for policy 0, policy_version 1346018 (0.0008) [2023-12-28 04:56:04,464][106226] Updated weights for policy 0, policy_version 1346028 (0.0009) [2023-12-28 04:56:04,516][106226] Updated weights for policy 0, policy_version 1346038 (0.0008) [2023-12-28 04:56:04,578][106226] Updated weights for policy 0, policy_version 1346048 (0.0008) [2023-12-28 04:56:05,002][106225] Updated weights for policy 1, policy_version 1349465 (0.0008) [2023-12-28 04:56:05,055][106225] Updated weights for policy 1, policy_version 1349475 (0.0008) [2023-12-28 04:56:05,104][106225] Updated weights for policy 1, policy_version 1349485 (0.0009) [2023-12-28 04:56:05,166][106225] Updated weights for policy 1, policy_version 1349495 (0.0008) [2023-12-28 04:56:05,296][106226] Updated weights for policy 0, policy_version 1346058 (0.0005) [2023-12-28 04:56:05,347][106226] Updated weights for policy 0, policy_version 1346068 (0.0005) [2023-12-28 04:56:05,401][106226] Updated weights for policy 0, policy_version 1346078 (0.0005) [2023-12-28 04:56:05,888][106225] Updated weights for policy 1, policy_version 1349505 (0.0008) [2023-12-28 04:56:05,937][106225] Updated weights for policy 1, policy_version 1349515 (0.0007) [2023-12-28 04:56:05,958][106226] Updated weights for policy 0, policy_version 1346088 (0.0008) [2023-12-28 04:56:05,984][106225] Updated weights for policy 1, policy_version 1349525 (0.0006) [2023-12-28 04:56:06,015][106226] Updated weights for policy 0, policy_version 1346098 (0.0007) [2023-12-28 04:56:06,067][106226] Updated weights for policy 0, policy_version 1346108 (0.0009) [2023-12-28 04:56:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 690200576. Throughput: 0: 10131.3, 1: 9608.7. Samples: 690204860. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:06,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.529')] [2023-12-28 04:56:06,751][106225] Updated weights for policy 1, policy_version 1349535 (0.0008) [2023-12-28 04:56:06,805][106226] Updated weights for policy 0, policy_version 1346118 (0.0010) [2023-12-28 04:56:06,807][106225] Updated weights for policy 1, policy_version 1349545 (0.0007) [2023-12-28 04:56:06,854][106226] Updated weights for policy 0, policy_version 1346128 (0.0009) [2023-12-28 04:56:06,869][106225] Updated weights for policy 1, policy_version 1349555 (0.0007) [2023-12-28 04:56:06,911][106226] Updated weights for policy 0, policy_version 1346138 (0.0006) [2023-12-28 04:56:07,481][106226] Updated weights for policy 0, policy_version 1346148 (0.0005) [2023-12-28 04:56:07,549][106226] Updated weights for policy 0, policy_version 1346158 (0.0005) [2023-12-28 04:56:07,578][106225] Updated weights for policy 1, policy_version 1349565 (0.0009) [2023-12-28 04:56:07,616][106226] Updated weights for policy 0, policy_version 1346168 (0.0005) [2023-12-28 04:56:07,630][106225] Updated weights for policy 1, policy_version 1349575 (0.0010) [2023-12-28 04:56:07,683][106225] Updated weights for policy 1, policy_version 1349585 (0.0010) [2023-12-28 04:56:08,170][106226] Updated weights for policy 0, policy_version 1346178 (0.0008) [2023-12-28 04:56:08,229][106226] Updated weights for policy 0, policy_version 1346188 (0.0007) [2023-12-28 04:56:08,289][106226] Updated weights for policy 0, policy_version 1346198 (0.0010) [2023-12-28 04:56:08,357][106226] Updated weights for policy 0, policy_version 1346208 (0.0010) [2023-12-28 04:56:08,373][106225] Updated weights for policy 1, policy_version 1349595 (0.0009) [2023-12-28 04:56:08,435][106225] Updated weights for policy 1, policy_version 1349605 (0.0007) [2023-12-28 04:56:08,501][106225] Updated weights for policy 1, policy_version 1349615 (0.0008) [2023-12-28 04:56:09,056][106226] Updated weights for policy 0, policy_version 1346218 (0.0011) [2023-12-28 04:56:09,103][106226] Updated weights for policy 0, policy_version 1346228 (0.0010) [2023-12-28 04:56:09,162][106226] Updated weights for policy 0, policy_version 1346238 (0.0011) [2023-12-28 04:56:09,175][106225] Updated weights for policy 1, policy_version 1349625 (0.0008) [2023-12-28 04:56:09,249][106225] Updated weights for policy 1, policy_version 1349635 (0.0007) [2023-12-28 04:56:09,313][106225] Updated weights for policy 1, policy_version 1349645 (0.0008) [2023-12-28 04:56:09,386][106225] Updated weights for policy 1, policy_version 1349655 (0.0008) [2023-12-28 04:56:10,000][106226] Updated weights for policy 0, policy_version 1346248 (0.0008) [2023-12-28 04:56:10,067][106226] Updated weights for policy 0, policy_version 1346258 (0.0009) [2023-12-28 04:56:10,119][106225] Updated weights for policy 1, policy_version 1349665 (0.0008) [2023-12-28 04:56:10,129][106226] Updated weights for policy 0, policy_version 1346268 (0.0006) [2023-12-28 04:56:10,184][106225] Updated weights for policy 1, policy_version 1349675 (0.0008) [2023-12-28 04:56:10,247][106225] Updated weights for policy 1, policy_version 1349685 (0.0007) [2023-12-28 04:56:10,880][106226] Updated weights for policy 0, policy_version 1346278 (0.0008) [2023-12-28 04:56:10,880][106225] Updated weights for policy 1, policy_version 1349695 (0.0008) [2023-12-28 04:56:10,931][106225] Updated weights for policy 1, policy_version 1349705 (0.0008) [2023-12-28 04:56:10,943][106226] Updated weights for policy 0, policy_version 1346288 (0.0009) [2023-12-28 04:56:10,988][106225] Updated weights for policy 1, policy_version 1349715 (0.0006) [2023-12-28 04:56:11,002][106226] Updated weights for policy 0, policy_version 1346298 (0.0007) [2023-12-28 04:56:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 690298880. Throughput: 0: 10216.3, 1: 9634.4. Samples: 690266228. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:11,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.783')] [2023-12-28 04:56:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001349720_345579520.pth... [2023-12-28 04:56:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001346304_344719360.pth... [2023-12-28 04:56:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001348600_345292800.pth [2023-12-28 04:56:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001345120_344416256.pth [2023-12-28 04:56:11,735][106226] Updated weights for policy 0, policy_version 1346308 (0.0008) [2023-12-28 04:56:11,795][106226] Updated weights for policy 0, policy_version 1346318 (0.0010) [2023-12-28 04:56:11,850][106225] Updated weights for policy 1, policy_version 1349725 (0.0006) [2023-12-28 04:56:11,853][106226] Updated weights for policy 0, policy_version 1346328 (0.0010) [2023-12-28 04:56:11,906][106225] Updated weights for policy 1, policy_version 1349735 (0.0005) [2023-12-28 04:56:11,970][106225] Updated weights for policy 1, policy_version 1349745 (0.0009) [2023-12-28 04:56:12,605][106226] Updated weights for policy 0, policy_version 1346338 (0.0008) [2023-12-28 04:56:12,675][106226] Updated weights for policy 0, policy_version 1346348 (0.0009) [2023-12-28 04:56:12,695][106225] Updated weights for policy 1, policy_version 1349755 (0.0008) [2023-12-28 04:56:12,744][106226] Updated weights for policy 0, policy_version 1346358 (0.0010) [2023-12-28 04:56:12,750][106225] Updated weights for policy 1, policy_version 1349765 (0.0006) [2023-12-28 04:56:12,802][106226] Updated weights for policy 0, policy_version 1346368 (0.0011) [2023-12-28 04:56:12,813][106225] Updated weights for policy 1, policy_version 1349775 (0.0006) [2023-12-28 04:56:13,414][106226] Updated weights for policy 0, policy_version 1346378 (0.0005) [2023-12-28 04:56:13,460][106226] Updated weights for policy 0, policy_version 1346388 (0.0005) [2023-12-28 04:56:13,520][106226] Updated weights for policy 0, policy_version 1346398 (0.0005) [2023-12-28 04:56:13,562][106225] Updated weights for policy 1, policy_version 1349785 (0.0008) [2023-12-28 04:56:13,623][106225] Updated weights for policy 1, policy_version 1349795 (0.0005) [2023-12-28 04:56:13,680][106225] Updated weights for policy 1, policy_version 1349805 (0.0005) [2023-12-28 04:56:13,747][106225] Updated weights for policy 1, policy_version 1349815 (0.0006) [2023-12-28 04:56:14,213][106226] Updated weights for policy 0, policy_version 1346408 (0.0008) [2023-12-28 04:56:14,268][106226] Updated weights for policy 0, policy_version 1346418 (0.0009) [2023-12-28 04:56:14,336][106226] Updated weights for policy 0, policy_version 1346428 (0.0008) [2023-12-28 04:56:14,383][106225] Updated weights for policy 1, policy_version 1349825 (0.0009) [2023-12-28 04:56:14,445][106225] Updated weights for policy 1, policy_version 1349835 (0.0007) [2023-12-28 04:56:14,494][106225] Updated weights for policy 1, policy_version 1349845 (0.0008) [2023-12-28 04:56:15,016][106226] Updated weights for policy 0, policy_version 1346438 (0.0008) [2023-12-28 04:56:15,083][106226] Updated weights for policy 0, policy_version 1346448 (0.0008) [2023-12-28 04:56:15,149][106226] Updated weights for policy 0, policy_version 1346458 (0.0009) [2023-12-28 04:56:15,218][106225] Updated weights for policy 1, policy_version 1349855 (0.0009) [2023-12-28 04:56:15,275][106225] Updated weights for policy 1, policy_version 1349865 (0.0009) [2023-12-28 04:56:15,339][106225] Updated weights for policy 1, policy_version 1349875 (0.0009) [2023-12-28 04:56:15,871][106226] Updated weights for policy 0, policy_version 1346468 (0.0008) [2023-12-28 04:56:15,933][106226] Updated weights for policy 0, policy_version 1346478 (0.0008) [2023-12-28 04:56:15,995][106226] Updated weights for policy 0, policy_version 1346488 (0.0008) [2023-12-28 04:56:16,102][106225] Updated weights for policy 1, policy_version 1349885 (0.0007) [2023-12-28 04:56:16,163][106225] Updated weights for policy 1, policy_version 1349895 (0.0008) [2023-12-28 04:56:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 690388992. Throughput: 0: 10119.6, 1: 9628.5. Samples: 690380980. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:16,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.765')] [2023-12-28 04:56:16,210][106225] Updated weights for policy 1, policy_version 1349905 (0.0007) [2023-12-28 04:56:16,694][106226] Updated weights for policy 0, policy_version 1346498 (0.0008) [2023-12-28 04:56:16,748][106226] Updated weights for policy 0, policy_version 1346508 (0.0005) [2023-12-28 04:56:16,808][106226] Updated weights for policy 0, policy_version 1346518 (0.0005) [2023-12-28 04:56:16,862][106226] Updated weights for policy 0, policy_version 1346528 (0.0007) [2023-12-28 04:56:16,904][106225] Updated weights for policy 1, policy_version 1349915 (0.0009) [2023-12-28 04:56:16,963][106225] Updated weights for policy 1, policy_version 1349925 (0.0010) [2023-12-28 04:56:17,025][106225] Updated weights for policy 1, policy_version 1349935 (0.0010) [2023-12-28 04:56:17,552][106226] Updated weights for policy 0, policy_version 1346538 (0.0009) [2023-12-28 04:56:17,597][106226] Updated weights for policy 0, policy_version 1346548 (0.0009) [2023-12-28 04:56:17,638][106225] Updated weights for policy 1, policy_version 1349945 (0.0010) [2023-12-28 04:56:17,648][106226] Updated weights for policy 0, policy_version 1346558 (0.0007) [2023-12-28 04:56:17,684][106225] Updated weights for policy 1, policy_version 1349955 (0.0007) [2023-12-28 04:56:17,729][106225] Updated weights for policy 1, policy_version 1349965 (0.0007) [2023-12-28 04:56:17,775][106225] Updated weights for policy 1, policy_version 1349975 (0.0007) [2023-12-28 04:56:18,281][106226] Updated weights for policy 0, policy_version 1346568 (0.0008) [2023-12-28 04:56:18,344][106226] Updated weights for policy 0, policy_version 1346578 (0.0009) [2023-12-28 04:56:18,417][106226] Updated weights for policy 0, policy_version 1346588 (0.0008) [2023-12-28 04:56:18,458][106225] Updated weights for policy 1, policy_version 1349985 (0.0008) [2023-12-28 04:56:18,526][106225] Updated weights for policy 1, policy_version 1349995 (0.0008) [2023-12-28 04:56:18,591][106225] Updated weights for policy 1, policy_version 1350005 (0.0010) [2023-12-28 04:56:19,175][106226] Updated weights for policy 0, policy_version 1346598 (0.0009) [2023-12-28 04:56:19,193][106225] Updated weights for policy 1, policy_version 1350015 (0.0007) [2023-12-28 04:56:19,236][106226] Updated weights for policy 0, policy_version 1346608 (0.0008) [2023-12-28 04:56:19,263][106225] Updated weights for policy 1, policy_version 1350025 (0.0009) [2023-12-28 04:56:19,302][106226] Updated weights for policy 0, policy_version 1346618 (0.0006) [2023-12-28 04:56:19,324][106225] Updated weights for policy 1, policy_version 1350035 (0.0010) [2023-12-28 04:56:20,034][106225] Updated weights for policy 1, policy_version 1350045 (0.0011) [2023-12-28 04:56:20,063][106226] Updated weights for policy 0, policy_version 1346628 (0.0006) [2023-12-28 04:56:20,096][106225] Updated weights for policy 1, policy_version 1350055 (0.0010) [2023-12-28 04:56:20,126][106226] Updated weights for policy 0, policy_version 1346638 (0.0006) [2023-12-28 04:56:20,147][106225] Updated weights for policy 1, policy_version 1350065 (0.0010) [2023-12-28 04:56:20,186][106226] Updated weights for policy 0, policy_version 1346648 (0.0007) [2023-12-28 04:56:20,838][106225] Updated weights for policy 1, policy_version 1350075 (0.0010) [2023-12-28 04:56:20,897][106225] Updated weights for policy 1, policy_version 1350085 (0.0009) [2023-12-28 04:56:20,954][106226] Updated weights for policy 0, policy_version 1346658 (0.0008) [2023-12-28 04:56:20,959][106225] Updated weights for policy 1, policy_version 1350095 (0.0009) [2023-12-28 04:56:21,018][106226] Updated weights for policy 0, policy_version 1346668 (0.0007) [2023-12-28 04:56:21,092][106226] Updated weights for policy 0, policy_version 1346678 (0.0009) [2023-12-28 04:56:21,159][106226] Updated weights for policy 0, policy_version 1346688 (0.0008) [2023-12-28 04:56:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 690495488. Throughput: 0: 10048.9, 1: 9706.4. Samples: 690499204. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:21,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.752')] [2023-12-28 04:56:21,758][106225] Updated weights for policy 1, policy_version 1350105 (0.0007) [2023-12-28 04:56:21,821][106225] Updated weights for policy 1, policy_version 1350115 (0.0006) [2023-12-28 04:56:21,892][106225] Updated weights for policy 1, policy_version 1350125 (0.0008) [2023-12-28 04:56:21,921][106226] Updated weights for policy 0, policy_version 1346698 (0.0008) [2023-12-28 04:56:21,956][106225] Updated weights for policy 1, policy_version 1350135 (0.0007) [2023-12-28 04:56:21,979][106226] Updated weights for policy 0, policy_version 1346708 (0.0007) [2023-12-28 04:56:22,048][106226] Updated weights for policy 0, policy_version 1346718 (0.0009) [2023-12-28 04:56:22,652][106225] Updated weights for policy 1, policy_version 1350145 (0.0007) [2023-12-28 04:56:22,718][106225] Updated weights for policy 1, policy_version 1350155 (0.0008) [2023-12-28 04:56:22,782][106225] Updated weights for policy 1, policy_version 1350165 (0.0009) [2023-12-28 04:56:22,829][106226] Updated weights for policy 0, policy_version 1346728 (0.0008) [2023-12-28 04:56:22,891][106226] Updated weights for policy 0, policy_version 1346738 (0.0009) [2023-12-28 04:56:22,954][106226] Updated weights for policy 0, policy_version 1346748 (0.0009) [2023-12-28 04:56:23,377][106225] Updated weights for policy 1, policy_version 1350175 (0.0006) [2023-12-28 04:56:23,427][106225] Updated weights for policy 1, policy_version 1350185 (0.0007) [2023-12-28 04:56:23,473][106225] Updated weights for policy 1, policy_version 1350195 (0.0009) [2023-12-28 04:56:23,730][106226] Updated weights for policy 0, policy_version 1346758 (0.0009) [2023-12-28 04:56:23,780][106226] Updated weights for policy 0, policy_version 1346768 (0.0008) [2023-12-28 04:56:23,839][106226] Updated weights for policy 0, policy_version 1346778 (0.0009) [2023-12-28 04:56:24,120][106225] Updated weights for policy 1, policy_version 1350205 (0.0007) [2023-12-28 04:56:24,177][106225] Updated weights for policy 1, policy_version 1350215 (0.0008) [2023-12-28 04:56:24,229][106225] Updated weights for policy 1, policy_version 1350225 (0.0008) [2023-12-28 04:56:24,577][106226] Updated weights for policy 0, policy_version 1346788 (0.0008) [2023-12-28 04:56:24,643][106226] Updated weights for policy 0, policy_version 1346798 (0.0008) [2023-12-28 04:56:24,704][106226] Updated weights for policy 0, policy_version 1346808 (0.0008) [2023-12-28 04:56:24,943][106225] Updated weights for policy 1, policy_version 1350235 (0.0008) [2023-12-28 04:56:24,987][106225] Updated weights for policy 1, policy_version 1350245 (0.0008) [2023-12-28 04:56:25,038][106225] Updated weights for policy 1, policy_version 1350255 (0.0006) [2023-12-28 04:56:25,423][106226] Updated weights for policy 0, policy_version 1346818 (0.0009) [2023-12-28 04:56:25,481][106226] Updated weights for policy 0, policy_version 1346828 (0.0007) [2023-12-28 04:56:25,535][106226] Updated weights for policy 0, policy_version 1346838 (0.0006) [2023-12-28 04:56:25,587][106226] Updated weights for policy 0, policy_version 1346848 (0.0008) [2023-12-28 04:56:25,747][106225] Updated weights for policy 1, policy_version 1350265 (0.0006) [2023-12-28 04:56:25,802][106225] Updated weights for policy 1, policy_version 1350275 (0.0009) [2023-12-28 04:56:25,858][106225] Updated weights for policy 1, policy_version 1350285 (0.0008) [2023-12-28 04:56:25,908][106225] Updated weights for policy 1, policy_version 1350295 (0.0009) [2023-12-28 04:56:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 690585600. Throughput: 0: 9953.1, 1: 9663.8. Samples: 690554836. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:26,176][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.565')] [2023-12-28 04:56:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001350296_345726976.pth... [2023-12-28 04:56:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001346848_344858624.pth... [2023-12-28 04:56:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001345696_344563712.pth [2023-12-28 04:56:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001349144_345432064.pth [2023-12-28 04:56:26,268][106226] Updated weights for policy 0, policy_version 1346858 (0.0007) [2023-12-28 04:56:26,316][106226] Updated weights for policy 0, policy_version 1346868 (0.0008) [2023-12-28 04:56:26,368][106226] Updated weights for policy 0, policy_version 1346878 (0.0008) [2023-12-28 04:56:26,646][106225] Updated weights for policy 1, policy_version 1350305 (0.0008) [2023-12-28 04:56:26,695][106225] Updated weights for policy 1, policy_version 1350315 (0.0009) [2023-12-28 04:56:26,743][106225] Updated weights for policy 1, policy_version 1350325 (0.0005) [2023-12-28 04:56:27,102][106226] Updated weights for policy 0, policy_version 1346888 (0.0008) [2023-12-28 04:56:27,155][106226] Updated weights for policy 0, policy_version 1346898 (0.0008) [2023-12-28 04:56:27,208][106226] Updated weights for policy 0, policy_version 1346908 (0.0005) [2023-12-28 04:56:27,359][106225] Updated weights for policy 1, policy_version 1350335 (0.0007) [2023-12-28 04:56:27,408][106225] Updated weights for policy 1, policy_version 1350345 (0.0008) [2023-12-28 04:56:27,459][106225] Updated weights for policy 1, policy_version 1350355 (0.0008) [2023-12-28 04:56:27,904][106226] Updated weights for policy 0, policy_version 1346918 (0.0007) [2023-12-28 04:56:27,955][106226] Updated weights for policy 0, policy_version 1346928 (0.0008) [2023-12-28 04:56:28,006][106226] Updated weights for policy 0, policy_version 1346938 (0.0008) [2023-12-28 04:56:28,190][106225] Updated weights for policy 1, policy_version 1350365 (0.0008) [2023-12-28 04:56:28,242][106225] Updated weights for policy 1, policy_version 1350375 (0.0008) [2023-12-28 04:56:28,286][106225] Updated weights for policy 1, policy_version 1350385 (0.0008) [2023-12-28 04:56:28,795][106226] Updated weights for policy 0, policy_version 1346948 (0.0007) [2023-12-28 04:56:28,855][106226] Updated weights for policy 0, policy_version 1346958 (0.0010) [2023-12-28 04:56:28,918][106226] Updated weights for policy 0, policy_version 1346968 (0.0010) [2023-12-28 04:56:29,026][106225] Updated weights for policy 1, policy_version 1350395 (0.0008) [2023-12-28 04:56:29,080][106225] Updated weights for policy 1, policy_version 1350405 (0.0008) [2023-12-28 04:56:29,130][106225] Updated weights for policy 1, policy_version 1350415 (0.0010) [2023-12-28 04:56:29,596][106226] Updated weights for policy 0, policy_version 1346978 (0.0007) [2023-12-28 04:56:29,668][106226] Updated weights for policy 0, policy_version 1346988 (0.0007) [2023-12-28 04:56:29,734][106226] Updated weights for policy 0, policy_version 1346998 (0.0008) [2023-12-28 04:56:29,798][106225] Updated weights for policy 1, policy_version 1350425 (0.0010) [2023-12-28 04:56:29,803][106226] Updated weights for policy 0, policy_version 1347008 (0.0007) [2023-12-28 04:56:29,865][106225] Updated weights for policy 1, policy_version 1350435 (0.0008) [2023-12-28 04:56:29,930][106225] Updated weights for policy 1, policy_version 1350445 (0.0008) [2023-12-28 04:56:29,991][106225] Updated weights for policy 1, policy_version 1350455 (0.0008) [2023-12-28 04:56:30,537][106226] Updated weights for policy 0, policy_version 1347018 (0.0008) [2023-12-28 04:56:30,591][106226] Updated weights for policy 0, policy_version 1347028 (0.0008) [2023-12-28 04:56:30,645][106226] Updated weights for policy 0, policy_version 1347038 (0.0008) [2023-12-28 04:56:30,693][106225] Updated weights for policy 1, policy_version 1350465 (0.0008) [2023-12-28 04:56:30,749][106225] Updated weights for policy 1, policy_version 1350475 (0.0008) [2023-12-28 04:56:30,806][106225] Updated weights for policy 1, policy_version 1350485 (0.0008) [2023-12-28 04:56:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 690683904. Throughput: 0: 9939.3, 1: 9739.0. Samples: 690675156. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:31,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.717')] [2023-12-28 04:56:31,447][106226] Updated weights for policy 0, policy_version 1347048 (0.0009) [2023-12-28 04:56:31,503][106226] Updated weights for policy 0, policy_version 1347058 (0.0008) [2023-12-28 04:56:31,533][106225] Updated weights for policy 1, policy_version 1350495 (0.0007) [2023-12-28 04:56:31,562][106226] Updated weights for policy 0, policy_version 1347068 (0.0006) [2023-12-28 04:56:31,595][106225] Updated weights for policy 1, policy_version 1350505 (0.0008) [2023-12-28 04:56:31,659][106225] Updated weights for policy 1, policy_version 1350515 (0.0007) [2023-12-28 04:56:32,214][106226] Updated weights for policy 0, policy_version 1347078 (0.0006) [2023-12-28 04:56:32,280][106226] Updated weights for policy 0, policy_version 1347088 (0.0006) [2023-12-28 04:56:32,344][106226] Updated weights for policy 0, policy_version 1347098 (0.0006) [2023-12-28 04:56:32,413][106225] Updated weights for policy 1, policy_version 1350525 (0.0009) [2023-12-28 04:56:32,476][106225] Updated weights for policy 1, policy_version 1350535 (0.0009) [2023-12-28 04:56:32,539][106225] Updated weights for policy 1, policy_version 1350545 (0.0009) [2023-12-28 04:56:32,993][106226] Updated weights for policy 0, policy_version 1347108 (0.0007) [2023-12-28 04:56:33,055][106226] Updated weights for policy 0, policy_version 1347118 (0.0005) [2023-12-28 04:56:33,101][106226] Updated weights for policy 0, policy_version 1347128 (0.0005) [2023-12-28 04:56:33,180][106225] Updated weights for policy 1, policy_version 1350555 (0.0008) [2023-12-28 04:56:33,238][106225] Updated weights for policy 1, policy_version 1350565 (0.0010) [2023-12-28 04:56:33,289][106225] Updated weights for policy 1, policy_version 1350575 (0.0010) [2023-12-28 04:56:33,731][106226] Updated weights for policy 0, policy_version 1347138 (0.0006) [2023-12-28 04:56:33,779][106226] Updated weights for policy 0, policy_version 1347148 (0.0008) [2023-12-28 04:56:33,827][106226] Updated weights for policy 0, policy_version 1347158 (0.0009) [2023-12-28 04:56:33,871][106226] Updated weights for policy 0, policy_version 1347168 (0.0007) [2023-12-28 04:56:33,970][106225] Updated weights for policy 1, policy_version 1350585 (0.0010) [2023-12-28 04:56:34,015][106225] Updated weights for policy 1, policy_version 1350595 (0.0006) [2023-12-28 04:56:34,065][106225] Updated weights for policy 1, policy_version 1350605 (0.0005) [2023-12-28 04:56:34,111][106225] Updated weights for policy 1, policy_version 1350615 (0.0005) [2023-12-28 04:56:34,646][106226] Updated weights for policy 0, policy_version 1347178 (0.0009) [2023-12-28 04:56:34,698][106226] Updated weights for policy 0, policy_version 1347188 (0.0009) [2023-12-28 04:56:34,749][106226] Updated weights for policy 0, policy_version 1347198 (0.0008) [2023-12-28 04:56:34,813][106225] Updated weights for policy 1, policy_version 1350625 (0.0008) [2023-12-28 04:56:34,862][106225] Updated weights for policy 1, policy_version 1350635 (0.0008) [2023-12-28 04:56:34,922][106225] Updated weights for policy 1, policy_version 1350645 (0.0008) [2023-12-28 04:56:35,420][106226] Updated weights for policy 0, policy_version 1347208 (0.0006) [2023-12-28 04:56:35,488][106226] Updated weights for policy 0, policy_version 1347218 (0.0006) [2023-12-28 04:56:35,551][106226] Updated weights for policy 0, policy_version 1347228 (0.0010) [2023-12-28 04:56:35,591][106225] Updated weights for policy 1, policy_version 1350655 (0.0008) [2023-12-28 04:56:35,640][106225] Updated weights for policy 1, policy_version 1350665 (0.0008) [2023-12-28 04:56:35,694][106225] Updated weights for policy 1, policy_version 1350675 (0.0008) [2023-12-28 04:56:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 690782208. Throughput: 0: 9902.0, 1: 9810.6. Samples: 690794452. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:36,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-4.799')] [2023-12-28 04:56:36,245][106226] Updated weights for policy 0, policy_version 1347238 (0.0009) [2023-12-28 04:56:36,305][106226] Updated weights for policy 0, policy_version 1347248 (0.0008) [2023-12-28 04:56:36,366][106226] Updated weights for policy 0, policy_version 1347258 (0.0010) [2023-12-28 04:56:36,427][106225] Updated weights for policy 1, policy_version 1350685 (0.0008) [2023-12-28 04:56:36,496][106225] Updated weights for policy 1, policy_version 1350695 (0.0008) [2023-12-28 04:56:36,567][106225] Updated weights for policy 1, policy_version 1350705 (0.0010) [2023-12-28 04:56:36,991][106226] Updated weights for policy 0, policy_version 1347268 (0.0008) [2023-12-28 04:56:37,059][106226] Updated weights for policy 0, policy_version 1347278 (0.0005) [2023-12-28 04:56:37,129][106226] Updated weights for policy 0, policy_version 1347288 (0.0006) [2023-12-28 04:56:37,352][106225] Updated weights for policy 1, policy_version 1350715 (0.0008) [2023-12-28 04:56:37,411][106225] Updated weights for policy 1, policy_version 1350725 (0.0005) [2023-12-28 04:56:37,470][106225] Updated weights for policy 1, policy_version 1350735 (0.0008) [2023-12-28 04:56:37,654][106226] Updated weights for policy 0, policy_version 1347298 (0.0008) [2023-12-28 04:56:37,711][106226] Updated weights for policy 0, policy_version 1347308 (0.0009) [2023-12-28 04:56:37,769][106226] Updated weights for policy 0, policy_version 1347318 (0.0009) [2023-12-28 04:56:37,831][106226] Updated weights for policy 0, policy_version 1347328 (0.0005) [2023-12-28 04:56:38,179][106225] Updated weights for policy 1, policy_version 1350745 (0.0010) [2023-12-28 04:56:38,242][106225] Updated weights for policy 1, policy_version 1350755 (0.0009) [2023-12-28 04:56:38,305][106225] Updated weights for policy 1, policy_version 1350765 (0.0009) [2023-12-28 04:56:38,372][106225] Updated weights for policy 1, policy_version 1350775 (0.0007) [2023-12-28 04:56:38,426][106226] Updated weights for policy 0, policy_version 1347338 (0.0007) [2023-12-28 04:56:38,483][106226] Updated weights for policy 0, policy_version 1347348 (0.0009) [2023-12-28 04:56:38,535][106226] Updated weights for policy 0, policy_version 1347358 (0.0008) [2023-12-28 04:56:39,119][106225] Updated weights for policy 1, policy_version 1350785 (0.0009) [2023-12-28 04:56:39,147][106226] Updated weights for policy 0, policy_version 1347368 (0.0009) [2023-12-28 04:56:39,178][106225] Updated weights for policy 1, policy_version 1350795 (0.0007) [2023-12-28 04:56:39,201][106226] Updated weights for policy 0, policy_version 1347378 (0.0006) [2023-12-28 04:56:39,239][106225] Updated weights for policy 1, policy_version 1350805 (0.0008) [2023-12-28 04:56:39,275][106226] Updated weights for policy 0, policy_version 1347388 (0.0008) [2023-12-28 04:56:40,027][106226] Updated weights for policy 0, policy_version 1347398 (0.0009) [2023-12-28 04:56:40,076][106225] Updated weights for policy 1, policy_version 1350815 (0.0008) [2023-12-28 04:56:40,081][106226] Updated weights for policy 0, policy_version 1347408 (0.0010) [2023-12-28 04:56:40,140][106225] Updated weights for policy 1, policy_version 1350825 (0.0006) [2023-12-28 04:56:40,142][106226] Updated weights for policy 0, policy_version 1347418 (0.0011) [2023-12-28 04:56:40,193][106225] Updated weights for policy 1, policy_version 1350835 (0.0006) [2023-12-28 04:56:40,905][106226] Updated weights for policy 0, policy_version 1347428 (0.0011) [2023-12-28 04:56:40,934][106225] Updated weights for policy 1, policy_version 1350845 (0.0007) [2023-12-28 04:56:40,966][106226] Updated weights for policy 0, policy_version 1347438 (0.0011) [2023-12-28 04:56:40,990][106225] Updated weights for policy 1, policy_version 1350855 (0.0006) [2023-12-28 04:56:41,034][106226] Updated weights for policy 0, policy_version 1347448 (0.0010) [2023-12-28 04:56:41,050][106225] Updated weights for policy 1, policy_version 1350865 (0.0007) [2023-12-28 04:56:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 690888704. Throughput: 0: 9972.5, 1: 9787.5. Samples: 690856224. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:41,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-4.591')] [2023-12-28 04:56:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001350872_345874432.pth... [2023-12-28 04:56:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001347456_345014272.pth... [2023-12-28 04:56:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001346304_344719360.pth [2023-12-28 04:56:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001349720_345579520.pth [2023-12-28 04:56:41,766][106226] Updated weights for policy 0, policy_version 1347458 (0.0007) [2023-12-28 04:56:41,820][106225] Updated weights for policy 1, policy_version 1350875 (0.0009) [2023-12-28 04:56:41,825][106226] Updated weights for policy 0, policy_version 1347468 (0.0009) [2023-12-28 04:56:41,882][106225] Updated weights for policy 1, policy_version 1350885 (0.0006) [2023-12-28 04:56:41,887][106226] Updated weights for policy 0, policy_version 1347478 (0.0010) [2023-12-28 04:56:41,945][106225] Updated weights for policy 1, policy_version 1350895 (0.0010) [2023-12-28 04:56:41,955][106226] Updated weights for policy 0, policy_version 1347488 (0.0011) [2023-12-28 04:56:42,664][106225] Updated weights for policy 1, policy_version 1350905 (0.0010) [2023-12-28 04:56:42,719][106226] Updated weights for policy 0, policy_version 1347498 (0.0006) [2023-12-28 04:56:42,728][106225] Updated weights for policy 1, policy_version 1350915 (0.0010) [2023-12-28 04:56:42,769][106226] Updated weights for policy 0, policy_version 1347508 (0.0006) [2023-12-28 04:56:42,787][106225] Updated weights for policy 1, policy_version 1350925 (0.0010) [2023-12-28 04:56:42,823][106226] Updated weights for policy 0, policy_version 1347518 (0.0009) [2023-12-28 04:56:42,849][106225] Updated weights for policy 1, policy_version 1350935 (0.0010) [2023-12-28 04:56:43,450][106226] Updated weights for policy 0, policy_version 1347528 (0.0006) [2023-12-28 04:56:43,478][106225] Updated weights for policy 1, policy_version 1350945 (0.0010) [2023-12-28 04:56:43,507][106226] Updated weights for policy 0, policy_version 1347538 (0.0005) [2023-12-28 04:56:43,533][106225] Updated weights for policy 1, policy_version 1350955 (0.0010) [2023-12-28 04:56:43,562][106226] Updated weights for policy 0, policy_version 1347548 (0.0005) [2023-12-28 04:56:43,587][106225] Updated weights for policy 1, policy_version 1350965 (0.0010) [2023-12-28 04:56:44,254][106225] Updated weights for policy 1, policy_version 1350975 (0.0009) [2023-12-28 04:56:44,269][106226] Updated weights for policy 0, policy_version 1347558 (0.0006) [2023-12-28 04:56:44,320][106225] Updated weights for policy 1, policy_version 1350985 (0.0008) [2023-12-28 04:56:44,331][106226] Updated weights for policy 0, policy_version 1347568 (0.0007) [2023-12-28 04:56:44,381][106225] Updated weights for policy 1, policy_version 1350995 (0.0008) [2023-12-28 04:56:44,392][106226] Updated weights for policy 0, policy_version 1347578 (0.0008) [2023-12-28 04:56:45,007][106225] Updated weights for policy 1, policy_version 1351005 (0.0009) [2023-12-28 04:56:45,057][106226] Updated weights for policy 0, policy_version 1347588 (0.0007) [2023-12-28 04:56:45,068][106225] Updated weights for policy 1, policy_version 1351015 (0.0011) [2023-12-28 04:56:45,110][106226] Updated weights for policy 0, policy_version 1347598 (0.0007) [2023-12-28 04:56:45,131][106225] Updated weights for policy 1, policy_version 1351025 (0.0011) [2023-12-28 04:56:45,173][106226] Updated weights for policy 0, policy_version 1347608 (0.0009) [2023-12-28 04:56:45,834][106226] Updated weights for policy 0, policy_version 1347618 (0.0008) [2023-12-28 04:56:45,859][106225] Updated weights for policy 1, policy_version 1351035 (0.0010) [2023-12-28 04:56:45,898][106226] Updated weights for policy 0, policy_version 1347628 (0.0007) [2023-12-28 04:56:45,912][106225] Updated weights for policy 1, policy_version 1351045 (0.0010) [2023-12-28 04:56:45,946][106226] Updated weights for policy 0, policy_version 1347638 (0.0005) [2023-12-28 04:56:45,962][106225] Updated weights for policy 1, policy_version 1351055 (0.0010) [2023-12-28 04:56:46,003][106226] Updated weights for policy 0, policy_version 1347648 (0.0006) [2023-12-28 04:56:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 690987008. Throughput: 0: 9854.5, 1: 9781.6. Samples: 690971436. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:46,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.826')] [2023-12-28 04:56:46,695][106225] Updated weights for policy 1, policy_version 1351065 (0.0010) [2023-12-28 04:56:46,723][106226] Updated weights for policy 0, policy_version 1347658 (0.0006) [2023-12-28 04:56:46,756][106225] Updated weights for policy 1, policy_version 1351075 (0.0011) [2023-12-28 04:56:46,789][106226] Updated weights for policy 0, policy_version 1347668 (0.0009) [2023-12-28 04:56:46,813][106225] Updated weights for policy 1, policy_version 1351085 (0.0010) [2023-12-28 04:56:46,859][106226] Updated weights for policy 0, policy_version 1347678 (0.0011) [2023-12-28 04:56:46,866][106225] Updated weights for policy 1, policy_version 1351095 (0.0010) [2023-12-28 04:56:47,474][106226] Updated weights for policy 0, policy_version 1347688 (0.0010) [2023-12-28 04:56:47,533][106226] Updated weights for policy 0, policy_version 1347698 (0.0010) [2023-12-28 04:56:47,584][106225] Updated weights for policy 1, policy_version 1351105 (0.0010) [2023-12-28 04:56:47,592][106226] Updated weights for policy 0, policy_version 1347708 (0.0006) [2023-12-28 04:56:47,650][106225] Updated weights for policy 1, policy_version 1351115 (0.0010) [2023-12-28 04:56:47,714][106225] Updated weights for policy 1, policy_version 1351125 (0.0010) [2023-12-28 04:56:48,266][106226] Updated weights for policy 0, policy_version 1347718 (0.0007) [2023-12-28 04:56:48,348][106226] Updated weights for policy 0, policy_version 1347728 (0.0010) [2023-12-28 04:56:48,407][106226] Updated weights for policy 0, policy_version 1347738 (0.0010) [2023-12-28 04:56:48,431][106225] Updated weights for policy 1, policy_version 1351135 (0.0010) [2023-12-28 04:56:48,495][106225] Updated weights for policy 1, policy_version 1351145 (0.0010) [2023-12-28 04:56:48,556][106225] Updated weights for policy 1, policy_version 1351155 (0.0010) [2023-12-28 04:56:49,017][106226] Updated weights for policy 0, policy_version 1347748 (0.0008) [2023-12-28 04:56:49,065][106226] Updated weights for policy 0, policy_version 1347758 (0.0005) [2023-12-28 04:56:49,125][106226] Updated weights for policy 0, policy_version 1347768 (0.0005) [2023-12-28 04:56:49,293][106225] Updated weights for policy 1, policy_version 1351165 (0.0010) [2023-12-28 04:56:49,360][106225] Updated weights for policy 1, policy_version 1351175 (0.0008) [2023-12-28 04:56:49,432][106225] Updated weights for policy 1, policy_version 1351185 (0.0006) [2023-12-28 04:56:49,850][106226] Updated weights for policy 0, policy_version 1347778 (0.0008) [2023-12-28 04:56:49,918][106226] Updated weights for policy 0, policy_version 1347788 (0.0007) [2023-12-28 04:56:49,985][106226] Updated weights for policy 0, policy_version 1347798 (0.0008) [2023-12-28 04:56:50,046][106226] Updated weights for policy 0, policy_version 1347808 (0.0009) [2023-12-28 04:56:50,127][106225] Updated weights for policy 1, policy_version 1351195 (0.0010) [2023-12-28 04:56:50,194][106225] Updated weights for policy 1, policy_version 1351205 (0.0009) [2023-12-28 04:56:50,259][106225] Updated weights for policy 1, policy_version 1351215 (0.0008) [2023-12-28 04:56:50,748][106226] Updated weights for policy 0, policy_version 1347818 (0.0009) [2023-12-28 04:56:50,818][106226] Updated weights for policy 0, policy_version 1347828 (0.0008) [2023-12-28 04:56:50,879][106226] Updated weights for policy 0, policy_version 1347838 (0.0008) [2023-12-28 04:56:50,937][106225] Updated weights for policy 1, policy_version 1351225 (0.0008) [2023-12-28 04:56:51,001][106225] Updated weights for policy 1, policy_version 1351235 (0.0010) [2023-12-28 04:56:51,072][106225] Updated weights for policy 1, policy_version 1351245 (0.0013) [2023-12-28 04:56:51,125][106225] Updated weights for policy 1, policy_version 1351255 (0.0008) [2023-12-28 04:56:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 691085312. Throughput: 0: 9872.5, 1: 9800.8. Samples: 691090160. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:51,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.542')] [2023-12-28 04:56:51,652][106226] Updated weights for policy 0, policy_version 1347848 (0.0009) [2023-12-28 04:56:51,711][106226] Updated weights for policy 0, policy_version 1347858 (0.0008) [2023-12-28 04:56:51,780][106226] Updated weights for policy 0, policy_version 1347868 (0.0008) [2023-12-28 04:56:51,871][106225] Updated weights for policy 1, policy_version 1351265 (0.0008) [2023-12-28 04:56:51,933][106225] Updated weights for policy 1, policy_version 1351275 (0.0007) [2023-12-28 04:56:51,997][106225] Updated weights for policy 1, policy_version 1351285 (0.0008) [2023-12-28 04:56:52,510][106226] Updated weights for policy 0, policy_version 1347878 (0.0009) [2023-12-28 04:56:52,578][106226] Updated weights for policy 0, policy_version 1347888 (0.0009) [2023-12-28 04:56:52,644][106226] Updated weights for policy 0, policy_version 1347898 (0.0009) [2023-12-28 04:56:52,698][106225] Updated weights for policy 1, policy_version 1351295 (0.0009) [2023-12-28 04:56:52,757][106225] Updated weights for policy 1, policy_version 1351305 (0.0008) [2023-12-28 04:56:52,819][106225] Updated weights for policy 1, policy_version 1351315 (0.0008) [2023-12-28 04:56:53,312][106226] Updated weights for policy 0, policy_version 1347908 (0.0009) [2023-12-28 04:56:53,377][106226] Updated weights for policy 0, policy_version 1347918 (0.0008) [2023-12-28 04:56:53,435][106226] Updated weights for policy 0, policy_version 1347928 (0.0005) [2023-12-28 04:56:53,453][106225] Updated weights for policy 1, policy_version 1351325 (0.0007) [2023-12-28 04:56:53,508][106225] Updated weights for policy 1, policy_version 1351335 (0.0006) [2023-12-28 04:56:53,560][106225] Updated weights for policy 1, policy_version 1351345 (0.0006) [2023-12-28 04:56:53,974][106226] Updated weights for policy 0, policy_version 1347938 (0.0005) [2023-12-28 04:56:54,033][106226] Updated weights for policy 0, policy_version 1347948 (0.0009) [2023-12-28 04:56:54,087][106226] Updated weights for policy 0, policy_version 1347958 (0.0010) [2023-12-28 04:56:54,137][106226] Updated weights for policy 0, policy_version 1347968 (0.0010) [2023-12-28 04:56:54,266][106225] Updated weights for policy 1, policy_version 1351355 (0.0007) [2023-12-28 04:56:54,327][106225] Updated weights for policy 1, policy_version 1351365 (0.0010) [2023-12-28 04:56:54,380][106225] Updated weights for policy 1, policy_version 1351375 (0.0010) [2023-12-28 04:56:54,789][106226] Updated weights for policy 0, policy_version 1347978 (0.0005) [2023-12-28 04:56:54,853][106226] Updated weights for policy 0, policy_version 1347988 (0.0005) [2023-12-28 04:56:54,909][106226] Updated weights for policy 0, policy_version 1347998 (0.0005) [2023-12-28 04:56:55,005][106225] Updated weights for policy 1, policy_version 1351385 (0.0010) [2023-12-28 04:56:55,070][106225] Updated weights for policy 1, policy_version 1351395 (0.0005) [2023-12-28 04:56:55,129][106225] Updated weights for policy 1, policy_version 1351405 (0.0005) [2023-12-28 04:56:55,180][106225] Updated weights for policy 1, policy_version 1351415 (0.0005) [2023-12-28 04:56:55,527][106226] Updated weights for policy 0, policy_version 1348008 (0.0009) [2023-12-28 04:56:55,574][106226] Updated weights for policy 0, policy_version 1348018 (0.0010) [2023-12-28 04:56:55,624][106226] Updated weights for policy 0, policy_version 1348028 (0.0010) [2023-12-28 04:56:55,777][106225] Updated weights for policy 1, policy_version 1351425 (0.0008) [2023-12-28 04:56:55,837][106225] Updated weights for policy 1, policy_version 1351435 (0.0008) [2023-12-28 04:56:55,907][106225] Updated weights for policy 1, policy_version 1351445 (0.0008) [2023-12-28 04:56:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 691183616. Throughput: 0: 9844.3, 1: 9807.5. Samples: 691150560. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:56:56,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-4.609')] [2023-12-28 04:56:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001351448_346021888.pth... [2023-12-28 04:56:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001348032_345161728.pth... [2023-12-28 04:56:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001350296_345726976.pth [2023-12-28 04:56:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001346848_344858624.pth [2023-12-28 04:56:56,355][106226] Updated weights for policy 0, policy_version 1348038 (0.0010) [2023-12-28 04:56:56,415][106226] Updated weights for policy 0, policy_version 1348048 (0.0010) [2023-12-28 04:56:56,469][106226] Updated weights for policy 0, policy_version 1348058 (0.0010) [2023-12-28 04:56:56,505][106225] Updated weights for policy 1, policy_version 1351455 (0.0006) [2023-12-28 04:56:56,548][106225] Updated weights for policy 1, policy_version 1351465 (0.0008) [2023-12-28 04:56:56,601][106225] Updated weights for policy 1, policy_version 1351475 (0.0007) [2023-12-28 04:56:57,177][106226] Updated weights for policy 0, policy_version 1348068 (0.0010) [2023-12-28 04:56:57,199][106225] Updated weights for policy 1, policy_version 1351485 (0.0008) [2023-12-28 04:56:57,233][106226] Updated weights for policy 0, policy_version 1348078 (0.0010) [2023-12-28 04:56:57,249][106225] Updated weights for policy 1, policy_version 1351495 (0.0010) [2023-12-28 04:56:57,289][106226] Updated weights for policy 0, policy_version 1348088 (0.0010) [2023-12-28 04:56:57,298][106225] Updated weights for policy 1, policy_version 1351505 (0.0010) [2023-12-28 04:56:57,896][106226] Updated weights for policy 0, policy_version 1348098 (0.0007) [2023-12-28 04:56:57,957][106226] Updated weights for policy 0, policy_version 1348108 (0.0005) [2023-12-28 04:56:57,979][106225] Updated weights for policy 1, policy_version 1351515 (0.0010) [2023-12-28 04:56:58,017][106226] Updated weights for policy 0, policy_version 1348118 (0.0008) [2023-12-28 04:56:58,034][106225] Updated weights for policy 1, policy_version 1351525 (0.0010) [2023-12-28 04:56:58,066][106226] Updated weights for policy 0, policy_version 1348128 (0.0010) [2023-12-28 04:56:58,095][106225] Updated weights for policy 1, policy_version 1351535 (0.0007) [2023-12-28 04:56:58,770][106226] Updated weights for policy 0, policy_version 1348138 (0.0011) [2023-12-28 04:56:58,851][106226] Updated weights for policy 0, policy_version 1348148 (0.0009) [2023-12-28 04:56:58,904][106225] Updated weights for policy 1, policy_version 1351545 (0.0005) [2023-12-28 04:56:58,914][106226] Updated weights for policy 0, policy_version 1348158 (0.0007) [2023-12-28 04:56:58,973][106225] Updated weights for policy 1, policy_version 1351555 (0.0008) [2023-12-28 04:56:59,034][106225] Updated weights for policy 1, policy_version 1351565 (0.0008) [2023-12-28 04:56:59,124][106225] Updated weights for policy 1, policy_version 1351575 (0.0008) [2023-12-28 04:56:59,627][106226] Updated weights for policy 0, policy_version 1348168 (0.0006) [2023-12-28 04:56:59,697][106226] Updated weights for policy 0, policy_version 1348178 (0.0009) [2023-12-28 04:56:59,755][106226] Updated weights for policy 0, policy_version 1348188 (0.0009) [2023-12-28 04:56:59,869][106225] Updated weights for policy 1, policy_version 1351585 (0.0008) [2023-12-28 04:56:59,931][106225] Updated weights for policy 1, policy_version 1351595 (0.0008) [2023-12-28 04:56:59,982][106225] Updated weights for policy 1, policy_version 1351605 (0.0007) [2023-12-28 04:57:00,531][106226] Updated weights for policy 0, policy_version 1348198 (0.0008) [2023-12-28 04:57:00,595][106226] Updated weights for policy 0, policy_version 1348208 (0.0006) [2023-12-28 04:57:00,643][106226] Updated weights for policy 0, policy_version 1348218 (0.0006) [2023-12-28 04:57:00,714][106225] Updated weights for policy 1, policy_version 1351615 (0.0007) [2023-12-28 04:57:00,783][106225] Updated weights for policy 1, policy_version 1351625 (0.0005) [2023-12-28 04:57:00,835][106225] Updated weights for policy 1, policy_version 1351635 (0.0009) [2023-12-28 04:57:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 691281920. Throughput: 0: 9908.1, 1: 9900.9. Samples: 691272384. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:01,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.796')] [2023-12-28 04:57:01,227][106226] Updated weights for policy 0, policy_version 1348228 (0.0008) [2023-12-28 04:57:01,297][106226] Updated weights for policy 0, policy_version 1348238 (0.0011) [2023-12-28 04:57:01,360][106226] Updated weights for policy 0, policy_version 1348248 (0.0010) [2023-12-28 04:57:01,532][106225] Updated weights for policy 1, policy_version 1351645 (0.0010) [2023-12-28 04:57:01,594][106225] Updated weights for policy 1, policy_version 1351655 (0.0009) [2023-12-28 04:57:01,661][106225] Updated weights for policy 1, policy_version 1351665 (0.0008) [2023-12-28 04:57:02,053][106226] Updated weights for policy 0, policy_version 1348258 (0.0010) [2023-12-28 04:57:02,111][106226] Updated weights for policy 0, policy_version 1348268 (0.0005) [2023-12-28 04:57:02,167][106226] Updated weights for policy 0, policy_version 1348278 (0.0005) [2023-12-28 04:57:02,231][106226] Updated weights for policy 0, policy_version 1348288 (0.0007) [2023-12-28 04:57:02,370][106225] Updated weights for policy 1, policy_version 1351675 (0.0008) [2023-12-28 04:57:02,435][106225] Updated weights for policy 1, policy_version 1351685 (0.0010) [2023-12-28 04:57:02,494][106225] Updated weights for policy 1, policy_version 1351695 (0.0008) [2023-12-28 04:57:02,827][106226] Updated weights for policy 0, policy_version 1348298 (0.0005) [2023-12-28 04:57:02,885][106226] Updated weights for policy 0, policy_version 1348309 (0.0007) [2023-12-28 04:57:02,937][106226] Updated weights for policy 0, policy_version 1348319 (0.0005) [2023-12-28 04:57:03,265][106225] Updated weights for policy 1, policy_version 1351705 (0.0009) [2023-12-28 04:57:03,321][106225] Updated weights for policy 1, policy_version 1351715 (0.0010) [2023-12-28 04:57:03,362][106225] Updated weights for policy 1, policy_version 1351725 (0.0006) [2023-12-28 04:57:03,414][106225] Updated weights for policy 1, policy_version 1351735 (0.0005) [2023-12-28 04:57:03,529][106226] Updated weights for policy 0, policy_version 1348329 (0.0008) [2023-12-28 04:57:03,582][106226] Updated weights for policy 0, policy_version 1348339 (0.0007) [2023-12-28 04:57:03,640][106226] Updated weights for policy 0, policy_version 1348349 (0.0005) [2023-12-28 04:57:04,081][106225] Updated weights for policy 1, policy_version 1351745 (0.0010) [2023-12-28 04:57:04,147][106225] Updated weights for policy 1, policy_version 1351755 (0.0011) [2023-12-28 04:57:04,213][106225] Updated weights for policy 1, policy_version 1351765 (0.0011) [2023-12-28 04:57:04,278][106226] Updated weights for policy 0, policy_version 1348359 (0.0008) [2023-12-28 04:57:04,340][106226] Updated weights for policy 0, policy_version 1348369 (0.0008) [2023-12-28 04:57:04,406][106226] Updated weights for policy 0, policy_version 1348379 (0.0008) [2023-12-28 04:57:04,957][106225] Updated weights for policy 1, policy_version 1351775 (0.0010) [2023-12-28 04:57:05,016][106225] Updated weights for policy 1, policy_version 1351785 (0.0009) [2023-12-28 04:57:05,033][106226] Updated weights for policy 0, policy_version 1348389 (0.0008) [2023-12-28 04:57:05,082][106225] Updated weights for policy 1, policy_version 1351795 (0.0006) [2023-12-28 04:57:05,102][106226] Updated weights for policy 0, policy_version 1348399 (0.0005) [2023-12-28 04:57:05,159][106226] Updated weights for policy 0, policy_version 1348409 (0.0005) [2023-12-28 04:57:05,655][106225] Updated weights for policy 1, policy_version 1351805 (0.0008) [2023-12-28 04:57:05,709][106225] Updated weights for policy 1, policy_version 1351815 (0.0010) [2023-12-28 04:57:05,715][106226] Updated weights for policy 0, policy_version 1348419 (0.0007) [2023-12-28 04:57:05,770][106225] Updated weights for policy 1, policy_version 1351825 (0.0005) [2023-12-28 04:57:05,781][106226] Updated weights for policy 0, policy_version 1348429 (0.0009) [2023-12-28 04:57:05,839][106226] Updated weights for policy 0, policy_version 1348439 (0.0009) [2023-12-28 04:57:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 691388416. Throughput: 0: 10058.8, 1: 9867.5. Samples: 691395884. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:06,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.531')] [2023-12-28 04:57:06,410][106225] Updated weights for policy 1, policy_version 1351835 (0.0008) [2023-12-28 04:57:06,472][106225] Updated weights for policy 1, policy_version 1351845 (0.0008) [2023-12-28 04:57:06,536][106225] Updated weights for policy 1, policy_version 1351855 (0.0007) [2023-12-28 04:57:06,613][106226] Updated weights for policy 0, policy_version 1348449 (0.0009) [2023-12-28 04:57:06,671][106226] Updated weights for policy 0, policy_version 1348459 (0.0009) [2023-12-28 04:57:06,731][106226] Updated weights for policy 0, policy_version 1348469 (0.0007) [2023-12-28 04:57:06,790][106226] Updated weights for policy 0, policy_version 1348479 (0.0009) [2023-12-28 04:57:07,132][106225] Updated weights for policy 1, policy_version 1351865 (0.0006) [2023-12-28 04:57:07,183][106225] Updated weights for policy 1, policy_version 1351875 (0.0010) [2023-12-28 04:57:07,236][106225] Updated weights for policy 1, policy_version 1351885 (0.0010) [2023-12-28 04:57:07,298][106225] Updated weights for policy 1, policy_version 1351895 (0.0010) [2023-12-28 04:57:07,568][106226] Updated weights for policy 0, policy_version 1348489 (0.0008) [2023-12-28 04:57:07,627][106226] Updated weights for policy 0, policy_version 1348499 (0.0007) [2023-12-28 04:57:07,680][106226] Updated weights for policy 0, policy_version 1348509 (0.0008) [2023-12-28 04:57:07,965][106225] Updated weights for policy 1, policy_version 1351905 (0.0006) [2023-12-28 04:57:08,029][106225] Updated weights for policy 1, policy_version 1351915 (0.0010) [2023-12-28 04:57:08,085][106225] Updated weights for policy 1, policy_version 1351925 (0.0010) [2023-12-28 04:57:08,425][106226] Updated weights for policy 0, policy_version 1348519 (0.0008) [2023-12-28 04:57:08,480][106226] Updated weights for policy 0, policy_version 1348529 (0.0008) [2023-12-28 04:57:08,544][106226] Updated weights for policy 0, policy_version 1348539 (0.0008) [2023-12-28 04:57:08,726][106225] Updated weights for policy 1, policy_version 1351935 (0.0007) [2023-12-28 04:57:08,796][106225] Updated weights for policy 1, policy_version 1351945 (0.0005) [2023-12-28 04:57:08,864][106225] Updated weights for policy 1, policy_version 1351955 (0.0005) [2023-12-28 04:57:09,274][106226] Updated weights for policy 0, policy_version 1348549 (0.0009) [2023-12-28 04:57:09,343][106226] Updated weights for policy 0, policy_version 1348559 (0.0007) [2023-12-28 04:57:09,420][106226] Updated weights for policy 0, policy_version 1348569 (0.0007) [2023-12-28 04:57:09,493][106225] Updated weights for policy 1, policy_version 1351965 (0.0009) [2023-12-28 04:57:09,548][106225] Updated weights for policy 1, policy_version 1351975 (0.0008) [2023-12-28 04:57:09,610][106225] Updated weights for policy 1, policy_version 1351985 (0.0009) [2023-12-28 04:57:10,153][106226] Updated weights for policy 0, policy_version 1348579 (0.0008) [2023-12-28 04:57:10,223][106226] Updated weights for policy 0, policy_version 1348589 (0.0009) [2023-12-28 04:57:10,290][106226] Updated weights for policy 0, policy_version 1348599 (0.0009) [2023-12-28 04:57:10,365][106225] Updated weights for policy 1, policy_version 1351995 (0.0007) [2023-12-28 04:57:10,425][106225] Updated weights for policy 1, policy_version 1352005 (0.0009) [2023-12-28 04:57:10,491][106225] Updated weights for policy 1, policy_version 1352015 (0.0006) [2023-12-28 04:57:10,890][106226] Updated weights for policy 0, policy_version 1348609 (0.0010) [2023-12-28 04:57:10,951][106226] Updated weights for policy 0, policy_version 1348619 (0.0009) [2023-12-28 04:57:11,016][106226] Updated weights for policy 0, policy_version 1348629 (0.0009) [2023-12-28 04:57:11,086][106226] Updated weights for policy 0, policy_version 1348639 (0.0008) [2023-12-28 04:57:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 691486720. Throughput: 0: 10091.8, 1: 9928.0. Samples: 691455724. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:11,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.808')] [2023-12-28 04:57:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001348640_345317376.pth... [2023-12-28 04:57:11,185][106225] Updated weights for policy 1, policy_version 1352025 (0.0006) [2023-12-28 04:57:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001347456_345014272.pth [2023-12-28 04:57:11,247][106225] Updated weights for policy 1, policy_version 1352035 (0.0008) [2023-12-28 04:57:11,310][106225] Updated weights for policy 1, policy_version 1352045 (0.0009) [2023-12-28 04:57:11,376][106225] Updated weights for policy 1, policy_version 1352055 (0.0008) [2023-12-28 04:57:11,382][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001352056_346177536.pth... [2023-12-28 04:57:11,387][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001350872_345874432.pth [2023-12-28 04:57:11,879][106226] Updated weights for policy 0, policy_version 1348649 (0.0008) [2023-12-28 04:57:11,947][106226] Updated weights for policy 0, policy_version 1348659 (0.0007) [2023-12-28 04:57:12,008][106226] Updated weights for policy 0, policy_version 1348669 (0.0009) [2023-12-28 04:57:12,188][106225] Updated weights for policy 1, policy_version 1352065 (0.0008) [2023-12-28 04:57:12,250][106225] Updated weights for policy 1, policy_version 1352075 (0.0006) [2023-12-28 04:57:12,311][106225] Updated weights for policy 1, policy_version 1352085 (0.0007) [2023-12-28 04:57:12,733][106226] Updated weights for policy 0, policy_version 1348679 (0.0007) [2023-12-28 04:57:12,788][106226] Updated weights for policy 0, policy_version 1348689 (0.0008) [2023-12-28 04:57:12,852][106226] Updated weights for policy 0, policy_version 1348699 (0.0009) [2023-12-28 04:57:13,031][106225] Updated weights for policy 1, policy_version 1352095 (0.0009) [2023-12-28 04:57:13,083][106225] Updated weights for policy 1, policy_version 1352105 (0.0006) [2023-12-28 04:57:13,131][106225] Updated weights for policy 1, policy_version 1352115 (0.0005) [2023-12-28 04:57:13,495][106226] Updated weights for policy 0, policy_version 1348709 (0.0010) [2023-12-28 04:57:13,555][106226] Updated weights for policy 0, policy_version 1348719 (0.0008) [2023-12-28 04:57:13,615][106226] Updated weights for policy 0, policy_version 1348729 (0.0007) [2023-12-28 04:57:13,774][106225] Updated weights for policy 1, policy_version 1352125 (0.0008) [2023-12-28 04:57:13,834][106225] Updated weights for policy 1, policy_version 1352135 (0.0010) [2023-12-28 04:57:13,883][106225] Updated weights for policy 1, policy_version 1352145 (0.0010) [2023-12-28 04:57:14,271][106226] Updated weights for policy 0, policy_version 1348739 (0.0010) [2023-12-28 04:57:14,331][106226] Updated weights for policy 0, policy_version 1348749 (0.0010) [2023-12-28 04:57:14,384][106226] Updated weights for policy 0, policy_version 1348759 (0.0010) [2023-12-28 04:57:14,609][106225] Updated weights for policy 1, policy_version 1352155 (0.0009) [2023-12-28 04:57:14,678][106225] Updated weights for policy 1, policy_version 1352165 (0.0007) [2023-12-28 04:57:14,742][106225] Updated weights for policy 1, policy_version 1352175 (0.0009) [2023-12-28 04:57:15,033][106226] Updated weights for policy 0, policy_version 1348769 (0.0006) [2023-12-28 04:57:15,091][106226] Updated weights for policy 0, policy_version 1348779 (0.0010) [2023-12-28 04:57:15,154][106226] Updated weights for policy 0, policy_version 1348789 (0.0010) [2023-12-28 04:57:15,209][106226] Updated weights for policy 0, policy_version 1348799 (0.0011) [2023-12-28 04:57:15,471][106225] Updated weights for policy 1, policy_version 1352185 (0.0008) [2023-12-28 04:57:15,525][106225] Updated weights for policy 1, policy_version 1352195 (0.0005) [2023-12-28 04:57:15,586][106225] Updated weights for policy 1, policy_version 1352205 (0.0005) [2023-12-28 04:57:15,640][106225] Updated weights for policy 1, policy_version 1352215 (0.0005) [2023-12-28 04:57:15,899][106226] Updated weights for policy 0, policy_version 1348809 (0.0011) [2023-12-28 04:57:15,955][106226] Updated weights for policy 0, policy_version 1348819 (0.0010) [2023-12-28 04:57:16,015][106226] Updated weights for policy 0, policy_version 1348829 (0.0011) [2023-12-28 04:57:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 691585024. Throughput: 0: 10103.4, 1: 9860.3. Samples: 691573524. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:16,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.515')] [2023-12-28 04:57:16,288][106225] Updated weights for policy 1, policy_version 1352225 (0.0008) [2023-12-28 04:57:16,350][106225] Updated weights for policy 1, policy_version 1352235 (0.0008) [2023-12-28 04:57:16,414][106225] Updated weights for policy 1, policy_version 1352245 (0.0008) [2023-12-28 04:57:16,685][106226] Updated weights for policy 0, policy_version 1348839 (0.0009) [2023-12-28 04:57:16,749][106226] Updated weights for policy 0, policy_version 1348849 (0.0007) [2023-12-28 04:57:16,807][106226] Updated weights for policy 0, policy_version 1348859 (0.0005) [2023-12-28 04:57:17,213][106225] Updated weights for policy 1, policy_version 1352255 (0.0009) [2023-12-28 04:57:17,275][106225] Updated weights for policy 1, policy_version 1352265 (0.0009) [2023-12-28 04:57:17,330][106225] Updated weights for policy 1, policy_version 1352275 (0.0009) [2023-12-28 04:57:17,414][106226] Updated weights for policy 0, policy_version 1348869 (0.0006) [2023-12-28 04:57:17,468][106226] Updated weights for policy 0, policy_version 1348879 (0.0005) [2023-12-28 04:57:17,524][106226] Updated weights for policy 0, policy_version 1348889 (0.0006) [2023-12-28 04:57:18,099][106226] Updated weights for policy 0, policy_version 1348899 (0.0009) [2023-12-28 04:57:18,112][106225] Updated weights for policy 1, policy_version 1352285 (0.0008) [2023-12-28 04:57:18,153][106226] Updated weights for policy 0, policy_version 1348909 (0.0005) [2023-12-28 04:57:18,171][106225] Updated weights for policy 1, policy_version 1352295 (0.0006) [2023-12-28 04:57:18,215][106226] Updated weights for policy 0, policy_version 1348919 (0.0005) [2023-12-28 04:57:18,233][106225] Updated weights for policy 1, policy_version 1352305 (0.0005) [2023-12-28 04:57:18,855][106226] Updated weights for policy 0, policy_version 1348929 (0.0006) [2023-12-28 04:57:18,915][106226] Updated weights for policy 0, policy_version 1348939 (0.0006) [2023-12-28 04:57:18,942][106225] Updated weights for policy 1, policy_version 1352315 (0.0006) [2023-12-28 04:57:18,966][106226] Updated weights for policy 0, policy_version 1348949 (0.0006) [2023-12-28 04:57:18,999][106225] Updated weights for policy 1, policy_version 1352325 (0.0009) [2023-12-28 04:57:19,016][106226] Updated weights for policy 0, policy_version 1348959 (0.0006) [2023-12-28 04:57:19,056][106225] Updated weights for policy 1, policy_version 1352335 (0.0009) [2023-12-28 04:57:19,705][106226] Updated weights for policy 0, policy_version 1348969 (0.0006) [2023-12-28 04:57:19,777][106226] Updated weights for policy 0, policy_version 1348979 (0.0006) [2023-12-28 04:57:19,851][106226] Updated weights for policy 0, policy_version 1348989 (0.0007) [2023-12-28 04:57:19,886][106225] Updated weights for policy 1, policy_version 1352345 (0.0009) [2023-12-28 04:57:19,956][106225] Updated weights for policy 1, policy_version 1352355 (0.0009) [2023-12-28 04:57:20,022][106225] Updated weights for policy 1, policy_version 1352365 (0.0009) [2023-12-28 04:57:20,092][106225] Updated weights for policy 1, policy_version 1352375 (0.0009) [2023-12-28 04:57:20,584][106226] Updated weights for policy 0, policy_version 1348999 (0.0009) [2023-12-28 04:57:20,647][106226] Updated weights for policy 0, policy_version 1349009 (0.0009) [2023-12-28 04:57:20,704][106226] Updated weights for policy 0, policy_version 1349019 (0.0008) [2023-12-28 04:57:20,852][106225] Updated weights for policy 1, policy_version 1352385 (0.0009) [2023-12-28 04:57:20,907][106225] Updated weights for policy 1, policy_version 1352395 (0.0008) [2023-12-28 04:57:20,963][106225] Updated weights for policy 1, policy_version 1352405 (0.0008) [2023-12-28 04:57:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 691683328. Throughput: 0: 10132.6, 1: 9789.2. Samples: 691690936. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:21,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.467')] [2023-12-28 04:57:21,518][106226] Updated weights for policy 0, policy_version 1349029 (0.0008) [2023-12-28 04:57:21,582][106226] Updated weights for policy 0, policy_version 1349039 (0.0009) [2023-12-28 04:57:21,645][106226] Updated weights for policy 0, policy_version 1349049 (0.0008) [2023-12-28 04:57:21,675][106225] Updated weights for policy 1, policy_version 1352415 (0.0009) [2023-12-28 04:57:21,742][106225] Updated weights for policy 1, policy_version 1352425 (0.0008) [2023-12-28 04:57:21,808][106225] Updated weights for policy 1, policy_version 1352435 (0.0008) [2023-12-28 04:57:22,414][106226] Updated weights for policy 0, policy_version 1349059 (0.0007) [2023-12-28 04:57:22,475][106226] Updated weights for policy 0, policy_version 1349069 (0.0006) [2023-12-28 04:57:22,532][106226] Updated weights for policy 0, policy_version 1349079 (0.0009) [2023-12-28 04:57:22,557][106225] Updated weights for policy 1, policy_version 1352445 (0.0009) [2023-12-28 04:57:22,608][106225] Updated weights for policy 1, policy_version 1352455 (0.0007) [2023-12-28 04:57:22,670][106225] Updated weights for policy 1, policy_version 1352465 (0.0010) [2023-12-28 04:57:23,244][106226] Updated weights for policy 0, policy_version 1349089 (0.0006) [2023-12-28 04:57:23,300][106226] Updated weights for policy 0, policy_version 1349099 (0.0005) [2023-12-28 04:57:23,348][106226] Updated weights for policy 0, policy_version 1349109 (0.0005) [2023-12-28 04:57:23,387][106225] Updated weights for policy 1, policy_version 1352475 (0.0008) [2023-12-28 04:57:23,411][106226] Updated weights for policy 0, policy_version 1349119 (0.0006) [2023-12-28 04:57:23,448][106225] Updated weights for policy 1, policy_version 1352485 (0.0005) [2023-12-28 04:57:23,506][106225] Updated weights for policy 1, policy_version 1352495 (0.0005) [2023-12-28 04:57:24,033][106226] Updated weights for policy 0, policy_version 1349129 (0.0005) [2023-12-28 04:57:24,046][106225] Updated weights for policy 1, policy_version 1352505 (0.0006) [2023-12-28 04:57:24,095][106225] Updated weights for policy 1, policy_version 1352515 (0.0008) [2023-12-28 04:57:24,098][106226] Updated weights for policy 0, policy_version 1349139 (0.0005) [2023-12-28 04:57:24,149][106225] Updated weights for policy 1, policy_version 1352525 (0.0008) [2023-12-28 04:57:24,152][106226] Updated weights for policy 0, policy_version 1349149 (0.0005) [2023-12-28 04:57:24,212][106225] Updated weights for policy 1, policy_version 1352535 (0.0009) [2023-12-28 04:57:24,810][106226] Updated weights for policy 0, policy_version 1349159 (0.0008) [2023-12-28 04:57:24,869][106226] Updated weights for policy 0, policy_version 1349169 (0.0008) [2023-12-28 04:57:24,925][106226] Updated weights for policy 0, policy_version 1349179 (0.0007) [2023-12-28 04:57:24,952][106225] Updated weights for policy 1, policy_version 1352545 (0.0008) [2023-12-28 04:57:25,016][106225] Updated weights for policy 1, policy_version 1352555 (0.0008) [2023-12-28 04:57:25,076][106225] Updated weights for policy 1, policy_version 1352565 (0.0007) [2023-12-28 04:57:25,617][106226] Updated weights for policy 0, policy_version 1349189 (0.0009) [2023-12-28 04:57:25,679][106226] Updated weights for policy 0, policy_version 1349199 (0.0008) [2023-12-28 04:57:25,739][106226] Updated weights for policy 0, policy_version 1349209 (0.0008) [2023-12-28 04:57:25,798][106225] Updated weights for policy 1, policy_version 1352575 (0.0010) [2023-12-28 04:57:25,858][106225] Updated weights for policy 1, policy_version 1352585 (0.0010) [2023-12-28 04:57:25,913][106225] Updated weights for policy 1, policy_version 1352595 (0.0006) [2023-12-28 04:57:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 691781632. Throughput: 0: 10046.8, 1: 9810.4. Samples: 691749796. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:26,175][105115] Avg episode reward: [(0, '-5.095'), (1, '-4.460')] [2023-12-28 04:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001349216_345464832.pth... [2023-12-28 04:57:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001352600_346316800.pth... [2023-12-28 04:57:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001348032_345161728.pth [2023-12-28 04:57:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001351448_346021888.pth [2023-12-28 04:57:26,454][106226] Updated weights for policy 0, policy_version 1349219 (0.0008) [2023-12-28 04:57:26,473][106225] Updated weights for policy 1, policy_version 1352605 (0.0005) [2023-12-28 04:57:26,504][106226] Updated weights for policy 0, policy_version 1349229 (0.0008) [2023-12-28 04:57:26,532][106225] Updated weights for policy 1, policy_version 1352615 (0.0007) [2023-12-28 04:57:26,568][106226] Updated weights for policy 0, policy_version 1349239 (0.0005) [2023-12-28 04:57:26,589][106225] Updated weights for policy 1, policy_version 1352625 (0.0007) [2023-12-28 04:57:27,117][106226] Updated weights for policy 0, policy_version 1349249 (0.0006) [2023-12-28 04:57:27,177][106226] Updated weights for policy 0, policy_version 1349259 (0.0010) [2023-12-28 04:57:27,191][106225] Updated weights for policy 1, policy_version 1352635 (0.0007) [2023-12-28 04:57:27,238][106226] Updated weights for policy 0, policy_version 1349269 (0.0007) [2023-12-28 04:57:27,248][106225] Updated weights for policy 1, policy_version 1352645 (0.0008) [2023-12-28 04:57:27,298][106226] Updated weights for policy 0, policy_version 1349279 (0.0006) [2023-12-28 04:57:27,309][106225] Updated weights for policy 1, policy_version 1352655 (0.0008) [2023-12-28 04:57:27,814][106226] Updated weights for policy 0, policy_version 1349289 (0.0005) [2023-12-28 04:57:27,872][106226] Updated weights for policy 0, policy_version 1349299 (0.0005) [2023-12-28 04:57:27,886][106225] Updated weights for policy 1, policy_version 1352665 (0.0006) [2023-12-28 04:57:27,922][106226] Updated weights for policy 0, policy_version 1349309 (0.0006) [2023-12-28 04:57:27,940][106225] Updated weights for policy 1, policy_version 1352675 (0.0006) [2023-12-28 04:57:27,991][106225] Updated weights for policy 1, policy_version 1352685 (0.0005) [2023-12-28 04:57:28,040][106225] Updated weights for policy 1, policy_version 1352695 (0.0007) [2023-12-28 04:57:28,633][106225] Updated weights for policy 1, policy_version 1352705 (0.0007) [2023-12-28 04:57:28,671][106226] Updated weights for policy 0, policy_version 1349319 (0.0007) [2023-12-28 04:57:28,689][106225] Updated weights for policy 1, policy_version 1352715 (0.0007) [2023-12-28 04:57:28,728][106226] Updated weights for policy 0, policy_version 1349329 (0.0008) [2023-12-28 04:57:28,746][106225] Updated weights for policy 1, policy_version 1352725 (0.0006) [2023-12-28 04:57:28,778][106226] Updated weights for policy 0, policy_version 1349339 (0.0008) [2023-12-28 04:57:29,387][106225] Updated weights for policy 1, policy_version 1352735 (0.0008) [2023-12-28 04:57:29,456][106225] Updated weights for policy 1, policy_version 1352745 (0.0008) [2023-12-28 04:57:29,485][106226] Updated weights for policy 0, policy_version 1349349 (0.0007) [2023-12-28 04:57:29,520][106225] Updated weights for policy 1, policy_version 1352755 (0.0008) [2023-12-28 04:57:29,542][106226] Updated weights for policy 0, policy_version 1349359 (0.0005) [2023-12-28 04:57:29,600][106226] Updated weights for policy 0, policy_version 1349369 (0.0005) [2023-12-28 04:57:30,248][106225] Updated weights for policy 1, policy_version 1352765 (0.0008) [2023-12-28 04:57:30,266][106226] Updated weights for policy 0, policy_version 1349379 (0.0006) [2023-12-28 04:57:30,308][106225] Updated weights for policy 1, policy_version 1352775 (0.0007) [2023-12-28 04:57:30,322][106226] Updated weights for policy 0, policy_version 1349389 (0.0007) [2023-12-28 04:57:30,367][106225] Updated weights for policy 1, policy_version 1352785 (0.0006) [2023-12-28 04:57:30,387][106226] Updated weights for policy 0, policy_version 1349399 (0.0007) [2023-12-28 04:57:31,000][106226] Updated weights for policy 0, policy_version 1349409 (0.0007) [2023-12-28 04:57:31,066][106225] Updated weights for policy 1, policy_version 1352795 (0.0008) [2023-12-28 04:57:31,070][106226] Updated weights for policy 0, policy_version 1349419 (0.0007) [2023-12-28 04:57:31,129][106225] Updated weights for policy 1, policy_version 1352805 (0.0011) [2023-12-28 04:57:31,129][106226] Updated weights for policy 0, policy_version 1349429 (0.0007) [2023-12-28 04:57:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 691879936. Throughput: 0: 10156.2, 1: 9972.7. Samples: 691877236. Policy #0 lag: (min: 30.0, avg: 37.8, max: 62.0) [2023-12-28 04:57:31,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.465')] [2023-12-28 04:57:31,185][106226] Updated weights for policy 0, policy_version 1349439 (0.0008) [2023-12-28 04:57:31,195][106225] Updated weights for policy 1, policy_version 1352815 (0.0009) [2023-12-28 04:57:31,834][106226] Updated weights for policy 0, policy_version 1349449 (0.0006) [2023-12-28 04:57:31,888][106226] Updated weights for policy 0, policy_version 1349459 (0.0008) [2023-12-28 04:57:31,940][106226] Updated weights for policy 0, policy_version 1349469 (0.0008) [2023-12-28 04:57:31,987][106225] Updated weights for policy 1, policy_version 1352825 (0.0008) [2023-12-28 04:57:32,040][106225] Updated weights for policy 1, policy_version 1352835 (0.0008) [2023-12-28 04:57:32,093][106225] Updated weights for policy 1, policy_version 1352845 (0.0008) [2023-12-28 04:57:32,162][106225] Updated weights for policy 1, policy_version 1352855 (0.0007) [2023-12-28 04:57:32,656][106226] Updated weights for policy 0, policy_version 1349479 (0.0010) [2023-12-28 04:57:32,710][106226] Updated weights for policy 0, policy_version 1349489 (0.0011) [2023-12-28 04:57:32,766][106226] Updated weights for policy 0, policy_version 1349499 (0.0010) [2023-12-28 04:57:32,871][106225] Updated weights for policy 1, policy_version 1352865 (0.0010) [2023-12-28 04:57:32,935][106225] Updated weights for policy 1, policy_version 1352875 (0.0010) [2023-12-28 04:57:33,001][106225] Updated weights for policy 1, policy_version 1352885 (0.0005) [2023-12-28 04:57:33,361][106226] Updated weights for policy 0, policy_version 1349509 (0.0008) [2023-12-28 04:57:33,409][106226] Updated weights for policy 0, policy_version 1349519 (0.0005) [2023-12-28 04:57:33,458][106226] Updated weights for policy 0, policy_version 1349529 (0.0008) [2023-12-28 04:57:33,597][106225] Updated weights for policy 1, policy_version 1352895 (0.0005) [2023-12-28 04:57:33,657][106225] Updated weights for policy 1, policy_version 1352905 (0.0006) [2023-12-28 04:57:33,714][106225] Updated weights for policy 1, policy_version 1352915 (0.0010) [2023-12-28 04:57:34,021][106226] Updated weights for policy 0, policy_version 1349539 (0.0009) [2023-12-28 04:57:34,079][106226] Updated weights for policy 0, policy_version 1349549 (0.0008) [2023-12-28 04:57:34,144][106226] Updated weights for policy 0, policy_version 1349559 (0.0008) [2023-12-28 04:57:34,435][106225] Updated weights for policy 1, policy_version 1352925 (0.0008) [2023-12-28 04:57:34,494][106225] Updated weights for policy 1, policy_version 1352935 (0.0008) [2023-12-28 04:57:34,548][106225] Updated weights for policy 1, policy_version 1352945 (0.0010) [2023-12-28 04:57:34,832][106226] Updated weights for policy 0, policy_version 1349569 (0.0009) [2023-12-28 04:57:34,895][106226] Updated weights for policy 0, policy_version 1349579 (0.0009) [2023-12-28 04:57:34,950][106226] Updated weights for policy 0, policy_version 1349589 (0.0009) [2023-12-28 04:57:35,011][106226] Updated weights for policy 0, policy_version 1349599 (0.0008) [2023-12-28 04:57:35,290][106225] Updated weights for policy 1, policy_version 1352955 (0.0008) [2023-12-28 04:57:35,349][106225] Updated weights for policy 1, policy_version 1352965 (0.0008) [2023-12-28 04:57:35,408][106225] Updated weights for policy 1, policy_version 1352975 (0.0008) [2023-12-28 04:57:35,736][106226] Updated weights for policy 0, policy_version 1349609 (0.0009) [2023-12-28 04:57:35,782][106226] Updated weights for policy 0, policy_version 1349619 (0.0008) [2023-12-28 04:57:35,830][106226] Updated weights for policy 0, policy_version 1349629 (0.0008) [2023-12-28 04:57:36,164][106225] Updated weights for policy 1, policy_version 1352985 (0.0008) [2023-12-28 04:57:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 691986432. Throughput: 0: 10200.6, 1: 9976.3. Samples: 691998120. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:57:36,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.637')] [2023-12-28 04:57:36,222][106225] Updated weights for policy 1, policy_version 1352995 (0.0009) [2023-12-28 04:57:36,283][106225] Updated weights for policy 1, policy_version 1353005 (0.0010) [2023-12-28 04:57:36,345][106225] Updated weights for policy 1, policy_version 1353015 (0.0009) [2023-12-28 04:57:36,509][106226] Updated weights for policy 0, policy_version 1349639 (0.0007) [2023-12-28 04:57:36,576][106226] Updated weights for policy 0, policy_version 1349649 (0.0007) [2023-12-28 04:57:36,642][106226] Updated weights for policy 0, policy_version 1349659 (0.0009) [2023-12-28 04:57:37,141][106225] Updated weights for policy 1, policy_version 1353025 (0.0009) [2023-12-28 04:57:37,193][106225] Updated weights for policy 1, policy_version 1353035 (0.0006) [2023-12-28 04:57:37,261][106225] Updated weights for policy 1, policy_version 1353045 (0.0007) [2023-12-28 04:57:37,284][106226] Updated weights for policy 0, policy_version 1349669 (0.0010) [2023-12-28 04:57:37,346][106226] Updated weights for policy 0, policy_version 1349679 (0.0006) [2023-12-28 04:57:37,416][106226] Updated weights for policy 0, policy_version 1349689 (0.0006) [2023-12-28 04:57:37,951][106225] Updated weights for policy 1, policy_version 1353055 (0.0009) [2023-12-28 04:57:38,015][106225] Updated weights for policy 1, policy_version 1353065 (0.0007) [2023-12-28 04:57:38,045][106226] Updated weights for policy 0, policy_version 1349699 (0.0005) [2023-12-28 04:57:38,077][106225] Updated weights for policy 1, policy_version 1353075 (0.0007) [2023-12-28 04:57:38,112][106226] Updated weights for policy 0, policy_version 1349709 (0.0007) [2023-12-28 04:57:38,177][106226] Updated weights for policy 0, policy_version 1349719 (0.0010) [2023-12-28 04:57:38,786][106225] Updated weights for policy 1, policy_version 1353085 (0.0006) [2023-12-28 04:57:38,849][106225] Updated weights for policy 1, policy_version 1353095 (0.0005) [2023-12-28 04:57:38,879][106226] Updated weights for policy 0, policy_version 1349729 (0.0011) [2023-12-28 04:57:38,914][106225] Updated weights for policy 1, policy_version 1353105 (0.0007) [2023-12-28 04:57:38,943][106226] Updated weights for policy 0, policy_version 1349739 (0.0010) [2023-12-28 04:57:38,989][106226] Updated weights for policy 0, policy_version 1349749 (0.0010) [2023-12-28 04:57:39,035][106226] Updated weights for policy 0, policy_version 1349759 (0.0010) [2023-12-28 04:57:39,590][106225] Updated weights for policy 1, policy_version 1353115 (0.0007) [2023-12-28 04:57:39,645][106225] Updated weights for policy 1, policy_version 1353125 (0.0008) [2023-12-28 04:57:39,703][106225] Updated weights for policy 1, policy_version 1353135 (0.0008) [2023-12-28 04:57:39,820][106226] Updated weights for policy 0, policy_version 1349769 (0.0008) [2023-12-28 04:57:39,891][106226] Updated weights for policy 0, policy_version 1349779 (0.0009) [2023-12-28 04:57:39,955][106226] Updated weights for policy 0, policy_version 1349789 (0.0010) [2023-12-28 04:57:40,379][106225] Updated weights for policy 1, policy_version 1353145 (0.0008) [2023-12-28 04:57:40,443][106225] Updated weights for policy 1, policy_version 1353155 (0.0009) [2023-12-28 04:57:40,506][106225] Updated weights for policy 1, policy_version 1353165 (0.0007) [2023-12-28 04:57:40,567][106225] Updated weights for policy 1, policy_version 1353175 (0.0009) [2023-12-28 04:57:40,727][106226] Updated weights for policy 0, policy_version 1349799 (0.0008) [2023-12-28 04:57:40,782][106226] Updated weights for policy 0, policy_version 1349809 (0.0009) [2023-12-28 04:57:40,834][106226] Updated weights for policy 0, policy_version 1349819 (0.0008) [2023-12-28 04:57:41,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 692084736. Throughput: 0: 10208.7, 1: 9947.1. Samples: 692057572. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:57:41,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.343')] [2023-12-28 04:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001349824_345620480.pth... [2023-12-28 04:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001353176_346464256.pth... [2023-12-28 04:57:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001352056_346177536.pth [2023-12-28 04:57:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001348640_345317376.pth [2023-12-28 04:57:41,333][106225] Updated weights for policy 1, policy_version 1353185 (0.0008) [2023-12-28 04:57:41,410][106225] Updated weights for policy 1, policy_version 1353195 (0.0008) [2023-12-28 04:57:41,472][106225] Updated weights for policy 1, policy_version 1353205 (0.0008) [2023-12-28 04:57:41,602][106226] Updated weights for policy 0, policy_version 1349829 (0.0009) [2023-12-28 04:57:41,675][106226] Updated weights for policy 0, policy_version 1349839 (0.0008) [2023-12-28 04:57:41,743][106226] Updated weights for policy 0, policy_version 1349849 (0.0008) [2023-12-28 04:57:42,239][106225] Updated weights for policy 1, policy_version 1353215 (0.0006) [2023-12-28 04:57:42,306][106225] Updated weights for policy 1, policy_version 1353225 (0.0008) [2023-12-28 04:57:42,378][106225] Updated weights for policy 1, policy_version 1353235 (0.0008) [2023-12-28 04:57:42,486][106226] Updated weights for policy 0, policy_version 1349859 (0.0008) [2023-12-28 04:57:42,546][106226] Updated weights for policy 0, policy_version 1349869 (0.0008) [2023-12-28 04:57:42,608][106226] Updated weights for policy 0, policy_version 1349879 (0.0008) [2023-12-28 04:57:43,058][106225] Updated weights for policy 1, policy_version 1353245 (0.0007) [2023-12-28 04:57:43,108][106225] Updated weights for policy 1, policy_version 1353255 (0.0008) [2023-12-28 04:57:43,163][106225] Updated weights for policy 1, policy_version 1353265 (0.0008) [2023-12-28 04:57:43,342][106226] Updated weights for policy 0, policy_version 1349889 (0.0008) [2023-12-28 04:57:43,415][106226] Updated weights for policy 0, policy_version 1349899 (0.0007) [2023-12-28 04:57:43,476][106226] Updated weights for policy 0, policy_version 1349909 (0.0005) [2023-12-28 04:57:43,535][106226] Updated weights for policy 0, policy_version 1349919 (0.0007) [2023-12-28 04:57:43,789][106225] Updated weights for policy 1, policy_version 1353275 (0.0009) [2023-12-28 04:57:43,834][106225] Updated weights for policy 1, policy_version 1353285 (0.0006) [2023-12-28 04:57:43,894][106225] Updated weights for policy 1, policy_version 1353295 (0.0005) [2023-12-28 04:57:44,202][106226] Updated weights for policy 0, policy_version 1349929 (0.0006) [2023-12-28 04:57:44,264][106226] Updated weights for policy 0, policy_version 1349939 (0.0008) [2023-12-28 04:57:44,328][106226] Updated weights for policy 0, policy_version 1349949 (0.0009) [2023-12-28 04:57:44,522][106225] Updated weights for policy 1, policy_version 1353305 (0.0005) [2023-12-28 04:57:44,583][106225] Updated weights for policy 1, policy_version 1353315 (0.0009) [2023-12-28 04:57:44,636][106225] Updated weights for policy 1, policy_version 1353325 (0.0009) [2023-12-28 04:57:44,698][106225] Updated weights for policy 1, policy_version 1353335 (0.0008) [2023-12-28 04:57:44,979][106226] Updated weights for policy 0, policy_version 1349959 (0.0008) [2023-12-28 04:57:45,041][106226] Updated weights for policy 0, policy_version 1349969 (0.0008) [2023-12-28 04:57:45,108][106226] Updated weights for policy 0, policy_version 1349979 (0.0008) [2023-12-28 04:57:45,445][106225] Updated weights for policy 1, policy_version 1353345 (0.0008) [2023-12-28 04:57:45,501][106225] Updated weights for policy 1, policy_version 1353355 (0.0008) [2023-12-28 04:57:45,559][106225] Updated weights for policy 1, policy_version 1353365 (0.0009) [2023-12-28 04:57:45,749][106226] Updated weights for policy 0, policy_version 1349989 (0.0007) [2023-12-28 04:57:45,802][106226] Updated weights for policy 0, policy_version 1349999 (0.0006) [2023-12-28 04:57:45,857][106226] Updated weights for policy 0, policy_version 1350009 (0.0006) [2023-12-28 04:57:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 692183040. Throughput: 0: 10116.0, 1: 9882.0. Samples: 692172292. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:57:46,175][105115] Avg episode reward: [(0, '-5.006'), (1, '-4.657')] [2023-12-28 04:57:46,270][106225] Updated weights for policy 1, policy_version 1353375 (0.0008) [2023-12-28 04:57:46,315][106225] Updated weights for policy 1, policy_version 1353385 (0.0008) [2023-12-28 04:57:46,365][106225] Updated weights for policy 1, policy_version 1353395 (0.0008) [2023-12-28 04:57:46,505][106226] Updated weights for policy 0, policy_version 1350019 (0.0008) [2023-12-28 04:57:46,574][106226] Updated weights for policy 0, policy_version 1350029 (0.0008) [2023-12-28 04:57:46,640][106226] Updated weights for policy 0, policy_version 1350039 (0.0008) [2023-12-28 04:57:47,186][106225] Updated weights for policy 1, policy_version 1353405 (0.0010) [2023-12-28 04:57:47,245][106225] Updated weights for policy 1, policy_version 1353415 (0.0010) [2023-12-28 04:57:47,300][106225] Updated weights for policy 1, policy_version 1353425 (0.0008) [2023-12-28 04:57:47,359][106226] Updated weights for policy 0, policy_version 1350049 (0.0008) [2023-12-28 04:57:47,406][106226] Updated weights for policy 0, policy_version 1350059 (0.0008) [2023-12-28 04:57:47,459][106226] Updated weights for policy 0, policy_version 1350069 (0.0006) [2023-12-28 04:57:47,506][106226] Updated weights for policy 0, policy_version 1350079 (0.0007) [2023-12-28 04:57:48,064][106225] Updated weights for policy 1, policy_version 1353435 (0.0008) [2023-12-28 04:57:48,094][106226] Updated weights for policy 0, policy_version 1350089 (0.0005) [2023-12-28 04:57:48,111][106225] Updated weights for policy 1, policy_version 1353445 (0.0007) [2023-12-28 04:57:48,148][106226] Updated weights for policy 0, policy_version 1350099 (0.0006) [2023-12-28 04:57:48,160][106225] Updated weights for policy 1, policy_version 1353455 (0.0005) [2023-12-28 04:57:48,198][106226] Updated weights for policy 0, policy_version 1350109 (0.0008) [2023-12-28 04:57:48,833][106225] Updated weights for policy 1, policy_version 1353465 (0.0005) [2023-12-28 04:57:48,894][106225] Updated weights for policy 1, policy_version 1353475 (0.0005) [2023-12-28 04:57:48,911][106226] Updated weights for policy 0, policy_version 1350119 (0.0008) [2023-12-28 04:57:48,942][106225] Updated weights for policy 1, policy_version 1353485 (0.0005) [2023-12-28 04:57:48,970][106226] Updated weights for policy 0, policy_version 1350129 (0.0008) [2023-12-28 04:57:48,994][106225] Updated weights for policy 1, policy_version 1353495 (0.0007) [2023-12-28 04:57:49,026][106226] Updated weights for policy 0, policy_version 1350139 (0.0007) [2023-12-28 04:57:49,684][106225] Updated weights for policy 1, policy_version 1353505 (0.0008) [2023-12-28 04:57:49,730][106225] Updated weights for policy 1, policy_version 1353515 (0.0007) [2023-12-28 04:57:49,745][106226] Updated weights for policy 0, policy_version 1350149 (0.0007) [2023-12-28 04:57:49,790][106225] Updated weights for policy 1, policy_version 1353525 (0.0006) [2023-12-28 04:57:49,809][106226] Updated weights for policy 0, policy_version 1350159 (0.0006) [2023-12-28 04:57:49,878][106226] Updated weights for policy 0, policy_version 1350169 (0.0008) [2023-12-28 04:57:50,486][106225] Updated weights for policy 1, policy_version 1353535 (0.0008) [2023-12-28 04:57:50,548][106225] Updated weights for policy 1, policy_version 1353545 (0.0008) [2023-12-28 04:57:50,618][106225] Updated weights for policy 1, policy_version 1353555 (0.0009) [2023-12-28 04:57:50,625][106226] Updated weights for policy 0, policy_version 1350179 (0.0006) [2023-12-28 04:57:50,691][106226] Updated weights for policy 0, policy_version 1350189 (0.0008) [2023-12-28 04:57:50,760][106226] Updated weights for policy 0, policy_version 1350199 (0.0009) [2023-12-28 04:57:51,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 692281344. Throughput: 0: 10033.4, 1: 9856.0. Samples: 692290908. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:57:51,175][105115] Avg episode reward: [(0, '-4.979'), (1, '-4.655')] [2023-12-28 04:57:51,390][106225] Updated weights for policy 1, policy_version 1353565 (0.0011) [2023-12-28 04:57:51,444][106226] Updated weights for policy 0, policy_version 1350209 (0.0008) [2023-12-28 04:57:51,449][106225] Updated weights for policy 1, policy_version 1353575 (0.0008) [2023-12-28 04:57:51,503][106226] Updated weights for policy 0, policy_version 1350219 (0.0008) [2023-12-28 04:57:51,506][106225] Updated weights for policy 1, policy_version 1353585 (0.0007) [2023-12-28 04:57:51,562][106226] Updated weights for policy 0, policy_version 1350229 (0.0009) [2023-12-28 04:57:51,629][106226] Updated weights for policy 0, policy_version 1350239 (0.0010) [2023-12-28 04:57:52,248][106225] Updated weights for policy 1, policy_version 1353595 (0.0008) [2023-12-28 04:57:52,312][106225] Updated weights for policy 1, policy_version 1353605 (0.0006) [2023-12-28 04:57:52,335][106226] Updated weights for policy 0, policy_version 1350249 (0.0008) [2023-12-28 04:57:52,380][106225] Updated weights for policy 1, policy_version 1353615 (0.0007) [2023-12-28 04:57:52,409][106226] Updated weights for policy 0, policy_version 1350259 (0.0008) [2023-12-28 04:57:52,482][106226] Updated weights for policy 0, policy_version 1350269 (0.0006) [2023-12-28 04:57:52,980][106225] Updated weights for policy 1, policy_version 1353625 (0.0006) [2023-12-28 04:57:53,050][106225] Updated weights for policy 1, policy_version 1353635 (0.0009) [2023-12-28 04:57:53,108][106225] Updated weights for policy 1, policy_version 1353645 (0.0010) [2023-12-28 04:57:53,166][106225] Updated weights for policy 1, policy_version 1353655 (0.0010) [2023-12-28 04:57:53,176][106226] Updated weights for policy 0, policy_version 1350279 (0.0007) [2023-12-28 04:57:53,235][106226] Updated weights for policy 0, policy_version 1350289 (0.0008) [2023-12-28 04:57:53,295][106226] Updated weights for policy 0, policy_version 1350299 (0.0008) [2023-12-28 04:57:53,850][106225] Updated weights for policy 1, policy_version 1353665 (0.0008) [2023-12-28 04:57:53,898][106225] Updated weights for policy 1, policy_version 1353675 (0.0008) [2023-12-28 04:57:53,966][106225] Updated weights for policy 1, policy_version 1353685 (0.0007) [2023-12-28 04:57:53,983][106226] Updated weights for policy 0, policy_version 1350309 (0.0008) [2023-12-28 04:57:54,041][106226] Updated weights for policy 0, policy_version 1350319 (0.0009) [2023-12-28 04:57:54,092][106226] Updated weights for policy 0, policy_version 1350330 (0.0008) [2023-12-28 04:57:54,575][106225] Updated weights for policy 1, policy_version 1353695 (0.0007) [2023-12-28 04:57:54,631][106225] Updated weights for policy 1, policy_version 1353705 (0.0008) [2023-12-28 04:57:54,687][106225] Updated weights for policy 1, policy_version 1353715 (0.0007) [2023-12-28 04:57:54,876][106226] Updated weights for policy 0, policy_version 1350340 (0.0010) [2023-12-28 04:57:54,939][106226] Updated weights for policy 0, policy_version 1350350 (0.0011) [2023-12-28 04:57:55,000][106226] Updated weights for policy 0, policy_version 1350360 (0.0011) [2023-12-28 04:57:55,389][106225] Updated weights for policy 1, policy_version 1353725 (0.0009) [2023-12-28 04:57:55,440][106225] Updated weights for policy 1, policy_version 1353735 (0.0007) [2023-12-28 04:57:55,491][106225] Updated weights for policy 1, policy_version 1353745 (0.0009) [2023-12-28 04:57:55,572][106226] Updated weights for policy 0, policy_version 1350370 (0.0007) [2023-12-28 04:57:55,629][106226] Updated weights for policy 0, policy_version 1350380 (0.0011) [2023-12-28 04:57:55,678][106226] Updated weights for policy 0, policy_version 1350390 (0.0010) [2023-12-28 04:57:55,735][106226] Updated weights for policy 0, policy_version 1350400 (0.0010) [2023-12-28 04:57:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 692379648. Throughput: 0: 10066.7, 1: 9800.2. Samples: 692349736. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:57:56,176][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.482')] [2023-12-28 04:57:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001350400_345767936.pth... [2023-12-28 04:57:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001349216_345464832.pth [2023-12-28 04:57:56,209][106225] Updated weights for policy 1, policy_version 1353755 (0.0006) [2023-12-28 04:57:56,268][106225] Updated weights for policy 1, policy_version 1353765 (0.0005) [2023-12-28 04:57:56,324][106225] Updated weights for policy 1, policy_version 1353775 (0.0005) [2023-12-28 04:57:56,381][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001353784_346619904.pth... [2023-12-28 04:57:56,393][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001352600_346316800.pth [2023-12-28 04:57:56,407][106226] Updated weights for policy 0, policy_version 1350410 (0.0010) [2023-12-28 04:57:56,464][106226] Updated weights for policy 0, policy_version 1350420 (0.0011) [2023-12-28 04:57:56,521][106226] Updated weights for policy 0, policy_version 1350430 (0.0010) [2023-12-28 04:57:56,909][106225] Updated weights for policy 1, policy_version 1353785 (0.0006) [2023-12-28 04:57:56,951][106225] Updated weights for policy 1, policy_version 1353795 (0.0010) [2023-12-28 04:57:57,019][106225] Updated weights for policy 1, policy_version 1353805 (0.0010) [2023-12-28 04:57:57,085][106225] Updated weights for policy 1, policy_version 1353815 (0.0007) [2023-12-28 04:57:57,198][106226] Updated weights for policy 0, policy_version 1350440 (0.0006) [2023-12-28 04:57:57,270][106226] Updated weights for policy 0, policy_version 1350450 (0.0005) [2023-12-28 04:57:57,331][106226] Updated weights for policy 0, policy_version 1350460 (0.0006) [2023-12-28 04:57:57,628][106225] Updated weights for policy 1, policy_version 1353825 (0.0006) [2023-12-28 04:57:57,690][106225] Updated weights for policy 1, policy_version 1353835 (0.0010) [2023-12-28 04:57:57,755][106225] Updated weights for policy 1, policy_version 1353845 (0.0007) [2023-12-28 04:57:57,951][106226] Updated weights for policy 0, policy_version 1350470 (0.0009) [2023-12-28 04:57:57,997][106226] Updated weights for policy 0, policy_version 1350480 (0.0010) [2023-12-28 04:57:58,046][106226] Updated weights for policy 0, policy_version 1350490 (0.0010) [2023-12-28 04:57:58,461][106225] Updated weights for policy 1, policy_version 1353855 (0.0008) [2023-12-28 04:57:58,528][106225] Updated weights for policy 1, policy_version 1353865 (0.0007) [2023-12-28 04:57:58,589][106225] Updated weights for policy 1, policy_version 1353875 (0.0008) [2023-12-28 04:57:58,794][106226] Updated weights for policy 0, policy_version 1350500 (0.0009) [2023-12-28 04:57:58,873][106226] Updated weights for policy 0, policy_version 1350510 (0.0007) [2023-12-28 04:57:58,931][106226] Updated weights for policy 0, policy_version 1350520 (0.0010) [2023-12-28 04:57:59,442][106225] Updated weights for policy 1, policy_version 1353885 (0.0009) [2023-12-28 04:57:59,500][106225] Updated weights for policy 1, policy_version 1353895 (0.0009) [2023-12-28 04:57:59,551][106225] Updated weights for policy 1, policy_version 1353905 (0.0008) [2023-12-28 04:57:59,635][106226] Updated weights for policy 0, policy_version 1350530 (0.0009) [2023-12-28 04:57:59,686][106226] Updated weights for policy 0, policy_version 1350540 (0.0005) [2023-12-28 04:57:59,745][106226] Updated weights for policy 0, policy_version 1350550 (0.0008) [2023-12-28 04:57:59,806][106226] Updated weights for policy 0, policy_version 1350560 (0.0008) [2023-12-28 04:58:00,295][106225] Updated weights for policy 1, policy_version 1353915 (0.0008) [2023-12-28 04:58:00,356][106225] Updated weights for policy 1, policy_version 1353925 (0.0008) [2023-12-28 04:58:00,411][106225] Updated weights for policy 1, policy_version 1353935 (0.0007) [2023-12-28 04:58:00,505][106226] Updated weights for policy 0, policy_version 1350570 (0.0010) [2023-12-28 04:58:00,564][106226] Updated weights for policy 0, policy_version 1350580 (0.0010) [2023-12-28 04:58:00,625][106226] Updated weights for policy 0, policy_version 1350590 (0.0007) [2023-12-28 04:58:01,123][106225] Updated weights for policy 1, policy_version 1353945 (0.0008) [2023-12-28 04:58:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 692477952. Throughput: 0: 10076.4, 1: 9865.7. Samples: 692470916. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:01,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.678')] [2023-12-28 04:58:01,190][106225] Updated weights for policy 1, policy_version 1353955 (0.0007) [2023-12-28 04:58:01,251][106225] Updated weights for policy 1, policy_version 1353965 (0.0008) [2023-12-28 04:58:01,266][106226] Updated weights for policy 0, policy_version 1350600 (0.0008) [2023-12-28 04:58:01,316][106225] Updated weights for policy 1, policy_version 1353975 (0.0008) [2023-12-28 04:58:01,321][106226] Updated weights for policy 0, policy_version 1350610 (0.0006) [2023-12-28 04:58:01,391][106226] Updated weights for policy 0, policy_version 1350620 (0.0008) [2023-12-28 04:58:02,022][106225] Updated weights for policy 1, policy_version 1353985 (0.0009) [2023-12-28 04:58:02,080][106225] Updated weights for policy 1, policy_version 1353995 (0.0008) [2023-12-28 04:58:02,109][106226] Updated weights for policy 0, policy_version 1350630 (0.0009) [2023-12-28 04:58:02,139][106225] Updated weights for policy 1, policy_version 1354005 (0.0008) [2023-12-28 04:58:02,164][106226] Updated weights for policy 0, policy_version 1350640 (0.0009) [2023-12-28 04:58:02,223][106226] Updated weights for policy 0, policy_version 1350650 (0.0009) [2023-12-28 04:58:02,896][106226] Updated weights for policy 0, policy_version 1350660 (0.0009) [2023-12-28 04:58:02,918][106225] Updated weights for policy 1, policy_version 1354015 (0.0007) [2023-12-28 04:58:02,952][106226] Updated weights for policy 0, policy_version 1350670 (0.0010) [2023-12-28 04:58:02,977][106225] Updated weights for policy 1, policy_version 1354025 (0.0007) [2023-12-28 04:58:03,010][106226] Updated weights for policy 0, policy_version 1350680 (0.0011) [2023-12-28 04:58:03,035][106225] Updated weights for policy 1, policy_version 1354035 (0.0006) [2023-12-28 04:58:03,587][106225] Updated weights for policy 1, policy_version 1354045 (0.0008) [2023-12-28 04:58:03,634][106225] Updated weights for policy 1, policy_version 1354055 (0.0008) [2023-12-28 04:58:03,687][106225] Updated weights for policy 1, policy_version 1354065 (0.0008) [2023-12-28 04:58:03,713][106226] Updated weights for policy 0, policy_version 1350690 (0.0010) [2023-12-28 04:58:03,760][106226] Updated weights for policy 0, policy_version 1350700 (0.0009) [2023-12-28 04:58:03,808][106226] Updated weights for policy 0, policy_version 1350710 (0.0006) [2023-12-28 04:58:03,875][106226] Updated weights for policy 0, policy_version 1350720 (0.0008) [2023-12-28 04:58:04,453][106225] Updated weights for policy 1, policy_version 1354075 (0.0007) [2023-12-28 04:58:04,505][106225] Updated weights for policy 1, policy_version 1354085 (0.0010) [2023-12-28 04:58:04,566][106225] Updated weights for policy 1, policy_version 1354095 (0.0010) [2023-12-28 04:58:04,624][106226] Updated weights for policy 0, policy_version 1350730 (0.0009) [2023-12-28 04:58:04,681][106226] Updated weights for policy 0, policy_version 1350740 (0.0010) [2023-12-28 04:58:04,733][106226] Updated weights for policy 0, policy_version 1350750 (0.0010) [2023-12-28 04:58:05,285][106225] Updated weights for policy 1, policy_version 1354105 (0.0010) [2023-12-28 04:58:05,316][106226] Updated weights for policy 0, policy_version 1350760 (0.0010) [2023-12-28 04:58:05,332][106225] Updated weights for policy 1, policy_version 1354115 (0.0010) [2023-12-28 04:58:05,365][106226] Updated weights for policy 0, policy_version 1350770 (0.0010) [2023-12-28 04:58:05,394][106225] Updated weights for policy 1, policy_version 1354125 (0.0010) [2023-12-28 04:58:05,412][106226] Updated weights for policy 0, policy_version 1350780 (0.0010) [2023-12-28 04:58:05,450][106225] Updated weights for policy 1, policy_version 1354135 (0.0010) [2023-12-28 04:58:06,062][106226] Updated weights for policy 0, policy_version 1350790 (0.0007) [2023-12-28 04:58:06,129][106226] Updated weights for policy 0, policy_version 1350800 (0.0007) [2023-12-28 04:58:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 692576256. Throughput: 0: 10087.4, 1: 9928.9. Samples: 692591672. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:06,175][105115] Avg episode reward: [(0, '-4.843'), (1, '-4.625')] [2023-12-28 04:58:06,196][106226] Updated weights for policy 0, policy_version 1350810 (0.0008) [2023-12-28 04:58:06,221][106225] Updated weights for policy 1, policy_version 1354145 (0.0008) [2023-12-28 04:58:06,281][106225] Updated weights for policy 1, policy_version 1354155 (0.0005) [2023-12-28 04:58:06,342][106225] Updated weights for policy 1, policy_version 1354165 (0.0008) [2023-12-28 04:58:06,846][106226] Updated weights for policy 0, policy_version 1350820 (0.0007) [2023-12-28 04:58:06,909][106226] Updated weights for policy 0, policy_version 1350830 (0.0006) [2023-12-28 04:58:06,956][106226] Updated weights for policy 0, policy_version 1350840 (0.0008) [2023-12-28 04:58:07,078][106225] Updated weights for policy 1, policy_version 1354175 (0.0008) [2023-12-28 04:58:07,137][106225] Updated weights for policy 1, policy_version 1354185 (0.0008) [2023-12-28 04:58:07,193][106225] Updated weights for policy 1, policy_version 1354195 (0.0008) [2023-12-28 04:58:07,646][106226] Updated weights for policy 0, policy_version 1350850 (0.0008) [2023-12-28 04:58:07,710][106226] Updated weights for policy 0, policy_version 1350860 (0.0009) [2023-12-28 04:58:07,774][106226] Updated weights for policy 0, policy_version 1350870 (0.0007) [2023-12-28 04:58:07,839][106226] Updated weights for policy 0, policy_version 1350880 (0.0007) [2023-12-28 04:58:07,956][106225] Updated weights for policy 1, policy_version 1354205 (0.0009) [2023-12-28 04:58:08,007][106225] Updated weights for policy 1, policy_version 1354215 (0.0006) [2023-12-28 04:58:08,066][106225] Updated weights for policy 1, policy_version 1354225 (0.0006) [2023-12-28 04:58:08,528][106226] Updated weights for policy 0, policy_version 1350890 (0.0010) [2023-12-28 04:58:08,589][106226] Updated weights for policy 0, policy_version 1350900 (0.0009) [2023-12-28 04:58:08,652][106226] Updated weights for policy 0, policy_version 1350910 (0.0008) [2023-12-28 04:58:08,810][106225] Updated weights for policy 1, policy_version 1354235 (0.0008) [2023-12-28 04:58:08,865][106225] Updated weights for policy 1, policy_version 1354245 (0.0010) [2023-12-28 04:58:08,927][106225] Updated weights for policy 1, policy_version 1354255 (0.0008) [2023-12-28 04:58:09,400][106226] Updated weights for policy 0, policy_version 1350920 (0.0009) [2023-12-28 04:58:09,473][106226] Updated weights for policy 0, policy_version 1350930 (0.0008) [2023-12-28 04:58:09,543][106226] Updated weights for policy 0, policy_version 1350940 (0.0009) [2023-12-28 04:58:09,638][106225] Updated weights for policy 1, policy_version 1354265 (0.0008) [2023-12-28 04:58:09,696][106225] Updated weights for policy 1, policy_version 1354275 (0.0010) [2023-12-28 04:58:09,755][106225] Updated weights for policy 1, policy_version 1354285 (0.0010) [2023-12-28 04:58:09,817][106225] Updated weights for policy 1, policy_version 1354295 (0.0010) [2023-12-28 04:58:10,315][106226] Updated weights for policy 0, policy_version 1350950 (0.0008) [2023-12-28 04:58:10,383][106226] Updated weights for policy 0, policy_version 1350960 (0.0009) [2023-12-28 04:58:10,449][106226] Updated weights for policy 0, policy_version 1350970 (0.0008) [2023-12-28 04:58:10,573][106225] Updated weights for policy 1, policy_version 1354305 (0.0008) [2023-12-28 04:58:10,622][106225] Updated weights for policy 1, policy_version 1354315 (0.0009) [2023-12-28 04:58:10,679][106225] Updated weights for policy 1, policy_version 1354325 (0.0008) [2023-12-28 04:58:11,097][106226] Updated weights for policy 0, policy_version 1350980 (0.0009) [2023-12-28 04:58:11,161][106226] Updated weights for policy 0, policy_version 1350990 (0.0009) [2023-12-28 04:58:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 692674560. Throughput: 0: 10093.6, 1: 9896.1. Samples: 692649332. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:11,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-4.642')] [2023-12-28 04:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001354328_346759168.pth... [2023-12-28 04:58:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001353176_346464256.pth [2023-12-28 04:58:11,227][106226] Updated weights for policy 0, policy_version 1351000 (0.0008) [2023-12-28 04:58:11,277][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001351008_345923584.pth... [2023-12-28 04:58:11,281][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001349824_345620480.pth [2023-12-28 04:58:11,458][106225] Updated weights for policy 1, policy_version 1354335 (0.0008) [2023-12-28 04:58:11,506][106225] Updated weights for policy 1, policy_version 1354345 (0.0008) [2023-12-28 04:58:11,559][106225] Updated weights for policy 1, policy_version 1354355 (0.0008) [2023-12-28 04:58:11,947][106226] Updated weights for policy 0, policy_version 1351010 (0.0007) [2023-12-28 04:58:12,013][106226] Updated weights for policy 0, policy_version 1351020 (0.0006) [2023-12-28 04:58:12,080][106226] Updated weights for policy 0, policy_version 1351030 (0.0007) [2023-12-28 04:58:12,144][106226] Updated weights for policy 0, policy_version 1351040 (0.0009) [2023-12-28 04:58:12,351][106225] Updated weights for policy 1, policy_version 1354365 (0.0008) [2023-12-28 04:58:12,419][106225] Updated weights for policy 1, policy_version 1354375 (0.0007) [2023-12-28 04:58:12,485][106225] Updated weights for policy 1, policy_version 1354385 (0.0005) [2023-12-28 04:58:12,903][106226] Updated weights for policy 0, policy_version 1351050 (0.0009) [2023-12-28 04:58:12,968][106226] Updated weights for policy 0, policy_version 1351060 (0.0009) [2023-12-28 04:58:13,027][106226] Updated weights for policy 0, policy_version 1351070 (0.0009) [2023-12-28 04:58:13,128][106225] Updated weights for policy 1, policy_version 1354395 (0.0007) [2023-12-28 04:58:13,180][106225] Updated weights for policy 1, policy_version 1354405 (0.0008) [2023-12-28 04:58:13,229][106225] Updated weights for policy 1, policy_version 1354415 (0.0008) [2023-12-28 04:58:13,811][106226] Updated weights for policy 0, policy_version 1351080 (0.0009) [2023-12-28 04:58:13,846][106225] Updated weights for policy 1, policy_version 1354425 (0.0008) [2023-12-28 04:58:13,861][106226] Updated weights for policy 0, policy_version 1351090 (0.0007) [2023-12-28 04:58:13,890][106225] Updated weights for policy 1, policy_version 1354435 (0.0007) [2023-12-28 04:58:13,914][106226] Updated weights for policy 0, policy_version 1351100 (0.0008) [2023-12-28 04:58:13,940][106225] Updated weights for policy 1, policy_version 1354445 (0.0007) [2023-12-28 04:58:13,991][106225] Updated weights for policy 1, policy_version 1354455 (0.0008) [2023-12-28 04:58:14,598][106225] Updated weights for policy 1, policy_version 1354465 (0.0006) [2023-12-28 04:58:14,603][106226] Updated weights for policy 0, policy_version 1351110 (0.0008) [2023-12-28 04:58:14,656][106225] Updated weights for policy 1, policy_version 1354475 (0.0005) [2023-12-28 04:58:14,659][106226] Updated weights for policy 0, policy_version 1351120 (0.0007) [2023-12-28 04:58:14,719][106226] Updated weights for policy 0, policy_version 1351130 (0.0005) [2023-12-28 04:58:14,720][106225] Updated weights for policy 1, policy_version 1354485 (0.0005) [2023-12-28 04:58:15,355][106225] Updated weights for policy 1, policy_version 1354495 (0.0007) [2023-12-28 04:58:15,393][106226] Updated weights for policy 0, policy_version 1351140 (0.0009) [2023-12-28 04:58:15,413][106225] Updated weights for policy 1, policy_version 1354505 (0.0005) [2023-12-28 04:58:15,446][106226] Updated weights for policy 0, policy_version 1351150 (0.0010) [2023-12-28 04:58:15,459][106225] Updated weights for policy 1, policy_version 1354515 (0.0005) [2023-12-28 04:58:15,502][106226] Updated weights for policy 0, policy_version 1351160 (0.0010) [2023-12-28 04:58:16,166][106225] Updated weights for policy 1, policy_version 1354525 (0.0007) [2023-12-28 04:58:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 692772864. Throughput: 0: 9955.1, 1: 9790.1. Samples: 692765772. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:16,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.509')] [2023-12-28 04:58:16,217][106226] Updated weights for policy 0, policy_version 1351170 (0.0010) [2023-12-28 04:58:16,219][106225] Updated weights for policy 1, policy_version 1354535 (0.0007) [2023-12-28 04:58:16,276][106225] Updated weights for policy 1, policy_version 1354545 (0.0005) [2023-12-28 04:58:16,277][106226] Updated weights for policy 0, policy_version 1351180 (0.0011) [2023-12-28 04:58:16,331][106226] Updated weights for policy 0, policy_version 1351190 (0.0010) [2023-12-28 04:58:16,384][106226] Updated weights for policy 0, policy_version 1351200 (0.0010) [2023-12-28 04:58:17,016][106225] Updated weights for policy 1, policy_version 1354555 (0.0006) [2023-12-28 04:58:17,081][106225] Updated weights for policy 1, policy_version 1354565 (0.0008) [2023-12-28 04:58:17,130][106226] Updated weights for policy 0, policy_version 1351210 (0.0011) [2023-12-28 04:58:17,143][106225] Updated weights for policy 1, policy_version 1354575 (0.0005) [2023-12-28 04:58:17,191][106226] Updated weights for policy 0, policy_version 1351220 (0.0011) [2023-12-28 04:58:17,239][106226] Updated weights for policy 0, policy_version 1351230 (0.0010) [2023-12-28 04:58:17,872][106225] Updated weights for policy 1, policy_version 1354585 (0.0006) [2023-12-28 04:58:17,925][106225] Updated weights for policy 1, policy_version 1354595 (0.0008) [2023-12-28 04:58:17,964][106226] Updated weights for policy 0, policy_version 1351240 (0.0011) [2023-12-28 04:58:17,979][106225] Updated weights for policy 1, policy_version 1354605 (0.0009) [2023-12-28 04:58:18,028][106226] Updated weights for policy 0, policy_version 1351250 (0.0011) [2023-12-28 04:58:18,034][106225] Updated weights for policy 1, policy_version 1354615 (0.0006) [2023-12-28 04:58:18,085][106226] Updated weights for policy 0, policy_version 1351260 (0.0010) [2023-12-28 04:58:18,798][106226] Updated weights for policy 0, policy_version 1351270 (0.0010) [2023-12-28 04:58:18,800][106225] Updated weights for policy 1, policy_version 1354625 (0.0006) [2023-12-28 04:58:18,846][106226] Updated weights for policy 0, policy_version 1351280 (0.0011) [2023-12-28 04:58:18,852][106225] Updated weights for policy 1, policy_version 1354635 (0.0006) [2023-12-28 04:58:18,896][106226] Updated weights for policy 0, policy_version 1351290 (0.0010) [2023-12-28 04:58:18,909][106225] Updated weights for policy 1, policy_version 1354645 (0.0006) [2023-12-28 04:58:19,637][106226] Updated weights for policy 0, policy_version 1351300 (0.0010) [2023-12-28 04:58:19,641][106225] Updated weights for policy 1, policy_version 1354655 (0.0007) [2023-12-28 04:58:19,698][106226] Updated weights for policy 0, policy_version 1351310 (0.0008) [2023-12-28 04:58:19,709][106225] Updated weights for policy 1, policy_version 1354665 (0.0007) [2023-12-28 04:58:19,754][106226] Updated weights for policy 0, policy_version 1351320 (0.0008) [2023-12-28 04:58:19,772][106225] Updated weights for policy 1, policy_version 1354675 (0.0009) [2023-12-28 04:58:20,413][106225] Updated weights for policy 1, policy_version 1354685 (0.0008) [2023-12-28 04:58:20,478][106225] Updated weights for policy 1, policy_version 1354695 (0.0005) [2023-12-28 04:58:20,502][106226] Updated weights for policy 0, policy_version 1351330 (0.0009) [2023-12-28 04:58:20,538][106225] Updated weights for policy 1, policy_version 1354705 (0.0008) [2023-12-28 04:58:20,561][106226] Updated weights for policy 0, policy_version 1351340 (0.0010) [2023-12-28 04:58:20,625][106226] Updated weights for policy 0, policy_version 1351350 (0.0011) [2023-12-28 04:58:20,689][106226] Updated weights for policy 0, policy_version 1351360 (0.0010) [2023-12-28 04:58:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 692871168. Throughput: 0: 9835.2, 1: 9785.2. Samples: 692881040. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:21,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.410')] [2023-12-28 04:58:21,298][106225] Updated weights for policy 1, policy_version 1354715 (0.0009) [2023-12-28 04:58:21,373][106225] Updated weights for policy 1, policy_version 1354725 (0.0009) [2023-12-28 04:58:21,441][106225] Updated weights for policy 1, policy_version 1354735 (0.0008) [2023-12-28 04:58:21,470][106226] Updated weights for policy 0, policy_version 1351370 (0.0007) [2023-12-28 04:58:21,537][106226] Updated weights for policy 0, policy_version 1351380 (0.0009) [2023-12-28 04:58:21,602][106226] Updated weights for policy 0, policy_version 1351390 (0.0009) [2023-12-28 04:58:22,143][106225] Updated weights for policy 1, policy_version 1354745 (0.0007) [2023-12-28 04:58:22,205][106225] Updated weights for policy 1, policy_version 1354755 (0.0009) [2023-12-28 04:58:22,259][106225] Updated weights for policy 1, policy_version 1354765 (0.0008) [2023-12-28 04:58:22,331][106225] Updated weights for policy 1, policy_version 1354775 (0.0008) [2023-12-28 04:58:22,449][106226] Updated weights for policy 0, policy_version 1351400 (0.0009) [2023-12-28 04:58:22,519][106226] Updated weights for policy 0, policy_version 1351410 (0.0005) [2023-12-28 04:58:22,583][106226] Updated weights for policy 0, policy_version 1351420 (0.0008) [2023-12-28 04:58:23,071][106225] Updated weights for policy 1, policy_version 1354785 (0.0006) [2023-12-28 04:58:23,129][106225] Updated weights for policy 1, policy_version 1354795 (0.0008) [2023-12-28 04:58:23,182][106225] Updated weights for policy 1, policy_version 1354806 (0.0010) [2023-12-28 04:58:23,189][106226] Updated weights for policy 0, policy_version 1351430 (0.0008) [2023-12-28 04:58:23,245][106226] Updated weights for policy 0, policy_version 1351440 (0.0008) [2023-12-28 04:58:23,309][106226] Updated weights for policy 0, policy_version 1351450 (0.0008) [2023-12-28 04:58:23,933][106226] Updated weights for policy 0, policy_version 1351460 (0.0008) [2023-12-28 04:58:23,976][106225] Updated weights for policy 1, policy_version 1354816 (0.0009) [2023-12-28 04:58:23,990][106226] Updated weights for policy 0, policy_version 1351470 (0.0008) [2023-12-28 04:58:24,028][106225] Updated weights for policy 1, policy_version 1354826 (0.0006) [2023-12-28 04:58:24,051][106226] Updated weights for policy 0, policy_version 1351480 (0.0006) [2023-12-28 04:58:24,078][106225] Updated weights for policy 1, policy_version 1354836 (0.0007) [2023-12-28 04:58:24,621][106226] Updated weights for policy 0, policy_version 1351490 (0.0008) [2023-12-28 04:58:24,679][106226] Updated weights for policy 0, policy_version 1351500 (0.0007) [2023-12-28 04:58:24,742][106226] Updated weights for policy 0, policy_version 1351510 (0.0009) [2023-12-28 04:58:24,871][106225] Updated weights for policy 1, policy_version 1354846 (0.0008) [2023-12-28 04:58:24,927][106225] Updated weights for policy 1, policy_version 1354856 (0.0008) [2023-12-28 04:58:24,974][106225] Updated weights for policy 1, policy_version 1354866 (0.0008) [2023-12-28 04:58:25,379][106226] Updated weights for policy 0, policy_version 1351521 (0.0007) [2023-12-28 04:58:25,434][106226] Updated weights for policy 0, policy_version 1351531 (0.0008) [2023-12-28 04:58:25,486][106226] Updated weights for policy 0, policy_version 1351541 (0.0009) [2023-12-28 04:58:25,538][106226] Updated weights for policy 0, policy_version 1351551 (0.0008) [2023-12-28 04:58:25,732][106225] Updated weights for policy 1, policy_version 1354876 (0.0009) [2023-12-28 04:58:25,784][106225] Updated weights for policy 1, policy_version 1354886 (0.0009) [2023-12-28 04:58:25,838][106225] Updated weights for policy 1, policy_version 1354896 (0.0008) [2023-12-28 04:58:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 692969472. Throughput: 0: 9799.7, 1: 9776.6. Samples: 692938508. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:26,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.684')] [2023-12-28 04:58:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001354904_346906624.pth... [2023-12-28 04:58:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001353784_346619904.pth [2023-12-28 04:58:26,216][106226] Updated weights for policy 0, policy_version 1351561 (0.0008) [2023-12-28 04:58:26,276][106226] Updated weights for policy 0, policy_version 1351571 (0.0009) [2023-12-28 04:58:26,333][106226] Updated weights for policy 0, policy_version 1351581 (0.0008) [2023-12-28 04:58:26,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001351584_346071040.pth... [2023-12-28 04:58:26,349][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001350400_345767936.pth [2023-12-28 04:58:26,584][106225] Updated weights for policy 1, policy_version 1354906 (0.0009) [2023-12-28 04:58:26,635][106225] Updated weights for policy 1, policy_version 1354916 (0.0008) [2023-12-28 04:58:26,684][106225] Updated weights for policy 1, policy_version 1354926 (0.0008) [2023-12-28 04:58:26,732][106225] Updated weights for policy 1, policy_version 1354936 (0.0008) [2023-12-28 04:58:27,016][106226] Updated weights for policy 0, policy_version 1351591 (0.0008) [2023-12-28 04:58:27,065][106226] Updated weights for policy 0, policy_version 1351601 (0.0009) [2023-12-28 04:58:27,113][106226] Updated weights for policy 0, policy_version 1351612 (0.0008) [2023-12-28 04:58:27,489][106225] Updated weights for policy 1, policy_version 1354946 (0.0008) [2023-12-28 04:58:27,551][106225] Updated weights for policy 1, policy_version 1354956 (0.0009) [2023-12-28 04:58:27,618][106225] Updated weights for policy 1, policy_version 1354966 (0.0009) [2023-12-28 04:58:27,763][106226] Updated weights for policy 0, policy_version 1351622 (0.0007) [2023-12-28 04:58:27,814][106226] Updated weights for policy 0, policy_version 1351632 (0.0005) [2023-12-28 04:58:27,867][106226] Updated weights for policy 0, policy_version 1351642 (0.0005) [2023-12-28 04:58:28,373][106225] Updated weights for policy 1, policy_version 1354976 (0.0008) [2023-12-28 04:58:28,423][106225] Updated weights for policy 1, policy_version 1354986 (0.0008) [2023-12-28 04:58:28,485][106225] Updated weights for policy 1, policy_version 1354996 (0.0009) [2023-12-28 04:58:28,501][106226] Updated weights for policy 0, policy_version 1351652 (0.0006) [2023-12-28 04:58:28,556][106226] Updated weights for policy 0, policy_version 1351662 (0.0009) [2023-12-28 04:58:28,606][106226] Updated weights for policy 0, policy_version 1351672 (0.0008) [2023-12-28 04:58:29,182][106225] Updated weights for policy 1, policy_version 1355006 (0.0009) [2023-12-28 04:58:29,253][106225] Updated weights for policy 1, policy_version 1355016 (0.0009) [2023-12-28 04:58:29,310][106225] Updated weights for policy 1, policy_version 1355026 (0.0008) [2023-12-28 04:58:29,368][106226] Updated weights for policy 0, policy_version 1351682 (0.0009) [2023-12-28 04:58:29,432][106226] Updated weights for policy 0, policy_version 1351692 (0.0008) [2023-12-28 04:58:29,481][106226] Updated weights for policy 0, policy_version 1351702 (0.0009) [2023-12-28 04:58:29,536][106226] Updated weights for policy 0, policy_version 1351712 (0.0008) [2023-12-28 04:58:30,018][106225] Updated weights for policy 1, policy_version 1355036 (0.0007) [2023-12-28 04:58:30,082][106225] Updated weights for policy 1, policy_version 1355046 (0.0006) [2023-12-28 04:58:30,143][106225] Updated weights for policy 1, policy_version 1355056 (0.0005) [2023-12-28 04:58:30,327][106226] Updated weights for policy 0, policy_version 1351722 (0.0008) [2023-12-28 04:58:30,382][106226] Updated weights for policy 0, policy_version 1351732 (0.0009) [2023-12-28 04:58:30,441][106226] Updated weights for policy 0, policy_version 1351742 (0.0008) [2023-12-28 04:58:30,726][106225] Updated weights for policy 1, policy_version 1355066 (0.0006) [2023-12-28 04:58:30,782][106225] Updated weights for policy 1, policy_version 1355076 (0.0009) [2023-12-28 04:58:30,841][106225] Updated weights for policy 1, policy_version 1355086 (0.0005) [2023-12-28 04:58:30,894][106225] Updated weights for policy 1, policy_version 1355096 (0.0005) [2023-12-28 04:58:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 693067776. Throughput: 0: 9935.6, 1: 9718.3. Samples: 693056716. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:31,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.508')] [2023-12-28 04:58:31,231][106226] Updated weights for policy 0, policy_version 1351752 (0.0010) [2023-12-28 04:58:31,299][106226] Updated weights for policy 0, policy_version 1351762 (0.0007) [2023-12-28 04:58:31,355][106226] Updated weights for policy 0, policy_version 1351772 (0.0006) [2023-12-28 04:58:31,604][106225] Updated weights for policy 1, policy_version 1355106 (0.0008) [2023-12-28 04:58:31,671][106225] Updated weights for policy 1, policy_version 1355116 (0.0007) [2023-12-28 04:58:31,731][106225] Updated weights for policy 1, policy_version 1355126 (0.0007) [2023-12-28 04:58:32,020][106226] Updated weights for policy 0, policy_version 1351782 (0.0006) [2023-12-28 04:58:32,089][106226] Updated weights for policy 0, policy_version 1351792 (0.0006) [2023-12-28 04:58:32,154][106226] Updated weights for policy 0, policy_version 1351802 (0.0009) [2023-12-28 04:58:32,491][106225] Updated weights for policy 1, policy_version 1355136 (0.0009) [2023-12-28 04:58:32,552][106225] Updated weights for policy 1, policy_version 1355146 (0.0010) [2023-12-28 04:58:32,613][106225] Updated weights for policy 1, policy_version 1355156 (0.0010) [2023-12-28 04:58:32,750][106226] Updated weights for policy 0, policy_version 1351812 (0.0007) [2023-12-28 04:58:32,811][106226] Updated weights for policy 0, policy_version 1351822 (0.0005) [2023-12-28 04:58:32,865][106226] Updated weights for policy 0, policy_version 1351832 (0.0008) [2023-12-28 04:58:33,264][106225] Updated weights for policy 1, policy_version 1355166 (0.0010) [2023-12-28 04:58:33,316][106225] Updated weights for policy 1, policy_version 1355176 (0.0010) [2023-12-28 04:58:33,361][106225] Updated weights for policy 1, policy_version 1355186 (0.0010) [2023-12-28 04:58:33,508][106226] Updated weights for policy 0, policy_version 1351842 (0.0007) [2023-12-28 04:58:33,559][106226] Updated weights for policy 0, policy_version 1351852 (0.0008) [2023-12-28 04:58:33,611][106226] Updated weights for policy 0, policy_version 1351862 (0.0010) [2023-12-28 04:58:33,656][106226] Updated weights for policy 0, policy_version 1351872 (0.0010) [2023-12-28 04:58:34,091][106225] Updated weights for policy 1, policy_version 1355196 (0.0010) [2023-12-28 04:58:34,156][106225] Updated weights for policy 1, policy_version 1355206 (0.0010) [2023-12-28 04:58:34,211][106225] Updated weights for policy 1, policy_version 1355216 (0.0007) [2023-12-28 04:58:34,254][106226] Updated weights for policy 0, policy_version 1351882 (0.0009) [2023-12-28 04:58:34,305][106226] Updated weights for policy 0, policy_version 1351892 (0.0008) [2023-12-28 04:58:34,353][106226] Updated weights for policy 0, policy_version 1351902 (0.0008) [2023-12-28 04:58:34,885][106225] Updated weights for policy 1, policy_version 1355226 (0.0006) [2023-12-28 04:58:34,946][106225] Updated weights for policy 1, policy_version 1355236 (0.0007) [2023-12-28 04:58:35,009][106225] Updated weights for policy 1, policy_version 1355246 (0.0010) [2023-12-28 04:58:35,055][106225] Updated weights for policy 1, policy_version 1355256 (0.0010) [2023-12-28 04:58:35,061][106226] Updated weights for policy 0, policy_version 1351912 (0.0006) [2023-12-28 04:58:35,121][106226] Updated weights for policy 0, policy_version 1351922 (0.0005) [2023-12-28 04:58:35,184][106226] Updated weights for policy 0, policy_version 1351932 (0.0005) [2023-12-28 04:58:35,716][106226] Updated weights for policy 0, policy_version 1351942 (0.0005) [2023-12-28 04:58:35,740][106225] Updated weights for policy 1, policy_version 1355266 (0.0010) [2023-12-28 04:58:35,764][106226] Updated weights for policy 0, policy_version 1351952 (0.0008) [2023-12-28 04:58:35,786][106225] Updated weights for policy 1, policy_version 1355276 (0.0010) [2023-12-28 04:58:35,812][106226] Updated weights for policy 0, policy_version 1351962 (0.0005) [2023-12-28 04:58:35,842][106225] Updated weights for policy 1, policy_version 1355286 (0.0010) [2023-12-28 04:58:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 693174272. Throughput: 0: 9984.4, 1: 9774.8. Samples: 693180072. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:36,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-4.720')] [2023-12-28 04:58:36,591][106225] Updated weights for policy 1, policy_version 1355296 (0.0010) [2023-12-28 04:58:36,649][106226] Updated weights for policy 0, policy_version 1351972 (0.0008) [2023-12-28 04:58:36,651][106225] Updated weights for policy 1, policy_version 1355306 (0.0010) [2023-12-28 04:58:36,703][106226] Updated weights for policy 0, policy_version 1351982 (0.0005) [2023-12-28 04:58:36,712][106225] Updated weights for policy 1, policy_version 1355316 (0.0010) [2023-12-28 04:58:36,761][106226] Updated weights for policy 0, policy_version 1351992 (0.0008) [2023-12-28 04:58:37,443][106225] Updated weights for policy 1, policy_version 1355326 (0.0007) [2023-12-28 04:58:37,498][106226] Updated weights for policy 0, policy_version 1352002 (0.0008) [2023-12-28 04:58:37,505][106225] Updated weights for policy 1, policy_version 1355336 (0.0005) [2023-12-28 04:58:37,554][106226] Updated weights for policy 0, policy_version 1352012 (0.0009) [2023-12-28 04:58:37,563][106225] Updated weights for policy 1, policy_version 1355346 (0.0007) [2023-12-28 04:58:37,605][106226] Updated weights for policy 0, policy_version 1352022 (0.0010) [2023-12-28 04:58:37,662][106226] Updated weights for policy 0, policy_version 1352032 (0.0010) [2023-12-28 04:58:38,180][106225] Updated weights for policy 1, policy_version 1355356 (0.0010) [2023-12-28 04:58:38,237][106225] Updated weights for policy 1, policy_version 1355366 (0.0010) [2023-12-28 04:58:38,295][106225] Updated weights for policy 1, policy_version 1355376 (0.0010) [2023-12-28 04:58:38,381][106226] Updated weights for policy 0, policy_version 1352042 (0.0006) [2023-12-28 04:58:38,454][106226] Updated weights for policy 0, policy_version 1352052 (0.0009) [2023-12-28 04:58:38,526][106226] Updated weights for policy 0, policy_version 1352062 (0.0007) [2023-12-28 04:58:38,985][106225] Updated weights for policy 1, policy_version 1355386 (0.0009) [2023-12-28 04:58:39,036][106225] Updated weights for policy 1, policy_version 1355396 (0.0010) [2023-12-28 04:58:39,085][106225] Updated weights for policy 1, policy_version 1355406 (0.0010) [2023-12-28 04:58:39,136][106225] Updated weights for policy 1, policy_version 1355416 (0.0010) [2023-12-28 04:58:39,148][106226] Updated weights for policy 0, policy_version 1352072 (0.0010) [2023-12-28 04:58:39,206][106226] Updated weights for policy 0, policy_version 1352082 (0.0011) [2023-12-28 04:58:39,278][106226] Updated weights for policy 0, policy_version 1352092 (0.0011) [2023-12-28 04:58:39,963][106225] Updated weights for policy 1, policy_version 1355426 (0.0008) [2023-12-28 04:58:40,022][106225] Updated weights for policy 1, policy_version 1355436 (0.0007) [2023-12-28 04:58:40,048][106226] Updated weights for policy 0, policy_version 1352102 (0.0011) [2023-12-28 04:58:40,079][106225] Updated weights for policy 1, policy_version 1355446 (0.0007) [2023-12-28 04:58:40,109][106226] Updated weights for policy 0, policy_version 1352112 (0.0011) [2023-12-28 04:58:40,160][106226] Updated weights for policy 0, policy_version 1352122 (0.0010) [2023-12-28 04:58:40,766][106226] Updated weights for policy 0, policy_version 1352132 (0.0008) [2023-12-28 04:58:40,822][106225] Updated weights for policy 1, policy_version 1355456 (0.0006) [2023-12-28 04:58:40,825][106226] Updated weights for policy 0, policy_version 1352142 (0.0006) [2023-12-28 04:58:40,881][106226] Updated weights for policy 0, policy_version 1352152 (0.0008) [2023-12-28 04:58:40,881][106225] Updated weights for policy 1, policy_version 1355466 (0.0005) [2023-12-28 04:58:40,945][106225] Updated weights for policy 1, policy_version 1355476 (0.0008) [2023-12-28 04:58:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 693272576. Throughput: 0: 9989.2, 1: 9780.5. Samples: 693239368. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:41,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.671')] [2023-12-28 04:58:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001355480_347054080.pth... [2023-12-28 04:58:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001354328_346759168.pth [2023-12-28 04:58:41,188][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001352160_346218496.pth... [2023-12-28 04:58:41,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001351008_345923584.pth [2023-12-28 04:58:41,552][106225] Updated weights for policy 1, policy_version 1355486 (0.0007) [2023-12-28 04:58:41,619][106225] Updated weights for policy 1, policy_version 1355496 (0.0008) [2023-12-28 04:58:41,638][106226] Updated weights for policy 0, policy_version 1352162 (0.0008) [2023-12-28 04:58:41,683][106225] Updated weights for policy 1, policy_version 1355506 (0.0007) [2023-12-28 04:58:41,707][106226] Updated weights for policy 0, policy_version 1352172 (0.0009) [2023-12-28 04:58:41,769][106226] Updated weights for policy 0, policy_version 1352182 (0.0010) [2023-12-28 04:58:41,834][106226] Updated weights for policy 0, policy_version 1352192 (0.0008) [2023-12-28 04:58:42,424][106225] Updated weights for policy 1, policy_version 1355516 (0.0009) [2023-12-28 04:58:42,475][106225] Updated weights for policy 1, policy_version 1355526 (0.0010) [2023-12-28 04:58:42,526][106225] Updated weights for policy 1, policy_version 1355536 (0.0010) [2023-12-28 04:58:42,537][106226] Updated weights for policy 0, policy_version 1352202 (0.0009) [2023-12-28 04:58:42,597][106226] Updated weights for policy 0, policy_version 1352212 (0.0007) [2023-12-28 04:58:42,662][106226] Updated weights for policy 0, policy_version 1352222 (0.0005) [2023-12-28 04:58:43,222][106226] Updated weights for policy 0, policy_version 1352232 (0.0007) [2023-12-28 04:58:43,286][106226] Updated weights for policy 0, policy_version 1352242 (0.0010) [2023-12-28 04:58:43,287][106225] Updated weights for policy 1, policy_version 1355546 (0.0010) [2023-12-28 04:58:43,344][106225] Updated weights for policy 1, policy_version 1355556 (0.0010) [2023-12-28 04:58:43,349][106226] Updated weights for policy 0, policy_version 1352252 (0.0010) [2023-12-28 04:58:43,401][106225] Updated weights for policy 1, policy_version 1355566 (0.0010) [2023-12-28 04:58:43,468][106225] Updated weights for policy 1, policy_version 1355576 (0.0010) [2023-12-28 04:58:43,952][106226] Updated weights for policy 0, policy_version 1352262 (0.0008) [2023-12-28 04:58:44,017][106226] Updated weights for policy 0, policy_version 1352272 (0.0010) [2023-12-28 04:58:44,068][106226] Updated weights for policy 0, policy_version 1352282 (0.0007) [2023-12-28 04:58:44,162][106225] Updated weights for policy 1, policy_version 1355586 (0.0009) [2023-12-28 04:58:44,227][106225] Updated weights for policy 1, policy_version 1355596 (0.0005) [2023-12-28 04:58:44,290][106225] Updated weights for policy 1, policy_version 1355606 (0.0005) [2023-12-28 04:58:44,735][106226] Updated weights for policy 0, policy_version 1352292 (0.0009) [2023-12-28 04:58:44,802][106226] Updated weights for policy 0, policy_version 1352302 (0.0010) [2023-12-28 04:58:44,870][106226] Updated weights for policy 0, policy_version 1352312 (0.0011) [2023-12-28 04:58:44,932][106225] Updated weights for policy 1, policy_version 1355616 (0.0007) [2023-12-28 04:58:44,997][106225] Updated weights for policy 1, policy_version 1355626 (0.0009) [2023-12-28 04:58:45,063][106225] Updated weights for policy 1, policy_version 1355636 (0.0008) [2023-12-28 04:58:45,585][106226] Updated weights for policy 0, policy_version 1352322 (0.0011) [2023-12-28 04:58:45,642][106226] Updated weights for policy 0, policy_version 1352332 (0.0010) [2023-12-28 04:58:45,648][106225] Updated weights for policy 1, policy_version 1355646 (0.0006) [2023-12-28 04:58:45,697][106226] Updated weights for policy 0, policy_version 1352342 (0.0011) [2023-12-28 04:58:45,706][106225] Updated weights for policy 1, policy_version 1355656 (0.0006) [2023-12-28 04:58:45,751][106226] Updated weights for policy 0, policy_version 1352352 (0.0010) [2023-12-28 04:58:45,762][106225] Updated weights for policy 1, policy_version 1355666 (0.0007) [2023-12-28 04:58:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 693370880. Throughput: 0: 9998.9, 1: 9727.3. Samples: 693358596. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:46,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.529')] [2023-12-28 04:58:46,307][106225] Updated weights for policy 1, policy_version 1355676 (0.0005) [2023-12-28 04:58:46,374][106225] Updated weights for policy 1, policy_version 1355686 (0.0005) [2023-12-28 04:58:46,400][106226] Updated weights for policy 0, policy_version 1352362 (0.0007) [2023-12-28 04:58:46,435][106225] Updated weights for policy 1, policy_version 1355696 (0.0006) [2023-12-28 04:58:46,461][106226] Updated weights for policy 0, policy_version 1352372 (0.0010) [2023-12-28 04:58:46,518][106226] Updated weights for policy 0, policy_version 1352382 (0.0010) [2023-12-28 04:58:47,048][106225] Updated weights for policy 1, policy_version 1355706 (0.0010) [2023-12-28 04:58:47,111][106225] Updated weights for policy 1, policy_version 1355716 (0.0008) [2023-12-28 04:58:47,169][106226] Updated weights for policy 0, policy_version 1352392 (0.0009) [2023-12-28 04:58:47,172][106225] Updated weights for policy 1, policy_version 1355726 (0.0006) [2023-12-28 04:58:47,231][106226] Updated weights for policy 0, policy_version 1352402 (0.0010) [2023-12-28 04:58:47,237][106225] Updated weights for policy 1, policy_version 1355736 (0.0006) [2023-12-28 04:58:47,288][106226] Updated weights for policy 0, policy_version 1352412 (0.0006) [2023-12-28 04:58:47,949][106226] Updated weights for policy 0, policy_version 1352422 (0.0006) [2023-12-28 04:58:47,993][106225] Updated weights for policy 1, policy_version 1355746 (0.0008) [2023-12-28 04:58:48,001][106226] Updated weights for policy 0, policy_version 1352432 (0.0005) [2023-12-28 04:58:48,053][106225] Updated weights for policy 1, policy_version 1355756 (0.0008) [2023-12-28 04:58:48,062][106226] Updated weights for policy 0, policy_version 1352442 (0.0005) [2023-12-28 04:58:48,107][106225] Updated weights for policy 1, policy_version 1355766 (0.0008) [2023-12-28 04:58:48,758][106226] Updated weights for policy 0, policy_version 1352452 (0.0007) [2023-12-28 04:58:48,814][106225] Updated weights for policy 1, policy_version 1355776 (0.0007) [2023-12-28 04:58:48,815][106226] Updated weights for policy 0, policy_version 1352462 (0.0008) [2023-12-28 04:58:48,879][106226] Updated weights for policy 0, policy_version 1352472 (0.0009) [2023-12-28 04:58:48,882][106225] Updated weights for policy 1, policy_version 1355786 (0.0006) [2023-12-28 04:58:48,950][106225] Updated weights for policy 1, policy_version 1355796 (0.0006) [2023-12-28 04:58:49,606][106225] Updated weights for policy 1, policy_version 1355806 (0.0008) [2023-12-28 04:58:49,643][106226] Updated weights for policy 0, policy_version 1352482 (0.0009) [2023-12-28 04:58:49,661][106225] Updated weights for policy 1, policy_version 1355816 (0.0007) [2023-12-28 04:58:49,695][106226] Updated weights for policy 0, policy_version 1352492 (0.0006) [2023-12-28 04:58:49,714][106225] Updated weights for policy 1, policy_version 1355826 (0.0006) [2023-12-28 04:58:49,753][106226] Updated weights for policy 0, policy_version 1352502 (0.0006) [2023-12-28 04:58:49,804][106226] Updated weights for policy 0, policy_version 1352512 (0.0009) [2023-12-28 04:58:50,434][106225] Updated weights for policy 1, policy_version 1355836 (0.0007) [2023-12-28 04:58:50,493][106225] Updated weights for policy 1, policy_version 1355846 (0.0008) [2023-12-28 04:58:50,551][106226] Updated weights for policy 0, policy_version 1352522 (0.0005) [2023-12-28 04:58:50,552][106225] Updated weights for policy 1, policy_version 1355856 (0.0008) [2023-12-28 04:58:50,600][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000001 [2023-12-28 04:58:50,617][106226] Updated weights for policy 0, policy_version 1352532 (0.0008) [2023-12-28 04:58:50,680][106226] Updated weights for policy 0, policy_version 1352542 (0.0008) [2023-12-28 04:58:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 693469184. Throughput: 0: 9957.6, 1: 9800.1. Samples: 693480768. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:51,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.510')] [2023-12-28 04:58:51,272][106225] Updated weights for policy 1, policy_version 1355866 (0.0007) [2023-12-28 04:58:51,326][106225] Updated weights for policy 1, policy_version 1355876 (0.0007) [2023-12-28 04:58:51,331][106226] Updated weights for policy 0, policy_version 1352552 (0.0007) [2023-12-28 04:58:51,400][106225] Updated weights for policy 1, policy_version 1355886 (0.0009) [2023-12-28 04:58:51,400][106226] Updated weights for policy 0, policy_version 1352562 (0.0008) [2023-12-28 04:58:51,461][106226] Updated weights for policy 0, policy_version 1352572 (0.0007) [2023-12-28 04:58:51,463][106225] Updated weights for policy 1, policy_version 1355896 (0.0008) [2023-12-28 04:58:52,095][106226] Updated weights for policy 0, policy_version 1352582 (0.0007) [2023-12-28 04:58:52,154][106226] Updated weights for policy 0, policy_version 1352592 (0.0009) [2023-12-28 04:58:52,204][106226] Updated weights for policy 0, policy_version 1352602 (0.0009) [2023-12-28 04:58:52,214][106225] Updated weights for policy 1, policy_version 1355906 (0.0008) [2023-12-28 04:58:52,282][106225] Updated weights for policy 1, policy_version 1355916 (0.0008) [2023-12-28 04:58:52,343][106225] Updated weights for policy 1, policy_version 1355926 (0.0008) [2023-12-28 04:58:52,891][106226] Updated weights for policy 0, policy_version 1352612 (0.0006) [2023-12-28 04:58:52,947][106226] Updated weights for policy 0, policy_version 1352622 (0.0007) [2023-12-28 04:58:53,009][106226] Updated weights for policy 0, policy_version 1352632 (0.0007) [2023-12-28 04:58:53,119][106225] Updated weights for policy 1, policy_version 1355936 (0.0008) [2023-12-28 04:58:53,163][106225] Updated weights for policy 1, policy_version 1355946 (0.0008) [2023-12-28 04:58:53,218][106225] Updated weights for policy 1, policy_version 1355956 (0.0008) [2023-12-28 04:58:53,641][106226] Updated weights for policy 0, policy_version 1352642 (0.0008) [2023-12-28 04:58:53,689][106226] Updated weights for policy 0, policy_version 1352652 (0.0008) [2023-12-28 04:58:53,738][106226] Updated weights for policy 0, policy_version 1352662 (0.0008) [2023-12-28 04:58:53,803][106226] Updated weights for policy 0, policy_version 1352672 (0.0007) [2023-12-28 04:58:53,995][106225] Updated weights for policy 1, policy_version 1355966 (0.0008) [2023-12-28 04:58:54,046][106225] Updated weights for policy 1, policy_version 1355976 (0.0007) [2023-12-28 04:58:54,098][106225] Updated weights for policy 1, policy_version 1355986 (0.0007) [2023-12-28 04:58:54,454][106226] Updated weights for policy 0, policy_version 1352682 (0.0009) [2023-12-28 04:58:54,514][106226] Updated weights for policy 0, policy_version 1352692 (0.0009) [2023-12-28 04:58:54,563][106226] Updated weights for policy 0, policy_version 1352702 (0.0009) [2023-12-28 04:58:54,914][106225] Updated weights for policy 1, policy_version 1355996 (0.0007) [2023-12-28 04:58:54,964][106225] Updated weights for policy 1, policy_version 1356006 (0.0008) [2023-12-28 04:58:55,025][106225] Updated weights for policy 1, policy_version 1356016 (0.0009) [2023-12-28 04:58:55,160][106226] Updated weights for policy 0, policy_version 1352712 (0.0008) [2023-12-28 04:58:55,210][106226] Updated weights for policy 0, policy_version 1352722 (0.0009) [2023-12-28 04:58:55,268][106226] Updated weights for policy 0, policy_version 1352732 (0.0008) [2023-12-28 04:58:55,747][106225] Updated weights for policy 1, policy_version 1356026 (0.0008) [2023-12-28 04:58:55,796][106225] Updated weights for policy 1, policy_version 1356036 (0.0008) [2023-12-28 04:58:55,841][106225] Updated weights for policy 1, policy_version 1356046 (0.0008) [2023-12-28 04:58:55,893][106225] Updated weights for policy 1, policy_version 1356056 (0.0006) [2023-12-28 04:58:55,988][106226] Updated weights for policy 0, policy_version 1352742 (0.0008) [2023-12-28 04:58:56,047][106226] Updated weights for policy 0, policy_version 1352752 (0.0006) [2023-12-28 04:58:56,115][106226] Updated weights for policy 0, policy_version 1352762 (0.0005) [2023-12-28 04:58:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 693575680. Throughput: 0: 9980.8, 1: 9787.4. Samples: 693538900. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:58:56,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.569')] [2023-12-28 04:58:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001352768_346374144.pth... [2023-12-28 04:58:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001356056_347201536.pth... [2023-12-28 04:58:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001351584_346071040.pth [2023-12-28 04:58:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001354904_346906624.pth [2023-12-28 04:58:56,638][106225] Updated weights for policy 1, policy_version 1356066 (0.0007) [2023-12-28 04:58:56,678][106226] Updated weights for policy 0, policy_version 1352772 (0.0005) [2023-12-28 04:58:56,695][106225] Updated weights for policy 1, policy_version 1356076 (0.0007) [2023-12-28 04:58:56,733][106226] Updated weights for policy 0, policy_version 1352782 (0.0005) [2023-12-28 04:58:56,744][106225] Updated weights for policy 1, policy_version 1356086 (0.0007) [2023-12-28 04:58:56,786][106226] Updated weights for policy 0, policy_version 1352792 (0.0008) [2023-12-28 04:58:57,397][106226] Updated weights for policy 0, policy_version 1352802 (0.0010) [2023-12-28 04:58:57,454][106226] Updated weights for policy 0, policy_version 1352812 (0.0010) [2023-12-28 04:58:57,510][106226] Updated weights for policy 0, policy_version 1352822 (0.0010) [2023-12-28 04:58:57,527][106225] Updated weights for policy 1, policy_version 1356096 (0.0006) [2023-12-28 04:58:57,564][106226] Updated weights for policy 0, policy_version 1352832 (0.0010) [2023-12-28 04:58:57,577][106225] Updated weights for policy 1, policy_version 1356106 (0.0006) [2023-12-28 04:58:57,626][106225] Updated weights for policy 1, policy_version 1356116 (0.0008) [2023-12-28 04:58:58,234][106226] Updated weights for policy 0, policy_version 1352842 (0.0009) [2023-12-28 04:58:58,294][106226] Updated weights for policy 0, policy_version 1352852 (0.0008) [2023-12-28 04:58:58,367][106226] Updated weights for policy 0, policy_version 1352862 (0.0008) [2023-12-28 04:58:58,439][106225] Updated weights for policy 1, policy_version 1356126 (0.0007) [2023-12-28 04:58:58,507][106225] Updated weights for policy 1, policy_version 1356136 (0.0010) [2023-12-28 04:58:58,574][106225] Updated weights for policy 1, policy_version 1356146 (0.0010) [2023-12-28 04:58:59,209][106226] Updated weights for policy 0, policy_version 1352872 (0.0008) [2023-12-28 04:58:59,274][106226] Updated weights for policy 0, policy_version 1352882 (0.0007) [2023-12-28 04:58:59,343][106226] Updated weights for policy 0, policy_version 1352892 (0.0007) [2023-12-28 04:58:59,366][106225] Updated weights for policy 1, policy_version 1356156 (0.0009) [2023-12-28 04:58:59,429][106225] Updated weights for policy 1, policy_version 1356166 (0.0006) [2023-12-28 04:58:59,484][106225] Updated weights for policy 1, policy_version 1356176 (0.0005) [2023-12-28 04:59:00,003][106226] Updated weights for policy 0, policy_version 1352902 (0.0009) [2023-12-28 04:59:00,067][106226] Updated weights for policy 0, policy_version 1352912 (0.0009) [2023-12-28 04:59:00,134][106226] Updated weights for policy 0, policy_version 1352922 (0.0009) [2023-12-28 04:59:00,165][106225] Updated weights for policy 1, policy_version 1356186 (0.0007) [2023-12-28 04:59:00,226][106225] Updated weights for policy 1, policy_version 1356196 (0.0006) [2023-12-28 04:59:00,280][106225] Updated weights for policy 1, policy_version 1356206 (0.0005) [2023-12-28 04:59:00,329][106225] Updated weights for policy 1, policy_version 1356216 (0.0005) [2023-12-28 04:59:00,839][106226] Updated weights for policy 0, policy_version 1352932 (0.0008) [2023-12-28 04:59:00,901][106226] Updated weights for policy 0, policy_version 1352942 (0.0008) [2023-12-28 04:59:00,959][106226] Updated weights for policy 0, policy_version 1352952 (0.0008) [2023-12-28 04:59:00,986][106225] Updated weights for policy 1, policy_version 1356226 (0.0005) [2023-12-28 04:59:01,049][106225] Updated weights for policy 1, policy_version 1356236 (0.0007) [2023-12-28 04:59:01,108][106225] Updated weights for policy 1, policy_version 1356246 (0.0007) [2023-12-28 04:59:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 693673984. Throughput: 0: 10100.5, 1: 9690.1. Samples: 693656344. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:01,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.808')] [2023-12-28 04:59:01,659][106226] Updated weights for policy 0, policy_version 1352962 (0.0006) [2023-12-28 04:59:01,724][106226] Updated weights for policy 0, policy_version 1352972 (0.0008) [2023-12-28 04:59:01,789][106226] Updated weights for policy 0, policy_version 1352982 (0.0009) [2023-12-28 04:59:01,812][106225] Updated weights for policy 1, policy_version 1356256 (0.0006) [2023-12-28 04:59:01,835][106226] Updated weights for policy 0, policy_version 1352992 (0.0007) [2023-12-28 04:59:01,869][106225] Updated weights for policy 1, policy_version 1356266 (0.0006) [2023-12-28 04:59:01,927][106225] Updated weights for policy 1, policy_version 1356276 (0.0007) [2023-12-28 04:59:02,464][106226] Updated weights for policy 0, policy_version 1353002 (0.0005) [2023-12-28 04:59:02,526][106226] Updated weights for policy 0, policy_version 1353012 (0.0011) [2023-12-28 04:59:02,594][106226] Updated weights for policy 0, policy_version 1353022 (0.0011) [2023-12-28 04:59:02,624][106225] Updated weights for policy 1, policy_version 1356286 (0.0008) [2023-12-28 04:59:02,684][106225] Updated weights for policy 1, policy_version 1356296 (0.0007) [2023-12-28 04:59:02,737][106225] Updated weights for policy 1, policy_version 1356306 (0.0005) [2023-12-28 04:59:03,139][106226] Updated weights for policy 0, policy_version 1353032 (0.0006) [2023-12-28 04:59:03,190][106226] Updated weights for policy 0, policy_version 1353042 (0.0005) [2023-12-28 04:59:03,245][106226] Updated weights for policy 0, policy_version 1353052 (0.0005) [2023-12-28 04:59:03,425][106225] Updated weights for policy 1, policy_version 1356316 (0.0007) [2023-12-28 04:59:03,481][106225] Updated weights for policy 1, policy_version 1356326 (0.0009) [2023-12-28 04:59:03,537][106225] Updated weights for policy 1, policy_version 1356336 (0.0008) [2023-12-28 04:59:03,807][106226] Updated weights for policy 0, policy_version 1353062 (0.0005) [2023-12-28 04:59:03,869][106226] Updated weights for policy 0, policy_version 1353072 (0.0007) [2023-12-28 04:59:03,930][106226] Updated weights for policy 0, policy_version 1353082 (0.0008) [2023-12-28 04:59:04,295][106225] Updated weights for policy 1, policy_version 1356346 (0.0008) [2023-12-28 04:59:04,355][106225] Updated weights for policy 1, policy_version 1356356 (0.0008) [2023-12-28 04:59:04,420][106225] Updated weights for policy 1, policy_version 1356366 (0.0009) [2023-12-28 04:59:04,479][106225] Updated weights for policy 1, policy_version 1356376 (0.0008) [2023-12-28 04:59:04,643][106226] Updated weights for policy 0, policy_version 1353092 (0.0008) [2023-12-28 04:59:04,694][106226] Updated weights for policy 0, policy_version 1353102 (0.0009) [2023-12-28 04:59:04,755][106226] Updated weights for policy 0, policy_version 1353112 (0.0009) [2023-12-28 04:59:05,135][106225] Updated weights for policy 1, policy_version 1356386 (0.0008) [2023-12-28 04:59:05,184][106225] Updated weights for policy 1, policy_version 1356396 (0.0009) [2023-12-28 04:59:05,239][106225] Updated weights for policy 1, policy_version 1356406 (0.0008) [2023-12-28 04:59:05,507][106226] Updated weights for policy 0, policy_version 1353122 (0.0009) [2023-12-28 04:59:05,559][106226] Updated weights for policy 0, policy_version 1353132 (0.0008) [2023-12-28 04:59:05,607][106226] Updated weights for policy 0, policy_version 1353142 (0.0008) [2023-12-28 04:59:05,658][106226] Updated weights for policy 0, policy_version 1353152 (0.0008) [2023-12-28 04:59:05,957][106225] Updated weights for policy 1, policy_version 1356416 (0.0008) [2023-12-28 04:59:06,014][106225] Updated weights for policy 1, policy_version 1356426 (0.0008) [2023-12-28 04:59:06,074][106225] Updated weights for policy 1, policy_version 1356436 (0.0009) [2023-12-28 04:59:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 693772288. Throughput: 0: 10203.0, 1: 9743.9. Samples: 693778652. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:06,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-4.558')] [2023-12-28 04:59:06,412][106226] Updated weights for policy 0, policy_version 1353162 (0.0008) [2023-12-28 04:59:06,473][106226] Updated weights for policy 0, policy_version 1353172 (0.0009) [2023-12-28 04:59:06,540][106226] Updated weights for policy 0, policy_version 1353182 (0.0008) [2023-12-28 04:59:06,841][106225] Updated weights for policy 1, policy_version 1356446 (0.0008) [2023-12-28 04:59:06,891][106225] Updated weights for policy 1, policy_version 1356456 (0.0008) [2023-12-28 04:59:06,945][106225] Updated weights for policy 1, policy_version 1356466 (0.0007) [2023-12-28 04:59:07,280][106226] Updated weights for policy 0, policy_version 1353192 (0.0009) [2023-12-28 04:59:07,339][106226] Updated weights for policy 0, policy_version 1353202 (0.0009) [2023-12-28 04:59:07,400][106226] Updated weights for policy 0, policy_version 1353212 (0.0009) [2023-12-28 04:59:07,637][106225] Updated weights for policy 1, policy_version 1356476 (0.0008) [2023-12-28 04:59:07,692][106225] Updated weights for policy 1, policy_version 1356486 (0.0008) [2023-12-28 04:59:07,744][106225] Updated weights for policy 1, policy_version 1356496 (0.0006) [2023-12-28 04:59:08,196][106226] Updated weights for policy 0, policy_version 1353222 (0.0008) [2023-12-28 04:59:08,253][106226] Updated weights for policy 0, policy_version 1353232 (0.0009) [2023-12-28 04:59:08,307][106226] Updated weights for policy 0, policy_version 1353242 (0.0009) [2023-12-28 04:59:08,337][106225] Updated weights for policy 1, policy_version 1356506 (0.0006) [2023-12-28 04:59:08,399][106225] Updated weights for policy 1, policy_version 1356516 (0.0010) [2023-12-28 04:59:08,459][106225] Updated weights for policy 1, policy_version 1356526 (0.0005) [2023-12-28 04:59:08,521][106225] Updated weights for policy 1, policy_version 1356536 (0.0008) [2023-12-28 04:59:09,053][106226] Updated weights for policy 0, policy_version 1353252 (0.0008) [2023-12-28 04:59:09,109][106226] Updated weights for policy 0, policy_version 1353263 (0.0008) [2023-12-28 04:59:09,165][106226] Updated weights for policy 0, policy_version 1353273 (0.0008) [2023-12-28 04:59:09,251][106225] Updated weights for policy 1, policy_version 1356546 (0.0008) [2023-12-28 04:59:09,309][106225] Updated weights for policy 1, policy_version 1356556 (0.0009) [2023-12-28 04:59:09,390][106225] Updated weights for policy 1, policy_version 1356566 (0.0008) [2023-12-28 04:59:10,013][106226] Updated weights for policy 0, policy_version 1353283 (0.0007) [2023-12-28 04:59:10,080][106226] Updated weights for policy 0, policy_version 1353293 (0.0009) [2023-12-28 04:59:10,128][106225] Updated weights for policy 1, policy_version 1356576 (0.0009) [2023-12-28 04:59:10,135][106226] Updated weights for policy 0, policy_version 1353303 (0.0007) [2023-12-28 04:59:10,178][106225] Updated weights for policy 1, policy_version 1356586 (0.0006) [2023-12-28 04:59:10,234][106225] Updated weights for policy 1, policy_version 1356596 (0.0008) [2023-12-28 04:59:10,902][106226] Updated weights for policy 0, policy_version 1353313 (0.0007) [2023-12-28 04:59:10,954][106226] Updated weights for policy 0, policy_version 1353323 (0.0009) [2023-12-28 04:59:10,968][106225] Updated weights for policy 1, policy_version 1356606 (0.0008) [2023-12-28 04:59:11,008][106226] Updated weights for policy 0, policy_version 1353333 (0.0008) [2023-12-28 04:59:11,034][106225] Updated weights for policy 1, policy_version 1356616 (0.0009) [2023-12-28 04:59:11,076][106226] Updated weights for policy 0, policy_version 1353343 (0.0009) [2023-12-28 04:59:11,104][106225] Updated weights for policy 1, policy_version 1356626 (0.0009) [2023-12-28 04:59:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 693870592. Throughput: 0: 10172.9, 1: 9784.7. Samples: 693836600. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:11,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-4.688')] [2023-12-28 04:59:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001356632_347348992.pth... [2023-12-28 04:59:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001353344_346521600.pth... [2023-12-28 04:59:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001355480_347054080.pth [2023-12-28 04:59:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001352160_346218496.pth [2023-12-28 04:59:11,842][106226] Updated weights for policy 0, policy_version 1353353 (0.0009) [2023-12-28 04:59:11,913][106226] Updated weights for policy 0, policy_version 1353363 (0.0010) [2023-12-28 04:59:11,931][106225] Updated weights for policy 1, policy_version 1356636 (0.0008) [2023-12-28 04:59:11,970][106226] Updated weights for policy 0, policy_version 1353373 (0.0006) [2023-12-28 04:59:11,987][106225] Updated weights for policy 1, policy_version 1356646 (0.0009) [2023-12-28 04:59:12,047][106225] Updated weights for policy 1, policy_version 1356656 (0.0005) [2023-12-28 04:59:12,668][106225] Updated weights for policy 1, policy_version 1356666 (0.0006) [2023-12-28 04:59:12,717][106226] Updated weights for policy 0, policy_version 1353383 (0.0007) [2023-12-28 04:59:12,720][106225] Updated weights for policy 1, policy_version 1356676 (0.0006) [2023-12-28 04:59:12,772][106225] Updated weights for policy 1, policy_version 1356686 (0.0007) [2023-12-28 04:59:12,784][106226] Updated weights for policy 0, policy_version 1353393 (0.0007) [2023-12-28 04:59:12,835][106225] Updated weights for policy 1, policy_version 1356696 (0.0005) [2023-12-28 04:59:12,837][106226] Updated weights for policy 0, policy_version 1353403 (0.0010) [2023-12-28 04:59:13,449][106225] Updated weights for policy 1, policy_version 1356706 (0.0008) [2023-12-28 04:59:13,464][106226] Updated weights for policy 0, policy_version 1353413 (0.0008) [2023-12-28 04:59:13,502][106225] Updated weights for policy 1, policy_version 1356716 (0.0008) [2023-12-28 04:59:13,510][106226] Updated weights for policy 0, policy_version 1353423 (0.0005) [2023-12-28 04:59:13,562][106226] Updated weights for policy 0, policy_version 1353433 (0.0008) [2023-12-28 04:59:13,565][106225] Updated weights for policy 1, policy_version 1356726 (0.0008) [2023-12-28 04:59:14,219][106225] Updated weights for policy 1, policy_version 1356736 (0.0006) [2023-12-28 04:59:14,284][106225] Updated weights for policy 1, policy_version 1356746 (0.0009) [2023-12-28 04:59:14,347][106225] Updated weights for policy 1, policy_version 1356756 (0.0008) [2023-12-28 04:59:14,361][106226] Updated weights for policy 0, policy_version 1353443 (0.0007) [2023-12-28 04:59:14,419][106226] Updated weights for policy 0, policy_version 1353453 (0.0008) [2023-12-28 04:59:14,475][106226] Updated weights for policy 0, policy_version 1353463 (0.0009) [2023-12-28 04:59:15,064][106225] Updated weights for policy 1, policy_version 1356766 (0.0008) [2023-12-28 04:59:15,124][106225] Updated weights for policy 1, policy_version 1356776 (0.0009) [2023-12-28 04:59:15,173][106226] Updated weights for policy 0, policy_version 1353473 (0.0008) [2023-12-28 04:59:15,182][106225] Updated weights for policy 1, policy_version 1356786 (0.0008) [2023-12-28 04:59:15,235][106226] Updated weights for policy 0, policy_version 1353483 (0.0011) [2023-12-28 04:59:15,292][106226] Updated weights for policy 0, policy_version 1353493 (0.0011) [2023-12-28 04:59:15,347][106226] Updated weights for policy 0, policy_version 1353503 (0.0010) [2023-12-28 04:59:15,942][106225] Updated weights for policy 1, policy_version 1356796 (0.0006) [2023-12-28 04:59:15,969][106226] Updated weights for policy 0, policy_version 1353513 (0.0006) [2023-12-28 04:59:15,990][106225] Updated weights for policy 1, policy_version 1356806 (0.0008) [2023-12-28 04:59:16,029][106226] Updated weights for policy 0, policy_version 1353523 (0.0006) [2023-12-28 04:59:16,043][106225] Updated weights for policy 1, policy_version 1356816 (0.0008) [2023-12-28 04:59:16,086][106226] Updated weights for policy 0, policy_version 1353533 (0.0005) [2023-12-28 04:59:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 693968896. Throughput: 0: 10045.9, 1: 9853.0. Samples: 693952164. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:16,175][105115] Avg episode reward: [(0, '-4.675'), (1, '-4.669')] [2023-12-28 04:59:16,663][106226] Updated weights for policy 0, policy_version 1353543 (0.0005) [2023-12-28 04:59:16,716][106226] Updated weights for policy 0, policy_version 1353553 (0.0007) [2023-12-28 04:59:16,778][106226] Updated weights for policy 0, policy_version 1353563 (0.0009) [2023-12-28 04:59:16,826][106225] Updated weights for policy 1, policy_version 1356826 (0.0008) [2023-12-28 04:59:16,875][106225] Updated weights for policy 1, policy_version 1356836 (0.0009) [2023-12-28 04:59:16,924][106225] Updated weights for policy 1, policy_version 1356846 (0.0009) [2023-12-28 04:59:17,415][106226] Updated weights for policy 0, policy_version 1353573 (0.0009) [2023-12-28 04:59:17,476][106226] Updated weights for policy 0, policy_version 1353583 (0.0008) [2023-12-28 04:59:17,540][106226] Updated weights for policy 0, policy_version 1353593 (0.0005) [2023-12-28 04:59:17,797][106225] Updated weights for policy 1, policy_version 1356857 (0.0010) [2023-12-28 04:59:17,868][106225] Updated weights for policy 1, policy_version 1356867 (0.0006) [2023-12-28 04:59:17,932][106225] Updated weights for policy 1, policy_version 1356877 (0.0006) [2023-12-28 04:59:17,987][106225] Updated weights for policy 1, policy_version 1356887 (0.0008) [2023-12-28 04:59:18,125][106226] Updated weights for policy 0, policy_version 1353603 (0.0006) [2023-12-28 04:59:18,179][106226] Updated weights for policy 0, policy_version 1353613 (0.0007) [2023-12-28 04:59:18,225][106226] Updated weights for policy 0, policy_version 1353623 (0.0010) [2023-12-28 04:59:18,587][106225] Updated weights for policy 1, policy_version 1356897 (0.0010) [2023-12-28 04:59:18,645][106225] Updated weights for policy 1, policy_version 1356907 (0.0010) [2023-12-28 04:59:18,707][106225] Updated weights for policy 1, policy_version 1356917 (0.0010) [2023-12-28 04:59:18,883][106226] Updated weights for policy 0, policy_version 1353633 (0.0010) [2023-12-28 04:59:18,944][106226] Updated weights for policy 0, policy_version 1353643 (0.0009) [2023-12-28 04:59:19,008][106226] Updated weights for policy 0, policy_version 1353653 (0.0011) [2023-12-28 04:59:19,072][106226] Updated weights for policy 0, policy_version 1353663 (0.0011) [2023-12-28 04:59:19,454][106225] Updated weights for policy 1, policy_version 1356927 (0.0010) [2023-12-28 04:59:19,541][106225] Updated weights for policy 1, policy_version 1356937 (0.0009) [2023-12-28 04:59:19,596][106225] Updated weights for policy 1, policy_version 1356947 (0.0008) [2023-12-28 04:59:19,789][106226] Updated weights for policy 0, policy_version 1353673 (0.0007) [2023-12-28 04:59:19,858][106226] Updated weights for policy 0, policy_version 1353683 (0.0008) [2023-12-28 04:59:19,917][106226] Updated weights for policy 0, policy_version 1353693 (0.0011) [2023-12-28 04:59:20,329][106225] Updated weights for policy 1, policy_version 1356957 (0.0009) [2023-12-28 04:59:20,382][106225] Updated weights for policy 1, policy_version 1356967 (0.0008) [2023-12-28 04:59:20,445][106225] Updated weights for policy 1, policy_version 1356977 (0.0008) [2023-12-28 04:59:20,637][106226] Updated weights for policy 0, policy_version 1353703 (0.0009) [2023-12-28 04:59:20,695][106226] Updated weights for policy 0, policy_version 1353713 (0.0008) [2023-12-28 04:59:20,759][106226] Updated weights for policy 0, policy_version 1353723 (0.0006) [2023-12-28 04:59:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 694059008. Throughput: 0: 10044.7, 1: 9737.3. Samples: 694070264. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:21,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-4.611')] [2023-12-28 04:59:21,225][106225] Updated weights for policy 1, policy_version 1356987 (0.0009) [2023-12-28 04:59:21,291][106225] Updated weights for policy 1, policy_version 1356997 (0.0008) [2023-12-28 04:59:21,354][106225] Updated weights for policy 1, policy_version 1357007 (0.0008) [2023-12-28 04:59:21,491][106226] Updated weights for policy 0, policy_version 1353733 (0.0008) [2023-12-28 04:59:21,550][106226] Updated weights for policy 0, policy_version 1353743 (0.0009) [2023-12-28 04:59:21,612][106226] Updated weights for policy 0, policy_version 1353753 (0.0009) [2023-12-28 04:59:22,111][106225] Updated weights for policy 1, policy_version 1357017 (0.0009) [2023-12-28 04:59:22,164][106225] Updated weights for policy 1, policy_version 1357027 (0.0005) [2023-12-28 04:59:22,220][106225] Updated weights for policy 1, policy_version 1357037 (0.0005) [2023-12-28 04:59:22,285][106225] Updated weights for policy 1, policy_version 1357047 (0.0007) [2023-12-28 04:59:22,426][106226] Updated weights for policy 0, policy_version 1353763 (0.0010) [2023-12-28 04:59:22,499][106226] Updated weights for policy 0, policy_version 1353773 (0.0008) [2023-12-28 04:59:22,561][106226] Updated weights for policy 0, policy_version 1353783 (0.0009) [2023-12-28 04:59:22,979][106225] Updated weights for policy 1, policy_version 1357057 (0.0009) [2023-12-28 04:59:23,037][106225] Updated weights for policy 1, policy_version 1357067 (0.0009) [2023-12-28 04:59:23,094][106225] Updated weights for policy 1, policy_version 1357077 (0.0008) [2023-12-28 04:59:23,296][106226] Updated weights for policy 0, policy_version 1353793 (0.0009) [2023-12-28 04:59:23,362][106226] Updated weights for policy 0, policy_version 1353803 (0.0009) [2023-12-28 04:59:23,424][106226] Updated weights for policy 0, policy_version 1353813 (0.0008) [2023-12-28 04:59:23,479][106226] Updated weights for policy 0, policy_version 1353823 (0.0009) [2023-12-28 04:59:23,798][106225] Updated weights for policy 1, policy_version 1357087 (0.0009) [2023-12-28 04:59:23,847][106225] Updated weights for policy 1, policy_version 1357097 (0.0008) [2023-12-28 04:59:23,895][106225] Updated weights for policy 1, policy_version 1357107 (0.0008) [2023-12-28 04:59:24,204][106226] Updated weights for policy 0, policy_version 1353833 (0.0006) [2023-12-28 04:59:24,266][106226] Updated weights for policy 0, policy_version 1353843 (0.0006) [2023-12-28 04:59:24,321][106226] Updated weights for policy 0, policy_version 1353853 (0.0006) [2023-12-28 04:59:24,654][106225] Updated weights for policy 1, policy_version 1357117 (0.0009) [2023-12-28 04:59:24,715][106225] Updated weights for policy 1, policy_version 1357127 (0.0008) [2023-12-28 04:59:24,773][106225] Updated weights for policy 1, policy_version 1357137 (0.0009) [2023-12-28 04:59:24,984][106226] Updated weights for policy 0, policy_version 1353863 (0.0009) [2023-12-28 04:59:25,037][106226] Updated weights for policy 0, policy_version 1353873 (0.0008) [2023-12-28 04:59:25,086][106226] Updated weights for policy 0, policy_version 1353883 (0.0008) [2023-12-28 04:59:25,463][106225] Updated weights for policy 1, policy_version 1357147 (0.0007) [2023-12-28 04:59:25,526][106225] Updated weights for policy 1, policy_version 1357157 (0.0006) [2023-12-28 04:59:25,576][106225] Updated weights for policy 1, policy_version 1357167 (0.0008) [2023-12-28 04:59:25,716][106226] Updated weights for policy 0, policy_version 1353893 (0.0007) [2023-12-28 04:59:25,776][106226] Updated weights for policy 0, policy_version 1353903 (0.0005) [2023-12-28 04:59:25,842][106226] Updated weights for policy 0, policy_version 1353913 (0.0005) [2023-12-28 04:59:26,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 694157312. Throughput: 0: 10004.5, 1: 9713.6. Samples: 694126684. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:26,176][105115] Avg episode reward: [(0, '-4.670'), (1, '-4.494')] [2023-12-28 04:59:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001357176_347488256.pth... [2023-12-28 04:59:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001353920_346669056.pth... [2023-12-28 04:59:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001356056_347201536.pth [2023-12-28 04:59:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001352768_346374144.pth [2023-12-28 04:59:26,329][106225] Updated weights for policy 1, policy_version 1357177 (0.0009) [2023-12-28 04:59:26,384][106226] Updated weights for policy 0, policy_version 1353923 (0.0006) [2023-12-28 04:59:26,384][106225] Updated weights for policy 1, policy_version 1357187 (0.0011) [2023-12-28 04:59:26,432][106225] Updated weights for policy 1, policy_version 1357197 (0.0008) [2023-12-28 04:59:26,437][106226] Updated weights for policy 0, policy_version 1353933 (0.0006) [2023-12-28 04:59:26,486][106225] Updated weights for policy 1, policy_version 1357207 (0.0005) [2023-12-28 04:59:26,491][106226] Updated weights for policy 0, policy_version 1353943 (0.0005) [2023-12-28 04:59:27,018][106226] Updated weights for policy 0, policy_version 1353953 (0.0006) [2023-12-28 04:59:27,073][106225] Updated weights for policy 1, policy_version 1357217 (0.0006) [2023-12-28 04:59:27,081][106226] Updated weights for policy 0, policy_version 1353963 (0.0009) [2023-12-28 04:59:27,130][106226] Updated weights for policy 0, policy_version 1353973 (0.0008) [2023-12-28 04:59:27,134][106225] Updated weights for policy 1, policy_version 1357227 (0.0005) [2023-12-28 04:59:27,189][106226] Updated weights for policy 0, policy_version 1353983 (0.0008) [2023-12-28 04:59:27,190][106225] Updated weights for policy 1, policy_version 1357237 (0.0005) [2023-12-28 04:59:27,804][106225] Updated weights for policy 1, policy_version 1357247 (0.0005) [2023-12-28 04:59:27,828][106226] Updated weights for policy 0, policy_version 1353993 (0.0006) [2023-12-28 04:59:27,858][106225] Updated weights for policy 1, policy_version 1357257 (0.0005) [2023-12-28 04:59:27,877][106226] Updated weights for policy 0, policy_version 1354003 (0.0007) [2023-12-28 04:59:27,913][106225] Updated weights for policy 1, policy_version 1357267 (0.0005) [2023-12-28 04:59:27,929][106226] Updated weights for policy 0, policy_version 1354013 (0.0008) [2023-12-28 04:59:28,532][106225] Updated weights for policy 1, policy_version 1357277 (0.0008) [2023-12-28 04:59:28,554][106226] Updated weights for policy 0, policy_version 1354023 (0.0006) [2023-12-28 04:59:28,593][106225] Updated weights for policy 1, policy_version 1357287 (0.0010) [2023-12-28 04:59:28,606][106226] Updated weights for policy 0, policy_version 1354033 (0.0006) [2023-12-28 04:59:28,650][106225] Updated weights for policy 1, policy_version 1357297 (0.0010) [2023-12-28 04:59:28,656][106226] Updated weights for policy 0, policy_version 1354043 (0.0006) [2023-12-28 04:59:29,371][106225] Updated weights for policy 1, policy_version 1357307 (0.0010) [2023-12-28 04:59:29,396][106226] Updated weights for policy 0, policy_version 1354053 (0.0007) [2023-12-28 04:59:29,426][106225] Updated weights for policy 1, policy_version 1357317 (0.0006) [2023-12-28 04:59:29,448][106226] Updated weights for policy 0, policy_version 1354063 (0.0006) [2023-12-28 04:59:29,474][106225] Updated weights for policy 1, policy_version 1357327 (0.0006) [2023-12-28 04:59:29,494][106226] Updated weights for policy 0, policy_version 1354073 (0.0007) [2023-12-28 04:59:30,173][106225] Updated weights for policy 1, policy_version 1357337 (0.0009) [2023-12-28 04:59:30,235][106225] Updated weights for policy 1, policy_version 1357347 (0.0006) [2023-12-28 04:59:30,292][106226] Updated weights for policy 0, policy_version 1354083 (0.0008) [2023-12-28 04:59:30,296][106225] Updated weights for policy 1, policy_version 1357357 (0.0007) [2023-12-28 04:59:30,347][106226] Updated weights for policy 0, policy_version 1354093 (0.0011) [2023-12-28 04:59:30,357][106225] Updated weights for policy 1, policy_version 1357367 (0.0006) [2023-12-28 04:59:30,398][106226] Updated weights for policy 0, policy_version 1354103 (0.0010) [2023-12-28 04:59:31,038][106226] Updated weights for policy 0, policy_version 1354113 (0.0011) [2023-12-28 04:59:31,077][106225] Updated weights for policy 1, policy_version 1357377 (0.0008) [2023-12-28 04:59:31,095][106226] Updated weights for policy 0, policy_version 1354123 (0.0009) [2023-12-28 04:59:31,136][106225] Updated weights for policy 1, policy_version 1357387 (0.0008) [2023-12-28 04:59:31,151][106226] Updated weights for policy 0, policy_version 1354133 (0.0007) [2023-12-28 04:59:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 694255616. Throughput: 0: 10085.0, 1: 9770.8. Samples: 694252112. Policy #0 lag: (min: 16.0, avg: 39.1, max: 40.0) [2023-12-28 04:59:31,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.676')] [2023-12-28 04:59:31,198][106225] Updated weights for policy 1, policy_version 1357397 (0.0007) [2023-12-28 04:59:31,211][106226] Updated weights for policy 0, policy_version 1354143 (0.0008) [2023-12-28 04:59:31,922][106225] Updated weights for policy 1, policy_version 1357407 (0.0007) [2023-12-28 04:59:31,941][106226] Updated weights for policy 0, policy_version 1354153 (0.0007) [2023-12-28 04:59:31,979][106225] Updated weights for policy 1, policy_version 1357417 (0.0005) [2023-12-28 04:59:32,001][106226] Updated weights for policy 0, policy_version 1354163 (0.0008) [2023-12-28 04:59:32,044][106225] Updated weights for policy 1, policy_version 1357427 (0.0008) [2023-12-28 04:59:32,061][106226] Updated weights for policy 0, policy_version 1354173 (0.0008) [2023-12-28 04:59:32,717][106225] Updated weights for policy 1, policy_version 1357437 (0.0008) [2023-12-28 04:59:32,759][106226] Updated weights for policy 0, policy_version 1354183 (0.0007) [2023-12-28 04:59:32,778][106225] Updated weights for policy 1, policy_version 1357447 (0.0007) [2023-12-28 04:59:32,820][106226] Updated weights for policy 0, policy_version 1354193 (0.0010) [2023-12-28 04:59:32,836][106225] Updated weights for policy 1, policy_version 1357457 (0.0010) [2023-12-28 04:59:32,880][106226] Updated weights for policy 0, policy_version 1354203 (0.0007) [2023-12-28 04:59:33,397][106225] Updated weights for policy 1, policy_version 1357467 (0.0007) [2023-12-28 04:59:33,444][106225] Updated weights for policy 1, policy_version 1357477 (0.0008) [2023-12-28 04:59:33,494][106225] Updated weights for policy 1, policy_version 1357487 (0.0007) [2023-12-28 04:59:33,585][106226] Updated weights for policy 0, policy_version 1354213 (0.0010) [2023-12-28 04:59:33,638][106226] Updated weights for policy 0, policy_version 1354223 (0.0010) [2023-12-28 04:59:33,692][106226] Updated weights for policy 0, policy_version 1354233 (0.0010) [2023-12-28 04:59:34,125][106225] Updated weights for policy 1, policy_version 1357497 (0.0007) [2023-12-28 04:59:34,188][106225] Updated weights for policy 1, policy_version 1357507 (0.0009) [2023-12-28 04:59:34,240][106225] Updated weights for policy 1, policy_version 1357517 (0.0008) [2023-12-28 04:59:34,301][106225] Updated weights for policy 1, policy_version 1357527 (0.0008) [2023-12-28 04:59:34,381][106226] Updated weights for policy 0, policy_version 1354243 (0.0006) [2023-12-28 04:59:34,448][106226] Updated weights for policy 0, policy_version 1354253 (0.0009) [2023-12-28 04:59:34,509][106226] Updated weights for policy 0, policy_version 1354263 (0.0008) [2023-12-28 04:59:34,981][106225] Updated weights for policy 1, policy_version 1357537 (0.0008) [2023-12-28 04:59:35,033][106225] Updated weights for policy 1, policy_version 1357547 (0.0009) [2023-12-28 04:59:35,085][106225] Updated weights for policy 1, policy_version 1357557 (0.0008) [2023-12-28 04:59:35,243][106226] Updated weights for policy 0, policy_version 1354273 (0.0008) [2023-12-28 04:59:35,297][106226] Updated weights for policy 0, policy_version 1354283 (0.0005) [2023-12-28 04:59:35,348][106226] Updated weights for policy 0, policy_version 1354293 (0.0009) [2023-12-28 04:59:35,406][106226] Updated weights for policy 0, policy_version 1354303 (0.0009) [2023-12-28 04:59:35,761][106225] Updated weights for policy 1, policy_version 1357567 (0.0009) [2023-12-28 04:59:35,823][106225] Updated weights for policy 1, policy_version 1357577 (0.0008) [2023-12-28 04:59:35,882][106225] Updated weights for policy 1, policy_version 1357587 (0.0008) [2023-12-28 04:59:36,141][106226] Updated weights for policy 0, policy_version 1354313 (0.0008) [2023-12-28 04:59:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 694362112. Throughput: 0: 10063.7, 1: 9772.5. Samples: 694373400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:59:36,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-4.238')] [2023-12-28 04:59:36,176][106141] Saving new best policy, reward=-4.238! [2023-12-28 04:59:36,212][106226] Updated weights for policy 0, policy_version 1354323 (0.0006) [2023-12-28 04:59:36,275][106226] Updated weights for policy 0, policy_version 1354333 (0.0006) [2023-12-28 04:59:36,603][106225] Updated weights for policy 1, policy_version 1357597 (0.0008) [2023-12-28 04:59:36,666][106225] Updated weights for policy 1, policy_version 1357607 (0.0008) [2023-12-28 04:59:36,724][106225] Updated weights for policy 1, policy_version 1357617 (0.0008) [2023-12-28 04:59:36,954][106226] Updated weights for policy 0, policy_version 1354343 (0.0009) [2023-12-28 04:59:37,007][106226] Updated weights for policy 0, policy_version 1354353 (0.0011) [2023-12-28 04:59:37,064][106226] Updated weights for policy 0, policy_version 1354363 (0.0010) [2023-12-28 04:59:37,397][106225] Updated weights for policy 1, policy_version 1357627 (0.0007) [2023-12-28 04:59:37,458][106225] Updated weights for policy 1, policy_version 1357637 (0.0010) [2023-12-28 04:59:37,514][106225] Updated weights for policy 1, policy_version 1357647 (0.0008) [2023-12-28 04:59:37,747][106226] Updated weights for policy 0, policy_version 1354373 (0.0010) [2023-12-28 04:59:37,809][106226] Updated weights for policy 0, policy_version 1354383 (0.0005) [2023-12-28 04:59:37,864][106226] Updated weights for policy 0, policy_version 1354393 (0.0005) [2023-12-28 04:59:38,237][106225] Updated weights for policy 1, policy_version 1357657 (0.0007) [2023-12-28 04:59:38,293][106225] Updated weights for policy 1, policy_version 1357667 (0.0007) [2023-12-28 04:59:38,352][106225] Updated weights for policy 1, policy_version 1357677 (0.0008) [2023-12-28 04:59:38,407][106225] Updated weights for policy 1, policy_version 1357687 (0.0007) [2023-12-28 04:59:38,577][106226] Updated weights for policy 0, policy_version 1354403 (0.0011) [2023-12-28 04:59:38,635][106226] Updated weights for policy 0, policy_version 1354413 (0.0010) [2023-12-28 04:59:38,699][106226] Updated weights for policy 0, policy_version 1354423 (0.0011) [2023-12-28 04:59:39,152][106225] Updated weights for policy 1, policy_version 1357697 (0.0010) [2023-12-28 04:59:39,209][106225] Updated weights for policy 1, policy_version 1357707 (0.0010) [2023-12-28 04:59:39,275][106225] Updated weights for policy 1, policy_version 1357717 (0.0009) [2023-12-28 04:59:39,352][106226] Updated weights for policy 0, policy_version 1354433 (0.0010) [2023-12-28 04:59:39,430][106226] Updated weights for policy 0, policy_version 1354443 (0.0010) [2023-12-28 04:59:39,496][106226] Updated weights for policy 0, policy_version 1354453 (0.0009) [2023-12-28 04:59:39,561][106226] Updated weights for policy 0, policy_version 1354463 (0.0008) [2023-12-28 04:59:40,097][106225] Updated weights for policy 1, policy_version 1357727 (0.0009) [2023-12-28 04:59:40,162][106225] Updated weights for policy 1, policy_version 1357737 (0.0009) [2023-12-28 04:59:40,222][106225] Updated weights for policy 1, policy_version 1357747 (0.0010) [2023-12-28 04:59:40,352][106226] Updated weights for policy 0, policy_version 1354473 (0.0008) [2023-12-28 04:59:40,416][106226] Updated weights for policy 0, policy_version 1354483 (0.0008) [2023-12-28 04:59:40,476][106226] Updated weights for policy 0, policy_version 1354493 (0.0006) [2023-12-28 04:59:40,969][106225] Updated weights for policy 1, policy_version 1357757 (0.0011) [2023-12-28 04:59:41,037][106225] Updated weights for policy 1, policy_version 1357767 (0.0010) [2023-12-28 04:59:41,098][106225] Updated weights for policy 1, policy_version 1357777 (0.0010) [2023-12-28 04:59:41,157][106226] Updated weights for policy 0, policy_version 1354503 (0.0008) [2023-12-28 04:59:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 694460416. Throughput: 0: 10043.4, 1: 9814.6. Samples: 694432516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:59:41,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-4.608')] [2023-12-28 04:59:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001357784_347643904.pth... [2023-12-28 04:59:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001356632_347348992.pth [2023-12-28 04:59:41,224][106226] Updated weights for policy 0, policy_version 1354513 (0.0009) [2023-12-28 04:59:41,290][106226] Updated weights for policy 0, policy_version 1354523 (0.0008) [2023-12-28 04:59:41,321][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001354528_346824704.pth... [2023-12-28 04:59:41,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001353344_346521600.pth [2023-12-28 04:59:41,860][106225] Updated weights for policy 1, policy_version 1357787 (0.0009) [2023-12-28 04:59:41,926][106225] Updated weights for policy 1, policy_version 1357797 (0.0009) [2023-12-28 04:59:41,995][106225] Updated weights for policy 1, policy_version 1357807 (0.0009) [2023-12-28 04:59:42,065][106226] Updated weights for policy 0, policy_version 1354533 (0.0008) [2023-12-28 04:59:42,130][106226] Updated weights for policy 0, policy_version 1354543 (0.0008) [2023-12-28 04:59:42,194][106226] Updated weights for policy 0, policy_version 1354553 (0.0009) [2023-12-28 04:59:42,690][106225] Updated weights for policy 1, policy_version 1357817 (0.0008) [2023-12-28 04:59:42,757][106225] Updated weights for policy 1, policy_version 1357827 (0.0009) [2023-12-28 04:59:42,820][106225] Updated weights for policy 1, policy_version 1357837 (0.0008) [2023-12-28 04:59:42,882][106225] Updated weights for policy 1, policy_version 1357847 (0.0008) [2023-12-28 04:59:42,959][106226] Updated weights for policy 0, policy_version 1354563 (0.0009) [2023-12-28 04:59:43,011][106226] Updated weights for policy 0, policy_version 1354573 (0.0007) [2023-12-28 04:59:43,067][106226] Updated weights for policy 0, policy_version 1354583 (0.0005) [2023-12-28 04:59:43,535][106225] Updated weights for policy 1, policy_version 1357857 (0.0008) [2023-12-28 04:59:43,584][106225] Updated weights for policy 1, policy_version 1357867 (0.0009) [2023-12-28 04:59:43,634][106225] Updated weights for policy 1, policy_version 1357877 (0.0008) [2023-12-28 04:59:43,755][106226] Updated weights for policy 0, policy_version 1354593 (0.0005) [2023-12-28 04:59:43,825][106226] Updated weights for policy 0, policy_version 1354603 (0.0005) [2023-12-28 04:59:43,892][106226] Updated weights for policy 0, policy_version 1354613 (0.0006) [2023-12-28 04:59:43,946][106226] Updated weights for policy 0, policy_version 1354623 (0.0005) [2023-12-28 04:59:44,243][106225] Updated weights for policy 1, policy_version 1357887 (0.0007) [2023-12-28 04:59:44,303][106225] Updated weights for policy 1, policy_version 1357897 (0.0005) [2023-12-28 04:59:44,366][106225] Updated weights for policy 1, policy_version 1357907 (0.0005) [2023-12-28 04:59:44,554][106226] Updated weights for policy 0, policy_version 1354633 (0.0008) [2023-12-28 04:59:44,618][106226] Updated weights for policy 0, policy_version 1354643 (0.0008) [2023-12-28 04:59:44,677][106226] Updated weights for policy 0, policy_version 1354653 (0.0008) [2023-12-28 04:59:45,015][106225] Updated weights for policy 1, policy_version 1357917 (0.0006) [2023-12-28 04:59:45,080][106225] Updated weights for policy 1, policy_version 1357927 (0.0006) [2023-12-28 04:59:45,150][106225] Updated weights for policy 1, policy_version 1357937 (0.0008) [2023-12-28 04:59:45,378][106226] Updated weights for policy 0, policy_version 1354663 (0.0009) [2023-12-28 04:59:45,441][106226] Updated weights for policy 0, policy_version 1354673 (0.0010) [2023-12-28 04:59:45,501][106226] Updated weights for policy 0, policy_version 1354683 (0.0010) [2023-12-28 04:59:45,804][106225] Updated weights for policy 1, policy_version 1357947 (0.0007) [2023-12-28 04:59:45,854][106225] Updated weights for policy 1, policy_version 1357957 (0.0008) [2023-12-28 04:59:45,922][106225] Updated weights for policy 1, policy_version 1357967 (0.0006) [2023-12-28 04:59:46,149][106226] Updated weights for policy 0, policy_version 1354693 (0.0010) [2023-12-28 04:59:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 694558720. Throughput: 0: 9953.4, 1: 9886.5. Samples: 694549140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:59:46,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.575')] [2023-12-28 04:59:46,212][106226] Updated weights for policy 0, policy_version 1354703 (0.0009) [2023-12-28 04:59:46,282][106226] Updated weights for policy 0, policy_version 1354713 (0.0005) [2023-12-28 04:59:46,597][106225] Updated weights for policy 1, policy_version 1357977 (0.0008) [2023-12-28 04:59:46,640][106225] Updated weights for policy 1, policy_version 1357987 (0.0007) [2023-12-28 04:59:46,689][106225] Updated weights for policy 1, policy_version 1357997 (0.0008) [2023-12-28 04:59:46,746][106225] Updated weights for policy 1, policy_version 1358007 (0.0009) [2023-12-28 04:59:46,925][106226] Updated weights for policy 0, policy_version 1354723 (0.0005) [2023-12-28 04:59:46,998][106226] Updated weights for policy 0, policy_version 1354733 (0.0011) [2023-12-28 04:59:47,063][106226] Updated weights for policy 0, policy_version 1354743 (0.0010) [2023-12-28 04:59:47,367][106225] Updated weights for policy 1, policy_version 1358017 (0.0006) [2023-12-28 04:59:47,425][106225] Updated weights for policy 1, policy_version 1358027 (0.0005) [2023-12-28 04:59:47,481][106225] Updated weights for policy 1, policy_version 1358037 (0.0006) [2023-12-28 04:59:47,739][106226] Updated weights for policy 0, policy_version 1354753 (0.0011) [2023-12-28 04:59:47,803][106226] Updated weights for policy 0, policy_version 1354763 (0.0011) [2023-12-28 04:59:47,870][106226] Updated weights for policy 0, policy_version 1354773 (0.0011) [2023-12-28 04:59:47,934][106226] Updated weights for policy 0, policy_version 1354783 (0.0010) [2023-12-28 04:59:48,150][106225] Updated weights for policy 1, policy_version 1358047 (0.0011) [2023-12-28 04:59:48,216][106225] Updated weights for policy 1, policy_version 1358057 (0.0011) [2023-12-28 04:59:48,278][106225] Updated weights for policy 1, policy_version 1358067 (0.0009) [2023-12-28 04:59:48,679][106226] Updated weights for policy 0, policy_version 1354793 (0.0011) [2023-12-28 04:59:48,740][106226] Updated weights for policy 0, policy_version 1354803 (0.0011) [2023-12-28 04:59:48,802][106226] Updated weights for policy 0, policy_version 1354813 (0.0011) [2023-12-28 04:59:48,958][106225] Updated weights for policy 1, policy_version 1358077 (0.0008) [2023-12-28 04:59:49,016][106225] Updated weights for policy 1, policy_version 1358087 (0.0008) [2023-12-28 04:59:49,069][106225] Updated weights for policy 1, policy_version 1358097 (0.0007) [2023-12-28 04:59:49,587][106226] Updated weights for policy 0, policy_version 1354823 (0.0011) [2023-12-28 04:59:49,645][106226] Updated weights for policy 0, policy_version 1354833 (0.0011) [2023-12-28 04:59:49,699][106226] Updated weights for policy 0, policy_version 1354843 (0.0010) [2023-12-28 04:59:49,785][106225] Updated weights for policy 1, policy_version 1358107 (0.0007) [2023-12-28 04:59:49,856][106225] Updated weights for policy 1, policy_version 1358117 (0.0008) [2023-12-28 04:59:49,926][106225] Updated weights for policy 1, policy_version 1358127 (0.0010) [2023-12-28 04:59:50,390][106226] Updated weights for policy 0, policy_version 1354853 (0.0011) [2023-12-28 04:59:50,440][106226] Updated weights for policy 0, policy_version 1354863 (0.0010) [2023-12-28 04:59:50,505][106226] Updated weights for policy 0, policy_version 1354873 (0.0011) [2023-12-28 04:59:50,649][106225] Updated weights for policy 1, policy_version 1358137 (0.0008) [2023-12-28 04:59:50,711][106225] Updated weights for policy 1, policy_version 1358147 (0.0009) [2023-12-28 04:59:50,771][106225] Updated weights for policy 1, policy_version 1358157 (0.0010) [2023-12-28 04:59:50,832][106225] Updated weights for policy 1, policy_version 1358167 (0.0010) [2023-12-28 04:59:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 694657024. Throughput: 0: 9887.6, 1: 9883.0. Samples: 694668328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:59:51,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.699')] [2023-12-28 04:59:51,243][106226] Updated weights for policy 0, policy_version 1354883 (0.0011) [2023-12-28 04:59:51,308][106226] Updated weights for policy 0, policy_version 1354893 (0.0007) [2023-12-28 04:59:51,384][106226] Updated weights for policy 0, policy_version 1354903 (0.0007) [2023-12-28 04:59:51,539][106225] Updated weights for policy 1, policy_version 1358177 (0.0008) [2023-12-28 04:59:51,599][106225] Updated weights for policy 1, policy_version 1358187 (0.0008) [2023-12-28 04:59:51,663][106225] Updated weights for policy 1, policy_version 1358197 (0.0007) [2023-12-28 04:59:52,108][106226] Updated weights for policy 0, policy_version 1354913 (0.0008) [2023-12-28 04:59:52,162][106226] Updated weights for policy 0, policy_version 1354923 (0.0009) [2023-12-28 04:59:52,215][106226] Updated weights for policy 0, policy_version 1354933 (0.0007) [2023-12-28 04:59:52,283][106226] Updated weights for policy 0, policy_version 1354943 (0.0007) [2023-12-28 04:59:52,323][106225] Updated weights for policy 1, policy_version 1358207 (0.0009) [2023-12-28 04:59:52,387][106225] Updated weights for policy 1, policy_version 1358217 (0.0010) [2023-12-28 04:59:52,446][106225] Updated weights for policy 1, policy_version 1358227 (0.0007) [2023-12-28 04:59:53,040][106226] Updated weights for policy 0, policy_version 1354953 (0.0008) [2023-12-28 04:59:53,070][106225] Updated weights for policy 1, policy_version 1358237 (0.0007) [2023-12-28 04:59:53,088][106226] Updated weights for policy 0, policy_version 1354963 (0.0009) [2023-12-28 04:59:53,121][106225] Updated weights for policy 1, policy_version 1358247 (0.0007) [2023-12-28 04:59:53,141][106226] Updated weights for policy 0, policy_version 1354973 (0.0005) [2023-12-28 04:59:53,182][106225] Updated weights for policy 1, policy_version 1358257 (0.0008) [2023-12-28 04:59:53,794][106226] Updated weights for policy 0, policy_version 1354983 (0.0005) [2023-12-28 04:59:53,821][106225] Updated weights for policy 1, policy_version 1358267 (0.0009) [2023-12-28 04:59:53,844][106226] Updated weights for policy 0, policy_version 1354993 (0.0005) [2023-12-28 04:59:53,890][106225] Updated weights for policy 1, policy_version 1358277 (0.0008) [2023-12-28 04:59:53,902][106226] Updated weights for policy 0, policy_version 1355003 (0.0006) [2023-12-28 04:59:53,957][106225] Updated weights for policy 1, policy_version 1358287 (0.0005) [2023-12-28 04:59:54,536][106225] Updated weights for policy 1, policy_version 1358297 (0.0006) [2023-12-28 04:59:54,539][106226] Updated weights for policy 0, policy_version 1355013 (0.0007) [2023-12-28 04:59:54,596][106225] Updated weights for policy 1, policy_version 1358307 (0.0007) [2023-12-28 04:59:54,598][106226] Updated weights for policy 0, policy_version 1355023 (0.0006) [2023-12-28 04:59:54,648][106225] Updated weights for policy 1, policy_version 1358317 (0.0006) [2023-12-28 04:59:54,652][106226] Updated weights for policy 0, policy_version 1355033 (0.0007) [2023-12-28 04:59:54,707][106225] Updated weights for policy 1, policy_version 1358327 (0.0009) [2023-12-28 04:59:55,354][106225] Updated weights for policy 1, policy_version 1358337 (0.0007) [2023-12-28 04:59:55,367][106226] Updated weights for policy 0, policy_version 1355043 (0.0007) [2023-12-28 04:59:55,405][106225] Updated weights for policy 1, policy_version 1358347 (0.0005) [2023-12-28 04:59:55,426][106226] Updated weights for policy 0, policy_version 1355053 (0.0006) [2023-12-28 04:59:55,456][106225] Updated weights for policy 1, policy_version 1358357 (0.0005) [2023-12-28 04:59:55,478][106226] Updated weights for policy 0, policy_version 1355063 (0.0005) [2023-12-28 04:59:56,032][106226] Updated weights for policy 0, policy_version 1355073 (0.0008) [2023-12-28 04:59:56,083][106226] Updated weights for policy 0, policy_version 1355083 (0.0007) [2023-12-28 04:59:56,134][106226] Updated weights for policy 0, policy_version 1355093 (0.0007) [2023-12-28 04:59:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 694755328. Throughput: 0: 9939.7, 1: 9904.7. Samples: 694729596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 04:59:56,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.555')] [2023-12-28 04:59:56,180][106225] Updated weights for policy 1, policy_version 1358367 (0.0007) [2023-12-28 04:59:56,189][106226] Updated weights for policy 0, policy_version 1355103 (0.0005) [2023-12-28 04:59:56,194][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001355104_346972160.pth... [2023-12-28 04:59:56,198][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001353920_346669056.pth [2023-12-28 04:59:56,239][106225] Updated weights for policy 1, policy_version 1358377 (0.0007) [2023-12-28 04:59:56,297][106225] Updated weights for policy 1, policy_version 1358387 (0.0009) [2023-12-28 04:59:56,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001358392_347799552.pth... [2023-12-28 04:59:56,333][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001357176_347488256.pth [2023-12-28 04:59:56,811][106226] Updated weights for policy 0, policy_version 1355113 (0.0010) [2023-12-28 04:59:56,860][106226] Updated weights for policy 0, policy_version 1355123 (0.0010) [2023-12-28 04:59:56,870][106225] Updated weights for policy 1, policy_version 1358397 (0.0006) [2023-12-28 04:59:56,914][106226] Updated weights for policy 0, policy_version 1355133 (0.0005) [2023-12-28 04:59:56,924][106225] Updated weights for policy 1, policy_version 1358407 (0.0007) [2023-12-28 04:59:56,982][106225] Updated weights for policy 1, policy_version 1358417 (0.0006) [2023-12-28 04:59:57,555][106226] Updated weights for policy 0, policy_version 1355143 (0.0010) [2023-12-28 04:59:57,572][106225] Updated weights for policy 1, policy_version 1358427 (0.0008) [2023-12-28 04:59:57,609][106226] Updated weights for policy 0, policy_version 1355153 (0.0010) [2023-12-28 04:59:57,619][106225] Updated weights for policy 1, policy_version 1358437 (0.0005) [2023-12-28 04:59:57,659][106226] Updated weights for policy 0, policy_version 1355163 (0.0010) [2023-12-28 04:59:57,670][106225] Updated weights for policy 1, policy_version 1358447 (0.0005) [2023-12-28 04:59:58,314][106225] Updated weights for policy 1, policy_version 1358457 (0.0006) [2023-12-28 04:59:58,390][106225] Updated weights for policy 1, policy_version 1358468 (0.0009) [2023-12-28 04:59:58,400][106226] Updated weights for policy 0, policy_version 1355173 (0.0009) [2023-12-28 04:59:58,455][106225] Updated weights for policy 1, policy_version 1358478 (0.0009) [2023-12-28 04:59:58,461][106226] Updated weights for policy 0, policy_version 1355183 (0.0008) [2023-12-28 04:59:58,519][106225] Updated weights for policy 1, policy_version 1358488 (0.0008) [2023-12-28 04:59:58,527][106226] Updated weights for policy 0, policy_version 1355193 (0.0008) [2023-12-28 04:59:59,293][106225] Updated weights for policy 1, policy_version 1358498 (0.0009) [2023-12-28 04:59:59,316][106226] Updated weights for policy 0, policy_version 1355203 (0.0007) [2023-12-28 04:59:59,357][106225] Updated weights for policy 1, policy_version 1358508 (0.0011) [2023-12-28 04:59:59,402][106226] Updated weights for policy 0, policy_version 1355213 (0.0007) [2023-12-28 04:59:59,421][106225] Updated weights for policy 1, policy_version 1358518 (0.0009) [2023-12-28 04:59:59,455][106226] Updated weights for policy 0, policy_version 1355223 (0.0007) [2023-12-28 05:00:00,177][106226] Updated weights for policy 0, policy_version 1355233 (0.0008) [2023-12-28 05:00:00,197][106225] Updated weights for policy 1, policy_version 1358528 (0.0009) [2023-12-28 05:00:00,233][106226] Updated weights for policy 0, policy_version 1355243 (0.0006) [2023-12-28 05:00:00,244][106225] Updated weights for policy 1, policy_version 1358538 (0.0008) [2023-12-28 05:00:00,299][106225] Updated weights for policy 1, policy_version 1358548 (0.0008) [2023-12-28 05:00:00,299][106226] Updated weights for policy 0, policy_version 1355253 (0.0006) [2023-12-28 05:00:00,364][106226] Updated weights for policy 0, policy_version 1355263 (0.0007) [2023-12-28 05:00:00,967][106226] Updated weights for policy 0, policy_version 1355273 (0.0006) [2023-12-28 05:00:01,030][106226] Updated weights for policy 0, policy_version 1355283 (0.0006) [2023-12-28 05:00:01,093][106226] Updated weights for policy 0, policy_version 1355293 (0.0010) [2023-12-28 05:00:01,112][106225] Updated weights for policy 1, policy_version 1358558 (0.0007) [2023-12-28 05:00:01,166][106225] Updated weights for policy 1, policy_version 1358568 (0.0008) [2023-12-28 05:00:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 694861824. Throughput: 0: 10034.2, 1: 9980.0. Samples: 694852804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:01,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.604')] [2023-12-28 05:00:01,230][106225] Updated weights for policy 1, policy_version 1358578 (0.0006) [2023-12-28 05:00:01,738][106226] Updated weights for policy 0, policy_version 1355303 (0.0009) [2023-12-28 05:00:01,799][106226] Updated weights for policy 0, policy_version 1355313 (0.0007) [2023-12-28 05:00:01,858][106226] Updated weights for policy 0, policy_version 1355323 (0.0009) [2023-12-28 05:00:01,968][106225] Updated weights for policy 1, policy_version 1358588 (0.0008) [2023-12-28 05:00:02,023][106225] Updated weights for policy 1, policy_version 1358598 (0.0009) [2023-12-28 05:00:02,074][106225] Updated weights for policy 1, policy_version 1358608 (0.0008) [2023-12-28 05:00:02,569][106226] Updated weights for policy 0, policy_version 1355333 (0.0007) [2023-12-28 05:00:02,635][106226] Updated weights for policy 0, policy_version 1355343 (0.0005) [2023-12-28 05:00:02,705][106226] Updated weights for policy 0, policy_version 1355353 (0.0007) [2023-12-28 05:00:02,816][106225] Updated weights for policy 1, policy_version 1358618 (0.0007) [2023-12-28 05:00:02,864][106225] Updated weights for policy 1, policy_version 1358628 (0.0006) [2023-12-28 05:00:02,920][106225] Updated weights for policy 1, policy_version 1358638 (0.0006) [2023-12-28 05:00:02,976][106225] Updated weights for policy 1, policy_version 1358648 (0.0005) [2023-12-28 05:00:03,317][106226] Updated weights for policy 0, policy_version 1355363 (0.0007) [2023-12-28 05:00:03,363][106226] Updated weights for policy 0, policy_version 1355373 (0.0006) [2023-12-28 05:00:03,414][106226] Updated weights for policy 0, policy_version 1355383 (0.0007) [2023-12-28 05:00:03,591][106225] Updated weights for policy 1, policy_version 1358658 (0.0008) [2023-12-28 05:00:03,645][106225] Updated weights for policy 1, policy_version 1358668 (0.0008) [2023-12-28 05:00:03,690][106225] Updated weights for policy 1, policy_version 1358678 (0.0007) [2023-12-28 05:00:04,130][106226] Updated weights for policy 0, policy_version 1355393 (0.0008) [2023-12-28 05:00:04,198][106226] Updated weights for policy 0, policy_version 1355403 (0.0008) [2023-12-28 05:00:04,259][106226] Updated weights for policy 0, policy_version 1355413 (0.0009) [2023-12-28 05:00:04,330][106226] Updated weights for policy 0, policy_version 1355423 (0.0008) [2023-12-28 05:00:04,439][106225] Updated weights for policy 1, policy_version 1358688 (0.0010) [2023-12-28 05:00:04,487][106225] Updated weights for policy 1, policy_version 1358698 (0.0010) [2023-12-28 05:00:04,541][106225] Updated weights for policy 1, policy_version 1358708 (0.0010) [2023-12-28 05:00:05,046][106226] Updated weights for policy 0, policy_version 1355433 (0.0008) [2023-12-28 05:00:05,099][106226] Updated weights for policy 0, policy_version 1355443 (0.0007) [2023-12-28 05:00:05,161][106226] Updated weights for policy 0, policy_version 1355453 (0.0009) [2023-12-28 05:00:05,271][106225] Updated weights for policy 1, policy_version 1358718 (0.0010) [2023-12-28 05:00:05,324][106225] Updated weights for policy 1, policy_version 1358728 (0.0010) [2023-12-28 05:00:05,384][106225] Updated weights for policy 1, policy_version 1358738 (0.0010) [2023-12-28 05:00:05,730][106226] Updated weights for policy 0, policy_version 1355463 (0.0005) [2023-12-28 05:00:05,795][106226] Updated weights for policy 0, policy_version 1355473 (0.0005) [2023-12-28 05:00:05,859][106226] Updated weights for policy 0, policy_version 1355483 (0.0005) [2023-12-28 05:00:05,990][106225] Updated weights for policy 1, policy_version 1358748 (0.0010) [2023-12-28 05:00:06,049][106225] Updated weights for policy 1, policy_version 1358758 (0.0009) [2023-12-28 05:00:06,108][106225] Updated weights for policy 1, policy_version 1358768 (0.0006) [2023-12-28 05:00:06,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 694968320. Throughput: 0: 10030.7, 1: 10040.1. Samples: 694973448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:06,175][105115] Avg episode reward: [(0, '-4.735'), (1, '-4.575')] [2023-12-28 05:00:06,539][106226] Updated weights for policy 0, policy_version 1355493 (0.0008) [2023-12-28 05:00:06,598][106226] Updated weights for policy 0, policy_version 1355503 (0.0008) [2023-12-28 05:00:06,662][106226] Updated weights for policy 0, policy_version 1355513 (0.0008) [2023-12-28 05:00:06,805][106225] Updated weights for policy 1, policy_version 1358778 (0.0010) [2023-12-28 05:00:06,869][106225] Updated weights for policy 1, policy_version 1358788 (0.0011) [2023-12-28 05:00:06,931][106225] Updated weights for policy 1, policy_version 1358798 (0.0010) [2023-12-28 05:00:06,993][106225] Updated weights for policy 1, policy_version 1358808 (0.0010) [2023-12-28 05:00:07,296][106226] Updated weights for policy 0, policy_version 1355523 (0.0006) [2023-12-28 05:00:07,360][106226] Updated weights for policy 0, policy_version 1355533 (0.0008) [2023-12-28 05:00:07,419][106226] Updated weights for policy 0, policy_version 1355543 (0.0008) [2023-12-28 05:00:07,641][106225] Updated weights for policy 1, policy_version 1358818 (0.0010) [2023-12-28 05:00:07,701][106225] Updated weights for policy 1, policy_version 1358828 (0.0010) [2023-12-28 05:00:07,759][106225] Updated weights for policy 1, policy_version 1358838 (0.0010) [2023-12-28 05:00:08,043][106226] Updated weights for policy 0, policy_version 1355553 (0.0008) [2023-12-28 05:00:08,111][106226] Updated weights for policy 0, policy_version 1355563 (0.0005) [2023-12-28 05:00:08,174][106226] Updated weights for policy 0, policy_version 1355573 (0.0005) [2023-12-28 05:00:08,243][106226] Updated weights for policy 0, policy_version 1355583 (0.0005) [2023-12-28 05:00:08,468][106225] Updated weights for policy 1, policy_version 1358848 (0.0007) [2023-12-28 05:00:08,528][106225] Updated weights for policy 1, policy_version 1358858 (0.0008) [2023-12-28 05:00:08,589][106225] Updated weights for policy 1, policy_version 1358868 (0.0010) [2023-12-28 05:00:08,880][106226] Updated weights for policy 0, policy_version 1355593 (0.0010) [2023-12-28 05:00:08,932][106226] Updated weights for policy 0, policy_version 1355603 (0.0010) [2023-12-28 05:00:08,999][106226] Updated weights for policy 0, policy_version 1355613 (0.0010) [2023-12-28 05:00:09,336][106225] Updated weights for policy 1, policy_version 1358878 (0.0008) [2023-12-28 05:00:09,405][106225] Updated weights for policy 1, policy_version 1358888 (0.0009) [2023-12-28 05:00:09,478][106225] Updated weights for policy 1, policy_version 1358898 (0.0008) [2023-12-28 05:00:09,688][106226] Updated weights for policy 0, policy_version 1355623 (0.0010) [2023-12-28 05:00:09,749][106226] Updated weights for policy 0, policy_version 1355633 (0.0011) [2023-12-28 05:00:09,807][106226] Updated weights for policy 0, policy_version 1355643 (0.0010) [2023-12-28 05:00:10,202][106225] Updated weights for policy 1, policy_version 1358908 (0.0009) [2023-12-28 05:00:10,251][106225] Updated weights for policy 1, policy_version 1358918 (0.0009) [2023-12-28 05:00:10,303][106225] Updated weights for policy 1, policy_version 1358928 (0.0008) [2023-12-28 05:00:10,554][106226] Updated weights for policy 0, policy_version 1355653 (0.0009) [2023-12-28 05:00:10,608][106226] Updated weights for policy 0, policy_version 1355663 (0.0011) [2023-12-28 05:00:10,666][106226] Updated weights for policy 0, policy_version 1355673 (0.0011) [2023-12-28 05:00:11,102][106225] Updated weights for policy 1, policy_version 1358938 (0.0008) [2023-12-28 05:00:11,167][106225] Updated weights for policy 1, policy_version 1358948 (0.0008) [2023-12-28 05:00:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 695058432. Throughput: 0: 10103.0, 1: 10076.9. Samples: 695034772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:11,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-4.705')] [2023-12-28 05:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001355680_347119616.pth... [2023-12-28 05:00:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001354528_346824704.pth [2023-12-28 05:00:11,241][106225] Updated weights for policy 1, policy_version 1358958 (0.0007) [2023-12-28 05:00:11,305][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001358968_347947008.pth... [2023-12-28 05:00:11,305][106225] Updated weights for policy 1, policy_version 1358968 (0.0008) [2023-12-28 05:00:11,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001357784_347643904.pth [2023-12-28 05:00:11,383][106226] Updated weights for policy 0, policy_version 1355683 (0.0010) [2023-12-28 05:00:11,449][106226] Updated weights for policy 0, policy_version 1355693 (0.0008) [2023-12-28 05:00:11,508][106226] Updated weights for policy 0, policy_version 1355703 (0.0005) [2023-12-28 05:00:12,091][106225] Updated weights for policy 1, policy_version 1358978 (0.0005) [2023-12-28 05:00:12,147][106225] Updated weights for policy 1, policy_version 1358988 (0.0005) [2023-12-28 05:00:12,200][106225] Updated weights for policy 1, policy_version 1358998 (0.0009) [2023-12-28 05:00:12,220][106226] Updated weights for policy 0, policy_version 1355713 (0.0006) [2023-12-28 05:00:12,284][106226] Updated weights for policy 0, policy_version 1355723 (0.0011) [2023-12-28 05:00:12,353][106226] Updated weights for policy 0, policy_version 1355733 (0.0010) [2023-12-28 05:00:12,415][106226] Updated weights for policy 0, policy_version 1355743 (0.0011) [2023-12-28 05:00:12,916][106225] Updated weights for policy 1, policy_version 1359008 (0.0010) [2023-12-28 05:00:12,976][106225] Updated weights for policy 1, policy_version 1359018 (0.0010) [2023-12-28 05:00:13,026][106225] Updated weights for policy 1, policy_version 1359028 (0.0010) [2023-12-28 05:00:13,054][106226] Updated weights for policy 0, policy_version 1355753 (0.0010) [2023-12-28 05:00:13,112][106226] Updated weights for policy 0, policy_version 1355763 (0.0009) [2023-12-28 05:00:13,171][106226] Updated weights for policy 0, policy_version 1355773 (0.0010) [2023-12-28 05:00:13,740][106225] Updated weights for policy 1, policy_version 1359038 (0.0010) [2023-12-28 05:00:13,804][106225] Updated weights for policy 1, policy_version 1359048 (0.0010) [2023-12-28 05:00:13,857][106225] Updated weights for policy 1, policy_version 1359058 (0.0010) [2023-12-28 05:00:13,867][106226] Updated weights for policy 0, policy_version 1355783 (0.0011) [2023-12-28 05:00:13,930][106226] Updated weights for policy 0, policy_version 1355793 (0.0011) [2023-12-28 05:00:13,994][106226] Updated weights for policy 0, policy_version 1355803 (0.0011) [2023-12-28 05:00:14,541][106225] Updated weights for policy 1, policy_version 1359068 (0.0008) [2023-12-28 05:00:14,606][106225] Updated weights for policy 1, policy_version 1359078 (0.0007) [2023-12-28 05:00:14,670][106225] Updated weights for policy 1, policy_version 1359088 (0.0010) [2023-12-28 05:00:14,687][106226] Updated weights for policy 0, policy_version 1355813 (0.0011) [2023-12-28 05:00:14,752][106226] Updated weights for policy 0, policy_version 1355823 (0.0010) [2023-12-28 05:00:14,820][106226] Updated weights for policy 0, policy_version 1355833 (0.0013) [2023-12-28 05:00:15,312][106225] Updated weights for policy 1, policy_version 1359098 (0.0011) [2023-12-28 05:00:15,368][106225] Updated weights for policy 1, policy_version 1359108 (0.0011) [2023-12-28 05:00:15,427][106225] Updated weights for policy 1, policy_version 1359118 (0.0010) [2023-12-28 05:00:15,484][106225] Updated weights for policy 1, policy_version 1359128 (0.0010) [2023-12-28 05:00:15,573][106226] Updated weights for policy 0, policy_version 1355843 (0.0010) [2023-12-28 05:00:15,633][106226] Updated weights for policy 0, policy_version 1355853 (0.0011) [2023-12-28 05:00:15,694][106226] Updated weights for policy 0, policy_version 1355863 (0.0011) [2023-12-28 05:00:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 695156736. Throughput: 0: 9974.5, 1: 9975.8. Samples: 695149876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:16,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.376')] [2023-12-28 05:00:16,187][106225] Updated weights for policy 1, policy_version 1359138 (0.0010) [2023-12-28 05:00:16,237][106225] Updated weights for policy 1, policy_version 1359148 (0.0010) [2023-12-28 05:00:16,293][106225] Updated weights for policy 1, policy_version 1359158 (0.0010) [2023-12-28 05:00:16,335][106226] Updated weights for policy 0, policy_version 1355873 (0.0010) [2023-12-28 05:00:16,395][106226] Updated weights for policy 0, policy_version 1355883 (0.0006) [2023-12-28 05:00:16,452][106226] Updated weights for policy 0, policy_version 1355893 (0.0007) [2023-12-28 05:00:16,505][106226] Updated weights for policy 0, policy_version 1355903 (0.0006) [2023-12-28 05:00:16,884][106225] Updated weights for policy 1, policy_version 1359168 (0.0009) [2023-12-28 05:00:16,937][106225] Updated weights for policy 1, policy_version 1359178 (0.0010) [2023-12-28 05:00:16,984][106225] Updated weights for policy 1, policy_version 1359188 (0.0010) [2023-12-28 05:00:17,136][106226] Updated weights for policy 0, policy_version 1355913 (0.0007) [2023-12-28 05:00:17,194][106226] Updated weights for policy 0, policy_version 1355923 (0.0005) [2023-12-28 05:00:17,251][106226] Updated weights for policy 0, policy_version 1355933 (0.0008) [2023-12-28 05:00:17,697][106225] Updated weights for policy 1, policy_version 1359198 (0.0010) [2023-12-28 05:00:17,758][106225] Updated weights for policy 1, policy_version 1359208 (0.0010) [2023-12-28 05:00:17,820][106225] Updated weights for policy 1, policy_version 1359218 (0.0010) [2023-12-28 05:00:17,851][106226] Updated weights for policy 0, policy_version 1355943 (0.0010) [2023-12-28 05:00:17,911][106226] Updated weights for policy 0, policy_version 1355953 (0.0011) [2023-12-28 05:00:17,984][106226] Updated weights for policy 0, policy_version 1355964 (0.0010) [2023-12-28 05:00:18,552][106225] Updated weights for policy 1, policy_version 1359228 (0.0010) [2023-12-28 05:00:18,620][106225] Updated weights for policy 1, policy_version 1359238 (0.0011) [2023-12-28 05:00:18,684][106225] Updated weights for policy 1, policy_version 1359248 (0.0010) [2023-12-28 05:00:18,710][106226] Updated weights for policy 0, policy_version 1355974 (0.0009) [2023-12-28 05:00:18,756][106226] Updated weights for policy 0, policy_version 1355984 (0.0008) [2023-12-28 05:00:18,807][106226] Updated weights for policy 0, policy_version 1355994 (0.0008) [2023-12-28 05:00:19,391][106225] Updated weights for policy 1, policy_version 1359258 (0.0009) [2023-12-28 05:00:19,445][106225] Updated weights for policy 1, policy_version 1359268 (0.0008) [2023-12-28 05:00:19,482][106226] Updated weights for policy 0, policy_version 1356004 (0.0007) [2023-12-28 05:00:19,504][106225] Updated weights for policy 1, policy_version 1359278 (0.0007) [2023-12-28 05:00:19,553][106226] Updated weights for policy 0, policy_version 1356014 (0.0006) [2023-12-28 05:00:19,563][106225] Updated weights for policy 1, policy_version 1359288 (0.0006) [2023-12-28 05:00:19,619][106226] Updated weights for policy 0, policy_version 1356024 (0.0008) [2023-12-28 05:00:20,281][106225] Updated weights for policy 1, policy_version 1359298 (0.0010) [2023-12-28 05:00:20,291][106226] Updated weights for policy 0, policy_version 1356034 (0.0008) [2023-12-28 05:00:20,342][106225] Updated weights for policy 1, policy_version 1359308 (0.0008) [2023-12-28 05:00:20,356][106226] Updated weights for policy 0, policy_version 1356044 (0.0007) [2023-12-28 05:00:20,404][106225] Updated weights for policy 1, policy_version 1359318 (0.0009) [2023-12-28 05:00:20,418][106226] Updated weights for policy 0, policy_version 1356054 (0.0007) [2023-12-28 05:00:20,481][106226] Updated weights for policy 0, policy_version 1356064 (0.0008) [2023-12-28 05:00:21,157][106225] Updated weights for policy 1, policy_version 1359328 (0.0010) [2023-12-28 05:00:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 695255040. Throughput: 0: 10023.4, 1: 9915.3. Samples: 695270640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:21,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.467')] [2023-12-28 05:00:21,215][106226] Updated weights for policy 0, policy_version 1356074 (0.0008) [2023-12-28 05:00:21,217][106225] Updated weights for policy 1, policy_version 1359338 (0.0009) [2023-12-28 05:00:21,283][106226] Updated weights for policy 0, policy_version 1356084 (0.0009) [2023-12-28 05:00:21,288][106225] Updated weights for policy 1, policy_version 1359348 (0.0010) [2023-12-28 05:00:21,352][106226] Updated weights for policy 0, policy_version 1356094 (0.0008) [2023-12-28 05:00:22,016][106225] Updated weights for policy 1, policy_version 1359358 (0.0011) [2023-12-28 05:00:22,069][106225] Updated weights for policy 1, policy_version 1359368 (0.0006) [2023-12-28 05:00:22,096][106226] Updated weights for policy 0, policy_version 1356104 (0.0009) [2023-12-28 05:00:22,126][106225] Updated weights for policy 1, policy_version 1359378 (0.0007) [2023-12-28 05:00:22,159][106226] Updated weights for policy 0, policy_version 1356114 (0.0006) [2023-12-28 05:00:22,218][106226] Updated weights for policy 0, policy_version 1356124 (0.0006) [2023-12-28 05:00:22,861][106225] Updated weights for policy 1, policy_version 1359388 (0.0007) [2023-12-28 05:00:22,915][106225] Updated weights for policy 1, policy_version 1359398 (0.0006) [2023-12-28 05:00:22,947][106226] Updated weights for policy 0, policy_version 1356134 (0.0009) [2023-12-28 05:00:22,967][106225] Updated weights for policy 1, policy_version 1359408 (0.0008) [2023-12-28 05:00:23,010][106226] Updated weights for policy 0, policy_version 1356144 (0.0008) [2023-12-28 05:00:23,068][106226] Updated weights for policy 0, policy_version 1356154 (0.0008) [2023-12-28 05:00:23,606][106225] Updated weights for policy 1, policy_version 1359418 (0.0006) [2023-12-28 05:00:23,658][106225] Updated weights for policy 1, policy_version 1359428 (0.0005) [2023-12-28 05:00:23,709][106225] Updated weights for policy 1, policy_version 1359438 (0.0005) [2023-12-28 05:00:23,759][106225] Updated weights for policy 1, policy_version 1359448 (0.0007) [2023-12-28 05:00:23,858][106226] Updated weights for policy 0, policy_version 1356164 (0.0009) [2023-12-28 05:00:23,922][106226] Updated weights for policy 0, policy_version 1356174 (0.0009) [2023-12-28 05:00:23,982][106226] Updated weights for policy 0, policy_version 1356184 (0.0007) [2023-12-28 05:00:24,487][106225] Updated weights for policy 1, policy_version 1359458 (0.0008) [2023-12-28 05:00:24,558][106225] Updated weights for policy 1, policy_version 1359468 (0.0009) [2023-12-28 05:00:24,607][106225] Updated weights for policy 1, policy_version 1359478 (0.0008) [2023-12-28 05:00:24,624][106226] Updated weights for policy 0, policy_version 1356194 (0.0005) [2023-12-28 05:00:24,684][106226] Updated weights for policy 0, policy_version 1356204 (0.0005) [2023-12-28 05:00:24,742][106226] Updated weights for policy 0, policy_version 1356214 (0.0006) [2023-12-28 05:00:24,804][106226] Updated weights for policy 0, policy_version 1356224 (0.0009) [2023-12-28 05:00:25,243][106225] Updated weights for policy 1, policy_version 1359488 (0.0009) [2023-12-28 05:00:25,291][106225] Updated weights for policy 1, policy_version 1359498 (0.0008) [2023-12-28 05:00:25,339][106225] Updated weights for policy 1, policy_version 1359508 (0.0008) [2023-12-28 05:00:25,519][106226] Updated weights for policy 0, policy_version 1356234 (0.0008) [2023-12-28 05:00:25,576][106226] Updated weights for policy 0, policy_version 1356244 (0.0008) [2023-12-28 05:00:25,639][106226] Updated weights for policy 0, policy_version 1356254 (0.0008) [2023-12-28 05:00:26,087][106225] Updated weights for policy 1, policy_version 1359518 (0.0008) [2023-12-28 05:00:26,153][106225] Updated weights for policy 1, policy_version 1359528 (0.0009) [2023-12-28 05:00:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 695353344. Throughput: 0: 9965.3, 1: 9935.9. Samples: 695328072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:26,176][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.645')] [2023-12-28 05:00:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001356256_347267072.pth... [2023-12-28 05:00:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001355104_346972160.pth [2023-12-28 05:00:26,202][106225] Updated weights for policy 1, policy_version 1359538 (0.0009) [2023-12-28 05:00:26,229][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001359544_348094464.pth... [2023-12-28 05:00:26,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001358392_347799552.pth [2023-12-28 05:00:26,310][106226] Updated weights for policy 0, policy_version 1356264 (0.0009) [2023-12-28 05:00:26,373][106226] Updated weights for policy 0, policy_version 1356274 (0.0009) [2023-12-28 05:00:26,432][106226] Updated weights for policy 0, policy_version 1356284 (0.0008) [2023-12-28 05:00:26,961][106225] Updated weights for policy 1, policy_version 1359548 (0.0008) [2023-12-28 05:00:27,003][106226] Updated weights for policy 0, policy_version 1356294 (0.0006) [2023-12-28 05:00:27,022][106225] Updated weights for policy 1, policy_version 1359558 (0.0008) [2023-12-28 05:00:27,062][106226] Updated weights for policy 0, policy_version 1356304 (0.0005) [2023-12-28 05:00:27,087][106225] Updated weights for policy 1, policy_version 1359568 (0.0007) [2023-12-28 05:00:27,119][106226] Updated weights for policy 0, policy_version 1356314 (0.0005) [2023-12-28 05:00:27,703][106226] Updated weights for policy 0, policy_version 1356324 (0.0010) [2023-12-28 05:00:27,751][106226] Updated weights for policy 0, policy_version 1356334 (0.0008) [2023-12-28 05:00:27,784][106225] Updated weights for policy 1, policy_version 1359578 (0.0008) [2023-12-28 05:00:27,797][106226] Updated weights for policy 0, policy_version 1356344 (0.0009) [2023-12-28 05:00:27,830][106225] Updated weights for policy 1, policy_version 1359588 (0.0006) [2023-12-28 05:00:27,876][106225] Updated weights for policy 1, policy_version 1359598 (0.0007) [2023-12-28 05:00:27,929][106225] Updated weights for policy 1, policy_version 1359608 (0.0007) [2023-12-28 05:00:28,515][106226] Updated weights for policy 0, policy_version 1356354 (0.0005) [2023-12-28 05:00:28,575][106226] Updated weights for policy 0, policy_version 1356364 (0.0006) [2023-12-28 05:00:28,625][106226] Updated weights for policy 0, policy_version 1356374 (0.0006) [2023-12-28 05:00:28,645][106225] Updated weights for policy 1, policy_version 1359618 (0.0006) [2023-12-28 05:00:28,684][106226] Updated weights for policy 0, policy_version 1356384 (0.0009) [2023-12-28 05:00:28,702][106225] Updated weights for policy 1, policy_version 1359628 (0.0006) [2023-12-28 05:00:28,757][106225] Updated weights for policy 1, policy_version 1359638 (0.0007) [2023-12-28 05:00:29,214][106226] Updated weights for policy 0, policy_version 1356394 (0.0010) [2023-12-28 05:00:29,285][106226] Updated weights for policy 0, policy_version 1356404 (0.0007) [2023-12-28 05:00:29,304][106225] Updated weights for policy 1, policy_version 1359648 (0.0008) [2023-12-28 05:00:29,358][106226] Updated weights for policy 0, policy_version 1356414 (0.0010) [2023-12-28 05:00:29,375][106225] Updated weights for policy 1, policy_version 1359658 (0.0008) [2023-12-28 05:00:29,441][106225] Updated weights for policy 1, policy_version 1359668 (0.0008) [2023-12-28 05:00:30,032][106226] Updated weights for policy 0, policy_version 1356424 (0.0010) [2023-12-28 05:00:30,093][106226] Updated weights for policy 0, policy_version 1356434 (0.0010) [2023-12-28 05:00:30,158][106226] Updated weights for policy 0, policy_version 1356444 (0.0011) [2023-12-28 05:00:30,229][106225] Updated weights for policy 1, policy_version 1359678 (0.0007) [2023-12-28 05:00:30,293][106225] Updated weights for policy 1, policy_version 1359688 (0.0008) [2023-12-28 05:00:30,363][106225] Updated weights for policy 1, policy_version 1359698 (0.0010) [2023-12-28 05:00:30,828][106226] Updated weights for policy 0, policy_version 1356454 (0.0011) [2023-12-28 05:00:30,873][106226] Updated weights for policy 0, policy_version 1356464 (0.0010) [2023-12-28 05:00:30,923][106226] Updated weights for policy 0, policy_version 1356474 (0.0010) [2023-12-28 05:00:31,020][106225] Updated weights for policy 1, policy_version 1359708 (0.0007) [2023-12-28 05:00:31,084][106225] Updated weights for policy 1, policy_version 1359718 (0.0008) [2023-12-28 05:00:31,146][106225] Updated weights for policy 1, policy_version 1359728 (0.0007) [2023-12-28 05:00:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 695459840. Throughput: 0: 10101.4, 1: 9965.4. Samples: 695452148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:31,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.559')] [2023-12-28 05:00:31,671][106226] Updated weights for policy 0, policy_version 1356484 (0.0010) [2023-12-28 05:00:31,742][106226] Updated weights for policy 0, policy_version 1356494 (0.0009) [2023-12-28 05:00:31,803][106226] Updated weights for policy 0, policy_version 1356504 (0.0008) [2023-12-28 05:00:31,833][106225] Updated weights for policy 1, policy_version 1359738 (0.0008) [2023-12-28 05:00:31,885][106225] Updated weights for policy 1, policy_version 1359748 (0.0007) [2023-12-28 05:00:31,931][106225] Updated weights for policy 1, policy_version 1359758 (0.0009) [2023-12-28 05:00:32,016][106225] Updated weights for policy 1, policy_version 1359768 (0.0008) [2023-12-28 05:00:32,498][106226] Updated weights for policy 0, policy_version 1356514 (0.0008) [2023-12-28 05:00:32,555][106226] Updated weights for policy 0, policy_version 1356524 (0.0007) [2023-12-28 05:00:32,610][106226] Updated weights for policy 0, policy_version 1356534 (0.0005) [2023-12-28 05:00:32,667][106226] Updated weights for policy 0, policy_version 1356544 (0.0007) [2023-12-28 05:00:32,753][106225] Updated weights for policy 1, policy_version 1359778 (0.0010) [2023-12-28 05:00:32,811][106225] Updated weights for policy 1, policy_version 1359788 (0.0009) [2023-12-28 05:00:32,862][106225] Updated weights for policy 1, policy_version 1359798 (0.0005) [2023-12-28 05:00:33,402][106226] Updated weights for policy 0, policy_version 1356554 (0.0010) [2023-12-28 05:00:33,460][106226] Updated weights for policy 0, policy_version 1356564 (0.0008) [2023-12-28 05:00:33,477][106225] Updated weights for policy 1, policy_version 1359808 (0.0005) [2023-12-28 05:00:33,514][106226] Updated weights for policy 0, policy_version 1356574 (0.0008) [2023-12-28 05:00:33,532][106225] Updated weights for policy 1, policy_version 1359818 (0.0005) [2023-12-28 05:00:33,587][106225] Updated weights for policy 1, policy_version 1359828 (0.0006) [2023-12-28 05:00:34,193][106225] Updated weights for policy 1, policy_version 1359838 (0.0006) [2023-12-28 05:00:34,255][106225] Updated weights for policy 1, policy_version 1359848 (0.0007) [2023-12-28 05:00:34,316][106225] Updated weights for policy 1, policy_version 1359858 (0.0006) [2023-12-28 05:00:34,318][106226] Updated weights for policy 0, policy_version 1356584 (0.0008) [2023-12-28 05:00:34,382][106226] Updated weights for policy 0, policy_version 1356594 (0.0007) [2023-12-28 05:00:34,438][106226] Updated weights for policy 0, policy_version 1356604 (0.0009) [2023-12-28 05:00:35,031][106225] Updated weights for policy 1, policy_version 1359868 (0.0008) [2023-12-28 05:00:35,081][106225] Updated weights for policy 1, policy_version 1359878 (0.0008) [2023-12-28 05:00:35,125][106226] Updated weights for policy 0, policy_version 1356614 (0.0007) [2023-12-28 05:00:35,136][106225] Updated weights for policy 1, policy_version 1359888 (0.0006) [2023-12-28 05:00:35,174][106226] Updated weights for policy 0, policy_version 1356624 (0.0006) [2023-12-28 05:00:35,232][106226] Updated weights for policy 0, policy_version 1356634 (0.0009) [2023-12-28 05:00:35,709][106225] Updated weights for policy 1, policy_version 1359898 (0.0006) [2023-12-28 05:00:35,768][106225] Updated weights for policy 1, policy_version 1359908 (0.0009) [2023-12-28 05:00:35,823][106225] Updated weights for policy 1, policy_version 1359918 (0.0009) [2023-12-28 05:00:35,868][106225] Updated weights for policy 1, policy_version 1359928 (0.0007) [2023-12-28 05:00:35,979][106226] Updated weights for policy 0, policy_version 1356644 (0.0010) [2023-12-28 05:00:36,037][106226] Updated weights for policy 0, policy_version 1356654 (0.0008) [2023-12-28 05:00:36,091][106226] Updated weights for policy 0, policy_version 1356664 (0.0006) [2023-12-28 05:00:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 695566336. Throughput: 0: 10068.4, 1: 10010.2. Samples: 695571860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:36,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.451')] [2023-12-28 05:00:36,644][106225] Updated weights for policy 1, policy_version 1359938 (0.0009) [2023-12-28 05:00:36,700][106225] Updated weights for policy 1, policy_version 1359948 (0.0008) [2023-12-28 05:00:36,757][106225] Updated weights for policy 1, policy_version 1359958 (0.0008) [2023-12-28 05:00:36,831][106226] Updated weights for policy 0, policy_version 1356674 (0.0008) [2023-12-28 05:00:36,895][106226] Updated weights for policy 0, policy_version 1356684 (0.0005) [2023-12-28 05:00:36,961][106226] Updated weights for policy 0, policy_version 1356694 (0.0008) [2023-12-28 05:00:37,024][106226] Updated weights for policy 0, policy_version 1356704 (0.0009) [2023-12-28 05:00:37,484][106225] Updated weights for policy 1, policy_version 1359968 (0.0008) [2023-12-28 05:00:37,544][106225] Updated weights for policy 1, policy_version 1359978 (0.0008) [2023-12-28 05:00:37,598][106225] Updated weights for policy 1, policy_version 1359988 (0.0008) [2023-12-28 05:00:37,696][106226] Updated weights for policy 0, policy_version 1356714 (0.0007) [2023-12-28 05:00:37,757][106226] Updated weights for policy 0, policy_version 1356724 (0.0009) [2023-12-28 05:00:37,815][106226] Updated weights for policy 0, policy_version 1356734 (0.0009) [2023-12-28 05:00:38,365][106225] Updated weights for policy 1, policy_version 1359998 (0.0009) [2023-12-28 05:00:38,427][106225] Updated weights for policy 1, policy_version 1360008 (0.0008) [2023-12-28 05:00:38,486][106225] Updated weights for policy 1, policy_version 1360018 (0.0009) [2023-12-28 05:00:38,500][106226] Updated weights for policy 0, policy_version 1356744 (0.0006) [2023-12-28 05:00:38,563][106226] Updated weights for policy 0, policy_version 1356754 (0.0009) [2023-12-28 05:00:38,619][106226] Updated weights for policy 0, policy_version 1356764 (0.0008) [2023-12-28 05:00:39,221][106225] Updated weights for policy 1, policy_version 1360028 (0.0008) [2023-12-28 05:00:39,287][106225] Updated weights for policy 1, policy_version 1360038 (0.0008) [2023-12-28 05:00:39,307][106226] Updated weights for policy 0, policy_version 1356774 (0.0008) [2023-12-28 05:00:39,360][106225] Updated weights for policy 1, policy_version 1360048 (0.0008) [2023-12-28 05:00:39,379][106226] Updated weights for policy 0, policy_version 1356784 (0.0008) [2023-12-28 05:00:39,450][106226] Updated weights for policy 0, policy_version 1356794 (0.0008) [2023-12-28 05:00:40,108][106225] Updated weights for policy 1, policy_version 1360058 (0.0010) [2023-12-28 05:00:40,157][106226] Updated weights for policy 0, policy_version 1356804 (0.0008) [2023-12-28 05:00:40,167][106225] Updated weights for policy 1, policy_version 1360068 (0.0010) [2023-12-28 05:00:40,217][106226] Updated weights for policy 0, policy_version 1356814 (0.0007) [2023-12-28 05:00:40,229][106225] Updated weights for policy 1, policy_version 1360078 (0.0011) [2023-12-28 05:00:40,276][106226] Updated weights for policy 0, policy_version 1356824 (0.0009) [2023-12-28 05:00:40,294][106225] Updated weights for policy 1, policy_version 1360088 (0.0011) [2023-12-28 05:00:40,933][106225] Updated weights for policy 1, policy_version 1360098 (0.0009) [2023-12-28 05:00:40,983][106226] Updated weights for policy 0, policy_version 1356834 (0.0007) [2023-12-28 05:00:40,995][106225] Updated weights for policy 1, policy_version 1360108 (0.0009) [2023-12-28 05:00:41,049][106226] Updated weights for policy 0, policy_version 1356844 (0.0011) [2023-12-28 05:00:41,065][106225] Updated weights for policy 1, policy_version 1360118 (0.0010) [2023-12-28 05:00:41,114][106226] Updated weights for policy 0, policy_version 1356854 (0.0011) [2023-12-28 05:00:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 695656448. Throughput: 0: 10054.9, 1: 9940.4. Samples: 695629388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:41,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.605')] [2023-12-28 05:00:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001360120_348241920.pth... [2023-12-28 05:00:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001356864_347422720.pth... [2023-12-28 05:00:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001358968_347947008.pth [2023-12-28 05:00:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001355680_347119616.pth [2023-12-28 05:00:41,817][106225] Updated weights for policy 1, policy_version 1360128 (0.0006) [2023-12-28 05:00:41,868][106225] Updated weights for policy 1, policy_version 1360138 (0.0008) [2023-12-28 05:00:41,917][106226] Updated weights for policy 0, policy_version 1356865 (0.0010) [2023-12-28 05:00:41,930][106225] Updated weights for policy 1, policy_version 1360148 (0.0008) [2023-12-28 05:00:41,982][106226] Updated weights for policy 0, policy_version 1356875 (0.0007) [2023-12-28 05:00:42,048][106226] Updated weights for policy 0, policy_version 1356885 (0.0008) [2023-12-28 05:00:42,113][106226] Updated weights for policy 0, policy_version 1356895 (0.0008) [2023-12-28 05:00:42,715][106225] Updated weights for policy 1, policy_version 1360158 (0.0008) [2023-12-28 05:00:42,782][106225] Updated weights for policy 1, policy_version 1360168 (0.0007) [2023-12-28 05:00:42,845][106226] Updated weights for policy 0, policy_version 1356905 (0.0007) [2023-12-28 05:00:42,848][106225] Updated weights for policy 1, policy_version 1360178 (0.0009) [2023-12-28 05:00:42,908][106226] Updated weights for policy 0, policy_version 1356915 (0.0008) [2023-12-28 05:00:42,962][106226] Updated weights for policy 0, policy_version 1356925 (0.0009) [2023-12-28 05:00:43,466][106225] Updated weights for policy 1, policy_version 1360188 (0.0009) [2023-12-28 05:00:43,511][106225] Updated weights for policy 1, policy_version 1360198 (0.0007) [2023-12-28 05:00:43,569][106225] Updated weights for policy 1, policy_version 1360208 (0.0005) [2023-12-28 05:00:43,658][106226] Updated weights for policy 0, policy_version 1356935 (0.0010) [2023-12-28 05:00:43,715][106226] Updated weights for policy 0, policy_version 1356945 (0.0007) [2023-12-28 05:00:43,773][106226] Updated weights for policy 0, policy_version 1356955 (0.0008) [2023-12-28 05:00:44,195][106225] Updated weights for policy 1, policy_version 1360218 (0.0005) [2023-12-28 05:00:44,251][106225] Updated weights for policy 1, policy_version 1360228 (0.0005) [2023-12-28 05:00:44,309][106225] Updated weights for policy 1, policy_version 1360238 (0.0007) [2023-12-28 05:00:44,368][106225] Updated weights for policy 1, policy_version 1360248 (0.0005) [2023-12-28 05:00:44,437][106226] Updated weights for policy 0, policy_version 1356965 (0.0009) [2023-12-28 05:00:44,496][106226] Updated weights for policy 0, policy_version 1356975 (0.0011) [2023-12-28 05:00:44,553][106226] Updated weights for policy 0, policy_version 1356985 (0.0007) [2023-12-28 05:00:44,970][106225] Updated weights for policy 1, policy_version 1360258 (0.0008) [2023-12-28 05:00:45,034][106225] Updated weights for policy 1, policy_version 1360268 (0.0009) [2023-12-28 05:00:45,099][106225] Updated weights for policy 1, policy_version 1360278 (0.0008) [2023-12-28 05:00:45,341][106226] Updated weights for policy 0, policy_version 1356995 (0.0008) [2023-12-28 05:00:45,402][106226] Updated weights for policy 0, policy_version 1357005 (0.0009) [2023-12-28 05:00:45,454][106226] Updated weights for policy 0, policy_version 1357015 (0.0008) [2023-12-28 05:00:45,668][106225] Updated weights for policy 1, policy_version 1360288 (0.0006) [2023-12-28 05:00:45,738][106225] Updated weights for policy 1, policy_version 1360298 (0.0008) [2023-12-28 05:00:45,806][106225] Updated weights for policy 1, policy_version 1360308 (0.0010) [2023-12-28 05:00:46,131][106226] Updated weights for policy 0, policy_version 1357025 (0.0009) [2023-12-28 05:00:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 695754752. Throughput: 0: 9970.2, 1: 9895.1. Samples: 695746740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:46,175][105115] Avg episode reward: [(0, '-4.814'), (1, '-4.545')] [2023-12-28 05:00:46,188][106226] Updated weights for policy 0, policy_version 1357035 (0.0008) [2023-12-28 05:00:46,247][106226] Updated weights for policy 0, policy_version 1357045 (0.0008) [2023-12-28 05:00:46,312][106226] Updated weights for policy 0, policy_version 1357055 (0.0009) [2023-12-28 05:00:46,510][106225] Updated weights for policy 1, policy_version 1360318 (0.0009) [2023-12-28 05:00:46,580][106225] Updated weights for policy 1, policy_version 1360328 (0.0009) [2023-12-28 05:00:46,639][106225] Updated weights for policy 1, policy_version 1360338 (0.0008) [2023-12-28 05:00:47,014][106226] Updated weights for policy 0, policy_version 1357065 (0.0005) [2023-12-28 05:00:47,070][106226] Updated weights for policy 0, policy_version 1357075 (0.0005) [2023-12-28 05:00:47,121][106226] Updated weights for policy 0, policy_version 1357085 (0.0005) [2023-12-28 05:00:47,266][106225] Updated weights for policy 1, policy_version 1360348 (0.0008) [2023-12-28 05:00:47,333][106225] Updated weights for policy 1, policy_version 1360358 (0.0010) [2023-12-28 05:00:47,394][106225] Updated weights for policy 1, policy_version 1360368 (0.0010) [2023-12-28 05:00:47,743][106226] Updated weights for policy 0, policy_version 1357095 (0.0008) [2023-12-28 05:00:47,788][106226] Updated weights for policy 0, policy_version 1357105 (0.0009) [2023-12-28 05:00:47,836][106226] Updated weights for policy 0, policy_version 1357115 (0.0009) [2023-12-28 05:00:48,032][106225] Updated weights for policy 1, policy_version 1360378 (0.0008) [2023-12-28 05:00:48,092][106225] Updated weights for policy 1, policy_version 1360388 (0.0008) [2023-12-28 05:00:48,154][106225] Updated weights for policy 1, policy_version 1360398 (0.0008) [2023-12-28 05:00:48,223][106225] Updated weights for policy 1, policy_version 1360408 (0.0008) [2023-12-28 05:00:48,619][106226] Updated weights for policy 0, policy_version 1357125 (0.0010) [2023-12-28 05:00:48,673][106226] Updated weights for policy 0, policy_version 1357135 (0.0011) [2023-12-28 05:00:48,734][106226] Updated weights for policy 0, policy_version 1357145 (0.0011) [2023-12-28 05:00:48,947][106225] Updated weights for policy 1, policy_version 1360418 (0.0008) [2023-12-28 05:00:48,996][106225] Updated weights for policy 1, policy_version 1360428 (0.0007) [2023-12-28 05:00:49,040][106225] Updated weights for policy 1, policy_version 1360438 (0.0007) [2023-12-28 05:00:49,475][106226] Updated weights for policy 0, policy_version 1357155 (0.0009) [2023-12-28 05:00:49,539][106226] Updated weights for policy 0, policy_version 1357165 (0.0006) [2023-12-28 05:00:49,603][106226] Updated weights for policy 0, policy_version 1357175 (0.0006) [2023-12-28 05:00:49,829][106225] Updated weights for policy 1, policy_version 1360448 (0.0008) [2023-12-28 05:00:49,886][106225] Updated weights for policy 1, policy_version 1360458 (0.0009) [2023-12-28 05:00:49,952][106225] Updated weights for policy 1, policy_version 1360468 (0.0008) [2023-12-28 05:00:50,322][106226] Updated weights for policy 0, policy_version 1357185 (0.0008) [2023-12-28 05:00:50,380][106226] Updated weights for policy 0, policy_version 1357195 (0.0008) [2023-12-28 05:00:50,435][106226] Updated weights for policy 0, policy_version 1357205 (0.0009) [2023-12-28 05:00:50,492][106226] Updated weights for policy 0, policy_version 1357215 (0.0005) [2023-12-28 05:00:50,587][106225] Updated weights for policy 1, policy_version 1360478 (0.0009) [2023-12-28 05:00:50,646][106225] Updated weights for policy 1, policy_version 1360488 (0.0006) [2023-12-28 05:00:50,707][106225] Updated weights for policy 1, policy_version 1360498 (0.0005) [2023-12-28 05:00:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 695853056. Throughput: 0: 9890.3, 1: 9956.4. Samples: 695866552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:51,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-4.387')] [2023-12-28 05:00:51,189][106226] Updated weights for policy 0, policy_version 1357225 (0.0009) [2023-12-28 05:00:51,245][106226] Updated weights for policy 0, policy_version 1357235 (0.0008) [2023-12-28 05:00:51,315][106226] Updated weights for policy 0, policy_version 1357245 (0.0009) [2023-12-28 05:00:51,363][106225] Updated weights for policy 1, policy_version 1360508 (0.0007) [2023-12-28 05:00:51,425][106225] Updated weights for policy 1, policy_version 1360518 (0.0008) [2023-12-28 05:00:51,476][106225] Updated weights for policy 1, policy_version 1360529 (0.0009) [2023-12-28 05:00:52,053][106226] Updated weights for policy 0, policy_version 1357255 (0.0008) [2023-12-28 05:00:52,114][106226] Updated weights for policy 0, policy_version 1357265 (0.0009) [2023-12-28 05:00:52,161][106226] Updated weights for policy 0, policy_version 1357275 (0.0009) [2023-12-28 05:00:52,269][106225] Updated weights for policy 1, policy_version 1360539 (0.0009) [2023-12-28 05:00:52,338][106225] Updated weights for policy 1, policy_version 1360549 (0.0008) [2023-12-28 05:00:52,412][106225] Updated weights for policy 1, policy_version 1360559 (0.0008) [2023-12-28 05:00:52,899][106226] Updated weights for policy 0, policy_version 1357285 (0.0009) [2023-12-28 05:00:52,955][106226] Updated weights for policy 0, policy_version 1357295 (0.0009) [2023-12-28 05:00:53,015][106226] Updated weights for policy 0, policy_version 1357305 (0.0009) [2023-12-28 05:00:53,140][106225] Updated weights for policy 1, policy_version 1360569 (0.0009) [2023-12-28 05:00:53,194][106225] Updated weights for policy 1, policy_version 1360579 (0.0009) [2023-12-28 05:00:53,251][106225] Updated weights for policy 1, policy_version 1360589 (0.0006) [2023-12-28 05:00:53,307][106225] Updated weights for policy 1, policy_version 1360599 (0.0010) [2023-12-28 05:00:53,709][106226] Updated weights for policy 0, policy_version 1357315 (0.0009) [2023-12-28 05:00:53,757][106226] Updated weights for policy 0, policy_version 1357325 (0.0007) [2023-12-28 05:00:53,810][106226] Updated weights for policy 0, policy_version 1357335 (0.0008) [2023-12-28 05:00:53,881][106225] Updated weights for policy 1, policy_version 1360609 (0.0005) [2023-12-28 05:00:53,944][106225] Updated weights for policy 1, policy_version 1360619 (0.0009) [2023-12-28 05:00:54,009][106225] Updated weights for policy 1, policy_version 1360629 (0.0006) [2023-12-28 05:00:54,555][106226] Updated weights for policy 0, policy_version 1357345 (0.0007) [2023-12-28 05:00:54,578][106225] Updated weights for policy 1, policy_version 1360639 (0.0009) [2023-12-28 05:00:54,608][106226] Updated weights for policy 0, policy_version 1357355 (0.0006) [2023-12-28 05:00:54,634][106225] Updated weights for policy 1, policy_version 1360649 (0.0009) [2023-12-28 05:00:54,660][106226] Updated weights for policy 0, policy_version 1357365 (0.0008) [2023-12-28 05:00:54,695][106225] Updated weights for policy 1, policy_version 1360659 (0.0010) [2023-12-28 05:00:54,714][106226] Updated weights for policy 0, policy_version 1357375 (0.0007) [2023-12-28 05:00:55,333][106226] Updated weights for policy 0, policy_version 1357385 (0.0008) [2023-12-28 05:00:55,362][106225] Updated weights for policy 1, policy_version 1360669 (0.0008) [2023-12-28 05:00:55,384][106226] Updated weights for policy 0, policy_version 1357395 (0.0006) [2023-12-28 05:00:55,422][106225] Updated weights for policy 1, policy_version 1360679 (0.0005) [2023-12-28 05:00:55,435][106226] Updated weights for policy 0, policy_version 1357405 (0.0005) [2023-12-28 05:00:55,481][106225] Updated weights for policy 1, policy_version 1360689 (0.0005) [2023-12-28 05:00:56,015][106226] Updated weights for policy 0, policy_version 1357415 (0.0006) [2023-12-28 05:00:56,020][106225] Updated weights for policy 1, policy_version 1360699 (0.0008) [2023-12-28 05:00:56,061][106226] Updated weights for policy 0, policy_version 1357425 (0.0008) [2023-12-28 05:00:56,073][106225] Updated weights for policy 1, policy_version 1360709 (0.0005) [2023-12-28 05:00:56,119][106226] Updated weights for policy 0, policy_version 1357435 (0.0007) [2023-12-28 05:00:56,130][106225] Updated weights for policy 1, policy_version 1360719 (0.0009) [2023-12-28 05:00:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19882.9). Total num frames: 695959552. Throughput: 0: 9832.7, 1: 9951.4. Samples: 695925060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:00:56,176][105115] Avg episode reward: [(0, '-4.258'), (1, '-4.753')] [2023-12-28 05:00:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001360728_348397568.pth... [2023-12-28 05:00:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001357440_347570176.pth... [2023-12-28 05:00:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001359544_348094464.pth [2023-12-28 05:00:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001356256_347267072.pth [2023-12-28 05:00:56,787][106225] Updated weights for policy 1, policy_version 1360729 (0.0010) [2023-12-28 05:00:56,796][106226] Updated weights for policy 0, policy_version 1357445 (0.0005) [2023-12-28 05:00:56,848][106225] Updated weights for policy 1, policy_version 1360739 (0.0009) [2023-12-28 05:00:56,850][106226] Updated weights for policy 0, policy_version 1357455 (0.0007) [2023-12-28 05:00:56,907][106225] Updated weights for policy 1, policy_version 1360749 (0.0010) [2023-12-28 05:00:56,907][106226] Updated weights for policy 0, policy_version 1357465 (0.0007) [2023-12-28 05:00:56,968][106225] Updated weights for policy 1, policy_version 1360759 (0.0009) [2023-12-28 05:00:57,552][106225] Updated weights for policy 1, policy_version 1360769 (0.0008) [2023-12-28 05:00:57,605][106225] Updated weights for policy 1, policy_version 1360779 (0.0010) [2023-12-28 05:00:57,608][106226] Updated weights for policy 0, policy_version 1357475 (0.0008) [2023-12-28 05:00:57,665][106225] Updated weights for policy 1, policy_version 1360789 (0.0010) [2023-12-28 05:00:57,668][106226] Updated weights for policy 0, policy_version 1357485 (0.0005) [2023-12-28 05:00:57,732][106226] Updated weights for policy 0, policy_version 1357495 (0.0008) [2023-12-28 05:00:58,245][106225] Updated weights for policy 1, policy_version 1360799 (0.0009) [2023-12-28 05:00:58,304][106225] Updated weights for policy 1, policy_version 1360809 (0.0008) [2023-12-28 05:00:58,331][106226] Updated weights for policy 0, policy_version 1357505 (0.0006) [2023-12-28 05:00:58,373][106225] Updated weights for policy 1, policy_version 1360819 (0.0008) [2023-12-28 05:00:58,403][106226] Updated weights for policy 0, policy_version 1357515 (0.0011) [2023-12-28 05:00:58,467][106226] Updated weights for policy 0, policy_version 1357525 (0.0010) [2023-12-28 05:00:58,532][106226] Updated weights for policy 0, policy_version 1357535 (0.0012) [2023-12-28 05:00:59,154][106225] Updated weights for policy 1, policy_version 1360829 (0.0008) [2023-12-28 05:00:59,218][106225] Updated weights for policy 1, policy_version 1360839 (0.0008) [2023-12-28 05:00:59,287][106225] Updated weights for policy 1, policy_version 1360849 (0.0008) [2023-12-28 05:00:59,377][106226] Updated weights for policy 0, policy_version 1357545 (0.0009) [2023-12-28 05:00:59,437][106226] Updated weights for policy 0, policy_version 1357555 (0.0007) [2023-12-28 05:00:59,498][106226] Updated weights for policy 0, policy_version 1357565 (0.0011) [2023-12-28 05:01:00,067][106225] Updated weights for policy 1, policy_version 1360859 (0.0007) [2023-12-28 05:01:00,134][106225] Updated weights for policy 1, policy_version 1360869 (0.0008) [2023-12-28 05:01:00,197][106225] Updated weights for policy 1, policy_version 1360879 (0.0007) [2023-12-28 05:01:00,233][106226] Updated weights for policy 0, policy_version 1357575 (0.0011) [2023-12-28 05:01:00,298][106226] Updated weights for policy 0, policy_version 1357585 (0.0011) [2023-12-28 05:01:00,356][106226] Updated weights for policy 0, policy_version 1357595 (0.0011) [2023-12-28 05:01:00,848][106225] Updated weights for policy 1, policy_version 1360889 (0.0008) [2023-12-28 05:01:00,918][106225] Updated weights for policy 1, policy_version 1360899 (0.0005) [2023-12-28 05:01:00,939][106226] Updated weights for policy 0, policy_version 1357605 (0.0007) [2023-12-28 05:01:00,973][106225] Updated weights for policy 1, policy_version 1360909 (0.0006) [2023-12-28 05:01:00,994][106226] Updated weights for policy 0, policy_version 1357615 (0.0005) [2023-12-28 05:01:01,028][106225] Updated weights for policy 1, policy_version 1360919 (0.0008) [2023-12-28 05:01:01,057][106226] Updated weights for policy 0, policy_version 1357625 (0.0010) [2023-12-28 05:01:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 696066048. Throughput: 0: 9891.4, 1: 10115.2. Samples: 696050172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:01,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.649')] [2023-12-28 05:01:01,682][106226] Updated weights for policy 0, policy_version 1357635 (0.0009) [2023-12-28 05:01:01,736][106226] Updated weights for policy 0, policy_version 1357645 (0.0006) [2023-12-28 05:01:01,802][106225] Updated weights for policy 1, policy_version 1360929 (0.0008) [2023-12-28 05:01:01,805][106226] Updated weights for policy 0, policy_version 1357655 (0.0006) [2023-12-28 05:01:01,847][106225] Updated weights for policy 1, policy_version 1360939 (0.0008) [2023-12-28 05:01:01,912][106225] Updated weights for policy 1, policy_version 1360949 (0.0007) [2023-12-28 05:01:02,513][106226] Updated weights for policy 0, policy_version 1357665 (0.0007) [2023-12-28 05:01:02,569][106226] Updated weights for policy 0, policy_version 1357675 (0.0007) [2023-12-28 05:01:02,614][106226] Updated weights for policy 0, policy_version 1357685 (0.0009) [2023-12-28 05:01:02,666][106226] Updated weights for policy 0, policy_version 1357695 (0.0008) [2023-12-28 05:01:02,693][106225] Updated weights for policy 1, policy_version 1360959 (0.0009) [2023-12-28 05:01:02,743][106225] Updated weights for policy 1, policy_version 1360969 (0.0008) [2023-12-28 05:01:02,796][106225] Updated weights for policy 1, policy_version 1360979 (0.0009) [2023-12-28 05:01:03,328][106226] Updated weights for policy 0, policy_version 1357705 (0.0009) [2023-12-28 05:01:03,390][106226] Updated weights for policy 0, policy_version 1357715 (0.0008) [2023-12-28 05:01:03,445][106226] Updated weights for policy 0, policy_version 1357725 (0.0005) [2023-12-28 05:01:03,556][106225] Updated weights for policy 1, policy_version 1360989 (0.0008) [2023-12-28 05:01:03,607][106225] Updated weights for policy 1, policy_version 1360999 (0.0008) [2023-12-28 05:01:03,665][106225] Updated weights for policy 1, policy_version 1361009 (0.0009) [2023-12-28 05:01:04,190][106226] Updated weights for policy 0, policy_version 1357735 (0.0007) [2023-12-28 05:01:04,252][106226] Updated weights for policy 0, policy_version 1357745 (0.0008) [2023-12-28 05:01:04,320][106226] Updated weights for policy 0, policy_version 1357755 (0.0008) [2023-12-28 05:01:04,422][106225] Updated weights for policy 1, policy_version 1361019 (0.0009) [2023-12-28 05:01:04,478][106225] Updated weights for policy 1, policy_version 1361029 (0.0008) [2023-12-28 05:01:04,540][106225] Updated weights for policy 1, policy_version 1361039 (0.0009) [2023-12-28 05:01:04,943][106226] Updated weights for policy 0, policy_version 1357765 (0.0008) [2023-12-28 05:01:05,001][106226] Updated weights for policy 0, policy_version 1357775 (0.0007) [2023-12-28 05:01:05,059][106226] Updated weights for policy 0, policy_version 1357785 (0.0007) [2023-12-28 05:01:05,287][106225] Updated weights for policy 1, policy_version 1361049 (0.0009) [2023-12-28 05:01:05,337][106225] Updated weights for policy 1, policy_version 1361059 (0.0010) [2023-12-28 05:01:05,386][106225] Updated weights for policy 1, policy_version 1361069 (0.0010) [2023-12-28 05:01:05,439][106225] Updated weights for policy 1, policy_version 1361079 (0.0010) [2023-12-28 05:01:05,752][106226] Updated weights for policy 0, policy_version 1357795 (0.0008) [2023-12-28 05:01:05,798][106226] Updated weights for policy 0, policy_version 1357805 (0.0008) [2023-12-28 05:01:05,848][106226] Updated weights for policy 0, policy_version 1357815 (0.0008) [2023-12-28 05:01:06,174][106225] Updated weights for policy 1, policy_version 1361089 (0.0010) [2023-12-28 05:01:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 696156160. Throughput: 0: 9913.3, 1: 10046.7. Samples: 696168844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:06,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.474')] [2023-12-28 05:01:06,240][106225] Updated weights for policy 1, policy_version 1361099 (0.0010) [2023-12-28 05:01:06,311][106225] Updated weights for policy 1, policy_version 1361109 (0.0010) [2023-12-28 05:01:06,535][106226] Updated weights for policy 0, policy_version 1357825 (0.0006) [2023-12-28 05:01:06,607][106226] Updated weights for policy 0, policy_version 1357835 (0.0009) [2023-12-28 05:01:06,667][106226] Updated weights for policy 0, policy_version 1357845 (0.0010) [2023-12-28 05:01:06,724][106226] Updated weights for policy 0, policy_version 1357855 (0.0009) [2023-12-28 05:01:06,975][106225] Updated weights for policy 1, policy_version 1361119 (0.0011) [2023-12-28 05:01:07,037][106225] Updated weights for policy 1, policy_version 1361129 (0.0011) [2023-12-28 05:01:07,098][106225] Updated weights for policy 1, policy_version 1361139 (0.0010) [2023-12-28 05:01:07,467][106226] Updated weights for policy 0, policy_version 1357865 (0.0007) [2023-12-28 05:01:07,536][106226] Updated weights for policy 0, policy_version 1357875 (0.0011) [2023-12-28 05:01:07,605][106226] Updated weights for policy 0, policy_version 1357885 (0.0011) [2023-12-28 05:01:07,701][106225] Updated weights for policy 1, policy_version 1361149 (0.0011) [2023-12-28 05:01:07,758][106225] Updated weights for policy 1, policy_version 1361159 (0.0011) [2023-12-28 05:01:07,821][106225] Updated weights for policy 1, policy_version 1361169 (0.0010) [2023-12-28 05:01:08,317][106226] Updated weights for policy 0, policy_version 1357895 (0.0011) [2023-12-28 05:01:08,390][106226] Updated weights for policy 0, policy_version 1357905 (0.0011) [2023-12-28 05:01:08,455][106226] Updated weights for policy 0, policy_version 1357915 (0.0007) [2023-12-28 05:01:08,509][106225] Updated weights for policy 1, policy_version 1361179 (0.0010) [2023-12-28 05:01:08,571][106225] Updated weights for policy 1, policy_version 1361189 (0.0007) [2023-12-28 05:01:08,640][106225] Updated weights for policy 1, policy_version 1361199 (0.0007) [2023-12-28 05:01:09,173][106226] Updated weights for policy 0, policy_version 1357925 (0.0011) [2023-12-28 05:01:09,239][106226] Updated weights for policy 0, policy_version 1357935 (0.0010) [2023-12-28 05:01:09,305][106226] Updated weights for policy 0, policy_version 1357945 (0.0011) [2023-12-28 05:01:09,357][106225] Updated weights for policy 1, policy_version 1361209 (0.0007) [2023-12-28 05:01:09,435][106225] Updated weights for policy 1, policy_version 1361219 (0.0008) [2023-12-28 05:01:09,498][106225] Updated weights for policy 1, policy_version 1361229 (0.0006) [2023-12-28 05:01:09,558][106225] Updated weights for policy 1, policy_version 1361239 (0.0007) [2023-12-28 05:01:10,078][106226] Updated weights for policy 0, policy_version 1357955 (0.0009) [2023-12-28 05:01:10,146][106226] Updated weights for policy 0, policy_version 1357965 (0.0009) [2023-12-28 05:01:10,197][106225] Updated weights for policy 1, policy_version 1361249 (0.0008) [2023-12-28 05:01:10,208][106226] Updated weights for policy 0, policy_version 1357975 (0.0008) [2023-12-28 05:01:10,261][106225] Updated weights for policy 1, policy_version 1361259 (0.0007) [2023-12-28 05:01:10,326][106225] Updated weights for policy 1, policy_version 1361269 (0.0007) [2023-12-28 05:01:10,878][106226] Updated weights for policy 0, policy_version 1357985 (0.0007) [2023-12-28 05:01:10,928][106226] Updated weights for policy 0, policy_version 1357995 (0.0008) [2023-12-28 05:01:10,990][106226] Updated weights for policy 0, policy_version 1358005 (0.0008) [2023-12-28 05:01:11,050][106226] Updated weights for policy 0, policy_version 1358015 (0.0007) [2023-12-28 05:01:11,068][106225] Updated weights for policy 1, policy_version 1361279 (0.0009) [2023-12-28 05:01:11,135][106225] Updated weights for policy 1, policy_version 1361289 (0.0008) [2023-12-28 05:01:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 696254464. Throughput: 0: 9936.0, 1: 10060.8. Samples: 696227928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:11,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.613')] [2023-12-28 05:01:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001358016_347717632.pth... [2023-12-28 05:01:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001356864_347422720.pth [2023-12-28 05:01:11,202][106225] Updated weights for policy 1, policy_version 1361299 (0.0007) [2023-12-28 05:01:11,226][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001361304_348545024.pth... [2023-12-28 05:01:11,232][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001360120_348241920.pth [2023-12-28 05:01:11,870][106226] Updated weights for policy 0, policy_version 1358025 (0.0008) [2023-12-28 05:01:11,940][106226] Updated weights for policy 0, policy_version 1358035 (0.0009) [2023-12-28 05:01:11,985][106225] Updated weights for policy 1, policy_version 1361309 (0.0007) [2023-12-28 05:01:12,007][106226] Updated weights for policy 0, policy_version 1358045 (0.0007) [2023-12-28 05:01:12,059][106225] Updated weights for policy 1, policy_version 1361319 (0.0008) [2023-12-28 05:01:12,124][106225] Updated weights for policy 1, policy_version 1361329 (0.0008) [2023-12-28 05:01:12,752][106226] Updated weights for policy 0, policy_version 1358055 (0.0008) [2023-12-28 05:01:12,819][106226] Updated weights for policy 0, policy_version 1358065 (0.0007) [2023-12-28 05:01:12,881][106226] Updated weights for policy 0, policy_version 1358075 (0.0009) [2023-12-28 05:01:12,908][106225] Updated weights for policy 1, policy_version 1361339 (0.0009) [2023-12-28 05:01:12,970][106225] Updated weights for policy 1, policy_version 1361349 (0.0009) [2023-12-28 05:01:13,029][106225] Updated weights for policy 1, policy_version 1361359 (0.0008) [2023-12-28 05:01:13,565][106226] Updated weights for policy 0, policy_version 1358085 (0.0008) [2023-12-28 05:01:13,625][106226] Updated weights for policy 0, policy_version 1358095 (0.0008) [2023-12-28 05:01:13,684][106226] Updated weights for policy 0, policy_version 1358105 (0.0008) [2023-12-28 05:01:13,753][106225] Updated weights for policy 1, policy_version 1361369 (0.0008) [2023-12-28 05:01:13,815][106225] Updated weights for policy 1, policy_version 1361379 (0.0010) [2023-12-28 05:01:13,879][106225] Updated weights for policy 1, policy_version 1361389 (0.0011) [2023-12-28 05:01:13,941][106225] Updated weights for policy 1, policy_version 1361399 (0.0010) [2023-12-28 05:01:14,436][106226] Updated weights for policy 0, policy_version 1358115 (0.0008) [2023-12-28 05:01:14,494][106226] Updated weights for policy 0, policy_version 1358125 (0.0008) [2023-12-28 05:01:14,552][106226] Updated weights for policy 0, policy_version 1358135 (0.0008) [2023-12-28 05:01:14,681][106225] Updated weights for policy 1, policy_version 1361409 (0.0010) [2023-12-28 05:01:14,747][106225] Updated weights for policy 1, policy_version 1361419 (0.0010) [2023-12-28 05:01:14,817][106225] Updated weights for policy 1, policy_version 1361429 (0.0008) [2023-12-28 05:01:15,258][106226] Updated weights for policy 0, policy_version 1358145 (0.0009) [2023-12-28 05:01:15,321][106226] Updated weights for policy 0, policy_version 1358155 (0.0008) [2023-12-28 05:01:15,382][106226] Updated weights for policy 0, policy_version 1358165 (0.0007) [2023-12-28 05:01:15,449][106226] Updated weights for policy 0, policy_version 1358175 (0.0009) [2023-12-28 05:01:15,477][106225] Updated weights for policy 1, policy_version 1361439 (0.0006) [2023-12-28 05:01:15,543][106225] Updated weights for policy 1, policy_version 1361449 (0.0007) [2023-12-28 05:01:15,596][106225] Updated weights for policy 1, policy_version 1361459 (0.0008) [2023-12-28 05:01:16,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 696344576. Throughput: 0: 9748.4, 1: 9981.8. Samples: 696340008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:16,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.744')] [2023-12-28 05:01:16,208][106225] Updated weights for policy 1, policy_version 1361469 (0.0007) [2023-12-28 05:01:16,231][106226] Updated weights for policy 0, policy_version 1358185 (0.0008) [2023-12-28 05:01:16,268][106225] Updated weights for policy 1, policy_version 1361479 (0.0007) [2023-12-28 05:01:16,290][106226] Updated weights for policy 0, policy_version 1358195 (0.0008) [2023-12-28 05:01:16,330][106225] Updated weights for policy 1, policy_version 1361489 (0.0007) [2023-12-28 05:01:16,352][106226] Updated weights for policy 0, policy_version 1358205 (0.0009) [2023-12-28 05:01:17,049][106225] Updated weights for policy 1, policy_version 1361499 (0.0007) [2023-12-28 05:01:17,112][106225] Updated weights for policy 1, policy_version 1361509 (0.0008) [2023-12-28 05:01:17,159][106226] Updated weights for policy 0, policy_version 1358215 (0.0008) [2023-12-28 05:01:17,166][106225] Updated weights for policy 1, policy_version 1361519 (0.0006) [2023-12-28 05:01:17,224][106226] Updated weights for policy 0, policy_version 1358225 (0.0008) [2023-12-28 05:01:17,271][106226] Updated weights for policy 0, policy_version 1358235 (0.0008) [2023-12-28 05:01:17,890][106225] Updated weights for policy 1, policy_version 1361529 (0.0007) [2023-12-28 05:01:17,951][106225] Updated weights for policy 1, policy_version 1361539 (0.0007) [2023-12-28 05:01:18,005][106225] Updated weights for policy 1, policy_version 1361549 (0.0008) [2023-12-28 05:01:18,025][106226] Updated weights for policy 0, policy_version 1358245 (0.0007) [2023-12-28 05:01:18,067][106225] Updated weights for policy 1, policy_version 1361559 (0.0008) [2023-12-28 05:01:18,078][106226] Updated weights for policy 0, policy_version 1358255 (0.0009) [2023-12-28 05:01:18,141][106226] Updated weights for policy 0, policy_version 1358265 (0.0009) [2023-12-28 05:01:18,833][106225] Updated weights for policy 1, policy_version 1361569 (0.0007) [2023-12-28 05:01:18,903][106225] Updated weights for policy 1, policy_version 1361579 (0.0006) [2023-12-28 05:01:18,927][106226] Updated weights for policy 0, policy_version 1358275 (0.0008) [2023-12-28 05:01:18,966][106225] Updated weights for policy 1, policy_version 1361589 (0.0007) [2023-12-28 05:01:18,984][106226] Updated weights for policy 0, policy_version 1358285 (0.0006) [2023-12-28 05:01:19,049][106226] Updated weights for policy 0, policy_version 1358295 (0.0006) [2023-12-28 05:01:19,648][106225] Updated weights for policy 1, policy_version 1361599 (0.0009) [2023-12-28 05:01:19,705][106225] Updated weights for policy 1, policy_version 1361609 (0.0009) [2023-12-28 05:01:19,772][106226] Updated weights for policy 0, policy_version 1358305 (0.0006) [2023-12-28 05:01:19,773][106225] Updated weights for policy 1, policy_version 1361619 (0.0006) [2023-12-28 05:01:19,843][106226] Updated weights for policy 0, policy_version 1358315 (0.0008) [2023-12-28 05:01:19,907][106226] Updated weights for policy 0, policy_version 1358325 (0.0010) [2023-12-28 05:01:19,974][106226] Updated weights for policy 0, policy_version 1358335 (0.0010) [2023-12-28 05:01:20,444][106225] Updated weights for policy 1, policy_version 1361629 (0.0007) [2023-12-28 05:01:20,504][106225] Updated weights for policy 1, policy_version 1361639 (0.0009) [2023-12-28 05:01:20,556][106225] Updated weights for policy 1, policy_version 1361649 (0.0007) [2023-12-28 05:01:20,748][106226] Updated weights for policy 0, policy_version 1358345 (0.0008) [2023-12-28 05:01:20,806][106226] Updated weights for policy 0, policy_version 1358355 (0.0006) [2023-12-28 05:01:20,859][106226] Updated weights for policy 0, policy_version 1358365 (0.0006) [2023-12-28 05:01:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 696442880. Throughput: 0: 9700.2, 1: 9896.5. Samples: 696453716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:21,175][105115] Avg episode reward: [(0, '-4.865'), (1, '-4.351')] [2023-12-28 05:01:21,299][106225] Updated weights for policy 1, policy_version 1361659 (0.0008) [2023-12-28 05:01:21,383][106225] Updated weights for policy 1, policy_version 1361669 (0.0008) [2023-12-28 05:01:21,451][106225] Updated weights for policy 1, policy_version 1361679 (0.0007) [2023-12-28 05:01:21,585][106226] Updated weights for policy 0, policy_version 1358375 (0.0007) [2023-12-28 05:01:21,651][106226] Updated weights for policy 0, policy_version 1358385 (0.0008) [2023-12-28 05:01:21,708][106226] Updated weights for policy 0, policy_version 1358395 (0.0008) [2023-12-28 05:01:22,182][106225] Updated weights for policy 1, policy_version 1361689 (0.0010) [2023-12-28 05:01:22,232][106225] Updated weights for policy 1, policy_version 1361699 (0.0008) [2023-12-28 05:01:22,294][106225] Updated weights for policy 1, policy_version 1361709 (0.0008) [2023-12-28 05:01:22,349][106225] Updated weights for policy 1, policy_version 1361719 (0.0006) [2023-12-28 05:01:22,458][106226] Updated weights for policy 0, policy_version 1358405 (0.0009) [2023-12-28 05:01:22,516][106226] Updated weights for policy 0, policy_version 1358415 (0.0009) [2023-12-28 05:01:22,579][106226] Updated weights for policy 0, policy_version 1358425 (0.0009) [2023-12-28 05:01:23,082][106225] Updated weights for policy 1, policy_version 1361729 (0.0008) [2023-12-28 05:01:23,152][106225] Updated weights for policy 1, policy_version 1361739 (0.0007) [2023-12-28 05:01:23,220][106225] Updated weights for policy 1, policy_version 1361749 (0.0008) [2023-12-28 05:01:23,257][106226] Updated weights for policy 0, policy_version 1358435 (0.0008) [2023-12-28 05:01:23,319][106226] Updated weights for policy 0, policy_version 1358445 (0.0008) [2023-12-28 05:01:23,384][106226] Updated weights for policy 0, policy_version 1358455 (0.0008) [2023-12-28 05:01:23,919][106225] Updated weights for policy 1, policy_version 1361759 (0.0007) [2023-12-28 05:01:23,970][106225] Updated weights for policy 1, policy_version 1361769 (0.0005) [2023-12-28 05:01:24,020][106225] Updated weights for policy 1, policy_version 1361779 (0.0008) [2023-12-28 05:01:24,043][106226] Updated weights for policy 0, policy_version 1358465 (0.0009) [2023-12-28 05:01:24,102][106226] Updated weights for policy 0, policy_version 1358475 (0.0008) [2023-12-28 05:01:24,166][106226] Updated weights for policy 0, policy_version 1358485 (0.0008) [2023-12-28 05:01:24,228][106226] Updated weights for policy 0, policy_version 1358495 (0.0008) [2023-12-28 05:01:24,681][106225] Updated weights for policy 1, policy_version 1361789 (0.0007) [2023-12-28 05:01:24,739][106225] Updated weights for policy 1, policy_version 1361799 (0.0009) [2023-12-28 05:01:24,789][106225] Updated weights for policy 1, policy_version 1361809 (0.0009) [2023-12-28 05:01:24,844][106226] Updated weights for policy 0, policy_version 1358505 (0.0009) [2023-12-28 05:01:24,899][106226] Updated weights for policy 0, policy_version 1358515 (0.0009) [2023-12-28 05:01:24,948][106226] Updated weights for policy 0, policy_version 1358525 (0.0008) [2023-12-28 05:01:25,524][106225] Updated weights for policy 1, policy_version 1361819 (0.0006) [2023-12-28 05:01:25,581][106225] Updated weights for policy 1, policy_version 1361829 (0.0005) [2023-12-28 05:01:25,635][106225] Updated weights for policy 1, policy_version 1361839 (0.0009) [2023-12-28 05:01:25,702][106226] Updated weights for policy 0, policy_version 1358535 (0.0006) [2023-12-28 05:01:25,758][106226] Updated weights for policy 0, policy_version 1358545 (0.0005) [2023-12-28 05:01:25,817][106226] Updated weights for policy 0, policy_version 1358555 (0.0005) [2023-12-28 05:01:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 696541184. Throughput: 0: 9689.8, 1: 9893.4. Samples: 696510636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:26,176][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.647')] [2023-12-28 05:01:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001361848_348684288.pth... [2023-12-28 05:01:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001358560_347856896.pth... [2023-12-28 05:01:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001360728_348397568.pth [2023-12-28 05:01:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001357440_347570176.pth [2023-12-28 05:01:26,323][106225] Updated weights for policy 1, policy_version 1361849 (0.0010) [2023-12-28 05:01:26,382][106225] Updated weights for policy 1, policy_version 1361859 (0.0006) [2023-12-28 05:01:26,422][106226] Updated weights for policy 0, policy_version 1358565 (0.0008) [2023-12-28 05:01:26,444][106225] Updated weights for policy 1, policy_version 1361869 (0.0007) [2023-12-28 05:01:26,490][106226] Updated weights for policy 0, policy_version 1358575 (0.0011) [2023-12-28 05:01:26,503][106225] Updated weights for policy 1, policy_version 1361879 (0.0007) [2023-12-28 05:01:26,557][106226] Updated weights for policy 0, policy_version 1358585 (0.0011) [2023-12-28 05:01:27,106][106226] Updated weights for policy 0, policy_version 1358595 (0.0009) [2023-12-28 05:01:27,168][106226] Updated weights for policy 0, policy_version 1358605 (0.0005) [2023-12-28 05:01:27,209][106225] Updated weights for policy 1, policy_version 1361889 (0.0008) [2023-12-28 05:01:27,227][106226] Updated weights for policy 0, policy_version 1358615 (0.0006) [2023-12-28 05:01:27,260][106225] Updated weights for policy 1, policy_version 1361899 (0.0007) [2023-12-28 05:01:27,312][106225] Updated weights for policy 1, policy_version 1361909 (0.0007) [2023-12-28 05:01:27,861][106226] Updated weights for policy 0, policy_version 1358625 (0.0010) [2023-12-28 05:01:27,919][106226] Updated weights for policy 0, policy_version 1358635 (0.0009) [2023-12-28 05:01:27,974][106226] Updated weights for policy 0, policy_version 1358645 (0.0008) [2023-12-28 05:01:28,032][106226] Updated weights for policy 0, policy_version 1358655 (0.0008) [2023-12-28 05:01:28,050][106225] Updated weights for policy 1, policy_version 1361919 (0.0007) [2023-12-28 05:01:28,107][106225] Updated weights for policy 1, policy_version 1361929 (0.0008) [2023-12-28 05:01:28,168][106225] Updated weights for policy 1, policy_version 1361939 (0.0009) [2023-12-28 05:01:28,804][106226] Updated weights for policy 0, policy_version 1358665 (0.0005) [2023-12-28 05:01:28,820][106225] Updated weights for policy 1, policy_version 1361949 (0.0005) [2023-12-28 05:01:28,872][106226] Updated weights for policy 0, policy_version 1358675 (0.0007) [2023-12-28 05:01:28,886][106225] Updated weights for policy 1, policy_version 1361959 (0.0006) [2023-12-28 05:01:28,936][106226] Updated weights for policy 0, policy_version 1358685 (0.0007) [2023-12-28 05:01:28,940][106225] Updated weights for policy 1, policy_version 1361969 (0.0007) [2023-12-28 05:01:29,560][106225] Updated weights for policy 1, policy_version 1361979 (0.0006) [2023-12-28 05:01:29,605][106226] Updated weights for policy 0, policy_version 1358695 (0.0009) [2023-12-28 05:01:29,612][106225] Updated weights for policy 1, policy_version 1361989 (0.0006) [2023-12-28 05:01:29,665][106226] Updated weights for policy 0, policy_version 1358705 (0.0011) [2023-12-28 05:01:29,679][106225] Updated weights for policy 1, policy_version 1361999 (0.0005) [2023-12-28 05:01:29,722][106226] Updated weights for policy 0, policy_version 1358715 (0.0011) [2023-12-28 05:01:30,377][106225] Updated weights for policy 1, policy_version 1362009 (0.0007) [2023-12-28 05:01:30,440][106225] Updated weights for policy 1, policy_version 1362019 (0.0009) [2023-12-28 05:01:30,469][106226] Updated weights for policy 0, policy_version 1358725 (0.0009) [2023-12-28 05:01:30,496][106225] Updated weights for policy 1, policy_version 1362029 (0.0008) [2023-12-28 05:01:30,520][106226] Updated weights for policy 0, policy_version 1358735 (0.0008) [2023-12-28 05:01:30,557][106225] Updated weights for policy 1, policy_version 1362039 (0.0005) [2023-12-28 05:01:30,571][106226] Updated weights for policy 0, policy_version 1358745 (0.0008) [2023-12-28 05:01:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 696639488. Throughput: 0: 9802.4, 1: 9893.1. Samples: 696633040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:31,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-4.512')] [2023-12-28 05:01:31,233][106225] Updated weights for policy 1, policy_version 1362049 (0.0008) [2023-12-28 05:01:31,293][106225] Updated weights for policy 1, policy_version 1362059 (0.0008) [2023-12-28 05:01:31,351][106225] Updated weights for policy 1, policy_version 1362069 (0.0008) [2023-12-28 05:01:31,370][106226] Updated weights for policy 0, policy_version 1358755 (0.0009) [2023-12-28 05:01:31,430][106226] Updated weights for policy 0, policy_version 1358765 (0.0008) [2023-12-28 05:01:31,483][106226] Updated weights for policy 0, policy_version 1358775 (0.0007) [2023-12-28 05:01:32,106][106225] Updated weights for policy 1, policy_version 1362079 (0.0008) [2023-12-28 05:01:32,164][106225] Updated weights for policy 1, policy_version 1362089 (0.0008) [2023-12-28 05:01:32,212][106226] Updated weights for policy 0, policy_version 1358785 (0.0007) [2023-12-28 05:01:32,218][106225] Updated weights for policy 1, policy_version 1362099 (0.0009) [2023-12-28 05:01:32,273][106226] Updated weights for policy 0, policy_version 1358795 (0.0008) [2023-12-28 05:01:32,337][106226] Updated weights for policy 0, policy_version 1358805 (0.0009) [2023-12-28 05:01:32,395][106226] Updated weights for policy 0, policy_version 1358815 (0.0009) [2023-12-28 05:01:32,888][106225] Updated weights for policy 1, policy_version 1362109 (0.0006) [2023-12-28 05:01:32,949][106225] Updated weights for policy 1, policy_version 1362119 (0.0008) [2023-12-28 05:01:33,005][106225] Updated weights for policy 1, policy_version 1362129 (0.0009) [2023-12-28 05:01:33,119][106226] Updated weights for policy 0, policy_version 1358825 (0.0009) [2023-12-28 05:01:33,187][106226] Updated weights for policy 0, policy_version 1358835 (0.0006) [2023-12-28 05:01:33,255][106226] Updated weights for policy 0, policy_version 1358845 (0.0005) [2023-12-28 05:01:33,607][106225] Updated weights for policy 1, policy_version 1362139 (0.0008) [2023-12-28 05:01:33,670][106225] Updated weights for policy 1, policy_version 1362149 (0.0012) [2023-12-28 05:01:33,727][106225] Updated weights for policy 1, policy_version 1362159 (0.0010) [2023-12-28 05:01:33,837][106226] Updated weights for policy 0, policy_version 1358855 (0.0007) [2023-12-28 05:01:33,899][106226] Updated weights for policy 0, policy_version 1358865 (0.0008) [2023-12-28 05:01:33,957][106226] Updated weights for policy 0, policy_version 1358875 (0.0008) [2023-12-28 05:01:34,505][106225] Updated weights for policy 1, policy_version 1362169 (0.0010) [2023-12-28 05:01:34,564][106225] Updated weights for policy 1, policy_version 1362179 (0.0009) [2023-12-28 05:01:34,587][106226] Updated weights for policy 0, policy_version 1358885 (0.0007) [2023-12-28 05:01:34,618][106225] Updated weights for policy 1, policy_version 1362189 (0.0008) [2023-12-28 05:01:34,640][106226] Updated weights for policy 0, policy_version 1358895 (0.0009) [2023-12-28 05:01:34,677][106225] Updated weights for policy 1, policy_version 1362199 (0.0007) [2023-12-28 05:01:34,700][106226] Updated weights for policy 0, policy_version 1358905 (0.0008) [2023-12-28 05:01:35,309][106225] Updated weights for policy 1, policy_version 1362209 (0.0008) [2023-12-28 05:01:35,365][106225] Updated weights for policy 1, policy_version 1362219 (0.0008) [2023-12-28 05:01:35,422][106225] Updated weights for policy 1, policy_version 1362229 (0.0009) [2023-12-28 05:01:35,443][106226] Updated weights for policy 0, policy_version 1358915 (0.0007) [2023-12-28 05:01:35,502][106226] Updated weights for policy 0, policy_version 1358925 (0.0006) [2023-12-28 05:01:35,561][106226] Updated weights for policy 0, policy_version 1358935 (0.0008) [2023-12-28 05:01:36,151][106225] Updated weights for policy 1, policy_version 1362239 (0.0009) [2023-12-28 05:01:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 696737792. Throughput: 0: 9824.1, 1: 9860.9. Samples: 696752376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:36,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.361')] [2023-12-28 05:01:36,186][106226] Updated weights for policy 0, policy_version 1358945 (0.0007) [2023-12-28 05:01:36,217][106225] Updated weights for policy 1, policy_version 1362249 (0.0006) [2023-12-28 05:01:36,242][106226] Updated weights for policy 0, policy_version 1358955 (0.0008) [2023-12-28 05:01:36,284][106225] Updated weights for policy 1, policy_version 1362259 (0.0006) [2023-12-28 05:01:36,305][106226] Updated weights for policy 0, policy_version 1358965 (0.0008) [2023-12-28 05:01:36,368][106226] Updated weights for policy 0, policy_version 1358975 (0.0009) [2023-12-28 05:01:36,926][106225] Updated weights for policy 1, policy_version 1362269 (0.0008) [2023-12-28 05:01:36,987][106225] Updated weights for policy 1, policy_version 1362279 (0.0009) [2023-12-28 05:01:37,048][106225] Updated weights for policy 1, policy_version 1362289 (0.0008) [2023-12-28 05:01:37,130][106226] Updated weights for policy 0, policy_version 1358985 (0.0008) [2023-12-28 05:01:37,183][106226] Updated weights for policy 0, policy_version 1358995 (0.0009) [2023-12-28 05:01:37,243][106226] Updated weights for policy 0, policy_version 1359005 (0.0009) [2023-12-28 05:01:37,641][106225] Updated weights for policy 1, policy_version 1362299 (0.0008) [2023-12-28 05:01:37,698][106225] Updated weights for policy 1, policy_version 1362309 (0.0009) [2023-12-28 05:01:37,762][106225] Updated weights for policy 1, policy_version 1362319 (0.0007) [2023-12-28 05:01:37,864][106226] Updated weights for policy 0, policy_version 1359015 (0.0007) [2023-12-28 05:01:37,930][106226] Updated weights for policy 0, policy_version 1359025 (0.0008) [2023-12-28 05:01:37,990][106226] Updated weights for policy 0, policy_version 1359035 (0.0005) [2023-12-28 05:01:38,438][106225] Updated weights for policy 1, policy_version 1362329 (0.0009) [2023-12-28 05:01:38,499][106225] Updated weights for policy 1, policy_version 1362339 (0.0008) [2023-12-28 05:01:38,557][106225] Updated weights for policy 1, policy_version 1362349 (0.0008) [2023-12-28 05:01:38,617][106225] Updated weights for policy 1, policy_version 1362359 (0.0008) [2023-12-28 05:01:38,638][106226] Updated weights for policy 0, policy_version 1359045 (0.0008) [2023-12-28 05:01:38,703][106226] Updated weights for policy 0, policy_version 1359055 (0.0011) [2023-12-28 05:01:38,757][106226] Updated weights for policy 0, policy_version 1359065 (0.0011) [2023-12-28 05:01:39,391][106225] Updated weights for policy 1, policy_version 1362369 (0.0008) [2023-12-28 05:01:39,461][106225] Updated weights for policy 1, policy_version 1362379 (0.0008) [2023-12-28 05:01:39,480][106226] Updated weights for policy 0, policy_version 1359075 (0.0009) [2023-12-28 05:01:39,520][106225] Updated weights for policy 1, policy_version 1362389 (0.0008) [2023-12-28 05:01:39,546][106226] Updated weights for policy 0, policy_version 1359085 (0.0007) [2023-12-28 05:01:39,608][106226] Updated weights for policy 0, policy_version 1359095 (0.0009) [2023-12-28 05:01:40,179][106225] Updated weights for policy 1, policy_version 1362399 (0.0009) [2023-12-28 05:01:40,249][106225] Updated weights for policy 1, policy_version 1362409 (0.0009) [2023-12-28 05:01:40,307][106225] Updated weights for policy 1, policy_version 1362419 (0.0007) [2023-12-28 05:01:40,379][106226] Updated weights for policy 0, policy_version 1359105 (0.0009) [2023-12-28 05:01:40,433][106226] Updated weights for policy 0, policy_version 1359115 (0.0007) [2023-12-28 05:01:40,497][106226] Updated weights for policy 0, policy_version 1359125 (0.0007) [2023-12-28 05:01:40,561][106226] Updated weights for policy 0, policy_version 1359135 (0.0008) [2023-12-28 05:01:40,935][106225] Updated weights for policy 1, policy_version 1362429 (0.0007) [2023-12-28 05:01:41,007][106225] Updated weights for policy 1, policy_version 1362439 (0.0009) [2023-12-28 05:01:41,077][106225] Updated weights for policy 1, policy_version 1362449 (0.0011) [2023-12-28 05:01:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 696844288. Throughput: 0: 9861.9, 1: 9884.4. Samples: 696813640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:41,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-4.845')] [2023-12-28 05:01:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001362456_348839936.pth... [2023-12-28 05:01:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001359136_348004352.pth... [2023-12-28 05:01:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001361304_348545024.pth [2023-12-28 05:01:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001358016_347717632.pth [2023-12-28 05:01:41,393][106226] Updated weights for policy 0, policy_version 1359145 (0.0008) [2023-12-28 05:01:41,462][106226] Updated weights for policy 0, policy_version 1359155 (0.0009) [2023-12-28 05:01:41,529][106226] Updated weights for policy 0, policy_version 1359165 (0.0010) [2023-12-28 05:01:41,798][106225] Updated weights for policy 1, policy_version 1362459 (0.0011) [2023-12-28 05:01:41,849][106225] Updated weights for policy 1, policy_version 1362469 (0.0009) [2023-12-28 05:01:41,896][106225] Updated weights for policy 1, policy_version 1362479 (0.0008) [2023-12-28 05:01:42,311][106226] Updated weights for policy 0, policy_version 1359175 (0.0008) [2023-12-28 05:01:42,387][106226] Updated weights for policy 0, policy_version 1359185 (0.0008) [2023-12-28 05:01:42,457][106226] Updated weights for policy 0, policy_version 1359195 (0.0010) [2023-12-28 05:01:42,590][106225] Updated weights for policy 1, policy_version 1362489 (0.0009) [2023-12-28 05:01:42,654][106225] Updated weights for policy 1, policy_version 1362499 (0.0008) [2023-12-28 05:01:42,712][106225] Updated weights for policy 1, policy_version 1362509 (0.0006) [2023-12-28 05:01:42,773][106225] Updated weights for policy 1, policy_version 1362519 (0.0006) [2023-12-28 05:01:43,234][106226] Updated weights for policy 0, policy_version 1359205 (0.0009) [2023-12-28 05:01:43,292][106226] Updated weights for policy 0, policy_version 1359215 (0.0008) [2023-12-28 05:01:43,341][106226] Updated weights for policy 0, policy_version 1359225 (0.0008) [2023-12-28 05:01:43,391][106225] Updated weights for policy 1, policy_version 1362529 (0.0009) [2023-12-28 05:01:43,447][106225] Updated weights for policy 1, policy_version 1362539 (0.0009) [2023-12-28 05:01:43,497][106225] Updated weights for policy 1, policy_version 1362549 (0.0008) [2023-12-28 05:01:44,112][106226] Updated weights for policy 0, policy_version 1359235 (0.0006) [2023-12-28 05:01:44,135][106225] Updated weights for policy 1, policy_version 1362559 (0.0009) [2023-12-28 05:01:44,164][106226] Updated weights for policy 0, policy_version 1359245 (0.0005) [2023-12-28 05:01:44,202][106225] Updated weights for policy 1, policy_version 1362569 (0.0008) [2023-12-28 05:01:44,216][106226] Updated weights for policy 0, policy_version 1359255 (0.0008) [2023-12-28 05:01:44,268][106225] Updated weights for policy 1, policy_version 1362579 (0.0008) [2023-12-28 05:01:44,945][106225] Updated weights for policy 1, policy_version 1362589 (0.0006) [2023-12-28 05:01:44,947][106226] Updated weights for policy 0, policy_version 1359265 (0.0007) [2023-12-28 05:01:45,011][106225] Updated weights for policy 1, policy_version 1362599 (0.0007) [2023-12-28 05:01:45,019][106226] Updated weights for policy 0, policy_version 1359275 (0.0006) [2023-12-28 05:01:45,080][106225] Updated weights for policy 1, policy_version 1362609 (0.0007) [2023-12-28 05:01:45,091][106226] Updated weights for policy 0, policy_version 1359285 (0.0006) [2023-12-28 05:01:45,160][106226] Updated weights for policy 0, policy_version 1359295 (0.0009) [2023-12-28 05:01:45,700][106225] Updated weights for policy 1, policy_version 1362619 (0.0007) [2023-12-28 05:01:45,750][106225] Updated weights for policy 1, policy_version 1362629 (0.0008) [2023-12-28 05:01:45,808][106225] Updated weights for policy 1, policy_version 1362639 (0.0008) [2023-12-28 05:01:45,862][106226] Updated weights for policy 0, policy_version 1359305 (0.0007) [2023-12-28 05:01:45,918][106226] Updated weights for policy 0, policy_version 1359315 (0.0008) [2023-12-28 05:01:45,970][106226] Updated weights for policy 0, policy_version 1359325 (0.0009) [2023-12-28 05:01:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 696942592. Throughput: 0: 9712.5, 1: 9825.4. Samples: 696929380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:46,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.518')] [2023-12-28 05:01:46,588][106225] Updated weights for policy 1, policy_version 1362649 (0.0006) [2023-12-28 05:01:46,612][106226] Updated weights for policy 0, policy_version 1359335 (0.0007) [2023-12-28 05:01:46,649][106225] Updated weights for policy 1, policy_version 1362659 (0.0006) [2023-12-28 05:01:46,657][106226] Updated weights for policy 0, policy_version 1359345 (0.0008) [2023-12-28 05:01:46,707][106226] Updated weights for policy 0, policy_version 1359355 (0.0008) [2023-12-28 05:01:46,708][106225] Updated weights for policy 1, policy_version 1362669 (0.0005) [2023-12-28 05:01:46,771][106225] Updated weights for policy 1, policy_version 1362679 (0.0005) [2023-12-28 05:01:47,354][106226] Updated weights for policy 0, policy_version 1359365 (0.0008) [2023-12-28 05:01:47,414][106226] Updated weights for policy 0, policy_version 1359375 (0.0006) [2023-12-28 05:01:47,430][106225] Updated weights for policy 1, policy_version 1362689 (0.0007) [2023-12-28 05:01:47,474][106226] Updated weights for policy 0, policy_version 1359385 (0.0005) [2023-12-28 05:01:47,480][106225] Updated weights for policy 1, policy_version 1362699 (0.0008) [2023-12-28 05:01:47,528][106225] Updated weights for policy 1, policy_version 1362709 (0.0008) [2023-12-28 05:01:48,137][106226] Updated weights for policy 0, policy_version 1359395 (0.0006) [2023-12-28 05:01:48,199][106226] Updated weights for policy 0, policy_version 1359405 (0.0008) [2023-12-28 05:01:48,244][106225] Updated weights for policy 1, policy_version 1362719 (0.0008) [2023-12-28 05:01:48,263][106226] Updated weights for policy 0, policy_version 1359415 (0.0006) [2023-12-28 05:01:48,293][106225] Updated weights for policy 1, policy_version 1362729 (0.0008) [2023-12-28 05:01:48,352][106225] Updated weights for policy 1, policy_version 1362739 (0.0007) [2023-12-28 05:01:48,944][106226] Updated weights for policy 0, policy_version 1359425 (0.0006) [2023-12-28 05:01:49,006][106226] Updated weights for policy 0, policy_version 1359435 (0.0008) [2023-12-28 05:01:49,069][106226] Updated weights for policy 0, policy_version 1359445 (0.0009) [2023-12-28 05:01:49,087][106225] Updated weights for policy 1, policy_version 1362749 (0.0007) [2023-12-28 05:01:49,148][106225] Updated weights for policy 1, policy_version 1362759 (0.0007) [2023-12-28 05:01:49,152][106226] Updated weights for policy 0, policy_version 1359455 (0.0008) [2023-12-28 05:01:49,201][106225] Updated weights for policy 1, policy_version 1362769 (0.0006) [2023-12-28 05:01:49,871][106226] Updated weights for policy 0, policy_version 1359465 (0.0009) [2023-12-28 05:01:49,928][106226] Updated weights for policy 0, policy_version 1359475 (0.0010) [2023-12-28 05:01:49,991][106225] Updated weights for policy 1, policy_version 1362779 (0.0008) [2023-12-28 05:01:49,997][106226] Updated weights for policy 0, policy_version 1359485 (0.0008) [2023-12-28 05:01:50,048][106225] Updated weights for policy 1, policy_version 1362789 (0.0007) [2023-12-28 05:01:50,106][106225] Updated weights for policy 1, policy_version 1362799 (0.0007) [2023-12-28 05:01:50,740][106226] Updated weights for policy 0, policy_version 1359495 (0.0010) [2023-12-28 05:01:50,797][106226] Updated weights for policy 0, policy_version 1359505 (0.0011) [2023-12-28 05:01:50,825][106225] Updated weights for policy 1, policy_version 1362809 (0.0007) [2023-12-28 05:01:50,861][106226] Updated weights for policy 0, policy_version 1359515 (0.0011) [2023-12-28 05:01:50,883][106225] Updated weights for policy 1, policy_version 1362819 (0.0006) [2023-12-28 05:01:50,934][106225] Updated weights for policy 1, policy_version 1362829 (0.0006) [2023-12-28 05:01:50,984][106225] Updated weights for policy 1, policy_version 1362839 (0.0007) [2023-12-28 05:01:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 697040896. Throughput: 0: 9638.6, 1: 9870.4. Samples: 697046748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:51,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.426')] [2023-12-28 05:01:51,631][106226] Updated weights for policy 0, policy_version 1359525 (0.0010) [2023-12-28 05:01:51,698][106226] Updated weights for policy 0, policy_version 1359535 (0.0009) [2023-12-28 05:01:51,757][106225] Updated weights for policy 1, policy_version 1362849 (0.0007) [2023-12-28 05:01:51,767][106226] Updated weights for policy 0, policy_version 1359545 (0.0008) [2023-12-28 05:01:51,806][106225] Updated weights for policy 1, policy_version 1362859 (0.0006) [2023-12-28 05:01:51,869][106225] Updated weights for policy 1, policy_version 1362869 (0.0010) [2023-12-28 05:01:52,458][106226] Updated weights for policy 0, policy_version 1359555 (0.0005) [2023-12-28 05:01:52,516][106226] Updated weights for policy 0, policy_version 1359565 (0.0008) [2023-12-28 05:01:52,566][106225] Updated weights for policy 1, policy_version 1362879 (0.0008) [2023-12-28 05:01:52,575][106226] Updated weights for policy 0, policy_version 1359575 (0.0006) [2023-12-28 05:01:52,625][106225] Updated weights for policy 1, policy_version 1362889 (0.0007) [2023-12-28 05:01:52,681][106225] Updated weights for policy 1, policy_version 1362899 (0.0008) [2023-12-28 05:01:53,249][106226] Updated weights for policy 0, policy_version 1359585 (0.0007) [2023-12-28 05:01:53,298][106226] Updated weights for policy 0, policy_version 1359595 (0.0008) [2023-12-28 05:01:53,347][106226] Updated weights for policy 0, policy_version 1359605 (0.0009) [2023-12-28 05:01:53,406][106226] Updated weights for policy 0, policy_version 1359615 (0.0008) [2023-12-28 05:01:53,416][106225] Updated weights for policy 1, policy_version 1362909 (0.0007) [2023-12-28 05:01:53,468][106225] Updated weights for policy 1, policy_version 1362919 (0.0008) [2023-12-28 05:01:53,528][106225] Updated weights for policy 1, policy_version 1362929 (0.0008) [2023-12-28 05:01:54,161][106226] Updated weights for policy 0, policy_version 1359625 (0.0009) [2023-12-28 05:01:54,221][106226] Updated weights for policy 0, policy_version 1359635 (0.0009) [2023-12-28 05:01:54,252][106225] Updated weights for policy 1, policy_version 1362939 (0.0007) [2023-12-28 05:01:54,281][106226] Updated weights for policy 0, policy_version 1359645 (0.0007) [2023-12-28 05:01:54,303][106225] Updated weights for policy 1, policy_version 1362949 (0.0006) [2023-12-28 05:01:54,363][106225] Updated weights for policy 1, policy_version 1362959 (0.0007) [2023-12-28 05:01:54,920][106225] Updated weights for policy 1, policy_version 1362969 (0.0006) [2023-12-28 05:01:54,978][106225] Updated weights for policy 1, policy_version 1362979 (0.0007) [2023-12-28 05:01:55,038][106225] Updated weights for policy 1, policy_version 1362989 (0.0007) [2023-12-28 05:01:55,096][106225] Updated weights for policy 1, policy_version 1362999 (0.0006) [2023-12-28 05:01:55,110][106226] Updated weights for policy 0, policy_version 1359655 (0.0008) [2023-12-28 05:01:55,177][106226] Updated weights for policy 0, policy_version 1359665 (0.0009) [2023-12-28 05:01:55,246][106226] Updated weights for policy 0, policy_version 1359675 (0.0010) [2023-12-28 05:01:55,699][106225] Updated weights for policy 1, policy_version 1363009 (0.0009) [2023-12-28 05:01:55,756][106225] Updated weights for policy 1, policy_version 1363019 (0.0008) [2023-12-28 05:01:55,815][106225] Updated weights for policy 1, policy_version 1363029 (0.0007) [2023-12-28 05:01:55,958][106226] Updated weights for policy 0, policy_version 1359685 (0.0008) [2023-12-28 05:01:56,012][106226] Updated weights for policy 0, policy_version 1359695 (0.0008) [2023-12-28 05:01:56,062][106226] Updated weights for policy 0, policy_version 1359705 (0.0008) [2023-12-28 05:01:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 697139200. Throughput: 0: 9655.7, 1: 9829.4. Samples: 697104760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:01:56,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.405')] [2023-12-28 05:01:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001359712_348151808.pth... [2023-12-28 05:01:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001363032_348987392.pth... [2023-12-28 05:01:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001358560_347856896.pth [2023-12-28 05:01:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001361848_348684288.pth [2023-12-28 05:01:56,493][106225] Updated weights for policy 1, policy_version 1363039 (0.0008) [2023-12-28 05:01:56,537][106225] Updated weights for policy 1, policy_version 1363049 (0.0008) [2023-12-28 05:01:56,587][106225] Updated weights for policy 1, policy_version 1363059 (0.0008) [2023-12-28 05:01:56,818][106226] Updated weights for policy 0, policy_version 1359715 (0.0009) [2023-12-28 05:01:56,871][106226] Updated weights for policy 0, policy_version 1359725 (0.0008) [2023-12-28 05:01:56,921][106226] Updated weights for policy 0, policy_version 1359735 (0.0008) [2023-12-28 05:01:57,289][106225] Updated weights for policy 1, policy_version 1363069 (0.0008) [2023-12-28 05:01:57,351][106225] Updated weights for policy 1, policy_version 1363079 (0.0006) [2023-12-28 05:01:57,399][106225] Updated weights for policy 1, policy_version 1363089 (0.0005) [2023-12-28 05:01:57,634][106226] Updated weights for policy 0, policy_version 1359745 (0.0009) [2023-12-28 05:01:57,694][106226] Updated weights for policy 0, policy_version 1359755 (0.0009) [2023-12-28 05:01:57,751][106226] Updated weights for policy 0, policy_version 1359765 (0.0008) [2023-12-28 05:01:57,797][106226] Updated weights for policy 0, policy_version 1359775 (0.0008) [2023-12-28 05:01:58,018][106225] Updated weights for policy 1, policy_version 1363099 (0.0005) [2023-12-28 05:01:58,077][106225] Updated weights for policy 1, policy_version 1363109 (0.0008) [2023-12-28 05:01:58,137][106225] Updated weights for policy 1, policy_version 1363119 (0.0008) [2023-12-28 05:01:58,600][106226] Updated weights for policy 0, policy_version 1359785 (0.0007) [2023-12-28 05:01:58,665][106226] Updated weights for policy 0, policy_version 1359795 (0.0007) [2023-12-28 05:01:58,732][106226] Updated weights for policy 0, policy_version 1359805 (0.0009) [2023-12-28 05:01:58,928][106225] Updated weights for policy 1, policy_version 1363129 (0.0009) [2023-12-28 05:01:58,995][106225] Updated weights for policy 1, policy_version 1363139 (0.0009) [2023-12-28 05:01:59,054][106225] Updated weights for policy 1, policy_version 1363149 (0.0009) [2023-12-28 05:01:59,120][106225] Updated weights for policy 1, policy_version 1363159 (0.0009) [2023-12-28 05:01:59,527][106226] Updated weights for policy 0, policy_version 1359815 (0.0007) [2023-12-28 05:01:59,590][106226] Updated weights for policy 0, policy_version 1359825 (0.0008) [2023-12-28 05:01:59,659][106226] Updated weights for policy 0, policy_version 1359835 (0.0006) [2023-12-28 05:01:59,870][106225] Updated weights for policy 1, policy_version 1363169 (0.0009) [2023-12-28 05:01:59,939][106225] Updated weights for policy 1, policy_version 1363179 (0.0008) [2023-12-28 05:01:59,995][106225] Updated weights for policy 1, policy_version 1363189 (0.0007) [2023-12-28 05:02:00,351][106226] Updated weights for policy 0, policy_version 1359845 (0.0006) [2023-12-28 05:02:00,419][106226] Updated weights for policy 0, policy_version 1359855 (0.0008) [2023-12-28 05:02:00,482][106226] Updated weights for policy 0, policy_version 1359865 (0.0009) [2023-12-28 05:02:00,623][106225] Updated weights for policy 1, policy_version 1363199 (0.0007) [2023-12-28 05:02:00,682][106225] Updated weights for policy 1, policy_version 1363209 (0.0007) [2023-12-28 05:02:00,741][106225] Updated weights for policy 1, policy_version 1363219 (0.0008) [2023-12-28 05:02:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19799.6). Total num frames: 697229312. Throughput: 0: 9645.5, 1: 9939.8. Samples: 697221348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:01,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.614')] [2023-12-28 05:02:01,243][106226] Updated weights for policy 0, policy_version 1359875 (0.0009) [2023-12-28 05:02:01,304][106226] Updated weights for policy 0, policy_version 1359885 (0.0009) [2023-12-28 05:02:01,357][106226] Updated weights for policy 0, policy_version 1359895 (0.0009) [2023-12-28 05:02:01,408][106225] Updated weights for policy 1, policy_version 1363229 (0.0008) [2023-12-28 05:02:01,470][106225] Updated weights for policy 1, policy_version 1363239 (0.0006) [2023-12-28 05:02:01,532][106225] Updated weights for policy 1, policy_version 1363249 (0.0007) [2023-12-28 05:02:02,163][106226] Updated weights for policy 0, policy_version 1359905 (0.0009) [2023-12-28 05:02:02,181][106225] Updated weights for policy 1, policy_version 1363259 (0.0007) [2023-12-28 05:02:02,224][106226] Updated weights for policy 0, policy_version 1359915 (0.0007) [2023-12-28 05:02:02,237][106225] Updated weights for policy 1, policy_version 1363269 (0.0006) [2023-12-28 05:02:02,290][106226] Updated weights for policy 0, policy_version 1359925 (0.0008) [2023-12-28 05:02:02,300][106225] Updated weights for policy 1, policy_version 1363279 (0.0006) [2023-12-28 05:02:02,353][106226] Updated weights for policy 0, policy_version 1359935 (0.0006) [2023-12-28 05:02:02,897][106225] Updated weights for policy 1, policy_version 1363289 (0.0007) [2023-12-28 05:02:02,955][106225] Updated weights for policy 1, policy_version 1363299 (0.0008) [2023-12-28 05:02:03,015][106225] Updated weights for policy 1, policy_version 1363309 (0.0008) [2023-12-28 05:02:03,073][106225] Updated weights for policy 1, policy_version 1363319 (0.0008) [2023-12-28 05:02:03,079][106226] Updated weights for policy 0, policy_version 1359945 (0.0007) [2023-12-28 05:02:03,138][106226] Updated weights for policy 0, policy_version 1359955 (0.0008) [2023-12-28 05:02:03,189][106226] Updated weights for policy 0, policy_version 1359965 (0.0008) [2023-12-28 05:02:03,755][106225] Updated weights for policy 1, policy_version 1363329 (0.0006) [2023-12-28 05:02:03,810][106225] Updated weights for policy 1, policy_version 1363339 (0.0005) [2023-12-28 05:02:03,873][106225] Updated weights for policy 1, policy_version 1363349 (0.0007) [2023-12-28 05:02:03,936][106226] Updated weights for policy 0, policy_version 1359975 (0.0008) [2023-12-28 05:02:04,003][106226] Updated weights for policy 0, policy_version 1359985 (0.0008) [2023-12-28 05:02:04,060][106226] Updated weights for policy 0, policy_version 1359995 (0.0008) [2023-12-28 05:02:04,496][106225] Updated weights for policy 1, policy_version 1363359 (0.0007) [2023-12-28 05:02:04,544][106225] Updated weights for policy 1, policy_version 1363369 (0.0007) [2023-12-28 05:02:04,598][106225] Updated weights for policy 1, policy_version 1363379 (0.0007) [2023-12-28 05:02:04,809][106226] Updated weights for policy 0, policy_version 1360005 (0.0008) [2023-12-28 05:02:04,858][106226] Updated weights for policy 0, policy_version 1360015 (0.0008) [2023-12-28 05:02:04,907][106226] Updated weights for policy 0, policy_version 1360025 (0.0008) [2023-12-28 05:02:05,157][106225] Updated weights for policy 1, policy_version 1363389 (0.0005) [2023-12-28 05:02:05,208][106225] Updated weights for policy 1, policy_version 1363399 (0.0005) [2023-12-28 05:02:05,258][106225] Updated weights for policy 1, policy_version 1363409 (0.0006) [2023-12-28 05:02:05,755][106226] Updated weights for policy 0, policy_version 1360035 (0.0008) [2023-12-28 05:02:05,810][106226] Updated weights for policy 0, policy_version 1360045 (0.0005) [2023-12-28 05:02:05,828][106225] Updated weights for policy 1, policy_version 1363419 (0.0006) [2023-12-28 05:02:05,865][106226] Updated weights for policy 0, policy_version 1360055 (0.0005) [2023-12-28 05:02:05,880][106225] Updated weights for policy 1, policy_version 1363429 (0.0008) [2023-12-28 05:02:05,931][106225] Updated weights for policy 1, policy_version 1363439 (0.0006) [2023-12-28 05:02:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 697335808. Throughput: 0: 9638.5, 1: 10085.2. Samples: 697341280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:06,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.527')] [2023-12-28 05:02:06,590][106226] Updated weights for policy 0, policy_version 1360065 (0.0008) [2023-12-28 05:02:06,609][106225] Updated weights for policy 1, policy_version 1363449 (0.0006) [2023-12-28 05:02:06,655][106226] Updated weights for policy 0, policy_version 1360075 (0.0007) [2023-12-28 05:02:06,667][106225] Updated weights for policy 1, policy_version 1363459 (0.0010) [2023-12-28 05:02:06,713][106226] Updated weights for policy 0, policy_version 1360085 (0.0006) [2023-12-28 05:02:06,729][106225] Updated weights for policy 1, policy_version 1363469 (0.0011) [2023-12-28 05:02:06,776][106226] Updated weights for policy 0, policy_version 1360095 (0.0007) [2023-12-28 05:02:06,792][106225] Updated weights for policy 1, policy_version 1363479 (0.0010) [2023-12-28 05:02:07,453][106226] Updated weights for policy 0, policy_version 1360105 (0.0009) [2023-12-28 05:02:07,489][106225] Updated weights for policy 1, policy_version 1363489 (0.0006) [2023-12-28 05:02:07,508][106226] Updated weights for policy 0, policy_version 1360115 (0.0007) [2023-12-28 05:02:07,544][106225] Updated weights for policy 1, policy_version 1363499 (0.0008) [2023-12-28 05:02:07,559][106226] Updated weights for policy 0, policy_version 1360125 (0.0008) [2023-12-28 05:02:07,594][106225] Updated weights for policy 1, policy_version 1363510 (0.0010) [2023-12-28 05:02:08,230][106226] Updated weights for policy 0, policy_version 1360135 (0.0010) [2023-12-28 05:02:08,284][106226] Updated weights for policy 0, policy_version 1360145 (0.0010) [2023-12-28 05:02:08,289][106225] Updated weights for policy 1, policy_version 1363520 (0.0006) [2023-12-28 05:02:08,345][106226] Updated weights for policy 0, policy_version 1360155 (0.0010) [2023-12-28 05:02:08,352][106225] Updated weights for policy 1, policy_version 1363530 (0.0007) [2023-12-28 05:02:08,412][106225] Updated weights for policy 1, policy_version 1363540 (0.0007) [2023-12-28 05:02:09,125][106226] Updated weights for policy 0, policy_version 1360165 (0.0011) [2023-12-28 05:02:09,127][106225] Updated weights for policy 1, policy_version 1363550 (0.0007) [2023-12-28 05:02:09,176][106225] Updated weights for policy 1, policy_version 1363560 (0.0009) [2023-12-28 05:02:09,183][106226] Updated weights for policy 0, policy_version 1360175 (0.0010) [2023-12-28 05:02:09,231][106225] Updated weights for policy 1, policy_version 1363570 (0.0010) [2023-12-28 05:02:09,248][106226] Updated weights for policy 0, policy_version 1360185 (0.0009) [2023-12-28 05:02:09,944][106226] Updated weights for policy 0, policy_version 1360195 (0.0009) [2023-12-28 05:02:09,998][106226] Updated weights for policy 0, policy_version 1360205 (0.0011) [2023-12-28 05:02:10,018][106225] Updated weights for policy 1, policy_version 1363580 (0.0010) [2023-12-28 05:02:10,066][106226] Updated weights for policy 0, policy_version 1360215 (0.0011) [2023-12-28 05:02:10,073][106225] Updated weights for policy 1, policy_version 1363590 (0.0006) [2023-12-28 05:02:10,136][106225] Updated weights for policy 1, policy_version 1363600 (0.0007) [2023-12-28 05:02:10,767][106225] Updated weights for policy 1, policy_version 1363610 (0.0008) [2023-12-28 05:02:10,783][106226] Updated weights for policy 0, policy_version 1360225 (0.0011) [2023-12-28 05:02:10,830][106225] Updated weights for policy 1, policy_version 1363620 (0.0008) [2023-12-28 05:02:10,845][106226] Updated weights for policy 0, policy_version 1360235 (0.0008) [2023-12-28 05:02:10,888][106225] Updated weights for policy 1, policy_version 1363630 (0.0006) [2023-12-28 05:02:10,907][106226] Updated weights for policy 0, policy_version 1360245 (0.0011) [2023-12-28 05:02:10,940][106225] Updated weights for policy 1, policy_version 1363640 (0.0006) [2023-12-28 05:02:10,959][106226] Updated weights for policy 0, policy_version 1360255 (0.0010) [2023-12-28 05:02:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 697434112. Throughput: 0: 9644.9, 1: 10146.8. Samples: 697401260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:11,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-4.690')] [2023-12-28 05:02:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001363640_349143040.pth... [2023-12-28 05:02:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001360256_348291072.pth... [2023-12-28 05:02:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001362456_348839936.pth [2023-12-28 05:02:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001359136_348004352.pth [2023-12-28 05:02:11,737][106226] Updated weights for policy 0, policy_version 1360265 (0.0009) [2023-12-28 05:02:11,742][106225] Updated weights for policy 1, policy_version 1363650 (0.0007) [2023-12-28 05:02:11,803][106226] Updated weights for policy 0, policy_version 1360275 (0.0009) [2023-12-28 05:02:11,809][106225] Updated weights for policy 1, policy_version 1363660 (0.0008) [2023-12-28 05:02:11,871][106225] Updated weights for policy 1, policy_version 1363670 (0.0008) [2023-12-28 05:02:11,872][106226] Updated weights for policy 0, policy_version 1360285 (0.0010) [2023-12-28 05:02:12,579][106226] Updated weights for policy 0, policy_version 1360295 (0.0007) [2023-12-28 05:02:12,584][106225] Updated weights for policy 1, policy_version 1363680 (0.0006) [2023-12-28 05:02:12,647][106226] Updated weights for policy 0, policy_version 1360305 (0.0007) [2023-12-28 05:02:12,652][106225] Updated weights for policy 1, policy_version 1363690 (0.0006) [2023-12-28 05:02:12,705][106225] Updated weights for policy 1, policy_version 1363700 (0.0009) [2023-12-28 05:02:12,714][106226] Updated weights for policy 0, policy_version 1360315 (0.0007) [2023-12-28 05:02:13,380][106225] Updated weights for policy 1, policy_version 1363710 (0.0010) [2023-12-28 05:02:13,390][106226] Updated weights for policy 0, policy_version 1360325 (0.0006) [2023-12-28 05:02:13,429][106225] Updated weights for policy 1, policy_version 1363720 (0.0010) [2023-12-28 05:02:13,448][106226] Updated weights for policy 0, policy_version 1360335 (0.0006) [2023-12-28 05:02:13,483][106225] Updated weights for policy 1, policy_version 1363730 (0.0006) [2023-12-28 05:02:13,498][106226] Updated weights for policy 0, policy_version 1360345 (0.0008) [2023-12-28 05:02:14,055][106225] Updated weights for policy 1, policy_version 1363740 (0.0007) [2023-12-28 05:02:14,105][106225] Updated weights for policy 1, policy_version 1363750 (0.0010) [2023-12-28 05:02:14,155][106225] Updated weights for policy 1, policy_version 1363760 (0.0007) [2023-12-28 05:02:14,317][106226] Updated weights for policy 0, policy_version 1360355 (0.0009) [2023-12-28 05:02:14,369][106226] Updated weights for policy 0, policy_version 1360365 (0.0008) [2023-12-28 05:02:14,421][106226] Updated weights for policy 0, policy_version 1360375 (0.0007) [2023-12-28 05:02:14,807][106225] Updated weights for policy 1, policy_version 1363770 (0.0006) [2023-12-28 05:02:14,872][106225] Updated weights for policy 1, policy_version 1363780 (0.0006) [2023-12-28 05:02:14,937][106225] Updated weights for policy 1, policy_version 1363790 (0.0009) [2023-12-28 05:02:15,003][106225] Updated weights for policy 1, policy_version 1363800 (0.0008) [2023-12-28 05:02:15,121][106226] Updated weights for policy 0, policy_version 1360385 (0.0009) [2023-12-28 05:02:15,183][106226] Updated weights for policy 0, policy_version 1360395 (0.0009) [2023-12-28 05:02:15,242][106226] Updated weights for policy 0, policy_version 1360405 (0.0010) [2023-12-28 05:02:15,305][106226] Updated weights for policy 0, policy_version 1360415 (0.0009) [2023-12-28 05:02:15,679][106225] Updated weights for policy 1, policy_version 1363810 (0.0005) [2023-12-28 05:02:15,736][106225] Updated weights for policy 1, policy_version 1363820 (0.0005) [2023-12-28 05:02:15,792][106225] Updated weights for policy 1, policy_version 1363830 (0.0007) [2023-12-28 05:02:15,953][106226] Updated weights for policy 0, policy_version 1360425 (0.0011) [2023-12-28 05:02:16,017][106226] Updated weights for policy 0, policy_version 1360435 (0.0009) [2023-12-28 05:02:16,073][106226] Updated weights for policy 0, policy_version 1360445 (0.0006) [2023-12-28 05:02:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 697532416. Throughput: 0: 9528.4, 1: 10154.8. Samples: 697518780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:16,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.348')] [2023-12-28 05:02:16,349][106225] Updated weights for policy 1, policy_version 1363840 (0.0005) [2023-12-28 05:02:16,414][106225] Updated weights for policy 1, policy_version 1363850 (0.0005) [2023-12-28 05:02:16,480][106225] Updated weights for policy 1, policy_version 1363860 (0.0005) [2023-12-28 05:02:16,664][106226] Updated weights for policy 0, policy_version 1360455 (0.0006) [2023-12-28 05:02:16,724][106226] Updated weights for policy 0, policy_version 1360465 (0.0005) [2023-12-28 05:02:16,792][106226] Updated weights for policy 0, policy_version 1360475 (0.0009) [2023-12-28 05:02:17,097][106225] Updated weights for policy 1, policy_version 1363870 (0.0008) [2023-12-28 05:02:17,161][106225] Updated weights for policy 1, policy_version 1363880 (0.0010) [2023-12-28 05:02:17,221][106225] Updated weights for policy 1, policy_version 1363890 (0.0010) [2023-12-28 05:02:17,407][106226] Updated weights for policy 0, policy_version 1360485 (0.0008) [2023-12-28 05:02:17,460][106226] Updated weights for policy 0, policy_version 1360495 (0.0009) [2023-12-28 05:02:17,520][106226] Updated weights for policy 0, policy_version 1360505 (0.0008) [2023-12-28 05:02:17,857][106225] Updated weights for policy 1, policy_version 1363900 (0.0009) [2023-12-28 05:02:17,914][106225] Updated weights for policy 1, policy_version 1363910 (0.0008) [2023-12-28 05:02:17,972][106225] Updated weights for policy 1, policy_version 1363920 (0.0007) [2023-12-28 05:02:18,245][106226] Updated weights for policy 0, policy_version 1360515 (0.0007) [2023-12-28 05:02:18,299][106226] Updated weights for policy 0, policy_version 1360525 (0.0005) [2023-12-28 05:02:18,361][106226] Updated weights for policy 0, policy_version 1360535 (0.0007) [2023-12-28 05:02:18,737][106225] Updated weights for policy 1, policy_version 1363930 (0.0008) [2023-12-28 05:02:18,797][106225] Updated weights for policy 1, policy_version 1363940 (0.0010) [2023-12-28 05:02:18,862][106225] Updated weights for policy 1, policy_version 1363950 (0.0010) [2023-12-28 05:02:18,912][106225] Updated weights for policy 1, policy_version 1363960 (0.0010) [2023-12-28 05:02:18,983][106226] Updated weights for policy 0, policy_version 1360545 (0.0006) [2023-12-28 05:02:19,042][106226] Updated weights for policy 0, policy_version 1360555 (0.0008) [2023-12-28 05:02:19,105][106226] Updated weights for policy 0, policy_version 1360565 (0.0007) [2023-12-28 05:02:19,169][106226] Updated weights for policy 0, policy_version 1360575 (0.0007) [2023-12-28 05:02:19,744][106225] Updated weights for policy 1, policy_version 1363970 (0.0008) [2023-12-28 05:02:19,810][106225] Updated weights for policy 1, policy_version 1363980 (0.0008) [2023-12-28 05:02:19,829][106226] Updated weights for policy 0, policy_version 1360585 (0.0010) [2023-12-28 05:02:19,876][106225] Updated weights for policy 1, policy_version 1363990 (0.0009) [2023-12-28 05:02:19,896][106226] Updated weights for policy 0, policy_version 1360595 (0.0007) [2023-12-28 05:02:19,969][106226] Updated weights for policy 0, policy_version 1360605 (0.0009) [2023-12-28 05:02:20,534][106225] Updated weights for policy 1, policy_version 1364000 (0.0009) [2023-12-28 05:02:20,605][106225] Updated weights for policy 1, policy_version 1364010 (0.0008) [2023-12-28 05:02:20,674][106225] Updated weights for policy 1, policy_version 1364020 (0.0008) [2023-12-28 05:02:20,720][106226] Updated weights for policy 0, policy_version 1360615 (0.0009) [2023-12-28 05:02:20,788][106226] Updated weights for policy 0, policy_version 1360625 (0.0008) [2023-12-28 05:02:20,852][106226] Updated weights for policy 0, policy_version 1360635 (0.0008) [2023-12-28 05:02:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 697630720. Throughput: 0: 9560.2, 1: 10172.2. Samples: 697640332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:21,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.453')] [2023-12-28 05:02:21,463][106225] Updated weights for policy 1, policy_version 1364030 (0.0008) [2023-12-28 05:02:21,526][106225] Updated weights for policy 1, policy_version 1364040 (0.0008) [2023-12-28 05:02:21,586][106225] Updated weights for policy 1, policy_version 1364050 (0.0009) [2023-12-28 05:02:21,613][106226] Updated weights for policy 0, policy_version 1360645 (0.0008) [2023-12-28 05:02:21,688][106226] Updated weights for policy 0, policy_version 1360655 (0.0007) [2023-12-28 05:02:21,761][106226] Updated weights for policy 0, policy_version 1360665 (0.0009) [2023-12-28 05:02:22,301][106225] Updated weights for policy 1, policy_version 1364060 (0.0006) [2023-12-28 05:02:22,364][106225] Updated weights for policy 1, policy_version 1364070 (0.0007) [2023-12-28 05:02:22,428][106225] Updated weights for policy 1, policy_version 1364080 (0.0008) [2023-12-28 05:02:22,482][106226] Updated weights for policy 0, policy_version 1360675 (0.0008) [2023-12-28 05:02:22,545][106226] Updated weights for policy 0, policy_version 1360685 (0.0009) [2023-12-28 05:02:22,611][106226] Updated weights for policy 0, policy_version 1360695 (0.0008) [2023-12-28 05:02:23,177][106225] Updated weights for policy 1, policy_version 1364090 (0.0007) [2023-12-28 05:02:23,227][106225] Updated weights for policy 1, policy_version 1364100 (0.0008) [2023-12-28 05:02:23,293][106225] Updated weights for policy 1, policy_version 1364110 (0.0008) [2023-12-28 05:02:23,295][106226] Updated weights for policy 0, policy_version 1360705 (0.0008) [2023-12-28 05:02:23,344][106226] Updated weights for policy 0, policy_version 1360715 (0.0007) [2023-12-28 05:02:23,356][106225] Updated weights for policy 1, policy_version 1364120 (0.0007) [2023-12-28 05:02:23,398][106226] Updated weights for policy 0, policy_version 1360725 (0.0005) [2023-12-28 05:02:23,453][106226] Updated weights for policy 0, policy_version 1360735 (0.0005) [2023-12-28 05:02:23,995][106225] Updated weights for policy 1, policy_version 1364130 (0.0007) [2023-12-28 05:02:24,038][106226] Updated weights for policy 0, policy_version 1360745 (0.0010) [2023-12-28 05:02:24,050][106225] Updated weights for policy 1, policy_version 1364140 (0.0005) [2023-12-28 05:02:24,099][106226] Updated weights for policy 0, policy_version 1360755 (0.0007) [2023-12-28 05:02:24,106][106225] Updated weights for policy 1, policy_version 1364150 (0.0006) [2023-12-28 05:02:24,155][106226] Updated weights for policy 0, policy_version 1360765 (0.0006) [2023-12-28 05:02:24,825][106225] Updated weights for policy 1, policy_version 1364160 (0.0008) [2023-12-28 05:02:24,834][106226] Updated weights for policy 0, policy_version 1360775 (0.0005) [2023-12-28 05:02:24,884][106225] Updated weights for policy 1, policy_version 1364170 (0.0008) [2023-12-28 05:02:24,891][106226] Updated weights for policy 0, policy_version 1360785 (0.0005) [2023-12-28 05:02:24,948][106225] Updated weights for policy 1, policy_version 1364180 (0.0006) [2023-12-28 05:02:24,957][106226] Updated weights for policy 0, policy_version 1360795 (0.0008) [2023-12-28 05:02:25,533][106226] Updated weights for policy 0, policy_version 1360805 (0.0006) [2023-12-28 05:02:25,591][106226] Updated weights for policy 0, policy_version 1360815 (0.0009) [2023-12-28 05:02:25,648][106226] Updated weights for policy 0, policy_version 1360825 (0.0011) [2023-12-28 05:02:25,691][106225] Updated weights for policy 1, policy_version 1364190 (0.0005) [2023-12-28 05:02:25,741][106225] Updated weights for policy 1, policy_version 1364200 (0.0008) [2023-12-28 05:02:25,792][106225] Updated weights for policy 1, policy_version 1364210 (0.0008) [2023-12-28 05:02:26,175][105115] Fps is (10 sec: 19659.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 697729024. Throughput: 0: 9565.2, 1: 10098.7. Samples: 697698520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:26,176][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.737')] [2023-12-28 05:02:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001360832_348438528.pth... [2023-12-28 05:02:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001364216_349290496.pth... [2023-12-28 05:02:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001359712_348151808.pth [2023-12-28 05:02:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001363032_348987392.pth [2023-12-28 05:02:26,274][106226] Updated weights for policy 0, policy_version 1360835 (0.0009) [2023-12-28 05:02:26,323][106226] Updated weights for policy 0, policy_version 1360845 (0.0005) [2023-12-28 05:02:26,389][106226] Updated weights for policy 0, policy_version 1360855 (0.0008) [2023-12-28 05:02:26,576][106225] Updated weights for policy 1, policy_version 1364220 (0.0008) [2023-12-28 05:02:26,621][106225] Updated weights for policy 1, policy_version 1364230 (0.0008) [2023-12-28 05:02:26,681][106225] Updated weights for policy 1, policy_version 1364240 (0.0008) [2023-12-28 05:02:27,086][106226] Updated weights for policy 0, policy_version 1360865 (0.0008) [2023-12-28 05:02:27,145][106226] Updated weights for policy 0, policy_version 1360875 (0.0009) [2023-12-28 05:02:27,199][106226] Updated weights for policy 0, policy_version 1360885 (0.0008) [2023-12-28 05:02:27,257][106226] Updated weights for policy 0, policy_version 1360895 (0.0008) [2023-12-28 05:02:27,424][106225] Updated weights for policy 1, policy_version 1364250 (0.0008) [2023-12-28 05:02:27,469][106225] Updated weights for policy 1, policy_version 1364260 (0.0005) [2023-12-28 05:02:27,526][106225] Updated weights for policy 1, policy_version 1364270 (0.0005) [2023-12-28 05:02:27,579][106225] Updated weights for policy 1, policy_version 1364280 (0.0005) [2023-12-28 05:02:27,912][106226] Updated weights for policy 0, policy_version 1360905 (0.0006) [2023-12-28 05:02:27,978][106226] Updated weights for policy 0, policy_version 1360915 (0.0005) [2023-12-28 05:02:28,036][106226] Updated weights for policy 0, policy_version 1360925 (0.0006) [2023-12-28 05:02:28,202][106225] Updated weights for policy 1, policy_version 1364290 (0.0008) [2023-12-28 05:02:28,260][106225] Updated weights for policy 1, policy_version 1364300 (0.0009) [2023-12-28 05:02:28,311][106225] Updated weights for policy 1, policy_version 1364310 (0.0008) [2023-12-28 05:02:28,602][106226] Updated weights for policy 0, policy_version 1360935 (0.0008) [2023-12-28 05:02:28,662][106226] Updated weights for policy 0, policy_version 1360945 (0.0010) [2023-12-28 05:02:28,723][106226] Updated weights for policy 0, policy_version 1360955 (0.0011) [2023-12-28 05:02:29,127][106225] Updated weights for policy 1, policy_version 1364320 (0.0008) [2023-12-28 05:02:29,182][106225] Updated weights for policy 1, policy_version 1364330 (0.0008) [2023-12-28 05:02:29,253][106225] Updated weights for policy 1, policy_version 1364340 (0.0009) [2023-12-28 05:02:29,399][106226] Updated weights for policy 0, policy_version 1360965 (0.0009) [2023-12-28 05:02:29,457][106226] Updated weights for policy 0, policy_version 1360975 (0.0008) [2023-12-28 05:02:29,508][106226] Updated weights for policy 0, policy_version 1360985 (0.0008) [2023-12-28 05:02:29,920][106225] Updated weights for policy 1, policy_version 1364350 (0.0009) [2023-12-28 05:02:29,976][106225] Updated weights for policy 1, policy_version 1364360 (0.0007) [2023-12-28 05:02:30,031][106225] Updated weights for policy 1, policy_version 1364370 (0.0008) [2023-12-28 05:02:30,259][106226] Updated weights for policy 0, policy_version 1360995 (0.0007) [2023-12-28 05:02:30,316][106226] Updated weights for policy 0, policy_version 1361005 (0.0008) [2023-12-28 05:02:30,378][106226] Updated weights for policy 0, policy_version 1361015 (0.0008) [2023-12-28 05:02:30,729][106225] Updated weights for policy 1, policy_version 1364380 (0.0006) [2023-12-28 05:02:30,775][106225] Updated weights for policy 1, policy_version 1364390 (0.0008) [2023-12-28 05:02:30,823][106225] Updated weights for policy 1, policy_version 1364400 (0.0008) [2023-12-28 05:02:31,055][106226] Updated weights for policy 0, policy_version 1361025 (0.0008) [2023-12-28 05:02:31,120][106226] Updated weights for policy 0, policy_version 1361035 (0.0008) [2023-12-28 05:02:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 697827328. Throughput: 0: 9763.5, 1: 10034.1. Samples: 697820268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:31,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-4.469')] [2023-12-28 05:02:31,187][106226] Updated weights for policy 0, policy_version 1361045 (0.0008) [2023-12-28 05:02:31,248][106226] Updated weights for policy 0, policy_version 1361055 (0.0009) [2023-12-28 05:02:31,574][106225] Updated weights for policy 1, policy_version 1364410 (0.0008) [2023-12-28 05:02:31,630][106225] Updated weights for policy 1, policy_version 1364420 (0.0009) [2023-12-28 05:02:31,695][106225] Updated weights for policy 1, policy_version 1364430 (0.0009) [2023-12-28 05:02:31,759][106225] Updated weights for policy 1, policy_version 1364440 (0.0008) [2023-12-28 05:02:31,942][106226] Updated weights for policy 0, policy_version 1361065 (0.0007) [2023-12-28 05:02:32,010][106226] Updated weights for policy 0, policy_version 1361075 (0.0007) [2023-12-28 05:02:32,079][106226] Updated weights for policy 0, policy_version 1361085 (0.0007) [2023-12-28 05:02:32,469][106225] Updated weights for policy 1, policy_version 1364450 (0.0009) [2023-12-28 05:02:32,528][106225] Updated weights for policy 1, policy_version 1364460 (0.0008) [2023-12-28 05:02:32,592][106225] Updated weights for policy 1, policy_version 1364470 (0.0008) [2023-12-28 05:02:32,717][106226] Updated weights for policy 0, policy_version 1361095 (0.0008) [2023-12-28 05:02:32,771][106226] Updated weights for policy 0, policy_version 1361105 (0.0007) [2023-12-28 05:02:32,829][106226] Updated weights for policy 0, policy_version 1361115 (0.0006) [2023-12-28 05:02:33,234][106225] Updated weights for policy 1, policy_version 1364480 (0.0009) [2023-12-28 05:02:33,291][106225] Updated weights for policy 1, policy_version 1364490 (0.0007) [2023-12-28 05:02:33,341][106225] Updated weights for policy 1, policy_version 1364500 (0.0010) [2023-12-28 05:02:33,533][106226] Updated weights for policy 0, policy_version 1361125 (0.0010) [2023-12-28 05:02:33,579][106226] Updated weights for policy 0, policy_version 1361135 (0.0010) [2023-12-28 05:02:33,625][106226] Updated weights for policy 0, policy_version 1361145 (0.0010) [2023-12-28 05:02:33,982][106225] Updated weights for policy 1, policy_version 1364510 (0.0007) [2023-12-28 05:02:34,030][106225] Updated weights for policy 1, policy_version 1364520 (0.0008) [2023-12-28 05:02:34,085][106225] Updated weights for policy 1, policy_version 1364530 (0.0008) [2023-12-28 05:02:34,217][106226] Updated weights for policy 0, policy_version 1361155 (0.0010) [2023-12-28 05:02:34,280][106226] Updated weights for policy 0, policy_version 1361165 (0.0011) [2023-12-28 05:02:34,344][106226] Updated weights for policy 0, policy_version 1361175 (0.0011) [2023-12-28 05:02:34,780][106225] Updated weights for policy 1, policy_version 1364540 (0.0006) [2023-12-28 05:02:34,843][106225] Updated weights for policy 1, policy_version 1364550 (0.0005) [2023-12-28 05:02:34,899][106225] Updated weights for policy 1, policy_version 1364560 (0.0005) [2023-12-28 05:02:35,039][106226] Updated weights for policy 0, policy_version 1361185 (0.0011) [2023-12-28 05:02:35,092][106226] Updated weights for policy 0, policy_version 1361195 (0.0010) [2023-12-28 05:02:35,152][106226] Updated weights for policy 0, policy_version 1361205 (0.0010) [2023-12-28 05:02:35,210][106226] Updated weights for policy 0, policy_version 1361215 (0.0009) [2023-12-28 05:02:35,405][106225] Updated weights for policy 1, policy_version 1364570 (0.0005) [2023-12-28 05:02:35,450][106225] Updated weights for policy 1, policy_version 1364580 (0.0005) [2023-12-28 05:02:35,501][106225] Updated weights for policy 1, policy_version 1364590 (0.0006) [2023-12-28 05:02:35,567][106225] Updated weights for policy 1, policy_version 1364600 (0.0005) [2023-12-28 05:02:35,909][106226] Updated weights for policy 0, policy_version 1361225 (0.0008) [2023-12-28 05:02:35,963][106226] Updated weights for policy 0, policy_version 1361235 (0.0005) [2023-12-28 05:02:36,022][106226] Updated weights for policy 0, policy_version 1361245 (0.0009) [2023-12-28 05:02:36,174][105115] Fps is (10 sec: 20481.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 697933824. Throughput: 0: 9811.3, 1: 10128.0. Samples: 697944016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:36,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.251')] [2023-12-28 05:02:36,245][106225] Updated weights for policy 1, policy_version 1364610 (0.0009) [2023-12-28 05:02:36,295][106225] Updated weights for policy 1, policy_version 1364620 (0.0008) [2023-12-28 05:02:36,347][106225] Updated weights for policy 1, policy_version 1364630 (0.0008) [2023-12-28 05:02:36,687][106226] Updated weights for policy 0, policy_version 1361255 (0.0008) [2023-12-28 05:02:36,754][106226] Updated weights for policy 0, policy_version 1361265 (0.0010) [2023-12-28 05:02:36,817][106226] Updated weights for policy 0, policy_version 1361275 (0.0010) [2023-12-28 05:02:37,123][106225] Updated weights for policy 1, policy_version 1364640 (0.0008) [2023-12-28 05:02:37,182][106225] Updated weights for policy 1, policy_version 1364650 (0.0008) [2023-12-28 05:02:37,245][106225] Updated weights for policy 1, policy_version 1364660 (0.0009) [2023-12-28 05:02:37,480][106226] Updated weights for policy 0, policy_version 1361285 (0.0007) [2023-12-28 05:02:37,539][106226] Updated weights for policy 0, policy_version 1361295 (0.0005) [2023-12-28 05:02:37,606][106226] Updated weights for policy 0, policy_version 1361305 (0.0005) [2023-12-28 05:02:37,902][106225] Updated weights for policy 1, policy_version 1364670 (0.0008) [2023-12-28 05:02:37,967][106225] Updated weights for policy 1, policy_version 1364680 (0.0009) [2023-12-28 05:02:38,027][106225] Updated weights for policy 1, policy_version 1364690 (0.0008) [2023-12-28 05:02:38,259][106226] Updated weights for policy 0, policy_version 1361315 (0.0007) [2023-12-28 05:02:38,312][106226] Updated weights for policy 0, policy_version 1361325 (0.0009) [2023-12-28 05:02:38,375][106226] Updated weights for policy 0, policy_version 1361335 (0.0008) [2023-12-28 05:02:38,787][106225] Updated weights for policy 1, policy_version 1364700 (0.0007) [2023-12-28 05:02:38,852][106225] Updated weights for policy 1, policy_version 1364710 (0.0007) [2023-12-28 05:02:38,915][106225] Updated weights for policy 1, policy_version 1364720 (0.0009) [2023-12-28 05:02:39,094][106226] Updated weights for policy 0, policy_version 1361345 (0.0008) [2023-12-28 05:02:39,156][106226] Updated weights for policy 0, policy_version 1361355 (0.0009) [2023-12-28 05:02:39,223][106226] Updated weights for policy 0, policy_version 1361365 (0.0009) [2023-12-28 05:02:39,293][106226] Updated weights for policy 0, policy_version 1361375 (0.0008) [2023-12-28 05:02:39,673][106225] Updated weights for policy 1, policy_version 1364730 (0.0008) [2023-12-28 05:02:39,731][106225] Updated weights for policy 1, policy_version 1364740 (0.0008) [2023-12-28 05:02:39,790][106225] Updated weights for policy 1, policy_version 1364750 (0.0008) [2023-12-28 05:02:39,856][106225] Updated weights for policy 1, policy_version 1364760 (0.0008) [2023-12-28 05:02:39,962][106226] Updated weights for policy 0, policy_version 1361385 (0.0008) [2023-12-28 05:02:40,032][106226] Updated weights for policy 0, policy_version 1361395 (0.0006) [2023-12-28 05:02:40,100][106226] Updated weights for policy 0, policy_version 1361405 (0.0007) [2023-12-28 05:02:40,545][106225] Updated weights for policy 1, policy_version 1364770 (0.0005) [2023-12-28 05:02:40,603][106225] Updated weights for policy 1, policy_version 1364780 (0.0005) [2023-12-28 05:02:40,663][106225] Updated weights for policy 1, policy_version 1364790 (0.0006) [2023-12-28 05:02:40,741][106226] Updated weights for policy 0, policy_version 1361415 (0.0009) [2023-12-28 05:02:40,806][106226] Updated weights for policy 0, policy_version 1361425 (0.0009) [2023-12-28 05:02:40,870][106226] Updated weights for policy 0, policy_version 1361435 (0.0010) [2023-12-28 05:02:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 698032128. Throughput: 0: 9844.3, 1: 10120.7. Samples: 698003188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:41,176][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.667')] [2023-12-28 05:02:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001364792_349437952.pth... [2023-12-28 05:02:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001361440_348594176.pth... [2023-12-28 05:02:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001363640_349143040.pth [2023-12-28 05:02:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001360256_348291072.pth [2023-12-28 05:02:41,291][106225] Updated weights for policy 1, policy_version 1364800 (0.0007) [2023-12-28 05:02:41,359][106225] Updated weights for policy 1, policy_version 1364810 (0.0008) [2023-12-28 05:02:41,424][106225] Updated weights for policy 1, policy_version 1364820 (0.0007) [2023-12-28 05:02:41,642][106226] Updated weights for policy 0, policy_version 1361445 (0.0008) [2023-12-28 05:02:41,709][106226] Updated weights for policy 0, policy_version 1361455 (0.0008) [2023-12-28 05:02:41,781][106226] Updated weights for policy 0, policy_version 1361465 (0.0008) [2023-12-28 05:02:42,170][106225] Updated weights for policy 1, policy_version 1364830 (0.0009) [2023-12-28 05:02:42,226][106225] Updated weights for policy 1, policy_version 1364840 (0.0008) [2023-12-28 05:02:42,284][106225] Updated weights for policy 1, policy_version 1364850 (0.0007) [2023-12-28 05:02:42,564][106226] Updated weights for policy 0, policy_version 1361475 (0.0009) [2023-12-28 05:02:42,629][106226] Updated weights for policy 0, policy_version 1361485 (0.0009) [2023-12-28 05:02:42,686][106226] Updated weights for policy 0, policy_version 1361495 (0.0009) [2023-12-28 05:02:43,013][106225] Updated weights for policy 1, policy_version 1364860 (0.0008) [2023-12-28 05:02:43,081][106225] Updated weights for policy 1, policy_version 1364870 (0.0007) [2023-12-28 05:02:43,132][106225] Updated weights for policy 1, policy_version 1364880 (0.0005) [2023-12-28 05:02:43,472][106226] Updated weights for policy 0, policy_version 1361505 (0.0008) [2023-12-28 05:02:43,534][106226] Updated weights for policy 0, policy_version 1361515 (0.0008) [2023-12-28 05:02:43,592][106226] Updated weights for policy 0, policy_version 1361525 (0.0006) [2023-12-28 05:02:43,640][106226] Updated weights for policy 0, policy_version 1361535 (0.0005) [2023-12-28 05:02:43,749][106225] Updated weights for policy 1, policy_version 1364890 (0.0006) [2023-12-28 05:02:43,808][106225] Updated weights for policy 1, policy_version 1364900 (0.0008) [2023-12-28 05:02:43,865][106225] Updated weights for policy 1, policy_version 1364910 (0.0008) [2023-12-28 05:02:43,923][106225] Updated weights for policy 1, policy_version 1364920 (0.0008) [2023-12-28 05:02:44,258][106226] Updated weights for policy 0, policy_version 1361545 (0.0007) [2023-12-28 05:02:44,313][106226] Updated weights for policy 0, policy_version 1361555 (0.0008) [2023-12-28 05:02:44,373][106226] Updated weights for policy 0, policy_version 1361565 (0.0009) [2023-12-28 05:02:44,670][106225] Updated weights for policy 1, policy_version 1364930 (0.0008) [2023-12-28 05:02:44,725][106225] Updated weights for policy 1, policy_version 1364940 (0.0008) [2023-12-28 05:02:44,781][106225] Updated weights for policy 1, policy_version 1364950 (0.0008) [2023-12-28 05:02:45,058][106226] Updated weights for policy 0, policy_version 1361575 (0.0007) [2023-12-28 05:02:45,124][106226] Updated weights for policy 0, policy_version 1361585 (0.0008) [2023-12-28 05:02:45,192][106226] Updated weights for policy 0, policy_version 1361595 (0.0010) [2023-12-28 05:02:45,492][106225] Updated weights for policy 1, policy_version 1364960 (0.0006) [2023-12-28 05:02:45,540][106225] Updated weights for policy 1, policy_version 1364970 (0.0008) [2023-12-28 05:02:45,587][106225] Updated weights for policy 1, policy_version 1364980 (0.0008) [2023-12-28 05:02:45,830][106226] Updated weights for policy 0, policy_version 1361605 (0.0008) [2023-12-28 05:02:45,889][106226] Updated weights for policy 0, policy_version 1361615 (0.0006) [2023-12-28 05:02:45,947][106226] Updated weights for policy 0, policy_version 1361625 (0.0005) [2023-12-28 05:02:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 698130432. Throughput: 0: 9900.6, 1: 10055.4. Samples: 698119368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:46,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.604')] [2023-12-28 05:02:46,371][106225] Updated weights for policy 1, policy_version 1364990 (0.0008) [2023-12-28 05:02:46,436][106225] Updated weights for policy 1, policy_version 1365000 (0.0008) [2023-12-28 05:02:46,499][106225] Updated weights for policy 1, policy_version 1365010 (0.0009) [2023-12-28 05:02:46,504][106226] Updated weights for policy 0, policy_version 1361635 (0.0005) [2023-12-28 05:02:46,570][106226] Updated weights for policy 0, policy_version 1361645 (0.0006) [2023-12-28 05:02:46,636][106226] Updated weights for policy 0, policy_version 1361655 (0.0005) [2023-12-28 05:02:47,190][106226] Updated weights for policy 0, policy_version 1361665 (0.0006) [2023-12-28 05:02:47,247][106226] Updated weights for policy 0, policy_version 1361675 (0.0011) [2023-12-28 05:02:47,290][106225] Updated weights for policy 1, policy_version 1365020 (0.0008) [2023-12-28 05:02:47,301][106226] Updated weights for policy 0, policy_version 1361685 (0.0011) [2023-12-28 05:02:47,342][106225] Updated weights for policy 1, policy_version 1365030 (0.0007) [2023-12-28 05:02:47,348][106226] Updated weights for policy 0, policy_version 1361695 (0.0010) [2023-12-28 05:02:47,402][106225] Updated weights for policy 1, policy_version 1365040 (0.0008) [2023-12-28 05:02:47,991][106226] Updated weights for policy 0, policy_version 1361705 (0.0009) [2023-12-28 05:02:48,050][106226] Updated weights for policy 0, policy_version 1361715 (0.0006) [2023-12-28 05:02:48,104][106226] Updated weights for policy 0, policy_version 1361725 (0.0005) [2023-12-28 05:02:48,199][106225] Updated weights for policy 1, policy_version 1365050 (0.0009) [2023-12-28 05:02:48,265][106225] Updated weights for policy 1, policy_version 1365060 (0.0008) [2023-12-28 05:02:48,331][106225] Updated weights for policy 1, policy_version 1365070 (0.0010) [2023-12-28 05:02:48,397][106225] Updated weights for policy 1, policy_version 1365080 (0.0011) [2023-12-28 05:02:48,770][106226] Updated weights for policy 0, policy_version 1361735 (0.0009) [2023-12-28 05:02:48,831][106226] Updated weights for policy 0, policy_version 1361745 (0.0011) [2023-12-28 05:02:48,882][106226] Updated weights for policy 0, policy_version 1361755 (0.0011) [2023-12-28 05:02:49,136][106225] Updated weights for policy 1, policy_version 1365090 (0.0010) [2023-12-28 05:02:49,194][106225] Updated weights for policy 1, policy_version 1365100 (0.0009) [2023-12-28 05:02:49,257][106225] Updated weights for policy 1, policy_version 1365110 (0.0008) [2023-12-28 05:02:49,633][106226] Updated weights for policy 0, policy_version 1361765 (0.0011) [2023-12-28 05:02:49,703][106226] Updated weights for policy 0, policy_version 1361775 (0.0011) [2023-12-28 05:02:49,766][106226] Updated weights for policy 0, policy_version 1361785 (0.0011) [2023-12-28 05:02:49,951][106225] Updated weights for policy 1, policy_version 1365120 (0.0008) [2023-12-28 05:02:50,014][106225] Updated weights for policy 1, policy_version 1365130 (0.0006) [2023-12-28 05:02:50,077][106225] Updated weights for policy 1, policy_version 1365140 (0.0005) [2023-12-28 05:02:50,441][106226] Updated weights for policy 0, policy_version 1361795 (0.0010) [2023-12-28 05:02:50,496][106226] Updated weights for policy 0, policy_version 1361805 (0.0011) [2023-12-28 05:02:50,546][106226] Updated weights for policy 0, policy_version 1361815 (0.0011) [2023-12-28 05:02:50,780][106225] Updated weights for policy 1, policy_version 1365150 (0.0008) [2023-12-28 05:02:50,846][106225] Updated weights for policy 1, policy_version 1365160 (0.0007) [2023-12-28 05:02:50,909][106225] Updated weights for policy 1, policy_version 1365170 (0.0010) [2023-12-28 05:02:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 698228736. Throughput: 0: 10077.2, 1: 9854.7. Samples: 698238216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:51,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-4.472')] [2023-12-28 05:02:51,324][106226] Updated weights for policy 0, policy_version 1361825 (0.0009) [2023-12-28 05:02:51,392][106226] Updated weights for policy 0, policy_version 1361835 (0.0008) [2023-12-28 05:02:51,462][106226] Updated weights for policy 0, policy_version 1361845 (0.0006) [2023-12-28 05:02:51,527][106226] Updated weights for policy 0, policy_version 1361855 (0.0006) [2023-12-28 05:02:51,641][106225] Updated weights for policy 1, policy_version 1365180 (0.0010) [2023-12-28 05:02:51,704][106225] Updated weights for policy 1, policy_version 1365190 (0.0010) [2023-12-28 05:02:51,771][106225] Updated weights for policy 1, policy_version 1365200 (0.0010) [2023-12-28 05:02:52,259][106226] Updated weights for policy 0, policy_version 1361865 (0.0008) [2023-12-28 05:02:52,319][106226] Updated weights for policy 0, policy_version 1361875 (0.0008) [2023-12-28 05:02:52,387][106226] Updated weights for policy 0, policy_version 1361885 (0.0008) [2023-12-28 05:02:52,534][106225] Updated weights for policy 1, policy_version 1365210 (0.0011) [2023-12-28 05:02:52,595][106225] Updated weights for policy 1, policy_version 1365220 (0.0010) [2023-12-28 05:02:52,649][106225] Updated weights for policy 1, policy_version 1365230 (0.0010) [2023-12-28 05:02:52,710][106225] Updated weights for policy 1, policy_version 1365240 (0.0010) [2023-12-28 05:02:53,168][106226] Updated weights for policy 0, policy_version 1361895 (0.0008) [2023-12-28 05:02:53,225][106226] Updated weights for policy 0, policy_version 1361905 (0.0007) [2023-12-28 05:02:53,291][106226] Updated weights for policy 0, policy_version 1361915 (0.0009) [2023-12-28 05:02:53,342][106225] Updated weights for policy 1, policy_version 1365250 (0.0005) [2023-12-28 05:02:53,408][106225] Updated weights for policy 1, policy_version 1365260 (0.0005) [2023-12-28 05:02:53,466][106225] Updated weights for policy 1, policy_version 1365270 (0.0008) [2023-12-28 05:02:54,025][106226] Updated weights for policy 0, policy_version 1361925 (0.0009) [2023-12-28 05:02:54,077][106226] Updated weights for policy 0, policy_version 1361935 (0.0009) [2023-12-28 05:02:54,097][106225] Updated weights for policy 1, policy_version 1365280 (0.0006) [2023-12-28 05:02:54,123][106226] Updated weights for policy 0, policy_version 1361945 (0.0008) [2023-12-28 05:02:54,153][106225] Updated weights for policy 1, policy_version 1365290 (0.0006) [2023-12-28 05:02:54,207][106225] Updated weights for policy 1, policy_version 1365300 (0.0005) [2023-12-28 05:02:54,841][106225] Updated weights for policy 1, policy_version 1365310 (0.0008) [2023-12-28 05:02:54,893][106225] Updated weights for policy 1, policy_version 1365320 (0.0010) [2023-12-28 05:02:54,919][106226] Updated weights for policy 0, policy_version 1361955 (0.0008) [2023-12-28 05:02:54,950][106225] Updated weights for policy 1, policy_version 1365330 (0.0010) [2023-12-28 05:02:54,974][106226] Updated weights for policy 0, policy_version 1361965 (0.0007) [2023-12-28 05:02:55,032][106226] Updated weights for policy 0, policy_version 1361975 (0.0008) [2023-12-28 05:02:55,666][106225] Updated weights for policy 1, policy_version 1365340 (0.0010) [2023-12-28 05:02:55,723][106225] Updated weights for policy 1, policy_version 1365350 (0.0010) [2023-12-28 05:02:55,772][106226] Updated weights for policy 0, policy_version 1361985 (0.0008) [2023-12-28 05:02:55,782][106225] Updated weights for policy 1, policy_version 1365360 (0.0010) [2023-12-28 05:02:55,826][106226] Updated weights for policy 0, policy_version 1361995 (0.0005) [2023-12-28 05:02:55,876][106226] Updated weights for policy 0, policy_version 1362005 (0.0008) [2023-12-28 05:02:55,931][106226] Updated weights for policy 0, policy_version 1362015 (0.0009) [2023-12-28 05:02:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 698327040. Throughput: 0: 10027.9, 1: 9830.1. Samples: 698294868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:02:56,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.440')] [2023-12-28 05:02:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001362016_348741632.pth... [2023-12-28 05:02:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001365368_349585408.pth... [2023-12-28 05:02:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001360832_348438528.pth [2023-12-28 05:02:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001364216_349290496.pth [2023-12-28 05:02:56,496][106225] Updated weights for policy 1, policy_version 1365370 (0.0010) [2023-12-28 05:02:56,548][106225] Updated weights for policy 1, policy_version 1365380 (0.0010) [2023-12-28 05:02:56,594][106225] Updated weights for policy 1, policy_version 1365390 (0.0010) [2023-12-28 05:02:56,644][106225] Updated weights for policy 1, policy_version 1365400 (0.0010) [2023-12-28 05:02:56,674][106226] Updated weights for policy 0, policy_version 1362025 (0.0007) [2023-12-28 05:02:56,717][106226] Updated weights for policy 0, policy_version 1362035 (0.0007) [2023-12-28 05:02:56,766][106226] Updated weights for policy 0, policy_version 1362045 (0.0007) [2023-12-28 05:02:57,312][106225] Updated weights for policy 1, policy_version 1365410 (0.0011) [2023-12-28 05:02:57,360][106225] Updated weights for policy 1, policy_version 1365420 (0.0010) [2023-12-28 05:02:57,423][106225] Updated weights for policy 1, policy_version 1365430 (0.0010) [2023-12-28 05:02:57,555][106226] Updated weights for policy 0, policy_version 1362055 (0.0006) [2023-12-28 05:02:57,613][106226] Updated weights for policy 0, policy_version 1362065 (0.0008) [2023-12-28 05:02:57,666][106226] Updated weights for policy 0, policy_version 1362075 (0.0008) [2023-12-28 05:02:58,143][106225] Updated weights for policy 1, policy_version 1365440 (0.0010) [2023-12-28 05:02:58,193][106225] Updated weights for policy 1, policy_version 1365450 (0.0010) [2023-12-28 05:02:58,257][106225] Updated weights for policy 1, policy_version 1365460 (0.0009) [2023-12-28 05:02:58,395][106226] Updated weights for policy 0, policy_version 1362085 (0.0008) [2023-12-28 05:02:58,462][106226] Updated weights for policy 0, policy_version 1362095 (0.0007) [2023-12-28 05:02:58,526][106226] Updated weights for policy 0, policy_version 1362105 (0.0007) [2023-12-28 05:02:59,139][106225] Updated weights for policy 1, policy_version 1365470 (0.0010) [2023-12-28 05:02:59,200][106225] Updated weights for policy 1, policy_version 1365480 (0.0009) [2023-12-28 05:02:59,273][106226] Updated weights for policy 0, policy_version 1362115 (0.0007) [2023-12-28 05:02:59,275][106225] Updated weights for policy 1, policy_version 1365490 (0.0009) [2023-12-28 05:02:59,346][106226] Updated weights for policy 0, policy_version 1362125 (0.0009) [2023-12-28 05:02:59,415][106226] Updated weights for policy 0, policy_version 1362135 (0.0008) [2023-12-28 05:03:00,029][106225] Updated weights for policy 1, policy_version 1365500 (0.0007) [2023-12-28 05:03:00,098][106225] Updated weights for policy 1, policy_version 1365510 (0.0007) [2023-12-28 05:03:00,144][106226] Updated weights for policy 0, policy_version 1362145 (0.0009) [2023-12-28 05:03:00,161][106225] Updated weights for policy 1, policy_version 1365520 (0.0006) [2023-12-28 05:03:00,198][106226] Updated weights for policy 0, policy_version 1362155 (0.0007) [2023-12-28 05:03:00,251][106226] Updated weights for policy 0, policy_version 1362165 (0.0006) [2023-12-28 05:03:00,311][106226] Updated weights for policy 0, policy_version 1362175 (0.0006) [2023-12-28 05:03:00,887][106225] Updated weights for policy 1, policy_version 1365530 (0.0006) [2023-12-28 05:03:00,946][106225] Updated weights for policy 1, policy_version 1365540 (0.0009) [2023-12-28 05:03:01,003][106225] Updated weights for policy 1, policy_version 1365550 (0.0007) [2023-12-28 05:03:01,045][106226] Updated weights for policy 0, policy_version 1362185 (0.0009) [2023-12-28 05:03:01,068][106225] Updated weights for policy 1, policy_version 1365560 (0.0007) [2023-12-28 05:03:01,098][106226] Updated weights for policy 0, policy_version 1362195 (0.0009) [2023-12-28 05:03:01,165][106226] Updated weights for policy 0, policy_version 1362205 (0.0008) [2023-12-28 05:03:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 698417152. Throughput: 0: 10008.3, 1: 9789.8. Samples: 698409696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:01,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.434')] [2023-12-28 05:03:01,821][106226] Updated weights for policy 0, policy_version 1362215 (0.0007) [2023-12-28 05:03:01,868][106225] Updated weights for policy 1, policy_version 1365570 (0.0008) [2023-12-28 05:03:01,887][106226] Updated weights for policy 0, policy_version 1362225 (0.0007) [2023-12-28 05:03:01,924][106225] Updated weights for policy 1, policy_version 1365580 (0.0006) [2023-12-28 05:03:01,949][106226] Updated weights for policy 0, policy_version 1362235 (0.0008) [2023-12-28 05:03:01,991][106225] Updated weights for policy 1, policy_version 1365590 (0.0007) [2023-12-28 05:03:02,637][106225] Updated weights for policy 1, policy_version 1365600 (0.0005) [2023-12-28 05:03:02,703][106225] Updated weights for policy 1, policy_version 1365610 (0.0007) [2023-12-28 05:03:02,704][106226] Updated weights for policy 0, policy_version 1362245 (0.0008) [2023-12-28 05:03:02,765][106225] Updated weights for policy 1, policy_version 1365620 (0.0006) [2023-12-28 05:03:02,767][106226] Updated weights for policy 0, policy_version 1362255 (0.0008) [2023-12-28 05:03:02,834][106226] Updated weights for policy 0, policy_version 1362265 (0.0005) [2023-12-28 05:03:03,363][106226] Updated weights for policy 0, policy_version 1362275 (0.0005) [2023-12-28 05:03:03,382][106225] Updated weights for policy 1, policy_version 1365630 (0.0005) [2023-12-28 05:03:03,427][106226] Updated weights for policy 0, policy_version 1362285 (0.0005) [2023-12-28 05:03:03,434][106225] Updated weights for policy 1, policy_version 1365640 (0.0009) [2023-12-28 05:03:03,476][106226] Updated weights for policy 0, policy_version 1362295 (0.0005) [2023-12-28 05:03:03,484][106225] Updated weights for policy 1, policy_version 1365650 (0.0010) [2023-12-28 05:03:04,153][106226] Updated weights for policy 0, policy_version 1362305 (0.0006) [2023-12-28 05:03:04,169][106225] Updated weights for policy 1, policy_version 1365660 (0.0010) [2023-12-28 05:03:04,216][106226] Updated weights for policy 0, policy_version 1362315 (0.0010) [2023-12-28 05:03:04,232][106225] Updated weights for policy 1, policy_version 1365670 (0.0010) [2023-12-28 05:03:04,277][106226] Updated weights for policy 0, policy_version 1362325 (0.0008) [2023-12-28 05:03:04,297][106225] Updated weights for policy 1, policy_version 1365680 (0.0010) [2023-12-28 05:03:04,345][106226] Updated weights for policy 0, policy_version 1362335 (0.0007) [2023-12-28 05:03:04,968][106225] Updated weights for policy 1, policy_version 1365690 (0.0009) [2023-12-28 05:03:05,022][106226] Updated weights for policy 0, policy_version 1362345 (0.0008) [2023-12-28 05:03:05,028][106225] Updated weights for policy 1, policy_version 1365700 (0.0007) [2023-12-28 05:03:05,078][106226] Updated weights for policy 0, policy_version 1362355 (0.0006) [2023-12-28 05:03:05,080][106225] Updated weights for policy 1, policy_version 1365710 (0.0007) [2023-12-28 05:03:05,123][106226] Updated weights for policy 0, policy_version 1362365 (0.0010) [2023-12-28 05:03:05,133][106225] Updated weights for policy 1, policy_version 1365720 (0.0006) [2023-12-28 05:03:05,688][106226] Updated weights for policy 0, policy_version 1362375 (0.0008) [2023-12-28 05:03:05,742][106226] Updated weights for policy 0, policy_version 1362385 (0.0006) [2023-12-28 05:03:05,793][106226] Updated weights for policy 0, policy_version 1362395 (0.0005) [2023-12-28 05:03:05,950][106225] Updated weights for policy 1, policy_version 1365730 (0.0008) [2023-12-28 05:03:06,035][106225] Updated weights for policy 1, policy_version 1365740 (0.0005) [2023-12-28 05:03:06,100][106225] Updated weights for policy 1, policy_version 1365750 (0.0007) [2023-12-28 05:03:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 698523648. Throughput: 0: 10033.4, 1: 9754.2. Samples: 698530776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:06,175][105115] Avg episode reward: [(0, '-4.792'), (1, '-4.648')] [2023-12-28 05:03:06,447][106226] Updated weights for policy 0, policy_version 1362405 (0.0007) [2023-12-28 05:03:06,514][106226] Updated weights for policy 0, policy_version 1362415 (0.0011) [2023-12-28 05:03:06,585][106226] Updated weights for policy 0, policy_version 1362425 (0.0011) [2023-12-28 05:03:06,775][106225] Updated weights for policy 1, policy_version 1365760 (0.0006) [2023-12-28 05:03:06,841][106225] Updated weights for policy 1, policy_version 1365770 (0.0008) [2023-12-28 05:03:06,903][106225] Updated weights for policy 1, policy_version 1365780 (0.0007) [2023-12-28 05:03:07,221][106226] Updated weights for policy 0, policy_version 1362435 (0.0009) [2023-12-28 05:03:07,283][106226] Updated weights for policy 0, policy_version 1362445 (0.0005) [2023-12-28 05:03:07,338][106226] Updated weights for policy 0, policy_version 1362455 (0.0006) [2023-12-28 05:03:07,501][106225] Updated weights for policy 1, policy_version 1365790 (0.0008) [2023-12-28 05:03:07,555][106225] Updated weights for policy 1, policy_version 1365800 (0.0007) [2023-12-28 05:03:07,615][106225] Updated weights for policy 1, policy_version 1365810 (0.0006) [2023-12-28 05:03:07,979][106226] Updated weights for policy 0, policy_version 1362465 (0.0007) [2023-12-28 05:03:08,041][106226] Updated weights for policy 0, policy_version 1362475 (0.0010) [2023-12-28 05:03:08,113][106226] Updated weights for policy 0, policy_version 1362485 (0.0011) [2023-12-28 05:03:08,173][106226] Updated weights for policy 0, policy_version 1362495 (0.0010) [2023-12-28 05:03:08,263][106225] Updated weights for policy 1, policy_version 1365820 (0.0007) [2023-12-28 05:03:08,311][106225] Updated weights for policy 1, policy_version 1365830 (0.0009) [2023-12-28 05:03:08,377][106225] Updated weights for policy 1, policy_version 1365840 (0.0008) [2023-12-28 05:03:08,846][106226] Updated weights for policy 0, policy_version 1362505 (0.0011) [2023-12-28 05:03:08,908][106226] Updated weights for policy 0, policy_version 1362515 (0.0011) [2023-12-28 05:03:08,959][106226] Updated weights for policy 0, policy_version 1362525 (0.0010) [2023-12-28 05:03:09,125][106225] Updated weights for policy 1, policy_version 1365850 (0.0009) [2023-12-28 05:03:09,177][106225] Updated weights for policy 1, policy_version 1365860 (0.0010) [2023-12-28 05:03:09,236][106225] Updated weights for policy 1, policy_version 1365870 (0.0010) [2023-12-28 05:03:09,296][106225] Updated weights for policy 1, policy_version 1365880 (0.0009) [2023-12-28 05:03:09,666][106226] Updated weights for policy 0, policy_version 1362535 (0.0009) [2023-12-28 05:03:09,724][106226] Updated weights for policy 0, policy_version 1362545 (0.0009) [2023-12-28 05:03:09,783][106226] Updated weights for policy 0, policy_version 1362555 (0.0009) [2023-12-28 05:03:10,082][106225] Updated weights for policy 1, policy_version 1365890 (0.0008) [2023-12-28 05:03:10,142][106225] Updated weights for policy 1, policy_version 1365900 (0.0009) [2023-12-28 05:03:10,204][106225] Updated weights for policy 1, policy_version 1365910 (0.0009) [2023-12-28 05:03:10,621][106226] Updated weights for policy 0, policy_version 1362565 (0.0008) [2023-12-28 05:03:10,684][106226] Updated weights for policy 0, policy_version 1362575 (0.0010) [2023-12-28 05:03:10,750][106226] Updated weights for policy 0, policy_version 1362585 (0.0010) [2023-12-28 05:03:10,832][106225] Updated weights for policy 1, policy_version 1365920 (0.0008) [2023-12-28 05:03:10,888][106225] Updated weights for policy 1, policy_version 1365930 (0.0005) [2023-12-28 05:03:10,945][106225] Updated weights for policy 1, policy_version 1365940 (0.0007) [2023-12-28 05:03:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 698621952. Throughput: 0: 10034.1, 1: 9807.4. Samples: 698591376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:11,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.445')] [2023-12-28 05:03:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001362592_348889088.pth... [2023-12-28 05:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001365944_349732864.pth... [2023-12-28 05:03:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001364792_349437952.pth [2023-12-28 05:03:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001361440_348594176.pth [2023-12-28 05:03:11,600][106226] Updated weights for policy 0, policy_version 1362595 (0.0008) [2023-12-28 05:03:11,626][106225] Updated weights for policy 1, policy_version 1365950 (0.0007) [2023-12-28 05:03:11,671][106226] Updated weights for policy 0, policy_version 1362605 (0.0010) [2023-12-28 05:03:11,691][106225] Updated weights for policy 1, policy_version 1365960 (0.0007) [2023-12-28 05:03:11,739][106226] Updated weights for policy 0, policy_version 1362615 (0.0007) [2023-12-28 05:03:11,757][106225] Updated weights for policy 1, policy_version 1365970 (0.0008) [2023-12-28 05:03:12,475][106225] Updated weights for policy 1, policy_version 1365980 (0.0007) [2023-12-28 05:03:12,535][106225] Updated weights for policy 1, policy_version 1365990 (0.0006) [2023-12-28 05:03:12,547][106226] Updated weights for policy 0, policy_version 1362625 (0.0009) [2023-12-28 05:03:12,584][106225] Updated weights for policy 1, policy_version 1366000 (0.0007) [2023-12-28 05:03:12,605][106226] Updated weights for policy 0, policy_version 1362635 (0.0006) [2023-12-28 05:03:12,663][106226] Updated weights for policy 0, policy_version 1362645 (0.0007) [2023-12-28 05:03:12,719][106226] Updated weights for policy 0, policy_version 1362655 (0.0006) [2023-12-28 05:03:13,340][106225] Updated weights for policy 1, policy_version 1366010 (0.0008) [2023-12-28 05:03:13,371][106226] Updated weights for policy 0, policy_version 1362665 (0.0010) [2023-12-28 05:03:13,396][106225] Updated weights for policy 1, policy_version 1366020 (0.0005) [2023-12-28 05:03:13,428][106226] Updated weights for policy 0, policy_version 1362675 (0.0011) [2023-12-28 05:03:13,444][106225] Updated weights for policy 1, policy_version 1366030 (0.0009) [2023-12-28 05:03:13,471][106226] Updated weights for policy 0, policy_version 1362685 (0.0007) [2023-12-28 05:03:13,488][106225] Updated weights for policy 1, policy_version 1366040 (0.0006) [2023-12-28 05:03:14,133][106226] Updated weights for policy 0, policy_version 1362695 (0.0009) [2023-12-28 05:03:14,190][106226] Updated weights for policy 0, policy_version 1362705 (0.0011) [2023-12-28 05:03:14,244][106226] Updated weights for policy 0, policy_version 1362715 (0.0011) [2023-12-28 05:03:14,258][106225] Updated weights for policy 1, policy_version 1366050 (0.0006) [2023-12-28 05:03:14,318][106225] Updated weights for policy 1, policy_version 1366060 (0.0007) [2023-12-28 05:03:14,368][106225] Updated weights for policy 1, policy_version 1366070 (0.0008) [2023-12-28 05:03:14,976][106226] Updated weights for policy 0, policy_version 1362725 (0.0011) [2023-12-28 05:03:15,038][106226] Updated weights for policy 0, policy_version 1362735 (0.0011) [2023-12-28 05:03:15,086][106225] Updated weights for policy 1, policy_version 1366080 (0.0010) [2023-12-28 05:03:15,099][106226] Updated weights for policy 0, policy_version 1362745 (0.0011) [2023-12-28 05:03:15,147][106225] Updated weights for policy 1, policy_version 1366090 (0.0011) [2023-12-28 05:03:15,199][106225] Updated weights for policy 1, policy_version 1366100 (0.0010) [2023-12-28 05:03:15,747][106226] Updated weights for policy 0, policy_version 1362755 (0.0011) [2023-12-28 05:03:15,812][106226] Updated weights for policy 0, policy_version 1362765 (0.0006) [2023-12-28 05:03:15,866][106226] Updated weights for policy 0, policy_version 1362775 (0.0005) [2023-12-28 05:03:15,893][106225] Updated weights for policy 1, policy_version 1366110 (0.0010) [2023-12-28 05:03:15,956][106225] Updated weights for policy 1, policy_version 1366120 (0.0010) [2023-12-28 05:03:16,013][106225] Updated weights for policy 1, policy_version 1366130 (0.0010) [2023-12-28 05:03:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 698720256. Throughput: 0: 9895.6, 1: 9799.9. Samples: 698706564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:16,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-4.739')] [2023-12-28 05:03:16,395][106226] Updated weights for policy 0, policy_version 1362785 (0.0006) [2023-12-28 05:03:16,458][106226] Updated weights for policy 0, policy_version 1362795 (0.0006) [2023-12-28 05:03:16,512][106226] Updated weights for policy 0, policy_version 1362805 (0.0005) [2023-12-28 05:03:16,573][106226] Updated weights for policy 0, policy_version 1362815 (0.0005) [2023-12-28 05:03:16,710][106225] Updated weights for policy 1, policy_version 1366140 (0.0008) [2023-12-28 05:03:16,774][106225] Updated weights for policy 1, policy_version 1366150 (0.0005) [2023-12-28 05:03:16,826][106225] Updated weights for policy 1, policy_version 1366160 (0.0005) [2023-12-28 05:03:17,180][106226] Updated weights for policy 0, policy_version 1362825 (0.0010) [2023-12-28 05:03:17,230][106226] Updated weights for policy 0, policy_version 1362835 (0.0010) [2023-12-28 05:03:17,276][106226] Updated weights for policy 0, policy_version 1362845 (0.0010) [2023-12-28 05:03:17,445][106225] Updated weights for policy 1, policy_version 1366170 (0.0005) [2023-12-28 05:03:17,509][106225] Updated weights for policy 1, policy_version 1366180 (0.0008) [2023-12-28 05:03:17,571][106225] Updated weights for policy 1, policy_version 1366190 (0.0008) [2023-12-28 05:03:17,636][106225] Updated weights for policy 1, policy_version 1366200 (0.0008) [2023-12-28 05:03:18,000][106226] Updated weights for policy 0, policy_version 1362855 (0.0010) [2023-12-28 05:03:18,060][106226] Updated weights for policy 0, policy_version 1362865 (0.0005) [2023-12-28 05:03:18,111][106226] Updated weights for policy 0, policy_version 1362875 (0.0005) [2023-12-28 05:03:18,260][106225] Updated weights for policy 1, policy_version 1366210 (0.0009) [2023-12-28 05:03:18,328][106225] Updated weights for policy 1, policy_version 1366220 (0.0007) [2023-12-28 05:03:18,390][106225] Updated weights for policy 1, policy_version 1366230 (0.0008) [2023-12-28 05:03:18,773][106226] Updated weights for policy 0, policy_version 1362885 (0.0008) [2023-12-28 05:03:18,830][106226] Updated weights for policy 0, policy_version 1362895 (0.0009) [2023-12-28 05:03:18,893][106226] Updated weights for policy 0, policy_version 1362905 (0.0008) [2023-12-28 05:03:19,120][106225] Updated weights for policy 1, policy_version 1366240 (0.0009) [2023-12-28 05:03:19,183][106225] Updated weights for policy 1, policy_version 1366250 (0.0010) [2023-12-28 05:03:19,266][106225] Updated weights for policy 1, policy_version 1366261 (0.0010) [2023-12-28 05:03:19,742][106226] Updated weights for policy 0, policy_version 1362915 (0.0009) [2023-12-28 05:03:19,802][106226] Updated weights for policy 0, policy_version 1362925 (0.0010) [2023-12-28 05:03:19,873][106226] Updated weights for policy 0, policy_version 1362935 (0.0008) [2023-12-28 05:03:19,977][106225] Updated weights for policy 1, policy_version 1366271 (0.0008) [2023-12-28 05:03:20,039][106225] Updated weights for policy 1, policy_version 1366281 (0.0007) [2023-12-28 05:03:20,104][106225] Updated weights for policy 1, policy_version 1366291 (0.0009) [2023-12-28 05:03:20,664][106226] Updated weights for policy 0, policy_version 1362945 (0.0008) [2023-12-28 05:03:20,734][106226] Updated weights for policy 0, policy_version 1362955 (0.0007) [2023-12-28 05:03:20,802][106225] Updated weights for policy 1, policy_version 1366301 (0.0008) [2023-12-28 05:03:20,804][106226] Updated weights for policy 0, policy_version 1362965 (0.0006) [2023-12-28 05:03:20,864][106225] Updated weights for policy 1, policy_version 1366311 (0.0007) [2023-12-28 05:03:20,877][106226] Updated weights for policy 0, policy_version 1362975 (0.0006) [2023-12-28 05:03:20,919][106225] Updated weights for policy 1, policy_version 1366321 (0.0006) [2023-12-28 05:03:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 698818560. Throughput: 0: 9865.6, 1: 9752.0. Samples: 698826808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:21,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.582')] [2023-12-28 05:03:21,621][106225] Updated weights for policy 1, policy_version 1366331 (0.0006) [2023-12-28 05:03:21,640][106226] Updated weights for policy 0, policy_version 1362985 (0.0008) [2023-12-28 05:03:21,695][106225] Updated weights for policy 1, policy_version 1366341 (0.0008) [2023-12-28 05:03:21,707][106226] Updated weights for policy 0, policy_version 1362995 (0.0006) [2023-12-28 05:03:21,774][106225] Updated weights for policy 1, policy_version 1366351 (0.0009) [2023-12-28 05:03:21,783][106226] Updated weights for policy 0, policy_version 1363005 (0.0008) [2023-12-28 05:03:22,431][106226] Updated weights for policy 0, policy_version 1363015 (0.0009) [2023-12-28 05:03:22,492][106226] Updated weights for policy 0, policy_version 1363025 (0.0009) [2023-12-28 05:03:22,552][106226] Updated weights for policy 0, policy_version 1363035 (0.0009) [2023-12-28 05:03:22,573][106225] Updated weights for policy 1, policy_version 1366361 (0.0007) [2023-12-28 05:03:22,632][106225] Updated weights for policy 1, policy_version 1366371 (0.0008) [2023-12-28 05:03:22,697][106225] Updated weights for policy 1, policy_version 1366381 (0.0008) [2023-12-28 05:03:22,751][106225] Updated weights for policy 1, policy_version 1366391 (0.0009) [2023-12-28 05:03:23,271][106226] Updated weights for policy 0, policy_version 1363045 (0.0009) [2023-12-28 05:03:23,338][106226] Updated weights for policy 0, policy_version 1363055 (0.0008) [2023-12-28 05:03:23,408][106226] Updated weights for policy 0, policy_version 1363065 (0.0010) [2023-12-28 05:03:23,478][106225] Updated weights for policy 1, policy_version 1366401 (0.0006) [2023-12-28 05:03:23,535][106225] Updated weights for policy 1, policy_version 1366411 (0.0007) [2023-12-28 05:03:23,589][106225] Updated weights for policy 1, policy_version 1366421 (0.0008) [2023-12-28 05:03:24,140][106226] Updated weights for policy 0, policy_version 1363075 (0.0009) [2023-12-28 05:03:24,206][106226] Updated weights for policy 0, policy_version 1363085 (0.0010) [2023-12-28 05:03:24,275][106226] Updated weights for policy 0, policy_version 1363095 (0.0009) [2023-12-28 05:03:24,277][106225] Updated weights for policy 1, policy_version 1366431 (0.0006) [2023-12-28 05:03:24,335][106225] Updated weights for policy 1, policy_version 1366441 (0.0006) [2023-12-28 05:03:24,397][106225] Updated weights for policy 1, policy_version 1366451 (0.0008) [2023-12-28 05:03:24,988][106226] Updated weights for policy 0, policy_version 1363105 (0.0007) [2023-12-28 05:03:25,049][106226] Updated weights for policy 0, policy_version 1363115 (0.0008) [2023-12-28 05:03:25,076][106225] Updated weights for policy 1, policy_version 1366461 (0.0007) [2023-12-28 05:03:25,106][106226] Updated weights for policy 0, policy_version 1363125 (0.0006) [2023-12-28 05:03:25,128][106225] Updated weights for policy 1, policy_version 1366471 (0.0007) [2023-12-28 05:03:25,158][106226] Updated weights for policy 0, policy_version 1363135 (0.0006) [2023-12-28 05:03:25,184][106225] Updated weights for policy 1, policy_version 1366481 (0.0008) [2023-12-28 05:03:25,772][106226] Updated weights for policy 0, policy_version 1363145 (0.0005) [2023-12-28 05:03:25,827][106226] Updated weights for policy 0, policy_version 1363155 (0.0006) [2023-12-28 05:03:25,885][106226] Updated weights for policy 0, policy_version 1363165 (0.0005) [2023-12-28 05:03:25,952][106225] Updated weights for policy 1, policy_version 1366491 (0.0009) [2023-12-28 05:03:25,999][106225] Updated weights for policy 1, policy_version 1366501 (0.0010) [2023-12-28 05:03:26,055][106225] Updated weights for policy 1, policy_version 1366511 (0.0010) [2023-12-28 05:03:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.5, 300 sec: 19827.4). Total num frames: 698916864. Throughput: 0: 9809.6, 1: 9741.8. Samples: 698882996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:26,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.691')] [2023-12-28 05:03:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001366520_349880320.pth... [2023-12-28 05:03:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001363168_349036544.pth... [2023-12-28 05:03:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001365368_349585408.pth [2023-12-28 05:03:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001362016_348741632.pth [2023-12-28 05:03:26,483][106226] Updated weights for policy 0, policy_version 1363175 (0.0005) [2023-12-28 05:03:26,534][106226] Updated weights for policy 0, policy_version 1363185 (0.0005) [2023-12-28 05:03:26,581][106226] Updated weights for policy 0, policy_version 1363195 (0.0005) [2023-12-28 05:03:26,763][106225] Updated weights for policy 1, policy_version 1366521 (0.0010) [2023-12-28 05:03:26,828][106225] Updated weights for policy 1, policy_version 1366531 (0.0010) [2023-12-28 05:03:26,878][106225] Updated weights for policy 1, policy_version 1366541 (0.0010) [2023-12-28 05:03:26,934][106225] Updated weights for policy 1, policy_version 1366551 (0.0010) [2023-12-28 05:03:27,167][106226] Updated weights for policy 0, policy_version 1363205 (0.0008) [2023-12-28 05:03:27,224][106226] Updated weights for policy 0, policy_version 1363215 (0.0010) [2023-12-28 05:03:27,286][106226] Updated weights for policy 0, policy_version 1363225 (0.0009) [2023-12-28 05:03:27,573][106225] Updated weights for policy 1, policy_version 1366561 (0.0009) [2023-12-28 05:03:27,633][106225] Updated weights for policy 1, policy_version 1366571 (0.0010) [2023-12-28 05:03:27,688][106225] Updated weights for policy 1, policy_version 1366581 (0.0010) [2023-12-28 05:03:27,933][106226] Updated weights for policy 0, policy_version 1363235 (0.0008) [2023-12-28 05:03:27,989][106226] Updated weights for policy 0, policy_version 1363245 (0.0006) [2023-12-28 05:03:28,053][106226] Updated weights for policy 0, policy_version 1363255 (0.0011) [2023-12-28 05:03:28,284][106225] Updated weights for policy 1, policy_version 1366591 (0.0007) [2023-12-28 05:03:28,344][106225] Updated weights for policy 1, policy_version 1366601 (0.0007) [2023-12-28 05:03:28,408][106225] Updated weights for policy 1, policy_version 1366611 (0.0008) [2023-12-28 05:03:28,742][106226] Updated weights for policy 0, policy_version 1363265 (0.0008) [2023-12-28 05:03:28,791][106226] Updated weights for policy 0, policy_version 1363275 (0.0010) [2023-12-28 05:03:28,858][106226] Updated weights for policy 0, policy_version 1363285 (0.0010) [2023-12-28 05:03:28,917][106226] Updated weights for policy 0, policy_version 1363295 (0.0010) [2023-12-28 05:03:29,069][106225] Updated weights for policy 1, policy_version 1366621 (0.0007) [2023-12-28 05:03:29,118][106225] Updated weights for policy 1, policy_version 1366631 (0.0005) [2023-12-28 05:03:29,169][106225] Updated weights for policy 1, policy_version 1366641 (0.0005) [2023-12-28 05:03:29,530][106226] Updated weights for policy 0, policy_version 1363305 (0.0011) [2023-12-28 05:03:29,591][106226] Updated weights for policy 0, policy_version 1363315 (0.0010) [2023-12-28 05:03:29,653][106226] Updated weights for policy 0, policy_version 1363325 (0.0010) [2023-12-28 05:03:29,803][106225] Updated weights for policy 1, policy_version 1366651 (0.0007) [2023-12-28 05:03:29,864][106225] Updated weights for policy 1, policy_version 1366661 (0.0010) [2023-12-28 05:03:29,922][106225] Updated weights for policy 1, policy_version 1366671 (0.0011) [2023-12-28 05:03:30,395][106226] Updated weights for policy 0, policy_version 1363335 (0.0010) [2023-12-28 05:03:30,455][106226] Updated weights for policy 0, policy_version 1363345 (0.0008) [2023-12-28 05:03:30,516][106226] Updated weights for policy 0, policy_version 1363355 (0.0008) [2023-12-28 05:03:30,634][106225] Updated weights for policy 1, policy_version 1366681 (0.0010) [2023-12-28 05:03:30,692][106225] Updated weights for policy 1, policy_version 1366691 (0.0005) [2023-12-28 05:03:30,746][106225] Updated weights for policy 1, policy_version 1366701 (0.0010) [2023-12-28 05:03:30,811][106225] Updated weights for policy 1, policy_version 1366711 (0.0010) [2023-12-28 05:03:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 699015168. Throughput: 0: 9927.3, 1: 9820.2. Samples: 699008004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:03:31,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.724')] [2023-12-28 05:03:31,179][106226] Updated weights for policy 0, policy_version 1363365 (0.0009) [2023-12-28 05:03:31,241][106226] Updated weights for policy 0, policy_version 1363375 (0.0009) [2023-12-28 05:03:31,302][106226] Updated weights for policy 0, policy_version 1363385 (0.0011) [2023-12-28 05:03:31,500][106225] Updated weights for policy 1, policy_version 1366721 (0.0009) [2023-12-28 05:03:31,560][106225] Updated weights for policy 1, policy_version 1366731 (0.0007) [2023-12-28 05:03:31,619][106225] Updated weights for policy 1, policy_version 1366741 (0.0009) [2023-12-28 05:03:31,977][106226] Updated weights for policy 0, policy_version 1363395 (0.0010) [2023-12-28 05:03:32,040][106226] Updated weights for policy 0, policy_version 1363405 (0.0007) [2023-12-28 05:03:32,102][106226] Updated weights for policy 0, policy_version 1363415 (0.0009) [2023-12-28 05:03:32,340][106225] Updated weights for policy 1, policy_version 1366751 (0.0007) [2023-12-28 05:03:32,406][106225] Updated weights for policy 1, policy_version 1366761 (0.0008) [2023-12-28 05:03:32,469][106225] Updated weights for policy 1, policy_version 1366771 (0.0005) [2023-12-28 05:03:32,836][106226] Updated weights for policy 0, policy_version 1363425 (0.0008) [2023-12-28 05:03:32,903][106226] Updated weights for policy 0, policy_version 1363435 (0.0007) [2023-12-28 05:03:32,965][106226] Updated weights for policy 0, policy_version 1363445 (0.0006) [2023-12-28 05:03:33,020][106226] Updated weights for policy 0, policy_version 1363455 (0.0008) [2023-12-28 05:03:33,109][106225] Updated weights for policy 1, policy_version 1366781 (0.0007) [2023-12-28 05:03:33,166][106225] Updated weights for policy 1, policy_version 1366791 (0.0009) [2023-12-28 05:03:33,210][106225] Updated weights for policy 1, policy_version 1366801 (0.0007) [2023-12-28 05:03:33,629][106226] Updated weights for policy 0, policy_version 1363465 (0.0009) [2023-12-28 05:03:33,691][106226] Updated weights for policy 0, policy_version 1363475 (0.0006) [2023-12-28 05:03:33,754][106226] Updated weights for policy 0, policy_version 1363485 (0.0008) [2023-12-28 05:03:33,986][106225] Updated weights for policy 1, policy_version 1366811 (0.0008) [2023-12-28 05:03:34,053][106225] Updated weights for policy 1, policy_version 1366821 (0.0005) [2023-12-28 05:03:34,119][106225] Updated weights for policy 1, policy_version 1366831 (0.0006) [2023-12-28 05:03:34,405][106226] Updated weights for policy 0, policy_version 1363495 (0.0008) [2023-12-28 05:03:34,461][106226] Updated weights for policy 0, policy_version 1363505 (0.0009) [2023-12-28 05:03:34,519][106226] Updated weights for policy 0, policy_version 1363515 (0.0009) [2023-12-28 05:03:34,782][106225] Updated weights for policy 1, policy_version 1366841 (0.0008) [2023-12-28 05:03:34,844][106225] Updated weights for policy 1, policy_version 1366851 (0.0008) [2023-12-28 05:03:34,897][106225] Updated weights for policy 1, policy_version 1366861 (0.0008) [2023-12-28 05:03:34,952][106225] Updated weights for policy 1, policy_version 1366871 (0.0009) [2023-12-28 05:03:35,246][106226] Updated weights for policy 0, policy_version 1363525 (0.0008) [2023-12-28 05:03:35,299][106226] Updated weights for policy 0, policy_version 1363535 (0.0008) [2023-12-28 05:03:35,352][106226] Updated weights for policy 0, policy_version 1363545 (0.0008) [2023-12-28 05:03:35,701][106225] Updated weights for policy 1, policy_version 1366881 (0.0009) [2023-12-28 05:03:35,759][106225] Updated weights for policy 1, policy_version 1366891 (0.0008) [2023-12-28 05:03:35,808][106225] Updated weights for policy 1, policy_version 1366901 (0.0009) [2023-12-28 05:03:35,960][106226] Updated weights for policy 0, policy_version 1363555 (0.0007) [2023-12-28 05:03:36,010][106226] Updated weights for policy 0, policy_version 1363565 (0.0005) [2023-12-28 05:03:36,067][106226] Updated weights for policy 0, policy_version 1363575 (0.0005) [2023-12-28 05:03:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 699121664. Throughput: 0: 9906.3, 1: 9872.7. Samples: 699128272. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:03:36,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.589')] [2023-12-28 05:03:36,583][106225] Updated weights for policy 1, policy_version 1366911 (0.0008) [2023-12-28 05:03:36,651][106225] Updated weights for policy 1, policy_version 1366921 (0.0006) [2023-12-28 05:03:36,714][106225] Updated weights for policy 1, policy_version 1366931 (0.0008) [2023-12-28 05:03:36,782][106226] Updated weights for policy 0, policy_version 1363585 (0.0007) [2023-12-28 05:03:36,836][106226] Updated weights for policy 0, policy_version 1363595 (0.0009) [2023-12-28 05:03:36,888][106226] Updated weights for policy 0, policy_version 1363605 (0.0009) [2023-12-28 05:03:36,938][106226] Updated weights for policy 0, policy_version 1363615 (0.0006) [2023-12-28 05:03:37,403][106225] Updated weights for policy 1, policy_version 1366941 (0.0008) [2023-12-28 05:03:37,449][106225] Updated weights for policy 1, policy_version 1366951 (0.0008) [2023-12-28 05:03:37,503][106225] Updated weights for policy 1, policy_version 1366961 (0.0007) [2023-12-28 05:03:37,649][106226] Updated weights for policy 0, policy_version 1363625 (0.0006) [2023-12-28 05:03:37,708][106226] Updated weights for policy 0, policy_version 1363635 (0.0006) [2023-12-28 05:03:37,761][106226] Updated weights for policy 0, policy_version 1363645 (0.0005) [2023-12-28 05:03:38,307][106225] Updated weights for policy 1, policy_version 1366971 (0.0008) [2023-12-28 05:03:38,373][106226] Updated weights for policy 0, policy_version 1363655 (0.0008) [2023-12-28 05:03:38,375][106225] Updated weights for policy 1, policy_version 1366981 (0.0007) [2023-12-28 05:03:38,431][106226] Updated weights for policy 0, policy_version 1363665 (0.0007) [2023-12-28 05:03:38,434][106225] Updated weights for policy 1, policy_version 1366991 (0.0006) [2023-12-28 05:03:38,502][106226] Updated weights for policy 0, policy_version 1363675 (0.0009) [2023-12-28 05:03:39,106][106226] Updated weights for policy 0, policy_version 1363685 (0.0006) [2023-12-28 05:03:39,168][106226] Updated weights for policy 0, policy_version 1363695 (0.0007) [2023-12-28 05:03:39,199][106225] Updated weights for policy 1, policy_version 1367001 (0.0006) [2023-12-28 05:03:39,235][106226] Updated weights for policy 0, policy_version 1363705 (0.0008) [2023-12-28 05:03:39,267][106225] Updated weights for policy 1, policy_version 1367011 (0.0008) [2023-12-28 05:03:39,330][106225] Updated weights for policy 1, policy_version 1367021 (0.0008) [2023-12-28 05:03:39,400][106225] Updated weights for policy 1, policy_version 1367031 (0.0008) [2023-12-28 05:03:39,949][106226] Updated weights for policy 0, policy_version 1363715 (0.0007) [2023-12-28 05:03:40,010][106226] Updated weights for policy 0, policy_version 1363725 (0.0009) [2023-12-28 05:03:40,066][106226] Updated weights for policy 0, policy_version 1363735 (0.0008) [2023-12-28 05:03:40,157][106225] Updated weights for policy 1, policy_version 1367041 (0.0007) [2023-12-28 05:03:40,213][106225] Updated weights for policy 1, policy_version 1367051 (0.0008) [2023-12-28 05:03:40,270][106225] Updated weights for policy 1, policy_version 1367061 (0.0008) [2023-12-28 05:03:40,729][106226] Updated weights for policy 0, policy_version 1363745 (0.0010) [2023-12-28 05:03:40,780][106226] Updated weights for policy 0, policy_version 1363755 (0.0008) [2023-12-28 05:03:40,830][106226] Updated weights for policy 0, policy_version 1363765 (0.0008) [2023-12-28 05:03:40,887][106226] Updated weights for policy 0, policy_version 1363775 (0.0008) [2023-12-28 05:03:41,036][106225] Updated weights for policy 1, policy_version 1367071 (0.0009) [2023-12-28 05:03:41,101][106225] Updated weights for policy 1, policy_version 1367081 (0.0010) [2023-12-28 05:03:41,173][106225] Updated weights for policy 1, policy_version 1367091 (0.0011) [2023-12-28 05:03:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 699211776. Throughput: 0: 9992.9, 1: 9836.9. Samples: 699187208. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:03:41,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.569')] [2023-12-28 05:03:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001363776_349192192.pth... [2023-12-28 05:03:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001362592_348889088.pth [2023-12-28 05:03:41,206][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001367096_350027776.pth... [2023-12-28 05:03:41,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001365944_349732864.pth [2023-12-28 05:03:41,659][106226] Updated weights for policy 0, policy_version 1363785 (0.0008) [2023-12-28 05:03:41,723][106226] Updated weights for policy 0, policy_version 1363795 (0.0006) [2023-12-28 05:03:41,791][106226] Updated weights for policy 0, policy_version 1363805 (0.0006) [2023-12-28 05:03:42,002][106225] Updated weights for policy 1, policy_version 1367101 (0.0008) [2023-12-28 05:03:42,052][106225] Updated weights for policy 1, policy_version 1367111 (0.0008) [2023-12-28 05:03:42,114][106225] Updated weights for policy 1, policy_version 1367121 (0.0008) [2023-12-28 05:03:42,507][106226] Updated weights for policy 0, policy_version 1363815 (0.0007) [2023-12-28 05:03:42,562][106226] Updated weights for policy 0, policy_version 1363825 (0.0010) [2023-12-28 05:03:42,623][106226] Updated weights for policy 0, policy_version 1363835 (0.0011) [2023-12-28 05:03:42,876][106225] Updated weights for policy 1, policy_version 1367131 (0.0008) [2023-12-28 05:03:42,938][106225] Updated weights for policy 1, policy_version 1367141 (0.0011) [2023-12-28 05:03:43,002][106225] Updated weights for policy 1, policy_version 1367151 (0.0011) [2023-12-28 05:03:43,250][106226] Updated weights for policy 0, policy_version 1363845 (0.0008) [2023-12-28 05:03:43,316][106226] Updated weights for policy 0, policy_version 1363855 (0.0011) [2023-12-28 05:03:43,369][106226] Updated weights for policy 0, policy_version 1363865 (0.0010) [2023-12-28 05:03:43,717][106225] Updated weights for policy 1, policy_version 1367161 (0.0010) [2023-12-28 05:03:43,769][106225] Updated weights for policy 1, policy_version 1367171 (0.0007) [2023-12-28 05:03:43,815][106225] Updated weights for policy 1, policy_version 1367181 (0.0008) [2023-12-28 05:03:43,880][106225] Updated weights for policy 1, policy_version 1367191 (0.0006) [2023-12-28 05:03:44,053][106226] Updated weights for policy 0, policy_version 1363875 (0.0009) [2023-12-28 05:03:44,125][106226] Updated weights for policy 0, policy_version 1363885 (0.0006) [2023-12-28 05:03:44,186][106226] Updated weights for policy 0, policy_version 1363895 (0.0008) [2023-12-28 05:03:44,525][106225] Updated weights for policy 1, policy_version 1367201 (0.0007) [2023-12-28 05:03:44,577][106225] Updated weights for policy 1, policy_version 1367211 (0.0009) [2023-12-28 05:03:44,631][106225] Updated weights for policy 1, policy_version 1367221 (0.0009) [2023-12-28 05:03:44,745][106226] Updated weights for policy 0, policy_version 1363905 (0.0010) [2023-12-28 05:03:44,818][106226] Updated weights for policy 0, policy_version 1363915 (0.0011) [2023-12-28 05:03:44,880][106226] Updated weights for policy 0, policy_version 1363925 (0.0011) [2023-12-28 05:03:44,946][106226] Updated weights for policy 0, policy_version 1363935 (0.0011) [2023-12-28 05:03:45,455][106225] Updated weights for policy 1, policy_version 1367231 (0.0007) [2023-12-28 05:03:45,517][106225] Updated weights for policy 1, policy_version 1367241 (0.0005) [2023-12-28 05:03:45,579][106225] Updated weights for policy 1, policy_version 1367251 (0.0006) [2023-12-28 05:03:45,626][106226] Updated weights for policy 0, policy_version 1363945 (0.0010) [2023-12-28 05:03:45,692][106226] Updated weights for policy 0, policy_version 1363955 (0.0010) [2023-12-28 05:03:45,759][106226] Updated weights for policy 0, policy_version 1363965 (0.0011) [2023-12-28 05:03:46,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 699310080. Throughput: 0: 10092.1, 1: 9748.1. Samples: 699302512. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:03:46,176][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.545')] [2023-12-28 05:03:46,236][106225] Updated weights for policy 1, policy_version 1367261 (0.0011) [2023-12-28 05:03:46,293][106225] Updated weights for policy 1, policy_version 1367271 (0.0008) [2023-12-28 05:03:46,349][106225] Updated weights for policy 1, policy_version 1367281 (0.0005) [2023-12-28 05:03:46,448][106226] Updated weights for policy 0, policy_version 1363975 (0.0011) [2023-12-28 05:03:46,504][106226] Updated weights for policy 0, policy_version 1363985 (0.0010) [2023-12-28 05:03:46,555][106226] Updated weights for policy 0, policy_version 1363995 (0.0010) [2023-12-28 05:03:46,917][106225] Updated weights for policy 1, policy_version 1367291 (0.0006) [2023-12-28 05:03:46,974][106225] Updated weights for policy 1, policy_version 1367301 (0.0008) [2023-12-28 05:03:47,031][106225] Updated weights for policy 1, policy_version 1367311 (0.0007) [2023-12-28 05:03:47,222][106226] Updated weights for policy 0, policy_version 1364005 (0.0011) [2023-12-28 05:03:47,272][106226] Updated weights for policy 0, policy_version 1364015 (0.0010) [2023-12-28 05:03:47,318][106226] Updated weights for policy 0, policy_version 1364025 (0.0010) [2023-12-28 05:03:47,678][106225] Updated weights for policy 1, policy_version 1367321 (0.0006) [2023-12-28 05:03:47,745][106225] Updated weights for policy 1, policy_version 1367331 (0.0006) [2023-12-28 05:03:47,804][106225] Updated weights for policy 1, policy_version 1367341 (0.0007) [2023-12-28 05:03:47,860][106225] Updated weights for policy 1, policy_version 1367351 (0.0008) [2023-12-28 05:03:48,061][106226] Updated weights for policy 0, policy_version 1364035 (0.0011) [2023-12-28 05:03:48,120][106226] Updated weights for policy 0, policy_version 1364045 (0.0011) [2023-12-28 05:03:48,180][106226] Updated weights for policy 0, policy_version 1364055 (0.0010) [2023-12-28 05:03:48,596][106225] Updated weights for policy 1, policy_version 1367361 (0.0010) [2023-12-28 05:03:48,656][106225] Updated weights for policy 1, policy_version 1367371 (0.0010) [2023-12-28 05:03:48,713][106225] Updated weights for policy 1, policy_version 1367381 (0.0010) [2023-12-28 05:03:48,892][106226] Updated weights for policy 0, policy_version 1364065 (0.0010) [2023-12-28 05:03:48,947][106226] Updated weights for policy 0, policy_version 1364075 (0.0011) [2023-12-28 05:03:49,006][106226] Updated weights for policy 0, policy_version 1364085 (0.0011) [2023-12-28 05:03:49,066][106226] Updated weights for policy 0, policy_version 1364095 (0.0011) [2023-12-28 05:03:49,372][106225] Updated weights for policy 1, policy_version 1367391 (0.0009) [2023-12-28 05:03:49,432][106225] Updated weights for policy 1, policy_version 1367401 (0.0008) [2023-12-28 05:03:49,495][106225] Updated weights for policy 1, policy_version 1367411 (0.0008) [2023-12-28 05:03:49,841][106226] Updated weights for policy 0, policy_version 1364105 (0.0011) [2023-12-28 05:03:49,907][106226] Updated weights for policy 0, policy_version 1364115 (0.0009) [2023-12-28 05:03:49,973][106226] Updated weights for policy 0, policy_version 1364125 (0.0011) [2023-12-28 05:03:50,243][106225] Updated weights for policy 1, policy_version 1367421 (0.0009) [2023-12-28 05:03:50,311][106225] Updated weights for policy 1, policy_version 1367431 (0.0007) [2023-12-28 05:03:50,380][106225] Updated weights for policy 1, policy_version 1367441 (0.0008) [2023-12-28 05:03:50,762][106226] Updated weights for policy 0, policy_version 1364135 (0.0011) [2023-12-28 05:03:50,822][106226] Updated weights for policy 0, policy_version 1364145 (0.0011) [2023-12-28 05:03:50,869][106226] Updated weights for policy 0, policy_version 1364155 (0.0010) [2023-12-28 05:03:51,003][106225] Updated weights for policy 1, policy_version 1367451 (0.0006) [2023-12-28 05:03:51,072][106225] Updated weights for policy 1, policy_version 1367461 (0.0008) [2023-12-28 05:03:51,133][106225] Updated weights for policy 1, policy_version 1367471 (0.0007) [2023-12-28 05:03:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 699408384. Throughput: 0: 9977.6, 1: 9802.0. Samples: 699420860. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:03:51,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.523')] [2023-12-28 05:03:51,555][106226] Updated weights for policy 0, policy_version 1364165 (0.0007) [2023-12-28 05:03:51,614][106226] Updated weights for policy 0, policy_version 1364175 (0.0006) [2023-12-28 05:03:51,677][106226] Updated weights for policy 0, policy_version 1364185 (0.0008) [2023-12-28 05:03:51,863][106225] Updated weights for policy 1, policy_version 1367481 (0.0007) [2023-12-28 05:03:51,924][106225] Updated weights for policy 1, policy_version 1367491 (0.0010) [2023-12-28 05:03:51,982][106225] Updated weights for policy 1, policy_version 1367501 (0.0010) [2023-12-28 05:03:52,042][106225] Updated weights for policy 1, policy_version 1367511 (0.0010) [2023-12-28 05:03:52,349][106226] Updated weights for policy 0, policy_version 1364195 (0.0007) [2023-12-28 05:03:52,415][106226] Updated weights for policy 0, policy_version 1364205 (0.0008) [2023-12-28 05:03:52,482][106226] Updated weights for policy 0, policy_version 1364215 (0.0006) [2023-12-28 05:03:52,788][106225] Updated weights for policy 1, policy_version 1367521 (0.0011) [2023-12-28 05:03:52,854][106225] Updated weights for policy 1, policy_version 1367531 (0.0010) [2023-12-28 05:03:52,914][106225] Updated weights for policy 1, policy_version 1367541 (0.0010) [2023-12-28 05:03:53,142][106226] Updated weights for policy 0, policy_version 1364225 (0.0010) [2023-12-28 05:03:53,208][106226] Updated weights for policy 0, policy_version 1364235 (0.0007) [2023-12-28 05:03:53,277][106226] Updated weights for policy 0, policy_version 1364245 (0.0005) [2023-12-28 05:03:53,335][106226] Updated weights for policy 0, policy_version 1364255 (0.0005) [2023-12-28 05:03:53,597][106225] Updated weights for policy 1, policy_version 1367551 (0.0010) [2023-12-28 05:03:53,652][106225] Updated weights for policy 1, policy_version 1367561 (0.0006) [2023-12-28 05:03:53,706][106225] Updated weights for policy 1, policy_version 1367571 (0.0006) [2023-12-28 05:03:53,880][106226] Updated weights for policy 0, policy_version 1364265 (0.0010) [2023-12-28 05:03:53,948][106226] Updated weights for policy 0, policy_version 1364275 (0.0005) [2023-12-28 05:03:54,003][106226] Updated weights for policy 0, policy_version 1364285 (0.0008) [2023-12-28 05:03:54,324][106225] Updated weights for policy 1, policy_version 1367581 (0.0006) [2023-12-28 05:03:54,387][106225] Updated weights for policy 1, policy_version 1367591 (0.0008) [2023-12-28 05:03:54,457][106225] Updated weights for policy 1, policy_version 1367601 (0.0009) [2023-12-28 05:03:54,588][106226] Updated weights for policy 0, policy_version 1364295 (0.0009) [2023-12-28 05:03:54,641][106226] Updated weights for policy 0, policy_version 1364305 (0.0008) [2023-12-28 05:03:54,688][106226] Updated weights for policy 0, policy_version 1364315 (0.0009) [2023-12-28 05:03:55,061][106225] Updated weights for policy 1, policy_version 1367611 (0.0010) [2023-12-28 05:03:55,124][106225] Updated weights for policy 1, policy_version 1367621 (0.0005) [2023-12-28 05:03:55,192][106225] Updated weights for policy 1, policy_version 1367631 (0.0006) [2023-12-28 05:03:55,429][106226] Updated weights for policy 0, policy_version 1364325 (0.0007) [2023-12-28 05:03:55,490][106226] Updated weights for policy 0, policy_version 1364335 (0.0005) [2023-12-28 05:03:55,560][106226] Updated weights for policy 0, policy_version 1364345 (0.0006) [2023-12-28 05:03:55,766][106225] Updated weights for policy 1, policy_version 1367641 (0.0007) [2023-12-28 05:03:55,829][106225] Updated weights for policy 1, policy_version 1367651 (0.0006) [2023-12-28 05:03:55,886][106225] Updated weights for policy 1, policy_version 1367661 (0.0005) [2023-12-28 05:03:55,940][106225] Updated weights for policy 1, policy_version 1367671 (0.0005) [2023-12-28 05:03:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 699514880. Throughput: 0: 10011.0, 1: 9775.7. Samples: 699481780. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:03:56,176][105115] Avg episode reward: [(0, '-4.536'), (1, '-4.333')] [2023-12-28 05:03:56,182][106226] Updated weights for policy 0, policy_version 1364355 (0.0007) [2023-12-28 05:03:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001367672_350175232.pth... [2023-12-28 05:03:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001366520_349880320.pth [2023-12-28 05:03:56,245][106226] Updated weights for policy 0, policy_version 1364365 (0.0007) [2023-12-28 05:03:56,307][106226] Updated weights for policy 0, policy_version 1364375 (0.0008) [2023-12-28 05:03:56,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001364384_349347840.pth... [2023-12-28 05:03:56,356][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001363168_349036544.pth [2023-12-28 05:03:56,567][106225] Updated weights for policy 1, policy_version 1367681 (0.0010) [2023-12-28 05:03:56,633][106225] Updated weights for policy 1, policy_version 1367691 (0.0010) [2023-12-28 05:03:56,692][106225] Updated weights for policy 1, policy_version 1367701 (0.0010) [2023-12-28 05:03:56,954][106226] Updated weights for policy 0, policy_version 1364385 (0.0008) [2023-12-28 05:03:57,017][106226] Updated weights for policy 0, policy_version 1364395 (0.0009) [2023-12-28 05:03:57,071][106226] Updated weights for policy 0, policy_version 1364406 (0.0010) [2023-12-28 05:03:57,120][106226] Updated weights for policy 0, policy_version 1364416 (0.0009) [2023-12-28 05:03:57,237][106225] Updated weights for policy 1, policy_version 1367711 (0.0005) [2023-12-28 05:03:57,296][106225] Updated weights for policy 1, policy_version 1367721 (0.0006) [2023-12-28 05:03:57,354][106225] Updated weights for policy 1, policy_version 1367731 (0.0005) [2023-12-28 05:03:57,889][106226] Updated weights for policy 0, policy_version 1364426 (0.0005) [2023-12-28 05:03:57,938][106225] Updated weights for policy 1, policy_version 1367741 (0.0005) [2023-12-28 05:03:57,949][106226] Updated weights for policy 0, policy_version 1364436 (0.0008) [2023-12-28 05:03:57,992][106225] Updated weights for policy 1, policy_version 1367751 (0.0005) [2023-12-28 05:03:58,006][106226] Updated weights for policy 0, policy_version 1364446 (0.0010) [2023-12-28 05:03:58,043][106225] Updated weights for policy 1, policy_version 1367761 (0.0005) [2023-12-28 05:03:58,716][106226] Updated weights for policy 0, policy_version 1364456 (0.0008) [2023-12-28 05:03:58,762][106225] Updated weights for policy 1, policy_version 1367771 (0.0006) [2023-12-28 05:03:58,786][106226] Updated weights for policy 0, policy_version 1364466 (0.0010) [2023-12-28 05:03:58,828][106225] Updated weights for policy 1, policy_version 1367781 (0.0010) [2023-12-28 05:03:58,856][106226] Updated weights for policy 0, policy_version 1364477 (0.0009) [2023-12-28 05:03:58,901][106225] Updated weights for policy 1, policy_version 1367791 (0.0011) [2023-12-28 05:03:59,595][106226] Updated weights for policy 0, policy_version 1364487 (0.0006) [2023-12-28 05:03:59,647][106226] Updated weights for policy 0, policy_version 1364497 (0.0006) [2023-12-28 05:03:59,697][106226] Updated weights for policy 0, policy_version 1364507 (0.0005) [2023-12-28 05:03:59,711][106225] Updated weights for policy 1, policy_version 1367801 (0.0007) [2023-12-28 05:03:59,769][106225] Updated weights for policy 1, policy_version 1367811 (0.0006) [2023-12-28 05:03:59,824][106225] Updated weights for policy 1, policy_version 1367821 (0.0007) [2023-12-28 05:03:59,894][106225] Updated weights for policy 1, policy_version 1367831 (0.0007) [2023-12-28 05:04:00,409][106226] Updated weights for policy 0, policy_version 1364517 (0.0008) [2023-12-28 05:04:00,464][106226] Updated weights for policy 0, policy_version 1364527 (0.0010) [2023-12-28 05:04:00,517][106226] Updated weights for policy 0, policy_version 1364537 (0.0010) [2023-12-28 05:04:00,527][106225] Updated weights for policy 1, policy_version 1367841 (0.0006) [2023-12-28 05:04:00,578][106225] Updated weights for policy 1, policy_version 1367851 (0.0007) [2023-12-28 05:04:00,628][106225] Updated weights for policy 1, policy_version 1367861 (0.0007) [2023-12-28 05:04:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 699613184. Throughput: 0: 10073.0, 1: 9902.6. Samples: 699605464. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:01,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.354')] [2023-12-28 05:04:01,292][106226] Updated weights for policy 0, policy_version 1364547 (0.0011) [2023-12-28 05:04:01,337][106225] Updated weights for policy 1, policy_version 1367871 (0.0006) [2023-12-28 05:04:01,356][106226] Updated weights for policy 0, policy_version 1364557 (0.0010) [2023-12-28 05:04:01,405][106225] Updated weights for policy 1, policy_version 1367881 (0.0008) [2023-12-28 05:04:01,422][106226] Updated weights for policy 0, policy_version 1364567 (0.0011) [2023-12-28 05:04:01,463][106225] Updated weights for policy 1, policy_version 1367891 (0.0006) [2023-12-28 05:04:02,149][106226] Updated weights for policy 0, policy_version 1364577 (0.0010) [2023-12-28 05:04:02,181][106225] Updated weights for policy 1, policy_version 1367901 (0.0007) [2023-12-28 05:04:02,203][106226] Updated weights for policy 0, policy_version 1364587 (0.0008) [2023-12-28 05:04:02,234][106225] Updated weights for policy 1, policy_version 1367911 (0.0007) [2023-12-28 05:04:02,264][106226] Updated weights for policy 0, policy_version 1364597 (0.0006) [2023-12-28 05:04:02,290][106225] Updated weights for policy 1, policy_version 1367921 (0.0006) [2023-12-28 05:04:02,316][106226] Updated weights for policy 0, policy_version 1364607 (0.0006) [2023-12-28 05:04:02,936][106226] Updated weights for policy 0, policy_version 1364617 (0.0009) [2023-12-28 05:04:02,980][106226] Updated weights for policy 0, policy_version 1364627 (0.0006) [2023-12-28 05:04:03,021][106225] Updated weights for policy 1, policy_version 1367931 (0.0006) [2023-12-28 05:04:03,027][106226] Updated weights for policy 0, policy_version 1364637 (0.0005) [2023-12-28 05:04:03,070][106225] Updated weights for policy 1, policy_version 1367941 (0.0008) [2023-12-28 05:04:03,131][106225] Updated weights for policy 1, policy_version 1367951 (0.0007) [2023-12-28 05:04:03,620][106226] Updated weights for policy 0, policy_version 1364647 (0.0006) [2023-12-28 05:04:03,666][106226] Updated weights for policy 0, policy_version 1364657 (0.0005) [2023-12-28 05:04:03,720][106226] Updated weights for policy 0, policy_version 1364667 (0.0005) [2023-12-28 05:04:03,844][106225] Updated weights for policy 1, policy_version 1367961 (0.0006) [2023-12-28 05:04:03,915][106225] Updated weights for policy 1, policy_version 1367971 (0.0008) [2023-12-28 05:04:03,981][106225] Updated weights for policy 1, policy_version 1367981 (0.0009) [2023-12-28 05:04:04,046][106225] Updated weights for policy 1, policy_version 1367991 (0.0008) [2023-12-28 05:04:04,337][106226] Updated weights for policy 0, policy_version 1364677 (0.0007) [2023-12-28 05:04:04,401][106226] Updated weights for policy 0, policy_version 1364687 (0.0009) [2023-12-28 05:04:04,461][106226] Updated weights for policy 0, policy_version 1364697 (0.0008) [2023-12-28 05:04:04,798][106225] Updated weights for policy 1, policy_version 1368001 (0.0008) [2023-12-28 05:04:04,859][106225] Updated weights for policy 1, policy_version 1368011 (0.0006) [2023-12-28 05:04:04,908][106225] Updated weights for policy 1, policy_version 1368021 (0.0009) [2023-12-28 05:04:05,071][106226] Updated weights for policy 0, policy_version 1364707 (0.0005) [2023-12-28 05:04:05,134][106226] Updated weights for policy 0, policy_version 1364717 (0.0007) [2023-12-28 05:04:05,200][106226] Updated weights for policy 0, policy_version 1364727 (0.0009) [2023-12-28 05:04:05,612][106225] Updated weights for policy 1, policy_version 1368031 (0.0008) [2023-12-28 05:04:05,662][106225] Updated weights for policy 1, policy_version 1368041 (0.0008) [2023-12-28 05:04:05,713][106225] Updated weights for policy 1, policy_version 1368051 (0.0007) [2023-12-28 05:04:05,782][106226] Updated weights for policy 0, policy_version 1364737 (0.0007) [2023-12-28 05:04:05,852][106226] Updated weights for policy 0, policy_version 1364747 (0.0011) [2023-12-28 05:04:05,919][106226] Updated weights for policy 0, policy_version 1364757 (0.0011) [2023-12-28 05:04:05,982][106226] Updated weights for policy 0, policy_version 1364767 (0.0011) [2023-12-28 05:04:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 699719680. Throughput: 0: 10158.5, 1: 9858.0. Samples: 699727548. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:06,175][105115] Avg episode reward: [(0, '-4.509'), (1, '-4.540')] [2023-12-28 05:04:06,416][106225] Updated weights for policy 1, policy_version 1368061 (0.0008) [2023-12-28 05:04:06,475][106225] Updated weights for policy 1, policy_version 1368071 (0.0007) [2023-12-28 05:04:06,538][106225] Updated weights for policy 1, policy_version 1368081 (0.0008) [2023-12-28 05:04:06,698][106226] Updated weights for policy 0, policy_version 1364777 (0.0011) [2023-12-28 05:04:06,765][106226] Updated weights for policy 0, policy_version 1364787 (0.0011) [2023-12-28 05:04:06,830][106226] Updated weights for policy 0, policy_version 1364797 (0.0011) [2023-12-28 05:04:07,188][106225] Updated weights for policy 1, policy_version 1368091 (0.0009) [2023-12-28 05:04:07,251][106225] Updated weights for policy 1, policy_version 1368101 (0.0008) [2023-12-28 05:04:07,313][106225] Updated weights for policy 1, policy_version 1368111 (0.0008) [2023-12-28 05:04:07,532][106226] Updated weights for policy 0, policy_version 1364807 (0.0010) [2023-12-28 05:04:07,588][106226] Updated weights for policy 0, policy_version 1364817 (0.0010) [2023-12-28 05:04:07,651][106226] Updated weights for policy 0, policy_version 1364827 (0.0010) [2023-12-28 05:04:07,923][106225] Updated weights for policy 1, policy_version 1368121 (0.0008) [2023-12-28 05:04:07,985][106225] Updated weights for policy 1, policy_version 1368131 (0.0009) [2023-12-28 05:04:08,033][106225] Updated weights for policy 1, policy_version 1368141 (0.0009) [2023-12-28 05:04:08,083][106225] Updated weights for policy 1, policy_version 1368151 (0.0007) [2023-12-28 05:04:08,353][106226] Updated weights for policy 0, policy_version 1364837 (0.0010) [2023-12-28 05:04:08,415][106226] Updated weights for policy 0, policy_version 1364847 (0.0009) [2023-12-28 05:04:08,482][106226] Updated weights for policy 0, policy_version 1364857 (0.0008) [2023-12-28 05:04:08,793][106225] Updated weights for policy 1, policy_version 1368161 (0.0008) [2023-12-28 05:04:08,853][106225] Updated weights for policy 1, policy_version 1368171 (0.0008) [2023-12-28 05:04:08,918][106225] Updated weights for policy 1, policy_version 1368181 (0.0008) [2023-12-28 05:04:09,200][106226] Updated weights for policy 0, policy_version 1364867 (0.0009) [2023-12-28 05:04:09,274][106226] Updated weights for policy 0, policy_version 1364877 (0.0009) [2023-12-28 05:04:09,335][106226] Updated weights for policy 0, policy_version 1364887 (0.0009) [2023-12-28 05:04:09,670][106225] Updated weights for policy 1, policy_version 1368191 (0.0008) [2023-12-28 05:04:09,735][106225] Updated weights for policy 1, policy_version 1368201 (0.0007) [2023-12-28 05:04:09,793][106225] Updated weights for policy 1, policy_version 1368211 (0.0008) [2023-12-28 05:04:10,132][106226] Updated weights for policy 0, policy_version 1364897 (0.0013) [2023-12-28 05:04:10,207][106226] Updated weights for policy 0, policy_version 1364907 (0.0008) [2023-12-28 05:04:10,278][106226] Updated weights for policy 0, policy_version 1364917 (0.0009) [2023-12-28 05:04:10,345][106226] Updated weights for policy 0, policy_version 1364927 (0.0009) [2023-12-28 05:04:10,487][106225] Updated weights for policy 1, policy_version 1368221 (0.0007) [2023-12-28 05:04:10,552][106225] Updated weights for policy 1, policy_version 1368231 (0.0008) [2023-12-28 05:04:10,611][106225] Updated weights for policy 1, policy_version 1368241 (0.0007) [2023-12-28 05:04:11,079][106226] Updated weights for policy 0, policy_version 1364937 (0.0009) [2023-12-28 05:04:11,152][106226] Updated weights for policy 0, policy_version 1364947 (0.0007) [2023-12-28 05:04:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 699809792. Throughput: 0: 10174.0, 1: 9931.3. Samples: 699787732. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:11,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.543')] [2023-12-28 05:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001368248_350322688.pth... [2023-12-28 05:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001367096_350027776.pth [2023-12-28 05:04:11,211][106226] Updated weights for policy 0, policy_version 1364957 (0.0009) [2023-12-28 05:04:11,226][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001364960_349495296.pth... [2023-12-28 05:04:11,231][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001363776_349192192.pth [2023-12-28 05:04:11,329][106225] Updated weights for policy 1, policy_version 1368251 (0.0008) [2023-12-28 05:04:11,401][106225] Updated weights for policy 1, policy_version 1368261 (0.0008) [2023-12-28 05:04:11,452][106225] Updated weights for policy 1, policy_version 1368271 (0.0008) [2023-12-28 05:04:11,988][106226] Updated weights for policy 0, policy_version 1364967 (0.0009) [2023-12-28 05:04:12,041][106226] Updated weights for policy 0, policy_version 1364977 (0.0008) [2023-12-28 05:04:12,103][106226] Updated weights for policy 0, policy_version 1364987 (0.0008) [2023-12-28 05:04:12,227][106225] Updated weights for policy 1, policy_version 1368281 (0.0009) [2023-12-28 05:04:12,294][106225] Updated weights for policy 1, policy_version 1368291 (0.0008) [2023-12-28 05:04:12,359][106225] Updated weights for policy 1, policy_version 1368301 (0.0007) [2023-12-28 05:04:12,423][106225] Updated weights for policy 1, policy_version 1368311 (0.0009) [2023-12-28 05:04:12,919][106226] Updated weights for policy 0, policy_version 1364997 (0.0009) [2023-12-28 05:04:12,968][106226] Updated weights for policy 0, policy_version 1365007 (0.0008) [2023-12-28 05:04:13,018][106226] Updated weights for policy 0, policy_version 1365017 (0.0009) [2023-12-28 05:04:13,111][106225] Updated weights for policy 1, policy_version 1368321 (0.0006) [2023-12-28 05:04:13,164][106225] Updated weights for policy 1, policy_version 1368331 (0.0005) [2023-12-28 05:04:13,218][106225] Updated weights for policy 1, policy_version 1368341 (0.0005) [2023-12-28 05:04:13,654][106226] Updated weights for policy 0, policy_version 1365027 (0.0008) [2023-12-28 05:04:13,719][106226] Updated weights for policy 0, policy_version 1365037 (0.0005) [2023-12-28 05:04:13,791][106226] Updated weights for policy 0, policy_version 1365047 (0.0006) [2023-12-28 05:04:13,843][106225] Updated weights for policy 1, policy_version 1368351 (0.0005) [2023-12-28 05:04:13,901][106225] Updated weights for policy 1, policy_version 1368361 (0.0005) [2023-12-28 05:04:13,963][106225] Updated weights for policy 1, policy_version 1368371 (0.0005) [2023-12-28 05:04:14,352][106226] Updated weights for policy 0, policy_version 1365057 (0.0009) [2023-12-28 05:04:14,399][106226] Updated weights for policy 0, policy_version 1365067 (0.0009) [2023-12-28 05:04:14,450][106226] Updated weights for policy 0, policy_version 1365077 (0.0008) [2023-12-28 05:04:14,495][106226] Updated weights for policy 0, policy_version 1365087 (0.0008) [2023-12-28 05:04:14,538][106225] Updated weights for policy 1, policy_version 1368381 (0.0005) [2023-12-28 05:04:14,603][106225] Updated weights for policy 1, policy_version 1368391 (0.0008) [2023-12-28 05:04:14,662][106225] Updated weights for policy 1, policy_version 1368401 (0.0008) [2023-12-28 05:04:15,219][106226] Updated weights for policy 0, policy_version 1365097 (0.0009) [2023-12-28 05:04:15,275][106226] Updated weights for policy 0, policy_version 1365107 (0.0010) [2023-12-28 05:04:15,323][106226] Updated weights for policy 0, policy_version 1365117 (0.0008) [2023-12-28 05:04:15,349][106225] Updated weights for policy 1, policy_version 1368411 (0.0008) [2023-12-28 05:04:15,399][106225] Updated weights for policy 1, policy_version 1368421 (0.0008) [2023-12-28 05:04:15,448][106225] Updated weights for policy 1, policy_version 1368431 (0.0009) [2023-12-28 05:04:16,066][106226] Updated weights for policy 0, policy_version 1365127 (0.0009) [2023-12-28 05:04:16,117][106226] Updated weights for policy 0, policy_version 1365137 (0.0007) [2023-12-28 05:04:16,152][106225] Updated weights for policy 1, policy_version 1368441 (0.0008) [2023-12-28 05:04:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 699908096. Throughput: 0: 10052.6, 1: 9866.0. Samples: 699904340. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:16,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.310')] [2023-12-28 05:04:16,184][106226] Updated weights for policy 0, policy_version 1365147 (0.0008) [2023-12-28 05:04:16,211][106225] Updated weights for policy 1, policy_version 1368451 (0.0005) [2023-12-28 05:04:16,264][106225] Updated weights for policy 1, policy_version 1368461 (0.0005) [2023-12-28 05:04:16,314][106225] Updated weights for policy 1, policy_version 1368471 (0.0006) [2023-12-28 05:04:16,886][106226] Updated weights for policy 0, policy_version 1365157 (0.0009) [2023-12-28 05:04:16,945][106225] Updated weights for policy 1, policy_version 1368481 (0.0006) [2023-12-28 05:04:16,948][106226] Updated weights for policy 0, policy_version 1365167 (0.0011) [2023-12-28 05:04:16,997][106225] Updated weights for policy 1, policy_version 1368491 (0.0006) [2023-12-28 05:04:17,009][106226] Updated weights for policy 0, policy_version 1365177 (0.0011) [2023-12-28 05:04:17,050][106225] Updated weights for policy 1, policy_version 1368501 (0.0009) [2023-12-28 05:04:17,701][106226] Updated weights for policy 0, policy_version 1365187 (0.0010) [2023-12-28 05:04:17,702][106225] Updated weights for policy 1, policy_version 1368511 (0.0006) [2023-12-28 05:04:17,760][106226] Updated weights for policy 0, policy_version 1365197 (0.0008) [2023-12-28 05:04:17,762][106225] Updated weights for policy 1, policy_version 1368521 (0.0006) [2023-12-28 05:04:17,814][106226] Updated weights for policy 0, policy_version 1365207 (0.0006) [2023-12-28 05:04:17,815][106225] Updated weights for policy 1, policy_version 1368531 (0.0010) [2023-12-28 05:04:18,466][106225] Updated weights for policy 1, policy_version 1368541 (0.0008) [2023-12-28 05:04:18,525][106225] Updated weights for policy 1, policy_version 1368551 (0.0005) [2023-12-28 05:04:18,553][106226] Updated weights for policy 0, policy_version 1365217 (0.0007) [2023-12-28 05:04:18,581][106225] Updated weights for policy 1, policy_version 1368561 (0.0005) [2023-12-28 05:04:18,609][106226] Updated weights for policy 0, policy_version 1365227 (0.0008) [2023-12-28 05:04:18,670][106226] Updated weights for policy 0, policy_version 1365237 (0.0008) [2023-12-28 05:04:18,723][106226] Updated weights for policy 0, policy_version 1365247 (0.0008) [2023-12-28 05:04:19,210][106225] Updated weights for policy 1, policy_version 1368571 (0.0007) [2023-12-28 05:04:19,276][106225] Updated weights for policy 1, policy_version 1368581 (0.0009) [2023-12-28 05:04:19,334][106225] Updated weights for policy 1, policy_version 1368591 (0.0010) [2023-12-28 05:04:19,542][106226] Updated weights for policy 0, policy_version 1365257 (0.0008) [2023-12-28 05:04:19,606][106226] Updated weights for policy 0, policy_version 1365267 (0.0006) [2023-12-28 05:04:19,673][106226] Updated weights for policy 0, policy_version 1365277 (0.0006) [2023-12-28 05:04:20,146][106225] Updated weights for policy 1, policy_version 1368601 (0.0010) [2023-12-28 05:04:20,214][106225] Updated weights for policy 1, policy_version 1368611 (0.0008) [2023-12-28 05:04:20,280][106225] Updated weights for policy 1, policy_version 1368621 (0.0008) [2023-12-28 05:04:20,327][106226] Updated weights for policy 0, policy_version 1365287 (0.0009) [2023-12-28 05:04:20,345][106225] Updated weights for policy 1, policy_version 1368631 (0.0009) [2023-12-28 05:04:20,387][106226] Updated weights for policy 0, policy_version 1365297 (0.0009) [2023-12-28 05:04:20,451][106226] Updated weights for policy 0, policy_version 1365307 (0.0010) [2023-12-28 05:04:21,127][106225] Updated weights for policy 1, policy_version 1368641 (0.0010) [2023-12-28 05:04:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 700006400. Throughput: 0: 9941.3, 1: 9911.5. Samples: 700021652. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:21,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-4.568')] [2023-12-28 05:04:21,195][106225] Updated weights for policy 1, policy_version 1368651 (0.0008) [2023-12-28 05:04:21,224][106226] Updated weights for policy 0, policy_version 1365317 (0.0008) [2023-12-28 05:04:21,260][106225] Updated weights for policy 1, policy_version 1368661 (0.0007) [2023-12-28 05:04:21,297][106226] Updated weights for policy 0, policy_version 1365327 (0.0009) [2023-12-28 05:04:21,376][106226] Updated weights for policy 0, policy_version 1365337 (0.0006) [2023-12-28 05:04:22,006][106225] Updated weights for policy 1, policy_version 1368671 (0.0008) [2023-12-28 05:04:22,061][106225] Updated weights for policy 1, policy_version 1368681 (0.0005) [2023-12-28 05:04:22,125][106225] Updated weights for policy 1, policy_version 1368691 (0.0007) [2023-12-28 05:04:22,165][106226] Updated weights for policy 0, policy_version 1365347 (0.0007) [2023-12-28 05:04:22,216][106226] Updated weights for policy 0, policy_version 1365357 (0.0008) [2023-12-28 05:04:22,278][106226] Updated weights for policy 0, policy_version 1365367 (0.0009) [2023-12-28 05:04:22,871][106225] Updated weights for policy 1, policy_version 1368701 (0.0009) [2023-12-28 05:04:22,933][106225] Updated weights for policy 1, policy_version 1368711 (0.0008) [2023-12-28 05:04:22,999][106225] Updated weights for policy 1, policy_version 1368721 (0.0008) [2023-12-28 05:04:23,024][106226] Updated weights for policy 0, policy_version 1365377 (0.0008) [2023-12-28 05:04:23,078][106226] Updated weights for policy 0, policy_version 1365387 (0.0009) [2023-12-28 05:04:23,139][106226] Updated weights for policy 0, policy_version 1365397 (0.0008) [2023-12-28 05:04:23,193][106226] Updated weights for policy 0, policy_version 1365407 (0.0009) [2023-12-28 05:04:23,755][106225] Updated weights for policy 1, policy_version 1368731 (0.0008) [2023-12-28 05:04:23,809][106225] Updated weights for policy 1, policy_version 1368741 (0.0008) [2023-12-28 05:04:23,843][106226] Updated weights for policy 0, policy_version 1365417 (0.0007) [2023-12-28 05:04:23,856][106225] Updated weights for policy 1, policy_version 1368751 (0.0007) [2023-12-28 05:04:23,893][106226] Updated weights for policy 0, policy_version 1365427 (0.0009) [2023-12-28 05:04:23,971][106226] Updated weights for policy 0, policy_version 1365437 (0.0010) [2023-12-28 05:04:24,516][106225] Updated weights for policy 1, policy_version 1368761 (0.0005) [2023-12-28 05:04:24,571][106225] Updated weights for policy 1, policy_version 1368771 (0.0005) [2023-12-28 05:04:24,621][106225] Updated weights for policy 1, policy_version 1368781 (0.0005) [2023-12-28 05:04:24,671][106225] Updated weights for policy 1, policy_version 1368791 (0.0005) [2023-12-28 05:04:24,751][106226] Updated weights for policy 0, policy_version 1365447 (0.0009) [2023-12-28 05:04:24,817][106226] Updated weights for policy 0, policy_version 1365457 (0.0009) [2023-12-28 05:04:24,883][106226] Updated weights for policy 0, policy_version 1365467 (0.0008) [2023-12-28 05:04:25,306][106225] Updated weights for policy 1, policy_version 1368801 (0.0008) [2023-12-28 05:04:25,365][106225] Updated weights for policy 1, policy_version 1368811 (0.0009) [2023-12-28 05:04:25,417][106225] Updated weights for policy 1, policy_version 1368821 (0.0009) [2023-12-28 05:04:25,509][106226] Updated weights for policy 0, policy_version 1365477 (0.0007) [2023-12-28 05:04:25,573][106226] Updated weights for policy 0, policy_version 1365487 (0.0009) [2023-12-28 05:04:25,622][106226] Updated weights for policy 0, policy_version 1365497 (0.0006) [2023-12-28 05:04:26,135][106225] Updated weights for policy 1, policy_version 1368831 (0.0008) [2023-12-28 05:04:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 700104704. Throughput: 0: 9883.1, 1: 9915.7. Samples: 700078156. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:26,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.402')] [2023-12-28 05:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001365504_349634560.pth... [2023-12-28 05:04:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001364384_349347840.pth [2023-12-28 05:04:26,194][106225] Updated weights for policy 1, policy_version 1368841 (0.0007) [2023-12-28 05:04:26,251][106225] Updated weights for policy 1, policy_version 1368851 (0.0005) [2023-12-28 05:04:26,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001368856_350478336.pth... [2023-12-28 05:04:26,285][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001367672_350175232.pth [2023-12-28 05:04:26,318][106226] Updated weights for policy 0, policy_version 1365507 (0.0006) [2023-12-28 05:04:26,379][106226] Updated weights for policy 0, policy_version 1365517 (0.0008) [2023-12-28 05:04:26,426][106226] Updated weights for policy 0, policy_version 1365527 (0.0008) [2023-12-28 05:04:26,827][106225] Updated weights for policy 1, policy_version 1368861 (0.0007) [2023-12-28 05:04:26,877][106225] Updated weights for policy 1, policy_version 1368871 (0.0006) [2023-12-28 05:04:26,930][106225] Updated weights for policy 1, policy_version 1368881 (0.0010) [2023-12-28 05:04:27,254][106226] Updated weights for policy 0, policy_version 1365537 (0.0008) [2023-12-28 05:04:27,303][106226] Updated weights for policy 0, policy_version 1365547 (0.0008) [2023-12-28 05:04:27,353][106226] Updated weights for policy 0, policy_version 1365557 (0.0008) [2023-12-28 05:04:27,410][106226] Updated weights for policy 0, policy_version 1365567 (0.0009) [2023-12-28 05:04:27,482][106225] Updated weights for policy 1, policy_version 1368891 (0.0007) [2023-12-28 05:04:27,539][106225] Updated weights for policy 1, policy_version 1368901 (0.0008) [2023-12-28 05:04:27,587][106225] Updated weights for policy 1, policy_version 1368911 (0.0005) [2023-12-28 05:04:28,110][106225] Updated weights for policy 1, policy_version 1368921 (0.0005) [2023-12-28 05:04:28,168][106225] Updated weights for policy 1, policy_version 1368931 (0.0005) [2023-12-28 05:04:28,198][106226] Updated weights for policy 0, policy_version 1365577 (0.0006) [2023-12-28 05:04:28,215][106225] Updated weights for policy 1, policy_version 1368941 (0.0005) [2023-12-28 05:04:28,254][106226] Updated weights for policy 0, policy_version 1365587 (0.0007) [2023-12-28 05:04:28,261][106225] Updated weights for policy 1, policy_version 1368951 (0.0005) [2023-12-28 05:04:28,318][106226] Updated weights for policy 0, policy_version 1365597 (0.0009) [2023-12-28 05:04:28,844][106225] Updated weights for policy 1, policy_version 1368961 (0.0009) [2023-12-28 05:04:28,903][106225] Updated weights for policy 1, policy_version 1368971 (0.0010) [2023-12-28 05:04:28,961][106226] Updated weights for policy 0, policy_version 1365607 (0.0008) [2023-12-28 05:04:28,966][106225] Updated weights for policy 1, policy_version 1368981 (0.0010) [2023-12-28 05:04:29,023][106226] Updated weights for policy 0, policy_version 1365617 (0.0007) [2023-12-28 05:04:29,089][106226] Updated weights for policy 0, policy_version 1365627 (0.0008) [2023-12-28 05:04:29,631][106225] Updated weights for policy 1, policy_version 1368991 (0.0009) [2023-12-28 05:04:29,691][106225] Updated weights for policy 1, policy_version 1369001 (0.0008) [2023-12-28 05:04:29,748][106225] Updated weights for policy 1, policy_version 1369011 (0.0009) [2023-12-28 05:04:29,881][106226] Updated weights for policy 0, policy_version 1365637 (0.0008) [2023-12-28 05:04:29,942][106226] Updated weights for policy 0, policy_version 1365647 (0.0009) [2023-12-28 05:04:29,999][106226] Updated weights for policy 0, policy_version 1365658 (0.0007) [2023-12-28 05:04:30,482][106225] Updated weights for policy 1, policy_version 1369021 (0.0008) [2023-12-28 05:04:30,534][106225] Updated weights for policy 1, policy_version 1369031 (0.0009) [2023-12-28 05:04:30,583][106225] Updated weights for policy 1, policy_version 1369041 (0.0008) [2023-12-28 05:04:30,614][106226] Updated weights for policy 0, policy_version 1365668 (0.0005) [2023-12-28 05:04:30,664][106226] Updated weights for policy 0, policy_version 1365678 (0.0005) [2023-12-28 05:04:30,717][106226] Updated weights for policy 0, policy_version 1365688 (0.0005) [2023-12-28 05:04:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 700211200. Throughput: 0: 9805.8, 1: 10167.7. Samples: 700201316. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:31,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.573')] [2023-12-28 05:04:31,328][106225] Updated weights for policy 1, policy_version 1369051 (0.0008) [2023-12-28 05:04:31,398][106225] Updated weights for policy 1, policy_version 1369061 (0.0008) [2023-12-28 05:04:31,417][106226] Updated weights for policy 0, policy_version 1365698 (0.0005) [2023-12-28 05:04:31,451][106225] Updated weights for policy 1, policy_version 1369071 (0.0007) [2023-12-28 05:04:31,474][106226] Updated weights for policy 0, policy_version 1365708 (0.0007) [2023-12-28 05:04:31,528][106226] Updated weights for policy 0, policy_version 1365718 (0.0007) [2023-12-28 05:04:31,591][106226] Updated weights for policy 0, policy_version 1365728 (0.0007) [2023-12-28 05:04:32,151][106225] Updated weights for policy 1, policy_version 1369081 (0.0008) [2023-12-28 05:04:32,216][106225] Updated weights for policy 1, policy_version 1369091 (0.0005) [2023-12-28 05:04:32,282][106225] Updated weights for policy 1, policy_version 1369101 (0.0009) [2023-12-28 05:04:32,334][106225] Updated weights for policy 1, policy_version 1369111 (0.0009) [2023-12-28 05:04:32,413][106226] Updated weights for policy 0, policy_version 1365738 (0.0008) [2023-12-28 05:04:32,470][106226] Updated weights for policy 0, policy_version 1365748 (0.0008) [2023-12-28 05:04:32,530][106226] Updated weights for policy 0, policy_version 1365758 (0.0007) [2023-12-28 05:04:33,007][106225] Updated weights for policy 1, policy_version 1369121 (0.0010) [2023-12-28 05:04:33,063][106225] Updated weights for policy 1, policy_version 1369131 (0.0010) [2023-12-28 05:04:33,119][106225] Updated weights for policy 1, policy_version 1369141 (0.0010) [2023-12-28 05:04:33,225][106226] Updated weights for policy 0, policy_version 1365768 (0.0008) [2023-12-28 05:04:33,271][106226] Updated weights for policy 0, policy_version 1365778 (0.0008) [2023-12-28 05:04:33,316][106226] Updated weights for policy 0, policy_version 1365788 (0.0007) [2023-12-28 05:04:33,838][106225] Updated weights for policy 1, policy_version 1369151 (0.0010) [2023-12-28 05:04:33,897][106225] Updated weights for policy 1, policy_version 1369161 (0.0010) [2023-12-28 05:04:33,944][106225] Updated weights for policy 1, policy_version 1369171 (0.0010) [2023-12-28 05:04:34,039][106226] Updated weights for policy 0, policy_version 1365798 (0.0008) [2023-12-28 05:04:34,086][106226] Updated weights for policy 0, policy_version 1365808 (0.0006) [2023-12-28 05:04:34,161][106226] Updated weights for policy 0, policy_version 1365818 (0.0006) [2023-12-28 05:04:34,597][106225] Updated weights for policy 1, policy_version 1369181 (0.0008) [2023-12-28 05:04:34,663][106225] Updated weights for policy 1, policy_version 1369191 (0.0008) [2023-12-28 05:04:34,730][106225] Updated weights for policy 1, policy_version 1369201 (0.0010) [2023-12-28 05:04:34,757][106226] Updated weights for policy 0, policy_version 1365828 (0.0008) [2023-12-28 05:04:34,818][106226] Updated weights for policy 0, policy_version 1365838 (0.0008) [2023-12-28 05:04:34,879][106226] Updated weights for policy 0, policy_version 1365848 (0.0008) [2023-12-28 05:04:35,415][106225] Updated weights for policy 1, policy_version 1369211 (0.0010) [2023-12-28 05:04:35,474][106225] Updated weights for policy 1, policy_version 1369221 (0.0006) [2023-12-28 05:04:35,539][106225] Updated weights for policy 1, policy_version 1369231 (0.0005) [2023-12-28 05:04:35,645][106226] Updated weights for policy 0, policy_version 1365858 (0.0008) [2023-12-28 05:04:35,707][106226] Updated weights for policy 0, policy_version 1365868 (0.0009) [2023-12-28 05:04:35,771][106226] Updated weights for policy 0, policy_version 1365878 (0.0008) [2023-12-28 05:04:35,829][106226] Updated weights for policy 0, policy_version 1365888 (0.0008) [2023-12-28 05:04:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 700309504. Throughput: 0: 9858.7, 1: 10121.8. Samples: 700319980. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:36,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.591')] [2023-12-28 05:04:36,199][106225] Updated weights for policy 1, policy_version 1369241 (0.0008) [2023-12-28 05:04:36,264][106225] Updated weights for policy 1, policy_version 1369251 (0.0008) [2023-12-28 05:04:36,328][106225] Updated weights for policy 1, policy_version 1369261 (0.0008) [2023-12-28 05:04:36,391][106225] Updated weights for policy 1, policy_version 1369271 (0.0006) [2023-12-28 05:04:36,549][106226] Updated weights for policy 0, policy_version 1365898 (0.0008) [2023-12-28 05:04:36,611][106226] Updated weights for policy 0, policy_version 1365908 (0.0008) [2023-12-28 05:04:36,671][106226] Updated weights for policy 0, policy_version 1365918 (0.0008) [2023-12-28 05:04:37,108][106225] Updated weights for policy 1, policy_version 1369281 (0.0007) [2023-12-28 05:04:37,161][106225] Updated weights for policy 1, policy_version 1369291 (0.0010) [2023-12-28 05:04:37,217][106225] Updated weights for policy 1, policy_version 1369301 (0.0010) [2023-12-28 05:04:37,434][106226] Updated weights for policy 0, policy_version 1365928 (0.0008) [2023-12-28 05:04:37,484][106226] Updated weights for policy 0, policy_version 1365938 (0.0007) [2023-12-28 05:04:37,539][106226] Updated weights for policy 0, policy_version 1365948 (0.0008) [2023-12-28 05:04:37,920][106225] Updated weights for policy 1, policy_version 1369311 (0.0010) [2023-12-28 05:04:37,975][106225] Updated weights for policy 1, policy_version 1369321 (0.0010) [2023-12-28 05:04:38,033][106225] Updated weights for policy 1, policy_version 1369331 (0.0010) [2023-12-28 05:04:38,307][106226] Updated weights for policy 0, policy_version 1365958 (0.0008) [2023-12-28 05:04:38,374][106226] Updated weights for policy 0, policy_version 1365968 (0.0008) [2023-12-28 05:04:38,435][106226] Updated weights for policy 0, policy_version 1365978 (0.0008) [2023-12-28 05:04:38,726][106225] Updated weights for policy 1, policy_version 1369341 (0.0010) [2023-12-28 05:04:38,782][106225] Updated weights for policy 1, policy_version 1369351 (0.0009) [2023-12-28 05:04:38,846][106225] Updated weights for policy 1, policy_version 1369361 (0.0008) [2023-12-28 05:04:39,195][106226] Updated weights for policy 0, policy_version 1365988 (0.0009) [2023-12-28 05:04:39,264][106226] Updated weights for policy 0, policy_version 1365998 (0.0009) [2023-12-28 05:04:39,319][106226] Updated weights for policy 0, policy_version 1366008 (0.0007) [2023-12-28 05:04:39,582][106225] Updated weights for policy 1, policy_version 1369371 (0.0009) [2023-12-28 05:04:39,644][106225] Updated weights for policy 1, policy_version 1369381 (0.0008) [2023-12-28 05:04:39,709][106225] Updated weights for policy 1, policy_version 1369391 (0.0009) [2023-12-28 05:04:40,066][106226] Updated weights for policy 0, policy_version 1366018 (0.0008) [2023-12-28 05:04:40,130][106226] Updated weights for policy 0, policy_version 1366028 (0.0006) [2023-12-28 05:04:40,191][106226] Updated weights for policy 0, policy_version 1366038 (0.0008) [2023-12-28 05:04:40,251][106226] Updated weights for policy 0, policy_version 1366048 (0.0008) [2023-12-28 05:04:40,505][106225] Updated weights for policy 1, policy_version 1369401 (0.0009) [2023-12-28 05:04:40,561][106225] Updated weights for policy 1, policy_version 1369411 (0.0009) [2023-12-28 05:04:40,621][106225] Updated weights for policy 1, policy_version 1369421 (0.0009) [2023-12-28 05:04:40,680][106225] Updated weights for policy 1, policy_version 1369431 (0.0008) [2023-12-28 05:04:40,938][106226] Updated weights for policy 0, policy_version 1366058 (0.0007) [2023-12-28 05:04:40,988][106226] Updated weights for policy 0, policy_version 1366068 (0.0009) [2023-12-28 05:04:41,052][106226] Updated weights for policy 0, policy_version 1366078 (0.0009) [2023-12-28 05:04:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 700407808. Throughput: 0: 9777.0, 1: 10136.0. Samples: 700377860. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:41,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.368')] [2023-12-28 05:04:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001369432_350625792.pth... [2023-12-28 05:04:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001366080_349782016.pth... [2023-12-28 05:04:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001364960_349495296.pth [2023-12-28 05:04:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001368248_350322688.pth [2023-12-28 05:04:41,492][106225] Updated weights for policy 1, policy_version 1369441 (0.0008) [2023-12-28 05:04:41,551][106225] Updated weights for policy 1, policy_version 1369451 (0.0009) [2023-12-28 05:04:41,611][106225] Updated weights for policy 1, policy_version 1369461 (0.0011) [2023-12-28 05:04:41,846][106226] Updated weights for policy 0, policy_version 1366088 (0.0008) [2023-12-28 05:04:41,912][106226] Updated weights for policy 0, policy_version 1366098 (0.0008) [2023-12-28 05:04:41,977][106226] Updated weights for policy 0, policy_version 1366108 (0.0007) [2023-12-28 05:04:42,382][106225] Updated weights for policy 1, policy_version 1369471 (0.0010) [2023-12-28 05:04:42,447][106225] Updated weights for policy 1, policy_version 1369481 (0.0010) [2023-12-28 05:04:42,511][106225] Updated weights for policy 1, policy_version 1369491 (0.0010) [2023-12-28 05:04:42,673][106226] Updated weights for policy 0, policy_version 1366118 (0.0009) [2023-12-28 05:04:42,740][106226] Updated weights for policy 0, policy_version 1366128 (0.0010) [2023-12-28 05:04:42,801][106226] Updated weights for policy 0, policy_version 1366138 (0.0010) [2023-12-28 05:04:43,168][106225] Updated weights for policy 1, policy_version 1369501 (0.0008) [2023-12-28 05:04:43,224][106225] Updated weights for policy 1, policy_version 1369511 (0.0005) [2023-12-28 05:04:43,280][106225] Updated weights for policy 1, policy_version 1369521 (0.0006) [2023-12-28 05:04:43,495][106226] Updated weights for policy 0, policy_version 1366148 (0.0010) [2023-12-28 05:04:43,554][106226] Updated weights for policy 0, policy_version 1366158 (0.0010) [2023-12-28 05:04:43,610][106226] Updated weights for policy 0, policy_version 1366168 (0.0010) [2023-12-28 05:04:43,907][106225] Updated weights for policy 1, policy_version 1369531 (0.0007) [2023-12-28 05:04:43,966][106225] Updated weights for policy 1, policy_version 1369541 (0.0006) [2023-12-28 05:04:44,035][106225] Updated weights for policy 1, policy_version 1369551 (0.0009) [2023-12-28 05:04:44,296][106226] Updated weights for policy 0, policy_version 1366178 (0.0010) [2023-12-28 05:04:44,361][106226] Updated weights for policy 0, policy_version 1366188 (0.0010) [2023-12-28 05:04:44,421][106226] Updated weights for policy 0, policy_version 1366198 (0.0010) [2023-12-28 05:04:44,481][106226] Updated weights for policy 0, policy_version 1366208 (0.0010) [2023-12-28 05:04:44,722][106225] Updated weights for policy 1, policy_version 1369561 (0.0010) [2023-12-28 05:04:44,782][106225] Updated weights for policy 1, policy_version 1369571 (0.0012) [2023-12-28 05:04:44,846][106225] Updated weights for policy 1, policy_version 1369581 (0.0010) [2023-12-28 05:04:44,912][106225] Updated weights for policy 1, policy_version 1369591 (0.0011) [2023-12-28 05:04:45,100][106226] Updated weights for policy 0, policy_version 1366218 (0.0006) [2023-12-28 05:04:45,165][106226] Updated weights for policy 0, policy_version 1366228 (0.0006) [2023-12-28 05:04:45,227][106226] Updated weights for policy 0, policy_version 1366238 (0.0008) [2023-12-28 05:04:45,627][106225] Updated weights for policy 1, policy_version 1369601 (0.0008) [2023-12-28 05:04:45,682][106225] Updated weights for policy 1, policy_version 1369611 (0.0005) [2023-12-28 05:04:45,742][106225] Updated weights for policy 1, policy_version 1369621 (0.0005) [2023-12-28 05:04:45,869][106226] Updated weights for policy 0, policy_version 1366248 (0.0010) [2023-12-28 05:04:45,932][106226] Updated weights for policy 0, policy_version 1366258 (0.0010) [2023-12-28 05:04:45,986][106226] Updated weights for policy 0, policy_version 1366268 (0.0010) [2023-12-28 05:04:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 700506112. Throughput: 0: 9747.6, 1: 10008.5. Samples: 700494488. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:46,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.423')] [2023-12-28 05:04:46,414][106225] Updated weights for policy 1, policy_version 1369631 (0.0009) [2023-12-28 05:04:46,483][106225] Updated weights for policy 1, policy_version 1369641 (0.0010) [2023-12-28 05:04:46,530][106225] Updated weights for policy 1, policy_version 1369651 (0.0010) [2023-12-28 05:04:46,677][106226] Updated weights for policy 0, policy_version 1366278 (0.0010) [2023-12-28 05:04:46,738][106226] Updated weights for policy 0, policy_version 1366288 (0.0008) [2023-12-28 05:04:46,805][106226] Updated weights for policy 0, policy_version 1366298 (0.0005) [2023-12-28 05:04:47,174][106225] Updated weights for policy 1, policy_version 1369661 (0.0007) [2023-12-28 05:04:47,233][106225] Updated weights for policy 1, policy_version 1369671 (0.0010) [2023-12-28 05:04:47,290][106225] Updated weights for policy 1, policy_version 1369681 (0.0010) [2023-12-28 05:04:47,436][106226] Updated weights for policy 0, policy_version 1366308 (0.0007) [2023-12-28 05:04:47,495][106226] Updated weights for policy 0, policy_version 1366318 (0.0010) [2023-12-28 05:04:47,561][106226] Updated weights for policy 0, policy_version 1366328 (0.0010) [2023-12-28 05:04:47,998][106225] Updated weights for policy 1, policy_version 1369691 (0.0010) [2023-12-28 05:04:48,051][106225] Updated weights for policy 1, policy_version 1369701 (0.0010) [2023-12-28 05:04:48,101][106225] Updated weights for policy 1, policy_version 1369711 (0.0010) [2023-12-28 05:04:48,266][106226] Updated weights for policy 0, policy_version 1366338 (0.0011) [2023-12-28 05:04:48,330][106226] Updated weights for policy 0, policy_version 1366348 (0.0011) [2023-12-28 05:04:48,396][106226] Updated weights for policy 0, policy_version 1366358 (0.0009) [2023-12-28 05:04:48,461][106226] Updated weights for policy 0, policy_version 1366368 (0.0007) [2023-12-28 05:04:48,850][106225] Updated weights for policy 1, policy_version 1369721 (0.0010) [2023-12-28 05:04:48,919][106225] Updated weights for policy 1, policy_version 1369731 (0.0011) [2023-12-28 05:04:48,977][106225] Updated weights for policy 1, policy_version 1369741 (0.0010) [2023-12-28 05:04:49,030][106225] Updated weights for policy 1, policy_version 1369751 (0.0010) [2023-12-28 05:04:49,135][106226] Updated weights for policy 0, policy_version 1366378 (0.0010) [2023-12-28 05:04:49,184][106226] Updated weights for policy 0, policy_version 1366388 (0.0010) [2023-12-28 05:04:49,244][106226] Updated weights for policy 0, policy_version 1366398 (0.0010) [2023-12-28 05:04:49,773][106225] Updated weights for policy 1, policy_version 1369761 (0.0010) [2023-12-28 05:04:49,836][106225] Updated weights for policy 1, policy_version 1369771 (0.0010) [2023-12-28 05:04:49,901][106225] Updated weights for policy 1, policy_version 1369781 (0.0010) [2023-12-28 05:04:50,002][106226] Updated weights for policy 0, policy_version 1366408 (0.0006) [2023-12-28 05:04:50,072][106226] Updated weights for policy 0, policy_version 1366418 (0.0006) [2023-12-28 05:04:50,138][106226] Updated weights for policy 0, policy_version 1366428 (0.0006) [2023-12-28 05:04:50,631][106225] Updated weights for policy 1, policy_version 1369791 (0.0009) [2023-12-28 05:04:50,691][106225] Updated weights for policy 1, policy_version 1369801 (0.0008) [2023-12-28 05:04:50,756][106225] Updated weights for policy 1, policy_version 1369811 (0.0008) [2023-12-28 05:04:50,774][106226] Updated weights for policy 0, policy_version 1366438 (0.0006) [2023-12-28 05:04:50,833][106226] Updated weights for policy 0, policy_version 1366448 (0.0006) [2023-12-28 05:04:50,897][106226] Updated weights for policy 0, policy_version 1366458 (0.0008) [2023-12-28 05:04:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 700604416. Throughput: 0: 9668.9, 1: 9994.7. Samples: 700612408. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:51,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.749')] [2023-12-28 05:04:51,521][106225] Updated weights for policy 1, policy_version 1369821 (0.0008) [2023-12-28 05:04:51,581][106225] Updated weights for policy 1, policy_version 1369831 (0.0008) [2023-12-28 05:04:51,630][106226] Updated weights for policy 0, policy_version 1366468 (0.0009) [2023-12-28 05:04:51,652][106225] Updated weights for policy 1, policy_version 1369841 (0.0009) [2023-12-28 05:04:51,691][106226] Updated weights for policy 0, policy_version 1366478 (0.0007) [2023-12-28 05:04:51,758][106226] Updated weights for policy 0, policy_version 1366488 (0.0008) [2023-12-28 05:04:52,374][106225] Updated weights for policy 1, policy_version 1369851 (0.0008) [2023-12-28 05:04:52,428][106225] Updated weights for policy 1, policy_version 1369861 (0.0008) [2023-12-28 05:04:52,472][106226] Updated weights for policy 0, policy_version 1366498 (0.0008) [2023-12-28 05:04:52,485][106225] Updated weights for policy 1, policy_version 1369871 (0.0009) [2023-12-28 05:04:52,530][106226] Updated weights for policy 0, policy_version 1366508 (0.0006) [2023-12-28 05:04:52,590][106226] Updated weights for policy 0, policy_version 1366518 (0.0007) [2023-12-28 05:04:52,652][106226] Updated weights for policy 0, policy_version 1366528 (0.0006) [2023-12-28 05:04:53,086][106225] Updated weights for policy 1, policy_version 1369881 (0.0008) [2023-12-28 05:04:53,135][106225] Updated weights for policy 1, policy_version 1369891 (0.0006) [2023-12-28 05:04:53,186][106225] Updated weights for policy 1, policy_version 1369901 (0.0005) [2023-12-28 05:04:53,245][106225] Updated weights for policy 1, policy_version 1369911 (0.0007) [2023-12-28 05:04:53,349][106226] Updated weights for policy 0, policy_version 1366538 (0.0005) [2023-12-28 05:04:53,398][106226] Updated weights for policy 0, policy_version 1366548 (0.0005) [2023-12-28 05:04:53,446][106226] Updated weights for policy 0, policy_version 1366558 (0.0005) [2023-12-28 05:04:53,941][106225] Updated weights for policy 1, policy_version 1369921 (0.0008) [2023-12-28 05:04:54,000][106225] Updated weights for policy 1, policy_version 1369931 (0.0008) [2023-12-28 05:04:54,006][106226] Updated weights for policy 0, policy_version 1366568 (0.0007) [2023-12-28 05:04:54,058][106225] Updated weights for policy 1, policy_version 1369941 (0.0005) [2023-12-28 05:04:54,060][106226] Updated weights for policy 0, policy_version 1366578 (0.0005) [2023-12-28 05:04:54,117][106226] Updated weights for policy 0, policy_version 1366588 (0.0006) [2023-12-28 05:04:54,709][106225] Updated weights for policy 1, policy_version 1369951 (0.0008) [2023-12-28 05:04:54,765][106225] Updated weights for policy 1, policy_version 1369961 (0.0008) [2023-12-28 05:04:54,809][106226] Updated weights for policy 0, policy_version 1366598 (0.0008) [2023-12-28 05:04:54,831][106225] Updated weights for policy 1, policy_version 1369971 (0.0007) [2023-12-28 05:04:54,860][106226] Updated weights for policy 0, policy_version 1366608 (0.0006) [2023-12-28 05:04:54,908][106226] Updated weights for policy 0, policy_version 1366618 (0.0008) [2023-12-28 05:04:55,512][106226] Updated weights for policy 0, policy_version 1366628 (0.0006) [2023-12-28 05:04:55,560][106226] Updated weights for policy 0, policy_version 1366638 (0.0008) [2023-12-28 05:04:55,609][106226] Updated weights for policy 0, policy_version 1366648 (0.0008) [2023-12-28 05:04:55,610][106225] Updated weights for policy 1, policy_version 1369981 (0.0008) [2023-12-28 05:04:55,656][106225] Updated weights for policy 1, policy_version 1369991 (0.0006) [2023-12-28 05:04:55,716][106225] Updated weights for policy 1, policy_version 1370001 (0.0009) [2023-12-28 05:04:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 700702720. Throughput: 0: 9708.9, 1: 9962.4. Samples: 700672940. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:04:56,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.521')] [2023-12-28 05:04:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001370008_350773248.pth... [2023-12-28 05:04:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001366656_349929472.pth... [2023-12-28 05:04:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001368856_350478336.pth [2023-12-28 05:04:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001365504_349634560.pth [2023-12-28 05:04:56,297][106226] Updated weights for policy 0, policy_version 1366658 (0.0006) [2023-12-28 05:04:56,357][106226] Updated weights for policy 0, policy_version 1366668 (0.0005) [2023-12-28 05:04:56,412][106226] Updated weights for policy 0, policy_version 1366678 (0.0005) [2023-12-28 05:04:56,463][106226] Updated weights for policy 0, policy_version 1366688 (0.0007) [2023-12-28 05:04:56,464][106225] Updated weights for policy 1, policy_version 1370011 (0.0009) [2023-12-28 05:04:56,528][106225] Updated weights for policy 1, policy_version 1370021 (0.0007) [2023-12-28 05:04:56,588][106225] Updated weights for policy 1, policy_version 1370031 (0.0007) [2023-12-28 05:04:56,968][106226] Updated weights for policy 0, policy_version 1366698 (0.0005) [2023-12-28 05:04:57,030][106226] Updated weights for policy 0, policy_version 1366708 (0.0005) [2023-12-28 05:04:57,084][106226] Updated weights for policy 0, policy_version 1366718 (0.0005) [2023-12-28 05:04:57,414][106225] Updated weights for policy 1, policy_version 1370041 (0.0009) [2023-12-28 05:04:57,469][106225] Updated weights for policy 1, policy_version 1370051 (0.0008) [2023-12-28 05:04:57,525][106225] Updated weights for policy 1, policy_version 1370061 (0.0008) [2023-12-28 05:04:57,574][106225] Updated weights for policy 1, policy_version 1370071 (0.0005) [2023-12-28 05:04:57,660][106226] Updated weights for policy 0, policy_version 1366728 (0.0005) [2023-12-28 05:04:57,721][106226] Updated weights for policy 0, policy_version 1366738 (0.0005) [2023-12-28 05:04:57,767][106226] Updated weights for policy 0, policy_version 1366748 (0.0005) [2023-12-28 05:04:58,149][106225] Updated weights for policy 1, policy_version 1370081 (0.0007) [2023-12-28 05:04:58,195][106225] Updated weights for policy 1, policy_version 1370091 (0.0006) [2023-12-28 05:04:58,262][106225] Updated weights for policy 1, policy_version 1370101 (0.0008) [2023-12-28 05:04:58,429][106226] Updated weights for policy 0, policy_version 1366758 (0.0007) [2023-12-28 05:04:58,501][106226] Updated weights for policy 0, policy_version 1366768 (0.0007) [2023-12-28 05:04:58,567][106226] Updated weights for policy 0, policy_version 1366778 (0.0008) [2023-12-28 05:04:59,113][106225] Updated weights for policy 1, policy_version 1370111 (0.0008) [2023-12-28 05:04:59,173][106225] Updated weights for policy 1, policy_version 1370121 (0.0008) [2023-12-28 05:04:59,249][106225] Updated weights for policy 1, policy_version 1370131 (0.0007) [2023-12-28 05:04:59,394][106226] Updated weights for policy 0, policy_version 1366788 (0.0009) [2023-12-28 05:04:59,455][106226] Updated weights for policy 0, policy_version 1366798 (0.0008) [2023-12-28 05:04:59,521][106226] Updated weights for policy 0, policy_version 1366808 (0.0008) [2023-12-28 05:05:00,021][106225] Updated weights for policy 1, policy_version 1370141 (0.0008) [2023-12-28 05:05:00,073][106225] Updated weights for policy 1, policy_version 1370151 (0.0008) [2023-12-28 05:05:00,125][106225] Updated weights for policy 1, policy_version 1370161 (0.0008) [2023-12-28 05:05:00,277][106226] Updated weights for policy 0, policy_version 1366818 (0.0009) [2023-12-28 05:05:00,335][106226] Updated weights for policy 0, policy_version 1366828 (0.0010) [2023-12-28 05:05:00,401][106226] Updated weights for policy 0, policy_version 1366838 (0.0011) [2023-12-28 05:05:00,454][106226] Updated weights for policy 0, policy_version 1366848 (0.0011) [2023-12-28 05:05:00,833][106225] Updated weights for policy 1, policy_version 1370171 (0.0007) [2023-12-28 05:05:00,888][106225] Updated weights for policy 1, policy_version 1370181 (0.0006) [2023-12-28 05:05:00,944][106225] Updated weights for policy 1, policy_version 1370191 (0.0010) [2023-12-28 05:05:01,139][106226] Updated weights for policy 0, policy_version 1366858 (0.0010) [2023-12-28 05:05:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 700801024. Throughput: 0: 9819.5, 1: 9910.5. Samples: 700792188. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:01,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.591')] [2023-12-28 05:05:01,207][106226] Updated weights for policy 0, policy_version 1366868 (0.0009) [2023-12-28 05:05:01,272][106226] Updated weights for policy 0, policy_version 1366878 (0.0008) [2023-12-28 05:05:01,738][106225] Updated weights for policy 1, policy_version 1370201 (0.0010) [2023-12-28 05:05:01,797][106225] Updated weights for policy 1, policy_version 1370211 (0.0008) [2023-12-28 05:05:01,859][106225] Updated weights for policy 1, policy_version 1370221 (0.0008) [2023-12-28 05:05:01,923][106225] Updated weights for policy 1, policy_version 1370231 (0.0006) [2023-12-28 05:05:01,925][106226] Updated weights for policy 0, policy_version 1366888 (0.0010) [2023-12-28 05:05:01,985][106226] Updated weights for policy 0, policy_version 1366898 (0.0011) [2023-12-28 05:05:02,047][106226] Updated weights for policy 0, policy_version 1366908 (0.0011) [2023-12-28 05:05:02,626][106225] Updated weights for policy 1, policy_version 1370241 (0.0010) [2023-12-28 05:05:02,683][106225] Updated weights for policy 1, policy_version 1370251 (0.0009) [2023-12-28 05:05:02,742][106225] Updated weights for policy 1, policy_version 1370261 (0.0007) [2023-12-28 05:05:02,749][106226] Updated weights for policy 0, policy_version 1366918 (0.0011) [2023-12-28 05:05:02,805][106226] Updated weights for policy 0, policy_version 1366928 (0.0010) [2023-12-28 05:05:02,868][106226] Updated weights for policy 0, policy_version 1366938 (0.0011) [2023-12-28 05:05:03,461][106225] Updated weights for policy 1, policy_version 1370271 (0.0009) [2023-12-28 05:05:03,523][106225] Updated weights for policy 1, policy_version 1370281 (0.0010) [2023-12-28 05:05:03,575][106226] Updated weights for policy 0, policy_version 1366948 (0.0010) [2023-12-28 05:05:03,585][106225] Updated weights for policy 1, policy_version 1370291 (0.0010) [2023-12-28 05:05:03,624][106226] Updated weights for policy 0, policy_version 1366958 (0.0010) [2023-12-28 05:05:03,676][106226] Updated weights for policy 0, policy_version 1366968 (0.0010) [2023-12-28 05:05:04,246][106225] Updated weights for policy 1, policy_version 1370301 (0.0011) [2023-12-28 05:05:04,305][106225] Updated weights for policy 1, policy_version 1370311 (0.0011) [2023-12-28 05:05:04,370][106225] Updated weights for policy 1, policy_version 1370321 (0.0010) [2023-12-28 05:05:04,389][106226] Updated weights for policy 0, policy_version 1366978 (0.0010) [2023-12-28 05:05:04,452][106226] Updated weights for policy 0, policy_version 1366988 (0.0010) [2023-12-28 05:05:04,515][106226] Updated weights for policy 0, policy_version 1366998 (0.0011) [2023-12-28 05:05:04,578][106226] Updated weights for policy 0, policy_version 1367008 (0.0011) [2023-12-28 05:05:04,992][106225] Updated weights for policy 1, policy_version 1370331 (0.0010) [2023-12-28 05:05:05,043][106225] Updated weights for policy 1, policy_version 1370341 (0.0010) [2023-12-28 05:05:05,094][106225] Updated weights for policy 1, policy_version 1370351 (0.0009) [2023-12-28 05:05:05,177][106226] Updated weights for policy 0, policy_version 1367018 (0.0007) [2023-12-28 05:05:05,238][106226] Updated weights for policy 0, policy_version 1367028 (0.0006) [2023-12-28 05:05:05,295][106226] Updated weights for policy 0, policy_version 1367038 (0.0005) [2023-12-28 05:05:05,788][106225] Updated weights for policy 1, policy_version 1370361 (0.0005) [2023-12-28 05:05:05,858][106225] Updated weights for policy 1, policy_version 1370371 (0.0008) [2023-12-28 05:05:05,888][106226] Updated weights for policy 0, policy_version 1367048 (0.0006) [2023-12-28 05:05:05,914][106225] Updated weights for policy 1, policy_version 1370381 (0.0011) [2023-12-28 05:05:05,943][106226] Updated weights for policy 0, policy_version 1367058 (0.0006) [2023-12-28 05:05:05,976][106225] Updated weights for policy 1, policy_version 1370391 (0.0010) [2023-12-28 05:05:06,005][106226] Updated weights for policy 0, policy_version 1367068 (0.0006) [2023-12-28 05:05:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 700907520. Throughput: 0: 9921.6, 1: 9881.7. Samples: 700912800. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:06,175][105115] Avg episode reward: [(0, '-4.311'), (1, '-4.427')] [2023-12-28 05:05:06,724][106225] Updated weights for policy 1, policy_version 1370401 (0.0010) [2023-12-28 05:05:06,746][106226] Updated weights for policy 0, policy_version 1367078 (0.0006) [2023-12-28 05:05:06,782][106225] Updated weights for policy 1, policy_version 1370411 (0.0010) [2023-12-28 05:05:06,798][106226] Updated weights for policy 0, policy_version 1367088 (0.0009) [2023-12-28 05:05:06,839][106225] Updated weights for policy 1, policy_version 1370421 (0.0010) [2023-12-28 05:05:06,849][106226] Updated weights for policy 0, policy_version 1367098 (0.0005) [2023-12-28 05:05:07,559][106225] Updated weights for policy 1, policy_version 1370431 (0.0010) [2023-12-28 05:05:07,597][106226] Updated weights for policy 0, policy_version 1367108 (0.0007) [2023-12-28 05:05:07,607][106225] Updated weights for policy 1, policy_version 1370441 (0.0010) [2023-12-28 05:05:07,645][106226] Updated weights for policy 0, policy_version 1367118 (0.0006) [2023-12-28 05:05:07,668][106225] Updated weights for policy 1, policy_version 1370451 (0.0010) [2023-12-28 05:05:07,694][106226] Updated weights for policy 0, policy_version 1367128 (0.0007) [2023-12-28 05:05:08,359][106225] Updated weights for policy 1, policy_version 1370461 (0.0009) [2023-12-28 05:05:08,362][106226] Updated weights for policy 0, policy_version 1367138 (0.0008) [2023-12-28 05:05:08,419][106225] Updated weights for policy 1, policy_version 1370471 (0.0008) [2023-12-28 05:05:08,424][106226] Updated weights for policy 0, policy_version 1367148 (0.0011) [2023-12-28 05:05:08,477][106225] Updated weights for policy 1, policy_version 1370481 (0.0007) [2023-12-28 05:05:08,484][106226] Updated weights for policy 0, policy_version 1367158 (0.0010) [2023-12-28 05:05:08,549][106226] Updated weights for policy 0, policy_version 1367168 (0.0011) [2023-12-28 05:05:09,075][106225] Updated weights for policy 1, policy_version 1370491 (0.0007) [2023-12-28 05:05:09,129][106225] Updated weights for policy 1, policy_version 1370501 (0.0006) [2023-12-28 05:05:09,182][106225] Updated weights for policy 1, policy_version 1370511 (0.0010) [2023-12-28 05:05:09,204][106226] Updated weights for policy 0, policy_version 1367178 (0.0010) [2023-12-28 05:05:09,267][106226] Updated weights for policy 0, policy_version 1367188 (0.0008) [2023-12-28 05:05:09,326][106226] Updated weights for policy 0, policy_version 1367198 (0.0009) [2023-12-28 05:05:09,905][106225] Updated weights for policy 1, policy_version 1370521 (0.0009) [2023-12-28 05:05:09,977][106225] Updated weights for policy 1, policy_version 1370531 (0.0009) [2023-12-28 05:05:09,997][106226] Updated weights for policy 0, policy_version 1367208 (0.0010) [2023-12-28 05:05:10,039][106225] Updated weights for policy 1, policy_version 1370541 (0.0007) [2023-12-28 05:05:10,065][106226] Updated weights for policy 0, policy_version 1367218 (0.0007) [2023-12-28 05:05:10,107][106225] Updated weights for policy 1, policy_version 1370551 (0.0008) [2023-12-28 05:05:10,135][106226] Updated weights for policy 0, policy_version 1367228 (0.0008) [2023-12-28 05:05:10,752][106225] Updated weights for policy 1, policy_version 1370561 (0.0008) [2023-12-28 05:05:10,808][106225] Updated weights for policy 1, policy_version 1370571 (0.0008) [2023-12-28 05:05:10,845][106226] Updated weights for policy 0, policy_version 1367238 (0.0007) [2023-12-28 05:05:10,864][106225] Updated weights for policy 1, policy_version 1370581 (0.0007) [2023-12-28 05:05:10,902][106226] Updated weights for policy 0, policy_version 1367248 (0.0009) [2023-12-28 05:05:10,952][106226] Updated weights for policy 0, policy_version 1367258 (0.0009) [2023-12-28 05:05:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 701005824. Throughput: 0: 9947.1, 1: 9909.2. Samples: 700971692. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:11,175][105115] Avg episode reward: [(0, '-4.195'), (1, '-4.591')] [2023-12-28 05:05:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001370584_350920704.pth... [2023-12-28 05:05:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001367264_350085120.pth... [2023-12-28 05:05:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001369432_350625792.pth [2023-12-28 05:05:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001366080_349782016.pth [2023-12-28 05:05:11,591][106225] Updated weights for policy 1, policy_version 1370591 (0.0007) [2023-12-28 05:05:11,653][106225] Updated weights for policy 1, policy_version 1370601 (0.0007) [2023-12-28 05:05:11,723][106225] Updated weights for policy 1, policy_version 1370611 (0.0010) [2023-12-28 05:05:11,799][106226] Updated weights for policy 0, policy_version 1367268 (0.0007) [2023-12-28 05:05:11,863][106226] Updated weights for policy 0, policy_version 1367278 (0.0006) [2023-12-28 05:05:11,924][106226] Updated weights for policy 0, policy_version 1367288 (0.0008) [2023-12-28 05:05:12,445][106225] Updated weights for policy 1, policy_version 1370621 (0.0007) [2023-12-28 05:05:12,505][106225] Updated weights for policy 1, policy_version 1370631 (0.0006) [2023-12-28 05:05:12,559][106225] Updated weights for policy 1, policy_version 1370641 (0.0005) [2023-12-28 05:05:12,634][106226] Updated weights for policy 0, policy_version 1367298 (0.0009) [2023-12-28 05:05:12,701][106226] Updated weights for policy 0, policy_version 1367308 (0.0009) [2023-12-28 05:05:12,761][106226] Updated weights for policy 0, policy_version 1367318 (0.0008) [2023-12-28 05:05:12,822][106226] Updated weights for policy 0, policy_version 1367328 (0.0006) [2023-12-28 05:05:13,193][106225] Updated weights for policy 1, policy_version 1370651 (0.0006) [2023-12-28 05:05:13,251][106225] Updated weights for policy 1, policy_version 1370661 (0.0009) [2023-12-28 05:05:13,306][106225] Updated weights for policy 1, policy_version 1370671 (0.0008) [2023-12-28 05:05:13,469][106226] Updated weights for policy 0, policy_version 1367338 (0.0005) [2023-12-28 05:05:13,524][106226] Updated weights for policy 0, policy_version 1367348 (0.0005) [2023-12-28 05:05:13,578][106226] Updated weights for policy 0, policy_version 1367358 (0.0005) [2023-12-28 05:05:13,992][106225] Updated weights for policy 1, policy_version 1370681 (0.0006) [2023-12-28 05:05:14,044][106225] Updated weights for policy 1, policy_version 1370691 (0.0009) [2023-12-28 05:05:14,097][106225] Updated weights for policy 1, policy_version 1370701 (0.0006) [2023-12-28 05:05:14,152][106225] Updated weights for policy 1, policy_version 1370711 (0.0005) [2023-12-28 05:05:14,202][106226] Updated weights for policy 0, policy_version 1367368 (0.0007) [2023-12-28 05:05:14,265][106226] Updated weights for policy 0, policy_version 1367378 (0.0008) [2023-12-28 05:05:14,327][106226] Updated weights for policy 0, policy_version 1367388 (0.0008) [2023-12-28 05:05:14,788][106225] Updated weights for policy 1, policy_version 1370721 (0.0007) [2023-12-28 05:05:14,851][106225] Updated weights for policy 1, policy_version 1370731 (0.0007) [2023-12-28 05:05:14,915][106225] Updated weights for policy 1, policy_version 1370741 (0.0009) [2023-12-28 05:05:15,108][106226] Updated weights for policy 0, policy_version 1367398 (0.0008) [2023-12-28 05:05:15,172][106226] Updated weights for policy 0, policy_version 1367408 (0.0008) [2023-12-28 05:05:15,238][106226] Updated weights for policy 0, policy_version 1367418 (0.0008) [2023-12-28 05:05:15,656][106225] Updated weights for policy 1, policy_version 1370751 (0.0009) [2023-12-28 05:05:15,709][106225] Updated weights for policy 1, policy_version 1370761 (0.0008) [2023-12-28 05:05:15,765][106225] Updated weights for policy 1, policy_version 1370771 (0.0008) [2023-12-28 05:05:15,894][106226] Updated weights for policy 0, policy_version 1367428 (0.0009) [2023-12-28 05:05:15,945][106226] Updated weights for policy 0, policy_version 1367438 (0.0011) [2023-12-28 05:05:15,998][106226] Updated weights for policy 0, policy_version 1367448 (0.0006) [2023-12-28 05:05:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 701104128. Throughput: 0: 9973.7, 1: 9812.7. Samples: 701091704. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:16,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.493')] [2023-12-28 05:05:16,498][106225] Updated weights for policy 1, policy_version 1370781 (0.0008) [2023-12-28 05:05:16,565][106225] Updated weights for policy 1, policy_version 1370791 (0.0007) [2023-12-28 05:05:16,631][106225] Updated weights for policy 1, policy_version 1370801 (0.0006) [2023-12-28 05:05:16,717][106226] Updated weights for policy 0, policy_version 1367458 (0.0008) [2023-12-28 05:05:16,784][106226] Updated weights for policy 0, policy_version 1367468 (0.0009) [2023-12-28 05:05:16,836][106226] Updated weights for policy 0, policy_version 1367478 (0.0007) [2023-12-28 05:05:16,890][106226] Updated weights for policy 0, policy_version 1367488 (0.0005) [2023-12-28 05:05:17,252][106225] Updated weights for policy 1, policy_version 1370811 (0.0007) [2023-12-28 05:05:17,318][106225] Updated weights for policy 1, policy_version 1370821 (0.0010) [2023-12-28 05:05:17,383][106225] Updated weights for policy 1, policy_version 1370831 (0.0010) [2023-12-28 05:05:17,486][106226] Updated weights for policy 0, policy_version 1367498 (0.0007) [2023-12-28 05:05:17,544][106226] Updated weights for policy 0, policy_version 1367508 (0.0008) [2023-12-28 05:05:17,602][106226] Updated weights for policy 0, policy_version 1367518 (0.0008) [2023-12-28 05:05:18,070][106225] Updated weights for policy 1, policy_version 1370841 (0.0010) [2023-12-28 05:05:18,127][106225] Updated weights for policy 1, policy_version 1370851 (0.0005) [2023-12-28 05:05:18,186][106225] Updated weights for policy 1, policy_version 1370861 (0.0005) [2023-12-28 05:05:18,255][106225] Updated weights for policy 1, policy_version 1370871 (0.0006) [2023-12-28 05:05:18,316][106226] Updated weights for policy 0, policy_version 1367528 (0.0006) [2023-12-28 05:05:18,381][106226] Updated weights for policy 0, policy_version 1367538 (0.0007) [2023-12-28 05:05:18,435][106226] Updated weights for policy 0, policy_version 1367548 (0.0007) [2023-12-28 05:05:18,872][106225] Updated weights for policy 1, policy_version 1370881 (0.0008) [2023-12-28 05:05:18,932][106225] Updated weights for policy 1, policy_version 1370891 (0.0008) [2023-12-28 05:05:18,990][106225] Updated weights for policy 1, policy_version 1370901 (0.0007) [2023-12-28 05:05:19,040][106226] Updated weights for policy 0, policy_version 1367558 (0.0008) [2023-12-28 05:05:19,094][106226] Updated weights for policy 0, policy_version 1367568 (0.0008) [2023-12-28 05:05:19,159][106226] Updated weights for policy 0, policy_version 1367578 (0.0008) [2023-12-28 05:05:19,680][106225] Updated weights for policy 1, policy_version 1370911 (0.0008) [2023-12-28 05:05:19,742][106225] Updated weights for policy 1, policy_version 1370921 (0.0009) [2023-12-28 05:05:19,805][106225] Updated weights for policy 1, policy_version 1370931 (0.0008) [2023-12-28 05:05:19,870][106226] Updated weights for policy 0, policy_version 1367588 (0.0008) [2023-12-28 05:05:19,936][106226] Updated weights for policy 0, policy_version 1367598 (0.0009) [2023-12-28 05:05:19,991][106226] Updated weights for policy 0, policy_version 1367608 (0.0009) [2023-12-28 05:05:20,549][106225] Updated weights for policy 1, policy_version 1370941 (0.0009) [2023-12-28 05:05:20,614][106225] Updated weights for policy 1, policy_version 1370951 (0.0008) [2023-12-28 05:05:20,670][106225] Updated weights for policy 1, policy_version 1370961 (0.0009) [2023-12-28 05:05:20,737][106226] Updated weights for policy 0, policy_version 1367618 (0.0009) [2023-12-28 05:05:20,802][106226] Updated weights for policy 0, policy_version 1367628 (0.0006) [2023-12-28 05:05:20,862][106226] Updated weights for policy 0, policy_version 1367638 (0.0006) [2023-12-28 05:05:20,926][106226] Updated weights for policy 0, policy_version 1367648 (0.0009) [2023-12-28 05:05:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 701202432. Throughput: 0: 9989.6, 1: 9802.7. Samples: 701210632. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:21,175][105115] Avg episode reward: [(0, '-4.776'), (1, '-4.578')] [2023-12-28 05:05:21,522][106225] Updated weights for policy 1, policy_version 1370971 (0.0007) [2023-12-28 05:05:21,588][106225] Updated weights for policy 1, policy_version 1370981 (0.0009) [2023-12-28 05:05:21,656][106225] Updated weights for policy 1, policy_version 1370991 (0.0008) [2023-12-28 05:05:21,681][106226] Updated weights for policy 0, policy_version 1367658 (0.0008) [2023-12-28 05:05:21,757][106226] Updated weights for policy 0, policy_version 1367668 (0.0008) [2023-12-28 05:05:21,825][106226] Updated weights for policy 0, policy_version 1367678 (0.0007) [2023-12-28 05:05:22,425][106225] Updated weights for policy 1, policy_version 1371001 (0.0007) [2023-12-28 05:05:22,499][106225] Updated weights for policy 1, policy_version 1371011 (0.0009) [2023-12-28 05:05:22,561][106225] Updated weights for policy 1, policy_version 1371021 (0.0010) [2023-12-28 05:05:22,594][106226] Updated weights for policy 0, policy_version 1367688 (0.0009) [2023-12-28 05:05:22,620][106225] Updated weights for policy 1, policy_version 1371031 (0.0008) [2023-12-28 05:05:22,658][106226] Updated weights for policy 0, policy_version 1367698 (0.0008) [2023-12-28 05:05:22,728][106226] Updated weights for policy 0, policy_version 1367708 (0.0008) [2023-12-28 05:05:23,328][106226] Updated weights for policy 0, policy_version 1367718 (0.0006) [2023-12-28 05:05:23,349][106225] Updated weights for policy 1, policy_version 1371041 (0.0009) [2023-12-28 05:05:23,388][106226] Updated weights for policy 0, policy_version 1367728 (0.0006) [2023-12-28 05:05:23,407][106225] Updated weights for policy 1, policy_version 1371051 (0.0008) [2023-12-28 05:05:23,442][106226] Updated weights for policy 0, policy_version 1367738 (0.0005) [2023-12-28 05:05:23,464][106225] Updated weights for policy 1, policy_version 1371061 (0.0008) [2023-12-28 05:05:24,068][106226] Updated weights for policy 0, policy_version 1367748 (0.0006) [2023-12-28 05:05:24,126][106226] Updated weights for policy 0, policy_version 1367758 (0.0008) [2023-12-28 05:05:24,187][106226] Updated weights for policy 0, policy_version 1367768 (0.0008) [2023-12-28 05:05:24,212][106225] Updated weights for policy 1, policy_version 1371071 (0.0010) [2023-12-28 05:05:24,270][106225] Updated weights for policy 1, policy_version 1371081 (0.0010) [2023-12-28 05:05:24,335][106225] Updated weights for policy 1, policy_version 1371091 (0.0010) [2023-12-28 05:05:24,965][106226] Updated weights for policy 0, policy_version 1367778 (0.0006) [2023-12-28 05:05:24,992][106225] Updated weights for policy 1, policy_version 1371101 (0.0008) [2023-12-28 05:05:25,024][106226] Updated weights for policy 0, policy_version 1367788 (0.0008) [2023-12-28 05:05:25,054][106225] Updated weights for policy 1, policy_version 1371111 (0.0005) [2023-12-28 05:05:25,081][106226] Updated weights for policy 0, policy_version 1367798 (0.0008) [2023-12-28 05:05:25,110][106225] Updated weights for policy 1, policy_version 1371121 (0.0005) [2023-12-28 05:05:25,138][106226] Updated weights for policy 0, policy_version 1367808 (0.0008) [2023-12-28 05:05:25,764][106225] Updated weights for policy 1, policy_version 1371131 (0.0008) [2023-12-28 05:05:25,827][106225] Updated weights for policy 1, policy_version 1371141 (0.0010) [2023-12-28 05:05:25,852][106226] Updated weights for policy 0, policy_version 1367818 (0.0006) [2023-12-28 05:05:25,883][106225] Updated weights for policy 1, policy_version 1371151 (0.0010) [2023-12-28 05:05:25,912][106226] Updated weights for policy 0, policy_version 1367828 (0.0007) [2023-12-28 05:05:25,974][106226] Updated weights for policy 0, policy_version 1367838 (0.0007) [2023-12-28 05:05:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 701300736. Throughput: 0: 10032.5, 1: 9738.1. Samples: 701267540. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:26,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.223')] [2023-12-28 05:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001371160_351068160.pth... [2023-12-28 05:05:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001367840_350232576.pth... [2023-12-28 05:05:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001370008_350773248.pth [2023-12-28 05:05:26,186][106141] Saving new best policy, reward=-4.223! [2023-12-28 05:05:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001366656_349929472.pth [2023-12-28 05:05:26,549][106225] Updated weights for policy 1, policy_version 1371161 (0.0010) [2023-12-28 05:05:26,600][106225] Updated weights for policy 1, policy_version 1371171 (0.0005) [2023-12-28 05:05:26,663][106225] Updated weights for policy 1, policy_version 1371181 (0.0009) [2023-12-28 05:05:26,699][106226] Updated weights for policy 0, policy_version 1367848 (0.0006) [2023-12-28 05:05:26,723][106225] Updated weights for policy 1, policy_version 1371191 (0.0010) [2023-12-28 05:05:26,749][106226] Updated weights for policy 0, policy_version 1367858 (0.0007) [2023-12-28 05:05:26,795][106226] Updated weights for policy 0, policy_version 1367868 (0.0008) [2023-12-28 05:05:27,287][106225] Updated weights for policy 1, policy_version 1371201 (0.0006) [2023-12-28 05:05:27,343][106225] Updated weights for policy 1, policy_version 1371211 (0.0005) [2023-12-28 05:05:27,397][106225] Updated weights for policy 1, policy_version 1371221 (0.0005) [2023-12-28 05:05:27,622][106226] Updated weights for policy 0, policy_version 1367878 (0.0008) [2023-12-28 05:05:27,684][106226] Updated weights for policy 0, policy_version 1367888 (0.0008) [2023-12-28 05:05:27,737][106226] Updated weights for policy 0, policy_version 1367898 (0.0007) [2023-12-28 05:05:28,020][106225] Updated weights for policy 1, policy_version 1371231 (0.0009) [2023-12-28 05:05:28,063][106225] Updated weights for policy 1, policy_version 1371241 (0.0010) [2023-12-28 05:05:28,109][106225] Updated weights for policy 1, policy_version 1371251 (0.0010) [2023-12-28 05:05:28,465][106226] Updated weights for policy 0, policy_version 1367908 (0.0008) [2023-12-28 05:05:28,512][106226] Updated weights for policy 0, policy_version 1367918 (0.0008) [2023-12-28 05:05:28,568][106226] Updated weights for policy 0, policy_version 1367928 (0.0008) [2023-12-28 05:05:28,805][106225] Updated weights for policy 1, policy_version 1371261 (0.0008) [2023-12-28 05:05:28,862][106225] Updated weights for policy 1, policy_version 1371271 (0.0008) [2023-12-28 05:05:28,914][106225] Updated weights for policy 1, policy_version 1371281 (0.0008) [2023-12-28 05:05:29,338][106226] Updated weights for policy 0, policy_version 1367938 (0.0009) [2023-12-28 05:05:29,405][106226] Updated weights for policy 0, policy_version 1367948 (0.0006) [2023-12-28 05:05:29,463][106226] Updated weights for policy 0, policy_version 1367958 (0.0006) [2023-12-28 05:05:29,522][106226] Updated weights for policy 0, policy_version 1367968 (0.0009) [2023-12-28 05:05:29,550][106225] Updated weights for policy 1, policy_version 1371291 (0.0009) [2023-12-28 05:05:29,604][106225] Updated weights for policy 1, policy_version 1371301 (0.0010) [2023-12-28 05:05:29,666][106225] Updated weights for policy 1, policy_version 1371311 (0.0010) [2023-12-28 05:05:30,235][106226] Updated weights for policy 0, policy_version 1367978 (0.0008) [2023-12-28 05:05:30,296][106226] Updated weights for policy 0, policy_version 1367988 (0.0008) [2023-12-28 05:05:30,354][106226] Updated weights for policy 0, policy_version 1367998 (0.0007) [2023-12-28 05:05:30,423][106225] Updated weights for policy 1, policy_version 1371321 (0.0010) [2023-12-28 05:05:30,478][106225] Updated weights for policy 1, policy_version 1371331 (0.0010) [2023-12-28 05:05:30,540][106225] Updated weights for policy 1, policy_version 1371341 (0.0010) [2023-12-28 05:05:30,596][106225] Updated weights for policy 1, policy_version 1371351 (0.0008) [2023-12-28 05:05:31,011][106226] Updated weights for policy 0, policy_version 1368008 (0.0009) [2023-12-28 05:05:31,078][106226] Updated weights for policy 0, policy_version 1368018 (0.0008) [2023-12-28 05:05:31,144][106226] Updated weights for policy 0, policy_version 1368028 (0.0008) [2023-12-28 05:05:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 701399040. Throughput: 0: 9967.4, 1: 9858.3. Samples: 701386644. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:31,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-4.486')] [2023-12-28 05:05:31,352][106225] Updated weights for policy 1, policy_version 1371361 (0.0008) [2023-12-28 05:05:31,421][106225] Updated weights for policy 1, policy_version 1371371 (0.0008) [2023-12-28 05:05:31,484][106225] Updated weights for policy 1, policy_version 1371381 (0.0008) [2023-12-28 05:05:31,861][106226] Updated weights for policy 0, policy_version 1368038 (0.0007) [2023-12-28 05:05:31,920][106226] Updated weights for policy 0, policy_version 1368048 (0.0006) [2023-12-28 05:05:31,979][106226] Updated weights for policy 0, policy_version 1368058 (0.0007) [2023-12-28 05:05:32,299][106225] Updated weights for policy 1, policy_version 1371391 (0.0008) [2023-12-28 05:05:32,354][106225] Updated weights for policy 1, policy_version 1371401 (0.0009) [2023-12-28 05:05:32,420][106225] Updated weights for policy 1, policy_version 1371411 (0.0008) [2023-12-28 05:05:32,647][106226] Updated weights for policy 0, policy_version 1368068 (0.0007) [2023-12-28 05:05:32,698][106226] Updated weights for policy 0, policy_version 1368078 (0.0009) [2023-12-28 05:05:32,759][106226] Updated weights for policy 0, policy_version 1368088 (0.0008) [2023-12-28 05:05:33,058][106225] Updated weights for policy 1, policy_version 1371421 (0.0009) [2023-12-28 05:05:33,114][106225] Updated weights for policy 1, policy_version 1371431 (0.0009) [2023-12-28 05:05:33,165][106225] Updated weights for policy 1, policy_version 1371441 (0.0008) [2023-12-28 05:05:33,524][106226] Updated weights for policy 0, policy_version 1368098 (0.0009) [2023-12-28 05:05:33,584][106226] Updated weights for policy 0, policy_version 1368108 (0.0007) [2023-12-28 05:05:33,629][106226] Updated weights for policy 0, policy_version 1368118 (0.0009) [2023-12-28 05:05:33,678][106226] Updated weights for policy 0, policy_version 1368128 (0.0008) [2023-12-28 05:05:33,898][106225] Updated weights for policy 1, policy_version 1371451 (0.0008) [2023-12-28 05:05:33,953][106225] Updated weights for policy 1, policy_version 1371461 (0.0008) [2023-12-28 05:05:34,017][106225] Updated weights for policy 1, policy_version 1371471 (0.0008) [2023-12-28 05:05:34,377][106226] Updated weights for policy 0, policy_version 1368138 (0.0006) [2023-12-28 05:05:34,443][106226] Updated weights for policy 0, policy_version 1368148 (0.0006) [2023-12-28 05:05:34,508][106226] Updated weights for policy 0, policy_version 1368158 (0.0008) [2023-12-28 05:05:34,797][106225] Updated weights for policy 1, policy_version 1371481 (0.0008) [2023-12-28 05:05:34,849][106225] Updated weights for policy 1, policy_version 1371491 (0.0008) [2023-12-28 05:05:34,907][106225] Updated weights for policy 1, policy_version 1371501 (0.0010) [2023-12-28 05:05:34,968][106225] Updated weights for policy 1, policy_version 1371511 (0.0008) [2023-12-28 05:05:35,015][106226] Updated weights for policy 0, policy_version 1368168 (0.0005) [2023-12-28 05:05:35,077][106226] Updated weights for policy 0, policy_version 1368178 (0.0005) [2023-12-28 05:05:35,137][106226] Updated weights for policy 0, policy_version 1368188 (0.0005) [2023-12-28 05:05:35,642][106226] Updated weights for policy 0, policy_version 1368198 (0.0005) [2023-12-28 05:05:35,709][106226] Updated weights for policy 0, policy_version 1368208 (0.0008) [2023-12-28 05:05:35,760][106226] Updated weights for policy 0, policy_version 1368218 (0.0010) [2023-12-28 05:05:35,793][106225] Updated weights for policy 1, policy_version 1371521 (0.0005) [2023-12-28 05:05:35,856][106225] Updated weights for policy 1, policy_version 1371531 (0.0007) [2023-12-28 05:05:35,918][106225] Updated weights for policy 1, policy_version 1371541 (0.0006) [2023-12-28 05:05:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 701497344. Throughput: 0: 10024.2, 1: 9809.3. Samples: 701504916. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-28 05:05:36,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.689')] [2023-12-28 05:05:36,469][106226] Updated weights for policy 0, policy_version 1368228 (0.0011) [2023-12-28 05:05:36,533][106226] Updated weights for policy 0, policy_version 1368238 (0.0011) [2023-12-28 05:05:36,563][106225] Updated weights for policy 1, policy_version 1371551 (0.0007) [2023-12-28 05:05:36,591][106226] Updated weights for policy 0, policy_version 1368248 (0.0011) [2023-12-28 05:05:36,617][106225] Updated weights for policy 1, policy_version 1371561 (0.0008) [2023-12-28 05:05:36,678][106225] Updated weights for policy 1, policy_version 1371571 (0.0008) [2023-12-28 05:05:37,243][106226] Updated weights for policy 0, policy_version 1368258 (0.0011) [2023-12-28 05:05:37,305][106226] Updated weights for policy 0, policy_version 1368268 (0.0010) [2023-12-28 05:05:37,379][106226] Updated weights for policy 0, policy_version 1368278 (0.0010) [2023-12-28 05:05:37,389][106225] Updated weights for policy 1, policy_version 1371581 (0.0007) [2023-12-28 05:05:37,438][106226] Updated weights for policy 0, policy_version 1368288 (0.0010) [2023-12-28 05:05:37,443][106225] Updated weights for policy 1, policy_version 1371591 (0.0005) [2023-12-28 05:05:37,495][106225] Updated weights for policy 1, policy_version 1371601 (0.0005) [2023-12-28 05:05:38,101][106225] Updated weights for policy 1, policy_version 1371611 (0.0007) [2023-12-28 05:05:38,136][106226] Updated weights for policy 0, policy_version 1368298 (0.0011) [2023-12-28 05:05:38,155][106225] Updated weights for policy 1, policy_version 1371621 (0.0010) [2023-12-28 05:05:38,192][106226] Updated weights for policy 0, policy_version 1368308 (0.0010) [2023-12-28 05:05:38,205][106225] Updated weights for policy 1, policy_version 1371631 (0.0010) [2023-12-28 05:05:38,239][106226] Updated weights for policy 0, policy_version 1368318 (0.0010) [2023-12-28 05:05:38,886][106225] Updated weights for policy 1, policy_version 1371641 (0.0009) [2023-12-28 05:05:38,942][106226] Updated weights for policy 0, policy_version 1368328 (0.0011) [2023-12-28 05:05:38,945][106225] Updated weights for policy 1, policy_version 1371651 (0.0006) [2023-12-28 05:05:38,995][106225] Updated weights for policy 1, policy_version 1371661 (0.0007) [2023-12-28 05:05:39,001][106226] Updated weights for policy 0, policy_version 1368338 (0.0011) [2023-12-28 05:05:39,048][106225] Updated weights for policy 1, policy_version 1371671 (0.0008) [2023-12-28 05:05:39,059][106226] Updated weights for policy 0, policy_version 1368348 (0.0010) [2023-12-28 05:05:39,737][106226] Updated weights for policy 0, policy_version 1368358 (0.0010) [2023-12-28 05:05:39,781][106225] Updated weights for policy 1, policy_version 1371681 (0.0006) [2023-12-28 05:05:39,788][106226] Updated weights for policy 0, policy_version 1368368 (0.0006) [2023-12-28 05:05:39,846][106225] Updated weights for policy 1, policy_version 1371691 (0.0012) [2023-12-28 05:05:39,856][106226] Updated weights for policy 0, policy_version 1368378 (0.0009) [2023-12-28 05:05:39,907][106225] Updated weights for policy 1, policy_version 1371701 (0.0008) [2023-12-28 05:05:40,538][106226] Updated weights for policy 0, policy_version 1368388 (0.0008) [2023-12-28 05:05:40,603][106226] Updated weights for policy 0, policy_version 1368398 (0.0008) [2023-12-28 05:05:40,612][106225] Updated weights for policy 1, policy_version 1371711 (0.0008) [2023-12-28 05:05:40,672][106226] Updated weights for policy 0, policy_version 1368408 (0.0008) [2023-12-28 05:05:40,693][106225] Updated weights for policy 1, policy_version 1371721 (0.0006) [2023-12-28 05:05:40,753][106225] Updated weights for policy 1, policy_version 1371731 (0.0008) [2023-12-28 05:05:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 701595648. Throughput: 0: 10008.7, 1: 9834.2. Samples: 701565868. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:05:41,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.643')] [2023-12-28 05:05:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001371736_351215616.pth... [2023-12-28 05:05:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001368416_350380032.pth... [2023-12-28 05:05:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001370584_350920704.pth [2023-12-28 05:05:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001367264_350085120.pth [2023-12-28 05:05:41,302][106226] Updated weights for policy 0, policy_version 1368418 (0.0008) [2023-12-28 05:05:41,378][106226] Updated weights for policy 0, policy_version 1368428 (0.0009) [2023-12-28 05:05:41,445][106226] Updated weights for policy 0, policy_version 1368438 (0.0009) [2023-12-28 05:05:41,506][106226] Updated weights for policy 0, policy_version 1368448 (0.0009) [2023-12-28 05:05:41,553][106225] Updated weights for policy 1, policy_version 1371741 (0.0008) [2023-12-28 05:05:41,605][106225] Updated weights for policy 1, policy_version 1371751 (0.0008) [2023-12-28 05:05:41,677][106225] Updated weights for policy 1, policy_version 1371761 (0.0009) [2023-12-28 05:05:42,250][106226] Updated weights for policy 0, policy_version 1368458 (0.0009) [2023-12-28 05:05:42,314][106226] Updated weights for policy 0, policy_version 1368468 (0.0009) [2023-12-28 05:05:42,383][106226] Updated weights for policy 0, policy_version 1368478 (0.0009) [2023-12-28 05:05:42,446][106225] Updated weights for policy 1, policy_version 1371771 (0.0007) [2023-12-28 05:05:42,504][106225] Updated weights for policy 1, policy_version 1371781 (0.0006) [2023-12-28 05:05:42,564][106225] Updated weights for policy 1, policy_version 1371791 (0.0008) [2023-12-28 05:05:43,062][106226] Updated weights for policy 0, policy_version 1368488 (0.0006) [2023-12-28 05:05:43,113][106226] Updated weights for policy 0, policy_version 1368498 (0.0005) [2023-12-28 05:05:43,162][106226] Updated weights for policy 0, policy_version 1368508 (0.0005) [2023-12-28 05:05:43,282][106225] Updated weights for policy 1, policy_version 1371801 (0.0009) [2023-12-28 05:05:43,327][106225] Updated weights for policy 1, policy_version 1371811 (0.0007) [2023-12-28 05:05:43,380][106225] Updated weights for policy 1, policy_version 1371821 (0.0008) [2023-12-28 05:05:43,433][106225] Updated weights for policy 1, policy_version 1371831 (0.0008) [2023-12-28 05:05:43,809][106226] Updated weights for policy 0, policy_version 1368518 (0.0008) [2023-12-28 05:05:43,863][106226] Updated weights for policy 0, policy_version 1368528 (0.0008) [2023-12-28 05:05:43,927][106226] Updated weights for policy 0, policy_version 1368538 (0.0007) [2023-12-28 05:05:44,066][106225] Updated weights for policy 1, policy_version 1371841 (0.0010) [2023-12-28 05:05:44,123][106225] Updated weights for policy 1, policy_version 1371851 (0.0010) [2023-12-28 05:05:44,190][106225] Updated weights for policy 1, policy_version 1371861 (0.0005) [2023-12-28 05:05:44,611][106226] Updated weights for policy 0, policy_version 1368548 (0.0007) [2023-12-28 05:05:44,668][106226] Updated weights for policy 0, policy_version 1368558 (0.0009) [2023-12-28 05:05:44,725][106225] Updated weights for policy 1, policy_version 1371871 (0.0006) [2023-12-28 05:05:44,732][106226] Updated weights for policy 0, policy_version 1368568 (0.0008) [2023-12-28 05:05:44,784][106225] Updated weights for policy 1, policy_version 1371881 (0.0008) [2023-12-28 05:05:44,839][106225] Updated weights for policy 1, policy_version 1371891 (0.0008) [2023-12-28 05:05:45,501][106226] Updated weights for policy 0, policy_version 1368578 (0.0007) [2023-12-28 05:05:45,558][106226] Updated weights for policy 0, policy_version 1368588 (0.0008) [2023-12-28 05:05:45,576][106225] Updated weights for policy 1, policy_version 1371901 (0.0007) [2023-12-28 05:05:45,616][106226] Updated weights for policy 0, policy_version 1368598 (0.0008) [2023-12-28 05:05:45,634][106225] Updated weights for policy 1, policy_version 1371911 (0.0006) [2023-12-28 05:05:45,679][106226] Updated weights for policy 0, policy_version 1368608 (0.0007) [2023-12-28 05:05:45,689][106225] Updated weights for policy 1, policy_version 1371921 (0.0008) [2023-12-28 05:05:46,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 701693952. Throughput: 0: 9947.6, 1: 9881.7. Samples: 701684504. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:05:46,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-4.672')] [2023-12-28 05:05:46,318][106225] Updated weights for policy 1, policy_version 1371931 (0.0006) [2023-12-28 05:05:46,380][106225] Updated weights for policy 1, policy_version 1371941 (0.0005) [2023-12-28 05:05:46,430][106225] Updated weights for policy 1, policy_version 1371951 (0.0007) [2023-12-28 05:05:46,451][106226] Updated weights for policy 0, policy_version 1368618 (0.0007) [2023-12-28 05:05:46,506][106226] Updated weights for policy 0, policy_version 1368628 (0.0008) [2023-12-28 05:05:46,564][106226] Updated weights for policy 0, policy_version 1368638 (0.0008) [2023-12-28 05:05:47,137][106225] Updated weights for policy 1, policy_version 1371961 (0.0007) [2023-12-28 05:05:47,201][106225] Updated weights for policy 1, policy_version 1371971 (0.0007) [2023-12-28 05:05:47,229][106226] Updated weights for policy 0, policy_version 1368648 (0.0008) [2023-12-28 05:05:47,263][106225] Updated weights for policy 1, policy_version 1371981 (0.0006) [2023-12-28 05:05:47,288][106226] Updated weights for policy 0, policy_version 1368658 (0.0006) [2023-12-28 05:05:47,321][106225] Updated weights for policy 1, policy_version 1371991 (0.0007) [2023-12-28 05:05:47,342][106226] Updated weights for policy 0, policy_version 1368668 (0.0009) [2023-12-28 05:05:47,985][106225] Updated weights for policy 1, policy_version 1372001 (0.0007) [2023-12-28 05:05:48,015][106226] Updated weights for policy 0, policy_version 1368678 (0.0007) [2023-12-28 05:05:48,048][106225] Updated weights for policy 1, policy_version 1372011 (0.0007) [2023-12-28 05:05:48,064][106226] Updated weights for policy 0, policy_version 1368688 (0.0009) [2023-12-28 05:05:48,098][106225] Updated weights for policy 1, policy_version 1372021 (0.0008) [2023-12-28 05:05:48,117][106226] Updated weights for policy 0, policy_version 1368698 (0.0005) [2023-12-28 05:05:48,737][106226] Updated weights for policy 0, policy_version 1368708 (0.0005) [2023-12-28 05:05:48,804][106226] Updated weights for policy 0, policy_version 1368718 (0.0009) [2023-12-28 05:05:48,847][106225] Updated weights for policy 1, policy_version 1372031 (0.0007) [2023-12-28 05:05:48,867][106226] Updated weights for policy 0, policy_version 1368728 (0.0011) [2023-12-28 05:05:48,905][106225] Updated weights for policy 1, policy_version 1372041 (0.0007) [2023-12-28 05:05:48,967][106225] Updated weights for policy 1, policy_version 1372051 (0.0009) [2023-12-28 05:05:49,588][106226] Updated weights for policy 0, policy_version 1368738 (0.0007) [2023-12-28 05:05:49,648][106226] Updated weights for policy 0, policy_version 1368748 (0.0005) [2023-12-28 05:05:49,683][106225] Updated weights for policy 1, policy_version 1372061 (0.0007) [2023-12-28 05:05:49,717][106226] Updated weights for policy 0, policy_version 1368758 (0.0007) [2023-12-28 05:05:49,735][106225] Updated weights for policy 1, policy_version 1372071 (0.0008) [2023-12-28 05:05:49,778][106226] Updated weights for policy 0, policy_version 1368768 (0.0010) [2023-12-28 05:05:49,787][106225] Updated weights for policy 1, policy_version 1372081 (0.0008) [2023-12-28 05:05:50,374][106226] Updated weights for policy 0, policy_version 1368778 (0.0006) [2023-12-28 05:05:50,434][106226] Updated weights for policy 0, policy_version 1368788 (0.0009) [2023-12-28 05:05:50,491][106226] Updated weights for policy 0, policy_version 1368798 (0.0008) [2023-12-28 05:05:50,604][106225] Updated weights for policy 1, policy_version 1372091 (0.0007) [2023-12-28 05:05:50,665][106225] Updated weights for policy 1, policy_version 1372101 (0.0007) [2023-12-28 05:05:50,722][106225] Updated weights for policy 1, policy_version 1372111 (0.0007) [2023-12-28 05:05:51,111][106226] Updated weights for policy 0, policy_version 1368808 (0.0011) [2023-12-28 05:05:51,172][106226] Updated weights for policy 0, policy_version 1368818 (0.0011) [2023-12-28 05:05:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 701792256. Throughput: 0: 9957.2, 1: 9868.5. Samples: 701804960. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:05:51,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.448')] [2023-12-28 05:05:51,233][106226] Updated weights for policy 0, policy_version 1368828 (0.0011) [2023-12-28 05:05:51,464][106225] Updated weights for policy 1, policy_version 1372121 (0.0006) [2023-12-28 05:05:51,528][106225] Updated weights for policy 1, policy_version 1372131 (0.0006) [2023-12-28 05:05:51,593][106225] Updated weights for policy 1, policy_version 1372141 (0.0008) [2023-12-28 05:05:51,663][106225] Updated weights for policy 1, policy_version 1372151 (0.0008) [2023-12-28 05:05:51,939][106226] Updated weights for policy 0, policy_version 1368838 (0.0009) [2023-12-28 05:05:52,003][106226] Updated weights for policy 0, policy_version 1368848 (0.0009) [2023-12-28 05:05:52,069][106226] Updated weights for policy 0, policy_version 1368858 (0.0007) [2023-12-28 05:05:52,416][106225] Updated weights for policy 1, policy_version 1372161 (0.0009) [2023-12-28 05:05:52,478][106225] Updated weights for policy 1, policy_version 1372171 (0.0008) [2023-12-28 05:05:52,542][106225] Updated weights for policy 1, policy_version 1372181 (0.0007) [2023-12-28 05:05:52,837][106226] Updated weights for policy 0, policy_version 1368868 (0.0008) [2023-12-28 05:05:52,897][106226] Updated weights for policy 0, policy_version 1368878 (0.0010) [2023-12-28 05:05:52,950][106226] Updated weights for policy 0, policy_version 1368888 (0.0008) [2023-12-28 05:05:53,311][106225] Updated weights for policy 1, policy_version 1372191 (0.0009) [2023-12-28 05:05:53,355][106225] Updated weights for policy 1, policy_version 1372201 (0.0008) [2023-12-28 05:05:53,402][106225] Updated weights for policy 1, policy_version 1372211 (0.0009) [2023-12-28 05:05:53,584][106226] Updated weights for policy 0, policy_version 1368898 (0.0008) [2023-12-28 05:05:53,646][106226] Updated weights for policy 0, policy_version 1368908 (0.0009) [2023-12-28 05:05:53,706][106226] Updated weights for policy 0, policy_version 1368918 (0.0007) [2023-12-28 05:05:53,764][106226] Updated weights for policy 0, policy_version 1368928 (0.0010) [2023-12-28 05:05:54,090][106225] Updated weights for policy 1, policy_version 1372221 (0.0008) [2023-12-28 05:05:54,145][106225] Updated weights for policy 1, policy_version 1372231 (0.0009) [2023-12-28 05:05:54,195][106225] Updated weights for policy 1, policy_version 1372241 (0.0008) [2023-12-28 05:05:54,428][106226] Updated weights for policy 0, policy_version 1368938 (0.0006) [2023-12-28 05:05:54,489][106226] Updated weights for policy 0, policy_version 1368948 (0.0006) [2023-12-28 05:05:54,548][106226] Updated weights for policy 0, policy_version 1368958 (0.0006) [2023-12-28 05:05:54,971][106225] Updated weights for policy 1, policy_version 1372251 (0.0009) [2023-12-28 05:05:55,029][106225] Updated weights for policy 1, policy_version 1372261 (0.0009) [2023-12-28 05:05:55,086][106225] Updated weights for policy 1, policy_version 1372271 (0.0008) [2023-12-28 05:05:55,184][106226] Updated weights for policy 0, policy_version 1368968 (0.0007) [2023-12-28 05:05:55,237][106226] Updated weights for policy 0, policy_version 1368978 (0.0009) [2023-12-28 05:05:55,289][106226] Updated weights for policy 0, policy_version 1368988 (0.0008) [2023-12-28 05:05:55,818][106225] Updated weights for policy 1, policy_version 1372281 (0.0009) [2023-12-28 05:05:55,875][106225] Updated weights for policy 1, policy_version 1372291 (0.0007) [2023-12-28 05:05:55,929][106225] Updated weights for policy 1, policy_version 1372301 (0.0005) [2023-12-28 05:05:55,986][106226] Updated weights for policy 0, policy_version 1368998 (0.0008) [2023-12-28 05:05:55,988][106225] Updated weights for policy 1, policy_version 1372311 (0.0006) [2023-12-28 05:05:56,043][106226] Updated weights for policy 0, policy_version 1369008 (0.0007) [2023-12-28 05:05:56,101][106226] Updated weights for policy 0, policy_version 1369018 (0.0008) [2023-12-28 05:05:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 701898752. Throughput: 0: 9931.8, 1: 9839.2. Samples: 701861384. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:05:56,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.430')] [2023-12-28 05:05:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001372312_351363072.pth... [2023-12-28 05:05:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001369024_350535680.pth... [2023-12-28 05:05:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001371160_351068160.pth [2023-12-28 05:05:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001367840_350232576.pth [2023-12-28 05:05:56,595][106225] Updated weights for policy 1, policy_version 1372321 (0.0007) [2023-12-28 05:05:56,657][106225] Updated weights for policy 1, policy_version 1372331 (0.0008) [2023-12-28 05:05:56,713][106225] Updated weights for policy 1, policy_version 1372341 (0.0009) [2023-12-28 05:05:56,757][106226] Updated weights for policy 0, policy_version 1369028 (0.0007) [2023-12-28 05:05:56,820][106226] Updated weights for policy 0, policy_version 1369038 (0.0006) [2023-12-28 05:05:56,878][106226] Updated weights for policy 0, policy_version 1369048 (0.0005) [2023-12-28 05:05:57,410][106225] Updated weights for policy 1, policy_version 1372351 (0.0010) [2023-12-28 05:05:57,443][106226] Updated weights for policy 0, policy_version 1369058 (0.0005) [2023-12-28 05:05:57,462][106225] Updated weights for policy 1, policy_version 1372361 (0.0007) [2023-12-28 05:05:57,511][106226] Updated weights for policy 0, policy_version 1369068 (0.0006) [2023-12-28 05:05:57,512][106225] Updated weights for policy 1, policy_version 1372371 (0.0009) [2023-12-28 05:05:57,567][106226] Updated weights for policy 0, policy_version 1369078 (0.0010) [2023-12-28 05:05:57,622][106226] Updated weights for policy 0, policy_version 1369088 (0.0010) [2023-12-28 05:05:58,112][106225] Updated weights for policy 1, policy_version 1372381 (0.0008) [2023-12-28 05:05:58,155][106226] Updated weights for policy 0, policy_version 1369098 (0.0006) [2023-12-28 05:05:58,171][106225] Updated weights for policy 1, policy_version 1372391 (0.0006) [2023-12-28 05:05:58,215][106226] Updated weights for policy 0, policy_version 1369108 (0.0006) [2023-12-28 05:05:58,234][106225] Updated weights for policy 1, policy_version 1372401 (0.0008) [2023-12-28 05:05:58,277][106226] Updated weights for policy 0, policy_version 1369118 (0.0008) [2023-12-28 05:05:58,963][106225] Updated weights for policy 1, policy_version 1372411 (0.0008) [2023-12-28 05:05:59,027][106225] Updated weights for policy 1, policy_version 1372421 (0.0007) [2023-12-28 05:05:59,040][106226] Updated weights for policy 0, policy_version 1369128 (0.0008) [2023-12-28 05:05:59,084][106225] Updated weights for policy 1, policy_version 1372431 (0.0007) [2023-12-28 05:05:59,102][106226] Updated weights for policy 0, policy_version 1369138 (0.0008) [2023-12-28 05:05:59,166][106226] Updated weights for policy 0, policy_version 1369148 (0.0007) [2023-12-28 05:05:59,854][106226] Updated weights for policy 0, policy_version 1369158 (0.0008) [2023-12-28 05:05:59,897][106225] Updated weights for policy 1, policy_version 1372441 (0.0006) [2023-12-28 05:05:59,916][106226] Updated weights for policy 0, policy_version 1369168 (0.0008) [2023-12-28 05:05:59,953][106225] Updated weights for policy 1, policy_version 1372451 (0.0008) [2023-12-28 05:05:59,978][106226] Updated weights for policy 0, policy_version 1369178 (0.0008) [2023-12-28 05:06:00,016][106225] Updated weights for policy 1, policy_version 1372461 (0.0007) [2023-12-28 05:06:00,080][106225] Updated weights for policy 1, policy_version 1372471 (0.0010) [2023-12-28 05:06:00,657][106226] Updated weights for policy 0, policy_version 1369188 (0.0008) [2023-12-28 05:06:00,730][106226] Updated weights for policy 0, policy_version 1369198 (0.0007) [2023-12-28 05:06:00,755][106225] Updated weights for policy 1, policy_version 1372481 (0.0010) [2023-12-28 05:06:00,792][106226] Updated weights for policy 0, policy_version 1369208 (0.0008) [2023-12-28 05:06:00,819][106225] Updated weights for policy 1, policy_version 1372491 (0.0010) [2023-12-28 05:06:00,871][106225] Updated weights for policy 1, policy_version 1372501 (0.0010) [2023-12-28 05:06:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 701997056. Throughput: 0: 10048.9, 1: 9785.7. Samples: 701984260. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:01,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.731')] [2023-12-28 05:06:01,489][106226] Updated weights for policy 0, policy_version 1369218 (0.0008) [2023-12-28 05:06:01,553][106226] Updated weights for policy 0, policy_version 1369228 (0.0006) [2023-12-28 05:06:01,614][106226] Updated weights for policy 0, policy_version 1369238 (0.0006) [2023-12-28 05:06:01,649][106225] Updated weights for policy 1, policy_version 1372511 (0.0009) [2023-12-28 05:06:01,681][106226] Updated weights for policy 0, policy_version 1369248 (0.0008) [2023-12-28 05:06:01,701][106225] Updated weights for policy 1, policy_version 1372521 (0.0006) [2023-12-28 05:06:01,767][106225] Updated weights for policy 1, policy_version 1372531 (0.0009) [2023-12-28 05:06:02,360][106225] Updated weights for policy 1, policy_version 1372541 (0.0007) [2023-12-28 05:06:02,402][106226] Updated weights for policy 0, policy_version 1369258 (0.0007) [2023-12-28 05:06:02,421][106225] Updated weights for policy 1, policy_version 1372551 (0.0008) [2023-12-28 05:06:02,460][106226] Updated weights for policy 0, policy_version 1369268 (0.0007) [2023-12-28 05:06:02,476][106225] Updated weights for policy 1, policy_version 1372561 (0.0008) [2023-12-28 05:06:02,520][106226] Updated weights for policy 0, policy_version 1369278 (0.0006) [2023-12-28 05:06:03,117][106225] Updated weights for policy 1, policy_version 1372571 (0.0007) [2023-12-28 05:06:03,181][106225] Updated weights for policy 1, policy_version 1372581 (0.0006) [2023-12-28 05:06:03,246][106225] Updated weights for policy 1, policy_version 1372591 (0.0006) [2023-12-28 05:06:03,274][106226] Updated weights for policy 0, policy_version 1369288 (0.0010) [2023-12-28 05:06:03,331][106226] Updated weights for policy 0, policy_version 1369298 (0.0010) [2023-12-28 05:06:03,381][106226] Updated weights for policy 0, policy_version 1369308 (0.0010) [2023-12-28 05:06:03,899][106225] Updated weights for policy 1, policy_version 1372601 (0.0009) [2023-12-28 05:06:03,965][106225] Updated weights for policy 1, policy_version 1372611 (0.0011) [2023-12-28 05:06:04,027][106225] Updated weights for policy 1, policy_version 1372621 (0.0011) [2023-12-28 05:06:04,087][106226] Updated weights for policy 0, policy_version 1369318 (0.0007) [2023-12-28 05:06:04,092][106225] Updated weights for policy 1, policy_version 1372631 (0.0011) [2023-12-28 05:06:04,152][106226] Updated weights for policy 0, policy_version 1369328 (0.0008) [2023-12-28 05:06:04,215][106226] Updated weights for policy 0, policy_version 1369338 (0.0008) [2023-12-28 05:06:04,767][106225] Updated weights for policy 1, policy_version 1372641 (0.0010) [2023-12-28 05:06:04,833][106225] Updated weights for policy 1, policy_version 1372651 (0.0010) [2023-12-28 05:06:04,875][106226] Updated weights for policy 0, policy_version 1369348 (0.0008) [2023-12-28 05:06:04,890][106225] Updated weights for policy 1, policy_version 1372661 (0.0010) [2023-12-28 05:06:04,927][106226] Updated weights for policy 0, policy_version 1369358 (0.0006) [2023-12-28 05:06:04,981][106226] Updated weights for policy 0, policy_version 1369368 (0.0007) [2023-12-28 05:06:05,592][106225] Updated weights for policy 1, policy_version 1372671 (0.0008) [2023-12-28 05:06:05,648][106225] Updated weights for policy 1, policy_version 1372681 (0.0010) [2023-12-28 05:06:05,704][106225] Updated weights for policy 1, policy_version 1372691 (0.0010) [2023-12-28 05:06:05,739][106226] Updated weights for policy 0, policy_version 1369378 (0.0008) [2023-12-28 05:06:05,789][106226] Updated weights for policy 0, policy_version 1369388 (0.0008) [2023-12-28 05:06:05,835][106226] Updated weights for policy 0, policy_version 1369398 (0.0008) [2023-12-28 05:06:05,886][106226] Updated weights for policy 0, policy_version 1369408 (0.0009) [2023-12-28 05:06:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 702095360. Throughput: 0: 9999.5, 1: 9826.9. Samples: 702102824. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:06,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-4.598')] [2023-12-28 05:06:06,343][106225] Updated weights for policy 1, policy_version 1372701 (0.0010) [2023-12-28 05:06:06,401][106225] Updated weights for policy 1, policy_version 1372711 (0.0010) [2023-12-28 05:06:06,463][106225] Updated weights for policy 1, policy_version 1372721 (0.0010) [2023-12-28 05:06:06,724][106226] Updated weights for policy 0, policy_version 1369418 (0.0009) [2023-12-28 05:06:06,785][106226] Updated weights for policy 0, policy_version 1369428 (0.0008) [2023-12-28 05:06:06,842][106226] Updated weights for policy 0, policy_version 1369438 (0.0008) [2023-12-28 05:06:07,157][106225] Updated weights for policy 1, policy_version 1372731 (0.0008) [2023-12-28 05:06:07,212][106225] Updated weights for policy 1, policy_version 1372741 (0.0010) [2023-12-28 05:06:07,271][106225] Updated weights for policy 1, policy_version 1372751 (0.0010) [2023-12-28 05:06:07,576][106226] Updated weights for policy 0, policy_version 1369448 (0.0007) [2023-12-28 05:06:07,626][106226] Updated weights for policy 0, policy_version 1369458 (0.0008) [2023-12-28 05:06:07,674][106226] Updated weights for policy 0, policy_version 1369468 (0.0008) [2023-12-28 05:06:07,911][106225] Updated weights for policy 1, policy_version 1372761 (0.0010) [2023-12-28 05:06:07,968][106225] Updated weights for policy 1, policy_version 1372771 (0.0010) [2023-12-28 05:06:08,028][106225] Updated weights for policy 1, policy_version 1372781 (0.0010) [2023-12-28 05:06:08,075][106225] Updated weights for policy 1, policy_version 1372791 (0.0010) [2023-12-28 05:06:08,459][106226] Updated weights for policy 0, policy_version 1369479 (0.0011) [2023-12-28 05:06:08,523][106226] Updated weights for policy 0, policy_version 1369489 (0.0011) [2023-12-28 05:06:08,581][106226] Updated weights for policy 0, policy_version 1369499 (0.0010) [2023-12-28 05:06:08,740][106225] Updated weights for policy 1, policy_version 1372801 (0.0009) [2023-12-28 05:06:08,797][106225] Updated weights for policy 1, policy_version 1372811 (0.0010) [2023-12-28 05:06:08,864][106225] Updated weights for policy 1, policy_version 1372821 (0.0010) [2023-12-28 05:06:09,291][106226] Updated weights for policy 0, policy_version 1369509 (0.0011) [2023-12-28 05:06:09,350][106226] Updated weights for policy 0, policy_version 1369519 (0.0011) [2023-12-28 05:06:09,424][106226] Updated weights for policy 0, policy_version 1369529 (0.0009) [2023-12-28 05:06:09,614][106225] Updated weights for policy 1, policy_version 1372831 (0.0009) [2023-12-28 05:06:09,676][106225] Updated weights for policy 1, policy_version 1372841 (0.0009) [2023-12-28 05:06:09,744][106225] Updated weights for policy 1, policy_version 1372851 (0.0009) [2023-12-28 05:06:10,148][106226] Updated weights for policy 0, policy_version 1369539 (0.0008) [2023-12-28 05:06:10,208][106226] Updated weights for policy 0, policy_version 1369549 (0.0007) [2023-12-28 05:06:10,264][106226] Updated weights for policy 0, policy_version 1369559 (0.0007) [2023-12-28 05:06:10,594][106225] Updated weights for policy 1, policy_version 1372861 (0.0009) [2023-12-28 05:06:10,654][106225] Updated weights for policy 1, policy_version 1372871 (0.0009) [2023-12-28 05:06:10,713][106225] Updated weights for policy 1, policy_version 1372881 (0.0008) [2023-12-28 05:06:10,993][106226] Updated weights for policy 0, policy_version 1369569 (0.0008) [2023-12-28 05:06:11,064][106226] Updated weights for policy 0, policy_version 1369579 (0.0008) [2023-12-28 05:06:11,133][106226] Updated weights for policy 0, policy_version 1369589 (0.0007) [2023-12-28 05:06:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 702185472. Throughput: 0: 9964.9, 1: 9928.5. Samples: 702162744. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:11,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.387')] [2023-12-28 05:06:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001372888_351510528.pth... [2023-12-28 05:06:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001371736_351215616.pth [2023-12-28 05:06:11,203][106226] Updated weights for policy 0, policy_version 1369599 (0.0006) [2023-12-28 05:06:11,209][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001369600_350683136.pth... [2023-12-28 05:06:11,215][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001368416_350380032.pth [2023-12-28 05:06:11,438][106225] Updated weights for policy 1, policy_version 1372891 (0.0008) [2023-12-28 05:06:11,509][106225] Updated weights for policy 1, policy_version 1372901 (0.0007) [2023-12-28 05:06:11,568][106225] Updated weights for policy 1, policy_version 1372911 (0.0008) [2023-12-28 05:06:12,020][106226] Updated weights for policy 0, policy_version 1369609 (0.0008) [2023-12-28 05:06:12,074][106226] Updated weights for policy 0, policy_version 1369619 (0.0009) [2023-12-28 05:06:12,126][106226] Updated weights for policy 0, policy_version 1369629 (0.0008) [2023-12-28 05:06:12,320][106225] Updated weights for policy 1, policy_version 1372921 (0.0009) [2023-12-28 05:06:12,387][106225] Updated weights for policy 1, policy_version 1372931 (0.0008) [2023-12-28 05:06:12,457][106225] Updated weights for policy 1, policy_version 1372941 (0.0009) [2023-12-28 05:06:12,511][106225] Updated weights for policy 1, policy_version 1372951 (0.0008) [2023-12-28 05:06:12,880][106226] Updated weights for policy 0, policy_version 1369639 (0.0009) [2023-12-28 05:06:12,947][106226] Updated weights for policy 0, policy_version 1369649 (0.0009) [2023-12-28 05:06:13,015][106226] Updated weights for policy 0, policy_version 1369659 (0.0009) [2023-12-28 05:06:13,116][106225] Updated weights for policy 1, policy_version 1372961 (0.0008) [2023-12-28 05:06:13,170][106225] Updated weights for policy 1, policy_version 1372971 (0.0005) [2023-12-28 05:06:13,221][106225] Updated weights for policy 1, policy_version 1372981 (0.0005) [2023-12-28 05:06:13,691][106226] Updated weights for policy 0, policy_version 1369669 (0.0007) [2023-12-28 05:06:13,749][106226] Updated weights for policy 0, policy_version 1369679 (0.0009) [2023-12-28 05:06:13,808][106226] Updated weights for policy 0, policy_version 1369689 (0.0009) [2023-12-28 05:06:13,838][106225] Updated weights for policy 1, policy_version 1372991 (0.0006) [2023-12-28 05:06:13,884][106225] Updated weights for policy 1, policy_version 1373001 (0.0005) [2023-12-28 05:06:13,929][106225] Updated weights for policy 1, policy_version 1373011 (0.0005) [2023-12-28 05:06:14,474][106226] Updated weights for policy 0, policy_version 1369699 (0.0008) [2023-12-28 05:06:14,519][106226] Updated weights for policy 0, policy_version 1369709 (0.0008) [2023-12-28 05:06:14,568][106226] Updated weights for policy 0, policy_version 1369719 (0.0007) [2023-12-28 05:06:14,674][106225] Updated weights for policy 1, policy_version 1373021 (0.0008) [2023-12-28 05:06:14,733][106225] Updated weights for policy 1, policy_version 1373031 (0.0008) [2023-12-28 05:06:14,800][106225] Updated weights for policy 1, policy_version 1373041 (0.0008) [2023-12-28 05:06:15,316][106226] Updated weights for policy 0, policy_version 1369729 (0.0007) [2023-12-28 05:06:15,375][106226] Updated weights for policy 0, policy_version 1369739 (0.0007) [2023-12-28 05:06:15,442][106226] Updated weights for policy 0, policy_version 1369749 (0.0005) [2023-12-28 05:06:15,499][106226] Updated weights for policy 0, policy_version 1369759 (0.0005) [2023-12-28 05:06:15,555][106225] Updated weights for policy 1, policy_version 1373051 (0.0006) [2023-12-28 05:06:15,604][106225] Updated weights for policy 1, policy_version 1373061 (0.0008) [2023-12-28 05:06:15,652][106225] Updated weights for policy 1, policy_version 1373071 (0.0008) [2023-12-28 05:06:16,110][106226] Updated weights for policy 0, policy_version 1369769 (0.0008) [2023-12-28 05:06:16,167][106226] Updated weights for policy 0, policy_version 1369779 (0.0009) [2023-12-28 05:06:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 702283776. Throughput: 0: 9990.8, 1: 9802.4. Samples: 702277336. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:16,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.471')] [2023-12-28 05:06:16,223][106226] Updated weights for policy 0, policy_version 1369789 (0.0009) [2023-12-28 05:06:16,398][106225] Updated weights for policy 1, policy_version 1373081 (0.0008) [2023-12-28 05:06:16,459][106225] Updated weights for policy 1, policy_version 1373091 (0.0008) [2023-12-28 05:06:16,515][106225] Updated weights for policy 1, policy_version 1373101 (0.0005) [2023-12-28 05:06:16,578][106225] Updated weights for policy 1, policy_version 1373111 (0.0005) [2023-12-28 05:06:16,853][106226] Updated weights for policy 0, policy_version 1369799 (0.0007) [2023-12-28 05:06:16,898][106226] Updated weights for policy 0, policy_version 1369809 (0.0008) [2023-12-28 05:06:16,946][106226] Updated weights for policy 0, policy_version 1369819 (0.0008) [2023-12-28 05:06:17,259][106225] Updated weights for policy 1, policy_version 1373121 (0.0009) [2023-12-28 05:06:17,307][106225] Updated weights for policy 1, policy_version 1373131 (0.0008) [2023-12-28 05:06:17,355][106225] Updated weights for policy 1, policy_version 1373141 (0.0009) [2023-12-28 05:06:17,562][106226] Updated weights for policy 0, policy_version 1369829 (0.0009) [2023-12-28 05:06:17,622][106226] Updated weights for policy 0, policy_version 1369839 (0.0010) [2023-12-28 05:06:17,679][106226] Updated weights for policy 0, policy_version 1369849 (0.0006) [2023-12-28 05:06:18,142][106225] Updated weights for policy 1, policy_version 1373151 (0.0008) [2023-12-28 05:06:18,204][106225] Updated weights for policy 1, policy_version 1373161 (0.0009) [2023-12-28 05:06:18,268][106225] Updated weights for policy 1, policy_version 1373171 (0.0007) [2023-12-28 05:06:18,344][106226] Updated weights for policy 0, policy_version 1369859 (0.0006) [2023-12-28 05:06:18,407][106226] Updated weights for policy 0, policy_version 1369870 (0.0007) [2023-12-28 05:06:18,467][106226] Updated weights for policy 0, policy_version 1369880 (0.0007) [2023-12-28 05:06:19,058][106225] Updated weights for policy 1, policy_version 1373181 (0.0009) [2023-12-28 05:06:19,098][106226] Updated weights for policy 0, policy_version 1369890 (0.0007) [2023-12-28 05:06:19,105][106225] Updated weights for policy 1, policy_version 1373191 (0.0009) [2023-12-28 05:06:19,156][106225] Updated weights for policy 1, policy_version 1373201 (0.0009) [2023-12-28 05:06:19,157][106226] Updated weights for policy 0, policy_version 1369900 (0.0005) [2023-12-28 05:06:19,208][106226] Updated weights for policy 0, policy_version 1369910 (0.0005) [2023-12-28 05:06:19,276][106226] Updated weights for policy 0, policy_version 1369920 (0.0008) [2023-12-28 05:06:19,966][106226] Updated weights for policy 0, policy_version 1369930 (0.0008) [2023-12-28 05:06:20,010][106225] Updated weights for policy 1, policy_version 1373211 (0.0008) [2023-12-28 05:06:20,022][106226] Updated weights for policy 0, policy_version 1369940 (0.0007) [2023-12-28 05:06:20,066][106225] Updated weights for policy 1, policy_version 1373221 (0.0008) [2023-12-28 05:06:20,071][106226] Updated weights for policy 0, policy_version 1369950 (0.0007) [2023-12-28 05:06:20,136][106225] Updated weights for policy 1, policy_version 1373231 (0.0008) [2023-12-28 05:06:20,801][106226] Updated weights for policy 0, policy_version 1369960 (0.0010) [2023-12-28 05:06:20,817][106225] Updated weights for policy 1, policy_version 1373241 (0.0008) [2023-12-28 05:06:20,868][106226] Updated weights for policy 0, policy_version 1369970 (0.0011) [2023-12-28 05:06:20,875][106225] Updated weights for policy 1, policy_version 1373251 (0.0006) [2023-12-28 05:06:20,930][106226] Updated weights for policy 0, policy_version 1369980 (0.0011) [2023-12-28 05:06:20,937][106225] Updated weights for policy 1, policy_version 1373261 (0.0008) [2023-12-28 05:06:21,001][106225] Updated weights for policy 1, policy_version 1373271 (0.0009) [2023-12-28 05:06:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 702390272. Throughput: 0: 9985.9, 1: 9803.4. Samples: 702395436. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:21,175][105115] Avg episode reward: [(0, '-4.866'), (1, '-4.554')] [2023-12-28 05:06:21,757][106226] Updated weights for policy 0, policy_version 1369990 (0.0009) [2023-12-28 05:06:21,806][106225] Updated weights for policy 1, policy_version 1373281 (0.0011) [2023-12-28 05:06:21,821][106226] Updated weights for policy 0, policy_version 1370000 (0.0007) [2023-12-28 05:06:21,874][106225] Updated weights for policy 1, policy_version 1373291 (0.0007) [2023-12-28 05:06:21,877][106226] Updated weights for policy 0, policy_version 1370010 (0.0005) [2023-12-28 05:06:21,933][106225] Updated weights for policy 1, policy_version 1373301 (0.0009) [2023-12-28 05:06:22,532][106226] Updated weights for policy 0, policy_version 1370020 (0.0007) [2023-12-28 05:06:22,596][106226] Updated weights for policy 0, policy_version 1370030 (0.0009) [2023-12-28 05:06:22,660][106225] Updated weights for policy 1, policy_version 1373311 (0.0007) [2023-12-28 05:06:22,665][106226] Updated weights for policy 0, policy_version 1370040 (0.0007) [2023-12-28 05:06:22,726][106225] Updated weights for policy 1, policy_version 1373321 (0.0007) [2023-12-28 05:06:22,789][106225] Updated weights for policy 1, policy_version 1373331 (0.0008) [2023-12-28 05:06:23,365][106226] Updated weights for policy 0, policy_version 1370050 (0.0008) [2023-12-28 05:06:23,419][106226] Updated weights for policy 0, policy_version 1370060 (0.0006) [2023-12-28 05:06:23,479][106225] Updated weights for policy 1, policy_version 1373341 (0.0007) [2023-12-28 05:06:23,485][106226] Updated weights for policy 0, policy_version 1370070 (0.0008) [2023-12-28 05:06:23,542][106225] Updated weights for policy 1, policy_version 1373351 (0.0006) [2023-12-28 05:06:23,553][106226] Updated weights for policy 0, policy_version 1370080 (0.0008) [2023-12-28 05:06:23,592][106225] Updated weights for policy 1, policy_version 1373361 (0.0007) [2023-12-28 05:06:24,158][106226] Updated weights for policy 0, policy_version 1370090 (0.0011) [2023-12-28 05:06:24,213][106226] Updated weights for policy 0, policy_version 1370100 (0.0011) [2023-12-28 05:06:24,272][106226] Updated weights for policy 0, policy_version 1370110 (0.0011) [2023-12-28 05:06:24,307][106225] Updated weights for policy 1, policy_version 1373371 (0.0010) [2023-12-28 05:06:24,365][106225] Updated weights for policy 1, policy_version 1373381 (0.0010) [2023-12-28 05:06:24,433][106225] Updated weights for policy 1, policy_version 1373391 (0.0010) [2023-12-28 05:06:24,978][106226] Updated weights for policy 0, policy_version 1370120 (0.0009) [2023-12-28 05:06:25,028][106226] Updated weights for policy 0, policy_version 1370130 (0.0011) [2023-12-28 05:06:25,078][106226] Updated weights for policy 0, policy_version 1370140 (0.0010) [2023-12-28 05:06:25,152][106225] Updated weights for policy 1, policy_version 1373401 (0.0010) [2023-12-28 05:06:25,203][106225] Updated weights for policy 1, policy_version 1373411 (0.0007) [2023-12-28 05:06:25,255][106225] Updated weights for policy 1, policy_version 1373421 (0.0005) [2023-12-28 05:06:25,314][106225] Updated weights for policy 1, policy_version 1373431 (0.0005) [2023-12-28 05:06:25,792][106226] Updated weights for policy 0, policy_version 1370150 (0.0010) [2023-12-28 05:06:25,848][106226] Updated weights for policy 0, policy_version 1370160 (0.0010) [2023-12-28 05:06:25,878][106225] Updated weights for policy 1, policy_version 1373441 (0.0009) [2023-12-28 05:06:25,912][106226] Updated weights for policy 0, policy_version 1370170 (0.0011) [2023-12-28 05:06:25,929][106225] Updated weights for policy 1, policy_version 1373451 (0.0006) [2023-12-28 05:06:25,994][106225] Updated weights for policy 1, policy_version 1373461 (0.0005) [2023-12-28 05:06:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 702488576. Throughput: 0: 9979.3, 1: 9749.8. Samples: 702453676. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:26,175][105115] Avg episode reward: [(0, '-4.285'), (1, '-4.597')] [2023-12-28 05:06:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001370176_350830592.pth... [2023-12-28 05:06:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001373464_351657984.pth... [2023-12-28 05:06:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001369024_350535680.pth [2023-12-28 05:06:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001372312_351363072.pth [2023-12-28 05:06:26,577][106226] Updated weights for policy 0, policy_version 1370180 (0.0010) [2023-12-28 05:06:26,625][106225] Updated weights for policy 1, policy_version 1373471 (0.0007) [2023-12-28 05:06:26,634][106226] Updated weights for policy 0, policy_version 1370190 (0.0010) [2023-12-28 05:06:26,680][106226] Updated weights for policy 0, policy_version 1370200 (0.0010) [2023-12-28 05:06:26,682][106225] Updated weights for policy 1, policy_version 1373481 (0.0007) [2023-12-28 05:06:26,735][106225] Updated weights for policy 1, policy_version 1373491 (0.0006) [2023-12-28 05:06:27,402][106226] Updated weights for policy 0, policy_version 1370210 (0.0010) [2023-12-28 05:06:27,422][106225] Updated weights for policy 1, policy_version 1373501 (0.0007) [2023-12-28 05:06:27,468][106226] Updated weights for policy 0, policy_version 1370220 (0.0011) [2023-12-28 05:06:27,469][106225] Updated weights for policy 1, policy_version 1373511 (0.0007) [2023-12-28 05:06:27,520][106225] Updated weights for policy 1, policy_version 1373521 (0.0007) [2023-12-28 05:06:27,531][106226] Updated weights for policy 0, policy_version 1370230 (0.0010) [2023-12-28 05:06:27,593][106226] Updated weights for policy 0, policy_version 1370240 (0.0011) [2023-12-28 05:06:28,161][106225] Updated weights for policy 1, policy_version 1373531 (0.0007) [2023-12-28 05:06:28,224][106225] Updated weights for policy 1, policy_version 1373541 (0.0005) [2023-12-28 05:06:28,285][106225] Updated weights for policy 1, policy_version 1373551 (0.0005) [2023-12-28 05:06:28,295][106226] Updated weights for policy 0, policy_version 1370250 (0.0011) [2023-12-28 05:06:28,363][106226] Updated weights for policy 0, policy_version 1370260 (0.0006) [2023-12-28 05:06:28,430][106226] Updated weights for policy 0, policy_version 1370270 (0.0008) [2023-12-28 05:06:28,937][106225] Updated weights for policy 1, policy_version 1373561 (0.0007) [2023-12-28 05:06:29,004][106225] Updated weights for policy 1, policy_version 1373571 (0.0010) [2023-12-28 05:06:29,064][106226] Updated weights for policy 0, policy_version 1370280 (0.0009) [2023-12-28 05:06:29,069][106225] Updated weights for policy 1, policy_version 1373581 (0.0010) [2023-12-28 05:06:29,110][106226] Updated weights for policy 0, policy_version 1370290 (0.0010) [2023-12-28 05:06:29,122][106225] Updated weights for policy 1, policy_version 1373591 (0.0010) [2023-12-28 05:06:29,160][106226] Updated weights for policy 0, policy_version 1370300 (0.0010) [2023-12-28 05:06:29,827][106225] Updated weights for policy 1, policy_version 1373601 (0.0008) [2023-12-28 05:06:29,891][106225] Updated weights for policy 1, policy_version 1373611 (0.0006) [2023-12-28 05:06:29,910][106226] Updated weights for policy 0, policy_version 1370310 (0.0011) [2023-12-28 05:06:29,948][106225] Updated weights for policy 1, policy_version 1373621 (0.0009) [2023-12-28 05:06:29,974][106226] Updated weights for policy 0, policy_version 1370320 (0.0009) [2023-12-28 05:06:30,036][106226] Updated weights for policy 0, policy_version 1370330 (0.0008) [2023-12-28 05:06:30,621][106225] Updated weights for policy 1, policy_version 1373631 (0.0011) [2023-12-28 05:06:30,678][106225] Updated weights for policy 1, policy_version 1373641 (0.0010) [2023-12-28 05:06:30,727][106225] Updated weights for policy 1, policy_version 1373651 (0.0010) [2023-12-28 05:06:30,742][106226] Updated weights for policy 0, policy_version 1370340 (0.0007) [2023-12-28 05:06:30,790][106226] Updated weights for policy 0, policy_version 1370350 (0.0006) [2023-12-28 05:06:30,798][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000010 [2023-12-28 05:06:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 702586880. Throughput: 0: 9966.6, 1: 9831.9. Samples: 702575440. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:31,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.488')] [2023-12-28 05:06:31,488][106225] Updated weights for policy 1, policy_version 1373661 (0.0010) [2023-12-28 05:06:31,520][106226] Updated weights for policy 0, policy_version 1370360 (0.0006) [2023-12-28 05:06:31,543][106225] Updated weights for policy 1, policy_version 1373671 (0.0010) [2023-12-28 05:06:31,586][106226] Updated weights for policy 0, policy_version 1370370 (0.0007) [2023-12-28 05:06:31,612][106225] Updated weights for policy 1, policy_version 1373681 (0.0007) [2023-12-28 05:06:31,655][106226] Updated weights for policy 0, policy_version 1370380 (0.0009) [2023-12-28 05:06:32,279][106226] Updated weights for policy 0, policy_version 1370390 (0.0007) [2023-12-28 05:06:32,352][106226] Updated weights for policy 0, policy_version 1370400 (0.0009) [2023-12-28 05:06:32,422][106226] Updated weights for policy 0, policy_version 1370410 (0.0007) [2023-12-28 05:06:32,426][106225] Updated weights for policy 1, policy_version 1373691 (0.0008) [2023-12-28 05:06:32,493][106225] Updated weights for policy 1, policy_version 1373701 (0.0007) [2023-12-28 05:06:32,556][106225] Updated weights for policy 1, policy_version 1373711 (0.0007) [2023-12-28 05:06:33,000][106226] Updated weights for policy 0, policy_version 1370420 (0.0007) [2023-12-28 05:06:33,057][106226] Updated weights for policy 0, policy_version 1370430 (0.0009) [2023-12-28 05:06:33,110][106226] Updated weights for policy 0, policy_version 1370440 (0.0007) [2023-12-28 05:06:33,305][106225] Updated weights for policy 1, policy_version 1373721 (0.0009) [2023-12-28 05:06:33,355][106225] Updated weights for policy 1, policy_version 1373731 (0.0007) [2023-12-28 05:06:33,408][106225] Updated weights for policy 1, policy_version 1373741 (0.0007) [2023-12-28 05:06:33,454][106225] Updated weights for policy 1, policy_version 1373751 (0.0007) [2023-12-28 05:06:33,768][106226] Updated weights for policy 0, policy_version 1370450 (0.0008) [2023-12-28 05:06:33,818][106226] Updated weights for policy 0, policy_version 1370460 (0.0010) [2023-12-28 05:06:33,868][106226] Updated weights for policy 0, policy_version 1370470 (0.0010) [2023-12-28 05:06:33,924][106226] Updated weights for policy 0, policy_version 1370480 (0.0010) [2023-12-28 05:06:34,109][106225] Updated weights for policy 1, policy_version 1373761 (0.0010) [2023-12-28 05:06:34,175][106225] Updated weights for policy 1, policy_version 1373771 (0.0010) [2023-12-28 05:06:34,236][106225] Updated weights for policy 1, policy_version 1373781 (0.0008) [2023-12-28 05:06:34,602][106226] Updated weights for policy 0, policy_version 1370490 (0.0006) [2023-12-28 05:06:34,664][106226] Updated weights for policy 0, policy_version 1370500 (0.0011) [2023-12-28 05:06:34,728][106226] Updated weights for policy 0, policy_version 1370510 (0.0009) [2023-12-28 05:06:34,893][106225] Updated weights for policy 1, policy_version 1373791 (0.0007) [2023-12-28 05:06:34,945][106225] Updated weights for policy 1, policy_version 1373801 (0.0005) [2023-12-28 05:06:35,007][106225] Updated weights for policy 1, policy_version 1373811 (0.0007) [2023-12-28 05:06:35,399][106226] Updated weights for policy 0, policy_version 1370520 (0.0011) [2023-12-28 05:06:35,446][106226] Updated weights for policy 0, policy_version 1370530 (0.0010) [2023-12-28 05:06:35,496][106226] Updated weights for policy 0, policy_version 1370540 (0.0010) [2023-12-28 05:06:35,635][106225] Updated weights for policy 1, policy_version 1373821 (0.0007) [2023-12-28 05:06:35,699][106225] Updated weights for policy 1, policy_version 1373831 (0.0006) [2023-12-28 05:06:35,762][106225] Updated weights for policy 1, policy_version 1373841 (0.0006) [2023-12-28 05:06:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 702685184. Throughput: 0: 9983.5, 1: 9850.6. Samples: 702697492. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:36,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.580')] [2023-12-28 05:06:36,273][106226] Updated weights for policy 0, policy_version 1370550 (0.0011) [2023-12-28 05:06:36,337][106226] Updated weights for policy 0, policy_version 1370560 (0.0010) [2023-12-28 05:06:36,378][106225] Updated weights for policy 1, policy_version 1373851 (0.0010) [2023-12-28 05:06:36,403][106226] Updated weights for policy 0, policy_version 1370570 (0.0010) [2023-12-28 05:06:36,438][106225] Updated weights for policy 1, policy_version 1373861 (0.0008) [2023-12-28 05:06:36,500][106225] Updated weights for policy 1, policy_version 1373871 (0.0008) [2023-12-28 05:06:37,017][106226] Updated weights for policy 0, policy_version 1370580 (0.0010) [2023-12-28 05:06:37,077][106226] Updated weights for policy 0, policy_version 1370590 (0.0011) [2023-12-28 05:06:37,138][106226] Updated weights for policy 0, policy_version 1370600 (0.0011) [2023-12-28 05:06:37,235][106225] Updated weights for policy 1, policy_version 1373881 (0.0007) [2023-12-28 05:06:37,289][106225] Updated weights for policy 1, policy_version 1373891 (0.0010) [2023-12-28 05:06:37,333][106225] Updated weights for policy 1, policy_version 1373901 (0.0010) [2023-12-28 05:06:37,396][106225] Updated weights for policy 1, policy_version 1373911 (0.0009) [2023-12-28 05:06:37,792][106226] Updated weights for policy 0, policy_version 1370610 (0.0008) [2023-12-28 05:06:37,855][106226] Updated weights for policy 0, policy_version 1370620 (0.0006) [2023-12-28 05:06:37,927][106226] Updated weights for policy 0, policy_version 1370630 (0.0006) [2023-12-28 05:06:37,994][106226] Updated weights for policy 0, policy_version 1370640 (0.0006) [2023-12-28 05:06:38,039][106225] Updated weights for policy 1, policy_version 1373921 (0.0009) [2023-12-28 05:06:38,091][106225] Updated weights for policy 1, policy_version 1373931 (0.0009) [2023-12-28 05:06:38,143][106225] Updated weights for policy 1, policy_version 1373941 (0.0008) [2023-12-28 05:06:38,619][106226] Updated weights for policy 0, policy_version 1370650 (0.0009) [2023-12-28 05:06:38,678][106226] Updated weights for policy 0, policy_version 1370660 (0.0008) [2023-12-28 05:06:38,740][106226] Updated weights for policy 0, policy_version 1370670 (0.0009) [2023-12-28 05:06:38,918][106225] Updated weights for policy 1, policy_version 1373951 (0.0010) [2023-12-28 05:06:38,979][106225] Updated weights for policy 1, policy_version 1373961 (0.0008) [2023-12-28 05:06:39,036][106225] Updated weights for policy 1, policy_version 1373971 (0.0008) [2023-12-28 05:06:39,443][106226] Updated weights for policy 0, policy_version 1370680 (0.0008) [2023-12-28 05:06:39,495][106226] Updated weights for policy 0, policy_version 1370690 (0.0008) [2023-12-28 05:06:39,544][106226] Updated weights for policy 0, policy_version 1370700 (0.0008) [2023-12-28 05:06:39,725][106225] Updated weights for policy 1, policy_version 1373981 (0.0008) [2023-12-28 05:06:39,802][106225] Updated weights for policy 1, policy_version 1373991 (0.0009) [2023-12-28 05:06:39,871][106225] Updated weights for policy 1, policy_version 1374001 (0.0008) [2023-12-28 05:06:40,335][106226] Updated weights for policy 0, policy_version 1370710 (0.0008) [2023-12-28 05:06:40,400][106226] Updated weights for policy 0, policy_version 1370720 (0.0008) [2023-12-28 05:06:40,463][106226] Updated weights for policy 0, policy_version 1370730 (0.0008) [2023-12-28 05:06:40,587][106225] Updated weights for policy 1, policy_version 1374011 (0.0007) [2023-12-28 05:06:40,653][106225] Updated weights for policy 1, policy_version 1374021 (0.0009) [2023-12-28 05:06:40,710][106225] Updated weights for policy 1, policy_version 1374031 (0.0010) [2023-12-28 05:06:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 702783488. Throughput: 0: 10042.2, 1: 9900.5. Samples: 702758808. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:41,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.528')] [2023-12-28 05:06:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001374040_351805440.pth... [2023-12-28 05:06:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001370736_350978048.pth... [2023-12-28 05:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001372888_351510528.pth [2023-12-28 05:06:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001369600_350683136.pth [2023-12-28 05:06:41,271][106226] Updated weights for policy 0, policy_version 1370740 (0.0008) [2023-12-28 05:06:41,339][106226] Updated weights for policy 0, policy_version 1370750 (0.0008) [2023-12-28 05:06:41,400][106225] Updated weights for policy 1, policy_version 1374041 (0.0010) [2023-12-28 05:06:41,410][106226] Updated weights for policy 0, policy_version 1370760 (0.0008) [2023-12-28 05:06:41,456][106225] Updated weights for policy 1, policy_version 1374051 (0.0008) [2023-12-28 05:06:41,522][106225] Updated weights for policy 1, policy_version 1374061 (0.0011) [2023-12-28 05:06:41,586][106225] Updated weights for policy 1, policy_version 1374071 (0.0010) [2023-12-28 05:06:42,176][106226] Updated weights for policy 0, policy_version 1370770 (0.0008) [2023-12-28 05:06:42,246][106226] Updated weights for policy 0, policy_version 1370780 (0.0009) [2023-12-28 05:06:42,297][106225] Updated weights for policy 1, policy_version 1374081 (0.0007) [2023-12-28 05:06:42,308][106226] Updated weights for policy 0, policy_version 1370790 (0.0009) [2023-12-28 05:06:42,360][106225] Updated weights for policy 1, policy_version 1374091 (0.0010) [2023-12-28 05:06:42,370][106226] Updated weights for policy 0, policy_version 1370800 (0.0007) [2023-12-28 05:06:42,429][106225] Updated weights for policy 1, policy_version 1374101 (0.0009) [2023-12-28 05:06:43,057][106226] Updated weights for policy 0, policy_version 1370810 (0.0009) [2023-12-28 05:06:43,115][106226] Updated weights for policy 0, policy_version 1370820 (0.0008) [2023-12-28 05:06:43,153][106225] Updated weights for policy 1, policy_version 1374111 (0.0006) [2023-12-28 05:06:43,174][106226] Updated weights for policy 0, policy_version 1370830 (0.0008) [2023-12-28 05:06:43,201][106225] Updated weights for policy 1, policy_version 1374121 (0.0007) [2023-12-28 05:06:43,257][106225] Updated weights for policy 1, policy_version 1374131 (0.0008) [2023-12-28 05:06:43,892][106226] Updated weights for policy 0, policy_version 1370840 (0.0006) [2023-12-28 05:06:43,962][106226] Updated weights for policy 0, policy_version 1370850 (0.0007) [2023-12-28 05:06:43,983][106225] Updated weights for policy 1, policy_version 1374141 (0.0007) [2023-12-28 05:06:44,021][106226] Updated weights for policy 0, policy_version 1370860 (0.0008) [2023-12-28 05:06:44,040][106225] Updated weights for policy 1, policy_version 1374151 (0.0005) [2023-12-28 05:06:44,103][106225] Updated weights for policy 1, policy_version 1374161 (0.0009) [2023-12-28 05:06:44,655][106225] Updated weights for policy 1, policy_version 1374171 (0.0010) [2023-12-28 05:06:44,712][106225] Updated weights for policy 1, policy_version 1374181 (0.0010) [2023-12-28 05:06:44,744][106226] Updated weights for policy 0, policy_version 1370870 (0.0007) [2023-12-28 05:06:44,776][106225] Updated weights for policy 1, policy_version 1374191 (0.0008) [2023-12-28 05:06:44,804][106226] Updated weights for policy 0, policy_version 1370880 (0.0010) [2023-12-28 05:06:44,866][106226] Updated weights for policy 0, policy_version 1370890 (0.0007) [2023-12-28 05:06:45,423][106225] Updated weights for policy 1, policy_version 1374201 (0.0012) [2023-12-28 05:06:45,480][106225] Updated weights for policy 1, policy_version 1374211 (0.0010) [2023-12-28 05:06:45,519][106226] Updated weights for policy 0, policy_version 1370900 (0.0006) [2023-12-28 05:06:45,534][106225] Updated weights for policy 1, policy_version 1374221 (0.0010) [2023-12-28 05:06:45,580][106226] Updated weights for policy 0, policy_version 1370910 (0.0005) [2023-12-28 05:06:45,595][106225] Updated weights for policy 1, policy_version 1374231 (0.0010) [2023-12-28 05:06:45,639][106226] Updated weights for policy 0, policy_version 1370920 (0.0005) [2023-12-28 05:06:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 702881792. Throughput: 0: 9860.5, 1: 9893.2. Samples: 702873176. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:46,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-4.744')] [2023-12-28 05:06:46,230][106225] Updated weights for policy 1, policy_version 1374241 (0.0007) [2023-12-28 05:06:46,247][106226] Updated weights for policy 0, policy_version 1370930 (0.0005) [2023-12-28 05:06:46,292][106225] Updated weights for policy 1, policy_version 1374251 (0.0009) [2023-12-28 05:06:46,303][106226] Updated weights for policy 0, policy_version 1370940 (0.0005) [2023-12-28 05:06:46,343][106225] Updated weights for policy 1, policy_version 1374261 (0.0009) [2023-12-28 05:06:46,361][106226] Updated weights for policy 0, policy_version 1370950 (0.0005) [2023-12-28 05:06:46,421][106226] Updated weights for policy 0, policy_version 1370960 (0.0005) [2023-12-28 05:06:47,012][106226] Updated weights for policy 0, policy_version 1370970 (0.0005) [2023-12-28 05:06:47,063][106225] Updated weights for policy 1, policy_version 1374271 (0.0008) [2023-12-28 05:06:47,076][106226] Updated weights for policy 0, policy_version 1370980 (0.0005) [2023-12-28 05:06:47,118][106225] Updated weights for policy 1, policy_version 1374281 (0.0005) [2023-12-28 05:06:47,140][106226] Updated weights for policy 0, policy_version 1370990 (0.0005) [2023-12-28 05:06:47,182][106225] Updated weights for policy 1, policy_version 1374291 (0.0005) [2023-12-28 05:06:47,714][106225] Updated weights for policy 1, policy_version 1374301 (0.0006) [2023-12-28 05:06:47,767][106226] Updated weights for policy 0, policy_version 1371000 (0.0005) [2023-12-28 05:06:47,774][106225] Updated weights for policy 1, policy_version 1374311 (0.0008) [2023-12-28 05:06:47,826][106226] Updated weights for policy 0, policy_version 1371010 (0.0005) [2023-12-28 05:06:47,830][106225] Updated weights for policy 1, policy_version 1374321 (0.0009) [2023-12-28 05:06:47,891][106226] Updated weights for policy 0, policy_version 1371020 (0.0005) [2023-12-28 05:06:48,478][106226] Updated weights for policy 0, policy_version 1371030 (0.0007) [2023-12-28 05:06:48,533][106226] Updated weights for policy 0, policy_version 1371040 (0.0008) [2023-12-28 05:06:48,582][106226] Updated weights for policy 0, policy_version 1371050 (0.0008) [2023-12-28 05:06:48,589][106225] Updated weights for policy 1, policy_version 1374331 (0.0008) [2023-12-28 05:06:48,652][106225] Updated weights for policy 1, policy_version 1374341 (0.0007) [2023-12-28 05:06:48,711][106225] Updated weights for policy 1, policy_version 1374351 (0.0005) [2023-12-28 05:06:49,348][106225] Updated weights for policy 1, policy_version 1374361 (0.0006) [2023-12-28 05:06:49,393][106226] Updated weights for policy 0, policy_version 1371060 (0.0008) [2023-12-28 05:06:49,410][106225] Updated weights for policy 1, policy_version 1374371 (0.0006) [2023-12-28 05:06:49,451][106226] Updated weights for policy 0, policy_version 1371070 (0.0008) [2023-12-28 05:06:49,471][106225] Updated weights for policy 1, policy_version 1374381 (0.0006) [2023-12-28 05:06:49,519][106226] Updated weights for policy 0, policy_version 1371080 (0.0008) [2023-12-28 05:06:49,532][106225] Updated weights for policy 1, policy_version 1374391 (0.0005) [2023-12-28 05:06:50,186][106225] Updated weights for policy 1, policy_version 1374401 (0.0008) [2023-12-28 05:06:50,234][106225] Updated weights for policy 1, policy_version 1374411 (0.0008) [2023-12-28 05:06:50,293][106225] Updated weights for policy 1, policy_version 1374421 (0.0008) [2023-12-28 05:06:50,309][106226] Updated weights for policy 0, policy_version 1371090 (0.0009) [2023-12-28 05:06:50,371][106226] Updated weights for policy 0, policy_version 1371100 (0.0009) [2023-12-28 05:06:50,425][106226] Updated weights for policy 0, policy_version 1371110 (0.0009) [2023-12-28 05:06:50,475][106226] Updated weights for policy 0, policy_version 1371120 (0.0009) [2023-12-28 05:06:51,072][106225] Updated weights for policy 1, policy_version 1374431 (0.0010) [2023-12-28 05:06:51,139][106225] Updated weights for policy 1, policy_version 1374441 (0.0009) [2023-12-28 05:06:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 702980096. Throughput: 0: 9945.1, 1: 9943.4. Samples: 702997804. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:51,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.933')] [2023-12-28 05:06:51,191][106226] Updated weights for policy 0, policy_version 1371130 (0.0009) [2023-12-28 05:06:51,199][106225] Updated weights for policy 1, policy_version 1374451 (0.0009) [2023-12-28 05:06:51,249][106226] Updated weights for policy 0, policy_version 1371140 (0.0009) [2023-12-28 05:06:51,312][106226] Updated weights for policy 0, policy_version 1371150 (0.0008) [2023-12-28 05:06:51,854][106225] Updated weights for policy 1, policy_version 1374461 (0.0009) [2023-12-28 05:06:51,926][106225] Updated weights for policy 1, policy_version 1374471 (0.0007) [2023-12-28 05:06:51,989][106225] Updated weights for policy 1, policy_version 1374481 (0.0008) [2023-12-28 05:06:52,092][106226] Updated weights for policy 0, policy_version 1371160 (0.0009) [2023-12-28 05:06:52,164][106226] Updated weights for policy 0, policy_version 1371170 (0.0007) [2023-12-28 05:06:52,223][106226] Updated weights for policy 0, policy_version 1371180 (0.0005) [2023-12-28 05:06:52,727][106225] Updated weights for policy 1, policy_version 1374491 (0.0008) [2023-12-28 05:06:52,782][106225] Updated weights for policy 1, policy_version 1374501 (0.0008) [2023-12-28 05:06:52,843][106225] Updated weights for policy 1, policy_version 1374511 (0.0008) [2023-12-28 05:06:52,947][106226] Updated weights for policy 0, policy_version 1371190 (0.0009) [2023-12-28 05:06:52,995][106226] Updated weights for policy 0, policy_version 1371200 (0.0010) [2023-12-28 05:06:53,056][106226] Updated weights for policy 0, policy_version 1371210 (0.0011) [2023-12-28 05:06:53,577][106225] Updated weights for policy 1, policy_version 1374521 (0.0008) [2023-12-28 05:06:53,640][106225] Updated weights for policy 1, policy_version 1374531 (0.0010) [2023-12-28 05:06:53,700][106225] Updated weights for policy 1, policy_version 1374541 (0.0010) [2023-12-28 05:06:53,763][106225] Updated weights for policy 1, policy_version 1374551 (0.0009) [2023-12-28 05:06:53,779][106226] Updated weights for policy 0, policy_version 1371220 (0.0010) [2023-12-28 05:06:53,830][106226] Updated weights for policy 0, policy_version 1371230 (0.0010) [2023-12-28 05:06:53,886][106226] Updated weights for policy 0, policy_version 1371240 (0.0010) [2023-12-28 05:06:54,415][106225] Updated weights for policy 1, policy_version 1374561 (0.0008) [2023-12-28 05:06:54,472][106225] Updated weights for policy 1, policy_version 1374571 (0.0007) [2023-12-28 05:06:54,532][106226] Updated weights for policy 0, policy_version 1371250 (0.0010) [2023-12-28 05:06:54,535][106225] Updated weights for policy 1, policy_version 1374581 (0.0006) [2023-12-28 05:06:54,590][106226] Updated weights for policy 0, policy_version 1371260 (0.0010) [2023-12-28 05:06:54,639][106226] Updated weights for policy 0, policy_version 1371270 (0.0010) [2023-12-28 05:06:54,697][106226] Updated weights for policy 0, policy_version 1371280 (0.0008) [2023-12-28 05:06:55,204][106225] Updated weights for policy 1, policy_version 1374591 (0.0007) [2023-12-28 05:06:55,260][106225] Updated weights for policy 1, policy_version 1374601 (0.0010) [2023-12-28 05:06:55,313][106225] Updated weights for policy 1, policy_version 1374611 (0.0010) [2023-12-28 05:06:55,391][106226] Updated weights for policy 0, policy_version 1371290 (0.0010) [2023-12-28 05:06:55,437][106226] Updated weights for policy 0, policy_version 1371300 (0.0010) [2023-12-28 05:06:55,496][106226] Updated weights for policy 0, policy_version 1371310 (0.0010) [2023-12-28 05:06:55,898][106225] Updated weights for policy 1, policy_version 1374621 (0.0008) [2023-12-28 05:06:55,963][106225] Updated weights for policy 1, policy_version 1374631 (0.0006) [2023-12-28 05:06:56,016][106225] Updated weights for policy 1, policy_version 1374641 (0.0007) [2023-12-28 05:06:56,129][106226] Updated weights for policy 0, policy_version 1371320 (0.0010) [2023-12-28 05:06:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 703086592. Throughput: 0: 9933.3, 1: 9866.3. Samples: 703053728. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:06:56,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-4.448')] [2023-12-28 05:06:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001374648_351961088.pth... [2023-12-28 05:06:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001373464_351657984.pth [2023-12-28 05:06:56,191][106226] Updated weights for policy 0, policy_version 1371330 (0.0011) [2023-12-28 05:06:56,253][106226] Updated weights for policy 0, policy_version 1371340 (0.0011) [2023-12-28 05:06:56,274][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001371344_351133696.pth... [2023-12-28 05:06:56,278][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001370176_350830592.pth [2023-12-28 05:06:56,726][106225] Updated weights for policy 1, policy_version 1374651 (0.0010) [2023-12-28 05:06:56,791][106225] Updated weights for policy 1, policy_version 1374661 (0.0008) [2023-12-28 05:06:56,849][106225] Updated weights for policy 1, policy_version 1374671 (0.0005) [2023-12-28 05:06:56,940][106226] Updated weights for policy 0, policy_version 1371350 (0.0008) [2023-12-28 05:06:56,990][106226] Updated weights for policy 0, policy_version 1371360 (0.0005) [2023-12-28 05:06:57,051][106226] Updated weights for policy 0, policy_version 1371370 (0.0005) [2023-12-28 05:06:57,383][106225] Updated weights for policy 1, policy_version 1374681 (0.0006) [2023-12-28 05:06:57,440][106225] Updated weights for policy 1, policy_version 1374691 (0.0008) [2023-12-28 05:06:57,486][106225] Updated weights for policy 1, policy_version 1374701 (0.0008) [2023-12-28 05:06:57,533][106225] Updated weights for policy 1, policy_version 1374711 (0.0007) [2023-12-28 05:06:57,676][106226] Updated weights for policy 0, policy_version 1371380 (0.0009) [2023-12-28 05:06:57,735][106226] Updated weights for policy 0, policy_version 1371390 (0.0009) [2023-12-28 05:06:57,793][106226] Updated weights for policy 0, policy_version 1371400 (0.0008) [2023-12-28 05:06:58,139][106225] Updated weights for policy 1, policy_version 1374721 (0.0010) [2023-12-28 05:06:58,188][106225] Updated weights for policy 1, policy_version 1374731 (0.0010) [2023-12-28 05:06:58,252][106225] Updated weights for policy 1, policy_version 1374741 (0.0008) [2023-12-28 05:06:58,578][106226] Updated weights for policy 0, policy_version 1371410 (0.0009) [2023-12-28 05:06:58,667][106226] Updated weights for policy 0, policy_version 1371420 (0.0008) [2023-12-28 05:06:58,732][106226] Updated weights for policy 0, policy_version 1371430 (0.0008) [2023-12-28 05:06:58,803][106226] Updated weights for policy 0, policy_version 1371440 (0.0008) [2023-12-28 05:06:59,040][106225] Updated weights for policy 1, policy_version 1374751 (0.0007) [2023-12-28 05:06:59,095][106225] Updated weights for policy 1, policy_version 1374761 (0.0009) [2023-12-28 05:06:59,156][106225] Updated weights for policy 1, policy_version 1374771 (0.0008) [2023-12-28 05:06:59,531][106226] Updated weights for policy 0, policy_version 1371450 (0.0006) [2023-12-28 05:06:59,593][106226] Updated weights for policy 0, policy_version 1371460 (0.0008) [2023-12-28 05:06:59,653][106226] Updated weights for policy 0, policy_version 1371470 (0.0008) [2023-12-28 05:06:59,999][106225] Updated weights for policy 1, policy_version 1374781 (0.0008) [2023-12-28 05:07:00,062][106225] Updated weights for policy 1, policy_version 1374791 (0.0006) [2023-12-28 05:07:00,122][106225] Updated weights for policy 1, policy_version 1374801 (0.0007) [2023-12-28 05:07:00,306][106226] Updated weights for policy 0, policy_version 1371480 (0.0009) [2023-12-28 05:07:00,365][106226] Updated weights for policy 0, policy_version 1371490 (0.0011) [2023-12-28 05:07:00,423][106226] Updated weights for policy 0, policy_version 1371500 (0.0009) [2023-12-28 05:07:00,811][106225] Updated weights for policy 1, policy_version 1374811 (0.0009) [2023-12-28 05:07:00,861][106225] Updated weights for policy 1, policy_version 1374821 (0.0007) [2023-12-28 05:07:00,925][106225] Updated weights for policy 1, policy_version 1374831 (0.0007) [2023-12-28 05:07:01,105][106226] Updated weights for policy 0, policy_version 1371510 (0.0007) [2023-12-28 05:07:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 703184896. Throughput: 0: 10014.4, 1: 9961.0. Samples: 703176228. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:01,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.614')] [2023-12-28 05:07:01,177][106226] Updated weights for policy 0, policy_version 1371520 (0.0007) [2023-12-28 05:07:01,243][106226] Updated weights for policy 0, policy_version 1371530 (0.0006) [2023-12-28 05:07:01,623][106225] Updated weights for policy 1, policy_version 1374841 (0.0006) [2023-12-28 05:07:01,680][106225] Updated weights for policy 1, policy_version 1374851 (0.0008) [2023-12-28 05:07:01,736][106225] Updated weights for policy 1, policy_version 1374861 (0.0008) [2023-12-28 05:07:01,798][106225] Updated weights for policy 1, policy_version 1374871 (0.0006) [2023-12-28 05:07:01,917][106226] Updated weights for policy 0, policy_version 1371540 (0.0008) [2023-12-28 05:07:01,989][106226] Updated weights for policy 0, policy_version 1371550 (0.0011) [2023-12-28 05:07:02,058][106226] Updated weights for policy 0, policy_version 1371560 (0.0011) [2023-12-28 05:07:02,480][106225] Updated weights for policy 1, policy_version 1374881 (0.0006) [2023-12-28 05:07:02,535][106225] Updated weights for policy 1, policy_version 1374891 (0.0008) [2023-12-28 05:07:02,597][106225] Updated weights for policy 1, policy_version 1374901 (0.0007) [2023-12-28 05:07:02,789][106226] Updated weights for policy 0, policy_version 1371570 (0.0010) [2023-12-28 05:07:02,838][106226] Updated weights for policy 0, policy_version 1371580 (0.0005) [2023-12-28 05:07:02,894][106226] Updated weights for policy 0, policy_version 1371590 (0.0007) [2023-12-28 05:07:02,954][106226] Updated weights for policy 0, policy_version 1371600 (0.0010) [2023-12-28 05:07:03,190][106225] Updated weights for policy 1, policy_version 1374911 (0.0008) [2023-12-28 05:07:03,233][106225] Updated weights for policy 1, policy_version 1374921 (0.0007) [2023-12-28 05:07:03,281][106225] Updated weights for policy 1, policy_version 1374931 (0.0005) [2023-12-28 05:07:03,561][106226] Updated weights for policy 0, policy_version 1371610 (0.0005) [2023-12-28 05:07:03,632][106226] Updated weights for policy 0, policy_version 1371620 (0.0005) [2023-12-28 05:07:03,699][106226] Updated weights for policy 0, policy_version 1371630 (0.0009) [2023-12-28 05:07:03,916][106225] Updated weights for policy 1, policy_version 1374941 (0.0006) [2023-12-28 05:07:03,977][106225] Updated weights for policy 1, policy_version 1374951 (0.0006) [2023-12-28 05:07:04,038][106225] Updated weights for policy 1, policy_version 1374961 (0.0008) [2023-12-28 05:07:04,349][106226] Updated weights for policy 0, policy_version 1371640 (0.0011) [2023-12-28 05:07:04,413][106226] Updated weights for policy 0, policy_version 1371650 (0.0010) [2023-12-28 05:07:04,478][106226] Updated weights for policy 0, policy_version 1371660 (0.0008) [2023-12-28 05:07:04,776][106225] Updated weights for policy 1, policy_version 1374971 (0.0008) [2023-12-28 05:07:04,837][106225] Updated weights for policy 1, policy_version 1374981 (0.0007) [2023-12-28 05:07:04,892][106225] Updated weights for policy 1, policy_version 1374991 (0.0006) [2023-12-28 05:07:05,151][106226] Updated weights for policy 0, policy_version 1371670 (0.0008) [2023-12-28 05:07:05,201][106226] Updated weights for policy 0, policy_version 1371680 (0.0010) [2023-12-28 05:07:05,258][106226] Updated weights for policy 0, policy_version 1371690 (0.0009) [2023-12-28 05:07:05,448][106225] Updated weights for policy 1, policy_version 1375001 (0.0005) [2023-12-28 05:07:05,494][106225] Updated weights for policy 1, policy_version 1375011 (0.0005) [2023-12-28 05:07:05,538][106225] Updated weights for policy 1, policy_version 1375021 (0.0005) [2023-12-28 05:07:05,588][106225] Updated weights for policy 1, policy_version 1375031 (0.0005) [2023-12-28 05:07:05,826][106226] Updated weights for policy 0, policy_version 1371700 (0.0007) [2023-12-28 05:07:05,875][106226] Updated weights for policy 0, policy_version 1371710 (0.0006) [2023-12-28 05:07:05,930][106226] Updated weights for policy 0, policy_version 1371720 (0.0007) [2023-12-28 05:07:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 703291392. Throughput: 0: 9999.5, 1: 10113.5. Samples: 703300516. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:06,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.535')] [2023-12-28 05:07:06,206][106225] Updated weights for policy 1, policy_version 1375041 (0.0006) [2023-12-28 05:07:06,270][106225] Updated weights for policy 1, policy_version 1375051 (0.0007) [2023-12-28 05:07:06,331][106225] Updated weights for policy 1, policy_version 1375061 (0.0008) [2023-12-28 05:07:06,686][106226] Updated weights for policy 0, policy_version 1371730 (0.0008) [2023-12-28 05:07:06,753][106226] Updated weights for policy 0, policy_version 1371740 (0.0009) [2023-12-28 05:07:06,814][106226] Updated weights for policy 0, policy_version 1371750 (0.0011) [2023-12-28 05:07:06,880][106226] Updated weights for policy 0, policy_version 1371760 (0.0011) [2023-12-28 05:07:07,004][106225] Updated weights for policy 1, policy_version 1375071 (0.0006) [2023-12-28 05:07:07,064][106225] Updated weights for policy 1, policy_version 1375081 (0.0007) [2023-12-28 05:07:07,120][106225] Updated weights for policy 1, policy_version 1375091 (0.0007) [2023-12-28 05:07:07,565][106226] Updated weights for policy 0, policy_version 1371770 (0.0005) [2023-12-28 05:07:07,619][106226] Updated weights for policy 0, policy_version 1371780 (0.0005) [2023-12-28 05:07:07,679][106226] Updated weights for policy 0, policy_version 1371790 (0.0006) [2023-12-28 05:07:07,867][106225] Updated weights for policy 1, policy_version 1375101 (0.0007) [2023-12-28 05:07:07,937][106225] Updated weights for policy 1, policy_version 1375111 (0.0005) [2023-12-28 05:07:07,985][106225] Updated weights for policy 1, policy_version 1375121 (0.0005) [2023-12-28 05:07:08,239][106226] Updated weights for policy 0, policy_version 1371800 (0.0010) [2023-12-28 05:07:08,299][106226] Updated weights for policy 0, policy_version 1371810 (0.0010) [2023-12-28 05:07:08,583][106225] Updated weights for policy 1, policy_version 1375131 (0.0006) [2023-12-28 05:07:08,633][106225] Updated weights for policy 1, policy_version 1375141 (0.0007) [2023-12-28 05:07:08,680][106225] Updated weights for policy 1, policy_version 1375151 (0.0006) [2023-12-28 05:07:09,066][106226] Updated weights for policy 0, policy_version 1371825 (0.0011) [2023-12-28 05:07:09,118][106226] Updated weights for policy 0, policy_version 1371835 (0.0010) [2023-12-28 05:07:09,168][106226] Updated weights for policy 0, policy_version 1371845 (0.0010) [2023-12-28 05:07:09,232][106226] Updated weights for policy 0, policy_version 1371855 (0.0010) [2023-12-28 05:07:09,420][106225] Updated weights for policy 1, policy_version 1375161 (0.0006) [2023-12-28 05:07:09,484][106225] Updated weights for policy 1, policy_version 1375171 (0.0011) [2023-12-28 05:07:09,554][106225] Updated weights for policy 1, policy_version 1375181 (0.0011) [2023-12-28 05:07:09,616][106225] Updated weights for policy 1, policy_version 1375191 (0.0011) [2023-12-28 05:07:09,993][106226] Updated weights for policy 0, policy_version 1371865 (0.0010) [2023-12-28 05:07:10,059][106226] Updated weights for policy 0, policy_version 1371875 (0.0011) [2023-12-28 05:07:10,117][106226] Updated weights for policy 0, policy_version 1371885 (0.0011) [2023-12-28 05:07:10,322][106225] Updated weights for policy 1, policy_version 1375201 (0.0010) [2023-12-28 05:07:10,377][106225] Updated weights for policy 1, policy_version 1375211 (0.0010) [2023-12-28 05:07:10,443][106225] Updated weights for policy 1, policy_version 1375221 (0.0010) [2023-12-28 05:07:10,756][106226] Updated weights for policy 0, policy_version 1371895 (0.0011) [2023-12-28 05:07:10,807][106226] Updated weights for policy 0, policy_version 1371905 (0.0010) [2023-12-28 05:07:10,864][106226] Updated weights for policy 0, policy_version 1371915 (0.0011) [2023-12-28 05:07:11,090][106225] Updated weights for policy 1, policy_version 1375231 (0.0011) [2023-12-28 05:07:11,165][106225] Updated weights for policy 1, policy_version 1375241 (0.0009) [2023-12-28 05:07:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 703389696. Throughput: 0: 10006.5, 1: 10158.4. Samples: 703361096. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:11,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.536')] [2023-12-28 05:07:11,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001371920_351281152.pth... [2023-12-28 05:07:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001370736_350978048.pth [2023-12-28 05:07:11,221][106225] Updated weights for policy 1, policy_version 1375251 (0.0009) [2023-12-28 05:07:11,255][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001375256_352116736.pth... [2023-12-28 05:07:11,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001374040_351805440.pth [2023-12-28 05:07:11,682][106226] Updated weights for policy 0, policy_version 1371925 (0.0009) [2023-12-28 05:07:11,756][106226] Updated weights for policy 0, policy_version 1371935 (0.0008) [2023-12-28 05:07:11,825][106226] Updated weights for policy 0, policy_version 1371945 (0.0008) [2023-12-28 05:07:12,020][106225] Updated weights for policy 1, policy_version 1375261 (0.0009) [2023-12-28 05:07:12,088][106225] Updated weights for policy 1, policy_version 1375271 (0.0010) [2023-12-28 05:07:12,152][106225] Updated weights for policy 1, policy_version 1375281 (0.0010) [2023-12-28 05:07:12,574][106226] Updated weights for policy 0, policy_version 1371955 (0.0009) [2023-12-28 05:07:12,628][106226] Updated weights for policy 0, policy_version 1371965 (0.0009) [2023-12-28 05:07:12,691][106226] Updated weights for policy 0, policy_version 1371975 (0.0008) [2023-12-28 05:07:12,874][106225] Updated weights for policy 1, policy_version 1375291 (0.0010) [2023-12-28 05:07:12,925][106225] Updated weights for policy 1, policy_version 1375301 (0.0010) [2023-12-28 05:07:12,974][106225] Updated weights for policy 1, policy_version 1375311 (0.0010) [2023-12-28 05:07:13,354][106226] Updated weights for policy 0, policy_version 1371985 (0.0009) [2023-12-28 05:07:13,417][106226] Updated weights for policy 0, policy_version 1371995 (0.0009) [2023-12-28 05:07:13,478][106226] Updated weights for policy 0, policy_version 1372005 (0.0010) [2023-12-28 05:07:13,543][106226] Updated weights for policy 0, policy_version 1372015 (0.0008) [2023-12-28 05:07:13,640][106225] Updated weights for policy 1, policy_version 1375321 (0.0010) [2023-12-28 05:07:13,703][106225] Updated weights for policy 1, policy_version 1375331 (0.0005) [2023-12-28 05:07:13,758][106225] Updated weights for policy 1, policy_version 1375341 (0.0005) [2023-12-28 05:07:13,813][106225] Updated weights for policy 1, policy_version 1375351 (0.0005) [2023-12-28 05:07:14,200][106226] Updated weights for policy 0, policy_version 1372025 (0.0010) [2023-12-28 05:07:14,261][106226] Updated weights for policy 0, policy_version 1372035 (0.0011) [2023-12-28 05:07:14,317][106226] Updated weights for policy 0, policy_version 1372045 (0.0007) [2023-12-28 05:07:14,321][106225] Updated weights for policy 1, policy_version 1375361 (0.0008) [2023-12-28 05:07:14,385][106225] Updated weights for policy 1, policy_version 1375371 (0.0008) [2023-12-28 05:07:14,443][106225] Updated weights for policy 1, policy_version 1375381 (0.0009) [2023-12-28 05:07:14,899][106226] Updated weights for policy 0, policy_version 1372055 (0.0006) [2023-12-28 05:07:14,968][106226] Updated weights for policy 0, policy_version 1372065 (0.0007) [2023-12-28 05:07:15,030][106226] Updated weights for policy 0, policy_version 1372075 (0.0009) [2023-12-28 05:07:15,132][106225] Updated weights for policy 1, policy_version 1375391 (0.0007) [2023-12-28 05:07:15,203][106225] Updated weights for policy 1, policy_version 1375401 (0.0009) [2023-12-28 05:07:15,267][106225] Updated weights for policy 1, policy_version 1375411 (0.0008) [2023-12-28 05:07:15,582][106226] Updated weights for policy 0, policy_version 1372085 (0.0005) [2023-12-28 05:07:15,648][106226] Updated weights for policy 0, policy_version 1372095 (0.0005) [2023-12-28 05:07:15,708][106226] Updated weights for policy 0, policy_version 1372105 (0.0009) [2023-12-28 05:07:15,838][106225] Updated weights for policy 1, policy_version 1375421 (0.0006) [2023-12-28 05:07:15,891][106225] Updated weights for policy 1, policy_version 1375431 (0.0006) [2023-12-28 05:07:15,952][106225] Updated weights for policy 1, policy_version 1375441 (0.0007) [2023-12-28 05:07:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20206.9, 300 sec: 19882.9). Total num frames: 703496192. Throughput: 0: 10015.8, 1: 10112.2. Samples: 703481200. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:16,176][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.664')] [2023-12-28 05:07:16,260][106226] Updated weights for policy 0, policy_version 1372115 (0.0008) [2023-12-28 05:07:16,310][106226] Updated weights for policy 0, policy_version 1372125 (0.0005) [2023-12-28 05:07:16,359][106226] Updated weights for policy 0, policy_version 1372135 (0.0006) [2023-12-28 05:07:16,564][106225] Updated weights for policy 1, policy_version 1375451 (0.0006) [2023-12-28 05:07:16,613][106225] Updated weights for policy 1, policy_version 1375461 (0.0007) [2023-12-28 05:07:16,671][106225] Updated weights for policy 1, policy_version 1375471 (0.0008) [2023-12-28 05:07:16,977][106226] Updated weights for policy 0, policy_version 1372145 (0.0006) [2023-12-28 05:07:17,039][106226] Updated weights for policy 0, policy_version 1372155 (0.0008) [2023-12-28 05:07:17,098][106226] Updated weights for policy 0, policy_version 1372165 (0.0007) [2023-12-28 05:07:17,148][106226] Updated weights for policy 0, policy_version 1372175 (0.0006) [2023-12-28 05:07:17,341][106225] Updated weights for policy 1, policy_version 1375481 (0.0007) [2023-12-28 05:07:17,409][106225] Updated weights for policy 1, policy_version 1375491 (0.0008) [2023-12-28 05:07:17,456][106225] Updated weights for policy 1, policy_version 1375501 (0.0008) [2023-12-28 05:07:17,505][106225] Updated weights for policy 1, policy_version 1375511 (0.0008) [2023-12-28 05:07:17,821][106226] Updated weights for policy 0, policy_version 1372185 (0.0008) [2023-12-28 05:07:17,882][106226] Updated weights for policy 0, policy_version 1372195 (0.0005) [2023-12-28 05:07:17,949][106226] Updated weights for policy 0, policy_version 1372205 (0.0005) [2023-12-28 05:07:18,271][106225] Updated weights for policy 1, policy_version 1375521 (0.0008) [2023-12-28 05:07:18,330][106225] Updated weights for policy 1, policy_version 1375531 (0.0007) [2023-12-28 05:07:18,389][106225] Updated weights for policy 1, policy_version 1375541 (0.0006) [2023-12-28 05:07:18,470][106226] Updated weights for policy 0, policy_version 1372215 (0.0006) [2023-12-28 05:07:18,538][106226] Updated weights for policy 0, policy_version 1372225 (0.0006) [2023-12-28 05:07:18,607][106226] Updated weights for policy 0, policy_version 1372235 (0.0006) [2023-12-28 05:07:19,149][106225] Updated weights for policy 1, policy_version 1375551 (0.0008) [2023-12-28 05:07:19,199][106225] Updated weights for policy 1, policy_version 1375561 (0.0008) [2023-12-28 05:07:19,252][106226] Updated weights for policy 0, policy_version 1372245 (0.0008) [2023-12-28 05:07:19,278][106225] Updated weights for policy 1, policy_version 1375571 (0.0008) [2023-12-28 05:07:19,318][106226] Updated weights for policy 0, policy_version 1372255 (0.0009) [2023-12-28 05:07:19,388][106226] Updated weights for policy 0, policy_version 1372265 (0.0009) [2023-12-28 05:07:19,927][106225] Updated weights for policy 1, policy_version 1375581 (0.0007) [2023-12-28 05:07:19,998][106225] Updated weights for policy 1, policy_version 1375591 (0.0008) [2023-12-28 05:07:20,057][106225] Updated weights for policy 1, policy_version 1375601 (0.0008) [2023-12-28 05:07:20,230][106226] Updated weights for policy 0, policy_version 1372275 (0.0010) [2023-12-28 05:07:20,299][106226] Updated weights for policy 0, policy_version 1372285 (0.0011) [2023-12-28 05:07:20,368][106226] Updated weights for policy 0, policy_version 1372295 (0.0008) [2023-12-28 05:07:20,811][106225] Updated weights for policy 1, policy_version 1375611 (0.0009) [2023-12-28 05:07:20,872][106225] Updated weights for policy 1, policy_version 1375621 (0.0011) [2023-12-28 05:07:20,931][106225] Updated weights for policy 1, policy_version 1375631 (0.0011) [2023-12-28 05:07:21,018][106226] Updated weights for policy 0, policy_version 1372305 (0.0007) [2023-12-28 05:07:21,093][106226] Updated weights for policy 0, policy_version 1372315 (0.0008) [2023-12-28 05:07:21,161][106226] Updated weights for policy 0, policy_version 1372325 (0.0007) [2023-12-28 05:07:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 703594496. Throughput: 0: 10037.2, 1: 10141.4. Samples: 703605532. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:21,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.600')] [2023-12-28 05:07:21,232][106226] Updated weights for policy 0, policy_version 1372335 (0.0008) [2023-12-28 05:07:21,684][106225] Updated weights for policy 1, policy_version 1375641 (0.0010) [2023-12-28 05:07:21,752][106225] Updated weights for policy 1, policy_version 1375651 (0.0007) [2023-12-28 05:07:21,817][106225] Updated weights for policy 1, policy_version 1375661 (0.0010) [2023-12-28 05:07:21,881][106225] Updated weights for policy 1, policy_version 1375671 (0.0010) [2023-12-28 05:07:22,098][106226] Updated weights for policy 0, policy_version 1372345 (0.0008) [2023-12-28 05:07:22,162][106226] Updated weights for policy 0, policy_version 1372355 (0.0006) [2023-12-28 05:07:22,233][106226] Updated weights for policy 0, policy_version 1372365 (0.0006) [2023-12-28 05:07:22,663][106225] Updated weights for policy 1, policy_version 1375681 (0.0010) [2023-12-28 05:07:22,735][106225] Updated weights for policy 1, policy_version 1375691 (0.0009) [2023-12-28 05:07:22,802][106225] Updated weights for policy 1, policy_version 1375701 (0.0011) [2023-12-28 05:07:22,911][106226] Updated weights for policy 0, policy_version 1372375 (0.0007) [2023-12-28 05:07:22,974][106226] Updated weights for policy 0, policy_version 1372385 (0.0007) [2023-12-28 05:07:23,039][106226] Updated weights for policy 0, policy_version 1372395 (0.0005) [2023-12-28 05:07:23,503][106225] Updated weights for policy 1, policy_version 1375711 (0.0007) [2023-12-28 05:07:23,563][106225] Updated weights for policy 1, policy_version 1375721 (0.0009) [2023-12-28 05:07:23,621][106225] Updated weights for policy 1, policy_version 1375731 (0.0010) [2023-12-28 05:07:23,631][106226] Updated weights for policy 0, policy_version 1372405 (0.0005) [2023-12-28 05:07:23,691][106226] Updated weights for policy 0, policy_version 1372415 (0.0007) [2023-12-28 05:07:23,749][106226] Updated weights for policy 0, policy_version 1372425 (0.0007) [2023-12-28 05:07:24,337][106225] Updated weights for policy 1, policy_version 1375741 (0.0010) [2023-12-28 05:07:24,393][106226] Updated weights for policy 0, policy_version 1372435 (0.0007) [2023-12-28 05:07:24,397][106225] Updated weights for policy 1, policy_version 1375751 (0.0010) [2023-12-28 05:07:24,447][106226] Updated weights for policy 0, policy_version 1372445 (0.0007) [2023-12-28 05:07:24,447][106225] Updated weights for policy 1, policy_version 1375761 (0.0010) [2023-12-28 05:07:24,504][106226] Updated weights for policy 0, policy_version 1372455 (0.0009) [2023-12-28 05:07:25,050][106225] Updated weights for policy 1, policy_version 1375771 (0.0010) [2023-12-28 05:07:25,110][106225] Updated weights for policy 1, policy_version 1375781 (0.0010) [2023-12-28 05:07:25,159][106225] Updated weights for policy 1, policy_version 1375791 (0.0010) [2023-12-28 05:07:25,244][106226] Updated weights for policy 0, policy_version 1372465 (0.0007) [2023-12-28 05:07:25,308][106226] Updated weights for policy 0, policy_version 1372475 (0.0008) [2023-12-28 05:07:25,367][106226] Updated weights for policy 0, policy_version 1372485 (0.0008) [2023-12-28 05:07:25,425][106226] Updated weights for policy 0, policy_version 1372495 (0.0008) [2023-12-28 05:07:25,867][106225] Updated weights for policy 1, policy_version 1375801 (0.0010) [2023-12-28 05:07:25,919][106225] Updated weights for policy 1, policy_version 1375811 (0.0010) [2023-12-28 05:07:25,981][106225] Updated weights for policy 1, policy_version 1375821 (0.0010) [2023-12-28 05:07:26,037][106225] Updated weights for policy 1, policy_version 1375831 (0.0010) [2023-12-28 05:07:26,131][106226] Updated weights for policy 0, policy_version 1372505 (0.0008) [2023-12-28 05:07:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 703692800. Throughput: 0: 9998.3, 1: 10093.3. Samples: 703662932. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:26,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.534')] [2023-12-28 05:07:26,177][106226] Updated weights for policy 0, policy_version 1372515 (0.0007) [2023-12-28 05:07:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001375832_352264192.pth... [2023-12-28 05:07:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001374648_351961088.pth [2023-12-28 05:07:26,235][106226] Updated weights for policy 0, policy_version 1372525 (0.0007) [2023-12-28 05:07:26,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001372528_351436800.pth... [2023-12-28 05:07:26,251][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001371344_351133696.pth [2023-12-28 05:07:26,758][106225] Updated weights for policy 1, policy_version 1375841 (0.0010) [2023-12-28 05:07:26,816][106225] Updated weights for policy 1, policy_version 1375851 (0.0010) [2023-12-28 05:07:26,877][106225] Updated weights for policy 1, policy_version 1375861 (0.0010) [2023-12-28 05:07:26,942][106226] Updated weights for policy 0, policy_version 1372535 (0.0007) [2023-12-28 05:07:26,992][106226] Updated weights for policy 0, policy_version 1372545 (0.0005) [2023-12-28 05:07:27,045][106226] Updated weights for policy 0, policy_version 1372555 (0.0010) [2023-12-28 05:07:27,529][106225] Updated weights for policy 1, policy_version 1375871 (0.0009) [2023-12-28 05:07:27,586][106225] Updated weights for policy 1, policy_version 1375881 (0.0010) [2023-12-28 05:07:27,629][106226] Updated weights for policy 0, policy_version 1372565 (0.0010) [2023-12-28 05:07:27,644][106225] Updated weights for policy 1, policy_version 1375891 (0.0010) [2023-12-28 05:07:27,677][106226] Updated weights for policy 0, policy_version 1372575 (0.0010) [2023-12-28 05:07:27,744][106226] Updated weights for policy 0, policy_version 1372585 (0.0006) [2023-12-28 05:07:28,310][106225] Updated weights for policy 1, policy_version 1375901 (0.0010) [2023-12-28 05:07:28,352][106226] Updated weights for policy 0, policy_version 1372595 (0.0007) [2023-12-28 05:07:28,370][106225] Updated weights for policy 1, policy_version 1375911 (0.0009) [2023-12-28 05:07:28,412][106226] Updated weights for policy 0, policy_version 1372605 (0.0009) [2023-12-28 05:07:28,423][106225] Updated weights for policy 1, policy_version 1375921 (0.0007) [2023-12-28 05:07:28,472][106226] Updated weights for policy 0, policy_version 1372615 (0.0008) [2023-12-28 05:07:29,083][106225] Updated weights for policy 1, policy_version 1375931 (0.0006) [2023-12-28 05:07:29,144][106225] Updated weights for policy 1, policy_version 1375941 (0.0005) [2023-12-28 05:07:29,202][106226] Updated weights for policy 0, policy_version 1372625 (0.0007) [2023-12-28 05:07:29,209][106225] Updated weights for policy 1, policy_version 1375951 (0.0006) [2023-12-28 05:07:29,274][106226] Updated weights for policy 0, policy_version 1372635 (0.0009) [2023-12-28 05:07:29,334][106226] Updated weights for policy 0, policy_version 1372645 (0.0009) [2023-12-28 05:07:29,400][106226] Updated weights for policy 0, policy_version 1372655 (0.0009) [2023-12-28 05:07:29,859][106225] Updated weights for policy 1, policy_version 1375961 (0.0008) [2023-12-28 05:07:29,914][106225] Updated weights for policy 1, policy_version 1375971 (0.0006) [2023-12-28 05:07:29,983][106225] Updated weights for policy 1, policy_version 1375981 (0.0008) [2023-12-28 05:07:30,043][106225] Updated weights for policy 1, policy_version 1375991 (0.0008) [2023-12-28 05:07:30,121][106226] Updated weights for policy 0, policy_version 1372665 (0.0006) [2023-12-28 05:07:30,184][106226] Updated weights for policy 0, policy_version 1372675 (0.0010) [2023-12-28 05:07:30,241][106226] Updated weights for policy 0, policy_version 1372685 (0.0011) [2023-12-28 05:07:30,747][106225] Updated weights for policy 1, policy_version 1376001 (0.0007) [2023-12-28 05:07:30,793][106225] Updated weights for policy 1, policy_version 1376011 (0.0007) [2023-12-28 05:07:30,838][106225] Updated weights for policy 1, policy_version 1376021 (0.0007) [2023-12-28 05:07:30,885][106226] Updated weights for policy 0, policy_version 1372695 (0.0010) [2023-12-28 05:07:30,947][106226] Updated weights for policy 0, policy_version 1372705 (0.0010) [2023-12-28 05:07:31,006][106226] Updated weights for policy 0, policy_version 1372715 (0.0010) [2023-12-28 05:07:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 703799296. Throughput: 0: 10128.5, 1: 10145.7. Samples: 703785516. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:31,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.562')] [2023-12-28 05:07:31,621][106225] Updated weights for policy 1, policy_version 1376031 (0.0008) [2023-12-28 05:07:31,691][106225] Updated weights for policy 1, policy_version 1376041 (0.0008) [2023-12-28 05:07:31,752][106226] Updated weights for policy 0, policy_version 1372725 (0.0009) [2023-12-28 05:07:31,762][106225] Updated weights for policy 1, policy_version 1376051 (0.0008) [2023-12-28 05:07:31,815][106226] Updated weights for policy 0, policy_version 1372735 (0.0007) [2023-12-28 05:07:31,866][106226] Updated weights for policy 0, policy_version 1372745 (0.0009) [2023-12-28 05:07:32,348][106225] Updated weights for policy 1, policy_version 1376061 (0.0008) [2023-12-28 05:07:32,414][106225] Updated weights for policy 1, policy_version 1376071 (0.0009) [2023-12-28 05:07:32,475][106225] Updated weights for policy 1, policy_version 1376081 (0.0008) [2023-12-28 05:07:32,667][106226] Updated weights for policy 0, policy_version 1372755 (0.0010) [2023-12-28 05:07:32,733][106226] Updated weights for policy 0, policy_version 1372765 (0.0011) [2023-12-28 05:07:32,797][106226] Updated weights for policy 0, policy_version 1372775 (0.0007) [2023-12-28 05:07:33,160][106225] Updated weights for policy 1, policy_version 1376091 (0.0007) [2023-12-28 05:07:33,207][106225] Updated weights for policy 1, policy_version 1376101 (0.0005) [2023-12-28 05:07:33,253][106225] Updated weights for policy 1, policy_version 1376111 (0.0006) [2023-12-28 05:07:33,402][106226] Updated weights for policy 0, policy_version 1372785 (0.0009) [2023-12-28 05:07:33,458][106226] Updated weights for policy 0, policy_version 1372795 (0.0008) [2023-12-28 05:07:33,507][106226] Updated weights for policy 0, policy_version 1372805 (0.0009) [2023-12-28 05:07:33,558][106226] Updated weights for policy 0, policy_version 1372815 (0.0007) [2023-12-28 05:07:33,807][106225] Updated weights for policy 1, policy_version 1376121 (0.0006) [2023-12-28 05:07:33,865][106225] Updated weights for policy 1, policy_version 1376131 (0.0010) [2023-12-28 05:07:33,924][106225] Updated weights for policy 1, policy_version 1376141 (0.0010) [2023-12-28 05:07:33,973][106225] Updated weights for policy 1, policy_version 1376151 (0.0010) [2023-12-28 05:07:34,181][106226] Updated weights for policy 0, policy_version 1372825 (0.0008) [2023-12-28 05:07:34,252][106226] Updated weights for policy 0, policy_version 1372835 (0.0006) [2023-12-28 05:07:34,316][106226] Updated weights for policy 0, policy_version 1372845 (0.0008) [2023-12-28 05:07:34,676][106225] Updated weights for policy 1, policy_version 1376161 (0.0006) [2023-12-28 05:07:34,741][106225] Updated weights for policy 1, policy_version 1376171 (0.0007) [2023-12-28 05:07:34,798][106225] Updated weights for policy 1, policy_version 1376181 (0.0010) [2023-12-28 05:07:35,024][106226] Updated weights for policy 0, policy_version 1372855 (0.0008) [2023-12-28 05:07:35,077][106226] Updated weights for policy 0, policy_version 1372865 (0.0008) [2023-12-28 05:07:35,140][106226] Updated weights for policy 0, policy_version 1372875 (0.0008) [2023-12-28 05:07:35,492][106225] Updated weights for policy 1, policy_version 1376191 (0.0010) [2023-12-28 05:07:35,548][106225] Updated weights for policy 1, policy_version 1376201 (0.0010) [2023-12-28 05:07:35,603][106225] Updated weights for policy 1, policy_version 1376211 (0.0010) [2023-12-28 05:07:35,898][106226] Updated weights for policy 0, policy_version 1372885 (0.0008) [2023-12-28 05:07:35,949][106226] Updated weights for policy 0, policy_version 1372895 (0.0006) [2023-12-28 05:07:36,007][106226] Updated weights for policy 0, policy_version 1372905 (0.0006) [2023-12-28 05:07:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 703897600. Throughput: 0: 10074.9, 1: 10113.0. Samples: 703906256. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-28 05:07:36,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.692')] [2023-12-28 05:07:36,256][106225] Updated weights for policy 1, policy_version 1376221 (0.0008) [2023-12-28 05:07:36,315][106225] Updated weights for policy 1, policy_version 1376231 (0.0006) [2023-12-28 05:07:36,379][106225] Updated weights for policy 1, policy_version 1376241 (0.0008) [2023-12-28 05:07:36,657][106226] Updated weights for policy 0, policy_version 1372915 (0.0006) [2023-12-28 05:07:36,726][106226] Updated weights for policy 0, policy_version 1372925 (0.0007) [2023-12-28 05:07:36,790][106226] Updated weights for policy 0, policy_version 1372935 (0.0007) [2023-12-28 05:07:37,024][106225] Updated weights for policy 1, policy_version 1376251 (0.0010) [2023-12-28 05:07:37,089][106225] Updated weights for policy 1, policy_version 1376261 (0.0011) [2023-12-28 05:07:37,150][106225] Updated weights for policy 1, policy_version 1376271 (0.0010) [2023-12-28 05:07:37,380][106226] Updated weights for policy 0, policy_version 1372945 (0.0008) [2023-12-28 05:07:37,442][106226] Updated weights for policy 0, policy_version 1372955 (0.0008) [2023-12-28 05:07:37,503][106226] Updated weights for policy 0, policy_version 1372965 (0.0007) [2023-12-28 05:07:37,561][106226] Updated weights for policy 0, policy_version 1372975 (0.0008) [2023-12-28 05:07:37,872][106225] Updated weights for policy 1, policy_version 1376281 (0.0011) [2023-12-28 05:07:37,922][106225] Updated weights for policy 1, policy_version 1376291 (0.0010) [2023-12-28 05:07:37,972][106225] Updated weights for policy 1, policy_version 1376301 (0.0010) [2023-12-28 05:07:38,028][106225] Updated weights for policy 1, policy_version 1376311 (0.0010) [2023-12-28 05:07:38,252][106226] Updated weights for policy 0, policy_version 1372985 (0.0006) [2023-12-28 05:07:38,303][106226] Updated weights for policy 0, policy_version 1372995 (0.0005) [2023-12-28 05:07:38,370][106226] Updated weights for policy 0, policy_version 1373005 (0.0007) [2023-12-28 05:07:38,735][106225] Updated weights for policy 1, policy_version 1376321 (0.0010) [2023-12-28 05:07:38,797][106225] Updated weights for policy 1, policy_version 1376331 (0.0010) [2023-12-28 05:07:38,858][106225] Updated weights for policy 1, policy_version 1376341 (0.0010) [2023-12-28 05:07:39,105][106226] Updated weights for policy 0, policy_version 1373015 (0.0009) [2023-12-28 05:07:39,161][106226] Updated weights for policy 0, policy_version 1373025 (0.0008) [2023-12-28 05:07:39,218][106226] Updated weights for policy 0, policy_version 1373035 (0.0008) [2023-12-28 05:07:39,581][106225] Updated weights for policy 1, policy_version 1376351 (0.0010) [2023-12-28 05:07:39,642][106225] Updated weights for policy 1, policy_version 1376361 (0.0010) [2023-12-28 05:07:39,697][106225] Updated weights for policy 1, policy_version 1376371 (0.0010) [2023-12-28 05:07:39,960][106226] Updated weights for policy 0, policy_version 1373045 (0.0008) [2023-12-28 05:07:40,018][106226] Updated weights for policy 0, policy_version 1373055 (0.0008) [2023-12-28 05:07:40,077][106226] Updated weights for policy 0, policy_version 1373065 (0.0008) [2023-12-28 05:07:40,474][106225] Updated weights for policy 1, policy_version 1376381 (0.0008) [2023-12-28 05:07:40,540][106225] Updated weights for policy 1, policy_version 1376391 (0.0005) [2023-12-28 05:07:40,612][106225] Updated weights for policy 1, policy_version 1376401 (0.0008) [2023-12-28 05:07:40,717][106226] Updated weights for policy 0, policy_version 1373075 (0.0008) [2023-12-28 05:07:40,777][106226] Updated weights for policy 0, policy_version 1373085 (0.0005) [2023-12-28 05:07:40,837][106226] Updated weights for policy 0, policy_version 1373095 (0.0006) [2023-12-28 05:07:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19882.9). Total num frames: 703995904. Throughput: 0: 10140.2, 1: 10171.6. Samples: 703967760. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:07:41,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-4.436')] [2023-12-28 05:07:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001376408_352411648.pth... [2023-12-28 05:07:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001373104_351584256.pth... [2023-12-28 05:07:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001371920_351281152.pth [2023-12-28 05:07:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001375256_352116736.pth [2023-12-28 05:07:41,262][106225] Updated weights for policy 1, policy_version 1376411 (0.0011) [2023-12-28 05:07:41,311][106225] Updated weights for policy 1, policy_version 1376421 (0.0009) [2023-12-28 05:07:41,364][106225] Updated weights for policy 1, policy_version 1376431 (0.0010) [2023-12-28 05:07:41,451][106226] Updated weights for policy 0, policy_version 1373105 (0.0006) [2023-12-28 05:07:41,506][106226] Updated weights for policy 0, policy_version 1373115 (0.0007) [2023-12-28 05:07:41,565][106226] Updated weights for policy 0, policy_version 1373125 (0.0010) [2023-12-28 05:07:41,624][106226] Updated weights for policy 0, policy_version 1373135 (0.0009) [2023-12-28 05:07:42,083][106225] Updated weights for policy 1, policy_version 1376441 (0.0010) [2023-12-28 05:07:42,148][106225] Updated weights for policy 1, policy_version 1376451 (0.0010) [2023-12-28 05:07:42,212][106225] Updated weights for policy 1, policy_version 1376461 (0.0011) [2023-12-28 05:07:42,280][106225] Updated weights for policy 1, policy_version 1376471 (0.0011) [2023-12-28 05:07:42,379][106226] Updated weights for policy 0, policy_version 1373145 (0.0008) [2023-12-28 05:07:42,430][106226] Updated weights for policy 0, policy_version 1373155 (0.0007) [2023-12-28 05:07:42,480][106226] Updated weights for policy 0, policy_version 1373165 (0.0008) [2023-12-28 05:07:42,988][106225] Updated weights for policy 1, policy_version 1376481 (0.0010) [2023-12-28 05:07:43,042][106225] Updated weights for policy 1, policy_version 1376491 (0.0010) [2023-12-28 05:07:43,093][106225] Updated weights for policy 1, policy_version 1376501 (0.0010) [2023-12-28 05:07:43,174][106226] Updated weights for policy 0, policy_version 1373175 (0.0008) [2023-12-28 05:07:43,231][106226] Updated weights for policy 0, policy_version 1373185 (0.0008) [2023-12-28 05:07:43,288][106226] Updated weights for policy 0, policy_version 1373195 (0.0008) [2023-12-28 05:07:43,832][106225] Updated weights for policy 1, policy_version 1376511 (0.0010) [2023-12-28 05:07:43,886][106225] Updated weights for policy 1, policy_version 1376521 (0.0008) [2023-12-28 05:07:43,932][106225] Updated weights for policy 1, policy_version 1376531 (0.0007) [2023-12-28 05:07:43,934][106226] Updated weights for policy 0, policy_version 1373205 (0.0006) [2023-12-28 05:07:43,991][106226] Updated weights for policy 0, policy_version 1373215 (0.0009) [2023-12-28 05:07:44,045][106226] Updated weights for policy 0, policy_version 1373225 (0.0008) [2023-12-28 05:07:44,598][106225] Updated weights for policy 1, policy_version 1376541 (0.0007) [2023-12-28 05:07:44,646][106225] Updated weights for policy 1, policy_version 1376551 (0.0005) [2023-12-28 05:07:44,692][106225] Updated weights for policy 1, policy_version 1376561 (0.0005) [2023-12-28 05:07:44,821][106226] Updated weights for policy 0, policy_version 1373235 (0.0009) [2023-12-28 05:07:44,890][106226] Updated weights for policy 0, policy_version 1373245 (0.0009) [2023-12-28 05:07:44,957][106226] Updated weights for policy 0, policy_version 1373255 (0.0008) [2023-12-28 05:07:45,374][106225] Updated weights for policy 1, policy_version 1376571 (0.0006) [2023-12-28 05:07:45,434][106225] Updated weights for policy 1, policy_version 1376581 (0.0009) [2023-12-28 05:07:45,490][106225] Updated weights for policy 1, policy_version 1376591 (0.0008) [2023-12-28 05:07:45,666][106226] Updated weights for policy 0, policy_version 1373265 (0.0009) [2023-12-28 05:07:45,720][106226] Updated weights for policy 0, policy_version 1373275 (0.0008) [2023-12-28 05:07:45,782][106226] Updated weights for policy 0, policy_version 1373285 (0.0008) [2023-12-28 05:07:45,833][106226] Updated weights for policy 0, policy_version 1373295 (0.0010) [2023-12-28 05:07:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19882.9). Total num frames: 704094208. Throughput: 0: 10111.8, 1: 10098.8. Samples: 704085708. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:07:46,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.587')] [2023-12-28 05:07:46,265][106225] Updated weights for policy 1, policy_version 1376601 (0.0009) [2023-12-28 05:07:46,318][106225] Updated weights for policy 1, policy_version 1376611 (0.0008) [2023-12-28 05:07:46,376][106225] Updated weights for policy 1, policy_version 1376621 (0.0009) [2023-12-28 05:07:46,426][106226] Updated weights for policy 0, policy_version 1373305 (0.0006) [2023-12-28 05:07:46,436][106225] Updated weights for policy 1, policy_version 1376631 (0.0008) [2023-12-28 05:07:46,489][106226] Updated weights for policy 0, policy_version 1373315 (0.0005) [2023-12-28 05:07:46,551][106226] Updated weights for policy 0, policy_version 1373325 (0.0005) [2023-12-28 05:07:47,111][106226] Updated weights for policy 0, policy_version 1373335 (0.0009) [2023-12-28 05:07:47,176][106226] Updated weights for policy 0, policy_version 1373345 (0.0011) [2023-12-28 05:07:47,231][106225] Updated weights for policy 1, policy_version 1376641 (0.0008) [2023-12-28 05:07:47,247][106226] Updated weights for policy 0, policy_version 1373355 (0.0011) [2023-12-28 05:07:47,285][106225] Updated weights for policy 1, policy_version 1376651 (0.0007) [2023-12-28 05:07:47,334][106225] Updated weights for policy 1, policy_version 1376661 (0.0008) [2023-12-28 05:07:47,938][106226] Updated weights for policy 0, policy_version 1373365 (0.0010) [2023-12-28 05:07:48,000][106226] Updated weights for policy 0, policy_version 1373375 (0.0010) [2023-12-28 05:07:48,055][106226] Updated weights for policy 0, policy_version 1373385 (0.0010) [2023-12-28 05:07:48,067][106225] Updated weights for policy 1, policy_version 1376671 (0.0008) [2023-12-28 05:07:48,123][106225] Updated weights for policy 1, policy_version 1376681 (0.0007) [2023-12-28 05:07:48,180][106225] Updated weights for policy 1, policy_version 1376691 (0.0008) [2023-12-28 05:07:48,801][106226] Updated weights for policy 0, policy_version 1373395 (0.0010) [2023-12-28 05:07:48,862][106226] Updated weights for policy 0, policy_version 1373405 (0.0008) [2023-12-28 05:07:48,924][106225] Updated weights for policy 1, policy_version 1376701 (0.0007) [2023-12-28 05:07:48,929][106226] Updated weights for policy 0, policy_version 1373415 (0.0007) [2023-12-28 05:07:48,973][106225] Updated weights for policy 1, policy_version 1376711 (0.0005) [2023-12-28 05:07:49,019][106225] Updated weights for policy 1, policy_version 1376721 (0.0005) [2023-12-28 05:07:49,646][106226] Updated weights for policy 0, policy_version 1373425 (0.0008) [2023-12-28 05:07:49,698][106226] Updated weights for policy 0, policy_version 1373435 (0.0009) [2023-12-28 05:07:49,720][106225] Updated weights for policy 1, policy_version 1376731 (0.0005) [2023-12-28 05:07:49,751][106226] Updated weights for policy 0, policy_version 1373445 (0.0008) [2023-12-28 05:07:49,767][106225] Updated weights for policy 1, policy_version 1376741 (0.0006) [2023-12-28 05:07:49,805][106226] Updated weights for policy 0, policy_version 1373455 (0.0007) [2023-12-28 05:07:49,843][106225] Updated weights for policy 1, policy_version 1376751 (0.0008) [2023-12-28 05:07:50,530][106226] Updated weights for policy 0, policy_version 1373465 (0.0008) [2023-12-28 05:07:50,598][106226] Updated weights for policy 0, policy_version 1373475 (0.0009) [2023-12-28 05:07:50,611][106225] Updated weights for policy 1, policy_version 1376761 (0.0008) [2023-12-28 05:07:50,665][106226] Updated weights for policy 0, policy_version 1373485 (0.0007) [2023-12-28 05:07:50,675][106225] Updated weights for policy 1, policy_version 1376771 (0.0008) [2023-12-28 05:07:50,735][106225] Updated weights for policy 1, policy_version 1376781 (0.0009) [2023-12-28 05:07:50,794][106225] Updated weights for policy 1, policy_version 1376791 (0.0009) [2023-12-28 05:07:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 704192512. Throughput: 0: 10100.9, 1: 9966.1. Samples: 704203528. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:07:51,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.456')] [2023-12-28 05:07:51,319][106226] Updated weights for policy 0, policy_version 1373495 (0.0008) [2023-12-28 05:07:51,389][106226] Updated weights for policy 0, policy_version 1373505 (0.0008) [2023-12-28 05:07:51,436][106226] Updated weights for policy 0, policy_version 1373515 (0.0008) [2023-12-28 05:07:51,594][106225] Updated weights for policy 1, policy_version 1376801 (0.0007) [2023-12-28 05:07:51,669][106225] Updated weights for policy 1, policy_version 1376812 (0.0009) [2023-12-28 05:07:51,741][106225] Updated weights for policy 1, policy_version 1376822 (0.0012) [2023-12-28 05:07:52,240][106226] Updated weights for policy 0, policy_version 1373525 (0.0008) [2023-12-28 05:07:52,309][106226] Updated weights for policy 0, policy_version 1373535 (0.0008) [2023-12-28 05:07:52,376][106226] Updated weights for policy 0, policy_version 1373545 (0.0009) [2023-12-28 05:07:52,419][106225] Updated weights for policy 1, policy_version 1376832 (0.0006) [2023-12-28 05:07:52,480][106225] Updated weights for policy 1, policy_version 1376842 (0.0008) [2023-12-28 05:07:52,547][106225] Updated weights for policy 1, policy_version 1376852 (0.0009) [2023-12-28 05:07:53,143][106226] Updated weights for policy 0, policy_version 1373555 (0.0009) [2023-12-28 05:07:53,195][106226] Updated weights for policy 0, policy_version 1373565 (0.0007) [2023-12-28 05:07:53,226][106225] Updated weights for policy 1, policy_version 1376862 (0.0007) [2023-12-28 05:07:53,244][106226] Updated weights for policy 0, policy_version 1373575 (0.0005) [2023-12-28 05:07:53,281][106225] Updated weights for policy 1, policy_version 1376872 (0.0009) [2023-12-28 05:07:53,347][106225] Updated weights for policy 1, policy_version 1376882 (0.0010) [2023-12-28 05:07:53,789][106226] Updated weights for policy 0, policy_version 1373585 (0.0005) [2023-12-28 05:07:53,857][106226] Updated weights for policy 0, policy_version 1373595 (0.0008) [2023-12-28 05:07:53,920][106226] Updated weights for policy 0, policy_version 1373605 (0.0008) [2023-12-28 05:07:53,975][106226] Updated weights for policy 0, policy_version 1373615 (0.0006) [2023-12-28 05:07:53,998][106225] Updated weights for policy 1, policy_version 1376892 (0.0010) [2023-12-28 05:07:54,053][106225] Updated weights for policy 1, policy_version 1376902 (0.0010) [2023-12-28 05:07:54,120][106225] Updated weights for policy 1, policy_version 1376912 (0.0010) [2023-12-28 05:07:54,642][106226] Updated weights for policy 0, policy_version 1373625 (0.0007) [2023-12-28 05:07:54,699][106226] Updated weights for policy 0, policy_version 1373635 (0.0008) [2023-12-28 05:07:54,758][106226] Updated weights for policy 0, policy_version 1373645 (0.0007) [2023-12-28 05:07:54,781][106225] Updated weights for policy 1, policy_version 1376922 (0.0010) [2023-12-28 05:07:54,831][106225] Updated weights for policy 1, policy_version 1376932 (0.0010) [2023-12-28 05:07:54,881][106225] Updated weights for policy 1, policy_version 1376942 (0.0010) [2023-12-28 05:07:54,931][106225] Updated weights for policy 1, policy_version 1376952 (0.0010) [2023-12-28 05:07:55,439][106226] Updated weights for policy 0, policy_version 1373655 (0.0006) [2023-12-28 05:07:55,496][106226] Updated weights for policy 0, policy_version 1373665 (0.0005) [2023-12-28 05:07:55,554][106226] Updated weights for policy 0, policy_version 1373675 (0.0005) [2023-12-28 05:07:55,609][106225] Updated weights for policy 1, policy_version 1376962 (0.0010) [2023-12-28 05:07:55,655][106225] Updated weights for policy 1, policy_version 1376972 (0.0010) [2023-12-28 05:07:55,698][106225] Updated weights for policy 1, policy_version 1376982 (0.0010) [2023-12-28 05:07:56,139][106226] Updated weights for policy 0, policy_version 1373685 (0.0007) [2023-12-28 05:07:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 704290816. Throughput: 0: 10091.8, 1: 9933.7. Samples: 704262248. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:07:56,176][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.543')] [2023-12-28 05:07:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001376984_352559104.pth... [2023-12-28 05:07:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001375832_352264192.pth [2023-12-28 05:07:56,191][106226] Updated weights for policy 0, policy_version 1373695 (0.0009) [2023-12-28 05:07:56,248][106226] Updated weights for policy 0, policy_version 1373705 (0.0009) [2023-12-28 05:07:56,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001373712_351739904.pth... [2023-12-28 05:07:56,283][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001372528_351436800.pth [2023-12-28 05:07:56,401][106225] Updated weights for policy 1, policy_version 1376992 (0.0009) [2023-12-28 05:07:56,458][106225] Updated weights for policy 1, policy_version 1377002 (0.0010) [2023-12-28 05:07:56,515][106225] Updated weights for policy 1, policy_version 1377012 (0.0010) [2023-12-28 05:07:56,880][106226] Updated weights for policy 0, policy_version 1373715 (0.0008) [2023-12-28 05:07:56,928][106226] Updated weights for policy 0, policy_version 1373725 (0.0008) [2023-12-28 05:07:56,975][106226] Updated weights for policy 0, policy_version 1373735 (0.0008) [2023-12-28 05:07:57,225][106225] Updated weights for policy 1, policy_version 1377022 (0.0010) [2023-12-28 05:07:57,285][106225] Updated weights for policy 1, policy_version 1377032 (0.0010) [2023-12-28 05:07:57,341][106225] Updated weights for policy 1, policy_version 1377042 (0.0010) [2023-12-28 05:07:57,609][106226] Updated weights for policy 0, policy_version 1373745 (0.0007) [2023-12-28 05:07:57,657][106226] Updated weights for policy 0, policy_version 1373755 (0.0005) [2023-12-28 05:07:57,707][106226] Updated weights for policy 0, policy_version 1373765 (0.0005) [2023-12-28 05:07:57,755][106226] Updated weights for policy 0, policy_version 1373775 (0.0007) [2023-12-28 05:07:58,036][106225] Updated weights for policy 1, policy_version 1377052 (0.0010) [2023-12-28 05:07:58,099][106225] Updated weights for policy 1, policy_version 1377062 (0.0007) [2023-12-28 05:07:58,152][106225] Updated weights for policy 1, policy_version 1377072 (0.0008) [2023-12-28 05:07:58,428][106226] Updated weights for policy 0, policy_version 1373785 (0.0008) [2023-12-28 05:07:58,494][106226] Updated weights for policy 0, policy_version 1373795 (0.0008) [2023-12-28 05:07:58,564][106226] Updated weights for policy 0, policy_version 1373805 (0.0008) [2023-12-28 05:07:58,948][106225] Updated weights for policy 1, policy_version 1377082 (0.0010) [2023-12-28 05:07:59,005][106225] Updated weights for policy 1, policy_version 1377092 (0.0009) [2023-12-28 05:07:59,067][106225] Updated weights for policy 1, policy_version 1377102 (0.0008) [2023-12-28 05:07:59,123][106225] Updated weights for policy 1, policy_version 1377112 (0.0008) [2023-12-28 05:07:59,400][106226] Updated weights for policy 0, policy_version 1373815 (0.0009) [2023-12-28 05:07:59,463][106226] Updated weights for policy 0, policy_version 1373825 (0.0008) [2023-12-28 05:07:59,526][106226] Updated weights for policy 0, policy_version 1373835 (0.0009) [2023-12-28 05:07:59,800][106225] Updated weights for policy 1, policy_version 1377122 (0.0008) [2023-12-28 05:07:59,863][106225] Updated weights for policy 1, policy_version 1377132 (0.0009) [2023-12-28 05:07:59,931][106225] Updated weights for policy 1, policy_version 1377142 (0.0008) [2023-12-28 05:08:00,248][106226] Updated weights for policy 0, policy_version 1373845 (0.0009) [2023-12-28 05:08:00,301][106226] Updated weights for policy 0, policy_version 1373855 (0.0005) [2023-12-28 05:08:00,357][106226] Updated weights for policy 0, policy_version 1373865 (0.0007) [2023-12-28 05:08:00,726][106225] Updated weights for policy 1, policy_version 1377152 (0.0009) [2023-12-28 05:08:00,778][106225] Updated weights for policy 1, policy_version 1377162 (0.0008) [2023-12-28 05:08:00,831][106225] Updated weights for policy 1, policy_version 1377172 (0.0008) [2023-12-28 05:08:00,981][106226] Updated weights for policy 0, policy_version 1373875 (0.0008) [2023-12-28 05:08:01,038][106226] Updated weights for policy 0, policy_version 1373885 (0.0007) [2023-12-28 05:08:01,097][106226] Updated weights for policy 0, policy_version 1373895 (0.0008) [2023-12-28 05:08:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 704397312. Throughput: 0: 10130.1, 1: 9905.5. Samples: 704382796. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:01,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.803')] [2023-12-28 05:08:01,636][106225] Updated weights for policy 1, policy_version 1377182 (0.0008) [2023-12-28 05:08:01,689][106225] Updated weights for policy 1, policy_version 1377192 (0.0008) [2023-12-28 05:08:01,761][106225] Updated weights for policy 1, policy_version 1377202 (0.0009) [2023-12-28 05:08:01,791][106226] Updated weights for policy 0, policy_version 1373905 (0.0008) [2023-12-28 05:08:01,843][106226] Updated weights for policy 0, policy_version 1373915 (0.0006) [2023-12-28 05:08:01,902][106226] Updated weights for policy 0, policy_version 1373925 (0.0005) [2023-12-28 05:08:01,961][106226] Updated weights for policy 0, policy_version 1373935 (0.0007) [2023-12-28 05:08:02,371][106225] Updated weights for policy 1, policy_version 1377212 (0.0007) [2023-12-28 05:08:02,429][106225] Updated weights for policy 1, policy_version 1377222 (0.0006) [2023-12-28 05:08:02,486][106225] Updated weights for policy 1, policy_version 1377232 (0.0005) [2023-12-28 05:08:02,657][106226] Updated weights for policy 0, policy_version 1373945 (0.0009) [2023-12-28 05:08:02,717][106226] Updated weights for policy 0, policy_version 1373955 (0.0007) [2023-12-28 05:08:02,783][106226] Updated weights for policy 0, policy_version 1373965 (0.0005) [2023-12-28 05:08:03,114][106225] Updated weights for policy 1, policy_version 1377242 (0.0006) [2023-12-28 05:08:03,171][106225] Updated weights for policy 1, policy_version 1377252 (0.0009) [2023-12-28 05:08:03,232][106225] Updated weights for policy 1, policy_version 1377262 (0.0009) [2023-12-28 05:08:03,298][106225] Updated weights for policy 1, policy_version 1377272 (0.0005) [2023-12-28 05:08:03,417][106226] Updated weights for policy 0, policy_version 1373975 (0.0005) [2023-12-28 05:08:03,482][106226] Updated weights for policy 0, policy_version 1373985 (0.0006) [2023-12-28 05:08:03,544][106226] Updated weights for policy 0, policy_version 1373995 (0.0007) [2023-12-28 05:08:03,928][106225] Updated weights for policy 1, policy_version 1377282 (0.0008) [2023-12-28 05:08:03,985][106225] Updated weights for policy 1, policy_version 1377292 (0.0007) [2023-12-28 05:08:04,058][106225] Updated weights for policy 1, policy_version 1377302 (0.0010) [2023-12-28 05:08:04,139][106226] Updated weights for policy 0, policy_version 1374005 (0.0007) [2023-12-28 05:08:04,194][106226] Updated weights for policy 0, policy_version 1374015 (0.0009) [2023-12-28 05:08:04,252][106226] Updated weights for policy 0, policy_version 1374025 (0.0009) [2023-12-28 05:08:04,815][106225] Updated weights for policy 1, policy_version 1377312 (0.0009) [2023-12-28 05:08:04,873][106225] Updated weights for policy 1, policy_version 1377322 (0.0009) [2023-12-28 05:08:04,929][106225] Updated weights for policy 1, policy_version 1377332 (0.0010) [2023-12-28 05:08:04,933][106226] Updated weights for policy 0, policy_version 1374035 (0.0008) [2023-12-28 05:08:04,988][106226] Updated weights for policy 0, policy_version 1374045 (0.0005) [2023-12-28 05:08:05,040][106226] Updated weights for policy 0, policy_version 1374055 (0.0009) [2023-12-28 05:08:05,634][106226] Updated weights for policy 0, policy_version 1374065 (0.0007) [2023-12-28 05:08:05,696][106226] Updated weights for policy 0, policy_version 1374075 (0.0007) [2023-12-28 05:08:05,711][106225] Updated weights for policy 1, policy_version 1377342 (0.0009) [2023-12-28 05:08:05,744][106226] Updated weights for policy 0, policy_version 1374085 (0.0007) [2023-12-28 05:08:05,772][106225] Updated weights for policy 1, policy_version 1377352 (0.0006) [2023-12-28 05:08:05,794][106226] Updated weights for policy 0, policy_version 1374095 (0.0006) [2023-12-28 05:08:05,827][106225] Updated weights for policy 1, policy_version 1377362 (0.0008) [2023-12-28 05:08:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 704495616. Throughput: 0: 10129.6, 1: 9851.9. Samples: 704504700. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:06,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.425')] [2023-12-28 05:08:06,429][106226] Updated weights for policy 0, policy_version 1374105 (0.0009) [2023-12-28 05:08:06,489][106226] Updated weights for policy 0, policy_version 1374115 (0.0009) [2023-12-28 05:08:06,542][106226] Updated weights for policy 0, policy_version 1374125 (0.0009) [2023-12-28 05:08:06,586][106225] Updated weights for policy 1, policy_version 1377372 (0.0007) [2023-12-28 05:08:06,656][106225] Updated weights for policy 1, policy_version 1377382 (0.0008) [2023-12-28 05:08:06,725][106225] Updated weights for policy 1, policy_version 1377392 (0.0008) [2023-12-28 05:08:07,275][106226] Updated weights for policy 0, policy_version 1374135 (0.0010) [2023-12-28 05:08:07,331][106226] Updated weights for policy 0, policy_version 1374145 (0.0011) [2023-12-28 05:08:07,384][106226] Updated weights for policy 0, policy_version 1374155 (0.0011) [2023-12-28 05:08:07,450][106225] Updated weights for policy 1, policy_version 1377402 (0.0008) [2023-12-28 05:08:07,515][106225] Updated weights for policy 1, policy_version 1377412 (0.0009) [2023-12-28 05:08:07,580][106225] Updated weights for policy 1, policy_version 1377422 (0.0010) [2023-12-28 05:08:07,644][106225] Updated weights for policy 1, policy_version 1377432 (0.0011) [2023-12-28 05:08:08,049][106226] Updated weights for policy 0, policy_version 1374165 (0.0007) [2023-12-28 05:08:08,112][106226] Updated weights for policy 0, policy_version 1374175 (0.0006) [2023-12-28 05:08:08,168][106226] Updated weights for policy 0, policy_version 1374185 (0.0005) [2023-12-28 05:08:08,364][106225] Updated weights for policy 1, policy_version 1377442 (0.0007) [2023-12-28 05:08:08,429][106225] Updated weights for policy 1, policy_version 1377452 (0.0007) [2023-12-28 05:08:08,489][106225] Updated weights for policy 1, policy_version 1377462 (0.0007) [2023-12-28 05:08:08,738][106226] Updated weights for policy 0, policy_version 1374195 (0.0006) [2023-12-28 05:08:08,802][106226] Updated weights for policy 0, policy_version 1374205 (0.0007) [2023-12-28 05:08:08,861][106226] Updated weights for policy 0, policy_version 1374215 (0.0007) [2023-12-28 05:08:09,195][106225] Updated weights for policy 1, policy_version 1377472 (0.0008) [2023-12-28 05:08:09,260][106225] Updated weights for policy 1, policy_version 1377482 (0.0010) [2023-12-28 05:08:09,311][106225] Updated weights for policy 1, policy_version 1377492 (0.0010) [2023-12-28 05:08:09,539][106226] Updated weights for policy 0, policy_version 1374225 (0.0007) [2023-12-28 05:08:09,599][106226] Updated weights for policy 0, policy_version 1374235 (0.0009) [2023-12-28 05:08:09,659][106226] Updated weights for policy 0, policy_version 1374245 (0.0009) [2023-12-28 05:08:09,720][106226] Updated weights for policy 0, policy_version 1374255 (0.0006) [2023-12-28 05:08:10,102][106225] Updated weights for policy 1, policy_version 1377502 (0.0009) [2023-12-28 05:08:10,155][106225] Updated weights for policy 1, policy_version 1377512 (0.0009) [2023-12-28 05:08:10,204][106225] Updated weights for policy 1, policy_version 1377522 (0.0009) [2023-12-28 05:08:10,432][106226] Updated weights for policy 0, policy_version 1374265 (0.0006) [2023-12-28 05:08:10,485][106226] Updated weights for policy 0, policy_version 1374275 (0.0007) [2023-12-28 05:08:10,533][106226] Updated weights for policy 0, policy_version 1374285 (0.0009) [2023-12-28 05:08:10,918][106225] Updated weights for policy 1, policy_version 1377532 (0.0008) [2023-12-28 05:08:10,971][106225] Updated weights for policy 1, policy_version 1377542 (0.0007) [2023-12-28 05:08:11,019][106225] Updated weights for policy 1, policy_version 1377552 (0.0006) [2023-12-28 05:08:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 704593920. Throughput: 0: 10172.2, 1: 9844.0. Samples: 704563664. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:11,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.426')] [2023-12-28 05:08:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001377560_352706560.pth... [2023-12-28 05:08:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001374288_351887360.pth... [2023-12-28 05:08:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001376408_352411648.pth [2023-12-28 05:08:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001373104_351584256.pth [2023-12-28 05:08:11,310][106226] Updated weights for policy 0, policy_version 1374295 (0.0009) [2023-12-28 05:08:11,378][106226] Updated weights for policy 0, policy_version 1374305 (0.0009) [2023-12-28 05:08:11,441][106226] Updated weights for policy 0, policy_version 1374315 (0.0009) [2023-12-28 05:08:11,778][106225] Updated weights for policy 1, policy_version 1377562 (0.0008) [2023-12-28 05:08:11,847][106225] Updated weights for policy 1, policy_version 1377572 (0.0009) [2023-12-28 05:08:11,907][106225] Updated weights for policy 1, policy_version 1377582 (0.0008) [2023-12-28 05:08:11,970][106225] Updated weights for policy 1, policy_version 1377592 (0.0009) [2023-12-28 05:08:12,195][106226] Updated weights for policy 0, policy_version 1374325 (0.0009) [2023-12-28 05:08:12,263][106226] Updated weights for policy 0, policy_version 1374335 (0.0009) [2023-12-28 05:08:12,332][106226] Updated weights for policy 0, policy_version 1374345 (0.0008) [2023-12-28 05:08:12,711][106225] Updated weights for policy 1, policy_version 1377602 (0.0008) [2023-12-28 05:08:12,762][106225] Updated weights for policy 1, policy_version 1377612 (0.0008) [2023-12-28 05:08:12,822][106225] Updated weights for policy 1, policy_version 1377622 (0.0009) [2023-12-28 05:08:13,008][106226] Updated weights for policy 0, policy_version 1374355 (0.0007) [2023-12-28 05:08:13,054][106226] Updated weights for policy 0, policy_version 1374365 (0.0006) [2023-12-28 05:08:13,104][106226] Updated weights for policy 0, policy_version 1374375 (0.0009) [2023-12-28 05:08:13,501][106225] Updated weights for policy 1, policy_version 1377632 (0.0010) [2023-12-28 05:08:13,550][106225] Updated weights for policy 1, policy_version 1377642 (0.0010) [2023-12-28 05:08:13,606][106225] Updated weights for policy 1, policy_version 1377652 (0.0010) [2023-12-28 05:08:13,866][106226] Updated weights for policy 0, policy_version 1374385 (0.0008) [2023-12-28 05:08:13,924][106226] Updated weights for policy 0, policy_version 1374395 (0.0008) [2023-12-28 05:08:13,977][106226] Updated weights for policy 0, policy_version 1374405 (0.0007) [2023-12-28 05:08:14,038][106226] Updated weights for policy 0, policy_version 1374415 (0.0008) [2023-12-28 05:08:14,292][106225] Updated weights for policy 1, policy_version 1377662 (0.0010) [2023-12-28 05:08:14,351][106225] Updated weights for policy 1, policy_version 1377672 (0.0010) [2023-12-28 05:08:14,411][106225] Updated weights for policy 1, policy_version 1377682 (0.0010) [2023-12-28 05:08:14,770][106226] Updated weights for policy 0, policy_version 1374425 (0.0008) [2023-12-28 05:08:14,835][106226] Updated weights for policy 0, policy_version 1374435 (0.0008) [2023-12-28 05:08:14,894][106226] Updated weights for policy 0, policy_version 1374445 (0.0009) [2023-12-28 05:08:15,129][106225] Updated weights for policy 1, policy_version 1377692 (0.0011) [2023-12-28 05:08:15,213][106225] Updated weights for policy 1, policy_version 1377702 (0.0011) [2023-12-28 05:08:15,274][106225] Updated weights for policy 1, policy_version 1377712 (0.0011) [2023-12-28 05:08:15,640][106226] Updated weights for policy 0, policy_version 1374455 (0.0007) [2023-12-28 05:08:15,701][106226] Updated weights for policy 0, policy_version 1374465 (0.0006) [2023-12-28 05:08:15,753][106226] Updated weights for policy 0, policy_version 1374475 (0.0006) [2023-12-28 05:08:15,970][106225] Updated weights for policy 1, policy_version 1377722 (0.0010) [2023-12-28 05:08:16,036][106225] Updated weights for policy 1, policy_version 1377732 (0.0008) [2023-12-28 05:08:16,093][106225] Updated weights for policy 1, policy_version 1377742 (0.0008) [2023-12-28 05:08:16,145][106225] Updated weights for policy 1, policy_version 1377752 (0.0008) [2023-12-28 05:08:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 704692224. Throughput: 0: 10086.6, 1: 9761.4. Samples: 704678672. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:16,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.690')] [2023-12-28 05:08:16,436][106226] Updated weights for policy 0, policy_version 1374485 (0.0008) [2023-12-28 05:08:16,488][106226] Updated weights for policy 0, policy_version 1374495 (0.0008) [2023-12-28 05:08:16,540][106226] Updated weights for policy 0, policy_version 1374505 (0.0006) [2023-12-28 05:08:16,832][106225] Updated weights for policy 1, policy_version 1377762 (0.0010) [2023-12-28 05:08:16,890][106225] Updated weights for policy 1, policy_version 1377772 (0.0009) [2023-12-28 05:08:16,947][106225] Updated weights for policy 1, policy_version 1377782 (0.0007) [2023-12-28 05:08:17,203][106226] Updated weights for policy 0, policy_version 1374515 (0.0008) [2023-12-28 05:08:17,251][106226] Updated weights for policy 0, policy_version 1374525 (0.0009) [2023-12-28 05:08:17,299][106226] Updated weights for policy 0, policy_version 1374535 (0.0008) [2023-12-28 05:08:17,590][106225] Updated weights for policy 1, policy_version 1377792 (0.0008) [2023-12-28 05:08:17,639][106225] Updated weights for policy 1, policy_version 1377802 (0.0009) [2023-12-28 05:08:17,685][106225] Updated weights for policy 1, policy_version 1377812 (0.0008) [2023-12-28 05:08:18,055][106226] Updated weights for policy 0, policy_version 1374545 (0.0007) [2023-12-28 05:08:18,114][106226] Updated weights for policy 0, policy_version 1374555 (0.0006) [2023-12-28 05:08:18,182][106226] Updated weights for policy 0, policy_version 1374565 (0.0006) [2023-12-28 05:08:18,238][106226] Updated weights for policy 0, policy_version 1374575 (0.0008) [2023-12-28 05:08:18,356][106225] Updated weights for policy 1, policy_version 1377822 (0.0008) [2023-12-28 05:08:18,422][106225] Updated weights for policy 1, policy_version 1377832 (0.0006) [2023-12-28 05:08:18,479][106225] Updated weights for policy 1, policy_version 1377842 (0.0005) [2023-12-28 05:08:18,888][106226] Updated weights for policy 0, policy_version 1374585 (0.0005) [2023-12-28 05:08:18,951][106226] Updated weights for policy 0, policy_version 1374595 (0.0005) [2023-12-28 05:08:19,000][106226] Updated weights for policy 0, policy_version 1374605 (0.0005) [2023-12-28 05:08:19,144][106225] Updated weights for policy 1, policy_version 1377852 (0.0005) [2023-12-28 05:08:19,203][106225] Updated weights for policy 1, policy_version 1377862 (0.0006) [2023-12-28 05:08:19,275][106225] Updated weights for policy 1, policy_version 1377872 (0.0008) [2023-12-28 05:08:19,638][106226] Updated weights for policy 0, policy_version 1374615 (0.0006) [2023-12-28 05:08:19,709][106226] Updated weights for policy 0, policy_version 1374625 (0.0006) [2023-12-28 05:08:19,781][106226] Updated weights for policy 0, policy_version 1374635 (0.0005) [2023-12-28 05:08:20,056][106225] Updated weights for policy 1, policy_version 1377882 (0.0009) [2023-12-28 05:08:20,118][106225] Updated weights for policy 1, policy_version 1377892 (0.0009) [2023-12-28 05:08:20,178][106225] Updated weights for policy 1, policy_version 1377902 (0.0008) [2023-12-28 05:08:20,233][106225] Updated weights for policy 1, policy_version 1377912 (0.0008) [2023-12-28 05:08:20,418][106226] Updated weights for policy 0, policy_version 1374645 (0.0006) [2023-12-28 05:08:20,487][106226] Updated weights for policy 0, policy_version 1374655 (0.0006) [2023-12-28 05:08:20,541][106226] Updated weights for policy 0, policy_version 1374665 (0.0009) [2023-12-28 05:08:21,012][106225] Updated weights for policy 1, policy_version 1377922 (0.0009) [2023-12-28 05:08:21,092][106225] Updated weights for policy 1, policy_version 1377932 (0.0008) [2023-12-28 05:08:21,160][106225] Updated weights for policy 1, policy_version 1377942 (0.0008) [2023-12-28 05:08:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 704790528. Throughput: 0: 10113.8, 1: 9721.2. Samples: 704798828. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:21,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.580')] [2023-12-28 05:08:21,273][106226] Updated weights for policy 0, policy_version 1374675 (0.0009) [2023-12-28 05:08:21,325][106226] Updated weights for policy 0, policy_version 1374685 (0.0009) [2023-12-28 05:08:21,390][106226] Updated weights for policy 0, policy_version 1374695 (0.0009) [2023-12-28 05:08:21,985][106225] Updated weights for policy 1, policy_version 1377952 (0.0007) [2023-12-28 05:08:22,054][106225] Updated weights for policy 1, policy_version 1377962 (0.0008) [2023-12-28 05:08:22,112][106225] Updated weights for policy 1, policy_version 1377972 (0.0008) [2023-12-28 05:08:22,193][106226] Updated weights for policy 0, policy_version 1374705 (0.0009) [2023-12-28 05:08:22,260][106226] Updated weights for policy 0, policy_version 1374715 (0.0008) [2023-12-28 05:08:22,335][106226] Updated weights for policy 0, policy_version 1374725 (0.0008) [2023-12-28 05:08:22,404][106226] Updated weights for policy 0, policy_version 1374735 (0.0008) [2023-12-28 05:08:22,862][106225] Updated weights for policy 1, policy_version 1377982 (0.0007) [2023-12-28 05:08:22,920][106225] Updated weights for policy 1, policy_version 1377992 (0.0005) [2023-12-28 05:08:22,970][106225] Updated weights for policy 1, policy_version 1378002 (0.0006) [2023-12-28 05:08:23,088][106226] Updated weights for policy 0, policy_version 1374745 (0.0008) [2023-12-28 05:08:23,149][106226] Updated weights for policy 0, policy_version 1374755 (0.0009) [2023-12-28 05:08:23,211][106226] Updated weights for policy 0, policy_version 1374765 (0.0008) [2023-12-28 05:08:23,652][106225] Updated weights for policy 1, policy_version 1378012 (0.0008) [2023-12-28 05:08:23,712][106225] Updated weights for policy 1, policy_version 1378023 (0.0010) [2023-12-28 05:08:23,766][106225] Updated weights for policy 1, policy_version 1378033 (0.0008) [2023-12-28 05:08:23,876][106226] Updated weights for policy 0, policy_version 1374775 (0.0007) [2023-12-28 05:08:23,936][106226] Updated weights for policy 0, policy_version 1374785 (0.0006) [2023-12-28 05:08:23,984][106226] Updated weights for policy 0, policy_version 1374795 (0.0005) [2023-12-28 05:08:24,571][106225] Updated weights for policy 1, policy_version 1378043 (0.0009) [2023-12-28 05:08:24,611][106226] Updated weights for policy 0, policy_version 1374805 (0.0007) [2023-12-28 05:08:24,625][106225] Updated weights for policy 1, policy_version 1378053 (0.0007) [2023-12-28 05:08:24,667][106226] Updated weights for policy 0, policy_version 1374815 (0.0006) [2023-12-28 05:08:24,688][106225] Updated weights for policy 1, policy_version 1378063 (0.0006) [2023-12-28 05:08:24,720][106226] Updated weights for policy 0, policy_version 1374825 (0.0006) [2023-12-28 05:08:25,405][106225] Updated weights for policy 1, policy_version 1378073 (0.0008) [2023-12-28 05:08:25,433][106226] Updated weights for policy 0, policy_version 1374835 (0.0008) [2023-12-28 05:08:25,450][106225] Updated weights for policy 1, policy_version 1378083 (0.0009) [2023-12-28 05:08:25,487][106226] Updated weights for policy 0, policy_version 1374845 (0.0006) [2023-12-28 05:08:25,504][106225] Updated weights for policy 1, policy_version 1378093 (0.0007) [2023-12-28 05:08:25,540][106226] Updated weights for policy 0, policy_version 1374855 (0.0007) [2023-12-28 05:08:25,562][106225] Updated weights for policy 1, policy_version 1378103 (0.0009) [2023-12-28 05:08:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 704880640. Throughput: 0: 10065.7, 1: 9660.0. Samples: 704855416. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:26,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.476')] [2023-12-28 05:08:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001374864_352034816.pth... [2023-12-28 05:08:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001378104_352845824.pth... [2023-12-28 05:08:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001373712_351739904.pth [2023-12-28 05:08:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001376984_352559104.pth [2023-12-28 05:08:26,254][106226] Updated weights for policy 0, policy_version 1374865 (0.0007) [2023-12-28 05:08:26,302][106225] Updated weights for policy 1, policy_version 1378113 (0.0006) [2023-12-28 05:08:26,311][106226] Updated weights for policy 0, policy_version 1374875 (0.0007) [2023-12-28 05:08:26,360][106225] Updated weights for policy 1, policy_version 1378123 (0.0006) [2023-12-28 05:08:26,366][106226] Updated weights for policy 0, policy_version 1374885 (0.0008) [2023-12-28 05:08:26,414][106225] Updated weights for policy 1, policy_version 1378133 (0.0007) [2023-12-28 05:08:26,424][106226] Updated weights for policy 0, policy_version 1374895 (0.0006) [2023-12-28 05:08:27,101][106225] Updated weights for policy 1, policy_version 1378143 (0.0008) [2023-12-28 05:08:27,140][106226] Updated weights for policy 0, policy_version 1374905 (0.0009) [2023-12-28 05:08:27,152][106225] Updated weights for policy 1, policy_version 1378153 (0.0009) [2023-12-28 05:08:27,193][106226] Updated weights for policy 0, policy_version 1374915 (0.0010) [2023-12-28 05:08:27,202][106225] Updated weights for policy 1, policy_version 1378163 (0.0009) [2023-12-28 05:08:27,248][106226] Updated weights for policy 0, policy_version 1374925 (0.0009) [2023-12-28 05:08:27,831][106226] Updated weights for policy 0, policy_version 1374935 (0.0009) [2023-12-28 05:08:27,879][106226] Updated weights for policy 0, policy_version 1374945 (0.0006) [2023-12-28 05:08:27,925][106226] Updated weights for policy 0, policy_version 1374955 (0.0005) [2023-12-28 05:08:28,020][106225] Updated weights for policy 1, policy_version 1378173 (0.0008) [2023-12-28 05:08:28,083][106225] Updated weights for policy 1, policy_version 1378183 (0.0010) [2023-12-28 05:08:28,147][106225] Updated weights for policy 1, policy_version 1378193 (0.0010) [2023-12-28 05:08:28,541][106226] Updated weights for policy 0, policy_version 1374965 (0.0006) [2023-12-28 05:08:28,596][106226] Updated weights for policy 0, policy_version 1374975 (0.0008) [2023-12-28 05:08:28,651][106226] Updated weights for policy 0, policy_version 1374985 (0.0008) [2023-12-28 05:08:28,848][106225] Updated weights for policy 1, policy_version 1378203 (0.0010) [2023-12-28 05:08:28,898][106225] Updated weights for policy 1, policy_version 1378213 (0.0010) [2023-12-28 05:08:28,948][106225] Updated weights for policy 1, policy_version 1378223 (0.0010) [2023-12-28 05:08:29,331][106226] Updated weights for policy 0, policy_version 1374995 (0.0008) [2023-12-28 05:08:29,397][106226] Updated weights for policy 0, policy_version 1375005 (0.0008) [2023-12-28 05:08:29,452][106226] Updated weights for policy 0, policy_version 1375015 (0.0008) [2023-12-28 05:08:29,743][106225] Updated weights for policy 1, policy_version 1378233 (0.0010) [2023-12-28 05:08:29,792][106225] Updated weights for policy 1, policy_version 1378243 (0.0008) [2023-12-28 05:08:29,847][106225] Updated weights for policy 1, policy_version 1378253 (0.0009) [2023-12-28 05:08:29,908][106225] Updated weights for policy 1, policy_version 1378263 (0.0009) [2023-12-28 05:08:30,091][106226] Updated weights for policy 0, policy_version 1375025 (0.0008) [2023-12-28 05:08:30,157][106226] Updated weights for policy 0, policy_version 1375035 (0.0009) [2023-12-28 05:08:30,210][106226] Updated weights for policy 0, policy_version 1375045 (0.0009) [2023-12-28 05:08:30,263][106226] Updated weights for policy 0, policy_version 1375055 (0.0006) [2023-12-28 05:08:30,651][106225] Updated weights for policy 1, policy_version 1378273 (0.0006) [2023-12-28 05:08:30,697][106225] Updated weights for policy 1, policy_version 1378283 (0.0005) [2023-12-28 05:08:30,742][106225] Updated weights for policy 1, policy_version 1378293 (0.0006) [2023-12-28 05:08:30,970][106226] Updated weights for policy 0, policy_version 1375065 (0.0008) [2023-12-28 05:08:31,031][106226] Updated weights for policy 0, policy_version 1375075 (0.0008) [2023-12-28 05:08:31,097][106226] Updated weights for policy 0, policy_version 1375085 (0.0008) [2023-12-28 05:08:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 704987136. Throughput: 0: 10141.0, 1: 9614.0. Samples: 704974680. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:31,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.597')] [2023-12-28 05:08:31,457][106225] Updated weights for policy 1, policy_version 1378303 (0.0008) [2023-12-28 05:08:31,518][106225] Updated weights for policy 1, policy_version 1378313 (0.0008) [2023-12-28 05:08:31,576][106225] Updated weights for policy 1, policy_version 1378323 (0.0007) [2023-12-28 05:08:31,808][106226] Updated weights for policy 0, policy_version 1375095 (0.0008) [2023-12-28 05:08:31,857][106226] Updated weights for policy 0, policy_version 1375105 (0.0008) [2023-12-28 05:08:31,916][106226] Updated weights for policy 0, policy_version 1375115 (0.0006) [2023-12-28 05:08:32,345][106225] Updated weights for policy 1, policy_version 1378333 (0.0009) [2023-12-28 05:08:32,401][106225] Updated weights for policy 1, policy_version 1378343 (0.0010) [2023-12-28 05:08:32,463][106225] Updated weights for policy 1, policy_version 1378353 (0.0007) [2023-12-28 05:08:32,618][106226] Updated weights for policy 0, policy_version 1375125 (0.0007) [2023-12-28 05:08:32,685][106226] Updated weights for policy 0, policy_version 1375135 (0.0008) [2023-12-28 05:08:32,749][106226] Updated weights for policy 0, policy_version 1375145 (0.0010) [2023-12-28 05:08:33,182][106225] Updated weights for policy 1, policy_version 1378363 (0.0007) [2023-12-28 05:08:33,227][106225] Updated weights for policy 1, policy_version 1378373 (0.0008) [2023-12-28 05:08:33,283][106225] Updated weights for policy 1, policy_version 1378383 (0.0007) [2023-12-28 05:08:33,435][106226] Updated weights for policy 0, policy_version 1375155 (0.0010) [2023-12-28 05:08:33,489][106226] Updated weights for policy 0, policy_version 1375165 (0.0011) [2023-12-28 05:08:33,556][106226] Updated weights for policy 0, policy_version 1375175 (0.0011) [2023-12-28 05:08:33,908][106225] Updated weights for policy 1, policy_version 1378393 (0.0007) [2023-12-28 05:08:33,967][106225] Updated weights for policy 1, policy_version 1378403 (0.0006) [2023-12-28 05:08:34,028][106225] Updated weights for policy 1, policy_version 1378413 (0.0006) [2023-12-28 05:08:34,080][106225] Updated weights for policy 1, policy_version 1378423 (0.0008) [2023-12-28 05:08:34,314][106226] Updated weights for policy 0, policy_version 1375185 (0.0010) [2023-12-28 05:08:34,380][106226] Updated weights for policy 0, policy_version 1375195 (0.0009) [2023-12-28 05:08:34,441][106226] Updated weights for policy 0, policy_version 1375205 (0.0009) [2023-12-28 05:08:34,500][106226] Updated weights for policy 0, policy_version 1375215 (0.0008) [2023-12-28 05:08:34,698][106225] Updated weights for policy 1, policy_version 1378433 (0.0006) [2023-12-28 05:08:34,763][106225] Updated weights for policy 1, policy_version 1378443 (0.0008) [2023-12-28 05:08:34,827][106225] Updated weights for policy 1, policy_version 1378453 (0.0009) [2023-12-28 05:08:35,253][106226] Updated weights for policy 0, policy_version 1375225 (0.0008) [2023-12-28 05:08:35,299][106226] Updated weights for policy 0, policy_version 1375235 (0.0007) [2023-12-28 05:08:35,347][106226] Updated weights for policy 0, policy_version 1375245 (0.0008) [2023-12-28 05:08:35,527][106225] Updated weights for policy 1, policy_version 1378463 (0.0010) [2023-12-28 05:08:35,583][106225] Updated weights for policy 1, policy_version 1378473 (0.0010) [2023-12-28 05:08:35,640][106225] Updated weights for policy 1, policy_version 1378483 (0.0010) [2023-12-28 05:08:36,070][106226] Updated weights for policy 0, policy_version 1375255 (0.0006) [2023-12-28 05:08:36,131][106226] Updated weights for policy 0, policy_version 1375265 (0.0007) [2023-12-28 05:08:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 705077248. Throughput: 0: 10066.1, 1: 9683.4. Samples: 705092256. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:36,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.765')] [2023-12-28 05:08:36,185][106226] Updated weights for policy 0, policy_version 1375275 (0.0009) [2023-12-28 05:08:36,245][106225] Updated weights for policy 1, policy_version 1378493 (0.0008) [2023-12-28 05:08:36,318][106225] Updated weights for policy 1, policy_version 1378503 (0.0005) [2023-12-28 05:08:36,388][106225] Updated weights for policy 1, policy_version 1378513 (0.0011) [2023-12-28 05:08:36,897][106226] Updated weights for policy 0, policy_version 1375285 (0.0009) [2023-12-28 05:08:36,954][106226] Updated weights for policy 0, policy_version 1375295 (0.0009) [2023-12-28 05:08:37,012][106226] Updated weights for policy 0, policy_version 1375305 (0.0008) [2023-12-28 05:08:37,062][106225] Updated weights for policy 1, policy_version 1378523 (0.0007) [2023-12-28 05:08:37,125][106225] Updated weights for policy 1, policy_version 1378533 (0.0007) [2023-12-28 05:08:37,189][106225] Updated weights for policy 1, policy_version 1378543 (0.0007) [2023-12-28 05:08:37,771][106226] Updated weights for policy 0, policy_version 1375315 (0.0008) [2023-12-28 05:08:37,828][106226] Updated weights for policy 0, policy_version 1375325 (0.0008) [2023-12-28 05:08:37,883][106225] Updated weights for policy 1, policy_version 1378553 (0.0010) [2023-12-28 05:08:37,886][106226] Updated weights for policy 0, policy_version 1375335 (0.0008) [2023-12-28 05:08:37,944][106225] Updated weights for policy 1, policy_version 1378563 (0.0008) [2023-12-28 05:08:37,996][106225] Updated weights for policy 1, policy_version 1378573 (0.0008) [2023-12-28 05:08:38,056][106225] Updated weights for policy 1, policy_version 1378583 (0.0009) [2023-12-28 05:08:38,575][106226] Updated weights for policy 0, policy_version 1375345 (0.0006) [2023-12-28 05:08:38,632][106226] Updated weights for policy 0, policy_version 1375355 (0.0008) [2023-12-28 05:08:38,685][106226] Updated weights for policy 0, policy_version 1375365 (0.0006) [2023-12-28 05:08:38,748][106226] Updated weights for policy 0, policy_version 1375375 (0.0006) [2023-12-28 05:08:38,804][106225] Updated weights for policy 1, policy_version 1378593 (0.0009) [2023-12-28 05:08:38,859][106225] Updated weights for policy 1, policy_version 1378603 (0.0010) [2023-12-28 05:08:38,920][106225] Updated weights for policy 1, policy_version 1378613 (0.0010) [2023-12-28 05:08:39,370][106226] Updated weights for policy 0, policy_version 1375385 (0.0009) [2023-12-28 05:08:39,446][106226] Updated weights for policy 0, policy_version 1375395 (0.0009) [2023-12-28 05:08:39,508][106226] Updated weights for policy 0, policy_version 1375405 (0.0008) [2023-12-28 05:08:39,799][106225] Updated weights for policy 1, policy_version 1378623 (0.0007) [2023-12-28 05:08:39,865][106225] Updated weights for policy 1, policy_version 1378633 (0.0007) [2023-12-28 05:08:39,936][106225] Updated weights for policy 1, policy_version 1378643 (0.0008) [2023-12-28 05:08:40,186][106226] Updated weights for policy 0, policy_version 1375415 (0.0007) [2023-12-28 05:08:40,244][106226] Updated weights for policy 0, policy_version 1375425 (0.0009) [2023-12-28 05:08:40,308][106226] Updated weights for policy 0, policy_version 1375435 (0.0009) [2023-12-28 05:08:40,650][106225] Updated weights for policy 1, policy_version 1378653 (0.0009) [2023-12-28 05:08:40,705][106225] Updated weights for policy 1, policy_version 1378663 (0.0007) [2023-12-28 05:08:40,759][106225] Updated weights for policy 1, policy_version 1378673 (0.0008) [2023-12-28 05:08:40,968][106226] Updated weights for policy 0, policy_version 1375445 (0.0010) [2023-12-28 05:08:41,032][106226] Updated weights for policy 0, policy_version 1375455 (0.0010) [2023-12-28 05:08:41,096][106226] Updated weights for policy 0, policy_version 1375465 (0.0009) [2023-12-28 05:08:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 705183744. Throughput: 0: 10069.8, 1: 9704.7. Samples: 705152096. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:41,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.958')] [2023-12-28 05:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001375472_352190464.pth... [2023-12-28 05:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001378680_352993280.pth... [2023-12-28 05:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001374288_351887360.pth [2023-12-28 05:08:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001377560_352706560.pth [2023-12-28 05:08:41,497][106225] Updated weights for policy 1, policy_version 1378683 (0.0007) [2023-12-28 05:08:41,568][106225] Updated weights for policy 1, policy_version 1378693 (0.0009) [2023-12-28 05:08:41,633][106225] Updated weights for policy 1, policy_version 1378703 (0.0009) [2023-12-28 05:08:41,915][106226] Updated weights for policy 0, policy_version 1375475 (0.0009) [2023-12-28 05:08:41,973][106226] Updated weights for policy 0, policy_version 1375485 (0.0011) [2023-12-28 05:08:42,035][106226] Updated weights for policy 0, policy_version 1375495 (0.0011) [2023-12-28 05:08:42,384][106225] Updated weights for policy 1, policy_version 1378713 (0.0006) [2023-12-28 05:08:42,449][106225] Updated weights for policy 1, policy_version 1378723 (0.0008) [2023-12-28 05:08:42,508][106225] Updated weights for policy 1, policy_version 1378733 (0.0008) [2023-12-28 05:08:42,563][106225] Updated weights for policy 1, policy_version 1378743 (0.0007) [2023-12-28 05:08:42,758][106226] Updated weights for policy 0, policy_version 1375505 (0.0010) [2023-12-28 05:08:42,814][106226] Updated weights for policy 0, policy_version 1375515 (0.0007) [2023-12-28 05:08:42,866][106226] Updated weights for policy 0, policy_version 1375525 (0.0007) [2023-12-28 05:08:42,921][106226] Updated weights for policy 0, policy_version 1375535 (0.0006) [2023-12-28 05:08:43,253][106225] Updated weights for policy 1, policy_version 1378753 (0.0008) [2023-12-28 05:08:43,303][106225] Updated weights for policy 1, policy_version 1378763 (0.0008) [2023-12-28 05:08:43,354][106225] Updated weights for policy 1, policy_version 1378773 (0.0008) [2023-12-28 05:08:43,521][106226] Updated weights for policy 0, policy_version 1375545 (0.0008) [2023-12-28 05:08:43,571][106226] Updated weights for policy 0, policy_version 1375555 (0.0007) [2023-12-28 05:08:43,618][106226] Updated weights for policy 0, policy_version 1375565 (0.0008) [2023-12-28 05:08:44,037][106225] Updated weights for policy 1, policy_version 1378783 (0.0010) [2023-12-28 05:08:44,084][106225] Updated weights for policy 1, policy_version 1378793 (0.0010) [2023-12-28 05:08:44,137][106225] Updated weights for policy 1, policy_version 1378803 (0.0006) [2023-12-28 05:08:44,384][106226] Updated weights for policy 0, policy_version 1375575 (0.0008) [2023-12-28 05:08:44,434][106226] Updated weights for policy 0, policy_version 1375585 (0.0007) [2023-12-28 05:08:44,480][106226] Updated weights for policy 0, policy_version 1375595 (0.0008) [2023-12-28 05:08:44,805][106225] Updated weights for policy 1, policy_version 1378813 (0.0008) [2023-12-28 05:08:44,868][106225] Updated weights for policy 1, policy_version 1378823 (0.0010) [2023-12-28 05:08:44,930][106225] Updated weights for policy 1, policy_version 1378833 (0.0010) [2023-12-28 05:08:45,221][106226] Updated weights for policy 0, policy_version 1375605 (0.0008) [2023-12-28 05:08:45,285][106226] Updated weights for policy 0, policy_version 1375615 (0.0008) [2023-12-28 05:08:45,346][106226] Updated weights for policy 0, policy_version 1375625 (0.0008) [2023-12-28 05:08:45,620][106225] Updated weights for policy 1, policy_version 1378843 (0.0011) [2023-12-28 05:08:45,678][106225] Updated weights for policy 1, policy_version 1378853 (0.0010) [2023-12-28 05:08:45,743][106225] Updated weights for policy 1, policy_version 1378863 (0.0010) [2023-12-28 05:08:46,113][106226] Updated weights for policy 0, policy_version 1375635 (0.0008) [2023-12-28 05:08:46,163][106226] Updated weights for policy 0, policy_version 1375645 (0.0008) [2023-12-28 05:08:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 705273856. Throughput: 0: 10013.1, 1: 9656.2. Samples: 705267916. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:46,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.335')] [2023-12-28 05:08:46,219][106226] Updated weights for policy 0, policy_version 1375655 (0.0007) [2023-12-28 05:08:46,444][106225] Updated weights for policy 1, policy_version 1378873 (0.0010) [2023-12-28 05:08:46,503][106225] Updated weights for policy 1, policy_version 1378883 (0.0010) [2023-12-28 05:08:46,563][106225] Updated weights for policy 1, policy_version 1378893 (0.0010) [2023-12-28 05:08:46,625][106225] Updated weights for policy 1, policy_version 1378903 (0.0010) [2023-12-28 05:08:46,976][106226] Updated weights for policy 0, policy_version 1375665 (0.0008) [2023-12-28 05:08:47,031][106226] Updated weights for policy 0, policy_version 1375675 (0.0009) [2023-12-28 05:08:47,082][106226] Updated weights for policy 0, policy_version 1375685 (0.0008) [2023-12-28 05:08:47,140][106226] Updated weights for policy 0, policy_version 1375695 (0.0008) [2023-12-28 05:08:47,209][106225] Updated weights for policy 1, policy_version 1378913 (0.0010) [2023-12-28 05:08:47,265][106225] Updated weights for policy 1, policy_version 1378923 (0.0010) [2023-12-28 05:08:47,320][106225] Updated weights for policy 1, policy_version 1378933 (0.0010) [2023-12-28 05:08:47,915][106226] Updated weights for policy 0, policy_version 1375705 (0.0007) [2023-12-28 05:08:47,966][106226] Updated weights for policy 0, policy_version 1375715 (0.0008) [2023-12-28 05:08:48,030][106226] Updated weights for policy 0, policy_version 1375725 (0.0008) [2023-12-28 05:08:48,047][106225] Updated weights for policy 1, policy_version 1378943 (0.0010) [2023-12-28 05:08:48,104][106225] Updated weights for policy 1, policy_version 1378953 (0.0010) [2023-12-28 05:08:48,159][106225] Updated weights for policy 1, policy_version 1378963 (0.0010) [2023-12-28 05:08:48,763][106226] Updated weights for policy 0, policy_version 1375735 (0.0008) [2023-12-28 05:08:48,826][106226] Updated weights for policy 0, policy_version 1375745 (0.0008) [2023-12-28 05:08:48,876][106226] Updated weights for policy 0, policy_version 1375755 (0.0008) [2023-12-28 05:08:48,891][106225] Updated weights for policy 1, policy_version 1378973 (0.0010) [2023-12-28 05:08:48,948][106225] Updated weights for policy 1, policy_version 1378983 (0.0010) [2023-12-28 05:08:49,011][106225] Updated weights for policy 1, policy_version 1378993 (0.0010) [2023-12-28 05:08:49,626][106226] Updated weights for policy 0, policy_version 1375765 (0.0007) [2023-12-28 05:08:49,680][106226] Updated weights for policy 0, policy_version 1375775 (0.0008) [2023-12-28 05:08:49,735][106226] Updated weights for policy 0, policy_version 1375785 (0.0008) [2023-12-28 05:08:49,770][106225] Updated weights for policy 1, policy_version 1379003 (0.0010) [2023-12-28 05:08:49,832][106225] Updated weights for policy 1, policy_version 1379013 (0.0010) [2023-12-28 05:08:49,894][106225] Updated weights for policy 1, policy_version 1379023 (0.0010) [2023-12-28 05:08:50,535][106226] Updated weights for policy 0, policy_version 1375795 (0.0008) [2023-12-28 05:08:50,598][106226] Updated weights for policy 0, policy_version 1375805 (0.0009) [2023-12-28 05:08:50,627][106225] Updated weights for policy 1, policy_version 1379033 (0.0009) [2023-12-28 05:08:50,657][106226] Updated weights for policy 0, policy_version 1375815 (0.0006) [2023-12-28 05:08:50,689][106225] Updated weights for policy 1, policy_version 1379043 (0.0011) [2023-12-28 05:08:50,745][106225] Updated weights for policy 1, policy_version 1379053 (0.0009) [2023-12-28 05:08:50,808][106225] Updated weights for policy 1, policy_version 1379063 (0.0008) [2023-12-28 05:08:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 705372160. Throughput: 0: 9826.9, 1: 9661.4. Samples: 705381676. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:51,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.375')] [2023-12-28 05:08:51,461][106226] Updated weights for policy 0, policy_version 1375825 (0.0007) [2023-12-28 05:08:51,520][106226] Updated weights for policy 0, policy_version 1375835 (0.0008) [2023-12-28 05:08:51,562][106225] Updated weights for policy 1, policy_version 1379073 (0.0010) [2023-12-28 05:08:51,579][106226] Updated weights for policy 0, policy_version 1375845 (0.0008) [2023-12-28 05:08:51,626][106225] Updated weights for policy 1, policy_version 1379083 (0.0010) [2023-12-28 05:08:51,647][106226] Updated weights for policy 0, policy_version 1375855 (0.0008) [2023-12-28 05:08:51,693][106225] Updated weights for policy 1, policy_version 1379093 (0.0007) [2023-12-28 05:08:52,311][106226] Updated weights for policy 0, policy_version 1375865 (0.0006) [2023-12-28 05:08:52,374][106225] Updated weights for policy 1, policy_version 1379103 (0.0009) [2023-12-28 05:08:52,388][106226] Updated weights for policy 0, policy_version 1375875 (0.0007) [2023-12-28 05:08:52,424][106225] Updated weights for policy 1, policy_version 1379113 (0.0006) [2023-12-28 05:08:52,451][106226] Updated weights for policy 0, policy_version 1375885 (0.0008) [2023-12-28 05:08:52,491][106225] Updated weights for policy 1, policy_version 1379123 (0.0009) [2023-12-28 05:08:53,154][106225] Updated weights for policy 1, policy_version 1379133 (0.0008) [2023-12-28 05:08:53,179][106226] Updated weights for policy 0, policy_version 1375895 (0.0008) [2023-12-28 05:08:53,213][106225] Updated weights for policy 1, policy_version 1379143 (0.0007) [2023-12-28 05:08:53,243][106226] Updated weights for policy 0, policy_version 1375905 (0.0006) [2023-12-28 05:08:53,260][106225] Updated weights for policy 1, policy_version 1379153 (0.0007) [2023-12-28 05:08:53,305][106226] Updated weights for policy 0, policy_version 1375915 (0.0007) [2023-12-28 05:08:53,998][106226] Updated weights for policy 0, policy_version 1375925 (0.0009) [2023-12-28 05:08:53,998][106225] Updated weights for policy 1, policy_version 1379163 (0.0007) [2023-12-28 05:08:54,050][106225] Updated weights for policy 1, policy_version 1379173 (0.0008) [2023-12-28 05:08:54,056][106226] Updated weights for policy 0, policy_version 1375935 (0.0007) [2023-12-28 05:08:54,100][106225] Updated weights for policy 1, policy_version 1379183 (0.0009) [2023-12-28 05:08:54,116][106226] Updated weights for policy 0, policy_version 1375945 (0.0007) [2023-12-28 05:08:54,772][106225] Updated weights for policy 1, policy_version 1379193 (0.0010) [2023-12-28 05:08:54,808][106226] Updated weights for policy 0, policy_version 1375955 (0.0009) [2023-12-28 05:08:54,831][106225] Updated weights for policy 1, policy_version 1379203 (0.0005) [2023-12-28 05:08:54,866][106226] Updated weights for policy 0, policy_version 1375965 (0.0008) [2023-12-28 05:08:54,887][106225] Updated weights for policy 1, policy_version 1379213 (0.0009) [2023-12-28 05:08:54,927][106226] Updated weights for policy 0, policy_version 1375975 (0.0006) [2023-12-28 05:08:54,941][106225] Updated weights for policy 1, policy_version 1379223 (0.0010) [2023-12-28 05:08:55,558][106225] Updated weights for policy 1, policy_version 1379233 (0.0011) [2023-12-28 05:08:55,619][106225] Updated weights for policy 1, policy_version 1379243 (0.0011) [2023-12-28 05:08:55,677][106225] Updated weights for policy 1, policy_version 1379253 (0.0010) [2023-12-28 05:08:55,696][106226] Updated weights for policy 0, policy_version 1375985 (0.0007) [2023-12-28 05:08:55,749][106226] Updated weights for policy 0, policy_version 1375995 (0.0006) [2023-12-28 05:08:55,802][106226] Updated weights for policy 0, policy_version 1376005 (0.0009) [2023-12-28 05:08:55,873][106226] Updated weights for policy 0, policy_version 1376015 (0.0009) [2023-12-28 05:08:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 705470464. Throughput: 0: 9764.4, 1: 9706.9. Samples: 705439872. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:08:56,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.690')] [2023-12-28 05:08:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001376016_352329728.pth... [2023-12-28 05:08:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001379256_353140736.pth... [2023-12-28 05:08:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001374864_352034816.pth [2023-12-28 05:08:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001378104_352845824.pth [2023-12-28 05:08:56,322][106225] Updated weights for policy 1, policy_version 1379263 (0.0010) [2023-12-28 05:08:56,375][106225] Updated weights for policy 1, policy_version 1379273 (0.0010) [2023-12-28 05:08:56,431][106225] Updated weights for policy 1, policy_version 1379283 (0.0010) [2023-12-28 05:08:56,603][106226] Updated weights for policy 0, policy_version 1376025 (0.0009) [2023-12-28 05:08:56,663][106226] Updated weights for policy 0, policy_version 1376035 (0.0007) [2023-12-28 05:08:56,726][106226] Updated weights for policy 0, policy_version 1376045 (0.0008) [2023-12-28 05:08:57,055][106225] Updated weights for policy 1, policy_version 1379293 (0.0010) [2023-12-28 05:08:57,103][106225] Updated weights for policy 1, policy_version 1379303 (0.0010) [2023-12-28 05:08:57,149][106225] Updated weights for policy 1, policy_version 1379313 (0.0010) [2023-12-28 05:08:57,493][106226] Updated weights for policy 0, policy_version 1376055 (0.0008) [2023-12-28 05:08:57,560][106226] Updated weights for policy 0, policy_version 1376065 (0.0007) [2023-12-28 05:08:57,614][106226] Updated weights for policy 0, policy_version 1376075 (0.0008) [2023-12-28 05:08:57,869][106225] Updated weights for policy 1, policy_version 1379323 (0.0010) [2023-12-28 05:08:57,930][106225] Updated weights for policy 1, policy_version 1379333 (0.0010) [2023-12-28 05:08:57,986][106225] Updated weights for policy 1, policy_version 1379343 (0.0010) [2023-12-28 05:08:58,354][106226] Updated weights for policy 0, policy_version 1376085 (0.0008) [2023-12-28 05:08:58,422][106226] Updated weights for policy 0, policy_version 1376095 (0.0007) [2023-12-28 05:08:58,493][106226] Updated weights for policy 0, policy_version 1376105 (0.0008) [2023-12-28 05:08:58,714][106225] Updated weights for policy 1, policy_version 1379353 (0.0011) [2023-12-28 05:08:58,781][106225] Updated weights for policy 1, policy_version 1379363 (0.0008) [2023-12-28 05:08:58,850][106225] Updated weights for policy 1, policy_version 1379373 (0.0007) [2023-12-28 05:08:58,919][106225] Updated weights for policy 1, policy_version 1379383 (0.0007) [2023-12-28 05:08:59,409][106226] Updated weights for policy 0, policy_version 1376115 (0.0008) [2023-12-28 05:08:59,477][106226] Updated weights for policy 0, policy_version 1376125 (0.0008) [2023-12-28 05:08:59,539][106226] Updated weights for policy 0, policy_version 1376135 (0.0008) [2023-12-28 05:08:59,642][106225] Updated weights for policy 1, policy_version 1379393 (0.0008) [2023-12-28 05:08:59,696][106225] Updated weights for policy 1, policy_version 1379403 (0.0007) [2023-12-28 05:08:59,746][106225] Updated weights for policy 1, policy_version 1379413 (0.0009) [2023-12-28 05:09:00,261][106226] Updated weights for policy 0, policy_version 1376145 (0.0010) [2023-12-28 05:09:00,322][106226] Updated weights for policy 0, policy_version 1376155 (0.0011) [2023-12-28 05:09:00,382][106226] Updated weights for policy 0, policy_version 1376165 (0.0009) [2023-12-28 05:09:00,444][106226] Updated weights for policy 0, policy_version 1376175 (0.0005) [2023-12-28 05:09:00,492][106225] Updated weights for policy 1, policy_version 1379423 (0.0009) [2023-12-28 05:09:00,546][106225] Updated weights for policy 1, policy_version 1379433 (0.0008) [2023-12-28 05:09:00,599][106225] Updated weights for policy 1, policy_version 1379443 (0.0008) [2023-12-28 05:09:01,025][106226] Updated weights for policy 0, policy_version 1376185 (0.0006) [2023-12-28 05:09:01,089][106226] Updated weights for policy 0, policy_version 1376195 (0.0008) [2023-12-28 05:09:01,144][106226] Updated weights for policy 0, policy_version 1376205 (0.0008) [2023-12-28 05:09:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 705568768. Throughput: 0: 9713.0, 1: 9775.3. Samples: 705555648. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:01,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.425')] [2023-12-28 05:09:01,381][106225] Updated weights for policy 1, policy_version 1379453 (0.0009) [2023-12-28 05:09:01,441][106225] Updated weights for policy 1, policy_version 1379463 (0.0010) [2023-12-28 05:09:01,491][106225] Updated weights for policy 1, policy_version 1379473 (0.0010) [2023-12-28 05:09:01,824][106226] Updated weights for policy 0, policy_version 1376215 (0.0011) [2023-12-28 05:09:01,884][106226] Updated weights for policy 0, policy_version 1376225 (0.0010) [2023-12-28 05:09:01,931][106226] Updated weights for policy 0, policy_version 1376235 (0.0010) [2023-12-28 05:09:02,184][106225] Updated weights for policy 1, policy_version 1379483 (0.0010) [2023-12-28 05:09:02,238][106225] Updated weights for policy 1, policy_version 1379493 (0.0008) [2023-12-28 05:09:02,299][106225] Updated weights for policy 1, policy_version 1379503 (0.0007) [2023-12-28 05:09:02,637][106226] Updated weights for policy 0, policy_version 1376245 (0.0008) [2023-12-28 05:09:02,702][106226] Updated weights for policy 0, policy_version 1376255 (0.0009) [2023-12-28 05:09:02,758][106226] Updated weights for policy 0, policy_version 1376265 (0.0010) [2023-12-28 05:09:02,997][106225] Updated weights for policy 1, policy_version 1379513 (0.0008) [2023-12-28 05:09:03,058][106225] Updated weights for policy 1, policy_version 1379523 (0.0008) [2023-12-28 05:09:03,109][106225] Updated weights for policy 1, policy_version 1379533 (0.0005) [2023-12-28 05:09:03,162][106225] Updated weights for policy 1, policy_version 1379543 (0.0005) [2023-12-28 05:09:03,417][106226] Updated weights for policy 0, policy_version 1376275 (0.0009) [2023-12-28 05:09:03,466][106226] Updated weights for policy 0, policy_version 1376285 (0.0010) [2023-12-28 05:09:03,518][106226] Updated weights for policy 0, policy_version 1376295 (0.0010) [2023-12-28 05:09:03,740][106225] Updated weights for policy 1, policy_version 1379553 (0.0007) [2023-12-28 05:09:03,801][106225] Updated weights for policy 1, policy_version 1379563 (0.0007) [2023-12-28 05:09:03,864][106225] Updated weights for policy 1, policy_version 1379573 (0.0007) [2023-12-28 05:09:04,181][106226] Updated weights for policy 0, policy_version 1376305 (0.0010) [2023-12-28 05:09:04,251][106226] Updated weights for policy 0, policy_version 1376315 (0.0007) [2023-12-28 05:09:04,313][106226] Updated weights for policy 0, policy_version 1376325 (0.0009) [2023-12-28 05:09:04,379][106226] Updated weights for policy 0, policy_version 1376335 (0.0009) [2023-12-28 05:09:04,546][106225] Updated weights for policy 1, policy_version 1379583 (0.0008) [2023-12-28 05:09:04,612][106225] Updated weights for policy 1, policy_version 1379593 (0.0007) [2023-12-28 05:09:04,672][106225] Updated weights for policy 1, policy_version 1379603 (0.0007) [2023-12-28 05:09:05,035][106226] Updated weights for policy 0, policy_version 1376345 (0.0008) [2023-12-28 05:09:05,081][106226] Updated weights for policy 0, policy_version 1376355 (0.0008) [2023-12-28 05:09:05,130][106226] Updated weights for policy 0, policy_version 1376365 (0.0009) [2023-12-28 05:09:05,335][106225] Updated weights for policy 1, policy_version 1379613 (0.0009) [2023-12-28 05:09:05,400][106225] Updated weights for policy 1, policy_version 1379623 (0.0008) [2023-12-28 05:09:05,461][106225] Updated weights for policy 1, policy_version 1379633 (0.0008) [2023-12-28 05:09:05,816][106226] Updated weights for policy 0, policy_version 1376375 (0.0007) [2023-12-28 05:09:05,875][106226] Updated weights for policy 0, policy_version 1376385 (0.0006) [2023-12-28 05:09:05,929][106226] Updated weights for policy 0, policy_version 1376395 (0.0008) [2023-12-28 05:09:06,128][106225] Updated weights for policy 1, policy_version 1379643 (0.0008) [2023-12-28 05:09:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 705667072. Throughput: 0: 9739.0, 1: 9781.8. Samples: 705677268. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:06,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.687')] [2023-12-28 05:09:06,190][106225] Updated weights for policy 1, policy_version 1379653 (0.0008) [2023-12-28 05:09:06,244][106225] Updated weights for policy 1, policy_version 1379663 (0.0007) [2023-12-28 05:09:06,656][106226] Updated weights for policy 0, policy_version 1376405 (0.0008) [2023-12-28 05:09:06,714][106226] Updated weights for policy 0, policy_version 1376415 (0.0009) [2023-12-28 05:09:06,786][106226] Updated weights for policy 0, policy_version 1376425 (0.0008) [2023-12-28 05:09:06,927][106225] Updated weights for policy 1, policy_version 1379673 (0.0008) [2023-12-28 05:09:06,984][106225] Updated weights for policy 1, policy_version 1379683 (0.0005) [2023-12-28 05:09:07,043][106225] Updated weights for policy 1, policy_version 1379693 (0.0005) [2023-12-28 05:09:07,096][106225] Updated weights for policy 1, policy_version 1379703 (0.0005) [2023-12-28 05:09:07,508][106226] Updated weights for policy 0, policy_version 1376435 (0.0009) [2023-12-28 05:09:07,563][106226] Updated weights for policy 0, policy_version 1376445 (0.0008) [2023-12-28 05:09:07,633][106226] Updated weights for policy 0, policy_version 1376455 (0.0007) [2023-12-28 05:09:07,665][106225] Updated weights for policy 1, policy_version 1379713 (0.0008) [2023-12-28 05:09:07,725][106225] Updated weights for policy 1, policy_version 1379723 (0.0008) [2023-12-28 05:09:07,783][106225] Updated weights for policy 1, policy_version 1379733 (0.0008) [2023-12-28 05:09:08,410][106226] Updated weights for policy 0, policy_version 1376465 (0.0008) [2023-12-28 05:09:08,469][106226] Updated weights for policy 0, policy_version 1376475 (0.0007) [2023-12-28 05:09:08,489][106225] Updated weights for policy 1, policy_version 1379743 (0.0010) [2023-12-28 05:09:08,523][106226] Updated weights for policy 0, policy_version 1376485 (0.0007) [2023-12-28 05:09:08,548][106225] Updated weights for policy 1, policy_version 1379753 (0.0009) [2023-12-28 05:09:08,574][106226] Updated weights for policy 0, policy_version 1376495 (0.0006) [2023-12-28 05:09:08,600][106225] Updated weights for policy 1, policy_version 1379763 (0.0007) [2023-12-28 05:09:09,310][106226] Updated weights for policy 0, policy_version 1376505 (0.0008) [2023-12-28 05:09:09,337][106225] Updated weights for policy 1, policy_version 1379773 (0.0008) [2023-12-28 05:09:09,371][106226] Updated weights for policy 0, policy_version 1376515 (0.0007) [2023-12-28 05:09:09,402][106225] Updated weights for policy 1, policy_version 1379783 (0.0008) [2023-12-28 05:09:09,446][106226] Updated weights for policy 0, policy_version 1376525 (0.0009) [2023-12-28 05:09:09,463][106225] Updated weights for policy 1, policy_version 1379793 (0.0006) [2023-12-28 05:09:10,170][106225] Updated weights for policy 1, policy_version 1379803 (0.0007) [2023-12-28 05:09:10,236][106226] Updated weights for policy 0, policy_version 1376535 (0.0009) [2023-12-28 05:09:10,236][106225] Updated weights for policy 1, policy_version 1379813 (0.0007) [2023-12-28 05:09:10,294][106226] Updated weights for policy 0, policy_version 1376545 (0.0007) [2023-12-28 05:09:10,295][106225] Updated weights for policy 1, policy_version 1379823 (0.0007) [2023-12-28 05:09:10,354][106226] Updated weights for policy 0, policy_version 1376555 (0.0006) [2023-12-28 05:09:10,864][106225] Updated weights for policy 1, policy_version 1379833 (0.0007) [2023-12-28 05:09:10,912][106225] Updated weights for policy 1, policy_version 1379843 (0.0005) [2023-12-28 05:09:10,957][106225] Updated weights for policy 1, policy_version 1379853 (0.0005) [2023-12-28 05:09:11,009][106225] Updated weights for policy 1, policy_version 1379863 (0.0007) [2023-12-28 05:09:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 705765376. Throughput: 0: 9722.8, 1: 9865.2. Samples: 705736876. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:11,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-4.454')] [2023-12-28 05:09:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001379864_353296384.pth... [2023-12-28 05:09:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001378680_352993280.pth [2023-12-28 05:09:11,222][106226] Updated weights for policy 0, policy_version 1376565 (0.0006) [2023-12-28 05:09:11,288][106226] Updated weights for policy 0, policy_version 1376575 (0.0008) [2023-12-28 05:09:11,356][106226] Updated weights for policy 0, policy_version 1376585 (0.0007) [2023-12-28 05:09:11,408][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001376592_352477184.pth... [2023-12-28 05:09:11,413][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001375472_352190464.pth [2023-12-28 05:09:11,771][106225] Updated weights for policy 1, policy_version 1379873 (0.0008) [2023-12-28 05:09:11,841][106225] Updated weights for policy 1, policy_version 1379883 (0.0011) [2023-12-28 05:09:11,898][106225] Updated weights for policy 1, policy_version 1379893 (0.0011) [2023-12-28 05:09:12,123][106226] Updated weights for policy 0, policy_version 1376595 (0.0008) [2023-12-28 05:09:12,179][106226] Updated weights for policy 0, policy_version 1376605 (0.0008) [2023-12-28 05:09:12,232][106226] Updated weights for policy 0, policy_version 1376615 (0.0008) [2023-12-28 05:09:12,631][106225] Updated weights for policy 1, policy_version 1379903 (0.0008) [2023-12-28 05:09:12,691][106225] Updated weights for policy 1, policy_version 1379913 (0.0006) [2023-12-28 05:09:12,747][106225] Updated weights for policy 1, policy_version 1379923 (0.0005) [2023-12-28 05:09:13,040][106226] Updated weights for policy 0, policy_version 1376625 (0.0008) [2023-12-28 05:09:13,089][106226] Updated weights for policy 0, policy_version 1376635 (0.0008) [2023-12-28 05:09:13,145][106226] Updated weights for policy 0, policy_version 1376645 (0.0008) [2023-12-28 05:09:13,189][106226] Updated weights for policy 0, policy_version 1376655 (0.0008) [2023-12-28 05:09:13,393][106225] Updated weights for policy 1, policy_version 1379933 (0.0007) [2023-12-28 05:09:13,456][106225] Updated weights for policy 1, policy_version 1379943 (0.0009) [2023-12-28 05:09:13,518][106225] Updated weights for policy 1, policy_version 1379953 (0.0009) [2023-12-28 05:09:13,947][106226] Updated weights for policy 0, policy_version 1376665 (0.0008) [2023-12-28 05:09:13,992][106226] Updated weights for policy 0, policy_version 1376675 (0.0008) [2023-12-28 05:09:14,045][106226] Updated weights for policy 0, policy_version 1376685 (0.0007) [2023-12-28 05:09:14,211][106225] Updated weights for policy 1, policy_version 1379963 (0.0008) [2023-12-28 05:09:14,268][106225] Updated weights for policy 1, policy_version 1379973 (0.0010) [2023-12-28 05:09:14,317][106225] Updated weights for policy 1, policy_version 1379983 (0.0008) [2023-12-28 05:09:14,712][106226] Updated weights for policy 0, policy_version 1376695 (0.0009) [2023-12-28 05:09:14,765][106226] Updated weights for policy 0, policy_version 1376705 (0.0010) [2023-12-28 05:09:14,818][106226] Updated weights for policy 0, policy_version 1376715 (0.0011) [2023-12-28 05:09:15,013][106225] Updated weights for policy 1, policy_version 1379993 (0.0009) [2023-12-28 05:09:15,064][106225] Updated weights for policy 1, policy_version 1380003 (0.0010) [2023-12-28 05:09:15,114][106225] Updated weights for policy 1, policy_version 1380013 (0.0007) [2023-12-28 05:09:15,181][106225] Updated weights for policy 1, policy_version 1380023 (0.0009) [2023-12-28 05:09:15,577][106226] Updated weights for policy 0, policy_version 1376725 (0.0010) [2023-12-28 05:09:15,643][106226] Updated weights for policy 0, policy_version 1376735 (0.0011) [2023-12-28 05:09:15,707][106226] Updated weights for policy 0, policy_version 1376745 (0.0011) [2023-12-28 05:09:15,888][106225] Updated weights for policy 1, policy_version 1380033 (0.0010) [2023-12-28 05:09:15,945][106225] Updated weights for policy 1, policy_version 1380043 (0.0010) [2023-12-28 05:09:16,008][106225] Updated weights for policy 1, policy_version 1380053 (0.0010) [2023-12-28 05:09:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 705863680. Throughput: 0: 9548.5, 1: 9932.2. Samples: 705851316. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:16,176][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.708')] [2023-12-28 05:09:16,413][106226] Updated weights for policy 0, policy_version 1376755 (0.0011) [2023-12-28 05:09:16,473][106226] Updated weights for policy 0, policy_version 1376765 (0.0011) [2023-12-28 05:09:16,533][106226] Updated weights for policy 0, policy_version 1376775 (0.0008) [2023-12-28 05:09:16,716][106225] Updated weights for policy 1, policy_version 1380063 (0.0010) [2023-12-28 05:09:16,778][106225] Updated weights for policy 1, policy_version 1380073 (0.0010) [2023-12-28 05:09:16,831][106225] Updated weights for policy 1, policy_version 1380083 (0.0010) [2023-12-28 05:09:17,225][106226] Updated weights for policy 0, policy_version 1376785 (0.0010) [2023-12-28 05:09:17,284][106226] Updated weights for policy 0, policy_version 1376795 (0.0010) [2023-12-28 05:09:17,340][106226] Updated weights for policy 0, policy_version 1376805 (0.0010) [2023-12-28 05:09:17,389][106226] Updated weights for policy 0, policy_version 1376815 (0.0010) [2023-12-28 05:09:17,548][106225] Updated weights for policy 1, policy_version 1380093 (0.0010) [2023-12-28 05:09:17,604][106225] Updated weights for policy 1, policy_version 1380103 (0.0010) [2023-12-28 05:09:17,657][106225] Updated weights for policy 1, policy_version 1380113 (0.0010) [2023-12-28 05:09:18,112][106226] Updated weights for policy 0, policy_version 1376825 (0.0011) [2023-12-28 05:09:18,173][106226] Updated weights for policy 0, policy_version 1376835 (0.0011) [2023-12-28 05:09:18,229][106226] Updated weights for policy 0, policy_version 1376845 (0.0010) [2023-12-28 05:09:18,375][106225] Updated weights for policy 1, policy_version 1380123 (0.0010) [2023-12-28 05:09:18,436][106225] Updated weights for policy 1, policy_version 1380133 (0.0010) [2023-12-28 05:09:18,500][106225] Updated weights for policy 1, policy_version 1380143 (0.0010) [2023-12-28 05:09:18,889][106226] Updated weights for policy 0, policy_version 1376855 (0.0009) [2023-12-28 05:09:18,957][106226] Updated weights for policy 0, policy_version 1376865 (0.0008) [2023-12-28 05:09:19,015][106226] Updated weights for policy 0, policy_version 1376875 (0.0008) [2023-12-28 05:09:19,198][106225] Updated weights for policy 1, policy_version 1380153 (0.0010) [2023-12-28 05:09:19,261][106225] Updated weights for policy 1, policy_version 1380163 (0.0011) [2023-12-28 05:09:19,322][106225] Updated weights for policy 1, policy_version 1380173 (0.0010) [2023-12-28 05:09:19,387][106225] Updated weights for policy 1, policy_version 1380183 (0.0010) [2023-12-28 05:09:19,724][106226] Updated weights for policy 0, policy_version 1376885 (0.0007) [2023-12-28 05:09:19,784][106226] Updated weights for policy 0, policy_version 1376895 (0.0006) [2023-12-28 05:09:19,851][106226] Updated weights for policy 0, policy_version 1376905 (0.0007) [2023-12-28 05:09:20,143][106225] Updated weights for policy 1, policy_version 1380193 (0.0011) [2023-12-28 05:09:20,211][106225] Updated weights for policy 1, policy_version 1380203 (0.0011) [2023-12-28 05:09:20,272][106225] Updated weights for policy 1, policy_version 1380213 (0.0011) [2023-12-28 05:09:20,530][106226] Updated weights for policy 0, policy_version 1376915 (0.0008) [2023-12-28 05:09:20,600][106226] Updated weights for policy 0, policy_version 1376925 (0.0008) [2023-12-28 05:09:20,662][106226] Updated weights for policy 0, policy_version 1376935 (0.0008) [2023-12-28 05:09:21,009][106225] Updated weights for policy 1, policy_version 1380223 (0.0011) [2023-12-28 05:09:21,078][106225] Updated weights for policy 1, policy_version 1380233 (0.0010) [2023-12-28 05:09:21,148][106225] Updated weights for policy 1, policy_version 1380243 (0.0009) [2023-12-28 05:09:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 705953792. Throughput: 0: 9556.0, 1: 9894.2. Samples: 705967516. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:21,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-4.551')] [2023-12-28 05:09:21,467][106226] Updated weights for policy 0, policy_version 1376945 (0.0008) [2023-12-28 05:09:21,518][106226] Updated weights for policy 0, policy_version 1376955 (0.0009) [2023-12-28 05:09:21,568][106226] Updated weights for policy 0, policy_version 1376965 (0.0009) [2023-12-28 05:09:21,636][106226] Updated weights for policy 0, policy_version 1376975 (0.0009) [2023-12-28 05:09:21,880][106225] Updated weights for policy 1, policy_version 1380253 (0.0010) [2023-12-28 05:09:21,940][106225] Updated weights for policy 1, policy_version 1380263 (0.0009) [2023-12-28 05:09:21,990][106225] Updated weights for policy 1, policy_version 1380273 (0.0009) [2023-12-28 05:09:22,367][106226] Updated weights for policy 0, policy_version 1376985 (0.0010) [2023-12-28 05:09:22,435][106226] Updated weights for policy 0, policy_version 1376995 (0.0010) [2023-12-28 05:09:22,506][106226] Updated weights for policy 0, policy_version 1377005 (0.0011) [2023-12-28 05:09:22,692][106225] Updated weights for policy 1, policy_version 1380283 (0.0007) [2023-12-28 05:09:22,760][106225] Updated weights for policy 1, policy_version 1380293 (0.0008) [2023-12-28 05:09:22,823][106225] Updated weights for policy 1, policy_version 1380303 (0.0008) [2023-12-28 05:09:23,217][106226] Updated weights for policy 0, policy_version 1377015 (0.0008) [2023-12-28 05:09:23,267][106226] Updated weights for policy 0, policy_version 1377025 (0.0009) [2023-12-28 05:09:23,312][106226] Updated weights for policy 0, policy_version 1377035 (0.0008) [2023-12-28 05:09:23,454][106225] Updated weights for policy 1, policy_version 1380313 (0.0009) [2023-12-28 05:09:23,511][106225] Updated weights for policy 1, policy_version 1380323 (0.0005) [2023-12-28 05:09:23,563][106225] Updated weights for policy 1, policy_version 1380333 (0.0006) [2023-12-28 05:09:23,617][106225] Updated weights for policy 1, policy_version 1380343 (0.0009) [2023-12-28 05:09:24,032][106226] Updated weights for policy 0, policy_version 1377045 (0.0007) [2023-12-28 05:09:24,095][106226] Updated weights for policy 0, policy_version 1377055 (0.0010) [2023-12-28 05:09:24,156][106226] Updated weights for policy 0, policy_version 1377065 (0.0011) [2023-12-28 05:09:24,330][106225] Updated weights for policy 1, policy_version 1380353 (0.0006) [2023-12-28 05:09:24,398][106225] Updated weights for policy 1, policy_version 1380363 (0.0006) [2023-12-28 05:09:24,462][106225] Updated weights for policy 1, policy_version 1380373 (0.0008) [2023-12-28 05:09:24,792][106226] Updated weights for policy 0, policy_version 1377075 (0.0010) [2023-12-28 05:09:24,853][106226] Updated weights for policy 0, policy_version 1377085 (0.0010) [2023-12-28 05:09:24,917][106226] Updated weights for policy 0, policy_version 1377095 (0.0011) [2023-12-28 05:09:25,159][106225] Updated weights for policy 1, policy_version 1380383 (0.0009) [2023-12-28 05:09:25,220][106225] Updated weights for policy 1, policy_version 1380393 (0.0009) [2023-12-28 05:09:25,284][106225] Updated weights for policy 1, policy_version 1380403 (0.0010) [2023-12-28 05:09:25,475][106226] Updated weights for policy 0, policy_version 1377105 (0.0010) [2023-12-28 05:09:25,531][106226] Updated weights for policy 0, policy_version 1377115 (0.0010) [2023-12-28 05:09:25,578][106226] Updated weights for policy 0, policy_version 1377126 (0.0007) [2023-12-28 05:09:25,634][106226] Updated weights for policy 0, policy_version 1377136 (0.0005) [2023-12-28 05:09:26,089][106225] Updated weights for policy 1, policy_version 1380413 (0.0008) [2023-12-28 05:09:26,148][106225] Updated weights for policy 1, policy_version 1380423 (0.0009) [2023-12-28 05:09:26,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 706052096. Throughput: 0: 9529.0, 1: 9887.2. Samples: 706025824. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:26,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.697')] [2023-12-28 05:09:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001377136_352616448.pth... [2023-12-28 05:09:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001376016_352329728.pth [2023-12-28 05:09:26,209][106225] Updated weights for policy 1, policy_version 1380433 (0.0008) [2023-12-28 05:09:26,247][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001380440_353443840.pth... [2023-12-28 05:09:26,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001379256_353140736.pth [2023-12-28 05:09:26,286][106226] Updated weights for policy 0, policy_version 1377146 (0.0009) [2023-12-28 05:09:26,333][106226] Updated weights for policy 0, policy_version 1377156 (0.0008) [2023-12-28 05:09:26,387][106226] Updated weights for policy 0, policy_version 1377166 (0.0008) [2023-12-28 05:09:26,960][106225] Updated weights for policy 1, policy_version 1380443 (0.0007) [2023-12-28 05:09:27,012][106225] Updated weights for policy 1, policy_version 1380454 (0.0008) [2023-12-28 05:09:27,036][106226] Updated weights for policy 0, policy_version 1377176 (0.0006) [2023-12-28 05:09:27,074][106225] Updated weights for policy 1, policy_version 1380464 (0.0008) [2023-12-28 05:09:27,087][106226] Updated weights for policy 0, policy_version 1377186 (0.0005) [2023-12-28 05:09:27,137][106226] Updated weights for policy 0, policy_version 1377196 (0.0005) [2023-12-28 05:09:27,756][106226] Updated weights for policy 0, policy_version 1377206 (0.0007) [2023-12-28 05:09:27,812][106226] Updated weights for policy 0, policy_version 1377216 (0.0009) [2023-12-28 05:09:27,827][106225] Updated weights for policy 1, policy_version 1380474 (0.0007) [2023-12-28 05:09:27,861][106226] Updated weights for policy 0, policy_version 1377226 (0.0007) [2023-12-28 05:09:27,875][106225] Updated weights for policy 1, policy_version 1380484 (0.0007) [2023-12-28 05:09:27,924][106225] Updated weights for policy 1, policy_version 1380494 (0.0008) [2023-12-28 05:09:27,973][106225] Updated weights for policy 1, policy_version 1380504 (0.0009) [2023-12-28 05:09:28,477][106226] Updated weights for policy 0, policy_version 1377236 (0.0007) [2023-12-28 05:09:28,534][106226] Updated weights for policy 0, policy_version 1377246 (0.0009) [2023-12-28 05:09:28,586][106226] Updated weights for policy 0, policy_version 1377256 (0.0009) [2023-12-28 05:09:28,753][106225] Updated weights for policy 1, policy_version 1380514 (0.0008) [2023-12-28 05:09:28,811][106225] Updated weights for policy 1, policy_version 1380524 (0.0008) [2023-12-28 05:09:28,861][106225] Updated weights for policy 1, policy_version 1380534 (0.0009) [2023-12-28 05:09:29,310][106226] Updated weights for policy 0, policy_version 1377266 (0.0008) [2023-12-28 05:09:29,386][106226] Updated weights for policy 0, policy_version 1377276 (0.0008) [2023-12-28 05:09:29,445][106226] Updated weights for policy 0, policy_version 1377286 (0.0007) [2023-12-28 05:09:29,501][106226] Updated weights for policy 0, policy_version 1377296 (0.0008) [2023-12-28 05:09:29,651][106225] Updated weights for policy 1, policy_version 1380544 (0.0009) [2023-12-28 05:09:29,709][106225] Updated weights for policy 1, policy_version 1380554 (0.0008) [2023-12-28 05:09:29,770][106225] Updated weights for policy 1, policy_version 1380564 (0.0008) [2023-12-28 05:09:30,250][106226] Updated weights for policy 0, policy_version 1377306 (0.0006) [2023-12-28 05:09:30,306][106226] Updated weights for policy 0, policy_version 1377316 (0.0006) [2023-12-28 05:09:30,355][106226] Updated weights for policy 0, policy_version 1377326 (0.0006) [2023-12-28 05:09:30,528][106225] Updated weights for policy 1, policy_version 1380574 (0.0008) [2023-12-28 05:09:30,593][106225] Updated weights for policy 1, policy_version 1380584 (0.0010) [2023-12-28 05:09:30,653][106225] Updated weights for policy 1, policy_version 1380594 (0.0010) [2023-12-28 05:09:30,947][106226] Updated weights for policy 0, policy_version 1377336 (0.0008) [2023-12-28 05:09:30,996][106226] Updated weights for policy 0, policy_version 1377346 (0.0010) [2023-12-28 05:09:31,062][106226] Updated weights for policy 0, policy_version 1377356 (0.0011) [2023-12-28 05:09:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 706158592. Throughput: 0: 9630.1, 1: 9862.3. Samples: 706145068. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:31,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-4.587')] [2023-12-28 05:09:31,356][106225] Updated weights for policy 1, policy_version 1380604 (0.0009) [2023-12-28 05:09:31,427][106225] Updated weights for policy 1, policy_version 1380614 (0.0008) [2023-12-28 05:09:31,490][106225] Updated weights for policy 1, policy_version 1380624 (0.0010) [2023-12-28 05:09:31,842][106226] Updated weights for policy 0, policy_version 1377366 (0.0008) [2023-12-28 05:09:31,904][106226] Updated weights for policy 0, policy_version 1377376 (0.0005) [2023-12-28 05:09:31,968][106226] Updated weights for policy 0, policy_version 1377386 (0.0007) [2023-12-28 05:09:32,153][106225] Updated weights for policy 1, policy_version 1380634 (0.0007) [2023-12-28 05:09:32,216][106225] Updated weights for policy 1, policy_version 1380644 (0.0007) [2023-12-28 05:09:32,283][106225] Updated weights for policy 1, policy_version 1380654 (0.0008) [2023-12-28 05:09:32,338][106225] Updated weights for policy 1, policy_version 1380664 (0.0006) [2023-12-28 05:09:32,723][106226] Updated weights for policy 0, policy_version 1377396 (0.0007) [2023-12-28 05:09:32,784][106226] Updated weights for policy 0, policy_version 1377406 (0.0008) [2023-12-28 05:09:32,845][106226] Updated weights for policy 0, policy_version 1377416 (0.0010) [2023-12-28 05:09:32,960][106225] Updated weights for policy 1, policy_version 1380674 (0.0007) [2023-12-28 05:09:33,016][106225] Updated weights for policy 1, policy_version 1380684 (0.0008) [2023-12-28 05:09:33,064][106225] Updated weights for policy 1, policy_version 1380694 (0.0009) [2023-12-28 05:09:33,451][106226] Updated weights for policy 0, policy_version 1377426 (0.0010) [2023-12-28 05:09:33,510][106226] Updated weights for policy 0, policy_version 1377436 (0.0008) [2023-12-28 05:09:33,573][106226] Updated weights for policy 0, policy_version 1377446 (0.0008) [2023-12-28 05:09:33,635][106226] Updated weights for policy 0, policy_version 1377456 (0.0010) [2023-12-28 05:09:33,774][106225] Updated weights for policy 1, policy_version 1380704 (0.0007) [2023-12-28 05:09:33,820][106225] Updated weights for policy 1, policy_version 1380714 (0.0008) [2023-12-28 05:09:33,867][106225] Updated weights for policy 1, policy_version 1380724 (0.0008) [2023-12-28 05:09:34,356][106226] Updated weights for policy 0, policy_version 1377466 (0.0008) [2023-12-28 05:09:34,421][106226] Updated weights for policy 0, policy_version 1377476 (0.0009) [2023-12-28 05:09:34,497][106226] Updated weights for policy 0, policy_version 1377486 (0.0009) [2023-12-28 05:09:34,658][106225] Updated weights for policy 1, policy_version 1380734 (0.0008) [2023-12-28 05:09:34,713][106225] Updated weights for policy 1, policy_version 1380744 (0.0007) [2023-12-28 05:09:34,768][106225] Updated weights for policy 1, policy_version 1380754 (0.0005) [2023-12-28 05:09:35,222][106226] Updated weights for policy 0, policy_version 1377496 (0.0006) [2023-12-28 05:09:35,276][106226] Updated weights for policy 0, policy_version 1377506 (0.0005) [2023-12-28 05:09:35,341][106226] Updated weights for policy 0, policy_version 1377516 (0.0005) [2023-12-28 05:09:35,364][106225] Updated weights for policy 1, policy_version 1380764 (0.0007) [2023-12-28 05:09:35,421][106225] Updated weights for policy 1, policy_version 1380774 (0.0008) [2023-12-28 05:09:35,475][106225] Updated weights for policy 1, policy_version 1380784 (0.0010) [2023-12-28 05:09:35,841][106226] Updated weights for policy 0, policy_version 1377526 (0.0005) [2023-12-28 05:09:35,895][106226] Updated weights for policy 0, policy_version 1377536 (0.0005) [2023-12-28 05:09:35,947][106226] Updated weights for policy 0, policy_version 1377546 (0.0006) [2023-12-28 05:09:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 706256896. Throughput: 0: 9787.4, 1: 9889.6. Samples: 706267140. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-28 05:09:36,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.763')] [2023-12-28 05:09:36,219][106225] Updated weights for policy 1, policy_version 1380794 (0.0008) [2023-12-28 05:09:36,282][106225] Updated weights for policy 1, policy_version 1380804 (0.0008) [2023-12-28 05:09:36,338][106225] Updated weights for policy 1, policy_version 1380814 (0.0009) [2023-12-28 05:09:36,393][106225] Updated weights for policy 1, policy_version 1380824 (0.0007) [2023-12-28 05:09:36,657][106226] Updated weights for policy 0, policy_version 1377556 (0.0008) [2023-12-28 05:09:36,717][106226] Updated weights for policy 0, policy_version 1377566 (0.0009) [2023-12-28 05:09:36,787][106226] Updated weights for policy 0, policy_version 1377576 (0.0010) [2023-12-28 05:09:37,031][106225] Updated weights for policy 1, policy_version 1380834 (0.0009) [2023-12-28 05:09:37,083][106225] Updated weights for policy 1, policy_version 1380844 (0.0008) [2023-12-28 05:09:37,134][106225] Updated weights for policy 1, policy_version 1380854 (0.0008) [2023-12-28 05:09:37,567][106226] Updated weights for policy 0, policy_version 1377586 (0.0009) [2023-12-28 05:09:37,624][106226] Updated weights for policy 0, policy_version 1377596 (0.0008) [2023-12-28 05:09:37,682][106226] Updated weights for policy 0, policy_version 1377606 (0.0008) [2023-12-28 05:09:37,739][106226] Updated weights for policy 0, policy_version 1377616 (0.0008) [2023-12-28 05:09:37,756][106225] Updated weights for policy 1, policy_version 1380864 (0.0009) [2023-12-28 05:09:37,817][106225] Updated weights for policy 1, policy_version 1380874 (0.0010) [2023-12-28 05:09:37,877][106225] Updated weights for policy 1, policy_version 1380884 (0.0010) [2023-12-28 05:09:38,434][106226] Updated weights for policy 0, policy_version 1377626 (0.0008) [2023-12-28 05:09:38,484][106226] Updated weights for policy 0, policy_version 1377636 (0.0008) [2023-12-28 05:09:38,539][106226] Updated weights for policy 0, policy_version 1377646 (0.0008) [2023-12-28 05:09:38,608][106225] Updated weights for policy 1, policy_version 1380894 (0.0010) [2023-12-28 05:09:38,670][106225] Updated weights for policy 1, policy_version 1380904 (0.0007) [2023-12-28 05:09:38,731][106225] Updated weights for policy 1, policy_version 1380914 (0.0007) [2023-12-28 05:09:39,284][106226] Updated weights for policy 0, policy_version 1377656 (0.0010) [2023-12-28 05:09:39,305][106225] Updated weights for policy 1, policy_version 1380924 (0.0007) [2023-12-28 05:09:39,346][106226] Updated weights for policy 0, policy_version 1377666 (0.0008) [2023-12-28 05:09:39,370][106225] Updated weights for policy 1, policy_version 1380934 (0.0010) [2023-12-28 05:09:39,421][106226] Updated weights for policy 0, policy_version 1377676 (0.0009) [2023-12-28 05:09:39,436][106225] Updated weights for policy 1, policy_version 1380944 (0.0010) [2023-12-28 05:09:40,074][106226] Updated weights for policy 0, policy_version 1377686 (0.0009) [2023-12-28 05:09:40,136][106226] Updated weights for policy 0, policy_version 1377696 (0.0011) [2023-12-28 05:09:40,193][106226] Updated weights for policy 0, policy_version 1377706 (0.0010) [2023-12-28 05:09:40,221][106225] Updated weights for policy 1, policy_version 1380954 (0.0010) [2023-12-28 05:09:40,282][106225] Updated weights for policy 1, policy_version 1380964 (0.0010) [2023-12-28 05:09:40,344][106225] Updated weights for policy 1, policy_version 1380974 (0.0011) [2023-12-28 05:09:40,407][106225] Updated weights for policy 1, policy_version 1380984 (0.0010) [2023-12-28 05:09:40,873][106226] Updated weights for policy 0, policy_version 1377716 (0.0009) [2023-12-28 05:09:40,933][106226] Updated weights for policy 0, policy_version 1377726 (0.0010) [2023-12-28 05:09:40,983][106226] Updated weights for policy 0, policy_version 1377736 (0.0010) [2023-12-28 05:09:41,103][106225] Updated weights for policy 1, policy_version 1380994 (0.0010) [2023-12-28 05:09:41,164][106225] Updated weights for policy 1, policy_version 1381004 (0.0011) [2023-12-28 05:09:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 706355200. Throughput: 0: 9762.1, 1: 9915.3. Samples: 706325356. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:09:41,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.484')] [2023-12-28 05:09:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001377744_352772096.pth... [2023-12-28 05:09:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001376592_352477184.pth [2023-12-28 05:09:41,227][106225] Updated weights for policy 1, policy_version 1381014 (0.0006) [2023-12-28 05:09:41,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001381016_353591296.pth... [2023-12-28 05:09:41,246][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001379864_353296384.pth [2023-12-28 05:09:41,794][106226] Updated weights for policy 0, policy_version 1377746 (0.0010) [2023-12-28 05:09:41,859][106226] Updated weights for policy 0, policy_version 1377756 (0.0006) [2023-12-28 05:09:41,915][106226] Updated weights for policy 0, policy_version 1377766 (0.0008) [2023-12-28 05:09:41,970][106226] Updated weights for policy 0, policy_version 1377776 (0.0005) [2023-12-28 05:09:42,038][106225] Updated weights for policy 1, policy_version 1381024 (0.0009) [2023-12-28 05:09:42,097][106225] Updated weights for policy 1, policy_version 1381034 (0.0009) [2023-12-28 05:09:42,161][106225] Updated weights for policy 1, policy_version 1381044 (0.0009) [2023-12-28 05:09:42,767][106226] Updated weights for policy 0, policy_version 1377786 (0.0006) [2023-12-28 05:09:42,832][106226] Updated weights for policy 0, policy_version 1377796 (0.0008) [2023-12-28 05:09:42,895][106226] Updated weights for policy 0, policy_version 1377806 (0.0008) [2023-12-28 05:09:42,974][106225] Updated weights for policy 1, policy_version 1381054 (0.0008) [2023-12-28 05:09:43,032][106225] Updated weights for policy 1, policy_version 1381064 (0.0009) [2023-12-28 05:09:43,090][106225] Updated weights for policy 1, policy_version 1381074 (0.0010) [2023-12-28 05:09:43,454][106226] Updated weights for policy 0, policy_version 1377816 (0.0006) [2023-12-28 05:09:43,505][106226] Updated weights for policy 0, policy_version 1377826 (0.0005) [2023-12-28 05:09:43,567][106226] Updated weights for policy 0, policy_version 1377836 (0.0005) [2023-12-28 05:09:43,715][106225] Updated weights for policy 1, policy_version 1381084 (0.0008) [2023-12-28 05:09:43,776][106225] Updated weights for policy 1, policy_version 1381094 (0.0008) [2023-12-28 05:09:43,836][106225] Updated weights for policy 1, policy_version 1381104 (0.0008) [2023-12-28 05:09:44,174][106226] Updated weights for policy 0, policy_version 1377846 (0.0007) [2023-12-28 05:09:44,234][106226] Updated weights for policy 0, policy_version 1377856 (0.0008) [2023-12-28 05:09:44,288][106226] Updated weights for policy 0, policy_version 1377866 (0.0009) [2023-12-28 05:09:44,504][106225] Updated weights for policy 1, policy_version 1381114 (0.0008) [2023-12-28 05:09:44,556][106225] Updated weights for policy 1, policy_version 1381124 (0.0008) [2023-12-28 05:09:44,605][106225] Updated weights for policy 1, policy_version 1381134 (0.0008) [2023-12-28 05:09:44,653][106225] Updated weights for policy 1, policy_version 1381144 (0.0009) [2023-12-28 05:09:45,047][106226] Updated weights for policy 0, policy_version 1377876 (0.0009) [2023-12-28 05:09:45,117][106226] Updated weights for policy 0, policy_version 1377886 (0.0009) [2023-12-28 05:09:45,181][106226] Updated weights for policy 0, policy_version 1377896 (0.0009) [2023-12-28 05:09:45,454][106225] Updated weights for policy 1, policy_version 1381154 (0.0009) [2023-12-28 05:09:45,505][106225] Updated weights for policy 1, policy_version 1381164 (0.0008) [2023-12-28 05:09:45,552][106225] Updated weights for policy 1, policy_version 1381174 (0.0009) [2023-12-28 05:09:45,853][106226] Updated weights for policy 0, policy_version 1377906 (0.0009) [2023-12-28 05:09:45,901][106226] Updated weights for policy 0, policy_version 1377916 (0.0009) [2023-12-28 05:09:45,949][106226] Updated weights for policy 0, policy_version 1377926 (0.0008) [2023-12-28 05:09:45,993][106226] Updated weights for policy 0, policy_version 1377936 (0.0008) [2023-12-28 05:09:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 706453504. Throughput: 0: 9892.9, 1: 9838.9. Samples: 706443580. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:09:46,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.521')] [2023-12-28 05:09:46,311][106225] Updated weights for policy 1, policy_version 1381184 (0.0008) [2023-12-28 05:09:46,369][106225] Updated weights for policy 1, policy_version 1381194 (0.0009) [2023-12-28 05:09:46,422][106225] Updated weights for policy 1, policy_version 1381204 (0.0008) [2023-12-28 05:09:46,727][106226] Updated weights for policy 0, policy_version 1377946 (0.0005) [2023-12-28 05:09:46,784][106226] Updated weights for policy 0, policy_version 1377956 (0.0006) [2023-12-28 05:09:46,845][106226] Updated weights for policy 0, policy_version 1377966 (0.0009) [2023-12-28 05:09:47,122][106225] Updated weights for policy 1, policy_version 1381214 (0.0009) [2023-12-28 05:09:47,179][106225] Updated weights for policy 1, policy_version 1381224 (0.0008) [2023-12-28 05:09:47,233][106225] Updated weights for policy 1, policy_version 1381234 (0.0009) [2023-12-28 05:09:47,441][106226] Updated weights for policy 0, policy_version 1377976 (0.0006) [2023-12-28 05:09:47,513][106226] Updated weights for policy 0, policy_version 1377986 (0.0005) [2023-12-28 05:09:47,578][106226] Updated weights for policy 0, policy_version 1377996 (0.0005) [2023-12-28 05:09:47,889][106225] Updated weights for policy 1, policy_version 1381244 (0.0007) [2023-12-28 05:09:47,946][106225] Updated weights for policy 1, policy_version 1381254 (0.0006) [2023-12-28 05:09:48,005][106225] Updated weights for policy 1, policy_version 1381264 (0.0008) [2023-12-28 05:09:48,155][106226] Updated weights for policy 0, policy_version 1378006 (0.0008) [2023-12-28 05:09:48,199][106226] Updated weights for policy 0, policy_version 1378016 (0.0008) [2023-12-28 05:09:48,245][106226] Updated weights for policy 0, policy_version 1378026 (0.0008) [2023-12-28 05:09:48,714][106225] Updated weights for policy 1, policy_version 1381274 (0.0008) [2023-12-28 05:09:48,766][106225] Updated weights for policy 1, policy_version 1381284 (0.0008) [2023-12-28 05:09:48,825][106225] Updated weights for policy 1, policy_version 1381294 (0.0008) [2023-12-28 05:09:48,884][106225] Updated weights for policy 1, policy_version 1381304 (0.0009) [2023-12-28 05:09:48,967][106226] Updated weights for policy 0, policy_version 1378036 (0.0008) [2023-12-28 05:09:49,025][106226] Updated weights for policy 0, policy_version 1378046 (0.0008) [2023-12-28 05:09:49,076][106226] Updated weights for policy 0, policy_version 1378056 (0.0006) [2023-12-28 05:09:49,564][106225] Updated weights for policy 1, policy_version 1381314 (0.0009) [2023-12-28 05:09:49,610][106225] Updated weights for policy 1, policy_version 1381324 (0.0008) [2023-12-28 05:09:49,666][106225] Updated weights for policy 1, policy_version 1381334 (0.0008) [2023-12-28 05:09:49,785][106226] Updated weights for policy 0, policy_version 1378066 (0.0008) [2023-12-28 05:09:49,841][106226] Updated weights for policy 0, policy_version 1378076 (0.0007) [2023-12-28 05:09:49,909][106226] Updated weights for policy 0, policy_version 1378086 (0.0009) [2023-12-28 05:09:49,971][106226] Updated weights for policy 0, policy_version 1378096 (0.0009) [2023-12-28 05:09:50,448][106225] Updated weights for policy 1, policy_version 1381344 (0.0008) [2023-12-28 05:09:50,514][106225] Updated weights for policy 1, policy_version 1381354 (0.0009) [2023-12-28 05:09:50,580][106225] Updated weights for policy 1, policy_version 1381364 (0.0009) [2023-12-28 05:09:50,675][106226] Updated weights for policy 0, policy_version 1378106 (0.0011) [2023-12-28 05:09:50,733][106226] Updated weights for policy 0, policy_version 1378116 (0.0011) [2023-12-28 05:09:50,802][106226] Updated weights for policy 0, policy_version 1378126 (0.0011) [2023-12-28 05:09:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 706551808. Throughput: 0: 9853.5, 1: 9807.0. Samples: 706561988. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:09:51,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.617')] [2023-12-28 05:09:51,302][106225] Updated weights for policy 1, policy_version 1381374 (0.0008) [2023-12-28 05:09:51,375][106225] Updated weights for policy 1, policy_version 1381384 (0.0009) [2023-12-28 05:09:51,439][106225] Updated weights for policy 1, policy_version 1381394 (0.0008) [2023-12-28 05:09:51,546][106226] Updated weights for policy 0, policy_version 1378136 (0.0010) [2023-12-28 05:09:51,613][106226] Updated weights for policy 0, policy_version 1378146 (0.0009) [2023-12-28 05:09:51,688][106226] Updated weights for policy 0, policy_version 1378156 (0.0007) [2023-12-28 05:09:52,168][106225] Updated weights for policy 1, policy_version 1381404 (0.0008) [2023-12-28 05:09:52,233][106225] Updated weights for policy 1, policy_version 1381414 (0.0008) [2023-12-28 05:09:52,293][106225] Updated weights for policy 1, policy_version 1381424 (0.0009) [2023-12-28 05:09:52,450][106226] Updated weights for policy 0, policy_version 1378166 (0.0007) [2023-12-28 05:09:52,509][106226] Updated weights for policy 0, policy_version 1378176 (0.0009) [2023-12-28 05:09:52,568][106226] Updated weights for policy 0, policy_version 1378186 (0.0008) [2023-12-28 05:09:53,033][106225] Updated weights for policy 1, policy_version 1381434 (0.0008) [2023-12-28 05:09:53,096][106225] Updated weights for policy 1, policy_version 1381444 (0.0009) [2023-12-28 05:09:53,142][106225] Updated weights for policy 1, policy_version 1381454 (0.0007) [2023-12-28 05:09:53,199][106225] Updated weights for policy 1, policy_version 1381464 (0.0008) [2023-12-28 05:09:53,251][106226] Updated weights for policy 0, policy_version 1378196 (0.0009) [2023-12-28 05:09:53,306][106226] Updated weights for policy 0, policy_version 1378206 (0.0008) [2023-12-28 05:09:53,373][106226] Updated weights for policy 0, policy_version 1378216 (0.0008) [2023-12-28 05:09:53,892][106225] Updated weights for policy 1, policy_version 1381474 (0.0005) [2023-12-28 05:09:53,952][106225] Updated weights for policy 1, policy_version 1381484 (0.0009) [2023-12-28 05:09:54,010][106225] Updated weights for policy 1, policy_version 1381494 (0.0008) [2023-12-28 05:09:54,132][106226] Updated weights for policy 0, policy_version 1378226 (0.0009) [2023-12-28 05:09:54,189][106226] Updated weights for policy 0, policy_version 1378236 (0.0008) [2023-12-28 05:09:54,248][106226] Updated weights for policy 0, policy_version 1378246 (0.0006) [2023-12-28 05:09:54,302][106226] Updated weights for policy 0, policy_version 1378256 (0.0008) [2023-12-28 05:09:54,668][106225] Updated weights for policy 1, policy_version 1381504 (0.0010) [2023-12-28 05:09:54,720][106225] Updated weights for policy 1, policy_version 1381514 (0.0010) [2023-12-28 05:09:54,774][106225] Updated weights for policy 1, policy_version 1381524 (0.0010) [2023-12-28 05:09:55,030][106226] Updated weights for policy 0, policy_version 1378266 (0.0008) [2023-12-28 05:09:55,081][106226] Updated weights for policy 0, policy_version 1378276 (0.0005) [2023-12-28 05:09:55,128][106226] Updated weights for policy 0, policy_version 1378286 (0.0006) [2023-12-28 05:09:55,472][106225] Updated weights for policy 1, policy_version 1381534 (0.0010) [2023-12-28 05:09:55,534][106225] Updated weights for policy 1, policy_version 1381544 (0.0010) [2023-12-28 05:09:55,594][106225] Updated weights for policy 1, policy_version 1381554 (0.0010) [2023-12-28 05:09:55,834][106226] Updated weights for policy 0, policy_version 1378296 (0.0008) [2023-12-28 05:09:55,893][106226] Updated weights for policy 0, policy_version 1378306 (0.0008) [2023-12-28 05:09:55,953][106226] Updated weights for policy 0, policy_version 1378316 (0.0008) [2023-12-28 05:09:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 706650112. Throughput: 0: 9866.1, 1: 9742.7. Samples: 706619268. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:09:56,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.680')] [2023-12-28 05:09:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001378320_352919552.pth... [2023-12-28 05:09:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001381560_353730560.pth... [2023-12-28 05:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001377136_352616448.pth [2023-12-28 05:09:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001380440_353443840.pth [2023-12-28 05:09:56,310][106225] Updated weights for policy 1, policy_version 1381564 (0.0010) [2023-12-28 05:09:56,360][106225] Updated weights for policy 1, policy_version 1381574 (0.0010) [2023-12-28 05:09:56,423][106225] Updated weights for policy 1, policy_version 1381584 (0.0010) [2023-12-28 05:09:56,698][106226] Updated weights for policy 0, policy_version 1378326 (0.0008) [2023-12-28 05:09:56,756][106226] Updated weights for policy 0, policy_version 1378336 (0.0008) [2023-12-28 05:09:56,814][106226] Updated weights for policy 0, policy_version 1378346 (0.0008) [2023-12-28 05:09:57,143][106225] Updated weights for policy 1, policy_version 1381594 (0.0010) [2023-12-28 05:09:57,193][106225] Updated weights for policy 1, policy_version 1381604 (0.0010) [2023-12-28 05:09:57,247][106225] Updated weights for policy 1, policy_version 1381614 (0.0010) [2023-12-28 05:09:57,301][106225] Updated weights for policy 1, policy_version 1381624 (0.0009) [2023-12-28 05:09:57,533][106226] Updated weights for policy 0, policy_version 1378356 (0.0009) [2023-12-28 05:09:57,586][106226] Updated weights for policy 0, policy_version 1378366 (0.0008) [2023-12-28 05:09:57,635][106226] Updated weights for policy 0, policy_version 1378376 (0.0007) [2023-12-28 05:09:57,945][106225] Updated weights for policy 1, policy_version 1381634 (0.0010) [2023-12-28 05:09:58,003][106225] Updated weights for policy 1, policy_version 1381644 (0.0010) [2023-12-28 05:09:58,059][106225] Updated weights for policy 1, policy_version 1381654 (0.0010) [2023-12-28 05:09:58,375][106226] Updated weights for policy 0, policy_version 1378386 (0.0007) [2023-12-28 05:09:58,441][106226] Updated weights for policy 0, policy_version 1378396 (0.0008) [2023-12-28 05:09:58,502][106226] Updated weights for policy 0, policy_version 1378406 (0.0008) [2023-12-28 05:09:58,562][106226] Updated weights for policy 0, policy_version 1378416 (0.0008) [2023-12-28 05:09:58,820][106225] Updated weights for policy 1, policy_version 1381664 (0.0009) [2023-12-28 05:09:58,887][106225] Updated weights for policy 1, policy_version 1381674 (0.0010) [2023-12-28 05:09:58,953][106225] Updated weights for policy 1, policy_version 1381684 (0.0010) [2023-12-28 05:09:59,348][106226] Updated weights for policy 0, policy_version 1378426 (0.0008) [2023-12-28 05:09:59,420][106226] Updated weights for policy 0, policy_version 1378436 (0.0009) [2023-12-28 05:09:59,479][106226] Updated weights for policy 0, policy_version 1378446 (0.0009) [2023-12-28 05:09:59,645][106225] Updated weights for policy 1, policy_version 1381694 (0.0011) [2023-12-28 05:09:59,699][106225] Updated weights for policy 1, policy_version 1381704 (0.0010) [2023-12-28 05:09:59,753][106225] Updated weights for policy 1, policy_version 1381714 (0.0008) [2023-12-28 05:10:00,243][106226] Updated weights for policy 0, policy_version 1378456 (0.0007) [2023-12-28 05:10:00,309][106226] Updated weights for policy 0, policy_version 1378466 (0.0009) [2023-12-28 05:10:00,379][106226] Updated weights for policy 0, policy_version 1378476 (0.0010) [2023-12-28 05:10:00,434][106225] Updated weights for policy 1, policy_version 1381724 (0.0010) [2023-12-28 05:10:00,493][106225] Updated weights for policy 1, policy_version 1381734 (0.0008) [2023-12-28 05:10:00,552][106225] Updated weights for policy 1, policy_version 1381744 (0.0010) [2023-12-28 05:10:01,150][106225] Updated weights for policy 1, policy_version 1381754 (0.0007) [2023-12-28 05:10:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 706740224. Throughput: 0: 9906.9, 1: 9733.7. Samples: 706735140. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:01,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.866')] [2023-12-28 05:10:01,203][106226] Updated weights for policy 0, policy_version 1378486 (0.0009) [2023-12-28 05:10:01,206][106225] Updated weights for policy 1, policy_version 1381764 (0.0009) [2023-12-28 05:10:01,265][106226] Updated weights for policy 0, policy_version 1378496 (0.0006) [2023-12-28 05:10:01,267][106225] Updated weights for policy 1, policy_version 1381774 (0.0011) [2023-12-28 05:10:01,321][106225] Updated weights for policy 1, policy_version 1381784 (0.0009) [2023-12-28 05:10:01,324][106226] Updated weights for policy 0, policy_version 1378506 (0.0006) [2023-12-28 05:10:02,042][106225] Updated weights for policy 1, policy_version 1381794 (0.0010) [2023-12-28 05:10:02,102][106225] Updated weights for policy 1, policy_version 1381804 (0.0009) [2023-12-28 05:10:02,157][106225] Updated weights for policy 1, policy_version 1381814 (0.0006) [2023-12-28 05:10:02,183][106226] Updated weights for policy 0, policy_version 1378516 (0.0008) [2023-12-28 05:10:02,248][106226] Updated weights for policy 0, policy_version 1378526 (0.0010) [2023-12-28 05:10:02,321][106226] Updated weights for policy 0, policy_version 1378536 (0.0010) [2023-12-28 05:10:02,855][106225] Updated weights for policy 1, policy_version 1381824 (0.0007) [2023-12-28 05:10:02,913][106225] Updated weights for policy 1, policy_version 1381834 (0.0007) [2023-12-28 05:10:02,956][106225] Updated weights for policy 1, policy_version 1381844 (0.0005) [2023-12-28 05:10:03,056][106226] Updated weights for policy 0, policy_version 1378546 (0.0008) [2023-12-28 05:10:03,105][106226] Updated weights for policy 0, policy_version 1378556 (0.0009) [2023-12-28 05:10:03,153][106226] Updated weights for policy 0, policy_version 1378566 (0.0008) [2023-12-28 05:10:03,205][106226] Updated weights for policy 0, policy_version 1378576 (0.0006) [2023-12-28 05:10:03,599][106225] Updated weights for policy 1, policy_version 1381854 (0.0006) [2023-12-28 05:10:03,644][106225] Updated weights for policy 1, policy_version 1381864 (0.0005) [2023-12-28 05:10:03,690][106225] Updated weights for policy 1, policy_version 1381874 (0.0005) [2023-12-28 05:10:03,796][106226] Updated weights for policy 0, policy_version 1378586 (0.0005) [2023-12-28 05:10:03,862][106226] Updated weights for policy 0, policy_version 1378596 (0.0010) [2023-12-28 05:10:03,926][106226] Updated weights for policy 0, policy_version 1378606 (0.0011) [2023-12-28 05:10:04,373][106225] Updated weights for policy 1, policy_version 1381884 (0.0007) [2023-12-28 05:10:04,439][106225] Updated weights for policy 1, policy_version 1381894 (0.0008) [2023-12-28 05:10:04,493][106225] Updated weights for policy 1, policy_version 1381904 (0.0008) [2023-12-28 05:10:04,630][106226] Updated weights for policy 0, policy_version 1378616 (0.0011) [2023-12-28 05:10:04,676][106226] Updated weights for policy 0, policy_version 1378626 (0.0010) [2023-12-28 05:10:04,729][106226] Updated weights for policy 0, policy_version 1378636 (0.0010) [2023-12-28 05:10:05,231][106225] Updated weights for policy 1, policy_version 1381914 (0.0008) [2023-12-28 05:10:05,284][106225] Updated weights for policy 1, policy_version 1381924 (0.0007) [2023-12-28 05:10:05,328][106225] Updated weights for policy 1, policy_version 1381934 (0.0008) [2023-12-28 05:10:05,382][106225] Updated weights for policy 1, policy_version 1381944 (0.0008) [2023-12-28 05:10:05,438][106226] Updated weights for policy 0, policy_version 1378646 (0.0009) [2023-12-28 05:10:05,485][106226] Updated weights for policy 0, policy_version 1378656 (0.0008) [2023-12-28 05:10:05,530][106226] Updated weights for policy 0, policy_version 1378666 (0.0009) [2023-12-28 05:10:06,120][106225] Updated weights for policy 1, policy_version 1381954 (0.0008) [2023-12-28 05:10:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 706838528. Throughput: 0: 9868.8, 1: 9811.0. Samples: 706853108. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:06,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.419')] [2023-12-28 05:10:06,182][106225] Updated weights for policy 1, policy_version 1381964 (0.0007) [2023-12-28 05:10:06,249][106225] Updated weights for policy 1, policy_version 1381974 (0.0007) [2023-12-28 05:10:06,311][106226] Updated weights for policy 0, policy_version 1378677 (0.0010) [2023-12-28 05:10:06,381][106226] Updated weights for policy 0, policy_version 1378687 (0.0009) [2023-12-28 05:10:06,446][106226] Updated weights for policy 0, policy_version 1378697 (0.0006) [2023-12-28 05:10:06,989][106225] Updated weights for policy 1, policy_version 1381984 (0.0008) [2023-12-28 05:10:07,041][106225] Updated weights for policy 1, policy_version 1381994 (0.0008) [2023-12-28 05:10:07,102][106225] Updated weights for policy 1, policy_version 1382004 (0.0007) [2023-12-28 05:10:07,131][106226] Updated weights for policy 0, policy_version 1378707 (0.0007) [2023-12-28 05:10:07,188][106226] Updated weights for policy 0, policy_version 1378717 (0.0011) [2023-12-28 05:10:07,254][106226] Updated weights for policy 0, policy_version 1378727 (0.0011) [2023-12-28 05:10:07,741][106225] Updated weights for policy 1, policy_version 1382014 (0.0007) [2023-12-28 05:10:07,803][106225] Updated weights for policy 1, policy_version 1382024 (0.0008) [2023-12-28 05:10:07,859][106225] Updated weights for policy 1, policy_version 1382034 (0.0009) [2023-12-28 05:10:07,864][106226] Updated weights for policy 0, policy_version 1378737 (0.0010) [2023-12-28 05:10:07,919][106226] Updated weights for policy 0, policy_version 1378747 (0.0007) [2023-12-28 05:10:07,976][106226] Updated weights for policy 0, policy_version 1378757 (0.0010) [2023-12-28 05:10:08,033][106226] Updated weights for policy 0, policy_version 1378767 (0.0010) [2023-12-28 05:10:08,570][106225] Updated weights for policy 1, policy_version 1382044 (0.0009) [2023-12-28 05:10:08,621][106225] Updated weights for policy 1, policy_version 1382054 (0.0006) [2023-12-28 05:10:08,678][106225] Updated weights for policy 1, policy_version 1382064 (0.0005) [2023-12-28 05:10:08,745][106226] Updated weights for policy 0, policy_version 1378777 (0.0011) [2023-12-28 05:10:08,799][106226] Updated weights for policy 0, policy_version 1378787 (0.0010) [2023-12-28 05:10:08,851][106226] Updated weights for policy 0, policy_version 1378797 (0.0008) [2023-12-28 05:10:09,452][106225] Updated weights for policy 1, policy_version 1382074 (0.0007) [2023-12-28 05:10:09,491][106226] Updated weights for policy 0, policy_version 1378807 (0.0009) [2023-12-28 05:10:09,513][106225] Updated weights for policy 1, policy_version 1382084 (0.0010) [2023-12-28 05:10:09,556][106226] Updated weights for policy 0, policy_version 1378817 (0.0009) [2023-12-28 05:10:09,574][106225] Updated weights for policy 1, policy_version 1382094 (0.0011) [2023-12-28 05:10:09,619][106226] Updated weights for policy 0, policy_version 1378827 (0.0006) [2023-12-28 05:10:09,642][106225] Updated weights for policy 1, policy_version 1382104 (0.0010) [2023-12-28 05:10:10,274][106226] Updated weights for policy 0, policy_version 1378837 (0.0010) [2023-12-28 05:10:10,341][106226] Updated weights for policy 0, policy_version 1378847 (0.0011) [2023-12-28 05:10:10,373][106225] Updated weights for policy 1, policy_version 1382114 (0.0007) [2023-12-28 05:10:10,410][106226] Updated weights for policy 0, policy_version 1378857 (0.0010) [2023-12-28 05:10:10,436][106225] Updated weights for policy 1, policy_version 1382124 (0.0009) [2023-12-28 05:10:10,499][106225] Updated weights for policy 1, policy_version 1382134 (0.0009) [2023-12-28 05:10:11,120][106226] Updated weights for policy 0, policy_version 1378867 (0.0010) [2023-12-28 05:10:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 706936832. Throughput: 0: 9912.1, 1: 9808.6. Samples: 706913256. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:11,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.727')] [2023-12-28 05:10:11,183][106225] Updated weights for policy 1, policy_version 1382144 (0.0008) [2023-12-28 05:10:11,197][106226] Updated weights for policy 0, policy_version 1378877 (0.0008) [2023-12-28 05:10:11,249][106225] Updated weights for policy 1, policy_version 1382154 (0.0010) [2023-12-28 05:10:11,262][106226] Updated weights for policy 0, policy_version 1378887 (0.0007) [2023-12-28 05:10:11,312][106225] Updated weights for policy 1, policy_version 1382164 (0.0009) [2023-12-28 05:10:11,317][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001378896_353067008.pth... [2023-12-28 05:10:11,320][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001377744_352772096.pth [2023-12-28 05:10:11,337][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001382168_353886208.pth... [2023-12-28 05:10:11,343][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001381016_353591296.pth [2023-12-28 05:10:12,008][106226] Updated weights for policy 0, policy_version 1378897 (0.0008) [2023-12-28 05:10:12,071][106226] Updated weights for policy 0, policy_version 1378907 (0.0011) [2023-12-28 05:10:12,136][106226] Updated weights for policy 0, policy_version 1378917 (0.0011) [2023-12-28 05:10:12,142][106225] Updated weights for policy 1, policy_version 1382174 (0.0010) [2023-12-28 05:10:12,193][106226] Updated weights for policy 0, policy_version 1378927 (0.0011) [2023-12-28 05:10:12,202][106225] Updated weights for policy 1, policy_version 1382184 (0.0005) [2023-12-28 05:10:12,277][106225] Updated weights for policy 1, policy_version 1382194 (0.0007) [2023-12-28 05:10:12,910][106225] Updated weights for policy 1, policy_version 1382204 (0.0008) [2023-12-28 05:10:12,958][106225] Updated weights for policy 1, policy_version 1382214 (0.0006) [2023-12-28 05:10:12,974][106226] Updated weights for policy 0, policy_version 1378937 (0.0011) [2023-12-28 05:10:13,010][106225] Updated weights for policy 1, policy_version 1382224 (0.0008) [2023-12-28 05:10:13,035][106226] Updated weights for policy 0, policy_version 1378947 (0.0011) [2023-12-28 05:10:13,099][106226] Updated weights for policy 0, policy_version 1378957 (0.0011) [2023-12-28 05:10:13,732][106225] Updated weights for policy 1, policy_version 1382234 (0.0006) [2023-12-28 05:10:13,795][106225] Updated weights for policy 1, policy_version 1382244 (0.0008) [2023-12-28 05:10:13,811][106226] Updated weights for policy 0, policy_version 1378967 (0.0011) [2023-12-28 05:10:13,855][106225] Updated weights for policy 1, policy_version 1382254 (0.0007) [2023-12-28 05:10:13,869][106226] Updated weights for policy 0, policy_version 1378977 (0.0011) [2023-12-28 05:10:13,911][106225] Updated weights for policy 1, policy_version 1382264 (0.0006) [2023-12-28 05:10:13,924][106226] Updated weights for policy 0, policy_version 1378987 (0.0011) [2023-12-28 05:10:14,638][106226] Updated weights for policy 0, policy_version 1378997 (0.0011) [2023-12-28 05:10:14,639][106225] Updated weights for policy 1, policy_version 1382274 (0.0007) [2023-12-28 05:10:14,690][106225] Updated weights for policy 1, policy_version 1382284 (0.0005) [2023-12-28 05:10:14,691][106226] Updated weights for policy 0, policy_version 1379007 (0.0010) [2023-12-28 05:10:14,736][106225] Updated weights for policy 1, policy_version 1382294 (0.0006) [2023-12-28 05:10:14,741][106226] Updated weights for policy 0, policy_version 1379017 (0.0010) [2023-12-28 05:10:15,418][106226] Updated weights for policy 0, policy_version 1379027 (0.0009) [2023-12-28 05:10:15,470][106226] Updated weights for policy 0, policy_version 1379037 (0.0009) [2023-12-28 05:10:15,506][106225] Updated weights for policy 1, policy_version 1382304 (0.0005) [2023-12-28 05:10:15,524][106226] Updated weights for policy 0, policy_version 1379047 (0.0008) [2023-12-28 05:10:15,564][106225] Updated weights for policy 1, policy_version 1382314 (0.0005) [2023-12-28 05:10:15,611][106225] Updated weights for policy 1, policy_version 1382324 (0.0005) [2023-12-28 05:10:16,168][106226] Updated weights for policy 0, policy_version 1379057 (0.0008) [2023-12-28 05:10:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 707035136. Throughput: 0: 9783.7, 1: 9832.0. Samples: 707027776. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:16,176][105115] Avg episode reward: [(0, '-4.783'), (1, '-4.653')] [2023-12-28 05:10:16,233][106226] Updated weights for policy 0, policy_version 1379067 (0.0007) [2023-12-28 05:10:16,274][106225] Updated weights for policy 1, policy_version 1382334 (0.0008) [2023-12-28 05:10:16,290][106226] Updated weights for policy 0, policy_version 1379077 (0.0006) [2023-12-28 05:10:16,327][106225] Updated weights for policy 1, policy_version 1382344 (0.0010) [2023-12-28 05:10:16,352][106226] Updated weights for policy 0, policy_version 1379087 (0.0005) [2023-12-28 05:10:16,380][106225] Updated weights for policy 1, policy_version 1382354 (0.0010) [2023-12-28 05:10:17,053][106226] Updated weights for policy 0, policy_version 1379097 (0.0008) [2023-12-28 05:10:17,105][106225] Updated weights for policy 1, policy_version 1382364 (0.0010) [2023-12-28 05:10:17,108][106226] Updated weights for policy 0, policy_version 1379107 (0.0007) [2023-12-28 05:10:17,155][106225] Updated weights for policy 1, policy_version 1382374 (0.0010) [2023-12-28 05:10:17,165][106226] Updated weights for policy 0, policy_version 1379117 (0.0006) [2023-12-28 05:10:17,208][106225] Updated weights for policy 1, policy_version 1382384 (0.0010) [2023-12-28 05:10:17,889][106226] Updated weights for policy 0, policy_version 1379127 (0.0007) [2023-12-28 05:10:17,931][106225] Updated weights for policy 1, policy_version 1382394 (0.0010) [2023-12-28 05:10:17,936][106226] Updated weights for policy 0, policy_version 1379137 (0.0008) [2023-12-28 05:10:17,978][106225] Updated weights for policy 1, policy_version 1382404 (0.0010) [2023-12-28 05:10:17,988][106226] Updated weights for policy 0, policy_version 1379147 (0.0006) [2023-12-28 05:10:18,025][106225] Updated weights for policy 1, policy_version 1382414 (0.0010) [2023-12-28 05:10:18,075][106225] Updated weights for policy 1, policy_version 1382424 (0.0010) [2023-12-28 05:10:18,717][106225] Updated weights for policy 1, policy_version 1382434 (0.0009) [2023-12-28 05:10:18,723][106226] Updated weights for policy 0, policy_version 1379157 (0.0006) [2023-12-28 05:10:18,775][106225] Updated weights for policy 1, policy_version 1382444 (0.0010) [2023-12-28 05:10:18,789][106226] Updated weights for policy 0, policy_version 1379167 (0.0007) [2023-12-28 05:10:18,827][106225] Updated weights for policy 1, policy_version 1382454 (0.0010) [2023-12-28 05:10:18,852][106226] Updated weights for policy 0, policy_version 1379177 (0.0007) [2023-12-28 05:10:19,486][106225] Updated weights for policy 1, policy_version 1382464 (0.0009) [2023-12-28 05:10:19,548][106225] Updated weights for policy 1, policy_version 1382474 (0.0009) [2023-12-28 05:10:19,579][106226] Updated weights for policy 0, policy_version 1379187 (0.0008) [2023-12-28 05:10:19,602][106225] Updated weights for policy 1, policy_version 1382484 (0.0011) [2023-12-28 05:10:19,640][106226] Updated weights for policy 0, policy_version 1379197 (0.0006) [2023-12-28 05:10:19,703][106226] Updated weights for policy 0, policy_version 1379207 (0.0008) [2023-12-28 05:10:20,374][106225] Updated weights for policy 1, policy_version 1382494 (0.0010) [2023-12-28 05:10:20,423][106225] Updated weights for policy 1, policy_version 1382504 (0.0008) [2023-12-28 05:10:20,442][106226] Updated weights for policy 0, policy_version 1379217 (0.0009) [2023-12-28 05:10:20,476][106225] Updated weights for policy 1, policy_version 1382514 (0.0006) [2023-12-28 05:10:20,498][106226] Updated weights for policy 0, policy_version 1379227 (0.0008) [2023-12-28 05:10:20,554][106226] Updated weights for policy 0, policy_version 1379237 (0.0008) [2023-12-28 05:10:20,618][106226] Updated weights for policy 0, policy_version 1379247 (0.0006) [2023-12-28 05:10:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 707133440. Throughput: 0: 9700.3, 1: 9826.4. Samples: 707145840. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:21,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.530')] [2023-12-28 05:10:21,251][106225] Updated weights for policy 1, policy_version 1382524 (0.0006) [2023-12-28 05:10:21,320][106225] Updated weights for policy 1, policy_version 1382534 (0.0009) [2023-12-28 05:10:21,390][106225] Updated weights for policy 1, policy_version 1382544 (0.0008) [2023-12-28 05:10:21,392][106226] Updated weights for policy 0, policy_version 1379257 (0.0006) [2023-12-28 05:10:21,454][106226] Updated weights for policy 0, policy_version 1379267 (0.0008) [2023-12-28 05:10:21,512][106226] Updated weights for policy 0, policy_version 1379277 (0.0009) [2023-12-28 05:10:22,153][106225] Updated weights for policy 1, policy_version 1382554 (0.0007) [2023-12-28 05:10:22,220][106225] Updated weights for policy 1, policy_version 1382564 (0.0005) [2023-12-28 05:10:22,290][106225] Updated weights for policy 1, policy_version 1382574 (0.0007) [2023-12-28 05:10:22,328][106226] Updated weights for policy 0, policy_version 1379287 (0.0007) [2023-12-28 05:10:22,366][106225] Updated weights for policy 1, policy_version 1382584 (0.0007) [2023-12-28 05:10:22,396][106226] Updated weights for policy 0, policy_version 1379297 (0.0008) [2023-12-28 05:10:22,449][106226] Updated weights for policy 0, policy_version 1379307 (0.0008) [2023-12-28 05:10:23,009][106225] Updated weights for policy 1, policy_version 1382594 (0.0008) [2023-12-28 05:10:23,069][106225] Updated weights for policy 1, policy_version 1382604 (0.0009) [2023-12-28 05:10:23,125][106225] Updated weights for policy 1, policy_version 1382614 (0.0008) [2023-12-28 05:10:23,218][106226] Updated weights for policy 0, policy_version 1379317 (0.0009) [2023-12-28 05:10:23,273][106226] Updated weights for policy 0, policy_version 1379327 (0.0008) [2023-12-28 05:10:23,336][106226] Updated weights for policy 0, policy_version 1379337 (0.0008) [2023-12-28 05:10:23,876][106225] Updated weights for policy 1, policy_version 1382624 (0.0009) [2023-12-28 05:10:23,936][106225] Updated weights for policy 1, policy_version 1382634 (0.0008) [2023-12-28 05:10:23,992][106225] Updated weights for policy 1, policy_version 1382644 (0.0005) [2023-12-28 05:10:24,103][106226] Updated weights for policy 0, policy_version 1379347 (0.0008) [2023-12-28 05:10:24,164][106226] Updated weights for policy 0, policy_version 1379357 (0.0006) [2023-12-28 05:10:24,224][106226] Updated weights for policy 0, policy_version 1379367 (0.0006) [2023-12-28 05:10:24,675][106225] Updated weights for policy 1, policy_version 1382654 (0.0007) [2023-12-28 05:10:24,723][106225] Updated weights for policy 1, policy_version 1382664 (0.0006) [2023-12-28 05:10:24,771][106225] Updated weights for policy 1, policy_version 1382674 (0.0008) [2023-12-28 05:10:24,786][106226] Updated weights for policy 0, policy_version 1379377 (0.0006) [2023-12-28 05:10:24,838][106226] Updated weights for policy 0, policy_version 1379387 (0.0008) [2023-12-28 05:10:24,898][106226] Updated weights for policy 0, policy_version 1379397 (0.0009) [2023-12-28 05:10:24,952][106226] Updated weights for policy 0, policy_version 1379407 (0.0009) [2023-12-28 05:10:25,532][106225] Updated weights for policy 1, policy_version 1382684 (0.0008) [2023-12-28 05:10:25,592][106225] Updated weights for policy 1, policy_version 1382694 (0.0008) [2023-12-28 05:10:25,607][106226] Updated weights for policy 0, policy_version 1379417 (0.0006) [2023-12-28 05:10:25,654][106225] Updated weights for policy 1, policy_version 1382704 (0.0008) [2023-12-28 05:10:25,661][106226] Updated weights for policy 0, policy_version 1379427 (0.0006) [2023-12-28 05:10:25,732][106226] Updated weights for policy 0, policy_version 1379437 (0.0006) [2023-12-28 05:10:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 707231744. Throughput: 0: 9686.5, 1: 9768.2. Samples: 707200816. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:26,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.969')] [2023-12-28 05:10:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001382712_354025472.pth... [2023-12-28 05:10:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001379440_353206272.pth... [2023-12-28 05:10:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001381560_353730560.pth [2023-12-28 05:10:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001378320_352919552.pth [2023-12-28 05:10:26,321][106226] Updated weights for policy 0, policy_version 1379447 (0.0006) [2023-12-28 05:10:26,351][106225] Updated weights for policy 1, policy_version 1382715 (0.0007) [2023-12-28 05:10:26,369][106226] Updated weights for policy 0, policy_version 1379457 (0.0005) [2023-12-28 05:10:26,406][106225] Updated weights for policy 1, policy_version 1382725 (0.0006) [2023-12-28 05:10:26,429][106226] Updated weights for policy 0, policy_version 1379467 (0.0006) [2023-12-28 05:10:26,462][106225] Updated weights for policy 1, policy_version 1382735 (0.0010) [2023-12-28 05:10:27,018][106226] Updated weights for policy 0, policy_version 1379477 (0.0007) [2023-12-28 05:10:27,071][106226] Updated weights for policy 0, policy_version 1379487 (0.0006) [2023-12-28 05:10:27,139][106226] Updated weights for policy 0, policy_version 1379497 (0.0006) [2023-12-28 05:10:27,151][106225] Updated weights for policy 1, policy_version 1382745 (0.0010) [2023-12-28 05:10:27,217][106225] Updated weights for policy 1, policy_version 1382755 (0.0006) [2023-12-28 05:10:27,274][106225] Updated weights for policy 1, policy_version 1382765 (0.0005) [2023-12-28 05:10:27,331][106225] Updated weights for policy 1, policy_version 1382775 (0.0006) [2023-12-28 05:10:27,739][106226] Updated weights for policy 0, policy_version 1379507 (0.0005) [2023-12-28 05:10:27,797][106226] Updated weights for policy 0, policy_version 1379517 (0.0006) [2023-12-28 05:10:27,848][106226] Updated weights for policy 0, policy_version 1379527 (0.0007) [2023-12-28 05:10:27,926][106225] Updated weights for policy 1, policy_version 1382785 (0.0008) [2023-12-28 05:10:27,984][106225] Updated weights for policy 1, policy_version 1382795 (0.0008) [2023-12-28 05:10:28,040][106225] Updated weights for policy 1, policy_version 1382805 (0.0008) [2023-12-28 05:10:28,434][106226] Updated weights for policy 0, policy_version 1379537 (0.0005) [2023-12-28 05:10:28,488][106226] Updated weights for policy 0, policy_version 1379547 (0.0006) [2023-12-28 05:10:28,554][106226] Updated weights for policy 0, policy_version 1379557 (0.0007) [2023-12-28 05:10:28,625][106226] Updated weights for policy 0, policy_version 1379567 (0.0009) [2023-12-28 05:10:28,734][106225] Updated weights for policy 1, policy_version 1382815 (0.0007) [2023-12-28 05:10:28,782][106225] Updated weights for policy 1, policy_version 1382825 (0.0007) [2023-12-28 05:10:28,834][106225] Updated weights for policy 1, policy_version 1382835 (0.0005) [2023-12-28 05:10:29,318][106226] Updated weights for policy 0, policy_version 1379577 (0.0011) [2023-12-28 05:10:29,389][106226] Updated weights for policy 0, policy_version 1379587 (0.0010) [2023-12-28 05:10:29,415][106225] Updated weights for policy 1, policy_version 1382845 (0.0005) [2023-12-28 05:10:29,449][106226] Updated weights for policy 0, policy_version 1379597 (0.0009) [2023-12-28 05:10:29,472][106225] Updated weights for policy 1, policy_version 1382855 (0.0005) [2023-12-28 05:10:29,529][106225] Updated weights for policy 1, policy_version 1382865 (0.0005) [2023-12-28 05:10:30,159][106226] Updated weights for policy 0, policy_version 1379607 (0.0011) [2023-12-28 05:10:30,190][106225] Updated weights for policy 1, policy_version 1382875 (0.0007) [2023-12-28 05:10:30,220][106226] Updated weights for policy 0, policy_version 1379617 (0.0010) [2023-12-28 05:10:30,251][106225] Updated weights for policy 1, policy_version 1382885 (0.0010) [2023-12-28 05:10:30,275][106226] Updated weights for policy 0, policy_version 1379627 (0.0008) [2023-12-28 05:10:30,312][106225] Updated weights for policy 1, policy_version 1382895 (0.0010) [2023-12-28 05:10:30,914][106225] Updated weights for policy 1, policy_version 1382905 (0.0010) [2023-12-28 05:10:30,966][106226] Updated weights for policy 0, policy_version 1379637 (0.0007) [2023-12-28 05:10:30,968][106225] Updated weights for policy 1, policy_version 1382915 (0.0007) [2023-12-28 05:10:31,014][106226] Updated weights for policy 0, policy_version 1379647 (0.0005) [2023-12-28 05:10:31,022][106225] Updated weights for policy 1, policy_version 1382925 (0.0007) [2023-12-28 05:10:31,078][106226] Updated weights for policy 0, policy_version 1379657 (0.0008) [2023-12-28 05:10:31,086][106225] Updated weights for policy 1, policy_version 1382935 (0.0007) [2023-12-28 05:10:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 707346432. Throughput: 0: 9785.0, 1: 9868.5. Samples: 707327988. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:31,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.834')] [2023-12-28 05:10:31,815][106226] Updated weights for policy 0, policy_version 1379667 (0.0008) [2023-12-28 05:10:31,828][106225] Updated weights for policy 1, policy_version 1382945 (0.0010) [2023-12-28 05:10:31,872][106226] Updated weights for policy 0, policy_version 1379677 (0.0010) [2023-12-28 05:10:31,885][106225] Updated weights for policy 1, policy_version 1382955 (0.0010) [2023-12-28 05:10:31,932][106226] Updated weights for policy 0, policy_version 1379687 (0.0009) [2023-12-28 05:10:31,946][106225] Updated weights for policy 1, policy_version 1382965 (0.0010) [2023-12-28 05:10:32,627][106225] Updated weights for policy 1, policy_version 1382975 (0.0010) [2023-12-28 05:10:32,630][106226] Updated weights for policy 0, policy_version 1379697 (0.0010) [2023-12-28 05:10:32,686][106225] Updated weights for policy 1, policy_version 1382985 (0.0009) [2023-12-28 05:10:32,689][106226] Updated weights for policy 0, policy_version 1379707 (0.0006) [2023-12-28 05:10:32,743][106225] Updated weights for policy 1, policy_version 1382995 (0.0007) [2023-12-28 05:10:32,753][106226] Updated weights for policy 0, policy_version 1379717 (0.0006) [2023-12-28 05:10:32,819][106226] Updated weights for policy 0, policy_version 1379727 (0.0006) [2023-12-28 05:10:33,441][106226] Updated weights for policy 0, policy_version 1379737 (0.0008) [2023-12-28 05:10:33,455][106225] Updated weights for policy 1, policy_version 1383005 (0.0009) [2023-12-28 05:10:33,503][106226] Updated weights for policy 0, policy_version 1379747 (0.0006) [2023-12-28 05:10:33,512][106225] Updated weights for policy 1, policy_version 1383015 (0.0010) [2023-12-28 05:10:33,555][106225] Updated weights for policy 1, policy_version 1383025 (0.0010) [2023-12-28 05:10:33,566][106226] Updated weights for policy 0, policy_version 1379757 (0.0007) [2023-12-28 05:10:34,195][106226] Updated weights for policy 0, policy_version 1379767 (0.0008) [2023-12-28 05:10:34,222][106225] Updated weights for policy 1, policy_version 1383035 (0.0009) [2023-12-28 05:10:34,254][106226] Updated weights for policy 0, policy_version 1379777 (0.0007) [2023-12-28 05:10:34,282][106225] Updated weights for policy 1, policy_version 1383045 (0.0008) [2023-12-28 05:10:34,316][106226] Updated weights for policy 0, policy_version 1379787 (0.0006) [2023-12-28 05:10:34,342][106225] Updated weights for policy 1, policy_version 1383055 (0.0007) [2023-12-28 05:10:34,995][106225] Updated weights for policy 1, policy_version 1383065 (0.0008) [2023-12-28 05:10:35,068][106225] Updated weights for policy 1, policy_version 1383075 (0.0008) [2023-12-28 05:10:35,089][106226] Updated weights for policy 0, policy_version 1379797 (0.0006) [2023-12-28 05:10:35,132][106225] Updated weights for policy 1, policy_version 1383085 (0.0006) [2023-12-28 05:10:35,150][106226] Updated weights for policy 0, policy_version 1379807 (0.0005) [2023-12-28 05:10:35,199][106225] Updated weights for policy 1, policy_version 1383095 (0.0006) [2023-12-28 05:10:35,205][106226] Updated weights for policy 0, policy_version 1379817 (0.0006) [2023-12-28 05:10:35,836][106225] Updated weights for policy 1, policy_version 1383105 (0.0010) [2023-12-28 05:10:35,843][106226] Updated weights for policy 0, policy_version 1379827 (0.0006) [2023-12-28 05:10:35,889][106225] Updated weights for policy 1, policy_version 1383115 (0.0010) [2023-12-28 05:10:35,891][106226] Updated weights for policy 0, policy_version 1379837 (0.0006) [2023-12-28 05:10:35,945][106226] Updated weights for policy 0, policy_version 1379847 (0.0005) [2023-12-28 05:10:35,946][106225] Updated weights for policy 1, policy_version 1383125 (0.0010) [2023-12-28 05:10:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 707444736. Throughput: 0: 9785.1, 1: 9936.5. Samples: 707449464. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:36,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.605')] [2023-12-28 05:10:36,675][106225] Updated weights for policy 1, policy_version 1383135 (0.0010) [2023-12-28 05:10:36,735][106226] Updated weights for policy 0, policy_version 1379857 (0.0007) [2023-12-28 05:10:36,738][106225] Updated weights for policy 1, policy_version 1383145 (0.0009) [2023-12-28 05:10:36,791][106225] Updated weights for policy 1, policy_version 1383155 (0.0010) [2023-12-28 05:10:36,797][106226] Updated weights for policy 0, policy_version 1379867 (0.0011) [2023-12-28 05:10:36,850][106226] Updated weights for policy 0, policy_version 1379877 (0.0008) [2023-12-28 05:10:36,904][106226] Updated weights for policy 0, policy_version 1379888 (0.0007) [2023-12-28 05:10:37,490][106225] Updated weights for policy 1, policy_version 1383165 (0.0009) [2023-12-28 05:10:37,550][106225] Updated weights for policy 1, policy_version 1383175 (0.0010) [2023-12-28 05:10:37,577][106226] Updated weights for policy 0, policy_version 1379898 (0.0010) [2023-12-28 05:10:37,607][106225] Updated weights for policy 1, policy_version 1383185 (0.0010) [2023-12-28 05:10:37,633][106226] Updated weights for policy 0, policy_version 1379908 (0.0008) [2023-12-28 05:10:37,692][106226] Updated weights for policy 0, policy_version 1379918 (0.0007) [2023-12-28 05:10:38,305][106225] Updated weights for policy 1, policy_version 1383195 (0.0010) [2023-12-28 05:10:38,370][106226] Updated weights for policy 0, policy_version 1379928 (0.0009) [2023-12-28 05:10:38,377][106225] Updated weights for policy 1, policy_version 1383205 (0.0007) [2023-12-28 05:10:38,432][106226] Updated weights for policy 0, policy_version 1379938 (0.0011) [2023-12-28 05:10:38,438][106225] Updated weights for policy 1, policy_version 1383215 (0.0006) [2023-12-28 05:10:38,500][106226] Updated weights for policy 0, policy_version 1379948 (0.0008) [2023-12-28 05:10:39,002][106225] Updated weights for policy 1, policy_version 1383225 (0.0008) [2023-12-28 05:10:39,059][106225] Updated weights for policy 1, policy_version 1383235 (0.0008) [2023-12-28 05:10:39,112][106225] Updated weights for policy 1, policy_version 1383245 (0.0007) [2023-12-28 05:10:39,164][106225] Updated weights for policy 1, policy_version 1383255 (0.0007) [2023-12-28 05:10:39,220][106226] Updated weights for policy 0, policy_version 1379958 (0.0010) [2023-12-28 05:10:39,291][106226] Updated weights for policy 0, policy_version 1379968 (0.0010) [2023-12-28 05:10:39,359][106226] Updated weights for policy 0, policy_version 1379978 (0.0007) [2023-12-28 05:10:39,886][106225] Updated weights for policy 1, policy_version 1383265 (0.0008) [2023-12-28 05:10:39,950][106225] Updated weights for policy 1, policy_version 1383275 (0.0008) [2023-12-28 05:10:40,001][106225] Updated weights for policy 1, policy_version 1383285 (0.0008) [2023-12-28 05:10:40,136][106226] Updated weights for policy 0, policy_version 1379988 (0.0010) [2023-12-28 05:10:40,197][106226] Updated weights for policy 0, policy_version 1379998 (0.0011) [2023-12-28 05:10:40,259][106226] Updated weights for policy 0, policy_version 1380008 (0.0009) [2023-12-28 05:10:40,723][106225] Updated weights for policy 1, policy_version 1383295 (0.0008) [2023-12-28 05:10:40,776][106225] Updated weights for policy 1, policy_version 1383305 (0.0007) [2023-12-28 05:10:40,823][106225] Updated weights for policy 1, policy_version 1383315 (0.0007) [2023-12-28 05:10:40,952][106226] Updated weights for policy 0, policy_version 1380018 (0.0009) [2023-12-28 05:10:41,006][106226] Updated weights for policy 0, policy_version 1380028 (0.0010) [2023-12-28 05:10:41,075][106226] Updated weights for policy 0, policy_version 1380038 (0.0009) [2023-12-28 05:10:41,144][106226] Updated weights for policy 0, policy_version 1380048 (0.0008) [2023-12-28 05:10:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 707543040. Throughput: 0: 9807.9, 1: 9959.0. Samples: 707508780. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:41,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.416')] [2023-12-28 05:10:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001380048_353361920.pth... [2023-12-28 05:10:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001383320_354181120.pth... [2023-12-28 05:10:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001378896_353067008.pth [2023-12-28 05:10:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001382168_353886208.pth [2023-12-28 05:10:41,656][106225] Updated weights for policy 1, policy_version 1383325 (0.0007) [2023-12-28 05:10:41,714][106225] Updated weights for policy 1, policy_version 1383335 (0.0008) [2023-12-28 05:10:41,781][106225] Updated weights for policy 1, policy_version 1383345 (0.0006) [2023-12-28 05:10:41,973][106226] Updated weights for policy 0, policy_version 1380058 (0.0008) [2023-12-28 05:10:42,043][106226] Updated weights for policy 0, policy_version 1380068 (0.0006) [2023-12-28 05:10:42,105][106226] Updated weights for policy 0, policy_version 1380078 (0.0006) [2023-12-28 05:10:42,474][106225] Updated weights for policy 1, policy_version 1383355 (0.0006) [2023-12-28 05:10:42,534][106225] Updated weights for policy 1, policy_version 1383365 (0.0009) [2023-12-28 05:10:42,582][106225] Updated weights for policy 1, policy_version 1383375 (0.0008) [2023-12-28 05:10:42,748][106226] Updated weights for policy 0, policy_version 1380088 (0.0010) [2023-12-28 05:10:42,812][106226] Updated weights for policy 0, policy_version 1380098 (0.0010) [2023-12-28 05:10:42,867][106226] Updated weights for policy 0, policy_version 1380108 (0.0011) [2023-12-28 05:10:43,240][106225] Updated weights for policy 1, policy_version 1383385 (0.0006) [2023-12-28 05:10:43,307][106225] Updated weights for policy 1, policy_version 1383395 (0.0005) [2023-12-28 05:10:43,365][106225] Updated weights for policy 1, policy_version 1383405 (0.0008) [2023-12-28 05:10:43,412][106225] Updated weights for policy 1, policy_version 1383415 (0.0007) [2023-12-28 05:10:43,603][106226] Updated weights for policy 0, policy_version 1380118 (0.0009) [2023-12-28 05:10:43,669][106226] Updated weights for policy 0, policy_version 1380128 (0.0009) [2023-12-28 05:10:43,737][106226] Updated weights for policy 0, policy_version 1380138 (0.0008) [2023-12-28 05:10:44,026][106225] Updated weights for policy 1, policy_version 1383425 (0.0005) [2023-12-28 05:10:44,076][106225] Updated weights for policy 1, policy_version 1383435 (0.0006) [2023-12-28 05:10:44,136][106225] Updated weights for policy 1, policy_version 1383445 (0.0008) [2023-12-28 05:10:44,506][106226] Updated weights for policy 0, policy_version 1380148 (0.0009) [2023-12-28 05:10:44,568][106226] Updated weights for policy 0, policy_version 1380158 (0.0009) [2023-12-28 05:10:44,630][106226] Updated weights for policy 0, policy_version 1380168 (0.0009) [2023-12-28 05:10:44,716][106225] Updated weights for policy 1, policy_version 1383455 (0.0008) [2023-12-28 05:10:44,764][106225] Updated weights for policy 1, policy_version 1383465 (0.0008) [2023-12-28 05:10:44,832][106225] Updated weights for policy 1, policy_version 1383475 (0.0008) [2023-12-28 05:10:45,343][106226] Updated weights for policy 0, policy_version 1380178 (0.0008) [2023-12-28 05:10:45,413][106226] Updated weights for policy 0, policy_version 1380188 (0.0008) [2023-12-28 05:10:45,469][106226] Updated weights for policy 0, policy_version 1380198 (0.0008) [2023-12-28 05:10:45,517][106226] Updated weights for policy 0, policy_version 1380208 (0.0007) [2023-12-28 05:10:45,616][106225] Updated weights for policy 1, policy_version 1383485 (0.0009) [2023-12-28 05:10:45,672][106225] Updated weights for policy 1, policy_version 1383495 (0.0010) [2023-12-28 05:10:45,731][106225] Updated weights for policy 1, policy_version 1383505 (0.0008) [2023-12-28 05:10:46,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 707633152. Throughput: 0: 9794.6, 1: 10007.6. Samples: 707626248. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:46,176][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.456')] [2023-12-28 05:10:46,241][106226] Updated weights for policy 0, policy_version 1380218 (0.0008) [2023-12-28 05:10:46,286][106226] Updated weights for policy 0, policy_version 1380228 (0.0008) [2023-12-28 05:10:46,332][106226] Updated weights for policy 0, policy_version 1380238 (0.0008) [2023-12-28 05:10:46,437][106225] Updated weights for policy 1, policy_version 1383515 (0.0009) [2023-12-28 05:10:46,491][106225] Updated weights for policy 1, policy_version 1383525 (0.0010) [2023-12-28 05:10:46,554][106225] Updated weights for policy 1, policy_version 1383535 (0.0010) [2023-12-28 05:10:46,986][106226] Updated weights for policy 0, policy_version 1380248 (0.0008) [2023-12-28 05:10:47,052][106226] Updated weights for policy 0, policy_version 1380258 (0.0005) [2023-12-28 05:10:47,117][106226] Updated weights for policy 0, policy_version 1380268 (0.0006) [2023-12-28 05:10:47,173][106225] Updated weights for policy 1, policy_version 1383545 (0.0010) [2023-12-28 05:10:47,233][106225] Updated weights for policy 1, policy_version 1383555 (0.0010) [2023-12-28 05:10:47,285][106225] Updated weights for policy 1, policy_version 1383565 (0.0010) [2023-12-28 05:10:47,335][106225] Updated weights for policy 1, policy_version 1383575 (0.0006) [2023-12-28 05:10:47,785][106226] Updated weights for policy 0, policy_version 1380278 (0.0009) [2023-12-28 05:10:47,839][106226] Updated weights for policy 0, policy_version 1380288 (0.0009) [2023-12-28 05:10:47,901][106226] Updated weights for policy 0, policy_version 1380298 (0.0009) [2023-12-28 05:10:47,991][106225] Updated weights for policy 1, policy_version 1383585 (0.0006) [2023-12-28 05:10:48,054][106225] Updated weights for policy 1, policy_version 1383595 (0.0006) [2023-12-28 05:10:48,102][106225] Updated weights for policy 1, policy_version 1383605 (0.0005) [2023-12-28 05:10:48,608][106226] Updated weights for policy 0, policy_version 1380308 (0.0009) [2023-12-28 05:10:48,666][106226] Updated weights for policy 0, policy_version 1380318 (0.0009) [2023-12-28 05:10:48,721][106226] Updated weights for policy 0, policy_version 1380328 (0.0008) [2023-12-28 05:10:48,817][106225] Updated weights for policy 1, policy_version 1383615 (0.0009) [2023-12-28 05:10:48,868][106225] Updated weights for policy 1, policy_version 1383625 (0.0010) [2023-12-28 05:10:48,926][106225] Updated weights for policy 1, policy_version 1383635 (0.0010) [2023-12-28 05:10:49,442][106226] Updated weights for policy 0, policy_version 1380338 (0.0008) [2023-12-28 05:10:49,503][106226] Updated weights for policy 0, policy_version 1380348 (0.0008) [2023-12-28 05:10:49,568][106226] Updated weights for policy 0, policy_version 1380358 (0.0008) [2023-12-28 05:10:49,631][106226] Updated weights for policy 0, policy_version 1380368 (0.0006) [2023-12-28 05:10:49,687][106225] Updated weights for policy 1, policy_version 1383645 (0.0008) [2023-12-28 05:10:49,751][106225] Updated weights for policy 1, policy_version 1383655 (0.0010) [2023-12-28 05:10:49,821][106225] Updated weights for policy 1, policy_version 1383665 (0.0010) [2023-12-28 05:10:50,303][106226] Updated weights for policy 0, policy_version 1380378 (0.0011) [2023-12-28 05:10:50,366][106226] Updated weights for policy 0, policy_version 1380388 (0.0011) [2023-12-28 05:10:50,422][106226] Updated weights for policy 0, policy_version 1380398 (0.0011) [2023-12-28 05:10:50,524][106225] Updated weights for policy 1, policy_version 1383675 (0.0010) [2023-12-28 05:10:50,590][106225] Updated weights for policy 1, policy_version 1383685 (0.0007) [2023-12-28 05:10:50,645][106225] Updated weights for policy 1, policy_version 1383695 (0.0008) [2023-12-28 05:10:51,173][106226] Updated weights for policy 0, policy_version 1380408 (0.0008) [2023-12-28 05:10:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 707731456. Throughput: 0: 9860.5, 1: 9961.9. Samples: 707745116. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:51,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.727')] [2023-12-28 05:10:51,238][106226] Updated weights for policy 0, policy_version 1380418 (0.0008) [2023-12-28 05:10:51,301][106226] Updated weights for policy 0, policy_version 1380428 (0.0008) [2023-12-28 05:10:51,351][106225] Updated weights for policy 1, policy_version 1383705 (0.0009) [2023-12-28 05:10:51,420][106225] Updated weights for policy 1, policy_version 1383715 (0.0011) [2023-12-28 05:10:51,478][106225] Updated weights for policy 1, policy_version 1383725 (0.0010) [2023-12-28 05:10:51,542][106225] Updated weights for policy 1, policy_version 1383735 (0.0010) [2023-12-28 05:10:52,069][106226] Updated weights for policy 0, policy_version 1380438 (0.0009) [2023-12-28 05:10:52,118][106226] Updated weights for policy 0, policy_version 1380448 (0.0010) [2023-12-28 05:10:52,172][106226] Updated weights for policy 0, policy_version 1380458 (0.0008) [2023-12-28 05:10:52,272][106225] Updated weights for policy 1, policy_version 1383745 (0.0010) [2023-12-28 05:10:52,331][106225] Updated weights for policy 1, policy_version 1383755 (0.0010) [2023-12-28 05:10:52,396][106225] Updated weights for policy 1, policy_version 1383765 (0.0010) [2023-12-28 05:10:52,945][106226] Updated weights for policy 0, policy_version 1380468 (0.0008) [2023-12-28 05:10:53,009][106226] Updated weights for policy 0, policy_version 1380478 (0.0008) [2023-12-28 05:10:53,068][106226] Updated weights for policy 0, policy_version 1380488 (0.0008) [2023-12-28 05:10:53,095][106225] Updated weights for policy 1, policy_version 1383775 (0.0007) [2023-12-28 05:10:53,160][106225] Updated weights for policy 1, policy_version 1383785 (0.0010) [2023-12-28 05:10:53,205][106225] Updated weights for policy 1, policy_version 1383795 (0.0010) [2023-12-28 05:10:53,795][106226] Updated weights for policy 0, policy_version 1380498 (0.0008) [2023-12-28 05:10:53,858][106226] Updated weights for policy 0, policy_version 1380508 (0.0009) [2023-12-28 05:10:53,921][106226] Updated weights for policy 0, policy_version 1380518 (0.0007) [2023-12-28 05:10:53,939][106225] Updated weights for policy 1, policy_version 1383805 (0.0010) [2023-12-28 05:10:53,975][106226] Updated weights for policy 0, policy_version 1380528 (0.0006) [2023-12-28 05:10:54,005][106225] Updated weights for policy 1, policy_version 1383815 (0.0010) [2023-12-28 05:10:54,070][106225] Updated weights for policy 1, policy_version 1383825 (0.0009) [2023-12-28 05:10:54,584][106226] Updated weights for policy 0, policy_version 1380538 (0.0007) [2023-12-28 05:10:54,638][106226] Updated weights for policy 0, policy_version 1380548 (0.0005) [2023-12-28 05:10:54,683][106226] Updated weights for policy 0, policy_version 1380558 (0.0005) [2023-12-28 05:10:54,742][106225] Updated weights for policy 1, policy_version 1383835 (0.0010) [2023-12-28 05:10:54,795][106225] Updated weights for policy 1, policy_version 1383845 (0.0010) [2023-12-28 05:10:54,853][106225] Updated weights for policy 1, policy_version 1383855 (0.0009) [2023-12-28 05:10:55,434][106226] Updated weights for policy 0, policy_version 1380568 (0.0008) [2023-12-28 05:10:55,477][106225] Updated weights for policy 1, policy_version 1383865 (0.0008) [2023-12-28 05:10:55,494][106226] Updated weights for policy 0, policy_version 1380578 (0.0008) [2023-12-28 05:10:55,534][106225] Updated weights for policy 1, policy_version 1383875 (0.0010) [2023-12-28 05:10:55,544][106226] Updated weights for policy 0, policy_version 1380588 (0.0005) [2023-12-28 05:10:55,591][106225] Updated weights for policy 1, policy_version 1383885 (0.0010) [2023-12-28 05:10:55,660][106225] Updated weights for policy 1, policy_version 1383895 (0.0007) [2023-12-28 05:10:56,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 707829760. Throughput: 0: 9808.0, 1: 9949.2. Samples: 707802328. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:10:56,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.751')] [2023-12-28 05:10:56,211][106226] Updated weights for policy 0, policy_version 1380598 (0.0006) [2023-12-28 05:10:56,211][106225] Updated weights for policy 1, policy_version 1383905 (0.0007) [2023-12-28 05:10:56,267][106226] Updated weights for policy 0, policy_version 1380608 (0.0008) [2023-12-28 05:10:56,268][106225] Updated weights for policy 1, policy_version 1383915 (0.0008) [2023-12-28 05:10:56,318][106225] Updated weights for policy 1, policy_version 1383925 (0.0007) [2023-12-28 05:10:56,324][106226] Updated weights for policy 0, policy_version 1380618 (0.0006) [2023-12-28 05:10:56,331][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001383928_354336768.pth... [2023-12-28 05:10:56,334][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001382712_354025472.pth [2023-12-28 05:10:56,357][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001380624_353509376.pth... [2023-12-28 05:10:56,361][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001379440_353206272.pth [2023-12-28 05:10:56,974][106225] Updated weights for policy 1, policy_version 1383935 (0.0006) [2023-12-28 05:10:57,036][106225] Updated weights for policy 1, policy_version 1383945 (0.0005) [2023-12-28 05:10:57,061][106226] Updated weights for policy 0, policy_version 1380628 (0.0007) [2023-12-28 05:10:57,096][106225] Updated weights for policy 1, policy_version 1383955 (0.0005) [2023-12-28 05:10:57,110][106226] Updated weights for policy 0, policy_version 1380638 (0.0008) [2023-12-28 05:10:57,155][106226] Updated weights for policy 0, policy_version 1380648 (0.0006) [2023-12-28 05:10:57,677][106225] Updated weights for policy 1, policy_version 1383965 (0.0009) [2023-12-28 05:10:57,729][106225] Updated weights for policy 1, policy_version 1383975 (0.0010) [2023-12-28 05:10:57,792][106225] Updated weights for policy 1, policy_version 1383985 (0.0010) [2023-12-28 05:10:57,857][106226] Updated weights for policy 0, policy_version 1380658 (0.0007) [2023-12-28 05:10:57,913][106226] Updated weights for policy 0, policy_version 1380668 (0.0008) [2023-12-28 05:10:57,967][106226] Updated weights for policy 0, policy_version 1380678 (0.0008) [2023-12-28 05:10:58,022][106226] Updated weights for policy 0, policy_version 1380688 (0.0007) [2023-12-28 05:10:58,539][106225] Updated weights for policy 1, policy_version 1383995 (0.0010) [2023-12-28 05:10:58,606][106225] Updated weights for policy 1, policy_version 1384005 (0.0008) [2023-12-28 05:10:58,667][106225] Updated weights for policy 1, policy_version 1384015 (0.0009) [2023-12-28 05:10:58,884][106226] Updated weights for policy 0, policy_version 1380698 (0.0007) [2023-12-28 05:10:58,959][106226] Updated weights for policy 0, policy_version 1380708 (0.0008) [2023-12-28 05:10:59,023][106226] Updated weights for policy 0, policy_version 1380718 (0.0008) [2023-12-28 05:10:59,492][106225] Updated weights for policy 1, policy_version 1384025 (0.0007) [2023-12-28 05:10:59,554][106225] Updated weights for policy 1, policy_version 1384035 (0.0009) [2023-12-28 05:10:59,603][106225] Updated weights for policy 1, policy_version 1384045 (0.0008) [2023-12-28 05:10:59,656][106225] Updated weights for policy 1, policy_version 1384055 (0.0008) [2023-12-28 05:10:59,777][106226] Updated weights for policy 0, policy_version 1380728 (0.0006) [2023-12-28 05:10:59,845][106226] Updated weights for policy 0, policy_version 1380738 (0.0006) [2023-12-28 05:10:59,911][106226] Updated weights for policy 0, policy_version 1380748 (0.0007) [2023-12-28 05:11:00,434][106225] Updated weights for policy 1, policy_version 1384065 (0.0007) [2023-12-28 05:11:00,466][106226] Updated weights for policy 0, policy_version 1380758 (0.0008) [2023-12-28 05:11:00,482][106225] Updated weights for policy 1, policy_version 1384075 (0.0010) [2023-12-28 05:11:00,526][106226] Updated weights for policy 0, policy_version 1380768 (0.0007) [2023-12-28 05:11:00,533][106225] Updated weights for policy 1, policy_version 1384085 (0.0010) [2023-12-28 05:11:00,587][106226] Updated weights for policy 0, policy_version 1380778 (0.0008) [2023-12-28 05:11:01,103][106225] Updated weights for policy 1, policy_version 1384095 (0.0009) [2023-12-28 05:11:01,169][106225] Updated weights for policy 1, policy_version 1384105 (0.0010) [2023-12-28 05:11:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 707928064. Throughput: 0: 9810.0, 1: 10023.8. Samples: 707920296. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:01,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.635')] [2023-12-28 05:11:01,230][106225] Updated weights for policy 1, policy_version 1384115 (0.0010) [2023-12-28 05:11:01,314][106226] Updated weights for policy 0, policy_version 1380788 (0.0010) [2023-12-28 05:11:01,378][106226] Updated weights for policy 0, policy_version 1380798 (0.0013) [2023-12-28 05:11:01,436][106226] Updated weights for policy 0, policy_version 1380808 (0.0010) [2023-12-28 05:11:01,933][106225] Updated weights for policy 1, policy_version 1384125 (0.0009) [2023-12-28 05:11:01,997][106225] Updated weights for policy 1, policy_version 1384135 (0.0010) [2023-12-28 05:11:02,063][106225] Updated weights for policy 1, policy_version 1384145 (0.0008) [2023-12-28 05:11:02,181][106226] Updated weights for policy 0, policy_version 1380818 (0.0010) [2023-12-28 05:11:02,239][106226] Updated weights for policy 0, policy_version 1380828 (0.0007) [2023-12-28 05:11:02,305][106226] Updated weights for policy 0, policy_version 1380838 (0.0008) [2023-12-28 05:11:02,372][106226] Updated weights for policy 0, policy_version 1380848 (0.0008) [2023-12-28 05:11:02,749][106225] Updated weights for policy 1, policy_version 1384155 (0.0010) [2023-12-28 05:11:02,810][106225] Updated weights for policy 1, policy_version 1384165 (0.0010) [2023-12-28 05:11:02,863][106225] Updated weights for policy 1, policy_version 1384175 (0.0010) [2023-12-28 05:11:03,052][106226] Updated weights for policy 0, policy_version 1380858 (0.0009) [2023-12-28 05:11:03,105][106226] Updated weights for policy 0, policy_version 1380868 (0.0010) [2023-12-28 05:11:03,158][106226] Updated weights for policy 0, policy_version 1380878 (0.0010) [2023-12-28 05:11:03,435][106225] Updated weights for policy 1, policy_version 1384185 (0.0007) [2023-12-28 05:11:03,488][106225] Updated weights for policy 1, policy_version 1384195 (0.0010) [2023-12-28 05:11:03,541][106225] Updated weights for policy 1, policy_version 1384205 (0.0008) [2023-12-28 05:11:03,591][106225] Updated weights for policy 1, policy_version 1384215 (0.0005) [2023-12-28 05:11:03,801][106226] Updated weights for policy 0, policy_version 1380888 (0.0011) [2023-12-28 05:11:03,861][106226] Updated weights for policy 0, policy_version 1380898 (0.0009) [2023-12-28 05:11:03,919][106226] Updated weights for policy 0, policy_version 1380908 (0.0007) [2023-12-28 05:11:04,262][106225] Updated weights for policy 1, policy_version 1384225 (0.0009) [2023-12-28 05:11:04,325][106225] Updated weights for policy 1, policy_version 1384235 (0.0008) [2023-12-28 05:11:04,377][106225] Updated weights for policy 1, policy_version 1384245 (0.0008) [2023-12-28 05:11:04,668][106226] Updated weights for policy 0, policy_version 1380918 (0.0007) [2023-12-28 05:11:04,726][106226] Updated weights for policy 0, policy_version 1380928 (0.0006) [2023-12-28 05:11:04,788][106226] Updated weights for policy 0, policy_version 1380938 (0.0006) [2023-12-28 05:11:05,153][106225] Updated weights for policy 1, policy_version 1384255 (0.0008) [2023-12-28 05:11:05,196][106225] Updated weights for policy 1, policy_version 1384265 (0.0008) [2023-12-28 05:11:05,246][106225] Updated weights for policy 1, policy_version 1384275 (0.0007) [2023-12-28 05:11:05,346][106226] Updated weights for policy 0, policy_version 1380948 (0.0007) [2023-12-28 05:11:05,413][106226] Updated weights for policy 0, policy_version 1380958 (0.0006) [2023-12-28 05:11:05,477][106226] Updated weights for policy 0, policy_version 1380968 (0.0008) [2023-12-28 05:11:06,030][106226] Updated weights for policy 0, policy_version 1380978 (0.0009) [2023-12-28 05:11:06,059][106225] Updated weights for policy 1, policy_version 1384285 (0.0009) [2023-12-28 05:11:06,099][106226] Updated weights for policy 0, policy_version 1380988 (0.0006) [2023-12-28 05:11:06,115][106225] Updated weights for policy 1, policy_version 1384295 (0.0010) [2023-12-28 05:11:06,162][106226] Updated weights for policy 0, policy_version 1380998 (0.0009) [2023-12-28 05:11:06,171][106225] Updated weights for policy 1, policy_version 1384305 (0.0007) [2023-12-28 05:11:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 708026368. Throughput: 0: 9902.7, 1: 10053.6. Samples: 708043872. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:06,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.287')] [2023-12-28 05:11:06,226][106226] Updated weights for policy 0, policy_version 1381008 (0.0009) [2023-12-28 05:11:06,885][106225] Updated weights for policy 1, policy_version 1384315 (0.0008) [2023-12-28 05:11:06,920][106226] Updated weights for policy 0, policy_version 1381018 (0.0005) [2023-12-28 05:11:06,940][106225] Updated weights for policy 1, policy_version 1384325 (0.0009) [2023-12-28 05:11:06,985][106226] Updated weights for policy 0, policy_version 1381028 (0.0005) [2023-12-28 05:11:06,992][106225] Updated weights for policy 1, policy_version 1384335 (0.0005) [2023-12-28 05:11:07,047][106226] Updated weights for policy 0, policy_version 1381038 (0.0008) [2023-12-28 05:11:07,654][106226] Updated weights for policy 0, policy_version 1381048 (0.0008) [2023-12-28 05:11:07,693][106225] Updated weights for policy 1, policy_version 1384345 (0.0008) [2023-12-28 05:11:07,714][106226] Updated weights for policy 0, policy_version 1381058 (0.0008) [2023-12-28 05:11:07,743][106225] Updated weights for policy 1, policy_version 1384355 (0.0010) [2023-12-28 05:11:07,765][106226] Updated weights for policy 0, policy_version 1381068 (0.0005) [2023-12-28 05:11:07,789][106225] Updated weights for policy 1, policy_version 1384365 (0.0010) [2023-12-28 05:11:07,836][106225] Updated weights for policy 1, policy_version 1384375 (0.0010) [2023-12-28 05:11:08,504][106226] Updated weights for policy 0, policy_version 1381078 (0.0007) [2023-12-28 05:11:08,562][106226] Updated weights for policy 0, policy_version 1381088 (0.0008) [2023-12-28 05:11:08,593][106225] Updated weights for policy 1, policy_version 1384385 (0.0011) [2023-12-28 05:11:08,618][106226] Updated weights for policy 0, policy_version 1381098 (0.0008) [2023-12-28 05:11:08,652][106225] Updated weights for policy 1, policy_version 1384395 (0.0010) [2023-12-28 05:11:08,718][106225] Updated weights for policy 1, policy_version 1384405 (0.0011) [2023-12-28 05:11:09,397][106226] Updated weights for policy 0, policy_version 1381108 (0.0009) [2023-12-28 05:11:09,462][106225] Updated weights for policy 1, policy_version 1384415 (0.0009) [2023-12-28 05:11:09,465][106226] Updated weights for policy 0, policy_version 1381118 (0.0008) [2023-12-28 05:11:09,516][106225] Updated weights for policy 1, policy_version 1384425 (0.0009) [2023-12-28 05:11:09,525][106226] Updated weights for policy 0, policy_version 1381128 (0.0009) [2023-12-28 05:11:09,575][106225] Updated weights for policy 1, policy_version 1384435 (0.0009) [2023-12-28 05:11:10,346][106226] Updated weights for policy 0, policy_version 1381138 (0.0009) [2023-12-28 05:11:10,403][106226] Updated weights for policy 0, policy_version 1381148 (0.0009) [2023-12-28 05:11:10,420][106225] Updated weights for policy 1, policy_version 1384445 (0.0010) [2023-12-28 05:11:10,456][106226] Updated weights for policy 0, policy_version 1381158 (0.0009) [2023-12-28 05:11:10,470][106225] Updated weights for policy 1, policy_version 1384455 (0.0009) [2023-12-28 05:11:10,514][106226] Updated weights for policy 0, policy_version 1381168 (0.0008) [2023-12-28 05:11:10,524][106225] Updated weights for policy 1, policy_version 1384465 (0.0009) [2023-12-28 05:11:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 708124672. Throughput: 0: 9964.4, 1: 10070.7. Samples: 708102400. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:11,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.373')] [2023-12-28 05:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001381168_353648640.pth... [2023-12-28 05:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001384472_354476032.pth... [2023-12-28 05:11:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001380048_353361920.pth [2023-12-28 05:11:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001383320_354181120.pth [2023-12-28 05:11:11,277][106225] Updated weights for policy 1, policy_version 1384475 (0.0010) [2023-12-28 05:11:11,315][106226] Updated weights for policy 0, policy_version 1381178 (0.0008) [2023-12-28 05:11:11,340][106225] Updated weights for policy 1, policy_version 1384485 (0.0008) [2023-12-28 05:11:11,390][106226] Updated weights for policy 0, policy_version 1381188 (0.0010) [2023-12-28 05:11:11,413][106225] Updated weights for policy 1, policy_version 1384495 (0.0008) [2023-12-28 05:11:11,442][106226] Updated weights for policy 0, policy_version 1381198 (0.0007) [2023-12-28 05:11:12,090][106225] Updated weights for policy 1, policy_version 1384505 (0.0007) [2023-12-28 05:11:12,153][106225] Updated weights for policy 1, policy_version 1384515 (0.0006) [2023-12-28 05:11:12,214][106225] Updated weights for policy 1, policy_version 1384525 (0.0010) [2023-12-28 05:11:12,235][106226] Updated weights for policy 0, policy_version 1381208 (0.0008) [2023-12-28 05:11:12,277][106225] Updated weights for policy 1, policy_version 1384535 (0.0011) [2023-12-28 05:11:12,300][106226] Updated weights for policy 0, policy_version 1381218 (0.0006) [2023-12-28 05:11:12,365][106226] Updated weights for policy 0, policy_version 1381228 (0.0008) [2023-12-28 05:11:12,996][106225] Updated weights for policy 1, policy_version 1384545 (0.0007) [2023-12-28 05:11:13,068][106225] Updated weights for policy 1, policy_version 1384555 (0.0007) [2023-12-28 05:11:13,093][106226] Updated weights for policy 0, policy_version 1381238 (0.0006) [2023-12-28 05:11:13,134][106225] Updated weights for policy 1, policy_version 1384565 (0.0006) [2023-12-28 05:11:13,150][106226] Updated weights for policy 0, policy_version 1381248 (0.0007) [2023-12-28 05:11:13,205][106226] Updated weights for policy 0, policy_version 1381258 (0.0006) [2023-12-28 05:11:13,667][106225] Updated weights for policy 1, policy_version 1384575 (0.0009) [2023-12-28 05:11:13,730][106225] Updated weights for policy 1, policy_version 1384585 (0.0010) [2023-12-28 05:11:13,766][106226] Updated weights for policy 0, policy_version 1381268 (0.0006) [2023-12-28 05:11:13,781][106225] Updated weights for policy 1, policy_version 1384595 (0.0009) [2023-12-28 05:11:13,830][106226] Updated weights for policy 0, policy_version 1381278 (0.0008) [2023-12-28 05:11:13,899][106226] Updated weights for policy 0, policy_version 1381288 (0.0010) [2023-12-28 05:11:14,419][106225] Updated weights for policy 1, policy_version 1384605 (0.0006) [2023-12-28 05:11:14,465][106226] Updated weights for policy 0, policy_version 1381298 (0.0009) [2023-12-28 05:11:14,471][106225] Updated weights for policy 1, policy_version 1384615 (0.0007) [2023-12-28 05:11:14,518][106225] Updated weights for policy 1, policy_version 1384625 (0.0010) [2023-12-28 05:11:14,528][106226] Updated weights for policy 0, policy_version 1381308 (0.0008) [2023-12-28 05:11:14,590][106226] Updated weights for policy 0, policy_version 1381318 (0.0010) [2023-12-28 05:11:14,660][106226] Updated weights for policy 0, policy_version 1381328 (0.0010) [2023-12-28 05:11:15,226][106225] Updated weights for policy 1, policy_version 1384635 (0.0010) [2023-12-28 05:11:15,288][106225] Updated weights for policy 1, policy_version 1384645 (0.0010) [2023-12-28 05:11:15,344][106226] Updated weights for policy 0, policy_version 1381338 (0.0007) [2023-12-28 05:11:15,349][106225] Updated weights for policy 1, policy_version 1384655 (0.0010) [2023-12-28 05:11:15,411][106226] Updated weights for policy 0, policy_version 1381348 (0.0006) [2023-12-28 05:11:15,474][106226] Updated weights for policy 0, policy_version 1381358 (0.0006) [2023-12-28 05:11:15,967][106225] Updated weights for policy 1, policy_version 1384665 (0.0010) [2023-12-28 05:11:16,028][106225] Updated weights for policy 1, policy_version 1384675 (0.0005) [2023-12-28 05:11:16,033][106226] Updated weights for policy 0, policy_version 1381368 (0.0010) [2023-12-28 05:11:16,089][106226] Updated weights for policy 0, policy_version 1381378 (0.0009) [2023-12-28 05:11:16,092][106225] Updated weights for policy 1, policy_version 1384685 (0.0009) [2023-12-28 05:11:16,143][106226] Updated weights for policy 0, policy_version 1381388 (0.0011) [2023-12-28 05:11:16,148][106225] Updated weights for policy 1, policy_version 1384695 (0.0009) [2023-12-28 05:11:16,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 708239360. Throughput: 0: 9801.9, 1: 10001.4. Samples: 708219136. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:16,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.545')] [2023-12-28 05:11:16,787][106225] Updated weights for policy 1, policy_version 1384705 (0.0010) [2023-12-28 05:11:16,855][106225] Updated weights for policy 1, policy_version 1384715 (0.0011) [2023-12-28 05:11:16,859][106226] Updated weights for policy 0, policy_version 1381398 (0.0011) [2023-12-28 05:11:16,913][106225] Updated weights for policy 1, policy_version 1384725 (0.0009) [2023-12-28 05:11:16,922][106226] Updated weights for policy 0, policy_version 1381408 (0.0011) [2023-12-28 05:11:16,990][106226] Updated weights for policy 0, policy_version 1381418 (0.0011) [2023-12-28 05:11:17,616][106225] Updated weights for policy 1, policy_version 1384735 (0.0010) [2023-12-28 05:11:17,669][106225] Updated weights for policy 1, policy_version 1384745 (0.0010) [2023-12-28 05:11:17,678][106226] Updated weights for policy 0, policy_version 1381428 (0.0011) [2023-12-28 05:11:17,720][106225] Updated weights for policy 1, policy_version 1384755 (0.0010) [2023-12-28 05:11:17,738][106226] Updated weights for policy 0, policy_version 1381438 (0.0010) [2023-12-28 05:11:17,801][106226] Updated weights for policy 0, policy_version 1381448 (0.0010) [2023-12-28 05:11:18,465][106225] Updated weights for policy 1, policy_version 1384765 (0.0010) [2023-12-28 05:11:18,513][106226] Updated weights for policy 0, policy_version 1381458 (0.0010) [2023-12-28 05:11:18,523][106225] Updated weights for policy 1, policy_version 1384775 (0.0010) [2023-12-28 05:11:18,578][106226] Updated weights for policy 0, policy_version 1381468 (0.0011) [2023-12-28 05:11:18,584][106225] Updated weights for policy 1, policy_version 1384785 (0.0010) [2023-12-28 05:11:18,640][106226] Updated weights for policy 0, policy_version 1381478 (0.0011) [2023-12-28 05:11:18,697][106226] Updated weights for policy 0, policy_version 1381488 (0.0011) [2023-12-28 05:11:19,296][106225] Updated weights for policy 1, policy_version 1384795 (0.0010) [2023-12-28 05:11:19,335][106226] Updated weights for policy 0, policy_version 1381498 (0.0010) [2023-12-28 05:11:19,364][106225] Updated weights for policy 1, policy_version 1384805 (0.0010) [2023-12-28 05:11:19,401][106226] Updated weights for policy 0, policy_version 1381508 (0.0009) [2023-12-28 05:11:19,426][106225] Updated weights for policy 1, policy_version 1384815 (0.0010) [2023-12-28 05:11:19,463][106226] Updated weights for policy 0, policy_version 1381518 (0.0010) [2023-12-28 05:11:20,199][106225] Updated weights for policy 1, policy_version 1384825 (0.0010) [2023-12-28 05:11:20,238][106226] Updated weights for policy 0, policy_version 1381528 (0.0011) [2023-12-28 05:11:20,267][106225] Updated weights for policy 1, policy_version 1384835 (0.0008) [2023-12-28 05:11:20,297][106226] Updated weights for policy 0, policy_version 1381538 (0.0011) [2023-12-28 05:11:20,335][106225] Updated weights for policy 1, policy_version 1384845 (0.0010) [2023-12-28 05:11:20,361][106226] Updated weights for policy 0, policy_version 1381548 (0.0008) [2023-12-28 05:11:20,397][106225] Updated weights for policy 1, policy_version 1384855 (0.0010) [2023-12-28 05:11:21,013][106226] Updated weights for policy 0, policy_version 1381558 (0.0006) [2023-12-28 05:11:21,077][106225] Updated weights for policy 1, policy_version 1384865 (0.0008) [2023-12-28 05:11:21,077][106226] Updated weights for policy 0, policy_version 1381568 (0.0008) [2023-12-28 05:11:21,143][106225] Updated weights for policy 1, policy_version 1384875 (0.0009) [2023-12-28 05:11:21,151][106226] Updated weights for policy 0, policy_version 1381578 (0.0008) [2023-12-28 05:11:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 708321280. Throughput: 0: 9807.3, 1: 9951.1. Samples: 708338592. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:21,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.699')] [2023-12-28 05:11:21,209][106225] Updated weights for policy 1, policy_version 1384885 (0.0010) [2023-12-28 05:11:21,881][106226] Updated weights for policy 0, policy_version 1381588 (0.0011) [2023-12-28 05:11:21,946][106226] Updated weights for policy 0, policy_version 1381598 (0.0011) [2023-12-28 05:11:22,009][106226] Updated weights for policy 0, policy_version 1381608 (0.0008) [2023-12-28 05:11:22,016][106225] Updated weights for policy 1, policy_version 1384895 (0.0009) [2023-12-28 05:11:22,072][106225] Updated weights for policy 1, policy_version 1384905 (0.0009) [2023-12-28 05:11:22,132][106225] Updated weights for policy 1, policy_version 1384915 (0.0009) [2023-12-28 05:11:22,672][106226] Updated weights for policy 0, policy_version 1381618 (0.0007) [2023-12-28 05:11:22,726][106226] Updated weights for policy 0, policy_version 1381628 (0.0010) [2023-12-28 05:11:22,795][106226] Updated weights for policy 0, policy_version 1381638 (0.0011) [2023-12-28 05:11:22,852][106226] Updated weights for policy 0, policy_version 1381648 (0.0011) [2023-12-28 05:11:22,944][106225] Updated weights for policy 1, policy_version 1384925 (0.0010) [2023-12-28 05:11:23,015][106225] Updated weights for policy 1, policy_version 1384935 (0.0009) [2023-12-28 05:11:23,078][106225] Updated weights for policy 1, policy_version 1384945 (0.0008) [2023-12-28 05:11:23,504][106226] Updated weights for policy 0, policy_version 1381658 (0.0009) [2023-12-28 05:11:23,553][106226] Updated weights for policy 0, policy_version 1381668 (0.0008) [2023-12-28 05:11:23,615][106226] Updated weights for policy 0, policy_version 1381678 (0.0009) [2023-12-28 05:11:23,799][106225] Updated weights for policy 1, policy_version 1384955 (0.0010) [2023-12-28 05:11:23,860][106225] Updated weights for policy 1, policy_version 1384965 (0.0008) [2023-12-28 05:11:23,918][106225] Updated weights for policy 1, policy_version 1384975 (0.0009) [2023-12-28 05:11:24,331][106226] Updated weights for policy 0, policy_version 1381688 (0.0006) [2023-12-28 05:11:24,382][106226] Updated weights for policy 0, policy_version 1381698 (0.0006) [2023-12-28 05:11:24,443][106226] Updated weights for policy 0, policy_version 1381708 (0.0006) [2023-12-28 05:11:24,690][106225] Updated weights for policy 1, policy_version 1384985 (0.0009) [2023-12-28 05:11:24,738][106225] Updated weights for policy 1, policy_version 1384995 (0.0006) [2023-12-28 05:11:24,794][106225] Updated weights for policy 1, policy_version 1385005 (0.0005) [2023-12-28 05:11:24,853][106225] Updated weights for policy 1, policy_version 1385015 (0.0007) [2023-12-28 05:11:25,098][106226] Updated weights for policy 0, policy_version 1381718 (0.0005) [2023-12-28 05:11:25,172][106226] Updated weights for policy 0, policy_version 1381728 (0.0005) [2023-12-28 05:11:25,232][106226] Updated weights for policy 0, policy_version 1381738 (0.0005) [2023-12-28 05:11:25,436][106225] Updated weights for policy 1, policy_version 1385025 (0.0010) [2023-12-28 05:11:25,487][106225] Updated weights for policy 1, policy_version 1385035 (0.0010) [2023-12-28 05:11:25,533][106225] Updated weights for policy 1, policy_version 1385045 (0.0010) [2023-12-28 05:11:25,889][106226] Updated weights for policy 0, policy_version 1381748 (0.0007) [2023-12-28 05:11:25,954][106226] Updated weights for policy 0, policy_version 1381758 (0.0008) [2023-12-28 05:11:26,002][106226] Updated weights for policy 0, policy_version 1381768 (0.0008) [2023-12-28 05:11:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 708427776. Throughput: 0: 9804.2, 1: 9905.0. Samples: 708395692. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:26,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.731')] [2023-12-28 05:11:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001385048_354623488.pth... [2023-12-28 05:11:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001381776_353804288.pth... [2023-12-28 05:11:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001380624_353509376.pth [2023-12-28 05:11:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001383928_354336768.pth [2023-12-28 05:11:26,267][106225] Updated weights for policy 1, policy_version 1385055 (0.0010) [2023-12-28 05:11:26,319][106225] Updated weights for policy 1, policy_version 1385065 (0.0010) [2023-12-28 05:11:26,374][106225] Updated weights for policy 1, policy_version 1385075 (0.0010) [2023-12-28 05:11:26,744][106226] Updated weights for policy 0, policy_version 1381778 (0.0008) [2023-12-28 05:11:26,798][106226] Updated weights for policy 0, policy_version 1381788 (0.0008) [2023-12-28 05:11:26,848][106226] Updated weights for policy 0, policy_version 1381798 (0.0009) [2023-12-28 05:11:26,898][106226] Updated weights for policy 0, policy_version 1381808 (0.0008) [2023-12-28 05:11:27,012][106225] Updated weights for policy 1, policy_version 1385085 (0.0010) [2023-12-28 05:11:27,058][106225] Updated weights for policy 1, policy_version 1385095 (0.0010) [2023-12-28 05:11:27,108][106225] Updated weights for policy 1, policy_version 1385105 (0.0010) [2023-12-28 05:11:27,694][106226] Updated weights for policy 0, policy_version 1381818 (0.0008) [2023-12-28 05:11:27,748][106226] Updated weights for policy 0, policy_version 1381828 (0.0007) [2023-12-28 05:11:27,770][106225] Updated weights for policy 1, policy_version 1385115 (0.0008) [2023-12-28 05:11:27,802][106226] Updated weights for policy 0, policy_version 1381838 (0.0006) [2023-12-28 05:11:27,826][106225] Updated weights for policy 1, policy_version 1385125 (0.0010) [2023-12-28 05:11:27,873][106225] Updated weights for policy 1, policy_version 1385135 (0.0010) [2023-12-28 05:11:28,520][106225] Updated weights for policy 1, policy_version 1385145 (0.0010) [2023-12-28 05:11:28,581][106225] Updated weights for policy 1, policy_version 1385155 (0.0011) [2023-12-28 05:11:28,603][106226] Updated weights for policy 0, policy_version 1381848 (0.0006) [2023-12-28 05:11:28,643][106225] Updated weights for policy 1, policy_version 1385165 (0.0011) [2023-12-28 05:11:28,665][106226] Updated weights for policy 0, policy_version 1381858 (0.0008) [2023-12-28 05:11:28,706][106225] Updated weights for policy 1, policy_version 1385175 (0.0011) [2023-12-28 05:11:28,728][106226] Updated weights for policy 0, policy_version 1381868 (0.0007) [2023-12-28 05:11:29,426][106226] Updated weights for policy 0, policy_version 1381878 (0.0007) [2023-12-28 05:11:29,446][106225] Updated weights for policy 1, policy_version 1385185 (0.0011) [2023-12-28 05:11:29,483][106226] Updated weights for policy 0, policy_version 1381888 (0.0007) [2023-12-28 05:11:29,507][106225] Updated weights for policy 1, policy_version 1385195 (0.0010) [2023-12-28 05:11:29,540][106226] Updated weights for policy 0, policy_version 1381898 (0.0006) [2023-12-28 05:11:29,564][106225] Updated weights for policy 1, policy_version 1385205 (0.0010) [2023-12-28 05:11:30,245][106225] Updated weights for policy 1, policy_version 1385215 (0.0007) [2023-12-28 05:11:30,303][106225] Updated weights for policy 1, policy_version 1385225 (0.0005) [2023-12-28 05:11:30,347][106226] Updated weights for policy 0, policy_version 1381908 (0.0007) [2023-12-28 05:11:30,360][106225] Updated weights for policy 1, policy_version 1385235 (0.0006) [2023-12-28 05:11:30,408][106226] Updated weights for policy 0, policy_version 1381918 (0.0008) [2023-12-28 05:11:30,464][106226] Updated weights for policy 0, policy_version 1381928 (0.0010) [2023-12-28 05:11:30,958][106225] Updated weights for policy 1, policy_version 1385245 (0.0005) [2023-12-28 05:11:31,016][106225] Updated weights for policy 1, policy_version 1385255 (0.0005) [2023-12-28 05:11:31,082][106225] Updated weights for policy 1, policy_version 1385265 (0.0010) [2023-12-28 05:11:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 708526080. Throughput: 0: 9842.8, 1: 9884.4. Samples: 708513964. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:31,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.520')] [2023-12-28 05:11:31,294][106226] Updated weights for policy 0, policy_version 1381938 (0.0009) [2023-12-28 05:11:31,359][106226] Updated weights for policy 0, policy_version 1381948 (0.0008) [2023-12-28 05:11:31,424][106226] Updated weights for policy 0, policy_version 1381958 (0.0008) [2023-12-28 05:11:31,487][106226] Updated weights for policy 0, policy_version 1381968 (0.0008) [2023-12-28 05:11:31,733][106225] Updated weights for policy 1, policy_version 1385275 (0.0010) [2023-12-28 05:11:31,797][106225] Updated weights for policy 1, policy_version 1385285 (0.0009) [2023-12-28 05:11:31,851][106225] Updated weights for policy 1, policy_version 1385295 (0.0010) [2023-12-28 05:11:32,226][106226] Updated weights for policy 0, policy_version 1381978 (0.0011) [2023-12-28 05:11:32,290][106226] Updated weights for policy 0, policy_version 1381988 (0.0009) [2023-12-28 05:11:32,350][106226] Updated weights for policy 0, policy_version 1381998 (0.0005) [2023-12-28 05:11:32,545][106225] Updated weights for policy 1, policy_version 1385305 (0.0009) [2023-12-28 05:11:32,605][106225] Updated weights for policy 1, policy_version 1385315 (0.0010) [2023-12-28 05:11:32,662][106225] Updated weights for policy 1, policy_version 1385325 (0.0009) [2023-12-28 05:11:32,719][106225] Updated weights for policy 1, policy_version 1385335 (0.0008) [2023-12-28 05:11:33,057][106226] Updated weights for policy 0, policy_version 1382008 (0.0010) [2023-12-28 05:11:33,115][106226] Updated weights for policy 0, policy_version 1382018 (0.0011) [2023-12-28 05:11:33,179][106226] Updated weights for policy 0, policy_version 1382028 (0.0011) [2023-12-28 05:11:33,463][106225] Updated weights for policy 1, policy_version 1385345 (0.0008) [2023-12-28 05:11:33,512][106225] Updated weights for policy 1, policy_version 1385355 (0.0007) [2023-12-28 05:11:33,572][106225] Updated weights for policy 1, policy_version 1385365 (0.0010) [2023-12-28 05:11:33,808][106226] Updated weights for policy 0, policy_version 1382038 (0.0009) [2023-12-28 05:11:33,851][106226] Updated weights for policy 0, policy_version 1382048 (0.0008) [2023-12-28 05:11:33,899][106226] Updated weights for policy 0, policy_version 1382058 (0.0008) [2023-12-28 05:11:34,231][106225] Updated weights for policy 1, policy_version 1385375 (0.0009) [2023-12-28 05:11:34,291][106225] Updated weights for policy 1, policy_version 1385385 (0.0009) [2023-12-28 05:11:34,347][106225] Updated weights for policy 1, policy_version 1385395 (0.0009) [2023-12-28 05:11:34,627][106226] Updated weights for policy 0, policy_version 1382068 (0.0009) [2023-12-28 05:11:34,683][106226] Updated weights for policy 0, policy_version 1382078 (0.0009) [2023-12-28 05:11:34,740][106226] Updated weights for policy 0, policy_version 1382088 (0.0008) [2023-12-28 05:11:35,090][106225] Updated weights for policy 1, policy_version 1385405 (0.0008) [2023-12-28 05:11:35,147][106225] Updated weights for policy 1, policy_version 1385415 (0.0009) [2023-12-28 05:11:35,195][106225] Updated weights for policy 1, policy_version 1385425 (0.0006) [2023-12-28 05:11:35,420][106226] Updated weights for policy 0, policy_version 1382098 (0.0006) [2023-12-28 05:11:35,486][106226] Updated weights for policy 0, policy_version 1382108 (0.0008) [2023-12-28 05:11:35,538][106226] Updated weights for policy 0, policy_version 1382118 (0.0007) [2023-12-28 05:11:35,587][106226] Updated weights for policy 0, policy_version 1382128 (0.0006) [2023-12-28 05:11:35,816][106225] Updated weights for policy 1, policy_version 1385435 (0.0006) [2023-12-28 05:11:35,872][106225] Updated weights for policy 1, policy_version 1385445 (0.0008) [2023-12-28 05:11:35,934][106225] Updated weights for policy 1, policy_version 1385455 (0.0009) [2023-12-28 05:11:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 708624384. Throughput: 0: 9805.5, 1: 9932.2. Samples: 708633312. Policy #0 lag: (min: 17.0, avg: 41.0, max: 49.0) [2023-12-28 05:11:36,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-4.421')] [2023-12-28 05:11:36,305][106226] Updated weights for policy 0, policy_version 1382138 (0.0007) [2023-12-28 05:11:36,368][106226] Updated weights for policy 0, policy_version 1382148 (0.0008) [2023-12-28 05:11:36,427][106226] Updated weights for policy 0, policy_version 1382158 (0.0006) [2023-12-28 05:11:36,654][106225] Updated weights for policy 1, policy_version 1385465 (0.0010) [2023-12-28 05:11:36,710][106225] Updated weights for policy 1, policy_version 1385475 (0.0010) [2023-12-28 05:11:36,770][106225] Updated weights for policy 1, policy_version 1385485 (0.0010) [2023-12-28 05:11:36,832][106225] Updated weights for policy 1, policy_version 1385495 (0.0010) [2023-12-28 05:11:37,054][106226] Updated weights for policy 0, policy_version 1382168 (0.0010) [2023-12-28 05:11:37,107][106226] Updated weights for policy 0, policy_version 1382178 (0.0010) [2023-12-28 05:11:37,158][106226] Updated weights for policy 0, policy_version 1382188 (0.0011) [2023-12-28 05:11:37,455][106225] Updated weights for policy 1, policy_version 1385505 (0.0006) [2023-12-28 05:11:37,513][106225] Updated weights for policy 1, policy_version 1385515 (0.0005) [2023-12-28 05:11:37,576][106225] Updated weights for policy 1, policy_version 1385525 (0.0007) [2023-12-28 05:11:37,771][106226] Updated weights for policy 0, policy_version 1382198 (0.0008) [2023-12-28 05:11:37,834][106226] Updated weights for policy 0, policy_version 1382208 (0.0006) [2023-12-28 05:11:37,897][106226] Updated weights for policy 0, policy_version 1382218 (0.0006) [2023-12-28 05:11:38,262][106225] Updated weights for policy 1, policy_version 1385535 (0.0009) [2023-12-28 05:11:38,313][106225] Updated weights for policy 1, policy_version 1385545 (0.0010) [2023-12-28 05:11:38,376][106225] Updated weights for policy 1, policy_version 1385555 (0.0010) [2023-12-28 05:11:38,502][106226] Updated weights for policy 0, policy_version 1382228 (0.0006) [2023-12-28 05:11:38,566][106226] Updated weights for policy 0, policy_version 1382238 (0.0007) [2023-12-28 05:11:38,630][106226] Updated weights for policy 0, policy_version 1382248 (0.0005) [2023-12-28 05:11:39,131][106225] Updated weights for policy 1, policy_version 1385565 (0.0010) [2023-12-28 05:11:39,199][106225] Updated weights for policy 1, policy_version 1385575 (0.0009) [2023-12-28 05:11:39,266][106225] Updated weights for policy 1, policy_version 1385585 (0.0007) [2023-12-28 05:11:39,301][106226] Updated weights for policy 0, policy_version 1382258 (0.0006) [2023-12-28 05:11:39,366][106226] Updated weights for policy 0, policy_version 1382268 (0.0007) [2023-12-28 05:11:39,435][106226] Updated weights for policy 0, policy_version 1382278 (0.0009) [2023-12-28 05:11:39,484][106226] Updated weights for policy 0, policy_version 1382288 (0.0008) [2023-12-28 05:11:40,024][106225] Updated weights for policy 1, policy_version 1385595 (0.0008) [2023-12-28 05:11:40,087][106225] Updated weights for policy 1, policy_version 1385605 (0.0008) [2023-12-28 05:11:40,153][106225] Updated weights for policy 1, policy_version 1385615 (0.0010) [2023-12-28 05:11:40,228][106226] Updated weights for policy 0, policy_version 1382298 (0.0008) [2023-12-28 05:11:40,287][106226] Updated weights for policy 0, policy_version 1382308 (0.0009) [2023-12-28 05:11:40,354][106226] Updated weights for policy 0, policy_version 1382318 (0.0009) [2023-12-28 05:11:40,888][106225] Updated weights for policy 1, policy_version 1385625 (0.0007) [2023-12-28 05:11:40,932][106225] Updated weights for policy 1, policy_version 1385635 (0.0008) [2023-12-28 05:11:40,986][106225] Updated weights for policy 1, policy_version 1385645 (0.0007) [2023-12-28 05:11:41,053][106225] Updated weights for policy 1, policy_version 1385655 (0.0007) [2023-12-28 05:11:41,074][106226] Updated weights for policy 0, policy_version 1382328 (0.0009) [2023-12-28 05:11:41,149][106226] Updated weights for policy 0, policy_version 1382338 (0.0008) [2023-12-28 05:11:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 708722688. Throughput: 0: 9902.5, 1: 9958.3. Samples: 708696064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:11:41,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.589')] [2023-12-28 05:11:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001385656_354779136.pth... [2023-12-28 05:11:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001384472_354476032.pth [2023-12-28 05:11:41,217][106226] Updated weights for policy 0, policy_version 1382348 (0.0008) [2023-12-28 05:11:41,242][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001382352_353951744.pth... [2023-12-28 05:11:41,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001381168_353648640.pth [2023-12-28 05:11:41,795][106225] Updated weights for policy 1, policy_version 1385665 (0.0006) [2023-12-28 05:11:41,854][106225] Updated weights for policy 1, policy_version 1385675 (0.0006) [2023-12-28 05:11:41,920][106225] Updated weights for policy 1, policy_version 1385685 (0.0008) [2023-12-28 05:11:41,976][106226] Updated weights for policy 0, policy_version 1382358 (0.0009) [2023-12-28 05:11:42,039][106226] Updated weights for policy 0, policy_version 1382368 (0.0009) [2023-12-28 05:11:42,101][106226] Updated weights for policy 0, policy_version 1382378 (0.0009) [2023-12-28 05:11:42,607][106225] Updated weights for policy 1, policy_version 1385695 (0.0006) [2023-12-28 05:11:42,672][106225] Updated weights for policy 1, policy_version 1385705 (0.0009) [2023-12-28 05:11:42,729][106225] Updated weights for policy 1, policy_version 1385715 (0.0007) [2023-12-28 05:11:42,853][106226] Updated weights for policy 0, policy_version 1382388 (0.0006) [2023-12-28 05:11:42,908][106226] Updated weights for policy 0, policy_version 1382398 (0.0008) [2023-12-28 05:11:42,959][106226] Updated weights for policy 0, policy_version 1382408 (0.0009) [2023-12-28 05:11:43,317][106225] Updated weights for policy 1, policy_version 1385725 (0.0006) [2023-12-28 05:11:43,374][106225] Updated weights for policy 1, policy_version 1385735 (0.0008) [2023-12-28 05:11:43,427][106225] Updated weights for policy 1, policy_version 1385745 (0.0010) [2023-12-28 05:11:43,622][106226] Updated weights for policy 0, policy_version 1382418 (0.0009) [2023-12-28 05:11:43,671][106226] Updated weights for policy 0, policy_version 1382428 (0.0008) [2023-12-28 05:11:43,719][106226] Updated weights for policy 0, policy_version 1382438 (0.0008) [2023-12-28 05:11:43,771][106226] Updated weights for policy 0, policy_version 1382448 (0.0005) [2023-12-28 05:11:44,023][106225] Updated weights for policy 1, policy_version 1385755 (0.0006) [2023-12-28 05:11:44,077][106225] Updated weights for policy 1, policy_version 1385765 (0.0005) [2023-12-28 05:11:44,145][106225] Updated weights for policy 1, policy_version 1385775 (0.0006) [2023-12-28 05:11:44,476][106226] Updated weights for policy 0, policy_version 1382458 (0.0005) [2023-12-28 05:11:44,542][106226] Updated weights for policy 0, policy_version 1382468 (0.0008) [2023-12-28 05:11:44,593][106226] Updated weights for policy 0, policy_version 1382478 (0.0010) [2023-12-28 05:11:44,710][106225] Updated weights for policy 1, policy_version 1385785 (0.0009) [2023-12-28 05:11:44,771][106225] Updated weights for policy 1, policy_version 1385795 (0.0009) [2023-12-28 05:11:44,841][106225] Updated weights for policy 1, policy_version 1385805 (0.0011) [2023-12-28 05:11:44,900][106225] Updated weights for policy 1, policy_version 1385815 (0.0011) [2023-12-28 05:11:45,326][106226] Updated weights for policy 0, policy_version 1382488 (0.0008) [2023-12-28 05:11:45,380][106226] Updated weights for policy 0, policy_version 1382498 (0.0007) [2023-12-28 05:11:45,435][106226] Updated weights for policy 0, policy_version 1382508 (0.0008) [2023-12-28 05:11:45,617][106225] Updated weights for policy 1, policy_version 1385825 (0.0010) [2023-12-28 05:11:45,663][106225] Updated weights for policy 1, policy_version 1385835 (0.0010) [2023-12-28 05:11:45,709][106225] Updated weights for policy 1, policy_version 1385845 (0.0010) [2023-12-28 05:11:46,122][106226] Updated weights for policy 0, policy_version 1382518 (0.0006) [2023-12-28 05:11:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 708820992. Throughput: 0: 9894.1, 1: 9980.0. Samples: 708814632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:11:46,175][106226] Updated weights for policy 0, policy_version 1382528 (0.0005) [2023-12-28 05:11:46,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-4.712')] [2023-12-28 05:11:46,229][106226] Updated weights for policy 0, policy_version 1382538 (0.0005) [2023-12-28 05:11:46,427][106225] Updated weights for policy 1, policy_version 1385855 (0.0010) [2023-12-28 05:11:46,485][106225] Updated weights for policy 1, policy_version 1385865 (0.0009) [2023-12-28 05:11:46,554][106225] Updated weights for policy 1, policy_version 1385875 (0.0008) [2023-12-28 05:11:46,778][106226] Updated weights for policy 0, policy_version 1382548 (0.0005) [2023-12-28 05:11:46,837][106226] Updated weights for policy 0, policy_version 1382558 (0.0005) [2023-12-28 05:11:46,896][106226] Updated weights for policy 0, policy_version 1382568 (0.0005) [2023-12-28 05:11:47,252][106225] Updated weights for policy 1, policy_version 1385885 (0.0010) [2023-12-28 05:11:47,313][106225] Updated weights for policy 1, policy_version 1385895 (0.0010) [2023-12-28 05:11:47,367][106225] Updated weights for policy 1, policy_version 1385905 (0.0010) [2023-12-28 05:11:47,550][106226] Updated weights for policy 0, policy_version 1382578 (0.0006) [2023-12-28 05:11:47,611][106226] Updated weights for policy 0, policy_version 1382588 (0.0008) [2023-12-28 05:11:47,666][106226] Updated weights for policy 0, policy_version 1382598 (0.0008) [2023-12-28 05:11:47,724][106226] Updated weights for policy 0, policy_version 1382608 (0.0008) [2023-12-28 05:11:48,085][106225] Updated weights for policy 1, policy_version 1385915 (0.0010) [2023-12-28 05:11:48,146][106225] Updated weights for policy 1, policy_version 1385925 (0.0008) [2023-12-28 05:11:48,203][106225] Updated weights for policy 1, policy_version 1385935 (0.0008) [2023-12-28 05:11:48,455][106226] Updated weights for policy 0, policy_version 1382618 (0.0009) [2023-12-28 05:11:48,516][106226] Updated weights for policy 0, policy_version 1382628 (0.0011) [2023-12-28 05:11:48,581][106226] Updated weights for policy 0, policy_version 1382638 (0.0009) [2023-12-28 05:11:49,006][106225] Updated weights for policy 1, policy_version 1385945 (0.0008) [2023-12-28 05:11:49,067][106225] Updated weights for policy 1, policy_version 1385955 (0.0007) [2023-12-28 05:11:49,129][106225] Updated weights for policy 1, policy_version 1385965 (0.0008) [2023-12-28 05:11:49,188][106225] Updated weights for policy 1, policy_version 1385975 (0.0008) [2023-12-28 05:11:49,198][106226] Updated weights for policy 0, policy_version 1382648 (0.0010) [2023-12-28 05:11:49,267][106226] Updated weights for policy 0, policy_version 1382658 (0.0009) [2023-12-28 05:11:49,322][106226] Updated weights for policy 0, policy_version 1382668 (0.0008) [2023-12-28 05:11:49,932][106225] Updated weights for policy 1, policy_version 1385985 (0.0008) [2023-12-28 05:11:50,001][106225] Updated weights for policy 1, policy_version 1385995 (0.0008) [2023-12-28 05:11:50,069][106225] Updated weights for policy 1, policy_version 1386005 (0.0006) [2023-12-28 05:11:50,086][106226] Updated weights for policy 0, policy_version 1382678 (0.0009) [2023-12-28 05:11:50,154][106226] Updated weights for policy 0, policy_version 1382688 (0.0011) [2023-12-28 05:11:50,219][106226] Updated weights for policy 0, policy_version 1382698 (0.0011) [2023-12-28 05:11:50,713][106225] Updated weights for policy 1, policy_version 1386015 (0.0007) [2023-12-28 05:11:50,770][106225] Updated weights for policy 1, policy_version 1386025 (0.0008) [2023-12-28 05:11:50,830][106225] Updated weights for policy 1, policy_version 1386035 (0.0008) [2023-12-28 05:11:50,904][106226] Updated weights for policy 0, policy_version 1382708 (0.0009) [2023-12-28 05:11:50,967][106226] Updated weights for policy 0, policy_version 1382718 (0.0006) [2023-12-28 05:11:51,043][106226] Updated weights for policy 0, policy_version 1382728 (0.0007) [2023-12-28 05:11:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 708927488. Throughput: 0: 9855.2, 1: 9899.9. Samples: 708932852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:11:51,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.700')] [2023-12-28 05:11:51,623][106225] Updated weights for policy 1, policy_version 1386045 (0.0007) [2023-12-28 05:11:51,686][106225] Updated weights for policy 1, policy_version 1386055 (0.0009) [2023-12-28 05:11:51,723][106226] Updated weights for policy 0, policy_version 1382738 (0.0007) [2023-12-28 05:11:51,754][106225] Updated weights for policy 1, policy_version 1386065 (0.0008) [2023-12-28 05:11:51,788][106226] Updated weights for policy 0, policy_version 1382748 (0.0008) [2023-12-28 05:11:51,848][106226] Updated weights for policy 0, policy_version 1382758 (0.0008) [2023-12-28 05:11:51,915][106226] Updated weights for policy 0, policy_version 1382768 (0.0011) [2023-12-28 05:11:52,434][106225] Updated weights for policy 1, policy_version 1386075 (0.0007) [2023-12-28 05:11:52,490][106225] Updated weights for policy 1, policy_version 1386085 (0.0008) [2023-12-28 05:11:52,549][106225] Updated weights for policy 1, policy_version 1386095 (0.0009) [2023-12-28 05:11:52,626][106226] Updated weights for policy 0, policy_version 1382778 (0.0008) [2023-12-28 05:11:52,683][106226] Updated weights for policy 0, policy_version 1382788 (0.0008) [2023-12-28 05:11:52,746][106226] Updated weights for policy 0, policy_version 1382798 (0.0008) [2023-12-28 05:11:53,216][106225] Updated weights for policy 1, policy_version 1386105 (0.0007) [2023-12-28 05:11:53,273][106225] Updated weights for policy 1, policy_version 1386115 (0.0005) [2023-12-28 05:11:53,331][106225] Updated weights for policy 1, policy_version 1386125 (0.0005) [2023-12-28 05:11:53,390][106225] Updated weights for policy 1, policy_version 1386135 (0.0005) [2023-12-28 05:11:53,448][106226] Updated weights for policy 0, policy_version 1382808 (0.0011) [2023-12-28 05:11:53,494][106226] Updated weights for policy 0, policy_version 1382818 (0.0010) [2023-12-28 05:11:53,547][106226] Updated weights for policy 0, policy_version 1382828 (0.0010) [2023-12-28 05:11:53,981][106225] Updated weights for policy 1, policy_version 1386145 (0.0005) [2023-12-28 05:11:54,030][106225] Updated weights for policy 1, policy_version 1386155 (0.0005) [2023-12-28 05:11:54,097][106225] Updated weights for policy 1, policy_version 1386165 (0.0007) [2023-12-28 05:11:54,273][106226] Updated weights for policy 0, policy_version 1382838 (0.0010) [2023-12-28 05:11:54,334][106226] Updated weights for policy 0, policy_version 1382848 (0.0011) [2023-12-28 05:11:54,394][106226] Updated weights for policy 0, policy_version 1382858 (0.0011) [2023-12-28 05:11:54,825][106225] Updated weights for policy 1, policy_version 1386175 (0.0007) [2023-12-28 05:11:54,884][106225] Updated weights for policy 1, policy_version 1386185 (0.0006) [2023-12-28 05:11:54,942][106225] Updated weights for policy 1, policy_version 1386195 (0.0006) [2023-12-28 05:11:55,043][106226] Updated weights for policy 0, policy_version 1382868 (0.0011) [2023-12-28 05:11:55,106][106226] Updated weights for policy 0, policy_version 1382878 (0.0011) [2023-12-28 05:11:55,167][106226] Updated weights for policy 0, policy_version 1382888 (0.0010) [2023-12-28 05:11:55,483][106225] Updated weights for policy 1, policy_version 1386205 (0.0006) [2023-12-28 05:11:55,540][106225] Updated weights for policy 1, policy_version 1386215 (0.0005) [2023-12-28 05:11:55,597][106225] Updated weights for policy 1, policy_version 1386225 (0.0006) [2023-12-28 05:11:55,867][106226] Updated weights for policy 0, policy_version 1382898 (0.0011) [2023-12-28 05:11:55,933][106226] Updated weights for policy 0, policy_version 1382908 (0.0011) [2023-12-28 05:11:55,998][106226] Updated weights for policy 0, policy_version 1382918 (0.0010) [2023-12-28 05:11:56,067][106226] Updated weights for policy 0, policy_version 1382928 (0.0011) [2023-12-28 05:11:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 709025792. Throughput: 0: 9847.1, 1: 9923.2. Samples: 708992064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:11:56,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.502')] [2023-12-28 05:11:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001382928_354099200.pth... [2023-12-28 05:11:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001386232_354926592.pth... [2023-12-28 05:11:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001381776_353804288.pth [2023-12-28 05:11:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001385048_354623488.pth [2023-12-28 05:11:56,238][106225] Updated weights for policy 1, policy_version 1386235 (0.0007) [2023-12-28 05:11:56,291][106225] Updated weights for policy 1, policy_version 1386245 (0.0010) [2023-12-28 05:11:56,351][106225] Updated weights for policy 1, policy_version 1386255 (0.0010) [2023-12-28 05:11:56,762][106226] Updated weights for policy 0, policy_version 1382938 (0.0010) [2023-12-28 05:11:56,828][106226] Updated weights for policy 0, policy_version 1382948 (0.0010) [2023-12-28 05:11:56,889][106226] Updated weights for policy 0, policy_version 1382958 (0.0010) [2023-12-28 05:11:57,007][106225] Updated weights for policy 1, policy_version 1386265 (0.0010) [2023-12-28 05:11:57,065][106225] Updated weights for policy 1, policy_version 1386275 (0.0006) [2023-12-28 05:11:57,122][106225] Updated weights for policy 1, policy_version 1386285 (0.0010) [2023-12-28 05:11:57,174][106225] Updated weights for policy 1, policy_version 1386295 (0.0008) [2023-12-28 05:11:57,578][106226] Updated weights for policy 0, policy_version 1382968 (0.0010) [2023-12-28 05:11:57,633][106226] Updated weights for policy 0, policy_version 1382978 (0.0010) [2023-12-28 05:11:57,695][106226] Updated weights for policy 0, policy_version 1382988 (0.0010) [2023-12-28 05:11:57,829][106225] Updated weights for policy 1, policy_version 1386305 (0.0010) [2023-12-28 05:11:57,875][106225] Updated weights for policy 1, policy_version 1386315 (0.0010) [2023-12-28 05:11:57,921][106225] Updated weights for policy 1, policy_version 1386325 (0.0010) [2023-12-28 05:11:58,429][106226] Updated weights for policy 0, policy_version 1382998 (0.0008) [2023-12-28 05:11:58,498][106226] Updated weights for policy 0, policy_version 1383008 (0.0010) [2023-12-28 05:11:58,562][106226] Updated weights for policy 0, policy_version 1383018 (0.0011) [2023-12-28 05:11:58,682][106225] Updated weights for policy 1, policy_version 1386335 (0.0008) [2023-12-28 05:11:58,740][106225] Updated weights for policy 1, policy_version 1386345 (0.0008) [2023-12-28 05:11:58,811][106225] Updated weights for policy 1, policy_version 1386355 (0.0008) [2023-12-28 05:11:59,395][106226] Updated weights for policy 0, policy_version 1383028 (0.0008) [2023-12-28 05:11:59,456][106226] Updated weights for policy 0, policy_version 1383038 (0.0009) [2023-12-28 05:11:59,513][106226] Updated weights for policy 0, policy_version 1383048 (0.0006) [2023-12-28 05:11:59,565][106225] Updated weights for policy 1, policy_version 1386365 (0.0009) [2023-12-28 05:11:59,628][106225] Updated weights for policy 1, policy_version 1386375 (0.0008) [2023-12-28 05:11:59,697][106225] Updated weights for policy 1, policy_version 1386385 (0.0008) [2023-12-28 05:12:00,248][106226] Updated weights for policy 0, policy_version 1383058 (0.0008) [2023-12-28 05:12:00,316][106226] Updated weights for policy 0, policy_version 1383068 (0.0007) [2023-12-28 05:12:00,382][106226] Updated weights for policy 0, policy_version 1383078 (0.0009) [2023-12-28 05:12:00,388][106225] Updated weights for policy 1, policy_version 1386395 (0.0010) [2023-12-28 05:12:00,444][106226] Updated weights for policy 0, policy_version 1383088 (0.0006) [2023-12-28 05:12:00,444][106225] Updated weights for policy 1, policy_version 1386405 (0.0007) [2023-12-28 05:12:00,515][106225] Updated weights for policy 1, policy_version 1386415 (0.0005) [2023-12-28 05:12:01,087][106226] Updated weights for policy 0, policy_version 1383098 (0.0007) [2023-12-28 05:12:01,147][106226] Updated weights for policy 0, policy_version 1383108 (0.0007) [2023-12-28 05:12:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 709115904. Throughput: 0: 9837.7, 1: 9976.8. Samples: 709110788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:01,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.556')] [2023-12-28 05:12:01,187][106225] Updated weights for policy 1, policy_version 1386425 (0.0005) [2023-12-28 05:12:01,208][106226] Updated weights for policy 0, policy_version 1383118 (0.0006) [2023-12-28 05:12:01,238][106225] Updated weights for policy 1, policy_version 1386435 (0.0006) [2023-12-28 05:12:01,295][106225] Updated weights for policy 1, policy_version 1386445 (0.0008) [2023-12-28 05:12:01,359][106225] Updated weights for policy 1, policy_version 1386456 (0.0009) [2023-12-28 05:12:01,910][106226] Updated weights for policy 0, policy_version 1383128 (0.0009) [2023-12-28 05:12:01,972][106226] Updated weights for policy 0, policy_version 1383138 (0.0008) [2023-12-28 05:12:02,034][106226] Updated weights for policy 0, policy_version 1383148 (0.0009) [2023-12-28 05:12:02,137][106225] Updated weights for policy 1, policy_version 1386466 (0.0009) [2023-12-28 05:12:02,194][106225] Updated weights for policy 1, policy_version 1386476 (0.0009) [2023-12-28 05:12:02,254][106225] Updated weights for policy 1, policy_version 1386486 (0.0010) [2023-12-28 05:12:02,757][106226] Updated weights for policy 0, policy_version 1383158 (0.0009) [2023-12-28 05:12:02,815][106226] Updated weights for policy 0, policy_version 1383168 (0.0008) [2023-12-28 05:12:02,873][106226] Updated weights for policy 0, policy_version 1383178 (0.0008) [2023-12-28 05:12:03,002][106225] Updated weights for policy 1, policy_version 1386496 (0.0008) [2023-12-28 05:12:03,052][106225] Updated weights for policy 1, policy_version 1386506 (0.0008) [2023-12-28 05:12:03,107][106225] Updated weights for policy 1, policy_version 1386516 (0.0008) [2023-12-28 05:12:03,593][106226] Updated weights for policy 0, policy_version 1383188 (0.0008) [2023-12-28 05:12:03,659][106226] Updated weights for policy 0, policy_version 1383198 (0.0008) [2023-12-28 05:12:03,723][106226] Updated weights for policy 0, policy_version 1383208 (0.0008) [2023-12-28 05:12:03,832][106225] Updated weights for policy 1, policy_version 1386526 (0.0008) [2023-12-28 05:12:03,893][106225] Updated weights for policy 1, policy_version 1386536 (0.0006) [2023-12-28 05:12:03,946][106225] Updated weights for policy 1, policy_version 1386546 (0.0008) [2023-12-28 05:12:04,461][106226] Updated weights for policy 0, policy_version 1383218 (0.0008) [2023-12-28 05:12:04,512][106226] Updated weights for policy 0, policy_version 1383228 (0.0008) [2023-12-28 05:12:04,566][106226] Updated weights for policy 0, policy_version 1383238 (0.0009) [2023-12-28 05:12:04,613][106226] Updated weights for policy 0, policy_version 1383248 (0.0008) [2023-12-28 05:12:04,683][106225] Updated weights for policy 1, policy_version 1386556 (0.0008) [2023-12-28 05:12:04,745][106225] Updated weights for policy 1, policy_version 1386566 (0.0008) [2023-12-28 05:12:04,804][106225] Updated weights for policy 1, policy_version 1386576 (0.0008) [2023-12-28 05:12:05,357][106226] Updated weights for policy 0, policy_version 1383258 (0.0007) [2023-12-28 05:12:05,408][106226] Updated weights for policy 0, policy_version 1383268 (0.0008) [2023-12-28 05:12:05,462][106226] Updated weights for policy 0, policy_version 1383278 (0.0008) [2023-12-28 05:12:05,538][106225] Updated weights for policy 1, policy_version 1386586 (0.0008) [2023-12-28 05:12:05,597][106225] Updated weights for policy 1, policy_version 1386596 (0.0010) [2023-12-28 05:12:05,650][106225] Updated weights for policy 1, policy_version 1386606 (0.0010) [2023-12-28 05:12:05,699][106225] Updated weights for policy 1, policy_version 1386616 (0.0010) [2023-12-28 05:12:06,173][106226] Updated weights for policy 0, policy_version 1383288 (0.0009) [2023-12-28 05:12:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 709214208. Throughput: 0: 9802.8, 1: 9937.1. Samples: 709226884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:06,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.698')] [2023-12-28 05:12:06,242][106226] Updated weights for policy 0, policy_version 1383298 (0.0011) [2023-12-28 05:12:06,309][106226] Updated weights for policy 0, policy_version 1383308 (0.0011) [2023-12-28 05:12:06,450][106225] Updated weights for policy 1, policy_version 1386626 (0.0011) [2023-12-28 05:12:06,512][106225] Updated weights for policy 1, policy_version 1386636 (0.0010) [2023-12-28 05:12:06,573][106225] Updated weights for policy 1, policy_version 1386646 (0.0011) [2023-12-28 05:12:06,966][106226] Updated weights for policy 0, policy_version 1383318 (0.0009) [2023-12-28 05:12:07,013][106226] Updated weights for policy 0, policy_version 1383328 (0.0010) [2023-12-28 05:12:07,063][106226] Updated weights for policy 0, policy_version 1383338 (0.0010) [2023-12-28 05:12:07,322][106225] Updated weights for policy 1, policy_version 1386656 (0.0008) [2023-12-28 05:12:07,381][106225] Updated weights for policy 1, policy_version 1386666 (0.0009) [2023-12-28 05:12:07,442][106225] Updated weights for policy 1, policy_version 1386676 (0.0009) [2023-12-28 05:12:07,727][106226] Updated weights for policy 0, policy_version 1383348 (0.0008) [2023-12-28 05:12:07,784][106226] Updated weights for policy 0, policy_version 1383358 (0.0010) [2023-12-28 05:12:07,835][106226] Updated weights for policy 0, policy_version 1383368 (0.0009) [2023-12-28 05:12:08,157][106225] Updated weights for policy 1, policy_version 1386686 (0.0010) [2023-12-28 05:12:08,207][106225] Updated weights for policy 1, policy_version 1386696 (0.0010) [2023-12-28 05:12:08,262][106225] Updated weights for policy 1, policy_version 1386706 (0.0010) [2023-12-28 05:12:08,604][106226] Updated weights for policy 0, policy_version 1383378 (0.0008) [2023-12-28 05:12:08,666][106226] Updated weights for policy 0, policy_version 1383388 (0.0008) [2023-12-28 05:12:08,727][106226] Updated weights for policy 0, policy_version 1383398 (0.0008) [2023-12-28 05:12:08,786][106226] Updated weights for policy 0, policy_version 1383408 (0.0008) [2023-12-28 05:12:09,033][106225] Updated weights for policy 1, policy_version 1386716 (0.0010) [2023-12-28 05:12:09,093][106225] Updated weights for policy 1, policy_version 1386726 (0.0010) [2023-12-28 05:12:09,148][106225] Updated weights for policy 1, policy_version 1386736 (0.0005) [2023-12-28 05:12:09,560][106226] Updated weights for policy 0, policy_version 1383418 (0.0007) [2023-12-28 05:12:09,619][106226] Updated weights for policy 0, policy_version 1383428 (0.0009) [2023-12-28 05:12:09,677][106226] Updated weights for policy 0, policy_version 1383438 (0.0009) [2023-12-28 05:12:09,934][106225] Updated weights for policy 1, policy_version 1386746 (0.0007) [2023-12-28 05:12:10,002][106225] Updated weights for policy 1, policy_version 1386756 (0.0009) [2023-12-28 05:12:10,061][106225] Updated weights for policy 1, policy_version 1386766 (0.0008) [2023-12-28 05:12:10,124][106225] Updated weights for policy 1, policy_version 1386776 (0.0007) [2023-12-28 05:12:10,470][106226] Updated weights for policy 0, policy_version 1383448 (0.0009) [2023-12-28 05:12:10,529][106226] Updated weights for policy 0, policy_version 1383458 (0.0008) [2023-12-28 05:12:10,595][106226] Updated weights for policy 0, policy_version 1383468 (0.0007) [2023-12-28 05:12:10,801][106225] Updated weights for policy 1, policy_version 1386786 (0.0009) [2023-12-28 05:12:10,849][106225] Updated weights for policy 1, policy_version 1386796 (0.0011) [2023-12-28 05:12:10,897][106225] Updated weights for policy 1, policy_version 1386806 (0.0010) [2023-12-28 05:12:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 709312512. Throughput: 0: 9799.2, 1: 9954.7. Samples: 709284620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:11,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.548')] [2023-12-28 05:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001386808_355074048.pth... [2023-12-28 05:12:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001383472_354238464.pth... [2023-12-28 05:12:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001385656_354779136.pth [2023-12-28 05:12:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001382352_353951744.pth [2023-12-28 05:12:11,309][106226] Updated weights for policy 0, policy_version 1383478 (0.0007) [2023-12-28 05:12:11,375][106226] Updated weights for policy 0, policy_version 1383488 (0.0009) [2023-12-28 05:12:11,432][106226] Updated weights for policy 0, policy_version 1383498 (0.0008) [2023-12-28 05:12:11,730][106225] Updated weights for policy 1, policy_version 1386816 (0.0009) [2023-12-28 05:12:11,800][106225] Updated weights for policy 1, policy_version 1386826 (0.0007) [2023-12-28 05:12:11,862][106225] Updated weights for policy 1, policy_version 1386836 (0.0008) [2023-12-28 05:12:12,246][106226] Updated weights for policy 0, policy_version 1383508 (0.0007) [2023-12-28 05:12:12,315][106226] Updated weights for policy 0, policy_version 1383518 (0.0008) [2023-12-28 05:12:12,393][106226] Updated weights for policy 0, policy_version 1383528 (0.0008) [2023-12-28 05:12:12,503][106225] Updated weights for policy 1, policy_version 1386846 (0.0009) [2023-12-28 05:12:12,564][106225] Updated weights for policy 1, policy_version 1386856 (0.0010) [2023-12-28 05:12:12,615][106225] Updated weights for policy 1, policy_version 1386866 (0.0010) [2023-12-28 05:12:13,102][106226] Updated weights for policy 0, policy_version 1383538 (0.0007) [2023-12-28 05:12:13,155][106226] Updated weights for policy 0, policy_version 1383548 (0.0008) [2023-12-28 05:12:13,199][106226] Updated weights for policy 0, policy_version 1383558 (0.0006) [2023-12-28 05:12:13,248][106226] Updated weights for policy 0, policy_version 1383568 (0.0006) [2023-12-28 05:12:13,261][106225] Updated weights for policy 1, policy_version 1386876 (0.0011) [2023-12-28 05:12:13,310][106225] Updated weights for policy 1, policy_version 1386886 (0.0008) [2023-12-28 05:12:13,363][106225] Updated weights for policy 1, policy_version 1386896 (0.0010) [2023-12-28 05:12:13,863][106226] Updated weights for policy 0, policy_version 1383578 (0.0005) [2023-12-28 05:12:13,917][106226] Updated weights for policy 0, policy_version 1383588 (0.0007) [2023-12-28 05:12:13,975][106226] Updated weights for policy 0, policy_version 1383598 (0.0006) [2023-12-28 05:12:14,046][106225] Updated weights for policy 1, policy_version 1386906 (0.0010) [2023-12-28 05:12:14,109][106225] Updated weights for policy 1, policy_version 1386916 (0.0010) [2023-12-28 05:12:14,171][106225] Updated weights for policy 1, policy_version 1386926 (0.0008) [2023-12-28 05:12:14,232][106225] Updated weights for policy 1, policy_version 1386936 (0.0008) [2023-12-28 05:12:14,632][106226] Updated weights for policy 0, policy_version 1383608 (0.0008) [2023-12-28 05:12:14,692][106226] Updated weights for policy 0, policy_version 1383618 (0.0007) [2023-12-28 05:12:14,755][106226] Updated weights for policy 0, policy_version 1383628 (0.0008) [2023-12-28 05:12:14,919][106225] Updated weights for policy 1, policy_version 1386946 (0.0008) [2023-12-28 05:12:14,980][106225] Updated weights for policy 1, policy_version 1386956 (0.0009) [2023-12-28 05:12:15,043][106225] Updated weights for policy 1, policy_version 1386966 (0.0009) [2023-12-28 05:12:15,447][106226] Updated weights for policy 0, policy_version 1383638 (0.0009) [2023-12-28 05:12:15,504][106226] Updated weights for policy 0, policy_version 1383648 (0.0009) [2023-12-28 05:12:15,564][106226] Updated weights for policy 0, policy_version 1383658 (0.0009) [2023-12-28 05:12:15,805][106225] Updated weights for policy 1, policy_version 1386976 (0.0008) [2023-12-28 05:12:15,872][106225] Updated weights for policy 1, policy_version 1386986 (0.0007) [2023-12-28 05:12:15,940][106225] Updated weights for policy 1, policy_version 1386996 (0.0008) [2023-12-28 05:12:16,170][106226] Updated weights for policy 0, policy_version 1383668 (0.0007) [2023-12-28 05:12:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 709410816. Throughput: 0: 9796.7, 1: 9919.1. Samples: 709401176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:16,176][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.692')] [2023-12-28 05:12:16,237][106226] Updated weights for policy 0, policy_version 1383678 (0.0005) [2023-12-28 05:12:16,297][106226] Updated weights for policy 0, policy_version 1383688 (0.0008) [2023-12-28 05:12:16,619][106225] Updated weights for policy 1, policy_version 1387006 (0.0008) [2023-12-28 05:12:16,671][106225] Updated weights for policy 1, policy_version 1387016 (0.0008) [2023-12-28 05:12:16,731][106225] Updated weights for policy 1, policy_version 1387026 (0.0008) [2023-12-28 05:12:16,976][106226] Updated weights for policy 0, policy_version 1383698 (0.0009) [2023-12-28 05:12:17,032][106226] Updated weights for policy 0, policy_version 1383708 (0.0010) [2023-12-28 05:12:17,075][106226] Updated weights for policy 0, policy_version 1383718 (0.0010) [2023-12-28 05:12:17,122][106226] Updated weights for policy 0, policy_version 1383728 (0.0011) [2023-12-28 05:12:17,432][106225] Updated weights for policy 1, policy_version 1387036 (0.0008) [2023-12-28 05:12:17,497][106225] Updated weights for policy 1, policy_version 1387046 (0.0008) [2023-12-28 05:12:17,560][106225] Updated weights for policy 1, policy_version 1387056 (0.0007) [2023-12-28 05:12:17,844][106226] Updated weights for policy 0, policy_version 1383738 (0.0010) [2023-12-28 05:12:17,907][106226] Updated weights for policy 0, policy_version 1383748 (0.0011) [2023-12-28 05:12:17,959][106226] Updated weights for policy 0, policy_version 1383758 (0.0008) [2023-12-28 05:12:18,209][106225] Updated weights for policy 1, policy_version 1387066 (0.0007) [2023-12-28 05:12:18,264][106225] Updated weights for policy 1, policy_version 1387076 (0.0006) [2023-12-28 05:12:18,321][106225] Updated weights for policy 1, policy_version 1387086 (0.0007) [2023-12-28 05:12:18,386][106225] Updated weights for policy 1, policy_version 1387096 (0.0008) [2023-12-28 05:12:18,633][106226] Updated weights for policy 0, policy_version 1383768 (0.0009) [2023-12-28 05:12:18,690][106226] Updated weights for policy 0, policy_version 1383778 (0.0009) [2023-12-28 05:12:18,749][106226] Updated weights for policy 0, policy_version 1383788 (0.0009) [2023-12-28 05:12:19,093][106225] Updated weights for policy 1, policy_version 1387106 (0.0008) [2023-12-28 05:12:19,147][106225] Updated weights for policy 1, policy_version 1387116 (0.0008) [2023-12-28 05:12:19,208][106225] Updated weights for policy 1, policy_version 1387126 (0.0008) [2023-12-28 05:12:19,505][106226] Updated weights for policy 0, policy_version 1383798 (0.0009) [2023-12-28 05:12:19,568][106226] Updated weights for policy 0, policy_version 1383808 (0.0006) [2023-12-28 05:12:19,636][106226] Updated weights for policy 0, policy_version 1383818 (0.0006) [2023-12-28 05:12:20,036][106225] Updated weights for policy 1, policy_version 1387136 (0.0009) [2023-12-28 05:12:20,096][106225] Updated weights for policy 1, policy_version 1387146 (0.0009) [2023-12-28 05:12:20,158][106225] Updated weights for policy 1, policy_version 1387156 (0.0009) [2023-12-28 05:12:20,333][106226] Updated weights for policy 0, policy_version 1383828 (0.0007) [2023-12-28 05:12:20,392][106226] Updated weights for policy 0, policy_version 1383838 (0.0009) [2023-12-28 05:12:20,455][106226] Updated weights for policy 0, policy_version 1383848 (0.0007) [2023-12-28 05:12:20,923][106225] Updated weights for policy 1, policy_version 1387166 (0.0007) [2023-12-28 05:12:20,982][106225] Updated weights for policy 1, policy_version 1387176 (0.0008) [2023-12-28 05:12:21,053][106225] Updated weights for policy 1, policy_version 1387186 (0.0008) [2023-12-28 05:12:21,126][106226] Updated weights for policy 0, policy_version 1383858 (0.0006) [2023-12-28 05:12:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 709509120. Throughput: 0: 9860.4, 1: 9828.1. Samples: 709519296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:21,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.884')] [2023-12-28 05:12:21,190][106226] Updated weights for policy 0, policy_version 1383868 (0.0008) [2023-12-28 05:12:21,258][106226] Updated weights for policy 0, policy_version 1383878 (0.0007) [2023-12-28 05:12:21,328][106226] Updated weights for policy 0, policy_version 1383888 (0.0007) [2023-12-28 05:12:21,857][106225] Updated weights for policy 1, policy_version 1387196 (0.0008) [2023-12-28 05:12:21,919][106225] Updated weights for policy 1, policy_version 1387206 (0.0008) [2023-12-28 05:12:21,987][106225] Updated weights for policy 1, policy_version 1387216 (0.0008) [2023-12-28 05:12:22,067][106226] Updated weights for policy 0, policy_version 1383898 (0.0009) [2023-12-28 05:12:22,138][106226] Updated weights for policy 0, policy_version 1383908 (0.0008) [2023-12-28 05:12:22,205][106226] Updated weights for policy 0, policy_version 1383918 (0.0009) [2023-12-28 05:12:22,750][106225] Updated weights for policy 1, policy_version 1387226 (0.0009) [2023-12-28 05:12:22,806][106225] Updated weights for policy 1, policy_version 1387236 (0.0009) [2023-12-28 05:12:22,870][106225] Updated weights for policy 1, policy_version 1387246 (0.0009) [2023-12-28 05:12:22,916][106226] Updated weights for policy 0, policy_version 1383928 (0.0007) [2023-12-28 05:12:22,930][106225] Updated weights for policy 1, policy_version 1387256 (0.0007) [2023-12-28 05:12:22,965][106226] Updated weights for policy 0, policy_version 1383938 (0.0006) [2023-12-28 05:12:23,014][106226] Updated weights for policy 0, policy_version 1383948 (0.0005) [2023-12-28 05:12:23,692][106226] Updated weights for policy 0, policy_version 1383958 (0.0008) [2023-12-28 05:12:23,694][106225] Updated weights for policy 1, policy_version 1387266 (0.0009) [2023-12-28 05:12:23,750][106226] Updated weights for policy 0, policy_version 1383968 (0.0006) [2023-12-28 05:12:23,752][106225] Updated weights for policy 1, policy_version 1387276 (0.0006) [2023-12-28 05:12:23,801][106226] Updated weights for policy 0, policy_version 1383978 (0.0008) [2023-12-28 05:12:23,811][106225] Updated weights for policy 1, policy_version 1387286 (0.0007) [2023-12-28 05:12:24,530][106225] Updated weights for policy 1, policy_version 1387296 (0.0008) [2023-12-28 05:12:24,577][106226] Updated weights for policy 0, policy_version 1383988 (0.0007) [2023-12-28 05:12:24,593][106225] Updated weights for policy 1, policy_version 1387306 (0.0008) [2023-12-28 05:12:24,638][106226] Updated weights for policy 0, policy_version 1383998 (0.0008) [2023-12-28 05:12:24,649][106225] Updated weights for policy 1, policy_version 1387316 (0.0007) [2023-12-28 05:12:24,699][106226] Updated weights for policy 0, policy_version 1384008 (0.0009) [2023-12-28 05:12:25,385][106225] Updated weights for policy 1, policy_version 1387326 (0.0007) [2023-12-28 05:12:25,411][106226] Updated weights for policy 0, policy_version 1384018 (0.0009) [2023-12-28 05:12:25,446][106225] Updated weights for policy 1, policy_version 1387336 (0.0006) [2023-12-28 05:12:25,465][106226] Updated weights for policy 0, policy_version 1384028 (0.0006) [2023-12-28 05:12:25,499][106225] Updated weights for policy 1, policy_version 1387346 (0.0008) [2023-12-28 05:12:25,514][106226] Updated weights for policy 0, policy_version 1384038 (0.0005) [2023-12-28 05:12:25,568][106226] Updated weights for policy 0, policy_version 1384048 (0.0008) [2023-12-28 05:12:26,111][106226] Updated weights for policy 0, policy_version 1384058 (0.0005) [2023-12-28 05:12:26,156][106226] Updated weights for policy 0, policy_version 1384068 (0.0006) [2023-12-28 05:12:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 709599232. Throughput: 0: 9771.1, 1: 9757.1. Samples: 709574836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:26,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-4.455')] [2023-12-28 05:12:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001387352_355213312.pth... [2023-12-28 05:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001386232_354926592.pth [2023-12-28 05:12:26,206][106226] Updated weights for policy 0, policy_version 1384078 (0.0009) [2023-12-28 05:12:26,217][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001384080_354394112.pth... [2023-12-28 05:12:26,221][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001382928_354099200.pth [2023-12-28 05:12:26,263][106225] Updated weights for policy 1, policy_version 1387356 (0.0007) [2023-12-28 05:12:26,320][106225] Updated weights for policy 1, policy_version 1387366 (0.0008) [2023-12-28 05:12:26,384][106225] Updated weights for policy 1, policy_version 1387376 (0.0008) [2023-12-28 05:12:26,912][106226] Updated weights for policy 0, policy_version 1384088 (0.0008) [2023-12-28 05:12:26,970][106226] Updated weights for policy 0, policy_version 1384098 (0.0008) [2023-12-28 05:12:27,029][106226] Updated weights for policy 0, policy_version 1384108 (0.0009) [2023-12-28 05:12:27,095][106225] Updated weights for policy 1, policy_version 1387386 (0.0009) [2023-12-28 05:12:27,149][106225] Updated weights for policy 1, policy_version 1387396 (0.0008) [2023-12-28 05:12:27,209][106225] Updated weights for policy 1, policy_version 1387406 (0.0008) [2023-12-28 05:12:27,263][106225] Updated weights for policy 1, policy_version 1387416 (0.0010) [2023-12-28 05:12:27,682][106226] Updated weights for policy 0, policy_version 1384118 (0.0009) [2023-12-28 05:12:27,747][106226] Updated weights for policy 0, policy_version 1384128 (0.0008) [2023-12-28 05:12:27,808][106226] Updated weights for policy 0, policy_version 1384138 (0.0007) [2023-12-28 05:12:27,946][106225] Updated weights for policy 1, policy_version 1387426 (0.0005) [2023-12-28 05:12:27,999][106225] Updated weights for policy 1, policy_version 1387436 (0.0005) [2023-12-28 05:12:28,051][106225] Updated weights for policy 1, policy_version 1387446 (0.0005) [2023-12-28 05:12:28,361][106226] Updated weights for policy 0, policy_version 1384148 (0.0006) [2023-12-28 05:12:28,422][106226] Updated weights for policy 0, policy_version 1384158 (0.0005) [2023-12-28 05:12:28,486][106226] Updated weights for policy 0, policy_version 1384168 (0.0006) [2023-12-28 05:12:28,658][106225] Updated weights for policy 1, policy_version 1387456 (0.0005) [2023-12-28 05:12:28,724][106225] Updated weights for policy 1, policy_version 1387466 (0.0009) [2023-12-28 05:12:28,787][106225] Updated weights for policy 1, policy_version 1387476 (0.0008) [2023-12-28 05:12:29,029][106226] Updated weights for policy 0, policy_version 1384178 (0.0006) [2023-12-28 05:12:29,085][106226] Updated weights for policy 0, policy_version 1384188 (0.0006) [2023-12-28 05:12:29,137][106226] Updated weights for policy 0, policy_version 1384198 (0.0008) [2023-12-28 05:12:29,190][106226] Updated weights for policy 0, policy_version 1384208 (0.0008) [2023-12-28 05:12:29,435][106225] Updated weights for policy 1, policy_version 1387486 (0.0007) [2023-12-28 05:12:29,500][106225] Updated weights for policy 1, policy_version 1387496 (0.0006) [2023-12-28 05:12:29,563][106225] Updated weights for policy 1, policy_version 1387506 (0.0008) [2023-12-28 05:12:29,886][106226] Updated weights for policy 0, policy_version 1384218 (0.0008) [2023-12-28 05:12:29,963][106226] Updated weights for policy 0, policy_version 1384228 (0.0008) [2023-12-28 05:12:30,027][106226] Updated weights for policy 0, policy_version 1384238 (0.0011) [2023-12-28 05:12:30,251][106225] Updated weights for policy 1, policy_version 1387516 (0.0008) [2023-12-28 05:12:30,317][106225] Updated weights for policy 1, policy_version 1387526 (0.0008) [2023-12-28 05:12:30,381][106225] Updated weights for policy 1, policy_version 1387536 (0.0006) [2023-12-28 05:12:30,722][106226] Updated weights for policy 0, policy_version 1384248 (0.0006) [2023-12-28 05:12:30,774][106226] Updated weights for policy 0, policy_version 1384258 (0.0006) [2023-12-28 05:12:30,832][106226] Updated weights for policy 0, policy_version 1384268 (0.0006) [2023-12-28 05:12:31,128][106225] Updated weights for policy 1, policy_version 1387546 (0.0008) [2023-12-28 05:12:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 709705728. Throughput: 0: 9906.3, 1: 9723.0. Samples: 709697948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:31,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-4.629')] [2023-12-28 05:12:31,189][106225] Updated weights for policy 1, policy_version 1387556 (0.0008) [2023-12-28 05:12:31,238][106225] Updated weights for policy 1, policy_version 1387566 (0.0007) [2023-12-28 05:12:31,297][106225] Updated weights for policy 1, policy_version 1387576 (0.0009) [2023-12-28 05:12:31,556][106226] Updated weights for policy 0, policy_version 1384278 (0.0008) [2023-12-28 05:12:31,619][106226] Updated weights for policy 0, policy_version 1384288 (0.0011) [2023-12-28 05:12:31,683][106226] Updated weights for policy 0, policy_version 1384298 (0.0011) [2023-12-28 05:12:32,041][106225] Updated weights for policy 1, policy_version 1387586 (0.0005) [2023-12-28 05:12:32,099][106225] Updated weights for policy 1, policy_version 1387596 (0.0006) [2023-12-28 05:12:32,155][106225] Updated weights for policy 1, policy_version 1387606 (0.0006) [2023-12-28 05:12:32,384][106226] Updated weights for policy 0, policy_version 1384308 (0.0011) [2023-12-28 05:12:32,443][106226] Updated weights for policy 0, policy_version 1384318 (0.0010) [2023-12-28 05:12:32,497][106226] Updated weights for policy 0, policy_version 1384328 (0.0011) [2023-12-28 05:12:32,821][106225] Updated weights for policy 1, policy_version 1387616 (0.0007) [2023-12-28 05:12:32,868][106225] Updated weights for policy 1, policy_version 1387626 (0.0007) [2023-12-28 05:12:32,916][106225] Updated weights for policy 1, policy_version 1387636 (0.0007) [2023-12-28 05:12:33,202][106226] Updated weights for policy 0, policy_version 1384338 (0.0009) [2023-12-28 05:12:33,257][106226] Updated weights for policy 0, policy_version 1384348 (0.0008) [2023-12-28 05:12:33,310][106226] Updated weights for policy 0, policy_version 1384358 (0.0010) [2023-12-28 05:12:33,359][106226] Updated weights for policy 0, policy_version 1384368 (0.0010) [2023-12-28 05:12:33,595][106225] Updated weights for policy 1, policy_version 1387646 (0.0008) [2023-12-28 05:12:33,650][106225] Updated weights for policy 1, policy_version 1387656 (0.0010) [2023-12-28 05:12:33,707][106225] Updated weights for policy 1, policy_version 1387666 (0.0010) [2023-12-28 05:12:34,035][106226] Updated weights for policy 0, policy_version 1384378 (0.0006) [2023-12-28 05:12:34,091][106226] Updated weights for policy 0, policy_version 1384388 (0.0006) [2023-12-28 05:12:34,146][106226] Updated weights for policy 0, policy_version 1384398 (0.0006) [2023-12-28 05:12:34,369][106225] Updated weights for policy 1, policy_version 1387676 (0.0010) [2023-12-28 05:12:34,434][106225] Updated weights for policy 1, policy_version 1387686 (0.0007) [2023-12-28 05:12:34,496][106225] Updated weights for policy 1, policy_version 1387696 (0.0010) [2023-12-28 05:12:34,863][106226] Updated weights for policy 0, policy_version 1384409 (0.0010) [2023-12-28 05:12:34,913][106226] Updated weights for policy 0, policy_version 1384419 (0.0010) [2023-12-28 05:12:34,958][106226] Updated weights for policy 0, policy_version 1384429 (0.0010) [2023-12-28 05:12:35,115][106225] Updated weights for policy 1, policy_version 1387706 (0.0009) [2023-12-28 05:12:35,178][106225] Updated weights for policy 1, policy_version 1387716 (0.0005) [2023-12-28 05:12:35,225][106225] Updated weights for policy 1, policy_version 1387726 (0.0007) [2023-12-28 05:12:35,277][106225] Updated weights for policy 1, policy_version 1387736 (0.0010) [2023-12-28 05:12:35,617][106226] Updated weights for policy 0, policy_version 1384439 (0.0009) [2023-12-28 05:12:35,674][106226] Updated weights for policy 0, policy_version 1384449 (0.0010) [2023-12-28 05:12:35,726][106226] Updated weights for policy 0, policy_version 1384459 (0.0010) [2023-12-28 05:12:35,897][106225] Updated weights for policy 1, policy_version 1387746 (0.0010) [2023-12-28 05:12:35,947][106225] Updated weights for policy 1, policy_version 1387756 (0.0010) [2023-12-28 05:12:36,004][106225] Updated weights for policy 1, policy_version 1387766 (0.0010) [2023-12-28 05:12:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 709812224. Throughput: 0: 9894.4, 1: 9816.4. Samples: 709819840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:36,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.617')] [2023-12-28 05:12:36,426][106226] Updated weights for policy 0, policy_version 1384469 (0.0009) [2023-12-28 05:12:36,490][106226] Updated weights for policy 0, policy_version 1384479 (0.0009) [2023-12-28 05:12:36,553][106226] Updated weights for policy 0, policy_version 1384489 (0.0009) [2023-12-28 05:12:36,753][106225] Updated weights for policy 1, policy_version 1387776 (0.0010) [2023-12-28 05:12:36,820][106225] Updated weights for policy 1, policy_version 1387786 (0.0010) [2023-12-28 05:12:36,882][106225] Updated weights for policy 1, policy_version 1387796 (0.0010) [2023-12-28 05:12:37,182][106226] Updated weights for policy 0, policy_version 1384499 (0.0008) [2023-12-28 05:12:37,244][106226] Updated weights for policy 0, policy_version 1384509 (0.0005) [2023-12-28 05:12:37,298][106226] Updated weights for policy 0, policy_version 1384519 (0.0005) [2023-12-28 05:12:37,600][106225] Updated weights for policy 1, policy_version 1387806 (0.0008) [2023-12-28 05:12:37,665][106225] Updated weights for policy 1, policy_version 1387816 (0.0006) [2023-12-28 05:12:37,729][106225] Updated weights for policy 1, policy_version 1387826 (0.0006) [2023-12-28 05:12:37,925][106226] Updated weights for policy 0, policy_version 1384529 (0.0006) [2023-12-28 05:12:37,989][106226] Updated weights for policy 0, policy_version 1384539 (0.0009) [2023-12-28 05:12:38,057][106226] Updated weights for policy 0, policy_version 1384549 (0.0006) [2023-12-28 05:12:38,117][106226] Updated weights for policy 0, policy_version 1384559 (0.0008) [2023-12-28 05:12:38,258][106225] Updated weights for policy 1, policy_version 1387836 (0.0006) [2023-12-28 05:12:38,309][106225] Updated weights for policy 1, policy_version 1387846 (0.0008) [2023-12-28 05:12:38,369][106225] Updated weights for policy 1, policy_version 1387856 (0.0008) [2023-12-28 05:12:38,719][106226] Updated weights for policy 0, policy_version 1384569 (0.0008) [2023-12-28 05:12:38,765][106226] Updated weights for policy 0, policy_version 1384579 (0.0007) [2023-12-28 05:12:38,820][106226] Updated weights for policy 0, policy_version 1384589 (0.0008) [2023-12-28 05:12:39,104][106225] Updated weights for policy 1, policy_version 1387866 (0.0008) [2023-12-28 05:12:39,169][106225] Updated weights for policy 1, policy_version 1387876 (0.0005) [2023-12-28 05:12:39,234][106225] Updated weights for policy 1, policy_version 1387886 (0.0006) [2023-12-28 05:12:39,295][106225] Updated weights for policy 1, policy_version 1387896 (0.0008) [2023-12-28 05:12:39,612][106226] Updated weights for policy 0, policy_version 1384599 (0.0010) [2023-12-28 05:12:39,678][106226] Updated weights for policy 0, policy_version 1384609 (0.0011) [2023-12-28 05:12:39,735][106226] Updated weights for policy 0, policy_version 1384619 (0.0009) [2023-12-28 05:12:40,099][106225] Updated weights for policy 1, policy_version 1387906 (0.0008) [2023-12-28 05:12:40,155][106225] Updated weights for policy 1, policy_version 1387916 (0.0008) [2023-12-28 05:12:40,214][106225] Updated weights for policy 1, policy_version 1387926 (0.0008) [2023-12-28 05:12:40,450][106226] Updated weights for policy 0, policy_version 1384629 (0.0007) [2023-12-28 05:12:40,512][106226] Updated weights for policy 0, policy_version 1384639 (0.0006) [2023-12-28 05:12:40,573][106226] Updated weights for policy 0, policy_version 1384649 (0.0005) [2023-12-28 05:12:40,965][106225] Updated weights for policy 1, policy_version 1387936 (0.0010) [2023-12-28 05:12:41,025][106225] Updated weights for policy 1, policy_version 1387946 (0.0010) [2023-12-28 05:12:41,098][106225] Updated weights for policy 1, policy_version 1387956 (0.0009) [2023-12-28 05:12:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 709910528. Throughput: 0: 9944.4, 1: 9813.0. Samples: 709881148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:41,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-4.719')] [2023-12-28 05:12:41,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001387960_355368960.pth... [2023-12-28 05:12:41,187][106226] Updated weights for policy 0, policy_version 1384659 (0.0006) [2023-12-28 05:12:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001386808_355074048.pth [2023-12-28 05:12:41,256][106226] Updated weights for policy 0, policy_version 1384669 (0.0008) [2023-12-28 05:12:41,319][106226] Updated weights for policy 0, policy_version 1384679 (0.0006) [2023-12-28 05:12:41,386][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001384688_354549760.pth... [2023-12-28 05:12:41,391][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001383472_354238464.pth [2023-12-28 05:12:41,902][106225] Updated weights for policy 1, policy_version 1387966 (0.0009) [2023-12-28 05:12:41,961][106225] Updated weights for policy 1, policy_version 1387976 (0.0010) [2023-12-28 05:12:41,969][106226] Updated weights for policy 0, policy_version 1384689 (0.0009) [2023-12-28 05:12:42,021][106226] Updated weights for policy 0, policy_version 1384699 (0.0006) [2023-12-28 05:12:42,029][106225] Updated weights for policy 1, policy_version 1387986 (0.0010) [2023-12-28 05:12:42,073][106226] Updated weights for policy 0, policy_version 1384709 (0.0006) [2023-12-28 05:12:42,134][106226] Updated weights for policy 0, policy_version 1384719 (0.0006) [2023-12-28 05:12:42,796][106225] Updated weights for policy 1, policy_version 1387996 (0.0008) [2023-12-28 05:12:42,806][106226] Updated weights for policy 0, policy_version 1384729 (0.0007) [2023-12-28 05:12:42,857][106225] Updated weights for policy 1, policy_version 1388006 (0.0008) [2023-12-28 05:12:42,863][106226] Updated weights for policy 0, policy_version 1384739 (0.0005) [2023-12-28 05:12:42,908][106225] Updated weights for policy 1, policy_version 1388016 (0.0008) [2023-12-28 05:12:42,920][106226] Updated weights for policy 0, policy_version 1384749 (0.0005) [2023-12-28 05:12:43,563][106226] Updated weights for policy 0, policy_version 1384759 (0.0007) [2023-12-28 05:12:43,565][106225] Updated weights for policy 1, policy_version 1388026 (0.0007) [2023-12-28 05:12:43,613][106226] Updated weights for policy 0, policy_version 1384769 (0.0005) [2023-12-28 05:12:43,615][106225] Updated weights for policy 1, policy_version 1388036 (0.0007) [2023-12-28 05:12:43,664][106226] Updated weights for policy 0, policy_version 1384779 (0.0008) [2023-12-28 05:12:43,667][106225] Updated weights for policy 1, policy_version 1388046 (0.0006) [2023-12-28 05:12:43,720][106225] Updated weights for policy 1, policy_version 1388056 (0.0005) [2023-12-28 05:12:44,281][106226] Updated weights for policy 0, policy_version 1384789 (0.0007) [2023-12-28 05:12:44,331][106226] Updated weights for policy 0, policy_version 1384799 (0.0005) [2023-12-28 05:12:44,338][106225] Updated weights for policy 1, policy_version 1388066 (0.0008) [2023-12-28 05:12:44,386][106226] Updated weights for policy 0, policy_version 1384809 (0.0007) [2023-12-28 05:12:44,400][106225] Updated weights for policy 1, policy_version 1388076 (0.0007) [2023-12-28 05:12:44,453][106225] Updated weights for policy 1, policy_version 1388086 (0.0007) [2023-12-28 05:12:45,053][106226] Updated weights for policy 0, policy_version 1384819 (0.0009) [2023-12-28 05:12:45,116][106226] Updated weights for policy 0, policy_version 1384829 (0.0009) [2023-12-28 05:12:45,188][106226] Updated weights for policy 0, policy_version 1384839 (0.0007) [2023-12-28 05:12:45,190][106225] Updated weights for policy 1, policy_version 1388096 (0.0007) [2023-12-28 05:12:45,250][106225] Updated weights for policy 1, policy_version 1388106 (0.0008) [2023-12-28 05:12:45,311][106225] Updated weights for policy 1, policy_version 1388116 (0.0008) [2023-12-28 05:12:45,779][106226] Updated weights for policy 0, policy_version 1384849 (0.0008) [2023-12-28 05:12:45,834][106226] Updated weights for policy 0, policy_version 1384859 (0.0005) [2023-12-28 05:12:45,887][106226] Updated weights for policy 0, policy_version 1384869 (0.0005) [2023-12-28 05:12:45,940][106226] Updated weights for policy 0, policy_version 1384879 (0.0009) [2023-12-28 05:12:46,121][106225] Updated weights for policy 1, policy_version 1388126 (0.0009) [2023-12-28 05:12:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 710008832. Throughput: 0: 10053.2, 1: 9731.9. Samples: 710001120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:46,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.752')] [2023-12-28 05:12:46,182][106225] Updated weights for policy 1, policy_version 1388136 (0.0008) [2023-12-28 05:12:46,236][106225] Updated weights for policy 1, policy_version 1388146 (0.0008) [2023-12-28 05:12:46,614][106226] Updated weights for policy 0, policy_version 1384889 (0.0010) [2023-12-28 05:12:46,668][106226] Updated weights for policy 0, policy_version 1384899 (0.0010) [2023-12-28 05:12:46,728][106226] Updated weights for policy 0, policy_version 1384909 (0.0011) [2023-12-28 05:12:46,973][106225] Updated weights for policy 1, policy_version 1388156 (0.0008) [2023-12-28 05:12:47,024][106225] Updated weights for policy 1, policy_version 1388166 (0.0007) [2023-12-28 05:12:47,081][106225] Updated weights for policy 1, policy_version 1388176 (0.0008) [2023-12-28 05:12:47,433][106226] Updated weights for policy 0, policy_version 1384919 (0.0010) [2023-12-28 05:12:47,479][106226] Updated weights for policy 0, policy_version 1384929 (0.0010) [2023-12-28 05:12:47,531][106226] Updated weights for policy 0, policy_version 1384939 (0.0010) [2023-12-28 05:12:47,834][106225] Updated weights for policy 1, policy_version 1388186 (0.0008) [2023-12-28 05:12:47,885][106225] Updated weights for policy 1, policy_version 1388196 (0.0007) [2023-12-28 05:12:47,937][106225] Updated weights for policy 1, policy_version 1388206 (0.0009) [2023-12-28 05:12:47,987][106225] Updated weights for policy 1, policy_version 1388216 (0.0009) [2023-12-28 05:12:48,189][106226] Updated weights for policy 0, policy_version 1384949 (0.0008) [2023-12-28 05:12:48,242][106226] Updated weights for policy 0, policy_version 1384959 (0.0006) [2023-12-28 05:12:48,296][106226] Updated weights for policy 0, policy_version 1384969 (0.0007) [2023-12-28 05:12:48,857][106226] Updated weights for policy 0, policy_version 1384979 (0.0007) [2023-12-28 05:12:48,859][106225] Updated weights for policy 1, policy_version 1388226 (0.0008) [2023-12-28 05:12:48,919][106226] Updated weights for policy 0, policy_version 1384989 (0.0006) [2023-12-28 05:12:48,920][106225] Updated weights for policy 1, policy_version 1388236 (0.0007) [2023-12-28 05:12:48,972][106225] Updated weights for policy 1, policy_version 1388246 (0.0006) [2023-12-28 05:12:48,974][106226] Updated weights for policy 0, policy_version 1384999 (0.0006) [2023-12-28 05:12:49,669][106226] Updated weights for policy 0, policy_version 1385009 (0.0007) [2023-12-28 05:12:49,736][106226] Updated weights for policy 0, policy_version 1385019 (0.0006) [2023-12-28 05:12:49,760][106225] Updated weights for policy 1, policy_version 1388256 (0.0009) [2023-12-28 05:12:49,801][106226] Updated weights for policy 0, policy_version 1385029 (0.0008) [2023-12-28 05:12:49,817][106225] Updated weights for policy 1, policy_version 1388266 (0.0007) [2023-12-28 05:12:49,868][106226] Updated weights for policy 0, policy_version 1385039 (0.0007) [2023-12-28 05:12:49,881][106225] Updated weights for policy 1, policy_version 1388276 (0.0008) [2023-12-28 05:12:50,604][106226] Updated weights for policy 0, policy_version 1385049 (0.0010) [2023-12-28 05:12:50,627][106225] Updated weights for policy 1, policy_version 1388286 (0.0007) [2023-12-28 05:12:50,666][106226] Updated weights for policy 0, policy_version 1385059 (0.0008) [2023-12-28 05:12:50,689][106225] Updated weights for policy 1, policy_version 1388296 (0.0006) [2023-12-28 05:12:50,719][106226] Updated weights for policy 0, policy_version 1385069 (0.0007) [2023-12-28 05:12:50,752][106225] Updated weights for policy 1, policy_version 1388306 (0.0006) [2023-12-28 05:12:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 710107136. Throughput: 0: 10124.0, 1: 9657.9. Samples: 710117072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.682')] [2023-12-28 05:12:51,418][106226] Updated weights for policy 0, policy_version 1385079 (0.0008) [2023-12-28 05:12:51,491][106226] Updated weights for policy 0, policy_version 1385089 (0.0009) [2023-12-28 05:12:51,523][106225] Updated weights for policy 1, policy_version 1388316 (0.0009) [2023-12-28 05:12:51,550][106226] Updated weights for policy 0, policy_version 1385099 (0.0006) [2023-12-28 05:12:51,592][106225] Updated weights for policy 1, policy_version 1388326 (0.0009) [2023-12-28 05:12:51,675][106225] Updated weights for policy 1, policy_version 1388337 (0.0008) [2023-12-28 05:12:52,243][106226] Updated weights for policy 0, policy_version 1385109 (0.0007) [2023-12-28 05:12:52,320][106226] Updated weights for policy 0, policy_version 1385119 (0.0008) [2023-12-28 05:12:52,387][106226] Updated weights for policy 0, policy_version 1385129 (0.0010) [2023-12-28 05:12:52,445][106225] Updated weights for policy 1, policy_version 1388347 (0.0008) [2023-12-28 05:12:52,493][106225] Updated weights for policy 1, policy_version 1388357 (0.0009) [2023-12-28 05:12:52,553][106225] Updated weights for policy 1, policy_version 1388367 (0.0008) [2023-12-28 05:12:53,103][106226] Updated weights for policy 0, policy_version 1385139 (0.0008) [2023-12-28 05:12:53,162][106226] Updated weights for policy 0, policy_version 1385149 (0.0008) [2023-12-28 05:12:53,220][106226] Updated weights for policy 0, policy_version 1385159 (0.0008) [2023-12-28 05:12:53,222][106225] Updated weights for policy 1, policy_version 1388377 (0.0008) [2023-12-28 05:12:53,278][106225] Updated weights for policy 1, policy_version 1388387 (0.0007) [2023-12-28 05:12:53,337][106225] Updated weights for policy 1, policy_version 1388397 (0.0009) [2023-12-28 05:12:53,392][106225] Updated weights for policy 1, policy_version 1388407 (0.0008) [2023-12-28 05:12:53,934][106226] Updated weights for policy 0, policy_version 1385169 (0.0006) [2023-12-28 05:12:53,992][106226] Updated weights for policy 0, policy_version 1385179 (0.0007) [2023-12-28 05:12:54,040][106226] Updated weights for policy 0, policy_version 1385189 (0.0010) [2023-12-28 05:12:54,080][106225] Updated weights for policy 1, policy_version 1388417 (0.0010) [2023-12-28 05:12:54,092][106226] Updated weights for policy 0, policy_version 1385199 (0.0010) [2023-12-28 05:12:54,136][106225] Updated weights for policy 1, policy_version 1388427 (0.0006) [2023-12-28 05:12:54,198][106225] Updated weights for policy 1, policy_version 1388437 (0.0006) [2023-12-28 05:12:54,677][106226] Updated weights for policy 0, policy_version 1385209 (0.0009) [2023-12-28 05:12:54,743][106226] Updated weights for policy 0, policy_version 1385219 (0.0009) [2023-12-28 05:12:54,776][106225] Updated weights for policy 1, policy_version 1388447 (0.0009) [2023-12-28 05:12:54,804][106226] Updated weights for policy 0, policy_version 1385229 (0.0007) [2023-12-28 05:12:54,839][106225] Updated weights for policy 1, policy_version 1388457 (0.0010) [2023-12-28 05:12:54,896][106225] Updated weights for policy 1, policy_version 1388467 (0.0010) [2023-12-28 05:12:55,566][106226] Updated weights for policy 0, policy_version 1385239 (0.0008) [2023-12-28 05:12:55,614][106225] Updated weights for policy 1, policy_version 1388477 (0.0008) [2023-12-28 05:12:55,619][106226] Updated weights for policy 0, policy_version 1385249 (0.0007) [2023-12-28 05:12:55,662][106225] Updated weights for policy 1, policy_version 1388487 (0.0010) [2023-12-28 05:12:55,683][106226] Updated weights for policy 0, policy_version 1385259 (0.0007) [2023-12-28 05:12:55,719][106225] Updated weights for policy 1, policy_version 1388497 (0.0010) [2023-12-28 05:12:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 710205440. Throughput: 0: 10114.6, 1: 9645.1. Samples: 710173804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:12:56,175][105115] Avg episode reward: [(0, '-4.229'), (1, '-4.563')] [2023-12-28 05:12:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001388504_355508224.pth... [2023-12-28 05:12:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001385264_354697216.pth... [2023-12-28 05:12:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001387352_355213312.pth [2023-12-28 05:12:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001384080_354394112.pth [2023-12-28 05:12:56,410][106225] Updated weights for policy 1, policy_version 1388507 (0.0009) [2023-12-28 05:12:56,428][106226] Updated weights for policy 0, policy_version 1385269 (0.0006) [2023-12-28 05:12:56,463][106225] Updated weights for policy 1, policy_version 1388517 (0.0006) [2023-12-28 05:12:56,487][106226] Updated weights for policy 0, policy_version 1385279 (0.0007) [2023-12-28 05:12:56,513][106225] Updated weights for policy 1, policy_version 1388527 (0.0006) [2023-12-28 05:12:56,546][106226] Updated weights for policy 0, policy_version 1385289 (0.0008) [2023-12-28 05:12:57,047][106225] Updated weights for policy 1, policy_version 1388537 (0.0005) [2023-12-28 05:12:57,100][106225] Updated weights for policy 1, policy_version 1388547 (0.0008) [2023-12-28 05:12:57,148][106225] Updated weights for policy 1, policy_version 1388557 (0.0005) [2023-12-28 05:12:57,192][106225] Updated weights for policy 1, policy_version 1388567 (0.0005) [2023-12-28 05:12:57,348][106226] Updated weights for policy 0, policy_version 1385299 (0.0009) [2023-12-28 05:12:57,408][106226] Updated weights for policy 0, policy_version 1385309 (0.0010) [2023-12-28 05:12:57,462][106226] Updated weights for policy 0, policy_version 1385319 (0.0008) [2023-12-28 05:12:57,825][106225] Updated weights for policy 1, policy_version 1388577 (0.0008) [2023-12-28 05:12:57,883][106225] Updated weights for policy 1, policy_version 1388587 (0.0008) [2023-12-28 05:12:57,938][106225] Updated weights for policy 1, policy_version 1388597 (0.0006) [2023-12-28 05:12:58,207][106226] Updated weights for policy 0, policy_version 1385329 (0.0008) [2023-12-28 05:12:58,274][106226] Updated weights for policy 0, policy_version 1385339 (0.0008) [2023-12-28 05:12:58,342][106226] Updated weights for policy 0, policy_version 1385349 (0.0009) [2023-12-28 05:12:58,411][106226] Updated weights for policy 0, policy_version 1385359 (0.0008) [2023-12-28 05:12:58,664][106225] Updated weights for policy 1, policy_version 1388607 (0.0008) [2023-12-28 05:12:58,725][106225] Updated weights for policy 1, policy_version 1388617 (0.0009) [2023-12-28 05:12:58,791][106225] Updated weights for policy 1, policy_version 1388627 (0.0010) [2023-12-28 05:12:59,241][106226] Updated weights for policy 0, policy_version 1385369 (0.0008) [2023-12-28 05:12:59,318][106226] Updated weights for policy 0, policy_version 1385379 (0.0007) [2023-12-28 05:12:59,392][106226] Updated weights for policy 0, policy_version 1385389 (0.0008) [2023-12-28 05:12:59,626][106225] Updated weights for policy 1, policy_version 1388637 (0.0009) [2023-12-28 05:12:59,683][106225] Updated weights for policy 1, policy_version 1388647 (0.0007) [2023-12-28 05:12:59,744][106225] Updated weights for policy 1, policy_version 1388657 (0.0007) [2023-12-28 05:13:00,096][106226] Updated weights for policy 0, policy_version 1385399 (0.0008) [2023-12-28 05:13:00,149][106226] Updated weights for policy 0, policy_version 1385409 (0.0008) [2023-12-28 05:13:00,203][106226] Updated weights for policy 0, policy_version 1385419 (0.0008) [2023-12-28 05:13:00,499][106225] Updated weights for policy 1, policy_version 1388667 (0.0009) [2023-12-28 05:13:00,550][106225] Updated weights for policy 1, policy_version 1388677 (0.0010) [2023-12-28 05:13:00,607][106225] Updated weights for policy 1, policy_version 1388687 (0.0010) [2023-12-28 05:13:00,964][106226] Updated weights for policy 0, policy_version 1385429 (0.0008) [2023-12-28 05:13:01,020][106226] Updated weights for policy 0, policy_version 1385439 (0.0008) [2023-12-28 05:13:01,089][106226] Updated weights for policy 0, policy_version 1385449 (0.0007) [2023-12-28 05:13:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 710303744. Throughput: 0: 10082.2, 1: 9708.1. Samples: 710291736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:01,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-4.537')] [2023-12-28 05:13:01,357][106225] Updated weights for policy 1, policy_version 1388697 (0.0010) [2023-12-28 05:13:01,426][106225] Updated weights for policy 1, policy_version 1388707 (0.0007) [2023-12-28 05:13:01,494][106225] Updated weights for policy 1, policy_version 1388717 (0.0006) [2023-12-28 05:13:01,556][106225] Updated weights for policy 1, policy_version 1388727 (0.0007) [2023-12-28 05:13:01,891][106226] Updated weights for policy 0, policy_version 1385459 (0.0008) [2023-12-28 05:13:01,945][106226] Updated weights for policy 0, policy_version 1385469 (0.0007) [2023-12-28 05:13:01,999][106226] Updated weights for policy 0, policy_version 1385479 (0.0008) [2023-12-28 05:13:02,250][106225] Updated weights for policy 1, policy_version 1388737 (0.0009) [2023-12-28 05:13:02,314][106225] Updated weights for policy 1, policy_version 1388747 (0.0009) [2023-12-28 05:13:02,373][106225] Updated weights for policy 1, policy_version 1388757 (0.0008) [2023-12-28 05:13:02,750][106226] Updated weights for policy 0, policy_version 1385489 (0.0007) [2023-12-28 05:13:02,804][106226] Updated weights for policy 0, policy_version 1385499 (0.0008) [2023-12-28 05:13:02,870][106226] Updated weights for policy 0, policy_version 1385509 (0.0008) [2023-12-28 05:13:02,933][106226] Updated weights for policy 0, policy_version 1385519 (0.0008) [2023-12-28 05:13:03,102][106225] Updated weights for policy 1, policy_version 1388767 (0.0007) [2023-12-28 05:13:03,160][106225] Updated weights for policy 1, policy_version 1388777 (0.0009) [2023-12-28 05:13:03,217][106225] Updated weights for policy 1, policy_version 1388787 (0.0008) [2023-12-28 05:13:03,650][106226] Updated weights for policy 0, policy_version 1385529 (0.0008) [2023-12-28 05:13:03,711][106226] Updated weights for policy 0, policy_version 1385539 (0.0009) [2023-12-28 05:13:03,768][106226] Updated weights for policy 0, policy_version 1385549 (0.0008) [2023-12-28 05:13:03,896][106225] Updated weights for policy 1, policy_version 1388797 (0.0008) [2023-12-28 05:13:03,956][106225] Updated weights for policy 1, policy_version 1388807 (0.0009) [2023-12-28 05:13:04,013][106225] Updated weights for policy 1, policy_version 1388817 (0.0008) [2023-12-28 05:13:04,464][106226] Updated weights for policy 0, policy_version 1385559 (0.0010) [2023-12-28 05:13:04,519][106226] Updated weights for policy 0, policy_version 1385569 (0.0011) [2023-12-28 05:13:04,574][106226] Updated weights for policy 0, policy_version 1385579 (0.0011) [2023-12-28 05:13:04,774][106225] Updated weights for policy 1, policy_version 1388827 (0.0008) [2023-12-28 05:13:04,831][106225] Updated weights for policy 1, policy_version 1388837 (0.0008) [2023-12-28 05:13:04,878][106225] Updated weights for policy 1, policy_version 1388847 (0.0007) [2023-12-28 05:13:05,274][106226] Updated weights for policy 0, policy_version 1385589 (0.0011) [2023-12-28 05:13:05,321][106226] Updated weights for policy 0, policy_version 1385599 (0.0005) [2023-12-28 05:13:05,378][106226] Updated weights for policy 0, policy_version 1385609 (0.0009) [2023-12-28 05:13:05,645][106225] Updated weights for policy 1, policy_version 1388857 (0.0008) [2023-12-28 05:13:05,699][106225] Updated weights for policy 1, policy_version 1388867 (0.0008) [2023-12-28 05:13:05,750][106225] Updated weights for policy 1, policy_version 1388877 (0.0008) [2023-12-28 05:13:05,813][106225] Updated weights for policy 1, policy_version 1388887 (0.0008) [2023-12-28 05:13:06,048][106226] Updated weights for policy 0, policy_version 1385619 (0.0010) [2023-12-28 05:13:06,107][106226] Updated weights for policy 0, policy_version 1385629 (0.0010) [2023-12-28 05:13:06,172][106226] Updated weights for policy 0, policy_version 1385639 (0.0009) [2023-12-28 05:13:06,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 710393856. Throughput: 0: 10023.3, 1: 9701.3. Samples: 710406904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:06,179][105115] Avg episode reward: [(0, '-4.400'), (1, '-4.685')] [2023-12-28 05:13:06,630][106225] Updated weights for policy 1, policy_version 1388897 (0.0008) [2023-12-28 05:13:06,682][106225] Updated weights for policy 1, policy_version 1388907 (0.0009) [2023-12-28 05:13:06,740][106225] Updated weights for policy 1, policy_version 1388917 (0.0009) [2023-12-28 05:13:06,830][106226] Updated weights for policy 0, policy_version 1385649 (0.0007) [2023-12-28 05:13:06,876][106226] Updated weights for policy 0, policy_version 1385659 (0.0008) [2023-12-28 05:13:06,931][106226] Updated weights for policy 0, policy_version 1385669 (0.0008) [2023-12-28 05:13:06,983][106226] Updated weights for policy 0, policy_version 1385679 (0.0006) [2023-12-28 05:13:07,557][106225] Updated weights for policy 1, policy_version 1388927 (0.0010) [2023-12-28 05:13:07,604][106226] Updated weights for policy 0, policy_version 1385689 (0.0006) [2023-12-28 05:13:07,607][106225] Updated weights for policy 1, policy_version 1388937 (0.0010) [2023-12-28 05:13:07,654][106225] Updated weights for policy 1, policy_version 1388947 (0.0010) [2023-12-28 05:13:07,656][106226] Updated weights for policy 0, policy_version 1385699 (0.0006) [2023-12-28 05:13:07,713][106226] Updated weights for policy 0, policy_version 1385709 (0.0007) [2023-12-28 05:13:08,305][106226] Updated weights for policy 0, policy_version 1385719 (0.0006) [2023-12-28 05:13:08,356][106225] Updated weights for policy 1, policy_version 1388957 (0.0009) [2023-12-28 05:13:08,370][106226] Updated weights for policy 0, policy_version 1385729 (0.0008) [2023-12-28 05:13:08,414][106225] Updated weights for policy 1, policy_version 1388967 (0.0008) [2023-12-28 05:13:08,432][106226] Updated weights for policy 0, policy_version 1385739 (0.0010) [2023-12-28 05:13:08,473][106225] Updated weights for policy 1, policy_version 1388977 (0.0008) [2023-12-28 05:13:09,083][106225] Updated weights for policy 1, policy_version 1388987 (0.0009) [2023-12-28 05:13:09,099][106226] Updated weights for policy 0, policy_version 1385749 (0.0006) [2023-12-28 05:13:09,145][106225] Updated weights for policy 1, policy_version 1388997 (0.0006) [2023-12-28 05:13:09,153][106226] Updated weights for policy 0, policy_version 1385759 (0.0005) [2023-12-28 05:13:09,208][106225] Updated weights for policy 1, policy_version 1389007 (0.0005) [2023-12-28 05:13:09,224][106226] Updated weights for policy 0, policy_version 1385769 (0.0007) [2023-12-28 05:13:09,896][106226] Updated weights for policy 0, policy_version 1385779 (0.0009) [2023-12-28 05:13:09,959][106226] Updated weights for policy 0, policy_version 1385789 (0.0010) [2023-12-28 05:13:10,016][106225] Updated weights for policy 1, policy_version 1389017 (0.0007) [2023-12-28 05:13:10,017][106226] Updated weights for policy 0, policy_version 1385799 (0.0010) [2023-12-28 05:13:10,076][106225] Updated weights for policy 1, policy_version 1389027 (0.0008) [2023-12-28 05:13:10,140][106225] Updated weights for policy 1, policy_version 1389037 (0.0008) [2023-12-28 05:13:10,207][106225] Updated weights for policy 1, policy_version 1389047 (0.0008) [2023-12-28 05:13:10,758][106226] Updated weights for policy 0, policy_version 1385809 (0.0011) [2023-12-28 05:13:10,808][106226] Updated weights for policy 0, policy_version 1385819 (0.0010) [2023-12-28 05:13:10,857][106226] Updated weights for policy 0, policy_version 1385829 (0.0010) [2023-12-28 05:13:10,867][106225] Updated weights for policy 1, policy_version 1389057 (0.0006) [2023-12-28 05:13:10,908][106226] Updated weights for policy 0, policy_version 1385839 (0.0010) [2023-12-28 05:13:10,918][106225] Updated weights for policy 1, policy_version 1389067 (0.0007) [2023-12-28 05:13:10,979][106225] Updated weights for policy 1, policy_version 1389077 (0.0008) [2023-12-28 05:13:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 710500352. Throughput: 0: 10113.0, 1: 9717.6. Samples: 710467212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:11,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.480')] [2023-12-28 05:13:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001385840_354844672.pth... [2023-12-28 05:13:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001389080_355655680.pth... [2023-12-28 05:13:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001387960_355368960.pth [2023-12-28 05:13:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001384688_354549760.pth [2023-12-28 05:13:11,625][106226] Updated weights for policy 0, policy_version 1385849 (0.0010) [2023-12-28 05:13:11,691][106226] Updated weights for policy 0, policy_version 1385859 (0.0009) [2023-12-28 05:13:11,771][106226] Updated weights for policy 0, policy_version 1385869 (0.0008) [2023-12-28 05:13:11,778][106225] Updated weights for policy 1, policy_version 1389087 (0.0007) [2023-12-28 05:13:11,833][106225] Updated weights for policy 1, policy_version 1389097 (0.0008) [2023-12-28 05:13:11,893][106225] Updated weights for policy 1, policy_version 1389107 (0.0008) [2023-12-28 05:13:12,522][106226] Updated weights for policy 0, policy_version 1385879 (0.0008) [2023-12-28 05:13:12,585][106226] Updated weights for policy 0, policy_version 1385889 (0.0008) [2023-12-28 05:13:12,646][106225] Updated weights for policy 1, policy_version 1389117 (0.0008) [2023-12-28 05:13:12,649][106226] Updated weights for policy 0, policy_version 1385899 (0.0007) [2023-12-28 05:13:12,699][106225] Updated weights for policy 1, policy_version 1389127 (0.0007) [2023-12-28 05:13:12,755][106225] Updated weights for policy 1, policy_version 1389137 (0.0008) [2023-12-28 05:13:13,233][106226] Updated weights for policy 0, policy_version 1385909 (0.0005) [2023-12-28 05:13:13,286][106226] Updated weights for policy 0, policy_version 1385919 (0.0005) [2023-12-28 05:13:13,336][106226] Updated weights for policy 0, policy_version 1385929 (0.0005) [2023-12-28 05:13:13,475][106225] Updated weights for policy 1, policy_version 1389147 (0.0007) [2023-12-28 05:13:13,531][106225] Updated weights for policy 1, policy_version 1389157 (0.0010) [2023-12-28 05:13:13,586][106225] Updated weights for policy 1, policy_version 1389167 (0.0010) [2023-12-28 05:13:13,911][106226] Updated weights for policy 0, policy_version 1385939 (0.0006) [2023-12-28 05:13:13,978][106226] Updated weights for policy 0, policy_version 1385949 (0.0008) [2023-12-28 05:13:14,041][106226] Updated weights for policy 0, policy_version 1385959 (0.0005) [2023-12-28 05:13:14,292][106225] Updated weights for policy 1, policy_version 1389177 (0.0010) [2023-12-28 05:13:14,347][106225] Updated weights for policy 1, policy_version 1389187 (0.0005) [2023-12-28 05:13:14,400][106225] Updated weights for policy 1, policy_version 1389197 (0.0005) [2023-12-28 05:13:14,450][106225] Updated weights for policy 1, policy_version 1389207 (0.0008) [2023-12-28 05:13:14,685][106226] Updated weights for policy 0, policy_version 1385969 (0.0006) [2023-12-28 05:13:14,742][106226] Updated weights for policy 0, policy_version 1385979 (0.0005) [2023-12-28 05:13:14,802][106226] Updated weights for policy 0, policy_version 1385989 (0.0009) [2023-12-28 05:13:14,861][106226] Updated weights for policy 0, policy_version 1385999 (0.0008) [2023-12-28 05:13:15,154][106225] Updated weights for policy 1, policy_version 1389217 (0.0011) [2023-12-28 05:13:15,219][106225] Updated weights for policy 1, policy_version 1389227 (0.0011) [2023-12-28 05:13:15,274][106225] Updated weights for policy 1, policy_version 1389237 (0.0011) [2023-12-28 05:13:15,539][106226] Updated weights for policy 0, policy_version 1386009 (0.0008) [2023-12-28 05:13:15,590][106226] Updated weights for policy 0, policy_version 1386019 (0.0008) [2023-12-28 05:13:15,653][106226] Updated weights for policy 0, policy_version 1386029 (0.0007) [2023-12-28 05:13:15,941][106225] Updated weights for policy 1, policy_version 1389247 (0.0010) [2023-12-28 05:13:15,990][106225] Updated weights for policy 1, policy_version 1389257 (0.0010) [2023-12-28 05:13:16,037][106225] Updated weights for policy 1, policy_version 1389267 (0.0010) [2023-12-28 05:13:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 710598656. Throughput: 0: 10054.3, 1: 9667.7. Samples: 710585440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:16,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.388')] [2023-12-28 05:13:16,360][106226] Updated weights for policy 0, policy_version 1386039 (0.0009) [2023-12-28 05:13:16,421][106226] Updated weights for policy 0, policy_version 1386049 (0.0009) [2023-12-28 05:13:16,481][106226] Updated weights for policy 0, policy_version 1386059 (0.0006) [2023-12-28 05:13:16,736][106225] Updated weights for policy 1, policy_version 1389277 (0.0008) [2023-12-28 05:13:16,782][106225] Updated weights for policy 1, policy_version 1389287 (0.0005) [2023-12-28 05:13:16,830][106225] Updated weights for policy 1, policy_version 1389297 (0.0005) [2023-12-28 05:13:17,135][106226] Updated weights for policy 0, policy_version 1386069 (0.0007) [2023-12-28 05:13:17,192][106226] Updated weights for policy 0, policy_version 1386079 (0.0009) [2023-12-28 05:13:17,251][106226] Updated weights for policy 0, policy_version 1386089 (0.0007) [2023-12-28 05:13:17,417][106225] Updated weights for policy 1, policy_version 1389307 (0.0007) [2023-12-28 05:13:17,474][106225] Updated weights for policy 1, policy_version 1389317 (0.0010) [2023-12-28 05:13:17,531][106225] Updated weights for policy 1, policy_version 1389327 (0.0006) [2023-12-28 05:13:17,906][106226] Updated weights for policy 0, policy_version 1386099 (0.0010) [2023-12-28 05:13:17,961][106226] Updated weights for policy 0, policy_version 1386109 (0.0009) [2023-12-28 05:13:18,020][106226] Updated weights for policy 0, policy_version 1386119 (0.0005) [2023-12-28 05:13:18,073][106225] Updated weights for policy 1, policy_version 1389337 (0.0005) [2023-12-28 05:13:18,132][106225] Updated weights for policy 1, policy_version 1389347 (0.0005) [2023-12-28 05:13:18,192][106225] Updated weights for policy 1, policy_version 1389357 (0.0008) [2023-12-28 05:13:18,252][106225] Updated weights for policy 1, policy_version 1389367 (0.0007) [2023-12-28 05:13:18,702][106226] Updated weights for policy 0, policy_version 1386129 (0.0007) [2023-12-28 05:13:18,760][106226] Updated weights for policy 0, policy_version 1386139 (0.0009) [2023-12-28 05:13:18,825][106226] Updated weights for policy 0, policy_version 1386149 (0.0005) [2023-12-28 05:13:18,887][106226] Updated weights for policy 0, policy_version 1386159 (0.0008) [2023-12-28 05:13:18,970][106225] Updated weights for policy 1, policy_version 1389377 (0.0010) [2023-12-28 05:13:19,030][106225] Updated weights for policy 1, policy_version 1389387 (0.0010) [2023-12-28 05:13:19,077][106225] Updated weights for policy 1, policy_version 1389397 (0.0010) [2023-12-28 05:13:19,658][106226] Updated weights for policy 0, policy_version 1386169 (0.0008) [2023-12-28 05:13:19,717][106226] Updated weights for policy 0, policy_version 1386179 (0.0010) [2023-12-28 05:13:19,779][106226] Updated weights for policy 0, policy_version 1386189 (0.0007) [2023-12-28 05:13:19,787][106225] Updated weights for policy 1, policy_version 1389407 (0.0008) [2023-12-28 05:13:19,857][106225] Updated weights for policy 1, policy_version 1389417 (0.0008) [2023-12-28 05:13:19,918][106225] Updated weights for policy 1, policy_version 1389427 (0.0010) [2023-12-28 05:13:20,525][106226] Updated weights for policy 0, policy_version 1386199 (0.0007) [2023-12-28 05:13:20,592][106226] Updated weights for policy 0, policy_version 1386209 (0.0008) [2023-12-28 05:13:20,630][106225] Updated weights for policy 1, policy_version 1389437 (0.0010) [2023-12-28 05:13:20,658][106226] Updated weights for policy 0, policy_version 1386219 (0.0008) [2023-12-28 05:13:20,694][106225] Updated weights for policy 1, policy_version 1389447 (0.0011) [2023-12-28 05:13:20,764][106225] Updated weights for policy 1, policy_version 1389457 (0.0010) [2023-12-28 05:13:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 710696960. Throughput: 0: 10042.0, 1: 9681.3. Samples: 710707388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:21,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.371')] [2023-12-28 05:13:21,408][106226] Updated weights for policy 0, policy_version 1386229 (0.0013) [2023-12-28 05:13:21,468][106225] Updated weights for policy 1, policy_version 1389467 (0.0010) [2023-12-28 05:13:21,471][106226] Updated weights for policy 0, policy_version 1386239 (0.0007) [2023-12-28 05:13:21,530][106225] Updated weights for policy 1, policy_version 1389477 (0.0011) [2023-12-28 05:13:21,537][106226] Updated weights for policy 0, policy_version 1386249 (0.0006) [2023-12-28 05:13:21,593][106225] Updated weights for policy 1, policy_version 1389487 (0.0010) [2023-12-28 05:13:22,265][106225] Updated weights for policy 1, policy_version 1389497 (0.0010) [2023-12-28 05:13:22,303][106226] Updated weights for policy 0, policy_version 1386259 (0.0006) [2023-12-28 05:13:22,329][106225] Updated weights for policy 1, policy_version 1389507 (0.0007) [2023-12-28 05:13:22,370][106226] Updated weights for policy 0, policy_version 1386269 (0.0007) [2023-12-28 05:13:22,403][106225] Updated weights for policy 1, policy_version 1389517 (0.0007) [2023-12-28 05:13:22,444][106226] Updated weights for policy 0, policy_version 1386279 (0.0006) [2023-12-28 05:13:22,460][106225] Updated weights for policy 1, policy_version 1389527 (0.0008) [2023-12-28 05:13:23,156][106226] Updated weights for policy 0, policy_version 1386289 (0.0007) [2023-12-28 05:13:23,170][106225] Updated weights for policy 1, policy_version 1389537 (0.0011) [2023-12-28 05:13:23,217][106226] Updated weights for policy 0, policy_version 1386299 (0.0008) [2023-12-28 05:13:23,218][106225] Updated weights for policy 1, policy_version 1389547 (0.0010) [2023-12-28 05:13:23,274][106225] Updated weights for policy 1, policy_version 1389557 (0.0011) [2023-12-28 05:13:23,279][106226] Updated weights for policy 0, policy_version 1386309 (0.0006) [2023-12-28 05:13:23,344][106226] Updated weights for policy 0, policy_version 1386319 (0.0007) [2023-12-28 05:13:24,001][106225] Updated weights for policy 1, policy_version 1389567 (0.0010) [2023-12-28 05:13:24,054][106225] Updated weights for policy 1, policy_version 1389577 (0.0009) [2023-12-28 05:13:24,054][106226] Updated weights for policy 0, policy_version 1386329 (0.0009) [2023-12-28 05:13:24,101][106225] Updated weights for policy 1, policy_version 1389587 (0.0010) [2023-12-28 05:13:24,112][106226] Updated weights for policy 0, policy_version 1386339 (0.0009) [2023-12-28 05:13:24,167][106226] Updated weights for policy 0, policy_version 1386349 (0.0007) [2023-12-28 05:13:24,836][106225] Updated weights for policy 1, policy_version 1389597 (0.0010) [2023-12-28 05:13:24,891][106225] Updated weights for policy 1, policy_version 1389607 (0.0009) [2023-12-28 05:13:24,923][106226] Updated weights for policy 0, policy_version 1386359 (0.0008) [2023-12-28 05:13:24,959][106225] Updated weights for policy 1, policy_version 1389617 (0.0008) [2023-12-28 05:13:24,987][106226] Updated weights for policy 0, policy_version 1386369 (0.0008) [2023-12-28 05:13:25,054][106226] Updated weights for policy 0, policy_version 1386379 (0.0005) [2023-12-28 05:13:25,540][106225] Updated weights for policy 1, policy_version 1389627 (0.0007) [2023-12-28 05:13:25,599][106225] Updated weights for policy 1, policy_version 1389637 (0.0007) [2023-12-28 05:13:25,650][106226] Updated weights for policy 0, policy_version 1386389 (0.0007) [2023-12-28 05:13:25,661][106225] Updated weights for policy 1, policy_version 1389647 (0.0005) [2023-12-28 05:13:25,708][106226] Updated weights for policy 0, policy_version 1386399 (0.0009) [2023-12-28 05:13:25,757][106226] Updated weights for policy 0, policy_version 1386409 (0.0007) [2023-12-28 05:13:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 710795264. Throughput: 0: 9953.6, 1: 9662.5. Samples: 710763872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:26,176][105115] Avg episode reward: [(0, '-4.670'), (1, '-4.628')] [2023-12-28 05:13:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001389656_355803136.pth... [2023-12-28 05:13:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001386416_354992128.pth... [2023-12-28 05:13:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001388504_355508224.pth [2023-12-28 05:13:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001385264_354697216.pth [2023-12-28 05:13:26,264][106225] Updated weights for policy 1, policy_version 1389657 (0.0009) [2023-12-28 05:13:26,326][106225] Updated weights for policy 1, policy_version 1389667 (0.0010) [2023-12-28 05:13:26,391][106225] Updated weights for policy 1, policy_version 1389677 (0.0006) [2023-12-28 05:13:26,449][106225] Updated weights for policy 1, policy_version 1389687 (0.0009) [2023-12-28 05:13:26,552][106226] Updated weights for policy 0, policy_version 1386419 (0.0009) [2023-12-28 05:13:26,616][106226] Updated weights for policy 0, policy_version 1386429 (0.0010) [2023-12-28 05:13:26,670][106226] Updated weights for policy 0, policy_version 1386439 (0.0010) [2023-12-28 05:13:26,992][106225] Updated weights for policy 1, policy_version 1389697 (0.0008) [2023-12-28 05:13:27,041][106225] Updated weights for policy 1, policy_version 1389707 (0.0005) [2023-12-28 05:13:27,093][106225] Updated weights for policy 1, policy_version 1389717 (0.0005) [2023-12-28 05:13:27,296][106226] Updated weights for policy 0, policy_version 1386449 (0.0010) [2023-12-28 05:13:27,348][106226] Updated weights for policy 0, policy_version 1386459 (0.0008) [2023-12-28 05:13:27,401][106226] Updated weights for policy 0, policy_version 1386469 (0.0008) [2023-12-28 05:13:27,458][106226] Updated weights for policy 0, policy_version 1386479 (0.0009) [2023-12-28 05:13:27,672][106225] Updated weights for policy 1, policy_version 1389727 (0.0009) [2023-12-28 05:13:27,731][106225] Updated weights for policy 1, policy_version 1389737 (0.0010) [2023-12-28 05:13:27,801][106225] Updated weights for policy 1, policy_version 1389747 (0.0010) [2023-12-28 05:13:28,082][106226] Updated weights for policy 0, policy_version 1386489 (0.0006) [2023-12-28 05:13:28,130][106226] Updated weights for policy 0, policy_version 1386499 (0.0005) [2023-12-28 05:13:28,199][106226] Updated weights for policy 0, policy_version 1386509 (0.0005) [2023-12-28 05:13:28,459][106225] Updated weights for policy 1, policy_version 1389757 (0.0010) [2023-12-28 05:13:28,513][106225] Updated weights for policy 1, policy_version 1389767 (0.0010) [2023-12-28 05:13:28,564][106225] Updated weights for policy 1, policy_version 1389777 (0.0009) [2023-12-28 05:13:28,722][106226] Updated weights for policy 0, policy_version 1386519 (0.0008) [2023-12-28 05:13:28,783][106226] Updated weights for policy 0, policy_version 1386529 (0.0011) [2023-12-28 05:13:28,839][106226] Updated weights for policy 0, policy_version 1386539 (0.0010) [2023-12-28 05:13:29,308][106225] Updated weights for policy 1, policy_version 1389787 (0.0008) [2023-12-28 05:13:29,377][106225] Updated weights for policy 1, policy_version 1389797 (0.0007) [2023-12-28 05:13:29,434][106225] Updated weights for policy 1, policy_version 1389807 (0.0006) [2023-12-28 05:13:29,558][106226] Updated weights for policy 0, policy_version 1386549 (0.0010) [2023-12-28 05:13:29,616][106226] Updated weights for policy 0, policy_version 1386559 (0.0008) [2023-12-28 05:13:29,678][106226] Updated weights for policy 0, policy_version 1386569 (0.0009) [2023-12-28 05:13:30,146][106225] Updated weights for policy 1, policy_version 1389817 (0.0009) [2023-12-28 05:13:30,199][106225] Updated weights for policy 1, policy_version 1389827 (0.0009) [2023-12-28 05:13:30,257][106225] Updated weights for policy 1, policy_version 1389837 (0.0009) [2023-12-28 05:13:30,318][106225] Updated weights for policy 1, policy_version 1389847 (0.0009) [2023-12-28 05:13:30,391][106226] Updated weights for policy 0, policy_version 1386579 (0.0008) [2023-12-28 05:13:30,442][106226] Updated weights for policy 0, policy_version 1386589 (0.0005) [2023-12-28 05:13:30,505][106226] Updated weights for policy 0, policy_version 1386599 (0.0009) [2023-12-28 05:13:31,064][106225] Updated weights for policy 1, policy_version 1389857 (0.0009) [2023-12-28 05:13:31,111][106225] Updated weights for policy 1, policy_version 1389867 (0.0010) [2023-12-28 05:13:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 710893568. Throughput: 0: 9927.1, 1: 9799.8. Samples: 710888828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:31,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.436')] [2023-12-28 05:13:31,177][106225] Updated weights for policy 1, policy_version 1389877 (0.0010) [2023-12-28 05:13:31,219][106226] Updated weights for policy 0, policy_version 1386609 (0.0008) [2023-12-28 05:13:31,275][106226] Updated weights for policy 0, policy_version 1386619 (0.0008) [2023-12-28 05:13:31,336][106226] Updated weights for policy 0, policy_version 1386629 (0.0008) [2023-12-28 05:13:31,408][106226] Updated weights for policy 0, policy_version 1386639 (0.0009) [2023-12-28 05:13:31,969][106225] Updated weights for policy 1, policy_version 1389887 (0.0009) [2023-12-28 05:13:32,022][106225] Updated weights for policy 1, policy_version 1389897 (0.0008) [2023-12-28 05:13:32,076][106225] Updated weights for policy 1, policy_version 1389907 (0.0008) [2023-12-28 05:13:32,149][106226] Updated weights for policy 0, policy_version 1386649 (0.0008) [2023-12-28 05:13:32,214][106226] Updated weights for policy 0, policy_version 1386659 (0.0009) [2023-12-28 05:13:32,274][106226] Updated weights for policy 0, policy_version 1386669 (0.0008) [2023-12-28 05:13:32,829][106225] Updated weights for policy 1, policy_version 1389917 (0.0008) [2023-12-28 05:13:32,893][106225] Updated weights for policy 1, policy_version 1389927 (0.0006) [2023-12-28 05:13:32,960][106225] Updated weights for policy 1, policy_version 1389937 (0.0005) [2023-12-28 05:13:33,058][106226] Updated weights for policy 0, policy_version 1386679 (0.0007) [2023-12-28 05:13:33,102][106226] Updated weights for policy 0, policy_version 1386689 (0.0009) [2023-12-28 05:13:33,154][106226] Updated weights for policy 0, policy_version 1386699 (0.0005) [2023-12-28 05:13:33,543][106225] Updated weights for policy 1, policy_version 1389947 (0.0006) [2023-12-28 05:13:33,598][106225] Updated weights for policy 1, policy_version 1389957 (0.0008) [2023-12-28 05:13:33,653][106225] Updated weights for policy 1, policy_version 1389967 (0.0009) [2023-12-28 05:13:33,759][106226] Updated weights for policy 0, policy_version 1386709 (0.0007) [2023-12-28 05:13:33,825][106226] Updated weights for policy 0, policy_version 1386719 (0.0006) [2023-12-28 05:13:33,885][106226] Updated weights for policy 0, policy_version 1386729 (0.0006) [2023-12-28 05:13:34,384][106225] Updated weights for policy 1, policy_version 1389977 (0.0006) [2023-12-28 05:13:34,449][106225] Updated weights for policy 1, policy_version 1389987 (0.0009) [2023-12-28 05:13:34,479][106226] Updated weights for policy 0, policy_version 1386739 (0.0005) [2023-12-28 05:13:34,509][106225] Updated weights for policy 1, policy_version 1389997 (0.0008) [2023-12-28 05:13:34,543][106226] Updated weights for policy 0, policy_version 1386749 (0.0008) [2023-12-28 05:13:34,568][106225] Updated weights for policy 1, policy_version 1390007 (0.0006) [2023-12-28 05:13:34,608][106226] Updated weights for policy 0, policy_version 1386759 (0.0008) [2023-12-28 05:13:35,210][106225] Updated weights for policy 1, policy_version 1390017 (0.0005) [2023-12-28 05:13:35,234][106226] Updated weights for policy 0, policy_version 1386769 (0.0010) [2023-12-28 05:13:35,258][106225] Updated weights for policy 1, policy_version 1390027 (0.0005) [2023-12-28 05:13:35,288][106226] Updated weights for policy 0, policy_version 1386779 (0.0005) [2023-12-28 05:13:35,305][106225] Updated weights for policy 1, policy_version 1390037 (0.0007) [2023-12-28 05:13:35,337][106226] Updated weights for policy 0, policy_version 1386789 (0.0005) [2023-12-28 05:13:35,383][106226] Updated weights for policy 0, policy_version 1386799 (0.0005) [2023-12-28 05:13:36,036][106225] Updated weights for policy 1, policy_version 1390047 (0.0007) [2023-12-28 05:13:36,045][106226] Updated weights for policy 0, policy_version 1386809 (0.0009) [2023-12-28 05:13:36,090][106225] Updated weights for policy 1, policy_version 1390057 (0.0008) [2023-12-28 05:13:36,093][106226] Updated weights for policy 0, policy_version 1386819 (0.0007) [2023-12-28 05:13:36,154][106225] Updated weights for policy 1, policy_version 1390067 (0.0007) [2023-12-28 05:13:36,159][106226] Updated weights for policy 0, policy_version 1386829 (0.0008) [2023-12-28 05:13:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 711000064. Throughput: 0: 9913.8, 1: 9907.5. Samples: 711009028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:13:36,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.503')] [2023-12-28 05:13:36,738][106225] Updated weights for policy 1, policy_version 1390077 (0.0006) [2023-12-28 05:13:36,792][106225] Updated weights for policy 1, policy_version 1390087 (0.0007) [2023-12-28 05:13:36,853][106225] Updated weights for policy 1, policy_version 1390097 (0.0005) [2023-12-28 05:13:37,020][106226] Updated weights for policy 0, policy_version 1386839 (0.0007) [2023-12-28 05:13:37,069][106226] Updated weights for policy 0, policy_version 1386849 (0.0005) [2023-12-28 05:13:37,121][106226] Updated weights for policy 0, policy_version 1386859 (0.0005) [2023-12-28 05:13:37,453][106225] Updated weights for policy 1, policy_version 1390107 (0.0007) [2023-12-28 05:13:37,518][106225] Updated weights for policy 1, policy_version 1390117 (0.0008) [2023-12-28 05:13:37,577][106225] Updated weights for policy 1, policy_version 1390127 (0.0005) [2023-12-28 05:13:37,785][106226] Updated weights for policy 0, policy_version 1386869 (0.0008) [2023-12-28 05:13:37,850][106226] Updated weights for policy 0, policy_version 1386879 (0.0007) [2023-12-28 05:13:37,909][106226] Updated weights for policy 0, policy_version 1386889 (0.0005) [2023-12-28 05:13:38,220][106225] Updated weights for policy 1, policy_version 1390137 (0.0006) [2023-12-28 05:13:38,282][106225] Updated weights for policy 1, policy_version 1390147 (0.0010) [2023-12-28 05:13:38,344][106225] Updated weights for policy 1, policy_version 1390157 (0.0010) [2023-12-28 05:13:38,403][106225] Updated weights for policy 1, policy_version 1390167 (0.0006) [2023-12-28 05:13:38,625][106226] Updated weights for policy 0, policy_version 1386899 (0.0008) [2023-12-28 05:13:38,693][106226] Updated weights for policy 0, policy_version 1386909 (0.0006) [2023-12-28 05:13:38,766][106226] Updated weights for policy 0, policy_version 1386919 (0.0009) [2023-12-28 05:13:39,111][106225] Updated weights for policy 1, policy_version 1390177 (0.0006) [2023-12-28 05:13:39,167][106225] Updated weights for policy 1, policy_version 1390187 (0.0005) [2023-12-28 05:13:39,232][106225] Updated weights for policy 1, policy_version 1390197 (0.0007) [2023-12-28 05:13:39,361][106226] Updated weights for policy 0, policy_version 1386929 (0.0009) [2023-12-28 05:13:39,433][106226] Updated weights for policy 0, policy_version 1386939 (0.0009) [2023-12-28 05:13:39,492][106226] Updated weights for policy 0, policy_version 1386949 (0.0009) [2023-12-28 05:13:39,545][106226] Updated weights for policy 0, policy_version 1386959 (0.0008) [2023-12-28 05:13:39,954][106225] Updated weights for policy 1, policy_version 1390207 (0.0008) [2023-12-28 05:13:40,019][106225] Updated weights for policy 1, policy_version 1390217 (0.0010) [2023-12-28 05:13:40,085][106225] Updated weights for policy 1, policy_version 1390227 (0.0011) [2023-12-28 05:13:40,321][106226] Updated weights for policy 0, policy_version 1386969 (0.0008) [2023-12-28 05:13:40,382][106226] Updated weights for policy 0, policy_version 1386979 (0.0008) [2023-12-28 05:13:40,446][106226] Updated weights for policy 0, policy_version 1386989 (0.0008) [2023-12-28 05:13:40,812][106225] Updated weights for policy 1, policy_version 1390237 (0.0007) [2023-12-28 05:13:40,867][106225] Updated weights for policy 1, policy_version 1390247 (0.0008) [2023-12-28 05:13:40,914][106225] Updated weights for policy 1, policy_version 1390257 (0.0008) [2023-12-28 05:13:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 711098368. Throughput: 0: 9920.2, 1: 10009.4. Samples: 711070636. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:13:41,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.444')] [2023-12-28 05:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001390264_355958784.pth... [2023-12-28 05:13:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001389080_355655680.pth [2023-12-28 05:13:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001390264_355958784.pth [2023-12-28 05:13:41,208][106226] Updated weights for policy 0, policy_version 1386999 (0.0008) [2023-12-28 05:13:41,274][106226] Updated weights for policy 0, policy_version 1387009 (0.0007) [2023-12-28 05:13:41,340][106226] Updated weights for policy 0, policy_version 1387019 (0.0009) [2023-12-28 05:13:41,378][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001387024_355147776.pth... [2023-12-28 05:13:41,383][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001385840_354844672.pth [2023-12-28 05:13:41,384][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001387024_355147776.pth [2023-12-28 05:13:41,765][106225] Updated weights for policy 1, policy_version 1390267 (0.0010) [2023-12-28 05:13:41,821][106225] Updated weights for policy 1, policy_version 1390277 (0.0006) [2023-12-28 05:13:41,885][106225] Updated weights for policy 1, policy_version 1390287 (0.0009) [2023-12-28 05:13:42,086][106226] Updated weights for policy 0, policy_version 1387029 (0.0008) [2023-12-28 05:13:42,148][106226] Updated weights for policy 0, policy_version 1387039 (0.0008) [2023-12-28 05:13:42,208][106226] Updated weights for policy 0, policy_version 1387049 (0.0009) [2023-12-28 05:13:42,662][106225] Updated weights for policy 1, policy_version 1390297 (0.0009) [2023-12-28 05:13:42,736][106225] Updated weights for policy 1, policy_version 1390307 (0.0009) [2023-12-28 05:13:42,799][106225] Updated weights for policy 1, policy_version 1390317 (0.0009) [2023-12-28 05:13:42,867][106225] Updated weights for policy 1, policy_version 1390327 (0.0006) [2023-12-28 05:13:42,916][106226] Updated weights for policy 0, policy_version 1387059 (0.0007) [2023-12-28 05:13:42,972][106226] Updated weights for policy 0, policy_version 1387069 (0.0010) [2023-12-28 05:13:43,034][106226] Updated weights for policy 0, policy_version 1387079 (0.0010) [2023-12-28 05:13:43,494][106225] Updated weights for policy 1, policy_version 1390337 (0.0010) [2023-12-28 05:13:43,543][106225] Updated weights for policy 1, policy_version 1390347 (0.0010) [2023-12-28 05:13:43,597][106225] Updated weights for policy 1, policy_version 1390357 (0.0010) [2023-12-28 05:13:43,699][106226] Updated weights for policy 0, policy_version 1387089 (0.0009) [2023-12-28 05:13:43,750][106226] Updated weights for policy 0, policy_version 1387099 (0.0008) [2023-12-28 05:13:43,801][106226] Updated weights for policy 0, policy_version 1387109 (0.0005) [2023-12-28 05:13:43,854][106226] Updated weights for policy 0, policy_version 1387119 (0.0005) [2023-12-28 05:13:44,302][106225] Updated weights for policy 1, policy_version 1390367 (0.0007) [2023-12-28 05:13:44,358][106225] Updated weights for policy 1, policy_version 1390377 (0.0005) [2023-12-28 05:13:44,414][106225] Updated weights for policy 1, policy_version 1390387 (0.0005) [2023-12-28 05:13:44,570][106226] Updated weights for policy 0, policy_version 1387129 (0.0008) [2023-12-28 05:13:44,630][106226] Updated weights for policy 0, policy_version 1387139 (0.0008) [2023-12-28 05:13:44,684][106226] Updated weights for policy 0, policy_version 1387149 (0.0008) [2023-12-28 05:13:45,059][106225] Updated weights for policy 1, policy_version 1390397 (0.0008) [2023-12-28 05:13:45,114][106225] Updated weights for policy 1, policy_version 1390407 (0.0010) [2023-12-28 05:13:45,173][106225] Updated weights for policy 1, policy_version 1390417 (0.0011) [2023-12-28 05:13:45,365][106226] Updated weights for policy 0, policy_version 1387159 (0.0008) [2023-12-28 05:13:45,419][106226] Updated weights for policy 0, policy_version 1387169 (0.0008) [2023-12-28 05:13:45,472][106226] Updated weights for policy 0, policy_version 1387179 (0.0008) [2023-12-28 05:13:45,895][106225] Updated weights for policy 1, policy_version 1390427 (0.0011) [2023-12-28 05:13:45,957][106225] Updated weights for policy 1, policy_version 1390437 (0.0009) [2023-12-28 05:13:46,017][106225] Updated weights for policy 1, policy_version 1390447 (0.0007) [2023-12-28 05:13:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 711196672. Throughput: 0: 9942.1, 1: 9921.6. Samples: 711185600. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:13:46,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.693')] [2023-12-28 05:13:46,220][106226] Updated weights for policy 0, policy_version 1387189 (0.0008) [2023-12-28 05:13:46,273][106226] Updated weights for policy 0, policy_version 1387199 (0.0008) [2023-12-28 05:13:46,327][106226] Updated weights for policy 0, policy_version 1387209 (0.0007) [2023-12-28 05:13:46,645][106225] Updated weights for policy 1, policy_version 1390457 (0.0008) [2023-12-28 05:13:46,697][106225] Updated weights for policy 1, policy_version 1390467 (0.0007) [2023-12-28 05:13:46,747][106225] Updated weights for policy 1, policy_version 1390477 (0.0008) [2023-12-28 05:13:46,800][106225] Updated weights for policy 1, policy_version 1390487 (0.0006) [2023-12-28 05:13:47,168][106226] Updated weights for policy 0, policy_version 1387219 (0.0008) [2023-12-28 05:13:47,237][106226] Updated weights for policy 0, policy_version 1387229 (0.0010) [2023-12-28 05:13:47,286][106226] Updated weights for policy 0, policy_version 1387239 (0.0009) [2023-12-28 05:13:47,385][106225] Updated weights for policy 1, policy_version 1390497 (0.0008) [2023-12-28 05:13:47,429][106225] Updated weights for policy 1, policy_version 1390507 (0.0006) [2023-12-28 05:13:47,474][106225] Updated weights for policy 1, policy_version 1390517 (0.0005) [2023-12-28 05:13:48,070][106225] Updated weights for policy 1, policy_version 1390527 (0.0007) [2023-12-28 05:13:48,098][106226] Updated weights for policy 0, policy_version 1387249 (0.0008) [2023-12-28 05:13:48,124][106225] Updated weights for policy 1, policy_version 1390537 (0.0008) [2023-12-28 05:13:48,150][106226] Updated weights for policy 0, policy_version 1387259 (0.0006) [2023-12-28 05:13:48,176][106225] Updated weights for policy 1, policy_version 1390547 (0.0007) [2023-12-28 05:13:48,201][106226] Updated weights for policy 0, policy_version 1387269 (0.0006) [2023-12-28 05:13:48,250][106226] Updated weights for policy 0, policy_version 1387279 (0.0008) [2023-12-28 05:13:48,901][106225] Updated weights for policy 1, policy_version 1390557 (0.0008) [2023-12-28 05:13:48,951][106225] Updated weights for policy 1, policy_version 1390567 (0.0010) [2023-12-28 05:13:49,001][106225] Updated weights for policy 1, policy_version 1390577 (0.0010) [2023-12-28 05:13:49,022][106226] Updated weights for policy 0, policy_version 1387289 (0.0006) [2023-12-28 05:13:49,079][106226] Updated weights for policy 0, policy_version 1387299 (0.0007) [2023-12-28 05:13:49,136][106226] Updated weights for policy 0, policy_version 1387309 (0.0008) [2023-12-28 05:13:49,679][106225] Updated weights for policy 1, policy_version 1390587 (0.0010) [2023-12-28 05:13:49,742][106225] Updated weights for policy 1, policy_version 1390597 (0.0008) [2023-12-28 05:13:49,805][106225] Updated weights for policy 1, policy_version 1390607 (0.0008) [2023-12-28 05:13:49,938][106226] Updated weights for policy 0, policy_version 1387319 (0.0008) [2023-12-28 05:13:49,997][106226] Updated weights for policy 0, policy_version 1387329 (0.0008) [2023-12-28 05:13:50,060][106226] Updated weights for policy 0, policy_version 1387339 (0.0008) [2023-12-28 05:13:50,504][106225] Updated weights for policy 1, policy_version 1390617 (0.0009) [2023-12-28 05:13:50,563][106225] Updated weights for policy 1, policy_version 1390627 (0.0008) [2023-12-28 05:13:50,632][106225] Updated weights for policy 1, policy_version 1390637 (0.0006) [2023-12-28 05:13:50,698][106225] Updated weights for policy 1, policy_version 1390647 (0.0007) [2023-12-28 05:13:50,854][106226] Updated weights for policy 0, policy_version 1387349 (0.0009) [2023-12-28 05:13:50,913][106226] Updated weights for policy 0, policy_version 1387359 (0.0008) [2023-12-28 05:13:50,976][106226] Updated weights for policy 0, policy_version 1387369 (0.0009) [2023-12-28 05:13:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 711294976. Throughput: 0: 9850.7, 1: 10030.9. Samples: 711301580. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:13:51,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.681')] [2023-12-28 05:13:51,403][106225] Updated weights for policy 1, policy_version 1390657 (0.0008) [2023-12-28 05:13:51,465][106225] Updated weights for policy 1, policy_version 1390667 (0.0007) [2023-12-28 05:13:51,525][106225] Updated weights for policy 1, policy_version 1390677 (0.0007) [2023-12-28 05:13:51,807][106226] Updated weights for policy 0, policy_version 1387379 (0.0009) [2023-12-28 05:13:51,863][106226] Updated weights for policy 0, policy_version 1387389 (0.0009) [2023-12-28 05:13:51,927][106226] Updated weights for policy 0, policy_version 1387399 (0.0008) [2023-12-28 05:13:52,243][106225] Updated weights for policy 1, policy_version 1390687 (0.0009) [2023-12-28 05:13:52,303][106225] Updated weights for policy 1, policy_version 1390697 (0.0010) [2023-12-28 05:13:52,363][106225] Updated weights for policy 1, policy_version 1390707 (0.0010) [2023-12-28 05:13:52,663][106226] Updated weights for policy 0, policy_version 1387409 (0.0009) [2023-12-28 05:13:52,723][106226] Updated weights for policy 0, policy_version 1387419 (0.0010) [2023-12-28 05:13:52,771][106226] Updated weights for policy 0, policy_version 1387429 (0.0010) [2023-12-28 05:13:52,838][106226] Updated weights for policy 0, policy_version 1387439 (0.0010) [2023-12-28 05:13:53,068][106225] Updated weights for policy 1, policy_version 1390717 (0.0007) [2023-12-28 05:13:53,119][106225] Updated weights for policy 1, policy_version 1390727 (0.0005) [2023-12-28 05:13:53,183][106225] Updated weights for policy 1, policy_version 1390737 (0.0005) [2023-12-28 05:13:53,593][106226] Updated weights for policy 0, policy_version 1387449 (0.0008) [2023-12-28 05:13:53,645][106226] Updated weights for policy 0, policy_version 1387459 (0.0008) [2023-12-28 05:13:53,699][106226] Updated weights for policy 0, policy_version 1387469 (0.0008) [2023-12-28 05:13:53,788][106225] Updated weights for policy 1, policy_version 1390747 (0.0008) [2023-12-28 05:13:53,854][106225] Updated weights for policy 1, policy_version 1390757 (0.0006) [2023-12-28 05:13:53,911][106225] Updated weights for policy 1, policy_version 1390767 (0.0008) [2023-12-28 05:13:54,449][106226] Updated weights for policy 0, policy_version 1387479 (0.0008) [2023-12-28 05:13:54,497][106226] Updated weights for policy 0, policy_version 1387489 (0.0008) [2023-12-28 05:13:54,541][106226] Updated weights for policy 0, policy_version 1387499 (0.0008) [2023-12-28 05:13:54,617][106225] Updated weights for policy 1, policy_version 1390777 (0.0008) [2023-12-28 05:13:54,665][106225] Updated weights for policy 1, policy_version 1390787 (0.0008) [2023-12-28 05:13:54,720][106225] Updated weights for policy 1, policy_version 1390797 (0.0008) [2023-12-28 05:13:54,780][106225] Updated weights for policy 1, policy_version 1390807 (0.0009) [2023-12-28 05:13:55,314][106226] Updated weights for policy 0, policy_version 1387509 (0.0008) [2023-12-28 05:13:55,368][106226] Updated weights for policy 0, policy_version 1387519 (0.0010) [2023-12-28 05:13:55,417][106226] Updated weights for policy 0, policy_version 1387529 (0.0008) [2023-12-28 05:13:55,519][106225] Updated weights for policy 1, policy_version 1390817 (0.0006) [2023-12-28 05:13:55,576][106225] Updated weights for policy 1, policy_version 1390827 (0.0006) [2023-12-28 05:13:55,634][106225] Updated weights for policy 1, policy_version 1390837 (0.0005) [2023-12-28 05:13:56,164][106226] Updated weights for policy 0, policy_version 1387539 (0.0007) [2023-12-28 05:13:56,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 711385088. Throughput: 0: 9744.1, 1: 10080.7. Samples: 711359324. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:13:56,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-4.760')] [2023-12-28 05:13:56,211][106225] Updated weights for policy 1, policy_version 1390847 (0.0006) [2023-12-28 05:13:56,213][106226] Updated weights for policy 0, policy_version 1387549 (0.0007) [2023-12-28 05:13:56,266][106225] Updated weights for policy 1, policy_version 1390857 (0.0005) [2023-12-28 05:13:56,267][106226] Updated weights for policy 0, policy_version 1387559 (0.0009) [2023-12-28 05:13:56,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001387568_355287040.pth... [2023-12-28 05:13:56,312][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001386416_354992128.pth [2023-12-28 05:13:56,317][106225] Updated weights for policy 1, policy_version 1390867 (0.0006) [2023-12-28 05:13:56,345][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001390872_356114432.pth... [2023-12-28 05:13:56,348][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001389656_355803136.pth [2023-12-28 05:13:56,853][106226] Updated weights for policy 0, policy_version 1387569 (0.0008) [2023-12-28 05:13:56,908][106226] Updated weights for policy 0, policy_version 1387579 (0.0007) [2023-12-28 05:13:56,937][106225] Updated weights for policy 1, policy_version 1390877 (0.0008) [2023-12-28 05:13:56,963][106226] Updated weights for policy 0, policy_version 1387589 (0.0006) [2023-12-28 05:13:56,987][106225] Updated weights for policy 1, policy_version 1390887 (0.0008) [2023-12-28 05:13:57,023][106226] Updated weights for policy 0, policy_version 1387599 (0.0008) [2023-12-28 05:13:57,038][106225] Updated weights for policy 1, policy_version 1390897 (0.0005) [2023-12-28 05:13:57,700][106225] Updated weights for policy 1, policy_version 1390907 (0.0007) [2023-12-28 05:13:57,738][106226] Updated weights for policy 0, policy_version 1387609 (0.0006) [2023-12-28 05:13:57,759][106225] Updated weights for policy 1, policy_version 1390917 (0.0010) [2023-12-28 05:13:57,799][106226] Updated weights for policy 0, policy_version 1387619 (0.0005) [2023-12-28 05:13:57,812][106225] Updated weights for policy 1, policy_version 1390927 (0.0010) [2023-12-28 05:13:57,862][106226] Updated weights for policy 0, policy_version 1387629 (0.0005) [2023-12-28 05:13:58,477][106225] Updated weights for policy 1, policy_version 1390937 (0.0010) [2023-12-28 05:13:58,542][106225] Updated weights for policy 1, policy_version 1390947 (0.0011) [2023-12-28 05:13:58,552][106226] Updated weights for policy 0, policy_version 1387639 (0.0008) [2023-12-28 05:13:58,610][106225] Updated weights for policy 1, policy_version 1390957 (0.0011) [2023-12-28 05:13:58,618][106226] Updated weights for policy 0, policy_version 1387649 (0.0011) [2023-12-28 05:13:58,673][106225] Updated weights for policy 1, policy_version 1390967 (0.0011) [2023-12-28 05:13:58,685][106226] Updated weights for policy 0, policy_version 1387659 (0.0010) [2023-12-28 05:13:59,478][106226] Updated weights for policy 0, policy_version 1387669 (0.0009) [2023-12-28 05:13:59,516][106225] Updated weights for policy 1, policy_version 1390977 (0.0010) [2023-12-28 05:13:59,526][106226] Updated weights for policy 0, policy_version 1387679 (0.0007) [2023-12-28 05:13:59,573][106225] Updated weights for policy 1, policy_version 1390987 (0.0010) [2023-12-28 05:13:59,583][106226] Updated weights for policy 0, policy_version 1387689 (0.0005) [2023-12-28 05:13:59,627][106225] Updated weights for policy 1, policy_version 1390997 (0.0009) [2023-12-28 05:14:00,317][106225] Updated weights for policy 1, policy_version 1391007 (0.0007) [2023-12-28 05:14:00,319][106226] Updated weights for policy 0, policy_version 1387699 (0.0007) [2023-12-28 05:14:00,363][106225] Updated weights for policy 1, policy_version 1391017 (0.0007) [2023-12-28 05:14:00,370][106226] Updated weights for policy 0, policy_version 1387709 (0.0007) [2023-12-28 05:14:00,417][106225] Updated weights for policy 1, policy_version 1391027 (0.0007) [2023-12-28 05:14:00,427][106226] Updated weights for policy 0, policy_version 1387719 (0.0007) [2023-12-28 05:14:01,105][106226] Updated weights for policy 0, policy_version 1387729 (0.0008) [2023-12-28 05:14:01,118][106225] Updated weights for policy 1, policy_version 1391037 (0.0007) [2023-12-28 05:14:01,165][106226] Updated weights for policy 0, policy_version 1387739 (0.0009) [2023-12-28 05:14:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 711483392. Throughput: 0: 9692.3, 1: 10146.7. Samples: 711478192. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:01,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.811')] [2023-12-28 05:14:01,183][106225] Updated weights for policy 1, policy_version 1391047 (0.0009) [2023-12-28 05:14:01,229][106226] Updated weights for policy 0, policy_version 1387749 (0.0006) [2023-12-28 05:14:01,251][106225] Updated weights for policy 1, policy_version 1391057 (0.0008) [2023-12-28 05:14:01,292][106226] Updated weights for policy 0, policy_version 1387759 (0.0010) [2023-12-28 05:14:01,961][106225] Updated weights for policy 1, policy_version 1391067 (0.0007) [2023-12-28 05:14:02,006][106226] Updated weights for policy 0, policy_version 1387769 (0.0011) [2023-12-28 05:14:02,023][106225] Updated weights for policy 1, policy_version 1391077 (0.0010) [2023-12-28 05:14:02,067][106226] Updated weights for policy 0, policy_version 1387779 (0.0009) [2023-12-28 05:14:02,084][106225] Updated weights for policy 1, policy_version 1391087 (0.0011) [2023-12-28 05:14:02,134][106226] Updated weights for policy 0, policy_version 1387789 (0.0006) [2023-12-28 05:14:02,779][106226] Updated weights for policy 0, policy_version 1387799 (0.0005) [2023-12-28 05:14:02,810][106225] Updated weights for policy 1, policy_version 1391097 (0.0007) [2023-12-28 05:14:02,837][106226] Updated weights for policy 0, policy_version 1387809 (0.0007) [2023-12-28 05:14:02,870][106225] Updated weights for policy 1, policy_version 1391107 (0.0007) [2023-12-28 05:14:02,888][106226] Updated weights for policy 0, policy_version 1387819 (0.0007) [2023-12-28 05:14:02,922][106225] Updated weights for policy 1, policy_version 1391117 (0.0006) [2023-12-28 05:14:02,978][106225] Updated weights for policy 1, policy_version 1391127 (0.0008) [2023-12-28 05:14:03,581][106226] Updated weights for policy 0, policy_version 1387829 (0.0005) [2023-12-28 05:14:03,607][106225] Updated weights for policy 1, policy_version 1391137 (0.0006) [2023-12-28 05:14:03,640][106226] Updated weights for policy 0, policy_version 1387839 (0.0007) [2023-12-28 05:14:03,669][106225] Updated weights for policy 1, policy_version 1391147 (0.0005) [2023-12-28 05:14:03,690][106226] Updated weights for policy 0, policy_version 1387849 (0.0008) [2023-12-28 05:14:03,727][106225] Updated weights for policy 1, policy_version 1391157 (0.0005) [2023-12-28 05:14:04,363][106225] Updated weights for policy 1, policy_version 1391167 (0.0006) [2023-12-28 05:14:04,414][106225] Updated weights for policy 1, policy_version 1391177 (0.0006) [2023-12-28 05:14:04,431][106226] Updated weights for policy 0, policy_version 1387859 (0.0008) [2023-12-28 05:14:04,477][106225] Updated weights for policy 1, policy_version 1391187 (0.0006) [2023-12-28 05:14:04,493][106226] Updated weights for policy 0, policy_version 1387869 (0.0005) [2023-12-28 05:14:04,558][106226] Updated weights for policy 0, policy_version 1387879 (0.0005) [2023-12-28 05:14:05,118][106225] Updated weights for policy 1, policy_version 1391197 (0.0007) [2023-12-28 05:14:05,148][106226] Updated weights for policy 0, policy_version 1387889 (0.0006) [2023-12-28 05:14:05,173][106225] Updated weights for policy 1, policy_version 1391207 (0.0006) [2023-12-28 05:14:05,194][106226] Updated weights for policy 0, policy_version 1387899 (0.0010) [2023-12-28 05:14:05,227][106225] Updated weights for policy 1, policy_version 1391217 (0.0005) [2023-12-28 05:14:05,245][106226] Updated weights for policy 0, policy_version 1387909 (0.0011) [2023-12-28 05:14:05,294][106226] Updated weights for policy 0, policy_version 1387919 (0.0010) [2023-12-28 05:14:05,855][106225] Updated weights for policy 1, policy_version 1391227 (0.0006) [2023-12-28 05:14:05,913][106225] Updated weights for policy 1, policy_version 1391237 (0.0008) [2023-12-28 05:14:05,963][106225] Updated weights for policy 1, policy_version 1391247 (0.0008) [2023-12-28 05:14:06,038][106226] Updated weights for policy 0, policy_version 1387929 (0.0011) [2023-12-28 05:14:06,089][106226] Updated weights for policy 0, policy_version 1387939 (0.0010) [2023-12-28 05:14:06,164][106226] Updated weights for policy 0, policy_version 1387949 (0.0011) [2023-12-28 05:14:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 711589888. Throughput: 0: 9706.2, 1: 10134.9. Samples: 711600240. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:06,175][105115] Avg episode reward: [(0, '-5.022'), (1, '-4.880')] [2023-12-28 05:14:06,638][106225] Updated weights for policy 1, policy_version 1391257 (0.0008) [2023-12-28 05:14:06,700][106225] Updated weights for policy 1, policy_version 1391267 (0.0008) [2023-12-28 05:14:06,763][106225] Updated weights for policy 1, policy_version 1391277 (0.0008) [2023-12-28 05:14:06,828][106225] Updated weights for policy 1, policy_version 1391287 (0.0009) [2023-12-28 05:14:06,897][106226] Updated weights for policy 0, policy_version 1387959 (0.0011) [2023-12-28 05:14:06,958][106226] Updated weights for policy 0, policy_version 1387969 (0.0010) [2023-12-28 05:14:07,027][106226] Updated weights for policy 0, policy_version 1387979 (0.0008) [2023-12-28 05:14:07,550][106225] Updated weights for policy 1, policy_version 1391297 (0.0008) [2023-12-28 05:14:07,607][106225] Updated weights for policy 1, policy_version 1391307 (0.0008) [2023-12-28 05:14:07,663][106225] Updated weights for policy 1, policy_version 1391317 (0.0008) [2023-12-28 05:14:07,729][106226] Updated weights for policy 0, policy_version 1387989 (0.0008) [2023-12-28 05:14:07,796][106226] Updated weights for policy 0, policy_version 1387999 (0.0010) [2023-12-28 05:14:07,859][106226] Updated weights for policy 0, policy_version 1388009 (0.0007) [2023-12-28 05:14:08,389][106225] Updated weights for policy 1, policy_version 1391327 (0.0008) [2023-12-28 05:14:08,451][106225] Updated weights for policy 1, policy_version 1391337 (0.0009) [2023-12-28 05:14:08,485][106226] Updated weights for policy 0, policy_version 1388019 (0.0009) [2023-12-28 05:14:08,508][106225] Updated weights for policy 1, policy_version 1391347 (0.0006) [2023-12-28 05:14:08,549][106226] Updated weights for policy 0, policy_version 1388029 (0.0011) [2023-12-28 05:14:08,615][106226] Updated weights for policy 0, policy_version 1388039 (0.0010) [2023-12-28 05:14:09,108][106225] Updated weights for policy 1, policy_version 1391357 (0.0007) [2023-12-28 05:14:09,169][106225] Updated weights for policy 1, policy_version 1391367 (0.0009) [2023-12-28 05:14:09,239][106225] Updated weights for policy 1, policy_version 1391377 (0.0010) [2023-12-28 05:14:09,281][106226] Updated weights for policy 0, policy_version 1388049 (0.0008) [2023-12-28 05:14:09,352][106226] Updated weights for policy 0, policy_version 1388059 (0.0010) [2023-12-28 05:14:09,417][106226] Updated weights for policy 0, policy_version 1388069 (0.0008) [2023-12-28 05:14:09,479][106226] Updated weights for policy 0, policy_version 1388079 (0.0009) [2023-12-28 05:14:10,021][106225] Updated weights for policy 1, policy_version 1391387 (0.0010) [2023-12-28 05:14:10,078][106225] Updated weights for policy 1, policy_version 1391397 (0.0008) [2023-12-28 05:14:10,145][106225] Updated weights for policy 1, policy_version 1391407 (0.0008) [2023-12-28 05:14:10,237][106226] Updated weights for policy 0, policy_version 1388089 (0.0008) [2023-12-28 05:14:10,306][106226] Updated weights for policy 0, policy_version 1388099 (0.0008) [2023-12-28 05:14:10,374][106226] Updated weights for policy 0, policy_version 1388109 (0.0009) [2023-12-28 05:14:10,848][106225] Updated weights for policy 1, policy_version 1391417 (0.0008) [2023-12-28 05:14:10,915][106225] Updated weights for policy 1, policy_version 1391427 (0.0010) [2023-12-28 05:14:10,976][106225] Updated weights for policy 1, policy_version 1391437 (0.0009) [2023-12-28 05:14:11,013][106226] Updated weights for policy 0, policy_version 1388119 (0.0007) [2023-12-28 05:14:11,040][106225] Updated weights for policy 1, policy_version 1391447 (0.0008) [2023-12-28 05:14:11,085][106226] Updated weights for policy 0, policy_version 1388129 (0.0008) [2023-12-28 05:14:11,159][106226] Updated weights for policy 0, policy_version 1388139 (0.0009) [2023-12-28 05:14:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 711688192. Throughput: 0: 9753.1, 1: 10158.3. Samples: 711659880. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:11,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.698')] [2023-12-28 05:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001391448_356261888.pth... [2023-12-28 05:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001390264_355958784.pth [2023-12-28 05:14:11,194][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001388144_355434496.pth... [2023-12-28 05:14:11,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001387024_355147776.pth [2023-12-28 05:14:11,880][106226] Updated weights for policy 0, policy_version 1388149 (0.0007) [2023-12-28 05:14:11,902][106225] Updated weights for policy 1, policy_version 1391457 (0.0007) [2023-12-28 05:14:11,943][106226] Updated weights for policy 0, policy_version 1388159 (0.0007) [2023-12-28 05:14:11,957][106225] Updated weights for policy 1, policy_version 1391467 (0.0006) [2023-12-28 05:14:12,000][106226] Updated weights for policy 0, policy_version 1388169 (0.0006) [2023-12-28 05:14:12,010][106225] Updated weights for policy 1, policy_version 1391477 (0.0008) [2023-12-28 05:14:12,734][106226] Updated weights for policy 0, policy_version 1388179 (0.0008) [2023-12-28 05:14:12,797][106226] Updated weights for policy 0, policy_version 1388189 (0.0007) [2023-12-28 05:14:12,802][106225] Updated weights for policy 1, policy_version 1391487 (0.0008) [2023-12-28 05:14:12,853][106226] Updated weights for policy 0, policy_version 1388199 (0.0006) [2023-12-28 05:14:12,854][106225] Updated weights for policy 1, policy_version 1391497 (0.0006) [2023-12-28 05:14:12,912][106225] Updated weights for policy 1, policy_version 1391507 (0.0008) [2023-12-28 05:14:13,564][106226] Updated weights for policy 0, policy_version 1388209 (0.0010) [2023-12-28 05:14:13,584][106225] Updated weights for policy 1, policy_version 1391517 (0.0009) [2023-12-28 05:14:13,622][106226] Updated weights for policy 0, policy_version 1388219 (0.0007) [2023-12-28 05:14:13,641][106225] Updated weights for policy 1, policy_version 1391527 (0.0007) [2023-12-28 05:14:13,680][106226] Updated weights for policy 0, policy_version 1388229 (0.0010) [2023-12-28 05:14:13,695][106225] Updated weights for policy 1, policy_version 1391537 (0.0006) [2023-12-28 05:14:13,737][106226] Updated weights for policy 0, policy_version 1388239 (0.0006) [2023-12-28 05:14:14,277][106225] Updated weights for policy 1, policy_version 1391547 (0.0006) [2023-12-28 05:14:14,328][106225] Updated weights for policy 1, policy_version 1391557 (0.0008) [2023-12-28 05:14:14,386][106225] Updated weights for policy 1, policy_version 1391567 (0.0006) [2023-12-28 05:14:14,404][106226] Updated weights for policy 0, policy_version 1388249 (0.0010) [2023-12-28 05:14:14,465][106226] Updated weights for policy 0, policy_version 1388259 (0.0011) [2023-12-28 05:14:14,524][106226] Updated weights for policy 0, policy_version 1388269 (0.0010) [2023-12-28 05:14:15,130][106225] Updated weights for policy 1, policy_version 1391577 (0.0006) [2023-12-28 05:14:15,192][106225] Updated weights for policy 1, policy_version 1391587 (0.0008) [2023-12-28 05:14:15,257][106225] Updated weights for policy 1, policy_version 1391597 (0.0008) [2023-12-28 05:14:15,301][106226] Updated weights for policy 0, policy_version 1388279 (0.0011) [2023-12-28 05:14:15,315][106225] Updated weights for policy 1, policy_version 1391607 (0.0007) [2023-12-28 05:14:15,360][106226] Updated weights for policy 0, policy_version 1388289 (0.0011) [2023-12-28 05:14:15,425][106226] Updated weights for policy 0, policy_version 1388299 (0.0009) [2023-12-28 05:14:16,052][106225] Updated weights for policy 1, policy_version 1391617 (0.0008) [2023-12-28 05:14:16,101][106226] Updated weights for policy 0, policy_version 1388309 (0.0008) [2023-12-28 05:14:16,114][106225] Updated weights for policy 1, policy_version 1391627 (0.0008) [2023-12-28 05:14:16,152][106226] Updated weights for policy 0, policy_version 1388319 (0.0007) [2023-12-28 05:14:16,170][106225] Updated weights for policy 1, policy_version 1391637 (0.0008) [2023-12-28 05:14:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 711778304. Throughput: 0: 9683.6, 1: 10022.6. Samples: 711775612. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:16,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.555')] [2023-12-28 05:14:16,210][106226] Updated weights for policy 0, policy_version 1388329 (0.0008) [2023-12-28 05:14:16,792][106226] Updated weights for policy 0, policy_version 1388339 (0.0009) [2023-12-28 05:14:16,848][106226] Updated weights for policy 0, policy_version 1388349 (0.0005) [2023-12-28 05:14:16,903][106226] Updated weights for policy 0, policy_version 1388359 (0.0005) [2023-12-28 05:14:16,964][106225] Updated weights for policy 1, policy_version 1391647 (0.0009) [2023-12-28 05:14:17,021][106225] Updated weights for policy 1, policy_version 1391657 (0.0007) [2023-12-28 05:14:17,094][106225] Updated weights for policy 1, policy_version 1391667 (0.0008) [2023-12-28 05:14:17,415][106226] Updated weights for policy 0, policy_version 1388369 (0.0005) [2023-12-28 05:14:17,477][106226] Updated weights for policy 0, policy_version 1388379 (0.0005) [2023-12-28 05:14:17,537][106226] Updated weights for policy 0, policy_version 1388389 (0.0006) [2023-12-28 05:14:17,597][106226] Updated weights for policy 0, policy_version 1388399 (0.0005) [2023-12-28 05:14:17,934][106225] Updated weights for policy 1, policy_version 1391677 (0.0010) [2023-12-28 05:14:17,990][106225] Updated weights for policy 1, policy_version 1391687 (0.0008) [2023-12-28 05:14:18,055][106225] Updated weights for policy 1, policy_version 1391697 (0.0008) [2023-12-28 05:14:18,102][106226] Updated weights for policy 0, policy_version 1388409 (0.0010) [2023-12-28 05:14:18,148][106226] Updated weights for policy 0, policy_version 1388419 (0.0010) [2023-12-28 05:14:18,203][106226] Updated weights for policy 0, policy_version 1388429 (0.0006) [2023-12-28 05:14:18,760][106225] Updated weights for policy 1, policy_version 1391707 (0.0007) [2023-12-28 05:14:18,807][106225] Updated weights for policy 1, policy_version 1391717 (0.0008) [2023-12-28 05:14:18,856][106225] Updated weights for policy 1, policy_version 1391727 (0.0008) [2023-12-28 05:14:18,897][106226] Updated weights for policy 0, policy_version 1388439 (0.0009) [2023-12-28 05:14:18,957][106226] Updated weights for policy 0, policy_version 1388449 (0.0010) [2023-12-28 05:14:19,010][106226] Updated weights for policy 0, policy_version 1388459 (0.0010) [2023-12-28 05:14:19,604][106225] Updated weights for policy 1, policy_version 1391737 (0.0006) [2023-12-28 05:14:19,669][106225] Updated weights for policy 1, policy_version 1391747 (0.0008) [2023-12-28 05:14:19,731][106225] Updated weights for policy 1, policy_version 1391757 (0.0007) [2023-12-28 05:14:19,741][106226] Updated weights for policy 0, policy_version 1388469 (0.0010) [2023-12-28 05:14:19,797][106225] Updated weights for policy 1, policy_version 1391767 (0.0007) [2023-12-28 05:14:19,803][106226] Updated weights for policy 0, policy_version 1388479 (0.0009) [2023-12-28 05:14:19,874][106226] Updated weights for policy 0, policy_version 1388489 (0.0009) [2023-12-28 05:14:20,508][106225] Updated weights for policy 1, policy_version 1391777 (0.0008) [2023-12-28 05:14:20,563][106225] Updated weights for policy 1, policy_version 1391787 (0.0007) [2023-12-28 05:14:20,607][106226] Updated weights for policy 0, policy_version 1388499 (0.0011) [2023-12-28 05:14:20,628][106225] Updated weights for policy 1, policy_version 1391797 (0.0010) [2023-12-28 05:14:20,662][106226] Updated weights for policy 0, policy_version 1388509 (0.0011) [2023-12-28 05:14:20,720][106226] Updated weights for policy 0, policy_version 1388519 (0.0011) [2023-12-28 05:14:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 711884800. Throughput: 0: 9739.4, 1: 9937.3. Samples: 711894480. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:21,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.672')] [2023-12-28 05:14:21,385][106225] Updated weights for policy 1, policy_version 1391807 (0.0010) [2023-12-28 05:14:21,426][106226] Updated weights for policy 0, policy_version 1388529 (0.0010) [2023-12-28 05:14:21,450][106225] Updated weights for policy 1, policy_version 1391817 (0.0009) [2023-12-28 05:14:21,483][106226] Updated weights for policy 0, policy_version 1388539 (0.0008) [2023-12-28 05:14:21,510][106225] Updated weights for policy 1, policy_version 1391827 (0.0008) [2023-12-28 05:14:21,546][106226] Updated weights for policy 0, policy_version 1388549 (0.0006) [2023-12-28 05:14:21,611][106226] Updated weights for policy 0, policy_version 1388559 (0.0008) [2023-12-28 05:14:22,284][106225] Updated weights for policy 1, policy_version 1391837 (0.0009) [2023-12-28 05:14:22,346][106225] Updated weights for policy 1, policy_version 1391847 (0.0010) [2023-12-28 05:14:22,374][106226] Updated weights for policy 0, policy_version 1388569 (0.0011) [2023-12-28 05:14:22,415][106225] Updated weights for policy 1, policy_version 1391857 (0.0007) [2023-12-28 05:14:22,432][106226] Updated weights for policy 0, policy_version 1388579 (0.0011) [2023-12-28 05:14:22,490][106226] Updated weights for policy 0, policy_version 1388589 (0.0011) [2023-12-28 05:14:23,119][106226] Updated weights for policy 0, policy_version 1388599 (0.0011) [2023-12-28 05:14:23,125][106225] Updated weights for policy 1, policy_version 1391867 (0.0006) [2023-12-28 05:14:23,169][106225] Updated weights for policy 1, policy_version 1391877 (0.0005) [2023-12-28 05:14:23,174][106226] Updated weights for policy 0, policy_version 1388609 (0.0009) [2023-12-28 05:14:23,220][106225] Updated weights for policy 1, policy_version 1391887 (0.0007) [2023-12-28 05:14:23,231][106226] Updated weights for policy 0, policy_version 1388619 (0.0009) [2023-12-28 05:14:23,907][106226] Updated weights for policy 0, policy_version 1388629 (0.0010) [2023-12-28 05:14:23,956][106225] Updated weights for policy 1, policy_version 1391897 (0.0005) [2023-12-28 05:14:23,964][106226] Updated weights for policy 0, policy_version 1388639 (0.0010) [2023-12-28 05:14:24,013][106225] Updated weights for policy 1, policy_version 1391907 (0.0008) [2023-12-28 05:14:24,030][106226] Updated weights for policy 0, policy_version 1388649 (0.0010) [2023-12-28 05:14:24,070][106225] Updated weights for policy 1, policy_version 1391917 (0.0005) [2023-12-28 05:14:24,139][106225] Updated weights for policy 1, policy_version 1391927 (0.0008) [2023-12-28 05:14:24,739][106225] Updated weights for policy 1, policy_version 1391937 (0.0006) [2023-12-28 05:14:24,759][106226] Updated weights for policy 0, policy_version 1388659 (0.0010) [2023-12-28 05:14:24,803][106225] Updated weights for policy 1, policy_version 1391947 (0.0007) [2023-12-28 05:14:24,815][106226] Updated weights for policy 0, policy_version 1388669 (0.0008) [2023-12-28 05:14:24,859][106225] Updated weights for policy 1, policy_version 1391957 (0.0010) [2023-12-28 05:14:24,877][106226] Updated weights for policy 0, policy_version 1388679 (0.0010) [2023-12-28 05:14:25,437][106225] Updated weights for policy 1, policy_version 1391967 (0.0007) [2023-12-28 05:14:25,501][106225] Updated weights for policy 1, policy_version 1391977 (0.0007) [2023-12-28 05:14:25,567][106225] Updated weights for policy 1, policy_version 1391987 (0.0008) [2023-12-28 05:14:25,589][106226] Updated weights for policy 0, policy_version 1388689 (0.0011) [2023-12-28 05:14:25,654][106226] Updated weights for policy 0, policy_version 1388699 (0.0011) [2023-12-28 05:14:25,714][106226] Updated weights for policy 0, policy_version 1388709 (0.0010) [2023-12-28 05:14:25,776][106226] Updated weights for policy 0, policy_version 1388719 (0.0011) [2023-12-28 05:14:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 711983104. Throughput: 0: 9744.8, 1: 9846.7. Samples: 711952252. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:26,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.571')] [2023-12-28 05:14:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001388720_355581952.pth... [2023-12-28 05:14:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001391992_356401152.pth... [2023-12-28 05:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001390872_356114432.pth [2023-12-28 05:14:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001387568_355287040.pth [2023-12-28 05:14:26,272][106225] Updated weights for policy 1, policy_version 1391997 (0.0006) [2023-12-28 05:14:26,342][106225] Updated weights for policy 1, policy_version 1392007 (0.0006) [2023-12-28 05:14:26,406][106225] Updated weights for policy 1, policy_version 1392017 (0.0006) [2023-12-28 05:14:26,493][106226] Updated weights for policy 0, policy_version 1388729 (0.0010) [2023-12-28 05:14:26,549][106226] Updated weights for policy 0, policy_version 1388739 (0.0011) [2023-12-28 05:14:26,599][106226] Updated weights for policy 0, policy_version 1388749 (0.0010) [2023-12-28 05:14:26,970][106225] Updated weights for policy 1, policy_version 1392027 (0.0008) [2023-12-28 05:14:27,025][106225] Updated weights for policy 1, policy_version 1392037 (0.0007) [2023-12-28 05:14:27,080][106225] Updated weights for policy 1, policy_version 1392047 (0.0007) [2023-12-28 05:14:27,321][106226] Updated weights for policy 0, policy_version 1388759 (0.0011) [2023-12-28 05:14:27,378][106226] Updated weights for policy 0, policy_version 1388769 (0.0010) [2023-12-28 05:14:27,437][106226] Updated weights for policy 0, policy_version 1388779 (0.0010) [2023-12-28 05:14:27,723][106225] Updated weights for policy 1, policy_version 1392057 (0.0008) [2023-12-28 05:14:27,776][106225] Updated weights for policy 1, policy_version 1392067 (0.0007) [2023-12-28 05:14:27,831][106225] Updated weights for policy 1, policy_version 1392077 (0.0007) [2023-12-28 05:14:27,884][106225] Updated weights for policy 1, policy_version 1392087 (0.0007) [2023-12-28 05:14:28,139][106226] Updated weights for policy 0, policy_version 1388789 (0.0010) [2023-12-28 05:14:28,192][106226] Updated weights for policy 0, policy_version 1388799 (0.0010) [2023-12-28 05:14:28,238][106226] Updated weights for policy 0, policy_version 1388809 (0.0010) [2023-12-28 05:14:28,616][106225] Updated weights for policy 1, policy_version 1392097 (0.0007) [2023-12-28 05:14:28,666][106225] Updated weights for policy 1, policy_version 1392107 (0.0008) [2023-12-28 05:14:28,724][106225] Updated weights for policy 1, policy_version 1392117 (0.0007) [2023-12-28 05:14:28,984][106226] Updated weights for policy 0, policy_version 1388819 (0.0009) [2023-12-28 05:14:29,032][106226] Updated weights for policy 0, policy_version 1388829 (0.0008) [2023-12-28 05:14:29,086][106226] Updated weights for policy 0, policy_version 1388839 (0.0009) [2023-12-28 05:14:29,401][106225] Updated weights for policy 1, policy_version 1392127 (0.0007) [2023-12-28 05:14:29,459][106225] Updated weights for policy 1, policy_version 1392137 (0.0009) [2023-12-28 05:14:29,514][106225] Updated weights for policy 1, policy_version 1392147 (0.0008) [2023-12-28 05:14:29,817][106226] Updated weights for policy 0, policy_version 1388849 (0.0008) [2023-12-28 05:14:29,885][106226] Updated weights for policy 0, policy_version 1388859 (0.0009) [2023-12-28 05:14:29,956][106226] Updated weights for policy 0, policy_version 1388869 (0.0008) [2023-12-28 05:14:30,018][106226] Updated weights for policy 0, policy_version 1388879 (0.0009) [2023-12-28 05:14:30,255][106225] Updated weights for policy 1, policy_version 1392157 (0.0008) [2023-12-28 05:14:30,309][106225] Updated weights for policy 1, policy_version 1392167 (0.0009) [2023-12-28 05:14:30,364][106225] Updated weights for policy 1, policy_version 1392177 (0.0009) [2023-12-28 05:14:30,759][106226] Updated weights for policy 0, policy_version 1388889 (0.0009) [2023-12-28 05:14:30,806][106226] Updated weights for policy 0, policy_version 1388899 (0.0009) [2023-12-28 05:14:30,849][106226] Updated weights for policy 0, policy_version 1388909 (0.0009) [2023-12-28 05:14:31,119][106225] Updated weights for policy 1, policy_version 1392187 (0.0009) [2023-12-28 05:14:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 712081408. Throughput: 0: 9761.6, 1: 9946.3. Samples: 712072456. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:31,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-4.882')] [2023-12-28 05:14:31,190][106225] Updated weights for policy 1, policy_version 1392197 (0.0009) [2023-12-28 05:14:31,244][106225] Updated weights for policy 1, policy_version 1392207 (0.0009) [2023-12-28 05:14:31,616][106226] Updated weights for policy 0, policy_version 1388919 (0.0008) [2023-12-28 05:14:31,680][106226] Updated weights for policy 0, policy_version 1388929 (0.0009) [2023-12-28 05:14:31,737][106226] Updated weights for policy 0, policy_version 1388939 (0.0007) [2023-12-28 05:14:31,972][106225] Updated weights for policy 1, policy_version 1392217 (0.0007) [2023-12-28 05:14:32,037][106225] Updated weights for policy 1, policy_version 1392227 (0.0005) [2023-12-28 05:14:32,104][106225] Updated weights for policy 1, policy_version 1392237 (0.0006) [2023-12-28 05:14:32,170][106225] Updated weights for policy 1, policy_version 1392247 (0.0008) [2023-12-28 05:14:32,440][106226] Updated weights for policy 0, policy_version 1388949 (0.0008) [2023-12-28 05:14:32,506][106226] Updated weights for policy 0, policy_version 1388959 (0.0009) [2023-12-28 05:14:32,555][106226] Updated weights for policy 0, policy_version 1388969 (0.0009) [2023-12-28 05:14:32,796][106225] Updated weights for policy 1, policy_version 1392257 (0.0008) [2023-12-28 05:14:32,850][106225] Updated weights for policy 1, policy_version 1392267 (0.0007) [2023-12-28 05:14:32,911][106225] Updated weights for policy 1, policy_version 1392277 (0.0007) [2023-12-28 05:14:33,306][106226] Updated weights for policy 0, policy_version 1388979 (0.0007) [2023-12-28 05:14:33,365][106226] Updated weights for policy 0, policy_version 1388989 (0.0005) [2023-12-28 05:14:33,413][106226] Updated weights for policy 0, policy_version 1388999 (0.0005) [2023-12-28 05:14:33,508][106225] Updated weights for policy 1, policy_version 1392287 (0.0009) [2023-12-28 05:14:33,570][106225] Updated weights for policy 1, policy_version 1392297 (0.0010) [2023-12-28 05:14:33,619][106225] Updated weights for policy 1, policy_version 1392307 (0.0010) [2023-12-28 05:14:34,040][106226] Updated weights for policy 0, policy_version 1389009 (0.0005) [2023-12-28 05:14:34,097][106226] Updated weights for policy 0, policy_version 1389019 (0.0008) [2023-12-28 05:14:34,158][106226] Updated weights for policy 0, policy_version 1389029 (0.0008) [2023-12-28 05:14:34,218][106226] Updated weights for policy 0, policy_version 1389039 (0.0007) [2023-12-28 05:14:34,339][106225] Updated weights for policy 1, policy_version 1392317 (0.0009) [2023-12-28 05:14:34,397][106225] Updated weights for policy 1, policy_version 1392327 (0.0008) [2023-12-28 05:14:34,460][106225] Updated weights for policy 1, policy_version 1392337 (0.0008) [2023-12-28 05:14:34,917][106226] Updated weights for policy 0, policy_version 1389049 (0.0006) [2023-12-28 05:14:34,978][106226] Updated weights for policy 0, policy_version 1389059 (0.0006) [2023-12-28 05:14:35,031][106226] Updated weights for policy 0, policy_version 1389069 (0.0009) [2023-12-28 05:14:35,129][106225] Updated weights for policy 1, policy_version 1392347 (0.0007) [2023-12-28 05:14:35,187][106225] Updated weights for policy 1, policy_version 1392357 (0.0008) [2023-12-28 05:14:35,235][106225] Updated weights for policy 1, policy_version 1392367 (0.0008) [2023-12-28 05:14:35,641][106226] Updated weights for policy 0, policy_version 1389079 (0.0008) [2023-12-28 05:14:35,697][106226] Updated weights for policy 0, policy_version 1389089 (0.0009) [2023-12-28 05:14:35,745][106226] Updated weights for policy 0, policy_version 1389099 (0.0009) [2023-12-28 05:14:36,010][106225] Updated weights for policy 1, policy_version 1392377 (0.0009) [2023-12-28 05:14:36,059][106225] Updated weights for policy 1, policy_version 1392387 (0.0008) [2023-12-28 05:14:36,110][106225] Updated weights for policy 1, policy_version 1392397 (0.0009) [2023-12-28 05:14:36,172][106225] Updated weights for policy 1, policy_version 1392407 (0.0007) [2023-12-28 05:14:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 712187904. Throughput: 0: 9893.4, 1: 9902.2. Samples: 712192380. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:36,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.682')] [2023-12-28 05:14:36,462][106226] Updated weights for policy 0, policy_version 1389109 (0.0007) [2023-12-28 05:14:36,512][106226] Updated weights for policy 0, policy_version 1389119 (0.0005) [2023-12-28 05:14:36,564][106226] Updated weights for policy 0, policy_version 1389129 (0.0006) [2023-12-28 05:14:36,929][106225] Updated weights for policy 1, policy_version 1392417 (0.0009) [2023-12-28 05:14:36,990][106225] Updated weights for policy 1, policy_version 1392427 (0.0008) [2023-12-28 05:14:37,051][106225] Updated weights for policy 1, policy_version 1392437 (0.0009) [2023-12-28 05:14:37,295][106226] Updated weights for policy 0, policy_version 1389139 (0.0006) [2023-12-28 05:14:37,356][106226] Updated weights for policy 0, policy_version 1389149 (0.0006) [2023-12-28 05:14:37,411][106226] Updated weights for policy 0, policy_version 1389159 (0.0009) [2023-12-28 05:14:37,754][106225] Updated weights for policy 1, policy_version 1392447 (0.0008) [2023-12-28 05:14:37,818][106225] Updated weights for policy 1, policy_version 1392457 (0.0008) [2023-12-28 05:14:37,874][106225] Updated weights for policy 1, policy_version 1392467 (0.0006) [2023-12-28 05:14:38,163][106226] Updated weights for policy 0, policy_version 1389169 (0.0009) [2023-12-28 05:14:38,225][106226] Updated weights for policy 0, policy_version 1389179 (0.0009) [2023-12-28 05:14:38,281][106226] Updated weights for policy 0, policy_version 1389189 (0.0009) [2023-12-28 05:14:38,337][106226] Updated weights for policy 0, policy_version 1389199 (0.0008) [2023-12-28 05:14:38,471][106225] Updated weights for policy 1, policy_version 1392477 (0.0006) [2023-12-28 05:14:38,530][106225] Updated weights for policy 1, policy_version 1392487 (0.0009) [2023-12-28 05:14:38,592][106225] Updated weights for policy 1, policy_version 1392497 (0.0010) [2023-12-28 05:14:39,044][106226] Updated weights for policy 0, policy_version 1389209 (0.0009) [2023-12-28 05:14:39,099][106226] Updated weights for policy 0, policy_version 1389219 (0.0009) [2023-12-28 05:14:39,150][106226] Updated weights for policy 0, policy_version 1389229 (0.0010) [2023-12-28 05:14:39,252][106225] Updated weights for policy 1, policy_version 1392507 (0.0010) [2023-12-28 05:14:39,314][106225] Updated weights for policy 1, policy_version 1392517 (0.0009) [2023-12-28 05:14:39,374][106225] Updated weights for policy 1, policy_version 1392527 (0.0009) [2023-12-28 05:14:40,007][106226] Updated weights for policy 0, policy_version 1389239 (0.0008) [2023-12-28 05:14:40,072][106225] Updated weights for policy 1, policy_version 1392537 (0.0009) [2023-12-28 05:14:40,075][106226] Updated weights for policy 0, policy_version 1389249 (0.0006) [2023-12-28 05:14:40,130][106225] Updated weights for policy 1, policy_version 1392547 (0.0010) [2023-12-28 05:14:40,135][106226] Updated weights for policy 0, policy_version 1389259 (0.0009) [2023-12-28 05:14:40,193][106225] Updated weights for policy 1, policy_version 1392557 (0.0011) [2023-12-28 05:14:40,255][106225] Updated weights for policy 1, policy_version 1392567 (0.0007) [2023-12-28 05:14:40,874][106226] Updated weights for policy 0, policy_version 1389269 (0.0007) [2023-12-28 05:14:40,934][106226] Updated weights for policy 0, policy_version 1389279 (0.0008) [2023-12-28 05:14:40,940][106225] Updated weights for policy 1, policy_version 1392577 (0.0007) [2023-12-28 05:14:40,994][106226] Updated weights for policy 0, policy_version 1389289 (0.0008) [2023-12-28 05:14:40,996][106225] Updated weights for policy 1, policy_version 1392587 (0.0007) [2023-12-28 05:14:41,060][106225] Updated weights for policy 1, policy_version 1392597 (0.0008) [2023-12-28 05:14:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 712286208. Throughput: 0: 9916.8, 1: 9886.6. Samples: 712250484. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:41,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.853')] [2023-12-28 05:14:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001392600_356556800.pth... [2023-12-28 05:14:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001389296_355729408.pth... [2023-12-28 05:14:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001391448_356261888.pth [2023-12-28 05:14:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001388144_355434496.pth [2023-12-28 05:14:41,815][106226] Updated weights for policy 0, policy_version 1389299 (0.0007) [2023-12-28 05:14:41,885][106226] Updated weights for policy 0, policy_version 1389309 (0.0007) [2023-12-28 05:14:41,907][106225] Updated weights for policy 1, policy_version 1392607 (0.0008) [2023-12-28 05:14:41,958][106226] Updated weights for policy 0, policy_version 1389319 (0.0007) [2023-12-28 05:14:41,972][106225] Updated weights for policy 1, policy_version 1392617 (0.0007) [2023-12-28 05:14:42,039][106225] Updated weights for policy 1, policy_version 1392627 (0.0007) [2023-12-28 05:14:42,654][106226] Updated weights for policy 0, policy_version 1389329 (0.0007) [2023-12-28 05:14:42,704][106226] Updated weights for policy 0, policy_version 1389339 (0.0009) [2023-12-28 05:14:42,758][106226] Updated weights for policy 0, policy_version 1389349 (0.0009) [2023-12-28 05:14:42,809][106225] Updated weights for policy 1, policy_version 1392637 (0.0007) [2023-12-28 05:14:42,822][106226] Updated weights for policy 0, policy_version 1389359 (0.0008) [2023-12-28 05:14:42,869][106225] Updated weights for policy 1, policy_version 1392647 (0.0007) [2023-12-28 05:14:42,926][106225] Updated weights for policy 1, policy_version 1392657 (0.0008) [2023-12-28 05:14:43,530][106226] Updated weights for policy 0, policy_version 1389369 (0.0008) [2023-12-28 05:14:43,584][106226] Updated weights for policy 0, policy_version 1389379 (0.0008) [2023-12-28 05:14:43,636][106226] Updated weights for policy 0, policy_version 1389389 (0.0008) [2023-12-28 05:14:43,642][106225] Updated weights for policy 1, policy_version 1392667 (0.0008) [2023-12-28 05:14:43,696][106225] Updated weights for policy 1, policy_version 1392677 (0.0008) [2023-12-28 05:14:43,756][106225] Updated weights for policy 1, policy_version 1392687 (0.0008) [2023-12-28 05:14:44,243][106226] Updated weights for policy 0, policy_version 1389399 (0.0008) [2023-12-28 05:14:44,296][106226] Updated weights for policy 0, policy_version 1389409 (0.0007) [2023-12-28 05:14:44,357][106226] Updated weights for policy 0, policy_version 1389419 (0.0008) [2023-12-28 05:14:44,370][106225] Updated weights for policy 1, policy_version 1392697 (0.0009) [2023-12-28 05:14:44,422][106225] Updated weights for policy 1, policy_version 1392707 (0.0005) [2023-12-28 05:14:44,477][106225] Updated weights for policy 1, policy_version 1392717 (0.0005) [2023-12-28 05:14:44,547][106225] Updated weights for policy 1, policy_version 1392727 (0.0006) [2023-12-28 05:14:45,108][106226] Updated weights for policy 0, policy_version 1389429 (0.0008) [2023-12-28 05:14:45,142][106225] Updated weights for policy 1, policy_version 1392737 (0.0010) [2023-12-28 05:14:45,168][106226] Updated weights for policy 0, policy_version 1389439 (0.0008) [2023-12-28 05:14:45,201][106225] Updated weights for policy 1, policy_version 1392747 (0.0010) [2023-12-28 05:14:45,230][106226] Updated weights for policy 0, policy_version 1389449 (0.0006) [2023-12-28 05:14:45,264][106225] Updated weights for policy 1, policy_version 1392757 (0.0010) [2023-12-28 05:14:45,846][106226] Updated weights for policy 0, policy_version 1389459 (0.0006) [2023-12-28 05:14:45,898][106226] Updated weights for policy 0, policy_version 1389469 (0.0005) [2023-12-28 05:14:45,939][106225] Updated weights for policy 1, policy_version 1392767 (0.0011) [2023-12-28 05:14:45,953][106226] Updated weights for policy 0, policy_version 1389479 (0.0005) [2023-12-28 05:14:45,992][106225] Updated weights for policy 1, policy_version 1392777 (0.0007) [2023-12-28 05:14:46,052][106225] Updated weights for policy 1, policy_version 1392787 (0.0006) [2023-12-28 05:14:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 712384512. Throughput: 0: 9880.5, 1: 9873.7. Samples: 712367128. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:46,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-4.728')] [2023-12-28 05:14:46,546][106226] Updated weights for policy 0, policy_version 1389489 (0.0007) [2023-12-28 05:14:46,600][106226] Updated weights for policy 0, policy_version 1389499 (0.0005) [2023-12-28 05:14:46,652][106226] Updated weights for policy 0, policy_version 1389509 (0.0005) [2023-12-28 05:14:46,712][106226] Updated weights for policy 0, policy_version 1389519 (0.0005) [2023-12-28 05:14:46,751][106225] Updated weights for policy 1, policy_version 1392797 (0.0010) [2023-12-28 05:14:46,817][106225] Updated weights for policy 1, policy_version 1392807 (0.0010) [2023-12-28 05:14:46,873][106225] Updated weights for policy 1, policy_version 1392817 (0.0010) [2023-12-28 05:14:47,306][106226] Updated weights for policy 0, policy_version 1389529 (0.0005) [2023-12-28 05:14:47,365][106226] Updated weights for policy 0, policy_version 1389539 (0.0005) [2023-12-28 05:14:47,418][106226] Updated weights for policy 0, policy_version 1389549 (0.0005) [2023-12-28 05:14:47,532][106225] Updated weights for policy 1, policy_version 1392827 (0.0009) [2023-12-28 05:14:47,604][106225] Updated weights for policy 1, policy_version 1392837 (0.0005) [2023-12-28 05:14:47,670][106225] Updated weights for policy 1, policy_version 1392847 (0.0005) [2023-12-28 05:14:48,019][106226] Updated weights for policy 0, policy_version 1389559 (0.0006) [2023-12-28 05:14:48,084][106226] Updated weights for policy 0, policy_version 1389569 (0.0005) [2023-12-28 05:14:48,150][106226] Updated weights for policy 0, policy_version 1389579 (0.0006) [2023-12-28 05:14:48,337][106225] Updated weights for policy 1, policy_version 1392857 (0.0008) [2023-12-28 05:14:48,398][106225] Updated weights for policy 1, policy_version 1392867 (0.0010) [2023-12-28 05:14:48,460][106225] Updated weights for policy 1, policy_version 1392877 (0.0010) [2023-12-28 05:14:48,520][106225] Updated weights for policy 1, policy_version 1392887 (0.0010) [2023-12-28 05:14:48,784][106226] Updated weights for policy 0, policy_version 1389589 (0.0008) [2023-12-28 05:14:48,849][106226] Updated weights for policy 0, policy_version 1389599 (0.0011) [2023-12-28 05:14:48,913][106226] Updated weights for policy 0, policy_version 1389609 (0.0007) [2023-12-28 05:14:49,160][106225] Updated weights for policy 1, policy_version 1392897 (0.0010) [2023-12-28 05:14:49,226][106225] Updated weights for policy 1, policy_version 1392907 (0.0010) [2023-12-28 05:14:49,292][106225] Updated weights for policy 1, policy_version 1392917 (0.0010) [2023-12-28 05:14:49,522][106226] Updated weights for policy 0, policy_version 1389619 (0.0007) [2023-12-28 05:14:49,579][106226] Updated weights for policy 0, policy_version 1389629 (0.0010) [2023-12-28 05:14:49,642][106226] Updated weights for policy 0, policy_version 1389639 (0.0010) [2023-12-28 05:14:49,997][106225] Updated weights for policy 1, policy_version 1392927 (0.0010) [2023-12-28 05:14:50,055][106225] Updated weights for policy 1, policy_version 1392937 (0.0010) [2023-12-28 05:14:50,119][106225] Updated weights for policy 1, policy_version 1392947 (0.0010) [2023-12-28 05:14:50,340][106226] Updated weights for policy 0, policy_version 1389649 (0.0011) [2023-12-28 05:14:50,387][106226] Updated weights for policy 0, policy_version 1389659 (0.0010) [2023-12-28 05:14:50,447][106226] Updated weights for policy 0, policy_version 1389669 (0.0010) [2023-12-28 05:14:50,510][106226] Updated weights for policy 0, policy_version 1389679 (0.0010) [2023-12-28 05:14:50,862][106225] Updated weights for policy 1, policy_version 1392957 (0.0008) [2023-12-28 05:14:50,926][106225] Updated weights for policy 1, policy_version 1392967 (0.0010) [2023-12-28 05:14:50,981][106225] Updated weights for policy 1, policy_version 1392977 (0.0011) [2023-12-28 05:14:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 712482816. Throughput: 0: 9971.0, 1: 9837.7. Samples: 712491632. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:51,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-4.553')] [2023-12-28 05:14:51,297][106226] Updated weights for policy 0, policy_version 1389689 (0.0008) [2023-12-28 05:14:51,368][106226] Updated weights for policy 0, policy_version 1389699 (0.0008) [2023-12-28 05:14:51,426][106226] Updated weights for policy 0, policy_version 1389709 (0.0008) [2023-12-28 05:14:51,772][106225] Updated weights for policy 1, policy_version 1392987 (0.0009) [2023-12-28 05:14:51,837][106225] Updated weights for policy 1, policy_version 1392997 (0.0006) [2023-12-28 05:14:51,889][106225] Updated weights for policy 1, policy_version 1393007 (0.0005) [2023-12-28 05:14:52,140][106226] Updated weights for policy 0, policy_version 1389719 (0.0008) [2023-12-28 05:14:52,201][106226] Updated weights for policy 0, policy_version 1389729 (0.0008) [2023-12-28 05:14:52,264][106226] Updated weights for policy 0, policy_version 1389739 (0.0008) [2023-12-28 05:14:52,545][106225] Updated weights for policy 1, policy_version 1393017 (0.0006) [2023-12-28 05:14:52,607][106225] Updated weights for policy 1, policy_version 1393027 (0.0010) [2023-12-28 05:14:52,671][106225] Updated weights for policy 1, policy_version 1393037 (0.0011) [2023-12-28 05:14:52,735][106225] Updated weights for policy 1, policy_version 1393047 (0.0010) [2023-12-28 05:14:53,001][106226] Updated weights for policy 0, policy_version 1389749 (0.0008) [2023-12-28 05:14:53,055][106226] Updated weights for policy 0, policy_version 1389759 (0.0009) [2023-12-28 05:14:53,107][106226] Updated weights for policy 0, policy_version 1389769 (0.0008) [2023-12-28 05:14:53,330][106225] Updated weights for policy 1, policy_version 1393057 (0.0006) [2023-12-28 05:14:53,385][106225] Updated weights for policy 1, policy_version 1393067 (0.0005) [2023-12-28 05:14:53,440][106225] Updated weights for policy 1, policy_version 1393077 (0.0005) [2023-12-28 05:14:53,950][106225] Updated weights for policy 1, policy_version 1393087 (0.0009) [2023-12-28 05:14:53,974][106226] Updated weights for policy 0, policy_version 1389779 (0.0007) [2023-12-28 05:14:54,013][106225] Updated weights for policy 1, policy_version 1393097 (0.0009) [2023-12-28 05:14:54,038][106226] Updated weights for policy 0, policy_version 1389789 (0.0007) [2023-12-28 05:14:54,074][106225] Updated weights for policy 1, policy_version 1393107 (0.0010) [2023-12-28 05:14:54,091][106226] Updated weights for policy 0, policy_version 1389799 (0.0005) [2023-12-28 05:14:54,701][106225] Updated weights for policy 1, policy_version 1393117 (0.0008) [2023-12-28 05:14:54,762][106225] Updated weights for policy 1, policy_version 1393127 (0.0005) [2023-12-28 05:14:54,815][106225] Updated weights for policy 1, policy_version 1393137 (0.0005) [2023-12-28 05:14:54,862][106226] Updated weights for policy 0, policy_version 1389809 (0.0007) [2023-12-28 05:14:54,919][106226] Updated weights for policy 0, policy_version 1389819 (0.0007) [2023-12-28 05:14:54,966][106226] Updated weights for policy 0, policy_version 1389829 (0.0008) [2023-12-28 05:14:55,019][106226] Updated weights for policy 0, policy_version 1389839 (0.0007) [2023-12-28 05:14:55,437][106225] Updated weights for policy 1, policy_version 1393147 (0.0006) [2023-12-28 05:14:55,497][106225] Updated weights for policy 1, policy_version 1393157 (0.0005) [2023-12-28 05:14:55,568][106225] Updated weights for policy 1, policy_version 1393167 (0.0009) [2023-12-28 05:14:55,645][106226] Updated weights for policy 0, policy_version 1389849 (0.0006) [2023-12-28 05:14:55,699][106226] Updated weights for policy 0, policy_version 1389859 (0.0008) [2023-12-28 05:14:55,769][106226] Updated weights for policy 0, policy_version 1389869 (0.0009) [2023-12-28 05:14:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 712581120. Throughput: 0: 9905.7, 1: 9872.6. Samples: 712549904. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:14:56,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.754')] [2023-12-28 05:14:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001389872_355876864.pth... [2023-12-28 05:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001393176_356704256.pth... [2023-12-28 05:14:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001388720_355581952.pth [2023-12-28 05:14:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001391992_356401152.pth [2023-12-28 05:14:56,235][106225] Updated weights for policy 1, policy_version 1393177 (0.0010) [2023-12-28 05:14:56,289][106225] Updated weights for policy 1, policy_version 1393187 (0.0006) [2023-12-28 05:14:56,343][106225] Updated weights for policy 1, policy_version 1393197 (0.0008) [2023-12-28 05:14:56,403][106225] Updated weights for policy 1, policy_version 1393207 (0.0005) [2023-12-28 05:14:56,488][106226] Updated weights for policy 0, policy_version 1389879 (0.0006) [2023-12-28 05:14:56,543][106226] Updated weights for policy 0, policy_version 1389889 (0.0005) [2023-12-28 05:14:56,595][106226] Updated weights for policy 0, policy_version 1389899 (0.0005) [2023-12-28 05:14:56,989][106225] Updated weights for policy 1, policy_version 1393217 (0.0010) [2023-12-28 05:14:57,042][106225] Updated weights for policy 1, policy_version 1393227 (0.0009) [2023-12-28 05:14:57,094][106225] Updated weights for policy 1, policy_version 1393237 (0.0008) [2023-12-28 05:14:57,203][106226] Updated weights for policy 0, policy_version 1389909 (0.0007) [2023-12-28 05:14:57,258][106226] Updated weights for policy 0, policy_version 1389919 (0.0008) [2023-12-28 05:14:57,320][106226] Updated weights for policy 0, policy_version 1389929 (0.0007) [2023-12-28 05:14:57,802][106225] Updated weights for policy 1, policy_version 1393247 (0.0010) [2023-12-28 05:14:57,852][106225] Updated weights for policy 1, policy_version 1393257 (0.0010) [2023-12-28 05:14:57,918][106225] Updated weights for policy 1, policy_version 1393267 (0.0010) [2023-12-28 05:14:58,008][106226] Updated weights for policy 0, policy_version 1389939 (0.0008) [2023-12-28 05:14:58,061][106226] Updated weights for policy 0, policy_version 1389949 (0.0008) [2023-12-28 05:14:58,117][106226] Updated weights for policy 0, policy_version 1389959 (0.0006) [2023-12-28 05:14:58,638][106225] Updated weights for policy 1, policy_version 1393277 (0.0010) [2023-12-28 05:14:58,700][106225] Updated weights for policy 1, policy_version 1393287 (0.0008) [2023-12-28 05:14:58,765][106225] Updated weights for policy 1, policy_version 1393297 (0.0008) [2023-12-28 05:14:58,907][106226] Updated weights for policy 0, policy_version 1389969 (0.0006) [2023-12-28 05:14:58,969][106226] Updated weights for policy 0, policy_version 1389979 (0.0008) [2023-12-28 05:14:59,025][106226] Updated weights for policy 0, policy_version 1389989 (0.0007) [2023-12-28 05:14:59,088][106226] Updated weights for policy 0, policy_version 1389999 (0.0006) [2023-12-28 05:14:59,616][106225] Updated weights for policy 1, policy_version 1393308 (0.0007) [2023-12-28 05:14:59,682][106225] Updated weights for policy 1, policy_version 1393318 (0.0007) [2023-12-28 05:14:59,715][106226] Updated weights for policy 0, policy_version 1390009 (0.0006) [2023-12-28 05:14:59,746][106225] Updated weights for policy 1, policy_version 1393328 (0.0008) [2023-12-28 05:14:59,783][106226] Updated weights for policy 0, policy_version 1390019 (0.0006) [2023-12-28 05:14:59,851][106226] Updated weights for policy 0, policy_version 1390029 (0.0008) [2023-12-28 05:15:00,402][106225] Updated weights for policy 1, policy_version 1393338 (0.0007) [2023-12-28 05:15:00,464][106225] Updated weights for policy 1, policy_version 1393348 (0.0008) [2023-12-28 05:15:00,472][106226] Updated weights for policy 0, policy_version 1390039 (0.0010) [2023-12-28 05:15:00,519][106225] Updated weights for policy 1, policy_version 1393358 (0.0006) [2023-12-28 05:15:00,529][106226] Updated weights for policy 0, policy_version 1390049 (0.0010) [2023-12-28 05:15:00,573][106225] Updated weights for policy 1, policy_version 1393368 (0.0006) [2023-12-28 05:15:00,586][106226] Updated weights for policy 0, policy_version 1390059 (0.0009) [2023-12-28 05:15:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 712679424. Throughput: 0: 9966.5, 1: 9945.1. Samples: 712671632. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:01,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-4.182')] [2023-12-28 05:15:01,176][106141] Saving new best policy, reward=-4.182! [2023-12-28 05:15:01,192][106226] Updated weights for policy 0, policy_version 1390069 (0.0007) [2023-12-28 05:15:01,254][106226] Updated weights for policy 0, policy_version 1390079 (0.0006) [2023-12-28 05:15:01,319][106226] Updated weights for policy 0, policy_version 1390089 (0.0006) [2023-12-28 05:15:01,377][106225] Updated weights for policy 1, policy_version 1393378 (0.0008) [2023-12-28 05:15:01,443][106225] Updated weights for policy 1, policy_version 1393388 (0.0006) [2023-12-28 05:15:01,510][106225] Updated weights for policy 1, policy_version 1393398 (0.0006) [2023-12-28 05:15:01,950][106226] Updated weights for policy 0, policy_version 1390099 (0.0007) [2023-12-28 05:15:02,007][106226] Updated weights for policy 0, policy_version 1390109 (0.0007) [2023-12-28 05:15:02,054][106226] Updated weights for policy 0, policy_version 1390119 (0.0005) [2023-12-28 05:15:02,162][106225] Updated weights for policy 1, policy_version 1393408 (0.0006) [2023-12-28 05:15:02,220][106225] Updated weights for policy 1, policy_version 1393418 (0.0008) [2023-12-28 05:15:02,288][106225] Updated weights for policy 1, policy_version 1393428 (0.0007) [2023-12-28 05:15:02,762][106226] Updated weights for policy 0, policy_version 1390129 (0.0006) [2023-12-28 05:15:02,815][106226] Updated weights for policy 0, policy_version 1390139 (0.0009) [2023-12-28 05:15:02,866][106226] Updated weights for policy 0, policy_version 1390149 (0.0006) [2023-12-28 05:15:02,918][106226] Updated weights for policy 0, policy_version 1390159 (0.0005) [2023-12-28 05:15:02,970][106225] Updated weights for policy 1, policy_version 1393438 (0.0008) [2023-12-28 05:15:03,025][106225] Updated weights for policy 1, policy_version 1393448 (0.0008) [2023-12-28 05:15:03,092][106225] Updated weights for policy 1, policy_version 1393458 (0.0009) [2023-12-28 05:15:03,499][106226] Updated weights for policy 0, policy_version 1390169 (0.0005) [2023-12-28 05:15:03,555][106226] Updated weights for policy 0, policy_version 1390179 (0.0006) [2023-12-28 05:15:03,612][106226] Updated weights for policy 0, policy_version 1390189 (0.0005) [2023-12-28 05:15:03,706][106225] Updated weights for policy 1, policy_version 1393468 (0.0009) [2023-12-28 05:15:03,768][106225] Updated weights for policy 1, policy_version 1393478 (0.0009) [2023-12-28 05:15:03,824][106225] Updated weights for policy 1, policy_version 1393488 (0.0008) [2023-12-28 05:15:04,300][106226] Updated weights for policy 0, policy_version 1390199 (0.0008) [2023-12-28 05:15:04,363][106226] Updated weights for policy 0, policy_version 1390209 (0.0008) [2023-12-28 05:15:04,426][106226] Updated weights for policy 0, policy_version 1390219 (0.0009) [2023-12-28 05:15:04,549][106225] Updated weights for policy 1, policy_version 1393498 (0.0007) [2023-12-28 05:15:04,605][106225] Updated weights for policy 1, policy_version 1393508 (0.0005) [2023-12-28 05:15:04,660][106225] Updated weights for policy 1, policy_version 1393518 (0.0008) [2023-12-28 05:15:04,712][106225] Updated weights for policy 1, policy_version 1393528 (0.0009) [2023-12-28 05:15:05,213][106226] Updated weights for policy 0, policy_version 1390229 (0.0010) [2023-12-28 05:15:05,276][106226] Updated weights for policy 0, policy_version 1390239 (0.0009) [2023-12-28 05:15:05,302][106225] Updated weights for policy 1, policy_version 1393538 (0.0005) [2023-12-28 05:15:05,336][106226] Updated weights for policy 0, policy_version 1390249 (0.0008) [2023-12-28 05:15:05,361][106225] Updated weights for policy 1, policy_version 1393548 (0.0005) [2023-12-28 05:15:05,412][106225] Updated weights for policy 1, policy_version 1393558 (0.0006) [2023-12-28 05:15:05,914][106226] Updated weights for policy 0, policy_version 1390259 (0.0008) [2023-12-28 05:15:05,969][106226] Updated weights for policy 0, policy_version 1390269 (0.0005) [2023-12-28 05:15:06,035][106226] Updated weights for policy 0, policy_version 1390279 (0.0005) [2023-12-28 05:15:06,154][106225] Updated weights for policy 1, policy_version 1393568 (0.0008) [2023-12-28 05:15:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 712785920. Throughput: 0: 9947.9, 1: 10070.8. Samples: 712795324. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:06,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.547')] [2023-12-28 05:15:06,222][106225] Updated weights for policy 1, policy_version 1393578 (0.0007) [2023-12-28 05:15:06,285][106225] Updated weights for policy 1, policy_version 1393588 (0.0008) [2023-12-28 05:15:06,763][106226] Updated weights for policy 0, policy_version 1390289 (0.0010) [2023-12-28 05:15:06,822][106226] Updated weights for policy 0, policy_version 1390299 (0.0011) [2023-12-28 05:15:06,882][106226] Updated weights for policy 0, policy_version 1390309 (0.0011) [2023-12-28 05:15:06,939][106226] Updated weights for policy 0, policy_version 1390319 (0.0011) [2023-12-28 05:15:07,027][106225] Updated weights for policy 1, policy_version 1393598 (0.0007) [2023-12-28 05:15:07,088][106225] Updated weights for policy 1, policy_version 1393608 (0.0005) [2023-12-28 05:15:07,153][106225] Updated weights for policy 1, policy_version 1393618 (0.0007) [2023-12-28 05:15:07,546][106226] Updated weights for policy 0, policy_version 1390329 (0.0006) [2023-12-28 05:15:07,603][106226] Updated weights for policy 0, policy_version 1390339 (0.0010) [2023-12-28 05:15:07,657][106226] Updated weights for policy 0, policy_version 1390349 (0.0011) [2023-12-28 05:15:07,794][106225] Updated weights for policy 1, policy_version 1393628 (0.0009) [2023-12-28 05:15:07,861][106225] Updated weights for policy 1, policy_version 1393638 (0.0005) [2023-12-28 05:15:07,913][106225] Updated weights for policy 1, policy_version 1393648 (0.0005) [2023-12-28 05:15:08,239][106226] Updated weights for policy 0, policy_version 1390359 (0.0006) [2023-12-28 05:15:08,304][106226] Updated weights for policy 0, policy_version 1390369 (0.0006) [2023-12-28 05:15:08,378][106226] Updated weights for policy 0, policy_version 1390379 (0.0007) [2023-12-28 05:15:08,619][106225] Updated weights for policy 1, policy_version 1393658 (0.0006) [2023-12-28 05:15:08,682][106225] Updated weights for policy 1, policy_version 1393668 (0.0008) [2023-12-28 05:15:08,745][106225] Updated weights for policy 1, policy_version 1393678 (0.0008) [2023-12-28 05:15:08,804][106225] Updated weights for policy 1, policy_version 1393688 (0.0008) [2023-12-28 05:15:09,037][106226] Updated weights for policy 0, policy_version 1390389 (0.0009) [2023-12-28 05:15:09,093][106226] Updated weights for policy 0, policy_version 1390399 (0.0008) [2023-12-28 05:15:09,150][106226] Updated weights for policy 0, policy_version 1390409 (0.0008) [2023-12-28 05:15:09,615][106225] Updated weights for policy 1, policy_version 1393698 (0.0007) [2023-12-28 05:15:09,681][106225] Updated weights for policy 1, policy_version 1393708 (0.0006) [2023-12-28 05:15:09,748][106225] Updated weights for policy 1, policy_version 1393718 (0.0008) [2023-12-28 05:15:09,960][106226] Updated weights for policy 0, policy_version 1390419 (0.0009) [2023-12-28 05:15:10,024][106226] Updated weights for policy 0, policy_version 1390429 (0.0008) [2023-12-28 05:15:10,082][106226] Updated weights for policy 0, policy_version 1390439 (0.0008) [2023-12-28 05:15:10,475][106225] Updated weights for policy 1, policy_version 1393728 (0.0006) [2023-12-28 05:15:10,541][106225] Updated weights for policy 1, policy_version 1393738 (0.0006) [2023-12-28 05:15:10,602][106225] Updated weights for policy 1, policy_version 1393748 (0.0008) [2023-12-28 05:15:10,868][106226] Updated weights for policy 0, policy_version 1390449 (0.0008) [2023-12-28 05:15:10,939][106226] Updated weights for policy 0, policy_version 1390459 (0.0007) [2023-12-28 05:15:11,009][106226] Updated weights for policy 0, policy_version 1390469 (0.0008) [2023-12-28 05:15:11,080][106226] Updated weights for policy 0, policy_version 1390479 (0.0009) [2023-12-28 05:15:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 712884224. Throughput: 0: 9999.3, 1: 10087.6. Samples: 712856164. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:11,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.704')] [2023-12-28 05:15:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001393752_356851712.pth... [2023-12-28 05:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001390480_356032512.pth... [2023-12-28 05:15:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001389296_355729408.pth [2023-12-28 05:15:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001392600_356556800.pth [2023-12-28 05:15:11,350][106225] Updated weights for policy 1, policy_version 1393758 (0.0008) [2023-12-28 05:15:11,419][106225] Updated weights for policy 1, policy_version 1393768 (0.0010) [2023-12-28 05:15:11,488][106225] Updated weights for policy 1, policy_version 1393778 (0.0008) [2023-12-28 05:15:11,921][106226] Updated weights for policy 0, policy_version 1390489 (0.0009) [2023-12-28 05:15:11,977][106226] Updated weights for policy 0, policy_version 1390499 (0.0009) [2023-12-28 05:15:12,042][106226] Updated weights for policy 0, policy_version 1390509 (0.0009) [2023-12-28 05:15:12,228][106225] Updated weights for policy 1, policy_version 1393788 (0.0007) [2023-12-28 05:15:12,293][106225] Updated weights for policy 1, policy_version 1393798 (0.0007) [2023-12-28 05:15:12,367][106225] Updated weights for policy 1, policy_version 1393808 (0.0008) [2023-12-28 05:15:12,879][106226] Updated weights for policy 0, policy_version 1390519 (0.0007) [2023-12-28 05:15:12,944][106226] Updated weights for policy 0, policy_version 1390529 (0.0008) [2023-12-28 05:15:13,014][106226] Updated weights for policy 0, policy_version 1390539 (0.0008) [2023-12-28 05:15:13,097][106225] Updated weights for policy 1, policy_version 1393818 (0.0009) [2023-12-28 05:15:13,161][106225] Updated weights for policy 1, policy_version 1393828 (0.0009) [2023-12-28 05:15:13,222][106225] Updated weights for policy 1, policy_version 1393838 (0.0008) [2023-12-28 05:15:13,279][106225] Updated weights for policy 1, policy_version 1393848 (0.0008) [2023-12-28 05:15:13,750][106226] Updated weights for policy 0, policy_version 1390549 (0.0009) [2023-12-28 05:15:13,815][106226] Updated weights for policy 0, policy_version 1390559 (0.0009) [2023-12-28 05:15:13,880][106226] Updated weights for policy 0, policy_version 1390569 (0.0009) [2023-12-28 05:15:13,975][106225] Updated weights for policy 1, policy_version 1393858 (0.0009) [2023-12-28 05:15:14,021][106225] Updated weights for policy 1, policy_version 1393868 (0.0008) [2023-12-28 05:15:14,069][106225] Updated weights for policy 1, policy_version 1393878 (0.0008) [2023-12-28 05:15:14,520][106226] Updated weights for policy 0, policy_version 1390579 (0.0007) [2023-12-28 05:15:14,589][106226] Updated weights for policy 0, policy_version 1390589 (0.0007) [2023-12-28 05:15:14,654][106226] Updated weights for policy 0, policy_version 1390599 (0.0008) [2023-12-28 05:15:14,785][106225] Updated weights for policy 1, policy_version 1393888 (0.0007) [2023-12-28 05:15:14,854][106225] Updated weights for policy 1, policy_version 1393898 (0.0008) [2023-12-28 05:15:14,928][106225] Updated weights for policy 1, policy_version 1393908 (0.0008) [2023-12-28 05:15:15,318][106226] Updated weights for policy 0, policy_version 1390609 (0.0007) [2023-12-28 05:15:15,383][106226] Updated weights for policy 0, policy_version 1390619 (0.0011) [2023-12-28 05:15:15,453][106226] Updated weights for policy 0, policy_version 1390629 (0.0010) [2023-12-28 05:15:15,518][106226] Updated weights for policy 0, policy_version 1390639 (0.0008) [2023-12-28 05:15:15,532][106225] Updated weights for policy 1, policy_version 1393918 (0.0007) [2023-12-28 05:15:15,602][106225] Updated weights for policy 1, policy_version 1393928 (0.0009) [2023-12-28 05:15:15,673][106225] Updated weights for policy 1, policy_version 1393938 (0.0008) [2023-12-28 05:15:16,161][106226] Updated weights for policy 0, policy_version 1390649 (0.0010) [2023-12-28 05:15:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 712974336. Throughput: 0: 9923.4, 1: 9955.4. Samples: 712967004. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:16,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.640')] [2023-12-28 05:15:16,214][106226] Updated weights for policy 0, policy_version 1390659 (0.0008) [2023-12-28 05:15:16,271][106226] Updated weights for policy 0, policy_version 1390669 (0.0009) [2023-12-28 05:15:16,287][106225] Updated weights for policy 1, policy_version 1393948 (0.0010) [2023-12-28 05:15:16,338][106225] Updated weights for policy 1, policy_version 1393958 (0.0007) [2023-12-28 05:15:16,400][106225] Updated weights for policy 1, policy_version 1393968 (0.0006) [2023-12-28 05:15:16,988][106226] Updated weights for policy 0, policy_version 1390679 (0.0010) [2023-12-28 05:15:16,995][106225] Updated weights for policy 1, policy_version 1393978 (0.0006) [2023-12-28 05:15:17,038][106226] Updated weights for policy 0, policy_version 1390689 (0.0009) [2023-12-28 05:15:17,055][106225] Updated weights for policy 1, policy_version 1393988 (0.0009) [2023-12-28 05:15:17,103][106226] Updated weights for policy 0, policy_version 1390699 (0.0009) [2023-12-28 05:15:17,118][106225] Updated weights for policy 1, policy_version 1393998 (0.0007) [2023-12-28 05:15:17,185][106225] Updated weights for policy 1, policy_version 1394008 (0.0006) [2023-12-28 05:15:17,779][106226] Updated weights for policy 0, policy_version 1390709 (0.0008) [2023-12-28 05:15:17,805][106225] Updated weights for policy 1, policy_version 1394018 (0.0006) [2023-12-28 05:15:17,841][106226] Updated weights for policy 0, policy_version 1390719 (0.0011) [2023-12-28 05:15:17,855][106225] Updated weights for policy 1, policy_version 1394028 (0.0008) [2023-12-28 05:15:17,903][106226] Updated weights for policy 0, policy_version 1390729 (0.0010) [2023-12-28 05:15:17,915][106225] Updated weights for policy 1, policy_version 1394038 (0.0005) [2023-12-28 05:15:18,626][106226] Updated weights for policy 0, policy_version 1390739 (0.0007) [2023-12-28 05:15:18,661][106225] Updated weights for policy 1, policy_version 1394048 (0.0007) [2023-12-28 05:15:18,681][106226] Updated weights for policy 0, policy_version 1390749 (0.0011) [2023-12-28 05:15:18,722][106225] Updated weights for policy 1, policy_version 1394058 (0.0005) [2023-12-28 05:15:18,735][106226] Updated weights for policy 0, policy_version 1390759 (0.0009) [2023-12-28 05:15:18,792][106225] Updated weights for policy 1, policy_version 1394068 (0.0009) [2023-12-28 05:15:19,429][106226] Updated weights for policy 0, policy_version 1390769 (0.0007) [2023-12-28 05:15:19,480][106226] Updated weights for policy 0, policy_version 1390779 (0.0008) [2023-12-28 05:15:19,520][106225] Updated weights for policy 1, policy_version 1394078 (0.0008) [2023-12-28 05:15:19,542][106226] Updated weights for policy 0, policy_version 1390789 (0.0008) [2023-12-28 05:15:19,577][106225] Updated weights for policy 1, policy_version 1394088 (0.0009) [2023-12-28 05:15:19,597][106226] Updated weights for policy 0, policy_version 1390799 (0.0005) [2023-12-28 05:15:19,637][106225] Updated weights for policy 1, policy_version 1394098 (0.0011) [2023-12-28 05:15:20,272][106226] Updated weights for policy 0, policy_version 1390809 (0.0007) [2023-12-28 05:15:20,336][106226] Updated weights for policy 0, policy_version 1390819 (0.0009) [2023-12-28 05:15:20,404][106226] Updated weights for policy 0, policy_version 1390829 (0.0007) [2023-12-28 05:15:20,430][106225] Updated weights for policy 1, policy_version 1394108 (0.0010) [2023-12-28 05:15:20,490][106225] Updated weights for policy 1, policy_version 1394118 (0.0008) [2023-12-28 05:15:20,547][106225] Updated weights for policy 1, policy_version 1394128 (0.0009) [2023-12-28 05:15:21,062][106226] Updated weights for policy 0, policy_version 1390839 (0.0008) [2023-12-28 05:15:21,129][106226] Updated weights for policy 0, policy_version 1390849 (0.0009) [2023-12-28 05:15:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 713072640. Throughput: 0: 9938.1, 1: 9956.9. Samples: 713087656. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:21,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-4.779')] [2023-12-28 05:15:21,197][106226] Updated weights for policy 0, policy_version 1390859 (0.0010) [2023-12-28 05:15:21,386][106225] Updated weights for policy 1, policy_version 1394138 (0.0009) [2023-12-28 05:15:21,455][106225] Updated weights for policy 1, policy_version 1394148 (0.0008) [2023-12-28 05:15:21,509][106225] Updated weights for policy 1, policy_version 1394158 (0.0008) [2023-12-28 05:15:21,571][106225] Updated weights for policy 1, policy_version 1394168 (0.0009) [2023-12-28 05:15:21,971][106226] Updated weights for policy 0, policy_version 1390869 (0.0008) [2023-12-28 05:15:22,039][106226] Updated weights for policy 0, policy_version 1390879 (0.0008) [2023-12-28 05:15:22,109][106226] Updated weights for policy 0, policy_version 1390889 (0.0007) [2023-12-28 05:15:22,392][106225] Updated weights for policy 1, policy_version 1394178 (0.0007) [2023-12-28 05:15:22,439][106225] Updated weights for policy 1, policy_version 1394188 (0.0005) [2023-12-28 05:15:22,500][106225] Updated weights for policy 1, policy_version 1394198 (0.0009) [2023-12-28 05:15:22,788][106226] Updated weights for policy 0, policy_version 1390899 (0.0009) [2023-12-28 05:15:22,848][106226] Updated weights for policy 0, policy_version 1390909 (0.0009) [2023-12-28 05:15:22,896][106226] Updated weights for policy 0, policy_version 1390919 (0.0008) [2023-12-28 05:15:23,171][106225] Updated weights for policy 1, policy_version 1394208 (0.0008) [2023-12-28 05:15:23,224][106225] Updated weights for policy 1, policy_version 1394218 (0.0009) [2023-12-28 05:15:23,276][106225] Updated weights for policy 1, policy_version 1394228 (0.0009) [2023-12-28 05:15:23,625][106226] Updated weights for policy 0, policy_version 1390929 (0.0008) [2023-12-28 05:15:23,685][106226] Updated weights for policy 0, policy_version 1390939 (0.0005) [2023-12-28 05:15:23,732][106226] Updated weights for policy 0, policy_version 1390949 (0.0005) [2023-12-28 05:15:23,786][106226] Updated weights for policy 0, policy_version 1390959 (0.0005) [2023-12-28 05:15:24,079][106225] Updated weights for policy 1, policy_version 1394238 (0.0008) [2023-12-28 05:15:24,127][106225] Updated weights for policy 1, policy_version 1394248 (0.0008) [2023-12-28 05:15:24,180][106225] Updated weights for policy 1, policy_version 1394258 (0.0007) [2023-12-28 05:15:24,357][106226] Updated weights for policy 0, policy_version 1390969 (0.0010) [2023-12-28 05:15:24,421][106226] Updated weights for policy 0, policy_version 1390979 (0.0010) [2023-12-28 05:15:24,487][106226] Updated weights for policy 0, policy_version 1390989 (0.0009) [2023-12-28 05:15:24,937][106225] Updated weights for policy 1, policy_version 1394268 (0.0008) [2023-12-28 05:15:24,998][106225] Updated weights for policy 1, policy_version 1394278 (0.0007) [2023-12-28 05:15:25,057][106225] Updated weights for policy 1, policy_version 1394288 (0.0008) [2023-12-28 05:15:25,141][106226] Updated weights for policy 0, policy_version 1390999 (0.0005) [2023-12-28 05:15:25,194][106226] Updated weights for policy 0, policy_version 1391009 (0.0005) [2023-12-28 05:15:25,245][106226] Updated weights for policy 0, policy_version 1391019 (0.0005) [2023-12-28 05:15:25,793][106226] Updated weights for policy 0, policy_version 1391029 (0.0006) [2023-12-28 05:15:25,845][106226] Updated weights for policy 0, policy_version 1391039 (0.0010) [2023-12-28 05:15:25,849][106225] Updated weights for policy 1, policy_version 1394298 (0.0008) [2023-12-28 05:15:25,905][106226] Updated weights for policy 0, policy_version 1391049 (0.0010) [2023-12-28 05:15:25,911][106225] Updated weights for policy 1, policy_version 1394308 (0.0005) [2023-12-28 05:15:25,959][106225] Updated weights for policy 1, policy_version 1394318 (0.0006) [2023-12-28 05:15:26,023][106225] Updated weights for policy 1, policy_version 1394328 (0.0007) [2023-12-28 05:15:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 713179136. Throughput: 0: 9959.9, 1: 9917.7. Samples: 713144976. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:26,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.725')] [2023-12-28 05:15:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001391056_356179968.pth... [2023-12-28 05:15:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001394328_356999168.pth... [2023-12-28 05:15:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001393176_356704256.pth [2023-12-28 05:15:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001389872_355876864.pth [2023-12-28 05:15:26,648][106226] Updated weights for policy 0, policy_version 1391059 (0.0011) [2023-12-28 05:15:26,698][106226] Updated weights for policy 0, policy_version 1391069 (0.0010) [2023-12-28 05:15:26,710][106225] Updated weights for policy 1, policy_version 1394338 (0.0006) [2023-12-28 05:15:26,753][106226] Updated weights for policy 0, policy_version 1391079 (0.0011) [2023-12-28 05:15:26,770][106225] Updated weights for policy 1, policy_version 1394348 (0.0007) [2023-12-28 05:15:26,832][106225] Updated weights for policy 1, policy_version 1394358 (0.0007) [2023-12-28 05:15:27,380][106226] Updated weights for policy 0, policy_version 1391089 (0.0011) [2023-12-28 05:15:27,438][106226] Updated weights for policy 0, policy_version 1391099 (0.0010) [2023-12-28 05:15:27,491][106226] Updated weights for policy 0, policy_version 1391109 (0.0010) [2023-12-28 05:15:27,497][106225] Updated weights for policy 1, policy_version 1394368 (0.0005) [2023-12-28 05:15:27,550][106226] Updated weights for policy 0, policy_version 1391119 (0.0010) [2023-12-28 05:15:27,552][106225] Updated weights for policy 1, policy_version 1394378 (0.0005) [2023-12-28 05:15:27,598][106225] Updated weights for policy 1, policy_version 1394388 (0.0007) [2023-12-28 05:15:28,219][106226] Updated weights for policy 0, policy_version 1391129 (0.0007) [2023-12-28 05:15:28,287][106226] Updated weights for policy 0, policy_version 1391139 (0.0007) [2023-12-28 05:15:28,337][106225] Updated weights for policy 1, policy_version 1394398 (0.0008) [2023-12-28 05:15:28,351][106226] Updated weights for policy 0, policy_version 1391149 (0.0009) [2023-12-28 05:15:28,404][106225] Updated weights for policy 1, policy_version 1394408 (0.0007) [2023-12-28 05:15:28,465][106225] Updated weights for policy 1, policy_version 1394418 (0.0007) [2023-12-28 05:15:29,114][106226] Updated weights for policy 0, policy_version 1391159 (0.0010) [2023-12-28 05:15:29,144][106225] Updated weights for policy 1, policy_version 1394428 (0.0005) [2023-12-28 05:15:29,167][106226] Updated weights for policy 0, policy_version 1391169 (0.0010) [2023-12-28 05:15:29,203][106225] Updated weights for policy 1, policy_version 1394438 (0.0005) [2023-12-28 05:15:29,229][106226] Updated weights for policy 0, policy_version 1391179 (0.0010) [2023-12-28 05:15:29,269][106225] Updated weights for policy 1, policy_version 1394448 (0.0008) [2023-12-28 05:15:29,977][106225] Updated weights for policy 1, policy_version 1394458 (0.0006) [2023-12-28 05:15:29,995][106226] Updated weights for policy 0, policy_version 1391189 (0.0008) [2023-12-28 05:15:30,026][106225] Updated weights for policy 1, policy_version 1394468 (0.0007) [2023-12-28 05:15:30,047][106226] Updated weights for policy 0, policy_version 1391199 (0.0009) [2023-12-28 05:15:30,079][106225] Updated weights for policy 1, policy_version 1394478 (0.0006) [2023-12-28 05:15:30,093][106226] Updated weights for policy 0, policy_version 1391209 (0.0008) [2023-12-28 05:15:30,131][106225] Updated weights for policy 1, policy_version 1394488 (0.0007) [2023-12-28 05:15:30,705][106226] Updated weights for policy 0, policy_version 1391219 (0.0006) [2023-12-28 05:15:30,755][106226] Updated weights for policy 0, policy_version 1391229 (0.0005) [2023-12-28 05:15:30,813][106226] Updated weights for policy 0, policy_version 1391239 (0.0005) [2023-12-28 05:15:30,862][106225] Updated weights for policy 1, policy_version 1394498 (0.0008) [2023-12-28 05:15:30,915][106225] Updated weights for policy 1, policy_version 1394508 (0.0008) [2023-12-28 05:15:30,961][106225] Updated weights for policy 1, policy_version 1394518 (0.0005) [2023-12-28 05:15:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 713277440. Throughput: 0: 10043.8, 1: 9869.4. Samples: 713263224. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:31,176][105115] Avg episode reward: [(0, '-4.708'), (1, '-5.252')] [2023-12-28 05:15:31,451][106226] Updated weights for policy 0, policy_version 1391249 (0.0006) [2023-12-28 05:15:31,516][106226] Updated weights for policy 0, policy_version 1391259 (0.0007) [2023-12-28 05:15:31,574][106226] Updated weights for policy 0, policy_version 1391269 (0.0005) [2023-12-28 05:15:31,644][106226] Updated weights for policy 0, policy_version 1391279 (0.0008) [2023-12-28 05:15:31,691][106225] Updated weights for policy 1, policy_version 1394528 (0.0010) [2023-12-28 05:15:31,756][106225] Updated weights for policy 1, policy_version 1394538 (0.0008) [2023-12-28 05:15:31,803][106225] Updated weights for policy 1, policy_version 1394548 (0.0008) [2023-12-28 05:15:32,303][106226] Updated weights for policy 0, policy_version 1391289 (0.0007) [2023-12-28 05:15:32,366][106226] Updated weights for policy 0, policy_version 1391299 (0.0007) [2023-12-28 05:15:32,438][106226] Updated weights for policy 0, policy_version 1391309 (0.0008) [2023-12-28 05:15:32,445][106225] Updated weights for policy 1, policy_version 1394558 (0.0007) [2023-12-28 05:15:32,501][106225] Updated weights for policy 1, policy_version 1394568 (0.0007) [2023-12-28 05:15:32,561][106225] Updated weights for policy 1, policy_version 1394578 (0.0005) [2023-12-28 05:15:33,141][106225] Updated weights for policy 1, policy_version 1394588 (0.0007) [2023-12-28 05:15:33,194][106225] Updated weights for policy 1, policy_version 1394598 (0.0009) [2023-12-28 05:15:33,200][106226] Updated weights for policy 0, policy_version 1391319 (0.0007) [2023-12-28 05:15:33,240][106225] Updated weights for policy 1, policy_version 1394608 (0.0010) [2023-12-28 05:15:33,256][106226] Updated weights for policy 0, policy_version 1391329 (0.0006) [2023-12-28 05:15:33,312][106226] Updated weights for policy 0, policy_version 1391339 (0.0008) [2023-12-28 05:15:33,882][106225] Updated weights for policy 1, policy_version 1394618 (0.0010) [2023-12-28 05:15:33,946][106225] Updated weights for policy 1, policy_version 1394628 (0.0011) [2023-12-28 05:15:34,000][106225] Updated weights for policy 1, policy_version 1394638 (0.0008) [2023-12-28 05:15:34,017][106226] Updated weights for policy 0, policy_version 1391349 (0.0007) [2023-12-28 05:15:34,060][106225] Updated weights for policy 1, policy_version 1394648 (0.0007) [2023-12-28 05:15:34,069][106226] Updated weights for policy 0, policy_version 1391359 (0.0008) [2023-12-28 05:15:34,120][106226] Updated weights for policy 0, policy_version 1391369 (0.0008) [2023-12-28 05:15:34,812][106225] Updated weights for policy 1, policy_version 1394658 (0.0011) [2023-12-28 05:15:34,860][106225] Updated weights for policy 1, policy_version 1394668 (0.0008) [2023-12-28 05:15:34,899][106226] Updated weights for policy 0, policy_version 1391379 (0.0008) [2023-12-28 05:15:34,914][106225] Updated weights for policy 1, policy_version 1394678 (0.0006) [2023-12-28 05:15:34,952][106226] Updated weights for policy 0, policy_version 1391389 (0.0007) [2023-12-28 05:15:35,003][106226] Updated weights for policy 0, policy_version 1391399 (0.0008) [2023-12-28 05:15:35,627][106225] Updated weights for policy 1, policy_version 1394688 (0.0010) [2023-12-28 05:15:35,687][106225] Updated weights for policy 1, policy_version 1394698 (0.0010) [2023-12-28 05:15:35,738][106226] Updated weights for policy 0, policy_version 1391409 (0.0006) [2023-12-28 05:15:35,744][106225] Updated weights for policy 1, policy_version 1394708 (0.0010) [2023-12-28 05:15:35,788][106226] Updated weights for policy 0, policy_version 1391419 (0.0005) [2023-12-28 05:15:35,836][106226] Updated weights for policy 0, policy_version 1391429 (0.0005) [2023-12-28 05:15:35,889][106226] Updated weights for policy 0, policy_version 1391439 (0.0005) [2023-12-28 05:15:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 713375744. Throughput: 0: 9942.0, 1: 9879.7. Samples: 713383612. Policy #0 lag: (min: 13.0, avg: 18.1, max: 45.0) [2023-12-28 05:15:36,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.668')] [2023-12-28 05:15:36,467][106225] Updated weights for policy 1, policy_version 1394718 (0.0011) [2023-12-28 05:15:36,522][106225] Updated weights for policy 1, policy_version 1394728 (0.0010) [2023-12-28 05:15:36,537][106226] Updated weights for policy 0, policy_version 1391449 (0.0006) [2023-12-28 05:15:36,581][106225] Updated weights for policy 1, policy_version 1394738 (0.0011) [2023-12-28 05:15:36,598][106226] Updated weights for policy 0, policy_version 1391459 (0.0006) [2023-12-28 05:15:36,653][106226] Updated weights for policy 0, policy_version 1391469 (0.0008) [2023-12-28 05:15:37,224][106225] Updated weights for policy 1, policy_version 1394748 (0.0008) [2023-12-28 05:15:37,287][106225] Updated weights for policy 1, policy_version 1394758 (0.0008) [2023-12-28 05:15:37,341][106225] Updated weights for policy 1, policy_version 1394768 (0.0008) [2023-12-28 05:15:37,355][106226] Updated weights for policy 0, policy_version 1391479 (0.0008) [2023-12-28 05:15:37,421][106226] Updated weights for policy 0, policy_version 1391489 (0.0008) [2023-12-28 05:15:37,488][106226] Updated weights for policy 0, policy_version 1391499 (0.0010) [2023-12-28 05:15:37,971][106225] Updated weights for policy 1, policy_version 1394778 (0.0006) [2023-12-28 05:15:38,026][106225] Updated weights for policy 1, policy_version 1394788 (0.0009) [2023-12-28 05:15:38,081][106225] Updated weights for policy 1, policy_version 1394798 (0.0008) [2023-12-28 05:15:38,140][106225] Updated weights for policy 1, policy_version 1394808 (0.0008) [2023-12-28 05:15:38,194][106226] Updated weights for policy 0, policy_version 1391509 (0.0009) [2023-12-28 05:15:38,256][106226] Updated weights for policy 0, policy_version 1391519 (0.0007) [2023-12-28 05:15:38,304][106226] Updated weights for policy 0, policy_version 1391529 (0.0010) [2023-12-28 05:15:38,944][106225] Updated weights for policy 1, policy_version 1394818 (0.0009) [2023-12-28 05:15:38,954][106226] Updated weights for policy 0, policy_version 1391539 (0.0008) [2023-12-28 05:15:39,007][106225] Updated weights for policy 1, policy_version 1394828 (0.0007) [2023-12-28 05:15:39,017][106226] Updated weights for policy 0, policy_version 1391549 (0.0010) [2023-12-28 05:15:39,065][106226] Updated weights for policy 0, policy_version 1391559 (0.0006) [2023-12-28 05:15:39,069][106225] Updated weights for policy 1, policy_version 1394838 (0.0008) [2023-12-28 05:15:39,811][106226] Updated weights for policy 0, policy_version 1391569 (0.0009) [2023-12-28 05:15:39,839][106225] Updated weights for policy 1, policy_version 1394848 (0.0006) [2023-12-28 05:15:39,880][106226] Updated weights for policy 0, policy_version 1391579 (0.0009) [2023-12-28 05:15:39,904][106225] Updated weights for policy 1, policy_version 1394858 (0.0008) [2023-12-28 05:15:39,949][106226] Updated weights for policy 0, policy_version 1391589 (0.0008) [2023-12-28 05:15:39,971][106225] Updated weights for policy 1, policy_version 1394868 (0.0007) [2023-12-28 05:15:40,014][106226] Updated weights for policy 0, policy_version 1391599 (0.0007) [2023-12-28 05:15:40,690][106225] Updated weights for policy 1, policy_version 1394878 (0.0008) [2023-12-28 05:15:40,745][106225] Updated weights for policy 1, policy_version 1394888 (0.0006) [2023-12-28 05:15:40,747][106226] Updated weights for policy 0, policy_version 1391609 (0.0007) [2023-12-28 05:15:40,796][106225] Updated weights for policy 1, policy_version 1394898 (0.0005) [2023-12-28 05:15:40,805][106226] Updated weights for policy 0, policy_version 1391619 (0.0008) [2023-12-28 05:15:40,855][106226] Updated weights for policy 0, policy_version 1391629 (0.0007) [2023-12-28 05:15:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 713474048. Throughput: 0: 10014.8, 1: 9846.4. Samples: 713443660. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:15:41,175][105115] Avg episode reward: [(0, '-4.737'), (1, '-4.562')] [2023-12-28 05:15:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001394904_357146624.pth... [2023-12-28 05:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001391632_356327424.pth... [2023-12-28 05:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001393752_356851712.pth [2023-12-28 05:15:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001390480_356032512.pth [2023-12-28 05:15:41,574][106225] Updated weights for policy 1, policy_version 1394908 (0.0008) [2023-12-28 05:15:41,640][106225] Updated weights for policy 1, policy_version 1394918 (0.0008) [2023-12-28 05:15:41,649][106226] Updated weights for policy 0, policy_version 1391639 (0.0008) [2023-12-28 05:15:41,709][106225] Updated weights for policy 1, policy_version 1394928 (0.0008) [2023-12-28 05:15:41,719][106226] Updated weights for policy 0, policy_version 1391649 (0.0006) [2023-12-28 05:15:41,795][106226] Updated weights for policy 0, policy_version 1391659 (0.0009) [2023-12-28 05:15:42,492][106225] Updated weights for policy 1, policy_version 1394938 (0.0009) [2023-12-28 05:15:42,523][106226] Updated weights for policy 0, policy_version 1391669 (0.0006) [2023-12-28 05:15:42,556][106225] Updated weights for policy 1, policy_version 1394948 (0.0011) [2023-12-28 05:15:42,589][106226] Updated weights for policy 0, policy_version 1391679 (0.0006) [2023-12-28 05:15:42,620][106225] Updated weights for policy 1, policy_version 1394958 (0.0010) [2023-12-28 05:15:42,647][106226] Updated weights for policy 0, policy_version 1391689 (0.0007) [2023-12-28 05:15:42,681][106225] Updated weights for policy 1, policy_version 1394968 (0.0010) [2023-12-28 05:15:43,244][106225] Updated weights for policy 1, policy_version 1394978 (0.0009) [2023-12-28 05:15:43,299][106225] Updated weights for policy 1, policy_version 1394988 (0.0005) [2023-12-28 05:15:43,363][106225] Updated weights for policy 1, policy_version 1394998 (0.0005) [2023-12-28 05:15:43,405][106226] Updated weights for policy 0, policy_version 1391699 (0.0008) [2023-12-28 05:15:43,455][106226] Updated weights for policy 0, policy_version 1391709 (0.0005) [2023-12-28 05:15:43,505][106226] Updated weights for policy 0, policy_version 1391719 (0.0005) [2023-12-28 05:15:44,034][106225] Updated weights for policy 1, policy_version 1395008 (0.0009) [2023-12-28 05:15:44,103][106225] Updated weights for policy 1, policy_version 1395018 (0.0008) [2023-12-28 05:15:44,139][106226] Updated weights for policy 0, policy_version 1391729 (0.0008) [2023-12-28 05:15:44,168][106225] Updated weights for policy 1, policy_version 1395028 (0.0008) [2023-12-28 05:15:44,206][106226] Updated weights for policy 0, policy_version 1391739 (0.0007) [2023-12-28 05:15:44,262][106226] Updated weights for policy 0, policy_version 1391749 (0.0008) [2023-12-28 05:15:44,312][106226] Updated weights for policy 0, policy_version 1391759 (0.0009) [2023-12-28 05:15:44,750][106225] Updated weights for policy 1, policy_version 1395038 (0.0007) [2023-12-28 05:15:44,815][106225] Updated weights for policy 1, policy_version 1395048 (0.0008) [2023-12-28 05:15:44,874][106225] Updated weights for policy 1, policy_version 1395058 (0.0008) [2023-12-28 05:15:45,116][106226] Updated weights for policy 0, policy_version 1391769 (0.0008) [2023-12-28 05:15:45,175][106226] Updated weights for policy 0, policy_version 1391779 (0.0008) [2023-12-28 05:15:45,238][106226] Updated weights for policy 0, policy_version 1391789 (0.0007) [2023-12-28 05:15:45,683][106225] Updated weights for policy 1, policy_version 1395068 (0.0009) [2023-12-28 05:15:45,727][106225] Updated weights for policy 1, policy_version 1395078 (0.0008) [2023-12-28 05:15:45,776][106225] Updated weights for policy 1, policy_version 1395088 (0.0008) [2023-12-28 05:15:45,844][106226] Updated weights for policy 0, policy_version 1391799 (0.0007) [2023-12-28 05:15:45,889][106226] Updated weights for policy 0, policy_version 1391809 (0.0008) [2023-12-28 05:15:45,934][106226] Updated weights for policy 0, policy_version 1391819 (0.0008) [2023-12-28 05:15:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 713572352. Throughput: 0: 9915.8, 1: 9798.7. Samples: 713558788. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:15:46,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.675')] [2023-12-28 05:15:46,502][106225] Updated weights for policy 1, policy_version 1395098 (0.0007) [2023-12-28 05:15:46,551][106225] Updated weights for policy 1, policy_version 1395108 (0.0005) [2023-12-28 05:15:46,605][106225] Updated weights for policy 1, policy_version 1395118 (0.0007) [2023-12-28 05:15:46,661][106225] Updated weights for policy 1, policy_version 1395128 (0.0006) [2023-12-28 05:15:46,709][106226] Updated weights for policy 0, policy_version 1391829 (0.0009) [2023-12-28 05:15:46,757][106226] Updated weights for policy 0, policy_version 1391839 (0.0008) [2023-12-28 05:15:46,812][106226] Updated weights for policy 0, policy_version 1391849 (0.0008) [2023-12-28 05:15:47,359][106225] Updated weights for policy 1, policy_version 1395138 (0.0008) [2023-12-28 05:15:47,412][106225] Updated weights for policy 1, policy_version 1395148 (0.0007) [2023-12-28 05:15:47,444][106226] Updated weights for policy 0, policy_version 1391859 (0.0011) [2023-12-28 05:15:47,467][106225] Updated weights for policy 1, policy_version 1395158 (0.0009) [2023-12-28 05:15:47,501][106226] Updated weights for policy 0, policy_version 1391869 (0.0011) [2023-12-28 05:15:47,558][106226] Updated weights for policy 0, policy_version 1391879 (0.0010) [2023-12-28 05:15:48,111][106225] Updated weights for policy 1, policy_version 1395168 (0.0006) [2023-12-28 05:15:48,172][106225] Updated weights for policy 1, policy_version 1395178 (0.0008) [2023-12-28 05:15:48,230][106225] Updated weights for policy 1, policy_version 1395188 (0.0008) [2023-12-28 05:15:48,275][106226] Updated weights for policy 0, policy_version 1391889 (0.0010) [2023-12-28 05:15:48,338][106226] Updated weights for policy 0, policy_version 1391899 (0.0009) [2023-12-28 05:15:48,405][106226] Updated weights for policy 0, policy_version 1391909 (0.0008) [2023-12-28 05:15:48,460][106226] Updated weights for policy 0, policy_version 1391919 (0.0008) [2023-12-28 05:15:48,905][106225] Updated weights for policy 1, policy_version 1395198 (0.0009) [2023-12-28 05:15:48,955][106225] Updated weights for policy 1, policy_version 1395208 (0.0010) [2023-12-28 05:15:49,004][106225] Updated weights for policy 1, policy_version 1395218 (0.0010) [2023-12-28 05:15:49,154][106226] Updated weights for policy 0, policy_version 1391929 (0.0008) [2023-12-28 05:15:49,213][106226] Updated weights for policy 0, policy_version 1391939 (0.0008) [2023-12-28 05:15:49,274][106226] Updated weights for policy 0, policy_version 1391949 (0.0008) [2023-12-28 05:15:49,720][106225] Updated weights for policy 1, policy_version 1395228 (0.0010) [2023-12-28 05:15:49,784][106225] Updated weights for policy 1, policy_version 1395238 (0.0010) [2023-12-28 05:15:49,847][106225] Updated weights for policy 1, policy_version 1395248 (0.0009) [2023-12-28 05:15:50,077][106226] Updated weights for policy 0, policy_version 1391959 (0.0010) [2023-12-28 05:15:50,135][106226] Updated weights for policy 0, policy_version 1391969 (0.0005) [2023-12-28 05:15:50,190][106226] Updated weights for policy 0, policy_version 1391979 (0.0007) [2023-12-28 05:15:50,580][106225] Updated weights for policy 1, policy_version 1395258 (0.0010) [2023-12-28 05:15:50,645][106225] Updated weights for policy 1, policy_version 1395268 (0.0009) [2023-12-28 05:15:50,704][106225] Updated weights for policy 1, policy_version 1395278 (0.0011) [2023-12-28 05:15:50,764][106225] Updated weights for policy 1, policy_version 1395288 (0.0009) [2023-12-28 05:15:50,806][106226] Updated weights for policy 0, policy_version 1391989 (0.0006) [2023-12-28 05:15:50,856][106226] Updated weights for policy 0, policy_version 1391999 (0.0008) [2023-12-28 05:15:50,914][106226] Updated weights for policy 0, policy_version 1392009 (0.0007) [2023-12-28 05:15:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 713670656. Throughput: 0: 9849.1, 1: 9753.8. Samples: 713677452. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:15:51,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.592')] [2023-12-28 05:15:51,465][106225] Updated weights for policy 1, policy_version 1395298 (0.0006) [2023-12-28 05:15:51,522][106225] Updated weights for policy 1, policy_version 1395308 (0.0007) [2023-12-28 05:15:51,584][106225] Updated weights for policy 1, policy_version 1395318 (0.0009) [2023-12-28 05:15:51,703][106226] Updated weights for policy 0, policy_version 1392019 (0.0008) [2023-12-28 05:15:51,769][106226] Updated weights for policy 0, policy_version 1392029 (0.0009) [2023-12-28 05:15:51,833][106226] Updated weights for policy 0, policy_version 1392039 (0.0007) [2023-12-28 05:15:52,319][106225] Updated weights for policy 1, policy_version 1395328 (0.0010) [2023-12-28 05:15:52,387][106225] Updated weights for policy 1, policy_version 1395338 (0.0008) [2023-12-28 05:15:52,446][106225] Updated weights for policy 1, policy_version 1395348 (0.0006) [2023-12-28 05:15:52,469][106226] Updated weights for policy 0, policy_version 1392049 (0.0008) [2023-12-28 05:15:52,531][106226] Updated weights for policy 0, policy_version 1392059 (0.0011) [2023-12-28 05:15:52,593][106226] Updated weights for policy 0, policy_version 1392069 (0.0011) [2023-12-28 05:15:52,657][106226] Updated weights for policy 0, policy_version 1392079 (0.0010) [2023-12-28 05:15:53,096][106225] Updated weights for policy 1, policy_version 1395358 (0.0007) [2023-12-28 05:15:53,145][106225] Updated weights for policy 1, policy_version 1395368 (0.0006) [2023-12-28 05:15:53,201][106225] Updated weights for policy 1, policy_version 1395378 (0.0006) [2023-12-28 05:15:53,327][106226] Updated weights for policy 0, policy_version 1392089 (0.0010) [2023-12-28 05:15:53,383][106226] Updated weights for policy 0, policy_version 1392099 (0.0011) [2023-12-28 05:15:53,433][106226] Updated weights for policy 0, policy_version 1392109 (0.0011) [2023-12-28 05:15:53,898][106225] Updated weights for policy 1, policy_version 1395388 (0.0007) [2023-12-28 05:15:53,962][106225] Updated weights for policy 1, policy_version 1395398 (0.0007) [2023-12-28 05:15:54,019][106225] Updated weights for policy 1, policy_version 1395408 (0.0008) [2023-12-28 05:15:54,130][106226] Updated weights for policy 0, policy_version 1392119 (0.0009) [2023-12-28 05:15:54,191][106226] Updated weights for policy 0, policy_version 1392129 (0.0010) [2023-12-28 05:15:54,249][106226] Updated weights for policy 0, policy_version 1392139 (0.0011) [2023-12-28 05:15:54,624][106225] Updated weights for policy 1, policy_version 1395418 (0.0008) [2023-12-28 05:15:54,680][106225] Updated weights for policy 1, policy_version 1395428 (0.0009) [2023-12-28 05:15:54,746][106225] Updated weights for policy 1, policy_version 1395438 (0.0010) [2023-12-28 05:15:54,813][106225] Updated weights for policy 1, policy_version 1395448 (0.0010) [2023-12-28 05:15:54,933][106226] Updated weights for policy 0, policy_version 1392149 (0.0009) [2023-12-28 05:15:54,999][106226] Updated weights for policy 0, policy_version 1392159 (0.0008) [2023-12-28 05:15:55,047][106226] Updated weights for policy 0, policy_version 1392169 (0.0006) [2023-12-28 05:15:55,497][106225] Updated weights for policy 1, policy_version 1395458 (0.0010) [2023-12-28 05:15:55,553][106225] Updated weights for policy 1, policy_version 1395468 (0.0010) [2023-12-28 05:15:55,606][106225] Updated weights for policy 1, policy_version 1395478 (0.0010) [2023-12-28 05:15:55,681][106226] Updated weights for policy 0, policy_version 1392179 (0.0006) [2023-12-28 05:15:55,745][106226] Updated weights for policy 0, policy_version 1392189 (0.0008) [2023-12-28 05:15:55,805][106226] Updated weights for policy 0, policy_version 1392199 (0.0008) [2023-12-28 05:15:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 713768960. Throughput: 0: 9819.7, 1: 9768.8. Samples: 713737644. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:15:56,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-4.762')] [2023-12-28 05:15:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001392208_356474880.pth... [2023-12-28 05:15:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001395480_357294080.pth... [2023-12-28 05:15:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001391056_356179968.pth [2023-12-28 05:15:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001394328_356999168.pth [2023-12-28 05:15:56,349][106225] Updated weights for policy 1, policy_version 1395488 (0.0010) [2023-12-28 05:15:56,418][106225] Updated weights for policy 1, policy_version 1395498 (0.0010) [2023-12-28 05:15:56,447][106226] Updated weights for policy 0, policy_version 1392209 (0.0008) [2023-12-28 05:15:56,486][106225] Updated weights for policy 1, policy_version 1395508 (0.0010) [2023-12-28 05:15:56,514][106226] Updated weights for policy 0, policy_version 1392219 (0.0007) [2023-12-28 05:15:56,574][106226] Updated weights for policy 0, policy_version 1392229 (0.0010) [2023-12-28 05:15:56,638][106226] Updated weights for policy 0, policy_version 1392239 (0.0010) [2023-12-28 05:15:57,144][106225] Updated weights for policy 1, policy_version 1395518 (0.0009) [2023-12-28 05:15:57,197][106225] Updated weights for policy 1, policy_version 1395528 (0.0007) [2023-12-28 05:15:57,246][106225] Updated weights for policy 1, policy_version 1395538 (0.0007) [2023-12-28 05:15:57,311][106226] Updated weights for policy 0, policy_version 1392249 (0.0010) [2023-12-28 05:15:57,368][106226] Updated weights for policy 0, policy_version 1392259 (0.0010) [2023-12-28 05:15:57,417][106226] Updated weights for policy 0, policy_version 1392269 (0.0010) [2023-12-28 05:15:57,964][106225] Updated weights for policy 1, policy_version 1395548 (0.0007) [2023-12-28 05:15:58,011][106225] Updated weights for policy 1, policy_version 1395558 (0.0006) [2023-12-28 05:15:58,064][106225] Updated weights for policy 1, policy_version 1395568 (0.0007) [2023-12-28 05:15:58,133][106226] Updated weights for policy 0, policy_version 1392279 (0.0010) [2023-12-28 05:15:58,180][106226] Updated weights for policy 0, policy_version 1392289 (0.0010) [2023-12-28 05:15:58,240][106226] Updated weights for policy 0, policy_version 1392299 (0.0007) [2023-12-28 05:15:58,895][106225] Updated weights for policy 1, policy_version 1395578 (0.0008) [2023-12-28 05:15:58,954][106225] Updated weights for policy 1, policy_version 1395588 (0.0007) [2023-12-28 05:15:59,020][106225] Updated weights for policy 1, policy_version 1395598 (0.0007) [2023-12-28 05:15:59,080][106225] Updated weights for policy 1, policy_version 1395608 (0.0007) [2023-12-28 05:15:59,081][106226] Updated weights for policy 0, policy_version 1392309 (0.0008) [2023-12-28 05:15:59,142][106226] Updated weights for policy 0, policy_version 1392319 (0.0005) [2023-12-28 05:15:59,207][106226] Updated weights for policy 0, policy_version 1392329 (0.0007) [2023-12-28 05:15:59,805][106225] Updated weights for policy 1, policy_version 1395618 (0.0007) [2023-12-28 05:15:59,870][106225] Updated weights for policy 1, policy_version 1395628 (0.0009) [2023-12-28 05:15:59,900][106226] Updated weights for policy 0, policy_version 1392339 (0.0009) [2023-12-28 05:15:59,972][106225] Updated weights for policy 1, policy_version 1395638 (0.0008) [2023-12-28 05:15:59,974][106226] Updated weights for policy 0, policy_version 1392349 (0.0008) [2023-12-28 05:16:00,044][106226] Updated weights for policy 0, policy_version 1392359 (0.0008) [2023-12-28 05:16:00,617][106225] Updated weights for policy 1, policy_version 1395648 (0.0005) [2023-12-28 05:16:00,678][106225] Updated weights for policy 1, policy_version 1395658 (0.0007) [2023-12-28 05:16:00,724][106226] Updated weights for policy 0, policy_version 1392369 (0.0009) [2023-12-28 05:16:00,731][106225] Updated weights for policy 1, policy_version 1395668 (0.0010) [2023-12-28 05:16:00,774][106226] Updated weights for policy 0, policy_version 1392379 (0.0007) [2023-12-28 05:16:00,822][106226] Updated weights for policy 0, policy_version 1392389 (0.0008) [2023-12-28 05:16:00,877][106226] Updated weights for policy 0, policy_version 1392399 (0.0005) [2023-12-28 05:16:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 713867264. Throughput: 0: 9918.7, 1: 9830.5. Samples: 713855716. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:01,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-4.523')] [2023-12-28 05:16:01,370][106225] Updated weights for policy 1, policy_version 1395678 (0.0009) [2023-12-28 05:16:01,431][106225] Updated weights for policy 1, policy_version 1395688 (0.0008) [2023-12-28 05:16:01,493][106225] Updated weights for policy 1, policy_version 1395698 (0.0008) [2023-12-28 05:16:01,576][106226] Updated weights for policy 0, policy_version 1392409 (0.0007) [2023-12-28 05:16:01,642][106226] Updated weights for policy 0, policy_version 1392419 (0.0009) [2023-12-28 05:16:01,693][106226] Updated weights for policy 0, policy_version 1392429 (0.0009) [2023-12-28 05:16:02,170][106225] Updated weights for policy 1, policy_version 1395708 (0.0008) [2023-12-28 05:16:02,225][106225] Updated weights for policy 1, policy_version 1395718 (0.0006) [2023-12-28 05:16:02,286][106225] Updated weights for policy 1, policy_version 1395728 (0.0009) [2023-12-28 05:16:02,512][106226] Updated weights for policy 0, policy_version 1392439 (0.0008) [2023-12-28 05:16:02,576][106226] Updated weights for policy 0, policy_version 1392449 (0.0008) [2023-12-28 05:16:02,636][106226] Updated weights for policy 0, policy_version 1392459 (0.0009) [2023-12-28 05:16:03,003][106225] Updated weights for policy 1, policy_version 1395738 (0.0009) [2023-12-28 05:16:03,054][106225] Updated weights for policy 1, policy_version 1395748 (0.0008) [2023-12-28 05:16:03,110][106225] Updated weights for policy 1, policy_version 1395758 (0.0009) [2023-12-28 05:16:03,167][106225] Updated weights for policy 1, policy_version 1395768 (0.0007) [2023-12-28 05:16:03,351][106226] Updated weights for policy 0, policy_version 1392469 (0.0008) [2023-12-28 05:16:03,396][106226] Updated weights for policy 0, policy_version 1392479 (0.0009) [2023-12-28 05:16:03,441][106226] Updated weights for policy 0, policy_version 1392489 (0.0006) [2023-12-28 05:16:03,852][106225] Updated weights for policy 1, policy_version 1395778 (0.0007) [2023-12-28 05:16:03,922][106225] Updated weights for policy 1, policy_version 1395788 (0.0007) [2023-12-28 05:16:03,992][106225] Updated weights for policy 1, policy_version 1395798 (0.0009) [2023-12-28 05:16:04,028][106226] Updated weights for policy 0, policy_version 1392499 (0.0005) [2023-12-28 05:16:04,088][106226] Updated weights for policy 0, policy_version 1392509 (0.0009) [2023-12-28 05:16:04,153][106226] Updated weights for policy 0, policy_version 1392519 (0.0011) [2023-12-28 05:16:04,733][106225] Updated weights for policy 1, policy_version 1395808 (0.0008) [2023-12-28 05:16:04,784][106225] Updated weights for policy 1, policy_version 1395818 (0.0008) [2023-12-28 05:16:04,831][106225] Updated weights for policy 1, policy_version 1395828 (0.0007) [2023-12-28 05:16:04,843][106226] Updated weights for policy 0, policy_version 1392529 (0.0011) [2023-12-28 05:16:04,893][106226] Updated weights for policy 0, policy_version 1392539 (0.0010) [2023-12-28 05:16:04,961][106226] Updated weights for policy 0, policy_version 1392549 (0.0009) [2023-12-28 05:16:05,013][106226] Updated weights for policy 0, policy_version 1392559 (0.0011) [2023-12-28 05:16:05,622][106225] Updated weights for policy 1, policy_version 1395838 (0.0008) [2023-12-28 05:16:05,675][106225] Updated weights for policy 1, policy_version 1395848 (0.0008) [2023-12-28 05:16:05,680][106226] Updated weights for policy 0, policy_version 1392569 (0.0008) [2023-12-28 05:16:05,733][106225] Updated weights for policy 1, policy_version 1395858 (0.0008) [2023-12-28 05:16:05,736][106226] Updated weights for policy 0, policy_version 1392579 (0.0010) [2023-12-28 05:16:05,796][106226] Updated weights for policy 0, policy_version 1392589 (0.0010) [2023-12-28 05:16:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 713965568. Throughput: 0: 9913.7, 1: 9791.0. Samples: 713974364. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:06,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.547')] [2023-12-28 05:16:06,488][106225] Updated weights for policy 1, policy_version 1395868 (0.0007) [2023-12-28 05:16:06,547][106225] Updated weights for policy 1, policy_version 1395878 (0.0009) [2023-12-28 05:16:06,549][106226] Updated weights for policy 0, policy_version 1392599 (0.0010) [2023-12-28 05:16:06,606][106225] Updated weights for policy 1, policy_version 1395888 (0.0009) [2023-12-28 05:16:06,610][106226] Updated weights for policy 0, policy_version 1392609 (0.0010) [2023-12-28 05:16:06,676][106226] Updated weights for policy 0, policy_version 1392619 (0.0011) [2023-12-28 05:16:07,189][106225] Updated weights for policy 1, policy_version 1395898 (0.0006) [2023-12-28 05:16:07,242][106225] Updated weights for policy 1, policy_version 1395908 (0.0005) [2023-12-28 05:16:07,298][106225] Updated weights for policy 1, policy_version 1395918 (0.0005) [2023-12-28 05:16:07,316][106226] Updated weights for policy 0, policy_version 1392629 (0.0010) [2023-12-28 05:16:07,349][106225] Updated weights for policy 1, policy_version 1395928 (0.0008) [2023-12-28 05:16:07,387][106226] Updated weights for policy 0, policy_version 1392639 (0.0008) [2023-12-28 05:16:07,452][106226] Updated weights for policy 0, policy_version 1392649 (0.0009) [2023-12-28 05:16:08,013][106225] Updated weights for policy 1, policy_version 1395938 (0.0009) [2023-12-28 05:16:08,070][106226] Updated weights for policy 0, policy_version 1392659 (0.0009) [2023-12-28 05:16:08,073][106225] Updated weights for policy 1, policy_version 1395948 (0.0008) [2023-12-28 05:16:08,123][106225] Updated weights for policy 1, policy_version 1395958 (0.0008) [2023-12-28 05:16:08,127][106226] Updated weights for policy 0, policy_version 1392669 (0.0005) [2023-12-28 05:16:08,184][106226] Updated weights for policy 0, policy_version 1392679 (0.0005) [2023-12-28 05:16:08,828][106226] Updated weights for policy 0, policy_version 1392689 (0.0008) [2023-12-28 05:16:08,889][106226] Updated weights for policy 0, policy_version 1392699 (0.0009) [2023-12-28 05:16:08,917][106225] Updated weights for policy 1, policy_version 1395968 (0.0009) [2023-12-28 05:16:08,950][106226] Updated weights for policy 0, policy_version 1392709 (0.0010) [2023-12-28 05:16:08,979][106225] Updated weights for policy 1, policy_version 1395978 (0.0006) [2023-12-28 05:16:09,010][106226] Updated weights for policy 0, policy_version 1392719 (0.0010) [2023-12-28 05:16:09,035][106225] Updated weights for policy 1, policy_version 1395988 (0.0007) [2023-12-28 05:16:09,758][106226] Updated weights for policy 0, policy_version 1392729 (0.0007) [2023-12-28 05:16:09,826][106226] Updated weights for policy 0, policy_version 1392739 (0.0010) [2023-12-28 05:16:09,832][106225] Updated weights for policy 1, policy_version 1395998 (0.0006) [2023-12-28 05:16:09,887][106226] Updated weights for policy 0, policy_version 1392749 (0.0008) [2023-12-28 05:16:09,898][106225] Updated weights for policy 1, policy_version 1396008 (0.0008) [2023-12-28 05:16:09,958][106225] Updated weights for policy 1, policy_version 1396018 (0.0007) [2023-12-28 05:16:10,600][106226] Updated weights for policy 0, policy_version 1392759 (0.0010) [2023-12-28 05:16:10,661][106225] Updated weights for policy 1, policy_version 1396028 (0.0006) [2023-12-28 05:16:10,662][106226] Updated weights for policy 0, policy_version 1392769 (0.0011) [2023-12-28 05:16:10,710][106225] Updated weights for policy 1, policy_version 1396038 (0.0005) [2023-12-28 05:16:10,716][106226] Updated weights for policy 0, policy_version 1392779 (0.0010) [2023-12-28 05:16:10,762][106225] Updated weights for policy 1, policy_version 1396048 (0.0007) [2023-12-28 05:16:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 714063872. Throughput: 0: 9940.5, 1: 9852.1. Samples: 714035644. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:11,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.668')] [2023-12-28 05:16:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001396056_357441536.pth... [2023-12-28 05:16:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001392784_356622336.pth... [2023-12-28 05:16:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001394904_357146624.pth [2023-12-28 05:16:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001391632_356327424.pth [2023-12-28 05:16:11,457][106226] Updated weights for policy 0, policy_version 1392789 (0.0010) [2023-12-28 05:16:11,516][106226] Updated weights for policy 0, policy_version 1392799 (0.0009) [2023-12-28 05:16:11,549][106225] Updated weights for policy 1, policy_version 1396058 (0.0008) [2023-12-28 05:16:11,581][106226] Updated weights for policy 0, policy_version 1392809 (0.0010) [2023-12-28 05:16:11,611][106225] Updated weights for policy 1, policy_version 1396068 (0.0010) [2023-12-28 05:16:11,703][106225] Updated weights for policy 1, policy_version 1396078 (0.0010) [2023-12-28 05:16:11,773][106225] Updated weights for policy 1, policy_version 1396088 (0.0009) [2023-12-28 05:16:12,365][106226] Updated weights for policy 0, policy_version 1392819 (0.0010) [2023-12-28 05:16:12,418][106226] Updated weights for policy 0, policy_version 1392829 (0.0009) [2023-12-28 05:16:12,466][106226] Updated weights for policy 0, policy_version 1392839 (0.0009) [2023-12-28 05:16:12,484][106225] Updated weights for policy 1, policy_version 1396098 (0.0009) [2023-12-28 05:16:12,537][106225] Updated weights for policy 1, policy_version 1396108 (0.0009) [2023-12-28 05:16:12,585][106225] Updated weights for policy 1, policy_version 1396118 (0.0009) [2023-12-28 05:16:13,148][106226] Updated weights for policy 0, policy_version 1392849 (0.0009) [2023-12-28 05:16:13,201][106226] Updated weights for policy 0, policy_version 1392859 (0.0010) [2023-12-28 05:16:13,251][106226] Updated weights for policy 0, policy_version 1392869 (0.0010) [2023-12-28 05:16:13,310][106226] Updated weights for policy 0, policy_version 1392879 (0.0010) [2023-12-28 05:16:13,370][106225] Updated weights for policy 1, policy_version 1396128 (0.0008) [2023-12-28 05:16:13,431][106225] Updated weights for policy 1, policy_version 1396138 (0.0010) [2023-12-28 05:16:13,491][106225] Updated weights for policy 1, policy_version 1396148 (0.0010) [2023-12-28 05:16:13,942][106226] Updated weights for policy 0, policy_version 1392889 (0.0009) [2023-12-28 05:16:14,027][106226] Updated weights for policy 0, policy_version 1392899 (0.0008) [2023-12-28 05:16:14,084][106226] Updated weights for policy 0, policy_version 1392909 (0.0009) [2023-12-28 05:16:14,127][106225] Updated weights for policy 1, policy_version 1396158 (0.0010) [2023-12-28 05:16:14,188][106225] Updated weights for policy 1, policy_version 1396168 (0.0010) [2023-12-28 05:16:14,247][106225] Updated weights for policy 1, policy_version 1396178 (0.0010) [2023-12-28 05:16:14,697][106226] Updated weights for policy 0, policy_version 1392919 (0.0008) [2023-12-28 05:16:14,746][106226] Updated weights for policy 0, policy_version 1392929 (0.0008) [2023-12-28 05:16:14,809][106226] Updated weights for policy 0, policy_version 1392939 (0.0008) [2023-12-28 05:16:14,983][106225] Updated weights for policy 1, policy_version 1396188 (0.0008) [2023-12-28 05:16:15,049][106225] Updated weights for policy 1, policy_version 1396198 (0.0006) [2023-12-28 05:16:15,111][106225] Updated weights for policy 1, policy_version 1396208 (0.0009) [2023-12-28 05:16:15,552][106226] Updated weights for policy 0, policy_version 1392949 (0.0007) [2023-12-28 05:16:15,616][106226] Updated weights for policy 0, policy_version 1392959 (0.0007) [2023-12-28 05:16:15,680][106226] Updated weights for policy 0, policy_version 1392969 (0.0011) [2023-12-28 05:16:15,797][106225] Updated weights for policy 1, policy_version 1396218 (0.0011) [2023-12-28 05:16:15,850][106225] Updated weights for policy 1, policy_version 1396228 (0.0010) [2023-12-28 05:16:15,903][106225] Updated weights for policy 1, policy_version 1396238 (0.0011) [2023-12-28 05:16:15,952][106225] Updated weights for policy 1, policy_version 1396248 (0.0010) [2023-12-28 05:16:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 714162176. Throughput: 0: 9898.1, 1: 9838.0. Samples: 714151352. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:16,176][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.586')] [2023-12-28 05:16:16,243][106226] Updated weights for policy 0, policy_version 1392979 (0.0009) [2023-12-28 05:16:16,292][106226] Updated weights for policy 0, policy_version 1392989 (0.0005) [2023-12-28 05:16:16,345][106226] Updated weights for policy 0, policy_version 1392999 (0.0005) [2023-12-28 05:16:16,638][106225] Updated weights for policy 1, policy_version 1396258 (0.0010) [2023-12-28 05:16:16,691][106225] Updated weights for policy 1, policy_version 1396268 (0.0010) [2023-12-28 05:16:16,740][106225] Updated weights for policy 1, policy_version 1396278 (0.0010) [2023-12-28 05:16:16,908][106226] Updated weights for policy 0, policy_version 1393009 (0.0006) [2023-12-28 05:16:16,964][106226] Updated weights for policy 0, policy_version 1393019 (0.0008) [2023-12-28 05:16:17,020][106226] Updated weights for policy 0, policy_version 1393029 (0.0008) [2023-12-28 05:16:17,079][106226] Updated weights for policy 0, policy_version 1393039 (0.0007) [2023-12-28 05:16:17,457][106225] Updated weights for policy 1, policy_version 1396288 (0.0010) [2023-12-28 05:16:17,510][106225] Updated weights for policy 1, policy_version 1396298 (0.0010) [2023-12-28 05:16:17,573][106225] Updated weights for policy 1, policy_version 1396308 (0.0010) [2023-12-28 05:16:17,727][106226] Updated weights for policy 0, policy_version 1393049 (0.0005) [2023-12-28 05:16:17,780][106226] Updated weights for policy 0, policy_version 1393059 (0.0005) [2023-12-28 05:16:17,828][106226] Updated weights for policy 0, policy_version 1393069 (0.0005) [2023-12-28 05:16:18,272][106225] Updated weights for policy 1, policy_version 1396318 (0.0010) [2023-12-28 05:16:18,325][106225] Updated weights for policy 1, policy_version 1396328 (0.0010) [2023-12-28 05:16:18,391][106225] Updated weights for policy 1, policy_version 1396338 (0.0009) [2023-12-28 05:16:18,399][106226] Updated weights for policy 0, policy_version 1393079 (0.0006) [2023-12-28 05:16:18,467][106226] Updated weights for policy 0, policy_version 1393089 (0.0010) [2023-12-28 05:16:18,534][106226] Updated weights for policy 0, policy_version 1393099 (0.0011) [2023-12-28 05:16:19,130][106225] Updated weights for policy 1, policy_version 1396348 (0.0008) [2023-12-28 05:16:19,190][106225] Updated weights for policy 1, policy_version 1396358 (0.0010) [2023-12-28 05:16:19,224][106226] Updated weights for policy 0, policy_version 1393109 (0.0009) [2023-12-28 05:16:19,249][106225] Updated weights for policy 1, policy_version 1396368 (0.0008) [2023-12-28 05:16:19,283][106226] Updated weights for policy 0, policy_version 1393119 (0.0007) [2023-12-28 05:16:19,346][106226] Updated weights for policy 0, policy_version 1393129 (0.0008) [2023-12-28 05:16:19,946][106225] Updated weights for policy 1, policy_version 1396378 (0.0007) [2023-12-28 05:16:20,008][106225] Updated weights for policy 1, policy_version 1396388 (0.0007) [2023-12-28 05:16:20,064][106226] Updated weights for policy 0, policy_version 1393139 (0.0007) [2023-12-28 05:16:20,069][106225] Updated weights for policy 1, policy_version 1396398 (0.0007) [2023-12-28 05:16:20,124][106225] Updated weights for policy 1, policy_version 1396408 (0.0006) [2023-12-28 05:16:20,135][106226] Updated weights for policy 0, policy_version 1393149 (0.0007) [2023-12-28 05:16:20,200][106226] Updated weights for policy 0, policy_version 1393159 (0.0009) [2023-12-28 05:16:20,840][106225] Updated weights for policy 1, policy_version 1396418 (0.0007) [2023-12-28 05:16:20,905][106225] Updated weights for policy 1, policy_version 1396428 (0.0008) [2023-12-28 05:16:20,919][106226] Updated weights for policy 0, policy_version 1393169 (0.0010) [2023-12-28 05:16:20,972][106225] Updated weights for policy 1, policy_version 1396438 (0.0008) [2023-12-28 05:16:20,990][106226] Updated weights for policy 0, policy_version 1393179 (0.0007) [2023-12-28 05:16:21,059][106226] Updated weights for policy 0, policy_version 1393189 (0.0009) [2023-12-28 05:16:21,122][106226] Updated weights for policy 0, policy_version 1393199 (0.0008) [2023-12-28 05:16:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 714268672. Throughput: 0: 9967.8, 1: 9810.2. Samples: 714273616. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:21,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.568')] [2023-12-28 05:16:21,744][106225] Updated weights for policy 1, policy_version 1396448 (0.0008) [2023-12-28 05:16:21,803][106225] Updated weights for policy 1, policy_version 1396458 (0.0010) [2023-12-28 05:16:21,845][106226] Updated weights for policy 0, policy_version 1393209 (0.0008) [2023-12-28 05:16:21,868][106225] Updated weights for policy 1, policy_version 1396468 (0.0007) [2023-12-28 05:16:21,909][106226] Updated weights for policy 0, policy_version 1393219 (0.0007) [2023-12-28 05:16:21,977][106226] Updated weights for policy 0, policy_version 1393229 (0.0009) [2023-12-28 05:16:22,625][106225] Updated weights for policy 1, policy_version 1396478 (0.0009) [2023-12-28 05:16:22,674][106226] Updated weights for policy 0, policy_version 1393239 (0.0006) [2023-12-28 05:16:22,679][106225] Updated weights for policy 1, policy_version 1396488 (0.0009) [2023-12-28 05:16:22,736][106225] Updated weights for policy 1, policy_version 1396498 (0.0007) [2023-12-28 05:16:22,740][106226] Updated weights for policy 0, policy_version 1393249 (0.0007) [2023-12-28 05:16:22,800][106226] Updated weights for policy 0, policy_version 1393259 (0.0011) [2023-12-28 05:16:23,355][106225] Updated weights for policy 1, policy_version 1396508 (0.0008) [2023-12-28 05:16:23,402][106226] Updated weights for policy 0, policy_version 1393269 (0.0009) [2023-12-28 05:16:23,412][106225] Updated weights for policy 1, policy_version 1396518 (0.0009) [2023-12-28 05:16:23,462][106226] Updated weights for policy 0, policy_version 1393279 (0.0011) [2023-12-28 05:16:23,475][106225] Updated weights for policy 1, policy_version 1396528 (0.0008) [2023-12-28 05:16:23,522][106226] Updated weights for policy 0, policy_version 1393289 (0.0011) [2023-12-28 05:16:24,180][106226] Updated weights for policy 0, policy_version 1393299 (0.0009) [2023-12-28 05:16:24,217][106225] Updated weights for policy 1, policy_version 1396538 (0.0006) [2023-12-28 05:16:24,240][106226] Updated weights for policy 0, policy_version 1393309 (0.0008) [2023-12-28 05:16:24,281][106225] Updated weights for policy 1, policy_version 1396548 (0.0007) [2023-12-28 05:16:24,298][106226] Updated weights for policy 0, policy_version 1393319 (0.0008) [2023-12-28 05:16:24,349][106225] Updated weights for policy 1, policy_version 1396558 (0.0005) [2023-12-28 05:16:24,420][106225] Updated weights for policy 1, policy_version 1396568 (0.0007) [2023-12-28 05:16:24,857][106226] Updated weights for policy 0, policy_version 1393329 (0.0007) [2023-12-28 05:16:24,917][106226] Updated weights for policy 0, policy_version 1393339 (0.0005) [2023-12-28 05:16:24,974][106226] Updated weights for policy 0, policy_version 1393349 (0.0005) [2023-12-28 05:16:25,024][106226] Updated weights for policy 0, policy_version 1393359 (0.0005) [2023-12-28 05:16:25,202][106225] Updated weights for policy 1, policy_version 1396578 (0.0005) [2023-12-28 05:16:25,258][106225] Updated weights for policy 1, policy_version 1396588 (0.0005) [2023-12-28 05:16:25,309][106225] Updated weights for policy 1, policy_version 1396598 (0.0007) [2023-12-28 05:16:25,616][106226] Updated weights for policy 0, policy_version 1393369 (0.0006) [2023-12-28 05:16:25,683][106226] Updated weights for policy 0, policy_version 1393379 (0.0007) [2023-12-28 05:16:25,737][106226] Updated weights for policy 0, policy_version 1393389 (0.0005) [2023-12-28 05:16:26,045][106225] Updated weights for policy 1, policy_version 1396608 (0.0007) [2023-12-28 05:16:26,100][106225] Updated weights for policy 1, policy_version 1396618 (0.0008) [2023-12-28 05:16:26,147][106225] Updated weights for policy 1, policy_version 1396628 (0.0008) [2023-12-28 05:16:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 714366976. Throughput: 0: 9974.1, 1: 9771.2. Samples: 714332200. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:26,176][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.501')] [2023-12-28 05:16:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001396632_357588992.pth... [2023-12-28 05:16:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001393392_356777984.pth... [2023-12-28 05:16:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001392208_356474880.pth [2023-12-28 05:16:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001395480_357294080.pth [2023-12-28 05:16:26,354][106226] Updated weights for policy 0, policy_version 1393399 (0.0009) [2023-12-28 05:16:26,405][106226] Updated weights for policy 0, policy_version 1393409 (0.0011) [2023-12-28 05:16:26,467][106226] Updated weights for policy 0, policy_version 1393419 (0.0011) [2023-12-28 05:16:26,873][106225] Updated weights for policy 1, policy_version 1396638 (0.0006) [2023-12-28 05:16:26,929][106225] Updated weights for policy 1, policy_version 1396648 (0.0005) [2023-12-28 05:16:26,990][106225] Updated weights for policy 1, policy_version 1396658 (0.0007) [2023-12-28 05:16:27,170][106226] Updated weights for policy 0, policy_version 1393429 (0.0007) [2023-12-28 05:16:27,214][106226] Updated weights for policy 0, policy_version 1393439 (0.0008) [2023-12-28 05:16:27,277][106226] Updated weights for policy 0, policy_version 1393449 (0.0005) [2023-12-28 05:16:27,635][106225] Updated weights for policy 1, policy_version 1396668 (0.0008) [2023-12-28 05:16:27,682][106225] Updated weights for policy 1, policy_version 1396678 (0.0008) [2023-12-28 05:16:27,733][106225] Updated weights for policy 1, policy_version 1396688 (0.0007) [2023-12-28 05:16:27,871][106226] Updated weights for policy 0, policy_version 1393459 (0.0009) [2023-12-28 05:16:27,922][106226] Updated weights for policy 0, policy_version 1393469 (0.0005) [2023-12-28 05:16:27,984][106226] Updated weights for policy 0, policy_version 1393479 (0.0005) [2023-12-28 05:16:28,508][106225] Updated weights for policy 1, policy_version 1396698 (0.0007) [2023-12-28 05:16:28,535][106226] Updated weights for policy 0, policy_version 1393489 (0.0006) [2023-12-28 05:16:28,568][106225] Updated weights for policy 1, policy_version 1396708 (0.0005) [2023-12-28 05:16:28,596][106226] Updated weights for policy 0, policy_version 1393499 (0.0011) [2023-12-28 05:16:28,624][106225] Updated weights for policy 1, policy_version 1396718 (0.0005) [2023-12-28 05:16:28,658][106226] Updated weights for policy 0, policy_version 1393509 (0.0010) [2023-12-28 05:16:28,680][106225] Updated weights for policy 1, policy_version 1396728 (0.0007) [2023-12-28 05:16:28,718][106226] Updated weights for policy 0, policy_version 1393519 (0.0011) [2023-12-28 05:16:29,367][106225] Updated weights for policy 1, policy_version 1396738 (0.0008) [2023-12-28 05:16:29,396][106226] Updated weights for policy 0, policy_version 1393529 (0.0010) [2023-12-28 05:16:29,429][106225] Updated weights for policy 1, policy_version 1396748 (0.0008) [2023-12-28 05:16:29,446][106226] Updated weights for policy 0, policy_version 1393539 (0.0010) [2023-12-28 05:16:29,487][106225] Updated weights for policy 1, policy_version 1396758 (0.0008) [2023-12-28 05:16:29,510][106226] Updated weights for policy 0, policy_version 1393549 (0.0010) [2023-12-28 05:16:30,228][106226] Updated weights for policy 0, policy_version 1393559 (0.0011) [2023-12-28 05:16:30,244][106225] Updated weights for policy 1, policy_version 1396768 (0.0010) [2023-12-28 05:16:30,288][106226] Updated weights for policy 0, policy_version 1393569 (0.0008) [2023-12-28 05:16:30,304][106225] Updated weights for policy 1, policy_version 1396778 (0.0010) [2023-12-28 05:16:30,353][106226] Updated weights for policy 0, policy_version 1393579 (0.0007) [2023-12-28 05:16:30,364][106225] Updated weights for policy 1, policy_version 1396788 (0.0008) [2023-12-28 05:16:31,013][106225] Updated weights for policy 1, policy_version 1396798 (0.0006) [2023-12-28 05:16:31,042][106226] Updated weights for policy 0, policy_version 1393589 (0.0007) [2023-12-28 05:16:31,074][106225] Updated weights for policy 1, policy_version 1396808 (0.0008) [2023-12-28 05:16:31,098][106226] Updated weights for policy 0, policy_version 1393599 (0.0006) [2023-12-28 05:16:31,140][106225] Updated weights for policy 1, policy_version 1396818 (0.0008) [2023-12-28 05:16:31,165][106226] Updated weights for policy 0, policy_version 1393609 (0.0007) [2023-12-28 05:16:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 714457088. Throughput: 0: 10167.6, 1: 9746.2. Samples: 714454908. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:31,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-4.623')] [2023-12-28 05:16:31,834][106226] Updated weights for policy 0, policy_version 1393619 (0.0007) [2023-12-28 05:16:31,872][106225] Updated weights for policy 1, policy_version 1396828 (0.0008) [2023-12-28 05:16:31,894][106226] Updated weights for policy 0, policy_version 1393629 (0.0007) [2023-12-28 05:16:31,935][106225] Updated weights for policy 1, policy_version 1396838 (0.0007) [2023-12-28 05:16:31,957][106226] Updated weights for policy 0, policy_version 1393639 (0.0006) [2023-12-28 05:16:31,989][106225] Updated weights for policy 1, policy_version 1396848 (0.0006) [2023-12-28 05:16:32,674][106226] Updated weights for policy 0, policy_version 1393649 (0.0008) [2023-12-28 05:16:32,737][106226] Updated weights for policy 0, policy_version 1393659 (0.0009) [2023-12-28 05:16:32,749][106225] Updated weights for policy 1, policy_version 1396858 (0.0008) [2023-12-28 05:16:32,795][106226] Updated weights for policy 0, policy_version 1393669 (0.0008) [2023-12-28 05:16:32,811][106225] Updated weights for policy 1, policy_version 1396868 (0.0005) [2023-12-28 05:16:32,852][106226] Updated weights for policy 0, policy_version 1393679 (0.0008) [2023-12-28 05:16:32,864][106225] Updated weights for policy 1, policy_version 1396878 (0.0005) [2023-12-28 05:16:32,922][106225] Updated weights for policy 1, policy_version 1396888 (0.0009) [2023-12-28 05:16:33,473][106225] Updated weights for policy 1, policy_version 1396898 (0.0010) [2023-12-28 05:16:33,526][106225] Updated weights for policy 1, policy_version 1396908 (0.0010) [2023-12-28 05:16:33,555][106226] Updated weights for policy 0, policy_version 1393689 (0.0006) [2023-12-28 05:16:33,579][106225] Updated weights for policy 1, policy_version 1396918 (0.0010) [2023-12-28 05:16:33,604][106226] Updated weights for policy 0, policy_version 1393699 (0.0006) [2023-12-28 05:16:33,652][106226] Updated weights for policy 0, policy_version 1393709 (0.0007) [2023-12-28 05:16:34,306][106225] Updated weights for policy 1, policy_version 1396928 (0.0008) [2023-12-28 05:16:34,318][106226] Updated weights for policy 0, policy_version 1393719 (0.0008) [2023-12-28 05:16:34,366][106225] Updated weights for policy 1, policy_version 1396938 (0.0010) [2023-12-28 05:16:34,368][106226] Updated weights for policy 0, policy_version 1393729 (0.0008) [2023-12-28 05:16:34,424][106226] Updated weights for policy 0, policy_version 1393739 (0.0008) [2023-12-28 05:16:34,429][106225] Updated weights for policy 1, policy_version 1396948 (0.0007) [2023-12-28 05:16:35,094][106226] Updated weights for policy 0, policy_version 1393749 (0.0006) [2023-12-28 05:16:35,122][106225] Updated weights for policy 1, policy_version 1396958 (0.0011) [2023-12-28 05:16:35,165][106226] Updated weights for policy 0, policy_version 1393759 (0.0005) [2023-12-28 05:16:35,184][106225] Updated weights for policy 1, policy_version 1396968 (0.0011) [2023-12-28 05:16:35,227][106226] Updated weights for policy 0, policy_version 1393769 (0.0005) [2023-12-28 05:16:35,238][106225] Updated weights for policy 1, policy_version 1396978 (0.0010) [2023-12-28 05:16:35,805][106226] Updated weights for policy 0, policy_version 1393779 (0.0005) [2023-12-28 05:16:35,864][106226] Updated weights for policy 0, policy_version 1393789 (0.0006) [2023-12-28 05:16:35,915][106226] Updated weights for policy 0, policy_version 1393799 (0.0006) [2023-12-28 05:16:35,961][106225] Updated weights for policy 1, policy_version 1396988 (0.0009) [2023-12-28 05:16:36,017][106225] Updated weights for policy 1, policy_version 1396998 (0.0006) [2023-12-28 05:16:36,074][106225] Updated weights for policy 1, policy_version 1397008 (0.0009) [2023-12-28 05:16:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 714571776. Throughput: 0: 10210.9, 1: 9768.5. Samples: 714576524. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:36,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.770')] [2023-12-28 05:16:36,634][106226] Updated weights for policy 0, policy_version 1393809 (0.0006) [2023-12-28 05:16:36,692][106226] Updated weights for policy 0, policy_version 1393819 (0.0008) [2023-12-28 05:16:36,754][106226] Updated weights for policy 0, policy_version 1393829 (0.0008) [2023-12-28 05:16:36,807][106225] Updated weights for policy 1, policy_version 1397018 (0.0009) [2023-12-28 05:16:36,811][106226] Updated weights for policy 0, policy_version 1393839 (0.0007) [2023-12-28 05:16:36,870][106225] Updated weights for policy 1, policy_version 1397028 (0.0010) [2023-12-28 05:16:36,929][106225] Updated weights for policy 1, policy_version 1397038 (0.0011) [2023-12-28 05:16:36,990][106225] Updated weights for policy 1, policy_version 1397048 (0.0010) [2023-12-28 05:16:37,533][106226] Updated weights for policy 0, policy_version 1393849 (0.0008) [2023-12-28 05:16:37,589][106226] Updated weights for policy 0, policy_version 1393859 (0.0008) [2023-12-28 05:16:37,627][106225] Updated weights for policy 1, policy_version 1397058 (0.0011) [2023-12-28 05:16:37,649][106226] Updated weights for policy 0, policy_version 1393869 (0.0005) [2023-12-28 05:16:37,677][106225] Updated weights for policy 1, policy_version 1397068 (0.0010) [2023-12-28 05:16:37,732][106225] Updated weights for policy 1, policy_version 1397078 (0.0010) [2023-12-28 05:16:38,389][106226] Updated weights for policy 0, policy_version 1393879 (0.0008) [2023-12-28 05:16:38,454][106226] Updated weights for policy 0, policy_version 1393889 (0.0007) [2023-12-28 05:16:38,480][106225] Updated weights for policy 1, policy_version 1397088 (0.0008) [2023-12-28 05:16:38,517][106226] Updated weights for policy 0, policy_version 1393899 (0.0008) [2023-12-28 05:16:38,531][106225] Updated weights for policy 1, policy_version 1397098 (0.0005) [2023-12-28 05:16:38,599][106225] Updated weights for policy 1, policy_version 1397108 (0.0010) [2023-12-28 05:16:39,267][106225] Updated weights for policy 1, policy_version 1397118 (0.0010) [2023-12-28 05:16:39,288][106226] Updated weights for policy 0, policy_version 1393909 (0.0009) [2023-12-28 05:16:39,327][106225] Updated weights for policy 1, policy_version 1397128 (0.0010) [2023-12-28 05:16:39,364][106226] Updated weights for policy 0, policy_version 1393919 (0.0008) [2023-12-28 05:16:39,397][106225] Updated weights for policy 1, policy_version 1397138 (0.0009) [2023-12-28 05:16:39,435][106226] Updated weights for policy 0, policy_version 1393929 (0.0008) [2023-12-28 05:16:40,160][106225] Updated weights for policy 1, policy_version 1397148 (0.0012) [2023-12-28 05:16:40,215][106225] Updated weights for policy 1, policy_version 1397158 (0.0010) [2023-12-28 05:16:40,258][106226] Updated weights for policy 0, policy_version 1393939 (0.0008) [2023-12-28 05:16:40,272][106225] Updated weights for policy 1, policy_version 1397168 (0.0008) [2023-12-28 05:16:40,327][106226] Updated weights for policy 0, policy_version 1393949 (0.0005) [2023-12-28 05:16:40,392][106226] Updated weights for policy 0, policy_version 1393959 (0.0006) [2023-12-28 05:16:40,931][106225] Updated weights for policy 1, policy_version 1397178 (0.0008) [2023-12-28 05:16:40,976][106226] Updated weights for policy 0, policy_version 1393969 (0.0006) [2023-12-28 05:16:40,992][106225] Updated weights for policy 1, policy_version 1397188 (0.0010) [2023-12-28 05:16:41,030][106226] Updated weights for policy 0, policy_version 1393979 (0.0006) [2023-12-28 05:16:41,061][106225] Updated weights for policy 1, policy_version 1397198 (0.0011) [2023-12-28 05:16:41,094][106226] Updated weights for policy 0, policy_version 1393989 (0.0008) [2023-12-28 05:16:41,130][106225] Updated weights for policy 1, policy_version 1397208 (0.0011) [2023-12-28 05:16:41,163][106226] Updated weights for policy 0, policy_version 1393999 (0.0008) [2023-12-28 05:16:41,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 714670080. Throughput: 0: 10160.7, 1: 9755.1. Samples: 714633856. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:41,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-4.746')] [2023-12-28 05:16:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001397208_357736448.pth... [2023-12-28 05:16:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001394000_356933632.pth... [2023-12-28 05:16:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001396056_357441536.pth [2023-12-28 05:16:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001392784_356622336.pth [2023-12-28 05:16:41,881][106226] Updated weights for policy 0, policy_version 1394009 (0.0007) [2023-12-28 05:16:41,906][106225] Updated weights for policy 1, policy_version 1397218 (0.0006) [2023-12-28 05:16:41,943][106226] Updated weights for policy 0, policy_version 1394019 (0.0009) [2023-12-28 05:16:41,975][106225] Updated weights for policy 1, policy_version 1397228 (0.0008) [2023-12-28 05:16:42,009][106226] Updated weights for policy 0, policy_version 1394029 (0.0007) [2023-12-28 05:16:42,042][106225] Updated weights for policy 1, policy_version 1397238 (0.0007) [2023-12-28 05:16:42,689][106225] Updated weights for policy 1, policy_version 1397248 (0.0006) [2023-12-28 05:16:42,753][106225] Updated weights for policy 1, policy_version 1397258 (0.0007) [2023-12-28 05:16:42,755][106226] Updated weights for policy 0, policy_version 1394039 (0.0007) [2023-12-28 05:16:42,812][106226] Updated weights for policy 0, policy_version 1394049 (0.0006) [2023-12-28 05:16:42,819][106225] Updated weights for policy 1, policy_version 1397268 (0.0011) [2023-12-28 05:16:42,881][106226] Updated weights for policy 0, policy_version 1394059 (0.0007) [2023-12-28 05:16:43,451][106225] Updated weights for policy 1, policy_version 1397278 (0.0010) [2023-12-28 05:16:43,514][106225] Updated weights for policy 1, policy_version 1397288 (0.0010) [2023-12-28 05:16:43,577][106225] Updated weights for policy 1, policy_version 1397298 (0.0010) [2023-12-28 05:16:43,587][106226] Updated weights for policy 0, policy_version 1394069 (0.0005) [2023-12-28 05:16:43,646][106226] Updated weights for policy 0, policy_version 1394079 (0.0007) [2023-12-28 05:16:43,712][106226] Updated weights for policy 0, policy_version 1394089 (0.0010) [2023-12-28 05:16:44,202][106225] Updated weights for policy 1, policy_version 1397308 (0.0010) [2023-12-28 05:16:44,261][106225] Updated weights for policy 1, policy_version 1397318 (0.0010) [2023-12-28 05:16:44,317][106225] Updated weights for policy 1, policy_version 1397328 (0.0010) [2023-12-28 05:16:44,473][106226] Updated weights for policy 0, policy_version 1394099 (0.0009) [2023-12-28 05:16:44,531][106226] Updated weights for policy 0, policy_version 1394109 (0.0008) [2023-12-28 05:16:44,593][106226] Updated weights for policy 0, policy_version 1394119 (0.0008) [2023-12-28 05:16:45,045][106225] Updated weights for policy 1, policy_version 1397338 (0.0009) [2023-12-28 05:16:45,113][106225] Updated weights for policy 1, policy_version 1397348 (0.0005) [2023-12-28 05:16:45,182][106225] Updated weights for policy 1, policy_version 1397358 (0.0006) [2023-12-28 05:16:45,239][106225] Updated weights for policy 1, policy_version 1397368 (0.0009) [2023-12-28 05:16:45,360][106226] Updated weights for policy 0, policy_version 1394129 (0.0007) [2023-12-28 05:16:45,417][106226] Updated weights for policy 0, policy_version 1394139 (0.0008) [2023-12-28 05:16:45,476][106226] Updated weights for policy 0, policy_version 1394149 (0.0008) [2023-12-28 05:16:45,541][106226] Updated weights for policy 0, policy_version 1394159 (0.0008) [2023-12-28 05:16:45,902][106225] Updated weights for policy 1, policy_version 1397378 (0.0008) [2023-12-28 05:16:45,966][106225] Updated weights for policy 1, policy_version 1397388 (0.0010) [2023-12-28 05:16:46,026][106225] Updated weights for policy 1, policy_version 1397398 (0.0008) [2023-12-28 05:16:46,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 714760192. Throughput: 0: 10107.3, 1: 9771.3. Samples: 714750256. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:46,176][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.852')] [2023-12-28 05:16:46,247][106226] Updated weights for policy 0, policy_version 1394169 (0.0009) [2023-12-28 05:16:46,296][106226] Updated weights for policy 0, policy_version 1394179 (0.0009) [2023-12-28 05:16:46,355][106226] Updated weights for policy 0, policy_version 1394189 (0.0008) [2023-12-28 05:16:46,794][106225] Updated weights for policy 1, policy_version 1397408 (0.0009) [2023-12-28 05:16:46,853][106225] Updated weights for policy 1, policy_version 1397418 (0.0008) [2023-12-28 05:16:46,901][106225] Updated weights for policy 1, policy_version 1397428 (0.0008) [2023-12-28 05:16:47,029][106226] Updated weights for policy 0, policy_version 1394199 (0.0007) [2023-12-28 05:16:47,080][106226] Updated weights for policy 0, policy_version 1394209 (0.0006) [2023-12-28 05:16:47,134][106226] Updated weights for policy 0, policy_version 1394219 (0.0007) [2023-12-28 05:16:47,636][106225] Updated weights for policy 1, policy_version 1397438 (0.0006) [2023-12-28 05:16:47,690][106225] Updated weights for policy 1, policy_version 1397448 (0.0005) [2023-12-28 05:16:47,755][106225] Updated weights for policy 1, policy_version 1397458 (0.0005) [2023-12-28 05:16:47,782][106226] Updated weights for policy 0, policy_version 1394229 (0.0008) [2023-12-28 05:16:47,834][106226] Updated weights for policy 0, policy_version 1394239 (0.0005) [2023-12-28 05:16:47,883][106226] Updated weights for policy 0, policy_version 1394249 (0.0005) [2023-12-28 05:16:48,266][106225] Updated weights for policy 1, policy_version 1397468 (0.0007) [2023-12-28 05:16:48,324][106225] Updated weights for policy 1, policy_version 1397478 (0.0009) [2023-12-28 05:16:48,378][106225] Updated weights for policy 1, policy_version 1397488 (0.0008) [2023-12-28 05:16:48,619][106226] Updated weights for policy 0, policy_version 1394259 (0.0009) [2023-12-28 05:16:48,669][106226] Updated weights for policy 0, policy_version 1394269 (0.0006) [2023-12-28 05:16:48,723][106226] Updated weights for policy 0, policy_version 1394279 (0.0006) [2023-12-28 05:16:49,113][106225] Updated weights for policy 1, policy_version 1397498 (0.0006) [2023-12-28 05:16:49,171][106225] Updated weights for policy 1, policy_version 1397508 (0.0010) [2023-12-28 05:16:49,227][106225] Updated weights for policy 1, policy_version 1397518 (0.0009) [2023-12-28 05:16:49,290][106225] Updated weights for policy 1, policy_version 1397528 (0.0008) [2023-12-28 05:16:49,371][106226] Updated weights for policy 0, policy_version 1394289 (0.0006) [2023-12-28 05:16:49,438][106226] Updated weights for policy 0, policy_version 1394299 (0.0009) [2023-12-28 05:16:49,497][106226] Updated weights for policy 0, policy_version 1394309 (0.0009) [2023-12-28 05:16:49,557][106226] Updated weights for policy 0, policy_version 1394319 (0.0008) [2023-12-28 05:16:50,077][106225] Updated weights for policy 1, policy_version 1397538 (0.0008) [2023-12-28 05:16:50,126][106225] Updated weights for policy 1, policy_version 1397548 (0.0009) [2023-12-28 05:16:50,176][106225] Updated weights for policy 1, policy_version 1397558 (0.0008) [2023-12-28 05:16:50,294][106226] Updated weights for policy 0, policy_version 1394329 (0.0008) [2023-12-28 05:16:50,353][106226] Updated weights for policy 0, policy_version 1394339 (0.0008) [2023-12-28 05:16:50,413][106226] Updated weights for policy 0, policy_version 1394349 (0.0009) [2023-12-28 05:16:50,923][106225] Updated weights for policy 1, policy_version 1397568 (0.0007) [2023-12-28 05:16:50,986][106225] Updated weights for policy 1, policy_version 1397578 (0.0008) [2023-12-28 05:16:51,052][106225] Updated weights for policy 1, policy_version 1397588 (0.0009) [2023-12-28 05:16:51,173][106226] Updated weights for policy 0, policy_version 1394359 (0.0008) [2023-12-28 05:16:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 714858496. Throughput: 0: 10091.6, 1: 9784.4. Samples: 714868780. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:51,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.855')] [2023-12-28 05:16:51,235][106226] Updated weights for policy 0, policy_version 1394369 (0.0008) [2023-12-28 05:16:51,297][106226] Updated weights for policy 0, policy_version 1394379 (0.0009) [2023-12-28 05:16:51,816][106225] Updated weights for policy 1, policy_version 1397598 (0.0008) [2023-12-28 05:16:51,866][106225] Updated weights for policy 1, policy_version 1397608 (0.0008) [2023-12-28 05:16:51,921][106225] Updated weights for policy 1, policy_version 1397619 (0.0010) [2023-12-28 05:16:52,011][106226] Updated weights for policy 0, policy_version 1394389 (0.0008) [2023-12-28 05:16:52,069][106226] Updated weights for policy 0, policy_version 1394399 (0.0007) [2023-12-28 05:16:52,123][106226] Updated weights for policy 0, policy_version 1394409 (0.0008) [2023-12-28 05:16:52,651][106225] Updated weights for policy 1, policy_version 1397629 (0.0009) [2023-12-28 05:16:52,709][106225] Updated weights for policy 1, policy_version 1397639 (0.0009) [2023-12-28 05:16:52,743][106226] Updated weights for policy 0, policy_version 1394419 (0.0007) [2023-12-28 05:16:52,766][106225] Updated weights for policy 1, policy_version 1397649 (0.0008) [2023-12-28 05:16:52,810][106226] Updated weights for policy 0, policy_version 1394429 (0.0010) [2023-12-28 05:16:52,873][106226] Updated weights for policy 0, policy_version 1394439 (0.0008) [2023-12-28 05:16:53,495][106225] Updated weights for policy 1, policy_version 1397659 (0.0010) [2023-12-28 05:16:53,512][106226] Updated weights for policy 0, policy_version 1394449 (0.0010) [2023-12-28 05:16:53,550][106225] Updated weights for policy 1, policy_version 1397669 (0.0006) [2023-12-28 05:16:53,576][106226] Updated weights for policy 0, policy_version 1394459 (0.0006) [2023-12-28 05:16:53,600][106225] Updated weights for policy 1, policy_version 1397679 (0.0005) [2023-12-28 05:16:53,628][106226] Updated weights for policy 0, policy_version 1394469 (0.0005) [2023-12-28 05:16:53,679][106226] Updated weights for policy 0, policy_version 1394479 (0.0005) [2023-12-28 05:16:54,282][106226] Updated weights for policy 0, policy_version 1394489 (0.0006) [2023-12-28 05:16:54,317][106225] Updated weights for policy 1, policy_version 1397689 (0.0007) [2023-12-28 05:16:54,350][106226] Updated weights for policy 0, policy_version 1394499 (0.0007) [2023-12-28 05:16:54,376][106225] Updated weights for policy 1, policy_version 1397699 (0.0006) [2023-12-28 05:16:54,408][106226] Updated weights for policy 0, policy_version 1394509 (0.0010) [2023-12-28 05:16:54,433][106225] Updated weights for policy 1, policy_version 1397709 (0.0006) [2023-12-28 05:16:54,490][106225] Updated weights for policy 1, policy_version 1397719 (0.0008) [2023-12-28 05:16:55,071][106226] Updated weights for policy 0, policy_version 1394519 (0.0011) [2023-12-28 05:16:55,139][106226] Updated weights for policy 0, policy_version 1394529 (0.0011) [2023-12-28 05:16:55,183][106225] Updated weights for policy 1, policy_version 1397729 (0.0010) [2023-12-28 05:16:55,190][106226] Updated weights for policy 0, policy_version 1394539 (0.0011) [2023-12-28 05:16:55,241][106225] Updated weights for policy 1, policy_version 1397739 (0.0010) [2023-12-28 05:16:55,294][106225] Updated weights for policy 1, policy_version 1397749 (0.0010) [2023-12-28 05:16:55,814][106226] Updated weights for policy 0, policy_version 1394549 (0.0010) [2023-12-28 05:16:55,864][106226] Updated weights for policy 0, policy_version 1394559 (0.0008) [2023-12-28 05:16:55,917][106226] Updated weights for policy 0, policy_version 1394569 (0.0009) [2023-12-28 05:16:55,934][106225] Updated weights for policy 1, policy_version 1397759 (0.0007) [2023-12-28 05:16:55,987][106225] Updated weights for policy 1, policy_version 1397769 (0.0005) [2023-12-28 05:16:56,045][106225] Updated weights for policy 1, policy_version 1397779 (0.0005) [2023-12-28 05:16:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 714964992. Throughput: 0: 10112.3, 1: 9739.5. Samples: 714928972. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:16:56,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.786')] [2023-12-28 05:16:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001397784_357883904.pth... [2023-12-28 05:16:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001394576_357081088.pth... [2023-12-28 05:16:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001396632_357588992.pth [2023-12-28 05:16:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001393392_356777984.pth [2023-12-28 05:16:56,613][106225] Updated weights for policy 1, policy_version 1397789 (0.0008) [2023-12-28 05:16:56,647][106226] Updated weights for policy 0, policy_version 1394579 (0.0011) [2023-12-28 05:16:56,668][106225] Updated weights for policy 1, policy_version 1397799 (0.0009) [2023-12-28 05:16:56,694][106226] Updated weights for policy 0, policy_version 1394589 (0.0010) [2023-12-28 05:16:56,716][106225] Updated weights for policy 1, policy_version 1397809 (0.0005) [2023-12-28 05:16:56,744][106226] Updated weights for policy 0, policy_version 1394599 (0.0010) [2023-12-28 05:16:57,382][106225] Updated weights for policy 1, policy_version 1397819 (0.0007) [2023-12-28 05:16:57,425][106225] Updated weights for policy 1, policy_version 1397829 (0.0005) [2023-12-28 05:16:57,468][106225] Updated weights for policy 1, policy_version 1397839 (0.0005) [2023-12-28 05:16:57,494][106226] Updated weights for policy 0, policy_version 1394609 (0.0008) [2023-12-28 05:16:57,552][106226] Updated weights for policy 0, policy_version 1394619 (0.0007) [2023-12-28 05:16:57,605][106226] Updated weights for policy 0, policy_version 1394629 (0.0008) [2023-12-28 05:16:57,651][106226] Updated weights for policy 0, policy_version 1394639 (0.0006) [2023-12-28 05:16:58,119][106225] Updated weights for policy 1, policy_version 1397849 (0.0009) [2023-12-28 05:16:58,169][106225] Updated weights for policy 1, policy_version 1397859 (0.0009) [2023-12-28 05:16:58,229][106225] Updated weights for policy 1, policy_version 1397869 (0.0009) [2023-12-28 05:16:58,260][106226] Updated weights for policy 0, policy_version 1394649 (0.0007) [2023-12-28 05:16:58,289][106225] Updated weights for policy 1, policy_version 1397879 (0.0008) [2023-12-28 05:16:58,320][106226] Updated weights for policy 0, policy_version 1394659 (0.0007) [2023-12-28 05:16:58,384][106226] Updated weights for policy 0, policy_version 1394669 (0.0007) [2023-12-28 05:16:59,162][106226] Updated weights for policy 0, policy_version 1394679 (0.0008) [2023-12-28 05:16:59,167][106225] Updated weights for policy 1, policy_version 1397889 (0.0007) [2023-12-28 05:16:59,227][106226] Updated weights for policy 0, policy_version 1394689 (0.0008) [2023-12-28 05:16:59,228][106225] Updated weights for policy 1, policy_version 1397899 (0.0008) [2023-12-28 05:16:59,298][106225] Updated weights for policy 1, policy_version 1397909 (0.0008) [2023-12-28 05:16:59,301][106226] Updated weights for policy 0, policy_version 1394699 (0.0010) [2023-12-28 05:17:00,048][106225] Updated weights for policy 1, policy_version 1397919 (0.0008) [2023-12-28 05:17:00,095][106225] Updated weights for policy 1, policy_version 1397929 (0.0006) [2023-12-28 05:17:00,097][106226] Updated weights for policy 0, policy_version 1394709 (0.0011) [2023-12-28 05:17:00,144][106226] Updated weights for policy 0, policy_version 1394719 (0.0010) [2023-12-28 05:17:00,146][106225] Updated weights for policy 1, policy_version 1397939 (0.0005) [2023-12-28 05:17:00,204][106226] Updated weights for policy 0, policy_version 1394729 (0.0010) [2023-12-28 05:17:00,887][106225] Updated weights for policy 1, policy_version 1397949 (0.0007) [2023-12-28 05:17:00,920][106226] Updated weights for policy 0, policy_version 1394739 (0.0010) [2023-12-28 05:17:00,948][106225] Updated weights for policy 1, policy_version 1397959 (0.0006) [2023-12-28 05:17:00,974][106226] Updated weights for policy 0, policy_version 1394749 (0.0010) [2023-12-28 05:17:01,009][106225] Updated weights for policy 1, policy_version 1397969 (0.0006) [2023-12-28 05:17:01,024][106226] Updated weights for policy 0, policy_version 1394759 (0.0010) [2023-12-28 05:17:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 715063296. Throughput: 0: 10113.8, 1: 9823.5. Samples: 715048528. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:01,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.431')] [2023-12-28 05:17:01,725][106225] Updated weights for policy 1, policy_version 1397979 (0.0009) [2023-12-28 05:17:01,754][106226] Updated weights for policy 0, policy_version 1394769 (0.0008) [2023-12-28 05:17:01,797][106225] Updated weights for policy 1, policy_version 1397989 (0.0009) [2023-12-28 05:17:01,816][106226] Updated weights for policy 0, policy_version 1394779 (0.0009) [2023-12-28 05:17:01,860][106225] Updated weights for policy 1, policy_version 1397999 (0.0008) [2023-12-28 05:17:01,878][106226] Updated weights for policy 0, policy_version 1394789 (0.0009) [2023-12-28 05:17:01,940][106226] Updated weights for policy 0, policy_version 1394799 (0.0010) [2023-12-28 05:17:02,469][106225] Updated weights for policy 1, policy_version 1398009 (0.0006) [2023-12-28 05:17:02,530][106225] Updated weights for policy 1, policy_version 1398019 (0.0008) [2023-12-28 05:17:02,592][106225] Updated weights for policy 1, policy_version 1398029 (0.0008) [2023-12-28 05:17:02,647][106225] Updated weights for policy 1, policy_version 1398039 (0.0007) [2023-12-28 05:17:02,656][106226] Updated weights for policy 0, policy_version 1394809 (0.0010) [2023-12-28 05:17:02,724][106226] Updated weights for policy 0, policy_version 1394819 (0.0011) [2023-12-28 05:17:02,785][106226] Updated weights for policy 0, policy_version 1394829 (0.0010) [2023-12-28 05:17:03,307][106225] Updated weights for policy 1, policy_version 1398049 (0.0010) [2023-12-28 05:17:03,363][106225] Updated weights for policy 1, policy_version 1398059 (0.0010) [2023-12-28 05:17:03,416][106225] Updated weights for policy 1, policy_version 1398069 (0.0010) [2023-12-28 05:17:03,495][106226] Updated weights for policy 0, policy_version 1394839 (0.0011) [2023-12-28 05:17:03,552][106226] Updated weights for policy 0, policy_version 1394849 (0.0011) [2023-12-28 05:17:03,615][106226] Updated weights for policy 0, policy_version 1394859 (0.0011) [2023-12-28 05:17:04,184][106225] Updated weights for policy 1, policy_version 1398079 (0.0008) [2023-12-28 05:17:04,247][106225] Updated weights for policy 1, policy_version 1398089 (0.0008) [2023-12-28 05:17:04,288][106226] Updated weights for policy 0, policy_version 1394869 (0.0011) [2023-12-28 05:17:04,309][106225] Updated weights for policy 1, policy_version 1398099 (0.0006) [2023-12-28 05:17:04,354][106226] Updated weights for policy 0, policy_version 1394879 (0.0011) [2023-12-28 05:17:04,411][106226] Updated weights for policy 0, policy_version 1394889 (0.0011) [2023-12-28 05:17:05,033][106225] Updated weights for policy 1, policy_version 1398109 (0.0007) [2023-12-28 05:17:05,085][106225] Updated weights for policy 1, policy_version 1398119 (0.0008) [2023-12-28 05:17:05,137][106225] Updated weights for policy 1, policy_version 1398129 (0.0007) [2023-12-28 05:17:05,138][106226] Updated weights for policy 0, policy_version 1394899 (0.0011) [2023-12-28 05:17:05,195][106226] Updated weights for policy 0, policy_version 1394909 (0.0010) [2023-12-28 05:17:05,246][106226] Updated weights for policy 0, policy_version 1394919 (0.0010) [2023-12-28 05:17:05,878][106225] Updated weights for policy 1, policy_version 1398139 (0.0006) [2023-12-28 05:17:05,939][106225] Updated weights for policy 1, policy_version 1398149 (0.0007) [2023-12-28 05:17:05,980][106226] Updated weights for policy 0, policy_version 1394929 (0.0010) [2023-12-28 05:17:06,002][106225] Updated weights for policy 1, policy_version 1398159 (0.0007) [2023-12-28 05:17:06,036][106226] Updated weights for policy 0, policy_version 1394939 (0.0010) [2023-12-28 05:17:06,089][106226] Updated weights for policy 0, policy_version 1394949 (0.0010) [2023-12-28 05:17:06,152][106226] Updated weights for policy 0, policy_version 1394959 (0.0011) [2023-12-28 05:17:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 715161600. Throughput: 0: 10000.6, 1: 9807.5. Samples: 715164980. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:06,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.499')] [2023-12-28 05:17:06,748][106225] Updated weights for policy 1, policy_version 1398169 (0.0007) [2023-12-28 05:17:06,810][106225] Updated weights for policy 1, policy_version 1398179 (0.0008) [2023-12-28 05:17:06,828][106226] Updated weights for policy 0, policy_version 1394969 (0.0007) [2023-12-28 05:17:06,868][106225] Updated weights for policy 1, policy_version 1398189 (0.0008) [2023-12-28 05:17:06,883][106226] Updated weights for policy 0, policy_version 1394979 (0.0008) [2023-12-28 05:17:06,929][106225] Updated weights for policy 1, policy_version 1398199 (0.0008) [2023-12-28 05:17:06,932][106226] Updated weights for policy 0, policy_version 1394989 (0.0008) [2023-12-28 05:17:07,521][106225] Updated weights for policy 1, policy_version 1398209 (0.0006) [2023-12-28 05:17:07,580][106225] Updated weights for policy 1, policy_version 1398219 (0.0005) [2023-12-28 05:17:07,647][106225] Updated weights for policy 1, policy_version 1398229 (0.0006) [2023-12-28 05:17:07,656][106226] Updated weights for policy 0, policy_version 1394999 (0.0007) [2023-12-28 05:17:07,710][106226] Updated weights for policy 0, policy_version 1395009 (0.0006) [2023-12-28 05:17:07,771][106226] Updated weights for policy 0, policy_version 1395019 (0.0005) [2023-12-28 05:17:08,225][106225] Updated weights for policy 1, policy_version 1398239 (0.0005) [2023-12-28 05:17:08,277][106225] Updated weights for policy 1, policy_version 1398249 (0.0006) [2023-12-28 05:17:08,333][106225] Updated weights for policy 1, policy_version 1398259 (0.0006) [2023-12-28 05:17:08,434][106226] Updated weights for policy 0, policy_version 1395029 (0.0008) [2023-12-28 05:17:08,510][106226] Updated weights for policy 0, policy_version 1395039 (0.0011) [2023-12-28 05:17:08,576][106226] Updated weights for policy 0, policy_version 1395049 (0.0011) [2023-12-28 05:17:08,992][106225] Updated weights for policy 1, policy_version 1398269 (0.0008) [2023-12-28 05:17:09,045][106225] Updated weights for policy 1, policy_version 1398279 (0.0007) [2023-12-28 05:17:09,093][106225] Updated weights for policy 1, policy_version 1398289 (0.0008) [2023-12-28 05:17:09,276][106226] Updated weights for policy 0, policy_version 1395059 (0.0010) [2023-12-28 05:17:09,345][106226] Updated weights for policy 0, policy_version 1395069 (0.0006) [2023-12-28 05:17:09,419][106226] Updated weights for policy 0, policy_version 1395079 (0.0008) [2023-12-28 05:17:09,908][106225] Updated weights for policy 1, policy_version 1398299 (0.0008) [2023-12-28 05:17:09,978][106225] Updated weights for policy 1, policy_version 1398309 (0.0008) [2023-12-28 05:17:10,040][106225] Updated weights for policy 1, policy_version 1398319 (0.0008) [2023-12-28 05:17:10,073][106226] Updated weights for policy 0, policy_version 1395089 (0.0008) [2023-12-28 05:17:10,133][106226] Updated weights for policy 0, policy_version 1395099 (0.0010) [2023-12-28 05:17:10,191][106226] Updated weights for policy 0, policy_version 1395109 (0.0007) [2023-12-28 05:17:10,254][106226] Updated weights for policy 0, policy_version 1395119 (0.0009) [2023-12-28 05:17:10,790][106225] Updated weights for policy 1, policy_version 1398329 (0.0008) [2023-12-28 05:17:10,856][106225] Updated weights for policy 1, policy_version 1398339 (0.0007) [2023-12-28 05:17:10,919][106225] Updated weights for policy 1, policy_version 1398349 (0.0007) [2023-12-28 05:17:10,979][106225] Updated weights for policy 1, policy_version 1398359 (0.0008) [2023-12-28 05:17:10,981][106226] Updated weights for policy 0, policy_version 1395129 (0.0008) [2023-12-28 05:17:11,039][106226] Updated weights for policy 0, policy_version 1395139 (0.0008) [2023-12-28 05:17:11,107][106226] Updated weights for policy 0, policy_version 1395149 (0.0008) [2023-12-28 05:17:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 715259904. Throughput: 0: 9996.2, 1: 9876.4. Samples: 715226464. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:11,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.916')] [2023-12-28 05:17:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001398360_358031360.pth... [2023-12-28 05:17:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001395152_357228544.pth... [2023-12-28 05:17:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001394000_356933632.pth [2023-12-28 05:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001397208_357736448.pth [2023-12-28 05:17:11,722][106225] Updated weights for policy 1, policy_version 1398369 (0.0007) [2023-12-28 05:17:11,787][106225] Updated weights for policy 1, policy_version 1398379 (0.0008) [2023-12-28 05:17:11,837][106225] Updated weights for policy 1, policy_version 1398389 (0.0007) [2023-12-28 05:17:11,969][106226] Updated weights for policy 0, policy_version 1395159 (0.0009) [2023-12-28 05:17:12,036][106226] Updated weights for policy 0, policy_version 1395169 (0.0008) [2023-12-28 05:17:12,099][106226] Updated weights for policy 0, policy_version 1395179 (0.0009) [2023-12-28 05:17:12,481][106225] Updated weights for policy 1, policy_version 1398399 (0.0007) [2023-12-28 05:17:12,532][106225] Updated weights for policy 1, policy_version 1398409 (0.0006) [2023-12-28 05:17:12,591][106225] Updated weights for policy 1, policy_version 1398419 (0.0005) [2023-12-28 05:17:12,933][106226] Updated weights for policy 0, policy_version 1395189 (0.0009) [2023-12-28 05:17:12,982][106226] Updated weights for policy 0, policy_version 1395199 (0.0008) [2023-12-28 05:17:13,038][106226] Updated weights for policy 0, policy_version 1395209 (0.0009) [2023-12-28 05:17:13,152][106225] Updated weights for policy 1, policy_version 1398429 (0.0007) [2023-12-28 05:17:13,198][106225] Updated weights for policy 1, policy_version 1398439 (0.0005) [2023-12-28 05:17:13,242][106225] Updated weights for policy 1, policy_version 1398449 (0.0005) [2023-12-28 05:17:13,769][106226] Updated weights for policy 0, policy_version 1395220 (0.0008) [2023-12-28 05:17:13,832][106226] Updated weights for policy 0, policy_version 1395230 (0.0005) [2023-12-28 05:17:13,841][106225] Updated weights for policy 1, policy_version 1398459 (0.0005) [2023-12-28 05:17:13,897][106226] Updated weights for policy 0, policy_version 1395240 (0.0005) [2023-12-28 05:17:13,897][106225] Updated weights for policy 1, policy_version 1398469 (0.0005) [2023-12-28 05:17:13,955][106225] Updated weights for policy 1, policy_version 1398479 (0.0007) [2023-12-28 05:17:14,467][106226] Updated weights for policy 0, policy_version 1395250 (0.0006) [2023-12-28 05:17:14,527][106226] Updated weights for policy 0, policy_version 1395260 (0.0005) [2023-12-28 05:17:14,587][106226] Updated weights for policy 0, policy_version 1395270 (0.0005) [2023-12-28 05:17:14,614][106225] Updated weights for policy 1, policy_version 1398489 (0.0009) [2023-12-28 05:17:14,644][106226] Updated weights for policy 0, policy_version 1395280 (0.0005) [2023-12-28 05:17:14,665][106225] Updated weights for policy 1, policy_version 1398499 (0.0010) [2023-12-28 05:17:14,729][106225] Updated weights for policy 1, policy_version 1398509 (0.0010) [2023-12-28 05:17:14,798][106225] Updated weights for policy 1, policy_version 1398519 (0.0010) [2023-12-28 05:17:15,328][106226] Updated weights for policy 0, policy_version 1395290 (0.0008) [2023-12-28 05:17:15,383][106226] Updated weights for policy 0, policy_version 1395300 (0.0010) [2023-12-28 05:17:15,447][106226] Updated weights for policy 0, policy_version 1395310 (0.0009) [2023-12-28 05:17:15,483][106225] Updated weights for policy 1, policy_version 1398529 (0.0006) [2023-12-28 05:17:15,546][106225] Updated weights for policy 1, policy_version 1398539 (0.0005) [2023-12-28 05:17:15,599][106225] Updated weights for policy 1, policy_version 1398549 (0.0005) [2023-12-28 05:17:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 715350016. Throughput: 0: 9829.3, 1: 9947.2. Samples: 715344856. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:16,176][105115] Avg episode reward: [(0, '-4.682'), (1, '-4.739')] [2023-12-28 05:17:16,192][106225] Updated weights for policy 1, policy_version 1398559 (0.0009) [2023-12-28 05:17:16,221][106226] Updated weights for policy 0, policy_version 1395320 (0.0009) [2023-12-28 05:17:16,242][106225] Updated weights for policy 1, policy_version 1398569 (0.0010) [2023-12-28 05:17:16,276][106226] Updated weights for policy 0, policy_version 1395330 (0.0006) [2023-12-28 05:17:16,289][106225] Updated weights for policy 1, policy_version 1398579 (0.0010) [2023-12-28 05:17:16,327][106226] Updated weights for policy 0, policy_version 1395340 (0.0007) [2023-12-28 05:17:16,850][106225] Updated weights for policy 1, policy_version 1398589 (0.0010) [2023-12-28 05:17:16,904][106225] Updated weights for policy 1, policy_version 1398599 (0.0010) [2023-12-28 05:17:16,966][106225] Updated weights for policy 1, policy_version 1398609 (0.0010) [2023-12-28 05:17:17,096][106226] Updated weights for policy 0, policy_version 1395350 (0.0009) [2023-12-28 05:17:17,153][106226] Updated weights for policy 0, policy_version 1395360 (0.0006) [2023-12-28 05:17:17,216][106226] Updated weights for policy 0, policy_version 1395370 (0.0008) [2023-12-28 05:17:17,627][106225] Updated weights for policy 1, policy_version 1398619 (0.0009) [2023-12-28 05:17:17,674][106225] Updated weights for policy 1, policy_version 1398629 (0.0007) [2023-12-28 05:17:17,729][106225] Updated weights for policy 1, policy_version 1398639 (0.0008) [2023-12-28 05:17:17,888][106226] Updated weights for policy 0, policy_version 1395380 (0.0011) [2023-12-28 05:17:17,938][106226] Updated weights for policy 0, policy_version 1395390 (0.0010) [2023-12-28 05:17:17,984][106226] Updated weights for policy 0, policy_version 1395400 (0.0010) [2023-12-28 05:17:18,299][106225] Updated weights for policy 1, policy_version 1398649 (0.0008) [2023-12-28 05:17:18,355][106225] Updated weights for policy 1, policy_version 1398659 (0.0008) [2023-12-28 05:17:18,417][106225] Updated weights for policy 1, policy_version 1398669 (0.0006) [2023-12-28 05:17:18,467][106225] Updated weights for policy 1, policy_version 1398679 (0.0007) [2023-12-28 05:17:18,684][106226] Updated weights for policy 0, policy_version 1395410 (0.0010) [2023-12-28 05:17:18,746][106226] Updated weights for policy 0, policy_version 1395420 (0.0009) [2023-12-28 05:17:18,807][106226] Updated weights for policy 0, policy_version 1395430 (0.0009) [2023-12-28 05:17:18,860][106226] Updated weights for policy 0, policy_version 1395440 (0.0010) [2023-12-28 05:17:19,080][106225] Updated weights for policy 1, policy_version 1398689 (0.0006) [2023-12-28 05:17:19,144][106225] Updated weights for policy 1, policy_version 1398699 (0.0005) [2023-12-28 05:17:19,209][106225] Updated weights for policy 1, policy_version 1398709 (0.0006) [2023-12-28 05:17:19,612][106226] Updated weights for policy 0, policy_version 1395450 (0.0011) [2023-12-28 05:17:19,676][106226] Updated weights for policy 0, policy_version 1395460 (0.0011) [2023-12-28 05:17:19,747][106226] Updated weights for policy 0, policy_version 1395470 (0.0011) [2023-12-28 05:17:19,869][106225] Updated weights for policy 1, policy_version 1398719 (0.0009) [2023-12-28 05:17:19,935][106225] Updated weights for policy 1, policy_version 1398729 (0.0011) [2023-12-28 05:17:19,998][106225] Updated weights for policy 1, policy_version 1398739 (0.0010) [2023-12-28 05:17:20,472][106226] Updated weights for policy 0, policy_version 1395480 (0.0011) [2023-12-28 05:17:20,522][106226] Updated weights for policy 0, policy_version 1395490 (0.0010) [2023-12-28 05:17:20,579][106226] Updated weights for policy 0, policy_version 1395500 (0.0011) [2023-12-28 05:17:20,692][106225] Updated weights for policy 1, policy_version 1398749 (0.0011) [2023-12-28 05:17:20,756][106225] Updated weights for policy 1, policy_version 1398759 (0.0009) [2023-12-28 05:17:20,822][106225] Updated weights for policy 1, policy_version 1398769 (0.0010) [2023-12-28 05:17:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 715456512. Throughput: 0: 9716.0, 1: 10062.5. Samples: 715466556. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:21,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-4.326')] [2023-12-28 05:17:21,297][106226] Updated weights for policy 0, policy_version 1395510 (0.0011) [2023-12-28 05:17:21,361][106226] Updated weights for policy 0, policy_version 1395520 (0.0009) [2023-12-28 05:17:21,433][106226] Updated weights for policy 0, policy_version 1395530 (0.0010) [2023-12-28 05:17:21,543][106225] Updated weights for policy 1, policy_version 1398779 (0.0009) [2023-12-28 05:17:21,607][106225] Updated weights for policy 1, policy_version 1398789 (0.0010) [2023-12-28 05:17:21,673][106225] Updated weights for policy 1, policy_version 1398799 (0.0011) [2023-12-28 05:17:22,145][106226] Updated weights for policy 0, policy_version 1395540 (0.0011) [2023-12-28 05:17:22,212][106226] Updated weights for policy 0, policy_version 1395550 (0.0009) [2023-12-28 05:17:22,283][106226] Updated weights for policy 0, policy_version 1395560 (0.0007) [2023-12-28 05:17:22,422][106225] Updated weights for policy 1, policy_version 1398809 (0.0010) [2023-12-28 05:17:22,483][106225] Updated weights for policy 1, policy_version 1398819 (0.0009) [2023-12-28 05:17:22,545][106225] Updated weights for policy 1, policy_version 1398829 (0.0010) [2023-12-28 05:17:22,601][106225] Updated weights for policy 1, policy_version 1398839 (0.0010) [2023-12-28 05:17:23,004][106226] Updated weights for policy 0, policy_version 1395570 (0.0008) [2023-12-28 05:17:23,071][106226] Updated weights for policy 0, policy_version 1395580 (0.0006) [2023-12-28 05:17:23,123][106226] Updated weights for policy 0, policy_version 1395590 (0.0005) [2023-12-28 05:17:23,169][106226] Updated weights for policy 0, policy_version 1395600 (0.0005) [2023-12-28 05:17:23,317][106225] Updated weights for policy 1, policy_version 1398849 (0.0006) [2023-12-28 05:17:23,378][106225] Updated weights for policy 1, policy_version 1398859 (0.0005) [2023-12-28 05:17:23,427][106225] Updated weights for policy 1, policy_version 1398869 (0.0006) [2023-12-28 05:17:23,794][106226] Updated weights for policy 0, policy_version 1395610 (0.0008) [2023-12-28 05:17:23,847][106226] Updated weights for policy 0, policy_version 1395620 (0.0009) [2023-12-28 05:17:23,901][106226] Updated weights for policy 0, policy_version 1395630 (0.0007) [2023-12-28 05:17:23,969][106225] Updated weights for policy 1, policy_version 1398879 (0.0009) [2023-12-28 05:17:24,033][106225] Updated weights for policy 1, policy_version 1398889 (0.0008) [2023-12-28 05:17:24,096][106225] Updated weights for policy 1, policy_version 1398899 (0.0008) [2023-12-28 05:17:24,578][106226] Updated weights for policy 0, policy_version 1395640 (0.0008) [2023-12-28 05:17:24,641][106226] Updated weights for policy 0, policy_version 1395650 (0.0007) [2023-12-28 05:17:24,694][106226] Updated weights for policy 0, policy_version 1395660 (0.0008) [2023-12-28 05:17:24,812][106225] Updated weights for policy 1, policy_version 1398909 (0.0010) [2023-12-28 05:17:24,881][106225] Updated weights for policy 1, policy_version 1398919 (0.0008) [2023-12-28 05:17:24,935][106225] Updated weights for policy 1, policy_version 1398929 (0.0009) [2023-12-28 05:17:25,309][106226] Updated weights for policy 0, policy_version 1395670 (0.0006) [2023-12-28 05:17:25,369][106226] Updated weights for policy 0, policy_version 1395680 (0.0005) [2023-12-28 05:17:25,426][106226] Updated weights for policy 0, policy_version 1395690 (0.0005) [2023-12-28 05:17:25,693][106225] Updated weights for policy 1, policy_version 1398939 (0.0008) [2023-12-28 05:17:25,750][106225] Updated weights for policy 1, policy_version 1398949 (0.0008) [2023-12-28 05:17:25,795][106225] Updated weights for policy 1, policy_version 1398959 (0.0008) [2023-12-28 05:17:26,063][106226] Updated weights for policy 0, policy_version 1395700 (0.0007) [2023-12-28 05:17:26,111][106226] Updated weights for policy 0, policy_version 1395710 (0.0006) [2023-12-28 05:17:26,158][106226] Updated weights for policy 0, policy_version 1395720 (0.0005) [2023-12-28 05:17:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 715554816. Throughput: 0: 9746.3, 1: 10072.8. Samples: 715525716. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:26,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-4.527')] [2023-12-28 05:17:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001398968_358187008.pth... [2023-12-28 05:17:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001397784_357883904.pth [2023-12-28 05:17:26,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001395728_357376000.pth... [2023-12-28 05:17:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001394576_357081088.pth [2023-12-28 05:17:26,615][106225] Updated weights for policy 1, policy_version 1398969 (0.0008) [2023-12-28 05:17:26,680][106225] Updated weights for policy 1, policy_version 1398979 (0.0008) [2023-12-28 05:17:26,715][106226] Updated weights for policy 0, policy_version 1395730 (0.0006) [2023-12-28 05:17:26,737][106225] Updated weights for policy 1, policy_version 1398989 (0.0007) [2023-12-28 05:17:26,771][106226] Updated weights for policy 0, policy_version 1395740 (0.0007) [2023-12-28 05:17:26,794][106225] Updated weights for policy 1, policy_version 1398999 (0.0006) [2023-12-28 05:17:26,827][106226] Updated weights for policy 0, policy_version 1395750 (0.0007) [2023-12-28 05:17:26,893][106226] Updated weights for policy 0, policy_version 1395760 (0.0009) [2023-12-28 05:17:27,459][106225] Updated weights for policy 1, policy_version 1399009 (0.0009) [2023-12-28 05:17:27,521][106225] Updated weights for policy 1, policy_version 1399019 (0.0008) [2023-12-28 05:17:27,579][106225] Updated weights for policy 1, policy_version 1399029 (0.0007) [2023-12-28 05:17:27,626][106226] Updated weights for policy 0, policy_version 1395770 (0.0007) [2023-12-28 05:17:27,687][106226] Updated weights for policy 0, policy_version 1395780 (0.0005) [2023-12-28 05:17:27,743][106226] Updated weights for policy 0, policy_version 1395790 (0.0006) [2023-12-28 05:17:28,215][106225] Updated weights for policy 1, policy_version 1399039 (0.0007) [2023-12-28 05:17:28,265][106225] Updated weights for policy 1, policy_version 1399049 (0.0008) [2023-12-28 05:17:28,325][106225] Updated weights for policy 1, policy_version 1399059 (0.0008) [2023-12-28 05:17:28,359][106226] Updated weights for policy 0, policy_version 1395800 (0.0007) [2023-12-28 05:17:28,416][106226] Updated weights for policy 0, policy_version 1395810 (0.0006) [2023-12-28 05:17:28,479][106226] Updated weights for policy 0, policy_version 1395820 (0.0008) [2023-12-28 05:17:29,063][106225] Updated weights for policy 1, policy_version 1399069 (0.0008) [2023-12-28 05:17:29,111][106225] Updated weights for policy 1, policy_version 1399079 (0.0008) [2023-12-28 05:17:29,156][106225] Updated weights for policy 1, policy_version 1399089 (0.0008) [2023-12-28 05:17:29,166][106226] Updated weights for policy 0, policy_version 1395830 (0.0007) [2023-12-28 05:17:29,217][106226] Updated weights for policy 0, policy_version 1395840 (0.0007) [2023-12-28 05:17:29,276][106226] Updated weights for policy 0, policy_version 1395850 (0.0007) [2023-12-28 05:17:29,934][106226] Updated weights for policy 0, policy_version 1395860 (0.0007) [2023-12-28 05:17:29,994][106226] Updated weights for policy 0, policy_version 1395870 (0.0009) [2023-12-28 05:17:30,046][106226] Updated weights for policy 0, policy_version 1395880 (0.0009) [2023-12-28 05:17:30,054][106225] Updated weights for policy 1, policy_version 1399099 (0.0007) [2023-12-28 05:17:30,113][106225] Updated weights for policy 1, policy_version 1399109 (0.0007) [2023-12-28 05:17:30,178][106225] Updated weights for policy 1, policy_version 1399119 (0.0008) [2023-12-28 05:17:30,661][106226] Updated weights for policy 0, policy_version 1395890 (0.0007) [2023-12-28 05:17:30,725][106226] Updated weights for policy 0, policy_version 1395900 (0.0005) [2023-12-28 05:17:30,786][106226] Updated weights for policy 0, policy_version 1395910 (0.0005) [2023-12-28 05:17:30,856][106226] Updated weights for policy 0, policy_version 1395920 (0.0006) [2023-12-28 05:17:30,932][106225] Updated weights for policy 1, policy_version 1399129 (0.0009) [2023-12-28 05:17:30,989][106225] Updated weights for policy 1, policy_version 1399139 (0.0008) [2023-12-28 05:17:31,053][106225] Updated weights for policy 1, policy_version 1399149 (0.0009) [2023-12-28 05:17:31,118][106225] Updated weights for policy 1, policy_version 1399159 (0.0009) [2023-12-28 05:17:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 715661312. Throughput: 0: 9914.6, 1: 10017.5. Samples: 715647200. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:31,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.823')] [2023-12-28 05:17:31,503][106226] Updated weights for policy 0, policy_version 1395930 (0.0009) [2023-12-28 05:17:31,552][106226] Updated weights for policy 0, policy_version 1395940 (0.0008) [2023-12-28 05:17:31,603][106226] Updated weights for policy 0, policy_version 1395950 (0.0009) [2023-12-28 05:17:31,836][106225] Updated weights for policy 1, policy_version 1399169 (0.0008) [2023-12-28 05:17:31,881][106225] Updated weights for policy 1, policy_version 1399179 (0.0008) [2023-12-28 05:17:31,940][106225] Updated weights for policy 1, policy_version 1399189 (0.0008) [2023-12-28 05:17:32,348][106226] Updated weights for policy 0, policy_version 1395960 (0.0008) [2023-12-28 05:17:32,415][106226] Updated weights for policy 0, policy_version 1395970 (0.0006) [2023-12-28 05:17:32,480][106226] Updated weights for policy 0, policy_version 1395980 (0.0008) [2023-12-28 05:17:32,703][106225] Updated weights for policy 1, policy_version 1399199 (0.0009) [2023-12-28 05:17:32,767][106225] Updated weights for policy 1, policy_version 1399209 (0.0009) [2023-12-28 05:17:32,830][106225] Updated weights for policy 1, policy_version 1399219 (0.0011) [2023-12-28 05:17:33,054][106226] Updated weights for policy 0, policy_version 1395990 (0.0010) [2023-12-28 05:17:33,111][106226] Updated weights for policy 0, policy_version 1396000 (0.0010) [2023-12-28 05:17:33,161][106226] Updated weights for policy 0, policy_version 1396010 (0.0010) [2023-12-28 05:17:33,610][106225] Updated weights for policy 1, policy_version 1399230 (0.0007) [2023-12-28 05:17:33,674][106225] Updated weights for policy 1, policy_version 1399240 (0.0005) [2023-12-28 05:17:33,743][106225] Updated weights for policy 1, policy_version 1399250 (0.0005) [2023-12-28 05:17:33,819][106226] Updated weights for policy 0, policy_version 1396020 (0.0011) [2023-12-28 05:17:33,872][106226] Updated weights for policy 0, policy_version 1396030 (0.0010) [2023-12-28 05:17:33,920][106226] Updated weights for policy 0, policy_version 1396040 (0.0008) [2023-12-28 05:17:34,328][106225] Updated weights for policy 1, policy_version 1399260 (0.0006) [2023-12-28 05:17:34,392][106225] Updated weights for policy 1, policy_version 1399270 (0.0010) [2023-12-28 05:17:34,452][106225] Updated weights for policy 1, policy_version 1399280 (0.0010) [2023-12-28 05:17:34,585][106226] Updated weights for policy 0, policy_version 1396050 (0.0006) [2023-12-28 05:17:34,654][106226] Updated weights for policy 0, policy_version 1396060 (0.0011) [2023-12-28 05:17:34,717][106226] Updated weights for policy 0, policy_version 1396070 (0.0010) [2023-12-28 05:17:34,772][106226] Updated weights for policy 0, policy_version 1396080 (0.0011) [2023-12-28 05:17:35,166][106225] Updated weights for policy 1, policy_version 1399290 (0.0010) [2023-12-28 05:17:35,214][106225] Updated weights for policy 1, policy_version 1399300 (0.0008) [2023-12-28 05:17:35,260][106225] Updated weights for policy 1, policy_version 1399310 (0.0008) [2023-12-28 05:17:35,305][106225] Updated weights for policy 1, policy_version 1399320 (0.0008) [2023-12-28 05:17:35,472][106226] Updated weights for policy 0, policy_version 1396090 (0.0009) [2023-12-28 05:17:35,535][106226] Updated weights for policy 0, policy_version 1396100 (0.0009) [2023-12-28 05:17:35,598][106226] Updated weights for policy 0, policy_version 1396110 (0.0008) [2023-12-28 05:17:36,061][106225] Updated weights for policy 1, policy_version 1399330 (0.0008) [2023-12-28 05:17:36,155][106225] Updated weights for policy 1, policy_version 1399340 (0.0008) [2023-12-28 05:17:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 715751424. Throughput: 0: 9954.8, 1: 9983.4. Samples: 715766004. Policy #0 lag: (min: 12.0, avg: 12.0, max: 18.0) [2023-12-28 05:17:36,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-4.925')] [2023-12-28 05:17:36,219][106225] Updated weights for policy 1, policy_version 1399350 (0.0006) [2023-12-28 05:17:36,338][106226] Updated weights for policy 0, policy_version 1396120 (0.0009) [2023-12-28 05:17:36,386][106226] Updated weights for policy 0, policy_version 1396130 (0.0008) [2023-12-28 05:17:36,435][106226] Updated weights for policy 0, policy_version 1396140 (0.0009) [2023-12-28 05:17:36,877][106225] Updated weights for policy 1, policy_version 1399360 (0.0007) [2023-12-28 05:17:36,946][106225] Updated weights for policy 1, policy_version 1399370 (0.0007) [2023-12-28 05:17:37,007][106225] Updated weights for policy 1, policy_version 1399380 (0.0008) [2023-12-28 05:17:37,204][106226] Updated weights for policy 0, policy_version 1396150 (0.0009) [2023-12-28 05:17:37,267][106226] Updated weights for policy 0, policy_version 1396160 (0.0009) [2023-12-28 05:17:37,331][106226] Updated weights for policy 0, policy_version 1396170 (0.0008) [2023-12-28 05:17:37,624][106225] Updated weights for policy 1, policy_version 1399390 (0.0008) [2023-12-28 05:17:37,685][106225] Updated weights for policy 1, policy_version 1399400 (0.0006) [2023-12-28 05:17:37,739][106225] Updated weights for policy 1, policy_version 1399410 (0.0005) [2023-12-28 05:17:38,155][106226] Updated weights for policy 0, policy_version 1396180 (0.0009) [2023-12-28 05:17:38,200][106226] Updated weights for policy 0, policy_version 1396190 (0.0008) [2023-12-28 05:17:38,254][106226] Updated weights for policy 0, policy_version 1396200 (0.0008) [2023-12-28 05:17:38,277][106225] Updated weights for policy 1, policy_version 1399420 (0.0006) [2023-12-28 05:17:38,340][106225] Updated weights for policy 1, policy_version 1399430 (0.0007) [2023-12-28 05:17:38,407][106225] Updated weights for policy 1, policy_version 1399440 (0.0008) [2023-12-28 05:17:39,021][106226] Updated weights for policy 0, policy_version 1396210 (0.0009) [2023-12-28 05:17:39,071][106226] Updated weights for policy 0, policy_version 1396220 (0.0005) [2023-12-28 05:17:39,106][106225] Updated weights for policy 1, policy_version 1399450 (0.0008) [2023-12-28 05:17:39,126][106226] Updated weights for policy 0, policy_version 1396230 (0.0005) [2023-12-28 05:17:39,162][106225] Updated weights for policy 1, policy_version 1399460 (0.0008) [2023-12-28 05:17:39,191][106226] Updated weights for policy 0, policy_version 1396240 (0.0007) [2023-12-28 05:17:39,224][106225] Updated weights for policy 1, policy_version 1399470 (0.0006) [2023-12-28 05:17:39,292][106225] Updated weights for policy 1, policy_version 1399480 (0.0008) [2023-12-28 05:17:39,962][106226] Updated weights for policy 0, policy_version 1396250 (0.0008) [2023-12-28 05:17:40,031][106226] Updated weights for policy 0, policy_version 1396260 (0.0007) [2023-12-28 05:17:40,069][106225] Updated weights for policy 1, policy_version 1399490 (0.0009) [2023-12-28 05:17:40,084][106226] Updated weights for policy 0, policy_version 1396270 (0.0007) [2023-12-28 05:17:40,132][106225] Updated weights for policy 1, policy_version 1399500 (0.0009) [2023-12-28 05:17:40,192][106225] Updated weights for policy 1, policy_version 1399510 (0.0008) [2023-12-28 05:17:40,805][106226] Updated weights for policy 0, policy_version 1396280 (0.0006) [2023-12-28 05:17:40,867][106226] Updated weights for policy 0, policy_version 1396290 (0.0005) [2023-12-28 05:17:40,906][106225] Updated weights for policy 1, policy_version 1399520 (0.0006) [2023-12-28 05:17:40,924][106226] Updated weights for policy 0, policy_version 1396300 (0.0005) [2023-12-28 05:17:40,962][106225] Updated weights for policy 1, policy_version 1399530 (0.0005) [2023-12-28 05:17:41,017][106225] Updated weights for policy 1, policy_version 1399540 (0.0005) [2023-12-28 05:17:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 715857920. Throughput: 0: 9856.8, 1: 10056.7. Samples: 715825080. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:17:41,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.834')] [2023-12-28 05:17:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001399544_358334464.pth... [2023-12-28 05:17:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001396304_357523456.pth... [2023-12-28 05:17:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001398360_358031360.pth [2023-12-28 05:17:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001395152_357228544.pth [2023-12-28 05:17:41,561][106226] Updated weights for policy 0, policy_version 1396310 (0.0007) [2023-12-28 05:17:41,624][106226] Updated weights for policy 0, policy_version 1396320 (0.0008) [2023-12-28 05:17:41,692][106226] Updated weights for policy 0, policy_version 1396330 (0.0008) [2023-12-28 05:17:41,738][106225] Updated weights for policy 1, policy_version 1399550 (0.0008) [2023-12-28 05:17:41,807][106225] Updated weights for policy 1, policy_version 1399560 (0.0006) [2023-12-28 05:17:41,875][106225] Updated weights for policy 1, policy_version 1399570 (0.0006) [2023-12-28 05:17:42,467][106226] Updated weights for policy 0, policy_version 1396340 (0.0008) [2023-12-28 05:17:42,522][106226] Updated weights for policy 0, policy_version 1396350 (0.0009) [2023-12-28 05:17:42,579][106226] Updated weights for policy 0, policy_version 1396360 (0.0009) [2023-12-28 05:17:42,593][106225] Updated weights for policy 1, policy_version 1399580 (0.0008) [2023-12-28 05:17:42,643][106225] Updated weights for policy 1, policy_version 1399590 (0.0009) [2023-12-28 05:17:42,697][106225] Updated weights for policy 1, policy_version 1399600 (0.0008) [2023-12-28 05:17:43,339][106225] Updated weights for policy 1, policy_version 1399610 (0.0009) [2023-12-28 05:17:43,355][106226] Updated weights for policy 0, policy_version 1396370 (0.0008) [2023-12-28 05:17:43,393][106225] Updated weights for policy 1, policy_version 1399620 (0.0007) [2023-12-28 05:17:43,424][106226] Updated weights for policy 0, policy_version 1396380 (0.0008) [2023-12-28 05:17:43,452][106225] Updated weights for policy 1, policy_version 1399630 (0.0007) [2023-12-28 05:17:43,492][106226] Updated weights for policy 0, policy_version 1396390 (0.0008) [2023-12-28 05:17:43,513][106225] Updated weights for policy 1, policy_version 1399640 (0.0005) [2023-12-28 05:17:43,565][106226] Updated weights for policy 0, policy_version 1396400 (0.0010) [2023-12-28 05:17:44,210][106226] Updated weights for policy 0, policy_version 1396410 (0.0007) [2023-12-28 05:17:44,212][106225] Updated weights for policy 1, policy_version 1399650 (0.0005) [2023-12-28 05:17:44,263][106226] Updated weights for policy 0, policy_version 1396420 (0.0006) [2023-12-28 05:17:44,274][106225] Updated weights for policy 1, policy_version 1399660 (0.0007) [2023-12-28 05:17:44,322][106226] Updated weights for policy 0, policy_version 1396430 (0.0007) [2023-12-28 05:17:44,330][106225] Updated weights for policy 1, policy_version 1399670 (0.0006) [2023-12-28 05:17:44,974][106225] Updated weights for policy 1, policy_version 1399680 (0.0008) [2023-12-28 05:17:45,040][106225] Updated weights for policy 1, policy_version 1399690 (0.0009) [2023-12-28 05:17:45,101][106225] Updated weights for policy 1, policy_version 1399700 (0.0010) [2023-12-28 05:17:45,105][106226] Updated weights for policy 0, policy_version 1396440 (0.0008) [2023-12-28 05:17:45,170][106226] Updated weights for policy 0, policy_version 1396450 (0.0009) [2023-12-28 05:17:45,240][106226] Updated weights for policy 0, policy_version 1396460 (0.0009) [2023-12-28 05:17:45,760][106225] Updated weights for policy 1, policy_version 1399710 (0.0006) [2023-12-28 05:17:45,820][106225] Updated weights for policy 1, policy_version 1399720 (0.0007) [2023-12-28 05:17:45,873][106225] Updated weights for policy 1, policy_version 1399730 (0.0009) [2023-12-28 05:17:45,983][106226] Updated weights for policy 0, policy_version 1396470 (0.0008) [2023-12-28 05:17:46,039][106226] Updated weights for policy 0, policy_version 1396480 (0.0009) [2023-12-28 05:17:46,099][106226] Updated weights for policy 0, policy_version 1396490 (0.0010) [2023-12-28 05:17:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 715956224. Throughput: 0: 9819.6, 1: 10025.0. Samples: 715941536. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:17:46,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.909')] [2023-12-28 05:17:46,556][106225] Updated weights for policy 1, policy_version 1399740 (0.0008) [2023-12-28 05:17:46,615][106225] Updated weights for policy 1, policy_version 1399750 (0.0008) [2023-12-28 05:17:46,677][106225] Updated weights for policy 1, policy_version 1399760 (0.0009) [2023-12-28 05:17:46,790][106226] Updated weights for policy 0, policy_version 1396500 (0.0008) [2023-12-28 05:17:46,849][106226] Updated weights for policy 0, policy_version 1396510 (0.0005) [2023-12-28 05:17:46,909][106226] Updated weights for policy 0, policy_version 1396520 (0.0005) [2023-12-28 05:17:47,410][106226] Updated weights for policy 0, policy_version 1396530 (0.0005) [2023-12-28 05:17:47,475][106226] Updated weights for policy 0, policy_version 1396540 (0.0005) [2023-12-28 05:17:47,496][106225] Updated weights for policy 1, policy_version 1399770 (0.0009) [2023-12-28 05:17:47,531][106226] Updated weights for policy 0, policy_version 1396550 (0.0005) [2023-12-28 05:17:47,557][106225] Updated weights for policy 1, policy_version 1399780 (0.0007) [2023-12-28 05:17:47,590][106226] Updated weights for policy 0, policy_version 1396560 (0.0005) [2023-12-28 05:17:47,617][106225] Updated weights for policy 1, policy_version 1399790 (0.0008) [2023-12-28 05:17:47,674][106225] Updated weights for policy 1, policy_version 1399800 (0.0008) [2023-12-28 05:17:48,153][106226] Updated weights for policy 0, policy_version 1396570 (0.0009) [2023-12-28 05:17:48,213][106226] Updated weights for policy 0, policy_version 1396580 (0.0009) [2023-12-28 05:17:48,270][106226] Updated weights for policy 0, policy_version 1396590 (0.0009) [2023-12-28 05:17:48,427][106225] Updated weights for policy 1, policy_version 1399810 (0.0006) [2023-12-28 05:17:48,478][106225] Updated weights for policy 1, policy_version 1399820 (0.0008) [2023-12-28 05:17:48,533][106225] Updated weights for policy 1, policy_version 1399830 (0.0008) [2023-12-28 05:17:48,987][106226] Updated weights for policy 0, policy_version 1396600 (0.0008) [2023-12-28 05:17:49,033][106226] Updated weights for policy 0, policy_version 1396610 (0.0008) [2023-12-28 05:17:49,084][106226] Updated weights for policy 0, policy_version 1396620 (0.0009) [2023-12-28 05:17:49,261][106225] Updated weights for policy 1, policy_version 1399840 (0.0009) [2023-12-28 05:17:49,333][106225] Updated weights for policy 1, policy_version 1399850 (0.0009) [2023-12-28 05:17:49,397][106225] Updated weights for policy 1, policy_version 1399860 (0.0009) [2023-12-28 05:17:49,871][106226] Updated weights for policy 0, policy_version 1396630 (0.0008) [2023-12-28 05:17:49,938][106226] Updated weights for policy 0, policy_version 1396640 (0.0008) [2023-12-28 05:17:49,990][106226] Updated weights for policy 0, policy_version 1396650 (0.0008) [2023-12-28 05:17:50,112][106225] Updated weights for policy 1, policy_version 1399870 (0.0008) [2023-12-28 05:17:50,167][106225] Updated weights for policy 1, policy_version 1399880 (0.0009) [2023-12-28 05:17:50,232][106225] Updated weights for policy 1, policy_version 1399890 (0.0009) [2023-12-28 05:17:50,729][106226] Updated weights for policy 0, policy_version 1396660 (0.0007) [2023-12-28 05:17:50,786][106226] Updated weights for policy 0, policy_version 1396670 (0.0008) [2023-12-28 05:17:50,839][106226] Updated weights for policy 0, policy_version 1396680 (0.0008) [2023-12-28 05:17:50,994][106225] Updated weights for policy 1, policy_version 1399900 (0.0008) [2023-12-28 05:17:51,058][106225] Updated weights for policy 1, policy_version 1399910 (0.0009) [2023-12-28 05:17:51,114][106225] Updated weights for policy 1, policy_version 1399920 (0.0006) [2023-12-28 05:17:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 716054528. Throughput: 0: 9875.6, 1: 9980.3. Samples: 716058496. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:17:51,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.919')] [2023-12-28 05:17:51,665][106226] Updated weights for policy 0, policy_version 1396690 (0.0009) [2023-12-28 05:17:51,727][106226] Updated weights for policy 0, policy_version 1396700 (0.0009) [2023-12-28 05:17:51,781][106225] Updated weights for policy 1, policy_version 1399930 (0.0006) [2023-12-28 05:17:51,791][106226] Updated weights for policy 0, policy_version 1396710 (0.0009) [2023-12-28 05:17:51,840][106226] Updated weights for policy 0, policy_version 1396720 (0.0007) [2023-12-28 05:17:51,842][106225] Updated weights for policy 1, policy_version 1399940 (0.0006) [2023-12-28 05:17:51,903][106225] Updated weights for policy 1, policy_version 1399950 (0.0009) [2023-12-28 05:17:51,966][106225] Updated weights for policy 1, policy_version 1399960 (0.0008) [2023-12-28 05:17:52,638][106226] Updated weights for policy 0, policy_version 1396730 (0.0007) [2023-12-28 05:17:52,676][106225] Updated weights for policy 1, policy_version 1399970 (0.0006) [2023-12-28 05:17:52,702][106226] Updated weights for policy 0, policy_version 1396740 (0.0007) [2023-12-28 05:17:52,730][106225] Updated weights for policy 1, policy_version 1399980 (0.0007) [2023-12-28 05:17:52,763][106226] Updated weights for policy 0, policy_version 1396750 (0.0006) [2023-12-28 05:17:52,781][106225] Updated weights for policy 1, policy_version 1399990 (0.0007) [2023-12-28 05:17:53,471][106226] Updated weights for policy 0, policy_version 1396760 (0.0006) [2023-12-28 05:17:53,473][106225] Updated weights for policy 1, policy_version 1400000 (0.0007) [2023-12-28 05:17:53,522][106226] Updated weights for policy 0, policy_version 1396770 (0.0006) [2023-12-28 05:17:53,525][106225] Updated weights for policy 1, policy_version 1400010 (0.0007) [2023-12-28 05:17:53,578][106226] Updated weights for policy 0, policy_version 1396780 (0.0006) [2023-12-28 05:17:53,583][106225] Updated weights for policy 1, policy_version 1400020 (0.0007) [2023-12-28 05:17:54,251][106226] Updated weights for policy 0, policy_version 1396790 (0.0007) [2023-12-28 05:17:54,311][106226] Updated weights for policy 0, policy_version 1396800 (0.0010) [2023-12-28 05:17:54,335][106225] Updated weights for policy 1, policy_version 1400030 (0.0007) [2023-12-28 05:17:54,367][106226] Updated weights for policy 0, policy_version 1396810 (0.0010) [2023-12-28 05:17:54,389][106225] Updated weights for policy 1, policy_version 1400040 (0.0007) [2023-12-28 05:17:54,452][106225] Updated weights for policy 1, policy_version 1400050 (0.0007) [2023-12-28 05:17:55,086][106226] Updated weights for policy 0, policy_version 1396820 (0.0011) [2023-12-28 05:17:55,143][106226] Updated weights for policy 0, policy_version 1396830 (0.0010) [2023-12-28 05:17:55,201][106226] Updated weights for policy 0, policy_version 1396840 (0.0007) [2023-12-28 05:17:55,202][106225] Updated weights for policy 1, policy_version 1400060 (0.0007) [2023-12-28 05:17:55,256][106225] Updated weights for policy 1, policy_version 1400070 (0.0009) [2023-12-28 05:17:55,311][106225] Updated weights for policy 1, policy_version 1400080 (0.0009) [2023-12-28 05:17:55,752][106226] Updated weights for policy 0, policy_version 1396850 (0.0006) [2023-12-28 05:17:55,806][106226] Updated weights for policy 0, policy_version 1396860 (0.0007) [2023-12-28 05:17:55,853][106226] Updated weights for policy 0, policy_version 1396870 (0.0010) [2023-12-28 05:17:55,902][106226] Updated weights for policy 0, policy_version 1396880 (0.0009) [2023-12-28 05:17:56,112][106225] Updated weights for policy 1, policy_version 1400090 (0.0009) [2023-12-28 05:17:56,169][106225] Updated weights for policy 1, policy_version 1400100 (0.0009) [2023-12-28 05:17:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 716144640. Throughput: 0: 9823.9, 1: 9941.1. Samples: 716115884. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:17:56,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.658')] [2023-12-28 05:17:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001396880_357670912.pth... [2023-12-28 05:17:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001395728_357376000.pth [2023-12-28 05:17:56,214][106225] Updated weights for policy 1, policy_version 1400110 (0.0008) [2023-12-28 05:17:56,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001400120_358481920.pth... [2023-12-28 05:17:56,267][106225] Updated weights for policy 1, policy_version 1400120 (0.0008) [2023-12-28 05:17:56,270][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001398968_358187008.pth [2023-12-28 05:17:56,496][106226] Updated weights for policy 0, policy_version 1396890 (0.0008) [2023-12-28 05:17:56,546][106226] Updated weights for policy 0, policy_version 1396900 (0.0008) [2023-12-28 05:17:56,601][106226] Updated weights for policy 0, policy_version 1396910 (0.0009) [2023-12-28 05:17:57,041][106225] Updated weights for policy 1, policy_version 1400130 (0.0008) [2023-12-28 05:17:57,095][106225] Updated weights for policy 1, policy_version 1400140 (0.0009) [2023-12-28 05:17:57,155][106225] Updated weights for policy 1, policy_version 1400150 (0.0009) [2023-12-28 05:17:57,281][106226] Updated weights for policy 0, policy_version 1396920 (0.0008) [2023-12-28 05:17:57,346][106226] Updated weights for policy 0, policy_version 1396930 (0.0009) [2023-12-28 05:17:57,398][106226] Updated weights for policy 0, policy_version 1396940 (0.0005) [2023-12-28 05:17:57,940][106225] Updated weights for policy 1, policy_version 1400160 (0.0007) [2023-12-28 05:17:57,987][106225] Updated weights for policy 1, policy_version 1400170 (0.0006) [2023-12-28 05:17:58,038][106225] Updated weights for policy 1, policy_version 1400180 (0.0005) [2023-12-28 05:17:58,060][106226] Updated weights for policy 0, policy_version 1396950 (0.0007) [2023-12-28 05:17:58,109][106226] Updated weights for policy 0, policy_version 1396960 (0.0008) [2023-12-28 05:17:58,154][106226] Updated weights for policy 0, policy_version 1396970 (0.0008) [2023-12-28 05:17:58,731][106225] Updated weights for policy 1, policy_version 1400190 (0.0007) [2023-12-28 05:17:58,797][106225] Updated weights for policy 1, policy_version 1400200 (0.0008) [2023-12-28 05:17:58,866][106225] Updated weights for policy 1, policy_version 1400210 (0.0012) [2023-12-28 05:17:59,036][106226] Updated weights for policy 0, policy_version 1396980 (0.0007) [2023-12-28 05:17:59,098][106226] Updated weights for policy 0, policy_version 1396990 (0.0007) [2023-12-28 05:17:59,162][106226] Updated weights for policy 0, policy_version 1397000 (0.0008) [2023-12-28 05:17:59,700][106225] Updated weights for policy 1, policy_version 1400220 (0.0008) [2023-12-28 05:17:59,754][106225] Updated weights for policy 1, policy_version 1400230 (0.0008) [2023-12-28 05:17:59,815][106225] Updated weights for policy 1, policy_version 1400240 (0.0009) [2023-12-28 05:17:59,847][106226] Updated weights for policy 0, policy_version 1397010 (0.0008) [2023-12-28 05:17:59,908][106226] Updated weights for policy 0, policy_version 1397020 (0.0006) [2023-12-28 05:17:59,977][106226] Updated weights for policy 0, policy_version 1397030 (0.0007) [2023-12-28 05:18:00,040][106226] Updated weights for policy 0, policy_version 1397040 (0.0007) [2023-12-28 05:18:00,520][106225] Updated weights for policy 1, policy_version 1400250 (0.0008) [2023-12-28 05:18:00,579][106225] Updated weights for policy 1, policy_version 1400260 (0.0009) [2023-12-28 05:18:00,604][106226] Updated weights for policy 0, policy_version 1397050 (0.0006) [2023-12-28 05:18:00,636][106225] Updated weights for policy 1, policy_version 1400270 (0.0008) [2023-12-28 05:18:00,658][106226] Updated weights for policy 0, policy_version 1397060 (0.0005) [2023-12-28 05:18:00,692][106225] Updated weights for policy 1, policy_version 1400280 (0.0008) [2023-12-28 05:18:00,711][106226] Updated weights for policy 0, policy_version 1397070 (0.0005) [2023-12-28 05:18:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 716242944. Throughput: 0: 9910.8, 1: 9804.0. Samples: 716232016. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:01,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.896')] [2023-12-28 05:18:01,386][106226] Updated weights for policy 0, policy_version 1397080 (0.0008) [2023-12-28 05:18:01,392][106225] Updated weights for policy 1, policy_version 1400290 (0.0008) [2023-12-28 05:18:01,445][106226] Updated weights for policy 0, policy_version 1397090 (0.0011) [2023-12-28 05:18:01,452][106225] Updated weights for policy 1, policy_version 1400300 (0.0008) [2023-12-28 05:18:01,505][106226] Updated weights for policy 0, policy_version 1397100 (0.0010) [2023-12-28 05:18:01,510][106225] Updated weights for policy 1, policy_version 1400310 (0.0008) [2023-12-28 05:18:02,201][106226] Updated weights for policy 0, policy_version 1397110 (0.0008) [2023-12-28 05:18:02,265][106226] Updated weights for policy 0, policy_version 1397120 (0.0006) [2023-12-28 05:18:02,297][106225] Updated weights for policy 1, policy_version 1400320 (0.0006) [2023-12-28 05:18:02,330][106226] Updated weights for policy 0, policy_version 1397130 (0.0010) [2023-12-28 05:18:02,357][106225] Updated weights for policy 1, policy_version 1400330 (0.0007) [2023-12-28 05:18:02,416][106225] Updated weights for policy 1, policy_version 1400340 (0.0008) [2023-12-28 05:18:03,000][106226] Updated weights for policy 0, policy_version 1397140 (0.0009) [2023-12-28 05:18:03,054][106226] Updated weights for policy 0, policy_version 1397150 (0.0010) [2023-12-28 05:18:03,067][106225] Updated weights for policy 1, policy_version 1400350 (0.0007) [2023-12-28 05:18:03,106][106226] Updated weights for policy 0, policy_version 1397160 (0.0010) [2023-12-28 05:18:03,113][106225] Updated weights for policy 1, policy_version 1400360 (0.0008) [2023-12-28 05:18:03,167][106225] Updated weights for policy 1, policy_version 1400370 (0.0008) [2023-12-28 05:18:03,702][106226] Updated weights for policy 0, policy_version 1397170 (0.0010) [2023-12-28 05:18:03,753][106226] Updated weights for policy 0, policy_version 1397180 (0.0010) [2023-12-28 05:18:03,816][106226] Updated weights for policy 0, policy_version 1397190 (0.0010) [2023-12-28 05:18:03,882][106226] Updated weights for policy 0, policy_version 1397200 (0.0010) [2023-12-28 05:18:03,971][106225] Updated weights for policy 1, policy_version 1400380 (0.0006) [2023-12-28 05:18:04,038][106225] Updated weights for policy 1, policy_version 1400390 (0.0007) [2023-12-28 05:18:04,107][106225] Updated weights for policy 1, policy_version 1400400 (0.0006) [2023-12-28 05:18:04,660][106226] Updated weights for policy 0, policy_version 1397210 (0.0011) [2023-12-28 05:18:04,679][106225] Updated weights for policy 1, policy_version 1400410 (0.0007) [2023-12-28 05:18:04,718][106226] Updated weights for policy 0, policy_version 1397220 (0.0006) [2023-12-28 05:18:04,733][106225] Updated weights for policy 1, policy_version 1400420 (0.0005) [2023-12-28 05:18:04,780][106226] Updated weights for policy 0, policy_version 1397230 (0.0006) [2023-12-28 05:18:04,799][106225] Updated weights for policy 1, policy_version 1400430 (0.0006) [2023-12-28 05:18:04,864][106225] Updated weights for policy 1, policy_version 1400440 (0.0005) [2023-12-28 05:18:05,413][106226] Updated weights for policy 0, policy_version 1397240 (0.0008) [2023-12-28 05:18:05,442][106225] Updated weights for policy 1, policy_version 1400450 (0.0008) [2023-12-28 05:18:05,471][106226] Updated weights for policy 0, policy_version 1397250 (0.0006) [2023-12-28 05:18:05,508][106225] Updated weights for policy 1, policy_version 1400460 (0.0009) [2023-12-28 05:18:05,524][106226] Updated weights for policy 0, policy_version 1397260 (0.0005) [2023-12-28 05:18:05,573][106225] Updated weights for policy 1, policy_version 1400470 (0.0009) [2023-12-28 05:18:06,097][106226] Updated weights for policy 0, policy_version 1397270 (0.0009) [2023-12-28 05:18:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 716341248. Throughput: 0: 10060.1, 1: 9713.0. Samples: 716356344. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:06,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.738')] [2023-12-28 05:18:06,179][106226] Updated weights for policy 0, policy_version 1397280 (0.0011) [2023-12-28 05:18:06,249][106226] Updated weights for policy 0, policy_version 1397290 (0.0011) [2023-12-28 05:18:06,343][106225] Updated weights for policy 1, policy_version 1400480 (0.0007) [2023-12-28 05:18:06,417][106225] Updated weights for policy 1, policy_version 1400490 (0.0009) [2023-12-28 05:18:06,491][106225] Updated weights for policy 1, policy_version 1400500 (0.0009) [2023-12-28 05:18:06,854][106226] Updated weights for policy 0, policy_version 1397300 (0.0009) [2023-12-28 05:18:06,925][106226] Updated weights for policy 0, policy_version 1397310 (0.0011) [2023-12-28 05:18:06,986][106226] Updated weights for policy 0, policy_version 1397320 (0.0010) [2023-12-28 05:18:07,204][106225] Updated weights for policy 1, policy_version 1400510 (0.0008) [2023-12-28 05:18:07,266][106225] Updated weights for policy 1, policy_version 1400520 (0.0008) [2023-12-28 05:18:07,326][106225] Updated weights for policy 1, policy_version 1400530 (0.0006) [2023-12-28 05:18:07,681][106226] Updated weights for policy 0, policy_version 1397330 (0.0008) [2023-12-28 05:18:07,743][106226] Updated weights for policy 0, policy_version 1397340 (0.0011) [2023-12-28 05:18:07,808][106226] Updated weights for policy 0, policy_version 1397350 (0.0011) [2023-12-28 05:18:07,869][106226] Updated weights for policy 0, policy_version 1397360 (0.0010) [2023-12-28 05:18:07,994][106225] Updated weights for policy 1, policy_version 1400540 (0.0008) [2023-12-28 05:18:08,054][106225] Updated weights for policy 1, policy_version 1400550 (0.0009) [2023-12-28 05:18:08,116][106225] Updated weights for policy 1, policy_version 1400560 (0.0008) [2023-12-28 05:18:08,480][106226] Updated weights for policy 0, policy_version 1397370 (0.0008) [2023-12-28 05:18:08,539][106226] Updated weights for policy 0, policy_version 1397380 (0.0008) [2023-12-28 05:18:08,600][106226] Updated weights for policy 0, policy_version 1397390 (0.0011) [2023-12-28 05:18:08,916][106225] Updated weights for policy 1, policy_version 1400570 (0.0010) [2023-12-28 05:18:08,980][106225] Updated weights for policy 1, policy_version 1400580 (0.0007) [2023-12-28 05:18:09,027][106225] Updated weights for policy 1, policy_version 1400590 (0.0007) [2023-12-28 05:18:09,074][106225] Updated weights for policy 1, policy_version 1400600 (0.0007) [2023-12-28 05:18:09,279][106226] Updated weights for policy 0, policy_version 1397400 (0.0011) [2023-12-28 05:18:09,335][106226] Updated weights for policy 0, policy_version 1397410 (0.0011) [2023-12-28 05:18:09,405][106226] Updated weights for policy 0, policy_version 1397420 (0.0009) [2023-12-28 05:18:09,810][106225] Updated weights for policy 1, policy_version 1400610 (0.0008) [2023-12-28 05:18:09,876][106225] Updated weights for policy 1, policy_version 1400620 (0.0007) [2023-12-28 05:18:09,938][106225] Updated weights for policy 1, policy_version 1400630 (0.0008) [2023-12-28 05:18:10,205][106226] Updated weights for policy 0, policy_version 1397430 (0.0009) [2023-12-28 05:18:10,270][106226] Updated weights for policy 0, policy_version 1397440 (0.0009) [2023-12-28 05:18:10,330][106226] Updated weights for policy 0, policy_version 1397450 (0.0009) [2023-12-28 05:18:10,675][106225] Updated weights for policy 1, policy_version 1400640 (0.0007) [2023-12-28 05:18:10,739][106225] Updated weights for policy 1, policy_version 1400650 (0.0008) [2023-12-28 05:18:10,797][106225] Updated weights for policy 1, policy_version 1400660 (0.0008) [2023-12-28 05:18:11,065][106226] Updated weights for policy 0, policy_version 1397460 (0.0010) [2023-12-28 05:18:11,117][106226] Updated weights for policy 0, policy_version 1397470 (0.0009) [2023-12-28 05:18:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 716439552. Throughput: 0: 10091.2, 1: 9678.1. Samples: 716415332. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:11,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.493')] [2023-12-28 05:18:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001400664_358621184.pth... [2023-12-28 05:18:11,184][106226] Updated weights for policy 0, policy_version 1397480 (0.0009) [2023-12-28 05:18:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001399544_358334464.pth [2023-12-28 05:18:11,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001397488_357826560.pth... [2023-12-28 05:18:11,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001396304_357523456.pth [2023-12-28 05:18:11,516][106225] Updated weights for policy 1, policy_version 1400670 (0.0007) [2023-12-28 05:18:11,567][106225] Updated weights for policy 1, policy_version 1400680 (0.0010) [2023-12-28 05:18:11,631][106225] Updated weights for policy 1, policy_version 1400690 (0.0010) [2023-12-28 05:18:12,042][106226] Updated weights for policy 0, policy_version 1397490 (0.0009) [2023-12-28 05:18:12,107][106226] Updated weights for policy 0, policy_version 1397500 (0.0010) [2023-12-28 05:18:12,168][106226] Updated weights for policy 0, policy_version 1397510 (0.0009) [2023-12-28 05:18:12,227][106226] Updated weights for policy 0, policy_version 1397520 (0.0008) [2023-12-28 05:18:12,325][106225] Updated weights for policy 1, policy_version 1400700 (0.0009) [2023-12-28 05:18:12,394][106225] Updated weights for policy 1, policy_version 1400710 (0.0010) [2023-12-28 05:18:12,455][106225] Updated weights for policy 1, policy_version 1400720 (0.0011) [2023-12-28 05:18:13,009][106226] Updated weights for policy 0, policy_version 1397530 (0.0008) [2023-12-28 05:18:13,059][106226] Updated weights for policy 0, policy_version 1397540 (0.0007) [2023-12-28 05:18:13,109][106226] Updated weights for policy 0, policy_version 1397550 (0.0008) [2023-12-28 05:18:13,177][106225] Updated weights for policy 1, policy_version 1400730 (0.0010) [2023-12-28 05:18:13,232][106225] Updated weights for policy 1, policy_version 1400740 (0.0010) [2023-12-28 05:18:13,289][106225] Updated weights for policy 1, policy_version 1400750 (0.0010) [2023-12-28 05:18:13,345][106225] Updated weights for policy 1, policy_version 1400760 (0.0010) [2023-12-28 05:18:13,821][106226] Updated weights for policy 0, policy_version 1397560 (0.0009) [2023-12-28 05:18:13,870][106226] Updated weights for policy 0, policy_version 1397570 (0.0007) [2023-12-28 05:18:13,923][106226] Updated weights for policy 0, policy_version 1397580 (0.0007) [2023-12-28 05:18:14,055][106225] Updated weights for policy 1, policy_version 1400770 (0.0010) [2023-12-28 05:18:14,102][106225] Updated weights for policy 1, policy_version 1400780 (0.0010) [2023-12-28 05:18:14,157][106225] Updated weights for policy 1, policy_version 1400790 (0.0010) [2023-12-28 05:18:14,547][106226] Updated weights for policy 0, policy_version 1397590 (0.0007) [2023-12-28 05:18:14,601][106226] Updated weights for policy 0, policy_version 1397600 (0.0008) [2023-12-28 05:18:14,655][106226] Updated weights for policy 0, policy_version 1397610 (0.0007) [2023-12-28 05:18:14,861][106225] Updated weights for policy 1, policy_version 1400800 (0.0007) [2023-12-28 05:18:14,921][106225] Updated weights for policy 1, policy_version 1400810 (0.0007) [2023-12-28 05:18:14,987][106225] Updated weights for policy 1, policy_version 1400820 (0.0007) [2023-12-28 05:18:15,344][106226] Updated weights for policy 0, policy_version 1397620 (0.0007) [2023-12-28 05:18:15,406][106226] Updated weights for policy 0, policy_version 1397630 (0.0007) [2023-12-28 05:18:15,478][106226] Updated weights for policy 0, policy_version 1397640 (0.0005) [2023-12-28 05:18:15,739][106225] Updated weights for policy 1, policy_version 1400830 (0.0008) [2023-12-28 05:18:15,811][106225] Updated weights for policy 1, policy_version 1400840 (0.0009) [2023-12-28 05:18:15,859][106225] Updated weights for policy 1, policy_version 1400850 (0.0006) [2023-12-28 05:18:16,072][106226] Updated weights for policy 0, policy_version 1397650 (0.0006) [2023-12-28 05:18:16,129][106226] Updated weights for policy 0, policy_version 1397660 (0.0006) [2023-12-28 05:18:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 716537856. Throughput: 0: 9934.9, 1: 9683.3. Samples: 716530024. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:16,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.885')] [2023-12-28 05:18:16,186][106226] Updated weights for policy 0, policy_version 1397670 (0.0011) [2023-12-28 05:18:16,237][106226] Updated weights for policy 0, policy_version 1397680 (0.0011) [2023-12-28 05:18:16,502][106225] Updated weights for policy 1, policy_version 1400860 (0.0006) [2023-12-28 05:18:16,556][106225] Updated weights for policy 1, policy_version 1400870 (0.0008) [2023-12-28 05:18:16,610][106225] Updated weights for policy 1, policy_version 1400880 (0.0008) [2023-12-28 05:18:16,974][106226] Updated weights for policy 0, policy_version 1397690 (0.0008) [2023-12-28 05:18:17,030][106226] Updated weights for policy 0, policy_version 1397700 (0.0008) [2023-12-28 05:18:17,084][106226] Updated weights for policy 0, policy_version 1397710 (0.0008) [2023-12-28 05:18:17,322][106225] Updated weights for policy 1, policy_version 1400890 (0.0007) [2023-12-28 05:18:17,379][106225] Updated weights for policy 1, policy_version 1400900 (0.0005) [2023-12-28 05:18:17,437][106225] Updated weights for policy 1, policy_version 1400910 (0.0008) [2023-12-28 05:18:17,497][106225] Updated weights for policy 1, policy_version 1400920 (0.0008) [2023-12-28 05:18:17,776][106226] Updated weights for policy 0, policy_version 1397720 (0.0006) [2023-12-28 05:18:17,824][106226] Updated weights for policy 0, policy_version 1397730 (0.0005) [2023-12-28 05:18:17,871][106226] Updated weights for policy 0, policy_version 1397740 (0.0005) [2023-12-28 05:18:18,258][106225] Updated weights for policy 1, policy_version 1400930 (0.0008) [2023-12-28 05:18:18,322][106225] Updated weights for policy 1, policy_version 1400940 (0.0008) [2023-12-28 05:18:18,387][106225] Updated weights for policy 1, policy_version 1400950 (0.0007) [2023-12-28 05:18:18,522][106226] Updated weights for policy 0, policy_version 1397750 (0.0008) [2023-12-28 05:18:18,584][106226] Updated weights for policy 0, policy_version 1397760 (0.0011) [2023-12-28 05:18:18,648][106226] Updated weights for policy 0, policy_version 1397770 (0.0011) [2023-12-28 05:18:18,965][106225] Updated weights for policy 1, policy_version 1400960 (0.0008) [2023-12-28 05:18:19,022][106225] Updated weights for policy 1, policy_version 1400970 (0.0007) [2023-12-28 05:18:19,085][106225] Updated weights for policy 1, policy_version 1400980 (0.0008) [2023-12-28 05:18:19,378][106226] Updated weights for policy 0, policy_version 1397780 (0.0010) [2023-12-28 05:18:19,445][106226] Updated weights for policy 0, policy_version 1397790 (0.0007) [2023-12-28 05:18:19,516][106226] Updated weights for policy 0, policy_version 1397800 (0.0008) [2023-12-28 05:18:19,813][106225] Updated weights for policy 1, policy_version 1400990 (0.0009) [2023-12-28 05:18:19,878][106225] Updated weights for policy 1, policy_version 1401000 (0.0009) [2023-12-28 05:18:19,946][106225] Updated weights for policy 1, policy_version 1401010 (0.0009) [2023-12-28 05:18:20,161][106226] Updated weights for policy 0, policy_version 1397810 (0.0007) [2023-12-28 05:18:20,229][106226] Updated weights for policy 0, policy_version 1397820 (0.0008) [2023-12-28 05:18:20,292][106226] Updated weights for policy 0, policy_version 1397830 (0.0008) [2023-12-28 05:18:20,356][106226] Updated weights for policy 0, policy_version 1397840 (0.0009) [2023-12-28 05:18:20,716][106225] Updated weights for policy 1, policy_version 1401020 (0.0008) [2023-12-28 05:18:20,778][106225] Updated weights for policy 1, policy_version 1401030 (0.0010) [2023-12-28 05:18:20,828][106225] Updated weights for policy 1, policy_version 1401040 (0.0008) [2023-12-28 05:18:21,052][106226] Updated weights for policy 0, policy_version 1397850 (0.0009) [2023-12-28 05:18:21,108][106226] Updated weights for policy 0, policy_version 1397860 (0.0009) [2023-12-28 05:18:21,171][106226] Updated weights for policy 0, policy_version 1397870 (0.0008) [2023-12-28 05:18:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 716636160. Throughput: 0: 9914.0, 1: 9704.5. Samples: 716648832. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:21,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.665')] [2023-12-28 05:18:21,640][106225] Updated weights for policy 1, policy_version 1401050 (0.0010) [2023-12-28 05:18:21,702][106225] Updated weights for policy 1, policy_version 1401060 (0.0009) [2023-12-28 05:18:21,771][106225] Updated weights for policy 1, policy_version 1401070 (0.0009) [2023-12-28 05:18:21,836][106225] Updated weights for policy 1, policy_version 1401080 (0.0009) [2023-12-28 05:18:21,876][106226] Updated weights for policy 0, policy_version 1397880 (0.0006) [2023-12-28 05:18:21,931][106226] Updated weights for policy 0, policy_version 1397890 (0.0007) [2023-12-28 05:18:21,988][106226] Updated weights for policy 0, policy_version 1397900 (0.0008) [2023-12-28 05:18:22,626][106225] Updated weights for policy 1, policy_version 1401090 (0.0009) [2023-12-28 05:18:22,684][106225] Updated weights for policy 1, policy_version 1401100 (0.0007) [2023-12-28 05:18:22,736][106226] Updated weights for policy 0, policy_version 1397910 (0.0008) [2023-12-28 05:18:22,738][106225] Updated weights for policy 1, policy_version 1401110 (0.0007) [2023-12-28 05:18:22,794][106226] Updated weights for policy 0, policy_version 1397920 (0.0008) [2023-12-28 05:18:22,851][106226] Updated weights for policy 0, policy_version 1397930 (0.0008) [2023-12-28 05:18:23,418][106225] Updated weights for policy 1, policy_version 1401120 (0.0008) [2023-12-28 05:18:23,470][106225] Updated weights for policy 1, policy_version 1401130 (0.0007) [2023-12-28 05:18:23,519][106225] Updated weights for policy 1, policy_version 1401140 (0.0007) [2023-12-28 05:18:23,630][106226] Updated weights for policy 0, policy_version 1397940 (0.0010) [2023-12-28 05:18:23,691][106226] Updated weights for policy 0, policy_version 1397950 (0.0010) [2023-12-28 05:18:23,756][106226] Updated weights for policy 0, policy_version 1397960 (0.0008) [2023-12-28 05:18:24,218][106225] Updated weights for policy 1, policy_version 1401150 (0.0006) [2023-12-28 05:18:24,279][106225] Updated weights for policy 1, policy_version 1401160 (0.0005) [2023-12-28 05:18:24,336][106225] Updated weights for policy 1, policy_version 1401170 (0.0007) [2023-12-28 05:18:24,346][106226] Updated weights for policy 0, policy_version 1397970 (0.0006) [2023-12-28 05:18:24,403][106226] Updated weights for policy 0, policy_version 1397980 (0.0007) [2023-12-28 05:18:24,462][106226] Updated weights for policy 0, policy_version 1397990 (0.0009) [2023-12-28 05:18:24,515][106226] Updated weights for policy 0, policy_version 1398000 (0.0009) [2023-12-28 05:18:24,987][106225] Updated weights for policy 1, policy_version 1401180 (0.0007) [2023-12-28 05:18:25,043][106225] Updated weights for policy 1, policy_version 1401190 (0.0007) [2023-12-28 05:18:25,102][106225] Updated weights for policy 1, policy_version 1401200 (0.0009) [2023-12-28 05:18:25,210][106226] Updated weights for policy 0, policy_version 1398010 (0.0005) [2023-12-28 05:18:25,265][106226] Updated weights for policy 0, policy_version 1398020 (0.0008) [2023-12-28 05:18:25,310][106226] Updated weights for policy 0, policy_version 1398030 (0.0008) [2023-12-28 05:18:25,858][106225] Updated weights for policy 1, policy_version 1401210 (0.0010) [2023-12-28 05:18:25,915][106225] Updated weights for policy 1, policy_version 1401220 (0.0007) [2023-12-28 05:18:25,969][106225] Updated weights for policy 1, policy_version 1401230 (0.0008) [2023-12-28 05:18:25,970][106226] Updated weights for policy 0, policy_version 1398040 (0.0010) [2023-12-28 05:18:26,023][106226] Updated weights for policy 0, policy_version 1398050 (0.0010) [2023-12-28 05:18:26,024][106225] Updated weights for policy 1, policy_version 1401240 (0.0008) [2023-12-28 05:18:26,082][106226] Updated weights for policy 0, policy_version 1398060 (0.0008) [2023-12-28 05:18:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 716742656. Throughput: 0: 9954.6, 1: 9610.2. Samples: 716705496. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:26,175][105115] Avg episode reward: [(0, '-4.856'), (1, '-4.527')] [2023-12-28 05:18:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001401240_358768640.pth... [2023-12-28 05:18:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001398064_357974016.pth... [2023-12-28 05:18:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001396880_357670912.pth [2023-12-28 05:18:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001400120_358481920.pth [2023-12-28 05:18:26,671][106225] Updated weights for policy 1, policy_version 1401250 (0.0005) [2023-12-28 05:18:26,729][106225] Updated weights for policy 1, policy_version 1401260 (0.0005) [2023-12-28 05:18:26,774][106225] Updated weights for policy 1, policy_version 1401270 (0.0005) [2023-12-28 05:18:26,777][106226] Updated weights for policy 0, policy_version 1398070 (0.0010) [2023-12-28 05:18:26,827][106226] Updated weights for policy 0, policy_version 1398080 (0.0010) [2023-12-28 05:18:26,879][106226] Updated weights for policy 0, policy_version 1398090 (0.0010) [2023-12-28 05:18:27,320][106225] Updated weights for policy 1, policy_version 1401280 (0.0005) [2023-12-28 05:18:27,380][106225] Updated weights for policy 1, policy_version 1401290 (0.0005) [2023-12-28 05:18:27,443][106225] Updated weights for policy 1, policy_version 1401300 (0.0007) [2023-12-28 05:18:27,491][106226] Updated weights for policy 0, policy_version 1398100 (0.0008) [2023-12-28 05:18:27,544][106226] Updated weights for policy 0, policy_version 1398110 (0.0005) [2023-12-28 05:18:27,597][106226] Updated weights for policy 0, policy_version 1398120 (0.0006) [2023-12-28 05:18:28,029][106225] Updated weights for policy 1, policy_version 1401310 (0.0006) [2023-12-28 05:18:28,087][106225] Updated weights for policy 1, policy_version 1401320 (0.0006) [2023-12-28 05:18:28,143][106225] Updated weights for policy 1, policy_version 1401330 (0.0005) [2023-12-28 05:18:28,323][106226] Updated weights for policy 0, policy_version 1398130 (0.0011) [2023-12-28 05:18:28,393][106226] Updated weights for policy 0, policy_version 1398140 (0.0011) [2023-12-28 05:18:28,454][106226] Updated weights for policy 0, policy_version 1398150 (0.0011) [2023-12-28 05:18:28,517][106226] Updated weights for policy 0, policy_version 1398160 (0.0010) [2023-12-28 05:18:28,755][106225] Updated weights for policy 1, policy_version 1401340 (0.0005) [2023-12-28 05:18:28,813][106225] Updated weights for policy 1, policy_version 1401350 (0.0006) [2023-12-28 05:18:28,874][106225] Updated weights for policy 1, policy_version 1401360 (0.0008) [2023-12-28 05:18:29,214][106226] Updated weights for policy 0, policy_version 1398170 (0.0011) [2023-12-28 05:18:29,282][106226] Updated weights for policy 0, policy_version 1398180 (0.0011) [2023-12-28 05:18:29,352][106226] Updated weights for policy 0, policy_version 1398190 (0.0010) [2023-12-28 05:18:29,564][106225] Updated weights for policy 1, policy_version 1401370 (0.0006) [2023-12-28 05:18:29,617][106225] Updated weights for policy 1, policy_version 1401380 (0.0007) [2023-12-28 05:18:29,670][106225] Updated weights for policy 1, policy_version 1401390 (0.0010) [2023-12-28 05:18:29,722][106225] Updated weights for policy 1, policy_version 1401400 (0.0010) [2023-12-28 05:18:29,980][106226] Updated weights for policy 0, policy_version 1398200 (0.0010) [2023-12-28 05:18:30,038][106226] Updated weights for policy 0, policy_version 1398210 (0.0010) [2023-12-28 05:18:30,103][106226] Updated weights for policy 0, policy_version 1398220 (0.0011) [2023-12-28 05:18:30,459][106225] Updated weights for policy 1, policy_version 1401410 (0.0007) [2023-12-28 05:18:30,516][106225] Updated weights for policy 1, policy_version 1401420 (0.0008) [2023-12-28 05:18:30,565][106225] Updated weights for policy 1, policy_version 1401430 (0.0007) [2023-12-28 05:18:30,800][106226] Updated weights for policy 0, policy_version 1398230 (0.0010) [2023-12-28 05:18:30,849][106226] Updated weights for policy 0, policy_version 1398240 (0.0009) [2023-12-28 05:18:30,895][106226] Updated weights for policy 0, policy_version 1398250 (0.0008) [2023-12-28 05:18:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 716840960. Throughput: 0: 10045.3, 1: 9716.5. Samples: 716830816. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:31,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.703')] [2023-12-28 05:18:31,229][106225] Updated weights for policy 1, policy_version 1401440 (0.0006) [2023-12-28 05:18:31,288][106225] Updated weights for policy 1, policy_version 1401450 (0.0009) [2023-12-28 05:18:31,356][106225] Updated weights for policy 1, policy_version 1401460 (0.0011) [2023-12-28 05:18:31,610][106226] Updated weights for policy 0, policy_version 1398260 (0.0008) [2023-12-28 05:18:31,673][106226] Updated weights for policy 0, policy_version 1398270 (0.0009) [2023-12-28 05:18:31,735][106226] Updated weights for policy 0, policy_version 1398280 (0.0008) [2023-12-28 05:18:32,124][106225] Updated weights for policy 1, policy_version 1401470 (0.0012) [2023-12-28 05:18:32,184][106225] Updated weights for policy 1, policy_version 1401480 (0.0010) [2023-12-28 05:18:32,237][106225] Updated weights for policy 1, policy_version 1401490 (0.0010) [2023-12-28 05:18:32,447][106226] Updated weights for policy 0, policy_version 1398290 (0.0008) [2023-12-28 05:18:32,510][106226] Updated weights for policy 0, policy_version 1398300 (0.0008) [2023-12-28 05:18:32,570][106226] Updated weights for policy 0, policy_version 1398310 (0.0008) [2023-12-28 05:18:32,634][106226] Updated weights for policy 0, policy_version 1398320 (0.0008) [2023-12-28 05:18:32,955][106225] Updated weights for policy 1, policy_version 1401500 (0.0010) [2023-12-28 05:18:33,014][106225] Updated weights for policy 1, policy_version 1401510 (0.0010) [2023-12-28 05:18:33,063][106225] Updated weights for policy 1, policy_version 1401520 (0.0010) [2023-12-28 05:18:33,268][106226] Updated weights for policy 0, policy_version 1398330 (0.0005) [2023-12-28 05:18:33,328][106226] Updated weights for policy 0, policy_version 1398340 (0.0005) [2023-12-28 05:18:33,389][106226] Updated weights for policy 0, policy_version 1398350 (0.0005) [2023-12-28 05:18:33,752][106225] Updated weights for policy 1, policy_version 1401530 (0.0010) [2023-12-28 05:18:33,807][106225] Updated weights for policy 1, policy_version 1401540 (0.0010) [2023-12-28 05:18:33,859][106225] Updated weights for policy 1, policy_version 1401550 (0.0008) [2023-12-28 05:18:33,904][106226] Updated weights for policy 0, policy_version 1398360 (0.0005) [2023-12-28 05:18:33,920][106225] Updated weights for policy 1, policy_version 1401560 (0.0005) [2023-12-28 05:18:33,953][106226] Updated weights for policy 0, policy_version 1398370 (0.0005) [2023-12-28 05:18:34,003][106226] Updated weights for policy 0, policy_version 1398380 (0.0006) [2023-12-28 05:18:34,539][106225] Updated weights for policy 1, policy_version 1401570 (0.0009) [2023-12-28 05:18:34,605][106225] Updated weights for policy 1, policy_version 1401580 (0.0008) [2023-12-28 05:18:34,669][106225] Updated weights for policy 1, policy_version 1401590 (0.0008) [2023-12-28 05:18:34,723][106226] Updated weights for policy 0, policy_version 1398390 (0.0008) [2023-12-28 05:18:34,786][106226] Updated weights for policy 0, policy_version 1398400 (0.0009) [2023-12-28 05:18:34,844][106226] Updated weights for policy 0, policy_version 1398410 (0.0009) [2023-12-28 05:18:35,359][106225] Updated weights for policy 1, policy_version 1401600 (0.0007) [2023-12-28 05:18:35,447][106225] Updated weights for policy 1, policy_version 1401610 (0.0006) [2023-12-28 05:18:35,495][106225] Updated weights for policy 1, policy_version 1401620 (0.0008) [2023-12-28 05:18:35,618][106226] Updated weights for policy 0, policy_version 1398420 (0.0007) [2023-12-28 05:18:35,673][106226] Updated weights for policy 0, policy_version 1398430 (0.0005) [2023-12-28 05:18:35,733][106226] Updated weights for policy 0, policy_version 1398440 (0.0005) [2023-12-28 05:18:36,065][106225] Updated weights for policy 1, policy_version 1401630 (0.0008) [2023-12-28 05:18:36,122][106225] Updated weights for policy 1, policy_version 1401640 (0.0006) [2023-12-28 05:18:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 716939264. Throughput: 0: 10078.2, 1: 9806.0. Samples: 716953280. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:36,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.757')] [2023-12-28 05:18:36,189][106225] Updated weights for policy 1, policy_version 1401650 (0.0008) [2023-12-28 05:18:36,336][106226] Updated weights for policy 0, policy_version 1398450 (0.0005) [2023-12-28 05:18:36,400][106226] Updated weights for policy 0, policy_version 1398460 (0.0006) [2023-12-28 05:18:36,455][106226] Updated weights for policy 0, policy_version 1398470 (0.0009) [2023-12-28 05:18:36,780][106225] Updated weights for policy 1, policy_version 1401660 (0.0007) [2023-12-28 05:18:36,849][106225] Updated weights for policy 1, policy_version 1401670 (0.0009) [2023-12-28 05:18:36,918][106225] Updated weights for policy 1, policy_version 1401680 (0.0010) [2023-12-28 05:18:37,177][106226] Updated weights for policy 0, policy_version 1398481 (0.0009) [2023-12-28 05:18:37,239][106226] Updated weights for policy 0, policy_version 1398491 (0.0009) [2023-12-28 05:18:37,301][106226] Updated weights for policy 0, policy_version 1398501 (0.0009) [2023-12-28 05:18:37,363][106226] Updated weights for policy 0, policy_version 1398511 (0.0008) [2023-12-28 05:18:37,643][106225] Updated weights for policy 1, policy_version 1401690 (0.0009) [2023-12-28 05:18:37,701][106225] Updated weights for policy 1, policy_version 1401700 (0.0008) [2023-12-28 05:18:37,770][106225] Updated weights for policy 1, policy_version 1401710 (0.0007) [2023-12-28 05:18:37,835][106225] Updated weights for policy 1, policy_version 1401720 (0.0008) [2023-12-28 05:18:37,994][106226] Updated weights for policy 0, policy_version 1398521 (0.0009) [2023-12-28 05:18:38,055][106226] Updated weights for policy 0, policy_version 1398531 (0.0008) [2023-12-28 05:18:38,111][106226] Updated weights for policy 0, policy_version 1398541 (0.0009) [2023-12-28 05:18:38,553][106225] Updated weights for policy 1, policy_version 1401730 (0.0008) [2023-12-28 05:18:38,615][106225] Updated weights for policy 1, policy_version 1401740 (0.0010) [2023-12-28 05:18:38,673][106225] Updated weights for policy 1, policy_version 1401750 (0.0009) [2023-12-28 05:18:38,849][106226] Updated weights for policy 0, policy_version 1398551 (0.0008) [2023-12-28 05:18:38,911][106226] Updated weights for policy 0, policy_version 1398561 (0.0009) [2023-12-28 05:18:38,975][106226] Updated weights for policy 0, policy_version 1398571 (0.0009) [2023-12-28 05:18:39,477][106225] Updated weights for policy 1, policy_version 1401760 (0.0009) [2023-12-28 05:18:39,547][106225] Updated weights for policy 1, policy_version 1401770 (0.0010) [2023-12-28 05:18:39,620][106225] Updated weights for policy 1, policy_version 1401780 (0.0009) [2023-12-28 05:18:39,724][106226] Updated weights for policy 0, policy_version 1398581 (0.0009) [2023-12-28 05:18:39,779][106226] Updated weights for policy 0, policy_version 1398591 (0.0010) [2023-12-28 05:18:39,846][106226] Updated weights for policy 0, policy_version 1398601 (0.0008) [2023-12-28 05:18:40,240][106225] Updated weights for policy 1, policy_version 1401790 (0.0008) [2023-12-28 05:18:40,300][106225] Updated weights for policy 1, policy_version 1401800 (0.0008) [2023-12-28 05:18:40,362][106225] Updated weights for policy 1, policy_version 1401810 (0.0009) [2023-12-28 05:18:40,628][106226] Updated weights for policy 0, policy_version 1398611 (0.0010) [2023-12-28 05:18:40,699][106226] Updated weights for policy 0, policy_version 1398621 (0.0009) [2023-12-28 05:18:40,756][106226] Updated weights for policy 0, policy_version 1398631 (0.0009) [2023-12-28 05:18:41,138][106225] Updated weights for policy 1, policy_version 1401820 (0.0008) [2023-12-28 05:18:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 717037568. Throughput: 0: 10109.7, 1: 9809.9. Samples: 717012264. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:41,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-4.709')] [2023-12-28 05:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001398640_358121472.pth... [2023-12-28 05:18:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001397488_357826560.pth [2023-12-28 05:18:41,204][106225] Updated weights for policy 1, policy_version 1401830 (0.0008) [2023-12-28 05:18:41,267][106225] Updated weights for policy 1, policy_version 1401840 (0.0007) [2023-12-28 05:18:41,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001401848_358924288.pth... [2023-12-28 05:18:41,313][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001400664_358621184.pth [2023-12-28 05:18:41,537][106226] Updated weights for policy 0, policy_version 1398641 (0.0008) [2023-12-28 05:18:41,601][106226] Updated weights for policy 0, policy_version 1398651 (0.0009) [2023-12-28 05:18:41,669][106226] Updated weights for policy 0, policy_version 1398661 (0.0007) [2023-12-28 05:18:41,744][106226] Updated weights for policy 0, policy_version 1398671 (0.0009) [2023-12-28 05:18:42,010][106225] Updated weights for policy 1, policy_version 1401850 (0.0008) [2023-12-28 05:18:42,065][106225] Updated weights for policy 1, policy_version 1401860 (0.0008) [2023-12-28 05:18:42,127][106225] Updated weights for policy 1, policy_version 1401870 (0.0008) [2023-12-28 05:18:42,178][106225] Updated weights for policy 1, policy_version 1401880 (0.0008) [2023-12-28 05:18:42,468][106226] Updated weights for policy 0, policy_version 1398681 (0.0009) [2023-12-28 05:18:42,527][106226] Updated weights for policy 0, policy_version 1398691 (0.0008) [2023-12-28 05:18:42,587][106226] Updated weights for policy 0, policy_version 1398701 (0.0008) [2023-12-28 05:18:42,948][106225] Updated weights for policy 1, policy_version 1401890 (0.0009) [2023-12-28 05:18:43,008][106225] Updated weights for policy 1, policy_version 1401900 (0.0009) [2023-12-28 05:18:43,065][106225] Updated weights for policy 1, policy_version 1401910 (0.0009) [2023-12-28 05:18:43,363][106226] Updated weights for policy 0, policy_version 1398711 (0.0009) [2023-12-28 05:18:43,410][106226] Updated weights for policy 0, policy_version 1398721 (0.0006) [2023-12-28 05:18:43,462][106226] Updated weights for policy 0, policy_version 1398731 (0.0008) [2023-12-28 05:18:43,684][106225] Updated weights for policy 1, policy_version 1401920 (0.0008) [2023-12-28 05:18:43,736][106225] Updated weights for policy 1, policy_version 1401930 (0.0008) [2023-12-28 05:18:43,800][106225] Updated weights for policy 1, policy_version 1401940 (0.0008) [2023-12-28 05:18:44,229][106226] Updated weights for policy 0, policy_version 1398741 (0.0009) [2023-12-28 05:18:44,289][106226] Updated weights for policy 0, policy_version 1398751 (0.0011) [2023-12-28 05:18:44,339][106226] Updated weights for policy 0, policy_version 1398761 (0.0011) [2023-12-28 05:18:44,534][106225] Updated weights for policy 1, policy_version 1401950 (0.0007) [2023-12-28 05:18:44,590][106225] Updated weights for policy 1, policy_version 1401960 (0.0005) [2023-12-28 05:18:44,654][106225] Updated weights for policy 1, policy_version 1401970 (0.0005) [2023-12-28 05:18:45,068][106226] Updated weights for policy 0, policy_version 1398771 (0.0010) [2023-12-28 05:18:45,126][106226] Updated weights for policy 0, policy_version 1398781 (0.0011) [2023-12-28 05:18:45,180][106226] Updated weights for policy 0, policy_version 1398791 (0.0011) [2023-12-28 05:18:45,268][106225] Updated weights for policy 1, policy_version 1401980 (0.0008) [2023-12-28 05:18:45,329][106225] Updated weights for policy 1, policy_version 1401990 (0.0010) [2023-12-28 05:18:45,389][106225] Updated weights for policy 1, policy_version 1402000 (0.0010) [2023-12-28 05:18:45,864][106226] Updated weights for policy 0, policy_version 1398801 (0.0010) [2023-12-28 05:18:45,914][106226] Updated weights for policy 0, policy_version 1398811 (0.0005) [2023-12-28 05:18:45,959][106226] Updated weights for policy 0, policy_version 1398821 (0.0007) [2023-12-28 05:18:46,006][106226] Updated weights for policy 0, policy_version 1398831 (0.0006) [2023-12-28 05:18:46,066][106225] Updated weights for policy 1, policy_version 1402010 (0.0010) [2023-12-28 05:18:46,121][106225] Updated weights for policy 1, policy_version 1402020 (0.0010) [2023-12-28 05:18:46,175][106225] Updated weights for policy 1, policy_version 1402030 (0.0007) [2023-12-28 05:18:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 717135872. Throughput: 0: 9972.4, 1: 9883.9. Samples: 717125552. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:46,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-4.596')] [2023-12-28 05:18:46,226][106225] Updated weights for policy 1, policy_version 1402040 (0.0008) [2023-12-28 05:18:46,663][106226] Updated weights for policy 0, policy_version 1398841 (0.0010) [2023-12-28 05:18:46,719][106226] Updated weights for policy 0, policy_version 1398851 (0.0010) [2023-12-28 05:18:46,779][106226] Updated weights for policy 0, policy_version 1398861 (0.0009) [2023-12-28 05:18:46,916][106225] Updated weights for policy 1, policy_version 1402050 (0.0009) [2023-12-28 05:18:46,978][106225] Updated weights for policy 1, policy_version 1402060 (0.0006) [2023-12-28 05:18:47,028][106225] Updated weights for policy 1, policy_version 1402070 (0.0005) [2023-12-28 05:18:47,428][106226] Updated weights for policy 0, policy_version 1398871 (0.0010) [2023-12-28 05:18:47,481][106226] Updated weights for policy 0, policy_version 1398881 (0.0010) [2023-12-28 05:18:47,538][106226] Updated weights for policy 0, policy_version 1398891 (0.0011) [2023-12-28 05:18:47,698][106225] Updated weights for policy 1, policy_version 1402080 (0.0007) [2023-12-28 05:18:47,747][106225] Updated weights for policy 1, policy_version 1402090 (0.0008) [2023-12-28 05:18:47,800][106225] Updated weights for policy 1, policy_version 1402100 (0.0009) [2023-12-28 05:18:48,235][106226] Updated weights for policy 0, policy_version 1398901 (0.0011) [2023-12-28 05:18:48,298][106226] Updated weights for policy 0, policy_version 1398911 (0.0011) [2023-12-28 05:18:48,362][106226] Updated weights for policy 0, policy_version 1398921 (0.0011) [2023-12-28 05:18:48,480][106225] Updated weights for policy 1, policy_version 1402110 (0.0008) [2023-12-28 05:18:48,531][106225] Updated weights for policy 1, policy_version 1402120 (0.0007) [2023-12-28 05:18:48,596][106225] Updated weights for policy 1, policy_version 1402130 (0.0006) [2023-12-28 05:18:49,071][106226] Updated weights for policy 0, policy_version 1398931 (0.0011) [2023-12-28 05:18:49,118][106226] Updated weights for policy 0, policy_version 1398941 (0.0010) [2023-12-28 05:18:49,165][106226] Updated weights for policy 0, policy_version 1398951 (0.0010) [2023-12-28 05:18:49,327][106225] Updated weights for policy 1, policy_version 1402140 (0.0007) [2023-12-28 05:18:49,396][106225] Updated weights for policy 1, policy_version 1402150 (0.0009) [2023-12-28 05:18:49,463][106225] Updated weights for policy 1, policy_version 1402160 (0.0007) [2023-12-28 05:18:49,921][106226] Updated weights for policy 0, policy_version 1398961 (0.0010) [2023-12-28 05:18:49,993][106226] Updated weights for policy 0, policy_version 1398971 (0.0009) [2023-12-28 05:18:50,058][106226] Updated weights for policy 0, policy_version 1398981 (0.0006) [2023-12-28 05:18:50,114][106226] Updated weights for policy 0, policy_version 1398991 (0.0006) [2023-12-28 05:18:50,239][106225] Updated weights for policy 1, policy_version 1402170 (0.0007) [2023-12-28 05:18:50,296][106225] Updated weights for policy 1, policy_version 1402180 (0.0009) [2023-12-28 05:18:50,357][106225] Updated weights for policy 1, policy_version 1402190 (0.0009) [2023-12-28 05:18:50,419][106225] Updated weights for policy 1, policy_version 1402200 (0.0009) [2023-12-28 05:18:50,870][106226] Updated weights for policy 0, policy_version 1399001 (0.0006) [2023-12-28 05:18:50,936][106226] Updated weights for policy 0, policy_version 1399011 (0.0006) [2023-12-28 05:18:51,000][106226] Updated weights for policy 0, policy_version 1399021 (0.0010) [2023-12-28 05:18:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 717234176. Throughput: 0: 9896.5, 1: 9841.8. Samples: 717244568. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:51,175][105115] Avg episode reward: [(0, '-4.960'), (1, '-4.750')] [2023-12-28 05:18:51,221][106225] Updated weights for policy 1, policy_version 1402210 (0.0007) [2023-12-28 05:18:51,281][106225] Updated weights for policy 1, policy_version 1402220 (0.0008) [2023-12-28 05:18:51,347][106225] Updated weights for policy 1, policy_version 1402230 (0.0008) [2023-12-28 05:18:51,706][106226] Updated weights for policy 0, policy_version 1399031 (0.0010) [2023-12-28 05:18:51,774][106226] Updated weights for policy 0, policy_version 1399041 (0.0008) [2023-12-28 05:18:51,840][106226] Updated weights for policy 0, policy_version 1399051 (0.0008) [2023-12-28 05:18:52,082][106225] Updated weights for policy 1, policy_version 1402240 (0.0010) [2023-12-28 05:18:52,141][106225] Updated weights for policy 1, policy_version 1402250 (0.0005) [2023-12-28 05:18:52,194][106225] Updated weights for policy 1, policy_version 1402260 (0.0009) [2023-12-28 05:18:52,627][106226] Updated weights for policy 0, policy_version 1399061 (0.0008) [2023-12-28 05:18:52,696][106226] Updated weights for policy 0, policy_version 1399071 (0.0009) [2023-12-28 05:18:52,765][106226] Updated weights for policy 0, policy_version 1399081 (0.0009) [2023-12-28 05:18:52,795][106225] Updated weights for policy 1, policy_version 1402270 (0.0010) [2023-12-28 05:18:52,843][106225] Updated weights for policy 1, policy_version 1402280 (0.0010) [2023-12-28 05:18:52,893][106225] Updated weights for policy 1, policy_version 1402290 (0.0010) [2023-12-28 05:18:53,519][106226] Updated weights for policy 0, policy_version 1399091 (0.0006) [2023-12-28 05:18:53,545][106225] Updated weights for policy 1, policy_version 1402300 (0.0009) [2023-12-28 05:18:53,575][106226] Updated weights for policy 0, policy_version 1399101 (0.0008) [2023-12-28 05:18:53,600][106225] Updated weights for policy 1, policy_version 1402310 (0.0006) [2023-12-28 05:18:53,632][106226] Updated weights for policy 0, policy_version 1399111 (0.0007) [2023-12-28 05:18:53,653][106225] Updated weights for policy 1, policy_version 1402320 (0.0006) [2023-12-28 05:18:54,331][106225] Updated weights for policy 1, policy_version 1402330 (0.0007) [2023-12-28 05:18:54,357][106226] Updated weights for policy 0, policy_version 1399121 (0.0008) [2023-12-28 05:18:54,382][106225] Updated weights for policy 1, policy_version 1402340 (0.0008) [2023-12-28 05:18:54,415][106226] Updated weights for policy 0, policy_version 1399131 (0.0005) [2023-12-28 05:18:54,434][106225] Updated weights for policy 1, policy_version 1402350 (0.0008) [2023-12-28 05:18:54,480][106226] Updated weights for policy 0, policy_version 1399141 (0.0006) [2023-12-28 05:18:54,501][106225] Updated weights for policy 1, policy_version 1402360 (0.0008) [2023-12-28 05:18:54,545][106226] Updated weights for policy 0, policy_version 1399151 (0.0006) [2023-12-28 05:18:55,091][106226] Updated weights for policy 0, policy_version 1399161 (0.0009) [2023-12-28 05:18:55,147][106226] Updated weights for policy 0, policy_version 1399171 (0.0008) [2023-12-28 05:18:55,203][106226] Updated weights for policy 0, policy_version 1399181 (0.0008) [2023-12-28 05:18:55,225][106225] Updated weights for policy 1, policy_version 1402370 (0.0007) [2023-12-28 05:18:55,288][106225] Updated weights for policy 1, policy_version 1402380 (0.0009) [2023-12-28 05:18:55,355][106225] Updated weights for policy 1, policy_version 1402390 (0.0009) [2023-12-28 05:18:55,847][106226] Updated weights for policy 0, policy_version 1399191 (0.0009) [2023-12-28 05:18:55,899][106226] Updated weights for policy 0, policy_version 1399201 (0.0008) [2023-12-28 05:18:55,957][106226] Updated weights for policy 0, policy_version 1399211 (0.0005) [2023-12-28 05:18:56,101][106225] Updated weights for policy 1, policy_version 1402400 (0.0008) [2023-12-28 05:18:56,164][106225] Updated weights for policy 1, policy_version 1402410 (0.0008) [2023-12-28 05:18:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 717332480. Throughput: 0: 9814.4, 1: 9891.1. Samples: 717302080. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:18:56,176][105115] Avg episode reward: [(0, '-4.941'), (1, '-4.730')] [2023-12-28 05:18:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001399216_358268928.pth... [2023-12-28 05:18:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001398064_357974016.pth [2023-12-28 05:18:56,220][106225] Updated weights for policy 1, policy_version 1402420 (0.0009) [2023-12-28 05:18:56,240][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001402424_359071744.pth... [2023-12-28 05:18:56,245][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001401240_358768640.pth [2023-12-28 05:18:56,637][106226] Updated weights for policy 0, policy_version 1399221 (0.0007) [2023-12-28 05:18:56,692][106226] Updated weights for policy 0, policy_version 1399231 (0.0008) [2023-12-28 05:18:56,755][106226] Updated weights for policy 0, policy_version 1399241 (0.0008) [2023-12-28 05:18:56,966][106225] Updated weights for policy 1, policy_version 1402430 (0.0008) [2023-12-28 05:18:57,028][106225] Updated weights for policy 1, policy_version 1402440 (0.0008) [2023-12-28 05:18:57,076][106225] Updated weights for policy 1, policy_version 1402450 (0.0008) [2023-12-28 05:18:57,310][106226] Updated weights for policy 0, policy_version 1399251 (0.0007) [2023-12-28 05:18:57,365][106226] Updated weights for policy 0, policy_version 1399261 (0.0006) [2023-12-28 05:18:57,426][106226] Updated weights for policy 0, policy_version 1399271 (0.0009) [2023-12-28 05:18:57,827][106225] Updated weights for policy 1, policy_version 1402460 (0.0007) [2023-12-28 05:18:57,871][106225] Updated weights for policy 1, policy_version 1402470 (0.0007) [2023-12-28 05:18:57,935][106225] Updated weights for policy 1, policy_version 1402480 (0.0007) [2023-12-28 05:18:58,106][106226] Updated weights for policy 0, policy_version 1399281 (0.0010) [2023-12-28 05:18:58,164][106226] Updated weights for policy 0, policy_version 1399291 (0.0009) [2023-12-28 05:18:58,233][106226] Updated weights for policy 0, policy_version 1399301 (0.0009) [2023-12-28 05:18:58,298][106226] Updated weights for policy 0, policy_version 1399311 (0.0011) [2023-12-28 05:18:58,687][106225] Updated weights for policy 1, policy_version 1402490 (0.0009) [2023-12-28 05:18:58,755][106225] Updated weights for policy 1, policy_version 1402500 (0.0011) [2023-12-28 05:18:58,824][106225] Updated weights for policy 1, policy_version 1402510 (0.0009) [2023-12-28 05:18:58,890][106225] Updated weights for policy 1, policy_version 1402520 (0.0009) [2023-12-28 05:18:59,069][106226] Updated weights for policy 0, policy_version 1399321 (0.0007) [2023-12-28 05:18:59,131][106226] Updated weights for policy 0, policy_version 1399331 (0.0008) [2023-12-28 05:18:59,190][106226] Updated weights for policy 0, policy_version 1399341 (0.0008) [2023-12-28 05:18:59,623][106225] Updated weights for policy 1, policy_version 1402530 (0.0011) [2023-12-28 05:18:59,682][106225] Updated weights for policy 1, policy_version 1402540 (0.0010) [2023-12-28 05:18:59,742][106225] Updated weights for policy 1, policy_version 1402550 (0.0010) [2023-12-28 05:18:59,986][106226] Updated weights for policy 0, policy_version 1399351 (0.0007) [2023-12-28 05:19:00,042][106226] Updated weights for policy 0, policy_version 1399361 (0.0007) [2023-12-28 05:19:00,093][106226] Updated weights for policy 0, policy_version 1399371 (0.0008) [2023-12-28 05:19:00,457][106225] Updated weights for policy 1, policy_version 1402560 (0.0009) [2023-12-28 05:19:00,503][106225] Updated weights for policy 1, policy_version 1402570 (0.0010) [2023-12-28 05:19:00,551][106225] Updated weights for policy 1, policy_version 1402580 (0.0010) [2023-12-28 05:19:00,850][106226] Updated weights for policy 0, policy_version 1399381 (0.0009) [2023-12-28 05:19:00,900][106226] Updated weights for policy 0, policy_version 1399391 (0.0008) [2023-12-28 05:19:00,947][106226] Updated weights for policy 0, policy_version 1399401 (0.0007) [2023-12-28 05:19:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 717430784. Throughput: 0: 9907.9, 1: 9866.3. Samples: 717419860. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:01,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-4.935')] [2023-12-28 05:19:01,323][106225] Updated weights for policy 1, policy_version 1402590 (0.0007) [2023-12-28 05:19:01,385][106225] Updated weights for policy 1, policy_version 1402600 (0.0007) [2023-12-28 05:19:01,437][106225] Updated weights for policy 1, policy_version 1402610 (0.0006) [2023-12-28 05:19:01,664][106226] Updated weights for policy 0, policy_version 1399411 (0.0006) [2023-12-28 05:19:01,735][106226] Updated weights for policy 0, policy_version 1399421 (0.0008) [2023-12-28 05:19:01,802][106226] Updated weights for policy 0, policy_version 1399431 (0.0008) [2023-12-28 05:19:02,133][106225] Updated weights for policy 1, policy_version 1402620 (0.0007) [2023-12-28 05:19:02,192][106225] Updated weights for policy 1, policy_version 1402630 (0.0008) [2023-12-28 05:19:02,252][106225] Updated weights for policy 1, policy_version 1402640 (0.0008) [2023-12-28 05:19:02,549][106226] Updated weights for policy 0, policy_version 1399441 (0.0008) [2023-12-28 05:19:02,605][106226] Updated weights for policy 0, policy_version 1399451 (0.0008) [2023-12-28 05:19:02,659][106226] Updated weights for policy 0, policy_version 1399461 (0.0009) [2023-12-28 05:19:02,716][106226] Updated weights for policy 0, policy_version 1399471 (0.0008) [2023-12-28 05:19:02,893][106225] Updated weights for policy 1, policy_version 1402650 (0.0008) [2023-12-28 05:19:02,954][106225] Updated weights for policy 1, policy_version 1402660 (0.0005) [2023-12-28 05:19:03,024][106225] Updated weights for policy 1, policy_version 1402670 (0.0005) [2023-12-28 05:19:03,085][106225] Updated weights for policy 1, policy_version 1402680 (0.0008) [2023-12-28 05:19:03,453][106226] Updated weights for policy 0, policy_version 1399481 (0.0006) [2023-12-28 05:19:03,509][106226] Updated weights for policy 0, policy_version 1399491 (0.0005) [2023-12-28 05:19:03,562][106226] Updated weights for policy 0, policy_version 1399501 (0.0005) [2023-12-28 05:19:03,628][106225] Updated weights for policy 1, policy_version 1402690 (0.0005) [2023-12-28 05:19:03,683][106225] Updated weights for policy 1, policy_version 1402700 (0.0005) [2023-12-28 05:19:03,731][106225] Updated weights for policy 1, policy_version 1402710 (0.0005) [2023-12-28 05:19:04,243][106226] Updated weights for policy 0, policy_version 1399511 (0.0009) [2023-12-28 05:19:04,303][106226] Updated weights for policy 0, policy_version 1399521 (0.0008) [2023-12-28 05:19:04,364][106226] Updated weights for policy 0, policy_version 1399531 (0.0007) [2023-12-28 05:19:04,385][106225] Updated weights for policy 1, policy_version 1402720 (0.0007) [2023-12-28 05:19:04,449][106225] Updated weights for policy 1, policy_version 1402730 (0.0008) [2023-12-28 05:19:04,506][106225] Updated weights for policy 1, policy_version 1402740 (0.0008) [2023-12-28 05:19:05,046][106226] Updated weights for policy 0, policy_version 1399541 (0.0008) [2023-12-28 05:19:05,092][106226] Updated weights for policy 0, policy_version 1399551 (0.0010) [2023-12-28 05:19:05,138][106226] Updated weights for policy 0, policy_version 1399561 (0.0005) [2023-12-28 05:19:05,265][106225] Updated weights for policy 1, policy_version 1402750 (0.0006) [2023-12-28 05:19:05,329][106225] Updated weights for policy 1, policy_version 1402760 (0.0005) [2023-12-28 05:19:05,384][106225] Updated weights for policy 1, policy_version 1402770 (0.0006) [2023-12-28 05:19:05,758][106226] Updated weights for policy 0, policy_version 1399571 (0.0005) [2023-12-28 05:19:05,809][106226] Updated weights for policy 0, policy_version 1399581 (0.0005) [2023-12-28 05:19:05,863][106226] Updated weights for policy 0, policy_version 1399591 (0.0008) [2023-12-28 05:19:06,093][106225] Updated weights for policy 1, policy_version 1402780 (0.0008) [2023-12-28 05:19:06,164][106225] Updated weights for policy 1, policy_version 1402790 (0.0008) [2023-12-28 05:19:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 717529088. Throughput: 0: 9884.2, 1: 9921.8. Samples: 717540100. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:06,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.584')] [2023-12-28 05:19:06,226][106225] Updated weights for policy 1, policy_version 1402800 (0.0008) [2023-12-28 05:19:06,562][106226] Updated weights for policy 0, policy_version 1399601 (0.0008) [2023-12-28 05:19:06,613][106226] Updated weights for policy 0, policy_version 1399611 (0.0007) [2023-12-28 05:19:06,667][106226] Updated weights for policy 0, policy_version 1399621 (0.0008) [2023-12-28 05:19:06,732][106226] Updated weights for policy 0, policy_version 1399631 (0.0009) [2023-12-28 05:19:06,878][106225] Updated weights for policy 1, policy_version 1402810 (0.0008) [2023-12-28 05:19:06,935][106225] Updated weights for policy 1, policy_version 1402820 (0.0008) [2023-12-28 05:19:06,996][106225] Updated weights for policy 1, policy_version 1402830 (0.0008) [2023-12-28 05:19:07,057][106225] Updated weights for policy 1, policy_version 1402840 (0.0008) [2023-12-28 05:19:07,426][106226] Updated weights for policy 0, policy_version 1399641 (0.0008) [2023-12-28 05:19:07,495][106226] Updated weights for policy 0, policy_version 1399651 (0.0005) [2023-12-28 05:19:07,560][106226] Updated weights for policy 0, policy_version 1399661 (0.0008) [2023-12-28 05:19:07,788][106225] Updated weights for policy 1, policy_version 1402850 (0.0010) [2023-12-28 05:19:07,848][106225] Updated weights for policy 1, policy_version 1402860 (0.0008) [2023-12-28 05:19:07,907][106225] Updated weights for policy 1, policy_version 1402870 (0.0008) [2023-12-28 05:19:08,091][106226] Updated weights for policy 0, policy_version 1399671 (0.0007) [2023-12-28 05:19:08,141][106226] Updated weights for policy 0, policy_version 1399681 (0.0009) [2023-12-28 05:19:08,189][106226] Updated weights for policy 0, policy_version 1399691 (0.0007) [2023-12-28 05:19:08,672][106225] Updated weights for policy 1, policy_version 1402880 (0.0008) [2023-12-28 05:19:08,726][106225] Updated weights for policy 1, policy_version 1402890 (0.0008) [2023-12-28 05:19:08,793][106225] Updated weights for policy 1, policy_version 1402900 (0.0006) [2023-12-28 05:19:08,944][106226] Updated weights for policy 0, policy_version 1399701 (0.0007) [2023-12-28 05:19:08,999][106226] Updated weights for policy 0, policy_version 1399711 (0.0009) [2023-12-28 05:19:09,054][106226] Updated weights for policy 0, policy_version 1399721 (0.0008) [2023-12-28 05:19:09,502][106225] Updated weights for policy 1, policy_version 1402910 (0.0007) [2023-12-28 05:19:09,559][106225] Updated weights for policy 1, policy_version 1402920 (0.0008) [2023-12-28 05:19:09,618][106225] Updated weights for policy 1, policy_version 1402930 (0.0009) [2023-12-28 05:19:09,761][106226] Updated weights for policy 0, policy_version 1399731 (0.0008) [2023-12-28 05:19:09,831][106226] Updated weights for policy 0, policy_version 1399741 (0.0008) [2023-12-28 05:19:09,897][106226] Updated weights for policy 0, policy_version 1399751 (0.0009) [2023-12-28 05:19:10,413][106225] Updated weights for policy 1, policy_version 1402940 (0.0008) [2023-12-28 05:19:10,471][106225] Updated weights for policy 1, policy_version 1402950 (0.0006) [2023-12-28 05:19:10,535][106225] Updated weights for policy 1, policy_version 1402960 (0.0006) [2023-12-28 05:19:10,652][106226] Updated weights for policy 0, policy_version 1399761 (0.0009) [2023-12-28 05:19:10,715][106226] Updated weights for policy 0, policy_version 1399771 (0.0009) [2023-12-28 05:19:10,775][106226] Updated weights for policy 0, policy_version 1399781 (0.0006) [2023-12-28 05:19:10,839][106226] Updated weights for policy 0, policy_version 1399791 (0.0008) [2023-12-28 05:19:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 717627392. Throughput: 0: 9916.7, 1: 9955.2. Samples: 717599732. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:11,175][105115] Avg episode reward: [(0, '-4.830'), (1, '-5.040')] [2023-12-28 05:19:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001402968_359211008.pth... [2023-12-28 05:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001399792_358416384.pth... [2023-12-28 05:19:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001398640_358121472.pth [2023-12-28 05:19:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001401848_358924288.pth [2023-12-28 05:19:11,264][106225] Updated weights for policy 1, policy_version 1402970 (0.0008) [2023-12-28 05:19:11,326][106225] Updated weights for policy 1, policy_version 1402980 (0.0006) [2023-12-28 05:19:11,402][106225] Updated weights for policy 1, policy_version 1402990 (0.0008) [2023-12-28 05:19:11,470][106225] Updated weights for policy 1, policy_version 1403000 (0.0006) [2023-12-28 05:19:11,614][106226] Updated weights for policy 0, policy_version 1399801 (0.0009) [2023-12-28 05:19:11,698][106226] Updated weights for policy 0, policy_version 1399812 (0.0008) [2023-12-28 05:19:11,763][106226] Updated weights for policy 0, policy_version 1399822 (0.0008) [2023-12-28 05:19:12,183][106225] Updated weights for policy 1, policy_version 1403010 (0.0007) [2023-12-28 05:19:12,244][106225] Updated weights for policy 1, policy_version 1403020 (0.0009) [2023-12-28 05:19:12,309][106225] Updated weights for policy 1, policy_version 1403030 (0.0009) [2023-12-28 05:19:12,472][106226] Updated weights for policy 0, policy_version 1399832 (0.0008) [2023-12-28 05:19:12,531][106226] Updated weights for policy 0, policy_version 1399842 (0.0008) [2023-12-28 05:19:12,592][106226] Updated weights for policy 0, policy_version 1399852 (0.0007) [2023-12-28 05:19:13,098][106225] Updated weights for policy 1, policy_version 1403040 (0.0011) [2023-12-28 05:19:13,160][106225] Updated weights for policy 1, policy_version 1403050 (0.0010) [2023-12-28 05:19:13,221][106225] Updated weights for policy 1, policy_version 1403060 (0.0011) [2023-12-28 05:19:13,359][106226] Updated weights for policy 0, policy_version 1399862 (0.0008) [2023-12-28 05:19:13,414][106226] Updated weights for policy 0, policy_version 1399872 (0.0008) [2023-12-28 05:19:13,476][106226] Updated weights for policy 0, policy_version 1399882 (0.0008) [2023-12-28 05:19:13,933][106225] Updated weights for policy 1, policy_version 1403070 (0.0010) [2023-12-28 05:19:13,989][106225] Updated weights for policy 1, policy_version 1403080 (0.0010) [2023-12-28 05:19:14,041][106225] Updated weights for policy 1, policy_version 1403090 (0.0010) [2023-12-28 05:19:14,206][106226] Updated weights for policy 0, policy_version 1399892 (0.0007) [2023-12-28 05:19:14,263][106226] Updated weights for policy 0, policy_version 1399902 (0.0006) [2023-12-28 05:19:14,313][106226] Updated weights for policy 0, policy_version 1399912 (0.0007) [2023-12-28 05:19:14,737][106225] Updated weights for policy 1, policy_version 1403100 (0.0010) [2023-12-28 05:19:14,800][106225] Updated weights for policy 1, policy_version 1403110 (0.0010) [2023-12-28 05:19:14,857][106225] Updated weights for policy 1, policy_version 1403120 (0.0010) [2023-12-28 05:19:14,996][106226] Updated weights for policy 0, policy_version 1399922 (0.0008) [2023-12-28 05:19:15,064][106226] Updated weights for policy 0, policy_version 1399932 (0.0006) [2023-12-28 05:19:15,128][106226] Updated weights for policy 0, policy_version 1399942 (0.0006) [2023-12-28 05:19:15,189][106226] Updated weights for policy 0, policy_version 1399952 (0.0006) [2023-12-28 05:19:15,587][106225] Updated weights for policy 1, policy_version 1403130 (0.0011) [2023-12-28 05:19:15,647][106225] Updated weights for policy 1, policy_version 1403140 (0.0010) [2023-12-28 05:19:15,701][106225] Updated weights for policy 1, policy_version 1403150 (0.0010) [2023-12-28 05:19:15,740][106226] Updated weights for policy 0, policy_version 1399962 (0.0006) [2023-12-28 05:19:15,751][106225] Updated weights for policy 1, policy_version 1403160 (0.0010) [2023-12-28 05:19:15,811][106226] Updated weights for policy 0, policy_version 1399972 (0.0006) [2023-12-28 05:19:15,873][106226] Updated weights for policy 0, policy_version 1399982 (0.0008) [2023-12-28 05:19:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 717725696. Throughput: 0: 9825.1, 1: 9803.3. Samples: 717714096. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:16,175][105115] Avg episode reward: [(0, '-4.771'), (1, '-4.487')] [2023-12-28 05:19:16,477][106226] Updated weights for policy 0, policy_version 1399992 (0.0006) [2023-12-28 05:19:16,486][106225] Updated weights for policy 1, policy_version 1403170 (0.0010) [2023-12-28 05:19:16,537][106225] Updated weights for policy 1, policy_version 1403180 (0.0010) [2023-12-28 05:19:16,542][106226] Updated weights for policy 0, policy_version 1400002 (0.0005) [2023-12-28 05:19:16,584][106225] Updated weights for policy 1, policy_version 1403190 (0.0010) [2023-12-28 05:19:16,607][106226] Updated weights for policy 0, policy_version 1400012 (0.0007) [2023-12-28 05:19:17,288][106226] Updated weights for policy 0, policy_version 1400022 (0.0008) [2023-12-28 05:19:17,328][106225] Updated weights for policy 1, policy_version 1403200 (0.0010) [2023-12-28 05:19:17,342][106226] Updated weights for policy 0, policy_version 1400032 (0.0007) [2023-12-28 05:19:17,392][106225] Updated weights for policy 1, policy_version 1403210 (0.0010) [2023-12-28 05:19:17,397][106226] Updated weights for policy 0, policy_version 1400042 (0.0006) [2023-12-28 05:19:17,454][106225] Updated weights for policy 1, policy_version 1403220 (0.0010) [2023-12-28 05:19:17,975][106226] Updated weights for policy 0, policy_version 1400052 (0.0005) [2023-12-28 05:19:18,042][106226] Updated weights for policy 0, policy_version 1400062 (0.0008) [2023-12-28 05:19:18,101][106226] Updated weights for policy 0, policy_version 1400072 (0.0008) [2023-12-28 05:19:18,157][106225] Updated weights for policy 1, policy_version 1403230 (0.0011) [2023-12-28 05:19:18,215][106225] Updated weights for policy 1, policy_version 1403240 (0.0010) [2023-12-28 05:19:18,266][106225] Updated weights for policy 1, policy_version 1403250 (0.0010) [2023-12-28 05:19:18,828][106226] Updated weights for policy 0, policy_version 1400082 (0.0007) [2023-12-28 05:19:18,898][106226] Updated weights for policy 0, policy_version 1400092 (0.0007) [2023-12-28 05:19:18,942][106225] Updated weights for policy 1, policy_version 1403260 (0.0008) [2023-12-28 05:19:18,967][106226] Updated weights for policy 0, policy_version 1400102 (0.0007) [2023-12-28 05:19:19,012][106225] Updated weights for policy 1, policy_version 1403270 (0.0007) [2023-12-28 05:19:19,034][106226] Updated weights for policy 0, policy_version 1400112 (0.0006) [2023-12-28 05:19:19,079][106225] Updated weights for policy 1, policy_version 1403280 (0.0010) [2023-12-28 05:19:19,683][106226] Updated weights for policy 0, policy_version 1400122 (0.0006) [2023-12-28 05:19:19,736][106226] Updated weights for policy 0, policy_version 1400132 (0.0007) [2023-12-28 05:19:19,795][106226] Updated weights for policy 0, policy_version 1400142 (0.0008) [2023-12-28 05:19:19,803][106225] Updated weights for policy 1, policy_version 1403290 (0.0010) [2023-12-28 05:19:19,878][106225] Updated weights for policy 1, policy_version 1403300 (0.0008) [2023-12-28 05:19:19,945][106225] Updated weights for policy 1, policy_version 1403310 (0.0008) [2023-12-28 05:19:20,011][106225] Updated weights for policy 1, policy_version 1403320 (0.0006) [2023-12-28 05:19:20,603][106226] Updated weights for policy 0, policy_version 1400152 (0.0008) [2023-12-28 05:19:20,605][106225] Updated weights for policy 1, policy_version 1403330 (0.0008) [2023-12-28 05:19:20,668][106225] Updated weights for policy 1, policy_version 1403340 (0.0006) [2023-12-28 05:19:20,669][106226] Updated weights for policy 0, policy_version 1400162 (0.0008) [2023-12-28 05:19:20,732][106226] Updated weights for policy 0, policy_version 1400172 (0.0008) [2023-12-28 05:19:20,742][106225] Updated weights for policy 1, policy_version 1403350 (0.0007) [2023-12-28 05:19:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 717824000. Throughput: 0: 9801.6, 1: 9753.8. Samples: 717833280. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:21,175][105115] Avg episode reward: [(0, '-4.991'), (1, '-4.614')] [2023-12-28 05:19:21,484][106225] Updated weights for policy 1, policy_version 1403360 (0.0008) [2023-12-28 05:19:21,517][106226] Updated weights for policy 0, policy_version 1400182 (0.0008) [2023-12-28 05:19:21,541][106225] Updated weights for policy 1, policy_version 1403370 (0.0008) [2023-12-28 05:19:21,576][106226] Updated weights for policy 0, policy_version 1400192 (0.0008) [2023-12-28 05:19:21,601][106225] Updated weights for policy 1, policy_version 1403380 (0.0008) [2023-12-28 05:19:21,641][106226] Updated weights for policy 0, policy_version 1400202 (0.0007) [2023-12-28 05:19:22,276][106226] Updated weights for policy 0, policy_version 1400212 (0.0007) [2023-12-28 05:19:22,348][106226] Updated weights for policy 0, policy_version 1400222 (0.0008) [2023-12-28 05:19:22,402][106225] Updated weights for policy 1, policy_version 1403390 (0.0008) [2023-12-28 05:19:22,408][106226] Updated weights for policy 0, policy_version 1400232 (0.0007) [2023-12-28 05:19:22,464][106225] Updated weights for policy 1, policy_version 1403400 (0.0007) [2023-12-28 05:19:22,520][106225] Updated weights for policy 1, policy_version 1403410 (0.0005) [2023-12-28 05:19:23,155][106226] Updated weights for policy 0, policy_version 1400242 (0.0006) [2023-12-28 05:19:23,221][106226] Updated weights for policy 0, policy_version 1400252 (0.0005) [2023-12-28 05:19:23,232][106225] Updated weights for policy 1, policy_version 1403420 (0.0005) [2023-12-28 05:19:23,276][106226] Updated weights for policy 0, policy_version 1400262 (0.0007) [2023-12-28 05:19:23,284][106225] Updated weights for policy 1, policy_version 1403430 (0.0007) [2023-12-28 05:19:23,332][106226] Updated weights for policy 0, policy_version 1400272 (0.0008) [2023-12-28 05:19:23,333][106225] Updated weights for policy 1, policy_version 1403440 (0.0006) [2023-12-28 05:19:24,001][106226] Updated weights for policy 0, policy_version 1400282 (0.0011) [2023-12-28 05:19:24,023][106225] Updated weights for policy 1, policy_version 1403450 (0.0005) [2023-12-28 05:19:24,060][106226] Updated weights for policy 0, policy_version 1400292 (0.0010) [2023-12-28 05:19:24,081][106225] Updated weights for policy 1, policy_version 1403460 (0.0006) [2023-12-28 05:19:24,117][106226] Updated weights for policy 0, policy_version 1400302 (0.0011) [2023-12-28 05:19:24,142][106225] Updated weights for policy 1, policy_version 1403470 (0.0007) [2023-12-28 05:19:24,197][106225] Updated weights for policy 1, policy_version 1403480 (0.0008) [2023-12-28 05:19:24,792][106226] Updated weights for policy 0, policy_version 1400312 (0.0006) [2023-12-28 05:19:24,851][106226] Updated weights for policy 0, policy_version 1400322 (0.0008) [2023-12-28 05:19:24,905][106226] Updated weights for policy 0, policy_version 1400332 (0.0007) [2023-12-28 05:19:24,937][106225] Updated weights for policy 1, policy_version 1403490 (0.0008) [2023-12-28 05:19:24,998][106225] Updated weights for policy 1, policy_version 1403500 (0.0006) [2023-12-28 05:19:25,055][106225] Updated weights for policy 1, policy_version 1403510 (0.0005) [2023-12-28 05:19:25,588][106226] Updated weights for policy 0, policy_version 1400342 (0.0007) [2023-12-28 05:19:25,638][106226] Updated weights for policy 0, policy_version 1400352 (0.0008) [2023-12-28 05:19:25,694][106226] Updated weights for policy 0, policy_version 1400362 (0.0008) [2023-12-28 05:19:25,710][106225] Updated weights for policy 1, policy_version 1403520 (0.0006) [2023-12-28 05:19:25,780][106225] Updated weights for policy 1, policy_version 1403530 (0.0006) [2023-12-28 05:19:25,834][106225] Updated weights for policy 1, policy_version 1403540 (0.0007) [2023-12-28 05:19:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 717922304. Throughput: 0: 9812.7, 1: 9728.6. Samples: 717891624. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:26,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.623')] [2023-12-28 05:19:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001403544_359358464.pth... [2023-12-28 05:19:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001400368_358563840.pth... [2023-12-28 05:19:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001399216_358268928.pth [2023-12-28 05:19:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001402424_359071744.pth [2023-12-28 05:19:26,407][106226] Updated weights for policy 0, policy_version 1400372 (0.0008) [2023-12-28 05:19:26,423][106225] Updated weights for policy 1, policy_version 1403550 (0.0007) [2023-12-28 05:19:26,467][106226] Updated weights for policy 0, policy_version 1400382 (0.0010) [2023-12-28 05:19:26,480][106225] Updated weights for policy 1, policy_version 1403560 (0.0010) [2023-12-28 05:19:26,529][106225] Updated weights for policy 1, policy_version 1403570 (0.0009) [2023-12-28 05:19:26,531][106226] Updated weights for policy 0, policy_version 1400392 (0.0006) [2023-12-28 05:19:27,047][106226] Updated weights for policy 0, policy_version 1400402 (0.0005) [2023-12-28 05:19:27,107][106226] Updated weights for policy 0, policy_version 1400412 (0.0008) [2023-12-28 05:19:27,134][106225] Updated weights for policy 1, policy_version 1403580 (0.0010) [2023-12-28 05:19:27,151][106226] Updated weights for policy 0, policy_version 1400422 (0.0006) [2023-12-28 05:19:27,184][106225] Updated weights for policy 1, policy_version 1403590 (0.0010) [2023-12-28 05:19:27,199][106226] Updated weights for policy 0, policy_version 1400432 (0.0007) [2023-12-28 05:19:27,244][106225] Updated weights for policy 1, policy_version 1403600 (0.0010) [2023-12-28 05:19:27,883][106225] Updated weights for policy 1, policy_version 1403610 (0.0009) [2023-12-28 05:19:27,933][106225] Updated weights for policy 1, policy_version 1403620 (0.0005) [2023-12-28 05:19:27,935][106226] Updated weights for policy 0, policy_version 1400442 (0.0008) [2023-12-28 05:19:27,983][106225] Updated weights for policy 1, policy_version 1403630 (0.0005) [2023-12-28 05:19:28,000][106226] Updated weights for policy 0, policy_version 1400452 (0.0008) [2023-12-28 05:19:28,039][106225] Updated weights for policy 1, policy_version 1403640 (0.0005) [2023-12-28 05:19:28,066][106226] Updated weights for policy 0, policy_version 1400462 (0.0005) [2023-12-28 05:19:28,662][106225] Updated weights for policy 1, policy_version 1403650 (0.0010) [2023-12-28 05:19:28,673][106226] Updated weights for policy 0, policy_version 1400472 (0.0005) [2023-12-28 05:19:28,716][106225] Updated weights for policy 1, policy_version 1403660 (0.0010) [2023-12-28 05:19:28,735][106226] Updated weights for policy 0, policy_version 1400482 (0.0005) [2023-12-28 05:19:28,777][106225] Updated weights for policy 1, policy_version 1403670 (0.0010) [2023-12-28 05:19:28,793][106226] Updated weights for policy 0, policy_version 1400492 (0.0010) [2023-12-28 05:19:29,385][106226] Updated weights for policy 0, policy_version 1400502 (0.0009) [2023-12-28 05:19:29,445][106225] Updated weights for policy 1, policy_version 1403680 (0.0010) [2023-12-28 05:19:29,446][106226] Updated weights for policy 0, policy_version 1400512 (0.0009) [2023-12-28 05:19:29,500][106226] Updated weights for policy 0, policy_version 1400522 (0.0010) [2023-12-28 05:19:29,501][106225] Updated weights for policy 1, policy_version 1403690 (0.0010) [2023-12-28 05:19:29,557][106225] Updated weights for policy 1, policy_version 1403700 (0.0010) [2023-12-28 05:19:30,237][106226] Updated weights for policy 0, policy_version 1400532 (0.0009) [2023-12-28 05:19:30,287][106226] Updated weights for policy 0, policy_version 1400542 (0.0007) [2023-12-28 05:19:30,292][106225] Updated weights for policy 1, policy_version 1403710 (0.0010) [2023-12-28 05:19:30,346][106226] Updated weights for policy 0, policy_version 1400552 (0.0006) [2023-12-28 05:19:30,350][106225] Updated weights for policy 1, policy_version 1403720 (0.0010) [2023-12-28 05:19:30,408][106225] Updated weights for policy 1, policy_version 1403730 (0.0010) [2023-12-28 05:19:30,987][106226] Updated weights for policy 0, policy_version 1400562 (0.0009) [2023-12-28 05:19:31,051][106226] Updated weights for policy 0, policy_version 1400572 (0.0008) [2023-12-28 05:19:31,112][106226] Updated weights for policy 0, policy_version 1400582 (0.0008) [2023-12-28 05:19:31,114][106225] Updated weights for policy 1, policy_version 1403740 (0.0009) [2023-12-28 05:19:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 718020608. Throughput: 0: 9985.4, 1: 9843.8. Samples: 718017868. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:31,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.753')] [2023-12-28 05:19:31,180][106226] Updated weights for policy 0, policy_version 1400592 (0.0007) [2023-12-28 05:19:31,186][106225] Updated weights for policy 1, policy_version 1403750 (0.0007) [2023-12-28 05:19:31,240][106225] Updated weights for policy 1, policy_version 1403760 (0.0008) [2023-12-28 05:19:31,894][106225] Updated weights for policy 1, policy_version 1403770 (0.0007) [2023-12-28 05:19:31,954][106225] Updated weights for policy 1, policy_version 1403780 (0.0007) [2023-12-28 05:19:31,964][106226] Updated weights for policy 0, policy_version 1400602 (0.0007) [2023-12-28 05:19:32,012][106225] Updated weights for policy 1, policy_version 1403790 (0.0006) [2023-12-28 05:19:32,015][106226] Updated weights for policy 0, policy_version 1400612 (0.0007) [2023-12-28 05:19:32,071][106226] Updated weights for policy 0, policy_version 1400622 (0.0006) [2023-12-28 05:19:32,074][106225] Updated weights for policy 1, policy_version 1403800 (0.0007) [2023-12-28 05:19:32,699][106225] Updated weights for policy 1, policy_version 1403810 (0.0005) [2023-12-28 05:19:32,763][106225] Updated weights for policy 1, policy_version 1403820 (0.0008) [2023-12-28 05:19:32,794][106226] Updated weights for policy 0, policy_version 1400632 (0.0009) [2023-12-28 05:19:32,820][106225] Updated weights for policy 1, policy_version 1403830 (0.0006) [2023-12-28 05:19:32,850][106226] Updated weights for policy 0, policy_version 1400642 (0.0007) [2023-12-28 05:19:32,908][106226] Updated weights for policy 0, policy_version 1400652 (0.0008) [2023-12-28 05:19:33,426][106225] Updated weights for policy 1, policy_version 1403840 (0.0007) [2023-12-28 05:19:33,485][106225] Updated weights for policy 1, policy_version 1403850 (0.0008) [2023-12-28 05:19:33,541][106225] Updated weights for policy 1, policy_version 1403860 (0.0006) [2023-12-28 05:19:33,691][106226] Updated weights for policy 0, policy_version 1400662 (0.0008) [2023-12-28 05:19:33,750][106226] Updated weights for policy 0, policy_version 1400672 (0.0007) [2023-12-28 05:19:33,819][106226] Updated weights for policy 0, policy_version 1400682 (0.0005) [2023-12-28 05:19:34,265][106225] Updated weights for policy 1, policy_version 1403870 (0.0008) [2023-12-28 05:19:34,314][106225] Updated weights for policy 1, policy_version 1403880 (0.0008) [2023-12-28 05:19:34,365][106225] Updated weights for policy 1, policy_version 1403890 (0.0008) [2023-12-28 05:19:34,421][106226] Updated weights for policy 0, policy_version 1400692 (0.0006) [2023-12-28 05:19:34,473][106226] Updated weights for policy 0, policy_version 1400702 (0.0008) [2023-12-28 05:19:34,526][106226] Updated weights for policy 0, policy_version 1400712 (0.0008) [2023-12-28 05:19:35,090][106225] Updated weights for policy 1, policy_version 1403900 (0.0007) [2023-12-28 05:19:35,145][106225] Updated weights for policy 1, policy_version 1403910 (0.0005) [2023-12-28 05:19:35,201][106225] Updated weights for policy 1, policy_version 1403920 (0.0005) [2023-12-28 05:19:35,239][106226] Updated weights for policy 0, policy_version 1400722 (0.0008) [2023-12-28 05:19:35,286][106226] Updated weights for policy 0, policy_version 1400732 (0.0007) [2023-12-28 05:19:35,342][106226] Updated weights for policy 0, policy_version 1400742 (0.0008) [2023-12-28 05:19:35,401][106226] Updated weights for policy 0, policy_version 1400752 (0.0009) [2023-12-28 05:19:35,882][106225] Updated weights for policy 1, policy_version 1403930 (0.0007) [2023-12-28 05:19:35,943][106225] Updated weights for policy 1, policy_version 1403940 (0.0005) [2023-12-28 05:19:35,996][106225] Updated weights for policy 1, policy_version 1403950 (0.0005) [2023-12-28 05:19:36,043][106225] Updated weights for policy 1, policy_version 1403960 (0.0005) [2023-12-28 05:19:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 718127104. Throughput: 0: 9941.4, 1: 9899.0. Samples: 718137388. Policy #0 lag: (min: 30.0, avg: 33.0, max: 62.0) [2023-12-28 05:19:36,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.694')] [2023-12-28 05:19:36,195][106226] Updated weights for policy 0, policy_version 1400762 (0.0007) [2023-12-28 05:19:36,260][106226] Updated weights for policy 0, policy_version 1400772 (0.0007) [2023-12-28 05:19:36,317][106226] Updated weights for policy 0, policy_version 1400782 (0.0008) [2023-12-28 05:19:36,685][106225] Updated weights for policy 1, policy_version 1403970 (0.0009) [2023-12-28 05:19:36,736][106225] Updated weights for policy 1, policy_version 1403980 (0.0009) [2023-12-28 05:19:36,788][106225] Updated weights for policy 1, policy_version 1403990 (0.0006) [2023-12-28 05:19:37,085][106226] Updated weights for policy 0, policy_version 1400792 (0.0009) [2023-12-28 05:19:37,145][106226] Updated weights for policy 0, policy_version 1400802 (0.0006) [2023-12-28 05:19:37,195][106226] Updated weights for policy 0, policy_version 1400812 (0.0005) [2023-12-28 05:19:37,496][106225] Updated weights for policy 1, policy_version 1404000 (0.0007) [2023-12-28 05:19:37,552][106225] Updated weights for policy 1, policy_version 1404010 (0.0008) [2023-12-28 05:19:37,607][106225] Updated weights for policy 1, policy_version 1404020 (0.0008) [2023-12-28 05:19:37,924][106226] Updated weights for policy 0, policy_version 1400822 (0.0008) [2023-12-28 05:19:37,978][106226] Updated weights for policy 0, policy_version 1400832 (0.0008) [2023-12-28 05:19:38,034][106226] Updated weights for policy 0, policy_version 1400842 (0.0008) [2023-12-28 05:19:38,234][106225] Updated weights for policy 1, policy_version 1404030 (0.0007) [2023-12-28 05:19:38,288][106225] Updated weights for policy 1, policy_version 1404040 (0.0008) [2023-12-28 05:19:38,356][106225] Updated weights for policy 1, policy_version 1404050 (0.0008) [2023-12-28 05:19:38,758][106226] Updated weights for policy 0, policy_version 1400852 (0.0009) [2023-12-28 05:19:38,827][106226] Updated weights for policy 0, policy_version 1400862 (0.0008) [2023-12-28 05:19:38,890][106226] Updated weights for policy 0, policy_version 1400872 (0.0007) [2023-12-28 05:19:39,130][106225] Updated weights for policy 1, policy_version 1404060 (0.0009) [2023-12-28 05:19:39,193][106225] Updated weights for policy 1, policy_version 1404070 (0.0010) [2023-12-28 05:19:39,257][106225] Updated weights for policy 1, policy_version 1404080 (0.0008) [2023-12-28 05:19:39,668][106226] Updated weights for policy 0, policy_version 1400882 (0.0008) [2023-12-28 05:19:39,735][106226] Updated weights for policy 0, policy_version 1400892 (0.0011) [2023-12-28 05:19:39,804][106226] Updated weights for policy 0, policy_version 1400902 (0.0011) [2023-12-28 05:19:39,873][106226] Updated weights for policy 0, policy_version 1400912 (0.0009) [2023-12-28 05:19:39,966][106225] Updated weights for policy 1, policy_version 1404090 (0.0006) [2023-12-28 05:19:40,028][106225] Updated weights for policy 1, policy_version 1404100 (0.0007) [2023-12-28 05:19:40,086][106225] Updated weights for policy 1, policy_version 1404110 (0.0007) [2023-12-28 05:19:40,149][106225] Updated weights for policy 1, policy_version 1404120 (0.0006) [2023-12-28 05:19:40,606][106226] Updated weights for policy 0, policy_version 1400922 (0.0008) [2023-12-28 05:19:40,673][106226] Updated weights for policy 0, policy_version 1400932 (0.0008) [2023-12-28 05:19:40,743][106226] Updated weights for policy 0, policy_version 1400942 (0.0007) [2023-12-28 05:19:40,869][106225] Updated weights for policy 1, policy_version 1404130 (0.0006) [2023-12-28 05:19:40,939][106225] Updated weights for policy 1, policy_version 1404140 (0.0010) [2023-12-28 05:19:41,007][106225] Updated weights for policy 1, policy_version 1404150 (0.0010) [2023-12-28 05:19:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 718225408. Throughput: 0: 9966.8, 1: 9899.1. Samples: 718196044. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:19:41,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-4.726')] [2023-12-28 05:19:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001404152_359514112.pth... [2023-12-28 05:19:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001400944_358711296.pth... [2023-12-28 05:19:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001402968_359211008.pth [2023-12-28 05:19:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001399792_358416384.pth [2023-12-28 05:19:41,388][106226] Updated weights for policy 0, policy_version 1400952 (0.0008) [2023-12-28 05:19:41,449][106226] Updated weights for policy 0, policy_version 1400962 (0.0007) [2023-12-28 05:19:41,510][106226] Updated weights for policy 0, policy_version 1400972 (0.0009) [2023-12-28 05:19:41,760][106225] Updated weights for policy 1, policy_version 1404160 (0.0009) [2023-12-28 05:19:41,822][106225] Updated weights for policy 1, policy_version 1404170 (0.0009) [2023-12-28 05:19:41,877][106225] Updated weights for policy 1, policy_version 1404180 (0.0011) [2023-12-28 05:19:42,287][106226] Updated weights for policy 0, policy_version 1400982 (0.0009) [2023-12-28 05:19:42,354][106226] Updated weights for policy 0, policy_version 1400992 (0.0008) [2023-12-28 05:19:42,423][106226] Updated weights for policy 0, policy_version 1401002 (0.0008) [2023-12-28 05:19:42,668][106225] Updated weights for policy 1, policy_version 1404190 (0.0011) [2023-12-28 05:19:42,722][106225] Updated weights for policy 1, policy_version 1404200 (0.0010) [2023-12-28 05:19:42,773][106225] Updated weights for policy 1, policy_version 1404210 (0.0010) [2023-12-28 05:19:43,181][106226] Updated weights for policy 0, policy_version 1401012 (0.0008) [2023-12-28 05:19:43,230][106226] Updated weights for policy 0, policy_version 1401022 (0.0007) [2023-12-28 05:19:43,280][106226] Updated weights for policy 0, policy_version 1401032 (0.0008) [2023-12-28 05:19:43,520][106225] Updated weights for policy 1, policy_version 1404220 (0.0010) [2023-12-28 05:19:43,581][106225] Updated weights for policy 1, policy_version 1404230 (0.0010) [2023-12-28 05:19:43,642][106225] Updated weights for policy 1, policy_version 1404240 (0.0010) [2023-12-28 05:19:44,025][106226] Updated weights for policy 0, policy_version 1401042 (0.0009) [2023-12-28 05:19:44,074][106226] Updated weights for policy 0, policy_version 1401052 (0.0008) [2023-12-28 05:19:44,119][106226] Updated weights for policy 0, policy_version 1401062 (0.0007) [2023-12-28 05:19:44,175][106226] Updated weights for policy 0, policy_version 1401072 (0.0008) [2023-12-28 05:19:44,357][106225] Updated weights for policy 1, policy_version 1404250 (0.0010) [2023-12-28 05:19:44,410][106225] Updated weights for policy 1, policy_version 1404260 (0.0010) [2023-12-28 05:19:44,470][106225] Updated weights for policy 1, policy_version 1404270 (0.0010) [2023-12-28 05:19:44,534][106225] Updated weights for policy 1, policy_version 1404280 (0.0010) [2023-12-28 05:19:44,911][106226] Updated weights for policy 0, policy_version 1401082 (0.0008) [2023-12-28 05:19:44,977][106226] Updated weights for policy 0, policy_version 1401092 (0.0008) [2023-12-28 05:19:45,039][106226] Updated weights for policy 0, policy_version 1401102 (0.0008) [2023-12-28 05:19:45,255][106225] Updated weights for policy 1, policy_version 1404290 (0.0011) [2023-12-28 05:19:45,319][106225] Updated weights for policy 1, policy_version 1404300 (0.0011) [2023-12-28 05:19:45,383][106225] Updated weights for policy 1, policy_version 1404310 (0.0010) [2023-12-28 05:19:45,780][106226] Updated weights for policy 0, policy_version 1401112 (0.0008) [2023-12-28 05:19:45,838][106226] Updated weights for policy 0, policy_version 1401122 (0.0008) [2023-12-28 05:19:45,888][106226] Updated weights for policy 0, policy_version 1401132 (0.0008) [2023-12-28 05:19:46,092][106225] Updated weights for policy 1, policy_version 1404320 (0.0010) [2023-12-28 05:19:46,159][106225] Updated weights for policy 1, policy_version 1404330 (0.0010) [2023-12-28 05:19:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 718315520. Throughput: 0: 9838.9, 1: 9896.5. Samples: 718307956. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:19:46,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-4.781')] [2023-12-28 05:19:46,219][106225] Updated weights for policy 1, policy_version 1404340 (0.0010) [2023-12-28 05:19:46,620][106226] Updated weights for policy 0, policy_version 1401142 (0.0008) [2023-12-28 05:19:46,684][106226] Updated weights for policy 0, policy_version 1401152 (0.0008) [2023-12-28 05:19:46,739][106226] Updated weights for policy 0, policy_version 1401162 (0.0007) [2023-12-28 05:19:46,926][106225] Updated weights for policy 1, policy_version 1404350 (0.0010) [2023-12-28 05:19:46,976][106225] Updated weights for policy 1, policy_version 1404360 (0.0010) [2023-12-28 05:19:47,027][106225] Updated weights for policy 1, policy_version 1404370 (0.0010) [2023-12-28 05:19:47,463][106226] Updated weights for policy 0, policy_version 1401172 (0.0009) [2023-12-28 05:19:47,523][106226] Updated weights for policy 0, policy_version 1401182 (0.0009) [2023-12-28 05:19:47,584][106226] Updated weights for policy 0, policy_version 1401192 (0.0009) [2023-12-28 05:19:47,740][106225] Updated weights for policy 1, policy_version 1404380 (0.0009) [2023-12-28 05:19:47,785][106225] Updated weights for policy 1, policy_version 1404390 (0.0008) [2023-12-28 05:19:47,834][106225] Updated weights for policy 1, policy_version 1404400 (0.0008) [2023-12-28 05:19:48,272][106226] Updated weights for policy 0, policy_version 1401202 (0.0008) [2023-12-28 05:19:48,338][106226] Updated weights for policy 0, policy_version 1401212 (0.0009) [2023-12-28 05:19:48,403][106226] Updated weights for policy 0, policy_version 1401222 (0.0007) [2023-12-28 05:19:48,466][106226] Updated weights for policy 0, policy_version 1401232 (0.0008) [2023-12-28 05:19:48,611][106225] Updated weights for policy 1, policy_version 1404410 (0.0009) [2023-12-28 05:19:48,677][106225] Updated weights for policy 1, policy_version 1404420 (0.0011) [2023-12-28 05:19:48,734][106225] Updated weights for policy 1, policy_version 1404430 (0.0010) [2023-12-28 05:19:48,797][106225] Updated weights for policy 1, policy_version 1404440 (0.0011) [2023-12-28 05:19:49,103][106226] Updated weights for policy 0, policy_version 1401242 (0.0005) [2023-12-28 05:19:49,163][106226] Updated weights for policy 0, policy_version 1401252 (0.0005) [2023-12-28 05:19:49,235][106226] Updated weights for policy 0, policy_version 1401262 (0.0006) [2023-12-28 05:19:49,569][106225] Updated weights for policy 1, policy_version 1404450 (0.0008) [2023-12-28 05:19:49,633][106225] Updated weights for policy 1, policy_version 1404460 (0.0008) [2023-12-28 05:19:49,699][106225] Updated weights for policy 1, policy_version 1404470 (0.0009) [2023-12-28 05:19:49,866][106226] Updated weights for policy 0, policy_version 1401272 (0.0009) [2023-12-28 05:19:49,918][106226] Updated weights for policy 0, policy_version 1401282 (0.0008) [2023-12-28 05:19:49,981][106226] Updated weights for policy 0, policy_version 1401292 (0.0008) [2023-12-28 05:19:50,492][106225] Updated weights for policy 1, policy_version 1404480 (0.0008) [2023-12-28 05:19:50,542][106225] Updated weights for policy 1, policy_version 1404490 (0.0008) [2023-12-28 05:19:50,607][106225] Updated weights for policy 1, policy_version 1404500 (0.0009) [2023-12-28 05:19:50,706][106226] Updated weights for policy 0, policy_version 1401302 (0.0008) [2023-12-28 05:19:50,762][106226] Updated weights for policy 0, policy_version 1401312 (0.0008) [2023-12-28 05:19:50,811][106226] Updated weights for policy 0, policy_version 1401322 (0.0008) [2023-12-28 05:19:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 718413824. Throughput: 0: 9833.3, 1: 9791.5. Samples: 718423212. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:19:51,175][105115] Avg episode reward: [(0, '-4.952'), (1, '-4.664')] [2023-12-28 05:19:51,402][106225] Updated weights for policy 1, policy_version 1404510 (0.0009) [2023-12-28 05:19:51,459][106225] Updated weights for policy 1, policy_version 1404520 (0.0007) [2023-12-28 05:19:51,526][106225] Updated weights for policy 1, policy_version 1404530 (0.0005) [2023-12-28 05:19:51,612][106226] Updated weights for policy 0, policy_version 1401332 (0.0009) [2023-12-28 05:19:51,675][106226] Updated weights for policy 0, policy_version 1401342 (0.0008) [2023-12-28 05:19:51,735][106226] Updated weights for policy 0, policy_version 1401352 (0.0008) [2023-12-28 05:19:52,154][106225] Updated weights for policy 1, policy_version 1404540 (0.0008) [2023-12-28 05:19:52,213][106225] Updated weights for policy 1, policy_version 1404550 (0.0008) [2023-12-28 05:19:52,273][106225] Updated weights for policy 1, policy_version 1404560 (0.0009) [2023-12-28 05:19:52,562][106226] Updated weights for policy 0, policy_version 1401362 (0.0008) [2023-12-28 05:19:52,630][106226] Updated weights for policy 0, policy_version 1401372 (0.0005) [2023-12-28 05:19:52,695][106226] Updated weights for policy 0, policy_version 1401382 (0.0006) [2023-12-28 05:19:52,755][106226] Updated weights for policy 0, policy_version 1401392 (0.0006) [2023-12-28 05:19:53,015][106225] Updated weights for policy 1, policy_version 1404570 (0.0010) [2023-12-28 05:19:53,076][106225] Updated weights for policy 1, policy_version 1404580 (0.0010) [2023-12-28 05:19:53,137][106225] Updated weights for policy 1, policy_version 1404590 (0.0010) [2023-12-28 05:19:53,194][106225] Updated weights for policy 1, policy_version 1404600 (0.0010) [2023-12-28 05:19:53,314][106226] Updated weights for policy 0, policy_version 1401402 (0.0008) [2023-12-28 05:19:53,360][106226] Updated weights for policy 0, policy_version 1401412 (0.0007) [2023-12-28 05:19:53,412][106226] Updated weights for policy 0, policy_version 1401422 (0.0008) [2023-12-28 05:19:53,808][106225] Updated weights for policy 1, policy_version 1404610 (0.0006) [2023-12-28 05:19:53,865][106225] Updated weights for policy 1, policy_version 1404620 (0.0005) [2023-12-28 05:19:53,926][106225] Updated weights for policy 1, policy_version 1404630 (0.0008) [2023-12-28 05:19:54,056][106226] Updated weights for policy 0, policy_version 1401432 (0.0005) [2023-12-28 05:19:54,104][106226] Updated weights for policy 0, policy_version 1401442 (0.0005) [2023-12-28 05:19:54,150][106226] Updated weights for policy 0, policy_version 1401452 (0.0009) [2023-12-28 05:19:54,546][106225] Updated weights for policy 1, policy_version 1404640 (0.0010) [2023-12-28 05:19:54,589][106225] Updated weights for policy 1, policy_version 1404650 (0.0010) [2023-12-28 05:19:54,639][106225] Updated weights for policy 1, policy_version 1404660 (0.0010) [2023-12-28 05:19:54,823][106226] Updated weights for policy 0, policy_version 1401462 (0.0010) [2023-12-28 05:19:54,869][106226] Updated weights for policy 0, policy_version 1401472 (0.0010) [2023-12-28 05:19:54,928][106226] Updated weights for policy 0, policy_version 1401482 (0.0011) [2023-12-28 05:19:55,326][106225] Updated weights for policy 1, policy_version 1404670 (0.0010) [2023-12-28 05:19:55,381][106225] Updated weights for policy 1, policy_version 1404680 (0.0010) [2023-12-28 05:19:55,430][106225] Updated weights for policy 1, policy_version 1404690 (0.0010) [2023-12-28 05:19:55,648][106226] Updated weights for policy 0, policy_version 1401492 (0.0008) [2023-12-28 05:19:55,703][106226] Updated weights for policy 0, policy_version 1401502 (0.0005) [2023-12-28 05:19:55,753][106226] Updated weights for policy 0, policy_version 1401512 (0.0005) [2023-12-28 05:19:56,093][106225] Updated weights for policy 1, policy_version 1404700 (0.0010) [2023-12-28 05:19:56,139][106225] Updated weights for policy 1, policy_version 1404710 (0.0010) [2023-12-28 05:19:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 718512128. Throughput: 0: 9824.6, 1: 9824.6. Samples: 718483948. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:19:56,176][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.984')] [2023-12-28 05:19:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001401520_358858752.pth... [2023-12-28 05:19:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001400368_358563840.pth [2023-12-28 05:19:56,199][106225] Updated weights for policy 1, policy_version 1404720 (0.0010) [2023-12-28 05:19:56,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001404728_359661568.pth... [2023-12-28 05:19:56,242][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001403544_359358464.pth [2023-12-28 05:19:56,300][106226] Updated weights for policy 0, policy_version 1401522 (0.0006) [2023-12-28 05:19:56,366][106226] Updated weights for policy 0, policy_version 1401532 (0.0009) [2023-12-28 05:19:56,432][106226] Updated weights for policy 0, policy_version 1401542 (0.0007) [2023-12-28 05:19:56,491][106226] Updated weights for policy 0, policy_version 1401552 (0.0008) [2023-12-28 05:19:56,854][106225] Updated weights for policy 1, policy_version 1404730 (0.0009) [2023-12-28 05:19:56,901][106225] Updated weights for policy 1, policy_version 1404740 (0.0005) [2023-12-28 05:19:56,945][106225] Updated weights for policy 1, policy_version 1404750 (0.0009) [2023-12-28 05:19:56,998][106225] Updated weights for policy 1, policy_version 1404760 (0.0010) [2023-12-28 05:19:57,105][106226] Updated weights for policy 0, policy_version 1401562 (0.0005) [2023-12-28 05:19:57,151][106226] Updated weights for policy 0, policy_version 1401572 (0.0005) [2023-12-28 05:19:57,212][106226] Updated weights for policy 0, policy_version 1401582 (0.0005) [2023-12-28 05:19:57,681][106225] Updated weights for policy 1, policy_version 1404770 (0.0005) [2023-12-28 05:19:57,740][106225] Updated weights for policy 1, policy_version 1404780 (0.0008) [2023-12-28 05:19:57,795][106225] Updated weights for policy 1, policy_version 1404790 (0.0010) [2023-12-28 05:19:57,836][106226] Updated weights for policy 0, policy_version 1401592 (0.0009) [2023-12-28 05:19:57,898][106226] Updated weights for policy 0, policy_version 1401602 (0.0010) [2023-12-28 05:19:57,957][106226] Updated weights for policy 0, policy_version 1401612 (0.0007) [2023-12-28 05:19:58,466][106225] Updated weights for policy 1, policy_version 1404800 (0.0009) [2023-12-28 05:19:58,534][106225] Updated weights for policy 1, policy_version 1404810 (0.0008) [2023-12-28 05:19:58,594][106225] Updated weights for policy 1, policy_version 1404820 (0.0009) [2023-12-28 05:19:58,743][106226] Updated weights for policy 0, policy_version 1401622 (0.0009) [2023-12-28 05:19:58,805][106226] Updated weights for policy 0, policy_version 1401632 (0.0008) [2023-12-28 05:19:58,869][106226] Updated weights for policy 0, policy_version 1401642 (0.0009) [2023-12-28 05:19:59,423][106225] Updated weights for policy 1, policy_version 1404830 (0.0009) [2023-12-28 05:19:59,483][106225] Updated weights for policy 1, policy_version 1404840 (0.0010) [2023-12-28 05:19:59,543][106225] Updated weights for policy 1, policy_version 1404850 (0.0010) [2023-12-28 05:19:59,686][106226] Updated weights for policy 0, policy_version 1401652 (0.0008) [2023-12-28 05:19:59,746][106226] Updated weights for policy 0, policy_version 1401662 (0.0011) [2023-12-28 05:19:59,797][106226] Updated weights for policy 0, policy_version 1401672 (0.0010) [2023-12-28 05:20:00,167][106225] Updated weights for policy 1, policy_version 1404860 (0.0007) [2023-12-28 05:20:00,228][106225] Updated weights for policy 1, policy_version 1404870 (0.0009) [2023-12-28 05:20:00,285][106225] Updated weights for policy 1, policy_version 1404880 (0.0010) [2023-12-28 05:20:00,493][106226] Updated weights for policy 0, policy_version 1401682 (0.0008) [2023-12-28 05:20:00,547][106226] Updated weights for policy 0, policy_version 1401692 (0.0006) [2023-12-28 05:20:00,605][106226] Updated weights for policy 0, policy_version 1401702 (0.0007) [2023-12-28 05:20:00,656][106226] Updated weights for policy 0, policy_version 1401712 (0.0009) [2023-12-28 05:20:00,870][106225] Updated weights for policy 1, policy_version 1404890 (0.0010) [2023-12-28 05:20:00,930][106225] Updated weights for policy 1, policy_version 1404900 (0.0008) [2023-12-28 05:20:00,985][106225] Updated weights for policy 1, policy_version 1404910 (0.0005) [2023-12-28 05:20:01,055][106225] Updated weights for policy 1, policy_version 1404920 (0.0006) [2023-12-28 05:20:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 718618624. Throughput: 0: 9887.2, 1: 9908.7. Samples: 718604912. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:01,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.591')] [2023-12-28 05:20:01,403][106226] Updated weights for policy 0, policy_version 1401722 (0.0007) [2023-12-28 05:20:01,462][106226] Updated weights for policy 0, policy_version 1401732 (0.0008) [2023-12-28 05:20:01,523][106226] Updated weights for policy 0, policy_version 1401742 (0.0009) [2023-12-28 05:20:01,801][106225] Updated weights for policy 1, policy_version 1404930 (0.0006) [2023-12-28 05:20:01,853][106225] Updated weights for policy 1, policy_version 1404940 (0.0008) [2023-12-28 05:20:01,902][106225] Updated weights for policy 1, policy_version 1404950 (0.0008) [2023-12-28 05:20:02,290][106226] Updated weights for policy 0, policy_version 1401752 (0.0008) [2023-12-28 05:20:02,361][106226] Updated weights for policy 0, policy_version 1401762 (0.0009) [2023-12-28 05:20:02,428][106226] Updated weights for policy 0, policy_version 1401772 (0.0007) [2023-12-28 05:20:02,532][106225] Updated weights for policy 1, policy_version 1404960 (0.0007) [2023-12-28 05:20:02,578][106225] Updated weights for policy 1, policy_version 1404970 (0.0008) [2023-12-28 05:20:02,632][106225] Updated weights for policy 1, policy_version 1404980 (0.0007) [2023-12-28 05:20:03,150][106226] Updated weights for policy 0, policy_version 1401782 (0.0008) [2023-12-28 05:20:03,201][106226] Updated weights for policy 0, policy_version 1401792 (0.0008) [2023-12-28 05:20:03,252][106226] Updated weights for policy 0, policy_version 1401802 (0.0008) [2023-12-28 05:20:03,362][106225] Updated weights for policy 1, policy_version 1404990 (0.0008) [2023-12-28 05:20:03,409][106225] Updated weights for policy 1, policy_version 1405000 (0.0008) [2023-12-28 05:20:03,462][106225] Updated weights for policy 1, policy_version 1405010 (0.0007) [2023-12-28 05:20:03,993][106226] Updated weights for policy 0, policy_version 1401812 (0.0009) [2023-12-28 05:20:04,054][106226] Updated weights for policy 0, policy_version 1401822 (0.0009) [2023-12-28 05:20:04,119][106226] Updated weights for policy 0, policy_version 1401832 (0.0008) [2023-12-28 05:20:04,163][106225] Updated weights for policy 1, policy_version 1405020 (0.0007) [2023-12-28 05:20:04,226][106225] Updated weights for policy 1, policy_version 1405030 (0.0007) [2023-12-28 05:20:04,292][106225] Updated weights for policy 1, policy_version 1405040 (0.0008) [2023-12-28 05:20:04,877][106226] Updated weights for policy 0, policy_version 1401842 (0.0008) [2023-12-28 05:20:04,933][106226] Updated weights for policy 0, policy_version 1401852 (0.0007) [2023-12-28 05:20:04,976][106225] Updated weights for policy 1, policy_version 1405050 (0.0008) [2023-12-28 05:20:04,984][106226] Updated weights for policy 0, policy_version 1401862 (0.0008) [2023-12-28 05:20:05,026][106225] Updated weights for policy 1, policy_version 1405060 (0.0006) [2023-12-28 05:20:05,045][106226] Updated weights for policy 0, policy_version 1401872 (0.0009) [2023-12-28 05:20:05,084][106225] Updated weights for policy 1, policy_version 1405070 (0.0006) [2023-12-28 05:20:05,129][106225] Updated weights for policy 1, policy_version 1405080 (0.0008) [2023-12-28 05:20:05,780][106225] Updated weights for policy 1, policy_version 1405090 (0.0010) [2023-12-28 05:20:05,824][106226] Updated weights for policy 0, policy_version 1401882 (0.0007) [2023-12-28 05:20:05,839][106225] Updated weights for policy 1, policy_version 1405100 (0.0010) [2023-12-28 05:20:05,883][106226] Updated weights for policy 0, policy_version 1401892 (0.0007) [2023-12-28 05:20:05,896][106225] Updated weights for policy 1, policy_version 1405110 (0.0010) [2023-12-28 05:20:05,931][106226] Updated weights for policy 0, policy_version 1401902 (0.0006) [2023-12-28 05:20:06,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 718716928. Throughput: 0: 9811.1, 1: 9995.3. Samples: 718724564. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:06,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.840')] [2023-12-28 05:20:06,569][106226] Updated weights for policy 0, policy_version 1401912 (0.0007) [2023-12-28 05:20:06,636][106225] Updated weights for policy 1, policy_version 1405120 (0.0011) [2023-12-28 05:20:06,639][106226] Updated weights for policy 0, policy_version 1401922 (0.0007) [2023-12-28 05:20:06,696][106226] Updated weights for policy 0, policy_version 1401932 (0.0006) [2023-12-28 05:20:06,698][106225] Updated weights for policy 1, policy_version 1405130 (0.0008) [2023-12-28 05:20:06,760][106225] Updated weights for policy 1, policy_version 1405140 (0.0009) [2023-12-28 05:20:07,382][106226] Updated weights for policy 0, policy_version 1401942 (0.0007) [2023-12-28 05:20:07,429][106226] Updated weights for policy 0, policy_version 1401952 (0.0009) [2023-12-28 05:20:07,465][106225] Updated weights for policy 1, policy_version 1405150 (0.0009) [2023-12-28 05:20:07,480][106226] Updated weights for policy 0, policy_version 1401962 (0.0008) [2023-12-28 05:20:07,517][106225] Updated weights for policy 1, policy_version 1405160 (0.0007) [2023-12-28 05:20:07,573][106225] Updated weights for policy 1, policy_version 1405170 (0.0008) [2023-12-28 05:20:08,137][106226] Updated weights for policy 0, policy_version 1401972 (0.0005) [2023-12-28 05:20:08,193][106226] Updated weights for policy 0, policy_version 1401982 (0.0007) [2023-12-28 05:20:08,246][106226] Updated weights for policy 0, policy_version 1401992 (0.0006) [2023-12-28 05:20:08,271][106225] Updated weights for policy 1, policy_version 1405180 (0.0009) [2023-12-28 05:20:08,327][106225] Updated weights for policy 1, policy_version 1405190 (0.0011) [2023-12-28 05:20:08,396][106225] Updated weights for policy 1, policy_version 1405201 (0.0007) [2023-12-28 05:20:08,928][106226] Updated weights for policy 0, policy_version 1402002 (0.0006) [2023-12-28 05:20:08,984][106226] Updated weights for policy 0, policy_version 1402012 (0.0010) [2023-12-28 05:20:09,047][106226] Updated weights for policy 0, policy_version 1402022 (0.0010) [2023-12-28 05:20:09,108][106226] Updated weights for policy 0, policy_version 1402032 (0.0010) [2023-12-28 05:20:09,119][106225] Updated weights for policy 1, policy_version 1405211 (0.0008) [2023-12-28 05:20:09,185][106225] Updated weights for policy 1, policy_version 1405221 (0.0005) [2023-12-28 05:20:09,256][106225] Updated weights for policy 1, policy_version 1405231 (0.0007) [2023-12-28 05:20:09,857][106226] Updated weights for policy 0, policy_version 1402042 (0.0010) [2023-12-28 05:20:09,923][106226] Updated weights for policy 0, policy_version 1402052 (0.0008) [2023-12-28 05:20:09,981][106226] Updated weights for policy 0, policy_version 1402062 (0.0010) [2023-12-28 05:20:10,015][106225] Updated weights for policy 1, policy_version 1405241 (0.0007) [2023-12-28 05:20:10,083][106225] Updated weights for policy 1, policy_version 1405251 (0.0009) [2023-12-28 05:20:10,149][106225] Updated weights for policy 1, policy_version 1405261 (0.0008) [2023-12-28 05:20:10,220][106225] Updated weights for policy 1, policy_version 1405271 (0.0011) [2023-12-28 05:20:10,684][106226] Updated weights for policy 0, policy_version 1402072 (0.0006) [2023-12-28 05:20:10,748][106226] Updated weights for policy 0, policy_version 1402082 (0.0008) [2023-12-28 05:20:10,802][106226] Updated weights for policy 0, policy_version 1402092 (0.0010) [2023-12-28 05:20:10,954][106225] Updated weights for policy 1, policy_version 1405281 (0.0006) [2023-12-28 05:20:11,011][106225] Updated weights for policy 1, policy_version 1405291 (0.0005) [2023-12-28 05:20:11,079][106225] Updated weights for policy 1, policy_version 1405301 (0.0008) [2023-12-28 05:20:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 718815232. Throughput: 0: 9835.3, 1: 9994.4. Samples: 718783960. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:11,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.747')] [2023-12-28 05:20:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001405304_359809024.pth... [2023-12-28 05:20:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001402096_359006208.pth... [2023-12-28 05:20:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001404152_359514112.pth [2023-12-28 05:20:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001400944_358711296.pth [2023-12-28 05:20:11,568][106226] Updated weights for policy 0, policy_version 1402102 (0.0010) [2023-12-28 05:20:11,634][106226] Updated weights for policy 0, policy_version 1402112 (0.0008) [2023-12-28 05:20:11,704][106226] Updated weights for policy 0, policy_version 1402122 (0.0007) [2023-12-28 05:20:11,885][106225] Updated weights for policy 1, policy_version 1405311 (0.0009) [2023-12-28 05:20:11,948][106225] Updated weights for policy 1, policy_version 1405321 (0.0009) [2023-12-28 05:20:12,012][106225] Updated weights for policy 1, policy_version 1405331 (0.0009) [2023-12-28 05:20:12,400][106226] Updated weights for policy 0, policy_version 1402132 (0.0008) [2023-12-28 05:20:12,459][106226] Updated weights for policy 0, policy_version 1402142 (0.0008) [2023-12-28 05:20:12,524][106226] Updated weights for policy 0, policy_version 1402152 (0.0008) [2023-12-28 05:20:12,804][106225] Updated weights for policy 1, policy_version 1405341 (0.0010) [2023-12-28 05:20:12,851][106225] Updated weights for policy 1, policy_version 1405351 (0.0010) [2023-12-28 05:20:12,898][106225] Updated weights for policy 1, policy_version 1405361 (0.0010) [2023-12-28 05:20:13,314][106226] Updated weights for policy 0, policy_version 1402162 (0.0009) [2023-12-28 05:20:13,372][106226] Updated weights for policy 0, policy_version 1402172 (0.0009) [2023-12-28 05:20:13,431][106226] Updated weights for policy 0, policy_version 1402182 (0.0008) [2023-12-28 05:20:13,483][106226] Updated weights for policy 0, policy_version 1402192 (0.0008) [2023-12-28 05:20:13,546][106225] Updated weights for policy 1, policy_version 1405371 (0.0010) [2023-12-28 05:20:13,611][106225] Updated weights for policy 1, policy_version 1405381 (0.0006) [2023-12-28 05:20:13,665][106225] Updated weights for policy 1, policy_version 1405391 (0.0009) [2023-12-28 05:20:14,315][106226] Updated weights for policy 0, policy_version 1402202 (0.0009) [2023-12-28 05:20:14,327][106225] Updated weights for policy 1, policy_version 1405401 (0.0008) [2023-12-28 05:20:14,371][106226] Updated weights for policy 0, policy_version 1402212 (0.0008) [2023-12-28 05:20:14,391][106225] Updated weights for policy 1, policy_version 1405411 (0.0008) [2023-12-28 05:20:14,426][106226] Updated weights for policy 0, policy_version 1402222 (0.0009) [2023-12-28 05:20:14,449][106225] Updated weights for policy 1, policy_version 1405421 (0.0006) [2023-12-28 05:20:14,500][106225] Updated weights for policy 1, policy_version 1405431 (0.0006) [2023-12-28 05:20:15,047][106226] Updated weights for policy 0, policy_version 1402232 (0.0008) [2023-12-28 05:20:15,110][106226] Updated weights for policy 0, policy_version 1402242 (0.0008) [2023-12-28 05:20:15,174][106226] Updated weights for policy 0, policy_version 1402252 (0.0009) [2023-12-28 05:20:15,231][106225] Updated weights for policy 1, policy_version 1405441 (0.0007) [2023-12-28 05:20:15,295][106225] Updated weights for policy 1, policy_version 1405451 (0.0006) [2023-12-28 05:20:15,353][106225] Updated weights for policy 1, policy_version 1405461 (0.0006) [2023-12-28 05:20:15,779][106226] Updated weights for policy 0, policy_version 1402262 (0.0008) [2023-12-28 05:20:15,826][106226] Updated weights for policy 0, policy_version 1402272 (0.0006) [2023-12-28 05:20:15,881][106226] Updated weights for policy 0, policy_version 1402282 (0.0005) [2023-12-28 05:20:15,948][106225] Updated weights for policy 1, policy_version 1405471 (0.0005) [2023-12-28 05:20:15,998][106225] Updated weights for policy 1, policy_version 1405481 (0.0005) [2023-12-28 05:20:16,054][106225] Updated weights for policy 1, policy_version 1405491 (0.0006) [2023-12-28 05:20:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 718913536. Throughput: 0: 9699.2, 1: 9863.6. Samples: 718898192. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:16,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.674')] [2023-12-28 05:20:16,481][106226] Updated weights for policy 0, policy_version 1402292 (0.0006) [2023-12-28 05:20:16,538][106226] Updated weights for policy 0, policy_version 1402302 (0.0005) [2023-12-28 05:20:16,601][106226] Updated weights for policy 0, policy_version 1402312 (0.0007) [2023-12-28 05:20:16,641][106225] Updated weights for policy 1, policy_version 1405501 (0.0009) [2023-12-28 05:20:16,693][106225] Updated weights for policy 1, policy_version 1405511 (0.0005) [2023-12-28 05:20:16,754][106225] Updated weights for policy 1, policy_version 1405521 (0.0005) [2023-12-28 05:20:17,331][106226] Updated weights for policy 0, policy_version 1402322 (0.0007) [2023-12-28 05:20:17,380][106226] Updated weights for policy 0, policy_version 1402332 (0.0007) [2023-12-28 05:20:17,416][106225] Updated weights for policy 1, policy_version 1405531 (0.0008) [2023-12-28 05:20:17,440][106226] Updated weights for policy 0, policy_version 1402342 (0.0007) [2023-12-28 05:20:17,476][106225] Updated weights for policy 1, policy_version 1405541 (0.0010) [2023-12-28 05:20:17,490][106226] Updated weights for policy 0, policy_version 1402352 (0.0006) [2023-12-28 05:20:17,532][106225] Updated weights for policy 1, policy_version 1405551 (0.0010) [2023-12-28 05:20:18,087][106226] Updated weights for policy 0, policy_version 1402362 (0.0005) [2023-12-28 05:20:18,103][106225] Updated weights for policy 1, policy_version 1405561 (0.0010) [2023-12-28 05:20:18,149][106226] Updated weights for policy 0, policy_version 1402372 (0.0006) [2023-12-28 05:20:18,158][106225] Updated weights for policy 1, policy_version 1405571 (0.0010) [2023-12-28 05:20:18,209][106226] Updated weights for policy 0, policy_version 1402382 (0.0007) [2023-12-28 05:20:18,211][106225] Updated weights for policy 1, policy_version 1405581 (0.0007) [2023-12-28 05:20:18,260][106225] Updated weights for policy 1, policy_version 1405591 (0.0010) [2023-12-28 05:20:18,926][106225] Updated weights for policy 1, policy_version 1405601 (0.0010) [2023-12-28 05:20:18,951][106226] Updated weights for policy 0, policy_version 1402392 (0.0007) [2023-12-28 05:20:18,981][106225] Updated weights for policy 1, policy_version 1405611 (0.0006) [2023-12-28 05:20:19,010][106226] Updated weights for policy 0, policy_version 1402402 (0.0009) [2023-12-28 05:20:19,032][106225] Updated weights for policy 1, policy_version 1405621 (0.0006) [2023-12-28 05:20:19,072][106226] Updated weights for policy 0, policy_version 1402412 (0.0011) [2023-12-28 05:20:19,762][106225] Updated weights for policy 1, policy_version 1405631 (0.0007) [2023-12-28 05:20:19,824][106226] Updated weights for policy 0, policy_version 1402422 (0.0009) [2023-12-28 05:20:19,826][106225] Updated weights for policy 1, policy_version 1405641 (0.0008) [2023-12-28 05:20:19,892][106226] Updated weights for policy 0, policy_version 1402432 (0.0008) [2023-12-28 05:20:19,895][106225] Updated weights for policy 1, policy_version 1405651 (0.0007) [2023-12-28 05:20:19,967][106226] Updated weights for policy 0, policy_version 1402442 (0.0007) [2023-12-28 05:20:20,647][106225] Updated weights for policy 1, policy_version 1405661 (0.0008) [2023-12-28 05:20:20,673][106226] Updated weights for policy 0, policy_version 1402452 (0.0006) [2023-12-28 05:20:20,710][106225] Updated weights for policy 1, policy_version 1405671 (0.0008) [2023-12-28 05:20:20,731][106226] Updated weights for policy 0, policy_version 1402462 (0.0009) [2023-12-28 05:20:20,772][106225] Updated weights for policy 1, policy_version 1405681 (0.0007) [2023-12-28 05:20:20,794][106226] Updated weights for policy 0, policy_version 1402472 (0.0006) [2023-12-28 05:20:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 719011840. Throughput: 0: 9744.0, 1: 9884.7. Samples: 719020680. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:21,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.781')] [2023-12-28 05:20:21,481][106225] Updated weights for policy 1, policy_version 1405691 (0.0006) [2023-12-28 05:20:21,552][106225] Updated weights for policy 1, policy_version 1405701 (0.0006) [2023-12-28 05:20:21,576][106226] Updated weights for policy 0, policy_version 1402482 (0.0009) [2023-12-28 05:20:21,617][106225] Updated weights for policy 1, policy_version 1405711 (0.0006) [2023-12-28 05:20:21,639][106226] Updated weights for policy 0, policy_version 1402492 (0.0011) [2023-12-28 05:20:21,706][106226] Updated weights for policy 0, policy_version 1402502 (0.0011) [2023-12-28 05:20:21,781][106226] Updated weights for policy 0, policy_version 1402512 (0.0011) [2023-12-28 05:20:22,285][106225] Updated weights for policy 1, policy_version 1405721 (0.0007) [2023-12-28 05:20:22,357][106225] Updated weights for policy 1, policy_version 1405731 (0.0008) [2023-12-28 05:20:22,420][106225] Updated weights for policy 1, policy_version 1405741 (0.0009) [2023-12-28 05:20:22,441][106226] Updated weights for policy 0, policy_version 1402522 (0.0006) [2023-12-28 05:20:22,481][106225] Updated weights for policy 1, policy_version 1405751 (0.0008) [2023-12-28 05:20:22,509][106226] Updated weights for policy 0, policy_version 1402532 (0.0006) [2023-12-28 05:20:22,577][106226] Updated weights for policy 0, policy_version 1402542 (0.0006) [2023-12-28 05:20:23,129][106226] Updated weights for policy 0, policy_version 1402552 (0.0006) [2023-12-28 05:20:23,181][106226] Updated weights for policy 0, policy_version 1402562 (0.0006) [2023-12-28 05:20:23,198][106225] Updated weights for policy 1, policy_version 1405761 (0.0011) [2023-12-28 05:20:23,239][106226] Updated weights for policy 0, policy_version 1402572 (0.0006) [2023-12-28 05:20:23,255][106225] Updated weights for policy 1, policy_version 1405771 (0.0010) [2023-12-28 05:20:23,318][106225] Updated weights for policy 1, policy_version 1405781 (0.0010) [2023-12-28 05:20:23,811][106226] Updated weights for policy 0, policy_version 1402582 (0.0010) [2023-12-28 05:20:23,874][106226] Updated weights for policy 0, policy_version 1402592 (0.0009) [2023-12-28 05:20:23,934][106226] Updated weights for policy 0, policy_version 1402602 (0.0008) [2023-12-28 05:20:23,941][106225] Updated weights for policy 1, policy_version 1405791 (0.0007) [2023-12-28 05:20:23,999][106225] Updated weights for policy 1, policy_version 1405801 (0.0007) [2023-12-28 05:20:24,049][106225] Updated weights for policy 1, policy_version 1405811 (0.0009) [2023-12-28 05:20:24,638][106226] Updated weights for policy 0, policy_version 1402612 (0.0007) [2023-12-28 05:20:24,687][106226] Updated weights for policy 0, policy_version 1402622 (0.0005) [2023-12-28 05:20:24,740][106226] Updated weights for policy 0, policy_version 1402632 (0.0005) [2023-12-28 05:20:24,788][106225] Updated weights for policy 1, policy_version 1405821 (0.0008) [2023-12-28 05:20:24,836][106225] Updated weights for policy 1, policy_version 1405831 (0.0008) [2023-12-28 05:20:24,882][106225] Updated weights for policy 1, policy_version 1405841 (0.0008) [2023-12-28 05:20:25,439][106226] Updated weights for policy 0, policy_version 1402642 (0.0008) [2023-12-28 05:20:25,501][106226] Updated weights for policy 0, policy_version 1402652 (0.0007) [2023-12-28 05:20:25,530][106225] Updated weights for policy 1, policy_version 1405851 (0.0007) [2023-12-28 05:20:25,564][106226] Updated weights for policy 0, policy_version 1402662 (0.0009) [2023-12-28 05:20:25,585][106225] Updated weights for policy 1, policy_version 1405861 (0.0007) [2023-12-28 05:20:25,621][106226] Updated weights for policy 0, policy_version 1402672 (0.0009) [2023-12-28 05:20:25,651][106225] Updated weights for policy 1, policy_version 1405871 (0.0007) [2023-12-28 05:20:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 719110144. Throughput: 0: 9817.9, 1: 9859.7. Samples: 719081532. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:26,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-4.464')] [2023-12-28 05:20:26,186][106225] Updated weights for policy 1, policy_version 1405881 (0.0005) [2023-12-28 05:20:26,199][106226] Updated weights for policy 0, policy_version 1402682 (0.0009) [2023-12-28 05:20:26,233][106225] Updated weights for policy 1, policy_version 1405891 (0.0006) [2023-12-28 05:20:26,251][106226] Updated weights for policy 0, policy_version 1402692 (0.0009) [2023-12-28 05:20:26,291][106225] Updated weights for policy 1, policy_version 1405901 (0.0005) [2023-12-28 05:20:26,301][106226] Updated weights for policy 0, policy_version 1402702 (0.0009) [2023-12-28 05:20:26,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001402704_359161856.pth... [2023-12-28 05:20:26,316][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001401520_358858752.pth [2023-12-28 05:20:26,342][106225] Updated weights for policy 1, policy_version 1405911 (0.0007) [2023-12-28 05:20:26,347][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001405912_359964672.pth... [2023-12-28 05:20:26,350][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001404728_359661568.pth [2023-12-28 05:20:26,942][106226] Updated weights for policy 0, policy_version 1402712 (0.0007) [2023-12-28 05:20:26,980][106225] Updated weights for policy 1, policy_version 1405921 (0.0007) [2023-12-28 05:20:27,002][106226] Updated weights for policy 0, policy_version 1402722 (0.0008) [2023-12-28 05:20:27,037][106225] Updated weights for policy 1, policy_version 1405931 (0.0005) [2023-12-28 05:20:27,052][106226] Updated weights for policy 0, policy_version 1402732 (0.0009) [2023-12-28 05:20:27,094][106225] Updated weights for policy 1, policy_version 1405941 (0.0005) [2023-12-28 05:20:27,701][106225] Updated weights for policy 1, policy_version 1405951 (0.0009) [2023-12-28 05:20:27,732][106226] Updated weights for policy 0, policy_version 1402742 (0.0007) [2023-12-28 05:20:27,765][106225] Updated weights for policy 1, policy_version 1405961 (0.0010) [2023-12-28 05:20:27,775][106226] Updated weights for policy 0, policy_version 1402752 (0.0006) [2023-12-28 05:20:27,818][106225] Updated weights for policy 1, policy_version 1405971 (0.0010) [2023-12-28 05:20:27,819][106226] Updated weights for policy 0, policy_version 1402762 (0.0006) [2023-12-28 05:20:28,515][106226] Updated weights for policy 0, policy_version 1402772 (0.0009) [2023-12-28 05:20:28,522][106225] Updated weights for policy 1, policy_version 1405981 (0.0009) [2023-12-28 05:20:28,576][106226] Updated weights for policy 0, policy_version 1402782 (0.0010) [2023-12-28 05:20:28,579][106225] Updated weights for policy 1, policy_version 1405991 (0.0010) [2023-12-28 05:20:28,636][106226] Updated weights for policy 0, policy_version 1402792 (0.0010) [2023-12-28 05:20:28,640][106225] Updated weights for policy 1, policy_version 1406001 (0.0008) [2023-12-28 05:20:29,337][106226] Updated weights for policy 0, policy_version 1402802 (0.0009) [2023-12-28 05:20:29,374][106225] Updated weights for policy 1, policy_version 1406011 (0.0008) [2023-12-28 05:20:29,404][106226] Updated weights for policy 0, policy_version 1402812 (0.0009) [2023-12-28 05:20:29,429][106225] Updated weights for policy 1, policy_version 1406021 (0.0008) [2023-12-28 05:20:29,462][106226] Updated weights for policy 0, policy_version 1402822 (0.0008) [2023-12-28 05:20:29,483][106225] Updated weights for policy 1, policy_version 1406031 (0.0008) [2023-12-28 05:20:29,518][106226] Updated weights for policy 0, policy_version 1402832 (0.0005) [2023-12-28 05:20:30,229][106225] Updated weights for policy 1, policy_version 1406041 (0.0008) [2023-12-28 05:20:30,234][106226] Updated weights for policy 0, policy_version 1402842 (0.0008) [2023-12-28 05:20:30,285][106225] Updated weights for policy 1, policy_version 1406051 (0.0010) [2023-12-28 05:20:30,288][106226] Updated weights for policy 0, policy_version 1402852 (0.0006) [2023-12-28 05:20:30,342][106225] Updated weights for policy 1, policy_version 1406061 (0.0010) [2023-12-28 05:20:30,345][106226] Updated weights for policy 0, policy_version 1402862 (0.0007) [2023-12-28 05:20:30,398][106225] Updated weights for policy 1, policy_version 1406071 (0.0010) [2023-12-28 05:20:30,939][106226] Updated weights for policy 0, policy_version 1402872 (0.0006) [2023-12-28 05:20:30,990][106226] Updated weights for policy 0, policy_version 1402882 (0.0005) [2023-12-28 05:20:31,053][106226] Updated weights for policy 0, policy_version 1402892 (0.0006) [2023-12-28 05:20:31,121][106225] Updated weights for policy 1, policy_version 1406081 (0.0009) [2023-12-28 05:20:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 719216640. Throughput: 0: 9953.9, 1: 10010.9. Samples: 719206376. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:31,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.599')] [2023-12-28 05:20:31,190][106225] Updated weights for policy 1, policy_version 1406091 (0.0010) [2023-12-28 05:20:31,256][106225] Updated weights for policy 1, policy_version 1406101 (0.0007) [2023-12-28 05:20:31,782][106226] Updated weights for policy 0, policy_version 1402902 (0.0010) [2023-12-28 05:20:31,839][106226] Updated weights for policy 0, policy_version 1402912 (0.0010) [2023-12-28 05:20:31,903][106226] Updated weights for policy 0, policy_version 1402922 (0.0010) [2023-12-28 05:20:31,934][106225] Updated weights for policy 1, policy_version 1406111 (0.0010) [2023-12-28 05:20:31,991][106225] Updated weights for policy 1, policy_version 1406121 (0.0010) [2023-12-28 05:20:32,045][106225] Updated weights for policy 1, policy_version 1406131 (0.0010) [2023-12-28 05:20:32,632][106226] Updated weights for policy 0, policy_version 1402932 (0.0010) [2023-12-28 05:20:32,689][106226] Updated weights for policy 0, policy_version 1402942 (0.0008) [2023-12-28 05:20:32,754][106226] Updated weights for policy 0, policy_version 1402952 (0.0008) [2023-12-28 05:20:32,789][106225] Updated weights for policy 1, policy_version 1406141 (0.0009) [2023-12-28 05:20:32,847][106225] Updated weights for policy 1, policy_version 1406151 (0.0006) [2023-12-28 05:20:32,908][106225] Updated weights for policy 1, policy_version 1406161 (0.0008) [2023-12-28 05:20:33,485][106225] Updated weights for policy 1, policy_version 1406171 (0.0009) [2023-12-28 05:20:33,509][106226] Updated weights for policy 0, policy_version 1402962 (0.0009) [2023-12-28 05:20:33,533][106225] Updated weights for policy 1, policy_version 1406181 (0.0010) [2023-12-28 05:20:33,557][106226] Updated weights for policy 0, policy_version 1402972 (0.0010) [2023-12-28 05:20:33,583][106225] Updated weights for policy 1, policy_version 1406191 (0.0010) [2023-12-28 05:20:33,619][106226] Updated weights for policy 0, policy_version 1402982 (0.0008) [2023-12-28 05:20:33,671][106226] Updated weights for policy 0, policy_version 1402992 (0.0009) [2023-12-28 05:20:34,223][106225] Updated weights for policy 1, policy_version 1406201 (0.0006) [2023-12-28 05:20:34,275][106225] Updated weights for policy 1, policy_version 1406211 (0.0009) [2023-12-28 05:20:34,332][106225] Updated weights for policy 1, policy_version 1406221 (0.0009) [2023-12-28 05:20:34,388][106225] Updated weights for policy 1, policy_version 1406231 (0.0007) [2023-12-28 05:20:34,451][106226] Updated weights for policy 0, policy_version 1403002 (0.0009) [2023-12-28 05:20:34,516][106226] Updated weights for policy 0, policy_version 1403012 (0.0009) [2023-12-28 05:20:34,572][106226] Updated weights for policy 0, policy_version 1403022 (0.0009) [2023-12-28 05:20:35,098][106225] Updated weights for policy 1, policy_version 1406241 (0.0010) [2023-12-28 05:20:35,161][106225] Updated weights for policy 1, policy_version 1406251 (0.0010) [2023-12-28 05:20:35,215][106225] Updated weights for policy 1, policy_version 1406261 (0.0010) [2023-12-28 05:20:35,338][106226] Updated weights for policy 0, policy_version 1403032 (0.0008) [2023-12-28 05:20:35,385][106226] Updated weights for policy 0, policy_version 1403042 (0.0007) [2023-12-28 05:20:35,435][106226] Updated weights for policy 0, policy_version 1403052 (0.0008) [2023-12-28 05:20:35,836][106225] Updated weights for policy 1, policy_version 1406271 (0.0007) [2023-12-28 05:20:35,897][106225] Updated weights for policy 1, policy_version 1406281 (0.0008) [2023-12-28 05:20:35,953][106225] Updated weights for policy 1, policy_version 1406291 (0.0006) [2023-12-28 05:20:36,065][106226] Updated weights for policy 0, policy_version 1403062 (0.0008) [2023-12-28 05:20:36,124][106226] Updated weights for policy 0, policy_version 1403072 (0.0009) [2023-12-28 05:20:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 719314944. Throughput: 0: 9946.6, 1: 10123.2. Samples: 719326352. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:36,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.938')] [2023-12-28 05:20:36,192][106226] Updated weights for policy 0, policy_version 1403082 (0.0009) [2023-12-28 05:20:36,552][106225] Updated weights for policy 1, policy_version 1406301 (0.0007) [2023-12-28 05:20:36,606][106225] Updated weights for policy 1, policy_version 1406311 (0.0007) [2023-12-28 05:20:36,666][106225] Updated weights for policy 1, policy_version 1406321 (0.0008) [2023-12-28 05:20:37,030][106226] Updated weights for policy 0, policy_version 1403092 (0.0009) [2023-12-28 05:20:37,099][106226] Updated weights for policy 0, policy_version 1403102 (0.0008) [2023-12-28 05:20:37,162][106226] Updated weights for policy 0, policy_version 1403112 (0.0007) [2023-12-28 05:20:37,280][106225] Updated weights for policy 1, policy_version 1406331 (0.0005) [2023-12-28 05:20:37,337][106225] Updated weights for policy 1, policy_version 1406341 (0.0005) [2023-12-28 05:20:37,395][106225] Updated weights for policy 1, policy_version 1406351 (0.0006) [2023-12-28 05:20:37,945][106226] Updated weights for policy 0, policy_version 1403122 (0.0009) [2023-12-28 05:20:37,964][106225] Updated weights for policy 1, policy_version 1406361 (0.0006) [2023-12-28 05:20:37,997][106226] Updated weights for policy 0, policy_version 1403132 (0.0007) [2023-12-28 05:20:38,018][106225] Updated weights for policy 1, policy_version 1406371 (0.0010) [2023-12-28 05:20:38,057][106226] Updated weights for policy 0, policy_version 1403142 (0.0007) [2023-12-28 05:20:38,062][106225] Updated weights for policy 1, policy_version 1406381 (0.0006) [2023-12-28 05:20:38,105][106225] Updated weights for policy 1, policy_version 1406391 (0.0005) [2023-12-28 05:20:38,117][106226] Updated weights for policy 0, policy_version 1403152 (0.0008) [2023-12-28 05:20:38,760][106225] Updated weights for policy 1, policy_version 1406401 (0.0010) [2023-12-28 05:20:38,818][106225] Updated weights for policy 1, policy_version 1406411 (0.0010) [2023-12-28 05:20:38,880][106225] Updated weights for policy 1, policy_version 1406421 (0.0011) [2023-12-28 05:20:38,893][106226] Updated weights for policy 0, policy_version 1403162 (0.0010) [2023-12-28 05:20:38,958][106226] Updated weights for policy 0, policy_version 1403172 (0.0008) [2023-12-28 05:20:39,020][106226] Updated weights for policy 0, policy_version 1403182 (0.0008) [2023-12-28 05:20:39,692][106226] Updated weights for policy 0, policy_version 1403192 (0.0007) [2023-12-28 05:20:39,715][106225] Updated weights for policy 1, policy_version 1406431 (0.0008) [2023-12-28 05:20:39,758][106226] Updated weights for policy 0, policy_version 1403202 (0.0009) [2023-12-28 05:20:39,779][106225] Updated weights for policy 1, policy_version 1406441 (0.0007) [2023-12-28 05:20:39,818][106226] Updated weights for policy 0, policy_version 1403212 (0.0008) [2023-12-28 05:20:39,848][106225] Updated weights for policy 1, policy_version 1406451 (0.0007) [2023-12-28 05:20:40,512][106225] Updated weights for policy 1, policy_version 1406461 (0.0006) [2023-12-28 05:20:40,569][106225] Updated weights for policy 1, policy_version 1406471 (0.0007) [2023-12-28 05:20:40,587][106226] Updated weights for policy 0, policy_version 1403222 (0.0008) [2023-12-28 05:20:40,624][106225] Updated weights for policy 1, policy_version 1406481 (0.0007) [2023-12-28 05:20:40,634][106226] Updated weights for policy 0, policy_version 1403232 (0.0010) [2023-12-28 05:20:40,699][106226] Updated weights for policy 0, policy_version 1403242 (0.0011) [2023-12-28 05:20:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 719413248. Throughput: 0: 9852.2, 1: 10196.0. Samples: 719386116. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:41,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-4.604')] [2023-12-28 05:20:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001403248_359301120.pth... [2023-12-28 05:20:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001406488_360112128.pth... [2023-12-28 05:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001402096_359006208.pth [2023-12-28 05:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001405304_359809024.pth [2023-12-28 05:20:41,323][106225] Updated weights for policy 1, policy_version 1406491 (0.0006) [2023-12-28 05:20:41,396][106225] Updated weights for policy 1, policy_version 1406501 (0.0008) [2023-12-28 05:20:41,452][106226] Updated weights for policy 0, policy_version 1403252 (0.0009) [2023-12-28 05:20:41,462][106225] Updated weights for policy 1, policy_version 1406511 (0.0007) [2023-12-28 05:20:41,513][106226] Updated weights for policy 0, policy_version 1403262 (0.0006) [2023-12-28 05:20:41,577][106226] Updated weights for policy 0, policy_version 1403272 (0.0008) [2023-12-28 05:20:42,227][106225] Updated weights for policy 1, policy_version 1406521 (0.0007) [2023-12-28 05:20:42,229][106226] Updated weights for policy 0, policy_version 1403282 (0.0007) [2023-12-28 05:20:42,291][106225] Updated weights for policy 1, policy_version 1406531 (0.0007) [2023-12-28 05:20:42,301][106226] Updated weights for policy 0, policy_version 1403292 (0.0007) [2023-12-28 05:20:42,361][106225] Updated weights for policy 1, policy_version 1406541 (0.0008) [2023-12-28 05:20:42,377][106226] Updated weights for policy 0, policy_version 1403302 (0.0008) [2023-12-28 05:20:42,429][106225] Updated weights for policy 1, policy_version 1406551 (0.0007) [2023-12-28 05:20:42,446][106226] Updated weights for policy 0, policy_version 1403312 (0.0010) [2023-12-28 05:20:43,130][106225] Updated weights for policy 1, policy_version 1406561 (0.0007) [2023-12-28 05:20:43,189][106225] Updated weights for policy 1, policy_version 1406571 (0.0007) [2023-12-28 05:20:43,202][106226] Updated weights for policy 0, policy_version 1403322 (0.0009) [2023-12-28 05:20:43,241][106225] Updated weights for policy 1, policy_version 1406581 (0.0006) [2023-12-28 05:20:43,263][106226] Updated weights for policy 0, policy_version 1403332 (0.0007) [2023-12-28 05:20:43,318][106226] Updated weights for policy 0, policy_version 1403342 (0.0008) [2023-12-28 05:20:43,907][106225] Updated weights for policy 1, policy_version 1406591 (0.0006) [2023-12-28 05:20:43,962][106225] Updated weights for policy 1, policy_version 1406601 (0.0006) [2023-12-28 05:20:44,009][106225] Updated weights for policy 1, policy_version 1406611 (0.0005) [2023-12-28 05:20:44,079][106226] Updated weights for policy 0, policy_version 1403352 (0.0010) [2023-12-28 05:20:44,139][106226] Updated weights for policy 0, policy_version 1403362 (0.0009) [2023-12-28 05:20:44,201][106226] Updated weights for policy 0, policy_version 1403372 (0.0009) [2023-12-28 05:20:44,729][106225] Updated weights for policy 1, policy_version 1406621 (0.0006) [2023-12-28 05:20:44,789][106225] Updated weights for policy 1, policy_version 1406631 (0.0008) [2023-12-28 05:20:44,854][106225] Updated weights for policy 1, policy_version 1406641 (0.0010) [2023-12-28 05:20:44,909][106226] Updated weights for policy 0, policy_version 1403382 (0.0008) [2023-12-28 05:20:44,974][106226] Updated weights for policy 0, policy_version 1403392 (0.0009) [2023-12-28 05:20:45,035][106226] Updated weights for policy 0, policy_version 1403402 (0.0009) [2023-12-28 05:20:45,647][106225] Updated weights for policy 1, policy_version 1406651 (0.0009) [2023-12-28 05:20:45,714][106225] Updated weights for policy 1, policy_version 1406661 (0.0010) [2023-12-28 05:20:45,741][106226] Updated weights for policy 0, policy_version 1403412 (0.0009) [2023-12-28 05:20:45,764][106225] Updated weights for policy 1, policy_version 1406671 (0.0010) [2023-12-28 05:20:45,798][106226] Updated weights for policy 0, policy_version 1403422 (0.0011) [2023-12-28 05:20:45,855][106226] Updated weights for policy 0, policy_version 1403432 (0.0010) [2023-12-28 05:20:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 719511552. Throughput: 0: 9786.6, 1: 10117.5. Samples: 719500596. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:46,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.638')] [2023-12-28 05:20:46,468][106225] Updated weights for policy 1, policy_version 1406681 (0.0010) [2023-12-28 05:20:46,511][106226] Updated weights for policy 0, policy_version 1403442 (0.0009) [2023-12-28 05:20:46,536][106225] Updated weights for policy 1, policy_version 1406691 (0.0006) [2023-12-28 05:20:46,570][106226] Updated weights for policy 0, policy_version 1403452 (0.0005) [2023-12-28 05:20:46,580][106225] Updated weights for policy 1, policy_version 1406701 (0.0005) [2023-12-28 05:20:46,624][106226] Updated weights for policy 0, policy_version 1403462 (0.0005) [2023-12-28 05:20:46,630][106225] Updated weights for policy 1, policy_version 1406711 (0.0005) [2023-12-28 05:20:46,670][106226] Updated weights for policy 0, policy_version 1403472 (0.0005) [2023-12-28 05:20:47,156][106225] Updated weights for policy 1, policy_version 1406721 (0.0005) [2023-12-28 05:20:47,210][106225] Updated weights for policy 1, policy_version 1406731 (0.0005) [2023-12-28 05:20:47,267][106225] Updated weights for policy 1, policy_version 1406741 (0.0006) [2023-12-28 05:20:47,270][106226] Updated weights for policy 0, policy_version 1403482 (0.0011) [2023-12-28 05:20:47,314][106226] Updated weights for policy 0, policy_version 1403492 (0.0010) [2023-12-28 05:20:47,360][106226] Updated weights for policy 0, policy_version 1403502 (0.0010) [2023-12-28 05:20:47,793][106225] Updated weights for policy 1, policy_version 1406751 (0.0005) [2023-12-28 05:20:47,853][106225] Updated weights for policy 1, policy_version 1406761 (0.0005) [2023-12-28 05:20:47,912][106225] Updated weights for policy 1, policy_version 1406771 (0.0005) [2023-12-28 05:20:48,090][106226] Updated weights for policy 0, policy_version 1403512 (0.0010) [2023-12-28 05:20:48,137][106226] Updated weights for policy 0, policy_version 1403522 (0.0010) [2023-12-28 05:20:48,181][106226] Updated weights for policy 0, policy_version 1403532 (0.0009) [2023-12-28 05:20:48,554][106225] Updated weights for policy 1, policy_version 1406781 (0.0008) [2023-12-28 05:20:48,613][106225] Updated weights for policy 1, policy_version 1406791 (0.0008) [2023-12-28 05:20:48,673][106225] Updated weights for policy 1, policy_version 1406801 (0.0008) [2023-12-28 05:20:48,809][106226] Updated weights for policy 0, policy_version 1403542 (0.0009) [2023-12-28 05:20:48,866][106226] Updated weights for policy 0, policy_version 1403552 (0.0010) [2023-12-28 05:20:48,922][106226] Updated weights for policy 0, policy_version 1403562 (0.0011) [2023-12-28 05:20:49,366][106225] Updated weights for policy 1, policy_version 1406811 (0.0008) [2023-12-28 05:20:49,428][106225] Updated weights for policy 1, policy_version 1406821 (0.0006) [2023-12-28 05:20:49,499][106225] Updated weights for policy 1, policy_version 1406831 (0.0006) [2023-12-28 05:20:49,634][106226] Updated weights for policy 0, policy_version 1403572 (0.0011) [2023-12-28 05:20:49,703][106226] Updated weights for policy 0, policy_version 1403582 (0.0011) [2023-12-28 05:20:49,769][106226] Updated weights for policy 0, policy_version 1403592 (0.0011) [2023-12-28 05:20:50,155][106225] Updated weights for policy 1, policy_version 1406841 (0.0009) [2023-12-28 05:20:50,210][106225] Updated weights for policy 1, policy_version 1406851 (0.0008) [2023-12-28 05:20:50,277][106225] Updated weights for policy 1, policy_version 1406861 (0.0007) [2023-12-28 05:20:50,340][106225] Updated weights for policy 1, policy_version 1406871 (0.0008) [2023-12-28 05:20:50,497][106226] Updated weights for policy 0, policy_version 1403602 (0.0009) [2023-12-28 05:20:50,546][106226] Updated weights for policy 0, policy_version 1403612 (0.0009) [2023-12-28 05:20:50,604][106226] Updated weights for policy 0, policy_version 1403622 (0.0009) [2023-12-28 05:20:50,664][106226] Updated weights for policy 0, policy_version 1403632 (0.0009) [2023-12-28 05:20:51,093][106225] Updated weights for policy 1, policy_version 1406881 (0.0008) [2023-12-28 05:20:51,156][106225] Updated weights for policy 1, policy_version 1406891 (0.0009) [2023-12-28 05:20:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 719609856. Throughput: 0: 9869.1, 1: 10124.7. Samples: 719624284. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:51,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-5.048')] [2023-12-28 05:20:51,206][106225] Updated weights for policy 1, policy_version 1406901 (0.0010) [2023-12-28 05:20:51,416][106226] Updated weights for policy 0, policy_version 1403642 (0.0007) [2023-12-28 05:20:51,474][106226] Updated weights for policy 0, policy_version 1403652 (0.0006) [2023-12-28 05:20:51,530][106226] Updated weights for policy 0, policy_version 1403662 (0.0008) [2023-12-28 05:20:52,015][106225] Updated weights for policy 1, policy_version 1406911 (0.0008) [2023-12-28 05:20:52,085][106225] Updated weights for policy 1, policy_version 1406921 (0.0009) [2023-12-28 05:20:52,129][106226] Updated weights for policy 0, policy_version 1403672 (0.0006) [2023-12-28 05:20:52,147][106225] Updated weights for policy 1, policy_version 1406931 (0.0007) [2023-12-28 05:20:52,188][106226] Updated weights for policy 0, policy_version 1403682 (0.0008) [2023-12-28 05:20:52,251][106226] Updated weights for policy 0, policy_version 1403692 (0.0009) [2023-12-28 05:20:52,889][106225] Updated weights for policy 1, policy_version 1406941 (0.0009) [2023-12-28 05:20:52,948][106225] Updated weights for policy 1, policy_version 1406951 (0.0008) [2023-12-28 05:20:52,978][106226] Updated weights for policy 0, policy_version 1403702 (0.0008) [2023-12-28 05:20:53,005][106225] Updated weights for policy 1, policy_version 1406961 (0.0009) [2023-12-28 05:20:53,036][106226] Updated weights for policy 0, policy_version 1403712 (0.0008) [2023-12-28 05:20:53,088][106226] Updated weights for policy 0, policy_version 1403722 (0.0009) [2023-12-28 05:20:53,623][106225] Updated weights for policy 1, policy_version 1406971 (0.0005) [2023-12-28 05:20:53,671][106225] Updated weights for policy 1, policy_version 1406981 (0.0009) [2023-12-28 05:20:53,704][106226] Updated weights for policy 0, policy_version 1403732 (0.0007) [2023-12-28 05:20:53,718][106225] Updated weights for policy 1, policy_version 1406991 (0.0009) [2023-12-28 05:20:53,758][106226] Updated weights for policy 0, policy_version 1403742 (0.0007) [2023-12-28 05:20:53,811][106226] Updated weights for policy 0, policy_version 1403752 (0.0010) [2023-12-28 05:20:54,341][106225] Updated weights for policy 1, policy_version 1407001 (0.0006) [2023-12-28 05:20:54,404][106225] Updated weights for policy 1, policy_version 1407011 (0.0010) [2023-12-28 05:20:54,465][106225] Updated weights for policy 1, policy_version 1407021 (0.0010) [2023-12-28 05:20:54,529][106225] Updated weights for policy 1, policy_version 1407031 (0.0009) [2023-12-28 05:20:54,576][106226] Updated weights for policy 0, policy_version 1403762 (0.0009) [2023-12-28 05:20:54,627][106226] Updated weights for policy 0, policy_version 1403772 (0.0008) [2023-12-28 05:20:54,685][106226] Updated weights for policy 0, policy_version 1403782 (0.0008) [2023-12-28 05:20:54,746][106226] Updated weights for policy 0, policy_version 1403792 (0.0008) [2023-12-28 05:20:55,146][106225] Updated weights for policy 1, policy_version 1407041 (0.0009) [2023-12-28 05:20:55,195][106225] Updated weights for policy 1, policy_version 1407051 (0.0008) [2023-12-28 05:20:55,253][106225] Updated weights for policy 1, policy_version 1407061 (0.0010) [2023-12-28 05:20:55,379][106226] Updated weights for policy 0, policy_version 1403802 (0.0005) [2023-12-28 05:20:55,435][106226] Updated weights for policy 0, policy_version 1403812 (0.0005) [2023-12-28 05:20:55,492][106226] Updated weights for policy 0, policy_version 1403822 (0.0005) [2023-12-28 05:20:56,045][106225] Updated weights for policy 1, policy_version 1407071 (0.0009) [2023-12-28 05:20:56,089][106225] Updated weights for policy 1, policy_version 1407081 (0.0006) [2023-12-28 05:20:56,135][106225] Updated weights for policy 1, policy_version 1407091 (0.0005) [2023-12-28 05:20:56,137][106226] Updated weights for policy 0, policy_version 1403832 (0.0006) [2023-12-28 05:20:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 719716352. Throughput: 0: 9867.8, 1: 10126.2. Samples: 719683692. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:20:56,176][105115] Avg episode reward: [(0, '-5.014'), (1, '-4.825')] [2023-12-28 05:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001407096_360267776.pth... [2023-12-28 05:20:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001405912_359964672.pth [2023-12-28 05:20:56,199][106226] Updated weights for policy 0, policy_version 1403842 (0.0008) [2023-12-28 05:20:56,268][106226] Updated weights for policy 0, policy_version 1403852 (0.0010) [2023-12-28 05:20:56,305][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001403856_359456768.pth... [2023-12-28 05:20:56,310][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001402704_359161856.pth [2023-12-28 05:20:56,800][106225] Updated weights for policy 1, policy_version 1407101 (0.0007) [2023-12-28 05:20:56,847][106225] Updated weights for policy 1, policy_version 1407111 (0.0008) [2023-12-28 05:20:56,897][106225] Updated weights for policy 1, policy_version 1407121 (0.0008) [2023-12-28 05:20:57,017][106226] Updated weights for policy 0, policy_version 1403862 (0.0008) [2023-12-28 05:20:57,067][106226] Updated weights for policy 0, policy_version 1403872 (0.0008) [2023-12-28 05:20:57,111][106226] Updated weights for policy 0, policy_version 1403882 (0.0008) [2023-12-28 05:20:57,615][106225] Updated weights for policy 1, policy_version 1407131 (0.0008) [2023-12-28 05:20:57,666][106225] Updated weights for policy 1, policy_version 1407141 (0.0008) [2023-12-28 05:20:57,713][106225] Updated weights for policy 1, policy_version 1407151 (0.0009) [2023-12-28 05:20:57,874][106226] Updated weights for policy 0, policy_version 1403892 (0.0008) [2023-12-28 05:20:57,926][106226] Updated weights for policy 0, policy_version 1403902 (0.0009) [2023-12-28 05:20:57,985][106226] Updated weights for policy 0, policy_version 1403912 (0.0007) [2023-12-28 05:20:58,501][106225] Updated weights for policy 1, policy_version 1407161 (0.0008) [2023-12-28 05:20:58,564][106225] Updated weights for policy 1, policy_version 1407171 (0.0008) [2023-12-28 05:20:58,628][106225] Updated weights for policy 1, policy_version 1407181 (0.0008) [2023-12-28 05:20:58,694][106225] Updated weights for policy 1, policy_version 1407191 (0.0008) [2023-12-28 05:20:58,696][106226] Updated weights for policy 0, policy_version 1403922 (0.0006) [2023-12-28 05:20:58,764][106226] Updated weights for policy 0, policy_version 1403932 (0.0008) [2023-12-28 05:20:58,833][106226] Updated weights for policy 0, policy_version 1403942 (0.0008) [2023-12-28 05:20:58,911][106226] Updated weights for policy 0, policy_version 1403952 (0.0009) [2023-12-28 05:20:59,575][106225] Updated weights for policy 1, policy_version 1407201 (0.0010) [2023-12-28 05:20:59,636][106225] Updated weights for policy 1, policy_version 1407211 (0.0010) [2023-12-28 05:20:59,693][106226] Updated weights for policy 0, policy_version 1403962 (0.0005) [2023-12-28 05:20:59,702][106225] Updated weights for policy 1, policy_version 1407221 (0.0009) [2023-12-28 05:20:59,753][106226] Updated weights for policy 0, policy_version 1403972 (0.0008) [2023-12-28 05:20:59,817][106226] Updated weights for policy 0, policy_version 1403982 (0.0008) [2023-12-28 05:21:00,413][106225] Updated weights for policy 1, policy_version 1407231 (0.0010) [2023-12-28 05:21:00,475][106225] Updated weights for policy 1, policy_version 1407241 (0.0010) [2023-12-28 05:21:00,526][106225] Updated weights for policy 1, policy_version 1407251 (0.0010) [2023-12-28 05:21:00,531][106226] Updated weights for policy 0, policy_version 1403992 (0.0007) [2023-12-28 05:21:00,593][106226] Updated weights for policy 0, policy_version 1404002 (0.0007) [2023-12-28 05:21:00,649][106226] Updated weights for policy 0, policy_version 1404012 (0.0008) [2023-12-28 05:21:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 719806464. Throughput: 0: 9904.4, 1: 10143.6. Samples: 719800348. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:01,175][105115] Avg episode reward: [(0, '-5.099'), (1, '-4.980')] [2023-12-28 05:21:01,252][106225] Updated weights for policy 1, policy_version 1407261 (0.0010) [2023-12-28 05:21:01,316][106225] Updated weights for policy 1, policy_version 1407271 (0.0010) [2023-12-28 05:21:01,342][106226] Updated weights for policy 0, policy_version 1404022 (0.0008) [2023-12-28 05:21:01,383][106225] Updated weights for policy 1, policy_version 1407281 (0.0010) [2023-12-28 05:21:01,408][106226] Updated weights for policy 0, policy_version 1404032 (0.0007) [2023-12-28 05:21:01,462][106226] Updated weights for policy 0, policy_version 1404042 (0.0008) [2023-12-28 05:21:02,067][106225] Updated weights for policy 1, policy_version 1407291 (0.0010) [2023-12-28 05:21:02,128][106225] Updated weights for policy 1, policy_version 1407301 (0.0010) [2023-12-28 05:21:02,178][106225] Updated weights for policy 1, policy_version 1407311 (0.0010) [2023-12-28 05:21:02,229][106226] Updated weights for policy 0, policy_version 1404052 (0.0008) [2023-12-28 05:21:02,290][106226] Updated weights for policy 0, policy_version 1404062 (0.0008) [2023-12-28 05:21:02,355][106226] Updated weights for policy 0, policy_version 1404072 (0.0008) [2023-12-28 05:21:02,854][106225] Updated weights for policy 1, policy_version 1407321 (0.0010) [2023-12-28 05:21:02,907][106225] Updated weights for policy 1, policy_version 1407331 (0.0010) [2023-12-28 05:21:02,958][106225] Updated weights for policy 1, policy_version 1407341 (0.0010) [2023-12-28 05:21:03,008][106225] Updated weights for policy 1, policy_version 1407351 (0.0010) [2023-12-28 05:21:03,094][106226] Updated weights for policy 0, policy_version 1404082 (0.0008) [2023-12-28 05:21:03,155][106226] Updated weights for policy 0, policy_version 1404092 (0.0006) [2023-12-28 05:21:03,211][106226] Updated weights for policy 0, policy_version 1404102 (0.0007) [2023-12-28 05:21:03,274][106226] Updated weights for policy 0, policy_version 1404112 (0.0007) [2023-12-28 05:21:03,640][106225] Updated weights for policy 1, policy_version 1407361 (0.0006) [2023-12-28 05:21:03,691][106225] Updated weights for policy 1, policy_version 1407371 (0.0006) [2023-12-28 05:21:03,744][106225] Updated weights for policy 1, policy_version 1407381 (0.0007) [2023-12-28 05:21:03,897][106226] Updated weights for policy 0, policy_version 1404122 (0.0008) [2023-12-28 05:21:03,963][106226] Updated weights for policy 0, policy_version 1404132 (0.0007) [2023-12-28 05:21:04,024][106226] Updated weights for policy 0, policy_version 1404142 (0.0008) [2023-12-28 05:21:04,475][106225] Updated weights for policy 1, policy_version 1407391 (0.0008) [2023-12-28 05:21:04,540][106225] Updated weights for policy 1, policy_version 1407401 (0.0008) [2023-12-28 05:21:04,600][106225] Updated weights for policy 1, policy_version 1407411 (0.0008) [2023-12-28 05:21:04,749][106226] Updated weights for policy 0, policy_version 1404152 (0.0010) [2023-12-28 05:21:04,804][106226] Updated weights for policy 0, policy_version 1404162 (0.0008) [2023-12-28 05:21:04,862][106226] Updated weights for policy 0, policy_version 1404172 (0.0005) [2023-12-28 05:21:05,288][106225] Updated weights for policy 1, policy_version 1407421 (0.0006) [2023-12-28 05:21:05,340][106225] Updated weights for policy 1, policy_version 1407431 (0.0005) [2023-12-28 05:21:05,386][106225] Updated weights for policy 1, policy_version 1407441 (0.0005) [2023-12-28 05:21:05,517][106226] Updated weights for policy 0, policy_version 1404182 (0.0009) [2023-12-28 05:21:05,580][106226] Updated weights for policy 0, policy_version 1404192 (0.0011) [2023-12-28 05:21:05,634][106226] Updated weights for policy 0, policy_version 1404202 (0.0010) [2023-12-28 05:21:05,965][106225] Updated weights for policy 1, policy_version 1407451 (0.0007) [2023-12-28 05:21:06,025][106225] Updated weights for policy 1, policy_version 1407461 (0.0010) [2023-12-28 05:21:06,084][106225] Updated weights for policy 1, policy_version 1407471 (0.0010) [2023-12-28 05:21:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 719912960. Throughput: 0: 9872.4, 1: 10126.4. Samples: 719920628. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:06,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.627')] [2023-12-28 05:21:06,383][106226] Updated weights for policy 0, policy_version 1404212 (0.0010) [2023-12-28 05:21:06,443][106226] Updated weights for policy 0, policy_version 1404222 (0.0010) [2023-12-28 05:21:06,508][106226] Updated weights for policy 0, policy_version 1404232 (0.0010) [2023-12-28 05:21:06,816][106225] Updated weights for policy 1, policy_version 1407481 (0.0010) [2023-12-28 05:21:06,874][106225] Updated weights for policy 1, policy_version 1407491 (0.0006) [2023-12-28 05:21:06,923][106225] Updated weights for policy 1, policy_version 1407501 (0.0005) [2023-12-28 05:21:06,974][106225] Updated weights for policy 1, policy_version 1407511 (0.0010) [2023-12-28 05:21:07,205][106226] Updated weights for policy 0, policy_version 1404242 (0.0010) [2023-12-28 05:21:07,271][106226] Updated weights for policy 0, policy_version 1404252 (0.0005) [2023-12-28 05:21:07,327][106226] Updated weights for policy 0, policy_version 1404262 (0.0009) [2023-12-28 05:21:07,384][106226] Updated weights for policy 0, policy_version 1404272 (0.0010) [2023-12-28 05:21:07,647][106225] Updated weights for policy 1, policy_version 1407521 (0.0008) [2023-12-28 05:21:07,707][106225] Updated weights for policy 1, policy_version 1407531 (0.0010) [2023-12-28 05:21:07,770][106225] Updated weights for policy 1, policy_version 1407541 (0.0010) [2023-12-28 05:21:07,969][106226] Updated weights for policy 0, policy_version 1404282 (0.0005) [2023-12-28 05:21:08,035][106226] Updated weights for policy 0, policy_version 1404292 (0.0007) [2023-12-28 05:21:08,092][106226] Updated weights for policy 0, policy_version 1404302 (0.0008) [2023-12-28 05:21:08,494][106225] Updated weights for policy 1, policy_version 1407551 (0.0011) [2023-12-28 05:21:08,549][106225] Updated weights for policy 1, policy_version 1407561 (0.0008) [2023-12-28 05:21:08,600][106225] Updated weights for policy 1, policy_version 1407571 (0.0010) [2023-12-28 05:21:08,781][106226] Updated weights for policy 0, policy_version 1404312 (0.0009) [2023-12-28 05:21:08,843][106226] Updated weights for policy 0, policy_version 1404322 (0.0008) [2023-12-28 05:21:08,893][106226] Updated weights for policy 0, policy_version 1404332 (0.0008) [2023-12-28 05:21:09,249][106225] Updated weights for policy 1, policy_version 1407581 (0.0010) [2023-12-28 05:21:09,349][106225] Updated weights for policy 1, policy_version 1407591 (0.0010) [2023-12-28 05:21:09,419][106225] Updated weights for policy 1, policy_version 1407601 (0.0012) [2023-12-28 05:21:09,692][106226] Updated weights for policy 0, policy_version 1404342 (0.0006) [2023-12-28 05:21:09,756][106226] Updated weights for policy 0, policy_version 1404352 (0.0006) [2023-12-28 05:21:09,824][106226] Updated weights for policy 0, policy_version 1404362 (0.0008) [2023-12-28 05:21:10,159][106225] Updated weights for policy 1, policy_version 1407611 (0.0008) [2023-12-28 05:21:10,222][106225] Updated weights for policy 1, policy_version 1407621 (0.0008) [2023-12-28 05:21:10,274][106225] Updated weights for policy 1, policy_version 1407631 (0.0008) [2023-12-28 05:21:10,505][106226] Updated weights for policy 0, policy_version 1404372 (0.0011) [2023-12-28 05:21:10,568][106226] Updated weights for policy 0, policy_version 1404382 (0.0011) [2023-12-28 05:21:10,637][106226] Updated weights for policy 0, policy_version 1404392 (0.0010) [2023-12-28 05:21:10,994][106225] Updated weights for policy 1, policy_version 1407641 (0.0008) [2023-12-28 05:21:11,059][106225] Updated weights for policy 1, policy_version 1407651 (0.0008) [2023-12-28 05:21:11,122][106225] Updated weights for policy 1, policy_version 1407661 (0.0008) [2023-12-28 05:21:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 720003072. Throughput: 0: 9835.1, 1: 10133.6. Samples: 719980124. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:11,175][105115] Avg episode reward: [(0, '-5.107'), (1, '-4.715')] [2023-12-28 05:21:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001404400_359596032.pth... [2023-12-28 05:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001403248_359301120.pth [2023-12-28 05:21:11,193][106225] Updated weights for policy 1, policy_version 1407671 (0.0008) [2023-12-28 05:21:11,197][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001407672_360415232.pth... [2023-12-28 05:21:11,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001406488_360112128.pth [2023-12-28 05:21:11,319][106226] Updated weights for policy 0, policy_version 1404402 (0.0009) [2023-12-28 05:21:11,390][106226] Updated weights for policy 0, policy_version 1404412 (0.0009) [2023-12-28 05:21:11,456][106226] Updated weights for policy 0, policy_version 1404422 (0.0010) [2023-12-28 05:21:11,522][106226] Updated weights for policy 0, policy_version 1404432 (0.0011) [2023-12-28 05:21:12,013][106225] Updated weights for policy 1, policy_version 1407681 (0.0010) [2023-12-28 05:21:12,073][106225] Updated weights for policy 1, policy_version 1407691 (0.0010) [2023-12-28 05:21:12,127][106225] Updated weights for policy 1, policy_version 1407701 (0.0008) [2023-12-28 05:21:12,318][106226] Updated weights for policy 0, policy_version 1404442 (0.0007) [2023-12-28 05:21:12,390][106226] Updated weights for policy 0, policy_version 1404452 (0.0010) [2023-12-28 05:21:12,452][106226] Updated weights for policy 0, policy_version 1404462 (0.0011) [2023-12-28 05:21:12,817][106225] Updated weights for policy 1, policy_version 1407711 (0.0008) [2023-12-28 05:21:12,878][106225] Updated weights for policy 1, policy_version 1407721 (0.0006) [2023-12-28 05:21:12,944][106225] Updated weights for policy 1, policy_version 1407731 (0.0008) [2023-12-28 05:21:13,153][106226] Updated weights for policy 0, policy_version 1404472 (0.0009) [2023-12-28 05:21:13,211][106226] Updated weights for policy 0, policy_version 1404482 (0.0008) [2023-12-28 05:21:13,269][106226] Updated weights for policy 0, policy_version 1404492 (0.0010) [2023-12-28 05:21:13,507][106225] Updated weights for policy 1, policy_version 1407741 (0.0010) [2023-12-28 05:21:13,558][106225] Updated weights for policy 1, policy_version 1407751 (0.0010) [2023-12-28 05:21:13,602][106225] Updated weights for policy 1, policy_version 1407761 (0.0010) [2023-12-28 05:21:14,006][106226] Updated weights for policy 0, policy_version 1404502 (0.0008) [2023-12-28 05:21:14,071][106226] Updated weights for policy 0, policy_version 1404512 (0.0009) [2023-12-28 05:21:14,128][106226] Updated weights for policy 0, policy_version 1404522 (0.0008) [2023-12-28 05:21:14,370][106225] Updated weights for policy 1, policy_version 1407771 (0.0010) [2023-12-28 05:21:14,424][106225] Updated weights for policy 1, policy_version 1407781 (0.0010) [2023-12-28 05:21:14,484][106225] Updated weights for policy 1, policy_version 1407791 (0.0009) [2023-12-28 05:21:14,891][106226] Updated weights for policy 0, policy_version 1404532 (0.0007) [2023-12-28 05:21:14,958][106226] Updated weights for policy 0, policy_version 1404542 (0.0008) [2023-12-28 05:21:15,022][106226] Updated weights for policy 0, policy_version 1404552 (0.0009) [2023-12-28 05:21:15,145][106225] Updated weights for policy 1, policy_version 1407801 (0.0010) [2023-12-28 05:21:15,205][106225] Updated weights for policy 1, policy_version 1407811 (0.0006) [2023-12-28 05:21:15,267][106225] Updated weights for policy 1, policy_version 1407821 (0.0006) [2023-12-28 05:21:15,329][106225] Updated weights for policy 1, policy_version 1407831 (0.0008) [2023-12-28 05:21:15,717][106226] Updated weights for policy 0, policy_version 1404562 (0.0008) [2023-12-28 05:21:15,767][106226] Updated weights for policy 0, policy_version 1404572 (0.0009) [2023-12-28 05:21:15,820][106226] Updated weights for policy 0, policy_version 1404582 (0.0006) [2023-12-28 05:21:15,872][106226] Updated weights for policy 0, policy_version 1404592 (0.0005) [2023-12-28 05:21:16,013][106225] Updated weights for policy 1, policy_version 1407841 (0.0009) [2023-12-28 05:21:16,075][106225] Updated weights for policy 1, policy_version 1407851 (0.0008) [2023-12-28 05:21:16,138][106225] Updated weights for policy 1, policy_version 1407861 (0.0010) [2023-12-28 05:21:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 720109568. Throughput: 0: 9701.9, 1: 10029.3. Samples: 720094280. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:16,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.828')] [2023-12-28 05:21:16,548][106226] Updated weights for policy 0, policy_version 1404602 (0.0010) [2023-12-28 05:21:16,606][106226] Updated weights for policy 0, policy_version 1404612 (0.0011) [2023-12-28 05:21:16,667][106226] Updated weights for policy 0, policy_version 1404622 (0.0011) [2023-12-28 05:21:16,717][106225] Updated weights for policy 1, policy_version 1407871 (0.0007) [2023-12-28 05:21:16,771][106225] Updated weights for policy 1, policy_version 1407881 (0.0008) [2023-12-28 05:21:16,827][106225] Updated weights for policy 1, policy_version 1407891 (0.0008) [2023-12-28 05:21:17,326][106226] Updated weights for policy 0, policy_version 1404632 (0.0006) [2023-12-28 05:21:17,376][106226] Updated weights for policy 0, policy_version 1404642 (0.0005) [2023-12-28 05:21:17,427][106226] Updated weights for policy 0, policy_version 1404652 (0.0006) [2023-12-28 05:21:17,444][106225] Updated weights for policy 1, policy_version 1407901 (0.0007) [2023-12-28 05:21:17,501][106225] Updated weights for policy 1, policy_version 1407911 (0.0010) [2023-12-28 05:21:17,558][106225] Updated weights for policy 1, policy_version 1407921 (0.0008) [2023-12-28 05:21:18,022][106226] Updated weights for policy 0, policy_version 1404662 (0.0007) [2023-12-28 05:21:18,070][106226] Updated weights for policy 0, policy_version 1404672 (0.0006) [2023-12-28 05:21:18,123][106226] Updated weights for policy 0, policy_version 1404682 (0.0010) [2023-12-28 05:21:18,127][106225] Updated weights for policy 1, policy_version 1407931 (0.0009) [2023-12-28 05:21:18,186][106225] Updated weights for policy 1, policy_version 1407941 (0.0006) [2023-12-28 05:21:18,247][106225] Updated weights for policy 1, policy_version 1407951 (0.0008) [2023-12-28 05:21:18,847][106226] Updated weights for policy 0, policy_version 1404692 (0.0011) [2023-12-28 05:21:18,906][106225] Updated weights for policy 1, policy_version 1407961 (0.0006) [2023-12-28 05:21:18,909][106226] Updated weights for policy 0, policy_version 1404702 (0.0011) [2023-12-28 05:21:18,963][106226] Updated weights for policy 0, policy_version 1404712 (0.0011) [2023-12-28 05:21:18,973][106225] Updated weights for policy 1, policy_version 1407971 (0.0007) [2023-12-28 05:21:19,037][106225] Updated weights for policy 1, policy_version 1407981 (0.0005) [2023-12-28 05:21:19,098][106225] Updated weights for policy 1, policy_version 1407991 (0.0006) [2023-12-28 05:21:19,685][106226] Updated weights for policy 0, policy_version 1404722 (0.0009) [2023-12-28 05:21:19,746][106226] Updated weights for policy 0, policy_version 1404732 (0.0006) [2023-12-28 05:21:19,748][106225] Updated weights for policy 1, policy_version 1408001 (0.0008) [2023-12-28 05:21:19,802][106225] Updated weights for policy 1, policy_version 1408011 (0.0007) [2023-12-28 05:21:19,815][106226] Updated weights for policy 0, policy_version 1404742 (0.0006) [2023-12-28 05:21:19,874][106225] Updated weights for policy 1, policy_version 1408021 (0.0007) [2023-12-28 05:21:19,879][106226] Updated weights for policy 0, policy_version 1404752 (0.0008) [2023-12-28 05:21:20,637][106226] Updated weights for policy 0, policy_version 1404762 (0.0008) [2023-12-28 05:21:20,648][106225] Updated weights for policy 1, policy_version 1408031 (0.0007) [2023-12-28 05:21:20,701][106226] Updated weights for policy 0, policy_version 1404772 (0.0008) [2023-12-28 05:21:20,708][106225] Updated weights for policy 1, policy_version 1408041 (0.0006) [2023-12-28 05:21:20,762][106226] Updated weights for policy 0, policy_version 1404782 (0.0008) [2023-12-28 05:21:20,764][106225] Updated weights for policy 1, policy_version 1408051 (0.0006) [2023-12-28 05:21:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 720207872. Throughput: 0: 9737.8, 1: 10071.3. Samples: 720217764. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:21,175][105115] Avg episode reward: [(0, '-4.838'), (1, '-4.445')] [2023-12-28 05:21:21,540][106225] Updated weights for policy 1, policy_version 1408061 (0.0008) [2023-12-28 05:21:21,556][106226] Updated weights for policy 0, policy_version 1404792 (0.0006) [2023-12-28 05:21:21,606][106225] Updated weights for policy 1, policy_version 1408071 (0.0008) [2023-12-28 05:21:21,623][106226] Updated weights for policy 0, policy_version 1404802 (0.0007) [2023-12-28 05:21:21,678][106225] Updated weights for policy 1, policy_version 1408081 (0.0008) [2023-12-28 05:21:21,690][106226] Updated weights for policy 0, policy_version 1404812 (0.0008) [2023-12-28 05:21:22,410][106225] Updated weights for policy 1, policy_version 1408091 (0.0009) [2023-12-28 05:21:22,454][106226] Updated weights for policy 0, policy_version 1404822 (0.0007) [2023-12-28 05:21:22,471][106225] Updated weights for policy 1, policy_version 1408101 (0.0008) [2023-12-28 05:21:22,512][106226] Updated weights for policy 0, policy_version 1404832 (0.0006) [2023-12-28 05:21:22,537][106225] Updated weights for policy 1, policy_version 1408111 (0.0010) [2023-12-28 05:21:22,563][106226] Updated weights for policy 0, policy_version 1404842 (0.0006) [2023-12-28 05:21:23,235][106226] Updated weights for policy 0, policy_version 1404852 (0.0007) [2023-12-28 05:21:23,241][106225] Updated weights for policy 1, policy_version 1408121 (0.0011) [2023-12-28 05:21:23,289][106225] Updated weights for policy 1, policy_version 1408131 (0.0010) [2023-12-28 05:21:23,289][106226] Updated weights for policy 0, policy_version 1404862 (0.0005) [2023-12-28 05:21:23,341][106226] Updated weights for policy 0, policy_version 1404872 (0.0005) [2023-12-28 05:21:23,350][106225] Updated weights for policy 1, policy_version 1408141 (0.0010) [2023-12-28 05:21:23,407][106225] Updated weights for policy 1, policy_version 1408151 (0.0010) [2023-12-28 05:21:23,911][106226] Updated weights for policy 0, policy_version 1404882 (0.0007) [2023-12-28 05:21:23,972][106226] Updated weights for policy 0, policy_version 1404892 (0.0005) [2023-12-28 05:21:24,024][106226] Updated weights for policy 0, policy_version 1404902 (0.0006) [2023-12-28 05:21:24,068][106225] Updated weights for policy 1, policy_version 1408161 (0.0010) [2023-12-28 05:21:24,078][106226] Updated weights for policy 0, policy_version 1404912 (0.0006) [2023-12-28 05:21:24,126][106225] Updated weights for policy 1, policy_version 1408171 (0.0010) [2023-12-28 05:21:24,187][106225] Updated weights for policy 1, policy_version 1408181 (0.0009) [2023-12-28 05:21:24,776][106226] Updated weights for policy 0, policy_version 1404922 (0.0006) [2023-12-28 05:21:24,825][106226] Updated weights for policy 0, policy_version 1404932 (0.0005) [2023-12-28 05:21:24,859][106225] Updated weights for policy 1, policy_version 1408191 (0.0009) [2023-12-28 05:21:24,874][106226] Updated weights for policy 0, policy_version 1404942 (0.0007) [2023-12-28 05:21:24,918][106225] Updated weights for policy 1, policy_version 1408201 (0.0010) [2023-12-28 05:21:24,978][106225] Updated weights for policy 1, policy_version 1408211 (0.0010) [2023-12-28 05:21:25,601][106226] Updated weights for policy 0, policy_version 1404952 (0.0008) [2023-12-28 05:21:25,651][106226] Updated weights for policy 0, policy_version 1404962 (0.0008) [2023-12-28 05:21:25,694][106225] Updated weights for policy 1, policy_version 1408221 (0.0010) [2023-12-28 05:21:25,696][106226] Updated weights for policy 0, policy_version 1404972 (0.0006) [2023-12-28 05:21:25,744][106225] Updated weights for policy 1, policy_version 1408231 (0.0010) [2023-12-28 05:21:25,800][106225] Updated weights for policy 1, policy_version 1408241 (0.0010) [2023-12-28 05:21:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 720306176. Throughput: 0: 9836.7, 1: 9945.5. Samples: 720276312. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:26,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.585')] [2023-12-28 05:21:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001404976_359743488.pth... [2023-12-28 05:21:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001408248_360562688.pth... [2023-12-28 05:21:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001403856_359456768.pth [2023-12-28 05:21:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001407096_360267776.pth [2023-12-28 05:21:26,448][106226] Updated weights for policy 0, policy_version 1404982 (0.0007) [2023-12-28 05:21:26,507][106226] Updated weights for policy 0, policy_version 1404992 (0.0009) [2023-12-28 05:21:26,521][106225] Updated weights for policy 1, policy_version 1408251 (0.0010) [2023-12-28 05:21:26,561][106226] Updated weights for policy 0, policy_version 1405002 (0.0011) [2023-12-28 05:21:26,577][106225] Updated weights for policy 1, policy_version 1408261 (0.0010) [2023-12-28 05:21:26,629][106225] Updated weights for policy 1, policy_version 1408271 (0.0007) [2023-12-28 05:21:27,164][106225] Updated weights for policy 1, policy_version 1408281 (0.0006) [2023-12-28 05:21:27,180][106226] Updated weights for policy 0, policy_version 1405012 (0.0007) [2023-12-28 05:21:27,213][106225] Updated weights for policy 1, policy_version 1408291 (0.0010) [2023-12-28 05:21:27,228][106226] Updated weights for policy 0, policy_version 1405022 (0.0005) [2023-12-28 05:21:27,263][106225] Updated weights for policy 1, policy_version 1408301 (0.0010) [2023-12-28 05:21:27,284][106226] Updated weights for policy 0, policy_version 1405032 (0.0007) [2023-12-28 05:21:27,317][106225] Updated weights for policy 1, policy_version 1408311 (0.0009) [2023-12-28 05:21:27,941][106225] Updated weights for policy 1, policy_version 1408321 (0.0005) [2023-12-28 05:21:27,960][106226] Updated weights for policy 0, policy_version 1405042 (0.0009) [2023-12-28 05:21:28,004][106225] Updated weights for policy 1, policy_version 1408331 (0.0006) [2023-12-28 05:21:28,018][106226] Updated weights for policy 0, policy_version 1405052 (0.0009) [2023-12-28 05:21:28,058][106225] Updated weights for policy 1, policy_version 1408341 (0.0010) [2023-12-28 05:21:28,077][106226] Updated weights for policy 0, policy_version 1405062 (0.0007) [2023-12-28 05:21:28,139][106226] Updated weights for policy 0, policy_version 1405072 (0.0006) [2023-12-28 05:21:28,706][106226] Updated weights for policy 0, policy_version 1405082 (0.0005) [2023-12-28 05:21:28,720][106225] Updated weights for policy 1, policy_version 1408351 (0.0011) [2023-12-28 05:21:28,759][106226] Updated weights for policy 0, policy_version 1405092 (0.0008) [2023-12-28 05:21:28,778][106225] Updated weights for policy 1, policy_version 1408361 (0.0010) [2023-12-28 05:21:28,813][106226] Updated weights for policy 0, policy_version 1405102 (0.0010) [2023-12-28 05:21:28,835][106225] Updated weights for policy 1, policy_version 1408371 (0.0010) [2023-12-28 05:21:29,518][106225] Updated weights for policy 1, policy_version 1408381 (0.0008) [2023-12-28 05:21:29,524][106226] Updated weights for policy 0, policy_version 1405112 (0.0008) [2023-12-28 05:21:29,568][106225] Updated weights for policy 1, policy_version 1408391 (0.0006) [2023-12-28 05:21:29,586][106226] Updated weights for policy 0, policy_version 1405122 (0.0008) [2023-12-28 05:21:29,622][106225] Updated weights for policy 1, policy_version 1408401 (0.0005) [2023-12-28 05:21:29,648][106226] Updated weights for policy 0, policy_version 1405132 (0.0008) [2023-12-28 05:21:30,325][106225] Updated weights for policy 1, policy_version 1408411 (0.0006) [2023-12-28 05:21:30,386][106225] Updated weights for policy 1, policy_version 1408421 (0.0009) [2023-12-28 05:21:30,409][106226] Updated weights for policy 0, policy_version 1405142 (0.0009) [2023-12-28 05:21:30,438][106225] Updated weights for policy 1, policy_version 1408431 (0.0007) [2023-12-28 05:21:30,463][106226] Updated weights for policy 0, policy_version 1405152 (0.0009) [2023-12-28 05:21:30,518][106226] Updated weights for policy 0, policy_version 1405162 (0.0009) [2023-12-28 05:21:31,125][106225] Updated weights for policy 1, policy_version 1408441 (0.0007) [2023-12-28 05:21:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 720404480. Throughput: 0: 9916.7, 1: 10068.7. Samples: 720399940. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:31,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.519')] [2023-12-28 05:21:31,187][106225] Updated weights for policy 1, policy_version 1408451 (0.0006) [2023-12-28 05:21:31,191][106226] Updated weights for policy 0, policy_version 1405172 (0.0010) [2023-12-28 05:21:31,250][106226] Updated weights for policy 0, policy_version 1405182 (0.0008) [2023-12-28 05:21:31,253][106225] Updated weights for policy 1, policy_version 1408461 (0.0006) [2023-12-28 05:21:31,308][106225] Updated weights for policy 1, policy_version 1408471 (0.0006) [2023-12-28 05:21:31,310][106226] Updated weights for policy 0, policy_version 1405192 (0.0009) [2023-12-28 05:21:31,936][106225] Updated weights for policy 1, policy_version 1408481 (0.0008) [2023-12-28 05:21:32,008][106225] Updated weights for policy 1, policy_version 1408491 (0.0009) [2023-12-28 05:21:32,060][106225] Updated weights for policy 1, policy_version 1408501 (0.0008) [2023-12-28 05:21:32,066][106226] Updated weights for policy 0, policy_version 1405202 (0.0008) [2023-12-28 05:21:32,128][106226] Updated weights for policy 0, policy_version 1405212 (0.0009) [2023-12-28 05:21:32,198][106226] Updated weights for policy 0, policy_version 1405222 (0.0008) [2023-12-28 05:21:32,251][106226] Updated weights for policy 0, policy_version 1405232 (0.0008) [2023-12-28 05:21:32,749][106225] Updated weights for policy 1, policy_version 1408511 (0.0007) [2023-12-28 05:21:32,801][106225] Updated weights for policy 1, policy_version 1408521 (0.0009) [2023-12-28 05:21:32,852][106225] Updated weights for policy 1, policy_version 1408531 (0.0008) [2023-12-28 05:21:32,920][106226] Updated weights for policy 0, policy_version 1405242 (0.0005) [2023-12-28 05:21:32,967][106226] Updated weights for policy 0, policy_version 1405252 (0.0008) [2023-12-28 05:21:33,019][106226] Updated weights for policy 0, policy_version 1405262 (0.0008) [2023-12-28 05:21:33,572][106225] Updated weights for policy 1, policy_version 1408541 (0.0009) [2023-12-28 05:21:33,615][106225] Updated weights for policy 1, policy_version 1408551 (0.0008) [2023-12-28 05:21:33,658][106225] Updated weights for policy 1, policy_version 1408561 (0.0008) [2023-12-28 05:21:33,740][106226] Updated weights for policy 0, policy_version 1405272 (0.0008) [2023-12-28 05:21:33,794][106226] Updated weights for policy 0, policy_version 1405282 (0.0008) [2023-12-28 05:21:33,843][106226] Updated weights for policy 0, policy_version 1405292 (0.0008) [2023-12-28 05:21:34,267][106225] Updated weights for policy 1, policy_version 1408571 (0.0007) [2023-12-28 05:21:34,323][106225] Updated weights for policy 1, policy_version 1408581 (0.0008) [2023-12-28 05:21:34,385][106225] Updated weights for policy 1, policy_version 1408591 (0.0008) [2023-12-28 05:21:34,640][106226] Updated weights for policy 0, policy_version 1405302 (0.0007) [2023-12-28 05:21:34,702][106226] Updated weights for policy 0, policy_version 1405312 (0.0006) [2023-12-28 05:21:34,761][106226] Updated weights for policy 0, policy_version 1405322 (0.0009) [2023-12-28 05:21:35,141][106225] Updated weights for policy 1, policy_version 1408601 (0.0009) [2023-12-28 05:21:35,192][106225] Updated weights for policy 1, policy_version 1408611 (0.0008) [2023-12-28 05:21:35,237][106225] Updated weights for policy 1, policy_version 1408621 (0.0008) [2023-12-28 05:21:35,284][106225] Updated weights for policy 1, policy_version 1408631 (0.0007) [2023-12-28 05:21:35,446][106226] Updated weights for policy 0, policy_version 1405332 (0.0009) [2023-12-28 05:21:35,491][106226] Updated weights for policy 0, policy_version 1405342 (0.0007) [2023-12-28 05:21:35,539][106226] Updated weights for policy 0, policy_version 1405352 (0.0008) [2023-12-28 05:21:36,025][106225] Updated weights for policy 1, policy_version 1408641 (0.0008) [2023-12-28 05:21:36,076][106225] Updated weights for policy 1, policy_version 1408651 (0.0009) [2023-12-28 05:21:36,140][106225] Updated weights for policy 1, policy_version 1408661 (0.0009) [2023-12-28 05:21:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 720510976. Throughput: 0: 9846.6, 1: 10015.8. Samples: 720518092. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:36,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-4.675')] [2023-12-28 05:21:36,292][106226] Updated weights for policy 0, policy_version 1405362 (0.0007) [2023-12-28 05:21:36,350][106226] Updated weights for policy 0, policy_version 1405372 (0.0006) [2023-12-28 05:21:36,415][106226] Updated weights for policy 0, policy_version 1405382 (0.0006) [2023-12-28 05:21:36,480][106226] Updated weights for policy 0, policy_version 1405392 (0.0007) [2023-12-28 05:21:36,957][106225] Updated weights for policy 1, policy_version 1408671 (0.0008) [2023-12-28 05:21:37,022][106225] Updated weights for policy 1, policy_version 1408681 (0.0009) [2023-12-28 05:21:37,077][106226] Updated weights for policy 0, policy_version 1405402 (0.0007) [2023-12-28 05:21:37,082][106225] Updated weights for policy 1, policy_version 1408691 (0.0007) [2023-12-28 05:21:37,137][106226] Updated weights for policy 0, policy_version 1405412 (0.0007) [2023-12-28 05:21:37,193][106226] Updated weights for policy 0, policy_version 1405422 (0.0007) [2023-12-28 05:21:37,722][106225] Updated weights for policy 1, policy_version 1408701 (0.0007) [2023-12-28 05:21:37,782][106225] Updated weights for policy 1, policy_version 1408711 (0.0007) [2023-12-28 05:21:37,798][106226] Updated weights for policy 0, policy_version 1405432 (0.0008) [2023-12-28 05:21:37,845][106225] Updated weights for policy 1, policy_version 1408721 (0.0008) [2023-12-28 05:21:37,859][106226] Updated weights for policy 0, policy_version 1405442 (0.0009) [2023-12-28 05:21:37,920][106226] Updated weights for policy 0, policy_version 1405452 (0.0010) [2023-12-28 05:21:38,536][106225] Updated weights for policy 1, policy_version 1408731 (0.0009) [2023-12-28 05:21:38,596][106225] Updated weights for policy 1, policy_version 1408741 (0.0009) [2023-12-28 05:21:38,657][106225] Updated weights for policy 1, policy_version 1408751 (0.0010) [2023-12-28 05:21:38,692][106226] Updated weights for policy 0, policy_version 1405462 (0.0009) [2023-12-28 05:21:38,742][106226] Updated weights for policy 0, policy_version 1405472 (0.0009) [2023-12-28 05:21:38,790][106226] Updated weights for policy 0, policy_version 1405482 (0.0008) [2023-12-28 05:21:39,334][106225] Updated weights for policy 1, policy_version 1408761 (0.0010) [2023-12-28 05:21:39,407][106225] Updated weights for policy 1, policy_version 1408771 (0.0009) [2023-12-28 05:21:39,467][106225] Updated weights for policy 1, policy_version 1408781 (0.0007) [2023-12-28 05:21:39,527][106225] Updated weights for policy 1, policy_version 1408791 (0.0009) [2023-12-28 05:21:39,551][106226] Updated weights for policy 0, policy_version 1405492 (0.0007) [2023-12-28 05:21:39,622][106226] Updated weights for policy 0, policy_version 1405502 (0.0008) [2023-12-28 05:21:39,685][106226] Updated weights for policy 0, policy_version 1405512 (0.0009) [2023-12-28 05:21:40,203][106225] Updated weights for policy 1, policy_version 1408801 (0.0009) [2023-12-28 05:21:40,265][106225] Updated weights for policy 1, policy_version 1408811 (0.0011) [2023-12-28 05:21:40,332][106225] Updated weights for policy 1, policy_version 1408821 (0.0011) [2023-12-28 05:21:40,397][106226] Updated weights for policy 0, policy_version 1405522 (0.0008) [2023-12-28 05:21:40,462][106226] Updated weights for policy 0, policy_version 1405532 (0.0008) [2023-12-28 05:21:40,532][106226] Updated weights for policy 0, policy_version 1405542 (0.0009) [2023-12-28 05:21:40,581][106226] Updated weights for policy 0, policy_version 1405552 (0.0009) [2023-12-28 05:21:41,007][106225] Updated weights for policy 1, policy_version 1408831 (0.0009) [2023-12-28 05:21:41,089][106225] Updated weights for policy 1, policy_version 1408841 (0.0008) [2023-12-28 05:21:41,153][106225] Updated weights for policy 1, policy_version 1408851 (0.0009) [2023-12-28 05:21:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 720601088. Throughput: 0: 9836.4, 1: 10014.5. Samples: 720576980. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:21:41,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.866')] [2023-12-28 05:21:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001405552_359890944.pth... [2023-12-28 05:21:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001404400_359596032.pth [2023-12-28 05:21:41,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001408856_360718336.pth... [2023-12-28 05:21:41,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001407672_360415232.pth [2023-12-28 05:21:41,343][106226] Updated weights for policy 0, policy_version 1405562 (0.0009) [2023-12-28 05:21:41,407][106226] Updated weights for policy 0, policy_version 1405572 (0.0009) [2023-12-28 05:21:41,465][106226] Updated weights for policy 0, policy_version 1405582 (0.0007) [2023-12-28 05:21:41,946][106225] Updated weights for policy 1, policy_version 1408861 (0.0009) [2023-12-28 05:21:42,010][106225] Updated weights for policy 1, policy_version 1408871 (0.0009) [2023-12-28 05:21:42,070][106225] Updated weights for policy 1, policy_version 1408881 (0.0008) [2023-12-28 05:21:42,233][106226] Updated weights for policy 0, policy_version 1405592 (0.0008) [2023-12-28 05:21:42,304][106226] Updated weights for policy 0, policy_version 1405602 (0.0008) [2023-12-28 05:21:42,371][106226] Updated weights for policy 0, policy_version 1405612 (0.0008) [2023-12-28 05:21:42,784][106225] Updated weights for policy 1, policy_version 1408891 (0.0009) [2023-12-28 05:21:42,847][106225] Updated weights for policy 1, policy_version 1408901 (0.0009) [2023-12-28 05:21:42,909][106225] Updated weights for policy 1, policy_version 1408911 (0.0008) [2023-12-28 05:21:43,106][106226] Updated weights for policy 0, policy_version 1405622 (0.0010) [2023-12-28 05:21:43,166][106226] Updated weights for policy 0, policy_version 1405632 (0.0009) [2023-12-28 05:21:43,227][106226] Updated weights for policy 0, policy_version 1405642 (0.0008) [2023-12-28 05:21:43,647][106225] Updated weights for policy 1, policy_version 1408921 (0.0008) [2023-12-28 05:21:43,705][106225] Updated weights for policy 1, policy_version 1408931 (0.0008) [2023-12-28 05:21:43,760][106225] Updated weights for policy 1, policy_version 1408941 (0.0008) [2023-12-28 05:21:43,820][106225] Updated weights for policy 1, policy_version 1408951 (0.0008) [2023-12-28 05:21:43,926][106226] Updated weights for policy 0, policy_version 1405652 (0.0009) [2023-12-28 05:21:43,978][106226] Updated weights for policy 0, policy_version 1405662 (0.0008) [2023-12-28 05:21:44,027][106226] Updated weights for policy 0, policy_version 1405672 (0.0008) [2023-12-28 05:21:44,595][106225] Updated weights for policy 1, policy_version 1408961 (0.0008) [2023-12-28 05:21:44,645][106225] Updated weights for policy 1, policy_version 1408971 (0.0008) [2023-12-28 05:21:44,667][106226] Updated weights for policy 0, policy_version 1405682 (0.0009) [2023-12-28 05:21:44,703][106225] Updated weights for policy 1, policy_version 1408981 (0.0007) [2023-12-28 05:21:44,730][106226] Updated weights for policy 0, policy_version 1405692 (0.0009) [2023-12-28 05:21:44,799][106226] Updated weights for policy 0, policy_version 1405702 (0.0008) [2023-12-28 05:21:44,865][106226] Updated weights for policy 0, policy_version 1405712 (0.0011) [2023-12-28 05:21:45,396][106225] Updated weights for policy 1, policy_version 1408991 (0.0006) [2023-12-28 05:21:45,447][106225] Updated weights for policy 1, policy_version 1409001 (0.0005) [2023-12-28 05:21:45,497][106225] Updated weights for policy 1, policy_version 1409011 (0.0007) [2023-12-28 05:21:45,591][106226] Updated weights for policy 0, policy_version 1405722 (0.0005) [2023-12-28 05:21:45,651][106226] Updated weights for policy 0, policy_version 1405732 (0.0006) [2023-12-28 05:21:45,708][106226] Updated weights for policy 0, policy_version 1405742 (0.0005) [2023-12-28 05:21:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 720699392. Throughput: 0: 9801.7, 1: 9977.1. Samples: 720690400. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:21:46,176][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.799')] [2023-12-28 05:21:46,229][106225] Updated weights for policy 1, policy_version 1409021 (0.0008) [2023-12-28 05:21:46,277][106225] Updated weights for policy 1, policy_version 1409031 (0.0010) [2023-12-28 05:21:46,316][106226] Updated weights for policy 0, policy_version 1405752 (0.0006) [2023-12-28 05:21:46,323][106225] Updated weights for policy 1, policy_version 1409041 (0.0009) [2023-12-28 05:21:46,372][106226] Updated weights for policy 0, policy_version 1405762 (0.0005) [2023-12-28 05:21:46,440][106226] Updated weights for policy 0, policy_version 1405772 (0.0005) [2023-12-28 05:21:46,970][106225] Updated weights for policy 1, policy_version 1409051 (0.0009) [2023-12-28 05:21:47,016][106225] Updated weights for policy 1, policy_version 1409061 (0.0008) [2023-12-28 05:21:47,025][106226] Updated weights for policy 0, policy_version 1405782 (0.0006) [2023-12-28 05:21:47,063][106225] Updated weights for policy 1, policy_version 1409071 (0.0005) [2023-12-28 05:21:47,088][106226] Updated weights for policy 0, policy_version 1405792 (0.0010) [2023-12-28 05:21:47,142][106226] Updated weights for policy 0, policy_version 1405802 (0.0005) [2023-12-28 05:21:47,660][106226] Updated weights for policy 0, policy_version 1405812 (0.0005) [2023-12-28 05:21:47,711][106226] Updated weights for policy 0, policy_version 1405822 (0.0005) [2023-12-28 05:21:47,769][106226] Updated weights for policy 0, policy_version 1405832 (0.0005) [2023-12-28 05:21:47,832][106225] Updated weights for policy 1, policy_version 1409081 (0.0006) [2023-12-28 05:21:47,891][106225] Updated weights for policy 1, policy_version 1409091 (0.0008) [2023-12-28 05:21:47,948][106225] Updated weights for policy 1, policy_version 1409101 (0.0005) [2023-12-28 05:21:47,997][106225] Updated weights for policy 1, policy_version 1409111 (0.0008) [2023-12-28 05:21:48,446][106226] Updated weights for policy 0, policy_version 1405842 (0.0006) [2023-12-28 05:21:48,504][106226] Updated weights for policy 0, policy_version 1405852 (0.0008) [2023-12-28 05:21:48,565][106226] Updated weights for policy 0, policy_version 1405862 (0.0009) [2023-12-28 05:21:48,630][106226] Updated weights for policy 0, policy_version 1405872 (0.0007) [2023-12-28 05:21:48,736][106225] Updated weights for policy 1, policy_version 1409121 (0.0005) [2023-12-28 05:21:48,783][106225] Updated weights for policy 1, policy_version 1409131 (0.0008) [2023-12-28 05:21:48,828][106225] Updated weights for policy 1, policy_version 1409141 (0.0008) [2023-12-28 05:21:49,389][106226] Updated weights for policy 0, policy_version 1405882 (0.0009) [2023-12-28 05:21:49,446][106226] Updated weights for policy 0, policy_version 1405892 (0.0008) [2023-12-28 05:21:49,505][106226] Updated weights for policy 0, policy_version 1405902 (0.0008) [2023-12-28 05:21:49,519][106225] Updated weights for policy 1, policy_version 1409151 (0.0007) [2023-12-28 05:21:49,582][106225] Updated weights for policy 1, policy_version 1409161 (0.0008) [2023-12-28 05:21:49,645][106225] Updated weights for policy 1, policy_version 1409171 (0.0008) [2023-12-28 05:21:50,271][106226] Updated weights for policy 0, policy_version 1405912 (0.0009) [2023-12-28 05:21:50,281][106225] Updated weights for policy 1, policy_version 1409181 (0.0007) [2023-12-28 05:21:50,330][106225] Updated weights for policy 1, policy_version 1409191 (0.0008) [2023-12-28 05:21:50,333][106226] Updated weights for policy 0, policy_version 1405922 (0.0011) [2023-12-28 05:21:50,390][106225] Updated weights for policy 1, policy_version 1409201 (0.0007) [2023-12-28 05:21:50,394][106226] Updated weights for policy 0, policy_version 1405932 (0.0011) [2023-12-28 05:21:51,036][106226] Updated weights for policy 0, policy_version 1405942 (0.0011) [2023-12-28 05:21:51,106][106226] Updated weights for policy 0, policy_version 1405952 (0.0009) [2023-12-28 05:21:51,171][106226] Updated weights for policy 0, policy_version 1405962 (0.0008) [2023-12-28 05:21:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 720797696. Throughput: 0: 9886.3, 1: 9940.4. Samples: 720812828. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:21:51,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.820')] [2023-12-28 05:21:51,237][106225] Updated weights for policy 1, policy_version 1409211 (0.0008) [2023-12-28 05:21:51,306][106225] Updated weights for policy 1, policy_version 1409221 (0.0009) [2023-12-28 05:21:51,373][106225] Updated weights for policy 1, policy_version 1409231 (0.0008) [2023-12-28 05:21:51,890][106226] Updated weights for policy 0, policy_version 1405972 (0.0009) [2023-12-28 05:21:51,951][106226] Updated weights for policy 0, policy_version 1405982 (0.0008) [2023-12-28 05:21:52,015][106226] Updated weights for policy 0, policy_version 1405992 (0.0009) [2023-12-28 05:21:52,135][106225] Updated weights for policy 1, policy_version 1409241 (0.0006) [2023-12-28 05:21:52,192][106225] Updated weights for policy 1, policy_version 1409251 (0.0007) [2023-12-28 05:21:52,255][106225] Updated weights for policy 1, policy_version 1409261 (0.0007) [2023-12-28 05:21:52,315][106225] Updated weights for policy 1, policy_version 1409271 (0.0006) [2023-12-28 05:21:52,709][106226] Updated weights for policy 0, policy_version 1406002 (0.0008) [2023-12-28 05:21:52,767][106226] Updated weights for policy 0, policy_version 1406012 (0.0006) [2023-12-28 05:21:52,833][106226] Updated weights for policy 0, policy_version 1406022 (0.0008) [2023-12-28 05:21:52,895][106226] Updated weights for policy 0, policy_version 1406032 (0.0008) [2023-12-28 05:21:53,002][106225] Updated weights for policy 1, policy_version 1409281 (0.0006) [2023-12-28 05:21:53,055][106225] Updated weights for policy 1, policy_version 1409291 (0.0006) [2023-12-28 05:21:53,108][106225] Updated weights for policy 1, policy_version 1409301 (0.0006) [2023-12-28 05:21:53,541][106226] Updated weights for policy 0, policy_version 1406042 (0.0010) [2023-12-28 05:21:53,601][106226] Updated weights for policy 0, policy_version 1406052 (0.0005) [2023-12-28 05:21:53,666][106226] Updated weights for policy 0, policy_version 1406062 (0.0006) [2023-12-28 05:21:53,838][106225] Updated weights for policy 1, policy_version 1409311 (0.0009) [2023-12-28 05:21:53,891][106225] Updated weights for policy 1, policy_version 1409321 (0.0008) [2023-12-28 05:21:53,946][106225] Updated weights for policy 1, policy_version 1409331 (0.0010) [2023-12-28 05:21:54,251][106226] Updated weights for policy 0, policy_version 1406072 (0.0006) [2023-12-28 05:21:54,315][106226] Updated weights for policy 0, policy_version 1406082 (0.0008) [2023-12-28 05:21:54,381][106226] Updated weights for policy 0, policy_version 1406092 (0.0011) [2023-12-28 05:21:54,558][106225] Updated weights for policy 1, policy_version 1409341 (0.0010) [2023-12-28 05:21:54,617][106225] Updated weights for policy 1, policy_version 1409351 (0.0010) [2023-12-28 05:21:54,676][106225] Updated weights for policy 1, policy_version 1409361 (0.0006) [2023-12-28 05:21:55,003][106226] Updated weights for policy 0, policy_version 1406102 (0.0011) [2023-12-28 05:21:55,057][106226] Updated weights for policy 0, policy_version 1406112 (0.0011) [2023-12-28 05:21:55,105][106226] Updated weights for policy 0, policy_version 1406122 (0.0010) [2023-12-28 05:21:55,313][106225] Updated weights for policy 1, policy_version 1409371 (0.0009) [2023-12-28 05:21:55,362][106225] Updated weights for policy 1, policy_version 1409381 (0.0010) [2023-12-28 05:21:55,411][106225] Updated weights for policy 1, policy_version 1409391 (0.0010) [2023-12-28 05:21:55,826][106226] Updated weights for policy 0, policy_version 1406132 (0.0010) [2023-12-28 05:21:55,876][106226] Updated weights for policy 0, policy_version 1406142 (0.0010) [2023-12-28 05:21:55,922][106226] Updated weights for policy 0, policy_version 1406152 (0.0010) [2023-12-28 05:21:56,000][106225] Updated weights for policy 1, policy_version 1409401 (0.0009) [2023-12-28 05:21:56,055][106225] Updated weights for policy 1, policy_version 1409411 (0.0005) [2023-12-28 05:21:56,108][106225] Updated weights for policy 1, policy_version 1409421 (0.0006) [2023-12-28 05:21:56,158][106225] Updated weights for policy 1, policy_version 1409431 (0.0007) [2023-12-28 05:21:56,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 720912384. Throughput: 0: 9897.0, 1: 9916.9. Samples: 720871756. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:21:56,176][105115] Avg episode reward: [(0, '-4.821'), (1, '-4.888')] [2023-12-28 05:21:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001409432_360865792.pth... [2023-12-28 05:21:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001406160_360046592.pth... [2023-12-28 05:21:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001404976_359743488.pth [2023-12-28 05:21:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001408248_360562688.pth [2023-12-28 05:21:56,658][106226] Updated weights for policy 0, policy_version 1406162 (0.0010) [2023-12-28 05:21:56,715][106226] Updated weights for policy 0, policy_version 1406172 (0.0010) [2023-12-28 05:21:56,767][106225] Updated weights for policy 1, policy_version 1409441 (0.0005) [2023-12-28 05:21:56,774][106226] Updated weights for policy 0, policy_version 1406182 (0.0010) [2023-12-28 05:21:56,825][106225] Updated weights for policy 1, policy_version 1409451 (0.0005) [2023-12-28 05:21:56,840][106226] Updated weights for policy 0, policy_version 1406192 (0.0011) [2023-12-28 05:21:56,872][106225] Updated weights for policy 1, policy_version 1409461 (0.0005) [2023-12-28 05:21:57,503][106226] Updated weights for policy 0, policy_version 1406202 (0.0010) [2023-12-28 05:21:57,554][106225] Updated weights for policy 1, policy_version 1409471 (0.0009) [2023-12-28 05:21:57,555][106226] Updated weights for policy 0, policy_version 1406212 (0.0010) [2023-12-28 05:21:57,610][106226] Updated weights for policy 0, policy_version 1406222 (0.0010) [2023-12-28 05:21:57,613][106225] Updated weights for policy 1, policy_version 1409481 (0.0010) [2023-12-28 05:21:57,665][106225] Updated weights for policy 1, policy_version 1409491 (0.0010) [2023-12-28 05:21:58,323][106226] Updated weights for policy 0, policy_version 1406232 (0.0007) [2023-12-28 05:21:58,354][106225] Updated weights for policy 1, policy_version 1409501 (0.0009) [2023-12-28 05:21:58,389][106226] Updated weights for policy 0, policy_version 1406242 (0.0008) [2023-12-28 05:21:58,419][106225] Updated weights for policy 1, policy_version 1409511 (0.0009) [2023-12-28 05:21:58,460][106226] Updated weights for policy 0, policy_version 1406252 (0.0009) [2023-12-28 05:21:58,490][106225] Updated weights for policy 1, policy_version 1409521 (0.0008) [2023-12-28 05:21:59,261][106226] Updated weights for policy 0, policy_version 1406262 (0.0014) [2023-12-28 05:21:59,331][106226] Updated weights for policy 0, policy_version 1406272 (0.0009) [2023-12-28 05:21:59,336][106225] Updated weights for policy 1, policy_version 1409531 (0.0008) [2023-12-28 05:21:59,402][106226] Updated weights for policy 0, policy_version 1406282 (0.0008) [2023-12-28 05:21:59,410][106225] Updated weights for policy 1, policy_version 1409541 (0.0009) [2023-12-28 05:21:59,470][106225] Updated weights for policy 1, policy_version 1409551 (0.0008) [2023-12-28 05:22:00,104][106226] Updated weights for policy 0, policy_version 1406292 (0.0006) [2023-12-28 05:22:00,161][106226] Updated weights for policy 0, policy_version 1406302 (0.0007) [2023-12-28 05:22:00,220][106226] Updated weights for policy 0, policy_version 1406312 (0.0008) [2023-12-28 05:22:00,247][106225] Updated weights for policy 1, policy_version 1409561 (0.0008) [2023-12-28 05:22:00,309][106225] Updated weights for policy 1, policy_version 1409571 (0.0006) [2023-12-28 05:22:00,363][106225] Updated weights for policy 1, policy_version 1409581 (0.0006) [2023-12-28 05:22:00,421][106225] Updated weights for policy 1, policy_version 1409591 (0.0008) [2023-12-28 05:22:00,962][106226] Updated weights for policy 0, policy_version 1406322 (0.0008) [2023-12-28 05:22:01,006][106225] Updated weights for policy 1, policy_version 1409601 (0.0005) [2023-12-28 05:22:01,016][106226] Updated weights for policy 0, policy_version 1406332 (0.0007) [2023-12-28 05:22:01,066][106225] Updated weights for policy 1, policy_version 1409611 (0.0008) [2023-12-28 05:22:01,083][106226] Updated weights for policy 0, policy_version 1406342 (0.0007) [2023-12-28 05:22:01,115][106225] Updated weights for policy 1, policy_version 1409621 (0.0007) [2023-12-28 05:22:01,150][106226] Updated weights for policy 0, policy_version 1406352 (0.0007) [2023-12-28 05:22:01,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 721010688. Throughput: 0: 9972.7, 1: 9980.1. Samples: 720992156. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:01,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.901')] [2023-12-28 05:22:01,832][106226] Updated weights for policy 0, policy_version 1406362 (0.0005) [2023-12-28 05:22:01,879][106225] Updated weights for policy 1, policy_version 1409631 (0.0006) [2023-12-28 05:22:01,892][106226] Updated weights for policy 0, policy_version 1406372 (0.0008) [2023-12-28 05:22:01,931][106225] Updated weights for policy 1, policy_version 1409641 (0.0008) [2023-12-28 05:22:01,949][106226] Updated weights for policy 0, policy_version 1406382 (0.0007) [2023-12-28 05:22:01,979][106225] Updated weights for policy 1, policy_version 1409651 (0.0009) [2023-12-28 05:22:02,615][106226] Updated weights for policy 0, policy_version 1406392 (0.0008) [2023-12-28 05:22:02,670][106226] Updated weights for policy 0, policy_version 1406402 (0.0008) [2023-12-28 05:22:02,697][106225] Updated weights for policy 1, policy_version 1409661 (0.0007) [2023-12-28 05:22:02,732][106226] Updated weights for policy 0, policy_version 1406412 (0.0008) [2023-12-28 05:22:02,756][106225] Updated weights for policy 1, policy_version 1409671 (0.0008) [2023-12-28 05:22:02,817][106225] Updated weights for policy 1, policy_version 1409681 (0.0008) [2023-12-28 05:22:03,415][106226] Updated weights for policy 0, policy_version 1406422 (0.0006) [2023-12-28 05:22:03,469][106226] Updated weights for policy 0, policy_version 1406432 (0.0005) [2023-12-28 05:22:03,535][106226] Updated weights for policy 0, policy_version 1406442 (0.0005) [2023-12-28 05:22:03,581][106225] Updated weights for policy 1, policy_version 1409691 (0.0008) [2023-12-28 05:22:03,630][106225] Updated weights for policy 1, policy_version 1409701 (0.0009) [2023-12-28 05:22:03,686][106225] Updated weights for policy 1, policy_version 1409711 (0.0009) [2023-12-28 05:22:04,048][106226] Updated weights for policy 0, policy_version 1406452 (0.0007) [2023-12-28 05:22:04,109][106226] Updated weights for policy 0, policy_version 1406462 (0.0009) [2023-12-28 05:22:04,182][106226] Updated weights for policy 0, policy_version 1406472 (0.0009) [2023-12-28 05:22:04,480][106225] Updated weights for policy 1, policy_version 1409721 (0.0008) [2023-12-28 05:22:04,543][106225] Updated weights for policy 1, policy_version 1409731 (0.0008) [2023-12-28 05:22:04,602][106225] Updated weights for policy 1, policy_version 1409741 (0.0009) [2023-12-28 05:22:04,661][106225] Updated weights for policy 1, policy_version 1409751 (0.0008) [2023-12-28 05:22:04,868][106226] Updated weights for policy 0, policy_version 1406482 (0.0009) [2023-12-28 05:22:04,929][106226] Updated weights for policy 0, policy_version 1406492 (0.0008) [2023-12-28 05:22:04,987][106226] Updated weights for policy 0, policy_version 1406502 (0.0007) [2023-12-28 05:22:05,045][106226] Updated weights for policy 0, policy_version 1406512 (0.0005) [2023-12-28 05:22:05,421][106225] Updated weights for policy 1, policy_version 1409761 (0.0006) [2023-12-28 05:22:05,469][106225] Updated weights for policy 1, policy_version 1409771 (0.0005) [2023-12-28 05:22:05,516][106225] Updated weights for policy 1, policy_version 1409781 (0.0005) [2023-12-28 05:22:05,693][106226] Updated weights for policy 0, policy_version 1406522 (0.0005) [2023-12-28 05:22:05,747][106226] Updated weights for policy 0, policy_version 1406532 (0.0006) [2023-12-28 05:22:05,807][106226] Updated weights for policy 0, policy_version 1406542 (0.0011) [2023-12-28 05:22:06,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 721100800. Throughput: 0: 10000.0, 1: 9861.0. Samples: 721111508. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:06,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.667')] [2023-12-28 05:22:06,211][106225] Updated weights for policy 1, policy_version 1409791 (0.0007) [2023-12-28 05:22:06,270][106225] Updated weights for policy 1, policy_version 1409801 (0.0008) [2023-12-28 05:22:06,332][106225] Updated weights for policy 1, policy_version 1409811 (0.0008) [2023-12-28 05:22:06,501][106226] Updated weights for policy 0, policy_version 1406552 (0.0010) [2023-12-28 05:22:06,559][106226] Updated weights for policy 0, policy_version 1406562 (0.0010) [2023-12-28 05:22:06,613][106226] Updated weights for policy 0, policy_version 1406572 (0.0011) [2023-12-28 05:22:07,023][106225] Updated weights for policy 1, policy_version 1409821 (0.0009) [2023-12-28 05:22:07,066][106225] Updated weights for policy 1, policy_version 1409831 (0.0010) [2023-12-28 05:22:07,117][106225] Updated weights for policy 1, policy_version 1409841 (0.0010) [2023-12-28 05:22:07,260][106226] Updated weights for policy 0, policy_version 1406582 (0.0011) [2023-12-28 05:22:07,321][106226] Updated weights for policy 0, policy_version 1406592 (0.0011) [2023-12-28 05:22:07,378][106226] Updated weights for policy 0, policy_version 1406602 (0.0011) [2023-12-28 05:22:07,800][106225] Updated weights for policy 1, policy_version 1409851 (0.0009) [2023-12-28 05:22:07,857][106225] Updated weights for policy 1, policy_version 1409861 (0.0005) [2023-12-28 05:22:07,915][106225] Updated weights for policy 1, policy_version 1409871 (0.0005) [2023-12-28 05:22:08,042][106226] Updated weights for policy 0, policy_version 1406612 (0.0010) [2023-12-28 05:22:08,101][106226] Updated weights for policy 0, policy_version 1406622 (0.0011) [2023-12-28 05:22:08,158][106226] Updated weights for policy 0, policy_version 1406632 (0.0010) [2023-12-28 05:22:08,560][106225] Updated weights for policy 1, policy_version 1409881 (0.0009) [2023-12-28 05:22:08,620][106225] Updated weights for policy 1, policy_version 1409891 (0.0010) [2023-12-28 05:22:08,675][106225] Updated weights for policy 1, policy_version 1409901 (0.0010) [2023-12-28 05:22:08,729][106225] Updated weights for policy 1, policy_version 1409911 (0.0010) [2023-12-28 05:22:08,897][106226] Updated weights for policy 0, policy_version 1406642 (0.0010) [2023-12-28 05:22:08,957][106226] Updated weights for policy 0, policy_version 1406652 (0.0011) [2023-12-28 05:22:09,016][106226] Updated weights for policy 0, policy_version 1406662 (0.0010) [2023-12-28 05:22:09,075][106226] Updated weights for policy 0, policy_version 1406672 (0.0010) [2023-12-28 05:22:09,474][106225] Updated weights for policy 1, policy_version 1409921 (0.0009) [2023-12-28 05:22:09,540][106225] Updated weights for policy 1, policy_version 1409931 (0.0011) [2023-12-28 05:22:09,605][106225] Updated weights for policy 1, policy_version 1409941 (0.0010) [2023-12-28 05:22:09,779][106226] Updated weights for policy 0, policy_version 1406682 (0.0011) [2023-12-28 05:22:09,838][106226] Updated weights for policy 0, policy_version 1406692 (0.0010) [2023-12-28 05:22:09,893][106226] Updated weights for policy 0, policy_version 1406702 (0.0011) [2023-12-28 05:22:10,297][106225] Updated weights for policy 1, policy_version 1409951 (0.0007) [2023-12-28 05:22:10,359][106225] Updated weights for policy 1, policy_version 1409961 (0.0007) [2023-12-28 05:22:10,427][106225] Updated weights for policy 1, policy_version 1409971 (0.0005) [2023-12-28 05:22:10,666][106226] Updated weights for policy 0, policy_version 1406712 (0.0010) [2023-12-28 05:22:10,731][106226] Updated weights for policy 0, policy_version 1406722 (0.0011) [2023-12-28 05:22:10,794][106226] Updated weights for policy 0, policy_version 1406732 (0.0011) [2023-12-28 05:22:11,076][106225] Updated weights for policy 1, policy_version 1409981 (0.0007) [2023-12-28 05:22:11,145][106225] Updated weights for policy 1, policy_version 1409991 (0.0007) [2023-12-28 05:22:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 721199104. Throughput: 0: 9988.0, 1: 9911.4. Samples: 721171784. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:11,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-4.681')] [2023-12-28 05:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001406736_360194048.pth... [2023-12-28 05:22:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001405552_359890944.pth [2023-12-28 05:22:11,211][106225] Updated weights for policy 1, policy_version 1410001 (0.0007) [2023-12-28 05:22:11,252][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001410008_361013248.pth... [2023-12-28 05:22:11,256][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001408856_360718336.pth [2023-12-28 05:22:11,585][106226] Updated weights for policy 0, policy_version 1406742 (0.0011) [2023-12-28 05:22:11,656][106226] Updated weights for policy 0, policy_version 1406752 (0.0011) [2023-12-28 05:22:11,730][106226] Updated weights for policy 0, policy_version 1406762 (0.0009) [2023-12-28 05:22:11,968][106225] Updated weights for policy 1, policy_version 1410011 (0.0007) [2023-12-28 05:22:12,035][106225] Updated weights for policy 1, policy_version 1410021 (0.0008) [2023-12-28 05:22:12,101][106225] Updated weights for policy 1, policy_version 1410031 (0.0008) [2023-12-28 05:22:12,468][106226] Updated weights for policy 0, policy_version 1406772 (0.0008) [2023-12-28 05:22:12,530][106226] Updated weights for policy 0, policy_version 1406782 (0.0009) [2023-12-28 05:22:12,585][106226] Updated weights for policy 0, policy_version 1406792 (0.0009) [2023-12-28 05:22:12,858][106225] Updated weights for policy 1, policy_version 1410041 (0.0009) [2023-12-28 05:22:12,926][106225] Updated weights for policy 1, policy_version 1410051 (0.0006) [2023-12-28 05:22:12,981][106225] Updated weights for policy 1, policy_version 1410061 (0.0008) [2023-12-28 05:22:13,036][106225] Updated weights for policy 1, policy_version 1410071 (0.0008) [2023-12-28 05:22:13,346][106226] Updated weights for policy 0, policy_version 1406802 (0.0009) [2023-12-28 05:22:13,405][106226] Updated weights for policy 0, policy_version 1406812 (0.0009) [2023-12-28 05:22:13,466][106226] Updated weights for policy 0, policy_version 1406822 (0.0006) [2023-12-28 05:22:13,524][106226] Updated weights for policy 0, policy_version 1406832 (0.0005) [2023-12-28 05:22:13,723][106225] Updated weights for policy 1, policy_version 1410081 (0.0008) [2023-12-28 05:22:13,785][106225] Updated weights for policy 1, policy_version 1410091 (0.0008) [2023-12-28 05:22:13,842][106225] Updated weights for policy 1, policy_version 1410101 (0.0008) [2023-12-28 05:22:14,107][106226] Updated weights for policy 0, policy_version 1406842 (0.0007) [2023-12-28 05:22:14,165][106226] Updated weights for policy 0, policy_version 1406852 (0.0009) [2023-12-28 05:22:14,232][106226] Updated weights for policy 0, policy_version 1406862 (0.0008) [2023-12-28 05:22:14,599][106225] Updated weights for policy 1, policy_version 1410111 (0.0006) [2023-12-28 05:22:14,663][106225] Updated weights for policy 1, policy_version 1410121 (0.0009) [2023-12-28 05:22:14,722][106225] Updated weights for policy 1, policy_version 1410131 (0.0008) [2023-12-28 05:22:14,940][106226] Updated weights for policy 0, policy_version 1406872 (0.0008) [2023-12-28 05:22:15,002][106226] Updated weights for policy 0, policy_version 1406882 (0.0011) [2023-12-28 05:22:15,065][106226] Updated weights for policy 0, policy_version 1406892 (0.0011) [2023-12-28 05:22:15,523][106225] Updated weights for policy 1, policy_version 1410141 (0.0008) [2023-12-28 05:22:15,575][106225] Updated weights for policy 1, policy_version 1410151 (0.0008) [2023-12-28 05:22:15,635][106225] Updated weights for policy 1, policy_version 1410161 (0.0007) [2023-12-28 05:22:15,693][106226] Updated weights for policy 0, policy_version 1406902 (0.0009) [2023-12-28 05:22:15,748][106226] Updated weights for policy 0, policy_version 1406912 (0.0005) [2023-12-28 05:22:15,804][106226] Updated weights for policy 0, policy_version 1406922 (0.0006) [2023-12-28 05:22:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 721297408. Throughput: 0: 9916.2, 1: 9780.7. Samples: 721286300. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:16,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.790')] [2023-12-28 05:22:16,382][106226] Updated weights for policy 0, policy_version 1406932 (0.0008) [2023-12-28 05:22:16,428][106225] Updated weights for policy 1, policy_version 1410171 (0.0007) [2023-12-28 05:22:16,429][106226] Updated weights for policy 0, policy_version 1406942 (0.0011) [2023-12-28 05:22:16,481][106226] Updated weights for policy 0, policy_version 1406952 (0.0011) [2023-12-28 05:22:16,483][106225] Updated weights for policy 1, policy_version 1410181 (0.0006) [2023-12-28 05:22:16,531][106225] Updated weights for policy 1, policy_version 1410191 (0.0008) [2023-12-28 05:22:17,097][106225] Updated weights for policy 1, policy_version 1410201 (0.0006) [2023-12-28 05:22:17,151][106225] Updated weights for policy 1, policy_version 1410211 (0.0005) [2023-12-28 05:22:17,157][106226] Updated weights for policy 0, policy_version 1406962 (0.0010) [2023-12-28 05:22:17,201][106225] Updated weights for policy 1, policy_version 1410221 (0.0006) [2023-12-28 05:22:17,212][106226] Updated weights for policy 0, policy_version 1406972 (0.0008) [2023-12-28 05:22:17,257][106225] Updated weights for policy 1, policy_version 1410231 (0.0005) [2023-12-28 05:22:17,274][106226] Updated weights for policy 0, policy_version 1406982 (0.0009) [2023-12-28 05:22:17,323][106226] Updated weights for policy 0, policy_version 1406992 (0.0009) [2023-12-28 05:22:17,845][106225] Updated weights for policy 1, policy_version 1410241 (0.0006) [2023-12-28 05:22:17,905][106225] Updated weights for policy 1, policy_version 1410251 (0.0005) [2023-12-28 05:22:17,971][106225] Updated weights for policy 1, policy_version 1410261 (0.0006) [2023-12-28 05:22:18,107][106226] Updated weights for policy 0, policy_version 1407002 (0.0008) [2023-12-28 05:22:18,156][106226] Updated weights for policy 0, policy_version 1407012 (0.0007) [2023-12-28 05:22:18,205][106226] Updated weights for policy 0, policy_version 1407022 (0.0008) [2023-12-28 05:22:18,578][106225] Updated weights for policy 1, policy_version 1410271 (0.0008) [2023-12-28 05:22:18,630][106225] Updated weights for policy 1, policy_version 1410281 (0.0007) [2023-12-28 05:22:18,689][106225] Updated weights for policy 1, policy_version 1410291 (0.0008) [2023-12-28 05:22:19,010][106226] Updated weights for policy 0, policy_version 1407032 (0.0008) [2023-12-28 05:22:19,065][106226] Updated weights for policy 0, policy_version 1407042 (0.0008) [2023-12-28 05:22:19,124][106226] Updated weights for policy 0, policy_version 1407052 (0.0009) [2023-12-28 05:22:19,460][106225] Updated weights for policy 1, policy_version 1410301 (0.0007) [2023-12-28 05:22:19,523][106225] Updated weights for policy 1, policy_version 1410311 (0.0009) [2023-12-28 05:22:19,581][106225] Updated weights for policy 1, policy_version 1410321 (0.0008) [2023-12-28 05:22:19,932][106226] Updated weights for policy 0, policy_version 1407062 (0.0011) [2023-12-28 05:22:20,000][106226] Updated weights for policy 0, policy_version 1407072 (0.0009) [2023-12-28 05:22:20,064][106226] Updated weights for policy 0, policy_version 1407082 (0.0011) [2023-12-28 05:22:20,387][106225] Updated weights for policy 1, policy_version 1410331 (0.0008) [2023-12-28 05:22:20,452][106225] Updated weights for policy 1, policy_version 1410341 (0.0008) [2023-12-28 05:22:20,515][106225] Updated weights for policy 1, policy_version 1410351 (0.0008) [2023-12-28 05:22:20,808][106226] Updated weights for policy 0, policy_version 1407092 (0.0010) [2023-12-28 05:22:20,869][106226] Updated weights for policy 0, policy_version 1407102 (0.0011) [2023-12-28 05:22:20,922][106226] Updated weights for policy 0, policy_version 1407112 (0.0011) [2023-12-28 05:22:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 721395712. Throughput: 0: 9922.0, 1: 9768.5. Samples: 721404160. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:21,175][105115] Avg episode reward: [(0, '-4.725'), (1, '-4.682')] [2023-12-28 05:22:21,322][106225] Updated weights for policy 1, policy_version 1410361 (0.0008) [2023-12-28 05:22:21,395][106225] Updated weights for policy 1, policy_version 1410371 (0.0007) [2023-12-28 05:22:21,445][106225] Updated weights for policy 1, policy_version 1410381 (0.0009) [2023-12-28 05:22:21,495][106225] Updated weights for policy 1, policy_version 1410391 (0.0009) [2023-12-28 05:22:21,718][106226] Updated weights for policy 0, policy_version 1407122 (0.0011) [2023-12-28 05:22:21,794][106226] Updated weights for policy 0, policy_version 1407132 (0.0008) [2023-12-28 05:22:21,859][106226] Updated weights for policy 0, policy_version 1407142 (0.0008) [2023-12-28 05:22:21,919][106226] Updated weights for policy 0, policy_version 1407152 (0.0007) [2023-12-28 05:22:22,324][106225] Updated weights for policy 1, policy_version 1410401 (0.0006) [2023-12-28 05:22:22,386][106225] Updated weights for policy 1, policy_version 1410411 (0.0006) [2023-12-28 05:22:22,441][106225] Updated weights for policy 1, policy_version 1410421 (0.0006) [2023-12-28 05:22:22,680][106226] Updated weights for policy 0, policy_version 1407162 (0.0006) [2023-12-28 05:22:22,744][106226] Updated weights for policy 0, policy_version 1407172 (0.0006) [2023-12-28 05:22:22,805][106226] Updated weights for policy 0, policy_version 1407182 (0.0006) [2023-12-28 05:22:23,265][106225] Updated weights for policy 1, policy_version 1410431 (0.0008) [2023-12-28 05:22:23,331][106225] Updated weights for policy 1, policy_version 1410441 (0.0007) [2023-12-28 05:22:23,344][106226] Updated weights for policy 0, policy_version 1407192 (0.0009) [2023-12-28 05:22:23,373][106225] Updated weights for policy 1, policy_version 1410451 (0.0005) [2023-12-28 05:22:23,397][106226] Updated weights for policy 0, policy_version 1407202 (0.0008) [2023-12-28 05:22:23,457][106226] Updated weights for policy 0, policy_version 1407212 (0.0008) [2023-12-28 05:22:24,040][106225] Updated weights for policy 1, policy_version 1410461 (0.0007) [2023-12-28 05:22:24,066][106226] Updated weights for policy 0, policy_version 1407222 (0.0006) [2023-12-28 05:22:24,100][106225] Updated weights for policy 1, policy_version 1410471 (0.0007) [2023-12-28 05:22:24,122][106226] Updated weights for policy 0, policy_version 1407232 (0.0006) [2023-12-28 05:22:24,165][106225] Updated weights for policy 1, policy_version 1410481 (0.0006) [2023-12-28 05:22:24,176][106226] Updated weights for policy 0, policy_version 1407242 (0.0009) [2023-12-28 05:22:24,774][106226] Updated weights for policy 0, policy_version 1407252 (0.0009) [2023-12-28 05:22:24,834][106226] Updated weights for policy 0, policy_version 1407262 (0.0011) [2023-12-28 05:22:24,863][106225] Updated weights for policy 1, policy_version 1410491 (0.0009) [2023-12-28 05:22:24,892][106226] Updated weights for policy 0, policy_version 1407272 (0.0010) [2023-12-28 05:22:24,913][106225] Updated weights for policy 1, policy_version 1410501 (0.0010) [2023-12-28 05:22:24,973][106225] Updated weights for policy 1, policy_version 1410511 (0.0010) [2023-12-28 05:22:25,557][106226] Updated weights for policy 0, policy_version 1407282 (0.0009) [2023-12-28 05:22:25,608][106226] Updated weights for policy 0, policy_version 1407292 (0.0005) [2023-12-28 05:22:25,661][106226] Updated weights for policy 0, policy_version 1407302 (0.0005) [2023-12-28 05:22:25,662][106225] Updated weights for policy 1, policy_version 1410521 (0.0008) [2023-12-28 05:22:25,712][106226] Updated weights for policy 0, policy_version 1407312 (0.0005) [2023-12-28 05:22:25,729][106225] Updated weights for policy 1, policy_version 1410531 (0.0008) [2023-12-28 05:22:25,787][106225] Updated weights for policy 1, policy_version 1410541 (0.0010) [2023-12-28 05:22:25,837][106225] Updated weights for policy 1, policy_version 1410551 (0.0010) [2023-12-28 05:22:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 721494016. Throughput: 0: 9928.5, 1: 9715.7. Samples: 721460964. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:26,175][105115] Avg episode reward: [(0, '-4.225'), (1, '-4.924')] [2023-12-28 05:22:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001410552_361152512.pth... [2023-12-28 05:22:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001407312_360341504.pth... [2023-12-28 05:22:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001409432_360865792.pth [2023-12-28 05:22:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001406160_360046592.pth [2023-12-28 05:22:26,338][106226] Updated weights for policy 0, policy_version 1407322 (0.0009) [2023-12-28 05:22:26,391][106226] Updated weights for policy 0, policy_version 1407332 (0.0008) [2023-12-28 05:22:26,421][106225] Updated weights for policy 1, policy_version 1410561 (0.0010) [2023-12-28 05:22:26,454][106226] Updated weights for policy 0, policy_version 1407342 (0.0006) [2023-12-28 05:22:26,480][106225] Updated weights for policy 1, policy_version 1410571 (0.0011) [2023-12-28 05:22:26,543][106225] Updated weights for policy 1, policy_version 1410581 (0.0009) [2023-12-28 05:22:27,105][106226] Updated weights for policy 0, policy_version 1407352 (0.0008) [2023-12-28 05:22:27,162][106226] Updated weights for policy 0, policy_version 1407362 (0.0009) [2023-12-28 05:22:27,214][106226] Updated weights for policy 0, policy_version 1407372 (0.0008) [2023-12-28 05:22:27,241][106225] Updated weights for policy 1, policy_version 1410591 (0.0008) [2023-12-28 05:22:27,290][106225] Updated weights for policy 1, policy_version 1410601 (0.0007) [2023-12-28 05:22:27,342][106225] Updated weights for policy 1, policy_version 1410611 (0.0008) [2023-12-28 05:22:27,808][106226] Updated weights for policy 0, policy_version 1407382 (0.0008) [2023-12-28 05:22:27,874][106226] Updated weights for policy 0, policy_version 1407392 (0.0010) [2023-12-28 05:22:27,936][106226] Updated weights for policy 0, policy_version 1407402 (0.0009) [2023-12-28 05:22:27,967][106225] Updated weights for policy 1, policy_version 1410621 (0.0007) [2023-12-28 05:22:28,021][106225] Updated weights for policy 1, policy_version 1410631 (0.0008) [2023-12-28 05:22:28,071][106225] Updated weights for policy 1, policy_version 1410641 (0.0009) [2023-12-28 05:22:28,700][106226] Updated weights for policy 0, policy_version 1407412 (0.0008) [2023-12-28 05:22:28,713][106225] Updated weights for policy 1, policy_version 1410651 (0.0009) [2023-12-28 05:22:28,756][106226] Updated weights for policy 0, policy_version 1407422 (0.0007) [2023-12-28 05:22:28,780][106225] Updated weights for policy 1, policy_version 1410661 (0.0010) [2023-12-28 05:22:28,814][106226] Updated weights for policy 0, policy_version 1407432 (0.0005) [2023-12-28 05:22:28,831][106225] Updated weights for policy 1, policy_version 1410671 (0.0010) [2023-12-28 05:22:29,468][106225] Updated weights for policy 1, policy_version 1410681 (0.0010) [2023-12-28 05:22:29,526][106225] Updated weights for policy 1, policy_version 1410691 (0.0005) [2023-12-28 05:22:29,581][106225] Updated weights for policy 1, policy_version 1410701 (0.0008) [2023-12-28 05:22:29,599][106226] Updated weights for policy 0, policy_version 1407442 (0.0007) [2023-12-28 05:22:29,642][106225] Updated weights for policy 1, policy_version 1410711 (0.0007) [2023-12-28 05:22:29,652][106226] Updated weights for policy 0, policy_version 1407452 (0.0006) [2023-12-28 05:22:29,708][106226] Updated weights for policy 0, policy_version 1407462 (0.0008) [2023-12-28 05:22:29,764][106226] Updated weights for policy 0, policy_version 1407472 (0.0007) [2023-12-28 05:22:30,426][106225] Updated weights for policy 1, policy_version 1410721 (0.0009) [2023-12-28 05:22:30,484][106225] Updated weights for policy 1, policy_version 1410731 (0.0007) [2023-12-28 05:22:30,506][106226] Updated weights for policy 0, policy_version 1407482 (0.0006) [2023-12-28 05:22:30,539][106225] Updated weights for policy 1, policy_version 1410741 (0.0006) [2023-12-28 05:22:30,560][106226] Updated weights for policy 0, policy_version 1407492 (0.0006) [2023-12-28 05:22:30,624][106226] Updated weights for policy 0, policy_version 1407502 (0.0008) [2023-12-28 05:22:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 721592320. Throughput: 0: 10031.8, 1: 9860.2. Samples: 721585536. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:31,175][105115] Avg episode reward: [(0, '-4.841'), (1, '-4.937')] [2023-12-28 05:22:31,306][106225] Updated weights for policy 1, policy_version 1410751 (0.0008) [2023-12-28 05:22:31,342][106226] Updated weights for policy 0, policy_version 1407512 (0.0008) [2023-12-28 05:22:31,370][106225] Updated weights for policy 1, policy_version 1410761 (0.0008) [2023-12-28 05:22:31,411][106226] Updated weights for policy 0, policy_version 1407522 (0.0007) [2023-12-28 05:22:31,427][106225] Updated weights for policy 1, policy_version 1410771 (0.0007) [2023-12-28 05:22:31,478][106226] Updated weights for policy 0, policy_version 1407532 (0.0005) [2023-12-28 05:22:32,165][106226] Updated weights for policy 0, policy_version 1407542 (0.0007) [2023-12-28 05:22:32,167][106225] Updated weights for policy 1, policy_version 1410781 (0.0007) [2023-12-28 05:22:32,216][106225] Updated weights for policy 1, policy_version 1410791 (0.0009) [2023-12-28 05:22:32,226][106226] Updated weights for policy 0, policy_version 1407552 (0.0007) [2023-12-28 05:22:32,273][106225] Updated weights for policy 1, policy_version 1410801 (0.0009) [2023-12-28 05:22:32,289][106226] Updated weights for policy 0, policy_version 1407562 (0.0007) [2023-12-28 05:22:32,878][106225] Updated weights for policy 1, policy_version 1410811 (0.0006) [2023-12-28 05:22:32,923][106225] Updated weights for policy 1, policy_version 1410821 (0.0005) [2023-12-28 05:22:32,969][106225] Updated weights for policy 1, policy_version 1410831 (0.0008) [2023-12-28 05:22:32,997][106226] Updated weights for policy 0, policy_version 1407572 (0.0007) [2023-12-28 05:22:33,048][106226] Updated weights for policy 0, policy_version 1407582 (0.0007) [2023-12-28 05:22:33,096][106226] Updated weights for policy 0, policy_version 1407592 (0.0008) [2023-12-28 05:22:33,676][106225] Updated weights for policy 1, policy_version 1410841 (0.0010) [2023-12-28 05:22:33,708][106226] Updated weights for policy 0, policy_version 1407602 (0.0007) [2023-12-28 05:22:33,732][106225] Updated weights for policy 1, policy_version 1410851 (0.0010) [2023-12-28 05:22:33,769][106226] Updated weights for policy 0, policy_version 1407612 (0.0006) [2023-12-28 05:22:33,791][106225] Updated weights for policy 1, policy_version 1410861 (0.0010) [2023-12-28 05:22:33,827][106226] Updated weights for policy 0, policy_version 1407622 (0.0005) [2023-12-28 05:22:33,853][106225] Updated weights for policy 1, policy_version 1410871 (0.0010) [2023-12-28 05:22:33,888][106226] Updated weights for policy 0, policy_version 1407632 (0.0006) [2023-12-28 05:22:34,551][106226] Updated weights for policy 0, policy_version 1407642 (0.0011) [2023-12-28 05:22:34,599][106225] Updated weights for policy 1, policy_version 1410881 (0.0010) [2023-12-28 05:22:34,613][106226] Updated weights for policy 0, policy_version 1407652 (0.0010) [2023-12-28 05:22:34,661][106225] Updated weights for policy 1, policy_version 1410891 (0.0011) [2023-12-28 05:22:34,672][106226] Updated weights for policy 0, policy_version 1407662 (0.0011) [2023-12-28 05:22:34,722][106225] Updated weights for policy 1, policy_version 1410901 (0.0011) [2023-12-28 05:22:35,369][106226] Updated weights for policy 0, policy_version 1407672 (0.0008) [2023-12-28 05:22:35,424][106226] Updated weights for policy 0, policy_version 1407682 (0.0007) [2023-12-28 05:22:35,429][106225] Updated weights for policy 1, policy_version 1410911 (0.0010) [2023-12-28 05:22:35,481][106226] Updated weights for policy 0, policy_version 1407692 (0.0007) [2023-12-28 05:22:35,489][106225] Updated weights for policy 1, policy_version 1410921 (0.0010) [2023-12-28 05:22:35,539][106225] Updated weights for policy 1, policy_version 1410931 (0.0010) [2023-12-28 05:22:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 721690624. Throughput: 0: 9980.7, 1: 9824.9. Samples: 721704080. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:36,175][105115] Avg episode reward: [(0, '-4.980'), (1, '-4.811')] [2023-12-28 05:22:36,193][106226] Updated weights for policy 0, policy_version 1407702 (0.0009) [2023-12-28 05:22:36,252][106225] Updated weights for policy 1, policy_version 1410941 (0.0010) [2023-12-28 05:22:36,254][106226] Updated weights for policy 0, policy_version 1407712 (0.0011) [2023-12-28 05:22:36,312][106225] Updated weights for policy 1, policy_version 1410951 (0.0010) [2023-12-28 05:22:36,315][106226] Updated weights for policy 0, policy_version 1407722 (0.0011) [2023-12-28 05:22:36,374][106225] Updated weights for policy 1, policy_version 1410961 (0.0009) [2023-12-28 05:22:37,024][106226] Updated weights for policy 0, policy_version 1407732 (0.0009) [2023-12-28 05:22:37,033][106225] Updated weights for policy 1, policy_version 1410971 (0.0007) [2023-12-28 05:22:37,078][106226] Updated weights for policy 0, policy_version 1407742 (0.0011) [2023-12-28 05:22:37,095][106225] Updated weights for policy 1, policy_version 1410981 (0.0006) [2023-12-28 05:22:37,129][106226] Updated weights for policy 0, policy_version 1407752 (0.0011) [2023-12-28 05:22:37,155][106225] Updated weights for policy 1, policy_version 1410991 (0.0010) [2023-12-28 05:22:37,830][106226] Updated weights for policy 0, policy_version 1407762 (0.0011) [2023-12-28 05:22:37,851][106225] Updated weights for policy 1, policy_version 1411001 (0.0007) [2023-12-28 05:22:37,888][106226] Updated weights for policy 0, policy_version 1407772 (0.0011) [2023-12-28 05:22:37,911][106225] Updated weights for policy 1, policy_version 1411011 (0.0010) [2023-12-28 05:22:37,948][106226] Updated weights for policy 0, policy_version 1407782 (0.0009) [2023-12-28 05:22:37,965][106225] Updated weights for policy 1, policy_version 1411021 (0.0007) [2023-12-28 05:22:38,010][106226] Updated weights for policy 0, policy_version 1407792 (0.0008) [2023-12-28 05:22:38,023][106225] Updated weights for policy 1, policy_version 1411031 (0.0006) [2023-12-28 05:22:38,617][106225] Updated weights for policy 1, policy_version 1411041 (0.0005) [2023-12-28 05:22:38,685][106225] Updated weights for policy 1, policy_version 1411051 (0.0008) [2023-12-28 05:22:38,747][106225] Updated weights for policy 1, policy_version 1411061 (0.0010) [2023-12-28 05:22:38,757][106226] Updated weights for policy 0, policy_version 1407802 (0.0006) [2023-12-28 05:22:38,818][106226] Updated weights for policy 0, policy_version 1407812 (0.0007) [2023-12-28 05:22:38,883][106226] Updated weights for policy 0, policy_version 1407822 (0.0008) [2023-12-28 05:22:39,405][106225] Updated weights for policy 1, policy_version 1411071 (0.0009) [2023-12-28 05:22:39,476][106225] Updated weights for policy 1, policy_version 1411081 (0.0008) [2023-12-28 05:22:39,539][106225] Updated weights for policy 1, policy_version 1411091 (0.0008) [2023-12-28 05:22:39,549][106226] Updated weights for policy 0, policy_version 1407832 (0.0007) [2023-12-28 05:22:39,609][106226] Updated weights for policy 0, policy_version 1407842 (0.0007) [2023-12-28 05:22:39,659][106226] Updated weights for policy 0, policy_version 1407852 (0.0008) [2023-12-28 05:22:40,301][106225] Updated weights for policy 1, policy_version 1411101 (0.0009) [2023-12-28 05:22:40,350][106226] Updated weights for policy 0, policy_version 1407862 (0.0008) [2023-12-28 05:22:40,360][106225] Updated weights for policy 1, policy_version 1411111 (0.0010) [2023-12-28 05:22:40,411][106226] Updated weights for policy 0, policy_version 1407872 (0.0008) [2023-12-28 05:22:40,422][106225] Updated weights for policy 1, policy_version 1411121 (0.0011) [2023-12-28 05:22:40,474][106226] Updated weights for policy 0, policy_version 1407882 (0.0005) [2023-12-28 05:22:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 721788928. Throughput: 0: 9951.9, 1: 9892.7. Samples: 721764764. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:41,176][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.579')] [2023-12-28 05:22:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001411128_361299968.pth... [2023-12-28 05:22:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001410008_361013248.pth [2023-12-28 05:22:41,220][106226] Updated weights for policy 0, policy_version 1407892 (0.0009) [2023-12-28 05:22:41,253][106225] Updated weights for policy 1, policy_version 1411131 (0.0010) [2023-12-28 05:22:41,288][106226] Updated weights for policy 0, policy_version 1407902 (0.0007) [2023-12-28 05:22:41,318][106225] Updated weights for policy 1, policy_version 1411141 (0.0008) [2023-12-28 05:22:41,354][106226] Updated weights for policy 0, policy_version 1407912 (0.0007) [2023-12-28 05:22:41,388][106225] Updated weights for policy 1, policy_version 1411151 (0.0006) [2023-12-28 05:22:41,416][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001407920_360497152.pth... [2023-12-28 05:22:41,420][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001406736_360194048.pth [2023-12-28 05:22:42,084][106225] Updated weights for policy 1, policy_version 1411161 (0.0008) [2023-12-28 05:22:42,151][106225] Updated weights for policy 1, policy_version 1411171 (0.0008) [2023-12-28 05:22:42,157][106226] Updated weights for policy 0, policy_version 1407922 (0.0008) [2023-12-28 05:22:42,212][106225] Updated weights for policy 1, policy_version 1411181 (0.0007) [2023-12-28 05:22:42,213][106226] Updated weights for policy 0, policy_version 1407932 (0.0007) [2023-12-28 05:22:42,263][106225] Updated weights for policy 1, policy_version 1411191 (0.0006) [2023-12-28 05:22:42,274][106226] Updated weights for policy 0, policy_version 1407942 (0.0008) [2023-12-28 05:22:42,337][106226] Updated weights for policy 0, policy_version 1407952 (0.0008) [2023-12-28 05:22:42,992][106225] Updated weights for policy 1, policy_version 1411201 (0.0008) [2023-12-28 05:22:43,052][106225] Updated weights for policy 1, policy_version 1411211 (0.0007) [2023-12-28 05:22:43,061][106226] Updated weights for policy 0, policy_version 1407962 (0.0009) [2023-12-28 05:22:43,111][106225] Updated weights for policy 1, policy_version 1411221 (0.0008) [2023-12-28 05:22:43,124][106226] Updated weights for policy 0, policy_version 1407972 (0.0008) [2023-12-28 05:22:43,188][106226] Updated weights for policy 0, policy_version 1407982 (0.0008) [2023-12-28 05:22:43,787][106225] Updated weights for policy 1, policy_version 1411231 (0.0006) [2023-12-28 05:22:43,843][106225] Updated weights for policy 1, policy_version 1411241 (0.0006) [2023-12-28 05:22:43,900][106225] Updated weights for policy 1, policy_version 1411251 (0.0009) [2023-12-28 05:22:43,942][106226] Updated weights for policy 0, policy_version 1407992 (0.0008) [2023-12-28 05:22:44,007][106226] Updated weights for policy 0, policy_version 1408002 (0.0009) [2023-12-28 05:22:44,065][106226] Updated weights for policy 0, policy_version 1408012 (0.0009) [2023-12-28 05:22:44,604][106225] Updated weights for policy 1, policy_version 1411261 (0.0007) [2023-12-28 05:22:44,662][106225] Updated weights for policy 1, policy_version 1411271 (0.0009) [2023-12-28 05:22:44,714][106225] Updated weights for policy 1, policy_version 1411281 (0.0008) [2023-12-28 05:22:44,744][106226] Updated weights for policy 0, policy_version 1408022 (0.0007) [2023-12-28 05:22:44,811][106226] Updated weights for policy 0, policy_version 1408032 (0.0008) [2023-12-28 05:22:44,871][106226] Updated weights for policy 0, policy_version 1408042 (0.0008) [2023-12-28 05:22:45,488][106225] Updated weights for policy 1, policy_version 1411291 (0.0006) [2023-12-28 05:22:45,554][106225] Updated weights for policy 1, policy_version 1411301 (0.0008) [2023-12-28 05:22:45,611][106225] Updated weights for policy 1, policy_version 1411311 (0.0008) [2023-12-28 05:22:45,618][106226] Updated weights for policy 0, policy_version 1408052 (0.0008) [2023-12-28 05:22:45,679][106226] Updated weights for policy 0, policy_version 1408062 (0.0007) [2023-12-28 05:22:45,745][106226] Updated weights for policy 0, policy_version 1408072 (0.0009) [2023-12-28 05:22:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 721887232. Throughput: 0: 9895.5, 1: 9806.4. Samples: 721878740. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:46,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-4.853')] [2023-12-28 05:22:46,308][106225] Updated weights for policy 1, policy_version 1411321 (0.0007) [2023-12-28 05:22:46,368][106225] Updated weights for policy 1, policy_version 1411331 (0.0007) [2023-12-28 05:22:46,427][106225] Updated weights for policy 1, policy_version 1411341 (0.0008) [2023-12-28 05:22:46,477][106226] Updated weights for policy 0, policy_version 1408082 (0.0008) [2023-12-28 05:22:46,477][106225] Updated weights for policy 1, policy_version 1411351 (0.0009) [2023-12-28 05:22:46,541][106226] Updated weights for policy 0, policy_version 1408092 (0.0009) [2023-12-28 05:22:46,604][106226] Updated weights for policy 0, policy_version 1408102 (0.0008) [2023-12-28 05:22:46,657][106226] Updated weights for policy 0, policy_version 1408112 (0.0009) [2023-12-28 05:22:47,084][106225] Updated weights for policy 1, policy_version 1411361 (0.0008) [2023-12-28 05:22:47,132][106225] Updated weights for policy 1, policy_version 1411371 (0.0008) [2023-12-28 05:22:47,187][106225] Updated weights for policy 1, policy_version 1411381 (0.0008) [2023-12-28 05:22:47,421][106226] Updated weights for policy 0, policy_version 1408122 (0.0011) [2023-12-28 05:22:47,480][106226] Updated weights for policy 0, policy_version 1408132 (0.0010) [2023-12-28 05:22:47,542][106226] Updated weights for policy 0, policy_version 1408142 (0.0010) [2023-12-28 05:22:47,947][106225] Updated weights for policy 1, policy_version 1411391 (0.0008) [2023-12-28 05:22:47,997][106225] Updated weights for policy 1, policy_version 1411401 (0.0008) [2023-12-28 05:22:48,050][106225] Updated weights for policy 1, policy_version 1411411 (0.0008) [2023-12-28 05:22:48,212][106226] Updated weights for policy 0, policy_version 1408152 (0.0010) [2023-12-28 05:22:48,275][106226] Updated weights for policy 0, policy_version 1408162 (0.0011) [2023-12-28 05:22:48,333][106226] Updated weights for policy 0, policy_version 1408172 (0.0010) [2023-12-28 05:22:48,824][106225] Updated weights for policy 1, policy_version 1411421 (0.0007) [2023-12-28 05:22:48,888][106225] Updated weights for policy 1, policy_version 1411431 (0.0008) [2023-12-28 05:22:48,942][106225] Updated weights for policy 1, policy_version 1411441 (0.0007) [2023-12-28 05:22:49,004][106226] Updated weights for policy 0, policy_version 1408182 (0.0008) [2023-12-28 05:22:49,050][106226] Updated weights for policy 0, policy_version 1408192 (0.0005) [2023-12-28 05:22:49,096][106226] Updated weights for policy 0, policy_version 1408202 (0.0005) [2023-12-28 05:22:49,664][106225] Updated weights for policy 1, policy_version 1411451 (0.0008) [2023-12-28 05:22:49,730][106225] Updated weights for policy 1, policy_version 1411461 (0.0008) [2023-12-28 05:22:49,759][106226] Updated weights for policy 0, policy_version 1408212 (0.0007) [2023-12-28 05:22:49,788][106225] Updated weights for policy 1, policy_version 1411471 (0.0007) [2023-12-28 05:22:49,817][106226] Updated weights for policy 0, policy_version 1408222 (0.0011) [2023-12-28 05:22:49,881][106226] Updated weights for policy 0, policy_version 1408232 (0.0011) [2023-12-28 05:22:50,516][106225] Updated weights for policy 1, policy_version 1411481 (0.0008) [2023-12-28 05:22:50,578][106225] Updated weights for policy 1, policy_version 1411491 (0.0009) [2023-12-28 05:22:50,621][106226] Updated weights for policy 0, policy_version 1408242 (0.0010) [2023-12-28 05:22:50,650][106225] Updated weights for policy 1, policy_version 1411501 (0.0008) [2023-12-28 05:22:50,685][106226] Updated weights for policy 0, policy_version 1408252 (0.0008) [2023-12-28 05:22:50,715][106225] Updated weights for policy 1, policy_version 1411511 (0.0007) [2023-12-28 05:22:50,746][106226] Updated weights for policy 0, policy_version 1408262 (0.0010) [2023-12-28 05:22:50,815][106226] Updated weights for policy 0, policy_version 1408272 (0.0011) [2023-12-28 05:22:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 721985536. Throughput: 0: 9830.2, 1: 9799.6. Samples: 721994852. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:51,175][105115] Avg episode reward: [(0, '-5.064'), (1, '-4.534')] [2023-12-28 05:22:51,499][106225] Updated weights for policy 1, policy_version 1411521 (0.0006) [2023-12-28 05:22:51,552][106226] Updated weights for policy 0, policy_version 1408282 (0.0008) [2023-12-28 05:22:51,561][106225] Updated weights for policy 1, policy_version 1411531 (0.0006) [2023-12-28 05:22:51,612][106226] Updated weights for policy 0, policy_version 1408292 (0.0008) [2023-12-28 05:22:51,623][106225] Updated weights for policy 1, policy_version 1411541 (0.0007) [2023-12-28 05:22:51,678][106226] Updated weights for policy 0, policy_version 1408302 (0.0007) [2023-12-28 05:22:52,394][106225] Updated weights for policy 1, policy_version 1411551 (0.0008) [2023-12-28 05:22:52,456][106225] Updated weights for policy 1, policy_version 1411561 (0.0006) [2023-12-28 05:22:52,478][106226] Updated weights for policy 0, policy_version 1408312 (0.0008) [2023-12-28 05:22:52,511][106225] Updated weights for policy 1, policy_version 1411571 (0.0006) [2023-12-28 05:22:52,536][106226] Updated weights for policy 0, policy_version 1408322 (0.0007) [2023-12-28 05:22:52,599][106226] Updated weights for policy 0, policy_version 1408332 (0.0009) [2023-12-28 05:22:53,224][106225] Updated weights for policy 1, policy_version 1411581 (0.0007) [2023-12-28 05:22:53,269][106225] Updated weights for policy 1, policy_version 1411591 (0.0008) [2023-12-28 05:22:53,316][106225] Updated weights for policy 1, policy_version 1411601 (0.0008) [2023-12-28 05:22:53,359][106226] Updated weights for policy 0, policy_version 1408342 (0.0009) [2023-12-28 05:22:53,429][106226] Updated weights for policy 0, policy_version 1408352 (0.0010) [2023-12-28 05:22:53,490][106226] Updated weights for policy 0, policy_version 1408362 (0.0010) [2023-12-28 05:22:54,006][106225] Updated weights for policy 1, policy_version 1411611 (0.0009) [2023-12-28 05:22:54,063][106225] Updated weights for policy 1, policy_version 1411621 (0.0010) [2023-12-28 05:22:54,124][106225] Updated weights for policy 1, policy_version 1411631 (0.0010) [2023-12-28 05:22:54,140][106226] Updated weights for policy 0, policy_version 1408372 (0.0009) [2023-12-28 05:22:54,200][106226] Updated weights for policy 0, policy_version 1408382 (0.0010) [2023-12-28 05:22:54,260][106226] Updated weights for policy 0, policy_version 1408392 (0.0010) [2023-12-28 05:22:54,840][106225] Updated weights for policy 1, policy_version 1411641 (0.0010) [2023-12-28 05:22:54,900][106225] Updated weights for policy 1, policy_version 1411651 (0.0010) [2023-12-28 05:22:54,959][106225] Updated weights for policy 1, policy_version 1411661 (0.0010) [2023-12-28 05:22:54,967][106226] Updated weights for policy 0, policy_version 1408402 (0.0010) [2023-12-28 05:22:55,022][106225] Updated weights for policy 1, policy_version 1411671 (0.0011) [2023-12-28 05:22:55,023][106226] Updated weights for policy 0, policy_version 1408412 (0.0011) [2023-12-28 05:22:55,069][106226] Updated weights for policy 0, policy_version 1408422 (0.0006) [2023-12-28 05:22:55,127][106226] Updated weights for policy 0, policy_version 1408432 (0.0010) [2023-12-28 05:22:55,694][106225] Updated weights for policy 1, policy_version 1411681 (0.0006) [2023-12-28 05:22:55,743][106225] Updated weights for policy 1, policy_version 1411691 (0.0010) [2023-12-28 05:22:55,781][106226] Updated weights for policy 0, policy_version 1408442 (0.0011) [2023-12-28 05:22:55,790][106225] Updated weights for policy 1, policy_version 1411701 (0.0010) [2023-12-28 05:22:55,840][106226] Updated weights for policy 0, policy_version 1408452 (0.0010) [2023-12-28 05:22:55,899][106226] Updated weights for policy 0, policy_version 1408462 (0.0010) [2023-12-28 05:22:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 722083840. Throughput: 0: 9784.1, 1: 9771.0. Samples: 722051764. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:22:56,175][105115] Avg episode reward: [(0, '-4.995'), (1, '-4.829')] [2023-12-28 05:22:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001411704_361447424.pth... [2023-12-28 05:22:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001408464_360636416.pth... [2023-12-28 05:22:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001410552_361152512.pth [2023-12-28 05:22:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001407312_360341504.pth [2023-12-28 05:22:56,493][106225] Updated weights for policy 1, policy_version 1411711 (0.0007) [2023-12-28 05:22:56,543][106225] Updated weights for policy 1, policy_version 1411721 (0.0007) [2023-12-28 05:22:56,593][106226] Updated weights for policy 0, policy_version 1408472 (0.0010) [2023-12-28 05:22:56,606][106225] Updated weights for policy 1, policy_version 1411731 (0.0007) [2023-12-28 05:22:56,639][106226] Updated weights for policy 0, policy_version 1408482 (0.0010) [2023-12-28 05:22:56,697][106226] Updated weights for policy 0, policy_version 1408492 (0.0010) [2023-12-28 05:22:57,272][106225] Updated weights for policy 1, policy_version 1411741 (0.0008) [2023-12-28 05:22:57,343][106225] Updated weights for policy 1, policy_version 1411751 (0.0009) [2023-12-28 05:22:57,354][106226] Updated weights for policy 0, policy_version 1408502 (0.0008) [2023-12-28 05:22:57,397][106225] Updated weights for policy 1, policy_version 1411761 (0.0010) [2023-12-28 05:22:57,415][106226] Updated weights for policy 0, policy_version 1408512 (0.0006) [2023-12-28 05:22:57,473][106226] Updated weights for policy 0, policy_version 1408522 (0.0006) [2023-12-28 05:22:58,026][106225] Updated weights for policy 1, policy_version 1411771 (0.0007) [2023-12-28 05:22:58,031][106226] Updated weights for policy 0, policy_version 1408532 (0.0006) [2023-12-28 05:22:58,082][106226] Updated weights for policy 0, policy_version 1408542 (0.0007) [2023-12-28 05:22:58,087][106225] Updated weights for policy 1, policy_version 1411781 (0.0006) [2023-12-28 05:22:58,141][106226] Updated weights for policy 0, policy_version 1408552 (0.0007) [2023-12-28 05:22:58,152][106225] Updated weights for policy 1, policy_version 1411791 (0.0005) [2023-12-28 05:22:58,975][106226] Updated weights for policy 0, policy_version 1408562 (0.0008) [2023-12-28 05:22:59,006][106225] Updated weights for policy 1, policy_version 1411801 (0.0008) [2023-12-28 05:22:59,037][106226] Updated weights for policy 0, policy_version 1408572 (0.0011) [2023-12-28 05:22:59,067][106225] Updated weights for policy 1, policy_version 1411811 (0.0010) [2023-12-28 05:22:59,098][106226] Updated weights for policy 0, policy_version 1408582 (0.0011) [2023-12-28 05:22:59,122][106225] Updated weights for policy 1, policy_version 1411821 (0.0006) [2023-12-28 05:22:59,163][106226] Updated weights for policy 0, policy_version 1408592 (0.0011) [2023-12-28 05:22:59,177][106225] Updated weights for policy 1, policy_version 1411831 (0.0006) [2023-12-28 05:22:59,859][106226] Updated weights for policy 0, policy_version 1408602 (0.0011) [2023-12-28 05:22:59,875][106225] Updated weights for policy 1, policy_version 1411842 (0.0008) [2023-12-28 05:22:59,917][106226] Updated weights for policy 0, policy_version 1408612 (0.0009) [2023-12-28 05:22:59,935][106225] Updated weights for policy 1, policy_version 1411852 (0.0007) [2023-12-28 05:22:59,979][106226] Updated weights for policy 0, policy_version 1408622 (0.0010) [2023-12-28 05:23:00,000][106225] Updated weights for policy 1, policy_version 1411862 (0.0009) [2023-12-28 05:23:00,665][106225] Updated weights for policy 1, policy_version 1411872 (0.0010) [2023-12-28 05:23:00,693][106226] Updated weights for policy 0, policy_version 1408632 (0.0010) [2023-12-28 05:23:00,726][106225] Updated weights for policy 1, policy_version 1411882 (0.0010) [2023-12-28 05:23:00,746][106226] Updated weights for policy 0, policy_version 1408642 (0.0010) [2023-12-28 05:23:00,786][106225] Updated weights for policy 1, policy_version 1411892 (0.0010) [2023-12-28 05:23:00,810][106226] Updated weights for policy 0, policy_version 1408652 (0.0006) [2023-12-28 05:23:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 722182144. Throughput: 0: 9850.7, 1: 9814.0. Samples: 722171208. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:01,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-4.699')] [2023-12-28 05:23:01,505][106226] Updated weights for policy 0, policy_version 1408662 (0.0010) [2023-12-28 05:23:01,557][106226] Updated weights for policy 0, policy_version 1408672 (0.0007) [2023-12-28 05:23:01,559][106225] Updated weights for policy 1, policy_version 1411902 (0.0009) [2023-12-28 05:23:01,617][106225] Updated weights for policy 1, policy_version 1411912 (0.0009) [2023-12-28 05:23:01,618][106226] Updated weights for policy 0, policy_version 1408682 (0.0009) [2023-12-28 05:23:01,677][106225] Updated weights for policy 1, policy_version 1411922 (0.0008) [2023-12-28 05:23:02,394][106226] Updated weights for policy 0, policy_version 1408692 (0.0008) [2023-12-28 05:23:02,436][106225] Updated weights for policy 1, policy_version 1411932 (0.0009) [2023-12-28 05:23:02,457][106226] Updated weights for policy 0, policy_version 1408702 (0.0008) [2023-12-28 05:23:02,493][106225] Updated weights for policy 1, policy_version 1411942 (0.0006) [2023-12-28 05:23:02,510][106226] Updated weights for policy 0, policy_version 1408712 (0.0008) [2023-12-28 05:23:02,546][106225] Updated weights for policy 1, policy_version 1411952 (0.0006) [2023-12-28 05:23:03,176][106225] Updated weights for policy 1, policy_version 1411962 (0.0008) [2023-12-28 05:23:03,221][106225] Updated weights for policy 1, policy_version 1411972 (0.0009) [2023-12-28 05:23:03,278][106225] Updated weights for policy 1, policy_version 1411982 (0.0008) [2023-12-28 05:23:03,283][106226] Updated weights for policy 0, policy_version 1408722 (0.0009) [2023-12-28 05:23:03,328][106226] Updated weights for policy 0, policy_version 1408732 (0.0006) [2023-12-28 05:23:03,333][106225] Updated weights for policy 1, policy_version 1411992 (0.0008) [2023-12-28 05:23:03,374][106226] Updated weights for policy 0, policy_version 1408742 (0.0005) [2023-12-28 05:23:03,428][106226] Updated weights for policy 0, policy_version 1408752 (0.0005) [2023-12-28 05:23:04,051][106226] Updated weights for policy 0, policy_version 1408762 (0.0006) [2023-12-28 05:23:04,105][106225] Updated weights for policy 1, policy_version 1412002 (0.0008) [2023-12-28 05:23:04,111][106226] Updated weights for policy 0, policy_version 1408772 (0.0007) [2023-12-28 05:23:04,166][106225] Updated weights for policy 1, policy_version 1412012 (0.0008) [2023-12-28 05:23:04,173][106226] Updated weights for policy 0, policy_version 1408782 (0.0008) [2023-12-28 05:23:04,234][106225] Updated weights for policy 1, policy_version 1412022 (0.0008) [2023-12-28 05:23:04,847][106226] Updated weights for policy 0, policy_version 1408792 (0.0010) [2023-12-28 05:23:04,904][106226] Updated weights for policy 0, policy_version 1408802 (0.0010) [2023-12-28 05:23:04,947][106225] Updated weights for policy 1, policy_version 1412032 (0.0006) [2023-12-28 05:23:04,960][106226] Updated weights for policy 0, policy_version 1408812 (0.0011) [2023-12-28 05:23:04,998][106225] Updated weights for policy 1, policy_version 1412042 (0.0007) [2023-12-28 05:23:05,058][106225] Updated weights for policy 1, policy_version 1412052 (0.0008) [2023-12-28 05:23:05,675][106226] Updated weights for policy 0, policy_version 1408822 (0.0007) [2023-12-28 05:23:05,706][106225] Updated weights for policy 1, policy_version 1412062 (0.0007) [2023-12-28 05:23:05,731][106226] Updated weights for policy 0, policy_version 1408832 (0.0005) [2023-12-28 05:23:05,762][106225] Updated weights for policy 1, policy_version 1412072 (0.0008) [2023-12-28 05:23:05,779][106226] Updated weights for policy 0, policy_version 1408842 (0.0006) [2023-12-28 05:23:05,812][106225] Updated weights for policy 1, policy_version 1412082 (0.0007) [2023-12-28 05:23:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 722280448. Throughput: 0: 9879.8, 1: 9802.3. Samples: 722289856. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:06,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.840')] [2023-12-28 05:23:06,461][106225] Updated weights for policy 1, policy_version 1412092 (0.0008) [2023-12-28 05:23:06,491][106226] Updated weights for policy 0, policy_version 1408852 (0.0007) [2023-12-28 05:23:06,522][106225] Updated weights for policy 1, policy_version 1412102 (0.0007) [2023-12-28 05:23:06,551][106226] Updated weights for policy 0, policy_version 1408862 (0.0008) [2023-12-28 05:23:06,581][106225] Updated weights for policy 1, policy_version 1412112 (0.0008) [2023-12-28 05:23:06,612][106226] Updated weights for policy 0, policy_version 1408872 (0.0006) [2023-12-28 05:23:07,256][106225] Updated weights for policy 1, policy_version 1412122 (0.0007) [2023-12-28 05:23:07,286][106226] Updated weights for policy 0, policy_version 1408882 (0.0008) [2023-12-28 05:23:07,313][106225] Updated weights for policy 1, policy_version 1412132 (0.0006) [2023-12-28 05:23:07,350][106226] Updated weights for policy 0, policy_version 1408892 (0.0011) [2023-12-28 05:23:07,370][106225] Updated weights for policy 1, policy_version 1412142 (0.0005) [2023-12-28 05:23:07,418][106226] Updated weights for policy 0, policy_version 1408902 (0.0011) [2023-12-28 05:23:07,428][106225] Updated weights for policy 1, policy_version 1412152 (0.0006) [2023-12-28 05:23:07,483][106226] Updated weights for policy 0, policy_version 1408912 (0.0011) [2023-12-28 05:23:08,029][106225] Updated weights for policy 1, policy_version 1412162 (0.0008) [2023-12-28 05:23:08,076][106225] Updated weights for policy 1, policy_version 1412172 (0.0005) [2023-12-28 05:23:08,085][106226] Updated weights for policy 0, policy_version 1408922 (0.0008) [2023-12-28 05:23:08,123][106225] Updated weights for policy 1, policy_version 1412182 (0.0005) [2023-12-28 05:23:08,134][106226] Updated weights for policy 0, policy_version 1408932 (0.0007) [2023-12-28 05:23:08,182][106226] Updated weights for policy 0, policy_version 1408942 (0.0007) [2023-12-28 05:23:08,828][106225] Updated weights for policy 1, policy_version 1412192 (0.0009) [2023-12-28 05:23:08,895][106225] Updated weights for policy 1, policy_version 1412202 (0.0011) [2023-12-28 05:23:08,933][106226] Updated weights for policy 0, policy_version 1408952 (0.0010) [2023-12-28 05:23:08,956][106225] Updated weights for policy 1, policy_version 1412212 (0.0010) [2023-12-28 05:23:08,994][106226] Updated weights for policy 0, policy_version 1408962 (0.0010) [2023-12-28 05:23:09,053][106226] Updated weights for policy 0, policy_version 1408972 (0.0010) [2023-12-28 05:23:09,707][106225] Updated weights for policy 1, policy_version 1412222 (0.0009) [2023-12-28 05:23:09,770][106225] Updated weights for policy 1, policy_version 1412232 (0.0007) [2023-12-28 05:23:09,788][106226] Updated weights for policy 0, policy_version 1408982 (0.0009) [2023-12-28 05:23:09,834][106225] Updated weights for policy 1, policy_version 1412242 (0.0007) [2023-12-28 05:23:09,853][106226] Updated weights for policy 0, policy_version 1408992 (0.0007) [2023-12-28 05:23:09,922][106226] Updated weights for policy 0, policy_version 1409002 (0.0008) [2023-12-28 05:23:10,549][106225] Updated weights for policy 1, policy_version 1412252 (0.0007) [2023-12-28 05:23:10,596][106225] Updated weights for policy 1, policy_version 1412262 (0.0007) [2023-12-28 05:23:10,660][106225] Updated weights for policy 1, policy_version 1412272 (0.0005) [2023-12-28 05:23:10,681][106226] Updated weights for policy 0, policy_version 1409012 (0.0007) [2023-12-28 05:23:10,737][106226] Updated weights for policy 0, policy_version 1409022 (0.0005) [2023-12-28 05:23:10,798][106226] Updated weights for policy 0, policy_version 1409032 (0.0007) [2023-12-28 05:23:11,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 722378752. Throughput: 0: 9869.5, 1: 9917.2. Samples: 722351364. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:11,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.863')] [2023-12-28 05:23:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001412280_361594880.pth... [2023-12-28 05:23:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001409040_360783872.pth... [2023-12-28 05:23:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001407920_360497152.pth [2023-12-28 05:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001411128_361299968.pth [2023-12-28 05:23:11,309][106225] Updated weights for policy 1, policy_version 1412282 (0.0006) [2023-12-28 05:23:11,389][106225] Updated weights for policy 1, policy_version 1412292 (0.0009) [2023-12-28 05:23:11,456][106225] Updated weights for policy 1, policy_version 1412302 (0.0006) [2023-12-28 05:23:11,501][106226] Updated weights for policy 0, policy_version 1409042 (0.0008) [2023-12-28 05:23:11,515][106225] Updated weights for policy 1, policy_version 1412312 (0.0007) [2023-12-28 05:23:11,556][106226] Updated weights for policy 0, policy_version 1409052 (0.0008) [2023-12-28 05:23:11,624][106226] Updated weights for policy 0, policy_version 1409062 (0.0007) [2023-12-28 05:23:11,692][106226] Updated weights for policy 0, policy_version 1409072 (0.0008) [2023-12-28 05:23:12,182][106225] Updated weights for policy 1, policy_version 1412322 (0.0006) [2023-12-28 05:23:12,240][106225] Updated weights for policy 1, policy_version 1412332 (0.0006) [2023-12-28 05:23:12,306][106225] Updated weights for policy 1, policy_version 1412342 (0.0009) [2023-12-28 05:23:12,433][106226] Updated weights for policy 0, policy_version 1409082 (0.0008) [2023-12-28 05:23:12,486][106226] Updated weights for policy 0, policy_version 1409092 (0.0009) [2023-12-28 05:23:12,539][106226] Updated weights for policy 0, policy_version 1409102 (0.0008) [2023-12-28 05:23:13,014][106225] Updated weights for policy 1, policy_version 1412352 (0.0008) [2023-12-28 05:23:13,078][106225] Updated weights for policy 1, policy_version 1412362 (0.0008) [2023-12-28 05:23:13,134][106225] Updated weights for policy 1, policy_version 1412372 (0.0008) [2023-12-28 05:23:13,263][106226] Updated weights for policy 0, policy_version 1409112 (0.0008) [2023-12-28 05:23:13,326][106226] Updated weights for policy 0, policy_version 1409122 (0.0008) [2023-12-28 05:23:13,378][106226] Updated weights for policy 0, policy_version 1409132 (0.0008) [2023-12-28 05:23:13,858][106225] Updated weights for policy 1, policy_version 1412382 (0.0008) [2023-12-28 05:23:13,924][106225] Updated weights for policy 1, policy_version 1412392 (0.0009) [2023-12-28 05:23:13,972][106225] Updated weights for policy 1, policy_version 1412402 (0.0008) [2023-12-28 05:23:14,117][106226] Updated weights for policy 0, policy_version 1409142 (0.0008) [2023-12-28 05:23:14,172][106226] Updated weights for policy 0, policy_version 1409152 (0.0009) [2023-12-28 05:23:14,232][106226] Updated weights for policy 0, policy_version 1409162 (0.0008) [2023-12-28 05:23:14,775][106225] Updated weights for policy 1, policy_version 1412412 (0.0008) [2023-12-28 05:23:14,824][106226] Updated weights for policy 0, policy_version 1409172 (0.0006) [2023-12-28 05:23:14,843][106225] Updated weights for policy 1, policy_version 1412422 (0.0008) [2023-12-28 05:23:14,886][106226] Updated weights for policy 0, policy_version 1409182 (0.0007) [2023-12-28 05:23:14,903][106225] Updated weights for policy 1, policy_version 1412432 (0.0008) [2023-12-28 05:23:14,956][106226] Updated weights for policy 0, policy_version 1409192 (0.0007) [2023-12-28 05:23:15,637][106226] Updated weights for policy 0, policy_version 1409202 (0.0008) [2023-12-28 05:23:15,685][106225] Updated weights for policy 1, policy_version 1412442 (0.0008) [2023-12-28 05:23:15,699][106226] Updated weights for policy 0, policy_version 1409212 (0.0005) [2023-12-28 05:23:15,749][106225] Updated weights for policy 1, policy_version 1412452 (0.0007) [2023-12-28 05:23:15,757][106226] Updated weights for policy 0, policy_version 1409222 (0.0005) [2023-12-28 05:23:15,802][106225] Updated weights for policy 1, policy_version 1412462 (0.0008) [2023-12-28 05:23:15,808][106226] Updated weights for policy 0, policy_version 1409232 (0.0006) [2023-12-28 05:23:15,849][106225] Updated weights for policy 1, policy_version 1412472 (0.0008) [2023-12-28 05:23:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 722477056. Throughput: 0: 9793.6, 1: 9785.5. Samples: 722466596. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:16,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.655')] [2023-12-28 05:23:16,407][106226] Updated weights for policy 0, policy_version 1409242 (0.0008) [2023-12-28 05:23:16,456][106226] Updated weights for policy 0, policy_version 1409252 (0.0006) [2023-12-28 05:23:16,509][106226] Updated weights for policy 0, policy_version 1409262 (0.0005) [2023-12-28 05:23:16,649][106225] Updated weights for policy 1, policy_version 1412482 (0.0008) [2023-12-28 05:23:16,694][106225] Updated weights for policy 1, policy_version 1412492 (0.0008) [2023-12-28 05:23:16,742][106225] Updated weights for policy 1, policy_version 1412502 (0.0008) [2023-12-28 05:23:17,119][106226] Updated weights for policy 0, policy_version 1409272 (0.0009) [2023-12-28 05:23:17,163][106226] Updated weights for policy 0, policy_version 1409282 (0.0010) [2023-12-28 05:23:17,216][106226] Updated weights for policy 0, policy_version 1409292 (0.0010) [2023-12-28 05:23:17,517][106225] Updated weights for policy 1, policy_version 1412512 (0.0007) [2023-12-28 05:23:17,569][106225] Updated weights for policy 1, policy_version 1412522 (0.0008) [2023-12-28 05:23:17,619][106225] Updated weights for policy 1, policy_version 1412532 (0.0008) [2023-12-28 05:23:17,912][106226] Updated weights for policy 0, policy_version 1409302 (0.0010) [2023-12-28 05:23:17,969][106226] Updated weights for policy 0, policy_version 1409312 (0.0010) [2023-12-28 05:23:18,015][106226] Updated weights for policy 0, policy_version 1409322 (0.0009) [2023-12-28 05:23:18,352][106225] Updated weights for policy 1, policy_version 1412542 (0.0008) [2023-12-28 05:23:18,415][106225] Updated weights for policy 1, policy_version 1412552 (0.0008) [2023-12-28 05:23:18,469][106225] Updated weights for policy 1, policy_version 1412562 (0.0008) [2023-12-28 05:23:18,747][106226] Updated weights for policy 0, policy_version 1409332 (0.0009) [2023-12-28 05:23:18,799][106226] Updated weights for policy 0, policy_version 1409342 (0.0008) [2023-12-28 05:23:18,848][106226] Updated weights for policy 0, policy_version 1409352 (0.0008) [2023-12-28 05:23:19,269][106225] Updated weights for policy 1, policy_version 1412572 (0.0007) [2023-12-28 05:23:19,333][106225] Updated weights for policy 1, policy_version 1412582 (0.0008) [2023-12-28 05:23:19,392][106225] Updated weights for policy 1, policy_version 1412592 (0.0008) [2023-12-28 05:23:19,562][106226] Updated weights for policy 0, policy_version 1409362 (0.0009) [2023-12-28 05:23:19,624][106226] Updated weights for policy 0, policy_version 1409372 (0.0008) [2023-12-28 05:23:19,687][106226] Updated weights for policy 0, policy_version 1409382 (0.0008) [2023-12-28 05:23:19,751][106226] Updated weights for policy 0, policy_version 1409392 (0.0008) [2023-12-28 05:23:20,122][106225] Updated weights for policy 1, policy_version 1412602 (0.0007) [2023-12-28 05:23:20,186][106225] Updated weights for policy 1, policy_version 1412612 (0.0006) [2023-12-28 05:23:20,250][106225] Updated weights for policy 1, policy_version 1412622 (0.0007) [2023-12-28 05:23:20,313][106225] Updated weights for policy 1, policy_version 1412632 (0.0006) [2023-12-28 05:23:20,512][106226] Updated weights for policy 0, policy_version 1409402 (0.0009) [2023-12-28 05:23:20,568][106226] Updated weights for policy 0, policy_version 1409412 (0.0009) [2023-12-28 05:23:20,638][106226] Updated weights for policy 0, policy_version 1409422 (0.0008) [2023-12-28 05:23:20,968][106225] Updated weights for policy 1, policy_version 1412642 (0.0005) [2023-12-28 05:23:21,040][106225] Updated weights for policy 1, policy_version 1412652 (0.0007) [2023-12-28 05:23:21,108][106225] Updated weights for policy 1, policy_version 1412662 (0.0007) [2023-12-28 05:23:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 722575360. Throughput: 0: 9789.7, 1: 9727.7. Samples: 722582364. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:21,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.660')] [2023-12-28 05:23:21,478][106226] Updated weights for policy 0, policy_version 1409432 (0.0008) [2023-12-28 05:23:21,539][106226] Updated weights for policy 0, policy_version 1409442 (0.0007) [2023-12-28 05:23:21,604][106226] Updated weights for policy 0, policy_version 1409452 (0.0006) [2023-12-28 05:23:21,843][106225] Updated weights for policy 1, policy_version 1412672 (0.0008) [2023-12-28 05:23:21,914][106225] Updated weights for policy 1, policy_version 1412682 (0.0008) [2023-12-28 05:23:21,985][106225] Updated weights for policy 1, policy_version 1412692 (0.0009) [2023-12-28 05:23:22,330][106226] Updated weights for policy 0, policy_version 1409462 (0.0009) [2023-12-28 05:23:22,393][106226] Updated weights for policy 0, policy_version 1409472 (0.0008) [2023-12-28 05:23:22,458][106226] Updated weights for policy 0, policy_version 1409482 (0.0008) [2023-12-28 05:23:22,730][106225] Updated weights for policy 1, policy_version 1412702 (0.0007) [2023-12-28 05:23:22,795][106225] Updated weights for policy 1, policy_version 1412712 (0.0009) [2023-12-28 05:23:22,861][106225] Updated weights for policy 1, policy_version 1412722 (0.0008) [2023-12-28 05:23:23,240][106226] Updated weights for policy 0, policy_version 1409492 (0.0008) [2023-12-28 05:23:23,297][106226] Updated weights for policy 0, policy_version 1409502 (0.0009) [2023-12-28 05:23:23,358][106226] Updated weights for policy 0, policy_version 1409512 (0.0008) [2023-12-28 05:23:23,610][106225] Updated weights for policy 1, policy_version 1412732 (0.0009) [2023-12-28 05:23:23,680][106225] Updated weights for policy 1, policy_version 1412742 (0.0008) [2023-12-28 05:23:23,741][106225] Updated weights for policy 1, policy_version 1412752 (0.0010) [2023-12-28 05:23:24,012][106226] Updated weights for policy 0, policy_version 1409522 (0.0008) [2023-12-28 05:23:24,070][106226] Updated weights for policy 0, policy_version 1409532 (0.0009) [2023-12-28 05:23:24,123][106226] Updated weights for policy 0, policy_version 1409542 (0.0008) [2023-12-28 05:23:24,170][106226] Updated weights for policy 0, policy_version 1409552 (0.0007) [2023-12-28 05:23:24,425][106225] Updated weights for policy 1, policy_version 1412762 (0.0008) [2023-12-28 05:23:24,489][106225] Updated weights for policy 1, policy_version 1412772 (0.0008) [2023-12-28 05:23:24,548][106225] Updated weights for policy 1, policy_version 1412782 (0.0008) [2023-12-28 05:23:24,608][106225] Updated weights for policy 1, policy_version 1412792 (0.0008) [2023-12-28 05:23:24,909][106226] Updated weights for policy 0, policy_version 1409562 (0.0009) [2023-12-28 05:23:24,971][106226] Updated weights for policy 0, policy_version 1409572 (0.0009) [2023-12-28 05:23:25,036][106226] Updated weights for policy 0, policy_version 1409582 (0.0009) [2023-12-28 05:23:25,312][106225] Updated weights for policy 1, policy_version 1412802 (0.0008) [2023-12-28 05:23:25,374][106225] Updated weights for policy 1, policy_version 1412812 (0.0009) [2023-12-28 05:23:25,429][106225] Updated weights for policy 1, policy_version 1412822 (0.0008) [2023-12-28 05:23:25,743][106226] Updated weights for policy 0, policy_version 1409592 (0.0008) [2023-12-28 05:23:25,794][106226] Updated weights for policy 0, policy_version 1409602 (0.0008) [2023-12-28 05:23:25,841][106226] Updated weights for policy 0, policy_version 1409612 (0.0008) [2023-12-28 05:23:26,143][106225] Updated weights for policy 1, policy_version 1412832 (0.0008) [2023-12-28 05:23:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 722665472. Throughput: 0: 9764.9, 1: 9634.7. Samples: 722637744. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:26,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.118')] [2023-12-28 05:23:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001409616_360931328.pth... [2023-12-28 05:23:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001408464_360636416.pth [2023-12-28 05:23:26,192][106225] Updated weights for policy 1, policy_version 1412842 (0.0008) [2023-12-28 05:23:26,245][106225] Updated weights for policy 1, policy_version 1412852 (0.0008) [2023-12-28 05:23:26,266][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001412856_361742336.pth... [2023-12-28 05:23:26,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001411704_361447424.pth [2023-12-28 05:23:26,581][106226] Updated weights for policy 0, policy_version 1409622 (0.0009) [2023-12-28 05:23:26,634][106226] Updated weights for policy 0, policy_version 1409632 (0.0008) [2023-12-28 05:23:26,688][106226] Updated weights for policy 0, policy_version 1409642 (0.0008) [2023-12-28 05:23:26,951][106225] Updated weights for policy 1, policy_version 1412862 (0.0008) [2023-12-28 05:23:26,996][106225] Updated weights for policy 1, policy_version 1412872 (0.0007) [2023-12-28 05:23:27,047][106225] Updated weights for policy 1, policy_version 1412882 (0.0008) [2023-12-28 05:23:27,381][106226] Updated weights for policy 0, policy_version 1409652 (0.0009) [2023-12-28 05:23:27,442][106226] Updated weights for policy 0, policy_version 1409662 (0.0008) [2023-12-28 05:23:27,489][106226] Updated weights for policy 0, policy_version 1409672 (0.0008) [2023-12-28 05:23:27,771][106225] Updated weights for policy 1, policy_version 1412892 (0.0008) [2023-12-28 05:23:27,832][106225] Updated weights for policy 1, policy_version 1412902 (0.0008) [2023-12-28 05:23:27,891][106225] Updated weights for policy 1, policy_version 1412912 (0.0008) [2023-12-28 05:23:28,244][106226] Updated weights for policy 0, policy_version 1409682 (0.0009) [2023-12-28 05:23:28,296][106226] Updated weights for policy 0, policy_version 1409692 (0.0008) [2023-12-28 05:23:28,377][106226] Updated weights for policy 0, policy_version 1409702 (0.0008) [2023-12-28 05:23:28,430][106226] Updated weights for policy 0, policy_version 1409712 (0.0008) [2023-12-28 05:23:28,519][106225] Updated weights for policy 1, policy_version 1412922 (0.0006) [2023-12-28 05:23:28,583][106225] Updated weights for policy 1, policy_version 1412932 (0.0007) [2023-12-28 05:23:28,641][106225] Updated weights for policy 1, policy_version 1412942 (0.0008) [2023-12-28 05:23:28,703][106225] Updated weights for policy 1, policy_version 1412952 (0.0008) [2023-12-28 05:23:29,169][106226] Updated weights for policy 0, policy_version 1409722 (0.0008) [2023-12-28 05:23:29,234][106226] Updated weights for policy 0, policy_version 1409732 (0.0009) [2023-12-28 05:23:29,290][106226] Updated weights for policy 0, policy_version 1409742 (0.0009) [2023-12-28 05:23:29,418][106225] Updated weights for policy 1, policy_version 1412962 (0.0009) [2023-12-28 05:23:29,476][106225] Updated weights for policy 1, policy_version 1412972 (0.0008) [2023-12-28 05:23:29,530][106225] Updated weights for policy 1, policy_version 1412982 (0.0008) [2023-12-28 05:23:30,016][106226] Updated weights for policy 0, policy_version 1409752 (0.0006) [2023-12-28 05:23:30,071][106226] Updated weights for policy 0, policy_version 1409762 (0.0009) [2023-12-28 05:23:30,134][106226] Updated weights for policy 0, policy_version 1409772 (0.0008) [2023-12-28 05:23:30,260][106225] Updated weights for policy 1, policy_version 1412992 (0.0008) [2023-12-28 05:23:30,320][106225] Updated weights for policy 1, policy_version 1413002 (0.0009) [2023-12-28 05:23:30,381][106225] Updated weights for policy 1, policy_version 1413012 (0.0007) [2023-12-28 05:23:30,877][106226] Updated weights for policy 0, policy_version 1409782 (0.0007) [2023-12-28 05:23:30,930][106226] Updated weights for policy 0, policy_version 1409792 (0.0008) [2023-12-28 05:23:30,976][106226] Updated weights for policy 0, policy_version 1409802 (0.0007) [2023-12-28 05:23:31,043][106225] Updated weights for policy 1, policy_version 1413022 (0.0009) [2023-12-28 05:23:31,104][106225] Updated weights for policy 1, policy_version 1413032 (0.0011) [2023-12-28 05:23:31,172][106225] Updated weights for policy 1, policy_version 1413042 (0.0010) [2023-12-28 05:23:31,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 722763776. Throughput: 0: 9792.5, 1: 9679.3. Samples: 722754968. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:31,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.833')] [2023-12-28 05:23:31,737][106226] Updated weights for policy 0, policy_version 1409812 (0.0008) [2023-12-28 05:23:31,793][106226] Updated weights for policy 0, policy_version 1409822 (0.0007) [2023-12-28 05:23:31,853][106226] Updated weights for policy 0, policy_version 1409832 (0.0008) [2023-12-28 05:23:31,904][106225] Updated weights for policy 1, policy_version 1413052 (0.0011) [2023-12-28 05:23:31,970][106225] Updated weights for policy 1, policy_version 1413062 (0.0010) [2023-12-28 05:23:32,037][106225] Updated weights for policy 1, policy_version 1413072 (0.0010) [2023-12-28 05:23:32,573][106226] Updated weights for policy 0, policy_version 1409842 (0.0007) [2023-12-28 05:23:32,631][106226] Updated weights for policy 0, policy_version 1409852 (0.0008) [2023-12-28 05:23:32,697][106226] Updated weights for policy 0, policy_version 1409862 (0.0008) [2023-12-28 05:23:32,751][106226] Updated weights for policy 0, policy_version 1409872 (0.0008) [2023-12-28 05:23:32,759][106225] Updated weights for policy 1, policy_version 1413082 (0.0010) [2023-12-28 05:23:32,812][106225] Updated weights for policy 1, policy_version 1413092 (0.0009) [2023-12-28 05:23:32,860][106225] Updated weights for policy 1, policy_version 1413102 (0.0008) [2023-12-28 05:23:32,907][106225] Updated weights for policy 1, policy_version 1413112 (0.0008) [2023-12-28 05:23:33,482][106226] Updated weights for policy 0, policy_version 1409882 (0.0008) [2023-12-28 05:23:33,530][106226] Updated weights for policy 0, policy_version 1409893 (0.0009) [2023-12-28 05:23:33,562][106225] Updated weights for policy 1, policy_version 1413122 (0.0006) [2023-12-28 05:23:33,573][106226] Updated weights for policy 0, policy_version 1409903 (0.0007) [2023-12-28 05:23:33,621][106225] Updated weights for policy 1, policy_version 1413132 (0.0008) [2023-12-28 05:23:33,675][106225] Updated weights for policy 1, policy_version 1413142 (0.0007) [2023-12-28 05:23:34,292][106226] Updated weights for policy 0, policy_version 1409913 (0.0008) [2023-12-28 05:23:34,359][106226] Updated weights for policy 0, policy_version 1409923 (0.0007) [2023-12-28 05:23:34,360][106225] Updated weights for policy 1, policy_version 1413152 (0.0008) [2023-12-28 05:23:34,417][106226] Updated weights for policy 0, policy_version 1409933 (0.0006) [2023-12-28 05:23:34,426][106225] Updated weights for policy 1, policy_version 1413162 (0.0009) [2023-12-28 05:23:34,488][106225] Updated weights for policy 1, policy_version 1413172 (0.0008) [2023-12-28 05:23:35,152][106226] Updated weights for policy 0, policy_version 1409943 (0.0008) [2023-12-28 05:23:35,213][106226] Updated weights for policy 0, policy_version 1409953 (0.0008) [2023-12-28 05:23:35,229][106225] Updated weights for policy 1, policy_version 1413182 (0.0009) [2023-12-28 05:23:35,268][106226] Updated weights for policy 0, policy_version 1409963 (0.0007) [2023-12-28 05:23:35,279][106225] Updated weights for policy 1, policy_version 1413192 (0.0005) [2023-12-28 05:23:35,325][106225] Updated weights for policy 1, policy_version 1413202 (0.0005) [2023-12-28 05:23:35,980][106225] Updated weights for policy 1, policy_version 1413212 (0.0006) [2023-12-28 05:23:36,022][106226] Updated weights for policy 0, policy_version 1409973 (0.0007) [2023-12-28 05:23:36,039][106225] Updated weights for policy 1, policy_version 1413222 (0.0007) [2023-12-28 05:23:36,074][106226] Updated weights for policy 0, policy_version 1409983 (0.0006) [2023-12-28 05:23:36,098][106225] Updated weights for policy 1, policy_version 1413232 (0.0006) [2023-12-28 05:23:36,141][106226] Updated weights for policy 0, policy_version 1409993 (0.0008) [2023-12-28 05:23:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 722862080. Throughput: 0: 9756.0, 1: 9740.5. Samples: 722872196. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:36,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.682')] [2023-12-28 05:23:36,754][106226] Updated weights for policy 0, policy_version 1410003 (0.0006) [2023-12-28 05:23:36,810][106226] Updated weights for policy 0, policy_version 1410013 (0.0005) [2023-12-28 05:23:36,869][106226] Updated weights for policy 0, policy_version 1410023 (0.0005) [2023-12-28 05:23:36,934][106225] Updated weights for policy 1, policy_version 1413242 (0.0007) [2023-12-28 05:23:36,993][106225] Updated weights for policy 1, policy_version 1413252 (0.0008) [2023-12-28 05:23:37,042][106225] Updated weights for policy 1, policy_version 1413262 (0.0009) [2023-12-28 05:23:37,092][106225] Updated weights for policy 1, policy_version 1413272 (0.0008) [2023-12-28 05:23:37,449][106226] Updated weights for policy 0, policy_version 1410033 (0.0006) [2023-12-28 05:23:37,502][106226] Updated weights for policy 0, policy_version 1410043 (0.0007) [2023-12-28 05:23:37,553][106226] Updated weights for policy 0, policy_version 1410053 (0.0005) [2023-12-28 05:23:37,604][106226] Updated weights for policy 0, policy_version 1410063 (0.0007) [2023-12-28 05:23:37,757][106225] Updated weights for policy 1, policy_version 1413282 (0.0008) [2023-12-28 05:23:37,819][106225] Updated weights for policy 1, policy_version 1413292 (0.0008) [2023-12-28 05:23:37,885][106225] Updated weights for policy 1, policy_version 1413302 (0.0008) [2023-12-28 05:23:38,298][106226] Updated weights for policy 0, policy_version 1410073 (0.0009) [2023-12-28 05:23:38,354][106226] Updated weights for policy 0, policy_version 1410083 (0.0007) [2023-12-28 05:23:38,421][106226] Updated weights for policy 0, policy_version 1410093 (0.0006) [2023-12-28 05:23:38,616][106225] Updated weights for policy 1, policy_version 1413312 (0.0009) [2023-12-28 05:23:38,680][106225] Updated weights for policy 1, policy_version 1413322 (0.0009) [2023-12-28 05:23:38,736][106225] Updated weights for policy 1, policy_version 1413332 (0.0010) [2023-12-28 05:23:39,072][106226] Updated weights for policy 0, policy_version 1410103 (0.0009) [2023-12-28 05:23:39,122][106226] Updated weights for policy 0, policy_version 1410113 (0.0009) [2023-12-28 05:23:39,184][106226] Updated weights for policy 0, policy_version 1410123 (0.0008) [2023-12-28 05:23:39,535][106225] Updated weights for policy 1, policy_version 1413342 (0.0008) [2023-12-28 05:23:39,595][106225] Updated weights for policy 1, policy_version 1413352 (0.0008) [2023-12-28 05:23:39,657][106225] Updated weights for policy 1, policy_version 1413362 (0.0008) [2023-12-28 05:23:40,011][106226] Updated weights for policy 0, policy_version 1410133 (0.0008) [2023-12-28 05:23:40,066][106226] Updated weights for policy 0, policy_version 1410143 (0.0009) [2023-12-28 05:23:40,130][106226] Updated weights for policy 0, policy_version 1410153 (0.0009) [2023-12-28 05:23:40,384][106225] Updated weights for policy 1, policy_version 1413372 (0.0008) [2023-12-28 05:23:40,436][106225] Updated weights for policy 1, policy_version 1413382 (0.0007) [2023-12-28 05:23:40,493][106225] Updated weights for policy 1, policy_version 1413392 (0.0008) [2023-12-28 05:23:40,881][106226] Updated weights for policy 0, policy_version 1410163 (0.0010) [2023-12-28 05:23:40,937][106226] Updated weights for policy 0, policy_version 1410173 (0.0011) [2023-12-28 05:23:40,987][106226] Updated weights for policy 0, policy_version 1410183 (0.0005) [2023-12-28 05:23:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 722960384. Throughput: 0: 9856.1, 1: 9722.7. Samples: 722932808. Policy #0 lag: (min: 9.0, avg: 29.4, max: 41.0) [2023-12-28 05:23:41,175][105115] Avg episode reward: [(0, '-4.882'), (1, '-4.591')] [2023-12-28 05:23:41,180][106225] Updated weights for policy 1, policy_version 1413402 (0.0008) [2023-12-28 05:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001410192_361078784.pth... [2023-12-28 05:23:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001409040_360783872.pth [2023-12-28 05:23:41,235][106225] Updated weights for policy 1, policy_version 1413412 (0.0008) [2023-12-28 05:23:41,301][106225] Updated weights for policy 1, policy_version 1413422 (0.0008) [2023-12-28 05:23:41,364][106225] Updated weights for policy 1, policy_version 1413432 (0.0008) [2023-12-28 05:23:41,364][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001413432_361889792.pth... [2023-12-28 05:23:41,368][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001412280_361594880.pth [2023-12-28 05:23:41,741][106226] Updated weights for policy 0, policy_version 1410193 (0.0007) [2023-12-28 05:23:41,805][106226] Updated weights for policy 0, policy_version 1410203 (0.0009) [2023-12-28 05:23:41,866][106226] Updated weights for policy 0, policy_version 1410213 (0.0006) [2023-12-28 05:23:41,931][106226] Updated weights for policy 0, policy_version 1410223 (0.0008) [2023-12-28 05:23:42,154][106225] Updated weights for policy 1, policy_version 1413442 (0.0008) [2023-12-28 05:23:42,220][106225] Updated weights for policy 1, policy_version 1413452 (0.0009) [2023-12-28 05:23:42,283][106225] Updated weights for policy 1, policy_version 1413462 (0.0008) [2023-12-28 05:23:42,679][106226] Updated weights for policy 0, policy_version 1410233 (0.0008) [2023-12-28 05:23:42,738][106226] Updated weights for policy 0, policy_version 1410243 (0.0008) [2023-12-28 05:23:42,793][106226] Updated weights for policy 0, policy_version 1410253 (0.0006) [2023-12-28 05:23:42,986][106225] Updated weights for policy 1, policy_version 1413472 (0.0007) [2023-12-28 05:23:43,050][106225] Updated weights for policy 1, policy_version 1413482 (0.0008) [2023-12-28 05:23:43,107][106225] Updated weights for policy 1, policy_version 1413492 (0.0008) [2023-12-28 05:23:43,474][106226] Updated weights for policy 0, policy_version 1410263 (0.0009) [2023-12-28 05:23:43,524][106226] Updated weights for policy 0, policy_version 1410273 (0.0010) [2023-12-28 05:23:43,577][106226] Updated weights for policy 0, policy_version 1410283 (0.0010) [2023-12-28 05:23:43,816][106225] Updated weights for policy 1, policy_version 1413502 (0.0007) [2023-12-28 05:23:43,866][106225] Updated weights for policy 1, policy_version 1413513 (0.0009) [2023-12-28 05:23:43,919][106225] Updated weights for policy 1, policy_version 1413523 (0.0008) [2023-12-28 05:23:44,157][106226] Updated weights for policy 0, policy_version 1410293 (0.0009) [2023-12-28 05:23:44,212][106226] Updated weights for policy 0, policy_version 1410303 (0.0005) [2023-12-28 05:23:44,273][106226] Updated weights for policy 0, policy_version 1410313 (0.0006) [2023-12-28 05:23:44,729][106225] Updated weights for policy 1, policy_version 1413533 (0.0008) [2023-12-28 05:23:44,789][106225] Updated weights for policy 1, policy_version 1413543 (0.0008) [2023-12-28 05:23:44,852][106225] Updated weights for policy 1, policy_version 1413553 (0.0007) [2023-12-28 05:23:44,969][106226] Updated weights for policy 0, policy_version 1410323 (0.0011) [2023-12-28 05:23:45,029][106226] Updated weights for policy 0, policy_version 1410333 (0.0007) [2023-12-28 05:23:45,087][106226] Updated weights for policy 0, policy_version 1410343 (0.0008) [2023-12-28 05:23:45,717][106225] Updated weights for policy 1, policy_version 1413563 (0.0008) [2023-12-28 05:23:45,768][106225] Updated weights for policy 1, policy_version 1413573 (0.0008) [2023-12-28 05:23:45,810][106226] Updated weights for policy 0, policy_version 1410353 (0.0010) [2023-12-28 05:23:45,820][106225] Updated weights for policy 1, policy_version 1413583 (0.0008) [2023-12-28 05:23:45,876][106226] Updated weights for policy 0, policy_version 1410363 (0.0007) [2023-12-28 05:23:45,922][106226] Updated weights for policy 0, policy_version 1410373 (0.0008) [2023-12-28 05:23:45,972][106226] Updated weights for policy 0, policy_version 1410383 (0.0009) [2023-12-28 05:23:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 723058688. Throughput: 0: 9818.4, 1: 9656.2. Samples: 723047564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:23:46,176][105115] Avg episode reward: [(0, '-4.886'), (1, '-4.725')] [2023-12-28 05:23:46,570][106225] Updated weights for policy 1, policy_version 1413593 (0.0006) [2023-12-28 05:23:46,621][106225] Updated weights for policy 1, policy_version 1413603 (0.0008) [2023-12-28 05:23:46,683][106225] Updated weights for policy 1, policy_version 1413613 (0.0008) [2023-12-28 05:23:46,698][106226] Updated weights for policy 0, policy_version 1410393 (0.0007) [2023-12-28 05:23:46,740][106225] Updated weights for policy 1, policy_version 1413623 (0.0009) [2023-12-28 05:23:46,749][106226] Updated weights for policy 0, policy_version 1410403 (0.0008) [2023-12-28 05:23:46,799][106226] Updated weights for policy 0, policy_version 1410413 (0.0008) [2023-12-28 05:23:47,401][106226] Updated weights for policy 0, policy_version 1410423 (0.0007) [2023-12-28 05:23:47,463][106226] Updated weights for policy 0, policy_version 1410433 (0.0007) [2023-12-28 05:23:47,512][106226] Updated weights for policy 0, policy_version 1410443 (0.0006) [2023-12-28 05:23:47,521][106225] Updated weights for policy 1, policy_version 1413633 (0.0007) [2023-12-28 05:23:47,581][106225] Updated weights for policy 1, policy_version 1413643 (0.0008) [2023-12-28 05:23:47,647][106225] Updated weights for policy 1, policy_version 1413653 (0.0010) [2023-12-28 05:23:48,094][106226] Updated weights for policy 0, policy_version 1410453 (0.0007) [2023-12-28 05:23:48,146][106226] Updated weights for policy 0, policy_version 1410463 (0.0008) [2023-12-28 05:23:48,198][106226] Updated weights for policy 0, policy_version 1410473 (0.0006) [2023-12-28 05:23:48,431][106225] Updated weights for policy 1, policy_version 1413663 (0.0009) [2023-12-28 05:23:48,477][106225] Updated weights for policy 1, policy_version 1413673 (0.0009) [2023-12-28 05:23:48,537][106225] Updated weights for policy 1, policy_version 1413683 (0.0009) [2023-12-28 05:23:48,903][106226] Updated weights for policy 0, policy_version 1410483 (0.0009) [2023-12-28 05:23:48,960][106226] Updated weights for policy 0, policy_version 1410493 (0.0009) [2023-12-28 05:23:49,025][106226] Updated weights for policy 0, policy_version 1410503 (0.0008) [2023-12-28 05:23:49,341][106225] Updated weights for policy 1, policy_version 1413693 (0.0008) [2023-12-28 05:23:49,412][106225] Updated weights for policy 1, policy_version 1413703 (0.0008) [2023-12-28 05:23:49,476][106225] Updated weights for policy 1, policy_version 1413713 (0.0008) [2023-12-28 05:23:49,777][106226] Updated weights for policy 0, policy_version 1410513 (0.0009) [2023-12-28 05:23:49,844][106226] Updated weights for policy 0, policy_version 1410523 (0.0009) [2023-12-28 05:23:49,910][106226] Updated weights for policy 0, policy_version 1410533 (0.0009) [2023-12-28 05:23:49,979][106226] Updated weights for policy 0, policy_version 1410544 (0.0009) [2023-12-28 05:23:50,217][106225] Updated weights for policy 1, policy_version 1413723 (0.0009) [2023-12-28 05:23:50,267][106225] Updated weights for policy 1, policy_version 1413733 (0.0007) [2023-12-28 05:23:50,316][106225] Updated weights for policy 1, policy_version 1413743 (0.0006) [2023-12-28 05:23:50,701][106226] Updated weights for policy 0, policy_version 1410554 (0.0008) [2023-12-28 05:23:50,765][106226] Updated weights for policy 0, policy_version 1410564 (0.0009) [2023-12-28 05:23:50,833][106226] Updated weights for policy 0, policy_version 1410574 (0.0009) [2023-12-28 05:23:50,989][106225] Updated weights for policy 1, policy_version 1413753 (0.0006) [2023-12-28 05:23:51,063][106225] Updated weights for policy 1, policy_version 1413763 (0.0007) [2023-12-28 05:23:51,120][106225] Updated weights for policy 1, policy_version 1413773 (0.0006) [2023-12-28 05:23:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19716.4). Total num frames: 723148800. Throughput: 0: 9827.7, 1: 9556.3. Samples: 723162136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:23:51,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.789')] [2023-12-28 05:23:51,185][106225] Updated weights for policy 1, policy_version 1413783 (0.0007) [2023-12-28 05:23:51,560][106226] Updated weights for policy 0, policy_version 1410584 (0.0008) [2023-12-28 05:23:51,629][106226] Updated weights for policy 0, policy_version 1410594 (0.0008) [2023-12-28 05:23:51,702][106226] Updated weights for policy 0, policy_version 1410604 (0.0009) [2023-12-28 05:23:51,856][106225] Updated weights for policy 1, policy_version 1413793 (0.0006) [2023-12-28 05:23:51,912][106225] Updated weights for policy 1, policy_version 1413803 (0.0007) [2023-12-28 05:23:51,978][106225] Updated weights for policy 1, policy_version 1413813 (0.0005) [2023-12-28 05:23:52,341][106226] Updated weights for policy 0, policy_version 1410614 (0.0007) [2023-12-28 05:23:52,412][106226] Updated weights for policy 0, policy_version 1410624 (0.0008) [2023-12-28 05:23:52,475][106226] Updated weights for policy 0, policy_version 1410634 (0.0008) [2023-12-28 05:23:52,627][106225] Updated weights for policy 1, policy_version 1413823 (0.0007) [2023-12-28 05:23:52,696][106225] Updated weights for policy 1, policy_version 1413833 (0.0009) [2023-12-28 05:23:52,753][106225] Updated weights for policy 1, policy_version 1413843 (0.0008) [2023-12-28 05:23:53,122][106226] Updated weights for policy 0, policy_version 1410644 (0.0007) [2023-12-28 05:23:53,180][106226] Updated weights for policy 0, policy_version 1410654 (0.0005) [2023-12-28 05:23:53,233][106226] Updated weights for policy 0, policy_version 1410664 (0.0010) [2023-12-28 05:23:53,428][106225] Updated weights for policy 1, policy_version 1413853 (0.0007) [2023-12-28 05:23:53,485][106225] Updated weights for policy 1, policy_version 1413863 (0.0008) [2023-12-28 05:23:53,547][106225] Updated weights for policy 1, policy_version 1413873 (0.0006) [2023-12-28 05:23:53,896][106226] Updated weights for policy 0, policy_version 1410674 (0.0011) [2023-12-28 05:23:53,945][106226] Updated weights for policy 0, policy_version 1410684 (0.0006) [2023-12-28 05:23:53,996][106226] Updated weights for policy 0, policy_version 1410694 (0.0005) [2023-12-28 05:23:54,058][106226] Updated weights for policy 0, policy_version 1410704 (0.0005) [2023-12-28 05:23:54,214][106225] Updated weights for policy 1, policy_version 1413883 (0.0006) [2023-12-28 05:23:54,279][106225] Updated weights for policy 1, policy_version 1413893 (0.0008) [2023-12-28 05:23:54,346][106225] Updated weights for policy 1, policy_version 1413903 (0.0007) [2023-12-28 05:23:54,752][106226] Updated weights for policy 0, policy_version 1410714 (0.0007) [2023-12-28 05:23:54,802][106226] Updated weights for policy 0, policy_version 1410724 (0.0005) [2023-12-28 05:23:54,863][106226] Updated weights for policy 0, policy_version 1410734 (0.0006) [2023-12-28 05:23:54,921][106225] Updated weights for policy 1, policy_version 1413913 (0.0005) [2023-12-28 05:23:54,974][106225] Updated weights for policy 1, policy_version 1413923 (0.0009) [2023-12-28 05:23:55,035][106225] Updated weights for policy 1, policy_version 1413933 (0.0009) [2023-12-28 05:23:55,086][106225] Updated weights for policy 1, policy_version 1413943 (0.0009) [2023-12-28 05:23:55,389][106226] Updated weights for policy 0, policy_version 1410744 (0.0008) [2023-12-28 05:23:55,439][106226] Updated weights for policy 0, policy_version 1410754 (0.0010) [2023-12-28 05:23:55,495][106226] Updated weights for policy 0, policy_version 1410764 (0.0006) [2023-12-28 05:23:55,700][106225] Updated weights for policy 1, policy_version 1413953 (0.0008) [2023-12-28 05:23:55,757][106225] Updated weights for policy 1, policy_version 1413963 (0.0009) [2023-12-28 05:23:55,811][106225] Updated weights for policy 1, policy_version 1413973 (0.0008) [2023-12-28 05:23:56,138][106226] Updated weights for policy 0, policy_version 1410774 (0.0007) [2023-12-28 05:23:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 723255296. Throughput: 0: 9849.5, 1: 9553.1. Samples: 723224484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:23:56,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-4.721')] [2023-12-28 05:23:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001413976_362029056.pth... [2023-12-28 05:23:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001412856_361742336.pth [2023-12-28 05:23:56,203][106226] Updated weights for policy 0, policy_version 1410784 (0.0008) [2023-12-28 05:23:56,262][106226] Updated weights for policy 0, policy_version 1410794 (0.0009) [2023-12-28 05:23:56,291][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001410800_361234432.pth... [2023-12-28 05:23:56,294][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001409616_360931328.pth [2023-12-28 05:23:56,470][106225] Updated weights for policy 1, policy_version 1413983 (0.0006) [2023-12-28 05:23:56,523][106225] Updated weights for policy 1, policy_version 1413993 (0.0009) [2023-12-28 05:23:56,571][106225] Updated weights for policy 1, policy_version 1414004 (0.0009) [2023-12-28 05:23:56,957][106226] Updated weights for policy 0, policy_version 1410804 (0.0008) [2023-12-28 05:23:57,012][106226] Updated weights for policy 0, policy_version 1410814 (0.0007) [2023-12-28 05:23:57,068][106226] Updated weights for policy 0, policy_version 1410824 (0.0008) [2023-12-28 05:23:57,307][106225] Updated weights for policy 1, policy_version 1414014 (0.0010) [2023-12-28 05:23:57,360][106225] Updated weights for policy 1, policy_version 1414024 (0.0008) [2023-12-28 05:23:57,403][106225] Updated weights for policy 1, policy_version 1414034 (0.0010) [2023-12-28 05:23:57,766][106226] Updated weights for policy 0, policy_version 1410834 (0.0006) [2023-12-28 05:23:57,818][106226] Updated weights for policy 0, policy_version 1410844 (0.0009) [2023-12-28 05:23:57,866][106226] Updated weights for policy 0, policy_version 1410854 (0.0010) [2023-12-28 05:23:57,918][106226] Updated weights for policy 0, policy_version 1410864 (0.0011) [2023-12-28 05:23:58,018][106225] Updated weights for policy 1, policy_version 1414044 (0.0008) [2023-12-28 05:23:58,075][106225] Updated weights for policy 1, policy_version 1414054 (0.0005) [2023-12-28 05:23:58,129][106225] Updated weights for policy 1, policy_version 1414064 (0.0005) [2023-12-28 05:23:58,764][106226] Updated weights for policy 0, policy_version 1410874 (0.0009) [2023-12-28 05:23:58,829][106226] Updated weights for policy 0, policy_version 1410884 (0.0008) [2023-12-28 05:23:58,831][106225] Updated weights for policy 1, policy_version 1414074 (0.0006) [2023-12-28 05:23:58,892][106225] Updated weights for policy 1, policy_version 1414084 (0.0010) [2023-12-28 05:23:58,897][106226] Updated weights for policy 0, policy_version 1410894 (0.0012) [2023-12-28 05:23:58,961][106225] Updated weights for policy 1, policy_version 1414094 (0.0010) [2023-12-28 05:23:59,020][106225] Updated weights for policy 1, policy_version 1414104 (0.0010) [2023-12-28 05:23:59,681][106226] Updated weights for policy 0, policy_version 1410904 (0.0010) [2023-12-28 05:23:59,741][106226] Updated weights for policy 0, policy_version 1410914 (0.0010) [2023-12-28 05:23:59,804][106226] Updated weights for policy 0, policy_version 1410924 (0.0006) [2023-12-28 05:23:59,812][106225] Updated weights for policy 1, policy_version 1414114 (0.0010) [2023-12-28 05:23:59,880][106225] Updated weights for policy 1, policy_version 1414124 (0.0009) [2023-12-28 05:23:59,948][106225] Updated weights for policy 1, policy_version 1414134 (0.0009) [2023-12-28 05:24:00,578][106226] Updated weights for policy 0, policy_version 1410934 (0.0008) [2023-12-28 05:24:00,604][106225] Updated weights for policy 1, policy_version 1414144 (0.0007) [2023-12-28 05:24:00,639][106226] Updated weights for policy 0, policy_version 1410944 (0.0007) [2023-12-28 05:24:00,664][106225] Updated weights for policy 1, policy_version 1414154 (0.0010) [2023-12-28 05:24:00,702][106226] Updated weights for policy 0, policy_version 1410954 (0.0006) [2023-12-28 05:24:00,729][106225] Updated weights for policy 1, policy_version 1414164 (0.0009) [2023-12-28 05:24:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 723353600. Throughput: 0: 9873.1, 1: 9655.8. Samples: 723345396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:01,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-4.616')] [2023-12-28 05:24:01,397][106226] Updated weights for policy 0, policy_version 1410964 (0.0008) [2023-12-28 05:24:01,459][106226] Updated weights for policy 0, policy_version 1410974 (0.0008) [2023-12-28 05:24:01,462][106225] Updated weights for policy 1, policy_version 1414174 (0.0009) [2023-12-28 05:24:01,509][106225] Updated weights for policy 1, policy_version 1414184 (0.0010) [2023-12-28 05:24:01,512][106226] Updated weights for policy 0, policy_version 1410984 (0.0006) [2023-12-28 05:24:01,557][106225] Updated weights for policy 1, policy_version 1414194 (0.0010) [2023-12-28 05:24:02,281][106226] Updated weights for policy 0, policy_version 1410994 (0.0007) [2023-12-28 05:24:02,316][106225] Updated weights for policy 1, policy_version 1414204 (0.0009) [2023-12-28 05:24:02,331][106226] Updated weights for policy 0, policy_version 1411004 (0.0010) [2023-12-28 05:24:02,380][106225] Updated weights for policy 1, policy_version 1414214 (0.0009) [2023-12-28 05:24:02,399][106226] Updated weights for policy 0, policy_version 1411014 (0.0009) [2023-12-28 05:24:02,440][106225] Updated weights for policy 1, policy_version 1414224 (0.0010) [2023-12-28 05:24:02,456][106226] Updated weights for policy 0, policy_version 1411024 (0.0008) [2023-12-28 05:24:03,099][106225] Updated weights for policy 1, policy_version 1414234 (0.0009) [2023-12-28 05:24:03,146][106225] Updated weights for policy 1, policy_version 1414244 (0.0009) [2023-12-28 05:24:03,187][106226] Updated weights for policy 0, policy_version 1411034 (0.0009) [2023-12-28 05:24:03,195][106225] Updated weights for policy 1, policy_version 1414254 (0.0010) [2023-12-28 05:24:03,243][106226] Updated weights for policy 0, policy_version 1411044 (0.0007) [2023-12-28 05:24:03,249][106225] Updated weights for policy 1, policy_version 1414264 (0.0010) [2023-12-28 05:24:03,296][106226] Updated weights for policy 0, policy_version 1411054 (0.0005) [2023-12-28 05:24:03,913][106226] Updated weights for policy 0, policy_version 1411064 (0.0009) [2023-12-28 05:24:03,914][106225] Updated weights for policy 1, policy_version 1414274 (0.0010) [2023-12-28 05:24:03,972][106225] Updated weights for policy 1, policy_version 1414284 (0.0011) [2023-12-28 05:24:03,973][106226] Updated weights for policy 0, policy_version 1411074 (0.0008) [2023-12-28 05:24:04,030][106225] Updated weights for policy 1, policy_version 1414294 (0.0010) [2023-12-28 05:24:04,039][106226] Updated weights for policy 0, policy_version 1411084 (0.0008) [2023-12-28 05:24:04,730][106225] Updated weights for policy 1, policy_version 1414304 (0.0010) [2023-12-28 05:24:04,790][106225] Updated weights for policy 1, policy_version 1414314 (0.0010) [2023-12-28 05:24:04,797][106226] Updated weights for policy 0, policy_version 1411094 (0.0007) [2023-12-28 05:24:04,840][106225] Updated weights for policy 1, policy_version 1414324 (0.0010) [2023-12-28 05:24:04,843][106226] Updated weights for policy 0, policy_version 1411104 (0.0007) [2023-12-28 05:24:04,892][106226] Updated weights for policy 0, policy_version 1411114 (0.0008) [2023-12-28 05:24:05,436][106225] Updated weights for policy 1, policy_version 1414334 (0.0007) [2023-12-28 05:24:05,499][106225] Updated weights for policy 1, policy_version 1414344 (0.0006) [2023-12-28 05:24:05,556][106225] Updated weights for policy 1, policy_version 1414354 (0.0005) [2023-12-28 05:24:05,727][106226] Updated weights for policy 0, policy_version 1411124 (0.0007) [2023-12-28 05:24:05,774][106226] Updated weights for policy 0, policy_version 1411134 (0.0008) [2023-12-28 05:24:05,820][106226] Updated weights for policy 0, policy_version 1411144 (0.0007) [2023-12-28 05:24:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 723451904. Throughput: 0: 9792.5, 1: 9774.1. Samples: 723462864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:06,176][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.781')] [2023-12-28 05:24:06,241][106225] Updated weights for policy 1, policy_version 1414364 (0.0010) [2023-12-28 05:24:06,306][106225] Updated weights for policy 1, policy_version 1414374 (0.0008) [2023-12-28 05:24:06,372][106225] Updated weights for policy 1, policy_version 1414384 (0.0009) [2023-12-28 05:24:06,580][106226] Updated weights for policy 0, policy_version 1411154 (0.0008) [2023-12-28 05:24:06,643][106226] Updated weights for policy 0, policy_version 1411164 (0.0008) [2023-12-28 05:24:06,706][106226] Updated weights for policy 0, policy_version 1411174 (0.0009) [2023-12-28 05:24:06,763][106226] Updated weights for policy 0, policy_version 1411184 (0.0006) [2023-12-28 05:24:07,042][106225] Updated weights for policy 1, policy_version 1414394 (0.0009) [2023-12-28 05:24:07,106][106225] Updated weights for policy 1, policy_version 1414404 (0.0010) [2023-12-28 05:24:07,178][106225] Updated weights for policy 1, policy_version 1414414 (0.0010) [2023-12-28 05:24:07,242][106225] Updated weights for policy 1, policy_version 1414424 (0.0010) [2023-12-28 05:24:07,406][106226] Updated weights for policy 0, policy_version 1411194 (0.0005) [2023-12-28 05:24:07,459][106226] Updated weights for policy 0, policy_version 1411204 (0.0007) [2023-12-28 05:24:07,505][106226] Updated weights for policy 0, policy_version 1411214 (0.0006) [2023-12-28 05:24:07,917][106225] Updated weights for policy 1, policy_version 1414434 (0.0010) [2023-12-28 05:24:07,980][106225] Updated weights for policy 1, policy_version 1414444 (0.0010) [2023-12-28 05:24:08,040][106225] Updated weights for policy 1, policy_version 1414454 (0.0010) [2023-12-28 05:24:08,139][106226] Updated weights for policy 0, policy_version 1411224 (0.0007) [2023-12-28 05:24:08,185][106226] Updated weights for policy 0, policy_version 1411234 (0.0007) [2023-12-28 05:24:08,242][106226] Updated weights for policy 0, policy_version 1411244 (0.0007) [2023-12-28 05:24:08,796][106225] Updated weights for policy 1, policy_version 1414464 (0.0010) [2023-12-28 05:24:08,847][106225] Updated weights for policy 1, policy_version 1414474 (0.0010) [2023-12-28 05:24:08,898][106225] Updated weights for policy 1, policy_version 1414484 (0.0010) [2023-12-28 05:24:08,908][106226] Updated weights for policy 0, policy_version 1411254 (0.0007) [2023-12-28 05:24:08,969][106226] Updated weights for policy 0, policy_version 1411264 (0.0007) [2023-12-28 05:24:09,025][106226] Updated weights for policy 0, policy_version 1411274 (0.0009) [2023-12-28 05:24:09,650][106225] Updated weights for policy 1, policy_version 1414494 (0.0010) [2023-12-28 05:24:09,714][106225] Updated weights for policy 1, policy_version 1414504 (0.0008) [2023-12-28 05:24:09,779][106225] Updated weights for policy 1, policy_version 1414514 (0.0007) [2023-12-28 05:24:09,798][106226] Updated weights for policy 0, policy_version 1411284 (0.0008) [2023-12-28 05:24:09,867][106226] Updated weights for policy 0, policy_version 1411294 (0.0009) [2023-12-28 05:24:09,932][106226] Updated weights for policy 0, policy_version 1411304 (0.0010) [2023-12-28 05:24:10,444][106225] Updated weights for policy 1, policy_version 1414524 (0.0006) [2023-12-28 05:24:10,512][106225] Updated weights for policy 1, policy_version 1414534 (0.0007) [2023-12-28 05:24:10,569][106225] Updated weights for policy 1, policy_version 1414544 (0.0008) [2023-12-28 05:24:10,726][106226] Updated weights for policy 0, policy_version 1411314 (0.0009) [2023-12-28 05:24:10,786][106226] Updated weights for policy 0, policy_version 1411324 (0.0009) [2023-12-28 05:24:10,849][106226] Updated weights for policy 0, policy_version 1411334 (0.0009) [2023-12-28 05:24:10,919][106226] Updated weights for policy 0, policy_version 1411344 (0.0009) [2023-12-28 05:24:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 723550208. Throughput: 0: 9863.7, 1: 9814.8. Samples: 723523272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:11,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-4.687')] [2023-12-28 05:24:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001414552_362176512.pth... [2023-12-28 05:24:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001411344_361373696.pth... [2023-12-28 05:24:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001413432_361889792.pth [2023-12-28 05:24:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001410192_361078784.pth [2023-12-28 05:24:11,235][106225] Updated weights for policy 1, policy_version 1414554 (0.0009) [2023-12-28 05:24:11,308][106225] Updated weights for policy 1, policy_version 1414564 (0.0008) [2023-12-28 05:24:11,378][106225] Updated weights for policy 1, policy_version 1414574 (0.0007) [2023-12-28 05:24:11,444][106225] Updated weights for policy 1, policy_version 1414584 (0.0009) [2023-12-28 05:24:11,670][106226] Updated weights for policy 0, policy_version 1411354 (0.0009) [2023-12-28 05:24:11,728][106226] Updated weights for policy 0, policy_version 1411364 (0.0010) [2023-12-28 05:24:11,802][106226] Updated weights for policy 0, policy_version 1411374 (0.0010) [2023-12-28 05:24:12,282][106225] Updated weights for policy 1, policy_version 1414594 (0.0009) [2023-12-28 05:24:12,344][106225] Updated weights for policy 1, policy_version 1414604 (0.0009) [2023-12-28 05:24:12,404][106225] Updated weights for policy 1, policy_version 1414614 (0.0009) [2023-12-28 05:24:12,618][106226] Updated weights for policy 0, policy_version 1411384 (0.0006) [2023-12-28 05:24:12,681][106226] Updated weights for policy 0, policy_version 1411394 (0.0006) [2023-12-28 05:24:12,737][106226] Updated weights for policy 0, policy_version 1411404 (0.0009) [2023-12-28 05:24:13,139][106225] Updated weights for policy 1, policy_version 1414624 (0.0006) [2023-12-28 05:24:13,198][106225] Updated weights for policy 1, policy_version 1414634 (0.0005) [2023-12-28 05:24:13,252][106225] Updated weights for policy 1, policy_version 1414644 (0.0005) [2023-12-28 05:24:13,287][106226] Updated weights for policy 0, policy_version 1411414 (0.0008) [2023-12-28 05:24:13,345][106226] Updated weights for policy 0, policy_version 1411424 (0.0010) [2023-12-28 05:24:13,411][106226] Updated weights for policy 0, policy_version 1411434 (0.0006) [2023-12-28 05:24:13,919][106225] Updated weights for policy 1, policy_version 1414654 (0.0009) [2023-12-28 05:24:13,949][106226] Updated weights for policy 0, policy_version 1411444 (0.0005) [2023-12-28 05:24:13,989][106225] Updated weights for policy 1, policy_version 1414664 (0.0011) [2023-12-28 05:24:14,000][106226] Updated weights for policy 0, policy_version 1411454 (0.0006) [2023-12-28 05:24:14,045][106225] Updated weights for policy 1, policy_version 1414674 (0.0010) [2023-12-28 05:24:14,057][106226] Updated weights for policy 0, policy_version 1411464 (0.0011) [2023-12-28 05:24:14,687][106225] Updated weights for policy 1, policy_version 1414684 (0.0008) [2023-12-28 05:24:14,704][106226] Updated weights for policy 0, policy_version 1411474 (0.0010) [2023-12-28 05:24:14,734][106225] Updated weights for policy 1, policy_version 1414694 (0.0006) [2023-12-28 05:24:14,770][106226] Updated weights for policy 0, policy_version 1411484 (0.0009) [2023-12-28 05:24:14,800][106225] Updated weights for policy 1, policy_version 1414704 (0.0007) [2023-12-28 05:24:14,838][106226] Updated weights for policy 0, policy_version 1411494 (0.0009) [2023-12-28 05:24:14,906][106226] Updated weights for policy 0, policy_version 1411504 (0.0008) [2023-12-28 05:24:15,527][106226] Updated weights for policy 0, policy_version 1411514 (0.0006) [2023-12-28 05:24:15,573][106225] Updated weights for policy 1, policy_version 1414714 (0.0009) [2023-12-28 05:24:15,584][106226] Updated weights for policy 0, policy_version 1411524 (0.0011) [2023-12-28 05:24:15,625][106225] Updated weights for policy 1, policy_version 1414724 (0.0007) [2023-12-28 05:24:15,639][106226] Updated weights for policy 0, policy_version 1411534 (0.0010) [2023-12-28 05:24:15,683][106225] Updated weights for policy 1, policy_version 1414734 (0.0006) [2023-12-28 05:24:15,749][106225] Updated weights for policy 1, policy_version 1414744 (0.0008) [2023-12-28 05:24:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 723648512. Throughput: 0: 9881.0, 1: 9789.8. Samples: 723640156. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:16,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-4.709')] [2023-12-28 05:24:16,346][106226] Updated weights for policy 0, policy_version 1411544 (0.0011) [2023-12-28 05:24:16,406][106226] Updated weights for policy 0, policy_version 1411554 (0.0011) [2023-12-28 05:24:16,473][106226] Updated weights for policy 0, policy_version 1411564 (0.0011) [2023-12-28 05:24:16,482][106225] Updated weights for policy 1, policy_version 1414754 (0.0009) [2023-12-28 05:24:16,536][106225] Updated weights for policy 1, policy_version 1414764 (0.0010) [2023-12-28 05:24:16,592][106225] Updated weights for policy 1, policy_version 1414774 (0.0010) [2023-12-28 05:24:17,141][106226] Updated weights for policy 0, policy_version 1411574 (0.0009) [2023-12-28 05:24:17,203][106226] Updated weights for policy 0, policy_version 1411584 (0.0005) [2023-12-28 05:24:17,266][106226] Updated weights for policy 0, policy_version 1411594 (0.0006) [2023-12-28 05:24:17,294][106225] Updated weights for policy 1, policy_version 1414784 (0.0009) [2023-12-28 05:24:17,355][106225] Updated weights for policy 1, policy_version 1414794 (0.0010) [2023-12-28 05:24:17,421][106225] Updated weights for policy 1, policy_version 1414804 (0.0010) [2023-12-28 05:24:17,798][106226] Updated weights for policy 0, policy_version 1411604 (0.0005) [2023-12-28 05:24:17,846][106226] Updated weights for policy 0, policy_version 1411614 (0.0005) [2023-12-28 05:24:17,897][106226] Updated weights for policy 0, policy_version 1411624 (0.0005) [2023-12-28 05:24:18,209][106225] Updated weights for policy 1, policy_version 1414814 (0.0007) [2023-12-28 05:24:18,263][106225] Updated weights for policy 1, policy_version 1414824 (0.0007) [2023-12-28 05:24:18,313][106225] Updated weights for policy 1, policy_version 1414834 (0.0010) [2023-12-28 05:24:18,478][106226] Updated weights for policy 0, policy_version 1411634 (0.0005) [2023-12-28 05:24:18,535][106226] Updated weights for policy 0, policy_version 1411644 (0.0006) [2023-12-28 05:24:18,590][106226] Updated weights for policy 0, policy_version 1411654 (0.0008) [2023-12-28 05:24:18,644][106226] Updated weights for policy 0, policy_version 1411664 (0.0008) [2023-12-28 05:24:18,994][106225] Updated weights for policy 1, policy_version 1414844 (0.0008) [2023-12-28 05:24:19,055][106225] Updated weights for policy 1, policy_version 1414854 (0.0007) [2023-12-28 05:24:19,124][106225] Updated weights for policy 1, policy_version 1414864 (0.0007) [2023-12-28 05:24:19,408][106226] Updated weights for policy 0, policy_version 1411674 (0.0008) [2023-12-28 05:24:19,467][106226] Updated weights for policy 0, policy_version 1411684 (0.0008) [2023-12-28 05:24:19,535][106226] Updated weights for policy 0, policy_version 1411694 (0.0008) [2023-12-28 05:24:19,828][106225] Updated weights for policy 1, policy_version 1414874 (0.0007) [2023-12-28 05:24:19,892][106225] Updated weights for policy 1, policy_version 1414884 (0.0009) [2023-12-28 05:24:19,954][106225] Updated weights for policy 1, policy_version 1414894 (0.0008) [2023-12-28 05:24:20,016][106225] Updated weights for policy 1, policy_version 1414904 (0.0009) [2023-12-28 05:24:20,285][106226] Updated weights for policy 0, policy_version 1411704 (0.0008) [2023-12-28 05:24:20,349][106226] Updated weights for policy 0, policy_version 1411714 (0.0009) [2023-12-28 05:24:20,413][106226] Updated weights for policy 0, policy_version 1411724 (0.0008) [2023-12-28 05:24:20,718][106225] Updated weights for policy 1, policy_version 1414914 (0.0009) [2023-12-28 05:24:20,784][106225] Updated weights for policy 1, policy_version 1414924 (0.0008) [2023-12-28 05:24:20,846][106225] Updated weights for policy 1, policy_version 1414934 (0.0008) [2023-12-28 05:24:21,161][106226] Updated weights for policy 0, policy_version 1411734 (0.0006) [2023-12-28 05:24:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 723746816. Throughput: 0: 9987.4, 1: 9717.6. Samples: 723758920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:21,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-4.694')] [2023-12-28 05:24:21,224][106226] Updated weights for policy 0, policy_version 1411744 (0.0006) [2023-12-28 05:24:21,288][106226] Updated weights for policy 0, policy_version 1411754 (0.0007) [2023-12-28 05:24:21,721][106225] Updated weights for policy 1, policy_version 1414944 (0.0008) [2023-12-28 05:24:21,800][106225] Updated weights for policy 1, policy_version 1414954 (0.0008) [2023-12-28 05:24:21,861][106225] Updated weights for policy 1, policy_version 1414964 (0.0008) [2023-12-28 05:24:21,968][106226] Updated weights for policy 0, policy_version 1411764 (0.0007) [2023-12-28 05:24:22,035][106226] Updated weights for policy 0, policy_version 1411774 (0.0006) [2023-12-28 05:24:22,104][106226] Updated weights for policy 0, policy_version 1411784 (0.0006) [2023-12-28 05:24:22,611][106225] Updated weights for policy 1, policy_version 1414974 (0.0010) [2023-12-28 05:24:22,680][106225] Updated weights for policy 1, policy_version 1414984 (0.0011) [2023-12-28 05:24:22,749][106225] Updated weights for policy 1, policy_version 1414994 (0.0011) [2023-12-28 05:24:22,801][106226] Updated weights for policy 0, policy_version 1411794 (0.0008) [2023-12-28 05:24:22,859][106226] Updated weights for policy 0, policy_version 1411804 (0.0008) [2023-12-28 05:24:22,931][106226] Updated weights for policy 0, policy_version 1411814 (0.0008) [2023-12-28 05:24:22,996][106226] Updated weights for policy 0, policy_version 1411824 (0.0008) [2023-12-28 05:24:23,393][106225] Updated weights for policy 1, policy_version 1415004 (0.0011) [2023-12-28 05:24:23,446][106225] Updated weights for policy 1, policy_version 1415014 (0.0010) [2023-12-28 05:24:23,497][106225] Updated weights for policy 1, policy_version 1415024 (0.0007) [2023-12-28 05:24:23,720][106226] Updated weights for policy 0, policy_version 1411834 (0.0005) [2023-12-28 05:24:23,772][106226] Updated weights for policy 0, policy_version 1411844 (0.0007) [2023-12-28 05:24:23,822][106226] Updated weights for policy 0, policy_version 1411854 (0.0008) [2023-12-28 05:24:24,125][106225] Updated weights for policy 1, policy_version 1415034 (0.0005) [2023-12-28 05:24:24,182][106225] Updated weights for policy 1, policy_version 1415044 (0.0005) [2023-12-28 05:24:24,232][106225] Updated weights for policy 1, policy_version 1415054 (0.0006) [2023-12-28 05:24:24,280][106225] Updated weights for policy 1, policy_version 1415064 (0.0006) [2023-12-28 05:24:24,530][106226] Updated weights for policy 0, policy_version 1411864 (0.0009) [2023-12-28 05:24:24,581][106226] Updated weights for policy 0, policy_version 1411874 (0.0009) [2023-12-28 05:24:24,632][106226] Updated weights for policy 0, policy_version 1411884 (0.0008) [2023-12-28 05:24:24,873][106225] Updated weights for policy 1, policy_version 1415074 (0.0005) [2023-12-28 05:24:24,931][106225] Updated weights for policy 1, policy_version 1415084 (0.0005) [2023-12-28 05:24:24,994][106225] Updated weights for policy 1, policy_version 1415094 (0.0008) [2023-12-28 05:24:25,445][106226] Updated weights for policy 0, policy_version 1411894 (0.0008) [2023-12-28 05:24:25,491][106226] Updated weights for policy 0, policy_version 1411904 (0.0007) [2023-12-28 05:24:25,546][106226] Updated weights for policy 0, policy_version 1411914 (0.0009) [2023-12-28 05:24:25,640][106225] Updated weights for policy 1, policy_version 1415104 (0.0007) [2023-12-28 05:24:25,709][106225] Updated weights for policy 1, policy_version 1415114 (0.0006) [2023-12-28 05:24:25,774][106225] Updated weights for policy 1, policy_version 1415124 (0.0008) [2023-12-28 05:24:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 723845120. Throughput: 0: 9904.5, 1: 9713.7. Samples: 723815632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:26,176][105115] Avg episode reward: [(0, '-4.735'), (1, '-4.871')] [2023-12-28 05:24:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001415128_362323968.pth... [2023-12-28 05:24:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001411920_361521152.pth... [2023-12-28 05:24:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001413976_362029056.pth [2023-12-28 05:24:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001410800_361234432.pth [2023-12-28 05:24:26,289][106226] Updated weights for policy 0, policy_version 1411924 (0.0010) [2023-12-28 05:24:26,349][106226] Updated weights for policy 0, policy_version 1411934 (0.0010) [2023-12-28 05:24:26,405][106226] Updated weights for policy 0, policy_version 1411944 (0.0010) [2023-12-28 05:24:26,421][106225] Updated weights for policy 1, policy_version 1415134 (0.0009) [2023-12-28 05:24:26,470][106225] Updated weights for policy 1, policy_version 1415144 (0.0010) [2023-12-28 05:24:26,525][106225] Updated weights for policy 1, policy_version 1415154 (0.0010) [2023-12-28 05:24:27,083][106226] Updated weights for policy 0, policy_version 1411954 (0.0010) [2023-12-28 05:24:27,139][106226] Updated weights for policy 0, policy_version 1411964 (0.0011) [2023-12-28 05:24:27,196][106226] Updated weights for policy 0, policy_version 1411974 (0.0010) [2023-12-28 05:24:27,242][106225] Updated weights for policy 1, policy_version 1415164 (0.0010) [2023-12-28 05:24:27,244][106226] Updated weights for policy 0, policy_version 1411984 (0.0009) [2023-12-28 05:24:27,302][106225] Updated weights for policy 1, policy_version 1415174 (0.0010) [2023-12-28 05:24:27,372][106225] Updated weights for policy 1, policy_version 1415184 (0.0010) [2023-12-28 05:24:27,907][106226] Updated weights for policy 0, policy_version 1411994 (0.0005) [2023-12-28 05:24:27,965][106226] Updated weights for policy 0, policy_version 1412004 (0.0005) [2023-12-28 05:24:28,022][106226] Updated weights for policy 0, policy_version 1412014 (0.0007) [2023-12-28 05:24:28,069][106225] Updated weights for policy 1, policy_version 1415194 (0.0010) [2023-12-28 05:24:28,124][106225] Updated weights for policy 1, policy_version 1415204 (0.0010) [2023-12-28 05:24:28,179][106225] Updated weights for policy 1, policy_version 1415214 (0.0010) [2023-12-28 05:24:28,227][106225] Updated weights for policy 1, policy_version 1415224 (0.0010) [2023-12-28 05:24:28,719][106226] Updated weights for policy 0, policy_version 1412024 (0.0010) [2023-12-28 05:24:28,776][106226] Updated weights for policy 0, policy_version 1412034 (0.0010) [2023-12-28 05:24:28,836][106226] Updated weights for policy 0, policy_version 1412044 (0.0011) [2023-12-28 05:24:28,919][106225] Updated weights for policy 1, policy_version 1415234 (0.0010) [2023-12-28 05:24:28,974][106225] Updated weights for policy 1, policy_version 1415244 (0.0010) [2023-12-28 05:24:29,033][106225] Updated weights for policy 1, policy_version 1415254 (0.0010) [2023-12-28 05:24:29,556][106226] Updated weights for policy 0, policy_version 1412054 (0.0009) [2023-12-28 05:24:29,614][106226] Updated weights for policy 0, policy_version 1412064 (0.0007) [2023-12-28 05:24:29,671][106226] Updated weights for policy 0, policy_version 1412074 (0.0008) [2023-12-28 05:24:29,758][106225] Updated weights for policy 1, policy_version 1415264 (0.0010) [2023-12-28 05:24:29,814][106225] Updated weights for policy 1, policy_version 1415274 (0.0005) [2023-12-28 05:24:29,882][106225] Updated weights for policy 1, policy_version 1415284 (0.0007) [2023-12-28 05:24:30,428][106226] Updated weights for policy 0, policy_version 1412084 (0.0008) [2023-12-28 05:24:30,480][106226] Updated weights for policy 0, policy_version 1412094 (0.0008) [2023-12-28 05:24:30,534][106226] Updated weights for policy 0, policy_version 1412104 (0.0008) [2023-12-28 05:24:30,578][106225] Updated weights for policy 1, policy_version 1415294 (0.0008) [2023-12-28 05:24:30,622][106225] Updated weights for policy 1, policy_version 1415304 (0.0008) [2023-12-28 05:24:30,667][106225] Updated weights for policy 1, policy_version 1415314 (0.0009) [2023-12-28 05:24:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 723943424. Throughput: 0: 9901.3, 1: 9839.5. Samples: 723935900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:31,176][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.812')] [2023-12-28 05:24:31,292][106226] Updated weights for policy 0, policy_version 1412114 (0.0006) [2023-12-28 05:24:31,347][106226] Updated weights for policy 0, policy_version 1412124 (0.0009) [2023-12-28 05:24:31,376][106225] Updated weights for policy 1, policy_version 1415324 (0.0008) [2023-12-28 05:24:31,415][106226] Updated weights for policy 0, policy_version 1412134 (0.0007) [2023-12-28 05:24:31,437][106225] Updated weights for policy 1, policy_version 1415334 (0.0008) [2023-12-28 05:24:31,477][106226] Updated weights for policy 0, policy_version 1412144 (0.0008) [2023-12-28 05:24:31,503][106225] Updated weights for policy 1, policy_version 1415344 (0.0007) [2023-12-28 05:24:32,176][106225] Updated weights for policy 1, policy_version 1415354 (0.0007) [2023-12-28 05:24:32,224][106225] Updated weights for policy 1, policy_version 1415364 (0.0010) [2023-12-28 05:24:32,233][106226] Updated weights for policy 0, policy_version 1412154 (0.0006) [2023-12-28 05:24:32,287][106225] Updated weights for policy 1, policy_version 1415374 (0.0010) [2023-12-28 05:24:32,301][106226] Updated weights for policy 0, policy_version 1412164 (0.0007) [2023-12-28 05:24:32,356][106225] Updated weights for policy 1, policy_version 1415384 (0.0009) [2023-12-28 05:24:32,370][106226] Updated weights for policy 0, policy_version 1412174 (0.0008) [2023-12-28 05:24:33,074][106226] Updated weights for policy 0, policy_version 1412184 (0.0010) [2023-12-28 05:24:33,089][106225] Updated weights for policy 1, policy_version 1415394 (0.0010) [2023-12-28 05:24:33,136][106226] Updated weights for policy 0, policy_version 1412194 (0.0010) [2023-12-28 05:24:33,142][106225] Updated weights for policy 1, policy_version 1415404 (0.0010) [2023-12-28 05:24:33,185][106225] Updated weights for policy 1, policy_version 1415414 (0.0010) [2023-12-28 05:24:33,186][106226] Updated weights for policy 0, policy_version 1412204 (0.0010) [2023-12-28 05:24:33,770][106226] Updated weights for policy 0, policy_version 1412214 (0.0007) [2023-12-28 05:24:33,824][106226] Updated weights for policy 0, policy_version 1412224 (0.0010) [2023-12-28 05:24:33,878][106226] Updated weights for policy 0, policy_version 1412234 (0.0006) [2023-12-28 05:24:33,891][106225] Updated weights for policy 1, policy_version 1415424 (0.0010) [2023-12-28 05:24:33,947][106225] Updated weights for policy 1, policy_version 1415434 (0.0010) [2023-12-28 05:24:33,990][106225] Updated weights for policy 1, policy_version 1415444 (0.0010) [2023-12-28 05:24:34,512][106226] Updated weights for policy 0, policy_version 1412244 (0.0006) [2023-12-28 05:24:34,565][106226] Updated weights for policy 0, policy_version 1412254 (0.0008) [2023-12-28 05:24:34,623][106226] Updated weights for policy 0, policy_version 1412264 (0.0008) [2023-12-28 05:24:34,742][106225] Updated weights for policy 1, policy_version 1415454 (0.0010) [2023-12-28 05:24:34,791][106225] Updated weights for policy 1, policy_version 1415464 (0.0010) [2023-12-28 05:24:34,844][106225] Updated weights for policy 1, policy_version 1415474 (0.0010) [2023-12-28 05:24:35,383][106226] Updated weights for policy 0, policy_version 1412274 (0.0008) [2023-12-28 05:24:35,445][106226] Updated weights for policy 0, policy_version 1412284 (0.0008) [2023-12-28 05:24:35,499][106226] Updated weights for policy 0, policy_version 1412294 (0.0008) [2023-12-28 05:24:35,545][106226] Updated weights for policy 0, policy_version 1412304 (0.0008) [2023-12-28 05:24:35,599][106225] Updated weights for policy 1, policy_version 1415484 (0.0010) [2023-12-28 05:24:35,652][106225] Updated weights for policy 1, policy_version 1415494 (0.0010) [2023-12-28 05:24:35,697][106225] Updated weights for policy 1, policy_version 1415504 (0.0010) [2023-12-28 05:24:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 724041728. Throughput: 0: 9879.1, 1: 9930.1. Samples: 724053552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:36,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.791')] [2023-12-28 05:24:36,311][106226] Updated weights for policy 0, policy_version 1412314 (0.0008) [2023-12-28 05:24:36,373][106226] Updated weights for policy 0, policy_version 1412324 (0.0007) [2023-12-28 05:24:36,434][106225] Updated weights for policy 1, policy_version 1415514 (0.0010) [2023-12-28 05:24:36,445][106226] Updated weights for policy 0, policy_version 1412334 (0.0007) [2023-12-28 05:24:36,495][106225] Updated weights for policy 1, policy_version 1415524 (0.0010) [2023-12-28 05:24:36,556][106225] Updated weights for policy 1, policy_version 1415534 (0.0006) [2023-12-28 05:24:36,612][106225] Updated weights for policy 1, policy_version 1415544 (0.0005) [2023-12-28 05:24:37,078][106226] Updated weights for policy 0, policy_version 1412344 (0.0010) [2023-12-28 05:24:37,141][106226] Updated weights for policy 0, policy_version 1412354 (0.0008) [2023-12-28 05:24:37,161][106225] Updated weights for policy 1, policy_version 1415554 (0.0006) [2023-12-28 05:24:37,205][106226] Updated weights for policy 0, policy_version 1412364 (0.0008) [2023-12-28 05:24:37,221][106225] Updated weights for policy 1, policy_version 1415564 (0.0005) [2023-12-28 05:24:37,284][106225] Updated weights for policy 1, policy_version 1415574 (0.0006) [2023-12-28 05:24:37,849][106225] Updated weights for policy 1, policy_version 1415584 (0.0005) [2023-12-28 05:24:37,901][106225] Updated weights for policy 1, policy_version 1415594 (0.0005) [2023-12-28 05:24:37,953][106226] Updated weights for policy 0, policy_version 1412374 (0.0007) [2023-12-28 05:24:37,964][106225] Updated weights for policy 1, policy_version 1415604 (0.0006) [2023-12-28 05:24:38,021][106226] Updated weights for policy 0, policy_version 1412384 (0.0006) [2023-12-28 05:24:38,078][106226] Updated weights for policy 0, policy_version 1412394 (0.0007) [2023-12-28 05:24:38,559][106225] Updated weights for policy 1, policy_version 1415614 (0.0010) [2023-12-28 05:24:38,620][106225] Updated weights for policy 1, policy_version 1415624 (0.0011) [2023-12-28 05:24:38,684][106225] Updated weights for policy 1, policy_version 1415634 (0.0010) [2023-12-28 05:24:38,751][106226] Updated weights for policy 0, policy_version 1412404 (0.0008) [2023-12-28 05:24:38,813][106226] Updated weights for policy 0, policy_version 1412414 (0.0008) [2023-12-28 05:24:38,870][106226] Updated weights for policy 0, policy_version 1412424 (0.0007) [2023-12-28 05:24:39,432][106225] Updated weights for policy 1, policy_version 1415644 (0.0009) [2023-12-28 05:24:39,488][106225] Updated weights for policy 1, policy_version 1415654 (0.0008) [2023-12-28 05:24:39,547][106225] Updated weights for policy 1, policy_version 1415664 (0.0008) [2023-12-28 05:24:39,642][106226] Updated weights for policy 0, policy_version 1412434 (0.0008) [2023-12-28 05:24:39,693][106226] Updated weights for policy 0, policy_version 1412444 (0.0009) [2023-12-28 05:24:39,743][106226] Updated weights for policy 0, policy_version 1412454 (0.0008) [2023-12-28 05:24:39,789][106226] Updated weights for policy 0, policy_version 1412464 (0.0008) [2023-12-28 05:24:40,307][106225] Updated weights for policy 1, policy_version 1415674 (0.0009) [2023-12-28 05:24:40,366][106225] Updated weights for policy 1, policy_version 1415684 (0.0010) [2023-12-28 05:24:40,427][106225] Updated weights for policy 1, policy_version 1415694 (0.0010) [2023-12-28 05:24:40,483][106225] Updated weights for policy 1, policy_version 1415704 (0.0009) [2023-12-28 05:24:40,534][106226] Updated weights for policy 0, policy_version 1412474 (0.0011) [2023-12-28 05:24:40,600][106226] Updated weights for policy 0, policy_version 1412484 (0.0007) [2023-12-28 05:24:40,671][106226] Updated weights for policy 0, policy_version 1412494 (0.0006) [2023-12-28 05:24:41,141][106225] Updated weights for policy 1, policy_version 1415714 (0.0010) [2023-12-28 05:24:41,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 724140032. Throughput: 0: 9834.2, 1: 9969.9. Samples: 724115664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:41,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.674')] [2023-12-28 05:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001412496_361668608.pth... [2023-12-28 05:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001411344_361373696.pth [2023-12-28 05:24:41,214][106225] Updated weights for policy 1, policy_version 1415724 (0.0010) [2023-12-28 05:24:41,284][106225] Updated weights for policy 1, policy_version 1415734 (0.0010) [2023-12-28 05:24:41,297][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001415736_362479616.pth... [2023-12-28 05:24:41,302][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001414552_362176512.pth [2023-12-28 05:24:41,400][106226] Updated weights for policy 0, policy_version 1412504 (0.0008) [2023-12-28 05:24:41,459][106226] Updated weights for policy 0, policy_version 1412514 (0.0008) [2023-12-28 05:24:41,520][106226] Updated weights for policy 0, policy_version 1412524 (0.0008) [2023-12-28 05:24:42,002][106225] Updated weights for policy 1, policy_version 1415744 (0.0011) [2023-12-28 05:24:42,064][106225] Updated weights for policy 1, policy_version 1415754 (0.0010) [2023-12-28 05:24:42,129][106225] Updated weights for policy 1, policy_version 1415764 (0.0011) [2023-12-28 05:24:42,313][106226] Updated weights for policy 0, policy_version 1412534 (0.0008) [2023-12-28 05:24:42,382][106226] Updated weights for policy 0, policy_version 1412544 (0.0009) [2023-12-28 05:24:42,439][106226] Updated weights for policy 0, policy_version 1412554 (0.0008) [2023-12-28 05:24:42,870][106225] Updated weights for policy 1, policy_version 1415774 (0.0010) [2023-12-28 05:24:42,916][106225] Updated weights for policy 1, policy_version 1415784 (0.0008) [2023-12-28 05:24:42,968][106225] Updated weights for policy 1, policy_version 1415794 (0.0006) [2023-12-28 05:24:43,192][106226] Updated weights for policy 0, policy_version 1412564 (0.0008) [2023-12-28 05:24:43,248][106226] Updated weights for policy 0, policy_version 1412574 (0.0008) [2023-12-28 05:24:43,301][106226] Updated weights for policy 0, policy_version 1412584 (0.0006) [2023-12-28 05:24:43,579][106225] Updated weights for policy 1, policy_version 1415804 (0.0006) [2023-12-28 05:24:43,638][106225] Updated weights for policy 1, policy_version 1415814 (0.0007) [2023-12-28 05:24:43,698][106225] Updated weights for policy 1, policy_version 1415824 (0.0010) [2023-12-28 05:24:44,008][106226] Updated weights for policy 0, policy_version 1412594 (0.0006) [2023-12-28 05:24:44,065][106226] Updated weights for policy 0, policy_version 1412604 (0.0009) [2023-12-28 05:24:44,122][106226] Updated weights for policy 0, policy_version 1412614 (0.0010) [2023-12-28 05:24:44,179][106226] Updated weights for policy 0, policy_version 1412624 (0.0009) [2023-12-28 05:24:44,325][106225] Updated weights for policy 1, policy_version 1415834 (0.0010) [2023-12-28 05:24:44,383][106225] Updated weights for policy 1, policy_version 1415844 (0.0006) [2023-12-28 05:24:44,441][106225] Updated weights for policy 1, policy_version 1415854 (0.0006) [2023-12-28 05:24:44,503][106225] Updated weights for policy 1, policy_version 1415864 (0.0005) [2023-12-28 05:24:44,940][106226] Updated weights for policy 0, policy_version 1412634 (0.0009) [2023-12-28 05:24:45,003][106226] Updated weights for policy 0, policy_version 1412644 (0.0008) [2023-12-28 05:24:45,053][106225] Updated weights for policy 1, policy_version 1415874 (0.0011) [2023-12-28 05:24:45,064][106226] Updated weights for policy 0, policy_version 1412654 (0.0006) [2023-12-28 05:24:45,105][106225] Updated weights for policy 1, policy_version 1415884 (0.0011) [2023-12-28 05:24:45,161][106225] Updated weights for policy 1, policy_version 1415894 (0.0010) [2023-12-28 05:24:45,808][106226] Updated weights for policy 0, policy_version 1412664 (0.0008) [2023-12-28 05:24:45,869][106226] Updated weights for policy 0, policy_version 1412674 (0.0008) [2023-12-28 05:24:45,899][106225] Updated weights for policy 1, policy_version 1415904 (0.0006) [2023-12-28 05:24:45,924][106226] Updated weights for policy 0, policy_version 1412684 (0.0007) [2023-12-28 05:24:45,963][106225] Updated weights for policy 1, policy_version 1415914 (0.0006) [2023-12-28 05:24:46,029][106225] Updated weights for policy 1, policy_version 1415924 (0.0006) [2023-12-28 05:24:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 724246528. Throughput: 0: 9752.7, 1: 9933.6. Samples: 724231284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:46,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.805')] [2023-12-28 05:24:46,686][106225] Updated weights for policy 1, policy_version 1415934 (0.0009) [2023-12-28 05:24:46,723][106226] Updated weights for policy 0, policy_version 1412694 (0.0007) [2023-12-28 05:24:46,746][106225] Updated weights for policy 1, policy_version 1415944 (0.0009) [2023-12-28 05:24:46,783][106226] Updated weights for policy 0, policy_version 1412704 (0.0009) [2023-12-28 05:24:46,798][106225] Updated weights for policy 1, policy_version 1415954 (0.0006) [2023-12-28 05:24:46,850][106226] Updated weights for policy 0, policy_version 1412714 (0.0008) [2023-12-28 05:24:47,401][106225] Updated weights for policy 1, policy_version 1415964 (0.0007) [2023-12-28 05:24:47,452][106225] Updated weights for policy 1, policy_version 1415974 (0.0010) [2023-12-28 05:24:47,516][106225] Updated weights for policy 1, policy_version 1415984 (0.0011) [2023-12-28 05:24:47,624][106226] Updated weights for policy 0, policy_version 1412724 (0.0010) [2023-12-28 05:24:47,684][106226] Updated weights for policy 0, policy_version 1412734 (0.0010) [2023-12-28 05:24:47,748][106226] Updated weights for policy 0, policy_version 1412744 (0.0009) [2023-12-28 05:24:48,102][106225] Updated weights for policy 1, policy_version 1415994 (0.0006) [2023-12-28 05:24:48,169][106225] Updated weights for policy 1, policy_version 1416004 (0.0005) [2023-12-28 05:24:48,233][106225] Updated weights for policy 1, policy_version 1416014 (0.0006) [2023-12-28 05:24:48,299][106225] Updated weights for policy 1, policy_version 1416024 (0.0008) [2023-12-28 05:24:48,574][106226] Updated weights for policy 0, policy_version 1412754 (0.0008) [2023-12-28 05:24:48,634][106226] Updated weights for policy 0, policy_version 1412764 (0.0009) [2023-12-28 05:24:48,695][106226] Updated weights for policy 0, policy_version 1412774 (0.0009) [2023-12-28 05:24:48,747][106226] Updated weights for policy 0, policy_version 1412784 (0.0009) [2023-12-28 05:24:48,967][106225] Updated weights for policy 1, policy_version 1416034 (0.0005) [2023-12-28 05:24:49,029][106225] Updated weights for policy 1, policy_version 1416044 (0.0007) [2023-12-28 05:24:49,086][106225] Updated weights for policy 1, policy_version 1416054 (0.0009) [2023-12-28 05:24:49,511][106226] Updated weights for policy 0, policy_version 1412794 (0.0009) [2023-12-28 05:24:49,577][106226] Updated weights for policy 0, policy_version 1412804 (0.0009) [2023-12-28 05:24:49,644][106226] Updated weights for policy 0, policy_version 1412814 (0.0009) [2023-12-28 05:24:49,773][106225] Updated weights for policy 1, policy_version 1416064 (0.0007) [2023-12-28 05:24:49,837][106225] Updated weights for policy 1, policy_version 1416074 (0.0008) [2023-12-28 05:24:49,893][106225] Updated weights for policy 1, policy_version 1416084 (0.0008) [2023-12-28 05:24:50,293][106226] Updated weights for policy 0, policy_version 1412824 (0.0010) [2023-12-28 05:24:50,361][106226] Updated weights for policy 0, policy_version 1412834 (0.0011) [2023-12-28 05:24:50,428][106226] Updated weights for policy 0, policy_version 1412844 (0.0011) [2023-12-28 05:24:50,507][106225] Updated weights for policy 1, policy_version 1416094 (0.0008) [2023-12-28 05:24:50,573][106225] Updated weights for policy 1, policy_version 1416104 (0.0006) [2023-12-28 05:24:50,629][106225] Updated weights for policy 1, policy_version 1416114 (0.0007) [2023-12-28 05:24:51,120][106226] Updated weights for policy 0, policy_version 1412854 (0.0011) [2023-12-28 05:24:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724336640. Throughput: 0: 9739.6, 1: 9975.5. Samples: 724350040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:51,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-5.031')] [2023-12-28 05:24:51,187][106226] Updated weights for policy 0, policy_version 1412864 (0.0006) [2023-12-28 05:24:51,260][106226] Updated weights for policy 0, policy_version 1412874 (0.0006) [2023-12-28 05:24:51,361][106225] Updated weights for policy 1, policy_version 1416124 (0.0008) [2023-12-28 05:24:51,429][106225] Updated weights for policy 1, policy_version 1416134 (0.0009) [2023-12-28 05:24:51,492][106225] Updated weights for policy 1, policy_version 1416144 (0.0008) [2023-12-28 05:24:51,879][106226] Updated weights for policy 0, policy_version 1412884 (0.0006) [2023-12-28 05:24:51,939][106226] Updated weights for policy 0, policy_version 1412894 (0.0006) [2023-12-28 05:24:52,005][106226] Updated weights for policy 0, policy_version 1412904 (0.0006) [2023-12-28 05:24:52,255][106225] Updated weights for policy 1, policy_version 1416154 (0.0007) [2023-12-28 05:24:52,319][106225] Updated weights for policy 1, policy_version 1416164 (0.0008) [2023-12-28 05:24:52,388][106225] Updated weights for policy 1, policy_version 1416174 (0.0007) [2023-12-28 05:24:52,455][106225] Updated weights for policy 1, policy_version 1416184 (0.0008) [2023-12-28 05:24:52,627][106226] Updated weights for policy 0, policy_version 1412914 (0.0007) [2023-12-28 05:24:52,688][106226] Updated weights for policy 0, policy_version 1412924 (0.0009) [2023-12-28 05:24:52,752][106226] Updated weights for policy 0, policy_version 1412934 (0.0009) [2023-12-28 05:24:52,806][106226] Updated weights for policy 0, policy_version 1412944 (0.0009) [2023-12-28 05:24:53,194][106225] Updated weights for policy 1, policy_version 1416194 (0.0008) [2023-12-28 05:24:53,252][106225] Updated weights for policy 1, policy_version 1416204 (0.0009) [2023-12-28 05:24:53,305][106225] Updated weights for policy 1, policy_version 1416214 (0.0009) [2023-12-28 05:24:53,413][106226] Updated weights for policy 0, policy_version 1412954 (0.0005) [2023-12-28 05:24:53,479][106226] Updated weights for policy 0, policy_version 1412964 (0.0009) [2023-12-28 05:24:53,537][106226] Updated weights for policy 0, policy_version 1412974 (0.0011) [2023-12-28 05:24:54,046][106225] Updated weights for policy 1, policy_version 1416224 (0.0008) [2023-12-28 05:24:54,099][106225] Updated weights for policy 1, policy_version 1416234 (0.0007) [2023-12-28 05:24:54,149][106225] Updated weights for policy 1, policy_version 1416244 (0.0008) [2023-12-28 05:24:54,218][106226] Updated weights for policy 0, policy_version 1412984 (0.0011) [2023-12-28 05:24:54,274][106226] Updated weights for policy 0, policy_version 1412994 (0.0010) [2023-12-28 05:24:54,335][106226] Updated weights for policy 0, policy_version 1413004 (0.0011) [2023-12-28 05:24:54,915][106225] Updated weights for policy 1, policy_version 1416254 (0.0008) [2023-12-28 05:24:54,962][106225] Updated weights for policy 1, policy_version 1416264 (0.0009) [2023-12-28 05:24:55,020][106225] Updated weights for policy 1, policy_version 1416274 (0.0008) [2023-12-28 05:24:55,050][106226] Updated weights for policy 0, policy_version 1413014 (0.0008) [2023-12-28 05:24:55,104][106226] Updated weights for policy 0, policy_version 1413024 (0.0008) [2023-12-28 05:24:55,168][106226] Updated weights for policy 0, policy_version 1413034 (0.0008) [2023-12-28 05:24:55,757][106225] Updated weights for policy 1, policy_version 1416284 (0.0008) [2023-12-28 05:24:55,811][106225] Updated weights for policy 1, policy_version 1416294 (0.0009) [2023-12-28 05:24:55,851][106226] Updated weights for policy 0, policy_version 1413044 (0.0008) [2023-12-28 05:24:55,861][106225] Updated weights for policy 1, policy_version 1416304 (0.0007) [2023-12-28 05:24:55,913][106226] Updated weights for policy 0, policy_version 1413054 (0.0009) [2023-12-28 05:24:55,974][106226] Updated weights for policy 0, policy_version 1413064 (0.0009) [2023-12-28 05:24:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724443136. Throughput: 0: 9751.6, 1: 9942.2. Samples: 724409496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:24:56,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.746')] [2023-12-28 05:24:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001416312_362627072.pth... [2023-12-28 05:24:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001413072_361816064.pth... [2023-12-28 05:24:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001411920_361521152.pth [2023-12-28 05:24:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001415128_362323968.pth [2023-12-28 05:24:56,597][106225] Updated weights for policy 1, policy_version 1416314 (0.0007) [2023-12-28 05:24:56,658][106225] Updated weights for policy 1, policy_version 1416324 (0.0008) [2023-12-28 05:24:56,662][106226] Updated weights for policy 0, policy_version 1413074 (0.0009) [2023-12-28 05:24:56,716][106225] Updated weights for policy 1, policy_version 1416334 (0.0007) [2023-12-28 05:24:56,718][106226] Updated weights for policy 0, policy_version 1413084 (0.0009) [2023-12-28 05:24:56,772][106226] Updated weights for policy 0, policy_version 1413094 (0.0007) [2023-12-28 05:24:56,778][106225] Updated weights for policy 1, policy_version 1416344 (0.0009) [2023-12-28 05:24:56,830][106226] Updated weights for policy 0, policy_version 1413104 (0.0006) [2023-12-28 05:24:57,400][106225] Updated weights for policy 1, policy_version 1416354 (0.0007) [2023-12-28 05:24:57,467][106225] Updated weights for policy 1, policy_version 1416364 (0.0005) [2023-12-28 05:24:57,534][106225] Updated weights for policy 1, policy_version 1416374 (0.0005) [2023-12-28 05:24:57,566][106226] Updated weights for policy 0, policy_version 1413114 (0.0007) [2023-12-28 05:24:57,615][106226] Updated weights for policy 0, policy_version 1413124 (0.0008) [2023-12-28 05:24:57,663][106226] Updated weights for policy 0, policy_version 1413134 (0.0008) [2023-12-28 05:24:58,144][106225] Updated weights for policy 1, policy_version 1416384 (0.0006) [2023-12-28 05:24:58,193][106225] Updated weights for policy 1, policy_version 1416394 (0.0006) [2023-12-28 05:24:58,255][106225] Updated weights for policy 1, policy_version 1416404 (0.0008) [2023-12-28 05:24:58,497][106226] Updated weights for policy 0, policy_version 1413144 (0.0008) [2023-12-28 05:24:58,558][106226] Updated weights for policy 0, policy_version 1413154 (0.0008) [2023-12-28 05:24:58,628][106226] Updated weights for policy 0, policy_version 1413164 (0.0008) [2023-12-28 05:24:59,081][106225] Updated weights for policy 1, policy_version 1416414 (0.0008) [2023-12-28 05:24:59,131][106225] Updated weights for policy 1, policy_version 1416424 (0.0008) [2023-12-28 05:24:59,192][106225] Updated weights for policy 1, policy_version 1416434 (0.0008) [2023-12-28 05:24:59,504][106226] Updated weights for policy 0, policy_version 1413174 (0.0007) [2023-12-28 05:24:59,571][106226] Updated weights for policy 0, policy_version 1413184 (0.0009) [2023-12-28 05:24:59,638][106226] Updated weights for policy 0, policy_version 1413194 (0.0011) [2023-12-28 05:24:59,976][106225] Updated weights for policy 1, policy_version 1416444 (0.0007) [2023-12-28 05:25:00,033][106225] Updated weights for policy 1, policy_version 1416454 (0.0008) [2023-12-28 05:25:00,088][106225] Updated weights for policy 1, policy_version 1416464 (0.0008) [2023-12-28 05:25:00,341][106226] Updated weights for policy 0, policy_version 1413204 (0.0009) [2023-12-28 05:25:00,401][106226] Updated weights for policy 0, policy_version 1413214 (0.0006) [2023-12-28 05:25:00,456][106226] Updated weights for policy 0, policy_version 1413224 (0.0005) [2023-12-28 05:25:00,830][106225] Updated weights for policy 1, policy_version 1416474 (0.0008) [2023-12-28 05:25:00,876][106225] Updated weights for policy 1, policy_version 1416484 (0.0010) [2023-12-28 05:25:00,929][106225] Updated weights for policy 1, policy_version 1416494 (0.0010) [2023-12-28 05:25:00,982][106225] Updated weights for policy 1, policy_version 1416504 (0.0010) [2023-12-28 05:25:01,072][106226] Updated weights for policy 0, policy_version 1413234 (0.0006) [2023-12-28 05:25:01,129][106226] Updated weights for policy 0, policy_version 1413244 (0.0008) [2023-12-28 05:25:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 724533248. Throughput: 0: 9702.3, 1: 9929.1. Samples: 724523568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:01,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.817')] [2023-12-28 05:25:01,196][106226] Updated weights for policy 0, policy_version 1413254 (0.0007) [2023-12-28 05:25:01,251][106226] Updated weights for policy 0, policy_version 1413264 (0.0006) [2023-12-28 05:25:01,749][106225] Updated weights for policy 1, policy_version 1416514 (0.0008) [2023-12-28 05:25:01,791][106225] Updated weights for policy 1, policy_version 1416524 (0.0007) [2023-12-28 05:25:01,838][106225] Updated weights for policy 1, policy_version 1416534 (0.0008) [2023-12-28 05:25:01,953][106226] Updated weights for policy 0, policy_version 1413274 (0.0005) [2023-12-28 05:25:02,007][106226] Updated weights for policy 0, policy_version 1413284 (0.0005) [2023-12-28 05:25:02,069][106226] Updated weights for policy 0, policy_version 1413294 (0.0007) [2023-12-28 05:25:02,626][106225] Updated weights for policy 1, policy_version 1416544 (0.0008) [2023-12-28 05:25:02,671][106226] Updated weights for policy 0, policy_version 1413304 (0.0007) [2023-12-28 05:25:02,676][106225] Updated weights for policy 1, policy_version 1416554 (0.0009) [2023-12-28 05:25:02,727][106225] Updated weights for policy 1, policy_version 1416564 (0.0010) [2023-12-28 05:25:02,728][106226] Updated weights for policy 0, policy_version 1413314 (0.0006) [2023-12-28 05:25:02,785][106226] Updated weights for policy 0, policy_version 1413324 (0.0007) [2023-12-28 05:25:03,398][106225] Updated weights for policy 1, policy_version 1416574 (0.0008) [2023-12-28 05:25:03,453][106225] Updated weights for policy 1, policy_version 1416584 (0.0005) [2023-12-28 05:25:03,477][106226] Updated weights for policy 0, policy_version 1413334 (0.0009) [2023-12-28 05:25:03,515][106225] Updated weights for policy 1, policy_version 1416594 (0.0005) [2023-12-28 05:25:03,526][106226] Updated weights for policy 0, policy_version 1413344 (0.0009) [2023-12-28 05:25:03,579][106226] Updated weights for policy 0, policy_version 1413354 (0.0010) [2023-12-28 05:25:04,211][106225] Updated weights for policy 1, policy_version 1416604 (0.0007) [2023-12-28 05:25:04,277][106225] Updated weights for policy 1, policy_version 1416614 (0.0007) [2023-12-28 05:25:04,304][106226] Updated weights for policy 0, policy_version 1413364 (0.0009) [2023-12-28 05:25:04,339][106225] Updated weights for policy 1, policy_version 1416624 (0.0007) [2023-12-28 05:25:04,371][106226] Updated weights for policy 0, policy_version 1413374 (0.0010) [2023-12-28 05:25:04,430][106226] Updated weights for policy 0, policy_version 1413384 (0.0011) [2023-12-28 05:25:04,982][106225] Updated weights for policy 1, policy_version 1416634 (0.0009) [2023-12-28 05:25:05,019][106226] Updated weights for policy 0, policy_version 1413394 (0.0008) [2023-12-28 05:25:05,043][106225] Updated weights for policy 1, policy_version 1416644 (0.0010) [2023-12-28 05:25:05,076][106226] Updated weights for policy 0, policy_version 1413404 (0.0006) [2023-12-28 05:25:05,092][106225] Updated weights for policy 1, policy_version 1416654 (0.0010) [2023-12-28 05:25:05,129][106226] Updated weights for policy 0, policy_version 1413414 (0.0005) [2023-12-28 05:25:05,138][106225] Updated weights for policy 1, policy_version 1416664 (0.0010) [2023-12-28 05:25:05,188][106226] Updated weights for policy 0, policy_version 1413424 (0.0006) [2023-12-28 05:25:05,731][106226] Updated weights for policy 0, policy_version 1413434 (0.0007) [2023-12-28 05:25:05,770][106225] Updated weights for policy 1, policy_version 1416674 (0.0005) [2023-12-28 05:25:05,787][106226] Updated weights for policy 0, policy_version 1413444 (0.0010) [2023-12-28 05:25:05,828][106225] Updated weights for policy 1, policy_version 1416684 (0.0009) [2023-12-28 05:25:05,842][106226] Updated weights for policy 0, policy_version 1413454 (0.0008) [2023-12-28 05:25:05,878][106225] Updated weights for policy 1, policy_version 1416694 (0.0010) [2023-12-28 05:25:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724639744. Throughput: 0: 9743.5, 1: 9995.6. Samples: 724647176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:06,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-4.669')] [2023-12-28 05:25:06,553][106226] Updated weights for policy 0, policy_version 1413464 (0.0006) [2023-12-28 05:25:06,614][106226] Updated weights for policy 0, policy_version 1413474 (0.0007) [2023-12-28 05:25:06,619][106225] Updated weights for policy 1, policy_version 1416704 (0.0010) [2023-12-28 05:25:06,678][106226] Updated weights for policy 0, policy_version 1413484 (0.0007) [2023-12-28 05:25:06,687][106225] Updated weights for policy 1, policy_version 1416714 (0.0011) [2023-12-28 05:25:06,745][106225] Updated weights for policy 1, policy_version 1416724 (0.0010) [2023-12-28 05:25:07,280][106226] Updated weights for policy 0, policy_version 1413494 (0.0008) [2023-12-28 05:25:07,343][106226] Updated weights for policy 0, policy_version 1413504 (0.0010) [2023-12-28 05:25:07,405][106226] Updated weights for policy 0, policy_version 1413514 (0.0006) [2023-12-28 05:25:07,461][106225] Updated weights for policy 1, policy_version 1416734 (0.0010) [2023-12-28 05:25:07,515][106225] Updated weights for policy 1, policy_version 1416744 (0.0010) [2023-12-28 05:25:07,561][106225] Updated weights for policy 1, policy_version 1416754 (0.0010) [2023-12-28 05:25:08,066][106226] Updated weights for policy 0, policy_version 1413524 (0.0009) [2023-12-28 05:25:08,116][106226] Updated weights for policy 0, policy_version 1413534 (0.0006) [2023-12-28 05:25:08,173][106226] Updated weights for policy 0, policy_version 1413544 (0.0009) [2023-12-28 05:25:08,283][106225] Updated weights for policy 1, policy_version 1416764 (0.0009) [2023-12-28 05:25:08,348][106225] Updated weights for policy 1, policy_version 1416774 (0.0008) [2023-12-28 05:25:08,408][106225] Updated weights for policy 1, policy_version 1416784 (0.0009) [2023-12-28 05:25:08,917][106226] Updated weights for policy 0, policy_version 1413554 (0.0008) [2023-12-28 05:25:08,966][106226] Updated weights for policy 0, policy_version 1413564 (0.0008) [2023-12-28 05:25:09,015][106226] Updated weights for policy 0, policy_version 1413574 (0.0008) [2023-12-28 05:25:09,064][106226] Updated weights for policy 0, policy_version 1413584 (0.0007) [2023-12-28 05:25:09,095][106225] Updated weights for policy 1, policy_version 1416794 (0.0006) [2023-12-28 05:25:09,154][106225] Updated weights for policy 1, policy_version 1416804 (0.0007) [2023-12-28 05:25:09,200][106225] Updated weights for policy 1, policy_version 1416814 (0.0005) [2023-12-28 05:25:09,268][106225] Updated weights for policy 1, policy_version 1416824 (0.0008) [2023-12-28 05:25:09,900][106226] Updated weights for policy 0, policy_version 1413594 (0.0009) [2023-12-28 05:25:09,972][106226] Updated weights for policy 0, policy_version 1413604 (0.0008) [2023-12-28 05:25:10,026][106225] Updated weights for policy 1, policy_version 1416834 (0.0008) [2023-12-28 05:25:10,033][106226] Updated weights for policy 0, policy_version 1413614 (0.0006) [2023-12-28 05:25:10,075][106225] Updated weights for policy 1, policy_version 1416844 (0.0007) [2023-12-28 05:25:10,134][106225] Updated weights for policy 1, policy_version 1416854 (0.0005) [2023-12-28 05:25:10,700][106225] Updated weights for policy 1, policy_version 1416864 (0.0007) [2023-12-28 05:25:10,760][106225] Updated weights for policy 1, policy_version 1416874 (0.0008) [2023-12-28 05:25:10,818][106225] Updated weights for policy 1, policy_version 1416884 (0.0009) [2023-12-28 05:25:10,840][106226] Updated weights for policy 0, policy_version 1413624 (0.0010) [2023-12-28 05:25:10,904][106226] Updated weights for policy 0, policy_version 1413634 (0.0011) [2023-12-28 05:25:10,965][106226] Updated weights for policy 0, policy_version 1413644 (0.0011) [2023-12-28 05:25:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724738048. Throughput: 0: 9770.2, 1: 10017.8. Samples: 724706088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:11,175][105115] Avg episode reward: [(0, '-5.051'), (1, '-4.375')] [2023-12-28 05:25:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001416888_362774528.pth... [2023-12-28 05:25:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001413648_361963520.pth... [2023-12-28 05:25:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001415736_362479616.pth [2023-12-28 05:25:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001412496_361668608.pth [2023-12-28 05:25:11,586][106225] Updated weights for policy 1, policy_version 1416894 (0.0007) [2023-12-28 05:25:11,654][106225] Updated weights for policy 1, policy_version 1416904 (0.0008) [2023-12-28 05:25:11,714][106225] Updated weights for policy 1, policy_version 1416914 (0.0008) [2023-12-28 05:25:11,776][106226] Updated weights for policy 0, policy_version 1413654 (0.0008) [2023-12-28 05:25:11,849][106226] Updated weights for policy 0, policy_version 1413664 (0.0007) [2023-12-28 05:25:11,917][106226] Updated weights for policy 0, policy_version 1413674 (0.0010) [2023-12-28 05:25:12,465][106225] Updated weights for policy 1, policy_version 1416924 (0.0007) [2023-12-28 05:25:12,520][106225] Updated weights for policy 1, policy_version 1416934 (0.0008) [2023-12-28 05:25:12,574][106225] Updated weights for policy 1, policy_version 1416944 (0.0008) [2023-12-28 05:25:12,655][106226] Updated weights for policy 0, policy_version 1413684 (0.0011) [2023-12-28 05:25:12,709][106226] Updated weights for policy 0, policy_version 1413694 (0.0011) [2023-12-28 05:25:12,767][106226] Updated weights for policy 0, policy_version 1413704 (0.0010) [2023-12-28 05:25:13,330][106225] Updated weights for policy 1, policy_version 1416954 (0.0008) [2023-12-28 05:25:13,392][106225] Updated weights for policy 1, policy_version 1416964 (0.0009) [2023-12-28 05:25:13,433][106226] Updated weights for policy 0, policy_version 1413714 (0.0010) [2023-12-28 05:25:13,450][106225] Updated weights for policy 1, policy_version 1416974 (0.0009) [2023-12-28 05:25:13,487][106226] Updated weights for policy 0, policy_version 1413724 (0.0006) [2023-12-28 05:25:13,499][106225] Updated weights for policy 1, policy_version 1416984 (0.0008) [2023-12-28 05:25:13,545][106226] Updated weights for policy 0, policy_version 1413734 (0.0005) [2023-12-28 05:25:13,604][106226] Updated weights for policy 0, policy_version 1413744 (0.0005) [2023-12-28 05:25:14,150][106225] Updated weights for policy 1, policy_version 1416994 (0.0010) [2023-12-28 05:25:14,156][106226] Updated weights for policy 0, policy_version 1413754 (0.0005) [2023-12-28 05:25:14,207][106225] Updated weights for policy 1, policy_version 1417004 (0.0010) [2023-12-28 05:25:14,213][106226] Updated weights for policy 0, policy_version 1413764 (0.0009) [2023-12-28 05:25:14,263][106225] Updated weights for policy 1, policy_version 1417014 (0.0010) [2023-12-28 05:25:14,270][106226] Updated weights for policy 0, policy_version 1413774 (0.0011) [2023-12-28 05:25:14,949][106226] Updated weights for policy 0, policy_version 1413784 (0.0009) [2023-12-28 05:25:14,972][106225] Updated weights for policy 1, policy_version 1417024 (0.0007) [2023-12-28 05:25:15,020][106226] Updated weights for policy 0, policy_version 1413794 (0.0008) [2023-12-28 05:25:15,035][106225] Updated weights for policy 1, policy_version 1417034 (0.0007) [2023-12-28 05:25:15,080][106226] Updated weights for policy 0, policy_version 1413804 (0.0008) [2023-12-28 05:25:15,086][106225] Updated weights for policy 1, policy_version 1417044 (0.0006) [2023-12-28 05:25:15,735][106226] Updated weights for policy 0, policy_version 1413814 (0.0007) [2023-12-28 05:25:15,738][106225] Updated weights for policy 1, policy_version 1417054 (0.0007) [2023-12-28 05:25:15,786][106226] Updated weights for policy 0, policy_version 1413824 (0.0005) [2023-12-28 05:25:15,798][106225] Updated weights for policy 1, policy_version 1417064 (0.0007) [2023-12-28 05:25:15,839][106226] Updated weights for policy 0, policy_version 1413834 (0.0010) [2023-12-28 05:25:15,856][106225] Updated weights for policy 1, policy_version 1417074 (0.0006) [2023-12-28 05:25:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724836352. Throughput: 0: 9755.6, 1: 9955.6. Samples: 724822900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:16,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.739')] [2023-12-28 05:25:16,451][106226] Updated weights for policy 0, policy_version 1413844 (0.0011) [2023-12-28 05:25:16,520][106226] Updated weights for policy 0, policy_version 1413854 (0.0011) [2023-12-28 05:25:16,581][106226] Updated weights for policy 0, policy_version 1413864 (0.0009) [2023-12-28 05:25:16,591][106225] Updated weights for policy 1, policy_version 1417084 (0.0008) [2023-12-28 05:25:16,656][106225] Updated weights for policy 1, policy_version 1417094 (0.0006) [2023-12-28 05:25:16,718][106225] Updated weights for policy 1, policy_version 1417104 (0.0007) [2023-12-28 05:25:17,245][106226] Updated weights for policy 0, policy_version 1413874 (0.0009) [2023-12-28 05:25:17,298][106226] Updated weights for policy 0, policy_version 1413884 (0.0006) [2023-12-28 05:25:17,346][106226] Updated weights for policy 0, policy_version 1413894 (0.0005) [2023-12-28 05:25:17,396][106226] Updated weights for policy 0, policy_version 1413904 (0.0007) [2023-12-28 05:25:17,458][106225] Updated weights for policy 1, policy_version 1417114 (0.0008) [2023-12-28 05:25:17,518][106225] Updated weights for policy 1, policy_version 1417124 (0.0009) [2023-12-28 05:25:17,570][106225] Updated weights for policy 1, policy_version 1417134 (0.0009) [2023-12-28 05:25:17,630][106225] Updated weights for policy 1, policy_version 1417144 (0.0009) [2023-12-28 05:25:18,000][106226] Updated weights for policy 0, policy_version 1413914 (0.0005) [2023-12-28 05:25:18,063][106226] Updated weights for policy 0, policy_version 1413924 (0.0005) [2023-12-28 05:25:18,122][106226] Updated weights for policy 0, policy_version 1413934 (0.0007) [2023-12-28 05:25:18,439][106225] Updated weights for policy 1, policy_version 1417154 (0.0006) [2023-12-28 05:25:18,497][106225] Updated weights for policy 1, policy_version 1417164 (0.0005) [2023-12-28 05:25:18,553][106225] Updated weights for policy 1, policy_version 1417174 (0.0006) [2023-12-28 05:25:18,864][106226] Updated weights for policy 0, policy_version 1413944 (0.0011) [2023-12-28 05:25:18,923][106226] Updated weights for policy 0, policy_version 1413954 (0.0009) [2023-12-28 05:25:18,985][106226] Updated weights for policy 0, policy_version 1413964 (0.0011) [2023-12-28 05:25:19,091][106225] Updated weights for policy 1, policy_version 1417184 (0.0008) [2023-12-28 05:25:19,153][106225] Updated weights for policy 1, policy_version 1417194 (0.0008) [2023-12-28 05:25:19,205][106225] Updated weights for policy 1, policy_version 1417204 (0.0007) [2023-12-28 05:25:19,779][106226] Updated weights for policy 0, policy_version 1413974 (0.0010) [2023-12-28 05:25:19,847][106226] Updated weights for policy 0, policy_version 1413984 (0.0009) [2023-12-28 05:25:19,911][106226] Updated weights for policy 0, policy_version 1413994 (0.0008) [2023-12-28 05:25:19,953][106225] Updated weights for policy 1, policy_version 1417214 (0.0008) [2023-12-28 05:25:20,020][106225] Updated weights for policy 1, policy_version 1417224 (0.0007) [2023-12-28 05:25:20,093][106225] Updated weights for policy 1, policy_version 1417234 (0.0008) [2023-12-28 05:25:20,714][106225] Updated weights for policy 1, policy_version 1417244 (0.0008) [2023-12-28 05:25:20,754][106226] Updated weights for policy 0, policy_version 1414004 (0.0007) [2023-12-28 05:25:20,773][106225] Updated weights for policy 1, policy_version 1417254 (0.0008) [2023-12-28 05:25:20,822][106226] Updated weights for policy 0, policy_version 1414014 (0.0006) [2023-12-28 05:25:20,829][106225] Updated weights for policy 1, policy_version 1417264 (0.0007) [2023-12-28 05:25:20,888][106226] Updated weights for policy 0, policy_version 1414024 (0.0008) [2023-12-28 05:25:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 724934656. Throughput: 0: 9765.1, 1: 9980.1. Samples: 724942088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:21,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-4.771')] [2023-12-28 05:25:21,563][106225] Updated weights for policy 1, policy_version 1417274 (0.0006) [2023-12-28 05:25:21,582][106226] Updated weights for policy 0, policy_version 1414034 (0.0006) [2023-12-28 05:25:21,632][106225] Updated weights for policy 1, policy_version 1417284 (0.0009) [2023-12-28 05:25:21,651][106226] Updated weights for policy 0, policy_version 1414044 (0.0008) [2023-12-28 05:25:21,699][106225] Updated weights for policy 1, policy_version 1417294 (0.0011) [2023-12-28 05:25:21,716][106226] Updated weights for policy 0, policy_version 1414054 (0.0007) [2023-12-28 05:25:21,771][106225] Updated weights for policy 1, policy_version 1417304 (0.0009) [2023-12-28 05:25:21,776][106226] Updated weights for policy 0, policy_version 1414064 (0.0006) [2023-12-28 05:25:22,469][106225] Updated weights for policy 1, policy_version 1417314 (0.0011) [2023-12-28 05:25:22,510][106226] Updated weights for policy 0, policy_version 1414074 (0.0006) [2023-12-28 05:25:22,524][106225] Updated weights for policy 1, policy_version 1417324 (0.0010) [2023-12-28 05:25:22,572][106226] Updated weights for policy 0, policy_version 1414084 (0.0007) [2023-12-28 05:25:22,580][106225] Updated weights for policy 1, policy_version 1417334 (0.0010) [2023-12-28 05:25:22,636][106226] Updated weights for policy 0, policy_version 1414094 (0.0009) [2023-12-28 05:25:23,250][106225] Updated weights for policy 1, policy_version 1417344 (0.0006) [2023-12-28 05:25:23,304][106225] Updated weights for policy 1, policy_version 1417354 (0.0009) [2023-12-28 05:25:23,341][106226] Updated weights for policy 0, policy_version 1414104 (0.0006) [2023-12-28 05:25:23,366][106225] Updated weights for policy 1, policy_version 1417364 (0.0009) [2023-12-28 05:25:23,404][106226] Updated weights for policy 0, policy_version 1414114 (0.0005) [2023-12-28 05:25:23,460][106226] Updated weights for policy 0, policy_version 1414124 (0.0005) [2023-12-28 05:25:24,004][106225] Updated weights for policy 1, policy_version 1417374 (0.0008) [2023-12-28 05:25:24,054][106225] Updated weights for policy 1, policy_version 1417384 (0.0010) [2023-12-28 05:25:24,105][106225] Updated weights for policy 1, policy_version 1417394 (0.0010) [2023-12-28 05:25:24,107][106226] Updated weights for policy 0, policy_version 1414134 (0.0006) [2023-12-28 05:25:24,168][106226] Updated weights for policy 0, policy_version 1414144 (0.0008) [2023-12-28 05:25:24,231][106226] Updated weights for policy 0, policy_version 1414154 (0.0005) [2023-12-28 05:25:24,811][106226] Updated weights for policy 0, policy_version 1414164 (0.0006) [2023-12-28 05:25:24,845][106225] Updated weights for policy 1, policy_version 1417404 (0.0011) [2023-12-28 05:25:24,872][106226] Updated weights for policy 0, policy_version 1414174 (0.0005) [2023-12-28 05:25:24,903][106225] Updated weights for policy 1, policy_version 1417414 (0.0010) [2023-12-28 05:25:24,931][106226] Updated weights for policy 0, policy_version 1414184 (0.0005) [2023-12-28 05:25:24,964][106225] Updated weights for policy 1, policy_version 1417424 (0.0010) [2023-12-28 05:25:25,587][106226] Updated weights for policy 0, policy_version 1414194 (0.0007) [2023-12-28 05:25:25,645][106226] Updated weights for policy 0, policy_version 1414204 (0.0006) [2023-12-28 05:25:25,656][106225] Updated weights for policy 1, policy_version 1417434 (0.0009) [2023-12-28 05:25:25,692][106226] Updated weights for policy 0, policy_version 1414214 (0.0006) [2023-12-28 05:25:25,702][106225] Updated weights for policy 1, policy_version 1417444 (0.0005) [2023-12-28 05:25:25,745][106226] Updated weights for policy 0, policy_version 1414224 (0.0005) [2023-12-28 05:25:25,759][106225] Updated weights for policy 1, policy_version 1417454 (0.0007) [2023-12-28 05:25:25,822][106225] Updated weights for policy 1, policy_version 1417464 (0.0008) [2023-12-28 05:25:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 725032960. Throughput: 0: 9765.9, 1: 9909.4. Samples: 725001056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:26,176][105115] Avg episode reward: [(0, '-4.918'), (1, '-4.570')] [2023-12-28 05:25:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001414224_362110976.pth... [2023-12-28 05:25:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001417464_362921984.pth... [2023-12-28 05:25:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001413072_361816064.pth [2023-12-28 05:25:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001416312_362627072.pth [2023-12-28 05:25:26,338][106226] Updated weights for policy 0, policy_version 1414234 (0.0006) [2023-12-28 05:25:26,391][106225] Updated weights for policy 1, policy_version 1417474 (0.0009) [2023-12-28 05:25:26,393][106226] Updated weights for policy 0, policy_version 1414244 (0.0009) [2023-12-28 05:25:26,440][106225] Updated weights for policy 1, policy_version 1417484 (0.0010) [2023-12-28 05:25:26,446][106226] Updated weights for policy 0, policy_version 1414254 (0.0010) [2023-12-28 05:25:26,491][106225] Updated weights for policy 1, policy_version 1417494 (0.0010) [2023-12-28 05:25:27,057][106226] Updated weights for policy 0, policy_version 1414264 (0.0008) [2023-12-28 05:25:27,102][106225] Updated weights for policy 1, policy_version 1417504 (0.0010) [2023-12-28 05:25:27,115][106226] Updated weights for policy 0, policy_version 1414274 (0.0007) [2023-12-28 05:25:27,151][106225] Updated weights for policy 1, policy_version 1417514 (0.0010) [2023-12-28 05:25:27,174][106226] Updated weights for policy 0, policy_version 1414284 (0.0006) [2023-12-28 05:25:27,197][106225] Updated weights for policy 1, policy_version 1417524 (0.0010) [2023-12-28 05:25:27,761][106226] Updated weights for policy 0, policy_version 1414294 (0.0008) [2023-12-28 05:25:27,817][106226] Updated weights for policy 0, policy_version 1414304 (0.0008) [2023-12-28 05:25:27,877][106226] Updated weights for policy 0, policy_version 1414314 (0.0008) [2023-12-28 05:25:27,927][106225] Updated weights for policy 1, policy_version 1417534 (0.0010) [2023-12-28 05:25:27,982][106225] Updated weights for policy 1, policy_version 1417544 (0.0010) [2023-12-28 05:25:28,038][106225] Updated weights for policy 1, policy_version 1417554 (0.0010) [2023-12-28 05:25:28,547][106226] Updated weights for policy 0, policy_version 1414324 (0.0008) [2023-12-28 05:25:28,608][106226] Updated weights for policy 0, policy_version 1414334 (0.0008) [2023-12-28 05:25:28,670][106226] Updated weights for policy 0, policy_version 1414344 (0.0008) [2023-12-28 05:25:28,744][106225] Updated weights for policy 1, policy_version 1417564 (0.0010) [2023-12-28 05:25:28,802][106225] Updated weights for policy 1, policy_version 1417574 (0.0010) [2023-12-28 05:25:28,866][106225] Updated weights for policy 1, policy_version 1417584 (0.0010) [2023-12-28 05:25:29,442][106226] Updated weights for policy 0, policy_version 1414354 (0.0008) [2023-12-28 05:25:29,496][106226] Updated weights for policy 0, policy_version 1414364 (0.0008) [2023-12-28 05:25:29,549][106226] Updated weights for policy 0, policy_version 1414374 (0.0008) [2023-12-28 05:25:29,608][106225] Updated weights for policy 1, policy_version 1417594 (0.0010) [2023-12-28 05:25:29,622][106226] Updated weights for policy 0, policy_version 1414384 (0.0007) [2023-12-28 05:25:29,651][106225] Updated weights for policy 1, policy_version 1417604 (0.0010) [2023-12-28 05:25:29,713][106225] Updated weights for policy 1, policy_version 1417614 (0.0010) [2023-12-28 05:25:29,763][106225] Updated weights for policy 1, policy_version 1417624 (0.0010) [2023-12-28 05:25:30,385][106226] Updated weights for policy 0, policy_version 1414394 (0.0010) [2023-12-28 05:25:30,446][106226] Updated weights for policy 0, policy_version 1414404 (0.0008) [2023-12-28 05:25:30,454][106225] Updated weights for policy 1, policy_version 1417634 (0.0006) [2023-12-28 05:25:30,502][106226] Updated weights for policy 0, policy_version 1414414 (0.0006) [2023-12-28 05:25:30,504][106225] Updated weights for policy 1, policy_version 1417644 (0.0007) [2023-12-28 05:25:30,556][106225] Updated weights for policy 1, policy_version 1417654 (0.0007) [2023-12-28 05:25:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 725131264. Throughput: 0: 9939.2, 1: 9930.2. Samples: 725125404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:31,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.813')] [2023-12-28 05:25:31,194][106225] Updated weights for policy 1, policy_version 1417664 (0.0008) [2023-12-28 05:25:31,247][106225] Updated weights for policy 1, policy_version 1417674 (0.0008) [2023-12-28 05:25:31,279][106226] Updated weights for policy 0, policy_version 1414424 (0.0009) [2023-12-28 05:25:31,301][106225] Updated weights for policy 1, policy_version 1417684 (0.0008) [2023-12-28 05:25:31,335][106226] Updated weights for policy 0, policy_version 1414434 (0.0010) [2023-12-28 05:25:31,403][106226] Updated weights for policy 0, policy_version 1414444 (0.0010) [2023-12-28 05:25:32,110][106226] Updated weights for policy 0, policy_version 1414454 (0.0010) [2023-12-28 05:25:32,124][106225] Updated weights for policy 1, policy_version 1417694 (0.0007) [2023-12-28 05:25:32,158][106226] Updated weights for policy 0, policy_version 1414464 (0.0006) [2023-12-28 05:25:32,180][106225] Updated weights for policy 1, policy_version 1417704 (0.0006) [2023-12-28 05:25:32,204][106226] Updated weights for policy 0, policy_version 1414474 (0.0006) [2023-12-28 05:25:32,229][106225] Updated weights for policy 1, policy_version 1417714 (0.0007) [2023-12-28 05:25:32,871][106225] Updated weights for policy 1, policy_version 1417724 (0.0007) [2023-12-28 05:25:32,931][106225] Updated weights for policy 1, policy_version 1417734 (0.0008) [2023-12-28 05:25:32,944][106226] Updated weights for policy 0, policy_version 1414484 (0.0008) [2023-12-28 05:25:32,984][106225] Updated weights for policy 1, policy_version 1417744 (0.0006) [2023-12-28 05:25:32,993][106226] Updated weights for policy 0, policy_version 1414494 (0.0010) [2023-12-28 05:25:33,047][106226] Updated weights for policy 0, policy_version 1414504 (0.0010) [2023-12-28 05:25:33,690][106225] Updated weights for policy 1, policy_version 1417754 (0.0006) [2023-12-28 05:25:33,730][106226] Updated weights for policy 0, policy_version 1414514 (0.0010) [2023-12-28 05:25:33,743][106225] Updated weights for policy 1, policy_version 1417764 (0.0009) [2023-12-28 05:25:33,790][106226] Updated weights for policy 0, policy_version 1414524 (0.0010) [2023-12-28 05:25:33,793][106225] Updated weights for policy 1, policy_version 1417774 (0.0006) [2023-12-28 05:25:33,842][106225] Updated weights for policy 1, policy_version 1417784 (0.0010) [2023-12-28 05:25:33,845][106226] Updated weights for policy 0, policy_version 1414534 (0.0010) [2023-12-28 05:25:33,917][106226] Updated weights for policy 0, policy_version 1414544 (0.0011) [2023-12-28 05:25:34,596][106225] Updated weights for policy 1, policy_version 1417794 (0.0011) [2023-12-28 05:25:34,605][106226] Updated weights for policy 0, policy_version 1414554 (0.0007) [2023-12-28 05:25:34,657][106225] Updated weights for policy 1, policy_version 1417804 (0.0010) [2023-12-28 05:25:34,669][106226] Updated weights for policy 0, policy_version 1414564 (0.0008) [2023-12-28 05:25:34,728][106225] Updated weights for policy 1, policy_version 1417814 (0.0010) [2023-12-28 05:25:34,743][106226] Updated weights for policy 0, policy_version 1414574 (0.0010) [2023-12-28 05:25:35,413][106226] Updated weights for policy 0, policy_version 1414584 (0.0010) [2023-12-28 05:25:35,437][106225] Updated weights for policy 1, policy_version 1417824 (0.0010) [2023-12-28 05:25:35,472][106226] Updated weights for policy 0, policy_version 1414594 (0.0010) [2023-12-28 05:25:35,490][106225] Updated weights for policy 1, policy_version 1417834 (0.0010) [2023-12-28 05:25:35,525][106226] Updated weights for policy 0, policy_version 1414604 (0.0011) [2023-12-28 05:25:35,540][106225] Updated weights for policy 1, policy_version 1417844 (0.0010) [2023-12-28 05:25:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 725229568. Throughput: 0: 9993.0, 1: 9849.0. Samples: 725242928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:36,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-4.919')] [2023-12-28 05:25:36,259][106226] Updated weights for policy 0, policy_version 1414614 (0.0009) [2023-12-28 05:25:36,308][106226] Updated weights for policy 0, policy_version 1414624 (0.0009) [2023-12-28 05:25:36,309][106225] Updated weights for policy 1, policy_version 1417854 (0.0009) [2023-12-28 05:25:36,360][106226] Updated weights for policy 0, policy_version 1414634 (0.0008) [2023-12-28 05:25:36,366][106225] Updated weights for policy 1, policy_version 1417864 (0.0010) [2023-12-28 05:25:36,428][106225] Updated weights for policy 1, policy_version 1417874 (0.0011) [2023-12-28 05:25:37,118][106226] Updated weights for policy 0, policy_version 1414644 (0.0008) [2023-12-28 05:25:37,168][106225] Updated weights for policy 1, policy_version 1417884 (0.0011) [2023-12-28 05:25:37,180][106226] Updated weights for policy 0, policy_version 1414654 (0.0011) [2023-12-28 05:25:37,218][106225] Updated weights for policy 1, policy_version 1417894 (0.0010) [2023-12-28 05:25:37,240][106226] Updated weights for policy 0, policy_version 1414664 (0.0010) [2023-12-28 05:25:37,268][106225] Updated weights for policy 1, policy_version 1417904 (0.0010) [2023-12-28 05:25:37,965][106226] Updated weights for policy 0, policy_version 1414674 (0.0010) [2023-12-28 05:25:37,997][106225] Updated weights for policy 1, policy_version 1417914 (0.0010) [2023-12-28 05:25:38,023][106226] Updated weights for policy 0, policy_version 1414684 (0.0007) [2023-12-28 05:25:38,051][106225] Updated weights for policy 1, policy_version 1417924 (0.0005) [2023-12-28 05:25:38,077][106226] Updated weights for policy 0, policy_version 1414694 (0.0008) [2023-12-28 05:25:38,097][106225] Updated weights for policy 1, policy_version 1417934 (0.0005) [2023-12-28 05:25:38,130][106226] Updated weights for policy 0, policy_version 1414704 (0.0007) [2023-12-28 05:25:38,155][106225] Updated weights for policy 1, policy_version 1417944 (0.0009) [2023-12-28 05:25:38,841][106226] Updated weights for policy 0, policy_version 1414714 (0.0009) [2023-12-28 05:25:38,864][106225] Updated weights for policy 1, policy_version 1417954 (0.0006) [2023-12-28 05:25:38,905][106226] Updated weights for policy 0, policy_version 1414724 (0.0008) [2023-12-28 05:25:38,917][106225] Updated weights for policy 1, policy_version 1417964 (0.0009) [2023-12-28 05:25:38,962][106226] Updated weights for policy 0, policy_version 1414734 (0.0009) [2023-12-28 05:25:38,976][106225] Updated weights for policy 1, policy_version 1417974 (0.0007) [2023-12-28 05:25:39,741][106226] Updated weights for policy 0, policy_version 1414744 (0.0007) [2023-12-28 05:25:39,743][106225] Updated weights for policy 1, policy_version 1417984 (0.0006) [2023-12-28 05:25:39,800][106226] Updated weights for policy 0, policy_version 1414754 (0.0007) [2023-12-28 05:25:39,802][106225] Updated weights for policy 1, policy_version 1417994 (0.0006) [2023-12-28 05:25:39,867][106226] Updated weights for policy 0, policy_version 1414764 (0.0008) [2023-12-28 05:25:39,870][106225] Updated weights for policy 1, policy_version 1418004 (0.0007) [2023-12-28 05:25:40,549][106226] Updated weights for policy 0, policy_version 1414774 (0.0009) [2023-12-28 05:25:40,602][106225] Updated weights for policy 1, policy_version 1418014 (0.0007) [2023-12-28 05:25:40,608][106226] Updated weights for policy 0, policy_version 1414784 (0.0008) [2023-12-28 05:25:40,653][106225] Updated weights for policy 1, policy_version 1418024 (0.0008) [2023-12-28 05:25:40,665][106226] Updated weights for policy 0, policy_version 1414794 (0.0009) [2023-12-28 05:25:40,702][106225] Updated weights for policy 1, policy_version 1418034 (0.0007) [2023-12-28 05:25:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 725327872. Throughput: 0: 9925.3, 1: 9875.2. Samples: 725300516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:25:41,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.750')] [2023-12-28 05:25:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001418040_363069440.pth... [2023-12-28 05:25:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001414800_362258432.pth... [2023-12-28 05:25:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001416888_362774528.pth [2023-12-28 05:25:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001413648_361963520.pth [2023-12-28 05:25:41,379][106226] Updated weights for policy 0, policy_version 1414804 (0.0008) [2023-12-28 05:25:41,442][106226] Updated weights for policy 0, policy_version 1414814 (0.0008) [2023-12-28 05:25:41,498][106226] Updated weights for policy 0, policy_version 1414824 (0.0008) [2023-12-28 05:25:41,528][106225] Updated weights for policy 1, policy_version 1418044 (0.0008) [2023-12-28 05:25:41,587][106225] Updated weights for policy 1, policy_version 1418054 (0.0008) [2023-12-28 05:25:41,655][106225] Updated weights for policy 1, policy_version 1418064 (0.0009) [2023-12-28 05:25:42,230][106226] Updated weights for policy 0, policy_version 1414834 (0.0006) [2023-12-28 05:25:42,295][106226] Updated weights for policy 0, policy_version 1414844 (0.0009) [2023-12-28 05:25:42,364][106226] Updated weights for policy 0, policy_version 1414854 (0.0008) [2023-12-28 05:25:42,411][106225] Updated weights for policy 1, policy_version 1418074 (0.0009) [2023-12-28 05:25:42,430][106226] Updated weights for policy 0, policy_version 1414864 (0.0006) [2023-12-28 05:25:42,460][106225] Updated weights for policy 1, policy_version 1418084 (0.0008) [2023-12-28 05:25:42,520][106225] Updated weights for policy 1, policy_version 1418094 (0.0008) [2023-12-28 05:25:42,580][106225] Updated weights for policy 1, policy_version 1418104 (0.0009) [2023-12-28 05:25:43,027][106226] Updated weights for policy 0, policy_version 1414874 (0.0006) [2023-12-28 05:25:43,093][106226] Updated weights for policy 0, policy_version 1414884 (0.0005) [2023-12-28 05:25:43,148][106226] Updated weights for policy 0, policy_version 1414894 (0.0007) [2023-12-28 05:25:43,311][106225] Updated weights for policy 1, policy_version 1418114 (0.0009) [2023-12-28 05:25:43,364][106225] Updated weights for policy 1, policy_version 1418124 (0.0009) [2023-12-28 05:25:43,426][106225] Updated weights for policy 1, policy_version 1418134 (0.0008) [2023-12-28 05:25:43,825][106226] Updated weights for policy 0, policy_version 1414904 (0.0008) [2023-12-28 05:25:43,882][106226] Updated weights for policy 0, policy_version 1414914 (0.0007) [2023-12-28 05:25:43,940][106226] Updated weights for policy 0, policy_version 1414924 (0.0008) [2023-12-28 05:25:44,159][106225] Updated weights for policy 1, policy_version 1418144 (0.0008) [2023-12-28 05:25:44,207][106225] Updated weights for policy 1, policy_version 1418154 (0.0008) [2023-12-28 05:25:44,253][106225] Updated weights for policy 1, policy_version 1418164 (0.0008) [2023-12-28 05:25:44,616][106226] Updated weights for policy 0, policy_version 1414934 (0.0008) [2023-12-28 05:25:44,668][106226] Updated weights for policy 0, policy_version 1414944 (0.0008) [2023-12-28 05:25:44,719][106226] Updated weights for policy 0, policy_version 1414954 (0.0008) [2023-12-28 05:25:45,028][106225] Updated weights for policy 1, policy_version 1418174 (0.0009) [2023-12-28 05:25:45,086][106225] Updated weights for policy 1, policy_version 1418184 (0.0009) [2023-12-28 05:25:45,134][106225] Updated weights for policy 1, policy_version 1418194 (0.0008) [2023-12-28 05:25:45,455][106226] Updated weights for policy 0, policy_version 1414964 (0.0007) [2023-12-28 05:25:45,521][106226] Updated weights for policy 0, policy_version 1414974 (0.0009) [2023-12-28 05:25:45,583][106226] Updated weights for policy 0, policy_version 1414984 (0.0008) [2023-12-28 05:25:45,792][106225] Updated weights for policy 1, policy_version 1418204 (0.0007) [2023-12-28 05:25:45,853][106225] Updated weights for policy 1, policy_version 1418214 (0.0005) [2023-12-28 05:25:45,921][106225] Updated weights for policy 1, policy_version 1418224 (0.0006) [2023-12-28 05:25:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 725426176. Throughput: 0: 9994.0, 1: 9826.4. Samples: 725415484. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:25:46,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.007')] [2023-12-28 05:25:46,318][106226] Updated weights for policy 0, policy_version 1414994 (0.0009) [2023-12-28 05:25:46,376][106226] Updated weights for policy 0, policy_version 1415004 (0.0009) [2023-12-28 05:25:46,438][106226] Updated weights for policy 0, policy_version 1415014 (0.0009) [2023-12-28 05:25:46,494][106226] Updated weights for policy 0, policy_version 1415024 (0.0009) [2023-12-28 05:25:46,528][106225] Updated weights for policy 1, policy_version 1418234 (0.0006) [2023-12-28 05:25:46,584][106225] Updated weights for policy 1, policy_version 1418244 (0.0008) [2023-12-28 05:25:46,646][106225] Updated weights for policy 1, policy_version 1418254 (0.0009) [2023-12-28 05:25:46,714][106225] Updated weights for policy 1, policy_version 1418264 (0.0009) [2023-12-28 05:25:47,306][106226] Updated weights for policy 0, policy_version 1415034 (0.0009) [2023-12-28 05:25:47,365][106226] Updated weights for policy 0, policy_version 1415044 (0.0006) [2023-12-28 05:25:47,377][106225] Updated weights for policy 1, policy_version 1418274 (0.0007) [2023-12-28 05:25:47,417][106226] Updated weights for policy 0, policy_version 1415054 (0.0007) [2023-12-28 05:25:47,434][106225] Updated weights for policy 1, policy_version 1418284 (0.0007) [2023-12-28 05:25:47,497][106225] Updated weights for policy 1, policy_version 1418294 (0.0008) [2023-12-28 05:25:48,121][106226] Updated weights for policy 0, policy_version 1415064 (0.0009) [2023-12-28 05:25:48,175][106226] Updated weights for policy 0, policy_version 1415074 (0.0008) [2023-12-28 05:25:48,191][106225] Updated weights for policy 1, policy_version 1418304 (0.0008) [2023-12-28 05:25:48,235][106226] Updated weights for policy 0, policy_version 1415084 (0.0005) [2023-12-28 05:25:48,247][106225] Updated weights for policy 1, policy_version 1418314 (0.0008) [2023-12-28 05:25:48,308][106225] Updated weights for policy 1, policy_version 1418324 (0.0009) [2023-12-28 05:25:48,900][106226] Updated weights for policy 0, policy_version 1415094 (0.0008) [2023-12-28 05:25:48,963][106226] Updated weights for policy 0, policy_version 1415104 (0.0011) [2023-12-28 05:25:49,013][106226] Updated weights for policy 0, policy_version 1415114 (0.0010) [2023-12-28 05:25:49,093][106225] Updated weights for policy 1, policy_version 1418334 (0.0008) [2023-12-28 05:25:49,144][106225] Updated weights for policy 1, policy_version 1418344 (0.0006) [2023-12-28 05:25:49,189][106225] Updated weights for policy 1, policy_version 1418354 (0.0005) [2023-12-28 05:25:49,677][106226] Updated weights for policy 0, policy_version 1415124 (0.0008) [2023-12-28 05:25:49,738][106226] Updated weights for policy 0, policy_version 1415134 (0.0006) [2023-12-28 05:25:49,802][106226] Updated weights for policy 0, policy_version 1415144 (0.0009) [2023-12-28 05:25:49,906][106225] Updated weights for policy 1, policy_version 1418364 (0.0007) [2023-12-28 05:25:49,980][106225] Updated weights for policy 1, policy_version 1418374 (0.0008) [2023-12-28 05:25:50,041][106225] Updated weights for policy 1, policy_version 1418384 (0.0009) [2023-12-28 05:25:50,485][106226] Updated weights for policy 0, policy_version 1415154 (0.0009) [2023-12-28 05:25:50,550][106226] Updated weights for policy 0, policy_version 1415164 (0.0007) [2023-12-28 05:25:50,620][106226] Updated weights for policy 0, policy_version 1415174 (0.0011) [2023-12-28 05:25:50,687][106226] Updated weights for policy 0, policy_version 1415184 (0.0011) [2023-12-28 05:25:50,757][106225] Updated weights for policy 1, policy_version 1418394 (0.0009) [2023-12-28 05:25:50,817][106225] Updated weights for policy 1, policy_version 1418404 (0.0009) [2023-12-28 05:25:50,884][106225] Updated weights for policy 1, policy_version 1418414 (0.0006) [2023-12-28 05:25:50,942][106225] Updated weights for policy 1, policy_version 1418424 (0.0008) [2023-12-28 05:25:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 725524480. Throughput: 0: 9862.0, 1: 9822.3. Samples: 725532968. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:25:51,175][105115] Avg episode reward: [(0, '-4.669'), (1, '-4.934')] [2023-12-28 05:25:51,445][106226] Updated weights for policy 0, policy_version 1415194 (0.0009) [2023-12-28 05:25:51,503][106226] Updated weights for policy 0, policy_version 1415204 (0.0011) [2023-12-28 05:25:51,557][106226] Updated weights for policy 0, policy_version 1415214 (0.0006) [2023-12-28 05:25:51,662][106225] Updated weights for policy 1, policy_version 1418434 (0.0010) [2023-12-28 05:25:51,728][106225] Updated weights for policy 1, policy_version 1418444 (0.0011) [2023-12-28 05:25:51,796][106225] Updated weights for policy 1, policy_version 1418454 (0.0010) [2023-12-28 05:25:52,264][106226] Updated weights for policy 0, policy_version 1415224 (0.0009) [2023-12-28 05:25:52,324][106226] Updated weights for policy 0, policy_version 1415234 (0.0010) [2023-12-28 05:25:52,390][106226] Updated weights for policy 0, policy_version 1415244 (0.0011) [2023-12-28 05:25:52,512][106225] Updated weights for policy 1, policy_version 1418464 (0.0007) [2023-12-28 05:25:52,571][106225] Updated weights for policy 1, policy_version 1418474 (0.0007) [2023-12-28 05:25:52,638][106225] Updated weights for policy 1, policy_version 1418484 (0.0008) [2023-12-28 05:25:53,005][106226] Updated weights for policy 0, policy_version 1415254 (0.0009) [2023-12-28 05:25:53,061][106226] Updated weights for policy 0, policy_version 1415264 (0.0009) [2023-12-28 05:25:53,118][106226] Updated weights for policy 0, policy_version 1415274 (0.0009) [2023-12-28 05:25:53,347][106225] Updated weights for policy 1, policy_version 1418494 (0.0008) [2023-12-28 05:25:53,404][106225] Updated weights for policy 1, policy_version 1418504 (0.0009) [2023-12-28 05:25:53,461][106225] Updated weights for policy 1, policy_version 1418514 (0.0010) [2023-12-28 05:25:53,758][106226] Updated weights for policy 0, policy_version 1415284 (0.0008) [2023-12-28 05:25:53,814][106226] Updated weights for policy 0, policy_version 1415294 (0.0008) [2023-12-28 05:25:53,867][106226] Updated weights for policy 0, policy_version 1415304 (0.0008) [2023-12-28 05:25:54,159][106225] Updated weights for policy 1, policy_version 1418524 (0.0008) [2023-12-28 05:25:54,210][106225] Updated weights for policy 1, policy_version 1418534 (0.0005) [2023-12-28 05:25:54,259][106225] Updated weights for policy 1, policy_version 1418544 (0.0008) [2023-12-28 05:25:54,561][106226] Updated weights for policy 0, policy_version 1415314 (0.0008) [2023-12-28 05:25:54,626][106226] Updated weights for policy 0, policy_version 1415324 (0.0008) [2023-12-28 05:25:54,690][106226] Updated weights for policy 0, policy_version 1415334 (0.0008) [2023-12-28 05:25:54,753][106226] Updated weights for policy 0, policy_version 1415344 (0.0008) [2023-12-28 05:25:54,957][106225] Updated weights for policy 1, policy_version 1418554 (0.0010) [2023-12-28 05:25:55,016][106225] Updated weights for policy 1, policy_version 1418564 (0.0010) [2023-12-28 05:25:55,077][106225] Updated weights for policy 1, policy_version 1418574 (0.0010) [2023-12-28 05:25:55,133][106225] Updated weights for policy 1, policy_version 1418584 (0.0009) [2023-12-28 05:25:55,375][106226] Updated weights for policy 0, policy_version 1415354 (0.0005) [2023-12-28 05:25:55,430][106226] Updated weights for policy 0, policy_version 1415364 (0.0005) [2023-12-28 05:25:55,486][106226] Updated weights for policy 0, policy_version 1415374 (0.0006) [2023-12-28 05:25:55,895][106225] Updated weights for policy 1, policy_version 1418594 (0.0005) [2023-12-28 05:25:55,962][106225] Updated weights for policy 1, policy_version 1418604 (0.0009) [2023-12-28 05:25:56,016][106225] Updated weights for policy 1, policy_version 1418614 (0.0010) [2023-12-28 05:25:56,050][106226] Updated weights for policy 0, policy_version 1415384 (0.0006) [2023-12-28 05:25:56,111][106226] Updated weights for policy 0, policy_version 1415394 (0.0006) [2023-12-28 05:25:56,170][106226] Updated weights for policy 0, policy_version 1415404 (0.0006) [2023-12-28 05:25:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 725622784. Throughput: 0: 9878.4, 1: 9815.2. Samples: 725592300. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:25:56,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.636')] [2023-12-28 05:25:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001418616_363216896.pth... [2023-12-28 05:25:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001417464_362921984.pth [2023-12-28 05:25:56,193][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001415408_362414080.pth... [2023-12-28 05:25:56,198][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001414224_362110976.pth [2023-12-28 05:25:56,638][106225] Updated weights for policy 1, policy_version 1418624 (0.0007) [2023-12-28 05:25:56,691][106225] Updated weights for policy 1, policy_version 1418634 (0.0008) [2023-12-28 05:25:56,741][106225] Updated weights for policy 1, policy_version 1418644 (0.0010) [2023-12-28 05:25:56,792][106226] Updated weights for policy 0, policy_version 1415414 (0.0007) [2023-12-28 05:25:56,833][106226] Updated weights for policy 0, policy_version 1415424 (0.0007) [2023-12-28 05:25:56,892][106226] Updated weights for policy 0, policy_version 1415434 (0.0008) [2023-12-28 05:25:57,454][106225] Updated weights for policy 1, policy_version 1418654 (0.0010) [2023-12-28 05:25:57,514][106225] Updated weights for policy 1, policy_version 1418664 (0.0008) [2023-12-28 05:25:57,553][106226] Updated weights for policy 0, policy_version 1415444 (0.0007) [2023-12-28 05:25:57,565][106225] Updated weights for policy 1, policy_version 1418674 (0.0010) [2023-12-28 05:25:57,598][106226] Updated weights for policy 0, policy_version 1415454 (0.0005) [2023-12-28 05:25:57,650][106226] Updated weights for policy 0, policy_version 1415464 (0.0005) [2023-12-28 05:25:58,228][106225] Updated weights for policy 1, policy_version 1418684 (0.0010) [2023-12-28 05:25:58,288][106225] Updated weights for policy 1, policy_version 1418694 (0.0009) [2023-12-28 05:25:58,319][106226] Updated weights for policy 0, policy_version 1415474 (0.0006) [2023-12-28 05:25:58,353][106225] Updated weights for policy 1, policy_version 1418704 (0.0009) [2023-12-28 05:25:58,386][106226] Updated weights for policy 0, policy_version 1415484 (0.0007) [2023-12-28 05:25:58,453][106226] Updated weights for policy 0, policy_version 1415494 (0.0009) [2023-12-28 05:25:58,517][106226] Updated weights for policy 0, policy_version 1415504 (0.0008) [2023-12-28 05:25:59,176][106225] Updated weights for policy 1, policy_version 1418714 (0.0009) [2023-12-28 05:25:59,248][106225] Updated weights for policy 1, policy_version 1418724 (0.0012) [2023-12-28 05:25:59,315][106225] Updated weights for policy 1, policy_version 1418734 (0.0010) [2023-12-28 05:25:59,382][106225] Updated weights for policy 1, policy_version 1418744 (0.0009) [2023-12-28 05:25:59,440][106226] Updated weights for policy 0, policy_version 1415514 (0.0008) [2023-12-28 05:25:59,500][106226] Updated weights for policy 0, policy_version 1415524 (0.0007) [2023-12-28 05:25:59,558][106226] Updated weights for policy 0, policy_version 1415534 (0.0008) [2023-12-28 05:26:00,100][106225] Updated weights for policy 1, policy_version 1418754 (0.0010) [2023-12-28 05:26:00,154][106225] Updated weights for policy 1, policy_version 1418764 (0.0010) [2023-12-28 05:26:00,205][106225] Updated weights for policy 1, policy_version 1418774 (0.0010) [2023-12-28 05:26:00,287][106226] Updated weights for policy 0, policy_version 1415544 (0.0008) [2023-12-28 05:26:00,353][106226] Updated weights for policy 0, policy_version 1415554 (0.0006) [2023-12-28 05:26:00,411][106226] Updated weights for policy 0, policy_version 1415564 (0.0006) [2023-12-28 05:26:00,960][106226] Updated weights for policy 0, policy_version 1415574 (0.0007) [2023-12-28 05:26:00,985][106225] Updated weights for policy 1, policy_version 1418784 (0.0007) [2023-12-28 05:26:01,013][106226] Updated weights for policy 0, policy_version 1415584 (0.0008) [2023-12-28 05:26:01,043][106225] Updated weights for policy 1, policy_version 1418794 (0.0007) [2023-12-28 05:26:01,086][106226] Updated weights for policy 0, policy_version 1415594 (0.0007) [2023-12-28 05:26:01,104][106225] Updated weights for policy 1, policy_version 1418804 (0.0007) [2023-12-28 05:26:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 725729280. Throughput: 0: 9954.4, 1: 9797.8. Samples: 725711748. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:01,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-4.701')] [2023-12-28 05:26:01,779][106226] Updated weights for policy 0, policy_version 1415604 (0.0008) [2023-12-28 05:26:01,841][106226] Updated weights for policy 0, policy_version 1415614 (0.0011) [2023-12-28 05:26:01,894][106226] Updated weights for policy 0, policy_version 1415624 (0.0011) [2023-12-28 05:26:01,908][106225] Updated weights for policy 1, policy_version 1418814 (0.0006) [2023-12-28 05:26:01,959][106225] Updated weights for policy 1, policy_version 1418824 (0.0007) [2023-12-28 05:26:02,007][106225] Updated weights for policy 1, policy_version 1418834 (0.0007) [2023-12-28 05:26:02,614][106226] Updated weights for policy 0, policy_version 1415634 (0.0010) [2023-12-28 05:26:02,663][106226] Updated weights for policy 0, policy_version 1415644 (0.0008) [2023-12-28 05:26:02,712][106226] Updated weights for policy 0, policy_version 1415654 (0.0007) [2023-12-28 05:26:02,715][106225] Updated weights for policy 1, policy_version 1418844 (0.0007) [2023-12-28 05:26:02,771][106226] Updated weights for policy 0, policy_version 1415664 (0.0009) [2023-12-28 05:26:02,773][106225] Updated weights for policy 1, policy_version 1418854 (0.0006) [2023-12-28 05:26:02,825][106225] Updated weights for policy 1, policy_version 1418864 (0.0008) [2023-12-28 05:26:03,512][106226] Updated weights for policy 0, policy_version 1415674 (0.0009) [2023-12-28 05:26:03,546][106225] Updated weights for policy 1, policy_version 1418874 (0.0009) [2023-12-28 05:26:03,570][106226] Updated weights for policy 0, policy_version 1415684 (0.0009) [2023-12-28 05:26:03,605][106225] Updated weights for policy 1, policy_version 1418884 (0.0005) [2023-12-28 05:26:03,626][106226] Updated weights for policy 0, policy_version 1415694 (0.0008) [2023-12-28 05:26:03,654][106225] Updated weights for policy 1, policy_version 1418894 (0.0005) [2023-12-28 05:26:03,713][106225] Updated weights for policy 1, policy_version 1418904 (0.0005) [2023-12-28 05:26:04,317][106226] Updated weights for policy 0, policy_version 1415704 (0.0008) [2023-12-28 05:26:04,381][106226] Updated weights for policy 0, policy_version 1415714 (0.0008) [2023-12-28 05:26:04,418][106225] Updated weights for policy 1, policy_version 1418914 (0.0008) [2023-12-28 05:26:04,443][106226] Updated weights for policy 0, policy_version 1415724 (0.0007) [2023-12-28 05:26:04,478][106225] Updated weights for policy 1, policy_version 1418924 (0.0007) [2023-12-28 05:26:04,533][106225] Updated weights for policy 1, policy_version 1418934 (0.0008) [2023-12-28 05:26:05,116][106225] Updated weights for policy 1, policy_version 1418944 (0.0006) [2023-12-28 05:26:05,169][106225] Updated weights for policy 1, policy_version 1418954 (0.0007) [2023-12-28 05:26:05,185][106226] Updated weights for policy 0, policy_version 1415734 (0.0006) [2023-12-28 05:26:05,221][106225] Updated weights for policy 1, policy_version 1418964 (0.0010) [2023-12-28 05:26:05,246][106226] Updated weights for policy 0, policy_version 1415744 (0.0005) [2023-12-28 05:26:05,303][106226] Updated weights for policy 0, policy_version 1415754 (0.0006) [2023-12-28 05:26:05,799][106226] Updated weights for policy 0, policy_version 1415764 (0.0005) [2023-12-28 05:26:05,854][106226] Updated weights for policy 0, policy_version 1415774 (0.0005) [2023-12-28 05:26:05,904][106226] Updated weights for policy 0, policy_version 1415784 (0.0005) [2023-12-28 05:26:05,940][106225] Updated weights for policy 1, policy_version 1418974 (0.0010) [2023-12-28 05:26:05,989][106225] Updated weights for policy 1, policy_version 1418984 (0.0008) [2023-12-28 05:26:06,041][106225] Updated weights for policy 1, policy_version 1418994 (0.0008) [2023-12-28 05:26:06,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 725827584. Throughput: 0: 10018.0, 1: 9770.8. Samples: 725832584. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:06,176][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.864')] [2023-12-28 05:26:06,554][106226] Updated weights for policy 0, policy_version 1415794 (0.0005) [2023-12-28 05:26:06,623][106226] Updated weights for policy 0, policy_version 1415804 (0.0009) [2023-12-28 05:26:06,688][106226] Updated weights for policy 0, policy_version 1415814 (0.0011) [2023-12-28 05:26:06,749][106226] Updated weights for policy 0, policy_version 1415824 (0.0010) [2023-12-28 05:26:06,758][106225] Updated weights for policy 1, policy_version 1419004 (0.0010) [2023-12-28 05:26:06,814][106225] Updated weights for policy 1, policy_version 1419014 (0.0010) [2023-12-28 05:26:06,876][106225] Updated weights for policy 1, policy_version 1419024 (0.0010) [2023-12-28 05:26:07,406][106226] Updated weights for policy 0, policy_version 1415834 (0.0006) [2023-12-28 05:26:07,466][106226] Updated weights for policy 0, policy_version 1415844 (0.0010) [2023-12-28 05:26:07,522][106226] Updated weights for policy 0, policy_version 1415854 (0.0011) [2023-12-28 05:26:07,559][106225] Updated weights for policy 1, policy_version 1419034 (0.0009) [2023-12-28 05:26:07,624][106225] Updated weights for policy 1, policy_version 1419044 (0.0006) [2023-12-28 05:26:07,681][106225] Updated weights for policy 1, policy_version 1419054 (0.0010) [2023-12-28 05:26:07,738][106225] Updated weights for policy 1, policy_version 1419064 (0.0010) [2023-12-28 05:26:08,225][106226] Updated weights for policy 0, policy_version 1415864 (0.0008) [2023-12-28 05:26:08,279][106226] Updated weights for policy 0, policy_version 1415874 (0.0006) [2023-12-28 05:26:08,342][106226] Updated weights for policy 0, policy_version 1415884 (0.0008) [2023-12-28 05:26:08,354][106225] Updated weights for policy 1, policy_version 1419075 (0.0009) [2023-12-28 05:26:08,410][106225] Updated weights for policy 1, policy_version 1419085 (0.0010) [2023-12-28 05:26:08,457][106225] Updated weights for policy 1, policy_version 1419095 (0.0010) [2023-12-28 05:26:09,007][106226] Updated weights for policy 0, policy_version 1415894 (0.0009) [2023-12-28 05:26:09,066][106226] Updated weights for policy 0, policy_version 1415904 (0.0008) [2023-12-28 05:26:09,119][106226] Updated weights for policy 0, policy_version 1415914 (0.0008) [2023-12-28 05:26:09,175][106225] Updated weights for policy 1, policy_version 1419105 (0.0007) [2023-12-28 05:26:09,237][106225] Updated weights for policy 1, policy_version 1419115 (0.0008) [2023-12-28 05:26:09,296][106225] Updated weights for policy 1, policy_version 1419125 (0.0008) [2023-12-28 05:26:09,881][106226] Updated weights for policy 0, policy_version 1415924 (0.0007) [2023-12-28 05:26:09,956][106226] Updated weights for policy 0, policy_version 1415934 (0.0008) [2023-12-28 05:26:09,963][106225] Updated weights for policy 1, policy_version 1419135 (0.0008) [2023-12-28 05:26:10,014][106226] Updated weights for policy 0, policy_version 1415944 (0.0007) [2023-12-28 05:26:10,020][106225] Updated weights for policy 1, policy_version 1419145 (0.0007) [2023-12-28 05:26:10,082][106225] Updated weights for policy 1, policy_version 1419155 (0.0008) [2023-12-28 05:26:10,692][106226] Updated weights for policy 0, policy_version 1415954 (0.0006) [2023-12-28 05:26:10,744][106226] Updated weights for policy 0, policy_version 1415964 (0.0008) [2023-12-28 05:26:10,799][106226] Updated weights for policy 0, policy_version 1415974 (0.0008) [2023-12-28 05:26:10,860][106225] Updated weights for policy 1, policy_version 1419165 (0.0007) [2023-12-28 05:26:10,868][106226] Updated weights for policy 0, policy_version 1415984 (0.0008) [2023-12-28 05:26:10,918][106225] Updated weights for policy 1, policy_version 1419175 (0.0006) [2023-12-28 05:26:10,971][106225] Updated weights for policy 1, policy_version 1419185 (0.0006) [2023-12-28 05:26:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 725925888. Throughput: 0: 10040.5, 1: 9786.3. Samples: 725893256. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:11,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.790')] [2023-12-28 05:26:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001419192_363364352.pth... [2023-12-28 05:26:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001415984_362561536.pth... [2023-12-28 05:26:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001418040_363069440.pth [2023-12-28 05:26:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001414800_362258432.pth [2023-12-28 05:26:11,608][106226] Updated weights for policy 0, policy_version 1415994 (0.0011) [2023-12-28 05:26:11,632][106225] Updated weights for policy 1, policy_version 1419195 (0.0006) [2023-12-28 05:26:11,678][106226] Updated weights for policy 0, policy_version 1416004 (0.0008) [2023-12-28 05:26:11,693][106225] Updated weights for policy 1, policy_version 1419205 (0.0008) [2023-12-28 05:26:11,742][106226] Updated weights for policy 0, policy_version 1416014 (0.0008) [2023-12-28 05:26:11,759][106225] Updated weights for policy 1, policy_version 1419215 (0.0008) [2023-12-28 05:26:12,455][106225] Updated weights for policy 1, policy_version 1419225 (0.0009) [2023-12-28 05:26:12,517][106225] Updated weights for policy 1, policy_version 1419235 (0.0009) [2023-12-28 05:26:12,536][106226] Updated weights for policy 0, policy_version 1416024 (0.0006) [2023-12-28 05:26:12,582][106225] Updated weights for policy 1, policy_version 1419245 (0.0008) [2023-12-28 05:26:12,597][106226] Updated weights for policy 0, policy_version 1416034 (0.0005) [2023-12-28 05:26:12,646][106225] Updated weights for policy 1, policy_version 1419255 (0.0008) [2023-12-28 05:26:12,666][106226] Updated weights for policy 0, policy_version 1416044 (0.0007) [2023-12-28 05:26:13,248][106226] Updated weights for policy 0, policy_version 1416054 (0.0006) [2023-12-28 05:26:13,298][106226] Updated weights for policy 0, policy_version 1416064 (0.0005) [2023-12-28 05:26:13,355][106226] Updated weights for policy 0, policy_version 1416074 (0.0005) [2023-12-28 05:26:13,408][106225] Updated weights for policy 1, policy_version 1419265 (0.0008) [2023-12-28 05:26:13,464][106225] Updated weights for policy 1, policy_version 1419275 (0.0009) [2023-12-28 05:26:13,527][106225] Updated weights for policy 1, policy_version 1419285 (0.0007) [2023-12-28 05:26:14,002][106226] Updated weights for policy 0, policy_version 1416084 (0.0007) [2023-12-28 05:26:14,055][106226] Updated weights for policy 0, policy_version 1416094 (0.0010) [2023-12-28 05:26:14,110][106226] Updated weights for policy 0, policy_version 1416104 (0.0007) [2023-12-28 05:26:14,275][106225] Updated weights for policy 1, policy_version 1419295 (0.0008) [2023-12-28 05:26:14,339][106225] Updated weights for policy 1, policy_version 1419305 (0.0007) [2023-12-28 05:26:14,385][106225] Updated weights for policy 1, policy_version 1419315 (0.0006) [2023-12-28 05:26:14,845][106226] Updated weights for policy 0, policy_version 1416114 (0.0008) [2023-12-28 05:26:14,904][106226] Updated weights for policy 0, policy_version 1416124 (0.0009) [2023-12-28 05:26:14,966][106226] Updated weights for policy 0, policy_version 1416134 (0.0011) [2023-12-28 05:26:15,026][106226] Updated weights for policy 0, policy_version 1416144 (0.0011) [2023-12-28 05:26:15,089][106225] Updated weights for policy 1, policy_version 1419325 (0.0008) [2023-12-28 05:26:15,144][106225] Updated weights for policy 1, policy_version 1419335 (0.0010) [2023-12-28 05:26:15,205][106225] Updated weights for policy 1, policy_version 1419345 (0.0010) [2023-12-28 05:26:15,762][106226] Updated weights for policy 0, policy_version 1416154 (0.0005) [2023-12-28 05:26:15,824][106226] Updated weights for policy 0, policy_version 1416164 (0.0007) [2023-12-28 05:26:15,877][106226] Updated weights for policy 0, policy_version 1416174 (0.0008) [2023-12-28 05:26:15,879][106225] Updated weights for policy 1, policy_version 1419355 (0.0010) [2023-12-28 05:26:15,940][106225] Updated weights for policy 1, policy_version 1419365 (0.0010) [2023-12-28 05:26:15,998][106225] Updated weights for policy 1, policy_version 1419375 (0.0007) [2023-12-28 05:26:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 726024192. Throughput: 0: 9941.9, 1: 9713.3. Samples: 726009888. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:16,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.557')] [2023-12-28 05:26:16,545][106225] Updated weights for policy 1, policy_version 1419385 (0.0006) [2023-12-28 05:26:16,577][106226] Updated weights for policy 0, policy_version 1416184 (0.0007) [2023-12-28 05:26:16,602][106225] Updated weights for policy 1, policy_version 1419395 (0.0007) [2023-12-28 05:26:16,636][106226] Updated weights for policy 0, policy_version 1416194 (0.0007) [2023-12-28 05:26:16,664][106225] Updated weights for policy 1, policy_version 1419405 (0.0005) [2023-12-28 05:26:16,684][106226] Updated weights for policy 0, policy_version 1416204 (0.0009) [2023-12-28 05:26:16,732][106225] Updated weights for policy 1, policy_version 1419415 (0.0005) [2023-12-28 05:26:17,320][106225] Updated weights for policy 1, policy_version 1419425 (0.0008) [2023-12-28 05:26:17,383][106225] Updated weights for policy 1, policy_version 1419435 (0.0008) [2023-12-28 05:26:17,408][106226] Updated weights for policy 0, policy_version 1416214 (0.0007) [2023-12-28 05:26:17,444][106225] Updated weights for policy 1, policy_version 1419445 (0.0008) [2023-12-28 05:26:17,466][106226] Updated weights for policy 0, policy_version 1416224 (0.0007) [2023-12-28 05:26:17,527][106226] Updated weights for policy 0, policy_version 1416234 (0.0008) [2023-12-28 05:26:18,184][106225] Updated weights for policy 1, policy_version 1419455 (0.0009) [2023-12-28 05:26:18,201][106226] Updated weights for policy 0, policy_version 1416244 (0.0007) [2023-12-28 05:26:18,242][106225] Updated weights for policy 1, policy_version 1419465 (0.0008) [2023-12-28 05:26:18,256][106226] Updated weights for policy 0, policy_version 1416254 (0.0006) [2023-12-28 05:26:18,293][106225] Updated weights for policy 1, policy_version 1419475 (0.0006) [2023-12-28 05:26:18,312][106226] Updated weights for policy 0, policy_version 1416264 (0.0007) [2023-12-28 05:26:18,951][106226] Updated weights for policy 0, policy_version 1416274 (0.0009) [2023-12-28 05:26:18,996][106226] Updated weights for policy 0, policy_version 1416284 (0.0009) [2023-12-28 05:26:19,063][106226] Updated weights for policy 0, policy_version 1416294 (0.0006) [2023-12-28 05:26:19,114][106225] Updated weights for policy 1, policy_version 1419485 (0.0009) [2023-12-28 05:26:19,131][106226] Updated weights for policy 0, policy_version 1416304 (0.0005) [2023-12-28 05:26:19,163][106225] Updated weights for policy 1, policy_version 1419495 (0.0008) [2023-12-28 05:26:19,216][106225] Updated weights for policy 1, policy_version 1419505 (0.0008) [2023-12-28 05:26:19,801][106226] Updated weights for policy 0, policy_version 1416314 (0.0009) [2023-12-28 05:26:19,868][106226] Updated weights for policy 0, policy_version 1416324 (0.0009) [2023-12-28 05:26:19,932][106226] Updated weights for policy 0, policy_version 1416334 (0.0009) [2023-12-28 05:26:20,043][106225] Updated weights for policy 1, policy_version 1419515 (0.0007) [2023-12-28 05:26:20,104][106225] Updated weights for policy 1, policy_version 1419525 (0.0009) [2023-12-28 05:26:20,165][106225] Updated weights for policy 1, policy_version 1419535 (0.0009) [2023-12-28 05:26:20,711][106226] Updated weights for policy 0, policy_version 1416344 (0.0008) [2023-12-28 05:26:20,782][106226] Updated weights for policy 0, policy_version 1416354 (0.0009) [2023-12-28 05:26:20,851][106226] Updated weights for policy 0, policy_version 1416364 (0.0009) [2023-12-28 05:26:20,922][106225] Updated weights for policy 1, policy_version 1419545 (0.0009) [2023-12-28 05:26:20,985][106225] Updated weights for policy 1, policy_version 1419555 (0.0008) [2023-12-28 05:26:21,059][106225] Updated weights for policy 1, policy_version 1419565 (0.0008) [2023-12-28 05:26:21,127][106225] Updated weights for policy 1, policy_version 1419575 (0.0007) [2023-12-28 05:26:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 726122496. Throughput: 0: 9950.6, 1: 9716.5. Samples: 726127948. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:21,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.990')] [2023-12-28 05:26:21,564][106226] Updated weights for policy 0, policy_version 1416374 (0.0008) [2023-12-28 05:26:21,635][106226] Updated weights for policy 0, policy_version 1416384 (0.0009) [2023-12-28 05:26:21,705][106226] Updated weights for policy 0, policy_version 1416394 (0.0006) [2023-12-28 05:26:21,842][106225] Updated weights for policy 1, policy_version 1419585 (0.0006) [2023-12-28 05:26:21,900][106225] Updated weights for policy 1, policy_version 1419595 (0.0007) [2023-12-28 05:26:21,952][106225] Updated weights for policy 1, policy_version 1419605 (0.0009) [2023-12-28 05:26:22,466][106226] Updated weights for policy 0, policy_version 1416404 (0.0009) [2023-12-28 05:26:22,524][106226] Updated weights for policy 0, policy_version 1416414 (0.0008) [2023-12-28 05:26:22,578][106226] Updated weights for policy 0, policy_version 1416424 (0.0007) [2023-12-28 05:26:22,700][106225] Updated weights for policy 1, policy_version 1419615 (0.0011) [2023-12-28 05:26:22,755][106225] Updated weights for policy 1, policy_version 1419625 (0.0010) [2023-12-28 05:26:22,809][106225] Updated weights for policy 1, policy_version 1419635 (0.0010) [2023-12-28 05:26:23,275][106226] Updated weights for policy 0, policy_version 1416434 (0.0007) [2023-12-28 05:26:23,342][106226] Updated weights for policy 0, policy_version 1416444 (0.0006) [2023-12-28 05:26:23,414][106226] Updated weights for policy 0, policy_version 1416454 (0.0009) [2023-12-28 05:26:23,469][106226] Updated weights for policy 0, policy_version 1416464 (0.0008) [2023-12-28 05:26:23,571][106225] Updated weights for policy 1, policy_version 1419645 (0.0009) [2023-12-28 05:26:23,635][106225] Updated weights for policy 1, policy_version 1419655 (0.0008) [2023-12-28 05:26:23,700][106225] Updated weights for policy 1, policy_version 1419665 (0.0007) [2023-12-28 05:26:24,160][106226] Updated weights for policy 0, policy_version 1416474 (0.0010) [2023-12-28 05:26:24,215][106226] Updated weights for policy 0, policy_version 1416484 (0.0008) [2023-12-28 05:26:24,277][106226] Updated weights for policy 0, policy_version 1416494 (0.0008) [2023-12-28 05:26:24,338][106225] Updated weights for policy 1, policy_version 1419675 (0.0008) [2023-12-28 05:26:24,397][106225] Updated weights for policy 1, policy_version 1419685 (0.0008) [2023-12-28 05:26:24,445][106225] Updated weights for policy 1, policy_version 1419695 (0.0008) [2023-12-28 05:26:25,004][106226] Updated weights for policy 0, policy_version 1416504 (0.0009) [2023-12-28 05:26:25,062][106226] Updated weights for policy 0, policy_version 1416514 (0.0008) [2023-12-28 05:26:25,119][106226] Updated weights for policy 0, policy_version 1416524 (0.0008) [2023-12-28 05:26:25,178][106225] Updated weights for policy 1, policy_version 1419705 (0.0009) [2023-12-28 05:26:25,239][106225] Updated weights for policy 1, policy_version 1419715 (0.0008) [2023-12-28 05:26:25,302][106225] Updated weights for policy 1, policy_version 1419725 (0.0008) [2023-12-28 05:26:25,354][106225] Updated weights for policy 1, policy_version 1419735 (0.0008) [2023-12-28 05:26:25,838][106226] Updated weights for policy 0, policy_version 1416534 (0.0007) [2023-12-28 05:26:25,905][106226] Updated weights for policy 0, policy_version 1416544 (0.0005) [2023-12-28 05:26:25,961][106226] Updated weights for policy 0, policy_version 1416554 (0.0005) [2023-12-28 05:26:26,094][106225] Updated weights for policy 1, policy_version 1419745 (0.0009) [2023-12-28 05:26:26,154][106225] Updated weights for policy 1, policy_version 1419755 (0.0008) [2023-12-28 05:26:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 726212608. Throughput: 0: 9951.3, 1: 9700.2. Samples: 726184832. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:26,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.623')] [2023-12-28 05:26:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001416560_362708992.pth... [2023-12-28 05:26:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001415408_362414080.pth [2023-12-28 05:26:26,205][106225] Updated weights for policy 1, policy_version 1419765 (0.0009) [2023-12-28 05:26:26,219][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001419768_363511808.pth... [2023-12-28 05:26:26,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001418616_363216896.pth [2023-12-28 05:26:26,505][106226] Updated weights for policy 0, policy_version 1416564 (0.0005) [2023-12-28 05:26:26,574][106226] Updated weights for policy 0, policy_version 1416574 (0.0006) [2023-12-28 05:26:26,639][106226] Updated weights for policy 0, policy_version 1416584 (0.0008) [2023-12-28 05:26:26,930][106225] Updated weights for policy 1, policy_version 1419775 (0.0006) [2023-12-28 05:26:26,996][106225] Updated weights for policy 1, policy_version 1419785 (0.0006) [2023-12-28 05:26:27,062][106225] Updated weights for policy 1, policy_version 1419795 (0.0010) [2023-12-28 05:26:27,166][106226] Updated weights for policy 0, policy_version 1416594 (0.0006) [2023-12-28 05:26:27,222][106226] Updated weights for policy 0, policy_version 1416604 (0.0005) [2023-12-28 05:26:27,298][106226] Updated weights for policy 0, policy_version 1416614 (0.0005) [2023-12-28 05:26:27,361][106226] Updated weights for policy 0, policy_version 1416624 (0.0009) [2023-12-28 05:26:27,756][106225] Updated weights for policy 1, policy_version 1419805 (0.0008) [2023-12-28 05:26:27,812][106225] Updated weights for policy 1, policy_version 1419815 (0.0009) [2023-12-28 05:26:27,865][106226] Updated weights for policy 0, policy_version 1416634 (0.0006) [2023-12-28 05:26:27,878][106225] Updated weights for policy 1, policy_version 1419825 (0.0008) [2023-12-28 05:26:27,911][106226] Updated weights for policy 0, policy_version 1416644 (0.0005) [2023-12-28 05:26:27,960][106226] Updated weights for policy 0, policy_version 1416654 (0.0007) [2023-12-28 05:26:28,565][106226] Updated weights for policy 0, policy_version 1416664 (0.0009) [2023-12-28 05:26:28,613][106226] Updated weights for policy 0, policy_version 1416674 (0.0008) [2023-12-28 05:26:28,661][106225] Updated weights for policy 1, policy_version 1419835 (0.0008) [2023-12-28 05:26:28,667][106226] Updated weights for policy 0, policy_version 1416684 (0.0008) [2023-12-28 05:26:28,722][106225] Updated weights for policy 1, policy_version 1419845 (0.0007) [2023-12-28 05:26:28,785][106225] Updated weights for policy 1, policy_version 1419855 (0.0008) [2023-12-28 05:26:29,410][106226] Updated weights for policy 0, policy_version 1416694 (0.0007) [2023-12-28 05:26:29,467][106226] Updated weights for policy 0, policy_version 1416704 (0.0008) [2023-12-28 05:26:29,515][106225] Updated weights for policy 1, policy_version 1419865 (0.0008) [2023-12-28 05:26:29,525][106226] Updated weights for policy 0, policy_version 1416714 (0.0008) [2023-12-28 05:26:29,576][106225] Updated weights for policy 1, policy_version 1419875 (0.0007) [2023-12-28 05:26:29,632][106225] Updated weights for policy 1, policy_version 1419885 (0.0008) [2023-12-28 05:26:29,681][106225] Updated weights for policy 1, policy_version 1419895 (0.0008) [2023-12-28 05:26:30,260][106226] Updated weights for policy 0, policy_version 1416724 (0.0006) [2023-12-28 05:26:30,327][106226] Updated weights for policy 0, policy_version 1416734 (0.0007) [2023-12-28 05:26:30,387][106226] Updated weights for policy 0, policy_version 1416744 (0.0009) [2023-12-28 05:26:30,454][106225] Updated weights for policy 1, policy_version 1419905 (0.0008) [2023-12-28 05:26:30,508][106225] Updated weights for policy 1, policy_version 1419915 (0.0008) [2023-12-28 05:26:30,558][106225] Updated weights for policy 1, policy_version 1419925 (0.0009) [2023-12-28 05:26:30,945][106226] Updated weights for policy 0, policy_version 1416754 (0.0008) [2023-12-28 05:26:31,001][106226] Updated weights for policy 0, policy_version 1416764 (0.0005) [2023-12-28 05:26:31,064][106226] Updated weights for policy 0, policy_version 1416774 (0.0007) [2023-12-28 05:26:31,125][106226] Updated weights for policy 0, policy_version 1416784 (0.0009) [2023-12-28 05:26:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 726319104. Throughput: 0: 10057.4, 1: 9734.5. Samples: 726306120. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:31,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.705')] [2023-12-28 05:26:31,398][106225] Updated weights for policy 1, policy_version 1419935 (0.0007) [2023-12-28 05:26:31,467][106225] Updated weights for policy 1, policy_version 1419945 (0.0010) [2023-12-28 05:26:31,515][106225] Updated weights for policy 1, policy_version 1419955 (0.0008) [2023-12-28 05:26:31,781][106226] Updated weights for policy 0, policy_version 1416794 (0.0008) [2023-12-28 05:26:31,843][106226] Updated weights for policy 0, policy_version 1416804 (0.0008) [2023-12-28 05:26:31,907][106226] Updated weights for policy 0, policy_version 1416814 (0.0007) [2023-12-28 05:26:32,324][106225] Updated weights for policy 1, policy_version 1419965 (0.0006) [2023-12-28 05:26:32,391][106225] Updated weights for policy 1, policy_version 1419975 (0.0008) [2023-12-28 05:26:32,460][106225] Updated weights for policy 1, policy_version 1419985 (0.0005) [2023-12-28 05:26:32,652][106226] Updated weights for policy 0, policy_version 1416824 (0.0008) [2023-12-28 05:26:32,710][106226] Updated weights for policy 0, policy_version 1416834 (0.0009) [2023-12-28 05:26:32,772][106226] Updated weights for policy 0, policy_version 1416844 (0.0009) [2023-12-28 05:26:33,137][106225] Updated weights for policy 1, policy_version 1419995 (0.0007) [2023-12-28 05:26:33,190][106225] Updated weights for policy 1, policy_version 1420005 (0.0010) [2023-12-28 05:26:33,250][106225] Updated weights for policy 1, policy_version 1420015 (0.0008) [2023-12-28 05:26:33,396][106226] Updated weights for policy 0, policy_version 1416854 (0.0007) [2023-12-28 05:26:33,444][106226] Updated weights for policy 0, policy_version 1416864 (0.0006) [2023-12-28 05:26:33,490][106226] Updated weights for policy 0, policy_version 1416874 (0.0005) [2023-12-28 05:26:34,059][106225] Updated weights for policy 1, policy_version 1420025 (0.0009) [2023-12-28 05:26:34,069][106226] Updated weights for policy 0, policy_version 1416884 (0.0007) [2023-12-28 05:26:34,116][106225] Updated weights for policy 1, policy_version 1420035 (0.0005) [2023-12-28 05:26:34,123][106226] Updated weights for policy 0, policy_version 1416894 (0.0011) [2023-12-28 05:26:34,186][106225] Updated weights for policy 1, policy_version 1420045 (0.0007) [2023-12-28 05:26:34,198][106226] Updated weights for policy 0, policy_version 1416904 (0.0011) [2023-12-28 05:26:34,248][106225] Updated weights for policy 1, policy_version 1420055 (0.0008) [2023-12-28 05:26:34,918][106226] Updated weights for policy 0, policy_version 1416914 (0.0006) [2023-12-28 05:26:34,958][106225] Updated weights for policy 1, policy_version 1420065 (0.0006) [2023-12-28 05:26:34,972][106226] Updated weights for policy 0, policy_version 1416924 (0.0008) [2023-12-28 05:26:35,012][106225] Updated weights for policy 1, policy_version 1420075 (0.0006) [2023-12-28 05:26:35,034][106226] Updated weights for policy 0, policy_version 1416934 (0.0008) [2023-12-28 05:26:35,071][106225] Updated weights for policy 1, policy_version 1420085 (0.0007) [2023-12-28 05:26:35,094][106226] Updated weights for policy 0, policy_version 1416944 (0.0009) [2023-12-28 05:26:35,622][106225] Updated weights for policy 1, policy_version 1420095 (0.0008) [2023-12-28 05:26:35,669][106225] Updated weights for policy 1, policy_version 1420105 (0.0010) [2023-12-28 05:26:35,713][106225] Updated weights for policy 1, policy_version 1420115 (0.0007) [2023-12-28 05:26:35,880][106226] Updated weights for policy 0, policy_version 1416954 (0.0009) [2023-12-28 05:26:35,940][106226] Updated weights for policy 0, policy_version 1416964 (0.0008) [2023-12-28 05:26:35,996][106226] Updated weights for policy 0, policy_version 1416974 (0.0008) [2023-12-28 05:26:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 726417408. Throughput: 0: 10124.4, 1: 9667.6. Samples: 726423612. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:36,175][105115] Avg episode reward: [(0, '-4.799'), (1, '-4.874')] [2023-12-28 05:26:36,428][106225] Updated weights for policy 1, policy_version 1420125 (0.0008) [2023-12-28 05:26:36,499][106225] Updated weights for policy 1, policy_version 1420135 (0.0010) [2023-12-28 05:26:36,568][106225] Updated weights for policy 1, policy_version 1420145 (0.0007) [2023-12-28 05:26:36,678][106226] Updated weights for policy 0, policy_version 1416984 (0.0009) [2023-12-28 05:26:36,731][106226] Updated weights for policy 0, policy_version 1416994 (0.0008) [2023-12-28 05:26:36,798][106226] Updated weights for policy 0, policy_version 1417004 (0.0008) [2023-12-28 05:26:37,155][106225] Updated weights for policy 1, policy_version 1420155 (0.0006) [2023-12-28 05:26:37,218][106225] Updated weights for policy 1, policy_version 1420165 (0.0006) [2023-12-28 05:26:37,288][106225] Updated weights for policy 1, policy_version 1420175 (0.0005) [2023-12-28 05:26:37,459][106226] Updated weights for policy 0, policy_version 1417014 (0.0008) [2023-12-28 05:26:37,513][106226] Updated weights for policy 0, policy_version 1417024 (0.0008) [2023-12-28 05:26:37,576][106226] Updated weights for policy 0, policy_version 1417034 (0.0010) [2023-12-28 05:26:37,804][106225] Updated weights for policy 1, policy_version 1420185 (0.0005) [2023-12-28 05:26:37,854][106225] Updated weights for policy 1, policy_version 1420195 (0.0008) [2023-12-28 05:26:37,909][106225] Updated weights for policy 1, policy_version 1420205 (0.0006) [2023-12-28 05:26:37,963][106225] Updated weights for policy 1, policy_version 1420215 (0.0005) [2023-12-28 05:26:38,380][106226] Updated weights for policy 0, policy_version 1417044 (0.0009) [2023-12-28 05:26:38,440][106226] Updated weights for policy 0, policy_version 1417054 (0.0008) [2023-12-28 05:26:38,501][106226] Updated weights for policy 0, policy_version 1417064 (0.0009) [2023-12-28 05:26:38,650][106225] Updated weights for policy 1, policy_version 1420225 (0.0010) [2023-12-28 05:26:38,709][106225] Updated weights for policy 1, policy_version 1420235 (0.0010) [2023-12-28 05:26:38,766][106225] Updated weights for policy 1, policy_version 1420245 (0.0010) [2023-12-28 05:26:39,219][106226] Updated weights for policy 0, policy_version 1417074 (0.0007) [2023-12-28 05:26:39,281][106226] Updated weights for policy 0, policy_version 1417084 (0.0009) [2023-12-28 05:26:39,344][106226] Updated weights for policy 0, policy_version 1417094 (0.0009) [2023-12-28 05:26:39,428][106226] Updated weights for policy 0, policy_version 1417104 (0.0008) [2023-12-28 05:26:39,455][106225] Updated weights for policy 1, policy_version 1420255 (0.0009) [2023-12-28 05:26:39,527][106225] Updated weights for policy 1, policy_version 1420265 (0.0008) [2023-12-28 05:26:39,593][106225] Updated weights for policy 1, policy_version 1420275 (0.0008) [2023-12-28 05:26:40,202][106226] Updated weights for policy 0, policy_version 1417114 (0.0008) [2023-12-28 05:26:40,263][106226] Updated weights for policy 0, policy_version 1417124 (0.0008) [2023-12-28 05:26:40,308][106225] Updated weights for policy 1, policy_version 1420285 (0.0008) [2023-12-28 05:26:40,324][106226] Updated weights for policy 0, policy_version 1417134 (0.0007) [2023-12-28 05:26:40,365][106225] Updated weights for policy 1, policy_version 1420295 (0.0008) [2023-12-28 05:26:40,426][106225] Updated weights for policy 1, policy_version 1420305 (0.0010) [2023-12-28 05:26:41,079][106226] Updated weights for policy 0, policy_version 1417144 (0.0007) [2023-12-28 05:26:41,104][106225] Updated weights for policy 1, policy_version 1420315 (0.0009) [2023-12-28 05:26:41,144][106226] Updated weights for policy 0, policy_version 1417154 (0.0007) [2023-12-28 05:26:41,172][106225] Updated weights for policy 1, policy_version 1420325 (0.0010) [2023-12-28 05:26:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 726507520. Throughput: 0: 10085.6, 1: 9757.0. Samples: 726485216. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:41,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-4.702')] [2023-12-28 05:26:41,205][106226] Updated weights for policy 0, policy_version 1417164 (0.0008) [2023-12-28 05:26:41,228][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001417168_362864640.pth... [2023-12-28 05:26:41,230][106225] Updated weights for policy 1, policy_version 1420335 (0.0008) [2023-12-28 05:26:41,232][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001415984_362561536.pth [2023-12-28 05:26:41,290][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001420344_363659264.pth... [2023-12-28 05:26:41,294][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001419192_363364352.pth [2023-12-28 05:26:41,967][106225] Updated weights for policy 1, policy_version 1420345 (0.0008) [2023-12-28 05:26:41,982][106226] Updated weights for policy 0, policy_version 1417174 (0.0006) [2023-12-28 05:26:42,025][106225] Updated weights for policy 1, policy_version 1420355 (0.0006) [2023-12-28 05:26:42,042][106226] Updated weights for policy 0, policy_version 1417184 (0.0009) [2023-12-28 05:26:42,083][106225] Updated weights for policy 1, policy_version 1420365 (0.0007) [2023-12-28 05:26:42,100][106226] Updated weights for policy 0, policy_version 1417194 (0.0006) [2023-12-28 05:26:42,141][106225] Updated weights for policy 1, policy_version 1420375 (0.0008) [2023-12-28 05:26:42,824][106226] Updated weights for policy 0, policy_version 1417204 (0.0007) [2023-12-28 05:26:42,877][106226] Updated weights for policy 0, policy_version 1417214 (0.0006) [2023-12-28 05:26:42,890][106225] Updated weights for policy 1, policy_version 1420385 (0.0008) [2023-12-28 05:26:42,927][106226] Updated weights for policy 0, policy_version 1417224 (0.0006) [2023-12-28 05:26:42,945][106225] Updated weights for policy 1, policy_version 1420395 (0.0008) [2023-12-28 05:26:42,997][106225] Updated weights for policy 1, policy_version 1420405 (0.0008) [2023-12-28 05:26:43,668][106226] Updated weights for policy 0, policy_version 1417234 (0.0005) [2023-12-28 05:26:43,669][106225] Updated weights for policy 1, policy_version 1420415 (0.0006) [2023-12-28 05:26:43,725][106226] Updated weights for policy 0, policy_version 1417244 (0.0006) [2023-12-28 05:26:43,737][106225] Updated weights for policy 1, policy_version 1420425 (0.0005) [2023-12-28 05:26:43,785][106226] Updated weights for policy 0, policy_version 1417254 (0.0006) [2023-12-28 05:26:43,790][106225] Updated weights for policy 1, policy_version 1420435 (0.0009) [2023-12-28 05:26:43,840][106226] Updated weights for policy 0, policy_version 1417264 (0.0006) [2023-12-28 05:26:44,501][106225] Updated weights for policy 1, policy_version 1420445 (0.0008) [2023-12-28 05:26:44,510][106226] Updated weights for policy 0, policy_version 1417274 (0.0008) [2023-12-28 05:26:44,551][106225] Updated weights for policy 1, policy_version 1420455 (0.0005) [2023-12-28 05:26:44,572][106226] Updated weights for policy 0, policy_version 1417284 (0.0007) [2023-12-28 05:26:44,609][106225] Updated weights for policy 1, policy_version 1420465 (0.0007) [2023-12-28 05:26:44,634][106226] Updated weights for policy 0, policy_version 1417294 (0.0006) [2023-12-28 05:26:45,309][106225] Updated weights for policy 1, policy_version 1420475 (0.0007) [2023-12-28 05:26:45,371][106225] Updated weights for policy 1, policy_version 1420485 (0.0009) [2023-12-28 05:26:45,389][106226] Updated weights for policy 0, policy_version 1417304 (0.0007) [2023-12-28 05:26:45,433][106225] Updated weights for policy 1, policy_version 1420495 (0.0009) [2023-12-28 05:26:45,447][106226] Updated weights for policy 0, policy_version 1417314 (0.0006) [2023-12-28 05:26:45,497][106226] Updated weights for policy 0, policy_version 1417324 (0.0008) [2023-12-28 05:26:46,124][106225] Updated weights for policy 1, policy_version 1420505 (0.0007) [2023-12-28 05:26:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 726605824. Throughput: 0: 9983.1, 1: 9769.8. Samples: 726600628. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:46,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.740')] [2023-12-28 05:26:46,180][106225] Updated weights for policy 1, policy_version 1420515 (0.0005) [2023-12-28 05:26:46,204][106226] Updated weights for policy 0, policy_version 1417334 (0.0007) [2023-12-28 05:26:46,231][106225] Updated weights for policy 1, policy_version 1420525 (0.0005) [2023-12-28 05:26:46,274][106226] Updated weights for policy 0, policy_version 1417344 (0.0006) [2023-12-28 05:26:46,292][106225] Updated weights for policy 1, policy_version 1420535 (0.0005) [2023-12-28 05:26:46,343][106226] Updated weights for policy 0, policy_version 1417354 (0.0005) [2023-12-28 05:26:46,841][106226] Updated weights for policy 0, policy_version 1417364 (0.0005) [2023-12-28 05:26:46,897][106225] Updated weights for policy 1, policy_version 1420545 (0.0005) [2023-12-28 05:26:46,905][106226] Updated weights for policy 0, policy_version 1417374 (0.0007) [2023-12-28 05:26:46,949][106225] Updated weights for policy 1, policy_version 1420555 (0.0005) [2023-12-28 05:26:46,961][106226] Updated weights for policy 0, policy_version 1417384 (0.0006) [2023-12-28 05:26:46,999][106225] Updated weights for policy 1, policy_version 1420565 (0.0005) [2023-12-28 05:26:47,586][106226] Updated weights for policy 0, policy_version 1417394 (0.0006) [2023-12-28 05:26:47,644][106225] Updated weights for policy 1, policy_version 1420575 (0.0009) [2023-12-28 05:26:47,648][106226] Updated weights for policy 0, policy_version 1417404 (0.0010) [2023-12-28 05:26:47,704][106225] Updated weights for policy 1, policy_version 1420585 (0.0007) [2023-12-28 05:26:47,709][106226] Updated weights for policy 0, policy_version 1417414 (0.0008) [2023-12-28 05:26:47,762][106225] Updated weights for policy 1, policy_version 1420595 (0.0010) [2023-12-28 05:26:47,772][106226] Updated weights for policy 0, policy_version 1417424 (0.0006) [2023-12-28 05:26:48,315][106225] Updated weights for policy 1, policy_version 1420605 (0.0008) [2023-12-28 05:26:48,386][106225] Updated weights for policy 1, policy_version 1420615 (0.0007) [2023-12-28 05:26:48,449][106225] Updated weights for policy 1, policy_version 1420625 (0.0011) [2023-12-28 05:26:48,524][106226] Updated weights for policy 0, policy_version 1417434 (0.0008) [2023-12-28 05:26:48,583][106226] Updated weights for policy 0, policy_version 1417444 (0.0008) [2023-12-28 05:26:48,638][106226] Updated weights for policy 0, policy_version 1417454 (0.0008) [2023-12-28 05:26:49,164][106225] Updated weights for policy 1, policy_version 1420635 (0.0011) [2023-12-28 05:26:49,222][106225] Updated weights for policy 1, policy_version 1420645 (0.0007) [2023-12-28 05:26:49,285][106225] Updated weights for policy 1, policy_version 1420655 (0.0010) [2023-12-28 05:26:49,402][106226] Updated weights for policy 0, policy_version 1417464 (0.0008) [2023-12-28 05:26:49,462][106226] Updated weights for policy 0, policy_version 1417474 (0.0008) [2023-12-28 05:26:49,521][106226] Updated weights for policy 0, policy_version 1417484 (0.0007) [2023-12-28 05:26:50,050][106225] Updated weights for policy 1, policy_version 1420665 (0.0010) [2023-12-28 05:26:50,111][106225] Updated weights for policy 1, policy_version 1420675 (0.0009) [2023-12-28 05:26:50,172][106225] Updated weights for policy 1, policy_version 1420685 (0.0009) [2023-12-28 05:26:50,234][106225] Updated weights for policy 1, policy_version 1420695 (0.0008) [2023-12-28 05:26:50,256][106226] Updated weights for policy 0, policy_version 1417494 (0.0009) [2023-12-28 05:26:50,315][106226] Updated weights for policy 0, policy_version 1417504 (0.0010) [2023-12-28 05:26:50,380][106226] Updated weights for policy 0, policy_version 1417514 (0.0008) [2023-12-28 05:26:50,855][106225] Updated weights for policy 1, policy_version 1420705 (0.0008) [2023-12-28 05:26:50,922][106225] Updated weights for policy 1, policy_version 1420715 (0.0009) [2023-12-28 05:26:50,977][106225] Updated weights for policy 1, policy_version 1420725 (0.0008) [2023-12-28 05:26:51,130][106226] Updated weights for policy 0, policy_version 1417524 (0.0009) [2023-12-28 05:26:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 726712320. Throughput: 0: 9914.3, 1: 9850.1. Samples: 726721984. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:51,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.832')] [2023-12-28 05:26:51,194][106226] Updated weights for policy 0, policy_version 1417534 (0.0009) [2023-12-28 05:26:51,254][106226] Updated weights for policy 0, policy_version 1417544 (0.0008) [2023-12-28 05:26:51,771][106225] Updated weights for policy 1, policy_version 1420735 (0.0008) [2023-12-28 05:26:51,824][106225] Updated weights for policy 1, policy_version 1420745 (0.0009) [2023-12-28 05:26:51,884][106225] Updated weights for policy 1, policy_version 1420755 (0.0008) [2023-12-28 05:26:51,993][106226] Updated weights for policy 0, policy_version 1417554 (0.0009) [2023-12-28 05:26:52,062][106226] Updated weights for policy 0, policy_version 1417564 (0.0008) [2023-12-28 05:26:52,117][106226] Updated weights for policy 0, policy_version 1417574 (0.0008) [2023-12-28 05:26:52,173][106226] Updated weights for policy 0, policy_version 1417584 (0.0009) [2023-12-28 05:26:52,666][106225] Updated weights for policy 1, policy_version 1420765 (0.0009) [2023-12-28 05:26:52,727][106225] Updated weights for policy 1, policy_version 1420775 (0.0009) [2023-12-28 05:26:52,791][106225] Updated weights for policy 1, policy_version 1420785 (0.0010) [2023-12-28 05:26:52,872][106226] Updated weights for policy 0, policy_version 1417594 (0.0008) [2023-12-28 05:26:52,939][106226] Updated weights for policy 0, policy_version 1417604 (0.0007) [2023-12-28 05:26:53,004][106226] Updated weights for policy 0, policy_version 1417615 (0.0009) [2023-12-28 05:26:53,416][106225] Updated weights for policy 1, policy_version 1420795 (0.0010) [2023-12-28 05:26:53,469][106225] Updated weights for policy 1, policy_version 1420805 (0.0010) [2023-12-28 05:26:53,523][106225] Updated weights for policy 1, policy_version 1420815 (0.0010) [2023-12-28 05:26:53,683][106226] Updated weights for policy 0, policy_version 1417625 (0.0008) [2023-12-28 05:26:53,732][106226] Updated weights for policy 0, policy_version 1417635 (0.0008) [2023-12-28 05:26:53,786][106226] Updated weights for policy 0, policy_version 1417645 (0.0008) [2023-12-28 05:26:54,121][106225] Updated weights for policy 1, policy_version 1420825 (0.0010) [2023-12-28 05:26:54,179][106225] Updated weights for policy 1, policy_version 1420835 (0.0006) [2023-12-28 05:26:54,228][106225] Updated weights for policy 1, policy_version 1420845 (0.0005) [2023-12-28 05:26:54,274][106225] Updated weights for policy 1, policy_version 1420855 (0.0005) [2023-12-28 05:26:54,608][106226] Updated weights for policy 0, policy_version 1417655 (0.0009) [2023-12-28 05:26:54,659][106226] Updated weights for policy 0, policy_version 1417665 (0.0009) [2023-12-28 05:26:54,708][106226] Updated weights for policy 0, policy_version 1417675 (0.0008) [2023-12-28 05:26:54,803][106225] Updated weights for policy 1, policy_version 1420865 (0.0010) [2023-12-28 05:26:54,853][106225] Updated weights for policy 1, policy_version 1420875 (0.0010) [2023-12-28 05:26:54,914][106225] Updated weights for policy 1, policy_version 1420885 (0.0008) [2023-12-28 05:26:55,472][106225] Updated weights for policy 1, policy_version 1420895 (0.0005) [2023-12-28 05:26:55,525][106225] Updated weights for policy 1, policy_version 1420905 (0.0005) [2023-12-28 05:26:55,564][106226] Updated weights for policy 0, policy_version 1417685 (0.0009) [2023-12-28 05:26:55,576][106225] Updated weights for policy 1, policy_version 1420915 (0.0005) [2023-12-28 05:26:55,624][106226] Updated weights for policy 0, policy_version 1417695 (0.0008) [2023-12-28 05:26:55,677][106226] Updated weights for policy 0, policy_version 1417705 (0.0008) [2023-12-28 05:26:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 726810624. Throughput: 0: 9872.4, 1: 9808.2. Samples: 726778880. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:26:56,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-4.572')] [2023-12-28 05:26:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001420920_363806720.pth... [2023-12-28 05:26:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001417712_363003904.pth... [2023-12-28 05:26:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001419768_363511808.pth [2023-12-28 05:26:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001416560_362708992.pth [2023-12-28 05:26:56,236][106225] Updated weights for policy 1, policy_version 1420925 (0.0007) [2023-12-28 05:26:56,282][106225] Updated weights for policy 1, policy_version 1420935 (0.0008) [2023-12-28 05:26:56,337][106225] Updated weights for policy 1, policy_version 1420945 (0.0008) [2023-12-28 05:26:56,415][106226] Updated weights for policy 0, policy_version 1417715 (0.0008) [2023-12-28 05:26:56,467][106226] Updated weights for policy 0, policy_version 1417725 (0.0009) [2023-12-28 05:26:56,518][106226] Updated weights for policy 0, policy_version 1417735 (0.0008) [2023-12-28 05:26:56,955][106225] Updated weights for policy 1, policy_version 1420955 (0.0007) [2023-12-28 05:26:57,010][106225] Updated weights for policy 1, policy_version 1420965 (0.0007) [2023-12-28 05:26:57,073][106225] Updated weights for policy 1, policy_version 1420975 (0.0009) [2023-12-28 05:26:57,296][106226] Updated weights for policy 0, policy_version 1417745 (0.0008) [2023-12-28 05:26:57,355][106226] Updated weights for policy 0, policy_version 1417755 (0.0008) [2023-12-28 05:26:57,413][106226] Updated weights for policy 0, policy_version 1417765 (0.0008) [2023-12-28 05:26:57,492][106226] Updated weights for policy 0, policy_version 1417775 (0.0009) [2023-12-28 05:26:57,703][106225] Updated weights for policy 1, policy_version 1420985 (0.0009) [2023-12-28 05:26:57,764][106225] Updated weights for policy 1, policy_version 1420995 (0.0008) [2023-12-28 05:26:57,819][106225] Updated weights for policy 1, policy_version 1421005 (0.0007) [2023-12-28 05:26:57,875][106225] Updated weights for policy 1, policy_version 1421015 (0.0007) [2023-12-28 05:26:58,254][106226] Updated weights for policy 0, policy_version 1417785 (0.0009) [2023-12-28 05:26:58,310][106226] Updated weights for policy 0, policy_version 1417795 (0.0008) [2023-12-28 05:26:58,374][106226] Updated weights for policy 0, policy_version 1417805 (0.0008) [2023-12-28 05:26:58,498][106225] Updated weights for policy 1, policy_version 1421025 (0.0007) [2023-12-28 05:26:58,567][106225] Updated weights for policy 1, policy_version 1421035 (0.0007) [2023-12-28 05:26:58,627][106225] Updated weights for policy 1, policy_version 1421045 (0.0007) [2023-12-28 05:26:59,250][106226] Updated weights for policy 0, policy_version 1417815 (0.0008) [2023-12-28 05:26:59,324][106226] Updated weights for policy 0, policy_version 1417825 (0.0009) [2023-12-28 05:26:59,390][106226] Updated weights for policy 0, policy_version 1417835 (0.0008) [2023-12-28 05:26:59,405][106225] Updated weights for policy 1, policy_version 1421055 (0.0008) [2023-12-28 05:26:59,470][106225] Updated weights for policy 1, policy_version 1421065 (0.0007) [2023-12-28 05:26:59,533][106225] Updated weights for policy 1, policy_version 1421075 (0.0008) [2023-12-28 05:27:00,047][106226] Updated weights for policy 0, policy_version 1417845 (0.0007) [2023-12-28 05:27:00,104][106226] Updated weights for policy 0, policy_version 1417855 (0.0008) [2023-12-28 05:27:00,170][106226] Updated weights for policy 0, policy_version 1417865 (0.0005) [2023-12-28 05:27:00,273][106225] Updated weights for policy 1, policy_version 1421085 (0.0009) [2023-12-28 05:27:00,334][106225] Updated weights for policy 1, policy_version 1421095 (0.0009) [2023-12-28 05:27:00,396][106225] Updated weights for policy 1, policy_version 1421105 (0.0007) [2023-12-28 05:27:00,859][106226] Updated weights for policy 0, policy_version 1417875 (0.0006) [2023-12-28 05:27:00,914][106226] Updated weights for policy 0, policy_version 1417885 (0.0008) [2023-12-28 05:27:00,972][106226] Updated weights for policy 0, policy_version 1417895 (0.0009) [2023-12-28 05:27:01,047][106225] Updated weights for policy 1, policy_version 1421115 (0.0007) [2023-12-28 05:27:01,112][106225] Updated weights for policy 1, policy_version 1421125 (0.0008) [2023-12-28 05:27:01,174][106225] Updated weights for policy 1, policy_version 1421135 (0.0007) [2023-12-28 05:27:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 726908928. Throughput: 0: 9773.8, 1: 9975.5. Samples: 726898604. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:01,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.824')] [2023-12-28 05:27:01,755][106226] Updated weights for policy 0, policy_version 1417905 (0.0008) [2023-12-28 05:27:01,814][106226] Updated weights for policy 0, policy_version 1417915 (0.0006) [2023-12-28 05:27:01,860][106226] Updated weights for policy 0, policy_version 1417925 (0.0008) [2023-12-28 05:27:01,896][106225] Updated weights for policy 1, policy_version 1421145 (0.0008) [2023-12-28 05:27:01,912][106226] Updated weights for policy 0, policy_version 1417935 (0.0007) [2023-12-28 05:27:01,952][106225] Updated weights for policy 1, policy_version 1421155 (0.0008) [2023-12-28 05:27:02,004][106225] Updated weights for policy 1, policy_version 1421165 (0.0008) [2023-12-28 05:27:02,064][106225] Updated weights for policy 1, policy_version 1421175 (0.0008) [2023-12-28 05:27:02,577][106226] Updated weights for policy 0, policy_version 1417945 (0.0009) [2023-12-28 05:27:02,631][106226] Updated weights for policy 0, policy_version 1417955 (0.0008) [2023-12-28 05:27:02,679][106226] Updated weights for policy 0, policy_version 1417965 (0.0009) [2023-12-28 05:27:02,884][106225] Updated weights for policy 1, policy_version 1421185 (0.0009) [2023-12-28 05:27:02,937][106225] Updated weights for policy 1, policy_version 1421195 (0.0008) [2023-12-28 05:27:02,987][106225] Updated weights for policy 1, policy_version 1421205 (0.0009) [2023-12-28 05:27:03,402][106226] Updated weights for policy 0, policy_version 1417975 (0.0009) [2023-12-28 05:27:03,462][106226] Updated weights for policy 0, policy_version 1417985 (0.0008) [2023-12-28 05:27:03,523][106226] Updated weights for policy 0, policy_version 1417995 (0.0008) [2023-12-28 05:27:03,728][106225] Updated weights for policy 1, policy_version 1421215 (0.0010) [2023-12-28 05:27:03,779][106225] Updated weights for policy 1, policy_version 1421225 (0.0008) [2023-12-28 05:27:03,828][106225] Updated weights for policy 1, policy_version 1421235 (0.0010) [2023-12-28 05:27:04,274][106226] Updated weights for policy 0, policy_version 1418005 (0.0009) [2023-12-28 05:27:04,342][106226] Updated weights for policy 0, policy_version 1418015 (0.0010) [2023-12-28 05:27:04,419][106226] Updated weights for policy 0, policy_version 1418025 (0.0008) [2023-12-28 05:27:04,548][106225] Updated weights for policy 1, policy_version 1421245 (0.0008) [2023-12-28 05:27:04,597][106225] Updated weights for policy 1, policy_version 1421255 (0.0005) [2023-12-28 05:27:04,648][106225] Updated weights for policy 1, policy_version 1421265 (0.0006) [2023-12-28 05:27:04,983][106226] Updated weights for policy 0, policy_version 1418035 (0.0006) [2023-12-28 05:27:05,046][106226] Updated weights for policy 0, policy_version 1418045 (0.0006) [2023-12-28 05:27:05,102][106226] Updated weights for policy 0, policy_version 1418055 (0.0009) [2023-12-28 05:27:05,393][106225] Updated weights for policy 1, policy_version 1421275 (0.0008) [2023-12-28 05:27:05,443][106225] Updated weights for policy 1, policy_version 1421285 (0.0007) [2023-12-28 05:27:05,495][106225] Updated weights for policy 1, policy_version 1421295 (0.0008) [2023-12-28 05:27:05,739][106226] Updated weights for policy 0, policy_version 1418065 (0.0009) [2023-12-28 05:27:05,787][106226] Updated weights for policy 0, policy_version 1418075 (0.0008) [2023-12-28 05:27:05,842][106226] Updated weights for policy 0, policy_version 1418085 (0.0006) [2023-12-28 05:27:05,894][106226] Updated weights for policy 0, policy_version 1418095 (0.0005) [2023-12-28 05:27:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 727007232. Throughput: 0: 9822.8, 1: 9941.1. Samples: 727017320. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:06,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.609')] [2023-12-28 05:27:06,260][106225] Updated weights for policy 1, policy_version 1421305 (0.0009) [2023-12-28 05:27:06,324][106225] Updated weights for policy 1, policy_version 1421315 (0.0009) [2023-12-28 05:27:06,390][106225] Updated weights for policy 1, policy_version 1421325 (0.0008) [2023-12-28 05:27:06,450][106225] Updated weights for policy 1, policy_version 1421335 (0.0009) [2023-12-28 05:27:06,517][106226] Updated weights for policy 0, policy_version 1418105 (0.0009) [2023-12-28 05:27:06,582][106226] Updated weights for policy 0, policy_version 1418115 (0.0009) [2023-12-28 05:27:06,643][106226] Updated weights for policy 0, policy_version 1418125 (0.0009) [2023-12-28 05:27:07,167][106225] Updated weights for policy 1, policy_version 1421345 (0.0009) [2023-12-28 05:27:07,231][106225] Updated weights for policy 1, policy_version 1421355 (0.0008) [2023-12-28 05:27:07,287][106225] Updated weights for policy 1, policy_version 1421365 (0.0008) [2023-12-28 05:27:07,402][106226] Updated weights for policy 0, policy_version 1418135 (0.0008) [2023-12-28 05:27:07,458][106226] Updated weights for policy 0, policy_version 1418145 (0.0008) [2023-12-28 05:27:07,511][106226] Updated weights for policy 0, policy_version 1418155 (0.0009) [2023-12-28 05:27:08,007][106225] Updated weights for policy 1, policy_version 1421375 (0.0008) [2023-12-28 05:27:08,064][106225] Updated weights for policy 1, policy_version 1421385 (0.0006) [2023-12-28 05:27:08,126][106225] Updated weights for policy 1, policy_version 1421395 (0.0008) [2023-12-28 05:27:08,248][106226] Updated weights for policy 0, policy_version 1418165 (0.0009) [2023-12-28 05:27:08,306][106226] Updated weights for policy 0, policy_version 1418175 (0.0008) [2023-12-28 05:27:08,369][106226] Updated weights for policy 0, policy_version 1418185 (0.0008) [2023-12-28 05:27:08,835][106225] Updated weights for policy 1, policy_version 1421405 (0.0007) [2023-12-28 05:27:08,898][106225] Updated weights for policy 1, policy_version 1421415 (0.0005) [2023-12-28 05:27:08,946][106225] Updated weights for policy 1, policy_version 1421425 (0.0005) [2023-12-28 05:27:09,164][106226] Updated weights for policy 0, policy_version 1418195 (0.0008) [2023-12-28 05:27:09,228][106226] Updated weights for policy 0, policy_version 1418205 (0.0008) [2023-12-28 05:27:09,295][106226] Updated weights for policy 0, policy_version 1418215 (0.0008) [2023-12-28 05:27:09,609][106225] Updated weights for policy 1, policy_version 1421435 (0.0007) [2023-12-28 05:27:09,671][106225] Updated weights for policy 1, policy_version 1421445 (0.0006) [2023-12-28 05:27:09,734][106225] Updated weights for policy 1, policy_version 1421455 (0.0008) [2023-12-28 05:27:10,082][106226] Updated weights for policy 0, policy_version 1418225 (0.0008) [2023-12-28 05:27:10,152][106226] Updated weights for policy 0, policy_version 1418235 (0.0010) [2023-12-28 05:27:10,216][106226] Updated weights for policy 0, policy_version 1418245 (0.0008) [2023-12-28 05:27:10,284][106226] Updated weights for policy 0, policy_version 1418255 (0.0008) [2023-12-28 05:27:10,478][106225] Updated weights for policy 1, policy_version 1421465 (0.0010) [2023-12-28 05:27:10,548][106225] Updated weights for policy 1, policy_version 1421475 (0.0011) [2023-12-28 05:27:10,614][106225] Updated weights for policy 1, policy_version 1421485 (0.0010) [2023-12-28 05:27:10,674][106225] Updated weights for policy 1, policy_version 1421495 (0.0010) [2023-12-28 05:27:10,867][106226] Updated weights for policy 0, policy_version 1418265 (0.0006) [2023-12-28 05:27:10,925][106226] Updated weights for policy 0, policy_version 1418275 (0.0005) [2023-12-28 05:27:10,985][106226] Updated weights for policy 0, policy_version 1418285 (0.0006) [2023-12-28 05:27:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 727105536. Throughput: 0: 9816.5, 1: 9962.7. Samples: 727074900. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:11,175][105115] Avg episode reward: [(0, '-4.856'), (1, '-4.803')] [2023-12-28 05:27:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001421496_363954176.pth... [2023-12-28 05:27:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001418288_363151360.pth... [2023-12-28 05:27:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001420344_363659264.pth [2023-12-28 05:27:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001417168_362864640.pth [2023-12-28 05:27:11,362][106225] Updated weights for policy 1, policy_version 1421505 (0.0008) [2023-12-28 05:27:11,432][106225] Updated weights for policy 1, policy_version 1421515 (0.0008) [2023-12-28 05:27:11,494][106225] Updated weights for policy 1, policy_version 1421525 (0.0007) [2023-12-28 05:27:11,702][106226] Updated weights for policy 0, policy_version 1418295 (0.0006) [2023-12-28 05:27:11,777][106226] Updated weights for policy 0, policy_version 1418305 (0.0008) [2023-12-28 05:27:11,840][106226] Updated weights for policy 0, policy_version 1418315 (0.0006) [2023-12-28 05:27:12,314][106225] Updated weights for policy 1, policy_version 1421535 (0.0009) [2023-12-28 05:27:12,387][106225] Updated weights for policy 1, policy_version 1421545 (0.0008) [2023-12-28 05:27:12,435][106225] Updated weights for policy 1, policy_version 1421555 (0.0008) [2023-12-28 05:27:12,465][106226] Updated weights for policy 0, policy_version 1418325 (0.0006) [2023-12-28 05:27:12,524][106226] Updated weights for policy 0, policy_version 1418335 (0.0006) [2023-12-28 05:27:12,587][106226] Updated weights for policy 0, policy_version 1418345 (0.0006) [2023-12-28 05:27:13,179][106225] Updated weights for policy 1, policy_version 1421565 (0.0009) [2023-12-28 05:27:13,236][106225] Updated weights for policy 1, policy_version 1421575 (0.0009) [2023-12-28 05:27:13,288][106225] Updated weights for policy 1, policy_version 1421585 (0.0006) [2023-12-28 05:27:13,290][106226] Updated weights for policy 0, policy_version 1418355 (0.0007) [2023-12-28 05:27:13,337][106226] Updated weights for policy 0, policy_version 1418365 (0.0008) [2023-12-28 05:27:13,389][106226] Updated weights for policy 0, policy_version 1418375 (0.0008) [2023-12-28 05:27:13,945][106225] Updated weights for policy 1, policy_version 1421595 (0.0007) [2023-12-28 05:27:14,001][106225] Updated weights for policy 1, policy_version 1421605 (0.0009) [2023-12-28 05:27:14,019][106226] Updated weights for policy 0, policy_version 1418385 (0.0009) [2023-12-28 05:27:14,060][106225] Updated weights for policy 1, policy_version 1421615 (0.0007) [2023-12-28 05:27:14,066][106226] Updated weights for policy 0, policy_version 1418395 (0.0005) [2023-12-28 05:27:14,110][106226] Updated weights for policy 0, policy_version 1418405 (0.0007) [2023-12-28 05:27:14,161][106226] Updated weights for policy 0, policy_version 1418415 (0.0008) [2023-12-28 05:27:14,729][106225] Updated weights for policy 1, policy_version 1421625 (0.0008) [2023-12-28 05:27:14,799][106225] Updated weights for policy 1, policy_version 1421635 (0.0009) [2023-12-28 05:27:14,865][106225] Updated weights for policy 1, policy_version 1421645 (0.0008) [2023-12-28 05:27:14,916][106226] Updated weights for policy 0, policy_version 1418425 (0.0006) [2023-12-28 05:27:14,928][106225] Updated weights for policy 1, policy_version 1421655 (0.0008) [2023-12-28 05:27:14,982][106226] Updated weights for policy 0, policy_version 1418435 (0.0008) [2023-12-28 05:27:15,041][106226] Updated weights for policy 0, policy_version 1418445 (0.0009) [2023-12-28 05:27:15,640][106225] Updated weights for policy 1, policy_version 1421665 (0.0008) [2023-12-28 05:27:15,693][106225] Updated weights for policy 1, policy_version 1421675 (0.0008) [2023-12-28 05:27:15,709][106226] Updated weights for policy 0, policy_version 1418455 (0.0007) [2023-12-28 05:27:15,744][106225] Updated weights for policy 1, policy_version 1421685 (0.0006) [2023-12-28 05:27:15,758][106226] Updated weights for policy 0, policy_version 1418465 (0.0007) [2023-12-28 05:27:15,803][106226] Updated weights for policy 0, policy_version 1418475 (0.0008) [2023-12-28 05:27:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 727203840. Throughput: 0: 9720.4, 1: 9981.5. Samples: 727192712. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:16,176][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.608')] [2023-12-28 05:27:16,434][106225] Updated weights for policy 1, policy_version 1421695 (0.0007) [2023-12-28 05:27:16,448][106226] Updated weights for policy 0, policy_version 1418485 (0.0009) [2023-12-28 05:27:16,490][106225] Updated weights for policy 1, policy_version 1421705 (0.0006) [2023-12-28 05:27:16,506][106226] Updated weights for policy 0, policy_version 1418495 (0.0011) [2023-12-28 05:27:16,545][106225] Updated weights for policy 1, policy_version 1421715 (0.0006) [2023-12-28 05:27:16,557][106226] Updated weights for policy 0, policy_version 1418505 (0.0011) [2023-12-28 05:27:17,203][106225] Updated weights for policy 1, policy_version 1421725 (0.0008) [2023-12-28 05:27:17,260][106225] Updated weights for policy 1, policy_version 1421735 (0.0008) [2023-12-28 05:27:17,270][106226] Updated weights for policy 0, policy_version 1418515 (0.0010) [2023-12-28 05:27:17,317][106225] Updated weights for policy 1, policy_version 1421745 (0.0006) [2023-12-28 05:27:17,326][106226] Updated weights for policy 0, policy_version 1418525 (0.0010) [2023-12-28 05:27:17,377][106226] Updated weights for policy 0, policy_version 1418535 (0.0008) [2023-12-28 05:27:18,015][106225] Updated weights for policy 1, policy_version 1421755 (0.0006) [2023-12-28 05:27:18,081][106225] Updated weights for policy 1, policy_version 1421765 (0.0006) [2023-12-28 05:27:18,085][106226] Updated weights for policy 0, policy_version 1418545 (0.0007) [2023-12-28 05:27:18,137][106225] Updated weights for policy 1, policy_version 1421775 (0.0006) [2023-12-28 05:27:18,142][106226] Updated weights for policy 0, policy_version 1418555 (0.0010) [2023-12-28 05:27:18,196][106226] Updated weights for policy 0, policy_version 1418565 (0.0010) [2023-12-28 05:27:18,256][106226] Updated weights for policy 0, policy_version 1418575 (0.0011) [2023-12-28 05:27:18,783][106225] Updated weights for policy 1, policy_version 1421785 (0.0007) [2023-12-28 05:27:18,846][106225] Updated weights for policy 1, policy_version 1421795 (0.0009) [2023-12-28 05:27:18,904][106225] Updated weights for policy 1, policy_version 1421805 (0.0008) [2023-12-28 05:27:18,970][106225] Updated weights for policy 1, policy_version 1421815 (0.0006) [2023-12-28 05:27:18,982][106226] Updated weights for policy 0, policy_version 1418585 (0.0010) [2023-12-28 05:27:19,044][106226] Updated weights for policy 0, policy_version 1418595 (0.0009) [2023-12-28 05:27:19,112][106226] Updated weights for policy 0, policy_version 1418605 (0.0010) [2023-12-28 05:27:19,674][106225] Updated weights for policy 1, policy_version 1421825 (0.0005) [2023-12-28 05:27:19,736][106225] Updated weights for policy 1, policy_version 1421835 (0.0005) [2023-12-28 05:27:19,796][106225] Updated weights for policy 1, policy_version 1421845 (0.0006) [2023-12-28 05:27:19,920][106226] Updated weights for policy 0, policy_version 1418615 (0.0008) [2023-12-28 05:27:19,987][106226] Updated weights for policy 0, policy_version 1418625 (0.0006) [2023-12-28 05:27:20,045][106226] Updated weights for policy 0, policy_version 1418635 (0.0006) [2023-12-28 05:27:20,525][106225] Updated weights for policy 1, policy_version 1421855 (0.0009) [2023-12-28 05:27:20,592][106225] Updated weights for policy 1, policy_version 1421865 (0.0010) [2023-12-28 05:27:20,644][106225] Updated weights for policy 1, policy_version 1421875 (0.0010) [2023-12-28 05:27:20,689][106226] Updated weights for policy 0, policy_version 1418645 (0.0006) [2023-12-28 05:27:20,751][106226] Updated weights for policy 0, policy_version 1418655 (0.0008) [2023-12-28 05:27:20,815][106226] Updated weights for policy 0, policy_version 1418665 (0.0009) [2023-12-28 05:27:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 727302144. Throughput: 0: 9680.1, 1: 10044.4. Samples: 727311220. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:21,176][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.551')] [2023-12-28 05:27:21,382][106225] Updated weights for policy 1, policy_version 1421885 (0.0010) [2023-12-28 05:27:21,447][106225] Updated weights for policy 1, policy_version 1421895 (0.0008) [2023-12-28 05:27:21,510][106225] Updated weights for policy 1, policy_version 1421905 (0.0008) [2023-12-28 05:27:21,583][106226] Updated weights for policy 0, policy_version 1418675 (0.0006) [2023-12-28 05:27:21,657][106226] Updated weights for policy 0, policy_version 1418685 (0.0007) [2023-12-28 05:27:21,727][106226] Updated weights for policy 0, policy_version 1418695 (0.0007) [2023-12-28 05:27:22,264][106225] Updated weights for policy 1, policy_version 1421915 (0.0008) [2023-12-28 05:27:22,327][106225] Updated weights for policy 1, policy_version 1421925 (0.0009) [2023-12-28 05:27:22,395][106225] Updated weights for policy 1, policy_version 1421935 (0.0009) [2023-12-28 05:27:22,443][106226] Updated weights for policy 0, policy_version 1418705 (0.0008) [2023-12-28 05:27:22,508][106226] Updated weights for policy 0, policy_version 1418715 (0.0008) [2023-12-28 05:27:22,572][106226] Updated weights for policy 0, policy_version 1418725 (0.0008) [2023-12-28 05:27:22,636][106226] Updated weights for policy 0, policy_version 1418735 (0.0009) [2023-12-28 05:27:23,097][106225] Updated weights for policy 1, policy_version 1421945 (0.0009) [2023-12-28 05:27:23,158][106225] Updated weights for policy 1, policy_version 1421955 (0.0010) [2023-12-28 05:27:23,218][106225] Updated weights for policy 1, policy_version 1421965 (0.0010) [2023-12-28 05:27:23,277][106225] Updated weights for policy 1, policy_version 1421975 (0.0007) [2023-12-28 05:27:23,420][106226] Updated weights for policy 0, policy_version 1418745 (0.0008) [2023-12-28 05:27:23,484][106226] Updated weights for policy 0, policy_version 1418755 (0.0008) [2023-12-28 05:27:23,551][106226] Updated weights for policy 0, policy_version 1418765 (0.0010) [2023-12-28 05:27:23,878][106225] Updated weights for policy 1, policy_version 1421985 (0.0005) [2023-12-28 05:27:23,932][106225] Updated weights for policy 1, policy_version 1421995 (0.0005) [2023-12-28 05:27:23,978][106225] Updated weights for policy 1, policy_version 1422005 (0.0009) [2023-12-28 05:27:24,309][106226] Updated weights for policy 0, policy_version 1418775 (0.0010) [2023-12-28 05:27:24,364][106226] Updated weights for policy 0, policy_version 1418785 (0.0009) [2023-12-28 05:27:24,417][106226] Updated weights for policy 0, policy_version 1418795 (0.0007) [2023-12-28 05:27:24,634][106225] Updated weights for policy 1, policy_version 1422015 (0.0010) [2023-12-28 05:27:24,688][106225] Updated weights for policy 1, policy_version 1422025 (0.0006) [2023-12-28 05:27:24,735][106225] Updated weights for policy 1, policy_version 1422035 (0.0005) [2023-12-28 05:27:25,203][106226] Updated weights for policy 0, policy_version 1418805 (0.0008) [2023-12-28 05:27:25,255][106226] Updated weights for policy 0, policy_version 1418815 (0.0009) [2023-12-28 05:27:25,305][106226] Updated weights for policy 0, policy_version 1418825 (0.0008) [2023-12-28 05:27:25,321][106225] Updated weights for policy 1, policy_version 1422045 (0.0007) [2023-12-28 05:27:25,371][106225] Updated weights for policy 1, policy_version 1422055 (0.0006) [2023-12-28 05:27:25,431][106225] Updated weights for policy 1, policy_version 1422065 (0.0005) [2023-12-28 05:27:26,050][106225] Updated weights for policy 1, policy_version 1422075 (0.0007) [2023-12-28 05:27:26,089][106226] Updated weights for policy 0, policy_version 1418835 (0.0007) [2023-12-28 05:27:26,114][106225] Updated weights for policy 1, policy_version 1422085 (0.0008) [2023-12-28 05:27:26,147][106226] Updated weights for policy 0, policy_version 1418845 (0.0005) [2023-12-28 05:27:26,163][106225] Updated weights for policy 1, policy_version 1422095 (0.0007) [2023-12-28 05:27:26,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 727392256. Throughput: 0: 9645.3, 1: 9977.5. Samples: 727368244. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:26,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-4.820')] [2023-12-28 05:27:26,208][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001422104_364109824.pth... [2023-12-28 05:27:26,211][106226] Updated weights for policy 0, policy_version 1418855 (0.0009) [2023-12-28 05:27:26,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001420920_363806720.pth [2023-12-28 05:27:26,256][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001418864_363298816.pth... [2023-12-28 05:27:26,259][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001417712_363003904.pth [2023-12-28 05:27:26,775][106225] Updated weights for policy 1, policy_version 1422105 (0.0007) [2023-12-28 05:27:26,815][106226] Updated weights for policy 0, policy_version 1418865 (0.0009) [2023-12-28 05:27:26,824][106225] Updated weights for policy 1, policy_version 1422115 (0.0005) [2023-12-28 05:27:26,865][106226] Updated weights for policy 0, policy_version 1418875 (0.0010) [2023-12-28 05:27:26,883][106225] Updated weights for policy 1, policy_version 1422125 (0.0005) [2023-12-28 05:27:26,925][106226] Updated weights for policy 0, policy_version 1418885 (0.0010) [2023-12-28 05:27:26,935][106225] Updated weights for policy 1, policy_version 1422135 (0.0005) [2023-12-28 05:27:26,974][106226] Updated weights for policy 0, policy_version 1418895 (0.0008) [2023-12-28 05:27:27,526][106225] Updated weights for policy 1, policy_version 1422145 (0.0005) [2023-12-28 05:27:27,587][106225] Updated weights for policy 1, policy_version 1422155 (0.0005) [2023-12-28 05:27:27,643][106225] Updated weights for policy 1, policy_version 1422165 (0.0005) [2023-12-28 05:27:27,718][106226] Updated weights for policy 0, policy_version 1418905 (0.0010) [2023-12-28 05:27:27,776][106226] Updated weights for policy 0, policy_version 1418915 (0.0011) [2023-12-28 05:27:27,833][106226] Updated weights for policy 0, policy_version 1418925 (0.0011) [2023-12-28 05:27:28,185][106225] Updated weights for policy 1, policy_version 1422175 (0.0006) [2023-12-28 05:27:28,252][106225] Updated weights for policy 1, policy_version 1422185 (0.0006) [2023-12-28 05:27:28,316][106225] Updated weights for policy 1, policy_version 1422195 (0.0007) [2023-12-28 05:27:28,502][106226] Updated weights for policy 0, policy_version 1418935 (0.0011) [2023-12-28 05:27:28,558][106226] Updated weights for policy 0, policy_version 1418945 (0.0010) [2023-12-28 05:27:28,618][106226] Updated weights for policy 0, policy_version 1418955 (0.0010) [2023-12-28 05:27:28,947][106225] Updated weights for policy 1, policy_version 1422205 (0.0008) [2023-12-28 05:27:28,993][106225] Updated weights for policy 1, policy_version 1422215 (0.0007) [2023-12-28 05:27:29,039][106225] Updated weights for policy 1, policy_version 1422225 (0.0007) [2023-12-28 05:27:29,282][106226] Updated weights for policy 0, policy_version 1418965 (0.0010) [2023-12-28 05:27:29,343][106226] Updated weights for policy 0, policy_version 1418975 (0.0010) [2023-12-28 05:27:29,427][106226] Updated weights for policy 0, policy_version 1418985 (0.0009) [2023-12-28 05:27:29,776][106225] Updated weights for policy 1, policy_version 1422235 (0.0009) [2023-12-28 05:27:29,847][106225] Updated weights for policy 1, policy_version 1422245 (0.0010) [2023-12-28 05:27:29,912][106225] Updated weights for policy 1, policy_version 1422255 (0.0009) [2023-12-28 05:27:30,191][106226] Updated weights for policy 0, policy_version 1418995 (0.0007) [2023-12-28 05:27:30,252][106226] Updated weights for policy 0, policy_version 1419005 (0.0008) [2023-12-28 05:27:30,303][106226] Updated weights for policy 0, policy_version 1419015 (0.0008) [2023-12-28 05:27:30,625][106225] Updated weights for policy 1, policy_version 1422265 (0.0010) [2023-12-28 05:27:30,670][106225] Updated weights for policy 1, policy_version 1422275 (0.0010) [2023-12-28 05:27:30,717][106225] Updated weights for policy 1, policy_version 1422285 (0.0010) [2023-12-28 05:27:30,775][106225] Updated weights for policy 1, policy_version 1422295 (0.0010) [2023-12-28 05:27:30,948][106226] Updated weights for policy 0, policy_version 1419025 (0.0007) [2023-12-28 05:27:31,007][106226] Updated weights for policy 0, policy_version 1419035 (0.0008) [2023-12-28 05:27:31,072][106226] Updated weights for policy 0, policy_version 1419045 (0.0009) [2023-12-28 05:27:31,135][106226] Updated weights for policy 0, policy_version 1419055 (0.0009) [2023-12-28 05:27:31,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 727506944. Throughput: 0: 9685.2, 1: 10148.3. Samples: 727493140. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:31,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-4.743')] [2023-12-28 05:27:31,481][106225] Updated weights for policy 1, policy_version 1422305 (0.0009) [2023-12-28 05:27:31,536][106225] Updated weights for policy 1, policy_version 1422315 (0.0008) [2023-12-28 05:27:31,590][106225] Updated weights for policy 1, policy_version 1422325 (0.0008) [2023-12-28 05:27:31,891][106226] Updated weights for policy 0, policy_version 1419065 (0.0009) [2023-12-28 05:27:31,953][106226] Updated weights for policy 0, policy_version 1419075 (0.0009) [2023-12-28 05:27:32,006][106226] Updated weights for policy 0, policy_version 1419085 (0.0009) [2023-12-28 05:27:32,380][106225] Updated weights for policy 1, policy_version 1422335 (0.0007) [2023-12-28 05:27:32,446][106225] Updated weights for policy 1, policy_version 1422345 (0.0007) [2023-12-28 05:27:32,513][106225] Updated weights for policy 1, policy_version 1422355 (0.0006) [2023-12-28 05:27:32,734][106226] Updated weights for policy 0, policy_version 1419095 (0.0007) [2023-12-28 05:27:32,783][106226] Updated weights for policy 0, policy_version 1419105 (0.0005) [2023-12-28 05:27:32,845][106226] Updated weights for policy 0, policy_version 1419115 (0.0008) [2023-12-28 05:27:33,197][106225] Updated weights for policy 1, policy_version 1422365 (0.0007) [2023-12-28 05:27:33,248][106225] Updated weights for policy 1, policy_version 1422375 (0.0008) [2023-12-28 05:27:33,304][106225] Updated weights for policy 1, policy_version 1422385 (0.0009) [2023-12-28 05:27:33,492][106226] Updated weights for policy 0, policy_version 1419126 (0.0008) [2023-12-28 05:27:33,545][106226] Updated weights for policy 0, policy_version 1419136 (0.0007) [2023-12-28 05:27:33,609][106226] Updated weights for policy 0, policy_version 1419146 (0.0008) [2023-12-28 05:27:34,024][106225] Updated weights for policy 1, policy_version 1422395 (0.0008) [2023-12-28 05:27:34,080][106225] Updated weights for policy 1, policy_version 1422405 (0.0007) [2023-12-28 05:27:34,137][106225] Updated weights for policy 1, policy_version 1422415 (0.0006) [2023-12-28 05:27:34,257][106226] Updated weights for policy 0, policy_version 1419156 (0.0010) [2023-12-28 05:27:34,324][106226] Updated weights for policy 0, policy_version 1419166 (0.0008) [2023-12-28 05:27:34,394][106226] Updated weights for policy 0, policy_version 1419176 (0.0008) [2023-12-28 05:27:34,805][106225] Updated weights for policy 1, policy_version 1422425 (0.0008) [2023-12-28 05:27:34,862][106225] Updated weights for policy 1, policy_version 1422435 (0.0009) [2023-12-28 05:27:34,920][106225] Updated weights for policy 1, policy_version 1422445 (0.0007) [2023-12-28 05:27:34,977][106225] Updated weights for policy 1, policy_version 1422455 (0.0006) [2023-12-28 05:27:35,032][106226] Updated weights for policy 0, policy_version 1419186 (0.0008) [2023-12-28 05:27:35,096][106226] Updated weights for policy 0, policy_version 1419196 (0.0010) [2023-12-28 05:27:35,160][106226] Updated weights for policy 0, policy_version 1419206 (0.0011) [2023-12-28 05:27:35,221][106226] Updated weights for policy 0, policy_version 1419216 (0.0010) [2023-12-28 05:27:35,716][106225] Updated weights for policy 1, policy_version 1422465 (0.0008) [2023-12-28 05:27:35,765][106225] Updated weights for policy 1, policy_version 1422475 (0.0008) [2023-12-28 05:27:35,822][106225] Updated weights for policy 1, policy_version 1422485 (0.0009) [2023-12-28 05:27:35,842][106226] Updated weights for policy 0, policy_version 1419226 (0.0007) [2023-12-28 05:27:35,892][106226] Updated weights for policy 0, policy_version 1419236 (0.0006) [2023-12-28 05:27:35,941][106226] Updated weights for policy 0, policy_version 1419246 (0.0008) [2023-12-28 05:27:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 727605248. Throughput: 0: 9732.9, 1: 10050.5. Samples: 727612236. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:36,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.476')] [2023-12-28 05:27:36,608][106225] Updated weights for policy 1, policy_version 1422495 (0.0008) [2023-12-28 05:27:36,666][106225] Updated weights for policy 1, policy_version 1422505 (0.0009) [2023-12-28 05:27:36,715][106225] Updated weights for policy 1, policy_version 1422515 (0.0009) [2023-12-28 05:27:36,760][106226] Updated weights for policy 0, policy_version 1419256 (0.0009) [2023-12-28 05:27:36,826][106226] Updated weights for policy 0, policy_version 1419266 (0.0008) [2023-12-28 05:27:36,893][106226] Updated weights for policy 0, policy_version 1419276 (0.0009) [2023-12-28 05:27:37,370][106225] Updated weights for policy 1, policy_version 1422525 (0.0009) [2023-12-28 05:27:37,437][106225] Updated weights for policy 1, policy_version 1422535 (0.0005) [2023-12-28 05:27:37,491][106225] Updated weights for policy 1, policy_version 1422545 (0.0005) [2023-12-28 05:27:37,685][106226] Updated weights for policy 0, policy_version 1419286 (0.0011) [2023-12-28 05:27:37,743][106226] Updated weights for policy 0, policy_version 1419296 (0.0009) [2023-12-28 05:27:37,794][106226] Updated weights for policy 0, policy_version 1419306 (0.0008) [2023-12-28 05:27:38,006][106225] Updated weights for policy 1, policy_version 1422555 (0.0005) [2023-12-28 05:27:38,058][106225] Updated weights for policy 1, policy_version 1422565 (0.0007) [2023-12-28 05:27:38,108][106225] Updated weights for policy 1, policy_version 1422575 (0.0010) [2023-12-28 05:27:38,671][106226] Updated weights for policy 0, policy_version 1419316 (0.0009) [2023-12-28 05:27:38,724][106226] Updated weights for policy 0, policy_version 1419326 (0.0008) [2023-12-28 05:27:38,778][106226] Updated weights for policy 0, policy_version 1419336 (0.0007) [2023-12-28 05:27:38,791][106225] Updated weights for policy 1, policy_version 1422585 (0.0009) [2023-12-28 05:27:38,850][106225] Updated weights for policy 1, policy_version 1422595 (0.0005) [2023-12-28 05:27:38,917][106225] Updated weights for policy 1, policy_version 1422605 (0.0005) [2023-12-28 05:27:38,973][106225] Updated weights for policy 1, policy_version 1422615 (0.0005) [2023-12-28 05:27:39,498][106226] Updated weights for policy 0, policy_version 1419346 (0.0008) [2023-12-28 05:27:39,557][106226] Updated weights for policy 0, policy_version 1419356 (0.0006) [2023-12-28 05:27:39,599][106225] Updated weights for policy 1, policy_version 1422625 (0.0010) [2023-12-28 05:27:39,618][106226] Updated weights for policy 0, policy_version 1419366 (0.0009) [2023-12-28 05:27:39,657][106225] Updated weights for policy 1, policy_version 1422635 (0.0011) [2023-12-28 05:27:39,680][106226] Updated weights for policy 0, policy_version 1419376 (0.0009) [2023-12-28 05:27:39,717][106225] Updated weights for policy 1, policy_version 1422645 (0.0010) [2023-12-28 05:27:40,321][106226] Updated weights for policy 0, policy_version 1419386 (0.0006) [2023-12-28 05:27:40,380][106226] Updated weights for policy 0, policy_version 1419396 (0.0007) [2023-12-28 05:27:40,443][106226] Updated weights for policy 0, policy_version 1419406 (0.0010) [2023-12-28 05:27:40,515][106225] Updated weights for policy 1, policy_version 1422655 (0.0010) [2023-12-28 05:27:40,572][106225] Updated weights for policy 1, policy_version 1422665 (0.0010) [2023-12-28 05:27:40,626][106225] Updated weights for policy 1, policy_version 1422675 (0.0010) [2023-12-28 05:27:41,063][106226] Updated weights for policy 0, policy_version 1419416 (0.0008) [2023-12-28 05:27:41,129][106226] Updated weights for policy 0, policy_version 1419426 (0.0007) [2023-12-28 05:27:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 727695360. Throughput: 0: 9677.8, 1: 10119.5. Samples: 727669756. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:27:41,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-4.673')] [2023-12-28 05:27:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001422680_364257280.pth... [2023-12-28 05:27:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001421496_363954176.pth [2023-12-28 05:27:41,201][106226] Updated weights for policy 0, policy_version 1419436 (0.0008) [2023-12-28 05:27:41,224][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001419440_363446272.pth... [2023-12-28 05:27:41,228][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001418288_363151360.pth [2023-12-28 05:27:41,417][106225] Updated weights for policy 1, policy_version 1422685 (0.0009) [2023-12-28 05:27:41,472][106225] Updated weights for policy 1, policy_version 1422695 (0.0010) [2023-12-28 05:27:41,523][106225] Updated weights for policy 1, policy_version 1422705 (0.0010) [2023-12-28 05:27:41,981][106226] Updated weights for policy 0, policy_version 1419446 (0.0010) [2023-12-28 05:27:42,037][106226] Updated weights for policy 0, policy_version 1419456 (0.0011) [2023-12-28 05:27:42,105][106226] Updated weights for policy 0, policy_version 1419466 (0.0010) [2023-12-28 05:27:42,191][106225] Updated weights for policy 1, policy_version 1422715 (0.0010) [2023-12-28 05:27:42,268][106225] Updated weights for policy 1, policy_version 1422725 (0.0010) [2023-12-28 05:27:42,337][106225] Updated weights for policy 1, policy_version 1422735 (0.0008) [2023-12-28 05:27:42,836][106226] Updated weights for policy 0, policy_version 1419476 (0.0010) [2023-12-28 05:27:42,895][106226] Updated weights for policy 0, policy_version 1419486 (0.0007) [2023-12-28 05:27:42,966][106226] Updated weights for policy 0, policy_version 1419496 (0.0009) [2023-12-28 05:27:43,016][106225] Updated weights for policy 1, policy_version 1422745 (0.0009) [2023-12-28 05:27:43,071][106225] Updated weights for policy 1, policy_version 1422755 (0.0010) [2023-12-28 05:27:43,131][106225] Updated weights for policy 1, policy_version 1422765 (0.0009) [2023-12-28 05:27:43,202][106225] Updated weights for policy 1, policy_version 1422775 (0.0006) [2023-12-28 05:27:43,594][106226] Updated weights for policy 0, policy_version 1419506 (0.0008) [2023-12-28 05:27:43,650][106226] Updated weights for policy 0, policy_version 1419516 (0.0005) [2023-12-28 05:27:43,701][106226] Updated weights for policy 0, policy_version 1419526 (0.0005) [2023-12-28 05:27:43,762][106226] Updated weights for policy 0, policy_version 1419536 (0.0005) [2023-12-28 05:27:43,861][106225] Updated weights for policy 1, policy_version 1422785 (0.0010) [2023-12-28 05:27:43,909][106225] Updated weights for policy 1, policy_version 1422795 (0.0010) [2023-12-28 05:27:43,956][106225] Updated weights for policy 1, policy_version 1422805 (0.0010) [2023-12-28 05:27:44,254][106226] Updated weights for policy 0, policy_version 1419546 (0.0006) [2023-12-28 05:27:44,306][106226] Updated weights for policy 0, policy_version 1419556 (0.0007) [2023-12-28 05:27:44,363][106226] Updated weights for policy 0, policy_version 1419566 (0.0008) [2023-12-28 05:27:44,683][106225] Updated weights for policy 1, policy_version 1422815 (0.0010) [2023-12-28 05:27:44,733][106225] Updated weights for policy 1, policy_version 1422825 (0.0010) [2023-12-28 05:27:44,794][106225] Updated weights for policy 1, policy_version 1422835 (0.0010) [2023-12-28 05:27:45,084][106226] Updated weights for policy 0, policy_version 1419576 (0.0006) [2023-12-28 05:27:45,144][106226] Updated weights for policy 0, policy_version 1419586 (0.0008) [2023-12-28 05:27:45,210][106226] Updated weights for policy 0, policy_version 1419596 (0.0008) [2023-12-28 05:27:45,555][106225] Updated weights for policy 1, policy_version 1422845 (0.0010) [2023-12-28 05:27:45,611][106225] Updated weights for policy 1, policy_version 1422855 (0.0010) [2023-12-28 05:27:45,657][106225] Updated weights for policy 1, policy_version 1422865 (0.0010) [2023-12-28 05:27:45,905][106226] Updated weights for policy 0, policy_version 1419606 (0.0006) [2023-12-28 05:27:45,964][106226] Updated weights for policy 0, policy_version 1419616 (0.0005) [2023-12-28 05:27:46,020][106226] Updated weights for policy 0, policy_version 1419626 (0.0005) [2023-12-28 05:27:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 727801856. Throughput: 0: 9837.0, 1: 9970.9. Samples: 727789964. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:27:46,176][105115] Avg episode reward: [(0, '-4.986'), (1, '-4.642')] [2023-12-28 05:27:46,343][106225] Updated weights for policy 1, policy_version 1422875 (0.0010) [2023-12-28 05:27:46,402][106225] Updated weights for policy 1, policy_version 1422885 (0.0010) [2023-12-28 05:27:46,459][106225] Updated weights for policy 1, policy_version 1422895 (0.0010) [2023-12-28 05:27:46,518][106226] Updated weights for policy 0, policy_version 1419636 (0.0005) [2023-12-28 05:27:46,582][106226] Updated weights for policy 0, policy_version 1419646 (0.0007) [2023-12-28 05:27:46,641][106226] Updated weights for policy 0, policy_version 1419656 (0.0009) [2023-12-28 05:27:47,133][106225] Updated weights for policy 1, policy_version 1422905 (0.0010) [2023-12-28 05:27:47,197][106225] Updated weights for policy 1, policy_version 1422915 (0.0010) [2023-12-28 05:27:47,259][106225] Updated weights for policy 1, policy_version 1422925 (0.0010) [2023-12-28 05:27:47,316][106225] Updated weights for policy 1, policy_version 1422935 (0.0010) [2023-12-28 05:27:47,321][106226] Updated weights for policy 0, policy_version 1419666 (0.0008) [2023-12-28 05:27:47,387][106226] Updated weights for policy 0, policy_version 1419676 (0.0008) [2023-12-28 05:27:47,451][106226] Updated weights for policy 0, policy_version 1419686 (0.0008) [2023-12-28 05:27:47,515][106226] Updated weights for policy 0, policy_version 1419696 (0.0008) [2023-12-28 05:27:48,051][106225] Updated weights for policy 1, policy_version 1422945 (0.0007) [2023-12-28 05:27:48,106][106225] Updated weights for policy 1, policy_version 1422955 (0.0005) [2023-12-28 05:27:48,164][106225] Updated weights for policy 1, policy_version 1422965 (0.0006) [2023-12-28 05:27:48,286][106226] Updated weights for policy 0, policy_version 1419706 (0.0009) [2023-12-28 05:27:48,350][106226] Updated weights for policy 0, policy_version 1419716 (0.0009) [2023-12-28 05:27:48,413][106226] Updated weights for policy 0, policy_version 1419726 (0.0009) [2023-12-28 05:27:48,844][106225] Updated weights for policy 1, policy_version 1422975 (0.0008) [2023-12-28 05:27:48,908][106225] Updated weights for policy 1, policy_version 1422985 (0.0009) [2023-12-28 05:27:48,968][106225] Updated weights for policy 1, policy_version 1422995 (0.0010) [2023-12-28 05:27:49,166][106226] Updated weights for policy 0, policy_version 1419736 (0.0008) [2023-12-28 05:27:49,228][106226] Updated weights for policy 0, policy_version 1419746 (0.0008) [2023-12-28 05:27:49,291][106226] Updated weights for policy 0, policy_version 1419756 (0.0008) [2023-12-28 05:27:49,648][106225] Updated weights for policy 1, policy_version 1423005 (0.0008) [2023-12-28 05:27:49,715][106225] Updated weights for policy 1, policy_version 1423015 (0.0006) [2023-12-28 05:27:49,781][106225] Updated weights for policy 1, policy_version 1423025 (0.0009) [2023-12-28 05:27:50,137][106226] Updated weights for policy 0, policy_version 1419766 (0.0010) [2023-12-28 05:27:50,193][106226] Updated weights for policy 0, policy_version 1419776 (0.0011) [2023-12-28 05:27:50,254][106226] Updated weights for policy 0, policy_version 1419786 (0.0011) [2023-12-28 05:27:50,523][106225] Updated weights for policy 1, policy_version 1423035 (0.0008) [2023-12-28 05:27:50,588][106225] Updated weights for policy 1, policy_version 1423045 (0.0008) [2023-12-28 05:27:50,651][106225] Updated weights for policy 1, policy_version 1423055 (0.0008) [2023-12-28 05:27:50,976][106226] Updated weights for policy 0, policy_version 1419796 (0.0010) [2023-12-28 05:27:51,034][106226] Updated weights for policy 0, policy_version 1419806 (0.0008) [2023-12-28 05:27:51,094][106226] Updated weights for policy 0, policy_version 1419816 (0.0008) [2023-12-28 05:27:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 727900160. Throughput: 0: 9772.2, 1: 9993.8. Samples: 727906788. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:27:51,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.382')] [2023-12-28 05:27:51,348][106225] Updated weights for policy 1, policy_version 1423065 (0.0008) [2023-12-28 05:27:51,412][106225] Updated weights for policy 1, policy_version 1423075 (0.0008) [2023-12-28 05:27:51,476][106225] Updated weights for policy 1, policy_version 1423085 (0.0008) [2023-12-28 05:27:51,542][106225] Updated weights for policy 1, policy_version 1423095 (0.0006) [2023-12-28 05:27:51,878][106226] Updated weights for policy 0, policy_version 1419826 (0.0008) [2023-12-28 05:27:51,932][106226] Updated weights for policy 0, policy_version 1419836 (0.0007) [2023-12-28 05:27:51,979][106226] Updated weights for policy 0, policy_version 1419846 (0.0009) [2023-12-28 05:27:52,035][106226] Updated weights for policy 0, policy_version 1419856 (0.0008) [2023-12-28 05:27:52,235][106225] Updated weights for policy 1, policy_version 1423105 (0.0008) [2023-12-28 05:27:52,302][106225] Updated weights for policy 1, policy_version 1423115 (0.0008) [2023-12-28 05:27:52,363][106225] Updated weights for policy 1, policy_version 1423125 (0.0006) [2023-12-28 05:27:52,791][106226] Updated weights for policy 0, policy_version 1419866 (0.0009) [2023-12-28 05:27:52,855][106226] Updated weights for policy 0, policy_version 1419876 (0.0009) [2023-12-28 05:27:52,918][106226] Updated weights for policy 0, policy_version 1419886 (0.0005) [2023-12-28 05:27:52,982][106225] Updated weights for policy 1, policy_version 1423135 (0.0006) [2023-12-28 05:27:53,040][106225] Updated weights for policy 1, policy_version 1423145 (0.0010) [2023-12-28 05:27:53,090][106225] Updated weights for policy 1, policy_version 1423155 (0.0010) [2023-12-28 05:27:53,646][106226] Updated weights for policy 0, policy_version 1419896 (0.0009) [2023-12-28 05:27:53,685][106225] Updated weights for policy 1, policy_version 1423165 (0.0009) [2023-12-28 05:27:53,703][106226] Updated weights for policy 0, policy_version 1419906 (0.0008) [2023-12-28 05:27:53,730][106225] Updated weights for policy 1, policy_version 1423175 (0.0007) [2023-12-28 05:27:53,767][106226] Updated weights for policy 0, policy_version 1419916 (0.0008) [2023-12-28 05:27:53,780][106225] Updated weights for policy 1, policy_version 1423185 (0.0006) [2023-12-28 05:27:54,495][106226] Updated weights for policy 0, policy_version 1419926 (0.0007) [2023-12-28 05:27:54,507][106225] Updated weights for policy 1, policy_version 1423195 (0.0009) [2023-12-28 05:27:54,562][106226] Updated weights for policy 0, policy_version 1419936 (0.0007) [2023-12-28 05:27:54,571][106225] Updated weights for policy 1, policy_version 1423205 (0.0010) [2023-12-28 05:27:54,625][106226] Updated weights for policy 0, policy_version 1419946 (0.0008) [2023-12-28 05:27:54,631][106225] Updated weights for policy 1, policy_version 1423215 (0.0010) [2023-12-28 05:27:55,260][106225] Updated weights for policy 1, policy_version 1423225 (0.0009) [2023-12-28 05:27:55,271][106226] Updated weights for policy 0, policy_version 1419956 (0.0007) [2023-12-28 05:27:55,315][106225] Updated weights for policy 1, policy_version 1423235 (0.0005) [2023-12-28 05:27:55,338][106226] Updated weights for policy 0, policy_version 1419966 (0.0008) [2023-12-28 05:27:55,371][106225] Updated weights for policy 1, policy_version 1423245 (0.0006) [2023-12-28 05:27:55,399][106226] Updated weights for policy 0, policy_version 1419976 (0.0009) [2023-12-28 05:27:55,431][106225] Updated weights for policy 1, policy_version 1423255 (0.0007) [2023-12-28 05:27:56,089][106225] Updated weights for policy 1, policy_version 1423265 (0.0008) [2023-12-28 05:27:56,127][106226] Updated weights for policy 0, policy_version 1419986 (0.0006) [2023-12-28 05:27:56,133][106225] Updated weights for policy 1, policy_version 1423275 (0.0007) [2023-12-28 05:27:56,174][106226] Updated weights for policy 0, policy_version 1419996 (0.0006) [2023-12-28 05:27:56,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 727990272. Throughput: 0: 9755.9, 1: 10044.9. Samples: 727965928. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:27:56,175][105115] Avg episode reward: [(0, '-4.858'), (1, '-4.638')] [2023-12-28 05:27:56,191][106225] Updated weights for policy 1, policy_version 1423285 (0.0008) [2023-12-28 05:27:56,206][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001423288_364412928.pth... [2023-12-28 05:27:56,210][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001422104_364109824.pth [2023-12-28 05:27:56,227][106226] Updated weights for policy 0, policy_version 1420006 (0.0008) [2023-12-28 05:27:56,275][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001420016_363593728.pth... [2023-12-28 05:27:56,278][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001418864_363298816.pth [2023-12-28 05:27:56,907][106225] Updated weights for policy 1, policy_version 1423295 (0.0009) [2023-12-28 05:27:56,950][106225] Updated weights for policy 1, policy_version 1423305 (0.0008) [2023-12-28 05:27:56,970][106226] Updated weights for policy 0, policy_version 1420017 (0.0008) [2023-12-28 05:27:56,992][106225] Updated weights for policy 1, policy_version 1423315 (0.0006) [2023-12-28 05:27:57,025][106226] Updated weights for policy 0, policy_version 1420027 (0.0007) [2023-12-28 05:27:57,083][106226] Updated weights for policy 0, policy_version 1420037 (0.0008) [2023-12-28 05:27:57,138][106226] Updated weights for policy 0, policy_version 1420047 (0.0008) [2023-12-28 05:27:57,741][106225] Updated weights for policy 1, policy_version 1423325 (0.0007) [2023-12-28 05:27:57,791][106225] Updated weights for policy 1, policy_version 1423335 (0.0007) [2023-12-28 05:27:57,817][106226] Updated weights for policy 0, policy_version 1420057 (0.0006) [2023-12-28 05:27:57,847][106225] Updated weights for policy 1, policy_version 1423345 (0.0007) [2023-12-28 05:27:57,865][106226] Updated weights for policy 0, policy_version 1420067 (0.0008) [2023-12-28 05:27:57,924][106226] Updated weights for policy 0, policy_version 1420077 (0.0007) [2023-12-28 05:27:58,651][106225] Updated weights for policy 1, policy_version 1423355 (0.0007) [2023-12-28 05:27:58,695][106226] Updated weights for policy 0, policy_version 1420087 (0.0008) [2023-12-28 05:27:58,708][106225] Updated weights for policy 1, policy_version 1423365 (0.0008) [2023-12-28 05:27:58,758][106226] Updated weights for policy 0, policy_version 1420097 (0.0008) [2023-12-28 05:27:58,772][106225] Updated weights for policy 1, policy_version 1423375 (0.0007) [2023-12-28 05:27:58,826][106226] Updated weights for policy 0, policy_version 1420107 (0.0009) [2023-12-28 05:27:59,574][106225] Updated weights for policy 1, policy_version 1423385 (0.0008) [2023-12-28 05:27:59,634][106225] Updated weights for policy 1, policy_version 1423395 (0.0008) [2023-12-28 05:27:59,656][106226] Updated weights for policy 0, policy_version 1420117 (0.0009) [2023-12-28 05:27:59,692][106225] Updated weights for policy 1, policy_version 1423405 (0.0006) [2023-12-28 05:27:59,715][106226] Updated weights for policy 0, policy_version 1420127 (0.0007) [2023-12-28 05:27:59,754][106225] Updated weights for policy 1, policy_version 1423415 (0.0005) [2023-12-28 05:27:59,776][106226] Updated weights for policy 0, policy_version 1420137 (0.0011) [2023-12-28 05:28:00,447][106226] Updated weights for policy 0, policy_version 1420147 (0.0010) [2023-12-28 05:28:00,495][106225] Updated weights for policy 1, policy_version 1423425 (0.0007) [2023-12-28 05:28:00,509][106226] Updated weights for policy 0, policy_version 1420157 (0.0006) [2023-12-28 05:28:00,556][106225] Updated weights for policy 1, policy_version 1423435 (0.0006) [2023-12-28 05:28:00,573][106226] Updated weights for policy 0, policy_version 1420167 (0.0009) [2023-12-28 05:28:00,614][106225] Updated weights for policy 1, policy_version 1423445 (0.0006) [2023-12-28 05:28:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 728088576. Throughput: 0: 9697.0, 1: 10044.2. Samples: 728081064. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:01,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.889')] [2023-12-28 05:28:01,261][106226] Updated weights for policy 0, policy_version 1420177 (0.0006) [2023-12-28 05:28:01,272][106225] Updated weights for policy 1, policy_version 1423455 (0.0007) [2023-12-28 05:28:01,317][106226] Updated weights for policy 0, policy_version 1420187 (0.0007) [2023-12-28 05:28:01,327][106225] Updated weights for policy 1, policy_version 1423465 (0.0006) [2023-12-28 05:28:01,384][106226] Updated weights for policy 0, policy_version 1420197 (0.0008) [2023-12-28 05:28:01,390][106225] Updated weights for policy 1, policy_version 1423475 (0.0007) [2023-12-28 05:28:01,440][106226] Updated weights for policy 0, policy_version 1420207 (0.0008) [2023-12-28 05:28:02,071][106225] Updated weights for policy 1, policy_version 1423485 (0.0005) [2023-12-28 05:28:02,130][106225] Updated weights for policy 1, policy_version 1423495 (0.0005) [2023-12-28 05:28:02,177][106225] Updated weights for policy 1, policy_version 1423505 (0.0006) [2023-12-28 05:28:02,255][106226] Updated weights for policy 0, policy_version 1420217 (0.0009) [2023-12-28 05:28:02,307][106226] Updated weights for policy 0, policy_version 1420227 (0.0007) [2023-12-28 05:28:02,365][106226] Updated weights for policy 0, policy_version 1420237 (0.0009) [2023-12-28 05:28:02,901][106225] Updated weights for policy 1, policy_version 1423515 (0.0008) [2023-12-28 05:28:02,956][106225] Updated weights for policy 1, policy_version 1423525 (0.0008) [2023-12-28 05:28:03,013][106225] Updated weights for policy 1, policy_version 1423535 (0.0008) [2023-12-28 05:28:03,028][106226] Updated weights for policy 0, policy_version 1420247 (0.0006) [2023-12-28 05:28:03,084][106226] Updated weights for policy 0, policy_version 1420257 (0.0007) [2023-12-28 05:28:03,138][106226] Updated weights for policy 0, policy_version 1420267 (0.0009) [2023-12-28 05:28:03,757][106225] Updated weights for policy 1, policy_version 1423545 (0.0009) [2023-12-28 05:28:03,811][106225] Updated weights for policy 1, policy_version 1423555 (0.0008) [2023-12-28 05:28:03,864][106225] Updated weights for policy 1, policy_version 1423565 (0.0008) [2023-12-28 05:28:03,876][106226] Updated weights for policy 0, policy_version 1420277 (0.0009) [2023-12-28 05:28:03,921][106225] Updated weights for policy 1, policy_version 1423575 (0.0006) [2023-12-28 05:28:03,935][106226] Updated weights for policy 0, policy_version 1420287 (0.0008) [2023-12-28 05:28:03,995][106226] Updated weights for policy 0, policy_version 1420297 (0.0008) [2023-12-28 05:28:04,656][106225] Updated weights for policy 1, policy_version 1423585 (0.0008) [2023-12-28 05:28:04,700][106225] Updated weights for policy 1, policy_version 1423595 (0.0008) [2023-12-28 05:28:04,751][106226] Updated weights for policy 0, policy_version 1420307 (0.0009) [2023-12-28 05:28:04,757][106225] Updated weights for policy 1, policy_version 1423605 (0.0009) [2023-12-28 05:28:04,807][106226] Updated weights for policy 0, policy_version 1420317 (0.0007) [2023-12-28 05:28:04,862][106226] Updated weights for policy 0, policy_version 1420327 (0.0008) [2023-12-28 05:28:05,440][106225] Updated weights for policy 1, policy_version 1423615 (0.0009) [2023-12-28 05:28:05,488][106226] Updated weights for policy 0, policy_version 1420337 (0.0008) [2023-12-28 05:28:05,493][106225] Updated weights for policy 1, policy_version 1423625 (0.0005) [2023-12-28 05:28:05,548][106226] Updated weights for policy 0, policy_version 1420347 (0.0011) [2023-12-28 05:28:05,548][106225] Updated weights for policy 1, policy_version 1423635 (0.0010) [2023-12-28 05:28:05,608][106226] Updated weights for policy 0, policy_version 1420357 (0.0011) [2023-12-28 05:28:05,667][106226] Updated weights for policy 0, policy_version 1420367 (0.0010) [2023-12-28 05:28:06,146][106225] Updated weights for policy 1, policy_version 1423645 (0.0009) [2023-12-28 05:28:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 728186880. Throughput: 0: 9722.8, 1: 10030.5. Samples: 728200116. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:06,175][105115] Avg episode reward: [(0, '-5.104'), (1, '-4.822')] [2023-12-28 05:28:06,211][106225] Updated weights for policy 1, policy_version 1423655 (0.0011) [2023-12-28 05:28:06,276][106226] Updated weights for policy 0, policy_version 1420377 (0.0007) [2023-12-28 05:28:06,277][106225] Updated weights for policy 1, policy_version 1423665 (0.0011) [2023-12-28 05:28:06,345][106226] Updated weights for policy 0, policy_version 1420387 (0.0008) [2023-12-28 05:28:06,407][106226] Updated weights for policy 0, policy_version 1420397 (0.0011) [2023-12-28 05:28:06,999][106225] Updated weights for policy 1, policy_version 1423675 (0.0009) [2023-12-28 05:28:07,062][106225] Updated weights for policy 1, policy_version 1423685 (0.0007) [2023-12-28 05:28:07,119][106226] Updated weights for policy 0, policy_version 1420407 (0.0008) [2023-12-28 05:28:07,120][106225] Updated weights for policy 1, policy_version 1423695 (0.0007) [2023-12-28 05:28:07,175][106226] Updated weights for policy 0, policy_version 1420417 (0.0006) [2023-12-28 05:28:07,235][106226] Updated weights for policy 0, policy_version 1420427 (0.0007) [2023-12-28 05:28:07,729][106225] Updated weights for policy 1, policy_version 1423705 (0.0009) [2023-12-28 05:28:07,800][106225] Updated weights for policy 1, policy_version 1423715 (0.0005) [2023-12-28 05:28:07,863][106226] Updated weights for policy 0, policy_version 1420437 (0.0008) [2023-12-28 05:28:07,864][106225] Updated weights for policy 1, policy_version 1423725 (0.0006) [2023-12-28 05:28:07,914][106226] Updated weights for policy 0, policy_version 1420447 (0.0006) [2023-12-28 05:28:07,921][106225] Updated weights for policy 1, policy_version 1423735 (0.0008) [2023-12-28 05:28:07,962][106226] Updated weights for policy 0, policy_version 1420457 (0.0005) [2023-12-28 05:28:08,587][106225] Updated weights for policy 1, policy_version 1423745 (0.0006) [2023-12-28 05:28:08,621][106226] Updated weights for policy 0, policy_version 1420467 (0.0005) [2023-12-28 05:28:08,652][106225] Updated weights for policy 1, policy_version 1423755 (0.0007) [2023-12-28 05:28:08,688][106226] Updated weights for policy 0, policy_version 1420477 (0.0005) [2023-12-28 05:28:08,711][106225] Updated weights for policy 1, policy_version 1423765 (0.0010) [2023-12-28 05:28:08,749][106226] Updated weights for policy 0, policy_version 1420487 (0.0007) [2023-12-28 05:28:09,410][106225] Updated weights for policy 1, policy_version 1423775 (0.0008) [2023-12-28 05:28:09,464][106226] Updated weights for policy 0, policy_version 1420497 (0.0007) [2023-12-28 05:28:09,478][106225] Updated weights for policy 1, policy_version 1423785 (0.0011) [2023-12-28 05:28:09,529][106226] Updated weights for policy 0, policy_version 1420507 (0.0007) [2023-12-28 05:28:09,543][106225] Updated weights for policy 1, policy_version 1423795 (0.0011) [2023-12-28 05:28:09,594][106226] Updated weights for policy 0, policy_version 1420517 (0.0007) [2023-12-28 05:28:09,659][106226] Updated weights for policy 0, policy_version 1420527 (0.0007) [2023-12-28 05:28:10,299][106225] Updated weights for policy 1, policy_version 1423805 (0.0010) [2023-12-28 05:28:10,350][106225] Updated weights for policy 1, policy_version 1423815 (0.0010) [2023-12-28 05:28:10,410][106225] Updated weights for policy 1, policy_version 1423825 (0.0010) [2023-12-28 05:28:10,412][106226] Updated weights for policy 0, policy_version 1420537 (0.0008) [2023-12-28 05:28:10,478][106226] Updated weights for policy 0, policy_version 1420547 (0.0008) [2023-12-28 05:28:10,542][106226] Updated weights for policy 0, policy_version 1420557 (0.0006) [2023-12-28 05:28:11,127][106226] Updated weights for policy 0, policy_version 1420567 (0.0007) [2023-12-28 05:28:11,160][106225] Updated weights for policy 1, policy_version 1423835 (0.0010) [2023-12-28 05:28:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 728285184. Throughput: 0: 9793.4, 1: 10067.0. Samples: 728261964. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:11,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.904')] [2023-12-28 05:28:11,200][106226] Updated weights for policy 0, policy_version 1420577 (0.0008) [2023-12-28 05:28:11,230][106225] Updated weights for policy 1, policy_version 1423845 (0.0011) [2023-12-28 05:28:11,262][106226] Updated weights for policy 0, policy_version 1420587 (0.0008) [2023-12-28 05:28:11,297][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001420592_363741184.pth... [2023-12-28 05:28:11,298][106225] Updated weights for policy 1, policy_version 1423855 (0.0010) [2023-12-28 05:28:11,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001419440_363446272.pth [2023-12-28 05:28:11,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001423864_364560384.pth... [2023-12-28 05:28:11,367][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001422680_364257280.pth [2023-12-28 05:28:11,923][106226] Updated weights for policy 0, policy_version 1420597 (0.0006) [2023-12-28 05:28:11,990][106226] Updated weights for policy 0, policy_version 1420607 (0.0008) [2023-12-28 05:28:12,042][106226] Updated weights for policy 0, policy_version 1420617 (0.0005) [2023-12-28 05:28:12,063][106225] Updated weights for policy 1, policy_version 1423865 (0.0007) [2023-12-28 05:28:12,115][106225] Updated weights for policy 1, policy_version 1423875 (0.0009) [2023-12-28 05:28:12,164][106225] Updated weights for policy 1, policy_version 1423885 (0.0009) [2023-12-28 05:28:12,214][106225] Updated weights for policy 1, policy_version 1423895 (0.0008) [2023-12-28 05:28:12,712][106226] Updated weights for policy 0, policy_version 1420627 (0.0007) [2023-12-28 05:28:12,768][106226] Updated weights for policy 0, policy_version 1420637 (0.0009) [2023-12-28 05:28:12,827][106226] Updated weights for policy 0, policy_version 1420647 (0.0008) [2023-12-28 05:28:12,991][106225] Updated weights for policy 1, policy_version 1423905 (0.0008) [2023-12-28 05:28:13,042][106225] Updated weights for policy 1, policy_version 1423915 (0.0008) [2023-12-28 05:28:13,095][106225] Updated weights for policy 1, policy_version 1423925 (0.0006) [2023-12-28 05:28:13,601][106226] Updated weights for policy 0, policy_version 1420657 (0.0009) [2023-12-28 05:28:13,652][106226] Updated weights for policy 0, policy_version 1420667 (0.0009) [2023-12-28 05:28:13,713][106226] Updated weights for policy 0, policy_version 1420678 (0.0008) [2023-12-28 05:28:13,732][106225] Updated weights for policy 1, policy_version 1423935 (0.0006) [2023-12-28 05:28:13,766][106226] Updated weights for policy 0, policy_version 1420688 (0.0007) [2023-12-28 05:28:13,784][106225] Updated weights for policy 1, policy_version 1423945 (0.0007) [2023-12-28 05:28:13,832][106225] Updated weights for policy 1, policy_version 1423955 (0.0008) [2023-12-28 05:28:14,524][106226] Updated weights for policy 0, policy_version 1420698 (0.0009) [2023-12-28 05:28:14,546][106225] Updated weights for policy 1, policy_version 1423965 (0.0008) [2023-12-28 05:28:14,586][106226] Updated weights for policy 0, policy_version 1420708 (0.0006) [2023-12-28 05:28:14,602][106225] Updated weights for policy 1, policy_version 1423975 (0.0008) [2023-12-28 05:28:14,632][106226] Updated weights for policy 0, policy_version 1420718 (0.0006) [2023-12-28 05:28:14,656][106225] Updated weights for policy 1, policy_version 1423985 (0.0008) [2023-12-28 05:28:15,343][106226] Updated weights for policy 0, policy_version 1420728 (0.0008) [2023-12-28 05:28:15,397][106226] Updated weights for policy 0, policy_version 1420738 (0.0010) [2023-12-28 05:28:15,438][106225] Updated weights for policy 1, policy_version 1423995 (0.0009) [2023-12-28 05:28:15,455][106226] Updated weights for policy 0, policy_version 1420748 (0.0010) [2023-12-28 05:28:15,491][106225] Updated weights for policy 1, policy_version 1424005 (0.0010) [2023-12-28 05:28:15,551][106225] Updated weights for policy 1, policy_version 1424015 (0.0010) [2023-12-28 05:28:16,152][106226] Updated weights for policy 0, policy_version 1420758 (0.0007) [2023-12-28 05:28:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 728383488. Throughput: 0: 9787.4, 1: 9855.4. Samples: 728377068. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:16,176][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.882')] [2023-12-28 05:28:16,203][106226] Updated weights for policy 0, policy_version 1420768 (0.0005) [2023-12-28 05:28:16,242][106225] Updated weights for policy 1, policy_version 1424025 (0.0010) [2023-12-28 05:28:16,254][106226] Updated weights for policy 0, policy_version 1420778 (0.0005) [2023-12-28 05:28:16,285][106225] Updated weights for policy 1, policy_version 1424035 (0.0010) [2023-12-28 05:28:16,332][106225] Updated weights for policy 1, policy_version 1424045 (0.0010) [2023-12-28 05:28:16,375][106225] Updated weights for policy 1, policy_version 1424055 (0.0010) [2023-12-28 05:28:16,787][106226] Updated weights for policy 0, policy_version 1420788 (0.0006) [2023-12-28 05:28:16,854][106226] Updated weights for policy 0, policy_version 1420798 (0.0005) [2023-12-28 05:28:16,919][106226] Updated weights for policy 0, policy_version 1420808 (0.0005) [2023-12-28 05:28:17,064][106225] Updated weights for policy 1, policy_version 1424065 (0.0008) [2023-12-28 05:28:17,111][106225] Updated weights for policy 1, policy_version 1424075 (0.0007) [2023-12-28 05:28:17,158][106225] Updated weights for policy 1, policy_version 1424085 (0.0008) [2023-12-28 05:28:17,535][106226] Updated weights for policy 0, policy_version 1420818 (0.0009) [2023-12-28 05:28:17,604][106226] Updated weights for policy 0, policy_version 1420828 (0.0011) [2023-12-28 05:28:17,663][106226] Updated weights for policy 0, policy_version 1420838 (0.0010) [2023-12-28 05:28:17,723][106226] Updated weights for policy 0, policy_version 1420848 (0.0011) [2023-12-28 05:28:17,822][106225] Updated weights for policy 1, policy_version 1424095 (0.0006) [2023-12-28 05:28:17,891][106225] Updated weights for policy 1, policy_version 1424105 (0.0005) [2023-12-28 05:28:17,953][106225] Updated weights for policy 1, policy_version 1424115 (0.0009) [2023-12-28 05:28:18,447][106226] Updated weights for policy 0, policy_version 1420858 (0.0011) [2023-12-28 05:28:18,514][106226] Updated weights for policy 0, policy_version 1420868 (0.0007) [2023-12-28 05:28:18,583][106226] Updated weights for policy 0, policy_version 1420878 (0.0006) [2023-12-28 05:28:18,584][106225] Updated weights for policy 1, policy_version 1424125 (0.0009) [2023-12-28 05:28:18,655][106225] Updated weights for policy 1, policy_version 1424135 (0.0010) [2023-12-28 05:28:18,723][106225] Updated weights for policy 1, policy_version 1424145 (0.0008) [2023-12-28 05:28:19,173][106226] Updated weights for policy 0, policy_version 1420888 (0.0010) [2023-12-28 05:28:19,232][106226] Updated weights for policy 0, policy_version 1420898 (0.0010) [2023-12-28 05:28:19,294][106226] Updated weights for policy 0, policy_version 1420908 (0.0009) [2023-12-28 05:28:19,445][106225] Updated weights for policy 1, policy_version 1424155 (0.0010) [2023-12-28 05:28:19,505][106225] Updated weights for policy 1, policy_version 1424165 (0.0010) [2023-12-28 05:28:19,563][106225] Updated weights for policy 1, policy_version 1424175 (0.0009) [2023-12-28 05:28:20,069][106226] Updated weights for policy 0, policy_version 1420918 (0.0009) [2023-12-28 05:28:20,137][106226] Updated weights for policy 0, policy_version 1420928 (0.0008) [2023-12-28 05:28:20,202][106226] Updated weights for policy 0, policy_version 1420938 (0.0008) [2023-12-28 05:28:20,335][106225] Updated weights for policy 1, policy_version 1424185 (0.0009) [2023-12-28 05:28:20,397][106225] Updated weights for policy 1, policy_version 1424195 (0.0009) [2023-12-28 05:28:20,453][106225] Updated weights for policy 1, policy_version 1424205 (0.0008) [2023-12-28 05:28:20,514][106225] Updated weights for policy 1, policy_version 1424215 (0.0009) [2023-12-28 05:28:20,982][106226] Updated weights for policy 0, policy_version 1420948 (0.0009) [2023-12-28 05:28:21,049][106226] Updated weights for policy 0, policy_version 1420958 (0.0009) [2023-12-28 05:28:21,113][106226] Updated weights for policy 0, policy_version 1420968 (0.0010) [2023-12-28 05:28:21,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 728489984. Throughput: 0: 9764.8, 1: 9881.9. Samples: 728496336. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:21,175][105115] Avg episode reward: [(0, '-5.091'), (1, '-5.017')] [2023-12-28 05:28:21,215][106225] Updated weights for policy 1, policy_version 1424225 (0.0009) [2023-12-28 05:28:21,280][106225] Updated weights for policy 1, policy_version 1424235 (0.0008) [2023-12-28 05:28:21,344][106225] Updated weights for policy 1, policy_version 1424245 (0.0007) [2023-12-28 05:28:21,859][106226] Updated weights for policy 0, policy_version 1420978 (0.0009) [2023-12-28 05:28:21,925][106226] Updated weights for policy 0, policy_version 1420988 (0.0010) [2023-12-28 05:28:21,991][106226] Updated weights for policy 0, policy_version 1420998 (0.0009) [2023-12-28 05:28:22,053][106226] Updated weights for policy 0, policy_version 1421008 (0.0011) [2023-12-28 05:28:22,102][106225] Updated weights for policy 1, policy_version 1424255 (0.0007) [2023-12-28 05:28:22,160][106225] Updated weights for policy 1, policy_version 1424265 (0.0008) [2023-12-28 05:28:22,224][106225] Updated weights for policy 1, policy_version 1424275 (0.0008) [2023-12-28 05:28:22,706][106226] Updated weights for policy 0, policy_version 1421018 (0.0010) [2023-12-28 05:28:22,768][106226] Updated weights for policy 0, policy_version 1421028 (0.0010) [2023-12-28 05:28:22,833][106226] Updated weights for policy 0, policy_version 1421038 (0.0009) [2023-12-28 05:28:23,058][106225] Updated weights for policy 1, policy_version 1424285 (0.0007) [2023-12-28 05:28:23,109][106225] Updated weights for policy 1, policy_version 1424295 (0.0008) [2023-12-28 05:28:23,170][106225] Updated weights for policy 1, policy_version 1424305 (0.0008) [2023-12-28 05:28:23,440][106226] Updated weights for policy 0, policy_version 1421048 (0.0011) [2023-12-28 05:28:23,494][106226] Updated weights for policy 0, policy_version 1421058 (0.0010) [2023-12-28 05:28:23,544][106226] Updated weights for policy 0, policy_version 1421068 (0.0010) [2023-12-28 05:28:23,927][106225] Updated weights for policy 1, policy_version 1424315 (0.0009) [2023-12-28 05:28:23,989][106225] Updated weights for policy 1, policy_version 1424325 (0.0007) [2023-12-28 05:28:24,052][106225] Updated weights for policy 1, policy_version 1424335 (0.0005) [2023-12-28 05:28:24,268][106226] Updated weights for policy 0, policy_version 1421078 (0.0011) [2023-12-28 05:28:24,333][106226] Updated weights for policy 0, policy_version 1421088 (0.0006) [2023-12-28 05:28:24,395][106226] Updated weights for policy 0, policy_version 1421098 (0.0005) [2023-12-28 05:28:24,757][106225] Updated weights for policy 1, policy_version 1424345 (0.0006) [2023-12-28 05:28:24,817][106225] Updated weights for policy 1, policy_version 1424355 (0.0007) [2023-12-28 05:28:24,875][106225] Updated weights for policy 1, policy_version 1424365 (0.0007) [2023-12-28 05:28:24,937][106225] Updated weights for policy 1, policy_version 1424375 (0.0009) [2023-12-28 05:28:25,028][106226] Updated weights for policy 0, policy_version 1421108 (0.0007) [2023-12-28 05:28:25,081][106226] Updated weights for policy 0, policy_version 1421118 (0.0006) [2023-12-28 05:28:25,142][106226] Updated weights for policy 0, policy_version 1421128 (0.0010) [2023-12-28 05:28:25,693][106225] Updated weights for policy 1, policy_version 1424385 (0.0008) [2023-12-28 05:28:25,739][106225] Updated weights for policy 1, policy_version 1424395 (0.0008) [2023-12-28 05:28:25,791][106225] Updated weights for policy 1, policy_version 1424405 (0.0007) [2023-12-28 05:28:25,861][106226] Updated weights for policy 0, policy_version 1421138 (0.0010) [2023-12-28 05:28:25,918][106226] Updated weights for policy 0, policy_version 1421148 (0.0005) [2023-12-28 05:28:25,971][106226] Updated weights for policy 0, policy_version 1421158 (0.0005) [2023-12-28 05:28:26,030][106226] Updated weights for policy 0, policy_version 1421168 (0.0005) [2023-12-28 05:28:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 728588288. Throughput: 0: 9869.5, 1: 9789.5. Samples: 728554412. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:26,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-5.080')] [2023-12-28 05:28:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001424408_364699648.pth... [2023-12-28 05:28:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001421168_363888640.pth... [2023-12-28 05:28:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001420016_363593728.pth [2023-12-28 05:28:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001423288_364412928.pth [2023-12-28 05:28:26,440][106225] Updated weights for policy 1, policy_version 1424415 (0.0007) [2023-12-28 05:28:26,496][106225] Updated weights for policy 1, policy_version 1424425 (0.0005) [2023-12-28 05:28:26,554][106225] Updated weights for policy 1, policy_version 1424435 (0.0006) [2023-12-28 05:28:26,624][106226] Updated weights for policy 0, policy_version 1421178 (0.0005) [2023-12-28 05:28:26,682][106226] Updated weights for policy 0, policy_version 1421188 (0.0005) [2023-12-28 05:28:26,749][106226] Updated weights for policy 0, policy_version 1421198 (0.0005) [2023-12-28 05:28:27,188][106225] Updated weights for policy 1, policy_version 1424445 (0.0010) [2023-12-28 05:28:27,238][106225] Updated weights for policy 1, policy_version 1424455 (0.0007) [2023-12-28 05:28:27,265][106226] Updated weights for policy 0, policy_version 1421208 (0.0008) [2023-12-28 05:28:27,296][106225] Updated weights for policy 1, policy_version 1424465 (0.0010) [2023-12-28 05:28:27,323][106226] Updated weights for policy 0, policy_version 1421218 (0.0007) [2023-12-28 05:28:27,387][106226] Updated weights for policy 0, policy_version 1421228 (0.0008) [2023-12-28 05:28:27,908][106226] Updated weights for policy 0, policy_version 1421238 (0.0006) [2023-12-28 05:28:27,968][106225] Updated weights for policy 1, policy_version 1424475 (0.0007) [2023-12-28 05:28:27,974][106226] Updated weights for policy 0, policy_version 1421248 (0.0010) [2023-12-28 05:28:28,026][106225] Updated weights for policy 1, policy_version 1424485 (0.0006) [2023-12-28 05:28:28,034][106226] Updated weights for policy 0, policy_version 1421258 (0.0010) [2023-12-28 05:28:28,082][106225] Updated weights for policy 1, policy_version 1424495 (0.0008) [2023-12-28 05:28:28,650][106226] Updated weights for policy 0, policy_version 1421268 (0.0010) [2023-12-28 05:28:28,704][106226] Updated weights for policy 0, policy_version 1421278 (0.0010) [2023-12-28 05:28:28,752][106225] Updated weights for policy 1, policy_version 1424505 (0.0007) [2023-12-28 05:28:28,761][106226] Updated weights for policy 0, policy_version 1421288 (0.0010) [2023-12-28 05:28:28,809][106225] Updated weights for policy 1, policy_version 1424515 (0.0010) [2023-12-28 05:28:28,867][106225] Updated weights for policy 1, policy_version 1424525 (0.0010) [2023-12-28 05:28:28,926][106225] Updated weights for policy 1, policy_version 1424535 (0.0010) [2023-12-28 05:28:29,497][106226] Updated weights for policy 0, policy_version 1421298 (0.0010) [2023-12-28 05:28:29,552][106226] Updated weights for policy 0, policy_version 1421308 (0.0010) [2023-12-28 05:28:29,598][106226] Updated weights for policy 0, policy_version 1421318 (0.0008) [2023-12-28 05:28:29,612][106225] Updated weights for policy 1, policy_version 1424545 (0.0009) [2023-12-28 05:28:29,644][106226] Updated weights for policy 0, policy_version 1421328 (0.0007) [2023-12-28 05:28:29,669][106225] Updated weights for policy 1, policy_version 1424555 (0.0010) [2023-12-28 05:28:29,720][106225] Updated weights for policy 1, policy_version 1424565 (0.0010) [2023-12-28 05:28:30,431][106226] Updated weights for policy 0, policy_version 1421338 (0.0008) [2023-12-28 05:28:30,495][106226] Updated weights for policy 0, policy_version 1421348 (0.0007) [2023-12-28 05:28:30,497][106225] Updated weights for policy 1, policy_version 1424575 (0.0011) [2023-12-28 05:28:30,553][106226] Updated weights for policy 0, policy_version 1421358 (0.0007) [2023-12-28 05:28:30,555][106225] Updated weights for policy 1, policy_version 1424585 (0.0010) [2023-12-28 05:28:30,615][106225] Updated weights for policy 1, policy_version 1424595 (0.0010) [2023-12-28 05:28:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 728686592. Throughput: 0: 9930.4, 1: 9844.0. Samples: 728679808. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:31,175][105115] Avg episode reward: [(0, '-5.132'), (1, '-4.652')] [2023-12-28 05:28:31,297][106226] Updated weights for policy 0, policy_version 1421368 (0.0007) [2023-12-28 05:28:31,303][106225] Updated weights for policy 1, policy_version 1424605 (0.0010) [2023-12-28 05:28:31,365][106225] Updated weights for policy 1, policy_version 1424615 (0.0008) [2023-12-28 05:28:31,365][106226] Updated weights for policy 0, policy_version 1421378 (0.0011) [2023-12-28 05:28:31,425][106226] Updated weights for policy 0, policy_version 1421388 (0.0009) [2023-12-28 05:28:31,431][106225] Updated weights for policy 1, policy_version 1424625 (0.0010) [2023-12-28 05:28:32,086][106226] Updated weights for policy 0, policy_version 1421398 (0.0007) [2023-12-28 05:28:32,143][106226] Updated weights for policy 0, policy_version 1421408 (0.0006) [2023-12-28 05:28:32,170][106225] Updated weights for policy 1, policy_version 1424635 (0.0009) [2023-12-28 05:28:32,211][106226] Updated weights for policy 0, policy_version 1421418 (0.0006) [2023-12-28 05:28:32,225][106225] Updated weights for policy 1, policy_version 1424645 (0.0005) [2023-12-28 05:28:32,279][106225] Updated weights for policy 1, policy_version 1424655 (0.0007) [2023-12-28 05:28:32,844][106226] Updated weights for policy 0, policy_version 1421428 (0.0008) [2023-12-28 05:28:32,900][106226] Updated weights for policy 0, policy_version 1421438 (0.0010) [2023-12-28 05:28:32,903][106225] Updated weights for policy 1, policy_version 1424665 (0.0008) [2023-12-28 05:28:32,959][106226] Updated weights for policy 0, policy_version 1421448 (0.0010) [2023-12-28 05:28:32,959][106225] Updated weights for policy 1, policy_version 1424675 (0.0009) [2023-12-28 05:28:33,010][106225] Updated weights for policy 1, policy_version 1424685 (0.0010) [2023-12-28 05:28:33,064][106225] Updated weights for policy 1, policy_version 1424695 (0.0010) [2023-12-28 05:28:33,689][106226] Updated weights for policy 0, policy_version 1421458 (0.0011) [2023-12-28 05:28:33,751][106226] Updated weights for policy 0, policy_version 1421468 (0.0010) [2023-12-28 05:28:33,781][106225] Updated weights for policy 1, policy_version 1424705 (0.0009) [2023-12-28 05:28:33,809][106226] Updated weights for policy 0, policy_version 1421478 (0.0010) [2023-12-28 05:28:33,838][106225] Updated weights for policy 1, policy_version 1424715 (0.0005) [2023-12-28 05:28:33,859][106226] Updated weights for policy 0, policy_version 1421488 (0.0010) [2023-12-28 05:28:33,903][106225] Updated weights for policy 1, policy_version 1424725 (0.0007) [2023-12-28 05:28:34,601][106226] Updated weights for policy 0, policy_version 1421498 (0.0011) [2023-12-28 05:28:34,649][106225] Updated weights for policy 1, policy_version 1424735 (0.0006) [2023-12-28 05:28:34,666][106226] Updated weights for policy 0, policy_version 1421508 (0.0011) [2023-12-28 05:28:34,699][106225] Updated weights for policy 1, policy_version 1424745 (0.0007) [2023-12-28 05:28:34,727][106226] Updated weights for policy 0, policy_version 1421518 (0.0011) [2023-12-28 05:28:34,758][106225] Updated weights for policy 1, policy_version 1424755 (0.0009) [2023-12-28 05:28:35,424][106226] Updated weights for policy 0, policy_version 1421528 (0.0006) [2023-12-28 05:28:35,479][106225] Updated weights for policy 1, policy_version 1424765 (0.0008) [2023-12-28 05:28:35,480][106226] Updated weights for policy 0, policy_version 1421538 (0.0005) [2023-12-28 05:28:35,530][106226] Updated weights for policy 0, policy_version 1421548 (0.0005) [2023-12-28 05:28:35,532][106225] Updated weights for policy 1, policy_version 1424775 (0.0008) [2023-12-28 05:28:35,580][106225] Updated weights for policy 1, policy_version 1424785 (0.0008) [2023-12-28 05:28:36,048][106226] Updated weights for policy 0, policy_version 1421558 (0.0005) [2023-12-28 05:28:36,123][106226] Updated weights for policy 0, policy_version 1421568 (0.0022) [2023-12-28 05:28:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 728784896. Throughput: 0: 9983.6, 1: 9827.8. Samples: 728798296. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:36,175][105115] Avg episode reward: [(0, '-5.005'), (1, '-4.834')] [2023-12-28 05:28:36,200][106226] Updated weights for policy 0, policy_version 1421580 (0.0007) [2023-12-28 05:28:36,404][106225] Updated weights for policy 1, policy_version 1424795 (0.0010) [2023-12-28 05:28:36,466][106225] Updated weights for policy 1, policy_version 1424805 (0.0008) [2023-12-28 05:28:36,532][106225] Updated weights for policy 1, policy_version 1424815 (0.0008) [2023-12-28 05:28:36,864][106226] Updated weights for policy 0, policy_version 1421590 (0.0008) [2023-12-28 05:28:36,924][106226] Updated weights for policy 0, policy_version 1421600 (0.0008) [2023-12-28 05:28:36,980][106226] Updated weights for policy 0, policy_version 1421610 (0.0008) [2023-12-28 05:28:37,255][106225] Updated weights for policy 1, policy_version 1424825 (0.0008) [2023-12-28 05:28:37,323][106225] Updated weights for policy 1, policy_version 1424835 (0.0011) [2023-12-28 05:28:37,386][106225] Updated weights for policy 1, policy_version 1424845 (0.0009) [2023-12-28 05:28:37,450][106225] Updated weights for policy 1, policy_version 1424855 (0.0007) [2023-12-28 05:28:37,606][106226] Updated weights for policy 0, policy_version 1421620 (0.0007) [2023-12-28 05:28:37,665][106226] Updated weights for policy 0, policy_version 1421630 (0.0009) [2023-12-28 05:28:37,728][106226] Updated weights for policy 0, policy_version 1421640 (0.0009) [2023-12-28 05:28:38,158][106225] Updated weights for policy 1, policy_version 1424865 (0.0008) [2023-12-28 05:28:38,210][106225] Updated weights for policy 1, policy_version 1424875 (0.0009) [2023-12-28 05:28:38,258][106225] Updated weights for policy 1, policy_version 1424885 (0.0009) [2023-12-28 05:28:38,420][106226] Updated weights for policy 0, policy_version 1421650 (0.0009) [2023-12-28 05:28:38,479][106226] Updated weights for policy 0, policy_version 1421660 (0.0010) [2023-12-28 05:28:38,534][106226] Updated weights for policy 0, policy_version 1421670 (0.0008) [2023-12-28 05:28:38,592][106226] Updated weights for policy 0, policy_version 1421680 (0.0007) [2023-12-28 05:28:38,950][106225] Updated weights for policy 1, policy_version 1424895 (0.0007) [2023-12-28 05:28:39,004][106225] Updated weights for policy 1, policy_version 1424905 (0.0005) [2023-12-28 05:28:39,049][106225] Updated weights for policy 1, policy_version 1424915 (0.0007) [2023-12-28 05:28:39,352][106226] Updated weights for policy 0, policy_version 1421690 (0.0009) [2023-12-28 05:28:39,425][106226] Updated weights for policy 0, policy_version 1421700 (0.0009) [2023-12-28 05:28:39,486][106226] Updated weights for policy 0, policy_version 1421710 (0.0008) [2023-12-28 05:28:39,748][106225] Updated weights for policy 1, policy_version 1424925 (0.0005) [2023-12-28 05:28:39,814][106225] Updated weights for policy 1, policy_version 1424935 (0.0006) [2023-12-28 05:28:39,886][106225] Updated weights for policy 1, policy_version 1424945 (0.0009) [2023-12-28 05:28:40,200][106226] Updated weights for policy 0, policy_version 1421720 (0.0007) [2023-12-28 05:28:40,263][106226] Updated weights for policy 0, policy_version 1421730 (0.0006) [2023-12-28 05:28:40,329][106226] Updated weights for policy 0, policy_version 1421740 (0.0007) [2023-12-28 05:28:40,559][106225] Updated weights for policy 1, policy_version 1424955 (0.0010) [2023-12-28 05:28:40,613][106225] Updated weights for policy 1, policy_version 1424965 (0.0005) [2023-12-28 05:28:40,659][106225] Updated weights for policy 1, policy_version 1424975 (0.0005) [2023-12-28 05:28:41,036][106226] Updated weights for policy 0, policy_version 1421750 (0.0008) [2023-12-28 05:28:41,107][106226] Updated weights for policy 0, policy_version 1421760 (0.0008) [2023-12-28 05:28:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 728883200. Throughput: 0: 10040.1, 1: 9761.2. Samples: 728856988. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:41,175][105115] Avg episode reward: [(0, '-4.768'), (1, '-4.610')] [2023-12-28 05:28:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001424984_364847104.pth... [2023-12-28 05:28:41,181][106226] Updated weights for policy 0, policy_version 1421770 (0.0009) [2023-12-28 05:28:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001423864_364560384.pth [2023-12-28 05:28:41,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001421776_364044288.pth... [2023-12-28 05:28:41,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001420592_363741184.pth [2023-12-28 05:28:41,273][106225] Updated weights for policy 1, policy_version 1424985 (0.0006) [2023-12-28 05:28:41,342][106225] Updated weights for policy 1, policy_version 1424995 (0.0007) [2023-12-28 05:28:41,411][106225] Updated weights for policy 1, policy_version 1425005 (0.0009) [2023-12-28 05:28:41,479][106225] Updated weights for policy 1, policy_version 1425015 (0.0006) [2023-12-28 05:28:41,990][106226] Updated weights for policy 0, policy_version 1421780 (0.0010) [2023-12-28 05:28:42,052][106226] Updated weights for policy 0, policy_version 1421790 (0.0008) [2023-12-28 05:28:42,113][106226] Updated weights for policy 0, policy_version 1421800 (0.0008) [2023-12-28 05:28:42,241][106225] Updated weights for policy 1, policy_version 1425025 (0.0008) [2023-12-28 05:28:42,307][106225] Updated weights for policy 1, policy_version 1425035 (0.0008) [2023-12-28 05:28:42,374][106225] Updated weights for policy 1, policy_version 1425045 (0.0008) [2023-12-28 05:28:42,856][106226] Updated weights for policy 0, policy_version 1421810 (0.0006) [2023-12-28 05:28:42,917][106226] Updated weights for policy 0, policy_version 1421820 (0.0005) [2023-12-28 05:28:42,975][106226] Updated weights for policy 0, policy_version 1421830 (0.0008) [2023-12-28 05:28:43,034][106226] Updated weights for policy 0, policy_version 1421840 (0.0008) [2023-12-28 05:28:43,072][106225] Updated weights for policy 1, policy_version 1425055 (0.0008) [2023-12-28 05:28:43,118][106225] Updated weights for policy 1, policy_version 1425065 (0.0007) [2023-12-28 05:28:43,171][106225] Updated weights for policy 1, policy_version 1425075 (0.0008) [2023-12-28 05:28:43,639][106226] Updated weights for policy 0, policy_version 1421850 (0.0009) [2023-12-28 05:28:43,692][106226] Updated weights for policy 0, policy_version 1421860 (0.0008) [2023-12-28 05:28:43,747][106226] Updated weights for policy 0, policy_version 1421870 (0.0008) [2023-12-28 05:28:43,853][106225] Updated weights for policy 1, policy_version 1425085 (0.0006) [2023-12-28 05:28:43,911][106225] Updated weights for policy 1, policy_version 1425095 (0.0005) [2023-12-28 05:28:43,966][106225] Updated weights for policy 1, policy_version 1425105 (0.0005) [2023-12-28 05:28:44,478][106226] Updated weights for policy 0, policy_version 1421880 (0.0009) [2023-12-28 05:28:44,536][106226] Updated weights for policy 0, policy_version 1421890 (0.0008) [2023-12-28 05:28:44,546][106225] Updated weights for policy 1, policy_version 1425115 (0.0006) [2023-12-28 05:28:44,584][106226] Updated weights for policy 0, policy_version 1421900 (0.0005) [2023-12-28 05:28:44,598][106225] Updated weights for policy 1, policy_version 1425125 (0.0007) [2023-12-28 05:28:44,659][106225] Updated weights for policy 1, policy_version 1425135 (0.0009) [2023-12-28 05:28:45,252][106226] Updated weights for policy 0, policy_version 1421910 (0.0006) [2023-12-28 05:28:45,311][106226] Updated weights for policy 0, policy_version 1421920 (0.0008) [2023-12-28 05:28:45,366][106225] Updated weights for policy 1, policy_version 1425145 (0.0009) [2023-12-28 05:28:45,368][106226] Updated weights for policy 0, policy_version 1421930 (0.0009) [2023-12-28 05:28:45,425][106225] Updated weights for policy 1, policy_version 1425155 (0.0005) [2023-12-28 05:28:45,475][106225] Updated weights for policy 1, policy_version 1425165 (0.0009) [2023-12-28 05:28:45,522][106225] Updated weights for policy 1, policy_version 1425175 (0.0005) [2023-12-28 05:28:45,928][106226] Updated weights for policy 0, policy_version 1421940 (0.0007) [2023-12-28 05:28:45,998][106226] Updated weights for policy 0, policy_version 1421950 (0.0006) [2023-12-28 05:28:46,065][106226] Updated weights for policy 0, policy_version 1421960 (0.0007) [2023-12-28 05:28:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 728989696. Throughput: 0: 10062.2, 1: 9829.7. Samples: 728976200. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:46,175][105115] Avg episode reward: [(0, '-4.890'), (1, '-4.843')] [2023-12-28 05:28:46,176][106225] Updated weights for policy 1, policy_version 1425185 (0.0008) [2023-12-28 05:28:46,236][106225] Updated weights for policy 1, policy_version 1425195 (0.0010) [2023-12-28 05:28:46,289][106225] Updated weights for policy 1, policy_version 1425205 (0.0010) [2023-12-28 05:28:46,722][106226] Updated weights for policy 0, policy_version 1421970 (0.0010) [2023-12-28 05:28:46,768][106226] Updated weights for policy 0, policy_version 1421980 (0.0010) [2023-12-28 05:28:46,817][106226] Updated weights for policy 0, policy_version 1421990 (0.0010) [2023-12-28 05:28:46,877][106226] Updated weights for policy 0, policy_version 1422000 (0.0010) [2023-12-28 05:28:47,002][106225] Updated weights for policy 1, policy_version 1425215 (0.0010) [2023-12-28 05:28:47,064][106225] Updated weights for policy 1, policy_version 1425225 (0.0006) [2023-12-28 05:28:47,121][106225] Updated weights for policy 1, policy_version 1425235 (0.0007) [2023-12-28 05:28:47,494][106226] Updated weights for policy 0, policy_version 1422010 (0.0005) [2023-12-28 05:28:47,546][106226] Updated weights for policy 0, policy_version 1422020 (0.0007) [2023-12-28 05:28:47,599][106226] Updated weights for policy 0, policy_version 1422030 (0.0008) [2023-12-28 05:28:47,754][106225] Updated weights for policy 1, policy_version 1425245 (0.0010) [2023-12-28 05:28:47,819][106225] Updated weights for policy 1, policy_version 1425255 (0.0010) [2023-12-28 05:28:47,885][106225] Updated weights for policy 1, policy_version 1425265 (0.0005) [2023-12-28 05:28:48,198][106226] Updated weights for policy 0, policy_version 1422040 (0.0006) [2023-12-28 05:28:48,260][106226] Updated weights for policy 0, policy_version 1422050 (0.0007) [2023-12-28 05:28:48,315][106226] Updated weights for policy 0, policy_version 1422060 (0.0009) [2023-12-28 05:28:48,539][106225] Updated weights for policy 1, policy_version 1425275 (0.0008) [2023-12-28 05:28:48,606][106225] Updated weights for policy 1, policy_version 1425285 (0.0009) [2023-12-28 05:28:48,663][106225] Updated weights for policy 1, policy_version 1425295 (0.0010) [2023-12-28 05:28:48,993][106226] Updated weights for policy 0, policy_version 1422070 (0.0008) [2023-12-28 05:28:49,046][106226] Updated weights for policy 0, policy_version 1422080 (0.0008) [2023-12-28 05:28:49,113][106226] Updated weights for policy 0, policy_version 1422090 (0.0008) [2023-12-28 05:28:49,338][106225] Updated weights for policy 1, policy_version 1425305 (0.0008) [2023-12-28 05:28:49,398][106225] Updated weights for policy 1, policy_version 1425315 (0.0009) [2023-12-28 05:28:49,465][106225] Updated weights for policy 1, policy_version 1425325 (0.0006) [2023-12-28 05:28:49,534][106225] Updated weights for policy 1, policy_version 1425335 (0.0005) [2023-12-28 05:28:49,944][106226] Updated weights for policy 0, policy_version 1422100 (0.0008) [2023-12-28 05:28:50,011][106226] Updated weights for policy 0, policy_version 1422110 (0.0006) [2023-12-28 05:28:50,081][106226] Updated weights for policy 0, policy_version 1422120 (0.0006) [2023-12-28 05:28:50,134][106225] Updated weights for policy 1, policy_version 1425345 (0.0007) [2023-12-28 05:28:50,188][106225] Updated weights for policy 1, policy_version 1425355 (0.0006) [2023-12-28 05:28:50,251][106225] Updated weights for policy 1, policy_version 1425365 (0.0008) [2023-12-28 05:28:50,726][106226] Updated weights for policy 0, policy_version 1422130 (0.0006) [2023-12-28 05:28:50,797][106226] Updated weights for policy 0, policy_version 1422140 (0.0008) [2023-12-28 05:28:50,864][106226] Updated weights for policy 0, policy_version 1422150 (0.0008) [2023-12-28 05:28:50,934][106226] Updated weights for policy 0, policy_version 1422160 (0.0008) [2023-12-28 05:28:50,967][106225] Updated weights for policy 1, policy_version 1425375 (0.0011) [2023-12-28 05:28:51,033][106225] Updated weights for policy 1, policy_version 1425385 (0.0011) [2023-12-28 05:28:51,094][106225] Updated weights for policy 1, policy_version 1425395 (0.0010) [2023-12-28 05:28:51,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 729096192. Throughput: 0: 10091.3, 1: 9899.3. Samples: 729099692. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:51,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.877')] [2023-12-28 05:28:51,693][106226] Updated weights for policy 0, policy_version 1422170 (0.0008) [2023-12-28 05:28:51,759][106226] Updated weights for policy 0, policy_version 1422180 (0.0010) [2023-12-28 05:28:51,815][106225] Updated weights for policy 1, policy_version 1425405 (0.0011) [2023-12-28 05:28:51,819][106226] Updated weights for policy 0, policy_version 1422190 (0.0008) [2023-12-28 05:28:51,873][106225] Updated weights for policy 1, policy_version 1425415 (0.0010) [2023-12-28 05:28:51,929][106225] Updated weights for policy 1, policy_version 1425425 (0.0011) [2023-12-28 05:28:52,581][106226] Updated weights for policy 0, policy_version 1422200 (0.0008) [2023-12-28 05:28:52,635][106226] Updated weights for policy 0, policy_version 1422210 (0.0008) [2023-12-28 05:28:52,696][106226] Updated weights for policy 0, policy_version 1422220 (0.0008) [2023-12-28 05:28:52,747][106225] Updated weights for policy 1, policy_version 1425435 (0.0011) [2023-12-28 05:28:52,814][106225] Updated weights for policy 1, policy_version 1425445 (0.0011) [2023-12-28 05:28:52,879][106225] Updated weights for policy 1, policy_version 1425455 (0.0007) [2023-12-28 05:28:53,327][106226] Updated weights for policy 0, policy_version 1422230 (0.0006) [2023-12-28 05:28:53,381][106226] Updated weights for policy 0, policy_version 1422240 (0.0005) [2023-12-28 05:28:53,410][106225] Updated weights for policy 1, policy_version 1425465 (0.0005) [2023-12-28 05:28:53,446][106226] Updated weights for policy 0, policy_version 1422250 (0.0006) [2023-12-28 05:28:53,469][106225] Updated weights for policy 1, policy_version 1425475 (0.0007) [2023-12-28 05:28:53,520][106225] Updated weights for policy 1, policy_version 1425485 (0.0010) [2023-12-28 05:28:53,563][106225] Updated weights for policy 1, policy_version 1425495 (0.0010) [2023-12-28 05:28:54,013][106226] Updated weights for policy 0, policy_version 1422260 (0.0005) [2023-12-28 05:28:54,059][106226] Updated weights for policy 0, policy_version 1422270 (0.0005) [2023-12-28 05:28:54,117][106226] Updated weights for policy 0, policy_version 1422280 (0.0005) [2023-12-28 05:28:54,180][106225] Updated weights for policy 1, policy_version 1425505 (0.0010) [2023-12-28 05:28:54,263][106225] Updated weights for policy 1, policy_version 1425515 (0.0010) [2023-12-28 05:28:54,315][106225] Updated weights for policy 1, policy_version 1425525 (0.0010) [2023-12-28 05:28:54,702][106226] Updated weights for policy 0, policy_version 1422290 (0.0006) [2023-12-28 05:28:54,749][106226] Updated weights for policy 0, policy_version 1422300 (0.0005) [2023-12-28 05:28:54,795][106226] Updated weights for policy 0, policy_version 1422310 (0.0005) [2023-12-28 05:28:54,841][106226] Updated weights for policy 0, policy_version 1422320 (0.0005) [2023-12-28 05:28:55,037][106225] Updated weights for policy 1, policy_version 1425535 (0.0010) [2023-12-28 05:28:55,098][106225] Updated weights for policy 1, policy_version 1425545 (0.0007) [2023-12-28 05:28:55,160][106225] Updated weights for policy 1, policy_version 1425555 (0.0009) [2023-12-28 05:28:55,472][106226] Updated weights for policy 0, policy_version 1422330 (0.0005) [2023-12-28 05:28:55,537][106226] Updated weights for policy 0, policy_version 1422340 (0.0005) [2023-12-28 05:28:55,598][106226] Updated weights for policy 0, policy_version 1422350 (0.0008) [2023-12-28 05:28:55,865][106225] Updated weights for policy 1, policy_version 1425565 (0.0007) [2023-12-28 05:28:55,917][106225] Updated weights for policy 1, policy_version 1425575 (0.0005) [2023-12-28 05:28:55,980][106225] Updated weights for policy 1, policy_version 1425585 (0.0005) [2023-12-28 05:28:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 729194496. Throughput: 0: 10099.3, 1: 9869.1. Samples: 729160544. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:28:56,176][105115] Avg episode reward: [(0, '-4.866'), (1, '-4.638')] [2023-12-28 05:28:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001425592_365002752.pth... [2023-12-28 05:28:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001422352_364191744.pth... [2023-12-28 05:28:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001424408_364699648.pth [2023-12-28 05:28:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001421168_363888640.pth [2023-12-28 05:28:56,332][106226] Updated weights for policy 0, policy_version 1422360 (0.0008) [2023-12-28 05:28:56,388][106226] Updated weights for policy 0, policy_version 1422370 (0.0007) [2023-12-28 05:28:56,448][106226] Updated weights for policy 0, policy_version 1422380 (0.0007) [2023-12-28 05:28:56,553][106225] Updated weights for policy 1, policy_version 1425595 (0.0007) [2023-12-28 05:28:56,599][106225] Updated weights for policy 1, policy_version 1425605 (0.0010) [2023-12-28 05:28:56,645][106225] Updated weights for policy 1, policy_version 1425615 (0.0010) [2023-12-28 05:28:56,992][106226] Updated weights for policy 0, policy_version 1422390 (0.0007) [2023-12-28 05:28:57,050][106226] Updated weights for policy 0, policy_version 1422400 (0.0008) [2023-12-28 05:28:57,102][106226] Updated weights for policy 0, policy_version 1422410 (0.0008) [2023-12-28 05:28:57,370][106225] Updated weights for policy 1, policy_version 1425625 (0.0010) [2023-12-28 05:28:57,436][106225] Updated weights for policy 1, policy_version 1425635 (0.0010) [2023-12-28 05:28:57,499][106225] Updated weights for policy 1, policy_version 1425645 (0.0010) [2023-12-28 05:28:57,550][106225] Updated weights for policy 1, policy_version 1425655 (0.0010) [2023-12-28 05:28:57,835][106226] Updated weights for policy 0, policy_version 1422420 (0.0008) [2023-12-28 05:28:57,900][106226] Updated weights for policy 0, policy_version 1422430 (0.0007) [2023-12-28 05:28:57,959][106226] Updated weights for policy 0, policy_version 1422440 (0.0007) [2023-12-28 05:28:58,203][106225] Updated weights for policy 1, policy_version 1425665 (0.0006) [2023-12-28 05:28:58,266][106225] Updated weights for policy 1, policy_version 1425675 (0.0009) [2023-12-28 05:28:58,330][106225] Updated weights for policy 1, policy_version 1425685 (0.0008) [2023-12-28 05:28:58,748][106226] Updated weights for policy 0, policy_version 1422450 (0.0009) [2023-12-28 05:28:58,814][106226] Updated weights for policy 0, policy_version 1422460 (0.0007) [2023-12-28 05:28:58,892][106226] Updated weights for policy 0, policy_version 1422470 (0.0008) [2023-12-28 05:28:58,952][106226] Updated weights for policy 0, policy_version 1422480 (0.0007) [2023-12-28 05:28:59,130][106225] Updated weights for policy 1, policy_version 1425695 (0.0008) [2023-12-28 05:28:59,189][106225] Updated weights for policy 1, policy_version 1425705 (0.0008) [2023-12-28 05:28:59,260][106225] Updated weights for policy 1, policy_version 1425715 (0.0008) [2023-12-28 05:28:59,711][106226] Updated weights for policy 0, policy_version 1422490 (0.0008) [2023-12-28 05:28:59,778][106226] Updated weights for policy 0, policy_version 1422500 (0.0009) [2023-12-28 05:28:59,846][106226] Updated weights for policy 0, policy_version 1422510 (0.0009) [2023-12-28 05:28:59,976][106225] Updated weights for policy 1, policy_version 1425725 (0.0007) [2023-12-28 05:29:00,046][106225] Updated weights for policy 1, policy_version 1425735 (0.0007) [2023-12-28 05:29:00,111][106225] Updated weights for policy 1, policy_version 1425745 (0.0007) [2023-12-28 05:29:00,587][106226] Updated weights for policy 0, policy_version 1422520 (0.0009) [2023-12-28 05:29:00,645][106226] Updated weights for policy 0, policy_version 1422530 (0.0008) [2023-12-28 05:29:00,701][106226] Updated weights for policy 0, policy_version 1422540 (0.0008) [2023-12-28 05:29:00,817][106225] Updated weights for policy 1, policy_version 1425755 (0.0009) [2023-12-28 05:29:00,868][106225] Updated weights for policy 1, policy_version 1425765 (0.0008) [2023-12-28 05:29:00,929][106225] Updated weights for policy 1, policy_version 1425775 (0.0009) [2023-12-28 05:29:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 729292800. Throughput: 0: 10140.8, 1: 9934.4. Samples: 729280452. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:01,175][105115] Avg episode reward: [(0, '-4.975'), (1, '-4.579')] [2023-12-28 05:29:01,424][106226] Updated weights for policy 0, policy_version 1422550 (0.0007) [2023-12-28 05:29:01,470][106226] Updated weights for policy 0, policy_version 1422560 (0.0005) [2023-12-28 05:29:01,529][106226] Updated weights for policy 0, policy_version 1422570 (0.0006) [2023-12-28 05:29:01,688][106225] Updated weights for policy 1, policy_version 1425785 (0.0010) [2023-12-28 05:29:01,755][106225] Updated weights for policy 1, policy_version 1425795 (0.0008) [2023-12-28 05:29:01,810][106225] Updated weights for policy 1, policy_version 1425805 (0.0009) [2023-12-28 05:29:01,860][106225] Updated weights for policy 1, policy_version 1425815 (0.0009) [2023-12-28 05:29:02,255][106226] Updated weights for policy 0, policy_version 1422580 (0.0009) [2023-12-28 05:29:02,323][106226] Updated weights for policy 0, policy_version 1422590 (0.0008) [2023-12-28 05:29:02,397][106226] Updated weights for policy 0, policy_version 1422600 (0.0014) [2023-12-28 05:29:02,613][106225] Updated weights for policy 1, policy_version 1425825 (0.0008) [2023-12-28 05:29:02,678][106225] Updated weights for policy 1, policy_version 1425835 (0.0009) [2023-12-28 05:29:02,737][106225] Updated weights for policy 1, policy_version 1425845 (0.0007) [2023-12-28 05:29:03,096][106226] Updated weights for policy 0, policy_version 1422610 (0.0009) [2023-12-28 05:29:03,154][106226] Updated weights for policy 0, policy_version 1422620 (0.0008) [2023-12-28 05:29:03,209][106226] Updated weights for policy 0, policy_version 1422630 (0.0006) [2023-12-28 05:29:03,260][106226] Updated weights for policy 0, policy_version 1422640 (0.0005) [2023-12-28 05:29:03,435][106225] Updated weights for policy 1, policy_version 1425855 (0.0007) [2023-12-28 05:29:03,497][106225] Updated weights for policy 1, policy_version 1425865 (0.0008) [2023-12-28 05:29:03,558][106225] Updated weights for policy 1, policy_version 1425875 (0.0008) [2023-12-28 05:29:03,956][106226] Updated weights for policy 0, policy_version 1422650 (0.0011) [2023-12-28 05:29:04,017][106226] Updated weights for policy 0, policy_version 1422660 (0.0010) [2023-12-28 05:29:04,077][106226] Updated weights for policy 0, policy_version 1422670 (0.0010) [2023-12-28 05:29:04,262][106225] Updated weights for policy 1, policy_version 1425885 (0.0008) [2023-12-28 05:29:04,311][106225] Updated weights for policy 1, policy_version 1425895 (0.0008) [2023-12-28 05:29:04,359][106225] Updated weights for policy 1, policy_version 1425905 (0.0005) [2023-12-28 05:29:04,736][106226] Updated weights for policy 0, policy_version 1422680 (0.0011) [2023-12-28 05:29:04,798][106226] Updated weights for policy 0, policy_version 1422690 (0.0010) [2023-12-28 05:29:04,855][106226] Updated weights for policy 0, policy_version 1422700 (0.0010) [2023-12-28 05:29:05,069][106225] Updated weights for policy 1, policy_version 1425915 (0.0007) [2023-12-28 05:29:05,124][106225] Updated weights for policy 1, policy_version 1425925 (0.0009) [2023-12-28 05:29:05,178][106225] Updated weights for policy 1, policy_version 1425935 (0.0009) [2023-12-28 05:29:05,439][106226] Updated weights for policy 0, policy_version 1422710 (0.0007) [2023-12-28 05:29:05,505][106226] Updated weights for policy 0, policy_version 1422720 (0.0009) [2023-12-28 05:29:05,567][106226] Updated weights for policy 0, policy_version 1422730 (0.0010) [2023-12-28 05:29:05,967][106225] Updated weights for policy 1, policy_version 1425945 (0.0009) [2023-12-28 05:29:06,013][106225] Updated weights for policy 1, policy_version 1425955 (0.0007) [2023-12-28 05:29:06,059][106225] Updated weights for policy 1, policy_version 1425965 (0.0005) [2023-12-28 05:29:06,121][106225] Updated weights for policy 1, policy_version 1425975 (0.0008) [2023-12-28 05:29:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 729391104. Throughput: 0: 10153.1, 1: 9898.7. Samples: 729398668. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:06,175][105115] Avg episode reward: [(0, '-4.954'), (1, '-4.788')] [2023-12-28 05:29:06,230][106226] Updated weights for policy 0, policy_version 1422740 (0.0009) [2023-12-28 05:29:06,292][106226] Updated weights for policy 0, policy_version 1422750 (0.0009) [2023-12-28 05:29:06,349][106226] Updated weights for policy 0, policy_version 1422760 (0.0010) [2023-12-28 05:29:06,906][106225] Updated weights for policy 1, policy_version 1425985 (0.0006) [2023-12-28 05:29:06,971][106225] Updated weights for policy 1, policy_version 1425995 (0.0008) [2023-12-28 05:29:07,032][106225] Updated weights for policy 1, policy_version 1426005 (0.0006) [2023-12-28 05:29:07,055][106226] Updated weights for policy 0, policy_version 1422770 (0.0011) [2023-12-28 05:29:07,112][106226] Updated weights for policy 0, policy_version 1422780 (0.0011) [2023-12-28 05:29:07,173][106226] Updated weights for policy 0, policy_version 1422790 (0.0011) [2023-12-28 05:29:07,230][106226] Updated weights for policy 0, policy_version 1422800 (0.0011) [2023-12-28 05:29:07,606][106225] Updated weights for policy 1, policy_version 1426015 (0.0007) [2023-12-28 05:29:07,667][106225] Updated weights for policy 1, policy_version 1426025 (0.0008) [2023-12-28 05:29:07,730][106225] Updated weights for policy 1, policy_version 1426035 (0.0007) [2023-12-28 05:29:07,947][106226] Updated weights for policy 0, policy_version 1422810 (0.0010) [2023-12-28 05:29:08,009][106226] Updated weights for policy 0, policy_version 1422820 (0.0010) [2023-12-28 05:29:08,065][106226] Updated weights for policy 0, policy_version 1422830 (0.0010) [2023-12-28 05:29:08,372][106225] Updated weights for policy 1, policy_version 1426045 (0.0008) [2023-12-28 05:29:08,424][106225] Updated weights for policy 1, policy_version 1426055 (0.0006) [2023-12-28 05:29:08,479][106225] Updated weights for policy 1, policy_version 1426065 (0.0005) [2023-12-28 05:29:08,799][106226] Updated weights for policy 0, policy_version 1422840 (0.0011) [2023-12-28 05:29:08,866][106226] Updated weights for policy 0, policy_version 1422850 (0.0011) [2023-12-28 05:29:08,937][106226] Updated weights for policy 0, policy_version 1422860 (0.0011) [2023-12-28 05:29:09,071][106225] Updated weights for policy 1, policy_version 1426075 (0.0006) [2023-12-28 05:29:09,134][106225] Updated weights for policy 1, policy_version 1426085 (0.0006) [2023-12-28 05:29:09,209][106225] Updated weights for policy 1, policy_version 1426095 (0.0006) [2023-12-28 05:29:09,670][106226] Updated weights for policy 0, policy_version 1422870 (0.0011) [2023-12-28 05:29:09,735][106226] Updated weights for policy 0, policy_version 1422880 (0.0007) [2023-12-28 05:29:09,805][106226] Updated weights for policy 0, policy_version 1422890 (0.0009) [2023-12-28 05:29:09,905][106225] Updated weights for policy 1, policy_version 1426105 (0.0007) [2023-12-28 05:29:09,969][106225] Updated weights for policy 1, policy_version 1426115 (0.0009) [2023-12-28 05:29:10,031][106225] Updated weights for policy 1, policy_version 1426125 (0.0007) [2023-12-28 05:29:10,091][106225] Updated weights for policy 1, policy_version 1426135 (0.0007) [2023-12-28 05:29:10,421][106226] Updated weights for policy 0, policy_version 1422900 (0.0008) [2023-12-28 05:29:10,483][106226] Updated weights for policy 0, policy_version 1422910 (0.0009) [2023-12-28 05:29:10,538][106226] Updated weights for policy 0, policy_version 1422920 (0.0007) [2023-12-28 05:29:10,774][106225] Updated weights for policy 1, policy_version 1426145 (0.0009) [2023-12-28 05:29:10,826][106225] Updated weights for policy 1, policy_version 1426155 (0.0008) [2023-12-28 05:29:10,885][106225] Updated weights for policy 1, policy_version 1426165 (0.0009) [2023-12-28 05:29:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 729489408. Throughput: 0: 10117.3, 1: 9975.6. Samples: 729458592. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:11,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-4.616')] [2023-12-28 05:29:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001426168_365150208.pth... [2023-12-28 05:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001422928_364339200.pth... [2023-12-28 05:29:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001424984_364847104.pth [2023-12-28 05:29:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001421776_364044288.pth [2023-12-28 05:29:11,255][106226] Updated weights for policy 0, policy_version 1422930 (0.0008) [2023-12-28 05:29:11,318][106226] Updated weights for policy 0, policy_version 1422940 (0.0008) [2023-12-28 05:29:11,394][106226] Updated weights for policy 0, policy_version 1422950 (0.0009) [2023-12-28 05:29:11,458][106226] Updated weights for policy 0, policy_version 1422960 (0.0008) [2023-12-28 05:29:11,683][106225] Updated weights for policy 1, policy_version 1426175 (0.0008) [2023-12-28 05:29:11,750][106225] Updated weights for policy 1, policy_version 1426185 (0.0009) [2023-12-28 05:29:11,813][106225] Updated weights for policy 1, policy_version 1426195 (0.0010) [2023-12-28 05:29:12,325][106226] Updated weights for policy 0, policy_version 1422970 (0.0007) [2023-12-28 05:29:12,392][106226] Updated weights for policy 0, policy_version 1422980 (0.0008) [2023-12-28 05:29:12,456][106226] Updated weights for policy 0, policy_version 1422990 (0.0008) [2023-12-28 05:29:12,469][106225] Updated weights for policy 1, policy_version 1426205 (0.0009) [2023-12-28 05:29:12,530][106225] Updated weights for policy 1, policy_version 1426215 (0.0010) [2023-12-28 05:29:12,596][106225] Updated weights for policy 1, policy_version 1426225 (0.0007) [2023-12-28 05:29:13,186][106226] Updated weights for policy 0, policy_version 1423000 (0.0007) [2023-12-28 05:29:13,238][106226] Updated weights for policy 0, policy_version 1423010 (0.0008) [2023-12-28 05:29:13,281][106225] Updated weights for policy 1, policy_version 1426235 (0.0005) [2023-12-28 05:29:13,292][106226] Updated weights for policy 0, policy_version 1423020 (0.0009) [2023-12-28 05:29:13,336][106225] Updated weights for policy 1, policy_version 1426245 (0.0006) [2023-12-28 05:29:13,391][106225] Updated weights for policy 1, policy_version 1426255 (0.0009) [2023-12-28 05:29:13,916][106226] Updated weights for policy 0, policy_version 1423030 (0.0005) [2023-12-28 05:29:13,966][106226] Updated weights for policy 0, policy_version 1423040 (0.0005) [2023-12-28 05:29:14,017][106226] Updated weights for policy 0, policy_version 1423050 (0.0005) [2023-12-28 05:29:14,206][106225] Updated weights for policy 1, policy_version 1426265 (0.0008) [2023-12-28 05:29:14,258][106225] Updated weights for policy 1, policy_version 1426275 (0.0008) [2023-12-28 05:29:14,307][106225] Updated weights for policy 1, policy_version 1426285 (0.0007) [2023-12-28 05:29:14,352][106225] Updated weights for policy 1, policy_version 1426295 (0.0007) [2023-12-28 05:29:14,621][106226] Updated weights for policy 0, policy_version 1423060 (0.0007) [2023-12-28 05:29:14,676][106226] Updated weights for policy 0, policy_version 1423070 (0.0007) [2023-12-28 05:29:14,738][106226] Updated weights for policy 0, policy_version 1423080 (0.0005) [2023-12-28 05:29:15,069][106225] Updated weights for policy 1, policy_version 1426305 (0.0010) [2023-12-28 05:29:15,117][106225] Updated weights for policy 1, policy_version 1426315 (0.0009) [2023-12-28 05:29:15,164][106225] Updated weights for policy 1, policy_version 1426325 (0.0005) [2023-12-28 05:29:15,441][106226] Updated weights for policy 0, policy_version 1423090 (0.0007) [2023-12-28 05:29:15,499][106226] Updated weights for policy 0, policy_version 1423100 (0.0011) [2023-12-28 05:29:15,562][106226] Updated weights for policy 0, policy_version 1423110 (0.0009) [2023-12-28 05:29:15,626][106226] Updated weights for policy 0, policy_version 1423120 (0.0009) [2023-12-28 05:29:15,870][106225] Updated weights for policy 1, policy_version 1426335 (0.0008) [2023-12-28 05:29:15,920][106225] Updated weights for policy 1, policy_version 1426345 (0.0007) [2023-12-28 05:29:15,983][106225] Updated weights for policy 1, policy_version 1426355 (0.0007) [2023-12-28 05:29:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 729587712. Throughput: 0: 9993.4, 1: 9903.4. Samples: 729575168. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:16,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-4.721')] [2023-12-28 05:29:16,280][106226] Updated weights for policy 0, policy_version 1423130 (0.0010) [2023-12-28 05:29:16,346][106226] Updated weights for policy 0, policy_version 1423140 (0.0010) [2023-12-28 05:29:16,408][106226] Updated weights for policy 0, policy_version 1423150 (0.0010) [2023-12-28 05:29:16,693][106225] Updated weights for policy 1, policy_version 1426365 (0.0008) [2023-12-28 05:29:16,740][106225] Updated weights for policy 1, policy_version 1426375 (0.0008) [2023-12-28 05:29:16,797][106225] Updated weights for policy 1, policy_version 1426385 (0.0008) [2023-12-28 05:29:17,022][106226] Updated weights for policy 0, policy_version 1423160 (0.0009) [2023-12-28 05:29:17,083][106226] Updated weights for policy 0, policy_version 1423170 (0.0009) [2023-12-28 05:29:17,135][106226] Updated weights for policy 0, policy_version 1423180 (0.0009) [2023-12-28 05:29:17,584][106225] Updated weights for policy 1, policy_version 1426395 (0.0007) [2023-12-28 05:29:17,638][106225] Updated weights for policy 1, policy_version 1426405 (0.0007) [2023-12-28 05:29:17,699][106225] Updated weights for policy 1, policy_version 1426415 (0.0009) [2023-12-28 05:29:17,809][106226] Updated weights for policy 0, policy_version 1423190 (0.0009) [2023-12-28 05:29:17,872][106226] Updated weights for policy 0, policy_version 1423200 (0.0009) [2023-12-28 05:29:17,927][106226] Updated weights for policy 0, policy_version 1423210 (0.0005) [2023-12-28 05:29:18,412][106225] Updated weights for policy 1, policy_version 1426425 (0.0008) [2023-12-28 05:29:18,473][106225] Updated weights for policy 1, policy_version 1426435 (0.0007) [2023-12-28 05:29:18,535][106225] Updated weights for policy 1, policy_version 1426445 (0.0008) [2023-12-28 05:29:18,590][106225] Updated weights for policy 1, policy_version 1426455 (0.0008) [2023-12-28 05:29:18,593][106226] Updated weights for policy 0, policy_version 1423220 (0.0006) [2023-12-28 05:29:18,644][106226] Updated weights for policy 0, policy_version 1423230 (0.0007) [2023-12-28 05:29:18,697][106226] Updated weights for policy 0, policy_version 1423240 (0.0007) [2023-12-28 05:29:19,351][106225] Updated weights for policy 1, policy_version 1426465 (0.0008) [2023-12-28 05:29:19,413][106225] Updated weights for policy 1, policy_version 1426475 (0.0005) [2023-12-28 05:29:19,472][106225] Updated weights for policy 1, policy_version 1426485 (0.0006) [2023-12-28 05:29:19,498][106226] Updated weights for policy 0, policy_version 1423250 (0.0009) [2023-12-28 05:29:19,561][106226] Updated weights for policy 0, policy_version 1423260 (0.0009) [2023-12-28 05:29:19,619][106226] Updated weights for policy 0, policy_version 1423270 (0.0010) [2023-12-28 05:29:20,226][106225] Updated weights for policy 1, policy_version 1426495 (0.0006) [2023-12-28 05:29:20,282][106225] Updated weights for policy 1, policy_version 1426505 (0.0006) [2023-12-28 05:29:20,345][106225] Updated weights for policy 1, policy_version 1426515 (0.0008) [2023-12-28 05:29:20,423][106226] Updated weights for policy 0, policy_version 1423281 (0.0009) [2023-12-28 05:29:20,482][106226] Updated weights for policy 0, policy_version 1423291 (0.0011) [2023-12-28 05:29:20,544][106226] Updated weights for policy 0, policy_version 1423301 (0.0011) [2023-12-28 05:29:20,614][106226] Updated weights for policy 0, policy_version 1423311 (0.0011) [2023-12-28 05:29:21,121][106225] Updated weights for policy 1, policy_version 1426525 (0.0008) [2023-12-28 05:29:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 729677824. Throughput: 0: 9955.9, 1: 9887.2. Samples: 729691236. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:21,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-4.897')] [2023-12-28 05:29:21,183][106225] Updated weights for policy 1, policy_version 1426535 (0.0008) [2023-12-28 05:29:21,240][106225] Updated weights for policy 1, policy_version 1426545 (0.0008) [2023-12-28 05:29:21,387][106226] Updated weights for policy 0, policy_version 1423321 (0.0014) [2023-12-28 05:29:21,450][106226] Updated weights for policy 0, policy_version 1423331 (0.0007) [2023-12-28 05:29:21,506][106226] Updated weights for policy 0, policy_version 1423341 (0.0006) [2023-12-28 05:29:22,061][106225] Updated weights for policy 1, policy_version 1426555 (0.0008) [2023-12-28 05:29:22,121][106225] Updated weights for policy 1, policy_version 1426565 (0.0008) [2023-12-28 05:29:22,172][106225] Updated weights for policy 1, policy_version 1426575 (0.0009) [2023-12-28 05:29:22,227][106226] Updated weights for policy 0, policy_version 1423351 (0.0006) [2023-12-28 05:29:22,287][106226] Updated weights for policy 0, policy_version 1423361 (0.0009) [2023-12-28 05:29:22,350][106226] Updated weights for policy 0, policy_version 1423371 (0.0008) [2023-12-28 05:29:22,844][106225] Updated weights for policy 1, policy_version 1426585 (0.0008) [2023-12-28 05:29:22,910][106225] Updated weights for policy 1, policy_version 1426595 (0.0008) [2023-12-28 05:29:22,975][106225] Updated weights for policy 1, policy_version 1426605 (0.0008) [2023-12-28 05:29:23,037][106225] Updated weights for policy 1, policy_version 1426615 (0.0008) [2023-12-28 05:29:23,112][106226] Updated weights for policy 0, policy_version 1423381 (0.0007) [2023-12-28 05:29:23,163][106226] Updated weights for policy 0, policy_version 1423391 (0.0005) [2023-12-28 05:29:23,221][106226] Updated weights for policy 0, policy_version 1423401 (0.0007) [2023-12-28 05:29:23,742][106225] Updated weights for policy 1, policy_version 1426625 (0.0008) [2023-12-28 05:29:23,797][106225] Updated weights for policy 1, policy_version 1426635 (0.0007) [2023-12-28 05:29:23,847][106226] Updated weights for policy 0, policy_version 1423411 (0.0005) [2023-12-28 05:29:23,857][106225] Updated weights for policy 1, policy_version 1426645 (0.0008) [2023-12-28 05:29:23,898][106226] Updated weights for policy 0, policy_version 1423421 (0.0005) [2023-12-28 05:29:23,957][106226] Updated weights for policy 0, policy_version 1423431 (0.0005) [2023-12-28 05:29:24,506][106226] Updated weights for policy 0, policy_version 1423441 (0.0005) [2023-12-28 05:29:24,563][106226] Updated weights for policy 0, policy_version 1423451 (0.0008) [2023-12-28 05:29:24,614][106226] Updated weights for policy 0, policy_version 1423461 (0.0008) [2023-12-28 05:29:24,642][106225] Updated weights for policy 1, policy_version 1426655 (0.0007) [2023-12-28 05:29:24,661][106226] Updated weights for policy 0, policy_version 1423471 (0.0009) [2023-12-28 05:29:24,690][106225] Updated weights for policy 1, policy_version 1426665 (0.0005) [2023-12-28 05:29:24,746][106225] Updated weights for policy 1, policy_version 1426675 (0.0005) [2023-12-28 05:29:25,343][106225] Updated weights for policy 1, policy_version 1426685 (0.0009) [2023-12-28 05:29:25,395][106225] Updated weights for policy 1, policy_version 1426695 (0.0010) [2023-12-28 05:29:25,445][106225] Updated weights for policy 1, policy_version 1426705 (0.0010) [2023-12-28 05:29:25,460][106226] Updated weights for policy 0, policy_version 1423481 (0.0010) [2023-12-28 05:29:25,517][106226] Updated weights for policy 0, policy_version 1423491 (0.0007) [2023-12-28 05:29:25,583][106226] Updated weights for policy 0, policy_version 1423501 (0.0008) [2023-12-28 05:29:26,125][106225] Updated weights for policy 1, policy_version 1426715 (0.0010) [2023-12-28 05:29:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 729776128. Throughput: 0: 9949.5, 1: 9883.3. Samples: 729749464. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:26,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-4.878')] [2023-12-28 05:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001423504_364486656.pth... [2023-12-28 05:29:26,181][106225] Updated weights for policy 1, policy_version 1426725 (0.0009) [2023-12-28 05:29:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001422352_364191744.pth [2023-12-28 05:29:26,226][106225] Updated weights for policy 1, policy_version 1426735 (0.0008) [2023-12-28 05:29:26,272][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001426744_365297664.pth... [2023-12-28 05:29:26,275][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001425592_365002752.pth [2023-12-28 05:29:26,282][106226] Updated weights for policy 0, policy_version 1423511 (0.0009) [2023-12-28 05:29:26,330][106226] Updated weights for policy 0, policy_version 1423521 (0.0008) [2023-12-28 05:29:26,377][106226] Updated weights for policy 0, policy_version 1423531 (0.0008) [2023-12-28 05:29:26,881][106225] Updated weights for policy 1, policy_version 1426745 (0.0008) [2023-12-28 05:29:26,934][106225] Updated weights for policy 1, policy_version 1426755 (0.0005) [2023-12-28 05:29:26,987][106225] Updated weights for policy 1, policy_version 1426765 (0.0005) [2023-12-28 05:29:27,045][106225] Updated weights for policy 1, policy_version 1426775 (0.0005) [2023-12-28 05:29:27,126][106226] Updated weights for policy 0, policy_version 1423541 (0.0009) [2023-12-28 05:29:27,187][106226] Updated weights for policy 0, policy_version 1423551 (0.0007) [2023-12-28 05:29:27,238][106226] Updated weights for policy 0, policy_version 1423561 (0.0009) [2023-12-28 05:29:27,628][106225] Updated weights for policy 1, policy_version 1426785 (0.0007) [2023-12-28 05:29:27,683][106225] Updated weights for policy 1, policy_version 1426795 (0.0005) [2023-12-28 05:29:27,743][106225] Updated weights for policy 1, policy_version 1426805 (0.0005) [2023-12-28 05:29:27,925][106226] Updated weights for policy 0, policy_version 1423571 (0.0008) [2023-12-28 05:29:27,989][106226] Updated weights for policy 0, policy_version 1423581 (0.0005) [2023-12-28 05:29:28,045][106226] Updated weights for policy 0, policy_version 1423591 (0.0005) [2023-12-28 05:29:28,285][106225] Updated weights for policy 1, policy_version 1426815 (0.0005) [2023-12-28 05:29:28,356][106225] Updated weights for policy 1, policy_version 1426825 (0.0007) [2023-12-28 05:29:28,413][106225] Updated weights for policy 1, policy_version 1426835 (0.0008) [2023-12-28 05:29:28,652][106226] Updated weights for policy 0, policy_version 1423601 (0.0006) [2023-12-28 05:29:28,716][106226] Updated weights for policy 0, policy_version 1423611 (0.0011) [2023-12-28 05:29:28,784][106226] Updated weights for policy 0, policy_version 1423621 (0.0011) [2023-12-28 05:29:28,848][106226] Updated weights for policy 0, policy_version 1423631 (0.0011) [2023-12-28 05:29:29,151][106225] Updated weights for policy 1, policy_version 1426845 (0.0008) [2023-12-28 05:29:29,211][106225] Updated weights for policy 1, policy_version 1426855 (0.0007) [2023-12-28 05:29:29,282][106225] Updated weights for policy 1, policy_version 1426865 (0.0008) [2023-12-28 05:29:29,456][106226] Updated weights for policy 0, policy_version 1423641 (0.0010) [2023-12-28 05:29:29,529][106226] Updated weights for policy 0, policy_version 1423651 (0.0011) [2023-12-28 05:29:29,598][106226] Updated weights for policy 0, policy_version 1423661 (0.0011) [2023-12-28 05:29:29,949][106225] Updated weights for policy 1, policy_version 1426875 (0.0008) [2023-12-28 05:29:30,015][106225] Updated weights for policy 1, policy_version 1426885 (0.0008) [2023-12-28 05:29:30,074][106225] Updated weights for policy 1, policy_version 1426895 (0.0008) [2023-12-28 05:29:30,278][106226] Updated weights for policy 0, policy_version 1423671 (0.0008) [2023-12-28 05:29:30,343][106226] Updated weights for policy 0, policy_version 1423681 (0.0009) [2023-12-28 05:29:30,399][106226] Updated weights for policy 0, policy_version 1423691 (0.0008) [2023-12-28 05:29:30,812][106225] Updated weights for policy 1, policy_version 1426905 (0.0008) [2023-12-28 05:29:30,871][106225] Updated weights for policy 1, policy_version 1426915 (0.0007) [2023-12-28 05:29:30,929][106225] Updated weights for policy 1, policy_version 1426925 (0.0008) [2023-12-28 05:29:30,983][106225] Updated weights for policy 1, policy_version 1426935 (0.0007) [2023-12-28 05:29:31,012][106226] Updated weights for policy 0, policy_version 1423701 (0.0007) [2023-12-28 05:29:31,075][106226] Updated weights for policy 0, policy_version 1423711 (0.0009) [2023-12-28 05:29:31,139][106226] Updated weights for policy 0, policy_version 1423721 (0.0010) [2023-12-28 05:29:31,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 729882624. Throughput: 0: 10010.9, 1: 9923.2. Samples: 729873236. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:31,175][105115] Avg episode reward: [(0, '-5.109'), (1, '-4.861')] [2023-12-28 05:29:31,723][106225] Updated weights for policy 1, policy_version 1426945 (0.0010) [2023-12-28 05:29:31,793][106225] Updated weights for policy 1, policy_version 1426955 (0.0006) [2023-12-28 05:29:31,856][106225] Updated weights for policy 1, policy_version 1426965 (0.0007) [2023-12-28 05:29:31,863][106226] Updated weights for policy 0, policy_version 1423731 (0.0009) [2023-12-28 05:29:31,922][106226] Updated weights for policy 0, policy_version 1423741 (0.0009) [2023-12-28 05:29:31,978][106226] Updated weights for policy 0, policy_version 1423751 (0.0009) [2023-12-28 05:29:32,580][106225] Updated weights for policy 1, policy_version 1426975 (0.0010) [2023-12-28 05:29:32,653][106225] Updated weights for policy 1, policy_version 1426985 (0.0009) [2023-12-28 05:29:32,703][106226] Updated weights for policy 0, policy_version 1423761 (0.0009) [2023-12-28 05:29:32,719][106225] Updated weights for policy 1, policy_version 1426995 (0.0008) [2023-12-28 05:29:32,753][106226] Updated weights for policy 0, policy_version 1423771 (0.0007) [2023-12-28 05:29:32,812][106226] Updated weights for policy 0, policy_version 1423781 (0.0006) [2023-12-28 05:29:32,880][106226] Updated weights for policy 0, policy_version 1423791 (0.0008) [2023-12-28 05:29:33,359][106225] Updated weights for policy 1, policy_version 1427005 (0.0006) [2023-12-28 05:29:33,413][106225] Updated weights for policy 1, policy_version 1427015 (0.0007) [2023-12-28 05:29:33,456][106226] Updated weights for policy 0, policy_version 1423801 (0.0005) [2023-12-28 05:29:33,467][106225] Updated weights for policy 1, policy_version 1427025 (0.0008) [2023-12-28 05:29:33,508][106226] Updated weights for policy 0, policy_version 1423811 (0.0005) [2023-12-28 05:29:33,564][106226] Updated weights for policy 0, policy_version 1423821 (0.0006) [2023-12-28 05:29:34,110][106226] Updated weights for policy 0, policy_version 1423831 (0.0007) [2023-12-28 05:29:34,169][106226] Updated weights for policy 0, policy_version 1423841 (0.0008) [2023-12-28 05:29:34,193][106225] Updated weights for policy 1, policy_version 1427035 (0.0006) [2023-12-28 05:29:34,236][106226] Updated weights for policy 0, policy_version 1423851 (0.0006) [2023-12-28 05:29:34,257][106225] Updated weights for policy 1, policy_version 1427045 (0.0006) [2023-12-28 05:29:34,328][106225] Updated weights for policy 1, policy_version 1427055 (0.0008) [2023-12-28 05:29:34,921][106226] Updated weights for policy 0, policy_version 1423861 (0.0005) [2023-12-28 05:29:34,938][106225] Updated weights for policy 1, policy_version 1427065 (0.0008) [2023-12-28 05:29:34,980][106226] Updated weights for policy 0, policy_version 1423871 (0.0010) [2023-12-28 05:29:34,991][106225] Updated weights for policy 1, policy_version 1427075 (0.0005) [2023-12-28 05:29:35,033][106226] Updated weights for policy 0, policy_version 1423881 (0.0007) [2023-12-28 05:29:35,056][106225] Updated weights for policy 1, policy_version 1427085 (0.0007) [2023-12-28 05:29:35,108][106225] Updated weights for policy 1, policy_version 1427095 (0.0008) [2023-12-28 05:29:35,590][106226] Updated weights for policy 0, policy_version 1423891 (0.0006) [2023-12-28 05:29:35,651][106226] Updated weights for policy 0, policy_version 1423901 (0.0008) [2023-12-28 05:29:35,708][106226] Updated weights for policy 0, policy_version 1423911 (0.0008) [2023-12-28 05:29:35,809][106225] Updated weights for policy 1, policy_version 1427105 (0.0006) [2023-12-28 05:29:35,868][106225] Updated weights for policy 1, policy_version 1427115 (0.0005) [2023-12-28 05:29:35,928][106225] Updated weights for policy 1, policy_version 1427125 (0.0008) [2023-12-28 05:29:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 729989120. Throughput: 0: 10049.7, 1: 9860.2. Samples: 729995636. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:36,175][105115] Avg episode reward: [(0, '-4.762'), (1, '-4.745')] [2023-12-28 05:29:36,533][106226] Updated weights for policy 0, policy_version 1423921 (0.0010) [2023-12-28 05:29:36,564][106225] Updated weights for policy 1, policy_version 1427135 (0.0010) [2023-12-28 05:29:36,599][106226] Updated weights for policy 0, policy_version 1423931 (0.0007) [2023-12-28 05:29:36,612][106225] Updated weights for policy 1, policy_version 1427145 (0.0008) [2023-12-28 05:29:36,662][106226] Updated weights for policy 0, policy_version 1423941 (0.0010) [2023-12-28 05:29:36,677][106225] Updated weights for policy 1, policy_version 1427155 (0.0010) [2023-12-28 05:29:36,722][106226] Updated weights for policy 0, policy_version 1423951 (0.0006) [2023-12-28 05:29:37,359][106225] Updated weights for policy 1, policy_version 1427165 (0.0010) [2023-12-28 05:29:37,416][106225] Updated weights for policy 1, policy_version 1427175 (0.0010) [2023-12-28 05:29:37,476][106225] Updated weights for policy 1, policy_version 1427185 (0.0010) [2023-12-28 05:29:37,482][106226] Updated weights for policy 0, policy_version 1423961 (0.0006) [2023-12-28 05:29:37,541][106226] Updated weights for policy 0, policy_version 1423971 (0.0007) [2023-12-28 05:29:37,596][106226] Updated weights for policy 0, policy_version 1423981 (0.0008) [2023-12-28 05:29:38,141][106225] Updated weights for policy 1, policy_version 1427195 (0.0009) [2023-12-28 05:29:38,200][106225] Updated weights for policy 1, policy_version 1427205 (0.0005) [2023-12-28 05:29:38,260][106225] Updated weights for policy 1, policy_version 1427215 (0.0006) [2023-12-28 05:29:38,305][106226] Updated weights for policy 0, policy_version 1423991 (0.0007) [2023-12-28 05:29:38,386][106226] Updated weights for policy 0, policy_version 1424001 (0.0007) [2023-12-28 05:29:38,455][106226] Updated weights for policy 0, policy_version 1424011 (0.0008) [2023-12-28 05:29:38,960][106225] Updated weights for policy 1, policy_version 1427225 (0.0010) [2023-12-28 05:29:39,020][106225] Updated weights for policy 1, policy_version 1427235 (0.0005) [2023-12-28 05:29:39,083][106225] Updated weights for policy 1, policy_version 1427245 (0.0006) [2023-12-28 05:29:39,102][106226] Updated weights for policy 0, policy_version 1424021 (0.0008) [2023-12-28 05:29:39,140][106225] Updated weights for policy 1, policy_version 1427255 (0.0005) [2023-12-28 05:29:39,161][106226] Updated weights for policy 0, policy_version 1424031 (0.0008) [2023-12-28 05:29:39,227][106226] Updated weights for policy 0, policy_version 1424041 (0.0009) [2023-12-28 05:29:39,851][106225] Updated weights for policy 1, policy_version 1427265 (0.0007) [2023-12-28 05:29:39,914][106225] Updated weights for policy 1, policy_version 1427275 (0.0007) [2023-12-28 05:29:39,930][106226] Updated weights for policy 0, policy_version 1424051 (0.0009) [2023-12-28 05:29:39,976][106225] Updated weights for policy 1, policy_version 1427285 (0.0006) [2023-12-28 05:29:39,989][106226] Updated weights for policy 0, policy_version 1424061 (0.0009) [2023-12-28 05:29:40,048][106226] Updated weights for policy 0, policy_version 1424071 (0.0008) [2023-12-28 05:29:40,681][106225] Updated weights for policy 1, policy_version 1427295 (0.0008) [2023-12-28 05:29:40,739][106225] Updated weights for policy 1, policy_version 1427305 (0.0009) [2023-12-28 05:29:40,788][106226] Updated weights for policy 0, policy_version 1424081 (0.0009) [2023-12-28 05:29:40,799][106225] Updated weights for policy 1, policy_version 1427315 (0.0007) [2023-12-28 05:29:40,855][106226] Updated weights for policy 0, policy_version 1424091 (0.0006) [2023-12-28 05:29:40,921][106226] Updated weights for policy 0, policy_version 1424101 (0.0007) [2023-12-28 05:29:40,978][106226] Updated weights for policy 0, policy_version 1424111 (0.0009) [2023-12-28 05:29:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19799.7). Total num frames: 730087424. Throughput: 0: 10002.6, 1: 9882.7. Samples: 730055380. Policy #0 lag: (min: 20.0, avg: 33.7, max: 52.0) [2023-12-28 05:29:41,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-4.985')] [2023-12-28 05:29:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001427320_365445120.pth... [2023-12-28 05:29:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001424112_364642304.pth... [2023-12-28 05:29:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001422928_364339200.pth [2023-12-28 05:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001426168_365150208.pth [2023-12-28 05:29:41,540][106225] Updated weights for policy 1, policy_version 1427325 (0.0007) [2023-12-28 05:29:41,609][106225] Updated weights for policy 1, policy_version 1427335 (0.0007) [2023-12-28 05:29:41,674][106225] Updated weights for policy 1, policy_version 1427345 (0.0008) [2023-12-28 05:29:41,737][106226] Updated weights for policy 0, policy_version 1424121 (0.0009) [2023-12-28 05:29:41,801][106226] Updated weights for policy 0, policy_version 1424131 (0.0008) [2023-12-28 05:29:41,866][106226] Updated weights for policy 0, policy_version 1424141 (0.0008) [2023-12-28 05:29:42,469][106225] Updated weights for policy 1, policy_version 1427355 (0.0007) [2023-12-28 05:29:42,535][106225] Updated weights for policy 1, policy_version 1427365 (0.0006) [2023-12-28 05:29:42,559][106226] Updated weights for policy 0, policy_version 1424151 (0.0007) [2023-12-28 05:29:42,594][106225] Updated weights for policy 1, policy_version 1427375 (0.0009) [2023-12-28 05:29:42,624][106226] Updated weights for policy 0, policy_version 1424161 (0.0006) [2023-12-28 05:29:42,689][106226] Updated weights for policy 0, policy_version 1424171 (0.0006) [2023-12-28 05:29:43,229][106225] Updated weights for policy 1, policy_version 1427385 (0.0010) [2023-12-28 05:29:43,278][106225] Updated weights for policy 1, policy_version 1427395 (0.0005) [2023-12-28 05:29:43,335][106225] Updated weights for policy 1, policy_version 1427405 (0.0005) [2023-12-28 05:29:43,381][106225] Updated weights for policy 1, policy_version 1427415 (0.0005) [2023-12-28 05:29:43,429][106226] Updated weights for policy 0, policy_version 1424181 (0.0006) [2023-12-28 05:29:43,486][106226] Updated weights for policy 0, policy_version 1424191 (0.0006) [2023-12-28 05:29:43,544][106226] Updated weights for policy 0, policy_version 1424201 (0.0006) [2023-12-28 05:29:43,942][106225] Updated weights for policy 1, policy_version 1427425 (0.0005) [2023-12-28 05:29:43,991][106225] Updated weights for policy 1, policy_version 1427435 (0.0005) [2023-12-28 05:29:44,042][106225] Updated weights for policy 1, policy_version 1427445 (0.0006) [2023-12-28 05:29:44,166][106226] Updated weights for policy 0, policy_version 1424211 (0.0007) [2023-12-28 05:29:44,225][106226] Updated weights for policy 0, policy_version 1424221 (0.0007) [2023-12-28 05:29:44,270][106226] Updated weights for policy 0, policy_version 1424231 (0.0005) [2023-12-28 05:29:44,629][106225] Updated weights for policy 1, policy_version 1427455 (0.0005) [2023-12-28 05:29:44,687][106225] Updated weights for policy 1, policy_version 1427465 (0.0006) [2023-12-28 05:29:44,742][106225] Updated weights for policy 1, policy_version 1427475 (0.0007) [2023-12-28 05:29:44,992][106226] Updated weights for policy 0, policy_version 1424241 (0.0006) [2023-12-28 05:29:45,062][106226] Updated weights for policy 0, policy_version 1424251 (0.0009) [2023-12-28 05:29:45,122][106226] Updated weights for policy 0, policy_version 1424261 (0.0009) [2023-12-28 05:29:45,185][106226] Updated weights for policy 0, policy_version 1424271 (0.0008) [2023-12-28 05:29:45,411][106225] Updated weights for policy 1, policy_version 1427485 (0.0009) [2023-12-28 05:29:45,469][106225] Updated weights for policy 1, policy_version 1427495 (0.0006) [2023-12-28 05:29:45,523][106225] Updated weights for policy 1, policy_version 1427505 (0.0008) [2023-12-28 05:29:45,957][106226] Updated weights for policy 0, policy_version 1424281 (0.0009) [2023-12-28 05:29:46,011][106226] Updated weights for policy 0, policy_version 1424291 (0.0009) [2023-12-28 05:29:46,076][106226] Updated weights for policy 0, policy_version 1424301 (0.0009) [2023-12-28 05:29:46,109][106225] Updated weights for policy 1, policy_version 1427515 (0.0009) [2023-12-28 05:29:46,160][106225] Updated weights for policy 1, policy_version 1427525 (0.0008) [2023-12-28 05:29:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 730185728. Throughput: 0: 9958.9, 1: 9913.2. Samples: 730174696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:29:46,175][105115] Avg episode reward: [(0, '-5.040'), (1, '-4.617')] [2023-12-28 05:29:46,208][106225] Updated weights for policy 1, policy_version 1427535 (0.0008) [2023-12-28 05:29:46,853][106225] Updated weights for policy 1, policy_version 1427545 (0.0009) [2023-12-28 05:29:46,875][106226] Updated weights for policy 0, policy_version 1424311 (0.0008) [2023-12-28 05:29:46,902][106225] Updated weights for policy 1, policy_version 1427555 (0.0007) [2023-12-28 05:29:46,938][106226] Updated weights for policy 0, policy_version 1424321 (0.0009) [2023-12-28 05:29:46,959][106225] Updated weights for policy 1, policy_version 1427565 (0.0005) [2023-12-28 05:29:46,996][106226] Updated weights for policy 0, policy_version 1424331 (0.0006) [2023-12-28 05:29:47,022][106225] Updated weights for policy 1, policy_version 1427575 (0.0007) [2023-12-28 05:29:47,709][106225] Updated weights for policy 1, policy_version 1427585 (0.0008) [2023-12-28 05:29:47,719][106226] Updated weights for policy 0, policy_version 1424341 (0.0009) [2023-12-28 05:29:47,759][106225] Updated weights for policy 1, policy_version 1427595 (0.0007) [2023-12-28 05:29:47,767][106226] Updated weights for policy 0, policy_version 1424351 (0.0007) [2023-12-28 05:29:47,812][106225] Updated weights for policy 1, policy_version 1427605 (0.0006) [2023-12-28 05:29:47,821][106226] Updated weights for policy 0, policy_version 1424361 (0.0008) [2023-12-28 05:29:48,410][106225] Updated weights for policy 1, policy_version 1427615 (0.0007) [2023-12-28 05:29:48,461][106225] Updated weights for policy 1, policy_version 1427625 (0.0008) [2023-12-28 05:29:48,517][106225] Updated weights for policy 1, policy_version 1427635 (0.0008) [2023-12-28 05:29:48,606][106226] Updated weights for policy 0, policy_version 1424371 (0.0009) [2023-12-28 05:29:48,665][106226] Updated weights for policy 0, policy_version 1424381 (0.0009) [2023-12-28 05:29:48,726][106226] Updated weights for policy 0, policy_version 1424391 (0.0008) [2023-12-28 05:29:49,357][106225] Updated weights for policy 1, policy_version 1427645 (0.0009) [2023-12-28 05:29:49,408][106225] Updated weights for policy 1, policy_version 1427655 (0.0009) [2023-12-28 05:29:49,435][106226] Updated weights for policy 0, policy_version 1424401 (0.0009) [2023-12-28 05:29:49,452][106225] Updated weights for policy 1, policy_version 1427665 (0.0008) [2023-12-28 05:29:49,491][106226] Updated weights for policy 0, policy_version 1424411 (0.0007) [2023-12-28 05:29:49,547][106226] Updated weights for policy 0, policy_version 1424421 (0.0008) [2023-12-28 05:29:49,608][106226] Updated weights for policy 0, policy_version 1424431 (0.0009) [2023-12-28 05:29:50,204][106225] Updated weights for policy 1, policy_version 1427675 (0.0007) [2023-12-28 05:29:50,268][106225] Updated weights for policy 1, policy_version 1427685 (0.0009) [2023-12-28 05:29:50,320][106225] Updated weights for policy 1, policy_version 1427695 (0.0009) [2023-12-28 05:29:50,331][106226] Updated weights for policy 0, policy_version 1424441 (0.0007) [2023-12-28 05:29:50,399][106226] Updated weights for policy 0, policy_version 1424451 (0.0007) [2023-12-28 05:29:50,458][106226] Updated weights for policy 0, policy_version 1424461 (0.0011) [2023-12-28 05:29:51,027][106225] Updated weights for policy 1, policy_version 1427705 (0.0007) [2023-12-28 05:29:51,098][106225] Updated weights for policy 1, policy_version 1427715 (0.0009) [2023-12-28 05:29:51,172][106225] Updated weights for policy 1, policy_version 1427725 (0.0008) [2023-12-28 05:29:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 730275840. Throughput: 0: 9837.4, 1: 9992.1. Samples: 730290996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:29:51,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.810')] [2023-12-28 05:29:51,206][106226] Updated weights for policy 0, policy_version 1424471 (0.0008) [2023-12-28 05:29:51,231][106225] Updated weights for policy 1, policy_version 1427735 (0.0006) [2023-12-28 05:29:51,275][106226] Updated weights for policy 0, policy_version 1424481 (0.0008) [2023-12-28 05:29:51,351][106226] Updated weights for policy 0, policy_version 1424491 (0.0009) [2023-12-28 05:29:51,947][106225] Updated weights for policy 1, policy_version 1427745 (0.0008) [2023-12-28 05:29:52,008][106225] Updated weights for policy 1, policy_version 1427755 (0.0008) [2023-12-28 05:29:52,075][106225] Updated weights for policy 1, policy_version 1427765 (0.0009) [2023-12-28 05:29:52,104][106226] Updated weights for policy 0, policy_version 1424501 (0.0008) [2023-12-28 05:29:52,168][106226] Updated weights for policy 0, policy_version 1424511 (0.0009) [2023-12-28 05:29:52,231][106226] Updated weights for policy 0, policy_version 1424521 (0.0008) [2023-12-28 05:29:52,769][106225] Updated weights for policy 1, policy_version 1427775 (0.0008) [2023-12-28 05:29:52,828][106225] Updated weights for policy 1, policy_version 1427785 (0.0008) [2023-12-28 05:29:52,877][106225] Updated weights for policy 1, policy_version 1427795 (0.0007) [2023-12-28 05:29:53,038][106226] Updated weights for policy 0, policy_version 1424531 (0.0009) [2023-12-28 05:29:53,095][106226] Updated weights for policy 0, policy_version 1424541 (0.0007) [2023-12-28 05:29:53,149][106226] Updated weights for policy 0, policy_version 1424551 (0.0005) [2023-12-28 05:29:53,659][106225] Updated weights for policy 1, policy_version 1427805 (0.0008) [2023-12-28 05:29:53,714][106225] Updated weights for policy 1, policy_version 1427815 (0.0008) [2023-12-28 05:29:53,769][106226] Updated weights for policy 0, policy_version 1424561 (0.0006) [2023-12-28 05:29:53,772][106225] Updated weights for policy 1, policy_version 1427825 (0.0008) [2023-12-28 05:29:53,815][106226] Updated weights for policy 0, policy_version 1424571 (0.0005) [2023-12-28 05:29:53,877][106226] Updated weights for policy 0, policy_version 1424581 (0.0005) [2023-12-28 05:29:53,934][106226] Updated weights for policy 0, policy_version 1424591 (0.0005) [2023-12-28 05:29:54,532][106225] Updated weights for policy 1, policy_version 1427835 (0.0008) [2023-12-28 05:29:54,595][106225] Updated weights for policy 1, policy_version 1427845 (0.0010) [2023-12-28 05:29:54,624][106226] Updated weights for policy 0, policy_version 1424601 (0.0007) [2023-12-28 05:29:54,648][106225] Updated weights for policy 1, policy_version 1427855 (0.0006) [2023-12-28 05:29:54,680][106226] Updated weights for policy 0, policy_version 1424611 (0.0008) [2023-12-28 05:29:54,744][106226] Updated weights for policy 0, policy_version 1424621 (0.0010) [2023-12-28 05:29:55,308][106225] Updated weights for policy 1, policy_version 1427865 (0.0006) [2023-12-28 05:29:55,357][106225] Updated weights for policy 1, policy_version 1427875 (0.0008) [2023-12-28 05:29:55,403][106225] Updated weights for policy 1, policy_version 1427885 (0.0007) [2023-12-28 05:29:55,406][106226] Updated weights for policy 0, policy_version 1424631 (0.0006) [2023-12-28 05:29:55,456][106225] Updated weights for policy 1, policy_version 1427895 (0.0005) [2023-12-28 05:29:55,466][106226] Updated weights for policy 0, policy_version 1424641 (0.0005) [2023-12-28 05:29:55,532][106226] Updated weights for policy 0, policy_version 1424651 (0.0005) [2023-12-28 05:29:56,065][106225] Updated weights for policy 1, policy_version 1427905 (0.0006) [2023-12-28 05:29:56,134][106225] Updated weights for policy 1, policy_version 1427915 (0.0007) [2023-12-28 05:29:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 730374144. Throughput: 0: 9840.1, 1: 9943.9. Samples: 730348872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:29:56,175][105115] Avg episode reward: [(0, '-4.955'), (1, '-4.852')] [2023-12-28 05:29:56,203][106225] Updated weights for policy 1, policy_version 1427925 (0.0007) [2023-12-28 05:29:56,211][106226] Updated weights for policy 0, policy_version 1424661 (0.0006) [2023-12-28 05:29:56,218][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001427928_365600768.pth... [2023-12-28 05:29:56,223][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001426744_365297664.pth [2023-12-28 05:29:56,270][106226] Updated weights for policy 0, policy_version 1424671 (0.0008) [2023-12-28 05:29:56,338][106226] Updated weights for policy 0, policy_version 1424681 (0.0009) [2023-12-28 05:29:56,382][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001424688_364789760.pth... [2023-12-28 05:29:56,386][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001423504_364486656.pth [2023-12-28 05:29:56,761][106225] Updated weights for policy 1, policy_version 1427935 (0.0008) [2023-12-28 05:29:56,834][106225] Updated weights for policy 1, policy_version 1427945 (0.0008) [2023-12-28 05:29:56,885][106225] Updated weights for policy 1, policy_version 1427955 (0.0005) [2023-12-28 05:29:56,988][106226] Updated weights for policy 0, policy_version 1424691 (0.0010) [2023-12-28 05:29:57,045][106226] Updated weights for policy 0, policy_version 1424701 (0.0010) [2023-12-28 05:29:57,098][106226] Updated weights for policy 0, policy_version 1424711 (0.0010) [2023-12-28 05:29:57,509][106225] Updated weights for policy 1, policy_version 1427965 (0.0006) [2023-12-28 05:29:57,565][106225] Updated weights for policy 1, policy_version 1427975 (0.0008) [2023-12-28 05:29:57,619][106225] Updated weights for policy 1, policy_version 1427985 (0.0008) [2023-12-28 05:29:57,735][106226] Updated weights for policy 0, policy_version 1424721 (0.0010) [2023-12-28 05:29:57,785][106226] Updated weights for policy 0, policy_version 1424731 (0.0005) [2023-12-28 05:29:57,836][106226] Updated weights for policy 0, policy_version 1424741 (0.0005) [2023-12-28 05:29:57,892][106226] Updated weights for policy 0, policy_version 1424751 (0.0008) [2023-12-28 05:29:58,371][106225] Updated weights for policy 1, policy_version 1427995 (0.0009) [2023-12-28 05:29:58,441][106225] Updated weights for policy 1, policy_version 1428005 (0.0009) [2023-12-28 05:29:58,510][106225] Updated weights for policy 1, policy_version 1428015 (0.0008) [2023-12-28 05:29:58,607][106226] Updated weights for policy 0, policy_version 1424761 (0.0009) [2023-12-28 05:29:58,666][106226] Updated weights for policy 0, policy_version 1424771 (0.0008) [2023-12-28 05:29:58,732][106226] Updated weights for policy 0, policy_version 1424781 (0.0008) [2023-12-28 05:29:59,326][106225] Updated weights for policy 1, policy_version 1428025 (0.0008) [2023-12-28 05:29:59,398][106225] Updated weights for policy 1, policy_version 1428035 (0.0008) [2023-12-28 05:29:59,467][106225] Updated weights for policy 1, policy_version 1428045 (0.0008) [2023-12-28 05:29:59,526][106225] Updated weights for policy 1, policy_version 1428055 (0.0008) [2023-12-28 05:29:59,639][106226] Updated weights for policy 0, policy_version 1424791 (0.0007) [2023-12-28 05:29:59,708][106226] Updated weights for policy 0, policy_version 1424801 (0.0006) [2023-12-28 05:29:59,767][106226] Updated weights for policy 0, policy_version 1424811 (0.0005) [2023-12-28 05:30:00,270][106225] Updated weights for policy 1, policy_version 1428065 (0.0008) [2023-12-28 05:30:00,324][106225] Updated weights for policy 1, policy_version 1428075 (0.0008) [2023-12-28 05:30:00,386][106225] Updated weights for policy 1, policy_version 1428085 (0.0009) [2023-12-28 05:30:00,403][106226] Updated weights for policy 0, policy_version 1424821 (0.0008) [2023-12-28 05:30:00,451][106226] Updated weights for policy 0, policy_version 1424831 (0.0008) [2023-12-28 05:30:00,503][106226] Updated weights for policy 0, policy_version 1424841 (0.0008) [2023-12-28 05:30:01,149][106225] Updated weights for policy 1, policy_version 1428095 (0.0009) [2023-12-28 05:30:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 730472448. Throughput: 0: 9856.0, 1: 9994.5. Samples: 730468440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:01,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.831')] [2023-12-28 05:30:01,208][106225] Updated weights for policy 1, policy_version 1428105 (0.0008) [2023-12-28 05:30:01,264][106226] Updated weights for policy 0, policy_version 1424851 (0.0008) [2023-12-28 05:30:01,269][106225] Updated weights for policy 1, policy_version 1428115 (0.0009) [2023-12-28 05:30:01,325][106226] Updated weights for policy 0, policy_version 1424861 (0.0007) [2023-12-28 05:30:01,396][106226] Updated weights for policy 0, policy_version 1424871 (0.0009) [2023-12-28 05:30:01,981][106225] Updated weights for policy 1, policy_version 1428125 (0.0006) [2023-12-28 05:30:02,046][106225] Updated weights for policy 1, policy_version 1428135 (0.0008) [2023-12-28 05:30:02,075][106226] Updated weights for policy 0, policy_version 1424881 (0.0007) [2023-12-28 05:30:02,106][106225] Updated weights for policy 1, policy_version 1428145 (0.0006) [2023-12-28 05:30:02,134][106226] Updated weights for policy 0, policy_version 1424891 (0.0007) [2023-12-28 05:30:02,193][106226] Updated weights for policy 0, policy_version 1424901 (0.0005) [2023-12-28 05:30:02,251][106226] Updated weights for policy 0, policy_version 1424911 (0.0005) [2023-12-28 05:30:02,811][106225] Updated weights for policy 1, policy_version 1428155 (0.0008) [2023-12-28 05:30:02,821][106226] Updated weights for policy 0, policy_version 1424921 (0.0008) [2023-12-28 05:30:02,868][106225] Updated weights for policy 1, policy_version 1428165 (0.0010) [2023-12-28 05:30:02,879][106226] Updated weights for policy 0, policy_version 1424931 (0.0006) [2023-12-28 05:30:02,922][106225] Updated weights for policy 1, policy_version 1428175 (0.0010) [2023-12-28 05:30:02,930][106226] Updated weights for policy 0, policy_version 1424941 (0.0005) [2023-12-28 05:30:03,481][106226] Updated weights for policy 0, policy_version 1424951 (0.0007) [2023-12-28 05:30:03,534][106226] Updated weights for policy 0, policy_version 1424961 (0.0007) [2023-12-28 05:30:03,591][106226] Updated weights for policy 0, policy_version 1424971 (0.0005) [2023-12-28 05:30:03,680][106225] Updated weights for policy 1, policy_version 1428185 (0.0010) [2023-12-28 05:30:03,732][106225] Updated weights for policy 1, policy_version 1428195 (0.0009) [2023-12-28 05:30:03,783][106225] Updated weights for policy 1, policy_version 1428206 (0.0010) [2023-12-28 05:30:03,831][106225] Updated weights for policy 1, policy_version 1428216 (0.0007) [2023-12-28 05:30:04,215][106226] Updated weights for policy 0, policy_version 1424981 (0.0007) [2023-12-28 05:30:04,285][106226] Updated weights for policy 0, policy_version 1424991 (0.0006) [2023-12-28 05:30:04,350][106226] Updated weights for policy 0, policy_version 1425001 (0.0008) [2023-12-28 05:30:04,655][106225] Updated weights for policy 1, policy_version 1428226 (0.0009) [2023-12-28 05:30:04,711][106225] Updated weights for policy 1, policy_version 1428236 (0.0009) [2023-12-28 05:30:04,770][106225] Updated weights for policy 1, policy_version 1428246 (0.0008) [2023-12-28 05:30:05,037][106226] Updated weights for policy 0, policy_version 1425011 (0.0009) [2023-12-28 05:30:05,091][106226] Updated weights for policy 0, policy_version 1425021 (0.0008) [2023-12-28 05:30:05,149][106226] Updated weights for policy 0, policy_version 1425031 (0.0008) [2023-12-28 05:30:05,506][106225] Updated weights for policy 1, policy_version 1428256 (0.0008) [2023-12-28 05:30:05,574][106225] Updated weights for policy 1, policy_version 1428266 (0.0009) [2023-12-28 05:30:05,644][106225] Updated weights for policy 1, policy_version 1428276 (0.0010) [2023-12-28 05:30:05,843][106226] Updated weights for policy 0, policy_version 1425041 (0.0009) [2023-12-28 05:30:05,898][106226] Updated weights for policy 0, policy_version 1425051 (0.0009) [2023-12-28 05:30:05,950][106226] Updated weights for policy 0, policy_version 1425061 (0.0008) [2023-12-28 05:30:05,994][106226] Updated weights for policy 0, policy_version 1425071 (0.0008) [2023-12-28 05:30:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 730578944. Throughput: 0: 9933.4, 1: 9971.1. Samples: 730586936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:06,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.851')] [2023-12-28 05:30:06,360][106225] Updated weights for policy 1, policy_version 1428286 (0.0009) [2023-12-28 05:30:06,414][106225] Updated weights for policy 1, policy_version 1428296 (0.0009) [2023-12-28 05:30:06,465][106225] Updated weights for policy 1, policy_version 1428306 (0.0008) [2023-12-28 05:30:06,766][106226] Updated weights for policy 0, policy_version 1425081 (0.0008) [2023-12-28 05:30:06,823][106226] Updated weights for policy 0, policy_version 1425091 (0.0009) [2023-12-28 05:30:06,882][106226] Updated weights for policy 0, policy_version 1425101 (0.0008) [2023-12-28 05:30:07,215][106225] Updated weights for policy 1, policy_version 1428316 (0.0009) [2023-12-28 05:30:07,280][106225] Updated weights for policy 1, policy_version 1428326 (0.0009) [2023-12-28 05:30:07,347][106225] Updated weights for policy 1, policy_version 1428336 (0.0009) [2023-12-28 05:30:07,647][106226] Updated weights for policy 0, policy_version 1425111 (0.0008) [2023-12-28 05:30:07,714][106226] Updated weights for policy 0, policy_version 1425121 (0.0005) [2023-12-28 05:30:07,777][106226] Updated weights for policy 0, policy_version 1425131 (0.0009) [2023-12-28 05:30:08,105][106225] Updated weights for policy 1, policy_version 1428346 (0.0008) [2023-12-28 05:30:08,166][106225] Updated weights for policy 1, policy_version 1428356 (0.0008) [2023-12-28 05:30:08,223][106225] Updated weights for policy 1, policy_version 1428366 (0.0008) [2023-12-28 05:30:08,280][106225] Updated weights for policy 1, policy_version 1428376 (0.0008) [2023-12-28 05:30:08,450][106226] Updated weights for policy 0, policy_version 1425141 (0.0010) [2023-12-28 05:30:08,511][106226] Updated weights for policy 0, policy_version 1425151 (0.0009) [2023-12-28 05:30:08,575][106226] Updated weights for policy 0, policy_version 1425161 (0.0009) [2023-12-28 05:30:09,042][106225] Updated weights for policy 1, policy_version 1428386 (0.0008) [2023-12-28 05:30:09,089][106225] Updated weights for policy 1, policy_version 1428396 (0.0010) [2023-12-28 05:30:09,145][106225] Updated weights for policy 1, policy_version 1428406 (0.0009) [2023-12-28 05:30:09,373][106226] Updated weights for policy 0, policy_version 1425171 (0.0009) [2023-12-28 05:30:09,443][106226] Updated weights for policy 0, policy_version 1425181 (0.0009) [2023-12-28 05:30:09,506][106226] Updated weights for policy 0, policy_version 1425191 (0.0009) [2023-12-28 05:30:09,962][106225] Updated weights for policy 1, policy_version 1428416 (0.0008) [2023-12-28 05:30:10,031][106225] Updated weights for policy 1, policy_version 1428426 (0.0011) [2023-12-28 05:30:10,097][106225] Updated weights for policy 1, policy_version 1428436 (0.0010) [2023-12-28 05:30:10,279][106226] Updated weights for policy 0, policy_version 1425201 (0.0009) [2023-12-28 05:30:10,345][106226] Updated weights for policy 0, policy_version 1425211 (0.0010) [2023-12-28 05:30:10,413][106226] Updated weights for policy 0, policy_version 1425221 (0.0008) [2023-12-28 05:30:10,476][106226] Updated weights for policy 0, policy_version 1425231 (0.0009) [2023-12-28 05:30:10,770][106225] Updated weights for policy 1, policy_version 1428446 (0.0009) [2023-12-28 05:30:10,820][106225] Updated weights for policy 1, policy_version 1428456 (0.0010) [2023-12-28 05:30:10,875][106225] Updated weights for policy 1, policy_version 1428466 (0.0006) [2023-12-28 05:30:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 730669056. Throughput: 0: 9902.4, 1: 9969.1. Samples: 730643684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:11,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-4.792')] [2023-12-28 05:30:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001428472_365740032.pth... [2023-12-28 05:30:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001427320_365445120.pth [2023-12-28 05:30:11,236][106226] Updated weights for policy 0, policy_version 1425241 (0.0007) [2023-12-28 05:30:11,307][106226] Updated weights for policy 0, policy_version 1425251 (0.0008) [2023-12-28 05:30:11,381][106226] Updated weights for policy 0, policy_version 1425261 (0.0008) [2023-12-28 05:30:11,409][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001425264_364937216.pth... [2023-12-28 05:30:11,414][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001424112_364642304.pth [2023-12-28 05:30:11,637][106225] Updated weights for policy 1, policy_version 1428476 (0.0007) [2023-12-28 05:30:11,716][106225] Updated weights for policy 1, policy_version 1428486 (0.0007) [2023-12-28 05:30:11,795][106225] Updated weights for policy 1, policy_version 1428496 (0.0009) [2023-12-28 05:30:12,186][106226] Updated weights for policy 0, policy_version 1425271 (0.0008) [2023-12-28 05:30:12,241][106226] Updated weights for policy 0, policy_version 1425281 (0.0008) [2023-12-28 05:30:12,307][106226] Updated weights for policy 0, policy_version 1425291 (0.0007) [2023-12-28 05:30:12,590][106225] Updated weights for policy 1, policy_version 1428506 (0.0007) [2023-12-28 05:30:12,663][106225] Updated weights for policy 1, policy_version 1428516 (0.0008) [2023-12-28 05:30:12,728][106225] Updated weights for policy 1, policy_version 1428526 (0.0008) [2023-12-28 05:30:12,797][106225] Updated weights for policy 1, policy_version 1428536 (0.0009) [2023-12-28 05:30:12,999][106226] Updated weights for policy 0, policy_version 1425301 (0.0008) [2023-12-28 05:30:13,057][106226] Updated weights for policy 0, policy_version 1425311 (0.0011) [2023-12-28 05:30:13,116][106226] Updated weights for policy 0, policy_version 1425321 (0.0009) [2023-12-28 05:30:13,503][106225] Updated weights for policy 1, policy_version 1428546 (0.0008) [2023-12-28 05:30:13,559][106225] Updated weights for policy 1, policy_version 1428556 (0.0007) [2023-12-28 05:30:13,612][106225] Updated weights for policy 1, policy_version 1428566 (0.0009) [2023-12-28 05:30:13,808][106226] Updated weights for policy 0, policy_version 1425331 (0.0011) [2023-12-28 05:30:13,862][106226] Updated weights for policy 0, policy_version 1425341 (0.0008) [2023-12-28 05:30:13,922][106226] Updated weights for policy 0, policy_version 1425351 (0.0008) [2023-12-28 05:30:14,333][106225] Updated weights for policy 1, policy_version 1428576 (0.0008) [2023-12-28 05:30:14,387][106225] Updated weights for policy 1, policy_version 1428586 (0.0007) [2023-12-28 05:30:14,443][106225] Updated weights for policy 1, policy_version 1428596 (0.0008) [2023-12-28 05:30:14,499][106226] Updated weights for policy 0, policy_version 1425361 (0.0006) [2023-12-28 05:30:14,553][106226] Updated weights for policy 0, policy_version 1425371 (0.0010) [2023-12-28 05:30:14,607][106226] Updated weights for policy 0, policy_version 1425381 (0.0011) [2023-12-28 05:30:14,668][106226] Updated weights for policy 0, policy_version 1425391 (0.0011) [2023-12-28 05:30:15,225][106225] Updated weights for policy 1, policy_version 1428606 (0.0009) [2023-12-28 05:30:15,283][106225] Updated weights for policy 1, policy_version 1428616 (0.0010) [2023-12-28 05:30:15,341][106225] Updated weights for policy 1, policy_version 1428626 (0.0011) [2023-12-28 05:30:15,403][106226] Updated weights for policy 0, policy_version 1425401 (0.0006) [2023-12-28 05:30:15,463][106226] Updated weights for policy 0, policy_version 1425411 (0.0008) [2023-12-28 05:30:15,526][106226] Updated weights for policy 0, policy_version 1425421 (0.0009) [2023-12-28 05:30:16,073][106225] Updated weights for policy 1, policy_version 1428636 (0.0011) [2023-12-28 05:30:16,131][106225] Updated weights for policy 1, policy_version 1428646 (0.0010) [2023-12-28 05:30:16,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 730759168. Throughput: 0: 9819.4, 1: 9797.7. Samples: 730756008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:16,175][105115] Avg episode reward: [(0, '-4.918'), (1, '-4.808')] [2023-12-28 05:30:16,187][106225] Updated weights for policy 1, policy_version 1428656 (0.0009) [2023-12-28 05:30:16,225][106226] Updated weights for policy 0, policy_version 1425431 (0.0006) [2023-12-28 05:30:16,276][106226] Updated weights for policy 0, policy_version 1425441 (0.0006) [2023-12-28 05:30:16,329][106226] Updated weights for policy 0, policy_version 1425451 (0.0008) [2023-12-28 05:30:16,867][106225] Updated weights for policy 1, policy_version 1428666 (0.0009) [2023-12-28 05:30:16,914][106225] Updated weights for policy 1, policy_version 1428676 (0.0005) [2023-12-28 05:30:16,970][106225] Updated weights for policy 1, policy_version 1428686 (0.0006) [2023-12-28 05:30:17,036][106225] Updated weights for policy 1, policy_version 1428696 (0.0006) [2023-12-28 05:30:17,069][106226] Updated weights for policy 0, policy_version 1425461 (0.0009) [2023-12-28 05:30:17,121][106226] Updated weights for policy 0, policy_version 1425471 (0.0006) [2023-12-28 05:30:17,181][106226] Updated weights for policy 0, policy_version 1425481 (0.0005) [2023-12-28 05:30:17,649][106225] Updated weights for policy 1, policy_version 1428706 (0.0005) [2023-12-28 05:30:17,713][106225] Updated weights for policy 1, policy_version 1428716 (0.0006) [2023-12-28 05:30:17,770][106225] Updated weights for policy 1, policy_version 1428726 (0.0010) [2023-12-28 05:30:17,828][106226] Updated weights for policy 0, policy_version 1425491 (0.0006) [2023-12-28 05:30:17,874][106226] Updated weights for policy 0, policy_version 1425501 (0.0007) [2023-12-28 05:30:17,924][106226] Updated weights for policy 0, policy_version 1425511 (0.0008) [2023-12-28 05:30:18,407][106225] Updated weights for policy 1, policy_version 1428736 (0.0008) [2023-12-28 05:30:18,472][106225] Updated weights for policy 1, policy_version 1428746 (0.0011) [2023-12-28 05:30:18,536][106225] Updated weights for policy 1, policy_version 1428756 (0.0010) [2023-12-28 05:30:18,631][106226] Updated weights for policy 0, policy_version 1425521 (0.0007) [2023-12-28 05:30:18,693][106226] Updated weights for policy 0, policy_version 1425531 (0.0006) [2023-12-28 05:30:18,755][106226] Updated weights for policy 0, policy_version 1425541 (0.0005) [2023-12-28 05:30:18,822][106226] Updated weights for policy 0, policy_version 1425551 (0.0006) [2023-12-28 05:30:19,180][106225] Updated weights for policy 1, policy_version 1428766 (0.0007) [2023-12-28 05:30:19,246][106225] Updated weights for policy 1, policy_version 1428776 (0.0011) [2023-12-28 05:30:19,316][106225] Updated weights for policy 1, policy_version 1428786 (0.0009) [2023-12-28 05:30:19,501][106226] Updated weights for policy 0, policy_version 1425561 (0.0009) [2023-12-28 05:30:19,563][106226] Updated weights for policy 0, policy_version 1425571 (0.0006) [2023-12-28 05:30:19,628][106226] Updated weights for policy 0, policy_version 1425581 (0.0007) [2023-12-28 05:30:20,008][106225] Updated weights for policy 1, policy_version 1428796 (0.0009) [2023-12-28 05:30:20,069][106225] Updated weights for policy 1, policy_version 1428806 (0.0009) [2023-12-28 05:30:20,135][106225] Updated weights for policy 1, policy_version 1428816 (0.0009) [2023-12-28 05:30:20,382][106226] Updated weights for policy 0, policy_version 1425591 (0.0007) [2023-12-28 05:30:20,440][106226] Updated weights for policy 0, policy_version 1425601 (0.0007) [2023-12-28 05:30:20,501][106226] Updated weights for policy 0, policy_version 1425611 (0.0008) [2023-12-28 05:30:20,868][106225] Updated weights for policy 1, policy_version 1428826 (0.0009) [2023-12-28 05:30:20,928][106225] Updated weights for policy 1, policy_version 1428836 (0.0010) [2023-12-28 05:30:20,984][106225] Updated weights for policy 1, policy_version 1428846 (0.0010) [2023-12-28 05:30:21,051][106225] Updated weights for policy 1, policy_version 1428856 (0.0011) [2023-12-28 05:30:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 730865664. Throughput: 0: 9712.6, 1: 9814.5. Samples: 730874360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:21,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.546')] [2023-12-28 05:30:21,289][106226] Updated weights for policy 0, policy_version 1425621 (0.0009) [2023-12-28 05:30:21,358][106226] Updated weights for policy 0, policy_version 1425631 (0.0008) [2023-12-28 05:30:21,430][106226] Updated weights for policy 0, policy_version 1425641 (0.0008) [2023-12-28 05:30:21,848][106225] Updated weights for policy 1, policy_version 1428866 (0.0008) [2023-12-28 05:30:21,904][106225] Updated weights for policy 1, policy_version 1428876 (0.0008) [2023-12-28 05:30:21,962][106225] Updated weights for policy 1, policy_version 1428886 (0.0007) [2023-12-28 05:30:22,135][106226] Updated weights for policy 0, policy_version 1425651 (0.0007) [2023-12-28 05:30:22,198][106226] Updated weights for policy 0, policy_version 1425661 (0.0008) [2023-12-28 05:30:22,259][106226] Updated weights for policy 0, policy_version 1425671 (0.0009) [2023-12-28 05:30:22,705][106225] Updated weights for policy 1, policy_version 1428896 (0.0007) [2023-12-28 05:30:22,766][106225] Updated weights for policy 1, policy_version 1428906 (0.0009) [2023-12-28 05:30:22,831][106225] Updated weights for policy 1, policy_version 1428916 (0.0009) [2023-12-28 05:30:23,028][106226] Updated weights for policy 0, policy_version 1425681 (0.0009) [2023-12-28 05:30:23,084][106226] Updated weights for policy 0, policy_version 1425691 (0.0009) [2023-12-28 05:30:23,143][106226] Updated weights for policy 0, policy_version 1425701 (0.0008) [2023-12-28 05:30:23,199][106226] Updated weights for policy 0, policy_version 1425711 (0.0007) [2023-12-28 05:30:23,556][106225] Updated weights for policy 1, policy_version 1428926 (0.0007) [2023-12-28 05:30:23,599][106225] Updated weights for policy 1, policy_version 1428936 (0.0005) [2023-12-28 05:30:23,648][106225] Updated weights for policy 1, policy_version 1428946 (0.0005) [2023-12-28 05:30:23,935][106226] Updated weights for policy 0, policy_version 1425721 (0.0009) [2023-12-28 05:30:24,000][106226] Updated weights for policy 0, policy_version 1425731 (0.0009) [2023-12-28 05:30:24,064][106226] Updated weights for policy 0, policy_version 1425741 (0.0009) [2023-12-28 05:30:24,321][106225] Updated weights for policy 1, policy_version 1428956 (0.0007) [2023-12-28 05:30:24,378][106225] Updated weights for policy 1, policy_version 1428966 (0.0009) [2023-12-28 05:30:24,429][106225] Updated weights for policy 1, policy_version 1428976 (0.0009) [2023-12-28 05:30:24,768][106226] Updated weights for policy 0, policy_version 1425751 (0.0008) [2023-12-28 05:30:24,825][106226] Updated weights for policy 0, policy_version 1425761 (0.0008) [2023-12-28 05:30:24,872][106226] Updated weights for policy 0, policy_version 1425771 (0.0008) [2023-12-28 05:30:25,095][106225] Updated weights for policy 1, policy_version 1428986 (0.0005) [2023-12-28 05:30:25,152][106225] Updated weights for policy 1, policy_version 1428996 (0.0008) [2023-12-28 05:30:25,206][106225] Updated weights for policy 1, policy_version 1429006 (0.0008) [2023-12-28 05:30:25,255][106225] Updated weights for policy 1, policy_version 1429016 (0.0007) [2023-12-28 05:30:25,630][106226] Updated weights for policy 0, policy_version 1425781 (0.0007) [2023-12-28 05:30:25,691][106226] Updated weights for policy 0, policy_version 1425791 (0.0007) [2023-12-28 05:30:25,753][106226] Updated weights for policy 0, policy_version 1425801 (0.0008) [2023-12-28 05:30:25,921][106225] Updated weights for policy 1, policy_version 1429026 (0.0008) [2023-12-28 05:30:25,969][106225] Updated weights for policy 1, policy_version 1429036 (0.0008) [2023-12-28 05:30:26,015][106225] Updated weights for policy 1, policy_version 1429046 (0.0008) [2023-12-28 05:30:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 730963968. Throughput: 0: 9695.8, 1: 9748.5. Samples: 730930376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:26,175][105115] Avg episode reward: [(0, '-4.894'), (1, '-4.795')] [2023-12-28 05:30:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001425808_365076480.pth... [2023-12-28 05:30:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001429048_365887488.pth... [2023-12-28 05:30:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001424688_364789760.pth [2023-12-28 05:30:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001427928_365600768.pth [2023-12-28 05:30:26,456][106226] Updated weights for policy 0, policy_version 1425812 (0.0008) [2023-12-28 05:30:26,507][106226] Updated weights for policy 0, policy_version 1425822 (0.0008) [2023-12-28 05:30:26,564][106226] Updated weights for policy 0, policy_version 1425832 (0.0009) [2023-12-28 05:30:26,744][106225] Updated weights for policy 1, policy_version 1429056 (0.0009) [2023-12-28 05:30:26,800][106225] Updated weights for policy 1, policy_version 1429066 (0.0009) [2023-12-28 05:30:26,852][106225] Updated weights for policy 1, policy_version 1429076 (0.0009) [2023-12-28 05:30:27,244][106226] Updated weights for policy 0, policy_version 1425842 (0.0008) [2023-12-28 05:30:27,291][106226] Updated weights for policy 0, policy_version 1425852 (0.0005) [2023-12-28 05:30:27,338][106226] Updated weights for policy 0, policy_version 1425862 (0.0008) [2023-12-28 05:30:27,383][106226] Updated weights for policy 0, policy_version 1425872 (0.0008) [2023-12-28 05:30:27,649][106225] Updated weights for policy 1, policy_version 1429086 (0.0007) [2023-12-28 05:30:27,713][106225] Updated weights for policy 1, policy_version 1429096 (0.0006) [2023-12-28 05:30:27,765][106225] Updated weights for policy 1, policy_version 1429106 (0.0006) [2023-12-28 05:30:27,996][106226] Updated weights for policy 0, policy_version 1425882 (0.0008) [2023-12-28 05:30:28,055][106226] Updated weights for policy 0, policy_version 1425892 (0.0008) [2023-12-28 05:30:28,114][106226] Updated weights for policy 0, policy_version 1425902 (0.0008) [2023-12-28 05:30:28,373][106225] Updated weights for policy 1, policy_version 1429116 (0.0009) [2023-12-28 05:30:28,429][106225] Updated weights for policy 1, policy_version 1429126 (0.0008) [2023-12-28 05:30:28,486][106225] Updated weights for policy 1, policy_version 1429136 (0.0007) [2023-12-28 05:30:28,863][106226] Updated weights for policy 0, policy_version 1425912 (0.0008) [2023-12-28 05:30:28,918][106226] Updated weights for policy 0, policy_version 1425922 (0.0008) [2023-12-28 05:30:28,971][106226] Updated weights for policy 0, policy_version 1425932 (0.0008) [2023-12-28 05:30:29,076][106225] Updated weights for policy 1, policy_version 1429146 (0.0007) [2023-12-28 05:30:29,125][106225] Updated weights for policy 1, policy_version 1429156 (0.0007) [2023-12-28 05:30:29,181][106225] Updated weights for policy 1, policy_version 1429166 (0.0005) [2023-12-28 05:30:29,250][106225] Updated weights for policy 1, policy_version 1429176 (0.0006) [2023-12-28 05:30:29,717][106226] Updated weights for policy 0, policy_version 1425942 (0.0010) [2023-12-28 05:30:29,774][106226] Updated weights for policy 0, policy_version 1425952 (0.0010) [2023-12-28 05:30:29,830][106226] Updated weights for policy 0, policy_version 1425962 (0.0009) [2023-12-28 05:30:29,943][106225] Updated weights for policy 1, policy_version 1429186 (0.0008) [2023-12-28 05:30:30,003][106225] Updated weights for policy 1, policy_version 1429196 (0.0008) [2023-12-28 05:30:30,054][106225] Updated weights for policy 1, policy_version 1429206 (0.0008) [2023-12-28 05:30:30,560][106226] Updated weights for policy 0, policy_version 1425972 (0.0008) [2023-12-28 05:30:30,609][106226] Updated weights for policy 0, policy_version 1425982 (0.0007) [2023-12-28 05:30:30,671][106226] Updated weights for policy 0, policy_version 1425992 (0.0008) [2023-12-28 05:30:30,795][106225] Updated weights for policy 1, policy_version 1429216 (0.0008) [2023-12-28 05:30:30,864][106225] Updated weights for policy 1, policy_version 1429226 (0.0006) [2023-12-28 05:30:30,928][106225] Updated weights for policy 1, policy_version 1429236 (0.0006) [2023-12-28 05:30:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 731062272. Throughput: 0: 9724.5, 1: 9756.8. Samples: 731051356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:31,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.710')] [2023-12-28 05:30:31,386][106226] Updated weights for policy 0, policy_version 1426002 (0.0009) [2023-12-28 05:30:31,444][106226] Updated weights for policy 0, policy_version 1426012 (0.0008) [2023-12-28 05:30:31,502][106226] Updated weights for policy 0, policy_version 1426022 (0.0008) [2023-12-28 05:30:31,565][106226] Updated weights for policy 0, policy_version 1426032 (0.0009) [2023-12-28 05:30:31,626][106225] Updated weights for policy 1, policy_version 1429246 (0.0008) [2023-12-28 05:30:31,687][106225] Updated weights for policy 1, policy_version 1429256 (0.0008) [2023-12-28 05:30:31,748][106225] Updated weights for policy 1, policy_version 1429266 (0.0007) [2023-12-28 05:30:32,278][106226] Updated weights for policy 0, policy_version 1426042 (0.0008) [2023-12-28 05:30:32,345][106226] Updated weights for policy 0, policy_version 1426052 (0.0009) [2023-12-28 05:30:32,408][106226] Updated weights for policy 0, policy_version 1426062 (0.0008) [2023-12-28 05:30:32,478][106225] Updated weights for policy 1, policy_version 1429276 (0.0008) [2023-12-28 05:30:32,537][106225] Updated weights for policy 1, policy_version 1429286 (0.0009) [2023-12-28 05:30:32,595][106225] Updated weights for policy 1, policy_version 1429296 (0.0007) [2023-12-28 05:30:33,080][106226] Updated weights for policy 0, policy_version 1426072 (0.0006) [2023-12-28 05:30:33,138][106226] Updated weights for policy 0, policy_version 1426082 (0.0006) [2023-12-28 05:30:33,198][106226] Updated weights for policy 0, policy_version 1426092 (0.0007) [2023-12-28 05:30:33,322][106225] Updated weights for policy 1, policy_version 1429306 (0.0009) [2023-12-28 05:30:33,384][106225] Updated weights for policy 1, policy_version 1429316 (0.0010) [2023-12-28 05:30:33,434][106225] Updated weights for policy 1, policy_version 1429326 (0.0010) [2023-12-28 05:30:33,479][106225] Updated weights for policy 1, policy_version 1429336 (0.0010) [2023-12-28 05:30:33,794][106226] Updated weights for policy 0, policy_version 1426102 (0.0010) [2023-12-28 05:30:33,853][106226] Updated weights for policy 0, policy_version 1426112 (0.0010) [2023-12-28 05:30:33,909][106226] Updated weights for policy 0, policy_version 1426122 (0.0010) [2023-12-28 05:30:34,204][106225] Updated weights for policy 1, policy_version 1429346 (0.0008) [2023-12-28 05:30:34,263][106225] Updated weights for policy 1, policy_version 1429356 (0.0008) [2023-12-28 05:30:34,315][106225] Updated weights for policy 1, policy_version 1429366 (0.0008) [2023-12-28 05:30:34,569][106226] Updated weights for policy 0, policy_version 1426132 (0.0008) [2023-12-28 05:30:34,638][106226] Updated weights for policy 0, policy_version 1426142 (0.0010) [2023-12-28 05:30:34,698][106226] Updated weights for policy 0, policy_version 1426152 (0.0011) [2023-12-28 05:30:34,984][106225] Updated weights for policy 1, policy_version 1429376 (0.0007) [2023-12-28 05:30:35,043][106225] Updated weights for policy 1, policy_version 1429386 (0.0008) [2023-12-28 05:30:35,086][106225] Updated weights for policy 1, policy_version 1429396 (0.0007) [2023-12-28 05:30:35,359][106226] Updated weights for policy 0, policy_version 1426162 (0.0010) [2023-12-28 05:30:35,406][106226] Updated weights for policy 0, policy_version 1426172 (0.0005) [2023-12-28 05:30:35,452][106226] Updated weights for policy 0, policy_version 1426182 (0.0009) [2023-12-28 05:30:35,499][106226] Updated weights for policy 0, policy_version 1426192 (0.0008) [2023-12-28 05:30:35,880][106225] Updated weights for policy 1, policy_version 1429406 (0.0007) [2023-12-28 05:30:35,934][106225] Updated weights for policy 1, policy_version 1429416 (0.0007) [2023-12-28 05:30:35,994][106225] Updated weights for policy 1, policy_version 1429426 (0.0008) [2023-12-28 05:30:36,146][106226] Updated weights for policy 0, policy_version 1426202 (0.0007) [2023-12-28 05:30:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 731160576. Throughput: 0: 9859.3, 1: 9688.7. Samples: 731170656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:36,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-4.966')] [2023-12-28 05:30:36,207][106226] Updated weights for policy 0, policy_version 1426212 (0.0008) [2023-12-28 05:30:36,273][106226] Updated weights for policy 0, policy_version 1426222 (0.0008) [2023-12-28 05:30:36,752][106225] Updated weights for policy 1, policy_version 1429437 (0.0009) [2023-12-28 05:30:36,810][106225] Updated weights for policy 1, policy_version 1429447 (0.0009) [2023-12-28 05:30:36,877][106225] Updated weights for policy 1, policy_version 1429457 (0.0008) [2023-12-28 05:30:36,905][106226] Updated weights for policy 0, policy_version 1426232 (0.0010) [2023-12-28 05:30:36,973][106226] Updated weights for policy 0, policy_version 1426242 (0.0011) [2023-12-28 05:30:37,035][106226] Updated weights for policy 0, policy_version 1426252 (0.0011) [2023-12-28 05:30:37,516][106225] Updated weights for policy 1, policy_version 1429467 (0.0006) [2023-12-28 05:30:37,577][106225] Updated weights for policy 1, policy_version 1429477 (0.0007) [2023-12-28 05:30:37,638][106225] Updated weights for policy 1, policy_version 1429487 (0.0007) [2023-12-28 05:30:37,735][106226] Updated weights for policy 0, policy_version 1426262 (0.0008) [2023-12-28 05:30:37,780][106226] Updated weights for policy 0, policy_version 1426272 (0.0006) [2023-12-28 05:30:37,823][106226] Updated weights for policy 0, policy_version 1426282 (0.0010) [2023-12-28 05:30:38,289][106225] Updated weights for policy 1, policy_version 1429497 (0.0006) [2023-12-28 05:30:38,352][106225] Updated weights for policy 1, policy_version 1429507 (0.0008) [2023-12-28 05:30:38,408][106225] Updated weights for policy 1, policy_version 1429517 (0.0006) [2023-12-28 05:30:38,470][106225] Updated weights for policy 1, policy_version 1429527 (0.0009) [2023-12-28 05:30:38,502][106226] Updated weights for policy 0, policy_version 1426292 (0.0009) [2023-12-28 05:30:38,565][106226] Updated weights for policy 0, policy_version 1426302 (0.0008) [2023-12-28 05:30:38,622][106226] Updated weights for policy 0, policy_version 1426312 (0.0008) [2023-12-28 05:30:39,161][106225] Updated weights for policy 1, policy_version 1429537 (0.0008) [2023-12-28 05:30:39,222][106225] Updated weights for policy 1, policy_version 1429547 (0.0009) [2023-12-28 05:30:39,288][106225] Updated weights for policy 1, policy_version 1429557 (0.0009) [2023-12-28 05:30:39,359][106226] Updated weights for policy 0, policy_version 1426322 (0.0009) [2023-12-28 05:30:39,434][106226] Updated weights for policy 0, policy_version 1426332 (0.0009) [2023-12-28 05:30:39,499][106226] Updated weights for policy 0, policy_version 1426342 (0.0008) [2023-12-28 05:30:39,561][106226] Updated weights for policy 0, policy_version 1426352 (0.0008) [2023-12-28 05:30:40,118][106225] Updated weights for policy 1, policy_version 1429567 (0.0009) [2023-12-28 05:30:40,175][106225] Updated weights for policy 1, policy_version 1429577 (0.0010) [2023-12-28 05:30:40,215][106226] Updated weights for policy 0, policy_version 1426362 (0.0008) [2023-12-28 05:30:40,237][106225] Updated weights for policy 1, policy_version 1429587 (0.0006) [2023-12-28 05:30:40,270][106226] Updated weights for policy 0, policy_version 1426372 (0.0009) [2023-12-28 05:30:40,334][106226] Updated weights for policy 0, policy_version 1426382 (0.0007) [2023-12-28 05:30:40,904][106226] Updated weights for policy 0, policy_version 1426392 (0.0008) [2023-12-28 05:30:40,910][106225] Updated weights for policy 1, policy_version 1429597 (0.0005) [2023-12-28 05:30:40,954][106226] Updated weights for policy 0, policy_version 1426402 (0.0006) [2023-12-28 05:30:40,967][106225] Updated weights for policy 1, policy_version 1429607 (0.0006) [2023-12-28 05:30:41,004][106226] Updated weights for policy 0, policy_version 1426412 (0.0008) [2023-12-28 05:30:41,028][106225] Updated weights for policy 1, policy_version 1429617 (0.0007) [2023-12-28 05:30:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 731267072. Throughput: 0: 9875.4, 1: 9708.6. Samples: 731230152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:41,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-4.948')] [2023-12-28 05:30:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001429624_366034944.pth... [2023-12-28 05:30:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001426416_365232128.pth... [2023-12-28 05:30:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001428472_365740032.pth [2023-12-28 05:30:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001425264_364937216.pth [2023-12-28 05:30:41,795][106225] Updated weights for policy 1, policy_version 1429627 (0.0008) [2023-12-28 05:30:41,798][106226] Updated weights for policy 0, policy_version 1426422 (0.0009) [2023-12-28 05:30:41,854][106225] Updated weights for policy 1, policy_version 1429637 (0.0010) [2023-12-28 05:30:41,862][106226] Updated weights for policy 0, policy_version 1426432 (0.0007) [2023-12-28 05:30:41,912][106225] Updated weights for policy 1, policy_version 1429647 (0.0008) [2023-12-28 05:30:41,930][106226] Updated weights for policy 0, policy_version 1426442 (0.0010) [2023-12-28 05:30:42,598][106226] Updated weights for policy 0, policy_version 1426452 (0.0008) [2023-12-28 05:30:42,659][106226] Updated weights for policy 0, policy_version 1426462 (0.0006) [2023-12-28 05:30:42,668][106225] Updated weights for policy 1, policy_version 1429657 (0.0009) [2023-12-28 05:30:42,721][106226] Updated weights for policy 0, policy_version 1426472 (0.0005) [2023-12-28 05:30:42,731][106225] Updated weights for policy 1, policy_version 1429667 (0.0008) [2023-12-28 05:30:42,800][106225] Updated weights for policy 1, policy_version 1429677 (0.0007) [2023-12-28 05:30:42,862][106225] Updated weights for policy 1, policy_version 1429687 (0.0010) [2023-12-28 05:30:43,272][106226] Updated weights for policy 0, policy_version 1426482 (0.0006) [2023-12-28 05:30:43,327][106226] Updated weights for policy 0, policy_version 1426492 (0.0005) [2023-12-28 05:30:43,392][106226] Updated weights for policy 0, policy_version 1426502 (0.0005) [2023-12-28 05:30:43,452][106226] Updated weights for policy 0, policy_version 1426512 (0.0005) [2023-12-28 05:30:43,535][106225] Updated weights for policy 1, policy_version 1429697 (0.0006) [2023-12-28 05:30:43,588][106225] Updated weights for policy 1, policy_version 1429707 (0.0007) [2023-12-28 05:30:43,640][106225] Updated weights for policy 1, policy_version 1429717 (0.0007) [2023-12-28 05:30:44,034][106226] Updated weights for policy 0, policy_version 1426522 (0.0005) [2023-12-28 05:30:44,080][106226] Updated weights for policy 0, policy_version 1426532 (0.0005) [2023-12-28 05:30:44,141][106226] Updated weights for policy 0, policy_version 1426542 (0.0005) [2023-12-28 05:30:44,344][106225] Updated weights for policy 1, policy_version 1429727 (0.0010) [2023-12-28 05:30:44,398][106225] Updated weights for policy 1, policy_version 1429737 (0.0010) [2023-12-28 05:30:44,457][106225] Updated weights for policy 1, policy_version 1429747 (0.0007) [2023-12-28 05:30:44,761][106226] Updated weights for policy 0, policy_version 1426552 (0.0008) [2023-12-28 05:30:44,823][106226] Updated weights for policy 0, policy_version 1426562 (0.0009) [2023-12-28 05:30:44,885][106226] Updated weights for policy 0, policy_version 1426572 (0.0007) [2023-12-28 05:30:45,142][106225] Updated weights for policy 1, policy_version 1429757 (0.0008) [2023-12-28 05:30:45,204][106225] Updated weights for policy 1, policy_version 1429767 (0.0011) [2023-12-28 05:30:45,266][106225] Updated weights for policy 1, policy_version 1429777 (0.0010) [2023-12-28 05:30:45,550][106226] Updated weights for policy 0, policy_version 1426582 (0.0008) [2023-12-28 05:30:45,609][106226] Updated weights for policy 0, policy_version 1426592 (0.0005) [2023-12-28 05:30:45,660][106226] Updated weights for policy 0, policy_version 1426602 (0.0007) [2023-12-28 05:30:45,873][106225] Updated weights for policy 1, policy_version 1429787 (0.0009) [2023-12-28 05:30:45,933][106225] Updated weights for policy 1, policy_version 1429797 (0.0010) [2023-12-28 05:30:45,992][106225] Updated weights for policy 1, policy_version 1429807 (0.0010) [2023-12-28 05:30:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 731365376. Throughput: 0: 9962.5, 1: 9657.7. Samples: 731351352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:46,176][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.872')] [2023-12-28 05:30:46,311][106226] Updated weights for policy 0, policy_version 1426612 (0.0009) [2023-12-28 05:30:46,360][106226] Updated weights for policy 0, policy_version 1426622 (0.0009) [2023-12-28 05:30:46,417][106226] Updated weights for policy 0, policy_version 1426632 (0.0010) [2023-12-28 05:30:46,593][106225] Updated weights for policy 1, policy_version 1429817 (0.0010) [2023-12-28 05:30:46,643][106225] Updated weights for policy 1, policy_version 1429827 (0.0010) [2023-12-28 05:30:46,704][106225] Updated weights for policy 1, policy_version 1429837 (0.0006) [2023-12-28 05:30:46,759][106225] Updated weights for policy 1, policy_version 1429847 (0.0005) [2023-12-28 05:30:47,125][106226] Updated weights for policy 0, policy_version 1426642 (0.0010) [2023-12-28 05:30:47,171][106226] Updated weights for policy 0, policy_version 1426652 (0.0010) [2023-12-28 05:30:47,230][106226] Updated weights for policy 0, policy_version 1426662 (0.0010) [2023-12-28 05:30:47,289][106226] Updated weights for policy 0, policy_version 1426672 (0.0010) [2023-12-28 05:30:47,370][106225] Updated weights for policy 1, policy_version 1429857 (0.0005) [2023-12-28 05:30:47,428][106225] Updated weights for policy 1, policy_version 1429867 (0.0005) [2023-12-28 05:30:47,484][106225] Updated weights for policy 1, policy_version 1429877 (0.0005) [2023-12-28 05:30:47,963][106226] Updated weights for policy 0, policy_version 1426682 (0.0008) [2023-12-28 05:30:48,006][106225] Updated weights for policy 1, policy_version 1429887 (0.0009) [2023-12-28 05:30:48,020][106226] Updated weights for policy 0, policy_version 1426692 (0.0006) [2023-12-28 05:30:48,056][106225] Updated weights for policy 1, policy_version 1429897 (0.0010) [2023-12-28 05:30:48,077][106226] Updated weights for policy 0, policy_version 1426702 (0.0006) [2023-12-28 05:30:48,113][106225] Updated weights for policy 1, policy_version 1429907 (0.0010) [2023-12-28 05:30:48,843][106225] Updated weights for policy 1, policy_version 1429917 (0.0009) [2023-12-28 05:30:48,856][106226] Updated weights for policy 0, policy_version 1426712 (0.0006) [2023-12-28 05:30:48,903][106225] Updated weights for policy 1, policy_version 1429927 (0.0007) [2023-12-28 05:30:48,905][106226] Updated weights for policy 0, policy_version 1426722 (0.0006) [2023-12-28 05:30:48,959][106226] Updated weights for policy 0, policy_version 1426732 (0.0005) [2023-12-28 05:30:48,967][106225] Updated weights for policy 1, policy_version 1429937 (0.0008) [2023-12-28 05:30:49,668][106225] Updated weights for policy 1, policy_version 1429947 (0.0008) [2023-12-28 05:30:49,732][106225] Updated weights for policy 1, policy_version 1429957 (0.0009) [2023-12-28 05:30:49,740][106226] Updated weights for policy 0, policy_version 1426742 (0.0007) [2023-12-28 05:30:49,791][106225] Updated weights for policy 1, policy_version 1429967 (0.0010) [2023-12-28 05:30:49,798][106226] Updated weights for policy 0, policy_version 1426752 (0.0006) [2023-12-28 05:30:49,863][106226] Updated weights for policy 0, policy_version 1426762 (0.0009) [2023-12-28 05:30:50,492][106225] Updated weights for policy 1, policy_version 1429977 (0.0010) [2023-12-28 05:30:50,544][106225] Updated weights for policy 1, policy_version 1429987 (0.0005) [2023-12-28 05:30:50,610][106225] Updated weights for policy 1, policy_version 1429997 (0.0007) [2023-12-28 05:30:50,617][106226] Updated weights for policy 0, policy_version 1426772 (0.0008) [2023-12-28 05:30:50,664][106225] Updated weights for policy 1, policy_version 1430007 (0.0007) [2023-12-28 05:30:50,676][106226] Updated weights for policy 0, policy_version 1426782 (0.0008) [2023-12-28 05:30:50,741][106226] Updated weights for policy 0, policy_version 1426792 (0.0008) [2023-12-28 05:30:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 731463680. Throughput: 0: 9885.0, 1: 9818.0. Samples: 731473572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:51,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-5.024')] [2023-12-28 05:30:51,363][106225] Updated weights for policy 1, policy_version 1430017 (0.0008) [2023-12-28 05:30:51,426][106225] Updated weights for policy 1, policy_version 1430027 (0.0009) [2023-12-28 05:30:51,464][106226] Updated weights for policy 0, policy_version 1426802 (0.0007) [2023-12-28 05:30:51,482][106225] Updated weights for policy 1, policy_version 1430037 (0.0008) [2023-12-28 05:30:51,526][106226] Updated weights for policy 0, policy_version 1426812 (0.0007) [2023-12-28 05:30:51,588][106226] Updated weights for policy 0, policy_version 1426822 (0.0009) [2023-12-28 05:30:51,653][106226] Updated weights for policy 0, policy_version 1426832 (0.0008) [2023-12-28 05:30:52,272][106225] Updated weights for policy 1, policy_version 1430047 (0.0008) [2023-12-28 05:30:52,338][106225] Updated weights for policy 1, policy_version 1430057 (0.0009) [2023-12-28 05:30:52,403][106225] Updated weights for policy 1, policy_version 1430067 (0.0007) [2023-12-28 05:30:52,414][106226] Updated weights for policy 0, policy_version 1426842 (0.0008) [2023-12-28 05:30:52,482][106226] Updated weights for policy 0, policy_version 1426852 (0.0006) [2023-12-28 05:30:52,545][106226] Updated weights for policy 0, policy_version 1426862 (0.0008) [2023-12-28 05:30:53,106][106225] Updated weights for policy 1, policy_version 1430077 (0.0007) [2023-12-28 05:30:53,163][106225] Updated weights for policy 1, policy_version 1430087 (0.0009) [2023-12-28 05:30:53,216][106225] Updated weights for policy 1, policy_version 1430097 (0.0009) [2023-12-28 05:30:53,263][106226] Updated weights for policy 0, policy_version 1426872 (0.0009) [2023-12-28 05:30:53,319][106226] Updated weights for policy 0, policy_version 1426882 (0.0009) [2023-12-28 05:30:53,378][106226] Updated weights for policy 0, policy_version 1426892 (0.0009) [2023-12-28 05:30:53,852][106225] Updated weights for policy 1, policy_version 1430107 (0.0007) [2023-12-28 05:30:53,908][106225] Updated weights for policy 1, policy_version 1430117 (0.0006) [2023-12-28 05:30:53,969][106225] Updated weights for policy 1, policy_version 1430127 (0.0008) [2023-12-28 05:30:54,194][106226] Updated weights for policy 0, policy_version 1426902 (0.0009) [2023-12-28 05:30:54,261][106226] Updated weights for policy 0, policy_version 1426912 (0.0007) [2023-12-28 05:30:54,327][106226] Updated weights for policy 0, policy_version 1426922 (0.0010) [2023-12-28 05:30:54,521][106225] Updated weights for policy 1, policy_version 1430137 (0.0006) [2023-12-28 05:30:54,589][106225] Updated weights for policy 1, policy_version 1430147 (0.0008) [2023-12-28 05:30:54,634][106225] Updated weights for policy 1, policy_version 1430157 (0.0008) [2023-12-28 05:30:54,689][106225] Updated weights for policy 1, policy_version 1430167 (0.0008) [2023-12-28 05:30:55,045][106226] Updated weights for policy 0, policy_version 1426932 (0.0007) [2023-12-28 05:30:55,104][106226] Updated weights for policy 0, policy_version 1426942 (0.0007) [2023-12-28 05:30:55,158][106226] Updated weights for policy 0, policy_version 1426952 (0.0009) [2023-12-28 05:30:55,390][106225] Updated weights for policy 1, policy_version 1430177 (0.0006) [2023-12-28 05:30:55,438][106225] Updated weights for policy 1, policy_version 1430187 (0.0010) [2023-12-28 05:30:55,487][106225] Updated weights for policy 1, policy_version 1430198 (0.0008) [2023-12-28 05:30:55,922][106226] Updated weights for policy 0, policy_version 1426962 (0.0008) [2023-12-28 05:30:55,980][106226] Updated weights for policy 0, policy_version 1426972 (0.0005) [2023-12-28 05:30:56,048][106226] Updated weights for policy 0, policy_version 1426982 (0.0005) [2023-12-28 05:30:56,114][106226] Updated weights for policy 0, policy_version 1426992 (0.0005) [2023-12-28 05:30:56,115][106225] Updated weights for policy 1, policy_version 1430208 (0.0008) [2023-12-28 05:30:56,167][106225] Updated weights for policy 1, policy_version 1430218 (0.0008) [2023-12-28 05:30:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 731561984. Throughput: 0: 9861.6, 1: 9840.8. Samples: 731530292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:30:56,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-4.758')] [2023-12-28 05:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001426992_365379584.pth... [2023-12-28 05:30:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001425808_365076480.pth [2023-12-28 05:30:56,225][106225] Updated weights for policy 1, policy_version 1430228 (0.0008) [2023-12-28 05:30:56,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001430232_366190592.pth... [2023-12-28 05:30:56,247][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001429048_365887488.pth [2023-12-28 05:30:56,691][106226] Updated weights for policy 0, policy_version 1427002 (0.0009) [2023-12-28 05:30:56,752][106226] Updated weights for policy 0, policy_version 1427012 (0.0009) [2023-12-28 05:30:56,805][106226] Updated weights for policy 0, policy_version 1427022 (0.0010) [2023-12-28 05:30:56,952][106225] Updated weights for policy 1, policy_version 1430238 (0.0007) [2023-12-28 05:30:57,018][106225] Updated weights for policy 1, policy_version 1430248 (0.0005) [2023-12-28 05:30:57,080][106225] Updated weights for policy 1, policy_version 1430258 (0.0005) [2023-12-28 05:30:57,469][106226] Updated weights for policy 0, policy_version 1427032 (0.0006) [2023-12-28 05:30:57,518][106226] Updated weights for policy 0, policy_version 1427042 (0.0005) [2023-12-28 05:30:57,565][106226] Updated weights for policy 0, policy_version 1427052 (0.0006) [2023-12-28 05:30:57,640][106225] Updated weights for policy 1, policy_version 1430268 (0.0005) [2023-12-28 05:30:57,688][106225] Updated weights for policy 1, policy_version 1430278 (0.0005) [2023-12-28 05:30:57,737][106225] Updated weights for policy 1, policy_version 1430288 (0.0007) [2023-12-28 05:30:58,226][106226] Updated weights for policy 0, policy_version 1427062 (0.0009) [2023-12-28 05:30:58,290][106226] Updated weights for policy 0, policy_version 1427072 (0.0009) [2023-12-28 05:30:58,363][106226] Updated weights for policy 0, policy_version 1427082 (0.0009) [2023-12-28 05:30:58,445][106225] Updated weights for policy 1, policy_version 1430298 (0.0008) [2023-12-28 05:30:58,511][106225] Updated weights for policy 1, policy_version 1430308 (0.0008) [2023-12-28 05:30:58,583][106225] Updated weights for policy 1, policy_version 1430318 (0.0008) [2023-12-28 05:30:58,646][106225] Updated weights for policy 1, policy_version 1430328 (0.0008) [2023-12-28 05:30:59,180][106226] Updated weights for policy 0, policy_version 1427092 (0.0009) [2023-12-28 05:30:59,242][106226] Updated weights for policy 0, policy_version 1427102 (0.0009) [2023-12-28 05:30:59,316][106226] Updated weights for policy 0, policy_version 1427112 (0.0008) [2023-12-28 05:30:59,484][106225] Updated weights for policy 1, policy_version 1430338 (0.0008) [2023-12-28 05:30:59,540][106225] Updated weights for policy 1, policy_version 1430348 (0.0007) [2023-12-28 05:30:59,605][106225] Updated weights for policy 1, policy_version 1430359 (0.0007) [2023-12-28 05:31:00,088][106226] Updated weights for policy 0, policy_version 1427122 (0.0010) [2023-12-28 05:31:00,148][106226] Updated weights for policy 0, policy_version 1427132 (0.0006) [2023-12-28 05:31:00,214][106226] Updated weights for policy 0, policy_version 1427142 (0.0007) [2023-12-28 05:31:00,269][106226] Updated weights for policy 0, policy_version 1427152 (0.0007) [2023-12-28 05:31:00,308][106225] Updated weights for policy 1, policy_version 1430369 (0.0009) [2023-12-28 05:31:00,369][106225] Updated weights for policy 1, policy_version 1430379 (0.0009) [2023-12-28 05:31:00,435][106225] Updated weights for policy 1, policy_version 1430389 (0.0008) [2023-12-28 05:31:00,938][106226] Updated weights for policy 0, policy_version 1427162 (0.0009) [2023-12-28 05:31:00,988][106226] Updated weights for policy 0, policy_version 1427172 (0.0008) [2023-12-28 05:31:01,049][106226] Updated weights for policy 0, policy_version 1427182 (0.0009) [2023-12-28 05:31:01,131][106225] Updated weights for policy 1, policy_version 1430399 (0.0008) [2023-12-28 05:31:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 731660288. Throughput: 0: 9880.5, 1: 9984.8. Samples: 731649948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:01,175][105115] Avg episode reward: [(0, '-4.867'), (1, '-4.901')] [2023-12-28 05:31:01,203][106225] Updated weights for policy 1, policy_version 1430409 (0.0008) [2023-12-28 05:31:01,267][106225] Updated weights for policy 1, policy_version 1430419 (0.0009) [2023-12-28 05:31:01,800][106226] Updated weights for policy 0, policy_version 1427192 (0.0008) [2023-12-28 05:31:01,866][106226] Updated weights for policy 0, policy_version 1427202 (0.0008) [2023-12-28 05:31:01,930][106225] Updated weights for policy 1, policy_version 1430429 (0.0006) [2023-12-28 05:31:01,933][106226] Updated weights for policy 0, policy_version 1427212 (0.0007) [2023-12-28 05:31:01,995][106225] Updated weights for policy 1, policy_version 1430439 (0.0007) [2023-12-28 05:31:02,062][106225] Updated weights for policy 1, policy_version 1430449 (0.0008) [2023-12-28 05:31:02,648][106226] Updated weights for policy 0, policy_version 1427222 (0.0007) [2023-12-28 05:31:02,710][106226] Updated weights for policy 0, policy_version 1427232 (0.0006) [2023-12-28 05:31:02,759][106225] Updated weights for policy 1, policy_version 1430459 (0.0007) [2023-12-28 05:31:02,772][106226] Updated weights for policy 0, policy_version 1427242 (0.0008) [2023-12-28 05:31:02,824][106225] Updated weights for policy 1, policy_version 1430469 (0.0007) [2023-12-28 05:31:02,883][106225] Updated weights for policy 1, policy_version 1430479 (0.0007) [2023-12-28 05:31:03,403][106226] Updated weights for policy 0, policy_version 1427252 (0.0009) [2023-12-28 05:31:03,463][106226] Updated weights for policy 0, policy_version 1427262 (0.0008) [2023-12-28 05:31:03,529][106226] Updated weights for policy 0, policy_version 1427272 (0.0009) [2023-12-28 05:31:03,588][106225] Updated weights for policy 1, policy_version 1430489 (0.0008) [2023-12-28 05:31:03,647][106225] Updated weights for policy 1, policy_version 1430499 (0.0009) [2023-12-28 05:31:03,698][106225] Updated weights for policy 1, policy_version 1430509 (0.0008) [2023-12-28 05:31:03,747][106225] Updated weights for policy 1, policy_version 1430519 (0.0008) [2023-12-28 05:31:04,239][106226] Updated weights for policy 0, policy_version 1427282 (0.0008) [2023-12-28 05:31:04,302][106226] Updated weights for policy 0, policy_version 1427292 (0.0008) [2023-12-28 05:31:04,366][106226] Updated weights for policy 0, policy_version 1427302 (0.0008) [2023-12-28 05:31:04,434][106226] Updated weights for policy 0, policy_version 1427312 (0.0008) [2023-12-28 05:31:04,486][106225] Updated weights for policy 1, policy_version 1430529 (0.0007) [2023-12-28 05:31:04,540][106225] Updated weights for policy 1, policy_version 1430539 (0.0008) [2023-12-28 05:31:04,600][106225] Updated weights for policy 1, policy_version 1430549 (0.0007) [2023-12-28 05:31:05,148][106226] Updated weights for policy 0, policy_version 1427322 (0.0005) [2023-12-28 05:31:05,206][106226] Updated weights for policy 0, policy_version 1427332 (0.0008) [2023-12-28 05:31:05,259][106226] Updated weights for policy 0, policy_version 1427342 (0.0005) [2023-12-28 05:31:05,328][106225] Updated weights for policy 1, policy_version 1430559 (0.0009) [2023-12-28 05:31:05,375][106225] Updated weights for policy 1, policy_version 1430569 (0.0010) [2023-12-28 05:31:05,423][106225] Updated weights for policy 1, policy_version 1430579 (0.0006) [2023-12-28 05:31:05,892][106226] Updated weights for policy 0, policy_version 1427352 (0.0005) [2023-12-28 05:31:05,948][106226] Updated weights for policy 0, policy_version 1427362 (0.0005) [2023-12-28 05:31:05,969][106225] Updated weights for policy 1, policy_version 1430589 (0.0008) [2023-12-28 05:31:06,007][106226] Updated weights for policy 0, policy_version 1427372 (0.0006) [2023-12-28 05:31:06,019][106225] Updated weights for policy 1, policy_version 1430599 (0.0010) [2023-12-28 05:31:06,069][106225] Updated weights for policy 1, policy_version 1430609 (0.0010) [2023-12-28 05:31:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 731766784. Throughput: 0: 9910.0, 1: 9975.0. Samples: 731769188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:06,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-4.658')] [2023-12-28 05:31:06,627][106226] Updated weights for policy 0, policy_version 1427382 (0.0007) [2023-12-28 05:31:06,689][106226] Updated weights for policy 0, policy_version 1427392 (0.0008) [2023-12-28 05:31:06,756][106226] Updated weights for policy 0, policy_version 1427402 (0.0009) [2023-12-28 05:31:06,857][106225] Updated weights for policy 1, policy_version 1430619 (0.0009) [2023-12-28 05:31:06,911][106225] Updated weights for policy 1, policy_version 1430629 (0.0010) [2023-12-28 05:31:06,972][106225] Updated weights for policy 1, policy_version 1430639 (0.0010) [2023-12-28 05:31:07,476][106226] Updated weights for policy 0, policy_version 1427412 (0.0007) [2023-12-28 05:31:07,526][106226] Updated weights for policy 0, policy_version 1427422 (0.0008) [2023-12-28 05:31:07,582][106226] Updated weights for policy 0, policy_version 1427432 (0.0008) [2023-12-28 05:31:07,684][106225] Updated weights for policy 1, policy_version 1430649 (0.0010) [2023-12-28 05:31:07,752][106225] Updated weights for policy 1, policy_version 1430659 (0.0006) [2023-12-28 05:31:07,813][106225] Updated weights for policy 1, policy_version 1430669 (0.0008) [2023-12-28 05:31:07,873][106225] Updated weights for policy 1, policy_version 1430679 (0.0009) [2023-12-28 05:31:08,365][106226] Updated weights for policy 0, policy_version 1427442 (0.0008) [2023-12-28 05:31:08,430][106226] Updated weights for policy 0, policy_version 1427452 (0.0008) [2023-12-28 05:31:08,491][106226] Updated weights for policy 0, policy_version 1427462 (0.0008) [2023-12-28 05:31:08,536][106225] Updated weights for policy 1, policy_version 1430689 (0.0010) [2023-12-28 05:31:08,549][106226] Updated weights for policy 0, policy_version 1427472 (0.0006) [2023-12-28 05:31:08,583][106225] Updated weights for policy 1, policy_version 1430699 (0.0010) [2023-12-28 05:31:08,626][106225] Updated weights for policy 1, policy_version 1430709 (0.0010) [2023-12-28 05:31:09,298][106226] Updated weights for policy 0, policy_version 1427482 (0.0009) [2023-12-28 05:31:09,365][106226] Updated weights for policy 0, policy_version 1427492 (0.0009) [2023-12-28 05:31:09,440][106226] Updated weights for policy 0, policy_version 1427502 (0.0009) [2023-12-28 05:31:09,459][106225] Updated weights for policy 1, policy_version 1430719 (0.0009) [2023-12-28 05:31:09,506][106225] Updated weights for policy 1, policy_version 1430729 (0.0009) [2023-12-28 05:31:09,558][106225] Updated weights for policy 1, policy_version 1430739 (0.0008) [2023-12-28 05:31:10,236][106225] Updated weights for policy 1, policy_version 1430749 (0.0008) [2023-12-28 05:31:10,280][106226] Updated weights for policy 0, policy_version 1427512 (0.0010) [2023-12-28 05:31:10,295][106225] Updated weights for policy 1, policy_version 1430759 (0.0009) [2023-12-28 05:31:10,340][106226] Updated weights for policy 0, policy_version 1427522 (0.0008) [2023-12-28 05:31:10,360][106225] Updated weights for policy 1, policy_version 1430769 (0.0009) [2023-12-28 05:31:10,396][106226] Updated weights for policy 0, policy_version 1427532 (0.0007) [2023-12-28 05:31:11,075][106225] Updated weights for policy 1, policy_version 1430779 (0.0006) [2023-12-28 05:31:11,144][106225] Updated weights for policy 1, policy_version 1430789 (0.0008) [2023-12-28 05:31:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 731848704. Throughput: 0: 9929.3, 1: 10014.9. Samples: 731827864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:11,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.709')] [2023-12-28 05:31:11,194][106226] Updated weights for policy 0, policy_version 1427542 (0.0008) [2023-12-28 05:31:11,213][106225] Updated weights for policy 1, policy_version 1430799 (0.0008) [2023-12-28 05:31:11,259][106226] Updated weights for policy 0, policy_version 1427552 (0.0008) [2023-12-28 05:31:11,269][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001430808_366338048.pth... [2023-12-28 05:31:11,274][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001429624_366034944.pth [2023-12-28 05:31:11,314][106226] Updated weights for policy 0, policy_version 1427562 (0.0007) [2023-12-28 05:31:11,348][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001427568_365527040.pth... [2023-12-28 05:31:11,352][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001426416_365232128.pth [2023-12-28 05:31:11,994][106225] Updated weights for policy 1, policy_version 1430809 (0.0008) [2023-12-28 05:31:12,050][106225] Updated weights for policy 1, policy_version 1430819 (0.0008) [2023-12-28 05:31:12,092][106226] Updated weights for policy 0, policy_version 1427572 (0.0009) [2023-12-28 05:31:12,100][106225] Updated weights for policy 1, policy_version 1430829 (0.0008) [2023-12-28 05:31:12,150][106226] Updated weights for policy 0, policy_version 1427582 (0.0008) [2023-12-28 05:31:12,156][106225] Updated weights for policy 1, policy_version 1430839 (0.0005) [2023-12-28 05:31:12,204][106226] Updated weights for policy 0, policy_version 1427592 (0.0008) [2023-12-28 05:31:12,882][106225] Updated weights for policy 1, policy_version 1430849 (0.0010) [2023-12-28 05:31:12,932][106225] Updated weights for policy 1, policy_version 1430859 (0.0010) [2023-12-28 05:31:12,986][106226] Updated weights for policy 0, policy_version 1427602 (0.0008) [2023-12-28 05:31:12,992][106225] Updated weights for policy 1, policy_version 1430869 (0.0010) [2023-12-28 05:31:13,039][106226] Updated weights for policy 0, policy_version 1427612 (0.0007) [2023-12-28 05:31:13,091][106226] Updated weights for policy 0, policy_version 1427622 (0.0008) [2023-12-28 05:31:13,143][106226] Updated weights for policy 0, policy_version 1427632 (0.0008) [2023-12-28 05:31:13,716][106225] Updated weights for policy 1, policy_version 1430879 (0.0010) [2023-12-28 05:31:13,769][106225] Updated weights for policy 1, policy_version 1430889 (0.0010) [2023-12-28 05:31:13,823][106225] Updated weights for policy 1, policy_version 1430899 (0.0010) [2023-12-28 05:31:13,853][106226] Updated weights for policy 0, policy_version 1427642 (0.0007) [2023-12-28 05:31:13,902][106226] Updated weights for policy 0, policy_version 1427652 (0.0008) [2023-12-28 05:31:13,958][106226] Updated weights for policy 0, policy_version 1427663 (0.0008) [2023-12-28 05:31:14,508][106225] Updated weights for policy 1, policy_version 1430909 (0.0008) [2023-12-28 05:31:14,558][106225] Updated weights for policy 1, policy_version 1430919 (0.0006) [2023-12-28 05:31:14,610][106225] Updated weights for policy 1, policy_version 1430929 (0.0010) [2023-12-28 05:31:14,718][106226] Updated weights for policy 0, policy_version 1427673 (0.0008) [2023-12-28 05:31:14,779][106226] Updated weights for policy 0, policy_version 1427683 (0.0008) [2023-12-28 05:31:14,844][106226] Updated weights for policy 0, policy_version 1427693 (0.0008) [2023-12-28 05:31:15,366][106225] Updated weights for policy 1, policy_version 1430939 (0.0010) [2023-12-28 05:31:15,426][106225] Updated weights for policy 1, policy_version 1430949 (0.0008) [2023-12-28 05:31:15,488][106225] Updated weights for policy 1, policy_version 1430959 (0.0009) [2023-12-28 05:31:15,595][106226] Updated weights for policy 0, policy_version 1427703 (0.0008) [2023-12-28 05:31:15,643][106226] Updated weights for policy 0, policy_version 1427713 (0.0009) [2023-12-28 05:31:15,700][106226] Updated weights for policy 0, policy_version 1427723 (0.0008) [2023-12-28 05:31:16,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 731947008. Throughput: 0: 9837.9, 1: 9932.6. Samples: 731941028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:16,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-4.937')] [2023-12-28 05:31:16,193][106225] Updated weights for policy 1, policy_version 1430969 (0.0008) [2023-12-28 05:31:16,251][106225] Updated weights for policy 1, policy_version 1430979 (0.0008) [2023-12-28 05:31:16,304][106225] Updated weights for policy 1, policy_version 1430989 (0.0008) [2023-12-28 05:31:16,352][106225] Updated weights for policy 1, policy_version 1430999 (0.0005) [2023-12-28 05:31:16,463][106226] Updated weights for policy 0, policy_version 1427733 (0.0008) [2023-12-28 05:31:16,520][106226] Updated weights for policy 0, policy_version 1427743 (0.0008) [2023-12-28 05:31:16,581][106226] Updated weights for policy 0, policy_version 1427753 (0.0008) [2023-12-28 05:31:17,039][106225] Updated weights for policy 1, policy_version 1431009 (0.0008) [2023-12-28 05:31:17,101][106225] Updated weights for policy 1, policy_version 1431019 (0.0009) [2023-12-28 05:31:17,153][106225] Updated weights for policy 1, policy_version 1431029 (0.0007) [2023-12-28 05:31:17,211][106226] Updated weights for policy 0, policy_version 1427763 (0.0008) [2023-12-28 05:31:17,262][106226] Updated weights for policy 0, policy_version 1427773 (0.0006) [2023-12-28 05:31:17,312][106226] Updated weights for policy 0, policy_version 1427783 (0.0007) [2023-12-28 05:31:17,852][106226] Updated weights for policy 0, policy_version 1427793 (0.0006) [2023-12-28 05:31:17,910][106226] Updated weights for policy 0, policy_version 1427803 (0.0005) [2023-12-28 05:31:17,974][106226] Updated weights for policy 0, policy_version 1427813 (0.0007) [2023-12-28 05:31:17,992][106225] Updated weights for policy 1, policy_version 1431039 (0.0006) [2023-12-28 05:31:18,026][106226] Updated weights for policy 0, policy_version 1427823 (0.0008) [2023-12-28 05:31:18,056][106225] Updated weights for policy 1, policy_version 1431049 (0.0005) [2023-12-28 05:31:18,122][106225] Updated weights for policy 1, policy_version 1431059 (0.0006) [2023-12-28 05:31:18,609][106226] Updated weights for policy 0, policy_version 1427833 (0.0006) [2023-12-28 05:31:18,665][106226] Updated weights for policy 0, policy_version 1427843 (0.0005) [2023-12-28 05:31:18,732][106226] Updated weights for policy 0, policy_version 1427853 (0.0005) [2023-12-28 05:31:18,890][106225] Updated weights for policy 1, policy_version 1431069 (0.0009) [2023-12-28 05:31:18,952][106225] Updated weights for policy 1, policy_version 1431079 (0.0008) [2023-12-28 05:31:19,014][106225] Updated weights for policy 1, policy_version 1431089 (0.0008) [2023-12-28 05:31:19,336][106226] Updated weights for policy 0, policy_version 1427863 (0.0008) [2023-12-28 05:31:19,405][106226] Updated weights for policy 0, policy_version 1427873 (0.0009) [2023-12-28 05:31:19,460][106226] Updated weights for policy 0, policy_version 1427883 (0.0008) [2023-12-28 05:31:19,739][106225] Updated weights for policy 1, policy_version 1431099 (0.0007) [2023-12-28 05:31:19,801][106225] Updated weights for policy 1, policy_version 1431109 (0.0006) [2023-12-28 05:31:19,866][106225] Updated weights for policy 1, policy_version 1431119 (0.0009) [2023-12-28 05:31:20,207][106226] Updated weights for policy 0, policy_version 1427893 (0.0007) [2023-12-28 05:31:20,279][106226] Updated weights for policy 0, policy_version 1427903 (0.0006) [2023-12-28 05:31:20,343][106226] Updated weights for policy 0, policy_version 1427913 (0.0006) [2023-12-28 05:31:20,576][106225] Updated weights for policy 1, policy_version 1431129 (0.0008) [2023-12-28 05:31:20,644][106225] Updated weights for policy 1, policy_version 1431139 (0.0010) [2023-12-28 05:31:20,707][106225] Updated weights for policy 1, policy_version 1431149 (0.0010) [2023-12-28 05:31:20,769][106225] Updated weights for policy 1, policy_version 1431159 (0.0011) [2023-12-28 05:31:20,967][106226] Updated weights for policy 0, policy_version 1427923 (0.0007) [2023-12-28 05:31:21,039][106226] Updated weights for policy 0, policy_version 1427933 (0.0008) [2023-12-28 05:31:21,110][106226] Updated weights for policy 0, policy_version 1427943 (0.0008) [2023-12-28 05:31:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 732053504. Throughput: 0: 9870.0, 1: 9895.0. Samples: 732060084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:21,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.798')] [2023-12-28 05:31:21,433][106225] Updated weights for policy 1, policy_version 1431169 (0.0009) [2023-12-28 05:31:21,490][106225] Updated weights for policy 1, policy_version 1431179 (0.0009) [2023-12-28 05:31:21,546][106225] Updated weights for policy 1, policy_version 1431189 (0.0008) [2023-12-28 05:31:21,825][106226] Updated weights for policy 0, policy_version 1427953 (0.0008) [2023-12-28 05:31:21,889][106226] Updated weights for policy 0, policy_version 1427963 (0.0006) [2023-12-28 05:31:21,946][106226] Updated weights for policy 0, policy_version 1427973 (0.0008) [2023-12-28 05:31:22,010][106226] Updated weights for policy 0, policy_version 1427983 (0.0008) [2023-12-28 05:31:22,372][106225] Updated weights for policy 1, policy_version 1431199 (0.0009) [2023-12-28 05:31:22,434][106225] Updated weights for policy 1, policy_version 1431209 (0.0008) [2023-12-28 05:31:22,496][106225] Updated weights for policy 1, policy_version 1431219 (0.0008) [2023-12-28 05:31:22,776][106226] Updated weights for policy 0, policy_version 1427993 (0.0009) [2023-12-28 05:31:22,845][106226] Updated weights for policy 0, policy_version 1428003 (0.0009) [2023-12-28 05:31:22,910][106226] Updated weights for policy 0, policy_version 1428013 (0.0008) [2023-12-28 05:31:23,155][106225] Updated weights for policy 1, policy_version 1431229 (0.0009) [2023-12-28 05:31:23,211][106225] Updated weights for policy 1, policy_version 1431239 (0.0008) [2023-12-28 05:31:23,263][106225] Updated weights for policy 1, policy_version 1431249 (0.0008) [2023-12-28 05:31:23,646][106226] Updated weights for policy 0, policy_version 1428023 (0.0009) [2023-12-28 05:31:23,699][106226] Updated weights for policy 0, policy_version 1428033 (0.0010) [2023-12-28 05:31:23,752][106226] Updated weights for policy 0, policy_version 1428043 (0.0010) [2023-12-28 05:31:23,897][106225] Updated weights for policy 1, policy_version 1431259 (0.0008) [2023-12-28 05:31:23,949][106225] Updated weights for policy 1, policy_version 1431269 (0.0006) [2023-12-28 05:31:24,013][106225] Updated weights for policy 1, policy_version 1431279 (0.0005) [2023-12-28 05:31:24,512][106226] Updated weights for policy 0, policy_version 1428053 (0.0009) [2023-12-28 05:31:24,561][106226] Updated weights for policy 0, policy_version 1428063 (0.0009) [2023-12-28 05:31:24,609][106226] Updated weights for policy 0, policy_version 1428073 (0.0008) [2023-12-28 05:31:24,682][106225] Updated weights for policy 1, policy_version 1431289 (0.0008) [2023-12-28 05:31:24,737][106225] Updated weights for policy 1, policy_version 1431299 (0.0008) [2023-12-28 05:31:24,794][106225] Updated weights for policy 1, policy_version 1431309 (0.0008) [2023-12-28 05:31:24,844][106225] Updated weights for policy 1, policy_version 1431319 (0.0008) [2023-12-28 05:31:25,341][106226] Updated weights for policy 0, policy_version 1428083 (0.0009) [2023-12-28 05:31:25,411][106226] Updated weights for policy 0, policy_version 1428093 (0.0006) [2023-12-28 05:31:25,469][106226] Updated weights for policy 0, policy_version 1428103 (0.0008) [2023-12-28 05:31:25,576][106225] Updated weights for policy 1, policy_version 1431329 (0.0008) [2023-12-28 05:31:25,641][106225] Updated weights for policy 1, policy_version 1431339 (0.0009) [2023-12-28 05:31:25,699][106225] Updated weights for policy 1, policy_version 1431349 (0.0008) [2023-12-28 05:31:26,150][106226] Updated weights for policy 0, policy_version 1428113 (0.0009) [2023-12-28 05:31:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 732143616. Throughput: 0: 9819.8, 1: 9886.0. Samples: 732116912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:26,175][105115] Avg episode reward: [(0, '-4.876'), (1, '-4.821')] [2023-12-28 05:31:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001431352_366477312.pth... [2023-12-28 05:31:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001430232_366190592.pth [2023-12-28 05:31:26,216][106226] Updated weights for policy 0, policy_version 1428123 (0.0011) [2023-12-28 05:31:26,281][106226] Updated weights for policy 0, policy_version 1428133 (0.0011) [2023-12-28 05:31:26,347][106226] Updated weights for policy 0, policy_version 1428143 (0.0006) [2023-12-28 05:31:26,352][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001428144_365674496.pth... [2023-12-28 05:31:26,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001426992_365379584.pth [2023-12-28 05:31:26,418][106225] Updated weights for policy 1, policy_version 1431359 (0.0006) [2023-12-28 05:31:26,474][106225] Updated weights for policy 1, policy_version 1431369 (0.0007) [2023-12-28 05:31:26,530][106225] Updated weights for policy 1, policy_version 1431379 (0.0007) [2023-12-28 05:31:26,958][106226] Updated weights for policy 0, policy_version 1428153 (0.0006) [2023-12-28 05:31:27,012][106226] Updated weights for policy 0, policy_version 1428163 (0.0008) [2023-12-28 05:31:27,066][106226] Updated weights for policy 0, policy_version 1428173 (0.0010) [2023-12-28 05:31:27,166][106225] Updated weights for policy 1, policy_version 1431389 (0.0007) [2023-12-28 05:31:27,221][106225] Updated weights for policy 1, policy_version 1431399 (0.0009) [2023-12-28 05:31:27,271][106225] Updated weights for policy 1, policy_version 1431409 (0.0008) [2023-12-28 05:31:27,643][106226] Updated weights for policy 0, policy_version 1428183 (0.0007) [2023-12-28 05:31:27,698][106226] Updated weights for policy 0, policy_version 1428193 (0.0005) [2023-12-28 05:31:27,755][106226] Updated weights for policy 0, policy_version 1428203 (0.0005) [2023-12-28 05:31:27,925][106225] Updated weights for policy 1, policy_version 1431419 (0.0009) [2023-12-28 05:31:27,971][106225] Updated weights for policy 1, policy_version 1431429 (0.0010) [2023-12-28 05:31:28,024][106225] Updated weights for policy 1, policy_version 1431439 (0.0010) [2023-12-28 05:31:28,355][106226] Updated weights for policy 0, policy_version 1428213 (0.0007) [2023-12-28 05:31:28,418][106226] Updated weights for policy 0, policy_version 1428223 (0.0011) [2023-12-28 05:31:28,471][106226] Updated weights for policy 0, policy_version 1428233 (0.0010) [2023-12-28 05:31:28,728][106225] Updated weights for policy 1, policy_version 1431449 (0.0010) [2023-12-28 05:31:28,780][106225] Updated weights for policy 1, policy_version 1431459 (0.0008) [2023-12-28 05:31:28,831][106225] Updated weights for policy 1, policy_version 1431469 (0.0008) [2023-12-28 05:31:28,879][106225] Updated weights for policy 1, policy_version 1431479 (0.0009) [2023-12-28 05:31:29,103][106226] Updated weights for policy 0, policy_version 1428243 (0.0009) [2023-12-28 05:31:29,164][106226] Updated weights for policy 0, policy_version 1428253 (0.0005) [2023-12-28 05:31:29,223][106226] Updated weights for policy 0, policy_version 1428263 (0.0007) [2023-12-28 05:31:29,669][106225] Updated weights for policy 1, policy_version 1431489 (0.0009) [2023-12-28 05:31:29,730][106225] Updated weights for policy 1, policy_version 1431499 (0.0009) [2023-12-28 05:31:29,787][106225] Updated weights for policy 1, policy_version 1431509 (0.0007) [2023-12-28 05:31:29,895][106226] Updated weights for policy 0, policy_version 1428273 (0.0008) [2023-12-28 05:31:29,960][106226] Updated weights for policy 0, policy_version 1428283 (0.0009) [2023-12-28 05:31:30,026][106226] Updated weights for policy 0, policy_version 1428293 (0.0009) [2023-12-28 05:31:30,084][106226] Updated weights for policy 0, policy_version 1428303 (0.0008) [2023-12-28 05:31:30,562][106225] Updated weights for policy 1, policy_version 1431519 (0.0008) [2023-12-28 05:31:30,617][106225] Updated weights for policy 1, policy_version 1431529 (0.0009) [2023-12-28 05:31:30,665][106225] Updated weights for policy 1, policy_version 1431539 (0.0008) [2023-12-28 05:31:30,802][106226] Updated weights for policy 0, policy_version 1428313 (0.0009) [2023-12-28 05:31:30,859][106226] Updated weights for policy 0, policy_version 1428323 (0.0009) [2023-12-28 05:31:30,907][106226] Updated weights for policy 0, policy_version 1428333 (0.0008) [2023-12-28 05:31:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 732250112. Throughput: 0: 9810.3, 1: 9938.9. Samples: 732240068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:31,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-4.523')] [2023-12-28 05:31:31,419][106225] Updated weights for policy 1, policy_version 1431549 (0.0008) [2023-12-28 05:31:31,475][106225] Updated weights for policy 1, policy_version 1431559 (0.0008) [2023-12-28 05:31:31,529][106225] Updated weights for policy 1, policy_version 1431569 (0.0008) [2023-12-28 05:31:31,678][106226] Updated weights for policy 0, policy_version 1428343 (0.0008) [2023-12-28 05:31:31,745][106226] Updated weights for policy 0, policy_version 1428353 (0.0008) [2023-12-28 05:31:31,803][106226] Updated weights for policy 0, policy_version 1428363 (0.0008) [2023-12-28 05:31:32,298][106225] Updated weights for policy 1, policy_version 1431579 (0.0008) [2023-12-28 05:31:32,357][106225] Updated weights for policy 1, policy_version 1431589 (0.0008) [2023-12-28 05:31:32,419][106225] Updated weights for policy 1, policy_version 1431599 (0.0007) [2023-12-28 05:31:32,429][106226] Updated weights for policy 0, policy_version 1428373 (0.0007) [2023-12-28 05:31:32,479][106226] Updated weights for policy 0, policy_version 1428383 (0.0008) [2023-12-28 05:31:32,535][106226] Updated weights for policy 0, policy_version 1428393 (0.0008) [2023-12-28 05:31:33,127][106225] Updated weights for policy 1, policy_version 1431609 (0.0008) [2023-12-28 05:31:33,190][106225] Updated weights for policy 1, policy_version 1431619 (0.0008) [2023-12-28 05:31:33,247][106225] Updated weights for policy 1, policy_version 1431629 (0.0011) [2023-12-28 05:31:33,287][106226] Updated weights for policy 0, policy_version 1428403 (0.0009) [2023-12-28 05:31:33,302][106225] Updated weights for policy 1, policy_version 1431639 (0.0010) [2023-12-28 05:31:33,336][106226] Updated weights for policy 0, policy_version 1428413 (0.0007) [2023-12-28 05:31:33,385][106226] Updated weights for policy 0, policy_version 1428423 (0.0007) [2023-12-28 05:31:33,964][106225] Updated weights for policy 1, policy_version 1431649 (0.0006) [2023-12-28 05:31:34,027][106225] Updated weights for policy 1, policy_version 1431659 (0.0005) [2023-12-28 05:31:34,084][106225] Updated weights for policy 1, policy_version 1431669 (0.0005) [2023-12-28 05:31:34,171][106226] Updated weights for policy 0, policy_version 1428433 (0.0008) [2023-12-28 05:31:34,232][106226] Updated weights for policy 0, policy_version 1428443 (0.0006) [2023-12-28 05:31:34,290][106226] Updated weights for policy 0, policy_version 1428453 (0.0008) [2023-12-28 05:31:34,356][106226] Updated weights for policy 0, policy_version 1428463 (0.0007) [2023-12-28 05:31:34,744][106225] Updated weights for policy 1, policy_version 1431679 (0.0009) [2023-12-28 05:31:34,805][106225] Updated weights for policy 1, policy_version 1431689 (0.0009) [2023-12-28 05:31:34,870][106225] Updated weights for policy 1, policy_version 1431699 (0.0011) [2023-12-28 05:31:35,101][106226] Updated weights for policy 0, policy_version 1428473 (0.0009) [2023-12-28 05:31:35,161][106226] Updated weights for policy 0, policy_version 1428483 (0.0006) [2023-12-28 05:31:35,220][106226] Updated weights for policy 0, policy_version 1428493 (0.0007) [2023-12-28 05:31:35,605][106225] Updated weights for policy 1, policy_version 1431709 (0.0011) [2023-12-28 05:31:35,667][106225] Updated weights for policy 1, policy_version 1431719 (0.0010) [2023-12-28 05:31:35,726][106225] Updated weights for policy 1, policy_version 1431729 (0.0010) [2023-12-28 05:31:35,942][106226] Updated weights for policy 0, policy_version 1428503 (0.0009) [2023-12-28 05:31:36,002][106226] Updated weights for policy 0, policy_version 1428513 (0.0007) [2023-12-28 05:31:36,051][106226] Updated weights for policy 0, policy_version 1428523 (0.0006) [2023-12-28 05:31:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 732348416. Throughput: 0: 9782.9, 1: 9818.3. Samples: 732355624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:36,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-4.697')] [2023-12-28 05:31:36,354][106225] Updated weights for policy 1, policy_version 1431739 (0.0010) [2023-12-28 05:31:36,417][106225] Updated weights for policy 1, policy_version 1431749 (0.0011) [2023-12-28 05:31:36,479][106225] Updated weights for policy 1, policy_version 1431759 (0.0010) [2023-12-28 05:31:36,833][106226] Updated weights for policy 0, policy_version 1428533 (0.0008) [2023-12-28 05:31:36,894][106226] Updated weights for policy 0, policy_version 1428543 (0.0008) [2023-12-28 05:31:36,945][106226] Updated weights for policy 0, policy_version 1428553 (0.0008) [2023-12-28 05:31:37,176][106225] Updated weights for policy 1, policy_version 1431769 (0.0011) [2023-12-28 05:31:37,233][106225] Updated weights for policy 1, policy_version 1431779 (0.0010) [2023-12-28 05:31:37,291][106225] Updated weights for policy 1, policy_version 1431789 (0.0010) [2023-12-28 05:31:37,348][106225] Updated weights for policy 1, policy_version 1431799 (0.0010) [2023-12-28 05:31:37,664][106226] Updated weights for policy 0, policy_version 1428563 (0.0007) [2023-12-28 05:31:37,721][106226] Updated weights for policy 0, policy_version 1428573 (0.0008) [2023-12-28 05:31:37,785][106226] Updated weights for policy 0, policy_version 1428583 (0.0008) [2023-12-28 05:31:37,994][106225] Updated weights for policy 1, policy_version 1431809 (0.0010) [2023-12-28 05:31:38,040][106225] Updated weights for policy 1, policy_version 1431819 (0.0010) [2023-12-28 05:31:38,095][106225] Updated weights for policy 1, policy_version 1431829 (0.0010) [2023-12-28 05:31:38,479][106226] Updated weights for policy 0, policy_version 1428593 (0.0008) [2023-12-28 05:31:38,544][106226] Updated weights for policy 0, policy_version 1428603 (0.0007) [2023-12-28 05:31:38,610][106226] Updated weights for policy 0, policy_version 1428613 (0.0008) [2023-12-28 05:31:38,675][106226] Updated weights for policy 0, policy_version 1428623 (0.0008) [2023-12-28 05:31:38,830][106225] Updated weights for policy 1, policy_version 1431839 (0.0007) [2023-12-28 05:31:38,891][106225] Updated weights for policy 1, policy_version 1431849 (0.0007) [2023-12-28 05:31:38,946][106225] Updated weights for policy 1, policy_version 1431859 (0.0005) [2023-12-28 05:31:39,480][106226] Updated weights for policy 0, policy_version 1428633 (0.0009) [2023-12-28 05:31:39,538][106225] Updated weights for policy 1, policy_version 1431869 (0.0008) [2023-12-28 05:31:39,538][106226] Updated weights for policy 0, policy_version 1428643 (0.0009) [2023-12-28 05:31:39,598][106226] Updated weights for policy 0, policy_version 1428653 (0.0007) [2023-12-28 05:31:39,600][106225] Updated weights for policy 1, policy_version 1431879 (0.0011) [2023-12-28 05:31:39,657][106225] Updated weights for policy 1, policy_version 1431889 (0.0010) [2023-12-28 05:31:40,374][106226] Updated weights for policy 0, policy_version 1428663 (0.0008) [2023-12-28 05:31:40,412][106225] Updated weights for policy 1, policy_version 1431899 (0.0010) [2023-12-28 05:31:40,430][106226] Updated weights for policy 0, policy_version 1428673 (0.0008) [2023-12-28 05:31:40,464][106225] Updated weights for policy 1, policy_version 1431909 (0.0010) [2023-12-28 05:31:40,490][106226] Updated weights for policy 0, policy_version 1428683 (0.0006) [2023-12-28 05:31:40,526][106225] Updated weights for policy 1, policy_version 1431919 (0.0011) [2023-12-28 05:31:41,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 732438528. Throughput: 0: 9807.6, 1: 9847.6. Samples: 732414780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:31:41,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-4.910')] [2023-12-28 05:31:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001428688_365813760.pth... [2023-12-28 05:31:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001431928_366624768.pth... [2023-12-28 05:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001427568_365527040.pth [2023-12-28 05:31:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001430808_366338048.pth [2023-12-28 05:31:41,246][106226] Updated weights for policy 0, policy_version 1428693 (0.0008) [2023-12-28 05:31:41,272][106225] Updated weights for policy 1, policy_version 1431929 (0.0010) [2023-12-28 05:31:41,309][106226] Updated weights for policy 0, policy_version 1428703 (0.0006) [2023-12-28 05:31:41,327][106225] Updated weights for policy 1, policy_version 1431939 (0.0010) [2023-12-28 05:31:41,373][106226] Updated weights for policy 0, policy_version 1428713 (0.0007) [2023-12-28 05:31:41,399][106225] Updated weights for policy 1, policy_version 1431949 (0.0011) [2023-12-28 05:31:41,465][106225] Updated weights for policy 1, policy_version 1431959 (0.0008) [2023-12-28 05:31:42,118][106226] Updated weights for policy 0, policy_version 1428723 (0.0007) [2023-12-28 05:31:42,175][106226] Updated weights for policy 0, policy_version 1428733 (0.0008) [2023-12-28 05:31:42,208][106225] Updated weights for policy 1, policy_version 1431969 (0.0009) [2023-12-28 05:31:42,236][106226] Updated weights for policy 0, policy_version 1428743 (0.0007) [2023-12-28 05:31:42,274][106225] Updated weights for policy 1, policy_version 1431979 (0.0008) [2023-12-28 05:31:42,326][106225] Updated weights for policy 1, policy_version 1431989 (0.0008) [2023-12-28 05:31:42,862][106226] Updated weights for policy 0, policy_version 1428753 (0.0008) [2023-12-28 05:31:42,919][106226] Updated weights for policy 0, policy_version 1428763 (0.0007) [2023-12-28 05:31:42,977][106226] Updated weights for policy 0, policy_version 1428773 (0.0006) [2023-12-28 05:31:43,033][106226] Updated weights for policy 0, policy_version 1428783 (0.0008) [2023-12-28 05:31:43,173][106225] Updated weights for policy 1, policy_version 1431999 (0.0009) [2023-12-28 05:31:43,222][106225] Updated weights for policy 1, policy_version 1432009 (0.0008) [2023-12-28 05:31:43,272][106225] Updated weights for policy 1, policy_version 1432019 (0.0008) [2023-12-28 05:31:43,690][106226] Updated weights for policy 0, policy_version 1428794 (0.0006) [2023-12-28 05:31:43,751][106226] Updated weights for policy 0, policy_version 1428804 (0.0005) [2023-12-28 05:31:43,819][106226] Updated weights for policy 0, policy_version 1428814 (0.0005) [2023-12-28 05:31:44,026][106225] Updated weights for policy 1, policy_version 1432029 (0.0009) [2023-12-28 05:31:44,081][106225] Updated weights for policy 1, policy_version 1432039 (0.0008) [2023-12-28 05:31:44,144][106225] Updated weights for policy 1, policy_version 1432049 (0.0008) [2023-12-28 05:31:44,490][106226] Updated weights for policy 0, policy_version 1428824 (0.0008) [2023-12-28 05:31:44,553][106226] Updated weights for policy 0, policy_version 1428834 (0.0009) [2023-12-28 05:31:44,608][106226] Updated weights for policy 0, policy_version 1428844 (0.0008) [2023-12-28 05:31:44,843][106225] Updated weights for policy 1, policy_version 1432059 (0.0008) [2023-12-28 05:31:44,910][106225] Updated weights for policy 1, policy_version 1432069 (0.0008) [2023-12-28 05:31:44,975][106225] Updated weights for policy 1, policy_version 1432079 (0.0009) [2023-12-28 05:31:45,299][106226] Updated weights for policy 0, policy_version 1428854 (0.0007) [2023-12-28 05:31:45,367][106226] Updated weights for policy 0, policy_version 1428864 (0.0005) [2023-12-28 05:31:45,425][106226] Updated weights for policy 0, policy_version 1428874 (0.0005) [2023-12-28 05:31:45,774][106225] Updated weights for policy 1, policy_version 1432089 (0.0008) [2023-12-28 05:31:45,831][106225] Updated weights for policy 1, policy_version 1432099 (0.0006) [2023-12-28 05:31:45,882][106225] Updated weights for policy 1, policy_version 1432109 (0.0005) [2023-12-28 05:31:45,937][106225] Updated weights for policy 1, policy_version 1432119 (0.0006) [2023-12-28 05:31:46,047][106226] Updated weights for policy 0, policy_version 1428884 (0.0008) [2023-12-28 05:31:46,109][106226] Updated weights for policy 0, policy_version 1428894 (0.0008) [2023-12-28 05:31:46,163][106226] Updated weights for policy 0, policy_version 1428904 (0.0008) [2023-12-28 05:31:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 732536832. Throughput: 0: 9798.0, 1: 9745.5. Samples: 732529404. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:31:46,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.567')] [2023-12-28 05:31:46,596][106225] Updated weights for policy 1, policy_version 1432129 (0.0010) [2023-12-28 05:31:46,653][106225] Updated weights for policy 1, policy_version 1432139 (0.0010) [2023-12-28 05:31:46,706][106225] Updated weights for policy 1, policy_version 1432149 (0.0007) [2023-12-28 05:31:46,911][106226] Updated weights for policy 0, policy_version 1428914 (0.0008) [2023-12-28 05:31:46,973][106226] Updated weights for policy 0, policy_version 1428924 (0.0008) [2023-12-28 05:31:47,039][106226] Updated weights for policy 0, policy_version 1428934 (0.0008) [2023-12-28 05:31:47,099][106226] Updated weights for policy 0, policy_version 1428944 (0.0008) [2023-12-28 05:31:47,408][106225] Updated weights for policy 1, policy_version 1432159 (0.0009) [2023-12-28 05:31:47,453][106225] Updated weights for policy 1, policy_version 1432169 (0.0008) [2023-12-28 05:31:47,500][106225] Updated weights for policy 1, policy_version 1432179 (0.0005) [2023-12-28 05:31:47,844][106226] Updated weights for policy 0, policy_version 1428954 (0.0010) [2023-12-28 05:31:47,900][106226] Updated weights for policy 0, policy_version 1428964 (0.0009) [2023-12-28 05:31:47,958][106226] Updated weights for policy 0, policy_version 1428974 (0.0009) [2023-12-28 05:31:48,119][106225] Updated weights for policy 1, policy_version 1432189 (0.0008) [2023-12-28 05:31:48,182][106225] Updated weights for policy 1, policy_version 1432199 (0.0008) [2023-12-28 05:31:48,240][106225] Updated weights for policy 1, policy_version 1432209 (0.0008) [2023-12-28 05:31:48,710][106226] Updated weights for policy 0, policy_version 1428984 (0.0008) [2023-12-28 05:31:48,773][106226] Updated weights for policy 0, policy_version 1428994 (0.0008) [2023-12-28 05:31:48,828][106226] Updated weights for policy 0, policy_version 1429004 (0.0010) [2023-12-28 05:31:48,906][106225] Updated weights for policy 1, policy_version 1432219 (0.0009) [2023-12-28 05:31:48,962][106225] Updated weights for policy 1, policy_version 1432229 (0.0008) [2023-12-28 05:31:49,014][106225] Updated weights for policy 1, policy_version 1432239 (0.0008) [2023-12-28 05:31:49,590][106226] Updated weights for policy 0, policy_version 1429014 (0.0009) [2023-12-28 05:31:49,641][106226] Updated weights for policy 0, policy_version 1429024 (0.0008) [2023-12-28 05:31:49,694][106226] Updated weights for policy 0, policy_version 1429034 (0.0009) [2023-12-28 05:31:49,763][106225] Updated weights for policy 1, policy_version 1432249 (0.0008) [2023-12-28 05:31:49,833][106225] Updated weights for policy 1, policy_version 1432259 (0.0009) [2023-12-28 05:31:49,900][106225] Updated weights for policy 1, policy_version 1432269 (0.0009) [2023-12-28 05:31:49,964][106225] Updated weights for policy 1, policy_version 1432279 (0.0007) [2023-12-28 05:31:50,421][106226] Updated weights for policy 0, policy_version 1429044 (0.0007) [2023-12-28 05:31:50,480][106226] Updated weights for policy 0, policy_version 1429054 (0.0005) [2023-12-28 05:31:50,535][106226] Updated weights for policy 0, policy_version 1429064 (0.0005) [2023-12-28 05:31:50,701][106225] Updated weights for policy 1, policy_version 1432289 (0.0008) [2023-12-28 05:31:50,758][106225] Updated weights for policy 1, policy_version 1432299 (0.0009) [2023-12-28 05:31:50,814][106225] Updated weights for policy 1, policy_version 1432309 (0.0009) [2023-12-28 05:31:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 732635136. Throughput: 0: 9760.6, 1: 9733.7. Samples: 732646432. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:31:51,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.404')] [2023-12-28 05:31:51,265][106226] Updated weights for policy 0, policy_version 1429075 (0.0007) [2023-12-28 05:31:51,328][106226] Updated weights for policy 0, policy_version 1429085 (0.0008) [2023-12-28 05:31:51,401][106226] Updated weights for policy 0, policy_version 1429095 (0.0009) [2023-12-28 05:31:51,581][106225] Updated weights for policy 1, policy_version 1432319 (0.0008) [2023-12-28 05:31:51,638][106225] Updated weights for policy 1, policy_version 1432329 (0.0008) [2023-12-28 05:31:51,696][106225] Updated weights for policy 1, policy_version 1432339 (0.0006) [2023-12-28 05:31:52,131][106226] Updated weights for policy 0, policy_version 1429105 (0.0007) [2023-12-28 05:31:52,194][106226] Updated weights for policy 0, policy_version 1429115 (0.0009) [2023-12-28 05:31:52,253][106226] Updated weights for policy 0, policy_version 1429125 (0.0006) [2023-12-28 05:31:52,311][106226] Updated weights for policy 0, policy_version 1429135 (0.0005) [2023-12-28 05:31:52,362][106225] Updated weights for policy 1, policy_version 1432349 (0.0007) [2023-12-28 05:31:52,431][106225] Updated weights for policy 1, policy_version 1432359 (0.0009) [2023-12-28 05:31:52,497][106225] Updated weights for policy 1, policy_version 1432369 (0.0008) [2023-12-28 05:31:53,011][106226] Updated weights for policy 0, policy_version 1429145 (0.0008) [2023-12-28 05:31:53,074][106226] Updated weights for policy 0, policy_version 1429155 (0.0006) [2023-12-28 05:31:53,138][106226] Updated weights for policy 0, policy_version 1429165 (0.0008) [2023-12-28 05:31:53,182][106225] Updated weights for policy 1, policy_version 1432379 (0.0008) [2023-12-28 05:31:53,241][106225] Updated weights for policy 1, policy_version 1432389 (0.0010) [2023-12-28 05:31:53,299][106225] Updated weights for policy 1, policy_version 1432399 (0.0009) [2023-12-28 05:31:53,878][106226] Updated weights for policy 0, policy_version 1429175 (0.0008) [2023-12-28 05:31:53,904][106225] Updated weights for policy 1, policy_version 1432409 (0.0008) [2023-12-28 05:31:53,943][106226] Updated weights for policy 0, policy_version 1429185 (0.0008) [2023-12-28 05:31:53,956][106225] Updated weights for policy 1, policy_version 1432419 (0.0007) [2023-12-28 05:31:54,007][106226] Updated weights for policy 0, policy_version 1429195 (0.0007) [2023-12-28 05:31:54,008][106225] Updated weights for policy 1, policy_version 1432429 (0.0008) [2023-12-28 05:31:54,064][106225] Updated weights for policy 1, policy_version 1432439 (0.0006) [2023-12-28 05:31:54,744][106226] Updated weights for policy 0, policy_version 1429205 (0.0007) [2023-12-28 05:31:54,769][106225] Updated weights for policy 1, policy_version 1432449 (0.0007) [2023-12-28 05:31:54,797][106226] Updated weights for policy 0, policy_version 1429215 (0.0006) [2023-12-28 05:31:54,816][106225] Updated weights for policy 1, policy_version 1432459 (0.0006) [2023-12-28 05:31:54,860][106226] Updated weights for policy 0, policy_version 1429225 (0.0008) [2023-12-28 05:31:54,860][106225] Updated weights for policy 1, policy_version 1432469 (0.0007) [2023-12-28 05:31:55,555][106225] Updated weights for policy 1, policy_version 1432479 (0.0006) [2023-12-28 05:31:55,600][106225] Updated weights for policy 1, policy_version 1432489 (0.0006) [2023-12-28 05:31:55,622][106226] Updated weights for policy 0, policy_version 1429235 (0.0009) [2023-12-28 05:31:55,660][106225] Updated weights for policy 1, policy_version 1432499 (0.0006) [2023-12-28 05:31:55,678][106226] Updated weights for policy 0, policy_version 1429245 (0.0007) [2023-12-28 05:31:55,741][106226] Updated weights for policy 0, policy_version 1429255 (0.0008) [2023-12-28 05:31:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 732733440. Throughput: 0: 9731.7, 1: 9741.2. Samples: 732704144. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:31:56,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.694')] [2023-12-28 05:31:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001429264_365961216.pth... [2023-12-28 05:31:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001432504_366772224.pth... [2023-12-28 05:31:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001428144_365674496.pth [2023-12-28 05:31:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001431352_366477312.pth [2023-12-28 05:31:56,261][106225] Updated weights for policy 1, policy_version 1432509 (0.0009) [2023-12-28 05:31:56,312][106225] Updated weights for policy 1, policy_version 1432519 (0.0009) [2023-12-28 05:31:56,366][106225] Updated weights for policy 1, policy_version 1432529 (0.0008) [2023-12-28 05:31:56,434][106226] Updated weights for policy 0, policy_version 1429265 (0.0009) [2023-12-28 05:31:56,493][106226] Updated weights for policy 0, policy_version 1429275 (0.0009) [2023-12-28 05:31:56,553][106226] Updated weights for policy 0, policy_version 1429285 (0.0009) [2023-12-28 05:31:56,608][106226] Updated weights for policy 0, policy_version 1429295 (0.0009) [2023-12-28 05:31:57,061][106225] Updated weights for policy 1, policy_version 1432539 (0.0010) [2023-12-28 05:31:57,110][106225] Updated weights for policy 1, policy_version 1432549 (0.0010) [2023-12-28 05:31:57,163][106225] Updated weights for policy 1, policy_version 1432559 (0.0010) [2023-12-28 05:31:57,306][106226] Updated weights for policy 0, policy_version 1429305 (0.0008) [2023-12-28 05:31:57,370][106226] Updated weights for policy 0, policy_version 1429315 (0.0010) [2023-12-28 05:31:57,418][106226] Updated weights for policy 0, policy_version 1429325 (0.0008) [2023-12-28 05:31:57,765][106225] Updated weights for policy 1, policy_version 1432569 (0.0008) [2023-12-28 05:31:57,818][106225] Updated weights for policy 1, policy_version 1432579 (0.0005) [2023-12-28 05:31:57,870][106225] Updated weights for policy 1, policy_version 1432589 (0.0005) [2023-12-28 05:31:57,931][106225] Updated weights for policy 1, policy_version 1432599 (0.0005) [2023-12-28 05:31:58,181][106226] Updated weights for policy 0, policy_version 1429335 (0.0010) [2023-12-28 05:31:58,244][106226] Updated weights for policy 0, policy_version 1429345 (0.0009) [2023-12-28 05:31:58,307][106226] Updated weights for policy 0, policy_version 1429355 (0.0007) [2023-12-28 05:31:58,559][106225] Updated weights for policy 1, policy_version 1432609 (0.0008) [2023-12-28 05:31:58,627][106225] Updated weights for policy 1, policy_version 1432619 (0.0009) [2023-12-28 05:31:58,690][106225] Updated weights for policy 1, policy_version 1432629 (0.0009) [2023-12-28 05:31:59,123][106226] Updated weights for policy 0, policy_version 1429365 (0.0009) [2023-12-28 05:31:59,192][106226] Updated weights for policy 0, policy_version 1429375 (0.0011) [2023-12-28 05:31:59,263][106226] Updated weights for policy 0, policy_version 1429385 (0.0009) [2023-12-28 05:31:59,557][106225] Updated weights for policy 1, policy_version 1432639 (0.0007) [2023-12-28 05:31:59,614][106225] Updated weights for policy 1, policy_version 1432649 (0.0006) [2023-12-28 05:31:59,673][106225] Updated weights for policy 1, policy_version 1432659 (0.0006) [2023-12-28 05:31:59,998][106226] Updated weights for policy 0, policy_version 1429395 (0.0007) [2023-12-28 05:32:00,059][106226] Updated weights for policy 0, policy_version 1429406 (0.0009) [2023-12-28 05:32:00,109][106226] Updated weights for policy 0, policy_version 1429416 (0.0009) [2023-12-28 05:32:00,280][106225] Updated weights for policy 1, policy_version 1432669 (0.0008) [2023-12-28 05:32:00,330][106225] Updated weights for policy 1, policy_version 1432679 (0.0008) [2023-12-28 05:32:00,394][106225] Updated weights for policy 1, policy_version 1432689 (0.0005) [2023-12-28 05:32:00,824][106226] Updated weights for policy 0, policy_version 1429426 (0.0006) [2023-12-28 05:32:00,871][106226] Updated weights for policy 0, policy_version 1429436 (0.0006) [2023-12-28 05:32:00,924][106226] Updated weights for policy 0, policy_version 1429446 (0.0008) [2023-12-28 05:32:00,978][106226] Updated weights for policy 0, policy_version 1429456 (0.0008) [2023-12-28 05:32:01,102][106225] Updated weights for policy 1, policy_version 1432699 (0.0006) [2023-12-28 05:32:01,167][106225] Updated weights for policy 1, policy_version 1432709 (0.0009) [2023-12-28 05:32:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 732831744. Throughput: 0: 9749.1, 1: 9815.5. Samples: 732821432. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:01,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-4.767')] [2023-12-28 05:32:01,226][106225] Updated weights for policy 1, policy_version 1432719 (0.0010) [2023-12-28 05:32:01,696][106226] Updated weights for policy 0, policy_version 1429466 (0.0008) [2023-12-28 05:32:01,765][106226] Updated weights for policy 0, policy_version 1429476 (0.0009) [2023-12-28 05:32:01,819][106226] Updated weights for policy 0, policy_version 1429486 (0.0009) [2023-12-28 05:32:01,903][106225] Updated weights for policy 1, policy_version 1432729 (0.0009) [2023-12-28 05:32:01,962][106225] Updated weights for policy 1, policy_version 1432739 (0.0009) [2023-12-28 05:32:02,011][106225] Updated weights for policy 1, policy_version 1432749 (0.0009) [2023-12-28 05:32:02,077][106225] Updated weights for policy 1, policy_version 1432759 (0.0006) [2023-12-28 05:32:02,580][106226] Updated weights for policy 0, policy_version 1429496 (0.0006) [2023-12-28 05:32:02,637][106226] Updated weights for policy 0, policy_version 1429506 (0.0006) [2023-12-28 05:32:02,695][106226] Updated weights for policy 0, policy_version 1429516 (0.0008) [2023-12-28 05:32:02,789][106225] Updated weights for policy 1, policy_version 1432769 (0.0010) [2023-12-28 05:32:02,839][106225] Updated weights for policy 1, policy_version 1432779 (0.0010) [2023-12-28 05:32:02,896][106225] Updated weights for policy 1, policy_version 1432789 (0.0010) [2023-12-28 05:32:03,335][106226] Updated weights for policy 0, policy_version 1429526 (0.0009) [2023-12-28 05:32:03,389][106226] Updated weights for policy 0, policy_version 1429536 (0.0008) [2023-12-28 05:32:03,447][106226] Updated weights for policy 0, policy_version 1429546 (0.0009) [2023-12-28 05:32:03,555][106225] Updated weights for policy 1, policy_version 1432799 (0.0010) [2023-12-28 05:32:03,614][106225] Updated weights for policy 1, policy_version 1432809 (0.0009) [2023-12-28 05:32:03,673][106225] Updated weights for policy 1, policy_version 1432819 (0.0005) [2023-12-28 05:32:04,120][106226] Updated weights for policy 0, policy_version 1429556 (0.0008) [2023-12-28 05:32:04,178][106226] Updated weights for policy 0, policy_version 1429566 (0.0008) [2023-12-28 05:32:04,245][106226] Updated weights for policy 0, policy_version 1429576 (0.0008) [2023-12-28 05:32:04,387][106225] Updated weights for policy 1, policy_version 1432829 (0.0009) [2023-12-28 05:32:04,444][106225] Updated weights for policy 1, policy_version 1432839 (0.0010) [2023-12-28 05:32:04,505][106225] Updated weights for policy 1, policy_version 1432849 (0.0010) [2023-12-28 05:32:05,039][106226] Updated weights for policy 0, policy_version 1429586 (0.0008) [2023-12-28 05:32:05,102][106226] Updated weights for policy 0, policy_version 1429596 (0.0006) [2023-12-28 05:32:05,160][106226] Updated weights for policy 0, policy_version 1429606 (0.0005) [2023-12-28 05:32:05,213][106225] Updated weights for policy 1, policy_version 1432859 (0.0010) [2023-12-28 05:32:05,227][106226] Updated weights for policy 0, policy_version 1429616 (0.0006) [2023-12-28 05:32:05,286][106225] Updated weights for policy 1, policy_version 1432869 (0.0008) [2023-12-28 05:32:05,344][106225] Updated weights for policy 1, policy_version 1432879 (0.0008) [2023-12-28 05:32:05,756][106226] Updated weights for policy 0, policy_version 1429626 (0.0008) [2023-12-28 05:32:05,816][106226] Updated weights for policy 0, policy_version 1429636 (0.0008) [2023-12-28 05:32:05,869][106226] Updated weights for policy 0, policy_version 1429646 (0.0008) [2023-12-28 05:32:06,057][106225] Updated weights for policy 1, policy_version 1432889 (0.0008) [2023-12-28 05:32:06,108][106225] Updated weights for policy 1, policy_version 1432899 (0.0010) [2023-12-28 05:32:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19744.1). Total num frames: 732930048. Throughput: 0: 9680.3, 1: 9909.1. Samples: 732941604. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:06,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-4.662')] [2023-12-28 05:32:06,176][106225] Updated weights for policy 1, policy_version 1432909 (0.0010) [2023-12-28 05:32:06,244][106225] Updated weights for policy 1, policy_version 1432919 (0.0009) [2023-12-28 05:32:06,629][106226] Updated weights for policy 0, policy_version 1429656 (0.0010) [2023-12-28 05:32:06,693][106226] Updated weights for policy 0, policy_version 1429666 (0.0009) [2023-12-28 05:32:06,760][106226] Updated weights for policy 0, policy_version 1429676 (0.0009) [2023-12-28 05:32:06,865][106225] Updated weights for policy 1, policy_version 1432929 (0.0006) [2023-12-28 05:32:06,931][106225] Updated weights for policy 1, policy_version 1432939 (0.0009) [2023-12-28 05:32:06,994][106225] Updated weights for policy 1, policy_version 1432949 (0.0009) [2023-12-28 05:32:07,575][106226] Updated weights for policy 0, policy_version 1429686 (0.0010) [2023-12-28 05:32:07,577][106225] Updated weights for policy 1, policy_version 1432959 (0.0010) [2023-12-28 05:32:07,632][106226] Updated weights for policy 0, policy_version 1429696 (0.0011) [2023-12-28 05:32:07,641][106225] Updated weights for policy 1, policy_version 1432969 (0.0010) [2023-12-28 05:32:07,685][106226] Updated weights for policy 0, policy_version 1429706 (0.0010) [2023-12-28 05:32:07,700][106225] Updated weights for policy 1, policy_version 1432979 (0.0010) [2023-12-28 05:32:08,256][106226] Updated weights for policy 0, policy_version 1429716 (0.0009) [2023-12-28 05:32:08,334][106226] Updated weights for policy 0, policy_version 1429728 (0.0008) [2023-12-28 05:32:08,410][106225] Updated weights for policy 1, policy_version 1432989 (0.0011) [2023-12-28 05:32:08,428][106226] Updated weights for policy 0, policy_version 1429739 (0.0008) [2023-12-28 05:32:08,467][106225] Updated weights for policy 1, policy_version 1432999 (0.0010) [2023-12-28 05:32:08,524][106225] Updated weights for policy 1, policy_version 1433009 (0.0010) [2023-12-28 05:32:09,134][106226] Updated weights for policy 0, policy_version 1429749 (0.0008) [2023-12-28 05:32:09,187][106226] Updated weights for policy 0, policy_version 1429759 (0.0008) [2023-12-28 05:32:09,247][106225] Updated weights for policy 1, policy_version 1433019 (0.0010) [2023-12-28 05:32:09,249][106226] Updated weights for policy 0, policy_version 1429769 (0.0007) [2023-12-28 05:32:09,313][106225] Updated weights for policy 1, policy_version 1433029 (0.0009) [2023-12-28 05:32:09,379][106225] Updated weights for policy 1, policy_version 1433039 (0.0009) [2023-12-28 05:32:10,026][106225] Updated weights for policy 1, policy_version 1433049 (0.0008) [2023-12-28 05:32:10,057][106226] Updated weights for policy 0, policy_version 1429779 (0.0007) [2023-12-28 05:32:10,094][106225] Updated weights for policy 1, policy_version 1433059 (0.0006) [2023-12-28 05:32:10,124][106226] Updated weights for policy 0, policy_version 1429789 (0.0007) [2023-12-28 05:32:10,154][106225] Updated weights for policy 1, policy_version 1433069 (0.0007) [2023-12-28 05:32:10,184][106226] Updated weights for policy 0, policy_version 1429799 (0.0008) [2023-12-28 05:32:10,210][106225] Updated weights for policy 1, policy_version 1433079 (0.0006) [2023-12-28 05:32:10,896][106226] Updated weights for policy 0, policy_version 1429809 (0.0008) [2023-12-28 05:32:10,919][106225] Updated weights for policy 1, policy_version 1433089 (0.0010) [2023-12-28 05:32:10,954][106226] Updated weights for policy 0, policy_version 1429819 (0.0010) [2023-12-28 05:32:10,966][106225] Updated weights for policy 1, policy_version 1433099 (0.0009) [2023-12-28 05:32:11,020][106225] Updated weights for policy 1, policy_version 1433109 (0.0007) [2023-12-28 05:32:11,037][106226] Updated weights for policy 0, policy_version 1429829 (0.0010) [2023-12-28 05:32:11,109][106226] Updated weights for policy 0, policy_version 1429839 (0.0008) [2023-12-28 05:32:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 733036544. Throughput: 0: 9718.6, 1: 9945.9. Samples: 733001820. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:11,175][105115] Avg episode reward: [(0, '-5.192'), (1, '-4.933')] [2023-12-28 05:32:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001433112_366927872.pth... [2023-12-28 05:32:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001429840_366108672.pth... [2023-12-28 05:32:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001431928_366624768.pth [2023-12-28 05:32:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001428688_365813760.pth [2023-12-28 05:32:11,820][106225] Updated weights for policy 1, policy_version 1433119 (0.0009) [2023-12-28 05:32:11,882][106225] Updated weights for policy 1, policy_version 1433129 (0.0009) [2023-12-28 05:32:11,902][106226] Updated weights for policy 0, policy_version 1429849 (0.0009) [2023-12-28 05:32:11,939][106225] Updated weights for policy 1, policy_version 1433139 (0.0009) [2023-12-28 05:32:11,955][106226] Updated weights for policy 0, policy_version 1429859 (0.0009) [2023-12-28 05:32:12,017][106226] Updated weights for policy 0, policy_version 1429869 (0.0009) [2023-12-28 05:32:12,746][106225] Updated weights for policy 1, policy_version 1433149 (0.0010) [2023-12-28 05:32:12,757][106226] Updated weights for policy 0, policy_version 1429879 (0.0007) [2023-12-28 05:32:12,808][106226] Updated weights for policy 0, policy_version 1429889 (0.0005) [2023-12-28 05:32:12,808][106225] Updated weights for policy 1, policy_version 1433159 (0.0010) [2023-12-28 05:32:12,861][106226] Updated weights for policy 0, policy_version 1429899 (0.0008) [2023-12-28 05:32:12,864][106225] Updated weights for policy 1, policy_version 1433169 (0.0008) [2023-12-28 05:32:13,558][106226] Updated weights for policy 0, policy_version 1429909 (0.0010) [2023-12-28 05:32:13,609][106225] Updated weights for policy 1, policy_version 1433179 (0.0009) [2023-12-28 05:32:13,615][106226] Updated weights for policy 0, policy_version 1429919 (0.0010) [2023-12-28 05:32:13,655][106225] Updated weights for policy 1, policy_version 1433189 (0.0005) [2023-12-28 05:32:13,661][106226] Updated weights for policy 0, policy_version 1429929 (0.0010) [2023-12-28 05:32:13,705][106225] Updated weights for policy 1, policy_version 1433199 (0.0006) [2023-12-28 05:32:14,381][106226] Updated weights for policy 0, policy_version 1429939 (0.0009) [2023-12-28 05:32:14,434][106226] Updated weights for policy 0, policy_version 1429949 (0.0010) [2023-12-28 05:32:14,469][106225] Updated weights for policy 1, policy_version 1433209 (0.0008) [2023-12-28 05:32:14,487][106226] Updated weights for policy 0, policy_version 1429959 (0.0010) [2023-12-28 05:32:14,531][106225] Updated weights for policy 1, policy_version 1433219 (0.0006) [2023-12-28 05:32:14,591][106225] Updated weights for policy 1, policy_version 1433229 (0.0008) [2023-12-28 05:32:14,650][106225] Updated weights for policy 1, policy_version 1433239 (0.0005) [2023-12-28 05:32:15,180][106226] Updated weights for policy 0, policy_version 1429969 (0.0010) [2023-12-28 05:32:15,239][106226] Updated weights for policy 0, policy_version 1429979 (0.0009) [2023-12-28 05:32:15,297][106226] Updated weights for policy 0, policy_version 1429989 (0.0007) [2023-12-28 05:32:15,319][106225] Updated weights for policy 1, policy_version 1433249 (0.0007) [2023-12-28 05:32:15,355][106226] Updated weights for policy 0, policy_version 1429999 (0.0009) [2023-12-28 05:32:15,368][106225] Updated weights for policy 1, policy_version 1433259 (0.0008) [2023-12-28 05:32:15,420][106225] Updated weights for policy 1, policy_version 1433269 (0.0008) [2023-12-28 05:32:15,990][106226] Updated weights for policy 0, policy_version 1430009 (0.0007) [2023-12-28 05:32:16,046][106226] Updated weights for policy 0, policy_version 1430019 (0.0005) [2023-12-28 05:32:16,099][106226] Updated weights for policy 0, policy_version 1430029 (0.0005) [2023-12-28 05:32:16,148][106225] Updated weights for policy 1, policy_version 1433279 (0.0010) [2023-12-28 05:32:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 733126656. Throughput: 0: 9577.5, 1: 9864.6. Samples: 733114956. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:16,175][105115] Avg episode reward: [(0, '-5.029'), (1, '-5.030')] [2023-12-28 05:32:16,196][106225] Updated weights for policy 1, policy_version 1433289 (0.0008) [2023-12-28 05:32:16,241][106225] Updated weights for policy 1, policy_version 1433299 (0.0008) [2023-12-28 05:32:16,701][106226] Updated weights for policy 0, policy_version 1430039 (0.0009) [2023-12-28 05:32:16,763][106226] Updated weights for policy 0, policy_version 1430049 (0.0011) [2023-12-28 05:32:16,817][106226] Updated weights for policy 0, policy_version 1430059 (0.0011) [2023-12-28 05:32:17,062][106225] Updated weights for policy 1, policy_version 1433309 (0.0008) [2023-12-28 05:32:17,121][106225] Updated weights for policy 1, policy_version 1433319 (0.0008) [2023-12-28 05:32:17,179][106225] Updated weights for policy 1, policy_version 1433329 (0.0009) [2023-12-28 05:32:17,461][106226] Updated weights for policy 0, policy_version 1430069 (0.0008) [2023-12-28 05:32:17,513][106226] Updated weights for policy 0, policy_version 1430079 (0.0005) [2023-12-28 05:32:17,571][106226] Updated weights for policy 0, policy_version 1430089 (0.0006) [2023-12-28 05:32:17,919][106225] Updated weights for policy 1, policy_version 1433339 (0.0007) [2023-12-28 05:32:17,989][106225] Updated weights for policy 1, policy_version 1433349 (0.0005) [2023-12-28 05:32:18,057][106225] Updated weights for policy 1, policy_version 1433359 (0.0007) [2023-12-28 05:32:18,095][106226] Updated weights for policy 0, policy_version 1430099 (0.0005) [2023-12-28 05:32:18,164][106226] Updated weights for policy 0, policy_version 1430109 (0.0006) [2023-12-28 05:32:18,225][106226] Updated weights for policy 0, policy_version 1430119 (0.0006) [2023-12-28 05:32:18,751][106225] Updated weights for policy 1, policy_version 1433369 (0.0008) [2023-12-28 05:32:18,803][106225] Updated weights for policy 1, policy_version 1433379 (0.0008) [2023-12-28 05:32:18,851][106225] Updated weights for policy 1, policy_version 1433389 (0.0008) [2023-12-28 05:32:18,902][106225] Updated weights for policy 1, policy_version 1433399 (0.0008) [2023-12-28 05:32:18,903][106226] Updated weights for policy 0, policy_version 1430129 (0.0011) [2023-12-28 05:32:18,953][106226] Updated weights for policy 0, policy_version 1430139 (0.0011) [2023-12-28 05:32:19,002][106226] Updated weights for policy 0, policy_version 1430149 (0.0010) [2023-12-28 05:32:19,053][106226] Updated weights for policy 0, policy_version 1430159 (0.0010) [2023-12-28 05:32:19,722][106225] Updated weights for policy 1, policy_version 1433409 (0.0008) [2023-12-28 05:32:19,785][106225] Updated weights for policy 1, policy_version 1433419 (0.0009) [2023-12-28 05:32:19,848][106226] Updated weights for policy 0, policy_version 1430169 (0.0010) [2023-12-28 05:32:19,856][106225] Updated weights for policy 1, policy_version 1433429 (0.0008) [2023-12-28 05:32:19,909][106226] Updated weights for policy 0, policy_version 1430179 (0.0010) [2023-12-28 05:32:19,975][106226] Updated weights for policy 0, policy_version 1430189 (0.0011) [2023-12-28 05:32:20,561][106225] Updated weights for policy 1, policy_version 1433439 (0.0007) [2023-12-28 05:32:20,619][106225] Updated weights for policy 1, policy_version 1433449 (0.0007) [2023-12-28 05:32:20,682][106225] Updated weights for policy 1, policy_version 1433459 (0.0006) [2023-12-28 05:32:20,803][106226] Updated weights for policy 0, policy_version 1430199 (0.0009) [2023-12-28 05:32:20,855][106226] Updated weights for policy 0, policy_version 1430209 (0.0008) [2023-12-28 05:32:20,914][106226] Updated weights for policy 0, policy_version 1430219 (0.0008) [2023-12-28 05:32:21,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 733224960. Throughput: 0: 9655.0, 1: 9837.3. Samples: 733232780. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:21,175][105115] Avg episode reward: [(0, '-5.139'), (1, '-4.535')] [2023-12-28 05:32:21,372][106225] Updated weights for policy 1, policy_version 1433469 (0.0007) [2023-12-28 05:32:21,433][106225] Updated weights for policy 1, policy_version 1433479 (0.0008) [2023-12-28 05:32:21,488][106225] Updated weights for policy 1, policy_version 1433489 (0.0009) [2023-12-28 05:32:21,644][106226] Updated weights for policy 0, policy_version 1430229 (0.0008) [2023-12-28 05:32:21,706][106226] Updated weights for policy 0, policy_version 1430239 (0.0009) [2023-12-28 05:32:21,775][106226] Updated weights for policy 0, policy_version 1430249 (0.0009) [2023-12-28 05:32:22,302][106225] Updated weights for policy 1, policy_version 1433500 (0.0010) [2023-12-28 05:32:22,364][106225] Updated weights for policy 1, policy_version 1433510 (0.0011) [2023-12-28 05:32:22,425][106225] Updated weights for policy 1, policy_version 1433520 (0.0011) [2023-12-28 05:32:22,576][106226] Updated weights for policy 0, policy_version 1430259 (0.0009) [2023-12-28 05:32:22,630][106226] Updated weights for policy 0, policy_version 1430269 (0.0007) [2023-12-28 05:32:22,682][106226] Updated weights for policy 0, policy_version 1430279 (0.0006) [2023-12-28 05:32:23,139][106225] Updated weights for policy 1, policy_version 1433530 (0.0011) [2023-12-28 05:32:23,190][106225] Updated weights for policy 1, policy_version 1433540 (0.0010) [2023-12-28 05:32:23,247][106225] Updated weights for policy 1, policy_version 1433550 (0.0010) [2023-12-28 05:32:23,310][106225] Updated weights for policy 1, policy_version 1433560 (0.0010) [2023-12-28 05:32:23,384][106226] Updated weights for policy 0, policy_version 1430289 (0.0007) [2023-12-28 05:32:23,437][106226] Updated weights for policy 0, policy_version 1430299 (0.0009) [2023-12-28 05:32:23,494][106226] Updated weights for policy 0, policy_version 1430309 (0.0008) [2023-12-28 05:32:23,543][106226] Updated weights for policy 0, policy_version 1430319 (0.0007) [2023-12-28 05:32:23,977][106225] Updated weights for policy 1, policy_version 1433570 (0.0009) [2023-12-28 05:32:24,028][106225] Updated weights for policy 1, policy_version 1433580 (0.0010) [2023-12-28 05:32:24,081][106225] Updated weights for policy 1, policy_version 1433590 (0.0010) [2023-12-28 05:32:24,267][106226] Updated weights for policy 0, policy_version 1430329 (0.0006) [2023-12-28 05:32:24,332][106226] Updated weights for policy 0, policy_version 1430339 (0.0007) [2023-12-28 05:32:24,395][106226] Updated weights for policy 0, policy_version 1430349 (0.0007) [2023-12-28 05:32:24,724][106225] Updated weights for policy 1, policy_version 1433600 (0.0005) [2023-12-28 05:32:24,776][106225] Updated weights for policy 1, policy_version 1433610 (0.0010) [2023-12-28 05:32:24,833][106225] Updated weights for policy 1, policy_version 1433620 (0.0010) [2023-12-28 05:32:24,965][106226] Updated weights for policy 0, policy_version 1430359 (0.0007) [2023-12-28 05:32:25,020][106226] Updated weights for policy 0, policy_version 1430369 (0.0011) [2023-12-28 05:32:25,073][106226] Updated weights for policy 0, policy_version 1430379 (0.0009) [2023-12-28 05:32:25,534][106225] Updated weights for policy 1, policy_version 1433630 (0.0007) [2023-12-28 05:32:25,581][106225] Updated weights for policy 1, policy_version 1433640 (0.0008) [2023-12-28 05:32:25,633][106225] Updated weights for policy 1, policy_version 1433650 (0.0009) [2023-12-28 05:32:25,738][106226] Updated weights for policy 0, policy_version 1430389 (0.0008) [2023-12-28 05:32:25,783][106226] Updated weights for policy 0, policy_version 1430399 (0.0005) [2023-12-28 05:32:25,834][106226] Updated weights for policy 0, policy_version 1430409 (0.0005) [2023-12-28 05:32:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 733323264. Throughput: 0: 9656.4, 1: 9796.8. Samples: 733290176. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:26,176][105115] Avg episode reward: [(0, '-4.779'), (1, '-5.093')] [2023-12-28 05:32:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001430416_366256128.pth... [2023-12-28 05:32:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001433656_367067136.pth... [2023-12-28 05:32:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001429264_365961216.pth [2023-12-28 05:32:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001432504_366772224.pth [2023-12-28 05:32:26,342][106225] Updated weights for policy 1, policy_version 1433661 (0.0007) [2023-12-28 05:32:26,408][106225] Updated weights for policy 1, policy_version 1433671 (0.0005) [2023-12-28 05:32:26,466][106225] Updated weights for policy 1, policy_version 1433681 (0.0005) [2023-12-28 05:32:26,580][106226] Updated weights for policy 0, policy_version 1430419 (0.0006) [2023-12-28 05:32:26,636][106226] Updated weights for policy 0, policy_version 1430429 (0.0005) [2023-12-28 05:32:26,685][106226] Updated weights for policy 0, policy_version 1430439 (0.0005) [2023-12-28 05:32:27,045][106225] Updated weights for policy 1, policy_version 1433691 (0.0006) [2023-12-28 05:32:27,108][106225] Updated weights for policy 1, policy_version 1433701 (0.0009) [2023-12-28 05:32:27,165][106225] Updated weights for policy 1, policy_version 1433711 (0.0010) [2023-12-28 05:32:27,223][106226] Updated weights for policy 0, policy_version 1430449 (0.0006) [2023-12-28 05:32:27,278][106226] Updated weights for policy 0, policy_version 1430459 (0.0010) [2023-12-28 05:32:27,343][106226] Updated weights for policy 0, policy_version 1430469 (0.0010) [2023-12-28 05:32:27,400][106226] Updated weights for policy 0, policy_version 1430479 (0.0010) [2023-12-28 05:32:27,753][106225] Updated weights for policy 1, policy_version 1433721 (0.0010) [2023-12-28 05:32:27,807][106225] Updated weights for policy 1, policy_version 1433731 (0.0005) [2023-12-28 05:32:27,860][106225] Updated weights for policy 1, policy_version 1433741 (0.0005) [2023-12-28 05:32:27,922][106225] Updated weights for policy 1, policy_version 1433751 (0.0005) [2023-12-28 05:32:27,960][106226] Updated weights for policy 0, policy_version 1430489 (0.0011) [2023-12-28 05:32:28,021][106226] Updated weights for policy 0, policy_version 1430499 (0.0011) [2023-12-28 05:32:28,075][106226] Updated weights for policy 0, policy_version 1430509 (0.0007) [2023-12-28 05:32:28,518][106225] Updated weights for policy 1, policy_version 1433761 (0.0010) [2023-12-28 05:32:28,569][106225] Updated weights for policy 1, policy_version 1433771 (0.0010) [2023-12-28 05:32:28,616][106225] Updated weights for policy 1, policy_version 1433781 (0.0010) [2023-12-28 05:32:28,680][106226] Updated weights for policy 0, policy_version 1430519 (0.0005) [2023-12-28 05:32:28,739][106226] Updated weights for policy 0, policy_version 1430529 (0.0005) [2023-12-28 05:32:28,803][106226] Updated weights for policy 0, policy_version 1430539 (0.0006) [2023-12-28 05:32:29,360][106225] Updated weights for policy 1, policy_version 1433791 (0.0009) [2023-12-28 05:32:29,427][106225] Updated weights for policy 1, policy_version 1433801 (0.0008) [2023-12-28 05:32:29,489][106226] Updated weights for policy 0, policy_version 1430549 (0.0011) [2023-12-28 05:32:29,491][106225] Updated weights for policy 1, policy_version 1433811 (0.0007) [2023-12-28 05:32:29,546][106226] Updated weights for policy 0, policy_version 1430559 (0.0010) [2023-12-28 05:32:29,603][106226] Updated weights for policy 0, policy_version 1430569 (0.0010) [2023-12-28 05:32:30,247][106225] Updated weights for policy 1, policy_version 1433821 (0.0007) [2023-12-28 05:32:30,297][106225] Updated weights for policy 1, policy_version 1433831 (0.0008) [2023-12-28 05:32:30,351][106225] Updated weights for policy 1, policy_version 1433841 (0.0008) [2023-12-28 05:32:30,363][106226] Updated weights for policy 0, policy_version 1430579 (0.0011) [2023-12-28 05:32:30,417][106226] Updated weights for policy 0, policy_version 1430589 (0.0010) [2023-12-28 05:32:30,475][106226] Updated weights for policy 0, policy_version 1430599 (0.0008) [2023-12-28 05:32:30,976][106225] Updated weights for policy 1, policy_version 1433851 (0.0007) [2023-12-28 05:32:31,030][106225] Updated weights for policy 1, policy_version 1433861 (0.0006) [2023-12-28 05:32:31,094][106225] Updated weights for policy 1, policy_version 1433871 (0.0008) [2023-12-28 05:32:31,174][106226] Updated weights for policy 0, policy_version 1430609 (0.0010) [2023-12-28 05:32:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 733429760. Throughput: 0: 9813.9, 1: 9932.6. Samples: 733417996. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:31,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.890')] [2023-12-28 05:32:31,237][106226] Updated weights for policy 0, policy_version 1430619 (0.0007) [2023-12-28 05:32:31,307][106226] Updated weights for policy 0, policy_version 1430629 (0.0008) [2023-12-28 05:32:31,368][106226] Updated weights for policy 0, policy_version 1430639 (0.0010) [2023-12-28 05:32:31,754][106225] Updated weights for policy 1, policy_version 1433881 (0.0009) [2023-12-28 05:32:31,809][106225] Updated weights for policy 1, policy_version 1433891 (0.0008) [2023-12-28 05:32:31,866][106225] Updated weights for policy 1, policy_version 1433901 (0.0008) [2023-12-28 05:32:31,912][106225] Updated weights for policy 1, policy_version 1433911 (0.0007) [2023-12-28 05:32:32,056][106226] Updated weights for policy 0, policy_version 1430649 (0.0010) [2023-12-28 05:32:32,122][106226] Updated weights for policy 0, policy_version 1430659 (0.0010) [2023-12-28 05:32:32,182][106226] Updated weights for policy 0, policy_version 1430669 (0.0010) [2023-12-28 05:32:32,665][106225] Updated weights for policy 1, policy_version 1433921 (0.0008) [2023-12-28 05:32:32,722][106225] Updated weights for policy 1, policy_version 1433931 (0.0005) [2023-12-28 05:32:32,785][106225] Updated weights for policy 1, policy_version 1433941 (0.0007) [2023-12-28 05:32:32,789][106226] Updated weights for policy 0, policy_version 1430679 (0.0011) [2023-12-28 05:32:32,842][106226] Updated weights for policy 0, policy_version 1430689 (0.0010) [2023-12-28 05:32:32,901][106226] Updated weights for policy 0, policy_version 1430699 (0.0010) [2023-12-28 05:32:33,403][106225] Updated weights for policy 1, policy_version 1433951 (0.0009) [2023-12-28 05:32:33,460][106225] Updated weights for policy 1, policy_version 1433961 (0.0010) [2023-12-28 05:32:33,518][106225] Updated weights for policy 1, policy_version 1433971 (0.0010) [2023-12-28 05:32:33,595][106226] Updated weights for policy 0, policy_version 1430709 (0.0009) [2023-12-28 05:32:33,642][106226] Updated weights for policy 0, policy_version 1430719 (0.0008) [2023-12-28 05:32:33,686][106226] Updated weights for policy 0, policy_version 1430729 (0.0007) [2023-12-28 05:32:34,181][106225] Updated weights for policy 1, policy_version 1433981 (0.0010) [2023-12-28 05:32:34,241][106225] Updated weights for policy 1, policy_version 1433991 (0.0006) [2023-12-28 05:32:34,303][106225] Updated weights for policy 1, policy_version 1434001 (0.0007) [2023-12-28 05:32:34,311][106226] Updated weights for policy 0, policy_version 1430739 (0.0008) [2023-12-28 05:32:34,372][106226] Updated weights for policy 0, policy_version 1430749 (0.0008) [2023-12-28 05:32:34,444][106226] Updated weights for policy 0, policy_version 1430759 (0.0008) [2023-12-28 05:32:34,867][106225] Updated weights for policy 1, policy_version 1434011 (0.0007) [2023-12-28 05:32:34,922][106225] Updated weights for policy 1, policy_version 1434021 (0.0005) [2023-12-28 05:32:34,969][106225] Updated weights for policy 1, policy_version 1434031 (0.0005) [2023-12-28 05:32:35,209][106226] Updated weights for policy 0, policy_version 1430769 (0.0008) [2023-12-28 05:32:35,273][106226] Updated weights for policy 0, policy_version 1430779 (0.0008) [2023-12-28 05:32:35,330][106226] Updated weights for policy 0, policy_version 1430789 (0.0009) [2023-12-28 05:32:35,380][106226] Updated weights for policy 0, policy_version 1430799 (0.0009) [2023-12-28 05:32:35,690][106225] Updated weights for policy 1, policy_version 1434041 (0.0006) [2023-12-28 05:32:35,751][106225] Updated weights for policy 1, policy_version 1434051 (0.0009) [2023-12-28 05:32:35,813][106225] Updated weights for policy 1, policy_version 1434061 (0.0008) [2023-12-28 05:32:35,861][106225] Updated weights for policy 1, policy_version 1434071 (0.0008) [2023-12-28 05:32:36,058][106226] Updated weights for policy 0, policy_version 1430809 (0.0009) [2023-12-28 05:32:36,115][106226] Updated weights for policy 0, policy_version 1430819 (0.0009) [2023-12-28 05:32:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 733528064. Throughput: 0: 9872.7, 1: 10002.9. Samples: 733540832. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:36,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.698')] [2023-12-28 05:32:36,177][106226] Updated weights for policy 0, policy_version 1430829 (0.0010) [2023-12-28 05:32:36,629][106225] Updated weights for policy 1, policy_version 1434081 (0.0009) [2023-12-28 05:32:36,686][106225] Updated weights for policy 1, policy_version 1434091 (0.0008) [2023-12-28 05:32:36,736][106225] Updated weights for policy 1, policy_version 1434101 (0.0008) [2023-12-28 05:32:36,918][106226] Updated weights for policy 0, policy_version 1430839 (0.0008) [2023-12-28 05:32:36,972][106226] Updated weights for policy 0, policy_version 1430849 (0.0009) [2023-12-28 05:32:37,028][106226] Updated weights for policy 0, policy_version 1430859 (0.0008) [2023-12-28 05:32:37,493][106225] Updated weights for policy 1, policy_version 1434111 (0.0008) [2023-12-28 05:32:37,553][106225] Updated weights for policy 1, policy_version 1434121 (0.0008) [2023-12-28 05:32:37,613][106225] Updated weights for policy 1, policy_version 1434131 (0.0009) [2023-12-28 05:32:37,759][106226] Updated weights for policy 0, policy_version 1430869 (0.0007) [2023-12-28 05:32:37,820][106226] Updated weights for policy 0, policy_version 1430879 (0.0007) [2023-12-28 05:32:37,888][106226] Updated weights for policy 0, policy_version 1430889 (0.0010) [2023-12-28 05:32:38,266][106225] Updated weights for policy 1, policy_version 1434141 (0.0007) [2023-12-28 05:32:38,336][106225] Updated weights for policy 1, policy_version 1434151 (0.0008) [2023-12-28 05:32:38,400][106225] Updated weights for policy 1, policy_version 1434161 (0.0009) [2023-12-28 05:32:38,648][106226] Updated weights for policy 0, policy_version 1430899 (0.0009) [2023-12-28 05:32:38,712][106226] Updated weights for policy 0, policy_version 1430909 (0.0009) [2023-12-28 05:32:38,766][106226] Updated weights for policy 0, policy_version 1430919 (0.0009) [2023-12-28 05:32:39,068][106225] Updated weights for policy 1, policy_version 1434171 (0.0008) [2023-12-28 05:32:39,119][106225] Updated weights for policy 1, policy_version 1434181 (0.0005) [2023-12-28 05:32:39,181][106225] Updated weights for policy 1, policy_version 1434191 (0.0005) [2023-12-28 05:32:39,569][106226] Updated weights for policy 0, policy_version 1430929 (0.0009) [2023-12-28 05:32:39,640][106226] Updated weights for policy 0, policy_version 1430939 (0.0006) [2023-12-28 05:32:39,712][106226] Updated weights for policy 0, policy_version 1430949 (0.0006) [2023-12-28 05:32:39,777][106226] Updated weights for policy 0, policy_version 1430959 (0.0007) [2023-12-28 05:32:39,930][106225] Updated weights for policy 1, policy_version 1434201 (0.0007) [2023-12-28 05:32:39,995][106225] Updated weights for policy 1, policy_version 1434211 (0.0009) [2023-12-28 05:32:40,047][106225] Updated weights for policy 1, policy_version 1434221 (0.0008) [2023-12-28 05:32:40,103][106225] Updated weights for policy 1, policy_version 1434231 (0.0008) [2023-12-28 05:32:40,439][106226] Updated weights for policy 0, policy_version 1430969 (0.0007) [2023-12-28 05:32:40,505][106226] Updated weights for policy 0, policy_version 1430979 (0.0009) [2023-12-28 05:32:40,569][106226] Updated weights for policy 0, policy_version 1430989 (0.0005) [2023-12-28 05:32:40,893][106225] Updated weights for policy 1, policy_version 1434241 (0.0010) [2023-12-28 05:32:40,958][106225] Updated weights for policy 1, policy_version 1434251 (0.0010) [2023-12-28 05:32:41,022][106225] Updated weights for policy 1, policy_version 1434261 (0.0010) [2023-12-28 05:32:41,142][106226] Updated weights for policy 0, policy_version 1430999 (0.0008) [2023-12-28 05:32:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 733626368. Throughput: 0: 9877.7, 1: 9969.9. Samples: 733597284. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:41,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-4.868')] [2023-12-28 05:32:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001434264_367222784.pth... [2023-12-28 05:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001433112_366927872.pth [2023-12-28 05:32:41,208][106226] Updated weights for policy 0, policy_version 1431009 (0.0010) [2023-12-28 05:32:41,277][106226] Updated weights for policy 0, policy_version 1431019 (0.0010) [2023-12-28 05:32:41,301][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001431024_366411776.pth... [2023-12-28 05:32:41,304][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001429840_366108672.pth [2023-12-28 05:32:41,775][106225] Updated weights for policy 1, policy_version 1434271 (0.0008) [2023-12-28 05:32:41,830][106225] Updated weights for policy 1, policy_version 1434281 (0.0006) [2023-12-28 05:32:41,882][106225] Updated weights for policy 1, policy_version 1434291 (0.0008) [2023-12-28 05:32:42,011][106226] Updated weights for policy 0, policy_version 1431029 (0.0011) [2023-12-28 05:32:42,074][106226] Updated weights for policy 0, policy_version 1431039 (0.0011) [2023-12-28 05:32:42,141][106226] Updated weights for policy 0, policy_version 1431049 (0.0011) [2023-12-28 05:32:42,595][106225] Updated weights for policy 1, policy_version 1434301 (0.0007) [2023-12-28 05:32:42,654][106225] Updated weights for policy 1, policy_version 1434311 (0.0008) [2023-12-28 05:32:42,715][106225] Updated weights for policy 1, policy_version 1434321 (0.0008) [2023-12-28 05:32:42,870][106226] Updated weights for policy 0, policy_version 1431059 (0.0011) [2023-12-28 05:32:42,934][106226] Updated weights for policy 0, policy_version 1431069 (0.0011) [2023-12-28 05:32:42,987][106226] Updated weights for policy 0, policy_version 1431079 (0.0010) [2023-12-28 05:32:43,435][106225] Updated weights for policy 1, policy_version 1434331 (0.0008) [2023-12-28 05:32:43,500][106225] Updated weights for policy 1, policy_version 1434341 (0.0009) [2023-12-28 05:32:43,565][106225] Updated weights for policy 1, policy_version 1434351 (0.0007) [2023-12-28 05:32:43,645][106226] Updated weights for policy 0, policy_version 1431089 (0.0011) [2023-12-28 05:32:43,704][106226] Updated weights for policy 0, policy_version 1431099 (0.0011) [2023-12-28 05:32:43,754][106226] Updated weights for policy 0, policy_version 1431109 (0.0010) [2023-12-28 05:32:43,812][106226] Updated weights for policy 0, policy_version 1431119 (0.0011) [2023-12-28 05:32:44,191][106225] Updated weights for policy 1, policy_version 1434361 (0.0009) [2023-12-28 05:32:44,249][106225] Updated weights for policy 1, policy_version 1434371 (0.0006) [2023-12-28 05:32:44,305][106225] Updated weights for policy 1, policy_version 1434381 (0.0005) [2023-12-28 05:32:44,360][106225] Updated weights for policy 1, policy_version 1434391 (0.0007) [2023-12-28 05:32:44,494][106226] Updated weights for policy 0, policy_version 1431129 (0.0010) [2023-12-28 05:32:44,553][106226] Updated weights for policy 0, policy_version 1431139 (0.0010) [2023-12-28 05:32:44,613][106226] Updated weights for policy 0, policy_version 1431149 (0.0010) [2023-12-28 05:32:45,003][106225] Updated weights for policy 1, policy_version 1434401 (0.0011) [2023-12-28 05:32:45,069][106225] Updated weights for policy 1, policy_version 1434411 (0.0011) [2023-12-28 05:32:45,131][106225] Updated weights for policy 1, policy_version 1434421 (0.0011) [2023-12-28 05:32:45,379][106226] Updated weights for policy 0, policy_version 1431159 (0.0011) [2023-12-28 05:32:45,426][106226] Updated weights for policy 0, policy_version 1431169 (0.0010) [2023-12-28 05:32:45,475][106226] Updated weights for policy 0, policy_version 1431179 (0.0010) [2023-12-28 05:32:45,798][106225] Updated weights for policy 1, policy_version 1434431 (0.0010) [2023-12-28 05:32:45,851][106225] Updated weights for policy 1, policy_version 1434441 (0.0010) [2023-12-28 05:32:45,898][106225] Updated weights for policy 1, policy_version 1434451 (0.0010) [2023-12-28 05:32:46,110][106226] Updated weights for policy 0, policy_version 1431189 (0.0008) [2023-12-28 05:32:46,162][106226] Updated weights for policy 0, policy_version 1431199 (0.0006) [2023-12-28 05:32:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 733724672. Throughput: 0: 9950.5, 1: 9920.2. Samples: 733715620. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:46,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.754')] [2023-12-28 05:32:46,220][106226] Updated weights for policy 0, policy_version 1431209 (0.0011) [2023-12-28 05:32:46,579][106225] Updated weights for policy 1, policy_version 1434461 (0.0010) [2023-12-28 05:32:46,630][106225] Updated weights for policy 1, policy_version 1434471 (0.0010) [2023-12-28 05:32:46,684][106225] Updated weights for policy 1, policy_version 1434481 (0.0009) [2023-12-28 05:32:46,926][106226] Updated weights for policy 0, policy_version 1431219 (0.0011) [2023-12-28 05:32:46,986][106226] Updated weights for policy 0, policy_version 1431229 (0.0009) [2023-12-28 05:32:47,054][106226] Updated weights for policy 0, policy_version 1431239 (0.0009) [2023-12-28 05:32:47,289][106225] Updated weights for policy 1, policy_version 1434491 (0.0007) [2023-12-28 05:32:47,347][106225] Updated weights for policy 1, policy_version 1434501 (0.0008) [2023-12-28 05:32:47,399][106225] Updated weights for policy 1, policy_version 1434511 (0.0010) [2023-12-28 05:32:47,730][106226] Updated weights for policy 0, policy_version 1431249 (0.0006) [2023-12-28 05:32:47,795][106226] Updated weights for policy 0, policy_version 1431259 (0.0011) [2023-12-28 05:32:47,861][106226] Updated weights for policy 0, policy_version 1431269 (0.0011) [2023-12-28 05:32:47,928][106226] Updated weights for policy 0, policy_version 1431279 (0.0011) [2023-12-28 05:32:48,039][106225] Updated weights for policy 1, policy_version 1434521 (0.0010) [2023-12-28 05:32:48,091][106225] Updated weights for policy 1, policy_version 1434531 (0.0006) [2023-12-28 05:32:48,142][106225] Updated weights for policy 1, policy_version 1434541 (0.0005) [2023-12-28 05:32:48,192][106225] Updated weights for policy 1, policy_version 1434551 (0.0005) [2023-12-28 05:32:48,602][106226] Updated weights for policy 0, policy_version 1431289 (0.0006) [2023-12-28 05:32:48,662][106226] Updated weights for policy 0, policy_version 1431299 (0.0010) [2023-12-28 05:32:48,719][106226] Updated weights for policy 0, policy_version 1431309 (0.0011) [2023-12-28 05:32:48,897][106225] Updated weights for policy 1, policy_version 1434561 (0.0008) [2023-12-28 05:32:48,952][106225] Updated weights for policy 1, policy_version 1434571 (0.0008) [2023-12-28 05:32:49,010][106225] Updated weights for policy 1, policy_version 1434581 (0.0008) [2023-12-28 05:32:49,450][106226] Updated weights for policy 0, policy_version 1431319 (0.0009) [2023-12-28 05:32:49,519][106226] Updated weights for policy 0, policy_version 1431329 (0.0008) [2023-12-28 05:32:49,586][106226] Updated weights for policy 0, policy_version 1431339 (0.0008) [2023-12-28 05:32:49,761][106225] Updated weights for policy 1, policy_version 1434591 (0.0010) [2023-12-28 05:32:49,826][106225] Updated weights for policy 1, policy_version 1434601 (0.0010) [2023-12-28 05:32:49,894][106225] Updated weights for policy 1, policy_version 1434611 (0.0009) [2023-12-28 05:32:50,401][106226] Updated weights for policy 0, policy_version 1431349 (0.0009) [2023-12-28 05:32:50,469][106226] Updated weights for policy 0, policy_version 1431359 (0.0011) [2023-12-28 05:32:50,534][106226] Updated weights for policy 0, policy_version 1431369 (0.0009) [2023-12-28 05:32:50,664][106225] Updated weights for policy 1, policy_version 1434621 (0.0007) [2023-12-28 05:32:50,720][106225] Updated weights for policy 1, policy_version 1434631 (0.0008) [2023-12-28 05:32:50,774][106225] Updated weights for policy 1, policy_version 1434641 (0.0008) [2023-12-28 05:32:51,140][106226] Updated weights for policy 0, policy_version 1431379 (0.0008) [2023-12-28 05:32:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 733822976. Throughput: 0: 9949.2, 1: 9917.8. Samples: 733835620. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:51,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.749')] [2023-12-28 05:32:51,198][106226] Updated weights for policy 0, policy_version 1431389 (0.0011) [2023-12-28 05:32:51,254][106226] Updated weights for policy 0, policy_version 1431399 (0.0010) [2023-12-28 05:32:51,562][106225] Updated weights for policy 1, policy_version 1434651 (0.0008) [2023-12-28 05:32:51,630][106225] Updated weights for policy 1, policy_version 1434661 (0.0008) [2023-12-28 05:32:51,695][106225] Updated weights for policy 1, policy_version 1434671 (0.0008) [2023-12-28 05:32:51,960][106226] Updated weights for policy 0, policy_version 1431409 (0.0011) [2023-12-28 05:32:52,025][106226] Updated weights for policy 0, policy_version 1431419 (0.0010) [2023-12-28 05:32:52,075][106226] Updated weights for policy 0, policy_version 1431429 (0.0010) [2023-12-28 05:32:52,125][106226] Updated weights for policy 0, policy_version 1431439 (0.0011) [2023-12-28 05:32:52,437][106225] Updated weights for policy 1, policy_version 1434681 (0.0008) [2023-12-28 05:32:52,499][106225] Updated weights for policy 1, policy_version 1434691 (0.0005) [2023-12-28 05:32:52,553][106225] Updated weights for policy 1, policy_version 1434701 (0.0006) [2023-12-28 05:32:52,603][106225] Updated weights for policy 1, policy_version 1434711 (0.0005) [2023-12-28 05:32:52,876][106226] Updated weights for policy 0, policy_version 1431449 (0.0010) [2023-12-28 05:32:52,929][106226] Updated weights for policy 0, policy_version 1431459 (0.0010) [2023-12-28 05:32:52,975][106226] Updated weights for policy 0, policy_version 1431469 (0.0010) [2023-12-28 05:32:53,278][106225] Updated weights for policy 1, policy_version 1434721 (0.0007) [2023-12-28 05:32:53,344][106225] Updated weights for policy 1, policy_version 1434731 (0.0006) [2023-12-28 05:32:53,405][106225] Updated weights for policy 1, policy_version 1434741 (0.0007) [2023-12-28 05:32:53,637][106226] Updated weights for policy 0, policy_version 1431479 (0.0007) [2023-12-28 05:32:53,688][106226] Updated weights for policy 0, policy_version 1431489 (0.0005) [2023-12-28 05:32:53,741][106226] Updated weights for policy 0, policy_version 1431499 (0.0005) [2023-12-28 05:32:54,133][106225] Updated weights for policy 1, policy_version 1434751 (0.0008) [2023-12-28 05:32:54,196][106225] Updated weights for policy 1, policy_version 1434761 (0.0010) [2023-12-28 05:32:54,255][106225] Updated weights for policy 1, policy_version 1434771 (0.0008) [2023-12-28 05:32:54,271][106226] Updated weights for policy 0, policy_version 1431509 (0.0005) [2023-12-28 05:32:54,338][106226] Updated weights for policy 0, policy_version 1431519 (0.0009) [2023-12-28 05:32:54,401][106226] Updated weights for policy 0, policy_version 1431529 (0.0008) [2023-12-28 05:32:55,009][106225] Updated weights for policy 1, policy_version 1434781 (0.0008) [2023-12-28 05:32:55,072][106225] Updated weights for policy 1, policy_version 1434791 (0.0009) [2023-12-28 05:32:55,108][106226] Updated weights for policy 0, policy_version 1431539 (0.0008) [2023-12-28 05:32:55,129][106225] Updated weights for policy 1, policy_version 1434801 (0.0008) [2023-12-28 05:32:55,157][106226] Updated weights for policy 0, policy_version 1431549 (0.0005) [2023-12-28 05:32:55,211][106226] Updated weights for policy 0, policy_version 1431559 (0.0008) [2023-12-28 05:32:55,771][106225] Updated weights for policy 1, policy_version 1434811 (0.0007) [2023-12-28 05:32:55,818][106225] Updated weights for policy 1, policy_version 1434821 (0.0006) [2023-12-28 05:32:55,862][106225] Updated weights for policy 1, policy_version 1434831 (0.0007) [2023-12-28 05:32:55,987][106226] Updated weights for policy 0, policy_version 1431569 (0.0008) [2023-12-28 05:32:56,045][106226] Updated weights for policy 0, policy_version 1431579 (0.0008) [2023-12-28 05:32:56,103][106226] Updated weights for policy 0, policy_version 1431589 (0.0008) [2023-12-28 05:32:56,158][106226] Updated weights for policy 0, policy_version 1431599 (0.0009) [2023-12-28 05:32:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 733929472. Throughput: 0: 9995.7, 1: 9865.1. Samples: 733895552. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:32:56,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.629')] [2023-12-28 05:32:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001434840_367370240.pth... [2023-12-28 05:32:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001431600_366559232.pth... [2023-12-28 05:32:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001433656_367067136.pth [2023-12-28 05:32:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001430416_366256128.pth [2023-12-28 05:32:56,579][106225] Updated weights for policy 1, policy_version 1434841 (0.0008) [2023-12-28 05:32:56,630][106225] Updated weights for policy 1, policy_version 1434851 (0.0008) [2023-12-28 05:32:56,684][106225] Updated weights for policy 1, policy_version 1434861 (0.0008) [2023-12-28 05:32:56,748][106225] Updated weights for policy 1, policy_version 1434871 (0.0007) [2023-12-28 05:32:56,871][106226] Updated weights for policy 0, policy_version 1431609 (0.0009) [2023-12-28 05:32:56,926][106226] Updated weights for policy 0, policy_version 1431619 (0.0009) [2023-12-28 05:32:56,974][106226] Updated weights for policy 0, policy_version 1431629 (0.0008) [2023-12-28 05:32:57,416][106225] Updated weights for policy 1, policy_version 1434881 (0.0008) [2023-12-28 05:32:57,467][106225] Updated weights for policy 1, policy_version 1434891 (0.0008) [2023-12-28 05:32:57,516][106225] Updated weights for policy 1, policy_version 1434901 (0.0006) [2023-12-28 05:32:57,758][106226] Updated weights for policy 0, policy_version 1431639 (0.0008) [2023-12-28 05:32:57,810][106226] Updated weights for policy 0, policy_version 1431649 (0.0008) [2023-12-28 05:32:57,858][106226] Updated weights for policy 0, policy_version 1431659 (0.0008) [2023-12-28 05:32:58,163][106225] Updated weights for policy 1, policy_version 1434911 (0.0008) [2023-12-28 05:32:58,224][106225] Updated weights for policy 1, policy_version 1434921 (0.0009) [2023-12-28 05:32:58,284][106225] Updated weights for policy 1, policy_version 1434931 (0.0009) [2023-12-28 05:32:58,594][106226] Updated weights for policy 0, policy_version 1431669 (0.0008) [2023-12-28 05:32:58,658][106226] Updated weights for policy 0, policy_version 1431680 (0.0010) [2023-12-28 05:32:58,724][106226] Updated weights for policy 0, policy_version 1431690 (0.0011) [2023-12-28 05:32:59,086][106225] Updated weights for policy 1, policy_version 1434941 (0.0008) [2023-12-28 05:32:59,144][106225] Updated weights for policy 1, policy_version 1434951 (0.0008) [2023-12-28 05:32:59,206][106225] Updated weights for policy 1, policy_version 1434961 (0.0008) [2023-12-28 05:32:59,579][106226] Updated weights for policy 0, policy_version 1431700 (0.0010) [2023-12-28 05:32:59,636][106226] Updated weights for policy 0, policy_version 1431710 (0.0009) [2023-12-28 05:32:59,686][106226] Updated weights for policy 0, policy_version 1431720 (0.0009) [2023-12-28 05:32:59,972][106225] Updated weights for policy 1, policy_version 1434971 (0.0009) [2023-12-28 05:33:00,038][106225] Updated weights for policy 1, policy_version 1434981 (0.0009) [2023-12-28 05:33:00,097][106225] Updated weights for policy 1, policy_version 1434991 (0.0008) [2023-12-28 05:33:00,416][106226] Updated weights for policy 0, policy_version 1431730 (0.0009) [2023-12-28 05:33:00,478][106226] Updated weights for policy 0, policy_version 1431740 (0.0008) [2023-12-28 05:33:00,528][106226] Updated weights for policy 0, policy_version 1431750 (0.0009) [2023-12-28 05:33:00,581][106226] Updated weights for policy 0, policy_version 1431760 (0.0007) [2023-12-28 05:33:00,875][106225] Updated weights for policy 1, policy_version 1435001 (0.0009) [2023-12-28 05:33:00,925][106225] Updated weights for policy 1, policy_version 1435011 (0.0008) [2023-12-28 05:33:00,978][106225] Updated weights for policy 1, policy_version 1435021 (0.0009) [2023-12-28 05:33:01,053][106225] Updated weights for policy 1, policy_version 1435031 (0.0008) [2023-12-28 05:33:01,160][106226] Updated weights for policy 0, policy_version 1431770 (0.0010) [2023-12-28 05:33:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 734019584. Throughput: 0: 9973.7, 1: 9900.1. Samples: 734009276. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:01,175][105115] Avg episode reward: [(0, '-4.828'), (1, '-4.558')] [2023-12-28 05:33:01,225][106226] Updated weights for policy 0, policy_version 1431780 (0.0011) [2023-12-28 05:33:01,286][106226] Updated weights for policy 0, policy_version 1431790 (0.0011) [2023-12-28 05:33:01,822][106225] Updated weights for policy 1, policy_version 1435041 (0.0008) [2023-12-28 05:33:01,883][106225] Updated weights for policy 1, policy_version 1435051 (0.0007) [2023-12-28 05:33:01,950][106225] Updated weights for policy 1, policy_version 1435061 (0.0008) [2023-12-28 05:33:02,025][106226] Updated weights for policy 0, policy_version 1431800 (0.0007) [2023-12-28 05:33:02,091][106226] Updated weights for policy 0, policy_version 1431810 (0.0005) [2023-12-28 05:33:02,149][106226] Updated weights for policy 0, policy_version 1431820 (0.0006) [2023-12-28 05:33:02,629][106225] Updated weights for policy 1, policy_version 1435071 (0.0008) [2023-12-28 05:33:02,683][106225] Updated weights for policy 1, policy_version 1435081 (0.0008) [2023-12-28 05:33:02,739][106225] Updated weights for policy 1, policy_version 1435091 (0.0008) [2023-12-28 05:33:02,849][106226] Updated weights for policy 0, policy_version 1431830 (0.0007) [2023-12-28 05:33:02,897][106226] Updated weights for policy 0, policy_version 1431840 (0.0009) [2023-12-28 05:33:02,946][106226] Updated weights for policy 0, policy_version 1431850 (0.0008) [2023-12-28 05:33:03,452][106225] Updated weights for policy 1, policy_version 1435101 (0.0007) [2023-12-28 05:33:03,502][106225] Updated weights for policy 1, policy_version 1435111 (0.0005) [2023-12-28 05:33:03,564][106225] Updated weights for policy 1, policy_version 1435121 (0.0005) [2023-12-28 05:33:03,628][106226] Updated weights for policy 0, policy_version 1431860 (0.0006) [2023-12-28 05:33:03,682][106226] Updated weights for policy 0, policy_version 1431870 (0.0008) [2023-12-28 05:33:03,728][106226] Updated weights for policy 0, policy_version 1431880 (0.0007) [2023-12-28 05:33:04,240][106225] Updated weights for policy 1, policy_version 1435131 (0.0006) [2023-12-28 05:33:04,299][106225] Updated weights for policy 1, policy_version 1435141 (0.0008) [2023-12-28 05:33:04,361][106225] Updated weights for policy 1, policy_version 1435151 (0.0009) [2023-12-28 05:33:04,442][106226] Updated weights for policy 0, policy_version 1431890 (0.0006) [2023-12-28 05:33:04,500][106226] Updated weights for policy 0, policy_version 1431900 (0.0009) [2023-12-28 05:33:04,556][106226] Updated weights for policy 0, policy_version 1431910 (0.0009) [2023-12-28 05:33:04,616][106226] Updated weights for policy 0, policy_version 1431920 (0.0009) [2023-12-28 05:33:05,176][106225] Updated weights for policy 1, policy_version 1435161 (0.0007) [2023-12-28 05:33:05,232][106225] Updated weights for policy 1, policy_version 1435171 (0.0008) [2023-12-28 05:33:05,286][106225] Updated weights for policy 1, policy_version 1435181 (0.0008) [2023-12-28 05:33:05,318][106226] Updated weights for policy 0, policy_version 1431930 (0.0011) [2023-12-28 05:33:05,340][106225] Updated weights for policy 1, policy_version 1435191 (0.0005) [2023-12-28 05:33:05,368][106226] Updated weights for policy 0, policy_version 1431940 (0.0010) [2023-12-28 05:33:05,421][106226] Updated weights for policy 0, policy_version 1431950 (0.0010) [2023-12-28 05:33:06,055][106225] Updated weights for policy 1, policy_version 1435201 (0.0007) [2023-12-28 05:33:06,119][106225] Updated weights for policy 1, policy_version 1435211 (0.0008) [2023-12-28 05:33:06,136][106226] Updated weights for policy 0, policy_version 1431960 (0.0010) [2023-12-28 05:33:06,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 734109696. Throughput: 0: 9970.7, 1: 9891.3. Samples: 734126568. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:06,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.035')] [2023-12-28 05:33:06,185][106225] Updated weights for policy 1, policy_version 1435221 (0.0007) [2023-12-28 05:33:06,198][106226] Updated weights for policy 0, policy_version 1431970 (0.0011) [2023-12-28 05:33:06,260][106226] Updated weights for policy 0, policy_version 1431980 (0.0011) [2023-12-28 05:33:06,885][106226] Updated weights for policy 0, policy_version 1431990 (0.0008) [2023-12-28 05:33:06,941][106225] Updated weights for policy 1, policy_version 1435231 (0.0008) [2023-12-28 05:33:06,948][106226] Updated weights for policy 0, policy_version 1432000 (0.0006) [2023-12-28 05:33:07,001][106225] Updated weights for policy 1, policy_version 1435241 (0.0009) [2023-12-28 05:33:07,003][106226] Updated weights for policy 0, policy_version 1432010 (0.0006) [2023-12-28 05:33:07,061][106225] Updated weights for policy 1, policy_version 1435251 (0.0006) [2023-12-28 05:33:07,704][106226] Updated weights for policy 0, policy_version 1432020 (0.0007) [2023-12-28 05:33:07,755][106225] Updated weights for policy 1, policy_version 1435261 (0.0008) [2023-12-28 05:33:07,761][106226] Updated weights for policy 0, policy_version 1432030 (0.0007) [2023-12-28 05:33:07,812][106225] Updated weights for policy 1, policy_version 1435271 (0.0006) [2023-12-28 05:33:07,818][106226] Updated weights for policy 0, policy_version 1432040 (0.0006) [2023-12-28 05:33:07,867][106225] Updated weights for policy 1, policy_version 1435281 (0.0007) [2023-12-28 05:33:08,389][106226] Updated weights for policy 0, policy_version 1432050 (0.0006) [2023-12-28 05:33:08,455][106226] Updated weights for policy 0, policy_version 1432060 (0.0009) [2023-12-28 05:33:08,517][106226] Updated weights for policy 0, policy_version 1432070 (0.0011) [2023-12-28 05:33:08,582][106226] Updated weights for policy 0, policy_version 1432080 (0.0011) [2023-12-28 05:33:08,698][106225] Updated weights for policy 1, policy_version 1435291 (0.0008) [2023-12-28 05:33:08,757][106225] Updated weights for policy 1, policy_version 1435301 (0.0007) [2023-12-28 05:33:08,818][106225] Updated weights for policy 1, policy_version 1435311 (0.0008) [2023-12-28 05:33:09,283][106226] Updated weights for policy 0, policy_version 1432090 (0.0011) [2023-12-28 05:33:09,348][106226] Updated weights for policy 0, policy_version 1432100 (0.0011) [2023-12-28 05:33:09,425][106226] Updated weights for policy 0, policy_version 1432110 (0.0008) [2023-12-28 05:33:09,591][106225] Updated weights for policy 1, policy_version 1435321 (0.0008) [2023-12-28 05:33:09,651][106225] Updated weights for policy 1, policy_version 1435331 (0.0009) [2023-12-28 05:33:09,720][106225] Updated weights for policy 1, policy_version 1435341 (0.0008) [2023-12-28 05:33:09,788][106225] Updated weights for policy 1, policy_version 1435351 (0.0006) [2023-12-28 05:33:10,099][106226] Updated weights for policy 0, policy_version 1432120 (0.0010) [2023-12-28 05:33:10,159][106226] Updated weights for policy 0, policy_version 1432130 (0.0010) [2023-12-28 05:33:10,231][106226] Updated weights for policy 0, policy_version 1432140 (0.0011) [2023-12-28 05:33:10,493][106225] Updated weights for policy 1, policy_version 1435361 (0.0008) [2023-12-28 05:33:10,545][106225] Updated weights for policy 1, policy_version 1435371 (0.0006) [2023-12-28 05:33:10,596][106225] Updated weights for policy 1, policy_version 1435381 (0.0007) [2023-12-28 05:33:10,890][106226] Updated weights for policy 0, policy_version 1432150 (0.0008) [2023-12-28 05:33:10,962][106226] Updated weights for policy 0, policy_version 1432160 (0.0009) [2023-12-28 05:33:11,029][106226] Updated weights for policy 0, policy_version 1432170 (0.0011) [2023-12-28 05:33:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 734216192. Throughput: 0: 10033.0, 1: 9875.0. Samples: 734186032. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:11,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-4.864')] [2023-12-28 05:33:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001435384_367509504.pth... [2023-12-28 05:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001432176_366706688.pth... [2023-12-28 05:33:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001431024_366411776.pth [2023-12-28 05:33:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001434264_367222784.pth [2023-12-28 05:33:11,266][106225] Updated weights for policy 1, policy_version 1435391 (0.0008) [2023-12-28 05:33:11,332][106225] Updated weights for policy 1, policy_version 1435401 (0.0007) [2023-12-28 05:33:11,397][106225] Updated weights for policy 1, policy_version 1435411 (0.0008) [2023-12-28 05:33:11,728][106226] Updated weights for policy 0, policy_version 1432180 (0.0010) [2023-12-28 05:33:11,803][106226] Updated weights for policy 0, policy_version 1432190 (0.0011) [2023-12-28 05:33:11,869][106226] Updated weights for policy 0, policy_version 1432200 (0.0011) [2023-12-28 05:33:12,088][106225] Updated weights for policy 1, policy_version 1435421 (0.0007) [2023-12-28 05:33:12,141][106225] Updated weights for policy 1, policy_version 1435431 (0.0008) [2023-12-28 05:33:12,203][106225] Updated weights for policy 1, policy_version 1435441 (0.0008) [2023-12-28 05:33:12,603][106226] Updated weights for policy 0, policy_version 1432210 (0.0010) [2023-12-28 05:33:12,659][106226] Updated weights for policy 0, policy_version 1432220 (0.0010) [2023-12-28 05:33:12,717][106226] Updated weights for policy 0, policy_version 1432230 (0.0011) [2023-12-28 05:33:12,782][106226] Updated weights for policy 0, policy_version 1432240 (0.0011) [2023-12-28 05:33:12,815][106225] Updated weights for policy 1, policy_version 1435451 (0.0008) [2023-12-28 05:33:12,867][106225] Updated weights for policy 1, policy_version 1435461 (0.0006) [2023-12-28 05:33:12,915][106225] Updated weights for policy 1, policy_version 1435471 (0.0006) [2023-12-28 05:33:13,385][106226] Updated weights for policy 0, policy_version 1432250 (0.0008) [2023-12-28 05:33:13,449][106226] Updated weights for policy 0, policy_version 1432260 (0.0010) [2023-12-28 05:33:13,506][106226] Updated weights for policy 0, policy_version 1432270 (0.0010) [2023-12-28 05:33:13,573][106225] Updated weights for policy 1, policy_version 1435481 (0.0009) [2023-12-28 05:33:13,634][106225] Updated weights for policy 1, policy_version 1435491 (0.0008) [2023-12-28 05:33:13,684][106225] Updated weights for policy 1, policy_version 1435501 (0.0007) [2023-12-28 05:33:13,733][106225] Updated weights for policy 1, policy_version 1435511 (0.0008) [2023-12-28 05:33:14,198][106226] Updated weights for policy 0, policy_version 1432280 (0.0011) [2023-12-28 05:33:14,265][106226] Updated weights for policy 0, policy_version 1432290 (0.0011) [2023-12-28 05:33:14,331][106226] Updated weights for policy 0, policy_version 1432300 (0.0010) [2023-12-28 05:33:14,353][106225] Updated weights for policy 1, policy_version 1435521 (0.0007) [2023-12-28 05:33:14,397][106225] Updated weights for policy 1, policy_version 1435531 (0.0005) [2023-12-28 05:33:14,444][106225] Updated weights for policy 1, policy_version 1435541 (0.0005) [2023-12-28 05:33:15,049][106226] Updated weights for policy 0, policy_version 1432310 (0.0011) [2023-12-28 05:33:15,069][106225] Updated weights for policy 1, policy_version 1435551 (0.0006) [2023-12-28 05:33:15,115][106226] Updated weights for policy 0, policy_version 1432320 (0.0011) [2023-12-28 05:33:15,129][106225] Updated weights for policy 1, policy_version 1435561 (0.0007) [2023-12-28 05:33:15,183][106226] Updated weights for policy 0, policy_version 1432330 (0.0011) [2023-12-28 05:33:15,195][106225] Updated weights for policy 1, policy_version 1435571 (0.0005) [2023-12-28 05:33:15,871][106225] Updated weights for policy 1, policy_version 1435581 (0.0006) [2023-12-28 05:33:15,901][106226] Updated weights for policy 0, policy_version 1432340 (0.0011) [2023-12-28 05:33:15,925][106225] Updated weights for policy 1, policy_version 1435591 (0.0006) [2023-12-28 05:33:15,965][106226] Updated weights for policy 0, policy_version 1432350 (0.0010) [2023-12-28 05:33:15,984][106225] Updated weights for policy 1, policy_version 1435601 (0.0005) [2023-12-28 05:33:16,023][106226] Updated weights for policy 0, policy_version 1432360 (0.0011) [2023-12-28 05:33:16,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 734322688. Throughput: 0: 9910.1, 1: 9840.8. Samples: 734306788. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:16,175][105115] Avg episode reward: [(0, '-5.173'), (1, '-4.521')] [2023-12-28 05:33:16,507][106225] Updated weights for policy 1, policy_version 1435611 (0.0006) [2023-12-28 05:33:16,550][106225] Updated weights for policy 1, policy_version 1435621 (0.0007) [2023-12-28 05:33:16,600][106225] Updated weights for policy 1, policy_version 1435631 (0.0008) [2023-12-28 05:33:16,724][106226] Updated weights for policy 0, policy_version 1432370 (0.0010) [2023-12-28 05:33:16,777][106226] Updated weights for policy 0, policy_version 1432380 (0.0010) [2023-12-28 05:33:16,831][106226] Updated weights for policy 0, policy_version 1432390 (0.0010) [2023-12-28 05:33:16,889][106226] Updated weights for policy 0, policy_version 1432400 (0.0007) [2023-12-28 05:33:17,339][106225] Updated weights for policy 1, policy_version 1435641 (0.0007) [2023-12-28 05:33:17,403][106225] Updated weights for policy 1, policy_version 1435651 (0.0005) [2023-12-28 05:33:17,468][106225] Updated weights for policy 1, policy_version 1435661 (0.0006) [2023-12-28 05:33:17,518][106225] Updated weights for policy 1, policy_version 1435671 (0.0005) [2023-12-28 05:33:17,530][106226] Updated weights for policy 0, policy_version 1432410 (0.0011) [2023-12-28 05:33:17,584][106226] Updated weights for policy 0, policy_version 1432420 (0.0011) [2023-12-28 05:33:17,644][106226] Updated weights for policy 0, policy_version 1432430 (0.0009) [2023-12-28 05:33:18,068][106225] Updated weights for policy 1, policy_version 1435681 (0.0006) [2023-12-28 05:33:18,126][106225] Updated weights for policy 1, policy_version 1435691 (0.0005) [2023-12-28 05:33:18,189][106225] Updated weights for policy 1, policy_version 1435701 (0.0005) [2023-12-28 05:33:18,385][106226] Updated weights for policy 0, policy_version 1432440 (0.0009) [2023-12-28 05:33:18,445][106226] Updated weights for policy 0, policy_version 1432450 (0.0007) [2023-12-28 05:33:18,509][106226] Updated weights for policy 0, policy_version 1432460 (0.0008) [2023-12-28 05:33:18,817][106225] Updated weights for policy 1, policy_version 1435711 (0.0007) [2023-12-28 05:33:18,882][106225] Updated weights for policy 1, policy_version 1435721 (0.0008) [2023-12-28 05:33:18,940][106225] Updated weights for policy 1, policy_version 1435731 (0.0008) [2023-12-28 05:33:19,243][106226] Updated weights for policy 0, policy_version 1432470 (0.0009) [2023-12-28 05:33:19,295][106226] Updated weights for policy 0, policy_version 1432480 (0.0010) [2023-12-28 05:33:19,356][106226] Updated weights for policy 0, policy_version 1432490 (0.0010) [2023-12-28 05:33:19,713][106225] Updated weights for policy 1, policy_version 1435741 (0.0007) [2023-12-28 05:33:19,780][106225] Updated weights for policy 1, policy_version 1435751 (0.0007) [2023-12-28 05:33:19,846][106225] Updated weights for policy 1, policy_version 1435761 (0.0008) [2023-12-28 05:33:20,150][106226] Updated weights for policy 0, policy_version 1432500 (0.0009) [2023-12-28 05:33:20,213][106226] Updated weights for policy 0, policy_version 1432510 (0.0011) [2023-12-28 05:33:20,275][106226] Updated weights for policy 0, policy_version 1432520 (0.0011) [2023-12-28 05:33:20,604][106225] Updated weights for policy 1, policy_version 1435771 (0.0008) [2023-12-28 05:33:20,664][106225] Updated weights for policy 1, policy_version 1435781 (0.0007) [2023-12-28 05:33:20,736][106225] Updated weights for policy 1, policy_version 1435791 (0.0007) [2023-12-28 05:33:21,049][106226] Updated weights for policy 0, policy_version 1432530 (0.0011) [2023-12-28 05:33:21,111][106226] Updated weights for policy 0, policy_version 1432540 (0.0009) [2023-12-28 05:33:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 734412800. Throughput: 0: 9834.6, 1: 9839.0. Samples: 734426144. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:21,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.856')] [2023-12-28 05:33:21,178][106226] Updated weights for policy 0, policy_version 1432550 (0.0008) [2023-12-28 05:33:21,237][106226] Updated weights for policy 0, policy_version 1432560 (0.0009) [2023-12-28 05:33:21,465][106225] Updated weights for policy 1, policy_version 1435801 (0.0007) [2023-12-28 05:33:21,526][106225] Updated weights for policy 1, policy_version 1435811 (0.0007) [2023-12-28 05:33:21,593][106225] Updated weights for policy 1, policy_version 1435821 (0.0009) [2023-12-28 05:33:21,664][106225] Updated weights for policy 1, policy_version 1435831 (0.0009) [2023-12-28 05:33:22,089][106226] Updated weights for policy 0, policy_version 1432570 (0.0011) [2023-12-28 05:33:22,148][106226] Updated weights for policy 0, policy_version 1432580 (0.0011) [2023-12-28 05:33:22,206][106226] Updated weights for policy 0, policy_version 1432590 (0.0011) [2023-12-28 05:33:22,334][106225] Updated weights for policy 1, policy_version 1435841 (0.0008) [2023-12-28 05:33:22,407][106225] Updated weights for policy 1, policy_version 1435851 (0.0008) [2023-12-28 05:33:22,476][106225] Updated weights for policy 1, policy_version 1435861 (0.0009) [2023-12-28 05:33:22,939][106226] Updated weights for policy 0, policy_version 1432600 (0.0009) [2023-12-28 05:33:22,987][106226] Updated weights for policy 0, policy_version 1432610 (0.0008) [2023-12-28 05:33:23,037][106226] Updated weights for policy 0, policy_version 1432620 (0.0009) [2023-12-28 05:33:23,187][106225] Updated weights for policy 1, policy_version 1435871 (0.0008) [2023-12-28 05:33:23,248][106225] Updated weights for policy 1, policy_version 1435881 (0.0008) [2023-12-28 05:33:23,293][106225] Updated weights for policy 1, policy_version 1435891 (0.0009) [2023-12-28 05:33:23,795][106226] Updated weights for policy 0, policy_version 1432630 (0.0010) [2023-12-28 05:33:23,845][106226] Updated weights for policy 0, policy_version 1432640 (0.0010) [2023-12-28 05:33:23,894][106226] Updated weights for policy 0, policy_version 1432650 (0.0010) [2023-12-28 05:33:24,022][106225] Updated weights for policy 1, policy_version 1435901 (0.0007) [2023-12-28 05:33:24,075][106225] Updated weights for policy 1, policy_version 1435911 (0.0008) [2023-12-28 05:33:24,141][106225] Updated weights for policy 1, policy_version 1435921 (0.0007) [2023-12-28 05:33:24,618][106226] Updated weights for policy 0, policy_version 1432660 (0.0010) [2023-12-28 05:33:24,678][106226] Updated weights for policy 0, policy_version 1432670 (0.0010) [2023-12-28 05:33:24,740][106226] Updated weights for policy 0, policy_version 1432680 (0.0011) [2023-12-28 05:33:24,880][106225] Updated weights for policy 1, policy_version 1435931 (0.0008) [2023-12-28 05:33:24,933][106225] Updated weights for policy 1, policy_version 1435941 (0.0007) [2023-12-28 05:33:24,993][106225] Updated weights for policy 1, policy_version 1435951 (0.0008) [2023-12-28 05:33:25,357][106226] Updated weights for policy 0, policy_version 1432690 (0.0009) [2023-12-28 05:33:25,405][106226] Updated weights for policy 0, policy_version 1432700 (0.0009) [2023-12-28 05:33:25,468][106226] Updated weights for policy 0, policy_version 1432710 (0.0009) [2023-12-28 05:33:25,534][106226] Updated weights for policy 0, policy_version 1432720 (0.0009) [2023-12-28 05:33:25,709][106225] Updated weights for policy 1, policy_version 1435961 (0.0007) [2023-12-28 05:33:25,771][106225] Updated weights for policy 1, policy_version 1435971 (0.0005) [2023-12-28 05:33:25,826][106225] Updated weights for policy 1, policy_version 1435981 (0.0005) [2023-12-28 05:33:25,884][106225] Updated weights for policy 1, policy_version 1435991 (0.0010) [2023-12-28 05:33:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 734511104. Throughput: 0: 9819.9, 1: 9847.4. Samples: 734482312. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:26,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-4.778')] [2023-12-28 05:33:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001435992_367665152.pth... [2023-12-28 05:33:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001432720_366845952.pth... [2023-12-28 05:33:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001434840_367370240.pth [2023-12-28 05:33:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001431600_366559232.pth [2023-12-28 05:33:26,274][106226] Updated weights for policy 0, policy_version 1432730 (0.0008) [2023-12-28 05:33:26,329][106226] Updated weights for policy 0, policy_version 1432740 (0.0008) [2023-12-28 05:33:26,387][106226] Updated weights for policy 0, policy_version 1432750 (0.0008) [2023-12-28 05:33:26,539][106225] Updated weights for policy 1, policy_version 1436001 (0.0010) [2023-12-28 05:33:26,592][106225] Updated weights for policy 1, policy_version 1436011 (0.0010) [2023-12-28 05:33:26,641][106225] Updated weights for policy 1, policy_version 1436021 (0.0010) [2023-12-28 05:33:27,036][106226] Updated weights for policy 0, policy_version 1432760 (0.0006) [2023-12-28 05:33:27,102][106226] Updated weights for policy 0, policy_version 1432770 (0.0005) [2023-12-28 05:33:27,163][106226] Updated weights for policy 0, policy_version 1432780 (0.0007) [2023-12-28 05:33:27,297][106225] Updated weights for policy 1, policy_version 1436031 (0.0010) [2023-12-28 05:33:27,362][106225] Updated weights for policy 1, policy_version 1436041 (0.0010) [2023-12-28 05:33:27,423][106225] Updated weights for policy 1, policy_version 1436051 (0.0010) [2023-12-28 05:33:27,768][106226] Updated weights for policy 0, policy_version 1432790 (0.0008) [2023-12-28 05:33:27,827][106226] Updated weights for policy 0, policy_version 1432800 (0.0010) [2023-12-28 05:33:27,880][106226] Updated weights for policy 0, policy_version 1432810 (0.0010) [2023-12-28 05:33:28,121][106225] Updated weights for policy 1, policy_version 1436061 (0.0009) [2023-12-28 05:33:28,169][106225] Updated weights for policy 1, policy_version 1436071 (0.0008) [2023-12-28 05:33:28,216][106225] Updated weights for policy 1, policy_version 1436081 (0.0008) [2023-12-28 05:33:28,462][106226] Updated weights for policy 0, policy_version 1432820 (0.0010) [2023-12-28 05:33:28,523][106226] Updated weights for policy 0, policy_version 1432830 (0.0011) [2023-12-28 05:33:28,578][106226] Updated weights for policy 0, policy_version 1432840 (0.0011) [2023-12-28 05:33:28,878][106225] Updated weights for policy 1, policy_version 1436091 (0.0007) [2023-12-28 05:33:28,936][106225] Updated weights for policy 1, policy_version 1436101 (0.0008) [2023-12-28 05:33:28,989][106225] Updated weights for policy 1, policy_version 1436111 (0.0008) [2023-12-28 05:33:29,312][106226] Updated weights for policy 0, policy_version 1432850 (0.0009) [2023-12-28 05:33:29,382][106226] Updated weights for policy 0, policy_version 1432860 (0.0013) [2023-12-28 05:33:29,446][106226] Updated weights for policy 0, policy_version 1432870 (0.0007) [2023-12-28 05:33:29,509][106226] Updated weights for policy 0, policy_version 1432880 (0.0008) [2023-12-28 05:33:29,766][106225] Updated weights for policy 1, policy_version 1436121 (0.0007) [2023-12-28 05:33:29,820][106225] Updated weights for policy 1, policy_version 1436131 (0.0008) [2023-12-28 05:33:29,885][106225] Updated weights for policy 1, policy_version 1436141 (0.0007) [2023-12-28 05:33:29,949][106225] Updated weights for policy 1, policy_version 1436151 (0.0009) [2023-12-28 05:33:30,184][106226] Updated weights for policy 0, policy_version 1432890 (0.0010) [2023-12-28 05:33:30,245][106226] Updated weights for policy 0, policy_version 1432900 (0.0011) [2023-12-28 05:33:30,292][106226] Updated weights for policy 0, policy_version 1432910 (0.0010) [2023-12-28 05:33:30,681][106225] Updated weights for policy 1, policy_version 1436161 (0.0006) [2023-12-28 05:33:30,742][106225] Updated weights for policy 1, policy_version 1436171 (0.0005) [2023-12-28 05:33:30,811][106225] Updated weights for policy 1, policy_version 1436181 (0.0005) [2023-12-28 05:33:30,964][106226] Updated weights for policy 0, policy_version 1432920 (0.0006) [2023-12-28 05:33:31,023][106226] Updated weights for policy 0, policy_version 1432930 (0.0007) [2023-12-28 05:33:31,084][106226] Updated weights for policy 0, policy_version 1432940 (0.0008) [2023-12-28 05:33:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 734617600. Throughput: 0: 9881.0, 1: 9870.2. Samples: 734604424. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:31,175][105115] Avg episode reward: [(0, '-5.180'), (1, '-4.521')] [2023-12-28 05:33:31,336][106225] Updated weights for policy 1, policy_version 1436191 (0.0006) [2023-12-28 05:33:31,410][106225] Updated weights for policy 1, policy_version 1436201 (0.0008) [2023-12-28 05:33:31,474][106225] Updated weights for policy 1, policy_version 1436211 (0.0008) [2023-12-28 05:33:31,864][106226] Updated weights for policy 0, policy_version 1432950 (0.0010) [2023-12-28 05:33:31,940][106226] Updated weights for policy 0, policy_version 1432960 (0.0010) [2023-12-28 05:33:32,013][106226] Updated weights for policy 0, policy_version 1432970 (0.0010) [2023-12-28 05:33:32,140][106225] Updated weights for policy 1, policy_version 1436221 (0.0009) [2023-12-28 05:33:32,192][106225] Updated weights for policy 1, policy_version 1436231 (0.0009) [2023-12-28 05:33:32,246][106225] Updated weights for policy 1, policy_version 1436241 (0.0007) [2023-12-28 05:33:32,752][106226] Updated weights for policy 0, policy_version 1432980 (0.0009) [2023-12-28 05:33:32,808][106226] Updated weights for policy 0, policy_version 1432990 (0.0009) [2023-12-28 05:33:32,856][106226] Updated weights for policy 0, policy_version 1433000 (0.0008) [2023-12-28 05:33:32,948][106225] Updated weights for policy 1, policy_version 1436251 (0.0007) [2023-12-28 05:33:33,012][106225] Updated weights for policy 1, policy_version 1436261 (0.0006) [2023-12-28 05:33:33,061][106225] Updated weights for policy 1, policy_version 1436271 (0.0009) [2023-12-28 05:33:33,563][106226] Updated weights for policy 0, policy_version 1433010 (0.0009) [2023-12-28 05:33:33,607][106226] Updated weights for policy 0, policy_version 1433020 (0.0008) [2023-12-28 05:33:33,652][106226] Updated weights for policy 0, policy_version 1433030 (0.0009) [2023-12-28 05:33:33,703][106226] Updated weights for policy 0, policy_version 1433040 (0.0008) [2023-12-28 05:33:33,772][106225] Updated weights for policy 1, policy_version 1436281 (0.0008) [2023-12-28 05:33:33,831][106225] Updated weights for policy 1, policy_version 1436291 (0.0008) [2023-12-28 05:33:33,882][106225] Updated weights for policy 1, policy_version 1436301 (0.0008) [2023-12-28 05:33:33,936][106225] Updated weights for policy 1, policy_version 1436311 (0.0008) [2023-12-28 05:33:34,488][106226] Updated weights for policy 0, policy_version 1433050 (0.0006) [2023-12-28 05:33:34,552][106226] Updated weights for policy 0, policy_version 1433060 (0.0008) [2023-12-28 05:33:34,606][106226] Updated weights for policy 0, policy_version 1433070 (0.0006) [2023-12-28 05:33:34,693][106225] Updated weights for policy 1, policy_version 1436321 (0.0008) [2023-12-28 05:33:34,751][106225] Updated weights for policy 1, policy_version 1436331 (0.0009) [2023-12-28 05:33:34,812][106225] Updated weights for policy 1, policy_version 1436341 (0.0009) [2023-12-28 05:33:35,218][106226] Updated weights for policy 0, policy_version 1433080 (0.0009) [2023-12-28 05:33:35,265][106226] Updated weights for policy 0, policy_version 1433090 (0.0008) [2023-12-28 05:33:35,313][106226] Updated weights for policy 0, policy_version 1433100 (0.0008) [2023-12-28 05:33:35,579][106225] Updated weights for policy 1, policy_version 1436351 (0.0008) [2023-12-28 05:33:35,637][106225] Updated weights for policy 1, policy_version 1436361 (0.0008) [2023-12-28 05:33:35,694][106225] Updated weights for policy 1, policy_version 1436371 (0.0006) [2023-12-28 05:33:36,036][106226] Updated weights for policy 0, policy_version 1433110 (0.0007) [2023-12-28 05:33:36,098][106226] Updated weights for policy 0, policy_version 1433120 (0.0007) [2023-12-28 05:33:36,165][106226] Updated weights for policy 0, policy_version 1433130 (0.0007) [2023-12-28 05:33:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 734707712. Throughput: 0: 9852.3, 1: 9846.4. Samples: 734722060. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:36,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.700')] [2023-12-28 05:33:36,469][106225] Updated weights for policy 1, policy_version 1436381 (0.0007) [2023-12-28 05:33:36,530][106225] Updated weights for policy 1, policy_version 1436391 (0.0009) [2023-12-28 05:33:36,596][106225] Updated weights for policy 1, policy_version 1436401 (0.0008) [2023-12-28 05:33:36,816][106226] Updated weights for policy 0, policy_version 1433140 (0.0007) [2023-12-28 05:33:36,877][106226] Updated weights for policy 0, policy_version 1433150 (0.0008) [2023-12-28 05:33:36,937][106226] Updated weights for policy 0, policy_version 1433160 (0.0009) [2023-12-28 05:33:37,281][106225] Updated weights for policy 1, policy_version 1436411 (0.0008) [2023-12-28 05:33:37,330][106225] Updated weights for policy 1, policy_version 1436421 (0.0008) [2023-12-28 05:33:37,376][106225] Updated weights for policy 1, policy_version 1436431 (0.0008) [2023-12-28 05:33:37,700][106226] Updated weights for policy 0, policy_version 1433170 (0.0008) [2023-12-28 05:33:37,765][106226] Updated weights for policy 0, policy_version 1433180 (0.0006) [2023-12-28 05:33:37,829][106226] Updated weights for policy 0, policy_version 1433190 (0.0007) [2023-12-28 05:33:37,882][106226] Updated weights for policy 0, policy_version 1433200 (0.0009) [2023-12-28 05:33:38,031][106225] Updated weights for policy 1, policy_version 1436441 (0.0006) [2023-12-28 05:33:38,084][106225] Updated weights for policy 1, policy_version 1436451 (0.0009) [2023-12-28 05:33:38,135][106225] Updated weights for policy 1, policy_version 1436461 (0.0009) [2023-12-28 05:33:38,186][106225] Updated weights for policy 1, policy_version 1436471 (0.0009) [2023-12-28 05:33:38,536][106226] Updated weights for policy 0, policy_version 1433210 (0.0006) [2023-12-28 05:33:38,596][106226] Updated weights for policy 0, policy_version 1433220 (0.0009) [2023-12-28 05:33:38,665][106226] Updated weights for policy 0, policy_version 1433230 (0.0006) [2023-12-28 05:33:38,984][106225] Updated weights for policy 1, policy_version 1436481 (0.0010) [2023-12-28 05:33:39,047][106225] Updated weights for policy 1, policy_version 1436491 (0.0010) [2023-12-28 05:33:39,101][106225] Updated weights for policy 1, policy_version 1436501 (0.0010) [2023-12-28 05:33:39,305][106226] Updated weights for policy 0, policy_version 1433240 (0.0008) [2023-12-28 05:33:39,374][106226] Updated weights for policy 0, policy_version 1433250 (0.0008) [2023-12-28 05:33:39,439][106226] Updated weights for policy 0, policy_version 1433260 (0.0008) [2023-12-28 05:33:39,870][106225] Updated weights for policy 1, policy_version 1436511 (0.0008) [2023-12-28 05:33:39,935][106225] Updated weights for policy 1, policy_version 1436521 (0.0008) [2023-12-28 05:33:39,985][106225] Updated weights for policy 1, policy_version 1436531 (0.0008) [2023-12-28 05:33:40,177][106226] Updated weights for policy 0, policy_version 1433270 (0.0008) [2023-12-28 05:33:40,242][106226] Updated weights for policy 0, policy_version 1433280 (0.0006) [2023-12-28 05:33:40,311][106226] Updated weights for policy 0, policy_version 1433290 (0.0006) [2023-12-28 05:33:40,722][106225] Updated weights for policy 1, policy_version 1436541 (0.0009) [2023-12-28 05:33:40,771][106225] Updated weights for policy 1, policy_version 1436551 (0.0009) [2023-12-28 05:33:40,821][106225] Updated weights for policy 1, policy_version 1436561 (0.0008) [2023-12-28 05:33:40,980][106226] Updated weights for policy 0, policy_version 1433300 (0.0007) [2023-12-28 05:33:41,042][106226] Updated weights for policy 0, policy_version 1433310 (0.0008) [2023-12-28 05:33:41,113][106226] Updated weights for policy 0, policy_version 1433320 (0.0009) [2023-12-28 05:33:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 734814208. Throughput: 0: 9837.2, 1: 9871.1. Samples: 734782424. Policy #0 lag: (min: 20.0, avg: 20.9, max: 39.0) [2023-12-28 05:33:41,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.666')] [2023-12-28 05:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001436568_367812608.pth... [2023-12-28 05:33:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001433328_367001600.pth... [2023-12-28 05:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001435384_367509504.pth [2023-12-28 05:33:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001432176_366706688.pth [2023-12-28 05:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001436568_367812608.pth [2023-12-28 05:33:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001433328_367001600.pth [2023-12-28 05:33:41,622][106225] Updated weights for policy 1, policy_version 1436571 (0.0010) [2023-12-28 05:33:41,682][106225] Updated weights for policy 1, policy_version 1436581 (0.0008) [2023-12-28 05:33:41,748][106225] Updated weights for policy 1, policy_version 1436591 (0.0008) [2023-12-28 05:33:41,822][106226] Updated weights for policy 0, policy_version 1433330 (0.0008) [2023-12-28 05:33:41,889][106226] Updated weights for policy 0, policy_version 1433340 (0.0008) [2023-12-28 05:33:41,950][106226] Updated weights for policy 0, policy_version 1433350 (0.0008) [2023-12-28 05:33:42,010][106226] Updated weights for policy 0, policy_version 1433360 (0.0008) [2023-12-28 05:33:42,510][106225] Updated weights for policy 1, policy_version 1436601 (0.0007) [2023-12-28 05:33:42,569][106225] Updated weights for policy 1, policy_version 1436611 (0.0005) [2023-12-28 05:33:42,635][106225] Updated weights for policy 1, policy_version 1436621 (0.0005) [2023-12-28 05:33:42,697][106225] Updated weights for policy 1, policy_version 1436631 (0.0005) [2023-12-28 05:33:42,777][106226] Updated weights for policy 0, policy_version 1433370 (0.0010) [2023-12-28 05:33:42,829][106226] Updated weights for policy 0, policy_version 1433380 (0.0010) [2023-12-28 05:33:42,884][106226] Updated weights for policy 0, policy_version 1433390 (0.0009) [2023-12-28 05:33:43,338][106225] Updated weights for policy 1, policy_version 1436641 (0.0009) [2023-12-28 05:33:43,401][106225] Updated weights for policy 1, policy_version 1436651 (0.0010) [2023-12-28 05:33:43,455][106225] Updated weights for policy 1, policy_version 1436661 (0.0010) [2023-12-28 05:33:43,624][106226] Updated weights for policy 0, policy_version 1433400 (0.0008) [2023-12-28 05:33:43,673][106226] Updated weights for policy 0, policy_version 1433410 (0.0007) [2023-12-28 05:33:43,737][106226] Updated weights for policy 0, policy_version 1433420 (0.0008) [2023-12-28 05:33:44,091][106225] Updated weights for policy 1, policy_version 1436671 (0.0010) [2023-12-28 05:33:44,154][106225] Updated weights for policy 1, policy_version 1436681 (0.0009) [2023-12-28 05:33:44,213][106225] Updated weights for policy 1, policy_version 1436691 (0.0005) [2023-12-28 05:33:44,458][106226] Updated weights for policy 0, policy_version 1433430 (0.0009) [2023-12-28 05:33:44,524][106226] Updated weights for policy 0, policy_version 1433440 (0.0010) [2023-12-28 05:33:44,584][106226] Updated weights for policy 0, policy_version 1433450 (0.0010) [2023-12-28 05:33:44,778][106225] Updated weights for policy 1, policy_version 1436701 (0.0007) [2023-12-28 05:33:44,845][106225] Updated weights for policy 1, policy_version 1436711 (0.0007) [2023-12-28 05:33:44,903][106225] Updated weights for policy 1, policy_version 1436721 (0.0008) [2023-12-28 05:33:45,220][106226] Updated weights for policy 0, policy_version 1433460 (0.0008) [2023-12-28 05:33:45,281][106226] Updated weights for policy 0, policy_version 1433470 (0.0011) [2023-12-28 05:33:45,342][106226] Updated weights for policy 0, policy_version 1433480 (0.0011) [2023-12-28 05:33:45,619][106225] Updated weights for policy 1, policy_version 1436731 (0.0008) [2023-12-28 05:33:45,665][106225] Updated weights for policy 1, policy_version 1436741 (0.0008) [2023-12-28 05:33:45,715][106225] Updated weights for policy 1, policy_version 1436751 (0.0010) [2023-12-28 05:33:46,046][106226] Updated weights for policy 0, policy_version 1433490 (0.0011) [2023-12-28 05:33:46,110][106226] Updated weights for policy 0, policy_version 1433500 (0.0011) [2023-12-28 05:33:46,171][106226] Updated weights for policy 0, policy_version 1433510 (0.0011) [2023-12-28 05:33:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 734904320. Throughput: 0: 9883.5, 1: 9898.2. Samples: 734899456. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:33:46,176][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.766')] [2023-12-28 05:33:46,234][106226] Updated weights for policy 0, policy_version 1433520 (0.0011) [2023-12-28 05:33:46,323][106225] Updated weights for policy 1, policy_version 1436761 (0.0010) [2023-12-28 05:33:46,385][106225] Updated weights for policy 1, policy_version 1436771 (0.0010) [2023-12-28 05:33:46,438][106225] Updated weights for policy 1, policy_version 1436781 (0.0010) [2023-12-28 05:33:46,485][106225] Updated weights for policy 1, policy_version 1436791 (0.0010) [2023-12-28 05:33:46,924][106226] Updated weights for policy 0, policy_version 1433530 (0.0008) [2023-12-28 05:33:46,984][106226] Updated weights for policy 0, policy_version 1433540 (0.0009) [2023-12-28 05:33:47,046][106226] Updated weights for policy 0, policy_version 1433550 (0.0008) [2023-12-28 05:33:47,178][106225] Updated weights for policy 1, policy_version 1436801 (0.0009) [2023-12-28 05:33:47,234][106225] Updated weights for policy 1, policy_version 1436811 (0.0008) [2023-12-28 05:33:47,293][106225] Updated weights for policy 1, policy_version 1436821 (0.0008) [2023-12-28 05:33:47,763][106226] Updated weights for policy 0, policy_version 1433560 (0.0008) [2023-12-28 05:33:47,819][106226] Updated weights for policy 0, policy_version 1433570 (0.0008) [2023-12-28 05:33:47,889][106226] Updated weights for policy 0, policy_version 1433580 (0.0009) [2023-12-28 05:33:47,996][106225] Updated weights for policy 1, policy_version 1436831 (0.0007) [2023-12-28 05:33:48,063][106225] Updated weights for policy 1, policy_version 1436841 (0.0010) [2023-12-28 05:33:48,116][106225] Updated weights for policy 1, policy_version 1436851 (0.0010) [2023-12-28 05:33:48,595][106226] Updated weights for policy 0, policy_version 1433590 (0.0008) [2023-12-28 05:33:48,653][106226] Updated weights for policy 0, policy_version 1433600 (0.0008) [2023-12-28 05:33:48,708][106226] Updated weights for policy 0, policy_version 1433610 (0.0008) [2023-12-28 05:33:48,818][106225] Updated weights for policy 1, policy_version 1436861 (0.0010) [2023-12-28 05:33:48,876][106225] Updated weights for policy 1, policy_version 1436871 (0.0010) [2023-12-28 05:33:48,936][106225] Updated weights for policy 1, policy_version 1436881 (0.0010) [2023-12-28 05:33:49,479][106226] Updated weights for policy 0, policy_version 1433620 (0.0008) [2023-12-28 05:33:49,537][106226] Updated weights for policy 0, policy_version 1433630 (0.0008) [2023-12-28 05:33:49,593][106226] Updated weights for policy 0, policy_version 1433640 (0.0006) [2023-12-28 05:33:49,670][106225] Updated weights for policy 1, policy_version 1436891 (0.0010) [2023-12-28 05:33:49,732][106225] Updated weights for policy 1, policy_version 1436901 (0.0010) [2023-12-28 05:33:49,787][106225] Updated weights for policy 1, policy_version 1436911 (0.0010) [2023-12-28 05:33:50,340][106226] Updated weights for policy 0, policy_version 1433650 (0.0007) [2023-12-28 05:33:50,400][106226] Updated weights for policy 0, policy_version 1433660 (0.0009) [2023-12-28 05:33:50,453][106226] Updated weights for policy 0, policy_version 1433670 (0.0008) [2023-12-28 05:33:50,505][106225] Updated weights for policy 1, policy_version 1436921 (0.0010) [2023-12-28 05:33:50,508][106226] Updated weights for policy 0, policy_version 1433680 (0.0007) [2023-12-28 05:33:50,558][106225] Updated weights for policy 1, policy_version 1436931 (0.0007) [2023-12-28 05:33:50,626][106225] Updated weights for policy 1, policy_version 1436941 (0.0009) [2023-12-28 05:33:50,691][106225] Updated weights for policy 1, policy_version 1436951 (0.0006) [2023-12-28 05:33:51,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 735002624. Throughput: 0: 9788.3, 1: 9959.2. Samples: 735015208. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:33:51,176][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.737')] [2023-12-28 05:33:51,367][106226] Updated weights for policy 0, policy_version 1433690 (0.0006) [2023-12-28 05:33:51,370][106225] Updated weights for policy 1, policy_version 1436961 (0.0007) [2023-12-28 05:33:51,435][106226] Updated weights for policy 0, policy_version 1433700 (0.0007) [2023-12-28 05:33:51,436][106225] Updated weights for policy 1, policy_version 1436971 (0.0007) [2023-12-28 05:33:51,495][106225] Updated weights for policy 1, policy_version 1436981 (0.0007) [2023-12-28 05:33:51,497][106226] Updated weights for policy 0, policy_version 1433710 (0.0006) [2023-12-28 05:33:52,228][106225] Updated weights for policy 1, policy_version 1436991 (0.0007) [2023-12-28 05:33:52,259][106226] Updated weights for policy 0, policy_version 1433720 (0.0008) [2023-12-28 05:33:52,295][106225] Updated weights for policy 1, policy_version 1437001 (0.0007) [2023-12-28 05:33:52,325][106226] Updated weights for policy 0, policy_version 1433730 (0.0007) [2023-12-28 05:33:52,361][106225] Updated weights for policy 1, policy_version 1437011 (0.0007) [2023-12-28 05:33:52,391][106226] Updated weights for policy 0, policy_version 1433740 (0.0008) [2023-12-28 05:33:53,078][106225] Updated weights for policy 1, policy_version 1437021 (0.0008) [2023-12-28 05:33:53,124][106226] Updated weights for policy 0, policy_version 1433750 (0.0007) [2023-12-28 05:33:53,143][106225] Updated weights for policy 1, policy_version 1437031 (0.0008) [2023-12-28 05:33:53,181][106226] Updated weights for policy 0, policy_version 1433760 (0.0005) [2023-12-28 05:33:53,195][106225] Updated weights for policy 1, policy_version 1437041 (0.0007) [2023-12-28 05:33:53,250][106226] Updated weights for policy 0, policy_version 1433770 (0.0008) [2023-12-28 05:33:53,814][106225] Updated weights for policy 1, policy_version 1437051 (0.0007) [2023-12-28 05:33:53,874][106225] Updated weights for policy 1, policy_version 1437061 (0.0008) [2023-12-28 05:33:53,926][106226] Updated weights for policy 0, policy_version 1433780 (0.0007) [2023-12-28 05:33:53,932][106225] Updated weights for policy 1, policy_version 1437071 (0.0007) [2023-12-28 05:33:53,982][106226] Updated weights for policy 0, policy_version 1433790 (0.0007) [2023-12-28 05:33:54,035][106226] Updated weights for policy 0, policy_version 1433800 (0.0008) [2023-12-28 05:33:54,629][106225] Updated weights for policy 1, policy_version 1437081 (0.0006) [2023-12-28 05:33:54,690][106225] Updated weights for policy 1, policy_version 1437091 (0.0009) [2023-12-28 05:33:54,738][106225] Updated weights for policy 1, policy_version 1437101 (0.0009) [2023-12-28 05:33:54,779][106226] Updated weights for policy 0, policy_version 1433810 (0.0009) [2023-12-28 05:33:54,781][106225] Updated weights for policy 1, policy_version 1437111 (0.0007) [2023-12-28 05:33:54,836][106226] Updated weights for policy 0, policy_version 1433820 (0.0008) [2023-12-28 05:33:54,884][106226] Updated weights for policy 0, policy_version 1433830 (0.0008) [2023-12-28 05:33:54,929][106226] Updated weights for policy 0, policy_version 1433840 (0.0009) [2023-12-28 05:33:55,528][106225] Updated weights for policy 1, policy_version 1437121 (0.0007) [2023-12-28 05:33:55,584][106225] Updated weights for policy 1, policy_version 1437131 (0.0010) [2023-12-28 05:33:55,642][106225] Updated weights for policy 1, policy_version 1437141 (0.0010) [2023-12-28 05:33:55,674][106226] Updated weights for policy 0, policy_version 1433850 (0.0010) [2023-12-28 05:33:55,727][106226] Updated weights for policy 0, policy_version 1433860 (0.0010) [2023-12-28 05:33:55,779][106226] Updated weights for policy 0, policy_version 1433870 (0.0010) [2023-12-28 05:33:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 735100928. Throughput: 0: 9708.4, 1: 9995.1. Samples: 735072688. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:33:56,175][105115] Avg episode reward: [(0, '-4.953'), (1, '-4.943')] [2023-12-28 05:33:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001437144_367960064.pth... [2023-12-28 05:33:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001433872_367140864.pth... [2023-12-28 05:33:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001432720_366845952.pth [2023-12-28 05:33:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001435992_367665152.pth [2023-12-28 05:33:56,330][106225] Updated weights for policy 1, policy_version 1437151 (0.0009) [2023-12-28 05:33:56,392][106225] Updated weights for policy 1, policy_version 1437161 (0.0010) [2023-12-28 05:33:56,443][106225] Updated weights for policy 1, policy_version 1437171 (0.0010) [2023-12-28 05:33:56,473][106226] Updated weights for policy 0, policy_version 1433880 (0.0011) [2023-12-28 05:33:56,534][106226] Updated weights for policy 0, policy_version 1433890 (0.0010) [2023-12-28 05:33:56,591][106226] Updated weights for policy 0, policy_version 1433900 (0.0010) [2023-12-28 05:33:57,075][106225] Updated weights for policy 1, policy_version 1437181 (0.0010) [2023-12-28 05:33:57,124][106225] Updated weights for policy 1, policy_version 1437191 (0.0010) [2023-12-28 05:33:57,173][106225] Updated weights for policy 1, policy_version 1437201 (0.0010) [2023-12-28 05:33:57,297][106226] Updated weights for policy 0, policy_version 1433910 (0.0010) [2023-12-28 05:33:57,359][106226] Updated weights for policy 0, policy_version 1433920 (0.0010) [2023-12-28 05:33:57,417][106226] Updated weights for policy 0, policy_version 1433930 (0.0009) [2023-12-28 05:33:57,894][106225] Updated weights for policy 1, policy_version 1437211 (0.0010) [2023-12-28 05:33:57,952][106225] Updated weights for policy 1, policy_version 1437221 (0.0009) [2023-12-28 05:33:58,009][106225] Updated weights for policy 1, policy_version 1437231 (0.0007) [2023-12-28 05:33:58,027][106226] Updated weights for policy 0, policy_version 1433940 (0.0008) [2023-12-28 05:33:58,086][106226] Updated weights for policy 0, policy_version 1433950 (0.0007) [2023-12-28 05:33:58,146][106226] Updated weights for policy 0, policy_version 1433960 (0.0005) [2023-12-28 05:33:58,725][106225] Updated weights for policy 1, policy_version 1437241 (0.0010) [2023-12-28 05:33:58,788][106225] Updated weights for policy 1, policy_version 1437251 (0.0008) [2023-12-28 05:33:58,858][106226] Updated weights for policy 0, policy_version 1433970 (0.0005) [2023-12-28 05:33:58,861][106225] Updated weights for policy 1, policy_version 1437261 (0.0008) [2023-12-28 05:33:58,921][106226] Updated weights for policy 0, policy_version 1433980 (0.0009) [2023-12-28 05:33:58,925][106225] Updated weights for policy 1, policy_version 1437271 (0.0009) [2023-12-28 05:33:58,984][106226] Updated weights for policy 0, policy_version 1433990 (0.0008) [2023-12-28 05:33:59,049][106226] Updated weights for policy 0, policy_version 1434000 (0.0006) [2023-12-28 05:33:59,632][106225] Updated weights for policy 1, policy_version 1437281 (0.0007) [2023-12-28 05:33:59,678][106226] Updated weights for policy 0, policy_version 1434010 (0.0009) [2023-12-28 05:33:59,692][106225] Updated weights for policy 1, policy_version 1437291 (0.0005) [2023-12-28 05:33:59,735][106226] Updated weights for policy 0, policy_version 1434020 (0.0007) [2023-12-28 05:33:59,746][106225] Updated weights for policy 1, policy_version 1437301 (0.0005) [2023-12-28 05:33:59,792][106226] Updated weights for policy 0, policy_version 1434030 (0.0008) [2023-12-28 05:34:00,437][106225] Updated weights for policy 1, policy_version 1437311 (0.0005) [2023-12-28 05:34:00,496][106225] Updated weights for policy 1, policy_version 1437321 (0.0008) [2023-12-28 05:34:00,526][106226] Updated weights for policy 0, policy_version 1434040 (0.0008) [2023-12-28 05:34:00,550][106225] Updated weights for policy 1, policy_version 1437331 (0.0010) [2023-12-28 05:34:00,589][106226] Updated weights for policy 0, policy_version 1434050 (0.0006) [2023-12-28 05:34:00,646][106226] Updated weights for policy 0, policy_version 1434060 (0.0007) [2023-12-28 05:34:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 735199232. Throughput: 0: 9723.2, 1: 9952.8. Samples: 735192208. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:01,175][105115] Avg episode reward: [(0, '-4.980'), (1, '-4.361')] [2023-12-28 05:34:01,192][106225] Updated weights for policy 1, policy_version 1437341 (0.0009) [2023-12-28 05:34:01,256][106225] Updated weights for policy 1, policy_version 1437351 (0.0006) [2023-12-28 05:34:01,310][106225] Updated weights for policy 1, policy_version 1437361 (0.0007) [2023-12-28 05:34:01,388][106226] Updated weights for policy 0, policy_version 1434070 (0.0008) [2023-12-28 05:34:01,455][106226] Updated weights for policy 0, policy_version 1434080 (0.0008) [2023-12-28 05:34:01,518][106226] Updated weights for policy 0, policy_version 1434090 (0.0007) [2023-12-28 05:34:02,009][106225] Updated weights for policy 1, policy_version 1437371 (0.0006) [2023-12-28 05:34:02,067][106225] Updated weights for policy 1, policy_version 1437381 (0.0009) [2023-12-28 05:34:02,132][106225] Updated weights for policy 1, policy_version 1437391 (0.0009) [2023-12-28 05:34:02,285][106226] Updated weights for policy 0, policy_version 1434100 (0.0006) [2023-12-28 05:34:02,341][106226] Updated weights for policy 0, policy_version 1434110 (0.0008) [2023-12-28 05:34:02,404][106226] Updated weights for policy 0, policy_version 1434120 (0.0008) [2023-12-28 05:34:02,839][106225] Updated weights for policy 1, policy_version 1437401 (0.0010) [2023-12-28 05:34:02,894][106225] Updated weights for policy 1, policy_version 1437411 (0.0009) [2023-12-28 05:34:02,946][106225] Updated weights for policy 1, policy_version 1437421 (0.0005) [2023-12-28 05:34:03,003][106225] Updated weights for policy 1, policy_version 1437431 (0.0005) [2023-12-28 05:34:03,161][106226] Updated weights for policy 0, policy_version 1434130 (0.0007) [2023-12-28 05:34:03,222][106226] Updated weights for policy 0, policy_version 1434140 (0.0006) [2023-12-28 05:34:03,274][106226] Updated weights for policy 0, policy_version 1434150 (0.0008) [2023-12-28 05:34:03,322][106226] Updated weights for policy 0, policy_version 1434160 (0.0008) [2023-12-28 05:34:03,552][106225] Updated weights for policy 1, policy_version 1437441 (0.0005) [2023-12-28 05:34:03,619][106225] Updated weights for policy 1, policy_version 1437451 (0.0005) [2023-12-28 05:34:03,673][106225] Updated weights for policy 1, policy_version 1437461 (0.0005) [2023-12-28 05:34:03,909][106226] Updated weights for policy 0, policy_version 1434170 (0.0011) [2023-12-28 05:34:03,980][106226] Updated weights for policy 0, policy_version 1434180 (0.0011) [2023-12-28 05:34:04,049][106226] Updated weights for policy 0, policy_version 1434190 (0.0011) [2023-12-28 05:34:04,246][106225] Updated weights for policy 1, policy_version 1437471 (0.0009) [2023-12-28 05:34:04,309][106225] Updated weights for policy 1, policy_version 1437481 (0.0010) [2023-12-28 05:34:04,370][106225] Updated weights for policy 1, policy_version 1437491 (0.0010) [2023-12-28 05:34:04,730][106226] Updated weights for policy 0, policy_version 1434200 (0.0007) [2023-12-28 05:34:04,783][106226] Updated weights for policy 0, policy_version 1434210 (0.0005) [2023-12-28 05:34:04,847][106226] Updated weights for policy 0, policy_version 1434220 (0.0005) [2023-12-28 05:34:05,047][106225] Updated weights for policy 1, policy_version 1437501 (0.0010) [2023-12-28 05:34:05,098][106225] Updated weights for policy 1, policy_version 1437511 (0.0010) [2023-12-28 05:34:05,145][106225] Updated weights for policy 1, policy_version 1437521 (0.0010) [2023-12-28 05:34:05,363][106226] Updated weights for policy 0, policy_version 1434230 (0.0005) [2023-12-28 05:34:05,419][106226] Updated weights for policy 0, policy_version 1434240 (0.0005) [2023-12-28 05:34:05,479][106226] Updated weights for policy 0, policy_version 1434250 (0.0005) [2023-12-28 05:34:05,901][106225] Updated weights for policy 1, policy_version 1437531 (0.0010) [2023-12-28 05:34:05,964][106225] Updated weights for policy 1, policy_version 1437541 (0.0010) [2023-12-28 05:34:06,025][106225] Updated weights for policy 1, policy_version 1437551 (0.0010) [2023-12-28 05:34:06,052][106226] Updated weights for policy 0, policy_version 1434260 (0.0005) [2023-12-28 05:34:06,115][106226] Updated weights for policy 0, policy_version 1434270 (0.0008) [2023-12-28 05:34:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 735305728. Throughput: 0: 9833.1, 1: 9967.0. Samples: 735317148. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:06,175][105115] Avg episode reward: [(0, '-4.772'), (1, '-4.821')] [2023-12-28 05:34:06,177][106226] Updated weights for policy 0, policy_version 1434280 (0.0011) [2023-12-28 05:34:06,725][106225] Updated weights for policy 1, policy_version 1437561 (0.0010) [2023-12-28 05:34:06,796][106225] Updated weights for policy 1, policy_version 1437571 (0.0008) [2023-12-28 05:34:06,855][106225] Updated weights for policy 1, policy_version 1437581 (0.0010) [2023-12-28 05:34:06,857][106226] Updated weights for policy 0, policy_version 1434290 (0.0010) [2023-12-28 05:34:06,906][106225] Updated weights for policy 1, policy_version 1437591 (0.0010) [2023-12-28 05:34:06,920][106226] Updated weights for policy 0, policy_version 1434300 (0.0011) [2023-12-28 05:34:06,984][106226] Updated weights for policy 0, policy_version 1434310 (0.0011) [2023-12-28 05:34:07,050][106226] Updated weights for policy 0, policy_version 1434320 (0.0011) [2023-12-28 05:34:07,537][106225] Updated weights for policy 1, policy_version 1437601 (0.0010) [2023-12-28 05:34:07,583][106225] Updated weights for policy 1, policy_version 1437611 (0.0010) [2023-12-28 05:34:07,632][106225] Updated weights for policy 1, policy_version 1437621 (0.0010) [2023-12-28 05:34:07,746][106226] Updated weights for policy 0, policy_version 1434330 (0.0011) [2023-12-28 05:34:07,795][106226] Updated weights for policy 0, policy_version 1434340 (0.0010) [2023-12-28 05:34:07,848][106226] Updated weights for policy 0, policy_version 1434350 (0.0010) [2023-12-28 05:34:08,365][106225] Updated weights for policy 1, policy_version 1437631 (0.0009) [2023-12-28 05:34:08,414][106225] Updated weights for policy 1, policy_version 1437641 (0.0005) [2023-12-28 05:34:08,473][106226] Updated weights for policy 0, policy_version 1434360 (0.0009) [2023-12-28 05:34:08,473][106225] Updated weights for policy 1, policy_version 1437651 (0.0006) [2023-12-28 05:34:08,524][106226] Updated weights for policy 0, policy_version 1434370 (0.0010) [2023-12-28 05:34:08,579][106226] Updated weights for policy 0, policy_version 1434380 (0.0011) [2023-12-28 05:34:09,098][106225] Updated weights for policy 1, policy_version 1437661 (0.0008) [2023-12-28 05:34:09,159][106225] Updated weights for policy 1, policy_version 1437671 (0.0011) [2023-12-28 05:34:09,217][106225] Updated weights for policy 1, policy_version 1437681 (0.0010) [2023-12-28 05:34:09,372][106226] Updated weights for policy 0, policy_version 1434390 (0.0010) [2023-12-28 05:34:09,440][106226] Updated weights for policy 0, policy_version 1434400 (0.0010) [2023-12-28 05:34:09,505][106226] Updated weights for policy 0, policy_version 1434410 (0.0010) [2023-12-28 05:34:09,977][106225] Updated weights for policy 1, policy_version 1437691 (0.0010) [2023-12-28 05:34:10,043][106225] Updated weights for policy 1, policy_version 1437701 (0.0009) [2023-12-28 05:34:10,108][106225] Updated weights for policy 1, policy_version 1437711 (0.0010) [2023-12-28 05:34:10,223][106226] Updated weights for policy 0, policy_version 1434420 (0.0009) [2023-12-28 05:34:10,283][106226] Updated weights for policy 0, policy_version 1434430 (0.0007) [2023-12-28 05:34:10,339][106226] Updated weights for policy 0, policy_version 1434440 (0.0008) [2023-12-28 05:34:10,780][106225] Updated weights for policy 1, policy_version 1437721 (0.0010) [2023-12-28 05:34:10,837][106225] Updated weights for policy 1, policy_version 1437731 (0.0007) [2023-12-28 05:34:10,900][106225] Updated weights for policy 1, policy_version 1437741 (0.0009) [2023-12-28 05:34:10,959][106225] Updated weights for policy 1, policy_version 1437751 (0.0010) [2023-12-28 05:34:11,099][106226] Updated weights for policy 0, policy_version 1434450 (0.0008) [2023-12-28 05:34:11,175][106226] Updated weights for policy 0, policy_version 1434460 (0.0009) [2023-12-28 05:34:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 735404032. Throughput: 0: 9897.9, 1: 10004.7. Samples: 735377932. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:11,175][105115] Avg episode reward: [(0, '-5.103'), (1, '-4.791')] [2023-12-28 05:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001437752_368115712.pth... [2023-12-28 05:34:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001436568_367812608.pth [2023-12-28 05:34:11,240][106226] Updated weights for policy 0, policy_version 1434470 (0.0008) [2023-12-28 05:34:11,305][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001434480_367296512.pth... [2023-12-28 05:34:11,307][106226] Updated weights for policy 0, policy_version 1434480 (0.0009) [2023-12-28 05:34:11,309][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001433328_367001600.pth [2023-12-28 05:34:11,710][106225] Updated weights for policy 1, policy_version 1437761 (0.0008) [2023-12-28 05:34:11,776][106225] Updated weights for policy 1, policy_version 1437771 (0.0008) [2023-12-28 05:34:11,831][106225] Updated weights for policy 1, policy_version 1437781 (0.0009) [2023-12-28 05:34:12,085][106226] Updated weights for policy 0, policy_version 1434490 (0.0008) [2023-12-28 05:34:12,135][106226] Updated weights for policy 0, policy_version 1434500 (0.0009) [2023-12-28 05:34:12,188][106226] Updated weights for policy 0, policy_version 1434510 (0.0008) [2023-12-28 05:34:12,596][106225] Updated weights for policy 1, policy_version 1437791 (0.0007) [2023-12-28 05:34:12,651][106225] Updated weights for policy 1, policy_version 1437801 (0.0005) [2023-12-28 05:34:12,713][106225] Updated weights for policy 1, policy_version 1437811 (0.0005) [2023-12-28 05:34:12,983][106226] Updated weights for policy 0, policy_version 1434520 (0.0008) [2023-12-28 05:34:13,042][106226] Updated weights for policy 0, policy_version 1434530 (0.0008) [2023-12-28 05:34:13,104][106226] Updated weights for policy 0, policy_version 1434540 (0.0009) [2023-12-28 05:34:13,328][106225] Updated weights for policy 1, policy_version 1437821 (0.0006) [2023-12-28 05:34:13,390][106225] Updated weights for policy 1, policy_version 1437831 (0.0009) [2023-12-28 05:34:13,439][106225] Updated weights for policy 1, policy_version 1437841 (0.0008) [2023-12-28 05:34:13,818][106226] Updated weights for policy 0, policy_version 1434550 (0.0008) [2023-12-28 05:34:13,865][106226] Updated weights for policy 0, policy_version 1434560 (0.0008) [2023-12-28 05:34:13,913][106226] Updated weights for policy 0, policy_version 1434570 (0.0008) [2023-12-28 05:34:14,164][106225] Updated weights for policy 1, policy_version 1437851 (0.0008) [2023-12-28 05:34:14,217][106225] Updated weights for policy 1, policy_version 1437861 (0.0008) [2023-12-28 05:34:14,265][106225] Updated weights for policy 1, policy_version 1437871 (0.0008) [2023-12-28 05:34:14,628][106226] Updated weights for policy 0, policy_version 1434580 (0.0008) [2023-12-28 05:34:14,678][106226] Updated weights for policy 0, policy_version 1434590 (0.0007) [2023-12-28 05:34:14,727][106226] Updated weights for policy 0, policy_version 1434600 (0.0006) [2023-12-28 05:34:15,006][106225] Updated weights for policy 1, policy_version 1437881 (0.0008) [2023-12-28 05:34:15,077][106225] Updated weights for policy 1, policy_version 1437891 (0.0007) [2023-12-28 05:34:15,137][106225] Updated weights for policy 1, policy_version 1437901 (0.0007) [2023-12-28 05:34:15,198][106225] Updated weights for policy 1, policy_version 1437911 (0.0007) [2023-12-28 05:34:15,513][106226] Updated weights for policy 0, policy_version 1434610 (0.0008) [2023-12-28 05:34:15,565][106226] Updated weights for policy 0, policy_version 1434620 (0.0009) [2023-12-28 05:34:15,623][106226] Updated weights for policy 0, policy_version 1434630 (0.0009) [2023-12-28 05:34:15,683][106226] Updated weights for policy 0, policy_version 1434640 (0.0009) [2023-12-28 05:34:15,823][106225] Updated weights for policy 1, policy_version 1437921 (0.0008) [2023-12-28 05:34:15,881][106225] Updated weights for policy 1, policy_version 1437931 (0.0008) [2023-12-28 05:34:15,935][106225] Updated weights for policy 1, policy_version 1437941 (0.0010) [2023-12-28 05:34:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 735502336. Throughput: 0: 9749.9, 1: 9964.7. Samples: 735491584. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:16,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-4.729')] [2023-12-28 05:34:16,291][106226] Updated weights for policy 0, policy_version 1434650 (0.0008) [2023-12-28 05:34:16,352][106226] Updated weights for policy 0, policy_version 1434660 (0.0009) [2023-12-28 05:34:16,412][106226] Updated weights for policy 0, policy_version 1434670 (0.0008) [2023-12-28 05:34:16,594][106225] Updated weights for policy 1, policy_version 1437951 (0.0008) [2023-12-28 05:34:16,641][106225] Updated weights for policy 1, policy_version 1437961 (0.0006) [2023-12-28 05:34:16,686][106225] Updated weights for policy 1, policy_version 1437971 (0.0008) [2023-12-28 05:34:17,076][106226] Updated weights for policy 0, policy_version 1434680 (0.0009) [2023-12-28 05:34:17,132][106226] Updated weights for policy 0, policy_version 1434690 (0.0010) [2023-12-28 05:34:17,181][106226] Updated weights for policy 0, policy_version 1434700 (0.0007) [2023-12-28 05:34:17,438][106225] Updated weights for policy 1, policy_version 1437981 (0.0007) [2023-12-28 05:34:17,488][106225] Updated weights for policy 1, policy_version 1437991 (0.0008) [2023-12-28 05:34:17,537][106225] Updated weights for policy 1, policy_version 1438002 (0.0009) [2023-12-28 05:34:17,757][106226] Updated weights for policy 0, policy_version 1434710 (0.0006) [2023-12-28 05:34:17,810][106226] Updated weights for policy 0, policy_version 1434720 (0.0007) [2023-12-28 05:34:17,863][106226] Updated weights for policy 0, policy_version 1434730 (0.0010) [2023-12-28 05:34:18,190][106225] Updated weights for policy 1, policy_version 1438012 (0.0007) [2023-12-28 05:34:18,246][106225] Updated weights for policy 1, policy_version 1438022 (0.0006) [2023-12-28 05:34:18,312][106225] Updated weights for policy 1, policy_version 1438032 (0.0006) [2023-12-28 05:34:18,510][106226] Updated weights for policy 0, policy_version 1434740 (0.0011) [2023-12-28 05:34:18,572][106226] Updated weights for policy 0, policy_version 1434750 (0.0010) [2023-12-28 05:34:18,636][106226] Updated weights for policy 0, policy_version 1434760 (0.0009) [2023-12-28 05:34:18,918][106225] Updated weights for policy 1, policy_version 1438042 (0.0008) [2023-12-28 05:34:18,976][106225] Updated weights for policy 1, policy_version 1438052 (0.0006) [2023-12-28 05:34:19,043][106225] Updated weights for policy 1, policy_version 1438062 (0.0006) [2023-12-28 05:34:19,105][106225] Updated weights for policy 1, policy_version 1438072 (0.0005) [2023-12-28 05:34:19,213][106226] Updated weights for policy 0, policy_version 1434770 (0.0008) [2023-12-28 05:34:19,281][106226] Updated weights for policy 0, policy_version 1434780 (0.0007) [2023-12-28 05:34:19,349][106226] Updated weights for policy 0, policy_version 1434790 (0.0011) [2023-12-28 05:34:19,418][106226] Updated weights for policy 0, policy_version 1434800 (0.0011) [2023-12-28 05:34:19,717][106225] Updated weights for policy 1, policy_version 1438082 (0.0007) [2023-12-28 05:34:19,783][106225] Updated weights for policy 1, policy_version 1438092 (0.0008) [2023-12-28 05:34:19,849][106225] Updated weights for policy 1, policy_version 1438102 (0.0007) [2023-12-28 05:34:20,164][106226] Updated weights for policy 0, policy_version 1434810 (0.0008) [2023-12-28 05:34:20,235][106226] Updated weights for policy 0, policy_version 1434820 (0.0009) [2023-12-28 05:34:20,285][106226] Updated weights for policy 0, policy_version 1434830 (0.0008) [2023-12-28 05:34:20,519][106225] Updated weights for policy 1, policy_version 1438112 (0.0010) [2023-12-28 05:34:20,576][106225] Updated weights for policy 1, policy_version 1438122 (0.0009) [2023-12-28 05:34:20,634][106225] Updated weights for policy 1, policy_version 1438132 (0.0010) [2023-12-28 05:34:21,120][106226] Updated weights for policy 0, policy_version 1434840 (0.0007) [2023-12-28 05:34:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 735600640. Throughput: 0: 9818.3, 1: 10037.6. Samples: 735615576. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:21,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-4.514')] [2023-12-28 05:34:21,184][106226] Updated weights for policy 0, policy_version 1434850 (0.0009) [2023-12-28 05:34:21,241][106226] Updated weights for policy 0, policy_version 1434860 (0.0008) [2023-12-28 05:34:21,371][106225] Updated weights for policy 1, policy_version 1438142 (0.0009) [2023-12-28 05:34:21,436][106225] Updated weights for policy 1, policy_version 1438152 (0.0007) [2023-12-28 05:34:21,499][106225] Updated weights for policy 1, policy_version 1438162 (0.0008) [2023-12-28 05:34:22,039][106226] Updated weights for policy 0, policy_version 1434870 (0.0007) [2023-12-28 05:34:22,103][106226] Updated weights for policy 0, policy_version 1434880 (0.0008) [2023-12-28 05:34:22,165][106226] Updated weights for policy 0, policy_version 1434890 (0.0008) [2023-12-28 05:34:22,210][106225] Updated weights for policy 1, policy_version 1438172 (0.0008) [2023-12-28 05:34:22,285][106225] Updated weights for policy 1, policy_version 1438182 (0.0007) [2023-12-28 05:34:22,355][106225] Updated weights for policy 1, policy_version 1438192 (0.0008) [2023-12-28 05:34:22,912][106226] Updated weights for policy 0, policy_version 1434900 (0.0008) [2023-12-28 05:34:22,980][106226] Updated weights for policy 0, policy_version 1434910 (0.0008) [2023-12-28 05:34:23,041][106226] Updated weights for policy 0, policy_version 1434920 (0.0008) [2023-12-28 05:34:23,047][106225] Updated weights for policy 1, policy_version 1438202 (0.0009) [2023-12-28 05:34:23,108][106225] Updated weights for policy 1, policy_version 1438212 (0.0011) [2023-12-28 05:34:23,173][106225] Updated weights for policy 1, policy_version 1438222 (0.0011) [2023-12-28 05:34:23,238][106225] Updated weights for policy 1, policy_version 1438232 (0.0010) [2023-12-28 05:34:23,704][106226] Updated weights for policy 0, policy_version 1434930 (0.0007) [2023-12-28 05:34:23,757][106226] Updated weights for policy 0, policy_version 1434940 (0.0010) [2023-12-28 05:34:23,810][106226] Updated weights for policy 0, policy_version 1434950 (0.0010) [2023-12-28 05:34:23,866][106226] Updated weights for policy 0, policy_version 1434960 (0.0010) [2023-12-28 05:34:23,875][106225] Updated weights for policy 1, policy_version 1438242 (0.0010) [2023-12-28 05:34:23,939][106225] Updated weights for policy 1, policy_version 1438252 (0.0010) [2023-12-28 05:34:23,993][106225] Updated weights for policy 1, policy_version 1438262 (0.0010) [2023-12-28 05:34:24,533][106226] Updated weights for policy 0, policy_version 1434970 (0.0011) [2023-12-28 05:34:24,591][106226] Updated weights for policy 0, policy_version 1434980 (0.0011) [2023-12-28 05:34:24,650][106226] Updated weights for policy 0, policy_version 1434990 (0.0010) [2023-12-28 05:34:24,733][106225] Updated weights for policy 1, policy_version 1438272 (0.0010) [2023-12-28 05:34:24,787][106225] Updated weights for policy 1, policy_version 1438282 (0.0010) [2023-12-28 05:34:24,842][106225] Updated weights for policy 1, policy_version 1438292 (0.0010) [2023-12-28 05:34:25,256][106226] Updated weights for policy 0, policy_version 1435000 (0.0009) [2023-12-28 05:34:25,319][106226] Updated weights for policy 0, policy_version 1435010 (0.0011) [2023-12-28 05:34:25,378][106226] Updated weights for policy 0, policy_version 1435020 (0.0011) [2023-12-28 05:34:25,601][106225] Updated weights for policy 1, policy_version 1438302 (0.0007) [2023-12-28 05:34:25,647][106225] Updated weights for policy 1, policy_version 1438312 (0.0010) [2023-12-28 05:34:25,697][106225] Updated weights for policy 1, policy_version 1438322 (0.0010) [2023-12-28 05:34:25,985][106226] Updated weights for policy 0, policy_version 1435030 (0.0010) [2023-12-28 05:34:26,039][106226] Updated weights for policy 0, policy_version 1435040 (0.0011) [2023-12-28 05:34:26,092][106226] Updated weights for policy 0, policy_version 1435050 (0.0010) [2023-12-28 05:34:26,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 735707136. Throughput: 0: 9781.3, 1: 10030.9. Samples: 735673976. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:26,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.404')] [2023-12-28 05:34:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001438328_368263168.pth... [2023-12-28 05:34:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001435056_367443968.pth... [2023-12-28 05:34:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001437144_367960064.pth [2023-12-28 05:34:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001433872_367140864.pth [2023-12-28 05:34:26,414][106225] Updated weights for policy 1, policy_version 1438332 (0.0010) [2023-12-28 05:34:26,476][106225] Updated weights for policy 1, policy_version 1438342 (0.0010) [2023-12-28 05:34:26,529][106225] Updated weights for policy 1, policy_version 1438352 (0.0010) [2023-12-28 05:34:26,720][106226] Updated weights for policy 0, policy_version 1435060 (0.0006) [2023-12-28 05:34:26,766][106226] Updated weights for policy 0, policy_version 1435070 (0.0005) [2023-12-28 05:34:26,812][106226] Updated weights for policy 0, policy_version 1435080 (0.0007) [2023-12-28 05:34:27,131][106225] Updated weights for policy 1, policy_version 1438362 (0.0010) [2023-12-28 05:34:27,184][106225] Updated weights for policy 1, policy_version 1438372 (0.0010) [2023-12-28 05:34:27,234][106225] Updated weights for policy 1, policy_version 1438382 (0.0010) [2023-12-28 05:34:27,287][106225] Updated weights for policy 1, policy_version 1438392 (0.0010) [2023-12-28 05:34:27,491][106226] Updated weights for policy 0, policy_version 1435090 (0.0010) [2023-12-28 05:34:27,548][106226] Updated weights for policy 0, policy_version 1435100 (0.0011) [2023-12-28 05:34:27,594][106226] Updated weights for policy 0, policy_version 1435110 (0.0010) [2023-12-28 05:34:27,647][106226] Updated weights for policy 0, policy_version 1435120 (0.0010) [2023-12-28 05:34:28,007][106225] Updated weights for policy 1, policy_version 1438402 (0.0010) [2023-12-28 05:34:28,053][106225] Updated weights for policy 1, policy_version 1438412 (0.0010) [2023-12-28 05:34:28,099][106225] Updated weights for policy 1, policy_version 1438422 (0.0010) [2023-12-28 05:34:28,250][106226] Updated weights for policy 0, policy_version 1435130 (0.0006) [2023-12-28 05:34:28,306][106226] Updated weights for policy 0, policy_version 1435140 (0.0005) [2023-12-28 05:34:28,374][106226] Updated weights for policy 0, policy_version 1435150 (0.0009) [2023-12-28 05:34:28,863][106225] Updated weights for policy 1, policy_version 1438432 (0.0009) [2023-12-28 05:34:28,928][106225] Updated weights for policy 1, policy_version 1438442 (0.0007) [2023-12-28 05:34:28,967][106226] Updated weights for policy 0, policy_version 1435160 (0.0008) [2023-12-28 05:34:28,978][106225] Updated weights for policy 1, policy_version 1438452 (0.0006) [2023-12-28 05:34:29,019][106226] Updated weights for policy 0, policy_version 1435170 (0.0009) [2023-12-28 05:34:29,072][106226] Updated weights for policy 0, policy_version 1435180 (0.0008) [2023-12-28 05:34:29,616][106225] Updated weights for policy 1, policy_version 1438462 (0.0007) [2023-12-28 05:34:29,668][106225] Updated weights for policy 1, policy_version 1438472 (0.0005) [2023-12-28 05:34:29,722][106225] Updated weights for policy 1, policy_version 1438482 (0.0005) [2023-12-28 05:34:29,871][106226] Updated weights for policy 0, policy_version 1435190 (0.0008) [2023-12-28 05:34:29,940][106226] Updated weights for policy 0, policy_version 1435200 (0.0011) [2023-12-28 05:34:30,007][106226] Updated weights for policy 0, policy_version 1435210 (0.0011) [2023-12-28 05:34:30,345][106225] Updated weights for policy 1, policy_version 1438492 (0.0007) [2023-12-28 05:34:30,401][106225] Updated weights for policy 1, policy_version 1438502 (0.0008) [2023-12-28 05:34:30,450][106225] Updated weights for policy 1, policy_version 1438512 (0.0007) [2023-12-28 05:34:30,706][106226] Updated weights for policy 0, policy_version 1435220 (0.0008) [2023-12-28 05:34:30,773][106226] Updated weights for policy 0, policy_version 1435230 (0.0008) [2023-12-28 05:34:30,830][106226] Updated weights for policy 0, policy_version 1435240 (0.0007) [2023-12-28 05:34:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 735805440. Throughput: 0: 9899.5, 1: 10048.1. Samples: 735797096. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:31,175][105115] Avg episode reward: [(0, '-5.030'), (1, '-4.477')] [2023-12-28 05:34:31,189][106225] Updated weights for policy 1, policy_version 1438522 (0.0007) [2023-12-28 05:34:31,250][106225] Updated weights for policy 1, policy_version 1438532 (0.0007) [2023-12-28 05:34:31,318][106225] Updated weights for policy 1, policy_version 1438542 (0.0007) [2023-12-28 05:34:31,393][106225] Updated weights for policy 1, policy_version 1438552 (0.0008) [2023-12-28 05:34:31,536][106226] Updated weights for policy 0, policy_version 1435250 (0.0007) [2023-12-28 05:34:31,585][106226] Updated weights for policy 0, policy_version 1435260 (0.0008) [2023-12-28 05:34:31,649][106226] Updated weights for policy 0, policy_version 1435270 (0.0010) [2023-12-28 05:34:31,705][106226] Updated weights for policy 0, policy_version 1435280 (0.0008) [2023-12-28 05:34:32,120][106225] Updated weights for policy 1, policy_version 1438562 (0.0006) [2023-12-28 05:34:32,172][106225] Updated weights for policy 1, policy_version 1438572 (0.0006) [2023-12-28 05:34:32,217][106225] Updated weights for policy 1, policy_version 1438582 (0.0005) [2023-12-28 05:34:32,524][106226] Updated weights for policy 0, policy_version 1435290 (0.0010) [2023-12-28 05:34:32,575][106226] Updated weights for policy 0, policy_version 1435300 (0.0008) [2023-12-28 05:34:32,629][106226] Updated weights for policy 0, policy_version 1435310 (0.0009) [2023-12-28 05:34:32,795][106225] Updated weights for policy 1, policy_version 1438592 (0.0008) [2023-12-28 05:34:32,846][106225] Updated weights for policy 1, policy_version 1438602 (0.0008) [2023-12-28 05:34:32,903][106225] Updated weights for policy 1, policy_version 1438612 (0.0008) [2023-12-28 05:34:33,338][106226] Updated weights for policy 0, policy_version 1435320 (0.0010) [2023-12-28 05:34:33,388][106226] Updated weights for policy 0, policy_version 1435330 (0.0007) [2023-12-28 05:34:33,450][106226] Updated weights for policy 0, policy_version 1435340 (0.0006) [2023-12-28 05:34:33,603][106225] Updated weights for policy 1, policy_version 1438622 (0.0008) [2023-12-28 05:34:33,662][106225] Updated weights for policy 1, policy_version 1438632 (0.0007) [2023-12-28 05:34:33,714][106225] Updated weights for policy 1, policy_version 1438642 (0.0005) [2023-12-28 05:34:34,017][106226] Updated weights for policy 0, policy_version 1435350 (0.0005) [2023-12-28 05:34:34,082][106226] Updated weights for policy 0, policy_version 1435360 (0.0005) [2023-12-28 05:34:34,128][106226] Updated weights for policy 0, policy_version 1435370 (0.0005) [2023-12-28 05:34:34,431][106225] Updated weights for policy 1, policy_version 1438652 (0.0007) [2023-12-28 05:34:34,482][106225] Updated weights for policy 1, policy_version 1438662 (0.0007) [2023-12-28 05:34:34,540][106225] Updated weights for policy 1, policy_version 1438672 (0.0008) [2023-12-28 05:34:34,801][106226] Updated weights for policy 0, policy_version 1435380 (0.0007) [2023-12-28 05:34:34,870][106226] Updated weights for policy 0, policy_version 1435390 (0.0005) [2023-12-28 05:34:34,934][106226] Updated weights for policy 0, policy_version 1435400 (0.0005) [2023-12-28 05:34:35,223][106225] Updated weights for policy 1, policy_version 1438682 (0.0008) [2023-12-28 05:34:35,282][106225] Updated weights for policy 1, policy_version 1438692 (0.0005) [2023-12-28 05:34:35,339][106225] Updated weights for policy 1, policy_version 1438702 (0.0005) [2023-12-28 05:34:35,408][106225] Updated weights for policy 1, policy_version 1438712 (0.0005) [2023-12-28 05:34:35,459][106226] Updated weights for policy 0, policy_version 1435410 (0.0006) [2023-12-28 05:34:35,515][106226] Updated weights for policy 0, policy_version 1435420 (0.0006) [2023-12-28 05:34:35,571][106226] Updated weights for policy 0, policy_version 1435430 (0.0005) [2023-12-28 05:34:35,626][106226] Updated weights for policy 0, policy_version 1435440 (0.0005) [2023-12-28 05:34:35,926][106225] Updated weights for policy 1, policy_version 1438722 (0.0006) [2023-12-28 05:34:35,985][106225] Updated weights for policy 1, policy_version 1438732 (0.0008) [2023-12-28 05:34:36,043][106225] Updated weights for policy 1, policy_version 1438742 (0.0008) [2023-12-28 05:34:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 735911936. Throughput: 0: 10036.7, 1: 10116.0. Samples: 735922080. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:36,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-4.547')] [2023-12-28 05:34:36,227][106226] Updated weights for policy 0, policy_version 1435450 (0.0011) [2023-12-28 05:34:36,293][106226] Updated weights for policy 0, policy_version 1435460 (0.0011) [2023-12-28 05:34:36,364][106226] Updated weights for policy 0, policy_version 1435470 (0.0011) [2023-12-28 05:34:36,729][106225] Updated weights for policy 1, policy_version 1438752 (0.0008) [2023-12-28 05:34:36,775][106225] Updated weights for policy 1, policy_version 1438762 (0.0005) [2023-12-28 05:34:36,828][106225] Updated weights for policy 1, policy_version 1438772 (0.0005) [2023-12-28 05:34:37,031][106226] Updated weights for policy 0, policy_version 1435480 (0.0008) [2023-12-28 05:34:37,088][106226] Updated weights for policy 0, policy_version 1435490 (0.0008) [2023-12-28 05:34:37,146][106226] Updated weights for policy 0, policy_version 1435500 (0.0008) [2023-12-28 05:34:37,472][106225] Updated weights for policy 1, policy_version 1438782 (0.0007) [2023-12-28 05:34:37,535][106225] Updated weights for policy 1, policy_version 1438792 (0.0010) [2023-12-28 05:34:37,601][106225] Updated weights for policy 1, policy_version 1438802 (0.0010) [2023-12-28 05:34:37,846][106226] Updated weights for policy 0, policy_version 1435510 (0.0010) [2023-12-28 05:34:37,901][106226] Updated weights for policy 0, policy_version 1435520 (0.0011) [2023-12-28 05:34:37,952][106226] Updated weights for policy 0, policy_version 1435530 (0.0011) [2023-12-28 05:34:38,323][106225] Updated weights for policy 1, policy_version 1438812 (0.0010) [2023-12-28 05:34:38,385][106225] Updated weights for policy 1, policy_version 1438822 (0.0008) [2023-12-28 05:34:38,433][106225] Updated weights for policy 1, policy_version 1438832 (0.0008) [2023-12-28 05:34:38,721][106226] Updated weights for policy 0, policy_version 1435540 (0.0011) [2023-12-28 05:34:38,778][106226] Updated weights for policy 0, policy_version 1435550 (0.0011) [2023-12-28 05:34:38,840][106226] Updated weights for policy 0, policy_version 1435560 (0.0010) [2023-12-28 05:34:39,191][106225] Updated weights for policy 1, policy_version 1438842 (0.0008) [2023-12-28 05:34:39,252][106225] Updated weights for policy 1, policy_version 1438852 (0.0009) [2023-12-28 05:34:39,307][106225] Updated weights for policy 1, policy_version 1438862 (0.0008) [2023-12-28 05:34:39,375][106225] Updated weights for policy 1, policy_version 1438872 (0.0008) [2023-12-28 05:34:39,570][106226] Updated weights for policy 0, policy_version 1435570 (0.0009) [2023-12-28 05:34:39,631][106226] Updated weights for policy 0, policy_version 1435580 (0.0008) [2023-12-28 05:34:39,685][106226] Updated weights for policy 0, policy_version 1435590 (0.0008) [2023-12-28 05:34:39,743][106226] Updated weights for policy 0, policy_version 1435600 (0.0009) [2023-12-28 05:34:40,129][106225] Updated weights for policy 1, policy_version 1438882 (0.0009) [2023-12-28 05:34:40,191][106225] Updated weights for policy 1, policy_version 1438892 (0.0010) [2023-12-28 05:34:40,251][106225] Updated weights for policy 1, policy_version 1438902 (0.0009) [2023-12-28 05:34:40,516][106226] Updated weights for policy 0, policy_version 1435610 (0.0008) [2023-12-28 05:34:40,573][106226] Updated weights for policy 0, policy_version 1435620 (0.0010) [2023-12-28 05:34:40,634][106226] Updated weights for policy 0, policy_version 1435630 (0.0008) [2023-12-28 05:34:40,986][106225] Updated weights for policy 1, policy_version 1438912 (0.0006) [2023-12-28 05:34:41,054][106225] Updated weights for policy 1, policy_version 1438922 (0.0007) [2023-12-28 05:34:41,111][106225] Updated weights for policy 1, policy_version 1438932 (0.0008) [2023-12-28 05:34:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 736010240. Throughput: 0: 10052.2, 1: 10122.4. Samples: 735980548. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:41,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-4.510')] [2023-12-28 05:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001438936_368418816.pth... [2023-12-28 05:34:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001435632_367591424.pth... [2023-12-28 05:34:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001437752_368115712.pth [2023-12-28 05:34:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001434480_367296512.pth [2023-12-28 05:34:41,409][106226] Updated weights for policy 0, policy_version 1435640 (0.0008) [2023-12-28 05:34:41,468][106226] Updated weights for policy 0, policy_version 1435650 (0.0009) [2023-12-28 05:34:41,534][106226] Updated weights for policy 0, policy_version 1435660 (0.0005) [2023-12-28 05:34:41,899][106225] Updated weights for policy 1, policy_version 1438942 (0.0008) [2023-12-28 05:34:41,957][106225] Updated weights for policy 1, policy_version 1438952 (0.0008) [2023-12-28 05:34:42,017][106225] Updated weights for policy 1, policy_version 1438962 (0.0009) [2023-12-28 05:34:42,237][106226] Updated weights for policy 0, policy_version 1435670 (0.0008) [2023-12-28 05:34:42,298][106226] Updated weights for policy 0, policy_version 1435680 (0.0008) [2023-12-28 05:34:42,358][106226] Updated weights for policy 0, policy_version 1435690 (0.0008) [2023-12-28 05:34:42,674][106225] Updated weights for policy 1, policy_version 1438972 (0.0010) [2023-12-28 05:34:42,736][106225] Updated weights for policy 1, policy_version 1438982 (0.0010) [2023-12-28 05:34:42,794][106225] Updated weights for policy 1, policy_version 1438992 (0.0011) [2023-12-28 05:34:43,161][106226] Updated weights for policy 0, policy_version 1435700 (0.0007) [2023-12-28 05:34:43,215][106226] Updated weights for policy 0, policy_version 1435710 (0.0008) [2023-12-28 05:34:43,283][106226] Updated weights for policy 0, policy_version 1435720 (0.0008) [2023-12-28 05:34:43,485][106225] Updated weights for policy 1, policy_version 1439002 (0.0010) [2023-12-28 05:34:43,534][106225] Updated weights for policy 1, policy_version 1439012 (0.0008) [2023-12-28 05:34:43,591][106225] Updated weights for policy 1, policy_version 1439022 (0.0008) [2023-12-28 05:34:43,646][106225] Updated weights for policy 1, policy_version 1439032 (0.0009) [2023-12-28 05:34:43,854][106226] Updated weights for policy 0, policy_version 1435730 (0.0008) [2023-12-28 05:34:43,905][106226] Updated weights for policy 0, policy_version 1435740 (0.0005) [2023-12-28 05:34:43,967][106226] Updated weights for policy 0, policy_version 1435750 (0.0008) [2023-12-28 05:34:44,027][106226] Updated weights for policy 0, policy_version 1435760 (0.0008) [2023-12-28 05:34:44,389][106225] Updated weights for policy 1, policy_version 1439042 (0.0008) [2023-12-28 05:34:44,451][106225] Updated weights for policy 1, policy_version 1439052 (0.0008) [2023-12-28 05:34:44,499][106225] Updated weights for policy 1, policy_version 1439062 (0.0005) [2023-12-28 05:34:44,693][106226] Updated weights for policy 0, policy_version 1435770 (0.0009) [2023-12-28 05:34:44,751][106226] Updated weights for policy 0, policy_version 1435780 (0.0005) [2023-12-28 05:34:44,836][106226] Updated weights for policy 0, policy_version 1435790 (0.0007) [2023-12-28 05:34:45,260][106225] Updated weights for policy 1, policy_version 1439072 (0.0007) [2023-12-28 05:34:45,326][106225] Updated weights for policy 1, policy_version 1439082 (0.0009) [2023-12-28 05:34:45,391][106225] Updated weights for policy 1, policy_version 1439092 (0.0008) [2023-12-28 05:34:45,480][106226] Updated weights for policy 0, policy_version 1435800 (0.0009) [2023-12-28 05:34:45,538][106226] Updated weights for policy 0, policy_version 1435810 (0.0008) [2023-12-28 05:34:45,591][106226] Updated weights for policy 0, policy_version 1435820 (0.0009) [2023-12-28 05:34:45,940][106225] Updated weights for policy 1, policy_version 1439102 (0.0009) [2023-12-28 05:34:45,998][106225] Updated weights for policy 1, policy_version 1439112 (0.0009) [2023-12-28 05:34:46,057][106225] Updated weights for policy 1, policy_version 1439122 (0.0007) [2023-12-28 05:34:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 736108544. Throughput: 0: 10020.2, 1: 10064.1. Samples: 736096000. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:46,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-4.571')] [2023-12-28 05:34:46,340][106226] Updated weights for policy 0, policy_version 1435830 (0.0008) [2023-12-28 05:34:46,393][106226] Updated weights for policy 0, policy_version 1435840 (0.0008) [2023-12-28 05:34:46,443][106226] Updated weights for policy 0, policy_version 1435850 (0.0007) [2023-12-28 05:34:46,647][106225] Updated weights for policy 1, policy_version 1439132 (0.0008) [2023-12-28 05:34:46,703][106225] Updated weights for policy 1, policy_version 1439142 (0.0009) [2023-12-28 05:34:46,764][106225] Updated weights for policy 1, policy_version 1439152 (0.0010) [2023-12-28 05:34:47,196][106226] Updated weights for policy 0, policy_version 1435860 (0.0009) [2023-12-28 05:34:47,271][106226] Updated weights for policy 0, policy_version 1435870 (0.0008) [2023-12-28 05:34:47,335][106226] Updated weights for policy 0, policy_version 1435880 (0.0008) [2023-12-28 05:34:47,400][106225] Updated weights for policy 1, policy_version 1439162 (0.0007) [2023-12-28 05:34:47,450][106225] Updated weights for policy 1, policy_version 1439172 (0.0005) [2023-12-28 05:34:47,502][106225] Updated weights for policy 1, policy_version 1439182 (0.0005) [2023-12-28 05:34:47,556][106225] Updated weights for policy 1, policy_version 1439192 (0.0006) [2023-12-28 05:34:47,974][106226] Updated weights for policy 0, policy_version 1435890 (0.0008) [2023-12-28 05:34:48,030][106226] Updated weights for policy 0, policy_version 1435900 (0.0009) [2023-12-28 05:34:48,086][106226] Updated weights for policy 0, policy_version 1435910 (0.0008) [2023-12-28 05:34:48,135][106226] Updated weights for policy 0, policy_version 1435920 (0.0009) [2023-12-28 05:34:48,198][106225] Updated weights for policy 1, policy_version 1439202 (0.0008) [2023-12-28 05:34:48,256][106225] Updated weights for policy 1, policy_version 1439212 (0.0009) [2023-12-28 05:34:48,312][106225] Updated weights for policy 1, policy_version 1439222 (0.0005) [2023-12-28 05:34:48,868][106226] Updated weights for policy 0, policy_version 1435930 (0.0009) [2023-12-28 05:34:48,921][106226] Updated weights for policy 0, policy_version 1435940 (0.0009) [2023-12-28 05:34:48,933][106225] Updated weights for policy 1, policy_version 1439232 (0.0006) [2023-12-28 05:34:48,975][106226] Updated weights for policy 0, policy_version 1435950 (0.0007) [2023-12-28 05:34:48,999][106225] Updated weights for policy 1, policy_version 1439242 (0.0010) [2023-12-28 05:34:49,062][106225] Updated weights for policy 1, policy_version 1439252 (0.0010) [2023-12-28 05:34:49,723][106226] Updated weights for policy 0, policy_version 1435960 (0.0007) [2023-12-28 05:34:49,736][106225] Updated weights for policy 1, policy_version 1439262 (0.0010) [2023-12-28 05:34:49,778][106226] Updated weights for policy 0, policy_version 1435970 (0.0006) [2023-12-28 05:34:49,798][106225] Updated weights for policy 1, policy_version 1439272 (0.0010) [2023-12-28 05:34:49,837][106226] Updated weights for policy 0, policy_version 1435980 (0.0009) [2023-12-28 05:34:49,864][106225] Updated weights for policy 1, policy_version 1439282 (0.0010) [2023-12-28 05:34:50,532][106226] Updated weights for policy 0, policy_version 1435990 (0.0006) [2023-12-28 05:34:50,591][106226] Updated weights for policy 0, policy_version 1436000 (0.0009) [2023-12-28 05:34:50,600][106225] Updated weights for policy 1, policy_version 1439292 (0.0011) [2023-12-28 05:34:50,656][106226] Updated weights for policy 0, policy_version 1436010 (0.0008) [2023-12-28 05:34:50,658][106225] Updated weights for policy 1, policy_version 1439302 (0.0010) [2023-12-28 05:34:50,720][106225] Updated weights for policy 1, policy_version 1439312 (0.0012) [2023-12-28 05:34:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.5, 300 sec: 19771.9). Total num frames: 736206848. Throughput: 0: 9942.1, 1: 10072.5. Samples: 736217808. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:51,175][105115] Avg episode reward: [(0, '-4.757'), (1, '-4.783')] [2023-12-28 05:34:51,309][106226] Updated weights for policy 0, policy_version 1436020 (0.0008) [2023-12-28 05:34:51,378][106226] Updated weights for policy 0, policy_version 1436030 (0.0008) [2023-12-28 05:34:51,450][106226] Updated weights for policy 0, policy_version 1436040 (0.0008) [2023-12-28 05:34:51,483][106225] Updated weights for policy 1, policy_version 1439322 (0.0009) [2023-12-28 05:34:51,550][106225] Updated weights for policy 1, policy_version 1439332 (0.0011) [2023-12-28 05:34:51,609][106225] Updated weights for policy 1, policy_version 1439342 (0.0010) [2023-12-28 05:34:51,687][106225] Updated weights for policy 1, policy_version 1439352 (0.0010) [2023-12-28 05:34:52,161][106226] Updated weights for policy 0, policy_version 1436050 (0.0006) [2023-12-28 05:34:52,227][106226] Updated weights for policy 0, policy_version 1436060 (0.0009) [2023-12-28 05:34:52,289][106226] Updated weights for policy 0, policy_version 1436070 (0.0008) [2023-12-28 05:34:52,326][106225] Updated weights for policy 1, policy_version 1439362 (0.0007) [2023-12-28 05:34:52,342][106226] Updated weights for policy 0, policy_version 1436080 (0.0008) [2023-12-28 05:34:52,386][106225] Updated weights for policy 1, policy_version 1439372 (0.0007) [2023-12-28 05:34:52,437][106225] Updated weights for policy 1, policy_version 1439382 (0.0005) [2023-12-28 05:34:53,039][106225] Updated weights for policy 1, policy_version 1439392 (0.0008) [2023-12-28 05:34:53,092][106225] Updated weights for policy 1, policy_version 1439402 (0.0007) [2023-12-28 05:34:53,111][106226] Updated weights for policy 0, policy_version 1436090 (0.0007) [2023-12-28 05:34:53,145][106225] Updated weights for policy 1, policy_version 1439412 (0.0005) [2023-12-28 05:34:53,167][106226] Updated weights for policy 0, policy_version 1436100 (0.0008) [2023-12-28 05:34:53,226][106226] Updated weights for policy 0, policy_version 1436110 (0.0008) [2023-12-28 05:34:53,817][106225] Updated weights for policy 1, policy_version 1439422 (0.0005) [2023-12-28 05:34:53,884][106225] Updated weights for policy 1, policy_version 1439432 (0.0005) [2023-12-28 05:34:53,904][106226] Updated weights for policy 0, policy_version 1436120 (0.0008) [2023-12-28 05:34:53,942][106225] Updated weights for policy 1, policy_version 1439442 (0.0005) [2023-12-28 05:34:53,954][106226] Updated weights for policy 0, policy_version 1436130 (0.0008) [2023-12-28 05:34:54,006][106226] Updated weights for policy 0, policy_version 1436140 (0.0008) [2023-12-28 05:34:54,564][106225] Updated weights for policy 1, policy_version 1439452 (0.0007) [2023-12-28 05:34:54,611][106225] Updated weights for policy 1, policy_version 1439462 (0.0010) [2023-12-28 05:34:54,657][106225] Updated weights for policy 1, policy_version 1439472 (0.0010) [2023-12-28 05:34:54,719][106226] Updated weights for policy 0, policy_version 1436150 (0.0006) [2023-12-28 05:34:54,773][106226] Updated weights for policy 0, policy_version 1436160 (0.0005) [2023-12-28 05:34:54,834][106226] Updated weights for policy 0, policy_version 1436170 (0.0005) [2023-12-28 05:34:55,364][106225] Updated weights for policy 1, policy_version 1439482 (0.0010) [2023-12-28 05:34:55,387][106226] Updated weights for policy 0, policy_version 1436180 (0.0005) [2023-12-28 05:34:55,419][106225] Updated weights for policy 1, policy_version 1439492 (0.0010) [2023-12-28 05:34:55,446][106226] Updated weights for policy 0, policy_version 1436190 (0.0006) [2023-12-28 05:34:55,466][106225] Updated weights for policy 1, policy_version 1439502 (0.0010) [2023-12-28 05:34:55,503][106226] Updated weights for policy 0, policy_version 1436200 (0.0006) [2023-12-28 05:34:55,523][106225] Updated weights for policy 1, policy_version 1439512 (0.0010) [2023-12-28 05:34:56,045][106226] Updated weights for policy 0, policy_version 1436210 (0.0007) [2023-12-28 05:34:56,096][106226] Updated weights for policy 0, policy_version 1436220 (0.0007) [2023-12-28 05:34:56,149][106226] Updated weights for policy 0, policy_version 1436230 (0.0006) [2023-12-28 05:34:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 736305152. Throughput: 0: 9908.6, 1: 10071.9. Samples: 736277056. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:34:56,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.650')] [2023-12-28 05:34:56,200][106225] Updated weights for policy 1, policy_version 1439522 (0.0010) [2023-12-28 05:34:56,210][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001436240_367747072.pth... [2023-12-28 05:34:56,211][106226] Updated weights for policy 0, policy_version 1436240 (0.0006) [2023-12-28 05:34:56,214][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001435056_367443968.pth [2023-12-28 05:34:56,253][106225] Updated weights for policy 1, policy_version 1439532 (0.0010) [2023-12-28 05:34:56,300][106225] Updated weights for policy 1, policy_version 1439542 (0.0010) [2023-12-28 05:34:56,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001439544_368574464.pth... [2023-12-28 05:34:56,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001438328_368263168.pth [2023-12-28 05:34:56,912][106226] Updated weights for policy 0, policy_version 1436250 (0.0008) [2023-12-28 05:34:56,964][106226] Updated weights for policy 0, policy_version 1436260 (0.0009) [2023-12-28 05:34:57,011][106226] Updated weights for policy 0, policy_version 1436270 (0.0010) [2023-12-28 05:34:57,028][106225] Updated weights for policy 1, policy_version 1439552 (0.0010) [2023-12-28 05:34:57,090][106225] Updated weights for policy 1, policy_version 1439562 (0.0010) [2023-12-28 05:34:57,146][106225] Updated weights for policy 1, policy_version 1439572 (0.0010) [2023-12-28 05:34:57,683][106226] Updated weights for policy 0, policy_version 1436280 (0.0006) [2023-12-28 05:34:57,745][106226] Updated weights for policy 0, policy_version 1436290 (0.0006) [2023-12-28 05:34:57,793][106225] Updated weights for policy 1, policy_version 1439582 (0.0008) [2023-12-28 05:34:57,805][106226] Updated weights for policy 0, policy_version 1436300 (0.0005) [2023-12-28 05:34:57,845][106225] Updated weights for policy 1, policy_version 1439592 (0.0009) [2023-12-28 05:34:57,896][106225] Updated weights for policy 1, policy_version 1439602 (0.0007) [2023-12-28 05:34:58,531][106226] Updated weights for policy 0, policy_version 1436310 (0.0006) [2023-12-28 05:34:58,601][106226] Updated weights for policy 0, policy_version 1436320 (0.0008) [2023-12-28 05:34:58,641][106225] Updated weights for policy 1, policy_version 1439612 (0.0008) [2023-12-28 05:34:58,667][106226] Updated weights for policy 0, policy_version 1436330 (0.0010) [2023-12-28 05:34:58,703][106225] Updated weights for policy 1, policy_version 1439622 (0.0010) [2023-12-28 05:34:58,769][106225] Updated weights for policy 1, policy_version 1439632 (0.0011) [2023-12-28 05:34:59,478][106226] Updated weights for policy 0, policy_version 1436340 (0.0011) [2023-12-28 05:34:59,540][106226] Updated weights for policy 0, policy_version 1436350 (0.0011) [2023-12-28 05:34:59,545][106225] Updated weights for policy 1, policy_version 1439642 (0.0011) [2023-12-28 05:34:59,603][106226] Updated weights for policy 0, policy_version 1436360 (0.0011) [2023-12-28 05:34:59,607][106225] Updated weights for policy 1, policy_version 1439652 (0.0011) [2023-12-28 05:34:59,664][106225] Updated weights for policy 1, policy_version 1439662 (0.0010) [2023-12-28 05:34:59,712][106225] Updated weights for policy 1, policy_version 1439672 (0.0010) [2023-12-28 05:35:00,263][106226] Updated weights for policy 0, policy_version 1436370 (0.0009) [2023-12-28 05:35:00,328][106226] Updated weights for policy 0, policy_version 1436380 (0.0010) [2023-12-28 05:35:00,398][106226] Updated weights for policy 0, policy_version 1436390 (0.0011) [2023-12-28 05:35:00,433][106225] Updated weights for policy 1, policy_version 1439682 (0.0006) [2023-12-28 05:35:00,448][106226] Updated weights for policy 0, policy_version 1436400 (0.0010) [2023-12-28 05:35:00,497][106225] Updated weights for policy 1, policy_version 1439692 (0.0010) [2023-12-28 05:35:00,561][106225] Updated weights for policy 1, policy_version 1439702 (0.0010) [2023-12-28 05:35:01,116][106226] Updated weights for policy 0, policy_version 1436410 (0.0006) [2023-12-28 05:35:01,166][106225] Updated weights for policy 1, policy_version 1439712 (0.0009) [2023-12-28 05:35:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 736403456. Throughput: 0: 10041.2, 1: 10103.5. Samples: 736398092. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:01,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-4.767')] [2023-12-28 05:35:01,181][106226] Updated weights for policy 0, policy_version 1436420 (0.0012) [2023-12-28 05:35:01,226][106225] Updated weights for policy 1, policy_version 1439722 (0.0009) [2023-12-28 05:35:01,249][106226] Updated weights for policy 0, policy_version 1436430 (0.0008) [2023-12-28 05:35:01,291][106225] Updated weights for policy 1, policy_version 1439732 (0.0009) [2023-12-28 05:35:01,978][106225] Updated weights for policy 1, policy_version 1439742 (0.0005) [2023-12-28 05:35:01,988][106226] Updated weights for policy 0, policy_version 1436440 (0.0010) [2023-12-28 05:35:02,036][106225] Updated weights for policy 1, policy_version 1439752 (0.0007) [2023-12-28 05:35:02,053][106226] Updated weights for policy 0, policy_version 1436450 (0.0011) [2023-12-28 05:35:02,100][106225] Updated weights for policy 1, policy_version 1439762 (0.0007) [2023-12-28 05:35:02,112][106226] Updated weights for policy 0, policy_version 1436460 (0.0011) [2023-12-28 05:35:02,741][106225] Updated weights for policy 1, policy_version 1439772 (0.0006) [2023-12-28 05:35:02,768][106226] Updated weights for policy 0, policy_version 1436470 (0.0008) [2023-12-28 05:35:02,801][106225] Updated weights for policy 1, policy_version 1439782 (0.0006) [2023-12-28 05:35:02,829][106226] Updated weights for policy 0, policy_version 1436480 (0.0006) [2023-12-28 05:35:02,862][106225] Updated weights for policy 1, policy_version 1439792 (0.0007) [2023-12-28 05:35:02,888][106226] Updated weights for policy 0, policy_version 1436490 (0.0005) [2023-12-28 05:35:03,390][106225] Updated weights for policy 1, policy_version 1439802 (0.0006) [2023-12-28 05:35:03,439][106226] Updated weights for policy 0, policy_version 1436500 (0.0008) [2023-12-28 05:35:03,444][106225] Updated weights for policy 1, policy_version 1439812 (0.0005) [2023-12-28 05:35:03,496][106226] Updated weights for policy 0, policy_version 1436510 (0.0008) [2023-12-28 05:35:03,500][106225] Updated weights for policy 1, policy_version 1439822 (0.0005) [2023-12-28 05:35:03,559][106226] Updated weights for policy 0, policy_version 1436520 (0.0008) [2023-12-28 05:35:03,561][106225] Updated weights for policy 1, policy_version 1439832 (0.0006) [2023-12-28 05:35:04,220][106225] Updated weights for policy 1, policy_version 1439842 (0.0006) [2023-12-28 05:35:04,247][106226] Updated weights for policy 0, policy_version 1436530 (0.0008) [2023-12-28 05:35:04,279][106225] Updated weights for policy 1, policy_version 1439852 (0.0006) [2023-12-28 05:35:04,313][106226] Updated weights for policy 0, policy_version 1436540 (0.0007) [2023-12-28 05:35:04,338][106225] Updated weights for policy 1, policy_version 1439862 (0.0007) [2023-12-28 05:35:04,373][106226] Updated weights for policy 0, policy_version 1436550 (0.0006) [2023-12-28 05:35:04,433][106226] Updated weights for policy 0, policy_version 1436560 (0.0009) [2023-12-28 05:35:04,986][106225] Updated weights for policy 1, policy_version 1439872 (0.0006) [2023-12-28 05:35:05,046][106225] Updated weights for policy 1, policy_version 1439882 (0.0008) [2023-12-28 05:35:05,099][106225] Updated weights for policy 1, policy_version 1439892 (0.0010) [2023-12-28 05:35:05,159][106226] Updated weights for policy 0, policy_version 1436570 (0.0008) [2023-12-28 05:35:05,212][106226] Updated weights for policy 0, policy_version 1436580 (0.0008) [2023-12-28 05:35:05,272][106226] Updated weights for policy 0, policy_version 1436590 (0.0007) [2023-12-28 05:35:05,771][106225] Updated weights for policy 1, policy_version 1439902 (0.0007) [2023-12-28 05:35:05,827][106225] Updated weights for policy 1, policy_version 1439912 (0.0005) [2023-12-28 05:35:05,838][106226] Updated weights for policy 0, policy_version 1436600 (0.0006) [2023-12-28 05:35:05,883][106225] Updated weights for policy 1, policy_version 1439922 (0.0005) [2023-12-28 05:35:05,899][106226] Updated weights for policy 0, policy_version 1436610 (0.0005) [2023-12-28 05:35:05,954][106226] Updated weights for policy 0, policy_version 1436620 (0.0008) [2023-12-28 05:35:06,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 736518144. Throughput: 0: 10047.9, 1: 10136.8. Samples: 736523888. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:06,175][105115] Avg episode reward: [(0, '-5.002'), (1, '-4.413')] [2023-12-28 05:35:06,469][106225] Updated weights for policy 1, policy_version 1439932 (0.0007) [2023-12-28 05:35:06,534][106225] Updated weights for policy 1, policy_version 1439942 (0.0009) [2023-12-28 05:35:06,600][106225] Updated weights for policy 1, policy_version 1439952 (0.0010) [2023-12-28 05:35:06,726][106226] Updated weights for policy 0, policy_version 1436630 (0.0010) [2023-12-28 05:35:06,789][106226] Updated weights for policy 0, policy_version 1436640 (0.0008) [2023-12-28 05:35:06,851][106226] Updated weights for policy 0, policy_version 1436650 (0.0008) [2023-12-28 05:35:07,416][106225] Updated weights for policy 1, policy_version 1439962 (0.0009) [2023-12-28 05:35:07,476][106225] Updated weights for policy 1, policy_version 1439972 (0.0010) [2023-12-28 05:35:07,528][106226] Updated weights for policy 0, policy_version 1436660 (0.0007) [2023-12-28 05:35:07,534][106225] Updated weights for policy 1, policy_version 1439982 (0.0010) [2023-12-28 05:35:07,581][106226] Updated weights for policy 0, policy_version 1436670 (0.0007) [2023-12-28 05:35:07,593][106225] Updated weights for policy 1, policy_version 1439992 (0.0009) [2023-12-28 05:35:07,636][106226] Updated weights for policy 0, policy_version 1436680 (0.0008) [2023-12-28 05:35:08,206][106226] Updated weights for policy 0, policy_version 1436690 (0.0007) [2023-12-28 05:35:08,259][106226] Updated weights for policy 0, policy_version 1436700 (0.0010) [2023-12-28 05:35:08,287][106225] Updated weights for policy 1, policy_version 1440002 (0.0009) [2023-12-28 05:35:08,309][106226] Updated weights for policy 0, policy_version 1436710 (0.0010) [2023-12-28 05:35:08,356][106225] Updated weights for policy 1, policy_version 1440013 (0.0010) [2023-12-28 05:35:08,377][106226] Updated weights for policy 0, policy_version 1436720 (0.0008) [2023-12-28 05:35:08,421][106225] Updated weights for policy 1, policy_version 1440023 (0.0009) [2023-12-28 05:35:09,022][106226] Updated weights for policy 0, policy_version 1436730 (0.0011) [2023-12-28 05:35:09,085][106226] Updated weights for policy 0, policy_version 1436740 (0.0010) [2023-12-28 05:35:09,142][106226] Updated weights for policy 0, policy_version 1436750 (0.0010) [2023-12-28 05:35:09,143][106225] Updated weights for policy 1, policy_version 1440033 (0.0006) [2023-12-28 05:35:09,195][106225] Updated weights for policy 1, policy_version 1440043 (0.0005) [2023-12-28 05:35:09,262][106225] Updated weights for policy 1, policy_version 1440053 (0.0008) [2023-12-28 05:35:09,887][106226] Updated weights for policy 0, policy_version 1436760 (0.0008) [2023-12-28 05:35:09,954][106226] Updated weights for policy 0, policy_version 1436770 (0.0007) [2023-12-28 05:35:10,014][106225] Updated weights for policy 1, policy_version 1440063 (0.0006) [2023-12-28 05:35:10,017][106226] Updated weights for policy 0, policy_version 1436780 (0.0008) [2023-12-28 05:35:10,083][106225] Updated weights for policy 1, policy_version 1440073 (0.0010) [2023-12-28 05:35:10,147][106225] Updated weights for policy 1, policy_version 1440083 (0.0010) [2023-12-28 05:35:10,663][106226] Updated weights for policy 0, policy_version 1436790 (0.0007) [2023-12-28 05:35:10,722][106226] Updated weights for policy 0, policy_version 1436800 (0.0006) [2023-12-28 05:35:10,778][106226] Updated weights for policy 0, policy_version 1436810 (0.0010) [2023-12-28 05:35:10,817][106225] Updated weights for policy 1, policy_version 1440093 (0.0008) [2023-12-28 05:35:10,876][106225] Updated weights for policy 1, policy_version 1440103 (0.0009) [2023-12-28 05:35:10,932][106225] Updated weights for policy 1, policy_version 1440113 (0.0010) [2023-12-28 05:35:11,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 736616448. Throughput: 0: 10097.8, 1: 10134.6. Samples: 736584432. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:11,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.705')] [2023-12-28 05:35:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001440120_368721920.pth... [2023-12-28 05:35:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001436816_367894528.pth... [2023-12-28 05:35:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001438936_368418816.pth [2023-12-28 05:35:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001435632_367591424.pth [2023-12-28 05:35:11,542][106226] Updated weights for policy 0, policy_version 1436820 (0.0011) [2023-12-28 05:35:11,613][106226] Updated weights for policy 0, policy_version 1436830 (0.0010) [2023-12-28 05:35:11,680][106226] Updated weights for policy 0, policy_version 1436840 (0.0008) [2023-12-28 05:35:11,707][106225] Updated weights for policy 1, policy_version 1440123 (0.0010) [2023-12-28 05:35:11,774][106225] Updated weights for policy 1, policy_version 1440133 (0.0007) [2023-12-28 05:35:11,844][106225] Updated weights for policy 1, policy_version 1440143 (0.0006) [2023-12-28 05:35:12,498][106225] Updated weights for policy 1, policy_version 1440153 (0.0006) [2023-12-28 05:35:12,500][106226] Updated weights for policy 0, policy_version 1436850 (0.0009) [2023-12-28 05:35:12,551][106225] Updated weights for policy 1, policy_version 1440163 (0.0006) [2023-12-28 05:35:12,560][106226] Updated weights for policy 0, policy_version 1436860 (0.0007) [2023-12-28 05:35:12,598][106225] Updated weights for policy 1, policy_version 1440173 (0.0007) [2023-12-28 05:35:12,620][106226] Updated weights for policy 0, policy_version 1436870 (0.0009) [2023-12-28 05:35:12,649][106225] Updated weights for policy 1, policy_version 1440183 (0.0007) [2023-12-28 05:35:12,677][106226] Updated weights for policy 0, policy_version 1436880 (0.0007) [2023-12-28 05:35:13,353][106225] Updated weights for policy 1, policy_version 1440193 (0.0008) [2023-12-28 05:35:13,412][106225] Updated weights for policy 1, policy_version 1440203 (0.0007) [2023-12-28 05:35:13,434][106226] Updated weights for policy 0, policy_version 1436890 (0.0007) [2023-12-28 05:35:13,470][106225] Updated weights for policy 1, policy_version 1440213 (0.0007) [2023-12-28 05:35:13,493][106226] Updated weights for policy 0, policy_version 1436900 (0.0006) [2023-12-28 05:35:13,546][106226] Updated weights for policy 0, policy_version 1436910 (0.0007) [2023-12-28 05:35:14,029][106225] Updated weights for policy 1, policy_version 1440223 (0.0006) [2023-12-28 05:35:14,087][106225] Updated weights for policy 1, policy_version 1440233 (0.0006) [2023-12-28 05:35:14,146][106225] Updated weights for policy 1, policy_version 1440243 (0.0009) [2023-12-28 05:35:14,358][106226] Updated weights for policy 0, policy_version 1436920 (0.0009) [2023-12-28 05:35:14,426][106226] Updated weights for policy 0, policy_version 1436930 (0.0010) [2023-12-28 05:35:14,488][106226] Updated weights for policy 0, policy_version 1436940 (0.0008) [2023-12-28 05:35:14,706][106225] Updated weights for policy 1, policy_version 1440253 (0.0008) [2023-12-28 05:35:14,755][106225] Updated weights for policy 1, policy_version 1440264 (0.0008) [2023-12-28 05:35:14,823][106225] Updated weights for policy 1, policy_version 1440274 (0.0008) [2023-12-28 05:35:15,299][106226] Updated weights for policy 0, policy_version 1436950 (0.0009) [2023-12-28 05:35:15,357][106226] Updated weights for policy 0, policy_version 1436960 (0.0009) [2023-12-28 05:35:15,417][106226] Updated weights for policy 0, policy_version 1436970 (0.0009) [2023-12-28 05:35:15,478][106225] Updated weights for policy 1, policy_version 1440284 (0.0007) [2023-12-28 05:35:15,526][106225] Updated weights for policy 1, policy_version 1440294 (0.0008) [2023-12-28 05:35:15,579][106225] Updated weights for policy 1, policy_version 1440304 (0.0008) [2023-12-28 05:35:16,173][106226] Updated weights for policy 0, policy_version 1436980 (0.0010) [2023-12-28 05:35:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 736706560. Throughput: 0: 9915.8, 1: 10163.2. Samples: 736700652. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:16,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-4.769')] [2023-12-28 05:35:16,228][106226] Updated weights for policy 0, policy_version 1436990 (0.0008) [2023-12-28 05:35:16,267][106225] Updated weights for policy 1, policy_version 1440314 (0.0008) [2023-12-28 05:35:16,286][106226] Updated weights for policy 0, policy_version 1437000 (0.0009) [2023-12-28 05:35:16,322][106225] Updated weights for policy 1, policy_version 1440324 (0.0005) [2023-12-28 05:35:16,375][106225] Updated weights for policy 1, policy_version 1440334 (0.0005) [2023-12-28 05:35:16,434][106225] Updated weights for policy 1, policy_version 1440344 (0.0006) [2023-12-28 05:35:16,975][106225] Updated weights for policy 1, policy_version 1440354 (0.0009) [2023-12-28 05:35:17,020][106226] Updated weights for policy 0, policy_version 1437010 (0.0008) [2023-12-28 05:35:17,037][106225] Updated weights for policy 1, policy_version 1440364 (0.0006) [2023-12-28 05:35:17,081][106226] Updated weights for policy 0, policy_version 1437020 (0.0008) [2023-12-28 05:35:17,091][106225] Updated weights for policy 1, policy_version 1440374 (0.0006) [2023-12-28 05:35:17,133][106226] Updated weights for policy 0, policy_version 1437030 (0.0006) [2023-12-28 05:35:17,187][106226] Updated weights for policy 0, policy_version 1437040 (0.0005) [2023-12-28 05:35:17,740][106226] Updated weights for policy 0, policy_version 1437050 (0.0006) [2023-12-28 05:35:17,749][106225] Updated weights for policy 1, policy_version 1440384 (0.0008) [2023-12-28 05:35:17,800][106226] Updated weights for policy 0, policy_version 1437060 (0.0005) [2023-12-28 05:35:17,817][106225] Updated weights for policy 1, policy_version 1440394 (0.0008) [2023-12-28 05:35:17,861][106226] Updated weights for policy 0, policy_version 1437070 (0.0006) [2023-12-28 05:35:17,884][106225] Updated weights for policy 1, policy_version 1440404 (0.0008) [2023-12-28 05:35:18,498][106225] Updated weights for policy 1, policy_version 1440414 (0.0008) [2023-12-28 05:35:18,551][106225] Updated weights for policy 1, policy_version 1440424 (0.0008) [2023-12-28 05:35:18,591][106226] Updated weights for policy 0, policy_version 1437080 (0.0008) [2023-12-28 05:35:18,608][106225] Updated weights for policy 1, policy_version 1440434 (0.0007) [2023-12-28 05:35:18,646][106226] Updated weights for policy 0, policy_version 1437090 (0.0007) [2023-12-28 05:35:18,710][106226] Updated weights for policy 0, policy_version 1437100 (0.0009) [2023-12-28 05:35:19,206][106225] Updated weights for policy 1, policy_version 1440444 (0.0007) [2023-12-28 05:35:19,273][106225] Updated weights for policy 1, policy_version 1440454 (0.0008) [2023-12-28 05:35:19,336][106225] Updated weights for policy 1, policy_version 1440464 (0.0006) [2023-12-28 05:35:19,494][106226] Updated weights for policy 0, policy_version 1437110 (0.0008) [2023-12-28 05:35:19,552][106226] Updated weights for policy 0, policy_version 1437120 (0.0007) [2023-12-28 05:35:19,616][106226] Updated weights for policy 0, policy_version 1437130 (0.0009) [2023-12-28 05:35:20,069][106225] Updated weights for policy 1, policy_version 1440474 (0.0007) [2023-12-28 05:35:20,128][106225] Updated weights for policy 1, policy_version 1440484 (0.0008) [2023-12-28 05:35:20,187][106225] Updated weights for policy 1, policy_version 1440494 (0.0008) [2023-12-28 05:35:20,248][106225] Updated weights for policy 1, policy_version 1440504 (0.0008) [2023-12-28 05:35:20,365][106226] Updated weights for policy 0, policy_version 1437140 (0.0009) [2023-12-28 05:35:20,423][106226] Updated weights for policy 0, policy_version 1437150 (0.0008) [2023-12-28 05:35:20,430][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000004 [2023-12-28 05:35:21,014][106225] Updated weights for policy 1, policy_version 1440514 (0.0011) [2023-12-28 05:35:21,084][106225] Updated weights for policy 1, policy_version 1440524 (0.0011) [2023-12-28 05:35:21,153][106225] Updated weights for policy 1, policy_version 1440534 (0.0009) [2023-12-28 05:35:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 736813056. Throughput: 0: 9808.4, 1: 10186.1. Samples: 736821828. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:21,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.862')] [2023-12-28 05:35:21,268][106226] Updated weights for policy 0, policy_version 1437160 (0.0009) [2023-12-28 05:35:21,334][106226] Updated weights for policy 0, policy_version 1437170 (0.0008) [2023-12-28 05:35:21,397][106226] Updated weights for policy 0, policy_version 1437180 (0.0008) [2023-12-28 05:35:21,898][106225] Updated weights for policy 1, policy_version 1440544 (0.0009) [2023-12-28 05:35:21,963][106225] Updated weights for policy 1, policy_version 1440554 (0.0008) [2023-12-28 05:35:22,031][106225] Updated weights for policy 1, policy_version 1440564 (0.0009) [2023-12-28 05:35:22,138][106226] Updated weights for policy 0, policy_version 1437190 (0.0006) [2023-12-28 05:35:22,208][106226] Updated weights for policy 0, policy_version 1437200 (0.0008) [2023-12-28 05:35:22,278][106226] Updated weights for policy 0, policy_version 1437210 (0.0008) [2023-12-28 05:35:22,757][106225] Updated weights for policy 1, policy_version 1440574 (0.0007) [2023-12-28 05:35:22,815][106225] Updated weights for policy 1, policy_version 1440584 (0.0008) [2023-12-28 05:35:22,875][106225] Updated weights for policy 1, policy_version 1440594 (0.0008) [2023-12-28 05:35:22,994][106226] Updated weights for policy 0, policy_version 1437220 (0.0008) [2023-12-28 05:35:23,057][106226] Updated weights for policy 0, policy_version 1437230 (0.0008) [2023-12-28 05:35:23,115][106226] Updated weights for policy 0, policy_version 1437240 (0.0007) [2023-12-28 05:35:23,471][106225] Updated weights for policy 1, policy_version 1440604 (0.0009) [2023-12-28 05:35:23,535][106225] Updated weights for policy 1, policy_version 1440614 (0.0006) [2023-12-28 05:35:23,595][106225] Updated weights for policy 1, policy_version 1440624 (0.0008) [2023-12-28 05:35:23,839][106226] Updated weights for policy 0, policy_version 1437250 (0.0007) [2023-12-28 05:35:23,899][106226] Updated weights for policy 0, policy_version 1437260 (0.0005) [2023-12-28 05:35:23,955][106226] Updated weights for policy 0, policy_version 1437270 (0.0005) [2023-12-28 05:35:24,020][106226] Updated weights for policy 0, policy_version 1437280 (0.0006) [2023-12-28 05:35:24,277][106225] Updated weights for policy 1, policy_version 1440634 (0.0008) [2023-12-28 05:35:24,338][106225] Updated weights for policy 1, policy_version 1440644 (0.0006) [2023-12-28 05:35:24,403][106225] Updated weights for policy 1, policy_version 1440654 (0.0005) [2023-12-28 05:35:24,462][106225] Updated weights for policy 1, policy_version 1440664 (0.0006) [2023-12-28 05:35:24,669][106226] Updated weights for policy 0, policy_version 1437290 (0.0011) [2023-12-28 05:35:24,727][106226] Updated weights for policy 0, policy_version 1437300 (0.0010) [2023-12-28 05:35:24,790][106226] Updated weights for policy 0, policy_version 1437310 (0.0010) [2023-12-28 05:35:25,074][106225] Updated weights for policy 1, policy_version 1440674 (0.0007) [2023-12-28 05:35:25,131][106225] Updated weights for policy 1, policy_version 1440684 (0.0008) [2023-12-28 05:35:25,187][106225] Updated weights for policy 1, policy_version 1440694 (0.0007) [2023-12-28 05:35:25,426][106226] Updated weights for policy 0, policy_version 1437320 (0.0011) [2023-12-28 05:35:25,475][106226] Updated weights for policy 0, policy_version 1437330 (0.0010) [2023-12-28 05:35:25,525][106226] Updated weights for policy 0, policy_version 1437340 (0.0010) [2023-12-28 05:35:25,933][106225] Updated weights for policy 1, policy_version 1440704 (0.0007) [2023-12-28 05:35:25,986][106225] Updated weights for policy 1, policy_version 1440714 (0.0007) [2023-12-28 05:35:26,046][106225] Updated weights for policy 1, policy_version 1440724 (0.0008) [2023-12-28 05:35:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 736911360. Throughput: 0: 9812.3, 1: 10166.6. Samples: 736879596. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:26,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.816')] [2023-12-28 05:35:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001440728_368877568.pth... [2023-12-28 05:35:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001437344_368033792.pth... [2023-12-28 05:35:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001436240_367747072.pth [2023-12-28 05:35:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001439544_368574464.pth [2023-12-28 05:35:26,267][106226] Updated weights for policy 0, policy_version 1437350 (0.0011) [2023-12-28 05:35:26,325][106226] Updated weights for policy 0, policy_version 1437360 (0.0011) [2023-12-28 05:35:26,384][106226] Updated weights for policy 0, policy_version 1437370 (0.0010) [2023-12-28 05:35:26,769][106225] Updated weights for policy 1, policy_version 1440734 (0.0008) [2023-12-28 05:35:26,814][106225] Updated weights for policy 1, policy_version 1440744 (0.0007) [2023-12-28 05:35:26,863][106225] Updated weights for policy 1, policy_version 1440754 (0.0007) [2023-12-28 05:35:27,097][106226] Updated weights for policy 0, policy_version 1437380 (0.0011) [2023-12-28 05:35:27,147][106226] Updated weights for policy 0, policy_version 1437390 (0.0010) [2023-12-28 05:35:27,194][106226] Updated weights for policy 0, policy_version 1437400 (0.0010) [2023-12-28 05:35:27,609][106225] Updated weights for policy 1, policy_version 1440764 (0.0008) [2023-12-28 05:35:27,667][106225] Updated weights for policy 1, policy_version 1440774 (0.0007) [2023-12-28 05:35:27,728][106225] Updated weights for policy 1, policy_version 1440784 (0.0008) [2023-12-28 05:35:27,917][106226] Updated weights for policy 0, policy_version 1437410 (0.0009) [2023-12-28 05:35:27,980][106226] Updated weights for policy 0, policy_version 1437420 (0.0010) [2023-12-28 05:35:28,041][106226] Updated weights for policy 0, policy_version 1437430 (0.0011) [2023-12-28 05:35:28,095][106226] Updated weights for policy 0, policy_version 1437440 (0.0010) [2023-12-28 05:35:28,354][106225] Updated weights for policy 1, policy_version 1440794 (0.0008) [2023-12-28 05:35:28,417][106225] Updated weights for policy 1, policy_version 1440804 (0.0006) [2023-12-28 05:35:28,475][106225] Updated weights for policy 1, policy_version 1440814 (0.0009) [2023-12-28 05:35:28,545][106225] Updated weights for policy 1, policy_version 1440824 (0.0008) [2023-12-28 05:35:28,756][106226] Updated weights for policy 0, policy_version 1437450 (0.0010) [2023-12-28 05:35:28,819][106226] Updated weights for policy 0, policy_version 1437460 (0.0011) [2023-12-28 05:35:28,877][106226] Updated weights for policy 0, policy_version 1437470 (0.0011) [2023-12-28 05:35:29,277][106225] Updated weights for policy 1, policy_version 1440834 (0.0007) [2023-12-28 05:35:29,339][106225] Updated weights for policy 1, policy_version 1440844 (0.0008) [2023-12-28 05:35:29,404][106225] Updated weights for policy 1, policy_version 1440854 (0.0008) [2023-12-28 05:35:29,474][106226] Updated weights for policy 0, policy_version 1437480 (0.0011) [2023-12-28 05:35:29,530][106226] Updated weights for policy 0, policy_version 1437490 (0.0010) [2023-12-28 05:35:29,587][106226] Updated weights for policy 0, policy_version 1437500 (0.0007) [2023-12-28 05:35:30,174][106225] Updated weights for policy 1, policy_version 1440864 (0.0008) [2023-12-28 05:35:30,235][106225] Updated weights for policy 1, policy_version 1440874 (0.0009) [2023-12-28 05:35:30,269][106226] Updated weights for policy 0, policy_version 1437510 (0.0006) [2023-12-28 05:35:30,291][106225] Updated weights for policy 1, policy_version 1440884 (0.0008) [2023-12-28 05:35:30,314][106226] Updated weights for policy 0, policy_version 1437520 (0.0005) [2023-12-28 05:35:30,369][106226] Updated weights for policy 0, policy_version 1437530 (0.0006) [2023-12-28 05:35:30,938][106225] Updated weights for policy 1, policy_version 1440894 (0.0006) [2023-12-28 05:35:30,992][106225] Updated weights for policy 1, policy_version 1440904 (0.0005) [2023-12-28 05:35:31,019][106226] Updated weights for policy 0, policy_version 1437540 (0.0007) [2023-12-28 05:35:31,054][106225] Updated weights for policy 1, policy_version 1440914 (0.0007) [2023-12-28 05:35:31,080][106226] Updated weights for policy 0, policy_version 1437550 (0.0008) [2023-12-28 05:35:31,142][106226] Updated weights for policy 0, policy_version 1437560 (0.0006) [2023-12-28 05:35:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 737009664. Throughput: 0: 9853.2, 1: 10211.6. Samples: 736998920. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:31,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.570')] [2023-12-28 05:35:31,753][106225] Updated weights for policy 1, policy_version 1440924 (0.0007) [2023-12-28 05:35:31,811][106225] Updated weights for policy 1, policy_version 1440934 (0.0008) [2023-12-28 05:35:31,865][106225] Updated weights for policy 1, policy_version 1440944 (0.0008) [2023-12-28 05:35:31,875][106226] Updated weights for policy 0, policy_version 1437570 (0.0007) [2023-12-28 05:35:31,936][106226] Updated weights for policy 0, policy_version 1437580 (0.0007) [2023-12-28 05:35:31,992][106226] Updated weights for policy 0, policy_version 1437590 (0.0007) [2023-12-28 05:35:32,051][106226] Updated weights for policy 0, policy_version 1437600 (0.0008) [2023-12-28 05:35:32,531][106225] Updated weights for policy 1, policy_version 1440954 (0.0008) [2023-12-28 05:35:32,589][106225] Updated weights for policy 1, policy_version 1440964 (0.0008) [2023-12-28 05:35:32,651][106225] Updated weights for policy 1, policy_version 1440974 (0.0008) [2023-12-28 05:35:32,718][106225] Updated weights for policy 1, policy_version 1440984 (0.0009) [2023-12-28 05:35:32,829][106226] Updated weights for policy 0, policy_version 1437610 (0.0005) [2023-12-28 05:35:32,887][106226] Updated weights for policy 0, policy_version 1437620 (0.0008) [2023-12-28 05:35:32,951][106226] Updated weights for policy 0, policy_version 1437630 (0.0008) [2023-12-28 05:35:33,402][106225] Updated weights for policy 1, policy_version 1440994 (0.0008) [2023-12-28 05:35:33,450][106225] Updated weights for policy 1, policy_version 1441004 (0.0008) [2023-12-28 05:35:33,512][106225] Updated weights for policy 1, policy_version 1441014 (0.0008) [2023-12-28 05:35:33,644][106226] Updated weights for policy 0, policy_version 1437640 (0.0006) [2023-12-28 05:35:33,694][106226] Updated weights for policy 0, policy_version 1437650 (0.0008) [2023-12-28 05:35:33,743][106226] Updated weights for policy 0, policy_version 1437660 (0.0008) [2023-12-28 05:35:34,086][106225] Updated weights for policy 1, policy_version 1441024 (0.0008) [2023-12-28 05:35:34,141][106225] Updated weights for policy 1, policy_version 1441034 (0.0008) [2023-12-28 05:35:34,202][106225] Updated weights for policy 1, policy_version 1441044 (0.0008) [2023-12-28 05:35:34,473][106226] Updated weights for policy 0, policy_version 1437670 (0.0008) [2023-12-28 05:35:34,529][106226] Updated weights for policy 0, policy_version 1437680 (0.0006) [2023-12-28 05:35:34,589][106226] Updated weights for policy 0, policy_version 1437690 (0.0006) [2023-12-28 05:35:35,015][106225] Updated weights for policy 1, policy_version 1441054 (0.0008) [2023-12-28 05:35:35,075][106225] Updated weights for policy 1, policy_version 1441064 (0.0008) [2023-12-28 05:35:35,134][106225] Updated weights for policy 1, policy_version 1441074 (0.0008) [2023-12-28 05:35:35,136][106226] Updated weights for policy 0, policy_version 1437700 (0.0005) [2023-12-28 05:35:35,182][106226] Updated weights for policy 0, policy_version 1437710 (0.0005) [2023-12-28 05:35:35,227][106226] Updated weights for policy 0, policy_version 1437720 (0.0005) [2023-12-28 05:35:35,843][106226] Updated weights for policy 0, policy_version 1437730 (0.0007) [2023-12-28 05:35:35,894][106226] Updated weights for policy 0, policy_version 1437740 (0.0007) [2023-12-28 05:35:35,902][106225] Updated weights for policy 1, policy_version 1441084 (0.0008) [2023-12-28 05:35:35,947][106226] Updated weights for policy 0, policy_version 1437750 (0.0006) [2023-12-28 05:35:35,949][106225] Updated weights for policy 1, policy_version 1441094 (0.0006) [2023-12-28 05:35:35,994][106225] Updated weights for policy 1, policy_version 1441104 (0.0006) [2023-12-28 05:35:35,995][106226] Updated weights for policy 0, policy_version 1437760 (0.0006) [2023-12-28 05:35:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 737116160. Throughput: 0: 9926.8, 1: 10133.1. Samples: 737120508. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:36,175][105115] Avg episode reward: [(0, '-5.007'), (1, '-4.598')] [2023-12-28 05:35:36,624][106226] Updated weights for policy 0, policy_version 1437770 (0.0008) [2023-12-28 05:35:36,671][106226] Updated weights for policy 0, policy_version 1437780 (0.0008) [2023-12-28 05:35:36,728][106226] Updated weights for policy 0, policy_version 1437790 (0.0011) [2023-12-28 05:35:36,815][106225] Updated weights for policy 1, policy_version 1441114 (0.0009) [2023-12-28 05:35:36,881][106225] Updated weights for policy 1, policy_version 1441124 (0.0007) [2023-12-28 05:35:36,932][106225] Updated weights for policy 1, policy_version 1441134 (0.0005) [2023-12-28 05:35:36,997][106225] Updated weights for policy 1, policy_version 1441144 (0.0006) [2023-12-28 05:35:37,388][106226] Updated weights for policy 0, policy_version 1437800 (0.0007) [2023-12-28 05:35:37,456][106226] Updated weights for policy 0, policy_version 1437810 (0.0009) [2023-12-28 05:35:37,518][106226] Updated weights for policy 0, policy_version 1437820 (0.0009) [2023-12-28 05:35:37,703][106225] Updated weights for policy 1, policy_version 1441154 (0.0007) [2023-12-28 05:35:37,765][106225] Updated weights for policy 1, policy_version 1441164 (0.0006) [2023-12-28 05:35:37,824][106225] Updated weights for policy 1, policy_version 1441174 (0.0008) [2023-12-28 05:35:38,276][106226] Updated weights for policy 0, policy_version 1437830 (0.0007) [2023-12-28 05:35:38,359][106226] Updated weights for policy 0, policy_version 1437840 (0.0009) [2023-12-28 05:35:38,427][106226] Updated weights for policy 0, policy_version 1437850 (0.0006) [2023-12-28 05:35:38,454][106225] Updated weights for policy 1, policy_version 1441184 (0.0007) [2023-12-28 05:35:38,519][106225] Updated weights for policy 1, policy_version 1441194 (0.0008) [2023-12-28 05:35:38,583][106225] Updated weights for policy 1, policy_version 1441204 (0.0009) [2023-12-28 05:35:39,000][106226] Updated weights for policy 0, policy_version 1437860 (0.0008) [2023-12-28 05:35:39,055][106226] Updated weights for policy 0, policy_version 1437870 (0.0008) [2023-12-28 05:35:39,114][106226] Updated weights for policy 0, policy_version 1437880 (0.0006) [2023-12-28 05:35:39,240][106225] Updated weights for policy 1, policy_version 1441214 (0.0007) [2023-12-28 05:35:39,305][106225] Updated weights for policy 1, policy_version 1441224 (0.0008) [2023-12-28 05:35:39,374][106225] Updated weights for policy 1, policy_version 1441234 (0.0008) [2023-12-28 05:35:39,850][106226] Updated weights for policy 0, policy_version 1437890 (0.0005) [2023-12-28 05:35:39,917][106226] Updated weights for policy 0, policy_version 1437900 (0.0008) [2023-12-28 05:35:39,986][106226] Updated weights for policy 0, policy_version 1437910 (0.0011) [2023-12-28 05:35:40,050][106226] Updated weights for policy 0, policy_version 1437920 (0.0011) [2023-12-28 05:35:40,107][106225] Updated weights for policy 1, policy_version 1441244 (0.0009) [2023-12-28 05:35:40,169][106225] Updated weights for policy 1, policy_version 1441254 (0.0011) [2023-12-28 05:35:40,235][106225] Updated weights for policy 1, policy_version 1441264 (0.0010) [2023-12-28 05:35:40,760][106226] Updated weights for policy 0, policy_version 1437930 (0.0007) [2023-12-28 05:35:40,815][106226] Updated weights for policy 0, policy_version 1437940 (0.0010) [2023-12-28 05:35:40,865][106226] Updated weights for policy 0, policy_version 1437950 (0.0010) [2023-12-28 05:35:40,953][106225] Updated weights for policy 1, policy_version 1441274 (0.0010) [2023-12-28 05:35:41,011][106225] Updated weights for policy 1, policy_version 1441284 (0.0006) [2023-12-28 05:35:41,085][106225] Updated weights for policy 1, policy_version 1441294 (0.0008) [2023-12-28 05:35:41,157][106225] Updated weights for policy 1, policy_version 1441304 (0.0009) [2023-12-28 05:35:41,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 737214464. Throughput: 0: 9987.8, 1: 10084.8. Samples: 737180324. Policy #0 lag: (min: 21.0, avg: 31.7, max: 32.0) [2023-12-28 05:35:41,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.933')] [2023-12-28 05:35:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001441304_369025024.pth... [2023-12-28 05:35:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001437952_368189440.pth... [2023-12-28 05:35:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001440120_368721920.pth [2023-12-28 05:35:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001436816_367894528.pth [2023-12-28 05:35:41,553][106226] Updated weights for policy 0, policy_version 1437960 (0.0009) [2023-12-28 05:35:41,610][106226] Updated weights for policy 0, policy_version 1437970 (0.0008) [2023-12-28 05:35:41,681][106226] Updated weights for policy 0, policy_version 1437980 (0.0007) [2023-12-28 05:35:41,867][106225] Updated weights for policy 1, policy_version 1441314 (0.0008) [2023-12-28 05:35:41,921][106225] Updated weights for policy 1, policy_version 1441324 (0.0007) [2023-12-28 05:35:41,979][106225] Updated weights for policy 1, policy_version 1441334 (0.0009) [2023-12-28 05:35:42,462][106226] Updated weights for policy 0, policy_version 1437990 (0.0008) [2023-12-28 05:35:42,526][106226] Updated weights for policy 0, policy_version 1438000 (0.0007) [2023-12-28 05:35:42,597][106226] Updated weights for policy 0, policy_version 1438010 (0.0006) [2023-12-28 05:35:42,699][106225] Updated weights for policy 1, policy_version 1441344 (0.0006) [2023-12-28 05:35:42,747][106225] Updated weights for policy 1, policy_version 1441354 (0.0007) [2023-12-28 05:35:42,795][106225] Updated weights for policy 1, policy_version 1441364 (0.0008) [2023-12-28 05:35:43,279][106226] Updated weights for policy 0, policy_version 1438020 (0.0010) [2023-12-28 05:35:43,342][106226] Updated weights for policy 0, policy_version 1438030 (0.0010) [2023-12-28 05:35:43,404][106226] Updated weights for policy 0, policy_version 1438040 (0.0011) [2023-12-28 05:35:43,505][106225] Updated weights for policy 1, policy_version 1441374 (0.0008) [2023-12-28 05:35:43,554][106225] Updated weights for policy 1, policy_version 1441384 (0.0008) [2023-12-28 05:35:43,600][106225] Updated weights for policy 1, policy_version 1441394 (0.0010) [2023-12-28 05:35:44,064][106226] Updated weights for policy 0, policy_version 1438050 (0.0010) [2023-12-28 05:35:44,122][106226] Updated weights for policy 0, policy_version 1438060 (0.0007) [2023-12-28 05:35:44,177][106226] Updated weights for policy 0, policy_version 1438070 (0.0007) [2023-12-28 05:35:44,229][106225] Updated weights for policy 1, policy_version 1441404 (0.0008) [2023-12-28 05:35:44,233][106226] Updated weights for policy 0, policy_version 1438080 (0.0010) [2023-12-28 05:35:44,292][106225] Updated weights for policy 1, policy_version 1441414 (0.0010) [2023-12-28 05:35:44,354][106225] Updated weights for policy 1, policy_version 1441424 (0.0010) [2023-12-28 05:35:44,946][106226] Updated weights for policy 0, policy_version 1438090 (0.0009) [2023-12-28 05:35:45,013][106226] Updated weights for policy 0, policy_version 1438100 (0.0011) [2023-12-28 05:35:45,061][106225] Updated weights for policy 1, policy_version 1441434 (0.0010) [2023-12-28 05:35:45,075][106226] Updated weights for policy 0, policy_version 1438110 (0.0010) [2023-12-28 05:35:45,126][106225] Updated weights for policy 1, policy_version 1441444 (0.0010) [2023-12-28 05:35:45,191][106225] Updated weights for policy 1, policy_version 1441454 (0.0010) [2023-12-28 05:35:45,250][106225] Updated weights for policy 1, policy_version 1441464 (0.0005) [2023-12-28 05:35:45,765][106226] Updated weights for policy 0, policy_version 1438120 (0.0006) [2023-12-28 05:35:45,826][106226] Updated weights for policy 0, policy_version 1438130 (0.0009) [2023-12-28 05:35:45,870][106226] Updated weights for policy 0, policy_version 1438140 (0.0005) [2023-12-28 05:35:45,910][106225] Updated weights for policy 1, policy_version 1441474 (0.0010) [2023-12-28 05:35:45,969][106225] Updated weights for policy 1, policy_version 1441484 (0.0010) [2023-12-28 05:35:46,026][106225] Updated weights for policy 1, policy_version 1441494 (0.0010) [2023-12-28 05:35:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 737312768. Throughput: 0: 9912.8, 1: 10084.2. Samples: 737297960. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:35:46,176][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.733')] [2023-12-28 05:35:46,469][106226] Updated weights for policy 0, policy_version 1438150 (0.0005) [2023-12-28 05:35:46,517][106226] Updated weights for policy 0, policy_version 1438160 (0.0005) [2023-12-28 05:35:46,584][106226] Updated weights for policy 0, policy_version 1438170 (0.0005) [2023-12-28 05:35:46,690][106225] Updated weights for policy 1, policy_version 1441504 (0.0008) [2023-12-28 05:35:46,739][106225] Updated weights for policy 1, policy_version 1441514 (0.0005) [2023-12-28 05:35:46,802][106225] Updated weights for policy 1, policy_version 1441524 (0.0005) [2023-12-28 05:35:47,173][106226] Updated weights for policy 0, policy_version 1438180 (0.0009) [2023-12-28 05:35:47,230][106226] Updated weights for policy 0, policy_version 1438190 (0.0011) [2023-12-28 05:35:47,284][106226] Updated weights for policy 0, policy_version 1438200 (0.0007) [2023-12-28 05:35:47,403][106225] Updated weights for policy 1, policy_version 1441534 (0.0008) [2023-12-28 05:35:47,445][106225] Updated weights for policy 1, policy_version 1441544 (0.0010) [2023-12-28 05:35:47,504][106225] Updated weights for policy 1, policy_version 1441554 (0.0010) [2023-12-28 05:35:47,981][106226] Updated weights for policy 0, policy_version 1438210 (0.0008) [2023-12-28 05:35:48,038][106226] Updated weights for policy 0, policy_version 1438220 (0.0006) [2023-12-28 05:35:48,093][106226] Updated weights for policy 0, policy_version 1438230 (0.0008) [2023-12-28 05:35:48,154][106226] Updated weights for policy 0, policy_version 1438240 (0.0007) [2023-12-28 05:35:48,237][106225] Updated weights for policy 1, policy_version 1441564 (0.0010) [2023-12-28 05:35:48,300][106225] Updated weights for policy 1, policy_version 1441574 (0.0010) [2023-12-28 05:35:48,368][106225] Updated weights for policy 1, policy_version 1441584 (0.0009) [2023-12-28 05:35:48,855][106226] Updated weights for policy 0, policy_version 1438250 (0.0008) [2023-12-28 05:35:48,903][106226] Updated weights for policy 0, policy_version 1438260 (0.0009) [2023-12-28 05:35:48,964][106226] Updated weights for policy 0, policy_version 1438270 (0.0009) [2023-12-28 05:35:49,067][106225] Updated weights for policy 1, policy_version 1441594 (0.0009) [2023-12-28 05:35:49,126][106225] Updated weights for policy 1, policy_version 1441604 (0.0010) [2023-12-28 05:35:49,182][106225] Updated weights for policy 1, policy_version 1441614 (0.0008) [2023-12-28 05:35:49,249][106225] Updated weights for policy 1, policy_version 1441624 (0.0008) [2023-12-28 05:35:49,711][106226] Updated weights for policy 0, policy_version 1438280 (0.0006) [2023-12-28 05:35:49,775][106226] Updated weights for policy 0, policy_version 1438290 (0.0009) [2023-12-28 05:35:49,848][106226] Updated weights for policy 0, policy_version 1438300 (0.0009) [2023-12-28 05:35:49,895][106225] Updated weights for policy 1, policy_version 1441634 (0.0007) [2023-12-28 05:35:49,964][106225] Updated weights for policy 1, policy_version 1441644 (0.0006) [2023-12-28 05:35:50,025][106225] Updated weights for policy 1, policy_version 1441654 (0.0008) [2023-12-28 05:35:50,531][106226] Updated weights for policy 0, policy_version 1438310 (0.0010) [2023-12-28 05:35:50,600][106226] Updated weights for policy 0, policy_version 1438320 (0.0011) [2023-12-28 05:35:50,647][106226] Updated weights for policy 0, policy_version 1438330 (0.0010) [2023-12-28 05:35:50,761][106225] Updated weights for policy 1, policy_version 1441664 (0.0008) [2023-12-28 05:35:50,828][106225] Updated weights for policy 1, policy_version 1441674 (0.0008) [2023-12-28 05:35:50,881][106225] Updated weights for policy 1, policy_version 1441684 (0.0007) [2023-12-28 05:35:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 737411072. Throughput: 0: 9891.8, 1: 10012.0. Samples: 737419560. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:35:51,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-4.513')] [2023-12-28 05:35:51,414][106226] Updated weights for policy 0, policy_version 1438340 (0.0010) [2023-12-28 05:35:51,474][106226] Updated weights for policy 0, policy_version 1438350 (0.0008) [2023-12-28 05:35:51,538][106226] Updated weights for policy 0, policy_version 1438360 (0.0009) [2023-12-28 05:35:51,624][106225] Updated weights for policy 1, policy_version 1441694 (0.0008) [2023-12-28 05:35:51,685][106225] Updated weights for policy 1, policy_version 1441704 (0.0009) [2023-12-28 05:35:51,763][106225] Updated weights for policy 1, policy_version 1441714 (0.0007) [2023-12-28 05:35:52,310][106226] Updated weights for policy 0, policy_version 1438370 (0.0009) [2023-12-28 05:35:52,379][106226] Updated weights for policy 0, policy_version 1438380 (0.0008) [2023-12-28 05:35:52,447][106226] Updated weights for policy 0, policy_version 1438390 (0.0009) [2023-12-28 05:35:52,486][106225] Updated weights for policy 1, policy_version 1441724 (0.0008) [2023-12-28 05:35:52,508][106226] Updated weights for policy 0, policy_version 1438400 (0.0006) [2023-12-28 05:35:52,551][106225] Updated weights for policy 1, policy_version 1441734 (0.0008) [2023-12-28 05:35:52,610][106225] Updated weights for policy 1, policy_version 1441744 (0.0011) [2023-12-28 05:35:53,131][106226] Updated weights for policy 0, policy_version 1438410 (0.0008) [2023-12-28 05:35:53,191][106226] Updated weights for policy 0, policy_version 1438420 (0.0008) [2023-12-28 05:35:53,240][106226] Updated weights for policy 0, policy_version 1438430 (0.0010) [2023-12-28 05:35:53,302][106225] Updated weights for policy 1, policy_version 1441754 (0.0010) [2023-12-28 05:35:53,352][106225] Updated weights for policy 1, policy_version 1441764 (0.0010) [2023-12-28 05:35:53,409][106225] Updated weights for policy 1, policy_version 1441774 (0.0010) [2023-12-28 05:35:53,466][106225] Updated weights for policy 1, policy_version 1441784 (0.0010) [2023-12-28 05:35:53,990][106226] Updated weights for policy 0, policy_version 1438440 (0.0008) [2023-12-28 05:35:54,047][106226] Updated weights for policy 0, policy_version 1438450 (0.0009) [2023-12-28 05:35:54,109][106226] Updated weights for policy 0, policy_version 1438460 (0.0009) [2023-12-28 05:35:54,144][106225] Updated weights for policy 1, policy_version 1441794 (0.0007) [2023-12-28 05:35:54,200][106225] Updated weights for policy 1, policy_version 1441804 (0.0009) [2023-12-28 05:35:54,257][106225] Updated weights for policy 1, policy_version 1441814 (0.0007) [2023-12-28 05:35:54,876][106226] Updated weights for policy 0, policy_version 1438470 (0.0007) [2023-12-28 05:35:54,876][106225] Updated weights for policy 1, policy_version 1441824 (0.0007) [2023-12-28 05:35:54,920][106225] Updated weights for policy 1, policy_version 1441834 (0.0006) [2023-12-28 05:35:54,922][106226] Updated weights for policy 0, policy_version 1438480 (0.0007) [2023-12-28 05:35:54,974][106225] Updated weights for policy 1, policy_version 1441844 (0.0005) [2023-12-28 05:35:54,975][106226] Updated weights for policy 0, policy_version 1438490 (0.0008) [2023-12-28 05:35:55,668][106225] Updated weights for policy 1, policy_version 1441854 (0.0008) [2023-12-28 05:35:55,727][106225] Updated weights for policy 1, policy_version 1441864 (0.0009) [2023-12-28 05:35:55,736][106226] Updated weights for policy 0, policy_version 1438500 (0.0008) [2023-12-28 05:35:55,785][106225] Updated weights for policy 1, policy_version 1441874 (0.0006) [2023-12-28 05:35:55,788][106226] Updated weights for policy 0, policy_version 1438510 (0.0006) [2023-12-28 05:35:55,835][106226] Updated weights for policy 0, policy_version 1438520 (0.0006) [2023-12-28 05:35:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 737509376. Throughput: 0: 9834.6, 1: 9998.5. Samples: 737476920. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:35:56,175][105115] Avg episode reward: [(0, '-4.969'), (1, '-4.702')] [2023-12-28 05:35:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001438528_368336896.pth... [2023-12-28 05:35:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001441880_369172480.pth... [2023-12-28 05:35:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001440728_368877568.pth [2023-12-28 05:35:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001437344_368033792.pth [2023-12-28 05:35:56,341][106225] Updated weights for policy 1, policy_version 1441884 (0.0006) [2023-12-28 05:35:56,403][106225] Updated weights for policy 1, policy_version 1441894 (0.0008) [2023-12-28 05:35:56,466][106225] Updated weights for policy 1, policy_version 1441904 (0.0009) [2023-12-28 05:35:56,637][106226] Updated weights for policy 0, policy_version 1438530 (0.0008) [2023-12-28 05:35:56,691][106226] Updated weights for policy 0, policy_version 1438540 (0.0008) [2023-12-28 05:35:56,738][106226] Updated weights for policy 0, policy_version 1438550 (0.0008) [2023-12-28 05:35:56,795][106226] Updated weights for policy 0, policy_version 1438560 (0.0008) [2023-12-28 05:35:57,134][106225] Updated weights for policy 1, policy_version 1441914 (0.0006) [2023-12-28 05:35:57,183][106225] Updated weights for policy 1, policy_version 1441924 (0.0008) [2023-12-28 05:35:57,243][106225] Updated weights for policy 1, policy_version 1441934 (0.0007) [2023-12-28 05:35:57,300][106225] Updated weights for policy 1, policy_version 1441944 (0.0005) [2023-12-28 05:35:57,524][106226] Updated weights for policy 0, policy_version 1438570 (0.0006) [2023-12-28 05:35:57,578][106226] Updated weights for policy 0, policy_version 1438580 (0.0005) [2023-12-28 05:35:57,629][106226] Updated weights for policy 0, policy_version 1438590 (0.0005) [2023-12-28 05:35:58,037][106225] Updated weights for policy 1, policy_version 1441954 (0.0010) [2023-12-28 05:35:58,090][106225] Updated weights for policy 1, policy_version 1441964 (0.0008) [2023-12-28 05:35:58,132][106226] Updated weights for policy 0, policy_version 1438600 (0.0005) [2023-12-28 05:35:58,144][106225] Updated weights for policy 1, policy_version 1441974 (0.0007) [2023-12-28 05:35:58,180][106226] Updated weights for policy 0, policy_version 1438610 (0.0006) [2023-12-28 05:35:58,237][106226] Updated weights for policy 0, policy_version 1438620 (0.0009) [2023-12-28 05:35:59,124][106226] Updated weights for policy 0, policy_version 1438630 (0.0010) [2023-12-28 05:35:59,188][106225] Updated weights for policy 1, policy_version 1441984 (0.0009) [2023-12-28 05:35:59,193][106226] Updated weights for policy 0, policy_version 1438640 (0.0009) [2023-12-28 05:35:59,268][106226] Updated weights for policy 0, policy_version 1438650 (0.0010) [2023-12-28 05:35:59,269][106225] Updated weights for policy 1, policy_version 1441994 (0.0009) [2023-12-28 05:35:59,342][106225] Updated weights for policy 1, policy_version 1442004 (0.0009) [2023-12-28 05:36:00,133][106225] Updated weights for policy 1, policy_version 1442014 (0.0007) [2023-12-28 05:36:00,174][106226] Updated weights for policy 0, policy_version 1438660 (0.0008) [2023-12-28 05:36:00,195][106225] Updated weights for policy 1, policy_version 1442024 (0.0007) [2023-12-28 05:36:00,238][106226] Updated weights for policy 0, policy_version 1438670 (0.0007) [2023-12-28 05:36:00,263][106225] Updated weights for policy 1, policy_version 1442034 (0.0008) [2023-12-28 05:36:00,297][106226] Updated weights for policy 0, policy_version 1438680 (0.0006) [2023-12-28 05:36:00,955][106225] Updated weights for policy 1, policy_version 1442044 (0.0008) [2023-12-28 05:36:01,001][106225] Updated weights for policy 1, policy_version 1442054 (0.0008) [2023-12-28 05:36:01,008][106226] Updated weights for policy 0, policy_version 1438690 (0.0008) [2023-12-28 05:36:01,066][106225] Updated weights for policy 1, policy_version 1442064 (0.0008) [2023-12-28 05:36:01,078][106226] Updated weights for policy 0, policy_version 1438700 (0.0008) [2023-12-28 05:36:01,139][106226] Updated weights for policy 0, policy_version 1438710 (0.0009) [2023-12-28 05:36:01,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 737599488. Throughput: 0: 9846.2, 1: 9911.4. Samples: 737589744. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:01,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.973')] [2023-12-28 05:36:01,209][106226] Updated weights for policy 0, policy_version 1438720 (0.0008) [2023-12-28 05:36:01,793][106225] Updated weights for policy 1, policy_version 1442074 (0.0008) [2023-12-28 05:36:01,857][106225] Updated weights for policy 1, policy_version 1442084 (0.0008) [2023-12-28 05:36:01,913][106225] Updated weights for policy 1, policy_version 1442094 (0.0008) [2023-12-28 05:36:01,967][106225] Updated weights for policy 1, policy_version 1442104 (0.0009) [2023-12-28 05:36:02,006][106226] Updated weights for policy 0, policy_version 1438730 (0.0008) [2023-12-28 05:36:02,050][106226] Updated weights for policy 0, policy_version 1438740 (0.0008) [2023-12-28 05:36:02,099][106226] Updated weights for policy 0, policy_version 1438750 (0.0008) [2023-12-28 05:36:02,709][106225] Updated weights for policy 1, policy_version 1442114 (0.0008) [2023-12-28 05:36:02,767][106225] Updated weights for policy 1, policy_version 1442124 (0.0008) [2023-12-28 05:36:02,828][106225] Updated weights for policy 1, policy_version 1442134 (0.0006) [2023-12-28 05:36:02,830][106226] Updated weights for policy 0, policy_version 1438760 (0.0008) [2023-12-28 05:36:02,893][106226] Updated weights for policy 0, policy_version 1438770 (0.0009) [2023-12-28 05:36:02,948][106226] Updated weights for policy 0, policy_version 1438780 (0.0008) [2023-12-28 05:36:03,460][106225] Updated weights for policy 1, policy_version 1442144 (0.0007) [2023-12-28 05:36:03,517][106225] Updated weights for policy 1, policy_version 1442154 (0.0005) [2023-12-28 05:36:03,575][106225] Updated weights for policy 1, policy_version 1442164 (0.0005) [2023-12-28 05:36:03,743][106226] Updated weights for policy 0, policy_version 1438790 (0.0009) [2023-12-28 05:36:03,801][106226] Updated weights for policy 0, policy_version 1438800 (0.0009) [2023-12-28 05:36:03,866][106226] Updated weights for policy 0, policy_version 1438810 (0.0009) [2023-12-28 05:36:04,247][106225] Updated weights for policy 1, policy_version 1442174 (0.0007) [2023-12-28 05:36:04,316][106225] Updated weights for policy 1, policy_version 1442184 (0.0007) [2023-12-28 05:36:04,386][106225] Updated weights for policy 1, policy_version 1442194 (0.0006) [2023-12-28 05:36:04,668][106226] Updated weights for policy 0, policy_version 1438820 (0.0008) [2023-12-28 05:36:04,721][106226] Updated weights for policy 0, policy_version 1438830 (0.0009) [2023-12-28 05:36:04,771][106226] Updated weights for policy 0, policy_version 1438840 (0.0009) [2023-12-28 05:36:05,026][106225] Updated weights for policy 1, policy_version 1442204 (0.0008) [2023-12-28 05:36:05,071][106225] Updated weights for policy 1, policy_version 1442214 (0.0008) [2023-12-28 05:36:05,120][106225] Updated weights for policy 1, policy_version 1442224 (0.0006) [2023-12-28 05:36:05,536][106226] Updated weights for policy 0, policy_version 1438850 (0.0009) [2023-12-28 05:36:05,584][106226] Updated weights for policy 0, policy_version 1438860 (0.0008) [2023-12-28 05:36:05,639][106226] Updated weights for policy 0, policy_version 1438870 (0.0009) [2023-12-28 05:36:05,690][106226] Updated weights for policy 0, policy_version 1438880 (0.0008) [2023-12-28 05:36:05,811][106225] Updated weights for policy 1, policy_version 1442234 (0.0006) [2023-12-28 05:36:05,859][106225] Updated weights for policy 1, policy_version 1442244 (0.0009) [2023-12-28 05:36:05,907][106225] Updated weights for policy 1, policy_version 1442254 (0.0008) [2023-12-28 05:36:05,967][106225] Updated weights for policy 1, policy_version 1442264 (0.0008) [2023-12-28 05:36:06,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 737697792. Throughput: 0: 9787.7, 1: 9855.7. Samples: 737705784. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:06,176][105115] Avg episode reward: [(0, '-4.992'), (1, '-4.509')] [2023-12-28 05:36:06,473][106226] Updated weights for policy 0, policy_version 1438890 (0.0009) [2023-12-28 05:36:06,543][106226] Updated weights for policy 0, policy_version 1438900 (0.0010) [2023-12-28 05:36:06,609][106226] Updated weights for policy 0, policy_version 1438910 (0.0008) [2023-12-28 05:36:06,706][106225] Updated weights for policy 1, policy_version 1442274 (0.0008) [2023-12-28 05:36:06,767][106225] Updated weights for policy 1, policy_version 1442284 (0.0008) [2023-12-28 05:36:06,828][106225] Updated weights for policy 1, policy_version 1442294 (0.0010) [2023-12-28 05:36:07,353][106226] Updated weights for policy 0, policy_version 1438920 (0.0008) [2023-12-28 05:36:07,416][106226] Updated weights for policy 0, policy_version 1438930 (0.0008) [2023-12-28 05:36:07,474][106226] Updated weights for policy 0, policy_version 1438940 (0.0008) [2023-12-28 05:36:07,524][106225] Updated weights for policy 1, policy_version 1442304 (0.0010) [2023-12-28 05:36:07,588][106225] Updated weights for policy 1, policy_version 1442314 (0.0010) [2023-12-28 05:36:07,646][106225] Updated weights for policy 1, policy_version 1442324 (0.0010) [2023-12-28 05:36:08,226][106226] Updated weights for policy 0, policy_version 1438950 (0.0008) [2023-12-28 05:36:08,283][106226] Updated weights for policy 0, policy_version 1438960 (0.0008) [2023-12-28 05:36:08,345][106226] Updated weights for policy 0, policy_version 1438970 (0.0008) [2023-12-28 05:36:08,374][106225] Updated weights for policy 1, policy_version 1442334 (0.0009) [2023-12-28 05:36:08,430][106225] Updated weights for policy 1, policy_version 1442344 (0.0010) [2023-12-28 05:36:08,490][106225] Updated weights for policy 1, policy_version 1442354 (0.0010) [2023-12-28 05:36:09,014][106226] Updated weights for policy 0, policy_version 1438980 (0.0007) [2023-12-28 05:36:09,066][106226] Updated weights for policy 0, policy_version 1438990 (0.0008) [2023-12-28 05:36:09,119][106226] Updated weights for policy 0, policy_version 1439000 (0.0008) [2023-12-28 05:36:09,221][106225] Updated weights for policy 1, policy_version 1442364 (0.0010) [2023-12-28 05:36:09,291][106225] Updated weights for policy 1, policy_version 1442374 (0.0008) [2023-12-28 05:36:09,374][106225] Updated weights for policy 1, policy_version 1442384 (0.0008) [2023-12-28 05:36:09,980][106226] Updated weights for policy 0, policy_version 1439010 (0.0008) [2023-12-28 05:36:10,042][106226] Updated weights for policy 0, policy_version 1439020 (0.0009) [2023-12-28 05:36:10,099][106226] Updated weights for policy 0, policy_version 1439030 (0.0008) [2023-12-28 05:36:10,100][106225] Updated weights for policy 1, policy_version 1442394 (0.0008) [2023-12-28 05:36:10,148][106225] Updated weights for policy 1, policy_version 1442404 (0.0006) [2023-12-28 05:36:10,166][106226] Updated weights for policy 0, policy_version 1439040 (0.0009) [2023-12-28 05:36:10,210][106225] Updated weights for policy 1, policy_version 1442414 (0.0008) [2023-12-28 05:36:10,271][106225] Updated weights for policy 1, policy_version 1442424 (0.0008) [2023-12-28 05:36:10,925][106226] Updated weights for policy 0, policy_version 1439050 (0.0009) [2023-12-28 05:36:10,985][106225] Updated weights for policy 1, policy_version 1442434 (0.0006) [2023-12-28 05:36:10,988][106226] Updated weights for policy 0, policy_version 1439060 (0.0007) [2023-12-28 05:36:11,049][106225] Updated weights for policy 1, policy_version 1442444 (0.0008) [2023-12-28 05:36:11,063][106226] Updated weights for policy 0, policy_version 1439070 (0.0007) [2023-12-28 05:36:11,119][106225] Updated weights for policy 1, policy_version 1442454 (0.0007) [2023-12-28 05:36:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 737796096. Throughput: 0: 9780.8, 1: 9848.8. Samples: 737762928. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:11,175][105115] Avg episode reward: [(0, '-5.137'), (1, '-4.802')] [2023-12-28 05:36:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001442456_369319936.pth... [2023-12-28 05:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001439072_368476160.pth... [2023-12-28 05:36:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001441304_369025024.pth [2023-12-28 05:36:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001437952_368189440.pth [2023-12-28 05:36:11,859][106226] Updated weights for policy 0, policy_version 1439080 (0.0008) [2023-12-28 05:36:11,912][106226] Updated weights for policy 0, policy_version 1439090 (0.0006) [2023-12-28 05:36:11,918][106225] Updated weights for policy 1, policy_version 1442464 (0.0008) [2023-12-28 05:36:11,976][106226] Updated weights for policy 0, policy_version 1439100 (0.0008) [2023-12-28 05:36:11,978][106225] Updated weights for policy 1, policy_version 1442474 (0.0007) [2023-12-28 05:36:12,038][106225] Updated weights for policy 1, policy_version 1442484 (0.0006) [2023-12-28 05:36:12,659][106226] Updated weights for policy 0, policy_version 1439110 (0.0010) [2023-12-28 05:36:12,720][106226] Updated weights for policy 0, policy_version 1439120 (0.0008) [2023-12-28 05:36:12,792][106226] Updated weights for policy 0, policy_version 1439130 (0.0009) [2023-12-28 05:36:12,813][106225] Updated weights for policy 1, policy_version 1442494 (0.0008) [2023-12-28 05:36:12,869][106225] Updated weights for policy 1, policy_version 1442504 (0.0008) [2023-12-28 05:36:12,924][106225] Updated weights for policy 1, policy_version 1442514 (0.0008) [2023-12-28 05:36:13,487][106226] Updated weights for policy 0, policy_version 1439140 (0.0009) [2023-12-28 05:36:13,553][106226] Updated weights for policy 0, policy_version 1439150 (0.0009) [2023-12-28 05:36:13,609][106226] Updated weights for policy 0, policy_version 1439160 (0.0010) [2023-12-28 05:36:13,612][106225] Updated weights for policy 1, policy_version 1442524 (0.0007) [2023-12-28 05:36:13,668][106225] Updated weights for policy 1, policy_version 1442534 (0.0007) [2023-12-28 05:36:13,719][106225] Updated weights for policy 1, policy_version 1442544 (0.0005) [2023-12-28 05:36:14,245][106226] Updated weights for policy 0, policy_version 1439170 (0.0010) [2023-12-28 05:36:14,308][106226] Updated weights for policy 0, policy_version 1439180 (0.0007) [2023-12-28 05:36:14,366][106226] Updated weights for policy 0, policy_version 1439190 (0.0005) [2023-12-28 05:36:14,373][106225] Updated weights for policy 1, policy_version 1442554 (0.0007) [2023-12-28 05:36:14,426][106226] Updated weights for policy 0, policy_version 1439200 (0.0007) [2023-12-28 05:36:14,430][106225] Updated weights for policy 1, policy_version 1442564 (0.0010) [2023-12-28 05:36:14,480][106225] Updated weights for policy 1, policy_version 1442574 (0.0010) [2023-12-28 05:36:14,540][106225] Updated weights for policy 1, policy_version 1442584 (0.0010) [2023-12-28 05:36:15,075][106226] Updated weights for policy 0, policy_version 1439210 (0.0011) [2023-12-28 05:36:15,137][106226] Updated weights for policy 0, policy_version 1439220 (0.0011) [2023-12-28 05:36:15,199][106226] Updated weights for policy 0, policy_version 1439230 (0.0009) [2023-12-28 05:36:15,279][106225] Updated weights for policy 1, policy_version 1442594 (0.0008) [2023-12-28 05:36:15,342][106225] Updated weights for policy 1, policy_version 1442604 (0.0007) [2023-12-28 05:36:15,397][106225] Updated weights for policy 1, policy_version 1442614 (0.0009) [2023-12-28 05:36:15,970][106225] Updated weights for policy 1, policy_version 1442624 (0.0010) [2023-12-28 05:36:15,972][106226] Updated weights for policy 0, policy_version 1439240 (0.0007) [2023-12-28 05:36:16,026][106225] Updated weights for policy 1, policy_version 1442634 (0.0010) [2023-12-28 05:36:16,032][106226] Updated weights for policy 0, policy_version 1439250 (0.0005) [2023-12-28 05:36:16,081][106225] Updated weights for policy 1, policy_version 1442644 (0.0010) [2023-12-28 05:36:16,087][106226] Updated weights for policy 0, policy_version 1439260 (0.0008) [2023-12-28 05:36:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 737894400. Throughput: 0: 9707.2, 1: 9811.4. Samples: 737877260. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:16,176][105115] Avg episode reward: [(0, '-4.949'), (1, '-4.793')] [2023-12-28 05:36:16,772][106225] Updated weights for policy 1, policy_version 1442654 (0.0007) [2023-12-28 05:36:16,819][106226] Updated weights for policy 0, policy_version 1439270 (0.0008) [2023-12-28 05:36:16,842][106225] Updated weights for policy 1, policy_version 1442664 (0.0005) [2023-12-28 05:36:16,872][106226] Updated weights for policy 0, policy_version 1439280 (0.0009) [2023-12-28 05:36:16,908][106225] Updated weights for policy 1, policy_version 1442674 (0.0006) [2023-12-28 05:36:16,924][106226] Updated weights for policy 0, policy_version 1439290 (0.0008) [2023-12-28 05:36:17,500][106225] Updated weights for policy 1, policy_version 1442684 (0.0008) [2023-12-28 05:36:17,546][106225] Updated weights for policy 1, policy_version 1442694 (0.0005) [2023-12-28 05:36:17,600][106225] Updated weights for policy 1, policy_version 1442704 (0.0005) [2023-12-28 05:36:17,618][106226] Updated weights for policy 0, policy_version 1439300 (0.0008) [2023-12-28 05:36:17,678][106226] Updated weights for policy 0, policy_version 1439310 (0.0009) [2023-12-28 05:36:17,728][106226] Updated weights for policy 0, policy_version 1439320 (0.0009) [2023-12-28 05:36:18,212][106225] Updated weights for policy 1, policy_version 1442714 (0.0005) [2023-12-28 05:36:18,265][106225] Updated weights for policy 1, policy_version 1442724 (0.0005) [2023-12-28 05:36:18,322][106225] Updated weights for policy 1, policy_version 1442734 (0.0009) [2023-12-28 05:36:18,393][106225] Updated weights for policy 1, policy_version 1442744 (0.0011) [2023-12-28 05:36:18,531][106226] Updated weights for policy 0, policy_version 1439330 (0.0007) [2023-12-28 05:36:18,597][106226] Updated weights for policy 0, policy_version 1439340 (0.0009) [2023-12-28 05:36:18,664][106226] Updated weights for policy 0, policy_version 1439350 (0.0009) [2023-12-28 05:36:18,734][106226] Updated weights for policy 0, policy_version 1439360 (0.0009) [2023-12-28 05:36:19,066][106225] Updated weights for policy 1, policy_version 1442754 (0.0010) [2023-12-28 05:36:19,122][106225] Updated weights for policy 1, policy_version 1442764 (0.0010) [2023-12-28 05:36:19,178][106225] Updated weights for policy 1, policy_version 1442774 (0.0010) [2023-12-28 05:36:19,468][106226] Updated weights for policy 0, policy_version 1439370 (0.0008) [2023-12-28 05:36:19,537][106226] Updated weights for policy 0, policy_version 1439380 (0.0009) [2023-12-28 05:36:19,594][106226] Updated weights for policy 0, policy_version 1439390 (0.0008) [2023-12-28 05:36:20,006][106225] Updated weights for policy 1, policy_version 1442784 (0.0010) [2023-12-28 05:36:20,068][106225] Updated weights for policy 1, policy_version 1442794 (0.0010) [2023-12-28 05:36:20,123][106225] Updated weights for policy 1, policy_version 1442804 (0.0010) [2023-12-28 05:36:20,394][106226] Updated weights for policy 0, policy_version 1439400 (0.0008) [2023-12-28 05:36:20,462][106226] Updated weights for policy 0, policy_version 1439410 (0.0008) [2023-12-28 05:36:20,517][106226] Updated weights for policy 0, policy_version 1439420 (0.0008) [2023-12-28 05:36:20,864][106225] Updated weights for policy 1, policy_version 1442814 (0.0007) [2023-12-28 05:36:20,916][106225] Updated weights for policy 1, policy_version 1442824 (0.0010) [2023-12-28 05:36:20,977][106225] Updated weights for policy 1, policy_version 1442834 (0.0010) [2023-12-28 05:36:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 737984512. Throughput: 0: 9559.0, 1: 9845.5. Samples: 737993708. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:21,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.689')] [2023-12-28 05:36:21,258][106226] Updated weights for policy 0, policy_version 1439430 (0.0008) [2023-12-28 05:36:21,325][106226] Updated weights for policy 0, policy_version 1439440 (0.0011) [2023-12-28 05:36:21,391][106226] Updated weights for policy 0, policy_version 1439450 (0.0010) [2023-12-28 05:36:21,782][106225] Updated weights for policy 1, policy_version 1442844 (0.0009) [2023-12-28 05:36:21,840][106225] Updated weights for policy 1, policy_version 1442854 (0.0006) [2023-12-28 05:36:21,903][106225] Updated weights for policy 1, policy_version 1442864 (0.0008) [2023-12-28 05:36:22,070][106226] Updated weights for policy 0, policy_version 1439460 (0.0006) [2023-12-28 05:36:22,132][106226] Updated weights for policy 0, policy_version 1439470 (0.0006) [2023-12-28 05:36:22,193][106226] Updated weights for policy 0, policy_version 1439480 (0.0008) [2023-12-28 05:36:22,675][106225] Updated weights for policy 1, policy_version 1442874 (0.0010) [2023-12-28 05:36:22,739][106225] Updated weights for policy 1, policy_version 1442884 (0.0009) [2023-12-28 05:36:22,806][106225] Updated weights for policy 1, policy_version 1442894 (0.0005) [2023-12-28 05:36:22,865][106225] Updated weights for policy 1, policy_version 1442904 (0.0005) [2023-12-28 05:36:22,928][106226] Updated weights for policy 0, policy_version 1439490 (0.0011) [2023-12-28 05:36:22,986][106226] Updated weights for policy 0, policy_version 1439500 (0.0006) [2023-12-28 05:36:23,044][106226] Updated weights for policy 0, policy_version 1439510 (0.0006) [2023-12-28 05:36:23,096][106226] Updated weights for policy 0, policy_version 1439520 (0.0005) [2023-12-28 05:36:23,483][106225] Updated weights for policy 1, policy_version 1442914 (0.0007) [2023-12-28 05:36:23,529][106225] Updated weights for policy 1, policy_version 1442924 (0.0010) [2023-12-28 05:36:23,591][106225] Updated weights for policy 1, policy_version 1442934 (0.0010) [2023-12-28 05:36:23,751][106226] Updated weights for policy 0, policy_version 1439530 (0.0010) [2023-12-28 05:36:23,813][106226] Updated weights for policy 0, policy_version 1439540 (0.0010) [2023-12-28 05:36:23,875][106226] Updated weights for policy 0, policy_version 1439550 (0.0010) [2023-12-28 05:36:24,291][106225] Updated weights for policy 1, policy_version 1442944 (0.0010) [2023-12-28 05:36:24,348][106225] Updated weights for policy 1, policy_version 1442954 (0.0007) [2023-12-28 05:36:24,404][106225] Updated weights for policy 1, policy_version 1442964 (0.0010) [2023-12-28 05:36:24,560][106226] Updated weights for policy 0, policy_version 1439560 (0.0010) [2023-12-28 05:36:24,609][106226] Updated weights for policy 0, policy_version 1439570 (0.0010) [2023-12-28 05:36:24,663][106226] Updated weights for policy 0, policy_version 1439580 (0.0010) [2023-12-28 05:36:25,086][106225] Updated weights for policy 1, policy_version 1442974 (0.0010) [2023-12-28 05:36:25,136][106225] Updated weights for policy 1, policy_version 1442984 (0.0010) [2023-12-28 05:36:25,193][106225] Updated weights for policy 1, policy_version 1442994 (0.0010) [2023-12-28 05:36:25,392][106226] Updated weights for policy 0, policy_version 1439590 (0.0011) [2023-12-28 05:36:25,452][106226] Updated weights for policy 0, policy_version 1439600 (0.0010) [2023-12-28 05:36:25,513][106226] Updated weights for policy 0, policy_version 1439610 (0.0010) [2023-12-28 05:36:25,955][106225] Updated weights for policy 1, policy_version 1443004 (0.0009) [2023-12-28 05:36:26,012][106225] Updated weights for policy 1, policy_version 1443014 (0.0005) [2023-12-28 05:36:26,067][106226] Updated weights for policy 0, policy_version 1439620 (0.0009) [2023-12-28 05:36:26,070][106225] Updated weights for policy 1, policy_version 1443024 (0.0005) [2023-12-28 05:36:26,129][106226] Updated weights for policy 0, policy_version 1439630 (0.0005) [2023-12-28 05:36:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 738082816. Throughput: 0: 9515.6, 1: 9851.2. Samples: 738051836. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:26,176][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.715')] [2023-12-28 05:36:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001443032_369467392.pth... [2023-12-28 05:36:26,185][106226] Updated weights for policy 0, policy_version 1439640 (0.0005) [2023-12-28 05:36:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001441880_369172480.pth [2023-12-28 05:36:26,222][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001439648_368623616.pth... [2023-12-28 05:36:26,225][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001438528_368336896.pth [2023-12-28 05:36:26,747][106226] Updated weights for policy 0, policy_version 1439650 (0.0008) [2023-12-28 05:36:26,802][106226] Updated weights for policy 0, policy_version 1439660 (0.0005) [2023-12-28 05:36:26,826][106225] Updated weights for policy 1, policy_version 1443034 (0.0009) [2023-12-28 05:36:26,858][106226] Updated weights for policy 0, policy_version 1439670 (0.0005) [2023-12-28 05:36:26,870][106225] Updated weights for policy 1, policy_version 1443044 (0.0008) [2023-12-28 05:36:26,914][106226] Updated weights for policy 0, policy_version 1439680 (0.0005) [2023-12-28 05:36:26,924][106225] Updated weights for policy 1, policy_version 1443054 (0.0008) [2023-12-28 05:36:26,978][106225] Updated weights for policy 1, policy_version 1443064 (0.0009) [2023-12-28 05:36:27,414][106226] Updated weights for policy 0, policy_version 1439690 (0.0006) [2023-12-28 05:36:27,464][106226] Updated weights for policy 0, policy_version 1439700 (0.0005) [2023-12-28 05:36:27,521][106226] Updated weights for policy 0, policy_version 1439710 (0.0005) [2023-12-28 05:36:27,826][106225] Updated weights for policy 1, policy_version 1443074 (0.0008) [2023-12-28 05:36:27,876][106225] Updated weights for policy 1, policy_version 1443084 (0.0009) [2023-12-28 05:36:27,931][106225] Updated weights for policy 1, policy_version 1443094 (0.0007) [2023-12-28 05:36:28,025][106226] Updated weights for policy 0, policy_version 1439720 (0.0009) [2023-12-28 05:36:28,072][106226] Updated weights for policy 0, policy_version 1439730 (0.0007) [2023-12-28 05:36:28,142][106226] Updated weights for policy 0, policy_version 1439740 (0.0008) [2023-12-28 05:36:28,646][106225] Updated weights for policy 1, policy_version 1443104 (0.0006) [2023-12-28 05:36:28,702][106225] Updated weights for policy 1, policy_version 1443114 (0.0008) [2023-12-28 05:36:28,751][106225] Updated weights for policy 1, policy_version 1443124 (0.0010) [2023-12-28 05:36:28,855][106226] Updated weights for policy 0, policy_version 1439750 (0.0010) [2023-12-28 05:36:28,911][106226] Updated weights for policy 0, policy_version 1439760 (0.0010) [2023-12-28 05:36:28,960][106226] Updated weights for policy 0, policy_version 1439770 (0.0010) [2023-12-28 05:36:29,365][106225] Updated weights for policy 1, policy_version 1443134 (0.0006) [2023-12-28 05:36:29,435][106225] Updated weights for policy 1, policy_version 1443144 (0.0007) [2023-12-28 05:36:29,499][106225] Updated weights for policy 1, policy_version 1443154 (0.0006) [2023-12-28 05:36:29,748][106226] Updated weights for policy 0, policy_version 1439780 (0.0010) [2023-12-28 05:36:29,809][106226] Updated weights for policy 0, policy_version 1439790 (0.0011) [2023-12-28 05:36:29,882][106226] Updated weights for policy 0, policy_version 1439800 (0.0010) [2023-12-28 05:36:30,196][106225] Updated weights for policy 1, policy_version 1443164 (0.0006) [2023-12-28 05:36:30,250][106225] Updated weights for policy 1, policy_version 1443174 (0.0008) [2023-12-28 05:36:30,308][106225] Updated weights for policy 1, policy_version 1443184 (0.0007) [2023-12-28 05:36:30,589][106226] Updated weights for policy 0, policy_version 1439810 (0.0010) [2023-12-28 05:36:30,657][106226] Updated weights for policy 0, policy_version 1439820 (0.0005) [2023-12-28 05:36:30,719][106226] Updated weights for policy 0, policy_version 1439830 (0.0005) [2023-12-28 05:36:30,774][106226] Updated weights for policy 0, policy_version 1439840 (0.0010) [2023-12-28 05:36:31,008][106225] Updated weights for policy 1, policy_version 1443194 (0.0007) [2023-12-28 05:36:31,073][106225] Updated weights for policy 1, policy_version 1443204 (0.0007) [2023-12-28 05:36:31,146][106225] Updated weights for policy 1, policy_version 1443214 (0.0008) [2023-12-28 05:36:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 738181120. Throughput: 0: 9676.9, 1: 9820.5. Samples: 738175340. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:31,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-4.706')] [2023-12-28 05:36:31,212][106225] Updated weights for policy 1, policy_version 1443224 (0.0009) [2023-12-28 05:36:31,444][106226] Updated weights for policy 0, policy_version 1439850 (0.0007) [2023-12-28 05:36:31,505][106226] Updated weights for policy 0, policy_version 1439860 (0.0008) [2023-12-28 05:36:31,561][106226] Updated weights for policy 0, policy_version 1439870 (0.0008) [2023-12-28 05:36:31,929][106225] Updated weights for policy 1, policy_version 1443234 (0.0008) [2023-12-28 05:36:31,983][106225] Updated weights for policy 1, policy_version 1443244 (0.0009) [2023-12-28 05:36:32,036][106225] Updated weights for policy 1, policy_version 1443254 (0.0008) [2023-12-28 05:36:32,260][106226] Updated weights for policy 0, policy_version 1439880 (0.0008) [2023-12-28 05:36:32,319][106226] Updated weights for policy 0, policy_version 1439890 (0.0008) [2023-12-28 05:36:32,387][106226] Updated weights for policy 0, policy_version 1439900 (0.0008) [2023-12-28 05:36:32,803][106225] Updated weights for policy 1, policy_version 1443264 (0.0008) [2023-12-28 05:36:32,848][106225] Updated weights for policy 1, policy_version 1443274 (0.0009) [2023-12-28 05:36:32,893][106225] Updated weights for policy 1, policy_version 1443284 (0.0008) [2023-12-28 05:36:32,993][106226] Updated weights for policy 0, policy_version 1439910 (0.0008) [2023-12-28 05:36:33,057][106226] Updated weights for policy 0, policy_version 1439920 (0.0009) [2023-12-28 05:36:33,106][106226] Updated weights for policy 0, policy_version 1439930 (0.0009) [2023-12-28 05:36:33,487][106225] Updated weights for policy 1, policy_version 1443294 (0.0007) [2023-12-28 05:36:33,537][106225] Updated weights for policy 1, policy_version 1443304 (0.0006) [2023-12-28 05:36:33,586][106225] Updated weights for policy 1, policy_version 1443314 (0.0008) [2023-12-28 05:36:33,750][106226] Updated weights for policy 0, policy_version 1439940 (0.0006) [2023-12-28 05:36:33,807][106226] Updated weights for policy 0, policy_version 1439950 (0.0007) [2023-12-28 05:36:33,868][106226] Updated weights for policy 0, policy_version 1439960 (0.0008) [2023-12-28 05:36:34,375][106225] Updated weights for policy 1, policy_version 1443324 (0.0009) [2023-12-28 05:36:34,434][106225] Updated weights for policy 1, policy_version 1443334 (0.0008) [2023-12-28 05:36:34,497][106225] Updated weights for policy 1, policy_version 1443344 (0.0005) [2023-12-28 05:36:34,588][106226] Updated weights for policy 0, policy_version 1439970 (0.0008) [2023-12-28 05:36:34,646][106226] Updated weights for policy 0, policy_version 1439980 (0.0009) [2023-12-28 05:36:34,692][106226] Updated weights for policy 0, policy_version 1439990 (0.0009) [2023-12-28 05:36:34,746][106226] Updated weights for policy 0, policy_version 1440000 (0.0009) [2023-12-28 05:36:35,160][106225] Updated weights for policy 1, policy_version 1443354 (0.0006) [2023-12-28 05:36:35,214][106225] Updated weights for policy 1, policy_version 1443364 (0.0005) [2023-12-28 05:36:35,273][106225] Updated weights for policy 1, policy_version 1443374 (0.0006) [2023-12-28 05:36:35,331][106225] Updated weights for policy 1, policy_version 1443384 (0.0005) [2023-12-28 05:36:35,455][106226] Updated weights for policy 0, policy_version 1440010 (0.0007) [2023-12-28 05:36:35,504][106226] Updated weights for policy 0, policy_version 1440020 (0.0008) [2023-12-28 05:36:35,557][106226] Updated weights for policy 0, policy_version 1440030 (0.0008) [2023-12-28 05:36:35,979][106225] Updated weights for policy 1, policy_version 1443394 (0.0006) [2023-12-28 05:36:36,053][106225] Updated weights for policy 1, policy_version 1443404 (0.0008) [2023-12-28 05:36:36,123][106225] Updated weights for policy 1, policy_version 1443414 (0.0011) [2023-12-28 05:36:36,139][106226] Updated weights for policy 0, policy_version 1440040 (0.0007) [2023-12-28 05:36:36,175][105115] Fps is (10 sec: 20480.6, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 738287616. Throughput: 0: 9708.9, 1: 9801.1. Samples: 738297508. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:36,178][105115] Avg episode reward: [(0, '-4.787'), (1, '-4.736')] [2023-12-28 05:36:36,204][106226] Updated weights for policy 0, policy_version 1440050 (0.0008) [2023-12-28 05:36:36,272][106226] Updated weights for policy 0, policy_version 1440060 (0.0009) [2023-12-28 05:36:36,838][106225] Updated weights for policy 1, policy_version 1443424 (0.0009) [2023-12-28 05:36:36,901][106225] Updated weights for policy 1, policy_version 1443434 (0.0006) [2023-12-28 05:36:36,944][106226] Updated weights for policy 0, policy_version 1440070 (0.0007) [2023-12-28 05:36:36,996][106225] Updated weights for policy 1, policy_version 1443444 (0.0006) [2023-12-28 05:36:36,997][106226] Updated weights for policy 0, policy_version 1440080 (0.0005) [2023-12-28 05:36:37,054][106226] Updated weights for policy 0, policy_version 1440090 (0.0005) [2023-12-28 05:36:37,643][106225] Updated weights for policy 1, policy_version 1443454 (0.0010) [2023-12-28 05:36:37,705][106225] Updated weights for policy 1, policy_version 1443464 (0.0011) [2023-12-28 05:36:37,715][106226] Updated weights for policy 0, policy_version 1440100 (0.0006) [2023-12-28 05:36:37,764][106225] Updated weights for policy 1, policy_version 1443474 (0.0011) [2023-12-28 05:36:37,779][106226] Updated weights for policy 0, policy_version 1440110 (0.0006) [2023-12-28 05:36:37,837][106226] Updated weights for policy 0, policy_version 1440120 (0.0009) [2023-12-28 05:36:38,484][106225] Updated weights for policy 1, policy_version 1443484 (0.0007) [2023-12-28 05:36:38,542][106225] Updated weights for policy 1, policy_version 1443494 (0.0008) [2023-12-28 05:36:38,562][106226] Updated weights for policy 0, policy_version 1440130 (0.0007) [2023-12-28 05:36:38,605][106225] Updated weights for policy 1, policy_version 1443504 (0.0010) [2023-12-28 05:36:38,620][106226] Updated weights for policy 0, policy_version 1440140 (0.0008) [2023-12-28 05:36:38,682][106226] Updated weights for policy 0, policy_version 1440150 (0.0007) [2023-12-28 05:36:38,734][106226] Updated weights for policy 0, policy_version 1440160 (0.0008) [2023-12-28 05:36:39,332][106225] Updated weights for policy 1, policy_version 1443514 (0.0011) [2023-12-28 05:36:39,407][106225] Updated weights for policy 1, policy_version 1443524 (0.0011) [2023-12-28 05:36:39,463][106226] Updated weights for policy 0, policy_version 1440170 (0.0006) [2023-12-28 05:36:39,468][106225] Updated weights for policy 1, policy_version 1443534 (0.0011) [2023-12-28 05:36:39,521][106226] Updated weights for policy 0, policy_version 1440180 (0.0006) [2023-12-28 05:36:39,531][106225] Updated weights for policy 1, policy_version 1443544 (0.0010) [2023-12-28 05:36:39,586][106226] Updated weights for policy 0, policy_version 1440190 (0.0007) [2023-12-28 05:36:40,236][106226] Updated weights for policy 0, policy_version 1440200 (0.0008) [2023-12-28 05:36:40,287][106225] Updated weights for policy 1, policy_version 1443554 (0.0007) [2023-12-28 05:36:40,307][106226] Updated weights for policy 0, policy_version 1440210 (0.0006) [2023-12-28 05:36:40,347][106225] Updated weights for policy 1, policy_version 1443564 (0.0008) [2023-12-28 05:36:40,362][106226] Updated weights for policy 0, policy_version 1440220 (0.0008) [2023-12-28 05:36:40,411][106225] Updated weights for policy 1, policy_version 1443574 (0.0009) [2023-12-28 05:36:41,072][106226] Updated weights for policy 0, policy_version 1440230 (0.0008) [2023-12-28 05:36:41,105][106225] Updated weights for policy 1, policy_version 1443584 (0.0008) [2023-12-28 05:36:41,125][106226] Updated weights for policy 0, policy_version 1440240 (0.0006) [2023-12-28 05:36:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19799.6). Total num frames: 738377728. Throughput: 0: 9732.0, 1: 9790.9. Samples: 738355452. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:41,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-5.097')] [2023-12-28 05:36:41,176][106225] Updated weights for policy 1, policy_version 1443594 (0.0009) [2023-12-28 05:36:41,194][106226] Updated weights for policy 0, policy_version 1440250 (0.0007) [2023-12-28 05:36:41,233][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001440256_368779264.pth... [2023-12-28 05:36:41,236][106225] Updated weights for policy 1, policy_version 1443604 (0.0010) [2023-12-28 05:36:41,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001439072_368476160.pth [2023-12-28 05:36:41,263][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001443608_369614848.pth... [2023-12-28 05:36:41,268][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001442456_369319936.pth [2023-12-28 05:36:41,941][106226] Updated weights for policy 0, policy_version 1440260 (0.0008) [2023-12-28 05:36:42,006][106226] Updated weights for policy 0, policy_version 1440270 (0.0009) [2023-12-28 05:36:42,009][106225] Updated weights for policy 1, policy_version 1443614 (0.0009) [2023-12-28 05:36:42,072][106226] Updated weights for policy 0, policy_version 1440280 (0.0006) [2023-12-28 05:36:42,073][106225] Updated weights for policy 1, policy_version 1443624 (0.0008) [2023-12-28 05:36:42,133][106225] Updated weights for policy 1, policy_version 1443634 (0.0007) [2023-12-28 05:36:42,801][106225] Updated weights for policy 1, policy_version 1443644 (0.0007) [2023-12-28 05:36:42,869][106225] Updated weights for policy 1, policy_version 1443654 (0.0005) [2023-12-28 05:36:42,872][106226] Updated weights for policy 0, policy_version 1440290 (0.0007) [2023-12-28 05:36:42,927][106226] Updated weights for policy 0, policy_version 1440300 (0.0010) [2023-12-28 05:36:42,935][106225] Updated weights for policy 1, policy_version 1443664 (0.0009) [2023-12-28 05:36:42,974][106226] Updated weights for policy 0, policy_version 1440310 (0.0010) [2023-12-28 05:36:43,024][106226] Updated weights for policy 0, policy_version 1440320 (0.0010) [2023-12-28 05:36:43,562][106225] Updated weights for policy 1, policy_version 1443674 (0.0010) [2023-12-28 05:36:43,628][106225] Updated weights for policy 1, policy_version 1443684 (0.0010) [2023-12-28 05:36:43,695][106225] Updated weights for policy 1, policy_version 1443694 (0.0010) [2023-12-28 05:36:43,702][106226] Updated weights for policy 0, policy_version 1440330 (0.0007) [2023-12-28 05:36:43,755][106225] Updated weights for policy 1, policy_version 1443704 (0.0010) [2023-12-28 05:36:43,756][106226] Updated weights for policy 0, policy_version 1440340 (0.0007) [2023-12-28 05:36:43,818][106226] Updated weights for policy 0, policy_version 1440350 (0.0005) [2023-12-28 05:36:44,464][106226] Updated weights for policy 0, policy_version 1440360 (0.0006) [2023-12-28 05:36:44,464][106225] Updated weights for policy 1, policy_version 1443714 (0.0010) [2023-12-28 05:36:44,521][106225] Updated weights for policy 1, policy_version 1443724 (0.0010) [2023-12-28 05:36:44,521][106226] Updated weights for policy 0, policy_version 1440370 (0.0007) [2023-12-28 05:36:44,578][106225] Updated weights for policy 1, policy_version 1443734 (0.0009) [2023-12-28 05:36:44,580][106226] Updated weights for policy 0, policy_version 1440380 (0.0005) [2023-12-28 05:36:45,247][106226] Updated weights for policy 0, policy_version 1440390 (0.0007) [2023-12-28 05:36:45,308][106226] Updated weights for policy 0, policy_version 1440400 (0.0008) [2023-12-28 05:36:45,318][106225] Updated weights for policy 1, policy_version 1443744 (0.0010) [2023-12-28 05:36:45,366][106226] Updated weights for policy 0, policy_version 1440410 (0.0006) [2023-12-28 05:36:45,375][106225] Updated weights for policy 1, policy_version 1443754 (0.0010) [2023-12-28 05:36:45,428][106225] Updated weights for policy 1, policy_version 1443764 (0.0010) [2023-12-28 05:36:46,088][106225] Updated weights for policy 1, policy_version 1443774 (0.0010) [2023-12-28 05:36:46,124][106226] Updated weights for policy 0, policy_version 1440420 (0.0007) [2023-12-28 05:36:46,146][106225] Updated weights for policy 1, policy_version 1443784 (0.0010) [2023-12-28 05:36:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19799.7). Total num frames: 738476032. Throughput: 0: 9818.2, 1: 9798.2. Samples: 738472484. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:46,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.583')] [2023-12-28 05:36:46,188][106226] Updated weights for policy 0, policy_version 1440430 (0.0010) [2023-12-28 05:36:46,203][106225] Updated weights for policy 1, policy_version 1443794 (0.0010) [2023-12-28 05:36:46,247][106226] Updated weights for policy 0, policy_version 1440440 (0.0011) [2023-12-28 05:36:46,835][106226] Updated weights for policy 0, policy_version 1440450 (0.0006) [2023-12-28 05:36:46,853][106225] Updated weights for policy 1, policy_version 1443804 (0.0010) [2023-12-28 05:36:46,898][106226] Updated weights for policy 0, policy_version 1440460 (0.0010) [2023-12-28 05:36:46,901][106225] Updated weights for policy 1, policy_version 1443814 (0.0010) [2023-12-28 05:36:46,952][106225] Updated weights for policy 1, policy_version 1443824 (0.0010) [2023-12-28 05:36:46,957][106226] Updated weights for policy 0, policy_version 1440470 (0.0007) [2023-12-28 05:36:47,017][106226] Updated weights for policy 0, policy_version 1440480 (0.0009) [2023-12-28 05:36:47,640][106225] Updated weights for policy 1, policy_version 1443834 (0.0007) [2023-12-28 05:36:47,696][106226] Updated weights for policy 0, policy_version 1440490 (0.0006) [2023-12-28 05:36:47,697][106225] Updated weights for policy 1, policy_version 1443844 (0.0010) [2023-12-28 05:36:47,750][106225] Updated weights for policy 1, policy_version 1443854 (0.0008) [2023-12-28 05:36:47,756][106226] Updated weights for policy 0, policy_version 1440500 (0.0006) [2023-12-28 05:36:47,804][106225] Updated weights for policy 1, policy_version 1443864 (0.0005) [2023-12-28 05:36:47,816][106226] Updated weights for policy 0, policy_version 1440510 (0.0008) [2023-12-28 05:36:48,401][106225] Updated weights for policy 1, policy_version 1443874 (0.0008) [2023-12-28 05:36:48,454][106226] Updated weights for policy 0, policy_version 1440520 (0.0010) [2023-12-28 05:36:48,461][106225] Updated weights for policy 1, policy_version 1443884 (0.0008) [2023-12-28 05:36:48,506][106226] Updated weights for policy 0, policy_version 1440530 (0.0009) [2023-12-28 05:36:48,520][106225] Updated weights for policy 1, policy_version 1443894 (0.0008) [2023-12-28 05:36:48,568][106226] Updated weights for policy 0, policy_version 1440540 (0.0009) [2023-12-28 05:36:49,155][106225] Updated weights for policy 1, policy_version 1443904 (0.0006) [2023-12-28 05:36:49,213][106225] Updated weights for policy 1, policy_version 1443914 (0.0006) [2023-12-28 05:36:49,229][106226] Updated weights for policy 0, policy_version 1440550 (0.0011) [2023-12-28 05:36:49,290][106225] Updated weights for policy 1, policy_version 1443924 (0.0008) [2023-12-28 05:36:49,295][106226] Updated weights for policy 0, policy_version 1440560 (0.0010) [2023-12-28 05:36:49,358][106226] Updated weights for policy 0, policy_version 1440570 (0.0009) [2023-12-28 05:36:49,873][106225] Updated weights for policy 1, policy_version 1443934 (0.0009) [2023-12-28 05:36:49,937][106225] Updated weights for policy 1, policy_version 1443944 (0.0008) [2023-12-28 05:36:49,999][106225] Updated weights for policy 1, policy_version 1443954 (0.0008) [2023-12-28 05:36:50,180][106226] Updated weights for policy 0, policy_version 1440580 (0.0009) [2023-12-28 05:36:50,236][106226] Updated weights for policy 0, policy_version 1440590 (0.0008) [2023-12-28 05:36:50,292][106226] Updated weights for policy 0, policy_version 1440600 (0.0009) [2023-12-28 05:36:50,734][106225] Updated weights for policy 1, policy_version 1443964 (0.0008) [2023-12-28 05:36:50,801][106225] Updated weights for policy 1, policy_version 1443974 (0.0008) [2023-12-28 05:36:50,861][106225] Updated weights for policy 1, policy_version 1443984 (0.0008) [2023-12-28 05:36:51,112][106226] Updated weights for policy 0, policy_version 1440610 (0.0008) [2023-12-28 05:36:51,174][106226] Updated weights for policy 0, policy_version 1440620 (0.0007) [2023-12-28 05:36:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 738582528. Throughput: 0: 9897.1, 1: 9837.2. Samples: 738593824. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:51,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.644')] [2023-12-28 05:36:51,221][106226] Updated weights for policy 0, policy_version 1440630 (0.0008) [2023-12-28 05:36:51,290][106226] Updated weights for policy 0, policy_version 1440640 (0.0008) [2023-12-28 05:36:51,589][106225] Updated weights for policy 1, policy_version 1443994 (0.0007) [2023-12-28 05:36:51,658][106225] Updated weights for policy 1, policy_version 1444004 (0.0011) [2023-12-28 05:36:51,725][106225] Updated weights for policy 1, policy_version 1444014 (0.0008) [2023-12-28 05:36:51,795][106225] Updated weights for policy 1, policy_version 1444024 (0.0008) [2023-12-28 05:36:52,029][106226] Updated weights for policy 0, policy_version 1440650 (0.0008) [2023-12-28 05:36:52,100][106226] Updated weights for policy 0, policy_version 1440660 (0.0008) [2023-12-28 05:36:52,165][106226] Updated weights for policy 0, policy_version 1440670 (0.0008) [2023-12-28 05:36:52,506][106225] Updated weights for policy 1, policy_version 1444034 (0.0008) [2023-12-28 05:36:52,574][106225] Updated weights for policy 1, policy_version 1444044 (0.0006) [2023-12-28 05:36:52,645][106225] Updated weights for policy 1, policy_version 1444054 (0.0008) [2023-12-28 05:36:52,841][106226] Updated weights for policy 0, policy_version 1440680 (0.0008) [2023-12-28 05:36:52,898][106226] Updated weights for policy 0, policy_version 1440690 (0.0008) [2023-12-28 05:36:52,958][106226] Updated weights for policy 0, policy_version 1440700 (0.0009) [2023-12-28 05:36:53,352][106225] Updated weights for policy 1, policy_version 1444064 (0.0009) [2023-12-28 05:36:53,410][106225] Updated weights for policy 1, policy_version 1444074 (0.0009) [2023-12-28 05:36:53,470][106225] Updated weights for policy 1, policy_version 1444084 (0.0009) [2023-12-28 05:36:53,648][106226] Updated weights for policy 0, policy_version 1440710 (0.0008) [2023-12-28 05:36:53,707][106226] Updated weights for policy 0, policy_version 1440720 (0.0009) [2023-12-28 05:36:53,766][106226] Updated weights for policy 0, policy_version 1440730 (0.0008) [2023-12-28 05:36:54,090][106225] Updated weights for policy 1, policy_version 1444094 (0.0006) [2023-12-28 05:36:54,138][106225] Updated weights for policy 1, policy_version 1444104 (0.0008) [2023-12-28 05:36:54,200][106225] Updated weights for policy 1, policy_version 1444114 (0.0008) [2023-12-28 05:36:54,546][106226] Updated weights for policy 0, policy_version 1440740 (0.0008) [2023-12-28 05:36:54,598][106226] Updated weights for policy 0, policy_version 1440750 (0.0009) [2023-12-28 05:36:54,644][106226] Updated weights for policy 0, policy_version 1440760 (0.0008) [2023-12-28 05:36:54,988][106225] Updated weights for policy 1, policy_version 1444124 (0.0009) [2023-12-28 05:36:55,046][106225] Updated weights for policy 1, policy_version 1444134 (0.0011) [2023-12-28 05:36:55,100][106225] Updated weights for policy 1, policy_version 1444144 (0.0010) [2023-12-28 05:36:55,412][106226] Updated weights for policy 0, policy_version 1440770 (0.0008) [2023-12-28 05:36:55,464][106226] Updated weights for policy 0, policy_version 1440780 (0.0007) [2023-12-28 05:36:55,524][106226] Updated weights for policy 0, policy_version 1440790 (0.0009) [2023-12-28 05:36:55,576][106226] Updated weights for policy 0, policy_version 1440800 (0.0009) [2023-12-28 05:36:55,746][106225] Updated weights for policy 1, policy_version 1444154 (0.0010) [2023-12-28 05:36:55,806][106225] Updated weights for policy 1, policy_version 1444164 (0.0010) [2023-12-28 05:36:55,862][106225] Updated weights for policy 1, policy_version 1444174 (0.0010) [2023-12-28 05:36:55,918][106225] Updated weights for policy 1, policy_version 1444184 (0.0010) [2023-12-28 05:36:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 738680832. Throughput: 0: 9907.7, 1: 9836.0. Samples: 738651392. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:36:56,176][105115] Avg episode reward: [(0, '-4.778'), (1, '-4.888')] [2023-12-28 05:36:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001444184_369762304.pth... [2023-12-28 05:36:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001440800_368918528.pth... [2023-12-28 05:36:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001439648_368623616.pth [2023-12-28 05:36:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001443032_369467392.pth [2023-12-28 05:36:56,277][106226] Updated weights for policy 0, policy_version 1440810 (0.0008) [2023-12-28 05:36:56,334][106226] Updated weights for policy 0, policy_version 1440820 (0.0006) [2023-12-28 05:36:56,386][106226] Updated weights for policy 0, policy_version 1440830 (0.0005) [2023-12-28 05:36:56,573][106225] Updated weights for policy 1, policy_version 1444194 (0.0007) [2023-12-28 05:36:56,619][106225] Updated weights for policy 1, policy_version 1444204 (0.0008) [2023-12-28 05:36:56,664][106225] Updated weights for policy 1, policy_version 1444214 (0.0008) [2023-12-28 05:36:56,932][106226] Updated weights for policy 0, policy_version 1440840 (0.0008) [2023-12-28 05:36:56,984][106226] Updated weights for policy 0, policy_version 1440850 (0.0006) [2023-12-28 05:36:57,048][106226] Updated weights for policy 0, policy_version 1440860 (0.0008) [2023-12-28 05:36:57,381][106225] Updated weights for policy 1, policy_version 1444224 (0.0010) [2023-12-28 05:36:57,435][106225] Updated weights for policy 1, policy_version 1444234 (0.0010) [2023-12-28 05:36:57,497][106225] Updated weights for policy 1, policy_version 1444244 (0.0008) [2023-12-28 05:36:57,643][106226] Updated weights for policy 0, policy_version 1440870 (0.0007) [2023-12-28 05:36:57,706][106226] Updated weights for policy 0, policy_version 1440880 (0.0005) [2023-12-28 05:36:57,777][106226] Updated weights for policy 0, policy_version 1440890 (0.0005) [2023-12-28 05:36:58,103][106225] Updated weights for policy 1, policy_version 1444254 (0.0005) [2023-12-28 05:36:58,159][106225] Updated weights for policy 1, policy_version 1444264 (0.0005) [2023-12-28 05:36:58,208][106225] Updated weights for policy 1, policy_version 1444274 (0.0005) [2023-12-28 05:36:58,301][106226] Updated weights for policy 0, policy_version 1440900 (0.0006) [2023-12-28 05:36:58,365][106226] Updated weights for policy 0, policy_version 1440910 (0.0009) [2023-12-28 05:36:58,431][106226] Updated weights for policy 0, policy_version 1440920 (0.0009) [2023-12-28 05:36:59,028][106225] Updated weights for policy 1, policy_version 1444284 (0.0010) [2023-12-28 05:36:59,085][106225] Updated weights for policy 1, policy_version 1444294 (0.0010) [2023-12-28 05:36:59,142][106225] Updated weights for policy 1, policy_version 1444304 (0.0010) [2023-12-28 05:36:59,282][106226] Updated weights for policy 0, policy_version 1440930 (0.0009) [2023-12-28 05:36:59,348][106226] Updated weights for policy 0, policy_version 1440940 (0.0011) [2023-12-28 05:36:59,415][106226] Updated weights for policy 0, policy_version 1440950 (0.0008) [2023-12-28 05:36:59,462][106226] Updated weights for policy 0, policy_version 1440960 (0.0010) [2023-12-28 05:36:59,903][106225] Updated weights for policy 1, policy_version 1444314 (0.0009) [2023-12-28 05:36:59,979][106225] Updated weights for policy 1, policy_version 1444324 (0.0006) [2023-12-28 05:37:00,047][106225] Updated weights for policy 1, policy_version 1444334 (0.0008) [2023-12-28 05:37:00,109][106225] Updated weights for policy 1, policy_version 1444344 (0.0008) [2023-12-28 05:37:00,136][106226] Updated weights for policy 0, policy_version 1440970 (0.0008) [2023-12-28 05:37:00,188][106226] Updated weights for policy 0, policy_version 1440980 (0.0008) [2023-12-28 05:37:00,249][106226] Updated weights for policy 0, policy_version 1440990 (0.0009) [2023-12-28 05:37:00,821][106225] Updated weights for policy 1, policy_version 1444354 (0.0008) [2023-12-28 05:37:00,882][106225] Updated weights for policy 1, policy_version 1444364 (0.0008) [2023-12-28 05:37:00,931][106225] Updated weights for policy 1, policy_version 1444374 (0.0008) [2023-12-28 05:37:00,958][106226] Updated weights for policy 0, policy_version 1441000 (0.0007) [2023-12-28 05:37:01,009][106226] Updated weights for policy 0, policy_version 1441010 (0.0008) [2023-12-28 05:37:01,073][106226] Updated weights for policy 0, policy_version 1441020 (0.0010) [2023-12-28 05:37:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 738787328. Throughput: 0: 10012.2, 1: 9903.3. Samples: 738773456. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:01,175][105115] Avg episode reward: [(0, '-4.896'), (1, '-5.098')] [2023-12-28 05:37:01,661][106225] Updated weights for policy 1, policy_version 1444384 (0.0008) [2023-12-28 05:37:01,720][106225] Updated weights for policy 1, policy_version 1444394 (0.0009) [2023-12-28 05:37:01,795][106225] Updated weights for policy 1, policy_version 1444404 (0.0008) [2023-12-28 05:37:01,845][106226] Updated weights for policy 0, policy_version 1441030 (0.0008) [2023-12-28 05:37:01,898][106226] Updated weights for policy 0, policy_version 1441040 (0.0008) [2023-12-28 05:37:01,948][106226] Updated weights for policy 0, policy_version 1441050 (0.0009) [2023-12-28 05:37:02,511][106225] Updated weights for policy 1, policy_version 1444414 (0.0008) [2023-12-28 05:37:02,576][106225] Updated weights for policy 1, policy_version 1444424 (0.0008) [2023-12-28 05:37:02,633][106225] Updated weights for policy 1, policy_version 1444434 (0.0008) [2023-12-28 05:37:02,695][106226] Updated weights for policy 0, policy_version 1441060 (0.0008) [2023-12-28 05:37:02,760][106226] Updated weights for policy 0, policy_version 1441070 (0.0008) [2023-12-28 05:37:02,821][106226] Updated weights for policy 0, policy_version 1441080 (0.0006) [2023-12-28 05:37:03,418][106225] Updated weights for policy 1, policy_version 1444444 (0.0008) [2023-12-28 05:37:03,429][106226] Updated weights for policy 0, policy_version 1441090 (0.0006) [2023-12-28 05:37:03,470][106225] Updated weights for policy 1, policy_version 1444454 (0.0005) [2023-12-28 05:37:03,483][106226] Updated weights for policy 0, policy_version 1441100 (0.0007) [2023-12-28 05:37:03,516][106225] Updated weights for policy 1, policy_version 1444464 (0.0006) [2023-12-28 05:37:03,537][106226] Updated weights for policy 0, policy_version 1441110 (0.0008) [2023-12-28 05:37:03,594][106226] Updated weights for policy 0, policy_version 1441120 (0.0008) [2023-12-28 05:37:04,289][106225] Updated weights for policy 1, policy_version 1444474 (0.0006) [2023-12-28 05:37:04,293][106226] Updated weights for policy 0, policy_version 1441130 (0.0011) [2023-12-28 05:37:04,351][106225] Updated weights for policy 1, policy_version 1444484 (0.0007) [2023-12-28 05:37:04,356][106226] Updated weights for policy 0, policy_version 1441140 (0.0010) [2023-12-28 05:37:04,404][106225] Updated weights for policy 1, policy_version 1444494 (0.0007) [2023-12-28 05:37:04,417][106226] Updated weights for policy 0, policy_version 1441150 (0.0011) [2023-12-28 05:37:04,462][106225] Updated weights for policy 1, policy_version 1444504 (0.0006) [2023-12-28 05:37:05,108][106226] Updated weights for policy 0, policy_version 1441160 (0.0010) [2023-12-28 05:37:05,141][106225] Updated weights for policy 1, policy_version 1444514 (0.0005) [2023-12-28 05:37:05,166][106226] Updated weights for policy 0, policy_version 1441170 (0.0009) [2023-12-28 05:37:05,200][106225] Updated weights for policy 1, policy_version 1444524 (0.0006) [2023-12-28 05:37:05,225][106226] Updated weights for policy 0, policy_version 1441180 (0.0008) [2023-12-28 05:37:05,259][106225] Updated weights for policy 1, policy_version 1444534 (0.0007) [2023-12-28 05:37:05,865][106225] Updated weights for policy 1, policy_version 1444544 (0.0008) [2023-12-28 05:37:05,923][106225] Updated weights for policy 1, policy_version 1444554 (0.0008) [2023-12-28 05:37:05,980][106225] Updated weights for policy 1, policy_version 1444564 (0.0007) [2023-12-28 05:37:05,990][106226] Updated weights for policy 0, policy_version 1441190 (0.0006) [2023-12-28 05:37:06,043][106226] Updated weights for policy 0, policy_version 1441200 (0.0007) [2023-12-28 05:37:06,110][106226] Updated weights for policy 0, policy_version 1441210 (0.0008) [2023-12-28 05:37:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 738885632. Throughput: 0: 10075.0, 1: 9818.5. Samples: 738888916. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:06,175][105115] Avg episode reward: [(0, '-4.924'), (1, '-4.561')] [2023-12-28 05:37:06,726][106225] Updated weights for policy 1, policy_version 1444574 (0.0010) [2023-12-28 05:37:06,792][106225] Updated weights for policy 1, policy_version 1444584 (0.0010) [2023-12-28 05:37:06,859][106225] Updated weights for policy 1, policy_version 1444594 (0.0010) [2023-12-28 05:37:06,894][106226] Updated weights for policy 0, policy_version 1441220 (0.0007) [2023-12-28 05:37:06,955][106226] Updated weights for policy 0, policy_version 1441230 (0.0008) [2023-12-28 05:37:07,012][106226] Updated weights for policy 0, policy_version 1441240 (0.0007) [2023-12-28 05:37:07,508][106225] Updated weights for policy 1, policy_version 1444604 (0.0008) [2023-12-28 05:37:07,568][106225] Updated weights for policy 1, policy_version 1444614 (0.0005) [2023-12-28 05:37:07,621][106225] Updated weights for policy 1, policy_version 1444624 (0.0005) [2023-12-28 05:37:07,825][106226] Updated weights for policy 0, policy_version 1441250 (0.0007) [2023-12-28 05:37:07,890][106226] Updated weights for policy 0, policy_version 1441260 (0.0008) [2023-12-28 05:37:07,951][106226] Updated weights for policy 0, policy_version 1441270 (0.0008) [2023-12-28 05:37:08,014][106226] Updated weights for policy 0, policy_version 1441280 (0.0008) [2023-12-28 05:37:08,302][106225] Updated weights for policy 1, policy_version 1444634 (0.0006) [2023-12-28 05:37:08,370][106225] Updated weights for policy 1, policy_version 1444644 (0.0008) [2023-12-28 05:37:08,440][106225] Updated weights for policy 1, policy_version 1444654 (0.0008) [2023-12-28 05:37:08,506][106225] Updated weights for policy 1, policy_version 1444664 (0.0008) [2023-12-28 05:37:08,689][106226] Updated weights for policy 0, policy_version 1441290 (0.0005) [2023-12-28 05:37:08,741][106226] Updated weights for policy 0, policy_version 1441300 (0.0009) [2023-12-28 05:37:08,788][106226] Updated weights for policy 0, policy_version 1441310 (0.0010) [2023-12-28 05:37:09,318][106225] Updated weights for policy 1, policy_version 1444674 (0.0008) [2023-12-28 05:37:09,384][106225] Updated weights for policy 1, policy_version 1444684 (0.0008) [2023-12-28 05:37:09,452][106225] Updated weights for policy 1, policy_version 1444694 (0.0007) [2023-12-28 05:37:09,469][106226] Updated weights for policy 0, policy_version 1441320 (0.0009) [2023-12-28 05:37:09,526][106226] Updated weights for policy 0, policy_version 1441330 (0.0008) [2023-12-28 05:37:09,584][106226] Updated weights for policy 0, policy_version 1441340 (0.0009) [2023-12-28 05:37:10,186][106225] Updated weights for policy 1, policy_version 1444704 (0.0008) [2023-12-28 05:37:10,258][106225] Updated weights for policy 1, policy_version 1444714 (0.0009) [2023-12-28 05:37:10,328][106225] Updated weights for policy 1, policy_version 1444724 (0.0008) [2023-12-28 05:37:10,350][106226] Updated weights for policy 0, policy_version 1441350 (0.0007) [2023-12-28 05:37:10,421][106226] Updated weights for policy 0, policy_version 1441360 (0.0005) [2023-12-28 05:37:10,481][106226] Updated weights for policy 0, policy_version 1441370 (0.0006) [2023-12-28 05:37:10,901][106225] Updated weights for policy 1, policy_version 1444734 (0.0006) [2023-12-28 05:37:10,950][106225] Updated weights for policy 1, policy_version 1444744 (0.0005) [2023-12-28 05:37:11,012][106225] Updated weights for policy 1, policy_version 1444754 (0.0005) [2023-12-28 05:37:11,142][106226] Updated weights for policy 0, policy_version 1441380 (0.0007) [2023-12-28 05:37:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 738975744. Throughput: 0: 10052.4, 1: 9834.0. Samples: 738946720. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:11,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.756')] [2023-12-28 05:37:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001444760_369909760.pth... [2023-12-28 05:37:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001443608_369614848.pth [2023-12-28 05:37:11,215][106226] Updated weights for policy 0, policy_version 1441390 (0.0008) [2023-12-28 05:37:11,284][106226] Updated weights for policy 0, policy_version 1441400 (0.0007) [2023-12-28 05:37:11,335][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001441408_369074176.pth... [2023-12-28 05:37:11,339][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001440256_368779264.pth [2023-12-28 05:37:11,740][106225] Updated weights for policy 1, policy_version 1444764 (0.0008) [2023-12-28 05:37:11,803][106225] Updated weights for policy 1, policy_version 1444774 (0.0007) [2023-12-28 05:37:11,860][106225] Updated weights for policy 1, policy_version 1444784 (0.0005) [2023-12-28 05:37:12,084][106226] Updated weights for policy 0, policy_version 1441410 (0.0007) [2023-12-28 05:37:12,154][106226] Updated weights for policy 0, policy_version 1441420 (0.0006) [2023-12-28 05:37:12,214][106226] Updated weights for policy 0, policy_version 1441430 (0.0007) [2023-12-28 05:37:12,278][106226] Updated weights for policy 0, policy_version 1441440 (0.0007) [2023-12-28 05:37:12,648][106225] Updated weights for policy 1, policy_version 1444794 (0.0009) [2023-12-28 05:37:12,713][106225] Updated weights for policy 1, policy_version 1444804 (0.0011) [2023-12-28 05:37:12,774][106225] Updated weights for policy 1, policy_version 1444814 (0.0010) [2023-12-28 05:37:12,839][106225] Updated weights for policy 1, policy_version 1444824 (0.0010) [2023-12-28 05:37:12,922][106226] Updated weights for policy 0, policy_version 1441450 (0.0008) [2023-12-28 05:37:12,982][106226] Updated weights for policy 0, policy_version 1441460 (0.0007) [2023-12-28 05:37:13,049][106226] Updated weights for policy 0, policy_version 1441470 (0.0005) [2023-12-28 05:37:13,506][106225] Updated weights for policy 1, policy_version 1444834 (0.0008) [2023-12-28 05:37:13,554][106225] Updated weights for policy 1, policy_version 1444844 (0.0008) [2023-12-28 05:37:13,600][106225] Updated weights for policy 1, policy_version 1444854 (0.0008) [2023-12-28 05:37:13,737][106226] Updated weights for policy 0, policy_version 1441480 (0.0008) [2023-12-28 05:37:13,795][106226] Updated weights for policy 0, policy_version 1441490 (0.0008) [2023-12-28 05:37:13,856][106226] Updated weights for policy 0, policy_version 1441500 (0.0009) [2023-12-28 05:37:14,224][106225] Updated weights for policy 1, policy_version 1444864 (0.0008) [2023-12-28 05:37:14,279][106225] Updated weights for policy 1, policy_version 1444874 (0.0008) [2023-12-28 05:37:14,334][106225] Updated weights for policy 1, policy_version 1444884 (0.0008) [2023-12-28 05:37:14,623][106226] Updated weights for policy 0, policy_version 1441510 (0.0009) [2023-12-28 05:37:14,681][106226] Updated weights for policy 0, policy_version 1441520 (0.0008) [2023-12-28 05:37:14,742][106226] Updated weights for policy 0, policy_version 1441530 (0.0009) [2023-12-28 05:37:15,060][106225] Updated weights for policy 1, policy_version 1444894 (0.0008) [2023-12-28 05:37:15,120][106225] Updated weights for policy 1, policy_version 1444904 (0.0009) [2023-12-28 05:37:15,187][106225] Updated weights for policy 1, policy_version 1444914 (0.0008) [2023-12-28 05:37:15,543][106226] Updated weights for policy 0, policy_version 1441540 (0.0008) [2023-12-28 05:37:15,594][106226] Updated weights for policy 0, policy_version 1441550 (0.0008) [2023-12-28 05:37:15,645][106226] Updated weights for policy 0, policy_version 1441560 (0.0008) [2023-12-28 05:37:15,821][106225] Updated weights for policy 1, policy_version 1444924 (0.0007) [2023-12-28 05:37:15,863][106225] Updated weights for policy 1, policy_version 1444934 (0.0005) [2023-12-28 05:37:15,914][106225] Updated weights for policy 1, policy_version 1444944 (0.0006) [2023-12-28 05:37:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 739074048. Throughput: 0: 9856.5, 1: 9854.3. Samples: 739062324. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:16,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-4.869')] [2023-12-28 05:37:16,359][106226] Updated weights for policy 0, policy_version 1441570 (0.0008) [2023-12-28 05:37:16,413][106226] Updated weights for policy 0, policy_version 1441580 (0.0005) [2023-12-28 05:37:16,467][106226] Updated weights for policy 0, policy_version 1441590 (0.0007) [2023-12-28 05:37:16,525][106226] Updated weights for policy 0, policy_version 1441600 (0.0005) [2023-12-28 05:37:16,679][106225] Updated weights for policy 1, policy_version 1444954 (0.0009) [2023-12-28 05:37:16,737][106225] Updated weights for policy 1, policy_version 1444964 (0.0010) [2023-12-28 05:37:16,790][106225] Updated weights for policy 1, policy_version 1444974 (0.0009) [2023-12-28 05:37:16,838][106225] Updated weights for policy 1, policy_version 1444984 (0.0009) [2023-12-28 05:37:17,068][106226] Updated weights for policy 0, policy_version 1441610 (0.0006) [2023-12-28 05:37:17,122][106226] Updated weights for policy 0, policy_version 1441620 (0.0008) [2023-12-28 05:37:17,180][106226] Updated weights for policy 0, policy_version 1441630 (0.0005) [2023-12-28 05:37:17,585][106225] Updated weights for policy 1, policy_version 1444994 (0.0008) [2023-12-28 05:37:17,637][106225] Updated weights for policy 1, policy_version 1445004 (0.0006) [2023-12-28 05:37:17,684][106225] Updated weights for policy 1, policy_version 1445014 (0.0006) [2023-12-28 05:37:17,872][106226] Updated weights for policy 0, policy_version 1441640 (0.0005) [2023-12-28 05:37:17,932][106226] Updated weights for policy 0, policy_version 1441650 (0.0008) [2023-12-28 05:37:17,989][106226] Updated weights for policy 0, policy_version 1441660 (0.0008) [2023-12-28 05:37:18,405][106225] Updated weights for policy 1, policy_version 1445024 (0.0008) [2023-12-28 05:37:18,466][106225] Updated weights for policy 1, policy_version 1445034 (0.0009) [2023-12-28 05:37:18,527][106225] Updated weights for policy 1, policy_version 1445044 (0.0008) [2023-12-28 05:37:18,683][106226] Updated weights for policy 0, policy_version 1441670 (0.0009) [2023-12-28 05:37:18,749][106226] Updated weights for policy 0, policy_version 1441680 (0.0008) [2023-12-28 05:37:18,820][106226] Updated weights for policy 0, policy_version 1441690 (0.0008) [2023-12-28 05:37:19,241][106225] Updated weights for policy 1, policy_version 1445054 (0.0009) [2023-12-28 05:37:19,307][106225] Updated weights for policy 1, policy_version 1445064 (0.0008) [2023-12-28 05:37:19,376][106225] Updated weights for policy 1, policy_version 1445074 (0.0009) [2023-12-28 05:37:19,577][106226] Updated weights for policy 0, policy_version 1441700 (0.0006) [2023-12-28 05:37:19,643][106226] Updated weights for policy 0, policy_version 1441710 (0.0008) [2023-12-28 05:37:19,708][106226] Updated weights for policy 0, policy_version 1441720 (0.0008) [2023-12-28 05:37:20,061][106225] Updated weights for policy 1, policy_version 1445084 (0.0010) [2023-12-28 05:37:20,127][106225] Updated weights for policy 1, policy_version 1445094 (0.0006) [2023-12-28 05:37:20,183][106225] Updated weights for policy 1, policy_version 1445104 (0.0006) [2023-12-28 05:37:20,514][106226] Updated weights for policy 0, policy_version 1441730 (0.0008) [2023-12-28 05:37:20,567][106226] Updated weights for policy 0, policy_version 1441740 (0.0009) [2023-12-28 05:37:20,634][106226] Updated weights for policy 0, policy_version 1441750 (0.0007) [2023-12-28 05:37:20,702][106226] Updated weights for policy 0, policy_version 1441760 (0.0009) [2023-12-28 05:37:20,784][106225] Updated weights for policy 1, policy_version 1445114 (0.0009) [2023-12-28 05:37:20,846][106225] Updated weights for policy 1, policy_version 1445124 (0.0011) [2023-12-28 05:37:20,907][106225] Updated weights for policy 1, policy_version 1445134 (0.0010) [2023-12-28 05:37:20,970][106225] Updated weights for policy 1, policy_version 1445144 (0.0011) [2023-12-28 05:37:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 739172352. Throughput: 0: 9768.5, 1: 9858.0. Samples: 739180700. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:21,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-4.685')] [2023-12-28 05:37:21,492][106226] Updated weights for policy 0, policy_version 1441770 (0.0008) [2023-12-28 05:37:21,552][106226] Updated weights for policy 0, policy_version 1441780 (0.0009) [2023-12-28 05:37:21,613][106226] Updated weights for policy 0, policy_version 1441790 (0.0008) [2023-12-28 05:37:21,679][106225] Updated weights for policy 1, policy_version 1445154 (0.0009) [2023-12-28 05:37:21,746][106225] Updated weights for policy 1, policy_version 1445164 (0.0008) [2023-12-28 05:37:21,810][106225] Updated weights for policy 1, policy_version 1445174 (0.0008) [2023-12-28 05:37:22,322][106226] Updated weights for policy 0, policy_version 1441800 (0.0008) [2023-12-28 05:37:22,390][106226] Updated weights for policy 0, policy_version 1441810 (0.0009) [2023-12-28 05:37:22,455][106226] Updated weights for policy 0, policy_version 1441820 (0.0006) [2023-12-28 05:37:22,609][106225] Updated weights for policy 1, policy_version 1445184 (0.0008) [2023-12-28 05:37:22,670][106225] Updated weights for policy 1, policy_version 1445194 (0.0010) [2023-12-28 05:37:22,736][106225] Updated weights for policy 1, policy_version 1445204 (0.0009) [2023-12-28 05:37:23,136][106226] Updated weights for policy 0, policy_version 1441830 (0.0007) [2023-12-28 05:37:23,202][106226] Updated weights for policy 0, policy_version 1441840 (0.0011) [2023-12-28 05:37:23,266][106226] Updated weights for policy 0, policy_version 1441850 (0.0009) [2023-12-28 05:37:23,499][106225] Updated weights for policy 1, policy_version 1445214 (0.0006) [2023-12-28 05:37:23,562][106225] Updated weights for policy 1, policy_version 1445224 (0.0008) [2023-12-28 05:37:23,618][106225] Updated weights for policy 1, policy_version 1445234 (0.0009) [2023-12-28 05:37:23,962][106226] Updated weights for policy 0, policy_version 1441860 (0.0008) [2023-12-28 05:37:24,025][106226] Updated weights for policy 0, policy_version 1441870 (0.0010) [2023-12-28 05:37:24,072][106226] Updated weights for policy 0, policy_version 1441880 (0.0010) [2023-12-28 05:37:24,332][106225] Updated weights for policy 1, policy_version 1445244 (0.0010) [2023-12-28 05:37:24,399][106225] Updated weights for policy 1, policy_version 1445254 (0.0010) [2023-12-28 05:37:24,462][106225] Updated weights for policy 1, policy_version 1445264 (0.0010) [2023-12-28 05:37:24,789][106226] Updated weights for policy 0, policy_version 1441890 (0.0011) [2023-12-28 05:37:24,849][106226] Updated weights for policy 0, policy_version 1441900 (0.0011) [2023-12-28 05:37:24,901][106226] Updated weights for policy 0, policy_version 1441910 (0.0010) [2023-12-28 05:37:24,964][106226] Updated weights for policy 0, policy_version 1441920 (0.0010) [2023-12-28 05:37:24,993][106225] Updated weights for policy 1, policy_version 1445274 (0.0009) [2023-12-28 05:37:25,058][106225] Updated weights for policy 1, policy_version 1445284 (0.0005) [2023-12-28 05:37:25,106][106225] Updated weights for policy 1, policy_version 1445294 (0.0005) [2023-12-28 05:37:25,155][106225] Updated weights for policy 1, policy_version 1445304 (0.0005) [2023-12-28 05:37:25,628][106226] Updated weights for policy 0, policy_version 1441930 (0.0005) [2023-12-28 05:37:25,670][106225] Updated weights for policy 1, policy_version 1445314 (0.0005) [2023-12-28 05:37:25,693][106226] Updated weights for policy 0, policy_version 1441940 (0.0005) [2023-12-28 05:37:25,727][106225] Updated weights for policy 1, policy_version 1445324 (0.0010) [2023-12-28 05:37:25,752][106226] Updated weights for policy 0, policy_version 1441950 (0.0005) [2023-12-28 05:37:25,787][106225] Updated weights for policy 1, policy_version 1445334 (0.0010) [2023-12-28 05:37:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 739270656. Throughput: 0: 9752.8, 1: 9829.1. Samples: 739236636. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:26,176][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.992')] [2023-12-28 05:37:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001445336_370057216.pth... [2023-12-28 05:37:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001441952_369213440.pth... [2023-12-28 05:37:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001444184_369762304.pth [2023-12-28 05:37:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001440800_368918528.pth [2023-12-28 05:37:26,283][106226] Updated weights for policy 0, policy_version 1441960 (0.0006) [2023-12-28 05:37:26,351][106226] Updated weights for policy 0, policy_version 1441970 (0.0006) [2023-12-28 05:37:26,383][106225] Updated weights for policy 1, policy_version 1445344 (0.0006) [2023-12-28 05:37:26,419][106226] Updated weights for policy 0, policy_version 1441980 (0.0006) [2023-12-28 05:37:26,442][106225] Updated weights for policy 1, policy_version 1445354 (0.0006) [2023-12-28 05:37:26,493][106225] Updated weights for policy 1, policy_version 1445364 (0.0008) [2023-12-28 05:37:27,025][106226] Updated weights for policy 0, policy_version 1441990 (0.0008) [2023-12-28 05:37:27,069][106225] Updated weights for policy 1, policy_version 1445374 (0.0008) [2023-12-28 05:37:27,089][106226] Updated weights for policy 0, policy_version 1442000 (0.0007) [2023-12-28 05:37:27,117][106225] Updated weights for policy 1, policy_version 1445384 (0.0010) [2023-12-28 05:37:27,139][106226] Updated weights for policy 0, policy_version 1442010 (0.0006) [2023-12-28 05:37:27,167][106225] Updated weights for policy 1, policy_version 1445394 (0.0010) [2023-12-28 05:37:27,836][106226] Updated weights for policy 0, policy_version 1442020 (0.0006) [2023-12-28 05:37:27,872][106225] Updated weights for policy 1, policy_version 1445404 (0.0010) [2023-12-28 05:37:27,885][106226] Updated weights for policy 0, policy_version 1442030 (0.0010) [2023-12-28 05:37:27,925][106225] Updated weights for policy 1, policy_version 1445414 (0.0010) [2023-12-28 05:37:27,938][106226] Updated weights for policy 0, policy_version 1442040 (0.0010) [2023-12-28 05:37:27,980][106225] Updated weights for policy 1, policy_version 1445424 (0.0010) [2023-12-28 05:37:28,606][106226] Updated weights for policy 0, policy_version 1442050 (0.0011) [2023-12-28 05:37:28,609][106225] Updated weights for policy 1, policy_version 1445434 (0.0010) [2023-12-28 05:37:28,666][106226] Updated weights for policy 0, policy_version 1442060 (0.0008) [2023-12-28 05:37:28,670][106225] Updated weights for policy 1, policy_version 1445444 (0.0010) [2023-12-28 05:37:28,719][106226] Updated weights for policy 0, policy_version 1442070 (0.0007) [2023-12-28 05:37:28,733][106225] Updated weights for policy 1, policy_version 1445454 (0.0010) [2023-12-28 05:37:28,784][106226] Updated weights for policy 0, policy_version 1442080 (0.0011) [2023-12-28 05:37:28,787][106225] Updated weights for policy 1, policy_version 1445464 (0.0010) [2023-12-28 05:37:29,439][106226] Updated weights for policy 0, policy_version 1442090 (0.0011) [2023-12-28 05:37:29,496][106226] Updated weights for policy 0, policy_version 1442100 (0.0010) [2023-12-28 05:37:29,520][106225] Updated weights for policy 1, policy_version 1445474 (0.0010) [2023-12-28 05:37:29,557][106226] Updated weights for policy 0, policy_version 1442110 (0.0011) [2023-12-28 05:37:29,576][106225] Updated weights for policy 1, policy_version 1445484 (0.0010) [2023-12-28 05:37:29,629][106225] Updated weights for policy 1, policy_version 1445494 (0.0010) [2023-12-28 05:37:30,292][106226] Updated weights for policy 0, policy_version 1442120 (0.0008) [2023-12-28 05:37:30,306][106225] Updated weights for policy 1, policy_version 1445504 (0.0008) [2023-12-28 05:37:30,348][106226] Updated weights for policy 0, policy_version 1442130 (0.0006) [2023-12-28 05:37:30,354][106225] Updated weights for policy 1, policy_version 1445514 (0.0006) [2023-12-28 05:37:30,404][106226] Updated weights for policy 0, policy_version 1442140 (0.0006) [2023-12-28 05:37:30,417][106225] Updated weights for policy 1, policy_version 1445524 (0.0008) [2023-12-28 05:37:31,017][106225] Updated weights for policy 1, policy_version 1445534 (0.0007) [2023-12-28 05:37:31,086][106225] Updated weights for policy 1, policy_version 1445544 (0.0008) [2023-12-28 05:37:31,141][106225] Updated weights for policy 1, policy_version 1445554 (0.0008) [2023-12-28 05:37:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 739368960. Throughput: 0: 9823.8, 1: 10014.5. Samples: 739365208. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:31,175][105115] Avg episode reward: [(0, '-4.994'), (1, '-4.450')] [2023-12-28 05:37:31,204][106226] Updated weights for policy 0, policy_version 1442150 (0.0010) [2023-12-28 05:37:31,265][106226] Updated weights for policy 0, policy_version 1442160 (0.0010) [2023-12-28 05:37:31,322][106226] Updated weights for policy 0, policy_version 1442170 (0.0010) [2023-12-28 05:37:31,879][106225] Updated weights for policy 1, policy_version 1445564 (0.0007) [2023-12-28 05:37:31,944][106225] Updated weights for policy 1, policy_version 1445574 (0.0007) [2023-12-28 05:37:32,009][106225] Updated weights for policy 1, policy_version 1445584 (0.0008) [2023-12-28 05:37:32,062][106226] Updated weights for policy 0, policy_version 1442180 (0.0011) [2023-12-28 05:37:32,130][106226] Updated weights for policy 0, policy_version 1442190 (0.0011) [2023-12-28 05:37:32,192][106226] Updated weights for policy 0, policy_version 1442200 (0.0011) [2023-12-28 05:37:32,723][106225] Updated weights for policy 1, policy_version 1445594 (0.0007) [2023-12-28 05:37:32,776][106225] Updated weights for policy 1, policy_version 1445604 (0.0009) [2023-12-28 05:37:32,839][106225] Updated weights for policy 1, policy_version 1445615 (0.0009) [2023-12-28 05:37:32,892][106226] Updated weights for policy 0, policy_version 1442210 (0.0009) [2023-12-28 05:37:32,943][106226] Updated weights for policy 0, policy_version 1442220 (0.0005) [2023-12-28 05:37:33,005][106226] Updated weights for policy 0, policy_version 1442230 (0.0005) [2023-12-28 05:37:33,070][106226] Updated weights for policy 0, policy_version 1442240 (0.0005) [2023-12-28 05:37:33,538][106225] Updated weights for policy 1, policy_version 1445625 (0.0008) [2023-12-28 05:37:33,560][106226] Updated weights for policy 0, policy_version 1442250 (0.0008) [2023-12-28 05:37:33,588][106225] Updated weights for policy 1, policy_version 1445635 (0.0006) [2023-12-28 05:37:33,616][106226] Updated weights for policy 0, policy_version 1442260 (0.0010) [2023-12-28 05:37:33,645][106225] Updated weights for policy 1, policy_version 1445645 (0.0005) [2023-12-28 05:37:33,677][106226] Updated weights for policy 0, policy_version 1442270 (0.0011) [2023-12-28 05:37:33,698][106225] Updated weights for policy 1, policy_version 1445655 (0.0006) [2023-12-28 05:37:34,393][106225] Updated weights for policy 1, policy_version 1445665 (0.0007) [2023-12-28 05:37:34,406][106226] Updated weights for policy 0, policy_version 1442280 (0.0009) [2023-12-28 05:37:34,454][106225] Updated weights for policy 1, policy_version 1445675 (0.0008) [2023-12-28 05:37:34,464][106226] Updated weights for policy 0, policy_version 1442290 (0.0008) [2023-12-28 05:37:34,509][106225] Updated weights for policy 1, policy_version 1445685 (0.0008) [2023-12-28 05:37:34,528][106226] Updated weights for policy 0, policy_version 1442300 (0.0008) [2023-12-28 05:37:35,163][106226] Updated weights for policy 0, policy_version 1442310 (0.0009) [2023-12-28 05:37:35,217][106226] Updated weights for policy 0, policy_version 1442320 (0.0006) [2023-12-28 05:37:35,280][106226] Updated weights for policy 0, policy_version 1442330 (0.0006) [2023-12-28 05:37:35,286][106225] Updated weights for policy 1, policy_version 1445695 (0.0008) [2023-12-28 05:37:35,345][106225] Updated weights for policy 1, policy_version 1445705 (0.0008) [2023-12-28 05:37:35,401][106225] Updated weights for policy 1, policy_version 1445715 (0.0009) [2023-12-28 05:37:35,893][106226] Updated weights for policy 0, policy_version 1442340 (0.0005) [2023-12-28 05:37:35,941][106226] Updated weights for policy 0, policy_version 1442350 (0.0005) [2023-12-28 05:37:35,993][106226] Updated weights for policy 0, policy_version 1442360 (0.0006) [2023-12-28 05:37:36,156][106225] Updated weights for policy 1, policy_version 1445725 (0.0007) [2023-12-28 05:37:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 739475456. Throughput: 0: 9882.0, 1: 9934.5. Samples: 739485568. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:36,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.777')] [2023-12-28 05:37:36,212][106225] Updated weights for policy 1, policy_version 1445735 (0.0006) [2023-12-28 05:37:36,269][106225] Updated weights for policy 1, policy_version 1445745 (0.0005) [2023-12-28 05:37:36,784][106226] Updated weights for policy 0, policy_version 1442370 (0.0009) [2023-12-28 05:37:36,844][106226] Updated weights for policy 0, policy_version 1442380 (0.0010) [2023-12-28 05:37:36,910][106226] Updated weights for policy 0, policy_version 1442390 (0.0006) [2023-12-28 05:37:36,954][106225] Updated weights for policy 1, policy_version 1445755 (0.0005) [2023-12-28 05:37:36,974][106226] Updated weights for policy 0, policy_version 1442400 (0.0009) [2023-12-28 05:37:37,003][106225] Updated weights for policy 1, policy_version 1445765 (0.0007) [2023-12-28 05:37:37,061][106225] Updated weights for policy 1, policy_version 1445775 (0.0008) [2023-12-28 05:37:37,580][106226] Updated weights for policy 0, policy_version 1442410 (0.0011) [2023-12-28 05:37:37,644][106226] Updated weights for policy 0, policy_version 1442420 (0.0011) [2023-12-28 05:37:37,706][106226] Updated weights for policy 0, policy_version 1442430 (0.0011) [2023-12-28 05:37:37,796][106225] Updated weights for policy 1, policy_version 1445785 (0.0006) [2023-12-28 05:37:37,847][106225] Updated weights for policy 1, policy_version 1445795 (0.0007) [2023-12-28 05:37:37,904][106225] Updated weights for policy 1, policy_version 1445805 (0.0008) [2023-12-28 05:37:37,952][106225] Updated weights for policy 1, policy_version 1445815 (0.0008) [2023-12-28 05:37:38,388][106226] Updated weights for policy 0, policy_version 1442440 (0.0009) [2023-12-28 05:37:38,439][106226] Updated weights for policy 0, policy_version 1442450 (0.0009) [2023-12-28 05:37:38,492][106226] Updated weights for policy 0, policy_version 1442460 (0.0008) [2023-12-28 05:37:38,729][106225] Updated weights for policy 1, policy_version 1445825 (0.0008) [2023-12-28 05:37:38,791][106225] Updated weights for policy 1, policy_version 1445835 (0.0009) [2023-12-28 05:37:38,852][106225] Updated weights for policy 1, policy_version 1445845 (0.0009) [2023-12-28 05:37:39,246][106226] Updated weights for policy 0, policy_version 1442470 (0.0008) [2023-12-28 05:37:39,303][106226] Updated weights for policy 0, policy_version 1442480 (0.0008) [2023-12-28 05:37:39,391][106226] Updated weights for policy 0, policy_version 1442490 (0.0008) [2023-12-28 05:37:39,539][106225] Updated weights for policy 1, policy_version 1445855 (0.0007) [2023-12-28 05:37:39,605][106225] Updated weights for policy 1, policy_version 1445865 (0.0008) [2023-12-28 05:37:39,672][106225] Updated weights for policy 1, policy_version 1445875 (0.0009) [2023-12-28 05:37:40,054][106226] Updated weights for policy 0, policy_version 1442500 (0.0008) [2023-12-28 05:37:40,113][106226] Updated weights for policy 0, policy_version 1442510 (0.0008) [2023-12-28 05:37:40,181][106226] Updated weights for policy 0, policy_version 1442520 (0.0008) [2023-12-28 05:37:40,449][106225] Updated weights for policy 1, policy_version 1445885 (0.0008) [2023-12-28 05:37:40,505][106225] Updated weights for policy 1, policy_version 1445895 (0.0008) [2023-12-28 05:37:40,565][106225] Updated weights for policy 1, policy_version 1445905 (0.0008) [2023-12-28 05:37:40,851][106226] Updated weights for policy 0, policy_version 1442530 (0.0007) [2023-12-28 05:37:40,907][106226] Updated weights for policy 0, policy_version 1442540 (0.0006) [2023-12-28 05:37:40,954][106226] Updated weights for policy 0, policy_version 1442550 (0.0005) [2023-12-28 05:37:41,022][106226] Updated weights for policy 0, policy_version 1442560 (0.0006) [2023-12-28 05:37:41,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 739573760. Throughput: 0: 9888.3, 1: 9948.1. Samples: 739544028. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-28 05:37:41,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.743')] [2023-12-28 05:37:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001445912_370204672.pth... [2023-12-28 05:37:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001442560_369369088.pth... [2023-12-28 05:37:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001441408_369074176.pth [2023-12-28 05:37:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001444760_369909760.pth [2023-12-28 05:37:41,427][106225] Updated weights for policy 1, policy_version 1445915 (0.0008) [2023-12-28 05:37:41,477][106225] Updated weights for policy 1, policy_version 1445925 (0.0008) [2023-12-28 05:37:41,542][106225] Updated weights for policy 1, policy_version 1445935 (0.0009) [2023-12-28 05:37:41,706][106226] Updated weights for policy 0, policy_version 1442570 (0.0009) [2023-12-28 05:37:41,775][106226] Updated weights for policy 0, policy_version 1442580 (0.0008) [2023-12-28 05:37:41,828][106226] Updated weights for policy 0, policy_version 1442590 (0.0009) [2023-12-28 05:37:42,327][106225] Updated weights for policy 1, policy_version 1445945 (0.0007) [2023-12-28 05:37:42,396][106225] Updated weights for policy 1, policy_version 1445955 (0.0010) [2023-12-28 05:37:42,451][106225] Updated weights for policy 1, policy_version 1445965 (0.0010) [2023-12-28 05:37:42,519][106225] Updated weights for policy 1, policy_version 1445975 (0.0010) [2023-12-28 05:37:42,593][106226] Updated weights for policy 0, policy_version 1442600 (0.0008) [2023-12-28 05:37:42,653][106226] Updated weights for policy 0, policy_version 1442610 (0.0008) [2023-12-28 05:37:42,704][106226] Updated weights for policy 0, policy_version 1442620 (0.0008) [2023-12-28 05:37:43,252][106225] Updated weights for policy 1, policy_version 1445985 (0.0007) [2023-12-28 05:37:43,299][106225] Updated weights for policy 1, policy_version 1445995 (0.0006) [2023-12-28 05:37:43,353][106225] Updated weights for policy 1, policy_version 1446005 (0.0008) [2023-12-28 05:37:43,380][106226] Updated weights for policy 0, policy_version 1442630 (0.0006) [2023-12-28 05:37:43,441][106226] Updated weights for policy 0, policy_version 1442640 (0.0005) [2023-12-28 05:37:43,499][106226] Updated weights for policy 0, policy_version 1442650 (0.0005) [2023-12-28 05:37:43,957][106225] Updated weights for policy 1, policy_version 1446015 (0.0005) [2023-12-28 05:37:44,024][106225] Updated weights for policy 1, policy_version 1446025 (0.0008) [2023-12-28 05:37:44,027][106226] Updated weights for policy 0, policy_version 1442660 (0.0006) [2023-12-28 05:37:44,080][106226] Updated weights for policy 0, policy_version 1442670 (0.0005) [2023-12-28 05:37:44,093][106225] Updated weights for policy 1, policy_version 1446035 (0.0008) [2023-12-28 05:37:44,136][106226] Updated weights for policy 0, policy_version 1442680 (0.0007) [2023-12-28 05:37:44,790][106226] Updated weights for policy 0, policy_version 1442690 (0.0009) [2023-12-28 05:37:44,836][106225] Updated weights for policy 1, policy_version 1446045 (0.0008) [2023-12-28 05:37:44,851][106226] Updated weights for policy 0, policy_version 1442700 (0.0007) [2023-12-28 05:37:44,898][106225] Updated weights for policy 1, policy_version 1446055 (0.0008) [2023-12-28 05:37:44,915][106226] Updated weights for policy 0, policy_version 1442710 (0.0006) [2023-12-28 05:37:44,966][106225] Updated weights for policy 1, policy_version 1446065 (0.0008) [2023-12-28 05:37:44,982][106226] Updated weights for policy 0, policy_version 1442720 (0.0007) [2023-12-28 05:37:45,671][106225] Updated weights for policy 1, policy_version 1446075 (0.0009) [2023-12-28 05:37:45,734][106226] Updated weights for policy 0, policy_version 1442730 (0.0005) [2023-12-28 05:37:45,736][106225] Updated weights for policy 1, policy_version 1446085 (0.0008) [2023-12-28 05:37:45,790][106226] Updated weights for policy 0, policy_version 1442740 (0.0007) [2023-12-28 05:37:45,798][106225] Updated weights for policy 1, policy_version 1446095 (0.0009) [2023-12-28 05:37:45,847][106226] Updated weights for policy 0, policy_version 1442750 (0.0010) [2023-12-28 05:37:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 739672064. Throughput: 0: 9876.6, 1: 9869.6. Samples: 739662036. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:37:46,175][105115] Avg episode reward: [(0, '-5.098'), (1, '-4.694')] [2023-12-28 05:37:46,374][106225] Updated weights for policy 1, policy_version 1446105 (0.0011) [2023-12-28 05:37:46,436][106225] Updated weights for policy 1, policy_version 1446115 (0.0010) [2023-12-28 05:37:46,493][106225] Updated weights for policy 1, policy_version 1446125 (0.0010) [2023-12-28 05:37:46,500][106226] Updated weights for policy 0, policy_version 1442760 (0.0010) [2023-12-28 05:37:46,554][106225] Updated weights for policy 1, policy_version 1446135 (0.0010) [2023-12-28 05:37:46,561][106226] Updated weights for policy 0, policy_version 1442770 (0.0010) [2023-12-28 05:37:46,618][106226] Updated weights for policy 0, policy_version 1442780 (0.0007) [2023-12-28 05:37:47,149][106225] Updated weights for policy 1, policy_version 1446145 (0.0006) [2023-12-28 05:37:47,204][106225] Updated weights for policy 1, policy_version 1446155 (0.0005) [2023-12-28 05:37:47,269][106225] Updated weights for policy 1, policy_version 1446165 (0.0005) [2023-12-28 05:37:47,311][106226] Updated weights for policy 0, policy_version 1442790 (0.0010) [2023-12-28 05:37:47,355][106226] Updated weights for policy 0, policy_version 1442800 (0.0010) [2023-12-28 05:37:47,408][106226] Updated weights for policy 0, policy_version 1442810 (0.0011) [2023-12-28 05:37:47,811][106225] Updated weights for policy 1, policy_version 1446175 (0.0005) [2023-12-28 05:37:47,857][106225] Updated weights for policy 1, policy_version 1446185 (0.0005) [2023-12-28 05:37:47,914][106225] Updated weights for policy 1, policy_version 1446195 (0.0005) [2023-12-28 05:37:48,074][106226] Updated weights for policy 0, policy_version 1442820 (0.0008) [2023-12-28 05:37:48,147][106226] Updated weights for policy 0, policy_version 1442830 (0.0005) [2023-12-28 05:37:48,215][106226] Updated weights for policy 0, policy_version 1442840 (0.0005) [2023-12-28 05:37:48,550][106225] Updated weights for policy 1, policy_version 1446205 (0.0009) [2023-12-28 05:37:48,610][106225] Updated weights for policy 1, policy_version 1446215 (0.0007) [2023-12-28 05:37:48,672][106225] Updated weights for policy 1, policy_version 1446225 (0.0005) [2023-12-28 05:37:48,828][106226] Updated weights for policy 0, policy_version 1442850 (0.0005) [2023-12-28 05:37:48,895][106226] Updated weights for policy 0, policy_version 1442860 (0.0005) [2023-12-28 05:37:48,962][106226] Updated weights for policy 0, policy_version 1442870 (0.0005) [2023-12-28 05:37:49,029][106226] Updated weights for policy 0, policy_version 1442880 (0.0007) [2023-12-28 05:37:49,431][106225] Updated weights for policy 1, policy_version 1446235 (0.0007) [2023-12-28 05:37:49,497][106225] Updated weights for policy 1, policy_version 1446245 (0.0006) [2023-12-28 05:37:49,560][106225] Updated weights for policy 1, policy_version 1446255 (0.0008) [2023-12-28 05:37:49,647][106226] Updated weights for policy 0, policy_version 1442890 (0.0006) [2023-12-28 05:37:49,713][106226] Updated weights for policy 0, policy_version 1442900 (0.0007) [2023-12-28 05:37:49,773][106226] Updated weights for policy 0, policy_version 1442910 (0.0010) [2023-12-28 05:37:50,255][106225] Updated weights for policy 1, policy_version 1446265 (0.0008) [2023-12-28 05:37:50,315][106225] Updated weights for policy 1, policy_version 1446275 (0.0007) [2023-12-28 05:37:50,375][106225] Updated weights for policy 1, policy_version 1446285 (0.0007) [2023-12-28 05:37:50,425][106225] Updated weights for policy 1, policy_version 1446295 (0.0009) [2023-12-28 05:37:50,492][106226] Updated weights for policy 0, policy_version 1442920 (0.0008) [2023-12-28 05:37:50,547][106226] Updated weights for policy 0, policy_version 1442930 (0.0005) [2023-12-28 05:37:50,614][106226] Updated weights for policy 0, policy_version 1442940 (0.0008) [2023-12-28 05:37:51,105][106225] Updated weights for policy 1, policy_version 1446305 (0.0008) [2023-12-28 05:37:51,172][106225] Updated weights for policy 1, policy_version 1446315 (0.0008) [2023-12-28 05:37:51,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 739770368. Throughput: 0: 9928.4, 1: 9986.7. Samples: 739785096. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:37:51,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.691')] [2023-12-28 05:37:51,235][106225] Updated weights for policy 1, policy_version 1446325 (0.0007) [2023-12-28 05:37:51,384][106226] Updated weights for policy 0, policy_version 1442950 (0.0008) [2023-12-28 05:37:51,449][106226] Updated weights for policy 0, policy_version 1442960 (0.0008) [2023-12-28 05:37:51,515][106226] Updated weights for policy 0, policy_version 1442970 (0.0008) [2023-12-28 05:37:51,974][106225] Updated weights for policy 1, policy_version 1446335 (0.0009) [2023-12-28 05:37:52,041][106225] Updated weights for policy 1, policy_version 1446345 (0.0009) [2023-12-28 05:37:52,096][106225] Updated weights for policy 1, policy_version 1446355 (0.0005) [2023-12-28 05:37:52,170][106226] Updated weights for policy 0, policy_version 1442980 (0.0008) [2023-12-28 05:37:52,228][106226] Updated weights for policy 0, policy_version 1442990 (0.0008) [2023-12-28 05:37:52,287][106226] Updated weights for policy 0, policy_version 1443000 (0.0008) [2023-12-28 05:37:52,821][106225] Updated weights for policy 1, policy_version 1446365 (0.0008) [2023-12-28 05:37:52,874][106225] Updated weights for policy 1, policy_version 1446375 (0.0008) [2023-12-28 05:37:52,924][106225] Updated weights for policy 1, policy_version 1446385 (0.0008) [2023-12-28 05:37:52,938][106226] Updated weights for policy 0, policy_version 1443010 (0.0006) [2023-12-28 05:37:52,984][106226] Updated weights for policy 0, policy_version 1443020 (0.0006) [2023-12-28 05:37:53,041][106226] Updated weights for policy 0, policy_version 1443030 (0.0008) [2023-12-28 05:37:53,092][106226] Updated weights for policy 0, policy_version 1443040 (0.0007) [2023-12-28 05:37:53,701][106225] Updated weights for policy 1, policy_version 1446395 (0.0008) [2023-12-28 05:37:53,762][106225] Updated weights for policy 1, policy_version 1446405 (0.0009) [2023-12-28 05:37:53,818][106226] Updated weights for policy 0, policy_version 1443050 (0.0007) [2023-12-28 05:37:53,820][106225] Updated weights for policy 1, policy_version 1446415 (0.0006) [2023-12-28 05:37:53,865][106226] Updated weights for policy 0, policy_version 1443060 (0.0006) [2023-12-28 05:37:53,924][106226] Updated weights for policy 0, policy_version 1443070 (0.0007) [2023-12-28 05:37:54,426][106225] Updated weights for policy 1, policy_version 1446425 (0.0006) [2023-12-28 05:37:54,480][106225] Updated weights for policy 1, policy_version 1446435 (0.0010) [2023-12-28 05:37:54,533][106225] Updated weights for policy 1, policy_version 1446445 (0.0010) [2023-12-28 05:37:54,583][106225] Updated weights for policy 1, policy_version 1446455 (0.0010) [2023-12-28 05:37:54,589][106226] Updated weights for policy 0, policy_version 1443080 (0.0006) [2023-12-28 05:37:54,651][106226] Updated weights for policy 0, policy_version 1443090 (0.0007) [2023-12-28 05:37:54,707][106226] Updated weights for policy 0, policy_version 1443100 (0.0008) [2023-12-28 05:37:55,292][106225] Updated weights for policy 1, policy_version 1446465 (0.0010) [2023-12-28 05:37:55,347][106225] Updated weights for policy 1, policy_version 1446475 (0.0010) [2023-12-28 05:37:55,387][106226] Updated weights for policy 0, policy_version 1443110 (0.0006) [2023-12-28 05:37:55,398][106225] Updated weights for policy 1, policy_version 1446485 (0.0010) [2023-12-28 05:37:55,440][106226] Updated weights for policy 0, policy_version 1443120 (0.0006) [2023-12-28 05:37:55,497][106226] Updated weights for policy 0, policy_version 1443130 (0.0006) [2023-12-28 05:37:56,126][106225] Updated weights for policy 1, policy_version 1446495 (0.0011) [2023-12-28 05:37:56,131][106226] Updated weights for policy 0, policy_version 1443140 (0.0010) [2023-12-28 05:37:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 739868672. Throughput: 0: 9974.1, 1: 9960.4. Samples: 739843776. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:37:56,175][105115] Avg episode reward: [(0, '-4.851'), (1, '-4.678')] [2023-12-28 05:37:56,176][106225] Updated weights for policy 1, policy_version 1446505 (0.0010) [2023-12-28 05:37:56,198][106226] Updated weights for policy 0, policy_version 1443150 (0.0011) [2023-12-28 05:37:56,233][106225] Updated weights for policy 1, policy_version 1446515 (0.0006) [2023-12-28 05:37:56,263][106226] Updated weights for policy 0, policy_version 1443160 (0.0011) [2023-12-28 05:37:56,265][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001446520_370360320.pth... [2023-12-28 05:37:56,270][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001445336_370057216.pth [2023-12-28 05:37:56,315][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001443168_369524736.pth... [2023-12-28 05:37:56,319][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001441952_369213440.pth [2023-12-28 05:37:56,787][106226] Updated weights for policy 0, policy_version 1443170 (0.0005) [2023-12-28 05:37:56,847][106226] Updated weights for policy 0, policy_version 1443180 (0.0005) [2023-12-28 05:37:56,892][106225] Updated weights for policy 1, policy_version 1446525 (0.0005) [2023-12-28 05:37:56,898][106226] Updated weights for policy 0, policy_version 1443190 (0.0005) [2023-12-28 05:37:56,951][106226] Updated weights for policy 0, policy_version 1443200 (0.0005) [2023-12-28 05:37:56,956][106225] Updated weights for policy 1, policy_version 1446535 (0.0005) [2023-12-28 05:37:57,025][106225] Updated weights for policy 1, policy_version 1446545 (0.0005) [2023-12-28 05:37:57,495][106226] Updated weights for policy 0, policy_version 1443210 (0.0010) [2023-12-28 05:37:57,563][106226] Updated weights for policy 0, policy_version 1443220 (0.0009) [2023-12-28 05:37:57,574][106225] Updated weights for policy 1, policy_version 1446555 (0.0006) [2023-12-28 05:37:57,615][106226] Updated weights for policy 0, policy_version 1443230 (0.0008) [2023-12-28 05:37:57,643][106225] Updated weights for policy 1, policy_version 1446565 (0.0006) [2023-12-28 05:37:57,701][106225] Updated weights for policy 1, policy_version 1446575 (0.0009) [2023-12-28 05:37:58,190][106226] Updated weights for policy 0, policy_version 1443240 (0.0008) [2023-12-28 05:37:58,256][106226] Updated weights for policy 0, policy_version 1443250 (0.0008) [2023-12-28 05:37:58,307][106225] Updated weights for policy 1, policy_version 1446585 (0.0010) [2023-12-28 05:37:58,319][106226] Updated weights for policy 0, policy_version 1443260 (0.0007) [2023-12-28 05:37:58,394][106225] Updated weights for policy 1, policy_version 1446595 (0.0008) [2023-12-28 05:37:58,462][106225] Updated weights for policy 1, policy_version 1446605 (0.0007) [2023-12-28 05:37:58,516][106225] Updated weights for policy 1, policy_version 1446615 (0.0011) [2023-12-28 05:37:59,119][106226] Updated weights for policy 0, policy_version 1443270 (0.0008) [2023-12-28 05:37:59,175][106226] Updated weights for policy 0, policy_version 1443280 (0.0009) [2023-12-28 05:37:59,238][106226] Updated weights for policy 0, policy_version 1443290 (0.0011) [2023-12-28 05:37:59,356][106225] Updated weights for policy 1, policy_version 1446625 (0.0008) [2023-12-28 05:37:59,443][106225] Updated weights for policy 1, policy_version 1446635 (0.0009) [2023-12-28 05:37:59,509][106225] Updated weights for policy 1, policy_version 1446645 (0.0009) [2023-12-28 05:38:00,103][106226] Updated weights for policy 0, policy_version 1443300 (0.0008) [2023-12-28 05:38:00,164][106226] Updated weights for policy 0, policy_version 1443310 (0.0007) [2023-12-28 05:38:00,193][106225] Updated weights for policy 1, policy_version 1446655 (0.0006) [2023-12-28 05:38:00,220][106226] Updated weights for policy 0, policy_version 1443320 (0.0007) [2023-12-28 05:38:00,250][106225] Updated weights for policy 1, policy_version 1446665 (0.0006) [2023-12-28 05:38:00,309][106225] Updated weights for policy 1, policy_version 1446675 (0.0008) [2023-12-28 05:38:00,923][106226] Updated weights for policy 0, policy_version 1443330 (0.0006) [2023-12-28 05:38:00,951][106225] Updated weights for policy 1, policy_version 1446685 (0.0007) [2023-12-28 05:38:00,977][106226] Updated weights for policy 0, policy_version 1443340 (0.0007) [2023-12-28 05:38:00,999][106225] Updated weights for policy 1, policy_version 1446695 (0.0006) [2023-12-28 05:38:01,037][106226] Updated weights for policy 0, policy_version 1443350 (0.0008) [2023-12-28 05:38:01,059][106225] Updated weights for policy 1, policy_version 1446705 (0.0007) [2023-12-28 05:38:01,102][106226] Updated weights for policy 0, policy_version 1443360 (0.0009) [2023-12-28 05:38:01,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 739983360. Throughput: 0: 10102.8, 1: 9997.4. Samples: 739966832. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:01,175][105115] Avg episode reward: [(0, '-4.867'), (1, '-4.704')] [2023-12-28 05:38:01,803][106225] Updated weights for policy 1, policy_version 1446715 (0.0008) [2023-12-28 05:38:01,857][106225] Updated weights for policy 1, policy_version 1446725 (0.0007) [2023-12-28 05:38:01,884][106226] Updated weights for policy 0, policy_version 1443370 (0.0007) [2023-12-28 05:38:01,907][106225] Updated weights for policy 1, policy_version 1446735 (0.0007) [2023-12-28 05:38:01,937][106226] Updated weights for policy 0, policy_version 1443380 (0.0006) [2023-12-28 05:38:01,992][106226] Updated weights for policy 0, policy_version 1443390 (0.0009) [2023-12-28 05:38:02,562][106225] Updated weights for policy 1, policy_version 1446745 (0.0007) [2023-12-28 05:38:02,625][106225] Updated weights for policy 1, policy_version 1446755 (0.0009) [2023-12-28 05:38:02,687][106225] Updated weights for policy 1, policy_version 1446765 (0.0008) [2023-12-28 05:38:02,749][106225] Updated weights for policy 1, policy_version 1446775 (0.0009) [2023-12-28 05:38:02,758][106226] Updated weights for policy 0, policy_version 1443400 (0.0008) [2023-12-28 05:38:02,820][106226] Updated weights for policy 0, policy_version 1443410 (0.0006) [2023-12-28 05:38:02,887][106226] Updated weights for policy 0, policy_version 1443420 (0.0006) [2023-12-28 05:38:03,482][106225] Updated weights for policy 1, policy_version 1446785 (0.0008) [2023-12-28 05:38:03,544][106225] Updated weights for policy 1, policy_version 1446795 (0.0008) [2023-12-28 05:38:03,549][106226] Updated weights for policy 0, policy_version 1443430 (0.0009) [2023-12-28 05:38:03,598][106225] Updated weights for policy 1, policy_version 1446805 (0.0005) [2023-12-28 05:38:03,600][106226] Updated weights for policy 0, policy_version 1443440 (0.0006) [2023-12-28 05:38:03,650][106226] Updated weights for policy 0, policy_version 1443450 (0.0007) [2023-12-28 05:38:04,246][106225] Updated weights for policy 1, policy_version 1446815 (0.0008) [2023-12-28 05:38:04,303][106225] Updated weights for policy 1, policy_version 1446825 (0.0009) [2023-12-28 05:38:04,363][106225] Updated weights for policy 1, policy_version 1446835 (0.0008) [2023-12-28 05:38:04,443][106226] Updated weights for policy 0, policy_version 1443460 (0.0009) [2023-12-28 05:38:04,495][106226] Updated weights for policy 0, policy_version 1443470 (0.0008) [2023-12-28 05:38:04,543][106226] Updated weights for policy 0, policy_version 1443480 (0.0008) [2023-12-28 05:38:05,003][106225] Updated weights for policy 1, policy_version 1446845 (0.0009) [2023-12-28 05:38:05,054][106225] Updated weights for policy 1, policy_version 1446855 (0.0010) [2023-12-28 05:38:05,113][106225] Updated weights for policy 1, policy_version 1446865 (0.0010) [2023-12-28 05:38:05,299][106226] Updated weights for policy 0, policy_version 1443490 (0.0009) [2023-12-28 05:38:05,361][106226] Updated weights for policy 0, policy_version 1443500 (0.0008) [2023-12-28 05:38:05,421][106226] Updated weights for policy 0, policy_version 1443510 (0.0008) [2023-12-28 05:38:05,471][106226] Updated weights for policy 0, policy_version 1443520 (0.0008) [2023-12-28 05:38:05,847][106225] Updated weights for policy 1, policy_version 1446875 (0.0010) [2023-12-28 05:38:05,908][106225] Updated weights for policy 1, policy_version 1446885 (0.0010) [2023-12-28 05:38:05,966][106225] Updated weights for policy 1, policy_version 1446895 (0.0010) [2023-12-28 05:38:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 740073472. Throughput: 0: 10060.6, 1: 9996.1. Samples: 740083252. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:06,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.906')] [2023-12-28 05:38:06,230][106226] Updated weights for policy 0, policy_version 1443530 (0.0008) [2023-12-28 05:38:06,292][106226] Updated weights for policy 0, policy_version 1443540 (0.0007) [2023-12-28 05:38:06,351][106226] Updated weights for policy 0, policy_version 1443550 (0.0008) [2023-12-28 05:38:06,640][106225] Updated weights for policy 1, policy_version 1446905 (0.0010) [2023-12-28 05:38:06,700][106225] Updated weights for policy 1, policy_version 1446915 (0.0007) [2023-12-28 05:38:06,750][106225] Updated weights for policy 1, policy_version 1446925 (0.0005) [2023-12-28 05:38:06,807][106225] Updated weights for policy 1, policy_version 1446935 (0.0005) [2023-12-28 05:38:07,166][106226] Updated weights for policy 0, policy_version 1443560 (0.0009) [2023-12-28 05:38:07,219][106226] Updated weights for policy 0, policy_version 1443570 (0.0008) [2023-12-28 05:38:07,284][106226] Updated weights for policy 0, policy_version 1443580 (0.0008) [2023-12-28 05:38:07,425][106225] Updated weights for policy 1, policy_version 1446945 (0.0008) [2023-12-28 05:38:07,475][106225] Updated weights for policy 1, policy_version 1446955 (0.0009) [2023-12-28 05:38:07,526][106225] Updated weights for policy 1, policy_version 1446965 (0.0006) [2023-12-28 05:38:07,866][106226] Updated weights for policy 0, policy_version 1443590 (0.0009) [2023-12-28 05:38:07,926][106226] Updated weights for policy 0, policy_version 1443600 (0.0008) [2023-12-28 05:38:07,977][106226] Updated weights for policy 0, policy_version 1443610 (0.0008) [2023-12-28 05:38:08,195][106225] Updated weights for policy 1, policy_version 1446975 (0.0008) [2023-12-28 05:38:08,253][106225] Updated weights for policy 1, policy_version 1446985 (0.0007) [2023-12-28 05:38:08,317][106225] Updated weights for policy 1, policy_version 1446995 (0.0009) [2023-12-28 05:38:08,779][106226] Updated weights for policy 0, policy_version 1443620 (0.0009) [2023-12-28 05:38:08,846][106226] Updated weights for policy 0, policy_version 1443630 (0.0010) [2023-12-28 05:38:08,909][106226] Updated weights for policy 0, policy_version 1443640 (0.0008) [2023-12-28 05:38:08,985][106225] Updated weights for policy 1, policy_version 1447005 (0.0008) [2023-12-28 05:38:09,036][106225] Updated weights for policy 1, policy_version 1447015 (0.0008) [2023-12-28 05:38:09,098][106225] Updated weights for policy 1, policy_version 1447025 (0.0008) [2023-12-28 05:38:09,650][106226] Updated weights for policy 0, policy_version 1443650 (0.0009) [2023-12-28 05:38:09,719][106226] Updated weights for policy 0, policy_version 1443660 (0.0011) [2023-12-28 05:38:09,788][106226] Updated weights for policy 0, policy_version 1443670 (0.0011) [2023-12-28 05:38:09,825][106225] Updated weights for policy 1, policy_version 1447035 (0.0008) [2023-12-28 05:38:09,857][106226] Updated weights for policy 0, policy_version 1443680 (0.0010) [2023-12-28 05:38:09,885][106225] Updated weights for policy 1, policy_version 1447045 (0.0008) [2023-12-28 05:38:09,957][106225] Updated weights for policy 1, policy_version 1447055 (0.0011) [2023-12-28 05:38:10,600][106226] Updated weights for policy 0, policy_version 1443690 (0.0006) [2023-12-28 05:38:10,655][106226] Updated weights for policy 0, policy_version 1443700 (0.0005) [2023-12-28 05:38:10,713][106226] Updated weights for policy 0, policy_version 1443710 (0.0006) [2023-12-28 05:38:10,715][106225] Updated weights for policy 1, policy_version 1447065 (0.0011) [2023-12-28 05:38:10,763][106225] Updated weights for policy 1, policy_version 1447075 (0.0010) [2023-12-28 05:38:10,813][106225] Updated weights for policy 1, policy_version 1447085 (0.0010) [2023-12-28 05:38:10,874][106225] Updated weights for policy 1, policy_version 1447095 (0.0010) [2023-12-28 05:38:11,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 740171776. Throughput: 0: 10048.1, 1: 10079.2. Samples: 740142360. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:11,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.870')] [2023-12-28 05:38:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001447096_370507776.pth... [2023-12-28 05:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001443712_369664000.pth... [2023-12-28 05:38:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001442560_369369088.pth [2023-12-28 05:38:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001445912_370204672.pth [2023-12-28 05:38:11,411][106226] Updated weights for policy 0, policy_version 1443720 (0.0007) [2023-12-28 05:38:11,475][106226] Updated weights for policy 0, policy_version 1443730 (0.0008) [2023-12-28 05:38:11,541][106226] Updated weights for policy 0, policy_version 1443740 (0.0006) [2023-12-28 05:38:11,628][106225] Updated weights for policy 1, policy_version 1447105 (0.0010) [2023-12-28 05:38:11,688][106225] Updated weights for policy 1, policy_version 1447115 (0.0009) [2023-12-28 05:38:11,755][106225] Updated weights for policy 1, policy_version 1447125 (0.0010) [2023-12-28 05:38:12,271][106226] Updated weights for policy 0, policy_version 1443750 (0.0008) [2023-12-28 05:38:12,337][106226] Updated weights for policy 0, policy_version 1443760 (0.0009) [2023-12-28 05:38:12,408][106226] Updated weights for policy 0, policy_version 1443770 (0.0009) [2023-12-28 05:38:12,523][106225] Updated weights for policy 1, policy_version 1447135 (0.0010) [2023-12-28 05:38:12,583][106225] Updated weights for policy 1, policy_version 1447145 (0.0010) [2023-12-28 05:38:12,644][106225] Updated weights for policy 1, policy_version 1447155 (0.0010) [2023-12-28 05:38:13,074][106226] Updated weights for policy 0, policy_version 1443780 (0.0008) [2023-12-28 05:38:13,135][106226] Updated weights for policy 0, policy_version 1443790 (0.0008) [2023-12-28 05:38:13,186][106226] Updated weights for policy 0, policy_version 1443800 (0.0008) [2023-12-28 05:38:13,353][106225] Updated weights for policy 1, policy_version 1447165 (0.0009) [2023-12-28 05:38:13,415][106225] Updated weights for policy 1, policy_version 1447175 (0.0008) [2023-12-28 05:38:13,471][106225] Updated weights for policy 1, policy_version 1447185 (0.0008) [2023-12-28 05:38:13,892][106226] Updated weights for policy 0, policy_version 1443810 (0.0007) [2023-12-28 05:38:13,957][106226] Updated weights for policy 0, policy_version 1443820 (0.0008) [2023-12-28 05:38:14,008][106226] Updated weights for policy 0, policy_version 1443830 (0.0009) [2023-12-28 05:38:14,061][106226] Updated weights for policy 0, policy_version 1443840 (0.0009) [2023-12-28 05:38:14,141][106225] Updated weights for policy 1, policy_version 1447195 (0.0009) [2023-12-28 05:38:14,187][106225] Updated weights for policy 1, policy_version 1447205 (0.0010) [2023-12-28 05:38:14,234][106225] Updated weights for policy 1, policy_version 1447215 (0.0009) [2023-12-28 05:38:14,784][106226] Updated weights for policy 0, policy_version 1443850 (0.0008) [2023-12-28 05:38:14,848][106226] Updated weights for policy 0, policy_version 1443860 (0.0008) [2023-12-28 05:38:14,913][106226] Updated weights for policy 0, policy_version 1443870 (0.0009) [2023-12-28 05:38:14,976][106225] Updated weights for policy 1, policy_version 1447225 (0.0008) [2023-12-28 05:38:15,032][106225] Updated weights for policy 1, policy_version 1447235 (0.0009) [2023-12-28 05:38:15,081][106225] Updated weights for policy 1, policy_version 1447245 (0.0008) [2023-12-28 05:38:15,143][106225] Updated weights for policy 1, policy_version 1447255 (0.0009) [2023-12-28 05:38:15,664][106226] Updated weights for policy 0, policy_version 1443880 (0.0009) [2023-12-28 05:38:15,715][106226] Updated weights for policy 0, policy_version 1443890 (0.0008) [2023-12-28 05:38:15,770][106226] Updated weights for policy 0, policy_version 1443900 (0.0009) [2023-12-28 05:38:15,836][106225] Updated weights for policy 1, policy_version 1447265 (0.0006) [2023-12-28 05:38:15,884][106225] Updated weights for policy 1, policy_version 1447275 (0.0005) [2023-12-28 05:38:15,932][106225] Updated weights for policy 1, policy_version 1447285 (0.0005) [2023-12-28 05:38:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 740270080. Throughput: 0: 9941.7, 1: 9893.2. Samples: 740257776. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:16,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.754')] [2023-12-28 05:38:16,540][106226] Updated weights for policy 0, policy_version 1443910 (0.0008) [2023-12-28 05:38:16,554][106225] Updated weights for policy 1, policy_version 1447295 (0.0006) [2023-12-28 05:38:16,592][106226] Updated weights for policy 0, policy_version 1443920 (0.0007) [2023-12-28 05:38:16,609][106225] Updated weights for policy 1, policy_version 1447305 (0.0007) [2023-12-28 05:38:16,647][106226] Updated weights for policy 0, policy_version 1443930 (0.0007) [2023-12-28 05:38:16,661][106225] Updated weights for policy 1, policy_version 1447315 (0.0009) [2023-12-28 05:38:17,374][106225] Updated weights for policy 1, policy_version 1447325 (0.0007) [2023-12-28 05:38:17,403][106226] Updated weights for policy 0, policy_version 1443940 (0.0006) [2023-12-28 05:38:17,436][106225] Updated weights for policy 1, policy_version 1447335 (0.0007) [2023-12-28 05:38:17,458][106226] Updated weights for policy 0, policy_version 1443950 (0.0006) [2023-12-28 05:38:17,497][106225] Updated weights for policy 1, policy_version 1447345 (0.0010) [2023-12-28 05:38:17,516][106226] Updated weights for policy 0, policy_version 1443960 (0.0006) [2023-12-28 05:38:18,086][106226] Updated weights for policy 0, policy_version 1443970 (0.0005) [2023-12-28 05:38:18,140][106226] Updated weights for policy 0, policy_version 1443980 (0.0005) [2023-12-28 05:38:18,197][106226] Updated weights for policy 0, policy_version 1443990 (0.0005) [2023-12-28 05:38:18,215][106225] Updated weights for policy 1, policy_version 1447355 (0.0008) [2023-12-28 05:38:18,261][106226] Updated weights for policy 0, policy_version 1444000 (0.0005) [2023-12-28 05:38:18,276][106225] Updated weights for policy 1, policy_version 1447365 (0.0007) [2023-12-28 05:38:18,332][106225] Updated weights for policy 1, policy_version 1447375 (0.0007) [2023-12-28 05:38:18,863][106226] Updated weights for policy 0, policy_version 1444010 (0.0010) [2023-12-28 05:38:18,918][106226] Updated weights for policy 0, policy_version 1444020 (0.0008) [2023-12-28 05:38:18,969][106226] Updated weights for policy 0, policy_version 1444030 (0.0009) [2023-12-28 05:38:19,021][106225] Updated weights for policy 1, policy_version 1447385 (0.0007) [2023-12-28 05:38:19,081][106225] Updated weights for policy 1, policy_version 1447395 (0.0005) [2023-12-28 05:38:19,135][106225] Updated weights for policy 1, policy_version 1447405 (0.0007) [2023-12-28 05:38:19,200][106225] Updated weights for policy 1, policy_version 1447415 (0.0008) [2023-12-28 05:38:19,795][106226] Updated weights for policy 0, policy_version 1444040 (0.0009) [2023-12-28 05:38:19,859][106226] Updated weights for policy 0, policy_version 1444050 (0.0009) [2023-12-28 05:38:19,922][106226] Updated weights for policy 0, policy_version 1444060 (0.0007) [2023-12-28 05:38:19,923][106225] Updated weights for policy 1, policy_version 1447425 (0.0008) [2023-12-28 05:38:19,989][106225] Updated weights for policy 1, policy_version 1447435 (0.0008) [2023-12-28 05:38:20,048][106225] Updated weights for policy 1, policy_version 1447445 (0.0009) [2023-12-28 05:38:20,611][106226] Updated weights for policy 0, policy_version 1444070 (0.0009) [2023-12-28 05:38:20,675][106226] Updated weights for policy 0, policy_version 1444080 (0.0009) [2023-12-28 05:38:20,739][106226] Updated weights for policy 0, policy_version 1444090 (0.0008) [2023-12-28 05:38:20,857][106225] Updated weights for policy 1, policy_version 1447455 (0.0009) [2023-12-28 05:38:20,912][106225] Updated weights for policy 1, policy_version 1447465 (0.0009) [2023-12-28 05:38:20,970][106225] Updated weights for policy 1, policy_version 1447475 (0.0010) [2023-12-28 05:38:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 740368384. Throughput: 0: 9901.9, 1: 9890.5. Samples: 740376224. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:21,175][105115] Avg episode reward: [(0, '-4.798'), (1, '-4.637')] [2023-12-28 05:38:21,433][106226] Updated weights for policy 0, policy_version 1444100 (0.0008) [2023-12-28 05:38:21,496][106226] Updated weights for policy 0, policy_version 1444110 (0.0008) [2023-12-28 05:38:21,562][106226] Updated weights for policy 0, policy_version 1444120 (0.0007) [2023-12-28 05:38:21,840][106225] Updated weights for policy 1, policy_version 1447485 (0.0010) [2023-12-28 05:38:21,898][106225] Updated weights for policy 1, policy_version 1447495 (0.0011) [2023-12-28 05:38:21,961][106225] Updated weights for policy 1, policy_version 1447505 (0.0011) [2023-12-28 05:38:22,271][106226] Updated weights for policy 0, policy_version 1444130 (0.0009) [2023-12-28 05:38:22,338][106226] Updated weights for policy 0, policy_version 1444140 (0.0011) [2023-12-28 05:38:22,400][106226] Updated weights for policy 0, policy_version 1444150 (0.0011) [2023-12-28 05:38:22,462][106226] Updated weights for policy 0, policy_version 1444160 (0.0008) [2023-12-28 05:38:22,696][106225] Updated weights for policy 1, policy_version 1447515 (0.0011) [2023-12-28 05:38:22,760][106225] Updated weights for policy 1, policy_version 1447525 (0.0011) [2023-12-28 05:38:22,821][106225] Updated weights for policy 1, policy_version 1447535 (0.0010) [2023-12-28 05:38:23,070][106226] Updated weights for policy 0, policy_version 1444170 (0.0010) [2023-12-28 05:38:23,124][106226] Updated weights for policy 0, policy_version 1444180 (0.0011) [2023-12-28 05:38:23,185][106226] Updated weights for policy 0, policy_version 1444190 (0.0011) [2023-12-28 05:38:23,501][106225] Updated weights for policy 1, policy_version 1447545 (0.0010) [2023-12-28 05:38:23,556][106225] Updated weights for policy 1, policy_version 1447555 (0.0010) [2023-12-28 05:38:23,617][106225] Updated weights for policy 1, policy_version 1447565 (0.0011) [2023-12-28 05:38:23,674][106225] Updated weights for policy 1, policy_version 1447575 (0.0010) [2023-12-28 05:38:23,853][106226] Updated weights for policy 0, policy_version 1444200 (0.0008) [2023-12-28 05:38:23,905][106226] Updated weights for policy 0, policy_version 1444210 (0.0005) [2023-12-28 05:38:23,958][106226] Updated weights for policy 0, policy_version 1444220 (0.0010) [2023-12-28 05:38:24,414][106225] Updated weights for policy 1, policy_version 1447585 (0.0008) [2023-12-28 05:38:24,469][106225] Updated weights for policy 1, policy_version 1447595 (0.0008) [2023-12-28 05:38:24,515][106225] Updated weights for policy 1, policy_version 1447605 (0.0007) [2023-12-28 05:38:24,671][106226] Updated weights for policy 0, policy_version 1444230 (0.0009) [2023-12-28 05:38:24,739][106226] Updated weights for policy 0, policy_version 1444240 (0.0005) [2023-12-28 05:38:24,800][106226] Updated weights for policy 0, policy_version 1444250 (0.0007) [2023-12-28 05:38:25,156][106225] Updated weights for policy 1, policy_version 1447615 (0.0006) [2023-12-28 05:38:25,216][106225] Updated weights for policy 1, policy_version 1447625 (0.0005) [2023-12-28 05:38:25,276][106225] Updated weights for policy 1, policy_version 1447635 (0.0005) [2023-12-28 05:38:25,460][106226] Updated weights for policy 0, policy_version 1444260 (0.0008) [2023-12-28 05:38:25,513][106226] Updated weights for policy 0, policy_version 1444270 (0.0005) [2023-12-28 05:38:25,570][106226] Updated weights for policy 0, policy_version 1444280 (0.0010) [2023-12-28 05:38:25,915][106225] Updated weights for policy 1, policy_version 1447645 (0.0008) [2023-12-28 05:38:25,974][106225] Updated weights for policy 1, policy_version 1447655 (0.0010) [2023-12-28 05:38:26,030][106225] Updated weights for policy 1, policy_version 1447665 (0.0010) [2023-12-28 05:38:26,143][106226] Updated weights for policy 0, policy_version 1444290 (0.0009) [2023-12-28 05:38:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 740466688. Throughput: 0: 9924.5, 1: 9855.1. Samples: 740434116. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:26,176][105115] Avg episode reward: [(0, '-4.737'), (1, '-4.814')] [2023-12-28 05:38:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001447672_370655232.pth... [2023-12-28 05:38:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001446520_370360320.pth [2023-12-28 05:38:26,197][106226] Updated weights for policy 0, policy_version 1444300 (0.0005) [2023-12-28 05:38:26,257][106226] Updated weights for policy 0, policy_version 1444310 (0.0006) [2023-12-28 05:38:26,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001444320_369819648.pth... [2023-12-28 05:38:26,313][106226] Updated weights for policy 0, policy_version 1444320 (0.0007) [2023-12-28 05:38:26,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001443168_369524736.pth [2023-12-28 05:38:26,724][106225] Updated weights for policy 1, policy_version 1447675 (0.0009) [2023-12-28 05:38:26,777][106225] Updated weights for policy 1, policy_version 1447685 (0.0007) [2023-12-28 05:38:26,823][106225] Updated weights for policy 1, policy_version 1447695 (0.0008) [2023-12-28 05:38:26,919][106226] Updated weights for policy 0, policy_version 1444330 (0.0005) [2023-12-28 05:38:26,977][106226] Updated weights for policy 0, policy_version 1444340 (0.0006) [2023-12-28 05:38:27,032][106226] Updated weights for policy 0, policy_version 1444350 (0.0006) [2023-12-28 05:38:27,517][106225] Updated weights for policy 1, policy_version 1447705 (0.0007) [2023-12-28 05:38:27,575][106225] Updated weights for policy 1, policy_version 1447715 (0.0006) [2023-12-28 05:38:27,634][106225] Updated weights for policy 1, policy_version 1447725 (0.0010) [2023-12-28 05:38:27,689][106225] Updated weights for policy 1, policy_version 1447735 (0.0009) [2023-12-28 05:38:27,694][106226] Updated weights for policy 0, policy_version 1444360 (0.0007) [2023-12-28 05:38:27,743][106226] Updated weights for policy 0, policy_version 1444370 (0.0008) [2023-12-28 05:38:27,793][106226] Updated weights for policy 0, policy_version 1444380 (0.0009) [2023-12-28 05:38:28,215][106225] Updated weights for policy 1, policy_version 1447745 (0.0005) [2023-12-28 05:38:28,275][106225] Updated weights for policy 1, policy_version 1447755 (0.0006) [2023-12-28 05:38:28,339][106225] Updated weights for policy 1, policy_version 1447765 (0.0007) [2023-12-28 05:38:28,373][106226] Updated weights for policy 0, policy_version 1444390 (0.0007) [2023-12-28 05:38:28,434][106226] Updated weights for policy 0, policy_version 1444400 (0.0009) [2023-12-28 05:38:28,489][106226] Updated weights for policy 0, policy_version 1444410 (0.0008) [2023-12-28 05:38:28,928][106225] Updated weights for policy 1, policy_version 1447775 (0.0007) [2023-12-28 05:38:28,981][106225] Updated weights for policy 1, policy_version 1447785 (0.0005) [2023-12-28 05:38:29,043][106225] Updated weights for policy 1, policy_version 1447795 (0.0005) [2023-12-28 05:38:29,260][106226] Updated weights for policy 0, policy_version 1444420 (0.0008) [2023-12-28 05:38:29,321][106226] Updated weights for policy 0, policy_version 1444430 (0.0006) [2023-12-28 05:38:29,392][106226] Updated weights for policy 0, policy_version 1444440 (0.0009) [2023-12-28 05:38:29,785][106225] Updated weights for policy 1, policy_version 1447805 (0.0008) [2023-12-28 05:38:29,852][106225] Updated weights for policy 1, policy_version 1447815 (0.0009) [2023-12-28 05:38:29,903][106225] Updated weights for policy 1, policy_version 1447825 (0.0008) [2023-12-28 05:38:30,018][106226] Updated weights for policy 0, policy_version 1444450 (0.0008) [2023-12-28 05:38:30,073][106226] Updated weights for policy 0, policy_version 1444460 (0.0007) [2023-12-28 05:38:30,137][106226] Updated weights for policy 0, policy_version 1444470 (0.0009) [2023-12-28 05:38:30,183][106226] Updated weights for policy 0, policy_version 1444480 (0.0010) [2023-12-28 05:38:30,582][106225] Updated weights for policy 1, policy_version 1447835 (0.0007) [2023-12-28 05:38:30,634][106225] Updated weights for policy 1, policy_version 1447845 (0.0005) [2023-12-28 05:38:30,684][106225] Updated weights for policy 1, policy_version 1447855 (0.0005) [2023-12-28 05:38:30,907][106226] Updated weights for policy 0, policy_version 1444490 (0.0007) [2023-12-28 05:38:30,957][106226] Updated weights for policy 0, policy_version 1444500 (0.0010) [2023-12-28 05:38:31,006][106226] Updated weights for policy 0, policy_version 1444510 (0.0010) [2023-12-28 05:38:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 740573184. Throughput: 0: 9979.1, 1: 9996.8. Samples: 740560952. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:31,175][105115] Avg episode reward: [(0, '-5.070'), (1, '-4.847')] [2023-12-28 05:38:31,376][106225] Updated weights for policy 1, policy_version 1447865 (0.0006) [2023-12-28 05:38:31,446][106225] Updated weights for policy 1, policy_version 1447875 (0.0009) [2023-12-28 05:38:31,515][106225] Updated weights for policy 1, policy_version 1447885 (0.0010) [2023-12-28 05:38:31,578][106225] Updated weights for policy 1, policy_version 1447895 (0.0010) [2023-12-28 05:38:31,764][106226] Updated weights for policy 0, policy_version 1444520 (0.0010) [2023-12-28 05:38:31,825][106226] Updated weights for policy 0, policy_version 1444530 (0.0011) [2023-12-28 05:38:31,891][106226] Updated weights for policy 0, policy_version 1444540 (0.0011) [2023-12-28 05:38:32,289][106225] Updated weights for policy 1, policy_version 1447905 (0.0010) [2023-12-28 05:38:32,351][106225] Updated weights for policy 1, policy_version 1447915 (0.0010) [2023-12-28 05:38:32,408][106225] Updated weights for policy 1, policy_version 1447925 (0.0009) [2023-12-28 05:38:32,527][106226] Updated weights for policy 0, policy_version 1444550 (0.0011) [2023-12-28 05:38:32,578][106226] Updated weights for policy 0, policy_version 1444560 (0.0010) [2023-12-28 05:38:32,629][106226] Updated weights for policy 0, policy_version 1444570 (0.0009) [2023-12-28 05:38:33,126][106225] Updated weights for policy 1, policy_version 1447935 (0.0010) [2023-12-28 05:38:33,183][106225] Updated weights for policy 1, policy_version 1447945 (0.0010) [2023-12-28 05:38:33,214][106226] Updated weights for policy 0, policy_version 1444580 (0.0006) [2023-12-28 05:38:33,240][106225] Updated weights for policy 1, policy_version 1447955 (0.0010) [2023-12-28 05:38:33,278][106226] Updated weights for policy 0, policy_version 1444590 (0.0011) [2023-12-28 05:38:33,341][106226] Updated weights for policy 0, policy_version 1444600 (0.0010) [2023-12-28 05:38:33,944][106225] Updated weights for policy 1, policy_version 1447965 (0.0010) [2023-12-28 05:38:33,997][106225] Updated weights for policy 1, policy_version 1447975 (0.0010) [2023-12-28 05:38:34,019][106226] Updated weights for policy 0, policy_version 1444610 (0.0010) [2023-12-28 05:38:34,053][106225] Updated weights for policy 1, policy_version 1447985 (0.0010) [2023-12-28 05:38:34,072][106226] Updated weights for policy 0, policy_version 1444620 (0.0009) [2023-12-28 05:38:34,131][106226] Updated weights for policy 0, policy_version 1444630 (0.0007) [2023-12-28 05:38:34,199][106226] Updated weights for policy 0, policy_version 1444640 (0.0007) [2023-12-28 05:38:34,805][106225] Updated weights for policy 1, policy_version 1447995 (0.0010) [2023-12-28 05:38:34,854][106225] Updated weights for policy 1, policy_version 1448005 (0.0010) [2023-12-28 05:38:34,855][106226] Updated weights for policy 0, policy_version 1444650 (0.0010) [2023-12-28 05:38:34,901][106225] Updated weights for policy 1, policy_version 1448015 (0.0010) [2023-12-28 05:38:34,905][106226] Updated weights for policy 0, policy_version 1444660 (0.0010) [2023-12-28 05:38:34,963][106226] Updated weights for policy 0, policy_version 1444670 (0.0011) [2023-12-28 05:38:35,636][106225] Updated weights for policy 1, policy_version 1448025 (0.0010) [2023-12-28 05:38:35,679][106226] Updated weights for policy 0, policy_version 1444680 (0.0010) [2023-12-28 05:38:35,694][106225] Updated weights for policy 1, policy_version 1448035 (0.0008) [2023-12-28 05:38:35,722][106226] Updated weights for policy 0, policy_version 1444690 (0.0010) [2023-12-28 05:38:35,748][106225] Updated weights for policy 1, policy_version 1448045 (0.0010) [2023-12-28 05:38:35,778][106226] Updated weights for policy 0, policy_version 1444700 (0.0010) [2023-12-28 05:38:35,808][106225] Updated weights for policy 1, policy_version 1448055 (0.0010) [2023-12-28 05:38:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 740671488. Throughput: 0: 9986.1, 1: 9903.6. Samples: 740680136. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:36,175][105115] Avg episode reward: [(0, '-4.850'), (1, '-4.763')] [2023-12-28 05:38:36,503][106226] Updated weights for policy 0, policy_version 1444710 (0.0011) [2023-12-28 05:38:36,542][106225] Updated weights for policy 1, policy_version 1448065 (0.0008) [2023-12-28 05:38:36,566][106226] Updated weights for policy 0, policy_version 1444720 (0.0011) [2023-12-28 05:38:36,604][106225] Updated weights for policy 1, policy_version 1448075 (0.0009) [2023-12-28 05:38:36,623][106226] Updated weights for policy 0, policy_version 1444730 (0.0011) [2023-12-28 05:38:36,666][106225] Updated weights for policy 1, policy_version 1448085 (0.0010) [2023-12-28 05:38:37,340][106226] Updated weights for policy 0, policy_version 1444740 (0.0010) [2023-12-28 05:38:37,368][106225] Updated weights for policy 1, policy_version 1448095 (0.0006) [2023-12-28 05:38:37,394][106226] Updated weights for policy 0, policy_version 1444750 (0.0006) [2023-12-28 05:38:37,418][106225] Updated weights for policy 1, policy_version 1448105 (0.0005) [2023-12-28 05:38:37,457][106226] Updated weights for policy 0, policy_version 1444760 (0.0006) [2023-12-28 05:38:37,478][106225] Updated weights for policy 1, policy_version 1448115 (0.0008) [2023-12-28 05:38:38,119][106225] Updated weights for policy 1, policy_version 1448125 (0.0007) [2023-12-28 05:38:38,138][106226] Updated weights for policy 0, policy_version 1444770 (0.0009) [2023-12-28 05:38:38,176][106225] Updated weights for policy 1, policy_version 1448135 (0.0005) [2023-12-28 05:38:38,197][106226] Updated weights for policy 0, policy_version 1444780 (0.0010) [2023-12-28 05:38:38,229][106225] Updated weights for policy 1, policy_version 1448145 (0.0006) [2023-12-28 05:38:38,260][106226] Updated weights for policy 0, policy_version 1444790 (0.0011) [2023-12-28 05:38:38,320][106226] Updated weights for policy 0, policy_version 1444800 (0.0010) [2023-12-28 05:38:38,883][106225] Updated weights for policy 1, policy_version 1448155 (0.0009) [2023-12-28 05:38:38,937][106225] Updated weights for policy 1, policy_version 1448165 (0.0008) [2023-12-28 05:38:38,985][106225] Updated weights for policy 1, policy_version 1448175 (0.0007) [2023-12-28 05:38:39,024][106226] Updated weights for policy 0, policy_version 1444810 (0.0011) [2023-12-28 05:38:39,089][106226] Updated weights for policy 0, policy_version 1444820 (0.0010) [2023-12-28 05:38:39,152][106226] Updated weights for policy 0, policy_version 1444830 (0.0010) [2023-12-28 05:38:39,736][106225] Updated weights for policy 1, policy_version 1448185 (0.0009) [2023-12-28 05:38:39,800][106225] Updated weights for policy 1, policy_version 1448195 (0.0008) [2023-12-28 05:38:39,835][106226] Updated weights for policy 0, policy_version 1444840 (0.0008) [2023-12-28 05:38:39,877][106225] Updated weights for policy 1, policy_version 1448205 (0.0008) [2023-12-28 05:38:39,904][106226] Updated weights for policy 0, policy_version 1444850 (0.0008) [2023-12-28 05:38:39,947][106225] Updated weights for policy 1, policy_version 1448215 (0.0008) [2023-12-28 05:38:39,983][106226] Updated weights for policy 0, policy_version 1444860 (0.0007) [2023-12-28 05:38:40,687][106225] Updated weights for policy 1, policy_version 1448225 (0.0006) [2023-12-28 05:38:40,688][106226] Updated weights for policy 0, policy_version 1444870 (0.0007) [2023-12-28 05:38:40,743][106225] Updated weights for policy 1, policy_version 1448235 (0.0005) [2023-12-28 05:38:40,747][106226] Updated weights for policy 0, policy_version 1444880 (0.0007) [2023-12-28 05:38:40,802][106225] Updated weights for policy 1, policy_version 1448245 (0.0008) [2023-12-28 05:38:40,819][106226] Updated weights for policy 0, policy_version 1444890 (0.0006) [2023-12-28 05:38:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 740769792. Throughput: 0: 9965.6, 1: 9948.6. Samples: 740739916. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:41,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-4.952')] [2023-12-28 05:38:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001448248_370802688.pth... [2023-12-28 05:38:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001444896_369967104.pth... [2023-12-28 05:38:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001447096_370507776.pth [2023-12-28 05:38:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001443712_369664000.pth [2023-12-28 05:38:41,568][106225] Updated weights for policy 1, policy_version 1448255 (0.0007) [2023-12-28 05:38:41,586][106226] Updated weights for policy 0, policy_version 1444900 (0.0007) [2023-12-28 05:38:41,635][106225] Updated weights for policy 1, policy_version 1448266 (0.0008) [2023-12-28 05:38:41,656][106226] Updated weights for policy 0, policy_version 1444910 (0.0007) [2023-12-28 05:38:41,698][106225] Updated weights for policy 1, policy_version 1448276 (0.0007) [2023-12-28 05:38:41,717][106226] Updated weights for policy 0, policy_version 1444920 (0.0007) [2023-12-28 05:38:42,475][106226] Updated weights for policy 0, policy_version 1444930 (0.0006) [2023-12-28 05:38:42,484][106225] Updated weights for policy 1, policy_version 1448286 (0.0008) [2023-12-28 05:38:42,531][106226] Updated weights for policy 0, policy_version 1444940 (0.0007) [2023-12-28 05:38:42,551][106225] Updated weights for policy 1, policy_version 1448296 (0.0009) [2023-12-28 05:38:42,595][106226] Updated weights for policy 0, policy_version 1444950 (0.0007) [2023-12-28 05:38:42,615][106225] Updated weights for policy 1, policy_version 1448306 (0.0008) [2023-12-28 05:38:42,652][106226] Updated weights for policy 0, policy_version 1444960 (0.0008) [2023-12-28 05:38:43,234][106226] Updated weights for policy 0, policy_version 1444970 (0.0006) [2023-12-28 05:38:43,302][106226] Updated weights for policy 0, policy_version 1444980 (0.0005) [2023-12-28 05:38:43,365][106225] Updated weights for policy 1, policy_version 1448316 (0.0008) [2023-12-28 05:38:43,367][106226] Updated weights for policy 0, policy_version 1444990 (0.0006) [2023-12-28 05:38:43,410][106225] Updated weights for policy 1, policy_version 1448326 (0.0007) [2023-12-28 05:38:43,463][106225] Updated weights for policy 1, policy_version 1448336 (0.0008) [2023-12-28 05:38:43,877][106226] Updated weights for policy 0, policy_version 1445000 (0.0009) [2023-12-28 05:38:43,926][106226] Updated weights for policy 0, policy_version 1445010 (0.0008) [2023-12-28 05:38:43,972][106226] Updated weights for policy 0, policy_version 1445020 (0.0008) [2023-12-28 05:38:44,265][106225] Updated weights for policy 1, policy_version 1448346 (0.0007) [2023-12-28 05:38:44,319][106225] Updated weights for policy 1, policy_version 1448356 (0.0008) [2023-12-28 05:38:44,380][106225] Updated weights for policy 1, policy_version 1448366 (0.0008) [2023-12-28 05:38:44,437][106225] Updated weights for policy 1, policy_version 1448376 (0.0008) [2023-12-28 05:38:44,673][106226] Updated weights for policy 0, policy_version 1445030 (0.0007) [2023-12-28 05:38:44,721][106226] Updated weights for policy 0, policy_version 1445040 (0.0007) [2023-12-28 05:38:44,773][106226] Updated weights for policy 0, policy_version 1445050 (0.0007) [2023-12-28 05:38:45,123][106225] Updated weights for policy 1, policy_version 1448386 (0.0009) [2023-12-28 05:38:45,175][106225] Updated weights for policy 1, policy_version 1448396 (0.0008) [2023-12-28 05:38:45,238][106225] Updated weights for policy 1, policy_version 1448406 (0.0009) [2023-12-28 05:38:45,577][106226] Updated weights for policy 0, policy_version 1445060 (0.0008) [2023-12-28 05:38:45,626][106226] Updated weights for policy 0, policy_version 1445070 (0.0006) [2023-12-28 05:38:45,686][106226] Updated weights for policy 0, policy_version 1445080 (0.0010) [2023-12-28 05:38:45,869][106225] Updated weights for policy 1, policy_version 1448416 (0.0006) [2023-12-28 05:38:45,924][106225] Updated weights for policy 1, policy_version 1448426 (0.0006) [2023-12-28 05:38:45,975][106225] Updated weights for policy 1, policy_version 1448436 (0.0010) [2023-12-28 05:38:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 740868096. Throughput: 0: 9918.4, 1: 9814.4. Samples: 740854808. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:46,175][105115] Avg episode reward: [(0, '-4.976'), (1, '-4.382')] [2023-12-28 05:38:46,413][106226] Updated weights for policy 0, policy_version 1445090 (0.0010) [2023-12-28 05:38:46,473][106226] Updated weights for policy 0, policy_version 1445100 (0.0011) [2023-12-28 05:38:46,520][106226] Updated weights for policy 0, policy_version 1445110 (0.0010) [2023-12-28 05:38:46,577][106226] Updated weights for policy 0, policy_version 1445120 (0.0007) [2023-12-28 05:38:46,614][106225] Updated weights for policy 1, policy_version 1448446 (0.0009) [2023-12-28 05:38:46,678][106225] Updated weights for policy 1, policy_version 1448456 (0.0008) [2023-12-28 05:38:46,741][106225] Updated weights for policy 1, policy_version 1448466 (0.0008) [2023-12-28 05:38:47,194][106226] Updated weights for policy 0, policy_version 1445130 (0.0006) [2023-12-28 05:38:47,241][106226] Updated weights for policy 0, policy_version 1445140 (0.0010) [2023-12-28 05:38:47,265][106225] Updated weights for policy 1, policy_version 1448476 (0.0006) [2023-12-28 05:38:47,298][106226] Updated weights for policy 0, policy_version 1445150 (0.0008) [2023-12-28 05:38:47,319][106225] Updated weights for policy 1, policy_version 1448486 (0.0005) [2023-12-28 05:38:47,368][106225] Updated weights for policy 1, policy_version 1448496 (0.0008) [2023-12-28 05:38:47,909][106226] Updated weights for policy 0, policy_version 1445160 (0.0006) [2023-12-28 05:38:47,961][106226] Updated weights for policy 0, policy_version 1445170 (0.0005) [2023-12-28 05:38:47,979][106225] Updated weights for policy 1, policy_version 1448506 (0.0008) [2023-12-28 05:38:48,018][106226] Updated weights for policy 0, policy_version 1445180 (0.0007) [2023-12-28 05:38:48,038][106225] Updated weights for policy 1, policy_version 1448516 (0.0007) [2023-12-28 05:38:48,095][106225] Updated weights for policy 1, policy_version 1448526 (0.0005) [2023-12-28 05:38:48,162][106225] Updated weights for policy 1, policy_version 1448536 (0.0005) [2023-12-28 05:38:48,741][106225] Updated weights for policy 1, policy_version 1448546 (0.0009) [2023-12-28 05:38:48,768][106226] Updated weights for policy 0, policy_version 1445190 (0.0006) [2023-12-28 05:38:48,805][106225] Updated weights for policy 1, policy_version 1448556 (0.0006) [2023-12-28 05:38:48,836][106226] Updated weights for policy 0, policy_version 1445200 (0.0006) [2023-12-28 05:38:48,868][106225] Updated weights for policy 1, policy_version 1448566 (0.0006) [2023-12-28 05:38:48,901][106226] Updated weights for policy 0, policy_version 1445210 (0.0008) [2023-12-28 05:38:49,479][106225] Updated weights for policy 1, policy_version 1448576 (0.0009) [2023-12-28 05:38:49,543][106225] Updated weights for policy 1, policy_version 1448586 (0.0009) [2023-12-28 05:38:49,562][106226] Updated weights for policy 0, policy_version 1445220 (0.0008) [2023-12-28 05:38:49,602][106225] Updated weights for policy 1, policy_version 1448596 (0.0007) [2023-12-28 05:38:49,633][106226] Updated weights for policy 0, policy_version 1445230 (0.0008) [2023-12-28 05:38:49,682][106226] Updated weights for policy 0, policy_version 1445240 (0.0008) [2023-12-28 05:38:50,343][106225] Updated weights for policy 1, policy_version 1448606 (0.0008) [2023-12-28 05:38:50,406][106225] Updated weights for policy 1, policy_version 1448616 (0.0009) [2023-12-28 05:38:50,421][106226] Updated weights for policy 0, policy_version 1445250 (0.0008) [2023-12-28 05:38:50,474][106226] Updated weights for policy 0, policy_version 1445260 (0.0008) [2023-12-28 05:38:50,475][106225] Updated weights for policy 1, policy_version 1448626 (0.0005) [2023-12-28 05:38:50,532][106226] Updated weights for policy 0, policy_version 1445270 (0.0006) [2023-12-28 05:38:50,596][106226] Updated weights for policy 0, policy_version 1445280 (0.0010) [2023-12-28 05:38:51,143][106225] Updated weights for policy 1, policy_version 1448636 (0.0006) [2023-12-28 05:38:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 740966400. Throughput: 0: 9997.1, 1: 9949.6. Samples: 740980852. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:51,175][105115] Avg episode reward: [(0, '-4.902'), (1, '-4.771')] [2023-12-28 05:38:51,197][106225] Updated weights for policy 1, policy_version 1448646 (0.0007) [2023-12-28 05:38:51,259][106225] Updated weights for policy 1, policy_version 1448656 (0.0008) [2023-12-28 05:38:51,310][106226] Updated weights for policy 0, policy_version 1445290 (0.0007) [2023-12-28 05:38:51,380][106226] Updated weights for policy 0, policy_version 1445300 (0.0007) [2023-12-28 05:38:51,441][106226] Updated weights for policy 0, policy_version 1445310 (0.0006) [2023-12-28 05:38:51,983][106225] Updated weights for policy 1, policy_version 1448666 (0.0007) [2023-12-28 05:38:52,042][106225] Updated weights for policy 1, policy_version 1448676 (0.0009) [2023-12-28 05:38:52,092][106225] Updated weights for policy 1, policy_version 1448686 (0.0008) [2023-12-28 05:38:52,141][106225] Updated weights for policy 1, policy_version 1448696 (0.0008) [2023-12-28 05:38:52,163][106226] Updated weights for policy 0, policy_version 1445320 (0.0008) [2023-12-28 05:38:52,217][106226] Updated weights for policy 0, policy_version 1445330 (0.0008) [2023-12-28 05:38:52,277][106226] Updated weights for policy 0, policy_version 1445340 (0.0009) [2023-12-28 05:38:52,902][106225] Updated weights for policy 1, policy_version 1448706 (0.0008) [2023-12-28 05:38:52,962][106225] Updated weights for policy 1, policy_version 1448716 (0.0009) [2023-12-28 05:38:53,025][106225] Updated weights for policy 1, policy_version 1448726 (0.0009) [2023-12-28 05:38:53,026][106226] Updated weights for policy 0, policy_version 1445350 (0.0009) [2023-12-28 05:38:53,086][106226] Updated weights for policy 0, policy_version 1445360 (0.0007) [2023-12-28 05:38:53,150][106226] Updated weights for policy 0, policy_version 1445370 (0.0008) [2023-12-28 05:38:53,635][106225] Updated weights for policy 1, policy_version 1448736 (0.0006) [2023-12-28 05:38:53,695][106225] Updated weights for policy 1, policy_version 1448746 (0.0006) [2023-12-28 05:38:53,752][106225] Updated weights for policy 1, policy_version 1448756 (0.0006) [2023-12-28 05:38:53,945][106226] Updated weights for policy 0, policy_version 1445380 (0.0010) [2023-12-28 05:38:54,000][106226] Updated weights for policy 0, policy_version 1445390 (0.0008) [2023-12-28 05:38:54,059][106226] Updated weights for policy 0, policy_version 1445400 (0.0008) [2023-12-28 05:38:54,454][106225] Updated weights for policy 1, policy_version 1448766 (0.0008) [2023-12-28 05:38:54,504][106225] Updated weights for policy 1, policy_version 1448776 (0.0008) [2023-12-28 05:38:54,564][106225] Updated weights for policy 1, policy_version 1448786 (0.0005) [2023-12-28 05:38:54,850][106226] Updated weights for policy 0, policy_version 1445410 (0.0008) [2023-12-28 05:38:54,914][106226] Updated weights for policy 0, policy_version 1445420 (0.0005) [2023-12-28 05:38:54,960][106226] Updated weights for policy 0, policy_version 1445430 (0.0006) [2023-12-28 05:38:55,020][106226] Updated weights for policy 0, policy_version 1445440 (0.0007) [2023-12-28 05:38:55,123][106225] Updated weights for policy 1, policy_version 1448796 (0.0008) [2023-12-28 05:38:55,182][106225] Updated weights for policy 1, policy_version 1448806 (0.0005) [2023-12-28 05:38:55,234][106225] Updated weights for policy 1, policy_version 1448816 (0.0005) [2023-12-28 05:38:55,662][106226] Updated weights for policy 0, policy_version 1445450 (0.0006) [2023-12-28 05:38:55,711][106226] Updated weights for policy 0, policy_version 1445460 (0.0005) [2023-12-28 05:38:55,759][106226] Updated weights for policy 0, policy_version 1445470 (0.0006) [2023-12-28 05:38:55,797][106225] Updated weights for policy 1, policy_version 1448826 (0.0006) [2023-12-28 05:38:55,855][106225] Updated weights for policy 1, policy_version 1448836 (0.0007) [2023-12-28 05:38:55,905][106225] Updated weights for policy 1, policy_version 1448846 (0.0005) [2023-12-28 05:38:55,953][106225] Updated weights for policy 1, policy_version 1448856 (0.0005) [2023-12-28 05:38:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 741072896. Throughput: 0: 9974.8, 1: 9922.0. Samples: 741037720. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:38:56,175][105115] Avg episode reward: [(0, '-4.685'), (1, '-4.765')] [2023-12-28 05:38:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001448856_370958336.pth... [2023-12-28 05:38:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001445472_370114560.pth... [2023-12-28 05:38:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001447672_370655232.pth [2023-12-28 05:38:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001444320_369819648.pth [2023-12-28 05:38:56,313][106226] Updated weights for policy 0, policy_version 1445480 (0.0005) [2023-12-28 05:38:56,361][106226] Updated weights for policy 0, policy_version 1445490 (0.0005) [2023-12-28 05:38:56,409][106226] Updated weights for policy 0, policy_version 1445500 (0.0007) [2023-12-28 05:38:56,581][106225] Updated weights for policy 1, policy_version 1448866 (0.0010) [2023-12-28 05:38:56,634][106225] Updated weights for policy 1, policy_version 1448876 (0.0009) [2023-12-28 05:38:56,684][106225] Updated weights for policy 1, policy_version 1448886 (0.0010) [2023-12-28 05:38:56,921][106226] Updated weights for policy 0, policy_version 1445510 (0.0007) [2023-12-28 05:38:56,966][106226] Updated weights for policy 0, policy_version 1445520 (0.0008) [2023-12-28 05:38:57,008][106226] Updated weights for policy 0, policy_version 1445530 (0.0007) [2023-12-28 05:38:57,397][106225] Updated weights for policy 1, policy_version 1448896 (0.0006) [2023-12-28 05:38:57,455][106225] Updated weights for policy 1, policy_version 1448906 (0.0005) [2023-12-28 05:38:57,516][106225] Updated weights for policy 1, policy_version 1448916 (0.0005) [2023-12-28 05:38:57,711][106226] Updated weights for policy 0, policy_version 1445540 (0.0007) [2023-12-28 05:38:57,768][106226] Updated weights for policy 0, policy_version 1445550 (0.0008) [2023-12-28 05:38:57,822][106226] Updated weights for policy 0, policy_version 1445560 (0.0008) [2023-12-28 05:38:58,156][106225] Updated weights for policy 1, policy_version 1448926 (0.0005) [2023-12-28 05:38:58,224][106225] Updated weights for policy 1, policy_version 1448936 (0.0007) [2023-12-28 05:38:58,290][106225] Updated weights for policy 1, policy_version 1448946 (0.0008) [2023-12-28 05:38:58,514][106226] Updated weights for policy 0, policy_version 1445570 (0.0007) [2023-12-28 05:38:58,579][106226] Updated weights for policy 0, policy_version 1445580 (0.0008) [2023-12-28 05:38:58,652][106226] Updated weights for policy 0, policy_version 1445590 (0.0008) [2023-12-28 05:38:58,719][106226] Updated weights for policy 0, policy_version 1445600 (0.0008) [2023-12-28 05:38:59,123][106225] Updated weights for policy 1, policy_version 1448956 (0.0009) [2023-12-28 05:38:59,187][106225] Updated weights for policy 1, policy_version 1448966 (0.0009) [2023-12-28 05:38:59,251][106225] Updated weights for policy 1, policy_version 1448976 (0.0008) [2023-12-28 05:38:59,490][106226] Updated weights for policy 0, policy_version 1445610 (0.0008) [2023-12-28 05:38:59,547][106226] Updated weights for policy 0, policy_version 1445620 (0.0009) [2023-12-28 05:38:59,599][106226] Updated weights for policy 0, policy_version 1445630 (0.0007) [2023-12-28 05:39:00,043][106225] Updated weights for policy 1, policy_version 1448986 (0.0008) [2023-12-28 05:39:00,092][106225] Updated weights for policy 1, policy_version 1448996 (0.0010) [2023-12-28 05:39:00,154][106225] Updated weights for policy 1, policy_version 1449006 (0.0009) [2023-12-28 05:39:00,212][106225] Updated weights for policy 1, policy_version 1449016 (0.0009) [2023-12-28 05:39:00,272][106226] Updated weights for policy 0, policy_version 1445640 (0.0006) [2023-12-28 05:39:00,336][106226] Updated weights for policy 0, policy_version 1445650 (0.0005) [2023-12-28 05:39:00,404][106226] Updated weights for policy 0, policy_version 1445660 (0.0007) [2023-12-28 05:39:00,952][106226] Updated weights for policy 0, policy_version 1445670 (0.0008) [2023-12-28 05:39:01,003][106225] Updated weights for policy 1, policy_version 1449026 (0.0007) [2023-12-28 05:39:01,012][106226] Updated weights for policy 0, policy_version 1445680 (0.0008) [2023-12-28 05:39:01,070][106225] Updated weights for policy 1, policy_version 1449036 (0.0007) [2023-12-28 05:39:01,076][106226] Updated weights for policy 0, policy_version 1445690 (0.0008) [2023-12-28 05:39:01,130][106225] Updated weights for policy 1, policy_version 1449046 (0.0006) [2023-12-28 05:39:01,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 741179392. Throughput: 0: 10077.8, 1: 10004.4. Samples: 741161476. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:01,176][105115] Avg episode reward: [(0, '-5.033'), (1, '-4.642')] [2023-12-28 05:39:01,833][106226] Updated weights for policy 0, policy_version 1445700 (0.0007) [2023-12-28 05:39:01,887][106225] Updated weights for policy 1, policy_version 1449056 (0.0006) [2023-12-28 05:39:01,898][106226] Updated weights for policy 0, policy_version 1445710 (0.0008) [2023-12-28 05:39:01,934][106225] Updated weights for policy 1, policy_version 1449066 (0.0008) [2023-12-28 05:39:01,963][106226] Updated weights for policy 0, policy_version 1445720 (0.0007) [2023-12-28 05:39:01,992][106225] Updated weights for policy 1, policy_version 1449076 (0.0006) [2023-12-28 05:39:02,717][106226] Updated weights for policy 0, policy_version 1445730 (0.0010) [2023-12-28 05:39:02,739][106225] Updated weights for policy 1, policy_version 1449086 (0.0007) [2023-12-28 05:39:02,780][106226] Updated weights for policy 0, policy_version 1445740 (0.0007) [2023-12-28 05:39:02,801][106225] Updated weights for policy 1, policy_version 1449096 (0.0006) [2023-12-28 05:39:02,842][106226] Updated weights for policy 0, policy_version 1445750 (0.0007) [2023-12-28 05:39:02,857][106225] Updated weights for policy 1, policy_version 1449106 (0.0005) [2023-12-28 05:39:02,909][106226] Updated weights for policy 0, policy_version 1445760 (0.0008) [2023-12-28 05:39:03,529][106225] Updated weights for policy 1, policy_version 1449116 (0.0006) [2023-12-28 05:39:03,575][106225] Updated weights for policy 1, policy_version 1449126 (0.0005) [2023-12-28 05:39:03,621][106225] Updated weights for policy 1, policy_version 1449136 (0.0005) [2023-12-28 05:39:03,631][106226] Updated weights for policy 0, policy_version 1445770 (0.0009) [2023-12-28 05:39:03,695][106226] Updated weights for policy 0, policy_version 1445780 (0.0009) [2023-12-28 05:39:03,747][106226] Updated weights for policy 0, policy_version 1445790 (0.0008) [2023-12-28 05:39:04,325][106225] Updated weights for policy 1, policy_version 1449146 (0.0006) [2023-12-28 05:39:04,377][106225] Updated weights for policy 1, policy_version 1449156 (0.0009) [2023-12-28 05:39:04,429][106225] Updated weights for policy 1, policy_version 1449166 (0.0008) [2023-12-28 05:39:04,478][106225] Updated weights for policy 1, policy_version 1449176 (0.0008) [2023-12-28 05:39:04,517][106226] Updated weights for policy 0, policy_version 1445800 (0.0006) [2023-12-28 05:39:04,574][106226] Updated weights for policy 0, policy_version 1445810 (0.0005) [2023-12-28 05:39:04,632][106226] Updated weights for policy 0, policy_version 1445820 (0.0007) [2023-12-28 05:39:05,179][106225] Updated weights for policy 1, policy_version 1449186 (0.0010) [2023-12-28 05:39:05,199][106226] Updated weights for policy 0, policy_version 1445830 (0.0007) [2023-12-28 05:39:05,239][106225] Updated weights for policy 1, policy_version 1449196 (0.0010) [2023-12-28 05:39:05,254][106226] Updated weights for policy 0, policy_version 1445840 (0.0008) [2023-12-28 05:39:05,293][106225] Updated weights for policy 1, policy_version 1449206 (0.0010) [2023-12-28 05:39:05,310][106226] Updated weights for policy 0, policy_version 1445850 (0.0005) [2023-12-28 05:39:05,948][106225] Updated weights for policy 1, policy_version 1449216 (0.0010) [2023-12-28 05:39:06,004][106225] Updated weights for policy 1, policy_version 1449226 (0.0010) [2023-12-28 05:39:06,056][106226] Updated weights for policy 0, policy_version 1445860 (0.0007) [2023-12-28 05:39:06,064][106225] Updated weights for policy 1, policy_version 1449236 (0.0010) [2023-12-28 05:39:06,111][106226] Updated weights for policy 0, policy_version 1445870 (0.0008) [2023-12-28 05:39:06,173][106226] Updated weights for policy 0, policy_version 1445880 (0.0008) [2023-12-28 05:39:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 741269504. Throughput: 0: 10084.8, 1: 9996.5. Samples: 741279884. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:06,175][105115] Avg episode reward: [(0, '-5.150'), (1, '-4.986')] [2023-12-28 05:39:06,702][106225] Updated weights for policy 1, policy_version 1449246 (0.0011) [2023-12-28 05:39:06,760][106225] Updated weights for policy 1, policy_version 1449256 (0.0011) [2023-12-28 05:39:06,818][106225] Updated weights for policy 1, policy_version 1449266 (0.0011) [2023-12-28 05:39:06,976][106226] Updated weights for policy 0, policy_version 1445890 (0.0008) [2023-12-28 05:39:07,038][106226] Updated weights for policy 0, policy_version 1445900 (0.0008) [2023-12-28 05:39:07,090][106226] Updated weights for policy 0, policy_version 1445910 (0.0007) [2023-12-28 05:39:07,144][106226] Updated weights for policy 0, policy_version 1445920 (0.0007) [2023-12-28 05:39:07,538][106225] Updated weights for policy 1, policy_version 1449276 (0.0011) [2023-12-28 05:39:07,594][106225] Updated weights for policy 1, policy_version 1449286 (0.0010) [2023-12-28 05:39:07,652][106225] Updated weights for policy 1, policy_version 1449296 (0.0010) [2023-12-28 05:39:07,857][106226] Updated weights for policy 0, policy_version 1445930 (0.0005) [2023-12-28 05:39:07,916][106226] Updated weights for policy 0, policy_version 1445940 (0.0008) [2023-12-28 05:39:07,966][106226] Updated weights for policy 0, policy_version 1445950 (0.0010) [2023-12-28 05:39:08,370][106225] Updated weights for policy 1, policy_version 1449306 (0.0010) [2023-12-28 05:39:08,428][106225] Updated weights for policy 1, policy_version 1449316 (0.0008) [2023-12-28 05:39:08,493][106225] Updated weights for policy 1, policy_version 1449326 (0.0008) [2023-12-28 05:39:08,554][106225] Updated weights for policy 1, policy_version 1449336 (0.0008) [2023-12-28 05:39:08,682][106226] Updated weights for policy 0, policy_version 1445960 (0.0010) [2023-12-28 05:39:08,743][106226] Updated weights for policy 0, policy_version 1445970 (0.0011) [2023-12-28 05:39:08,805][106226] Updated weights for policy 0, policy_version 1445980 (0.0007) [2023-12-28 05:39:09,276][106225] Updated weights for policy 1, policy_version 1449346 (0.0008) [2023-12-28 05:39:09,336][106225] Updated weights for policy 1, policy_version 1449356 (0.0008) [2023-12-28 05:39:09,410][106225] Updated weights for policy 1, policy_version 1449366 (0.0009) [2023-12-28 05:39:09,580][106226] Updated weights for policy 0, policy_version 1445990 (0.0008) [2023-12-28 05:39:09,650][106226] Updated weights for policy 0, policy_version 1446000 (0.0009) [2023-12-28 05:39:09,722][106226] Updated weights for policy 0, policy_version 1446010 (0.0010) [2023-12-28 05:39:10,164][106225] Updated weights for policy 1, policy_version 1449376 (0.0007) [2023-12-28 05:39:10,220][106225] Updated weights for policy 1, policy_version 1449386 (0.0008) [2023-12-28 05:39:10,277][106225] Updated weights for policy 1, policy_version 1449396 (0.0006) [2023-12-28 05:39:10,493][106226] Updated weights for policy 0, policy_version 1446020 (0.0010) [2023-12-28 05:39:10,561][106226] Updated weights for policy 0, policy_version 1446030 (0.0010) [2023-12-28 05:39:10,622][106226] Updated weights for policy 0, policy_version 1446040 (0.0008) [2023-12-28 05:39:10,880][106225] Updated weights for policy 1, policy_version 1449406 (0.0008) [2023-12-28 05:39:10,935][106225] Updated weights for policy 1, policy_version 1449416 (0.0006) [2023-12-28 05:39:10,983][106225] Updated weights for policy 1, policy_version 1449426 (0.0005) [2023-12-28 05:39:11,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 741367808. Throughput: 0: 10041.8, 1: 10031.9. Samples: 741337428. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:11,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-4.539')] [2023-12-28 05:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001446048_370262016.pth... [2023-12-28 05:39:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001449432_371105792.pth... [2023-12-28 05:39:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001444896_369967104.pth [2023-12-28 05:39:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001448248_370802688.pth [2023-12-28 05:39:11,426][106226] Updated weights for policy 0, policy_version 1446050 (0.0009) [2023-12-28 05:39:11,495][106226] Updated weights for policy 0, policy_version 1446060 (0.0009) [2023-12-28 05:39:11,561][106226] Updated weights for policy 0, policy_version 1446070 (0.0009) [2023-12-28 05:39:11,628][106226] Updated weights for policy 0, policy_version 1446080 (0.0011) [2023-12-28 05:39:11,742][106225] Updated weights for policy 1, policy_version 1449436 (0.0007) [2023-12-28 05:39:11,805][106225] Updated weights for policy 1, policy_version 1449446 (0.0009) [2023-12-28 05:39:11,876][106225] Updated weights for policy 1, policy_version 1449456 (0.0009) [2023-12-28 05:39:12,367][106226] Updated weights for policy 0, policy_version 1446090 (0.0007) [2023-12-28 05:39:12,438][106226] Updated weights for policy 0, policy_version 1446100 (0.0006) [2023-12-28 05:39:12,504][106226] Updated weights for policy 0, policy_version 1446110 (0.0006) [2023-12-28 05:39:12,604][106225] Updated weights for policy 1, policy_version 1449466 (0.0008) [2023-12-28 05:39:12,667][106225] Updated weights for policy 1, policy_version 1449476 (0.0007) [2023-12-28 05:39:12,735][106225] Updated weights for policy 1, policy_version 1449486 (0.0006) [2023-12-28 05:39:12,795][106225] Updated weights for policy 1, policy_version 1449496 (0.0009) [2023-12-28 05:39:13,097][106226] Updated weights for policy 0, policy_version 1446120 (0.0007) [2023-12-28 05:39:13,151][106226] Updated weights for policy 0, policy_version 1446130 (0.0008) [2023-12-28 05:39:13,220][106226] Updated weights for policy 0, policy_version 1446140 (0.0009) [2023-12-28 05:39:13,469][106225] Updated weights for policy 1, policy_version 1449506 (0.0008) [2023-12-28 05:39:13,520][106225] Updated weights for policy 1, policy_version 1449516 (0.0008) [2023-12-28 05:39:13,571][106225] Updated weights for policy 1, policy_version 1449526 (0.0008) [2023-12-28 05:39:13,874][106226] Updated weights for policy 0, policy_version 1446150 (0.0008) [2023-12-28 05:39:13,923][106226] Updated weights for policy 0, policy_version 1446160 (0.0007) [2023-12-28 05:39:13,978][106226] Updated weights for policy 0, policy_version 1446170 (0.0005) [2023-12-28 05:39:14,341][106225] Updated weights for policy 1, policy_version 1449536 (0.0008) [2023-12-28 05:39:14,399][106225] Updated weights for policy 1, policy_version 1449546 (0.0008) [2023-12-28 05:39:14,451][106225] Updated weights for policy 1, policy_version 1449556 (0.0008) [2023-12-28 05:39:14,678][106226] Updated weights for policy 0, policy_version 1446180 (0.0008) [2023-12-28 05:39:14,746][106226] Updated weights for policy 0, policy_version 1446190 (0.0007) [2023-12-28 05:39:14,820][106226] Updated weights for policy 0, policy_version 1446200 (0.0007) [2023-12-28 05:39:15,236][106225] Updated weights for policy 1, policy_version 1449566 (0.0008) [2023-12-28 05:39:15,305][106225] Updated weights for policy 1, policy_version 1449576 (0.0008) [2023-12-28 05:39:15,372][106225] Updated weights for policy 1, policy_version 1449586 (0.0008) [2023-12-28 05:39:15,499][106226] Updated weights for policy 0, policy_version 1446210 (0.0008) [2023-12-28 05:39:15,561][106226] Updated weights for policy 0, policy_version 1446220 (0.0009) [2023-12-28 05:39:15,623][106226] Updated weights for policy 0, policy_version 1446230 (0.0010) [2023-12-28 05:39:15,686][106226] Updated weights for policy 0, policy_version 1446240 (0.0008) [2023-12-28 05:39:16,136][106225] Updated weights for policy 1, policy_version 1449596 (0.0007) [2023-12-28 05:39:16,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.2, 300 sec: 19855.2). Total num frames: 741457920. Throughput: 0: 9892.3, 1: 9913.6. Samples: 741452224. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:16,176][105115] Avg episode reward: [(0, '-4.789'), (1, '-5.032')] [2023-12-28 05:39:16,202][106225] Updated weights for policy 1, policy_version 1449606 (0.0005) [2023-12-28 05:39:16,242][106226] Updated weights for policy 0, policy_version 1446250 (0.0011) [2023-12-28 05:39:16,269][106225] Updated weights for policy 1, policy_version 1449616 (0.0007) [2023-12-28 05:39:16,295][106226] Updated weights for policy 0, policy_version 1446260 (0.0010) [2023-12-28 05:39:16,356][106226] Updated weights for policy 0, policy_version 1446270 (0.0010) [2023-12-28 05:39:16,959][106226] Updated weights for policy 0, policy_version 1446280 (0.0007) [2023-12-28 05:39:16,961][106225] Updated weights for policy 1, policy_version 1449626 (0.0007) [2023-12-28 05:39:17,013][106226] Updated weights for policy 0, policy_version 1446290 (0.0006) [2023-12-28 05:39:17,022][106225] Updated weights for policy 1, policy_version 1449636 (0.0009) [2023-12-28 05:39:17,072][106226] Updated weights for policy 0, policy_version 1446300 (0.0007) [2023-12-28 05:39:17,074][106225] Updated weights for policy 1, policy_version 1449646 (0.0008) [2023-12-28 05:39:17,126][106225] Updated weights for policy 1, policy_version 1449656 (0.0007) [2023-12-28 05:39:17,791][106226] Updated weights for policy 0, policy_version 1446310 (0.0008) [2023-12-28 05:39:17,843][106226] Updated weights for policy 0, policy_version 1446320 (0.0007) [2023-12-28 05:39:17,856][106225] Updated weights for policy 1, policy_version 1449666 (0.0009) [2023-12-28 05:39:17,893][106226] Updated weights for policy 0, policy_version 1446330 (0.0006) [2023-12-28 05:39:17,911][106225] Updated weights for policy 1, policy_version 1449676 (0.0007) [2023-12-28 05:39:17,968][106225] Updated weights for policy 1, policy_version 1449686 (0.0007) [2023-12-28 05:39:18,570][106226] Updated weights for policy 0, policy_version 1446340 (0.0008) [2023-12-28 05:39:18,631][106226] Updated weights for policy 0, policy_version 1446350 (0.0010) [2023-12-28 05:39:18,698][106226] Updated weights for policy 0, policy_version 1446360 (0.0009) [2023-12-28 05:39:18,703][106225] Updated weights for policy 1, policy_version 1449696 (0.0006) [2023-12-28 05:39:18,759][106225] Updated weights for policy 1, policy_version 1449706 (0.0006) [2023-12-28 05:39:18,815][106225] Updated weights for policy 1, policy_version 1449716 (0.0006) [2023-12-28 05:39:19,396][106226] Updated weights for policy 0, policy_version 1446370 (0.0011) [2023-12-28 05:39:19,457][106226] Updated weights for policy 0, policy_version 1446380 (0.0011) [2023-12-28 05:39:19,485][106225] Updated weights for policy 1, policy_version 1449726 (0.0009) [2023-12-28 05:39:19,518][106226] Updated weights for policy 0, policy_version 1446390 (0.0011) [2023-12-28 05:39:19,548][106225] Updated weights for policy 1, policy_version 1449736 (0.0007) [2023-12-28 05:39:19,582][106226] Updated weights for policy 0, policy_version 1446400 (0.0010) [2023-12-28 05:39:19,607][106225] Updated weights for policy 1, policy_version 1449746 (0.0008) [2023-12-28 05:39:20,307][106225] Updated weights for policy 1, policy_version 1449756 (0.0008) [2023-12-28 05:39:20,367][106225] Updated weights for policy 1, policy_version 1449766 (0.0008) [2023-12-28 05:39:20,370][106226] Updated weights for policy 0, policy_version 1446410 (0.0006) [2023-12-28 05:39:20,421][106225] Updated weights for policy 1, policy_version 1449776 (0.0008) [2023-12-28 05:39:20,437][106226] Updated weights for policy 0, policy_version 1446420 (0.0007) [2023-12-28 05:39:20,492][106226] Updated weights for policy 0, policy_version 1446430 (0.0010) [2023-12-28 05:39:21,148][106225] Updated weights for policy 1, policy_version 1449786 (0.0006) [2023-12-28 05:39:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 741556224. Throughput: 0: 9884.8, 1: 9891.9. Samples: 741570088. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:21,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-5.082')] [2023-12-28 05:39:21,210][106225] Updated weights for policy 1, policy_version 1449796 (0.0008) [2023-12-28 05:39:21,259][106226] Updated weights for policy 0, policy_version 1446440 (0.0007) [2023-12-28 05:39:21,277][106225] Updated weights for policy 1, policy_version 1449806 (0.0007) [2023-12-28 05:39:21,317][106226] Updated weights for policy 0, policy_version 1446450 (0.0008) [2023-12-28 05:39:21,338][106225] Updated weights for policy 1, policy_version 1449816 (0.0008) [2023-12-28 05:39:21,382][106226] Updated weights for policy 0, policy_version 1446460 (0.0008) [2023-12-28 05:39:22,049][106225] Updated weights for policy 1, policy_version 1449826 (0.0009) [2023-12-28 05:39:22,103][106226] Updated weights for policy 0, policy_version 1446470 (0.0007) [2023-12-28 05:39:22,114][106225] Updated weights for policy 1, policy_version 1449836 (0.0007) [2023-12-28 05:39:22,167][106226] Updated weights for policy 0, policy_version 1446480 (0.0006) [2023-12-28 05:39:22,167][106225] Updated weights for policy 1, policy_version 1449846 (0.0007) [2023-12-28 05:39:22,234][106226] Updated weights for policy 0, policy_version 1446490 (0.0006) [2023-12-28 05:39:22,836][106225] Updated weights for policy 1, policy_version 1449856 (0.0009) [2023-12-28 05:39:22,892][106225] Updated weights for policy 1, policy_version 1449866 (0.0008) [2023-12-28 05:39:22,947][106225] Updated weights for policy 1, policy_version 1449876 (0.0008) [2023-12-28 05:39:22,966][106226] Updated weights for policy 0, policy_version 1446500 (0.0008) [2023-12-28 05:39:23,021][106226] Updated weights for policy 0, policy_version 1446510 (0.0009) [2023-12-28 05:39:23,080][106226] Updated weights for policy 0, policy_version 1446520 (0.0009) [2023-12-28 05:39:23,596][106225] Updated weights for policy 1, policy_version 1449886 (0.0006) [2023-12-28 05:39:23,659][106225] Updated weights for policy 1, policy_version 1449896 (0.0007) [2023-12-28 05:39:23,724][106225] Updated weights for policy 1, policy_version 1449906 (0.0008) [2023-12-28 05:39:23,838][106226] Updated weights for policy 0, policy_version 1446530 (0.0008) [2023-12-28 05:39:23,893][106226] Updated weights for policy 0, policy_version 1446540 (0.0005) [2023-12-28 05:39:23,943][106226] Updated weights for policy 0, policy_version 1446550 (0.0005) [2023-12-28 05:39:24,002][106226] Updated weights for policy 0, policy_version 1446560 (0.0005) [2023-12-28 05:39:24,477][106225] Updated weights for policy 1, policy_version 1449916 (0.0009) [2023-12-28 05:39:24,524][106225] Updated weights for policy 1, policy_version 1449926 (0.0006) [2023-12-28 05:39:24,576][106225] Updated weights for policy 1, policy_version 1449936 (0.0007) [2023-12-28 05:39:24,635][106226] Updated weights for policy 0, policy_version 1446570 (0.0008) [2023-12-28 05:39:24,693][106226] Updated weights for policy 0, policy_version 1446580 (0.0008) [2023-12-28 05:39:24,749][106226] Updated weights for policy 0, policy_version 1446590 (0.0008) [2023-12-28 05:39:25,257][106225] Updated weights for policy 1, policy_version 1449946 (0.0007) [2023-12-28 05:39:25,308][106225] Updated weights for policy 1, policy_version 1449956 (0.0009) [2023-12-28 05:39:25,361][106225] Updated weights for policy 1, policy_version 1449966 (0.0009) [2023-12-28 05:39:25,418][106225] Updated weights for policy 1, policy_version 1449976 (0.0009) [2023-12-28 05:39:25,463][106226] Updated weights for policy 0, policy_version 1446600 (0.0008) [2023-12-28 05:39:25,511][106226] Updated weights for policy 0, policy_version 1446610 (0.0008) [2023-12-28 05:39:25,563][106226] Updated weights for policy 0, policy_version 1446620 (0.0008) [2023-12-28 05:39:26,144][106225] Updated weights for policy 1, policy_version 1449986 (0.0005) [2023-12-28 05:39:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 741654528. Throughput: 0: 9875.5, 1: 9888.4. Samples: 741629296. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:26,176][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.922')] [2023-12-28 05:39:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001446624_370409472.pth... [2023-12-28 05:39:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001445472_370114560.pth [2023-12-28 05:39:26,199][106225] Updated weights for policy 1, policy_version 1449996 (0.0007) [2023-12-28 05:39:26,247][106225] Updated weights for policy 1, policy_version 1450006 (0.0010) [2023-12-28 05:39:26,255][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001450008_371253248.pth... [2023-12-28 05:39:26,259][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001448856_370958336.pth [2023-12-28 05:39:26,271][106226] Updated weights for policy 0, policy_version 1446630 (0.0006) [2023-12-28 05:39:26,327][106226] Updated weights for policy 0, policy_version 1446640 (0.0005) [2023-12-28 05:39:26,380][106226] Updated weights for policy 0, policy_version 1446650 (0.0008) [2023-12-28 05:39:26,937][106225] Updated weights for policy 1, policy_version 1450016 (0.0008) [2023-12-28 05:39:26,968][106226] Updated weights for policy 0, policy_version 1446660 (0.0007) [2023-12-28 05:39:26,996][106225] Updated weights for policy 1, policy_version 1450026 (0.0007) [2023-12-28 05:39:27,025][106226] Updated weights for policy 0, policy_version 1446670 (0.0006) [2023-12-28 05:39:27,050][106225] Updated weights for policy 1, policy_version 1450036 (0.0006) [2023-12-28 05:39:27,074][106226] Updated weights for policy 0, policy_version 1446680 (0.0007) [2023-12-28 05:39:27,759][106225] Updated weights for policy 1, policy_version 1450046 (0.0008) [2023-12-28 05:39:27,771][106226] Updated weights for policy 0, policy_version 1446690 (0.0008) [2023-12-28 05:39:27,806][106225] Updated weights for policy 1, policy_version 1450056 (0.0008) [2023-12-28 05:39:27,838][106226] Updated weights for policy 0, policy_version 1446700 (0.0005) [2023-12-28 05:39:27,853][106225] Updated weights for policy 1, policy_version 1450066 (0.0008) [2023-12-28 05:39:27,897][106226] Updated weights for policy 0, policy_version 1446710 (0.0008) [2023-12-28 05:39:27,956][106226] Updated weights for policy 0, policy_version 1446720 (0.0008) [2023-12-28 05:39:28,524][106225] Updated weights for policy 1, policy_version 1450076 (0.0007) [2023-12-28 05:39:28,581][106225] Updated weights for policy 1, policy_version 1450086 (0.0007) [2023-12-28 05:39:28,636][106225] Updated weights for policy 1, policy_version 1450096 (0.0007) [2023-12-28 05:39:28,669][106226] Updated weights for policy 0, policy_version 1446730 (0.0010) [2023-12-28 05:39:28,729][106226] Updated weights for policy 0, policy_version 1446740 (0.0010) [2023-12-28 05:39:28,779][106226] Updated weights for policy 0, policy_version 1446750 (0.0010) [2023-12-28 05:39:29,401][106225] Updated weights for policy 1, policy_version 1450106 (0.0007) [2023-12-28 05:39:29,454][106225] Updated weights for policy 1, policy_version 1450116 (0.0007) [2023-12-28 05:39:29,490][106226] Updated weights for policy 0, policy_version 1446760 (0.0011) [2023-12-28 05:39:29,508][106225] Updated weights for policy 1, policy_version 1450126 (0.0007) [2023-12-28 05:39:29,546][106226] Updated weights for policy 0, policy_version 1446770 (0.0010) [2023-12-28 05:39:29,561][106225] Updated weights for policy 1, policy_version 1450136 (0.0005) [2023-12-28 05:39:29,611][106226] Updated weights for policy 0, policy_version 1446780 (0.0011) [2023-12-28 05:39:30,238][106225] Updated weights for policy 1, policy_version 1450146 (0.0008) [2023-12-28 05:39:30,263][106226] Updated weights for policy 0, policy_version 1446790 (0.0007) [2023-12-28 05:39:30,291][106225] Updated weights for policy 1, policy_version 1450156 (0.0009) [2023-12-28 05:39:30,315][106226] Updated weights for policy 0, policy_version 1446800 (0.0005) [2023-12-28 05:39:30,343][106225] Updated weights for policy 1, policy_version 1450166 (0.0008) [2023-12-28 05:39:30,374][106226] Updated weights for policy 0, policy_version 1446810 (0.0006) [2023-12-28 05:39:30,950][106226] Updated weights for policy 0, policy_version 1446820 (0.0006) [2023-12-28 05:39:31,009][106226] Updated weights for policy 0, policy_version 1446830 (0.0006) [2023-12-28 05:39:31,078][106226] Updated weights for policy 0, policy_version 1446840 (0.0007) [2023-12-28 05:39:31,167][106225] Updated weights for policy 1, policy_version 1450176 (0.0008) [2023-12-28 05:39:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 741761024. Throughput: 0: 9882.4, 1: 9994.2. Samples: 741749252. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:31,175][105115] Avg episode reward: [(0, '-5.311'), (1, '-4.659')] [2023-12-28 05:39:31,226][106225] Updated weights for policy 1, policy_version 1450186 (0.0008) [2023-12-28 05:39:31,290][106225] Updated weights for policy 1, policy_version 1450196 (0.0008) [2023-12-28 05:39:31,767][106226] Updated weights for policy 0, policy_version 1446850 (0.0005) [2023-12-28 05:39:31,831][106226] Updated weights for policy 0, policy_version 1446860 (0.0005) [2023-12-28 05:39:31,893][106226] Updated weights for policy 0, policy_version 1446870 (0.0005) [2023-12-28 05:39:31,950][106226] Updated weights for policy 0, policy_version 1446880 (0.0005) [2023-12-28 05:39:32,068][106225] Updated weights for policy 1, policy_version 1450206 (0.0009) [2023-12-28 05:39:32,138][106225] Updated weights for policy 1, policy_version 1450216 (0.0009) [2023-12-28 05:39:32,205][106225] Updated weights for policy 1, policy_version 1450226 (0.0010) [2023-12-28 05:39:32,518][106226] Updated weights for policy 0, policy_version 1446890 (0.0008) [2023-12-28 05:39:32,578][106226] Updated weights for policy 0, policy_version 1446900 (0.0008) [2023-12-28 05:39:32,642][106226] Updated weights for policy 0, policy_version 1446910 (0.0009) [2023-12-28 05:39:32,951][106225] Updated weights for policy 1, policy_version 1450236 (0.0007) [2023-12-28 05:39:32,994][106225] Updated weights for policy 1, policy_version 1450246 (0.0005) [2023-12-28 05:39:33,042][106225] Updated weights for policy 1, policy_version 1450256 (0.0005) [2023-12-28 05:39:33,369][106226] Updated weights for policy 0, policy_version 1446920 (0.0007) [2023-12-28 05:39:33,438][106226] Updated weights for policy 0, policy_version 1446930 (0.0010) [2023-12-28 05:39:33,507][106226] Updated weights for policy 0, policy_version 1446940 (0.0009) [2023-12-28 05:39:33,679][106225] Updated weights for policy 1, policy_version 1450266 (0.0007) [2023-12-28 05:39:33,738][106225] Updated weights for policy 1, policy_version 1450276 (0.0010) [2023-12-28 05:39:33,793][106225] Updated weights for policy 1, policy_version 1450286 (0.0010) [2023-12-28 05:39:33,852][106225] Updated weights for policy 1, policy_version 1450296 (0.0010) [2023-12-28 05:39:34,208][106226] Updated weights for policy 0, policy_version 1446950 (0.0009) [2023-12-28 05:39:34,268][106226] Updated weights for policy 0, policy_version 1446960 (0.0008) [2023-12-28 05:39:34,327][106226] Updated weights for policy 0, policy_version 1446970 (0.0008) [2023-12-28 05:39:34,496][106225] Updated weights for policy 1, policy_version 1450306 (0.0010) [2023-12-28 05:39:34,551][106225] Updated weights for policy 1, policy_version 1450316 (0.0010) [2023-12-28 05:39:34,605][106225] Updated weights for policy 1, policy_version 1450326 (0.0010) [2023-12-28 05:39:35,057][106226] Updated weights for policy 0, policy_version 1446980 (0.0007) [2023-12-28 05:39:35,102][106226] Updated weights for policy 0, policy_version 1446990 (0.0007) [2023-12-28 05:39:35,150][106226] Updated weights for policy 0, policy_version 1447000 (0.0005) [2023-12-28 05:39:35,330][106225] Updated weights for policy 1, policy_version 1450336 (0.0006) [2023-12-28 05:39:35,384][106225] Updated weights for policy 1, policy_version 1450346 (0.0005) [2023-12-28 05:39:35,439][106225] Updated weights for policy 1, policy_version 1450356 (0.0006) [2023-12-28 05:39:35,795][106226] Updated weights for policy 0, policy_version 1447010 (0.0006) [2023-12-28 05:39:35,858][106226] Updated weights for policy 0, policy_version 1447020 (0.0005) [2023-12-28 05:39:35,929][106226] Updated weights for policy 0, policy_version 1447030 (0.0006) [2023-12-28 05:39:35,994][106226] Updated weights for policy 0, policy_version 1447040 (0.0006) [2023-12-28 05:39:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 741859328. Throughput: 0: 9922.1, 1: 9814.0. Samples: 741868972. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:36,175][105115] Avg episode reward: [(0, '-5.111'), (1, '-4.962')] [2023-12-28 05:39:36,201][106225] Updated weights for policy 1, policy_version 1450366 (0.0008) [2023-12-28 05:39:36,252][106225] Updated weights for policy 1, policy_version 1450376 (0.0008) [2023-12-28 05:39:36,303][106225] Updated weights for policy 1, policy_version 1450386 (0.0008) [2023-12-28 05:39:36,612][106226] Updated weights for policy 0, policy_version 1447050 (0.0005) [2023-12-28 05:39:36,678][106226] Updated weights for policy 0, policy_version 1447060 (0.0006) [2023-12-28 05:39:36,739][106226] Updated weights for policy 0, policy_version 1447070 (0.0007) [2023-12-28 05:39:37,122][106225] Updated weights for policy 1, policy_version 1450396 (0.0007) [2023-12-28 05:39:37,170][106225] Updated weights for policy 1, policy_version 1450406 (0.0005) [2023-12-28 05:39:37,219][106225] Updated weights for policy 1, policy_version 1450416 (0.0005) [2023-12-28 05:39:37,359][106226] Updated weights for policy 0, policy_version 1447080 (0.0007) [2023-12-28 05:39:37,416][106226] Updated weights for policy 0, policy_version 1447090 (0.0008) [2023-12-28 05:39:37,471][106226] Updated weights for policy 0, policy_version 1447100 (0.0008) [2023-12-28 05:39:37,937][106225] Updated weights for policy 1, policy_version 1450426 (0.0006) [2023-12-28 05:39:37,991][106225] Updated weights for policy 1, policy_version 1450436 (0.0008) [2023-12-28 05:39:38,050][106225] Updated weights for policy 1, policy_version 1450446 (0.0009) [2023-12-28 05:39:38,101][106225] Updated weights for policy 1, policy_version 1450456 (0.0006) [2023-12-28 05:39:38,103][106226] Updated weights for policy 0, policy_version 1447110 (0.0008) [2023-12-28 05:39:38,158][106226] Updated weights for policy 0, policy_version 1447120 (0.0010) [2023-12-28 05:39:38,212][106226] Updated weights for policy 0, policy_version 1447130 (0.0006) [2023-12-28 05:39:38,770][106226] Updated weights for policy 0, policy_version 1447140 (0.0005) [2023-12-28 05:39:38,826][106226] Updated weights for policy 0, policy_version 1447150 (0.0006) [2023-12-28 05:39:38,887][106225] Updated weights for policy 1, policy_version 1450466 (0.0011) [2023-12-28 05:39:38,889][106226] Updated weights for policy 0, policy_version 1447160 (0.0009) [2023-12-28 05:39:38,942][106225] Updated weights for policy 1, policy_version 1450476 (0.0010) [2023-12-28 05:39:38,992][106225] Updated weights for policy 1, policy_version 1450486 (0.0009) [2023-12-28 05:39:39,526][106226] Updated weights for policy 0, policy_version 1447170 (0.0008) [2023-12-28 05:39:39,596][106226] Updated weights for policy 0, policy_version 1447180 (0.0010) [2023-12-28 05:39:39,660][106226] Updated weights for policy 0, policy_version 1447190 (0.0006) [2023-12-28 05:39:39,729][106226] Updated weights for policy 0, policy_version 1447200 (0.0006) [2023-12-28 05:39:39,766][106225] Updated weights for policy 1, policy_version 1450496 (0.0011) [2023-12-28 05:39:39,839][106225] Updated weights for policy 1, policy_version 1450506 (0.0010) [2023-12-28 05:39:39,906][106225] Updated weights for policy 1, policy_version 1450516 (0.0008) [2023-12-28 05:39:40,488][106226] Updated weights for policy 0, policy_version 1447210 (0.0011) [2023-12-28 05:39:40,549][106226] Updated weights for policy 0, policy_version 1447220 (0.0011) [2023-12-28 05:39:40,606][106226] Updated weights for policy 0, policy_version 1447230 (0.0011) [2023-12-28 05:39:40,679][106225] Updated weights for policy 1, policy_version 1450526 (0.0008) [2023-12-28 05:39:40,733][106225] Updated weights for policy 1, policy_version 1450536 (0.0008) [2023-12-28 05:39:40,798][106225] Updated weights for policy 1, policy_version 1450546 (0.0008) [2023-12-28 05:39:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 741957632. Throughput: 0: 10047.0, 1: 9765.1. Samples: 741929264. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:41,175][105115] Avg episode reward: [(0, '-4.695'), (1, '-4.529')] [2023-12-28 05:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001450552_371392512.pth... [2023-12-28 05:39:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001447232_370565120.pth... [2023-12-28 05:39:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001446048_370262016.pth [2023-12-28 05:39:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001449432_371105792.pth [2023-12-28 05:39:41,326][106226] Updated weights for policy 0, policy_version 1447240 (0.0011) [2023-12-28 05:39:41,405][106226] Updated weights for policy 0, policy_version 1447250 (0.0011) [2023-12-28 05:39:41,467][106226] Updated weights for policy 0, policy_version 1447260 (0.0007) [2023-12-28 05:39:41,655][106225] Updated weights for policy 1, policy_version 1450556 (0.0008) [2023-12-28 05:39:41,724][106225] Updated weights for policy 1, policy_version 1450566 (0.0007) [2023-12-28 05:39:41,782][106225] Updated weights for policy 1, policy_version 1450576 (0.0007) [2023-12-28 05:39:42,190][106226] Updated weights for policy 0, policy_version 1447270 (0.0009) [2023-12-28 05:39:42,250][106226] Updated weights for policy 0, policy_version 1447280 (0.0008) [2023-12-28 05:39:42,311][106226] Updated weights for policy 0, policy_version 1447290 (0.0009) [2023-12-28 05:39:42,519][106225] Updated weights for policy 1, policy_version 1450586 (0.0009) [2023-12-28 05:39:42,576][106225] Updated weights for policy 1, policy_version 1450596 (0.0008) [2023-12-28 05:39:42,632][106225] Updated weights for policy 1, policy_version 1450606 (0.0008) [2023-12-28 05:39:42,684][106225] Updated weights for policy 1, policy_version 1450616 (0.0008) [2023-12-28 05:39:43,072][106226] Updated weights for policy 0, policy_version 1447300 (0.0009) [2023-12-28 05:39:43,121][106226] Updated weights for policy 0, policy_version 1447310 (0.0008) [2023-12-28 05:39:43,187][106226] Updated weights for policy 0, policy_version 1447320 (0.0006) [2023-12-28 05:39:43,398][106225] Updated weights for policy 1, policy_version 1450626 (0.0005) [2023-12-28 05:39:43,457][106225] Updated weights for policy 1, policy_version 1450636 (0.0005) [2023-12-28 05:39:43,516][106225] Updated weights for policy 1, policy_version 1450646 (0.0005) [2023-12-28 05:39:43,807][106226] Updated weights for policy 0, policy_version 1447330 (0.0005) [2023-12-28 05:39:43,859][106226] Updated weights for policy 0, policy_version 1447340 (0.0005) [2023-12-28 05:39:43,924][106226] Updated weights for policy 0, policy_version 1447350 (0.0007) [2023-12-28 05:39:43,981][106226] Updated weights for policy 0, policy_version 1447360 (0.0010) [2023-12-28 05:39:44,149][106225] Updated weights for policy 1, policy_version 1450656 (0.0010) [2023-12-28 05:39:44,211][106225] Updated weights for policy 1, policy_version 1450666 (0.0010) [2023-12-28 05:39:44,267][106225] Updated weights for policy 1, policy_version 1450676 (0.0010) [2023-12-28 05:39:44,659][106226] Updated weights for policy 0, policy_version 1447370 (0.0008) [2023-12-28 05:39:44,716][106226] Updated weights for policy 0, policy_version 1447380 (0.0005) [2023-12-28 05:39:44,775][106226] Updated weights for policy 0, policy_version 1447390 (0.0007) [2023-12-28 05:39:44,977][106225] Updated weights for policy 1, policy_version 1450686 (0.0010) [2023-12-28 05:39:45,049][106225] Updated weights for policy 1, policy_version 1450696 (0.0011) [2023-12-28 05:39:45,120][106225] Updated weights for policy 1, policy_version 1450706 (0.0007) [2023-12-28 05:39:45,395][106226] Updated weights for policy 0, policy_version 1447400 (0.0010) [2023-12-28 05:39:45,455][106226] Updated weights for policy 0, policy_version 1447410 (0.0010) [2023-12-28 05:39:45,508][106226] Updated weights for policy 0, policy_version 1447420 (0.0010) [2023-12-28 05:39:45,534][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000006 [2023-12-28 05:39:45,776][106225] Updated weights for policy 1, policy_version 1450716 (0.0007) [2023-12-28 05:39:45,827][106225] Updated weights for policy 1, policy_version 1450726 (0.0009) [2023-12-28 05:39:45,872][106225] Updated weights for policy 1, policy_version 1450736 (0.0005) [2023-12-28 05:39:46,174][106226] Updated weights for policy 0, policy_version 1447430 (0.0006) [2023-12-28 05:39:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 742055936. Throughput: 0: 9976.5, 1: 9656.5. Samples: 742044956. Policy #0 lag: (min: 19.0, avg: 29.2, max: 51.0) [2023-12-28 05:39:46,175][105115] Avg episode reward: [(0, '-4.989'), (1, '-4.696')] [2023-12-28 05:39:46,229][106226] Updated weights for policy 0, policy_version 1447440 (0.0006) [2023-12-28 05:39:46,278][106226] Updated weights for policy 0, policy_version 1447450 (0.0008) [2023-12-28 05:39:46,496][106225] Updated weights for policy 1, policy_version 1450746 (0.0005) [2023-12-28 05:39:46,553][106225] Updated weights for policy 1, policy_version 1450756 (0.0005) [2023-12-28 05:39:46,614][106225] Updated weights for policy 1, policy_version 1450766 (0.0005) [2023-12-28 05:39:46,666][106225] Updated weights for policy 1, policy_version 1450776 (0.0006) [2023-12-28 05:39:47,000][106226] Updated weights for policy 0, policy_version 1447460 (0.0007) [2023-12-28 05:39:47,059][106226] Updated weights for policy 0, policy_version 1447470 (0.0005) [2023-12-28 05:39:47,115][106226] Updated weights for policy 0, policy_version 1447480 (0.0005) [2023-12-28 05:39:47,230][106225] Updated weights for policy 1, policy_version 1450786 (0.0010) [2023-12-28 05:39:47,296][106225] Updated weights for policy 1, policy_version 1450796 (0.0010) [2023-12-28 05:39:47,356][106225] Updated weights for policy 1, policy_version 1450806 (0.0009) [2023-12-28 05:39:47,683][106226] Updated weights for policy 0, policy_version 1447490 (0.0006) [2023-12-28 05:39:47,738][106226] Updated weights for policy 0, policy_version 1447500 (0.0005) [2023-12-28 05:39:47,783][106226] Updated weights for policy 0, policy_version 1447510 (0.0005) [2023-12-28 05:39:47,834][106226] Updated weights for policy 0, policy_version 1447520 (0.0005) [2023-12-28 05:39:48,113][106225] Updated weights for policy 1, policy_version 1450816 (0.0008) [2023-12-28 05:39:48,168][106225] Updated weights for policy 1, policy_version 1450826 (0.0008) [2023-12-28 05:39:48,227][106225] Updated weights for policy 1, policy_version 1450836 (0.0009) [2023-12-28 05:39:48,490][106226] Updated weights for policy 0, policy_version 1447530 (0.0009) [2023-12-28 05:39:48,555][106226] Updated weights for policy 0, policy_version 1447540 (0.0009) [2023-12-28 05:39:48,605][106226] Updated weights for policy 0, policy_version 1447550 (0.0008) [2023-12-28 05:39:48,929][106225] Updated weights for policy 1, policy_version 1450846 (0.0008) [2023-12-28 05:39:48,994][106225] Updated weights for policy 1, policy_version 1450856 (0.0008) [2023-12-28 05:39:49,060][106225] Updated weights for policy 1, policy_version 1450866 (0.0008) [2023-12-28 05:39:49,379][106226] Updated weights for policy 0, policy_version 1447560 (0.0009) [2023-12-28 05:39:49,440][106226] Updated weights for policy 0, policy_version 1447570 (0.0008) [2023-12-28 05:39:49,506][106226] Updated weights for policy 0, policy_version 1447580 (0.0008) [2023-12-28 05:39:49,786][106225] Updated weights for policy 1, policy_version 1450876 (0.0008) [2023-12-28 05:39:49,851][106225] Updated weights for policy 1, policy_version 1450886 (0.0008) [2023-12-28 05:39:49,920][106225] Updated weights for policy 1, policy_version 1450896 (0.0008) [2023-12-28 05:39:50,249][106226] Updated weights for policy 0, policy_version 1447590 (0.0007) [2023-12-28 05:39:50,312][106226] Updated weights for policy 0, policy_version 1447600 (0.0005) [2023-12-28 05:39:50,377][106226] Updated weights for policy 0, policy_version 1447610 (0.0007) [2023-12-28 05:39:50,600][106225] Updated weights for policy 1, policy_version 1450906 (0.0008) [2023-12-28 05:39:50,663][106225] Updated weights for policy 1, policy_version 1450916 (0.0008) [2023-12-28 05:39:50,724][106225] Updated weights for policy 1, policy_version 1450926 (0.0008) [2023-12-28 05:39:50,787][106225] Updated weights for policy 1, policy_version 1450936 (0.0009) [2023-12-28 05:39:50,999][106226] Updated weights for policy 0, policy_version 1447620 (0.0005) [2023-12-28 05:39:51,068][106226] Updated weights for policy 0, policy_version 1447630 (0.0008) [2023-12-28 05:39:51,135][106226] Updated weights for policy 0, policy_version 1447640 (0.0009) [2023-12-28 05:39:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 742154240. Throughput: 0: 10021.7, 1: 9705.0. Samples: 742167592. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:39:51,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.303')] [2023-12-28 05:39:51,580][106225] Updated weights for policy 1, policy_version 1450946 (0.0007) [2023-12-28 05:39:51,646][106225] Updated weights for policy 1, policy_version 1450956 (0.0008) [2023-12-28 05:39:51,719][106225] Updated weights for policy 1, policy_version 1450966 (0.0008) [2023-12-28 05:39:51,857][106226] Updated weights for policy 0, policy_version 1447650 (0.0009) [2023-12-28 05:39:51,911][106226] Updated weights for policy 0, policy_version 1447660 (0.0006) [2023-12-28 05:39:51,970][106226] Updated weights for policy 0, policy_version 1447670 (0.0006) [2023-12-28 05:39:52,027][106226] Updated weights for policy 0, policy_version 1447680 (0.0006) [2023-12-28 05:39:52,462][106225] Updated weights for policy 1, policy_version 1450976 (0.0008) [2023-12-28 05:39:52,515][106225] Updated weights for policy 1, policy_version 1450986 (0.0007) [2023-12-28 05:39:52,575][106225] Updated weights for policy 1, policy_version 1450996 (0.0009) [2023-12-28 05:39:52,702][106226] Updated weights for policy 0, policy_version 1447690 (0.0009) [2023-12-28 05:39:52,763][106226] Updated weights for policy 0, policy_version 1447700 (0.0006) [2023-12-28 05:39:52,822][106226] Updated weights for policy 0, policy_version 1447710 (0.0005) [2023-12-28 05:39:53,338][106225] Updated weights for policy 1, policy_version 1451006 (0.0009) [2023-12-28 05:39:53,402][106225] Updated weights for policy 1, policy_version 1451016 (0.0009) [2023-12-28 05:39:53,440][106226] Updated weights for policy 0, policy_version 1447720 (0.0005) [2023-12-28 05:39:53,462][106225] Updated weights for policy 1, policy_version 1451026 (0.0008) [2023-12-28 05:39:53,499][106226] Updated weights for policy 0, policy_version 1447730 (0.0008) [2023-12-28 05:39:53,552][106226] Updated weights for policy 0, policy_version 1447740 (0.0005) [2023-12-28 05:39:54,068][106226] Updated weights for policy 0, policy_version 1447750 (0.0005) [2023-12-28 05:39:54,120][106226] Updated weights for policy 0, policy_version 1447760 (0.0005) [2023-12-28 05:39:54,171][106226] Updated weights for policy 0, policy_version 1447770 (0.0005) [2023-12-28 05:39:54,286][106225] Updated weights for policy 1, policy_version 1451036 (0.0008) [2023-12-28 05:39:54,350][106225] Updated weights for policy 1, policy_version 1451046 (0.0009) [2023-12-28 05:39:54,411][106225] Updated weights for policy 1, policy_version 1451056 (0.0010) [2023-12-28 05:39:54,852][106226] Updated weights for policy 0, policy_version 1447780 (0.0008) [2023-12-28 05:39:54,906][106226] Updated weights for policy 0, policy_version 1447790 (0.0010) [2023-12-28 05:39:54,966][106226] Updated weights for policy 0, policy_version 1447800 (0.0010) [2023-12-28 05:39:55,137][106225] Updated weights for policy 1, policy_version 1451066 (0.0010) [2023-12-28 05:39:55,187][106225] Updated weights for policy 1, policy_version 1451076 (0.0010) [2023-12-28 05:39:55,236][106225] Updated weights for policy 1, policy_version 1451086 (0.0010) [2023-12-28 05:39:55,285][106225] Updated weights for policy 1, policy_version 1451096 (0.0010) [2023-12-28 05:39:55,589][106226] Updated weights for policy 0, policy_version 1447810 (0.0008) [2023-12-28 05:39:55,653][106226] Updated weights for policy 0, policy_version 1447820 (0.0005) [2023-12-28 05:39:55,710][106226] Updated weights for policy 0, policy_version 1447830 (0.0005) [2023-12-28 05:39:55,762][106226] Updated weights for policy 0, policy_version 1447840 (0.0005) [2023-12-28 05:39:56,031][106225] Updated weights for policy 1, policy_version 1451106 (0.0010) [2023-12-28 05:39:56,084][106225] Updated weights for policy 1, policy_version 1451116 (0.0010) [2023-12-28 05:39:56,139][106225] Updated weights for policy 1, policy_version 1451126 (0.0010) [2023-12-28 05:39:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 742260736. Throughput: 0: 10103.1, 1: 9652.8. Samples: 742226444. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:39:56,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.655')] [2023-12-28 05:39:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001451128_371539968.pth... [2023-12-28 05:39:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001447840_370720768.pth... [2023-12-28 05:39:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001450008_371253248.pth [2023-12-28 05:39:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001446624_370409472.pth [2023-12-28 05:39:56,339][106226] Updated weights for policy 0, policy_version 1447850 (0.0010) [2023-12-28 05:39:56,409][106226] Updated weights for policy 0, policy_version 1447860 (0.0009) [2023-12-28 05:39:56,474][106226] Updated weights for policy 0, policy_version 1447870 (0.0008) [2023-12-28 05:39:56,800][106225] Updated weights for policy 1, policy_version 1451136 (0.0006) [2023-12-28 05:39:56,842][106225] Updated weights for policy 1, policy_version 1451146 (0.0005) [2023-12-28 05:39:56,887][106225] Updated weights for policy 1, policy_version 1451156 (0.0005) [2023-12-28 05:39:57,088][106226] Updated weights for policy 0, policy_version 1447880 (0.0006) [2023-12-28 05:39:57,143][106226] Updated weights for policy 0, policy_version 1447890 (0.0005) [2023-12-28 05:39:57,197][106226] Updated weights for policy 0, policy_version 1447900 (0.0005) [2023-12-28 05:39:57,591][106225] Updated weights for policy 1, policy_version 1451166 (0.0009) [2023-12-28 05:39:57,656][106225] Updated weights for policy 1, policy_version 1451176 (0.0010) [2023-12-28 05:39:57,718][106225] Updated weights for policy 1, policy_version 1451186 (0.0010) [2023-12-28 05:39:57,759][106226] Updated weights for policy 0, policy_version 1447910 (0.0007) [2023-12-28 05:39:57,806][106226] Updated weights for policy 0, policy_version 1447920 (0.0008) [2023-12-28 05:39:57,854][106226] Updated weights for policy 0, policy_version 1447930 (0.0007) [2023-12-28 05:39:58,418][106225] Updated weights for policy 1, policy_version 1451196 (0.0010) [2023-12-28 05:39:58,486][106225] Updated weights for policy 1, policy_version 1451206 (0.0010) [2023-12-28 05:39:58,550][106225] Updated weights for policy 1, policy_version 1451216 (0.0011) [2023-12-28 05:39:58,612][106226] Updated weights for policy 0, policy_version 1447940 (0.0007) [2023-12-28 05:39:58,684][106226] Updated weights for policy 0, policy_version 1447950 (0.0007) [2023-12-28 05:39:58,756][106226] Updated weights for policy 0, policy_version 1447960 (0.0007) [2023-12-28 05:39:59,302][106225] Updated weights for policy 1, policy_version 1451226 (0.0009) [2023-12-28 05:39:59,366][106225] Updated weights for policy 1, policy_version 1451236 (0.0008) [2023-12-28 05:39:59,428][106225] Updated weights for policy 1, policy_version 1451246 (0.0009) [2023-12-28 05:39:59,479][106225] Updated weights for policy 1, policy_version 1451256 (0.0005) [2023-12-28 05:39:59,538][106226] Updated weights for policy 0, policy_version 1447970 (0.0007) [2023-12-28 05:39:59,594][106226] Updated weights for policy 0, policy_version 1447980 (0.0008) [2023-12-28 05:39:59,647][106226] Updated weights for policy 0, policy_version 1447990 (0.0009) [2023-12-28 05:39:59,704][106226] Updated weights for policy 0, policy_version 1448000 (0.0008) [2023-12-28 05:40:00,144][106225] Updated weights for policy 1, policy_version 1451266 (0.0008) [2023-12-28 05:40:00,204][106225] Updated weights for policy 1, policy_version 1451276 (0.0008) [2023-12-28 05:40:00,262][106225] Updated weights for policy 1, policy_version 1451286 (0.0008) [2023-12-28 05:40:00,497][106226] Updated weights for policy 0, policy_version 1448010 (0.0008) [2023-12-28 05:40:00,550][106226] Updated weights for policy 0, policy_version 1448020 (0.0006) [2023-12-28 05:40:00,601][106226] Updated weights for policy 0, policy_version 1448030 (0.0006) [2023-12-28 05:40:00,955][106225] Updated weights for policy 1, policy_version 1451296 (0.0008) [2023-12-28 05:40:00,999][106225] Updated weights for policy 1, policy_version 1451306 (0.0008) [2023-12-28 05:40:01,055][106225] Updated weights for policy 1, policy_version 1451316 (0.0008) [2023-12-28 05:40:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 742359040. Throughput: 0: 10203.4, 1: 9659.5. Samples: 742346044. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:01,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.523')] [2023-12-28 05:40:01,374][106226] Updated weights for policy 0, policy_version 1448040 (0.0008) [2023-12-28 05:40:01,447][106226] Updated weights for policy 0, policy_version 1448050 (0.0010) [2023-12-28 05:40:01,516][106226] Updated weights for policy 0, policy_version 1448060 (0.0010) [2023-12-28 05:40:01,764][106225] Updated weights for policy 1, policy_version 1451326 (0.0008) [2023-12-28 05:40:01,823][106225] Updated weights for policy 1, policy_version 1451336 (0.0008) [2023-12-28 05:40:01,878][106225] Updated weights for policy 1, policy_version 1451346 (0.0005) [2023-12-28 05:40:02,321][106226] Updated weights for policy 0, policy_version 1448070 (0.0009) [2023-12-28 05:40:02,386][106226] Updated weights for policy 0, policy_version 1448080 (0.0008) [2023-12-28 05:40:02,444][106226] Updated weights for policy 0, policy_version 1448090 (0.0008) [2023-12-28 05:40:02,544][106225] Updated weights for policy 1, policy_version 1451356 (0.0006) [2023-12-28 05:40:02,601][106225] Updated weights for policy 1, policy_version 1451366 (0.0009) [2023-12-28 05:40:02,658][106225] Updated weights for policy 1, policy_version 1451376 (0.0005) [2023-12-28 05:40:03,199][106226] Updated weights for policy 0, policy_version 1448100 (0.0007) [2023-12-28 05:40:03,233][106225] Updated weights for policy 1, policy_version 1451386 (0.0006) [2023-12-28 05:40:03,252][106226] Updated weights for policy 0, policy_version 1448110 (0.0008) [2023-12-28 05:40:03,283][106225] Updated weights for policy 1, policy_version 1451396 (0.0010) [2023-12-28 05:40:03,318][106226] Updated weights for policy 0, policy_version 1448120 (0.0005) [2023-12-28 05:40:03,333][106225] Updated weights for policy 1, policy_version 1451406 (0.0009) [2023-12-28 05:40:03,389][106225] Updated weights for policy 1, policy_version 1451416 (0.0010) [2023-12-28 05:40:03,907][106226] Updated weights for policy 0, policy_version 1448130 (0.0006) [2023-12-28 05:40:03,969][106226] Updated weights for policy 0, policy_version 1448140 (0.0007) [2023-12-28 05:40:04,037][106226] Updated weights for policy 0, policy_version 1448150 (0.0006) [2023-12-28 05:40:04,102][106226] Updated weights for policy 0, policy_version 1448160 (0.0007) [2023-12-28 05:40:04,127][106225] Updated weights for policy 1, policy_version 1451426 (0.0008) [2023-12-28 05:40:04,192][106225] Updated weights for policy 1, policy_version 1451436 (0.0009) [2023-12-28 05:40:04,257][106225] Updated weights for policy 1, policy_version 1451446 (0.0009) [2023-12-28 05:40:04,745][106226] Updated weights for policy 0, policy_version 1448170 (0.0011) [2023-12-28 05:40:04,796][106226] Updated weights for policy 0, policy_version 1448180 (0.0010) [2023-12-28 05:40:04,850][106226] Updated weights for policy 0, policy_version 1448190 (0.0010) [2023-12-28 05:40:05,006][106225] Updated weights for policy 1, policy_version 1451456 (0.0008) [2023-12-28 05:40:05,053][106225] Updated weights for policy 1, policy_version 1451466 (0.0005) [2023-12-28 05:40:05,108][106225] Updated weights for policy 1, policy_version 1451476 (0.0006) [2023-12-28 05:40:05,582][106226] Updated weights for policy 0, policy_version 1448200 (0.0010) [2023-12-28 05:40:05,631][106226] Updated weights for policy 0, policy_version 1448210 (0.0010) [2023-12-28 05:40:05,683][106226] Updated weights for policy 0, policy_version 1448220 (0.0010) [2023-12-28 05:40:05,784][106225] Updated weights for policy 1, policy_version 1451486 (0.0005) [2023-12-28 05:40:05,841][106225] Updated weights for policy 1, policy_version 1451496 (0.0005) [2023-12-28 05:40:05,902][106225] Updated weights for policy 1, policy_version 1451506 (0.0008) [2023-12-28 05:40:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 742457344. Throughput: 0: 10143.1, 1: 9746.0. Samples: 742465100. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:06,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.652')] [2023-12-28 05:40:06,447][106226] Updated weights for policy 0, policy_version 1448230 (0.0008) [2023-12-28 05:40:06,508][106226] Updated weights for policy 0, policy_version 1448240 (0.0008) [2023-12-28 05:40:06,572][106226] Updated weights for policy 0, policy_version 1448250 (0.0007) [2023-12-28 05:40:06,586][106225] Updated weights for policy 1, policy_version 1451516 (0.0007) [2023-12-28 05:40:06,650][106225] Updated weights for policy 1, policy_version 1451526 (0.0007) [2023-12-28 05:40:06,712][106225] Updated weights for policy 1, policy_version 1451536 (0.0008) [2023-12-28 05:40:07,248][106226] Updated weights for policy 0, policy_version 1448260 (0.0011) [2023-12-28 05:40:07,309][106226] Updated weights for policy 0, policy_version 1448270 (0.0011) [2023-12-28 05:40:07,363][106226] Updated weights for policy 0, policy_version 1448280 (0.0010) [2023-12-28 05:40:07,436][106225] Updated weights for policy 1, policy_version 1451546 (0.0007) [2023-12-28 05:40:07,491][106225] Updated weights for policy 1, policy_version 1451556 (0.0008) [2023-12-28 05:40:07,537][106225] Updated weights for policy 1, policy_version 1451566 (0.0007) [2023-12-28 05:40:07,587][106225] Updated weights for policy 1, policy_version 1451576 (0.0008) [2023-12-28 05:40:08,086][106226] Updated weights for policy 0, policy_version 1448290 (0.0011) [2023-12-28 05:40:08,136][106226] Updated weights for policy 0, policy_version 1448300 (0.0010) [2023-12-28 05:40:08,194][106226] Updated weights for policy 0, policy_version 1448310 (0.0011) [2023-12-28 05:40:08,259][106226] Updated weights for policy 0, policy_version 1448320 (0.0011) [2023-12-28 05:40:08,307][106225] Updated weights for policy 1, policy_version 1451586 (0.0008) [2023-12-28 05:40:08,380][106225] Updated weights for policy 1, policy_version 1451596 (0.0007) [2023-12-28 05:40:08,446][106225] Updated weights for policy 1, policy_version 1451606 (0.0006) [2023-12-28 05:40:08,975][106226] Updated weights for policy 0, policy_version 1448330 (0.0011) [2023-12-28 05:40:09,036][106226] Updated weights for policy 0, policy_version 1448340 (0.0011) [2023-12-28 05:40:09,097][106226] Updated weights for policy 0, policy_version 1448350 (0.0010) [2023-12-28 05:40:09,154][106225] Updated weights for policy 1, policy_version 1451616 (0.0007) [2023-12-28 05:40:09,204][106225] Updated weights for policy 1, policy_version 1451626 (0.0008) [2023-12-28 05:40:09,300][106225] Updated weights for policy 1, policy_version 1451636 (0.0008) [2023-12-28 05:40:09,834][106226] Updated weights for policy 0, policy_version 1448360 (0.0008) [2023-12-28 05:40:09,905][106226] Updated weights for policy 0, policy_version 1448370 (0.0007) [2023-12-28 05:40:09,966][106226] Updated weights for policy 0, policy_version 1448380 (0.0007) [2023-12-28 05:40:10,032][106225] Updated weights for policy 1, policy_version 1451646 (0.0010) [2023-12-28 05:40:10,087][106225] Updated weights for policy 1, policy_version 1451656 (0.0010) [2023-12-28 05:40:10,155][106225] Updated weights for policy 1, policy_version 1451666 (0.0011) [2023-12-28 05:40:10,601][106226] Updated weights for policy 0, policy_version 1448390 (0.0007) [2023-12-28 05:40:10,663][106226] Updated weights for policy 0, policy_version 1448400 (0.0008) [2023-12-28 05:40:10,718][106226] Updated weights for policy 0, policy_version 1448410 (0.0008) [2023-12-28 05:40:10,900][106225] Updated weights for policy 1, policy_version 1451676 (0.0010) [2023-12-28 05:40:10,962][106225] Updated weights for policy 1, policy_version 1451686 (0.0010) [2023-12-28 05:40:11,030][106225] Updated weights for policy 1, policy_version 1451696 (0.0007) [2023-12-28 05:40:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 742555648. Throughput: 0: 10144.2, 1: 9720.1. Samples: 742523188. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:11,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.811')] [2023-12-28 05:40:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001451704_371687424.pth... [2023-12-28 05:40:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001448416_370868224.pth... [2023-12-28 05:40:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001450552_371392512.pth [2023-12-28 05:40:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001447232_370565120.pth [2023-12-28 05:40:11,372][106226] Updated weights for policy 0, policy_version 1448420 (0.0007) [2023-12-28 05:40:11,441][106226] Updated weights for policy 0, policy_version 1448430 (0.0007) [2023-12-28 05:40:11,510][106226] Updated weights for policy 0, policy_version 1448440 (0.0008) [2023-12-28 05:40:11,852][106225] Updated weights for policy 1, policy_version 1451706 (0.0009) [2023-12-28 05:40:11,912][106225] Updated weights for policy 1, policy_version 1451716 (0.0008) [2023-12-28 05:40:11,980][106225] Updated weights for policy 1, policy_version 1451726 (0.0009) [2023-12-28 05:40:12,047][106225] Updated weights for policy 1, policy_version 1451736 (0.0007) [2023-12-28 05:40:12,247][106226] Updated weights for policy 0, policy_version 1448450 (0.0009) [2023-12-28 05:40:12,310][106226] Updated weights for policy 0, policy_version 1448460 (0.0009) [2023-12-28 05:40:12,380][106226] Updated weights for policy 0, policy_version 1448470 (0.0009) [2023-12-28 05:40:12,439][106226] Updated weights for policy 0, policy_version 1448480 (0.0009) [2023-12-28 05:40:12,732][106225] Updated weights for policy 1, policy_version 1451746 (0.0009) [2023-12-28 05:40:12,794][106225] Updated weights for policy 1, policy_version 1451756 (0.0008) [2023-12-28 05:40:12,852][106225] Updated weights for policy 1, policy_version 1451766 (0.0008) [2023-12-28 05:40:13,215][106226] Updated weights for policy 0, policy_version 1448490 (0.0008) [2023-12-28 05:40:13,274][106226] Updated weights for policy 0, policy_version 1448500 (0.0008) [2023-12-28 05:40:13,335][106226] Updated weights for policy 0, policy_version 1448510 (0.0008) [2023-12-28 05:40:13,510][106225] Updated weights for policy 1, policy_version 1451776 (0.0008) [2023-12-28 05:40:13,573][106225] Updated weights for policy 1, policy_version 1451786 (0.0009) [2023-12-28 05:40:13,623][106225] Updated weights for policy 1, policy_version 1451796 (0.0007) [2023-12-28 05:40:14,085][106226] Updated weights for policy 0, policy_version 1448520 (0.0009) [2023-12-28 05:40:14,150][106226] Updated weights for policy 0, policy_version 1448530 (0.0008) [2023-12-28 05:40:14,207][106226] Updated weights for policy 0, policy_version 1448540 (0.0007) [2023-12-28 05:40:14,261][106225] Updated weights for policy 1, policy_version 1451806 (0.0005) [2023-12-28 05:40:14,334][106225] Updated weights for policy 1, policy_version 1451816 (0.0005) [2023-12-28 05:40:14,390][106225] Updated weights for policy 1, policy_version 1451826 (0.0005) [2023-12-28 05:40:14,885][106226] Updated weights for policy 0, policy_version 1448550 (0.0009) [2023-12-28 05:40:14,951][106226] Updated weights for policy 0, policy_version 1448560 (0.0009) [2023-12-28 05:40:14,969][106225] Updated weights for policy 1, policy_version 1451836 (0.0007) [2023-12-28 05:40:15,010][106226] Updated weights for policy 0, policy_version 1448570 (0.0008) [2023-12-28 05:40:15,033][106225] Updated weights for policy 1, policy_version 1451846 (0.0007) [2023-12-28 05:40:15,098][106225] Updated weights for policy 1, policy_version 1451856 (0.0008) [2023-12-28 05:40:15,753][106226] Updated weights for policy 0, policy_version 1448580 (0.0010) [2023-12-28 05:40:15,808][106225] Updated weights for policy 1, policy_version 1451866 (0.0008) [2023-12-28 05:40:15,815][106226] Updated weights for policy 0, policy_version 1448590 (0.0008) [2023-12-28 05:40:15,866][106225] Updated weights for policy 1, policy_version 1451876 (0.0009) [2023-12-28 05:40:15,872][106226] Updated weights for policy 0, policy_version 1448600 (0.0008) [2023-12-28 05:40:15,923][106225] Updated weights for policy 1, policy_version 1451886 (0.0009) [2023-12-28 05:40:15,984][106225] Updated weights for policy 1, policy_version 1451896 (0.0008) [2023-12-28 05:40:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 742653952. Throughput: 0: 10087.2, 1: 9704.5. Samples: 742639880. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:16,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-4.984')] [2023-12-28 05:40:16,566][106226] Updated weights for policy 0, policy_version 1448610 (0.0005) [2023-12-28 05:40:16,621][106226] Updated weights for policy 0, policy_version 1448620 (0.0005) [2023-12-28 05:40:16,675][106226] Updated weights for policy 0, policy_version 1448630 (0.0006) [2023-12-28 05:40:16,678][106225] Updated weights for policy 1, policy_version 1451906 (0.0005) [2023-12-28 05:40:16,729][106225] Updated weights for policy 1, policy_version 1451916 (0.0009) [2023-12-28 05:40:16,731][106226] Updated weights for policy 0, policy_version 1448640 (0.0010) [2023-12-28 05:40:16,788][106225] Updated weights for policy 1, policy_version 1451926 (0.0008) [2023-12-28 05:40:17,364][106226] Updated weights for policy 0, policy_version 1448650 (0.0007) [2023-12-28 05:40:17,425][106226] Updated weights for policy 0, policy_version 1448660 (0.0005) [2023-12-28 05:40:17,494][106226] Updated weights for policy 0, policy_version 1448670 (0.0006) [2023-12-28 05:40:17,511][106225] Updated weights for policy 1, policy_version 1451936 (0.0006) [2023-12-28 05:40:17,578][106225] Updated weights for policy 1, policy_version 1451946 (0.0010) [2023-12-28 05:40:17,645][106225] Updated weights for policy 1, policy_version 1451956 (0.0010) [2023-12-28 05:40:18,035][106226] Updated weights for policy 0, policy_version 1448680 (0.0006) [2023-12-28 05:40:18,086][106226] Updated weights for policy 0, policy_version 1448690 (0.0009) [2023-12-28 05:40:18,141][106226] Updated weights for policy 0, policy_version 1448700 (0.0008) [2023-12-28 05:40:18,257][106225] Updated weights for policy 1, policy_version 1451966 (0.0007) [2023-12-28 05:40:18,324][106225] Updated weights for policy 1, policy_version 1451976 (0.0008) [2023-12-28 05:40:18,392][106225] Updated weights for policy 1, policy_version 1451986 (0.0007) [2023-12-28 05:40:18,931][106226] Updated weights for policy 0, policy_version 1448710 (0.0010) [2023-12-28 05:40:18,985][106226] Updated weights for policy 0, policy_version 1448720 (0.0008) [2023-12-28 05:40:19,003][106225] Updated weights for policy 1, policy_version 1451996 (0.0007) [2023-12-28 05:40:19,066][106225] Updated weights for policy 1, policy_version 1452006 (0.0006) [2023-12-28 05:40:19,074][106226] Updated weights for policy 0, policy_version 1448730 (0.0007) [2023-12-28 05:40:19,136][106225] Updated weights for policy 1, policy_version 1452016 (0.0008) [2023-12-28 05:40:19,760][106226] Updated weights for policy 0, policy_version 1448740 (0.0007) [2023-12-28 05:40:19,823][106226] Updated weights for policy 0, policy_version 1448750 (0.0008) [2023-12-28 05:40:19,886][106226] Updated weights for policy 0, policy_version 1448760 (0.0008) [2023-12-28 05:40:19,895][106225] Updated weights for policy 1, policy_version 1452026 (0.0010) [2023-12-28 05:40:19,956][106225] Updated weights for policy 1, policy_version 1452036 (0.0007) [2023-12-28 05:40:20,019][106225] Updated weights for policy 1, policy_version 1452046 (0.0008) [2023-12-28 05:40:20,078][106225] Updated weights for policy 1, policy_version 1452056 (0.0008) [2023-12-28 05:40:20,644][106226] Updated weights for policy 0, policy_version 1448770 (0.0006) [2023-12-28 05:40:20,710][106226] Updated weights for policy 0, policy_version 1448780 (0.0007) [2023-12-28 05:40:20,768][106226] Updated weights for policy 0, policy_version 1448790 (0.0011) [2023-12-28 05:40:20,803][106225] Updated weights for policy 1, policy_version 1452066 (0.0007) [2023-12-28 05:40:20,836][106226] Updated weights for policy 0, policy_version 1448800 (0.0011) [2023-12-28 05:40:20,868][106225] Updated weights for policy 1, policy_version 1452076 (0.0006) [2023-12-28 05:40:20,933][106225] Updated weights for policy 1, policy_version 1452086 (0.0005) [2023-12-28 05:40:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 742752256. Throughput: 0: 10046.3, 1: 9743.2. Samples: 742759500. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:21,175][105115] Avg episode reward: [(0, '-4.881'), (1, '-4.812')] [2023-12-28 05:40:21,608][106226] Updated weights for policy 0, policy_version 1448810 (0.0008) [2023-12-28 05:40:21,651][106225] Updated weights for policy 1, policy_version 1452096 (0.0008) [2023-12-28 05:40:21,675][106226] Updated weights for policy 0, policy_version 1448820 (0.0007) [2023-12-28 05:40:21,711][106225] Updated weights for policy 1, policy_version 1452106 (0.0007) [2023-12-28 05:40:21,736][106226] Updated weights for policy 0, policy_version 1448830 (0.0009) [2023-12-28 05:40:21,779][106225] Updated weights for policy 1, policy_version 1452116 (0.0009) [2023-12-28 05:40:22,485][106225] Updated weights for policy 1, policy_version 1452126 (0.0009) [2023-12-28 05:40:22,529][106226] Updated weights for policy 0, policy_version 1448840 (0.0006) [2023-12-28 05:40:22,543][106225] Updated weights for policy 1, policy_version 1452136 (0.0008) [2023-12-28 05:40:22,584][106226] Updated weights for policy 0, policy_version 1448850 (0.0005) [2023-12-28 05:40:22,600][106225] Updated weights for policy 1, policy_version 1452146 (0.0008) [2023-12-28 05:40:22,642][106226] Updated weights for policy 0, policy_version 1448860 (0.0007) [2023-12-28 05:40:23,346][106226] Updated weights for policy 0, policy_version 1448870 (0.0009) [2023-12-28 05:40:23,361][106225] Updated weights for policy 1, policy_version 1452156 (0.0009) [2023-12-28 05:40:23,402][106226] Updated weights for policy 0, policy_version 1448880 (0.0009) [2023-12-28 05:40:23,411][106225] Updated weights for policy 1, policy_version 1452166 (0.0010) [2023-12-28 05:40:23,460][106226] Updated weights for policy 0, policy_version 1448890 (0.0007) [2023-12-28 05:40:23,462][106225] Updated weights for policy 1, policy_version 1452176 (0.0010) [2023-12-28 05:40:24,067][106225] Updated weights for policy 1, policy_version 1452186 (0.0009) [2023-12-28 05:40:24,123][106225] Updated weights for policy 1, policy_version 1452196 (0.0005) [2023-12-28 05:40:24,169][106225] Updated weights for policy 1, policy_version 1452206 (0.0005) [2023-12-28 05:40:24,217][106225] Updated weights for policy 1, policy_version 1452216 (0.0005) [2023-12-28 05:40:24,255][106226] Updated weights for policy 0, policy_version 1448900 (0.0007) [2023-12-28 05:40:24,316][106226] Updated weights for policy 0, policy_version 1448910 (0.0009) [2023-12-28 05:40:24,380][106226] Updated weights for policy 0, policy_version 1448920 (0.0009) [2023-12-28 05:40:24,809][106225] Updated weights for policy 1, policy_version 1452226 (0.0009) [2023-12-28 05:40:24,862][106225] Updated weights for policy 1, policy_version 1452236 (0.0009) [2023-12-28 05:40:24,923][106225] Updated weights for policy 1, policy_version 1452246 (0.0008) [2023-12-28 05:40:25,159][106226] Updated weights for policy 0, policy_version 1448930 (0.0008) [2023-12-28 05:40:25,210][106226] Updated weights for policy 0, policy_version 1448940 (0.0007) [2023-12-28 05:40:25,259][106226] Updated weights for policy 0, policy_version 1448950 (0.0009) [2023-12-28 05:40:25,308][106226] Updated weights for policy 0, policy_version 1448960 (0.0008) [2023-12-28 05:40:25,716][106225] Updated weights for policy 1, policy_version 1452256 (0.0008) [2023-12-28 05:40:25,763][106225] Updated weights for policy 1, policy_version 1452266 (0.0009) [2023-12-28 05:40:25,806][106225] Updated weights for policy 1, policy_version 1452276 (0.0009) [2023-12-28 05:40:25,921][106226] Updated weights for policy 0, policy_version 1448970 (0.0008) [2023-12-28 05:40:25,969][106226] Updated weights for policy 0, policy_version 1448980 (0.0008) [2023-12-28 05:40:26,015][106226] Updated weights for policy 0, policy_version 1448990 (0.0009) [2023-12-28 05:40:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 742850560. Throughput: 0: 9913.3, 1: 9784.5. Samples: 742815664. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:26,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-4.808')] [2023-12-28 05:40:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001452280_371834880.pth... [2023-12-28 05:40:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001448992_371015680.pth... [2023-12-28 05:40:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001451128_371539968.pth [2023-12-28 05:40:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001447840_370720768.pth [2023-12-28 05:40:26,594][106225] Updated weights for policy 1, policy_version 1452286 (0.0008) [2023-12-28 05:40:26,642][106225] Updated weights for policy 1, policy_version 1452296 (0.0008) [2023-12-28 05:40:26,691][106226] Updated weights for policy 0, policy_version 1449000 (0.0008) [2023-12-28 05:40:26,692][106225] Updated weights for policy 1, policy_version 1452306 (0.0008) [2023-12-28 05:40:26,752][106226] Updated weights for policy 0, policy_version 1449010 (0.0005) [2023-12-28 05:40:26,815][106226] Updated weights for policy 0, policy_version 1449020 (0.0006) [2023-12-28 05:40:27,434][106226] Updated weights for policy 0, policy_version 1449030 (0.0005) [2023-12-28 05:40:27,457][106225] Updated weights for policy 1, policy_version 1452316 (0.0008) [2023-12-28 05:40:27,480][106226] Updated weights for policy 0, policy_version 1449040 (0.0007) [2023-12-28 05:40:27,515][106225] Updated weights for policy 1, policy_version 1452326 (0.0007) [2023-12-28 05:40:27,532][106226] Updated weights for policy 0, policy_version 1449050 (0.0007) [2023-12-28 05:40:27,567][106225] Updated weights for policy 1, policy_version 1452336 (0.0006) [2023-12-28 05:40:28,111][106226] Updated weights for policy 0, policy_version 1449060 (0.0008) [2023-12-28 05:40:28,170][106226] Updated weights for policy 0, policy_version 1449070 (0.0008) [2023-12-28 05:40:28,224][106226] Updated weights for policy 0, policy_version 1449080 (0.0008) [2023-12-28 05:40:28,228][106225] Updated weights for policy 1, policy_version 1452346 (0.0006) [2023-12-28 05:40:28,279][106225] Updated weights for policy 1, policy_version 1452356 (0.0007) [2023-12-28 05:40:28,336][106225] Updated weights for policy 1, policy_version 1452366 (0.0008) [2023-12-28 05:40:28,402][106225] Updated weights for policy 1, policy_version 1452376 (0.0009) [2023-12-28 05:40:28,975][106226] Updated weights for policy 0, policy_version 1449090 (0.0008) [2023-12-28 05:40:29,030][106226] Updated weights for policy 0, policy_version 1449100 (0.0008) [2023-12-28 05:40:29,086][106226] Updated weights for policy 0, policy_version 1449110 (0.0008) [2023-12-28 05:40:29,127][106225] Updated weights for policy 1, policy_version 1452386 (0.0008) [2023-12-28 05:40:29,136][106226] Updated weights for policy 0, policy_version 1449120 (0.0006) [2023-12-28 05:40:29,173][106225] Updated weights for policy 1, policy_version 1452396 (0.0008) [2023-12-28 05:40:29,223][106225] Updated weights for policy 1, policy_version 1452406 (0.0008) [2023-12-28 05:40:29,811][106226] Updated weights for policy 0, policy_version 1449130 (0.0009) [2023-12-28 05:40:29,879][106226] Updated weights for policy 0, policy_version 1449140 (0.0007) [2023-12-28 05:40:29,951][106226] Updated weights for policy 0, policy_version 1449150 (0.0007) [2023-12-28 05:40:30,010][106225] Updated weights for policy 1, policy_version 1452416 (0.0006) [2023-12-28 05:40:30,064][106225] Updated weights for policy 1, policy_version 1452426 (0.0008) [2023-12-28 05:40:30,125][106225] Updated weights for policy 1, policy_version 1452436 (0.0007) [2023-12-28 05:40:30,641][106226] Updated weights for policy 0, policy_version 1449160 (0.0009) [2023-12-28 05:40:30,692][106226] Updated weights for policy 0, policy_version 1449170 (0.0008) [2023-12-28 05:40:30,715][106225] Updated weights for policy 1, policy_version 1452446 (0.0005) [2023-12-28 05:40:30,741][106226] Updated weights for policy 0, policy_version 1449180 (0.0010) [2023-12-28 05:40:30,763][106225] Updated weights for policy 1, policy_version 1452456 (0.0005) [2023-12-28 05:40:30,809][106225] Updated weights for policy 1, policy_version 1452466 (0.0005) [2023-12-28 05:40:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 742948864. Throughput: 0: 9973.7, 1: 9834.1. Samples: 742936304. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:31,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-4.369')] [2023-12-28 05:40:31,436][106226] Updated weights for policy 0, policy_version 1449190 (0.0006) [2023-12-28 05:40:31,483][106225] Updated weights for policy 1, policy_version 1452476 (0.0007) [2023-12-28 05:40:31,489][106226] Updated weights for policy 0, policy_version 1449200 (0.0006) [2023-12-28 05:40:31,534][106225] Updated weights for policy 1, policy_version 1452486 (0.0006) [2023-12-28 05:40:31,539][106226] Updated weights for policy 0, policy_version 1449210 (0.0009) [2023-12-28 05:40:31,593][106225] Updated weights for policy 1, policy_version 1452496 (0.0009) [2023-12-28 05:40:32,276][106226] Updated weights for policy 0, policy_version 1449220 (0.0007) [2023-12-28 05:40:32,276][106225] Updated weights for policy 1, policy_version 1452506 (0.0009) [2023-12-28 05:40:32,334][106225] Updated weights for policy 1, policy_version 1452516 (0.0009) [2023-12-28 05:40:32,335][106226] Updated weights for policy 0, policy_version 1449230 (0.0010) [2023-12-28 05:40:32,398][106225] Updated weights for policy 1, policy_version 1452526 (0.0008) [2023-12-28 05:40:32,400][106226] Updated weights for policy 0, policy_version 1449240 (0.0007) [2023-12-28 05:40:32,453][106225] Updated weights for policy 1, policy_version 1452536 (0.0008) [2023-12-28 05:40:33,132][106226] Updated weights for policy 0, policy_version 1449250 (0.0007) [2023-12-28 05:40:33,140][106225] Updated weights for policy 1, policy_version 1452546 (0.0008) [2023-12-28 05:40:33,187][106226] Updated weights for policy 0, policy_version 1449260 (0.0010) [2023-12-28 05:40:33,193][106225] Updated weights for policy 1, policy_version 1452556 (0.0007) [2023-12-28 05:40:33,242][106225] Updated weights for policy 1, policy_version 1452566 (0.0006) [2023-12-28 05:40:33,247][106226] Updated weights for policy 0, policy_version 1449270 (0.0010) [2023-12-28 05:40:33,305][106226] Updated weights for policy 0, policy_version 1449280 (0.0010) [2023-12-28 05:40:33,893][106225] Updated weights for policy 1, policy_version 1452576 (0.0006) [2023-12-28 05:40:33,954][106225] Updated weights for policy 1, policy_version 1452586 (0.0005) [2023-12-28 05:40:34,016][106225] Updated weights for policy 1, policy_version 1452596 (0.0005) [2023-12-28 05:40:34,035][106226] Updated weights for policy 0, policy_version 1449290 (0.0007) [2023-12-28 05:40:34,089][106226] Updated weights for policy 0, policy_version 1449300 (0.0010) [2023-12-28 05:40:34,165][106226] Updated weights for policy 0, policy_version 1449310 (0.0011) [2023-12-28 05:40:34,615][106225] Updated weights for policy 1, policy_version 1452606 (0.0008) [2023-12-28 05:40:34,681][106225] Updated weights for policy 1, policy_version 1452616 (0.0009) [2023-12-28 05:40:34,746][106225] Updated weights for policy 1, policy_version 1452626 (0.0009) [2023-12-28 05:40:34,888][106226] Updated weights for policy 0, policy_version 1449320 (0.0007) [2023-12-28 05:40:34,957][106226] Updated weights for policy 0, policy_version 1449330 (0.0007) [2023-12-28 05:40:35,025][106226] Updated weights for policy 0, policy_version 1449340 (0.0008) [2023-12-28 05:40:35,475][106225] Updated weights for policy 1, policy_version 1452636 (0.0010) [2023-12-28 05:40:35,535][106225] Updated weights for policy 1, policy_version 1452646 (0.0010) [2023-12-28 05:40:35,552][106226] Updated weights for policy 0, policy_version 1449350 (0.0006) [2023-12-28 05:40:35,592][106225] Updated weights for policy 1, policy_version 1452656 (0.0010) [2023-12-28 05:40:35,606][106226] Updated weights for policy 0, policy_version 1449360 (0.0005) [2023-12-28 05:40:35,655][106226] Updated weights for policy 0, policy_version 1449370 (0.0007) [2023-12-28 05:40:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 743047168. Throughput: 0: 9945.3, 1: 9863.1. Samples: 743058968. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:36,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-4.871')] [2023-12-28 05:40:36,312][106225] Updated weights for policy 1, policy_version 1452666 (0.0010) [2023-12-28 05:40:36,364][106226] Updated weights for policy 0, policy_version 1449380 (0.0010) [2023-12-28 05:40:36,364][106225] Updated weights for policy 1, policy_version 1452676 (0.0009) [2023-12-28 05:40:36,419][106225] Updated weights for policy 1, policy_version 1452686 (0.0010) [2023-12-28 05:40:36,429][106226] Updated weights for policy 0, policy_version 1449390 (0.0008) [2023-12-28 05:40:36,478][106225] Updated weights for policy 1, policy_version 1452696 (0.0011) [2023-12-28 05:40:36,496][106226] Updated weights for policy 0, policy_version 1449400 (0.0006) [2023-12-28 05:40:37,103][106225] Updated weights for policy 1, policy_version 1452706 (0.0006) [2023-12-28 05:40:37,161][106225] Updated weights for policy 1, policy_version 1452716 (0.0009) [2023-12-28 05:40:37,208][106225] Updated weights for policy 1, policy_version 1452726 (0.0010) [2023-12-28 05:40:37,290][106226] Updated weights for policy 0, policy_version 1449410 (0.0008) [2023-12-28 05:40:37,337][106226] Updated weights for policy 0, policy_version 1449420 (0.0008) [2023-12-28 05:40:37,387][106226] Updated weights for policy 0, policy_version 1449430 (0.0009) [2023-12-28 05:40:37,437][106226] Updated weights for policy 0, policy_version 1449440 (0.0009) [2023-12-28 05:40:37,879][106225] Updated weights for policy 1, policy_version 1452736 (0.0010) [2023-12-28 05:40:37,930][106225] Updated weights for policy 1, policy_version 1452746 (0.0010) [2023-12-28 05:40:37,977][106225] Updated weights for policy 1, policy_version 1452756 (0.0010) [2023-12-28 05:40:38,091][106226] Updated weights for policy 0, policy_version 1449450 (0.0008) [2023-12-28 05:40:38,146][106226] Updated weights for policy 0, policy_version 1449460 (0.0009) [2023-12-28 05:40:38,200][106226] Updated weights for policy 0, policy_version 1449470 (0.0008) [2023-12-28 05:40:38,673][106225] Updated weights for policy 1, policy_version 1452766 (0.0010) [2023-12-28 05:40:38,730][106225] Updated weights for policy 1, policy_version 1452776 (0.0010) [2023-12-28 05:40:38,792][106225] Updated weights for policy 1, policy_version 1452786 (0.0009) [2023-12-28 05:40:38,975][106226] Updated weights for policy 0, policy_version 1449480 (0.0009) [2023-12-28 05:40:39,029][106226] Updated weights for policy 0, policy_version 1449490 (0.0008) [2023-12-28 05:40:39,079][106226] Updated weights for policy 0, policy_version 1449500 (0.0007) [2023-12-28 05:40:39,585][106225] Updated weights for policy 1, policy_version 1452796 (0.0010) [2023-12-28 05:40:39,638][106225] Updated weights for policy 1, policy_version 1452806 (0.0008) [2023-12-28 05:40:39,697][106225] Updated weights for policy 1, policy_version 1452816 (0.0007) [2023-12-28 05:40:39,869][106226] Updated weights for policy 0, policy_version 1449510 (0.0009) [2023-12-28 05:40:39,928][106226] Updated weights for policy 0, policy_version 1449520 (0.0008) [2023-12-28 05:40:39,995][106226] Updated weights for policy 0, policy_version 1449530 (0.0006) [2023-12-28 05:40:40,507][106225] Updated weights for policy 1, policy_version 1452826 (0.0006) [2023-12-28 05:40:40,567][106225] Updated weights for policy 1, policy_version 1452836 (0.0008) [2023-12-28 05:40:40,620][106225] Updated weights for policy 1, policy_version 1452846 (0.0009) [2023-12-28 05:40:40,675][106225] Updated weights for policy 1, policy_version 1452856 (0.0008) [2023-12-28 05:40:40,728][106226] Updated weights for policy 0, policy_version 1449540 (0.0009) [2023-12-28 05:40:40,794][106226] Updated weights for policy 0, policy_version 1449550 (0.0009) [2023-12-28 05:40:40,849][106226] Updated weights for policy 0, policy_version 1449560 (0.0008) [2023-12-28 05:40:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 743145472. Throughput: 0: 9860.2, 1: 9956.8. Samples: 743118212. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:41,175][105115] Avg episode reward: [(0, '-4.945'), (1, '-4.595')] [2023-12-28 05:40:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001452856_371982336.pth... [2023-12-28 05:40:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001449568_371163136.pth... [2023-12-28 05:40:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001451704_371687424.pth [2023-12-28 05:40:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001448416_370868224.pth [2023-12-28 05:40:41,461][106225] Updated weights for policy 1, policy_version 1452866 (0.0009) [2023-12-28 05:40:41,521][106225] Updated weights for policy 1, policy_version 1452876 (0.0008) [2023-12-28 05:40:41,543][106226] Updated weights for policy 0, policy_version 1449570 (0.0008) [2023-12-28 05:40:41,581][106225] Updated weights for policy 1, policy_version 1452886 (0.0007) [2023-12-28 05:40:41,606][106226] Updated weights for policy 0, policy_version 1449580 (0.0007) [2023-12-28 05:40:41,671][106226] Updated weights for policy 0, policy_version 1449590 (0.0009) [2023-12-28 05:40:41,747][106226] Updated weights for policy 0, policy_version 1449600 (0.0009) [2023-12-28 05:40:42,282][106225] Updated weights for policy 1, policy_version 1452896 (0.0008) [2023-12-28 05:40:42,349][106225] Updated weights for policy 1, policy_version 1452906 (0.0007) [2023-12-28 05:40:42,416][106225] Updated weights for policy 1, policy_version 1452916 (0.0006) [2023-12-28 05:40:42,547][106226] Updated weights for policy 0, policy_version 1449610 (0.0010) [2023-12-28 05:40:42,597][106226] Updated weights for policy 0, policy_version 1449620 (0.0009) [2023-12-28 05:40:42,651][106226] Updated weights for policy 0, policy_version 1449630 (0.0009) [2023-12-28 05:40:43,081][106225] Updated weights for policy 1, policy_version 1452926 (0.0006) [2023-12-28 05:40:43,137][106225] Updated weights for policy 1, policy_version 1452936 (0.0005) [2023-12-28 05:40:43,190][106225] Updated weights for policy 1, policy_version 1452946 (0.0006) [2023-12-28 05:40:43,407][106226] Updated weights for policy 0, policy_version 1449640 (0.0007) [2023-12-28 05:40:43,474][106226] Updated weights for policy 0, policy_version 1449650 (0.0008) [2023-12-28 05:40:43,536][106226] Updated weights for policy 0, policy_version 1449660 (0.0008) [2023-12-28 05:40:43,890][106225] Updated weights for policy 1, policy_version 1452956 (0.0007) [2023-12-28 05:40:43,953][106225] Updated weights for policy 1, policy_version 1452966 (0.0010) [2023-12-28 05:40:44,015][106225] Updated weights for policy 1, policy_version 1452976 (0.0010) [2023-12-28 05:40:44,149][106226] Updated weights for policy 0, policy_version 1449670 (0.0011) [2023-12-28 05:40:44,213][106226] Updated weights for policy 0, policy_version 1449680 (0.0011) [2023-12-28 05:40:44,274][106226] Updated weights for policy 0, policy_version 1449690 (0.0011) [2023-12-28 05:40:44,662][106225] Updated weights for policy 1, policy_version 1452986 (0.0008) [2023-12-28 05:40:44,717][106225] Updated weights for policy 1, policy_version 1452996 (0.0006) [2023-12-28 05:40:44,781][106225] Updated weights for policy 1, policy_version 1453006 (0.0008) [2023-12-28 05:40:44,844][106225] Updated weights for policy 1, policy_version 1453016 (0.0010) [2023-12-28 05:40:44,991][106226] Updated weights for policy 0, policy_version 1449700 (0.0010) [2023-12-28 05:40:45,047][106226] Updated weights for policy 0, policy_version 1449710 (0.0007) [2023-12-28 05:40:45,113][106226] Updated weights for policy 0, policy_version 1449720 (0.0007) [2023-12-28 05:40:45,554][106225] Updated weights for policy 1, policy_version 1453026 (0.0010) [2023-12-28 05:40:45,610][106225] Updated weights for policy 1, policy_version 1453036 (0.0010) [2023-12-28 05:40:45,674][106225] Updated weights for policy 1, policy_version 1453046 (0.0010) [2023-12-28 05:40:45,777][106226] Updated weights for policy 0, policy_version 1449730 (0.0007) [2023-12-28 05:40:45,827][106226] Updated weights for policy 0, policy_version 1449740 (0.0010) [2023-12-28 05:40:45,889][106226] Updated weights for policy 0, policy_version 1449750 (0.0010) [2023-12-28 05:40:45,939][106226] Updated weights for policy 0, policy_version 1449760 (0.0010) [2023-12-28 05:40:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 743243776. Throughput: 0: 9761.8, 1: 9936.2. Samples: 743232460. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:46,176][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.494')] [2023-12-28 05:40:46,354][106225] Updated weights for policy 1, policy_version 1453056 (0.0006) [2023-12-28 05:40:46,409][106225] Updated weights for policy 1, policy_version 1453066 (0.0005) [2023-12-28 05:40:46,461][106225] Updated weights for policy 1, policy_version 1453076 (0.0010) [2023-12-28 05:40:46,670][106226] Updated weights for policy 0, policy_version 1449770 (0.0007) [2023-12-28 05:40:46,730][106226] Updated weights for policy 0, policy_version 1449780 (0.0005) [2023-12-28 05:40:46,793][106226] Updated weights for policy 0, policy_version 1449790 (0.0009) [2023-12-28 05:40:47,146][106225] Updated weights for policy 1, policy_version 1453086 (0.0008) [2023-12-28 05:40:47,201][106225] Updated weights for policy 1, policy_version 1453096 (0.0006) [2023-12-28 05:40:47,256][106225] Updated weights for policy 1, policy_version 1453106 (0.0005) [2023-12-28 05:40:47,357][106226] Updated weights for policy 0, policy_version 1449800 (0.0007) [2023-12-28 05:40:47,432][106226] Updated weights for policy 0, policy_version 1449810 (0.0006) [2023-12-28 05:40:47,490][106226] Updated weights for policy 0, policy_version 1449820 (0.0005) [2023-12-28 05:40:47,816][106225] Updated weights for policy 1, policy_version 1453116 (0.0005) [2023-12-28 05:40:47,870][106225] Updated weights for policy 1, policy_version 1453126 (0.0005) [2023-12-28 05:40:47,923][106225] Updated weights for policy 1, policy_version 1453136 (0.0006) [2023-12-28 05:40:48,070][106226] Updated weights for policy 0, policy_version 1449830 (0.0008) [2023-12-28 05:40:48,129][106226] Updated weights for policy 0, policy_version 1449840 (0.0008) [2023-12-28 05:40:48,201][106226] Updated weights for policy 0, policy_version 1449850 (0.0005) [2023-12-28 05:40:48,534][106225] Updated weights for policy 1, policy_version 1453146 (0.0009) [2023-12-28 05:40:48,590][106225] Updated weights for policy 1, policy_version 1453156 (0.0008) [2023-12-28 05:40:48,638][106225] Updated weights for policy 1, policy_version 1453166 (0.0008) [2023-12-28 05:40:48,688][106225] Updated weights for policy 1, policy_version 1453176 (0.0008) [2023-12-28 05:40:48,841][106226] Updated weights for policy 0, policy_version 1449860 (0.0006) [2023-12-28 05:40:48,903][106226] Updated weights for policy 0, policy_version 1449870 (0.0009) [2023-12-28 05:40:48,961][106226] Updated weights for policy 0, policy_version 1449880 (0.0007) [2023-12-28 05:40:49,460][106225] Updated weights for policy 1, policy_version 1453186 (0.0009) [2023-12-28 05:40:49,512][106225] Updated weights for policy 1, policy_version 1453196 (0.0008) [2023-12-28 05:40:49,558][106225] Updated weights for policy 1, policy_version 1453206 (0.0008) [2023-12-28 05:40:49,671][106226] Updated weights for policy 0, policy_version 1449890 (0.0008) [2023-12-28 05:40:49,733][106226] Updated weights for policy 0, policy_version 1449900 (0.0008) [2023-12-28 05:40:49,798][106226] Updated weights for policy 0, policy_version 1449910 (0.0008) [2023-12-28 05:40:49,865][106226] Updated weights for policy 0, policy_version 1449920 (0.0009) [2023-12-28 05:40:50,329][106225] Updated weights for policy 1, policy_version 1453216 (0.0008) [2023-12-28 05:40:50,392][106225] Updated weights for policy 1, policy_version 1453226 (0.0007) [2023-12-28 05:40:50,453][106225] Updated weights for policy 1, policy_version 1453236 (0.0009) [2023-12-28 05:40:50,574][106226] Updated weights for policy 0, policy_version 1449930 (0.0008) [2023-12-28 05:40:50,635][106226] Updated weights for policy 0, policy_version 1449940 (0.0007) [2023-12-28 05:40:50,693][106226] Updated weights for policy 0, policy_version 1449950 (0.0006) [2023-12-28 05:40:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 743342080. Throughput: 0: 9843.2, 1: 9908.7. Samples: 743353936. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:51,175][105115] Avg episode reward: [(0, '-4.971'), (1, '-4.783')] [2023-12-28 05:40:51,216][106225] Updated weights for policy 1, policy_version 1453246 (0.0008) [2023-12-28 05:40:51,277][106225] Updated weights for policy 1, policy_version 1453256 (0.0008) [2023-12-28 05:40:51,337][106225] Updated weights for policy 1, policy_version 1453266 (0.0008) [2023-12-28 05:40:51,375][106226] Updated weights for policy 0, policy_version 1449960 (0.0009) [2023-12-28 05:40:51,441][106226] Updated weights for policy 0, policy_version 1449970 (0.0009) [2023-12-28 05:40:51,503][106226] Updated weights for policy 0, policy_version 1449980 (0.0009) [2023-12-28 05:40:52,089][106225] Updated weights for policy 1, policy_version 1453276 (0.0006) [2023-12-28 05:40:52,148][106225] Updated weights for policy 1, policy_version 1453286 (0.0006) [2023-12-28 05:40:52,201][106225] Updated weights for policy 1, policy_version 1453296 (0.0005) [2023-12-28 05:40:52,272][106226] Updated weights for policy 0, policy_version 1449990 (0.0009) [2023-12-28 05:40:52,323][106226] Updated weights for policy 0, policy_version 1450000 (0.0009) [2023-12-28 05:40:52,385][106226] Updated weights for policy 0, policy_version 1450010 (0.0007) [2023-12-28 05:40:52,888][106225] Updated weights for policy 1, policy_version 1453306 (0.0006) [2023-12-28 05:40:52,945][106225] Updated weights for policy 1, policy_version 1453316 (0.0009) [2023-12-28 05:40:52,997][106225] Updated weights for policy 1, policy_version 1453326 (0.0008) [2023-12-28 05:40:53,047][106225] Updated weights for policy 1, policy_version 1453336 (0.0009) [2023-12-28 05:40:53,142][106226] Updated weights for policy 0, policy_version 1450020 (0.0008) [2023-12-28 05:40:53,202][106226] Updated weights for policy 0, policy_version 1450030 (0.0007) [2023-12-28 05:40:53,257][106226] Updated weights for policy 0, policy_version 1450040 (0.0008) [2023-12-28 05:40:53,712][106225] Updated weights for policy 1, policy_version 1453346 (0.0006) [2023-12-28 05:40:53,761][106225] Updated weights for policy 1, policy_version 1453356 (0.0010) [2023-12-28 05:40:53,811][106225] Updated weights for policy 1, policy_version 1453366 (0.0010) [2023-12-28 05:40:54,014][106226] Updated weights for policy 0, policy_version 1450050 (0.0008) [2023-12-28 05:40:54,072][106226] Updated weights for policy 0, policy_version 1450060 (0.0005) [2023-12-28 05:40:54,133][106226] Updated weights for policy 0, policy_version 1450070 (0.0006) [2023-12-28 05:40:54,182][106226] Updated weights for policy 0, policy_version 1450080 (0.0010) [2023-12-28 05:40:54,525][106225] Updated weights for policy 1, policy_version 1453376 (0.0010) [2023-12-28 05:40:54,579][106225] Updated weights for policy 1, policy_version 1453386 (0.0010) [2023-12-28 05:40:54,639][106225] Updated weights for policy 1, policy_version 1453396 (0.0010) [2023-12-28 05:40:54,783][106226] Updated weights for policy 0, policy_version 1450090 (0.0009) [2023-12-28 05:40:54,851][106226] Updated weights for policy 0, policy_version 1450100 (0.0008) [2023-12-28 05:40:54,916][106226] Updated weights for policy 0, policy_version 1450110 (0.0008) [2023-12-28 05:40:55,369][106225] Updated weights for policy 1, policy_version 1453406 (0.0009) [2023-12-28 05:40:55,430][106225] Updated weights for policy 1, policy_version 1453416 (0.0007) [2023-12-28 05:40:55,483][106225] Updated weights for policy 1, policy_version 1453426 (0.0007) [2023-12-28 05:40:55,679][106226] Updated weights for policy 0, policy_version 1450120 (0.0007) [2023-12-28 05:40:55,737][106226] Updated weights for policy 0, policy_version 1450130 (0.0008) [2023-12-28 05:40:55,787][106226] Updated weights for policy 0, policy_version 1450140 (0.0006) [2023-12-28 05:40:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 743440384. Throughput: 0: 9814.2, 1: 9923.0. Samples: 743411364. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:40:56,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-5.027')] [2023-12-28 05:40:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001450144_371310592.pth... [2023-12-28 05:40:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001453432_372129792.pth... [2023-12-28 05:40:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001452280_371834880.pth [2023-12-28 05:40:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001448992_371015680.pth [2023-12-28 05:40:56,212][106225] Updated weights for policy 1, policy_version 1453436 (0.0008) [2023-12-28 05:40:56,265][106225] Updated weights for policy 1, policy_version 1453446 (0.0009) [2023-12-28 05:40:56,318][106225] Updated weights for policy 1, policy_version 1453456 (0.0009) [2023-12-28 05:40:56,410][106226] Updated weights for policy 0, policy_version 1450150 (0.0007) [2023-12-28 05:40:56,462][106226] Updated weights for policy 0, policy_version 1450160 (0.0010) [2023-12-28 05:40:56,522][106226] Updated weights for policy 0, policy_version 1450170 (0.0007) [2023-12-28 05:40:57,086][106226] Updated weights for policy 0, policy_version 1450180 (0.0006) [2023-12-28 05:40:57,109][106225] Updated weights for policy 1, policy_version 1453466 (0.0007) [2023-12-28 05:40:57,152][106226] Updated weights for policy 0, policy_version 1450190 (0.0008) [2023-12-28 05:40:57,158][106225] Updated weights for policy 1, policy_version 1453476 (0.0005) [2023-12-28 05:40:57,204][106226] Updated weights for policy 0, policy_version 1450200 (0.0005) [2023-12-28 05:40:57,224][106225] Updated weights for policy 1, policy_version 1453486 (0.0008) [2023-12-28 05:40:57,286][106225] Updated weights for policy 1, policy_version 1453496 (0.0008) [2023-12-28 05:40:57,813][106226] Updated weights for policy 0, policy_version 1450210 (0.0006) [2023-12-28 05:40:57,870][106226] Updated weights for policy 0, policy_version 1450220 (0.0005) [2023-12-28 05:40:57,929][106225] Updated weights for policy 1, policy_version 1453506 (0.0009) [2023-12-28 05:40:57,933][106226] Updated weights for policy 0, policy_version 1450230 (0.0005) [2023-12-28 05:40:57,978][106225] Updated weights for policy 1, policy_version 1453516 (0.0007) [2023-12-28 05:40:57,987][106226] Updated weights for policy 0, policy_version 1450240 (0.0005) [2023-12-28 05:40:58,028][106225] Updated weights for policy 1, policy_version 1453526 (0.0007) [2023-12-28 05:40:58,672][106226] Updated weights for policy 0, policy_version 1450250 (0.0008) [2023-12-28 05:40:58,733][106226] Updated weights for policy 0, policy_version 1450260 (0.0007) [2023-12-28 05:40:58,781][106225] Updated weights for policy 1, policy_version 1453536 (0.0007) [2023-12-28 05:40:58,807][106226] Updated weights for policy 0, policy_version 1450271 (0.0008) [2023-12-28 05:40:58,855][106225] Updated weights for policy 1, policy_version 1453546 (0.0009) [2023-12-28 05:40:58,920][106225] Updated weights for policy 1, policy_version 1453556 (0.0008) [2023-12-28 05:40:59,683][106226] Updated weights for policy 0, policy_version 1450281 (0.0013) [2023-12-28 05:40:59,694][106225] Updated weights for policy 1, policy_version 1453566 (0.0006) [2023-12-28 05:40:59,739][106226] Updated weights for policy 0, policy_version 1450291 (0.0010) [2023-12-28 05:40:59,742][106225] Updated weights for policy 1, policy_version 1453576 (0.0007) [2023-12-28 05:40:59,791][106225] Updated weights for policy 1, policy_version 1453586 (0.0009) [2023-12-28 05:40:59,793][106226] Updated weights for policy 0, policy_version 1450301 (0.0010) [2023-12-28 05:41:00,430][106225] Updated weights for policy 1, policy_version 1453596 (0.0008) [2023-12-28 05:41:00,495][106225] Updated weights for policy 1, policy_version 1453606 (0.0009) [2023-12-28 05:41:00,546][106226] Updated weights for policy 0, policy_version 1450311 (0.0007) [2023-12-28 05:41:00,553][106225] Updated weights for policy 1, policy_version 1453616 (0.0007) [2023-12-28 05:41:00,603][106226] Updated weights for policy 0, policy_version 1450321 (0.0006) [2023-12-28 05:41:00,658][106226] Updated weights for policy 0, policy_version 1450331 (0.0006) [2023-12-28 05:41:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 743538688. Throughput: 0: 9872.3, 1: 9882.9. Samples: 743528860. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:01,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.878')] [2023-12-28 05:41:01,235][106225] Updated weights for policy 1, policy_version 1453626 (0.0009) [2023-12-28 05:41:01,285][106226] Updated weights for policy 0, policy_version 1450341 (0.0008) [2023-12-28 05:41:01,296][106225] Updated weights for policy 1, policy_version 1453636 (0.0007) [2023-12-28 05:41:01,346][106226] Updated weights for policy 0, policy_version 1450351 (0.0007) [2023-12-28 05:41:01,357][106225] Updated weights for policy 1, policy_version 1453646 (0.0006) [2023-12-28 05:41:01,418][106226] Updated weights for policy 0, policy_version 1450361 (0.0009) [2023-12-28 05:41:01,424][106225] Updated weights for policy 1, policy_version 1453656 (0.0007) [2023-12-28 05:41:02,086][106225] Updated weights for policy 1, policy_version 1453666 (0.0010) [2023-12-28 05:41:02,146][106225] Updated weights for policy 1, policy_version 1453676 (0.0010) [2023-12-28 05:41:02,204][106225] Updated weights for policy 1, policy_version 1453686 (0.0010) [2023-12-28 05:41:02,205][106226] Updated weights for policy 0, policy_version 1450371 (0.0007) [2023-12-28 05:41:02,264][106226] Updated weights for policy 0, policy_version 1450381 (0.0008) [2023-12-28 05:41:02,329][106226] Updated weights for policy 0, policy_version 1450391 (0.0009) [2023-12-28 05:41:02,851][106225] Updated weights for policy 1, policy_version 1453696 (0.0010) [2023-12-28 05:41:02,898][106225] Updated weights for policy 1, policy_version 1453706 (0.0010) [2023-12-28 05:41:02,948][106225] Updated weights for policy 1, policy_version 1453716 (0.0010) [2023-12-28 05:41:02,979][106226] Updated weights for policy 0, policy_version 1450401 (0.0007) [2023-12-28 05:41:03,027][106226] Updated weights for policy 0, policy_version 1450411 (0.0010) [2023-12-28 05:41:03,076][106226] Updated weights for policy 0, policy_version 1450421 (0.0007) [2023-12-28 05:41:03,131][106226] Updated weights for policy 0, policy_version 1450431 (0.0005) [2023-12-28 05:41:03,647][106225] Updated weights for policy 1, policy_version 1453726 (0.0010) [2023-12-28 05:41:03,700][106225] Updated weights for policy 1, policy_version 1453736 (0.0010) [2023-12-28 05:41:03,746][106225] Updated weights for policy 1, policy_version 1453746 (0.0010) [2023-12-28 05:41:03,838][106226] Updated weights for policy 0, policy_version 1450441 (0.0007) [2023-12-28 05:41:03,904][106226] Updated weights for policy 0, policy_version 1450451 (0.0008) [2023-12-28 05:41:03,963][106226] Updated weights for policy 0, policy_version 1450461 (0.0009) [2023-12-28 05:41:04,495][106225] Updated weights for policy 1, policy_version 1453756 (0.0010) [2023-12-28 05:41:04,553][106225] Updated weights for policy 1, policy_version 1453766 (0.0010) [2023-12-28 05:41:04,619][106225] Updated weights for policy 1, policy_version 1453776 (0.0008) [2023-12-28 05:41:04,686][106226] Updated weights for policy 0, policy_version 1450471 (0.0010) [2023-12-28 05:41:04,740][106226] Updated weights for policy 0, policy_version 1450481 (0.0010) [2023-12-28 05:41:04,789][106226] Updated weights for policy 0, policy_version 1450491 (0.0010) [2023-12-28 05:41:05,325][106225] Updated weights for policy 1, policy_version 1453786 (0.0010) [2023-12-28 05:41:05,389][106225] Updated weights for policy 1, policy_version 1453796 (0.0008) [2023-12-28 05:41:05,452][106225] Updated weights for policy 1, policy_version 1453806 (0.0009) [2023-12-28 05:41:05,479][106226] Updated weights for policy 0, policy_version 1450501 (0.0010) [2023-12-28 05:41:05,505][106225] Updated weights for policy 1, policy_version 1453816 (0.0010) [2023-12-28 05:41:05,538][106226] Updated weights for policy 0, policy_version 1450511 (0.0010) [2023-12-28 05:41:05,599][106226] Updated weights for policy 0, policy_version 1450521 (0.0011) [2023-12-28 05:41:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 743636992. Throughput: 0: 9873.5, 1: 9911.8. Samples: 743649840. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:06,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.536')] [2023-12-28 05:41:06,215][106225] Updated weights for policy 1, policy_version 1453826 (0.0009) [2023-12-28 05:41:06,259][106226] Updated weights for policy 0, policy_version 1450531 (0.0008) [2023-12-28 05:41:06,278][106225] Updated weights for policy 1, policy_version 1453836 (0.0008) [2023-12-28 05:41:06,315][106226] Updated weights for policy 0, policy_version 1450541 (0.0008) [2023-12-28 05:41:06,337][106225] Updated weights for policy 1, policy_version 1453846 (0.0006) [2023-12-28 05:41:06,379][106226] Updated weights for policy 0, policy_version 1450551 (0.0008) [2023-12-28 05:41:07,028][106225] Updated weights for policy 1, policy_version 1453856 (0.0006) [2023-12-28 05:41:07,091][106225] Updated weights for policy 1, policy_version 1453866 (0.0006) [2023-12-28 05:41:07,142][106226] Updated weights for policy 0, policy_version 1450561 (0.0009) [2023-12-28 05:41:07,151][106225] Updated weights for policy 1, policy_version 1453876 (0.0005) [2023-12-28 05:41:07,215][106226] Updated weights for policy 0, policy_version 1450571 (0.0008) [2023-12-28 05:41:07,284][106226] Updated weights for policy 0, policy_version 1450581 (0.0008) [2023-12-28 05:41:07,349][106226] Updated weights for policy 0, policy_version 1450591 (0.0008) [2023-12-28 05:41:07,771][106225] Updated weights for policy 1, policy_version 1453886 (0.0006) [2023-12-28 05:41:07,828][106225] Updated weights for policy 1, policy_version 1453896 (0.0005) [2023-12-28 05:41:07,888][106225] Updated weights for policy 1, policy_version 1453906 (0.0005) [2023-12-28 05:41:08,015][106226] Updated weights for policy 0, policy_version 1450601 (0.0009) [2023-12-28 05:41:08,063][106226] Updated weights for policy 0, policy_version 1450612 (0.0008) [2023-12-28 05:41:08,119][106226] Updated weights for policy 0, policy_version 1450622 (0.0008) [2023-12-28 05:41:08,430][106225] Updated weights for policy 1, policy_version 1453916 (0.0007) [2023-12-28 05:41:08,488][106225] Updated weights for policy 1, policy_version 1453926 (0.0010) [2023-12-28 05:41:08,548][106225] Updated weights for policy 1, policy_version 1453936 (0.0010) [2023-12-28 05:41:08,908][106226] Updated weights for policy 0, policy_version 1450632 (0.0009) [2023-12-28 05:41:08,956][106226] Updated weights for policy 0, policy_version 1450642 (0.0009) [2023-12-28 05:41:09,004][106226] Updated weights for policy 0, policy_version 1450652 (0.0008) [2023-12-28 05:41:09,236][106225] Updated weights for policy 1, policy_version 1453946 (0.0009) [2023-12-28 05:41:09,299][106225] Updated weights for policy 1, policy_version 1453956 (0.0007) [2023-12-28 05:41:09,366][106225] Updated weights for policy 1, policy_version 1453966 (0.0008) [2023-12-28 05:41:09,430][106225] Updated weights for policy 1, policy_version 1453976 (0.0009) [2023-12-28 05:41:09,859][106226] Updated weights for policy 0, policy_version 1450662 (0.0008) [2023-12-28 05:41:09,926][106226] Updated weights for policy 0, policy_version 1450672 (0.0007) [2023-12-28 05:41:09,999][106226] Updated weights for policy 0, policy_version 1450682 (0.0008) [2023-12-28 05:41:10,145][106225] Updated weights for policy 1, policy_version 1453986 (0.0011) [2023-12-28 05:41:10,204][106225] Updated weights for policy 1, policy_version 1453996 (0.0011) [2023-12-28 05:41:10,272][106225] Updated weights for policy 1, policy_version 1454006 (0.0011) [2023-12-28 05:41:10,724][106226] Updated weights for policy 0, policy_version 1450692 (0.0008) [2023-12-28 05:41:10,780][106226] Updated weights for policy 0, policy_version 1450702 (0.0009) [2023-12-28 05:41:10,835][106226] Updated weights for policy 0, policy_version 1450712 (0.0008) [2023-12-28 05:41:10,940][106225] Updated weights for policy 1, policy_version 1454016 (0.0006) [2023-12-28 05:41:10,995][106225] Updated weights for policy 1, policy_version 1454026 (0.0006) [2023-12-28 05:41:11,064][106225] Updated weights for policy 1, policy_version 1454036 (0.0009) [2023-12-28 05:41:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 743743488. Throughput: 0: 9898.7, 1: 9965.9. Samples: 743709568. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:11,175][105115] Avg episode reward: [(0, '-4.749'), (1, '-4.617')] [2023-12-28 05:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001450720_371458048.pth... [2023-12-28 05:41:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001454040_372285440.pth... [2023-12-28 05:41:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001452856_371982336.pth [2023-12-28 05:41:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001449568_371163136.pth [2023-12-28 05:41:11,664][106226] Updated weights for policy 0, policy_version 1450722 (0.0008) [2023-12-28 05:41:11,729][106226] Updated weights for policy 0, policy_version 1450732 (0.0008) [2023-12-28 05:41:11,789][106226] Updated weights for policy 0, policy_version 1450742 (0.0008) [2023-12-28 05:41:11,832][106225] Updated weights for policy 1, policy_version 1454046 (0.0008) [2023-12-28 05:41:11,855][106226] Updated weights for policy 0, policy_version 1450752 (0.0008) [2023-12-28 05:41:11,896][106225] Updated weights for policy 1, policy_version 1454056 (0.0008) [2023-12-28 05:41:11,961][106225] Updated weights for policy 1, policy_version 1454066 (0.0010) [2023-12-28 05:41:12,585][106226] Updated weights for policy 0, policy_version 1450762 (0.0005) [2023-12-28 05:41:12,653][106226] Updated weights for policy 0, policy_version 1450772 (0.0008) [2023-12-28 05:41:12,680][106225] Updated weights for policy 1, policy_version 1454076 (0.0008) [2023-12-28 05:41:12,712][106226] Updated weights for policy 0, policy_version 1450782 (0.0009) [2023-12-28 05:41:12,735][106225] Updated weights for policy 1, policy_version 1454086 (0.0006) [2023-12-28 05:41:12,798][106225] Updated weights for policy 1, policy_version 1454096 (0.0008) [2023-12-28 05:41:13,377][106225] Updated weights for policy 1, policy_version 1454106 (0.0008) [2023-12-28 05:41:13,434][106225] Updated weights for policy 1, policy_version 1454116 (0.0005) [2023-12-28 05:41:13,471][106226] Updated weights for policy 0, policy_version 1450792 (0.0007) [2023-12-28 05:41:13,488][106225] Updated weights for policy 1, policy_version 1454126 (0.0005) [2023-12-28 05:41:13,532][106226] Updated weights for policy 0, policy_version 1450802 (0.0008) [2023-12-28 05:41:13,541][106225] Updated weights for policy 1, policy_version 1454136 (0.0007) [2023-12-28 05:41:13,583][106226] Updated weights for policy 0, policy_version 1450812 (0.0007) [2023-12-28 05:41:14,180][106225] Updated weights for policy 1, policy_version 1454146 (0.0010) [2023-12-28 05:41:14,184][106226] Updated weights for policy 0, policy_version 1450822 (0.0007) [2023-12-28 05:41:14,238][106226] Updated weights for policy 0, policy_version 1450832 (0.0008) [2023-12-28 05:41:14,243][106225] Updated weights for policy 1, policy_version 1454156 (0.0007) [2023-12-28 05:41:14,293][106226] Updated weights for policy 0, policy_version 1450842 (0.0010) [2023-12-28 05:41:14,300][106225] Updated weights for policy 1, policy_version 1454166 (0.0005) [2023-12-28 05:41:14,969][106225] Updated weights for policy 1, policy_version 1454176 (0.0009) [2023-12-28 05:41:15,038][106226] Updated weights for policy 0, policy_version 1450852 (0.0011) [2023-12-28 05:41:15,043][106225] Updated weights for policy 1, policy_version 1454186 (0.0011) [2023-12-28 05:41:15,106][106226] Updated weights for policy 0, policy_version 1450862 (0.0011) [2023-12-28 05:41:15,110][106225] Updated weights for policy 1, policy_version 1454196 (0.0010) [2023-12-28 05:41:15,170][106226] Updated weights for policy 0, policy_version 1450872 (0.0011) [2023-12-28 05:41:15,813][106225] Updated weights for policy 1, policy_version 1454206 (0.0011) [2023-12-28 05:41:15,868][106226] Updated weights for policy 0, policy_version 1450882 (0.0010) [2023-12-28 05:41:15,872][106225] Updated weights for policy 1, policy_version 1454216 (0.0005) [2023-12-28 05:41:15,920][106225] Updated weights for policy 1, policy_version 1454226 (0.0006) [2023-12-28 05:41:15,923][106226] Updated weights for policy 0, policy_version 1450892 (0.0005) [2023-12-28 05:41:15,981][106226] Updated weights for policy 0, policy_version 1450902 (0.0009) [2023-12-28 05:41:16,042][106226] Updated weights for policy 0, policy_version 1450912 (0.0010) [2023-12-28 05:41:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 743841792. Throughput: 0: 9771.7, 1: 10015.1. Samples: 743826712. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:16,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-4.564')] [2023-12-28 05:41:16,575][106225] Updated weights for policy 1, policy_version 1454236 (0.0008) [2023-12-28 05:41:16,631][106225] Updated weights for policy 1, policy_version 1454246 (0.0010) [2023-12-28 05:41:16,688][106225] Updated weights for policy 1, policy_version 1454256 (0.0010) [2023-12-28 05:41:16,734][106226] Updated weights for policy 0, policy_version 1450922 (0.0008) [2023-12-28 05:41:16,791][106226] Updated weights for policy 0, policy_version 1450932 (0.0005) [2023-12-28 05:41:16,847][106226] Updated weights for policy 0, policy_version 1450942 (0.0010) [2023-12-28 05:41:17,411][106225] Updated weights for policy 1, policy_version 1454266 (0.0010) [2023-12-28 05:41:17,458][106225] Updated weights for policy 1, policy_version 1454276 (0.0010) [2023-12-28 05:41:17,501][106225] Updated weights for policy 1, policy_version 1454286 (0.0010) [2023-12-28 05:41:17,547][106225] Updated weights for policy 1, policy_version 1454296 (0.0010) [2023-12-28 05:41:17,553][106226] Updated weights for policy 0, policy_version 1450952 (0.0007) [2023-12-28 05:41:17,599][106226] Updated weights for policy 0, policy_version 1450962 (0.0007) [2023-12-28 05:41:17,642][106226] Updated weights for policy 0, policy_version 1450972 (0.0006) [2023-12-28 05:41:18,154][106225] Updated weights for policy 1, policy_version 1454306 (0.0005) [2023-12-28 05:41:18,204][106225] Updated weights for policy 1, policy_version 1454316 (0.0006) [2023-12-28 05:41:18,250][106225] Updated weights for policy 1, policy_version 1454326 (0.0008) [2023-12-28 05:41:18,279][106226] Updated weights for policy 0, policy_version 1450982 (0.0007) [2023-12-28 05:41:18,335][106226] Updated weights for policy 0, policy_version 1450992 (0.0008) [2023-12-28 05:41:18,399][106226] Updated weights for policy 0, policy_version 1451002 (0.0009) [2023-12-28 05:41:18,983][106225] Updated weights for policy 1, policy_version 1454336 (0.0010) [2023-12-28 05:41:19,039][106225] Updated weights for policy 1, policy_version 1454346 (0.0010) [2023-12-28 05:41:19,090][106225] Updated weights for policy 1, policy_version 1454356 (0.0006) [2023-12-28 05:41:19,154][106226] Updated weights for policy 0, policy_version 1451012 (0.0008) [2023-12-28 05:41:19,217][106226] Updated weights for policy 0, policy_version 1451022 (0.0009) [2023-12-28 05:41:19,285][106226] Updated weights for policy 0, policy_version 1451032 (0.0009) [2023-12-28 05:41:19,774][106225] Updated weights for policy 1, policy_version 1454366 (0.0008) [2023-12-28 05:41:19,836][106225] Updated weights for policy 1, policy_version 1454376 (0.0010) [2023-12-28 05:41:19,908][106225] Updated weights for policy 1, policy_version 1454386 (0.0008) [2023-12-28 05:41:20,046][106226] Updated weights for policy 0, policy_version 1451042 (0.0008) [2023-12-28 05:41:20,106][106226] Updated weights for policy 0, policy_version 1451052 (0.0009) [2023-12-28 05:41:20,163][106226] Updated weights for policy 0, policy_version 1451062 (0.0008) [2023-12-28 05:41:20,224][106226] Updated weights for policy 0, policy_version 1451072 (0.0009) [2023-12-28 05:41:20,674][106225] Updated weights for policy 1, policy_version 1454396 (0.0008) [2023-12-28 05:41:20,741][106225] Updated weights for policy 1, policy_version 1454406 (0.0008) [2023-12-28 05:41:20,804][106225] Updated weights for policy 1, policy_version 1454416 (0.0011) [2023-12-28 05:41:20,958][106226] Updated weights for policy 0, policy_version 1451082 (0.0008) [2023-12-28 05:41:21,014][106226] Updated weights for policy 0, policy_version 1451092 (0.0007) [2023-12-28 05:41:21,083][106226] Updated weights for policy 0, policy_version 1451102 (0.0007) [2023-12-28 05:41:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 743940096. Throughput: 0: 9716.5, 1: 9966.8. Samples: 743944716. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:21,175][105115] Avg episode reward: [(0, '-5.111'), (1, '-4.767')] [2023-12-28 05:41:21,565][106225] Updated weights for policy 1, policy_version 1454426 (0.0008) [2023-12-28 05:41:21,635][106225] Updated weights for policy 1, policy_version 1454436 (0.0008) [2023-12-28 05:41:21,701][106225] Updated weights for policy 1, policy_version 1454446 (0.0009) [2023-12-28 05:41:21,775][106225] Updated weights for policy 1, policy_version 1454456 (0.0008) [2023-12-28 05:41:21,865][106226] Updated weights for policy 0, policy_version 1451112 (0.0007) [2023-12-28 05:41:21,934][106226] Updated weights for policy 0, policy_version 1451122 (0.0007) [2023-12-28 05:41:21,992][106226] Updated weights for policy 0, policy_version 1451132 (0.0009) [2023-12-28 05:41:22,424][106225] Updated weights for policy 1, policy_version 1454466 (0.0008) [2023-12-28 05:41:22,487][106225] Updated weights for policy 1, policy_version 1454476 (0.0007) [2023-12-28 05:41:22,555][106225] Updated weights for policy 1, policy_version 1454486 (0.0010) [2023-12-28 05:41:22,765][106226] Updated weights for policy 0, policy_version 1451142 (0.0009) [2023-12-28 05:41:22,829][106226] Updated weights for policy 0, policy_version 1451152 (0.0008) [2023-12-28 05:41:22,889][106226] Updated weights for policy 0, policy_version 1451162 (0.0008) [2023-12-28 05:41:23,200][106225] Updated weights for policy 1, policy_version 1454496 (0.0008) [2023-12-28 05:41:23,257][106225] Updated weights for policy 1, policy_version 1454506 (0.0009) [2023-12-28 05:41:23,314][106225] Updated weights for policy 1, policy_version 1454516 (0.0005) [2023-12-28 05:41:23,575][106226] Updated weights for policy 0, policy_version 1451172 (0.0008) [2023-12-28 05:41:23,631][106226] Updated weights for policy 0, policy_version 1451182 (0.0005) [2023-12-28 05:41:23,684][106226] Updated weights for policy 0, policy_version 1451192 (0.0005) [2023-12-28 05:41:23,932][106225] Updated weights for policy 1, policy_version 1454526 (0.0006) [2023-12-28 05:41:23,985][106225] Updated weights for policy 1, policy_version 1454536 (0.0008) [2023-12-28 05:41:24,036][106225] Updated weights for policy 1, policy_version 1454546 (0.0008) [2023-12-28 05:41:24,231][106226] Updated weights for policy 0, policy_version 1451202 (0.0006) [2023-12-28 05:41:24,287][106226] Updated weights for policy 0, policy_version 1451212 (0.0007) [2023-12-28 05:41:24,338][106226] Updated weights for policy 0, policy_version 1451222 (0.0006) [2023-12-28 05:41:24,391][106226] Updated weights for policy 0, policy_version 1451232 (0.0008) [2023-12-28 05:41:24,719][106225] Updated weights for policy 1, policy_version 1454556 (0.0008) [2023-12-28 05:41:24,778][106225] Updated weights for policy 1, policy_version 1454566 (0.0005) [2023-12-28 05:41:24,840][106225] Updated weights for policy 1, policy_version 1454576 (0.0008) [2023-12-28 05:41:25,050][106226] Updated weights for policy 0, policy_version 1451242 (0.0010) [2023-12-28 05:41:25,107][106226] Updated weights for policy 0, policy_version 1451252 (0.0010) [2023-12-28 05:41:25,161][106226] Updated weights for policy 0, policy_version 1451262 (0.0010) [2023-12-28 05:41:25,491][106225] Updated weights for policy 1, policy_version 1454586 (0.0006) [2023-12-28 05:41:25,555][106225] Updated weights for policy 1, policy_version 1454596 (0.0010) [2023-12-28 05:41:25,620][106225] Updated weights for policy 1, policy_version 1454606 (0.0010) [2023-12-28 05:41:25,681][106225] Updated weights for policy 1, policy_version 1454616 (0.0009) [2023-12-28 05:41:25,886][106226] Updated weights for policy 0, policy_version 1451272 (0.0011) [2023-12-28 05:41:25,944][106226] Updated weights for policy 0, policy_version 1451282 (0.0011) [2023-12-28 05:41:26,007][106226] Updated weights for policy 0, policy_version 1451292 (0.0011) [2023-12-28 05:41:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 744038400. Throughput: 0: 9751.6, 1: 9963.9. Samples: 744005412. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:26,176][105115] Avg episode reward: [(0, '-5.029'), (1, '-4.673')] [2023-12-28 05:41:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001454616_372432896.pth... [2023-12-28 05:41:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001451296_371605504.pth... [2023-12-28 05:41:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001453432_372129792.pth [2023-12-28 05:41:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001450144_371310592.pth [2023-12-28 05:41:26,312][106225] Updated weights for policy 1, policy_version 1454626 (0.0005) [2023-12-28 05:41:26,363][106225] Updated weights for policy 1, policy_version 1454636 (0.0005) [2023-12-28 05:41:26,426][106225] Updated weights for policy 1, policy_version 1454646 (0.0006) [2023-12-28 05:41:26,708][106226] Updated weights for policy 0, policy_version 1451302 (0.0010) [2023-12-28 05:41:26,757][106226] Updated weights for policy 0, policy_version 1451312 (0.0010) [2023-12-28 05:41:26,812][106226] Updated weights for policy 0, policy_version 1451322 (0.0010) [2023-12-28 05:41:27,089][106225] Updated weights for policy 1, policy_version 1454656 (0.0006) [2023-12-28 05:41:27,154][106225] Updated weights for policy 1, policy_version 1454666 (0.0005) [2023-12-28 05:41:27,206][106225] Updated weights for policy 1, policy_version 1454676 (0.0006) [2023-12-28 05:41:27,545][106226] Updated weights for policy 0, policy_version 1451332 (0.0011) [2023-12-28 05:41:27,603][106226] Updated weights for policy 0, policy_version 1451342 (0.0010) [2023-12-28 05:41:27,655][106226] Updated weights for policy 0, policy_version 1451352 (0.0010) [2023-12-28 05:41:27,814][106225] Updated weights for policy 1, policy_version 1454686 (0.0009) [2023-12-28 05:41:27,864][106225] Updated weights for policy 1, policy_version 1454696 (0.0009) [2023-12-28 05:41:27,929][106225] Updated weights for policy 1, policy_version 1454706 (0.0010) [2023-12-28 05:41:28,367][106226] Updated weights for policy 0, policy_version 1451362 (0.0010) [2023-12-28 05:41:28,437][106226] Updated weights for policy 0, policy_version 1451372 (0.0006) [2023-12-28 05:41:28,498][106226] Updated weights for policy 0, policy_version 1451382 (0.0007) [2023-12-28 05:41:28,561][106226] Updated weights for policy 0, policy_version 1451392 (0.0010) [2023-12-28 05:41:28,629][106225] Updated weights for policy 1, policy_version 1454716 (0.0010) [2023-12-28 05:41:28,690][106225] Updated weights for policy 1, policy_version 1454726 (0.0010) [2023-12-28 05:41:28,754][106225] Updated weights for policy 1, policy_version 1454736 (0.0010) [2023-12-28 05:41:29,311][106226] Updated weights for policy 0, policy_version 1451402 (0.0006) [2023-12-28 05:41:29,364][106225] Updated weights for policy 1, policy_version 1454746 (0.0007) [2023-12-28 05:41:29,371][106226] Updated weights for policy 0, policy_version 1451412 (0.0007) [2023-12-28 05:41:29,425][106225] Updated weights for policy 1, policy_version 1454756 (0.0008) [2023-12-28 05:41:29,434][106226] Updated weights for policy 0, policy_version 1451422 (0.0007) [2023-12-28 05:41:29,481][106225] Updated weights for policy 1, policy_version 1454766 (0.0007) [2023-12-28 05:41:29,532][106225] Updated weights for policy 1, policy_version 1454776 (0.0006) [2023-12-28 05:41:30,118][106226] Updated weights for policy 0, policy_version 1451432 (0.0010) [2023-12-28 05:41:30,176][106226] Updated weights for policy 0, policy_version 1451442 (0.0011) [2023-12-28 05:41:30,182][106225] Updated weights for policy 1, policy_version 1454786 (0.0009) [2023-12-28 05:41:30,233][106226] Updated weights for policy 0, policy_version 1451452 (0.0011) [2023-12-28 05:41:30,243][106225] Updated weights for policy 1, policy_version 1454796 (0.0011) [2023-12-28 05:41:30,308][106225] Updated weights for policy 1, policy_version 1454806 (0.0010) [2023-12-28 05:41:30,909][106225] Updated weights for policy 1, policy_version 1454816 (0.0006) [2023-12-28 05:41:30,944][106226] Updated weights for policy 0, policy_version 1451462 (0.0008) [2023-12-28 05:41:30,963][106225] Updated weights for policy 1, policy_version 1454826 (0.0005) [2023-12-28 05:41:30,989][106226] Updated weights for policy 0, policy_version 1451472 (0.0008) [2023-12-28 05:41:31,030][106225] Updated weights for policy 1, policy_version 1454836 (0.0007) [2023-12-28 05:41:31,055][106226] Updated weights for policy 0, policy_version 1451482 (0.0008) [2023-12-28 05:41:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 744144896. Throughput: 0: 9796.7, 1: 10086.8. Samples: 744127216. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:31,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.828')] [2023-12-28 05:41:31,736][106226] Updated weights for policy 0, policy_version 1451492 (0.0008) [2023-12-28 05:41:31,761][106225] Updated weights for policy 1, policy_version 1454846 (0.0015) [2023-12-28 05:41:31,800][106226] Updated weights for policy 0, policy_version 1451502 (0.0008) [2023-12-28 05:41:31,815][106225] Updated weights for policy 1, policy_version 1454856 (0.0010) [2023-12-28 05:41:31,859][106226] Updated weights for policy 0, policy_version 1451512 (0.0008) [2023-12-28 05:41:31,870][106225] Updated weights for policy 1, policy_version 1454866 (0.0010) [2023-12-28 05:41:32,614][106226] Updated weights for policy 0, policy_version 1451522 (0.0008) [2023-12-28 05:41:32,628][106225] Updated weights for policy 1, policy_version 1454876 (0.0009) [2023-12-28 05:41:32,663][106226] Updated weights for policy 0, policy_version 1451532 (0.0007) [2023-12-28 05:41:32,681][106225] Updated weights for policy 1, policy_version 1454886 (0.0007) [2023-12-28 05:41:32,714][106226] Updated weights for policy 0, policy_version 1451542 (0.0006) [2023-12-28 05:41:32,736][106225] Updated weights for policy 1, policy_version 1454896 (0.0005) [2023-12-28 05:41:32,768][106226] Updated weights for policy 0, policy_version 1451552 (0.0009) [2023-12-28 05:41:33,329][106225] Updated weights for policy 1, policy_version 1454906 (0.0007) [2023-12-28 05:41:33,389][106225] Updated weights for policy 1, policy_version 1454916 (0.0005) [2023-12-28 05:41:33,439][106225] Updated weights for policy 1, policy_version 1454926 (0.0008) [2023-12-28 05:41:33,456][106226] Updated weights for policy 0, policy_version 1451562 (0.0006) [2023-12-28 05:41:33,495][106225] Updated weights for policy 1, policy_version 1454936 (0.0007) [2023-12-28 05:41:33,510][106226] Updated weights for policy 0, policy_version 1451572 (0.0006) [2023-12-28 05:41:33,562][106226] Updated weights for policy 0, policy_version 1451582 (0.0006) [2023-12-28 05:41:34,072][106225] Updated weights for policy 1, policy_version 1454946 (0.0010) [2023-12-28 05:41:34,133][106226] Updated weights for policy 0, policy_version 1451592 (0.0008) [2023-12-28 05:41:34,133][106225] Updated weights for policy 1, policy_version 1454956 (0.0011) [2023-12-28 05:41:34,197][106225] Updated weights for policy 1, policy_version 1454966 (0.0010) [2023-12-28 05:41:34,202][106226] Updated weights for policy 0, policy_version 1451602 (0.0008) [2023-12-28 05:41:34,265][106226] Updated weights for policy 0, policy_version 1451612 (0.0008) [2023-12-28 05:41:34,895][106225] Updated weights for policy 1, policy_version 1454976 (0.0009) [2023-12-28 05:41:34,931][106226] Updated weights for policy 0, policy_version 1451622 (0.0008) [2023-12-28 05:41:34,949][106225] Updated weights for policy 1, policy_version 1454986 (0.0007) [2023-12-28 05:41:34,992][106226] Updated weights for policy 0, policy_version 1451632 (0.0007) [2023-12-28 05:41:35,007][106225] Updated weights for policy 1, policy_version 1454996 (0.0007) [2023-12-28 05:41:35,057][106226] Updated weights for policy 0, policy_version 1451642 (0.0007) [2023-12-28 05:41:35,570][106225] Updated weights for policy 1, policy_version 1455006 (0.0006) [2023-12-28 05:41:35,627][106225] Updated weights for policy 1, policy_version 1455016 (0.0005) [2023-12-28 05:41:35,675][106225] Updated weights for policy 1, policy_version 1455026 (0.0005) [2023-12-28 05:41:35,787][106226] Updated weights for policy 0, policy_version 1451652 (0.0007) [2023-12-28 05:41:35,855][106226] Updated weights for policy 0, policy_version 1451662 (0.0005) [2023-12-28 05:41:35,925][106226] Updated weights for policy 0, policy_version 1451672 (0.0007) [2023-12-28 05:41:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 744243200. Throughput: 0: 9774.4, 1: 10169.1. Samples: 744251392. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:36,175][105115] Avg episode reward: [(0, '-4.850'), (1, '-4.828')] [2023-12-28 05:41:36,266][106225] Updated weights for policy 1, policy_version 1455036 (0.0007) [2023-12-28 05:41:36,323][106225] Updated weights for policy 1, policy_version 1455046 (0.0008) [2023-12-28 05:41:36,391][106225] Updated weights for policy 1, policy_version 1455056 (0.0008) [2023-12-28 05:41:36,572][106226] Updated weights for policy 0, policy_version 1451682 (0.0007) [2023-12-28 05:41:36,636][106226] Updated weights for policy 0, policy_version 1451692 (0.0005) [2023-12-28 05:41:36,698][106226] Updated weights for policy 0, policy_version 1451702 (0.0005) [2023-12-28 05:41:36,756][106226] Updated weights for policy 0, policy_version 1451712 (0.0005) [2023-12-28 05:41:37,191][106225] Updated weights for policy 1, policy_version 1455066 (0.0009) [2023-12-28 05:41:37,253][106225] Updated weights for policy 1, policy_version 1455076 (0.0008) [2023-12-28 05:41:37,302][106225] Updated weights for policy 1, policy_version 1455086 (0.0008) [2023-12-28 05:41:37,355][106226] Updated weights for policy 0, policy_version 1451722 (0.0007) [2023-12-28 05:41:37,357][106225] Updated weights for policy 1, policy_version 1455096 (0.0006) [2023-12-28 05:41:37,421][106226] Updated weights for policy 0, policy_version 1451732 (0.0009) [2023-12-28 05:41:37,480][106226] Updated weights for policy 0, policy_version 1451742 (0.0009) [2023-12-28 05:41:38,072][106225] Updated weights for policy 1, policy_version 1455106 (0.0010) [2023-12-28 05:41:38,132][106225] Updated weights for policy 1, policy_version 1455116 (0.0010) [2023-12-28 05:41:38,188][106225] Updated weights for policy 1, policy_version 1455126 (0.0006) [2023-12-28 05:41:38,220][106226] Updated weights for policy 0, policy_version 1451752 (0.0009) [2023-12-28 05:41:38,275][106226] Updated weights for policy 0, policy_version 1451762 (0.0009) [2023-12-28 05:41:38,330][106226] Updated weights for policy 0, policy_version 1451772 (0.0008) [2023-12-28 05:41:38,887][106225] Updated weights for policy 1, policy_version 1455136 (0.0008) [2023-12-28 05:41:38,947][106225] Updated weights for policy 1, policy_version 1455146 (0.0009) [2023-12-28 05:41:39,001][106225] Updated weights for policy 1, policy_version 1455156 (0.0009) [2023-12-28 05:41:39,070][106226] Updated weights for policy 0, policy_version 1451782 (0.0008) [2023-12-28 05:41:39,133][106226] Updated weights for policy 0, policy_version 1451792 (0.0008) [2023-12-28 05:41:39,192][106226] Updated weights for policy 0, policy_version 1451802 (0.0009) [2023-12-28 05:41:39,793][106225] Updated weights for policy 1, policy_version 1455166 (0.0008) [2023-12-28 05:41:39,848][106225] Updated weights for policy 1, policy_version 1455176 (0.0008) [2023-12-28 05:41:39,912][106225] Updated weights for policy 1, policy_version 1455186 (0.0009) [2023-12-28 05:41:39,991][106226] Updated weights for policy 0, policy_version 1451812 (0.0009) [2023-12-28 05:41:40,059][106226] Updated weights for policy 0, policy_version 1451822 (0.0006) [2023-12-28 05:41:40,109][106226] Updated weights for policy 0, policy_version 1451832 (0.0006) [2023-12-28 05:41:40,709][106225] Updated weights for policy 1, policy_version 1455196 (0.0009) [2023-12-28 05:41:40,761][106225] Updated weights for policy 1, policy_version 1455206 (0.0008) [2023-12-28 05:41:40,809][106225] Updated weights for policy 1, policy_version 1455216 (0.0008) [2023-12-28 05:41:40,847][106226] Updated weights for policy 0, policy_version 1451842 (0.0006) [2023-12-28 05:41:40,911][106226] Updated weights for policy 0, policy_version 1451852 (0.0008) [2023-12-28 05:41:40,961][106226] Updated weights for policy 0, policy_version 1451862 (0.0008) [2023-12-28 05:41:41,017][106226] Updated weights for policy 0, policy_version 1451872 (0.0008) [2023-12-28 05:41:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 744341504. Throughput: 0: 9812.8, 1: 10157.0. Samples: 744310008. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:41,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.774')] [2023-12-28 05:41:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001455224_372588544.pth... [2023-12-28 05:41:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001451872_371752960.pth... [2023-12-28 05:41:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001454040_372285440.pth [2023-12-28 05:41:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001450720_371458048.pth [2023-12-28 05:41:41,545][106225] Updated weights for policy 1, policy_version 1455226 (0.0008) [2023-12-28 05:41:41,606][106225] Updated weights for policy 1, policy_version 1455236 (0.0010) [2023-12-28 05:41:41,677][106225] Updated weights for policy 1, policy_version 1455246 (0.0007) [2023-12-28 05:41:41,744][106225] Updated weights for policy 1, policy_version 1455256 (0.0008) [2023-12-28 05:41:41,843][106226] Updated weights for policy 0, policy_version 1451882 (0.0008) [2023-12-28 05:41:41,907][106226] Updated weights for policy 0, policy_version 1451892 (0.0009) [2023-12-28 05:41:41,972][106226] Updated weights for policy 0, policy_version 1451902 (0.0010) [2023-12-28 05:41:42,460][106225] Updated weights for policy 1, policy_version 1455266 (0.0009) [2023-12-28 05:41:42,510][106225] Updated weights for policy 1, policy_version 1455276 (0.0008) [2023-12-28 05:41:42,570][106225] Updated weights for policy 1, policy_version 1455286 (0.0009) [2023-12-28 05:41:42,711][106226] Updated weights for policy 0, policy_version 1451912 (0.0007) [2023-12-28 05:41:42,780][106226] Updated weights for policy 0, policy_version 1451922 (0.0005) [2023-12-28 05:41:42,847][106226] Updated weights for policy 0, policy_version 1451932 (0.0007) [2023-12-28 05:41:43,356][106225] Updated weights for policy 1, policy_version 1455296 (0.0006) [2023-12-28 05:41:43,407][106225] Updated weights for policy 1, policy_version 1455306 (0.0005) [2023-12-28 05:41:43,432][106226] Updated weights for policy 0, policy_version 1451942 (0.0005) [2023-12-28 05:41:43,463][106225] Updated weights for policy 1, policy_version 1455316 (0.0005) [2023-12-28 05:41:43,496][106226] Updated weights for policy 0, policy_version 1451952 (0.0006) [2023-12-28 05:41:43,569][106226] Updated weights for policy 0, policy_version 1451962 (0.0005) [2023-12-28 05:41:44,156][106226] Updated weights for policy 0, policy_version 1451972 (0.0008) [2023-12-28 05:41:44,179][106225] Updated weights for policy 1, policy_version 1455326 (0.0007) [2023-12-28 05:41:44,211][106226] Updated weights for policy 0, policy_version 1451982 (0.0006) [2023-12-28 05:41:44,240][106225] Updated weights for policy 1, policy_version 1455336 (0.0008) [2023-12-28 05:41:44,270][106226] Updated weights for policy 0, policy_version 1451992 (0.0006) [2023-12-28 05:41:44,300][106225] Updated weights for policy 1, policy_version 1455346 (0.0008) [2023-12-28 05:41:44,912][106226] Updated weights for policy 0, policy_version 1452002 (0.0005) [2023-12-28 05:41:44,976][106226] Updated weights for policy 0, policy_version 1452012 (0.0008) [2023-12-28 05:41:45,041][106226] Updated weights for policy 0, policy_version 1452022 (0.0008) [2023-12-28 05:41:45,085][106225] Updated weights for policy 1, policy_version 1455356 (0.0008) [2023-12-28 05:41:45,102][106226] Updated weights for policy 0, policy_version 1452032 (0.0008) [2023-12-28 05:41:45,147][106225] Updated weights for policy 1, policy_version 1455366 (0.0007) [2023-12-28 05:41:45,207][106225] Updated weights for policy 1, policy_version 1455376 (0.0008) [2023-12-28 05:41:45,801][106226] Updated weights for policy 0, policy_version 1452042 (0.0011) [2023-12-28 05:41:45,857][106226] Updated weights for policy 0, policy_version 1452052 (0.0010) [2023-12-28 05:41:45,919][106226] Updated weights for policy 0, policy_version 1452062 (0.0005) [2023-12-28 05:41:45,953][106225] Updated weights for policy 1, policy_version 1455386 (0.0008) [2023-12-28 05:41:46,017][106225] Updated weights for policy 1, policy_version 1455396 (0.0008) [2023-12-28 05:41:46,082][106225] Updated weights for policy 1, policy_version 1455406 (0.0008) [2023-12-28 05:41:46,146][106225] Updated weights for policy 1, policy_version 1455416 (0.0008) [2023-12-28 05:41:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 744439808. Throughput: 0: 9783.3, 1: 10118.0. Samples: 744424424. Policy #0 lag: (min: 31.0, avg: 34.2, max: 63.0) [2023-12-28 05:41:46,176][105115] Avg episode reward: [(0, '-4.766'), (1, '-4.706')] [2023-12-28 05:41:46,591][106226] Updated weights for policy 0, policy_version 1452072 (0.0008) [2023-12-28 05:41:46,655][106226] Updated weights for policy 0, policy_version 1452082 (0.0009) [2023-12-28 05:41:46,711][106226] Updated weights for policy 0, policy_version 1452092 (0.0005) [2023-12-28 05:41:46,861][106225] Updated weights for policy 1, policy_version 1455426 (0.0005) [2023-12-28 05:41:46,926][106225] Updated weights for policy 1, policy_version 1455436 (0.0005) [2023-12-28 05:41:46,979][106225] Updated weights for policy 1, policy_version 1455446 (0.0005) [2023-12-28 05:41:47,341][106226] Updated weights for policy 0, policy_version 1452102 (0.0009) [2023-12-28 05:41:47,399][106226] Updated weights for policy 0, policy_version 1452112 (0.0011) [2023-12-28 05:41:47,446][106226] Updated weights for policy 0, policy_version 1452122 (0.0010) [2023-12-28 05:41:47,545][106225] Updated weights for policy 1, policy_version 1455456 (0.0009) [2023-12-28 05:41:47,608][106225] Updated weights for policy 1, policy_version 1455466 (0.0010) [2023-12-28 05:41:47,653][106225] Updated weights for policy 1, policy_version 1455476 (0.0010) [2023-12-28 05:41:48,157][106226] Updated weights for policy 0, policy_version 1452132 (0.0010) [2023-12-28 05:41:48,222][106226] Updated weights for policy 0, policy_version 1452142 (0.0009) [2023-12-28 05:41:48,269][106225] Updated weights for policy 1, policy_version 1455486 (0.0007) [2023-12-28 05:41:48,281][106226] Updated weights for policy 0, policy_version 1452152 (0.0009) [2023-12-28 05:41:48,335][106225] Updated weights for policy 1, policy_version 1455496 (0.0006) [2023-12-28 05:41:48,393][106225] Updated weights for policy 1, policy_version 1455506 (0.0008) [2023-12-28 05:41:49,012][106226] Updated weights for policy 0, policy_version 1452162 (0.0007) [2023-12-28 05:41:49,074][106226] Updated weights for policy 0, policy_version 1452172 (0.0010) [2023-12-28 05:41:49,098][106225] Updated weights for policy 1, policy_version 1455516 (0.0008) [2023-12-28 05:41:49,127][106226] Updated weights for policy 0, policy_version 1452182 (0.0006) [2023-12-28 05:41:49,154][106225] Updated weights for policy 1, policy_version 1455526 (0.0010) [2023-12-28 05:41:49,181][106226] Updated weights for policy 0, policy_version 1452192 (0.0007) [2023-12-28 05:41:49,218][106225] Updated weights for policy 1, policy_version 1455536 (0.0010) [2023-12-28 05:41:49,855][106226] Updated weights for policy 0, policy_version 1452202 (0.0008) [2023-12-28 05:41:49,909][106226] Updated weights for policy 0, policy_version 1452212 (0.0007) [2023-12-28 05:41:49,977][106226] Updated weights for policy 0, policy_version 1452222 (0.0008) [2023-12-28 05:41:50,011][106225] Updated weights for policy 1, policy_version 1455546 (0.0010) [2023-12-28 05:41:50,061][106225] Updated weights for policy 1, policy_version 1455556 (0.0009) [2023-12-28 05:41:50,118][106225] Updated weights for policy 1, policy_version 1455566 (0.0009) [2023-12-28 05:41:50,167][106225] Updated weights for policy 1, policy_version 1455576 (0.0009) [2023-12-28 05:41:50,699][106226] Updated weights for policy 0, policy_version 1452232 (0.0009) [2023-12-28 05:41:50,763][106226] Updated weights for policy 0, policy_version 1452242 (0.0009) [2023-12-28 05:41:50,822][106226] Updated weights for policy 0, policy_version 1452252 (0.0007) [2023-12-28 05:41:50,962][106225] Updated weights for policy 1, policy_version 1455586 (0.0009) [2023-12-28 05:41:51,024][106225] Updated weights for policy 1, policy_version 1455596 (0.0008) [2023-12-28 05:41:51,091][106225] Updated weights for policy 1, policy_version 1455606 (0.0008) [2023-12-28 05:41:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 744538112. Throughput: 0: 9788.7, 1: 10063.9. Samples: 744543208. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:41:51,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-4.672')] [2023-12-28 05:41:51,533][106226] Updated weights for policy 0, policy_version 1452262 (0.0007) [2023-12-28 05:41:51,582][106226] Updated weights for policy 0, policy_version 1452272 (0.0009) [2023-12-28 05:41:51,640][106226] Updated weights for policy 0, policy_version 1452282 (0.0007) [2023-12-28 05:41:51,888][106225] Updated weights for policy 1, policy_version 1455616 (0.0006) [2023-12-28 05:41:51,949][106225] Updated weights for policy 1, policy_version 1455626 (0.0006) [2023-12-28 05:41:52,011][106225] Updated weights for policy 1, policy_version 1455636 (0.0007) [2023-12-28 05:41:52,367][106226] Updated weights for policy 0, policy_version 1452292 (0.0008) [2023-12-28 05:41:52,420][106226] Updated weights for policy 0, policy_version 1452302 (0.0009) [2023-12-28 05:41:52,474][106226] Updated weights for policy 0, policy_version 1452312 (0.0009) [2023-12-28 05:41:52,627][106225] Updated weights for policy 1, policy_version 1455646 (0.0005) [2023-12-28 05:41:52,688][106225] Updated weights for policy 1, policy_version 1455656 (0.0006) [2023-12-28 05:41:52,753][106225] Updated weights for policy 1, policy_version 1455666 (0.0008) [2023-12-28 05:41:53,203][106226] Updated weights for policy 0, policy_version 1452322 (0.0010) [2023-12-28 05:41:53,254][106226] Updated weights for policy 0, policy_version 1452332 (0.0009) [2023-12-28 05:41:53,309][106226] Updated weights for policy 0, policy_version 1452342 (0.0009) [2023-12-28 05:41:53,359][106226] Updated weights for policy 0, policy_version 1452352 (0.0009) [2023-12-28 05:41:53,367][106225] Updated weights for policy 1, policy_version 1455676 (0.0007) [2023-12-28 05:41:53,421][106225] Updated weights for policy 1, policy_version 1455686 (0.0005) [2023-12-28 05:41:53,471][106225] Updated weights for policy 1, policy_version 1455696 (0.0005) [2023-12-28 05:41:53,998][106225] Updated weights for policy 1, policy_version 1455706 (0.0005) [2023-12-28 05:41:54,056][106225] Updated weights for policy 1, policy_version 1455716 (0.0007) [2023-12-28 05:41:54,110][106225] Updated weights for policy 1, policy_version 1455726 (0.0009) [2023-12-28 05:41:54,159][106225] Updated weights for policy 1, policy_version 1455736 (0.0007) [2023-12-28 05:41:54,186][106226] Updated weights for policy 0, policy_version 1452362 (0.0008) [2023-12-28 05:41:54,258][106226] Updated weights for policy 0, policy_version 1452372 (0.0009) [2023-12-28 05:41:54,322][106226] Updated weights for policy 0, policy_version 1452382 (0.0009) [2023-12-28 05:41:54,877][106225] Updated weights for policy 1, policy_version 1455746 (0.0010) [2023-12-28 05:41:54,937][106225] Updated weights for policy 1, policy_version 1455756 (0.0010) [2023-12-28 05:41:55,001][106225] Updated weights for policy 1, policy_version 1455766 (0.0006) [2023-12-28 05:41:55,047][106226] Updated weights for policy 0, policy_version 1452392 (0.0008) [2023-12-28 05:41:55,108][106226] Updated weights for policy 0, policy_version 1452402 (0.0008) [2023-12-28 05:41:55,168][106226] Updated weights for policy 0, policy_version 1452412 (0.0007) [2023-12-28 05:41:55,737][106225] Updated weights for policy 1, policy_version 1455776 (0.0010) [2023-12-28 05:41:55,800][106225] Updated weights for policy 1, policy_version 1455786 (0.0010) [2023-12-28 05:41:55,834][106226] Updated weights for policy 0, policy_version 1452422 (0.0008) [2023-12-28 05:41:55,861][106225] Updated weights for policy 1, policy_version 1455796 (0.0007) [2023-12-28 05:41:55,894][106226] Updated weights for policy 0, policy_version 1452432 (0.0007) [2023-12-28 05:41:55,956][106226] Updated weights for policy 0, policy_version 1452442 (0.0006) [2023-12-28 05:41:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 744636416. Throughput: 0: 9784.6, 1: 10059.1. Samples: 744602536. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:41:56,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.873')] [2023-12-28 05:41:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001455800_372736000.pth... [2023-12-28 05:41:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001452448_371900416.pth... [2023-12-28 05:41:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001454616_372432896.pth [2023-12-28 05:41:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001451296_371605504.pth [2023-12-28 05:41:56,578][106225] Updated weights for policy 1, policy_version 1455806 (0.0006) [2023-12-28 05:41:56,613][106226] Updated weights for policy 0, policy_version 1452452 (0.0006) [2023-12-28 05:41:56,635][106225] Updated weights for policy 1, policy_version 1455816 (0.0005) [2023-12-28 05:41:56,674][106226] Updated weights for policy 0, policy_version 1452462 (0.0009) [2023-12-28 05:41:56,697][106225] Updated weights for policy 1, policy_version 1455826 (0.0005) [2023-12-28 05:41:56,731][106226] Updated weights for policy 0, policy_version 1452472 (0.0009) [2023-12-28 05:41:57,331][106225] Updated weights for policy 1, policy_version 1455836 (0.0006) [2023-12-28 05:41:57,390][106225] Updated weights for policy 1, policy_version 1455846 (0.0010) [2023-12-28 05:41:57,420][106226] Updated weights for policy 0, policy_version 1452482 (0.0008) [2023-12-28 05:41:57,438][106225] Updated weights for policy 1, policy_version 1455856 (0.0009) [2023-12-28 05:41:57,480][106226] Updated weights for policy 0, policy_version 1452492 (0.0007) [2023-12-28 05:41:57,549][106226] Updated weights for policy 0, policy_version 1452502 (0.0009) [2023-12-28 05:41:57,608][106226] Updated weights for policy 0, policy_version 1452512 (0.0008) [2023-12-28 05:41:58,096][106225] Updated weights for policy 1, policy_version 1455866 (0.0007) [2023-12-28 05:41:58,148][106225] Updated weights for policy 1, policy_version 1455876 (0.0007) [2023-12-28 05:41:58,193][106225] Updated weights for policy 1, policy_version 1455886 (0.0008) [2023-12-28 05:41:58,259][106225] Updated weights for policy 1, policy_version 1455896 (0.0008) [2023-12-28 05:41:58,335][106226] Updated weights for policy 0, policy_version 1452522 (0.0009) [2023-12-28 05:41:58,402][106226] Updated weights for policy 0, policy_version 1452532 (0.0010) [2023-12-28 05:41:58,474][106226] Updated weights for policy 0, policy_version 1452542 (0.0008) [2023-12-28 05:41:59,111][106225] Updated weights for policy 1, policy_version 1455906 (0.0009) [2023-12-28 05:41:59,173][106225] Updated weights for policy 1, policy_version 1455916 (0.0008) [2023-12-28 05:41:59,239][106225] Updated weights for policy 1, policy_version 1455926 (0.0009) [2023-12-28 05:41:59,265][106226] Updated weights for policy 0, policy_version 1452552 (0.0008) [2023-12-28 05:41:59,332][106226] Updated weights for policy 0, policy_version 1452562 (0.0008) [2023-12-28 05:41:59,400][106226] Updated weights for policy 0, policy_version 1452572 (0.0008) [2023-12-28 05:42:00,013][106225] Updated weights for policy 1, policy_version 1455936 (0.0008) [2023-12-28 05:42:00,058][106226] Updated weights for policy 0, policy_version 1452582 (0.0007) [2023-12-28 05:42:00,060][106225] Updated weights for policy 1, policy_version 1455946 (0.0008) [2023-12-28 05:42:00,108][106225] Updated weights for policy 1, policy_version 1455956 (0.0008) [2023-12-28 05:42:00,115][106226] Updated weights for policy 0, policy_version 1452592 (0.0007) [2023-12-28 05:42:00,174][106226] Updated weights for policy 0, policy_version 1452602 (0.0008) [2023-12-28 05:42:00,705][106225] Updated weights for policy 1, policy_version 1455966 (0.0006) [2023-12-28 05:42:00,762][106225] Updated weights for policy 1, policy_version 1455976 (0.0005) [2023-12-28 05:42:00,812][106225] Updated weights for policy 1, policy_version 1455986 (0.0005) [2023-12-28 05:42:01,032][106226] Updated weights for policy 0, policy_version 1452612 (0.0009) [2023-12-28 05:42:01,094][106226] Updated weights for policy 0, policy_version 1452622 (0.0007) [2023-12-28 05:42:01,157][106226] Updated weights for policy 0, policy_version 1452632 (0.0009) [2023-12-28 05:42:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 744726528. Throughput: 0: 9834.1, 1: 10013.9. Samples: 744719872. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:01,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-5.002')] [2023-12-28 05:42:01,450][106225] Updated weights for policy 1, policy_version 1455996 (0.0006) [2023-12-28 05:42:01,515][106225] Updated weights for policy 1, policy_version 1456006 (0.0008) [2023-12-28 05:42:01,572][106225] Updated weights for policy 1, policy_version 1456016 (0.0007) [2023-12-28 05:42:01,893][106226] Updated weights for policy 0, policy_version 1452642 (0.0008) [2023-12-28 05:42:01,957][106226] Updated weights for policy 0, policy_version 1452652 (0.0007) [2023-12-28 05:42:02,019][106226] Updated weights for policy 0, policy_version 1452662 (0.0009) [2023-12-28 05:42:02,082][106226] Updated weights for policy 0, policy_version 1452672 (0.0009) [2023-12-28 05:42:02,320][106225] Updated weights for policy 1, policy_version 1456026 (0.0007) [2023-12-28 05:42:02,388][106225] Updated weights for policy 1, policy_version 1456036 (0.0007) [2023-12-28 05:42:02,451][106225] Updated weights for policy 1, policy_version 1456046 (0.0008) [2023-12-28 05:42:02,513][106225] Updated weights for policy 1, policy_version 1456056 (0.0005) [2023-12-28 05:42:02,751][106226] Updated weights for policy 0, policy_version 1452682 (0.0005) [2023-12-28 05:42:02,800][106226] Updated weights for policy 0, policy_version 1452692 (0.0005) [2023-12-28 05:42:02,854][106226] Updated weights for policy 0, policy_version 1452702 (0.0007) [2023-12-28 05:42:03,226][106225] Updated weights for policy 1, policy_version 1456066 (0.0008) [2023-12-28 05:42:03,285][106225] Updated weights for policy 1, policy_version 1456076 (0.0007) [2023-12-28 05:42:03,340][106225] Updated weights for policy 1, policy_version 1456086 (0.0007) [2023-12-28 05:42:03,491][106226] Updated weights for policy 0, policy_version 1452712 (0.0006) [2023-12-28 05:42:03,547][106226] Updated weights for policy 0, policy_version 1452722 (0.0005) [2023-12-28 05:42:03,604][106226] Updated weights for policy 0, policy_version 1452732 (0.0010) [2023-12-28 05:42:04,111][106225] Updated weights for policy 1, policy_version 1456096 (0.0009) [2023-12-28 05:42:04,169][106225] Updated weights for policy 1, policy_version 1456106 (0.0008) [2023-12-28 05:42:04,230][106225] Updated weights for policy 1, policy_version 1456116 (0.0007) [2023-12-28 05:42:04,283][106226] Updated weights for policy 0, policy_version 1452742 (0.0011) [2023-12-28 05:42:04,348][106226] Updated weights for policy 0, policy_version 1452752 (0.0011) [2023-12-28 05:42:04,412][106226] Updated weights for policy 0, policy_version 1452762 (0.0010) [2023-12-28 05:42:04,941][106225] Updated weights for policy 1, policy_version 1456126 (0.0007) [2023-12-28 05:42:04,988][106225] Updated weights for policy 1, policy_version 1456136 (0.0008) [2023-12-28 05:42:05,036][106225] Updated weights for policy 1, policy_version 1456146 (0.0007) [2023-12-28 05:42:05,122][106226] Updated weights for policy 0, policy_version 1452772 (0.0011) [2023-12-28 05:42:05,168][106226] Updated weights for policy 0, policy_version 1452782 (0.0010) [2023-12-28 05:42:05,226][106226] Updated weights for policy 0, policy_version 1452792 (0.0010) [2023-12-28 05:42:05,723][106225] Updated weights for policy 1, policy_version 1456156 (0.0006) [2023-12-28 05:42:05,790][106225] Updated weights for policy 1, policy_version 1456166 (0.0005) [2023-12-28 05:42:05,847][106225] Updated weights for policy 1, policy_version 1456176 (0.0007) [2023-12-28 05:42:05,956][106226] Updated weights for policy 0, policy_version 1452802 (0.0009) [2023-12-28 05:42:06,018][106226] Updated weights for policy 0, policy_version 1452812 (0.0007) [2023-12-28 05:42:06,077][106226] Updated weights for policy 0, policy_version 1452822 (0.0007) [2023-12-28 05:42:06,137][106226] Updated weights for policy 0, policy_version 1452832 (0.0008) [2023-12-28 05:42:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 744833024. Throughput: 0: 9844.8, 1: 10027.6. Samples: 744838980. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:06,176][105115] Avg episode reward: [(0, '-4.802'), (1, '-4.974')] [2023-12-28 05:42:06,500][106225] Updated weights for policy 1, policy_version 1456186 (0.0011) [2023-12-28 05:42:06,566][106225] Updated weights for policy 1, policy_version 1456196 (0.0011) [2023-12-28 05:42:06,628][106225] Updated weights for policy 1, policy_version 1456206 (0.0011) [2023-12-28 05:42:06,690][106225] Updated weights for policy 1, policy_version 1456216 (0.0005) [2023-12-28 05:42:06,825][106226] Updated weights for policy 0, policy_version 1452842 (0.0009) [2023-12-28 05:42:06,876][106226] Updated weights for policy 0, policy_version 1452852 (0.0009) [2023-12-28 05:42:06,926][106226] Updated weights for policy 0, policy_version 1452862 (0.0009) [2023-12-28 05:42:07,227][106225] Updated weights for policy 1, policy_version 1456226 (0.0006) [2023-12-28 05:42:07,294][106225] Updated weights for policy 1, policy_version 1456236 (0.0007) [2023-12-28 05:42:07,349][106225] Updated weights for policy 1, policy_version 1456246 (0.0010) [2023-12-28 05:42:07,717][106226] Updated weights for policy 0, policy_version 1452872 (0.0008) [2023-12-28 05:42:07,769][106226] Updated weights for policy 0, policy_version 1452882 (0.0007) [2023-12-28 05:42:07,827][106226] Updated weights for policy 0, policy_version 1452892 (0.0008) [2023-12-28 05:42:08,032][106225] Updated weights for policy 1, policy_version 1456256 (0.0010) [2023-12-28 05:42:08,082][106225] Updated weights for policy 1, policy_version 1456266 (0.0010) [2023-12-28 05:42:08,135][106225] Updated weights for policy 1, policy_version 1456276 (0.0010) [2023-12-28 05:42:08,482][106226] Updated weights for policy 0, policy_version 1452902 (0.0007) [2023-12-28 05:42:08,547][106226] Updated weights for policy 0, policy_version 1452912 (0.0006) [2023-12-28 05:42:08,614][106226] Updated weights for policy 0, policy_version 1452922 (0.0008) [2023-12-28 05:42:08,884][106225] Updated weights for policy 1, policy_version 1456286 (0.0010) [2023-12-28 05:42:08,951][106225] Updated weights for policy 1, policy_version 1456296 (0.0010) [2023-12-28 05:42:09,019][106225] Updated weights for policy 1, policy_version 1456306 (0.0010) [2023-12-28 05:42:09,216][106226] Updated weights for policy 0, policy_version 1452932 (0.0008) [2023-12-28 05:42:09,284][106226] Updated weights for policy 0, policy_version 1452942 (0.0008) [2023-12-28 05:42:09,349][106226] Updated weights for policy 0, policy_version 1452952 (0.0009) [2023-12-28 05:42:09,690][106225] Updated weights for policy 1, policy_version 1456316 (0.0008) [2023-12-28 05:42:09,743][106225] Updated weights for policy 1, policy_version 1456326 (0.0007) [2023-12-28 05:42:09,799][106225] Updated weights for policy 1, policy_version 1456336 (0.0008) [2023-12-28 05:42:10,094][106226] Updated weights for policy 0, policy_version 1452962 (0.0009) [2023-12-28 05:42:10,141][106226] Updated weights for policy 0, policy_version 1452972 (0.0008) [2023-12-28 05:42:10,191][106226] Updated weights for policy 0, policy_version 1452982 (0.0008) [2023-12-28 05:42:10,253][106226] Updated weights for policy 0, policy_version 1452992 (0.0008) [2023-12-28 05:42:10,591][106225] Updated weights for policy 1, policy_version 1456346 (0.0008) [2023-12-28 05:42:10,655][106225] Updated weights for policy 1, policy_version 1456356 (0.0008) [2023-12-28 05:42:10,727][106225] Updated weights for policy 1, policy_version 1456366 (0.0007) [2023-12-28 05:42:10,793][106225] Updated weights for policy 1, policy_version 1456376 (0.0008) [2023-12-28 05:42:11,032][106226] Updated weights for policy 0, policy_version 1453002 (0.0006) [2023-12-28 05:42:11,099][106226] Updated weights for policy 0, policy_version 1453012 (0.0008) [2023-12-28 05:42:11,162][106226] Updated weights for policy 0, policy_version 1453022 (0.0009) [2023-12-28 05:42:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 744931328. Throughput: 0: 9853.8, 1: 10034.7. Samples: 744900388. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:11,175][105115] Avg episode reward: [(0, '-5.113'), (1, '-4.669')] [2023-12-28 05:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001456376_372883456.pth... [2023-12-28 05:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001453024_372047872.pth... [2023-12-28 05:42:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001451872_371752960.pth [2023-12-28 05:42:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001455224_372588544.pth [2023-12-28 05:42:11,590][106225] Updated weights for policy 1, policy_version 1456386 (0.0008) [2023-12-28 05:42:11,664][106225] Updated weights for policy 1, policy_version 1456396 (0.0008) [2023-12-28 05:42:11,725][106225] Updated weights for policy 1, policy_version 1456406 (0.0008) [2023-12-28 05:42:11,942][106226] Updated weights for policy 0, policy_version 1453032 (0.0009) [2023-12-28 05:42:12,007][106226] Updated weights for policy 0, policy_version 1453042 (0.0009) [2023-12-28 05:42:12,072][106226] Updated weights for policy 0, policy_version 1453052 (0.0009) [2023-12-28 05:42:12,410][106225] Updated weights for policy 1, policy_version 1456416 (0.0008) [2023-12-28 05:42:12,466][106225] Updated weights for policy 1, policy_version 1456426 (0.0006) [2023-12-28 05:42:12,532][106225] Updated weights for policy 1, policy_version 1456436 (0.0008) [2023-12-28 05:42:12,786][106226] Updated weights for policy 0, policy_version 1453062 (0.0007) [2023-12-28 05:42:12,845][106226] Updated weights for policy 0, policy_version 1453072 (0.0005) [2023-12-28 05:42:12,918][106226] Updated weights for policy 0, policy_version 1453082 (0.0005) [2023-12-28 05:42:13,252][106225] Updated weights for policy 1, policy_version 1456446 (0.0007) [2023-12-28 05:42:13,317][106225] Updated weights for policy 1, policy_version 1456456 (0.0005) [2023-12-28 05:42:13,378][106225] Updated weights for policy 1, policy_version 1456466 (0.0005) [2023-12-28 05:42:13,468][106226] Updated weights for policy 0, policy_version 1453092 (0.0007) [2023-12-28 05:42:13,524][106226] Updated weights for policy 0, policy_version 1453102 (0.0005) [2023-12-28 05:42:13,576][106226] Updated weights for policy 0, policy_version 1453112 (0.0007) [2023-12-28 05:42:13,870][106225] Updated weights for policy 1, policy_version 1456476 (0.0005) [2023-12-28 05:42:13,921][106225] Updated weights for policy 1, policy_version 1456486 (0.0005) [2023-12-28 05:42:13,967][106225] Updated weights for policy 1, policy_version 1456496 (0.0005) [2023-12-28 05:42:14,335][106226] Updated weights for policy 0, policy_version 1453122 (0.0008) [2023-12-28 05:42:14,389][106226] Updated weights for policy 0, policy_version 1453132 (0.0007) [2023-12-28 05:42:14,435][106226] Updated weights for policy 0, policy_version 1453142 (0.0008) [2023-12-28 05:42:14,495][106226] Updated weights for policy 0, policy_version 1453152 (0.0008) [2023-12-28 05:42:14,510][106225] Updated weights for policy 1, policy_version 1456506 (0.0005) [2023-12-28 05:42:14,558][106225] Updated weights for policy 1, policy_version 1456516 (0.0007) [2023-12-28 05:42:14,616][106225] Updated weights for policy 1, policy_version 1456526 (0.0011) [2023-12-28 05:42:15,214][106226] Updated weights for policy 0, policy_version 1453162 (0.0009) [2023-12-28 05:42:15,282][106226] Updated weights for policy 0, policy_version 1453172 (0.0009) [2023-12-28 05:42:15,350][106226] Updated weights for policy 0, policy_version 1453182 (0.0010) [2023-12-28 05:42:15,372][106225] Updated weights for policy 1, policy_version 1456537 (0.0009) [2023-12-28 05:42:15,434][106225] Updated weights for policy 1, policy_version 1456547 (0.0005) [2023-12-28 05:42:15,501][106225] Updated weights for policy 1, policy_version 1456557 (0.0006) [2023-12-28 05:42:15,565][106225] Updated weights for policy 1, policy_version 1456567 (0.0007) [2023-12-28 05:42:16,066][106226] Updated weights for policy 0, policy_version 1453192 (0.0009) [2023-12-28 05:42:16,117][106226] Updated weights for policy 0, policy_version 1453202 (0.0008) [2023-12-28 05:42:16,171][106226] Updated weights for policy 0, policy_version 1453212 (0.0008) [2023-12-28 05:42:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 745021440. Throughput: 0: 9824.4, 1: 9983.7. Samples: 745018580. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:16,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.882')] [2023-12-28 05:42:16,202][106225] Updated weights for policy 1, policy_version 1456577 (0.0008) [2023-12-28 05:42:16,253][106225] Updated weights for policy 1, policy_version 1456587 (0.0008) [2023-12-28 05:42:16,304][106225] Updated weights for policy 1, policy_version 1456597 (0.0009) [2023-12-28 05:42:16,915][106226] Updated weights for policy 0, policy_version 1453222 (0.0007) [2023-12-28 05:42:16,974][106226] Updated weights for policy 0, policy_version 1453232 (0.0009) [2023-12-28 05:42:17,025][106226] Updated weights for policy 0, policy_version 1453242 (0.0010) [2023-12-28 05:42:17,050][106225] Updated weights for policy 1, policy_version 1456607 (0.0008) [2023-12-28 05:42:17,103][106225] Updated weights for policy 1, policy_version 1456617 (0.0007) [2023-12-28 05:42:17,157][106225] Updated weights for policy 1, policy_version 1456627 (0.0008) [2023-12-28 05:42:17,722][106226] Updated weights for policy 0, policy_version 1453252 (0.0011) [2023-12-28 05:42:17,775][106226] Updated weights for policy 0, policy_version 1453262 (0.0010) [2023-12-28 05:42:17,781][106225] Updated weights for policy 1, policy_version 1456637 (0.0007) [2023-12-28 05:42:17,826][106226] Updated weights for policy 0, policy_version 1453272 (0.0010) [2023-12-28 05:42:17,832][106225] Updated weights for policy 1, policy_version 1456647 (0.0006) [2023-12-28 05:42:17,876][106225] Updated weights for policy 1, policy_version 1456657 (0.0006) [2023-12-28 05:42:18,566][106226] Updated weights for policy 0, policy_version 1453282 (0.0010) [2023-12-28 05:42:18,629][106226] Updated weights for policy 0, policy_version 1453292 (0.0008) [2023-12-28 05:42:18,655][106225] Updated weights for policy 1, policy_version 1456667 (0.0007) [2023-12-28 05:42:18,690][106226] Updated weights for policy 0, policy_version 1453302 (0.0009) [2023-12-28 05:42:18,717][106225] Updated weights for policy 1, policy_version 1456677 (0.0008) [2023-12-28 05:42:18,753][106226] Updated weights for policy 0, policy_version 1453312 (0.0007) [2023-12-28 05:42:18,780][106225] Updated weights for policy 1, policy_version 1456687 (0.0008) [2023-12-28 05:42:19,464][106226] Updated weights for policy 0, policy_version 1453322 (0.0010) [2023-12-28 05:42:19,467][106225] Updated weights for policy 1, policy_version 1456697 (0.0007) [2023-12-28 05:42:19,528][106226] Updated weights for policy 0, policy_version 1453332 (0.0009) [2023-12-28 05:42:19,529][106225] Updated weights for policy 1, policy_version 1456707 (0.0007) [2023-12-28 05:42:19,587][106225] Updated weights for policy 1, policy_version 1456717 (0.0006) [2023-12-28 05:42:19,589][106226] Updated weights for policy 0, policy_version 1453342 (0.0009) [2023-12-28 05:42:19,638][106225] Updated weights for policy 1, policy_version 1456727 (0.0007) [2023-12-28 05:42:20,391][106225] Updated weights for policy 1, policy_version 1456737 (0.0007) [2023-12-28 05:42:20,424][106226] Updated weights for policy 0, policy_version 1453352 (0.0009) [2023-12-28 05:42:20,450][106225] Updated weights for policy 1, policy_version 1456747 (0.0006) [2023-12-28 05:42:20,493][106226] Updated weights for policy 0, policy_version 1453362 (0.0009) [2023-12-28 05:42:20,505][106225] Updated weights for policy 1, policy_version 1456757 (0.0006) [2023-12-28 05:42:20,564][106226] Updated weights for policy 0, policy_version 1453372 (0.0011) [2023-12-28 05:42:21,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 745119744. Throughput: 0: 9733.8, 1: 9884.9. Samples: 745134236. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:21,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-4.808')] [2023-12-28 05:42:21,190][106225] Updated weights for policy 1, policy_version 1456767 (0.0008) [2023-12-28 05:42:21,259][106225] Updated weights for policy 1, policy_version 1456777 (0.0008) [2023-12-28 05:42:21,304][106226] Updated weights for policy 0, policy_version 1453382 (0.0009) [2023-12-28 05:42:21,324][106225] Updated weights for policy 1, policy_version 1456787 (0.0009) [2023-12-28 05:42:21,376][106226] Updated weights for policy 0, policy_version 1453392 (0.0008) [2023-12-28 05:42:21,431][106226] Updated weights for policy 0, policy_version 1453402 (0.0006) [2023-12-28 05:42:22,059][106225] Updated weights for policy 1, policy_version 1456797 (0.0009) [2023-12-28 05:42:22,083][106226] Updated weights for policy 0, policy_version 1453412 (0.0007) [2023-12-28 05:42:22,130][106225] Updated weights for policy 1, policy_version 1456807 (0.0006) [2023-12-28 05:42:22,145][106226] Updated weights for policy 0, policy_version 1453422 (0.0008) [2023-12-28 05:42:22,197][106225] Updated weights for policy 1, policy_version 1456817 (0.0006) [2023-12-28 05:42:22,205][106226] Updated weights for policy 0, policy_version 1453432 (0.0008) [2023-12-28 05:42:22,839][106225] Updated weights for policy 1, policy_version 1456827 (0.0007) [2023-12-28 05:42:22,888][106225] Updated weights for policy 1, policy_version 1456837 (0.0008) [2023-12-28 05:42:22,937][106225] Updated weights for policy 1, policy_version 1456847 (0.0008) [2023-12-28 05:42:22,973][106226] Updated weights for policy 0, policy_version 1453442 (0.0008) [2023-12-28 05:42:23,038][106226] Updated weights for policy 0, policy_version 1453452 (0.0008) [2023-12-28 05:42:23,108][106226] Updated weights for policy 0, policy_version 1453462 (0.0009) [2023-12-28 05:42:23,161][106226] Updated weights for policy 0, policy_version 1453472 (0.0008) [2023-12-28 05:42:23,660][106225] Updated weights for policy 1, policy_version 1456857 (0.0009) [2023-12-28 05:42:23,713][106225] Updated weights for policy 1, policy_version 1456867 (0.0008) [2023-12-28 05:42:23,769][106225] Updated weights for policy 1, policy_version 1456877 (0.0009) [2023-12-28 05:42:23,833][106225] Updated weights for policy 1, policy_version 1456887 (0.0008) [2023-12-28 05:42:23,896][106226] Updated weights for policy 0, policy_version 1453482 (0.0005) [2023-12-28 05:42:23,962][106226] Updated weights for policy 0, policy_version 1453492 (0.0009) [2023-12-28 05:42:24,018][106226] Updated weights for policy 0, policy_version 1453502 (0.0009) [2023-12-28 05:42:24,582][106226] Updated weights for policy 0, policy_version 1453512 (0.0008) [2023-12-28 05:42:24,643][106225] Updated weights for policy 1, policy_version 1456897 (0.0006) [2023-12-28 05:42:24,651][106226] Updated weights for policy 0, policy_version 1453522 (0.0008) [2023-12-28 05:42:24,698][106225] Updated weights for policy 1, policy_version 1456907 (0.0007) [2023-12-28 05:42:24,711][106226] Updated weights for policy 0, policy_version 1453532 (0.0008) [2023-12-28 05:42:24,748][106225] Updated weights for policy 1, policy_version 1456917 (0.0007) [2023-12-28 05:42:25,283][106226] Updated weights for policy 0, policy_version 1453542 (0.0008) [2023-12-28 05:42:25,336][106226] Updated weights for policy 0, policy_version 1453552 (0.0010) [2023-12-28 05:42:25,403][106226] Updated weights for policy 0, policy_version 1453562 (0.0007) [2023-12-28 05:42:25,522][106225] Updated weights for policy 1, policy_version 1456927 (0.0008) [2023-12-28 05:42:25,569][106225] Updated weights for policy 1, policy_version 1456937 (0.0007) [2023-12-28 05:42:25,632][106225] Updated weights for policy 1, policy_version 1456947 (0.0009) [2023-12-28 05:42:26,074][106226] Updated weights for policy 0, policy_version 1453572 (0.0011) [2023-12-28 05:42:26,135][106226] Updated weights for policy 0, policy_version 1453582 (0.0011) [2023-12-28 05:42:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 745218048. Throughput: 0: 9716.2, 1: 9886.3. Samples: 745192120. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:26,176][105115] Avg episode reward: [(0, '-4.806'), (1, '-4.809')] [2023-12-28 05:42:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001456952_373030912.pth... [2023-12-28 05:42:26,190][106226] Updated weights for policy 0, policy_version 1453592 (0.0011) [2023-12-28 05:42:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001455800_372736000.pth [2023-12-28 05:42:26,227][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001453600_372195328.pth... [2023-12-28 05:42:26,231][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001452448_371900416.pth [2023-12-28 05:42:26,409][106225] Updated weights for policy 1, policy_version 1456957 (0.0010) [2023-12-28 05:42:26,462][106225] Updated weights for policy 1, policy_version 1456967 (0.0009) [2023-12-28 05:42:26,528][106225] Updated weights for policy 1, policy_version 1456977 (0.0005) [2023-12-28 05:42:26,793][106226] Updated weights for policy 0, policy_version 1453602 (0.0009) [2023-12-28 05:42:26,841][106226] Updated weights for policy 0, policy_version 1453612 (0.0005) [2023-12-28 05:42:26,901][106226] Updated weights for policy 0, policy_version 1453622 (0.0007) [2023-12-28 05:42:26,960][106226] Updated weights for policy 0, policy_version 1453632 (0.0010) [2023-12-28 05:42:27,105][106225] Updated weights for policy 1, policy_version 1456987 (0.0005) [2023-12-28 05:42:27,151][106225] Updated weights for policy 1, policy_version 1456997 (0.0005) [2023-12-28 05:42:27,204][106225] Updated weights for policy 1, policy_version 1457007 (0.0005) [2023-12-28 05:42:27,625][106226] Updated weights for policy 0, policy_version 1453642 (0.0010) [2023-12-28 05:42:27,689][106226] Updated weights for policy 0, policy_version 1453652 (0.0005) [2023-12-28 05:42:27,745][106226] Updated weights for policy 0, policy_version 1453662 (0.0005) [2023-12-28 05:42:27,770][106225] Updated weights for policy 1, policy_version 1457017 (0.0006) [2023-12-28 05:42:27,830][106225] Updated weights for policy 1, policy_version 1457027 (0.0010) [2023-12-28 05:42:27,886][106225] Updated weights for policy 1, policy_version 1457037 (0.0010) [2023-12-28 05:42:27,942][106225] Updated weights for policy 1, policy_version 1457047 (0.0010) [2023-12-28 05:42:28,262][106226] Updated weights for policy 0, policy_version 1453672 (0.0008) [2023-12-28 05:42:28,316][106226] Updated weights for policy 0, policy_version 1453682 (0.0005) [2023-12-28 05:42:28,378][106226] Updated weights for policy 0, policy_version 1453692 (0.0008) [2023-12-28 05:42:28,641][106225] Updated weights for policy 1, policy_version 1457057 (0.0007) [2023-12-28 05:42:28,691][106225] Updated weights for policy 1, policy_version 1457067 (0.0010) [2023-12-28 05:42:28,755][106225] Updated weights for policy 1, policy_version 1457077 (0.0006) [2023-12-28 05:42:29,019][106226] Updated weights for policy 0, policy_version 1453702 (0.0010) [2023-12-28 05:42:29,068][106226] Updated weights for policy 0, policy_version 1453712 (0.0009) [2023-12-28 05:42:29,117][106226] Updated weights for policy 0, policy_version 1453722 (0.0008) [2023-12-28 05:42:29,307][106225] Updated weights for policy 1, policy_version 1457087 (0.0009) [2023-12-28 05:42:29,372][106225] Updated weights for policy 1, policy_version 1457097 (0.0009) [2023-12-28 05:42:29,440][106225] Updated weights for policy 1, policy_version 1457107 (0.0008) [2023-12-28 05:42:29,773][106226] Updated weights for policy 0, policy_version 1453732 (0.0009) [2023-12-28 05:42:29,829][106226] Updated weights for policy 0, policy_version 1453742 (0.0009) [2023-12-28 05:42:29,897][106226] Updated weights for policy 0, policy_version 1453752 (0.0010) [2023-12-28 05:42:30,082][106225] Updated weights for policy 1, policy_version 1457117 (0.0008) [2023-12-28 05:42:30,138][106225] Updated weights for policy 1, policy_version 1457127 (0.0010) [2023-12-28 05:42:30,185][106225] Updated weights for policy 1, policy_version 1457137 (0.0010) [2023-12-28 05:42:30,612][106226] Updated weights for policy 0, policy_version 1453762 (0.0008) [2023-12-28 05:42:30,671][106226] Updated weights for policy 0, policy_version 1453772 (0.0008) [2023-12-28 05:42:30,723][106226] Updated weights for policy 0, policy_version 1453782 (0.0008) [2023-12-28 05:42:30,775][106226] Updated weights for policy 0, policy_version 1453792 (0.0009) [2023-12-28 05:42:30,861][106225] Updated weights for policy 1, policy_version 1457147 (0.0009) [2023-12-28 05:42:30,915][106225] Updated weights for policy 1, policy_version 1457157 (0.0006) [2023-12-28 05:42:30,975][106225] Updated weights for policy 1, policy_version 1457167 (0.0006) [2023-12-28 05:42:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 745332736. Throughput: 0: 9865.4, 1: 10024.6. Samples: 745319468. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:31,175][105115] Avg episode reward: [(0, '-4.990'), (1, '-5.009')] [2023-12-28 05:42:31,543][106226] Updated weights for policy 0, policy_version 1453802 (0.0007) [2023-12-28 05:42:31,593][106226] Updated weights for policy 0, policy_version 1453812 (0.0008) [2023-12-28 05:42:31,658][106226] Updated weights for policy 0, policy_version 1453822 (0.0008) [2023-12-28 05:42:31,731][106225] Updated weights for policy 1, policy_version 1457177 (0.0007) [2023-12-28 05:42:31,793][106225] Updated weights for policy 1, policy_version 1457187 (0.0009) [2023-12-28 05:42:31,839][106225] Updated weights for policy 1, policy_version 1457197 (0.0010) [2023-12-28 05:42:31,891][106225] Updated weights for policy 1, policy_version 1457207 (0.0010) [2023-12-28 05:42:32,369][106226] Updated weights for policy 0, policy_version 1453832 (0.0008) [2023-12-28 05:42:32,437][106226] Updated weights for policy 0, policy_version 1453842 (0.0008) [2023-12-28 05:42:32,496][106226] Updated weights for policy 0, policy_version 1453852 (0.0008) [2023-12-28 05:42:32,651][106225] Updated weights for policy 1, policy_version 1457217 (0.0008) [2023-12-28 05:42:32,705][106225] Updated weights for policy 1, policy_version 1457227 (0.0010) [2023-12-28 05:42:32,763][106225] Updated weights for policy 1, policy_version 1457237 (0.0010) [2023-12-28 05:42:33,192][106226] Updated weights for policy 0, policy_version 1453862 (0.0006) [2023-12-28 05:42:33,247][106226] Updated weights for policy 0, policy_version 1453872 (0.0005) [2023-12-28 05:42:33,308][106226] Updated weights for policy 0, policy_version 1453882 (0.0005) [2023-12-28 05:42:33,389][106225] Updated weights for policy 1, policy_version 1457247 (0.0009) [2023-12-28 05:42:33,451][106225] Updated weights for policy 1, policy_version 1457257 (0.0009) [2023-12-28 05:42:33,508][106225] Updated weights for policy 1, policy_version 1457267 (0.0009) [2023-12-28 05:42:33,818][106226] Updated weights for policy 0, policy_version 1453892 (0.0005) [2023-12-28 05:42:33,872][106226] Updated weights for policy 0, policy_version 1453902 (0.0005) [2023-12-28 05:42:33,927][106226] Updated weights for policy 0, policy_version 1453912 (0.0005) [2023-12-28 05:42:34,243][106225] Updated weights for policy 1, policy_version 1457277 (0.0007) [2023-12-28 05:42:34,302][106225] Updated weights for policy 1, policy_version 1457287 (0.0007) [2023-12-28 05:42:34,362][106225] Updated weights for policy 1, policy_version 1457297 (0.0009) [2023-12-28 05:42:34,636][106226] Updated weights for policy 0, policy_version 1453922 (0.0009) [2023-12-28 05:42:34,693][106226] Updated weights for policy 0, policy_version 1453932 (0.0009) [2023-12-28 05:42:34,750][106226] Updated weights for policy 0, policy_version 1453942 (0.0009) [2023-12-28 05:42:34,819][106226] Updated weights for policy 0, policy_version 1453952 (0.0009) [2023-12-28 05:42:35,022][106225] Updated weights for policy 1, policy_version 1457307 (0.0008) [2023-12-28 05:42:35,084][106225] Updated weights for policy 1, policy_version 1457317 (0.0005) [2023-12-28 05:42:35,129][106225] Updated weights for policy 1, policy_version 1457327 (0.0005) [2023-12-28 05:42:35,597][106226] Updated weights for policy 0, policy_version 1453962 (0.0008) [2023-12-28 05:42:35,653][106226] Updated weights for policy 0, policy_version 1453972 (0.0009) [2023-12-28 05:42:35,714][106226] Updated weights for policy 0, policy_version 1453982 (0.0008) [2023-12-28 05:42:35,775][106225] Updated weights for policy 1, policy_version 1457337 (0.0007) [2023-12-28 05:42:35,826][106225] Updated weights for policy 1, policy_version 1457347 (0.0009) [2023-12-28 05:42:35,887][106225] Updated weights for policy 1, policy_version 1457357 (0.0009) [2023-12-28 05:42:35,953][106225] Updated weights for policy 1, policy_version 1457367 (0.0008) [2023-12-28 05:42:36,174][105115] Fps is (10 sec: 21299.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 745431040. Throughput: 0: 9847.9, 1: 10058.0. Samples: 745438976. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:36,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-4.872')] [2023-12-28 05:42:36,459][106226] Updated weights for policy 0, policy_version 1453992 (0.0009) [2023-12-28 05:42:36,525][106226] Updated weights for policy 0, policy_version 1454002 (0.0010) [2023-12-28 05:42:36,585][106226] Updated weights for policy 0, policy_version 1454012 (0.0008) [2023-12-28 05:42:36,732][106225] Updated weights for policy 1, policy_version 1457377 (0.0008) [2023-12-28 05:42:36,789][106225] Updated weights for policy 1, policy_version 1457387 (0.0008) [2023-12-28 05:42:36,843][106225] Updated weights for policy 1, policy_version 1457397 (0.0008) [2023-12-28 05:42:37,295][106226] Updated weights for policy 0, policy_version 1454022 (0.0009) [2023-12-28 05:42:37,362][106226] Updated weights for policy 0, policy_version 1454032 (0.0008) [2023-12-28 05:42:37,419][106226] Updated weights for policy 0, policy_version 1454042 (0.0009) [2023-12-28 05:42:37,566][106225] Updated weights for policy 1, policy_version 1457407 (0.0009) [2023-12-28 05:42:37,631][106225] Updated weights for policy 1, policy_version 1457417 (0.0009) [2023-12-28 05:42:37,694][106225] Updated weights for policy 1, policy_version 1457427 (0.0008) [2023-12-28 05:42:38,119][106226] Updated weights for policy 0, policy_version 1454052 (0.0008) [2023-12-28 05:42:38,172][106226] Updated weights for policy 0, policy_version 1454062 (0.0009) [2023-12-28 05:42:38,228][106226] Updated weights for policy 0, policy_version 1454072 (0.0008) [2023-12-28 05:42:38,413][106225] Updated weights for policy 1, policy_version 1457437 (0.0008) [2023-12-28 05:42:38,469][106225] Updated weights for policy 1, policy_version 1457447 (0.0008) [2023-12-28 05:42:38,516][106225] Updated weights for policy 1, policy_version 1457457 (0.0007) [2023-12-28 05:42:38,989][106226] Updated weights for policy 0, policy_version 1454082 (0.0008) [2023-12-28 05:42:39,051][106226] Updated weights for policy 0, policy_version 1454092 (0.0008) [2023-12-28 05:42:39,115][106226] Updated weights for policy 0, policy_version 1454102 (0.0008) [2023-12-28 05:42:39,175][106226] Updated weights for policy 0, policy_version 1454112 (0.0008) [2023-12-28 05:42:39,313][106225] Updated weights for policy 1, policy_version 1457467 (0.0009) [2023-12-28 05:42:39,389][106225] Updated weights for policy 1, policy_version 1457477 (0.0011) [2023-12-28 05:42:39,464][106225] Updated weights for policy 1, policy_version 1457487 (0.0009) [2023-12-28 05:42:40,000][106226] Updated weights for policy 0, policy_version 1454122 (0.0010) [2023-12-28 05:42:40,067][106226] Updated weights for policy 0, policy_version 1454132 (0.0008) [2023-12-28 05:42:40,132][106226] Updated weights for policy 0, policy_version 1454142 (0.0010) [2023-12-28 05:42:40,197][106225] Updated weights for policy 1, policy_version 1457497 (0.0009) [2023-12-28 05:42:40,255][106225] Updated weights for policy 1, policy_version 1457507 (0.0008) [2023-12-28 05:42:40,309][106225] Updated weights for policy 1, policy_version 1457517 (0.0008) [2023-12-28 05:42:40,365][106225] Updated weights for policy 1, policy_version 1457527 (0.0007) [2023-12-28 05:42:40,867][106226] Updated weights for policy 0, policy_version 1454152 (0.0008) [2023-12-28 05:42:40,934][106226] Updated weights for policy 0, policy_version 1454162 (0.0009) [2023-12-28 05:42:40,997][106226] Updated weights for policy 0, policy_version 1454172 (0.0007) [2023-12-28 05:42:41,088][106225] Updated weights for policy 1, policy_version 1457537 (0.0008) [2023-12-28 05:42:41,160][106225] Updated weights for policy 1, policy_version 1457547 (0.0008) [2023-12-28 05:42:41,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 745521152. Throughput: 0: 9858.1, 1: 9975.2. Samples: 745495036. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:41,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-4.978')] [2023-12-28 05:42:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001454176_372342784.pth... [2023-12-28 05:42:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001453024_372047872.pth [2023-12-28 05:42:41,228][106225] Updated weights for policy 1, policy_version 1457557 (0.0008) [2023-12-28 05:42:41,245][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001457560_373186560.pth... [2023-12-28 05:42:41,250][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001456376_372883456.pth [2023-12-28 05:42:41,741][106226] Updated weights for policy 0, policy_version 1454182 (0.0009) [2023-12-28 05:42:41,808][106226] Updated weights for policy 0, policy_version 1454192 (0.0008) [2023-12-28 05:42:41,873][106226] Updated weights for policy 0, policy_version 1454202 (0.0008) [2023-12-28 05:42:42,001][106225] Updated weights for policy 1, policy_version 1457567 (0.0008) [2023-12-28 05:42:42,060][106225] Updated weights for policy 1, policy_version 1457577 (0.0008) [2023-12-28 05:42:42,123][106225] Updated weights for policy 1, policy_version 1457587 (0.0008) [2023-12-28 05:42:42,601][106226] Updated weights for policy 0, policy_version 1454212 (0.0007) [2023-12-28 05:42:42,663][106226] Updated weights for policy 0, policy_version 1454222 (0.0005) [2023-12-28 05:42:42,722][106226] Updated weights for policy 0, policy_version 1454232 (0.0006) [2023-12-28 05:42:42,893][106225] Updated weights for policy 1, policy_version 1457597 (0.0008) [2023-12-28 05:42:42,953][106225] Updated weights for policy 1, policy_version 1457607 (0.0008) [2023-12-28 05:42:43,007][106225] Updated weights for policy 1, policy_version 1457617 (0.0008) [2023-12-28 05:42:43,333][106226] Updated weights for policy 0, policy_version 1454242 (0.0006) [2023-12-28 05:42:43,388][106226] Updated weights for policy 0, policy_version 1454252 (0.0008) [2023-12-28 05:42:43,442][106226] Updated weights for policy 0, policy_version 1454262 (0.0008) [2023-12-28 05:42:43,494][106226] Updated weights for policy 0, policy_version 1454272 (0.0008) [2023-12-28 05:42:43,683][106225] Updated weights for policy 1, policy_version 1457627 (0.0007) [2023-12-28 05:42:43,735][106225] Updated weights for policy 1, policy_version 1457637 (0.0005) [2023-12-28 05:42:43,793][106225] Updated weights for policy 1, policy_version 1457647 (0.0007) [2023-12-28 05:42:44,303][106226] Updated weights for policy 0, policy_version 1454282 (0.0008) [2023-12-28 05:42:44,351][106226] Updated weights for policy 0, policy_version 1454292 (0.0008) [2023-12-28 05:42:44,374][106225] Updated weights for policy 1, policy_version 1457657 (0.0006) [2023-12-28 05:42:44,396][106226] Updated weights for policy 0, policy_version 1454302 (0.0007) [2023-12-28 05:42:44,431][106225] Updated weights for policy 1, policy_version 1457667 (0.0007) [2023-12-28 05:42:44,487][106225] Updated weights for policy 1, policy_version 1457677 (0.0008) [2023-12-28 05:42:44,536][106225] Updated weights for policy 1, policy_version 1457687 (0.0008) [2023-12-28 05:42:45,165][106226] Updated weights for policy 0, policy_version 1454312 (0.0009) [2023-12-28 05:42:45,229][106225] Updated weights for policy 1, policy_version 1457697 (0.0006) [2023-12-28 05:42:45,232][106226] Updated weights for policy 0, policy_version 1454322 (0.0009) [2023-12-28 05:42:45,293][106225] Updated weights for policy 1, policy_version 1457707 (0.0006) [2023-12-28 05:42:45,301][106226] Updated weights for policy 0, policy_version 1454332 (0.0009) [2023-12-28 05:42:45,357][106225] Updated weights for policy 1, policy_version 1457717 (0.0007) [2023-12-28 05:42:46,012][106226] Updated weights for policy 0, policy_version 1454342 (0.0007) [2023-12-28 05:42:46,022][106225] Updated weights for policy 1, policy_version 1457727 (0.0008) [2023-12-28 05:42:46,069][106226] Updated weights for policy 0, policy_version 1454352 (0.0006) [2023-12-28 05:42:46,071][106225] Updated weights for policy 1, policy_version 1457737 (0.0006) [2023-12-28 05:42:46,128][106226] Updated weights for policy 0, policy_version 1454362 (0.0007) [2023-12-28 05:42:46,131][106225] Updated weights for policy 1, policy_version 1457747 (0.0006) [2023-12-28 05:42:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 745627648. Throughput: 0: 9810.6, 1: 9946.5. Samples: 745608940. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:46,175][105115] Avg episode reward: [(0, '-5.021'), (1, '-4.839')] [2023-12-28 05:42:46,849][106226] Updated weights for policy 0, policy_version 1454372 (0.0008) [2023-12-28 05:42:46,863][106225] Updated weights for policy 1, policy_version 1457757 (0.0008) [2023-12-28 05:42:46,896][106226] Updated weights for policy 0, policy_version 1454382 (0.0006) [2023-12-28 05:42:46,918][106225] Updated weights for policy 1, policy_version 1457767 (0.0006) [2023-12-28 05:42:46,943][106226] Updated weights for policy 0, policy_version 1454392 (0.0005) [2023-12-28 05:42:46,976][106225] Updated weights for policy 1, policy_version 1457777 (0.0007) [2023-12-28 05:42:47,613][106225] Updated weights for policy 1, policy_version 1457787 (0.0008) [2023-12-28 05:42:47,629][106226] Updated weights for policy 0, policy_version 1454402 (0.0007) [2023-12-28 05:42:47,670][106225] Updated weights for policy 1, policy_version 1457797 (0.0005) [2023-12-28 05:42:47,683][106226] Updated weights for policy 0, policy_version 1454412 (0.0010) [2023-12-28 05:42:47,725][106225] Updated weights for policy 1, policy_version 1457807 (0.0006) [2023-12-28 05:42:47,737][106226] Updated weights for policy 0, policy_version 1454422 (0.0010) [2023-12-28 05:42:47,791][106226] Updated weights for policy 0, policy_version 1454432 (0.0010) [2023-12-28 05:42:48,430][106225] Updated weights for policy 1, policy_version 1457817 (0.0006) [2023-12-28 05:42:48,487][106225] Updated weights for policy 1, policy_version 1457827 (0.0008) [2023-12-28 05:42:48,539][106225] Updated weights for policy 1, policy_version 1457837 (0.0006) [2023-12-28 05:42:48,549][106226] Updated weights for policy 0, policy_version 1454442 (0.0010) [2023-12-28 05:42:48,599][106225] Updated weights for policy 1, policy_version 1457847 (0.0006) [2023-12-28 05:42:48,609][106226] Updated weights for policy 0, policy_version 1454452 (0.0008) [2023-12-28 05:42:48,673][106226] Updated weights for policy 0, policy_version 1454462 (0.0011) [2023-12-28 05:42:49,269][106225] Updated weights for policy 1, policy_version 1457857 (0.0007) [2023-12-28 05:42:49,274][106226] Updated weights for policy 0, policy_version 1454472 (0.0012) [2023-12-28 05:42:49,330][106225] Updated weights for policy 1, policy_version 1457867 (0.0007) [2023-12-28 05:42:49,334][106226] Updated weights for policy 0, policy_version 1454482 (0.0011) [2023-12-28 05:42:49,398][106225] Updated weights for policy 1, policy_version 1457877 (0.0009) [2023-12-28 05:42:49,405][106226] Updated weights for policy 0, policy_version 1454492 (0.0009) [2023-12-28 05:42:50,145][106226] Updated weights for policy 0, policy_version 1454502 (0.0007) [2023-12-28 05:42:50,154][106225] Updated weights for policy 1, policy_version 1457887 (0.0008) [2023-12-28 05:42:50,204][106226] Updated weights for policy 0, policy_version 1454512 (0.0005) [2023-12-28 05:42:50,213][106225] Updated weights for policy 1, policy_version 1457897 (0.0007) [2023-12-28 05:42:50,262][106226] Updated weights for policy 0, policy_version 1454522 (0.0006) [2023-12-28 05:42:50,269][106225] Updated weights for policy 1, policy_version 1457907 (0.0007) [2023-12-28 05:42:50,962][106226] Updated weights for policy 0, policy_version 1454532 (0.0008) [2023-12-28 05:42:51,014][106226] Updated weights for policy 0, policy_version 1454542 (0.0009) [2023-12-28 05:42:51,021][106225] Updated weights for policy 1, policy_version 1457917 (0.0009) [2023-12-28 05:42:51,080][106226] Updated weights for policy 0, policy_version 1454552 (0.0008) [2023-12-28 05:42:51,087][106225] Updated weights for policy 1, policy_version 1457927 (0.0008) [2023-12-28 05:42:51,152][106225] Updated weights for policy 1, policy_version 1457937 (0.0008) [2023-12-28 05:42:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 745717760. Throughput: 0: 9810.9, 1: 9926.6. Samples: 745727164. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:51,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-4.708')] [2023-12-28 05:42:51,876][106226] Updated weights for policy 0, policy_version 1454562 (0.0007) [2023-12-28 05:42:51,945][106226] Updated weights for policy 0, policy_version 1454572 (0.0007) [2023-12-28 05:42:51,971][106225] Updated weights for policy 1, policy_version 1457947 (0.0007) [2023-12-28 05:42:52,000][106226] Updated weights for policy 0, policy_version 1454582 (0.0011) [2023-12-28 05:42:52,031][106225] Updated weights for policy 1, policy_version 1457957 (0.0006) [2023-12-28 05:42:52,059][106226] Updated weights for policy 0, policy_version 1454592 (0.0011) [2023-12-28 05:42:52,086][106225] Updated weights for policy 1, policy_version 1457967 (0.0005) [2023-12-28 05:42:52,759][106226] Updated weights for policy 0, policy_version 1454602 (0.0007) [2023-12-28 05:42:52,786][106225] Updated weights for policy 1, policy_version 1457977 (0.0007) [2023-12-28 05:42:52,821][106226] Updated weights for policy 0, policy_version 1454612 (0.0007) [2023-12-28 05:42:52,839][106225] Updated weights for policy 1, policy_version 1457987 (0.0008) [2023-12-28 05:42:52,875][106226] Updated weights for policy 0, policy_version 1454622 (0.0005) [2023-12-28 05:42:52,895][106225] Updated weights for policy 1, policy_version 1457997 (0.0008) [2023-12-28 05:42:52,956][106225] Updated weights for policy 1, policy_version 1458007 (0.0009) [2023-12-28 05:42:53,577][106226] Updated weights for policy 0, policy_version 1454632 (0.0008) [2023-12-28 05:42:53,604][106225] Updated weights for policy 1, policy_version 1458017 (0.0005) [2023-12-28 05:42:53,632][106226] Updated weights for policy 0, policy_version 1454642 (0.0007) [2023-12-28 05:42:53,667][106225] Updated weights for policy 1, policy_version 1458027 (0.0008) [2023-12-28 05:42:53,690][106226] Updated weights for policy 0, policy_version 1454652 (0.0010) [2023-12-28 05:42:53,728][106225] Updated weights for policy 1, policy_version 1458037 (0.0010) [2023-12-28 05:42:54,413][106226] Updated weights for policy 0, policy_version 1454662 (0.0008) [2023-12-28 05:42:54,414][106225] Updated weights for policy 1, policy_version 1458047 (0.0010) [2023-12-28 05:42:54,467][106225] Updated weights for policy 1, policy_version 1458057 (0.0006) [2023-12-28 05:42:54,472][106226] Updated weights for policy 0, policy_version 1454672 (0.0006) [2023-12-28 05:42:54,524][106225] Updated weights for policy 1, policy_version 1458067 (0.0006) [2023-12-28 05:42:54,527][106226] Updated weights for policy 0, policy_version 1454682 (0.0007) [2023-12-28 05:42:55,252][106225] Updated weights for policy 1, policy_version 1458077 (0.0007) [2023-12-28 05:42:55,270][106226] Updated weights for policy 0, policy_version 1454692 (0.0007) [2023-12-28 05:42:55,301][106225] Updated weights for policy 1, policy_version 1458087 (0.0007) [2023-12-28 05:42:55,349][106225] Updated weights for policy 1, policy_version 1458097 (0.0008) [2023-12-28 05:42:55,351][106226] Updated weights for policy 0, policy_version 1454702 (0.0007) [2023-12-28 05:42:55,409][106226] Updated weights for policy 0, policy_version 1454712 (0.0009) [2023-12-28 05:42:56,063][106226] Updated weights for policy 0, policy_version 1454722 (0.0008) [2023-12-28 05:42:56,117][106226] Updated weights for policy 0, policy_version 1454732 (0.0006) [2023-12-28 05:42:56,165][106225] Updated weights for policy 1, policy_version 1458107 (0.0007) [2023-12-28 05:42:56,173][106226] Updated weights for policy 0, policy_version 1454742 (0.0006) [2023-12-28 05:42:56,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 745807872. Throughput: 0: 9779.5, 1: 9878.2. Samples: 745784988. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:42:56,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.781')] [2023-12-28 05:42:56,219][106225] Updated weights for policy 1, policy_version 1458117 (0.0007) [2023-12-28 05:42:56,233][106226] Updated weights for policy 0, policy_version 1454752 (0.0007) [2023-12-28 05:42:56,233][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001454752_372490240.pth... [2023-12-28 05:42:56,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001453600_372195328.pth [2023-12-28 05:42:56,276][106225] Updated weights for policy 1, policy_version 1458127 (0.0008) [2023-12-28 05:42:56,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001458136_373334016.pth... [2023-12-28 05:42:56,332][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001456952_373030912.pth [2023-12-28 05:42:56,925][106226] Updated weights for policy 0, policy_version 1454762 (0.0007) [2023-12-28 05:42:56,980][106226] Updated weights for policy 0, policy_version 1454772 (0.0008) [2023-12-28 05:42:57,014][106225] Updated weights for policy 1, policy_version 1458137 (0.0009) [2023-12-28 05:42:57,036][106226] Updated weights for policy 0, policy_version 1454782 (0.0007) [2023-12-28 05:42:57,063][106225] Updated weights for policy 1, policy_version 1458147 (0.0006) [2023-12-28 05:42:57,119][106225] Updated weights for policy 1, policy_version 1458157 (0.0008) [2023-12-28 05:42:57,177][106225] Updated weights for policy 1, policy_version 1458167 (0.0008) [2023-12-28 05:42:57,610][106226] Updated weights for policy 0, policy_version 1454792 (0.0006) [2023-12-28 05:42:57,660][106226] Updated weights for policy 0, policy_version 1454802 (0.0009) [2023-12-28 05:42:57,719][106226] Updated weights for policy 0, policy_version 1454812 (0.0006) [2023-12-28 05:42:57,787][106225] Updated weights for policy 1, policy_version 1458177 (0.0006) [2023-12-28 05:42:57,845][106225] Updated weights for policy 1, policy_version 1458187 (0.0005) [2023-12-28 05:42:57,895][106225] Updated weights for policy 1, policy_version 1458197 (0.0005) [2023-12-28 05:42:58,264][106226] Updated weights for policy 0, policy_version 1454822 (0.0007) [2023-12-28 05:42:58,323][106226] Updated weights for policy 0, policy_version 1454832 (0.0008) [2023-12-28 05:42:58,398][106226] Updated weights for policy 0, policy_version 1454842 (0.0008) [2023-12-28 05:42:58,509][106225] Updated weights for policy 1, policy_version 1458207 (0.0008) [2023-12-28 05:42:58,571][106225] Updated weights for policy 1, policy_version 1458217 (0.0008) [2023-12-28 05:42:58,641][106225] Updated weights for policy 1, policy_version 1458227 (0.0007) [2023-12-28 05:42:59,225][106226] Updated weights for policy 0, policy_version 1454852 (0.0009) [2023-12-28 05:42:59,300][106226] Updated weights for policy 0, policy_version 1454862 (0.0009) [2023-12-28 05:42:59,364][106226] Updated weights for policy 0, policy_version 1454872 (0.0009) [2023-12-28 05:42:59,471][106225] Updated weights for policy 1, policy_version 1458237 (0.0007) [2023-12-28 05:42:59,525][106225] Updated weights for policy 1, policy_version 1458247 (0.0007) [2023-12-28 05:42:59,584][106225] Updated weights for policy 1, policy_version 1458257 (0.0009) [2023-12-28 05:43:00,131][106226] Updated weights for policy 0, policy_version 1454882 (0.0008) [2023-12-28 05:43:00,193][106226] Updated weights for policy 0, policy_version 1454892 (0.0008) [2023-12-28 05:43:00,254][106226] Updated weights for policy 0, policy_version 1454902 (0.0008) [2023-12-28 05:43:00,257][106225] Updated weights for policy 1, policy_version 1458267 (0.0007) [2023-12-28 05:43:00,306][106226] Updated weights for policy 0, policy_version 1454912 (0.0008) [2023-12-28 05:43:00,313][106225] Updated weights for policy 1, policy_version 1458277 (0.0007) [2023-12-28 05:43:00,367][106225] Updated weights for policy 1, policy_version 1458287 (0.0008) [2023-12-28 05:43:01,062][106226] Updated weights for policy 0, policy_version 1454922 (0.0007) [2023-12-28 05:43:01,099][106225] Updated weights for policy 1, policy_version 1458297 (0.0008) [2023-12-28 05:43:01,118][106226] Updated weights for policy 0, policy_version 1454932 (0.0010) [2023-12-28 05:43:01,169][106225] Updated weights for policy 1, policy_version 1458307 (0.0007) [2023-12-28 05:43:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 745906176. Throughput: 0: 9834.0, 1: 9827.6. Samples: 745903352. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:01,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-4.766')] [2023-12-28 05:43:01,179][106226] Updated weights for policy 0, policy_version 1454942 (0.0006) [2023-12-28 05:43:01,234][106225] Updated weights for policy 1, policy_version 1458317 (0.0008) [2023-12-28 05:43:01,292][106225] Updated weights for policy 1, policy_version 1458327 (0.0009) [2023-12-28 05:43:01,934][106226] Updated weights for policy 0, policy_version 1454952 (0.0008) [2023-12-28 05:43:01,991][106226] Updated weights for policy 0, policy_version 1454962 (0.0008) [2023-12-28 05:43:02,051][106226] Updated weights for policy 0, policy_version 1454972 (0.0008) [2023-12-28 05:43:02,053][106225] Updated weights for policy 1, policy_version 1458337 (0.0007) [2023-12-28 05:43:02,110][106225] Updated weights for policy 1, policy_version 1458347 (0.0007) [2023-12-28 05:43:02,172][106225] Updated weights for policy 1, policy_version 1458357 (0.0008) [2023-12-28 05:43:02,769][106226] Updated weights for policy 0, policy_version 1454982 (0.0007) [2023-12-28 05:43:02,823][106226] Updated weights for policy 0, policy_version 1454992 (0.0008) [2023-12-28 05:43:02,873][106226] Updated weights for policy 0, policy_version 1455002 (0.0008) [2023-12-28 05:43:02,905][106225] Updated weights for policy 1, policy_version 1458367 (0.0008) [2023-12-28 05:43:02,948][106225] Updated weights for policy 1, policy_version 1458377 (0.0005) [2023-12-28 05:43:02,995][106225] Updated weights for policy 1, policy_version 1458387 (0.0006) [2023-12-28 05:43:03,590][106226] Updated weights for policy 0, policy_version 1455012 (0.0008) [2023-12-28 05:43:03,653][106226] Updated weights for policy 0, policy_version 1455022 (0.0008) [2023-12-28 05:43:03,711][106225] Updated weights for policy 1, policy_version 1458397 (0.0010) [2023-12-28 05:43:03,711][106226] Updated weights for policy 0, policy_version 1455032 (0.0007) [2023-12-28 05:43:03,771][106225] Updated weights for policy 1, policy_version 1458407 (0.0010) [2023-12-28 05:43:03,833][106225] Updated weights for policy 1, policy_version 1458417 (0.0010) [2023-12-28 05:43:04,299][106226] Updated weights for policy 0, policy_version 1455042 (0.0006) [2023-12-28 05:43:04,365][106226] Updated weights for policy 0, policy_version 1455052 (0.0006) [2023-12-28 05:43:04,428][106226] Updated weights for policy 0, policy_version 1455062 (0.0006) [2023-12-28 05:43:04,494][106226] Updated weights for policy 0, policy_version 1455072 (0.0007) [2023-12-28 05:43:04,501][106225] Updated weights for policy 1, policy_version 1458427 (0.0010) [2023-12-28 05:43:04,561][106225] Updated weights for policy 1, policy_version 1458437 (0.0010) [2023-12-28 05:43:04,625][106225] Updated weights for policy 1, policy_version 1458447 (0.0010) [2023-12-28 05:43:05,105][106226] Updated weights for policy 0, policy_version 1455082 (0.0006) [2023-12-28 05:43:05,168][106226] Updated weights for policy 0, policy_version 1455092 (0.0011) [2023-12-28 05:43:05,236][106226] Updated weights for policy 0, policy_version 1455102 (0.0009) [2023-12-28 05:43:05,316][106225] Updated weights for policy 1, policy_version 1458457 (0.0010) [2023-12-28 05:43:05,382][106225] Updated weights for policy 1, policy_version 1458467 (0.0010) [2023-12-28 05:43:05,448][106225] Updated weights for policy 1, policy_version 1458477 (0.0011) [2023-12-28 05:43:05,505][106225] Updated weights for policy 1, policy_version 1458487 (0.0010) [2023-12-28 05:43:05,794][106226] Updated weights for policy 0, policy_version 1455112 (0.0006) [2023-12-28 05:43:05,852][106226] Updated weights for policy 0, policy_version 1455122 (0.0007) [2023-12-28 05:43:05,899][106226] Updated weights for policy 0, policy_version 1455132 (0.0007) [2023-12-28 05:43:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 746012672. Throughput: 0: 9939.2, 1: 9817.4. Samples: 746023284. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:06,175][105115] Avg episode reward: [(0, '-4.992'), (1, '-5.014')] [2023-12-28 05:43:06,217][106225] Updated weights for policy 1, policy_version 1458497 (0.0011) [2023-12-28 05:43:06,281][106225] Updated weights for policy 1, policy_version 1458507 (0.0011) [2023-12-28 05:43:06,344][106225] Updated weights for policy 1, policy_version 1458517 (0.0010) [2023-12-28 05:43:06,615][106226] Updated weights for policy 0, policy_version 1455142 (0.0009) [2023-12-28 05:43:06,680][106226] Updated weights for policy 0, policy_version 1455152 (0.0008) [2023-12-28 05:43:06,741][106226] Updated weights for policy 0, policy_version 1455162 (0.0008) [2023-12-28 05:43:07,023][106225] Updated weights for policy 1, policy_version 1458527 (0.0007) [2023-12-28 05:43:07,078][106225] Updated weights for policy 1, policy_version 1458537 (0.0005) [2023-12-28 05:43:07,138][106225] Updated weights for policy 1, policy_version 1458547 (0.0006) [2023-12-28 05:43:07,428][106226] Updated weights for policy 0, policy_version 1455172 (0.0006) [2023-12-28 05:43:07,490][106226] Updated weights for policy 0, policy_version 1455182 (0.0006) [2023-12-28 05:43:07,539][106226] Updated weights for policy 0, policy_version 1455192 (0.0008) [2023-12-28 05:43:07,793][106225] Updated weights for policy 1, policy_version 1458557 (0.0008) [2023-12-28 05:43:07,843][106225] Updated weights for policy 1, policy_version 1458567 (0.0010) [2023-12-28 05:43:07,902][106225] Updated weights for policy 1, policy_version 1458577 (0.0009) [2023-12-28 05:43:08,171][106226] Updated weights for policy 0, policy_version 1455202 (0.0008) [2023-12-28 05:43:08,227][106226] Updated weights for policy 0, policy_version 1455212 (0.0005) [2023-12-28 05:43:08,273][106226] Updated weights for policy 0, policy_version 1455222 (0.0005) [2023-12-28 05:43:08,323][106226] Updated weights for policy 0, policy_version 1455232 (0.0006) [2023-12-28 05:43:08,723][106225] Updated weights for policy 1, policy_version 1458587 (0.0008) [2023-12-28 05:43:08,782][106225] Updated weights for policy 1, policy_version 1458597 (0.0009) [2023-12-28 05:43:08,838][106225] Updated weights for policy 1, policy_version 1458607 (0.0008) [2023-12-28 05:43:08,982][106226] Updated weights for policy 0, policy_version 1455242 (0.0008) [2023-12-28 05:43:09,041][106226] Updated weights for policy 0, policy_version 1455252 (0.0008) [2023-12-28 05:43:09,100][106226] Updated weights for policy 0, policy_version 1455262 (0.0008) [2023-12-28 05:43:09,568][106225] Updated weights for policy 1, policy_version 1458618 (0.0008) [2023-12-28 05:43:09,624][106225] Updated weights for policy 1, policy_version 1458628 (0.0006) [2023-12-28 05:43:09,685][106225] Updated weights for policy 1, policy_version 1458638 (0.0006) [2023-12-28 05:43:09,744][106225] Updated weights for policy 1, policy_version 1458648 (0.0006) [2023-12-28 05:43:10,008][106226] Updated weights for policy 0, policy_version 1455272 (0.0008) [2023-12-28 05:43:10,075][106226] Updated weights for policy 0, policy_version 1455282 (0.0008) [2023-12-28 05:43:10,135][106226] Updated weights for policy 0, policy_version 1455292 (0.0009) [2023-12-28 05:43:10,440][106225] Updated weights for policy 1, policy_version 1458658 (0.0009) [2023-12-28 05:43:10,497][106225] Updated weights for policy 1, policy_version 1458668 (0.0009) [2023-12-28 05:43:10,555][106225] Updated weights for policy 1, policy_version 1458678 (0.0009) [2023-12-28 05:43:10,855][106226] Updated weights for policy 0, policy_version 1455302 (0.0009) [2023-12-28 05:43:10,907][106226] Updated weights for policy 0, policy_version 1455312 (0.0008) [2023-12-28 05:43:10,967][106226] Updated weights for policy 0, policy_version 1455322 (0.0006) [2023-12-28 05:43:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 746110976. Throughput: 0: 9980.8, 1: 9816.6. Samples: 746083000. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:11,175][105115] Avg episode reward: [(0, '-4.861'), (1, '-4.906')] [2023-12-28 05:43:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001458680_373473280.pth... [2023-12-28 05:43:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001455328_372637696.pth... [2023-12-28 05:43:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001457560_373186560.pth [2023-12-28 05:43:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001454176_372342784.pth [2023-12-28 05:43:11,337][106225] Updated weights for policy 1, policy_version 1458688 (0.0008) [2023-12-28 05:43:11,401][106225] Updated weights for policy 1, policy_version 1458698 (0.0008) [2023-12-28 05:43:11,453][106225] Updated weights for policy 1, policy_version 1458708 (0.0008) [2023-12-28 05:43:11,729][106226] Updated weights for policy 0, policy_version 1455332 (0.0009) [2023-12-28 05:43:11,801][106226] Updated weights for policy 0, policy_version 1455342 (0.0010) [2023-12-28 05:43:11,858][106226] Updated weights for policy 0, policy_version 1455352 (0.0010) [2023-12-28 05:43:12,204][106225] Updated weights for policy 1, policy_version 1458718 (0.0008) [2023-12-28 05:43:12,265][106225] Updated weights for policy 1, policy_version 1458728 (0.0008) [2023-12-28 05:43:12,327][106225] Updated weights for policy 1, policy_version 1458738 (0.0008) [2023-12-28 05:43:12,585][106226] Updated weights for policy 0, policy_version 1455362 (0.0010) [2023-12-28 05:43:12,643][106226] Updated weights for policy 0, policy_version 1455372 (0.0008) [2023-12-28 05:43:12,697][106226] Updated weights for policy 0, policy_version 1455382 (0.0008) [2023-12-28 05:43:12,760][106226] Updated weights for policy 0, policy_version 1455392 (0.0009) [2023-12-28 05:43:13,059][106225] Updated weights for policy 1, policy_version 1458748 (0.0008) [2023-12-28 05:43:13,121][106225] Updated weights for policy 1, policy_version 1458758 (0.0008) [2023-12-28 05:43:13,170][106225] Updated weights for policy 1, policy_version 1458768 (0.0008) [2023-12-28 05:43:13,483][106226] Updated weights for policy 0, policy_version 1455402 (0.0007) [2023-12-28 05:43:13,532][106226] Updated weights for policy 0, policy_version 1455412 (0.0007) [2023-12-28 05:43:13,586][106226] Updated weights for policy 0, policy_version 1455422 (0.0006) [2023-12-28 05:43:13,958][106225] Updated weights for policy 1, policy_version 1458778 (0.0008) [2023-12-28 05:43:14,004][106225] Updated weights for policy 1, policy_version 1458788 (0.0008) [2023-12-28 05:43:14,055][106225] Updated weights for policy 1, policy_version 1458798 (0.0008) [2023-12-28 05:43:14,106][106225] Updated weights for policy 1, policy_version 1458808 (0.0008) [2023-12-28 05:43:14,160][106226] Updated weights for policy 0, policy_version 1455432 (0.0008) [2023-12-28 05:43:14,213][106226] Updated weights for policy 0, policy_version 1455442 (0.0009) [2023-12-28 05:43:14,267][106226] Updated weights for policy 0, policy_version 1455452 (0.0008) [2023-12-28 05:43:14,743][106225] Updated weights for policy 1, policy_version 1458818 (0.0008) [2023-12-28 05:43:14,807][106225] Updated weights for policy 1, policy_version 1458828 (0.0008) [2023-12-28 05:43:14,870][106225] Updated weights for policy 1, policy_version 1458838 (0.0007) [2023-12-28 05:43:15,093][106226] Updated weights for policy 0, policy_version 1455462 (0.0009) [2023-12-28 05:43:15,156][106226] Updated weights for policy 0, policy_version 1455472 (0.0008) [2023-12-28 05:43:15,213][106226] Updated weights for policy 0, policy_version 1455482 (0.0009) [2023-12-28 05:43:15,618][106225] Updated weights for policy 1, policy_version 1458848 (0.0009) [2023-12-28 05:43:15,669][106225] Updated weights for policy 1, policy_version 1458858 (0.0008) [2023-12-28 05:43:15,720][106225] Updated weights for policy 1, policy_version 1458868 (0.0008) [2023-12-28 05:43:15,955][106226] Updated weights for policy 0, policy_version 1455492 (0.0009) [2023-12-28 05:43:16,001][106226] Updated weights for policy 0, policy_version 1455502 (0.0009) [2023-12-28 05:43:16,054][106226] Updated weights for policy 0, policy_version 1455512 (0.0009) [2023-12-28 05:43:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 746209280. Throughput: 0: 9769.8, 1: 9724.5. Samples: 746196716. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:16,176][105115] Avg episode reward: [(0, '-4.918'), (1, '-4.750')] [2023-12-28 05:43:16,453][106225] Updated weights for policy 1, policy_version 1458878 (0.0009) [2023-12-28 05:43:16,508][106225] Updated weights for policy 1, policy_version 1458888 (0.0008) [2023-12-28 05:43:16,559][106225] Updated weights for policy 1, policy_version 1458898 (0.0008) [2023-12-28 05:43:16,801][106226] Updated weights for policy 0, policy_version 1455522 (0.0006) [2023-12-28 05:43:16,851][106226] Updated weights for policy 0, policy_version 1455532 (0.0009) [2023-12-28 05:43:16,902][106226] Updated weights for policy 0, policy_version 1455542 (0.0009) [2023-12-28 05:43:16,965][106226] Updated weights for policy 0, policy_version 1455552 (0.0008) [2023-12-28 05:43:17,163][106225] Updated weights for policy 1, policy_version 1458908 (0.0007) [2023-12-28 05:43:17,221][106225] Updated weights for policy 1, policy_version 1458918 (0.0008) [2023-12-28 05:43:17,277][106225] Updated weights for policy 1, policy_version 1458928 (0.0008) [2023-12-28 05:43:17,708][106226] Updated weights for policy 0, policy_version 1455562 (0.0008) [2023-12-28 05:43:17,758][106226] Updated weights for policy 0, policy_version 1455572 (0.0008) [2023-12-28 05:43:17,810][106226] Updated weights for policy 0, policy_version 1455582 (0.0009) [2023-12-28 05:43:18,015][106225] Updated weights for policy 1, policy_version 1458938 (0.0007) [2023-12-28 05:43:18,080][106225] Updated weights for policy 1, policy_version 1458948 (0.0008) [2023-12-28 05:43:18,153][106225] Updated weights for policy 1, policy_version 1458958 (0.0009) [2023-12-28 05:43:18,213][106225] Updated weights for policy 1, policy_version 1458968 (0.0008) [2023-12-28 05:43:18,540][106226] Updated weights for policy 0, policy_version 1455592 (0.0007) [2023-12-28 05:43:18,600][106226] Updated weights for policy 0, policy_version 1455602 (0.0008) [2023-12-28 05:43:18,664][106226] Updated weights for policy 0, policy_version 1455612 (0.0009) [2023-12-28 05:43:18,905][106225] Updated weights for policy 1, policy_version 1458978 (0.0009) [2023-12-28 05:43:18,955][106225] Updated weights for policy 1, policy_version 1458988 (0.0008) [2023-12-28 05:43:19,005][106225] Updated weights for policy 1, policy_version 1458998 (0.0009) [2023-12-28 05:43:19,261][106226] Updated weights for policy 0, policy_version 1455622 (0.0010) [2023-12-28 05:43:19,323][106226] Updated weights for policy 0, policy_version 1455632 (0.0008) [2023-12-28 05:43:19,389][106226] Updated weights for policy 0, policy_version 1455642 (0.0008) [2023-12-28 05:43:19,792][106225] Updated weights for policy 1, policy_version 1459008 (0.0007) [2023-12-28 05:43:19,857][106225] Updated weights for policy 1, policy_version 1459018 (0.0008) [2023-12-28 05:43:19,922][106225] Updated weights for policy 1, policy_version 1459028 (0.0008) [2023-12-28 05:43:20,167][106226] Updated weights for policy 0, policy_version 1455652 (0.0008) [2023-12-28 05:43:20,234][106226] Updated weights for policy 0, policy_version 1455662 (0.0010) [2023-12-28 05:43:20,292][106226] Updated weights for policy 0, policy_version 1455672 (0.0011) [2023-12-28 05:43:20,658][106225] Updated weights for policy 1, policy_version 1459038 (0.0007) [2023-12-28 05:43:20,726][106225] Updated weights for policy 1, policy_version 1459048 (0.0008) [2023-12-28 05:43:20,794][106225] Updated weights for policy 1, policy_version 1459058 (0.0009) [2023-12-28 05:43:21,048][106226] Updated weights for policy 0, policy_version 1455682 (0.0011) [2023-12-28 05:43:21,124][106226] Updated weights for policy 0, policy_version 1455692 (0.0010) [2023-12-28 05:43:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 746299392. Throughput: 0: 9726.8, 1: 9664.0. Samples: 746311564. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:21,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-4.773')] [2023-12-28 05:43:21,190][106226] Updated weights for policy 0, policy_version 1455702 (0.0011) [2023-12-28 05:43:21,259][106226] Updated weights for policy 0, policy_version 1455712 (0.0009) [2023-12-28 05:43:21,615][106225] Updated weights for policy 1, policy_version 1459068 (0.0008) [2023-12-28 05:43:21,687][106225] Updated weights for policy 1, policy_version 1459078 (0.0008) [2023-12-28 05:43:21,760][106225] Updated weights for policy 1, policy_version 1459088 (0.0007) [2023-12-28 05:43:21,991][106226] Updated weights for policy 0, policy_version 1455722 (0.0006) [2023-12-28 05:43:22,050][106226] Updated weights for policy 0, policy_version 1455732 (0.0007) [2023-12-28 05:43:22,123][106226] Updated weights for policy 0, policy_version 1455742 (0.0006) [2023-12-28 05:43:22,466][106225] Updated weights for policy 1, policy_version 1459098 (0.0008) [2023-12-28 05:43:22,522][106225] Updated weights for policy 1, policy_version 1459108 (0.0007) [2023-12-28 05:43:22,574][106225] Updated weights for policy 1, policy_version 1459118 (0.0008) [2023-12-28 05:43:22,639][106225] Updated weights for policy 1, policy_version 1459128 (0.0008) [2023-12-28 05:43:22,786][106226] Updated weights for policy 0, policy_version 1455752 (0.0007) [2023-12-28 05:43:22,849][106226] Updated weights for policy 0, policy_version 1455762 (0.0006) [2023-12-28 05:43:22,910][106226] Updated weights for policy 0, policy_version 1455772 (0.0005) [2023-12-28 05:43:23,422][106225] Updated weights for policy 1, policy_version 1459138 (0.0007) [2023-12-28 05:43:23,480][106225] Updated weights for policy 1, policy_version 1459148 (0.0005) [2023-12-28 05:43:23,538][106225] Updated weights for policy 1, policy_version 1459158 (0.0007) [2023-12-28 05:43:23,546][106226] Updated weights for policy 0, policy_version 1455782 (0.0008) [2023-12-28 05:43:23,606][106226] Updated weights for policy 0, policy_version 1455792 (0.0008) [2023-12-28 05:43:23,661][106226] Updated weights for policy 0, policy_version 1455802 (0.0008) [2023-12-28 05:43:24,214][106225] Updated weights for policy 1, policy_version 1459168 (0.0009) [2023-12-28 05:43:24,277][106225] Updated weights for policy 1, policy_version 1459178 (0.0008) [2023-12-28 05:43:24,328][106225] Updated weights for policy 1, policy_version 1459188 (0.0008) [2023-12-28 05:43:24,399][106226] Updated weights for policy 0, policy_version 1455812 (0.0007) [2023-12-28 05:43:24,458][106226] Updated weights for policy 0, policy_version 1455822 (0.0009) [2023-12-28 05:43:24,509][106226] Updated weights for policy 0, policy_version 1455832 (0.0005) [2023-12-28 05:43:24,913][106225] Updated weights for policy 1, policy_version 1459198 (0.0009) [2023-12-28 05:43:24,985][106225] Updated weights for policy 1, policy_version 1459208 (0.0007) [2023-12-28 05:43:25,033][106225] Updated weights for policy 1, policy_version 1459218 (0.0009) [2023-12-28 05:43:25,241][106226] Updated weights for policy 0, policy_version 1455842 (0.0008) [2023-12-28 05:43:25,305][106226] Updated weights for policy 0, policy_version 1455852 (0.0009) [2023-12-28 05:43:25,364][106226] Updated weights for policy 0, policy_version 1455862 (0.0008) [2023-12-28 05:43:25,419][106226] Updated weights for policy 0, policy_version 1455872 (0.0008) [2023-12-28 05:43:25,700][106225] Updated weights for policy 1, policy_version 1459228 (0.0009) [2023-12-28 05:43:25,756][106225] Updated weights for policy 1, policy_version 1459238 (0.0008) [2023-12-28 05:43:25,816][106225] Updated weights for policy 1, policy_version 1459248 (0.0008) [2023-12-28 05:43:26,157][106226] Updated weights for policy 0, policy_version 1455882 (0.0008) [2023-12-28 05:43:26,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 746397696. Throughput: 0: 9750.9, 1: 9661.8. Samples: 746368604. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:26,175][105115] Avg episode reward: [(0, '-5.017'), (1, '-4.782')] [2023-12-28 05:43:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001459256_373620736.pth... [2023-12-28 05:43:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001458136_373334016.pth [2023-12-28 05:43:26,224][106226] Updated weights for policy 0, policy_version 1455892 (0.0006) [2023-12-28 05:43:26,296][106226] Updated weights for policy 0, policy_version 1455902 (0.0006) [2023-12-28 05:43:26,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001455904_372785152.pth... [2023-12-28 05:43:26,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001454752_372490240.pth [2023-12-28 05:43:26,490][106225] Updated weights for policy 1, policy_version 1459258 (0.0008) [2023-12-28 05:43:26,549][106225] Updated weights for policy 1, policy_version 1459268 (0.0007) [2023-12-28 05:43:26,603][106225] Updated weights for policy 1, policy_version 1459278 (0.0009) [2023-12-28 05:43:26,661][106225] Updated weights for policy 1, policy_version 1459288 (0.0008) [2023-12-28 05:43:26,897][106226] Updated weights for policy 0, policy_version 1455912 (0.0007) [2023-12-28 05:43:26,942][106226] Updated weights for policy 0, policy_version 1455922 (0.0008) [2023-12-28 05:43:26,990][106226] Updated weights for policy 0, policy_version 1455932 (0.0008) [2023-12-28 05:43:27,359][106225] Updated weights for policy 1, policy_version 1459298 (0.0007) [2023-12-28 05:43:27,408][106225] Updated weights for policy 1, policy_version 1459308 (0.0008) [2023-12-28 05:43:27,455][106225] Updated weights for policy 1, policy_version 1459318 (0.0008) [2023-12-28 05:43:27,712][106226] Updated weights for policy 0, policy_version 1455942 (0.0008) [2023-12-28 05:43:27,756][106226] Updated weights for policy 0, policy_version 1455952 (0.0008) [2023-12-28 05:43:27,805][106226] Updated weights for policy 0, policy_version 1455962 (0.0009) [2023-12-28 05:43:28,148][106225] Updated weights for policy 1, policy_version 1459328 (0.0008) [2023-12-28 05:43:28,200][106225] Updated weights for policy 1, policy_version 1459338 (0.0005) [2023-12-28 05:43:28,258][106225] Updated weights for policy 1, policy_version 1459348 (0.0005) [2023-12-28 05:43:28,553][106226] Updated weights for policy 0, policy_version 1455972 (0.0008) [2023-12-28 05:43:28,604][106226] Updated weights for policy 0, policy_version 1455982 (0.0008) [2023-12-28 05:43:28,659][106226] Updated weights for policy 0, policy_version 1455992 (0.0008) [2023-12-28 05:43:28,951][106225] Updated weights for policy 1, policy_version 1459358 (0.0010) [2023-12-28 05:43:29,000][106225] Updated weights for policy 1, policy_version 1459368 (0.0010) [2023-12-28 05:43:29,053][106225] Updated weights for policy 1, policy_version 1459378 (0.0010) [2023-12-28 05:43:29,427][106226] Updated weights for policy 0, policy_version 1456002 (0.0008) [2023-12-28 05:43:29,474][106226] Updated weights for policy 0, policy_version 1456012 (0.0008) [2023-12-28 05:43:29,522][106226] Updated weights for policy 0, policy_version 1456022 (0.0008) [2023-12-28 05:43:29,578][106226] Updated weights for policy 0, policy_version 1456032 (0.0007) [2023-12-28 05:43:29,804][106225] Updated weights for policy 1, policy_version 1459388 (0.0010) [2023-12-28 05:43:29,869][106225] Updated weights for policy 1, policy_version 1459398 (0.0009) [2023-12-28 05:43:29,927][106225] Updated weights for policy 1, policy_version 1459408 (0.0010) [2023-12-28 05:43:30,390][106226] Updated weights for policy 0, policy_version 1456042 (0.0011) [2023-12-28 05:43:30,450][106226] Updated weights for policy 0, policy_version 1456052 (0.0010) [2023-12-28 05:43:30,503][106226] Updated weights for policy 0, policy_version 1456062 (0.0010) [2023-12-28 05:43:30,560][106225] Updated weights for policy 1, policy_version 1459418 (0.0008) [2023-12-28 05:43:30,605][106225] Updated weights for policy 1, policy_version 1459428 (0.0008) [2023-12-28 05:43:30,650][106225] Updated weights for policy 1, policy_version 1459438 (0.0007) [2023-12-28 05:43:30,696][106225] Updated weights for policy 1, policy_version 1459448 (0.0007) [2023-12-28 05:43:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 746496000. Throughput: 0: 9791.5, 1: 9737.8. Samples: 746487760. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:31,175][105115] Avg episode reward: [(0, '-4.994'), (1, '-4.679')] [2023-12-28 05:43:31,193][106226] Updated weights for policy 0, policy_version 1456072 (0.0011) [2023-12-28 05:43:31,244][106226] Updated weights for policy 0, policy_version 1456082 (0.0010) [2023-12-28 05:43:31,307][106226] Updated weights for policy 0, policy_version 1456092 (0.0010) [2023-12-28 05:43:31,387][106225] Updated weights for policy 1, policy_version 1459458 (0.0008) [2023-12-28 05:43:31,452][106225] Updated weights for policy 1, policy_version 1459468 (0.0007) [2023-12-28 05:43:31,508][106225] Updated weights for policy 1, policy_version 1459478 (0.0008) [2023-12-28 05:43:31,990][106226] Updated weights for policy 0, policy_version 1456102 (0.0010) [2023-12-28 05:43:32,049][106226] Updated weights for policy 0, policy_version 1456112 (0.0009) [2023-12-28 05:43:32,117][106226] Updated weights for policy 0, policy_version 1456122 (0.0006) [2023-12-28 05:43:32,265][106225] Updated weights for policy 1, policy_version 1459488 (0.0009) [2023-12-28 05:43:32,321][106225] Updated weights for policy 1, policy_version 1459498 (0.0008) [2023-12-28 05:43:32,381][106225] Updated weights for policy 1, policy_version 1459508 (0.0008) [2023-12-28 05:43:32,815][106226] Updated weights for policy 0, policy_version 1456132 (0.0009) [2023-12-28 05:43:32,868][106226] Updated weights for policy 0, policy_version 1456142 (0.0010) [2023-12-28 05:43:32,920][106226] Updated weights for policy 0, policy_version 1456152 (0.0010) [2023-12-28 05:43:33,076][106225] Updated weights for policy 1, policy_version 1459518 (0.0008) [2023-12-28 05:43:33,127][106225] Updated weights for policy 1, policy_version 1459528 (0.0010) [2023-12-28 05:43:33,186][106225] Updated weights for policy 1, policy_version 1459538 (0.0005) [2023-12-28 05:43:33,540][106226] Updated weights for policy 0, policy_version 1456162 (0.0009) [2023-12-28 05:43:33,591][106226] Updated weights for policy 0, policy_version 1456172 (0.0008) [2023-12-28 05:43:33,643][106226] Updated weights for policy 0, policy_version 1456182 (0.0009) [2023-12-28 05:43:33,701][106226] Updated weights for policy 0, policy_version 1456192 (0.0008) [2023-12-28 05:43:33,860][106225] Updated weights for policy 1, policy_version 1459548 (0.0008) [2023-12-28 05:43:33,922][106225] Updated weights for policy 1, policy_version 1459558 (0.0005) [2023-12-28 05:43:33,970][106225] Updated weights for policy 1, policy_version 1459568 (0.0005) [2023-12-28 05:43:34,381][106226] Updated weights for policy 0, policy_version 1456202 (0.0009) [2023-12-28 05:43:34,450][106226] Updated weights for policy 0, policy_version 1456212 (0.0008) [2023-12-28 05:43:34,525][106226] Updated weights for policy 0, policy_version 1456222 (0.0008) [2023-12-28 05:43:34,654][106225] Updated weights for policy 1, policy_version 1459578 (0.0006) [2023-12-28 05:43:34,719][106225] Updated weights for policy 1, policy_version 1459588 (0.0007) [2023-12-28 05:43:34,783][106225] Updated weights for policy 1, policy_version 1459598 (0.0010) [2023-12-28 05:43:34,842][106225] Updated weights for policy 1, policy_version 1459608 (0.0009) [2023-12-28 05:43:35,113][106226] Updated weights for policy 0, policy_version 1456232 (0.0008) [2023-12-28 05:43:35,174][106226] Updated weights for policy 0, policy_version 1456242 (0.0010) [2023-12-28 05:43:35,225][106226] Updated weights for policy 0, policy_version 1456252 (0.0005) [2023-12-28 05:43:35,517][106225] Updated weights for policy 1, policy_version 1459618 (0.0008) [2023-12-28 05:43:35,575][106225] Updated weights for policy 1, policy_version 1459628 (0.0008) [2023-12-28 05:43:35,630][106225] Updated weights for policy 1, policy_version 1459638 (0.0009) [2023-12-28 05:43:35,877][106226] Updated weights for policy 0, policy_version 1456262 (0.0006) [2023-12-28 05:43:35,929][106226] Updated weights for policy 0, policy_version 1456272 (0.0007) [2023-12-28 05:43:35,986][106226] Updated weights for policy 0, policy_version 1456282 (0.0006) [2023-12-28 05:43:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 746602496. Throughput: 0: 9864.7, 1: 9750.8. Samples: 746609864. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:36,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-5.138')] [2023-12-28 05:43:36,394][106225] Updated weights for policy 1, policy_version 1459648 (0.0009) [2023-12-28 05:43:36,456][106225] Updated weights for policy 1, policy_version 1459658 (0.0008) [2023-12-28 05:43:36,514][106225] Updated weights for policy 1, policy_version 1459668 (0.0009) [2023-12-28 05:43:36,698][106226] Updated weights for policy 0, policy_version 1456292 (0.0009) [2023-12-28 05:43:36,759][106226] Updated weights for policy 0, policy_version 1456302 (0.0007) [2023-12-28 05:43:36,816][106226] Updated weights for policy 0, policy_version 1456312 (0.0010) [2023-12-28 05:43:37,139][106225] Updated weights for policy 1, policy_version 1459678 (0.0009) [2023-12-28 05:43:37,192][106225] Updated weights for policy 1, policy_version 1459688 (0.0009) [2023-12-28 05:43:37,252][106225] Updated weights for policy 1, policy_version 1459698 (0.0008) [2023-12-28 05:43:37,571][106226] Updated weights for policy 0, policy_version 1456322 (0.0009) [2023-12-28 05:43:37,629][106226] Updated weights for policy 0, policy_version 1456332 (0.0008) [2023-12-28 05:43:37,690][106226] Updated weights for policy 0, policy_version 1456342 (0.0009) [2023-12-28 05:43:37,748][106226] Updated weights for policy 0, policy_version 1456352 (0.0008) [2023-12-28 05:43:38,003][106225] Updated weights for policy 1, policy_version 1459708 (0.0008) [2023-12-28 05:43:38,058][106225] Updated weights for policy 1, policy_version 1459718 (0.0008) [2023-12-28 05:43:38,116][106225] Updated weights for policy 1, policy_version 1459728 (0.0008) [2023-12-28 05:43:38,416][106226] Updated weights for policy 0, policy_version 1456362 (0.0008) [2023-12-28 05:43:38,479][106226] Updated weights for policy 0, policy_version 1456372 (0.0009) [2023-12-28 05:43:38,538][106226] Updated weights for policy 0, policy_version 1456382 (0.0008) [2023-12-28 05:43:38,877][106225] Updated weights for policy 1, policy_version 1459738 (0.0008) [2023-12-28 05:43:38,944][106225] Updated weights for policy 1, policy_version 1459748 (0.0009) [2023-12-28 05:43:39,003][106225] Updated weights for policy 1, policy_version 1459758 (0.0009) [2023-12-28 05:43:39,067][106225] Updated weights for policy 1, policy_version 1459768 (0.0009) [2023-12-28 05:43:39,294][106226] Updated weights for policy 0, policy_version 1456392 (0.0007) [2023-12-28 05:43:39,364][106226] Updated weights for policy 0, policy_version 1456402 (0.0008) [2023-12-28 05:43:39,438][106226] Updated weights for policy 0, policy_version 1456412 (0.0009) [2023-12-28 05:43:39,843][106225] Updated weights for policy 1, policy_version 1459778 (0.0010) [2023-12-28 05:43:39,903][106225] Updated weights for policy 1, policy_version 1459788 (0.0009) [2023-12-28 05:43:39,969][106225] Updated weights for policy 1, policy_version 1459798 (0.0009) [2023-12-28 05:43:40,209][106226] Updated weights for policy 0, policy_version 1456422 (0.0008) [2023-12-28 05:43:40,269][106226] Updated weights for policy 0, policy_version 1456432 (0.0009) [2023-12-28 05:43:40,325][106226] Updated weights for policy 0, policy_version 1456442 (0.0008) [2023-12-28 05:43:40,698][106225] Updated weights for policy 1, policy_version 1459808 (0.0006) [2023-12-28 05:43:40,763][106225] Updated weights for policy 1, policy_version 1459818 (0.0005) [2023-12-28 05:43:40,820][106225] Updated weights for policy 1, policy_version 1459828 (0.0005) [2023-12-28 05:43:41,143][106226] Updated weights for policy 0, policy_version 1456452 (0.0009) [2023-12-28 05:43:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 746692608. Throughput: 0: 9864.1, 1: 9755.8. Samples: 746667884. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:41,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.896')] [2023-12-28 05:43:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001459832_373768192.pth... [2023-12-28 05:43:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001458680_373473280.pth [2023-12-28 05:43:41,213][106226] Updated weights for policy 0, policy_version 1456462 (0.0009) [2023-12-28 05:43:41,287][106226] Updated weights for policy 0, policy_version 1456472 (0.0012) [2023-12-28 05:43:41,335][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001456480_372932608.pth... [2023-12-28 05:43:41,338][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001455328_372637696.pth [2023-12-28 05:43:41,506][106225] Updated weights for policy 1, policy_version 1459838 (0.0006) [2023-12-28 05:43:41,575][106225] Updated weights for policy 1, policy_version 1459848 (0.0006) [2023-12-28 05:43:41,644][106225] Updated weights for policy 1, policy_version 1459858 (0.0007) [2023-12-28 05:43:42,046][106226] Updated weights for policy 0, policy_version 1456482 (0.0009) [2023-12-28 05:43:42,104][106226] Updated weights for policy 0, policy_version 1456492 (0.0010) [2023-12-28 05:43:42,160][106226] Updated weights for policy 0, policy_version 1456502 (0.0008) [2023-12-28 05:43:42,225][106226] Updated weights for policy 0, policy_version 1456512 (0.0009) [2023-12-28 05:43:42,291][106225] Updated weights for policy 1, policy_version 1459868 (0.0007) [2023-12-28 05:43:42,350][106225] Updated weights for policy 1, policy_version 1459878 (0.0008) [2023-12-28 05:43:42,418][106225] Updated weights for policy 1, policy_version 1459888 (0.0009) [2023-12-28 05:43:42,985][106226] Updated weights for policy 0, policy_version 1456522 (0.0006) [2023-12-28 05:43:43,045][106226] Updated weights for policy 0, policy_version 1456532 (0.0009) [2023-12-28 05:43:43,090][106225] Updated weights for policy 1, policy_version 1459898 (0.0008) [2023-12-28 05:43:43,109][106226] Updated weights for policy 0, policy_version 1456542 (0.0008) [2023-12-28 05:43:43,150][106225] Updated weights for policy 1, policy_version 1459908 (0.0005) [2023-12-28 05:43:43,211][106225] Updated weights for policy 1, policy_version 1459918 (0.0008) [2023-12-28 05:43:43,261][106225] Updated weights for policy 1, policy_version 1459928 (0.0008) [2023-12-28 05:43:43,786][106226] Updated weights for policy 0, policy_version 1456552 (0.0008) [2023-12-28 05:43:43,840][106226] Updated weights for policy 0, policy_version 1456562 (0.0008) [2023-12-28 05:43:43,892][106226] Updated weights for policy 0, policy_version 1456572 (0.0008) [2023-12-28 05:43:43,956][106225] Updated weights for policy 1, policy_version 1459938 (0.0007) [2023-12-28 05:43:44,010][106225] Updated weights for policy 1, policy_version 1459948 (0.0010) [2023-12-28 05:43:44,060][106225] Updated weights for policy 1, policy_version 1459958 (0.0010) [2023-12-28 05:43:44,658][106226] Updated weights for policy 0, policy_version 1456582 (0.0008) [2023-12-28 05:43:44,724][106225] Updated weights for policy 1, policy_version 1459968 (0.0010) [2023-12-28 05:43:44,725][106226] Updated weights for policy 0, policy_version 1456592 (0.0007) [2023-12-28 05:43:44,790][106225] Updated weights for policy 1, policy_version 1459978 (0.0009) [2023-12-28 05:43:44,793][106226] Updated weights for policy 0, policy_version 1456602 (0.0007) [2023-12-28 05:43:44,850][106225] Updated weights for policy 1, policy_version 1459988 (0.0008) [2023-12-28 05:43:45,519][106226] Updated weights for policy 0, policy_version 1456612 (0.0007) [2023-12-28 05:43:45,580][106225] Updated weights for policy 1, policy_version 1459998 (0.0007) [2023-12-28 05:43:45,582][106226] Updated weights for policy 0, policy_version 1456622 (0.0009) [2023-12-28 05:43:45,636][106225] Updated weights for policy 1, policy_version 1460008 (0.0005) [2023-12-28 05:43:45,638][106226] Updated weights for policy 0, policy_version 1456632 (0.0008) [2023-12-28 05:43:45,696][106225] Updated weights for policy 1, policy_version 1460018 (0.0008) [2023-12-28 05:43:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 746790912. Throughput: 0: 9742.2, 1: 9772.4. Samples: 746781508. Policy #0 lag: (min: 3.0, avg: 10.0, max: 35.0) [2023-12-28 05:43:46,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-5.050')] [2023-12-28 05:43:46,323][106225] Updated weights for policy 1, policy_version 1460028 (0.0007) [2023-12-28 05:43:46,368][106225] Updated weights for policy 1, policy_version 1460038 (0.0005) [2023-12-28 05:43:46,407][106226] Updated weights for policy 0, policy_version 1456642 (0.0008) [2023-12-28 05:43:46,418][106225] Updated weights for policy 1, policy_version 1460048 (0.0005) [2023-12-28 05:43:46,463][106226] Updated weights for policy 0, policy_version 1456652 (0.0008) [2023-12-28 05:43:46,520][106226] Updated weights for policy 0, policy_version 1456662 (0.0009) [2023-12-28 05:43:46,573][106226] Updated weights for policy 0, policy_version 1456672 (0.0009) [2023-12-28 05:43:46,963][106225] Updated weights for policy 1, policy_version 1460058 (0.0005) [2023-12-28 05:43:47,014][106225] Updated weights for policy 1, policy_version 1460068 (0.0005) [2023-12-28 05:43:47,062][106225] Updated weights for policy 1, policy_version 1460078 (0.0006) [2023-12-28 05:43:47,126][106225] Updated weights for policy 1, policy_version 1460088 (0.0005) [2023-12-28 05:43:47,423][106226] Updated weights for policy 0, policy_version 1456682 (0.0009) [2023-12-28 05:43:47,478][106226] Updated weights for policy 0, policy_version 1456692 (0.0008) [2023-12-28 05:43:47,545][106226] Updated weights for policy 0, policy_version 1456702 (0.0009) [2023-12-28 05:43:47,715][106225] Updated weights for policy 1, policy_version 1460098 (0.0008) [2023-12-28 05:43:47,771][106225] Updated weights for policy 1, policy_version 1460108 (0.0009) [2023-12-28 05:43:47,829][106225] Updated weights for policy 1, policy_version 1460118 (0.0008) [2023-12-28 05:43:48,252][106226] Updated weights for policy 0, policy_version 1456712 (0.0010) [2023-12-28 05:43:48,303][106226] Updated weights for policy 0, policy_version 1456722 (0.0010) [2023-12-28 05:43:48,363][106226] Updated weights for policy 0, policy_version 1456732 (0.0008) [2023-12-28 05:43:48,550][106225] Updated weights for policy 1, policy_version 1460128 (0.0008) [2023-12-28 05:43:48,606][106225] Updated weights for policy 1, policy_version 1460138 (0.0008) [2023-12-28 05:43:48,662][106225] Updated weights for policy 1, policy_version 1460148 (0.0008) [2023-12-28 05:43:49,133][106226] Updated weights for policy 0, policy_version 1456742 (0.0009) [2023-12-28 05:43:49,199][106226] Updated weights for policy 0, policy_version 1456752 (0.0011) [2023-12-28 05:43:49,261][106226] Updated weights for policy 0, policy_version 1456762 (0.0009) [2023-12-28 05:43:49,447][106225] Updated weights for policy 1, policy_version 1460158 (0.0009) [2023-12-28 05:43:49,512][106225] Updated weights for policy 1, policy_version 1460168 (0.0010) [2023-12-28 05:43:49,580][106225] Updated weights for policy 1, policy_version 1460178 (0.0011) [2023-12-28 05:43:49,999][106226] Updated weights for policy 0, policy_version 1456772 (0.0010) [2023-12-28 05:43:50,056][106226] Updated weights for policy 0, policy_version 1456782 (0.0008) [2023-12-28 05:43:50,119][106226] Updated weights for policy 0, policy_version 1456792 (0.0008) [2023-12-28 05:43:50,274][106225] Updated weights for policy 1, policy_version 1460188 (0.0008) [2023-12-28 05:43:50,335][106225] Updated weights for policy 1, policy_version 1460198 (0.0006) [2023-12-28 05:43:50,405][106225] Updated weights for policy 1, policy_version 1460208 (0.0006) [2023-12-28 05:43:50,786][106226] Updated weights for policy 0, policy_version 1456802 (0.0009) [2023-12-28 05:43:50,837][106226] Updated weights for policy 0, policy_version 1456812 (0.0008) [2023-12-28 05:43:50,892][106226] Updated weights for policy 0, policy_version 1456822 (0.0008) [2023-12-28 05:43:50,942][106226] Updated weights for policy 0, policy_version 1456832 (0.0008) [2023-12-28 05:43:51,077][106225] Updated weights for policy 1, policy_version 1460218 (0.0006) [2023-12-28 05:43:51,144][106225] Updated weights for policy 1, policy_version 1460228 (0.0008) [2023-12-28 05:43:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 746889216. Throughput: 0: 9629.5, 1: 9832.9. Samples: 746899092. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:43:51,175][105115] Avg episode reward: [(0, '-5.029'), (1, '-4.877')] [2023-12-28 05:43:51,202][106225] Updated weights for policy 1, policy_version 1460238 (0.0008) [2023-12-28 05:43:51,268][106225] Updated weights for policy 1, policy_version 1460248 (0.0009) [2023-12-28 05:43:51,745][106226] Updated weights for policy 0, policy_version 1456842 (0.0009) [2023-12-28 05:43:51,805][106226] Updated weights for policy 0, policy_version 1456852 (0.0009) [2023-12-28 05:43:51,866][106226] Updated weights for policy 0, policy_version 1456862 (0.0006) [2023-12-28 05:43:51,992][106225] Updated weights for policy 1, policy_version 1460258 (0.0009) [2023-12-28 05:43:52,050][106225] Updated weights for policy 1, policy_version 1460268 (0.0008) [2023-12-28 05:43:52,115][106225] Updated weights for policy 1, policy_version 1460278 (0.0008) [2023-12-28 05:43:52,592][106226] Updated weights for policy 0, policy_version 1456872 (0.0007) [2023-12-28 05:43:52,661][106226] Updated weights for policy 0, policy_version 1456882 (0.0006) [2023-12-28 05:43:52,728][106226] Updated weights for policy 0, policy_version 1456892 (0.0008) [2023-12-28 05:43:52,893][106225] Updated weights for policy 1, policy_version 1460288 (0.0009) [2023-12-28 05:43:52,961][106225] Updated weights for policy 1, policy_version 1460298 (0.0010) [2023-12-28 05:43:53,026][106225] Updated weights for policy 1, policy_version 1460308 (0.0011) [2023-12-28 05:43:53,366][106226] Updated weights for policy 0, policy_version 1456902 (0.0008) [2023-12-28 05:43:53,429][106226] Updated weights for policy 0, policy_version 1456912 (0.0007) [2023-12-28 05:43:53,501][106226] Updated weights for policy 0, policy_version 1456922 (0.0006) [2023-12-28 05:43:53,708][106225] Updated weights for policy 1, policy_version 1460318 (0.0010) [2023-12-28 05:43:53,770][106225] Updated weights for policy 1, policy_version 1460328 (0.0009) [2023-12-28 05:43:53,829][106225] Updated weights for policy 1, policy_version 1460338 (0.0010) [2023-12-28 05:43:54,039][106226] Updated weights for policy 0, policy_version 1456932 (0.0005) [2023-12-28 05:43:54,093][106226] Updated weights for policy 0, policy_version 1456942 (0.0005) [2023-12-28 05:43:54,153][106226] Updated weights for policy 0, policy_version 1456952 (0.0006) [2023-12-28 05:43:54,505][106225] Updated weights for policy 1, policy_version 1460348 (0.0008) [2023-12-28 05:43:54,555][106225] Updated weights for policy 1, policy_version 1460358 (0.0005) [2023-12-28 05:43:54,609][106225] Updated weights for policy 1, policy_version 1460368 (0.0005) [2023-12-28 05:43:54,783][106226] Updated weights for policy 0, policy_version 1456962 (0.0007) [2023-12-28 05:43:54,838][106226] Updated weights for policy 0, policy_version 1456972 (0.0009) [2023-12-28 05:43:54,892][106226] Updated weights for policy 0, policy_version 1456982 (0.0011) [2023-12-28 05:43:54,949][106226] Updated weights for policy 0, policy_version 1456992 (0.0011) [2023-12-28 05:43:55,178][106225] Updated weights for policy 1, policy_version 1460378 (0.0008) [2023-12-28 05:43:55,241][106225] Updated weights for policy 1, policy_version 1460388 (0.0010) [2023-12-28 05:43:55,297][106225] Updated weights for policy 1, policy_version 1460398 (0.0010) [2023-12-28 05:43:55,352][106225] Updated weights for policy 1, policy_version 1460408 (0.0010) [2023-12-28 05:43:55,655][106226] Updated weights for policy 0, policy_version 1457002 (0.0008) [2023-12-28 05:43:55,701][106226] Updated weights for policy 0, policy_version 1457012 (0.0008) [2023-12-28 05:43:55,761][106226] Updated weights for policy 0, policy_version 1457022 (0.0008) [2023-12-28 05:43:55,997][106225] Updated weights for policy 1, policy_version 1460418 (0.0010) [2023-12-28 05:43:56,047][106225] Updated weights for policy 1, policy_version 1460428 (0.0010) [2023-12-28 05:43:56,094][106225] Updated weights for policy 1, policy_version 1460438 (0.0010) [2023-12-28 05:43:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 746995712. Throughput: 0: 9632.6, 1: 9817.6. Samples: 746958260. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:43:56,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-5.002')] [2023-12-28 05:43:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001460440_373923840.pth... [2023-12-28 05:43:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001457024_373071872.pth... [2023-12-28 05:43:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001459256_373620736.pth [2023-12-28 05:43:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001455904_372785152.pth [2023-12-28 05:43:56,476][106226] Updated weights for policy 0, policy_version 1457032 (0.0006) [2023-12-28 05:43:56,541][106226] Updated weights for policy 0, policy_version 1457042 (0.0009) [2023-12-28 05:43:56,605][106226] Updated weights for policy 0, policy_version 1457052 (0.0011) [2023-12-28 05:43:56,874][106225] Updated weights for policy 1, policy_version 1460448 (0.0010) [2023-12-28 05:43:56,937][106225] Updated weights for policy 1, policy_version 1460458 (0.0010) [2023-12-28 05:43:56,988][106225] Updated weights for policy 1, policy_version 1460468 (0.0010) [2023-12-28 05:43:57,326][106226] Updated weights for policy 0, policy_version 1457062 (0.0011) [2023-12-28 05:43:57,372][106226] Updated weights for policy 0, policy_version 1457072 (0.0010) [2023-12-28 05:43:57,424][106226] Updated weights for policy 0, policy_version 1457082 (0.0010) [2023-12-28 05:43:57,709][106225] Updated weights for policy 1, policy_version 1460478 (0.0010) [2023-12-28 05:43:57,772][106225] Updated weights for policy 1, policy_version 1460488 (0.0010) [2023-12-28 05:43:57,834][106225] Updated weights for policy 1, policy_version 1460498 (0.0010) [2023-12-28 05:43:58,002][106226] Updated weights for policy 0, policy_version 1457092 (0.0008) [2023-12-28 05:43:58,050][106226] Updated weights for policy 0, policy_version 1457102 (0.0005) [2023-12-28 05:43:58,105][106226] Updated weights for policy 0, policy_version 1457112 (0.0005) [2023-12-28 05:43:58,622][106225] Updated weights for policy 1, policy_version 1460509 (0.0010) [2023-12-28 05:43:58,679][106225] Updated weights for policy 1, policy_version 1460519 (0.0007) [2023-12-28 05:43:58,748][106225] Updated weights for policy 1, policy_version 1460529 (0.0008) [2023-12-28 05:43:58,863][106226] Updated weights for policy 0, policy_version 1457122 (0.0006) [2023-12-28 05:43:58,939][106226] Updated weights for policy 0, policy_version 1457132 (0.0010) [2023-12-28 05:43:59,001][106226] Updated weights for policy 0, policy_version 1457142 (0.0011) [2023-12-28 05:43:59,059][106226] Updated weights for policy 0, policy_version 1457152 (0.0011) [2023-12-28 05:43:59,622][106225] Updated weights for policy 1, policy_version 1460539 (0.0007) [2023-12-28 05:43:59,672][106225] Updated weights for policy 1, policy_version 1460549 (0.0009) [2023-12-28 05:43:59,726][106225] Updated weights for policy 1, policy_version 1460559 (0.0010) [2023-12-28 05:43:59,801][106226] Updated weights for policy 0, policy_version 1457162 (0.0010) [2023-12-28 05:43:59,867][106226] Updated weights for policy 0, policy_version 1457172 (0.0011) [2023-12-28 05:43:59,934][106226] Updated weights for policy 0, policy_version 1457182 (0.0008) [2023-12-28 05:44:00,411][106225] Updated weights for policy 1, policy_version 1460569 (0.0010) [2023-12-28 05:44:00,471][106225] Updated weights for policy 1, policy_version 1460579 (0.0010) [2023-12-28 05:44:00,528][106225] Updated weights for policy 1, policy_version 1460589 (0.0010) [2023-12-28 05:44:00,580][106225] Updated weights for policy 1, policy_version 1460599 (0.0008) [2023-12-28 05:44:00,593][106226] Updated weights for policy 0, policy_version 1457192 (0.0006) [2023-12-28 05:44:00,650][106226] Updated weights for policy 0, policy_version 1457202 (0.0005) [2023-12-28 05:44:00,701][106226] Updated weights for policy 0, policy_version 1457212 (0.0005) [2023-12-28 05:44:01,163][106225] Updated weights for policy 1, policy_version 1460609 (0.0009) [2023-12-28 05:44:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 747085824. Throughput: 0: 9710.8, 1: 9841.9. Samples: 747076584. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:01,175][105115] Avg episode reward: [(0, '-4.890'), (1, '-4.855')] [2023-12-28 05:44:01,213][106225] Updated weights for policy 1, policy_version 1460619 (0.0007) [2023-12-28 05:44:01,272][106225] Updated weights for policy 1, policy_version 1460629 (0.0008) [2023-12-28 05:44:01,367][106226] Updated weights for policy 0, policy_version 1457222 (0.0009) [2023-12-28 05:44:01,432][106226] Updated weights for policy 0, policy_version 1457232 (0.0011) [2023-12-28 05:44:01,482][106226] Updated weights for policy 0, policy_version 1457242 (0.0010) [2023-12-28 05:44:01,968][106225] Updated weights for policy 1, policy_version 1460639 (0.0009) [2023-12-28 05:44:02,025][106225] Updated weights for policy 1, policy_version 1460649 (0.0009) [2023-12-28 05:44:02,080][106225] Updated weights for policy 1, policy_version 1460659 (0.0009) [2023-12-28 05:44:02,251][106226] Updated weights for policy 0, policy_version 1457252 (0.0010) [2023-12-28 05:44:02,310][106226] Updated weights for policy 0, policy_version 1457262 (0.0007) [2023-12-28 05:44:02,367][106226] Updated weights for policy 0, policy_version 1457272 (0.0008) [2023-12-28 05:44:02,865][106225] Updated weights for policy 1, policy_version 1460669 (0.0010) [2023-12-28 05:44:02,924][106225] Updated weights for policy 1, policy_version 1460679 (0.0010) [2023-12-28 05:44:02,980][106225] Updated weights for policy 1, policy_version 1460689 (0.0010) [2023-12-28 05:44:03,053][106226] Updated weights for policy 0, policy_version 1457282 (0.0006) [2023-12-28 05:44:03,109][106226] Updated weights for policy 0, policy_version 1457292 (0.0008) [2023-12-28 05:44:03,157][106226] Updated weights for policy 0, policy_version 1457302 (0.0007) [2023-12-28 05:44:03,202][106226] Updated weights for policy 0, policy_version 1457312 (0.0007) [2023-12-28 05:44:03,680][106225] Updated weights for policy 1, policy_version 1460699 (0.0009) [2023-12-28 05:44:03,741][106225] Updated weights for policy 1, policy_version 1460709 (0.0008) [2023-12-28 05:44:03,805][106225] Updated weights for policy 1, policy_version 1460719 (0.0008) [2023-12-28 05:44:03,889][106226] Updated weights for policy 0, policy_version 1457322 (0.0007) [2023-12-28 05:44:03,941][106226] Updated weights for policy 0, policy_version 1457332 (0.0007) [2023-12-28 05:44:03,995][106226] Updated weights for policy 0, policy_version 1457342 (0.0008) [2023-12-28 05:44:04,513][106225] Updated weights for policy 1, policy_version 1460729 (0.0009) [2023-12-28 05:44:04,568][106225] Updated weights for policy 1, policy_version 1460739 (0.0009) [2023-12-28 05:44:04,621][106225] Updated weights for policy 1, policy_version 1460749 (0.0006) [2023-12-28 05:44:04,677][106225] Updated weights for policy 1, policy_version 1460759 (0.0006) [2023-12-28 05:44:04,736][106226] Updated weights for policy 0, policy_version 1457352 (0.0009) [2023-12-28 05:44:04,786][106226] Updated weights for policy 0, policy_version 1457362 (0.0008) [2023-12-28 05:44:04,840][106226] Updated weights for policy 0, policy_version 1457372 (0.0009) [2023-12-28 05:44:05,339][106225] Updated weights for policy 1, policy_version 1460769 (0.0007) [2023-12-28 05:44:05,391][106225] Updated weights for policy 1, policy_version 1460779 (0.0008) [2023-12-28 05:44:05,445][106225] Updated weights for policy 1, policy_version 1460789 (0.0007) [2023-12-28 05:44:05,533][106226] Updated weights for policy 0, policy_version 1457382 (0.0008) [2023-12-28 05:44:05,601][106226] Updated weights for policy 0, policy_version 1457392 (0.0009) [2023-12-28 05:44:05,662][106226] Updated weights for policy 0, policy_version 1457402 (0.0009) [2023-12-28 05:44:06,087][106225] Updated weights for policy 1, policy_version 1460799 (0.0007) [2023-12-28 05:44:06,155][106225] Updated weights for policy 1, policy_version 1460809 (0.0008) [2023-12-28 05:44:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 747184128. Throughput: 0: 9749.4, 1: 9918.9. Samples: 747196640. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:06,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-4.533')] [2023-12-28 05:44:06,216][106225] Updated weights for policy 1, policy_version 1460819 (0.0008) [2023-12-28 05:44:06,440][106226] Updated weights for policy 0, policy_version 1457412 (0.0009) [2023-12-28 05:44:06,498][106226] Updated weights for policy 0, policy_version 1457422 (0.0011) [2023-12-28 05:44:06,557][106226] Updated weights for policy 0, policy_version 1457432 (0.0011) [2023-12-28 05:44:06,988][106225] Updated weights for policy 1, policy_version 1460829 (0.0008) [2023-12-28 05:44:07,038][106225] Updated weights for policy 1, policy_version 1460839 (0.0008) [2023-12-28 05:44:07,088][106225] Updated weights for policy 1, policy_version 1460849 (0.0008) [2023-12-28 05:44:07,284][106226] Updated weights for policy 0, policy_version 1457442 (0.0010) [2023-12-28 05:44:07,342][106226] Updated weights for policy 0, policy_version 1457452 (0.0010) [2023-12-28 05:44:07,401][106226] Updated weights for policy 0, policy_version 1457462 (0.0011) [2023-12-28 05:44:07,467][106226] Updated weights for policy 0, policy_version 1457472 (0.0010) [2023-12-28 05:44:07,837][106225] Updated weights for policy 1, policy_version 1460859 (0.0008) [2023-12-28 05:44:07,894][106225] Updated weights for policy 1, policy_version 1460869 (0.0007) [2023-12-28 05:44:07,961][106225] Updated weights for policy 1, policy_version 1460879 (0.0008) [2023-12-28 05:44:08,174][106226] Updated weights for policy 0, policy_version 1457482 (0.0010) [2023-12-28 05:44:08,234][106226] Updated weights for policy 0, policy_version 1457492 (0.0011) [2023-12-28 05:44:08,297][106226] Updated weights for policy 0, policy_version 1457502 (0.0010) [2023-12-28 05:44:08,691][106225] Updated weights for policy 1, policy_version 1460889 (0.0008) [2023-12-28 05:44:08,750][106225] Updated weights for policy 1, policy_version 1460899 (0.0007) [2023-12-28 05:44:08,806][106225] Updated weights for policy 1, policy_version 1460909 (0.0007) [2023-12-28 05:44:08,851][106225] Updated weights for policy 1, policy_version 1460919 (0.0008) [2023-12-28 05:44:09,044][106226] Updated weights for policy 0, policy_version 1457512 (0.0010) [2023-12-28 05:44:09,100][106226] Updated weights for policy 0, policy_version 1457522 (0.0009) [2023-12-28 05:44:09,157][106226] Updated weights for policy 0, policy_version 1457532 (0.0008) [2023-12-28 05:44:09,617][106225] Updated weights for policy 1, policy_version 1460929 (0.0007) [2023-12-28 05:44:09,677][106225] Updated weights for policy 1, policy_version 1460939 (0.0006) [2023-12-28 05:44:09,736][106225] Updated weights for policy 1, policy_version 1460949 (0.0006) [2023-12-28 05:44:09,931][106226] Updated weights for policy 0, policy_version 1457542 (0.0007) [2023-12-28 05:44:09,999][106226] Updated weights for policy 0, policy_version 1457552 (0.0006) [2023-12-28 05:44:10,057][106226] Updated weights for policy 0, policy_version 1457562 (0.0006) [2023-12-28 05:44:10,419][106225] Updated weights for policy 1, policy_version 1460959 (0.0006) [2023-12-28 05:44:10,481][106225] Updated weights for policy 1, policy_version 1460969 (0.0007) [2023-12-28 05:44:10,541][106225] Updated weights for policy 1, policy_version 1460979 (0.0006) [2023-12-28 05:44:10,717][106226] Updated weights for policy 0, policy_version 1457572 (0.0007) [2023-12-28 05:44:10,777][106226] Updated weights for policy 0, policy_version 1457582 (0.0006) [2023-12-28 05:44:10,837][106226] Updated weights for policy 0, policy_version 1457592 (0.0005) [2023-12-28 05:44:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 747282432. Throughput: 0: 9729.4, 1: 9939.9. Samples: 747253720. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:11,175][105115] Avg episode reward: [(0, '-4.792'), (1, '-4.584')] [2023-12-28 05:44:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001460984_374063104.pth... [2023-12-28 05:44:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001457600_373219328.pth... [2023-12-28 05:44:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001459832_373768192.pth [2023-12-28 05:44:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001456480_372932608.pth [2023-12-28 05:44:11,268][106225] Updated weights for policy 1, policy_version 1460989 (0.0008) [2023-12-28 05:44:11,336][106225] Updated weights for policy 1, policy_version 1460999 (0.0009) [2023-12-28 05:44:11,414][106225] Updated weights for policy 1, policy_version 1461009 (0.0008) [2023-12-28 05:44:11,545][106226] Updated weights for policy 0, policy_version 1457602 (0.0008) [2023-12-28 05:44:11,615][106226] Updated weights for policy 0, policy_version 1457612 (0.0007) [2023-12-28 05:44:11,684][106226] Updated weights for policy 0, policy_version 1457622 (0.0009) [2023-12-28 05:44:11,753][106226] Updated weights for policy 0, policy_version 1457632 (0.0010) [2023-12-28 05:44:12,134][106225] Updated weights for policy 1, policy_version 1461019 (0.0006) [2023-12-28 05:44:12,186][106225] Updated weights for policy 1, policy_version 1461029 (0.0008) [2023-12-28 05:44:12,243][106225] Updated weights for policy 1, policy_version 1461039 (0.0009) [2023-12-28 05:44:12,561][106226] Updated weights for policy 0, policy_version 1457642 (0.0009) [2023-12-28 05:44:12,629][106226] Updated weights for policy 0, policy_version 1457652 (0.0008) [2023-12-28 05:44:12,689][106226] Updated weights for policy 0, policy_version 1457662 (0.0006) [2023-12-28 05:44:13,021][106225] Updated weights for policy 1, policy_version 1461049 (0.0008) [2023-12-28 05:44:13,066][106225] Updated weights for policy 1, policy_version 1461059 (0.0008) [2023-12-28 05:44:13,110][106225] Updated weights for policy 1, policy_version 1461069 (0.0008) [2023-12-28 05:44:13,173][106225] Updated weights for policy 1, policy_version 1461079 (0.0008) [2023-12-28 05:44:13,364][106226] Updated weights for policy 0, policy_version 1457672 (0.0010) [2023-12-28 05:44:13,425][106226] Updated weights for policy 0, policy_version 1457682 (0.0011) [2023-12-28 05:44:13,485][106226] Updated weights for policy 0, policy_version 1457692 (0.0011) [2023-12-28 05:44:13,936][106225] Updated weights for policy 1, policy_version 1461089 (0.0008) [2023-12-28 05:44:13,979][106225] Updated weights for policy 1, policy_version 1461099 (0.0008) [2023-12-28 05:44:14,025][106225] Updated weights for policy 1, policy_version 1461109 (0.0006) [2023-12-28 05:44:14,152][106226] Updated weights for policy 0, policy_version 1457702 (0.0008) [2023-12-28 05:44:14,213][106226] Updated weights for policy 0, policy_version 1457712 (0.0006) [2023-12-28 05:44:14,270][106226] Updated weights for policy 0, policy_version 1457722 (0.0005) [2023-12-28 05:44:14,723][106225] Updated weights for policy 1, policy_version 1461119 (0.0008) [2023-12-28 05:44:14,787][106225] Updated weights for policy 1, policy_version 1461129 (0.0008) [2023-12-28 05:44:14,849][106225] Updated weights for policy 1, policy_version 1461139 (0.0009) [2023-12-28 05:44:14,908][106226] Updated weights for policy 0, policy_version 1457732 (0.0005) [2023-12-28 05:44:14,977][106226] Updated weights for policy 0, policy_version 1457742 (0.0006) [2023-12-28 05:44:15,039][106226] Updated weights for policy 0, policy_version 1457752 (0.0007) [2023-12-28 05:44:15,547][106225] Updated weights for policy 1, policy_version 1461149 (0.0008) [2023-12-28 05:44:15,589][106226] Updated weights for policy 0, policy_version 1457762 (0.0007) [2023-12-28 05:44:15,603][106225] Updated weights for policy 1, policy_version 1461159 (0.0008) [2023-12-28 05:44:15,654][106226] Updated weights for policy 0, policy_version 1457772 (0.0006) [2023-12-28 05:44:15,664][106225] Updated weights for policy 1, policy_version 1461169 (0.0008) [2023-12-28 05:44:15,713][106226] Updated weights for policy 0, policy_version 1457782 (0.0007) [2023-12-28 05:44:15,780][106226] Updated weights for policy 0, policy_version 1457792 (0.0009) [2023-12-28 05:44:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 747380736. Throughput: 0: 9757.5, 1: 9856.6. Samples: 747370396. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:16,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.735')] [2023-12-28 05:44:16,407][106225] Updated weights for policy 1, policy_version 1461179 (0.0007) [2023-12-28 05:44:16,416][106226] Updated weights for policy 0, policy_version 1457802 (0.0005) [2023-12-28 05:44:16,465][106225] Updated weights for policy 1, policy_version 1461189 (0.0010) [2023-12-28 05:44:16,480][106226] Updated weights for policy 0, policy_version 1457812 (0.0008) [2023-12-28 05:44:16,521][106225] Updated weights for policy 1, policy_version 1461199 (0.0006) [2023-12-28 05:44:16,543][106226] Updated weights for policy 0, policy_version 1457822 (0.0007) [2023-12-28 05:44:17,155][106226] Updated weights for policy 0, policy_version 1457832 (0.0008) [2023-12-28 05:44:17,214][106226] Updated weights for policy 0, policy_version 1457842 (0.0009) [2023-12-28 05:44:17,269][106225] Updated weights for policy 1, policy_version 1461209 (0.0008) [2023-12-28 05:44:17,272][106226] Updated weights for policy 0, policy_version 1457852 (0.0008) [2023-12-28 05:44:17,322][106225] Updated weights for policy 1, policy_version 1461219 (0.0005) [2023-12-28 05:44:17,367][106225] Updated weights for policy 1, policy_version 1461229 (0.0005) [2023-12-28 05:44:17,416][106225] Updated weights for policy 1, policy_version 1461239 (0.0009) [2023-12-28 05:44:17,929][106226] Updated weights for policy 0, policy_version 1457862 (0.0006) [2023-12-28 05:44:17,979][106226] Updated weights for policy 0, policy_version 1457872 (0.0009) [2023-12-28 05:44:18,036][106226] Updated weights for policy 0, policy_version 1457882 (0.0008) [2023-12-28 05:44:18,072][106225] Updated weights for policy 1, policy_version 1461249 (0.0008) [2023-12-28 05:44:18,122][106225] Updated weights for policy 1, policy_version 1461259 (0.0008) [2023-12-28 05:44:18,171][106225] Updated weights for policy 1, policy_version 1461269 (0.0009) [2023-12-28 05:44:18,774][106226] Updated weights for policy 0, policy_version 1457892 (0.0009) [2023-12-28 05:44:18,838][106226] Updated weights for policy 0, policy_version 1457902 (0.0008) [2023-12-28 05:44:18,890][106226] Updated weights for policy 0, policy_version 1457912 (0.0008) [2023-12-28 05:44:18,945][106225] Updated weights for policy 1, policy_version 1461279 (0.0006) [2023-12-28 05:44:18,993][106225] Updated weights for policy 1, policy_version 1461289 (0.0005) [2023-12-28 05:44:19,038][106225] Updated weights for policy 1, policy_version 1461299 (0.0007) [2023-12-28 05:44:19,611][106226] Updated weights for policy 0, policy_version 1457922 (0.0009) [2023-12-28 05:44:19,667][106226] Updated weights for policy 0, policy_version 1457932 (0.0008) [2023-12-28 05:44:19,718][106226] Updated weights for policy 0, policy_version 1457942 (0.0010) [2023-12-28 05:44:19,774][106225] Updated weights for policy 1, policy_version 1461309 (0.0009) [2023-12-28 05:44:19,775][106226] Updated weights for policy 0, policy_version 1457952 (0.0007) [2023-12-28 05:44:19,836][106225] Updated weights for policy 1, policy_version 1461319 (0.0008) [2023-12-28 05:44:19,900][106225] Updated weights for policy 1, policy_version 1461329 (0.0007) [2023-12-28 05:44:20,511][106226] Updated weights for policy 0, policy_version 1457962 (0.0011) [2023-12-28 05:44:20,567][106225] Updated weights for policy 1, policy_version 1461339 (0.0008) [2023-12-28 05:44:20,575][106226] Updated weights for policy 0, policy_version 1457972 (0.0011) [2023-12-28 05:44:20,627][106225] Updated weights for policy 1, policy_version 1461349 (0.0007) [2023-12-28 05:44:20,642][106226] Updated weights for policy 0, policy_version 1457982 (0.0009) [2023-12-28 05:44:20,691][106225] Updated weights for policy 1, policy_version 1461359 (0.0006) [2023-12-28 05:44:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 747479040. Throughput: 0: 9736.4, 1: 9814.3. Samples: 747489648. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:21,175][105115] Avg episode reward: [(0, '-5.177'), (1, '-4.957')] [2023-12-28 05:44:21,324][106226] Updated weights for policy 0, policy_version 1457992 (0.0009) [2023-12-28 05:44:21,396][106226] Updated weights for policy 0, policy_version 1458002 (0.0010) [2023-12-28 05:44:21,455][106226] Updated weights for policy 0, policy_version 1458013 (0.0010) [2023-12-28 05:44:21,472][106225] Updated weights for policy 1, policy_version 1461369 (0.0008) [2023-12-28 05:44:21,528][106225] Updated weights for policy 1, policy_version 1461379 (0.0008) [2023-12-28 05:44:21,595][106225] Updated weights for policy 1, policy_version 1461389 (0.0008) [2023-12-28 05:44:21,663][106225] Updated weights for policy 1, policy_version 1461399 (0.0008) [2023-12-28 05:44:22,237][106226] Updated weights for policy 0, policy_version 1458023 (0.0008) [2023-12-28 05:44:22,293][106226] Updated weights for policy 0, policy_version 1458033 (0.0008) [2023-12-28 05:44:22,359][106226] Updated weights for policy 0, policy_version 1458043 (0.0006) [2023-12-28 05:44:22,474][106225] Updated weights for policy 1, policy_version 1461409 (0.0009) [2023-12-28 05:44:22,540][106225] Updated weights for policy 1, policy_version 1461419 (0.0008) [2023-12-28 05:44:22,603][106225] Updated weights for policy 1, policy_version 1461429 (0.0009) [2023-12-28 05:44:23,111][106226] Updated weights for policy 0, policy_version 1458053 (0.0009) [2023-12-28 05:44:23,161][106226] Updated weights for policy 0, policy_version 1458063 (0.0007) [2023-12-28 05:44:23,214][106226] Updated weights for policy 0, policy_version 1458073 (0.0005) [2023-12-28 05:44:23,303][106225] Updated weights for policy 1, policy_version 1461439 (0.0009) [2023-12-28 05:44:23,371][106225] Updated weights for policy 1, policy_version 1461449 (0.0010) [2023-12-28 05:44:23,431][106225] Updated weights for policy 1, policy_version 1461459 (0.0010) [2023-12-28 05:44:23,762][106226] Updated weights for policy 0, policy_version 1458083 (0.0007) [2023-12-28 05:44:23,810][106226] Updated weights for policy 0, policy_version 1458093 (0.0008) [2023-12-28 05:44:23,857][106226] Updated weights for policy 0, policy_version 1458103 (0.0010) [2023-12-28 05:44:24,098][106225] Updated weights for policy 1, policy_version 1461469 (0.0008) [2023-12-28 05:44:24,160][106225] Updated weights for policy 1, policy_version 1461479 (0.0006) [2023-12-28 05:44:24,223][106225] Updated weights for policy 1, policy_version 1461489 (0.0007) [2023-12-28 05:44:24,583][106226] Updated weights for policy 0, policy_version 1458113 (0.0010) [2023-12-28 05:44:24,639][106226] Updated weights for policy 0, policy_version 1458123 (0.0011) [2023-12-28 05:44:24,692][106226] Updated weights for policy 0, policy_version 1458133 (0.0011) [2023-12-28 05:44:24,745][106226] Updated weights for policy 0, policy_version 1458143 (0.0010) [2023-12-28 05:44:24,873][106225] Updated weights for policy 1, policy_version 1461499 (0.0009) [2023-12-28 05:44:24,936][106225] Updated weights for policy 1, policy_version 1461509 (0.0010) [2023-12-28 05:44:25,001][106225] Updated weights for policy 1, policy_version 1461519 (0.0011) [2023-12-28 05:44:25,440][106226] Updated weights for policy 0, policy_version 1458153 (0.0011) [2023-12-28 05:44:25,496][106226] Updated weights for policy 0, policy_version 1458163 (0.0010) [2023-12-28 05:44:25,555][106226] Updated weights for policy 0, policy_version 1458173 (0.0011) [2023-12-28 05:44:25,637][106225] Updated weights for policy 1, policy_version 1461529 (0.0010) [2023-12-28 05:44:25,687][106225] Updated weights for policy 1, policy_version 1461539 (0.0008) [2023-12-28 05:44:25,733][106225] Updated weights for policy 1, policy_version 1461549 (0.0007) [2023-12-28 05:44:25,788][106225] Updated weights for policy 1, policy_version 1461559 (0.0006) [2023-12-28 05:44:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 747577344. Throughput: 0: 9767.8, 1: 9784.4. Samples: 747547736. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:26,176][105115] Avg episode reward: [(0, '-4.717'), (1, '-4.776')] [2023-12-28 05:44:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001461560_374210560.pth... [2023-12-28 05:44:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001460440_373923840.pth [2023-12-28 05:44:26,201][106226] Updated weights for policy 0, policy_version 1458183 (0.0011) [2023-12-28 05:44:26,254][106226] Updated weights for policy 0, policy_version 1458193 (0.0011) [2023-12-28 05:44:26,308][106226] Updated weights for policy 0, policy_version 1458203 (0.0010) [2023-12-28 05:44:26,330][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001458208_373374976.pth... [2023-12-28 05:44:26,333][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001457024_373071872.pth [2023-12-28 05:44:26,429][106225] Updated weights for policy 1, policy_version 1461569 (0.0005) [2023-12-28 05:44:26,488][106225] Updated weights for policy 1, policy_version 1461579 (0.0006) [2023-12-28 05:44:26,549][106225] Updated weights for policy 1, policy_version 1461589 (0.0008) [2023-12-28 05:44:27,018][106226] Updated weights for policy 0, policy_version 1458213 (0.0010) [2023-12-28 05:44:27,073][106226] Updated weights for policy 0, policy_version 1458223 (0.0006) [2023-12-28 05:44:27,127][106226] Updated weights for policy 0, policy_version 1458233 (0.0006) [2023-12-28 05:44:27,166][106225] Updated weights for policy 1, policy_version 1461599 (0.0008) [2023-12-28 05:44:27,231][106225] Updated weights for policy 1, policy_version 1461609 (0.0007) [2023-12-28 05:44:27,289][106225] Updated weights for policy 1, policy_version 1461619 (0.0009) [2023-12-28 05:44:27,699][106226] Updated weights for policy 0, policy_version 1458243 (0.0006) [2023-12-28 05:44:27,760][106226] Updated weights for policy 0, policy_version 1458253 (0.0008) [2023-12-28 05:44:27,825][106226] Updated weights for policy 0, policy_version 1458263 (0.0008) [2023-12-28 05:44:27,977][106225] Updated weights for policy 1, policy_version 1461629 (0.0010) [2023-12-28 05:44:28,038][106225] Updated weights for policy 1, policy_version 1461639 (0.0008) [2023-12-28 05:44:28,094][106225] Updated weights for policy 1, policy_version 1461649 (0.0008) [2023-12-28 05:44:28,502][106226] Updated weights for policy 0, policy_version 1458273 (0.0009) [2023-12-28 05:44:28,575][106226] Updated weights for policy 0, policy_version 1458283 (0.0011) [2023-12-28 05:44:28,636][106226] Updated weights for policy 0, policy_version 1458293 (0.0010) [2023-12-28 05:44:28,690][106226] Updated weights for policy 0, policy_version 1458303 (0.0011) [2023-12-28 05:44:28,740][106225] Updated weights for policy 1, policy_version 1461659 (0.0007) [2023-12-28 05:44:28,798][106225] Updated weights for policy 1, policy_version 1461669 (0.0006) [2023-12-28 05:44:28,861][106225] Updated weights for policy 1, policy_version 1461679 (0.0005) [2023-12-28 05:44:29,397][106226] Updated weights for policy 0, policy_version 1458313 (0.0008) [2023-12-28 05:44:29,453][106226] Updated weights for policy 0, policy_version 1458323 (0.0006) [2023-12-28 05:44:29,511][106226] Updated weights for policy 0, policy_version 1458333 (0.0008) [2023-12-28 05:44:29,541][106225] Updated weights for policy 1, policy_version 1461689 (0.0010) [2023-12-28 05:44:29,604][106225] Updated weights for policy 1, policy_version 1461699 (0.0010) [2023-12-28 05:44:29,669][106225] Updated weights for policy 1, policy_version 1461709 (0.0010) [2023-12-28 05:44:29,731][106225] Updated weights for policy 1, policy_version 1461719 (0.0010) [2023-12-28 05:44:30,260][106226] Updated weights for policy 0, policy_version 1458343 (0.0007) [2023-12-28 05:44:30,320][106226] Updated weights for policy 0, policy_version 1458353 (0.0007) [2023-12-28 05:44:30,379][106226] Updated weights for policy 0, policy_version 1458363 (0.0007) [2023-12-28 05:44:30,389][106225] Updated weights for policy 1, policy_version 1461729 (0.0006) [2023-12-28 05:44:30,446][106225] Updated weights for policy 1, policy_version 1461739 (0.0006) [2023-12-28 05:44:30,499][106225] Updated weights for policy 1, policy_version 1461749 (0.0010) [2023-12-28 05:44:31,036][106226] Updated weights for policy 0, policy_version 1458373 (0.0008) [2023-12-28 05:44:31,107][106226] Updated weights for policy 0, policy_version 1458383 (0.0007) [2023-12-28 05:44:31,173][106226] Updated weights for policy 0, policy_version 1458393 (0.0008) [2023-12-28 05:44:31,188][106225] Updated weights for policy 1, policy_version 1461759 (0.0008) [2023-12-28 05:44:31,194][105115] Fps is (10 sec: 19622.4, 60 sec: 19654.3, 300 sec: 19715.0). Total num frames: 747675648. Throughput: 0: 9908.5, 1: 9864.6. Samples: 747671684. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:31,195][105115] Avg episode reward: [(0, '-5.196'), (1, '-4.668')] [2023-12-28 05:44:31,249][106225] Updated weights for policy 1, policy_version 1461769 (0.0006) [2023-12-28 05:44:31,312][106225] Updated weights for policy 1, policy_version 1461779 (0.0006) [2023-12-28 05:44:31,897][106226] Updated weights for policy 0, policy_version 1458403 (0.0007) [2023-12-28 05:44:31,957][106226] Updated weights for policy 0, policy_version 1458413 (0.0007) [2023-12-28 05:44:32,018][106226] Updated weights for policy 0, policy_version 1458423 (0.0006) [2023-12-28 05:44:32,024][106225] Updated weights for policy 1, policy_version 1461789 (0.0008) [2023-12-28 05:44:32,079][106225] Updated weights for policy 1, policy_version 1461799 (0.0010) [2023-12-28 05:44:32,136][106225] Updated weights for policy 1, policy_version 1461809 (0.0010) [2023-12-28 05:44:32,644][106226] Updated weights for policy 0, policy_version 1458433 (0.0006) [2023-12-28 05:44:32,707][106226] Updated weights for policy 0, policy_version 1458443 (0.0009) [2023-12-28 05:44:32,764][106226] Updated weights for policy 0, policy_version 1458453 (0.0007) [2023-12-28 05:44:32,828][106226] Updated weights for policy 0, policy_version 1458463 (0.0008) [2023-12-28 05:44:32,856][106225] Updated weights for policy 1, policy_version 1461819 (0.0009) [2023-12-28 05:44:32,908][106225] Updated weights for policy 1, policy_version 1461829 (0.0007) [2023-12-28 05:44:32,957][106225] Updated weights for policy 1, policy_version 1461839 (0.0008) [2023-12-28 05:44:33,515][106226] Updated weights for policy 0, policy_version 1458473 (0.0009) [2023-12-28 05:44:33,560][106226] Updated weights for policy 0, policy_version 1458483 (0.0008) [2023-12-28 05:44:33,611][106226] Updated weights for policy 0, policy_version 1458493 (0.0008) [2023-12-28 05:44:33,688][106225] Updated weights for policy 1, policy_version 1461849 (0.0008) [2023-12-28 05:44:33,748][106225] Updated weights for policy 1, policy_version 1461859 (0.0008) [2023-12-28 05:44:33,801][106225] Updated weights for policy 1, policy_version 1461869 (0.0008) [2023-12-28 05:44:33,846][106225] Updated weights for policy 1, policy_version 1461879 (0.0008) [2023-12-28 05:44:34,273][106226] Updated weights for policy 0, policy_version 1458503 (0.0007) [2023-12-28 05:44:34,326][106226] Updated weights for policy 0, policy_version 1458513 (0.0011) [2023-12-28 05:44:34,377][106226] Updated weights for policy 0, policy_version 1458523 (0.0010) [2023-12-28 05:44:34,613][106225] Updated weights for policy 1, policy_version 1461889 (0.0008) [2023-12-28 05:44:34,662][106225] Updated weights for policy 1, policy_version 1461899 (0.0007) [2023-12-28 05:44:34,728][106225] Updated weights for policy 1, policy_version 1461909 (0.0007) [2023-12-28 05:44:35,145][106226] Updated weights for policy 0, policy_version 1458533 (0.0008) [2023-12-28 05:44:35,203][106226] Updated weights for policy 0, policy_version 1458543 (0.0009) [2023-12-28 05:44:35,249][106226] Updated weights for policy 0, policy_version 1458553 (0.0008) [2023-12-28 05:44:35,441][106225] Updated weights for policy 1, policy_version 1461919 (0.0008) [2023-12-28 05:44:35,492][106225] Updated weights for policy 1, policy_version 1461929 (0.0008) [2023-12-28 05:44:35,543][106225] Updated weights for policy 1, policy_version 1461939 (0.0008) [2023-12-28 05:44:35,880][106226] Updated weights for policy 0, policy_version 1458563 (0.0006) [2023-12-28 05:44:35,940][106226] Updated weights for policy 0, policy_version 1458573 (0.0005) [2023-12-28 05:44:35,998][106226] Updated weights for policy 0, policy_version 1458583 (0.0005) [2023-12-28 05:44:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 747782144. Throughput: 0: 10016.3, 1: 9791.2. Samples: 747790432. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:36,176][105115] Avg episode reward: [(0, '-4.961'), (1, '-4.750')] [2023-12-28 05:44:36,303][106225] Updated weights for policy 1, policy_version 1461949 (0.0008) [2023-12-28 05:44:36,361][106225] Updated weights for policy 1, policy_version 1461959 (0.0008) [2023-12-28 05:44:36,417][106225] Updated weights for policy 1, policy_version 1461969 (0.0008) [2023-12-28 05:44:36,587][106226] Updated weights for policy 0, policy_version 1458593 (0.0005) [2023-12-28 05:44:36,651][106226] Updated weights for policy 0, policy_version 1458603 (0.0008) [2023-12-28 05:44:36,712][106226] Updated weights for policy 0, policy_version 1458613 (0.0009) [2023-12-28 05:44:36,776][106226] Updated weights for policy 0, policy_version 1458623 (0.0009) [2023-12-28 05:44:37,198][106225] Updated weights for policy 1, policy_version 1461979 (0.0008) [2023-12-28 05:44:37,264][106225] Updated weights for policy 1, policy_version 1461989 (0.0007) [2023-12-28 05:44:37,323][106225] Updated weights for policy 1, policy_version 1461999 (0.0008) [2023-12-28 05:44:37,514][106226] Updated weights for policy 0, policy_version 1458633 (0.0010) [2023-12-28 05:44:37,572][106226] Updated weights for policy 0, policy_version 1458643 (0.0011) [2023-12-28 05:44:37,630][106226] Updated weights for policy 0, policy_version 1458653 (0.0008) [2023-12-28 05:44:38,039][106225] Updated weights for policy 1, policy_version 1462009 (0.0008) [2023-12-28 05:44:38,089][106225] Updated weights for policy 1, policy_version 1462019 (0.0007) [2023-12-28 05:44:38,134][106225] Updated weights for policy 1, policy_version 1462029 (0.0007) [2023-12-28 05:44:38,181][106225] Updated weights for policy 1, policy_version 1462039 (0.0007) [2023-12-28 05:44:38,355][106226] Updated weights for policy 0, policy_version 1458663 (0.0008) [2023-12-28 05:44:38,410][106226] Updated weights for policy 0, policy_version 1458673 (0.0011) [2023-12-28 05:44:38,459][106226] Updated weights for policy 0, policy_version 1458683 (0.0010) [2023-12-28 05:44:38,963][106225] Updated weights for policy 1, policy_version 1462049 (0.0006) [2023-12-28 05:44:39,020][106225] Updated weights for policy 1, policy_version 1462059 (0.0008) [2023-12-28 05:44:39,089][106225] Updated weights for policy 1, policy_version 1462069 (0.0009) [2023-12-28 05:44:39,177][106226] Updated weights for policy 0, policy_version 1458693 (0.0008) [2023-12-28 05:44:39,248][106226] Updated weights for policy 0, policy_version 1458703 (0.0008) [2023-12-28 05:44:39,307][106226] Updated weights for policy 0, policy_version 1458713 (0.0008) [2023-12-28 05:44:39,799][106225] Updated weights for policy 1, policy_version 1462079 (0.0008) [2023-12-28 05:44:39,866][106225] Updated weights for policy 1, policy_version 1462089 (0.0008) [2023-12-28 05:44:39,935][106225] Updated weights for policy 1, policy_version 1462099 (0.0010) [2023-12-28 05:44:40,047][106226] Updated weights for policy 0, policy_version 1458723 (0.0008) [2023-12-28 05:44:40,104][106226] Updated weights for policy 0, policy_version 1458733 (0.0008) [2023-12-28 05:44:40,167][106226] Updated weights for policy 0, policy_version 1458743 (0.0008) [2023-12-28 05:44:40,595][106225] Updated weights for policy 1, policy_version 1462109 (0.0009) [2023-12-28 05:44:40,650][106225] Updated weights for policy 1, policy_version 1462119 (0.0011) [2023-12-28 05:44:40,712][106225] Updated weights for policy 1, policy_version 1462129 (0.0011) [2023-12-28 05:44:40,931][106226] Updated weights for policy 0, policy_version 1458753 (0.0008) [2023-12-28 05:44:40,995][106226] Updated weights for policy 0, policy_version 1458763 (0.0008) [2023-12-28 05:44:41,057][106226] Updated weights for policy 0, policy_version 1458773 (0.0009) [2023-12-28 05:44:41,124][106226] Updated weights for policy 0, policy_version 1458783 (0.0009) [2023-12-28 05:44:41,175][105115] Fps is (10 sec: 20520.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 747880448. Throughput: 0: 9985.0, 1: 9792.4. Samples: 747848240. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:41,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.828')] [2023-12-28 05:44:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001462136_374358016.pth... [2023-12-28 05:44:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001458784_373522432.pth... [2023-12-28 05:44:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001457600_373219328.pth [2023-12-28 05:44:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001460984_374063104.pth [2023-12-28 05:44:41,410][106225] Updated weights for policy 1, policy_version 1462139 (0.0010) [2023-12-28 05:44:41,470][106225] Updated weights for policy 1, policy_version 1462149 (0.0008) [2023-12-28 05:44:41,529][106225] Updated weights for policy 1, policy_version 1462159 (0.0008) [2023-12-28 05:44:41,924][106226] Updated weights for policy 0, policy_version 1458793 (0.0009) [2023-12-28 05:44:41,980][106226] Updated weights for policy 0, policy_version 1458803 (0.0009) [2023-12-28 05:44:42,041][106226] Updated weights for policy 0, policy_version 1458813 (0.0008) [2023-12-28 05:44:42,259][106225] Updated weights for policy 1, policy_version 1462169 (0.0008) [2023-12-28 05:44:42,326][106225] Updated weights for policy 1, policy_version 1462179 (0.0008) [2023-12-28 05:44:42,403][106225] Updated weights for policy 1, policy_version 1462189 (0.0008) [2023-12-28 05:44:42,457][106225] Updated weights for policy 1, policy_version 1462199 (0.0009) [2023-12-28 05:44:42,811][106226] Updated weights for policy 0, policy_version 1458823 (0.0009) [2023-12-28 05:44:42,870][106226] Updated weights for policy 0, policy_version 1458833 (0.0010) [2023-12-28 05:44:42,936][106226] Updated weights for policy 0, policy_version 1458843 (0.0008) [2023-12-28 05:44:43,230][106225] Updated weights for policy 1, policy_version 1462209 (0.0008) [2023-12-28 05:44:43,302][106225] Updated weights for policy 1, policy_version 1462219 (0.0005) [2023-12-28 05:44:43,355][106225] Updated weights for policy 1, policy_version 1462229 (0.0005) [2023-12-28 05:44:43,595][106226] Updated weights for policy 0, policy_version 1458853 (0.0007) [2023-12-28 05:44:43,651][106226] Updated weights for policy 0, policy_version 1458863 (0.0009) [2023-12-28 05:44:43,706][106226] Updated weights for policy 0, policy_version 1458873 (0.0008) [2023-12-28 05:44:43,932][106225] Updated weights for policy 1, policy_version 1462239 (0.0007) [2023-12-28 05:44:43,999][106225] Updated weights for policy 1, policy_version 1462249 (0.0008) [2023-12-28 05:44:44,060][106225] Updated weights for policy 1, policy_version 1462259 (0.0008) [2023-12-28 05:44:44,360][106226] Updated weights for policy 0, policy_version 1458883 (0.0008) [2023-12-28 05:44:44,408][106226] Updated weights for policy 0, policy_version 1458893 (0.0005) [2023-12-28 05:44:44,456][106226] Updated weights for policy 0, policy_version 1458903 (0.0008) [2023-12-28 05:44:44,857][106225] Updated weights for policy 1, policy_version 1462269 (0.0008) [2023-12-28 05:44:44,918][106225] Updated weights for policy 1, policy_version 1462279 (0.0008) [2023-12-28 05:44:44,982][106225] Updated weights for policy 1, policy_version 1462289 (0.0009) [2023-12-28 05:44:45,063][106226] Updated weights for policy 0, policy_version 1458913 (0.0006) [2023-12-28 05:44:45,133][106226] Updated weights for policy 0, policy_version 1458923 (0.0011) [2023-12-28 05:44:45,195][106226] Updated weights for policy 0, policy_version 1458933 (0.0011) [2023-12-28 05:44:45,261][106226] Updated weights for policy 0, policy_version 1458943 (0.0011) [2023-12-28 05:44:45,711][106225] Updated weights for policy 1, policy_version 1462299 (0.0009) [2023-12-28 05:44:45,774][106225] Updated weights for policy 1, policy_version 1462309 (0.0010) [2023-12-28 05:44:45,835][106225] Updated weights for policy 1, policy_version 1462319 (0.0010) [2023-12-28 05:44:45,866][106226] Updated weights for policy 0, policy_version 1458953 (0.0008) [2023-12-28 05:44:45,929][106226] Updated weights for policy 0, policy_version 1458963 (0.0009) [2023-12-28 05:44:45,979][106226] Updated weights for policy 0, policy_version 1458973 (0.0010) [2023-12-28 05:44:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.2, 300 sec: 19744.1). Total num frames: 747978752. Throughput: 0: 9953.3, 1: 9788.9. Samples: 747964988. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:46,176][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.808')] [2023-12-28 05:44:46,432][106225] Updated weights for policy 1, policy_version 1462329 (0.0009) [2023-12-28 05:44:46,491][106225] Updated weights for policy 1, policy_version 1462339 (0.0005) [2023-12-28 05:44:46,547][106225] Updated weights for policy 1, policy_version 1462349 (0.0006) [2023-12-28 05:44:46,616][106226] Updated weights for policy 0, policy_version 1458983 (0.0010) [2023-12-28 05:44:46,622][106225] Updated weights for policy 1, policy_version 1462359 (0.0006) [2023-12-28 05:44:46,663][106226] Updated weights for policy 0, policy_version 1458993 (0.0010) [2023-12-28 05:44:46,709][106226] Updated weights for policy 0, policy_version 1459003 (0.0010) [2023-12-28 05:44:47,215][106225] Updated weights for policy 1, policy_version 1462369 (0.0010) [2023-12-28 05:44:47,273][106225] Updated weights for policy 1, policy_version 1462379 (0.0010) [2023-12-28 05:44:47,319][106226] Updated weights for policy 0, policy_version 1459013 (0.0008) [2023-12-28 05:44:47,330][106225] Updated weights for policy 1, policy_version 1462389 (0.0010) [2023-12-28 05:44:47,374][106226] Updated weights for policy 0, policy_version 1459023 (0.0007) [2023-12-28 05:44:47,429][106226] Updated weights for policy 0, policy_version 1459033 (0.0009) [2023-12-28 05:44:48,051][106226] Updated weights for policy 0, policy_version 1459043 (0.0009) [2023-12-28 05:44:48,051][106225] Updated weights for policy 1, policy_version 1462399 (0.0010) [2023-12-28 05:44:48,108][106225] Updated weights for policy 1, policy_version 1462409 (0.0010) [2023-12-28 05:44:48,113][106226] Updated weights for policy 0, policy_version 1459053 (0.0006) [2023-12-28 05:44:48,161][106225] Updated weights for policy 1, policy_version 1462419 (0.0010) [2023-12-28 05:44:48,169][106226] Updated weights for policy 0, policy_version 1459063 (0.0006) [2023-12-28 05:44:48,825][106226] Updated weights for policy 0, policy_version 1459073 (0.0006) [2023-12-28 05:44:48,882][106226] Updated weights for policy 0, policy_version 1459083 (0.0007) [2023-12-28 05:44:48,887][106225] Updated weights for policy 1, policy_version 1462429 (0.0009) [2023-12-28 05:44:48,935][106226] Updated weights for policy 0, policy_version 1459093 (0.0005) [2023-12-28 05:44:48,948][106225] Updated weights for policy 1, policy_version 1462439 (0.0008) [2023-12-28 05:44:48,987][106226] Updated weights for policy 0, policy_version 1459103 (0.0006) [2023-12-28 05:44:49,003][106225] Updated weights for policy 1, policy_version 1462449 (0.0007) [2023-12-28 05:44:49,688][106226] Updated weights for policy 0, policy_version 1459113 (0.0008) [2023-12-28 05:44:49,724][106225] Updated weights for policy 1, policy_version 1462459 (0.0007) [2023-12-28 05:44:49,754][106226] Updated weights for policy 0, policy_version 1459123 (0.0008) [2023-12-28 05:44:49,779][106225] Updated weights for policy 1, policy_version 1462469 (0.0010) [2023-12-28 05:44:49,816][106226] Updated weights for policy 0, policy_version 1459133 (0.0006) [2023-12-28 05:44:49,846][106225] Updated weights for policy 1, policy_version 1462479 (0.0010) [2023-12-28 05:44:50,536][106226] Updated weights for policy 0, policy_version 1459143 (0.0008) [2023-12-28 05:44:50,584][106225] Updated weights for policy 1, policy_version 1462489 (0.0008) [2023-12-28 05:44:50,599][106226] Updated weights for policy 0, policy_version 1459153 (0.0008) [2023-12-28 05:44:50,650][106225] Updated weights for policy 1, policy_version 1462499 (0.0011) [2023-12-28 05:44:50,656][106226] Updated weights for policy 0, policy_version 1459163 (0.0006) [2023-12-28 05:44:50,702][106225] Updated weights for policy 1, policy_version 1462509 (0.0010) [2023-12-28 05:44:50,760][106225] Updated weights for policy 1, policy_version 1462519 (0.0011) [2023-12-28 05:44:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 748077056. Throughput: 0: 10019.5, 1: 9761.3. Samples: 748086776. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:51,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.874')] [2023-12-28 05:44:51,453][106226] Updated weights for policy 0, policy_version 1459173 (0.0006) [2023-12-28 05:44:51,513][106226] Updated weights for policy 0, policy_version 1459183 (0.0007) [2023-12-28 05:44:51,540][106225] Updated weights for policy 1, policy_version 1462529 (0.0009) [2023-12-28 05:44:51,571][106226] Updated weights for policy 0, policy_version 1459193 (0.0006) [2023-12-28 05:44:51,601][106225] Updated weights for policy 1, policy_version 1462539 (0.0007) [2023-12-28 05:44:51,666][106225] Updated weights for policy 1, policy_version 1462549 (0.0009) [2023-12-28 05:44:52,318][106226] Updated weights for policy 0, policy_version 1459203 (0.0008) [2023-12-28 05:44:52,389][106225] Updated weights for policy 1, policy_version 1462559 (0.0008) [2023-12-28 05:44:52,393][106226] Updated weights for policy 0, policy_version 1459213 (0.0008) [2023-12-28 05:44:52,448][106225] Updated weights for policy 1, policy_version 1462569 (0.0007) [2023-12-28 05:44:52,450][106226] Updated weights for policy 0, policy_version 1459223 (0.0006) [2023-12-28 05:44:52,503][106225] Updated weights for policy 1, policy_version 1462579 (0.0007) [2023-12-28 05:44:53,143][106226] Updated weights for policy 0, policy_version 1459233 (0.0007) [2023-12-28 05:44:53,204][106226] Updated weights for policy 0, policy_version 1459243 (0.0008) [2023-12-28 05:44:53,251][106225] Updated weights for policy 1, policy_version 1462589 (0.0008) [2023-12-28 05:44:53,268][106226] Updated weights for policy 0, policy_version 1459253 (0.0006) [2023-12-28 05:44:53,302][106225] Updated weights for policy 1, policy_version 1462599 (0.0007) [2023-12-28 05:44:53,327][106226] Updated weights for policy 0, policy_version 1459263 (0.0006) [2023-12-28 05:44:53,355][106225] Updated weights for policy 1, policy_version 1462609 (0.0010) [2023-12-28 05:44:53,932][106226] Updated weights for policy 0, policy_version 1459273 (0.0006) [2023-12-28 05:44:54,011][106226] Updated weights for policy 0, policy_version 1459283 (0.0006) [2023-12-28 05:44:54,041][106225] Updated weights for policy 1, policy_version 1462619 (0.0010) [2023-12-28 05:44:54,067][106226] Updated weights for policy 0, policy_version 1459293 (0.0006) [2023-12-28 05:44:54,086][106225] Updated weights for policy 1, policy_version 1462629 (0.0008) [2023-12-28 05:44:54,133][106225] Updated weights for policy 1, policy_version 1462639 (0.0005) [2023-12-28 05:44:54,684][106225] Updated weights for policy 1, policy_version 1462649 (0.0006) [2023-12-28 05:44:54,737][106226] Updated weights for policy 0, policy_version 1459303 (0.0007) [2023-12-28 05:44:54,745][106225] Updated weights for policy 1, policy_version 1462659 (0.0009) [2023-12-28 05:44:54,793][106226] Updated weights for policy 0, policy_version 1459313 (0.0006) [2023-12-28 05:44:54,806][106225] Updated weights for policy 1, policy_version 1462669 (0.0010) [2023-12-28 05:44:54,850][106226] Updated weights for policy 0, policy_version 1459323 (0.0006) [2023-12-28 05:44:54,870][106225] Updated weights for policy 1, policy_version 1462679 (0.0010) [2023-12-28 05:44:55,505][106226] Updated weights for policy 0, policy_version 1459333 (0.0006) [2023-12-28 05:44:55,567][106226] Updated weights for policy 0, policy_version 1459343 (0.0006) [2023-12-28 05:44:55,576][106225] Updated weights for policy 1, policy_version 1462689 (0.0010) [2023-12-28 05:44:55,622][106226] Updated weights for policy 0, policy_version 1459353 (0.0009) [2023-12-28 05:44:55,643][106225] Updated weights for policy 1, policy_version 1462699 (0.0010) [2023-12-28 05:44:55,699][106225] Updated weights for policy 1, policy_version 1462709 (0.0010) [2023-12-28 05:44:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 748175360. Throughput: 0: 10050.5, 1: 9753.9. Samples: 748144924. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:44:56,176][105115] Avg episode reward: [(0, '-4.810'), (1, '-4.793')] [2023-12-28 05:44:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001462712_374505472.pth... [2023-12-28 05:44:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001459360_373669888.pth... [2023-12-28 05:44:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001458208_373374976.pth [2023-12-28 05:44:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001461560_374210560.pth [2023-12-28 05:44:56,299][106226] Updated weights for policy 0, policy_version 1459363 (0.0008) [2023-12-28 05:44:56,356][106226] Updated weights for policy 0, policy_version 1459373 (0.0009) [2023-12-28 05:44:56,411][106225] Updated weights for policy 1, policy_version 1462719 (0.0006) [2023-12-28 05:44:56,424][106226] Updated weights for policy 0, policy_version 1459383 (0.0008) [2023-12-28 05:44:56,469][106225] Updated weights for policy 1, policy_version 1462729 (0.0005) [2023-12-28 05:44:56,533][106225] Updated weights for policy 1, policy_version 1462739 (0.0005) [2023-12-28 05:44:57,072][106226] Updated weights for policy 0, policy_version 1459393 (0.0009) [2023-12-28 05:44:57,135][106226] Updated weights for policy 0, policy_version 1459403 (0.0006) [2023-12-28 05:44:57,184][106225] Updated weights for policy 1, policy_version 1462749 (0.0008) [2023-12-28 05:44:57,198][106226] Updated weights for policy 0, policy_version 1459413 (0.0009) [2023-12-28 05:44:57,237][106225] Updated weights for policy 1, policy_version 1462759 (0.0007) [2023-12-28 05:44:57,261][106226] Updated weights for policy 0, policy_version 1459423 (0.0010) [2023-12-28 05:44:57,283][106225] Updated weights for policy 1, policy_version 1462769 (0.0009) [2023-12-28 05:44:57,895][106226] Updated weights for policy 0, policy_version 1459433 (0.0006) [2023-12-28 05:44:57,948][106225] Updated weights for policy 1, policy_version 1462779 (0.0008) [2023-12-28 05:44:57,953][106226] Updated weights for policy 0, policy_version 1459443 (0.0005) [2023-12-28 05:44:57,997][106225] Updated weights for policy 1, policy_version 1462789 (0.0006) [2023-12-28 05:44:58,002][106226] Updated weights for policy 0, policy_version 1459453 (0.0010) [2023-12-28 05:44:58,051][106225] Updated weights for policy 1, policy_version 1462799 (0.0007) [2023-12-28 05:44:58,662][106226] Updated weights for policy 0, policy_version 1459463 (0.0008) [2023-12-28 05:44:58,727][106226] Updated weights for policy 0, policy_version 1459473 (0.0007) [2023-12-28 05:44:58,804][106226] Updated weights for policy 0, policy_version 1459483 (0.0007) [2023-12-28 05:44:58,972][106225] Updated weights for policy 1, policy_version 1462809 (0.0009) [2023-12-28 05:44:59,037][106225] Updated weights for policy 1, policy_version 1462819 (0.0008) [2023-12-28 05:44:59,102][106225] Updated weights for policy 1, policy_version 1462829 (0.0008) [2023-12-28 05:44:59,170][106225] Updated weights for policy 1, policy_version 1462839 (0.0008) [2023-12-28 05:44:59,527][106226] Updated weights for policy 0, policy_version 1459493 (0.0009) [2023-12-28 05:44:59,597][106226] Updated weights for policy 0, policy_version 1459503 (0.0010) [2023-12-28 05:44:59,671][106226] Updated weights for policy 0, policy_version 1459513 (0.0010) [2023-12-28 05:44:59,801][106225] Updated weights for policy 1, policy_version 1462849 (0.0007) [2023-12-28 05:44:59,862][106225] Updated weights for policy 1, policy_version 1462859 (0.0010) [2023-12-28 05:44:59,930][106225] Updated weights for policy 1, policy_version 1462869 (0.0009) [2023-12-28 05:45:00,381][106226] Updated weights for policy 0, policy_version 1459523 (0.0010) [2023-12-28 05:45:00,446][106226] Updated weights for policy 0, policy_version 1459533 (0.0009) [2023-12-28 05:45:00,512][106226] Updated weights for policy 0, policy_version 1459543 (0.0007) [2023-12-28 05:45:00,618][106225] Updated weights for policy 1, policy_version 1462879 (0.0010) [2023-12-28 05:45:00,682][106225] Updated weights for policy 1, policy_version 1462889 (0.0008) [2023-12-28 05:45:00,742][106225] Updated weights for policy 1, policy_version 1462899 (0.0007) [2023-12-28 05:45:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 748273664. Throughput: 0: 10078.1, 1: 9824.2. Samples: 748266000. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:01,175][105115] Avg episode reward: [(0, '-4.961'), (1, '-4.713')] [2023-12-28 05:45:01,273][106226] Updated weights for policy 0, policy_version 1459553 (0.0007) [2023-12-28 05:45:01,328][106226] Updated weights for policy 0, policy_version 1459563 (0.0008) [2023-12-28 05:45:01,389][106225] Updated weights for policy 1, policy_version 1462909 (0.0009) [2023-12-28 05:45:01,395][106226] Updated weights for policy 0, policy_version 1459573 (0.0007) [2023-12-28 05:45:01,447][106225] Updated weights for policy 1, policy_version 1462919 (0.0010) [2023-12-28 05:45:01,453][106226] Updated weights for policy 0, policy_version 1459583 (0.0005) [2023-12-28 05:45:01,503][106225] Updated weights for policy 1, policy_version 1462929 (0.0010) [2023-12-28 05:45:02,200][106225] Updated weights for policy 1, policy_version 1462939 (0.0009) [2023-12-28 05:45:02,235][106226] Updated weights for policy 0, policy_version 1459593 (0.0007) [2023-12-28 05:45:02,253][106225] Updated weights for policy 1, policy_version 1462949 (0.0006) [2023-12-28 05:45:02,295][106226] Updated weights for policy 0, policy_version 1459603 (0.0008) [2023-12-28 05:45:02,313][106225] Updated weights for policy 1, policy_version 1462959 (0.0010) [2023-12-28 05:45:02,356][106226] Updated weights for policy 0, policy_version 1459613 (0.0007) [2023-12-28 05:45:02,998][106226] Updated weights for policy 0, policy_version 1459623 (0.0007) [2023-12-28 05:45:03,046][106226] Updated weights for policy 0, policy_version 1459633 (0.0007) [2023-12-28 05:45:03,050][106225] Updated weights for policy 1, policy_version 1462969 (0.0010) [2023-12-28 05:45:03,098][106226] Updated weights for policy 0, policy_version 1459643 (0.0007) [2023-12-28 05:45:03,104][106225] Updated weights for policy 1, policy_version 1462979 (0.0006) [2023-12-28 05:45:03,149][106225] Updated weights for policy 1, policy_version 1462989 (0.0006) [2023-12-28 05:45:03,202][106225] Updated weights for policy 1, policy_version 1462999 (0.0007) [2023-12-28 05:45:03,764][106226] Updated weights for policy 0, policy_version 1459653 (0.0006) [2023-12-28 05:45:03,811][106226] Updated weights for policy 0, policy_version 1459663 (0.0005) [2023-12-28 05:45:03,878][106226] Updated weights for policy 0, policy_version 1459673 (0.0008) [2023-12-28 05:45:03,972][106225] Updated weights for policy 1, policy_version 1463009 (0.0007) [2023-12-28 05:45:04,037][106225] Updated weights for policy 1, policy_version 1463019 (0.0007) [2023-12-28 05:45:04,098][106225] Updated weights for policy 1, policy_version 1463029 (0.0008) [2023-12-28 05:45:04,578][106226] Updated weights for policy 0, policy_version 1459683 (0.0009) [2023-12-28 05:45:04,648][106226] Updated weights for policy 0, policy_version 1459693 (0.0008) [2023-12-28 05:45:04,707][106226] Updated weights for policy 0, policy_version 1459703 (0.0005) [2023-12-28 05:45:04,842][106225] Updated weights for policy 1, policy_version 1463039 (0.0008) [2023-12-28 05:45:04,891][106225] Updated weights for policy 1, policy_version 1463049 (0.0008) [2023-12-28 05:45:04,941][106225] Updated weights for policy 1, policy_version 1463059 (0.0008) [2023-12-28 05:45:05,295][106226] Updated weights for policy 0, policy_version 1459713 (0.0005) [2023-12-28 05:45:05,355][106226] Updated weights for policy 0, policy_version 1459723 (0.0005) [2023-12-28 05:45:05,409][106226] Updated weights for policy 0, policy_version 1459733 (0.0005) [2023-12-28 05:45:05,459][106226] Updated weights for policy 0, policy_version 1459743 (0.0005) [2023-12-28 05:45:05,774][106225] Updated weights for policy 1, policy_version 1463069 (0.0008) [2023-12-28 05:45:05,845][106225] Updated weights for policy 1, policy_version 1463079 (0.0010) [2023-12-28 05:45:05,907][106225] Updated weights for policy 1, policy_version 1463089 (0.0009) [2023-12-28 05:45:05,976][106226] Updated weights for policy 0, policy_version 1459753 (0.0006) [2023-12-28 05:45:06,036][106226] Updated weights for policy 0, policy_version 1459763 (0.0005) [2023-12-28 05:45:06,115][106226] Updated weights for policy 0, policy_version 1459774 (0.0006) [2023-12-28 05:45:06,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 748380160. Throughput: 0: 10095.6, 1: 9806.7. Samples: 748385248. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:06,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-4.815')] [2023-12-28 05:45:06,592][106225] Updated weights for policy 1, policy_version 1463099 (0.0009) [2023-12-28 05:45:06,654][106225] Updated weights for policy 1, policy_version 1463109 (0.0010) [2023-12-28 05:45:06,716][106225] Updated weights for policy 1, policy_version 1463119 (0.0010) [2023-12-28 05:45:06,795][106226] Updated weights for policy 0, policy_version 1459784 (0.0006) [2023-12-28 05:45:06,843][106226] Updated weights for policy 0, policy_version 1459794 (0.0005) [2023-12-28 05:45:06,892][106226] Updated weights for policy 0, policy_version 1459804 (0.0005) [2023-12-28 05:45:07,350][106225] Updated weights for policy 1, policy_version 1463129 (0.0010) [2023-12-28 05:45:07,399][106225] Updated weights for policy 1, policy_version 1463139 (0.0010) [2023-12-28 05:45:07,453][106225] Updated weights for policy 1, policy_version 1463149 (0.0010) [2023-12-28 05:45:07,515][106225] Updated weights for policy 1, policy_version 1463159 (0.0010) [2023-12-28 05:45:07,575][106226] Updated weights for policy 0, policy_version 1459814 (0.0006) [2023-12-28 05:45:07,638][106226] Updated weights for policy 0, policy_version 1459824 (0.0005) [2023-12-28 05:45:07,693][106226] Updated weights for policy 0, policy_version 1459834 (0.0005) [2023-12-28 05:45:08,183][106225] Updated weights for policy 1, policy_version 1463169 (0.0009) [2023-12-28 05:45:08,237][106225] Updated weights for policy 1, policy_version 1463179 (0.0010) [2023-12-28 05:45:08,287][106225] Updated weights for policy 1, policy_version 1463189 (0.0010) [2023-12-28 05:45:08,305][106226] Updated weights for policy 0, policy_version 1459844 (0.0006) [2023-12-28 05:45:08,385][106226] Updated weights for policy 0, policy_version 1459857 (0.0007) [2023-12-28 05:45:08,453][106226] Updated weights for policy 0, policy_version 1459867 (0.0005) [2023-12-28 05:45:08,981][106225] Updated weights for policy 1, policy_version 1463199 (0.0010) [2023-12-28 05:45:09,037][106225] Updated weights for policy 1, policy_version 1463209 (0.0010) [2023-12-28 05:45:09,096][106225] Updated weights for policy 1, policy_version 1463219 (0.0009) [2023-12-28 05:45:09,179][106226] Updated weights for policy 0, policy_version 1459877 (0.0010) [2023-12-28 05:45:09,244][106226] Updated weights for policy 0, policy_version 1459887 (0.0008) [2023-12-28 05:45:09,310][106226] Updated weights for policy 0, policy_version 1459897 (0.0008) [2023-12-28 05:45:09,894][106225] Updated weights for policy 1, policy_version 1463229 (0.0008) [2023-12-28 05:45:09,959][106225] Updated weights for policy 1, policy_version 1463239 (0.0012) [2023-12-28 05:45:09,984][106226] Updated weights for policy 0, policy_version 1459907 (0.0009) [2023-12-28 05:45:10,022][106225] Updated weights for policy 1, policy_version 1463249 (0.0010) [2023-12-28 05:45:10,048][106226] Updated weights for policy 0, policy_version 1459917 (0.0006) [2023-12-28 05:45:10,113][106226] Updated weights for policy 0, policy_version 1459927 (0.0007) [2023-12-28 05:45:10,756][106226] Updated weights for policy 0, policy_version 1459937 (0.0008) [2023-12-28 05:45:10,771][106225] Updated weights for policy 1, policy_version 1463259 (0.0009) [2023-12-28 05:45:10,813][106226] Updated weights for policy 0, policy_version 1459947 (0.0007) [2023-12-28 05:45:10,830][106225] Updated weights for policy 1, policy_version 1463269 (0.0009) [2023-12-28 05:45:10,872][106226] Updated weights for policy 0, policy_version 1459957 (0.0007) [2023-12-28 05:45:10,889][106225] Updated weights for policy 1, policy_version 1463279 (0.0010) [2023-12-28 05:45:10,934][106226] Updated weights for policy 0, policy_version 1459967 (0.0007) [2023-12-28 05:45:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 748478464. Throughput: 0: 10094.4, 1: 9874.1. Samples: 748446312. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:11,175][105115] Avg episode reward: [(0, '-5.206'), (1, '-4.823')] [2023-12-28 05:45:11,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001459968_373825536.pth... [2023-12-28 05:45:11,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001463288_374652928.pth... [2023-12-28 05:45:11,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001462136_374358016.pth [2023-12-28 05:45:11,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001458784_373522432.pth [2023-12-28 05:45:11,678][106225] Updated weights for policy 1, policy_version 1463289 (0.0008) [2023-12-28 05:45:11,690][106226] Updated weights for policy 0, policy_version 1459977 (0.0008) [2023-12-28 05:45:11,745][106225] Updated weights for policy 1, policy_version 1463299 (0.0009) [2023-12-28 05:45:11,755][106226] Updated weights for policy 0, policy_version 1459987 (0.0007) [2023-12-28 05:45:11,802][106225] Updated weights for policy 1, policy_version 1463309 (0.0010) [2023-12-28 05:45:11,821][106226] Updated weights for policy 0, policy_version 1459997 (0.0009) [2023-12-28 05:45:11,864][106225] Updated weights for policy 1, policy_version 1463319 (0.0009) [2023-12-28 05:45:12,657][106226] Updated weights for policy 0, policy_version 1460007 (0.0009) [2023-12-28 05:45:12,714][106225] Updated weights for policy 1, policy_version 1463329 (0.0008) [2023-12-28 05:45:12,729][106226] Updated weights for policy 0, policy_version 1460017 (0.0008) [2023-12-28 05:45:12,782][106225] Updated weights for policy 1, policy_version 1463339 (0.0007) [2023-12-28 05:45:12,796][106226] Updated weights for policy 0, policy_version 1460027 (0.0008) [2023-12-28 05:45:12,849][106225] Updated weights for policy 1, policy_version 1463349 (0.0007) [2023-12-28 05:45:13,513][106226] Updated weights for policy 0, policy_version 1460037 (0.0007) [2023-12-28 05:45:13,571][106226] Updated weights for policy 0, policy_version 1460047 (0.0006) [2023-12-28 05:45:13,593][106225] Updated weights for policy 1, policy_version 1463359 (0.0008) [2023-12-28 05:45:13,633][106226] Updated weights for policy 0, policy_version 1460057 (0.0009) [2023-12-28 05:45:13,655][106225] Updated weights for policy 1, policy_version 1463369 (0.0007) [2023-12-28 05:45:13,716][106225] Updated weights for policy 1, policy_version 1463379 (0.0008) [2023-12-28 05:45:14,300][106226] Updated weights for policy 0, policy_version 1460067 (0.0006) [2023-12-28 05:45:14,361][106226] Updated weights for policy 0, policy_version 1460077 (0.0009) [2023-12-28 05:45:14,416][106226] Updated weights for policy 0, policy_version 1460087 (0.0009) [2023-12-28 05:45:14,467][106225] Updated weights for policy 1, policy_version 1463389 (0.0008) [2023-12-28 05:45:14,530][106225] Updated weights for policy 1, policy_version 1463399 (0.0008) [2023-12-28 05:45:14,589][106225] Updated weights for policy 1, policy_version 1463409 (0.0008) [2023-12-28 05:45:15,166][106226] Updated weights for policy 0, policy_version 1460097 (0.0007) [2023-12-28 05:45:15,226][106226] Updated weights for policy 0, policy_version 1460107 (0.0006) [2023-12-28 05:45:15,286][106226] Updated weights for policy 0, policy_version 1460117 (0.0009) [2023-12-28 05:45:15,349][106226] Updated weights for policy 0, policy_version 1460127 (0.0010) [2023-12-28 05:45:15,416][106225] Updated weights for policy 1, policy_version 1463419 (0.0008) [2023-12-28 05:45:15,472][106225] Updated weights for policy 1, policy_version 1463429 (0.0008) [2023-12-28 05:45:15,531][106225] Updated weights for policy 1, policy_version 1463439 (0.0007) [2023-12-28 05:45:16,028][106226] Updated weights for policy 0, policy_version 1460137 (0.0010) [2023-12-28 05:45:16,086][106226] Updated weights for policy 0, policy_version 1460147 (0.0011) [2023-12-28 05:45:16,144][106226] Updated weights for policy 0, policy_version 1460157 (0.0011) [2023-12-28 05:45:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 748568576. Throughput: 0: 10008.9, 1: 9670.9. Samples: 748556888. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:16,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-5.009')] [2023-12-28 05:45:16,258][106225] Updated weights for policy 1, policy_version 1463449 (0.0007) [2023-12-28 05:45:16,321][106225] Updated weights for policy 1, policy_version 1463459 (0.0005) [2023-12-28 05:45:16,376][106225] Updated weights for policy 1, policy_version 1463469 (0.0009) [2023-12-28 05:45:16,431][106225] Updated weights for policy 1, policy_version 1463479 (0.0008) [2023-12-28 05:45:16,837][106226] Updated weights for policy 0, policy_version 1460167 (0.0011) [2023-12-28 05:45:16,909][106226] Updated weights for policy 0, policy_version 1460177 (0.0010) [2023-12-28 05:45:16,972][106226] Updated weights for policy 0, policy_version 1460187 (0.0010) [2023-12-28 05:45:17,121][106225] Updated weights for policy 1, policy_version 1463489 (0.0007) [2023-12-28 05:45:17,193][106225] Updated weights for policy 1, policy_version 1463499 (0.0006) [2023-12-28 05:45:17,257][106225] Updated weights for policy 1, policy_version 1463509 (0.0005) [2023-12-28 05:45:17,648][106226] Updated weights for policy 0, policy_version 1460197 (0.0011) [2023-12-28 05:45:17,698][106226] Updated weights for policy 0, policy_version 1460207 (0.0010) [2023-12-28 05:45:17,753][106226] Updated weights for policy 0, policy_version 1460217 (0.0011) [2023-12-28 05:45:17,886][106225] Updated weights for policy 1, policy_version 1463519 (0.0007) [2023-12-28 05:45:17,937][106225] Updated weights for policy 1, policy_version 1463529 (0.0008) [2023-12-28 05:45:17,985][106225] Updated weights for policy 1, policy_version 1463539 (0.0008) [2023-12-28 05:45:18,488][106226] Updated weights for policy 0, policy_version 1460227 (0.0009) [2023-12-28 05:45:18,541][106226] Updated weights for policy 0, policy_version 1460237 (0.0009) [2023-12-28 05:45:18,605][106226] Updated weights for policy 0, policy_version 1460247 (0.0009) [2023-12-28 05:45:18,743][106225] Updated weights for policy 1, policy_version 1463549 (0.0008) [2023-12-28 05:45:18,802][106225] Updated weights for policy 1, policy_version 1463559 (0.0008) [2023-12-28 05:45:18,863][106225] Updated weights for policy 1, policy_version 1463569 (0.0009) [2023-12-28 05:45:19,362][106226] Updated weights for policy 0, policy_version 1460257 (0.0007) [2023-12-28 05:45:19,432][106226] Updated weights for policy 0, policy_version 1460267 (0.0008) [2023-12-28 05:45:19,505][106226] Updated weights for policy 0, policy_version 1460277 (0.0008) [2023-12-28 05:45:19,563][106226] Updated weights for policy 0, policy_version 1460287 (0.0008) [2023-12-28 05:45:19,642][106225] Updated weights for policy 1, policy_version 1463579 (0.0009) [2023-12-28 05:45:19,699][106225] Updated weights for policy 1, policy_version 1463589 (0.0008) [2023-12-28 05:45:19,770][106225] Updated weights for policy 1, policy_version 1463599 (0.0007) [2023-12-28 05:45:20,343][106226] Updated weights for policy 0, policy_version 1460297 (0.0008) [2023-12-28 05:45:20,408][106226] Updated weights for policy 0, policy_version 1460307 (0.0008) [2023-12-28 05:45:20,474][106226] Updated weights for policy 0, policy_version 1460317 (0.0008) [2023-12-28 05:45:20,541][106225] Updated weights for policy 1, policy_version 1463609 (0.0008) [2023-12-28 05:45:20,609][106225] Updated weights for policy 1, policy_version 1463619 (0.0008) [2023-12-28 05:45:20,675][106225] Updated weights for policy 1, policy_version 1463629 (0.0008) [2023-12-28 05:45:20,736][106225] Updated weights for policy 1, policy_version 1463639 (0.0008) [2023-12-28 05:45:21,174][105115] Fps is (10 sec: 18022.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 748658688. Throughput: 0: 9928.6, 1: 9632.7. Samples: 748670684. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:21,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-4.432')] [2023-12-28 05:45:21,233][106226] Updated weights for policy 0, policy_version 1460327 (0.0008) [2023-12-28 05:45:21,297][106226] Updated weights for policy 0, policy_version 1460337 (0.0008) [2023-12-28 05:45:21,362][106226] Updated weights for policy 0, policy_version 1460347 (0.0008) [2023-12-28 05:45:21,494][106225] Updated weights for policy 1, policy_version 1463649 (0.0008) [2023-12-28 05:45:21,551][106225] Updated weights for policy 1, policy_version 1463659 (0.0009) [2023-12-28 05:45:21,611][106225] Updated weights for policy 1, policy_version 1463669 (0.0009) [2023-12-28 05:45:22,178][106226] Updated weights for policy 0, policy_version 1460357 (0.0007) [2023-12-28 05:45:22,242][106226] Updated weights for policy 0, policy_version 1460367 (0.0006) [2023-12-28 05:45:22,303][106226] Updated weights for policy 0, policy_version 1460377 (0.0007) [2023-12-28 05:45:22,390][106225] Updated weights for policy 1, policy_version 1463679 (0.0009) [2023-12-28 05:45:22,451][106225] Updated weights for policy 1, policy_version 1463689 (0.0009) [2023-12-28 05:45:22,513][106225] Updated weights for policy 1, policy_version 1463699 (0.0008) [2023-12-28 05:45:22,916][106226] Updated weights for policy 0, policy_version 1460387 (0.0007) [2023-12-28 05:45:22,977][106226] Updated weights for policy 0, policy_version 1460397 (0.0008) [2023-12-28 05:45:23,034][106226] Updated weights for policy 0, policy_version 1460407 (0.0009) [2023-12-28 05:45:23,259][106225] Updated weights for policy 1, policy_version 1463709 (0.0006) [2023-12-28 05:45:23,310][106225] Updated weights for policy 1, policy_version 1463719 (0.0007) [2023-12-28 05:45:23,368][106225] Updated weights for policy 1, policy_version 1463729 (0.0010) [2023-12-28 05:45:23,798][106226] Updated weights for policy 0, policy_version 1460417 (0.0008) [2023-12-28 05:45:23,851][106226] Updated weights for policy 0, policy_version 1460427 (0.0005) [2023-12-28 05:45:23,910][106226] Updated weights for policy 0, policy_version 1460437 (0.0008) [2023-12-28 05:45:23,958][106226] Updated weights for policy 0, policy_version 1460447 (0.0008) [2023-12-28 05:45:24,071][106225] Updated weights for policy 1, policy_version 1463739 (0.0010) [2023-12-28 05:45:24,131][106225] Updated weights for policy 1, policy_version 1463749 (0.0010) [2023-12-28 05:45:24,190][106225] Updated weights for policy 1, policy_version 1463759 (0.0010) [2023-12-28 05:45:24,561][106226] Updated weights for policy 0, policy_version 1460457 (0.0005) [2023-12-28 05:45:24,621][106226] Updated weights for policy 0, policy_version 1460467 (0.0005) [2023-12-28 05:45:24,680][106226] Updated weights for policy 0, policy_version 1460477 (0.0006) [2023-12-28 05:45:24,901][106225] Updated weights for policy 1, policy_version 1463769 (0.0010) [2023-12-28 05:45:24,962][106225] Updated weights for policy 1, policy_version 1463779 (0.0010) [2023-12-28 05:45:25,016][106225] Updated weights for policy 1, policy_version 1463789 (0.0010) [2023-12-28 05:45:25,069][106225] Updated weights for policy 1, policy_version 1463799 (0.0010) [2023-12-28 05:45:25,310][106226] Updated weights for policy 0, policy_version 1460487 (0.0007) [2023-12-28 05:45:25,366][106226] Updated weights for policy 0, policy_version 1460497 (0.0008) [2023-12-28 05:45:25,420][106226] Updated weights for policy 0, policy_version 1460507 (0.0008) [2023-12-28 05:45:25,787][106225] Updated weights for policy 1, policy_version 1463809 (0.0010) [2023-12-28 05:45:25,837][106225] Updated weights for policy 1, policy_version 1463819 (0.0010) [2023-12-28 05:45:25,884][106225] Updated weights for policy 1, policy_version 1463829 (0.0006) [2023-12-28 05:45:26,144][106226] Updated weights for policy 0, policy_version 1460517 (0.0010) [2023-12-28 05:45:26,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 748756992. Throughput: 0: 9916.4, 1: 9622.9. Samples: 748727512. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:26,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-4.965')] [2023-12-28 05:45:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001463832_374792192.pth... [2023-12-28 05:45:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001462712_374505472.pth [2023-12-28 05:45:26,193][106226] Updated weights for policy 0, policy_version 1460527 (0.0006) [2023-12-28 05:45:26,247][106226] Updated weights for policy 0, policy_version 1460537 (0.0008) [2023-12-28 05:45:26,279][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001460544_373972992.pth... [2023-12-28 05:45:26,282][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001459360_373669888.pth [2023-12-28 05:45:26,587][106225] Updated weights for policy 1, policy_version 1463839 (0.0005) [2023-12-28 05:45:26,648][106225] Updated weights for policy 1, policy_version 1463849 (0.0005) [2023-12-28 05:45:26,711][106225] Updated weights for policy 1, policy_version 1463859 (0.0006) [2023-12-28 05:45:26,936][106226] Updated weights for policy 0, policy_version 1460547 (0.0009) [2023-12-28 05:45:26,985][106226] Updated weights for policy 0, policy_version 1460557 (0.0007) [2023-12-28 05:45:27,039][106226] Updated weights for policy 0, policy_version 1460567 (0.0009) [2023-12-28 05:45:27,341][106225] Updated weights for policy 1, policy_version 1463869 (0.0008) [2023-12-28 05:45:27,403][106225] Updated weights for policy 1, policy_version 1463879 (0.0009) [2023-12-28 05:45:27,461][106225] Updated weights for policy 1, policy_version 1463889 (0.0008) [2023-12-28 05:45:27,756][106226] Updated weights for policy 0, policy_version 1460578 (0.0008) [2023-12-28 05:45:27,814][106226] Updated weights for policy 0, policy_version 1460588 (0.0009) [2023-12-28 05:45:27,869][106226] Updated weights for policy 0, policy_version 1460598 (0.0007) [2023-12-28 05:45:27,929][106226] Updated weights for policy 0, policy_version 1460608 (0.0005) [2023-12-28 05:45:28,141][106225] Updated weights for policy 1, policy_version 1463899 (0.0005) [2023-12-28 05:45:28,197][106225] Updated weights for policy 1, policy_version 1463909 (0.0005) [2023-12-28 05:45:28,253][106225] Updated weights for policy 1, policy_version 1463919 (0.0005) [2023-12-28 05:45:28,616][106226] Updated weights for policy 0, policy_version 1460618 (0.0006) [2023-12-28 05:45:28,681][106226] Updated weights for policy 0, policy_version 1460628 (0.0005) [2023-12-28 05:45:28,742][106226] Updated weights for policy 0, policy_version 1460638 (0.0006) [2023-12-28 05:45:28,934][106225] Updated weights for policy 1, policy_version 1463929 (0.0005) [2023-12-28 05:45:28,988][106225] Updated weights for policy 1, policy_version 1463939 (0.0005) [2023-12-28 05:45:29,041][106225] Updated weights for policy 1, policy_version 1463949 (0.0007) [2023-12-28 05:45:29,096][106225] Updated weights for policy 1, policy_version 1463959 (0.0008) [2023-12-28 05:45:29,363][106226] Updated weights for policy 0, policy_version 1460648 (0.0007) [2023-12-28 05:45:29,423][106226] Updated weights for policy 0, policy_version 1460658 (0.0009) [2023-12-28 05:45:29,479][106226] Updated weights for policy 0, policy_version 1460668 (0.0009) [2023-12-28 05:45:29,780][106225] Updated weights for policy 1, policy_version 1463969 (0.0008) [2023-12-28 05:45:29,839][106225] Updated weights for policy 1, policy_version 1463979 (0.0008) [2023-12-28 05:45:29,908][106225] Updated weights for policy 1, policy_version 1463989 (0.0007) [2023-12-28 05:45:30,200][106226] Updated weights for policy 0, policy_version 1460678 (0.0008) [2023-12-28 05:45:30,279][106226] Updated weights for policy 0, policy_version 1460688 (0.0006) [2023-12-28 05:45:30,335][106226] Updated weights for policy 0, policy_version 1460698 (0.0005) [2023-12-28 05:45:30,640][106225] Updated weights for policy 1, policy_version 1463999 (0.0009) [2023-12-28 05:45:30,695][106225] Updated weights for policy 1, policy_version 1464009 (0.0008) [2023-12-28 05:45:30,741][106225] Updated weights for policy 1, policy_version 1464019 (0.0009) [2023-12-28 05:45:30,907][106226] Updated weights for policy 0, policy_version 1460708 (0.0005) [2023-12-28 05:45:30,963][106226] Updated weights for policy 0, policy_version 1460718 (0.0005) [2023-12-28 05:45:31,018][106226] Updated weights for policy 0, policy_version 1460728 (0.0006) [2023-12-28 05:45:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19803.8, 300 sec: 19716.3). Total num frames: 748863488. Throughput: 0: 9991.9, 1: 9679.5. Samples: 748850196. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:31,175][105115] Avg episode reward: [(0, '-5.108'), (1, '-4.534')] [2023-12-28 05:45:31,598][106225] Updated weights for policy 1, policy_version 1464030 (0.0007) [2023-12-28 05:45:31,669][106225] Updated weights for policy 1, policy_version 1464040 (0.0008) [2023-12-28 05:45:31,684][106226] Updated weights for policy 0, policy_version 1460738 (0.0009) [2023-12-28 05:45:31,730][106225] Updated weights for policy 1, policy_version 1464050 (0.0007) [2023-12-28 05:45:31,746][106226] Updated weights for policy 0, policy_version 1460748 (0.0008) [2023-12-28 05:45:31,811][106226] Updated weights for policy 0, policy_version 1460758 (0.0009) [2023-12-28 05:45:31,876][106226] Updated weights for policy 0, policy_version 1460768 (0.0009) [2023-12-28 05:45:32,377][106225] Updated weights for policy 1, policy_version 1464060 (0.0007) [2023-12-28 05:45:32,436][106225] Updated weights for policy 1, policy_version 1464070 (0.0008) [2023-12-28 05:45:32,490][106225] Updated weights for policy 1, policy_version 1464080 (0.0008) [2023-12-28 05:45:32,607][106226] Updated weights for policy 0, policy_version 1460778 (0.0009) [2023-12-28 05:45:32,667][106226] Updated weights for policy 0, policy_version 1460788 (0.0009) [2023-12-28 05:45:32,726][106226] Updated weights for policy 0, policy_version 1460798 (0.0009) [2023-12-28 05:45:33,156][106225] Updated weights for policy 1, policy_version 1464090 (0.0008) [2023-12-28 05:45:33,223][106225] Updated weights for policy 1, policy_version 1464100 (0.0008) [2023-12-28 05:45:33,286][106225] Updated weights for policy 1, policy_version 1464110 (0.0008) [2023-12-28 05:45:33,345][106225] Updated weights for policy 1, policy_version 1464120 (0.0008) [2023-12-28 05:45:33,477][106226] Updated weights for policy 0, policy_version 1460808 (0.0007) [2023-12-28 05:45:33,536][106226] Updated weights for policy 0, policy_version 1460818 (0.0008) [2023-12-28 05:45:33,592][106226] Updated weights for policy 0, policy_version 1460828 (0.0008) [2023-12-28 05:45:33,995][106225] Updated weights for policy 1, policy_version 1464130 (0.0009) [2023-12-28 05:45:34,037][106225] Updated weights for policy 1, policy_version 1464140 (0.0010) [2023-12-28 05:45:34,086][106225] Updated weights for policy 1, policy_version 1464150 (0.0010) [2023-12-28 05:45:34,361][106226] Updated weights for policy 0, policy_version 1460838 (0.0008) [2023-12-28 05:45:34,422][106226] Updated weights for policy 0, policy_version 1460848 (0.0008) [2023-12-28 05:45:34,487][106226] Updated weights for policy 0, policy_version 1460858 (0.0008) [2023-12-28 05:45:34,788][106225] Updated weights for policy 1, policy_version 1464160 (0.0009) [2023-12-28 05:45:34,837][106225] Updated weights for policy 1, policy_version 1464170 (0.0009) [2023-12-28 05:45:34,884][106225] Updated weights for policy 1, policy_version 1464180 (0.0008) [2023-12-28 05:45:35,211][106226] Updated weights for policy 0, policy_version 1460868 (0.0009) [2023-12-28 05:45:35,269][106226] Updated weights for policy 0, policy_version 1460878 (0.0011) [2023-12-28 05:45:35,320][106226] Updated weights for policy 0, policy_version 1460888 (0.0011) [2023-12-28 05:45:35,600][106225] Updated weights for policy 1, policy_version 1464190 (0.0007) [2023-12-28 05:45:35,663][106225] Updated weights for policy 1, policy_version 1464200 (0.0011) [2023-12-28 05:45:35,711][106225] Updated weights for policy 1, policy_version 1464210 (0.0010) [2023-12-28 05:45:35,954][106226] Updated weights for policy 0, policy_version 1460898 (0.0009) [2023-12-28 05:45:36,017][106226] Updated weights for policy 0, policy_version 1460908 (0.0005) [2023-12-28 05:45:36,081][106226] Updated weights for policy 0, policy_version 1460918 (0.0010) [2023-12-28 05:45:36,147][106226] Updated weights for policy 0, policy_version 1460928 (0.0009) [2023-12-28 05:45:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 748961792. Throughput: 0: 9935.2, 1: 9667.5. Samples: 748968896. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:36,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.641')] [2023-12-28 05:45:36,339][106225] Updated weights for policy 1, policy_version 1464220 (0.0010) [2023-12-28 05:45:36,400][106225] Updated weights for policy 1, policy_version 1464230 (0.0010) [2023-12-28 05:45:36,461][106225] Updated weights for policy 1, policy_version 1464240 (0.0011) [2023-12-28 05:45:36,814][106226] Updated weights for policy 0, policy_version 1460938 (0.0010) [2023-12-28 05:45:36,883][106226] Updated weights for policy 0, policy_version 1460948 (0.0007) [2023-12-28 05:45:36,954][106226] Updated weights for policy 0, policy_version 1460958 (0.0008) [2023-12-28 05:45:37,183][106225] Updated weights for policy 1, policy_version 1464250 (0.0010) [2023-12-28 05:45:37,237][106225] Updated weights for policy 1, policy_version 1464260 (0.0008) [2023-12-28 05:45:37,307][106225] Updated weights for policy 1, policy_version 1464270 (0.0007) [2023-12-28 05:45:37,370][106225] Updated weights for policy 1, policy_version 1464280 (0.0008) [2023-12-28 05:45:37,515][106226] Updated weights for policy 0, policy_version 1460968 (0.0007) [2023-12-28 05:45:37,565][106226] Updated weights for policy 0, policy_version 1460978 (0.0005) [2023-12-28 05:45:37,610][106226] Updated weights for policy 0, policy_version 1460988 (0.0005) [2023-12-28 05:45:38,062][106225] Updated weights for policy 1, policy_version 1464290 (0.0005) [2023-12-28 05:45:38,116][106225] Updated weights for policy 1, policy_version 1464300 (0.0008) [2023-12-28 05:45:38,168][106225] Updated weights for policy 1, policy_version 1464310 (0.0009) [2023-12-28 05:45:38,252][106226] Updated weights for policy 0, policy_version 1460998 (0.0007) [2023-12-28 05:45:38,310][106226] Updated weights for policy 0, policy_version 1461008 (0.0008) [2023-12-28 05:45:38,385][106226] Updated weights for policy 0, policy_version 1461018 (0.0010) [2023-12-28 05:45:38,865][106225] Updated weights for policy 1, policy_version 1464320 (0.0008) [2023-12-28 05:45:38,921][106225] Updated weights for policy 1, policy_version 1464330 (0.0008) [2023-12-28 05:45:38,977][106225] Updated weights for policy 1, policy_version 1464340 (0.0009) [2023-12-28 05:45:39,130][106226] Updated weights for policy 0, policy_version 1461028 (0.0008) [2023-12-28 05:45:39,187][106226] Updated weights for policy 0, policy_version 1461038 (0.0005) [2023-12-28 05:45:39,256][106226] Updated weights for policy 0, policy_version 1461048 (0.0009) [2023-12-28 05:45:39,732][106225] Updated weights for policy 1, policy_version 1464350 (0.0009) [2023-12-28 05:45:39,800][106225] Updated weights for policy 1, policy_version 1464360 (0.0008) [2023-12-28 05:45:39,872][106225] Updated weights for policy 1, policy_version 1464370 (0.0008) [2023-12-28 05:45:40,015][106226] Updated weights for policy 0, policy_version 1461058 (0.0008) [2023-12-28 05:45:40,075][106226] Updated weights for policy 0, policy_version 1461068 (0.0009) [2023-12-28 05:45:40,132][106226] Updated weights for policy 0, policy_version 1461078 (0.0009) [2023-12-28 05:45:40,194][106226] Updated weights for policy 0, policy_version 1461088 (0.0009) [2023-12-28 05:45:40,529][106225] Updated weights for policy 1, policy_version 1464380 (0.0008) [2023-12-28 05:45:40,582][106225] Updated weights for policy 1, policy_version 1464390 (0.0009) [2023-12-28 05:45:40,639][106225] Updated weights for policy 1, policy_version 1464400 (0.0008) [2023-12-28 05:45:40,890][106226] Updated weights for policy 0, policy_version 1461098 (0.0009) [2023-12-28 05:45:40,938][106226] Updated weights for policy 0, policy_version 1461108 (0.0006) [2023-12-28 05:45:40,989][106226] Updated weights for policy 0, policy_version 1461118 (0.0006) [2023-12-28 05:45:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 749060096. Throughput: 0: 9958.4, 1: 9707.5. Samples: 749029888. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:41,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.649')] [2023-12-28 05:45:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001464408_374939648.pth... [2023-12-28 05:45:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001461120_374120448.pth... [2023-12-28 05:45:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001459968_373825536.pth [2023-12-28 05:45:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001463288_374652928.pth [2023-12-28 05:45:41,403][106225] Updated weights for policy 1, policy_version 1464410 (0.0008) [2023-12-28 05:45:41,460][106225] Updated weights for policy 1, policy_version 1464420 (0.0008) [2023-12-28 05:45:41,522][106225] Updated weights for policy 1, policy_version 1464430 (0.0009) [2023-12-28 05:45:41,591][106225] Updated weights for policy 1, policy_version 1464440 (0.0009) [2023-12-28 05:45:41,757][106226] Updated weights for policy 0, policy_version 1461128 (0.0008) [2023-12-28 05:45:41,827][106226] Updated weights for policy 0, policy_version 1461138 (0.0008) [2023-12-28 05:45:41,888][106226] Updated weights for policy 0, policy_version 1461148 (0.0007) [2023-12-28 05:45:42,449][106225] Updated weights for policy 1, policy_version 1464450 (0.0009) [2023-12-28 05:45:42,511][106225] Updated weights for policy 1, policy_version 1464460 (0.0008) [2023-12-28 05:45:42,570][106225] Updated weights for policy 1, policy_version 1464470 (0.0008) [2023-12-28 05:45:42,605][106226] Updated weights for policy 0, policy_version 1461158 (0.0009) [2023-12-28 05:45:42,654][106226] Updated weights for policy 0, policy_version 1461168 (0.0008) [2023-12-28 05:45:42,702][106226] Updated weights for policy 0, policy_version 1461178 (0.0008) [2023-12-28 05:45:43,185][106225] Updated weights for policy 1, policy_version 1464480 (0.0008) [2023-12-28 05:45:43,242][106225] Updated weights for policy 1, policy_version 1464490 (0.0009) [2023-12-28 05:45:43,294][106225] Updated weights for policy 1, policy_version 1464500 (0.0006) [2023-12-28 05:45:43,547][106226] Updated weights for policy 0, policy_version 1461188 (0.0008) [2023-12-28 05:45:43,593][106226] Updated weights for policy 0, policy_version 1461198 (0.0009) [2023-12-28 05:45:43,637][106226] Updated weights for policy 0, policy_version 1461208 (0.0008) [2023-12-28 05:45:43,948][106225] Updated weights for policy 1, policy_version 1464510 (0.0009) [2023-12-28 05:45:44,012][106225] Updated weights for policy 1, policy_version 1464520 (0.0010) [2023-12-28 05:45:44,067][106225] Updated weights for policy 1, policy_version 1464530 (0.0010) [2023-12-28 05:45:44,361][106226] Updated weights for policy 0, policy_version 1461218 (0.0005) [2023-12-28 05:45:44,408][106226] Updated weights for policy 0, policy_version 1461228 (0.0005) [2023-12-28 05:45:44,453][106226] Updated weights for policy 0, policy_version 1461238 (0.0005) [2023-12-28 05:45:44,511][106226] Updated weights for policy 0, policy_version 1461248 (0.0005) [2023-12-28 05:45:44,627][106225] Updated weights for policy 1, policy_version 1464540 (0.0008) [2023-12-28 05:45:44,688][106225] Updated weights for policy 1, policy_version 1464550 (0.0009) [2023-12-28 05:45:44,751][106225] Updated weights for policy 1, policy_version 1464560 (0.0010) [2023-12-28 05:45:45,176][106226] Updated weights for policy 0, policy_version 1461258 (0.0007) [2023-12-28 05:45:45,244][106226] Updated weights for policy 0, policy_version 1461268 (0.0008) [2023-12-28 05:45:45,314][106226] Updated weights for policy 0, policy_version 1461278 (0.0008) [2023-12-28 05:45:45,376][106225] Updated weights for policy 1, policy_version 1464570 (0.0011) [2023-12-28 05:45:45,441][106225] Updated weights for policy 1, policy_version 1464580 (0.0011) [2023-12-28 05:45:45,499][106225] Updated weights for policy 1, policy_version 1464590 (0.0010) [2023-12-28 05:45:45,549][106225] Updated weights for policy 1, policy_version 1464600 (0.0006) [2023-12-28 05:45:46,036][106226] Updated weights for policy 0, policy_version 1461288 (0.0010) [2023-12-28 05:45:46,091][106226] Updated weights for policy 0, policy_version 1461298 (0.0010) [2023-12-28 05:45:46,143][106226] Updated weights for policy 0, policy_version 1461308 (0.0010) [2023-12-28 05:45:46,172][106225] Updated weights for policy 1, policy_version 1464610 (0.0007) [2023-12-28 05:45:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 749158400. Throughput: 0: 9883.4, 1: 9678.3. Samples: 749146276. Policy #0 lag: (min: 24.0, avg: 53.3, max: 56.0) [2023-12-28 05:45:46,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.778')] [2023-12-28 05:45:46,228][106225] Updated weights for policy 1, policy_version 1464620 (0.0008) [2023-12-28 05:45:46,289][106225] Updated weights for policy 1, policy_version 1464630 (0.0008) [2023-12-28 05:45:46,831][106226] Updated weights for policy 0, policy_version 1461318 (0.0008) [2023-12-28 05:45:46,892][106226] Updated weights for policy 0, policy_version 1461328 (0.0008) [2023-12-28 05:45:46,946][106226] Updated weights for policy 0, policy_version 1461338 (0.0008) [2023-12-28 05:45:47,054][106225] Updated weights for policy 1, policy_version 1464640 (0.0010) [2023-12-28 05:45:47,110][106225] Updated weights for policy 1, policy_version 1464650 (0.0010) [2023-12-28 05:45:47,179][106225] Updated weights for policy 1, policy_version 1464660 (0.0010) [2023-12-28 05:45:47,550][106226] Updated weights for policy 0, policy_version 1461348 (0.0006) [2023-12-28 05:45:47,603][106226] Updated weights for policy 0, policy_version 1461358 (0.0005) [2023-12-28 05:45:47,655][106226] Updated weights for policy 0, policy_version 1461368 (0.0006) [2023-12-28 05:45:47,822][106225] Updated weights for policy 1, policy_version 1464670 (0.0009) [2023-12-28 05:45:47,899][106225] Updated weights for policy 1, policy_version 1464680 (0.0006) [2023-12-28 05:45:47,968][106225] Updated weights for policy 1, policy_version 1464690 (0.0005) [2023-12-28 05:45:48,298][106226] Updated weights for policy 0, policy_version 1461378 (0.0008) [2023-12-28 05:45:48,365][106226] Updated weights for policy 0, policy_version 1461388 (0.0009) [2023-12-28 05:45:48,421][106226] Updated weights for policy 0, policy_version 1461398 (0.0008) [2023-12-28 05:45:48,472][106226] Updated weights for policy 0, policy_version 1461408 (0.0008) [2023-12-28 05:45:48,532][106225] Updated weights for policy 1, policy_version 1464700 (0.0007) [2023-12-28 05:45:48,579][106225] Updated weights for policy 1, policy_version 1464710 (0.0010) [2023-12-28 05:45:48,637][106225] Updated weights for policy 1, policy_version 1464720 (0.0007) [2023-12-28 05:45:49,274][106225] Updated weights for policy 1, policy_version 1464730 (0.0008) [2023-12-28 05:45:49,283][106226] Updated weights for policy 0, policy_version 1461418 (0.0008) [2023-12-28 05:45:49,335][106225] Updated weights for policy 1, policy_version 1464740 (0.0006) [2023-12-28 05:45:49,348][106226] Updated weights for policy 0, policy_version 1461428 (0.0008) [2023-12-28 05:45:49,403][106225] Updated weights for policy 1, policy_version 1464750 (0.0007) [2023-12-28 05:45:49,416][106226] Updated weights for policy 0, policy_version 1461438 (0.0008) [2023-12-28 05:45:49,452][106225] Updated weights for policy 1, policy_version 1464760 (0.0007) [2023-12-28 05:45:50,125][106226] Updated weights for policy 0, policy_version 1461448 (0.0008) [2023-12-28 05:45:50,199][106226] Updated weights for policy 0, policy_version 1461458 (0.0008) [2023-12-28 05:45:50,247][106225] Updated weights for policy 1, policy_version 1464770 (0.0010) [2023-12-28 05:45:50,260][106226] Updated weights for policy 0, policy_version 1461468 (0.0005) [2023-12-28 05:45:50,307][106225] Updated weights for policy 1, policy_version 1464780 (0.0010) [2023-12-28 05:45:50,370][106225] Updated weights for policy 1, policy_version 1464790 (0.0008) [2023-12-28 05:45:50,925][106226] Updated weights for policy 0, policy_version 1461478 (0.0007) [2023-12-28 05:45:50,977][106226] Updated weights for policy 0, policy_version 1461488 (0.0007) [2023-12-28 05:45:51,044][106226] Updated weights for policy 0, policy_version 1461498 (0.0008) [2023-12-28 05:45:51,081][106225] Updated weights for policy 1, policy_version 1464800 (0.0009) [2023-12-28 05:45:51,150][106225] Updated weights for policy 1, policy_version 1464810 (0.0008) [2023-12-28 05:45:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 749256704. Throughput: 0: 9822.4, 1: 9766.9. Samples: 749266768. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:45:51,175][105115] Avg episode reward: [(0, '-4.963'), (1, '-4.711')] [2023-12-28 05:45:51,215][106225] Updated weights for policy 1, policy_version 1464820 (0.0010) [2023-12-28 05:45:51,823][106226] Updated weights for policy 0, policy_version 1461508 (0.0008) [2023-12-28 05:45:51,884][106226] Updated weights for policy 0, policy_version 1461518 (0.0005) [2023-12-28 05:45:51,950][106226] Updated weights for policy 0, policy_version 1461528 (0.0008) [2023-12-28 05:45:51,998][106225] Updated weights for policy 1, policy_version 1464830 (0.0010) [2023-12-28 05:45:52,056][106225] Updated weights for policy 1, policy_version 1464840 (0.0008) [2023-12-28 05:45:52,116][106225] Updated weights for policy 1, policy_version 1464850 (0.0005) [2023-12-28 05:45:52,617][106226] Updated weights for policy 0, policy_version 1461538 (0.0010) [2023-12-28 05:45:52,684][106226] Updated weights for policy 0, policy_version 1461548 (0.0005) [2023-12-28 05:45:52,751][106226] Updated weights for policy 0, policy_version 1461558 (0.0005) [2023-12-28 05:45:52,776][106225] Updated weights for policy 1, policy_version 1464860 (0.0008) [2023-12-28 05:45:52,815][106226] Updated weights for policy 0, policy_version 1461568 (0.0006) [2023-12-28 05:45:52,836][106225] Updated weights for policy 1, policy_version 1464870 (0.0007) [2023-12-28 05:45:52,892][106225] Updated weights for policy 1, policy_version 1464880 (0.0005) [2023-12-28 05:45:53,449][106226] Updated weights for policy 0, policy_version 1461578 (0.0008) [2023-12-28 05:45:53,506][106226] Updated weights for policy 0, policy_version 1461588 (0.0005) [2023-12-28 05:45:53,552][106225] Updated weights for policy 1, policy_version 1464890 (0.0006) [2023-12-28 05:45:53,566][106226] Updated weights for policy 0, policy_version 1461598 (0.0005) [2023-12-28 05:45:53,619][106225] Updated weights for policy 1, policy_version 1464900 (0.0010) [2023-12-28 05:45:53,681][106225] Updated weights for policy 1, policy_version 1464910 (0.0010) [2023-12-28 05:45:53,730][106225] Updated weights for policy 1, policy_version 1464920 (0.0010) [2023-12-28 05:45:54,163][106226] Updated weights for policy 0, policy_version 1461608 (0.0008) [2023-12-28 05:45:54,223][106226] Updated weights for policy 0, policy_version 1461618 (0.0008) [2023-12-28 05:45:54,294][106226] Updated weights for policy 0, policy_version 1461628 (0.0008) [2023-12-28 05:45:54,406][106225] Updated weights for policy 1, policy_version 1464930 (0.0007) [2023-12-28 05:45:54,452][106225] Updated weights for policy 1, policy_version 1464940 (0.0006) [2023-12-28 05:45:54,505][106225] Updated weights for policy 1, policy_version 1464950 (0.0010) [2023-12-28 05:45:55,025][106226] Updated weights for policy 0, policy_version 1461638 (0.0006) [2023-12-28 05:45:55,087][106226] Updated weights for policy 0, policy_version 1461648 (0.0005) [2023-12-28 05:45:55,143][106226] Updated weights for policy 0, policy_version 1461658 (0.0007) [2023-12-28 05:45:55,189][106225] Updated weights for policy 1, policy_version 1464960 (0.0010) [2023-12-28 05:45:55,247][106225] Updated weights for policy 1, policy_version 1464970 (0.0010) [2023-12-28 05:45:55,303][106225] Updated weights for policy 1, policy_version 1464980 (0.0010) [2023-12-28 05:45:55,822][106226] Updated weights for policy 0, policy_version 1461668 (0.0009) [2023-12-28 05:45:55,886][106226] Updated weights for policy 0, policy_version 1461678 (0.0008) [2023-12-28 05:45:55,953][106226] Updated weights for policy 0, policy_version 1461688 (0.0007) [2023-12-28 05:45:56,017][106225] Updated weights for policy 1, policy_version 1464990 (0.0008) [2023-12-28 05:45:56,076][106225] Updated weights for policy 1, policy_version 1465000 (0.0010) [2023-12-28 05:45:56,125][106225] Updated weights for policy 1, policy_version 1465010 (0.0010) [2023-12-28 05:45:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 749363200. Throughput: 0: 9833.4, 1: 9724.4. Samples: 749326416. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:45:56,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.934')] [2023-12-28 05:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001465016_375095296.pth... [2023-12-28 05:45:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001461696_374267904.pth... [2023-12-28 05:45:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001463832_374792192.pth [2023-12-28 05:45:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001460544_373972992.pth [2023-12-28 05:45:56,660][106226] Updated weights for policy 0, policy_version 1461698 (0.0008) [2023-12-28 05:45:56,712][106226] Updated weights for policy 0, policy_version 1461708 (0.0007) [2023-12-28 05:45:56,758][106226] Updated weights for policy 0, policy_version 1461718 (0.0008) [2023-12-28 05:45:56,763][106225] Updated weights for policy 1, policy_version 1465020 (0.0007) [2023-12-28 05:45:56,814][106226] Updated weights for policy 0, policy_version 1461728 (0.0008) [2023-12-28 05:45:56,822][106225] Updated weights for policy 1, policy_version 1465030 (0.0010) [2023-12-28 05:45:56,880][106225] Updated weights for policy 1, policy_version 1465040 (0.0010) [2023-12-28 05:45:57,547][106226] Updated weights for policy 0, policy_version 1461738 (0.0007) [2023-12-28 05:45:57,560][106225] Updated weights for policy 1, policy_version 1465050 (0.0009) [2023-12-28 05:45:57,603][106226] Updated weights for policy 0, policy_version 1461748 (0.0007) [2023-12-28 05:45:57,621][106225] Updated weights for policy 1, policy_version 1465060 (0.0008) [2023-12-28 05:45:57,658][106226] Updated weights for policy 0, policy_version 1461758 (0.0006) [2023-12-28 05:45:57,676][106225] Updated weights for policy 1, policy_version 1465070 (0.0008) [2023-12-28 05:45:57,734][106225] Updated weights for policy 1, policy_version 1465080 (0.0008) [2023-12-28 05:45:58,435][106226] Updated weights for policy 0, policy_version 1461768 (0.0009) [2023-12-28 05:45:58,484][106225] Updated weights for policy 1, policy_version 1465090 (0.0010) [2023-12-28 05:45:58,500][106226] Updated weights for policy 0, policy_version 1461778 (0.0008) [2023-12-28 05:45:58,553][106225] Updated weights for policy 1, policy_version 1465100 (0.0010) [2023-12-28 05:45:58,569][106226] Updated weights for policy 0, policy_version 1461788 (0.0008) [2023-12-28 05:45:58,626][106225] Updated weights for policy 1, policy_version 1465111 (0.0009) [2023-12-28 05:45:59,442][106226] Updated weights for policy 0, policy_version 1461798 (0.0008) [2023-12-28 05:45:59,499][106226] Updated weights for policy 0, policy_version 1461808 (0.0005) [2023-12-28 05:45:59,501][106225] Updated weights for policy 1, policy_version 1465121 (0.0008) [2023-12-28 05:45:59,557][106226] Updated weights for policy 0, policy_version 1461818 (0.0006) [2023-12-28 05:45:59,558][106225] Updated weights for policy 1, policy_version 1465131 (0.0007) [2023-12-28 05:45:59,615][106225] Updated weights for policy 1, policy_version 1465141 (0.0007) [2023-12-28 05:46:00,238][106225] Updated weights for policy 1, policy_version 1465151 (0.0007) [2023-12-28 05:46:00,300][106225] Updated weights for policy 1, policy_version 1465161 (0.0005) [2023-12-28 05:46:00,345][106226] Updated weights for policy 0, policy_version 1461828 (0.0006) [2023-12-28 05:46:00,355][106225] Updated weights for policy 1, policy_version 1465171 (0.0006) [2023-12-28 05:46:00,402][106226] Updated weights for policy 0, policy_version 1461838 (0.0007) [2023-12-28 05:46:00,466][106226] Updated weights for policy 0, policy_version 1461848 (0.0008) [2023-12-28 05:46:00,980][106225] Updated weights for policy 1, policy_version 1465181 (0.0006) [2023-12-28 05:46:01,035][106225] Updated weights for policy 1, policy_version 1465191 (0.0007) [2023-12-28 05:46:01,101][106225] Updated weights for policy 1, policy_version 1465201 (0.0008) [2023-12-28 05:46:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 749453312. Throughput: 0: 9804.1, 1: 9834.2. Samples: 749440612. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:01,175][105115] Avg episode reward: [(0, '-5.018'), (1, '-4.802')] [2023-12-28 05:46:01,190][106226] Updated weights for policy 0, policy_version 1461858 (0.0009) [2023-12-28 05:46:01,255][106226] Updated weights for policy 0, policy_version 1461868 (0.0010) [2023-12-28 05:46:01,317][106226] Updated weights for policy 0, policy_version 1461878 (0.0010) [2023-12-28 05:46:01,377][106226] Updated weights for policy 0, policy_version 1461888 (0.0009) [2023-12-28 05:46:01,853][106225] Updated weights for policy 1, policy_version 1465211 (0.0009) [2023-12-28 05:46:01,915][106225] Updated weights for policy 1, policy_version 1465221 (0.0009) [2023-12-28 05:46:01,979][106225] Updated weights for policy 1, policy_version 1465231 (0.0006) [2023-12-28 05:46:02,008][106226] Updated weights for policy 0, policy_version 1461898 (0.0011) [2023-12-28 05:46:02,069][106226] Updated weights for policy 0, policy_version 1461908 (0.0011) [2023-12-28 05:46:02,135][106226] Updated weights for policy 0, policy_version 1461918 (0.0010) [2023-12-28 05:46:02,574][106225] Updated weights for policy 1, policy_version 1465241 (0.0006) [2023-12-28 05:46:02,624][106225] Updated weights for policy 1, policy_version 1465251 (0.0008) [2023-12-28 05:46:02,679][106225] Updated weights for policy 1, policy_version 1465261 (0.0007) [2023-12-28 05:46:02,734][106225] Updated weights for policy 1, policy_version 1465271 (0.0007) [2023-12-28 05:46:02,795][106226] Updated weights for policy 0, policy_version 1461928 (0.0011) [2023-12-28 05:46:02,847][106226] Updated weights for policy 0, policy_version 1461938 (0.0011) [2023-12-28 05:46:02,901][106226] Updated weights for policy 0, policy_version 1461948 (0.0011) [2023-12-28 05:46:03,384][106225] Updated weights for policy 1, policy_version 1465281 (0.0006) [2023-12-28 05:46:03,437][106225] Updated weights for policy 1, policy_version 1465291 (0.0010) [2023-12-28 05:46:03,488][106225] Updated weights for policy 1, policy_version 1465301 (0.0008) [2023-12-28 05:46:03,559][106226] Updated weights for policy 0, policy_version 1461958 (0.0007) [2023-12-28 05:46:03,618][106226] Updated weights for policy 0, policy_version 1461968 (0.0006) [2023-12-28 05:46:03,675][106226] Updated weights for policy 0, policy_version 1461978 (0.0006) [2023-12-28 05:46:04,129][106225] Updated weights for policy 1, policy_version 1465311 (0.0008) [2023-12-28 05:46:04,200][106225] Updated weights for policy 1, policy_version 1465321 (0.0006) [2023-12-28 05:46:04,263][106226] Updated weights for policy 0, policy_version 1461988 (0.0006) [2023-12-28 05:46:04,269][106225] Updated weights for policy 1, policy_version 1465331 (0.0006) [2023-12-28 05:46:04,326][106226] Updated weights for policy 0, policy_version 1461998 (0.0007) [2023-12-28 05:46:04,395][106226] Updated weights for policy 0, policy_version 1462008 (0.0008) [2023-12-28 05:46:04,868][106225] Updated weights for policy 1, policy_version 1465341 (0.0006) [2023-12-28 05:46:04,918][106225] Updated weights for policy 1, policy_version 1465351 (0.0005) [2023-12-28 05:46:04,977][106225] Updated weights for policy 1, policy_version 1465361 (0.0007) [2023-12-28 05:46:05,064][106226] Updated weights for policy 0, policy_version 1462018 (0.0009) [2023-12-28 05:46:05,130][106226] Updated weights for policy 0, policy_version 1462028 (0.0006) [2023-12-28 05:46:05,191][106226] Updated weights for policy 0, policy_version 1462038 (0.0005) [2023-12-28 05:46:05,257][106226] Updated weights for policy 0, policy_version 1462048 (0.0005) [2023-12-28 05:46:05,537][106225] Updated weights for policy 1, policy_version 1465371 (0.0007) [2023-12-28 05:46:05,587][106225] Updated weights for policy 1, policy_version 1465381 (0.0010) [2023-12-28 05:46:05,642][106225] Updated weights for policy 1, policy_version 1465391 (0.0010) [2023-12-28 05:46:05,784][106226] Updated weights for policy 0, policy_version 1462058 (0.0009) [2023-12-28 05:46:05,837][106226] Updated weights for policy 0, policy_version 1462068 (0.0009) [2023-12-28 05:46:05,890][106226] Updated weights for policy 0, policy_version 1462078 (0.0008) [2023-12-28 05:46:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 749559808. Throughput: 0: 9922.9, 1: 10015.1. Samples: 749567896. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:06,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.913')] [2023-12-28 05:46:06,261][106225] Updated weights for policy 1, policy_version 1465401 (0.0008) [2023-12-28 05:46:06,330][106225] Updated weights for policy 1, policy_version 1465411 (0.0006) [2023-12-28 05:46:06,394][106225] Updated weights for policy 1, policy_version 1465421 (0.0006) [2023-12-28 05:46:06,458][106225] Updated weights for policy 1, policy_version 1465431 (0.0006) [2023-12-28 05:46:06,634][106226] Updated weights for policy 0, policy_version 1462088 (0.0006) [2023-12-28 05:46:06,702][106226] Updated weights for policy 0, policy_version 1462098 (0.0009) [2023-12-28 05:46:06,759][106226] Updated weights for policy 0, policy_version 1462108 (0.0010) [2023-12-28 05:46:07,145][106225] Updated weights for policy 1, policy_version 1465441 (0.0008) [2023-12-28 05:46:07,205][106225] Updated weights for policy 1, policy_version 1465451 (0.0009) [2023-12-28 05:46:07,259][106225] Updated weights for policy 1, policy_version 1465461 (0.0008) [2023-12-28 05:46:07,359][106226] Updated weights for policy 0, policy_version 1462118 (0.0008) [2023-12-28 05:46:07,413][106226] Updated weights for policy 0, policy_version 1462128 (0.0010) [2023-12-28 05:46:07,463][106226] Updated weights for policy 0, policy_version 1462138 (0.0010) [2023-12-28 05:46:07,987][106225] Updated weights for policy 1, policy_version 1465471 (0.0007) [2023-12-28 05:46:08,044][106225] Updated weights for policy 1, policy_version 1465481 (0.0008) [2023-12-28 05:46:08,094][106225] Updated weights for policy 1, policy_version 1465491 (0.0007) [2023-12-28 05:46:08,094][106226] Updated weights for policy 0, policy_version 1462148 (0.0007) [2023-12-28 05:46:08,148][106226] Updated weights for policy 0, policy_version 1462158 (0.0010) [2023-12-28 05:46:08,212][106226] Updated weights for policy 0, policy_version 1462168 (0.0011) [2023-12-28 05:46:08,789][106225] Updated weights for policy 1, policy_version 1465501 (0.0005) [2023-12-28 05:46:08,858][106225] Updated weights for policy 1, policy_version 1465511 (0.0005) [2023-12-28 05:46:08,928][106225] Updated weights for policy 1, policy_version 1465521 (0.0006) [2023-12-28 05:46:08,943][106226] Updated weights for policy 0, policy_version 1462178 (0.0010) [2023-12-28 05:46:08,992][106226] Updated weights for policy 0, policy_version 1462188 (0.0006) [2023-12-28 05:46:09,040][106226] Updated weights for policy 0, policy_version 1462198 (0.0005) [2023-12-28 05:46:09,098][106226] Updated weights for policy 0, policy_version 1462208 (0.0006) [2023-12-28 05:46:09,662][106225] Updated weights for policy 1, policy_version 1465531 (0.0008) [2023-12-28 05:46:09,728][106225] Updated weights for policy 1, policy_version 1465541 (0.0009) [2023-12-28 05:46:09,796][106225] Updated weights for policy 1, policy_version 1465551 (0.0009) [2023-12-28 05:46:09,806][106226] Updated weights for policy 0, policy_version 1462218 (0.0007) [2023-12-28 05:46:09,874][106226] Updated weights for policy 0, policy_version 1462228 (0.0009) [2023-12-28 05:46:09,932][106226] Updated weights for policy 0, policy_version 1462238 (0.0008) [2023-12-28 05:46:10,512][106225] Updated weights for policy 1, policy_version 1465561 (0.0009) [2023-12-28 05:46:10,569][106225] Updated weights for policy 1, policy_version 1465571 (0.0009) [2023-12-28 05:46:10,631][106225] Updated weights for policy 1, policy_version 1465581 (0.0009) [2023-12-28 05:46:10,688][106225] Updated weights for policy 1, policy_version 1465591 (0.0007) [2023-12-28 05:46:10,710][106226] Updated weights for policy 0, policy_version 1462248 (0.0007) [2023-12-28 05:46:10,764][106226] Updated weights for policy 0, policy_version 1462258 (0.0009) [2023-12-28 05:46:10,814][106226] Updated weights for policy 0, policy_version 1462268 (0.0009) [2023-12-28 05:46:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 749658112. Throughput: 0: 9976.8, 1: 10063.9. Samples: 749629344. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:11,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.758')] [2023-12-28 05:46:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001465592_375242752.pth... [2023-12-28 05:46:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001462272_374415360.pth... [2023-12-28 05:46:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001464408_374939648.pth [2023-12-28 05:46:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001461120_374120448.pth [2023-12-28 05:46:11,318][106225] Updated weights for policy 1, policy_version 1465601 (0.0007) [2023-12-28 05:46:11,385][106225] Updated weights for policy 1, policy_version 1465611 (0.0008) [2023-12-28 05:46:11,443][106225] Updated weights for policy 1, policy_version 1465621 (0.0008) [2023-12-28 05:46:11,635][106226] Updated weights for policy 0, policy_version 1462278 (0.0009) [2023-12-28 05:46:11,700][106226] Updated weights for policy 0, policy_version 1462288 (0.0008) [2023-12-28 05:46:11,773][106226] Updated weights for policy 0, policy_version 1462298 (0.0009) [2023-12-28 05:46:12,210][106225] Updated weights for policy 1, policy_version 1465631 (0.0008) [2023-12-28 05:46:12,276][106225] Updated weights for policy 1, policy_version 1465641 (0.0008) [2023-12-28 05:46:12,340][106225] Updated weights for policy 1, policy_version 1465651 (0.0008) [2023-12-28 05:46:12,576][106226] Updated weights for policy 0, policy_version 1462308 (0.0009) [2023-12-28 05:46:12,640][106226] Updated weights for policy 0, policy_version 1462318 (0.0009) [2023-12-28 05:46:12,707][106226] Updated weights for policy 0, policy_version 1462328 (0.0007) [2023-12-28 05:46:13,022][106225] Updated weights for policy 1, policy_version 1465661 (0.0008) [2023-12-28 05:46:13,074][106225] Updated weights for policy 1, policy_version 1465671 (0.0008) [2023-12-28 05:46:13,127][106225] Updated weights for policy 1, policy_version 1465681 (0.0009) [2023-12-28 05:46:13,483][106226] Updated weights for policy 0, policy_version 1462338 (0.0010) [2023-12-28 05:46:13,540][106226] Updated weights for policy 0, policy_version 1462348 (0.0008) [2023-12-28 05:46:13,589][106226] Updated weights for policy 0, policy_version 1462358 (0.0009) [2023-12-28 05:46:13,635][106226] Updated weights for policy 0, policy_version 1462368 (0.0009) [2023-12-28 05:46:13,847][106225] Updated weights for policy 1, policy_version 1465691 (0.0008) [2023-12-28 05:46:13,910][106225] Updated weights for policy 1, policy_version 1465701 (0.0009) [2023-12-28 05:46:13,962][106225] Updated weights for policy 1, policy_version 1465711 (0.0009) [2023-12-28 05:46:14,317][106226] Updated weights for policy 0, policy_version 1462378 (0.0009) [2023-12-28 05:46:14,364][106226] Updated weights for policy 0, policy_version 1462388 (0.0008) [2023-12-28 05:46:14,417][106226] Updated weights for policy 0, policy_version 1462398 (0.0008) [2023-12-28 05:46:14,672][106225] Updated weights for policy 1, policy_version 1465721 (0.0008) [2023-12-28 05:46:14,733][106225] Updated weights for policy 1, policy_version 1465731 (0.0009) [2023-12-28 05:46:14,800][106225] Updated weights for policy 1, policy_version 1465741 (0.0008) [2023-12-28 05:46:14,860][106225] Updated weights for policy 1, policy_version 1465751 (0.0008) [2023-12-28 05:46:15,177][106226] Updated weights for policy 0, policy_version 1462408 (0.0010) [2023-12-28 05:46:15,243][106226] Updated weights for policy 0, policy_version 1462418 (0.0010) [2023-12-28 05:46:15,309][106226] Updated weights for policy 0, policy_version 1462428 (0.0008) [2023-12-28 05:46:15,546][106225] Updated weights for policy 1, policy_version 1465761 (0.0005) [2023-12-28 05:46:15,602][106225] Updated weights for policy 1, policy_version 1465771 (0.0007) [2023-12-28 05:46:15,661][106225] Updated weights for policy 1, policy_version 1465781 (0.0008) [2023-12-28 05:46:15,991][106226] Updated weights for policy 0, policy_version 1462438 (0.0007) [2023-12-28 05:46:16,051][106226] Updated weights for policy 0, policy_version 1462448 (0.0005) [2023-12-28 05:46:16,107][106226] Updated weights for policy 0, policy_version 1462458 (0.0005) [2023-12-28 05:46:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 749756416. Throughput: 0: 9832.1, 1: 10003.1. Samples: 749742780. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:16,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.819')] [2023-12-28 05:46:16,393][106225] Updated weights for policy 1, policy_version 1465791 (0.0009) [2023-12-28 05:46:16,457][106225] Updated weights for policy 1, policy_version 1465801 (0.0010) [2023-12-28 05:46:16,508][106225] Updated weights for policy 1, policy_version 1465811 (0.0008) [2023-12-28 05:46:16,661][106226] Updated weights for policy 0, policy_version 1462468 (0.0007) [2023-12-28 05:46:16,721][106226] Updated weights for policy 0, policy_version 1462478 (0.0008) [2023-12-28 05:46:16,788][106226] Updated weights for policy 0, policy_version 1462488 (0.0007) [2023-12-28 05:46:17,258][106225] Updated weights for policy 1, policy_version 1465821 (0.0009) [2023-12-28 05:46:17,311][106225] Updated weights for policy 1, policy_version 1465831 (0.0008) [2023-12-28 05:46:17,370][106225] Updated weights for policy 1, policy_version 1465841 (0.0008) [2023-12-28 05:46:17,428][106226] Updated weights for policy 0, policy_version 1462498 (0.0008) [2023-12-28 05:46:17,490][106226] Updated weights for policy 0, policy_version 1462508 (0.0008) [2023-12-28 05:46:17,551][106226] Updated weights for policy 0, policy_version 1462518 (0.0010) [2023-12-28 05:46:17,609][106226] Updated weights for policy 0, policy_version 1462528 (0.0008) [2023-12-28 05:46:18,033][106225] Updated weights for policy 1, policy_version 1465851 (0.0009) [2023-12-28 05:46:18,079][106225] Updated weights for policy 1, policy_version 1465861 (0.0007) [2023-12-28 05:46:18,135][106225] Updated weights for policy 1, policy_version 1465871 (0.0009) [2023-12-28 05:46:18,297][106226] Updated weights for policy 0, policy_version 1462538 (0.0008) [2023-12-28 05:46:18,389][106226] Updated weights for policy 0, policy_version 1462548 (0.0008) [2023-12-28 05:46:18,449][106226] Updated weights for policy 0, policy_version 1462558 (0.0008) [2023-12-28 05:46:18,900][106225] Updated weights for policy 1, policy_version 1465881 (0.0009) [2023-12-28 05:46:18,960][106225] Updated weights for policy 1, policy_version 1465891 (0.0010) [2023-12-28 05:46:19,020][106225] Updated weights for policy 1, policy_version 1465901 (0.0010) [2023-12-28 05:46:19,084][106225] Updated weights for policy 1, policy_version 1465911 (0.0010) [2023-12-28 05:46:19,147][106226] Updated weights for policy 0, policy_version 1462568 (0.0009) [2023-12-28 05:46:19,213][106226] Updated weights for policy 0, policy_version 1462578 (0.0010) [2023-12-28 05:46:19,280][106226] Updated weights for policy 0, policy_version 1462588 (0.0008) [2023-12-28 05:46:19,779][106225] Updated weights for policy 1, policy_version 1465921 (0.0008) [2023-12-28 05:46:19,845][106225] Updated weights for policy 1, policy_version 1465931 (0.0008) [2023-12-28 05:46:19,919][106225] Updated weights for policy 1, policy_version 1465941 (0.0008) [2023-12-28 05:46:19,999][106226] Updated weights for policy 0, policy_version 1462598 (0.0007) [2023-12-28 05:46:20,070][106226] Updated weights for policy 0, policy_version 1462608 (0.0006) [2023-12-28 05:46:20,139][106226] Updated weights for policy 0, policy_version 1462618 (0.0006) [2023-12-28 05:46:20,582][106225] Updated weights for policy 1, policy_version 1465951 (0.0008) [2023-12-28 05:46:20,646][106225] Updated weights for policy 1, policy_version 1465961 (0.0008) [2023-12-28 05:46:20,702][106225] Updated weights for policy 1, policy_version 1465971 (0.0008) [2023-12-28 05:46:20,839][106226] Updated weights for policy 0, policy_version 1462628 (0.0007) [2023-12-28 05:46:20,910][106226] Updated weights for policy 0, policy_version 1462638 (0.0007) [2023-12-28 05:46:20,975][106226] Updated weights for policy 0, policy_version 1462648 (0.0009) [2023-12-28 05:46:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 749854720. Throughput: 0: 9838.5, 1: 9992.3. Samples: 749861280. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:21,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.606')] [2023-12-28 05:46:21,478][106225] Updated weights for policy 1, policy_version 1465981 (0.0010) [2023-12-28 05:46:21,528][106225] Updated weights for policy 1, policy_version 1465991 (0.0008) [2023-12-28 05:46:21,575][106225] Updated weights for policy 1, policy_version 1466001 (0.0008) [2023-12-28 05:46:21,748][106226] Updated weights for policy 0, policy_version 1462658 (0.0008) [2023-12-28 05:46:21,807][106226] Updated weights for policy 0, policy_version 1462668 (0.0006) [2023-12-28 05:46:21,881][106226] Updated weights for policy 0, policy_version 1462678 (0.0006) [2023-12-28 05:46:21,949][106226] Updated weights for policy 0, policy_version 1462688 (0.0007) [2023-12-28 05:46:22,365][106225] Updated weights for policy 1, policy_version 1466011 (0.0009) [2023-12-28 05:46:22,433][106225] Updated weights for policy 1, policy_version 1466021 (0.0007) [2023-12-28 05:46:22,497][106225] Updated weights for policy 1, policy_version 1466031 (0.0007) [2023-12-28 05:46:22,592][106226] Updated weights for policy 0, policy_version 1462698 (0.0010) [2023-12-28 05:46:22,646][106226] Updated weights for policy 0, policy_version 1462708 (0.0010) [2023-12-28 05:46:22,701][106226] Updated weights for policy 0, policy_version 1462718 (0.0011) [2023-12-28 05:46:23,241][106225] Updated weights for policy 1, policy_version 1466041 (0.0008) [2023-12-28 05:46:23,295][106225] Updated weights for policy 1, policy_version 1466051 (0.0008) [2023-12-28 05:46:23,355][106225] Updated weights for policy 1, policy_version 1466061 (0.0008) [2023-12-28 05:46:23,405][106226] Updated weights for policy 0, policy_version 1462728 (0.0009) [2023-12-28 05:46:23,416][106225] Updated weights for policy 1, policy_version 1466071 (0.0008) [2023-12-28 05:46:23,465][106226] Updated weights for policy 0, policy_version 1462738 (0.0009) [2023-12-28 05:46:23,524][106226] Updated weights for policy 0, policy_version 1462748 (0.0010) [2023-12-28 05:46:24,147][106226] Updated weights for policy 0, policy_version 1462758 (0.0010) [2023-12-28 05:46:24,168][106225] Updated weights for policy 1, policy_version 1466081 (0.0006) [2023-12-28 05:46:24,214][106226] Updated weights for policy 0, policy_version 1462768 (0.0011) [2023-12-28 05:46:24,224][106225] Updated weights for policy 1, policy_version 1466091 (0.0006) [2023-12-28 05:46:24,275][106226] Updated weights for policy 0, policy_version 1462778 (0.0010) [2023-12-28 05:46:24,280][106225] Updated weights for policy 1, policy_version 1466101 (0.0005) [2023-12-28 05:46:24,984][106226] Updated weights for policy 0, policy_version 1462788 (0.0010) [2023-12-28 05:46:25,020][106225] Updated weights for policy 1, policy_version 1466111 (0.0005) [2023-12-28 05:46:25,045][106226] Updated weights for policy 0, policy_version 1462798 (0.0008) [2023-12-28 05:46:25,068][106225] Updated weights for policy 1, policy_version 1466121 (0.0008) [2023-12-28 05:46:25,104][106226] Updated weights for policy 0, policy_version 1462808 (0.0010) [2023-12-28 05:46:25,123][106225] Updated weights for policy 1, policy_version 1466131 (0.0008) [2023-12-28 05:46:25,801][106226] Updated weights for policy 0, policy_version 1462818 (0.0010) [2023-12-28 05:46:25,852][106225] Updated weights for policy 1, policy_version 1466141 (0.0007) [2023-12-28 05:46:25,860][106226] Updated weights for policy 0, policy_version 1462828 (0.0009) [2023-12-28 05:46:25,906][106225] Updated weights for policy 1, policy_version 1466151 (0.0008) [2023-12-28 05:46:25,926][106226] Updated weights for policy 0, policy_version 1462838 (0.0008) [2023-12-28 05:46:25,958][106225] Updated weights for policy 1, policy_version 1466161 (0.0006) [2023-12-28 05:46:25,975][106226] Updated weights for policy 0, policy_version 1462848 (0.0010) [2023-12-28 05:46:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 749953024. Throughput: 0: 9817.6, 1: 9934.6. Samples: 749918744. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:26,176][105115] Avg episode reward: [(0, '-4.741'), (1, '-4.749')] [2023-12-28 05:46:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001462848_374562816.pth... [2023-12-28 05:46:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001466168_375390208.pth... [2023-12-28 05:46:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001461696_374267904.pth [2023-12-28 05:46:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001465016_375095296.pth [2023-12-28 05:46:26,671][106226] Updated weights for policy 0, policy_version 1462858 (0.0010) [2023-12-28 05:46:26,689][106225] Updated weights for policy 1, policy_version 1466171 (0.0006) [2023-12-28 05:46:26,729][106226] Updated weights for policy 0, policy_version 1462868 (0.0010) [2023-12-28 05:46:26,740][106225] Updated weights for policy 1, policy_version 1466181 (0.0008) [2023-12-28 05:46:26,774][106226] Updated weights for policy 0, policy_version 1462878 (0.0010) [2023-12-28 05:46:26,791][106225] Updated weights for policy 1, policy_version 1466191 (0.0008) [2023-12-28 05:46:27,493][106226] Updated weights for policy 0, policy_version 1462888 (0.0010) [2023-12-28 05:46:27,515][106225] Updated weights for policy 1, policy_version 1466201 (0.0008) [2023-12-28 05:46:27,538][106226] Updated weights for policy 0, policy_version 1462898 (0.0010) [2023-12-28 05:46:27,559][106225] Updated weights for policy 1, policy_version 1466211 (0.0008) [2023-12-28 05:46:27,584][106226] Updated weights for policy 0, policy_version 1462908 (0.0010) [2023-12-28 05:46:27,606][106225] Updated weights for policy 1, policy_version 1466221 (0.0005) [2023-12-28 05:46:27,673][106225] Updated weights for policy 1, policy_version 1466231 (0.0007) [2023-12-28 05:46:28,349][106226] Updated weights for policy 0, policy_version 1462918 (0.0009) [2023-12-28 05:46:28,387][106225] Updated weights for policy 1, policy_version 1466241 (0.0007) [2023-12-28 05:46:28,409][106226] Updated weights for policy 0, policy_version 1462928 (0.0007) [2023-12-28 05:46:28,447][106225] Updated weights for policy 1, policy_version 1466251 (0.0008) [2023-12-28 05:46:28,472][106226] Updated weights for policy 0, policy_version 1462938 (0.0007) [2023-12-28 05:46:28,501][106225] Updated weights for policy 1, policy_version 1466261 (0.0005) [2023-12-28 05:46:29,107][106225] Updated weights for policy 1, policy_version 1466271 (0.0009) [2023-12-28 05:46:29,133][106226] Updated weights for policy 0, policy_version 1462948 (0.0006) [2023-12-28 05:46:29,158][106225] Updated weights for policy 1, policy_version 1466281 (0.0006) [2023-12-28 05:46:29,189][106226] Updated weights for policy 0, policy_version 1462958 (0.0007) [2023-12-28 05:46:29,206][106225] Updated weights for policy 1, policy_version 1466291 (0.0007) [2023-12-28 05:46:29,258][106226] Updated weights for policy 0, policy_version 1462968 (0.0008) [2023-12-28 05:46:29,966][106226] Updated weights for policy 0, policy_version 1462978 (0.0008) [2023-12-28 05:46:30,004][106225] Updated weights for policy 1, policy_version 1466301 (0.0008) [2023-12-28 05:46:30,027][106226] Updated weights for policy 0, policy_version 1462988 (0.0007) [2023-12-28 05:46:30,057][106225] Updated weights for policy 1, policy_version 1466311 (0.0007) [2023-12-28 05:46:30,074][106226] Updated weights for policy 0, policy_version 1462998 (0.0008) [2023-12-28 05:46:30,116][106225] Updated weights for policy 1, policy_version 1466321 (0.0007) [2023-12-28 05:46:30,133][106226] Updated weights for policy 0, policy_version 1463008 (0.0006) [2023-12-28 05:46:30,762][106225] Updated weights for policy 1, policy_version 1466331 (0.0007) [2023-12-28 05:46:30,811][106225] Updated weights for policy 1, policy_version 1466341 (0.0006) [2023-12-28 05:46:30,862][106225] Updated weights for policy 1, policy_version 1466351 (0.0006) [2023-12-28 05:46:30,897][106226] Updated weights for policy 0, policy_version 1463018 (0.0008) [2023-12-28 05:46:30,954][106226] Updated weights for policy 0, policy_version 1463028 (0.0009) [2023-12-28 05:46:31,014][106226] Updated weights for policy 0, policy_version 1463038 (0.0009) [2023-12-28 05:46:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 750051328. Throughput: 0: 9852.1, 1: 9918.2. Samples: 750035940. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:31,175][105115] Avg episode reward: [(0, '-4.967'), (1, '-4.825')] [2023-12-28 05:46:31,577][106225] Updated weights for policy 1, policy_version 1466361 (0.0006) [2023-12-28 05:46:31,642][106225] Updated weights for policy 1, policy_version 1466371 (0.0009) [2023-12-28 05:46:31,695][106225] Updated weights for policy 1, policy_version 1466381 (0.0008) [2023-12-28 05:46:31,762][106225] Updated weights for policy 1, policy_version 1466391 (0.0008) [2023-12-28 05:46:31,793][106226] Updated weights for policy 0, policy_version 1463048 (0.0008) [2023-12-28 05:46:31,844][106226] Updated weights for policy 0, policy_version 1463058 (0.0009) [2023-12-28 05:46:31,891][106226] Updated weights for policy 0, policy_version 1463068 (0.0009) [2023-12-28 05:46:32,517][106225] Updated weights for policy 1, policy_version 1466401 (0.0010) [2023-12-28 05:46:32,581][106225] Updated weights for policy 1, policy_version 1466411 (0.0005) [2023-12-28 05:46:32,637][106225] Updated weights for policy 1, policy_version 1466421 (0.0006) [2023-12-28 05:46:32,726][106226] Updated weights for policy 0, policy_version 1463078 (0.0008) [2023-12-28 05:46:32,776][106226] Updated weights for policy 0, policy_version 1463088 (0.0009) [2023-12-28 05:46:32,835][106226] Updated weights for policy 0, policy_version 1463098 (0.0009) [2023-12-28 05:46:33,245][106225] Updated weights for policy 1, policy_version 1466431 (0.0010) [2023-12-28 05:46:33,288][106225] Updated weights for policy 1, policy_version 1466441 (0.0010) [2023-12-28 05:46:33,334][106225] Updated weights for policy 1, policy_version 1466451 (0.0010) [2023-12-28 05:46:33,488][106226] Updated weights for policy 0, policy_version 1463108 (0.0009) [2023-12-28 05:46:33,548][106226] Updated weights for policy 0, policy_version 1463118 (0.0009) [2023-12-28 05:46:33,599][106226] Updated weights for policy 0, policy_version 1463128 (0.0009) [2023-12-28 05:46:34,001][106225] Updated weights for policy 1, policy_version 1466461 (0.0008) [2023-12-28 05:46:34,058][106225] Updated weights for policy 1, policy_version 1466471 (0.0005) [2023-12-28 05:46:34,114][106225] Updated weights for policy 1, policy_version 1466481 (0.0006) [2023-12-28 05:46:34,387][106226] Updated weights for policy 0, policy_version 1463138 (0.0007) [2023-12-28 05:46:34,440][106226] Updated weights for policy 0, policy_version 1463148 (0.0008) [2023-12-28 05:46:34,497][106226] Updated weights for policy 0, policy_version 1463158 (0.0009) [2023-12-28 05:46:34,554][106226] Updated weights for policy 0, policy_version 1463168 (0.0009) [2023-12-28 05:46:34,763][106225] Updated weights for policy 1, policy_version 1466491 (0.0007) [2023-12-28 05:46:34,818][106225] Updated weights for policy 1, policy_version 1466501 (0.0007) [2023-12-28 05:46:34,874][106225] Updated weights for policy 1, policy_version 1466511 (0.0008) [2023-12-28 05:46:35,242][106226] Updated weights for policy 0, policy_version 1463178 (0.0008) [2023-12-28 05:46:35,306][106226] Updated weights for policy 0, policy_version 1463188 (0.0007) [2023-12-28 05:46:35,370][106226] Updated weights for policy 0, policy_version 1463198 (0.0008) [2023-12-28 05:46:35,503][106225] Updated weights for policy 1, policy_version 1466521 (0.0006) [2023-12-28 05:46:35,566][106225] Updated weights for policy 1, policy_version 1466531 (0.0006) [2023-12-28 05:46:35,613][106225] Updated weights for policy 1, policy_version 1466541 (0.0005) [2023-12-28 05:46:35,667][106225] Updated weights for policy 1, policy_version 1466551 (0.0005) [2023-12-28 05:46:35,926][106226] Updated weights for policy 0, policy_version 1463208 (0.0007) [2023-12-28 05:46:35,972][106226] Updated weights for policy 0, policy_version 1463218 (0.0005) [2023-12-28 05:46:36,018][106226] Updated weights for policy 0, policy_version 1463228 (0.0005) [2023-12-28 05:46:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 750149632. Throughput: 0: 9840.9, 1: 9948.9. Samples: 750157308. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:36,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.621')] [2023-12-28 05:46:36,305][106225] Updated weights for policy 1, policy_version 1466561 (0.0006) [2023-12-28 05:46:36,371][106225] Updated weights for policy 1, policy_version 1466571 (0.0008) [2023-12-28 05:46:36,436][106225] Updated weights for policy 1, policy_version 1466581 (0.0008) [2023-12-28 05:46:36,694][106226] Updated weights for policy 0, policy_version 1463238 (0.0008) [2023-12-28 05:46:36,750][106226] Updated weights for policy 0, policy_version 1463248 (0.0008) [2023-12-28 05:46:36,809][106226] Updated weights for policy 0, policy_version 1463258 (0.0008) [2023-12-28 05:46:37,030][106225] Updated weights for policy 1, policy_version 1466591 (0.0006) [2023-12-28 05:46:37,093][106225] Updated weights for policy 1, policy_version 1466601 (0.0005) [2023-12-28 05:46:37,160][106225] Updated weights for policy 1, policy_version 1466611 (0.0005) [2023-12-28 05:46:37,612][106226] Updated weights for policy 0, policy_version 1463268 (0.0008) [2023-12-28 05:46:37,662][106226] Updated weights for policy 0, policy_version 1463278 (0.0008) [2023-12-28 05:46:37,719][106226] Updated weights for policy 0, policy_version 1463288 (0.0009) [2023-12-28 05:46:37,723][106225] Updated weights for policy 1, policy_version 1466621 (0.0007) [2023-12-28 05:46:37,786][106225] Updated weights for policy 1, policy_version 1466631 (0.0009) [2023-12-28 05:46:37,839][106225] Updated weights for policy 1, policy_version 1466641 (0.0009) [2023-12-28 05:46:38,426][106225] Updated weights for policy 1, policy_version 1466651 (0.0007) [2023-12-28 05:46:38,494][106225] Updated weights for policy 1, policy_version 1466661 (0.0007) [2023-12-28 05:46:38,494][106226] Updated weights for policy 0, policy_version 1463298 (0.0007) [2023-12-28 05:46:38,557][106226] Updated weights for policy 0, policy_version 1463308 (0.0007) [2023-12-28 05:46:38,562][106225] Updated weights for policy 1, policy_version 1466671 (0.0008) [2023-12-28 05:46:38,621][106226] Updated weights for policy 0, policy_version 1463318 (0.0009) [2023-12-28 05:46:38,682][106226] Updated weights for policy 0, policy_version 1463328 (0.0009) [2023-12-28 05:46:39,163][106225] Updated weights for policy 1, policy_version 1466681 (0.0006) [2023-12-28 05:46:39,214][106225] Updated weights for policy 1, policy_version 1466691 (0.0006) [2023-12-28 05:46:39,285][106225] Updated weights for policy 1, policy_version 1466701 (0.0009) [2023-12-28 05:46:39,347][106225] Updated weights for policy 1, policy_version 1466711 (0.0008) [2023-12-28 05:46:39,415][106226] Updated weights for policy 0, policy_version 1463338 (0.0007) [2023-12-28 05:46:39,469][106226] Updated weights for policy 0, policy_version 1463348 (0.0008) [2023-12-28 05:46:39,533][106226] Updated weights for policy 0, policy_version 1463358 (0.0008) [2023-12-28 05:46:40,087][106225] Updated weights for policy 1, policy_version 1466721 (0.0008) [2023-12-28 05:46:40,143][106225] Updated weights for policy 1, policy_version 1466731 (0.0007) [2023-12-28 05:46:40,212][106225] Updated weights for policy 1, policy_version 1466741 (0.0007) [2023-12-28 05:46:40,324][106226] Updated weights for policy 0, policy_version 1463368 (0.0009) [2023-12-28 05:46:40,378][106226] Updated weights for policy 0, policy_version 1463378 (0.0008) [2023-12-28 05:46:40,433][106226] Updated weights for policy 0, policy_version 1463388 (0.0009) [2023-12-28 05:46:40,907][106225] Updated weights for policy 1, policy_version 1466751 (0.0009) [2023-12-28 05:46:40,968][106225] Updated weights for policy 1, policy_version 1466761 (0.0009) [2023-12-28 05:46:41,022][106225] Updated weights for policy 1, policy_version 1466771 (0.0008) [2023-12-28 05:46:41,162][106226] Updated weights for policy 0, policy_version 1463398 (0.0008) [2023-12-28 05:46:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 750247936. Throughput: 0: 9778.4, 1: 10038.6. Samples: 750218180. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:41,175][105115] Avg episode reward: [(0, '-4.978'), (1, '-4.946')] [2023-12-28 05:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001466776_375545856.pth... [2023-12-28 05:46:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001465592_375242752.pth [2023-12-28 05:46:41,232][106226] Updated weights for policy 0, policy_version 1463408 (0.0008) [2023-12-28 05:46:41,297][106226] Updated weights for policy 0, policy_version 1463418 (0.0008) [2023-12-28 05:46:41,329][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001463424_374710272.pth... [2023-12-28 05:46:41,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001462272_374415360.pth [2023-12-28 05:46:41,862][106225] Updated weights for policy 1, policy_version 1466781 (0.0008) [2023-12-28 05:46:41,927][106225] Updated weights for policy 1, policy_version 1466791 (0.0006) [2023-12-28 05:46:41,945][106226] Updated weights for policy 0, policy_version 1463428 (0.0007) [2023-12-28 05:46:41,989][106225] Updated weights for policy 1, policy_version 1466801 (0.0008) [2023-12-28 05:46:42,011][106226] Updated weights for policy 0, policy_version 1463438 (0.0007) [2023-12-28 05:46:42,071][106226] Updated weights for policy 0, policy_version 1463448 (0.0008) [2023-12-28 05:46:42,688][106225] Updated weights for policy 1, policy_version 1466811 (0.0007) [2023-12-28 05:46:42,755][106225] Updated weights for policy 1, policy_version 1466821 (0.0009) [2023-12-28 05:46:42,823][106225] Updated weights for policy 1, policy_version 1466831 (0.0008) [2023-12-28 05:46:42,860][106226] Updated weights for policy 0, policy_version 1463458 (0.0009) [2023-12-28 05:46:42,921][106226] Updated weights for policy 0, policy_version 1463468 (0.0008) [2023-12-28 05:46:42,986][106226] Updated weights for policy 0, policy_version 1463478 (0.0009) [2023-12-28 05:46:43,047][106226] Updated weights for policy 0, policy_version 1463488 (0.0009) [2023-12-28 05:46:43,569][106225] Updated weights for policy 1, policy_version 1466841 (0.0007) [2023-12-28 05:46:43,623][106225] Updated weights for policy 1, policy_version 1466851 (0.0008) [2023-12-28 05:46:43,667][106225] Updated weights for policy 1, policy_version 1466861 (0.0008) [2023-12-28 05:46:43,730][106225] Updated weights for policy 1, policy_version 1466871 (0.0007) [2023-12-28 05:46:43,732][106226] Updated weights for policy 0, policy_version 1463498 (0.0008) [2023-12-28 05:46:43,787][106226] Updated weights for policy 0, policy_version 1463508 (0.0005) [2023-12-28 05:46:43,844][106226] Updated weights for policy 0, policy_version 1463518 (0.0008) [2023-12-28 05:46:44,482][106225] Updated weights for policy 1, policy_version 1466881 (0.0010) [2023-12-28 05:46:44,543][106225] Updated weights for policy 1, policy_version 1466891 (0.0010) [2023-12-28 05:46:44,561][106226] Updated weights for policy 0, policy_version 1463528 (0.0006) [2023-12-28 05:46:44,606][106225] Updated weights for policy 1, policy_version 1466901 (0.0010) [2023-12-28 05:46:44,623][106226] Updated weights for policy 0, policy_version 1463538 (0.0008) [2023-12-28 05:46:44,689][106226] Updated weights for policy 0, policy_version 1463548 (0.0008) [2023-12-28 05:46:45,326][106225] Updated weights for policy 1, policy_version 1466911 (0.0010) [2023-12-28 05:46:45,386][106225] Updated weights for policy 1, policy_version 1466921 (0.0008) [2023-12-28 05:46:45,408][106226] Updated weights for policy 0, policy_version 1463558 (0.0007) [2023-12-28 05:46:45,447][106225] Updated weights for policy 1, policy_version 1466931 (0.0007) [2023-12-28 05:46:45,465][106226] Updated weights for policy 0, policy_version 1463568 (0.0007) [2023-12-28 05:46:45,523][106226] Updated weights for policy 0, policy_version 1463578 (0.0007) [2023-12-28 05:46:46,132][106225] Updated weights for policy 1, policy_version 1466941 (0.0008) [2023-12-28 05:46:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 750338048. Throughput: 0: 9813.3, 1: 10004.5. Samples: 750332408. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:46,175][105115] Avg episode reward: [(0, '-4.631'), (1, '-4.528')] [2023-12-28 05:46:46,182][106225] Updated weights for policy 1, policy_version 1466951 (0.0010) [2023-12-28 05:46:46,235][106225] Updated weights for policy 1, policy_version 1466961 (0.0010) [2023-12-28 05:46:46,286][106226] Updated weights for policy 0, policy_version 1463588 (0.0006) [2023-12-28 05:46:46,347][106226] Updated weights for policy 0, policy_version 1463598 (0.0005) [2023-12-28 05:46:46,413][106226] Updated weights for policy 0, policy_version 1463608 (0.0005) [2023-12-28 05:46:46,917][106225] Updated weights for policy 1, policy_version 1466971 (0.0007) [2023-12-28 05:46:46,975][106225] Updated weights for policy 1, policy_version 1466981 (0.0007) [2023-12-28 05:46:47,004][106226] Updated weights for policy 0, policy_version 1463618 (0.0007) [2023-12-28 05:46:47,038][106225] Updated weights for policy 1, policy_version 1466991 (0.0008) [2023-12-28 05:46:47,059][106226] Updated weights for policy 0, policy_version 1463628 (0.0007) [2023-12-28 05:46:47,113][106226] Updated weights for policy 0, policy_version 1463638 (0.0006) [2023-12-28 05:46:47,166][106226] Updated weights for policy 0, policy_version 1463648 (0.0008) [2023-12-28 05:46:47,690][106225] Updated weights for policy 1, policy_version 1467001 (0.0010) [2023-12-28 05:46:47,759][106225] Updated weights for policy 1, policy_version 1467011 (0.0007) [2023-12-28 05:46:47,825][106225] Updated weights for policy 1, policy_version 1467021 (0.0008) [2023-12-28 05:46:47,892][106225] Updated weights for policy 1, policy_version 1467031 (0.0008) [2023-12-28 05:46:47,924][106226] Updated weights for policy 0, policy_version 1463658 (0.0007) [2023-12-28 05:46:47,972][106226] Updated weights for policy 0, policy_version 1463668 (0.0009) [2023-12-28 05:46:48,019][106226] Updated weights for policy 0, policy_version 1463678 (0.0010) [2023-12-28 05:46:48,583][106225] Updated weights for policy 1, policy_version 1467041 (0.0006) [2023-12-28 05:46:48,643][106225] Updated weights for policy 1, policy_version 1467051 (0.0011) [2023-12-28 05:46:48,709][106225] Updated weights for policy 1, policy_version 1467061 (0.0007) [2023-12-28 05:46:48,747][106226] Updated weights for policy 0, policy_version 1463688 (0.0010) [2023-12-28 05:46:48,806][106226] Updated weights for policy 0, policy_version 1463698 (0.0011) [2023-12-28 05:46:48,854][106226] Updated weights for policy 0, policy_version 1463708 (0.0011) [2023-12-28 05:46:49,312][106225] Updated weights for policy 1, policy_version 1467071 (0.0009) [2023-12-28 05:46:49,368][106225] Updated weights for policy 1, policy_version 1467081 (0.0010) [2023-12-28 05:46:49,432][106225] Updated weights for policy 1, policy_version 1467091 (0.0008) [2023-12-28 05:46:49,588][106226] Updated weights for policy 0, policy_version 1463718 (0.0007) [2023-12-28 05:46:49,651][106226] Updated weights for policy 0, policy_version 1463728 (0.0008) [2023-12-28 05:46:49,719][106226] Updated weights for policy 0, policy_version 1463738 (0.0008) [2023-12-28 05:46:50,034][106225] Updated weights for policy 1, policy_version 1467101 (0.0008) [2023-12-28 05:46:50,096][106225] Updated weights for policy 1, policy_version 1467111 (0.0008) [2023-12-28 05:46:50,154][106225] Updated weights for policy 1, policy_version 1467121 (0.0008) [2023-12-28 05:46:50,479][106226] Updated weights for policy 0, policy_version 1463748 (0.0010) [2023-12-28 05:46:50,537][106226] Updated weights for policy 0, policy_version 1463758 (0.0009) [2023-12-28 05:46:50,597][106226] Updated weights for policy 0, policy_version 1463768 (0.0009) [2023-12-28 05:46:50,844][106225] Updated weights for policy 1, policy_version 1467131 (0.0008) [2023-12-28 05:46:50,899][106225] Updated weights for policy 1, policy_version 1467141 (0.0008) [2023-12-28 05:46:50,966][106225] Updated weights for policy 1, policy_version 1467151 (0.0008) [2023-12-28 05:46:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 750444544. Throughput: 0: 9703.6, 1: 9946.0. Samples: 750452128. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:51,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.830')] [2023-12-28 05:46:51,309][106226] Updated weights for policy 0, policy_version 1463778 (0.0009) [2023-12-28 05:46:51,374][106226] Updated weights for policy 0, policy_version 1463788 (0.0009) [2023-12-28 05:46:51,438][106226] Updated weights for policy 0, policy_version 1463798 (0.0009) [2023-12-28 05:46:51,488][106226] Updated weights for policy 0, policy_version 1463808 (0.0008) [2023-12-28 05:46:51,702][106225] Updated weights for policy 1, policy_version 1467161 (0.0009) [2023-12-28 05:46:51,775][106225] Updated weights for policy 1, policy_version 1467171 (0.0011) [2023-12-28 05:46:51,831][106225] Updated weights for policy 1, policy_version 1467181 (0.0010) [2023-12-28 05:46:51,886][106225] Updated weights for policy 1, policy_version 1467191 (0.0010) [2023-12-28 05:46:52,270][106226] Updated weights for policy 0, policy_version 1463818 (0.0006) [2023-12-28 05:46:52,331][106226] Updated weights for policy 0, policy_version 1463828 (0.0006) [2023-12-28 05:46:52,401][106226] Updated weights for policy 0, policy_version 1463838 (0.0008) [2023-12-28 05:46:52,654][106225] Updated weights for policy 1, policy_version 1467201 (0.0011) [2023-12-28 05:46:52,722][106225] Updated weights for policy 1, policy_version 1467211 (0.0011) [2023-12-28 05:46:52,790][106225] Updated weights for policy 1, policy_version 1467221 (0.0010) [2023-12-28 05:46:53,028][106226] Updated weights for policy 0, policy_version 1463848 (0.0008) [2023-12-28 05:46:53,093][106226] Updated weights for policy 0, policy_version 1463858 (0.0008) [2023-12-28 05:46:53,154][106226] Updated weights for policy 0, policy_version 1463868 (0.0006) [2023-12-28 05:46:53,494][106225] Updated weights for policy 1, policy_version 1467231 (0.0010) [2023-12-28 05:46:53,548][106225] Updated weights for policy 1, policy_version 1467241 (0.0010) [2023-12-28 05:46:53,607][106225] Updated weights for policy 1, policy_version 1467251 (0.0010) [2023-12-28 05:46:53,733][106226] Updated weights for policy 0, policy_version 1463878 (0.0005) [2023-12-28 05:46:53,788][106226] Updated weights for policy 0, policy_version 1463888 (0.0005) [2023-12-28 05:46:53,858][106226] Updated weights for policy 0, policy_version 1463898 (0.0006) [2023-12-28 05:46:54,325][106225] Updated weights for policy 1, policy_version 1467261 (0.0010) [2023-12-28 05:46:54,386][106225] Updated weights for policy 1, policy_version 1467271 (0.0009) [2023-12-28 05:46:54,447][106225] Updated weights for policy 1, policy_version 1467281 (0.0005) [2023-12-28 05:46:54,465][106226] Updated weights for policy 0, policy_version 1463908 (0.0007) [2023-12-28 05:46:54,521][106226] Updated weights for policy 0, policy_version 1463918 (0.0006) [2023-12-28 05:46:54,587][106226] Updated weights for policy 0, policy_version 1463928 (0.0006) [2023-12-28 05:46:55,124][106225] Updated weights for policy 1, policy_version 1467291 (0.0009) [2023-12-28 05:46:55,172][106225] Updated weights for policy 1, policy_version 1467301 (0.0010) [2023-12-28 05:46:55,221][106225] Updated weights for policy 1, policy_version 1467311 (0.0010) [2023-12-28 05:46:55,287][106226] Updated weights for policy 0, policy_version 1463938 (0.0008) [2023-12-28 05:46:55,329][106226] Updated weights for policy 0, policy_version 1463948 (0.0007) [2023-12-28 05:46:55,379][106226] Updated weights for policy 0, policy_version 1463958 (0.0008) [2023-12-28 05:46:55,440][106226] Updated weights for policy 0, policy_version 1463968 (0.0008) [2023-12-28 05:46:55,872][106225] Updated weights for policy 1, policy_version 1467321 (0.0010) [2023-12-28 05:46:55,930][106225] Updated weights for policy 1, policy_version 1467331 (0.0007) [2023-12-28 05:46:55,989][106225] Updated weights for policy 1, policy_version 1467341 (0.0005) [2023-12-28 05:46:56,043][106225] Updated weights for policy 1, policy_version 1467351 (0.0005) [2023-12-28 05:46:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 750542848. Throughput: 0: 9700.4, 1: 9894.5. Samples: 750511112. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:46:56,175][105115] Avg episode reward: [(0, '-4.964'), (1, '-5.015')] [2023-12-28 05:46:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001467352_375693312.pth... [2023-12-28 05:46:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001466168_375390208.pth [2023-12-28 05:46:56,190][106226] Updated weights for policy 0, policy_version 1463978 (0.0006) [2023-12-28 05:46:56,245][106226] Updated weights for policy 0, policy_version 1463988 (0.0008) [2023-12-28 05:46:56,306][106226] Updated weights for policy 0, policy_version 1463998 (0.0008) [2023-12-28 05:46:56,317][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001464000_374857728.pth... [2023-12-28 05:46:56,321][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001462848_374562816.pth [2023-12-28 05:46:56,610][106225] Updated weights for policy 1, policy_version 1467361 (0.0005) [2023-12-28 05:46:56,661][106225] Updated weights for policy 1, policy_version 1467371 (0.0006) [2023-12-28 05:46:56,711][106225] Updated weights for policy 1, policy_version 1467381 (0.0008) [2023-12-28 05:46:57,056][106226] Updated weights for policy 0, policy_version 1464008 (0.0009) [2023-12-28 05:46:57,109][106226] Updated weights for policy 0, policy_version 1464018 (0.0008) [2023-12-28 05:46:57,166][106226] Updated weights for policy 0, policy_version 1464028 (0.0008) [2023-12-28 05:46:57,345][106225] Updated weights for policy 1, policy_version 1467391 (0.0006) [2023-12-28 05:46:57,397][106225] Updated weights for policy 1, policy_version 1467401 (0.0005) [2023-12-28 05:46:57,446][106225] Updated weights for policy 1, policy_version 1467411 (0.0005) [2023-12-28 05:46:57,782][106226] Updated weights for policy 0, policy_version 1464038 (0.0007) [2023-12-28 05:46:57,840][106226] Updated weights for policy 0, policy_version 1464048 (0.0005) [2023-12-28 05:46:57,896][106226] Updated weights for policy 0, policy_version 1464058 (0.0006) [2023-12-28 05:46:58,191][106225] Updated weights for policy 1, policy_version 1467421 (0.0007) [2023-12-28 05:46:58,251][106225] Updated weights for policy 1, policy_version 1467431 (0.0007) [2023-12-28 05:46:58,318][106225] Updated weights for policy 1, policy_version 1467441 (0.0008) [2023-12-28 05:46:58,690][106226] Updated weights for policy 0, policy_version 1464068 (0.0010) [2023-12-28 05:46:58,775][106226] Updated weights for policy 0, policy_version 1464080 (0.0008) [2023-12-28 05:46:58,844][106226] Updated weights for policy 0, policy_version 1464090 (0.0009) [2023-12-28 05:46:59,150][106225] Updated weights for policy 1, policy_version 1467451 (0.0008) [2023-12-28 05:46:59,208][106225] Updated weights for policy 1, policy_version 1467461 (0.0007) [2023-12-28 05:46:59,277][106225] Updated weights for policy 1, policy_version 1467471 (0.0008) [2023-12-28 05:46:59,654][106226] Updated weights for policy 0, policy_version 1464100 (0.0008) [2023-12-28 05:46:59,705][106226] Updated weights for policy 0, policy_version 1464110 (0.0009) [2023-12-28 05:46:59,753][106226] Updated weights for policy 0, policy_version 1464120 (0.0008) [2023-12-28 05:46:59,972][106225] Updated weights for policy 1, policy_version 1467481 (0.0006) [2023-12-28 05:47:00,032][106225] Updated weights for policy 1, policy_version 1467491 (0.0007) [2023-12-28 05:47:00,081][106225] Updated weights for policy 1, policy_version 1467501 (0.0005) [2023-12-28 05:47:00,141][106225] Updated weights for policy 1, policy_version 1467511 (0.0005) [2023-12-28 05:47:00,538][106226] Updated weights for policy 0, policy_version 1464130 (0.0009) [2023-12-28 05:47:00,587][106226] Updated weights for policy 0, policy_version 1464140 (0.0010) [2023-12-28 05:47:00,634][106226] Updated weights for policy 0, policy_version 1464150 (0.0009) [2023-12-28 05:47:00,679][106226] Updated weights for policy 0, policy_version 1464160 (0.0008) [2023-12-28 05:47:00,756][106225] Updated weights for policy 1, policy_version 1467521 (0.0007) [2023-12-28 05:47:00,811][106225] Updated weights for policy 1, policy_version 1467531 (0.0007) [2023-12-28 05:47:00,867][106225] Updated weights for policy 1, policy_version 1467541 (0.0008) [2023-12-28 05:47:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 750641152. Throughput: 0: 9741.4, 1: 9953.9. Samples: 750629072. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:01,175][105115] Avg episode reward: [(0, '-4.921'), (1, '-4.655')] [2023-12-28 05:47:01,440][106226] Updated weights for policy 0, policy_version 1464170 (0.0009) [2023-12-28 05:47:01,512][106226] Updated weights for policy 0, policy_version 1464180 (0.0005) [2023-12-28 05:47:01,576][106226] Updated weights for policy 0, policy_version 1464190 (0.0008) [2023-12-28 05:47:01,663][106225] Updated weights for policy 1, policy_version 1467551 (0.0009) [2023-12-28 05:47:01,731][106225] Updated weights for policy 1, policy_version 1467561 (0.0011) [2023-12-28 05:47:01,790][106225] Updated weights for policy 1, policy_version 1467571 (0.0005) [2023-12-28 05:47:02,320][106226] Updated weights for policy 0, policy_version 1464200 (0.0009) [2023-12-28 05:47:02,393][106226] Updated weights for policy 0, policy_version 1464210 (0.0009) [2023-12-28 05:47:02,445][106226] Updated weights for policy 0, policy_version 1464220 (0.0009) [2023-12-28 05:47:02,479][106225] Updated weights for policy 1, policy_version 1467581 (0.0007) [2023-12-28 05:47:02,533][106225] Updated weights for policy 1, policy_version 1467591 (0.0009) [2023-12-28 05:47:02,590][106225] Updated weights for policy 1, policy_version 1467601 (0.0009) [2023-12-28 05:47:03,168][106226] Updated weights for policy 0, policy_version 1464230 (0.0008) [2023-12-28 05:47:03,226][106226] Updated weights for policy 0, policy_version 1464240 (0.0008) [2023-12-28 05:47:03,276][106226] Updated weights for policy 0, policy_version 1464250 (0.0007) [2023-12-28 05:47:03,336][106225] Updated weights for policy 1, policy_version 1467611 (0.0009) [2023-12-28 05:47:03,401][106225] Updated weights for policy 1, policy_version 1467621 (0.0010) [2023-12-28 05:47:03,455][106225] Updated weights for policy 1, policy_version 1467631 (0.0010) [2023-12-28 05:47:04,007][106226] Updated weights for policy 0, policy_version 1464260 (0.0008) [2023-12-28 05:47:04,069][106226] Updated weights for policy 0, policy_version 1464270 (0.0005) [2023-12-28 05:47:04,107][106225] Updated weights for policy 1, policy_version 1467641 (0.0010) [2023-12-28 05:47:04,131][106226] Updated weights for policy 0, policy_version 1464280 (0.0008) [2023-12-28 05:47:04,168][106225] Updated weights for policy 1, policy_version 1467651 (0.0011) [2023-12-28 05:47:04,232][106225] Updated weights for policy 1, policy_version 1467661 (0.0011) [2023-12-28 05:47:04,297][106225] Updated weights for policy 1, policy_version 1467671 (0.0010) [2023-12-28 05:47:04,786][106226] Updated weights for policy 0, policy_version 1464290 (0.0010) [2023-12-28 05:47:04,845][106226] Updated weights for policy 0, policy_version 1464300 (0.0008) [2023-12-28 05:47:04,912][106226] Updated weights for policy 0, policy_version 1464310 (0.0006) [2023-12-28 05:47:04,968][106226] Updated weights for policy 0, policy_version 1464320 (0.0010) [2023-12-28 05:47:05,016][106225] Updated weights for policy 1, policy_version 1467681 (0.0007) [2023-12-28 05:47:05,076][106225] Updated weights for policy 1, policy_version 1467691 (0.0006) [2023-12-28 05:47:05,148][106225] Updated weights for policy 1, policy_version 1467701 (0.0005) [2023-12-28 05:47:05,611][106226] Updated weights for policy 0, policy_version 1464330 (0.0010) [2023-12-28 05:47:05,668][106226] Updated weights for policy 0, policy_version 1464340 (0.0010) [2023-12-28 05:47:05,728][106226] Updated weights for policy 0, policy_version 1464350 (0.0009) [2023-12-28 05:47:05,769][106225] Updated weights for policy 1, policy_version 1467711 (0.0006) [2023-12-28 05:47:05,818][106225] Updated weights for policy 1, policy_version 1467721 (0.0010) [2023-12-28 05:47:05,864][106225] Updated weights for policy 1, policy_version 1467731 (0.0009) [2023-12-28 05:47:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 750739456. Throughput: 0: 9714.1, 1: 9982.6. Samples: 750747636. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:06,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-4.895')] [2023-12-28 05:47:06,352][106226] Updated weights for policy 0, policy_version 1464360 (0.0008) [2023-12-28 05:47:06,415][106226] Updated weights for policy 0, policy_version 1464370 (0.0008) [2023-12-28 05:47:06,479][106226] Updated weights for policy 0, policy_version 1464380 (0.0007) [2023-12-28 05:47:06,546][106225] Updated weights for policy 1, policy_version 1467742 (0.0006) [2023-12-28 05:47:06,610][106225] Updated weights for policy 1, policy_version 1467752 (0.0008) [2023-12-28 05:47:06,665][106225] Updated weights for policy 1, policy_version 1467762 (0.0010) [2023-12-28 05:47:07,086][106226] Updated weights for policy 0, policy_version 1464390 (0.0009) [2023-12-28 05:47:07,140][106226] Updated weights for policy 0, policy_version 1464400 (0.0011) [2023-12-28 05:47:07,201][106226] Updated weights for policy 0, policy_version 1464410 (0.0011) [2023-12-28 05:47:07,408][106225] Updated weights for policy 1, policy_version 1467772 (0.0008) [2023-12-28 05:47:07,471][106225] Updated weights for policy 1, policy_version 1467782 (0.0006) [2023-12-28 05:47:07,530][106225] Updated weights for policy 1, policy_version 1467792 (0.0006) [2023-12-28 05:47:07,871][106226] Updated weights for policy 0, policy_version 1464420 (0.0011) [2023-12-28 05:47:07,928][106226] Updated weights for policy 0, policy_version 1464430 (0.0010) [2023-12-28 05:47:07,974][106226] Updated weights for policy 0, policy_version 1464440 (0.0010) [2023-12-28 05:47:08,046][106225] Updated weights for policy 1, policy_version 1467802 (0.0006) [2023-12-28 05:47:08,093][106225] Updated weights for policy 1, policy_version 1467812 (0.0009) [2023-12-28 05:47:08,147][106225] Updated weights for policy 1, policy_version 1467822 (0.0007) [2023-12-28 05:47:08,201][106225] Updated weights for policy 1, policy_version 1467832 (0.0008) [2023-12-28 05:47:08,654][106226] Updated weights for policy 0, policy_version 1464450 (0.0009) [2023-12-28 05:47:08,717][106226] Updated weights for policy 0, policy_version 1464460 (0.0011) [2023-12-28 05:47:08,781][106226] Updated weights for policy 0, policy_version 1464470 (0.0010) [2023-12-28 05:47:08,848][106226] Updated weights for policy 0, policy_version 1464480 (0.0011) [2023-12-28 05:47:08,968][106225] Updated weights for policy 1, policy_version 1467842 (0.0010) [2023-12-28 05:47:09,019][106225] Updated weights for policy 1, policy_version 1467852 (0.0010) [2023-12-28 05:47:09,075][106225] Updated weights for policy 1, policy_version 1467862 (0.0010) [2023-12-28 05:47:09,532][106226] Updated weights for policy 0, policy_version 1464490 (0.0009) [2023-12-28 05:47:09,590][106226] Updated weights for policy 0, policy_version 1464500 (0.0011) [2023-12-28 05:47:09,659][106226] Updated weights for policy 0, policy_version 1464510 (0.0011) [2023-12-28 05:47:09,799][106225] Updated weights for policy 1, policy_version 1467872 (0.0010) [2023-12-28 05:47:09,865][106225] Updated weights for policy 1, policy_version 1467882 (0.0011) [2023-12-28 05:47:09,924][106225] Updated weights for policy 1, policy_version 1467892 (0.0007) [2023-12-28 05:47:10,363][106226] Updated weights for policy 0, policy_version 1464520 (0.0011) [2023-12-28 05:47:10,428][106226] Updated weights for policy 0, policy_version 1464530 (0.0011) [2023-12-28 05:47:10,490][106226] Updated weights for policy 0, policy_version 1464540 (0.0011) [2023-12-28 05:47:10,651][106225] Updated weights for policy 1, policy_version 1467902 (0.0010) [2023-12-28 05:47:10,701][106225] Updated weights for policy 1, policy_version 1467912 (0.0010) [2023-12-28 05:47:10,744][106225] Updated weights for policy 1, policy_version 1467922 (0.0010) [2023-12-28 05:47:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 750837760. Throughput: 0: 9742.0, 1: 10054.7. Samples: 750809592. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:11,175][105115] Avg episode reward: [(0, '-4.816'), (1, '-4.352')] [2023-12-28 05:47:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001467928_375840768.pth... [2023-12-28 05:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001466776_375545856.pth [2023-12-28 05:47:11,223][106226] Updated weights for policy 0, policy_version 1464550 (0.0010) [2023-12-28 05:47:11,288][106226] Updated weights for policy 0, policy_version 1464560 (0.0008) [2023-12-28 05:47:11,353][106226] Updated weights for policy 0, policy_version 1464570 (0.0010) [2023-12-28 05:47:11,400][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001464576_375005184.pth... [2023-12-28 05:47:11,405][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001463424_374710272.pth [2023-12-28 05:47:11,538][106225] Updated weights for policy 1, policy_version 1467932 (0.0010) [2023-12-28 05:47:11,607][106225] Updated weights for policy 1, policy_version 1467942 (0.0008) [2023-12-28 05:47:11,679][106225] Updated weights for policy 1, policy_version 1467952 (0.0008) [2023-12-28 05:47:12,156][106226] Updated weights for policy 0, policy_version 1464580 (0.0008) [2023-12-28 05:47:12,221][106226] Updated weights for policy 0, policy_version 1464590 (0.0005) [2023-12-28 05:47:12,290][106226] Updated weights for policy 0, policy_version 1464600 (0.0008) [2023-12-28 05:47:12,407][106225] Updated weights for policy 1, policy_version 1467962 (0.0007) [2023-12-28 05:47:12,469][106225] Updated weights for policy 1, policy_version 1467972 (0.0006) [2023-12-28 05:47:12,525][106225] Updated weights for policy 1, policy_version 1467982 (0.0008) [2023-12-28 05:47:12,585][106225] Updated weights for policy 1, policy_version 1467992 (0.0005) [2023-12-28 05:47:12,990][106226] Updated weights for policy 0, policy_version 1464610 (0.0007) [2023-12-28 05:47:13,047][106226] Updated weights for policy 0, policy_version 1464620 (0.0006) [2023-12-28 05:47:13,095][106226] Updated weights for policy 0, policy_version 1464630 (0.0009) [2023-12-28 05:47:13,147][106225] Updated weights for policy 1, policy_version 1468002 (0.0007) [2023-12-28 05:47:13,159][106226] Updated weights for policy 0, policy_version 1464640 (0.0008) [2023-12-28 05:47:13,197][106225] Updated weights for policy 1, policy_version 1468012 (0.0008) [2023-12-28 05:47:13,256][106225] Updated weights for policy 1, policy_version 1468022 (0.0008) [2023-12-28 05:47:13,900][106226] Updated weights for policy 0, policy_version 1464650 (0.0009) [2023-12-28 05:47:13,956][106226] Updated weights for policy 0, policy_version 1464660 (0.0010) [2023-12-28 05:47:13,985][106225] Updated weights for policy 1, policy_version 1468032 (0.0006) [2023-12-28 05:47:14,005][106226] Updated weights for policy 0, policy_version 1464670 (0.0008) [2023-12-28 05:47:14,045][106225] Updated weights for policy 1, policy_version 1468042 (0.0005) [2023-12-28 05:47:14,113][106225] Updated weights for policy 1, policy_version 1468052 (0.0007) [2023-12-28 05:47:14,751][106225] Updated weights for policy 1, policy_version 1468062 (0.0008) [2023-12-28 05:47:14,771][106226] Updated weights for policy 0, policy_version 1464680 (0.0006) [2023-12-28 05:47:14,812][106225] Updated weights for policy 1, policy_version 1468072 (0.0007) [2023-12-28 05:47:14,840][106226] Updated weights for policy 0, policy_version 1464690 (0.0009) [2023-12-28 05:47:14,878][106225] Updated weights for policy 1, policy_version 1468082 (0.0007) [2023-12-28 05:47:14,904][106226] Updated weights for policy 0, policy_version 1464700 (0.0006) [2023-12-28 05:47:15,609][106226] Updated weights for policy 0, policy_version 1464710 (0.0007) [2023-12-28 05:47:15,631][106225] Updated weights for policy 1, policy_version 1468092 (0.0008) [2023-12-28 05:47:15,669][106226] Updated weights for policy 0, policy_version 1464720 (0.0008) [2023-12-28 05:47:15,676][106225] Updated weights for policy 1, policy_version 1468102 (0.0006) [2023-12-28 05:47:15,728][106226] Updated weights for policy 0, policy_version 1464730 (0.0007) [2023-12-28 05:47:15,733][106225] Updated weights for policy 1, policy_version 1468112 (0.0008) [2023-12-28 05:47:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 750936064. Throughput: 0: 9692.9, 1: 10080.1. Samples: 750925724. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:16,175][105115] Avg episode reward: [(0, '-5.016'), (1, '-4.552')] [2023-12-28 05:47:16,384][106226] Updated weights for policy 0, policy_version 1464740 (0.0005) [2023-12-28 05:47:16,448][106226] Updated weights for policy 0, policy_version 1464750 (0.0005) [2023-12-28 05:47:16,510][106225] Updated weights for policy 1, policy_version 1468122 (0.0009) [2023-12-28 05:47:16,510][106226] Updated weights for policy 0, policy_version 1464760 (0.0006) [2023-12-28 05:47:16,560][106225] Updated weights for policy 1, policy_version 1468132 (0.0007) [2023-12-28 05:47:16,610][106225] Updated weights for policy 1, policy_version 1468142 (0.0008) [2023-12-28 05:47:16,661][106225] Updated weights for policy 1, policy_version 1468152 (0.0009) [2023-12-28 05:47:17,055][106226] Updated weights for policy 0, policy_version 1464770 (0.0005) [2023-12-28 05:47:17,115][106226] Updated weights for policy 0, policy_version 1464780 (0.0007) [2023-12-28 05:47:17,168][106226] Updated weights for policy 0, policy_version 1464790 (0.0007) [2023-12-28 05:47:17,225][106226] Updated weights for policy 0, policy_version 1464800 (0.0005) [2023-12-28 05:47:17,477][106225] Updated weights for policy 1, policy_version 1468162 (0.0009) [2023-12-28 05:47:17,528][106225] Updated weights for policy 1, policy_version 1468172 (0.0008) [2023-12-28 05:47:17,576][106225] Updated weights for policy 1, policy_version 1468182 (0.0008) [2023-12-28 05:47:17,825][106226] Updated weights for policy 0, policy_version 1464810 (0.0007) [2023-12-28 05:47:17,887][106226] Updated weights for policy 0, policy_version 1464820 (0.0009) [2023-12-28 05:47:17,948][106226] Updated weights for policy 0, policy_version 1464830 (0.0009) [2023-12-28 05:47:18,182][106225] Updated weights for policy 1, policy_version 1468192 (0.0008) [2023-12-28 05:47:18,249][106225] Updated weights for policy 1, policy_version 1468202 (0.0009) [2023-12-28 05:47:18,300][106225] Updated weights for policy 1, policy_version 1468212 (0.0008) [2023-12-28 05:47:18,631][106226] Updated weights for policy 0, policy_version 1464840 (0.0009) [2023-12-28 05:47:18,693][106226] Updated weights for policy 0, policy_version 1464850 (0.0007) [2023-12-28 05:47:18,750][106226] Updated weights for policy 0, policy_version 1464860 (0.0007) [2023-12-28 05:47:19,059][106225] Updated weights for policy 1, policy_version 1468222 (0.0009) [2023-12-28 05:47:19,116][106225] Updated weights for policy 1, policy_version 1468232 (0.0010) [2023-12-28 05:47:19,183][106225] Updated weights for policy 1, policy_version 1468242 (0.0010) [2023-12-28 05:47:19,525][106226] Updated weights for policy 0, policy_version 1464870 (0.0008) [2023-12-28 05:47:19,574][106226] Updated weights for policy 0, policy_version 1464880 (0.0009) [2023-12-28 05:47:19,638][106226] Updated weights for policy 0, policy_version 1464890 (0.0009) [2023-12-28 05:47:19,870][106225] Updated weights for policy 1, policy_version 1468252 (0.0010) [2023-12-28 05:47:19,927][106225] Updated weights for policy 1, policy_version 1468262 (0.0008) [2023-12-28 05:47:19,991][106225] Updated weights for policy 1, policy_version 1468272 (0.0008) [2023-12-28 05:47:20,426][106226] Updated weights for policy 0, policy_version 1464900 (0.0008) [2023-12-28 05:47:20,480][106226] Updated weights for policy 0, policy_version 1464910 (0.0010) [2023-12-28 05:47:20,532][106226] Updated weights for policy 0, policy_version 1464920 (0.0008) [2023-12-28 05:47:20,704][106225] Updated weights for policy 1, policy_version 1468282 (0.0008) [2023-12-28 05:47:20,769][106225] Updated weights for policy 1, policy_version 1468292 (0.0008) [2023-12-28 05:47:20,829][106225] Updated weights for policy 1, policy_version 1468302 (0.0009) [2023-12-28 05:47:20,882][106225] Updated weights for policy 1, policy_version 1468312 (0.0009) [2023-12-28 05:47:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 751034368. Throughput: 0: 9744.1, 1: 9964.8. Samples: 751044208. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:21,175][105115] Avg episode reward: [(0, '-5.145'), (1, '-4.611')] [2023-12-28 05:47:21,282][106226] Updated weights for policy 0, policy_version 1464930 (0.0008) [2023-12-28 05:47:21,343][106226] Updated weights for policy 0, policy_version 1464940 (0.0008) [2023-12-28 05:47:21,420][106226] Updated weights for policy 0, policy_version 1464950 (0.0010) [2023-12-28 05:47:21,480][106226] Updated weights for policy 0, policy_version 1464960 (0.0006) [2023-12-28 05:47:21,708][106225] Updated weights for policy 1, policy_version 1468322 (0.0008) [2023-12-28 05:47:21,794][106225] Updated weights for policy 1, policy_version 1468332 (0.0007) [2023-12-28 05:47:21,850][106225] Updated weights for policy 1, policy_version 1468342 (0.0009) [2023-12-28 05:47:22,141][106226] Updated weights for policy 0, policy_version 1464970 (0.0010) [2023-12-28 05:47:22,210][106226] Updated weights for policy 0, policy_version 1464980 (0.0009) [2023-12-28 05:47:22,286][106226] Updated weights for policy 0, policy_version 1464990 (0.0009) [2023-12-28 05:47:22,567][106225] Updated weights for policy 1, policy_version 1468352 (0.0009) [2023-12-28 05:47:22,634][106225] Updated weights for policy 1, policy_version 1468362 (0.0008) [2023-12-28 05:47:22,697][106225] Updated weights for policy 1, policy_version 1468372 (0.0008) [2023-12-28 05:47:22,984][106226] Updated weights for policy 0, policy_version 1465000 (0.0011) [2023-12-28 05:47:23,048][106226] Updated weights for policy 0, policy_version 1465010 (0.0011) [2023-12-28 05:47:23,108][106226] Updated weights for policy 0, policy_version 1465020 (0.0009) [2023-12-28 05:47:23,425][106225] Updated weights for policy 1, policy_version 1468382 (0.0009) [2023-12-28 05:47:23,478][106225] Updated weights for policy 1, policy_version 1468392 (0.0010) [2023-12-28 05:47:23,531][106225] Updated weights for policy 1, policy_version 1468402 (0.0010) [2023-12-28 05:47:23,710][106226] Updated weights for policy 0, policy_version 1465030 (0.0007) [2023-12-28 05:47:23,759][106226] Updated weights for policy 0, policy_version 1465040 (0.0006) [2023-12-28 05:47:23,826][106226] Updated weights for policy 0, policy_version 1465050 (0.0011) [2023-12-28 05:47:24,136][106225] Updated weights for policy 1, policy_version 1468412 (0.0010) [2023-12-28 05:47:24,197][106225] Updated weights for policy 1, policy_version 1468422 (0.0010) [2023-12-28 05:47:24,258][106225] Updated weights for policy 1, policy_version 1468432 (0.0011) [2023-12-28 05:47:24,447][106226] Updated weights for policy 0, policy_version 1465060 (0.0010) [2023-12-28 05:47:24,501][106226] Updated weights for policy 0, policy_version 1465070 (0.0010) [2023-12-28 05:47:24,553][106226] Updated weights for policy 0, policy_version 1465080 (0.0010) [2023-12-28 05:47:24,952][106225] Updated weights for policy 1, policy_version 1468442 (0.0010) [2023-12-28 05:47:25,018][106225] Updated weights for policy 1, policy_version 1468452 (0.0005) [2023-12-28 05:47:25,087][106225] Updated weights for policy 1, policy_version 1468462 (0.0005) [2023-12-28 05:47:25,143][106225] Updated weights for policy 1, policy_version 1468472 (0.0007) [2023-12-28 05:47:25,205][106226] Updated weights for policy 0, policy_version 1465090 (0.0011) [2023-12-28 05:47:25,264][106226] Updated weights for policy 0, policy_version 1465100 (0.0010) [2023-12-28 05:47:25,315][106226] Updated weights for policy 0, policy_version 1465110 (0.0010) [2023-12-28 05:47:25,358][106226] Updated weights for policy 0, policy_version 1465120 (0.0010) [2023-12-28 05:47:25,703][106225] Updated weights for policy 1, policy_version 1468482 (0.0008) [2023-12-28 05:47:25,752][106225] Updated weights for policy 1, policy_version 1468492 (0.0008) [2023-12-28 05:47:25,812][106225] Updated weights for policy 1, policy_version 1468502 (0.0008) [2023-12-28 05:47:25,961][106226] Updated weights for policy 0, policy_version 1465130 (0.0008) [2023-12-28 05:47:26,013][106226] Updated weights for policy 0, policy_version 1465140 (0.0007) [2023-12-28 05:47:26,067][106226] Updated weights for policy 0, policy_version 1465150 (0.0005) [2023-12-28 05:47:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 751140864. Throughput: 0: 9798.5, 1: 9841.7. Samples: 751101988. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:26,175][105115] Avg episode reward: [(0, '-5.164'), (1, '-4.851')] [2023-12-28 05:47:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001465152_375152640.pth... [2023-12-28 05:47:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001468504_375988224.pth... [2023-12-28 05:47:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001464000_374857728.pth [2023-12-28 05:47:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001467352_375693312.pth [2023-12-28 05:47:26,588][106225] Updated weights for policy 1, policy_version 1468512 (0.0008) [2023-12-28 05:47:26,637][106225] Updated weights for policy 1, policy_version 1468522 (0.0008) [2023-12-28 05:47:26,682][106225] Updated weights for policy 1, policy_version 1468532 (0.0007) [2023-12-28 05:47:26,731][106226] Updated weights for policy 0, policy_version 1465160 (0.0009) [2023-12-28 05:47:26,777][106226] Updated weights for policy 0, policy_version 1465170 (0.0010) [2023-12-28 05:47:26,833][106226] Updated weights for policy 0, policy_version 1465180 (0.0010) [2023-12-28 05:47:27,335][106225] Updated weights for policy 1, policy_version 1468542 (0.0006) [2023-12-28 05:47:27,387][106225] Updated weights for policy 1, policy_version 1468552 (0.0005) [2023-12-28 05:47:27,447][106225] Updated weights for policy 1, policy_version 1468562 (0.0005) [2023-12-28 05:47:27,565][106226] Updated weights for policy 0, policy_version 1465190 (0.0010) [2023-12-28 05:47:27,617][106226] Updated weights for policy 0, policy_version 1465200 (0.0009) [2023-12-28 05:47:27,668][106226] Updated weights for policy 0, policy_version 1465210 (0.0008) [2023-12-28 05:47:28,020][106225] Updated weights for policy 1, policy_version 1468572 (0.0007) [2023-12-28 05:47:28,063][106225] Updated weights for policy 1, policy_version 1468582 (0.0010) [2023-12-28 05:47:28,109][106225] Updated weights for policy 1, policy_version 1468592 (0.0010) [2023-12-28 05:47:28,293][106226] Updated weights for policy 0, policy_version 1465220 (0.0009) [2023-12-28 05:47:28,357][106226] Updated weights for policy 0, policy_version 1465230 (0.0008) [2023-12-28 05:47:28,415][106226] Updated weights for policy 0, policy_version 1465240 (0.0009) [2023-12-28 05:47:28,816][106225] Updated weights for policy 1, policy_version 1468602 (0.0009) [2023-12-28 05:47:28,863][106225] Updated weights for policy 1, policy_version 1468612 (0.0005) [2023-12-28 05:47:28,909][106225] Updated weights for policy 1, policy_version 1468622 (0.0005) [2023-12-28 05:47:28,955][106225] Updated weights for policy 1, policy_version 1468632 (0.0005) [2023-12-28 05:47:29,179][106226] Updated weights for policy 0, policy_version 1465250 (0.0007) [2023-12-28 05:47:29,239][106226] Updated weights for policy 0, policy_version 1465260 (0.0007) [2023-12-28 05:47:29,300][106226] Updated weights for policy 0, policy_version 1465270 (0.0008) [2023-12-28 05:47:29,370][106226] Updated weights for policy 0, policy_version 1465280 (0.0007) [2023-12-28 05:47:29,543][106225] Updated weights for policy 1, policy_version 1468642 (0.0010) [2023-12-28 05:47:29,604][106225] Updated weights for policy 1, policy_version 1468652 (0.0010) [2023-12-28 05:47:29,664][106225] Updated weights for policy 1, policy_version 1468662 (0.0010) [2023-12-28 05:47:30,041][106226] Updated weights for policy 0, policy_version 1465290 (0.0007) [2023-12-28 05:47:30,097][106226] Updated weights for policy 0, policy_version 1465300 (0.0008) [2023-12-28 05:47:30,148][106226] Updated weights for policy 0, policy_version 1465310 (0.0005) [2023-12-28 05:47:30,387][106225] Updated weights for policy 1, policy_version 1468672 (0.0010) [2023-12-28 05:47:30,438][106225] Updated weights for policy 1, policy_version 1468682 (0.0010) [2023-12-28 05:47:30,488][106225] Updated weights for policy 1, policy_version 1468692 (0.0010) [2023-12-28 05:47:30,714][106226] Updated weights for policy 0, policy_version 1465320 (0.0005) [2023-12-28 05:47:30,768][106226] Updated weights for policy 0, policy_version 1465330 (0.0007) [2023-12-28 05:47:30,824][106226] Updated weights for policy 0, policy_version 1465340 (0.0008) [2023-12-28 05:47:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 751239168. Throughput: 0: 9917.1, 1: 10009.7. Samples: 751229112. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:31,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-4.764')] [2023-12-28 05:47:31,207][106225] Updated weights for policy 1, policy_version 1468702 (0.0007) [2023-12-28 05:47:31,280][106225] Updated weights for policy 1, policy_version 1468712 (0.0008) [2023-12-28 05:47:31,342][106225] Updated weights for policy 1, policy_version 1468722 (0.0009) [2023-12-28 05:47:31,447][106226] Updated weights for policy 0, policy_version 1465350 (0.0007) [2023-12-28 05:47:31,501][106226] Updated weights for policy 0, policy_version 1465360 (0.0007) [2023-12-28 05:47:31,563][106226] Updated weights for policy 0, policy_version 1465370 (0.0005) [2023-12-28 05:47:32,043][106225] Updated weights for policy 1, policy_version 1468732 (0.0007) [2023-12-28 05:47:32,098][106225] Updated weights for policy 1, policy_version 1468742 (0.0006) [2023-12-28 05:47:32,156][106225] Updated weights for policy 1, policy_version 1468752 (0.0006) [2023-12-28 05:47:32,309][106226] Updated weights for policy 0, policy_version 1465380 (0.0007) [2023-12-28 05:47:32,375][106226] Updated weights for policy 0, policy_version 1465390 (0.0007) [2023-12-28 05:47:32,439][106226] Updated weights for policy 0, policy_version 1465400 (0.0007) [2023-12-28 05:47:32,852][106225] Updated weights for policy 1, policy_version 1468762 (0.0010) [2023-12-28 05:47:32,912][106225] Updated weights for policy 1, policy_version 1468772 (0.0010) [2023-12-28 05:47:32,969][106225] Updated weights for policy 1, policy_version 1468782 (0.0010) [2023-12-28 05:47:33,021][106225] Updated weights for policy 1, policy_version 1468792 (0.0010) [2023-12-28 05:47:33,069][106226] Updated weights for policy 0, policy_version 1465410 (0.0005) [2023-12-28 05:47:33,132][106226] Updated weights for policy 0, policy_version 1465420 (0.0005) [2023-12-28 05:47:33,177][106226] Updated weights for policy 0, policy_version 1465430 (0.0005) [2023-12-28 05:47:33,222][106226] Updated weights for policy 0, policy_version 1465440 (0.0005) [2023-12-28 05:47:33,617][106225] Updated weights for policy 1, policy_version 1468802 (0.0005) [2023-12-28 05:47:33,680][106225] Updated weights for policy 1, policy_version 1468812 (0.0006) [2023-12-28 05:47:33,746][106225] Updated weights for policy 1, policy_version 1468822 (0.0006) [2023-12-28 05:47:33,768][106226] Updated weights for policy 0, policy_version 1465450 (0.0008) [2023-12-28 05:47:33,821][106226] Updated weights for policy 0, policy_version 1465460 (0.0006) [2023-12-28 05:47:33,872][106226] Updated weights for policy 0, policy_version 1465470 (0.0005) [2023-12-28 05:47:34,399][106225] Updated weights for policy 1, policy_version 1468832 (0.0009) [2023-12-28 05:47:34,461][106225] Updated weights for policy 1, policy_version 1468842 (0.0011) [2023-12-28 05:47:34,514][106226] Updated weights for policy 0, policy_version 1465480 (0.0007) [2023-12-28 05:47:34,519][106225] Updated weights for policy 1, policy_version 1468852 (0.0011) [2023-12-28 05:47:34,574][106226] Updated weights for policy 0, policy_version 1465490 (0.0009) [2023-12-28 05:47:34,628][106226] Updated weights for policy 0, policy_version 1465500 (0.0009) [2023-12-28 05:47:35,224][106225] Updated weights for policy 1, policy_version 1468862 (0.0008) [2023-12-28 05:47:35,275][106225] Updated weights for policy 1, policy_version 1468872 (0.0008) [2023-12-28 05:47:35,335][106225] Updated weights for policy 1, policy_version 1468882 (0.0007) [2023-12-28 05:47:35,352][106226] Updated weights for policy 0, policy_version 1465510 (0.0008) [2023-12-28 05:47:35,407][106226] Updated weights for policy 0, policy_version 1465520 (0.0008) [2023-12-28 05:47:35,468][106226] Updated weights for policy 0, policy_version 1465530 (0.0008) [2023-12-28 05:47:36,075][106225] Updated weights for policy 1, policy_version 1468892 (0.0008) [2023-12-28 05:47:36,139][106225] Updated weights for policy 1, policy_version 1468902 (0.0009) [2023-12-28 05:47:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 751337472. Throughput: 0: 10047.1, 1: 9973.6. Samples: 751353060. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:36,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.795')] [2023-12-28 05:47:36,183][106226] Updated weights for policy 0, policy_version 1465540 (0.0007) [2023-12-28 05:47:36,204][106225] Updated weights for policy 1, policy_version 1468912 (0.0010) [2023-12-28 05:47:36,246][106226] Updated weights for policy 0, policy_version 1465550 (0.0006) [2023-12-28 05:47:36,308][106226] Updated weights for policy 0, policy_version 1465560 (0.0008) [2023-12-28 05:47:36,949][106225] Updated weights for policy 1, policy_version 1468922 (0.0010) [2023-12-28 05:47:37,014][106225] Updated weights for policy 1, policy_version 1468932 (0.0011) [2023-12-28 05:47:37,043][106226] Updated weights for policy 0, policy_version 1465570 (0.0008) [2023-12-28 05:47:37,069][106225] Updated weights for policy 1, policy_version 1468942 (0.0010) [2023-12-28 05:47:37,106][106226] Updated weights for policy 0, policy_version 1465580 (0.0006) [2023-12-28 05:47:37,119][106225] Updated weights for policy 1, policy_version 1468952 (0.0010) [2023-12-28 05:47:37,167][106226] Updated weights for policy 0, policy_version 1465590 (0.0008) [2023-12-28 05:47:37,216][106226] Updated weights for policy 0, policy_version 1465600 (0.0007) [2023-12-28 05:47:37,764][106225] Updated weights for policy 1, policy_version 1468962 (0.0005) [2023-12-28 05:47:37,821][106225] Updated weights for policy 1, policy_version 1468972 (0.0005) [2023-12-28 05:47:37,867][106225] Updated weights for policy 1, policy_version 1468982 (0.0005) [2023-12-28 05:47:37,998][106226] Updated weights for policy 0, policy_version 1465610 (0.0008) [2023-12-28 05:47:38,048][106226] Updated weights for policy 0, policy_version 1465620 (0.0007) [2023-12-28 05:47:38,091][106226] Updated weights for policy 0, policy_version 1465630 (0.0008) [2023-12-28 05:47:38,517][106225] Updated weights for policy 1, policy_version 1468992 (0.0006) [2023-12-28 05:47:38,583][106225] Updated weights for policy 1, policy_version 1469002 (0.0005) [2023-12-28 05:47:38,647][106225] Updated weights for policy 1, policy_version 1469012 (0.0009) [2023-12-28 05:47:38,862][106226] Updated weights for policy 0, policy_version 1465640 (0.0008) [2023-12-28 05:47:38,932][106226] Updated weights for policy 0, policy_version 1465650 (0.0010) [2023-12-28 05:47:38,998][106226] Updated weights for policy 0, policy_version 1465660 (0.0010) [2023-12-28 05:47:39,247][106225] Updated weights for policy 1, policy_version 1469022 (0.0010) [2023-12-28 05:47:39,310][106225] Updated weights for policy 1, policy_version 1469032 (0.0006) [2023-12-28 05:47:39,375][106225] Updated weights for policy 1, policy_version 1469042 (0.0007) [2023-12-28 05:47:39,760][106226] Updated weights for policy 0, policy_version 1465670 (0.0009) [2023-12-28 05:47:39,816][106226] Updated weights for policy 0, policy_version 1465680 (0.0009) [2023-12-28 05:47:39,885][106226] Updated weights for policy 0, policy_version 1465690 (0.0008) [2023-12-28 05:47:40,135][106225] Updated weights for policy 1, policy_version 1469052 (0.0009) [2023-12-28 05:47:40,195][106225] Updated weights for policy 1, policy_version 1469062 (0.0009) [2023-12-28 05:47:40,249][106225] Updated weights for policy 1, policy_version 1469072 (0.0009) [2023-12-28 05:47:40,638][106226] Updated weights for policy 0, policy_version 1465700 (0.0007) [2023-12-28 05:47:40,694][106226] Updated weights for policy 0, policy_version 1465710 (0.0005) [2023-12-28 05:47:40,755][106226] Updated weights for policy 0, policy_version 1465720 (0.0005) [2023-12-28 05:47:40,934][106225] Updated weights for policy 1, policy_version 1469082 (0.0009) [2023-12-28 05:47:40,990][106225] Updated weights for policy 1, policy_version 1469092 (0.0006) [2023-12-28 05:47:41,063][106225] Updated weights for policy 1, policy_version 1469102 (0.0007) [2023-12-28 05:47:41,124][106225] Updated weights for policy 1, policy_version 1469112 (0.0010) [2023-12-28 05:47:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 751443968. Throughput: 0: 9966.2, 1: 10028.6. Samples: 751410880. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:41,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.707')] [2023-12-28 05:47:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001465728_375300096.pth... [2023-12-28 05:47:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001469112_376143872.pth... [2023-12-28 05:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001467928_375840768.pth [2023-12-28 05:47:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001464576_375005184.pth [2023-12-28 05:47:41,466][106226] Updated weights for policy 0, policy_version 1465730 (0.0007) [2023-12-28 05:47:41,527][106226] Updated weights for policy 0, policy_version 1465740 (0.0009) [2023-12-28 05:47:41,584][106226] Updated weights for policy 0, policy_version 1465750 (0.0009) [2023-12-28 05:47:41,653][106226] Updated weights for policy 0, policy_version 1465760 (0.0009) [2023-12-28 05:47:41,822][106225] Updated weights for policy 1, policy_version 1469122 (0.0009) [2023-12-28 05:47:41,876][106225] Updated weights for policy 1, policy_version 1469132 (0.0009) [2023-12-28 05:47:41,930][106225] Updated weights for policy 1, policy_version 1469142 (0.0009) [2023-12-28 05:47:42,421][106226] Updated weights for policy 0, policy_version 1465770 (0.0009) [2023-12-28 05:47:42,484][106226] Updated weights for policy 0, policy_version 1465780 (0.0009) [2023-12-28 05:47:42,544][106226] Updated weights for policy 0, policy_version 1465790 (0.0008) [2023-12-28 05:47:42,698][106225] Updated weights for policy 1, policy_version 1469152 (0.0010) [2023-12-28 05:47:42,756][106225] Updated weights for policy 1, policy_version 1469162 (0.0010) [2023-12-28 05:47:42,821][106225] Updated weights for policy 1, policy_version 1469172 (0.0010) [2023-12-28 05:47:43,292][106226] Updated weights for policy 0, policy_version 1465800 (0.0008) [2023-12-28 05:47:43,341][106226] Updated weights for policy 0, policy_version 1465810 (0.0009) [2023-12-28 05:47:43,393][106226] Updated weights for policy 0, policy_version 1465820 (0.0008) [2023-12-28 05:47:43,499][106225] Updated weights for policy 1, policy_version 1469182 (0.0007) [2023-12-28 05:47:43,556][106225] Updated weights for policy 1, policy_version 1469192 (0.0008) [2023-12-28 05:47:43,623][106225] Updated weights for policy 1, policy_version 1469202 (0.0006) [2023-12-28 05:47:44,193][106225] Updated weights for policy 1, policy_version 1469212 (0.0007) [2023-12-28 05:47:44,257][106225] Updated weights for policy 1, policy_version 1469222 (0.0010) [2023-12-28 05:47:44,270][106226] Updated weights for policy 0, policy_version 1465830 (0.0008) [2023-12-28 05:47:44,317][106225] Updated weights for policy 1, policy_version 1469232 (0.0010) [2023-12-28 05:47:44,326][106226] Updated weights for policy 0, policy_version 1465840 (0.0010) [2023-12-28 05:47:44,377][106226] Updated weights for policy 0, policy_version 1465850 (0.0006) [2023-12-28 05:47:45,036][106225] Updated weights for policy 1, policy_version 1469242 (0.0010) [2023-12-28 05:47:45,094][106225] Updated weights for policy 1, policy_version 1469252 (0.0010) [2023-12-28 05:47:45,109][106226] Updated weights for policy 0, policy_version 1465860 (0.0007) [2023-12-28 05:47:45,151][106225] Updated weights for policy 1, policy_version 1469262 (0.0011) [2023-12-28 05:47:45,169][106226] Updated weights for policy 0, policy_version 1465870 (0.0006) [2023-12-28 05:47:45,212][106225] Updated weights for policy 1, policy_version 1469272 (0.0010) [2023-12-28 05:47:45,233][106226] Updated weights for policy 0, policy_version 1465880 (0.0009) [2023-12-28 05:47:45,813][106225] Updated weights for policy 1, policy_version 1469282 (0.0008) [2023-12-28 05:47:45,870][106225] Updated weights for policy 1, policy_version 1469292 (0.0010) [2023-12-28 05:47:45,930][106225] Updated weights for policy 1, policy_version 1469302 (0.0010) [2023-12-28 05:47:46,044][106226] Updated weights for policy 0, policy_version 1465890 (0.0009) [2023-12-28 05:47:46,100][106226] Updated weights for policy 0, policy_version 1465900 (0.0009) [2023-12-28 05:47:46,166][106226] Updated weights for policy 0, policy_version 1465910 (0.0008) [2023-12-28 05:47:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 751534080. Throughput: 0: 9935.7, 1: 9990.0. Samples: 751525728. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-28 05:47:46,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.884')] [2023-12-28 05:47:46,227][106226] Updated weights for policy 0, policy_version 1465920 (0.0008) [2023-12-28 05:47:46,574][106225] Updated weights for policy 1, policy_version 1469312 (0.0006) [2023-12-28 05:47:46,632][106225] Updated weights for policy 1, policy_version 1469322 (0.0005) [2023-12-28 05:47:46,680][106225] Updated weights for policy 1, policy_version 1469332 (0.0005) [2023-12-28 05:47:46,974][106226] Updated weights for policy 0, policy_version 1465930 (0.0008) [2023-12-28 05:47:47,025][106226] Updated weights for policy 0, policy_version 1465940 (0.0008) [2023-12-28 05:47:47,085][106226] Updated weights for policy 0, policy_version 1465950 (0.0008) [2023-12-28 05:47:47,240][106225] Updated weights for policy 1, policy_version 1469342 (0.0005) [2023-12-28 05:47:47,295][106225] Updated weights for policy 1, policy_version 1469352 (0.0005) [2023-12-28 05:47:47,351][106225] Updated weights for policy 1, policy_version 1469362 (0.0006) [2023-12-28 05:47:47,831][106226] Updated weights for policy 0, policy_version 1465960 (0.0009) [2023-12-28 05:47:47,894][106226] Updated weights for policy 0, policy_version 1465970 (0.0009) [2023-12-28 05:47:47,949][106226] Updated weights for policy 0, policy_version 1465980 (0.0009) [2023-12-28 05:47:48,022][106225] Updated weights for policy 1, policy_version 1469372 (0.0009) [2023-12-28 05:47:48,079][106225] Updated weights for policy 1, policy_version 1469382 (0.0010) [2023-12-28 05:47:48,129][106225] Updated weights for policy 1, policy_version 1469392 (0.0010) [2023-12-28 05:47:48,676][106226] Updated weights for policy 0, policy_version 1465990 (0.0008) [2023-12-28 05:47:48,733][106226] Updated weights for policy 0, policy_version 1466000 (0.0008) [2023-12-28 05:47:48,794][106226] Updated weights for policy 0, policy_version 1466010 (0.0008) [2023-12-28 05:47:48,886][106225] Updated weights for policy 1, policy_version 1469402 (0.0010) [2023-12-28 05:47:48,949][106225] Updated weights for policy 1, policy_version 1469412 (0.0011) [2023-12-28 05:47:49,009][106225] Updated weights for policy 1, policy_version 1469422 (0.0010) [2023-12-28 05:47:49,069][106225] Updated weights for policy 1, policy_version 1469432 (0.0010) [2023-12-28 05:47:49,523][106226] Updated weights for policy 0, policy_version 1466020 (0.0008) [2023-12-28 05:47:49,588][106226] Updated weights for policy 0, policy_version 1466030 (0.0008) [2023-12-28 05:47:49,650][106226] Updated weights for policy 0, policy_version 1466040 (0.0008) [2023-12-28 05:47:49,814][106225] Updated weights for policy 1, policy_version 1469442 (0.0011) [2023-12-28 05:47:49,885][106225] Updated weights for policy 1, policy_version 1469452 (0.0008) [2023-12-28 05:47:49,951][106225] Updated weights for policy 1, policy_version 1469462 (0.0007) [2023-12-28 05:47:50,413][106226] Updated weights for policy 0, policy_version 1466050 (0.0008) [2023-12-28 05:47:50,479][106226] Updated weights for policy 0, policy_version 1466060 (0.0010) [2023-12-28 05:47:50,533][106226] Updated weights for policy 0, policy_version 1466070 (0.0009) [2023-12-28 05:47:50,620][106226] Updated weights for policy 0, policy_version 1466080 (0.0009) [2023-12-28 05:47:50,624][106225] Updated weights for policy 1, policy_version 1469472 (0.0007) [2023-12-28 05:47:50,687][106225] Updated weights for policy 1, policy_version 1469482 (0.0006) [2023-12-28 05:47:50,749][106225] Updated weights for policy 1, policy_version 1469492 (0.0009) [2023-12-28 05:47:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 751632384. Throughput: 0: 9856.4, 1: 10044.3. Samples: 751643164. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:47:51,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.649')] [2023-12-28 05:47:51,285][106226] Updated weights for policy 0, policy_version 1466090 (0.0007) [2023-12-28 05:47:51,335][106226] Updated weights for policy 0, policy_version 1466100 (0.0007) [2023-12-28 05:47:51,411][106226] Updated weights for policy 0, policy_version 1466110 (0.0008) [2023-12-28 05:47:51,524][106225] Updated weights for policy 1, policy_version 1469502 (0.0008) [2023-12-28 05:47:51,592][106225] Updated weights for policy 1, policy_version 1469512 (0.0006) [2023-12-28 05:47:51,658][106225] Updated weights for policy 1, policy_version 1469522 (0.0008) [2023-12-28 05:47:52,083][106226] Updated weights for policy 0, policy_version 1466120 (0.0006) [2023-12-28 05:47:52,144][106226] Updated weights for policy 0, policy_version 1466130 (0.0006) [2023-12-28 05:47:52,213][106226] Updated weights for policy 0, policy_version 1466140 (0.0006) [2023-12-28 05:47:52,316][106225] Updated weights for policy 1, policy_version 1469532 (0.0011) [2023-12-28 05:47:52,379][106225] Updated weights for policy 1, policy_version 1469542 (0.0011) [2023-12-28 05:47:52,442][106225] Updated weights for policy 1, policy_version 1469552 (0.0011) [2023-12-28 05:47:52,894][106226] Updated weights for policy 0, policy_version 1466150 (0.0010) [2023-12-28 05:47:52,943][106226] Updated weights for policy 0, policy_version 1466160 (0.0011) [2023-12-28 05:47:52,990][106226] Updated weights for policy 0, policy_version 1466170 (0.0010) [2023-12-28 05:47:53,151][106225] Updated weights for policy 1, policy_version 1469562 (0.0009) [2023-12-28 05:47:53,213][106225] Updated weights for policy 1, policy_version 1469572 (0.0006) [2023-12-28 05:47:53,269][106225] Updated weights for policy 1, policy_version 1469582 (0.0005) [2023-12-28 05:47:53,327][106225] Updated weights for policy 1, policy_version 1469592 (0.0005) [2023-12-28 05:47:53,737][106226] Updated weights for policy 0, policy_version 1466180 (0.0009) [2023-12-28 05:47:53,787][106226] Updated weights for policy 0, policy_version 1466190 (0.0008) [2023-12-28 05:47:53,835][106226] Updated weights for policy 0, policy_version 1466200 (0.0008) [2023-12-28 05:47:53,927][106225] Updated weights for policy 1, policy_version 1469602 (0.0010) [2023-12-28 05:47:53,983][106225] Updated weights for policy 1, policy_version 1469612 (0.0010) [2023-12-28 05:47:54,039][106225] Updated weights for policy 1, policy_version 1469622 (0.0010) [2023-12-28 05:47:54,599][106226] Updated weights for policy 0, policy_version 1466210 (0.0008) [2023-12-28 05:47:54,648][106226] Updated weights for policy 0, policy_version 1466220 (0.0008) [2023-12-28 05:47:54,697][106226] Updated weights for policy 0, policy_version 1466230 (0.0008) [2023-12-28 05:47:54,718][106225] Updated weights for policy 1, policy_version 1469632 (0.0008) [2023-12-28 05:47:54,752][106226] Updated weights for policy 0, policy_version 1466240 (0.0006) [2023-12-28 05:47:54,779][106225] Updated weights for policy 1, policy_version 1469642 (0.0006) [2023-12-28 05:47:54,839][106225] Updated weights for policy 1, policy_version 1469652 (0.0008) [2023-12-28 05:47:55,432][106225] Updated weights for policy 1, policy_version 1469662 (0.0007) [2023-12-28 05:47:55,471][106226] Updated weights for policy 0, policy_version 1466250 (0.0007) [2023-12-28 05:47:55,488][106225] Updated weights for policy 1, policy_version 1469672 (0.0005) [2023-12-28 05:47:55,521][106226] Updated weights for policy 0, policy_version 1466260 (0.0007) [2023-12-28 05:47:55,547][106225] Updated weights for policy 1, policy_version 1469682 (0.0005) [2023-12-28 05:47:55,577][106226] Updated weights for policy 0, policy_version 1466270 (0.0008) [2023-12-28 05:47:56,148][106225] Updated weights for policy 1, policy_version 1469692 (0.0005) [2023-12-28 05:47:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 751730688. Throughput: 0: 9814.6, 1: 10031.4. Samples: 751702668. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:47:56,176][105115] Avg episode reward: [(0, '-5.017'), (1, '-4.939')] [2023-12-28 05:47:56,203][106225] Updated weights for policy 1, policy_version 1469702 (0.0006) [2023-12-28 05:47:56,224][106226] Updated weights for policy 0, policy_version 1466280 (0.0006) [2023-12-28 05:47:56,260][106225] Updated weights for policy 1, policy_version 1469712 (0.0005) [2023-12-28 05:47:56,282][106226] Updated weights for policy 0, policy_version 1466290 (0.0005) [2023-12-28 05:47:56,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001469720_376299520.pth... [2023-12-28 05:47:56,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001468504_375988224.pth [2023-12-28 05:47:56,341][106226] Updated weights for policy 0, policy_version 1466300 (0.0005) [2023-12-28 05:47:56,367][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001466304_375447552.pth... [2023-12-28 05:47:56,371][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001465152_375152640.pth [2023-12-28 05:47:56,818][106225] Updated weights for policy 1, policy_version 1469722 (0.0005) [2023-12-28 05:47:56,824][106226] Updated weights for policy 0, policy_version 1466310 (0.0007) [2023-12-28 05:47:56,877][106226] Updated weights for policy 0, policy_version 1466320 (0.0008) [2023-12-28 05:47:56,883][106225] Updated weights for policy 1, policy_version 1469732 (0.0005) [2023-12-28 05:47:56,926][106226] Updated weights for policy 0, policy_version 1466330 (0.0008) [2023-12-28 05:47:56,941][106225] Updated weights for policy 1, policy_version 1469742 (0.0005) [2023-12-28 05:47:56,985][106225] Updated weights for policy 1, policy_version 1469752 (0.0008) [2023-12-28 05:47:57,547][106225] Updated weights for policy 1, policy_version 1469762 (0.0005) [2023-12-28 05:47:57,593][106225] Updated weights for policy 1, policy_version 1469772 (0.0005) [2023-12-28 05:47:57,639][106225] Updated weights for policy 1, policy_version 1469782 (0.0005) [2023-12-28 05:47:57,646][106226] Updated weights for policy 0, policy_version 1466340 (0.0006) [2023-12-28 05:47:57,704][106226] Updated weights for policy 0, policy_version 1466350 (0.0005) [2023-12-28 05:47:57,759][106226] Updated weights for policy 0, policy_version 1466360 (0.0005) [2023-12-28 05:47:58,296][106226] Updated weights for policy 0, policy_version 1466370 (0.0006) [2023-12-28 05:47:58,308][106225] Updated weights for policy 1, policy_version 1469792 (0.0009) [2023-12-28 05:47:58,362][106226] Updated weights for policy 0, policy_version 1466380 (0.0008) [2023-12-28 05:47:58,381][106225] Updated weights for policy 1, policy_version 1469803 (0.0008) [2023-12-28 05:47:58,426][106226] Updated weights for policy 0, policy_version 1466390 (0.0008) [2023-12-28 05:47:58,452][106225] Updated weights for policy 1, policy_version 1469813 (0.0008) [2023-12-28 05:47:58,494][106226] Updated weights for policy 0, policy_version 1466400 (0.0008) [2023-12-28 05:47:59,373][106225] Updated weights for policy 1, policy_version 1469823 (0.0009) [2023-12-28 05:47:59,420][106226] Updated weights for policy 0, policy_version 1466410 (0.0009) [2023-12-28 05:47:59,433][106225] Updated weights for policy 1, policy_version 1469833 (0.0008) [2023-12-28 05:47:59,475][106226] Updated weights for policy 0, policy_version 1466420 (0.0007) [2023-12-28 05:47:59,484][106225] Updated weights for policy 1, policy_version 1469843 (0.0008) [2023-12-28 05:47:59,533][106226] Updated weights for policy 0, policy_version 1466430 (0.0008) [2023-12-28 05:48:00,266][106225] Updated weights for policy 1, policy_version 1469853 (0.0007) [2023-12-28 05:48:00,290][106226] Updated weights for policy 0, policy_version 1466440 (0.0008) [2023-12-28 05:48:00,315][106225] Updated weights for policy 1, policy_version 1469863 (0.0006) [2023-12-28 05:48:00,349][106226] Updated weights for policy 0, policy_version 1466450 (0.0007) [2023-12-28 05:48:00,370][106225] Updated weights for policy 1, policy_version 1469873 (0.0006) [2023-12-28 05:48:00,400][106226] Updated weights for policy 0, policy_version 1466460 (0.0006) [2023-12-28 05:48:01,054][106226] Updated weights for policy 0, policy_version 1466470 (0.0009) [2023-12-28 05:48:01,086][106225] Updated weights for policy 1, policy_version 1469883 (0.0007) [2023-12-28 05:48:01,112][106226] Updated weights for policy 0, policy_version 1466480 (0.0008) [2023-12-28 05:48:01,141][106225] Updated weights for policy 1, policy_version 1469893 (0.0006) [2023-12-28 05:48:01,174][106226] Updated weights for policy 0, policy_version 1466490 (0.0009) [2023-12-28 05:48:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 751828992. Throughput: 0: 9910.9, 1: 10092.9. Samples: 751825896. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:01,175][105115] Avg episode reward: [(0, '-4.849'), (1, '-4.677')] [2023-12-28 05:48:01,206][106225] Updated weights for policy 1, policy_version 1469903 (0.0008) [2023-12-28 05:48:01,940][106226] Updated weights for policy 0, policy_version 1466500 (0.0008) [2023-12-28 05:48:01,970][106225] Updated weights for policy 1, policy_version 1469913 (0.0008) [2023-12-28 05:48:02,002][106226] Updated weights for policy 0, policy_version 1466510 (0.0006) [2023-12-28 05:48:02,036][106225] Updated weights for policy 1, policy_version 1469923 (0.0008) [2023-12-28 05:48:02,063][106226] Updated weights for policy 0, policy_version 1466520 (0.0006) [2023-12-28 05:48:02,088][106225] Updated weights for policy 1, policy_version 1469933 (0.0009) [2023-12-28 05:48:02,137][106225] Updated weights for policy 1, policy_version 1469943 (0.0008) [2023-12-28 05:48:02,628][106226] Updated weights for policy 0, policy_version 1466530 (0.0007) [2023-12-28 05:48:02,685][106226] Updated weights for policy 0, policy_version 1466540 (0.0005) [2023-12-28 05:48:02,737][106226] Updated weights for policy 0, policy_version 1466550 (0.0010) [2023-12-28 05:48:02,787][106226] Updated weights for policy 0, policy_version 1466560 (0.0010) [2023-12-28 05:48:02,951][106225] Updated weights for policy 1, policy_version 1469953 (0.0005) [2023-12-28 05:48:03,001][106225] Updated weights for policy 1, policy_version 1469963 (0.0006) [2023-12-28 05:48:03,051][106225] Updated weights for policy 1, policy_version 1469973 (0.0005) [2023-12-28 05:48:03,490][106226] Updated weights for policy 0, policy_version 1466570 (0.0006) [2023-12-28 05:48:03,537][106226] Updated weights for policy 0, policy_version 1466580 (0.0010) [2023-12-28 05:48:03,592][106226] Updated weights for policy 0, policy_version 1466590 (0.0008) [2023-12-28 05:48:03,599][106225] Updated weights for policy 1, policy_version 1469983 (0.0005) [2023-12-28 05:48:03,660][106225] Updated weights for policy 1, policy_version 1469993 (0.0005) [2023-12-28 05:48:03,718][106225] Updated weights for policy 1, policy_version 1470003 (0.0005) [2023-12-28 05:48:04,306][106226] Updated weights for policy 0, policy_version 1466600 (0.0009) [2023-12-28 05:48:04,327][106225] Updated weights for policy 1, policy_version 1470013 (0.0008) [2023-12-28 05:48:04,367][106226] Updated weights for policy 0, policy_version 1466610 (0.0007) [2023-12-28 05:48:04,392][106225] Updated weights for policy 1, policy_version 1470023 (0.0011) [2023-12-28 05:48:04,429][106226] Updated weights for policy 0, policy_version 1466620 (0.0011) [2023-12-28 05:48:04,457][106225] Updated weights for policy 1, policy_version 1470033 (0.0010) [2023-12-28 05:48:05,079][106225] Updated weights for policy 1, policy_version 1470043 (0.0010) [2023-12-28 05:48:05,104][106226] Updated weights for policy 0, policy_version 1466630 (0.0008) [2023-12-28 05:48:05,133][106225] Updated weights for policy 1, policy_version 1470053 (0.0007) [2023-12-28 05:48:05,153][106226] Updated weights for policy 0, policy_version 1466640 (0.0006) [2023-12-28 05:48:05,201][106225] Updated weights for policy 1, policy_version 1470063 (0.0008) [2023-12-28 05:48:05,201][106226] Updated weights for policy 0, policy_version 1466650 (0.0006) [2023-12-28 05:48:05,848][106226] Updated weights for policy 0, policy_version 1466660 (0.0006) [2023-12-28 05:48:05,900][106226] Updated weights for policy 0, policy_version 1466670 (0.0008) [2023-12-28 05:48:05,918][106225] Updated weights for policy 1, policy_version 1470073 (0.0008) [2023-12-28 05:48:05,956][106226] Updated weights for policy 0, policy_version 1466680 (0.0007) [2023-12-28 05:48:05,970][106225] Updated weights for policy 1, policy_version 1470083 (0.0007) [2023-12-28 05:48:06,024][106225] Updated weights for policy 1, policy_version 1470093 (0.0005) [2023-12-28 05:48:06,080][106225] Updated weights for policy 1, policy_version 1470103 (0.0005) [2023-12-28 05:48:06,175][105115] Fps is (10 sec: 21299.4, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 751943680. Throughput: 0: 9913.7, 1: 10141.4. Samples: 751946688. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:06,176][105115] Avg episode reward: [(0, '-4.942'), (1, '-4.662')] [2023-12-28 05:48:06,677][106226] Updated weights for policy 0, policy_version 1466690 (0.0007) [2023-12-28 05:48:06,735][106226] Updated weights for policy 0, policy_version 1466700 (0.0007) [2023-12-28 05:48:06,748][106225] Updated weights for policy 1, policy_version 1470113 (0.0006) [2023-12-28 05:48:06,795][106226] Updated weights for policy 0, policy_version 1466710 (0.0007) [2023-12-28 05:48:06,805][106225] Updated weights for policy 1, policy_version 1470123 (0.0008) [2023-12-28 05:48:06,854][106226] Updated weights for policy 0, policy_version 1466720 (0.0008) [2023-12-28 05:48:06,860][106225] Updated weights for policy 1, policy_version 1470133 (0.0009) [2023-12-28 05:48:07,468][106225] Updated weights for policy 1, policy_version 1470143 (0.0010) [2023-12-28 05:48:07,515][106225] Updated weights for policy 1, policy_version 1470153 (0.0010) [2023-12-28 05:48:07,565][106225] Updated weights for policy 1, policy_version 1470163 (0.0010) [2023-12-28 05:48:07,602][106226] Updated weights for policy 0, policy_version 1466730 (0.0006) [2023-12-28 05:48:07,655][106226] Updated weights for policy 0, policy_version 1466740 (0.0008) [2023-12-28 05:48:07,703][106226] Updated weights for policy 0, policy_version 1466750 (0.0008) [2023-12-28 05:48:08,187][106225] Updated weights for policy 1, policy_version 1470173 (0.0008) [2023-12-28 05:48:08,249][106225] Updated weights for policy 1, policy_version 1470183 (0.0009) [2023-12-28 05:48:08,299][106225] Updated weights for policy 1, policy_version 1470193 (0.0010) [2023-12-28 05:48:08,496][106226] Updated weights for policy 0, policy_version 1466760 (0.0006) [2023-12-28 05:48:08,564][106226] Updated weights for policy 0, policy_version 1466770 (0.0007) [2023-12-28 05:48:08,629][106226] Updated weights for policy 0, policy_version 1466780 (0.0007) [2023-12-28 05:48:08,964][106225] Updated weights for policy 1, policy_version 1470203 (0.0009) [2023-12-28 05:48:09,026][106225] Updated weights for policy 1, policy_version 1470213 (0.0010) [2023-12-28 05:48:09,087][106225] Updated weights for policy 1, policy_version 1470223 (0.0010) [2023-12-28 05:48:09,316][106226] Updated weights for policy 0, policy_version 1466790 (0.0006) [2023-12-28 05:48:09,397][106226] Updated weights for policy 0, policy_version 1466800 (0.0010) [2023-12-28 05:48:09,467][106226] Updated weights for policy 0, policy_version 1466810 (0.0008) [2023-12-28 05:48:09,829][106225] Updated weights for policy 1, policy_version 1470233 (0.0011) [2023-12-28 05:48:09,895][106225] Updated weights for policy 1, policy_version 1470243 (0.0009) [2023-12-28 05:48:09,965][106225] Updated weights for policy 1, policy_version 1470253 (0.0009) [2023-12-28 05:48:10,027][106225] Updated weights for policy 1, policy_version 1470263 (0.0007) [2023-12-28 05:48:10,159][106226] Updated weights for policy 0, policy_version 1466820 (0.0009) [2023-12-28 05:48:10,223][106226] Updated weights for policy 0, policy_version 1466830 (0.0006) [2023-12-28 05:48:10,280][106226] Updated weights for policy 0, policy_version 1466840 (0.0006) [2023-12-28 05:48:10,668][106225] Updated weights for policy 1, policy_version 1470273 (0.0005) [2023-12-28 05:48:10,718][106225] Updated weights for policy 1, policy_version 1470283 (0.0005) [2023-12-28 05:48:10,772][106225] Updated weights for policy 1, policy_version 1470293 (0.0005) [2023-12-28 05:48:10,910][106226] Updated weights for policy 0, policy_version 1466850 (0.0009) [2023-12-28 05:48:10,959][106226] Updated weights for policy 0, policy_version 1466860 (0.0008) [2023-12-28 05:48:11,007][106226] Updated weights for policy 0, policy_version 1466870 (0.0008) [2023-12-28 05:48:11,070][106226] Updated weights for policy 0, policy_version 1466880 (0.0008) [2023-12-28 05:48:11,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 752041984. Throughput: 0: 9875.9, 1: 10246.4. Samples: 752007492. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:11,175][105115] Avg episode reward: [(0, '-4.922'), (1, '-4.797')] [2023-12-28 05:48:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001466880_375595008.pth... [2023-12-28 05:48:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001470296_376446976.pth... [2023-12-28 05:48:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001469112_376143872.pth [2023-12-28 05:48:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001465728_375300096.pth [2023-12-28 05:48:11,518][106225] Updated weights for policy 1, policy_version 1470304 (0.0008) [2023-12-28 05:48:11,582][106225] Updated weights for policy 1, policy_version 1470314 (0.0009) [2023-12-28 05:48:11,640][106225] Updated weights for policy 1, policy_version 1470324 (0.0009) [2023-12-28 05:48:11,865][106226] Updated weights for policy 0, policy_version 1466890 (0.0009) [2023-12-28 05:48:11,919][106226] Updated weights for policy 0, policy_version 1466900 (0.0008) [2023-12-28 05:48:11,981][106226] Updated weights for policy 0, policy_version 1466910 (0.0008) [2023-12-28 05:48:12,435][106225] Updated weights for policy 1, policy_version 1470334 (0.0009) [2023-12-28 05:48:12,492][106225] Updated weights for policy 1, policy_version 1470344 (0.0008) [2023-12-28 05:48:12,542][106225] Updated weights for policy 1, policy_version 1470354 (0.0008) [2023-12-28 05:48:12,732][106226] Updated weights for policy 0, policy_version 1466920 (0.0008) [2023-12-28 05:48:12,791][106226] Updated weights for policy 0, policy_version 1466930 (0.0009) [2023-12-28 05:48:12,842][106226] Updated weights for policy 0, policy_version 1466940 (0.0008) [2023-12-28 05:48:13,266][106225] Updated weights for policy 1, policy_version 1470364 (0.0010) [2023-12-28 05:48:13,333][106225] Updated weights for policy 1, policy_version 1470374 (0.0010) [2023-12-28 05:48:13,393][106225] Updated weights for policy 1, policy_version 1470384 (0.0010) [2023-12-28 05:48:13,429][106226] Updated weights for policy 0, policy_version 1466950 (0.0006) [2023-12-28 05:48:13,491][106226] Updated weights for policy 0, policy_version 1466960 (0.0006) [2023-12-28 05:48:13,544][106226] Updated weights for policy 0, policy_version 1466970 (0.0006) [2023-12-28 05:48:14,066][106225] Updated weights for policy 1, policy_version 1470394 (0.0009) [2023-12-28 05:48:14,123][106225] Updated weights for policy 1, policy_version 1470404 (0.0008) [2023-12-28 05:48:14,178][106225] Updated weights for policy 1, policy_version 1470414 (0.0007) [2023-12-28 05:48:14,243][106225] Updated weights for policy 1, policy_version 1470424 (0.0005) [2023-12-28 05:48:14,266][106226] Updated weights for policy 0, policy_version 1466980 (0.0007) [2023-12-28 05:48:14,328][106226] Updated weights for policy 0, policy_version 1466990 (0.0011) [2023-12-28 05:48:14,378][106226] Updated weights for policy 0, policy_version 1467000 (0.0009) [2023-12-28 05:48:14,826][106225] Updated weights for policy 1, policy_version 1470434 (0.0008) [2023-12-28 05:48:14,884][106225] Updated weights for policy 1, policy_version 1470444 (0.0007) [2023-12-28 05:48:14,942][106225] Updated weights for policy 1, policy_version 1470454 (0.0008) [2023-12-28 05:48:15,205][106226] Updated weights for policy 0, policy_version 1467010 (0.0010) [2023-12-28 05:48:15,260][106226] Updated weights for policy 0, policy_version 1467020 (0.0010) [2023-12-28 05:48:15,311][106226] Updated weights for policy 0, policy_version 1467030 (0.0011) [2023-12-28 05:48:15,372][106226] Updated weights for policy 0, policy_version 1467040 (0.0011) [2023-12-28 05:48:15,673][106225] Updated weights for policy 1, policy_version 1470464 (0.0008) [2023-12-28 05:48:15,725][106225] Updated weights for policy 1, policy_version 1470474 (0.0008) [2023-12-28 05:48:15,782][106225] Updated weights for policy 1, policy_version 1470484 (0.0008) [2023-12-28 05:48:16,109][106226] Updated weights for policy 0, policy_version 1467050 (0.0011) [2023-12-28 05:48:16,173][106226] Updated weights for policy 0, policy_version 1467060 (0.0011) [2023-12-28 05:48:16,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 752132096. Throughput: 0: 9786.2, 1: 10136.0. Samples: 752125612. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:16,175][105115] Avg episode reward: [(0, '-5.110'), (1, '-4.435')] [2023-12-28 05:48:16,222][106226] Updated weights for policy 0, policy_version 1467070 (0.0011) [2023-12-28 05:48:16,520][106225] Updated weights for policy 1, policy_version 1470494 (0.0008) [2023-12-28 05:48:16,580][106225] Updated weights for policy 1, policy_version 1470504 (0.0007) [2023-12-28 05:48:16,632][106225] Updated weights for policy 1, policy_version 1470514 (0.0007) [2023-12-28 05:48:16,933][106226] Updated weights for policy 0, policy_version 1467080 (0.0010) [2023-12-28 05:48:16,979][106226] Updated weights for policy 0, policy_version 1467090 (0.0010) [2023-12-28 05:48:17,032][106226] Updated weights for policy 0, policy_version 1467100 (0.0010) [2023-12-28 05:48:17,353][106225] Updated weights for policy 1, policy_version 1470524 (0.0007) [2023-12-28 05:48:17,419][106225] Updated weights for policy 1, policy_version 1470534 (0.0008) [2023-12-28 05:48:17,476][106225] Updated weights for policy 1, policy_version 1470544 (0.0008) [2023-12-28 05:48:17,769][106226] Updated weights for policy 0, policy_version 1467110 (0.0010) [2023-12-28 05:48:17,825][106226] Updated weights for policy 0, policy_version 1467120 (0.0010) [2023-12-28 05:48:17,872][106226] Updated weights for policy 0, policy_version 1467130 (0.0010) [2023-12-28 05:48:18,222][106225] Updated weights for policy 1, policy_version 1470554 (0.0008) [2023-12-28 05:48:18,280][106225] Updated weights for policy 1, policy_version 1470564 (0.0008) [2023-12-28 05:48:18,347][106225] Updated weights for policy 1, policy_version 1470574 (0.0008) [2023-12-28 05:48:18,409][106225] Updated weights for policy 1, policy_version 1470584 (0.0008) [2023-12-28 05:48:18,531][106226] Updated weights for policy 0, policy_version 1467140 (0.0009) [2023-12-28 05:48:18,595][106226] Updated weights for policy 0, policy_version 1467150 (0.0008) [2023-12-28 05:48:18,657][106226] Updated weights for policy 0, policy_version 1467160 (0.0008) [2023-12-28 05:48:19,098][106225] Updated weights for policy 1, policy_version 1470594 (0.0007) [2023-12-28 05:48:19,159][106225] Updated weights for policy 1, policy_version 1470604 (0.0007) [2023-12-28 05:48:19,220][106225] Updated weights for policy 1, policy_version 1470614 (0.0008) [2023-12-28 05:48:19,448][106226] Updated weights for policy 0, policy_version 1467170 (0.0008) [2023-12-28 05:48:19,509][106226] Updated weights for policy 0, policy_version 1467180 (0.0007) [2023-12-28 05:48:19,574][106226] Updated weights for policy 0, policy_version 1467190 (0.0009) [2023-12-28 05:48:19,636][106226] Updated weights for policy 0, policy_version 1467200 (0.0009) [2023-12-28 05:48:19,964][106225] Updated weights for policy 1, policy_version 1470624 (0.0007) [2023-12-28 05:48:20,032][106225] Updated weights for policy 1, policy_version 1470634 (0.0007) [2023-12-28 05:48:20,098][106225] Updated weights for policy 1, policy_version 1470644 (0.0009) [2023-12-28 05:48:20,375][106226] Updated weights for policy 0, policy_version 1467210 (0.0008) [2023-12-28 05:48:20,444][106226] Updated weights for policy 0, policy_version 1467220 (0.0008) [2023-12-28 05:48:20,507][106226] Updated weights for policy 0, policy_version 1467230 (0.0008) [2023-12-28 05:48:20,849][106225] Updated weights for policy 1, policy_version 1470654 (0.0008) [2023-12-28 05:48:20,901][106225] Updated weights for policy 1, policy_version 1470664 (0.0007) [2023-12-28 05:48:20,961][106225] Updated weights for policy 1, policy_version 1470674 (0.0008) [2023-12-28 05:48:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 752230400. Throughput: 0: 9660.3, 1: 10052.9. Samples: 752240152. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:21,175][105115] Avg episode reward: [(0, '-4.941'), (1, '-4.547')] [2023-12-28 05:48:21,186][106226] Updated weights for policy 0, policy_version 1467240 (0.0010) [2023-12-28 05:48:21,253][106226] Updated weights for policy 0, policy_version 1467250 (0.0011) [2023-12-28 05:48:21,320][106226] Updated weights for policy 0, policy_version 1467260 (0.0009) [2023-12-28 05:48:21,768][106225] Updated weights for policy 1, policy_version 1470684 (0.0008) [2023-12-28 05:48:21,820][106225] Updated weights for policy 1, policy_version 1470694 (0.0007) [2023-12-28 05:48:21,879][106225] Updated weights for policy 1, policy_version 1470704 (0.0007) [2023-12-28 05:48:22,102][106226] Updated weights for policy 0, policy_version 1467270 (0.0009) [2023-12-28 05:48:22,167][106226] Updated weights for policy 0, policy_version 1467280 (0.0010) [2023-12-28 05:48:22,227][106226] Updated weights for policy 0, policy_version 1467290 (0.0011) [2023-12-28 05:48:22,616][106225] Updated weights for policy 1, policy_version 1470714 (0.0008) [2023-12-28 05:48:22,674][106225] Updated weights for policy 1, policy_version 1470724 (0.0007) [2023-12-28 05:48:22,734][106225] Updated weights for policy 1, policy_version 1470734 (0.0007) [2023-12-28 05:48:22,792][106225] Updated weights for policy 1, policy_version 1470744 (0.0008) [2023-12-28 05:48:22,930][106226] Updated weights for policy 0, policy_version 1467300 (0.0010) [2023-12-28 05:48:22,982][106226] Updated weights for policy 0, policy_version 1467310 (0.0008) [2023-12-28 05:48:23,036][106226] Updated weights for policy 0, policy_version 1467320 (0.0009) [2023-12-28 05:48:23,529][106225] Updated weights for policy 1, policy_version 1470754 (0.0009) [2023-12-28 05:48:23,577][106225] Updated weights for policy 1, policy_version 1470764 (0.0005) [2023-12-28 05:48:23,635][106225] Updated weights for policy 1, policy_version 1470774 (0.0005) [2023-12-28 05:48:23,824][106226] Updated weights for policy 0, policy_version 1467330 (0.0009) [2023-12-28 05:48:23,877][106226] Updated weights for policy 0, policy_version 1467340 (0.0008) [2023-12-28 05:48:23,930][106226] Updated weights for policy 0, policy_version 1467350 (0.0011) [2023-12-28 05:48:23,993][106226] Updated weights for policy 0, policy_version 1467360 (0.0011) [2023-12-28 05:48:24,207][106225] Updated weights for policy 1, policy_version 1470784 (0.0008) [2023-12-28 05:48:24,264][106225] Updated weights for policy 1, policy_version 1470794 (0.0008) [2023-12-28 05:48:24,319][106225] Updated weights for policy 1, policy_version 1470804 (0.0008) [2023-12-28 05:48:24,678][106226] Updated weights for policy 0, policy_version 1467370 (0.0007) [2023-12-28 05:48:24,726][106226] Updated weights for policy 0, policy_version 1467380 (0.0009) [2023-12-28 05:48:24,771][106226] Updated weights for policy 0, policy_version 1467390 (0.0006) [2023-12-28 05:48:25,089][106225] Updated weights for policy 1, policy_version 1470814 (0.0008) [2023-12-28 05:48:25,144][106225] Updated weights for policy 1, policy_version 1470824 (0.0008) [2023-12-28 05:48:25,203][106225] Updated weights for policy 1, policy_version 1470834 (0.0008) [2023-12-28 05:48:25,463][106226] Updated weights for policy 0, policy_version 1467400 (0.0006) [2023-12-28 05:48:25,528][106226] Updated weights for policy 0, policy_version 1467410 (0.0006) [2023-12-28 05:48:25,590][106226] Updated weights for policy 0, policy_version 1467420 (0.0009) [2023-12-28 05:48:25,922][106225] Updated weights for policy 1, policy_version 1470844 (0.0010) [2023-12-28 05:48:25,976][106225] Updated weights for policy 1, policy_version 1470854 (0.0008) [2023-12-28 05:48:26,024][106225] Updated weights for policy 1, policy_version 1470864 (0.0008) [2023-12-28 05:48:26,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 752328704. Throughput: 0: 9662.9, 1: 10001.9. Samples: 752295792. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:26,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-4.684')] [2023-12-28 05:48:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001470872_376594432.pth... [2023-12-28 05:48:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001467424_375734272.pth... [2023-12-28 05:48:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001469720_376299520.pth [2023-12-28 05:48:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001466304_375447552.pth [2023-12-28 05:48:26,255][106226] Updated weights for policy 0, policy_version 1467430 (0.0009) [2023-12-28 05:48:26,320][106226] Updated weights for policy 0, policy_version 1467440 (0.0009) [2023-12-28 05:48:26,380][106226] Updated weights for policy 0, policy_version 1467450 (0.0009) [2023-12-28 05:48:26,729][106225] Updated weights for policy 1, policy_version 1470874 (0.0007) [2023-12-28 05:48:26,784][106225] Updated weights for policy 1, policy_version 1470884 (0.0008) [2023-12-28 05:48:26,830][106225] Updated weights for policy 1, policy_version 1470894 (0.0008) [2023-12-28 05:48:26,873][106225] Updated weights for policy 1, policy_version 1470904 (0.0008) [2023-12-28 05:48:27,117][106226] Updated weights for policy 0, policy_version 1467460 (0.0009) [2023-12-28 05:48:27,161][106226] Updated weights for policy 0, policy_version 1467470 (0.0008) [2023-12-28 05:48:27,209][106226] Updated weights for policy 0, policy_version 1467480 (0.0008) [2023-12-28 05:48:27,569][106225] Updated weights for policy 1, policy_version 1470914 (0.0008) [2023-12-28 05:48:27,616][106225] Updated weights for policy 1, policy_version 1470924 (0.0008) [2023-12-28 05:48:27,673][106225] Updated weights for policy 1, policy_version 1470934 (0.0007) [2023-12-28 05:48:27,971][106226] Updated weights for policy 0, policy_version 1467490 (0.0009) [2023-12-28 05:48:28,029][106226] Updated weights for policy 0, policy_version 1467500 (0.0008) [2023-12-28 05:48:28,088][106226] Updated weights for policy 0, policy_version 1467510 (0.0008) [2023-12-28 05:48:28,149][106226] Updated weights for policy 0, policy_version 1467520 (0.0008) [2023-12-28 05:48:28,380][106225] Updated weights for policy 1, policy_version 1470944 (0.0010) [2023-12-28 05:48:28,428][106225] Updated weights for policy 1, policy_version 1470954 (0.0008) [2023-12-28 05:48:28,477][106225] Updated weights for policy 1, policy_version 1470964 (0.0008) [2023-12-28 05:48:28,837][106226] Updated weights for policy 0, policy_version 1467530 (0.0008) [2023-12-28 05:48:28,905][106226] Updated weights for policy 0, policy_version 1467540 (0.0008) [2023-12-28 05:48:28,968][106226] Updated weights for policy 0, policy_version 1467550 (0.0009) [2023-12-28 05:48:29,256][106225] Updated weights for policy 1, policy_version 1470974 (0.0009) [2023-12-28 05:48:29,324][106225] Updated weights for policy 1, policy_version 1470984 (0.0010) [2023-12-28 05:48:29,404][106225] Updated weights for policy 1, policy_version 1470994 (0.0009) [2023-12-28 05:48:29,655][106226] Updated weights for policy 0, policy_version 1467560 (0.0006) [2023-12-28 05:48:29,715][106226] Updated weights for policy 0, policy_version 1467570 (0.0007) [2023-12-28 05:48:29,779][106226] Updated weights for policy 0, policy_version 1467580 (0.0005) [2023-12-28 05:48:30,113][106225] Updated weights for policy 1, policy_version 1471004 (0.0006) [2023-12-28 05:48:30,162][106225] Updated weights for policy 1, policy_version 1471014 (0.0005) [2023-12-28 05:48:30,215][106225] Updated weights for policy 1, policy_version 1471024 (0.0009) [2023-12-28 05:48:30,432][106226] Updated weights for policy 0, policy_version 1467590 (0.0007) [2023-12-28 05:48:30,490][106226] Updated weights for policy 0, policy_version 1467600 (0.0009) [2023-12-28 05:48:30,545][106226] Updated weights for policy 0, policy_version 1467610 (0.0008) [2023-12-28 05:48:30,888][106225] Updated weights for policy 1, policy_version 1471034 (0.0009) [2023-12-28 05:48:30,935][106225] Updated weights for policy 1, policy_version 1471044 (0.0008) [2023-12-28 05:48:30,999][106225] Updated weights for policy 1, policy_version 1471054 (0.0005) [2023-12-28 05:48:31,068][106225] Updated weights for policy 1, policy_version 1471064 (0.0006) [2023-12-28 05:48:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 752427008. Throughput: 0: 9752.2, 1: 10005.7. Samples: 752414832. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:31,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-4.652')] [2023-12-28 05:48:31,313][106226] Updated weights for policy 0, policy_version 1467620 (0.0008) [2023-12-28 05:48:31,383][106226] Updated weights for policy 0, policy_version 1467630 (0.0008) [2023-12-28 05:48:31,447][106226] Updated weights for policy 0, policy_version 1467640 (0.0007) [2023-12-28 05:48:31,781][106225] Updated weights for policy 1, policy_version 1471074 (0.0008) [2023-12-28 05:48:31,827][106225] Updated weights for policy 1, policy_version 1471084 (0.0008) [2023-12-28 05:48:31,873][106225] Updated weights for policy 1, policy_version 1471094 (0.0008) [2023-12-28 05:48:32,121][106226] Updated weights for policy 0, policy_version 1467650 (0.0006) [2023-12-28 05:48:32,175][106226] Updated weights for policy 0, policy_version 1467660 (0.0010) [2023-12-28 05:48:32,225][106226] Updated weights for policy 0, policy_version 1467670 (0.0010) [2023-12-28 05:48:32,283][106226] Updated weights for policy 0, policy_version 1467680 (0.0011) [2023-12-28 05:48:32,604][106225] Updated weights for policy 1, policy_version 1471104 (0.0008) [2023-12-28 05:48:32,660][106225] Updated weights for policy 1, policy_version 1471114 (0.0008) [2023-12-28 05:48:32,715][106225] Updated weights for policy 1, policy_version 1471124 (0.0008) [2023-12-28 05:48:33,014][106226] Updated weights for policy 0, policy_version 1467690 (0.0005) [2023-12-28 05:48:33,068][106226] Updated weights for policy 0, policy_version 1467700 (0.0006) [2023-12-28 05:48:33,115][106226] Updated weights for policy 0, policy_version 1467710 (0.0006) [2023-12-28 05:48:33,522][106225] Updated weights for policy 1, policy_version 1471134 (0.0008) [2023-12-28 05:48:33,578][106225] Updated weights for policy 1, policy_version 1471144 (0.0006) [2023-12-28 05:48:33,634][106225] Updated weights for policy 1, policy_version 1471154 (0.0009) [2023-12-28 05:48:33,671][106226] Updated weights for policy 0, policy_version 1467720 (0.0007) [2023-12-28 05:48:33,728][106226] Updated weights for policy 0, policy_version 1467730 (0.0008) [2023-12-28 05:48:33,777][106226] Updated weights for policy 0, policy_version 1467740 (0.0010) [2023-12-28 05:48:34,341][106225] Updated weights for policy 1, policy_version 1471164 (0.0008) [2023-12-28 05:48:34,402][106225] Updated weights for policy 1, policy_version 1471174 (0.0007) [2023-12-28 05:48:34,435][106226] Updated weights for policy 0, policy_version 1467750 (0.0011) [2023-12-28 05:48:34,463][106225] Updated weights for policy 1, policy_version 1471184 (0.0006) [2023-12-28 05:48:34,500][106226] Updated weights for policy 0, policy_version 1467760 (0.0011) [2023-12-28 05:48:34,564][106226] Updated weights for policy 0, policy_version 1467770 (0.0011) [2023-12-28 05:48:35,160][106225] Updated weights for policy 1, policy_version 1471194 (0.0008) [2023-12-28 05:48:35,190][106226] Updated weights for policy 0, policy_version 1467780 (0.0007) [2023-12-28 05:48:35,206][106225] Updated weights for policy 1, policy_version 1471204 (0.0008) [2023-12-28 05:48:35,244][106226] Updated weights for policy 0, policy_version 1467790 (0.0005) [2023-12-28 05:48:35,262][106225] Updated weights for policy 1, policy_version 1471214 (0.0008) [2023-12-28 05:48:35,302][106226] Updated weights for policy 0, policy_version 1467800 (0.0005) [2023-12-28 05:48:35,326][106225] Updated weights for policy 1, policy_version 1471224 (0.0008) [2023-12-28 05:48:35,885][106226] Updated weights for policy 0, policy_version 1467810 (0.0006) [2023-12-28 05:48:35,942][106226] Updated weights for policy 0, policy_version 1467820 (0.0010) [2023-12-28 05:48:35,996][106226] Updated weights for policy 0, policy_version 1467830 (0.0011) [2023-12-28 05:48:36,037][106225] Updated weights for policy 1, policy_version 1471234 (0.0007) [2023-12-28 05:48:36,047][106226] Updated weights for policy 0, policy_version 1467840 (0.0010) [2023-12-28 05:48:36,096][106225] Updated weights for policy 1, policy_version 1471244 (0.0010) [2023-12-28 05:48:36,156][106225] Updated weights for policy 1, policy_version 1471254 (0.0008) [2023-12-28 05:48:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 752533504. Throughput: 0: 9915.5, 1: 9906.9. Samples: 752535172. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:36,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-4.577')] [2023-12-28 05:48:36,785][106226] Updated weights for policy 0, policy_version 1467850 (0.0007) [2023-12-28 05:48:36,852][106226] Updated weights for policy 0, policy_version 1467860 (0.0008) [2023-12-28 05:48:36,910][106225] Updated weights for policy 1, policy_version 1471264 (0.0007) [2023-12-28 05:48:36,923][106226] Updated weights for policy 0, policy_version 1467870 (0.0008) [2023-12-28 05:48:36,963][106225] Updated weights for policy 1, policy_version 1471274 (0.0008) [2023-12-28 05:48:37,029][106225] Updated weights for policy 1, policy_version 1471284 (0.0008) [2023-12-28 05:48:37,450][106226] Updated weights for policy 0, policy_version 1467880 (0.0007) [2023-12-28 05:48:37,498][106226] Updated weights for policy 0, policy_version 1467890 (0.0006) [2023-12-28 05:48:37,545][106226] Updated weights for policy 0, policy_version 1467900 (0.0006) [2023-12-28 05:48:37,758][106225] Updated weights for policy 1, policy_version 1471294 (0.0009) [2023-12-28 05:48:37,814][106225] Updated weights for policy 1, policy_version 1471304 (0.0011) [2023-12-28 05:48:37,874][106225] Updated weights for policy 1, policy_version 1471314 (0.0007) [2023-12-28 05:48:38,209][106226] Updated weights for policy 0, policy_version 1467910 (0.0008) [2023-12-28 05:48:38,267][106226] Updated weights for policy 0, policy_version 1467920 (0.0008) [2023-12-28 05:48:38,330][106226] Updated weights for policy 0, policy_version 1467930 (0.0010) [2023-12-28 05:48:38,490][106225] Updated weights for policy 1, policy_version 1471324 (0.0008) [2023-12-28 05:48:38,549][106225] Updated weights for policy 1, policy_version 1471334 (0.0009) [2023-12-28 05:48:38,612][106225] Updated weights for policy 1, policy_version 1471344 (0.0009) [2023-12-28 05:48:39,065][106226] Updated weights for policy 0, policy_version 1467940 (0.0008) [2023-12-28 05:48:39,116][106226] Updated weights for policy 0, policy_version 1467950 (0.0009) [2023-12-28 05:48:39,169][106226] Updated weights for policy 0, policy_version 1467960 (0.0009) [2023-12-28 05:48:39,336][106225] Updated weights for policy 1, policy_version 1471354 (0.0009) [2023-12-28 05:48:39,409][106225] Updated weights for policy 1, policy_version 1471364 (0.0009) [2023-12-28 05:48:39,474][106225] Updated weights for policy 1, policy_version 1471374 (0.0010) [2023-12-28 05:48:39,539][106225] Updated weights for policy 1, policy_version 1471384 (0.0011) [2023-12-28 05:48:40,027][106226] Updated weights for policy 0, policy_version 1467970 (0.0008) [2023-12-28 05:48:40,099][106226] Updated weights for policy 0, policy_version 1467980 (0.0006) [2023-12-28 05:48:40,172][106226] Updated weights for policy 0, policy_version 1467990 (0.0006) [2023-12-28 05:48:40,242][106226] Updated weights for policy 0, policy_version 1468000 (0.0008) [2023-12-28 05:48:40,269][106225] Updated weights for policy 1, policy_version 1471394 (0.0011) [2023-12-28 05:48:40,332][106225] Updated weights for policy 1, policy_version 1471404 (0.0010) [2023-12-28 05:48:40,400][106225] Updated weights for policy 1, policy_version 1471414 (0.0008) [2023-12-28 05:48:40,851][106226] Updated weights for policy 0, policy_version 1468010 (0.0008) [2023-12-28 05:48:40,911][106226] Updated weights for policy 0, policy_version 1468020 (0.0008) [2023-12-28 05:48:40,980][106226] Updated weights for policy 0, policy_version 1468030 (0.0006) [2023-12-28 05:48:41,020][106225] Updated weights for policy 1, policy_version 1471424 (0.0006) [2023-12-28 05:48:41,086][106225] Updated weights for policy 1, policy_version 1471434 (0.0007) [2023-12-28 05:48:41,154][106225] Updated weights for policy 1, policy_version 1471444 (0.0009) [2023-12-28 05:48:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 752623616. Throughput: 0: 9957.3, 1: 9906.5. Samples: 752596536. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:41,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.876')] [2023-12-28 05:48:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001471448_376741888.pth... [2023-12-28 05:48:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001468032_375889920.pth... [2023-12-28 05:48:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001466880_375595008.pth [2023-12-28 05:48:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001470296_376446976.pth [2023-12-28 05:48:41,732][106226] Updated weights for policy 0, policy_version 1468040 (0.0008) [2023-12-28 05:48:41,798][106226] Updated weights for policy 0, policy_version 1468050 (0.0008) [2023-12-28 05:48:41,862][106226] Updated weights for policy 0, policy_version 1468060 (0.0009) [2023-12-28 05:48:41,935][106225] Updated weights for policy 1, policy_version 1471454 (0.0009) [2023-12-28 05:48:41,993][106225] Updated weights for policy 1, policy_version 1471464 (0.0007) [2023-12-28 05:48:42,055][106225] Updated weights for policy 1, policy_version 1471474 (0.0009) [2023-12-28 05:48:42,630][106226] Updated weights for policy 0, policy_version 1468070 (0.0009) [2023-12-28 05:48:42,690][106226] Updated weights for policy 0, policy_version 1468080 (0.0009) [2023-12-28 05:48:42,756][106226] Updated weights for policy 0, policy_version 1468090 (0.0008) [2023-12-28 05:48:42,793][106225] Updated weights for policy 1, policy_version 1471484 (0.0009) [2023-12-28 05:48:42,855][106225] Updated weights for policy 1, policy_version 1471494 (0.0005) [2023-12-28 05:48:42,908][106225] Updated weights for policy 1, policy_version 1471504 (0.0005) [2023-12-28 05:48:43,489][106226] Updated weights for policy 0, policy_version 1468100 (0.0007) [2023-12-28 05:48:43,552][106226] Updated weights for policy 0, policy_version 1468110 (0.0008) [2023-12-28 05:48:43,598][106225] Updated weights for policy 1, policy_version 1471514 (0.0007) [2023-12-28 05:48:43,614][106226] Updated weights for policy 0, policy_version 1468120 (0.0009) [2023-12-28 05:48:43,655][106225] Updated weights for policy 1, policy_version 1471524 (0.0006) [2023-12-28 05:48:43,706][106225] Updated weights for policy 1, policy_version 1471534 (0.0005) [2023-12-28 05:48:43,759][106225] Updated weights for policy 1, policy_version 1471544 (0.0005) [2023-12-28 05:48:44,381][106226] Updated weights for policy 0, policy_version 1468130 (0.0008) [2023-12-28 05:48:44,389][106225] Updated weights for policy 1, policy_version 1471554 (0.0007) [2023-12-28 05:48:44,443][106226] Updated weights for policy 0, policy_version 1468140 (0.0006) [2023-12-28 05:48:44,446][106225] Updated weights for policy 1, policy_version 1471564 (0.0007) [2023-12-28 05:48:44,505][106225] Updated weights for policy 1, policy_version 1471574 (0.0006) [2023-12-28 05:48:44,512][106226] Updated weights for policy 0, policy_version 1468150 (0.0007) [2023-12-28 05:48:44,572][106226] Updated weights for policy 0, policy_version 1468160 (0.0008) [2023-12-28 05:48:45,193][106225] Updated weights for policy 1, policy_version 1471584 (0.0007) [2023-12-28 05:48:45,249][106225] Updated weights for policy 1, policy_version 1471594 (0.0008) [2023-12-28 05:48:45,303][106225] Updated weights for policy 1, policy_version 1471604 (0.0010) [2023-12-28 05:48:45,349][106226] Updated weights for policy 0, policy_version 1468170 (0.0008) [2023-12-28 05:48:45,405][106226] Updated weights for policy 0, policy_version 1468180 (0.0008) [2023-12-28 05:48:45,468][106226] Updated weights for policy 0, policy_version 1468190 (0.0008) [2023-12-28 05:48:46,011][106225] Updated weights for policy 1, policy_version 1471614 (0.0010) [2023-12-28 05:48:46,070][106225] Updated weights for policy 1, policy_version 1471624 (0.0009) [2023-12-28 05:48:46,119][106225] Updated weights for policy 1, policy_version 1471634 (0.0008) [2023-12-28 05:48:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 752721920. Throughput: 0: 9842.8, 1: 9836.5. Samples: 752711468. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:46,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-4.898')] [2023-12-28 05:48:46,183][106226] Updated weights for policy 0, policy_version 1468200 (0.0008) [2023-12-28 05:48:46,232][106226] Updated weights for policy 0, policy_version 1468210 (0.0008) [2023-12-28 05:48:46,284][106226] Updated weights for policy 0, policy_version 1468220 (0.0008) [2023-12-28 05:48:46,792][106225] Updated weights for policy 1, policy_version 1471644 (0.0007) [2023-12-28 05:48:46,849][106225] Updated weights for policy 1, policy_version 1471654 (0.0005) [2023-12-28 05:48:46,909][106225] Updated weights for policy 1, policy_version 1471664 (0.0008) [2023-12-28 05:48:47,060][106226] Updated weights for policy 0, policy_version 1468230 (0.0007) [2023-12-28 05:48:47,125][106226] Updated weights for policy 0, policy_version 1468240 (0.0009) [2023-12-28 05:48:47,189][106226] Updated weights for policy 0, policy_version 1468250 (0.0008) [2023-12-28 05:48:47,531][106225] Updated weights for policy 1, policy_version 1471674 (0.0008) [2023-12-28 05:48:47,589][106225] Updated weights for policy 1, policy_version 1471684 (0.0008) [2023-12-28 05:48:47,643][106225] Updated weights for policy 1, policy_version 1471694 (0.0008) [2023-12-28 05:48:47,701][106225] Updated weights for policy 1, policy_version 1471704 (0.0008) [2023-12-28 05:48:47,930][106226] Updated weights for policy 0, policy_version 1468260 (0.0009) [2023-12-28 05:48:47,990][106226] Updated weights for policy 0, policy_version 1468270 (0.0011) [2023-12-28 05:48:48,055][106226] Updated weights for policy 0, policy_version 1468280 (0.0010) [2023-12-28 05:48:48,404][106225] Updated weights for policy 1, policy_version 1471714 (0.0008) [2023-12-28 05:48:48,470][106225] Updated weights for policy 1, policy_version 1471724 (0.0007) [2023-12-28 05:48:48,540][106225] Updated weights for policy 1, policy_version 1471734 (0.0009) [2023-12-28 05:48:48,723][106226] Updated weights for policy 0, policy_version 1468290 (0.0009) [2023-12-28 05:48:48,786][106226] Updated weights for policy 0, policy_version 1468300 (0.0006) [2023-12-28 05:48:48,845][106226] Updated weights for policy 0, policy_version 1468310 (0.0006) [2023-12-28 05:48:48,908][106226] Updated weights for policy 0, policy_version 1468320 (0.0006) [2023-12-28 05:48:49,374][106225] Updated weights for policy 1, policy_version 1471744 (0.0009) [2023-12-28 05:48:49,439][106225] Updated weights for policy 1, policy_version 1471754 (0.0009) [2023-12-28 05:48:49,458][106226] Updated weights for policy 0, policy_version 1468330 (0.0006) [2023-12-28 05:48:49,498][106225] Updated weights for policy 1, policy_version 1471764 (0.0008) [2023-12-28 05:48:49,517][106226] Updated weights for policy 0, policy_version 1468340 (0.0006) [2023-12-28 05:48:49,570][106226] Updated weights for policy 0, policy_version 1468350 (0.0007) [2023-12-28 05:48:50,249][106225] Updated weights for policy 1, policy_version 1471774 (0.0007) [2023-12-28 05:48:50,302][106225] Updated weights for policy 1, policy_version 1471784 (0.0006) [2023-12-28 05:48:50,341][106226] Updated weights for policy 0, policy_version 1468360 (0.0007) [2023-12-28 05:48:50,352][106225] Updated weights for policy 1, policy_version 1471794 (0.0006) [2023-12-28 05:48:50,404][106226] Updated weights for policy 0, policy_version 1468370 (0.0008) [2023-12-28 05:48:50,454][106226] Updated weights for policy 0, policy_version 1468380 (0.0009) [2023-12-28 05:48:51,029][106225] Updated weights for policy 1, policy_version 1471804 (0.0006) [2023-12-28 05:48:51,097][106225] Updated weights for policy 1, policy_version 1471814 (0.0009) [2023-12-28 05:48:51,144][106226] Updated weights for policy 0, policy_version 1468390 (0.0008) [2023-12-28 05:48:51,156][106225] Updated weights for policy 1, policy_version 1471824 (0.0007) [2023-12-28 05:48:51,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 752812032. Throughput: 0: 9784.9, 1: 9820.6. Samples: 752828936. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:51,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.758')] [2023-12-28 05:48:51,203][106226] Updated weights for policy 0, policy_version 1468400 (0.0007) [2023-12-28 05:48:51,263][106226] Updated weights for policy 0, policy_version 1468410 (0.0008) [2023-12-28 05:48:51,890][106225] Updated weights for policy 1, policy_version 1471834 (0.0008) [2023-12-28 05:48:51,947][106225] Updated weights for policy 1, policy_version 1471844 (0.0008) [2023-12-28 05:48:51,990][106226] Updated weights for policy 0, policy_version 1468420 (0.0007) [2023-12-28 05:48:52,000][106225] Updated weights for policy 1, policy_version 1471854 (0.0007) [2023-12-28 05:48:52,053][106226] Updated weights for policy 0, policy_version 1468430 (0.0009) [2023-12-28 05:48:52,059][106225] Updated weights for policy 1, policy_version 1471864 (0.0007) [2023-12-28 05:48:52,115][106226] Updated weights for policy 0, policy_version 1468440 (0.0009) [2023-12-28 05:48:52,797][106225] Updated weights for policy 1, policy_version 1471874 (0.0008) [2023-12-28 05:48:52,842][106225] Updated weights for policy 1, policy_version 1471884 (0.0008) [2023-12-28 05:48:52,852][106226] Updated weights for policy 0, policy_version 1468450 (0.0008) [2023-12-28 05:48:52,890][106225] Updated weights for policy 1, policy_version 1471894 (0.0006) [2023-12-28 05:48:52,901][106226] Updated weights for policy 0, policy_version 1468460 (0.0007) [2023-12-28 05:48:52,956][106226] Updated weights for policy 0, policy_version 1468470 (0.0008) [2023-12-28 05:48:53,012][106226] Updated weights for policy 0, policy_version 1468480 (0.0005) [2023-12-28 05:48:53,651][106226] Updated weights for policy 0, policy_version 1468490 (0.0008) [2023-12-28 05:48:53,690][106225] Updated weights for policy 1, policy_version 1471904 (0.0006) [2023-12-28 05:48:53,708][106226] Updated weights for policy 0, policy_version 1468500 (0.0007) [2023-12-28 05:48:53,753][106225] Updated weights for policy 1, policy_version 1471914 (0.0006) [2023-12-28 05:48:53,767][106226] Updated weights for policy 0, policy_version 1468510 (0.0007) [2023-12-28 05:48:53,814][106225] Updated weights for policy 1, policy_version 1471924 (0.0007) [2023-12-28 05:48:54,429][106226] Updated weights for policy 0, policy_version 1468520 (0.0005) [2023-12-28 05:48:54,479][106226] Updated weights for policy 0, policy_version 1468530 (0.0007) [2023-12-28 05:48:54,532][106225] Updated weights for policy 1, policy_version 1471934 (0.0008) [2023-12-28 05:48:54,537][106226] Updated weights for policy 0, policy_version 1468540 (0.0010) [2023-12-28 05:48:54,585][106225] Updated weights for policy 1, policy_version 1471944 (0.0007) [2023-12-28 05:48:54,640][106225] Updated weights for policy 1, policy_version 1471954 (0.0008) [2023-12-28 05:48:55,165][106226] Updated weights for policy 0, policy_version 1468550 (0.0010) [2023-12-28 05:48:55,227][106226] Updated weights for policy 0, policy_version 1468560 (0.0010) [2023-12-28 05:48:55,283][106226] Updated weights for policy 0, policy_version 1468570 (0.0010) [2023-12-28 05:48:55,432][106225] Updated weights for policy 1, policy_version 1471964 (0.0009) [2023-12-28 05:48:55,489][106225] Updated weights for policy 1, policy_version 1471974 (0.0007) [2023-12-28 05:48:55,542][106225] Updated weights for policy 1, policy_version 1471984 (0.0009) [2023-12-28 05:48:55,853][106226] Updated weights for policy 0, policy_version 1468580 (0.0005) [2023-12-28 05:48:55,916][106226] Updated weights for policy 0, policy_version 1468590 (0.0009) [2023-12-28 05:48:55,969][106226] Updated weights for policy 0, policy_version 1468600 (0.0008) [2023-12-28 05:48:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 752918528. Throughput: 0: 9799.4, 1: 9729.1. Samples: 752886272. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:48:56,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.876')] [2023-12-28 05:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001471992_376881152.pth... [2023-12-28 05:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001468608_376037376.pth... [2023-12-28 05:48:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001467424_375734272.pth [2023-12-28 05:48:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001470872_376594432.pth [2023-12-28 05:48:56,371][106225] Updated weights for policy 1, policy_version 1471994 (0.0009) [2023-12-28 05:48:56,427][106225] Updated weights for policy 1, policy_version 1472004 (0.0008) [2023-12-28 05:48:56,489][106225] Updated weights for policy 1, policy_version 1472014 (0.0008) [2023-12-28 05:48:56,513][106226] Updated weights for policy 0, policy_version 1468610 (0.0005) [2023-12-28 05:48:56,546][106225] Updated weights for policy 1, policy_version 1472024 (0.0008) [2023-12-28 05:48:56,559][106226] Updated weights for policy 0, policy_version 1468620 (0.0005) [2023-12-28 05:48:56,604][106226] Updated weights for policy 0, policy_version 1468630 (0.0005) [2023-12-28 05:48:56,652][106226] Updated weights for policy 0, policy_version 1468640 (0.0005) [2023-12-28 05:48:57,241][106226] Updated weights for policy 0, policy_version 1468650 (0.0010) [2023-12-28 05:48:57,301][106226] Updated weights for policy 0, policy_version 1468660 (0.0010) [2023-12-28 05:48:57,333][106225] Updated weights for policy 1, policy_version 1472034 (0.0005) [2023-12-28 05:48:57,357][106226] Updated weights for policy 0, policy_version 1468670 (0.0011) [2023-12-28 05:48:57,397][106225] Updated weights for policy 1, policy_version 1472044 (0.0005) [2023-12-28 05:48:57,449][106225] Updated weights for policy 1, policy_version 1472054 (0.0005) [2023-12-28 05:48:57,947][106225] Updated weights for policy 1, policy_version 1472064 (0.0006) [2023-12-28 05:48:58,004][106226] Updated weights for policy 0, policy_version 1468680 (0.0010) [2023-12-28 05:48:58,006][106225] Updated weights for policy 1, policy_version 1472074 (0.0006) [2023-12-28 05:48:58,053][106225] Updated weights for policy 1, policy_version 1472084 (0.0007) [2023-12-28 05:48:58,063][106226] Updated weights for policy 0, policy_version 1468690 (0.0010) [2023-12-28 05:48:58,110][106226] Updated weights for policy 0, policy_version 1468700 (0.0010) [2023-12-28 05:48:58,886][106225] Updated weights for policy 1, policy_version 1472094 (0.0007) [2023-12-28 05:48:58,902][106226] Updated weights for policy 0, policy_version 1468710 (0.0010) [2023-12-28 05:48:58,951][106225] Updated weights for policy 1, policy_version 1472104 (0.0010) [2023-12-28 05:48:58,958][106226] Updated weights for policy 0, policy_version 1468720 (0.0008) [2023-12-28 05:48:59,007][106225] Updated weights for policy 1, policy_version 1472114 (0.0011) [2023-12-28 05:48:59,018][106226] Updated weights for policy 0, policy_version 1468730 (0.0007) [2023-12-28 05:48:59,783][106225] Updated weights for policy 1, policy_version 1472124 (0.0006) [2023-12-28 05:48:59,828][106226] Updated weights for policy 0, policy_version 1468740 (0.0007) [2023-12-28 05:48:59,847][106225] Updated weights for policy 1, policy_version 1472134 (0.0010) [2023-12-28 05:48:59,891][106226] Updated weights for policy 0, policy_version 1468750 (0.0008) [2023-12-28 05:48:59,908][106225] Updated weights for policy 1, policy_version 1472144 (0.0010) [2023-12-28 05:48:59,953][106226] Updated weights for policy 0, policy_version 1468760 (0.0008) [2023-12-28 05:49:00,604][106225] Updated weights for policy 1, policy_version 1472154 (0.0008) [2023-12-28 05:49:00,612][106226] Updated weights for policy 0, policy_version 1468770 (0.0007) [2023-12-28 05:49:00,656][106225] Updated weights for policy 1, policy_version 1472164 (0.0005) [2023-12-28 05:49:00,671][106226] Updated weights for policy 0, policy_version 1468780 (0.0006) [2023-12-28 05:49:00,707][106225] Updated weights for policy 1, policy_version 1472174 (0.0005) [2023-12-28 05:49:00,723][106226] Updated weights for policy 0, policy_version 1468790 (0.0006) [2023-12-28 05:49:00,759][106225] Updated weights for policy 1, policy_version 1472184 (0.0005) [2023-12-28 05:49:00,785][106226] Updated weights for policy 0, policy_version 1468800 (0.0006) [2023-12-28 05:49:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 753016832. Throughput: 0: 9905.5, 1: 9668.7. Samples: 753006452. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:01,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.540')] [2023-12-28 05:49:01,416][106225] Updated weights for policy 1, policy_version 1472194 (0.0008) [2023-12-28 05:49:01,472][106225] Updated weights for policy 1, policy_version 1472204 (0.0006) [2023-12-28 05:49:01,474][106226] Updated weights for policy 0, policy_version 1468810 (0.0008) [2023-12-28 05:49:01,529][106225] Updated weights for policy 1, policy_version 1472214 (0.0006) [2023-12-28 05:49:01,538][106226] Updated weights for policy 0, policy_version 1468820 (0.0009) [2023-12-28 05:49:01,592][106226] Updated weights for policy 0, policy_version 1468830 (0.0008) [2023-12-28 05:49:02,120][106225] Updated weights for policy 1, policy_version 1472224 (0.0007) [2023-12-28 05:49:02,168][106225] Updated weights for policy 1, policy_version 1472234 (0.0005) [2023-12-28 05:49:02,222][106225] Updated weights for policy 1, policy_version 1472244 (0.0005) [2023-12-28 05:49:02,366][106226] Updated weights for policy 0, policy_version 1468840 (0.0008) [2023-12-28 05:49:02,425][106226] Updated weights for policy 0, policy_version 1468850 (0.0006) [2023-12-28 05:49:02,482][106226] Updated weights for policy 0, policy_version 1468860 (0.0005) [2023-12-28 05:49:02,882][106225] Updated weights for policy 1, policy_version 1472254 (0.0008) [2023-12-28 05:49:02,944][106225] Updated weights for policy 1, policy_version 1472264 (0.0008) [2023-12-28 05:49:03,005][106225] Updated weights for policy 1, policy_version 1472274 (0.0008) [2023-12-28 05:49:03,187][106226] Updated weights for policy 0, policy_version 1468870 (0.0007) [2023-12-28 05:49:03,249][106226] Updated weights for policy 0, policy_version 1468880 (0.0009) [2023-12-28 05:49:03,298][106226] Updated weights for policy 0, policy_version 1468890 (0.0008) [2023-12-28 05:49:03,587][106225] Updated weights for policy 1, policy_version 1472284 (0.0008) [2023-12-28 05:49:03,643][106225] Updated weights for policy 1, policy_version 1472294 (0.0006) [2023-12-28 05:49:03,693][106225] Updated weights for policy 1, policy_version 1472304 (0.0005) [2023-12-28 05:49:04,133][106226] Updated weights for policy 0, policy_version 1468900 (0.0008) [2023-12-28 05:49:04,199][106226] Updated weights for policy 0, policy_version 1468910 (0.0008) [2023-12-28 05:49:04,269][106226] Updated weights for policy 0, policy_version 1468920 (0.0007) [2023-12-28 05:49:04,280][106225] Updated weights for policy 1, policy_version 1472314 (0.0006) [2023-12-28 05:49:04,340][106225] Updated weights for policy 1, policy_version 1472324 (0.0006) [2023-12-28 05:49:04,399][106225] Updated weights for policy 1, policy_version 1472334 (0.0006) [2023-12-28 05:49:04,456][106225] Updated weights for policy 1, policy_version 1472344 (0.0005) [2023-12-28 05:49:04,831][106226] Updated weights for policy 0, policy_version 1468930 (0.0006) [2023-12-28 05:49:04,891][106226] Updated weights for policy 0, policy_version 1468940 (0.0005) [2023-12-28 05:49:04,943][106226] Updated weights for policy 0, policy_version 1468950 (0.0006) [2023-12-28 05:49:04,991][106226] Updated weights for policy 0, policy_version 1468960 (0.0008) [2023-12-28 05:49:05,022][106225] Updated weights for policy 1, policy_version 1472354 (0.0010) [2023-12-28 05:49:05,078][106225] Updated weights for policy 1, policy_version 1472364 (0.0010) [2023-12-28 05:49:05,135][106225] Updated weights for policy 1, policy_version 1472374 (0.0010) [2023-12-28 05:49:05,743][106226] Updated weights for policy 0, policy_version 1468970 (0.0005) [2023-12-28 05:49:05,764][106225] Updated weights for policy 1, policy_version 1472384 (0.0006) [2023-12-28 05:49:05,802][106226] Updated weights for policy 0, policy_version 1468980 (0.0005) [2023-12-28 05:49:05,835][106225] Updated weights for policy 1, policy_version 1472394 (0.0006) [2023-12-28 05:49:05,851][106226] Updated weights for policy 0, policy_version 1468990 (0.0007) [2023-12-28 05:49:05,897][106225] Updated weights for policy 1, policy_version 1472404 (0.0010) [2023-12-28 05:49:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 753123328. Throughput: 0: 9927.0, 1: 9876.2. Samples: 753131300. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:06,175][105115] Avg episode reward: [(0, '-4.872'), (1, '-4.571')] [2023-12-28 05:49:06,464][106225] Updated weights for policy 1, policy_version 1472414 (0.0009) [2023-12-28 05:49:06,523][106225] Updated weights for policy 1, policy_version 1472424 (0.0009) [2023-12-28 05:49:06,566][106226] Updated weights for policy 0, policy_version 1469000 (0.0007) [2023-12-28 05:49:06,577][106225] Updated weights for policy 1, policy_version 1472434 (0.0007) [2023-12-28 05:49:06,627][106226] Updated weights for policy 0, policy_version 1469010 (0.0008) [2023-12-28 05:49:06,692][106226] Updated weights for policy 0, policy_version 1469020 (0.0009) [2023-12-28 05:49:07,341][106225] Updated weights for policy 1, policy_version 1472444 (0.0006) [2023-12-28 05:49:07,382][106226] Updated weights for policy 0, policy_version 1469030 (0.0010) [2023-12-28 05:49:07,392][106225] Updated weights for policy 1, policy_version 1472454 (0.0006) [2023-12-28 05:49:07,438][106226] Updated weights for policy 0, policy_version 1469040 (0.0010) [2023-12-28 05:49:07,444][106225] Updated weights for policy 1, policy_version 1472464 (0.0006) [2023-12-28 05:49:07,496][106226] Updated weights for policy 0, policy_version 1469050 (0.0010) [2023-12-28 05:49:08,192][106226] Updated weights for policy 0, policy_version 1469060 (0.0009) [2023-12-28 05:49:08,202][106225] Updated weights for policy 1, policy_version 1472474 (0.0006) [2023-12-28 05:49:08,243][106226] Updated weights for policy 0, policy_version 1469070 (0.0009) [2023-12-28 05:49:08,260][106225] Updated weights for policy 1, policy_version 1472484 (0.0006) [2023-12-28 05:49:08,303][106226] Updated weights for policy 0, policy_version 1469080 (0.0011) [2023-12-28 05:49:08,318][106225] Updated weights for policy 1, policy_version 1472494 (0.0006) [2023-12-28 05:49:08,383][106225] Updated weights for policy 1, policy_version 1472504 (0.0008) [2023-12-28 05:49:09,045][106226] Updated weights for policy 0, policy_version 1469090 (0.0010) [2023-12-28 05:49:09,109][106226] Updated weights for policy 0, policy_version 1469100 (0.0010) [2023-12-28 05:49:09,123][106225] Updated weights for policy 1, policy_version 1472514 (0.0006) [2023-12-28 05:49:09,161][106226] Updated weights for policy 0, policy_version 1469110 (0.0010) [2023-12-28 05:49:09,167][106225] Updated weights for policy 1, policy_version 1472524 (0.0006) [2023-12-28 05:49:09,215][106226] Updated weights for policy 0, policy_version 1469120 (0.0010) [2023-12-28 05:49:09,217][106225] Updated weights for policy 1, policy_version 1472534 (0.0007) [2023-12-28 05:49:09,953][106225] Updated weights for policy 1, policy_version 1472544 (0.0007) [2023-12-28 05:49:09,977][106226] Updated weights for policy 0, policy_version 1469130 (0.0008) [2023-12-28 05:49:10,018][106225] Updated weights for policy 1, policy_version 1472554 (0.0011) [2023-12-28 05:49:10,036][106226] Updated weights for policy 0, policy_version 1469140 (0.0008) [2023-12-28 05:49:10,077][106225] Updated weights for policy 1, policy_version 1472564 (0.0011) [2023-12-28 05:49:10,095][106226] Updated weights for policy 0, policy_version 1469150 (0.0008) [2023-12-28 05:49:10,776][106225] Updated weights for policy 1, policy_version 1472574 (0.0011) [2023-12-28 05:49:10,777][106226] Updated weights for policy 0, policy_version 1469160 (0.0006) [2023-12-28 05:49:10,827][106225] Updated weights for policy 1, policy_version 1472584 (0.0010) [2023-12-28 05:49:10,830][106226] Updated weights for policy 0, policy_version 1469170 (0.0007) [2023-12-28 05:49:10,888][106226] Updated weights for policy 0, policy_version 1469180 (0.0008) [2023-12-28 05:49:10,891][106225] Updated weights for policy 1, policy_version 1472594 (0.0005) [2023-12-28 05:49:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 753221632. Throughput: 0: 9958.7, 1: 9899.9. Samples: 753189436. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:11,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-4.853')] [2023-12-28 05:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001472600_377036800.pth... [2023-12-28 05:49:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001469184_376184832.pth... [2023-12-28 05:49:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001471448_376741888.pth [2023-12-28 05:49:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001468032_375889920.pth [2023-12-28 05:49:11,635][106226] Updated weights for policy 0, policy_version 1469190 (0.0010) [2023-12-28 05:49:11,638][106225] Updated weights for policy 1, policy_version 1472604 (0.0009) [2023-12-28 05:49:11,700][106226] Updated weights for policy 0, policy_version 1469200 (0.0011) [2023-12-28 05:49:11,702][106225] Updated weights for policy 1, policy_version 1472614 (0.0007) [2023-12-28 05:49:11,764][106225] Updated weights for policy 1, policy_version 1472624 (0.0009) [2023-12-28 05:49:11,768][106226] Updated weights for policy 0, policy_version 1469210 (0.0009) [2023-12-28 05:49:12,525][106225] Updated weights for policy 1, policy_version 1472634 (0.0007) [2023-12-28 05:49:12,570][106226] Updated weights for policy 0, policy_version 1469220 (0.0007) [2023-12-28 05:49:12,589][106225] Updated weights for policy 1, policy_version 1472644 (0.0007) [2023-12-28 05:49:12,632][106226] Updated weights for policy 0, policy_version 1469230 (0.0009) [2023-12-28 05:49:12,650][106225] Updated weights for policy 1, policy_version 1472654 (0.0006) [2023-12-28 05:49:12,699][106226] Updated weights for policy 0, policy_version 1469240 (0.0010) [2023-12-28 05:49:12,710][106225] Updated weights for policy 1, policy_version 1472664 (0.0006) [2023-12-28 05:49:13,263][106225] Updated weights for policy 1, policy_version 1472674 (0.0005) [2023-12-28 05:49:13,325][106225] Updated weights for policy 1, policy_version 1472684 (0.0005) [2023-12-28 05:49:13,388][106225] Updated weights for policy 1, policy_version 1472694 (0.0007) [2023-12-28 05:49:13,501][106226] Updated weights for policy 0, policy_version 1469250 (0.0008) [2023-12-28 05:49:13,557][106226] Updated weights for policy 0, policy_version 1469260 (0.0009) [2023-12-28 05:49:13,614][106226] Updated weights for policy 0, policy_version 1469270 (0.0010) [2023-12-28 05:49:13,682][106226] Updated weights for policy 0, policy_version 1469280 (0.0010) [2023-12-28 05:49:14,041][106225] Updated weights for policy 1, policy_version 1472704 (0.0008) [2023-12-28 05:49:14,094][106225] Updated weights for policy 1, policy_version 1472714 (0.0009) [2023-12-28 05:49:14,151][106225] Updated weights for policy 1, policy_version 1472724 (0.0009) [2023-12-28 05:49:14,363][106226] Updated weights for policy 0, policy_version 1469290 (0.0006) [2023-12-28 05:49:14,431][106226] Updated weights for policy 0, policy_version 1469300 (0.0007) [2023-12-28 05:49:14,501][106226] Updated weights for policy 0, policy_version 1469310 (0.0008) [2023-12-28 05:49:14,939][106225] Updated weights for policy 1, policy_version 1472734 (0.0009) [2023-12-28 05:49:14,996][106225] Updated weights for policy 1, policy_version 1472744 (0.0009) [2023-12-28 05:49:15,066][106225] Updated weights for policy 1, policy_version 1472754 (0.0005) [2023-12-28 05:49:15,229][106226] Updated weights for policy 0, policy_version 1469320 (0.0008) [2023-12-28 05:49:15,288][106226] Updated weights for policy 0, policy_version 1469330 (0.0008) [2023-12-28 05:49:15,347][106226] Updated weights for policy 0, policy_version 1469340 (0.0009) [2023-12-28 05:49:15,663][106225] Updated weights for policy 1, policy_version 1472764 (0.0005) [2023-12-28 05:49:15,718][106225] Updated weights for policy 1, policy_version 1472774 (0.0005) [2023-12-28 05:49:15,775][106225] Updated weights for policy 1, policy_version 1472784 (0.0005) [2023-12-28 05:49:16,108][106226] Updated weights for policy 0, policy_version 1469350 (0.0008) [2023-12-28 05:49:16,168][106226] Updated weights for policy 0, policy_version 1469360 (0.0009) [2023-12-28 05:49:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 753311744. Throughput: 0: 9886.3, 1: 9891.5. Samples: 753304832. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:16,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-4.602')] [2023-12-28 05:49:16,220][106226] Updated weights for policy 0, policy_version 1469370 (0.0008) [2023-12-28 05:49:16,442][106225] Updated weights for policy 1, policy_version 1472794 (0.0006) [2023-12-28 05:49:16,492][106225] Updated weights for policy 1, policy_version 1472804 (0.0005) [2023-12-28 05:49:16,548][106225] Updated weights for policy 1, policy_version 1472814 (0.0006) [2023-12-28 05:49:16,604][106225] Updated weights for policy 1, policy_version 1472824 (0.0009) [2023-12-28 05:49:16,941][106226] Updated weights for policy 0, policy_version 1469380 (0.0008) [2023-12-28 05:49:17,002][106226] Updated weights for policy 0, policy_version 1469390 (0.0006) [2023-12-28 05:49:17,049][106226] Updated weights for policy 0, policy_version 1469400 (0.0008) [2023-12-28 05:49:17,302][106225] Updated weights for policy 1, policy_version 1472834 (0.0009) [2023-12-28 05:49:17,355][106225] Updated weights for policy 1, policy_version 1472844 (0.0008) [2023-12-28 05:49:17,406][106225] Updated weights for policy 1, policy_version 1472854 (0.0008) [2023-12-28 05:49:17,774][106226] Updated weights for policy 0, policy_version 1469410 (0.0009) [2023-12-28 05:49:17,819][106226] Updated weights for policy 0, policy_version 1469420 (0.0008) [2023-12-28 05:49:17,867][106226] Updated weights for policy 0, policy_version 1469430 (0.0008) [2023-12-28 05:49:17,916][106226] Updated weights for policy 0, policy_version 1469440 (0.0008) [2023-12-28 05:49:18,104][106225] Updated weights for policy 1, policy_version 1472864 (0.0009) [2023-12-28 05:49:18,155][106225] Updated weights for policy 1, policy_version 1472874 (0.0008) [2023-12-28 05:49:18,224][106225] Updated weights for policy 1, policy_version 1472884 (0.0006) [2023-12-28 05:49:18,642][106226] Updated weights for policy 0, policy_version 1469450 (0.0008) [2023-12-28 05:49:18,695][106226] Updated weights for policy 0, policy_version 1469460 (0.0010) [2023-12-28 05:49:18,753][106226] Updated weights for policy 0, policy_version 1469470 (0.0011) [2023-12-28 05:49:18,815][106225] Updated weights for policy 1, policy_version 1472894 (0.0008) [2023-12-28 05:49:18,866][106225] Updated weights for policy 1, policy_version 1472904 (0.0010) [2023-12-28 05:49:18,918][106225] Updated weights for policy 1, policy_version 1472914 (0.0010) [2023-12-28 05:49:19,413][106226] Updated weights for policy 0, policy_version 1469480 (0.0007) [2023-12-28 05:49:19,477][106226] Updated weights for policy 0, policy_version 1469490 (0.0009) [2023-12-28 05:49:19,545][106226] Updated weights for policy 0, policy_version 1469500 (0.0009) [2023-12-28 05:49:19,631][106225] Updated weights for policy 1, policy_version 1472924 (0.0010) [2023-12-28 05:49:19,689][106225] Updated weights for policy 1, policy_version 1472934 (0.0010) [2023-12-28 05:49:19,750][106225] Updated weights for policy 1, policy_version 1472944 (0.0011) [2023-12-28 05:49:20,237][106226] Updated weights for policy 0, policy_version 1469510 (0.0008) [2023-12-28 05:49:20,303][106226] Updated weights for policy 0, policy_version 1469520 (0.0006) [2023-12-28 05:49:20,372][106226] Updated weights for policy 0, policy_version 1469530 (0.0007) [2023-12-28 05:49:20,566][106225] Updated weights for policy 1, policy_version 1472954 (0.0008) [2023-12-28 05:49:20,632][106225] Updated weights for policy 1, policy_version 1472964 (0.0007) [2023-12-28 05:49:20,689][106225] Updated weights for policy 1, policy_version 1472974 (0.0009) [2023-12-28 05:49:20,745][106225] Updated weights for policy 1, policy_version 1472984 (0.0008) [2023-12-28 05:49:21,005][106226] Updated weights for policy 0, policy_version 1469540 (0.0007) [2023-12-28 05:49:21,078][106226] Updated weights for policy 0, policy_version 1469550 (0.0008) [2023-12-28 05:49:21,141][106226] Updated weights for policy 0, policy_version 1469560 (0.0009) [2023-12-28 05:49:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 753410048. Throughput: 0: 9799.9, 1: 9939.4. Samples: 753423440. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:21,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.974')] [2023-12-28 05:49:21,503][106225] Updated weights for policy 1, policy_version 1472994 (0.0007) [2023-12-28 05:49:21,562][106225] Updated weights for policy 1, policy_version 1473004 (0.0008) [2023-12-28 05:49:21,630][106225] Updated weights for policy 1, policy_version 1473014 (0.0008) [2023-12-28 05:49:21,892][106226] Updated weights for policy 0, policy_version 1469570 (0.0007) [2023-12-28 05:49:21,958][106226] Updated weights for policy 0, policy_version 1469580 (0.0007) [2023-12-28 05:49:22,020][106226] Updated weights for policy 0, policy_version 1469590 (0.0008) [2023-12-28 05:49:22,085][106226] Updated weights for policy 0, policy_version 1469600 (0.0009) [2023-12-28 05:49:22,357][106225] Updated weights for policy 1, policy_version 1473024 (0.0009) [2023-12-28 05:49:22,423][106225] Updated weights for policy 1, policy_version 1473034 (0.0009) [2023-12-28 05:49:22,509][106225] Updated weights for policy 1, policy_version 1473044 (0.0008) [2023-12-28 05:49:22,855][106226] Updated weights for policy 0, policy_version 1469610 (0.0009) [2023-12-28 05:49:22,920][106226] Updated weights for policy 0, policy_version 1469620 (0.0009) [2023-12-28 05:49:22,980][106226] Updated weights for policy 0, policy_version 1469630 (0.0009) [2023-12-28 05:49:23,186][106225] Updated weights for policy 1, policy_version 1473054 (0.0007) [2023-12-28 05:49:23,247][106225] Updated weights for policy 1, policy_version 1473064 (0.0006) [2023-12-28 05:49:23,306][106225] Updated weights for policy 1, policy_version 1473074 (0.0008) [2023-12-28 05:49:23,743][106226] Updated weights for policy 0, policy_version 1469640 (0.0006) [2023-12-28 05:49:23,806][106226] Updated weights for policy 0, policy_version 1469650 (0.0005) [2023-12-28 05:49:23,873][106226] Updated weights for policy 0, policy_version 1469660 (0.0005) [2023-12-28 05:49:23,889][106225] Updated weights for policy 1, policy_version 1473084 (0.0009) [2023-12-28 05:49:23,949][106225] Updated weights for policy 1, policy_version 1473094 (0.0007) [2023-12-28 05:49:24,017][106225] Updated weights for policy 1, policy_version 1473104 (0.0005) [2023-12-28 05:49:24,519][106226] Updated weights for policy 0, policy_version 1469670 (0.0008) [2023-12-28 05:49:24,542][106225] Updated weights for policy 1, policy_version 1473114 (0.0005) [2023-12-28 05:49:24,579][106226] Updated weights for policy 0, policy_version 1469680 (0.0009) [2023-12-28 05:49:24,598][106225] Updated weights for policy 1, policy_version 1473124 (0.0006) [2023-12-28 05:49:24,632][106226] Updated weights for policy 0, policy_version 1469690 (0.0005) [2023-12-28 05:49:24,652][106225] Updated weights for policy 1, policy_version 1473134 (0.0008) [2023-12-28 05:49:24,710][106225] Updated weights for policy 1, policy_version 1473144 (0.0008) [2023-12-28 05:49:25,256][106225] Updated weights for policy 1, policy_version 1473154 (0.0005) [2023-12-28 05:49:25,313][106225] Updated weights for policy 1, policy_version 1473164 (0.0005) [2023-12-28 05:49:25,363][106226] Updated weights for policy 0, policy_version 1469700 (0.0006) [2023-12-28 05:49:25,373][106225] Updated weights for policy 1, policy_version 1473174 (0.0005) [2023-12-28 05:49:25,416][106226] Updated weights for policy 0, policy_version 1469710 (0.0008) [2023-12-28 05:49:25,468][106226] Updated weights for policy 0, policy_version 1469720 (0.0008) [2023-12-28 05:49:25,939][106225] Updated weights for policy 1, policy_version 1473184 (0.0005) [2023-12-28 05:49:25,985][106225] Updated weights for policy 1, policy_version 1473194 (0.0005) [2023-12-28 05:49:26,035][106225] Updated weights for policy 1, policy_version 1473204 (0.0006) [2023-12-28 05:49:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19801.0). Total num frames: 753516544. Throughput: 0: 9731.4, 1: 9918.0. Samples: 753480760. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:26,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.595')] [2023-12-28 05:49:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001473208_377192448.pth... [2023-12-28 05:49:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001469728_376324096.pth... [2023-12-28 05:49:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001471992_376881152.pth [2023-12-28 05:49:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001468608_376037376.pth [2023-12-28 05:49:26,290][106226] Updated weights for policy 0, policy_version 1469730 (0.0008) [2023-12-28 05:49:26,342][106226] Updated weights for policy 0, policy_version 1469740 (0.0009) [2023-12-28 05:49:26,393][106226] Updated weights for policy 0, policy_version 1469750 (0.0008) [2023-12-28 05:49:26,452][106226] Updated weights for policy 0, policy_version 1469760 (0.0009) [2023-12-28 05:49:26,682][106225] Updated weights for policy 1, policy_version 1473214 (0.0007) [2023-12-28 05:49:26,728][106225] Updated weights for policy 1, policy_version 1473224 (0.0008) [2023-12-28 05:49:26,773][106225] Updated weights for policy 1, policy_version 1473234 (0.0008) [2023-12-28 05:49:27,181][106226] Updated weights for policy 0, policy_version 1469770 (0.0005) [2023-12-28 05:49:27,230][106226] Updated weights for policy 0, policy_version 1469780 (0.0005) [2023-12-28 05:49:27,277][106226] Updated weights for policy 0, policy_version 1469790 (0.0005) [2023-12-28 05:49:27,511][106225] Updated weights for policy 1, policy_version 1473244 (0.0005) [2023-12-28 05:49:27,561][106225] Updated weights for policy 1, policy_version 1473254 (0.0005) [2023-12-28 05:49:27,616][106225] Updated weights for policy 1, policy_version 1473264 (0.0005) [2023-12-28 05:49:27,987][106226] Updated weights for policy 0, policy_version 1469800 (0.0007) [2023-12-28 05:49:28,041][106226] Updated weights for policy 0, policy_version 1469810 (0.0008) [2023-12-28 05:49:28,101][106226] Updated weights for policy 0, policy_version 1469820 (0.0008) [2023-12-28 05:49:28,267][106225] Updated weights for policy 1, policy_version 1473274 (0.0007) [2023-12-28 05:49:28,319][106225] Updated weights for policy 1, policy_version 1473284 (0.0010) [2023-12-28 05:49:28,385][106225] Updated weights for policy 1, policy_version 1473294 (0.0011) [2023-12-28 05:49:28,449][106225] Updated weights for policy 1, policy_version 1473304 (0.0011) [2023-12-28 05:49:28,818][106226] Updated weights for policy 0, policy_version 1469830 (0.0007) [2023-12-28 05:49:28,865][106226] Updated weights for policy 0, policy_version 1469840 (0.0008) [2023-12-28 05:49:28,919][106226] Updated weights for policy 0, policy_version 1469850 (0.0008) [2023-12-28 05:49:29,160][106225] Updated weights for policy 1, policy_version 1473314 (0.0010) [2023-12-28 05:49:29,221][106225] Updated weights for policy 1, policy_version 1473324 (0.0010) [2023-12-28 05:49:29,285][106225] Updated weights for policy 1, policy_version 1473334 (0.0008) [2023-12-28 05:49:29,661][106226] Updated weights for policy 0, policy_version 1469860 (0.0007) [2023-12-28 05:49:29,710][106226] Updated weights for policy 0, policy_version 1469870 (0.0005) [2023-12-28 05:49:29,765][106226] Updated weights for policy 0, policy_version 1469880 (0.0007) [2023-12-28 05:49:30,024][106225] Updated weights for policy 1, policy_version 1473344 (0.0010) [2023-12-28 05:49:30,073][106225] Updated weights for policy 1, policy_version 1473354 (0.0010) [2023-12-28 05:49:30,124][106225] Updated weights for policy 1, policy_version 1473364 (0.0010) [2023-12-28 05:49:30,408][106226] Updated weights for policy 0, policy_version 1469890 (0.0008) [2023-12-28 05:49:30,474][106226] Updated weights for policy 0, policy_version 1469900 (0.0009) [2023-12-28 05:49:30,540][106226] Updated weights for policy 0, policy_version 1469910 (0.0010) [2023-12-28 05:49:30,589][106226] Updated weights for policy 0, policy_version 1469920 (0.0009) [2023-12-28 05:49:30,792][106225] Updated weights for policy 1, policy_version 1473374 (0.0009) [2023-12-28 05:49:30,850][106225] Updated weights for policy 1, policy_version 1473384 (0.0009) [2023-12-28 05:49:30,920][106225] Updated weights for policy 1, policy_version 1473394 (0.0008) [2023-12-28 05:49:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 753614848. Throughput: 0: 9764.5, 1: 10041.5. Samples: 753602736. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:31,175][105115] Avg episode reward: [(0, '-4.900'), (1, '-4.628')] [2023-12-28 05:49:31,354][106226] Updated weights for policy 0, policy_version 1469930 (0.0010) [2023-12-28 05:49:31,420][106226] Updated weights for policy 0, policy_version 1469940 (0.0009) [2023-12-28 05:49:31,479][106226] Updated weights for policy 0, policy_version 1469950 (0.0008) [2023-12-28 05:49:31,609][106225] Updated weights for policy 1, policy_version 1473404 (0.0008) [2023-12-28 05:49:31,681][106225] Updated weights for policy 1, policy_version 1473414 (0.0009) [2023-12-28 05:49:31,752][106225] Updated weights for policy 1, policy_version 1473424 (0.0008) [2023-12-28 05:49:32,235][106226] Updated weights for policy 0, policy_version 1469960 (0.0007) [2023-12-28 05:49:32,299][106226] Updated weights for policy 0, policy_version 1469970 (0.0008) [2023-12-28 05:49:32,367][106225] Updated weights for policy 1, policy_version 1473434 (0.0008) [2023-12-28 05:49:32,369][106226] Updated weights for policy 0, policy_version 1469980 (0.0008) [2023-12-28 05:49:32,430][106225] Updated weights for policy 1, policy_version 1473444 (0.0009) [2023-12-28 05:49:32,494][106225] Updated weights for policy 1, policy_version 1473454 (0.0009) [2023-12-28 05:49:32,552][106225] Updated weights for policy 1, policy_version 1473464 (0.0008) [2023-12-28 05:49:33,046][106226] Updated weights for policy 0, policy_version 1469990 (0.0008) [2023-12-28 05:49:33,092][106226] Updated weights for policy 0, policy_version 1470000 (0.0008) [2023-12-28 05:49:33,146][106226] Updated weights for policy 0, policy_version 1470010 (0.0009) [2023-12-28 05:49:33,241][106225] Updated weights for policy 1, policy_version 1473474 (0.0006) [2023-12-28 05:49:33,290][106225] Updated weights for policy 1, policy_version 1473484 (0.0010) [2023-12-28 05:49:33,342][106225] Updated weights for policy 1, policy_version 1473494 (0.0010) [2023-12-28 05:49:33,765][106226] Updated weights for policy 0, policy_version 1470020 (0.0006) [2023-12-28 05:49:33,809][106226] Updated weights for policy 0, policy_version 1470030 (0.0007) [2023-12-28 05:49:33,856][106226] Updated weights for policy 0, policy_version 1470040 (0.0008) [2023-12-28 05:49:34,005][106225] Updated weights for policy 1, policy_version 1473504 (0.0007) [2023-12-28 05:49:34,050][106225] Updated weights for policy 1, policy_version 1473514 (0.0005) [2023-12-28 05:49:34,100][106225] Updated weights for policy 1, policy_version 1473524 (0.0008) [2023-12-28 05:49:34,662][106226] Updated weights for policy 0, policy_version 1470050 (0.0008) [2023-12-28 05:49:34,720][106226] Updated weights for policy 0, policy_version 1470060 (0.0008) [2023-12-28 05:49:34,781][106226] Updated weights for policy 0, policy_version 1470070 (0.0007) [2023-12-28 05:49:34,813][106225] Updated weights for policy 1, policy_version 1473534 (0.0009) [2023-12-28 05:49:34,836][106226] Updated weights for policy 0, policy_version 1470080 (0.0007) [2023-12-28 05:49:34,874][106225] Updated weights for policy 1, policy_version 1473544 (0.0007) [2023-12-28 05:49:34,937][106225] Updated weights for policy 1, policy_version 1473554 (0.0009) [2023-12-28 05:49:35,452][106226] Updated weights for policy 0, policy_version 1470090 (0.0010) [2023-12-28 05:49:35,505][106226] Updated weights for policy 0, policy_version 1470100 (0.0010) [2023-12-28 05:49:35,568][106226] Updated weights for policy 0, policy_version 1470110 (0.0010) [2023-12-28 05:49:35,672][106225] Updated weights for policy 1, policy_version 1473564 (0.0008) [2023-12-28 05:49:35,719][106225] Updated weights for policy 1, policy_version 1473574 (0.0007) [2023-12-28 05:49:35,762][106225] Updated weights for policy 1, policy_version 1473584 (0.0008) [2023-12-28 05:49:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 753713152. Throughput: 0: 9798.2, 1: 10071.3. Samples: 753723064. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:36,175][105115] Avg episode reward: [(0, '-4.970'), (1, '-4.878')] [2023-12-28 05:49:36,305][106226] Updated weights for policy 0, policy_version 1470120 (0.0011) [2023-12-28 05:49:36,366][106226] Updated weights for policy 0, policy_version 1470130 (0.0011) [2023-12-28 05:49:36,421][106226] Updated weights for policy 0, policy_version 1470140 (0.0011) [2023-12-28 05:49:36,553][106225] Updated weights for policy 1, policy_version 1473594 (0.0008) [2023-12-28 05:49:36,609][106225] Updated weights for policy 1, policy_version 1473604 (0.0010) [2023-12-28 05:49:36,671][106225] Updated weights for policy 1, policy_version 1473614 (0.0011) [2023-12-28 05:49:36,729][106225] Updated weights for policy 1, policy_version 1473624 (0.0011) [2023-12-28 05:49:37,134][106226] Updated weights for policy 0, policy_version 1470150 (0.0011) [2023-12-28 05:49:37,181][106226] Updated weights for policy 0, policy_version 1470160 (0.0010) [2023-12-28 05:49:37,228][106226] Updated weights for policy 0, policy_version 1470170 (0.0010) [2023-12-28 05:49:37,353][106225] Updated weights for policy 1, policy_version 1473634 (0.0010) [2023-12-28 05:49:37,400][106225] Updated weights for policy 1, policy_version 1473644 (0.0010) [2023-12-28 05:49:37,461][106225] Updated weights for policy 1, policy_version 1473654 (0.0010) [2023-12-28 05:49:37,981][106226] Updated weights for policy 0, policy_version 1470180 (0.0010) [2023-12-28 05:49:38,038][106226] Updated weights for policy 0, policy_version 1470190 (0.0010) [2023-12-28 05:49:38,076][106225] Updated weights for policy 1, policy_version 1473664 (0.0010) [2023-12-28 05:49:38,095][106226] Updated weights for policy 0, policy_version 1470200 (0.0010) [2023-12-28 05:49:38,140][106225] Updated weights for policy 1, policy_version 1473674 (0.0010) [2023-12-28 05:49:38,201][106225] Updated weights for policy 1, policy_version 1473684 (0.0010) [2023-12-28 05:49:38,821][106226] Updated weights for policy 0, policy_version 1470210 (0.0010) [2023-12-28 05:49:38,869][106226] Updated weights for policy 0, policy_version 1470220 (0.0009) [2023-12-28 05:49:38,925][106226] Updated weights for policy 0, policy_version 1470230 (0.0008) [2023-12-28 05:49:38,964][106225] Updated weights for policy 1, policy_version 1473694 (0.0008) [2023-12-28 05:49:38,981][106226] Updated weights for policy 0, policy_version 1470240 (0.0008) [2023-12-28 05:49:39,025][106225] Updated weights for policy 1, policy_version 1473704 (0.0006) [2023-12-28 05:49:39,087][106225] Updated weights for policy 1, policy_version 1473714 (0.0006) [2023-12-28 05:49:39,800][106225] Updated weights for policy 1, policy_version 1473724 (0.0007) [2023-12-28 05:49:39,826][106226] Updated weights for policy 0, policy_version 1470250 (0.0007) [2023-12-28 05:49:39,871][106225] Updated weights for policy 1, policy_version 1473734 (0.0007) [2023-12-28 05:49:39,897][106226] Updated weights for policy 0, policy_version 1470260 (0.0007) [2023-12-28 05:49:39,936][106225] Updated weights for policy 1, policy_version 1473744 (0.0008) [2023-12-28 05:49:39,970][106226] Updated weights for policy 0, policy_version 1470270 (0.0007) [2023-12-28 05:49:40,657][106225] Updated weights for policy 1, policy_version 1473754 (0.0007) [2023-12-28 05:49:40,689][106226] Updated weights for policy 0, policy_version 1470280 (0.0008) [2023-12-28 05:49:40,718][106225] Updated weights for policy 1, policy_version 1473764 (0.0006) [2023-12-28 05:49:40,736][106226] Updated weights for policy 0, policy_version 1470290 (0.0008) [2023-12-28 05:49:40,766][106225] Updated weights for policy 1, policy_version 1473774 (0.0005) [2023-12-28 05:49:40,795][106226] Updated weights for policy 0, policy_version 1470300 (0.0011) [2023-12-28 05:49:40,816][106225] Updated weights for policy 1, policy_version 1473784 (0.0005) [2023-12-28 05:49:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 753811456. Throughput: 0: 9782.7, 1: 10122.3. Samples: 753782000. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:41,176][105115] Avg episode reward: [(0, '-4.805'), (1, '-4.738')] [2023-12-28 05:49:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001473784_377339904.pth... [2023-12-28 05:49:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001470304_376471552.pth... [2023-12-28 05:49:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001469184_376184832.pth [2023-12-28 05:49:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001472600_377036800.pth [2023-12-28 05:49:41,609][106225] Updated weights for policy 1, policy_version 1473794 (0.0008) [2023-12-28 05:49:41,637][106226] Updated weights for policy 0, policy_version 1470310 (0.0009) [2023-12-28 05:49:41,672][106225] Updated weights for policy 1, policy_version 1473804 (0.0008) [2023-12-28 05:49:41,699][106226] Updated weights for policy 0, policy_version 1470320 (0.0008) [2023-12-28 05:49:41,736][106225] Updated weights for policy 1, policy_version 1473814 (0.0007) [2023-12-28 05:49:41,763][106226] Updated weights for policy 0, policy_version 1470330 (0.0008) [2023-12-28 05:49:42,465][106226] Updated weights for policy 0, policy_version 1470340 (0.0009) [2023-12-28 05:49:42,498][106225] Updated weights for policy 1, policy_version 1473824 (0.0005) [2023-12-28 05:49:42,525][106226] Updated weights for policy 0, policy_version 1470350 (0.0008) [2023-12-28 05:49:42,557][106225] Updated weights for policy 1, policy_version 1473834 (0.0006) [2023-12-28 05:49:42,577][106226] Updated weights for policy 0, policy_version 1470360 (0.0007) [2023-12-28 05:49:42,625][106225] Updated weights for policy 1, policy_version 1473844 (0.0008) [2023-12-28 05:49:43,276][106226] Updated weights for policy 0, policy_version 1470370 (0.0006) [2023-12-28 05:49:43,299][106225] Updated weights for policy 1, policy_version 1473854 (0.0008) [2023-12-28 05:49:43,335][106226] Updated weights for policy 0, policy_version 1470380 (0.0008) [2023-12-28 05:49:43,361][106225] Updated weights for policy 1, policy_version 1473864 (0.0007) [2023-12-28 05:49:43,396][106226] Updated weights for policy 0, policy_version 1470390 (0.0006) [2023-12-28 05:49:43,419][106225] Updated weights for policy 1, policy_version 1473874 (0.0007) [2023-12-28 05:49:43,452][106226] Updated weights for policy 0, policy_version 1470400 (0.0006) [2023-12-28 05:49:44,016][106225] Updated weights for policy 1, policy_version 1473884 (0.0006) [2023-12-28 05:49:44,063][106225] Updated weights for policy 1, policy_version 1473894 (0.0005) [2023-12-28 05:49:44,112][106225] Updated weights for policy 1, policy_version 1473904 (0.0006) [2023-12-28 05:49:44,160][106226] Updated weights for policy 0, policy_version 1470410 (0.0007) [2023-12-28 05:49:44,218][106226] Updated weights for policy 0, policy_version 1470420 (0.0008) [2023-12-28 05:49:44,270][106226] Updated weights for policy 0, policy_version 1470430 (0.0008) [2023-12-28 05:49:44,796][106225] Updated weights for policy 1, policy_version 1473914 (0.0007) [2023-12-28 05:49:44,860][106225] Updated weights for policy 1, policy_version 1473924 (0.0011) [2023-12-28 05:49:44,921][106225] Updated weights for policy 1, policy_version 1473934 (0.0010) [2023-12-28 05:49:44,985][106225] Updated weights for policy 1, policy_version 1473944 (0.0010) [2023-12-28 05:49:45,009][106226] Updated weights for policy 0, policy_version 1470440 (0.0010) [2023-12-28 05:49:45,075][106226] Updated weights for policy 0, policy_version 1470450 (0.0010) [2023-12-28 05:49:45,130][106226] Updated weights for policy 0, policy_version 1470460 (0.0011) [2023-12-28 05:49:45,706][106225] Updated weights for policy 1, policy_version 1473954 (0.0006) [2023-12-28 05:49:45,763][106225] Updated weights for policy 1, policy_version 1473964 (0.0009) [2023-12-28 05:49:45,824][106225] Updated weights for policy 1, policy_version 1473974 (0.0008) [2023-12-28 05:49:45,846][106226] Updated weights for policy 0, policy_version 1470470 (0.0009) [2023-12-28 05:49:45,902][106226] Updated weights for policy 0, policy_version 1470480 (0.0005) [2023-12-28 05:49:45,952][106226] Updated weights for policy 0, policy_version 1470490 (0.0005) [2023-12-28 05:49:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 753909760. Throughput: 0: 9640.7, 1: 10171.1. Samples: 753897984. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 05:49:46,175][105115] Avg episode reward: [(0, '-4.866'), (1, '-4.703')] [2023-12-28 05:49:46,412][106225] Updated weights for policy 1, policy_version 1473984 (0.0010) [2023-12-28 05:49:46,469][106225] Updated weights for policy 1, policy_version 1473994 (0.0010) [2023-12-28 05:49:46,529][106225] Updated weights for policy 1, policy_version 1474004 (0.0010) [2023-12-28 05:49:46,538][106226] Updated weights for policy 0, policy_version 1470500 (0.0007) [2023-12-28 05:49:46,588][106226] Updated weights for policy 0, policy_version 1470510 (0.0010) [2023-12-28 05:49:46,635][106226] Updated weights for policy 0, policy_version 1470520 (0.0010) [2023-12-28 05:49:47,116][106225] Updated weights for policy 1, policy_version 1474014 (0.0007) [2023-12-28 05:49:47,178][106225] Updated weights for policy 1, policy_version 1474024 (0.0005) [2023-12-28 05:49:47,238][106225] Updated weights for policy 1, policy_version 1474034 (0.0007) [2023-12-28 05:49:47,384][106226] Updated weights for policy 0, policy_version 1470530 (0.0010) [2023-12-28 05:49:47,445][106226] Updated weights for policy 0, policy_version 1470540 (0.0011) [2023-12-28 05:49:47,509][106226] Updated weights for policy 0, policy_version 1470550 (0.0010) [2023-12-28 05:49:47,578][106226] Updated weights for policy 0, policy_version 1470560 (0.0011) [2023-12-28 05:49:47,810][106225] Updated weights for policy 1, policy_version 1474044 (0.0007) [2023-12-28 05:49:47,872][106225] Updated weights for policy 1, policy_version 1474054 (0.0005) [2023-12-28 05:49:47,920][106225] Updated weights for policy 1, policy_version 1474064 (0.0005) [2023-12-28 05:49:48,205][106226] Updated weights for policy 0, policy_version 1470570 (0.0005) [2023-12-28 05:49:48,271][106226] Updated weights for policy 0, policy_version 1470580 (0.0009) [2023-12-28 05:49:48,333][106226] Updated weights for policy 0, policy_version 1470590 (0.0012) [2023-12-28 05:49:48,484][106225] Updated weights for policy 1, policy_version 1474074 (0.0006) [2023-12-28 05:49:48,539][106225] Updated weights for policy 1, policy_version 1474084 (0.0007) [2023-12-28 05:49:48,598][106225] Updated weights for policy 1, policy_version 1474094 (0.0008) [2023-12-28 05:49:48,656][106225] Updated weights for policy 1, policy_version 1474104 (0.0008) [2023-12-28 05:49:49,022][106226] Updated weights for policy 0, policy_version 1470600 (0.0010) [2023-12-28 05:49:49,071][106226] Updated weights for policy 0, policy_version 1470610 (0.0010) [2023-12-28 05:49:49,127][106226] Updated weights for policy 0, policy_version 1470620 (0.0010) [2023-12-28 05:49:49,421][106225] Updated weights for policy 1, policy_version 1474114 (0.0007) [2023-12-28 05:49:49,476][106225] Updated weights for policy 1, policy_version 1474124 (0.0008) [2023-12-28 05:49:49,522][106225] Updated weights for policy 1, policy_version 1474134 (0.0008) [2023-12-28 05:49:49,883][106226] Updated weights for policy 0, policy_version 1470630 (0.0011) [2023-12-28 05:49:49,942][106226] Updated weights for policy 0, policy_version 1470640 (0.0011) [2023-12-28 05:49:50,010][106226] Updated weights for policy 0, policy_version 1470650 (0.0010) [2023-12-28 05:49:50,237][106225] Updated weights for policy 1, policy_version 1474144 (0.0008) [2023-12-28 05:49:50,299][106225] Updated weights for policy 1, policy_version 1474154 (0.0006) [2023-12-28 05:49:50,357][106225] Updated weights for policy 1, policy_version 1474164 (0.0008) [2023-12-28 05:49:50,724][106226] Updated weights for policy 0, policy_version 1470660 (0.0009) [2023-12-28 05:49:50,783][106226] Updated weights for policy 0, policy_version 1470670 (0.0011) [2023-12-28 05:49:50,843][106226] Updated weights for policy 0, policy_version 1470680 (0.0010) [2023-12-28 05:49:51,120][106225] Updated weights for policy 1, policy_version 1474174 (0.0009) [2023-12-28 05:49:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 754008064. Throughput: 0: 9651.4, 1: 10097.3. Samples: 754019992. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:49:51,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.599')] [2023-12-28 05:49:51,189][106225] Updated weights for policy 1, policy_version 1474184 (0.0010) [2023-12-28 05:49:51,254][106225] Updated weights for policy 1, policy_version 1474194 (0.0010) [2023-12-28 05:49:51,550][106226] Updated weights for policy 0, policy_version 1470690 (0.0006) [2023-12-28 05:49:51,614][106226] Updated weights for policy 0, policy_version 1470700 (0.0008) [2023-12-28 05:49:51,678][106226] Updated weights for policy 0, policy_version 1470710 (0.0008) [2023-12-28 05:49:51,749][106226] Updated weights for policy 0, policy_version 1470720 (0.0007) [2023-12-28 05:49:51,961][106225] Updated weights for policy 1, policy_version 1474204 (0.0008) [2023-12-28 05:49:52,024][106225] Updated weights for policy 1, policy_version 1474214 (0.0009) [2023-12-28 05:49:52,082][106225] Updated weights for policy 1, policy_version 1474224 (0.0008) [2023-12-28 05:49:52,452][106226] Updated weights for policy 0, policy_version 1470730 (0.0009) [2023-12-28 05:49:52,519][106226] Updated weights for policy 0, policy_version 1470740 (0.0010) [2023-12-28 05:49:52,579][106226] Updated weights for policy 0, policy_version 1470750 (0.0006) [2023-12-28 05:49:52,815][106225] Updated weights for policy 1, policy_version 1474234 (0.0008) [2023-12-28 05:49:52,888][106225] Updated weights for policy 1, policy_version 1474244 (0.0005) [2023-12-28 05:49:52,942][106225] Updated weights for policy 1, policy_version 1474254 (0.0005) [2023-12-28 05:49:52,988][106225] Updated weights for policy 1, policy_version 1474264 (0.0005) [2023-12-28 05:49:53,190][106226] Updated weights for policy 0, policy_version 1470760 (0.0008) [2023-12-28 05:49:53,245][106226] Updated weights for policy 0, policy_version 1470770 (0.0009) [2023-12-28 05:49:53,289][106226] Updated weights for policy 0, policy_version 1470780 (0.0008) [2023-12-28 05:49:53,584][106225] Updated weights for policy 1, policy_version 1474274 (0.0007) [2023-12-28 05:49:53,631][106225] Updated weights for policy 1, policy_version 1474284 (0.0005) [2023-12-28 05:49:53,679][106225] Updated weights for policy 1, policy_version 1474294 (0.0005) [2023-12-28 05:49:54,070][106226] Updated weights for policy 0, policy_version 1470790 (0.0009) [2023-12-28 05:49:54,124][106226] Updated weights for policy 0, policy_version 1470800 (0.0007) [2023-12-28 05:49:54,177][106226] Updated weights for policy 0, policy_version 1470810 (0.0006) [2023-12-28 05:49:54,333][106225] Updated weights for policy 1, policy_version 1474304 (0.0008) [2023-12-28 05:49:54,381][106225] Updated weights for policy 1, policy_version 1474314 (0.0008) [2023-12-28 05:49:54,432][106225] Updated weights for policy 1, policy_version 1474324 (0.0008) [2023-12-28 05:49:54,918][106226] Updated weights for policy 0, policy_version 1470820 (0.0008) [2023-12-28 05:49:54,978][106226] Updated weights for policy 0, policy_version 1470830 (0.0009) [2023-12-28 05:49:55,037][106226] Updated weights for policy 0, policy_version 1470840 (0.0006) [2023-12-28 05:49:55,115][106225] Updated weights for policy 1, policy_version 1474334 (0.0009) [2023-12-28 05:49:55,167][106225] Updated weights for policy 1, policy_version 1474344 (0.0009) [2023-12-28 05:49:55,219][106225] Updated weights for policy 1, policy_version 1474354 (0.0008) [2023-12-28 05:49:55,697][106226] Updated weights for policy 0, policy_version 1470850 (0.0007) [2023-12-28 05:49:55,759][106226] Updated weights for policy 0, policy_version 1470860 (0.0006) [2023-12-28 05:49:55,809][106226] Updated weights for policy 0, policy_version 1470870 (0.0005) [2023-12-28 05:49:55,869][106226] Updated weights for policy 0, policy_version 1470880 (0.0008) [2023-12-28 05:49:55,965][106225] Updated weights for policy 1, policy_version 1474364 (0.0007) [2023-12-28 05:49:56,015][106225] Updated weights for policy 1, policy_version 1474374 (0.0008) [2023-12-28 05:49:56,064][106225] Updated weights for policy 1, policy_version 1474384 (0.0008) [2023-12-28 05:49:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 754114560. Throughput: 0: 9668.4, 1: 10115.0. Samples: 754079684. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:49:56,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.480')] [2023-12-28 05:49:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001474392_377495552.pth... [2023-12-28 05:49:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001470880_376619008.pth... [2023-12-28 05:49:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001469728_376324096.pth [2023-12-28 05:49:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001473208_377192448.pth [2023-12-28 05:49:56,427][106226] Updated weights for policy 0, policy_version 1470890 (0.0005) [2023-12-28 05:49:56,486][106226] Updated weights for policy 0, policy_version 1470900 (0.0008) [2023-12-28 05:49:56,544][106226] Updated weights for policy 0, policy_version 1470910 (0.0009) [2023-12-28 05:49:56,875][106225] Updated weights for policy 1, policy_version 1474394 (0.0008) [2023-12-28 05:49:56,947][106225] Updated weights for policy 1, policy_version 1474404 (0.0009) [2023-12-28 05:49:57,001][106225] Updated weights for policy 1, policy_version 1474414 (0.0008) [2023-12-28 05:49:57,052][106225] Updated weights for policy 1, policy_version 1474424 (0.0008) [2023-12-28 05:49:57,188][106226] Updated weights for policy 0, policy_version 1470920 (0.0010) [2023-12-28 05:49:57,250][106226] Updated weights for policy 0, policy_version 1470930 (0.0010) [2023-12-28 05:49:57,318][106226] Updated weights for policy 0, policy_version 1470940 (0.0011) [2023-12-28 05:49:57,849][106225] Updated weights for policy 1, policy_version 1474434 (0.0006) [2023-12-28 05:49:57,853][106226] Updated weights for policy 0, policy_version 1470950 (0.0010) [2023-12-28 05:49:57,899][106225] Updated weights for policy 1, policy_version 1474444 (0.0008) [2023-12-28 05:49:57,909][106226] Updated weights for policy 0, policy_version 1470960 (0.0006) [2023-12-28 05:49:57,948][106225] Updated weights for policy 1, policy_version 1474454 (0.0008) [2023-12-28 05:49:57,972][106226] Updated weights for policy 0, policy_version 1470970 (0.0005) [2023-12-28 05:49:58,626][106226] Updated weights for policy 0, policy_version 1470980 (0.0008) [2023-12-28 05:49:58,690][106226] Updated weights for policy 0, policy_version 1470990 (0.0009) [2023-12-28 05:49:58,755][106226] Updated weights for policy 0, policy_version 1471000 (0.0012) [2023-12-28 05:49:58,787][106225] Updated weights for policy 1, policy_version 1474464 (0.0008) [2023-12-28 05:49:58,853][106225] Updated weights for policy 1, policy_version 1474474 (0.0008) [2023-12-28 05:49:58,922][106225] Updated weights for policy 1, policy_version 1474484 (0.0008) [2023-12-28 05:49:59,546][106226] Updated weights for policy 0, policy_version 1471011 (0.0007) [2023-12-28 05:49:59,608][106226] Updated weights for policy 0, policy_version 1471021 (0.0006) [2023-12-28 05:49:59,676][106226] Updated weights for policy 0, policy_version 1471031 (0.0006) [2023-12-28 05:49:59,812][106225] Updated weights for policy 1, policy_version 1474494 (0.0008) [2023-12-28 05:49:59,883][106225] Updated weights for policy 1, policy_version 1474504 (0.0009) [2023-12-28 05:49:59,942][106225] Updated weights for policy 1, policy_version 1474514 (0.0010) [2023-12-28 05:50:00,315][106226] Updated weights for policy 0, policy_version 1471041 (0.0006) [2023-12-28 05:50:00,374][106226] Updated weights for policy 0, policy_version 1471051 (0.0007) [2023-12-28 05:50:00,428][106226] Updated weights for policy 0, policy_version 1471061 (0.0008) [2023-12-28 05:50:00,473][106226] Updated weights for policy 0, policy_version 1471071 (0.0007) [2023-12-28 05:50:00,642][106225] Updated weights for policy 1, policy_version 1474524 (0.0007) [2023-12-28 05:50:00,689][106225] Updated weights for policy 1, policy_version 1474534 (0.0005) [2023-12-28 05:50:00,735][106225] Updated weights for policy 1, policy_version 1474544 (0.0005) [2023-12-28 05:50:01,033][106226] Updated weights for policy 0, policy_version 1471081 (0.0008) [2023-12-28 05:50:01,098][106226] Updated weights for policy 0, policy_version 1471091 (0.0008) [2023-12-28 05:50:01,163][106226] Updated weights for policy 0, policy_version 1471101 (0.0008) [2023-12-28 05:50:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 754204672. Throughput: 0: 9793.2, 1: 10038.5. Samples: 754197260. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:01,175][105115] Avg episode reward: [(0, '-4.893'), (1, '-4.673')] [2023-12-28 05:50:01,381][106225] Updated weights for policy 1, policy_version 1474554 (0.0006) [2023-12-28 05:50:01,449][106225] Updated weights for policy 1, policy_version 1474564 (0.0008) [2023-12-28 05:50:01,508][106225] Updated weights for policy 1, policy_version 1474574 (0.0008) [2023-12-28 05:50:01,573][106225] Updated weights for policy 1, policy_version 1474584 (0.0008) [2023-12-28 05:50:01,936][106226] Updated weights for policy 0, policy_version 1471111 (0.0009) [2023-12-28 05:50:01,991][106226] Updated weights for policy 0, policy_version 1471121 (0.0009) [2023-12-28 05:50:02,050][106226] Updated weights for policy 0, policy_version 1471131 (0.0008) [2023-12-28 05:50:02,267][106225] Updated weights for policy 1, policy_version 1474594 (0.0008) [2023-12-28 05:50:02,324][106225] Updated weights for policy 1, policy_version 1474604 (0.0009) [2023-12-28 05:50:02,385][106225] Updated weights for policy 1, policy_version 1474614 (0.0009) [2023-12-28 05:50:02,782][106226] Updated weights for policy 0, policy_version 1471141 (0.0007) [2023-12-28 05:50:02,839][106226] Updated weights for policy 0, policy_version 1471151 (0.0005) [2023-12-28 05:50:02,899][106226] Updated weights for policy 0, policy_version 1471161 (0.0007) [2023-12-28 05:50:03,139][106225] Updated weights for policy 1, policy_version 1474624 (0.0008) [2023-12-28 05:50:03,201][106225] Updated weights for policy 1, policy_version 1474634 (0.0005) [2023-12-28 05:50:03,259][106225] Updated weights for policy 1, policy_version 1474644 (0.0006) [2023-12-28 05:50:03,471][106226] Updated weights for policy 0, policy_version 1471171 (0.0006) [2023-12-28 05:50:03,524][106226] Updated weights for policy 0, policy_version 1471181 (0.0005) [2023-12-28 05:50:03,576][106226] Updated weights for policy 0, policy_version 1471191 (0.0005) [2023-12-28 05:50:03,772][106225] Updated weights for policy 1, policy_version 1474654 (0.0007) [2023-12-28 05:50:03,841][106225] Updated weights for policy 1, policy_version 1474664 (0.0008) [2023-12-28 05:50:03,906][106225] Updated weights for policy 1, policy_version 1474674 (0.0007) [2023-12-28 05:50:04,179][106226] Updated weights for policy 0, policy_version 1471201 (0.0006) [2023-12-28 05:50:04,240][106226] Updated weights for policy 0, policy_version 1471211 (0.0009) [2023-12-28 05:50:04,297][106226] Updated weights for policy 0, policy_version 1471221 (0.0008) [2023-12-28 05:50:04,359][106226] Updated weights for policy 0, policy_version 1471231 (0.0008) [2023-12-28 05:50:04,587][106225] Updated weights for policy 1, policy_version 1474684 (0.0007) [2023-12-28 05:50:04,651][106225] Updated weights for policy 1, policy_version 1474694 (0.0009) [2023-12-28 05:50:04,714][106225] Updated weights for policy 1, policy_version 1474704 (0.0009) [2023-12-28 05:50:05,122][106226] Updated weights for policy 0, policy_version 1471241 (0.0007) [2023-12-28 05:50:05,177][106226] Updated weights for policy 0, policy_version 1471251 (0.0009) [2023-12-28 05:50:05,235][106226] Updated weights for policy 0, policy_version 1471261 (0.0008) [2023-12-28 05:50:05,416][106225] Updated weights for policy 1, policy_version 1474714 (0.0008) [2023-12-28 05:50:05,470][106225] Updated weights for policy 1, policy_version 1474724 (0.0008) [2023-12-28 05:50:05,543][106225] Updated weights for policy 1, policy_version 1474734 (0.0009) [2023-12-28 05:50:05,602][106225] Updated weights for policy 1, policy_version 1474744 (0.0009) [2023-12-28 05:50:05,929][106226] Updated weights for policy 0, policy_version 1471271 (0.0008) [2023-12-28 05:50:05,974][106226] Updated weights for policy 0, policy_version 1471281 (0.0008) [2023-12-28 05:50:06,022][106226] Updated weights for policy 0, policy_version 1471291 (0.0008) [2023-12-28 05:50:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 754311168. Throughput: 0: 9846.7, 1: 10058.0. Samples: 754319156. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:06,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-4.560')] [2023-12-28 05:50:06,291][106225] Updated weights for policy 1, policy_version 1474754 (0.0009) [2023-12-28 05:50:06,354][106225] Updated weights for policy 1, policy_version 1474764 (0.0008) [2023-12-28 05:50:06,420][106225] Updated weights for policy 1, policy_version 1474774 (0.0007) [2023-12-28 05:50:06,757][106226] Updated weights for policy 0, policy_version 1471301 (0.0007) [2023-12-28 05:50:06,816][106226] Updated weights for policy 0, policy_version 1471311 (0.0007) [2023-12-28 05:50:06,879][106226] Updated weights for policy 0, policy_version 1471321 (0.0008) [2023-12-28 05:50:07,146][106225] Updated weights for policy 1, policy_version 1474784 (0.0007) [2023-12-28 05:50:07,192][106225] Updated weights for policy 1, policy_version 1474794 (0.0008) [2023-12-28 05:50:07,247][106225] Updated weights for policy 1, policy_version 1474804 (0.0008) [2023-12-28 05:50:07,566][106226] Updated weights for policy 0, policy_version 1471331 (0.0008) [2023-12-28 05:50:07,624][106226] Updated weights for policy 0, policy_version 1471341 (0.0008) [2023-12-28 05:50:07,683][106226] Updated weights for policy 0, policy_version 1471351 (0.0008) [2023-12-28 05:50:07,999][106225] Updated weights for policy 1, policy_version 1474814 (0.0008) [2023-12-28 05:50:08,057][106225] Updated weights for policy 1, policy_version 1474824 (0.0006) [2023-12-28 05:50:08,126][106225] Updated weights for policy 1, policy_version 1474834 (0.0005) [2023-12-28 05:50:08,256][106226] Updated weights for policy 0, policy_version 1471361 (0.0006) [2023-12-28 05:50:08,315][106226] Updated weights for policy 0, policy_version 1471371 (0.0010) [2023-12-28 05:50:08,394][106226] Updated weights for policy 0, policy_version 1471381 (0.0008) [2023-12-28 05:50:08,453][106226] Updated weights for policy 0, policy_version 1471391 (0.0008) [2023-12-28 05:50:08,753][106225] Updated weights for policy 1, policy_version 1474844 (0.0010) [2023-12-28 05:50:08,812][106225] Updated weights for policy 1, policy_version 1474854 (0.0008) [2023-12-28 05:50:08,874][106225] Updated weights for policy 1, policy_version 1474864 (0.0009) [2023-12-28 05:50:09,179][106226] Updated weights for policy 0, policy_version 1471401 (0.0008) [2023-12-28 05:50:09,249][106226] Updated weights for policy 0, policy_version 1471411 (0.0008) [2023-12-28 05:50:09,317][106226] Updated weights for policy 0, policy_version 1471421 (0.0008) [2023-12-28 05:50:09,638][106225] Updated weights for policy 1, policy_version 1474874 (0.0008) [2023-12-28 05:50:09,706][106225] Updated weights for policy 1, policy_version 1474884 (0.0007) [2023-12-28 05:50:09,768][106225] Updated weights for policy 1, policy_version 1474894 (0.0007) [2023-12-28 05:50:09,829][106225] Updated weights for policy 1, policy_version 1474904 (0.0008) [2023-12-28 05:50:10,042][106226] Updated weights for policy 0, policy_version 1471431 (0.0008) [2023-12-28 05:50:10,095][106226] Updated weights for policy 0, policy_version 1471441 (0.0008) [2023-12-28 05:50:10,156][106226] Updated weights for policy 0, policy_version 1471451 (0.0009) [2023-12-28 05:50:10,596][106225] Updated weights for policy 1, policy_version 1474914 (0.0009) [2023-12-28 05:50:10,656][106225] Updated weights for policy 1, policy_version 1474924 (0.0009) [2023-12-28 05:50:10,715][106225] Updated weights for policy 1, policy_version 1474934 (0.0008) [2023-12-28 05:50:10,895][106226] Updated weights for policy 0, policy_version 1471461 (0.0009) [2023-12-28 05:50:10,959][106226] Updated weights for policy 0, policy_version 1471471 (0.0008) [2023-12-28 05:50:11,022][106226] Updated weights for policy 0, policy_version 1471481 (0.0008) [2023-12-28 05:50:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 754409472. Throughput: 0: 9903.6, 1: 10072.0. Samples: 754379660. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:11,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.473')] [2023-12-28 05:50:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001474936_377634816.pth... [2023-12-28 05:50:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001471488_376774656.pth... [2023-12-28 05:50:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001470304_376471552.pth [2023-12-28 05:50:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001473784_377339904.pth [2023-12-28 05:50:11,495][106225] Updated weights for policy 1, policy_version 1474944 (0.0008) [2023-12-28 05:50:11,557][106225] Updated weights for policy 1, policy_version 1474954 (0.0008) [2023-12-28 05:50:11,620][106225] Updated weights for policy 1, policy_version 1474964 (0.0008) [2023-12-28 05:50:11,885][106226] Updated weights for policy 0, policy_version 1471491 (0.0009) [2023-12-28 05:50:11,956][106226] Updated weights for policy 0, policy_version 1471501 (0.0008) [2023-12-28 05:50:12,015][106226] Updated weights for policy 0, policy_version 1471511 (0.0008) [2023-12-28 05:50:12,366][106225] Updated weights for policy 1, policy_version 1474974 (0.0008) [2023-12-28 05:50:12,434][106225] Updated weights for policy 1, policy_version 1474984 (0.0008) [2023-12-28 05:50:12,494][106225] Updated weights for policy 1, policy_version 1474994 (0.0006) [2023-12-28 05:50:12,723][106226] Updated weights for policy 0, policy_version 1471521 (0.0008) [2023-12-28 05:50:12,791][106226] Updated weights for policy 0, policy_version 1471531 (0.0008) [2023-12-28 05:50:12,855][106226] Updated weights for policy 0, policy_version 1471541 (0.0006) [2023-12-28 05:50:12,913][106226] Updated weights for policy 0, policy_version 1471551 (0.0006) [2023-12-28 05:50:13,183][106225] Updated weights for policy 1, policy_version 1475004 (0.0007) [2023-12-28 05:50:13,235][106225] Updated weights for policy 1, policy_version 1475014 (0.0009) [2023-12-28 05:50:13,283][106225] Updated weights for policy 1, policy_version 1475024 (0.0008) [2023-12-28 05:50:13,436][106226] Updated weights for policy 0, policy_version 1471561 (0.0005) [2023-12-28 05:50:13,494][106226] Updated weights for policy 0, policy_version 1471571 (0.0005) [2023-12-28 05:50:13,547][106226] Updated weights for policy 0, policy_version 1471581 (0.0006) [2023-12-28 05:50:14,074][106225] Updated weights for policy 1, policy_version 1475034 (0.0010) [2023-12-28 05:50:14,130][106225] Updated weights for policy 1, policy_version 1475044 (0.0008) [2023-12-28 05:50:14,188][106225] Updated weights for policy 1, policy_version 1475054 (0.0008) [2023-12-28 05:50:14,194][106226] Updated weights for policy 0, policy_version 1471591 (0.0007) [2023-12-28 05:50:14,246][106225] Updated weights for policy 1, policy_version 1475064 (0.0007) [2023-12-28 05:50:14,250][106226] Updated weights for policy 0, policy_version 1471601 (0.0008) [2023-12-28 05:50:14,306][106226] Updated weights for policy 0, policy_version 1471611 (0.0005) [2023-12-28 05:50:14,942][106226] Updated weights for policy 0, policy_version 1471621 (0.0007) [2023-12-28 05:50:14,981][106225] Updated weights for policy 1, policy_version 1475074 (0.0007) [2023-12-28 05:50:15,005][106226] Updated weights for policy 0, policy_version 1471631 (0.0008) [2023-12-28 05:50:15,046][106225] Updated weights for policy 1, policy_version 1475084 (0.0006) [2023-12-28 05:50:15,055][106140] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000005 [2023-12-28 05:50:15,104][106225] Updated weights for policy 1, policy_version 1475094 (0.0006) [2023-12-28 05:50:15,685][106225] Updated weights for policy 1, policy_version 1475104 (0.0007) [2023-12-28 05:50:15,742][106225] Updated weights for policy 1, policy_version 1475114 (0.0007) [2023-12-28 05:50:15,775][106226] Updated weights for policy 0, policy_version 1471641 (0.0008) [2023-12-28 05:50:15,800][106225] Updated weights for policy 1, policy_version 1475124 (0.0008) [2023-12-28 05:50:15,824][106226] Updated weights for policy 0, policy_version 1471651 (0.0006) [2023-12-28 05:50:15,871][106226] Updated weights for policy 0, policy_version 1471661 (0.0010) [2023-12-28 05:50:15,931][106226] Updated weights for policy 0, policy_version 1471671 (0.0011) [2023-12-28 05:50:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 754507776. Throughput: 0: 9949.7, 1: 9865.3. Samples: 754494412. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:16,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.741')] [2023-12-28 05:50:16,569][106225] Updated weights for policy 1, policy_version 1475134 (0.0007) [2023-12-28 05:50:16,593][106226] Updated weights for policy 0, policy_version 1471681 (0.0010) [2023-12-28 05:50:16,629][106225] Updated weights for policy 1, policy_version 1475144 (0.0005) [2023-12-28 05:50:16,650][106226] Updated weights for policy 0, policy_version 1471691 (0.0010) [2023-12-28 05:50:16,686][106225] Updated weights for policy 1, policy_version 1475154 (0.0006) [2023-12-28 05:50:16,709][106226] Updated weights for policy 0, policy_version 1471701 (0.0010) [2023-12-28 05:50:17,403][106226] Updated weights for policy 0, policy_version 1471711 (0.0007) [2023-12-28 05:50:17,423][106225] Updated weights for policy 1, policy_version 1475164 (0.0008) [2023-12-28 05:50:17,456][106226] Updated weights for policy 0, policy_version 1471721 (0.0006) [2023-12-28 05:50:17,481][106225] Updated weights for policy 1, policy_version 1475174 (0.0009) [2023-12-28 05:50:17,514][106226] Updated weights for policy 0, policy_version 1471731 (0.0006) [2023-12-28 05:50:17,535][106225] Updated weights for policy 1, policy_version 1475184 (0.0008) [2023-12-28 05:50:18,199][106226] Updated weights for policy 0, policy_version 1471741 (0.0008) [2023-12-28 05:50:18,242][106225] Updated weights for policy 1, policy_version 1475194 (0.0008) [2023-12-28 05:50:18,256][106226] Updated weights for policy 0, policy_version 1471751 (0.0009) [2023-12-28 05:50:18,294][106225] Updated weights for policy 1, policy_version 1475204 (0.0006) [2023-12-28 05:50:18,304][106226] Updated weights for policy 0, policy_version 1471761 (0.0007) [2023-12-28 05:50:18,354][106225] Updated weights for policy 1, policy_version 1475214 (0.0007) [2023-12-28 05:50:18,411][106225] Updated weights for policy 1, policy_version 1475224 (0.0008) [2023-12-28 05:50:19,048][106226] Updated weights for policy 0, policy_version 1471771 (0.0008) [2023-12-28 05:50:19,102][106226] Updated weights for policy 0, policy_version 1471781 (0.0008) [2023-12-28 05:50:19,130][106225] Updated weights for policy 1, policy_version 1475234 (0.0005) [2023-12-28 05:50:19,160][106226] Updated weights for policy 0, policy_version 1471791 (0.0008) [2023-12-28 05:50:19,186][106225] Updated weights for policy 1, policy_version 1475244 (0.0008) [2023-12-28 05:50:19,252][106225] Updated weights for policy 1, policy_version 1475254 (0.0007) [2023-12-28 05:50:19,947][106226] Updated weights for policy 0, policy_version 1471801 (0.0008) [2023-12-28 05:50:19,986][106225] Updated weights for policy 1, policy_version 1475264 (0.0011) [2023-12-28 05:50:20,011][106226] Updated weights for policy 0, policy_version 1471811 (0.0010) [2023-12-28 05:50:20,053][106225] Updated weights for policy 1, policy_version 1475274 (0.0011) [2023-12-28 05:50:20,071][106226] Updated weights for policy 0, policy_version 1471821 (0.0010) [2023-12-28 05:50:20,114][106225] Updated weights for policy 1, policy_version 1475284 (0.0011) [2023-12-28 05:50:20,134][106226] Updated weights for policy 0, policy_version 1471831 (0.0009) [2023-12-28 05:50:20,900][106225] Updated weights for policy 1, policy_version 1475294 (0.0009) [2023-12-28 05:50:20,941][106226] Updated weights for policy 0, policy_version 1471841 (0.0009) [2023-12-28 05:50:20,953][106225] Updated weights for policy 1, policy_version 1475304 (0.0008) [2023-12-28 05:50:20,998][106226] Updated weights for policy 0, policy_version 1471851 (0.0009) [2023-12-28 05:50:21,005][106225] Updated weights for policy 1, policy_version 1475314 (0.0008) [2023-12-28 05:50:21,062][106226] Updated weights for policy 0, policy_version 1471861 (0.0009) [2023-12-28 05:50:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 754606080. Throughput: 0: 9904.6, 1: 9806.6. Samples: 754610072. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:21,175][105115] Avg episode reward: [(0, '-5.003'), (1, '-4.774')] [2023-12-28 05:50:21,863][106225] Updated weights for policy 1, policy_version 1475324 (0.0008) [2023-12-28 05:50:21,917][106225] Updated weights for policy 1, policy_version 1475334 (0.0009) [2023-12-28 05:50:21,946][106226] Updated weights for policy 0, policy_version 1471871 (0.0010) [2023-12-28 05:50:21,976][106225] Updated weights for policy 1, policy_version 1475344 (0.0008) [2023-12-28 05:50:22,009][106226] Updated weights for policy 0, policy_version 1471881 (0.0008) [2023-12-28 05:50:22,076][106226] Updated weights for policy 0, policy_version 1471891 (0.0006) [2023-12-28 05:50:22,662][106225] Updated weights for policy 1, policy_version 1475354 (0.0007) [2023-12-28 05:50:22,719][106225] Updated weights for policy 1, policy_version 1475364 (0.0008) [2023-12-28 05:50:22,777][106225] Updated weights for policy 1, policy_version 1475374 (0.0008) [2023-12-28 05:50:22,808][106226] Updated weights for policy 0, policy_version 1471901 (0.0006) [2023-12-28 05:50:22,834][106225] Updated weights for policy 1, policy_version 1475384 (0.0007) [2023-12-28 05:50:22,877][106226] Updated weights for policy 0, policy_version 1471911 (0.0008) [2023-12-28 05:50:22,942][106226] Updated weights for policy 0, policy_version 1471921 (0.0008) [2023-12-28 05:50:23,528][106225] Updated weights for policy 1, policy_version 1475394 (0.0005) [2023-12-28 05:50:23,573][106225] Updated weights for policy 1, policy_version 1475404 (0.0005) [2023-12-28 05:50:23,629][106225] Updated weights for policy 1, policy_version 1475414 (0.0005) [2023-12-28 05:50:23,649][106226] Updated weights for policy 0, policy_version 1471931 (0.0007) [2023-12-28 05:50:23,714][106226] Updated weights for policy 0, policy_version 1471941 (0.0005) [2023-12-28 05:50:23,784][106226] Updated weights for policy 0, policy_version 1471951 (0.0006) [2023-12-28 05:50:24,236][106225] Updated weights for policy 1, policy_version 1475424 (0.0005) [2023-12-28 05:50:24,295][106226] Updated weights for policy 0, policy_version 1471961 (0.0006) [2023-12-28 05:50:24,296][106225] Updated weights for policy 1, policy_version 1475434 (0.0005) [2023-12-28 05:50:24,359][106226] Updated weights for policy 0, policy_version 1471971 (0.0007) [2023-12-28 05:50:24,363][106225] Updated weights for policy 1, policy_version 1475444 (0.0006) [2023-12-28 05:50:24,419][106226] Updated weights for policy 0, policy_version 1471981 (0.0010) [2023-12-28 05:50:24,465][106226] Updated weights for policy 0, policy_version 1471991 (0.0008) [2023-12-28 05:50:25,007][106225] Updated weights for policy 1, policy_version 1475454 (0.0009) [2023-12-28 05:50:25,070][106225] Updated weights for policy 1, policy_version 1475464 (0.0010) [2023-12-28 05:50:25,130][106225] Updated weights for policy 1, policy_version 1475474 (0.0010) [2023-12-28 05:50:25,201][106226] Updated weights for policy 0, policy_version 1472001 (0.0010) [2023-12-28 05:50:25,256][106226] Updated weights for policy 0, policy_version 1472011 (0.0006) [2023-12-28 05:50:25,308][106226] Updated weights for policy 0, policy_version 1472021 (0.0005) [2023-12-28 05:50:25,784][106225] Updated weights for policy 1, policy_version 1475484 (0.0010) [2023-12-28 05:50:25,842][106225] Updated weights for policy 1, policy_version 1475494 (0.0010) [2023-12-28 05:50:25,906][106225] Updated weights for policy 1, policy_version 1475504 (0.0010) [2023-12-28 05:50:25,932][106226] Updated weights for policy 0, policy_version 1472031 (0.0005) [2023-12-28 05:50:25,984][106226] Updated weights for policy 0, policy_version 1472041 (0.0005) [2023-12-28 05:50:26,036][106226] Updated weights for policy 0, policy_version 1472051 (0.0005) [2023-12-28 05:50:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 754704384. Throughput: 0: 9915.7, 1: 9772.2. Samples: 754667960. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:26,176][105115] Avg episode reward: [(0, '-5.011'), (1, '-4.208')] [2023-12-28 05:50:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001472056_376922112.pth... [2023-12-28 05:50:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001475512_377782272.pth... [2023-12-28 05:50:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001470880_376619008.pth [2023-12-28 05:50:26,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001474392_377495552.pth [2023-12-28 05:50:26,617][106225] Updated weights for policy 1, policy_version 1475514 (0.0010) [2023-12-28 05:50:26,663][106225] Updated weights for policy 1, policy_version 1475524 (0.0010) [2023-12-28 05:50:26,689][106226] Updated weights for policy 0, policy_version 1472061 (0.0008) [2023-12-28 05:50:26,716][106225] Updated weights for policy 1, policy_version 1475534 (0.0010) [2023-12-28 05:50:26,738][106226] Updated weights for policy 0, policy_version 1472071 (0.0010) [2023-12-28 05:50:26,773][106225] Updated weights for policy 1, policy_version 1475544 (0.0010) [2023-12-28 05:50:26,783][106226] Updated weights for policy 0, policy_version 1472081 (0.0010) [2023-12-28 05:50:27,475][106226] Updated weights for policy 0, policy_version 1472091 (0.0010) [2023-12-28 05:50:27,509][106225] Updated weights for policy 1, policy_version 1475554 (0.0010) [2023-12-28 05:50:27,535][106226] Updated weights for policy 0, policy_version 1472101 (0.0010) [2023-12-28 05:50:27,564][106225] Updated weights for policy 1, policy_version 1475564 (0.0010) [2023-12-28 05:50:27,597][106226] Updated weights for policy 0, policy_version 1472111 (0.0008) [2023-12-28 05:50:27,630][106225] Updated weights for policy 1, policy_version 1475574 (0.0010) [2023-12-28 05:50:28,260][106226] Updated weights for policy 0, policy_version 1472121 (0.0010) [2023-12-28 05:50:28,313][106226] Updated weights for policy 0, policy_version 1472131 (0.0010) [2023-12-28 05:50:28,344][106225] Updated weights for policy 1, policy_version 1475584 (0.0009) [2023-12-28 05:50:28,371][106226] Updated weights for policy 0, policy_version 1472141 (0.0007) [2023-12-28 05:50:28,409][106225] Updated weights for policy 1, policy_version 1475594 (0.0008) [2023-12-28 05:50:28,421][106226] Updated weights for policy 0, policy_version 1472151 (0.0005) [2023-12-28 05:50:28,464][106225] Updated weights for policy 1, policy_version 1475604 (0.0008) [2023-12-28 05:50:28,971][106226] Updated weights for policy 0, policy_version 1472161 (0.0008) [2023-12-28 05:50:29,024][106226] Updated weights for policy 0, policy_version 1472171 (0.0010) [2023-12-28 05:50:29,068][106225] Updated weights for policy 1, policy_version 1475614 (0.0006) [2023-12-28 05:50:29,084][106226] Updated weights for policy 0, policy_version 1472181 (0.0011) [2023-12-28 05:50:29,117][106225] Updated weights for policy 1, policy_version 1475624 (0.0005) [2023-12-28 05:50:29,172][106225] Updated weights for policy 1, policy_version 1475634 (0.0005) [2023-12-28 05:50:29,731][106226] Updated weights for policy 0, policy_version 1472191 (0.0007) [2023-12-28 05:50:29,790][106226] Updated weights for policy 0, policy_version 1472201 (0.0005) [2023-12-28 05:50:29,842][106225] Updated weights for policy 1, policy_version 1475644 (0.0007) [2023-12-28 05:50:29,855][106226] Updated weights for policy 0, policy_version 1472211 (0.0007) [2023-12-28 05:50:29,900][106225] Updated weights for policy 1, policy_version 1475654 (0.0006) [2023-12-28 05:50:29,972][106225] Updated weights for policy 1, policy_version 1475664 (0.0008) [2023-12-28 05:50:30,568][106226] Updated weights for policy 0, policy_version 1472221 (0.0008) [2023-12-28 05:50:30,619][106225] Updated weights for policy 1, policy_version 1475674 (0.0007) [2023-12-28 05:50:30,629][106226] Updated weights for policy 0, policy_version 1472231 (0.0010) [2023-12-28 05:50:30,671][106225] Updated weights for policy 1, policy_version 1475684 (0.0007) [2023-12-28 05:50:30,688][106226] Updated weights for policy 0, policy_version 1472241 (0.0011) [2023-12-28 05:50:30,721][106225] Updated weights for policy 1, policy_version 1475694 (0.0006) [2023-12-28 05:50:30,773][106225] Updated weights for policy 1, policy_version 1475704 (0.0006) [2023-12-28 05:50:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 754802688. Throughput: 0: 10061.1, 1: 9827.8. Samples: 754792988. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:31,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-4.727')] [2023-12-28 05:50:31,413][106226] Updated weights for policy 0, policy_version 1472251 (0.0011) [2023-12-28 05:50:31,454][106225] Updated weights for policy 1, policy_version 1475714 (0.0007) [2023-12-28 05:50:31,472][106226] Updated weights for policy 0, policy_version 1472261 (0.0008) [2023-12-28 05:50:31,507][106225] Updated weights for policy 1, policy_version 1475724 (0.0008) [2023-12-28 05:50:31,534][106226] Updated weights for policy 0, policy_version 1472271 (0.0007) [2023-12-28 05:50:31,562][106225] Updated weights for policy 1, policy_version 1475734 (0.0006) [2023-12-28 05:50:32,236][106226] Updated weights for policy 0, policy_version 1472281 (0.0009) [2023-12-28 05:50:32,262][106225] Updated weights for policy 1, policy_version 1475744 (0.0007) [2023-12-28 05:50:32,298][106226] Updated weights for policy 0, policy_version 1472291 (0.0007) [2023-12-28 05:50:32,321][106225] Updated weights for policy 1, policy_version 1475754 (0.0006) [2023-12-28 05:50:32,371][106226] Updated weights for policy 0, policy_version 1472301 (0.0008) [2023-12-28 05:50:32,378][106225] Updated weights for policy 1, policy_version 1475764 (0.0007) [2023-12-28 05:50:32,437][106226] Updated weights for policy 0, policy_version 1472311 (0.0006) [2023-12-28 05:50:33,092][106225] Updated weights for policy 1, policy_version 1475774 (0.0007) [2023-12-28 05:50:33,105][106226] Updated weights for policy 0, policy_version 1472321 (0.0007) [2023-12-28 05:50:33,144][106225] Updated weights for policy 1, policy_version 1475784 (0.0006) [2023-12-28 05:50:33,157][106226] Updated weights for policy 0, policy_version 1472331 (0.0006) [2023-12-28 05:50:33,194][106225] Updated weights for policy 1, policy_version 1475794 (0.0005) [2023-12-28 05:50:33,210][106226] Updated weights for policy 0, policy_version 1472342 (0.0007) [2023-12-28 05:50:33,880][106226] Updated weights for policy 0, policy_version 1472352 (0.0008) [2023-12-28 05:50:33,939][106226] Updated weights for policy 0, policy_version 1472362 (0.0008) [2023-12-28 05:50:33,948][106225] Updated weights for policy 1, policy_version 1475804 (0.0008) [2023-12-28 05:50:33,989][106226] Updated weights for policy 0, policy_version 1472372 (0.0007) [2023-12-28 05:50:33,995][106225] Updated weights for policy 1, policy_version 1475814 (0.0005) [2023-12-28 05:50:34,048][106225] Updated weights for policy 1, policy_version 1475824 (0.0008) [2023-12-28 05:50:34,649][106226] Updated weights for policy 0, policy_version 1472382 (0.0006) [2023-12-28 05:50:34,717][106226] Updated weights for policy 0, policy_version 1472392 (0.0009) [2023-12-28 05:50:34,768][106226] Updated weights for policy 0, policy_version 1472402 (0.0010) [2023-12-28 05:50:34,786][106225] Updated weights for policy 1, policy_version 1475834 (0.0009) [2023-12-28 05:50:34,844][106225] Updated weights for policy 1, policy_version 1475844 (0.0007) [2023-12-28 05:50:34,897][106225] Updated weights for policy 1, policy_version 1475854 (0.0005) [2023-12-28 05:50:34,956][106225] Updated weights for policy 1, policy_version 1475864 (0.0005) [2023-12-28 05:50:35,489][106226] Updated weights for policy 0, policy_version 1472412 (0.0007) [2023-12-28 05:50:35,545][106226] Updated weights for policy 0, policy_version 1472422 (0.0006) [2023-12-28 05:50:35,604][106226] Updated weights for policy 0, policy_version 1472432 (0.0007) [2023-12-28 05:50:35,631][106225] Updated weights for policy 1, policy_version 1475874 (0.0007) [2023-12-28 05:50:35,682][106225] Updated weights for policy 1, policy_version 1475884 (0.0010) [2023-12-28 05:50:35,731][106225] Updated weights for policy 1, policy_version 1475894 (0.0008) [2023-12-28 05:50:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 754900992. Throughput: 0: 10091.2, 1: 9762.1. Samples: 754913392. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:36,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-4.731')] [2023-12-28 05:50:36,213][106226] Updated weights for policy 0, policy_version 1472442 (0.0009) [2023-12-28 05:50:36,274][106226] Updated weights for policy 0, policy_version 1472452 (0.0011) [2023-12-28 05:50:36,336][106226] Updated weights for policy 0, policy_version 1472462 (0.0011) [2023-12-28 05:50:36,383][106225] Updated weights for policy 1, policy_version 1475904 (0.0010) [2023-12-28 05:50:36,402][106226] Updated weights for policy 0, policy_version 1472472 (0.0011) [2023-12-28 05:50:36,443][106225] Updated weights for policy 1, policy_version 1475914 (0.0007) [2023-12-28 05:50:36,505][106225] Updated weights for policy 1, policy_version 1475924 (0.0006) [2023-12-28 05:50:37,122][106226] Updated weights for policy 0, policy_version 1472482 (0.0011) [2023-12-28 05:50:37,155][106225] Updated weights for policy 1, policy_version 1475934 (0.0007) [2023-12-28 05:50:37,184][106226] Updated weights for policy 0, policy_version 1472492 (0.0011) [2023-12-28 05:50:37,217][106225] Updated weights for policy 1, policy_version 1475944 (0.0006) [2023-12-28 05:50:37,246][106226] Updated weights for policy 0, policy_version 1472502 (0.0011) [2023-12-28 05:50:37,272][106225] Updated weights for policy 1, policy_version 1475954 (0.0006) [2023-12-28 05:50:37,838][106225] Updated weights for policy 1, policy_version 1475964 (0.0008) [2023-12-28 05:50:37,902][106225] Updated weights for policy 1, policy_version 1475974 (0.0008) [2023-12-28 05:50:37,962][106225] Updated weights for policy 1, policy_version 1475984 (0.0009) [2023-12-28 05:50:37,962][106226] Updated weights for policy 0, policy_version 1472512 (0.0011) [2023-12-28 05:50:38,017][106226] Updated weights for policy 0, policy_version 1472522 (0.0011) [2023-12-28 05:50:38,070][106226] Updated weights for policy 0, policy_version 1472532 (0.0011) [2023-12-28 05:50:38,598][106225] Updated weights for policy 1, policy_version 1475994 (0.0009) [2023-12-28 05:50:38,655][106225] Updated weights for policy 1, policy_version 1476004 (0.0008) [2023-12-28 05:50:38,706][106225] Updated weights for policy 1, policy_version 1476014 (0.0008) [2023-12-28 05:50:38,760][106225] Updated weights for policy 1, policy_version 1476024 (0.0008) [2023-12-28 05:50:38,826][106226] Updated weights for policy 0, policy_version 1472542 (0.0011) [2023-12-28 05:50:38,894][106226] Updated weights for policy 0, policy_version 1472552 (0.0011) [2023-12-28 05:50:38,955][106226] Updated weights for policy 0, policy_version 1472562 (0.0011) [2023-12-28 05:50:39,578][106225] Updated weights for policy 1, policy_version 1476034 (0.0008) [2023-12-28 05:50:39,640][106225] Updated weights for policy 1, policy_version 1476044 (0.0010) [2023-12-28 05:50:39,674][106226] Updated weights for policy 0, policy_version 1472572 (0.0011) [2023-12-28 05:50:39,702][106225] Updated weights for policy 1, policy_version 1476054 (0.0007) [2023-12-28 05:50:39,733][106226] Updated weights for policy 0, policy_version 1472582 (0.0011) [2023-12-28 05:50:39,792][106226] Updated weights for policy 0, policy_version 1472592 (0.0011) [2023-12-28 05:50:40,455][106225] Updated weights for policy 1, policy_version 1476064 (0.0010) [2023-12-28 05:50:40,519][106225] Updated weights for policy 1, policy_version 1476074 (0.0010) [2023-12-28 05:50:40,543][106226] Updated weights for policy 0, policy_version 1472602 (0.0010) [2023-12-28 05:50:40,583][106225] Updated weights for policy 1, policy_version 1476084 (0.0010) [2023-12-28 05:50:40,603][106226] Updated weights for policy 0, policy_version 1472612 (0.0010) [2023-12-28 05:50:40,662][106226] Updated weights for policy 0, policy_version 1472622 (0.0011) [2023-12-28 05:50:40,721][106226] Updated weights for policy 0, policy_version 1472632 (0.0009) [2023-12-28 05:50:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 754999296. Throughput: 0: 10065.7, 1: 9820.3. Samples: 754974560. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:41,176][105115] Avg episode reward: [(0, '-4.878'), (1, '-4.691')] [2023-12-28 05:50:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001476088_377929728.pth... [2023-12-28 05:50:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001472632_377069568.pth... [2023-12-28 05:50:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001474936_377634816.pth [2023-12-28 05:50:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001471488_376774656.pth [2023-12-28 05:50:41,301][106225] Updated weights for policy 1, policy_version 1476094 (0.0010) [2023-12-28 05:50:41,370][106225] Updated weights for policy 1, policy_version 1476104 (0.0009) [2023-12-28 05:50:41,389][106226] Updated weights for policy 0, policy_version 1472642 (0.0009) [2023-12-28 05:50:41,432][106225] Updated weights for policy 1, policy_version 1476114 (0.0010) [2023-12-28 05:50:41,450][106226] Updated weights for policy 0, policy_version 1472652 (0.0006) [2023-12-28 05:50:41,515][106226] Updated weights for policy 0, policy_version 1472662 (0.0007) [2023-12-28 05:50:42,152][106225] Updated weights for policy 1, policy_version 1476124 (0.0010) [2023-12-28 05:50:42,219][106225] Updated weights for policy 1, policy_version 1476134 (0.0010) [2023-12-28 05:50:42,293][106225] Updated weights for policy 1, policy_version 1476144 (0.0011) [2023-12-28 05:50:42,327][106226] Updated weights for policy 0, policy_version 1472672 (0.0007) [2023-12-28 05:50:42,395][106226] Updated weights for policy 0, policy_version 1472682 (0.0008) [2023-12-28 05:50:42,460][106226] Updated weights for policy 0, policy_version 1472692 (0.0007) [2023-12-28 05:50:42,946][106225] Updated weights for policy 1, policy_version 1476154 (0.0009) [2023-12-28 05:50:43,006][106225] Updated weights for policy 1, policy_version 1476164 (0.0005) [2023-12-28 05:50:43,073][106225] Updated weights for policy 1, policy_version 1476174 (0.0009) [2023-12-28 05:50:43,137][106225] Updated weights for policy 1, policy_version 1476184 (0.0010) [2023-12-28 05:50:43,233][106226] Updated weights for policy 0, policy_version 1472702 (0.0007) [2023-12-28 05:50:43,300][106226] Updated weights for policy 0, policy_version 1472712 (0.0007) [2023-12-28 05:50:43,351][106226] Updated weights for policy 0, policy_version 1472722 (0.0008) [2023-12-28 05:50:43,791][106225] Updated weights for policy 1, policy_version 1476194 (0.0010) [2023-12-28 05:50:43,854][106225] Updated weights for policy 1, policy_version 1476204 (0.0010) [2023-12-28 05:50:43,907][106225] Updated weights for policy 1, policy_version 1476214 (0.0010) [2023-12-28 05:50:43,921][106226] Updated weights for policy 0, policy_version 1472732 (0.0008) [2023-12-28 05:50:43,972][106226] Updated weights for policy 0, policy_version 1472742 (0.0008) [2023-12-28 05:50:44,023][106226] Updated weights for policy 0, policy_version 1472752 (0.0008) [2023-12-28 05:50:44,602][106225] Updated weights for policy 1, policy_version 1476224 (0.0010) [2023-12-28 05:50:44,654][106225] Updated weights for policy 1, policy_version 1476234 (0.0010) [2023-12-28 05:50:44,703][106225] Updated weights for policy 1, policy_version 1476244 (0.0010) [2023-12-28 05:50:44,766][106226] Updated weights for policy 0, policy_version 1472762 (0.0009) [2023-12-28 05:50:44,829][106226] Updated weights for policy 0, policy_version 1472772 (0.0008) [2023-12-28 05:50:44,890][106226] Updated weights for policy 0, policy_version 1472782 (0.0008) [2023-12-28 05:50:44,952][106226] Updated weights for policy 0, policy_version 1472792 (0.0008) [2023-12-28 05:50:45,479][106225] Updated weights for policy 1, policy_version 1476254 (0.0007) [2023-12-28 05:50:45,542][106225] Updated weights for policy 1, policy_version 1476264 (0.0006) [2023-12-28 05:50:45,606][106225] Updated weights for policy 1, policy_version 1476274 (0.0005) [2023-12-28 05:50:45,721][106226] Updated weights for policy 0, policy_version 1472802 (0.0008) [2023-12-28 05:50:45,791][106226] Updated weights for policy 0, policy_version 1472812 (0.0010) [2023-12-28 05:50:45,843][106226] Updated weights for policy 0, policy_version 1472822 (0.0008) [2023-12-28 05:50:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 755097600. Throughput: 0: 9954.2, 1: 9863.9. Samples: 755089076. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:46,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.881')] [2023-12-28 05:50:46,232][106225] Updated weights for policy 1, policy_version 1476284 (0.0010) [2023-12-28 05:50:46,278][106225] Updated weights for policy 1, policy_version 1476294 (0.0010) [2023-12-28 05:50:46,329][106225] Updated weights for policy 1, policy_version 1476304 (0.0007) [2023-12-28 05:50:46,611][106226] Updated weights for policy 0, policy_version 1472832 (0.0007) [2023-12-28 05:50:46,678][106226] Updated weights for policy 0, policy_version 1472842 (0.0009) [2023-12-28 05:50:46,743][106226] Updated weights for policy 0, policy_version 1472852 (0.0010) [2023-12-28 05:50:46,940][106225] Updated weights for policy 1, policy_version 1476314 (0.0005) [2023-12-28 05:50:47,003][106225] Updated weights for policy 1, policy_version 1476324 (0.0006) [2023-12-28 05:50:47,061][106225] Updated weights for policy 1, policy_version 1476334 (0.0009) [2023-12-28 05:50:47,116][106225] Updated weights for policy 1, policy_version 1476344 (0.0006) [2023-12-28 05:50:47,530][106226] Updated weights for policy 0, policy_version 1472862 (0.0009) [2023-12-28 05:50:47,592][106226] Updated weights for policy 0, policy_version 1472872 (0.0008) [2023-12-28 05:50:47,657][106226] Updated weights for policy 0, policy_version 1472882 (0.0008) [2023-12-28 05:50:47,765][106225] Updated weights for policy 1, policy_version 1476354 (0.0010) [2023-12-28 05:50:47,822][106225] Updated weights for policy 1, policy_version 1476364 (0.0010) [2023-12-28 05:50:47,881][106225] Updated weights for policy 1, policy_version 1476374 (0.0010) [2023-12-28 05:50:48,426][106226] Updated weights for policy 0, policy_version 1472892 (0.0008) [2023-12-28 05:50:48,490][106226] Updated weights for policy 0, policy_version 1472902 (0.0007) [2023-12-28 05:50:48,554][106226] Updated weights for policy 0, policy_version 1472912 (0.0007) [2023-12-28 05:50:48,578][106225] Updated weights for policy 1, policy_version 1476384 (0.0010) [2023-12-28 05:50:48,641][106225] Updated weights for policy 1, policy_version 1476394 (0.0010) [2023-12-28 05:50:48,709][106225] Updated weights for policy 1, policy_version 1476404 (0.0006) [2023-12-28 05:50:49,331][106226] Updated weights for policy 0, policy_version 1472922 (0.0007) [2023-12-28 05:50:49,403][106226] Updated weights for policy 0, policy_version 1472932 (0.0010) [2023-12-28 05:50:49,406][106225] Updated weights for policy 1, policy_version 1476414 (0.0006) [2023-12-28 05:50:49,466][106225] Updated weights for policy 1, policy_version 1476424 (0.0006) [2023-12-28 05:50:49,471][106226] Updated weights for policy 0, policy_version 1472942 (0.0011) [2023-12-28 05:50:49,532][106225] Updated weights for policy 1, policy_version 1476434 (0.0006) [2023-12-28 05:50:49,537][106226] Updated weights for policy 0, policy_version 1472952 (0.0011) [2023-12-28 05:50:50,236][106225] Updated weights for policy 1, policy_version 1476444 (0.0007) [2023-12-28 05:50:50,269][106226] Updated weights for policy 0, policy_version 1472962 (0.0008) [2023-12-28 05:50:50,297][106225] Updated weights for policy 1, policy_version 1476454 (0.0007) [2023-12-28 05:50:50,329][106226] Updated weights for policy 0, policy_version 1472972 (0.0008) [2023-12-28 05:50:50,353][106225] Updated weights for policy 1, policy_version 1476464 (0.0007) [2023-12-28 05:50:50,390][106226] Updated weights for policy 0, policy_version 1472982 (0.0008) [2023-12-28 05:50:51,047][106226] Updated weights for policy 0, policy_version 1472992 (0.0008) [2023-12-28 05:50:51,119][106226] Updated weights for policy 0, policy_version 1473002 (0.0008) [2023-12-28 05:50:51,163][106225] Updated weights for policy 1, policy_version 1476474 (0.0008) [2023-12-28 05:50:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 755187712. Throughput: 0: 9830.8, 1: 9856.1. Samples: 755205064. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:51,175][105115] Avg episode reward: [(0, '-4.761'), (1, '-4.508')] [2023-12-28 05:50:51,182][106226] Updated weights for policy 0, policy_version 1473012 (0.0007) [2023-12-28 05:50:51,223][106225] Updated weights for policy 1, policy_version 1476484 (0.0008) [2023-12-28 05:50:51,284][106225] Updated weights for policy 1, policy_version 1476494 (0.0008) [2023-12-28 05:50:51,346][106225] Updated weights for policy 1, policy_version 1476504 (0.0008) [2023-12-28 05:50:51,881][106226] Updated weights for policy 0, policy_version 1473022 (0.0007) [2023-12-28 05:50:51,935][106226] Updated weights for policy 0, policy_version 1473032 (0.0009) [2023-12-28 05:50:52,002][106226] Updated weights for policy 0, policy_version 1473042 (0.0007) [2023-12-28 05:50:52,149][106225] Updated weights for policy 1, policy_version 1476514 (0.0008) [2023-12-28 05:50:52,207][106225] Updated weights for policy 1, policy_version 1476524 (0.0006) [2023-12-28 05:50:52,271][106225] Updated weights for policy 1, policy_version 1476534 (0.0007) [2023-12-28 05:50:52,684][106226] Updated weights for policy 0, policy_version 1473052 (0.0008) [2023-12-28 05:50:52,745][106226] Updated weights for policy 0, policy_version 1473062 (0.0011) [2023-12-28 05:50:52,805][106226] Updated weights for policy 0, policy_version 1473072 (0.0011) [2023-12-28 05:50:53,078][106225] Updated weights for policy 1, policy_version 1476544 (0.0008) [2023-12-28 05:50:53,141][106225] Updated weights for policy 1, policy_version 1476554 (0.0008) [2023-12-28 05:50:53,195][106225] Updated weights for policy 1, policy_version 1476564 (0.0009) [2023-12-28 05:50:53,465][106226] Updated weights for policy 0, policy_version 1473082 (0.0006) [2023-12-28 05:50:53,522][106226] Updated weights for policy 0, policy_version 1473092 (0.0005) [2023-12-28 05:50:53,577][106226] Updated weights for policy 0, policy_version 1473102 (0.0005) [2023-12-28 05:50:53,633][106226] Updated weights for policy 0, policy_version 1473112 (0.0005) [2023-12-28 05:50:53,875][106225] Updated weights for policy 1, policy_version 1476574 (0.0006) [2023-12-28 05:50:53,942][106225] Updated weights for policy 1, policy_version 1476584 (0.0005) [2023-12-28 05:50:53,987][106225] Updated weights for policy 1, policy_version 1476594 (0.0005) [2023-12-28 05:50:54,213][106226] Updated weights for policy 0, policy_version 1473122 (0.0008) [2023-12-28 05:50:54,271][106226] Updated weights for policy 0, policy_version 1473132 (0.0008) [2023-12-28 05:50:54,330][106226] Updated weights for policy 0, policy_version 1473142 (0.0009) [2023-12-28 05:50:54,643][106225] Updated weights for policy 1, policy_version 1476604 (0.0007) [2023-12-28 05:50:54,707][106225] Updated weights for policy 1, policy_version 1476614 (0.0009) [2023-12-28 05:50:54,769][106225] Updated weights for policy 1, policy_version 1476624 (0.0008) [2023-12-28 05:50:54,917][106226] Updated weights for policy 0, policy_version 1473152 (0.0006) [2023-12-28 05:50:54,965][106226] Updated weights for policy 0, policy_version 1473162 (0.0005) [2023-12-28 05:50:55,025][106226] Updated weights for policy 0, policy_version 1473172 (0.0008) [2023-12-28 05:50:55,507][106225] Updated weights for policy 1, policy_version 1476634 (0.0010) [2023-12-28 05:50:55,560][106225] Updated weights for policy 1, policy_version 1476644 (0.0010) [2023-12-28 05:50:55,612][106225] Updated weights for policy 1, policy_version 1476654 (0.0010) [2023-12-28 05:50:55,641][106226] Updated weights for policy 0, policy_version 1473182 (0.0008) [2023-12-28 05:50:55,666][106225] Updated weights for policy 1, policy_version 1476664 (0.0010) [2023-12-28 05:50:55,693][106226] Updated weights for policy 0, policy_version 1473192 (0.0007) [2023-12-28 05:50:55,740][106226] Updated weights for policy 0, policy_version 1473202 (0.0008) [2023-12-28 05:50:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 755294208. Throughput: 0: 9828.3, 1: 9795.7. Samples: 755262744. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:50:56,176][105115] Avg episode reward: [(0, '-4.909'), (1, '-4.438')] [2023-12-28 05:50:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001473208_377217024.pth... [2023-12-28 05:50:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001476664_378077184.pth... [2023-12-28 05:50:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001472056_376922112.pth [2023-12-28 05:50:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001475512_377782272.pth [2023-12-28 05:50:56,258][106225] Updated weights for policy 1, policy_version 1476674 (0.0005) [2023-12-28 05:50:56,306][106225] Updated weights for policy 1, policy_version 1476684 (0.0007) [2023-12-28 05:50:56,356][106225] Updated weights for policy 1, policy_version 1476694 (0.0008) [2023-12-28 05:50:56,511][106226] Updated weights for policy 0, policy_version 1473212 (0.0008) [2023-12-28 05:50:56,572][106226] Updated weights for policy 0, policy_version 1473222 (0.0008) [2023-12-28 05:50:56,636][106226] Updated weights for policy 0, policy_version 1473232 (0.0009) [2023-12-28 05:50:56,992][106225] Updated weights for policy 1, policy_version 1476704 (0.0005) [2023-12-28 05:50:57,040][106225] Updated weights for policy 1, policy_version 1476714 (0.0005) [2023-12-28 05:50:57,090][106225] Updated weights for policy 1, policy_version 1476724 (0.0005) [2023-12-28 05:50:57,457][106226] Updated weights for policy 0, policy_version 1473242 (0.0009) [2023-12-28 05:50:57,519][106226] Updated weights for policy 0, policy_version 1473252 (0.0008) [2023-12-28 05:50:57,587][106226] Updated weights for policy 0, policy_version 1473262 (0.0008) [2023-12-28 05:50:57,645][106226] Updated weights for policy 0, policy_version 1473272 (0.0007) [2023-12-28 05:50:57,650][106225] Updated weights for policy 1, policy_version 1476734 (0.0007) [2023-12-28 05:50:57,702][106225] Updated weights for policy 1, policy_version 1476744 (0.0005) [2023-12-28 05:50:57,763][106225] Updated weights for policy 1, policy_version 1476754 (0.0009) [2023-12-28 05:50:58,407][106225] Updated weights for policy 1, policy_version 1476764 (0.0010) [2023-12-28 05:50:58,453][106226] Updated weights for policy 0, policy_version 1473282 (0.0007) [2023-12-28 05:50:58,473][106225] Updated weights for policy 1, policy_version 1476774 (0.0007) [2023-12-28 05:50:58,518][106226] Updated weights for policy 0, policy_version 1473292 (0.0008) [2023-12-28 05:50:58,537][106225] Updated weights for policy 1, policy_version 1476784 (0.0006) [2023-12-28 05:50:58,584][106226] Updated weights for policy 0, policy_version 1473302 (0.0008) [2023-12-28 05:50:59,329][106225] Updated weights for policy 1, policy_version 1476794 (0.0007) [2023-12-28 05:50:59,381][106226] Updated weights for policy 0, policy_version 1473312 (0.0008) [2023-12-28 05:50:59,399][106225] Updated weights for policy 1, policy_version 1476804 (0.0007) [2023-12-28 05:50:59,444][106226] Updated weights for policy 0, policy_version 1473322 (0.0008) [2023-12-28 05:50:59,460][106225] Updated weights for policy 1, policy_version 1476814 (0.0009) [2023-12-28 05:50:59,505][106226] Updated weights for policy 0, policy_version 1473332 (0.0007) [2023-12-28 05:50:59,518][106225] Updated weights for policy 1, policy_version 1476824 (0.0007) [2023-12-28 05:51:00,216][106225] Updated weights for policy 1, policy_version 1476834 (0.0010) [2023-12-28 05:51:00,266][106226] Updated weights for policy 0, policy_version 1473342 (0.0008) [2023-12-28 05:51:00,278][106225] Updated weights for policy 1, policy_version 1476844 (0.0008) [2023-12-28 05:51:00,324][106226] Updated weights for policy 0, policy_version 1473352 (0.0008) [2023-12-28 05:51:00,345][106225] Updated weights for policy 1, policy_version 1476854 (0.0008) [2023-12-28 05:51:00,387][106226] Updated weights for policy 0, policy_version 1473362 (0.0009) [2023-12-28 05:51:00,947][106225] Updated weights for policy 1, policy_version 1476864 (0.0009) [2023-12-28 05:51:00,990][106226] Updated weights for policy 0, policy_version 1473372 (0.0006) [2023-12-28 05:51:01,017][106225] Updated weights for policy 1, policy_version 1476874 (0.0010) [2023-12-28 05:51:01,071][106226] Updated weights for policy 0, policy_version 1473382 (0.0007) [2023-12-28 05:51:01,076][106225] Updated weights for policy 1, policy_version 1476884 (0.0011) [2023-12-28 05:51:01,135][106226] Updated weights for policy 0, policy_version 1473392 (0.0006) [2023-12-28 05:51:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 755392512. Throughput: 0: 9791.4, 1: 9952.8. Samples: 755382900. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:01,175][105115] Avg episode reward: [(0, '-5.114'), (1, '-4.838')] [2023-12-28 05:51:01,780][106225] Updated weights for policy 1, policy_version 1476894 (0.0009) [2023-12-28 05:51:01,808][106226] Updated weights for policy 0, policy_version 1473402 (0.0008) [2023-12-28 05:51:01,838][106225] Updated weights for policy 1, policy_version 1476904 (0.0008) [2023-12-28 05:51:01,864][106226] Updated weights for policy 0, policy_version 1473412 (0.0005) [2023-12-28 05:51:01,891][106225] Updated weights for policy 1, policy_version 1476914 (0.0007) [2023-12-28 05:51:01,921][106226] Updated weights for policy 0, policy_version 1473422 (0.0005) [2023-12-28 05:51:01,974][106226] Updated weights for policy 0, policy_version 1473432 (0.0007) [2023-12-28 05:51:02,595][106225] Updated weights for policy 1, policy_version 1476924 (0.0007) [2023-12-28 05:51:02,596][106226] Updated weights for policy 0, policy_version 1473442 (0.0009) [2023-12-28 05:51:02,646][106226] Updated weights for policy 0, policy_version 1473452 (0.0010) [2023-12-28 05:51:02,656][106225] Updated weights for policy 1, policy_version 1476934 (0.0005) [2023-12-28 05:51:02,707][106226] Updated weights for policy 0, policy_version 1473462 (0.0010) [2023-12-28 05:51:02,716][106225] Updated weights for policy 1, policy_version 1476944 (0.0006) [2023-12-28 05:51:03,383][106226] Updated weights for policy 0, policy_version 1473472 (0.0007) [2023-12-28 05:51:03,399][106225] Updated weights for policy 1, policy_version 1476954 (0.0006) [2023-12-28 05:51:03,445][106226] Updated weights for policy 0, policy_version 1473482 (0.0006) [2023-12-28 05:51:03,447][106225] Updated weights for policy 1, policy_version 1476964 (0.0007) [2023-12-28 05:51:03,505][106225] Updated weights for policy 1, policy_version 1476974 (0.0007) [2023-12-28 05:51:03,508][106226] Updated weights for policy 0, policy_version 1473492 (0.0006) [2023-12-28 05:51:03,556][106225] Updated weights for policy 1, policy_version 1476984 (0.0006) [2023-12-28 05:51:04,140][106226] Updated weights for policy 0, policy_version 1473502 (0.0007) [2023-12-28 05:51:04,203][106226] Updated weights for policy 0, policy_version 1473512 (0.0008) [2023-12-28 05:51:04,234][106225] Updated weights for policy 1, policy_version 1476994 (0.0008) [2023-12-28 05:51:04,259][106226] Updated weights for policy 0, policy_version 1473522 (0.0007) [2023-12-28 05:51:04,301][106225] Updated weights for policy 1, policy_version 1477004 (0.0008) [2023-12-28 05:51:04,363][106225] Updated weights for policy 1, policy_version 1477014 (0.0007) [2023-12-28 05:51:05,011][106226] Updated weights for policy 0, policy_version 1473532 (0.0006) [2023-12-28 05:51:05,039][106225] Updated weights for policy 1, policy_version 1477024 (0.0008) [2023-12-28 05:51:05,060][106226] Updated weights for policy 0, policy_version 1473542 (0.0008) [2023-12-28 05:51:05,099][106225] Updated weights for policy 1, policy_version 1477034 (0.0008) [2023-12-28 05:51:05,118][106226] Updated weights for policy 0, policy_version 1473552 (0.0008) [2023-12-28 05:51:05,155][106225] Updated weights for policy 1, policy_version 1477044 (0.0007) [2023-12-28 05:51:05,743][106226] Updated weights for policy 0, policy_version 1473562 (0.0007) [2023-12-28 05:51:05,802][106226] Updated weights for policy 0, policy_version 1473572 (0.0008) [2023-12-28 05:51:05,864][106226] Updated weights for policy 0, policy_version 1473582 (0.0005) [2023-12-28 05:51:05,923][106226] Updated weights for policy 0, policy_version 1473592 (0.0005) [2023-12-28 05:51:05,933][106225] Updated weights for policy 1, policy_version 1477054 (0.0008) [2023-12-28 05:51:05,982][106225] Updated weights for policy 1, policy_version 1477064 (0.0008) [2023-12-28 05:51:06,030][106225] Updated weights for policy 1, policy_version 1477074 (0.0008) [2023-12-28 05:51:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 755499008. Throughput: 0: 9887.7, 1: 9996.0. Samples: 755504836. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:06,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.958')] [2023-12-28 05:51:06,600][106226] Updated weights for policy 0, policy_version 1473602 (0.0011) [2023-12-28 05:51:06,667][106226] Updated weights for policy 0, policy_version 1473612 (0.0011) [2023-12-28 05:51:06,712][106225] Updated weights for policy 1, policy_version 1477084 (0.0006) [2023-12-28 05:51:06,728][106226] Updated weights for policy 0, policy_version 1473622 (0.0011) [2023-12-28 05:51:06,768][106225] Updated weights for policy 1, policy_version 1477094 (0.0008) [2023-12-28 05:51:06,828][106225] Updated weights for policy 1, policy_version 1477104 (0.0007) [2023-12-28 05:51:07,430][106226] Updated weights for policy 0, policy_version 1473632 (0.0011) [2023-12-28 05:51:07,489][106226] Updated weights for policy 0, policy_version 1473642 (0.0011) [2023-12-28 05:51:07,524][106225] Updated weights for policy 1, policy_version 1477114 (0.0008) [2023-12-28 05:51:07,550][106226] Updated weights for policy 0, policy_version 1473652 (0.0011) [2023-12-28 05:51:07,579][106225] Updated weights for policy 1, policy_version 1477124 (0.0008) [2023-12-28 05:51:07,623][106225] Updated weights for policy 1, policy_version 1477134 (0.0008) [2023-12-28 05:51:07,673][106225] Updated weights for policy 1, policy_version 1477144 (0.0008) [2023-12-28 05:51:08,170][106226] Updated weights for policy 0, policy_version 1473662 (0.0008) [2023-12-28 05:51:08,238][106226] Updated weights for policy 0, policy_version 1473672 (0.0006) [2023-12-28 05:51:08,292][106226] Updated weights for policy 0, policy_version 1473682 (0.0005) [2023-12-28 05:51:08,516][106225] Updated weights for policy 1, policy_version 1477154 (0.0010) [2023-12-28 05:51:08,573][106225] Updated weights for policy 1, policy_version 1477164 (0.0008) [2023-12-28 05:51:08,630][106225] Updated weights for policy 1, policy_version 1477174 (0.0008) [2023-12-28 05:51:08,903][106226] Updated weights for policy 0, policy_version 1473692 (0.0007) [2023-12-28 05:51:08,960][106226] Updated weights for policy 0, policy_version 1473702 (0.0006) [2023-12-28 05:51:09,015][106226] Updated weights for policy 0, policy_version 1473712 (0.0005) [2023-12-28 05:51:09,372][106225] Updated weights for policy 1, policy_version 1477184 (0.0008) [2023-12-28 05:51:09,442][106225] Updated weights for policy 1, policy_version 1477194 (0.0009) [2023-12-28 05:51:09,508][106225] Updated weights for policy 1, policy_version 1477204 (0.0008) [2023-12-28 05:51:09,701][106226] Updated weights for policy 0, policy_version 1473722 (0.0006) [2023-12-28 05:51:09,765][106226] Updated weights for policy 0, policy_version 1473732 (0.0008) [2023-12-28 05:51:09,831][106226] Updated weights for policy 0, policy_version 1473742 (0.0009) [2023-12-28 05:51:09,893][106226] Updated weights for policy 0, policy_version 1473752 (0.0007) [2023-12-28 05:51:10,257][106225] Updated weights for policy 1, policy_version 1477214 (0.0007) [2023-12-28 05:51:10,315][106225] Updated weights for policy 1, policy_version 1477224 (0.0007) [2023-12-28 05:51:10,374][106225] Updated weights for policy 1, policy_version 1477234 (0.0007) [2023-12-28 05:51:10,637][106226] Updated weights for policy 0, policy_version 1473762 (0.0008) [2023-12-28 05:51:10,704][106226] Updated weights for policy 0, policy_version 1473772 (0.0009) [2023-12-28 05:51:10,759][106226] Updated weights for policy 0, policy_version 1473782 (0.0008) [2023-12-28 05:51:11,080][106225] Updated weights for policy 1, policy_version 1477244 (0.0010) [2023-12-28 05:51:11,148][106225] Updated weights for policy 1, policy_version 1477254 (0.0011) [2023-12-28 05:51:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 755589120. Throughput: 0: 9938.1, 1: 9980.8. Samples: 755564304. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:11,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.729')] [2023-12-28 05:51:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001473784_377364480.pth... [2023-12-28 05:51:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001472632_377069568.pth [2023-12-28 05:51:11,216][106225] Updated weights for policy 1, policy_version 1477264 (0.0010) [2023-12-28 05:51:11,271][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001477272_378232832.pth... [2023-12-28 05:51:11,277][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001476088_377929728.pth [2023-12-28 05:51:11,542][106226] Updated weights for policy 0, policy_version 1473792 (0.0009) [2023-12-28 05:51:11,605][106226] Updated weights for policy 0, policy_version 1473802 (0.0009) [2023-12-28 05:51:11,674][106226] Updated weights for policy 0, policy_version 1473812 (0.0009) [2023-12-28 05:51:11,934][106225] Updated weights for policy 1, policy_version 1477274 (0.0009) [2023-12-28 05:51:11,999][106225] Updated weights for policy 1, policy_version 1477284 (0.0008) [2023-12-28 05:51:12,062][106225] Updated weights for policy 1, policy_version 1477294 (0.0008) [2023-12-28 05:51:12,122][106225] Updated weights for policy 1, policy_version 1477304 (0.0008) [2023-12-28 05:51:12,407][106226] Updated weights for policy 0, policy_version 1473822 (0.0008) [2023-12-28 05:51:12,473][106226] Updated weights for policy 0, policy_version 1473832 (0.0008) [2023-12-28 05:51:12,536][106226] Updated weights for policy 0, policy_version 1473842 (0.0009) [2023-12-28 05:51:12,852][106225] Updated weights for policy 1, policy_version 1477314 (0.0009) [2023-12-28 05:51:12,906][106225] Updated weights for policy 1, policy_version 1477324 (0.0007) [2023-12-28 05:51:12,964][106225] Updated weights for policy 1, policy_version 1477334 (0.0006) [2023-12-28 05:51:13,204][106226] Updated weights for policy 0, policy_version 1473852 (0.0007) [2023-12-28 05:51:13,269][106226] Updated weights for policy 0, policy_version 1473862 (0.0007) [2023-12-28 05:51:13,328][106226] Updated weights for policy 0, policy_version 1473872 (0.0008) [2023-12-28 05:51:13,666][106225] Updated weights for policy 1, policy_version 1477344 (0.0005) [2023-12-28 05:51:13,718][106225] Updated weights for policy 1, policy_version 1477354 (0.0005) [2023-12-28 05:51:13,772][106225] Updated weights for policy 1, policy_version 1477364 (0.0007) [2023-12-28 05:51:14,088][106226] Updated weights for policy 0, policy_version 1473882 (0.0009) [2023-12-28 05:51:14,138][106226] Updated weights for policy 0, policy_version 1473892 (0.0009) [2023-12-28 05:51:14,195][106226] Updated weights for policy 0, policy_version 1473902 (0.0007) [2023-12-28 05:51:14,254][106226] Updated weights for policy 0, policy_version 1473912 (0.0007) [2023-12-28 05:51:14,361][106225] Updated weights for policy 1, policy_version 1477374 (0.0007) [2023-12-28 05:51:14,420][106225] Updated weights for policy 1, policy_version 1477384 (0.0008) [2023-12-28 05:51:14,478][106225] Updated weights for policy 1, policy_version 1477394 (0.0008) [2023-12-28 05:51:15,018][106226] Updated weights for policy 0, policy_version 1473922 (0.0008) [2023-12-28 05:51:15,083][106226] Updated weights for policy 0, policy_version 1473932 (0.0008) [2023-12-28 05:51:15,143][106225] Updated weights for policy 1, policy_version 1477404 (0.0007) [2023-12-28 05:51:15,144][106226] Updated weights for policy 0, policy_version 1473942 (0.0008) [2023-12-28 05:51:15,199][106225] Updated weights for policy 1, policy_version 1477414 (0.0008) [2023-12-28 05:51:15,262][106225] Updated weights for policy 1, policy_version 1477424 (0.0008) [2023-12-28 05:51:15,922][106226] Updated weights for policy 0, policy_version 1473952 (0.0009) [2023-12-28 05:51:15,940][106225] Updated weights for policy 1, policy_version 1477434 (0.0008) [2023-12-28 05:51:15,978][106226] Updated weights for policy 0, policy_version 1473962 (0.0007) [2023-12-28 05:51:16,000][106225] Updated weights for policy 1, policy_version 1477444 (0.0006) [2023-12-28 05:51:16,039][106226] Updated weights for policy 0, policy_version 1473972 (0.0007) [2023-12-28 05:51:16,062][106225] Updated weights for policy 1, policy_version 1477454 (0.0007) [2023-12-28 05:51:16,117][106225] Updated weights for policy 1, policy_version 1477464 (0.0008) [2023-12-28 05:51:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 755695616. Throughput: 0: 9763.1, 1: 9950.9. Samples: 755680116. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:16,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.603')] [2023-12-28 05:51:16,675][106226] Updated weights for policy 0, policy_version 1473982 (0.0006) [2023-12-28 05:51:16,728][106226] Updated weights for policy 0, policy_version 1473992 (0.0008) [2023-12-28 05:51:16,774][106226] Updated weights for policy 0, policy_version 1474002 (0.0007) [2023-12-28 05:51:16,846][106225] Updated weights for policy 1, policy_version 1477474 (0.0009) [2023-12-28 05:51:16,908][106225] Updated weights for policy 1, policy_version 1477484 (0.0008) [2023-12-28 05:51:16,970][106225] Updated weights for policy 1, policy_version 1477494 (0.0008) [2023-12-28 05:51:17,446][106226] Updated weights for policy 0, policy_version 1474012 (0.0007) [2023-12-28 05:51:17,497][106226] Updated weights for policy 0, policy_version 1474022 (0.0009) [2023-12-28 05:51:17,548][106226] Updated weights for policy 0, policy_version 1474032 (0.0009) [2023-12-28 05:51:17,695][106225] Updated weights for policy 1, policy_version 1477504 (0.0008) [2023-12-28 05:51:17,749][106225] Updated weights for policy 1, policy_version 1477514 (0.0008) [2023-12-28 05:51:17,796][106225] Updated weights for policy 1, policy_version 1477524 (0.0008) [2023-12-28 05:51:18,253][106226] Updated weights for policy 0, policy_version 1474042 (0.0009) [2023-12-28 05:51:18,302][106226] Updated weights for policy 0, policy_version 1474052 (0.0009) [2023-12-28 05:51:18,361][106226] Updated weights for policy 0, policy_version 1474062 (0.0008) [2023-12-28 05:51:18,424][106226] Updated weights for policy 0, policy_version 1474072 (0.0008) [2023-12-28 05:51:18,549][106225] Updated weights for policy 1, policy_version 1477534 (0.0007) [2023-12-28 05:51:18,617][106225] Updated weights for policy 1, policy_version 1477544 (0.0008) [2023-12-28 05:51:18,680][106225] Updated weights for policy 1, policy_version 1477554 (0.0009) [2023-12-28 05:51:19,166][106226] Updated weights for policy 0, policy_version 1474082 (0.0009) [2023-12-28 05:51:19,216][106226] Updated weights for policy 0, policy_version 1474092 (0.0008) [2023-12-28 05:51:19,287][106226] Updated weights for policy 0, policy_version 1474102 (0.0009) [2023-12-28 05:51:19,429][106225] Updated weights for policy 1, policy_version 1477564 (0.0009) [2023-12-28 05:51:19,493][106225] Updated weights for policy 1, policy_version 1477574 (0.0009) [2023-12-28 05:51:19,560][106225] Updated weights for policy 1, policy_version 1477584 (0.0008) [2023-12-28 05:51:20,045][106226] Updated weights for policy 0, policy_version 1474112 (0.0008) [2023-12-28 05:51:20,113][106226] Updated weights for policy 0, policy_version 1474122 (0.0009) [2023-12-28 05:51:20,177][106226] Updated weights for policy 0, policy_version 1474132 (0.0009) [2023-12-28 05:51:20,349][106225] Updated weights for policy 1, policy_version 1477594 (0.0008) [2023-12-28 05:51:20,416][106225] Updated weights for policy 1, policy_version 1477604 (0.0008) [2023-12-28 05:51:20,486][106225] Updated weights for policy 1, policy_version 1477614 (0.0008) [2023-12-28 05:51:20,546][106225] Updated weights for policy 1, policy_version 1477624 (0.0009) [2023-12-28 05:51:20,868][106226] Updated weights for policy 0, policy_version 1474142 (0.0007) [2023-12-28 05:51:20,932][106226] Updated weights for policy 0, policy_version 1474152 (0.0009) [2023-12-28 05:51:20,990][106226] Updated weights for policy 0, policy_version 1474162 (0.0009) [2023-12-28 05:51:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 755785728. Throughput: 0: 9709.3, 1: 9863.5. Samples: 755794172. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:21,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-4.631')] [2023-12-28 05:51:21,310][106225] Updated weights for policy 1, policy_version 1477634 (0.0007) [2023-12-28 05:51:21,375][106225] Updated weights for policy 1, policy_version 1477644 (0.0007) [2023-12-28 05:51:21,437][106225] Updated weights for policy 1, policy_version 1477654 (0.0006) [2023-12-28 05:51:21,823][106226] Updated weights for policy 0, policy_version 1474172 (0.0009) [2023-12-28 05:51:21,892][106226] Updated weights for policy 0, policy_version 1474182 (0.0008) [2023-12-28 05:51:21,952][106226] Updated weights for policy 0, policy_version 1474192 (0.0006) [2023-12-28 05:51:22,186][106225] Updated weights for policy 1, policy_version 1477664 (0.0009) [2023-12-28 05:51:22,251][106225] Updated weights for policy 1, policy_version 1477674 (0.0006) [2023-12-28 05:51:22,314][106225] Updated weights for policy 1, policy_version 1477684 (0.0010) [2023-12-28 05:51:22,658][106226] Updated weights for policy 0, policy_version 1474202 (0.0007) [2023-12-28 05:51:22,727][106226] Updated weights for policy 0, policy_version 1474212 (0.0008) [2023-12-28 05:51:22,787][106226] Updated weights for policy 0, policy_version 1474222 (0.0008) [2023-12-28 05:51:22,850][106226] Updated weights for policy 0, policy_version 1474232 (0.0008) [2023-12-28 05:51:23,051][106225] Updated weights for policy 1, policy_version 1477694 (0.0011) [2023-12-28 05:51:23,107][106225] Updated weights for policy 1, policy_version 1477704 (0.0010) [2023-12-28 05:51:23,162][106225] Updated weights for policy 1, policy_version 1477714 (0.0010) [2023-12-28 05:51:23,571][106226] Updated weights for policy 0, policy_version 1474242 (0.0007) [2023-12-28 05:51:23,629][106226] Updated weights for policy 0, policy_version 1474252 (0.0009) [2023-12-28 05:51:23,684][106226] Updated weights for policy 0, policy_version 1474262 (0.0008) [2023-12-28 05:51:23,840][106225] Updated weights for policy 1, policy_version 1477724 (0.0010) [2023-12-28 05:51:23,897][106225] Updated weights for policy 1, policy_version 1477734 (0.0010) [2023-12-28 05:51:23,949][106225] Updated weights for policy 1, policy_version 1477744 (0.0010) [2023-12-28 05:51:24,451][106226] Updated weights for policy 0, policy_version 1474272 (0.0009) [2023-12-28 05:51:24,503][106226] Updated weights for policy 0, policy_version 1474282 (0.0008) [2023-12-28 05:51:24,574][106226] Updated weights for policy 0, policy_version 1474292 (0.0009) [2023-12-28 05:51:24,594][106225] Updated weights for policy 1, policy_version 1477754 (0.0009) [2023-12-28 05:51:24,646][106225] Updated weights for policy 1, policy_version 1477764 (0.0005) [2023-12-28 05:51:24,694][106225] Updated weights for policy 1, policy_version 1477774 (0.0005) [2023-12-28 05:51:24,754][106225] Updated weights for policy 1, policy_version 1477784 (0.0005) [2023-12-28 05:51:25,260][106225] Updated weights for policy 1, policy_version 1477794 (0.0006) [2023-12-28 05:51:25,308][106225] Updated weights for policy 1, policy_version 1477804 (0.0008) [2023-12-28 05:51:25,358][106225] Updated weights for policy 1, policy_version 1477814 (0.0010) [2023-12-28 05:51:25,410][106226] Updated weights for policy 0, policy_version 1474302 (0.0008) [2023-12-28 05:51:25,463][106226] Updated weights for policy 0, policy_version 1474312 (0.0008) [2023-12-28 05:51:25,512][106226] Updated weights for policy 0, policy_version 1474322 (0.0007) [2023-12-28 05:51:26,085][106225] Updated weights for policy 1, policy_version 1477824 (0.0010) [2023-12-28 05:51:26,148][106225] Updated weights for policy 1, policy_version 1477834 (0.0010) [2023-12-28 05:51:26,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.4, 300 sec: 19744.1). Total num frames: 755875840. Throughput: 0: 9687.1, 1: 9774.3. Samples: 755850324. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:26,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-4.566')] [2023-12-28 05:51:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001474328_377503744.pth... [2023-12-28 05:51:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001473208_377217024.pth [2023-12-28 05:51:26,199][106225] Updated weights for policy 1, policy_version 1477844 (0.0010) [2023-12-28 05:51:26,214][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001477848_378380288.pth... [2023-12-28 05:51:26,217][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001476664_378077184.pth [2023-12-28 05:51:26,282][106226] Updated weights for policy 0, policy_version 1474332 (0.0007) [2023-12-28 05:51:26,347][106226] Updated weights for policy 0, policy_version 1474342 (0.0008) [2023-12-28 05:51:26,406][106226] Updated weights for policy 0, policy_version 1474352 (0.0008) [2023-12-28 05:51:26,922][106225] Updated weights for policy 1, policy_version 1477854 (0.0009) [2023-12-28 05:51:26,975][106225] Updated weights for policy 1, policy_version 1477864 (0.0006) [2023-12-28 05:51:27,028][106225] Updated weights for policy 1, policy_version 1477874 (0.0005) [2023-12-28 05:51:27,160][106226] Updated weights for policy 0, policy_version 1474362 (0.0008) [2023-12-28 05:51:27,224][106226] Updated weights for policy 0, policy_version 1474372 (0.0009) [2023-12-28 05:51:27,281][106226] Updated weights for policy 0, policy_version 1474382 (0.0008) [2023-12-28 05:51:27,337][106226] Updated weights for policy 0, policy_version 1474392 (0.0009) [2023-12-28 05:51:27,619][106225] Updated weights for policy 1, policy_version 1477884 (0.0005) [2023-12-28 05:51:27,682][106225] Updated weights for policy 1, policy_version 1477894 (0.0006) [2023-12-28 05:51:27,732][106225] Updated weights for policy 1, policy_version 1477904 (0.0010) [2023-12-28 05:51:28,079][106226] Updated weights for policy 0, policy_version 1474402 (0.0008) [2023-12-28 05:51:28,134][106226] Updated weights for policy 0, policy_version 1474412 (0.0008) [2023-12-28 05:51:28,204][106226] Updated weights for policy 0, policy_version 1474422 (0.0010) [2023-12-28 05:51:28,368][106225] Updated weights for policy 1, policy_version 1477914 (0.0010) [2023-12-28 05:51:28,421][106225] Updated weights for policy 1, policy_version 1477924 (0.0009) [2023-12-28 05:51:28,487][106225] Updated weights for policy 1, policy_version 1477934 (0.0008) [2023-12-28 05:51:28,543][106225] Updated weights for policy 1, policy_version 1477944 (0.0009) [2023-12-28 05:51:28,935][106226] Updated weights for policy 0, policy_version 1474432 (0.0009) [2023-12-28 05:51:28,996][106226] Updated weights for policy 0, policy_version 1474442 (0.0008) [2023-12-28 05:51:29,050][106226] Updated weights for policy 0, policy_version 1474452 (0.0008) [2023-12-28 05:51:29,253][106225] Updated weights for policy 1, policy_version 1477954 (0.0009) [2023-12-28 05:51:29,314][106225] Updated weights for policy 1, policy_version 1477964 (0.0007) [2023-12-28 05:51:29,381][106225] Updated weights for policy 1, policy_version 1477975 (0.0007) [2023-12-28 05:51:29,717][106226] Updated weights for policy 0, policy_version 1474462 (0.0007) [2023-12-28 05:51:29,776][106226] Updated weights for policy 0, policy_version 1474472 (0.0006) [2023-12-28 05:51:29,833][106226] Updated weights for policy 0, policy_version 1474482 (0.0009) [2023-12-28 05:51:30,151][106225] Updated weights for policy 1, policy_version 1477985 (0.0009) [2023-12-28 05:51:30,202][106225] Updated weights for policy 1, policy_version 1477995 (0.0010) [2023-12-28 05:51:30,259][106225] Updated weights for policy 1, policy_version 1478005 (0.0010) [2023-12-28 05:51:30,504][106226] Updated weights for policy 0, policy_version 1474492 (0.0006) [2023-12-28 05:51:30,556][106226] Updated weights for policy 0, policy_version 1474502 (0.0006) [2023-12-28 05:51:30,619][106226] Updated weights for policy 0, policy_version 1474512 (0.0007) [2023-12-28 05:51:31,000][106225] Updated weights for policy 1, policy_version 1478015 (0.0010) [2023-12-28 05:51:31,064][106225] Updated weights for policy 1, policy_version 1478025 (0.0010) [2023-12-28 05:51:31,129][106225] Updated weights for policy 1, policy_version 1478035 (0.0011) [2023-12-28 05:51:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 755982336. Throughput: 0: 9661.6, 1: 9889.0. Samples: 755968852. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:31,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.843')] [2023-12-28 05:51:31,358][106226] Updated weights for policy 0, policy_version 1474522 (0.0008) [2023-12-28 05:51:31,414][106226] Updated weights for policy 0, policy_version 1474532 (0.0008) [2023-12-28 05:51:31,461][106226] Updated weights for policy 0, policy_version 1474542 (0.0008) [2023-12-28 05:51:31,523][106226] Updated weights for policy 0, policy_version 1474552 (0.0008) [2023-12-28 05:51:31,890][106225] Updated weights for policy 1, policy_version 1478045 (0.0011) [2023-12-28 05:51:31,945][106225] Updated weights for policy 1, policy_version 1478055 (0.0010) [2023-12-28 05:51:32,001][106225] Updated weights for policy 1, policy_version 1478065 (0.0010) [2023-12-28 05:51:32,282][106226] Updated weights for policy 0, policy_version 1474562 (0.0008) [2023-12-28 05:51:32,349][106226] Updated weights for policy 0, policy_version 1474572 (0.0009) [2023-12-28 05:51:32,421][106226] Updated weights for policy 0, policy_version 1474582 (0.0006) [2023-12-28 05:51:32,699][106225] Updated weights for policy 1, policy_version 1478075 (0.0010) [2023-12-28 05:51:32,763][106225] Updated weights for policy 1, policy_version 1478085 (0.0008) [2023-12-28 05:51:32,815][106225] Updated weights for policy 1, policy_version 1478095 (0.0007) [2023-12-28 05:51:33,171][106226] Updated weights for policy 0, policy_version 1474592 (0.0008) [2023-12-28 05:51:33,230][106226] Updated weights for policy 0, policy_version 1474602 (0.0008) [2023-12-28 05:51:33,289][106226] Updated weights for policy 0, policy_version 1474612 (0.0008) [2023-12-28 05:51:33,428][106225] Updated weights for policy 1, policy_version 1478105 (0.0008) [2023-12-28 05:51:33,470][106225] Updated weights for policy 1, policy_version 1478115 (0.0010) [2023-12-28 05:51:33,516][106225] Updated weights for policy 1, policy_version 1478125 (0.0010) [2023-12-28 05:51:33,558][106225] Updated weights for policy 1, policy_version 1478135 (0.0010) [2023-12-28 05:51:33,984][106226] Updated weights for policy 0, policy_version 1474622 (0.0007) [2023-12-28 05:51:34,054][106226] Updated weights for policy 0, policy_version 1474632 (0.0010) [2023-12-28 05:51:34,109][106226] Updated weights for policy 0, policy_version 1474642 (0.0005) [2023-12-28 05:51:34,269][106225] Updated weights for policy 1, policy_version 1478145 (0.0008) [2023-12-28 05:51:34,332][106225] Updated weights for policy 1, policy_version 1478155 (0.0008) [2023-12-28 05:51:34,394][106225] Updated weights for policy 1, policy_version 1478165 (0.0008) [2023-12-28 05:51:34,831][106226] Updated weights for policy 0, policy_version 1474652 (0.0007) [2023-12-28 05:51:34,885][106226] Updated weights for policy 0, policy_version 1474662 (0.0009) [2023-12-28 05:51:34,944][106226] Updated weights for policy 0, policy_version 1474672 (0.0009) [2023-12-28 05:51:35,068][106225] Updated weights for policy 1, policy_version 1478175 (0.0006) [2023-12-28 05:51:35,121][106225] Updated weights for policy 1, policy_version 1478185 (0.0005) [2023-12-28 05:51:35,169][106225] Updated weights for policy 1, policy_version 1478195 (0.0005) [2023-12-28 05:51:35,586][106226] Updated weights for policy 0, policy_version 1474683 (0.0010) [2023-12-28 05:51:35,640][106226] Updated weights for policy 0, policy_version 1474693 (0.0005) [2023-12-28 05:51:35,701][106226] Updated weights for policy 0, policy_version 1474703 (0.0005) [2023-12-28 05:51:35,899][106225] Updated weights for policy 1, policy_version 1478205 (0.0005) [2023-12-28 05:51:35,952][106225] Updated weights for policy 1, policy_version 1478215 (0.0006) [2023-12-28 05:51:36,010][106225] Updated weights for policy 1, policy_version 1478225 (0.0005) [2023-12-28 05:51:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 756080640. Throughput: 0: 9746.1, 1: 9876.6. Samples: 756088088. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:36,175][105115] Avg episode reward: [(0, '-4.839'), (1, '-4.494')] [2023-12-28 05:51:36,306][106226] Updated weights for policy 0, policy_version 1474713 (0.0005) [2023-12-28 05:51:36,363][106226] Updated weights for policy 0, policy_version 1474723 (0.0005) [2023-12-28 05:51:36,425][106226] Updated weights for policy 0, policy_version 1474733 (0.0007) [2023-12-28 05:51:36,493][106226] Updated weights for policy 0, policy_version 1474743 (0.0009) [2023-12-28 05:51:36,725][106225] Updated weights for policy 1, policy_version 1478235 (0.0006) [2023-12-28 05:51:36,784][106225] Updated weights for policy 1, policy_version 1478245 (0.0008) [2023-12-28 05:51:36,840][106225] Updated weights for policy 1, policy_version 1478255 (0.0010) [2023-12-28 05:51:37,145][106226] Updated weights for policy 0, policy_version 1474753 (0.0005) [2023-12-28 05:51:37,202][106226] Updated weights for policy 0, policy_version 1474763 (0.0005) [2023-12-28 05:51:37,265][106226] Updated weights for policy 0, policy_version 1474773 (0.0006) [2023-12-28 05:51:37,533][106225] Updated weights for policy 1, policy_version 1478265 (0.0010) [2023-12-28 05:51:37,584][106225] Updated weights for policy 1, policy_version 1478275 (0.0006) [2023-12-28 05:51:37,648][106225] Updated weights for policy 1, policy_version 1478285 (0.0007) [2023-12-28 05:51:37,700][106225] Updated weights for policy 1, policy_version 1478295 (0.0012) [2023-12-28 05:51:37,928][106226] Updated weights for policy 0, policy_version 1474783 (0.0008) [2023-12-28 05:51:37,981][106226] Updated weights for policy 0, policy_version 1474793 (0.0010) [2023-12-28 05:51:38,037][106226] Updated weights for policy 0, policy_version 1474803 (0.0008) [2023-12-28 05:51:38,340][106225] Updated weights for policy 1, policy_version 1478305 (0.0008) [2023-12-28 05:51:38,411][106225] Updated weights for policy 1, policy_version 1478315 (0.0010) [2023-12-28 05:51:38,476][106225] Updated weights for policy 1, policy_version 1478325 (0.0011) [2023-12-28 05:51:38,831][106226] Updated weights for policy 0, policy_version 1474813 (0.0008) [2023-12-28 05:51:38,886][106226] Updated weights for policy 0, policy_version 1474823 (0.0008) [2023-12-28 05:51:38,943][106226] Updated weights for policy 0, policy_version 1474833 (0.0008) [2023-12-28 05:51:39,196][106225] Updated weights for policy 1, policy_version 1478335 (0.0011) [2023-12-28 05:51:39,262][106225] Updated weights for policy 1, policy_version 1478345 (0.0010) [2023-12-28 05:51:39,320][106225] Updated weights for policy 1, policy_version 1478355 (0.0010) [2023-12-28 05:51:39,681][106226] Updated weights for policy 0, policy_version 1474843 (0.0008) [2023-12-28 05:51:39,746][106226] Updated weights for policy 0, policy_version 1474853 (0.0009) [2023-12-28 05:51:39,817][106226] Updated weights for policy 0, policy_version 1474863 (0.0009) [2023-12-28 05:51:40,080][106225] Updated weights for policy 1, policy_version 1478365 (0.0009) [2023-12-28 05:51:40,138][106225] Updated weights for policy 1, policy_version 1478375 (0.0009) [2023-12-28 05:51:40,200][106225] Updated weights for policy 1, policy_version 1478385 (0.0009) [2023-12-28 05:51:40,642][106226] Updated weights for policy 0, policy_version 1474873 (0.0008) [2023-12-28 05:51:40,714][106226] Updated weights for policy 0, policy_version 1474883 (0.0008) [2023-12-28 05:51:40,769][106226] Updated weights for policy 0, policy_version 1474893 (0.0008) [2023-12-28 05:51:40,820][106226] Updated weights for policy 0, policy_version 1474903 (0.0008) [2023-12-28 05:51:40,996][106225] Updated weights for policy 1, policy_version 1478395 (0.0009) [2023-12-28 05:51:41,055][106225] Updated weights for policy 1, policy_version 1478405 (0.0009) [2023-12-28 05:51:41,135][106225] Updated weights for policy 1, policy_version 1478415 (0.0009) [2023-12-28 05:51:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 756170752. Throughput: 0: 9717.4, 1: 9938.8. Samples: 756147268. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:41,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.828')] [2023-12-28 05:51:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001474904_377651200.pth... [2023-12-28 05:51:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001473784_377364480.pth [2023-12-28 05:51:41,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001478424_378527744.pth... [2023-12-28 05:51:41,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001477272_378232832.pth [2023-12-28 05:51:41,625][106226] Updated weights for policy 0, policy_version 1474913 (0.0008) [2023-12-28 05:51:41,696][106226] Updated weights for policy 0, policy_version 1474923 (0.0009) [2023-12-28 05:51:41,770][106226] Updated weights for policy 0, policy_version 1474933 (0.0008) [2023-12-28 05:51:41,937][106225] Updated weights for policy 1, policy_version 1478425 (0.0010) [2023-12-28 05:51:42,001][106225] Updated weights for policy 1, policy_version 1478435 (0.0007) [2023-12-28 05:51:42,065][106225] Updated weights for policy 1, policy_version 1478445 (0.0008) [2023-12-28 05:51:42,126][106225] Updated weights for policy 1, policy_version 1478455 (0.0006) [2023-12-28 05:51:42,484][106226] Updated weights for policy 0, policy_version 1474943 (0.0010) [2023-12-28 05:51:42,549][106226] Updated weights for policy 0, policy_version 1474953 (0.0011) [2023-12-28 05:51:42,611][106226] Updated weights for policy 0, policy_version 1474963 (0.0011) [2023-12-28 05:51:42,794][106225] Updated weights for policy 1, policy_version 1478465 (0.0007) [2023-12-28 05:51:42,856][106225] Updated weights for policy 1, policy_version 1478475 (0.0008) [2023-12-28 05:51:42,921][106225] Updated weights for policy 1, policy_version 1478485 (0.0010) [2023-12-28 05:51:43,220][106226] Updated weights for policy 0, policy_version 1474973 (0.0008) [2023-12-28 05:51:43,269][106226] Updated weights for policy 0, policy_version 1474983 (0.0006) [2023-12-28 05:51:43,323][106226] Updated weights for policy 0, policy_version 1474993 (0.0010) [2023-12-28 05:51:43,661][106225] Updated weights for policy 1, policy_version 1478495 (0.0009) [2023-12-28 05:51:43,721][106225] Updated weights for policy 1, policy_version 1478505 (0.0009) [2023-12-28 05:51:43,779][106225] Updated weights for policy 1, policy_version 1478515 (0.0006) [2023-12-28 05:51:43,889][106226] Updated weights for policy 0, policy_version 1475003 (0.0009) [2023-12-28 05:51:43,949][106226] Updated weights for policy 0, policy_version 1475013 (0.0006) [2023-12-28 05:51:44,008][106226] Updated weights for policy 0, policy_version 1475023 (0.0005) [2023-12-28 05:51:44,410][106225] Updated weights for policy 1, policy_version 1478525 (0.0005) [2023-12-28 05:51:44,460][106225] Updated weights for policy 1, policy_version 1478535 (0.0007) [2023-12-28 05:51:44,507][106225] Updated weights for policy 1, policy_version 1478545 (0.0005) [2023-12-28 05:51:44,574][106226] Updated weights for policy 0, policy_version 1475033 (0.0006) [2023-12-28 05:51:44,643][106226] Updated weights for policy 0, policy_version 1475043 (0.0010) [2023-12-28 05:51:44,705][106226] Updated weights for policy 0, policy_version 1475053 (0.0008) [2023-12-28 05:51:44,769][106226] Updated weights for policy 0, policy_version 1475063 (0.0006) [2023-12-28 05:51:45,164][106225] Updated weights for policy 1, policy_version 1478555 (0.0005) [2023-12-28 05:51:45,228][106225] Updated weights for policy 1, policy_version 1478565 (0.0006) [2023-12-28 05:51:45,288][106225] Updated weights for policy 1, policy_version 1478575 (0.0006) [2023-12-28 05:51:45,552][106226] Updated weights for policy 0, policy_version 1475073 (0.0008) [2023-12-28 05:51:45,606][106226] Updated weights for policy 0, policy_version 1475083 (0.0009) [2023-12-28 05:51:45,657][106226] Updated weights for policy 0, policy_version 1475093 (0.0009) [2023-12-28 05:51:45,914][106225] Updated weights for policy 1, policy_version 1478585 (0.0006) [2023-12-28 05:51:45,978][106225] Updated weights for policy 1, policy_version 1478595 (0.0006) [2023-12-28 05:51:46,044][106225] Updated weights for policy 1, policy_version 1478605 (0.0007) [2023-12-28 05:51:46,110][106225] Updated weights for policy 1, policy_version 1478615 (0.0007) [2023-12-28 05:51:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 756277248. Throughput: 0: 9775.6, 1: 9822.0. Samples: 756264796. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-28 05:51:46,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-4.676')] [2023-12-28 05:51:46,412][106226] Updated weights for policy 0, policy_version 1475103 (0.0009) [2023-12-28 05:51:46,464][106226] Updated weights for policy 0, policy_version 1475113 (0.0008) [2023-12-28 05:51:46,525][106226] Updated weights for policy 0, policy_version 1475123 (0.0009) [2023-12-28 05:51:46,693][106225] Updated weights for policy 1, policy_version 1478625 (0.0005) [2023-12-28 05:51:46,744][106225] Updated weights for policy 1, policy_version 1478635 (0.0005) [2023-12-28 05:51:46,810][106225] Updated weights for policy 1, policy_version 1478645 (0.0006) [2023-12-28 05:51:47,299][106226] Updated weights for policy 0, policy_version 1475133 (0.0009) [2023-12-28 05:51:47,357][106226] Updated weights for policy 0, policy_version 1475143 (0.0009) [2023-12-28 05:51:47,412][106226] Updated weights for policy 0, policy_version 1475153 (0.0009) [2023-12-28 05:51:47,436][106225] Updated weights for policy 1, policy_version 1478655 (0.0007) [2023-12-28 05:51:47,496][106225] Updated weights for policy 1, policy_version 1478665 (0.0005) [2023-12-28 05:51:47,554][106225] Updated weights for policy 1, policy_version 1478675 (0.0005) [2023-12-28 05:51:48,080][106225] Updated weights for policy 1, policy_version 1478685 (0.0005) [2023-12-28 05:51:48,133][106225] Updated weights for policy 1, policy_version 1478695 (0.0005) [2023-12-28 05:51:48,198][106225] Updated weights for policy 1, policy_version 1478705 (0.0005) [2023-12-28 05:51:48,238][106226] Updated weights for policy 0, policy_version 1475163 (0.0008) [2023-12-28 05:51:48,296][106226] Updated weights for policy 0, policy_version 1475173 (0.0010) [2023-12-28 05:51:48,359][106226] Updated weights for policy 0, policy_version 1475183 (0.0008) [2023-12-28 05:51:48,798][106225] Updated weights for policy 1, policy_version 1478715 (0.0006) [2023-12-28 05:51:48,850][106225] Updated weights for policy 1, policy_version 1478725 (0.0008) [2023-12-28 05:51:48,902][106225] Updated weights for policy 1, policy_version 1478735 (0.0008) [2023-12-28 05:51:49,098][106226] Updated weights for policy 0, policy_version 1475193 (0.0008) [2023-12-28 05:51:49,174][106226] Updated weights for policy 0, policy_version 1475203 (0.0008) [2023-12-28 05:51:49,250][106226] Updated weights for policy 0, policy_version 1475213 (0.0009) [2023-12-28 05:51:49,322][106226] Updated weights for policy 0, policy_version 1475223 (0.0008) [2023-12-28 05:51:49,647][106225] Updated weights for policy 1, policy_version 1478745 (0.0008) [2023-12-28 05:51:49,711][106225] Updated weights for policy 1, policy_version 1478755 (0.0009) [2023-12-28 05:51:49,773][106225] Updated weights for policy 1, policy_version 1478765 (0.0008) [2023-12-28 05:51:49,839][106225] Updated weights for policy 1, policy_version 1478775 (0.0008) [2023-12-28 05:51:50,063][106226] Updated weights for policy 0, policy_version 1475233 (0.0008) [2023-12-28 05:51:50,137][106226] Updated weights for policy 0, policy_version 1475243 (0.0008) [2023-12-28 05:51:50,198][106226] Updated weights for policy 0, policy_version 1475253 (0.0009) [2023-12-28 05:51:50,494][106225] Updated weights for policy 1, policy_version 1478785 (0.0008) [2023-12-28 05:51:50,561][106225] Updated weights for policy 1, policy_version 1478795 (0.0009) [2023-12-28 05:51:50,634][106225] Updated weights for policy 1, policy_version 1478805 (0.0007) [2023-12-28 05:51:50,945][106226] Updated weights for policy 0, policy_version 1475263 (0.0009) [2023-12-28 05:51:51,004][106226] Updated weights for policy 0, policy_version 1475273 (0.0008) [2023-12-28 05:51:51,074][106226] Updated weights for policy 0, policy_version 1475283 (0.0007) [2023-12-28 05:51:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 756375552. Throughput: 0: 9598.2, 1: 9929.7. Samples: 756383592. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:51:51,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.953')] [2023-12-28 05:51:51,245][106225] Updated weights for policy 1, policy_version 1478815 (0.0008) [2023-12-28 05:51:51,308][106225] Updated weights for policy 1, policy_version 1478825 (0.0008) [2023-12-28 05:51:51,383][106225] Updated weights for policy 1, policy_version 1478835 (0.0008) [2023-12-28 05:51:51,831][106226] Updated weights for policy 0, policy_version 1475293 (0.0007) [2023-12-28 05:51:51,880][106226] Updated weights for policy 0, policy_version 1475303 (0.0007) [2023-12-28 05:51:51,933][106226] Updated weights for policy 0, policy_version 1475313 (0.0008) [2023-12-28 05:51:52,087][106225] Updated weights for policy 1, policy_version 1478845 (0.0008) [2023-12-28 05:51:52,148][106225] Updated weights for policy 1, policy_version 1478855 (0.0008) [2023-12-28 05:51:52,197][106225] Updated weights for policy 1, policy_version 1478865 (0.0008) [2023-12-28 05:51:52,671][106226] Updated weights for policy 0, policy_version 1475323 (0.0007) [2023-12-28 05:51:52,718][106226] Updated weights for policy 0, policy_version 1475333 (0.0007) [2023-12-28 05:51:52,770][106226] Updated weights for policy 0, policy_version 1475343 (0.0006) [2023-12-28 05:51:53,036][106225] Updated weights for policy 1, policy_version 1478875 (0.0009) [2023-12-28 05:51:53,101][106225] Updated weights for policy 1, policy_version 1478885 (0.0010) [2023-12-28 05:51:53,165][106225] Updated weights for policy 1, policy_version 1478895 (0.0008) [2023-12-28 05:51:53,343][106226] Updated weights for policy 0, policy_version 1475353 (0.0005) [2023-12-28 05:51:53,408][106226] Updated weights for policy 0, policy_version 1475363 (0.0008) [2023-12-28 05:51:53,460][106226] Updated weights for policy 0, policy_version 1475373 (0.0007) [2023-12-28 05:51:53,523][106226] Updated weights for policy 0, policy_version 1475383 (0.0005) [2023-12-28 05:51:53,962][106225] Updated weights for policy 1, policy_version 1478905 (0.0008) [2023-12-28 05:51:54,019][106225] Updated weights for policy 1, policy_version 1478915 (0.0009) [2023-12-28 05:51:54,055][106226] Updated weights for policy 0, policy_version 1475393 (0.0005) [2023-12-28 05:51:54,076][106225] Updated weights for policy 1, policy_version 1478925 (0.0009) [2023-12-28 05:51:54,113][106226] Updated weights for policy 0, policy_version 1475403 (0.0005) [2023-12-28 05:51:54,132][106225] Updated weights for policy 1, policy_version 1478935 (0.0008) [2023-12-28 05:51:54,169][106226] Updated weights for policy 0, policy_version 1475413 (0.0005) [2023-12-28 05:51:54,724][106226] Updated weights for policy 0, policy_version 1475423 (0.0005) [2023-12-28 05:51:54,771][106226] Updated weights for policy 0, policy_version 1475433 (0.0005) [2023-12-28 05:51:54,836][106226] Updated weights for policy 0, policy_version 1475443 (0.0005) [2023-12-28 05:51:54,931][106225] Updated weights for policy 1, policy_version 1478945 (0.0009) [2023-12-28 05:51:54,981][106225] Updated weights for policy 1, policy_version 1478955 (0.0008) [2023-12-28 05:51:55,043][106225] Updated weights for policy 1, policy_version 1478965 (0.0008) [2023-12-28 05:51:55,368][106226] Updated weights for policy 0, policy_version 1475453 (0.0005) [2023-12-28 05:51:55,421][106226] Updated weights for policy 0, policy_version 1475463 (0.0005) [2023-12-28 05:51:55,483][106226] Updated weights for policy 0, policy_version 1475473 (0.0005) [2023-12-28 05:51:55,871][106225] Updated weights for policy 1, policy_version 1478975 (0.0009) [2023-12-28 05:51:55,925][106225] Updated weights for policy 1, policy_version 1478985 (0.0008) [2023-12-28 05:51:55,985][106225] Updated weights for policy 1, policy_version 1478995 (0.0009) [2023-12-28 05:51:56,066][106226] Updated weights for policy 0, policy_version 1475483 (0.0005) [2023-12-28 05:51:56,117][106226] Updated weights for policy 0, policy_version 1475493 (0.0006) [2023-12-28 05:51:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 756473856. Throughput: 0: 9625.2, 1: 9931.2. Samples: 756444348. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:51:56,176][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.824')] [2023-12-28 05:51:56,181][106226] Updated weights for policy 0, policy_version 1475503 (0.0009) [2023-12-28 05:51:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001479000_378675200.pth... [2023-12-28 05:51:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001477848_378380288.pth [2023-12-28 05:51:56,229][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001475512_377806848.pth... [2023-12-28 05:51:56,233][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001474328_377503744.pth [2023-12-28 05:51:56,750][106226] Updated weights for policy 0, policy_version 1475513 (0.0008) [2023-12-28 05:51:56,784][106225] Updated weights for policy 1, policy_version 1479005 (0.0008) [2023-12-28 05:51:56,805][106226] Updated weights for policy 0, policy_version 1475523 (0.0009) [2023-12-28 05:51:56,834][106225] Updated weights for policy 1, policy_version 1479015 (0.0006) [2023-12-28 05:51:56,869][106226] Updated weights for policy 0, policy_version 1475533 (0.0007) [2023-12-28 05:51:56,907][106225] Updated weights for policy 1, policy_version 1479025 (0.0006) [2023-12-28 05:51:56,917][106226] Updated weights for policy 0, policy_version 1475543 (0.0007) [2023-12-28 05:51:57,608][106226] Updated weights for policy 0, policy_version 1475553 (0.0008) [2023-12-28 05:51:57,643][106225] Updated weights for policy 1, policy_version 1479035 (0.0006) [2023-12-28 05:51:57,661][106226] Updated weights for policy 0, policy_version 1475563 (0.0008) [2023-12-28 05:51:57,695][106225] Updated weights for policy 1, policy_version 1479045 (0.0005) [2023-12-28 05:51:57,724][106226] Updated weights for policy 0, policy_version 1475573 (0.0008) [2023-12-28 05:51:57,753][106225] Updated weights for policy 1, policy_version 1479055 (0.0007) [2023-12-28 05:51:58,415][106226] Updated weights for policy 0, policy_version 1475583 (0.0006) [2023-12-28 05:51:58,483][106226] Updated weights for policy 0, policy_version 1475593 (0.0008) [2023-12-28 05:51:58,512][106225] Updated weights for policy 1, policy_version 1479065 (0.0008) [2023-12-28 05:51:58,547][106226] Updated weights for policy 0, policy_version 1475603 (0.0008) [2023-12-28 05:51:58,577][106225] Updated weights for policy 1, policy_version 1479075 (0.0008) [2023-12-28 05:51:58,636][106225] Updated weights for policy 1, policy_version 1479086 (0.0010) [2023-12-28 05:51:58,690][106225] Updated weights for policy 1, policy_version 1479096 (0.0008) [2023-12-28 05:51:59,344][106226] Updated weights for policy 0, policy_version 1475613 (0.0009) [2023-12-28 05:51:59,407][106226] Updated weights for policy 0, policy_version 1475623 (0.0011) [2023-12-28 05:51:59,476][106226] Updated weights for policy 0, policy_version 1475633 (0.0011) [2023-12-28 05:51:59,482][106225] Updated weights for policy 1, policy_version 1479106 (0.0008) [2023-12-28 05:51:59,537][106225] Updated weights for policy 1, policy_version 1479116 (0.0007) [2023-12-28 05:51:59,595][106225] Updated weights for policy 1, policy_version 1479126 (0.0008) [2023-12-28 05:52:00,218][106226] Updated weights for policy 0, policy_version 1475643 (0.0011) [2023-12-28 05:52:00,278][106226] Updated weights for policy 0, policy_version 1475653 (0.0010) [2023-12-28 05:52:00,339][106226] Updated weights for policy 0, policy_version 1475663 (0.0009) [2023-12-28 05:52:00,363][106225] Updated weights for policy 1, policy_version 1479136 (0.0008) [2023-12-28 05:52:00,419][106225] Updated weights for policy 1, policy_version 1479146 (0.0009) [2023-12-28 05:52:00,483][106225] Updated weights for policy 1, policy_version 1479156 (0.0010) [2023-12-28 05:52:00,975][106226] Updated weights for policy 0, policy_version 1475673 (0.0009) [2023-12-28 05:52:01,031][106226] Updated weights for policy 0, policy_version 1475683 (0.0007) [2023-12-28 05:52:01,093][106226] Updated weights for policy 0, policy_version 1475693 (0.0009) [2023-12-28 05:52:01,160][106226] Updated weights for policy 0, policy_version 1475703 (0.0008) [2023-12-28 05:52:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 756572160. Throughput: 0: 9787.6, 1: 9778.7. Samples: 756560600. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:01,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-4.666')] [2023-12-28 05:52:01,217][106225] Updated weights for policy 1, policy_version 1479166 (0.0009) [2023-12-28 05:52:01,285][106225] Updated weights for policy 1, policy_version 1479176 (0.0009) [2023-12-28 05:52:01,345][106225] Updated weights for policy 1, policy_version 1479186 (0.0008) [2023-12-28 05:52:01,878][106226] Updated weights for policy 0, policy_version 1475713 (0.0008) [2023-12-28 05:52:01,935][106226] Updated weights for policy 0, policy_version 1475723 (0.0007) [2023-12-28 05:52:01,992][106226] Updated weights for policy 0, policy_version 1475733 (0.0008) [2023-12-28 05:52:02,052][106225] Updated weights for policy 1, policy_version 1479196 (0.0009) [2023-12-28 05:52:02,105][106225] Updated weights for policy 1, policy_version 1479206 (0.0008) [2023-12-28 05:52:02,162][106225] Updated weights for policy 1, policy_version 1479216 (0.0009) [2023-12-28 05:52:02,715][106226] Updated weights for policy 0, policy_version 1475743 (0.0009) [2023-12-28 05:52:02,768][106226] Updated weights for policy 0, policy_version 1475753 (0.0007) [2023-12-28 05:52:02,819][106226] Updated weights for policy 0, policy_version 1475763 (0.0007) [2023-12-28 05:52:02,825][106225] Updated weights for policy 1, policy_version 1479226 (0.0009) [2023-12-28 05:52:02,877][106225] Updated weights for policy 1, policy_version 1479236 (0.0007) [2023-12-28 05:52:02,925][106225] Updated weights for policy 1, policy_version 1479246 (0.0008) [2023-12-28 05:52:02,969][106225] Updated weights for policy 1, policy_version 1479256 (0.0008) [2023-12-28 05:52:03,500][106226] Updated weights for policy 0, policy_version 1475773 (0.0006) [2023-12-28 05:52:03,548][106226] Updated weights for policy 0, policy_version 1475783 (0.0005) [2023-12-28 05:52:03,593][106226] Updated weights for policy 0, policy_version 1475793 (0.0005) [2023-12-28 05:52:03,742][106225] Updated weights for policy 1, policy_version 1479266 (0.0010) [2023-12-28 05:52:03,798][106225] Updated weights for policy 1, policy_version 1479276 (0.0010) [2023-12-28 05:52:03,855][106225] Updated weights for policy 1, policy_version 1479286 (0.0009) [2023-12-28 05:52:04,236][106226] Updated weights for policy 0, policy_version 1475803 (0.0007) [2023-12-28 05:52:04,300][106226] Updated weights for policy 0, policy_version 1475813 (0.0011) [2023-12-28 05:52:04,361][106226] Updated weights for policy 0, policy_version 1475823 (0.0011) [2023-12-28 05:52:04,574][106225] Updated weights for policy 1, policy_version 1479296 (0.0010) [2023-12-28 05:52:04,630][106225] Updated weights for policy 1, policy_version 1479306 (0.0010) [2023-12-28 05:52:04,677][106225] Updated weights for policy 1, policy_version 1479316 (0.0010) [2023-12-28 05:52:05,059][106226] Updated weights for policy 0, policy_version 1475833 (0.0011) [2023-12-28 05:52:05,110][106226] Updated weights for policy 0, policy_version 1475843 (0.0009) [2023-12-28 05:52:05,160][106226] Updated weights for policy 0, policy_version 1475853 (0.0009) [2023-12-28 05:52:05,210][106226] Updated weights for policy 0, policy_version 1475863 (0.0009) [2023-12-28 05:52:05,247][106225] Updated weights for policy 1, policy_version 1479326 (0.0009) [2023-12-28 05:52:05,303][106225] Updated weights for policy 1, policy_version 1479336 (0.0010) [2023-12-28 05:52:05,349][106225] Updated weights for policy 1, policy_version 1479346 (0.0010) [2023-12-28 05:52:05,919][106226] Updated weights for policy 0, policy_version 1475873 (0.0008) [2023-12-28 05:52:05,975][106226] Updated weights for policy 0, policy_version 1475883 (0.0007) [2023-12-28 05:52:06,029][106226] Updated weights for policy 0, policy_version 1475893 (0.0008) [2023-12-28 05:52:06,051][106225] Updated weights for policy 1, policy_version 1479356 (0.0010) [2023-12-28 05:52:06,112][106225] Updated weights for policy 1, policy_version 1479366 (0.0010) [2023-12-28 05:52:06,173][106225] Updated weights for policy 1, policy_version 1479376 (0.0009) [2023-12-28 05:52:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 756670464. Throughput: 0: 9828.5, 1: 9863.5. Samples: 756680312. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:06,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-4.629')] [2023-12-28 05:52:06,796][106226] Updated weights for policy 0, policy_version 1475903 (0.0007) [2023-12-28 05:52:06,848][106226] Updated weights for policy 0, policy_version 1475913 (0.0008) [2023-12-28 05:52:06,902][106226] Updated weights for policy 0, policy_version 1475923 (0.0008) [2023-12-28 05:52:06,942][106225] Updated weights for policy 1, policy_version 1479386 (0.0011) [2023-12-28 05:52:06,990][106225] Updated weights for policy 1, policy_version 1479396 (0.0010) [2023-12-28 05:52:07,045][106225] Updated weights for policy 1, policy_version 1479406 (0.0010) [2023-12-28 05:52:07,097][106225] Updated weights for policy 1, policy_version 1479416 (0.0006) [2023-12-28 05:52:07,620][106226] Updated weights for policy 0, policy_version 1475933 (0.0008) [2023-12-28 05:52:07,676][106226] Updated weights for policy 0, policy_version 1475943 (0.0005) [2023-12-28 05:52:07,707][106225] Updated weights for policy 1, policy_version 1479426 (0.0008) [2023-12-28 05:52:07,725][106226] Updated weights for policy 0, policy_version 1475953 (0.0005) [2023-12-28 05:52:07,758][106225] Updated weights for policy 1, policy_version 1479436 (0.0009) [2023-12-28 05:52:07,815][106225] Updated weights for policy 1, policy_version 1479446 (0.0010) [2023-12-28 05:52:08,307][106226] Updated weights for policy 0, policy_version 1475963 (0.0007) [2023-12-28 05:52:08,369][106226] Updated weights for policy 0, policy_version 1475973 (0.0009) [2023-12-28 05:52:08,431][106226] Updated weights for policy 0, policy_version 1475983 (0.0008) [2023-12-28 05:52:08,490][106225] Updated weights for policy 1, policy_version 1479456 (0.0010) [2023-12-28 05:52:08,554][106225] Updated weights for policy 1, policy_version 1479466 (0.0011) [2023-12-28 05:52:08,612][106225] Updated weights for policy 1, policy_version 1479476 (0.0010) [2023-12-28 05:52:09,173][106226] Updated weights for policy 0, policy_version 1475993 (0.0007) [2023-12-28 05:52:09,230][106226] Updated weights for policy 0, policy_version 1476003 (0.0008) [2023-12-28 05:52:09,298][106226] Updated weights for policy 0, policy_version 1476013 (0.0006) [2023-12-28 05:52:09,331][106225] Updated weights for policy 1, policy_version 1479486 (0.0008) [2023-12-28 05:52:09,361][106226] Updated weights for policy 0, policy_version 1476023 (0.0008) [2023-12-28 05:52:09,403][106225] Updated weights for policy 1, policy_version 1479496 (0.0008) [2023-12-28 05:52:09,473][106225] Updated weights for policy 1, policy_version 1479506 (0.0009) [2023-12-28 05:52:10,084][106226] Updated weights for policy 0, policy_version 1476033 (0.0011) [2023-12-28 05:52:10,152][106226] Updated weights for policy 0, policy_version 1476043 (0.0011) [2023-12-28 05:52:10,185][106225] Updated weights for policy 1, policy_version 1479516 (0.0007) [2023-12-28 05:52:10,203][106226] Updated weights for policy 0, policy_version 1476053 (0.0010) [2023-12-28 05:52:10,242][106225] Updated weights for policy 1, policy_version 1479526 (0.0007) [2023-12-28 05:52:10,309][106225] Updated weights for policy 1, policy_version 1479536 (0.0008) [2023-12-28 05:52:10,827][106226] Updated weights for policy 0, policy_version 1476063 (0.0006) [2023-12-28 05:52:10,884][106226] Updated weights for policy 0, policy_version 1476073 (0.0005) [2023-12-28 05:52:10,943][106226] Updated weights for policy 0, policy_version 1476083 (0.0005) [2023-12-28 05:52:11,077][106225] Updated weights for policy 1, policy_version 1479546 (0.0010) [2023-12-28 05:52:11,139][106225] Updated weights for policy 1, policy_version 1479556 (0.0009) [2023-12-28 05:52:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 756768768. Throughput: 0: 9887.4, 1: 9898.7. Samples: 756740700. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:11,175][105115] Avg episode reward: [(0, '-4.977'), (1, '-4.766')] [2023-12-28 05:52:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001476088_377954304.pth... [2023-12-28 05:52:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001474904_377651200.pth [2023-12-28 05:52:11,198][106225] Updated weights for policy 1, policy_version 1479566 (0.0009) [2023-12-28 05:52:11,258][106225] Updated weights for policy 1, policy_version 1479576 (0.0010) [2023-12-28 05:52:11,259][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001479576_378822656.pth... [2023-12-28 05:52:11,264][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001478424_378527744.pth [2023-12-28 05:52:11,672][106226] Updated weights for policy 0, policy_version 1476093 (0.0011) [2023-12-28 05:52:11,744][106226] Updated weights for policy 0, policy_version 1476103 (0.0008) [2023-12-28 05:52:11,806][106226] Updated weights for policy 0, policy_version 1476113 (0.0009) [2023-12-28 05:52:12,077][106225] Updated weights for policy 1, policy_version 1479586 (0.0008) [2023-12-28 05:52:12,134][106225] Updated weights for policy 1, policy_version 1479596 (0.0008) [2023-12-28 05:52:12,194][106225] Updated weights for policy 1, policy_version 1479606 (0.0008) [2023-12-28 05:52:12,567][106226] Updated weights for policy 0, policy_version 1476123 (0.0008) [2023-12-28 05:52:12,627][106226] Updated weights for policy 0, policy_version 1476133 (0.0007) [2023-12-28 05:52:12,687][106226] Updated weights for policy 0, policy_version 1476143 (0.0008) [2023-12-28 05:52:12,932][106225] Updated weights for policy 1, policy_version 1479616 (0.0008) [2023-12-28 05:52:12,985][106225] Updated weights for policy 1, policy_version 1479626 (0.0009) [2023-12-28 05:52:13,038][106225] Updated weights for policy 1, policy_version 1479636 (0.0009) [2023-12-28 05:52:13,382][106226] Updated weights for policy 0, policy_version 1476153 (0.0007) [2023-12-28 05:52:13,443][106226] Updated weights for policy 0, policy_version 1476163 (0.0006) [2023-12-28 05:52:13,501][106226] Updated weights for policy 0, policy_version 1476173 (0.0005) [2023-12-28 05:52:13,558][106226] Updated weights for policy 0, policy_version 1476183 (0.0005) [2023-12-28 05:52:13,824][106225] Updated weights for policy 1, policy_version 1479646 (0.0006) [2023-12-28 05:52:13,876][106225] Updated weights for policy 1, policy_version 1479656 (0.0007) [2023-12-28 05:52:13,918][106225] Updated weights for policy 1, policy_version 1479666 (0.0005) [2023-12-28 05:52:14,163][106226] Updated weights for policy 0, policy_version 1476193 (0.0009) [2023-12-28 05:52:14,213][106226] Updated weights for policy 0, policy_version 1476203 (0.0009) [2023-12-28 05:52:14,266][106226] Updated weights for policy 0, policy_version 1476213 (0.0008) [2023-12-28 05:52:14,525][106225] Updated weights for policy 1, policy_version 1479676 (0.0007) [2023-12-28 05:52:14,583][106225] Updated weights for policy 1, policy_version 1479686 (0.0009) [2023-12-28 05:52:14,646][106225] Updated weights for policy 1, policy_version 1479696 (0.0009) [2023-12-28 05:52:14,967][106226] Updated weights for policy 0, policy_version 1476223 (0.0010) [2023-12-28 05:52:15,028][106226] Updated weights for policy 0, policy_version 1476233 (0.0011) [2023-12-28 05:52:15,090][106226] Updated weights for policy 0, policy_version 1476243 (0.0010) [2023-12-28 05:52:15,408][106225] Updated weights for policy 1, policy_version 1479706 (0.0007) [2023-12-28 05:52:15,459][106225] Updated weights for policy 1, policy_version 1479716 (0.0008) [2023-12-28 05:52:15,520][106225] Updated weights for policy 1, policy_version 1479726 (0.0008) [2023-12-28 05:52:15,566][106225] Updated weights for policy 1, policy_version 1479736 (0.0007) [2023-12-28 05:52:15,786][106226] Updated weights for policy 0, policy_version 1476253 (0.0011) [2023-12-28 05:52:15,830][106226] Updated weights for policy 0, policy_version 1476263 (0.0005) [2023-12-28 05:52:15,883][106226] Updated weights for policy 0, policy_version 1476273 (0.0008) [2023-12-28 05:52:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 756867072. Throughput: 0: 9965.6, 1: 9763.2. Samples: 756856648. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:16,176][105115] Avg episode reward: [(0, '-4.690'), (1, '-4.739')] [2023-12-28 05:52:16,317][106225] Updated weights for policy 1, policy_version 1479746 (0.0006) [2023-12-28 05:52:16,380][106225] Updated weights for policy 1, policy_version 1479756 (0.0006) [2023-12-28 05:52:16,450][106225] Updated weights for policy 1, policy_version 1479766 (0.0009) [2023-12-28 05:52:16,566][106226] Updated weights for policy 0, policy_version 1476283 (0.0009) [2023-12-28 05:52:16,620][106226] Updated weights for policy 0, policy_version 1476293 (0.0006) [2023-12-28 05:52:16,677][106226] Updated weights for policy 0, policy_version 1476303 (0.0007) [2023-12-28 05:52:17,164][106225] Updated weights for policy 1, policy_version 1479776 (0.0008) [2023-12-28 05:52:17,226][106225] Updated weights for policy 1, policy_version 1479786 (0.0007) [2023-12-28 05:52:17,273][106225] Updated weights for policy 1, policy_version 1479796 (0.0008) [2023-12-28 05:52:17,363][106226] Updated weights for policy 0, policy_version 1476313 (0.0010) [2023-12-28 05:52:17,433][106226] Updated weights for policy 0, policy_version 1476323 (0.0006) [2023-12-28 05:52:17,488][106226] Updated weights for policy 0, policy_version 1476333 (0.0005) [2023-12-28 05:52:17,553][106226] Updated weights for policy 0, policy_version 1476343 (0.0006) [2023-12-28 05:52:18,055][106225] Updated weights for policy 1, policy_version 1479806 (0.0006) [2023-12-28 05:52:18,114][106225] Updated weights for policy 1, policy_version 1479816 (0.0007) [2023-12-28 05:52:18,162][106226] Updated weights for policy 0, policy_version 1476353 (0.0006) [2023-12-28 05:52:18,174][106225] Updated weights for policy 1, policy_version 1479826 (0.0009) [2023-12-28 05:52:18,224][106226] Updated weights for policy 0, policy_version 1476363 (0.0006) [2023-12-28 05:52:18,278][106226] Updated weights for policy 0, policy_version 1476373 (0.0006) [2023-12-28 05:52:18,887][106226] Updated weights for policy 0, policy_version 1476383 (0.0006) [2023-12-28 05:52:18,953][106226] Updated weights for policy 0, policy_version 1476393 (0.0006) [2023-12-28 05:52:18,978][106225] Updated weights for policy 1, policy_version 1479836 (0.0007) [2023-12-28 05:52:19,011][106226] Updated weights for policy 0, policy_version 1476403 (0.0006) [2023-12-28 05:52:19,037][106225] Updated weights for policy 1, policy_version 1479846 (0.0006) [2023-12-28 05:52:19,091][106225] Updated weights for policy 1, policy_version 1479856 (0.0009) [2023-12-28 05:52:19,625][106226] Updated weights for policy 0, policy_version 1476413 (0.0005) [2023-12-28 05:52:19,692][106226] Updated weights for policy 0, policy_version 1476423 (0.0007) [2023-12-28 05:52:19,752][106226] Updated weights for policy 0, policy_version 1476433 (0.0008) [2023-12-28 05:52:19,988][106225] Updated weights for policy 1, policy_version 1479866 (0.0009) [2023-12-28 05:52:20,055][106225] Updated weights for policy 1, policy_version 1479876 (0.0008) [2023-12-28 05:52:20,115][106225] Updated weights for policy 1, policy_version 1479886 (0.0009) [2023-12-28 05:52:20,180][106225] Updated weights for policy 1, policy_version 1479896 (0.0008) [2023-12-28 05:52:20,445][106226] Updated weights for policy 0, policy_version 1476443 (0.0008) [2023-12-28 05:52:20,506][106226] Updated weights for policy 0, policy_version 1476453 (0.0008) [2023-12-28 05:52:20,559][106226] Updated weights for policy 0, policy_version 1476463 (0.0009) [2023-12-28 05:52:20,923][106225] Updated weights for policy 1, policy_version 1479906 (0.0009) [2023-12-28 05:52:20,990][106225] Updated weights for policy 1, policy_version 1479916 (0.0009) [2023-12-28 05:52:21,057][106225] Updated weights for policy 1, policy_version 1479926 (0.0009) [2023-12-28 05:52:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 756965376. Throughput: 0: 10029.8, 1: 9662.7. Samples: 756974248. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:21,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.522')] [2023-12-28 05:52:21,337][106226] Updated weights for policy 0, policy_version 1476473 (0.0010) [2023-12-28 05:52:21,414][106226] Updated weights for policy 0, policy_version 1476483 (0.0008) [2023-12-28 05:52:21,462][106226] Updated weights for policy 0, policy_version 1476493 (0.0008) [2023-12-28 05:52:21,510][106226] Updated weights for policy 0, policy_version 1476503 (0.0008) [2023-12-28 05:52:21,839][106225] Updated weights for policy 1, policy_version 1479936 (0.0010) [2023-12-28 05:52:21,902][106225] Updated weights for policy 1, policy_version 1479946 (0.0008) [2023-12-28 05:52:21,966][106225] Updated weights for policy 1, policy_version 1479956 (0.0009) [2023-12-28 05:52:22,280][106226] Updated weights for policy 0, policy_version 1476513 (0.0009) [2023-12-28 05:52:22,343][106226] Updated weights for policy 0, policy_version 1476523 (0.0012) [2023-12-28 05:52:22,412][106226] Updated weights for policy 0, policy_version 1476533 (0.0010) [2023-12-28 05:52:22,753][106225] Updated weights for policy 1, policy_version 1479966 (0.0008) [2023-12-28 05:52:22,815][106225] Updated weights for policy 1, policy_version 1479976 (0.0007) [2023-12-28 05:52:22,869][106225] Updated weights for policy 1, policy_version 1479986 (0.0007) [2023-12-28 05:52:23,142][106226] Updated weights for policy 0, policy_version 1476543 (0.0007) [2023-12-28 05:52:23,200][106226] Updated weights for policy 0, policy_version 1476553 (0.0007) [2023-12-28 05:52:23,259][106226] Updated weights for policy 0, policy_version 1476563 (0.0006) [2023-12-28 05:52:23,482][106225] Updated weights for policy 1, policy_version 1479996 (0.0008) [2023-12-28 05:52:23,538][106225] Updated weights for policy 1, policy_version 1480006 (0.0008) [2023-12-28 05:52:23,593][106225] Updated weights for policy 1, policy_version 1480016 (0.0007) [2023-12-28 05:52:23,963][106226] Updated weights for policy 0, policy_version 1476573 (0.0006) [2023-12-28 05:52:24,025][106226] Updated weights for policy 0, policy_version 1476583 (0.0006) [2023-12-28 05:52:24,086][106226] Updated weights for policy 0, policy_version 1476593 (0.0007) [2023-12-28 05:52:24,137][106225] Updated weights for policy 1, policy_version 1480026 (0.0006) [2023-12-28 05:52:24,184][106225] Updated weights for policy 1, policy_version 1480036 (0.0007) [2023-12-28 05:52:24,241][106225] Updated weights for policy 1, policy_version 1480046 (0.0008) [2023-12-28 05:52:24,302][106225] Updated weights for policy 1, policy_version 1480056 (0.0008) [2023-12-28 05:52:24,758][106226] Updated weights for policy 0, policy_version 1476603 (0.0008) [2023-12-28 05:52:24,809][106226] Updated weights for policy 0, policy_version 1476613 (0.0010) [2023-12-28 05:52:24,863][106226] Updated weights for policy 0, policy_version 1476623 (0.0010) [2023-12-28 05:52:25,048][106225] Updated weights for policy 1, policy_version 1480066 (0.0007) [2023-12-28 05:52:25,091][106225] Updated weights for policy 1, policy_version 1480076 (0.0008) [2023-12-28 05:52:25,137][106225] Updated weights for policy 1, policy_version 1480086 (0.0007) [2023-12-28 05:52:25,598][106226] Updated weights for policy 0, policy_version 1476633 (0.0010) [2023-12-28 05:52:25,660][106226] Updated weights for policy 0, policy_version 1476643 (0.0010) [2023-12-28 05:52:25,712][106226] Updated weights for policy 0, policy_version 1476653 (0.0010) [2023-12-28 05:52:25,765][106226] Updated weights for policy 0, policy_version 1476663 (0.0007) [2023-12-28 05:52:25,849][106225] Updated weights for policy 1, policy_version 1480096 (0.0009) [2023-12-28 05:52:25,901][106225] Updated weights for policy 1, policy_version 1480106 (0.0005) [2023-12-28 05:52:25,954][106225] Updated weights for policy 1, policy_version 1480116 (0.0005) [2023-12-28 05:52:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 757063680. Throughput: 0: 10003.6, 1: 9634.1. Samples: 757030960. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:26,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-4.685')] [2023-12-28 05:52:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001476664_378101760.pth... [2023-12-28 05:52:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001480120_378961920.pth... [2023-12-28 05:52:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001475512_377806848.pth [2023-12-28 05:52:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001479000_378675200.pth [2023-12-28 05:52:26,308][106226] Updated weights for policy 0, policy_version 1476673 (0.0005) [2023-12-28 05:52:26,363][106226] Updated weights for policy 0, policy_version 1476683 (0.0005) [2023-12-28 05:52:26,416][106226] Updated weights for policy 0, policy_version 1476693 (0.0005) [2023-12-28 05:52:26,628][106225] Updated weights for policy 1, policy_version 1480126 (0.0005) [2023-12-28 05:52:26,684][106225] Updated weights for policy 1, policy_version 1480136 (0.0005) [2023-12-28 05:52:26,736][106225] Updated weights for policy 1, policy_version 1480146 (0.0005) [2023-12-28 05:52:26,932][106226] Updated weights for policy 0, policy_version 1476703 (0.0006) [2023-12-28 05:52:26,995][106226] Updated weights for policy 0, policy_version 1476713 (0.0005) [2023-12-28 05:52:27,057][106226] Updated weights for policy 0, policy_version 1476723 (0.0005) [2023-12-28 05:52:27,375][106225] Updated weights for policy 1, policy_version 1480156 (0.0007) [2023-12-28 05:52:27,428][106225] Updated weights for policy 1, policy_version 1480166 (0.0005) [2023-12-28 05:52:27,484][106225] Updated weights for policy 1, policy_version 1480176 (0.0008) [2023-12-28 05:52:27,613][106226] Updated weights for policy 0, policy_version 1476733 (0.0008) [2023-12-28 05:52:27,665][106226] Updated weights for policy 0, policy_version 1476743 (0.0010) [2023-12-28 05:52:27,722][106226] Updated weights for policy 0, policy_version 1476753 (0.0010) [2023-12-28 05:52:28,098][106225] Updated weights for policy 1, policy_version 1480186 (0.0010) [2023-12-28 05:52:28,151][106225] Updated weights for policy 1, policy_version 1480196 (0.0010) [2023-12-28 05:52:28,204][106225] Updated weights for policy 1, policy_version 1480206 (0.0010) [2023-12-28 05:52:28,256][106225] Updated weights for policy 1, policy_version 1480216 (0.0010) [2023-12-28 05:52:28,345][106226] Updated weights for policy 0, policy_version 1476763 (0.0009) [2023-12-28 05:52:28,404][106226] Updated weights for policy 0, policy_version 1476773 (0.0006) [2023-12-28 05:52:28,471][106226] Updated weights for policy 0, policy_version 1476783 (0.0006) [2023-12-28 05:52:28,963][106225] Updated weights for policy 1, policy_version 1480226 (0.0010) [2023-12-28 05:52:29,023][106225] Updated weights for policy 1, policy_version 1480236 (0.0010) [2023-12-28 05:52:29,083][106225] Updated weights for policy 1, policy_version 1480246 (0.0009) [2023-12-28 05:52:29,094][106226] Updated weights for policy 0, policy_version 1476793 (0.0006) [2023-12-28 05:52:29,156][106226] Updated weights for policy 0, policy_version 1476803 (0.0006) [2023-12-28 05:52:29,213][106226] Updated weights for policy 0, policy_version 1476813 (0.0006) [2023-12-28 05:52:29,284][106226] Updated weights for policy 0, policy_version 1476823 (0.0008) [2023-12-28 05:52:29,863][106225] Updated weights for policy 1, policy_version 1480256 (0.0009) [2023-12-28 05:52:29,926][106225] Updated weights for policy 1, policy_version 1480266 (0.0007) [2023-12-28 05:52:29,949][106226] Updated weights for policy 0, policy_version 1476833 (0.0010) [2023-12-28 05:52:29,997][106225] Updated weights for policy 1, policy_version 1480276 (0.0007) [2023-12-28 05:52:30,025][106226] Updated weights for policy 0, policy_version 1476843 (0.0008) [2023-12-28 05:52:30,087][106226] Updated weights for policy 0, policy_version 1476853 (0.0008) [2023-12-28 05:52:30,641][106225] Updated weights for policy 1, policy_version 1480286 (0.0006) [2023-12-28 05:52:30,692][106225] Updated weights for policy 1, policy_version 1480296 (0.0009) [2023-12-28 05:52:30,745][106225] Updated weights for policy 1, policy_version 1480306 (0.0010) [2023-12-28 05:52:30,758][106226] Updated weights for policy 0, policy_version 1476863 (0.0006) [2023-12-28 05:52:30,804][106226] Updated weights for policy 0, policy_version 1476873 (0.0005) [2023-12-28 05:52:30,852][106226] Updated weights for policy 0, policy_version 1476883 (0.0005) [2023-12-28 05:52:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 757170176. Throughput: 0: 10125.8, 1: 9739.6. Samples: 757158736. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:31,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.545')] [2023-12-28 05:52:31,457][106225] Updated weights for policy 1, policy_version 1480316 (0.0010) [2023-12-28 05:52:31,488][106226] Updated weights for policy 0, policy_version 1476893 (0.0007) [2023-12-28 05:52:31,511][106225] Updated weights for policy 1, policy_version 1480326 (0.0007) [2023-12-28 05:52:31,532][106226] Updated weights for policy 0, policy_version 1476903 (0.0008) [2023-12-28 05:52:31,560][106225] Updated weights for policy 1, policy_version 1480336 (0.0007) [2023-12-28 05:52:31,576][106226] Updated weights for policy 0, policy_version 1476913 (0.0008) [2023-12-28 05:52:32,298][106226] Updated weights for policy 0, policy_version 1476923 (0.0008) [2023-12-28 05:52:32,363][106226] Updated weights for policy 0, policy_version 1476933 (0.0008) [2023-12-28 05:52:32,367][106225] Updated weights for policy 1, policy_version 1480346 (0.0007) [2023-12-28 05:52:32,428][106225] Updated weights for policy 1, policy_version 1480356 (0.0008) [2023-12-28 05:52:32,432][106226] Updated weights for policy 0, policy_version 1476943 (0.0006) [2023-12-28 05:52:32,493][106225] Updated weights for policy 1, policy_version 1480366 (0.0008) [2023-12-28 05:52:32,554][106225] Updated weights for policy 1, policy_version 1480376 (0.0008) [2023-12-28 05:52:33,185][106226] Updated weights for policy 0, policy_version 1476953 (0.0007) [2023-12-28 05:52:33,230][106225] Updated weights for policy 1, policy_version 1480386 (0.0008) [2023-12-28 05:52:33,247][106226] Updated weights for policy 0, policy_version 1476963 (0.0007) [2023-12-28 05:52:33,282][106225] Updated weights for policy 1, policy_version 1480396 (0.0010) [2023-12-28 05:52:33,303][106226] Updated weights for policy 0, policy_version 1476973 (0.0005) [2023-12-28 05:52:33,338][106225] Updated weights for policy 1, policy_version 1480406 (0.0010) [2023-12-28 05:52:33,359][106226] Updated weights for policy 0, policy_version 1476983 (0.0007) [2023-12-28 05:52:34,023][106226] Updated weights for policy 0, policy_version 1476993 (0.0005) [2023-12-28 05:52:34,034][106225] Updated weights for policy 1, policy_version 1480416 (0.0010) [2023-12-28 05:52:34,068][106226] Updated weights for policy 0, policy_version 1477003 (0.0005) [2023-12-28 05:52:34,079][106225] Updated weights for policy 1, policy_version 1480426 (0.0010) [2023-12-28 05:52:34,120][106226] Updated weights for policy 0, policy_version 1477013 (0.0005) [2023-12-28 05:52:34,129][106225] Updated weights for policy 1, policy_version 1480436 (0.0010) [2023-12-28 05:52:34,803][106226] Updated weights for policy 0, policy_version 1477023 (0.0008) [2023-12-28 05:52:34,843][106225] Updated weights for policy 1, policy_version 1480446 (0.0010) [2023-12-28 05:52:34,862][106226] Updated weights for policy 0, policy_version 1477033 (0.0006) [2023-12-28 05:52:34,901][106225] Updated weights for policy 1, policy_version 1480456 (0.0010) [2023-12-28 05:52:34,920][106226] Updated weights for policy 0, policy_version 1477043 (0.0011) [2023-12-28 05:52:34,959][106225] Updated weights for policy 1, policy_version 1480466 (0.0010) [2023-12-28 05:52:35,547][106226] Updated weights for policy 0, policy_version 1477053 (0.0006) [2023-12-28 05:52:35,609][106226] Updated weights for policy 0, policy_version 1477063 (0.0005) [2023-12-28 05:52:35,650][106225] Updated weights for policy 1, policy_version 1480476 (0.0008) [2023-12-28 05:52:35,676][106226] Updated weights for policy 0, policy_version 1477073 (0.0005) [2023-12-28 05:52:35,701][106225] Updated weights for policy 1, policy_version 1480486 (0.0006) [2023-12-28 05:52:35,757][106225] Updated weights for policy 1, policy_version 1480496 (0.0006) [2023-12-28 05:52:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 757268480. Throughput: 0: 10314.2, 1: 9617.4. Samples: 757280516. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:36,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.901')] [2023-12-28 05:52:36,183][106226] Updated weights for policy 0, policy_version 1477083 (0.0007) [2023-12-28 05:52:36,234][106226] Updated weights for policy 0, policy_version 1477093 (0.0011) [2023-12-28 05:52:36,295][106226] Updated weights for policy 0, policy_version 1477103 (0.0011) [2023-12-28 05:52:36,441][106225] Updated weights for policy 1, policy_version 1480506 (0.0006) [2023-12-28 05:52:36,505][106225] Updated weights for policy 1, policy_version 1480516 (0.0006) [2023-12-28 05:52:36,569][106225] Updated weights for policy 1, policy_version 1480526 (0.0010) [2023-12-28 05:52:36,630][106225] Updated weights for policy 1, policy_version 1480536 (0.0008) [2023-12-28 05:52:37,033][106226] Updated weights for policy 0, policy_version 1477113 (0.0011) [2023-12-28 05:52:37,083][106226] Updated weights for policy 0, policy_version 1477123 (0.0010) [2023-12-28 05:52:37,137][106226] Updated weights for policy 0, policy_version 1477133 (0.0010) [2023-12-28 05:52:37,180][106225] Updated weights for policy 1, policy_version 1480546 (0.0005) [2023-12-28 05:52:37,201][106226] Updated weights for policy 0, policy_version 1477143 (0.0011) [2023-12-28 05:52:37,243][106225] Updated weights for policy 1, policy_version 1480556 (0.0006) [2023-12-28 05:52:37,306][106225] Updated weights for policy 1, policy_version 1480566 (0.0010) [2023-12-28 05:52:37,841][106225] Updated weights for policy 1, policy_version 1480576 (0.0007) [2023-12-28 05:52:37,891][106225] Updated weights for policy 1, policy_version 1480586 (0.0005) [2023-12-28 05:52:37,929][106226] Updated weights for policy 0, policy_version 1477153 (0.0011) [2023-12-28 05:52:37,945][106225] Updated weights for policy 1, policy_version 1480596 (0.0006) [2023-12-28 05:52:37,984][106226] Updated weights for policy 0, policy_version 1477163 (0.0011) [2023-12-28 05:52:38,044][106226] Updated weights for policy 0, policy_version 1477173 (0.0011) [2023-12-28 05:52:38,665][106225] Updated weights for policy 1, policy_version 1480606 (0.0008) [2023-12-28 05:52:38,734][106225] Updated weights for policy 1, policy_version 1480616 (0.0008) [2023-12-28 05:52:38,787][106226] Updated weights for policy 0, policy_version 1477183 (0.0011) [2023-12-28 05:52:38,793][106225] Updated weights for policy 1, policy_version 1480626 (0.0006) [2023-12-28 05:52:38,845][106226] Updated weights for policy 0, policy_version 1477193 (0.0011) [2023-12-28 05:52:38,902][106226] Updated weights for policy 0, policy_version 1477203 (0.0010) [2023-12-28 05:52:39,519][106225] Updated weights for policy 1, policy_version 1480636 (0.0007) [2023-12-28 05:52:39,580][106225] Updated weights for policy 1, policy_version 1480646 (0.0008) [2023-12-28 05:52:39,635][106225] Updated weights for policy 1, policy_version 1480656 (0.0008) [2023-12-28 05:52:39,659][106226] Updated weights for policy 0, policy_version 1477213 (0.0009) [2023-12-28 05:52:39,720][106226] Updated weights for policy 0, policy_version 1477223 (0.0007) [2023-12-28 05:52:39,781][106226] Updated weights for policy 0, policy_version 1477233 (0.0008) [2023-12-28 05:52:40,383][106225] Updated weights for policy 1, policy_version 1480666 (0.0007) [2023-12-28 05:52:40,448][106225] Updated weights for policy 1, policy_version 1480676 (0.0005) [2023-12-28 05:52:40,514][106225] Updated weights for policy 1, policy_version 1480686 (0.0005) [2023-12-28 05:52:40,524][106226] Updated weights for policy 0, policy_version 1477243 (0.0008) [2023-12-28 05:52:40,572][106225] Updated weights for policy 1, policy_version 1480696 (0.0007) [2023-12-28 05:52:40,577][106226] Updated weights for policy 0, policy_version 1477253 (0.0010) [2023-12-28 05:52:40,637][106226] Updated weights for policy 0, policy_version 1477263 (0.0011) [2023-12-28 05:52:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 757366784. Throughput: 0: 10226.5, 1: 9704.8. Samples: 757341256. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:41,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-4.866')] [2023-12-28 05:52:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001477272_378257408.pth... [2023-12-28 05:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001480696_379109376.pth... [2023-12-28 05:52:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001476088_377954304.pth [2023-12-28 05:52:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001479576_378822656.pth [2023-12-28 05:52:41,268][106225] Updated weights for policy 1, policy_version 1480706 (0.0011) [2023-12-28 05:52:41,334][106225] Updated weights for policy 1, policy_version 1480716 (0.0011) [2023-12-28 05:52:41,362][106226] Updated weights for policy 0, policy_version 1477273 (0.0010) [2023-12-28 05:52:41,417][106225] Updated weights for policy 1, policy_version 1480726 (0.0010) [2023-12-28 05:52:41,429][106226] Updated weights for policy 0, policy_version 1477283 (0.0010) [2023-12-28 05:52:41,493][106226] Updated weights for policy 0, policy_version 1477293 (0.0008) [2023-12-28 05:52:41,554][106226] Updated weights for policy 0, policy_version 1477303 (0.0007) [2023-12-28 05:52:42,120][106225] Updated weights for policy 1, policy_version 1480736 (0.0010) [2023-12-28 05:52:42,173][106225] Updated weights for policy 1, policy_version 1480746 (0.0008) [2023-12-28 05:52:42,231][106225] Updated weights for policy 1, policy_version 1480756 (0.0008) [2023-12-28 05:52:42,290][106226] Updated weights for policy 0, policy_version 1477313 (0.0007) [2023-12-28 05:52:42,359][106226] Updated weights for policy 0, policy_version 1477323 (0.0007) [2023-12-28 05:52:42,425][106226] Updated weights for policy 0, policy_version 1477333 (0.0008) [2023-12-28 05:52:43,023][106225] Updated weights for policy 1, policy_version 1480766 (0.0008) [2023-12-28 05:52:43,078][106226] Updated weights for policy 0, policy_version 1477343 (0.0008) [2023-12-28 05:52:43,080][106225] Updated weights for policy 1, policy_version 1480776 (0.0008) [2023-12-28 05:52:43,131][106225] Updated weights for policy 1, policy_version 1480786 (0.0005) [2023-12-28 05:52:43,141][106226] Updated weights for policy 0, policy_version 1477353 (0.0007) [2023-12-28 05:52:43,200][106226] Updated weights for policy 0, policy_version 1477363 (0.0007) [2023-12-28 05:52:43,825][106226] Updated weights for policy 0, policy_version 1477373 (0.0007) [2023-12-28 05:52:43,879][106226] Updated weights for policy 0, policy_version 1477383 (0.0005) [2023-12-28 05:52:43,911][106225] Updated weights for policy 1, policy_version 1480796 (0.0008) [2023-12-28 05:52:43,931][106226] Updated weights for policy 0, policy_version 1477393 (0.0005) [2023-12-28 05:52:43,971][106225] Updated weights for policy 1, policy_version 1480806 (0.0008) [2023-12-28 05:52:44,022][106225] Updated weights for policy 1, policy_version 1480816 (0.0009) [2023-12-28 05:52:44,536][106226] Updated weights for policy 0, policy_version 1477403 (0.0007) [2023-12-28 05:52:44,585][106226] Updated weights for policy 0, policy_version 1477413 (0.0008) [2023-12-28 05:52:44,644][106226] Updated weights for policy 0, policy_version 1477423 (0.0006) [2023-12-28 05:52:44,785][106225] Updated weights for policy 1, policy_version 1480826 (0.0009) [2023-12-28 05:52:44,857][106225] Updated weights for policy 1, policy_version 1480836 (0.0007) [2023-12-28 05:52:44,918][106225] Updated weights for policy 1, policy_version 1480846 (0.0009) [2023-12-28 05:52:44,982][106225] Updated weights for policy 1, policy_version 1480856 (0.0009) [2023-12-28 05:52:45,376][106226] Updated weights for policy 0, policy_version 1477433 (0.0008) [2023-12-28 05:52:45,432][106226] Updated weights for policy 0, policy_version 1477443 (0.0008) [2023-12-28 05:52:45,489][106226] Updated weights for policy 0, policy_version 1477453 (0.0008) [2023-12-28 05:52:45,538][106226] Updated weights for policy 0, policy_version 1477463 (0.0007) [2023-12-28 05:52:45,720][106225] Updated weights for policy 1, policy_version 1480866 (0.0010) [2023-12-28 05:52:45,783][106225] Updated weights for policy 1, policy_version 1480876 (0.0010) [2023-12-28 05:52:45,838][106225] Updated weights for policy 1, policy_version 1480886 (0.0009) [2023-12-28 05:52:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 757465088. Throughput: 0: 10155.3, 1: 9768.4. Samples: 757457168. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:46,175][105115] Avg episode reward: [(0, '-4.842'), (1, '-4.622')] [2023-12-28 05:52:46,275][106226] Updated weights for policy 0, policy_version 1477473 (0.0008) [2023-12-28 05:52:46,337][106226] Updated weights for policy 0, policy_version 1477483 (0.0009) [2023-12-28 05:52:46,399][106226] Updated weights for policy 0, policy_version 1477493 (0.0008) [2023-12-28 05:52:46,495][106225] Updated weights for policy 1, policy_version 1480896 (0.0008) [2023-12-28 05:52:46,549][106225] Updated weights for policy 1, policy_version 1480906 (0.0009) [2023-12-28 05:52:46,602][106225] Updated weights for policy 1, policy_version 1480916 (0.0008) [2023-12-28 05:52:47,064][106226] Updated weights for policy 0, policy_version 1477503 (0.0008) [2023-12-28 05:52:47,117][106226] Updated weights for policy 0, policy_version 1477513 (0.0008) [2023-12-28 05:52:47,173][106226] Updated weights for policy 0, policy_version 1477523 (0.0009) [2023-12-28 05:52:47,332][106225] Updated weights for policy 1, policy_version 1480926 (0.0007) [2023-12-28 05:52:47,378][106225] Updated weights for policy 1, policy_version 1480936 (0.0005) [2023-12-28 05:52:47,420][106225] Updated weights for policy 1, policy_version 1480946 (0.0005) [2023-12-28 05:52:47,854][106226] Updated weights for policy 0, policy_version 1477533 (0.0009) [2023-12-28 05:52:47,907][106226] Updated weights for policy 0, policy_version 1477543 (0.0010) [2023-12-28 05:52:47,960][106226] Updated weights for policy 0, policy_version 1477553 (0.0010) [2023-12-28 05:52:47,978][106225] Updated weights for policy 1, policy_version 1480956 (0.0007) [2023-12-28 05:52:48,025][106225] Updated weights for policy 1, policy_version 1480966 (0.0010) [2023-12-28 05:52:48,071][106225] Updated weights for policy 1, policy_version 1480976 (0.0010) [2023-12-28 05:52:48,608][106226] Updated weights for policy 0, policy_version 1477563 (0.0010) [2023-12-28 05:52:48,665][106226] Updated weights for policy 0, policy_version 1477573 (0.0008) [2023-12-28 05:52:48,732][106226] Updated weights for policy 0, policy_version 1477583 (0.0007) [2023-12-28 05:52:48,840][106225] Updated weights for policy 1, policy_version 1480986 (0.0009) [2023-12-28 05:52:48,907][106225] Updated weights for policy 1, policy_version 1480996 (0.0005) [2023-12-28 05:52:48,974][106225] Updated weights for policy 1, policy_version 1481006 (0.0005) [2023-12-28 05:52:49,042][106225] Updated weights for policy 1, policy_version 1481016 (0.0006) [2023-12-28 05:52:49,486][106226] Updated weights for policy 0, policy_version 1477593 (0.0008) [2023-12-28 05:52:49,548][106226] Updated weights for policy 0, policy_version 1477603 (0.0009) [2023-12-28 05:52:49,611][106226] Updated weights for policy 0, policy_version 1477613 (0.0008) [2023-12-28 05:52:49,671][106226] Updated weights for policy 0, policy_version 1477623 (0.0009) [2023-12-28 05:52:49,732][106225] Updated weights for policy 1, policy_version 1481026 (0.0008) [2023-12-28 05:52:49,785][106225] Updated weights for policy 1, policy_version 1481036 (0.0009) [2023-12-28 05:52:49,842][106225] Updated weights for policy 1, policy_version 1481046 (0.0009) [2023-12-28 05:52:50,384][106226] Updated weights for policy 0, policy_version 1477633 (0.0009) [2023-12-28 05:52:50,438][106226] Updated weights for policy 0, policy_version 1477643 (0.0009) [2023-12-28 05:52:50,494][106226] Updated weights for policy 0, policy_version 1477653 (0.0008) [2023-12-28 05:52:50,542][106225] Updated weights for policy 1, policy_version 1481056 (0.0008) [2023-12-28 05:52:50,598][106225] Updated weights for policy 1, policy_version 1481066 (0.0008) [2023-12-28 05:52:50,659][106225] Updated weights for policy 1, policy_version 1481076 (0.0009) [2023-12-28 05:52:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 757563392. Throughput: 0: 10118.8, 1: 9757.3. Samples: 757574732. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:51,175][105115] Avg episode reward: [(0, '-4.863'), (1, '-4.920')] [2023-12-28 05:52:51,313][106226] Updated weights for policy 0, policy_version 1477663 (0.0007) [2023-12-28 05:52:51,380][106225] Updated weights for policy 1, policy_version 1481086 (0.0008) [2023-12-28 05:52:51,389][106226] Updated weights for policy 0, policy_version 1477673 (0.0008) [2023-12-28 05:52:51,445][106225] Updated weights for policy 1, policy_version 1481096 (0.0006) [2023-12-28 05:52:51,454][106226] Updated weights for policy 0, policy_version 1477683 (0.0009) [2023-12-28 05:52:51,502][106225] Updated weights for policy 1, policy_version 1481106 (0.0007) [2023-12-28 05:52:52,226][106226] Updated weights for policy 0, policy_version 1477693 (0.0007) [2023-12-28 05:52:52,245][106225] Updated weights for policy 1, policy_version 1481116 (0.0008) [2023-12-28 05:52:52,288][106226] Updated weights for policy 0, policy_version 1477703 (0.0006) [2023-12-28 05:52:52,313][106225] Updated weights for policy 1, policy_version 1481126 (0.0008) [2023-12-28 05:52:52,352][106226] Updated weights for policy 0, policy_version 1477713 (0.0006) [2023-12-28 05:52:52,387][106225] Updated weights for policy 1, policy_version 1481136 (0.0008) [2023-12-28 05:52:52,981][106226] Updated weights for policy 0, policy_version 1477723 (0.0008) [2023-12-28 05:52:53,043][106226] Updated weights for policy 0, policy_version 1477733 (0.0008) [2023-12-28 05:52:53,108][106226] Updated weights for policy 0, policy_version 1477743 (0.0009) [2023-12-28 05:52:53,134][106225] Updated weights for policy 1, policy_version 1481146 (0.0009) [2023-12-28 05:52:53,189][106225] Updated weights for policy 1, policy_version 1481156 (0.0009) [2023-12-28 05:52:53,247][106225] Updated weights for policy 1, policy_version 1481166 (0.0008) [2023-12-28 05:52:53,294][106225] Updated weights for policy 1, policy_version 1481176 (0.0009) [2023-12-28 05:52:53,787][106226] Updated weights for policy 0, policy_version 1477753 (0.0006) [2023-12-28 05:52:53,838][106226] Updated weights for policy 0, policy_version 1477763 (0.0008) [2023-12-28 05:52:53,893][106226] Updated weights for policy 0, policy_version 1477773 (0.0008) [2023-12-28 05:52:53,949][106226] Updated weights for policy 0, policy_version 1477783 (0.0007) [2023-12-28 05:52:54,031][106225] Updated weights for policy 1, policy_version 1481186 (0.0010) [2023-12-28 05:52:54,088][106225] Updated weights for policy 1, policy_version 1481196 (0.0010) [2023-12-28 05:52:54,146][106225] Updated weights for policy 1, policy_version 1481206 (0.0010) [2023-12-28 05:52:54,700][106226] Updated weights for policy 0, policy_version 1477793 (0.0009) [2023-12-28 05:52:54,755][106226] Updated weights for policy 0, policy_version 1477803 (0.0009) [2023-12-28 05:52:54,806][106226] Updated weights for policy 0, policy_version 1477813 (0.0008) [2023-12-28 05:52:54,858][106225] Updated weights for policy 1, policy_version 1481216 (0.0008) [2023-12-28 05:52:54,909][106225] Updated weights for policy 1, policy_version 1481226 (0.0008) [2023-12-28 05:52:54,961][106225] Updated weights for policy 1, policy_version 1481236 (0.0009) [2023-12-28 05:52:55,523][106226] Updated weights for policy 0, policy_version 1477823 (0.0008) [2023-12-28 05:52:55,570][106226] Updated weights for policy 0, policy_version 1477833 (0.0008) [2023-12-28 05:52:55,615][106226] Updated weights for policy 0, policy_version 1477843 (0.0008) [2023-12-28 05:52:55,709][106225] Updated weights for policy 1, policy_version 1481246 (0.0008) [2023-12-28 05:52:55,775][106225] Updated weights for policy 1, policy_version 1481256 (0.0009) [2023-12-28 05:52:55,830][106225] Updated weights for policy 1, policy_version 1481266 (0.0008) [2023-12-28 05:52:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 757661696. Throughput: 0: 10088.5, 1: 9721.3. Samples: 757632144. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:52:56,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-4.689')] [2023-12-28 05:52:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001481272_379256832.pth... [2023-12-28 05:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001477848_378404864.pth... [2023-12-28 05:52:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001480120_378961920.pth [2023-12-28 05:52:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001476664_378101760.pth [2023-12-28 05:52:56,347][106226] Updated weights for policy 0, policy_version 1477853 (0.0008) [2023-12-28 05:52:56,408][106226] Updated weights for policy 0, policy_version 1477863 (0.0008) [2023-12-28 05:52:56,463][106226] Updated weights for policy 0, policy_version 1477873 (0.0008) [2023-12-28 05:52:56,552][106225] Updated weights for policy 1, policy_version 1481276 (0.0008) [2023-12-28 05:52:56,605][106225] Updated weights for policy 1, policy_version 1481286 (0.0009) [2023-12-28 05:52:56,654][106225] Updated weights for policy 1, policy_version 1481296 (0.0009) [2023-12-28 05:52:57,090][106226] Updated weights for policy 0, policy_version 1477883 (0.0006) [2023-12-28 05:52:57,138][106226] Updated weights for policy 0, policy_version 1477893 (0.0008) [2023-12-28 05:52:57,188][106226] Updated weights for policy 0, policy_version 1477903 (0.0008) [2023-12-28 05:52:57,394][106225] Updated weights for policy 1, policy_version 1481306 (0.0008) [2023-12-28 05:52:57,443][106225] Updated weights for policy 1, policy_version 1481316 (0.0008) [2023-12-28 05:52:57,486][106225] Updated weights for policy 1, policy_version 1481326 (0.0008) [2023-12-28 05:52:57,539][106225] Updated weights for policy 1, policy_version 1481336 (0.0008) [2023-12-28 05:52:57,944][106226] Updated weights for policy 0, policy_version 1477913 (0.0008) [2023-12-28 05:52:57,996][106226] Updated weights for policy 0, policy_version 1477923 (0.0009) [2023-12-28 05:52:58,052][106226] Updated weights for policy 0, policy_version 1477933 (0.0009) [2023-12-28 05:52:58,105][106226] Updated weights for policy 0, policy_version 1477943 (0.0010) [2023-12-28 05:52:58,170][106225] Updated weights for policy 1, policy_version 1481346 (0.0005) [2023-12-28 05:52:58,231][106225] Updated weights for policy 1, policy_version 1481356 (0.0007) [2023-12-28 05:52:58,301][106225] Updated weights for policy 1, policy_version 1481366 (0.0007) [2023-12-28 05:52:58,997][106226] Updated weights for policy 0, policy_version 1477953 (0.0006) [2023-12-28 05:52:59,058][106226] Updated weights for policy 0, policy_version 1477963 (0.0008) [2023-12-28 05:52:59,102][106225] Updated weights for policy 1, policy_version 1481376 (0.0008) [2023-12-28 05:52:59,124][106226] Updated weights for policy 0, policy_version 1477973 (0.0008) [2023-12-28 05:52:59,157][106225] Updated weights for policy 1, policy_version 1481386 (0.0008) [2023-12-28 05:52:59,217][106225] Updated weights for policy 1, policy_version 1481396 (0.0007) [2023-12-28 05:52:59,869][106226] Updated weights for policy 0, policy_version 1477983 (0.0008) [2023-12-28 05:52:59,924][106226] Updated weights for policy 0, policy_version 1477993 (0.0006) [2023-12-28 05:52:59,984][106226] Updated weights for policy 0, policy_version 1478003 (0.0008) [2023-12-28 05:53:00,048][106225] Updated weights for policy 1, policy_version 1481406 (0.0008) [2023-12-28 05:53:00,104][106225] Updated weights for policy 1, policy_version 1481416 (0.0008) [2023-12-28 05:53:00,163][106225] Updated weights for policy 1, policy_version 1481426 (0.0008) [2023-12-28 05:53:00,684][106226] Updated weights for policy 0, policy_version 1478013 (0.0007) [2023-12-28 05:53:00,740][106226] Updated weights for policy 0, policy_version 1478023 (0.0008) [2023-12-28 05:53:00,786][106226] Updated weights for policy 0, policy_version 1478033 (0.0007) [2023-12-28 05:53:00,904][106225] Updated weights for policy 1, policy_version 1481436 (0.0010) [2023-12-28 05:53:00,956][106225] Updated weights for policy 1, policy_version 1481446 (0.0008) [2023-12-28 05:53:01,006][106225] Updated weights for policy 1, policy_version 1481456 (0.0010) [2023-12-28 05:53:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 757760000. Throughput: 0: 10031.8, 1: 9741.5. Samples: 757746444. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:01,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.874')] [2023-12-28 05:53:01,507][106226] Updated weights for policy 0, policy_version 1478043 (0.0008) [2023-12-28 05:53:01,566][106226] Updated weights for policy 0, policy_version 1478053 (0.0008) [2023-12-28 05:53:01,631][106226] Updated weights for policy 0, policy_version 1478063 (0.0009) [2023-12-28 05:53:01,756][106225] Updated weights for policy 1, policy_version 1481466 (0.0009) [2023-12-28 05:53:01,819][106225] Updated weights for policy 1, policy_version 1481476 (0.0007) [2023-12-28 05:53:01,876][106225] Updated weights for policy 1, policy_version 1481486 (0.0005) [2023-12-28 05:53:01,933][106225] Updated weights for policy 1, policy_version 1481496 (0.0006) [2023-12-28 05:53:02,397][106226] Updated weights for policy 0, policy_version 1478073 (0.0009) [2023-12-28 05:53:02,453][106226] Updated weights for policy 0, policy_version 1478083 (0.0009) [2023-12-28 05:53:02,503][106226] Updated weights for policy 0, policy_version 1478093 (0.0009) [2023-12-28 05:53:02,565][106226] Updated weights for policy 0, policy_version 1478103 (0.0008) [2023-12-28 05:53:02,616][106225] Updated weights for policy 1, policy_version 1481506 (0.0008) [2023-12-28 05:53:02,663][106225] Updated weights for policy 1, policy_version 1481516 (0.0008) [2023-12-28 05:53:02,716][106225] Updated weights for policy 1, policy_version 1481526 (0.0005) [2023-12-28 05:53:03,337][106226] Updated weights for policy 0, policy_version 1478113 (0.0006) [2023-12-28 05:53:03,343][106225] Updated weights for policy 1, policy_version 1481536 (0.0008) [2023-12-28 05:53:03,394][106226] Updated weights for policy 0, policy_version 1478123 (0.0007) [2023-12-28 05:53:03,400][106225] Updated weights for policy 1, policy_version 1481546 (0.0008) [2023-12-28 05:53:03,455][106226] Updated weights for policy 0, policy_version 1478133 (0.0007) [2023-12-28 05:53:03,457][106225] Updated weights for policy 1, policy_version 1481556 (0.0007) [2023-12-28 05:53:04,179][106226] Updated weights for policy 0, policy_version 1478143 (0.0007) [2023-12-28 05:53:04,181][106225] Updated weights for policy 1, policy_version 1481566 (0.0007) [2023-12-28 05:53:04,238][106226] Updated weights for policy 0, policy_version 1478153 (0.0006) [2023-12-28 05:53:04,239][106225] Updated weights for policy 1, policy_version 1481576 (0.0007) [2023-12-28 05:53:04,293][106226] Updated weights for policy 0, policy_version 1478163 (0.0007) [2023-12-28 05:53:04,298][106225] Updated weights for policy 1, policy_version 1481586 (0.0007) [2023-12-28 05:53:04,998][106225] Updated weights for policy 1, policy_version 1481596 (0.0008) [2023-12-28 05:53:05,044][106226] Updated weights for policy 0, policy_version 1478173 (0.0008) [2023-12-28 05:53:05,056][106225] Updated weights for policy 1, policy_version 1481606 (0.0005) [2023-12-28 05:53:05,105][106226] Updated weights for policy 0, policy_version 1478183 (0.0009) [2023-12-28 05:53:05,112][106225] Updated weights for policy 1, policy_version 1481616 (0.0005) [2023-12-28 05:53:05,165][106226] Updated weights for policy 0, policy_version 1478193 (0.0008) [2023-12-28 05:53:05,744][106225] Updated weights for policy 1, policy_version 1481626 (0.0006) [2023-12-28 05:53:05,802][106225] Updated weights for policy 1, policy_version 1481636 (0.0009) [2023-12-28 05:53:05,860][106225] Updated weights for policy 1, policy_version 1481646 (0.0008) [2023-12-28 05:53:05,897][106226] Updated weights for policy 0, policy_version 1478203 (0.0009) [2023-12-28 05:53:05,911][106225] Updated weights for policy 1, policy_version 1481656 (0.0006) [2023-12-28 05:53:05,958][106226] Updated weights for policy 0, policy_version 1478213 (0.0008) [2023-12-28 05:53:06,017][106226] Updated weights for policy 0, policy_version 1478223 (0.0008) [2023-12-28 05:53:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 757858304. Throughput: 0: 9910.0, 1: 9836.4. Samples: 757862836. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:06,175][105115] Avg episode reward: [(0, '-4.106'), (1, '-4.666')] [2023-12-28 05:53:06,587][106225] Updated weights for policy 1, policy_version 1481666 (0.0009) [2023-12-28 05:53:06,651][106225] Updated weights for policy 1, policy_version 1481676 (0.0009) [2023-12-28 05:53:06,713][106225] Updated weights for policy 1, policy_version 1481686 (0.0008) [2023-12-28 05:53:06,779][106226] Updated weights for policy 0, policy_version 1478233 (0.0008) [2023-12-28 05:53:06,828][106226] Updated weights for policy 0, policy_version 1478243 (0.0009) [2023-12-28 05:53:06,880][106226] Updated weights for policy 0, policy_version 1478253 (0.0008) [2023-12-28 05:53:06,935][106226] Updated weights for policy 0, policy_version 1478263 (0.0008) [2023-12-28 05:53:07,479][106225] Updated weights for policy 1, policy_version 1481696 (0.0010) [2023-12-28 05:53:07,537][106225] Updated weights for policy 1, policy_version 1481706 (0.0008) [2023-12-28 05:53:07,589][106225] Updated weights for policy 1, policy_version 1481716 (0.0006) [2023-12-28 05:53:07,610][106226] Updated weights for policy 0, policy_version 1478273 (0.0007) [2023-12-28 05:53:07,655][106226] Updated weights for policy 0, policy_version 1478283 (0.0008) [2023-12-28 05:53:07,711][106226] Updated weights for policy 0, policy_version 1478293 (0.0009) [2023-12-28 05:53:08,331][106226] Updated weights for policy 0, policy_version 1478303 (0.0007) [2023-12-28 05:53:08,377][106225] Updated weights for policy 1, policy_version 1481726 (0.0006) [2023-12-28 05:53:08,395][106226] Updated weights for policy 0, policy_version 1478313 (0.0006) [2023-12-28 05:53:08,436][106225] Updated weights for policy 1, policy_version 1481736 (0.0007) [2023-12-28 05:53:08,454][106226] Updated weights for policy 0, policy_version 1478323 (0.0006) [2023-12-28 05:53:08,495][106225] Updated weights for policy 1, policy_version 1481746 (0.0008) [2023-12-28 05:53:09,145][106226] Updated weights for policy 0, policy_version 1478333 (0.0009) [2023-12-28 05:53:09,204][106226] Updated weights for policy 0, policy_version 1478343 (0.0009) [2023-12-28 05:53:09,223][106225] Updated weights for policy 1, policy_version 1481756 (0.0008) [2023-12-28 05:53:09,279][106226] Updated weights for policy 0, policy_version 1478353 (0.0008) [2023-12-28 05:53:09,290][106225] Updated weights for policy 1, policy_version 1481766 (0.0007) [2023-12-28 05:53:09,358][106225] Updated weights for policy 1, policy_version 1481776 (0.0008) [2023-12-28 05:53:10,011][106226] Updated weights for policy 0, policy_version 1478363 (0.0007) [2023-12-28 05:53:10,077][106226] Updated weights for policy 0, policy_version 1478373 (0.0008) [2023-12-28 05:53:10,141][106225] Updated weights for policy 1, policy_version 1481786 (0.0009) [2023-12-28 05:53:10,143][106226] Updated weights for policy 0, policy_version 1478383 (0.0008) [2023-12-28 05:53:10,201][106225] Updated weights for policy 1, policy_version 1481796 (0.0007) [2023-12-28 05:53:10,261][106225] Updated weights for policy 1, policy_version 1481806 (0.0008) [2023-12-28 05:53:10,323][106225] Updated weights for policy 1, policy_version 1481816 (0.0009) [2023-12-28 05:53:10,757][106226] Updated weights for policy 0, policy_version 1478393 (0.0007) [2023-12-28 05:53:10,823][106226] Updated weights for policy 0, policy_version 1478403 (0.0009) [2023-12-28 05:53:10,882][106226] Updated weights for policy 0, policy_version 1478413 (0.0008) [2023-12-28 05:53:10,946][106226] Updated weights for policy 0, policy_version 1478423 (0.0008) [2023-12-28 05:53:11,140][106225] Updated weights for policy 1, policy_version 1481826 (0.0010) [2023-12-28 05:53:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 757948416. Throughput: 0: 9961.5, 1: 9827.5. Samples: 757921468. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:11,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.792')] [2023-12-28 05:53:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001478424_378552320.pth... [2023-12-28 05:53:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001477272_378257408.pth [2023-12-28 05:53:11,201][106225] Updated weights for policy 1, policy_version 1481836 (0.0009) [2023-12-28 05:53:11,264][106225] Updated weights for policy 1, policy_version 1481846 (0.0008) [2023-12-28 05:53:11,274][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001481848_379404288.pth... [2023-12-28 05:53:11,278][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001480696_379109376.pth [2023-12-28 05:53:11,716][106226] Updated weights for policy 0, policy_version 1478433 (0.0008) [2023-12-28 05:53:11,786][106226] Updated weights for policy 0, policy_version 1478443 (0.0008) [2023-12-28 05:53:11,855][106226] Updated weights for policy 0, policy_version 1478453 (0.0009) [2023-12-28 05:53:12,059][106225] Updated weights for policy 1, policy_version 1481856 (0.0009) [2023-12-28 05:53:12,124][106225] Updated weights for policy 1, policy_version 1481866 (0.0008) [2023-12-28 05:53:12,183][106225] Updated weights for policy 1, policy_version 1481876 (0.0005) [2023-12-28 05:53:12,567][106226] Updated weights for policy 0, policy_version 1478463 (0.0008) [2023-12-28 05:53:12,622][106226] Updated weights for policy 0, policy_version 1478473 (0.0010) [2023-12-28 05:53:12,676][106226] Updated weights for policy 0, policy_version 1478483 (0.0010) [2023-12-28 05:53:12,877][106225] Updated weights for policy 1, policy_version 1481886 (0.0005) [2023-12-28 05:53:12,928][106225] Updated weights for policy 1, policy_version 1481896 (0.0009) [2023-12-28 05:53:12,978][106225] Updated weights for policy 1, policy_version 1481906 (0.0010) [2023-12-28 05:53:13,443][106226] Updated weights for policy 0, policy_version 1478493 (0.0010) [2023-12-28 05:53:13,492][106226] Updated weights for policy 0, policy_version 1478503 (0.0008) [2023-12-28 05:53:13,552][106226] Updated weights for policy 0, policy_version 1478513 (0.0009) [2023-12-28 05:53:13,561][106225] Updated weights for policy 1, policy_version 1481916 (0.0008) [2023-12-28 05:53:13,620][106225] Updated weights for policy 1, policy_version 1481926 (0.0005) [2023-12-28 05:53:13,679][106225] Updated weights for policy 1, policy_version 1481936 (0.0005) [2023-12-28 05:53:14,208][106225] Updated weights for policy 1, policy_version 1481946 (0.0005) [2023-12-28 05:53:14,269][106225] Updated weights for policy 1, policy_version 1481956 (0.0005) [2023-12-28 05:53:14,330][106225] Updated weights for policy 1, policy_version 1481966 (0.0005) [2023-12-28 05:53:14,385][106226] Updated weights for policy 0, policy_version 1478523 (0.0008) [2023-12-28 05:53:14,394][106225] Updated weights for policy 1, policy_version 1481976 (0.0008) [2023-12-28 05:53:14,444][106226] Updated weights for policy 0, policy_version 1478533 (0.0008) [2023-12-28 05:53:14,504][106226] Updated weights for policy 0, policy_version 1478543 (0.0008) [2023-12-28 05:53:14,986][106225] Updated weights for policy 1, policy_version 1481986 (0.0008) [2023-12-28 05:53:15,048][106225] Updated weights for policy 1, policy_version 1481996 (0.0011) [2023-12-28 05:53:15,111][106225] Updated weights for policy 1, policy_version 1482006 (0.0011) [2023-12-28 05:53:15,302][106226] Updated weights for policy 0, policy_version 1478553 (0.0009) [2023-12-28 05:53:15,352][106226] Updated weights for policy 0, policy_version 1478563 (0.0008) [2023-12-28 05:53:15,405][106226] Updated weights for policy 0, policy_version 1478573 (0.0008) [2023-12-28 05:53:15,455][106226] Updated weights for policy 0, policy_version 1478583 (0.0007) [2023-12-28 05:53:15,816][106225] Updated weights for policy 1, policy_version 1482016 (0.0009) [2023-12-28 05:53:15,866][106225] Updated weights for policy 1, policy_version 1482026 (0.0010) [2023-12-28 05:53:15,925][106225] Updated weights for policy 1, policy_version 1482036 (0.0010) [2023-12-28 05:53:16,162][106226] Updated weights for policy 0, policy_version 1478593 (0.0008) [2023-12-28 05:53:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 758046720. Throughput: 0: 9734.1, 1: 9798.7. Samples: 758037716. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:16,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-4.878')] [2023-12-28 05:53:16,215][106226] Updated weights for policy 0, policy_version 1478603 (0.0007) [2023-12-28 05:53:16,263][106226] Updated weights for policy 0, policy_version 1478613 (0.0008) [2023-12-28 05:53:16,654][106225] Updated weights for policy 1, policy_version 1482046 (0.0010) [2023-12-28 05:53:16,715][106225] Updated weights for policy 1, policy_version 1482056 (0.0011) [2023-12-28 05:53:16,776][106225] Updated weights for policy 1, policy_version 1482066 (0.0011) [2023-12-28 05:53:17,020][106226] Updated weights for policy 0, policy_version 1478623 (0.0008) [2023-12-28 05:53:17,084][106226] Updated weights for policy 0, policy_version 1478633 (0.0007) [2023-12-28 05:53:17,143][106226] Updated weights for policy 0, policy_version 1478643 (0.0008) [2023-12-28 05:53:17,472][106225] Updated weights for policy 1, policy_version 1482076 (0.0010) [2023-12-28 05:53:17,532][106225] Updated weights for policy 1, policy_version 1482086 (0.0010) [2023-12-28 05:53:17,591][106225] Updated weights for policy 1, policy_version 1482096 (0.0010) [2023-12-28 05:53:17,889][106226] Updated weights for policy 0, policy_version 1478653 (0.0007) [2023-12-28 05:53:17,949][106226] Updated weights for policy 0, policy_version 1478663 (0.0008) [2023-12-28 05:53:18,007][106226] Updated weights for policy 0, policy_version 1478673 (0.0009) [2023-12-28 05:53:18,231][106225] Updated weights for policy 1, policy_version 1482106 (0.0010) [2023-12-28 05:53:18,278][106225] Updated weights for policy 1, policy_version 1482116 (0.0010) [2023-12-28 05:53:18,343][106225] Updated weights for policy 1, policy_version 1482126 (0.0011) [2023-12-28 05:53:18,403][106225] Updated weights for policy 1, policy_version 1482136 (0.0010) [2023-12-28 05:53:18,809][106226] Updated weights for policy 0, policy_version 1478683 (0.0008) [2023-12-28 05:53:18,871][106226] Updated weights for policy 0, policy_version 1478693 (0.0009) [2023-12-28 05:53:18,934][106226] Updated weights for policy 0, policy_version 1478703 (0.0009) [2023-12-28 05:53:19,090][106225] Updated weights for policy 1, policy_version 1482146 (0.0007) [2023-12-28 05:53:19,144][106225] Updated weights for policy 1, policy_version 1482156 (0.0005) [2023-12-28 05:53:19,209][106225] Updated weights for policy 1, policy_version 1482166 (0.0005) [2023-12-28 05:53:19,710][106226] Updated weights for policy 0, policy_version 1478713 (0.0008) [2023-12-28 05:53:19,775][106226] Updated weights for policy 0, policy_version 1478723 (0.0009) [2023-12-28 05:53:19,833][106225] Updated weights for policy 1, policy_version 1482176 (0.0007) [2023-12-28 05:53:19,854][106226] Updated weights for policy 0, policy_version 1478733 (0.0009) [2023-12-28 05:53:19,896][106225] Updated weights for policy 1, policy_version 1482186 (0.0008) [2023-12-28 05:53:19,919][106226] Updated weights for policy 0, policy_version 1478743 (0.0007) [2023-12-28 05:53:19,962][106225] Updated weights for policy 1, policy_version 1482196 (0.0008) [2023-12-28 05:53:20,696][106226] Updated weights for policy 0, policy_version 1478753 (0.0008) [2023-12-28 05:53:20,727][106225] Updated weights for policy 1, policy_version 1482206 (0.0008) [2023-12-28 05:53:20,758][106226] Updated weights for policy 0, policy_version 1478763 (0.0008) [2023-12-28 05:53:20,789][106225] Updated weights for policy 1, policy_version 1482216 (0.0007) [2023-12-28 05:53:20,824][106226] Updated weights for policy 0, policy_version 1478773 (0.0008) [2023-12-28 05:53:20,851][106225] Updated weights for policy 1, policy_version 1482226 (0.0006) [2023-12-28 05:53:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 758145024. Throughput: 0: 9571.4, 1: 9806.8. Samples: 758152536. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:21,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-4.657')] [2023-12-28 05:53:21,614][106226] Updated weights for policy 0, policy_version 1478783 (0.0008) [2023-12-28 05:53:21,646][106225] Updated weights for policy 1, policy_version 1482236 (0.0007) [2023-12-28 05:53:21,687][106226] Updated weights for policy 0, policy_version 1478793 (0.0008) [2023-12-28 05:53:21,709][106225] Updated weights for policy 1, policy_version 1482246 (0.0008) [2023-12-28 05:53:21,753][106226] Updated weights for policy 0, policy_version 1478803 (0.0008) [2023-12-28 05:53:21,780][106225] Updated weights for policy 1, policy_version 1482256 (0.0008) [2023-12-28 05:53:22,362][106226] Updated weights for policy 0, policy_version 1478813 (0.0008) [2023-12-28 05:53:22,418][106226] Updated weights for policy 0, policy_version 1478823 (0.0008) [2023-12-28 05:53:22,473][106226] Updated weights for policy 0, policy_version 1478833 (0.0008) [2023-12-28 05:53:22,623][106225] Updated weights for policy 1, policy_version 1482266 (0.0008) [2023-12-28 05:53:22,686][106225] Updated weights for policy 1, policy_version 1482276 (0.0008) [2023-12-28 05:53:22,745][106225] Updated weights for policy 1, policy_version 1482286 (0.0008) [2023-12-28 05:53:22,807][106225] Updated weights for policy 1, policy_version 1482296 (0.0009) [2023-12-28 05:53:23,228][106226] Updated weights for policy 0, policy_version 1478843 (0.0009) [2023-12-28 05:53:23,278][106226] Updated weights for policy 0, policy_version 1478853 (0.0010) [2023-12-28 05:53:23,336][106226] Updated weights for policy 0, policy_version 1478863 (0.0010) [2023-12-28 05:53:23,537][106225] Updated weights for policy 1, policy_version 1482306 (0.0008) [2023-12-28 05:53:23,590][106225] Updated weights for policy 1, policy_version 1482316 (0.0008) [2023-12-28 05:53:23,634][106225] Updated weights for policy 1, policy_version 1482326 (0.0008) [2023-12-28 05:53:24,033][106226] Updated weights for policy 0, policy_version 1478873 (0.0010) [2023-12-28 05:53:24,087][106226] Updated weights for policy 0, policy_version 1478883 (0.0009) [2023-12-28 05:53:24,153][106226] Updated weights for policy 0, policy_version 1478893 (0.0009) [2023-12-28 05:53:24,220][106226] Updated weights for policy 0, policy_version 1478903 (0.0008) [2023-12-28 05:53:24,384][106225] Updated weights for policy 1, policy_version 1482336 (0.0008) [2023-12-28 05:53:24,440][106225] Updated weights for policy 1, policy_version 1482346 (0.0008) [2023-12-28 05:53:24,495][106225] Updated weights for policy 1, policy_version 1482356 (0.0008) [2023-12-28 05:53:24,958][106226] Updated weights for policy 0, policy_version 1478913 (0.0009) [2023-12-28 05:53:25,017][106226] Updated weights for policy 0, policy_version 1478923 (0.0008) [2023-12-28 05:53:25,080][106226] Updated weights for policy 0, policy_version 1478933 (0.0009) [2023-12-28 05:53:25,197][106225] Updated weights for policy 1, policy_version 1482366 (0.0008) [2023-12-28 05:53:25,254][106225] Updated weights for policy 1, policy_version 1482376 (0.0008) [2023-12-28 05:53:25,300][106225] Updated weights for policy 1, policy_version 1482386 (0.0008) [2023-12-28 05:53:25,785][106226] Updated weights for policy 0, policy_version 1478943 (0.0008) [2023-12-28 05:53:25,844][106226] Updated weights for policy 0, policy_version 1478953 (0.0008) [2023-12-28 05:53:25,898][106226] Updated weights for policy 0, policy_version 1478963 (0.0009) [2023-12-28 05:53:26,016][106225] Updated weights for policy 1, policy_version 1482396 (0.0007) [2023-12-28 05:53:26,075][106225] Updated weights for policy 1, policy_version 1482406 (0.0006) [2023-12-28 05:53:26,128][106225] Updated weights for policy 1, policy_version 1482416 (0.0009) [2023-12-28 05:53:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 758243328. Throughput: 0: 9596.8, 1: 9676.2. Samples: 758208540. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:26,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.980')] [2023-12-28 05:53:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001478968_378691584.pth... [2023-12-28 05:53:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001482424_379551744.pth... [2023-12-28 05:53:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001477848_378404864.pth [2023-12-28 05:53:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001481272_379256832.pth [2023-12-28 05:53:26,685][106226] Updated weights for policy 0, policy_version 1478973 (0.0008) [2023-12-28 05:53:26,724][106225] Updated weights for policy 1, policy_version 1482426 (0.0007) [2023-12-28 05:53:26,745][106226] Updated weights for policy 0, policy_version 1478983 (0.0008) [2023-12-28 05:53:26,771][106225] Updated weights for policy 1, policy_version 1482436 (0.0006) [2023-12-28 05:53:26,803][106226] Updated weights for policy 0, policy_version 1478993 (0.0007) [2023-12-28 05:53:26,820][106225] Updated weights for policy 1, policy_version 1482446 (0.0006) [2023-12-28 05:53:26,869][106225] Updated weights for policy 1, policy_version 1482456 (0.0005) [2023-12-28 05:53:27,516][106225] Updated weights for policy 1, policy_version 1482466 (0.0007) [2023-12-28 05:53:27,522][106226] Updated weights for policy 0, policy_version 1479003 (0.0009) [2023-12-28 05:53:27,565][106225] Updated weights for policy 1, policy_version 1482476 (0.0005) [2023-12-28 05:53:27,573][106226] Updated weights for policy 0, policy_version 1479013 (0.0010) [2023-12-28 05:53:27,616][106225] Updated weights for policy 1, policy_version 1482486 (0.0005) [2023-12-28 05:53:27,626][106226] Updated weights for policy 0, policy_version 1479023 (0.0010) [2023-12-28 05:53:28,168][106225] Updated weights for policy 1, policy_version 1482496 (0.0005) [2023-12-28 05:53:28,234][106225] Updated weights for policy 1, policy_version 1482506 (0.0005) [2023-12-28 05:53:28,248][106226] Updated weights for policy 0, policy_version 1479033 (0.0009) [2023-12-28 05:53:28,288][106225] Updated weights for policy 1, policy_version 1482516 (0.0005) [2023-12-28 05:53:28,301][106226] Updated weights for policy 0, policy_version 1479043 (0.0007) [2023-12-28 05:53:28,361][106226] Updated weights for policy 0, policy_version 1479053 (0.0009) [2023-12-28 05:53:28,423][106226] Updated weights for policy 0, policy_version 1479063 (0.0009) [2023-12-28 05:53:28,970][106225] Updated weights for policy 1, policy_version 1482526 (0.0007) [2023-12-28 05:53:29,026][106225] Updated weights for policy 1, policy_version 1482536 (0.0007) [2023-12-28 05:53:29,077][106226] Updated weights for policy 0, policy_version 1479073 (0.0008) [2023-12-28 05:53:29,084][106225] Updated weights for policy 1, policy_version 1482546 (0.0005) [2023-12-28 05:53:29,127][106226] Updated weights for policy 0, policy_version 1479083 (0.0008) [2023-12-28 05:53:29,184][106226] Updated weights for policy 0, policy_version 1479093 (0.0010) [2023-12-28 05:53:29,802][106225] Updated weights for policy 1, policy_version 1482556 (0.0006) [2023-12-28 05:53:29,866][106225] Updated weights for policy 1, policy_version 1482566 (0.0008) [2023-12-28 05:53:29,927][106225] Updated weights for policy 1, policy_version 1482576 (0.0008) [2023-12-28 05:53:29,985][106226] Updated weights for policy 0, policy_version 1479103 (0.0010) [2023-12-28 05:53:30,035][106226] Updated weights for policy 0, policy_version 1479113 (0.0009) [2023-12-28 05:53:30,093][106226] Updated weights for policy 0, policy_version 1479123 (0.0010) [2023-12-28 05:53:30,674][106225] Updated weights for policy 1, policy_version 1482586 (0.0007) [2023-12-28 05:53:30,731][106225] Updated weights for policy 1, policy_version 1482596 (0.0007) [2023-12-28 05:53:30,785][106225] Updated weights for policy 1, policy_version 1482606 (0.0008) [2023-12-28 05:53:30,822][106226] Updated weights for policy 0, policy_version 1479133 (0.0011) [2023-12-28 05:53:30,844][106225] Updated weights for policy 1, policy_version 1482616 (0.0006) [2023-12-28 05:53:30,880][106226] Updated weights for policy 0, policy_version 1479143 (0.0011) [2023-12-28 05:53:30,934][106226] Updated weights for policy 0, policy_version 1479153 (0.0011) [2023-12-28 05:53:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 758341632. Throughput: 0: 9562.0, 1: 9833.3. Samples: 758329952. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:31,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-4.890')] [2023-12-28 05:53:31,623][106226] Updated weights for policy 0, policy_version 1479163 (0.0010) [2023-12-28 05:53:31,648][106225] Updated weights for policy 1, policy_version 1482626 (0.0009) [2023-12-28 05:53:31,694][106226] Updated weights for policy 0, policy_version 1479173 (0.0007) [2023-12-28 05:53:31,713][106225] Updated weights for policy 1, policy_version 1482636 (0.0007) [2023-12-28 05:53:31,758][106226] Updated weights for policy 0, policy_version 1479183 (0.0007) [2023-12-28 05:53:31,764][106225] Updated weights for policy 1, policy_version 1482646 (0.0005) [2023-12-28 05:53:32,384][106226] Updated weights for policy 0, policy_version 1479193 (0.0007) [2023-12-28 05:53:32,446][106226] Updated weights for policy 0, policy_version 1479203 (0.0010) [2023-12-28 05:53:32,512][106225] Updated weights for policy 1, policy_version 1482656 (0.0006) [2023-12-28 05:53:32,517][106226] Updated weights for policy 0, policy_version 1479213 (0.0008) [2023-12-28 05:53:32,569][106225] Updated weights for policy 1, policy_version 1482666 (0.0009) [2023-12-28 05:53:32,587][106226] Updated weights for policy 0, policy_version 1479223 (0.0007) [2023-12-28 05:53:32,620][106225] Updated weights for policy 1, policy_version 1482676 (0.0009) [2023-12-28 05:53:33,123][106226] Updated weights for policy 0, policy_version 1479233 (0.0010) [2023-12-28 05:53:33,179][106226] Updated weights for policy 0, policy_version 1479243 (0.0010) [2023-12-28 05:53:33,228][106226] Updated weights for policy 0, policy_version 1479253 (0.0010) [2023-12-28 05:53:33,410][106225] Updated weights for policy 1, policy_version 1482686 (0.0010) [2023-12-28 05:53:33,464][106225] Updated weights for policy 1, policy_version 1482696 (0.0009) [2023-12-28 05:53:33,513][106225] Updated weights for policy 1, policy_version 1482706 (0.0008) [2023-12-28 05:53:33,814][106226] Updated weights for policy 0, policy_version 1479263 (0.0010) [2023-12-28 05:53:33,870][106226] Updated weights for policy 0, policy_version 1479273 (0.0010) [2023-12-28 05:53:33,936][106226] Updated weights for policy 0, policy_version 1479283 (0.0010) [2023-12-28 05:53:34,298][106225] Updated weights for policy 1, policy_version 1482716 (0.0007) [2023-12-28 05:53:34,351][106225] Updated weights for policy 1, policy_version 1482726 (0.0006) [2023-12-28 05:53:34,413][106225] Updated weights for policy 1, policy_version 1482736 (0.0006) [2023-12-28 05:53:34,644][106226] Updated weights for policy 0, policy_version 1479293 (0.0010) [2023-12-28 05:53:34,708][106226] Updated weights for policy 0, policy_version 1479303 (0.0008) [2023-12-28 05:53:34,764][106226] Updated weights for policy 0, policy_version 1479313 (0.0009) [2023-12-28 05:53:35,101][106225] Updated weights for policy 1, policy_version 1482746 (0.0007) [2023-12-28 05:53:35,156][106225] Updated weights for policy 1, policy_version 1482756 (0.0008) [2023-12-28 05:53:35,212][106225] Updated weights for policy 1, policy_version 1482766 (0.0009) [2023-12-28 05:53:35,268][106225] Updated weights for policy 1, policy_version 1482776 (0.0008) [2023-12-28 05:53:35,384][106226] Updated weights for policy 0, policy_version 1479323 (0.0008) [2023-12-28 05:53:35,431][106226] Updated weights for policy 0, policy_version 1479333 (0.0008) [2023-12-28 05:53:35,491][106226] Updated weights for policy 0, policy_version 1479343 (0.0009) [2023-12-28 05:53:35,880][106225] Updated weights for policy 1, policy_version 1482786 (0.0009) [2023-12-28 05:53:35,953][106225] Updated weights for policy 1, policy_version 1482796 (0.0009) [2023-12-28 05:53:36,007][106225] Updated weights for policy 1, policy_version 1482806 (0.0007) [2023-12-28 05:53:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 758439936. Throughput: 0: 9650.2, 1: 9794.2. Samples: 758449732. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:36,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.674')] [2023-12-28 05:53:36,276][106226] Updated weights for policy 0, policy_version 1479353 (0.0008) [2023-12-28 05:53:36,337][106226] Updated weights for policy 0, policy_version 1479363 (0.0009) [2023-12-28 05:53:36,401][106226] Updated weights for policy 0, policy_version 1479373 (0.0008) [2023-12-28 05:53:36,467][106226] Updated weights for policy 0, policy_version 1479383 (0.0008) [2023-12-28 05:53:36,723][106225] Updated weights for policy 1, policy_version 1482816 (0.0008) [2023-12-28 05:53:36,784][106225] Updated weights for policy 1, policy_version 1482826 (0.0008) [2023-12-28 05:53:36,842][106225] Updated weights for policy 1, policy_version 1482836 (0.0008) [2023-12-28 05:53:37,111][106226] Updated weights for policy 0, policy_version 1479393 (0.0006) [2023-12-28 05:53:37,177][106226] Updated weights for policy 0, policy_version 1479403 (0.0006) [2023-12-28 05:53:37,241][106226] Updated weights for policy 0, policy_version 1479413 (0.0006) [2023-12-28 05:53:37,562][106225] Updated weights for policy 1, policy_version 1482846 (0.0007) [2023-12-28 05:53:37,626][106225] Updated weights for policy 1, policy_version 1482856 (0.0008) [2023-12-28 05:53:37,685][106225] Updated weights for policy 1, policy_version 1482866 (0.0006) [2023-12-28 05:53:37,865][106226] Updated weights for policy 0, policy_version 1479423 (0.0005) [2023-12-28 05:53:37,926][106226] Updated weights for policy 0, policy_version 1479433 (0.0010) [2023-12-28 05:53:37,973][106226] Updated weights for policy 0, policy_version 1479443 (0.0010) [2023-12-28 05:53:38,341][106225] Updated weights for policy 1, policy_version 1482876 (0.0006) [2023-12-28 05:53:38,405][106225] Updated weights for policy 1, policy_version 1482886 (0.0009) [2023-12-28 05:53:38,464][106225] Updated weights for policy 1, policy_version 1482896 (0.0008) [2023-12-28 05:53:38,695][106226] Updated weights for policy 0, policy_version 1479453 (0.0010) [2023-12-28 05:53:38,756][106226] Updated weights for policy 0, policy_version 1479463 (0.0009) [2023-12-28 05:53:38,821][106226] Updated weights for policy 0, policy_version 1479473 (0.0010) [2023-12-28 05:53:39,120][106225] Updated weights for policy 1, policy_version 1482906 (0.0009) [2023-12-28 05:53:39,183][106225] Updated weights for policy 1, policy_version 1482916 (0.0008) [2023-12-28 05:53:39,246][106225] Updated weights for policy 1, policy_version 1482926 (0.0008) [2023-12-28 05:53:39,307][106225] Updated weights for policy 1, policy_version 1482936 (0.0009) [2023-12-28 05:53:39,625][106226] Updated weights for policy 0, policy_version 1479483 (0.0010) [2023-12-28 05:53:39,685][106226] Updated weights for policy 0, policy_version 1479493 (0.0009) [2023-12-28 05:53:39,746][106226] Updated weights for policy 0, policy_version 1479503 (0.0009) [2023-12-28 05:53:40,044][106225] Updated weights for policy 1, policy_version 1482946 (0.0009) [2023-12-28 05:53:40,094][106225] Updated weights for policy 1, policy_version 1482956 (0.0009) [2023-12-28 05:53:40,149][106225] Updated weights for policy 1, policy_version 1482966 (0.0009) [2023-12-28 05:53:40,518][106226] Updated weights for policy 0, policy_version 1479513 (0.0009) [2023-12-28 05:53:40,571][106226] Updated weights for policy 0, policy_version 1479523 (0.0009) [2023-12-28 05:53:40,621][106226] Updated weights for policy 0, policy_version 1479533 (0.0009) [2023-12-28 05:53:40,680][106226] Updated weights for policy 0, policy_version 1479543 (0.0009) [2023-12-28 05:53:40,905][106225] Updated weights for policy 1, policy_version 1482976 (0.0008) [2023-12-28 05:53:40,964][106225] Updated weights for policy 1, policy_version 1482986 (0.0008) [2023-12-28 05:53:41,019][106225] Updated weights for policy 1, policy_version 1482996 (0.0008) [2023-12-28 05:53:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 758538240. Throughput: 0: 9671.1, 1: 9807.4. Samples: 758508680. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:41,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.863')] [2023-12-28 05:53:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001483000_379699200.pth... [2023-12-28 05:53:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001479544_378839040.pth... [2023-12-28 05:53:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001481848_379404288.pth [2023-12-28 05:53:41,184][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001483000_379699200.pth [2023-12-28 05:53:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001478424_378552320.pth [2023-12-28 05:53:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001479544_378839040.pth [2023-12-28 05:53:41,437][106226] Updated weights for policy 0, policy_version 1479553 (0.0009) [2023-12-28 05:53:41,498][106226] Updated weights for policy 0, policy_version 1479563 (0.0009) [2023-12-28 05:53:41,567][106226] Updated weights for policy 0, policy_version 1479573 (0.0009) [2023-12-28 05:53:41,906][106225] Updated weights for policy 1, policy_version 1483006 (0.0009) [2023-12-28 05:53:41,974][106225] Updated weights for policy 1, policy_version 1483016 (0.0008) [2023-12-28 05:53:42,036][106225] Updated weights for policy 1, policy_version 1483026 (0.0006) [2023-12-28 05:53:42,350][106226] Updated weights for policy 0, policy_version 1479583 (0.0009) [2023-12-28 05:53:42,414][106226] Updated weights for policy 0, policy_version 1479593 (0.0009) [2023-12-28 05:53:42,476][106226] Updated weights for policy 0, policy_version 1479603 (0.0008) [2023-12-28 05:53:42,762][106225] Updated weights for policy 1, policy_version 1483036 (0.0007) [2023-12-28 05:53:42,822][106225] Updated weights for policy 1, policy_version 1483046 (0.0008) [2023-12-28 05:53:42,884][106225] Updated weights for policy 1, policy_version 1483056 (0.0009) [2023-12-28 05:53:43,199][106226] Updated weights for policy 0, policy_version 1479613 (0.0008) [2023-12-28 05:53:43,248][106226] Updated weights for policy 0, policy_version 1479623 (0.0007) [2023-12-28 05:53:43,292][106226] Updated weights for policy 0, policy_version 1479633 (0.0007) [2023-12-28 05:53:43,584][106225] Updated weights for policy 1, policy_version 1483066 (0.0008) [2023-12-28 05:53:43,640][106225] Updated weights for policy 1, policy_version 1483076 (0.0006) [2023-12-28 05:53:43,692][106225] Updated weights for policy 1, policy_version 1483086 (0.0006) [2023-12-28 05:53:43,744][106225] Updated weights for policy 1, policy_version 1483096 (0.0005) [2023-12-28 05:53:44,056][106226] Updated weights for policy 0, policy_version 1479643 (0.0009) [2023-12-28 05:53:44,115][106226] Updated weights for policy 0, policy_version 1479653 (0.0010) [2023-12-28 05:53:44,174][106226] Updated weights for policy 0, policy_version 1479663 (0.0010) [2023-12-28 05:53:44,401][106225] Updated weights for policy 1, policy_version 1483106 (0.0009) [2023-12-28 05:53:44,461][106225] Updated weights for policy 1, policy_version 1483116 (0.0007) [2023-12-28 05:53:44,528][106225] Updated weights for policy 1, policy_version 1483126 (0.0005) [2023-12-28 05:53:44,767][106226] Updated weights for policy 0, policy_version 1479673 (0.0010) [2023-12-28 05:53:44,832][106226] Updated weights for policy 0, policy_version 1479683 (0.0007) [2023-12-28 05:53:44,897][106226] Updated weights for policy 0, policy_version 1479693 (0.0010) [2023-12-28 05:53:44,966][106226] Updated weights for policy 0, policy_version 1479703 (0.0009) [2023-12-28 05:53:45,207][106225] Updated weights for policy 1, policy_version 1483136 (0.0008) [2023-12-28 05:53:45,270][106225] Updated weights for policy 1, policy_version 1483146 (0.0008) [2023-12-28 05:53:45,332][106225] Updated weights for policy 1, policy_version 1483156 (0.0008) [2023-12-28 05:53:45,588][106226] Updated weights for policy 0, policy_version 1479713 (0.0010) [2023-12-28 05:53:45,651][106226] Updated weights for policy 0, policy_version 1479723 (0.0011) [2023-12-28 05:53:45,701][106226] Updated weights for policy 0, policy_version 1479733 (0.0010) [2023-12-28 05:53:46,040][106225] Updated weights for policy 1, policy_version 1483166 (0.0010) [2023-12-28 05:53:46,093][106225] Updated weights for policy 1, policy_version 1483176 (0.0010) [2023-12-28 05:53:46,143][106225] Updated weights for policy 1, policy_version 1483186 (0.0010) [2023-12-28 05:53:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 758636544. Throughput: 0: 9664.9, 1: 9817.3. Samples: 758623144. Policy #0 lag: (min: 5.0, avg: 28.6, max: 32.0) [2023-12-28 05:53:46,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.672')] [2023-12-28 05:53:46,366][106226] Updated weights for policy 0, policy_version 1479743 (0.0011) [2023-12-28 05:53:46,427][106226] Updated weights for policy 0, policy_version 1479753 (0.0011) [2023-12-28 05:53:46,491][106226] Updated weights for policy 0, policy_version 1479763 (0.0011) [2023-12-28 05:53:46,892][106225] Updated weights for policy 1, policy_version 1483196 (0.0009) [2023-12-28 05:53:46,954][106225] Updated weights for policy 1, policy_version 1483206 (0.0007) [2023-12-28 05:53:47,020][106225] Updated weights for policy 1, policy_version 1483216 (0.0007) [2023-12-28 05:53:47,214][106226] Updated weights for policy 0, policy_version 1479773 (0.0009) [2023-12-28 05:53:47,270][106226] Updated weights for policy 0, policy_version 1479783 (0.0008) [2023-12-28 05:53:47,321][106226] Updated weights for policy 0, policy_version 1479793 (0.0006) [2023-12-28 05:53:47,619][106225] Updated weights for policy 1, policy_version 1483226 (0.0008) [2023-12-28 05:53:47,664][106225] Updated weights for policy 1, policy_version 1483236 (0.0006) [2023-12-28 05:53:47,714][106225] Updated weights for policy 1, policy_version 1483246 (0.0006) [2023-12-28 05:53:47,768][106225] Updated weights for policy 1, policy_version 1483256 (0.0008) [2023-12-28 05:53:47,973][106226] Updated weights for policy 0, policy_version 1479803 (0.0006) [2023-12-28 05:53:48,029][106226] Updated weights for policy 0, policy_version 1479813 (0.0008) [2023-12-28 05:53:48,074][106226] Updated weights for policy 0, policy_version 1479823 (0.0007) [2023-12-28 05:53:48,480][106225] Updated weights for policy 1, policy_version 1483266 (0.0007) [2023-12-28 05:53:48,542][106225] Updated weights for policy 1, policy_version 1483276 (0.0007) [2023-12-28 05:53:48,609][106225] Updated weights for policy 1, policy_version 1483286 (0.0005) [2023-12-28 05:53:48,785][106226] Updated weights for policy 0, policy_version 1479833 (0.0009) [2023-12-28 05:53:48,853][106226] Updated weights for policy 0, policy_version 1479843 (0.0007) [2023-12-28 05:53:48,916][106226] Updated weights for policy 0, policy_version 1479853 (0.0006) [2023-12-28 05:53:48,977][106226] Updated weights for policy 0, policy_version 1479863 (0.0006) [2023-12-28 05:53:49,287][106225] Updated weights for policy 1, policy_version 1483296 (0.0007) [2023-12-28 05:53:49,353][106225] Updated weights for policy 1, policy_version 1483306 (0.0007) [2023-12-28 05:53:49,420][106225] Updated weights for policy 1, policy_version 1483316 (0.0007) [2023-12-28 05:53:49,553][106226] Updated weights for policy 0, policy_version 1479873 (0.0006) [2023-12-28 05:53:49,609][106226] Updated weights for policy 0, policy_version 1479883 (0.0007) [2023-12-28 05:53:49,675][106226] Updated weights for policy 0, policy_version 1479893 (0.0009) [2023-12-28 05:53:50,062][106225] Updated weights for policy 1, policy_version 1483326 (0.0009) [2023-12-28 05:53:50,116][106225] Updated weights for policy 1, policy_version 1483336 (0.0010) [2023-12-28 05:53:50,167][106225] Updated weights for policy 1, policy_version 1483346 (0.0010) [2023-12-28 05:53:50,389][106226] Updated weights for policy 0, policy_version 1479903 (0.0008) [2023-12-28 05:53:50,441][106226] Updated weights for policy 0, policy_version 1479913 (0.0008) [2023-12-28 05:53:50,493][106226] Updated weights for policy 0, policy_version 1479923 (0.0008) [2023-12-28 05:53:50,919][106225] Updated weights for policy 1, policy_version 1483356 (0.0010) [2023-12-28 05:53:50,974][106225] Updated weights for policy 1, policy_version 1483366 (0.0011) [2023-12-28 05:53:51,026][106225] Updated weights for policy 1, policy_version 1483376 (0.0010) [2023-12-28 05:53:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 758734848. Throughput: 0: 9775.2, 1: 9826.2. Samples: 758744900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:53:51,175][105115] Avg episode reward: [(0, '-4.754'), (1, '-4.648')] [2023-12-28 05:53:51,197][106226] Updated weights for policy 0, policy_version 1479933 (0.0008) [2023-12-28 05:53:51,258][106226] Updated weights for policy 0, policy_version 1479943 (0.0007) [2023-12-28 05:53:51,321][106226] Updated weights for policy 0, policy_version 1479953 (0.0006) [2023-12-28 05:53:51,826][106225] Updated weights for policy 1, policy_version 1483386 (0.0011) [2023-12-28 05:53:51,895][106225] Updated weights for policy 1, policy_version 1483396 (0.0009) [2023-12-28 05:53:51,962][106225] Updated weights for policy 1, policy_version 1483406 (0.0009) [2023-12-28 05:53:52,027][106226] Updated weights for policy 0, policy_version 1479963 (0.0010) [2023-12-28 05:53:52,035][106225] Updated weights for policy 1, policy_version 1483416 (0.0011) [2023-12-28 05:53:52,091][106226] Updated weights for policy 0, policy_version 1479973 (0.0007) [2023-12-28 05:53:52,160][106226] Updated weights for policy 0, policy_version 1479983 (0.0011) [2023-12-28 05:53:52,831][106225] Updated weights for policy 1, policy_version 1483426 (0.0008) [2023-12-28 05:53:52,897][106225] Updated weights for policy 1, policy_version 1483436 (0.0007) [2023-12-28 05:53:52,923][106226] Updated weights for policy 0, policy_version 1479993 (0.0010) [2023-12-28 05:53:52,960][106225] Updated weights for policy 1, policy_version 1483446 (0.0007) [2023-12-28 05:53:52,988][106226] Updated weights for policy 0, policy_version 1480003 (0.0010) [2023-12-28 05:53:53,049][106226] Updated weights for policy 0, policy_version 1480013 (0.0010) [2023-12-28 05:53:53,108][106226] Updated weights for policy 0, policy_version 1480023 (0.0011) [2023-12-28 05:53:53,621][106225] Updated weights for policy 1, policy_version 1483456 (0.0008) [2023-12-28 05:53:53,693][106225] Updated weights for policy 1, policy_version 1483466 (0.0009) [2023-12-28 05:53:53,762][106225] Updated weights for policy 1, policy_version 1483476 (0.0009) [2023-12-28 05:53:53,790][106226] Updated weights for policy 0, policy_version 1480033 (0.0006) [2023-12-28 05:53:53,851][106226] Updated weights for policy 0, policy_version 1480043 (0.0005) [2023-12-28 05:53:53,907][106226] Updated weights for policy 0, policy_version 1480053 (0.0005) [2023-12-28 05:53:54,447][106225] Updated weights for policy 1, policy_version 1483486 (0.0006) [2023-12-28 05:53:54,460][106226] Updated weights for policy 0, policy_version 1480063 (0.0009) [2023-12-28 05:53:54,506][106226] Updated weights for policy 0, policy_version 1480073 (0.0010) [2023-12-28 05:53:54,508][106225] Updated weights for policy 1, policy_version 1483496 (0.0007) [2023-12-28 05:53:54,559][106226] Updated weights for policy 0, policy_version 1480083 (0.0006) [2023-12-28 05:53:54,573][106225] Updated weights for policy 1, policy_version 1483506 (0.0008) [2023-12-28 05:53:55,119][106225] Updated weights for policy 1, policy_version 1483516 (0.0007) [2023-12-28 05:53:55,168][106225] Updated weights for policy 1, policy_version 1483526 (0.0007) [2023-12-28 05:53:55,218][106225] Updated weights for policy 1, policy_version 1483536 (0.0007) [2023-12-28 05:53:55,283][106226] Updated weights for policy 0, policy_version 1480093 (0.0010) [2023-12-28 05:53:55,337][106226] Updated weights for policy 0, policy_version 1480103 (0.0010) [2023-12-28 05:53:55,394][106226] Updated weights for policy 0, policy_version 1480113 (0.0011) [2023-12-28 05:53:55,820][106225] Updated weights for policy 1, policy_version 1483546 (0.0007) [2023-12-28 05:53:55,873][106225] Updated weights for policy 1, policy_version 1483556 (0.0005) [2023-12-28 05:53:55,924][106225] Updated weights for policy 1, policy_version 1483566 (0.0005) [2023-12-28 05:53:55,978][106225] Updated weights for policy 1, policy_version 1483576 (0.0005) [2023-12-28 05:53:56,089][106226] Updated weights for policy 0, policy_version 1480123 (0.0011) [2023-12-28 05:53:56,137][106226] Updated weights for policy 0, policy_version 1480133 (0.0008) [2023-12-28 05:53:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 758833152. Throughput: 0: 9756.9, 1: 9809.2. Samples: 758801944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:53:56,176][105115] Avg episode reward: [(0, '-4.911'), (1, '-4.895')] [2023-12-28 05:53:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001483576_379846656.pth... [2023-12-28 05:53:56,191][106226] Updated weights for policy 0, policy_version 1480143 (0.0008) [2023-12-28 05:53:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001482424_379551744.pth [2023-12-28 05:53:56,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001480152_378994688.pth... [2023-12-28 05:53:56,245][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001478968_378691584.pth [2023-12-28 05:53:56,568][106225] Updated weights for policy 1, policy_version 1483586 (0.0010) [2023-12-28 05:53:56,631][106225] Updated weights for policy 1, policy_version 1483596 (0.0010) [2023-12-28 05:53:56,684][106225] Updated weights for policy 1, policy_version 1483606 (0.0010) [2023-12-28 05:53:56,869][106226] Updated weights for policy 0, policy_version 1480153 (0.0007) [2023-12-28 05:53:56,925][106226] Updated weights for policy 0, policy_version 1480163 (0.0005) [2023-12-28 05:53:56,989][106226] Updated weights for policy 0, policy_version 1480173 (0.0005) [2023-12-28 05:53:57,037][106226] Updated weights for policy 0, policy_version 1480183 (0.0005) [2023-12-28 05:53:57,315][106225] Updated weights for policy 1, policy_version 1483616 (0.0010) [2023-12-28 05:53:57,378][106225] Updated weights for policy 1, policy_version 1483626 (0.0009) [2023-12-28 05:53:57,441][106225] Updated weights for policy 1, policy_version 1483636 (0.0010) [2023-12-28 05:53:57,606][106226] Updated weights for policy 0, policy_version 1480193 (0.0009) [2023-12-28 05:53:57,660][106226] Updated weights for policy 0, policy_version 1480203 (0.0009) [2023-12-28 05:53:57,717][106226] Updated weights for policy 0, policy_version 1480213 (0.0008) [2023-12-28 05:53:58,057][106225] Updated weights for policy 1, policy_version 1483646 (0.0010) [2023-12-28 05:53:58,109][106225] Updated weights for policy 1, policy_version 1483656 (0.0010) [2023-12-28 05:53:58,157][106225] Updated weights for policy 1, policy_version 1483666 (0.0009) [2023-12-28 05:53:58,525][106226] Updated weights for policy 0, policy_version 1480223 (0.0008) [2023-12-28 05:53:58,591][106226] Updated weights for policy 0, policy_version 1480233 (0.0008) [2023-12-28 05:53:58,656][106226] Updated weights for policy 0, policy_version 1480243 (0.0008) [2023-12-28 05:53:58,939][106225] Updated weights for policy 1, policy_version 1483676 (0.0007) [2023-12-28 05:53:59,001][106225] Updated weights for policy 1, policy_version 1483686 (0.0008) [2023-12-28 05:53:59,068][106225] Updated weights for policy 1, policy_version 1483696 (0.0007) [2023-12-28 05:53:59,481][106226] Updated weights for policy 0, policy_version 1480253 (0.0009) [2023-12-28 05:53:59,542][106226] Updated weights for policy 0, policy_version 1480263 (0.0009) [2023-12-28 05:53:59,597][106226] Updated weights for policy 0, policy_version 1480273 (0.0009) [2023-12-28 05:53:59,831][106225] Updated weights for policy 1, policy_version 1483706 (0.0008) [2023-12-28 05:53:59,892][106225] Updated weights for policy 1, policy_version 1483716 (0.0007) [2023-12-28 05:53:59,967][106225] Updated weights for policy 1, policy_version 1483726 (0.0008) [2023-12-28 05:54:00,030][106225] Updated weights for policy 1, policy_version 1483736 (0.0008) [2023-12-28 05:54:00,245][106226] Updated weights for policy 0, policy_version 1480283 (0.0007) [2023-12-28 05:54:00,305][106226] Updated weights for policy 0, policy_version 1480293 (0.0005) [2023-12-28 05:54:00,369][106226] Updated weights for policy 0, policy_version 1480303 (0.0007) [2023-12-28 05:54:00,728][106225] Updated weights for policy 1, policy_version 1483746 (0.0008) [2023-12-28 05:54:00,779][106225] Updated weights for policy 1, policy_version 1483756 (0.0007) [2023-12-28 05:54:00,838][106225] Updated weights for policy 1, policy_version 1483766 (0.0008) [2023-12-28 05:54:01,066][106226] Updated weights for policy 0, policy_version 1480313 (0.0007) [2023-12-28 05:54:01,133][106226] Updated weights for policy 0, policy_version 1480323 (0.0007) [2023-12-28 05:54:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 758931456. Throughput: 0: 9859.0, 1: 9863.4. Samples: 758925224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:01,175][105115] Avg episode reward: [(0, '-4.679'), (1, '-4.958')] [2023-12-28 05:54:01,196][106226] Updated weights for policy 0, policy_version 1480333 (0.0008) [2023-12-28 05:54:01,266][106226] Updated weights for policy 0, policy_version 1480343 (0.0007) [2023-12-28 05:54:01,557][106225] Updated weights for policy 1, policy_version 1483776 (0.0007) [2023-12-28 05:54:01,613][106225] Updated weights for policy 1, policy_version 1483786 (0.0008) [2023-12-28 05:54:01,686][106225] Updated weights for policy 1, policy_version 1483796 (0.0009) [2023-12-28 05:54:01,955][106226] Updated weights for policy 0, policy_version 1480353 (0.0009) [2023-12-28 05:54:02,017][106226] Updated weights for policy 0, policy_version 1480363 (0.0009) [2023-12-28 05:54:02,084][106226] Updated weights for policy 0, policy_version 1480373 (0.0008) [2023-12-28 05:54:02,395][106225] Updated weights for policy 1, policy_version 1483806 (0.0009) [2023-12-28 05:54:02,461][106225] Updated weights for policy 1, policy_version 1483816 (0.0008) [2023-12-28 05:54:02,519][106225] Updated weights for policy 1, policy_version 1483826 (0.0007) [2023-12-28 05:54:02,837][106226] Updated weights for policy 0, policy_version 1480383 (0.0009) [2023-12-28 05:54:02,892][106226] Updated weights for policy 0, policy_version 1480393 (0.0009) [2023-12-28 05:54:02,943][106226] Updated weights for policy 0, policy_version 1480403 (0.0008) [2023-12-28 05:54:03,180][106225] Updated weights for policy 1, policy_version 1483836 (0.0008) [2023-12-28 05:54:03,234][106225] Updated weights for policy 1, policy_version 1483846 (0.0007) [2023-12-28 05:54:03,296][106225] Updated weights for policy 1, policy_version 1483856 (0.0006) [2023-12-28 05:54:03,586][106226] Updated weights for policy 0, policy_version 1480413 (0.0008) [2023-12-28 05:54:03,641][106226] Updated weights for policy 0, policy_version 1480423 (0.0009) [2023-12-28 05:54:03,688][106226] Updated weights for policy 0, policy_version 1480433 (0.0008) [2023-12-28 05:54:04,002][106225] Updated weights for policy 1, policy_version 1483866 (0.0006) [2023-12-28 05:54:04,053][106225] Updated weights for policy 1, policy_version 1483876 (0.0008) [2023-12-28 05:54:04,108][106225] Updated weights for policy 1, policy_version 1483886 (0.0008) [2023-12-28 05:54:04,171][106225] Updated weights for policy 1, policy_version 1483896 (0.0006) [2023-12-28 05:54:04,436][106226] Updated weights for policy 0, policy_version 1480443 (0.0009) [2023-12-28 05:54:04,489][106226] Updated weights for policy 0, policy_version 1480453 (0.0008) [2023-12-28 05:54:04,543][106226] Updated weights for policy 0, policy_version 1480463 (0.0009) [2023-12-28 05:54:04,799][106225] Updated weights for policy 1, policy_version 1483906 (0.0008) [2023-12-28 05:54:04,860][106225] Updated weights for policy 1, policy_version 1483916 (0.0008) [2023-12-28 05:54:04,929][106225] Updated weights for policy 1, policy_version 1483926 (0.0008) [2023-12-28 05:54:05,266][106226] Updated weights for policy 0, policy_version 1480473 (0.0007) [2023-12-28 05:54:05,328][106226] Updated weights for policy 0, policy_version 1480483 (0.0005) [2023-12-28 05:54:05,392][106226] Updated weights for policy 0, policy_version 1480493 (0.0008) [2023-12-28 05:54:05,442][106226] Updated weights for policy 0, policy_version 1480503 (0.0008) [2023-12-28 05:54:05,635][106225] Updated weights for policy 1, policy_version 1483936 (0.0008) [2023-12-28 05:54:05,698][106225] Updated weights for policy 1, policy_version 1483946 (0.0007) [2023-12-28 05:54:05,747][106225] Updated weights for policy 1, policy_version 1483956 (0.0009) [2023-12-28 05:54:06,118][106226] Updated weights for policy 0, policy_version 1480513 (0.0009) [2023-12-28 05:54:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 759029760. Throughput: 0: 9933.7, 1: 9850.9. Samples: 759042844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:06,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-4.407')] [2023-12-28 05:54:06,184][106226] Updated weights for policy 0, policy_version 1480523 (0.0008) [2023-12-28 05:54:06,243][106226] Updated weights for policy 0, policy_version 1480533 (0.0008) [2023-12-28 05:54:06,485][106225] Updated weights for policy 1, policy_version 1483966 (0.0010) [2023-12-28 05:54:06,546][106225] Updated weights for policy 1, policy_version 1483976 (0.0010) [2023-12-28 05:54:06,608][106225] Updated weights for policy 1, policy_version 1483986 (0.0011) [2023-12-28 05:54:07,001][106226] Updated weights for policy 0, policy_version 1480543 (0.0008) [2023-12-28 05:54:07,052][106226] Updated weights for policy 0, policy_version 1480553 (0.0007) [2023-12-28 05:54:07,105][106226] Updated weights for policy 0, policy_version 1480563 (0.0008) [2023-12-28 05:54:07,272][106225] Updated weights for policy 1, policy_version 1483996 (0.0008) [2023-12-28 05:54:07,334][106225] Updated weights for policy 1, policy_version 1484006 (0.0005) [2023-12-28 05:54:07,406][106225] Updated weights for policy 1, policy_version 1484016 (0.0005) [2023-12-28 05:54:07,882][106226] Updated weights for policy 0, policy_version 1480573 (0.0008) [2023-12-28 05:54:07,942][106226] Updated weights for policy 0, policy_version 1480583 (0.0009) [2023-12-28 05:54:08,000][106226] Updated weights for policy 0, policy_version 1480593 (0.0008) [2023-12-28 05:54:08,010][106225] Updated weights for policy 1, policy_version 1484026 (0.0006) [2023-12-28 05:54:08,059][106225] Updated weights for policy 1, policy_version 1484036 (0.0007) [2023-12-28 05:54:08,120][106225] Updated weights for policy 1, policy_version 1484046 (0.0008) [2023-12-28 05:54:08,181][106225] Updated weights for policy 1, policy_version 1484056 (0.0008) [2023-12-28 05:54:08,773][106226] Updated weights for policy 0, policy_version 1480603 (0.0007) [2023-12-28 05:54:08,829][106226] Updated weights for policy 0, policy_version 1480613 (0.0008) [2023-12-28 05:54:08,867][106225] Updated weights for policy 1, policy_version 1484066 (0.0006) [2023-12-28 05:54:08,892][106226] Updated weights for policy 0, policy_version 1480623 (0.0008) [2023-12-28 05:54:08,929][106225] Updated weights for policy 1, policy_version 1484076 (0.0006) [2023-12-28 05:54:08,990][106225] Updated weights for policy 1, policy_version 1484086 (0.0008) [2023-12-28 05:54:09,672][106226] Updated weights for policy 0, policy_version 1480633 (0.0008) [2023-12-28 05:54:09,683][106225] Updated weights for policy 1, policy_version 1484096 (0.0007) [2023-12-28 05:54:09,732][106226] Updated weights for policy 0, policy_version 1480643 (0.0007) [2023-12-28 05:54:09,749][106225] Updated weights for policy 1, policy_version 1484106 (0.0008) [2023-12-28 05:54:09,794][106226] Updated weights for policy 0, policy_version 1480653 (0.0006) [2023-12-28 05:54:09,813][106225] Updated weights for policy 1, policy_version 1484116 (0.0007) [2023-12-28 05:54:09,860][106226] Updated weights for policy 0, policy_version 1480663 (0.0009) [2023-12-28 05:54:10,495][106225] Updated weights for policy 1, policy_version 1484126 (0.0008) [2023-12-28 05:54:10,550][106225] Updated weights for policy 1, policy_version 1484136 (0.0007) [2023-12-28 05:54:10,560][106226] Updated weights for policy 0, policy_version 1480673 (0.0008) [2023-12-28 05:54:10,598][106225] Updated weights for policy 1, policy_version 1484146 (0.0005) [2023-12-28 05:54:10,619][106226] Updated weights for policy 0, policy_version 1480683 (0.0008) [2023-12-28 05:54:10,682][106226] Updated weights for policy 0, policy_version 1480693 (0.0009) [2023-12-28 05:54:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 759128064. Throughput: 0: 9879.3, 1: 9951.0. Samples: 759100900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:11,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.688')] [2023-12-28 05:54:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001484152_379994112.pth... [2023-12-28 05:54:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001480696_379133952.pth... [2023-12-28 05:54:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001483000_379699200.pth [2023-12-28 05:54:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001479544_378839040.pth [2023-12-28 05:54:11,324][106225] Updated weights for policy 1, policy_version 1484156 (0.0007) [2023-12-28 05:54:11,394][106225] Updated weights for policy 1, policy_version 1484166 (0.0013) [2023-12-28 05:54:11,453][106226] Updated weights for policy 0, policy_version 1480703 (0.0007) [2023-12-28 05:54:11,459][106225] Updated weights for policy 1, policy_version 1484176 (0.0009) [2023-12-28 05:54:11,515][106226] Updated weights for policy 0, policy_version 1480713 (0.0007) [2023-12-28 05:54:11,578][106226] Updated weights for policy 0, policy_version 1480723 (0.0007) [2023-12-28 05:54:12,199][106225] Updated weights for policy 1, policy_version 1484186 (0.0009) [2023-12-28 05:54:12,265][106225] Updated weights for policy 1, policy_version 1484196 (0.0006) [2023-12-28 05:54:12,329][106225] Updated weights for policy 1, policy_version 1484206 (0.0008) [2023-12-28 05:54:12,380][106226] Updated weights for policy 0, policy_version 1480733 (0.0007) [2023-12-28 05:54:12,401][106225] Updated weights for policy 1, policy_version 1484216 (0.0008) [2023-12-28 05:54:12,443][106226] Updated weights for policy 0, policy_version 1480743 (0.0006) [2023-12-28 05:54:12,510][106226] Updated weights for policy 0, policy_version 1480753 (0.0008) [2023-12-28 05:54:13,089][106225] Updated weights for policy 1, policy_version 1484226 (0.0010) [2023-12-28 05:54:13,160][106225] Updated weights for policy 1, policy_version 1484236 (0.0010) [2023-12-28 05:54:13,170][106226] Updated weights for policy 0, policy_version 1480763 (0.0007) [2023-12-28 05:54:13,223][106225] Updated weights for policy 1, policy_version 1484246 (0.0009) [2023-12-28 05:54:13,224][106226] Updated weights for policy 0, policy_version 1480773 (0.0006) [2023-12-28 05:54:13,279][106226] Updated weights for policy 0, policy_version 1480783 (0.0005) [2023-12-28 05:54:13,797][106226] Updated weights for policy 0, policy_version 1480793 (0.0005) [2023-12-28 05:54:13,851][106226] Updated weights for policy 0, policy_version 1480803 (0.0005) [2023-12-28 05:54:13,857][106225] Updated weights for policy 1, policy_version 1484256 (0.0006) [2023-12-28 05:54:13,914][106226] Updated weights for policy 0, policy_version 1480813 (0.0007) [2023-12-28 05:54:13,926][106225] Updated weights for policy 1, policy_version 1484266 (0.0006) [2023-12-28 05:54:13,968][106226] Updated weights for policy 0, policy_version 1480823 (0.0006) [2023-12-28 05:54:13,986][106225] Updated weights for policy 1, policy_version 1484276 (0.0006) [2023-12-28 05:54:14,489][106226] Updated weights for policy 0, policy_version 1480833 (0.0008) [2023-12-28 05:54:14,537][106226] Updated weights for policy 0, policy_version 1480843 (0.0009) [2023-12-28 05:54:14,591][106226] Updated weights for policy 0, policy_version 1480853 (0.0007) [2023-12-28 05:54:14,622][106225] Updated weights for policy 1, policy_version 1484286 (0.0007) [2023-12-28 05:54:14,690][106225] Updated weights for policy 1, policy_version 1484296 (0.0010) [2023-12-28 05:54:14,758][106225] Updated weights for policy 1, policy_version 1484306 (0.0005) [2023-12-28 05:54:15,344][106226] Updated weights for policy 0, policy_version 1480863 (0.0006) [2023-12-28 05:54:15,391][106226] Updated weights for policy 0, policy_version 1480873 (0.0008) [2023-12-28 05:54:15,438][106225] Updated weights for policy 1, policy_version 1484316 (0.0007) [2023-12-28 05:54:15,448][106226] Updated weights for policy 0, policy_version 1480883 (0.0007) [2023-12-28 05:54:15,492][106225] Updated weights for policy 1, policy_version 1484326 (0.0007) [2023-12-28 05:54:15,551][106225] Updated weights for policy 1, policy_version 1484336 (0.0007) [2023-12-28 05:54:16,148][106226] Updated weights for policy 0, policy_version 1480893 (0.0006) [2023-12-28 05:54:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 759226368. Throughput: 0: 9936.7, 1: 9870.2. Samples: 759221264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:16,176][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.664')] [2023-12-28 05:54:16,197][106226] Updated weights for policy 0, policy_version 1480903 (0.0006) [2023-12-28 05:54:16,252][106225] Updated weights for policy 1, policy_version 1484346 (0.0006) [2023-12-28 05:54:16,254][106226] Updated weights for policy 0, policy_version 1480913 (0.0010) [2023-12-28 05:54:16,308][106225] Updated weights for policy 1, policy_version 1484356 (0.0010) [2023-12-28 05:54:16,364][106225] Updated weights for policy 1, policy_version 1484366 (0.0010) [2023-12-28 05:54:16,424][106225] Updated weights for policy 1, policy_version 1484376 (0.0010) [2023-12-28 05:54:16,935][106226] Updated weights for policy 0, policy_version 1480923 (0.0009) [2023-12-28 05:54:17,007][106226] Updated weights for policy 0, policy_version 1480933 (0.0008) [2023-12-28 05:54:17,068][106225] Updated weights for policy 1, policy_version 1484386 (0.0007) [2023-12-28 05:54:17,069][106226] Updated weights for policy 0, policy_version 1480943 (0.0006) [2023-12-28 05:54:17,128][106225] Updated weights for policy 1, policy_version 1484396 (0.0009) [2023-12-28 05:54:17,193][106225] Updated weights for policy 1, policy_version 1484406 (0.0010) [2023-12-28 05:54:17,729][106226] Updated weights for policy 0, policy_version 1480953 (0.0006) [2023-12-28 05:54:17,791][106226] Updated weights for policy 0, policy_version 1480963 (0.0008) [2023-12-28 05:54:17,845][106226] Updated weights for policy 0, policy_version 1480973 (0.0008) [2023-12-28 05:54:17,888][106225] Updated weights for policy 1, policy_version 1484416 (0.0009) [2023-12-28 05:54:17,898][106226] Updated weights for policy 0, policy_version 1480983 (0.0007) [2023-12-28 05:54:17,939][106225] Updated weights for policy 1, policy_version 1484426 (0.0005) [2023-12-28 05:54:17,993][106225] Updated weights for policy 1, policy_version 1484436 (0.0005) [2023-12-28 05:54:18,617][106225] Updated weights for policy 1, policy_version 1484446 (0.0009) [2023-12-28 05:54:18,626][106226] Updated weights for policy 0, policy_version 1480993 (0.0010) [2023-12-28 05:54:18,678][106225] Updated weights for policy 1, policy_version 1484456 (0.0010) [2023-12-28 05:54:18,683][106226] Updated weights for policy 0, policy_version 1481003 (0.0010) [2023-12-28 05:54:18,740][106225] Updated weights for policy 1, policy_version 1484466 (0.0010) [2023-12-28 05:54:18,743][106226] Updated weights for policy 0, policy_version 1481013 (0.0010) [2023-12-28 05:54:19,382][106225] Updated weights for policy 1, policy_version 1484476 (0.0009) [2023-12-28 05:54:19,446][106225] Updated weights for policy 1, policy_version 1484486 (0.0006) [2023-12-28 05:54:19,456][106226] Updated weights for policy 0, policy_version 1481023 (0.0010) [2023-12-28 05:54:19,513][106225] Updated weights for policy 1, policy_version 1484496 (0.0011) [2023-12-28 05:54:19,527][106226] Updated weights for policy 0, policy_version 1481033 (0.0011) [2023-12-28 05:54:19,594][106226] Updated weights for policy 0, policy_version 1481043 (0.0009) [2023-12-28 05:54:20,253][106225] Updated weights for policy 1, policy_version 1484506 (0.0008) [2023-12-28 05:54:20,313][106225] Updated weights for policy 1, policy_version 1484516 (0.0008) [2023-12-28 05:54:20,342][106226] Updated weights for policy 0, policy_version 1481053 (0.0009) [2023-12-28 05:54:20,378][106225] Updated weights for policy 1, policy_version 1484526 (0.0009) [2023-12-28 05:54:20,404][106226] Updated weights for policy 0, policy_version 1481063 (0.0009) [2023-12-28 05:54:20,438][106225] Updated weights for policy 1, policy_version 1484536 (0.0006) [2023-12-28 05:54:20,468][106226] Updated weights for policy 0, policy_version 1481073 (0.0007) [2023-12-28 05:54:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 759324672. Throughput: 0: 9855.0, 1: 9933.8. Samples: 759340228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:21,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.916')] [2023-12-28 05:54:21,203][106226] Updated weights for policy 0, policy_version 1481083 (0.0009) [2023-12-28 05:54:21,251][106225] Updated weights for policy 1, policy_version 1484546 (0.0007) [2023-12-28 05:54:21,268][106226] Updated weights for policy 0, policy_version 1481093 (0.0007) [2023-12-28 05:54:21,315][106225] Updated weights for policy 1, policy_version 1484556 (0.0007) [2023-12-28 05:54:21,337][106226] Updated weights for policy 0, policy_version 1481103 (0.0009) [2023-12-28 05:54:21,384][106225] Updated weights for policy 1, policy_version 1484566 (0.0008) [2023-12-28 05:54:22,012][106226] Updated weights for policy 0, policy_version 1481113 (0.0008) [2023-12-28 05:54:22,054][106225] Updated weights for policy 1, policy_version 1484576 (0.0006) [2023-12-28 05:54:22,077][106226] Updated weights for policy 0, policy_version 1481123 (0.0007) [2023-12-28 05:54:22,111][106225] Updated weights for policy 1, policy_version 1484586 (0.0007) [2023-12-28 05:54:22,142][106226] Updated weights for policy 0, policy_version 1481133 (0.0009) [2023-12-28 05:54:22,173][106225] Updated weights for policy 1, policy_version 1484596 (0.0007) [2023-12-28 05:54:22,202][106226] Updated weights for policy 0, policy_version 1481143 (0.0009) [2023-12-28 05:54:22,890][106225] Updated weights for policy 1, policy_version 1484606 (0.0006) [2023-12-28 05:54:22,954][106225] Updated weights for policy 1, policy_version 1484616 (0.0007) [2023-12-28 05:54:22,960][106226] Updated weights for policy 0, policy_version 1481153 (0.0006) [2023-12-28 05:54:23,009][106225] Updated weights for policy 1, policy_version 1484626 (0.0007) [2023-12-28 05:54:23,017][106226] Updated weights for policy 0, policy_version 1481163 (0.0007) [2023-12-28 05:54:23,074][106226] Updated weights for policy 0, policy_version 1481173 (0.0007) [2023-12-28 05:54:23,651][106225] Updated weights for policy 1, policy_version 1484636 (0.0009) [2023-12-28 05:54:23,713][106225] Updated weights for policy 1, policy_version 1484646 (0.0009) [2023-12-28 05:54:23,772][106226] Updated weights for policy 0, policy_version 1481183 (0.0008) [2023-12-28 05:54:23,775][106225] Updated weights for policy 1, policy_version 1484656 (0.0008) [2023-12-28 05:54:23,827][106226] Updated weights for policy 0, policy_version 1481193 (0.0007) [2023-12-28 05:54:23,891][106226] Updated weights for policy 0, policy_version 1481203 (0.0009) [2023-12-28 05:54:24,410][106225] Updated weights for policy 1, policy_version 1484666 (0.0007) [2023-12-28 05:54:24,472][106225] Updated weights for policy 1, policy_version 1484676 (0.0008) [2023-12-28 05:54:24,533][106225] Updated weights for policy 1, policy_version 1484686 (0.0008) [2023-12-28 05:54:24,593][106225] Updated weights for policy 1, policy_version 1484696 (0.0006) [2023-12-28 05:54:24,669][106226] Updated weights for policy 0, policy_version 1481213 (0.0008) [2023-12-28 05:54:24,727][106226] Updated weights for policy 0, policy_version 1481223 (0.0005) [2023-12-28 05:54:24,784][106226] Updated weights for policy 0, policy_version 1481233 (0.0006) [2023-12-28 05:54:25,124][106225] Updated weights for policy 1, policy_version 1484706 (0.0005) [2023-12-28 05:54:25,178][106225] Updated weights for policy 1, policy_version 1484716 (0.0005) [2023-12-28 05:54:25,239][106225] Updated weights for policy 1, policy_version 1484726 (0.0006) [2023-12-28 05:54:25,530][106226] Updated weights for policy 0, policy_version 1481243 (0.0009) [2023-12-28 05:54:25,591][106226] Updated weights for policy 0, policy_version 1481253 (0.0010) [2023-12-28 05:54:25,650][106226] Updated weights for policy 0, policy_version 1481263 (0.0007) [2023-12-28 05:54:25,795][106225] Updated weights for policy 1, policy_version 1484736 (0.0006) [2023-12-28 05:54:25,846][106225] Updated weights for policy 1, policy_version 1484746 (0.0005) [2023-12-28 05:54:25,899][106225] Updated weights for policy 1, policy_version 1484756 (0.0009) [2023-12-28 05:54:26,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 759431168. Throughput: 0: 9823.1, 1: 9933.5. Samples: 759397720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:26,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.802')] [2023-12-28 05:54:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001484760_380149760.pth... [2023-12-28 05:54:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001481272_379281408.pth... [2023-12-28 05:54:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001483576_379846656.pth [2023-12-28 05:54:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001480152_378994688.pth [2023-12-28 05:54:26,437][106226] Updated weights for policy 0, policy_version 1481273 (0.0009) [2023-12-28 05:54:26,498][106226] Updated weights for policy 0, policy_version 1481283 (0.0008) [2023-12-28 05:54:26,551][106225] Updated weights for policy 1, policy_version 1484766 (0.0008) [2023-12-28 05:54:26,553][106226] Updated weights for policy 0, policy_version 1481293 (0.0006) [2023-12-28 05:54:26,609][106225] Updated weights for policy 1, policy_version 1484776 (0.0006) [2023-12-28 05:54:26,611][106226] Updated weights for policy 0, policy_version 1481303 (0.0008) [2023-12-28 05:54:26,661][106225] Updated weights for policy 1, policy_version 1484786 (0.0008) [2023-12-28 05:54:27,323][106226] Updated weights for policy 0, policy_version 1481313 (0.0009) [2023-12-28 05:54:27,374][106225] Updated weights for policy 1, policy_version 1484796 (0.0007) [2023-12-28 05:54:27,385][106226] Updated weights for policy 0, policy_version 1481323 (0.0008) [2023-12-28 05:54:27,432][106225] Updated weights for policy 1, policy_version 1484806 (0.0005) [2023-12-28 05:54:27,445][106226] Updated weights for policy 0, policy_version 1481333 (0.0007) [2023-12-28 05:54:27,490][106225] Updated weights for policy 1, policy_version 1484816 (0.0005) [2023-12-28 05:54:28,121][106225] Updated weights for policy 1, policy_version 1484826 (0.0005) [2023-12-28 05:54:28,171][106225] Updated weights for policy 1, policy_version 1484836 (0.0005) [2023-12-28 05:54:28,187][106226] Updated weights for policy 0, policy_version 1481343 (0.0008) [2023-12-28 05:54:28,224][106225] Updated weights for policy 1, policy_version 1484846 (0.0005) [2023-12-28 05:54:28,239][106226] Updated weights for policy 0, policy_version 1481353 (0.0008) [2023-12-28 05:54:28,272][106225] Updated weights for policy 1, policy_version 1484856 (0.0005) [2023-12-28 05:54:28,284][106226] Updated weights for policy 0, policy_version 1481363 (0.0008) [2023-12-28 05:54:28,964][106225] Updated weights for policy 1, policy_version 1484866 (0.0008) [2023-12-28 05:54:29,018][106225] Updated weights for policy 1, policy_version 1484876 (0.0008) [2023-12-28 05:54:29,061][106226] Updated weights for policy 0, policy_version 1481373 (0.0007) [2023-12-28 05:54:29,077][106225] Updated weights for policy 1, policy_version 1484886 (0.0009) [2023-12-28 05:54:29,122][106226] Updated weights for policy 0, policy_version 1481383 (0.0008) [2023-12-28 05:54:29,180][106226] Updated weights for policy 0, policy_version 1481393 (0.0008) [2023-12-28 05:54:29,745][106225] Updated weights for policy 1, policy_version 1484896 (0.0008) [2023-12-28 05:54:29,806][106225] Updated weights for policy 1, policy_version 1484906 (0.0010) [2023-12-28 05:54:29,870][106225] Updated weights for policy 1, policy_version 1484916 (0.0010) [2023-12-28 05:54:30,026][106226] Updated weights for policy 0, policy_version 1481403 (0.0008) [2023-12-28 05:54:30,092][106226] Updated weights for policy 0, policy_version 1481413 (0.0007) [2023-12-28 05:54:30,153][106226] Updated weights for policy 0, policy_version 1481423 (0.0006) [2023-12-28 05:54:30,501][106225] Updated weights for policy 1, policy_version 1484926 (0.0007) [2023-12-28 05:54:30,555][106225] Updated weights for policy 1, policy_version 1484936 (0.0006) [2023-12-28 05:54:30,602][106225] Updated weights for policy 1, policy_version 1484946 (0.0008) [2023-12-28 05:54:30,831][106226] Updated weights for policy 0, policy_version 1481433 (0.0007) [2023-12-28 05:54:30,888][106226] Updated weights for policy 0, policy_version 1481443 (0.0009) [2023-12-28 05:54:30,944][106226] Updated weights for policy 0, policy_version 1481453 (0.0007) [2023-12-28 05:54:31,005][106226] Updated weights for policy 0, policy_version 1481463 (0.0005) [2023-12-28 05:54:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 759529472. Throughput: 0: 9795.6, 1: 10107.4. Samples: 759518784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:31,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.854')] [2023-12-28 05:54:31,294][106225] Updated weights for policy 1, policy_version 1484956 (0.0007) [2023-12-28 05:54:31,352][106225] Updated weights for policy 1, policy_version 1484966 (0.0007) [2023-12-28 05:54:31,418][106225] Updated weights for policy 1, policy_version 1484976 (0.0008) [2023-12-28 05:54:31,787][106226] Updated weights for policy 0, policy_version 1481473 (0.0007) [2023-12-28 05:54:31,847][106226] Updated weights for policy 0, policy_version 1481483 (0.0007) [2023-12-28 05:54:31,909][106226] Updated weights for policy 0, policy_version 1481493 (0.0009) [2023-12-28 05:54:32,130][106225] Updated weights for policy 1, policy_version 1484986 (0.0009) [2023-12-28 05:54:32,217][106225] Updated weights for policy 1, policy_version 1484996 (0.0010) [2023-12-28 05:54:32,289][106225] Updated weights for policy 1, policy_version 1485006 (0.0011) [2023-12-28 05:54:32,359][106225] Updated weights for policy 1, policy_version 1485016 (0.0010) [2023-12-28 05:54:32,552][106226] Updated weights for policy 0, policy_version 1481503 (0.0006) [2023-12-28 05:54:32,609][106226] Updated weights for policy 0, policy_version 1481513 (0.0006) [2023-12-28 05:54:32,668][106226] Updated weights for policy 0, policy_version 1481523 (0.0006) [2023-12-28 05:54:32,949][106225] Updated weights for policy 1, policy_version 1485026 (0.0008) [2023-12-28 05:54:33,003][106225] Updated weights for policy 1, policy_version 1485036 (0.0005) [2023-12-28 05:54:33,053][106225] Updated weights for policy 1, policy_version 1485046 (0.0005) [2023-12-28 05:54:33,267][106226] Updated weights for policy 0, policy_version 1481533 (0.0008) [2023-12-28 05:54:33,326][106226] Updated weights for policy 0, policy_version 1481543 (0.0010) [2023-12-28 05:54:33,385][106226] Updated weights for policy 0, policy_version 1481553 (0.0009) [2023-12-28 05:54:33,571][106225] Updated weights for policy 1, policy_version 1485056 (0.0005) [2023-12-28 05:54:33,621][106225] Updated weights for policy 1, policy_version 1485066 (0.0005) [2023-12-28 05:54:33,677][106225] Updated weights for policy 1, policy_version 1485076 (0.0005) [2023-12-28 05:54:34,206][106226] Updated weights for policy 0, policy_version 1481563 (0.0009) [2023-12-28 05:54:34,268][106226] Updated weights for policy 0, policy_version 1481573 (0.0008) [2023-12-28 05:54:34,328][106225] Updated weights for policy 1, policy_version 1485086 (0.0008) [2023-12-28 05:54:34,333][106226] Updated weights for policy 0, policy_version 1481583 (0.0007) [2023-12-28 05:54:34,390][106225] Updated weights for policy 1, policy_version 1485096 (0.0010) [2023-12-28 05:54:34,447][106225] Updated weights for policy 1, policy_version 1485106 (0.0010) [2023-12-28 05:54:35,054][106226] Updated weights for policy 0, policy_version 1481593 (0.0006) [2023-12-28 05:54:35,117][106226] Updated weights for policy 0, policy_version 1481603 (0.0008) [2023-12-28 05:54:35,169][106226] Updated weights for policy 0, policy_version 1481613 (0.0007) [2023-12-28 05:54:35,174][106225] Updated weights for policy 1, policy_version 1485116 (0.0011) [2023-12-28 05:54:35,218][106226] Updated weights for policy 0, policy_version 1481623 (0.0006) [2023-12-28 05:54:35,234][106225] Updated weights for policy 1, policy_version 1485126 (0.0010) [2023-12-28 05:54:35,296][106225] Updated weights for policy 1, policy_version 1485136 (0.0010) [2023-12-28 05:54:35,850][106226] Updated weights for policy 0, policy_version 1481633 (0.0008) [2023-12-28 05:54:35,910][106226] Updated weights for policy 0, policy_version 1481643 (0.0008) [2023-12-28 05:54:35,976][106226] Updated weights for policy 0, policy_version 1481653 (0.0008) [2023-12-28 05:54:36,002][106225] Updated weights for policy 1, policy_version 1485146 (0.0010) [2023-12-28 05:54:36,064][106225] Updated weights for policy 1, policy_version 1485156 (0.0007) [2023-12-28 05:54:36,143][106225] Updated weights for policy 1, policy_version 1485166 (0.0009) [2023-12-28 05:54:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 759627776. Throughput: 0: 9739.9, 1: 10159.6. Samples: 759640376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:36,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.687')] [2023-12-28 05:54:36,206][106225] Updated weights for policy 1, policy_version 1485176 (0.0007) [2023-12-28 05:54:36,728][106226] Updated weights for policy 0, policy_version 1481663 (0.0008) [2023-12-28 05:54:36,786][106226] Updated weights for policy 0, policy_version 1481673 (0.0011) [2023-12-28 05:54:36,834][106226] Updated weights for policy 0, policy_version 1481683 (0.0011) [2023-12-28 05:54:36,872][106225] Updated weights for policy 1, policy_version 1485186 (0.0006) [2023-12-28 05:54:36,931][106225] Updated weights for policy 1, policy_version 1485196 (0.0005) [2023-12-28 05:54:37,010][106225] Updated weights for policy 1, policy_version 1485206 (0.0006) [2023-12-28 05:54:37,514][106226] Updated weights for policy 0, policy_version 1481693 (0.0011) [2023-12-28 05:54:37,536][106225] Updated weights for policy 1, policy_version 1485216 (0.0005) [2023-12-28 05:54:37,580][106226] Updated weights for policy 0, policy_version 1481703 (0.0009) [2023-12-28 05:54:37,600][106225] Updated weights for policy 1, policy_version 1485226 (0.0008) [2023-12-28 05:54:37,651][106226] Updated weights for policy 0, policy_version 1481713 (0.0005) [2023-12-28 05:54:37,667][106225] Updated weights for policy 1, policy_version 1485236 (0.0009) [2023-12-28 05:54:38,307][106226] Updated weights for policy 0, policy_version 1481723 (0.0006) [2023-12-28 05:54:38,316][106225] Updated weights for policy 1, policy_version 1485246 (0.0007) [2023-12-28 05:54:38,380][106225] Updated weights for policy 1, policy_version 1485256 (0.0008) [2023-12-28 05:54:38,386][106226] Updated weights for policy 0, policy_version 1481733 (0.0007) [2023-12-28 05:54:38,441][106225] Updated weights for policy 1, policy_version 1485266 (0.0006) [2023-12-28 05:54:38,445][106226] Updated weights for policy 0, policy_version 1481743 (0.0006) [2023-12-28 05:54:39,096][106226] Updated weights for policy 0, policy_version 1481753 (0.0006) [2023-12-28 05:54:39,146][106225] Updated weights for policy 1, policy_version 1485276 (0.0008) [2023-12-28 05:54:39,150][106226] Updated weights for policy 0, policy_version 1481763 (0.0011) [2023-12-28 05:54:39,204][106226] Updated weights for policy 0, policy_version 1481773 (0.0011) [2023-12-28 05:54:39,207][106225] Updated weights for policy 1, policy_version 1485286 (0.0006) [2023-12-28 05:54:39,269][106226] Updated weights for policy 0, policy_version 1481783 (0.0009) [2023-12-28 05:54:39,271][106225] Updated weights for policy 1, policy_version 1485296 (0.0007) [2023-12-28 05:54:40,013][106226] Updated weights for policy 0, policy_version 1481793 (0.0007) [2023-12-28 05:54:40,044][106225] Updated weights for policy 1, policy_version 1485306 (0.0007) [2023-12-28 05:54:40,082][106226] Updated weights for policy 0, policy_version 1481803 (0.0007) [2023-12-28 05:54:40,105][106225] Updated weights for policy 1, policy_version 1485316 (0.0009) [2023-12-28 05:54:40,143][106226] Updated weights for policy 0, policy_version 1481813 (0.0008) [2023-12-28 05:54:40,166][106225] Updated weights for policy 1, policy_version 1485326 (0.0010) [2023-12-28 05:54:40,230][106225] Updated weights for policy 1, policy_version 1485336 (0.0011) [2023-12-28 05:54:40,808][106226] Updated weights for policy 0, policy_version 1481823 (0.0008) [2023-12-28 05:54:40,870][106226] Updated weights for policy 0, policy_version 1481833 (0.0009) [2023-12-28 05:54:40,912][106225] Updated weights for policy 1, policy_version 1485346 (0.0005) [2023-12-28 05:54:40,931][106226] Updated weights for policy 0, policy_version 1481843 (0.0008) [2023-12-28 05:54:40,979][106225] Updated weights for policy 1, policy_version 1485356 (0.0005) [2023-12-28 05:54:41,039][106225] Updated weights for policy 1, policy_version 1485366 (0.0007) [2023-12-28 05:54:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 759734272. Throughput: 0: 9755.2, 1: 10259.4. Samples: 759702600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:41,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.753')] [2023-12-28 05:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001485368_380305408.pth... [2023-12-28 05:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001481848_379428864.pth... [2023-12-28 05:54:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001484152_379994112.pth [2023-12-28 05:54:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001480696_379133952.pth [2023-12-28 05:54:41,580][106226] Updated weights for policy 0, policy_version 1481853 (0.0007) [2023-12-28 05:54:41,649][106226] Updated weights for policy 0, policy_version 1481863 (0.0010) [2023-12-28 05:54:41,720][106226] Updated weights for policy 0, policy_version 1481873 (0.0009) [2023-12-28 05:54:41,773][106225] Updated weights for policy 1, policy_version 1485376 (0.0008) [2023-12-28 05:54:41,829][106225] Updated weights for policy 1, policy_version 1485386 (0.0008) [2023-12-28 05:54:41,877][106225] Updated weights for policy 1, policy_version 1485396 (0.0008) [2023-12-28 05:54:42,440][106226] Updated weights for policy 0, policy_version 1481883 (0.0009) [2023-12-28 05:54:42,495][106226] Updated weights for policy 0, policy_version 1481893 (0.0006) [2023-12-28 05:54:42,553][106226] Updated weights for policy 0, policy_version 1481903 (0.0006) [2023-12-28 05:54:42,662][106225] Updated weights for policy 1, policy_version 1485406 (0.0007) [2023-12-28 05:54:42,728][106225] Updated weights for policy 1, policy_version 1485416 (0.0009) [2023-12-28 05:54:42,788][106225] Updated weights for policy 1, policy_version 1485426 (0.0008) [2023-12-28 05:54:43,164][106226] Updated weights for policy 0, policy_version 1481913 (0.0006) [2023-12-28 05:54:43,212][106226] Updated weights for policy 0, policy_version 1481923 (0.0005) [2023-12-28 05:54:43,275][106226] Updated weights for policy 0, policy_version 1481933 (0.0005) [2023-12-28 05:54:43,338][106226] Updated weights for policy 0, policy_version 1481943 (0.0005) [2023-12-28 05:54:43,467][106225] Updated weights for policy 1, policy_version 1485436 (0.0009) [2023-12-28 05:54:43,513][106225] Updated weights for policy 1, policy_version 1485446 (0.0010) [2023-12-28 05:54:43,567][106225] Updated weights for policy 1, policy_version 1485456 (0.0010) [2023-12-28 05:54:43,840][106226] Updated weights for policy 0, policy_version 1481953 (0.0005) [2023-12-28 05:54:43,907][106226] Updated weights for policy 0, policy_version 1481963 (0.0005) [2023-12-28 05:54:43,955][106226] Updated weights for policy 0, policy_version 1481973 (0.0005) [2023-12-28 05:54:44,268][106225] Updated weights for policy 1, policy_version 1485466 (0.0010) [2023-12-28 05:54:44,335][106225] Updated weights for policy 1, policy_version 1485476 (0.0005) [2023-12-28 05:54:44,399][106225] Updated weights for policy 1, policy_version 1485486 (0.0006) [2023-12-28 05:54:44,453][106225] Updated weights for policy 1, policy_version 1485496 (0.0005) [2023-12-28 05:54:44,464][106226] Updated weights for policy 0, policy_version 1481983 (0.0007) [2023-12-28 05:54:44,516][106226] Updated weights for policy 0, policy_version 1481993 (0.0009) [2023-12-28 05:54:44,569][106226] Updated weights for policy 0, policy_version 1482003 (0.0009) [2023-12-28 05:54:45,064][106225] Updated weights for policy 1, policy_version 1485506 (0.0009) [2023-12-28 05:54:45,132][106225] Updated weights for policy 1, policy_version 1485516 (0.0009) [2023-12-28 05:54:45,192][106225] Updated weights for policy 1, policy_version 1485526 (0.0009) [2023-12-28 05:54:45,344][106226] Updated weights for policy 0, policy_version 1482013 (0.0009) [2023-12-28 05:54:45,412][106226] Updated weights for policy 0, policy_version 1482023 (0.0009) [2023-12-28 05:54:45,478][106226] Updated weights for policy 0, policy_version 1482033 (0.0008) [2023-12-28 05:54:45,914][106225] Updated weights for policy 1, policy_version 1485536 (0.0009) [2023-12-28 05:54:45,964][106225] Updated weights for policy 1, policy_version 1485546 (0.0009) [2023-12-28 05:54:46,016][106225] Updated weights for policy 1, policy_version 1485556 (0.0009) [2023-12-28 05:54:46,126][106226] Updated weights for policy 0, policy_version 1482043 (0.0008) [2023-12-28 05:54:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 759832576. Throughput: 0: 9819.8, 1: 10153.2. Samples: 759824012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:46,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.870')] [2023-12-28 05:54:46,176][106226] Updated weights for policy 0, policy_version 1482053 (0.0008) [2023-12-28 05:54:46,226][106226] Updated weights for policy 0, policy_version 1482063 (0.0009) [2023-12-28 05:54:46,785][106225] Updated weights for policy 1, policy_version 1485566 (0.0008) [2023-12-28 05:54:46,851][106225] Updated weights for policy 1, policy_version 1485576 (0.0008) [2023-12-28 05:54:46,869][106226] Updated weights for policy 0, policy_version 1482073 (0.0009) [2023-12-28 05:54:46,910][106225] Updated weights for policy 1, policy_version 1485586 (0.0006) [2023-12-28 05:54:46,931][106226] Updated weights for policy 0, policy_version 1482083 (0.0008) [2023-12-28 05:54:46,987][106226] Updated weights for policy 0, policy_version 1482093 (0.0010) [2023-12-28 05:54:47,047][106226] Updated weights for policy 0, policy_version 1482103 (0.0010) [2023-12-28 05:54:47,656][106225] Updated weights for policy 1, policy_version 1485596 (0.0006) [2023-12-28 05:54:47,722][106225] Updated weights for policy 1, policy_version 1485606 (0.0008) [2023-12-28 05:54:47,770][106226] Updated weights for policy 0, policy_version 1482113 (0.0011) [2023-12-28 05:54:47,784][106225] Updated weights for policy 1, policy_version 1485616 (0.0005) [2023-12-28 05:54:47,831][106226] Updated weights for policy 0, policy_version 1482123 (0.0010) [2023-12-28 05:54:47,893][106226] Updated weights for policy 0, policy_version 1482133 (0.0011) [2023-12-28 05:54:48,462][106225] Updated weights for policy 1, policy_version 1485626 (0.0007) [2023-12-28 05:54:48,523][106225] Updated weights for policy 1, policy_version 1485636 (0.0007) [2023-12-28 05:54:48,580][106226] Updated weights for policy 0, policy_version 1482143 (0.0008) [2023-12-28 05:54:48,591][106225] Updated weights for policy 1, policy_version 1485646 (0.0008) [2023-12-28 05:54:48,636][106226] Updated weights for policy 0, policy_version 1482153 (0.0006) [2023-12-28 05:54:48,651][106225] Updated weights for policy 1, policy_version 1485656 (0.0009) [2023-12-28 05:54:48,695][106226] Updated weights for policy 0, policy_version 1482163 (0.0008) [2023-12-28 05:54:49,372][106225] Updated weights for policy 1, policy_version 1485666 (0.0008) [2023-12-28 05:54:49,408][106226] Updated weights for policy 0, policy_version 1482173 (0.0008) [2023-12-28 05:54:49,433][106225] Updated weights for policy 1, policy_version 1485676 (0.0007) [2023-12-28 05:54:49,467][106226] Updated weights for policy 0, policy_version 1482183 (0.0006) [2023-12-28 05:54:49,491][106225] Updated weights for policy 1, policy_version 1485686 (0.0007) [2023-12-28 05:54:49,525][106226] Updated weights for policy 0, policy_version 1482193 (0.0008) [2023-12-28 05:54:50,168][106225] Updated weights for policy 1, policy_version 1485696 (0.0008) [2023-12-28 05:54:50,221][106225] Updated weights for policy 1, policy_version 1485706 (0.0009) [2023-12-28 05:54:50,283][106225] Updated weights for policy 1, policy_version 1485716 (0.0009) [2023-12-28 05:54:50,283][106226] Updated weights for policy 0, policy_version 1482203 (0.0008) [2023-12-28 05:54:50,347][106226] Updated weights for policy 0, policy_version 1482213 (0.0008) [2023-12-28 05:54:50,411][106226] Updated weights for policy 0, policy_version 1482223 (0.0009) [2023-12-28 05:54:51,016][106225] Updated weights for policy 1, policy_version 1485726 (0.0008) [2023-12-28 05:54:51,076][106225] Updated weights for policy 1, policy_version 1485736 (0.0010) [2023-12-28 05:54:51,138][106225] Updated weights for policy 1, policy_version 1485746 (0.0009) [2023-12-28 05:54:51,154][106226] Updated weights for policy 0, policy_version 1482233 (0.0009) [2023-12-28 05:54:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 759922688. Throughput: 0: 9814.6, 1: 10115.6. Samples: 759939704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:51,175][105115] Avg episode reward: [(0, '-4.915'), (1, '-4.880')] [2023-12-28 05:54:51,218][106226] Updated weights for policy 0, policy_version 1482243 (0.0006) [2023-12-28 05:54:51,286][106226] Updated weights for policy 0, policy_version 1482253 (0.0009) [2023-12-28 05:54:51,346][106226] Updated weights for policy 0, policy_version 1482263 (0.0008) [2023-12-28 05:54:51,859][106225] Updated weights for policy 1, policy_version 1485756 (0.0006) [2023-12-28 05:54:51,913][106225] Updated weights for policy 1, policy_version 1485766 (0.0005) [2023-12-28 05:54:51,969][106225] Updated weights for policy 1, policy_version 1485776 (0.0008) [2023-12-28 05:54:52,125][106226] Updated weights for policy 0, policy_version 1482273 (0.0006) [2023-12-28 05:54:52,182][106226] Updated weights for policy 0, policy_version 1482283 (0.0005) [2023-12-28 05:54:52,240][106226] Updated weights for policy 0, policy_version 1482293 (0.0005) [2023-12-28 05:54:52,598][106225] Updated weights for policy 1, policy_version 1485786 (0.0006) [2023-12-28 05:54:52,658][106225] Updated weights for policy 1, policy_version 1485796 (0.0006) [2023-12-28 05:54:52,719][106225] Updated weights for policy 1, policy_version 1485806 (0.0008) [2023-12-28 05:54:52,774][106225] Updated weights for policy 1, policy_version 1485816 (0.0008) [2023-12-28 05:54:52,969][106226] Updated weights for policy 0, policy_version 1482303 (0.0008) [2023-12-28 05:54:53,021][106226] Updated weights for policy 0, policy_version 1482313 (0.0008) [2023-12-28 05:54:53,073][106226] Updated weights for policy 0, policy_version 1482323 (0.0009) [2023-12-28 05:54:53,393][106225] Updated weights for policy 1, policy_version 1485826 (0.0005) [2023-12-28 05:54:53,467][106225] Updated weights for policy 1, policy_version 1485836 (0.0005) [2023-12-28 05:54:53,538][106225] Updated weights for policy 1, policy_version 1485846 (0.0008) [2023-12-28 05:54:53,846][106226] Updated weights for policy 0, policy_version 1482333 (0.0009) [2023-12-28 05:54:53,900][106226] Updated weights for policy 0, policy_version 1482343 (0.0009) [2023-12-28 05:54:53,966][106226] Updated weights for policy 0, policy_version 1482353 (0.0009) [2023-12-28 05:54:54,126][106225] Updated weights for policy 1, policy_version 1485856 (0.0009) [2023-12-28 05:54:54,189][106225] Updated weights for policy 1, policy_version 1485866 (0.0008) [2023-12-28 05:54:54,252][106225] Updated weights for policy 1, policy_version 1485876 (0.0007) [2023-12-28 05:54:54,792][106226] Updated weights for policy 0, policy_version 1482363 (0.0009) [2023-12-28 05:54:54,804][106225] Updated weights for policy 1, policy_version 1485886 (0.0006) [2023-12-28 05:54:54,841][106226] Updated weights for policy 0, policy_version 1482373 (0.0008) [2023-12-28 05:54:54,862][106225] Updated weights for policy 1, policy_version 1485896 (0.0005) [2023-12-28 05:54:54,899][106226] Updated weights for policy 0, policy_version 1482383 (0.0009) [2023-12-28 05:54:54,922][106225] Updated weights for policy 1, policy_version 1485906 (0.0005) [2023-12-28 05:54:55,580][106225] Updated weights for policy 1, policy_version 1485916 (0.0007) [2023-12-28 05:54:55,640][106225] Updated weights for policy 1, policy_version 1485926 (0.0009) [2023-12-28 05:54:55,657][106226] Updated weights for policy 0, policy_version 1482393 (0.0008) [2023-12-28 05:54:55,688][106225] Updated weights for policy 1, policy_version 1485936 (0.0009) [2023-12-28 05:54:55,720][106226] Updated weights for policy 0, policy_version 1482403 (0.0006) [2023-12-28 05:54:55,785][106226] Updated weights for policy 0, policy_version 1482413 (0.0009) [2023-12-28 05:54:55,843][106226] Updated weights for policy 0, policy_version 1482423 (0.0008) [2023-12-28 05:54:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 760029184. Throughput: 0: 9817.3, 1: 10131.4. Samples: 759998596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:54:56,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.802')] [2023-12-28 05:54:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001485944_380452864.pth... [2023-12-28 05:54:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001482424_379576320.pth... [2023-12-28 05:54:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001481272_379281408.pth [2023-12-28 05:54:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001484760_380149760.pth [2023-12-28 05:54:56,411][106225] Updated weights for policy 1, policy_version 1485946 (0.0008) [2023-12-28 05:54:56,465][106225] Updated weights for policy 1, policy_version 1485956 (0.0008) [2023-12-28 05:54:56,523][106225] Updated weights for policy 1, policy_version 1485966 (0.0009) [2023-12-28 05:54:56,541][106226] Updated weights for policy 0, policy_version 1482433 (0.0006) [2023-12-28 05:54:56,570][106225] Updated weights for policy 1, policy_version 1485976 (0.0006) [2023-12-28 05:54:56,592][106226] Updated weights for policy 0, policy_version 1482443 (0.0007) [2023-12-28 05:54:56,642][106226] Updated weights for policy 0, policy_version 1482453 (0.0009) [2023-12-28 05:54:57,235][106225] Updated weights for policy 1, policy_version 1485986 (0.0008) [2023-12-28 05:54:57,292][106225] Updated weights for policy 1, policy_version 1485996 (0.0007) [2023-12-28 05:54:57,351][106225] Updated weights for policy 1, policy_version 1486006 (0.0008) [2023-12-28 05:54:57,396][106226] Updated weights for policy 0, policy_version 1482463 (0.0010) [2023-12-28 05:54:57,452][106226] Updated weights for policy 0, policy_version 1482473 (0.0010) [2023-12-28 05:54:57,514][106226] Updated weights for policy 0, policy_version 1482483 (0.0011) [2023-12-28 05:54:58,025][106225] Updated weights for policy 1, policy_version 1486016 (0.0007) [2023-12-28 05:54:58,081][106225] Updated weights for policy 1, policy_version 1486026 (0.0006) [2023-12-28 05:54:58,129][106225] Updated weights for policy 1, policy_version 1486036 (0.0005) [2023-12-28 05:54:58,237][106226] Updated weights for policy 0, policy_version 1482493 (0.0009) [2023-12-28 05:54:58,300][106226] Updated weights for policy 0, policy_version 1482503 (0.0008) [2023-12-28 05:54:58,376][106226] Updated weights for policy 0, policy_version 1482513 (0.0007) [2023-12-28 05:54:58,900][106225] Updated weights for policy 1, policy_version 1486046 (0.0007) [2023-12-28 05:54:58,963][106225] Updated weights for policy 1, policy_version 1486056 (0.0008) [2023-12-28 05:54:59,025][106225] Updated weights for policy 1, policy_version 1486066 (0.0008) [2023-12-28 05:54:59,156][106226] Updated weights for policy 0, policy_version 1482523 (0.0007) [2023-12-28 05:54:59,223][106226] Updated weights for policy 0, policy_version 1482533 (0.0008) [2023-12-28 05:54:59,289][106226] Updated weights for policy 0, policy_version 1482543 (0.0009) [2023-12-28 05:54:59,797][106225] Updated weights for policy 1, policy_version 1486076 (0.0009) [2023-12-28 05:54:59,858][106225] Updated weights for policy 1, policy_version 1486086 (0.0011) [2023-12-28 05:54:59,910][106225] Updated weights for policy 1, policy_version 1486096 (0.0010) [2023-12-28 05:54:59,991][106226] Updated weights for policy 0, policy_version 1482553 (0.0008) [2023-12-28 05:55:00,039][106226] Updated weights for policy 0, policy_version 1482563 (0.0008) [2023-12-28 05:55:00,105][106226] Updated weights for policy 0, policy_version 1482573 (0.0007) [2023-12-28 05:55:00,168][106226] Updated weights for policy 0, policy_version 1482583 (0.0008) [2023-12-28 05:55:00,647][106225] Updated weights for policy 1, policy_version 1486106 (0.0010) [2023-12-28 05:55:00,698][106225] Updated weights for policy 1, policy_version 1486116 (0.0008) [2023-12-28 05:55:00,745][106225] Updated weights for policy 1, policy_version 1486126 (0.0008) [2023-12-28 05:55:00,793][106225] Updated weights for policy 1, policy_version 1486136 (0.0008) [2023-12-28 05:55:00,888][106226] Updated weights for policy 0, policy_version 1482593 (0.0009) [2023-12-28 05:55:00,942][106226] Updated weights for policy 0, policy_version 1482603 (0.0008) [2023-12-28 05:55:00,993][106226] Updated weights for policy 0, policy_version 1482613 (0.0005) [2023-12-28 05:55:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 760127488. Throughput: 0: 9717.6, 1: 10160.0. Samples: 760115752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:01,175][105115] Avg episode reward: [(0, '-5.123'), (1, '-4.816')] [2023-12-28 05:55:01,513][106225] Updated weights for policy 1, policy_version 1486146 (0.0005) [2023-12-28 05:55:01,568][106225] Updated weights for policy 1, policy_version 1486156 (0.0007) [2023-12-28 05:55:01,633][106225] Updated weights for policy 1, policy_version 1486166 (0.0006) [2023-12-28 05:55:01,754][106226] Updated weights for policy 0, policy_version 1482623 (0.0007) [2023-12-28 05:55:01,823][106226] Updated weights for policy 0, policy_version 1482633 (0.0005) [2023-12-28 05:55:01,892][106226] Updated weights for policy 0, policy_version 1482643 (0.0006) [2023-12-28 05:55:02,245][106225] Updated weights for policy 1, policy_version 1486176 (0.0006) [2023-12-28 05:55:02,333][106225] Updated weights for policy 1, policy_version 1486186 (0.0007) [2023-12-28 05:55:02,411][106225] Updated weights for policy 1, policy_version 1486196 (0.0009) [2023-12-28 05:55:02,584][106226] Updated weights for policy 0, policy_version 1482653 (0.0009) [2023-12-28 05:55:02,641][106226] Updated weights for policy 0, policy_version 1482663 (0.0009) [2023-12-28 05:55:02,705][106226] Updated weights for policy 0, policy_version 1482673 (0.0009) [2023-12-28 05:55:03,069][106225] Updated weights for policy 1, policy_version 1486206 (0.0010) [2023-12-28 05:55:03,124][106225] Updated weights for policy 1, policy_version 1486216 (0.0010) [2023-12-28 05:55:03,184][106225] Updated weights for policy 1, policy_version 1486226 (0.0010) [2023-12-28 05:55:03,415][106226] Updated weights for policy 0, policy_version 1482683 (0.0008) [2023-12-28 05:55:03,471][106226] Updated weights for policy 0, policy_version 1482693 (0.0007) [2023-12-28 05:55:03,527][106226] Updated weights for policy 0, policy_version 1482703 (0.0008) [2023-12-28 05:55:03,800][106225] Updated weights for policy 1, policy_version 1486236 (0.0005) [2023-12-28 05:55:03,865][106225] Updated weights for policy 1, policy_version 1486246 (0.0009) [2023-12-28 05:55:03,928][106225] Updated weights for policy 1, policy_version 1486256 (0.0010) [2023-12-28 05:55:04,293][106226] Updated weights for policy 0, policy_version 1482713 (0.0008) [2023-12-28 05:55:04,348][106226] Updated weights for policy 0, policy_version 1482723 (0.0008) [2023-12-28 05:55:04,410][106226] Updated weights for policy 0, policy_version 1482733 (0.0008) [2023-12-28 05:55:04,458][106226] Updated weights for policy 0, policy_version 1482743 (0.0008) [2023-12-28 05:55:04,640][106225] Updated weights for policy 1, policy_version 1486266 (0.0010) [2023-12-28 05:55:04,692][106225] Updated weights for policy 1, policy_version 1486276 (0.0010) [2023-12-28 05:55:04,742][106225] Updated weights for policy 1, policy_version 1486286 (0.0010) [2023-12-28 05:55:04,791][106225] Updated weights for policy 1, policy_version 1486296 (0.0010) [2023-12-28 05:55:05,206][106226] Updated weights for policy 0, policy_version 1482753 (0.0009) [2023-12-28 05:55:05,258][106226] Updated weights for policy 0, policy_version 1482763 (0.0008) [2023-12-28 05:55:05,313][106226] Updated weights for policy 0, policy_version 1482773 (0.0008) [2023-12-28 05:55:05,457][106225] Updated weights for policy 1, policy_version 1486306 (0.0009) [2023-12-28 05:55:05,520][106225] Updated weights for policy 1, policy_version 1486316 (0.0008) [2023-12-28 05:55:05,582][106225] Updated weights for policy 1, policy_version 1486326 (0.0010) [2023-12-28 05:55:06,085][106226] Updated weights for policy 0, policy_version 1482783 (0.0009) [2023-12-28 05:55:06,147][106226] Updated weights for policy 0, policy_version 1482793 (0.0008) [2023-12-28 05:55:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 760217600. Throughput: 0: 9671.9, 1: 10167.5. Samples: 760233004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:06,175][105115] Avg episode reward: [(0, '-4.876'), (1, '-4.515')] [2023-12-28 05:55:06,215][106226] Updated weights for policy 0, policy_version 1482803 (0.0010) [2023-12-28 05:55:06,296][106225] Updated weights for policy 1, policy_version 1486336 (0.0008) [2023-12-28 05:55:06,355][106225] Updated weights for policy 1, policy_version 1486346 (0.0008) [2023-12-28 05:55:06,417][106225] Updated weights for policy 1, policy_version 1486356 (0.0008) [2023-12-28 05:55:06,943][106226] Updated weights for policy 0, policy_version 1482813 (0.0008) [2023-12-28 05:55:06,995][106226] Updated weights for policy 0, policy_version 1482823 (0.0008) [2023-12-28 05:55:07,031][106225] Updated weights for policy 1, policy_version 1486366 (0.0009) [2023-12-28 05:55:07,055][106226] Updated weights for policy 0, policy_version 1482833 (0.0008) [2023-12-28 05:55:07,091][106225] Updated weights for policy 1, policy_version 1486376 (0.0010) [2023-12-28 05:55:07,138][106225] Updated weights for policy 1, policy_version 1486386 (0.0010) [2023-12-28 05:55:07,720][106226] Updated weights for policy 0, policy_version 1482843 (0.0007) [2023-12-28 05:55:07,775][106226] Updated weights for policy 0, policy_version 1482853 (0.0007) [2023-12-28 05:55:07,785][106225] Updated weights for policy 1, policy_version 1486396 (0.0008) [2023-12-28 05:55:07,832][106226] Updated weights for policy 0, policy_version 1482863 (0.0009) [2023-12-28 05:55:07,834][106225] Updated weights for policy 1, policy_version 1486406 (0.0005) [2023-12-28 05:55:07,886][106225] Updated weights for policy 1, policy_version 1486416 (0.0005) [2023-12-28 05:55:08,476][106225] Updated weights for policy 1, policy_version 1486426 (0.0006) [2023-12-28 05:55:08,543][106225] Updated weights for policy 1, policy_version 1486436 (0.0009) [2023-12-28 05:55:08,610][106225] Updated weights for policy 1, policy_version 1486446 (0.0010) [2023-12-28 05:55:08,629][106226] Updated weights for policy 0, policy_version 1482873 (0.0008) [2023-12-28 05:55:08,673][106225] Updated weights for policy 1, policy_version 1486456 (0.0009) [2023-12-28 05:55:08,687][106226] Updated weights for policy 0, policy_version 1482883 (0.0007) [2023-12-28 05:55:08,750][106226] Updated weights for policy 0, policy_version 1482893 (0.0009) [2023-12-28 05:55:08,811][106226] Updated weights for policy 0, policy_version 1482903 (0.0009) [2023-12-28 05:55:09,358][106225] Updated weights for policy 1, policy_version 1486466 (0.0008) [2023-12-28 05:55:09,430][106225] Updated weights for policy 1, policy_version 1486476 (0.0008) [2023-12-28 05:55:09,498][106225] Updated weights for policy 1, policy_version 1486486 (0.0006) [2023-12-28 05:55:09,612][106226] Updated weights for policy 0, policy_version 1482913 (0.0008) [2023-12-28 05:55:09,680][106226] Updated weights for policy 0, policy_version 1482923 (0.0009) [2023-12-28 05:55:09,728][106226] Updated weights for policy 0, policy_version 1482933 (0.0009) [2023-12-28 05:55:10,166][106225] Updated weights for policy 1, policy_version 1486496 (0.0006) [2023-12-28 05:55:10,232][106225] Updated weights for policy 1, policy_version 1486506 (0.0009) [2023-12-28 05:55:10,291][106225] Updated weights for policy 1, policy_version 1486516 (0.0011) [2023-12-28 05:55:10,508][106226] Updated weights for policy 0, policy_version 1482943 (0.0008) [2023-12-28 05:55:10,576][106226] Updated weights for policy 0, policy_version 1482953 (0.0007) [2023-12-28 05:55:10,634][106226] Updated weights for policy 0, policy_version 1482963 (0.0010) [2023-12-28 05:55:10,863][106225] Updated weights for policy 1, policy_version 1486526 (0.0009) [2023-12-28 05:55:10,917][106225] Updated weights for policy 1, policy_version 1486536 (0.0007) [2023-12-28 05:55:10,967][106225] Updated weights for policy 1, policy_version 1486546 (0.0008) [2023-12-28 05:55:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 760324096. Throughput: 0: 9669.9, 1: 10228.3. Samples: 760293144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:11,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.519')] [2023-12-28 05:55:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001486552_380608512.pth... [2023-12-28 05:55:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001482968_379715584.pth... [2023-12-28 05:55:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001485368_380305408.pth [2023-12-28 05:55:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001481848_379428864.pth [2023-12-28 05:55:11,386][106226] Updated weights for policy 0, policy_version 1482973 (0.0008) [2023-12-28 05:55:11,452][106226] Updated weights for policy 0, policy_version 1482983 (0.0007) [2023-12-28 05:55:11,518][106226] Updated weights for policy 0, policy_version 1482993 (0.0008) [2023-12-28 05:55:11,786][106225] Updated weights for policy 1, policy_version 1486556 (0.0009) [2023-12-28 05:55:11,849][106225] Updated weights for policy 1, policy_version 1486566 (0.0010) [2023-12-28 05:55:11,912][106225] Updated weights for policy 1, policy_version 1486576 (0.0011) [2023-12-28 05:55:12,187][106226] Updated weights for policy 0, policy_version 1483003 (0.0008) [2023-12-28 05:55:12,250][106226] Updated weights for policy 0, policy_version 1483013 (0.0007) [2023-12-28 05:55:12,321][106226] Updated weights for policy 0, policy_version 1483023 (0.0007) [2023-12-28 05:55:12,661][106225] Updated weights for policy 1, policy_version 1486586 (0.0011) [2023-12-28 05:55:12,720][106225] Updated weights for policy 1, policy_version 1486596 (0.0008) [2023-12-28 05:55:12,786][106225] Updated weights for policy 1, policy_version 1486606 (0.0010) [2023-12-28 05:55:12,845][106225] Updated weights for policy 1, policy_version 1486616 (0.0008) [2023-12-28 05:55:13,031][106226] Updated weights for policy 0, policy_version 1483033 (0.0008) [2023-12-28 05:55:13,091][106226] Updated weights for policy 0, policy_version 1483043 (0.0009) [2023-12-28 05:55:13,140][106226] Updated weights for policy 0, policy_version 1483053 (0.0009) [2023-12-28 05:55:13,193][106226] Updated weights for policy 0, policy_version 1483063 (0.0008) [2023-12-28 05:55:13,550][106225] Updated weights for policy 1, policy_version 1486626 (0.0006) [2023-12-28 05:55:13,614][106225] Updated weights for policy 1, policy_version 1486636 (0.0008) [2023-12-28 05:55:13,673][106225] Updated weights for policy 1, policy_version 1486646 (0.0008) [2023-12-28 05:55:13,941][106226] Updated weights for policy 0, policy_version 1483073 (0.0007) [2023-12-28 05:55:13,990][106226] Updated weights for policy 0, policy_version 1483083 (0.0008) [2023-12-28 05:55:14,041][106226] Updated weights for policy 0, policy_version 1483093 (0.0010) [2023-12-28 05:55:14,246][106225] Updated weights for policy 1, policy_version 1486656 (0.0006) [2023-12-28 05:55:14,303][106225] Updated weights for policy 1, policy_version 1486666 (0.0005) [2023-12-28 05:55:14,370][106225] Updated weights for policy 1, policy_version 1486676 (0.0007) [2023-12-28 05:55:14,866][106226] Updated weights for policy 0, policy_version 1483103 (0.0009) [2023-12-28 05:55:14,933][106226] Updated weights for policy 0, policy_version 1483113 (0.0007) [2023-12-28 05:55:14,983][106225] Updated weights for policy 1, policy_version 1486686 (0.0009) [2023-12-28 05:55:15,000][106226] Updated weights for policy 0, policy_version 1483123 (0.0010) [2023-12-28 05:55:15,048][106225] Updated weights for policy 1, policy_version 1486696 (0.0011) [2023-12-28 05:55:15,112][106225] Updated weights for policy 1, policy_version 1486706 (0.0010) [2023-12-28 05:55:15,619][106226] Updated weights for policy 0, policy_version 1483133 (0.0008) [2023-12-28 05:55:15,676][106226] Updated weights for policy 0, policy_version 1483143 (0.0005) [2023-12-28 05:55:15,730][106226] Updated weights for policy 0, policy_version 1483153 (0.0007) [2023-12-28 05:55:15,830][106225] Updated weights for policy 1, policy_version 1486716 (0.0009) [2023-12-28 05:55:15,883][106225] Updated weights for policy 1, policy_version 1486726 (0.0005) [2023-12-28 05:55:15,929][106225] Updated weights for policy 1, policy_version 1486736 (0.0005) [2023-12-28 05:55:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19934.0, 300 sec: 19716.4). Total num frames: 760422400. Throughput: 0: 9673.3, 1: 10133.3. Samples: 760410076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:16,175][105115] Avg episode reward: [(0, '-4.871'), (1, '-4.803')] [2023-12-28 05:55:16,315][106226] Updated weights for policy 0, policy_version 1483163 (0.0006) [2023-12-28 05:55:16,378][106226] Updated weights for policy 0, policy_version 1483173 (0.0008) [2023-12-28 05:55:16,442][106226] Updated weights for policy 0, policy_version 1483183 (0.0006) [2023-12-28 05:55:16,516][106225] Updated weights for policy 1, policy_version 1486746 (0.0006) [2023-12-28 05:55:16,563][106225] Updated weights for policy 1, policy_version 1486756 (0.0010) [2023-12-28 05:55:16,617][106225] Updated weights for policy 1, policy_version 1486766 (0.0010) [2023-12-28 05:55:16,677][106225] Updated weights for policy 1, policy_version 1486776 (0.0010) [2023-12-28 05:55:16,995][106226] Updated weights for policy 0, policy_version 1483193 (0.0006) [2023-12-28 05:55:17,061][106226] Updated weights for policy 0, policy_version 1483203 (0.0009) [2023-12-28 05:55:17,119][106226] Updated weights for policy 0, policy_version 1483213 (0.0008) [2023-12-28 05:55:17,173][106226] Updated weights for policy 0, policy_version 1483223 (0.0008) [2023-12-28 05:55:17,289][106225] Updated weights for policy 1, policy_version 1486786 (0.0009) [2023-12-28 05:55:17,351][106225] Updated weights for policy 1, policy_version 1486796 (0.0007) [2023-12-28 05:55:17,414][106225] Updated weights for policy 1, policy_version 1486806 (0.0008) [2023-12-28 05:55:17,884][106226] Updated weights for policy 0, policy_version 1483233 (0.0009) [2023-12-28 05:55:17,939][106226] Updated weights for policy 0, policy_version 1483243 (0.0009) [2023-12-28 05:55:17,997][106226] Updated weights for policy 0, policy_version 1483253 (0.0008) [2023-12-28 05:55:18,109][106225] Updated weights for policy 1, policy_version 1486816 (0.0009) [2023-12-28 05:55:18,166][106225] Updated weights for policy 1, policy_version 1486826 (0.0008) [2023-12-28 05:55:18,222][106225] Updated weights for policy 1, policy_version 1486836 (0.0009) [2023-12-28 05:55:18,673][106226] Updated weights for policy 0, policy_version 1483263 (0.0007) [2023-12-28 05:55:18,739][106226] Updated weights for policy 0, policy_version 1483273 (0.0006) [2023-12-28 05:55:18,797][106226] Updated weights for policy 0, policy_version 1483283 (0.0008) [2023-12-28 05:55:18,990][106225] Updated weights for policy 1, policy_version 1486846 (0.0009) [2023-12-28 05:55:19,042][106225] Updated weights for policy 1, policy_version 1486856 (0.0009) [2023-12-28 05:55:19,093][106225] Updated weights for policy 1, policy_version 1486866 (0.0006) [2023-12-28 05:55:19,449][106226] Updated weights for policy 0, policy_version 1483293 (0.0007) [2023-12-28 05:55:19,520][106226] Updated weights for policy 0, policy_version 1483303 (0.0008) [2023-12-28 05:55:19,584][106226] Updated weights for policy 0, policy_version 1483313 (0.0008) [2023-12-28 05:55:19,842][106225] Updated weights for policy 1, policy_version 1486876 (0.0007) [2023-12-28 05:55:19,897][106225] Updated weights for policy 1, policy_version 1486886 (0.0009) [2023-12-28 05:55:19,959][106225] Updated weights for policy 1, policy_version 1486896 (0.0008) [2023-12-28 05:55:20,243][106226] Updated weights for policy 0, policy_version 1483323 (0.0009) [2023-12-28 05:55:20,294][106226] Updated weights for policy 0, policy_version 1483333 (0.0009) [2023-12-28 05:55:20,352][106226] Updated weights for policy 0, policy_version 1483343 (0.0009) [2023-12-28 05:55:20,686][106225] Updated weights for policy 1, policy_version 1486906 (0.0007) [2023-12-28 05:55:20,752][106225] Updated weights for policy 1, policy_version 1486916 (0.0009) [2023-12-28 05:55:20,819][106225] Updated weights for policy 1, policy_version 1486926 (0.0009) [2023-12-28 05:55:20,884][106225] Updated weights for policy 1, policy_version 1486936 (0.0009) [2023-12-28 05:55:21,167][106226] Updated weights for policy 0, policy_version 1483353 (0.0008) [2023-12-28 05:55:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 760520704. Throughput: 0: 9753.4, 1: 10082.9. Samples: 760533012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:21,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.559')] [2023-12-28 05:55:21,232][106226] Updated weights for policy 0, policy_version 1483363 (0.0008) [2023-12-28 05:55:21,298][106226] Updated weights for policy 0, policy_version 1483373 (0.0008) [2023-12-28 05:55:21,360][106226] Updated weights for policy 0, policy_version 1483383 (0.0008) [2023-12-28 05:55:21,694][106225] Updated weights for policy 1, policy_version 1486946 (0.0009) [2023-12-28 05:55:21,762][106225] Updated weights for policy 1, policy_version 1486956 (0.0008) [2023-12-28 05:55:21,819][106225] Updated weights for policy 1, policy_version 1486966 (0.0008) [2023-12-28 05:55:22,127][106226] Updated weights for policy 0, policy_version 1483393 (0.0006) [2023-12-28 05:55:22,196][106226] Updated weights for policy 0, policy_version 1483403 (0.0009) [2023-12-28 05:55:22,261][106226] Updated weights for policy 0, policy_version 1483413 (0.0008) [2023-12-28 05:55:22,547][106225] Updated weights for policy 1, policy_version 1486976 (0.0009) [2023-12-28 05:55:22,606][106225] Updated weights for policy 1, policy_version 1486986 (0.0009) [2023-12-28 05:55:22,670][106225] Updated weights for policy 1, policy_version 1486996 (0.0009) [2023-12-28 05:55:22,940][106226] Updated weights for policy 0, policy_version 1483423 (0.0006) [2023-12-28 05:55:23,009][106226] Updated weights for policy 0, policy_version 1483433 (0.0006) [2023-12-28 05:55:23,071][106226] Updated weights for policy 0, policy_version 1483443 (0.0006) [2023-12-28 05:55:23,370][106225] Updated weights for policy 1, policy_version 1487006 (0.0010) [2023-12-28 05:55:23,437][106225] Updated weights for policy 1, policy_version 1487016 (0.0010) [2023-12-28 05:55:23,498][106225] Updated weights for policy 1, policy_version 1487026 (0.0011) [2023-12-28 05:55:23,628][106226] Updated weights for policy 0, policy_version 1483453 (0.0009) [2023-12-28 05:55:23,684][106226] Updated weights for policy 0, policy_version 1483463 (0.0010) [2023-12-28 05:55:23,731][106226] Updated weights for policy 0, policy_version 1483473 (0.0010) [2023-12-28 05:55:24,114][106225] Updated weights for policy 1, policy_version 1487036 (0.0010) [2023-12-28 05:55:24,176][106225] Updated weights for policy 1, policy_version 1487046 (0.0007) [2023-12-28 05:55:24,246][106225] Updated weights for policy 1, policy_version 1487056 (0.0007) [2023-12-28 05:55:24,417][106226] Updated weights for policy 0, policy_version 1483483 (0.0010) [2023-12-28 05:55:24,472][106226] Updated weights for policy 0, policy_version 1483493 (0.0010) [2023-12-28 05:55:24,532][106226] Updated weights for policy 0, policy_version 1483503 (0.0011) [2023-12-28 05:55:24,914][106225] Updated weights for policy 1, policy_version 1487066 (0.0010) [2023-12-28 05:55:24,971][106225] Updated weights for policy 1, policy_version 1487076 (0.0010) [2023-12-28 05:55:25,029][106225] Updated weights for policy 1, policy_version 1487086 (0.0010) [2023-12-28 05:55:25,088][106225] Updated weights for policy 1, policy_version 1487096 (0.0010) [2023-12-28 05:55:25,207][106226] Updated weights for policy 0, policy_version 1483513 (0.0011) [2023-12-28 05:55:25,270][106226] Updated weights for policy 0, policy_version 1483523 (0.0010) [2023-12-28 05:55:25,337][106226] Updated weights for policy 0, policy_version 1483533 (0.0011) [2023-12-28 05:55:25,404][106226] Updated weights for policy 0, policy_version 1483543 (0.0011) [2023-12-28 05:55:25,710][106225] Updated weights for policy 1, policy_version 1487106 (0.0005) [2023-12-28 05:55:25,758][106225] Updated weights for policy 1, policy_version 1487116 (0.0005) [2023-12-28 05:55:25,819][106225] Updated weights for policy 1, policy_version 1487126 (0.0005) [2023-12-28 05:55:26,111][106226] Updated weights for policy 0, policy_version 1483553 (0.0011) [2023-12-28 05:55:26,165][106226] Updated weights for policy 0, policy_version 1483563 (0.0011) [2023-12-28 05:55:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19716.3). Total num frames: 760619008. Throughput: 0: 9742.3, 1: 9992.8. Samples: 760590684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:26,176][105115] Avg episode reward: [(0, '-4.871'), (1, '-4.590')] [2023-12-28 05:55:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001487128_380755968.pth... [2023-12-28 05:55:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001485944_380452864.pth [2023-12-28 05:55:26,218][106226] Updated weights for policy 0, policy_version 1483573 (0.0010) [2023-12-28 05:55:26,234][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001483576_379871232.pth... [2023-12-28 05:55:26,237][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001482424_379576320.pth [2023-12-28 05:55:26,411][106225] Updated weights for policy 1, policy_version 1487136 (0.0009) [2023-12-28 05:55:26,470][106225] Updated weights for policy 1, policy_version 1487146 (0.0008) [2023-12-28 05:55:26,523][106225] Updated weights for policy 1, policy_version 1487156 (0.0008) [2023-12-28 05:55:26,887][106226] Updated weights for policy 0, policy_version 1483583 (0.0008) [2023-12-28 05:55:26,956][106226] Updated weights for policy 0, policy_version 1483593 (0.0006) [2023-12-28 05:55:27,014][106226] Updated weights for policy 0, policy_version 1483603 (0.0011) [2023-12-28 05:55:27,175][106225] Updated weights for policy 1, policy_version 1487166 (0.0010) [2023-12-28 05:55:27,220][106225] Updated weights for policy 1, policy_version 1487176 (0.0009) [2023-12-28 05:55:27,264][106225] Updated weights for policy 1, policy_version 1487186 (0.0005) [2023-12-28 05:55:27,594][106226] Updated weights for policy 0, policy_version 1483613 (0.0011) [2023-12-28 05:55:27,652][106226] Updated weights for policy 0, policy_version 1483623 (0.0010) [2023-12-28 05:55:27,708][106226] Updated weights for policy 0, policy_version 1483633 (0.0010) [2023-12-28 05:55:27,952][106225] Updated weights for policy 1, policy_version 1487196 (0.0006) [2023-12-28 05:55:27,999][106225] Updated weights for policy 1, policy_version 1487206 (0.0009) [2023-12-28 05:55:28,042][106225] Updated weights for policy 1, policy_version 1487216 (0.0010) [2023-12-28 05:55:28,405][106226] Updated weights for policy 0, policy_version 1483643 (0.0009) [2023-12-28 05:55:28,471][106226] Updated weights for policy 0, policy_version 1483653 (0.0011) [2023-12-28 05:55:28,540][106226] Updated weights for policy 0, policy_version 1483663 (0.0011) [2023-12-28 05:55:28,725][106225] Updated weights for policy 1, policy_version 1487226 (0.0008) [2023-12-28 05:55:28,779][106225] Updated weights for policy 1, policy_version 1487236 (0.0006) [2023-12-28 05:55:28,835][106225] Updated weights for policy 1, policy_version 1487246 (0.0006) [2023-12-28 05:55:28,895][106225] Updated weights for policy 1, policy_version 1487256 (0.0006) [2023-12-28 05:55:29,195][106226] Updated weights for policy 0, policy_version 1483673 (0.0010) [2023-12-28 05:55:29,261][106226] Updated weights for policy 0, policy_version 1483683 (0.0008) [2023-12-28 05:55:29,334][106226] Updated weights for policy 0, policy_version 1483693 (0.0006) [2023-12-28 05:55:29,402][106226] Updated weights for policy 0, policy_version 1483703 (0.0008) [2023-12-28 05:55:29,563][106225] Updated weights for policy 1, policy_version 1487266 (0.0006) [2023-12-28 05:55:29,620][106225] Updated weights for policy 1, policy_version 1487276 (0.0005) [2023-12-28 05:55:29,682][106225] Updated weights for policy 1, policy_version 1487286 (0.0006) [2023-12-28 05:55:30,062][106226] Updated weights for policy 0, policy_version 1483713 (0.0009) [2023-12-28 05:55:30,113][106226] Updated weights for policy 0, policy_version 1483723 (0.0008) [2023-12-28 05:55:30,161][106226] Updated weights for policy 0, policy_version 1483733 (0.0008) [2023-12-28 05:55:30,381][106225] Updated weights for policy 1, policy_version 1487296 (0.0010) [2023-12-28 05:55:30,438][106225] Updated weights for policy 1, policy_version 1487306 (0.0010) [2023-12-28 05:55:30,495][106225] Updated weights for policy 1, policy_version 1487316 (0.0010) [2023-12-28 05:55:30,877][106226] Updated weights for policy 0, policy_version 1483743 (0.0010) [2023-12-28 05:55:30,923][106226] Updated weights for policy 0, policy_version 1483753 (0.0010) [2023-12-28 05:55:30,969][106226] Updated weights for policy 0, policy_version 1483763 (0.0010) [2023-12-28 05:55:31,163][106225] Updated weights for policy 1, policy_version 1487326 (0.0007) [2023-12-28 05:55:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 760725504. Throughput: 0: 9713.3, 1: 10125.2. Samples: 760716740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:31,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.858')] [2023-12-28 05:55:31,228][106225] Updated weights for policy 1, policy_version 1487336 (0.0009) [2023-12-28 05:55:31,293][106225] Updated weights for policy 1, policy_version 1487346 (0.0008) [2023-12-28 05:55:31,722][106226] Updated weights for policy 0, policy_version 1483773 (0.0010) [2023-12-28 05:55:31,794][106226] Updated weights for policy 0, policy_version 1483783 (0.0008) [2023-12-28 05:55:31,855][106226] Updated weights for policy 0, policy_version 1483793 (0.0008) [2023-12-28 05:55:32,023][106225] Updated weights for policy 1, policy_version 1487356 (0.0009) [2023-12-28 05:55:32,082][106225] Updated weights for policy 1, policy_version 1487366 (0.0009) [2023-12-28 05:55:32,142][106225] Updated weights for policy 1, policy_version 1487376 (0.0008) [2023-12-28 05:55:32,582][106226] Updated weights for policy 0, policy_version 1483803 (0.0009) [2023-12-28 05:55:32,652][106226] Updated weights for policy 0, policy_version 1483813 (0.0008) [2023-12-28 05:55:32,718][106226] Updated weights for policy 0, policy_version 1483823 (0.0008) [2023-12-28 05:55:32,925][106225] Updated weights for policy 1, policy_version 1487386 (0.0009) [2023-12-28 05:55:32,981][106225] Updated weights for policy 1, policy_version 1487396 (0.0006) [2023-12-28 05:55:33,037][106225] Updated weights for policy 1, policy_version 1487406 (0.0006) [2023-12-28 05:55:33,090][106225] Updated weights for policy 1, policy_version 1487416 (0.0007) [2023-12-28 05:55:33,394][106226] Updated weights for policy 0, policy_version 1483833 (0.0008) [2023-12-28 05:55:33,458][106226] Updated weights for policy 0, policy_version 1483843 (0.0009) [2023-12-28 05:55:33,520][106226] Updated weights for policy 0, policy_version 1483853 (0.0008) [2023-12-28 05:55:33,580][106226] Updated weights for policy 0, policy_version 1483863 (0.0008) [2023-12-28 05:55:33,752][106225] Updated weights for policy 1, policy_version 1487426 (0.0009) [2023-12-28 05:55:33,814][106225] Updated weights for policy 1, policy_version 1487436 (0.0009) [2023-12-28 05:55:33,868][106225] Updated weights for policy 1, policy_version 1487446 (0.0008) [2023-12-28 05:55:34,265][106226] Updated weights for policy 0, policy_version 1483873 (0.0009) [2023-12-28 05:55:34,332][106226] Updated weights for policy 0, policy_version 1483883 (0.0008) [2023-12-28 05:55:34,395][106226] Updated weights for policy 0, policy_version 1483893 (0.0008) [2023-12-28 05:55:34,569][106225] Updated weights for policy 1, policy_version 1487456 (0.0009) [2023-12-28 05:55:34,629][106225] Updated weights for policy 1, policy_version 1487466 (0.0008) [2023-12-28 05:55:34,696][106225] Updated weights for policy 1, policy_version 1487476 (0.0008) [2023-12-28 05:55:35,122][106226] Updated weights for policy 0, policy_version 1483903 (0.0009) [2023-12-28 05:55:35,178][106226] Updated weights for policy 0, policy_version 1483913 (0.0008) [2023-12-28 05:55:35,231][106226] Updated weights for policy 0, policy_version 1483923 (0.0009) [2023-12-28 05:55:35,406][106225] Updated weights for policy 1, policy_version 1487486 (0.0009) [2023-12-28 05:55:35,456][106225] Updated weights for policy 1, policy_version 1487496 (0.0009) [2023-12-28 05:55:35,509][106225] Updated weights for policy 1, policy_version 1487506 (0.0009) [2023-12-28 05:55:35,854][106226] Updated weights for policy 0, policy_version 1483933 (0.0008) [2023-12-28 05:55:35,921][106226] Updated weights for policy 0, policy_version 1483943 (0.0005) [2023-12-28 05:55:35,989][106226] Updated weights for policy 0, policy_version 1483953 (0.0005) [2023-12-28 05:55:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 760823808. Throughput: 0: 9729.2, 1: 10139.8. Samples: 760833812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:36,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-4.779')] [2023-12-28 05:55:36,279][106225] Updated weights for policy 1, policy_version 1487516 (0.0009) [2023-12-28 05:55:36,345][106225] Updated weights for policy 1, policy_version 1487526 (0.0008) [2023-12-28 05:55:36,411][106225] Updated weights for policy 1, policy_version 1487536 (0.0008) [2023-12-28 05:55:36,589][106226] Updated weights for policy 0, policy_version 1483963 (0.0006) [2023-12-28 05:55:36,658][106226] Updated weights for policy 0, policy_version 1483973 (0.0008) [2023-12-28 05:55:36,721][106226] Updated weights for policy 0, policy_version 1483983 (0.0008) [2023-12-28 05:55:37,138][106225] Updated weights for policy 1, policy_version 1487546 (0.0009) [2023-12-28 05:55:37,188][106225] Updated weights for policy 1, policy_version 1487556 (0.0010) [2023-12-28 05:55:37,246][106225] Updated weights for policy 1, policy_version 1487566 (0.0010) [2023-12-28 05:55:37,309][106225] Updated weights for policy 1, policy_version 1487576 (0.0010) [2023-12-28 05:55:37,441][106226] Updated weights for policy 0, policy_version 1483993 (0.0008) [2023-12-28 05:55:37,500][106226] Updated weights for policy 0, policy_version 1484003 (0.0005) [2023-12-28 05:55:37,563][106226] Updated weights for policy 0, policy_version 1484013 (0.0006) [2023-12-28 05:55:37,615][106226] Updated weights for policy 0, policy_version 1484023 (0.0009) [2023-12-28 05:55:38,016][106225] Updated weights for policy 1, policy_version 1487586 (0.0011) [2023-12-28 05:55:38,078][106225] Updated weights for policy 1, policy_version 1487596 (0.0010) [2023-12-28 05:55:38,134][106225] Updated weights for policy 1, policy_version 1487606 (0.0010) [2023-12-28 05:55:38,275][106226] Updated weights for policy 0, policy_version 1484033 (0.0007) [2023-12-28 05:55:38,322][106226] Updated weights for policy 0, policy_version 1484043 (0.0008) [2023-12-28 05:55:38,389][106226] Updated weights for policy 0, policy_version 1484053 (0.0008) [2023-12-28 05:55:38,787][106225] Updated weights for policy 1, policy_version 1487616 (0.0010) [2023-12-28 05:55:38,839][106225] Updated weights for policy 1, policy_version 1487626 (0.0010) [2023-12-28 05:55:38,892][106225] Updated weights for policy 1, policy_version 1487636 (0.0007) [2023-12-28 05:55:39,022][106226] Updated weights for policy 0, policy_version 1484063 (0.0007) [2023-12-28 05:55:39,085][106226] Updated weights for policy 0, policy_version 1484073 (0.0008) [2023-12-28 05:55:39,140][106226] Updated weights for policy 0, policy_version 1484083 (0.0008) [2023-12-28 05:55:39,544][106225] Updated weights for policy 1, policy_version 1487646 (0.0006) [2023-12-28 05:55:39,603][106225] Updated weights for policy 1, policy_version 1487656 (0.0006) [2023-12-28 05:55:39,666][106225] Updated weights for policy 1, policy_version 1487666 (0.0006) [2023-12-28 05:55:39,937][106226] Updated weights for policy 0, policy_version 1484093 (0.0008) [2023-12-28 05:55:40,004][106226] Updated weights for policy 0, policy_version 1484103 (0.0009) [2023-12-28 05:55:40,073][106226] Updated weights for policy 0, policy_version 1484113 (0.0009) [2023-12-28 05:55:40,349][106225] Updated weights for policy 1, policy_version 1487676 (0.0007) [2023-12-28 05:55:40,409][106225] Updated weights for policy 1, policy_version 1487686 (0.0006) [2023-12-28 05:55:40,473][106225] Updated weights for policy 1, policy_version 1487696 (0.0009) [2023-12-28 05:55:40,769][106226] Updated weights for policy 0, policy_version 1484123 (0.0008) [2023-12-28 05:55:40,824][106226] Updated weights for policy 0, policy_version 1484133 (0.0005) [2023-12-28 05:55:40,879][106226] Updated weights for policy 0, policy_version 1484143 (0.0005) [2023-12-28 05:55:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 760922112. Throughput: 0: 9815.5, 1: 10096.5. Samples: 760894636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:41,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-4.736')] [2023-12-28 05:55:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001487704_380903424.pth... [2023-12-28 05:55:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001484152_380018688.pth... [2023-12-28 05:55:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001482968_379715584.pth [2023-12-28 05:55:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001486552_380608512.pth [2023-12-28 05:55:41,273][106225] Updated weights for policy 1, policy_version 1487706 (0.0008) [2023-12-28 05:55:41,331][106225] Updated weights for policy 1, policy_version 1487716 (0.0007) [2023-12-28 05:55:41,399][106225] Updated weights for policy 1, policy_version 1487726 (0.0008) [2023-12-28 05:55:41,466][106225] Updated weights for policy 1, policy_version 1487736 (0.0009) [2023-12-28 05:55:41,544][106226] Updated weights for policy 0, policy_version 1484153 (0.0006) [2023-12-28 05:55:41,604][106226] Updated weights for policy 0, policy_version 1484163 (0.0009) [2023-12-28 05:55:41,677][106226] Updated weights for policy 0, policy_version 1484173 (0.0009) [2023-12-28 05:55:41,763][106226] Updated weights for policy 0, policy_version 1484183 (0.0008) [2023-12-28 05:55:42,225][106225] Updated weights for policy 1, policy_version 1487746 (0.0008) [2023-12-28 05:55:42,289][106225] Updated weights for policy 1, policy_version 1487756 (0.0009) [2023-12-28 05:55:42,354][106225] Updated weights for policy 1, policy_version 1487766 (0.0009) [2023-12-28 05:55:42,486][106226] Updated weights for policy 0, policy_version 1484193 (0.0006) [2023-12-28 05:55:42,546][106226] Updated weights for policy 0, policy_version 1484203 (0.0006) [2023-12-28 05:55:42,603][106226] Updated weights for policy 0, policy_version 1484213 (0.0008) [2023-12-28 05:55:43,072][106225] Updated weights for policy 1, policy_version 1487776 (0.0007) [2023-12-28 05:55:43,128][106225] Updated weights for policy 1, policy_version 1487786 (0.0006) [2023-12-28 05:55:43,196][106225] Updated weights for policy 1, policy_version 1487796 (0.0005) [2023-12-28 05:55:43,273][106226] Updated weights for policy 0, policy_version 1484223 (0.0008) [2023-12-28 05:55:43,326][106226] Updated weights for policy 0, policy_version 1484233 (0.0009) [2023-12-28 05:55:43,380][106226] Updated weights for policy 0, policy_version 1484243 (0.0008) [2023-12-28 05:55:43,760][106225] Updated weights for policy 1, policy_version 1487806 (0.0006) [2023-12-28 05:55:43,828][106225] Updated weights for policy 1, policy_version 1487816 (0.0006) [2023-12-28 05:55:43,887][106225] Updated weights for policy 1, policy_version 1487826 (0.0006) [2023-12-28 05:55:44,193][106226] Updated weights for policy 0, policy_version 1484253 (0.0009) [2023-12-28 05:55:44,258][106226] Updated weights for policy 0, policy_version 1484263 (0.0008) [2023-12-28 05:55:44,315][106226] Updated weights for policy 0, policy_version 1484273 (0.0008) [2023-12-28 05:55:44,488][106225] Updated weights for policy 1, policy_version 1487836 (0.0006) [2023-12-28 05:55:44,546][106225] Updated weights for policy 1, policy_version 1487846 (0.0006) [2023-12-28 05:55:44,604][106225] Updated weights for policy 1, policy_version 1487856 (0.0006) [2023-12-28 05:55:45,127][106226] Updated weights for policy 0, policy_version 1484283 (0.0007) [2023-12-28 05:55:45,192][106226] Updated weights for policy 0, policy_version 1484293 (0.0007) [2023-12-28 05:55:45,252][106226] Updated weights for policy 0, policy_version 1484303 (0.0008) [2023-12-28 05:55:45,313][106225] Updated weights for policy 1, policy_version 1487866 (0.0007) [2023-12-28 05:55:45,375][106225] Updated weights for policy 1, policy_version 1487876 (0.0010) [2023-12-28 05:55:45,437][106225] Updated weights for policy 1, policy_version 1487886 (0.0010) [2023-12-28 05:55:45,493][106225] Updated weights for policy 1, policy_version 1487896 (0.0010) [2023-12-28 05:55:45,897][106226] Updated weights for policy 0, policy_version 1484313 (0.0008) [2023-12-28 05:55:45,955][106226] Updated weights for policy 0, policy_version 1484323 (0.0005) [2023-12-28 05:55:46,020][106226] Updated weights for policy 0, policy_version 1484333 (0.0005) [2023-12-28 05:55:46,083][106226] Updated weights for policy 0, policy_version 1484343 (0.0005) [2023-12-28 05:55:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 761020416. Throughput: 0: 9803.7, 1: 10085.8. Samples: 761010780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 05:55:46,175][105115] Avg episode reward: [(0, '-4.913'), (1, '-4.815')] [2023-12-28 05:55:46,202][106225] Updated weights for policy 1, policy_version 1487906 (0.0010) [2023-12-28 05:55:46,258][106225] Updated weights for policy 1, policy_version 1487916 (0.0010) [2023-12-28 05:55:46,308][106225] Updated weights for policy 1, policy_version 1487926 (0.0010) [2023-12-28 05:55:46,716][106226] Updated weights for policy 0, policy_version 1484353 (0.0010) [2023-12-28 05:55:46,778][106226] Updated weights for policy 0, policy_version 1484363 (0.0009) [2023-12-28 05:55:46,840][106226] Updated weights for policy 0, policy_version 1484373 (0.0005) [2023-12-28 05:55:46,922][106225] Updated weights for policy 1, policy_version 1487936 (0.0010) [2023-12-28 05:55:46,975][106225] Updated weights for policy 1, policy_version 1487946 (0.0010) [2023-12-28 05:55:47,034][106225] Updated weights for policy 1, policy_version 1487956 (0.0010) [2023-12-28 05:55:47,518][106226] Updated weights for policy 0, policy_version 1484383 (0.0009) [2023-12-28 05:55:47,568][106226] Updated weights for policy 0, policy_version 1484393 (0.0010) [2023-12-28 05:55:47,623][106226] Updated weights for policy 0, policy_version 1484403 (0.0010) [2023-12-28 05:55:47,702][106225] Updated weights for policy 1, policy_version 1487966 (0.0009) [2023-12-28 05:55:47,763][106225] Updated weights for policy 1, policy_version 1487976 (0.0009) [2023-12-28 05:55:47,815][106225] Updated weights for policy 1, policy_version 1487986 (0.0008) [2023-12-28 05:55:48,327][106226] Updated weights for policy 0, policy_version 1484413 (0.0009) [2023-12-28 05:55:48,392][106226] Updated weights for policy 0, policy_version 1484423 (0.0008) [2023-12-28 05:55:48,454][106226] Updated weights for policy 0, policy_version 1484433 (0.0008) [2023-12-28 05:55:48,594][106225] Updated weights for policy 1, policy_version 1487996 (0.0008) [2023-12-28 05:55:48,646][106225] Updated weights for policy 1, policy_version 1488006 (0.0009) [2023-12-28 05:55:48,694][106225] Updated weights for policy 1, policy_version 1488016 (0.0010) [2023-12-28 05:55:49,149][106226] Updated weights for policy 0, policy_version 1484443 (0.0009) [2023-12-28 05:55:49,210][106226] Updated weights for policy 0, policy_version 1484453 (0.0010) [2023-12-28 05:55:49,286][106226] Updated weights for policy 0, policy_version 1484463 (0.0007) [2023-12-28 05:55:49,393][106225] Updated weights for policy 1, policy_version 1488026 (0.0010) [2023-12-28 05:55:49,453][106225] Updated weights for policy 1, policy_version 1488036 (0.0008) [2023-12-28 05:55:49,505][106225] Updated weights for policy 1, policy_version 1488046 (0.0007) [2023-12-28 05:55:49,556][106225] Updated weights for policy 1, policy_version 1488056 (0.0010) [2023-12-28 05:55:50,073][106226] Updated weights for policy 0, policy_version 1484473 (0.0008) [2023-12-28 05:55:50,139][106226] Updated weights for policy 0, policy_version 1484483 (0.0005) [2023-12-28 05:55:50,206][106226] Updated weights for policy 0, policy_version 1484493 (0.0005) [2023-12-28 05:55:50,276][106226] Updated weights for policy 0, policy_version 1484503 (0.0007) [2023-12-28 05:55:50,288][106225] Updated weights for policy 1, policy_version 1488066 (0.0007) [2023-12-28 05:55:50,358][106225] Updated weights for policy 1, policy_version 1488076 (0.0006) [2023-12-28 05:55:50,418][106225] Updated weights for policy 1, policy_version 1488086 (0.0007) [2023-12-28 05:55:50,875][106226] Updated weights for policy 0, policy_version 1484513 (0.0008) [2023-12-28 05:55:50,937][106226] Updated weights for policy 0, policy_version 1484523 (0.0009) [2023-12-28 05:55:50,998][106226] Updated weights for policy 0, policy_version 1484533 (0.0008) [2023-12-28 05:55:51,116][106225] Updated weights for policy 1, policy_version 1488096 (0.0010) [2023-12-28 05:55:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 761118720. Throughput: 0: 9861.5, 1: 10059.1. Samples: 761129432. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:55:51,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.493')] [2023-12-28 05:55:51,184][106225] Updated weights for policy 1, policy_version 1488106 (0.0009) [2023-12-28 05:55:51,242][106225] Updated weights for policy 1, policy_version 1488116 (0.0006) [2023-12-28 05:55:51,762][106226] Updated weights for policy 0, policy_version 1484543 (0.0011) [2023-12-28 05:55:51,830][106226] Updated weights for policy 0, policy_version 1484553 (0.0011) [2023-12-28 05:55:51,897][106226] Updated weights for policy 0, policy_version 1484563 (0.0011) [2023-12-28 05:55:51,930][106225] Updated weights for policy 1, policy_version 1488126 (0.0007) [2023-12-28 05:55:51,985][106225] Updated weights for policy 1, policy_version 1488136 (0.0005) [2023-12-28 05:55:52,039][106225] Updated weights for policy 1, policy_version 1488146 (0.0005) [2023-12-28 05:55:52,597][106226] Updated weights for policy 0, policy_version 1484573 (0.0011) [2023-12-28 05:55:52,665][106226] Updated weights for policy 0, policy_version 1484583 (0.0011) [2023-12-28 05:55:52,683][106225] Updated weights for policy 1, policy_version 1488156 (0.0005) [2023-12-28 05:55:52,732][106226] Updated weights for policy 0, policy_version 1484593 (0.0011) [2023-12-28 05:55:52,745][106225] Updated weights for policy 1, policy_version 1488166 (0.0006) [2023-12-28 05:55:52,811][106225] Updated weights for policy 1, policy_version 1488176 (0.0006) [2023-12-28 05:55:53,344][106226] Updated weights for policy 0, policy_version 1484603 (0.0011) [2023-12-28 05:55:53,378][106225] Updated weights for policy 1, policy_version 1488186 (0.0007) [2023-12-28 05:55:53,406][106226] Updated weights for policy 0, policy_version 1484613 (0.0011) [2023-12-28 05:55:53,433][106225] Updated weights for policy 1, policy_version 1488196 (0.0006) [2023-12-28 05:55:53,470][106226] Updated weights for policy 0, policy_version 1484623 (0.0011) [2023-12-28 05:55:53,486][106225] Updated weights for policy 1, policy_version 1488206 (0.0007) [2023-12-28 05:55:53,543][106225] Updated weights for policy 1, policy_version 1488216 (0.0005) [2023-12-28 05:55:54,075][106226] Updated weights for policy 0, policy_version 1484633 (0.0010) [2023-12-28 05:55:54,140][106226] Updated weights for policy 0, policy_version 1484643 (0.0005) [2023-12-28 05:55:54,155][106225] Updated weights for policy 1, policy_version 1488226 (0.0006) [2023-12-28 05:55:54,212][106226] Updated weights for policy 0, policy_version 1484653 (0.0006) [2023-12-28 05:55:54,219][106225] Updated weights for policy 1, policy_version 1488236 (0.0006) [2023-12-28 05:55:54,269][106226] Updated weights for policy 0, policy_version 1484663 (0.0005) [2023-12-28 05:55:54,276][106225] Updated weights for policy 1, policy_version 1488246 (0.0009) [2023-12-28 05:55:54,856][106226] Updated weights for policy 0, policy_version 1484673 (0.0010) [2023-12-28 05:55:54,915][106226] Updated weights for policy 0, policy_version 1484683 (0.0009) [2023-12-28 05:55:54,957][106225] Updated weights for policy 1, policy_version 1488256 (0.0008) [2023-12-28 05:55:54,978][106226] Updated weights for policy 0, policy_version 1484693 (0.0007) [2023-12-28 05:55:55,014][106225] Updated weights for policy 1, policy_version 1488266 (0.0007) [2023-12-28 05:55:55,066][106225] Updated weights for policy 1, policy_version 1488276 (0.0006) [2023-12-28 05:55:55,689][106226] Updated weights for policy 0, policy_version 1484703 (0.0009) [2023-12-28 05:55:55,706][106225] Updated weights for policy 1, policy_version 1488286 (0.0006) [2023-12-28 05:55:55,744][106226] Updated weights for policy 0, policy_version 1484713 (0.0011) [2023-12-28 05:55:55,766][106225] Updated weights for policy 1, policy_version 1488296 (0.0006) [2023-12-28 05:55:55,807][106226] Updated weights for policy 0, policy_version 1484723 (0.0006) [2023-12-28 05:55:55,823][106225] Updated weights for policy 1, policy_version 1488306 (0.0008) [2023-12-28 05:55:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 761225216. Throughput: 0: 9919.7, 1: 10048.0. Samples: 761191688. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:55:56,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.670')] [2023-12-28 05:55:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001488312_381059072.pth... [2023-12-28 05:55:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001484728_380166144.pth... [2023-12-28 05:55:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001487128_380755968.pth [2023-12-28 05:55:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001483576_379871232.pth [2023-12-28 05:55:56,395][106226] Updated weights for policy 0, policy_version 1484733 (0.0008) [2023-12-28 05:55:56,451][106226] Updated weights for policy 0, policy_version 1484743 (0.0010) [2023-12-28 05:55:56,502][106226] Updated weights for policy 0, policy_version 1484753 (0.0008) [2023-12-28 05:55:56,610][106225] Updated weights for policy 1, policy_version 1488316 (0.0009) [2023-12-28 05:55:56,662][106225] Updated weights for policy 1, policy_version 1488326 (0.0007) [2023-12-28 05:55:56,711][106225] Updated weights for policy 1, policy_version 1488336 (0.0007) [2023-12-28 05:55:57,156][106226] Updated weights for policy 0, policy_version 1484763 (0.0009) [2023-12-28 05:55:57,215][106226] Updated weights for policy 0, policy_version 1484773 (0.0010) [2023-12-28 05:55:57,274][106226] Updated weights for policy 0, policy_version 1484783 (0.0010) [2023-12-28 05:55:57,371][106225] Updated weights for policy 1, policy_version 1488346 (0.0008) [2023-12-28 05:55:57,427][106225] Updated weights for policy 1, policy_version 1488356 (0.0006) [2023-12-28 05:55:57,489][106225] Updated weights for policy 1, policy_version 1488366 (0.0005) [2023-12-28 05:55:57,547][106225] Updated weights for policy 1, policy_version 1488376 (0.0005) [2023-12-28 05:55:57,974][106226] Updated weights for policy 0, policy_version 1484793 (0.0011) [2023-12-28 05:55:58,029][106226] Updated weights for policy 0, policy_version 1484803 (0.0007) [2023-12-28 05:55:58,069][106225] Updated weights for policy 1, policy_version 1488386 (0.0008) [2023-12-28 05:55:58,086][106226] Updated weights for policy 0, policy_version 1484813 (0.0005) [2023-12-28 05:55:58,126][106225] Updated weights for policy 1, policy_version 1488396 (0.0008) [2023-12-28 05:55:58,136][106226] Updated weights for policy 0, policy_version 1484823 (0.0005) [2023-12-28 05:55:58,179][106225] Updated weights for policy 1, policy_version 1488406 (0.0009) [2023-12-28 05:55:58,930][106226] Updated weights for policy 0, policy_version 1484833 (0.0007) [2023-12-28 05:55:58,989][106226] Updated weights for policy 0, policy_version 1484843 (0.0006) [2023-12-28 05:55:59,055][106226] Updated weights for policy 0, policy_version 1484853 (0.0008) [2023-12-28 05:55:59,084][106225] Updated weights for policy 1, policy_version 1488416 (0.0010) [2023-12-28 05:55:59,145][106225] Updated weights for policy 1, policy_version 1488426 (0.0010) [2023-12-28 05:55:59,204][106225] Updated weights for policy 1, policy_version 1488436 (0.0009) [2023-12-28 05:55:59,819][106226] Updated weights for policy 0, policy_version 1484863 (0.0008) [2023-12-28 05:55:59,887][106226] Updated weights for policy 0, policy_version 1484873 (0.0008) [2023-12-28 05:55:59,920][106225] Updated weights for policy 1, policy_version 1488446 (0.0008) [2023-12-28 05:55:59,952][106226] Updated weights for policy 0, policy_version 1484883 (0.0008) [2023-12-28 05:55:59,986][106225] Updated weights for policy 1, policy_version 1488456 (0.0007) [2023-12-28 05:56:00,051][106225] Updated weights for policy 1, policy_version 1488466 (0.0006) [2023-12-28 05:56:00,690][106225] Updated weights for policy 1, policy_version 1488476 (0.0007) [2023-12-28 05:56:00,708][106226] Updated weights for policy 0, policy_version 1484893 (0.0007) [2023-12-28 05:56:00,746][106225] Updated weights for policy 1, policy_version 1488486 (0.0007) [2023-12-28 05:56:00,752][106226] Updated weights for policy 0, policy_version 1484903 (0.0008) [2023-12-28 05:56:00,800][106226] Updated weights for policy 0, policy_version 1484913 (0.0006) [2023-12-28 05:56:00,809][106225] Updated weights for policy 1, policy_version 1488496 (0.0007) [2023-12-28 05:56:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 761323520. Throughput: 0: 10009.4, 1: 10017.8. Samples: 761311304. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:01,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.575')] [2023-12-28 05:56:01,526][106225] Updated weights for policy 1, policy_version 1488506 (0.0008) [2023-12-28 05:56:01,576][106225] Updated weights for policy 1, policy_version 1488516 (0.0010) [2023-12-28 05:56:01,585][106226] Updated weights for policy 0, policy_version 1484923 (0.0005) [2023-12-28 05:56:01,634][106225] Updated weights for policy 1, policy_version 1488526 (0.0010) [2023-12-28 05:56:01,664][106226] Updated weights for policy 0, policy_version 1484933 (0.0008) [2023-12-28 05:56:01,695][106225] Updated weights for policy 1, policy_version 1488536 (0.0010) [2023-12-28 05:56:01,729][106226] Updated weights for policy 0, policy_version 1484943 (0.0007) [2023-12-28 05:56:02,373][106225] Updated weights for policy 1, policy_version 1488546 (0.0010) [2023-12-28 05:56:02,431][106225] Updated weights for policy 1, policy_version 1488556 (0.0010) [2023-12-28 05:56:02,488][106225] Updated weights for policy 1, policy_version 1488566 (0.0010) [2023-12-28 05:56:02,497][106226] Updated weights for policy 0, policy_version 1484953 (0.0007) [2023-12-28 05:56:02,546][106226] Updated weights for policy 0, policy_version 1484963 (0.0007) [2023-12-28 05:56:02,597][106226] Updated weights for policy 0, policy_version 1484973 (0.0006) [2023-12-28 05:56:02,657][106226] Updated weights for policy 0, policy_version 1484983 (0.0006) [2023-12-28 05:56:03,195][106225] Updated weights for policy 1, policy_version 1488576 (0.0010) [2023-12-28 05:56:03,248][106225] Updated weights for policy 1, policy_version 1488586 (0.0010) [2023-12-28 05:56:03,296][106225] Updated weights for policy 1, policy_version 1488596 (0.0010) [2023-12-28 05:56:03,321][106226] Updated weights for policy 0, policy_version 1484993 (0.0005) [2023-12-28 05:56:03,379][106226] Updated weights for policy 0, policy_version 1485003 (0.0008) [2023-12-28 05:56:03,436][106226] Updated weights for policy 0, policy_version 1485013 (0.0008) [2023-12-28 05:56:04,025][106225] Updated weights for policy 1, policy_version 1488606 (0.0009) [2023-12-28 05:56:04,091][106225] Updated weights for policy 1, policy_version 1488616 (0.0008) [2023-12-28 05:56:04,144][106226] Updated weights for policy 0, policy_version 1485023 (0.0006) [2023-12-28 05:56:04,154][106225] Updated weights for policy 1, policy_version 1488626 (0.0008) [2023-12-28 05:56:04,204][106226] Updated weights for policy 0, policy_version 1485033 (0.0008) [2023-12-28 05:56:04,256][106226] Updated weights for policy 0, policy_version 1485043 (0.0008) [2023-12-28 05:56:04,835][106225] Updated weights for policy 1, policy_version 1488636 (0.0008) [2023-12-28 05:56:04,895][106225] Updated weights for policy 1, policy_version 1488646 (0.0007) [2023-12-28 05:56:04,953][106225] Updated weights for policy 1, policy_version 1488656 (0.0008) [2023-12-28 05:56:05,022][106226] Updated weights for policy 0, policy_version 1485053 (0.0009) [2023-12-28 05:56:05,078][106226] Updated weights for policy 0, policy_version 1485063 (0.0010) [2023-12-28 05:56:05,125][106226] Updated weights for policy 0, policy_version 1485073 (0.0011) [2023-12-28 05:56:05,672][106225] Updated weights for policy 1, policy_version 1488666 (0.0007) [2023-12-28 05:56:05,719][106225] Updated weights for policy 1, policy_version 1488676 (0.0008) [2023-12-28 05:56:05,773][106225] Updated weights for policy 1, policy_version 1488686 (0.0008) [2023-12-28 05:56:05,836][106225] Updated weights for policy 1, policy_version 1488696 (0.0007) [2023-12-28 05:56:05,849][106226] Updated weights for policy 0, policy_version 1485083 (0.0010) [2023-12-28 05:56:05,902][106226] Updated weights for policy 0, policy_version 1485093 (0.0010) [2023-12-28 05:56:05,951][106226] Updated weights for policy 0, policy_version 1485103 (0.0010) [2023-12-28 05:56:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 761421824. Throughput: 0: 9884.8, 1: 10007.6. Samples: 761428168. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:06,175][105115] Avg episode reward: [(0, '-4.903'), (1, '-4.620')] [2023-12-28 05:56:06,589][106225] Updated weights for policy 1, policy_version 1488706 (0.0008) [2023-12-28 05:56:06,653][106225] Updated weights for policy 1, policy_version 1488716 (0.0008) [2023-12-28 05:56:06,687][106226] Updated weights for policy 0, policy_version 1485113 (0.0010) [2023-12-28 05:56:06,714][106225] Updated weights for policy 1, policy_version 1488726 (0.0008) [2023-12-28 05:56:06,755][106226] Updated weights for policy 0, policy_version 1485123 (0.0011) [2023-12-28 05:56:06,812][106226] Updated weights for policy 0, policy_version 1485133 (0.0011) [2023-12-28 05:56:06,872][106226] Updated weights for policy 0, policy_version 1485143 (0.0011) [2023-12-28 05:56:07,369][106225] Updated weights for policy 1, policy_version 1488736 (0.0007) [2023-12-28 05:56:07,422][106225] Updated weights for policy 1, policy_version 1488746 (0.0005) [2023-12-28 05:56:07,473][106225] Updated weights for policy 1, policy_version 1488756 (0.0005) [2023-12-28 05:56:07,546][106226] Updated weights for policy 0, policy_version 1485153 (0.0010) [2023-12-28 05:56:07,595][106226] Updated weights for policy 0, policy_version 1485163 (0.0009) [2023-12-28 05:56:07,645][106226] Updated weights for policy 0, policy_version 1485173 (0.0009) [2023-12-28 05:56:08,113][106225] Updated weights for policy 1, policy_version 1488766 (0.0007) [2023-12-28 05:56:08,164][106225] Updated weights for policy 1, policy_version 1488776 (0.0008) [2023-12-28 05:56:08,218][106225] Updated weights for policy 1, policy_version 1488786 (0.0008) [2023-12-28 05:56:08,390][106226] Updated weights for policy 0, policy_version 1485183 (0.0008) [2023-12-28 05:56:08,451][106226] Updated weights for policy 0, policy_version 1485193 (0.0010) [2023-12-28 05:56:08,520][106226] Updated weights for policy 0, policy_version 1485203 (0.0006) [2023-12-28 05:56:09,019][106225] Updated weights for policy 1, policy_version 1488796 (0.0008) [2023-12-28 05:56:09,081][106226] Updated weights for policy 0, policy_version 1485213 (0.0005) [2023-12-28 05:56:09,086][106225] Updated weights for policy 1, policy_version 1488806 (0.0008) [2023-12-28 05:56:09,143][106226] Updated weights for policy 0, policy_version 1485223 (0.0006) [2023-12-28 05:56:09,147][106225] Updated weights for policy 1, policy_version 1488816 (0.0008) [2023-12-28 05:56:09,201][106226] Updated weights for policy 0, policy_version 1485233 (0.0007) [2023-12-28 05:56:09,898][106225] Updated weights for policy 1, policy_version 1488826 (0.0007) [2023-12-28 05:56:09,959][106226] Updated weights for policy 0, policy_version 1485243 (0.0007) [2023-12-28 05:56:09,965][106225] Updated weights for policy 1, policy_version 1488836 (0.0008) [2023-12-28 05:56:10,019][106226] Updated weights for policy 0, policy_version 1485253 (0.0007) [2023-12-28 05:56:10,026][106225] Updated weights for policy 1, policy_version 1488846 (0.0009) [2023-12-28 05:56:10,075][106225] Updated weights for policy 1, policy_version 1488856 (0.0006) [2023-12-28 05:56:10,084][106226] Updated weights for policy 0, policy_version 1485263 (0.0007) [2023-12-28 05:56:10,759][106226] Updated weights for policy 0, policy_version 1485273 (0.0008) [2023-12-28 05:56:10,822][106226] Updated weights for policy 0, policy_version 1485283 (0.0006) [2023-12-28 05:56:10,827][106225] Updated weights for policy 1, policy_version 1488866 (0.0008) [2023-12-28 05:56:10,877][106226] Updated weights for policy 0, policy_version 1485293 (0.0006) [2023-12-28 05:56:10,885][106225] Updated weights for policy 1, policy_version 1488876 (0.0006) [2023-12-28 05:56:10,934][106226] Updated weights for policy 0, policy_version 1485303 (0.0005) [2023-12-28 05:56:10,951][106225] Updated weights for policy 1, policy_version 1488886 (0.0008) [2023-12-28 05:56:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 761520128. Throughput: 0: 9902.0, 1: 10048.6. Samples: 761488460. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:11,175][105115] Avg episode reward: [(0, '-4.917'), (1, '-4.797')] [2023-12-28 05:56:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001488888_381206528.pth... [2023-12-28 05:56:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001485304_380313600.pth... [2023-12-28 05:56:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001484152_380018688.pth [2023-12-28 05:56:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001487704_380903424.pth [2023-12-28 05:56:11,576][106226] Updated weights for policy 0, policy_version 1485313 (0.0006) [2023-12-28 05:56:11,648][106226] Updated weights for policy 0, policy_version 1485323 (0.0007) [2023-12-28 05:56:11,716][106226] Updated weights for policy 0, policy_version 1485333 (0.0008) [2023-12-28 05:56:11,745][106225] Updated weights for policy 1, policy_version 1488896 (0.0008) [2023-12-28 05:56:11,800][106225] Updated weights for policy 1, policy_version 1488906 (0.0008) [2023-12-28 05:56:11,862][106225] Updated weights for policy 1, policy_version 1488916 (0.0008) [2023-12-28 05:56:12,468][106226] Updated weights for policy 0, policy_version 1485343 (0.0008) [2023-12-28 05:56:12,527][106226] Updated weights for policy 0, policy_version 1485353 (0.0008) [2023-12-28 05:56:12,581][106226] Updated weights for policy 0, policy_version 1485363 (0.0008) [2023-12-28 05:56:12,620][106225] Updated weights for policy 1, policy_version 1488926 (0.0007) [2023-12-28 05:56:12,678][106225] Updated weights for policy 1, policy_version 1488936 (0.0008) [2023-12-28 05:56:12,727][106225] Updated weights for policy 1, policy_version 1488946 (0.0008) [2023-12-28 05:56:13,181][106226] Updated weights for policy 0, policy_version 1485373 (0.0006) [2023-12-28 05:56:13,232][106226] Updated weights for policy 0, policy_version 1485383 (0.0009) [2023-12-28 05:56:13,283][106226] Updated weights for policy 0, policy_version 1485393 (0.0010) [2023-12-28 05:56:13,556][106225] Updated weights for policy 1, policy_version 1488956 (0.0008) [2023-12-28 05:56:13,612][106225] Updated weights for policy 1, policy_version 1488966 (0.0007) [2023-12-28 05:56:13,670][106225] Updated weights for policy 1, policy_version 1488976 (0.0008) [2023-12-28 05:56:13,905][106226] Updated weights for policy 0, policy_version 1485403 (0.0009) [2023-12-28 05:56:13,969][106226] Updated weights for policy 0, policy_version 1485413 (0.0007) [2023-12-28 05:56:14,022][106226] Updated weights for policy 0, policy_version 1485423 (0.0010) [2023-12-28 05:56:14,426][106225] Updated weights for policy 1, policy_version 1488986 (0.0008) [2023-12-28 05:56:14,488][106225] Updated weights for policy 1, policy_version 1488996 (0.0007) [2023-12-28 05:56:14,552][106225] Updated weights for policy 1, policy_version 1489006 (0.0007) [2023-12-28 05:56:14,610][106225] Updated weights for policy 1, policy_version 1489016 (0.0008) [2023-12-28 05:56:14,716][106226] Updated weights for policy 0, policy_version 1485433 (0.0011) [2023-12-28 05:56:14,783][106226] Updated weights for policy 0, policy_version 1485443 (0.0009) [2023-12-28 05:56:14,843][106226] Updated weights for policy 0, policy_version 1485453 (0.0010) [2023-12-28 05:56:14,898][106226] Updated weights for policy 0, policy_version 1485463 (0.0008) [2023-12-28 05:56:15,354][106225] Updated weights for policy 1, policy_version 1489026 (0.0008) [2023-12-28 05:56:15,418][106225] Updated weights for policy 1, policy_version 1489036 (0.0009) [2023-12-28 05:56:15,475][106225] Updated weights for policy 1, policy_version 1489046 (0.0007) [2023-12-28 05:56:15,603][106226] Updated weights for policy 0, policy_version 1485473 (0.0009) [2023-12-28 05:56:15,656][106226] Updated weights for policy 0, policy_version 1485483 (0.0008) [2023-12-28 05:56:15,721][106226] Updated weights for policy 0, policy_version 1485493 (0.0005) [2023-12-28 05:56:16,109][106225] Updated weights for policy 1, policy_version 1489056 (0.0008) [2023-12-28 05:56:16,163][106225] Updated weights for policy 1, policy_version 1489066 (0.0006) [2023-12-28 05:56:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 761610240. Throughput: 0: 9879.4, 1: 9811.5. Samples: 761602828. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:16,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-4.699')] [2023-12-28 05:56:16,225][106225] Updated weights for policy 1, policy_version 1489076 (0.0007) [2023-12-28 05:56:16,310][106226] Updated weights for policy 0, policy_version 1485503 (0.0005) [2023-12-28 05:56:16,371][106226] Updated weights for policy 0, policy_version 1485513 (0.0005) [2023-12-28 05:56:16,425][106226] Updated weights for policy 0, policy_version 1485523 (0.0007) [2023-12-28 05:56:16,994][106226] Updated weights for policy 0, policy_version 1485533 (0.0008) [2023-12-28 05:56:16,997][106225] Updated weights for policy 1, policy_version 1489086 (0.0009) [2023-12-28 05:56:17,051][106225] Updated weights for policy 1, policy_version 1489096 (0.0008) [2023-12-28 05:56:17,053][106226] Updated weights for policy 0, policy_version 1485543 (0.0005) [2023-12-28 05:56:17,097][106225] Updated weights for policy 1, policy_version 1489106 (0.0008) [2023-12-28 05:56:17,111][106226] Updated weights for policy 0, policy_version 1485553 (0.0005) [2023-12-28 05:56:17,677][106226] Updated weights for policy 0, policy_version 1485563 (0.0007) [2023-12-28 05:56:17,730][106226] Updated weights for policy 0, policy_version 1485573 (0.0011) [2023-12-28 05:56:17,742][106225] Updated weights for policy 1, policy_version 1489116 (0.0008) [2023-12-28 05:56:17,781][106226] Updated weights for policy 0, policy_version 1485583 (0.0010) [2023-12-28 05:56:17,790][106225] Updated weights for policy 1, policy_version 1489126 (0.0007) [2023-12-28 05:56:17,840][106225] Updated weights for policy 1, policy_version 1489136 (0.0006) [2023-12-28 05:56:18,510][106226] Updated weights for policy 0, policy_version 1485593 (0.0010) [2023-12-28 05:56:18,568][106226] Updated weights for policy 0, policy_version 1485603 (0.0011) [2023-12-28 05:56:18,600][106225] Updated weights for policy 1, policy_version 1489146 (0.0008) [2023-12-28 05:56:18,625][106226] Updated weights for policy 0, policy_version 1485613 (0.0010) [2023-12-28 05:56:18,659][106225] Updated weights for policy 1, policy_version 1489156 (0.0005) [2023-12-28 05:56:18,673][106226] Updated weights for policy 0, policy_version 1485623 (0.0010) [2023-12-28 05:56:18,708][106225] Updated weights for policy 1, policy_version 1489166 (0.0006) [2023-12-28 05:56:18,759][106225] Updated weights for policy 1, policy_version 1489176 (0.0008) [2023-12-28 05:56:19,383][106226] Updated weights for policy 0, policy_version 1485633 (0.0009) [2023-12-28 05:56:19,453][106226] Updated weights for policy 0, policy_version 1485643 (0.0007) [2023-12-28 05:56:19,520][106226] Updated weights for policy 0, policy_version 1485653 (0.0008) [2023-12-28 05:56:19,588][106225] Updated weights for policy 1, policy_version 1489186 (0.0008) [2023-12-28 05:56:19,637][106225] Updated weights for policy 1, policy_version 1489196 (0.0008) [2023-12-28 05:56:19,685][106225] Updated weights for policy 1, policy_version 1489206 (0.0008) [2023-12-28 05:56:20,254][106226] Updated weights for policy 0, policy_version 1485663 (0.0008) [2023-12-28 05:56:20,313][106226] Updated weights for policy 0, policy_version 1485673 (0.0009) [2023-12-28 05:56:20,376][106226] Updated weights for policy 0, policy_version 1485683 (0.0008) [2023-12-28 05:56:20,401][106225] Updated weights for policy 1, policy_version 1489216 (0.0008) [2023-12-28 05:56:20,465][106225] Updated weights for policy 1, policy_version 1489226 (0.0009) [2023-12-28 05:56:20,539][106225] Updated weights for policy 1, policy_version 1489236 (0.0009) [2023-12-28 05:56:21,162][106226] Updated weights for policy 0, policy_version 1485693 (0.0007) [2023-12-28 05:56:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 761708544. Throughput: 0: 9943.4, 1: 9823.8. Samples: 761723336. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:21,175][105115] Avg episode reward: [(0, '-4.909'), (1, '-4.833')] [2023-12-28 05:56:21,218][106225] Updated weights for policy 1, policy_version 1489246 (0.0008) [2023-12-28 05:56:21,232][106226] Updated weights for policy 0, policy_version 1485703 (0.0006) [2023-12-28 05:56:21,289][106225] Updated weights for policy 1, policy_version 1489256 (0.0007) [2023-12-28 05:56:21,308][106226] Updated weights for policy 0, policy_version 1485713 (0.0007) [2023-12-28 05:56:21,357][106225] Updated weights for policy 1, policy_version 1489266 (0.0008) [2023-12-28 05:56:22,015][106226] Updated weights for policy 0, policy_version 1485723 (0.0007) [2023-12-28 05:56:22,068][106225] Updated weights for policy 1, policy_version 1489276 (0.0008) [2023-12-28 05:56:22,074][106226] Updated weights for policy 0, policy_version 1485733 (0.0007) [2023-12-28 05:56:22,129][106225] Updated weights for policy 1, policy_version 1489286 (0.0008) [2023-12-28 05:56:22,140][106226] Updated weights for policy 0, policy_version 1485743 (0.0006) [2023-12-28 05:56:22,190][106225] Updated weights for policy 1, policy_version 1489296 (0.0009) [2023-12-28 05:56:22,895][106225] Updated weights for policy 1, policy_version 1489306 (0.0008) [2023-12-28 05:56:22,925][106226] Updated weights for policy 0, policy_version 1485753 (0.0007) [2023-12-28 05:56:22,946][106225] Updated weights for policy 1, policy_version 1489316 (0.0006) [2023-12-28 05:56:22,972][106226] Updated weights for policy 0, policy_version 1485763 (0.0010) [2023-12-28 05:56:22,997][106225] Updated weights for policy 1, policy_version 1489326 (0.0005) [2023-12-28 05:56:23,030][106226] Updated weights for policy 0, policy_version 1485773 (0.0011) [2023-12-28 05:56:23,052][106225] Updated weights for policy 1, policy_version 1489336 (0.0005) [2023-12-28 05:56:23,084][106226] Updated weights for policy 0, policy_version 1485783 (0.0010) [2023-12-28 05:56:23,714][106226] Updated weights for policy 0, policy_version 1485793 (0.0010) [2023-12-28 05:56:23,745][106225] Updated weights for policy 1, policy_version 1489346 (0.0005) [2023-12-28 05:56:23,759][106226] Updated weights for policy 0, policy_version 1485803 (0.0008) [2023-12-28 05:56:23,805][106226] Updated weights for policy 0, policy_version 1485813 (0.0008) [2023-12-28 05:56:23,806][106225] Updated weights for policy 1, policy_version 1489356 (0.0005) [2023-12-28 05:56:23,863][106225] Updated weights for policy 1, policy_version 1489366 (0.0006) [2023-12-28 05:56:24,545][106225] Updated weights for policy 1, policy_version 1489376 (0.0007) [2023-12-28 05:56:24,563][106226] Updated weights for policy 0, policy_version 1485823 (0.0009) [2023-12-28 05:56:24,597][106225] Updated weights for policy 1, policy_version 1489386 (0.0006) [2023-12-28 05:56:24,621][106226] Updated weights for policy 0, policy_version 1485833 (0.0007) [2023-12-28 05:56:24,649][106225] Updated weights for policy 1, policy_version 1489396 (0.0006) [2023-12-28 05:56:24,676][106226] Updated weights for policy 0, policy_version 1485843 (0.0008) [2023-12-28 05:56:25,194][106225] Updated weights for policy 1, policy_version 1489406 (0.0008) [2023-12-28 05:56:25,249][106225] Updated weights for policy 1, policy_version 1489416 (0.0008) [2023-12-28 05:56:25,310][106225] Updated weights for policy 1, policy_version 1489426 (0.0008) [2023-12-28 05:56:25,485][106226] Updated weights for policy 0, policy_version 1485853 (0.0009) [2023-12-28 05:56:25,539][106226] Updated weights for policy 0, policy_version 1485863 (0.0008) [2023-12-28 05:56:25,595][106226] Updated weights for policy 0, policy_version 1485873 (0.0008) [2023-12-28 05:56:25,987][106225] Updated weights for policy 1, policy_version 1489436 (0.0008) [2023-12-28 05:56:26,038][106225] Updated weights for policy 1, policy_version 1489446 (0.0008) [2023-12-28 05:56:26,086][106225] Updated weights for policy 1, policy_version 1489456 (0.0007) [2023-12-28 05:56:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 761815040. Throughput: 0: 9885.4, 1: 9820.7. Samples: 761781408. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:26,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.494')] [2023-12-28 05:56:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001485880_380461056.pth... [2023-12-28 05:56:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001489464_381353984.pth... [2023-12-28 05:56:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001484728_380166144.pth [2023-12-28 05:56:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001488312_381059072.pth [2023-12-28 05:56:26,362][106226] Updated weights for policy 0, policy_version 1485883 (0.0009) [2023-12-28 05:56:26,426][106226] Updated weights for policy 0, policy_version 1485893 (0.0008) [2023-12-28 05:56:26,484][106226] Updated weights for policy 0, policy_version 1485903 (0.0009) [2023-12-28 05:56:26,709][106225] Updated weights for policy 1, policy_version 1489466 (0.0006) [2023-12-28 05:56:26,762][106225] Updated weights for policy 1, policy_version 1489476 (0.0009) [2023-12-28 05:56:26,814][106225] Updated weights for policy 1, policy_version 1489486 (0.0008) [2023-12-28 05:56:26,862][106225] Updated weights for policy 1, policy_version 1489496 (0.0008) [2023-12-28 05:56:27,198][106226] Updated weights for policy 0, policy_version 1485913 (0.0008) [2023-12-28 05:56:27,256][106226] Updated weights for policy 0, policy_version 1485923 (0.0009) [2023-12-28 05:56:27,312][106226] Updated weights for policy 0, policy_version 1485933 (0.0008) [2023-12-28 05:56:27,370][106226] Updated weights for policy 0, policy_version 1485943 (0.0009) [2023-12-28 05:56:27,495][106225] Updated weights for policy 1, policy_version 1489506 (0.0008) [2023-12-28 05:56:27,545][106225] Updated weights for policy 1, policy_version 1489517 (0.0010) [2023-12-28 05:56:27,590][106225] Updated weights for policy 1, policy_version 1489527 (0.0010) [2023-12-28 05:56:28,115][106226] Updated weights for policy 0, policy_version 1485953 (0.0008) [2023-12-28 05:56:28,167][106226] Updated weights for policy 0, policy_version 1485963 (0.0007) [2023-12-28 05:56:28,216][106226] Updated weights for policy 0, policy_version 1485973 (0.0008) [2023-12-28 05:56:28,343][106225] Updated weights for policy 1, policy_version 1489537 (0.0007) [2023-12-28 05:56:28,401][106225] Updated weights for policy 1, policy_version 1489547 (0.0008) [2023-12-28 05:56:28,449][106225] Updated weights for policy 1, policy_version 1489557 (0.0008) [2023-12-28 05:56:28,995][106226] Updated weights for policy 0, policy_version 1485983 (0.0007) [2023-12-28 05:56:29,051][106226] Updated weights for policy 0, policy_version 1485993 (0.0007) [2023-12-28 05:56:29,068][106225] Updated weights for policy 1, policy_version 1489567 (0.0006) [2023-12-28 05:56:29,104][106226] Updated weights for policy 0, policy_version 1486003 (0.0007) [2023-12-28 05:56:29,114][106225] Updated weights for policy 1, policy_version 1489577 (0.0009) [2023-12-28 05:56:29,160][106225] Updated weights for policy 1, policy_version 1489587 (0.0010) [2023-12-28 05:56:29,861][106226] Updated weights for policy 0, policy_version 1486013 (0.0006) [2023-12-28 05:56:29,879][106225] Updated weights for policy 1, policy_version 1489597 (0.0009) [2023-12-28 05:56:29,923][106226] Updated weights for policy 0, policy_version 1486023 (0.0008) [2023-12-28 05:56:29,938][106225] Updated weights for policy 1, policy_version 1489607 (0.0008) [2023-12-28 05:56:30,003][106226] Updated weights for policy 0, policy_version 1486033 (0.0008) [2023-12-28 05:56:30,006][106225] Updated weights for policy 1, policy_version 1489617 (0.0006) [2023-12-28 05:56:30,726][106226] Updated weights for policy 0, policy_version 1486043 (0.0007) [2023-12-28 05:56:30,763][106225] Updated weights for policy 1, policy_version 1489627 (0.0008) [2023-12-28 05:56:30,774][106226] Updated weights for policy 0, policy_version 1486053 (0.0008) [2023-12-28 05:56:30,812][106225] Updated weights for policy 1, policy_version 1489637 (0.0006) [2023-12-28 05:56:30,826][106226] Updated weights for policy 0, policy_version 1486063 (0.0006) [2023-12-28 05:56:30,861][106225] Updated weights for policy 1, policy_version 1489647 (0.0005) [2023-12-28 05:56:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 761913344. Throughput: 0: 9885.4, 1: 9895.1. Samples: 761900904. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:31,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.794')] [2023-12-28 05:56:31,534][106226] Updated weights for policy 0, policy_version 1486073 (0.0008) [2023-12-28 05:56:31,590][106226] Updated weights for policy 0, policy_version 1486083 (0.0009) [2023-12-28 05:56:31,617][106225] Updated weights for policy 1, policy_version 1489657 (0.0005) [2023-12-28 05:56:31,659][106226] Updated weights for policy 0, policy_version 1486093 (0.0008) [2023-12-28 05:56:31,677][106225] Updated weights for policy 1, policy_version 1489667 (0.0007) [2023-12-28 05:56:31,720][106226] Updated weights for policy 0, policy_version 1486103 (0.0008) [2023-12-28 05:56:31,745][106225] Updated weights for policy 1, policy_version 1489677 (0.0009) [2023-12-28 05:56:31,811][106225] Updated weights for policy 1, policy_version 1489687 (0.0008) [2023-12-28 05:56:32,466][106226] Updated weights for policy 0, policy_version 1486113 (0.0008) [2023-12-28 05:56:32,523][106226] Updated weights for policy 0, policy_version 1486123 (0.0008) [2023-12-28 05:56:32,568][106225] Updated weights for policy 1, policy_version 1489697 (0.0010) [2023-12-28 05:56:32,578][106226] Updated weights for policy 0, policy_version 1486133 (0.0005) [2023-12-28 05:56:32,625][106225] Updated weights for policy 1, policy_version 1489707 (0.0010) [2023-12-28 05:56:32,683][106225] Updated weights for policy 1, policy_version 1489717 (0.0010) [2023-12-28 05:56:33,279][106226] Updated weights for policy 0, policy_version 1486143 (0.0007) [2023-12-28 05:56:33,331][106226] Updated weights for policy 0, policy_version 1486153 (0.0007) [2023-12-28 05:56:33,385][106226] Updated weights for policy 0, policy_version 1486163 (0.0006) [2023-12-28 05:56:33,390][106225] Updated weights for policy 1, policy_version 1489727 (0.0010) [2023-12-28 05:56:33,448][106225] Updated weights for policy 1, policy_version 1489737 (0.0009) [2023-12-28 05:56:33,502][106225] Updated weights for policy 1, policy_version 1489747 (0.0006) [2023-12-28 05:56:34,048][106225] Updated weights for policy 1, policy_version 1489757 (0.0005) [2023-12-28 05:56:34,093][106225] Updated weights for policy 1, policy_version 1489767 (0.0005) [2023-12-28 05:56:34,126][106226] Updated weights for policy 0, policy_version 1486173 (0.0006) [2023-12-28 05:56:34,156][106225] Updated weights for policy 1, policy_version 1489777 (0.0007) [2023-12-28 05:56:34,204][106226] Updated weights for policy 0, policy_version 1486183 (0.0007) [2023-12-28 05:56:34,269][106226] Updated weights for policy 0, policy_version 1486193 (0.0006) [2023-12-28 05:56:34,870][106225] Updated weights for policy 1, policy_version 1489787 (0.0007) [2023-12-28 05:56:34,929][106225] Updated weights for policy 1, policy_version 1489797 (0.0008) [2023-12-28 05:56:34,973][106226] Updated weights for policy 0, policy_version 1486203 (0.0006) [2023-12-28 05:56:34,987][106225] Updated weights for policy 1, policy_version 1489807 (0.0008) [2023-12-28 05:56:35,026][106226] Updated weights for policy 0, policy_version 1486213 (0.0007) [2023-12-28 05:56:35,076][106226] Updated weights for policy 0, policy_version 1486223 (0.0008) [2023-12-28 05:56:35,654][106225] Updated weights for policy 1, policy_version 1489817 (0.0007) [2023-12-28 05:56:35,708][106225] Updated weights for policy 1, policy_version 1489827 (0.0005) [2023-12-28 05:56:35,768][106225] Updated weights for policy 1, policy_version 1489837 (0.0006) [2023-12-28 05:56:35,825][106225] Updated weights for policy 1, policy_version 1489847 (0.0008) [2023-12-28 05:56:35,846][106226] Updated weights for policy 0, policy_version 1486233 (0.0008) [2023-12-28 05:56:35,898][106226] Updated weights for policy 0, policy_version 1486243 (0.0008) [2023-12-28 05:56:35,957][106226] Updated weights for policy 0, policy_version 1486253 (0.0008) [2023-12-28 05:56:36,008][106226] Updated weights for policy 0, policy_version 1486263 (0.0009) [2023-12-28 05:56:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 762011648. Throughput: 0: 9846.1, 1: 9905.7. Samples: 762018268. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:36,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-4.801')] [2023-12-28 05:56:36,516][106225] Updated weights for policy 1, policy_version 1489857 (0.0009) [2023-12-28 05:56:36,576][106225] Updated weights for policy 1, policy_version 1489867 (0.0008) [2023-12-28 05:56:36,641][106225] Updated weights for policy 1, policy_version 1489877 (0.0009) [2023-12-28 05:56:36,765][106226] Updated weights for policy 0, policy_version 1486273 (0.0008) [2023-12-28 05:56:36,828][106226] Updated weights for policy 0, policy_version 1486283 (0.0009) [2023-12-28 05:56:36,883][106226] Updated weights for policy 0, policy_version 1486293 (0.0009) [2023-12-28 05:56:37,324][106225] Updated weights for policy 1, policy_version 1489887 (0.0008) [2023-12-28 05:56:37,381][106225] Updated weights for policy 1, policy_version 1489897 (0.0009) [2023-12-28 05:56:37,442][106225] Updated weights for policy 1, policy_version 1489907 (0.0009) [2023-12-28 05:56:37,625][106226] Updated weights for policy 0, policy_version 1486303 (0.0009) [2023-12-28 05:56:37,672][106226] Updated weights for policy 0, policy_version 1486313 (0.0008) [2023-12-28 05:56:37,721][106226] Updated weights for policy 0, policy_version 1486323 (0.0008) [2023-12-28 05:56:38,114][106225] Updated weights for policy 1, policy_version 1489917 (0.0008) [2023-12-28 05:56:38,170][106225] Updated weights for policy 1, policy_version 1489927 (0.0009) [2023-12-28 05:56:38,223][106225] Updated weights for policy 1, policy_version 1489937 (0.0008) [2023-12-28 05:56:38,489][106226] Updated weights for policy 0, policy_version 1486333 (0.0008) [2023-12-28 05:56:38,546][106226] Updated weights for policy 0, policy_version 1486343 (0.0009) [2023-12-28 05:56:38,613][106226] Updated weights for policy 0, policy_version 1486353 (0.0009) [2023-12-28 05:56:39,019][106225] Updated weights for policy 1, policy_version 1489947 (0.0008) [2023-12-28 05:56:39,072][106225] Updated weights for policy 1, policy_version 1489957 (0.0009) [2023-12-28 05:56:39,130][106225] Updated weights for policy 1, policy_version 1489967 (0.0008) [2023-12-28 05:56:39,257][106226] Updated weights for policy 0, policy_version 1486363 (0.0009) [2023-12-28 05:56:39,319][106226] Updated weights for policy 0, policy_version 1486373 (0.0008) [2023-12-28 05:56:39,390][106226] Updated weights for policy 0, policy_version 1486383 (0.0008) [2023-12-28 05:56:39,807][106225] Updated weights for policy 1, policy_version 1489977 (0.0010) [2023-12-28 05:56:39,875][106225] Updated weights for policy 1, policy_version 1489987 (0.0007) [2023-12-28 05:56:39,945][106225] Updated weights for policy 1, policy_version 1489997 (0.0006) [2023-12-28 05:56:40,015][106225] Updated weights for policy 1, policy_version 1490007 (0.0006) [2023-12-28 05:56:40,191][106226] Updated weights for policy 0, policy_version 1486393 (0.0008) [2023-12-28 05:56:40,256][106226] Updated weights for policy 0, policy_version 1486403 (0.0009) [2023-12-28 05:56:40,312][106226] Updated weights for policy 0, policy_version 1486413 (0.0009) [2023-12-28 05:56:40,369][106226] Updated weights for policy 0, policy_version 1486423 (0.0009) [2023-12-28 05:56:40,639][106225] Updated weights for policy 1, policy_version 1490017 (0.0006) [2023-12-28 05:56:40,691][106225] Updated weights for policy 1, policy_version 1490027 (0.0007) [2023-12-28 05:56:40,744][106225] Updated weights for policy 1, policy_version 1490037 (0.0009) [2023-12-28 05:56:41,147][106226] Updated weights for policy 0, policy_version 1486433 (0.0009) [2023-12-28 05:56:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 762101760. Throughput: 0: 9795.6, 1: 9853.2. Samples: 762075888. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:41,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.804')] [2023-12-28 05:56:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001490040_381501440.pth... [2023-12-28 05:56:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001488888_381206528.pth [2023-12-28 05:56:41,210][106226] Updated weights for policy 0, policy_version 1486443 (0.0008) [2023-12-28 05:56:41,278][106226] Updated weights for policy 0, policy_version 1486453 (0.0009) [2023-12-28 05:56:41,295][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001486456_380608512.pth... [2023-12-28 05:56:41,298][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001485304_380313600.pth [2023-12-28 05:56:41,436][106225] Updated weights for policy 1, policy_version 1490047 (0.0007) [2023-12-28 05:56:41,496][106225] Updated weights for policy 1, policy_version 1490057 (0.0009) [2023-12-28 05:56:41,561][106225] Updated weights for policy 1, policy_version 1490067 (0.0009) [2023-12-28 05:56:41,971][106226] Updated weights for policy 0, policy_version 1486463 (0.0009) [2023-12-28 05:56:42,038][106226] Updated weights for policy 0, policy_version 1486473 (0.0009) [2023-12-28 05:56:42,101][106226] Updated weights for policy 0, policy_version 1486483 (0.0008) [2023-12-28 05:56:42,338][106225] Updated weights for policy 1, policy_version 1490077 (0.0009) [2023-12-28 05:56:42,407][106225] Updated weights for policy 1, policy_version 1490087 (0.0007) [2023-12-28 05:56:42,474][106225] Updated weights for policy 1, policy_version 1490097 (0.0007) [2023-12-28 05:56:42,809][106226] Updated weights for policy 0, policy_version 1486493 (0.0008) [2023-12-28 05:56:42,869][106226] Updated weights for policy 0, policy_version 1486503 (0.0009) [2023-12-28 05:56:42,927][106226] Updated weights for policy 0, policy_version 1486513 (0.0008) [2023-12-28 05:56:43,140][106225] Updated weights for policy 1, policy_version 1490107 (0.0009) [2023-12-28 05:56:43,200][106225] Updated weights for policy 1, policy_version 1490117 (0.0010) [2023-12-28 05:56:43,256][106225] Updated weights for policy 1, policy_version 1490127 (0.0010) [2023-12-28 05:56:43,587][106226] Updated weights for policy 0, policy_version 1486523 (0.0009) [2023-12-28 05:56:43,641][106226] Updated weights for policy 0, policy_version 1486533 (0.0009) [2023-12-28 05:56:43,695][106226] Updated weights for policy 0, policy_version 1486543 (0.0008) [2023-12-28 05:56:43,876][106225] Updated weights for policy 1, policy_version 1490137 (0.0010) [2023-12-28 05:56:43,925][106225] Updated weights for policy 1, policy_version 1490147 (0.0007) [2023-12-28 05:56:43,974][106225] Updated weights for policy 1, policy_version 1490157 (0.0008) [2023-12-28 05:56:44,022][106225] Updated weights for policy 1, policy_version 1490167 (0.0008) [2023-12-28 05:56:44,354][106226] Updated weights for policy 0, policy_version 1486553 (0.0008) [2023-12-28 05:56:44,412][106226] Updated weights for policy 0, policy_version 1486563 (0.0007) [2023-12-28 05:56:44,468][106226] Updated weights for policy 0, policy_version 1486573 (0.0010) [2023-12-28 05:56:44,524][106226] Updated weights for policy 0, policy_version 1486583 (0.0010) [2023-12-28 05:56:44,695][106225] Updated weights for policy 1, policy_version 1490177 (0.0010) [2023-12-28 05:56:44,748][106225] Updated weights for policy 1, policy_version 1490187 (0.0009) [2023-12-28 05:56:44,816][106225] Updated weights for policy 1, policy_version 1490197 (0.0010) [2023-12-28 05:56:45,142][106226] Updated weights for policy 0, policy_version 1486593 (0.0009) [2023-12-28 05:56:45,199][106226] Updated weights for policy 0, policy_version 1486603 (0.0010) [2023-12-28 05:56:45,256][106226] Updated weights for policy 0, policy_version 1486613 (0.0010) [2023-12-28 05:56:45,561][106225] Updated weights for policy 1, policy_version 1490207 (0.0010) [2023-12-28 05:56:45,614][106225] Updated weights for policy 1, policy_version 1490217 (0.0010) [2023-12-28 05:56:45,664][106225] Updated weights for policy 1, policy_version 1490227 (0.0010) [2023-12-28 05:56:45,907][106226] Updated weights for policy 0, policy_version 1486623 (0.0007) [2023-12-28 05:56:45,962][106226] Updated weights for policy 0, policy_version 1486633 (0.0005) [2023-12-28 05:56:46,016][106226] Updated weights for policy 0, policy_version 1486643 (0.0006) [2023-12-28 05:56:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 762208256. Throughput: 0: 9778.9, 1: 9862.9. Samples: 762195184. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:46,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.452')] [2023-12-28 05:56:46,356][106225] Updated weights for policy 1, policy_version 1490237 (0.0009) [2023-12-28 05:56:46,418][106225] Updated weights for policy 1, policy_version 1490247 (0.0008) [2023-12-28 05:56:46,478][106225] Updated weights for policy 1, policy_version 1490257 (0.0008) [2023-12-28 05:56:46,714][106226] Updated weights for policy 0, policy_version 1486653 (0.0009) [2023-12-28 05:56:46,768][106226] Updated weights for policy 0, policy_version 1486663 (0.0009) [2023-12-28 05:56:46,818][106226] Updated weights for policy 0, policy_version 1486673 (0.0009) [2023-12-28 05:56:47,111][106225] Updated weights for policy 1, policy_version 1490267 (0.0008) [2023-12-28 05:56:47,163][106225] Updated weights for policy 1, policy_version 1490277 (0.0005) [2023-12-28 05:56:47,221][106225] Updated weights for policy 1, policy_version 1490287 (0.0006) [2023-12-28 05:56:47,553][106226] Updated weights for policy 0, policy_version 1486683 (0.0010) [2023-12-28 05:56:47,617][106226] Updated weights for policy 0, policy_version 1486693 (0.0011) [2023-12-28 05:56:47,677][106226] Updated weights for policy 0, policy_version 1486703 (0.0010) [2023-12-28 05:56:47,837][106225] Updated weights for policy 1, policy_version 1490297 (0.0007) [2023-12-28 05:56:47,897][106225] Updated weights for policy 1, policy_version 1490307 (0.0007) [2023-12-28 05:56:47,953][106225] Updated weights for policy 1, policy_version 1490317 (0.0006) [2023-12-28 05:56:48,009][106225] Updated weights for policy 1, policy_version 1490327 (0.0006) [2023-12-28 05:56:48,389][106226] Updated weights for policy 0, policy_version 1486713 (0.0011) [2023-12-28 05:56:48,452][106226] Updated weights for policy 0, policy_version 1486723 (0.0010) [2023-12-28 05:56:48,514][106226] Updated weights for policy 0, policy_version 1486733 (0.0010) [2023-12-28 05:56:48,573][106226] Updated weights for policy 0, policy_version 1486743 (0.0009) [2023-12-28 05:56:48,651][106225] Updated weights for policy 1, policy_version 1490337 (0.0007) [2023-12-28 05:56:48,705][106225] Updated weights for policy 1, policy_version 1490347 (0.0008) [2023-12-28 05:56:48,762][106225] Updated weights for policy 1, policy_version 1490357 (0.0006) [2023-12-28 05:56:49,182][106226] Updated weights for policy 0, policy_version 1486753 (0.0005) [2023-12-28 05:56:49,239][106226] Updated weights for policy 0, policy_version 1486763 (0.0006) [2023-12-28 05:56:49,301][106226] Updated weights for policy 0, policy_version 1486773 (0.0007) [2023-12-28 05:56:49,356][106225] Updated weights for policy 1, policy_version 1490367 (0.0009) [2023-12-28 05:56:49,423][106225] Updated weights for policy 1, policy_version 1490377 (0.0011) [2023-12-28 05:56:49,477][106225] Updated weights for policy 1, policy_version 1490387 (0.0010) [2023-12-28 05:56:50,091][106226] Updated weights for policy 0, policy_version 1486783 (0.0008) [2023-12-28 05:56:50,146][106226] Updated weights for policy 0, policy_version 1486793 (0.0007) [2023-12-28 05:56:50,172][106225] Updated weights for policy 1, policy_version 1490397 (0.0009) [2023-12-28 05:56:50,198][106226] Updated weights for policy 0, policy_version 1486803 (0.0006) [2023-12-28 05:56:50,232][106225] Updated weights for policy 1, policy_version 1490407 (0.0007) [2023-12-28 05:56:50,294][106225] Updated weights for policy 1, policy_version 1490417 (0.0008) [2023-12-28 05:56:50,961][106226] Updated weights for policy 0, policy_version 1486813 (0.0010) [2023-12-28 05:56:50,992][106225] Updated weights for policy 1, policy_version 1490427 (0.0009) [2023-12-28 05:56:51,030][106226] Updated weights for policy 0, policy_version 1486823 (0.0011) [2023-12-28 05:56:51,061][106225] Updated weights for policy 1, policy_version 1490437 (0.0008) [2023-12-28 05:56:51,101][106226] Updated weights for policy 0, policy_version 1486833 (0.0009) [2023-12-28 05:56:51,128][106225] Updated weights for policy 1, policy_version 1490447 (0.0008) [2023-12-28 05:56:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 762306560. Throughput: 0: 9821.7, 1: 9916.9. Samples: 762316404. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:51,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.632')] [2023-12-28 05:56:51,784][106226] Updated weights for policy 0, policy_version 1486843 (0.0010) [2023-12-28 05:56:51,842][106226] Updated weights for policy 0, policy_version 1486853 (0.0009) [2023-12-28 05:56:51,875][106225] Updated weights for policy 1, policy_version 1490457 (0.0009) [2023-12-28 05:56:51,901][106226] Updated weights for policy 0, policy_version 1486863 (0.0009) [2023-12-28 05:56:51,932][106225] Updated weights for policy 1, policy_version 1490467 (0.0006) [2023-12-28 05:56:51,993][106225] Updated weights for policy 1, policy_version 1490477 (0.0008) [2023-12-28 05:56:52,046][106225] Updated weights for policy 1, policy_version 1490487 (0.0008) [2023-12-28 05:56:52,658][106226] Updated weights for policy 0, policy_version 1486873 (0.0007) [2023-12-28 05:56:52,717][106226] Updated weights for policy 0, policy_version 1486883 (0.0005) [2023-12-28 05:56:52,776][106226] Updated weights for policy 0, policy_version 1486893 (0.0008) [2023-12-28 05:56:52,783][106225] Updated weights for policy 1, policy_version 1490497 (0.0008) [2023-12-28 05:56:52,836][106226] Updated weights for policy 0, policy_version 1486903 (0.0006) [2023-12-28 05:56:52,838][106225] Updated weights for policy 1, policy_version 1490507 (0.0006) [2023-12-28 05:56:52,903][106225] Updated weights for policy 1, policy_version 1490517 (0.0009) [2023-12-28 05:56:53,472][106226] Updated weights for policy 0, policy_version 1486913 (0.0005) [2023-12-28 05:56:53,536][106226] Updated weights for policy 0, policy_version 1486923 (0.0005) [2023-12-28 05:56:53,597][106226] Updated weights for policy 0, policy_version 1486933 (0.0005) [2023-12-28 05:56:53,650][106225] Updated weights for policy 1, policy_version 1490527 (0.0010) [2023-12-28 05:56:53,717][106225] Updated weights for policy 1, policy_version 1490537 (0.0008) [2023-12-28 05:56:53,773][106225] Updated weights for policy 1, policy_version 1490547 (0.0010) [2023-12-28 05:56:54,179][106226] Updated weights for policy 0, policy_version 1486943 (0.0006) [2023-12-28 05:56:54,238][106226] Updated weights for policy 0, policy_version 1486953 (0.0009) [2023-12-28 05:56:54,297][106226] Updated weights for policy 0, policy_version 1486963 (0.0010) [2023-12-28 05:56:54,493][106225] Updated weights for policy 1, policy_version 1490557 (0.0011) [2023-12-28 05:56:54,552][106225] Updated weights for policy 1, policy_version 1490567 (0.0008) [2023-12-28 05:56:54,612][106225] Updated weights for policy 1, policy_version 1490577 (0.0006) [2023-12-28 05:56:54,897][106226] Updated weights for policy 0, policy_version 1486973 (0.0008) [2023-12-28 05:56:54,946][106226] Updated weights for policy 0, policy_version 1486983 (0.0005) [2023-12-28 05:56:55,015][106226] Updated weights for policy 0, policy_version 1486993 (0.0010) [2023-12-28 05:56:55,189][106225] Updated weights for policy 1, policy_version 1490587 (0.0007) [2023-12-28 05:56:55,246][106225] Updated weights for policy 1, policy_version 1490597 (0.0010) [2023-12-28 05:56:55,308][106225] Updated weights for policy 1, policy_version 1490607 (0.0010) [2023-12-28 05:56:55,680][106226] Updated weights for policy 0, policy_version 1487003 (0.0010) [2023-12-28 05:56:55,746][106226] Updated weights for policy 0, policy_version 1487013 (0.0011) [2023-12-28 05:56:55,802][106226] Updated weights for policy 0, policy_version 1487023 (0.0010) [2023-12-28 05:56:55,959][106225] Updated weights for policy 1, policy_version 1490617 (0.0010) [2023-12-28 05:56:56,017][106225] Updated weights for policy 1, policy_version 1490627 (0.0006) [2023-12-28 05:56:56,077][106225] Updated weights for policy 1, policy_version 1490637 (0.0006) [2023-12-28 05:56:56,144][106225] Updated weights for policy 1, policy_version 1490647 (0.0006) [2023-12-28 05:56:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 762413056. Throughput: 0: 9823.0, 1: 9885.9. Samples: 762375360. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:56:56,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.431')] [2023-12-28 05:56:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001490648_381657088.pth... [2023-12-28 05:56:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001487032_380755968.pth... [2023-12-28 05:56:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001489464_381353984.pth [2023-12-28 05:56:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001485880_380461056.pth [2023-12-28 05:56:56,517][106226] Updated weights for policy 0, policy_version 1487033 (0.0010) [2023-12-28 05:56:56,580][106226] Updated weights for policy 0, policy_version 1487043 (0.0011) [2023-12-28 05:56:56,639][106226] Updated weights for policy 0, policy_version 1487053 (0.0011) [2023-12-28 05:56:56,702][106226] Updated weights for policy 0, policy_version 1487063 (0.0010) [2023-12-28 05:56:56,746][106225] Updated weights for policy 1, policy_version 1490657 (0.0006) [2023-12-28 05:56:56,807][106225] Updated weights for policy 1, policy_version 1490667 (0.0007) [2023-12-28 05:56:56,861][106225] Updated weights for policy 1, policy_version 1490677 (0.0007) [2023-12-28 05:56:57,386][106226] Updated weights for policy 0, policy_version 1487073 (0.0010) [2023-12-28 05:56:57,445][106226] Updated weights for policy 0, policy_version 1487083 (0.0010) [2023-12-28 05:56:57,508][106226] Updated weights for policy 0, policy_version 1487093 (0.0011) [2023-12-28 05:56:57,532][106225] Updated weights for policy 1, policy_version 1490687 (0.0009) [2023-12-28 05:56:57,581][106225] Updated weights for policy 1, policy_version 1490697 (0.0010) [2023-12-28 05:56:57,627][106225] Updated weights for policy 1, policy_version 1490707 (0.0010) [2023-12-28 05:56:58,223][106226] Updated weights for policy 0, policy_version 1487103 (0.0010) [2023-12-28 05:56:58,284][106226] Updated weights for policy 0, policy_version 1487113 (0.0008) [2023-12-28 05:56:58,360][106226] Updated weights for policy 0, policy_version 1487123 (0.0008) [2023-12-28 05:56:58,404][106225] Updated weights for policy 1, policy_version 1490717 (0.0010) [2023-12-28 05:56:58,466][106225] Updated weights for policy 1, policy_version 1490727 (0.0009) [2023-12-28 05:56:58,528][106225] Updated weights for policy 1, policy_version 1490737 (0.0008) [2023-12-28 05:56:59,102][106226] Updated weights for policy 0, policy_version 1487133 (0.0007) [2023-12-28 05:56:59,161][106226] Updated weights for policy 0, policy_version 1487143 (0.0006) [2023-12-28 05:56:59,234][106226] Updated weights for policy 0, policy_version 1487153 (0.0007) [2023-12-28 05:56:59,406][106225] Updated weights for policy 1, policy_version 1490747 (0.0008) [2023-12-28 05:56:59,464][106225] Updated weights for policy 1, policy_version 1490757 (0.0009) [2023-12-28 05:56:59,522][106225] Updated weights for policy 1, policy_version 1490767 (0.0008) [2023-12-28 05:56:59,833][106226] Updated weights for policy 0, policy_version 1487163 (0.0008) [2023-12-28 05:56:59,903][106226] Updated weights for policy 0, policy_version 1487173 (0.0009) [2023-12-28 05:56:59,970][106226] Updated weights for policy 0, policy_version 1487183 (0.0010) [2023-12-28 05:57:00,247][106225] Updated weights for policy 1, policy_version 1490777 (0.0009) [2023-12-28 05:57:00,303][106225] Updated weights for policy 1, policy_version 1490787 (0.0006) [2023-12-28 05:57:00,366][106225] Updated weights for policy 1, policy_version 1490797 (0.0009) [2023-12-28 05:57:00,426][106225] Updated weights for policy 1, policy_version 1490807 (0.0009) [2023-12-28 05:57:00,717][106226] Updated weights for policy 0, policy_version 1487193 (0.0011) [2023-12-28 05:57:00,770][106226] Updated weights for policy 0, policy_version 1487203 (0.0007) [2023-12-28 05:57:00,832][106226] Updated weights for policy 0, policy_version 1487213 (0.0006) [2023-12-28 05:57:00,892][106226] Updated weights for policy 0, policy_version 1487223 (0.0005) [2023-12-28 05:57:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 762503168. Throughput: 0: 9811.8, 1: 10013.0. Samples: 762494944. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:01,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-4.570')] [2023-12-28 05:57:01,186][106225] Updated weights for policy 1, policy_version 1490817 (0.0009) [2023-12-28 05:57:01,247][106225] Updated weights for policy 1, policy_version 1490827 (0.0009) [2023-12-28 05:57:01,306][106225] Updated weights for policy 1, policy_version 1490837 (0.0006) [2023-12-28 05:57:01,557][106226] Updated weights for policy 0, policy_version 1487233 (0.0007) [2023-12-28 05:57:01,614][106226] Updated weights for policy 0, policy_version 1487243 (0.0009) [2023-12-28 05:57:01,681][106226] Updated weights for policy 0, policy_version 1487253 (0.0008) [2023-12-28 05:57:02,084][106225] Updated weights for policy 1, policy_version 1490847 (0.0009) [2023-12-28 05:57:02,154][106225] Updated weights for policy 1, policy_version 1490857 (0.0009) [2023-12-28 05:57:02,213][106225] Updated weights for policy 1, policy_version 1490867 (0.0008) [2023-12-28 05:57:02,381][106226] Updated weights for policy 0, policy_version 1487263 (0.0008) [2023-12-28 05:57:02,451][106226] Updated weights for policy 0, policy_version 1487273 (0.0006) [2023-12-28 05:57:02,518][106226] Updated weights for policy 0, policy_version 1487283 (0.0006) [2023-12-28 05:57:02,919][106225] Updated weights for policy 1, policy_version 1490877 (0.0008) [2023-12-28 05:57:02,970][106225] Updated weights for policy 1, policy_version 1490887 (0.0009) [2023-12-28 05:57:03,019][106225] Updated weights for policy 1, policy_version 1490897 (0.0009) [2023-12-28 05:57:03,091][106226] Updated weights for policy 0, policy_version 1487293 (0.0008) [2023-12-28 05:57:03,146][106226] Updated weights for policy 0, policy_version 1487303 (0.0009) [2023-12-28 05:57:03,197][106226] Updated weights for policy 0, policy_version 1487313 (0.0008) [2023-12-28 05:57:03,758][106225] Updated weights for policy 1, policy_version 1490907 (0.0008) [2023-12-28 05:57:03,811][106225] Updated weights for policy 1, policy_version 1490917 (0.0008) [2023-12-28 05:57:03,868][106226] Updated weights for policy 0, policy_version 1487323 (0.0008) [2023-12-28 05:57:03,875][106225] Updated weights for policy 1, policy_version 1490927 (0.0010) [2023-12-28 05:57:03,935][106226] Updated weights for policy 0, policy_version 1487333 (0.0007) [2023-12-28 05:57:03,991][106226] Updated weights for policy 0, policy_version 1487343 (0.0008) [2023-12-28 05:57:04,618][106225] Updated weights for policy 1, policy_version 1490937 (0.0007) [2023-12-28 05:57:04,655][106226] Updated weights for policy 0, policy_version 1487353 (0.0006) [2023-12-28 05:57:04,666][106225] Updated weights for policy 1, policy_version 1490947 (0.0010) [2023-12-28 05:57:04,704][106226] Updated weights for policy 0, policy_version 1487363 (0.0006) [2023-12-28 05:57:04,710][106225] Updated weights for policy 1, policy_version 1490957 (0.0005) [2023-12-28 05:57:04,755][106226] Updated weights for policy 0, policy_version 1487373 (0.0006) [2023-12-28 05:57:04,758][106225] Updated weights for policy 1, policy_version 1490967 (0.0005) [2023-12-28 05:57:04,806][106226] Updated weights for policy 0, policy_version 1487383 (0.0008) [2023-12-28 05:57:05,464][106225] Updated weights for policy 1, policy_version 1490977 (0.0007) [2023-12-28 05:57:05,516][106225] Updated weights for policy 1, policy_version 1490987 (0.0008) [2023-12-28 05:57:05,533][106226] Updated weights for policy 0, policy_version 1487393 (0.0008) [2023-12-28 05:57:05,560][106225] Updated weights for policy 1, policy_version 1490997 (0.0006) [2023-12-28 05:57:05,585][106226] Updated weights for policy 0, policy_version 1487403 (0.0008) [2023-12-28 05:57:05,633][106226] Updated weights for policy 0, policy_version 1487413 (0.0008) [2023-12-28 05:57:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 762601472. Throughput: 0: 9795.8, 1: 10001.3. Samples: 762614208. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:06,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.690')] [2023-12-28 05:57:06,252][106226] Updated weights for policy 0, policy_version 1487423 (0.0008) [2023-12-28 05:57:06,318][106226] Updated weights for policy 0, policy_version 1487433 (0.0007) [2023-12-28 05:57:06,333][106225] Updated weights for policy 1, policy_version 1491007 (0.0010) [2023-12-28 05:57:06,374][106226] Updated weights for policy 0, policy_version 1487443 (0.0009) [2023-12-28 05:57:06,391][106225] Updated weights for policy 1, policy_version 1491017 (0.0010) [2023-12-28 05:57:06,456][106225] Updated weights for policy 1, policy_version 1491027 (0.0011) [2023-12-28 05:57:07,010][106226] Updated weights for policy 0, policy_version 1487453 (0.0007) [2023-12-28 05:57:07,067][106226] Updated weights for policy 0, policy_version 1487463 (0.0011) [2023-12-28 05:57:07,132][106226] Updated weights for policy 0, policy_version 1487473 (0.0011) [2023-12-28 05:57:07,169][106225] Updated weights for policy 1, policy_version 1491037 (0.0010) [2023-12-28 05:57:07,229][106225] Updated weights for policy 1, policy_version 1491047 (0.0009) [2023-12-28 05:57:07,285][106225] Updated weights for policy 1, policy_version 1491057 (0.0006) [2023-12-28 05:57:07,806][106226] Updated weights for policy 0, policy_version 1487483 (0.0011) [2023-12-28 05:57:07,862][106226] Updated weights for policy 0, policy_version 1487493 (0.0010) [2023-12-28 05:57:07,921][106226] Updated weights for policy 0, policy_version 1487503 (0.0010) [2023-12-28 05:57:07,931][106225] Updated weights for policy 1, policy_version 1491067 (0.0005) [2023-12-28 05:57:07,986][106225] Updated weights for policy 1, policy_version 1491077 (0.0006) [2023-12-28 05:57:08,050][106225] Updated weights for policy 1, policy_version 1491087 (0.0009) [2023-12-28 05:57:08,541][106226] Updated weights for policy 0, policy_version 1487513 (0.0010) [2023-12-28 05:57:08,605][106226] Updated weights for policy 0, policy_version 1487523 (0.0007) [2023-12-28 05:57:08,665][106226] Updated weights for policy 0, policy_version 1487533 (0.0008) [2023-12-28 05:57:08,727][106226] Updated weights for policy 0, policy_version 1487543 (0.0007) [2023-12-28 05:57:08,790][106225] Updated weights for policy 1, policy_version 1491097 (0.0006) [2023-12-28 05:57:08,849][106225] Updated weights for policy 1, policy_version 1491107 (0.0008) [2023-12-28 05:57:08,908][106225] Updated weights for policy 1, policy_version 1491117 (0.0007) [2023-12-28 05:57:08,965][106225] Updated weights for policy 1, policy_version 1491127 (0.0007) [2023-12-28 05:57:09,328][106226] Updated weights for policy 0, policy_version 1487553 (0.0008) [2023-12-28 05:57:09,394][106226] Updated weights for policy 0, policy_version 1487563 (0.0009) [2023-12-28 05:57:09,459][106226] Updated weights for policy 0, policy_version 1487573 (0.0007) [2023-12-28 05:57:09,718][106225] Updated weights for policy 1, policy_version 1491137 (0.0010) [2023-12-28 05:57:09,783][106225] Updated weights for policy 1, policy_version 1491147 (0.0010) [2023-12-28 05:57:09,851][106225] Updated weights for policy 1, policy_version 1491157 (0.0011) [2023-12-28 05:57:10,151][106226] Updated weights for policy 0, policy_version 1487583 (0.0008) [2023-12-28 05:57:10,216][106226] Updated weights for policy 0, policy_version 1487593 (0.0007) [2023-12-28 05:57:10,285][106226] Updated weights for policy 0, policy_version 1487603 (0.0007) [2023-12-28 05:57:10,584][106225] Updated weights for policy 1, policy_version 1491167 (0.0008) [2023-12-28 05:57:10,645][106225] Updated weights for policy 1, policy_version 1491177 (0.0005) [2023-12-28 05:57:10,712][106225] Updated weights for policy 1, policy_version 1491187 (0.0009) [2023-12-28 05:57:10,966][106226] Updated weights for policy 0, policy_version 1487613 (0.0008) [2023-12-28 05:57:11,016][106226] Updated weights for policy 0, policy_version 1487623 (0.0010) [2023-12-28 05:57:11,089][106226] Updated weights for policy 0, policy_version 1487633 (0.0011) [2023-12-28 05:57:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 762707968. Throughput: 0: 9869.5, 1: 10003.5. Samples: 762675692. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:11,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-5.097')] [2023-12-28 05:57:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001491192_381796352.pth... [2023-12-28 05:57:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001487640_380911616.pth... [2023-12-28 05:57:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001490040_381501440.pth [2023-12-28 05:57:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001486456_380608512.pth [2023-12-28 05:57:11,415][106225] Updated weights for policy 1, policy_version 1491197 (0.0009) [2023-12-28 05:57:11,466][106225] Updated weights for policy 1, policy_version 1491207 (0.0009) [2023-12-28 05:57:11,513][106225] Updated weights for policy 1, policy_version 1491217 (0.0008) [2023-12-28 05:57:11,922][106226] Updated weights for policy 0, policy_version 1487643 (0.0010) [2023-12-28 05:57:11,987][106226] Updated weights for policy 0, policy_version 1487653 (0.0009) [2023-12-28 05:57:12,053][106226] Updated weights for policy 0, policy_version 1487663 (0.0008) [2023-12-28 05:57:12,251][106225] Updated weights for policy 1, policy_version 1491227 (0.0008) [2023-12-28 05:57:12,321][106225] Updated weights for policy 1, policy_version 1491237 (0.0008) [2023-12-28 05:57:12,391][106225] Updated weights for policy 1, policy_version 1491247 (0.0008) [2023-12-28 05:57:12,766][106226] Updated weights for policy 0, policy_version 1487673 (0.0009) [2023-12-28 05:57:12,830][106226] Updated weights for policy 0, policy_version 1487683 (0.0009) [2023-12-28 05:57:12,887][106226] Updated weights for policy 0, policy_version 1487693 (0.0011) [2023-12-28 05:57:12,945][106226] Updated weights for policy 0, policy_version 1487703 (0.0011) [2023-12-28 05:57:13,131][106225] Updated weights for policy 1, policy_version 1491257 (0.0007) [2023-12-28 05:57:13,187][106225] Updated weights for policy 1, policy_version 1491267 (0.0007) [2023-12-28 05:57:13,241][106225] Updated weights for policy 1, policy_version 1491277 (0.0009) [2023-12-28 05:57:13,297][106225] Updated weights for policy 1, policy_version 1491287 (0.0008) [2023-12-28 05:57:13,599][106226] Updated weights for policy 0, policy_version 1487713 (0.0010) [2023-12-28 05:57:13,649][106226] Updated weights for policy 0, policy_version 1487723 (0.0010) [2023-12-28 05:57:13,694][106226] Updated weights for policy 0, policy_version 1487733 (0.0007) [2023-12-28 05:57:14,101][106225] Updated weights for policy 1, policy_version 1491297 (0.0007) [2023-12-28 05:57:14,161][106225] Updated weights for policy 1, policy_version 1491307 (0.0006) [2023-12-28 05:57:14,218][106225] Updated weights for policy 1, policy_version 1491317 (0.0005) [2023-12-28 05:57:14,273][106226] Updated weights for policy 0, policy_version 1487743 (0.0009) [2023-12-28 05:57:14,320][106226] Updated weights for policy 0, policy_version 1487753 (0.0010) [2023-12-28 05:57:14,373][106226] Updated weights for policy 0, policy_version 1487763 (0.0010) [2023-12-28 05:57:14,878][106225] Updated weights for policy 1, policy_version 1491327 (0.0007) [2023-12-28 05:57:14,940][106225] Updated weights for policy 1, policy_version 1491337 (0.0007) [2023-12-28 05:57:15,007][106225] Updated weights for policy 1, policy_version 1491347 (0.0008) [2023-12-28 05:57:15,093][106226] Updated weights for policy 0, policy_version 1487773 (0.0011) [2023-12-28 05:57:15,159][106226] Updated weights for policy 0, policy_version 1487783 (0.0011) [2023-12-28 05:57:15,233][106226] Updated weights for policy 0, policy_version 1487793 (0.0010) [2023-12-28 05:57:15,600][106225] Updated weights for policy 1, policy_version 1491357 (0.0008) [2023-12-28 05:57:15,658][106225] Updated weights for policy 1, policy_version 1491367 (0.0008) [2023-12-28 05:57:15,703][106225] Updated weights for policy 1, policy_version 1491377 (0.0008) [2023-12-28 05:57:15,838][106226] Updated weights for policy 0, policy_version 1487803 (0.0008) [2023-12-28 05:57:15,891][106226] Updated weights for policy 0, policy_version 1487813 (0.0010) [2023-12-28 05:57:15,944][106226] Updated weights for policy 0, policy_version 1487823 (0.0009) [2023-12-28 05:57:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 762806272. Throughput: 0: 9960.2, 1: 9850.4. Samples: 762792380. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:16,176][105115] Avg episode reward: [(0, '-4.894'), (1, '-4.831')] [2023-12-28 05:57:16,468][106225] Updated weights for policy 1, policy_version 1491387 (0.0007) [2023-12-28 05:57:16,514][106225] Updated weights for policy 1, policy_version 1491397 (0.0007) [2023-12-28 05:57:16,575][106225] Updated weights for policy 1, policy_version 1491407 (0.0008) [2023-12-28 05:57:16,635][106226] Updated weights for policy 0, policy_version 1487833 (0.0006) [2023-12-28 05:57:16,697][106226] Updated weights for policy 0, policy_version 1487843 (0.0011) [2023-12-28 05:57:16,759][106226] Updated weights for policy 0, policy_version 1487853 (0.0011) [2023-12-28 05:57:16,822][106226] Updated weights for policy 0, policy_version 1487863 (0.0011) [2023-12-28 05:57:17,251][106225] Updated weights for policy 1, policy_version 1491417 (0.0007) [2023-12-28 05:57:17,313][106225] Updated weights for policy 1, policy_version 1491427 (0.0010) [2023-12-28 05:57:17,373][106225] Updated weights for policy 1, policy_version 1491437 (0.0010) [2023-12-28 05:57:17,430][106225] Updated weights for policy 1, policy_version 1491447 (0.0010) [2023-12-28 05:57:17,522][106226] Updated weights for policy 0, policy_version 1487873 (0.0011) [2023-12-28 05:57:17,579][106226] Updated weights for policy 0, policy_version 1487883 (0.0010) [2023-12-28 05:57:17,633][106226] Updated weights for policy 0, policy_version 1487893 (0.0010) [2023-12-28 05:57:18,132][106225] Updated weights for policy 1, policy_version 1491457 (0.0010) [2023-12-28 05:57:18,191][106225] Updated weights for policy 1, policy_version 1491467 (0.0010) [2023-12-28 05:57:18,235][106225] Updated weights for policy 1, policy_version 1491477 (0.0010) [2023-12-28 05:57:18,367][106226] Updated weights for policy 0, policy_version 1487903 (0.0011) [2023-12-28 05:57:18,431][106226] Updated weights for policy 0, policy_version 1487913 (0.0011) [2023-12-28 05:57:18,491][106226] Updated weights for policy 0, policy_version 1487923 (0.0010) [2023-12-28 05:57:18,965][106225] Updated weights for policy 1, policy_version 1491487 (0.0009) [2023-12-28 05:57:19,029][106225] Updated weights for policy 1, policy_version 1491497 (0.0007) [2023-12-28 05:57:19,086][106225] Updated weights for policy 1, policy_version 1491507 (0.0008) [2023-12-28 05:57:19,163][106226] Updated weights for policy 0, policy_version 1487933 (0.0011) [2023-12-28 05:57:19,227][106226] Updated weights for policy 0, policy_version 1487943 (0.0011) [2023-12-28 05:57:19,290][106226] Updated weights for policy 0, policy_version 1487953 (0.0011) [2023-12-28 05:57:19,746][106225] Updated weights for policy 1, policy_version 1491517 (0.0008) [2023-12-28 05:57:19,814][106225] Updated weights for policy 1, policy_version 1491527 (0.0007) [2023-12-28 05:57:19,880][106225] Updated weights for policy 1, policy_version 1491537 (0.0008) [2023-12-28 05:57:20,098][106226] Updated weights for policy 0, policy_version 1487963 (0.0011) [2023-12-28 05:57:20,166][106226] Updated weights for policy 0, policy_version 1487973 (0.0011) [2023-12-28 05:57:20,229][106226] Updated weights for policy 0, policy_version 1487983 (0.0011) [2023-12-28 05:57:20,609][106225] Updated weights for policy 1, policy_version 1491547 (0.0007) [2023-12-28 05:57:20,670][106225] Updated weights for policy 1, policy_version 1491557 (0.0008) [2023-12-28 05:57:20,725][106225] Updated weights for policy 1, policy_version 1491567 (0.0010) [2023-12-28 05:57:20,896][106226] Updated weights for policy 0, policy_version 1487993 (0.0010) [2023-12-28 05:57:20,955][106226] Updated weights for policy 0, policy_version 1488003 (0.0007) [2023-12-28 05:57:21,008][106226] Updated weights for policy 0, policy_version 1488013 (0.0008) [2023-12-28 05:57:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 762904576. Throughput: 0: 9984.2, 1: 9836.5. Samples: 762910196. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:21,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-4.650')] [2023-12-28 05:57:21,482][106225] Updated weights for policy 1, policy_version 1491577 (0.0010) [2023-12-28 05:57:21,544][106225] Updated weights for policy 1, policy_version 1491587 (0.0007) [2023-12-28 05:57:21,591][106225] Updated weights for policy 1, policy_version 1491597 (0.0009) [2023-12-28 05:57:21,662][106225] Updated weights for policy 1, policy_version 1491607 (0.0011) [2023-12-28 05:57:21,929][106226] Updated weights for policy 0, policy_version 1488026 (0.0013) [2023-12-28 05:57:21,992][106226] Updated weights for policy 0, policy_version 1488036 (0.0007) [2023-12-28 05:57:22,052][106226] Updated weights for policy 0, policy_version 1488046 (0.0008) [2023-12-28 05:57:22,103][106226] Updated weights for policy 0, policy_version 1488056 (0.0008) [2023-12-28 05:57:22,351][106225] Updated weights for policy 1, policy_version 1491617 (0.0009) [2023-12-28 05:57:22,417][106225] Updated weights for policy 1, policy_version 1491627 (0.0008) [2023-12-28 05:57:22,479][106225] Updated weights for policy 1, policy_version 1491637 (0.0010) [2023-12-28 05:57:22,806][106226] Updated weights for policy 0, policy_version 1488066 (0.0011) [2023-12-28 05:57:22,866][106226] Updated weights for policy 0, policy_version 1488076 (0.0011) [2023-12-28 05:57:22,928][106226] Updated weights for policy 0, policy_version 1488086 (0.0009) [2023-12-28 05:57:23,239][106225] Updated weights for policy 1, policy_version 1491647 (0.0008) [2023-12-28 05:57:23,290][106225] Updated weights for policy 1, policy_version 1491657 (0.0008) [2023-12-28 05:57:23,350][106225] Updated weights for policy 1, policy_version 1491667 (0.0008) [2023-12-28 05:57:23,654][106226] Updated weights for policy 0, policy_version 1488096 (0.0009) [2023-12-28 05:57:23,715][106226] Updated weights for policy 0, policy_version 1488106 (0.0011) [2023-12-28 05:57:23,768][106226] Updated weights for policy 0, policy_version 1488116 (0.0010) [2023-12-28 05:57:24,028][106225] Updated weights for policy 1, policy_version 1491677 (0.0009) [2023-12-28 05:57:24,076][106225] Updated weights for policy 1, policy_version 1491687 (0.0010) [2023-12-28 05:57:24,143][106225] Updated weights for policy 1, policy_version 1491697 (0.0008) [2023-12-28 05:57:24,412][106226] Updated weights for policy 0, policy_version 1488126 (0.0010) [2023-12-28 05:57:24,460][106226] Updated weights for policy 0, policy_version 1488136 (0.0008) [2023-12-28 05:57:24,522][106226] Updated weights for policy 0, policy_version 1488146 (0.0008) [2023-12-28 05:57:24,893][106225] Updated weights for policy 1, policy_version 1491707 (0.0007) [2023-12-28 05:57:24,959][106225] Updated weights for policy 1, policy_version 1491717 (0.0005) [2023-12-28 05:57:25,020][106225] Updated weights for policy 1, policy_version 1491727 (0.0005) [2023-12-28 05:57:25,128][106226] Updated weights for policy 0, policy_version 1488156 (0.0007) [2023-12-28 05:57:25,195][106226] Updated weights for policy 0, policy_version 1488166 (0.0007) [2023-12-28 05:57:25,247][106226] Updated weights for policy 0, policy_version 1488176 (0.0008) [2023-12-28 05:57:25,652][106225] Updated weights for policy 1, policy_version 1491737 (0.0007) [2023-12-28 05:57:25,716][106225] Updated weights for policy 1, policy_version 1491747 (0.0007) [2023-12-28 05:57:25,776][106225] Updated weights for policy 1, policy_version 1491757 (0.0009) [2023-12-28 05:57:25,834][106225] Updated weights for policy 1, policy_version 1491767 (0.0009) [2023-12-28 05:57:25,909][106226] Updated weights for policy 0, policy_version 1488186 (0.0009) [2023-12-28 05:57:25,967][106226] Updated weights for policy 0, policy_version 1488196 (0.0009) [2023-12-28 05:57:26,036][106226] Updated weights for policy 0, policy_version 1488206 (0.0006) [2023-12-28 05:57:26,090][106226] Updated weights for policy 0, policy_version 1488216 (0.0010) [2023-12-28 05:57:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 763002880. Throughput: 0: 9969.4, 1: 9829.5. Samples: 762966836. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:26,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-4.736')] [2023-12-28 05:57:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001488216_381059072.pth... [2023-12-28 05:57:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001491768_381943808.pth... [2023-12-28 05:57:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001487032_380755968.pth [2023-12-28 05:57:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001490648_381657088.pth [2023-12-28 05:57:26,394][106225] Updated weights for policy 1, policy_version 1491777 (0.0006) [2023-12-28 05:57:26,449][106225] Updated weights for policy 1, policy_version 1491787 (0.0005) [2023-12-28 05:57:26,503][106225] Updated weights for policy 1, policy_version 1491797 (0.0007) [2023-12-28 05:57:26,911][106226] Updated weights for policy 0, policy_version 1488226 (0.0005) [2023-12-28 05:57:26,967][106226] Updated weights for policy 0, policy_version 1488236 (0.0006) [2023-12-28 05:57:27,027][106226] Updated weights for policy 0, policy_version 1488246 (0.0009) [2023-12-28 05:57:27,074][106225] Updated weights for policy 1, policy_version 1491807 (0.0009) [2023-12-28 05:57:27,135][106225] Updated weights for policy 1, policy_version 1491817 (0.0008) [2023-12-28 05:57:27,185][106225] Updated weights for policy 1, policy_version 1491827 (0.0007) [2023-12-28 05:57:27,599][106226] Updated weights for policy 0, policy_version 1488256 (0.0008) [2023-12-28 05:57:27,649][106226] Updated weights for policy 0, policy_version 1488266 (0.0007) [2023-12-28 05:57:27,694][106226] Updated weights for policy 0, policy_version 1488276 (0.0005) [2023-12-28 05:57:27,854][106225] Updated weights for policy 1, policy_version 1491837 (0.0009) [2023-12-28 05:57:27,913][106225] Updated weights for policy 1, policy_version 1491847 (0.0005) [2023-12-28 05:57:27,962][106225] Updated weights for policy 1, policy_version 1491857 (0.0005) [2023-12-28 05:57:28,325][106226] Updated weights for policy 0, policy_version 1488286 (0.0006) [2023-12-28 05:57:28,391][106226] Updated weights for policy 0, policy_version 1488296 (0.0008) [2023-12-28 05:57:28,459][106226] Updated weights for policy 0, policy_version 1488306 (0.0009) [2023-12-28 05:57:28,624][106225] Updated weights for policy 1, policy_version 1491867 (0.0006) [2023-12-28 05:57:28,682][106225] Updated weights for policy 1, policy_version 1491877 (0.0009) [2023-12-28 05:57:28,739][106225] Updated weights for policy 1, policy_version 1491887 (0.0009) [2023-12-28 05:57:29,029][106226] Updated weights for policy 0, policy_version 1488316 (0.0007) [2023-12-28 05:57:29,083][106226] Updated weights for policy 0, policy_version 1488326 (0.0005) [2023-12-28 05:57:29,145][106226] Updated weights for policy 0, policy_version 1488336 (0.0008) [2023-12-28 05:57:29,522][106225] Updated weights for policy 1, policy_version 1491897 (0.0008) [2023-12-28 05:57:29,575][106225] Updated weights for policy 1, policy_version 1491907 (0.0010) [2023-12-28 05:57:29,622][106225] Updated weights for policy 1, policy_version 1491917 (0.0010) [2023-12-28 05:57:29,678][106225] Updated weights for policy 1, policy_version 1491927 (0.0010) [2023-12-28 05:57:29,846][106226] Updated weights for policy 0, policy_version 1488346 (0.0009) [2023-12-28 05:57:29,905][106226] Updated weights for policy 0, policy_version 1488356 (0.0009) [2023-12-28 05:57:29,967][106226] Updated weights for policy 0, policy_version 1488366 (0.0008) [2023-12-28 05:57:30,030][106226] Updated weights for policy 0, policy_version 1488376 (0.0006) [2023-12-28 05:57:30,339][106225] Updated weights for policy 1, policy_version 1491937 (0.0010) [2023-12-28 05:57:30,395][106225] Updated weights for policy 1, policy_version 1491947 (0.0009) [2023-12-28 05:57:30,446][106225] Updated weights for policy 1, policy_version 1491957 (0.0009) [2023-12-28 05:57:30,690][106226] Updated weights for policy 0, policy_version 1488386 (0.0008) [2023-12-28 05:57:30,756][106226] Updated weights for policy 0, policy_version 1488396 (0.0008) [2023-12-28 05:57:30,806][106226] Updated weights for policy 0, policy_version 1488406 (0.0007) [2023-12-28 05:57:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 763101184. Throughput: 0: 10066.3, 1: 9866.1. Samples: 763092144. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:31,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-4.858')] [2023-12-28 05:57:31,205][106225] Updated weights for policy 1, policy_version 1491967 (0.0010) [2023-12-28 05:57:31,273][106225] Updated weights for policy 1, policy_version 1491977 (0.0009) [2023-12-28 05:57:31,337][106225] Updated weights for policy 1, policy_version 1491987 (0.0009) [2023-12-28 05:57:31,466][106226] Updated weights for policy 0, policy_version 1488416 (0.0008) [2023-12-28 05:57:31,536][106226] Updated weights for policy 0, policy_version 1488426 (0.0007) [2023-12-28 05:57:31,600][106226] Updated weights for policy 0, policy_version 1488436 (0.0010) [2023-12-28 05:57:32,128][106225] Updated weights for policy 1, policy_version 1491997 (0.0008) [2023-12-28 05:57:32,177][106225] Updated weights for policy 1, policy_version 1492007 (0.0007) [2023-12-28 05:57:32,233][106225] Updated weights for policy 1, policy_version 1492017 (0.0008) [2023-12-28 05:57:32,297][106226] Updated weights for policy 0, policy_version 1488446 (0.0007) [2023-12-28 05:57:32,359][106226] Updated weights for policy 0, policy_version 1488456 (0.0007) [2023-12-28 05:57:32,423][106226] Updated weights for policy 0, policy_version 1488466 (0.0007) [2023-12-28 05:57:33,005][106226] Updated weights for policy 0, policy_version 1488476 (0.0006) [2023-12-28 05:57:33,025][106225] Updated weights for policy 1, policy_version 1492027 (0.0010) [2023-12-28 05:57:33,059][106226] Updated weights for policy 0, policy_version 1488486 (0.0005) [2023-12-28 05:57:33,086][106225] Updated weights for policy 1, policy_version 1492037 (0.0010) [2023-12-28 05:57:33,123][106226] Updated weights for policy 0, policy_version 1488496 (0.0005) [2023-12-28 05:57:33,144][106225] Updated weights for policy 1, policy_version 1492047 (0.0010) [2023-12-28 05:57:33,778][106226] Updated weights for policy 0, policy_version 1488506 (0.0009) [2023-12-28 05:57:33,847][106226] Updated weights for policy 0, policy_version 1488516 (0.0008) [2023-12-28 05:57:33,883][106225] Updated weights for policy 1, policy_version 1492057 (0.0007) [2023-12-28 05:57:33,915][106226] Updated weights for policy 0, policy_version 1488526 (0.0008) [2023-12-28 05:57:33,942][106225] Updated weights for policy 1, policy_version 1492067 (0.0009) [2023-12-28 05:57:33,976][106226] Updated weights for policy 0, policy_version 1488536 (0.0009) [2023-12-28 05:57:34,003][106225] Updated weights for policy 1, policy_version 1492077 (0.0008) [2023-12-28 05:57:34,069][106225] Updated weights for policy 1, policy_version 1492087 (0.0009) [2023-12-28 05:57:34,655][106226] Updated weights for policy 0, policy_version 1488546 (0.0009) [2023-12-28 05:57:34,709][106226] Updated weights for policy 0, policy_version 1488556 (0.0010) [2023-12-28 05:57:34,754][106226] Updated weights for policy 0, policy_version 1488566 (0.0006) [2023-12-28 05:57:34,767][106225] Updated weights for policy 1, policy_version 1492097 (0.0010) [2023-12-28 05:57:34,832][106225] Updated weights for policy 1, policy_version 1492107 (0.0011) [2023-12-28 05:57:34,893][106225] Updated weights for policy 1, policy_version 1492117 (0.0010) [2023-12-28 05:57:35,490][106226] Updated weights for policy 0, policy_version 1488576 (0.0005) [2023-12-28 05:57:35,503][106225] Updated weights for policy 1, policy_version 1492127 (0.0007) [2023-12-28 05:57:35,550][106226] Updated weights for policy 0, policy_version 1488586 (0.0005) [2023-12-28 05:57:35,565][106225] Updated weights for policy 1, policy_version 1492137 (0.0008) [2023-12-28 05:57:35,614][106226] Updated weights for policy 0, policy_version 1488596 (0.0005) [2023-12-28 05:57:35,624][106225] Updated weights for policy 1, policy_version 1492147 (0.0007) [2023-12-28 05:57:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 763199488. Throughput: 0: 10123.1, 1: 9769.4. Samples: 763211560. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:36,175][105115] Avg episode reward: [(0, '-4.841'), (1, '-4.945')] [2023-12-28 05:57:36,276][106226] Updated weights for policy 0, policy_version 1488606 (0.0008) [2023-12-28 05:57:36,339][106226] Updated weights for policy 0, policy_version 1488616 (0.0009) [2023-12-28 05:57:36,355][106225] Updated weights for policy 1, policy_version 1492157 (0.0006) [2023-12-28 05:57:36,390][106226] Updated weights for policy 0, policy_version 1488626 (0.0008) [2023-12-28 05:57:36,408][106225] Updated weights for policy 1, policy_version 1492167 (0.0008) [2023-12-28 05:57:36,471][106225] Updated weights for policy 1, policy_version 1492177 (0.0006) [2023-12-28 05:57:37,052][106225] Updated weights for policy 1, policy_version 1492187 (0.0006) [2023-12-28 05:57:37,101][106225] Updated weights for policy 1, policy_version 1492197 (0.0008) [2023-12-28 05:57:37,147][106225] Updated weights for policy 1, policy_version 1492207 (0.0008) [2023-12-28 05:57:37,188][106226] Updated weights for policy 0, policy_version 1488636 (0.0008) [2023-12-28 05:57:37,246][106226] Updated weights for policy 0, policy_version 1488646 (0.0009) [2023-12-28 05:57:37,308][106226] Updated weights for policy 0, policy_version 1488656 (0.0008) [2023-12-28 05:57:37,932][106226] Updated weights for policy 0, policy_version 1488666 (0.0008) [2023-12-28 05:57:37,966][106225] Updated weights for policy 1, policy_version 1492217 (0.0008) [2023-12-28 05:57:38,001][106226] Updated weights for policy 0, policy_version 1488676 (0.0008) [2023-12-28 05:57:38,022][106225] Updated weights for policy 1, policy_version 1492227 (0.0008) [2023-12-28 05:57:38,058][106226] Updated weights for policy 0, policy_version 1488686 (0.0007) [2023-12-28 05:57:38,075][106225] Updated weights for policy 1, policy_version 1492237 (0.0008) [2023-12-28 05:57:38,117][106226] Updated weights for policy 0, policy_version 1488696 (0.0006) [2023-12-28 05:57:38,132][106225] Updated weights for policy 1, policy_version 1492247 (0.0007) [2023-12-28 05:57:38,833][106225] Updated weights for policy 1, policy_version 1492257 (0.0007) [2023-12-28 05:57:38,848][106226] Updated weights for policy 0, policy_version 1488706 (0.0008) [2023-12-28 05:57:38,886][106225] Updated weights for policy 1, policy_version 1492267 (0.0006) [2023-12-28 05:57:38,900][106226] Updated weights for policy 0, policy_version 1488716 (0.0007) [2023-12-28 05:57:38,939][106225] Updated weights for policy 1, policy_version 1492277 (0.0006) [2023-12-28 05:57:38,949][106226] Updated weights for policy 0, policy_version 1488726 (0.0005) [2023-12-28 05:57:39,671][106225] Updated weights for policy 1, policy_version 1492287 (0.0007) [2023-12-28 05:57:39,728][106225] Updated weights for policy 1, policy_version 1492297 (0.0007) [2023-12-28 05:57:39,756][106226] Updated weights for policy 0, policy_version 1488736 (0.0009) [2023-12-28 05:57:39,794][106225] Updated weights for policy 1, policy_version 1492307 (0.0007) [2023-12-28 05:57:39,822][106226] Updated weights for policy 0, policy_version 1488746 (0.0008) [2023-12-28 05:57:39,895][106226] Updated weights for policy 0, policy_version 1488756 (0.0009) [2023-12-28 05:57:40,423][106225] Updated weights for policy 1, policy_version 1492317 (0.0008) [2023-12-28 05:57:40,487][106225] Updated weights for policy 1, policy_version 1492327 (0.0009) [2023-12-28 05:57:40,547][106225] Updated weights for policy 1, policy_version 1492337 (0.0009) [2023-12-28 05:57:40,669][106226] Updated weights for policy 0, policy_version 1488766 (0.0007) [2023-12-28 05:57:40,729][106226] Updated weights for policy 0, policy_version 1488776 (0.0006) [2023-12-28 05:57:40,795][106226] Updated weights for policy 0, policy_version 1488786 (0.0009) [2023-12-28 05:57:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 763297792. Throughput: 0: 10070.3, 1: 9808.9. Samples: 763269924. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:41,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.719')] [2023-12-28 05:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001488792_381206528.pth... [2023-12-28 05:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001492344_382091264.pth... [2023-12-28 05:57:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001487640_380911616.pth [2023-12-28 05:57:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001491192_381796352.pth [2023-12-28 05:57:41,277][106225] Updated weights for policy 1, policy_version 1492347 (0.0008) [2023-12-28 05:57:41,348][106225] Updated weights for policy 1, policy_version 1492357 (0.0008) [2023-12-28 05:57:41,419][106225] Updated weights for policy 1, policy_version 1492367 (0.0008) [2023-12-28 05:57:41,493][106226] Updated weights for policy 0, policy_version 1488796 (0.0007) [2023-12-28 05:57:41,562][106226] Updated weights for policy 0, policy_version 1488806 (0.0008) [2023-12-28 05:57:41,656][106226] Updated weights for policy 0, policy_version 1488816 (0.0008) [2023-12-28 05:57:42,116][106225] Updated weights for policy 1, policy_version 1492377 (0.0008) [2023-12-28 05:57:42,182][106225] Updated weights for policy 1, policy_version 1492387 (0.0008) [2023-12-28 05:57:42,235][106225] Updated weights for policy 1, policy_version 1492397 (0.0008) [2023-12-28 05:57:42,299][106225] Updated weights for policy 1, policy_version 1492407 (0.0013) [2023-12-28 05:57:42,438][106226] Updated weights for policy 0, policy_version 1488826 (0.0008) [2023-12-28 05:57:42,491][106226] Updated weights for policy 0, policy_version 1488836 (0.0010) [2023-12-28 05:57:42,557][106226] Updated weights for policy 0, policy_version 1488846 (0.0010) [2023-12-28 05:57:42,621][106226] Updated weights for policy 0, policy_version 1488856 (0.0010) [2023-12-28 05:57:42,924][106225] Updated weights for policy 1, policy_version 1492417 (0.0006) [2023-12-28 05:57:42,973][106225] Updated weights for policy 1, policy_version 1492427 (0.0005) [2023-12-28 05:57:43,017][106225] Updated weights for policy 1, policy_version 1492437 (0.0005) [2023-12-28 05:57:43,430][106226] Updated weights for policy 0, policy_version 1488866 (0.0007) [2023-12-28 05:57:43,477][106226] Updated weights for policy 0, policy_version 1488876 (0.0008) [2023-12-28 05:57:43,528][106226] Updated weights for policy 0, policy_version 1488886 (0.0008) [2023-12-28 05:57:43,687][106225] Updated weights for policy 1, policy_version 1492447 (0.0010) [2023-12-28 05:57:43,733][106225] Updated weights for policy 1, policy_version 1492457 (0.0010) [2023-12-28 05:57:43,790][106225] Updated weights for policy 1, policy_version 1492467 (0.0010) [2023-12-28 05:57:44,203][106226] Updated weights for policy 0, policy_version 1488896 (0.0006) [2023-12-28 05:57:44,273][106226] Updated weights for policy 0, policy_version 1488906 (0.0005) [2023-12-28 05:57:44,344][106226] Updated weights for policy 0, policy_version 1488916 (0.0008) [2023-12-28 05:57:44,472][106225] Updated weights for policy 1, policy_version 1492477 (0.0006) [2023-12-28 05:57:44,543][106225] Updated weights for policy 1, policy_version 1492487 (0.0005) [2023-12-28 05:57:44,607][106225] Updated weights for policy 1, policy_version 1492497 (0.0005) [2023-12-28 05:57:45,029][106226] Updated weights for policy 0, policy_version 1488926 (0.0010) [2023-12-28 05:57:45,094][106226] Updated weights for policy 0, policy_version 1488936 (0.0009) [2023-12-28 05:57:45,168][106226] Updated weights for policy 0, policy_version 1488946 (0.0008) [2023-12-28 05:57:45,246][106225] Updated weights for policy 1, policy_version 1492507 (0.0008) [2023-12-28 05:57:45,312][106225] Updated weights for policy 1, policy_version 1492517 (0.0007) [2023-12-28 05:57:45,371][106225] Updated weights for policy 1, policy_version 1492527 (0.0008) [2023-12-28 05:57:45,891][106226] Updated weights for policy 0, policy_version 1488956 (0.0008) [2023-12-28 05:57:45,947][106226] Updated weights for policy 0, policy_version 1488966 (0.0008) [2023-12-28 05:57:45,994][106226] Updated weights for policy 0, policy_version 1488976 (0.0009) [2023-12-28 05:57:46,070][106225] Updated weights for policy 1, policy_version 1492537 (0.0007) [2023-12-28 05:57:46,125][106225] Updated weights for policy 1, policy_version 1492547 (0.0005) [2023-12-28 05:57:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 763396096. Throughput: 0: 9964.7, 1: 9837.9. Samples: 763386064. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-28 05:57:46,175][105115] Avg episode reward: [(0, '-4.732'), (1, '-4.676')] [2023-12-28 05:57:46,185][106225] Updated weights for policy 1, policy_version 1492557 (0.0009) [2023-12-28 05:57:46,239][106225] Updated weights for policy 1, policy_version 1492567 (0.0009) [2023-12-28 05:57:46,794][106225] Updated weights for policy 1, policy_version 1492577 (0.0010) [2023-12-28 05:57:46,819][106226] Updated weights for policy 0, policy_version 1488986 (0.0008) [2023-12-28 05:57:46,841][106225] Updated weights for policy 1, policy_version 1492587 (0.0010) [2023-12-28 05:57:46,884][106226] Updated weights for policy 0, policy_version 1488996 (0.0007) [2023-12-28 05:57:46,894][106225] Updated weights for policy 1, policy_version 1492597 (0.0006) [2023-12-28 05:57:46,938][106226] Updated weights for policy 0, policy_version 1489006 (0.0008) [2023-12-28 05:57:46,992][106226] Updated weights for policy 0, policy_version 1489016 (0.0009) [2023-12-28 05:57:47,449][106225] Updated weights for policy 1, policy_version 1492607 (0.0005) [2023-12-28 05:57:47,524][106225] Updated weights for policy 1, policy_version 1492617 (0.0005) [2023-12-28 05:57:47,581][106225] Updated weights for policy 1, policy_version 1492627 (0.0005) [2023-12-28 05:57:47,664][106226] Updated weights for policy 0, policy_version 1489026 (0.0008) [2023-12-28 05:57:47,718][106226] Updated weights for policy 0, policy_version 1489036 (0.0008) [2023-12-28 05:57:47,807][106226] Updated weights for policy 0, policy_version 1489046 (0.0009) [2023-12-28 05:57:48,150][106225] Updated weights for policy 1, policy_version 1492637 (0.0008) [2023-12-28 05:57:48,205][106225] Updated weights for policy 1, policy_version 1492647 (0.0010) [2023-12-28 05:57:48,263][106225] Updated weights for policy 1, policy_version 1492657 (0.0010) [2023-12-28 05:57:48,554][106226] Updated weights for policy 0, policy_version 1489056 (0.0008) [2023-12-28 05:57:48,616][106226] Updated weights for policy 0, policy_version 1489066 (0.0008) [2023-12-28 05:57:48,687][106226] Updated weights for policy 0, policy_version 1489076 (0.0008) [2023-12-28 05:57:48,958][106225] Updated weights for policy 1, policy_version 1492667 (0.0010) [2023-12-28 05:57:49,004][106225] Updated weights for policy 1, policy_version 1492677 (0.0008) [2023-12-28 05:57:49,060][106225] Updated weights for policy 1, policy_version 1492687 (0.0008) [2023-12-28 05:57:49,415][106226] Updated weights for policy 0, policy_version 1489086 (0.0009) [2023-12-28 05:57:49,484][106226] Updated weights for policy 0, policy_version 1489096 (0.0008) [2023-12-28 05:57:49,543][106226] Updated weights for policy 0, policy_version 1489106 (0.0009) [2023-12-28 05:57:49,755][106225] Updated weights for policy 1, policy_version 1492697 (0.0008) [2023-12-28 05:57:49,819][106225] Updated weights for policy 1, policy_version 1492707 (0.0007) [2023-12-28 05:57:49,887][106225] Updated weights for policy 1, policy_version 1492717 (0.0008) [2023-12-28 05:57:49,959][106225] Updated weights for policy 1, policy_version 1492727 (0.0008) [2023-12-28 05:57:50,283][106226] Updated weights for policy 0, policy_version 1489116 (0.0008) [2023-12-28 05:57:50,333][106226] Updated weights for policy 0, policy_version 1489126 (0.0005) [2023-12-28 05:57:50,400][106226] Updated weights for policy 0, policy_version 1489136 (0.0006) [2023-12-28 05:57:50,660][106225] Updated weights for policy 1, policy_version 1492737 (0.0007) [2023-12-28 05:57:50,722][106225] Updated weights for policy 1, policy_version 1492747 (0.0005) [2023-12-28 05:57:50,792][106225] Updated weights for policy 1, policy_version 1492757 (0.0006) [2023-12-28 05:57:50,997][106226] Updated weights for policy 0, policy_version 1489146 (0.0008) [2023-12-28 05:57:51,059][106226] Updated weights for policy 0, policy_version 1489156 (0.0009) [2023-12-28 05:57:51,126][106226] Updated weights for policy 0, policy_version 1489166 (0.0010) [2023-12-28 05:57:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 763494400. Throughput: 0: 9882.8, 1: 9967.1. Samples: 763507452. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:57:51,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.532')] [2023-12-28 05:57:51,200][106226] Updated weights for policy 0, policy_version 1489176 (0.0007) [2023-12-28 05:57:51,502][106225] Updated weights for policy 1, policy_version 1492767 (0.0009) [2023-12-28 05:57:51,565][106225] Updated weights for policy 1, policy_version 1492777 (0.0008) [2023-12-28 05:57:51,639][106225] Updated weights for policy 1, policy_version 1492787 (0.0008) [2023-12-28 05:57:51,911][106226] Updated weights for policy 0, policy_version 1489186 (0.0011) [2023-12-28 05:57:51,974][106226] Updated weights for policy 0, policy_version 1489196 (0.0010) [2023-12-28 05:57:52,038][106226] Updated weights for policy 0, policy_version 1489206 (0.0011) [2023-12-28 05:57:52,367][106225] Updated weights for policy 1, policy_version 1492797 (0.0008) [2023-12-28 05:57:52,431][106225] Updated weights for policy 1, policy_version 1492807 (0.0008) [2023-12-28 05:57:52,500][106225] Updated weights for policy 1, policy_version 1492817 (0.0005) [2023-12-28 05:57:52,755][106226] Updated weights for policy 0, policy_version 1489216 (0.0008) [2023-12-28 05:57:52,819][106226] Updated weights for policy 0, policy_version 1489226 (0.0011) [2023-12-28 05:57:52,879][106226] Updated weights for policy 0, policy_version 1489236 (0.0010) [2023-12-28 05:57:53,147][106225] Updated weights for policy 1, policy_version 1492827 (0.0005) [2023-12-28 05:57:53,215][106225] Updated weights for policy 1, policy_version 1492837 (0.0005) [2023-12-28 05:57:53,283][106225] Updated weights for policy 1, policy_version 1492847 (0.0005) [2023-12-28 05:57:53,402][106226] Updated weights for policy 0, policy_version 1489246 (0.0005) [2023-12-28 05:57:53,453][106226] Updated weights for policy 0, policy_version 1489256 (0.0005) [2023-12-28 05:57:53,510][106226] Updated weights for policy 0, policy_version 1489266 (0.0007) [2023-12-28 05:57:53,805][106225] Updated weights for policy 1, policy_version 1492857 (0.0006) [2023-12-28 05:57:53,865][106225] Updated weights for policy 1, policy_version 1492867 (0.0008) [2023-12-28 05:57:53,923][106225] Updated weights for policy 1, policy_version 1492877 (0.0007) [2023-12-28 05:57:53,976][106225] Updated weights for policy 1, policy_version 1492887 (0.0008) [2023-12-28 05:57:54,170][106226] Updated weights for policy 0, policy_version 1489276 (0.0010) [2023-12-28 05:57:54,216][106226] Updated weights for policy 0, policy_version 1489286 (0.0010) [2023-12-28 05:57:54,261][106226] Updated weights for policy 0, policy_version 1489296 (0.0010) [2023-12-28 05:57:54,666][106225] Updated weights for policy 1, policy_version 1492897 (0.0006) [2023-12-28 05:57:54,729][106225] Updated weights for policy 1, policy_version 1492907 (0.0006) [2023-12-28 05:57:54,794][106225] Updated weights for policy 1, policy_version 1492917 (0.0006) [2023-12-28 05:57:54,871][106226] Updated weights for policy 0, policy_version 1489306 (0.0010) [2023-12-28 05:57:54,937][106226] Updated weights for policy 0, policy_version 1489316 (0.0006) [2023-12-28 05:57:55,001][106226] Updated weights for policy 0, policy_version 1489326 (0.0011) [2023-12-28 05:57:55,063][106226] Updated weights for policy 0, policy_version 1489336 (0.0011) [2023-12-28 05:57:55,473][106225] Updated weights for policy 1, policy_version 1492927 (0.0009) [2023-12-28 05:57:55,530][106225] Updated weights for policy 1, policy_version 1492937 (0.0010) [2023-12-28 05:57:55,589][106225] Updated weights for policy 1, policy_version 1492947 (0.0010) [2023-12-28 05:57:55,738][106226] Updated weights for policy 0, policy_version 1489346 (0.0010) [2023-12-28 05:57:55,801][106226] Updated weights for policy 0, policy_version 1489356 (0.0010) [2023-12-28 05:57:55,860][106226] Updated weights for policy 0, policy_version 1489366 (0.0010) [2023-12-28 05:57:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 763600896. Throughput: 0: 9866.1, 1: 9993.0. Samples: 763569348. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:57:56,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.746')] [2023-12-28 05:57:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001489368_381353984.pth... [2023-12-28 05:57:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001492952_382246912.pth... [2023-12-28 05:57:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001488216_381059072.pth [2023-12-28 05:57:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001491768_381943808.pth [2023-12-28 05:57:56,285][106225] Updated weights for policy 1, policy_version 1492957 (0.0008) [2023-12-28 05:57:56,346][106225] Updated weights for policy 1, policy_version 1492967 (0.0005) [2023-12-28 05:57:56,409][106225] Updated weights for policy 1, policy_version 1492977 (0.0009) [2023-12-28 05:57:56,562][106226] Updated weights for policy 0, policy_version 1489376 (0.0010) [2023-12-28 05:57:56,623][106226] Updated weights for policy 0, policy_version 1489386 (0.0010) [2023-12-28 05:57:56,669][106226] Updated weights for policy 0, policy_version 1489396 (0.0010) [2023-12-28 05:57:56,979][106225] Updated weights for policy 1, policy_version 1492987 (0.0008) [2023-12-28 05:57:57,032][106225] Updated weights for policy 1, policy_version 1492997 (0.0009) [2023-12-28 05:57:57,087][106225] Updated weights for policy 1, policy_version 1493007 (0.0010) [2023-12-28 05:57:57,381][106226] Updated weights for policy 0, policy_version 1489406 (0.0010) [2023-12-28 05:57:57,450][106226] Updated weights for policy 0, policy_version 1489416 (0.0011) [2023-12-28 05:57:57,516][106226] Updated weights for policy 0, policy_version 1489426 (0.0010) [2023-12-28 05:57:57,721][106225] Updated weights for policy 1, policy_version 1493017 (0.0010) [2023-12-28 05:57:57,771][106225] Updated weights for policy 1, policy_version 1493027 (0.0007) [2023-12-28 05:57:57,824][106225] Updated weights for policy 1, policy_version 1493037 (0.0007) [2023-12-28 05:57:57,884][106225] Updated weights for policy 1, policy_version 1493047 (0.0008) [2023-12-28 05:57:58,137][106226] Updated weights for policy 0, policy_version 1489436 (0.0008) [2023-12-28 05:57:58,207][106226] Updated weights for policy 0, policy_version 1489446 (0.0006) [2023-12-28 05:57:58,276][106226] Updated weights for policy 0, policy_version 1489456 (0.0008) [2023-12-28 05:57:58,546][106225] Updated weights for policy 1, policy_version 1493057 (0.0008) [2023-12-28 05:57:58,612][106225] Updated weights for policy 1, policy_version 1493067 (0.0008) [2023-12-28 05:57:58,675][106225] Updated weights for policy 1, policy_version 1493077 (0.0008) [2023-12-28 05:57:59,051][106226] Updated weights for policy 0, policy_version 1489466 (0.0008) [2023-12-28 05:57:59,111][106226] Updated weights for policy 0, policy_version 1489476 (0.0008) [2023-12-28 05:57:59,161][106226] Updated weights for policy 0, policy_version 1489486 (0.0008) [2023-12-28 05:57:59,225][106226] Updated weights for policy 0, policy_version 1489496 (0.0008) [2023-12-28 05:57:59,483][106225] Updated weights for policy 1, policy_version 1493087 (0.0010) [2023-12-28 05:57:59,547][106225] Updated weights for policy 1, policy_version 1493097 (0.0010) [2023-12-28 05:57:59,597][106225] Updated weights for policy 1, policy_version 1493107 (0.0010) [2023-12-28 05:57:59,965][106226] Updated weights for policy 0, policy_version 1489506 (0.0012) [2023-12-28 05:58:00,033][106226] Updated weights for policy 0, policy_version 1489516 (0.0008) [2023-12-28 05:58:00,093][106226] Updated weights for policy 0, policy_version 1489526 (0.0010) [2023-12-28 05:58:00,279][106225] Updated weights for policy 1, policy_version 1493117 (0.0008) [2023-12-28 05:58:00,342][106225] Updated weights for policy 1, policy_version 1493127 (0.0008) [2023-12-28 05:58:00,408][106225] Updated weights for policy 1, policy_version 1493137 (0.0008) [2023-12-28 05:58:00,734][106226] Updated weights for policy 0, policy_version 1489536 (0.0008) [2023-12-28 05:58:00,781][106226] Updated weights for policy 0, policy_version 1489546 (0.0009) [2023-12-28 05:58:00,839][106226] Updated weights for policy 0, policy_version 1489556 (0.0009) [2023-12-28 05:58:01,029][106225] Updated weights for policy 1, policy_version 1493147 (0.0009) [2023-12-28 05:58:01,084][106225] Updated weights for policy 1, policy_version 1493157 (0.0009) [2023-12-28 05:58:01,148][106225] Updated weights for policy 1, policy_version 1493167 (0.0008) [2023-12-28 05:58:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 763699200. Throughput: 0: 9863.9, 1: 10085.4. Samples: 763690096. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:01,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-4.901')] [2023-12-28 05:58:01,635][106226] Updated weights for policy 0, policy_version 1489566 (0.0009) [2023-12-28 05:58:01,691][106226] Updated weights for policy 0, policy_version 1489576 (0.0007) [2023-12-28 05:58:01,757][106226] Updated weights for policy 0, policy_version 1489586 (0.0008) [2023-12-28 05:58:01,855][106225] Updated weights for policy 1, policy_version 1493177 (0.0007) [2023-12-28 05:58:01,919][106225] Updated weights for policy 1, policy_version 1493187 (0.0008) [2023-12-28 05:58:01,990][106225] Updated weights for policy 1, policy_version 1493197 (0.0009) [2023-12-28 05:58:02,054][106225] Updated weights for policy 1, policy_version 1493207 (0.0008) [2023-12-28 05:58:02,392][106226] Updated weights for policy 0, policy_version 1489596 (0.0008) [2023-12-28 05:58:02,461][106226] Updated weights for policy 0, policy_version 1489606 (0.0007) [2023-12-28 05:58:02,522][106226] Updated weights for policy 0, policy_version 1489616 (0.0006) [2023-12-28 05:58:02,825][106225] Updated weights for policy 1, policy_version 1493217 (0.0006) [2023-12-28 05:58:02,891][106225] Updated weights for policy 1, policy_version 1493227 (0.0005) [2023-12-28 05:58:02,959][106225] Updated weights for policy 1, policy_version 1493237 (0.0006) [2023-12-28 05:58:03,215][106226] Updated weights for policy 0, policy_version 1489626 (0.0006) [2023-12-28 05:58:03,262][106226] Updated weights for policy 0, policy_version 1489636 (0.0008) [2023-12-28 05:58:03,308][106226] Updated weights for policy 0, policy_version 1489646 (0.0008) [2023-12-28 05:58:03,356][106226] Updated weights for policy 0, policy_version 1489656 (0.0009) [2023-12-28 05:58:03,580][106225] Updated weights for policy 1, policy_version 1493247 (0.0006) [2023-12-28 05:58:03,632][106225] Updated weights for policy 1, policy_version 1493257 (0.0005) [2023-12-28 05:58:03,677][106225] Updated weights for policy 1, policy_version 1493267 (0.0005) [2023-12-28 05:58:04,244][106226] Updated weights for policy 0, policy_version 1489666 (0.0008) [2023-12-28 05:58:04,300][106226] Updated weights for policy 0, policy_version 1489676 (0.0008) [2023-12-28 05:58:04,325][106225] Updated weights for policy 1, policy_version 1493277 (0.0008) [2023-12-28 05:58:04,359][106226] Updated weights for policy 0, policy_version 1489686 (0.0006) [2023-12-28 05:58:04,390][106225] Updated weights for policy 1, policy_version 1493287 (0.0011) [2023-12-28 05:58:04,452][106225] Updated weights for policy 1, policy_version 1493297 (0.0010) [2023-12-28 05:58:05,070][106226] Updated weights for policy 0, policy_version 1489696 (0.0009) [2023-12-28 05:58:05,132][106226] Updated weights for policy 0, policy_version 1489706 (0.0008) [2023-12-28 05:58:05,173][106225] Updated weights for policy 1, policy_version 1493307 (0.0009) [2023-12-28 05:58:05,200][106226] Updated weights for policy 0, policy_version 1489716 (0.0008) [2023-12-28 05:58:05,228][106225] Updated weights for policy 1, policy_version 1493317 (0.0006) [2023-12-28 05:58:05,278][106225] Updated weights for policy 1, policy_version 1493327 (0.0008) [2023-12-28 05:58:05,878][106225] Updated weights for policy 1, policy_version 1493337 (0.0008) [2023-12-28 05:58:05,934][106225] Updated weights for policy 1, policy_version 1493347 (0.0005) [2023-12-28 05:58:05,979][106226] Updated weights for policy 0, policy_version 1489726 (0.0009) [2023-12-28 05:58:05,992][106225] Updated weights for policy 1, policy_version 1493357 (0.0005) [2023-12-28 05:58:06,037][106226] Updated weights for policy 0, policy_version 1489736 (0.0008) [2023-12-28 05:58:06,048][106225] Updated weights for policy 1, policy_version 1493367 (0.0005) [2023-12-28 05:58:06,091][106226] Updated weights for policy 0, policy_version 1489746 (0.0009) [2023-12-28 05:58:06,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 763805696. Throughput: 0: 9826.8, 1: 10136.4. Samples: 763808544. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:06,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.766')] [2023-12-28 05:58:06,681][106225] Updated weights for policy 1, policy_version 1493377 (0.0008) [2023-12-28 05:58:06,743][106225] Updated weights for policy 1, policy_version 1493387 (0.0007) [2023-12-28 05:58:06,794][106225] Updated weights for policy 1, policy_version 1493397 (0.0005) [2023-12-28 05:58:06,893][106226] Updated weights for policy 0, policy_version 1489756 (0.0007) [2023-12-28 05:58:06,963][106226] Updated weights for policy 0, policy_version 1489766 (0.0006) [2023-12-28 05:58:07,031][106226] Updated weights for policy 0, policy_version 1489776 (0.0005) [2023-12-28 05:58:07,450][106225] Updated weights for policy 1, policy_version 1493407 (0.0005) [2023-12-28 05:58:07,501][106225] Updated weights for policy 1, policy_version 1493417 (0.0005) [2023-12-28 05:58:07,554][106225] Updated weights for policy 1, policy_version 1493427 (0.0005) [2023-12-28 05:58:07,565][106226] Updated weights for policy 0, policy_version 1489786 (0.0005) [2023-12-28 05:58:07,618][106226] Updated weights for policy 0, policy_version 1489796 (0.0005) [2023-12-28 05:58:07,666][106226] Updated weights for policy 0, policy_version 1489806 (0.0010) [2023-12-28 05:58:07,719][106226] Updated weights for policy 0, policy_version 1489816 (0.0010) [2023-12-28 05:58:08,183][106225] Updated weights for policy 1, policy_version 1493437 (0.0008) [2023-12-28 05:58:08,236][106225] Updated weights for policy 1, policy_version 1493447 (0.0009) [2023-12-28 05:58:08,291][106225] Updated weights for policy 1, policy_version 1493457 (0.0009) [2023-12-28 05:58:08,349][106226] Updated weights for policy 0, policy_version 1489826 (0.0010) [2023-12-28 05:58:08,410][106226] Updated weights for policy 0, policy_version 1489836 (0.0007) [2023-12-28 05:58:08,463][106226] Updated weights for policy 0, policy_version 1489846 (0.0007) [2023-12-28 05:58:09,096][106225] Updated weights for policy 1, policy_version 1493467 (0.0007) [2023-12-28 05:58:09,119][106226] Updated weights for policy 0, policy_version 1489856 (0.0006) [2023-12-28 05:58:09,148][106225] Updated weights for policy 1, policy_version 1493477 (0.0007) [2023-12-28 05:58:09,190][106226] Updated weights for policy 0, policy_version 1489866 (0.0005) [2023-12-28 05:58:09,203][106225] Updated weights for policy 1, policy_version 1493487 (0.0008) [2023-12-28 05:58:09,261][106226] Updated weights for policy 0, policy_version 1489876 (0.0009) [2023-12-28 05:58:09,937][106226] Updated weights for policy 0, policy_version 1489886 (0.0011) [2023-12-28 05:58:09,976][106225] Updated weights for policy 1, policy_version 1493497 (0.0007) [2023-12-28 05:58:10,003][106226] Updated weights for policy 0, policy_version 1489896 (0.0010) [2023-12-28 05:58:10,036][106225] Updated weights for policy 1, policy_version 1493507 (0.0007) [2023-12-28 05:58:10,068][106226] Updated weights for policy 0, policy_version 1489906 (0.0009) [2023-12-28 05:58:10,102][106225] Updated weights for policy 1, policy_version 1493517 (0.0006) [2023-12-28 05:58:10,168][106225] Updated weights for policy 1, policy_version 1493527 (0.0006) [2023-12-28 05:58:10,759][106226] Updated weights for policy 0, policy_version 1489916 (0.0008) [2023-12-28 05:58:10,827][106226] Updated weights for policy 0, policy_version 1489926 (0.0011) [2023-12-28 05:58:10,859][106225] Updated weights for policy 1, policy_version 1493537 (0.0006) [2023-12-28 05:58:10,889][106226] Updated weights for policy 0, policy_version 1489936 (0.0011) [2023-12-28 05:58:10,914][106225] Updated weights for policy 1, policy_version 1493547 (0.0005) [2023-12-28 05:58:10,973][106225] Updated weights for policy 1, policy_version 1493557 (0.0006) [2023-12-28 05:58:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 763904000. Throughput: 0: 9912.8, 1: 10201.0. Samples: 763871956. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:11,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-4.964')] [2023-12-28 05:58:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001489944_381501440.pth... [2023-12-28 05:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001493560_382402560.pth... [2023-12-28 05:58:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001488792_381206528.pth [2023-12-28 05:58:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001492344_382091264.pth [2023-12-28 05:58:11,687][106225] Updated weights for policy 1, policy_version 1493567 (0.0009) [2023-12-28 05:58:11,700][106226] Updated weights for policy 0, policy_version 1489946 (0.0011) [2023-12-28 05:58:11,754][106225] Updated weights for policy 1, policy_version 1493577 (0.0009) [2023-12-28 05:58:11,768][106226] Updated weights for policy 0, policy_version 1489956 (0.0010) [2023-12-28 05:58:11,819][106225] Updated weights for policy 1, policy_version 1493587 (0.0009) [2023-12-28 05:58:11,830][106226] Updated weights for policy 0, policy_version 1489966 (0.0008) [2023-12-28 05:58:11,891][106226] Updated weights for policy 0, policy_version 1489976 (0.0011) [2023-12-28 05:58:12,499][106225] Updated weights for policy 1, policy_version 1493597 (0.0008) [2023-12-28 05:58:12,568][106225] Updated weights for policy 1, policy_version 1493607 (0.0008) [2023-12-28 05:58:12,596][106226] Updated weights for policy 0, policy_version 1489986 (0.0006) [2023-12-28 05:58:12,629][106225] Updated weights for policy 1, policy_version 1493617 (0.0007) [2023-12-28 05:58:12,657][106226] Updated weights for policy 0, policy_version 1489996 (0.0007) [2023-12-28 05:58:12,718][106226] Updated weights for policy 0, policy_version 1490006 (0.0010) [2023-12-28 05:58:13,278][106225] Updated weights for policy 1, policy_version 1493627 (0.0007) [2023-12-28 05:58:13,287][106226] Updated weights for policy 0, policy_version 1490016 (0.0011) [2023-12-28 05:58:13,327][106225] Updated weights for policy 1, policy_version 1493637 (0.0005) [2023-12-28 05:58:13,340][106226] Updated weights for policy 0, policy_version 1490026 (0.0010) [2023-12-28 05:58:13,383][106225] Updated weights for policy 1, policy_version 1493647 (0.0006) [2023-12-28 05:58:13,393][106226] Updated weights for policy 0, policy_version 1490036 (0.0010) [2023-12-28 05:58:13,979][106225] Updated weights for policy 1, policy_version 1493657 (0.0006) [2023-12-28 05:58:14,026][106225] Updated weights for policy 1, policy_version 1493667 (0.0006) [2023-12-28 05:58:14,044][106226] Updated weights for policy 0, policy_version 1490046 (0.0010) [2023-12-28 05:58:14,074][106225] Updated weights for policy 1, policy_version 1493677 (0.0005) [2023-12-28 05:58:14,091][106226] Updated weights for policy 0, policy_version 1490056 (0.0010) [2023-12-28 05:58:14,124][106225] Updated weights for policy 1, policy_version 1493687 (0.0006) [2023-12-28 05:58:14,148][106226] Updated weights for policy 0, policy_version 1490066 (0.0010) [2023-12-28 05:58:14,836][106226] Updated weights for policy 0, policy_version 1490076 (0.0011) [2023-12-28 05:58:14,881][106225] Updated weights for policy 1, policy_version 1493697 (0.0006) [2023-12-28 05:58:14,894][106226] Updated weights for policy 0, policy_version 1490086 (0.0011) [2023-12-28 05:58:14,940][106225] Updated weights for policy 1, policy_version 1493707 (0.0006) [2023-12-28 05:58:14,945][106226] Updated weights for policy 0, policy_version 1490096 (0.0010) [2023-12-28 05:58:15,003][106225] Updated weights for policy 1, policy_version 1493717 (0.0006) [2023-12-28 05:58:15,630][106226] Updated weights for policy 0, policy_version 1490106 (0.0011) [2023-12-28 05:58:15,689][106226] Updated weights for policy 0, policy_version 1490116 (0.0011) [2023-12-28 05:58:15,732][106225] Updated weights for policy 1, policy_version 1493727 (0.0007) [2023-12-28 05:58:15,746][106226] Updated weights for policy 0, policy_version 1490126 (0.0010) [2023-12-28 05:58:15,789][106225] Updated weights for policy 1, policy_version 1493737 (0.0005) [2023-12-28 05:58:15,805][106226] Updated weights for policy 0, policy_version 1490136 (0.0010) [2023-12-28 05:58:15,848][106225] Updated weights for policy 1, policy_version 1493747 (0.0008) [2023-12-28 05:58:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 764002304. Throughput: 0: 9823.9, 1: 10133.5. Samples: 763990232. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:16,176][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.516')] [2023-12-28 05:58:16,502][106226] Updated weights for policy 0, policy_version 1490146 (0.0011) [2023-12-28 05:58:16,506][106225] Updated weights for policy 1, policy_version 1493757 (0.0009) [2023-12-28 05:58:16,559][106225] Updated weights for policy 1, policy_version 1493767 (0.0008) [2023-12-28 05:58:16,560][106226] Updated weights for policy 0, policy_version 1490156 (0.0011) [2023-12-28 05:58:16,607][106225] Updated weights for policy 1, policy_version 1493777 (0.0007) [2023-12-28 05:58:16,619][106226] Updated weights for policy 0, policy_version 1490166 (0.0010) [2023-12-28 05:58:17,262][106225] Updated weights for policy 1, policy_version 1493787 (0.0008) [2023-12-28 05:58:17,317][106225] Updated weights for policy 1, policy_version 1493797 (0.0006) [2023-12-28 05:58:17,325][106226] Updated weights for policy 0, policy_version 1490176 (0.0011) [2023-12-28 05:58:17,376][106225] Updated weights for policy 1, policy_version 1493807 (0.0006) [2023-12-28 05:58:17,378][106226] Updated weights for policy 0, policy_version 1490186 (0.0010) [2023-12-28 05:58:17,424][106226] Updated weights for policy 0, policy_version 1490196 (0.0010) [2023-12-28 05:58:18,089][106226] Updated weights for policy 0, policy_version 1490206 (0.0010) [2023-12-28 05:58:18,139][106225] Updated weights for policy 1, policy_version 1493817 (0.0005) [2023-12-28 05:58:18,140][106226] Updated weights for policy 0, policy_version 1490216 (0.0010) [2023-12-28 05:58:18,188][106226] Updated weights for policy 0, policy_version 1490226 (0.0010) [2023-12-28 05:58:18,197][106225] Updated weights for policy 1, policy_version 1493827 (0.0006) [2023-12-28 05:58:18,251][106225] Updated weights for policy 1, policy_version 1493837 (0.0005) [2023-12-28 05:58:18,316][106225] Updated weights for policy 1, policy_version 1493847 (0.0007) [2023-12-28 05:58:18,916][106226] Updated weights for policy 0, policy_version 1490236 (0.0011) [2023-12-28 05:58:18,972][106226] Updated weights for policy 0, policy_version 1490246 (0.0010) [2023-12-28 05:58:18,978][106225] Updated weights for policy 1, policy_version 1493857 (0.0007) [2023-12-28 05:58:19,029][106226] Updated weights for policy 0, policy_version 1490256 (0.0011) [2023-12-28 05:58:19,039][106225] Updated weights for policy 1, policy_version 1493867 (0.0005) [2023-12-28 05:58:19,098][106225] Updated weights for policy 1, policy_version 1493877 (0.0008) [2023-12-28 05:58:19,787][106226] Updated weights for policy 0, policy_version 1490266 (0.0010) [2023-12-28 05:58:19,855][106226] Updated weights for policy 0, policy_version 1490276 (0.0009) [2023-12-28 05:58:19,883][106225] Updated weights for policy 1, policy_version 1493887 (0.0009) [2023-12-28 05:58:19,915][106226] Updated weights for policy 0, policy_version 1490286 (0.0006) [2023-12-28 05:58:19,942][106225] Updated weights for policy 1, policy_version 1493897 (0.0008) [2023-12-28 05:58:19,978][106226] Updated weights for policy 0, policy_version 1490296 (0.0008) [2023-12-28 05:58:20,009][106225] Updated weights for policy 1, policy_version 1493907 (0.0007) [2023-12-28 05:58:20,718][106225] Updated weights for policy 1, policy_version 1493917 (0.0007) [2023-12-28 05:58:20,735][106226] Updated weights for policy 0, policy_version 1490306 (0.0008) [2023-12-28 05:58:20,777][106225] Updated weights for policy 1, policy_version 1493927 (0.0006) [2023-12-28 05:58:20,800][106226] Updated weights for policy 0, policy_version 1490316 (0.0006) [2023-12-28 05:58:20,828][106225] Updated weights for policy 1, policy_version 1493937 (0.0008) [2023-12-28 05:58:20,863][106226] Updated weights for policy 0, policy_version 1490326 (0.0006) [2023-12-28 05:58:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 764100608. Throughput: 0: 9767.1, 1: 10156.4. Samples: 764108120. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:21,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-4.568')] [2023-12-28 05:58:21,544][106226] Updated weights for policy 0, policy_version 1490336 (0.0008) [2023-12-28 05:58:21,591][106225] Updated weights for policy 1, policy_version 1493947 (0.0008) [2023-12-28 05:58:21,614][106226] Updated weights for policy 0, policy_version 1490346 (0.0009) [2023-12-28 05:58:21,661][106225] Updated weights for policy 1, policy_version 1493957 (0.0008) [2023-12-28 05:58:21,681][106226] Updated weights for policy 0, policy_version 1490356 (0.0008) [2023-12-28 05:58:21,723][106225] Updated weights for policy 1, policy_version 1493967 (0.0006) [2023-12-28 05:58:22,413][106225] Updated weights for policy 1, policy_version 1493977 (0.0008) [2023-12-28 05:58:22,445][106226] Updated weights for policy 0, policy_version 1490366 (0.0008) [2023-12-28 05:58:22,470][106225] Updated weights for policy 1, policy_version 1493987 (0.0008) [2023-12-28 05:58:22,505][106226] Updated weights for policy 0, policy_version 1490376 (0.0006) [2023-12-28 05:58:22,531][106225] Updated weights for policy 1, policy_version 1493997 (0.0007) [2023-12-28 05:58:22,571][106226] Updated weights for policy 0, policy_version 1490386 (0.0006) [2023-12-28 05:58:22,588][106225] Updated weights for policy 1, policy_version 1494007 (0.0009) [2023-12-28 05:58:23,209][106226] Updated weights for policy 0, policy_version 1490396 (0.0006) [2023-12-28 05:58:23,255][106226] Updated weights for policy 0, policy_version 1490406 (0.0005) [2023-12-28 05:58:23,305][106226] Updated weights for policy 0, policy_version 1490416 (0.0005) [2023-12-28 05:58:23,340][106225] Updated weights for policy 1, policy_version 1494017 (0.0008) [2023-12-28 05:58:23,402][106225] Updated weights for policy 1, policy_version 1494027 (0.0009) [2023-12-28 05:58:23,451][106225] Updated weights for policy 1, policy_version 1494037 (0.0009) [2023-12-28 05:58:23,910][106226] Updated weights for policy 0, policy_version 1490426 (0.0005) [2023-12-28 05:58:23,955][106226] Updated weights for policy 0, policy_version 1490436 (0.0005) [2023-12-28 05:58:24,002][106226] Updated weights for policy 0, policy_version 1490446 (0.0006) [2023-12-28 05:58:24,053][106226] Updated weights for policy 0, policy_version 1490456 (0.0007) [2023-12-28 05:58:24,197][106225] Updated weights for policy 1, policy_version 1494047 (0.0009) [2023-12-28 05:58:24,253][106225] Updated weights for policy 1, policy_version 1494057 (0.0008) [2023-12-28 05:58:24,312][106225] Updated weights for policy 1, policy_version 1494067 (0.0009) [2023-12-28 05:58:24,745][106226] Updated weights for policy 0, policy_version 1490466 (0.0009) [2023-12-28 05:58:24,794][106226] Updated weights for policy 0, policy_version 1490476 (0.0008) [2023-12-28 05:58:24,849][106226] Updated weights for policy 0, policy_version 1490486 (0.0009) [2023-12-28 05:58:25,054][106225] Updated weights for policy 1, policy_version 1494077 (0.0009) [2023-12-28 05:58:25,101][106225] Updated weights for policy 1, policy_version 1494087 (0.0009) [2023-12-28 05:58:25,161][106225] Updated weights for policy 1, policy_version 1494097 (0.0009) [2023-12-28 05:58:25,567][106226] Updated weights for policy 0, policy_version 1490496 (0.0007) [2023-12-28 05:58:25,626][106226] Updated weights for policy 0, policy_version 1490506 (0.0008) [2023-12-28 05:58:25,675][106226] Updated weights for policy 0, policy_version 1490516 (0.0009) [2023-12-28 05:58:25,898][106225] Updated weights for policy 1, policy_version 1494107 (0.0008) [2023-12-28 05:58:25,956][106225] Updated weights for policy 1, policy_version 1494117 (0.0008) [2023-12-28 05:58:26,017][106225] Updated weights for policy 1, policy_version 1494127 (0.0008) [2023-12-28 05:58:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 764198912. Throughput: 0: 9819.8, 1: 10114.1. Samples: 764166952. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:26,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-4.651')] [2023-12-28 05:58:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001490520_381648896.pth... [2023-12-28 05:58:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001494136_382550016.pth... [2023-12-28 05:58:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001489368_381353984.pth [2023-12-28 05:58:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001492952_382246912.pth [2023-12-28 05:58:26,338][106226] Updated weights for policy 0, policy_version 1490526 (0.0010) [2023-12-28 05:58:26,393][106226] Updated weights for policy 0, policy_version 1490536 (0.0007) [2023-12-28 05:58:26,446][106226] Updated weights for policy 0, policy_version 1490546 (0.0008) [2023-12-28 05:58:26,825][106225] Updated weights for policy 1, policy_version 1494137 (0.0008) [2023-12-28 05:58:26,886][106225] Updated weights for policy 1, policy_version 1494147 (0.0008) [2023-12-28 05:58:26,941][106225] Updated weights for policy 1, policy_version 1494157 (0.0005) [2023-12-28 05:58:26,998][106225] Updated weights for policy 1, policy_version 1494167 (0.0007) [2023-12-28 05:58:27,059][106226] Updated weights for policy 0, policy_version 1490556 (0.0007) [2023-12-28 05:58:27,109][106226] Updated weights for policy 0, policy_version 1490566 (0.0010) [2023-12-28 05:58:27,155][106226] Updated weights for policy 0, policy_version 1490576 (0.0010) [2023-12-28 05:58:27,685][106225] Updated weights for policy 1, policy_version 1494177 (0.0010) [2023-12-28 05:58:27,732][106225] Updated weights for policy 1, policy_version 1494187 (0.0010) [2023-12-28 05:58:27,753][106226] Updated weights for policy 0, policy_version 1490586 (0.0009) [2023-12-28 05:58:27,784][106225] Updated weights for policy 1, policy_version 1494197 (0.0010) [2023-12-28 05:58:27,803][106226] Updated weights for policy 0, policy_version 1490596 (0.0005) [2023-12-28 05:58:27,858][106226] Updated weights for policy 0, policy_version 1490606 (0.0005) [2023-12-28 05:58:27,910][106226] Updated weights for policy 0, policy_version 1490616 (0.0010) [2023-12-28 05:58:28,512][106225] Updated weights for policy 1, policy_version 1494207 (0.0010) [2023-12-28 05:58:28,566][106225] Updated weights for policy 1, policy_version 1494217 (0.0010) [2023-12-28 05:58:28,590][106226] Updated weights for policy 0, policy_version 1490626 (0.0011) [2023-12-28 05:58:28,616][106225] Updated weights for policy 1, policy_version 1494227 (0.0010) [2023-12-28 05:58:28,647][106226] Updated weights for policy 0, policy_version 1490636 (0.0011) [2023-12-28 05:58:28,704][106226] Updated weights for policy 0, policy_version 1490646 (0.0007) [2023-12-28 05:58:29,204][106225] Updated weights for policy 1, policy_version 1494237 (0.0008) [2023-12-28 05:58:29,274][106225] Updated weights for policy 1, policy_version 1494247 (0.0008) [2023-12-28 05:58:29,344][106225] Updated weights for policy 1, policy_version 1494257 (0.0009) [2023-12-28 05:58:29,488][106226] Updated weights for policy 0, policy_version 1490656 (0.0007) [2023-12-28 05:58:29,552][106226] Updated weights for policy 0, policy_version 1490666 (0.0007) [2023-12-28 05:58:29,612][106226] Updated weights for policy 0, policy_version 1490676 (0.0006) [2023-12-28 05:58:30,035][106225] Updated weights for policy 1, policy_version 1494267 (0.0007) [2023-12-28 05:58:30,090][106225] Updated weights for policy 1, policy_version 1494277 (0.0009) [2023-12-28 05:58:30,155][106225] Updated weights for policy 1, policy_version 1494287 (0.0008) [2023-12-28 05:58:30,231][106226] Updated weights for policy 0, policy_version 1490686 (0.0006) [2023-12-28 05:58:30,302][106226] Updated weights for policy 0, policy_version 1490696 (0.0006) [2023-12-28 05:58:30,363][106226] Updated weights for policy 0, policy_version 1490706 (0.0009) [2023-12-28 05:58:30,784][106225] Updated weights for policy 1, policy_version 1494297 (0.0007) [2023-12-28 05:58:30,840][106225] Updated weights for policy 1, policy_version 1494307 (0.0008) [2023-12-28 05:58:30,900][106225] Updated weights for policy 1, policy_version 1494317 (0.0007) [2023-12-28 05:58:30,951][106225] Updated weights for policy 1, policy_version 1494327 (0.0007) [2023-12-28 05:58:31,049][106226] Updated weights for policy 0, policy_version 1490716 (0.0008) [2023-12-28 05:58:31,123][106226] Updated weights for policy 0, policy_version 1490726 (0.0008) [2023-12-28 05:58:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 764297216. Throughput: 0: 9978.4, 1: 10074.0. Samples: 764288420. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:31,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.648')] [2023-12-28 05:58:31,192][106226] Updated weights for policy 0, policy_version 1490736 (0.0008) [2023-12-28 05:58:31,751][106225] Updated weights for policy 1, policy_version 1494337 (0.0009) [2023-12-28 05:58:31,806][106225] Updated weights for policy 1, policy_version 1494347 (0.0008) [2023-12-28 05:58:31,867][106225] Updated weights for policy 1, policy_version 1494357 (0.0008) [2023-12-28 05:58:31,885][106226] Updated weights for policy 0, policy_version 1490746 (0.0006) [2023-12-28 05:58:31,951][106226] Updated weights for policy 0, policy_version 1490756 (0.0009) [2023-12-28 05:58:32,017][106226] Updated weights for policy 0, policy_version 1490766 (0.0009) [2023-12-28 05:58:32,075][106226] Updated weights for policy 0, policy_version 1490776 (0.0008) [2023-12-28 05:58:32,623][106225] Updated weights for policy 1, policy_version 1494367 (0.0006) [2023-12-28 05:58:32,696][106225] Updated weights for policy 1, policy_version 1494377 (0.0005) [2023-12-28 05:58:32,758][106225] Updated weights for policy 1, policy_version 1494387 (0.0006) [2023-12-28 05:58:32,813][106226] Updated weights for policy 0, policy_version 1490786 (0.0009) [2023-12-28 05:58:32,875][106226] Updated weights for policy 0, policy_version 1490796 (0.0010) [2023-12-28 05:58:32,937][106226] Updated weights for policy 0, policy_version 1490806 (0.0010) [2023-12-28 05:58:33,361][106225] Updated weights for policy 1, policy_version 1494397 (0.0008) [2023-12-28 05:58:33,419][106225] Updated weights for policy 1, policy_version 1494407 (0.0010) [2023-12-28 05:58:33,474][106225] Updated weights for policy 1, policy_version 1494417 (0.0010) [2023-12-28 05:58:33,686][106226] Updated weights for policy 0, policy_version 1490816 (0.0008) [2023-12-28 05:58:33,739][106226] Updated weights for policy 0, policy_version 1490826 (0.0008) [2023-12-28 05:58:33,785][106226] Updated weights for policy 0, policy_version 1490836 (0.0007) [2023-12-28 05:58:34,135][106225] Updated weights for policy 1, policy_version 1494427 (0.0009) [2023-12-28 05:58:34,200][106225] Updated weights for policy 1, policy_version 1494437 (0.0009) [2023-12-28 05:58:34,263][106225] Updated weights for policy 1, policy_version 1494447 (0.0010) [2023-12-28 05:58:34,614][106226] Updated weights for policy 0, policy_version 1490846 (0.0008) [2023-12-28 05:58:34,665][106226] Updated weights for policy 0, policy_version 1490856 (0.0008) [2023-12-28 05:58:34,719][106226] Updated weights for policy 0, policy_version 1490866 (0.0007) [2023-12-28 05:58:34,960][106225] Updated weights for policy 1, policy_version 1494457 (0.0010) [2023-12-28 05:58:35,011][106225] Updated weights for policy 1, policy_version 1494467 (0.0010) [2023-12-28 05:58:35,068][106225] Updated weights for policy 1, policy_version 1494477 (0.0010) [2023-12-28 05:58:35,121][106225] Updated weights for policy 1, policy_version 1494487 (0.0010) [2023-12-28 05:58:35,360][106226] Updated weights for policy 0, policy_version 1490876 (0.0007) [2023-12-28 05:58:35,421][106226] Updated weights for policy 0, policy_version 1490886 (0.0008) [2023-12-28 05:58:35,482][106226] Updated weights for policy 0, policy_version 1490896 (0.0008) [2023-12-28 05:58:35,851][106225] Updated weights for policy 1, policy_version 1494497 (0.0010) [2023-12-28 05:58:35,911][106225] Updated weights for policy 1, policy_version 1494507 (0.0010) [2023-12-28 05:58:35,970][106225] Updated weights for policy 1, policy_version 1494517 (0.0010) [2023-12-28 05:58:36,059][106226] Updated weights for policy 0, policy_version 1490906 (0.0008) [2023-12-28 05:58:36,126][106226] Updated weights for policy 0, policy_version 1490916 (0.0007) [2023-12-28 05:58:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 764395520. Throughput: 0: 10011.5, 1: 9985.3. Samples: 764407308. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:36,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.553')] [2023-12-28 05:58:36,193][106226] Updated weights for policy 0, policy_version 1490926 (0.0007) [2023-12-28 05:58:36,262][106226] Updated weights for policy 0, policy_version 1490936 (0.0009) [2023-12-28 05:58:36,673][106225] Updated weights for policy 1, policy_version 1494527 (0.0008) [2023-12-28 05:58:36,735][106225] Updated weights for policy 1, policy_version 1494537 (0.0009) [2023-12-28 05:58:36,793][106225] Updated weights for policy 1, policy_version 1494547 (0.0010) [2023-12-28 05:58:36,926][106226] Updated weights for policy 0, policy_version 1490946 (0.0007) [2023-12-28 05:58:36,992][106226] Updated weights for policy 0, policy_version 1490956 (0.0008) [2023-12-28 05:58:37,054][106226] Updated weights for policy 0, policy_version 1490966 (0.0008) [2023-12-28 05:58:37,445][106225] Updated weights for policy 1, policy_version 1494557 (0.0008) [2023-12-28 05:58:37,506][106225] Updated weights for policy 1, policy_version 1494567 (0.0010) [2023-12-28 05:58:37,569][106225] Updated weights for policy 1, policy_version 1494577 (0.0010) [2023-12-28 05:58:37,805][106226] Updated weights for policy 0, policy_version 1490976 (0.0008) [2023-12-28 05:58:37,866][106226] Updated weights for policy 0, policy_version 1490986 (0.0008) [2023-12-28 05:58:37,916][106226] Updated weights for policy 0, policy_version 1490996 (0.0008) [2023-12-28 05:58:38,249][106225] Updated weights for policy 1, policy_version 1494587 (0.0007) [2023-12-28 05:58:38,311][106225] Updated weights for policy 1, policy_version 1494597 (0.0008) [2023-12-28 05:58:38,374][106225] Updated weights for policy 1, policy_version 1494607 (0.0007) [2023-12-28 05:58:38,650][106226] Updated weights for policy 0, policy_version 1491006 (0.0008) [2023-12-28 05:58:38,709][106226] Updated weights for policy 0, policy_version 1491016 (0.0008) [2023-12-28 05:58:38,769][106226] Updated weights for policy 0, policy_version 1491026 (0.0009) [2023-12-28 05:58:39,087][106225] Updated weights for policy 1, policy_version 1494617 (0.0008) [2023-12-28 05:58:39,154][106225] Updated weights for policy 1, policy_version 1494627 (0.0009) [2023-12-28 05:58:39,214][106225] Updated weights for policy 1, policy_version 1494637 (0.0009) [2023-12-28 05:58:39,277][106225] Updated weights for policy 1, policy_version 1494647 (0.0010) [2023-12-28 05:58:39,526][106226] Updated weights for policy 0, policy_version 1491036 (0.0009) [2023-12-28 05:58:39,592][106226] Updated weights for policy 0, policy_version 1491046 (0.0011) [2023-12-28 05:58:39,656][106226] Updated weights for policy 0, policy_version 1491056 (0.0011) [2023-12-28 05:58:40,026][106225] Updated weights for policy 1, policy_version 1494657 (0.0008) [2023-12-28 05:58:40,093][106225] Updated weights for policy 1, policy_version 1494667 (0.0006) [2023-12-28 05:58:40,151][106225] Updated weights for policy 1, policy_version 1494677 (0.0006) [2023-12-28 05:58:40,399][106226] Updated weights for policy 0, policy_version 1491066 (0.0010) [2023-12-28 05:58:40,458][106226] Updated weights for policy 0, policy_version 1491076 (0.0009) [2023-12-28 05:58:40,517][106226] Updated weights for policy 0, policy_version 1491086 (0.0009) [2023-12-28 05:58:40,577][106226] Updated weights for policy 0, policy_version 1491096 (0.0007) [2023-12-28 05:58:40,769][106225] Updated weights for policy 1, policy_version 1494687 (0.0007) [2023-12-28 05:58:40,822][106225] Updated weights for policy 1, policy_version 1494697 (0.0007) [2023-12-28 05:58:40,884][106225] Updated weights for policy 1, policy_version 1494707 (0.0009) [2023-12-28 05:58:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 764493824. Throughput: 0: 9949.5, 1: 9969.6. Samples: 764465708. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:41,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-4.772')] [2023-12-28 05:58:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001494712_382697472.pth... [2023-12-28 05:58:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001491096_381796352.pth... [2023-12-28 05:58:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001493560_382402560.pth [2023-12-28 05:58:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001489944_381501440.pth [2023-12-28 05:58:41,281][106226] Updated weights for policy 0, policy_version 1491106 (0.0009) [2023-12-28 05:58:41,348][106226] Updated weights for policy 0, policy_version 1491116 (0.0008) [2023-12-28 05:58:41,422][106226] Updated weights for policy 0, policy_version 1491126 (0.0009) [2023-12-28 05:58:41,659][106225] Updated weights for policy 1, policy_version 1494717 (0.0009) [2023-12-28 05:58:41,720][106225] Updated weights for policy 1, policy_version 1494727 (0.0006) [2023-12-28 05:58:41,788][106225] Updated weights for policy 1, policy_version 1494737 (0.0008) [2023-12-28 05:58:42,180][106226] Updated weights for policy 0, policy_version 1491136 (0.0009) [2023-12-28 05:58:42,241][106226] Updated weights for policy 0, policy_version 1491146 (0.0008) [2023-12-28 05:58:42,305][106226] Updated weights for policy 0, policy_version 1491156 (0.0008) [2023-12-28 05:58:42,515][106225] Updated weights for policy 1, policy_version 1494747 (0.0008) [2023-12-28 05:58:42,570][106225] Updated weights for policy 1, policy_version 1494757 (0.0008) [2023-12-28 05:58:42,634][106225] Updated weights for policy 1, policy_version 1494767 (0.0008) [2023-12-28 05:58:43,014][106226] Updated weights for policy 0, policy_version 1491166 (0.0010) [2023-12-28 05:58:43,077][106226] Updated weights for policy 0, policy_version 1491176 (0.0010) [2023-12-28 05:58:43,143][106226] Updated weights for policy 0, policy_version 1491186 (0.0011) [2023-12-28 05:58:43,327][106225] Updated weights for policy 1, policy_version 1494777 (0.0008) [2023-12-28 05:58:43,382][106225] Updated weights for policy 1, policy_version 1494787 (0.0008) [2023-12-28 05:58:43,439][106225] Updated weights for policy 1, policy_version 1494797 (0.0008) [2023-12-28 05:58:43,499][106225] Updated weights for policy 1, policy_version 1494807 (0.0007) [2023-12-28 05:58:43,824][106226] Updated weights for policy 0, policy_version 1491196 (0.0008) [2023-12-28 05:58:43,881][106226] Updated weights for policy 0, policy_version 1491206 (0.0005) [2023-12-28 05:58:43,938][106226] Updated weights for policy 0, policy_version 1491216 (0.0005) [2023-12-28 05:58:44,239][106225] Updated weights for policy 1, policy_version 1494817 (0.0007) [2023-12-28 05:58:44,290][106225] Updated weights for policy 1, policy_version 1494827 (0.0006) [2023-12-28 05:58:44,348][106225] Updated weights for policy 1, policy_version 1494837 (0.0005) [2023-12-28 05:58:44,507][106226] Updated weights for policy 0, policy_version 1491226 (0.0006) [2023-12-28 05:58:44,558][106226] Updated weights for policy 0, policy_version 1491236 (0.0009) [2023-12-28 05:58:44,610][106226] Updated weights for policy 0, policy_version 1491246 (0.0009) [2023-12-28 05:58:44,660][106226] Updated weights for policy 0, policy_version 1491256 (0.0008) [2023-12-28 05:58:45,063][106225] Updated weights for policy 1, policy_version 1494847 (0.0007) [2023-12-28 05:58:45,116][106225] Updated weights for policy 1, policy_version 1494857 (0.0008) [2023-12-28 05:58:45,176][106225] Updated weights for policy 1, policy_version 1494867 (0.0008) [2023-12-28 05:58:45,350][106226] Updated weights for policy 0, policy_version 1491266 (0.0009) [2023-12-28 05:58:45,404][106226] Updated weights for policy 0, policy_version 1491276 (0.0008) [2023-12-28 05:58:45,457][106226] Updated weights for policy 0, policy_version 1491286 (0.0010) [2023-12-28 05:58:45,872][106225] Updated weights for policy 1, policy_version 1494877 (0.0008) [2023-12-28 05:58:45,931][106225] Updated weights for policy 1, policy_version 1494887 (0.0009) [2023-12-28 05:58:45,988][106225] Updated weights for policy 1, policy_version 1494897 (0.0008) [2023-12-28 05:58:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 764592128. Throughput: 0: 9921.8, 1: 9899.3. Samples: 764582044. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:46,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-4.588')] [2023-12-28 05:58:46,209][106226] Updated weights for policy 0, policy_version 1491296 (0.0006) [2023-12-28 05:58:46,257][106226] Updated weights for policy 0, policy_version 1491306 (0.0005) [2023-12-28 05:58:46,307][106226] Updated weights for policy 0, policy_version 1491316 (0.0005) [2023-12-28 05:58:46,744][106225] Updated weights for policy 1, policy_version 1494907 (0.0009) [2023-12-28 05:58:46,792][106225] Updated weights for policy 1, policy_version 1494917 (0.0008) [2023-12-28 05:58:46,837][106225] Updated weights for policy 1, policy_version 1494927 (0.0005) [2023-12-28 05:58:46,897][106226] Updated weights for policy 0, policy_version 1491326 (0.0008) [2023-12-28 05:58:46,961][106226] Updated weights for policy 0, policy_version 1491336 (0.0006) [2023-12-28 05:58:47,024][106226] Updated weights for policy 0, policy_version 1491346 (0.0006) [2023-12-28 05:58:47,423][106225] Updated weights for policy 1, policy_version 1494937 (0.0005) [2023-12-28 05:58:47,487][106225] Updated weights for policy 1, policy_version 1494947 (0.0009) [2023-12-28 05:58:47,534][106225] Updated weights for policy 1, policy_version 1494957 (0.0010) [2023-12-28 05:58:47,578][106225] Updated weights for policy 1, policy_version 1494967 (0.0006) [2023-12-28 05:58:47,636][106226] Updated weights for policy 0, policy_version 1491356 (0.0008) [2023-12-28 05:58:47,695][106226] Updated weights for policy 0, policy_version 1491366 (0.0010) [2023-12-28 05:58:47,761][106226] Updated weights for policy 0, policy_version 1491376 (0.0010) [2023-12-28 05:58:48,254][106225] Updated weights for policy 1, policy_version 1494977 (0.0010) [2023-12-28 05:58:48,314][106225] Updated weights for policy 1, policy_version 1494987 (0.0010) [2023-12-28 05:58:48,383][106225] Updated weights for policy 1, policy_version 1494997 (0.0011) [2023-12-28 05:58:48,425][106226] Updated weights for policy 0, policy_version 1491386 (0.0010) [2023-12-28 05:58:48,484][106226] Updated weights for policy 0, policy_version 1491396 (0.0008) [2023-12-28 05:58:48,548][106226] Updated weights for policy 0, policy_version 1491406 (0.0008) [2023-12-28 05:58:48,603][106226] Updated weights for policy 0, policy_version 1491416 (0.0008) [2023-12-28 05:58:49,099][106225] Updated weights for policy 1, policy_version 1495007 (0.0009) [2023-12-28 05:58:49,151][106225] Updated weights for policy 1, policy_version 1495017 (0.0010) [2023-12-28 05:58:49,211][106225] Updated weights for policy 1, policy_version 1495027 (0.0010) [2023-12-28 05:58:49,283][106226] Updated weights for policy 0, policy_version 1491426 (0.0007) [2023-12-28 05:58:49,341][106226] Updated weights for policy 0, policy_version 1491436 (0.0006) [2023-12-28 05:58:49,409][106226] Updated weights for policy 0, policy_version 1491446 (0.0008) [2023-12-28 05:58:49,936][106225] Updated weights for policy 1, policy_version 1495037 (0.0009) [2023-12-28 05:58:50,006][106225] Updated weights for policy 1, policy_version 1495047 (0.0006) [2023-12-28 05:58:50,074][106225] Updated weights for policy 1, policy_version 1495057 (0.0006) [2023-12-28 05:58:50,140][106226] Updated weights for policy 0, policy_version 1491456 (0.0009) [2023-12-28 05:58:50,208][106226] Updated weights for policy 0, policy_version 1491466 (0.0010) [2023-12-28 05:58:50,270][106226] Updated weights for policy 0, policy_version 1491476 (0.0009) [2023-12-28 05:58:50,631][106225] Updated weights for policy 1, policy_version 1495067 (0.0006) [2023-12-28 05:58:50,693][106225] Updated weights for policy 1, policy_version 1495077 (0.0009) [2023-12-28 05:58:50,754][106225] Updated weights for policy 1, policy_version 1495087 (0.0008) [2023-12-28 05:58:51,026][106226] Updated weights for policy 0, policy_version 1491486 (0.0009) [2023-12-28 05:58:51,092][106226] Updated weights for policy 0, policy_version 1491496 (0.0008) [2023-12-28 05:58:51,158][106226] Updated weights for policy 0, policy_version 1491506 (0.0009) [2023-12-28 05:58:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 764690432. Throughput: 0: 9997.9, 1: 9888.3. Samples: 764703420. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:51,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-4.942')] [2023-12-28 05:58:51,572][106225] Updated weights for policy 1, policy_version 1495097 (0.0009) [2023-12-28 05:58:51,642][106225] Updated weights for policy 1, policy_version 1495107 (0.0008) [2023-12-28 05:58:51,705][106225] Updated weights for policy 1, policy_version 1495117 (0.0008) [2023-12-28 05:58:51,771][106225] Updated weights for policy 1, policy_version 1495127 (0.0008) [2023-12-28 05:58:51,874][106226] Updated weights for policy 0, policy_version 1491516 (0.0005) [2023-12-28 05:58:51,942][106226] Updated weights for policy 0, policy_version 1491526 (0.0008) [2023-12-28 05:58:52,001][106226] Updated weights for policy 0, policy_version 1491536 (0.0006) [2023-12-28 05:58:52,421][106225] Updated weights for policy 1, policy_version 1495137 (0.0009) [2023-12-28 05:58:52,481][106225] Updated weights for policy 1, policy_version 1495147 (0.0009) [2023-12-28 05:58:52,545][106225] Updated weights for policy 1, policy_version 1495157 (0.0008) [2023-12-28 05:58:52,646][106226] Updated weights for policy 0, policy_version 1491546 (0.0006) [2023-12-28 05:58:52,712][106226] Updated weights for policy 0, policy_version 1491556 (0.0007) [2023-12-28 05:58:52,783][106226] Updated weights for policy 0, policy_version 1491566 (0.0008) [2023-12-28 05:58:52,848][106226] Updated weights for policy 0, policy_version 1491576 (0.0008) [2023-12-28 05:58:53,238][106225] Updated weights for policy 1, policy_version 1495167 (0.0010) [2023-12-28 05:58:53,289][106225] Updated weights for policy 1, policy_version 1495177 (0.0008) [2023-12-28 05:58:53,358][106225] Updated weights for policy 1, policy_version 1495187 (0.0005) [2023-12-28 05:58:53,405][106226] Updated weights for policy 0, policy_version 1491586 (0.0007) [2023-12-28 05:58:53,453][106226] Updated weights for policy 0, policy_version 1491596 (0.0008) [2023-12-28 05:58:53,508][106226] Updated weights for policy 0, policy_version 1491606 (0.0009) [2023-12-28 05:58:54,042][106225] Updated weights for policy 1, policy_version 1495197 (0.0007) [2023-12-28 05:58:54,097][106225] Updated weights for policy 1, policy_version 1495207 (0.0008) [2023-12-28 05:58:54,160][106225] Updated weights for policy 1, policy_version 1495217 (0.0008) [2023-12-28 05:58:54,222][106226] Updated weights for policy 0, policy_version 1491616 (0.0010) [2023-12-28 05:58:54,278][106226] Updated weights for policy 0, policy_version 1491626 (0.0011) [2023-12-28 05:58:54,331][106226] Updated weights for policy 0, policy_version 1491636 (0.0010) [2023-12-28 05:58:54,881][106225] Updated weights for policy 1, policy_version 1495227 (0.0007) [2023-12-28 05:58:54,939][106225] Updated weights for policy 1, policy_version 1495237 (0.0007) [2023-12-28 05:58:55,002][106225] Updated weights for policy 1, policy_version 1495247 (0.0008) [2023-12-28 05:58:55,077][106226] Updated weights for policy 0, policy_version 1491646 (0.0009) [2023-12-28 05:58:55,130][106226] Updated weights for policy 0, policy_version 1491656 (0.0009) [2023-12-28 05:58:55,184][106226] Updated weights for policy 0, policy_version 1491666 (0.0007) [2023-12-28 05:58:55,592][106225] Updated weights for policy 1, policy_version 1495257 (0.0008) [2023-12-28 05:58:55,650][106225] Updated weights for policy 1, policy_version 1495267 (0.0005) [2023-12-28 05:58:55,700][106225] Updated weights for policy 1, policy_version 1495277 (0.0005) [2023-12-28 05:58:55,753][106225] Updated weights for policy 1, policy_version 1495287 (0.0005) [2023-12-28 05:58:55,863][106226] Updated weights for policy 0, policy_version 1491676 (0.0007) [2023-12-28 05:58:55,915][106226] Updated weights for policy 0, policy_version 1491686 (0.0010) [2023-12-28 05:58:55,961][106226] Updated weights for policy 0, policy_version 1491696 (0.0010) [2023-12-28 05:58:56,175][105115] Fps is (10 sec: 20479.1, 60 sec: 19933.7, 300 sec: 19882.9). Total num frames: 764796928. Throughput: 0: 9978.7, 1: 9837.8. Samples: 764763704. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:58:56,176][105115] Avg episode reward: [(0, '-4.951'), (1, '-4.749')] [2023-12-28 05:58:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001491704_381952000.pth... [2023-12-28 05:58:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001495288_382844928.pth... [2023-12-28 05:58:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001490520_381648896.pth [2023-12-28 05:58:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001494136_382550016.pth [2023-12-28 05:58:56,392][106225] Updated weights for policy 1, policy_version 1495297 (0.0005) [2023-12-28 05:58:56,445][106225] Updated weights for policy 1, policy_version 1495307 (0.0005) [2023-12-28 05:58:56,508][106225] Updated weights for policy 1, policy_version 1495317 (0.0008) [2023-12-28 05:58:56,659][106226] Updated weights for policy 0, policy_version 1491706 (0.0008) [2023-12-28 05:58:56,719][106226] Updated weights for policy 0, policy_version 1491716 (0.0008) [2023-12-28 05:58:56,790][106226] Updated weights for policy 0, policy_version 1491726 (0.0008) [2023-12-28 05:58:56,846][106226] Updated weights for policy 0, policy_version 1491736 (0.0009) [2023-12-28 05:58:57,114][106225] Updated weights for policy 1, policy_version 1495327 (0.0009) [2023-12-28 05:58:57,171][106225] Updated weights for policy 1, policy_version 1495337 (0.0009) [2023-12-28 05:58:57,229][106225] Updated weights for policy 1, policy_version 1495347 (0.0010) [2023-12-28 05:58:57,427][106226] Updated weights for policy 0, policy_version 1491746 (0.0009) [2023-12-28 05:58:57,478][106226] Updated weights for policy 0, policy_version 1491756 (0.0008) [2023-12-28 05:58:57,529][106226] Updated weights for policy 0, policy_version 1491766 (0.0005) [2023-12-28 05:58:57,905][106225] Updated weights for policy 1, policy_version 1495357 (0.0007) [2023-12-28 05:58:57,950][106225] Updated weights for policy 1, policy_version 1495367 (0.0005) [2023-12-28 05:58:58,006][106225] Updated weights for policy 1, policy_version 1495377 (0.0005) [2023-12-28 05:58:58,125][106226] Updated weights for policy 0, policy_version 1491776 (0.0008) [2023-12-28 05:58:58,174][106226] Updated weights for policy 0, policy_version 1491786 (0.0009) [2023-12-28 05:58:58,233][106226] Updated weights for policy 0, policy_version 1491796 (0.0009) [2023-12-28 05:58:58,677][106225] Updated weights for policy 1, policy_version 1495387 (0.0006) [2023-12-28 05:58:58,737][106225] Updated weights for policy 1, policy_version 1495397 (0.0008) [2023-12-28 05:58:58,803][106225] Updated weights for policy 1, policy_version 1495407 (0.0008) [2023-12-28 05:58:59,170][106226] Updated weights for policy 0, policy_version 1491806 (0.0010) [2023-12-28 05:58:59,247][106226] Updated weights for policy 0, policy_version 1491816 (0.0011) [2023-12-28 05:58:59,308][106226] Updated weights for policy 0, policy_version 1491826 (0.0008) [2023-12-28 05:58:59,638][106225] Updated weights for policy 1, policy_version 1495417 (0.0008) [2023-12-28 05:58:59,727][106225] Updated weights for policy 1, policy_version 1495427 (0.0005) [2023-12-28 05:58:59,795][106225] Updated weights for policy 1, policy_version 1495437 (0.0005) [2023-12-28 05:58:59,861][106225] Updated weights for policy 1, policy_version 1495447 (0.0007) [2023-12-28 05:59:00,104][106226] Updated weights for policy 0, policy_version 1491836 (0.0008) [2023-12-28 05:59:00,160][106226] Updated weights for policy 0, policy_version 1491846 (0.0008) [2023-12-28 05:59:00,212][106226] Updated weights for policy 0, policy_version 1491856 (0.0008) [2023-12-28 05:59:00,484][106225] Updated weights for policy 1, policy_version 1495457 (0.0006) [2023-12-28 05:59:00,539][106225] Updated weights for policy 1, policy_version 1495467 (0.0005) [2023-12-28 05:59:00,584][106225] Updated weights for policy 1, policy_version 1495477 (0.0005) [2023-12-28 05:59:00,997][106226] Updated weights for policy 0, policy_version 1491866 (0.0008) [2023-12-28 05:59:01,059][106226] Updated weights for policy 0, policy_version 1491876 (0.0010) [2023-12-28 05:59:01,127][106226] Updated weights for policy 0, policy_version 1491886 (0.0008) [2023-12-28 05:59:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 764887040. Throughput: 0: 9970.3, 1: 9885.5. Samples: 764883740. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:01,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.704')] [2023-12-28 05:59:01,193][106226] Updated weights for policy 0, policy_version 1491896 (0.0009) [2023-12-28 05:59:01,228][106225] Updated weights for policy 1, policy_version 1495487 (0.0006) [2023-12-28 05:59:01,299][106225] Updated weights for policy 1, policy_version 1495497 (0.0007) [2023-12-28 05:59:01,369][106225] Updated weights for policy 1, policy_version 1495507 (0.0008) [2023-12-28 05:59:01,931][106226] Updated weights for policy 0, policy_version 1491906 (0.0008) [2023-12-28 05:59:01,987][106226] Updated weights for policy 0, policy_version 1491917 (0.0007) [2023-12-28 05:59:02,037][106226] Updated weights for policy 0, policy_version 1491927 (0.0007) [2023-12-28 05:59:02,042][106225] Updated weights for policy 1, policy_version 1495517 (0.0008) [2023-12-28 05:59:02,107][106225] Updated weights for policy 1, policy_version 1495527 (0.0008) [2023-12-28 05:59:02,173][106225] Updated weights for policy 1, policy_version 1495537 (0.0007) [2023-12-28 05:59:02,740][106226] Updated weights for policy 0, policy_version 1491937 (0.0010) [2023-12-28 05:59:02,806][106226] Updated weights for policy 0, policy_version 1491947 (0.0010) [2023-12-28 05:59:02,829][106225] Updated weights for policy 1, policy_version 1495547 (0.0008) [2023-12-28 05:59:02,863][106226] Updated weights for policy 0, policy_version 1491957 (0.0010) [2023-12-28 05:59:02,885][106225] Updated weights for policy 1, policy_version 1495557 (0.0010) [2023-12-28 05:59:02,942][106225] Updated weights for policy 1, policy_version 1495567 (0.0008) [2023-12-28 05:59:03,496][106226] Updated weights for policy 0, policy_version 1491967 (0.0007) [2023-12-28 05:59:03,554][106226] Updated weights for policy 0, policy_version 1491977 (0.0006) [2023-12-28 05:59:03,605][106226] Updated weights for policy 0, policy_version 1491987 (0.0008) [2023-12-28 05:59:03,672][106225] Updated weights for policy 1, policy_version 1495577 (0.0009) [2023-12-28 05:59:03,728][106225] Updated weights for policy 1, policy_version 1495587 (0.0007) [2023-12-28 05:59:03,782][106225] Updated weights for policy 1, policy_version 1495597 (0.0006) [2023-12-28 05:59:03,838][106225] Updated weights for policy 1, policy_version 1495607 (0.0006) [2023-12-28 05:59:04,316][106226] Updated weights for policy 0, policy_version 1491997 (0.0008) [2023-12-28 05:59:04,380][106226] Updated weights for policy 0, policy_version 1492007 (0.0010) [2023-12-28 05:59:04,437][106226] Updated weights for policy 0, policy_version 1492017 (0.0010) [2023-12-28 05:59:04,495][106225] Updated weights for policy 1, policy_version 1495617 (0.0007) [2023-12-28 05:59:04,560][106225] Updated weights for policy 1, policy_version 1495627 (0.0005) [2023-12-28 05:59:04,620][106225] Updated weights for policy 1, policy_version 1495637 (0.0008) [2023-12-28 05:59:05,097][106226] Updated weights for policy 0, policy_version 1492027 (0.0009) [2023-12-28 05:59:05,161][106226] Updated weights for policy 0, policy_version 1492037 (0.0010) [2023-12-28 05:59:05,220][106226] Updated weights for policy 0, policy_version 1492047 (0.0010) [2023-12-28 05:59:05,349][106225] Updated weights for policy 1, policy_version 1495647 (0.0011) [2023-12-28 05:59:05,409][106225] Updated weights for policy 1, policy_version 1495657 (0.0009) [2023-12-28 05:59:05,466][106225] Updated weights for policy 1, policy_version 1495667 (0.0008) [2023-12-28 05:59:05,894][106226] Updated weights for policy 0, policy_version 1492057 (0.0006) [2023-12-28 05:59:05,959][106226] Updated weights for policy 0, policy_version 1492067 (0.0009) [2023-12-28 05:59:06,019][106226] Updated weights for policy 0, policy_version 1492077 (0.0008) [2023-12-28 05:59:06,080][106226] Updated weights for policy 0, policy_version 1492087 (0.0006) [2023-12-28 05:59:06,174][105115] Fps is (10 sec: 19661.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 764993536. Throughput: 0: 9962.8, 1: 9911.6. Samples: 765002468. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:06,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-4.623')] [2023-12-28 05:59:06,178][106225] Updated weights for policy 1, policy_version 1495677 (0.0007) [2023-12-28 05:59:06,238][106225] Updated weights for policy 1, policy_version 1495687 (0.0007) [2023-12-28 05:59:06,307][106225] Updated weights for policy 1, policy_version 1495697 (0.0006) [2023-12-28 05:59:06,822][106226] Updated weights for policy 0, policy_version 1492097 (0.0010) [2023-12-28 05:59:06,869][106226] Updated weights for policy 0, policy_version 1492107 (0.0011) [2023-12-28 05:59:06,916][106226] Updated weights for policy 0, policy_version 1492117 (0.0010) [2023-12-28 05:59:06,968][106225] Updated weights for policy 1, policy_version 1495707 (0.0007) [2023-12-28 05:59:07,015][106225] Updated weights for policy 1, policy_version 1495717 (0.0010) [2023-12-28 05:59:07,062][106225] Updated weights for policy 1, policy_version 1495727 (0.0010) [2023-12-28 05:59:07,650][106226] Updated weights for policy 0, policy_version 1492127 (0.0008) [2023-12-28 05:59:07,697][106226] Updated weights for policy 0, policy_version 1492137 (0.0008) [2023-12-28 05:59:07,752][106226] Updated weights for policy 0, policy_version 1492147 (0.0007) [2023-12-28 05:59:07,820][106225] Updated weights for policy 1, policy_version 1495737 (0.0010) [2023-12-28 05:59:07,885][106225] Updated weights for policy 1, policy_version 1495747 (0.0011) [2023-12-28 05:59:07,941][106225] Updated weights for policy 1, policy_version 1495757 (0.0010) [2023-12-28 05:59:08,010][106225] Updated weights for policy 1, policy_version 1495767 (0.0010) [2023-12-28 05:59:08,441][106226] Updated weights for policy 0, policy_version 1492157 (0.0006) [2023-12-28 05:59:08,509][106226] Updated weights for policy 0, policy_version 1492167 (0.0006) [2023-12-28 05:59:08,575][106226] Updated weights for policy 0, policy_version 1492177 (0.0006) [2023-12-28 05:59:08,737][106225] Updated weights for policy 1, policy_version 1495777 (0.0006) [2023-12-28 05:59:08,787][106225] Updated weights for policy 1, policy_version 1495787 (0.0005) [2023-12-28 05:59:08,842][106225] Updated weights for policy 1, policy_version 1495797 (0.0008) [2023-12-28 05:59:09,175][106226] Updated weights for policy 0, policy_version 1492187 (0.0007) [2023-12-28 05:59:09,233][106226] Updated weights for policy 0, policy_version 1492197 (0.0006) [2023-12-28 05:59:09,295][106226] Updated weights for policy 0, policy_version 1492207 (0.0007) [2023-12-28 05:59:09,542][106225] Updated weights for policy 1, policy_version 1495807 (0.0006) [2023-12-28 05:59:09,604][106225] Updated weights for policy 1, policy_version 1495817 (0.0007) [2023-12-28 05:59:09,666][106225] Updated weights for policy 1, policy_version 1495827 (0.0008) [2023-12-28 05:59:10,064][106226] Updated weights for policy 0, policy_version 1492217 (0.0008) [2023-12-28 05:59:10,123][106226] Updated weights for policy 0, policy_version 1492227 (0.0009) [2023-12-28 05:59:10,181][106226] Updated weights for policy 0, policy_version 1492237 (0.0009) [2023-12-28 05:59:10,242][106226] Updated weights for policy 0, policy_version 1492247 (0.0009) [2023-12-28 05:59:10,386][106225] Updated weights for policy 1, policy_version 1495837 (0.0008) [2023-12-28 05:59:10,452][106225] Updated weights for policy 1, policy_version 1495847 (0.0008) [2023-12-28 05:59:10,503][106225] Updated weights for policy 1, policy_version 1495857 (0.0005) [2023-12-28 05:59:11,034][106226] Updated weights for policy 0, policy_version 1492257 (0.0006) [2023-12-28 05:59:11,110][106225] Updated weights for policy 1, policy_version 1495867 (0.0007) [2023-12-28 05:59:11,111][106226] Updated weights for policy 0, policy_version 1492267 (0.0007) [2023-12-28 05:59:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 765083648. Throughput: 0: 9952.4, 1: 9938.0. Samples: 765062016. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:11,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-4.751')] [2023-12-28 05:59:11,178][106226] Updated weights for policy 0, policy_version 1492277 (0.0008) [2023-12-28 05:59:11,180][106225] Updated weights for policy 1, policy_version 1495877 (0.0011) [2023-12-28 05:59:11,198][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001492280_382099456.pth... [2023-12-28 05:59:11,202][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001491096_381796352.pth [2023-12-28 05:59:11,241][106225] Updated weights for policy 1, policy_version 1495887 (0.0010) [2023-12-28 05:59:11,298][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001495896_383000576.pth... [2023-12-28 05:59:11,302][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001494712_382697472.pth [2023-12-28 05:59:11,918][106226] Updated weights for policy 0, policy_version 1492287 (0.0009) [2023-12-28 05:59:11,931][106225] Updated weights for policy 1, policy_version 1495897 (0.0010) [2023-12-28 05:59:11,983][106226] Updated weights for policy 0, policy_version 1492297 (0.0008) [2023-12-28 05:59:11,992][106225] Updated weights for policy 1, policy_version 1495907 (0.0005) [2023-12-28 05:59:12,043][106226] Updated weights for policy 0, policy_version 1492307 (0.0009) [2023-12-28 05:59:12,048][106225] Updated weights for policy 1, policy_version 1495917 (0.0006) [2023-12-28 05:59:12,103][106225] Updated weights for policy 1, policy_version 1495927 (0.0006) [2023-12-28 05:59:12,767][106225] Updated weights for policy 1, policy_version 1495937 (0.0009) [2023-12-28 05:59:12,823][106225] Updated weights for policy 1, policy_version 1495947 (0.0008) [2023-12-28 05:59:12,848][106226] Updated weights for policy 0, policy_version 1492317 (0.0009) [2023-12-28 05:59:12,884][106225] Updated weights for policy 1, policy_version 1495957 (0.0007) [2023-12-28 05:59:12,910][106226] Updated weights for policy 0, policy_version 1492327 (0.0008) [2023-12-28 05:59:12,970][106226] Updated weights for policy 0, policy_version 1492337 (0.0008) [2023-12-28 05:59:13,613][106225] Updated weights for policy 1, policy_version 1495967 (0.0007) [2023-12-28 05:59:13,669][106225] Updated weights for policy 1, policy_version 1495977 (0.0007) [2023-12-28 05:59:13,670][106226] Updated weights for policy 0, policy_version 1492347 (0.0008) [2023-12-28 05:59:13,718][106225] Updated weights for policy 1, policy_version 1495987 (0.0008) [2023-12-28 05:59:13,729][106226] Updated weights for policy 0, policy_version 1492357 (0.0005) [2023-12-28 05:59:13,790][106226] Updated weights for policy 0, policy_version 1492367 (0.0005) [2023-12-28 05:59:14,365][106226] Updated weights for policy 0, policy_version 1492377 (0.0006) [2023-12-28 05:59:14,424][106226] Updated weights for policy 0, policy_version 1492387 (0.0008) [2023-12-28 05:59:14,487][106226] Updated weights for policy 0, policy_version 1492397 (0.0008) [2023-12-28 05:59:14,504][106225] Updated weights for policy 1, policy_version 1495997 (0.0007) [2023-12-28 05:59:14,543][106226] Updated weights for policy 0, policy_version 1492407 (0.0007) [2023-12-28 05:59:14,554][106225] Updated weights for policy 1, policy_version 1496007 (0.0007) [2023-12-28 05:59:14,616][106225] Updated weights for policy 1, policy_version 1496017 (0.0008) [2023-12-28 05:59:15,248][106226] Updated weights for policy 0, policy_version 1492417 (0.0008) [2023-12-28 05:59:15,308][106226] Updated weights for policy 0, policy_version 1492427 (0.0008) [2023-12-28 05:59:15,368][106226] Updated weights for policy 0, policy_version 1492437 (0.0009) [2023-12-28 05:59:15,390][106225] Updated weights for policy 1, policy_version 1496027 (0.0009) [2023-12-28 05:59:15,438][106225] Updated weights for policy 1, policy_version 1496037 (0.0008) [2023-12-28 05:59:15,487][106225] Updated weights for policy 1, policy_version 1496047 (0.0008) [2023-12-28 05:59:16,083][106226] Updated weights for policy 0, policy_version 1492447 (0.0007) [2023-12-28 05:59:16,133][106226] Updated weights for policy 0, policy_version 1492457 (0.0008) [2023-12-28 05:59:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 765181952. Throughput: 0: 9828.6, 1: 9934.5. Samples: 765177760. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:16,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-4.647')] [2023-12-28 05:59:16,178][106226] Updated weights for policy 0, policy_version 1492467 (0.0008) [2023-12-28 05:59:16,238][106225] Updated weights for policy 1, policy_version 1496057 (0.0008) [2023-12-28 05:59:16,297][106225] Updated weights for policy 1, policy_version 1496067 (0.0008) [2023-12-28 05:59:16,355][106225] Updated weights for policy 1, policy_version 1496077 (0.0007) [2023-12-28 05:59:16,419][106225] Updated weights for policy 1, policy_version 1496087 (0.0008) [2023-12-28 05:59:16,934][106226] Updated weights for policy 0, policy_version 1492477 (0.0008) [2023-12-28 05:59:16,980][106226] Updated weights for policy 0, policy_version 1492487 (0.0007) [2023-12-28 05:59:17,034][106226] Updated weights for policy 0, policy_version 1492497 (0.0007) [2023-12-28 05:59:17,083][106225] Updated weights for policy 1, policy_version 1496097 (0.0010) [2023-12-28 05:59:17,139][106225] Updated weights for policy 1, policy_version 1496107 (0.0008) [2023-12-28 05:59:17,200][106225] Updated weights for policy 1, policy_version 1496117 (0.0010) [2023-12-28 05:59:17,816][106226] Updated weights for policy 0, policy_version 1492507 (0.0008) [2023-12-28 05:59:17,864][106225] Updated weights for policy 1, policy_version 1496127 (0.0010) [2023-12-28 05:59:17,879][106226] Updated weights for policy 0, policy_version 1492517 (0.0011) [2023-12-28 05:59:17,923][106225] Updated weights for policy 1, policy_version 1496137 (0.0009) [2023-12-28 05:59:17,937][106226] Updated weights for policy 0, policy_version 1492527 (0.0010) [2023-12-28 05:59:17,983][106225] Updated weights for policy 1, policy_version 1496147 (0.0010) [2023-12-28 05:59:18,643][106225] Updated weights for policy 1, policy_version 1496157 (0.0009) [2023-12-28 05:59:18,654][106226] Updated weights for policy 0, policy_version 1492537 (0.0010) [2023-12-28 05:59:18,697][106225] Updated weights for policy 1, policy_version 1496167 (0.0010) [2023-12-28 05:59:18,719][106226] Updated weights for policy 0, policy_version 1492547 (0.0006) [2023-12-28 05:59:18,760][106225] Updated weights for policy 1, policy_version 1496177 (0.0011) [2023-12-28 05:59:18,779][106226] Updated weights for policy 0, policy_version 1492557 (0.0007) [2023-12-28 05:59:18,842][106226] Updated weights for policy 0, policy_version 1492567 (0.0007) [2023-12-28 05:59:19,478][106225] Updated weights for policy 1, policy_version 1496187 (0.0010) [2023-12-28 05:59:19,542][106225] Updated weights for policy 1, policy_version 1496197 (0.0007) [2023-12-28 05:59:19,564][106226] Updated weights for policy 0, policy_version 1492577 (0.0007) [2023-12-28 05:59:19,599][106225] Updated weights for policy 1, policy_version 1496207 (0.0006) [2023-12-28 05:59:19,626][106226] Updated weights for policy 0, policy_version 1492587 (0.0007) [2023-12-28 05:59:19,689][106226] Updated weights for policy 0, policy_version 1492597 (0.0008) [2023-12-28 05:59:20,382][106225] Updated weights for policy 1, policy_version 1496217 (0.0008) [2023-12-28 05:59:20,439][106225] Updated weights for policy 1, policy_version 1496227 (0.0008) [2023-12-28 05:59:20,465][106226] Updated weights for policy 0, policy_version 1492607 (0.0008) [2023-12-28 05:59:20,492][106225] Updated weights for policy 1, policy_version 1496237 (0.0006) [2023-12-28 05:59:20,526][106226] Updated weights for policy 0, policy_version 1492617 (0.0010) [2023-12-28 05:59:20,541][106225] Updated weights for policy 1, policy_version 1496247 (0.0006) [2023-12-28 05:59:20,593][106226] Updated weights for policy 0, policy_version 1492627 (0.0010) [2023-12-28 05:59:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 765280256. Throughput: 0: 9754.2, 1: 9908.1. Samples: 765292112. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:21,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.604')] [2023-12-28 05:59:21,370][106225] Updated weights for policy 1, policy_version 1496257 (0.0009) [2023-12-28 05:59:21,372][106226] Updated weights for policy 0, policy_version 1492637 (0.0010) [2023-12-28 05:59:21,431][106225] Updated weights for policy 1, policy_version 1496267 (0.0007) [2023-12-28 05:59:21,441][106226] Updated weights for policy 0, policy_version 1492647 (0.0008) [2023-12-28 05:59:21,489][106225] Updated weights for policy 1, policy_version 1496277 (0.0007) [2023-12-28 05:59:21,507][106226] Updated weights for policy 0, policy_version 1492657 (0.0007) [2023-12-28 05:59:22,266][106225] Updated weights for policy 1, policy_version 1496287 (0.0008) [2023-12-28 05:59:22,293][106226] Updated weights for policy 0, policy_version 1492667 (0.0009) [2023-12-28 05:59:22,331][106225] Updated weights for policy 1, policy_version 1496297 (0.0007) [2023-12-28 05:59:22,361][106226] Updated weights for policy 0, policy_version 1492677 (0.0011) [2023-12-28 05:59:22,396][106225] Updated weights for policy 1, policy_version 1496307 (0.0007) [2023-12-28 05:59:22,430][106226] Updated weights for policy 0, policy_version 1492687 (0.0010) [2023-12-28 05:59:23,141][106226] Updated weights for policy 0, policy_version 1492697 (0.0010) [2023-12-28 05:59:23,159][106225] Updated weights for policy 1, policy_version 1496317 (0.0007) [2023-12-28 05:59:23,202][106226] Updated weights for policy 0, policy_version 1492707 (0.0010) [2023-12-28 05:59:23,209][106225] Updated weights for policy 1, policy_version 1496327 (0.0006) [2023-12-28 05:59:23,260][106226] Updated weights for policy 0, policy_version 1492717 (0.0010) [2023-12-28 05:59:23,262][106225] Updated weights for policy 1, policy_version 1496337 (0.0007) [2023-12-28 05:59:23,320][106226] Updated weights for policy 0, policy_version 1492727 (0.0010) [2023-12-28 05:59:23,903][106225] Updated weights for policy 1, policy_version 1496347 (0.0007) [2023-12-28 05:59:23,950][106226] Updated weights for policy 0, policy_version 1492737 (0.0006) [2023-12-28 05:59:23,960][106225] Updated weights for policy 1, policy_version 1496357 (0.0006) [2023-12-28 05:59:23,996][106226] Updated weights for policy 0, policy_version 1492747 (0.0006) [2023-12-28 05:59:24,024][106225] Updated weights for policy 1, policy_version 1496367 (0.0010) [2023-12-28 05:59:24,048][106226] Updated weights for policy 0, policy_version 1492757 (0.0005) [2023-12-28 05:59:24,572][106226] Updated weights for policy 0, policy_version 1492767 (0.0005) [2023-12-28 05:59:24,633][106226] Updated weights for policy 0, policy_version 1492777 (0.0006) [2023-12-28 05:59:24,678][106225] Updated weights for policy 1, policy_version 1496377 (0.0010) [2023-12-28 05:59:24,694][106226] Updated weights for policy 0, policy_version 1492787 (0.0009) [2023-12-28 05:59:24,726][106225] Updated weights for policy 1, policy_version 1496387 (0.0005) [2023-12-28 05:59:24,774][106225] Updated weights for policy 1, policy_version 1496397 (0.0005) [2023-12-28 05:59:24,820][106225] Updated weights for policy 1, policy_version 1496407 (0.0005) [2023-12-28 05:59:25,408][106225] Updated weights for policy 1, policy_version 1496417 (0.0010) [2023-12-28 05:59:25,444][106226] Updated weights for policy 0, policy_version 1492797 (0.0008) [2023-12-28 05:59:25,461][106225] Updated weights for policy 1, policy_version 1496427 (0.0010) [2023-12-28 05:59:25,495][106226] Updated weights for policy 0, policy_version 1492807 (0.0006) [2023-12-28 05:59:25,511][106225] Updated weights for policy 1, policy_version 1496437 (0.0007) [2023-12-28 05:59:25,549][106226] Updated weights for policy 0, policy_version 1492817 (0.0009) [2023-12-28 05:59:26,127][106225] Updated weights for policy 1, policy_version 1496447 (0.0005) [2023-12-28 05:59:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 765378560. Throughput: 0: 9775.3, 1: 9865.9. Samples: 765349568. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:26,176][105115] Avg episode reward: [(0, '-4.684'), (1, '-5.061')] [2023-12-28 05:59:26,177][106225] Updated weights for policy 1, policy_version 1496457 (0.0006) [2023-12-28 05:59:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001492824_382238720.pth... [2023-12-28 05:59:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001491704_381952000.pth [2023-12-28 05:59:26,241][106225] Updated weights for policy 1, policy_version 1496467 (0.0010) [2023-12-28 05:59:26,270][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001496472_383148032.pth... [2023-12-28 05:59:26,273][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001495288_382844928.pth [2023-12-28 05:59:26,354][106226] Updated weights for policy 0, policy_version 1492827 (0.0010) [2023-12-28 05:59:26,406][106226] Updated weights for policy 0, policy_version 1492837 (0.0008) [2023-12-28 05:59:26,452][106226] Updated weights for policy 0, policy_version 1492847 (0.0007) [2023-12-28 05:59:26,885][106225] Updated weights for policy 1, policy_version 1496477 (0.0008) [2023-12-28 05:59:26,943][106225] Updated weights for policy 1, policy_version 1496487 (0.0010) [2023-12-28 05:59:27,008][106225] Updated weights for policy 1, policy_version 1496497 (0.0010) [2023-12-28 05:59:27,233][106226] Updated weights for policy 0, policy_version 1492857 (0.0007) [2023-12-28 05:59:27,302][106226] Updated weights for policy 0, policy_version 1492867 (0.0006) [2023-12-28 05:59:27,356][106226] Updated weights for policy 0, policy_version 1492877 (0.0008) [2023-12-28 05:59:27,405][106226] Updated weights for policy 0, policy_version 1492887 (0.0008) [2023-12-28 05:59:27,542][106225] Updated weights for policy 1, policy_version 1496507 (0.0005) [2023-12-28 05:59:27,592][106225] Updated weights for policy 1, policy_version 1496517 (0.0005) [2023-12-28 05:59:27,635][106225] Updated weights for policy 1, policy_version 1496527 (0.0005) [2023-12-28 05:59:28,158][106226] Updated weights for policy 0, policy_version 1492897 (0.0009) [2023-12-28 05:59:28,168][106225] Updated weights for policy 1, policy_version 1496537 (0.0005) [2023-12-28 05:59:28,216][106226] Updated weights for policy 0, policy_version 1492907 (0.0009) [2023-12-28 05:59:28,225][106225] Updated weights for policy 1, policy_version 1496547 (0.0005) [2023-12-28 05:59:28,274][106226] Updated weights for policy 0, policy_version 1492917 (0.0009) [2023-12-28 05:59:28,276][106225] Updated weights for policy 1, policy_version 1496557 (0.0006) [2023-12-28 05:59:28,342][106225] Updated weights for policy 1, policy_version 1496567 (0.0007) [2023-12-28 05:59:28,944][106225] Updated weights for policy 1, policy_version 1496577 (0.0009) [2023-12-28 05:59:28,997][106225] Updated weights for policy 1, policy_version 1496587 (0.0006) [2023-12-28 05:59:29,008][106226] Updated weights for policy 0, policy_version 1492927 (0.0006) [2023-12-28 05:59:29,044][106225] Updated weights for policy 1, policy_version 1496597 (0.0005) [2023-12-28 05:59:29,067][106226] Updated weights for policy 0, policy_version 1492937 (0.0005) [2023-12-28 05:59:29,128][106226] Updated weights for policy 0, policy_version 1492947 (0.0006) [2023-12-28 05:59:29,697][106225] Updated weights for policy 1, policy_version 1496607 (0.0005) [2023-12-28 05:59:29,756][106225] Updated weights for policy 1, policy_version 1496617 (0.0009) [2023-12-28 05:59:29,790][106226] Updated weights for policy 0, policy_version 1492957 (0.0009) [2023-12-28 05:59:29,803][106225] Updated weights for policy 1, policy_version 1496627 (0.0007) [2023-12-28 05:59:29,870][106226] Updated weights for policy 0, policy_version 1492967 (0.0010) [2023-12-28 05:59:29,937][106226] Updated weights for policy 0, policy_version 1492977 (0.0009) [2023-12-28 05:59:30,532][106225] Updated weights for policy 1, policy_version 1496637 (0.0008) [2023-12-28 05:59:30,578][106225] Updated weights for policy 1, policy_version 1496647 (0.0005) [2023-12-28 05:59:30,632][106225] Updated weights for policy 1, policy_version 1496657 (0.0006) [2023-12-28 05:59:30,649][106226] Updated weights for policy 0, policy_version 1492987 (0.0007) [2023-12-28 05:59:30,699][106226] Updated weights for policy 0, policy_version 1492997 (0.0005) [2023-12-28 05:59:30,753][106226] Updated weights for policy 0, policy_version 1493007 (0.0005) [2023-12-28 05:59:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 765485056. Throughput: 0: 9760.9, 1: 10092.1. Samples: 765475428. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:31,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.733')] [2023-12-28 05:59:31,269][106225] Updated weights for policy 1, policy_version 1496667 (0.0007) [2023-12-28 05:59:31,333][106225] Updated weights for policy 1, policy_version 1496677 (0.0010) [2023-12-28 05:59:31,356][106226] Updated weights for policy 0, policy_version 1493017 (0.0006) [2023-12-28 05:59:31,409][106225] Updated weights for policy 1, policy_version 1496687 (0.0009) [2023-12-28 05:59:31,432][106226] Updated weights for policy 0, policy_version 1493027 (0.0008) [2023-12-28 05:59:31,484][106226] Updated weights for policy 0, policy_version 1493037 (0.0007) [2023-12-28 05:59:31,532][106226] Updated weights for policy 0, policy_version 1493047 (0.0008) [2023-12-28 05:59:32,055][106225] Updated weights for policy 1, policy_version 1496697 (0.0007) [2023-12-28 05:59:32,101][106225] Updated weights for policy 1, policy_version 1496707 (0.0005) [2023-12-28 05:59:32,163][106225] Updated weights for policy 1, policy_version 1496717 (0.0005) [2023-12-28 05:59:32,216][106225] Updated weights for policy 1, policy_version 1496727 (0.0006) [2023-12-28 05:59:32,288][106226] Updated weights for policy 0, policy_version 1493057 (0.0007) [2023-12-28 05:59:32,352][106226] Updated weights for policy 0, policy_version 1493067 (0.0008) [2023-12-28 05:59:32,418][106226] Updated weights for policy 0, policy_version 1493077 (0.0006) [2023-12-28 05:59:32,899][106225] Updated weights for policy 1, policy_version 1496737 (0.0006) [2023-12-28 05:59:32,960][106225] Updated weights for policy 1, policy_version 1496747 (0.0008) [2023-12-28 05:59:33,023][106225] Updated weights for policy 1, policy_version 1496757 (0.0008) [2023-12-28 05:59:33,050][106226] Updated weights for policy 0, policy_version 1493088 (0.0007) [2023-12-28 05:59:33,105][106226] Updated weights for policy 0, policy_version 1493098 (0.0005) [2023-12-28 05:59:33,159][106226] Updated weights for policy 0, policy_version 1493108 (0.0007) [2023-12-28 05:59:33,758][106225] Updated weights for policy 1, policy_version 1496767 (0.0008) [2023-12-28 05:59:33,789][106226] Updated weights for policy 0, policy_version 1493118 (0.0005) [2023-12-28 05:59:33,815][106225] Updated weights for policy 1, policy_version 1496777 (0.0007) [2023-12-28 05:59:33,836][106226] Updated weights for policy 0, policy_version 1493128 (0.0006) [2023-12-28 05:59:33,868][106225] Updated weights for policy 1, policy_version 1496787 (0.0005) [2023-12-28 05:59:33,893][106226] Updated weights for policy 0, policy_version 1493138 (0.0006) [2023-12-28 05:59:34,503][106225] Updated weights for policy 1, policy_version 1496797 (0.0007) [2023-12-28 05:59:34,568][106225] Updated weights for policy 1, policy_version 1496807 (0.0010) [2023-12-28 05:59:34,600][106226] Updated weights for policy 0, policy_version 1493148 (0.0006) [2023-12-28 05:59:34,626][106225] Updated weights for policy 1, policy_version 1496817 (0.0008) [2023-12-28 05:59:34,666][106226] Updated weights for policy 0, policy_version 1493158 (0.0006) [2023-12-28 05:59:34,726][106226] Updated weights for policy 0, policy_version 1493168 (0.0008) [2023-12-28 05:59:35,354][106226] Updated weights for policy 0, policy_version 1493178 (0.0008) [2023-12-28 05:59:35,408][106225] Updated weights for policy 1, policy_version 1496827 (0.0008) [2023-12-28 05:59:35,413][106226] Updated weights for policy 0, policy_version 1493188 (0.0009) [2023-12-28 05:59:35,471][106225] Updated weights for policy 1, policy_version 1496837 (0.0008) [2023-12-28 05:59:35,473][106226] Updated weights for policy 0, policy_version 1493198 (0.0006) [2023-12-28 05:59:35,527][106225] Updated weights for policy 1, policy_version 1496847 (0.0006) [2023-12-28 05:59:35,532][106226] Updated weights for policy 0, policy_version 1493208 (0.0009) [2023-12-28 05:59:36,139][106226] Updated weights for policy 0, policy_version 1493218 (0.0010) [2023-12-28 05:59:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 765583360. Throughput: 0: 9820.4, 1: 10047.2. Samples: 765597464. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:36,175][105115] Avg episode reward: [(0, '-4.628'), (1, '-5.103')] [2023-12-28 05:59:36,200][106226] Updated weights for policy 0, policy_version 1493228 (0.0011) [2023-12-28 05:59:36,258][106226] Updated weights for policy 0, policy_version 1493238 (0.0011) [2023-12-28 05:59:36,344][106225] Updated weights for policy 1, policy_version 1496857 (0.0008) [2023-12-28 05:59:36,408][106225] Updated weights for policy 1, policy_version 1496867 (0.0008) [2023-12-28 05:59:36,468][106225] Updated weights for policy 1, policy_version 1496877 (0.0008) [2023-12-28 05:59:36,521][106225] Updated weights for policy 1, policy_version 1496887 (0.0010) [2023-12-28 05:59:36,994][106226] Updated weights for policy 0, policy_version 1493248 (0.0009) [2023-12-28 05:59:37,046][106226] Updated weights for policy 0, policy_version 1493258 (0.0005) [2023-12-28 05:59:37,096][106226] Updated weights for policy 0, policy_version 1493268 (0.0010) [2023-12-28 05:59:37,210][106225] Updated weights for policy 1, policy_version 1496897 (0.0008) [2023-12-28 05:59:37,258][106225] Updated weights for policy 1, policy_version 1496907 (0.0010) [2023-12-28 05:59:37,319][106225] Updated weights for policy 1, policy_version 1496917 (0.0010) [2023-12-28 05:59:37,744][106226] Updated weights for policy 0, policy_version 1493278 (0.0009) [2023-12-28 05:59:37,792][106226] Updated weights for policy 0, policy_version 1493288 (0.0010) [2023-12-28 05:59:37,847][106226] Updated weights for policy 0, policy_version 1493298 (0.0010) [2023-12-28 05:59:38,040][106225] Updated weights for policy 1, policy_version 1496927 (0.0007) [2023-12-28 05:59:38,096][106225] Updated weights for policy 1, policy_version 1496937 (0.0005) [2023-12-28 05:59:38,152][106225] Updated weights for policy 1, policy_version 1496947 (0.0008) [2023-12-28 05:59:38,583][106226] Updated weights for policy 0, policy_version 1493308 (0.0011) [2023-12-28 05:59:38,644][106226] Updated weights for policy 0, policy_version 1493318 (0.0011) [2023-12-28 05:59:38,712][106226] Updated weights for policy 0, policy_version 1493328 (0.0011) [2023-12-28 05:59:38,860][106225] Updated weights for policy 1, policy_version 1496957 (0.0010) [2023-12-28 05:59:38,921][106225] Updated weights for policy 1, policy_version 1496967 (0.0008) [2023-12-28 05:59:38,981][106225] Updated weights for policy 1, policy_version 1496977 (0.0010) [2023-12-28 05:59:39,374][106226] Updated weights for policy 0, policy_version 1493338 (0.0010) [2023-12-28 05:59:39,446][106226] Updated weights for policy 0, policy_version 1493348 (0.0008) [2023-12-28 05:59:39,518][106226] Updated weights for policy 0, policy_version 1493358 (0.0006) [2023-12-28 05:59:39,576][106226] Updated weights for policy 0, policy_version 1493368 (0.0008) [2023-12-28 05:59:39,748][106225] Updated weights for policy 1, policy_version 1496987 (0.0010) [2023-12-28 05:59:39,805][106225] Updated weights for policy 1, policy_version 1496997 (0.0008) [2023-12-28 05:59:39,868][106225] Updated weights for policy 1, policy_version 1497007 (0.0008) [2023-12-28 05:59:40,322][106226] Updated weights for policy 0, policy_version 1493378 (0.0011) [2023-12-28 05:59:40,380][106226] Updated weights for policy 0, policy_version 1493388 (0.0011) [2023-12-28 05:59:40,448][106226] Updated weights for policy 0, policy_version 1493398 (0.0011) [2023-12-28 05:59:40,570][106225] Updated weights for policy 1, policy_version 1497017 (0.0008) [2023-12-28 05:59:40,635][106225] Updated weights for policy 1, policy_version 1497027 (0.0011) [2023-12-28 05:59:40,699][106225] Updated weights for policy 1, policy_version 1497037 (0.0011) [2023-12-28 05:59:40,762][106225] Updated weights for policy 1, policy_version 1497047 (0.0010) [2023-12-28 05:59:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 765681664. Throughput: 0: 9795.7, 1: 10044.5. Samples: 765656508. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:41,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.619')] [2023-12-28 05:59:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001497048_383295488.pth... [2023-12-28 05:59:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001495896_383000576.pth [2023-12-28 05:59:41,199][106226] Updated weights for policy 0, policy_version 1493408 (0.0008) [2023-12-28 05:59:41,255][106226] Updated weights for policy 0, policy_version 1493418 (0.0009) [2023-12-28 05:59:41,313][106226] Updated weights for policy 0, policy_version 1493428 (0.0009) [2023-12-28 05:59:41,343][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001493432_382394368.pth... [2023-12-28 05:59:41,348][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001492280_382099456.pth [2023-12-28 05:59:41,525][106225] Updated weights for policy 1, policy_version 1497057 (0.0008) [2023-12-28 05:59:41,590][106225] Updated weights for policy 1, policy_version 1497067 (0.0009) [2023-12-28 05:59:41,652][106225] Updated weights for policy 1, policy_version 1497077 (0.0008) [2023-12-28 05:59:42,041][106226] Updated weights for policy 0, policy_version 1493438 (0.0008) [2023-12-28 05:59:42,099][106226] Updated weights for policy 0, policy_version 1493448 (0.0009) [2023-12-28 05:59:42,162][106226] Updated weights for policy 0, policy_version 1493458 (0.0009) [2023-12-28 05:59:42,455][106225] Updated weights for policy 1, policy_version 1497087 (0.0008) [2023-12-28 05:59:42,514][106225] Updated weights for policy 1, policy_version 1497097 (0.0007) [2023-12-28 05:59:42,582][106225] Updated weights for policy 1, policy_version 1497107 (0.0005) [2023-12-28 05:59:42,913][106226] Updated weights for policy 0, policy_version 1493468 (0.0008) [2023-12-28 05:59:42,967][106226] Updated weights for policy 0, policy_version 1493478 (0.0008) [2023-12-28 05:59:43,019][106226] Updated weights for policy 0, policy_version 1493488 (0.0008) [2023-12-28 05:59:43,266][106225] Updated weights for policy 1, policy_version 1497117 (0.0008) [2023-12-28 05:59:43,315][106225] Updated weights for policy 1, policy_version 1497127 (0.0008) [2023-12-28 05:59:43,365][106225] Updated weights for policy 1, policy_version 1497137 (0.0008) [2023-12-28 05:59:43,755][106226] Updated weights for policy 0, policy_version 1493498 (0.0008) [2023-12-28 05:59:43,813][106226] Updated weights for policy 0, policy_version 1493508 (0.0009) [2023-12-28 05:59:43,865][106226] Updated weights for policy 0, policy_version 1493518 (0.0008) [2023-12-28 05:59:43,924][106226] Updated weights for policy 0, policy_version 1493528 (0.0008) [2023-12-28 05:59:44,105][106225] Updated weights for policy 1, policy_version 1497147 (0.0007) [2023-12-28 05:59:44,163][106225] Updated weights for policy 1, policy_version 1497157 (0.0007) [2023-12-28 05:59:44,227][106225] Updated weights for policy 1, policy_version 1497167 (0.0007) [2023-12-28 05:59:44,634][106226] Updated weights for policy 0, policy_version 1493538 (0.0008) [2023-12-28 05:59:44,686][106226] Updated weights for policy 0, policy_version 1493548 (0.0009) [2023-12-28 05:59:44,741][106226] Updated weights for policy 0, policy_version 1493558 (0.0008) [2023-12-28 05:59:44,874][106225] Updated weights for policy 1, policy_version 1497177 (0.0006) [2023-12-28 05:59:44,938][106225] Updated weights for policy 1, policy_version 1497187 (0.0009) [2023-12-28 05:59:45,002][106225] Updated weights for policy 1, policy_version 1497197 (0.0010) [2023-12-28 05:59:45,068][106225] Updated weights for policy 1, policy_version 1497207 (0.0010) [2023-12-28 05:59:45,451][106226] Updated weights for policy 0, policy_version 1493568 (0.0008) [2023-12-28 05:59:45,506][106226] Updated weights for policy 0, policy_version 1493578 (0.0008) [2023-12-28 05:59:45,564][106226] Updated weights for policy 0, policy_version 1493588 (0.0008) [2023-12-28 05:59:45,785][106225] Updated weights for policy 1, policy_version 1497217 (0.0006) [2023-12-28 05:59:45,850][106225] Updated weights for policy 1, policy_version 1497227 (0.0005) [2023-12-28 05:59:45,912][106225] Updated weights for policy 1, policy_version 1497237 (0.0006) [2023-12-28 05:59:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 765779968. Throughput: 0: 9745.7, 1: 9957.7. Samples: 765770392. Policy #0 lag: (min: 0.0, avg: 26.1, max: 32.0) [2023-12-28 05:59:46,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.820')] [2023-12-28 05:59:46,302][106226] Updated weights for policy 0, policy_version 1493598 (0.0006) [2023-12-28 05:59:46,357][106226] Updated weights for policy 0, policy_version 1493608 (0.0005) [2023-12-28 05:59:46,421][106226] Updated weights for policy 0, policy_version 1493618 (0.0008) [2023-12-28 05:59:46,525][106225] Updated weights for policy 1, policy_version 1497247 (0.0006) [2023-12-28 05:59:46,587][106225] Updated weights for policy 1, policy_version 1497257 (0.0005) [2023-12-28 05:59:46,640][106225] Updated weights for policy 1, policy_version 1497267 (0.0005) [2023-12-28 05:59:47,146][106226] Updated weights for policy 0, policy_version 1493628 (0.0010) [2023-12-28 05:59:47,211][106225] Updated weights for policy 1, policy_version 1497277 (0.0006) [2023-12-28 05:59:47,213][106226] Updated weights for policy 0, policy_version 1493638 (0.0008) [2023-12-28 05:59:47,262][106225] Updated weights for policy 1, policy_version 1497287 (0.0006) [2023-12-28 05:59:47,264][106226] Updated weights for policy 0, policy_version 1493648 (0.0008) [2023-12-28 05:59:47,317][106225] Updated weights for policy 1, policy_version 1497297 (0.0007) [2023-12-28 05:59:47,990][106225] Updated weights for policy 1, policy_version 1497307 (0.0007) [2023-12-28 05:59:48,009][106226] Updated weights for policy 0, policy_version 1493658 (0.0007) [2023-12-28 05:59:48,041][106225] Updated weights for policy 1, policy_version 1497317 (0.0006) [2023-12-28 05:59:48,067][106226] Updated weights for policy 0, policy_version 1493668 (0.0007) [2023-12-28 05:59:48,093][106225] Updated weights for policy 1, policy_version 1497327 (0.0006) [2023-12-28 05:59:48,128][106226] Updated weights for policy 0, policy_version 1493678 (0.0008) [2023-12-28 05:59:48,193][106226] Updated weights for policy 0, policy_version 1493688 (0.0008) [2023-12-28 05:59:48,721][106225] Updated weights for policy 1, policy_version 1497337 (0.0007) [2023-12-28 05:59:48,772][106225] Updated weights for policy 1, policy_version 1497347 (0.0010) [2023-12-28 05:59:48,828][106225] Updated weights for policy 1, policy_version 1497357 (0.0010) [2023-12-28 05:59:48,894][106225] Updated weights for policy 1, policy_version 1497367 (0.0010) [2023-12-28 05:59:48,988][106226] Updated weights for policy 0, policy_version 1493698 (0.0009) [2023-12-28 05:59:49,048][106226] Updated weights for policy 0, policy_version 1493708 (0.0006) [2023-12-28 05:59:49,112][106226] Updated weights for policy 0, policy_version 1493718 (0.0009) [2023-12-28 05:59:49,573][106225] Updated weights for policy 1, policy_version 1497377 (0.0010) [2023-12-28 05:59:49,634][106225] Updated weights for policy 1, policy_version 1497387 (0.0010) [2023-12-28 05:59:49,681][106225] Updated weights for policy 1, policy_version 1497397 (0.0010) [2023-12-28 05:59:49,831][106226] Updated weights for policy 0, policy_version 1493728 (0.0008) [2023-12-28 05:59:49,891][106226] Updated weights for policy 0, policy_version 1493738 (0.0008) [2023-12-28 05:59:49,959][106226] Updated weights for policy 0, policy_version 1493748 (0.0009) [2023-12-28 05:59:50,427][106225] Updated weights for policy 1, policy_version 1497407 (0.0009) [2023-12-28 05:59:50,475][106225] Updated weights for policy 1, policy_version 1497417 (0.0008) [2023-12-28 05:59:50,528][106225] Updated weights for policy 1, policy_version 1497427 (0.0007) [2023-12-28 05:59:50,755][106226] Updated weights for policy 0, policy_version 1493758 (0.0009) [2023-12-28 05:59:50,805][106226] Updated weights for policy 0, policy_version 1493768 (0.0009) [2023-12-28 05:59:50,861][106226] Updated weights for policy 0, policy_version 1493778 (0.0009) [2023-12-28 05:59:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 765878272. Throughput: 0: 9673.3, 1: 10002.6. Samples: 765887884. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 05:59:51,175][105115] Avg episode reward: [(0, '-4.737'), (1, '-4.633')] [2023-12-28 05:59:51,245][106225] Updated weights for policy 1, policy_version 1497437 (0.0007) [2023-12-28 05:59:51,309][106225] Updated weights for policy 1, policy_version 1497447 (0.0008) [2023-12-28 05:59:51,383][106225] Updated weights for policy 1, policy_version 1497457 (0.0008) [2023-12-28 05:59:51,685][106226] Updated weights for policy 0, policy_version 1493788 (0.0009) [2023-12-28 05:59:51,758][106226] Updated weights for policy 0, policy_version 1493798 (0.0011) [2023-12-28 05:59:51,821][106226] Updated weights for policy 0, policy_version 1493808 (0.0010) [2023-12-28 05:59:52,127][106225] Updated weights for policy 1, policy_version 1497467 (0.0008) [2023-12-28 05:59:52,178][106225] Updated weights for policy 1, policy_version 1497477 (0.0008) [2023-12-28 05:59:52,233][106225] Updated weights for policy 1, policy_version 1497487 (0.0008) [2023-12-28 05:59:52,504][106226] Updated weights for policy 0, policy_version 1493818 (0.0008) [2023-12-28 05:59:52,572][106226] Updated weights for policy 0, policy_version 1493828 (0.0011) [2023-12-28 05:59:52,627][106226] Updated weights for policy 0, policy_version 1493838 (0.0011) [2023-12-28 05:59:52,688][106226] Updated weights for policy 0, policy_version 1493848 (0.0011) [2023-12-28 05:59:52,922][106225] Updated weights for policy 1, policy_version 1497497 (0.0008) [2023-12-28 05:59:52,982][106225] Updated weights for policy 1, policy_version 1497507 (0.0006) [2023-12-28 05:59:53,052][106225] Updated weights for policy 1, policy_version 1497517 (0.0006) [2023-12-28 05:59:53,112][106225] Updated weights for policy 1, policy_version 1497527 (0.0008) [2023-12-28 05:59:53,362][106226] Updated weights for policy 0, policy_version 1493858 (0.0005) [2023-12-28 05:59:53,416][106226] Updated weights for policy 0, policy_version 1493868 (0.0005) [2023-12-28 05:59:53,466][106226] Updated weights for policy 0, policy_version 1493878 (0.0006) [2023-12-28 05:59:53,698][106225] Updated weights for policy 1, policy_version 1497537 (0.0006) [2023-12-28 05:59:53,744][106225] Updated weights for policy 1, policy_version 1497547 (0.0005) [2023-12-28 05:59:53,799][106225] Updated weights for policy 1, policy_version 1497557 (0.0005) [2023-12-28 05:59:54,098][106226] Updated weights for policy 0, policy_version 1493888 (0.0006) [2023-12-28 05:59:54,148][106226] Updated weights for policy 0, policy_version 1493898 (0.0006) [2023-12-28 05:59:54,195][106226] Updated weights for policy 0, policy_version 1493908 (0.0006) [2023-12-28 05:59:54,423][106225] Updated weights for policy 1, policy_version 1497567 (0.0008) [2023-12-28 05:59:54,482][106225] Updated weights for policy 1, policy_version 1497577 (0.0007) [2023-12-28 05:59:54,543][106225] Updated weights for policy 1, policy_version 1497587 (0.0006) [2023-12-28 05:59:54,886][106226] Updated weights for policy 0, policy_version 1493918 (0.0009) [2023-12-28 05:59:54,936][106226] Updated weights for policy 0, policy_version 1493928 (0.0010) [2023-12-28 05:59:54,996][106226] Updated weights for policy 0, policy_version 1493938 (0.0010) [2023-12-28 05:59:55,133][106225] Updated weights for policy 1, policy_version 1497597 (0.0005) [2023-12-28 05:59:55,187][106225] Updated weights for policy 1, policy_version 1497607 (0.0008) [2023-12-28 05:59:55,237][106225] Updated weights for policy 1, policy_version 1497617 (0.0008) [2023-12-28 05:59:55,604][106226] Updated weights for policy 0, policy_version 1493948 (0.0008) [2023-12-28 05:59:55,667][106226] Updated weights for policy 0, policy_version 1493958 (0.0005) [2023-12-28 05:59:55,727][106226] Updated weights for policy 0, policy_version 1493968 (0.0005) [2023-12-28 05:59:56,005][106225] Updated weights for policy 1, policy_version 1497627 (0.0006) [2023-12-28 05:59:56,058][106225] Updated weights for policy 1, policy_version 1497637 (0.0005) [2023-12-28 05:59:56,113][106225] Updated weights for policy 1, policy_version 1497647 (0.0007) [2023-12-28 05:59:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.5, 300 sec: 19855.2). Total num frames: 765984768. Throughput: 0: 9675.7, 1: 10030.9. Samples: 765948812. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 05:59:56,175][105115] Avg episode reward: [(0, '-4.857'), (1, '-4.368')] [2023-12-28 05:59:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001497656_383451136.pth... [2023-12-28 05:59:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001493976_382533632.pth... [2023-12-28 05:59:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001496472_383148032.pth [2023-12-28 05:59:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001492824_382238720.pth [2023-12-28 05:59:56,356][106226] Updated weights for policy 0, policy_version 1493978 (0.0007) [2023-12-28 05:59:56,417][106226] Updated weights for policy 0, policy_version 1493988 (0.0010) [2023-12-28 05:59:56,476][106226] Updated weights for policy 0, policy_version 1493998 (0.0011) [2023-12-28 05:59:56,538][106226] Updated weights for policy 0, policy_version 1494008 (0.0009) [2023-12-28 05:59:56,812][106225] Updated weights for policy 1, policy_version 1497657 (0.0008) [2023-12-28 05:59:56,863][106225] Updated weights for policy 1, policy_version 1497667 (0.0010) [2023-12-28 05:59:56,908][106225] Updated weights for policy 1, policy_version 1497677 (0.0007) [2023-12-28 05:59:56,956][106225] Updated weights for policy 1, policy_version 1497687 (0.0009) [2023-12-28 05:59:57,103][106226] Updated weights for policy 0, policy_version 1494018 (0.0005) [2023-12-28 05:59:57,153][106226] Updated weights for policy 0, policy_version 1494028 (0.0005) [2023-12-28 05:59:57,203][106226] Updated weights for policy 0, policy_version 1494038 (0.0005) [2023-12-28 05:59:57,759][106225] Updated weights for policy 1, policy_version 1497697 (0.0007) [2023-12-28 05:59:57,780][106226] Updated weights for policy 0, policy_version 1494048 (0.0009) [2023-12-28 05:59:57,817][106225] Updated weights for policy 1, policy_version 1497707 (0.0006) [2023-12-28 05:59:57,831][106226] Updated weights for policy 0, policy_version 1494058 (0.0010) [2023-12-28 05:59:57,874][106225] Updated weights for policy 1, policy_version 1497717 (0.0005) [2023-12-28 05:59:57,883][106226] Updated weights for policy 0, policy_version 1494068 (0.0010) [2023-12-28 05:59:58,621][106226] Updated weights for policy 0, policy_version 1494078 (0.0011) [2023-12-28 05:59:58,639][106225] Updated weights for policy 1, policy_version 1497727 (0.0006) [2023-12-28 05:59:58,683][106226] Updated weights for policy 0, policy_version 1494088 (0.0010) [2023-12-28 05:59:58,701][106225] Updated weights for policy 1, policy_version 1497737 (0.0007) [2023-12-28 05:59:58,762][106226] Updated weights for policy 0, policy_version 1494098 (0.0009) [2023-12-28 05:59:58,778][106225] Updated weights for policy 1, policy_version 1497747 (0.0008) [2023-12-28 05:59:59,496][106226] Updated weights for policy 0, policy_version 1494108 (0.0009) [2023-12-28 05:59:59,547][106225] Updated weights for policy 1, policy_version 1497757 (0.0009) [2023-12-28 05:59:59,557][106226] Updated weights for policy 0, policy_version 1494118 (0.0011) [2023-12-28 05:59:59,602][106225] Updated weights for policy 1, policy_version 1497767 (0.0011) [2023-12-28 05:59:59,619][106226] Updated weights for policy 0, policy_version 1494128 (0.0010) [2023-12-28 05:59:59,662][106225] Updated weights for policy 1, policy_version 1497777 (0.0011) [2023-12-28 06:00:00,303][106226] Updated weights for policy 0, policy_version 1494138 (0.0009) [2023-12-28 06:00:00,359][106226] Updated weights for policy 0, policy_version 1494148 (0.0010) [2023-12-28 06:00:00,380][106225] Updated weights for policy 1, policy_version 1497787 (0.0010) [2023-12-28 06:00:00,415][106226] Updated weights for policy 0, policy_version 1494158 (0.0010) [2023-12-28 06:00:00,429][106225] Updated weights for policy 1, policy_version 1497797 (0.0010) [2023-12-28 06:00:00,471][106226] Updated weights for policy 0, policy_version 1494168 (0.0010) [2023-12-28 06:00:00,476][106225] Updated weights for policy 1, policy_version 1497807 (0.0010) [2023-12-28 06:00:01,085][106226] Updated weights for policy 0, policy_version 1494178 (0.0010) [2023-12-28 06:00:01,148][106226] Updated weights for policy 0, policy_version 1494188 (0.0008) [2023-12-28 06:00:01,163][106225] Updated weights for policy 1, policy_version 1497817 (0.0010) [2023-12-28 06:00:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 766074880. Throughput: 0: 9790.8, 1: 10012.1. Samples: 766068892. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:01,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.897')] [2023-12-28 06:00:01,208][106226] Updated weights for policy 0, policy_version 1494198 (0.0006) [2023-12-28 06:00:01,217][106225] Updated weights for policy 1, policy_version 1497827 (0.0011) [2023-12-28 06:00:01,285][106225] Updated weights for policy 1, policy_version 1497837 (0.0010) [2023-12-28 06:00:01,345][106225] Updated weights for policy 1, policy_version 1497847 (0.0010) [2023-12-28 06:00:01,887][106226] Updated weights for policy 0, policy_version 1494208 (0.0008) [2023-12-28 06:00:01,960][106226] Updated weights for policy 0, policy_version 1494218 (0.0009) [2023-12-28 06:00:02,024][106226] Updated weights for policy 0, policy_version 1494228 (0.0008) [2023-12-28 06:00:02,155][106225] Updated weights for policy 1, policy_version 1497857 (0.0010) [2023-12-28 06:00:02,216][106225] Updated weights for policy 1, policy_version 1497867 (0.0010) [2023-12-28 06:00:02,275][106225] Updated weights for policy 1, policy_version 1497877 (0.0010) [2023-12-28 06:00:02,738][106226] Updated weights for policy 0, policy_version 1494238 (0.0007) [2023-12-28 06:00:02,800][106226] Updated weights for policy 0, policy_version 1494248 (0.0008) [2023-12-28 06:00:02,856][106226] Updated weights for policy 0, policy_version 1494258 (0.0008) [2023-12-28 06:00:03,021][106225] Updated weights for policy 1, policy_version 1497887 (0.0010) [2023-12-28 06:00:03,067][106225] Updated weights for policy 1, policy_version 1497897 (0.0010) [2023-12-28 06:00:03,129][106225] Updated weights for policy 1, policy_version 1497907 (0.0010) [2023-12-28 06:00:03,585][106226] Updated weights for policy 0, policy_version 1494268 (0.0008) [2023-12-28 06:00:03,638][106226] Updated weights for policy 0, policy_version 1494278 (0.0009) [2023-12-28 06:00:03,697][106226] Updated weights for policy 0, policy_version 1494288 (0.0008) [2023-12-28 06:00:03,860][106225] Updated weights for policy 1, policy_version 1497917 (0.0009) [2023-12-28 06:00:03,922][106225] Updated weights for policy 1, policy_version 1497927 (0.0009) [2023-12-28 06:00:03,989][106225] Updated weights for policy 1, policy_version 1497937 (0.0009) [2023-12-28 06:00:04,395][106226] Updated weights for policy 0, policy_version 1494298 (0.0008) [2023-12-28 06:00:04,462][106226] Updated weights for policy 0, policy_version 1494308 (0.0008) [2023-12-28 06:00:04,526][106226] Updated weights for policy 0, policy_version 1494318 (0.0005) [2023-12-28 06:00:04,597][106226] Updated weights for policy 0, policy_version 1494328 (0.0007) [2023-12-28 06:00:04,623][106225] Updated weights for policy 1, policy_version 1497947 (0.0008) [2023-12-28 06:00:04,682][106225] Updated weights for policy 1, policy_version 1497957 (0.0011) [2023-12-28 06:00:04,741][106225] Updated weights for policy 1, policy_version 1497967 (0.0008) [2023-12-28 06:00:05,250][106226] Updated weights for policy 0, policy_version 1494338 (0.0008) [2023-12-28 06:00:05,312][106226] Updated weights for policy 0, policy_version 1494348 (0.0008) [2023-12-28 06:00:05,366][106226] Updated weights for policy 0, policy_version 1494358 (0.0008) [2023-12-28 06:00:05,429][106225] Updated weights for policy 1, policy_version 1497977 (0.0005) [2023-12-28 06:00:05,485][106225] Updated weights for policy 1, policy_version 1497987 (0.0005) [2023-12-28 06:00:05,540][106225] Updated weights for policy 1, policy_version 1497997 (0.0007) [2023-12-28 06:00:05,593][106225] Updated weights for policy 1, policy_version 1498007 (0.0010) [2023-12-28 06:00:05,998][106226] Updated weights for policy 0, policy_version 1494368 (0.0007) [2023-12-28 06:00:06,066][106226] Updated weights for policy 0, policy_version 1494378 (0.0008) [2023-12-28 06:00:06,129][106226] Updated weights for policy 0, policy_version 1494388 (0.0008) [2023-12-28 06:00:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 766181376. Throughput: 0: 9899.6, 1: 10020.7. Samples: 766188528. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:06,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.649')] [2023-12-28 06:00:06,271][106225] Updated weights for policy 1, policy_version 1498017 (0.0010) [2023-12-28 06:00:06,336][106225] Updated weights for policy 1, policy_version 1498027 (0.0011) [2023-12-28 06:00:06,397][106225] Updated weights for policy 1, policy_version 1498037 (0.0010) [2023-12-28 06:00:06,795][106226] Updated weights for policy 0, policy_version 1494398 (0.0007) [2023-12-28 06:00:06,865][106226] Updated weights for policy 0, policy_version 1494408 (0.0005) [2023-12-28 06:00:06,919][106226] Updated weights for policy 0, policy_version 1494418 (0.0005) [2023-12-28 06:00:07,122][106225] Updated weights for policy 1, policy_version 1498047 (0.0010) [2023-12-28 06:00:07,184][106225] Updated weights for policy 1, policy_version 1498057 (0.0011) [2023-12-28 06:00:07,249][106225] Updated weights for policy 1, policy_version 1498067 (0.0010) [2023-12-28 06:00:07,466][106226] Updated weights for policy 0, policy_version 1494428 (0.0006) [2023-12-28 06:00:07,524][106226] Updated weights for policy 0, policy_version 1494438 (0.0008) [2023-12-28 06:00:07,583][106226] Updated weights for policy 0, policy_version 1494448 (0.0008) [2023-12-28 06:00:07,951][106225] Updated weights for policy 1, policy_version 1498077 (0.0009) [2023-12-28 06:00:08,007][106225] Updated weights for policy 1, policy_version 1498087 (0.0006) [2023-12-28 06:00:08,055][106225] Updated weights for policy 1, policy_version 1498097 (0.0006) [2023-12-28 06:00:08,285][106226] Updated weights for policy 0, policy_version 1494458 (0.0007) [2023-12-28 06:00:08,355][106226] Updated weights for policy 0, policy_version 1494468 (0.0007) [2023-12-28 06:00:08,419][106226] Updated weights for policy 0, policy_version 1494478 (0.0010) [2023-12-28 06:00:08,476][106226] Updated weights for policy 0, policy_version 1494488 (0.0008) [2023-12-28 06:00:08,656][106225] Updated weights for policy 1, policy_version 1498107 (0.0006) [2023-12-28 06:00:08,719][106225] Updated weights for policy 1, policy_version 1498117 (0.0009) [2023-12-28 06:00:08,784][106225] Updated weights for policy 1, policy_version 1498127 (0.0011) [2023-12-28 06:00:09,298][106226] Updated weights for policy 0, policy_version 1494499 (0.0009) [2023-12-28 06:00:09,373][106226] Updated weights for policy 0, policy_version 1494509 (0.0009) [2023-12-28 06:00:09,458][106226] Updated weights for policy 0, policy_version 1494519 (0.0008) [2023-12-28 06:00:09,559][106225] Updated weights for policy 1, policy_version 1498137 (0.0011) [2023-12-28 06:00:09,626][106225] Updated weights for policy 1, policy_version 1498147 (0.0010) [2023-12-28 06:00:09,691][106225] Updated weights for policy 1, policy_version 1498157 (0.0011) [2023-12-28 06:00:09,755][106225] Updated weights for policy 1, policy_version 1498167 (0.0010) [2023-12-28 06:00:10,296][106226] Updated weights for policy 0, policy_version 1494529 (0.0008) [2023-12-28 06:00:10,367][106226] Updated weights for policy 0, policy_version 1494539 (0.0006) [2023-12-28 06:00:10,433][106226] Updated weights for policy 0, policy_version 1494549 (0.0007) [2023-12-28 06:00:10,567][106225] Updated weights for policy 1, policy_version 1498177 (0.0009) [2023-12-28 06:00:10,636][106225] Updated weights for policy 1, policy_version 1498187 (0.0009) [2023-12-28 06:00:10,695][106225] Updated weights for policy 1, policy_version 1498197 (0.0008) [2023-12-28 06:00:11,113][106226] Updated weights for policy 0, policy_version 1494559 (0.0008) [2023-12-28 06:00:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 766271488. Throughput: 0: 9925.6, 1: 10069.4. Samples: 766249344. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:11,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.419')] [2023-12-28 06:00:11,186][106226] Updated weights for policy 0, policy_version 1494569 (0.0010) [2023-12-28 06:00:11,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001498200_383590400.pth... [2023-12-28 06:00:11,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001497048_383295488.pth [2023-12-28 06:00:11,262][106226] Updated weights for policy 0, policy_version 1494579 (0.0009) [2023-12-28 06:00:11,300][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001494584_382689280.pth... [2023-12-28 06:00:11,305][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001493432_382394368.pth [2023-12-28 06:00:11,502][106225] Updated weights for policy 1, policy_version 1498207 (0.0009) [2023-12-28 06:00:11,557][106225] Updated weights for policy 1, policy_version 1498217 (0.0007) [2023-12-28 06:00:11,614][106225] Updated weights for policy 1, policy_version 1498227 (0.0008) [2023-12-28 06:00:12,036][106226] Updated weights for policy 0, policy_version 1494589 (0.0009) [2023-12-28 06:00:12,099][106226] Updated weights for policy 0, policy_version 1494599 (0.0006) [2023-12-28 06:00:12,166][106226] Updated weights for policy 0, policy_version 1494609 (0.0007) [2023-12-28 06:00:12,432][106225] Updated weights for policy 1, policy_version 1498237 (0.0007) [2023-12-28 06:00:12,497][106225] Updated weights for policy 1, policy_version 1498247 (0.0009) [2023-12-28 06:00:12,563][106225] Updated weights for policy 1, policy_version 1498257 (0.0008) [2023-12-28 06:00:12,850][106226] Updated weights for policy 0, policy_version 1494619 (0.0008) [2023-12-28 06:00:12,909][106226] Updated weights for policy 0, policy_version 1494629 (0.0010) [2023-12-28 06:00:12,967][106226] Updated weights for policy 0, policy_version 1494639 (0.0009) [2023-12-28 06:00:13,231][106225] Updated weights for policy 1, policy_version 1498267 (0.0008) [2023-12-28 06:00:13,278][106225] Updated weights for policy 1, policy_version 1498277 (0.0008) [2023-12-28 06:00:13,322][106225] Updated weights for policy 1, policy_version 1498287 (0.0005) [2023-12-28 06:00:13,710][106226] Updated weights for policy 0, policy_version 1494649 (0.0010) [2023-12-28 06:00:13,775][106226] Updated weights for policy 0, policy_version 1494659 (0.0006) [2023-12-28 06:00:13,834][106226] Updated weights for policy 0, policy_version 1494669 (0.0010) [2023-12-28 06:00:13,899][106226] Updated weights for policy 0, policy_version 1494679 (0.0011) [2023-12-28 06:00:13,992][106225] Updated weights for policy 1, policy_version 1498297 (0.0008) [2023-12-28 06:00:14,048][106225] Updated weights for policy 1, policy_version 1498307 (0.0008) [2023-12-28 06:00:14,098][106225] Updated weights for policy 1, policy_version 1498317 (0.0008) [2023-12-28 06:00:14,150][106225] Updated weights for policy 1, policy_version 1498327 (0.0006) [2023-12-28 06:00:14,554][106226] Updated weights for policy 0, policy_version 1494689 (0.0010) [2023-12-28 06:00:14,610][106226] Updated weights for policy 0, policy_version 1494699 (0.0006) [2023-12-28 06:00:14,674][106226] Updated weights for policy 0, policy_version 1494709 (0.0011) [2023-12-28 06:00:14,932][106225] Updated weights for policy 1, policy_version 1498337 (0.0009) [2023-12-28 06:00:14,999][106225] Updated weights for policy 1, policy_version 1498347 (0.0008) [2023-12-28 06:00:15,061][106225] Updated weights for policy 1, policy_version 1498357 (0.0009) [2023-12-28 06:00:15,373][106226] Updated weights for policy 0, policy_version 1494719 (0.0010) [2023-12-28 06:00:15,430][106226] Updated weights for policy 0, policy_version 1494729 (0.0010) [2023-12-28 06:00:15,491][106226] Updated weights for policy 0, policy_version 1494739 (0.0011) [2023-12-28 06:00:15,818][106225] Updated weights for policy 1, policy_version 1498367 (0.0009) [2023-12-28 06:00:15,872][106225] Updated weights for policy 1, policy_version 1498377 (0.0009) [2023-12-28 06:00:15,926][106225] Updated weights for policy 1, policy_version 1498387 (0.0007) [2023-12-28 06:00:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 766369792. Throughput: 0: 9883.3, 1: 9777.5. Samples: 766360164. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:16,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.826')] [2023-12-28 06:00:16,176][106226] Updated weights for policy 0, policy_version 1494749 (0.0011) [2023-12-28 06:00:16,230][106226] Updated weights for policy 0, policy_version 1494759 (0.0011) [2023-12-28 06:00:16,289][106226] Updated weights for policy 0, policy_version 1494769 (0.0011) [2023-12-28 06:00:16,650][106225] Updated weights for policy 1, policy_version 1498397 (0.0008) [2023-12-28 06:00:16,709][106225] Updated weights for policy 1, policy_version 1498407 (0.0007) [2023-12-28 06:00:16,768][106225] Updated weights for policy 1, policy_version 1498417 (0.0008) [2023-12-28 06:00:17,023][106226] Updated weights for policy 0, policy_version 1494779 (0.0011) [2023-12-28 06:00:17,084][106226] Updated weights for policy 0, policy_version 1494789 (0.0010) [2023-12-28 06:00:17,149][106226] Updated weights for policy 0, policy_version 1494799 (0.0006) [2023-12-28 06:00:17,518][106225] Updated weights for policy 1, policy_version 1498427 (0.0008) [2023-12-28 06:00:17,571][106225] Updated weights for policy 1, policy_version 1498437 (0.0007) [2023-12-28 06:00:17,623][106225] Updated weights for policy 1, policy_version 1498447 (0.0009) [2023-12-28 06:00:17,792][106226] Updated weights for policy 0, policy_version 1494809 (0.0009) [2023-12-28 06:00:17,857][106226] Updated weights for policy 0, policy_version 1494819 (0.0008) [2023-12-28 06:00:17,925][106226] Updated weights for policy 0, policy_version 1494829 (0.0009) [2023-12-28 06:00:17,988][106226] Updated weights for policy 0, policy_version 1494839 (0.0008) [2023-12-28 06:00:18,415][106225] Updated weights for policy 1, policy_version 1498457 (0.0008) [2023-12-28 06:00:18,476][106225] Updated weights for policy 1, policy_version 1498467 (0.0008) [2023-12-28 06:00:18,541][106225] Updated weights for policy 1, policy_version 1498477 (0.0009) [2023-12-28 06:00:18,594][106225] Updated weights for policy 1, policy_version 1498487 (0.0010) [2023-12-28 06:00:18,662][106226] Updated weights for policy 0, policy_version 1494849 (0.0007) [2023-12-28 06:00:18,709][106226] Updated weights for policy 0, policy_version 1494859 (0.0007) [2023-12-28 06:00:18,770][106226] Updated weights for policy 0, policy_version 1494869 (0.0009) [2023-12-28 06:00:19,352][106225] Updated weights for policy 1, policy_version 1498497 (0.0009) [2023-12-28 06:00:19,422][106225] Updated weights for policy 1, policy_version 1498507 (0.0009) [2023-12-28 06:00:19,485][106225] Updated weights for policy 1, policy_version 1498517 (0.0006) [2023-12-28 06:00:19,495][106226] Updated weights for policy 0, policy_version 1494879 (0.0008) [2023-12-28 06:00:19,559][106226] Updated weights for policy 0, policy_version 1494889 (0.0009) [2023-12-28 06:00:19,625][106226] Updated weights for policy 0, policy_version 1494899 (0.0009) [2023-12-28 06:00:20,213][106225] Updated weights for policy 1, policy_version 1498527 (0.0008) [2023-12-28 06:00:20,278][106225] Updated weights for policy 1, policy_version 1498537 (0.0006) [2023-12-28 06:00:20,343][106225] Updated weights for policy 1, policy_version 1498547 (0.0008) [2023-12-28 06:00:20,457][106226] Updated weights for policy 0, policy_version 1494909 (0.0009) [2023-12-28 06:00:20,528][106226] Updated weights for policy 0, policy_version 1494919 (0.0007) [2023-12-28 06:00:20,599][106226] Updated weights for policy 0, policy_version 1494929 (0.0008) [2023-12-28 06:00:21,104][106225] Updated weights for policy 1, policy_version 1498557 (0.0007) [2023-12-28 06:00:21,171][106225] Updated weights for policy 1, policy_version 1498567 (0.0008) [2023-12-28 06:00:21,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 766459904. Throughput: 0: 9750.9, 1: 9706.7. Samples: 766473060. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:21,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.896')] [2023-12-28 06:00:21,231][106225] Updated weights for policy 1, policy_version 1498577 (0.0008) [2023-12-28 06:00:21,363][106226] Updated weights for policy 0, policy_version 1494939 (0.0009) [2023-12-28 06:00:21,427][106226] Updated weights for policy 0, policy_version 1494949 (0.0008) [2023-12-28 06:00:21,484][106226] Updated weights for policy 0, policy_version 1494959 (0.0009) [2023-12-28 06:00:22,005][106225] Updated weights for policy 1, policy_version 1498587 (0.0009) [2023-12-28 06:00:22,068][106225] Updated weights for policy 1, policy_version 1498597 (0.0009) [2023-12-28 06:00:22,129][106225] Updated weights for policy 1, policy_version 1498607 (0.0008) [2023-12-28 06:00:22,218][106226] Updated weights for policy 0, policy_version 1494969 (0.0008) [2023-12-28 06:00:22,295][106226] Updated weights for policy 0, policy_version 1494979 (0.0007) [2023-12-28 06:00:22,365][106226] Updated weights for policy 0, policy_version 1494989 (0.0009) [2023-12-28 06:00:22,416][106226] Updated weights for policy 0, policy_version 1494999 (0.0008) [2023-12-28 06:00:22,845][106225] Updated weights for policy 1, policy_version 1498617 (0.0009) [2023-12-28 06:00:22,905][106225] Updated weights for policy 1, policy_version 1498627 (0.0008) [2023-12-28 06:00:22,967][106225] Updated weights for policy 1, policy_version 1498637 (0.0010) [2023-12-28 06:00:23,032][106225] Updated weights for policy 1, policy_version 1498647 (0.0011) [2023-12-28 06:00:23,161][106226] Updated weights for policy 0, policy_version 1495009 (0.0009) [2023-12-28 06:00:23,219][106226] Updated weights for policy 0, policy_version 1495019 (0.0008) [2023-12-28 06:00:23,300][106226] Updated weights for policy 0, policy_version 1495029 (0.0007) [2023-12-28 06:00:23,662][106225] Updated weights for policy 1, policy_version 1498657 (0.0007) [2023-12-28 06:00:23,721][106225] Updated weights for policy 1, policy_version 1498667 (0.0006) [2023-12-28 06:00:23,780][106225] Updated weights for policy 1, policy_version 1498677 (0.0010) [2023-12-28 06:00:24,016][106226] Updated weights for policy 0, policy_version 1495039 (0.0008) [2023-12-28 06:00:24,074][106226] Updated weights for policy 0, policy_version 1495049 (0.0008) [2023-12-28 06:00:24,125][106226] Updated weights for policy 0, policy_version 1495059 (0.0009) [2023-12-28 06:00:24,441][106225] Updated weights for policy 1, policy_version 1498687 (0.0010) [2023-12-28 06:00:24,494][106225] Updated weights for policy 1, policy_version 1498697 (0.0010) [2023-12-28 06:00:24,555][106225] Updated weights for policy 1, policy_version 1498707 (0.0007) [2023-12-28 06:00:24,868][106226] Updated weights for policy 0, policy_version 1495069 (0.0008) [2023-12-28 06:00:24,921][106226] Updated weights for policy 0, policy_version 1495079 (0.0007) [2023-12-28 06:00:24,979][106226] Updated weights for policy 0, policy_version 1495089 (0.0008) [2023-12-28 06:00:25,268][106225] Updated weights for policy 1, policy_version 1498717 (0.0009) [2023-12-28 06:00:25,329][106225] Updated weights for policy 1, policy_version 1498727 (0.0010) [2023-12-28 06:00:25,375][106225] Updated weights for policy 1, policy_version 1498737 (0.0010) [2023-12-28 06:00:25,597][106226] Updated weights for policy 0, policy_version 1495099 (0.0007) [2023-12-28 06:00:25,652][106226] Updated weights for policy 0, policy_version 1495109 (0.0007) [2023-12-28 06:00:25,702][106226] Updated weights for policy 0, policy_version 1495119 (0.0009) [2023-12-28 06:00:26,026][106225] Updated weights for policy 1, policy_version 1498747 (0.0010) [2023-12-28 06:00:26,087][106225] Updated weights for policy 1, policy_version 1498757 (0.0008) [2023-12-28 06:00:26,149][106225] Updated weights for policy 1, policy_version 1498767 (0.0009) [2023-12-28 06:00:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 766558208. Throughput: 0: 9708.5, 1: 9697.1. Samples: 766529764. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:26,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.935')] [2023-12-28 06:00:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001495128_382828544.pth... [2023-12-28 06:00:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001493976_382533632.pth [2023-12-28 06:00:26,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001498776_383737856.pth... [2023-12-28 06:00:26,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001497656_383451136.pth [2023-12-28 06:00:26,392][106226] Updated weights for policy 0, policy_version 1495129 (0.0005) [2023-12-28 06:00:26,447][106226] Updated weights for policy 0, policy_version 1495139 (0.0006) [2023-12-28 06:00:26,499][106226] Updated weights for policy 0, policy_version 1495149 (0.0005) [2023-12-28 06:00:26,550][106226] Updated weights for policy 0, policy_version 1495159 (0.0005) [2023-12-28 06:00:26,855][106225] Updated weights for policy 1, policy_version 1498777 (0.0008) [2023-12-28 06:00:26,923][106225] Updated weights for policy 1, policy_version 1498787 (0.0008) [2023-12-28 06:00:26,982][106225] Updated weights for policy 1, policy_version 1498797 (0.0008) [2023-12-28 06:00:27,048][106225] Updated weights for policy 1, policy_version 1498807 (0.0009) [2023-12-28 06:00:27,166][106226] Updated weights for policy 0, policy_version 1495169 (0.0008) [2023-12-28 06:00:27,220][106226] Updated weights for policy 0, policy_version 1495179 (0.0009) [2023-12-28 06:00:27,269][106226] Updated weights for policy 0, policy_version 1495189 (0.0008) [2023-12-28 06:00:27,703][106225] Updated weights for policy 1, policy_version 1498817 (0.0005) [2023-12-28 06:00:27,755][106225] Updated weights for policy 1, policy_version 1498827 (0.0007) [2023-12-28 06:00:27,802][106225] Updated weights for policy 1, policy_version 1498837 (0.0007) [2023-12-28 06:00:27,927][106226] Updated weights for policy 0, policy_version 1495199 (0.0009) [2023-12-28 06:00:27,973][106226] Updated weights for policy 0, policy_version 1495209 (0.0009) [2023-12-28 06:00:28,022][106226] Updated weights for policy 0, policy_version 1495219 (0.0010) [2023-12-28 06:00:28,502][106225] Updated weights for policy 1, policy_version 1498847 (0.0007) [2023-12-28 06:00:28,549][106225] Updated weights for policy 1, policy_version 1498857 (0.0008) [2023-12-28 06:00:28,593][106225] Updated weights for policy 1, policy_version 1498867 (0.0007) [2023-12-28 06:00:28,779][106226] Updated weights for policy 0, policy_version 1495229 (0.0009) [2023-12-28 06:00:28,833][106226] Updated weights for policy 0, policy_version 1495239 (0.0011) [2023-12-28 06:00:28,886][106226] Updated weights for policy 0, policy_version 1495249 (0.0010) [2023-12-28 06:00:29,364][106225] Updated weights for policy 1, policy_version 1498877 (0.0007) [2023-12-28 06:00:29,430][106225] Updated weights for policy 1, policy_version 1498887 (0.0006) [2023-12-28 06:00:29,484][106225] Updated weights for policy 1, policy_version 1498897 (0.0008) [2023-12-28 06:00:29,656][106226] Updated weights for policy 0, policy_version 1495259 (0.0010) [2023-12-28 06:00:29,714][106226] Updated weights for policy 0, policy_version 1495269 (0.0009) [2023-12-28 06:00:29,776][106226] Updated weights for policy 0, policy_version 1495279 (0.0008) [2023-12-28 06:00:30,137][106225] Updated weights for policy 1, policy_version 1498907 (0.0005) [2023-12-28 06:00:30,198][106225] Updated weights for policy 1, policy_version 1498917 (0.0005) [2023-12-28 06:00:30,256][106225] Updated weights for policy 1, policy_version 1498927 (0.0006) [2023-12-28 06:00:30,567][106226] Updated weights for policy 0, policy_version 1495289 (0.0008) [2023-12-28 06:00:30,626][106226] Updated weights for policy 0, policy_version 1495299 (0.0008) [2023-12-28 06:00:30,685][106226] Updated weights for policy 0, policy_version 1495309 (0.0008) [2023-12-28 06:00:30,738][106226] Updated weights for policy 0, policy_version 1495319 (0.0005) [2023-12-28 06:00:30,927][106225] Updated weights for policy 1, policy_version 1498937 (0.0006) [2023-12-28 06:00:30,992][106225] Updated weights for policy 1, policy_version 1498947 (0.0008) [2023-12-28 06:00:31,056][106225] Updated weights for policy 1, policy_version 1498957 (0.0008) [2023-12-28 06:00:31,120][106225] Updated weights for policy 1, policy_version 1498967 (0.0008) [2023-12-28 06:00:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 766664704. Throughput: 0: 9795.9, 1: 9766.0. Samples: 766650680. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:31,175][105115] Avg episode reward: [(0, '-5.114'), (1, '-4.447')] [2023-12-28 06:00:31,438][106226] Updated weights for policy 0, policy_version 1495329 (0.0008) [2023-12-28 06:00:31,491][106226] Updated weights for policy 0, policy_version 1495339 (0.0009) [2023-12-28 06:00:31,540][106226] Updated weights for policy 0, policy_version 1495349 (0.0007) [2023-12-28 06:00:31,850][106225] Updated weights for policy 1, policy_version 1498977 (0.0006) [2023-12-28 06:00:31,903][106225] Updated weights for policy 1, policy_version 1498987 (0.0005) [2023-12-28 06:00:31,955][106225] Updated weights for policy 1, policy_version 1498997 (0.0005) [2023-12-28 06:00:32,187][106226] Updated weights for policy 0, policy_version 1495359 (0.0008) [2023-12-28 06:00:32,246][106226] Updated weights for policy 0, policy_version 1495369 (0.0008) [2023-12-28 06:00:32,307][106226] Updated weights for policy 0, policy_version 1495379 (0.0008) [2023-12-28 06:00:32,629][106225] Updated weights for policy 1, policy_version 1499007 (0.0007) [2023-12-28 06:00:32,683][106225] Updated weights for policy 1, policy_version 1499017 (0.0008) [2023-12-28 06:00:32,747][106225] Updated weights for policy 1, policy_version 1499027 (0.0005) [2023-12-28 06:00:33,007][106226] Updated weights for policy 0, policy_version 1495389 (0.0008) [2023-12-28 06:00:33,063][106226] Updated weights for policy 0, policy_version 1495399 (0.0009) [2023-12-28 06:00:33,116][106226] Updated weights for policy 0, policy_version 1495409 (0.0009) [2023-12-28 06:00:33,317][106225] Updated weights for policy 1, policy_version 1499037 (0.0007) [2023-12-28 06:00:33,374][106225] Updated weights for policy 1, policy_version 1499047 (0.0008) [2023-12-28 06:00:33,426][106225] Updated weights for policy 1, policy_version 1499057 (0.0008) [2023-12-28 06:00:33,775][106226] Updated weights for policy 0, policy_version 1495419 (0.0008) [2023-12-28 06:00:33,834][106226] Updated weights for policy 0, policy_version 1495429 (0.0008) [2023-12-28 06:00:33,893][106226] Updated weights for policy 0, policy_version 1495439 (0.0008) [2023-12-28 06:00:34,252][106225] Updated weights for policy 1, policy_version 1499067 (0.0008) [2023-12-28 06:00:34,323][106225] Updated weights for policy 1, policy_version 1499077 (0.0008) [2023-12-28 06:00:34,388][106225] Updated weights for policy 1, policy_version 1499087 (0.0007) [2023-12-28 06:00:34,534][106226] Updated weights for policy 0, policy_version 1495449 (0.0007) [2023-12-28 06:00:34,598][106226] Updated weights for policy 0, policy_version 1495459 (0.0009) [2023-12-28 06:00:34,661][106226] Updated weights for policy 0, policy_version 1495469 (0.0009) [2023-12-28 06:00:34,724][106226] Updated weights for policy 0, policy_version 1495479 (0.0009) [2023-12-28 06:00:35,120][106225] Updated weights for policy 1, policy_version 1499097 (0.0008) [2023-12-28 06:00:35,179][106225] Updated weights for policy 1, policy_version 1499107 (0.0009) [2023-12-28 06:00:35,234][106225] Updated weights for policy 1, policy_version 1499117 (0.0008) [2023-12-28 06:00:35,288][106225] Updated weights for policy 1, policy_version 1499127 (0.0008) [2023-12-28 06:00:35,365][106226] Updated weights for policy 0, policy_version 1495489 (0.0009) [2023-12-28 06:00:35,425][106226] Updated weights for policy 0, policy_version 1495499 (0.0009) [2023-12-28 06:00:35,498][106226] Updated weights for policy 0, policy_version 1495509 (0.0008) [2023-12-28 06:00:36,061][106225] Updated weights for policy 1, policy_version 1499137 (0.0008) [2023-12-28 06:00:36,125][106225] Updated weights for policy 1, policy_version 1499147 (0.0006) [2023-12-28 06:00:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 766754816. Throughput: 0: 9914.1, 1: 9692.2. Samples: 766770168. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:36,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-4.670')] [2023-12-28 06:00:36,187][106225] Updated weights for policy 1, policy_version 1499157 (0.0008) [2023-12-28 06:00:36,256][106226] Updated weights for policy 0, policy_version 1495519 (0.0007) [2023-12-28 06:00:36,319][106226] Updated weights for policy 0, policy_version 1495529 (0.0009) [2023-12-28 06:00:36,383][106226] Updated weights for policy 0, policy_version 1495539 (0.0008) [2023-12-28 06:00:37,012][106226] Updated weights for policy 0, policy_version 1495549 (0.0007) [2023-12-28 06:00:37,014][106225] Updated weights for policy 1, policy_version 1499167 (0.0008) [2023-12-28 06:00:37,069][106225] Updated weights for policy 1, policy_version 1499177 (0.0008) [2023-12-28 06:00:37,072][106226] Updated weights for policy 0, policy_version 1495559 (0.0006) [2023-12-28 06:00:37,126][106225] Updated weights for policy 1, policy_version 1499187 (0.0009) [2023-12-28 06:00:37,136][106226] Updated weights for policy 0, policy_version 1495569 (0.0007) [2023-12-28 06:00:37,798][106226] Updated weights for policy 0, policy_version 1495579 (0.0006) [2023-12-28 06:00:37,850][106226] Updated weights for policy 0, policy_version 1495589 (0.0008) [2023-12-28 06:00:37,889][106225] Updated weights for policy 1, policy_version 1499197 (0.0007) [2023-12-28 06:00:37,900][106226] Updated weights for policy 0, policy_version 1495599 (0.0006) [2023-12-28 06:00:37,954][106225] Updated weights for policy 1, policy_version 1499207 (0.0010) [2023-12-28 06:00:38,015][106225] Updated weights for policy 1, policy_version 1499217 (0.0010) [2023-12-28 06:00:38,627][106226] Updated weights for policy 0, policy_version 1495609 (0.0006) [2023-12-28 06:00:38,685][106226] Updated weights for policy 0, policy_version 1495619 (0.0008) [2023-12-28 06:00:38,740][106226] Updated weights for policy 0, policy_version 1495629 (0.0008) [2023-12-28 06:00:38,763][106225] Updated weights for policy 1, policy_version 1499227 (0.0009) [2023-12-28 06:00:38,804][106226] Updated weights for policy 0, policy_version 1495639 (0.0008) [2023-12-28 06:00:38,831][106225] Updated weights for policy 1, policy_version 1499237 (0.0011) [2023-12-28 06:00:38,891][106225] Updated weights for policy 1, policy_version 1499247 (0.0008) [2023-12-28 06:00:39,646][106226] Updated weights for policy 0, policy_version 1495649 (0.0009) [2023-12-28 06:00:39,648][106225] Updated weights for policy 1, policy_version 1499257 (0.0006) [2023-12-28 06:00:39,707][106226] Updated weights for policy 0, policy_version 1495659 (0.0007) [2023-12-28 06:00:39,712][106225] Updated weights for policy 1, policy_version 1499267 (0.0006) [2023-12-28 06:00:39,770][106226] Updated weights for policy 0, policy_version 1495669 (0.0008) [2023-12-28 06:00:39,772][106225] Updated weights for policy 1, policy_version 1499277 (0.0008) [2023-12-28 06:00:39,838][106225] Updated weights for policy 1, policy_version 1499287 (0.0008) [2023-12-28 06:00:40,524][106226] Updated weights for policy 0, policy_version 1495679 (0.0007) [2023-12-28 06:00:40,588][106226] Updated weights for policy 0, policy_version 1495689 (0.0008) [2023-12-28 06:00:40,610][106225] Updated weights for policy 1, policy_version 1499297 (0.0007) [2023-12-28 06:00:40,647][106226] Updated weights for policy 0, policy_version 1495699 (0.0007) [2023-12-28 06:00:40,662][106225] Updated weights for policy 1, policy_version 1499307 (0.0006) [2023-12-28 06:00:40,725][106225] Updated weights for policy 1, policy_version 1499317 (0.0008) [2023-12-28 06:00:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 766853120. Throughput: 0: 9900.8, 1: 9627.0. Samples: 766827564. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:41,175][105115] Avg episode reward: [(0, '-5.026'), (1, '-4.579')] [2023-12-28 06:00:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001499320_383877120.pth... [2023-12-28 06:00:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001495704_382976000.pth... [2023-12-28 06:00:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001498200_383590400.pth [2023-12-28 06:00:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001494584_382689280.pth [2023-12-28 06:00:41,425][106226] Updated weights for policy 0, policy_version 1495709 (0.0008) [2023-12-28 06:00:41,450][106225] Updated weights for policy 1, policy_version 1499327 (0.0007) [2023-12-28 06:00:41,475][106226] Updated weights for policy 0, policy_version 1495719 (0.0008) [2023-12-28 06:00:41,511][106225] Updated weights for policy 1, policy_version 1499337 (0.0006) [2023-12-28 06:00:41,529][106226] Updated weights for policy 0, policy_version 1495729 (0.0007) [2023-12-28 06:00:41,576][106225] Updated weights for policy 1, policy_version 1499347 (0.0006) [2023-12-28 06:00:42,207][106225] Updated weights for policy 1, policy_version 1499357 (0.0007) [2023-12-28 06:00:42,271][106225] Updated weights for policy 1, policy_version 1499367 (0.0009) [2023-12-28 06:00:42,338][106225] Updated weights for policy 1, policy_version 1499377 (0.0008) [2023-12-28 06:00:42,408][106226] Updated weights for policy 0, policy_version 1495739 (0.0008) [2023-12-28 06:00:42,478][106226] Updated weights for policy 0, policy_version 1495749 (0.0007) [2023-12-28 06:00:42,548][106226] Updated weights for policy 0, policy_version 1495759 (0.0009) [2023-12-28 06:00:43,084][106225] Updated weights for policy 1, policy_version 1499387 (0.0010) [2023-12-28 06:00:43,149][106225] Updated weights for policy 1, policy_version 1499397 (0.0010) [2023-12-28 06:00:43,213][106225] Updated weights for policy 1, policy_version 1499407 (0.0010) [2023-12-28 06:00:43,252][106226] Updated weights for policy 0, policy_version 1495769 (0.0008) [2023-12-28 06:00:43,307][106226] Updated weights for policy 0, policy_version 1495779 (0.0008) [2023-12-28 06:00:43,370][106226] Updated weights for policy 0, policy_version 1495789 (0.0006) [2023-12-28 06:00:43,424][106226] Updated weights for policy 0, policy_version 1495799 (0.0006) [2023-12-28 06:00:43,835][106225] Updated weights for policy 1, policy_version 1499417 (0.0010) [2023-12-28 06:00:43,890][106225] Updated weights for policy 1, policy_version 1499427 (0.0005) [2023-12-28 06:00:43,941][106225] Updated weights for policy 1, policy_version 1499437 (0.0005) [2023-12-28 06:00:43,993][106225] Updated weights for policy 1, policy_version 1499447 (0.0005) [2023-12-28 06:00:44,142][106226] Updated weights for policy 0, policy_version 1495809 (0.0008) [2023-12-28 06:00:44,192][106226] Updated weights for policy 0, policy_version 1495819 (0.0009) [2023-12-28 06:00:44,249][106226] Updated weights for policy 0, policy_version 1495829 (0.0008) [2023-12-28 06:00:44,582][106225] Updated weights for policy 1, policy_version 1499457 (0.0009) [2023-12-28 06:00:44,628][106225] Updated weights for policy 1, policy_version 1499467 (0.0010) [2023-12-28 06:00:44,674][106225] Updated weights for policy 1, policy_version 1499477 (0.0010) [2023-12-28 06:00:45,014][106226] Updated weights for policy 0, policy_version 1495839 (0.0007) [2023-12-28 06:00:45,079][106226] Updated weights for policy 0, policy_version 1495849 (0.0006) [2023-12-28 06:00:45,132][106226] Updated weights for policy 0, policy_version 1495859 (0.0007) [2023-12-28 06:00:45,475][106225] Updated weights for policy 1, policy_version 1499487 (0.0009) [2023-12-28 06:00:45,534][106225] Updated weights for policy 1, policy_version 1499497 (0.0008) [2023-12-28 06:00:45,591][106225] Updated weights for policy 1, policy_version 1499507 (0.0010) [2023-12-28 06:00:45,724][106226] Updated weights for policy 0, policy_version 1495869 (0.0006) [2023-12-28 06:00:45,773][106226] Updated weights for policy 0, policy_version 1495879 (0.0005) [2023-12-28 06:00:45,821][106226] Updated weights for policy 0, policy_version 1495889 (0.0006) [2023-12-28 06:00:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19771.8). Total num frames: 766951424. Throughput: 0: 9751.9, 1: 9651.8. Samples: 766942064. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:46,176][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.980')] [2023-12-28 06:00:46,235][106225] Updated weights for policy 1, policy_version 1499517 (0.0009) [2023-12-28 06:00:46,299][106225] Updated weights for policy 1, policy_version 1499527 (0.0007) [2023-12-28 06:00:46,366][106225] Updated weights for policy 1, policy_version 1499537 (0.0006) [2023-12-28 06:00:46,487][106226] Updated weights for policy 0, policy_version 1495899 (0.0005) [2023-12-28 06:00:46,543][106226] Updated weights for policy 0, policy_version 1495909 (0.0005) [2023-12-28 06:00:46,598][106226] Updated weights for policy 0, policy_version 1495919 (0.0006) [2023-12-28 06:00:46,922][106225] Updated weights for policy 1, policy_version 1499547 (0.0006) [2023-12-28 06:00:46,982][106225] Updated weights for policy 1, policy_version 1499557 (0.0008) [2023-12-28 06:00:47,045][106225] Updated weights for policy 1, policy_version 1499567 (0.0008) [2023-12-28 06:00:47,263][106226] Updated weights for policy 0, policy_version 1495929 (0.0010) [2023-12-28 06:00:47,320][106226] Updated weights for policy 0, policy_version 1495939 (0.0005) [2023-12-28 06:00:47,373][106226] Updated weights for policy 0, policy_version 1495949 (0.0005) [2023-12-28 06:00:47,426][106226] Updated weights for policy 0, policy_version 1495959 (0.0008) [2023-12-28 06:00:47,752][106225] Updated weights for policy 1, policy_version 1499577 (0.0008) [2023-12-28 06:00:47,821][106225] Updated weights for policy 1, policy_version 1499587 (0.0008) [2023-12-28 06:00:47,888][106225] Updated weights for policy 1, policy_version 1499597 (0.0008) [2023-12-28 06:00:47,943][106225] Updated weights for policy 1, policy_version 1499607 (0.0008) [2023-12-28 06:00:48,028][106226] Updated weights for policy 0, policy_version 1495969 (0.0009) [2023-12-28 06:00:48,086][106226] Updated weights for policy 0, policy_version 1495979 (0.0008) [2023-12-28 06:00:48,133][106226] Updated weights for policy 0, policy_version 1495989 (0.0008) [2023-12-28 06:00:48,600][106225] Updated weights for policy 1, policy_version 1499617 (0.0008) [2023-12-28 06:00:48,653][106225] Updated weights for policy 1, policy_version 1499627 (0.0006) [2023-12-28 06:00:48,714][106225] Updated weights for policy 1, policy_version 1499637 (0.0005) [2023-12-28 06:00:48,798][106226] Updated weights for policy 0, policy_version 1495999 (0.0006) [2023-12-28 06:00:48,861][106226] Updated weights for policy 0, policy_version 1496009 (0.0005) [2023-12-28 06:00:48,926][106226] Updated weights for policy 0, policy_version 1496019 (0.0007) [2023-12-28 06:00:49,499][106225] Updated weights for policy 1, policy_version 1499647 (0.0008) [2023-12-28 06:00:49,559][106225] Updated weights for policy 1, policy_version 1499657 (0.0008) [2023-12-28 06:00:49,565][106226] Updated weights for policy 0, policy_version 1496029 (0.0007) [2023-12-28 06:00:49,618][106225] Updated weights for policy 1, policy_version 1499667 (0.0006) [2023-12-28 06:00:49,627][106226] Updated weights for policy 0, policy_version 1496039 (0.0008) [2023-12-28 06:00:49,689][106226] Updated weights for policy 0, policy_version 1496049 (0.0007) [2023-12-28 06:00:50,280][106225] Updated weights for policy 1, policy_version 1499677 (0.0008) [2023-12-28 06:00:50,342][106225] Updated weights for policy 1, policy_version 1499687 (0.0011) [2023-12-28 06:00:50,371][106226] Updated weights for policy 0, policy_version 1496059 (0.0007) [2023-12-28 06:00:50,393][106225] Updated weights for policy 1, policy_version 1499697 (0.0010) [2023-12-28 06:00:50,433][106226] Updated weights for policy 0, policy_version 1496069 (0.0008) [2023-12-28 06:00:50,492][106226] Updated weights for policy 0, policy_version 1496079 (0.0008) [2023-12-28 06:00:51,080][106225] Updated weights for policy 1, policy_version 1499707 (0.0009) [2023-12-28 06:00:51,106][106226] Updated weights for policy 0, policy_version 1496089 (0.0008) [2023-12-28 06:00:51,146][106225] Updated weights for policy 1, policy_version 1499717 (0.0008) [2023-12-28 06:00:51,170][106226] Updated weights for policy 0, policy_version 1496099 (0.0011) [2023-12-28 06:00:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 767049728. Throughput: 0: 9809.7, 1: 9679.6. Samples: 767065548. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:51,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-4.823')] [2023-12-28 06:00:51,209][106225] Updated weights for policy 1, policy_version 1499727 (0.0009) [2023-12-28 06:00:51,239][106226] Updated weights for policy 0, policy_version 1496109 (0.0011) [2023-12-28 06:00:51,303][106226] Updated weights for policy 0, policy_version 1496119 (0.0009) [2023-12-28 06:00:51,899][106225] Updated weights for policy 1, policy_version 1499737 (0.0007) [2023-12-28 06:00:51,968][106225] Updated weights for policy 1, policy_version 1499747 (0.0008) [2023-12-28 06:00:52,039][106225] Updated weights for policy 1, policy_version 1499757 (0.0009) [2023-12-28 06:00:52,057][106226] Updated weights for policy 0, policy_version 1496129 (0.0006) [2023-12-28 06:00:52,098][106225] Updated weights for policy 1, policy_version 1499767 (0.0010) [2023-12-28 06:00:52,107][106226] Updated weights for policy 0, policy_version 1496139 (0.0008) [2023-12-28 06:00:52,157][106226] Updated weights for policy 0, policy_version 1496149 (0.0005) [2023-12-28 06:00:52,838][106225] Updated weights for policy 1, policy_version 1499777 (0.0010) [2023-12-28 06:00:52,896][106226] Updated weights for policy 0, policy_version 1496159 (0.0006) [2023-12-28 06:00:52,898][106225] Updated weights for policy 1, policy_version 1499787 (0.0010) [2023-12-28 06:00:52,955][106226] Updated weights for policy 0, policy_version 1496169 (0.0007) [2023-12-28 06:00:52,960][106225] Updated weights for policy 1, policy_version 1499797 (0.0006) [2023-12-28 06:00:53,013][106226] Updated weights for policy 0, policy_version 1496179 (0.0007) [2023-12-28 06:00:53,585][106225] Updated weights for policy 1, policy_version 1499807 (0.0006) [2023-12-28 06:00:53,641][106225] Updated weights for policy 1, policy_version 1499817 (0.0009) [2023-12-28 06:00:53,700][106225] Updated weights for policy 1, policy_version 1499827 (0.0005) [2023-12-28 06:00:53,769][106226] Updated weights for policy 0, policy_version 1496189 (0.0008) [2023-12-28 06:00:53,823][106226] Updated weights for policy 0, policy_version 1496199 (0.0009) [2023-12-28 06:00:53,876][106226] Updated weights for policy 0, policy_version 1496209 (0.0007) [2023-12-28 06:00:54,220][106225] Updated weights for policy 1, policy_version 1499837 (0.0008) [2023-12-28 06:00:54,279][106225] Updated weights for policy 1, policy_version 1499847 (0.0010) [2023-12-28 06:00:54,336][106225] Updated weights for policy 1, policy_version 1499857 (0.0010) [2023-12-28 06:00:54,727][106226] Updated weights for policy 0, policy_version 1496219 (0.0009) [2023-12-28 06:00:54,788][106226] Updated weights for policy 0, policy_version 1496229 (0.0008) [2023-12-28 06:00:54,846][106226] Updated weights for policy 0, policy_version 1496239 (0.0005) [2023-12-28 06:00:54,962][106225] Updated weights for policy 1, policy_version 1499867 (0.0011) [2023-12-28 06:00:55,025][106225] Updated weights for policy 1, policy_version 1499877 (0.0010) [2023-12-28 06:00:55,088][106225] Updated weights for policy 1, policy_version 1499887 (0.0008) [2023-12-28 06:00:55,538][106226] Updated weights for policy 0, policy_version 1496249 (0.0005) [2023-12-28 06:00:55,596][106226] Updated weights for policy 0, policy_version 1496259 (0.0005) [2023-12-28 06:00:55,649][106226] Updated weights for policy 0, policy_version 1496269 (0.0005) [2023-12-28 06:00:55,711][106226] Updated weights for policy 0, policy_version 1496279 (0.0005) [2023-12-28 06:00:55,749][106225] Updated weights for policy 1, policy_version 1499897 (0.0008) [2023-12-28 06:00:55,815][106225] Updated weights for policy 1, policy_version 1499907 (0.0008) [2023-12-28 06:00:55,878][106225] Updated weights for policy 1, policy_version 1499917 (0.0008) [2023-12-28 06:00:55,944][106225] Updated weights for policy 1, policy_version 1499927 (0.0009) [2023-12-28 06:00:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 767156224. Throughput: 0: 9731.6, 1: 9670.7. Samples: 767122444. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:00:56,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-4.855')] [2023-12-28 06:00:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001499928_384032768.pth... [2023-12-28 06:00:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001496280_383123456.pth... [2023-12-28 06:00:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001498776_383737856.pth [2023-12-28 06:00:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001495128_382828544.pth [2023-12-28 06:00:56,273][106226] Updated weights for policy 0, policy_version 1496289 (0.0008) [2023-12-28 06:00:56,338][106226] Updated weights for policy 0, policy_version 1496299 (0.0008) [2023-12-28 06:00:56,396][106226] Updated weights for policy 0, policy_version 1496309 (0.0008) [2023-12-28 06:00:56,552][106225] Updated weights for policy 1, policy_version 1499937 (0.0009) [2023-12-28 06:00:56,611][106225] Updated weights for policy 1, policy_version 1499947 (0.0005) [2023-12-28 06:00:56,676][106225] Updated weights for policy 1, policy_version 1499957 (0.0006) [2023-12-28 06:00:57,117][106226] Updated weights for policy 0, policy_version 1496319 (0.0008) [2023-12-28 06:00:57,171][106226] Updated weights for policy 0, policy_version 1496329 (0.0007) [2023-12-28 06:00:57,229][106226] Updated weights for policy 0, policy_version 1496339 (0.0005) [2023-12-28 06:00:57,265][106225] Updated weights for policy 1, policy_version 1499967 (0.0010) [2023-12-28 06:00:57,327][106225] Updated weights for policy 1, policy_version 1499977 (0.0008) [2023-12-28 06:00:57,379][106225] Updated weights for policy 1, policy_version 1499987 (0.0008) [2023-12-28 06:00:57,948][106226] Updated weights for policy 0, policy_version 1496349 (0.0007) [2023-12-28 06:00:58,001][106226] Updated weights for policy 0, policy_version 1496359 (0.0008) [2023-12-28 06:00:58,024][106225] Updated weights for policy 1, policy_version 1499997 (0.0010) [2023-12-28 06:00:58,057][106226] Updated weights for policy 0, policy_version 1496369 (0.0006) [2023-12-28 06:00:58,070][106225] Updated weights for policy 1, policy_version 1500007 (0.0010) [2023-12-28 06:00:58,124][106225] Updated weights for policy 1, policy_version 1500017 (0.0010) [2023-12-28 06:00:58,804][106226] Updated weights for policy 0, policy_version 1496379 (0.0006) [2023-12-28 06:00:58,878][106226] Updated weights for policy 0, policy_version 1496389 (0.0009) [2023-12-28 06:00:58,940][106226] Updated weights for policy 0, policy_version 1496399 (0.0008) [2023-12-28 06:00:59,004][106225] Updated weights for policy 1, policy_version 1500027 (0.0010) [2023-12-28 06:00:59,063][106225] Updated weights for policy 1, policy_version 1500037 (0.0008) [2023-12-28 06:00:59,116][106225] Updated weights for policy 1, policy_version 1500047 (0.0008) [2023-12-28 06:00:59,698][106226] Updated weights for policy 0, policy_version 1496409 (0.0008) [2023-12-28 06:00:59,764][106226] Updated weights for policy 0, policy_version 1496419 (0.0006) [2023-12-28 06:00:59,834][106226] Updated weights for policy 0, policy_version 1496429 (0.0009) [2023-12-28 06:00:59,895][106226] Updated weights for policy 0, policy_version 1496439 (0.0008) [2023-12-28 06:00:59,909][106225] Updated weights for policy 1, policy_version 1500057 (0.0008) [2023-12-28 06:00:59,978][106225] Updated weights for policy 1, policy_version 1500067 (0.0009) [2023-12-28 06:01:00,041][106225] Updated weights for policy 1, policy_version 1500077 (0.0008) [2023-12-28 06:01:00,104][106225] Updated weights for policy 1, policy_version 1500087 (0.0009) [2023-12-28 06:01:00,562][106226] Updated weights for policy 0, policy_version 1496449 (0.0008) [2023-12-28 06:01:00,621][106226] Updated weights for policy 0, policy_version 1496459 (0.0005) [2023-12-28 06:01:00,681][106226] Updated weights for policy 0, policy_version 1496469 (0.0009) [2023-12-28 06:01:00,871][106225] Updated weights for policy 1, policy_version 1500097 (0.0008) [2023-12-28 06:01:00,923][106225] Updated weights for policy 1, policy_version 1500107 (0.0010) [2023-12-28 06:01:00,973][106225] Updated weights for policy 1, policy_version 1500118 (0.0009) [2023-12-28 06:01:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 767254528. Throughput: 0: 9772.9, 1: 9840.3. Samples: 767242756. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:01,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.580')] [2023-12-28 06:01:01,340][106226] Updated weights for policy 0, policy_version 1496479 (0.0010) [2023-12-28 06:01:01,408][106226] Updated weights for policy 0, policy_version 1496489 (0.0007) [2023-12-28 06:01:01,463][106226] Updated weights for policy 0, policy_version 1496499 (0.0009) [2023-12-28 06:01:01,804][106225] Updated weights for policy 1, policy_version 1500128 (0.0007) [2023-12-28 06:01:01,874][106225] Updated weights for policy 1, policy_version 1500138 (0.0006) [2023-12-28 06:01:01,939][106225] Updated weights for policy 1, policy_version 1500148 (0.0010) [2023-12-28 06:01:02,142][106226] Updated weights for policy 0, policy_version 1496509 (0.0009) [2023-12-28 06:01:02,192][106226] Updated weights for policy 0, policy_version 1496519 (0.0010) [2023-12-28 06:01:02,243][106226] Updated weights for policy 0, policy_version 1496529 (0.0010) [2023-12-28 06:01:02,671][106225] Updated weights for policy 1, policy_version 1500158 (0.0010) [2023-12-28 06:01:02,736][106225] Updated weights for policy 1, policy_version 1500168 (0.0009) [2023-12-28 06:01:02,800][106225] Updated weights for policy 1, policy_version 1500178 (0.0008) [2023-12-28 06:01:02,878][106226] Updated weights for policy 0, policy_version 1496539 (0.0008) [2023-12-28 06:01:02,932][106226] Updated weights for policy 0, policy_version 1496549 (0.0005) [2023-12-28 06:01:02,982][106226] Updated weights for policy 0, policy_version 1496559 (0.0005) [2023-12-28 06:01:03,541][106225] Updated weights for policy 1, policy_version 1500188 (0.0007) [2023-12-28 06:01:03,581][106226] Updated weights for policy 0, policy_version 1496569 (0.0005) [2023-12-28 06:01:03,599][106225] Updated weights for policy 1, policy_version 1500198 (0.0005) [2023-12-28 06:01:03,639][106226] Updated weights for policy 0, policy_version 1496579 (0.0005) [2023-12-28 06:01:03,655][106225] Updated weights for policy 1, policy_version 1500208 (0.0005) [2023-12-28 06:01:03,693][106226] Updated weights for policy 0, policy_version 1496589 (0.0005) [2023-12-28 06:01:03,742][106226] Updated weights for policy 0, policy_version 1496599 (0.0005) [2023-12-28 06:01:04,344][106225] Updated weights for policy 1, policy_version 1500218 (0.0007) [2023-12-28 06:01:04,415][106225] Updated weights for policy 1, policy_version 1500228 (0.0006) [2023-12-28 06:01:04,443][106226] Updated weights for policy 0, policy_version 1496609 (0.0008) [2023-12-28 06:01:04,479][106225] Updated weights for policy 1, policy_version 1500238 (0.0006) [2023-12-28 06:01:04,505][106226] Updated weights for policy 0, policy_version 1496619 (0.0008) [2023-12-28 06:01:04,540][106225] Updated weights for policy 1, policy_version 1500248 (0.0008) [2023-12-28 06:01:04,557][106226] Updated weights for policy 0, policy_version 1496629 (0.0008) [2023-12-28 06:01:05,124][106225] Updated weights for policy 1, policy_version 1500258 (0.0009) [2023-12-28 06:01:05,126][106226] Updated weights for policy 0, policy_version 1496639 (0.0008) [2023-12-28 06:01:05,185][106225] Updated weights for policy 1, policy_version 1500268 (0.0006) [2023-12-28 06:01:05,187][106226] Updated weights for policy 0, policy_version 1496649 (0.0009) [2023-12-28 06:01:05,242][106225] Updated weights for policy 1, policy_version 1500278 (0.0010) [2023-12-28 06:01:05,250][106226] Updated weights for policy 0, policy_version 1496659 (0.0006) [2023-12-28 06:01:05,912][106225] Updated weights for policy 1, policy_version 1500288 (0.0009) [2023-12-28 06:01:05,932][106226] Updated weights for policy 0, policy_version 1496669 (0.0005) [2023-12-28 06:01:05,975][106225] Updated weights for policy 1, policy_version 1500298 (0.0008) [2023-12-28 06:01:05,989][106226] Updated weights for policy 0, policy_version 1496679 (0.0007) [2023-12-28 06:01:06,028][106225] Updated weights for policy 1, policy_version 1500308 (0.0006) [2023-12-28 06:01:06,054][106226] Updated weights for policy 0, policy_version 1496689 (0.0008) [2023-12-28 06:01:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 767361024. Throughput: 0: 9928.0, 1: 9871.8. Samples: 767364052. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:06,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.746')] [2023-12-28 06:01:06,718][106225] Updated weights for policy 1, policy_version 1500318 (0.0007) [2023-12-28 06:01:06,780][106225] Updated weights for policy 1, policy_version 1500328 (0.0008) [2023-12-28 06:01:06,796][106226] Updated weights for policy 0, policy_version 1496699 (0.0008) [2023-12-28 06:01:06,838][106225] Updated weights for policy 1, policy_version 1500338 (0.0005) [2023-12-28 06:01:06,855][106226] Updated weights for policy 0, policy_version 1496709 (0.0008) [2023-12-28 06:01:06,912][106226] Updated weights for policy 0, policy_version 1496719 (0.0009) [2023-12-28 06:01:07,509][106225] Updated weights for policy 1, policy_version 1500348 (0.0007) [2023-12-28 06:01:07,571][106225] Updated weights for policy 1, policy_version 1500358 (0.0009) [2023-12-28 06:01:07,593][106226] Updated weights for policy 0, policy_version 1496729 (0.0008) [2023-12-28 06:01:07,632][106225] Updated weights for policy 1, policy_version 1500368 (0.0010) [2023-12-28 06:01:07,654][106226] Updated weights for policy 0, policy_version 1496739 (0.0006) [2023-12-28 06:01:07,712][106226] Updated weights for policy 0, policy_version 1496749 (0.0007) [2023-12-28 06:01:07,774][106226] Updated weights for policy 0, policy_version 1496759 (0.0010) [2023-12-28 06:01:08,242][106225] Updated weights for policy 1, policy_version 1500378 (0.0010) [2023-12-28 06:01:08,301][106225] Updated weights for policy 1, policy_version 1500388 (0.0010) [2023-12-28 06:01:08,365][106225] Updated weights for policy 1, policy_version 1500398 (0.0011) [2023-12-28 06:01:08,430][106225] Updated weights for policy 1, policy_version 1500408 (0.0011) [2023-12-28 06:01:08,531][106226] Updated weights for policy 0, policy_version 1496769 (0.0008) [2023-12-28 06:01:08,589][106226] Updated weights for policy 0, policy_version 1496779 (0.0007) [2023-12-28 06:01:08,650][106226] Updated weights for policy 0, policy_version 1496789 (0.0008) [2023-12-28 06:01:09,087][106225] Updated weights for policy 1, policy_version 1500418 (0.0005) [2023-12-28 06:01:09,144][106225] Updated weights for policy 1, policy_version 1500428 (0.0005) [2023-12-28 06:01:09,194][106225] Updated weights for policy 1, policy_version 1500438 (0.0008) [2023-12-28 06:01:09,429][106226] Updated weights for policy 0, policy_version 1496799 (0.0008) [2023-12-28 06:01:09,495][106226] Updated weights for policy 0, policy_version 1496809 (0.0012) [2023-12-28 06:01:09,557][106226] Updated weights for policy 0, policy_version 1496819 (0.0011) [2023-12-28 06:01:09,937][106225] Updated weights for policy 1, policy_version 1500448 (0.0008) [2023-12-28 06:01:09,993][106225] Updated weights for policy 1, policy_version 1500458 (0.0007) [2023-12-28 06:01:10,053][106225] Updated weights for policy 1, policy_version 1500468 (0.0008) [2023-12-28 06:01:10,307][106226] Updated weights for policy 0, policy_version 1496829 (0.0010) [2023-12-28 06:01:10,357][106226] Updated weights for policy 0, policy_version 1496839 (0.0008) [2023-12-28 06:01:10,415][106226] Updated weights for policy 0, policy_version 1496849 (0.0009) [2023-12-28 06:01:10,730][106225] Updated weights for policy 1, policy_version 1500478 (0.0008) [2023-12-28 06:01:10,793][106225] Updated weights for policy 1, policy_version 1500488 (0.0008) [2023-12-28 06:01:10,854][106225] Updated weights for policy 1, policy_version 1500498 (0.0006) [2023-12-28 06:01:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 767451136. Throughput: 0: 9936.2, 1: 9920.2. Samples: 767423300. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:11,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.925')] [2023-12-28 06:01:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001500504_384180224.pth... [2023-12-28 06:01:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001496856_383270912.pth... [2023-12-28 06:01:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001499320_383877120.pth [2023-12-28 06:01:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001495704_382976000.pth [2023-12-28 06:01:11,231][106226] Updated weights for policy 0, policy_version 1496859 (0.0009) [2023-12-28 06:01:11,299][106226] Updated weights for policy 0, policy_version 1496869 (0.0007) [2023-12-28 06:01:11,377][106226] Updated weights for policy 0, policy_version 1496879 (0.0007) [2023-12-28 06:01:11,555][106225] Updated weights for policy 1, policy_version 1500508 (0.0006) [2023-12-28 06:01:11,625][106225] Updated weights for policy 1, policy_version 1500518 (0.0008) [2023-12-28 06:01:11,689][106225] Updated weights for policy 1, policy_version 1500528 (0.0011) [2023-12-28 06:01:12,111][106226] Updated weights for policy 0, policy_version 1496889 (0.0007) [2023-12-28 06:01:12,175][106226] Updated weights for policy 0, policy_version 1496899 (0.0008) [2023-12-28 06:01:12,226][106226] Updated weights for policy 0, policy_version 1496909 (0.0008) [2023-12-28 06:01:12,286][106226] Updated weights for policy 0, policy_version 1496919 (0.0008) [2023-12-28 06:01:12,425][106225] Updated weights for policy 1, policy_version 1500538 (0.0009) [2023-12-28 06:01:12,480][106225] Updated weights for policy 1, policy_version 1500548 (0.0010) [2023-12-28 06:01:12,537][106225] Updated weights for policy 1, policy_version 1500558 (0.0006) [2023-12-28 06:01:12,595][106225] Updated weights for policy 1, policy_version 1500568 (0.0006) [2023-12-28 06:01:13,065][106226] Updated weights for policy 0, policy_version 1496929 (0.0009) [2023-12-28 06:01:13,120][106226] Updated weights for policy 0, policy_version 1496939 (0.0007) [2023-12-28 06:01:13,170][106226] Updated weights for policy 0, policy_version 1496949 (0.0008) [2023-12-28 06:01:13,253][106225] Updated weights for policy 1, policy_version 1500578 (0.0005) [2023-12-28 06:01:13,309][106225] Updated weights for policy 1, policy_version 1500588 (0.0008) [2023-12-28 06:01:13,371][106225] Updated weights for policy 1, policy_version 1500598 (0.0007) [2023-12-28 06:01:13,938][106226] Updated weights for policy 0, policy_version 1496959 (0.0008) [2023-12-28 06:01:13,992][106226] Updated weights for policy 0, policy_version 1496969 (0.0008) [2023-12-28 06:01:14,044][106226] Updated weights for policy 0, policy_version 1496979 (0.0008) [2023-12-28 06:01:14,077][106225] Updated weights for policy 1, policy_version 1500608 (0.0009) [2023-12-28 06:01:14,137][106225] Updated weights for policy 1, policy_version 1500618 (0.0011) [2023-12-28 06:01:14,200][106225] Updated weights for policy 1, policy_version 1500628 (0.0010) [2023-12-28 06:01:14,834][106226] Updated weights for policy 0, policy_version 1496989 (0.0007) [2023-12-28 06:01:14,886][106225] Updated weights for policy 1, policy_version 1500638 (0.0011) [2023-12-28 06:01:14,894][106226] Updated weights for policy 0, policy_version 1496999 (0.0009) [2023-12-28 06:01:14,941][106225] Updated weights for policy 1, policy_version 1500648 (0.0011) [2023-12-28 06:01:14,957][106226] Updated weights for policy 0, policy_version 1497009 (0.0009) [2023-12-28 06:01:15,005][106225] Updated weights for policy 1, policy_version 1500658 (0.0011) [2023-12-28 06:01:15,701][106226] Updated weights for policy 0, policy_version 1497019 (0.0006) [2023-12-28 06:01:15,730][106225] Updated weights for policy 1, policy_version 1500668 (0.0010) [2023-12-28 06:01:15,755][106226] Updated weights for policy 0, policy_version 1497029 (0.0009) [2023-12-28 06:01:15,786][106225] Updated weights for policy 1, policy_version 1500678 (0.0007) [2023-12-28 06:01:15,807][106226] Updated weights for policy 0, policy_version 1497039 (0.0009) [2023-12-28 06:01:15,845][106225] Updated weights for policy 1, policy_version 1500688 (0.0007) [2023-12-28 06:01:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 767549440. Throughput: 0: 9803.2, 1: 9901.2. Samples: 767537380. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:16,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.947')] [2023-12-28 06:01:16,464][106226] Updated weights for policy 0, policy_version 1497049 (0.0007) [2023-12-28 06:01:16,521][106226] Updated weights for policy 0, policy_version 1497059 (0.0005) [2023-12-28 06:01:16,533][106225] Updated weights for policy 1, policy_version 1500698 (0.0010) [2023-12-28 06:01:16,566][106226] Updated weights for policy 0, policy_version 1497069 (0.0007) [2023-12-28 06:01:16,587][106225] Updated weights for policy 1, policy_version 1500708 (0.0010) [2023-12-28 06:01:16,620][106226] Updated weights for policy 0, policy_version 1497079 (0.0007) [2023-12-28 06:01:16,636][106225] Updated weights for policy 1, policy_version 1500718 (0.0010) [2023-12-28 06:01:16,686][106225] Updated weights for policy 1, policy_version 1500728 (0.0010) [2023-12-28 06:01:17,303][106226] Updated weights for policy 0, policy_version 1497089 (0.0008) [2023-12-28 06:01:17,343][106225] Updated weights for policy 1, policy_version 1500738 (0.0005) [2023-12-28 06:01:17,350][106226] Updated weights for policy 0, policy_version 1497099 (0.0009) [2023-12-28 06:01:17,402][106225] Updated weights for policy 1, policy_version 1500748 (0.0009) [2023-12-28 06:01:17,405][106226] Updated weights for policy 0, policy_version 1497109 (0.0008) [2023-12-28 06:01:17,458][106225] Updated weights for policy 1, policy_version 1500758 (0.0010) [2023-12-28 06:01:18,079][106226] Updated weights for policy 0, policy_version 1497119 (0.0008) [2023-12-28 06:01:18,134][106226] Updated weights for policy 0, policy_version 1497129 (0.0008) [2023-12-28 06:01:18,139][106225] Updated weights for policy 1, policy_version 1500768 (0.0007) [2023-12-28 06:01:18,182][106226] Updated weights for policy 0, policy_version 1497139 (0.0009) [2023-12-28 06:01:18,190][106225] Updated weights for policy 1, policy_version 1500778 (0.0006) [2023-12-28 06:01:18,253][106225] Updated weights for policy 1, policy_version 1500788 (0.0007) [2023-12-28 06:01:18,910][106226] Updated weights for policy 0, policy_version 1497149 (0.0008) [2023-12-28 06:01:18,974][106226] Updated weights for policy 0, policy_version 1497159 (0.0008) [2023-12-28 06:01:19,015][106225] Updated weights for policy 1, policy_version 1500798 (0.0009) [2023-12-28 06:01:19,033][106226] Updated weights for policy 0, policy_version 1497169 (0.0006) [2023-12-28 06:01:19,069][106225] Updated weights for policy 1, policy_version 1500808 (0.0010) [2023-12-28 06:01:19,116][106225] Updated weights for policy 1, policy_version 1500818 (0.0010) [2023-12-28 06:01:19,770][106226] Updated weights for policy 0, policy_version 1497179 (0.0006) [2023-12-28 06:01:19,845][106226] Updated weights for policy 0, policy_version 1497189 (0.0008) [2023-12-28 06:01:19,900][106226] Updated weights for policy 0, policy_version 1497199 (0.0007) [2023-12-28 06:01:19,942][106225] Updated weights for policy 1, policy_version 1500828 (0.0010) [2023-12-28 06:01:20,001][106225] Updated weights for policy 1, policy_version 1500838 (0.0011) [2023-12-28 06:01:20,055][106225] Updated weights for policy 1, policy_version 1500848 (0.0011) [2023-12-28 06:01:20,618][106226] Updated weights for policy 0, policy_version 1497209 (0.0008) [2023-12-28 06:01:20,685][106226] Updated weights for policy 0, policy_version 1497219 (0.0009) [2023-12-28 06:01:20,751][106226] Updated weights for policy 0, policy_version 1497229 (0.0007) [2023-12-28 06:01:20,759][106225] Updated weights for policy 1, policy_version 1500858 (0.0010) [2023-12-28 06:01:20,816][106226] Updated weights for policy 0, policy_version 1497239 (0.0008) [2023-12-28 06:01:20,822][106225] Updated weights for policy 1, policy_version 1500868 (0.0009) [2023-12-28 06:01:20,896][106225] Updated weights for policy 1, policy_version 1500878 (0.0009) [2023-12-28 06:01:20,963][106225] Updated weights for policy 1, policy_version 1500888 (0.0010) [2023-12-28 06:01:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 767647744. Throughput: 0: 9765.0, 1: 9905.6. Samples: 767655344. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:21,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.735')] [2023-12-28 06:01:21,579][106226] Updated weights for policy 0, policy_version 1497249 (0.0005) [2023-12-28 06:01:21,646][106226] Updated weights for policy 0, policy_version 1497259 (0.0007) [2023-12-28 06:01:21,659][106225] Updated weights for policy 1, policy_version 1500898 (0.0009) [2023-12-28 06:01:21,714][106226] Updated weights for policy 0, policy_version 1497269 (0.0008) [2023-12-28 06:01:21,729][106225] Updated weights for policy 1, policy_version 1500908 (0.0008) [2023-12-28 06:01:21,796][106225] Updated weights for policy 1, policy_version 1500918 (0.0008) [2023-12-28 06:01:22,488][106225] Updated weights for policy 1, policy_version 1500928 (0.0006) [2023-12-28 06:01:22,528][106226] Updated weights for policy 0, policy_version 1497279 (0.0008) [2023-12-28 06:01:22,553][106225] Updated weights for policy 1, policy_version 1500938 (0.0006) [2023-12-28 06:01:22,597][106226] Updated weights for policy 0, policy_version 1497289 (0.0007) [2023-12-28 06:01:22,611][106225] Updated weights for policy 1, policy_version 1500948 (0.0006) [2023-12-28 06:01:22,658][106226] Updated weights for policy 0, policy_version 1497299 (0.0007) [2023-12-28 06:01:23,268][106225] Updated weights for policy 1, policy_version 1500958 (0.0007) [2023-12-28 06:01:23,320][106225] Updated weights for policy 1, policy_version 1500968 (0.0008) [2023-12-28 06:01:23,370][106225] Updated weights for policy 1, policy_version 1500978 (0.0009) [2023-12-28 06:01:23,384][106226] Updated weights for policy 0, policy_version 1497309 (0.0008) [2023-12-28 06:01:23,442][106226] Updated weights for policy 0, policy_version 1497319 (0.0008) [2023-12-28 06:01:23,489][106226] Updated weights for policy 0, policy_version 1497329 (0.0008) [2023-12-28 06:01:23,976][106225] Updated weights for policy 1, policy_version 1500988 (0.0007) [2023-12-28 06:01:24,028][106225] Updated weights for policy 1, policy_version 1500998 (0.0007) [2023-12-28 06:01:24,076][106225] Updated weights for policy 1, policy_version 1501008 (0.0009) [2023-12-28 06:01:24,268][106226] Updated weights for policy 0, policy_version 1497339 (0.0009) [2023-12-28 06:01:24,327][106226] Updated weights for policy 0, policy_version 1497349 (0.0010) [2023-12-28 06:01:24,390][106226] Updated weights for policy 0, policy_version 1497359 (0.0011) [2023-12-28 06:01:24,828][106225] Updated weights for policy 1, policy_version 1501018 (0.0010) [2023-12-28 06:01:24,893][106225] Updated weights for policy 1, policy_version 1501028 (0.0010) [2023-12-28 06:01:24,948][106225] Updated weights for policy 1, policy_version 1501038 (0.0009) [2023-12-28 06:01:24,995][106225] Updated weights for policy 1, policy_version 1501048 (0.0008) [2023-12-28 06:01:25,039][106226] Updated weights for policy 0, policy_version 1497369 (0.0010) [2023-12-28 06:01:25,096][106226] Updated weights for policy 0, policy_version 1497379 (0.0009) [2023-12-28 06:01:25,153][106226] Updated weights for policy 0, policy_version 1497389 (0.0009) [2023-12-28 06:01:25,214][106226] Updated weights for policy 0, policy_version 1497399 (0.0008) [2023-12-28 06:01:25,617][106225] Updated weights for policy 1, policy_version 1501058 (0.0006) [2023-12-28 06:01:25,678][106225] Updated weights for policy 1, policy_version 1501068 (0.0006) [2023-12-28 06:01:25,735][106225] Updated weights for policy 1, policy_version 1501078 (0.0005) [2023-12-28 06:01:25,974][106226] Updated weights for policy 0, policy_version 1497409 (0.0005) [2023-12-28 06:01:26,031][106226] Updated weights for policy 0, policy_version 1497419 (0.0005) [2023-12-28 06:01:26,095][106226] Updated weights for policy 0, policy_version 1497429 (0.0005) [2023-12-28 06:01:26,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 767746048. Throughput: 0: 9702.2, 1: 9960.8. Samples: 767712396. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:26,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-5.035')] [2023-12-28 06:01:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001501080_384327680.pth... [2023-12-28 06:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001497432_383418368.pth... [2023-12-28 06:01:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001499928_384032768.pth [2023-12-28 06:01:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001496280_383123456.pth [2023-12-28 06:01:26,348][106225] Updated weights for policy 1, policy_version 1501088 (0.0009) [2023-12-28 06:01:26,403][106225] Updated weights for policy 1, policy_version 1501098 (0.0009) [2023-12-28 06:01:26,460][106225] Updated weights for policy 1, policy_version 1501108 (0.0009) [2023-12-28 06:01:26,633][106226] Updated weights for policy 0, policy_version 1497439 (0.0005) [2023-12-28 06:01:26,684][106226] Updated weights for policy 0, policy_version 1497449 (0.0005) [2023-12-28 06:01:26,747][106226] Updated weights for policy 0, policy_version 1497459 (0.0009) [2023-12-28 06:01:27,130][106225] Updated weights for policy 1, policy_version 1501118 (0.0007) [2023-12-28 06:01:27,179][106225] Updated weights for policy 1, policy_version 1501128 (0.0005) [2023-12-28 06:01:27,230][106225] Updated weights for policy 1, policy_version 1501138 (0.0006) [2023-12-28 06:01:27,393][106226] Updated weights for policy 0, policy_version 1497469 (0.0008) [2023-12-28 06:01:27,456][106226] Updated weights for policy 0, policy_version 1497479 (0.0005) [2023-12-28 06:01:27,522][106226] Updated weights for policy 0, policy_version 1497489 (0.0005) [2023-12-28 06:01:27,906][106225] Updated weights for policy 1, policy_version 1501148 (0.0008) [2023-12-28 06:01:27,961][106225] Updated weights for policy 1, policy_version 1501158 (0.0010) [2023-12-28 06:01:28,003][106225] Updated weights for policy 1, policy_version 1501168 (0.0010) [2023-12-28 06:01:28,071][106226] Updated weights for policy 0, policy_version 1497499 (0.0007) [2023-12-28 06:01:28,120][106226] Updated weights for policy 0, policy_version 1497509 (0.0010) [2023-12-28 06:01:28,177][106226] Updated weights for policy 0, policy_version 1497519 (0.0009) [2023-12-28 06:01:28,645][106225] Updated weights for policy 1, policy_version 1501178 (0.0009) [2023-12-28 06:01:28,699][106225] Updated weights for policy 1, policy_version 1501188 (0.0006) [2023-12-28 06:01:28,751][106225] Updated weights for policy 1, policy_version 1501198 (0.0006) [2023-12-28 06:01:28,806][106225] Updated weights for policy 1, policy_version 1501208 (0.0008) [2023-12-28 06:01:28,859][106226] Updated weights for policy 0, policy_version 1497529 (0.0006) [2023-12-28 06:01:28,913][106226] Updated weights for policy 0, policy_version 1497539 (0.0010) [2023-12-28 06:01:28,970][106226] Updated weights for policy 0, policy_version 1497549 (0.0010) [2023-12-28 06:01:29,025][106226] Updated weights for policy 0, policy_version 1497559 (0.0010) [2023-12-28 06:01:29,480][106225] Updated weights for policy 1, policy_version 1501218 (0.0010) [2023-12-28 06:01:29,540][106225] Updated weights for policy 1, policy_version 1501228 (0.0010) [2023-12-28 06:01:29,598][106225] Updated weights for policy 1, policy_version 1501238 (0.0010) [2023-12-28 06:01:29,792][106226] Updated weights for policy 0, policy_version 1497569 (0.0011) [2023-12-28 06:01:29,846][106226] Updated weights for policy 0, policy_version 1497579 (0.0010) [2023-12-28 06:01:29,908][106226] Updated weights for policy 0, policy_version 1497589 (0.0011) [2023-12-28 06:01:30,331][106225] Updated weights for policy 1, policy_version 1501248 (0.0008) [2023-12-28 06:01:30,388][106225] Updated weights for policy 1, policy_version 1501258 (0.0008) [2023-12-28 06:01:30,431][106225] Updated weights for policy 1, policy_version 1501268 (0.0007) [2023-12-28 06:01:30,684][106226] Updated weights for policy 0, policy_version 1497599 (0.0010) [2023-12-28 06:01:30,740][106226] Updated weights for policy 0, policy_version 1497609 (0.0010) [2023-12-28 06:01:30,799][106226] Updated weights for policy 0, policy_version 1497619 (0.0010) [2023-12-28 06:01:31,162][106225] Updated weights for policy 1, policy_version 1501278 (0.0008) [2023-12-28 06:01:31,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 767844352. Throughput: 0: 9851.4, 1: 10041.4. Samples: 767837232. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:31,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.868')] [2023-12-28 06:01:31,218][106225] Updated weights for policy 1, policy_version 1501288 (0.0007) [2023-12-28 06:01:31,280][106225] Updated weights for policy 1, policy_version 1501298 (0.0008) [2023-12-28 06:01:31,550][106226] Updated weights for policy 0, policy_version 1497629 (0.0008) [2023-12-28 06:01:31,615][106226] Updated weights for policy 0, policy_version 1497639 (0.0010) [2023-12-28 06:01:31,677][106226] Updated weights for policy 0, policy_version 1497649 (0.0011) [2023-12-28 06:01:32,050][106225] Updated weights for policy 1, policy_version 1501308 (0.0007) [2023-12-28 06:01:32,110][106225] Updated weights for policy 1, policy_version 1501318 (0.0007) [2023-12-28 06:01:32,168][106225] Updated weights for policy 1, policy_version 1501328 (0.0008) [2023-12-28 06:01:32,414][106226] Updated weights for policy 0, policy_version 1497659 (0.0010) [2023-12-28 06:01:32,475][106226] Updated weights for policy 0, policy_version 1497669 (0.0011) [2023-12-28 06:01:32,530][106226] Updated weights for policy 0, policy_version 1497679 (0.0011) [2023-12-28 06:01:32,904][106225] Updated weights for policy 1, policy_version 1501338 (0.0007) [2023-12-28 06:01:32,963][106225] Updated weights for policy 1, policy_version 1501348 (0.0005) [2023-12-28 06:01:33,023][106225] Updated weights for policy 1, policy_version 1501358 (0.0005) [2023-12-28 06:01:33,086][106225] Updated weights for policy 1, policy_version 1501368 (0.0009) [2023-12-28 06:01:33,233][106226] Updated weights for policy 0, policy_version 1497689 (0.0010) [2023-12-28 06:01:33,290][106226] Updated weights for policy 0, policy_version 1497699 (0.0005) [2023-12-28 06:01:33,340][106226] Updated weights for policy 0, policy_version 1497709 (0.0005) [2023-12-28 06:01:33,393][106226] Updated weights for policy 0, policy_version 1497719 (0.0008) [2023-12-28 06:01:33,723][106225] Updated weights for policy 1, policy_version 1501378 (0.0010) [2023-12-28 06:01:33,770][106225] Updated weights for policy 1, policy_version 1501388 (0.0010) [2023-12-28 06:01:33,845][106225] Updated weights for policy 1, policy_version 1501398 (0.0010) [2023-12-28 06:01:33,974][106226] Updated weights for policy 0, policy_version 1497729 (0.0006) [2023-12-28 06:01:34,017][106226] Updated weights for policy 0, policy_version 1497739 (0.0010) [2023-12-28 06:01:34,063][106226] Updated weights for policy 0, policy_version 1497749 (0.0010) [2023-12-28 06:01:34,566][106225] Updated weights for policy 1, policy_version 1501408 (0.0010) [2023-12-28 06:01:34,628][106225] Updated weights for policy 1, policy_version 1501418 (0.0010) [2023-12-28 06:01:34,690][106225] Updated weights for policy 1, policy_version 1501428 (0.0010) [2023-12-28 06:01:34,810][106226] Updated weights for policy 0, policy_version 1497759 (0.0007) [2023-12-28 06:01:34,869][106226] Updated weights for policy 0, policy_version 1497769 (0.0005) [2023-12-28 06:01:34,928][106226] Updated weights for policy 0, policy_version 1497779 (0.0005) [2023-12-28 06:01:35,387][106225] Updated weights for policy 1, policy_version 1501438 (0.0010) [2023-12-28 06:01:35,437][106225] Updated weights for policy 1, policy_version 1501448 (0.0010) [2023-12-28 06:01:35,458][106226] Updated weights for policy 0, policy_version 1497789 (0.0005) [2023-12-28 06:01:35,487][106225] Updated weights for policy 1, policy_version 1501458 (0.0010) [2023-12-28 06:01:35,521][106226] Updated weights for policy 0, policy_version 1497799 (0.0008) [2023-12-28 06:01:35,578][106226] Updated weights for policy 0, policy_version 1497809 (0.0010) [2023-12-28 06:01:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 767942656. Throughput: 0: 9807.5, 1: 9988.2. Samples: 767956352. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:36,175][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.614')] [2023-12-28 06:01:36,228][106225] Updated weights for policy 1, policy_version 1501468 (0.0010) [2023-12-28 06:01:36,237][106226] Updated weights for policy 0, policy_version 1497819 (0.0010) [2023-12-28 06:01:36,285][106226] Updated weights for policy 0, policy_version 1497829 (0.0008) [2023-12-28 06:01:36,291][106225] Updated weights for policy 1, policy_version 1501478 (0.0012) [2023-12-28 06:01:36,346][106226] Updated weights for policy 0, policy_version 1497839 (0.0007) [2023-12-28 06:01:36,352][106225] Updated weights for policy 1, policy_version 1501488 (0.0010) [2023-12-28 06:01:37,011][106225] Updated weights for policy 1, policy_version 1501498 (0.0010) [2023-12-28 06:01:37,076][106226] Updated weights for policy 0, policy_version 1497849 (0.0010) [2023-12-28 06:01:37,077][106225] Updated weights for policy 1, policy_version 1501508 (0.0006) [2023-12-28 06:01:37,133][106226] Updated weights for policy 0, policy_version 1497859 (0.0006) [2023-12-28 06:01:37,134][106225] Updated weights for policy 1, policy_version 1501518 (0.0007) [2023-12-28 06:01:37,186][106225] Updated weights for policy 1, policy_version 1501528 (0.0007) [2023-12-28 06:01:37,190][106226] Updated weights for policy 0, policy_version 1497869 (0.0006) [2023-12-28 06:01:37,244][106226] Updated weights for policy 0, policy_version 1497879 (0.0009) [2023-12-28 06:01:37,860][106225] Updated weights for policy 1, policy_version 1501538 (0.0008) [2023-12-28 06:01:37,916][106225] Updated weights for policy 1, policy_version 1501548 (0.0007) [2023-12-28 06:01:37,918][106226] Updated weights for policy 0, policy_version 1497889 (0.0010) [2023-12-28 06:01:37,971][106226] Updated weights for policy 0, policy_version 1497899 (0.0008) [2023-12-28 06:01:37,977][106225] Updated weights for policy 1, policy_version 1501558 (0.0006) [2023-12-28 06:01:38,036][106226] Updated weights for policy 0, policy_version 1497909 (0.0009) [2023-12-28 06:01:38,680][106225] Updated weights for policy 1, policy_version 1501568 (0.0007) [2023-12-28 06:01:38,741][106225] Updated weights for policy 1, policy_version 1501578 (0.0008) [2023-12-28 06:01:38,747][106226] Updated weights for policy 0, policy_version 1497919 (0.0011) [2023-12-28 06:01:38,803][106225] Updated weights for policy 1, policy_version 1501588 (0.0005) [2023-12-28 06:01:38,805][106226] Updated weights for policy 0, policy_version 1497929 (0.0011) [2023-12-28 06:01:38,856][106226] Updated weights for policy 0, policy_version 1497939 (0.0010) [2023-12-28 06:01:39,578][106226] Updated weights for policy 0, policy_version 1497949 (0.0011) [2023-12-28 06:01:39,584][106225] Updated weights for policy 1, policy_version 1501598 (0.0006) [2023-12-28 06:01:39,632][106226] Updated weights for policy 0, policy_version 1497959 (0.0008) [2023-12-28 06:01:39,643][106225] Updated weights for policy 1, policy_version 1501608 (0.0007) [2023-12-28 06:01:39,691][106226] Updated weights for policy 0, policy_version 1497969 (0.0006) [2023-12-28 06:01:39,707][106225] Updated weights for policy 1, policy_version 1501618 (0.0008) [2023-12-28 06:01:40,411][106226] Updated weights for policy 0, policy_version 1497979 (0.0007) [2023-12-28 06:01:40,471][106226] Updated weights for policy 0, policy_version 1497989 (0.0007) [2023-12-28 06:01:40,502][106225] Updated weights for policy 1, policy_version 1501628 (0.0009) [2023-12-28 06:01:40,527][106226] Updated weights for policy 0, policy_version 1497999 (0.0007) [2023-12-28 06:01:40,565][106225] Updated weights for policy 1, policy_version 1501638 (0.0008) [2023-12-28 06:01:40,622][106225] Updated weights for policy 1, policy_version 1501648 (0.0007) [2023-12-28 06:01:41,147][106226] Updated weights for policy 0, policy_version 1498009 (0.0008) [2023-12-28 06:01:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 768040960. Throughput: 0: 9858.2, 1: 9986.0. Samples: 768015428. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:41,175][105115] Avg episode reward: [(0, '-4.935'), (1, '-4.521')] [2023-12-28 06:01:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001501656_384475136.pth... [2023-12-28 06:01:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001500504_384180224.pth [2023-12-28 06:01:41,205][106226] Updated weights for policy 0, policy_version 1498019 (0.0008) [2023-12-28 06:01:41,237][106225] Updated weights for policy 1, policy_version 1501658 (0.0006) [2023-12-28 06:01:41,269][106226] Updated weights for policy 0, policy_version 1498029 (0.0010) [2023-12-28 06:01:41,300][106225] Updated weights for policy 1, policy_version 1501668 (0.0007) [2023-12-28 06:01:41,333][106226] Updated weights for policy 0, policy_version 1498039 (0.0008) [2023-12-28 06:01:41,338][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001498040_383574016.pth... [2023-12-28 06:01:41,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001496856_383270912.pth [2023-12-28 06:01:41,369][106225] Updated weights for policy 1, policy_version 1501678 (0.0007) [2023-12-28 06:01:41,437][106225] Updated weights for policy 1, policy_version 1501688 (0.0009) [2023-12-28 06:01:42,116][106226] Updated weights for policy 0, policy_version 1498049 (0.0008) [2023-12-28 06:01:42,173][106226] Updated weights for policy 0, policy_version 1498059 (0.0008) [2023-12-28 06:01:42,202][106225] Updated weights for policy 1, policy_version 1501698 (0.0009) [2023-12-28 06:01:42,236][106226] Updated weights for policy 0, policy_version 1498069 (0.0007) [2023-12-28 06:01:42,266][106225] Updated weights for policy 1, policy_version 1501708 (0.0006) [2023-12-28 06:01:42,329][106225] Updated weights for policy 1, policy_version 1501718 (0.0007) [2023-12-28 06:01:42,894][106226] Updated weights for policy 0, policy_version 1498079 (0.0007) [2023-12-28 06:01:42,958][106226] Updated weights for policy 0, policy_version 1498089 (0.0008) [2023-12-28 06:01:43,020][106226] Updated weights for policy 0, policy_version 1498099 (0.0008) [2023-12-28 06:01:43,066][106225] Updated weights for policy 1, policy_version 1501728 (0.0008) [2023-12-28 06:01:43,116][106225] Updated weights for policy 1, policy_version 1501738 (0.0008) [2023-12-28 06:01:43,177][106225] Updated weights for policy 1, policy_version 1501748 (0.0006) [2023-12-28 06:01:43,680][106226] Updated weights for policy 0, policy_version 1498109 (0.0008) [2023-12-28 06:01:43,740][106226] Updated weights for policy 0, policy_version 1498119 (0.0008) [2023-12-28 06:01:43,795][106226] Updated weights for policy 0, policy_version 1498129 (0.0008) [2023-12-28 06:01:43,911][106225] Updated weights for policy 1, policy_version 1501758 (0.0007) [2023-12-28 06:01:43,964][106225] Updated weights for policy 1, policy_version 1501768 (0.0009) [2023-12-28 06:01:44,014][106225] Updated weights for policy 1, policy_version 1501778 (0.0009) [2023-12-28 06:01:44,427][106226] Updated weights for policy 0, policy_version 1498139 (0.0006) [2023-12-28 06:01:44,489][106226] Updated weights for policy 0, policy_version 1498149 (0.0010) [2023-12-28 06:01:44,551][106226] Updated weights for policy 0, policy_version 1498159 (0.0009) [2023-12-28 06:01:44,726][106225] Updated weights for policy 1, policy_version 1501788 (0.0008) [2023-12-28 06:01:44,814][106225] Updated weights for policy 1, policy_version 1501798 (0.0007) [2023-12-28 06:01:44,885][106225] Updated weights for policy 1, policy_version 1501808 (0.0010) [2023-12-28 06:01:45,223][106226] Updated weights for policy 0, policy_version 1498170 (0.0008) [2023-12-28 06:01:45,291][106226] Updated weights for policy 0, policy_version 1498180 (0.0011) [2023-12-28 06:01:45,356][106226] Updated weights for policy 0, policy_version 1498190 (0.0011) [2023-12-28 06:01:45,420][106226] Updated weights for policy 0, policy_version 1498200 (0.0011) [2023-12-28 06:01:45,569][106225] Updated weights for policy 1, policy_version 1501818 (0.0007) [2023-12-28 06:01:45,630][106225] Updated weights for policy 1, policy_version 1501828 (0.0008) [2023-12-28 06:01:45,692][106225] Updated weights for policy 1, policy_version 1501838 (0.0008) [2023-12-28 06:01:45,753][106225] Updated weights for policy 1, policy_version 1501848 (0.0008) [2023-12-28 06:01:46,124][106226] Updated weights for policy 0, policy_version 1498210 (0.0011) [2023-12-28 06:01:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 768139264. Throughput: 0: 9926.0, 1: 9853.4. Samples: 768132828. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:46,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.718')] [2023-12-28 06:01:46,189][106226] Updated weights for policy 0, policy_version 1498220 (0.0011) [2023-12-28 06:01:46,246][106226] Updated weights for policy 0, policy_version 1498230 (0.0011) [2023-12-28 06:01:46,496][106225] Updated weights for policy 1, policy_version 1501858 (0.0008) [2023-12-28 06:01:46,555][106225] Updated weights for policy 1, policy_version 1501868 (0.0009) [2023-12-28 06:01:46,614][106225] Updated weights for policy 1, policy_version 1501878 (0.0009) [2023-12-28 06:01:46,886][106226] Updated weights for policy 0, policy_version 1498240 (0.0006) [2023-12-28 06:01:46,948][106226] Updated weights for policy 0, policy_version 1498250 (0.0005) [2023-12-28 06:01:47,003][106226] Updated weights for policy 0, policy_version 1498260 (0.0005) [2023-12-28 06:01:47,301][106225] Updated weights for policy 1, policy_version 1501888 (0.0008) [2023-12-28 06:01:47,358][106225] Updated weights for policy 1, policy_version 1501898 (0.0008) [2023-12-28 06:01:47,415][106225] Updated weights for policy 1, policy_version 1501908 (0.0009) [2023-12-28 06:01:47,569][106226] Updated weights for policy 0, policy_version 1498270 (0.0007) [2023-12-28 06:01:47,624][106226] Updated weights for policy 0, policy_version 1498280 (0.0009) [2023-12-28 06:01:47,685][106226] Updated weights for policy 0, policy_version 1498290 (0.0008) [2023-12-28 06:01:48,162][106225] Updated weights for policy 1, policy_version 1501918 (0.0010) [2023-12-28 06:01:48,222][106225] Updated weights for policy 1, policy_version 1501928 (0.0010) [2023-12-28 06:01:48,283][106225] Updated weights for policy 1, policy_version 1501938 (0.0010) [2023-12-28 06:01:48,432][106226] Updated weights for policy 0, policy_version 1498300 (0.0008) [2023-12-28 06:01:48,493][106226] Updated weights for policy 0, policy_version 1498310 (0.0008) [2023-12-28 06:01:48,557][106226] Updated weights for policy 0, policy_version 1498320 (0.0008) [2023-12-28 06:01:49,012][106225] Updated weights for policy 1, policy_version 1501948 (0.0010) [2023-12-28 06:01:49,062][106225] Updated weights for policy 1, policy_version 1501958 (0.0010) [2023-12-28 06:01:49,119][106225] Updated weights for policy 1, policy_version 1501968 (0.0010) [2023-12-28 06:01:49,301][106226] Updated weights for policy 0, policy_version 1498330 (0.0007) [2023-12-28 06:01:49,364][106226] Updated weights for policy 0, policy_version 1498340 (0.0008) [2023-12-28 06:01:49,426][106226] Updated weights for policy 0, policy_version 1498350 (0.0008) [2023-12-28 06:01:49,480][106226] Updated weights for policy 0, policy_version 1498360 (0.0008) [2023-12-28 06:01:49,874][106225] Updated weights for policy 1, policy_version 1501978 (0.0010) [2023-12-28 06:01:49,932][106225] Updated weights for policy 1, policy_version 1501988 (0.0010) [2023-12-28 06:01:50,000][106225] Updated weights for policy 1, policy_version 1501998 (0.0011) [2023-12-28 06:01:50,065][106225] Updated weights for policy 1, policy_version 1502008 (0.0010) [2023-12-28 06:01:50,269][106226] Updated weights for policy 0, policy_version 1498370 (0.0008) [2023-12-28 06:01:50,334][106226] Updated weights for policy 0, policy_version 1498380 (0.0008) [2023-12-28 06:01:50,400][106226] Updated weights for policy 0, policy_version 1498390 (0.0006) [2023-12-28 06:01:50,779][106225] Updated weights for policy 1, policy_version 1502018 (0.0005) [2023-12-28 06:01:50,833][106225] Updated weights for policy 1, policy_version 1502028 (0.0006) [2023-12-28 06:01:50,885][106225] Updated weights for policy 1, policy_version 1502038 (0.0008) [2023-12-28 06:01:51,049][106226] Updated weights for policy 0, policy_version 1498400 (0.0008) [2023-12-28 06:01:51,117][106226] Updated weights for policy 0, policy_version 1498410 (0.0006) [2023-12-28 06:01:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 768237568. Throughput: 0: 9826.0, 1: 9847.3. Samples: 768249352. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:01:51,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.793')] [2023-12-28 06:01:51,195][106226] Updated weights for policy 0, policy_version 1498420 (0.0007) [2023-12-28 06:01:51,606][106225] Updated weights for policy 1, policy_version 1502048 (0.0007) [2023-12-28 06:01:51,676][106225] Updated weights for policy 1, policy_version 1502058 (0.0008) [2023-12-28 06:01:51,744][106225] Updated weights for policy 1, policy_version 1502068 (0.0007) [2023-12-28 06:01:51,826][106226] Updated weights for policy 0, policy_version 1498430 (0.0007) [2023-12-28 06:01:51,883][106226] Updated weights for policy 0, policy_version 1498440 (0.0009) [2023-12-28 06:01:51,937][106226] Updated weights for policy 0, policy_version 1498450 (0.0008) [2023-12-28 06:01:52,366][106225] Updated weights for policy 1, policy_version 1502078 (0.0007) [2023-12-28 06:01:52,429][106225] Updated weights for policy 1, policy_version 1502088 (0.0006) [2023-12-28 06:01:52,490][106225] Updated weights for policy 1, policy_version 1502098 (0.0005) [2023-12-28 06:01:52,776][106226] Updated weights for policy 0, policy_version 1498460 (0.0009) [2023-12-28 06:01:52,833][106226] Updated weights for policy 0, policy_version 1498470 (0.0008) [2023-12-28 06:01:52,896][106226] Updated weights for policy 0, policy_version 1498480 (0.0009) [2023-12-28 06:01:53,087][106225] Updated weights for policy 1, policy_version 1502108 (0.0005) [2023-12-28 06:01:53,154][106225] Updated weights for policy 1, policy_version 1502118 (0.0005) [2023-12-28 06:01:53,222][106225] Updated weights for policy 1, policy_version 1502128 (0.0005) [2023-12-28 06:01:53,682][106226] Updated weights for policy 0, policy_version 1498490 (0.0008) [2023-12-28 06:01:53,743][106226] Updated weights for policy 0, policy_version 1498500 (0.0005) [2023-12-28 06:01:53,806][106226] Updated weights for policy 0, policy_version 1498510 (0.0005) [2023-12-28 06:01:53,826][106225] Updated weights for policy 1, policy_version 1502138 (0.0008) [2023-12-28 06:01:53,867][106226] Updated weights for policy 0, policy_version 1498520 (0.0006) [2023-12-28 06:01:53,881][106225] Updated weights for policy 1, policy_version 1502148 (0.0007) [2023-12-28 06:01:53,929][106225] Updated weights for policy 1, policy_version 1502158 (0.0008) [2023-12-28 06:01:53,985][106225] Updated weights for policy 1, policy_version 1502168 (0.0008) [2023-12-28 06:01:54,533][106226] Updated weights for policy 0, policy_version 1498530 (0.0008) [2023-12-28 06:01:54,589][106226] Updated weights for policy 0, policy_version 1498540 (0.0007) [2023-12-28 06:01:54,644][106226] Updated weights for policy 0, policy_version 1498550 (0.0007) [2023-12-28 06:01:54,695][106225] Updated weights for policy 1, policy_version 1502178 (0.0007) [2023-12-28 06:01:54,749][106225] Updated weights for policy 1, policy_version 1502188 (0.0005) [2023-12-28 06:01:54,810][106225] Updated weights for policy 1, policy_version 1502198 (0.0005) [2023-12-28 06:01:55,340][106225] Updated weights for policy 1, policy_version 1502208 (0.0006) [2023-12-28 06:01:55,344][106226] Updated weights for policy 0, policy_version 1498560 (0.0007) [2023-12-28 06:01:55,394][106225] Updated weights for policy 1, policy_version 1502218 (0.0007) [2023-12-28 06:01:55,408][106226] Updated weights for policy 0, policy_version 1498570 (0.0007) [2023-12-28 06:01:55,449][106225] Updated weights for policy 1, policy_version 1502228 (0.0006) [2023-12-28 06:01:55,466][106226] Updated weights for policy 0, policy_version 1498580 (0.0008) [2023-12-28 06:01:56,149][106225] Updated weights for policy 1, policy_version 1502238 (0.0008) [2023-12-28 06:01:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 768335872. Throughput: 0: 9821.1, 1: 9867.0. Samples: 768309260. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:01:56,175][105115] Avg episode reward: [(0, '-4.677'), (1, '-4.665')] [2023-12-28 06:01:56,185][106226] Updated weights for policy 0, policy_version 1498590 (0.0007) [2023-12-28 06:01:56,205][106225] Updated weights for policy 1, policy_version 1502248 (0.0006) [2023-12-28 06:01:56,258][106226] Updated weights for policy 0, policy_version 1498600 (0.0007) [2023-12-28 06:01:56,262][106225] Updated weights for policy 1, policy_version 1502258 (0.0005) [2023-12-28 06:01:56,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001502264_384630784.pth... [2023-12-28 06:01:56,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001501080_384327680.pth [2023-12-28 06:01:56,315][106226] Updated weights for policy 0, policy_version 1498610 (0.0008) [2023-12-28 06:01:56,352][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001498616_383721472.pth... [2023-12-28 06:01:56,355][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001497432_383418368.pth [2023-12-28 06:01:56,823][106225] Updated weights for policy 1, policy_version 1502268 (0.0005) [2023-12-28 06:01:56,880][106225] Updated weights for policy 1, policy_version 1502278 (0.0005) [2023-12-28 06:01:56,934][106225] Updated weights for policy 1, policy_version 1502288 (0.0005) [2023-12-28 06:01:57,062][106226] Updated weights for policy 0, policy_version 1498620 (0.0007) [2023-12-28 06:01:57,129][106226] Updated weights for policy 0, policy_version 1498630 (0.0005) [2023-12-28 06:01:57,181][106226] Updated weights for policy 0, policy_version 1498640 (0.0005) [2023-12-28 06:01:57,450][106225] Updated weights for policy 1, policy_version 1502298 (0.0005) [2023-12-28 06:01:57,519][106225] Updated weights for policy 1, policy_version 1502308 (0.0006) [2023-12-28 06:01:57,564][106225] Updated weights for policy 1, policy_version 1502318 (0.0008) [2023-12-28 06:01:57,607][106225] Updated weights for policy 1, policy_version 1502328 (0.0007) [2023-12-28 06:01:57,721][106226] Updated weights for policy 0, policy_version 1498650 (0.0005) [2023-12-28 06:01:57,781][106226] Updated weights for policy 0, policy_version 1498660 (0.0005) [2023-12-28 06:01:57,849][106226] Updated weights for policy 0, policy_version 1498670 (0.0005) [2023-12-28 06:01:57,910][106226] Updated weights for policy 0, policy_version 1498680 (0.0005) [2023-12-28 06:01:58,200][106225] Updated weights for policy 1, policy_version 1502338 (0.0008) [2023-12-28 06:01:58,257][106225] Updated weights for policy 1, policy_version 1502348 (0.0007) [2023-12-28 06:01:58,309][106225] Updated weights for policy 1, policy_version 1502358 (0.0008) [2023-12-28 06:01:58,542][106226] Updated weights for policy 0, policy_version 1498690 (0.0009) [2023-12-28 06:01:58,614][106226] Updated weights for policy 0, policy_version 1498700 (0.0008) [2023-12-28 06:01:58,688][106226] Updated weights for policy 0, policy_version 1498710 (0.0009) [2023-12-28 06:01:59,176][106225] Updated weights for policy 1, policy_version 1502368 (0.0010) [2023-12-28 06:01:59,246][106225] Updated weights for policy 1, policy_version 1502378 (0.0007) [2023-12-28 06:01:59,311][106225] Updated weights for policy 1, policy_version 1502388 (0.0009) [2023-12-28 06:01:59,563][106226] Updated weights for policy 0, policy_version 1498720 (0.0008) [2023-12-28 06:01:59,625][106226] Updated weights for policy 0, policy_version 1498730 (0.0008) [2023-12-28 06:01:59,689][106226] Updated weights for policy 0, policy_version 1498740 (0.0009) [2023-12-28 06:02:00,044][106225] Updated weights for policy 1, policy_version 1502398 (0.0006) [2023-12-28 06:02:00,102][106225] Updated weights for policy 1, policy_version 1502408 (0.0006) [2023-12-28 06:02:00,156][106225] Updated weights for policy 1, policy_version 1502418 (0.0006) [2023-12-28 06:02:00,421][106226] Updated weights for policy 0, policy_version 1498750 (0.0008) [2023-12-28 06:02:00,480][106226] Updated weights for policy 0, policy_version 1498760 (0.0008) [2023-12-28 06:02:00,538][106226] Updated weights for policy 0, policy_version 1498770 (0.0008) [2023-12-28 06:02:00,826][106225] Updated weights for policy 1, policy_version 1502428 (0.0007) [2023-12-28 06:02:00,882][106225] Updated weights for policy 1, policy_version 1502438 (0.0005) [2023-12-28 06:02:00,942][106225] Updated weights for policy 1, policy_version 1502448 (0.0005) [2023-12-28 06:02:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 768442368. Throughput: 0: 9901.3, 1: 9971.9. Samples: 768431672. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:01,175][105115] Avg episode reward: [(0, '-4.874'), (1, '-5.143')] [2023-12-28 06:02:01,284][106226] Updated weights for policy 0, policy_version 1498780 (0.0009) [2023-12-28 06:02:01,352][106226] Updated weights for policy 0, policy_version 1498790 (0.0009) [2023-12-28 06:02:01,416][106226] Updated weights for policy 0, policy_version 1498800 (0.0007) [2023-12-28 06:02:01,565][106225] Updated weights for policy 1, policy_version 1502458 (0.0005) [2023-12-28 06:02:01,620][106225] Updated weights for policy 1, policy_version 1502468 (0.0008) [2023-12-28 06:02:01,691][106225] Updated weights for policy 1, policy_version 1502478 (0.0006) [2023-12-28 06:02:01,757][106225] Updated weights for policy 1, policy_version 1502488 (0.0007) [2023-12-28 06:02:02,139][106226] Updated weights for policy 0, policy_version 1498810 (0.0008) [2023-12-28 06:02:02,198][106226] Updated weights for policy 0, policy_version 1498820 (0.0006) [2023-12-28 06:02:02,266][106226] Updated weights for policy 0, policy_version 1498830 (0.0009) [2023-12-28 06:02:02,329][106226] Updated weights for policy 0, policy_version 1498840 (0.0009) [2023-12-28 06:02:02,401][106225] Updated weights for policy 1, policy_version 1502498 (0.0010) [2023-12-28 06:02:02,453][106225] Updated weights for policy 1, policy_version 1502508 (0.0008) [2023-12-28 06:02:02,500][106225] Updated weights for policy 1, policy_version 1502518 (0.0007) [2023-12-28 06:02:03,093][106226] Updated weights for policy 0, policy_version 1498850 (0.0009) [2023-12-28 06:02:03,133][106225] Updated weights for policy 1, policy_version 1502528 (0.0007) [2023-12-28 06:02:03,147][106226] Updated weights for policy 0, policy_version 1498860 (0.0007) [2023-12-28 06:02:03,195][106225] Updated weights for policy 1, policy_version 1502538 (0.0008) [2023-12-28 06:02:03,207][106226] Updated weights for policy 0, policy_version 1498870 (0.0008) [2023-12-28 06:02:03,252][106225] Updated weights for policy 1, policy_version 1502548 (0.0007) [2023-12-28 06:02:03,825][106225] Updated weights for policy 1, policy_version 1502558 (0.0007) [2023-12-28 06:02:03,886][106225] Updated weights for policy 1, policy_version 1502568 (0.0010) [2023-12-28 06:02:03,941][106225] Updated weights for policy 1, policy_version 1502578 (0.0010) [2023-12-28 06:02:03,951][106226] Updated weights for policy 0, policy_version 1498880 (0.0006) [2023-12-28 06:02:04,004][106226] Updated weights for policy 0, policy_version 1498890 (0.0007) [2023-12-28 06:02:04,065][106226] Updated weights for policy 0, policy_version 1498900 (0.0008) [2023-12-28 06:02:04,684][106225] Updated weights for policy 1, policy_version 1502588 (0.0010) [2023-12-28 06:02:04,710][106226] Updated weights for policy 0, policy_version 1498910 (0.0007) [2023-12-28 06:02:04,744][106225] Updated weights for policy 1, policy_version 1502598 (0.0010) [2023-12-28 06:02:04,768][106226] Updated weights for policy 0, policy_version 1498920 (0.0007) [2023-12-28 06:02:04,801][106225] Updated weights for policy 1, policy_version 1502608 (0.0010) [2023-12-28 06:02:04,815][106226] Updated weights for policy 0, policy_version 1498930 (0.0005) [2023-12-28 06:02:05,397][106226] Updated weights for policy 0, policy_version 1498940 (0.0007) [2023-12-28 06:02:05,456][106226] Updated weights for policy 0, policy_version 1498950 (0.0006) [2023-12-28 06:02:05,515][106226] Updated weights for policy 0, policy_version 1498960 (0.0005) [2023-12-28 06:02:05,527][106225] Updated weights for policy 1, policy_version 1502618 (0.0010) [2023-12-28 06:02:05,577][106225] Updated weights for policy 1, policy_version 1502628 (0.0010) [2023-12-28 06:02:05,635][106225] Updated weights for policy 1, policy_version 1502638 (0.0010) [2023-12-28 06:02:05,688][106225] Updated weights for policy 1, policy_version 1502648 (0.0010) [2023-12-28 06:02:06,132][106226] Updated weights for policy 0, policy_version 1498970 (0.0007) [2023-12-28 06:02:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 768540672. Throughput: 0: 9913.2, 1: 10044.0. Samples: 768553416. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:06,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.792')] [2023-12-28 06:02:06,193][106226] Updated weights for policy 0, policy_version 1498980 (0.0009) [2023-12-28 06:02:06,258][106226] Updated weights for policy 0, policy_version 1498990 (0.0008) [2023-12-28 06:02:06,317][106226] Updated weights for policy 0, policy_version 1499000 (0.0008) [2023-12-28 06:02:06,427][106225] Updated weights for policy 1, policy_version 1502658 (0.0007) [2023-12-28 06:02:06,496][106225] Updated weights for policy 1, policy_version 1502668 (0.0006) [2023-12-28 06:02:06,565][106225] Updated weights for policy 1, policy_version 1502678 (0.0006) [2023-12-28 06:02:07,053][106226] Updated weights for policy 0, policy_version 1499010 (0.0005) [2023-12-28 06:02:07,104][106226] Updated weights for policy 0, policy_version 1499020 (0.0008) [2023-12-28 06:02:07,139][106225] Updated weights for policy 1, policy_version 1502688 (0.0006) [2023-12-28 06:02:07,151][106226] Updated weights for policy 0, policy_version 1499030 (0.0010) [2023-12-28 06:02:07,198][106225] Updated weights for policy 1, policy_version 1502698 (0.0006) [2023-12-28 06:02:07,261][106225] Updated weights for policy 1, policy_version 1502708 (0.0006) [2023-12-28 06:02:07,831][106226] Updated weights for policy 0, policy_version 1499040 (0.0008) [2023-12-28 06:02:07,885][106226] Updated weights for policy 0, policy_version 1499050 (0.0009) [2023-12-28 06:02:07,917][106225] Updated weights for policy 1, policy_version 1502718 (0.0008) [2023-12-28 06:02:07,938][106226] Updated weights for policy 0, policy_version 1499060 (0.0005) [2023-12-28 06:02:07,977][106225] Updated weights for policy 1, policy_version 1502728 (0.0010) [2023-12-28 06:02:08,039][106225] Updated weights for policy 1, policy_version 1502738 (0.0010) [2023-12-28 06:02:08,692][106226] Updated weights for policy 0, policy_version 1499070 (0.0009) [2023-12-28 06:02:08,742][106226] Updated weights for policy 0, policy_version 1499080 (0.0008) [2023-12-28 06:02:08,761][106225] Updated weights for policy 1, policy_version 1502748 (0.0010) [2023-12-28 06:02:08,806][106226] Updated weights for policy 0, policy_version 1499090 (0.0006) [2023-12-28 06:02:08,823][106225] Updated weights for policy 1, policy_version 1502758 (0.0011) [2023-12-28 06:02:08,880][106225] Updated weights for policy 1, policy_version 1502768 (0.0010) [2023-12-28 06:02:09,584][106225] Updated weights for policy 1, policy_version 1502778 (0.0011) [2023-12-28 06:02:09,618][106226] Updated weights for policy 0, policy_version 1499100 (0.0007) [2023-12-28 06:02:09,639][106225] Updated weights for policy 1, policy_version 1502788 (0.0010) [2023-12-28 06:02:09,680][106226] Updated weights for policy 0, policy_version 1499110 (0.0006) [2023-12-28 06:02:09,701][106225] Updated weights for policy 1, policy_version 1502798 (0.0011) [2023-12-28 06:02:09,746][106226] Updated weights for policy 0, policy_version 1499120 (0.0007) [2023-12-28 06:02:09,763][106225] Updated weights for policy 1, policy_version 1502808 (0.0011) [2023-12-28 06:02:10,472][106226] Updated weights for policy 0, policy_version 1499130 (0.0010) [2023-12-28 06:02:10,532][106225] Updated weights for policy 1, policy_version 1502818 (0.0007) [2023-12-28 06:02:10,538][106226] Updated weights for policy 0, policy_version 1499140 (0.0007) [2023-12-28 06:02:10,588][106225] Updated weights for policy 1, policy_version 1502828 (0.0008) [2023-12-28 06:02:10,597][106226] Updated weights for policy 0, policy_version 1499150 (0.0006) [2023-12-28 06:02:10,653][106225] Updated weights for policy 1, policy_version 1502838 (0.0007) [2023-12-28 06:02:10,661][106226] Updated weights for policy 0, policy_version 1499160 (0.0010) [2023-12-28 06:02:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 768638976. Throughput: 0: 9955.2, 1: 10059.7. Samples: 768613068. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:11,175][105115] Avg episode reward: [(0, '-5.223'), (1, '-4.985')] [2023-12-28 06:02:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001499160_383860736.pth... [2023-12-28 06:02:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001502840_384778240.pth... [2023-12-28 06:02:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001501656_384475136.pth [2023-12-28 06:02:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001498040_383574016.pth [2023-12-28 06:02:11,315][106226] Updated weights for policy 0, policy_version 1499170 (0.0011) [2023-12-28 06:02:11,387][106226] Updated weights for policy 0, policy_version 1499180 (0.0010) [2023-12-28 06:02:11,408][106225] Updated weights for policy 1, policy_version 1502848 (0.0010) [2023-12-28 06:02:11,449][106226] Updated weights for policy 0, policy_version 1499190 (0.0011) [2023-12-28 06:02:11,464][106225] Updated weights for policy 1, policy_version 1502858 (0.0009) [2023-12-28 06:02:11,523][106225] Updated weights for policy 1, policy_version 1502868 (0.0008) [2023-12-28 06:02:12,140][106226] Updated weights for policy 0, policy_version 1499200 (0.0011) [2023-12-28 06:02:12,197][106226] Updated weights for policy 0, policy_version 1499210 (0.0009) [2023-12-28 06:02:12,267][106226] Updated weights for policy 0, policy_version 1499220 (0.0008) [2023-12-28 06:02:12,312][106225] Updated weights for policy 1, policy_version 1502878 (0.0009) [2023-12-28 06:02:12,370][106225] Updated weights for policy 1, policy_version 1502888 (0.0009) [2023-12-28 06:02:12,428][106225] Updated weights for policy 1, policy_version 1502898 (0.0009) [2023-12-28 06:02:12,972][106226] Updated weights for policy 0, policy_version 1499230 (0.0006) [2023-12-28 06:02:13,031][106226] Updated weights for policy 0, policy_version 1499240 (0.0005) [2023-12-28 06:02:13,098][106226] Updated weights for policy 0, policy_version 1499250 (0.0006) [2023-12-28 06:02:13,178][106225] Updated weights for policy 1, policy_version 1502908 (0.0007) [2023-12-28 06:02:13,234][106225] Updated weights for policy 1, policy_version 1502918 (0.0005) [2023-12-28 06:02:13,296][106225] Updated weights for policy 1, policy_version 1502928 (0.0005) [2023-12-28 06:02:13,710][106226] Updated weights for policy 0, policy_version 1499260 (0.0006) [2023-12-28 06:02:13,781][106226] Updated weights for policy 0, policy_version 1499270 (0.0006) [2023-12-28 06:02:13,845][106225] Updated weights for policy 1, policy_version 1502938 (0.0006) [2023-12-28 06:02:13,845][106226] Updated weights for policy 0, policy_version 1499280 (0.0006) [2023-12-28 06:02:13,890][106225] Updated weights for policy 1, policy_version 1502948 (0.0010) [2023-12-28 06:02:13,947][106225] Updated weights for policy 1, policy_version 1502958 (0.0010) [2023-12-28 06:02:13,990][106225] Updated weights for policy 1, policy_version 1502968 (0.0010) [2023-12-28 06:02:14,381][106226] Updated weights for policy 0, policy_version 1499290 (0.0006) [2023-12-28 06:02:14,440][106226] Updated weights for policy 0, policy_version 1499300 (0.0010) [2023-12-28 06:02:14,493][106226] Updated weights for policy 0, policy_version 1499310 (0.0010) [2023-12-28 06:02:14,543][106226] Updated weights for policy 0, policy_version 1499320 (0.0010) [2023-12-28 06:02:14,695][106225] Updated weights for policy 1, policy_version 1502978 (0.0010) [2023-12-28 06:02:14,752][106225] Updated weights for policy 1, policy_version 1502988 (0.0010) [2023-12-28 06:02:14,821][106225] Updated weights for policy 1, policy_version 1502998 (0.0010) [2023-12-28 06:02:15,315][106226] Updated weights for policy 0, policy_version 1499330 (0.0011) [2023-12-28 06:02:15,369][106226] Updated weights for policy 0, policy_version 1499340 (0.0011) [2023-12-28 06:02:15,415][106226] Updated weights for policy 0, policy_version 1499350 (0.0010) [2023-12-28 06:02:15,496][106225] Updated weights for policy 1, policy_version 1503008 (0.0010) [2023-12-28 06:02:15,543][106225] Updated weights for policy 1, policy_version 1503018 (0.0010) [2023-12-28 06:02:15,594][106225] Updated weights for policy 1, policy_version 1503028 (0.0010) [2023-12-28 06:02:16,104][106226] Updated weights for policy 0, policy_version 1499360 (0.0009) [2023-12-28 06:02:16,160][106226] Updated weights for policy 0, policy_version 1499370 (0.0009) [2023-12-28 06:02:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 768737280. Throughput: 0: 9913.7, 1: 9966.3. Samples: 768731832. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:16,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.477')] [2023-12-28 06:02:16,217][106226] Updated weights for policy 0, policy_version 1499380 (0.0009) [2023-12-28 06:02:16,268][106225] Updated weights for policy 1, policy_version 1503038 (0.0009) [2023-12-28 06:02:16,327][106225] Updated weights for policy 1, policy_version 1503048 (0.0008) [2023-12-28 06:02:16,384][106225] Updated weights for policy 1, policy_version 1503058 (0.0005) [2023-12-28 06:02:16,982][106226] Updated weights for policy 0, policy_version 1499390 (0.0008) [2023-12-28 06:02:16,984][106225] Updated weights for policy 1, policy_version 1503068 (0.0006) [2023-12-28 06:02:17,034][106226] Updated weights for policy 0, policy_version 1499400 (0.0006) [2023-12-28 06:02:17,042][106225] Updated weights for policy 1, policy_version 1503078 (0.0007) [2023-12-28 06:02:17,100][106226] Updated weights for policy 0, policy_version 1499410 (0.0009) [2023-12-28 06:02:17,108][106225] Updated weights for policy 1, policy_version 1503088 (0.0005) [2023-12-28 06:02:17,776][106225] Updated weights for policy 1, policy_version 1503098 (0.0005) [2023-12-28 06:02:17,836][106225] Updated weights for policy 1, policy_version 1503108 (0.0006) [2023-12-28 06:02:17,856][106226] Updated weights for policy 0, policy_version 1499420 (0.0009) [2023-12-28 06:02:17,901][106225] Updated weights for policy 1, policy_version 1503118 (0.0006) [2023-12-28 06:02:17,916][106226] Updated weights for policy 0, policy_version 1499430 (0.0008) [2023-12-28 06:02:17,966][106226] Updated weights for policy 0, policy_version 1499440 (0.0008) [2023-12-28 06:02:17,968][106225] Updated weights for policy 1, policy_version 1503128 (0.0005) [2023-12-28 06:02:18,592][106225] Updated weights for policy 1, policy_version 1503138 (0.0010) [2023-12-28 06:02:18,663][106225] Updated weights for policy 1, policy_version 1503148 (0.0011) [2023-12-28 06:02:18,691][106226] Updated weights for policy 0, policy_version 1499450 (0.0007) [2023-12-28 06:02:18,734][106225] Updated weights for policy 1, policy_version 1503158 (0.0011) [2023-12-28 06:02:18,749][106226] Updated weights for policy 0, policy_version 1499460 (0.0006) [2023-12-28 06:02:18,814][106226] Updated weights for policy 0, policy_version 1499470 (0.0008) [2023-12-28 06:02:18,880][106226] Updated weights for policy 0, policy_version 1499480 (0.0008) [2023-12-28 06:02:19,496][106225] Updated weights for policy 1, policy_version 1503168 (0.0009) [2023-12-28 06:02:19,560][106225] Updated weights for policy 1, policy_version 1503178 (0.0007) [2023-12-28 06:02:19,605][106226] Updated weights for policy 0, policy_version 1499490 (0.0011) [2023-12-28 06:02:19,619][106225] Updated weights for policy 1, policy_version 1503188 (0.0009) [2023-12-28 06:02:19,671][106226] Updated weights for policy 0, policy_version 1499500 (0.0006) [2023-12-28 06:02:19,738][106226] Updated weights for policy 0, policy_version 1499510 (0.0010) [2023-12-28 06:02:20,294][106225] Updated weights for policy 1, policy_version 1503198 (0.0009) [2023-12-28 06:02:20,357][106225] Updated weights for policy 1, policy_version 1503208 (0.0009) [2023-12-28 06:02:20,423][106225] Updated weights for policy 1, policy_version 1503218 (0.0010) [2023-12-28 06:02:20,455][106226] Updated weights for policy 0, policy_version 1499520 (0.0011) [2023-12-28 06:02:20,516][106226] Updated weights for policy 0, policy_version 1499530 (0.0011) [2023-12-28 06:02:20,589][106226] Updated weights for policy 0, policy_version 1499540 (0.0011) [2023-12-28 06:02:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 768835584. Throughput: 0: 9816.5, 1: 10025.8. Samples: 768849256. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:21,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.345')] [2023-12-28 06:02:21,183][106225] Updated weights for policy 1, policy_version 1503228 (0.0009) [2023-12-28 06:02:21,237][106225] Updated weights for policy 1, policy_version 1503238 (0.0008) [2023-12-28 06:02:21,299][106225] Updated weights for policy 1, policy_version 1503248 (0.0010) [2023-12-28 06:02:21,347][106226] Updated weights for policy 0, policy_version 1499550 (0.0009) [2023-12-28 06:02:21,420][106226] Updated weights for policy 0, policy_version 1499560 (0.0009) [2023-12-28 06:02:21,484][106226] Updated weights for policy 0, policy_version 1499570 (0.0009) [2023-12-28 06:02:22,111][106225] Updated weights for policy 1, policy_version 1503258 (0.0007) [2023-12-28 06:02:22,171][106225] Updated weights for policy 1, policy_version 1503268 (0.0009) [2023-12-28 06:02:22,231][106225] Updated weights for policy 1, policy_version 1503278 (0.0008) [2023-12-28 06:02:22,267][106226] Updated weights for policy 0, policy_version 1499580 (0.0008) [2023-12-28 06:02:22,296][106225] Updated weights for policy 1, policy_version 1503288 (0.0007) [2023-12-28 06:02:22,333][106226] Updated weights for policy 0, policy_version 1499590 (0.0008) [2023-12-28 06:02:22,402][106226] Updated weights for policy 0, policy_version 1499600 (0.0008) [2023-12-28 06:02:23,050][106226] Updated weights for policy 0, policy_version 1499610 (0.0008) [2023-12-28 06:02:23,111][106225] Updated weights for policy 1, policy_version 1503298 (0.0007) [2023-12-28 06:02:23,113][106226] Updated weights for policy 0, policy_version 1499620 (0.0007) [2023-12-28 06:02:23,162][106226] Updated weights for policy 0, policy_version 1499630 (0.0007) [2023-12-28 06:02:23,165][106225] Updated weights for policy 1, policy_version 1503308 (0.0006) [2023-12-28 06:02:23,214][106226] Updated weights for policy 0, policy_version 1499640 (0.0007) [2023-12-28 06:02:23,223][106225] Updated weights for policy 1, policy_version 1503318 (0.0006) [2023-12-28 06:02:23,851][106225] Updated weights for policy 1, policy_version 1503328 (0.0008) [2023-12-28 06:02:23,904][106225] Updated weights for policy 1, policy_version 1503338 (0.0009) [2023-12-28 06:02:23,962][106225] Updated weights for policy 1, policy_version 1503348 (0.0006) [2023-12-28 06:02:23,979][106226] Updated weights for policy 0, policy_version 1499650 (0.0007) [2023-12-28 06:02:24,034][106226] Updated weights for policy 0, policy_version 1499660 (0.0007) [2023-12-28 06:02:24,094][106226] Updated weights for policy 0, policy_version 1499670 (0.0006) [2023-12-28 06:02:24,653][106225] Updated weights for policy 1, policy_version 1503358 (0.0006) [2023-12-28 06:02:24,709][106225] Updated weights for policy 1, policy_version 1503368 (0.0005) [2023-12-28 06:02:24,750][106226] Updated weights for policy 0, policy_version 1499680 (0.0009) [2023-12-28 06:02:24,761][106225] Updated weights for policy 1, policy_version 1503378 (0.0005) [2023-12-28 06:02:24,804][106226] Updated weights for policy 0, policy_version 1499690 (0.0010) [2023-12-28 06:02:24,859][106226] Updated weights for policy 0, policy_version 1499700 (0.0006) [2023-12-28 06:02:25,288][106225] Updated weights for policy 1, policy_version 1503388 (0.0006) [2023-12-28 06:02:25,344][106225] Updated weights for policy 1, policy_version 1503398 (0.0007) [2023-12-28 06:02:25,399][106225] Updated weights for policy 1, policy_version 1503408 (0.0008) [2023-12-28 06:02:25,483][106226] Updated weights for policy 0, policy_version 1499710 (0.0008) [2023-12-28 06:02:25,545][106226] Updated weights for policy 0, policy_version 1499720 (0.0010) [2023-12-28 06:02:25,604][106226] Updated weights for policy 0, policy_version 1499730 (0.0010) [2023-12-28 06:02:26,122][106225] Updated weights for policy 1, policy_version 1503418 (0.0008) [2023-12-28 06:02:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 768933888. Throughput: 0: 9799.6, 1: 9982.8. Samples: 768905640. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:26,176][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.616')] [2023-12-28 06:02:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001499736_384008192.pth... [2023-12-28 06:02:26,189][106225] Updated weights for policy 1, policy_version 1503428 (0.0005) [2023-12-28 06:02:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001498616_383721472.pth [2023-12-28 06:02:26,249][106225] Updated weights for policy 1, policy_version 1503438 (0.0006) [2023-12-28 06:02:26,305][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001503448_384933888.pth... [2023-12-28 06:02:26,308][106225] Updated weights for policy 1, policy_version 1503448 (0.0007) [2023-12-28 06:02:26,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001502264_384630784.pth [2023-12-28 06:02:26,322][106226] Updated weights for policy 0, policy_version 1499740 (0.0010) [2023-12-28 06:02:26,378][106226] Updated weights for policy 0, policy_version 1499750 (0.0009) [2023-12-28 06:02:26,433][106226] Updated weights for policy 0, policy_version 1499760 (0.0005) [2023-12-28 06:02:26,900][106225] Updated weights for policy 1, policy_version 1503458 (0.0006) [2023-12-28 06:02:26,956][106225] Updated weights for policy 1, policy_version 1503468 (0.0008) [2023-12-28 06:02:27,016][106225] Updated weights for policy 1, policy_version 1503478 (0.0007) [2023-12-28 06:02:27,113][106226] Updated weights for policy 0, policy_version 1499770 (0.0010) [2023-12-28 06:02:27,165][106226] Updated weights for policy 0, policy_version 1499780 (0.0010) [2023-12-28 06:02:27,221][106226] Updated weights for policy 0, policy_version 1499790 (0.0010) [2023-12-28 06:02:27,274][106226] Updated weights for policy 0, policy_version 1499800 (0.0010) [2023-12-28 06:02:27,654][106225] Updated weights for policy 1, policy_version 1503488 (0.0008) [2023-12-28 06:02:27,710][106225] Updated weights for policy 1, policy_version 1503498 (0.0008) [2023-12-28 06:02:27,767][106225] Updated weights for policy 1, policy_version 1503508 (0.0007) [2023-12-28 06:02:27,974][106226] Updated weights for policy 0, policy_version 1499810 (0.0010) [2023-12-28 06:02:28,023][106226] Updated weights for policy 0, policy_version 1499820 (0.0010) [2023-12-28 06:02:28,079][106226] Updated weights for policy 0, policy_version 1499830 (0.0008) [2023-12-28 06:02:28,506][106225] Updated weights for policy 1, policy_version 1503518 (0.0008) [2023-12-28 06:02:28,565][106225] Updated weights for policy 1, policy_version 1503528 (0.0010) [2023-12-28 06:02:28,619][106225] Updated weights for policy 1, policy_version 1503538 (0.0009) [2023-12-28 06:02:28,730][106226] Updated weights for policy 0, policy_version 1499840 (0.0009) [2023-12-28 06:02:28,787][106226] Updated weights for policy 0, policy_version 1499850 (0.0011) [2023-12-28 06:02:28,856][106226] Updated weights for policy 0, policy_version 1499860 (0.0006) [2023-12-28 06:02:29,405][106225] Updated weights for policy 1, policy_version 1503548 (0.0008) [2023-12-28 06:02:29,463][106225] Updated weights for policy 1, policy_version 1503558 (0.0010) [2023-12-28 06:02:29,495][106226] Updated weights for policy 0, policy_version 1499870 (0.0006) [2023-12-28 06:02:29,533][106225] Updated weights for policy 1, policy_version 1503568 (0.0006) [2023-12-28 06:02:29,558][106226] Updated weights for policy 0, policy_version 1499880 (0.0008) [2023-12-28 06:02:29,613][106226] Updated weights for policy 0, policy_version 1499890 (0.0007) [2023-12-28 06:02:30,240][106225] Updated weights for policy 1, policy_version 1503578 (0.0007) [2023-12-28 06:02:30,295][106225] Updated weights for policy 1, policy_version 1503588 (0.0008) [2023-12-28 06:02:30,353][106225] Updated weights for policy 1, policy_version 1503598 (0.0008) [2023-12-28 06:02:30,356][106226] Updated weights for policy 0, policy_version 1499900 (0.0007) [2023-12-28 06:02:30,405][106225] Updated weights for policy 1, policy_version 1503608 (0.0008) [2023-12-28 06:02:30,416][106226] Updated weights for policy 0, policy_version 1499910 (0.0006) [2023-12-28 06:02:30,467][106226] Updated weights for policy 0, policy_version 1499920 (0.0009) [2023-12-28 06:02:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 769032192. Throughput: 0: 9815.0, 1: 10081.6. Samples: 769028176. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:31,175][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.769')] [2023-12-28 06:02:31,179][106226] Updated weights for policy 0, policy_version 1499930 (0.0009) [2023-12-28 06:02:31,181][106225] Updated weights for policy 1, policy_version 1503618 (0.0006) [2023-12-28 06:02:31,238][106225] Updated weights for policy 1, policy_version 1503628 (0.0008) [2023-12-28 06:02:31,244][106226] Updated weights for policy 0, policy_version 1499940 (0.0010) [2023-12-28 06:02:31,297][106225] Updated weights for policy 1, policy_version 1503638 (0.0007) [2023-12-28 06:02:31,305][106226] Updated weights for policy 0, policy_version 1499950 (0.0010) [2023-12-28 06:02:31,370][106226] Updated weights for policy 0, policy_version 1499960 (0.0009) [2023-12-28 06:02:32,041][106225] Updated weights for policy 1, policy_version 1503648 (0.0008) [2023-12-28 06:02:32,102][106225] Updated weights for policy 1, policy_version 1503658 (0.0008) [2023-12-28 06:02:32,145][106226] Updated weights for policy 0, policy_version 1499970 (0.0007) [2023-12-28 06:02:32,160][106225] Updated weights for policy 1, policy_version 1503668 (0.0006) [2023-12-28 06:02:32,209][106226] Updated weights for policy 0, policy_version 1499980 (0.0005) [2023-12-28 06:02:32,279][106226] Updated weights for policy 0, policy_version 1499990 (0.0008) [2023-12-28 06:02:32,851][106225] Updated weights for policy 1, policy_version 1503678 (0.0008) [2023-12-28 06:02:32,898][106225] Updated weights for policy 1, policy_version 1503688 (0.0008) [2023-12-28 06:02:32,933][106226] Updated weights for policy 0, policy_version 1500000 (0.0008) [2023-12-28 06:02:32,943][106225] Updated weights for policy 1, policy_version 1503698 (0.0006) [2023-12-28 06:02:32,991][106226] Updated weights for policy 0, policy_version 1500010 (0.0006) [2023-12-28 06:02:33,049][106226] Updated weights for policy 0, policy_version 1500020 (0.0008) [2023-12-28 06:02:33,704][106225] Updated weights for policy 1, policy_version 1503708 (0.0007) [2023-12-28 06:02:33,735][106226] Updated weights for policy 0, policy_version 1500030 (0.0007) [2023-12-28 06:02:33,749][106225] Updated weights for policy 1, policy_version 1503718 (0.0006) [2023-12-28 06:02:33,789][106226] Updated weights for policy 0, policy_version 1500040 (0.0006) [2023-12-28 06:02:33,795][106225] Updated weights for policy 1, policy_version 1503728 (0.0007) [2023-12-28 06:02:33,846][106226] Updated weights for policy 0, policy_version 1500050 (0.0008) [2023-12-28 06:02:34,460][106225] Updated weights for policy 1, policy_version 1503738 (0.0007) [2023-12-28 06:02:34,526][106225] Updated weights for policy 1, policy_version 1503748 (0.0011) [2023-12-28 06:02:34,532][106226] Updated weights for policy 0, policy_version 1500060 (0.0008) [2023-12-28 06:02:34,591][106225] Updated weights for policy 1, policy_version 1503758 (0.0010) [2023-12-28 06:02:34,599][106226] Updated weights for policy 0, policy_version 1500070 (0.0008) [2023-12-28 06:02:34,655][106225] Updated weights for policy 1, policy_version 1503768 (0.0010) [2023-12-28 06:02:34,662][106226] Updated weights for policy 0, policy_version 1500080 (0.0009) [2023-12-28 06:02:35,333][106225] Updated weights for policy 1, policy_version 1503778 (0.0008) [2023-12-28 06:02:35,385][106225] Updated weights for policy 1, policy_version 1503788 (0.0006) [2023-12-28 06:02:35,416][106226] Updated weights for policy 0, policy_version 1500090 (0.0008) [2023-12-28 06:02:35,445][106225] Updated weights for policy 1, policy_version 1503798 (0.0006) [2023-12-28 06:02:35,479][106226] Updated weights for policy 0, policy_version 1500100 (0.0009) [2023-12-28 06:02:35,547][106226] Updated weights for policy 0, policy_version 1500110 (0.0010) [2023-12-28 06:02:35,600][106226] Updated weights for policy 0, policy_version 1500120 (0.0010) [2023-12-28 06:02:36,009][106225] Updated weights for policy 1, policy_version 1503808 (0.0006) [2023-12-28 06:02:36,059][106225] Updated weights for policy 1, policy_version 1503818 (0.0007) [2023-12-28 06:02:36,115][106225] Updated weights for policy 1, policy_version 1503828 (0.0008) [2023-12-28 06:02:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 769138688. Throughput: 0: 9766.4, 1: 10148.7. Samples: 769145532. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:36,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.838')] [2023-12-28 06:02:36,448][106226] Updated weights for policy 0, policy_version 1500130 (0.0009) [2023-12-28 06:02:36,515][106226] Updated weights for policy 0, policy_version 1500140 (0.0008) [2023-12-28 06:02:36,575][106226] Updated weights for policy 0, policy_version 1500150 (0.0007) [2023-12-28 06:02:36,810][106225] Updated weights for policy 1, policy_version 1503838 (0.0007) [2023-12-28 06:02:36,867][106225] Updated weights for policy 1, policy_version 1503848 (0.0007) [2023-12-28 06:02:36,935][106225] Updated weights for policy 1, policy_version 1503858 (0.0007) [2023-12-28 06:02:37,294][106226] Updated weights for policy 0, policy_version 1500160 (0.0007) [2023-12-28 06:02:37,345][106226] Updated weights for policy 0, policy_version 1500170 (0.0008) [2023-12-28 06:02:37,400][106226] Updated weights for policy 0, policy_version 1500180 (0.0008) [2023-12-28 06:02:37,525][106225] Updated weights for policy 1, policy_version 1503868 (0.0010) [2023-12-28 06:02:37,574][106225] Updated weights for policy 1, policy_version 1503878 (0.0007) [2023-12-28 06:02:37,636][106225] Updated weights for policy 1, policy_version 1503888 (0.0008) [2023-12-28 06:02:38,122][106226] Updated weights for policy 0, policy_version 1500190 (0.0009) [2023-12-28 06:02:38,184][106226] Updated weights for policy 0, policy_version 1500200 (0.0007) [2023-12-28 06:02:38,243][106226] Updated weights for policy 0, policy_version 1500210 (0.0008) [2023-12-28 06:02:38,280][106225] Updated weights for policy 1, policy_version 1503898 (0.0009) [2023-12-28 06:02:38,345][106225] Updated weights for policy 1, policy_version 1503908 (0.0011) [2023-12-28 06:02:38,406][106225] Updated weights for policy 1, policy_version 1503918 (0.0011) [2023-12-28 06:02:38,465][106225] Updated weights for policy 1, policy_version 1503928 (0.0010) [2023-12-28 06:02:39,066][106225] Updated weights for policy 1, policy_version 1503938 (0.0010) [2023-12-28 06:02:39,083][106226] Updated weights for policy 0, policy_version 1500220 (0.0008) [2023-12-28 06:02:39,116][106225] Updated weights for policy 1, policy_version 1503948 (0.0010) [2023-12-28 06:02:39,143][106226] Updated weights for policy 0, policy_version 1500230 (0.0011) [2023-12-28 06:02:39,172][106225] Updated weights for policy 1, policy_version 1503958 (0.0010) [2023-12-28 06:02:39,200][106226] Updated weights for policy 0, policy_version 1500240 (0.0011) [2023-12-28 06:02:39,895][106225] Updated weights for policy 1, policy_version 1503968 (0.0010) [2023-12-28 06:02:39,964][106225] Updated weights for policy 1, policy_version 1503978 (0.0011) [2023-12-28 06:02:39,965][106226] Updated weights for policy 0, policy_version 1500250 (0.0010) [2023-12-28 06:02:40,022][106225] Updated weights for policy 1, policy_version 1503988 (0.0011) [2023-12-28 06:02:40,031][106226] Updated weights for policy 0, policy_version 1500260 (0.0008) [2023-12-28 06:02:40,088][106226] Updated weights for policy 0, policy_version 1500270 (0.0007) [2023-12-28 06:02:40,144][106226] Updated weights for policy 0, policy_version 1500280 (0.0008) [2023-12-28 06:02:40,779][106225] Updated weights for policy 1, policy_version 1503998 (0.0011) [2023-12-28 06:02:40,833][106225] Updated weights for policy 1, policy_version 1504008 (0.0010) [2023-12-28 06:02:40,878][106226] Updated weights for policy 0, policy_version 1500290 (0.0006) [2023-12-28 06:02:40,888][106225] Updated weights for policy 1, policy_version 1504018 (0.0010) [2023-12-28 06:02:40,937][106226] Updated weights for policy 0, policy_version 1500300 (0.0007) [2023-12-28 06:02:40,994][106226] Updated weights for policy 0, policy_version 1500310 (0.0008) [2023-12-28 06:02:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 769236992. Throughput: 0: 9756.5, 1: 10158.2. Samples: 769205424. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:41,175][105115] Avg episode reward: [(0, '-4.889'), (1, '-4.582')] [2023-12-28 06:02:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001504024_385081344.pth... [2023-12-28 06:02:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001500312_384155648.pth... [2023-12-28 06:02:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001502840_384778240.pth [2023-12-28 06:02:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001499160_383860736.pth [2023-12-28 06:02:41,682][106225] Updated weights for policy 1, policy_version 1504028 (0.0009) [2023-12-28 06:02:41,755][106225] Updated weights for policy 1, policy_version 1504039 (0.0007) [2023-12-28 06:02:41,790][106226] Updated weights for policy 0, policy_version 1500320 (0.0011) [2023-12-28 06:02:41,820][106225] Updated weights for policy 1, policy_version 1504049 (0.0010) [2023-12-28 06:02:41,858][106226] Updated weights for policy 0, policy_version 1500330 (0.0011) [2023-12-28 06:02:41,914][106226] Updated weights for policy 0, policy_version 1500340 (0.0011) [2023-12-28 06:02:42,604][106226] Updated weights for policy 0, policy_version 1500350 (0.0011) [2023-12-28 06:02:42,609][106225] Updated weights for policy 1, policy_version 1504059 (0.0006) [2023-12-28 06:02:42,663][106226] Updated weights for policy 0, policy_version 1500360 (0.0009) [2023-12-28 06:02:42,665][106225] Updated weights for policy 1, policy_version 1504069 (0.0006) [2023-12-28 06:02:42,722][106226] Updated weights for policy 0, policy_version 1500370 (0.0009) [2023-12-28 06:02:42,724][106225] Updated weights for policy 1, policy_version 1504079 (0.0006) [2023-12-28 06:02:43,356][106226] Updated weights for policy 0, policy_version 1500380 (0.0009) [2023-12-28 06:02:43,411][106226] Updated weights for policy 0, policy_version 1500390 (0.0008) [2023-12-28 06:02:43,430][106225] Updated weights for policy 1, policy_version 1504089 (0.0007) [2023-12-28 06:02:43,466][106226] Updated weights for policy 0, policy_version 1500400 (0.0006) [2023-12-28 06:02:43,489][106225] Updated weights for policy 1, policy_version 1504099 (0.0007) [2023-12-28 06:02:43,545][106225] Updated weights for policy 1, policy_version 1504109 (0.0008) [2023-12-28 06:02:43,609][106225] Updated weights for policy 1, policy_version 1504119 (0.0008) [2023-12-28 06:02:44,056][106226] Updated weights for policy 0, policy_version 1500410 (0.0006) [2023-12-28 06:02:44,117][106226] Updated weights for policy 0, policy_version 1500420 (0.0010) [2023-12-28 06:02:44,167][106226] Updated weights for policy 0, policy_version 1500430 (0.0009) [2023-12-28 06:02:44,225][106226] Updated weights for policy 0, policy_version 1500440 (0.0009) [2023-12-28 06:02:44,284][106225] Updated weights for policy 1, policy_version 1504129 (0.0006) [2023-12-28 06:02:44,342][106225] Updated weights for policy 1, policy_version 1504139 (0.0005) [2023-12-28 06:02:44,391][106225] Updated weights for policy 1, policy_version 1504149 (0.0005) [2023-12-28 06:02:44,940][106226] Updated weights for policy 0, policy_version 1500450 (0.0011) [2023-12-28 06:02:44,951][106225] Updated weights for policy 1, policy_version 1504159 (0.0008) [2023-12-28 06:02:45,002][106226] Updated weights for policy 0, policy_version 1500460 (0.0011) [2023-12-28 06:02:45,015][106225] Updated weights for policy 1, policy_version 1504169 (0.0008) [2023-12-28 06:02:45,061][106226] Updated weights for policy 0, policy_version 1500470 (0.0010) [2023-12-28 06:02:45,075][106225] Updated weights for policy 1, policy_version 1504179 (0.0006) [2023-12-28 06:02:45,717][106226] Updated weights for policy 0, policy_version 1500480 (0.0006) [2023-12-28 06:02:45,763][106226] Updated weights for policy 0, policy_version 1500490 (0.0007) [2023-12-28 06:02:45,811][106226] Updated weights for policy 0, policy_version 1500500 (0.0006) [2023-12-28 06:02:45,836][106225] Updated weights for policy 1, policy_version 1504189 (0.0010) [2023-12-28 06:02:45,895][106225] Updated weights for policy 1, policy_version 1504199 (0.0010) [2023-12-28 06:02:45,946][106225] Updated weights for policy 1, policy_version 1504209 (0.0008) [2023-12-28 06:02:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 769335296. Throughput: 0: 9773.9, 1: 10034.2. Samples: 769323036. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:46,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.687')] [2023-12-28 06:02:46,446][106226] Updated weights for policy 0, policy_version 1500510 (0.0006) [2023-12-28 06:02:46,508][106226] Updated weights for policy 0, policy_version 1500520 (0.0006) [2023-12-28 06:02:46,564][106226] Updated weights for policy 0, policy_version 1500530 (0.0006) [2023-12-28 06:02:46,649][106225] Updated weights for policy 1, policy_version 1504219 (0.0008) [2023-12-28 06:02:46,712][106225] Updated weights for policy 1, policy_version 1504229 (0.0010) [2023-12-28 06:02:46,770][106225] Updated weights for policy 1, policy_version 1504239 (0.0008) [2023-12-28 06:02:47,206][106226] Updated weights for policy 0, policy_version 1500540 (0.0007) [2023-12-28 06:02:47,260][106226] Updated weights for policy 0, policy_version 1500550 (0.0010) [2023-12-28 06:02:47,302][106226] Updated weights for policy 0, policy_version 1500560 (0.0010) [2023-12-28 06:02:47,362][106225] Updated weights for policy 1, policy_version 1504249 (0.0010) [2023-12-28 06:02:47,416][106225] Updated weights for policy 1, policy_version 1504259 (0.0010) [2023-12-28 06:02:47,472][106225] Updated weights for policy 1, policy_version 1504269 (0.0010) [2023-12-28 06:02:47,534][106225] Updated weights for policy 1, policy_version 1504279 (0.0008) [2023-12-28 06:02:48,008][106226] Updated weights for policy 0, policy_version 1500570 (0.0010) [2023-12-28 06:02:48,068][106226] Updated weights for policy 0, policy_version 1500580 (0.0008) [2023-12-28 06:02:48,112][106225] Updated weights for policy 1, policy_version 1504289 (0.0010) [2023-12-28 06:02:48,123][106226] Updated weights for policy 0, policy_version 1500590 (0.0007) [2023-12-28 06:02:48,163][106225] Updated weights for policy 1, policy_version 1504299 (0.0010) [2023-12-28 06:02:48,177][106226] Updated weights for policy 0, policy_version 1500600 (0.0011) [2023-12-28 06:02:48,217][106225] Updated weights for policy 1, policy_version 1504309 (0.0010) [2023-12-28 06:02:48,947][106225] Updated weights for policy 1, policy_version 1504319 (0.0011) [2023-12-28 06:02:48,948][106226] Updated weights for policy 0, policy_version 1500610 (0.0009) [2023-12-28 06:02:48,997][106226] Updated weights for policy 0, policy_version 1500620 (0.0006) [2023-12-28 06:02:49,005][106225] Updated weights for policy 1, policy_version 1504329 (0.0010) [2023-12-28 06:02:49,050][106226] Updated weights for policy 0, policy_version 1500630 (0.0007) [2023-12-28 06:02:49,063][106225] Updated weights for policy 1, policy_version 1504339 (0.0010) [2023-12-28 06:02:49,778][106225] Updated weights for policy 1, policy_version 1504349 (0.0011) [2023-12-28 06:02:49,790][106226] Updated weights for policy 0, policy_version 1500640 (0.0010) [2023-12-28 06:02:49,848][106225] Updated weights for policy 1, policy_version 1504359 (0.0010) [2023-12-28 06:02:49,851][106226] Updated weights for policy 0, policy_version 1500650 (0.0010) [2023-12-28 06:02:49,917][106226] Updated weights for policy 0, policy_version 1500660 (0.0007) [2023-12-28 06:02:49,919][106225] Updated weights for policy 1, policy_version 1504369 (0.0008) [2023-12-28 06:02:50,569][106226] Updated weights for policy 0, policy_version 1500670 (0.0007) [2023-12-28 06:02:50,632][106226] Updated weights for policy 0, policy_version 1500681 (0.0011) [2023-12-28 06:02:50,697][106226] Updated weights for policy 0, policy_version 1500691 (0.0009) [2023-12-28 06:02:50,699][106225] Updated weights for policy 1, policy_version 1504379 (0.0008) [2023-12-28 06:02:50,754][106225] Updated weights for policy 1, policy_version 1504389 (0.0009) [2023-12-28 06:02:50,809][106225] Updated weights for policy 1, policy_version 1504399 (0.0008) [2023-12-28 06:02:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 769433600. Throughput: 0: 9796.4, 1: 9975.0. Samples: 769443132. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:51,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-5.060')] [2023-12-28 06:02:51,446][106226] Updated weights for policy 0, policy_version 1500701 (0.0011) [2023-12-28 06:02:51,504][106226] Updated weights for policy 0, policy_version 1500711 (0.0010) [2023-12-28 06:02:51,567][106226] Updated weights for policy 0, policy_version 1500721 (0.0011) [2023-12-28 06:02:51,591][106225] Updated weights for policy 1, policy_version 1504409 (0.0007) [2023-12-28 06:02:51,662][106225] Updated weights for policy 1, policy_version 1504419 (0.0008) [2023-12-28 06:02:51,726][106225] Updated weights for policy 1, policy_version 1504429 (0.0007) [2023-12-28 06:02:51,792][106225] Updated weights for policy 1, policy_version 1504439 (0.0005) [2023-12-28 06:02:52,286][106226] Updated weights for policy 0, policy_version 1500731 (0.0010) [2023-12-28 06:02:52,354][106226] Updated weights for policy 0, policy_version 1500741 (0.0006) [2023-12-28 06:02:52,418][106226] Updated weights for policy 0, policy_version 1500751 (0.0007) [2023-12-28 06:02:52,501][106225] Updated weights for policy 1, policy_version 1504449 (0.0007) [2023-12-28 06:02:52,560][106225] Updated weights for policy 1, policy_version 1504459 (0.0008) [2023-12-28 06:02:52,617][106225] Updated weights for policy 1, policy_version 1504469 (0.0009) [2023-12-28 06:02:53,001][106226] Updated weights for policy 0, policy_version 1500761 (0.0007) [2023-12-28 06:02:53,053][106226] Updated weights for policy 0, policy_version 1500771 (0.0006) [2023-12-28 06:02:53,107][106226] Updated weights for policy 0, policy_version 1500781 (0.0005) [2023-12-28 06:02:53,170][106226] Updated weights for policy 0, policy_version 1500791 (0.0006) [2023-12-28 06:02:53,355][106225] Updated weights for policy 1, policy_version 1504479 (0.0007) [2023-12-28 06:02:53,409][106225] Updated weights for policy 1, policy_version 1504489 (0.0008) [2023-12-28 06:02:53,464][106225] Updated weights for policy 1, policy_version 1504499 (0.0008) [2023-12-28 06:02:53,934][106226] Updated weights for policy 0, policy_version 1500801 (0.0008) [2023-12-28 06:02:54,001][106226] Updated weights for policy 0, policy_version 1500811 (0.0005) [2023-12-28 06:02:54,020][106225] Updated weights for policy 1, policy_version 1504509 (0.0005) [2023-12-28 06:02:54,069][106226] Updated weights for policy 0, policy_version 1500821 (0.0006) [2023-12-28 06:02:54,077][106225] Updated weights for policy 1, policy_version 1504519 (0.0005) [2023-12-28 06:02:54,136][106225] Updated weights for policy 1, policy_version 1504529 (0.0006) [2023-12-28 06:02:54,742][106226] Updated weights for policy 0, policy_version 1500831 (0.0009) [2023-12-28 06:02:54,773][106225] Updated weights for policy 1, policy_version 1504539 (0.0008) [2023-12-28 06:02:54,791][106226] Updated weights for policy 0, policy_version 1500841 (0.0007) [2023-12-28 06:02:54,821][106225] Updated weights for policy 1, policy_version 1504549 (0.0005) [2023-12-28 06:02:54,847][106226] Updated weights for policy 0, policy_version 1500851 (0.0006) [2023-12-28 06:02:54,872][106225] Updated weights for policy 1, policy_version 1504559 (0.0006) [2023-12-28 06:02:55,535][106226] Updated weights for policy 0, policy_version 1500861 (0.0006) [2023-12-28 06:02:55,580][106225] Updated weights for policy 1, policy_version 1504569 (0.0008) [2023-12-28 06:02:55,590][106226] Updated weights for policy 0, policy_version 1500871 (0.0005) [2023-12-28 06:02:55,632][106225] Updated weights for policy 1, policy_version 1504579 (0.0008) [2023-12-28 06:02:55,639][106226] Updated weights for policy 0, policy_version 1500881 (0.0005) [2023-12-28 06:02:55,684][106225] Updated weights for policy 1, policy_version 1504589 (0.0008) [2023-12-28 06:02:55,739][106225] Updated weights for policy 1, policy_version 1504599 (0.0007) [2023-12-28 06:02:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 769531904. Throughput: 0: 9818.2, 1: 9940.8. Samples: 769502224. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:02:56,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.562')] [2023-12-28 06:02:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001504600_385228800.pth... [2023-12-28 06:02:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001500888_384303104.pth... [2023-12-28 06:02:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001503448_384933888.pth [2023-12-28 06:02:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001499736_384008192.pth [2023-12-28 06:02:56,294][106226] Updated weights for policy 0, policy_version 1500891 (0.0006) [2023-12-28 06:02:56,359][106226] Updated weights for policy 0, policy_version 1500901 (0.0006) [2023-12-28 06:02:56,425][106226] Updated weights for policy 0, policy_version 1500911 (0.0005) [2023-12-28 06:02:56,466][106225] Updated weights for policy 1, policy_version 1504609 (0.0007) [2023-12-28 06:02:56,535][106225] Updated weights for policy 1, policy_version 1504619 (0.0008) [2023-12-28 06:02:56,599][106225] Updated weights for policy 1, policy_version 1504629 (0.0007) [2023-12-28 06:02:57,013][106226] Updated weights for policy 0, policy_version 1500921 (0.0005) [2023-12-28 06:02:57,059][106226] Updated weights for policy 0, policy_version 1500931 (0.0008) [2023-12-28 06:02:57,105][106226] Updated weights for policy 0, policy_version 1500941 (0.0008) [2023-12-28 06:02:57,167][106226] Updated weights for policy 0, policy_version 1500951 (0.0009) [2023-12-28 06:02:57,293][106225] Updated weights for policy 1, policy_version 1504639 (0.0008) [2023-12-28 06:02:57,358][106225] Updated weights for policy 1, policy_version 1504649 (0.0009) [2023-12-28 06:02:57,416][106225] Updated weights for policy 1, policy_version 1504659 (0.0008) [2023-12-28 06:02:57,891][106226] Updated weights for policy 0, policy_version 1500961 (0.0008) [2023-12-28 06:02:57,936][106226] Updated weights for policy 0, policy_version 1500971 (0.0008) [2023-12-28 06:02:57,981][106226] Updated weights for policy 0, policy_version 1500981 (0.0006) [2023-12-28 06:02:58,140][106225] Updated weights for policy 1, policy_version 1504669 (0.0008) [2023-12-28 06:02:58,191][106225] Updated weights for policy 1, policy_version 1504679 (0.0008) [2023-12-28 06:02:58,247][106225] Updated weights for policy 1, policy_version 1504689 (0.0008) [2023-12-28 06:02:58,675][106226] Updated weights for policy 0, policy_version 1500991 (0.0007) [2023-12-28 06:02:58,742][106226] Updated weights for policy 0, policy_version 1501001 (0.0007) [2023-12-28 06:02:58,839][106226] Updated weights for policy 0, policy_version 1501011 (0.0009) [2023-12-28 06:02:59,048][106225] Updated weights for policy 1, policy_version 1504699 (0.0007) [2023-12-28 06:02:59,110][106225] Updated weights for policy 1, policy_version 1504709 (0.0007) [2023-12-28 06:02:59,172][106225] Updated weights for policy 1, policy_version 1504719 (0.0008) [2023-12-28 06:02:59,560][106226] Updated weights for policy 0, policy_version 1501021 (0.0009) [2023-12-28 06:02:59,630][106226] Updated weights for policy 0, policy_version 1501031 (0.0009) [2023-12-28 06:02:59,694][106226] Updated weights for policy 0, policy_version 1501041 (0.0008) [2023-12-28 06:02:59,936][106225] Updated weights for policy 1, policy_version 1504729 (0.0008) [2023-12-28 06:02:59,988][106225] Updated weights for policy 1, policy_version 1504739 (0.0008) [2023-12-28 06:03:00,051][106225] Updated weights for policy 1, policy_version 1504749 (0.0008) [2023-12-28 06:03:00,109][106225] Updated weights for policy 1, policy_version 1504759 (0.0007) [2023-12-28 06:03:00,442][106226] Updated weights for policy 0, policy_version 1501051 (0.0009) [2023-12-28 06:03:00,504][106226] Updated weights for policy 0, policy_version 1501061 (0.0009) [2023-12-28 06:03:00,569][106226] Updated weights for policy 0, policy_version 1501071 (0.0009) [2023-12-28 06:03:00,676][106225] Updated weights for policy 1, policy_version 1504769 (0.0005) [2023-12-28 06:03:00,731][106225] Updated weights for policy 1, policy_version 1504779 (0.0005) [2023-12-28 06:03:00,777][106225] Updated weights for policy 1, policy_version 1504789 (0.0005) [2023-12-28 06:03:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 769630208. Throughput: 0: 9819.3, 1: 9948.3. Samples: 769621372. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:01,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.571')] [2023-12-28 06:03:01,361][106226] Updated weights for policy 0, policy_version 1501081 (0.0010) [2023-12-28 06:03:01,430][106226] Updated weights for policy 0, policy_version 1501091 (0.0008) [2023-12-28 06:03:01,492][106226] Updated weights for policy 0, policy_version 1501101 (0.0007) [2023-12-28 06:03:01,494][106225] Updated weights for policy 1, policy_version 1504799 (0.0007) [2023-12-28 06:03:01,544][106226] Updated weights for policy 0, policy_version 1501111 (0.0008) [2023-12-28 06:03:01,558][106225] Updated weights for policy 1, policy_version 1504809 (0.0007) [2023-12-28 06:03:01,623][106225] Updated weights for policy 1, policy_version 1504819 (0.0008) [2023-12-28 06:03:02,241][106226] Updated weights for policy 0, policy_version 1501121 (0.0006) [2023-12-28 06:03:02,305][106226] Updated weights for policy 0, policy_version 1501131 (0.0008) [2023-12-28 06:03:02,371][106226] Updated weights for policy 0, policy_version 1501141 (0.0009) [2023-12-28 06:03:02,389][106225] Updated weights for policy 1, policy_version 1504829 (0.0009) [2023-12-28 06:03:02,440][106225] Updated weights for policy 1, policy_version 1504839 (0.0008) [2023-12-28 06:03:02,486][106225] Updated weights for policy 1, policy_version 1504849 (0.0008) [2023-12-28 06:03:03,100][106226] Updated weights for policy 0, policy_version 1501151 (0.0006) [2023-12-28 06:03:03,153][106226] Updated weights for policy 0, policy_version 1501161 (0.0008) [2023-12-28 06:03:03,160][106225] Updated weights for policy 1, policy_version 1504859 (0.0007) [2023-12-28 06:03:03,209][106225] Updated weights for policy 1, policy_version 1504869 (0.0005) [2023-12-28 06:03:03,210][106226] Updated weights for policy 0, policy_version 1501171 (0.0009) [2023-12-28 06:03:03,262][106225] Updated weights for policy 1, policy_version 1504879 (0.0007) [2023-12-28 06:03:03,848][106226] Updated weights for policy 0, policy_version 1501181 (0.0008) [2023-12-28 06:03:03,904][106226] Updated weights for policy 0, policy_version 1501191 (0.0009) [2023-12-28 06:03:03,907][106225] Updated weights for policy 1, policy_version 1504889 (0.0007) [2023-12-28 06:03:03,962][106226] Updated weights for policy 0, policy_version 1501201 (0.0010) [2023-12-28 06:03:03,964][106225] Updated weights for policy 1, policy_version 1504899 (0.0007) [2023-12-28 06:03:04,031][106225] Updated weights for policy 1, policy_version 1504909 (0.0006) [2023-12-28 06:03:04,088][106225] Updated weights for policy 1, policy_version 1504919 (0.0008) [2023-12-28 06:03:04,650][106226] Updated weights for policy 0, policy_version 1501211 (0.0009) [2023-12-28 06:03:04,718][106226] Updated weights for policy 0, policy_version 1501221 (0.0006) [2023-12-28 06:03:04,778][106226] Updated weights for policy 0, policy_version 1501231 (0.0011) [2023-12-28 06:03:04,845][106225] Updated weights for policy 1, policy_version 1504929 (0.0007) [2023-12-28 06:03:04,905][106225] Updated weights for policy 1, policy_version 1504939 (0.0006) [2023-12-28 06:03:04,965][106225] Updated weights for policy 1, policy_version 1504949 (0.0005) [2023-12-28 06:03:05,450][106226] Updated weights for policy 0, policy_version 1501241 (0.0010) [2023-12-28 06:03:05,509][106226] Updated weights for policy 0, policy_version 1501251 (0.0010) [2023-12-28 06:03:05,572][106226] Updated weights for policy 0, policy_version 1501261 (0.0010) [2023-12-28 06:03:05,588][106225] Updated weights for policy 1, policy_version 1504959 (0.0005) [2023-12-28 06:03:05,626][106226] Updated weights for policy 0, policy_version 1501271 (0.0011) [2023-12-28 06:03:05,644][106225] Updated weights for policy 1, policy_version 1504969 (0.0006) [2023-12-28 06:03:05,709][106225] Updated weights for policy 1, policy_version 1504979 (0.0007) [2023-12-28 06:03:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 769728512. Throughput: 0: 9843.6, 1: 9965.8. Samples: 769740680. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:06,175][105115] Avg episode reward: [(0, '-4.925'), (1, '-4.673')] [2023-12-28 06:03:06,342][106226] Updated weights for policy 0, policy_version 1501281 (0.0009) [2023-12-28 06:03:06,345][106225] Updated weights for policy 1, policy_version 1504989 (0.0008) [2023-12-28 06:03:06,398][106226] Updated weights for policy 0, policy_version 1501291 (0.0009) [2023-12-28 06:03:06,403][106225] Updated weights for policy 1, policy_version 1504999 (0.0009) [2023-12-28 06:03:06,461][106226] Updated weights for policy 0, policy_version 1501301 (0.0009) [2023-12-28 06:03:06,461][106225] Updated weights for policy 1, policy_version 1505009 (0.0009) [2023-12-28 06:03:07,304][106226] Updated weights for policy 0, policy_version 1501311 (0.0010) [2023-12-28 06:03:07,317][106225] Updated weights for policy 1, policy_version 1505019 (0.0008) [2023-12-28 06:03:07,363][106226] Updated weights for policy 0, policy_version 1501321 (0.0008) [2023-12-28 06:03:07,382][106225] Updated weights for policy 1, policy_version 1505029 (0.0006) [2023-12-28 06:03:07,423][106226] Updated weights for policy 0, policy_version 1501331 (0.0009) [2023-12-28 06:03:07,440][106225] Updated weights for policy 1, policy_version 1505039 (0.0006) [2023-12-28 06:03:07,991][106226] Updated weights for policy 0, policy_version 1501341 (0.0009) [2023-12-28 06:03:08,054][106226] Updated weights for policy 0, policy_version 1501351 (0.0008) [2023-12-28 06:03:08,119][106226] Updated weights for policy 0, policy_version 1501361 (0.0009) [2023-12-28 06:03:08,186][106225] Updated weights for policy 1, policy_version 1505049 (0.0007) [2023-12-28 06:03:08,240][106225] Updated weights for policy 1, policy_version 1505059 (0.0008) [2023-12-28 06:03:08,301][106225] Updated weights for policy 1, policy_version 1505069 (0.0010) [2023-12-28 06:03:08,360][106225] Updated weights for policy 1, policy_version 1505079 (0.0009) [2023-12-28 06:03:08,765][106226] Updated weights for policy 0, policy_version 1501371 (0.0008) [2023-12-28 06:03:08,821][106226] Updated weights for policy 0, policy_version 1501381 (0.0009) [2023-12-28 06:03:08,875][106226] Updated weights for policy 0, policy_version 1501391 (0.0009) [2023-12-28 06:03:09,165][106225] Updated weights for policy 1, policy_version 1505089 (0.0007) [2023-12-28 06:03:09,225][106225] Updated weights for policy 1, policy_version 1505099 (0.0009) [2023-12-28 06:03:09,287][106225] Updated weights for policy 1, policy_version 1505109 (0.0008) [2023-12-28 06:03:09,626][106226] Updated weights for policy 0, policy_version 1501401 (0.0008) [2023-12-28 06:03:09,682][106226] Updated weights for policy 0, policy_version 1501411 (0.0009) [2023-12-28 06:03:09,745][106226] Updated weights for policy 0, policy_version 1501421 (0.0009) [2023-12-28 06:03:09,799][106226] Updated weights for policy 0, policy_version 1501431 (0.0008) [2023-12-28 06:03:10,077][106225] Updated weights for policy 1, policy_version 1505119 (0.0009) [2023-12-28 06:03:10,130][106225] Updated weights for policy 1, policy_version 1505129 (0.0008) [2023-12-28 06:03:10,182][106225] Updated weights for policy 1, policy_version 1505139 (0.0008) [2023-12-28 06:03:10,572][106226] Updated weights for policy 0, policy_version 1501441 (0.0007) [2023-12-28 06:03:10,627][106226] Updated weights for policy 0, policy_version 1501451 (0.0009) [2023-12-28 06:03:10,698][106226] Updated weights for policy 0, policy_version 1501461 (0.0005) [2023-12-28 06:03:10,933][106225] Updated weights for policy 1, policy_version 1505149 (0.0009) [2023-12-28 06:03:10,991][106225] Updated weights for policy 1, policy_version 1505159 (0.0009) [2023-12-28 06:03:11,055][106225] Updated weights for policy 1, policy_version 1505169 (0.0008) [2023-12-28 06:03:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 769826816. Throughput: 0: 9862.2, 1: 9951.0. Samples: 769797228. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:11,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.781')] [2023-12-28 06:03:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001505176_385376256.pth... [2023-12-28 06:03:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001501464_384450560.pth... [2023-12-28 06:03:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001504024_385081344.pth [2023-12-28 06:03:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001500312_384155648.pth [2023-12-28 06:03:11,427][106226] Updated weights for policy 0, policy_version 1501471 (0.0007) [2023-12-28 06:03:11,489][106226] Updated weights for policy 0, policy_version 1501481 (0.0008) [2023-12-28 06:03:11,548][106226] Updated weights for policy 0, policy_version 1501491 (0.0008) [2023-12-28 06:03:11,833][106225] Updated weights for policy 1, policy_version 1505179 (0.0009) [2023-12-28 06:03:11,894][106225] Updated weights for policy 1, policy_version 1505189 (0.0008) [2023-12-28 06:03:11,949][106225] Updated weights for policy 1, policy_version 1505199 (0.0008) [2023-12-28 06:03:12,336][106226] Updated weights for policy 0, policy_version 1501501 (0.0009) [2023-12-28 06:03:12,405][106226] Updated weights for policy 0, policy_version 1501511 (0.0008) [2023-12-28 06:03:12,471][106226] Updated weights for policy 0, policy_version 1501521 (0.0011) [2023-12-28 06:03:12,714][106225] Updated weights for policy 1, policy_version 1505209 (0.0007) [2023-12-28 06:03:12,775][106225] Updated weights for policy 1, policy_version 1505219 (0.0008) [2023-12-28 06:03:12,839][106225] Updated weights for policy 1, policy_version 1505229 (0.0008) [2023-12-28 06:03:12,906][106225] Updated weights for policy 1, policy_version 1505239 (0.0008) [2023-12-28 06:03:13,117][106226] Updated weights for policy 0, policy_version 1501531 (0.0010) [2023-12-28 06:03:13,178][106226] Updated weights for policy 0, policy_version 1501541 (0.0009) [2023-12-28 06:03:13,224][106226] Updated weights for policy 0, policy_version 1501551 (0.0009) [2023-12-28 06:03:13,598][106225] Updated weights for policy 1, policy_version 1505249 (0.0010) [2023-12-28 06:03:13,645][106225] Updated weights for policy 1, policy_version 1505259 (0.0010) [2023-12-28 06:03:13,703][106225] Updated weights for policy 1, policy_version 1505269 (0.0010) [2023-12-28 06:03:13,988][106226] Updated weights for policy 0, policy_version 1501561 (0.0008) [2023-12-28 06:03:14,034][106226] Updated weights for policy 0, policy_version 1501571 (0.0005) [2023-12-28 06:03:14,082][106226] Updated weights for policy 0, policy_version 1501581 (0.0006) [2023-12-28 06:03:14,148][106226] Updated weights for policy 0, policy_version 1501591 (0.0009) [2023-12-28 06:03:14,312][106225] Updated weights for policy 1, policy_version 1505279 (0.0009) [2023-12-28 06:03:14,371][106225] Updated weights for policy 1, policy_version 1505289 (0.0010) [2023-12-28 06:03:14,427][106225] Updated weights for policy 1, policy_version 1505299 (0.0009) [2023-12-28 06:03:14,803][106226] Updated weights for policy 0, policy_version 1501601 (0.0009) [2023-12-28 06:03:14,868][106226] Updated weights for policy 0, policy_version 1501611 (0.0007) [2023-12-28 06:03:14,922][106226] Updated weights for policy 0, policy_version 1501621 (0.0008) [2023-12-28 06:03:15,137][106225] Updated weights for policy 1, policy_version 1505309 (0.0009) [2023-12-28 06:03:15,193][106225] Updated weights for policy 1, policy_version 1505319 (0.0008) [2023-12-28 06:03:15,256][106225] Updated weights for policy 1, policy_version 1505329 (0.0007) [2023-12-28 06:03:15,605][106226] Updated weights for policy 0, policy_version 1501631 (0.0006) [2023-12-28 06:03:15,667][106226] Updated weights for policy 0, policy_version 1501641 (0.0005) [2023-12-28 06:03:15,740][106226] Updated weights for policy 0, policy_version 1501651 (0.0005) [2023-12-28 06:03:15,977][106225] Updated weights for policy 1, policy_version 1505339 (0.0009) [2023-12-28 06:03:16,027][106225] Updated weights for policy 1, policy_version 1505349 (0.0010) [2023-12-28 06:03:16,073][106225] Updated weights for policy 1, policy_version 1505359 (0.0010) [2023-12-28 06:03:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 769925120. Throughput: 0: 9757.3, 1: 9874.0. Samples: 769911580. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:16,175][105115] Avg episode reward: [(0, '-4.959'), (1, '-4.731')] [2023-12-28 06:03:16,218][106226] Updated weights for policy 0, policy_version 1501661 (0.0005) [2023-12-28 06:03:16,281][106226] Updated weights for policy 0, policy_version 1501671 (0.0005) [2023-12-28 06:03:16,340][106226] Updated weights for policy 0, policy_version 1501681 (0.0007) [2023-12-28 06:03:16,813][106225] Updated weights for policy 1, policy_version 1505369 (0.0010) [2023-12-28 06:03:16,870][106225] Updated weights for policy 1, policy_version 1505379 (0.0006) [2023-12-28 06:03:16,913][106226] Updated weights for policy 0, policy_version 1501691 (0.0007) [2023-12-28 06:03:16,919][106225] Updated weights for policy 1, policy_version 1505389 (0.0008) [2023-12-28 06:03:16,970][106225] Updated weights for policy 1, policy_version 1505399 (0.0006) [2023-12-28 06:03:16,979][106226] Updated weights for policy 0, policy_version 1501701 (0.0008) [2023-12-28 06:03:17,032][106226] Updated weights for policy 0, policy_version 1501711 (0.0008) [2023-12-28 06:03:17,652][106225] Updated weights for policy 1, policy_version 1505409 (0.0009) [2023-12-28 06:03:17,711][106225] Updated weights for policy 1, policy_version 1505419 (0.0009) [2023-12-28 06:03:17,768][106226] Updated weights for policy 0, policy_version 1501721 (0.0009) [2023-12-28 06:03:17,770][106225] Updated weights for policy 1, policy_version 1505429 (0.0008) [2023-12-28 06:03:17,822][106226] Updated weights for policy 0, policy_version 1501731 (0.0007) [2023-12-28 06:03:17,878][106226] Updated weights for policy 0, policy_version 1501741 (0.0009) [2023-12-28 06:03:17,935][106226] Updated weights for policy 0, policy_version 1501751 (0.0009) [2023-12-28 06:03:18,530][106225] Updated weights for policy 1, policy_version 1505439 (0.0007) [2023-12-28 06:03:18,594][106225] Updated weights for policy 1, policy_version 1505449 (0.0008) [2023-12-28 06:03:18,652][106225] Updated weights for policy 1, policy_version 1505459 (0.0007) [2023-12-28 06:03:18,655][106226] Updated weights for policy 0, policy_version 1501761 (0.0008) [2023-12-28 06:03:18,713][106226] Updated weights for policy 0, policy_version 1501771 (0.0008) [2023-12-28 06:03:18,768][106226] Updated weights for policy 0, policy_version 1501781 (0.0008) [2023-12-28 06:03:19,389][106225] Updated weights for policy 1, policy_version 1505469 (0.0008) [2023-12-28 06:03:19,436][106225] Updated weights for policy 1, policy_version 1505479 (0.0006) [2023-12-28 06:03:19,498][106225] Updated weights for policy 1, policy_version 1505489 (0.0008) [2023-12-28 06:03:19,530][106226] Updated weights for policy 0, policy_version 1501791 (0.0008) [2023-12-28 06:03:19,581][106226] Updated weights for policy 0, policy_version 1501801 (0.0008) [2023-12-28 06:03:19,633][106226] Updated weights for policy 0, policy_version 1501811 (0.0008) [2023-12-28 06:03:20,242][106225] Updated weights for policy 1, policy_version 1505499 (0.0006) [2023-12-28 06:03:20,305][106225] Updated weights for policy 1, policy_version 1505509 (0.0009) [2023-12-28 06:03:20,369][106225] Updated weights for policy 1, policy_version 1505519 (0.0008) [2023-12-28 06:03:20,382][106226] Updated weights for policy 0, policy_version 1501821 (0.0009) [2023-12-28 06:03:20,446][106226] Updated weights for policy 0, policy_version 1501831 (0.0011) [2023-12-28 06:03:20,509][106226] Updated weights for policy 0, policy_version 1501841 (0.0011) [2023-12-28 06:03:21,086][106225] Updated weights for policy 1, policy_version 1505529 (0.0006) [2023-12-28 06:03:21,152][106225] Updated weights for policy 1, policy_version 1505539 (0.0008) [2023-12-28 06:03:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 770015232. Throughput: 0: 9836.2, 1: 9805.2. Samples: 770029396. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:21,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.746')] [2023-12-28 06:03:21,220][106225] Updated weights for policy 1, policy_version 1505549 (0.0008) [2023-12-28 06:03:21,273][106226] Updated weights for policy 0, policy_version 1501851 (0.0007) [2023-12-28 06:03:21,286][106225] Updated weights for policy 1, policy_version 1505559 (0.0007) [2023-12-28 06:03:21,340][106226] Updated weights for policy 0, policy_version 1501861 (0.0008) [2023-12-28 06:03:21,414][106226] Updated weights for policy 0, policy_version 1501871 (0.0008) [2023-12-28 06:03:22,083][106225] Updated weights for policy 1, policy_version 1505569 (0.0005) [2023-12-28 06:03:22,144][106226] Updated weights for policy 0, policy_version 1501881 (0.0006) [2023-12-28 06:03:22,153][106225] Updated weights for policy 1, policy_version 1505579 (0.0006) [2023-12-28 06:03:22,205][106226] Updated weights for policy 0, policy_version 1501891 (0.0011) [2023-12-28 06:03:22,211][106225] Updated weights for policy 1, policy_version 1505589 (0.0006) [2023-12-28 06:03:22,271][106226] Updated weights for policy 0, policy_version 1501901 (0.0012) [2023-12-28 06:03:22,332][106226] Updated weights for policy 0, policy_version 1501911 (0.0011) [2023-12-28 06:03:22,890][106225] Updated weights for policy 1, policy_version 1505599 (0.0007) [2023-12-28 06:03:22,955][106225] Updated weights for policy 1, policy_version 1505609 (0.0008) [2023-12-28 06:03:23,021][106225] Updated weights for policy 1, policy_version 1505619 (0.0007) [2023-12-28 06:03:23,058][106226] Updated weights for policy 0, policy_version 1501921 (0.0008) [2023-12-28 06:03:23,119][106226] Updated weights for policy 0, policy_version 1501931 (0.0011) [2023-12-28 06:03:23,181][106226] Updated weights for policy 0, policy_version 1501941 (0.0011) [2023-12-28 06:03:23,714][106225] Updated weights for policy 1, policy_version 1505629 (0.0009) [2023-12-28 06:03:23,773][106225] Updated weights for policy 1, policy_version 1505639 (0.0006) [2023-12-28 06:03:23,838][106225] Updated weights for policy 1, policy_version 1505649 (0.0005) [2023-12-28 06:03:23,894][106226] Updated weights for policy 0, policy_version 1501951 (0.0007) [2023-12-28 06:03:23,953][106226] Updated weights for policy 0, policy_version 1501961 (0.0005) [2023-12-28 06:03:24,012][106226] Updated weights for policy 0, policy_version 1501971 (0.0009) [2023-12-28 06:03:24,415][106225] Updated weights for policy 1, policy_version 1505659 (0.0008) [2023-12-28 06:03:24,466][106225] Updated weights for policy 1, policy_version 1505669 (0.0010) [2023-12-28 06:03:24,510][106225] Updated weights for policy 1, policy_version 1505679 (0.0010) [2023-12-28 06:03:24,656][106226] Updated weights for policy 0, policy_version 1501981 (0.0009) [2023-12-28 06:03:24,710][106226] Updated weights for policy 0, policy_version 1501991 (0.0005) [2023-12-28 06:03:24,766][106226] Updated weights for policy 0, policy_version 1502001 (0.0005) [2023-12-28 06:03:25,233][106225] Updated weights for policy 1, policy_version 1505689 (0.0010) [2023-12-28 06:03:25,295][106225] Updated weights for policy 1, policy_version 1505699 (0.0010) [2023-12-28 06:03:25,349][106226] Updated weights for policy 0, policy_version 1502011 (0.0006) [2023-12-28 06:03:25,351][106225] Updated weights for policy 1, policy_version 1505709 (0.0010) [2023-12-28 06:03:25,400][106226] Updated weights for policy 0, policy_version 1502021 (0.0007) [2023-12-28 06:03:25,406][106225] Updated weights for policy 1, policy_version 1505719 (0.0009) [2023-12-28 06:03:25,455][106226] Updated weights for policy 0, policy_version 1502031 (0.0008) [2023-12-28 06:03:26,096][106225] Updated weights for policy 1, policy_version 1505729 (0.0008) [2023-12-28 06:03:26,160][106225] Updated weights for policy 1, policy_version 1505739 (0.0008) [2023-12-28 06:03:26,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 770113536. Throughput: 0: 9866.2, 1: 9717.4. Samples: 770086688. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:26,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-4.469')] [2023-12-28 06:03:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001502040_384598016.pth... [2023-12-28 06:03:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001500888_384303104.pth [2023-12-28 06:03:26,213][106225] Updated weights for policy 1, policy_version 1505749 (0.0009) [2023-12-28 06:03:26,215][106226] Updated weights for policy 0, policy_version 1502041 (0.0008) [2023-12-28 06:03:26,223][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001505752_385523712.pth... [2023-12-28 06:03:26,226][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001504600_385228800.pth [2023-12-28 06:03:26,266][106226] Updated weights for policy 0, policy_version 1502051 (0.0005) [2023-12-28 06:03:26,327][106226] Updated weights for policy 0, policy_version 1502061 (0.0005) [2023-12-28 06:03:26,386][106226] Updated weights for policy 0, policy_version 1502071 (0.0005) [2023-12-28 06:03:26,960][106225] Updated weights for policy 1, policy_version 1505759 (0.0010) [2023-12-28 06:03:26,962][106226] Updated weights for policy 0, policy_version 1502081 (0.0007) [2023-12-28 06:03:27,011][106225] Updated weights for policy 1, policy_version 1505769 (0.0010) [2023-12-28 06:03:27,017][106226] Updated weights for policy 0, policy_version 1502091 (0.0008) [2023-12-28 06:03:27,063][106225] Updated weights for policy 1, policy_version 1505779 (0.0010) [2023-12-28 06:03:27,070][106226] Updated weights for policy 0, policy_version 1502101 (0.0006) [2023-12-28 06:03:27,791][106225] Updated weights for policy 1, policy_version 1505789 (0.0008) [2023-12-28 06:03:27,817][106226] Updated weights for policy 0, policy_version 1502111 (0.0008) [2023-12-28 06:03:27,843][106225] Updated weights for policy 1, policy_version 1505799 (0.0006) [2023-12-28 06:03:27,868][106226] Updated weights for policy 0, policy_version 1502121 (0.0007) [2023-12-28 06:03:27,890][106225] Updated weights for policy 1, policy_version 1505809 (0.0006) [2023-12-28 06:03:27,915][106226] Updated weights for policy 0, policy_version 1502131 (0.0006) [2023-12-28 06:03:28,539][106225] Updated weights for policy 1, policy_version 1505819 (0.0006) [2023-12-28 06:03:28,564][106226] Updated weights for policy 0, policy_version 1502141 (0.0008) [2023-12-28 06:03:28,592][106225] Updated weights for policy 1, policy_version 1505829 (0.0005) [2023-12-28 06:03:28,618][106226] Updated weights for policy 0, policy_version 1502151 (0.0007) [2023-12-28 06:03:28,653][106225] Updated weights for policy 1, policy_version 1505839 (0.0008) [2023-12-28 06:03:28,667][106226] Updated weights for policy 0, policy_version 1502161 (0.0007) [2023-12-28 06:03:29,241][106225] Updated weights for policy 1, policy_version 1505849 (0.0006) [2023-12-28 06:03:29,295][106225] Updated weights for policy 1, policy_version 1505859 (0.0008) [2023-12-28 06:03:29,364][106225] Updated weights for policy 1, policy_version 1505869 (0.0009) [2023-12-28 06:03:29,426][106225] Updated weights for policy 1, policy_version 1505879 (0.0009) [2023-12-28 06:03:29,464][106226] Updated weights for policy 0, policy_version 1502171 (0.0007) [2023-12-28 06:03:29,522][106226] Updated weights for policy 0, policy_version 1502181 (0.0007) [2023-12-28 06:03:29,574][106226] Updated weights for policy 0, policy_version 1502191 (0.0008) [2023-12-28 06:03:30,141][106225] Updated weights for policy 1, policy_version 1505889 (0.0008) [2023-12-28 06:03:30,196][106225] Updated weights for policy 1, policy_version 1505899 (0.0008) [2023-12-28 06:03:30,254][106225] Updated weights for policy 1, policy_version 1505909 (0.0008) [2023-12-28 06:03:30,299][106226] Updated weights for policy 0, policy_version 1502201 (0.0009) [2023-12-28 06:03:30,351][106226] Updated weights for policy 0, policy_version 1502211 (0.0009) [2023-12-28 06:03:30,404][106226] Updated weights for policy 0, policy_version 1502221 (0.0009) [2023-12-28 06:03:30,454][106226] Updated weights for policy 0, policy_version 1502231 (0.0009) [2023-12-28 06:03:30,988][106225] Updated weights for policy 1, policy_version 1505919 (0.0009) [2023-12-28 06:03:31,069][106225] Updated weights for policy 1, policy_version 1505929 (0.0008) [2023-12-28 06:03:31,136][106225] Updated weights for policy 1, policy_version 1505939 (0.0009) [2023-12-28 06:03:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 770220032. Throughput: 0: 9912.3, 1: 9777.0. Samples: 770209052. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:31,175][105115] Avg episode reward: [(0, '-4.763'), (1, '-4.859')] [2023-12-28 06:03:31,192][106226] Updated weights for policy 0, policy_version 1502241 (0.0007) [2023-12-28 06:03:31,254][106226] Updated weights for policy 0, policy_version 1502251 (0.0008) [2023-12-28 06:03:31,320][106226] Updated weights for policy 0, policy_version 1502261 (0.0008) [2023-12-28 06:03:31,812][106225] Updated weights for policy 1, policy_version 1505949 (0.0009) [2023-12-28 06:03:31,859][106225] Updated weights for policy 1, policy_version 1505959 (0.0009) [2023-12-28 06:03:31,907][106225] Updated weights for policy 1, policy_version 1505969 (0.0008) [2023-12-28 06:03:32,093][106226] Updated weights for policy 0, policy_version 1502271 (0.0008) [2023-12-28 06:03:32,142][106226] Updated weights for policy 0, policy_version 1502281 (0.0008) [2023-12-28 06:03:32,198][106226] Updated weights for policy 0, policy_version 1502291 (0.0009) [2023-12-28 06:03:32,614][106225] Updated weights for policy 1, policy_version 1505979 (0.0008) [2023-12-28 06:03:32,660][106225] Updated weights for policy 1, policy_version 1505989 (0.0007) [2023-12-28 06:03:32,719][106225] Updated weights for policy 1, policy_version 1505999 (0.0009) [2023-12-28 06:03:32,927][106226] Updated weights for policy 0, policy_version 1502301 (0.0008) [2023-12-28 06:03:32,983][106226] Updated weights for policy 0, policy_version 1502311 (0.0009) [2023-12-28 06:03:33,028][106226] Updated weights for policy 0, policy_version 1502321 (0.0008) [2023-12-28 06:03:33,461][106225] Updated weights for policy 1, policy_version 1506009 (0.0007) [2023-12-28 06:03:33,529][106225] Updated weights for policy 1, policy_version 1506019 (0.0005) [2023-12-28 06:03:33,580][106225] Updated weights for policy 1, policy_version 1506029 (0.0005) [2023-12-28 06:03:33,633][106225] Updated weights for policy 1, policy_version 1506039 (0.0005) [2023-12-28 06:03:33,682][106226] Updated weights for policy 0, policy_version 1502331 (0.0007) [2023-12-28 06:03:33,731][106226] Updated weights for policy 0, policy_version 1502341 (0.0005) [2023-12-28 06:03:33,794][106226] Updated weights for policy 0, policy_version 1502351 (0.0005) [2023-12-28 06:03:34,193][106225] Updated weights for policy 1, policy_version 1506049 (0.0007) [2023-12-28 06:03:34,252][106225] Updated weights for policy 1, policy_version 1506059 (0.0007) [2023-12-28 06:03:34,306][106225] Updated weights for policy 1, policy_version 1506069 (0.0007) [2023-12-28 06:03:34,506][106226] Updated weights for policy 0, policy_version 1502361 (0.0008) [2023-12-28 06:03:34,571][106226] Updated weights for policy 0, policy_version 1502371 (0.0011) [2023-12-28 06:03:34,635][106226] Updated weights for policy 0, policy_version 1502381 (0.0011) [2023-12-28 06:03:34,703][106226] Updated weights for policy 0, policy_version 1502391 (0.0011) [2023-12-28 06:03:35,064][106225] Updated weights for policy 1, policy_version 1506079 (0.0009) [2023-12-28 06:03:35,115][106225] Updated weights for policy 1, policy_version 1506089 (0.0010) [2023-12-28 06:03:35,175][106225] Updated weights for policy 1, policy_version 1506099 (0.0010) [2023-12-28 06:03:35,292][106226] Updated weights for policy 0, policy_version 1502401 (0.0006) [2023-12-28 06:03:35,351][106226] Updated weights for policy 0, policy_version 1502411 (0.0005) [2023-12-28 06:03:35,407][106226] Updated weights for policy 0, policy_version 1502421 (0.0005) [2023-12-28 06:03:35,802][106225] Updated weights for policy 1, policy_version 1506109 (0.0008) [2023-12-28 06:03:35,851][106225] Updated weights for policy 1, policy_version 1506119 (0.0005) [2023-12-28 06:03:35,900][106225] Updated weights for policy 1, policy_version 1506129 (0.0005) [2023-12-28 06:03:35,950][106226] Updated weights for policy 0, policy_version 1502431 (0.0007) [2023-12-28 06:03:36,005][106226] Updated weights for policy 0, policy_version 1502441 (0.0007) [2023-12-28 06:03:36,062][106226] Updated weights for policy 0, policy_version 1502451 (0.0005) [2023-12-28 06:03:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 770326528. Throughput: 0: 9924.9, 1: 9808.1. Samples: 770331116. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:36,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.773')] [2023-12-28 06:03:36,526][106225] Updated weights for policy 1, policy_version 1506139 (0.0007) [2023-12-28 06:03:36,592][106225] Updated weights for policy 1, policy_version 1506149 (0.0011) [2023-12-28 06:03:36,651][106225] Updated weights for policy 1, policy_version 1506159 (0.0010) [2023-12-28 06:03:36,734][106226] Updated weights for policy 0, policy_version 1502461 (0.0006) [2023-12-28 06:03:36,804][106226] Updated weights for policy 0, policy_version 1502471 (0.0006) [2023-12-28 06:03:36,867][106226] Updated weights for policy 0, policy_version 1502481 (0.0008) [2023-12-28 06:03:37,291][106225] Updated weights for policy 1, policy_version 1506169 (0.0010) [2023-12-28 06:03:37,351][106225] Updated weights for policy 1, policy_version 1506179 (0.0009) [2023-12-28 06:03:37,409][106225] Updated weights for policy 1, policy_version 1506189 (0.0010) [2023-12-28 06:03:37,478][106225] Updated weights for policy 1, policy_version 1506199 (0.0011) [2023-12-28 06:03:37,624][106226] Updated weights for policy 0, policy_version 1502491 (0.0007) [2023-12-28 06:03:37,679][106226] Updated weights for policy 0, policy_version 1502501 (0.0007) [2023-12-28 06:03:37,738][106226] Updated weights for policy 0, policy_version 1502511 (0.0011) [2023-12-28 06:03:38,158][106225] Updated weights for policy 1, policy_version 1506209 (0.0008) [2023-12-28 06:03:38,217][106225] Updated weights for policy 1, policy_version 1506219 (0.0006) [2023-12-28 06:03:38,274][106225] Updated weights for policy 1, policy_version 1506229 (0.0005) [2023-12-28 06:03:38,386][106226] Updated weights for policy 0, policy_version 1502521 (0.0009) [2023-12-28 06:03:38,436][106226] Updated weights for policy 0, policy_version 1502531 (0.0010) [2023-12-28 06:03:38,492][106226] Updated weights for policy 0, policy_version 1502541 (0.0009) [2023-12-28 06:03:38,561][106226] Updated weights for policy 0, policy_version 1502551 (0.0007) [2023-12-28 06:03:38,935][106225] Updated weights for policy 1, policy_version 1506239 (0.0007) [2023-12-28 06:03:38,998][106225] Updated weights for policy 1, policy_version 1506249 (0.0009) [2023-12-28 06:03:39,052][106225] Updated weights for policy 1, policy_version 1506259 (0.0008) [2023-12-28 06:03:39,375][106226] Updated weights for policy 0, policy_version 1502561 (0.0009) [2023-12-28 06:03:39,448][106226] Updated weights for policy 0, policy_version 1502571 (0.0008) [2023-12-28 06:03:39,509][106226] Updated weights for policy 0, policy_version 1502581 (0.0009) [2023-12-28 06:03:39,747][106225] Updated weights for policy 1, policy_version 1506269 (0.0008) [2023-12-28 06:03:39,820][106225] Updated weights for policy 1, policy_version 1506279 (0.0008) [2023-12-28 06:03:39,889][106225] Updated weights for policy 1, policy_version 1506289 (0.0007) [2023-12-28 06:03:40,312][106226] Updated weights for policy 0, policy_version 1502591 (0.0009) [2023-12-28 06:03:40,373][106226] Updated weights for policy 0, policy_version 1502601 (0.0007) [2023-12-28 06:03:40,426][106226] Updated weights for policy 0, policy_version 1502611 (0.0008) [2023-12-28 06:03:40,556][106225] Updated weights for policy 1, policy_version 1506299 (0.0008) [2023-12-28 06:03:40,611][106225] Updated weights for policy 1, policy_version 1506309 (0.0009) [2023-12-28 06:03:40,662][106225] Updated weights for policy 1, policy_version 1506319 (0.0008) [2023-12-28 06:03:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 770416640. Throughput: 0: 9915.2, 1: 9864.3. Samples: 770392304. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:41,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.821')] [2023-12-28 06:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001506328_385671168.pth... [2023-12-28 06:03:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001505176_385376256.pth [2023-12-28 06:03:41,192][106226] Updated weights for policy 0, policy_version 1502621 (0.0010) [2023-12-28 06:03:41,252][106226] Updated weights for policy 0, policy_version 1502631 (0.0010) [2023-12-28 06:03:41,315][106226] Updated weights for policy 0, policy_version 1502641 (0.0008) [2023-12-28 06:03:41,362][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001502648_384753664.pth... [2023-12-28 06:03:41,367][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001501464_384450560.pth [2023-12-28 06:03:41,446][106225] Updated weights for policy 1, policy_version 1506329 (0.0008) [2023-12-28 06:03:41,500][106225] Updated weights for policy 1, policy_version 1506339 (0.0005) [2023-12-28 06:03:41,559][106225] Updated weights for policy 1, policy_version 1506349 (0.0006) [2023-12-28 06:03:41,617][106225] Updated weights for policy 1, policy_version 1506359 (0.0007) [2023-12-28 06:03:42,088][106226] Updated weights for policy 0, policy_version 1502651 (0.0009) [2023-12-28 06:03:42,157][106226] Updated weights for policy 0, policy_version 1502661 (0.0008) [2023-12-28 06:03:42,224][106226] Updated weights for policy 0, policy_version 1502671 (0.0007) [2023-12-28 06:03:42,336][106225] Updated weights for policy 1, policy_version 1506369 (0.0009) [2023-12-28 06:03:42,407][106225] Updated weights for policy 1, policy_version 1506379 (0.0010) [2023-12-28 06:03:42,468][106225] Updated weights for policy 1, policy_version 1506389 (0.0008) [2023-12-28 06:03:42,949][106226] Updated weights for policy 0, policy_version 1502681 (0.0008) [2023-12-28 06:03:43,011][106226] Updated weights for policy 0, policy_version 1502691 (0.0009) [2023-12-28 06:03:43,073][106226] Updated weights for policy 0, policy_version 1502701 (0.0008) [2023-12-28 06:03:43,113][106225] Updated weights for policy 1, policy_version 1506399 (0.0007) [2023-12-28 06:03:43,126][106226] Updated weights for policy 0, policy_version 1502711 (0.0009) [2023-12-28 06:03:43,169][106225] Updated weights for policy 1, policy_version 1506409 (0.0008) [2023-12-28 06:03:43,229][106225] Updated weights for policy 1, policy_version 1506419 (0.0008) [2023-12-28 06:03:43,831][106226] Updated weights for policy 0, policy_version 1502721 (0.0008) [2023-12-28 06:03:43,879][106226] Updated weights for policy 0, policy_version 1502731 (0.0008) [2023-12-28 06:03:43,937][106225] Updated weights for policy 1, policy_version 1506429 (0.0007) [2023-12-28 06:03:43,939][106226] Updated weights for policy 0, policy_version 1502741 (0.0007) [2023-12-28 06:03:43,990][106225] Updated weights for policy 1, policy_version 1506439 (0.0007) [2023-12-28 06:03:44,042][106225] Updated weights for policy 1, policy_version 1506449 (0.0008) [2023-12-28 06:03:44,648][106226] Updated weights for policy 0, policy_version 1502751 (0.0008) [2023-12-28 06:03:44,698][106226] Updated weights for policy 0, policy_version 1502761 (0.0010) [2023-12-28 06:03:44,744][106226] Updated weights for policy 0, policy_version 1502771 (0.0010) [2023-12-28 06:03:44,827][106225] Updated weights for policy 1, policy_version 1506459 (0.0008) [2023-12-28 06:03:44,894][106225] Updated weights for policy 1, policy_version 1506469 (0.0006) [2023-12-28 06:03:44,959][106225] Updated weights for policy 1, policy_version 1506479 (0.0008) [2023-12-28 06:03:45,494][106226] Updated weights for policy 0, policy_version 1502781 (0.0008) [2023-12-28 06:03:45,546][106226] Updated weights for policy 0, policy_version 1502791 (0.0005) [2023-12-28 06:03:45,579][106225] Updated weights for policy 1, policy_version 1506489 (0.0008) [2023-12-28 06:03:45,600][106226] Updated weights for policy 0, policy_version 1502801 (0.0007) [2023-12-28 06:03:45,644][106225] Updated weights for policy 1, policy_version 1506499 (0.0006) [2023-12-28 06:03:45,714][106225] Updated weights for policy 1, policy_version 1506509 (0.0005) [2023-12-28 06:03:45,776][106225] Updated weights for policy 1, policy_version 1506519 (0.0005) [2023-12-28 06:03:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 770514944. Throughput: 0: 9811.1, 1: 9846.9. Samples: 770505980. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:46,175][105115] Avg episode reward: [(0, '-4.879'), (1, '-4.737')] [2023-12-28 06:03:46,282][106225] Updated weights for policy 1, policy_version 1506529 (0.0006) [2023-12-28 06:03:46,334][106225] Updated weights for policy 1, policy_version 1506539 (0.0009) [2023-12-28 06:03:46,379][106226] Updated weights for policy 0, policy_version 1502811 (0.0007) [2023-12-28 06:03:46,385][106225] Updated weights for policy 1, policy_version 1506549 (0.0007) [2023-12-28 06:03:46,428][106226] Updated weights for policy 0, policy_version 1502821 (0.0008) [2023-12-28 06:03:46,477][106226] Updated weights for policy 0, policy_version 1502831 (0.0008) [2023-12-28 06:03:47,111][106226] Updated weights for policy 0, policy_version 1502841 (0.0008) [2023-12-28 06:03:47,167][106226] Updated weights for policy 0, policy_version 1502851 (0.0005) [2023-12-28 06:03:47,174][106225] Updated weights for policy 1, policy_version 1506559 (0.0007) [2023-12-28 06:03:47,217][106226] Updated weights for policy 0, policy_version 1502861 (0.0009) [2023-12-28 06:03:47,224][106225] Updated weights for policy 1, policy_version 1506569 (0.0006) [2023-12-28 06:03:47,264][106226] Updated weights for policy 0, policy_version 1502871 (0.0008) [2023-12-28 06:03:47,278][106225] Updated weights for policy 1, policy_version 1506579 (0.0007) [2023-12-28 06:03:47,881][106226] Updated weights for policy 0, policy_version 1502881 (0.0010) [2023-12-28 06:03:47,941][106226] Updated weights for policy 0, policy_version 1502891 (0.0008) [2023-12-28 06:03:48,005][106226] Updated weights for policy 0, policy_version 1502901 (0.0005) [2023-12-28 06:03:48,064][106225] Updated weights for policy 1, policy_version 1506589 (0.0008) [2023-12-28 06:03:48,115][106225] Updated weights for policy 1, policy_version 1506599 (0.0008) [2023-12-28 06:03:48,172][106225] Updated weights for policy 1, policy_version 1506609 (0.0007) [2023-12-28 06:03:48,726][106226] Updated weights for policy 0, policy_version 1502911 (0.0007) [2023-12-28 06:03:48,790][106226] Updated weights for policy 0, policy_version 1502921 (0.0008) [2023-12-28 06:03:48,855][106226] Updated weights for policy 0, policy_version 1502931 (0.0008) [2023-12-28 06:03:48,870][106225] Updated weights for policy 1, policy_version 1506619 (0.0007) [2023-12-28 06:03:48,932][106225] Updated weights for policy 1, policy_version 1506629 (0.0008) [2023-12-28 06:03:48,989][106225] Updated weights for policy 1, policy_version 1506639 (0.0008) [2023-12-28 06:03:49,551][106226] Updated weights for policy 0, policy_version 1502941 (0.0009) [2023-12-28 06:03:49,610][106226] Updated weights for policy 0, policy_version 1502951 (0.0009) [2023-12-28 06:03:49,679][106226] Updated weights for policy 0, policy_version 1502961 (0.0008) [2023-12-28 06:03:49,711][106225] Updated weights for policy 1, policy_version 1506649 (0.0009) [2023-12-28 06:03:49,759][106225] Updated weights for policy 1, policy_version 1506659 (0.0010) [2023-12-28 06:03:49,810][106225] Updated weights for policy 1, policy_version 1506669 (0.0010) [2023-12-28 06:03:49,879][106225] Updated weights for policy 1, policy_version 1506679 (0.0009) [2023-12-28 06:03:50,442][106226] Updated weights for policy 0, policy_version 1502971 (0.0008) [2023-12-28 06:03:50,498][106226] Updated weights for policy 0, policy_version 1502981 (0.0009) [2023-12-28 06:03:50,549][106226] Updated weights for policy 0, policy_version 1502991 (0.0008) [2023-12-28 06:03:50,660][106225] Updated weights for policy 1, policy_version 1506689 (0.0009) [2023-12-28 06:03:50,722][106225] Updated weights for policy 1, policy_version 1506699 (0.0008) [2023-12-28 06:03:50,785][106225] Updated weights for policy 1, policy_version 1506709 (0.0007) [2023-12-28 06:03:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 770613248. Throughput: 0: 9815.6, 1: 9810.0. Samples: 770623832. Policy #0 lag: (min: 27.0, avg: 52.3, max: 56.0) [2023-12-28 06:03:51,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-4.809')] [2023-12-28 06:03:51,312][106226] Updated weights for policy 0, policy_version 1503001 (0.0008) [2023-12-28 06:03:51,376][106226] Updated weights for policy 0, policy_version 1503011 (0.0007) [2023-12-28 06:03:51,440][106226] Updated weights for policy 0, policy_version 1503021 (0.0008) [2023-12-28 06:03:51,507][106226] Updated weights for policy 0, policy_version 1503031 (0.0009) [2023-12-28 06:03:51,535][106225] Updated weights for policy 1, policy_version 1506719 (0.0007) [2023-12-28 06:03:51,599][106225] Updated weights for policy 1, policy_version 1506729 (0.0006) [2023-12-28 06:03:51,669][106225] Updated weights for policy 1, policy_version 1506739 (0.0008) [2023-12-28 06:03:52,341][106226] Updated weights for policy 0, policy_version 1503041 (0.0008) [2023-12-28 06:03:52,407][106225] Updated weights for policy 1, policy_version 1506749 (0.0009) [2023-12-28 06:03:52,413][106226] Updated weights for policy 0, policy_version 1503051 (0.0007) [2023-12-28 06:03:52,462][106225] Updated weights for policy 1, policy_version 1506759 (0.0010) [2023-12-28 06:03:52,473][106226] Updated weights for policy 0, policy_version 1503061 (0.0006) [2023-12-28 06:03:52,515][106225] Updated weights for policy 1, policy_version 1506769 (0.0010) [2023-12-28 06:03:53,182][106226] Updated weights for policy 0, policy_version 1503071 (0.0006) [2023-12-28 06:03:53,199][106225] Updated weights for policy 1, policy_version 1506779 (0.0009) [2023-12-28 06:03:53,246][106226] Updated weights for policy 0, policy_version 1503081 (0.0005) [2023-12-28 06:03:53,261][106225] Updated weights for policy 1, policy_version 1506789 (0.0005) [2023-12-28 06:03:53,297][106226] Updated weights for policy 0, policy_version 1503091 (0.0005) [2023-12-28 06:03:53,314][106225] Updated weights for policy 1, policy_version 1506799 (0.0006) [2023-12-28 06:03:53,884][106225] Updated weights for policy 1, policy_version 1506809 (0.0006) [2023-12-28 06:03:53,887][106226] Updated weights for policy 0, policy_version 1503101 (0.0006) [2023-12-28 06:03:53,941][106226] Updated weights for policy 0, policy_version 1503111 (0.0007) [2023-12-28 06:03:53,944][106225] Updated weights for policy 1, policy_version 1506819 (0.0009) [2023-12-28 06:03:54,002][106226] Updated weights for policy 0, policy_version 1503121 (0.0007) [2023-12-28 06:03:54,004][106225] Updated weights for policy 1, policy_version 1506829 (0.0007) [2023-12-28 06:03:54,053][106225] Updated weights for policy 1, policy_version 1506839 (0.0005) [2023-12-28 06:03:54,566][106226] Updated weights for policy 0, policy_version 1503131 (0.0006) [2023-12-28 06:03:54,632][106226] Updated weights for policy 0, policy_version 1503141 (0.0005) [2023-12-28 06:03:54,687][106225] Updated weights for policy 1, policy_version 1506849 (0.0005) [2023-12-28 06:03:54,701][106226] Updated weights for policy 0, policy_version 1503151 (0.0006) [2023-12-28 06:03:54,746][106225] Updated weights for policy 1, policy_version 1506859 (0.0005) [2023-12-28 06:03:54,813][106225] Updated weights for policy 1, policy_version 1506869 (0.0006) [2023-12-28 06:03:55,246][106226] Updated weights for policy 0, policy_version 1503161 (0.0005) [2023-12-28 06:03:55,304][106226] Updated weights for policy 0, policy_version 1503171 (0.0006) [2023-12-28 06:03:55,365][106226] Updated weights for policy 0, policy_version 1503181 (0.0006) [2023-12-28 06:03:55,388][106225] Updated weights for policy 1, policy_version 1506879 (0.0007) [2023-12-28 06:03:55,433][106226] Updated weights for policy 0, policy_version 1503191 (0.0005) [2023-12-28 06:03:55,448][106225] Updated weights for policy 1, policy_version 1506889 (0.0008) [2023-12-28 06:03:55,507][106225] Updated weights for policy 1, policy_version 1506899 (0.0010) [2023-12-28 06:03:55,993][106226] Updated weights for policy 0, policy_version 1503201 (0.0006) [2023-12-28 06:03:56,054][106226] Updated weights for policy 0, policy_version 1503211 (0.0009) [2023-12-28 06:03:56,118][106226] Updated weights for policy 0, policy_version 1503221 (0.0011) [2023-12-28 06:03:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 770719744. Throughput: 0: 9816.4, 1: 9871.9. Samples: 770683200. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:03:56,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-4.662')] [2023-12-28 06:03:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001503224_384901120.pth... [2023-12-28 06:03:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001502040_384598016.pth [2023-12-28 06:03:56,209][106225] Updated weights for policy 1, policy_version 1506909 (0.0010) [2023-12-28 06:03:56,266][106225] Updated weights for policy 1, policy_version 1506919 (0.0010) [2023-12-28 06:03:56,319][106225] Updated weights for policy 1, policy_version 1506929 (0.0010) [2023-12-28 06:03:56,360][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001506936_385826816.pth... [2023-12-28 06:03:56,364][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001505752_385523712.pth [2023-12-28 06:03:56,706][106226] Updated weights for policy 0, policy_version 1503231 (0.0007) [2023-12-28 06:03:56,756][106226] Updated weights for policy 0, policy_version 1503241 (0.0005) [2023-12-28 06:03:56,808][106226] Updated weights for policy 0, policy_version 1503251 (0.0005) [2023-12-28 06:03:56,923][106225] Updated weights for policy 1, policy_version 1506939 (0.0008) [2023-12-28 06:03:56,971][106225] Updated weights for policy 1, policy_version 1506949 (0.0009) [2023-12-28 06:03:57,028][106225] Updated weights for policy 1, policy_version 1506959 (0.0006) [2023-12-28 06:03:57,418][106226] Updated weights for policy 0, policy_version 1503261 (0.0006) [2023-12-28 06:03:57,477][106226] Updated weights for policy 0, policy_version 1503271 (0.0009) [2023-12-28 06:03:57,535][106226] Updated weights for policy 0, policy_version 1503281 (0.0007) [2023-12-28 06:03:57,758][106225] Updated weights for policy 1, policy_version 1506969 (0.0006) [2023-12-28 06:03:57,807][106225] Updated weights for policy 1, policy_version 1506979 (0.0005) [2023-12-28 06:03:57,852][106225] Updated weights for policy 1, policy_version 1506989 (0.0005) [2023-12-28 06:03:57,901][106225] Updated weights for policy 1, policy_version 1506999 (0.0005) [2023-12-28 06:03:58,065][106226] Updated weights for policy 0, policy_version 1503291 (0.0005) [2023-12-28 06:03:58,124][106226] Updated weights for policy 0, policy_version 1503301 (0.0005) [2023-12-28 06:03:58,173][106226] Updated weights for policy 0, policy_version 1503311 (0.0005) [2023-12-28 06:03:58,497][106225] Updated weights for policy 1, policy_version 1507009 (0.0007) [2023-12-28 06:03:58,560][106225] Updated weights for policy 1, policy_version 1507019 (0.0008) [2023-12-28 06:03:58,624][106225] Updated weights for policy 1, policy_version 1507029 (0.0007) [2023-12-28 06:03:58,904][106226] Updated weights for policy 0, policy_version 1503321 (0.0006) [2023-12-28 06:03:58,969][106226] Updated weights for policy 0, policy_version 1503331 (0.0008) [2023-12-28 06:03:59,026][106226] Updated weights for policy 0, policy_version 1503341 (0.0009) [2023-12-28 06:03:59,088][106226] Updated weights for policy 0, policy_version 1503351 (0.0009) [2023-12-28 06:03:59,288][106225] Updated weights for policy 1, policy_version 1507039 (0.0007) [2023-12-28 06:03:59,350][106225] Updated weights for policy 1, policy_version 1507049 (0.0007) [2023-12-28 06:03:59,417][106225] Updated weights for policy 1, policy_version 1507059 (0.0008) [2023-12-28 06:03:59,906][106226] Updated weights for policy 0, policy_version 1503361 (0.0007) [2023-12-28 06:03:59,975][106226] Updated weights for policy 0, policy_version 1503371 (0.0008) [2023-12-28 06:04:00,032][106226] Updated weights for policy 0, policy_version 1503381 (0.0008) [2023-12-28 06:04:00,046][106225] Updated weights for policy 1, policy_version 1507069 (0.0006) [2023-12-28 06:04:00,096][106225] Updated weights for policy 1, policy_version 1507079 (0.0008) [2023-12-28 06:04:00,146][106225] Updated weights for policy 1, policy_version 1507089 (0.0008) [2023-12-28 06:04:00,673][106226] Updated weights for policy 0, policy_version 1503391 (0.0006) [2023-12-28 06:04:00,738][106226] Updated weights for policy 0, policy_version 1503401 (0.0005) [2023-12-28 06:04:00,798][106226] Updated weights for policy 0, policy_version 1503411 (0.0005) [2023-12-28 06:04:00,801][106225] Updated weights for policy 1, policy_version 1507099 (0.0010) [2023-12-28 06:04:00,861][106225] Updated weights for policy 1, policy_version 1507109 (0.0009) [2023-12-28 06:04:00,916][106225] Updated weights for policy 1, policy_version 1507119 (0.0008) [2023-12-28 06:04:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 770826240. Throughput: 0: 9990.6, 1: 10024.2. Samples: 770812248. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:01,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-4.914')] [2023-12-28 06:04:01,410][106226] Updated weights for policy 0, policy_version 1503421 (0.0008) [2023-12-28 06:04:01,481][106226] Updated weights for policy 0, policy_version 1503431 (0.0011) [2023-12-28 06:04:01,546][106226] Updated weights for policy 0, policy_version 1503441 (0.0011) [2023-12-28 06:04:01,597][106225] Updated weights for policy 1, policy_version 1507129 (0.0005) [2023-12-28 06:04:01,673][106225] Updated weights for policy 1, policy_version 1507139 (0.0008) [2023-12-28 06:04:01,725][106225] Updated weights for policy 1, policy_version 1507149 (0.0008) [2023-12-28 06:04:01,801][106225] Updated weights for policy 1, policy_version 1507159 (0.0009) [2023-12-28 06:04:02,314][106226] Updated weights for policy 0, policy_version 1503451 (0.0010) [2023-12-28 06:04:02,385][106226] Updated weights for policy 0, policy_version 1503461 (0.0008) [2023-12-28 06:04:02,439][106226] Updated weights for policy 0, policy_version 1503471 (0.0008) [2023-12-28 06:04:02,483][106225] Updated weights for policy 1, policy_version 1507169 (0.0010) [2023-12-28 06:04:02,542][106225] Updated weights for policy 1, policy_version 1507179 (0.0010) [2023-12-28 06:04:02,602][106225] Updated weights for policy 1, policy_version 1507189 (0.0005) [2023-12-28 06:04:03,180][106226] Updated weights for policy 0, policy_version 1503481 (0.0009) [2023-12-28 06:04:03,187][106225] Updated weights for policy 1, policy_version 1507199 (0.0009) [2023-12-28 06:04:03,241][106225] Updated weights for policy 1, policy_version 1507209 (0.0010) [2023-12-28 06:04:03,246][106226] Updated weights for policy 0, policy_version 1503491 (0.0005) [2023-12-28 06:04:03,297][106225] Updated weights for policy 1, policy_version 1507219 (0.0010) [2023-12-28 06:04:03,304][106226] Updated weights for policy 0, policy_version 1503501 (0.0005) [2023-12-28 06:04:03,360][106226] Updated weights for policy 0, policy_version 1503511 (0.0006) [2023-12-28 06:04:03,944][106226] Updated weights for policy 0, policy_version 1503521 (0.0007) [2023-12-28 06:04:03,982][106225] Updated weights for policy 1, policy_version 1507229 (0.0008) [2023-12-28 06:04:04,001][106226] Updated weights for policy 0, policy_version 1503531 (0.0008) [2023-12-28 06:04:04,048][106225] Updated weights for policy 1, policy_version 1507239 (0.0005) [2023-12-28 06:04:04,068][106226] Updated weights for policy 0, policy_version 1503541 (0.0009) [2023-12-28 06:04:04,114][106225] Updated weights for policy 1, policy_version 1507249 (0.0006) [2023-12-28 06:04:04,779][106226] Updated weights for policy 0, policy_version 1503551 (0.0009) [2023-12-28 06:04:04,789][106225] Updated weights for policy 1, policy_version 1507259 (0.0008) [2023-12-28 06:04:04,830][106226] Updated weights for policy 0, policy_version 1503561 (0.0008) [2023-12-28 06:04:04,836][106225] Updated weights for policy 1, policy_version 1507269 (0.0006) [2023-12-28 06:04:04,873][106226] Updated weights for policy 0, policy_version 1503571 (0.0006) [2023-12-28 06:04:04,894][106225] Updated weights for policy 1, policy_version 1507279 (0.0007) [2023-12-28 06:04:05,570][106225] Updated weights for policy 1, policy_version 1507289 (0.0008) [2023-12-28 06:04:05,607][106226] Updated weights for policy 0, policy_version 1503581 (0.0007) [2023-12-28 06:04:05,638][106225] Updated weights for policy 1, policy_version 1507299 (0.0008) [2023-12-28 06:04:05,671][106226] Updated weights for policy 0, policy_version 1503591 (0.0006) [2023-12-28 06:04:05,695][106225] Updated weights for policy 1, policy_version 1507309 (0.0007) [2023-12-28 06:04:05,739][106226] Updated weights for policy 0, policy_version 1503601 (0.0007) [2023-12-28 06:04:05,758][106225] Updated weights for policy 1, policy_version 1507319 (0.0007) [2023-12-28 06:04:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 770924544. Throughput: 0: 9981.2, 1: 10124.2. Samples: 770934136. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:06,175][105115] Avg episode reward: [(0, '-4.930'), (1, '-4.893')] [2023-12-28 06:04:06,423][106226] Updated weights for policy 0, policy_version 1503611 (0.0007) [2023-12-28 06:04:06,484][106225] Updated weights for policy 1, policy_version 1507329 (0.0007) [2023-12-28 06:04:06,493][106226] Updated weights for policy 0, policy_version 1503621 (0.0007) [2023-12-28 06:04:06,549][106225] Updated weights for policy 1, policy_version 1507339 (0.0008) [2023-12-28 06:04:06,551][106226] Updated weights for policy 0, policy_version 1503631 (0.0006) [2023-12-28 06:04:06,601][106225] Updated weights for policy 1, policy_version 1507349 (0.0007) [2023-12-28 06:04:07,253][106226] Updated weights for policy 0, policy_version 1503641 (0.0008) [2023-12-28 06:04:07,318][106226] Updated weights for policy 0, policy_version 1503651 (0.0008) [2023-12-28 06:04:07,349][106225] Updated weights for policy 1, policy_version 1507359 (0.0006) [2023-12-28 06:04:07,383][106226] Updated weights for policy 0, policy_version 1503661 (0.0008) [2023-12-28 06:04:07,416][106225] Updated weights for policy 1, policy_version 1507369 (0.0005) [2023-12-28 06:04:07,454][106226] Updated weights for policy 0, policy_version 1503671 (0.0006) [2023-12-28 06:04:07,506][106225] Updated weights for policy 1, policy_version 1507379 (0.0006) [2023-12-28 06:04:08,126][106226] Updated weights for policy 0, policy_version 1503681 (0.0009) [2023-12-28 06:04:08,153][106225] Updated weights for policy 1, policy_version 1507389 (0.0006) [2023-12-28 06:04:08,189][106226] Updated weights for policy 0, policy_version 1503691 (0.0008) [2023-12-28 06:04:08,205][106225] Updated weights for policy 1, policy_version 1507399 (0.0006) [2023-12-28 06:04:08,248][106226] Updated weights for policy 0, policy_version 1503701 (0.0007) [2023-12-28 06:04:08,261][106225] Updated weights for policy 1, policy_version 1507409 (0.0008) [2023-12-28 06:04:08,889][106225] Updated weights for policy 1, policy_version 1507419 (0.0008) [2023-12-28 06:04:08,942][106225] Updated weights for policy 1, policy_version 1507429 (0.0009) [2023-12-28 06:04:08,993][106225] Updated weights for policy 1, policy_version 1507439 (0.0007) [2023-12-28 06:04:09,022][106226] Updated weights for policy 0, policy_version 1503711 (0.0007) [2023-12-28 06:04:09,073][106226] Updated weights for policy 0, policy_version 1503721 (0.0007) [2023-12-28 06:04:09,130][106226] Updated weights for policy 0, policy_version 1503731 (0.0008) [2023-12-28 06:04:09,763][106225] Updated weights for policy 1, policy_version 1507449 (0.0006) [2023-12-28 06:04:09,821][106225] Updated weights for policy 1, policy_version 1507459 (0.0008) [2023-12-28 06:04:09,863][106226] Updated weights for policy 0, policy_version 1503741 (0.0009) [2023-12-28 06:04:09,887][106225] Updated weights for policy 1, policy_version 1507469 (0.0009) [2023-12-28 06:04:09,929][106226] Updated weights for policy 0, policy_version 1503751 (0.0007) [2023-12-28 06:04:09,960][106225] Updated weights for policy 1, policy_version 1507479 (0.0010) [2023-12-28 06:04:09,997][106226] Updated weights for policy 0, policy_version 1503761 (0.0007) [2023-12-28 06:04:10,663][106225] Updated weights for policy 1, policy_version 1507489 (0.0010) [2023-12-28 06:04:10,721][106225] Updated weights for policy 1, policy_version 1507499 (0.0011) [2023-12-28 06:04:10,739][106226] Updated weights for policy 0, policy_version 1503771 (0.0008) [2023-12-28 06:04:10,778][106225] Updated weights for policy 1, policy_version 1507509 (0.0010) [2023-12-28 06:04:10,796][106226] Updated weights for policy 0, policy_version 1503781 (0.0009) [2023-12-28 06:04:10,853][106226] Updated weights for policy 0, policy_version 1503791 (0.0008) [2023-12-28 06:04:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 771022848. Throughput: 0: 9976.9, 1: 10152.5. Samples: 770992512. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:11,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.649')] [2023-12-28 06:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001507512_385974272.pth... [2023-12-28 06:04:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001503800_385048576.pth... [2023-12-28 06:04:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001506328_385671168.pth [2023-12-28 06:04:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001502648_384753664.pth [2023-12-28 06:04:11,520][106225] Updated weights for policy 1, policy_version 1507519 (0.0009) [2023-12-28 06:04:11,550][106226] Updated weights for policy 0, policy_version 1503801 (0.0006) [2023-12-28 06:04:11,578][106225] Updated weights for policy 1, policy_version 1507529 (0.0007) [2023-12-28 06:04:11,616][106226] Updated weights for policy 0, policy_version 1503811 (0.0008) [2023-12-28 06:04:11,643][106225] Updated weights for policy 1, policy_version 1507539 (0.0008) [2023-12-28 06:04:11,688][106226] Updated weights for policy 0, policy_version 1503821 (0.0008) [2023-12-28 06:04:11,767][106226] Updated weights for policy 0, policy_version 1503831 (0.0008) [2023-12-28 06:04:12,379][106226] Updated weights for policy 0, policy_version 1503841 (0.0008) [2023-12-28 06:04:12,435][106226] Updated weights for policy 0, policy_version 1503851 (0.0010) [2023-12-28 06:04:12,463][106225] Updated weights for policy 1, policy_version 1507549 (0.0009) [2023-12-28 06:04:12,486][106226] Updated weights for policy 0, policy_version 1503861 (0.0011) [2023-12-28 06:04:12,525][106225] Updated weights for policy 1, policy_version 1507559 (0.0009) [2023-12-28 06:04:12,582][106225] Updated weights for policy 1, policy_version 1507569 (0.0008) [2023-12-28 06:04:13,122][106226] Updated weights for policy 0, policy_version 1503871 (0.0009) [2023-12-28 06:04:13,175][106226] Updated weights for policy 0, policy_version 1503881 (0.0010) [2023-12-28 06:04:13,232][106226] Updated weights for policy 0, policy_version 1503891 (0.0010) [2023-12-28 06:04:13,359][106225] Updated weights for policy 1, policy_version 1507579 (0.0009) [2023-12-28 06:04:13,410][106225] Updated weights for policy 1, policy_version 1507589 (0.0010) [2023-12-28 06:04:13,456][106225] Updated weights for policy 1, policy_version 1507599 (0.0010) [2023-12-28 06:04:13,943][106226] Updated weights for policy 0, policy_version 1503901 (0.0011) [2023-12-28 06:04:13,999][106226] Updated weights for policy 0, policy_version 1503911 (0.0010) [2023-12-28 06:04:14,062][106226] Updated weights for policy 0, policy_version 1503921 (0.0010) [2023-12-28 06:04:14,184][106225] Updated weights for policy 1, policy_version 1507609 (0.0010) [2023-12-28 06:04:14,236][106225] Updated weights for policy 1, policy_version 1507619 (0.0008) [2023-12-28 06:04:14,284][106225] Updated weights for policy 1, policy_version 1507629 (0.0007) [2023-12-28 06:04:14,343][106225] Updated weights for policy 1, policy_version 1507639 (0.0008) [2023-12-28 06:04:14,633][106226] Updated weights for policy 0, policy_version 1503931 (0.0009) [2023-12-28 06:04:14,687][106226] Updated weights for policy 0, policy_version 1503941 (0.0007) [2023-12-28 06:04:14,735][106226] Updated weights for policy 0, policy_version 1503951 (0.0010) [2023-12-28 06:04:15,200][106225] Updated weights for policy 1, policy_version 1507649 (0.0010) [2023-12-28 06:04:15,262][106225] Updated weights for policy 1, policy_version 1507659 (0.0010) [2023-12-28 06:04:15,323][106225] Updated weights for policy 1, policy_version 1507669 (0.0011) [2023-12-28 06:04:15,472][106226] Updated weights for policy 0, policy_version 1503961 (0.0010) [2023-12-28 06:04:15,528][106226] Updated weights for policy 0, policy_version 1503971 (0.0005) [2023-12-28 06:04:15,580][106226] Updated weights for policy 0, policy_version 1503981 (0.0005) [2023-12-28 06:04:15,643][106226] Updated weights for policy 0, policy_version 1503991 (0.0005) [2023-12-28 06:04:16,021][106225] Updated weights for policy 1, policy_version 1507679 (0.0010) [2023-12-28 06:04:16,084][106225] Updated weights for policy 1, policy_version 1507689 (0.0010) [2023-12-28 06:04:16,142][106225] Updated weights for policy 1, policy_version 1507699 (0.0010) [2023-12-28 06:04:16,155][106226] Updated weights for policy 0, policy_version 1504001 (0.0006) [2023-12-28 06:04:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 771121152. Throughput: 0: 9963.0, 1: 10017.4. Samples: 771108172. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:16,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.830')] [2023-12-28 06:04:16,215][106226] Updated weights for policy 0, policy_version 1504011 (0.0007) [2023-12-28 06:04:16,272][106226] Updated weights for policy 0, policy_version 1504021 (0.0008) [2023-12-28 06:04:16,831][106225] Updated weights for policy 1, policy_version 1507709 (0.0009) [2023-12-28 06:04:16,894][106225] Updated weights for policy 1, policy_version 1507719 (0.0006) [2023-12-28 06:04:16,903][106226] Updated weights for policy 0, policy_version 1504031 (0.0007) [2023-12-28 06:04:16,956][106225] Updated weights for policy 1, policy_version 1507729 (0.0006) [2023-12-28 06:04:16,966][106226] Updated weights for policy 0, policy_version 1504041 (0.0009) [2023-12-28 06:04:17,021][106226] Updated weights for policy 0, policy_version 1504051 (0.0006) [2023-12-28 06:04:17,609][106225] Updated weights for policy 1, policy_version 1507739 (0.0007) [2023-12-28 06:04:17,656][106225] Updated weights for policy 1, policy_version 1507749 (0.0010) [2023-12-28 06:04:17,707][106225] Updated weights for policy 1, policy_version 1507759 (0.0010) [2023-12-28 06:04:17,782][106226] Updated weights for policy 0, policy_version 1504061 (0.0007) [2023-12-28 06:04:17,839][106226] Updated weights for policy 0, policy_version 1504071 (0.0005) [2023-12-28 06:04:17,901][106226] Updated weights for policy 0, policy_version 1504081 (0.0006) [2023-12-28 06:04:18,451][106225] Updated weights for policy 1, policy_version 1507769 (0.0008) [2023-12-28 06:04:18,455][106226] Updated weights for policy 0, policy_version 1504091 (0.0007) [2023-12-28 06:04:18,511][106225] Updated weights for policy 1, policy_version 1507779 (0.0007) [2023-12-28 06:04:18,516][106226] Updated weights for policy 0, policy_version 1504101 (0.0010) [2023-12-28 06:04:18,567][106225] Updated weights for policy 1, policy_version 1507789 (0.0007) [2023-12-28 06:04:18,577][106226] Updated weights for policy 0, policy_version 1504111 (0.0007) [2023-12-28 06:04:18,618][106225] Updated weights for policy 1, policy_version 1507799 (0.0007) [2023-12-28 06:04:19,196][106226] Updated weights for policy 0, policy_version 1504121 (0.0007) [2023-12-28 06:04:19,261][106226] Updated weights for policy 0, policy_version 1504131 (0.0008) [2023-12-28 06:04:19,319][106226] Updated weights for policy 0, policy_version 1504141 (0.0009) [2023-12-28 06:04:19,357][106225] Updated weights for policy 1, policy_version 1507809 (0.0010) [2023-12-28 06:04:19,386][106226] Updated weights for policy 0, policy_version 1504151 (0.0007) [2023-12-28 06:04:19,419][106225] Updated weights for policy 1, policy_version 1507819 (0.0010) [2023-12-28 06:04:19,468][106225] Updated weights for policy 1, policy_version 1507829 (0.0010) [2023-12-28 06:04:20,181][106226] Updated weights for policy 0, policy_version 1504161 (0.0007) [2023-12-28 06:04:20,205][106225] Updated weights for policy 1, policy_version 1507839 (0.0011) [2023-12-28 06:04:20,239][106226] Updated weights for policy 0, policy_version 1504171 (0.0009) [2023-12-28 06:04:20,262][106225] Updated weights for policy 1, policy_version 1507849 (0.0011) [2023-12-28 06:04:20,295][106226] Updated weights for policy 0, policy_version 1504181 (0.0006) [2023-12-28 06:04:20,324][106225] Updated weights for policy 1, policy_version 1507859 (0.0011) [2023-12-28 06:04:21,108][106226] Updated weights for policy 0, policy_version 1504191 (0.0009) [2023-12-28 06:04:21,115][106225] Updated weights for policy 1, policy_version 1507869 (0.0010) [2023-12-28 06:04:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 771211264. Throughput: 0: 9971.9, 1: 9948.6. Samples: 771227540. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:21,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.430')] [2023-12-28 06:04:21,176][106226] Updated weights for policy 0, policy_version 1504201 (0.0009) [2023-12-28 06:04:21,185][106225] Updated weights for policy 1, policy_version 1507879 (0.0009) [2023-12-28 06:04:21,240][106226] Updated weights for policy 0, policy_version 1504211 (0.0008) [2023-12-28 06:04:21,252][106225] Updated weights for policy 1, policy_version 1507889 (0.0009) [2023-12-28 06:04:21,988][106225] Updated weights for policy 1, policy_version 1507899 (0.0009) [2023-12-28 06:04:21,998][106226] Updated weights for policy 0, policy_version 1504221 (0.0009) [2023-12-28 06:04:22,040][106225] Updated weights for policy 1, policy_version 1507909 (0.0010) [2023-12-28 06:04:22,055][106226] Updated weights for policy 0, policy_version 1504231 (0.0009) [2023-12-28 06:04:22,090][106225] Updated weights for policy 1, policy_version 1507919 (0.0010) [2023-12-28 06:04:22,117][106226] Updated weights for policy 0, policy_version 1504241 (0.0010) [2023-12-28 06:04:22,804][106225] Updated weights for policy 1, policy_version 1507929 (0.0010) [2023-12-28 06:04:22,863][106225] Updated weights for policy 1, policy_version 1507939 (0.0010) [2023-12-28 06:04:22,873][106226] Updated weights for policy 0, policy_version 1504251 (0.0011) [2023-12-28 06:04:22,913][106225] Updated weights for policy 1, policy_version 1507949 (0.0010) [2023-12-28 06:04:22,934][106226] Updated weights for policy 0, policy_version 1504261 (0.0011) [2023-12-28 06:04:22,971][106225] Updated weights for policy 1, policy_version 1507959 (0.0010) [2023-12-28 06:04:22,992][106226] Updated weights for policy 0, policy_version 1504271 (0.0011) [2023-12-28 06:04:23,673][106225] Updated weights for policy 1, policy_version 1507969 (0.0010) [2023-12-28 06:04:23,698][106226] Updated weights for policy 0, policy_version 1504281 (0.0011) [2023-12-28 06:04:23,728][106225] Updated weights for policy 1, policy_version 1507979 (0.0010) [2023-12-28 06:04:23,755][106226] Updated weights for policy 0, policy_version 1504291 (0.0011) [2023-12-28 06:04:23,787][106225] Updated weights for policy 1, policy_version 1507989 (0.0010) [2023-12-28 06:04:23,816][106226] Updated weights for policy 0, policy_version 1504301 (0.0011) [2023-12-28 06:04:23,880][106226] Updated weights for policy 0, policy_version 1504311 (0.0011) [2023-12-28 06:04:24,474][106226] Updated weights for policy 0, policy_version 1504321 (0.0009) [2023-12-28 06:04:24,493][106225] Updated weights for policy 1, policy_version 1507999 (0.0011) [2023-12-28 06:04:24,533][106226] Updated weights for policy 0, policy_version 1504331 (0.0011) [2023-12-28 06:04:24,542][106225] Updated weights for policy 1, policy_version 1508009 (0.0010) [2023-12-28 06:04:24,589][106226] Updated weights for policy 0, policy_version 1504341 (0.0009) [2023-12-28 06:04:24,601][106225] Updated weights for policy 1, policy_version 1508019 (0.0009) [2023-12-28 06:04:25,244][106226] Updated weights for policy 0, policy_version 1504351 (0.0009) [2023-12-28 06:04:25,295][106226] Updated weights for policy 0, policy_version 1504361 (0.0010) [2023-12-28 06:04:25,304][106225] Updated weights for policy 1, policy_version 1508029 (0.0007) [2023-12-28 06:04:25,341][106226] Updated weights for policy 0, policy_version 1504371 (0.0010) [2023-12-28 06:04:25,350][106225] Updated weights for policy 1, policy_version 1508039 (0.0005) [2023-12-28 06:04:25,393][106225] Updated weights for policy 1, policy_version 1508049 (0.0005) [2023-12-28 06:04:26,023][106225] Updated weights for policy 1, policy_version 1508059 (0.0006) [2023-12-28 06:04:26,027][106226] Updated weights for policy 0, policy_version 1504381 (0.0008) [2023-12-28 06:04:26,078][106226] Updated weights for policy 0, policy_version 1504391 (0.0006) [2023-12-28 06:04:26,080][106225] Updated weights for policy 1, policy_version 1508069 (0.0008) [2023-12-28 06:04:26,130][106225] Updated weights for policy 1, policy_version 1508079 (0.0005) [2023-12-28 06:04:26,135][106226] Updated weights for policy 0, policy_version 1504401 (0.0011) [2023-12-28 06:04:26,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20206.9, 300 sec: 19799.6). Total num frames: 771325952. Throughput: 0: 9943.9, 1: 9883.1. Samples: 771284512. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:26,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.547')] [2023-12-28 06:04:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001508088_386121728.pth... [2023-12-28 06:04:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001504408_385204224.pth... [2023-12-28 06:04:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001506936_385826816.pth [2023-12-28 06:04:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001503224_384901120.pth [2023-12-28 06:04:26,760][106225] Updated weights for policy 1, policy_version 1508089 (0.0006) [2023-12-28 06:04:26,765][106226] Updated weights for policy 0, policy_version 1504411 (0.0009) [2023-12-28 06:04:26,813][106225] Updated weights for policy 1, policy_version 1508099 (0.0005) [2023-12-28 06:04:26,819][106226] Updated weights for policy 0, policy_version 1504421 (0.0005) [2023-12-28 06:04:26,867][106225] Updated weights for policy 1, policy_version 1508109 (0.0008) [2023-12-28 06:04:26,874][106226] Updated weights for policy 0, policy_version 1504431 (0.0006) [2023-12-28 06:04:26,918][106225] Updated weights for policy 1, policy_version 1508119 (0.0006) [2023-12-28 06:04:27,533][106226] Updated weights for policy 0, policy_version 1504441 (0.0007) [2023-12-28 06:04:27,582][106226] Updated weights for policy 0, policy_version 1504451 (0.0010) [2023-12-28 06:04:27,629][106226] Updated weights for policy 0, policy_version 1504461 (0.0009) [2023-12-28 06:04:27,633][106225] Updated weights for policy 1, policy_version 1508129 (0.0007) [2023-12-28 06:04:27,674][106226] Updated weights for policy 0, policy_version 1504471 (0.0005) [2023-12-28 06:04:27,678][106225] Updated weights for policy 1, policy_version 1508139 (0.0006) [2023-12-28 06:04:27,741][106225] Updated weights for policy 1, policy_version 1508149 (0.0005) [2023-12-28 06:04:28,313][106226] Updated weights for policy 0, policy_version 1504481 (0.0010) [2023-12-28 06:04:28,376][106226] Updated weights for policy 0, policy_version 1504491 (0.0011) [2023-12-28 06:04:28,409][106225] Updated weights for policy 1, policy_version 1508159 (0.0005) [2023-12-28 06:04:28,433][106226] Updated weights for policy 0, policy_version 1504501 (0.0010) [2023-12-28 06:04:28,460][106225] Updated weights for policy 1, policy_version 1508169 (0.0007) [2023-12-28 06:04:28,519][106225] Updated weights for policy 1, policy_version 1508179 (0.0007) [2023-12-28 06:04:29,167][106226] Updated weights for policy 0, policy_version 1504511 (0.0009) [2023-12-28 06:04:29,231][106225] Updated weights for policy 1, policy_version 1508189 (0.0007) [2023-12-28 06:04:29,241][106226] Updated weights for policy 0, policy_version 1504521 (0.0008) [2023-12-28 06:04:29,290][106225] Updated weights for policy 1, policy_version 1508199 (0.0010) [2023-12-28 06:04:29,297][106226] Updated weights for policy 0, policy_version 1504531 (0.0010) [2023-12-28 06:04:29,356][106225] Updated weights for policy 1, policy_version 1508209 (0.0012) [2023-12-28 06:04:30,012][106226] Updated weights for policy 0, policy_version 1504541 (0.0010) [2023-12-28 06:04:30,032][106225] Updated weights for policy 1, policy_version 1508219 (0.0008) [2023-12-28 06:04:30,077][106226] Updated weights for policy 0, policy_version 1504551 (0.0011) [2023-12-28 06:04:30,088][106225] Updated weights for policy 1, policy_version 1508229 (0.0006) [2023-12-28 06:04:30,131][106226] Updated weights for policy 0, policy_version 1504561 (0.0010) [2023-12-28 06:04:30,142][106225] Updated weights for policy 1, policy_version 1508239 (0.0006) [2023-12-28 06:04:30,786][106226] Updated weights for policy 0, policy_version 1504571 (0.0009) [2023-12-28 06:04:30,830][106225] Updated weights for policy 1, policy_version 1508249 (0.0008) [2023-12-28 06:04:30,838][106226] Updated weights for policy 0, policy_version 1504581 (0.0007) [2023-12-28 06:04:30,885][106225] Updated weights for policy 1, policy_version 1508259 (0.0005) [2023-12-28 06:04:30,892][106226] Updated weights for policy 0, policy_version 1504591 (0.0009) [2023-12-28 06:04:30,939][106225] Updated weights for policy 1, policy_version 1508269 (0.0005) [2023-12-28 06:04:30,990][106225] Updated weights for policy 1, policy_version 1508279 (0.0005) [2023-12-28 06:04:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 771424256. Throughput: 0: 10089.4, 1: 9964.9. Samples: 771408424. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:31,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.603')] [2023-12-28 06:04:31,568][106226] Updated weights for policy 0, policy_version 1504601 (0.0008) [2023-12-28 06:04:31,640][106226] Updated weights for policy 0, policy_version 1504611 (0.0008) [2023-12-28 06:04:31,692][106226] Updated weights for policy 0, policy_version 1504621 (0.0007) [2023-12-28 06:04:31,705][106225] Updated weights for policy 1, policy_version 1508289 (0.0010) [2023-12-28 06:04:31,753][106226] Updated weights for policy 0, policy_version 1504631 (0.0007) [2023-12-28 06:04:31,768][106225] Updated weights for policy 1, policy_version 1508299 (0.0010) [2023-12-28 06:04:31,828][106225] Updated weights for policy 1, policy_version 1508309 (0.0010) [2023-12-28 06:04:32,458][106225] Updated weights for policy 1, policy_version 1508319 (0.0011) [2023-12-28 06:04:32,515][106225] Updated weights for policy 1, policy_version 1508329 (0.0011) [2023-12-28 06:04:32,522][106226] Updated weights for policy 0, policy_version 1504641 (0.0009) [2023-12-28 06:04:32,578][106225] Updated weights for policy 1, policy_version 1508339 (0.0009) [2023-12-28 06:04:32,584][106226] Updated weights for policy 0, policy_version 1504651 (0.0006) [2023-12-28 06:04:32,650][106226] Updated weights for policy 0, policy_version 1504661 (0.0006) [2023-12-28 06:04:33,281][106226] Updated weights for policy 0, policy_version 1504671 (0.0006) [2023-12-28 06:04:33,283][106225] Updated weights for policy 1, policy_version 1508349 (0.0008) [2023-12-28 06:04:33,335][106226] Updated weights for policy 0, policy_version 1504681 (0.0005) [2023-12-28 06:04:33,342][106225] Updated weights for policy 1, policy_version 1508359 (0.0005) [2023-12-28 06:04:33,384][106226] Updated weights for policy 0, policy_version 1504691 (0.0005) [2023-12-28 06:04:33,402][106225] Updated weights for policy 1, policy_version 1508369 (0.0005) [2023-12-28 06:04:33,907][106225] Updated weights for policy 1, policy_version 1508379 (0.0005) [2023-12-28 06:04:33,963][106225] Updated weights for policy 1, policy_version 1508389 (0.0005) [2023-12-28 06:04:34,018][106225] Updated weights for policy 1, policy_version 1508399 (0.0005) [2023-12-28 06:04:34,080][106226] Updated weights for policy 0, policy_version 1504701 (0.0006) [2023-12-28 06:04:34,132][106226] Updated weights for policy 0, policy_version 1504711 (0.0006) [2023-12-28 06:04:34,200][106226] Updated weights for policy 0, policy_version 1504721 (0.0007) [2023-12-28 06:04:34,654][106225] Updated weights for policy 1, policy_version 1508409 (0.0007) [2023-12-28 06:04:34,724][106225] Updated weights for policy 1, policy_version 1508419 (0.0009) [2023-12-28 06:04:34,790][106225] Updated weights for policy 1, policy_version 1508429 (0.0010) [2023-12-28 06:04:34,848][106225] Updated weights for policy 1, policy_version 1508439 (0.0010) [2023-12-28 06:04:34,850][106226] Updated weights for policy 0, policy_version 1504731 (0.0006) [2023-12-28 06:04:34,910][106226] Updated weights for policy 0, policy_version 1504741 (0.0009) [2023-12-28 06:04:34,972][106226] Updated weights for policy 0, policy_version 1504751 (0.0006) [2023-12-28 06:04:35,414][106225] Updated weights for policy 1, policy_version 1508449 (0.0008) [2023-12-28 06:04:35,475][106225] Updated weights for policy 1, policy_version 1508459 (0.0009) [2023-12-28 06:04:35,532][106225] Updated weights for policy 1, policy_version 1508469 (0.0008) [2023-12-28 06:04:35,535][106226] Updated weights for policy 0, policy_version 1504761 (0.0006) [2023-12-28 06:04:35,592][106226] Updated weights for policy 0, policy_version 1504771 (0.0007) [2023-12-28 06:04:35,655][106226] Updated weights for policy 0, policy_version 1504781 (0.0009) [2023-12-28 06:04:35,711][106226] Updated weights for policy 0, policy_version 1504791 (0.0009) [2023-12-28 06:04:36,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 771522560. Throughput: 0: 10153.3, 1: 10051.8. Samples: 771533064. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:36,175][105115] Avg episode reward: [(0, '-4.806'), (1, '-4.970')] [2023-12-28 06:04:36,280][106225] Updated weights for policy 1, policy_version 1508479 (0.0008) [2023-12-28 06:04:36,345][106225] Updated weights for policy 1, policy_version 1508489 (0.0007) [2023-12-28 06:04:36,409][106225] Updated weights for policy 1, policy_version 1508499 (0.0007) [2023-12-28 06:04:36,436][106226] Updated weights for policy 0, policy_version 1504801 (0.0007) [2023-12-28 06:04:36,500][106226] Updated weights for policy 0, policy_version 1504811 (0.0009) [2023-12-28 06:04:36,567][106226] Updated weights for policy 0, policy_version 1504821 (0.0007) [2023-12-28 06:04:37,064][106225] Updated weights for policy 1, policy_version 1508509 (0.0006) [2023-12-28 06:04:37,113][106225] Updated weights for policy 1, policy_version 1508519 (0.0007) [2023-12-28 06:04:37,170][106225] Updated weights for policy 1, policy_version 1508529 (0.0008) [2023-12-28 06:04:37,247][106226] Updated weights for policy 0, policy_version 1504831 (0.0009) [2023-12-28 06:04:37,294][106226] Updated weights for policy 0, policy_version 1504841 (0.0005) [2023-12-28 06:04:37,350][106226] Updated weights for policy 0, policy_version 1504851 (0.0005) [2023-12-28 06:04:37,799][106225] Updated weights for policy 1, policy_version 1508539 (0.0008) [2023-12-28 06:04:37,865][106225] Updated weights for policy 1, policy_version 1508549 (0.0010) [2023-12-28 06:04:37,927][106225] Updated weights for policy 1, policy_version 1508559 (0.0010) [2023-12-28 06:04:38,047][106226] Updated weights for policy 0, policy_version 1504861 (0.0007) [2023-12-28 06:04:38,116][106226] Updated weights for policy 0, policy_version 1504871 (0.0007) [2023-12-28 06:04:38,170][106226] Updated weights for policy 0, policy_version 1504881 (0.0010) [2023-12-28 06:04:38,644][106225] Updated weights for policy 1, policy_version 1508569 (0.0010) [2023-12-28 06:04:38,701][106225] Updated weights for policy 1, policy_version 1508579 (0.0009) [2023-12-28 06:04:38,760][106225] Updated weights for policy 1, policy_version 1508589 (0.0009) [2023-12-28 06:04:38,821][106225] Updated weights for policy 1, policy_version 1508599 (0.0009) [2023-12-28 06:04:38,858][106226] Updated weights for policy 0, policy_version 1504891 (0.0008) [2023-12-28 06:04:38,913][106226] Updated weights for policy 0, policy_version 1504901 (0.0011) [2023-12-28 06:04:38,963][106226] Updated weights for policy 0, policy_version 1504911 (0.0011) [2023-12-28 06:04:39,623][106225] Updated weights for policy 1, policy_version 1508609 (0.0007) [2023-12-28 06:04:39,689][106225] Updated weights for policy 1, policy_version 1508619 (0.0007) [2023-12-28 06:04:39,748][106225] Updated weights for policy 1, policy_version 1508629 (0.0008) [2023-12-28 06:04:39,824][106226] Updated weights for policy 0, policy_version 1504921 (0.0010) [2023-12-28 06:04:39,885][106226] Updated weights for policy 0, policy_version 1504931 (0.0008) [2023-12-28 06:04:39,954][106226] Updated weights for policy 0, policy_version 1504941 (0.0008) [2023-12-28 06:04:40,020][106226] Updated weights for policy 0, policy_version 1504951 (0.0008) [2023-12-28 06:04:40,502][106225] Updated weights for policy 1, policy_version 1508639 (0.0008) [2023-12-28 06:04:40,561][106225] Updated weights for policy 1, policy_version 1508649 (0.0009) [2023-12-28 06:04:40,619][106225] Updated weights for policy 1, policy_version 1508659 (0.0008) [2023-12-28 06:04:40,668][106226] Updated weights for policy 0, policy_version 1504961 (0.0008) [2023-12-28 06:04:40,713][106226] Updated weights for policy 0, policy_version 1504971 (0.0008) [2023-12-28 06:04:40,764][106226] Updated weights for policy 0, policy_version 1504981 (0.0006) [2023-12-28 06:04:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 771620864. Throughput: 0: 10158.4, 1: 10062.4. Samples: 771593136. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:41,176][105115] Avg episode reward: [(0, '-4.960'), (1, '-4.904')] [2023-12-28 06:04:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001508664_386269184.pth... [2023-12-28 06:04:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001504984_385351680.pth... [2023-12-28 06:04:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001507512_385974272.pth [2023-12-28 06:04:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001503800_385048576.pth [2023-12-28 06:04:41,420][106225] Updated weights for policy 1, policy_version 1508669 (0.0008) [2023-12-28 06:04:41,468][106225] Updated weights for policy 1, policy_version 1508679 (0.0008) [2023-12-28 06:04:41,531][106225] Updated weights for policy 1, policy_version 1508689 (0.0008) [2023-12-28 06:04:41,545][106226] Updated weights for policy 0, policy_version 1504991 (0.0006) [2023-12-28 06:04:41,611][106226] Updated weights for policy 0, policy_version 1505001 (0.0007) [2023-12-28 06:04:41,677][106226] Updated weights for policy 0, policy_version 1505011 (0.0010) [2023-12-28 06:04:42,338][106225] Updated weights for policy 1, policy_version 1508699 (0.0008) [2023-12-28 06:04:42,407][106225] Updated weights for policy 1, policy_version 1508709 (0.0008) [2023-12-28 06:04:42,432][106226] Updated weights for policy 0, policy_version 1505021 (0.0007) [2023-12-28 06:04:42,462][106225] Updated weights for policy 1, policy_version 1508719 (0.0008) [2023-12-28 06:04:42,494][106226] Updated weights for policy 0, policy_version 1505031 (0.0008) [2023-12-28 06:04:42,555][106226] Updated weights for policy 0, policy_version 1505041 (0.0008) [2023-12-28 06:04:43,141][106225] Updated weights for policy 1, policy_version 1508729 (0.0006) [2023-12-28 06:04:43,207][106225] Updated weights for policy 1, policy_version 1508739 (0.0009) [2023-12-28 06:04:43,238][106226] Updated weights for policy 0, policy_version 1505051 (0.0007) [2023-12-28 06:04:43,263][106225] Updated weights for policy 1, policy_version 1508749 (0.0010) [2023-12-28 06:04:43,287][106226] Updated weights for policy 0, policy_version 1505061 (0.0006) [2023-12-28 06:04:43,316][106225] Updated weights for policy 1, policy_version 1508759 (0.0010) [2023-12-28 06:04:43,332][106226] Updated weights for policy 0, policy_version 1505071 (0.0008) [2023-12-28 06:04:43,966][106225] Updated weights for policy 1, policy_version 1508769 (0.0008) [2023-12-28 06:04:44,026][106225] Updated weights for policy 1, policy_version 1508779 (0.0008) [2023-12-28 06:04:44,059][106226] Updated weights for policy 0, policy_version 1505081 (0.0008) [2023-12-28 06:04:44,081][106225] Updated weights for policy 1, policy_version 1508789 (0.0008) [2023-12-28 06:04:44,117][106226] Updated weights for policy 0, policy_version 1505091 (0.0008) [2023-12-28 06:04:44,173][106226] Updated weights for policy 0, policy_version 1505101 (0.0007) [2023-12-28 06:04:44,223][106226] Updated weights for policy 0, policy_version 1505111 (0.0006) [2023-12-28 06:04:44,781][106225] Updated weights for policy 1, policy_version 1508799 (0.0008) [2023-12-28 06:04:44,852][106225] Updated weights for policy 1, policy_version 1508809 (0.0008) [2023-12-28 06:04:44,879][106226] Updated weights for policy 0, policy_version 1505121 (0.0007) [2023-12-28 06:04:44,918][106225] Updated weights for policy 1, policy_version 1508819 (0.0008) [2023-12-28 06:04:44,940][106226] Updated weights for policy 0, policy_version 1505131 (0.0006) [2023-12-28 06:04:45,005][106226] Updated weights for policy 0, policy_version 1505141 (0.0006) [2023-12-28 06:04:45,606][106226] Updated weights for policy 0, policy_version 1505151 (0.0007) [2023-12-28 06:04:45,647][106225] Updated weights for policy 1, policy_version 1508829 (0.0009) [2023-12-28 06:04:45,665][106226] Updated weights for policy 0, policy_version 1505161 (0.0006) [2023-12-28 06:04:45,702][106225] Updated weights for policy 1, policy_version 1508839 (0.0011) [2023-12-28 06:04:45,713][106226] Updated weights for policy 0, policy_version 1505171 (0.0006) [2023-12-28 06:04:45,754][106225] Updated weights for policy 1, policy_version 1508849 (0.0008) [2023-12-28 06:04:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 771719168. Throughput: 0: 10018.8, 1: 9882.4. Samples: 771707808. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:46,176][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.507')] [2023-12-28 06:04:46,463][106226] Updated weights for policy 0, policy_version 1505181 (0.0008) [2023-12-28 06:04:46,479][106225] Updated weights for policy 1, policy_version 1508859 (0.0008) [2023-12-28 06:04:46,523][106226] Updated weights for policy 0, policy_version 1505191 (0.0008) [2023-12-28 06:04:46,536][106225] Updated weights for policy 1, policy_version 1508869 (0.0010) [2023-12-28 06:04:46,582][106226] Updated weights for policy 0, policy_version 1505201 (0.0006) [2023-12-28 06:04:46,590][106225] Updated weights for policy 1, policy_version 1508879 (0.0010) [2023-12-28 06:04:47,311][106225] Updated weights for policy 1, policy_version 1508889 (0.0010) [2023-12-28 06:04:47,316][106226] Updated weights for policy 0, policy_version 1505211 (0.0007) [2023-12-28 06:04:47,361][106225] Updated weights for policy 1, policy_version 1508899 (0.0007) [2023-12-28 06:04:47,367][106226] Updated weights for policy 0, policy_version 1505221 (0.0006) [2023-12-28 06:04:47,412][106225] Updated weights for policy 1, policy_version 1508909 (0.0007) [2023-12-28 06:04:47,425][106226] Updated weights for policy 0, policy_version 1505231 (0.0006) [2023-12-28 06:04:47,469][106225] Updated weights for policy 1, policy_version 1508919 (0.0006) [2023-12-28 06:04:48,056][106226] Updated weights for policy 0, policy_version 1505241 (0.0008) [2023-12-28 06:04:48,093][106225] Updated weights for policy 1, policy_version 1508929 (0.0005) [2023-12-28 06:04:48,115][106226] Updated weights for policy 0, policy_version 1505251 (0.0007) [2023-12-28 06:04:48,151][106225] Updated weights for policy 1, policy_version 1508939 (0.0006) [2023-12-28 06:04:48,173][106226] Updated weights for policy 0, policy_version 1505261 (0.0011) [2023-12-28 06:04:48,202][106225] Updated weights for policy 1, policy_version 1508949 (0.0005) [2023-12-28 06:04:48,238][106226] Updated weights for policy 0, policy_version 1505271 (0.0006) [2023-12-28 06:04:48,848][106225] Updated weights for policy 1, policy_version 1508959 (0.0009) [2023-12-28 06:04:48,855][106226] Updated weights for policy 0, policy_version 1505281 (0.0010) [2023-12-28 06:04:48,899][106225] Updated weights for policy 1, policy_version 1508969 (0.0010) [2023-12-28 06:04:48,903][106226] Updated weights for policy 0, policy_version 1505291 (0.0010) [2023-12-28 06:04:48,950][106226] Updated weights for policy 0, policy_version 1505301 (0.0010) [2023-12-28 06:04:48,954][106225] Updated weights for policy 1, policy_version 1508979 (0.0010) [2023-12-28 06:04:49,696][106225] Updated weights for policy 1, policy_version 1508989 (0.0008) [2023-12-28 06:04:49,746][106226] Updated weights for policy 0, policy_version 1505311 (0.0009) [2023-12-28 06:04:49,759][106225] Updated weights for policy 1, policy_version 1508999 (0.0005) [2023-12-28 06:04:49,807][106226] Updated weights for policy 0, policy_version 1505321 (0.0008) [2023-12-28 06:04:49,815][106225] Updated weights for policy 1, policy_version 1509009 (0.0006) [2023-12-28 06:04:49,871][106226] Updated weights for policy 0, policy_version 1505331 (0.0009) [2023-12-28 06:04:50,426][106225] Updated weights for policy 1, policy_version 1509019 (0.0008) [2023-12-28 06:04:50,479][106225] Updated weights for policy 1, policy_version 1509029 (0.0008) [2023-12-28 06:04:50,533][106225] Updated weights for policy 1, policy_version 1509039 (0.0006) [2023-12-28 06:04:50,651][106226] Updated weights for policy 0, policy_version 1505341 (0.0009) [2023-12-28 06:04:50,711][106226] Updated weights for policy 0, policy_version 1505351 (0.0008) [2023-12-28 06:04:50,772][106226] Updated weights for policy 0, policy_version 1505361 (0.0007) [2023-12-28 06:04:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 771817472. Throughput: 0: 9988.0, 1: 9859.0. Samples: 771827252. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:51,175][105115] Avg episode reward: [(0, '-4.901'), (1, '-4.574')] [2023-12-28 06:04:51,253][106225] Updated weights for policy 1, policy_version 1509049 (0.0006) [2023-12-28 06:04:51,312][106225] Updated weights for policy 1, policy_version 1509059 (0.0006) [2023-12-28 06:04:51,374][106225] Updated weights for policy 1, policy_version 1509069 (0.0010) [2023-12-28 06:04:51,446][106225] Updated weights for policy 1, policy_version 1509079 (0.0008) [2023-12-28 06:04:51,465][106226] Updated weights for policy 0, policy_version 1505371 (0.0007) [2023-12-28 06:04:51,533][106226] Updated weights for policy 0, policy_version 1505381 (0.0009) [2023-12-28 06:04:51,603][106226] Updated weights for policy 0, policy_version 1505391 (0.0009) [2023-12-28 06:04:52,152][106225] Updated weights for policy 1, policy_version 1509089 (0.0008) [2023-12-28 06:04:52,205][106225] Updated weights for policy 1, policy_version 1509099 (0.0007) [2023-12-28 06:04:52,268][106225] Updated weights for policy 1, policy_version 1509109 (0.0006) [2023-12-28 06:04:52,281][106226] Updated weights for policy 0, policy_version 1505401 (0.0009) [2023-12-28 06:04:52,345][106226] Updated weights for policy 0, policy_version 1505411 (0.0006) [2023-12-28 06:04:52,418][106226] Updated weights for policy 0, policy_version 1505421 (0.0007) [2023-12-28 06:04:52,487][106226] Updated weights for policy 0, policy_version 1505431 (0.0006) [2023-12-28 06:04:52,951][106225] Updated weights for policy 1, policy_version 1509119 (0.0006) [2023-12-28 06:04:53,010][106225] Updated weights for policy 1, policy_version 1509129 (0.0009) [2023-12-28 06:04:53,068][106225] Updated weights for policy 1, policy_version 1509139 (0.0007) [2023-12-28 06:04:53,148][106226] Updated weights for policy 0, policy_version 1505441 (0.0006) [2023-12-28 06:04:53,208][106226] Updated weights for policy 0, policy_version 1505451 (0.0008) [2023-12-28 06:04:53,267][106226] Updated weights for policy 0, policy_version 1505461 (0.0009) [2023-12-28 06:04:53,757][106225] Updated weights for policy 1, policy_version 1509149 (0.0009) [2023-12-28 06:04:53,815][106225] Updated weights for policy 1, policy_version 1509159 (0.0009) [2023-12-28 06:04:53,870][106225] Updated weights for policy 1, policy_version 1509169 (0.0008) [2023-12-28 06:04:53,988][106226] Updated weights for policy 0, policy_version 1505471 (0.0008) [2023-12-28 06:04:54,048][106226] Updated weights for policy 0, policy_version 1505481 (0.0009) [2023-12-28 06:04:54,111][106226] Updated weights for policy 0, policy_version 1505491 (0.0009) [2023-12-28 06:04:54,541][106225] Updated weights for policy 1, policy_version 1509179 (0.0008) [2023-12-28 06:04:54,593][106225] Updated weights for policy 1, policy_version 1509189 (0.0008) [2023-12-28 06:04:54,646][106225] Updated weights for policy 1, policy_version 1509199 (0.0008) [2023-12-28 06:04:54,858][106226] Updated weights for policy 0, policy_version 1505501 (0.0008) [2023-12-28 06:04:54,914][106226] Updated weights for policy 0, policy_version 1505511 (0.0008) [2023-12-28 06:04:54,959][106226] Updated weights for policy 0, policy_version 1505521 (0.0008) [2023-12-28 06:04:55,389][106225] Updated weights for policy 1, policy_version 1509209 (0.0008) [2023-12-28 06:04:55,447][106225] Updated weights for policy 1, policy_version 1509219 (0.0008) [2023-12-28 06:04:55,506][106225] Updated weights for policy 1, policy_version 1509229 (0.0008) [2023-12-28 06:04:55,563][106225] Updated weights for policy 1, policy_version 1509239 (0.0009) [2023-12-28 06:04:55,696][106226] Updated weights for policy 0, policy_version 1505531 (0.0009) [2023-12-28 06:04:55,743][106226] Updated weights for policy 0, policy_version 1505541 (0.0008) [2023-12-28 06:04:55,794][106226] Updated weights for policy 0, policy_version 1505551 (0.0008) [2023-12-28 06:04:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 771915776. Throughput: 0: 10006.8, 1: 9863.4. Samples: 771886676. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:04:56,176][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.545')] [2023-12-28 06:04:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001505560_385499136.pth... [2023-12-28 06:04:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001504408_385204224.pth [2023-12-28 06:04:56,229][106225] Updated weights for policy 1, policy_version 1509249 (0.0008) [2023-12-28 06:04:56,274][106225] Updated weights for policy 1, policy_version 1509259 (0.0009) [2023-12-28 06:04:56,318][106225] Updated weights for policy 1, policy_version 1509269 (0.0008) [2023-12-28 06:04:56,329][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001509272_386424832.pth... [2023-12-28 06:04:56,333][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001508088_386121728.pth [2023-12-28 06:04:56,555][106226] Updated weights for policy 0, policy_version 1505561 (0.0009) [2023-12-28 06:04:56,608][106226] Updated weights for policy 0, policy_version 1505571 (0.0009) [2023-12-28 06:04:56,656][106226] Updated weights for policy 0, policy_version 1505581 (0.0008) [2023-12-28 06:04:56,706][106226] Updated weights for policy 0, policy_version 1505591 (0.0008) [2023-12-28 06:04:57,060][106225] Updated weights for policy 1, policy_version 1509279 (0.0008) [2023-12-28 06:04:57,109][106225] Updated weights for policy 1, policy_version 1509289 (0.0007) [2023-12-28 06:04:57,155][106225] Updated weights for policy 1, policy_version 1509299 (0.0008) [2023-12-28 06:04:57,439][106226] Updated weights for policy 0, policy_version 1505601 (0.0010) [2023-12-28 06:04:57,492][106226] Updated weights for policy 0, policy_version 1505611 (0.0010) [2023-12-28 06:04:57,548][106226] Updated weights for policy 0, policy_version 1505621 (0.0010) [2023-12-28 06:04:57,844][106225] Updated weights for policy 1, policy_version 1509309 (0.0008) [2023-12-28 06:04:57,894][106225] Updated weights for policy 1, policy_version 1509319 (0.0008) [2023-12-28 06:04:57,950][106225] Updated weights for policy 1, policy_version 1509329 (0.0007) [2023-12-28 06:04:58,255][106226] Updated weights for policy 0, policy_version 1505632 (0.0008) [2023-12-28 06:04:58,335][106226] Updated weights for policy 0, policy_version 1505644 (0.0007) [2023-12-28 06:04:58,430][106226] Updated weights for policy 0, policy_version 1505656 (0.0019) [2023-12-28 06:04:58,787][106225] Updated weights for policy 1, policy_version 1509339 (0.0008) [2023-12-28 06:04:58,852][106225] Updated weights for policy 1, policy_version 1509349 (0.0009) [2023-12-28 06:04:58,909][106225] Updated weights for policy 1, policy_version 1509359 (0.0009) [2023-12-28 06:04:59,345][106226] Updated weights for policy 0, policy_version 1505666 (0.0006) [2023-12-28 06:04:59,418][106226] Updated weights for policy 0, policy_version 1505676 (0.0008) [2023-12-28 06:04:59,483][106226] Updated weights for policy 0, policy_version 1505686 (0.0005) [2023-12-28 06:04:59,741][106225] Updated weights for policy 1, policy_version 1509369 (0.0009) [2023-12-28 06:04:59,793][106225] Updated weights for policy 1, policy_version 1509379 (0.0008) [2023-12-28 06:04:59,859][106225] Updated weights for policy 1, policy_version 1509389 (0.0008) [2023-12-28 06:04:59,916][106225] Updated weights for policy 1, policy_version 1509399 (0.0009) [2023-12-28 06:05:00,145][106226] Updated weights for policy 0, policy_version 1505696 (0.0008) [2023-12-28 06:05:00,210][106226] Updated weights for policy 0, policy_version 1505706 (0.0007) [2023-12-28 06:05:00,268][106226] Updated weights for policy 0, policy_version 1505716 (0.0005) [2023-12-28 06:05:00,671][106225] Updated weights for policy 1, policy_version 1509409 (0.0008) [2023-12-28 06:05:00,730][106225] Updated weights for policy 1, policy_version 1509419 (0.0010) [2023-12-28 06:05:00,783][106225] Updated weights for policy 1, policy_version 1509429 (0.0010) [2023-12-28 06:05:00,853][106226] Updated weights for policy 0, policy_version 1505726 (0.0007) [2023-12-28 06:05:00,899][106226] Updated weights for policy 0, policy_version 1505736 (0.0008) [2023-12-28 06:05:00,947][106226] Updated weights for policy 0, policy_version 1505746 (0.0007) [2023-12-28 06:05:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 772014080. Throughput: 0: 9915.5, 1: 9901.9. Samples: 771999952. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:01,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-4.865')] [2023-12-28 06:05:01,489][106225] Updated weights for policy 1, policy_version 1509439 (0.0010) [2023-12-28 06:05:01,533][106225] Updated weights for policy 1, policy_version 1509449 (0.0010) [2023-12-28 06:05:01,590][106225] Updated weights for policy 1, policy_version 1509459 (0.0005) [2023-12-28 06:05:01,744][106226] Updated weights for policy 0, policy_version 1505756 (0.0008) [2023-12-28 06:05:01,801][106226] Updated weights for policy 0, policy_version 1505766 (0.0007) [2023-12-28 06:05:01,855][106226] Updated weights for policy 0, policy_version 1505776 (0.0008) [2023-12-28 06:05:02,300][106225] Updated weights for policy 1, policy_version 1509469 (0.0009) [2023-12-28 06:05:02,363][106225] Updated weights for policy 1, policy_version 1509479 (0.0010) [2023-12-28 06:05:02,430][106225] Updated weights for policy 1, policy_version 1509489 (0.0005) [2023-12-28 06:05:02,621][106226] Updated weights for policy 0, policy_version 1505786 (0.0008) [2023-12-28 06:05:02,683][106226] Updated weights for policy 0, policy_version 1505796 (0.0007) [2023-12-28 06:05:02,743][106226] Updated weights for policy 0, policy_version 1505806 (0.0008) [2023-12-28 06:05:02,803][106226] Updated weights for policy 0, policy_version 1505816 (0.0008) [2023-12-28 06:05:03,093][106225] Updated weights for policy 1, policy_version 1509499 (0.0007) [2023-12-28 06:05:03,156][106225] Updated weights for policy 1, policy_version 1509509 (0.0006) [2023-12-28 06:05:03,214][106225] Updated weights for policy 1, policy_version 1509519 (0.0005) [2023-12-28 06:05:03,641][106226] Updated weights for policy 0, policy_version 1505826 (0.0009) [2023-12-28 06:05:03,691][106226] Updated weights for policy 0, policy_version 1505836 (0.0009) [2023-12-28 06:05:03,744][106226] Updated weights for policy 0, policy_version 1505846 (0.0008) [2023-12-28 06:05:03,762][106225] Updated weights for policy 1, policy_version 1509529 (0.0005) [2023-12-28 06:05:03,828][106225] Updated weights for policy 1, policy_version 1509539 (0.0006) [2023-12-28 06:05:03,891][106225] Updated weights for policy 1, policy_version 1509549 (0.0006) [2023-12-28 06:05:03,942][106225] Updated weights for policy 1, policy_version 1509559 (0.0006) [2023-12-28 06:05:04,532][106225] Updated weights for policy 1, policy_version 1509569 (0.0009) [2023-12-28 06:05:04,546][106226] Updated weights for policy 0, policy_version 1505856 (0.0006) [2023-12-28 06:05:04,594][106225] Updated weights for policy 1, policy_version 1509579 (0.0010) [2023-12-28 06:05:04,603][106226] Updated weights for policy 0, policy_version 1505866 (0.0008) [2023-12-28 06:05:04,646][106225] Updated weights for policy 1, policy_version 1509589 (0.0006) [2023-12-28 06:05:04,656][106226] Updated weights for policy 0, policy_version 1505876 (0.0007) [2023-12-28 06:05:05,346][106226] Updated weights for policy 0, policy_version 1505886 (0.0008) [2023-12-28 06:05:05,352][106225] Updated weights for policy 1, policy_version 1509599 (0.0006) [2023-12-28 06:05:05,397][106226] Updated weights for policy 0, policy_version 1505896 (0.0006) [2023-12-28 06:05:05,414][106225] Updated weights for policy 1, policy_version 1509609 (0.0006) [2023-12-28 06:05:05,445][106226] Updated weights for policy 0, policy_version 1505906 (0.0006) [2023-12-28 06:05:05,463][106225] Updated weights for policy 1, policy_version 1509619 (0.0006) [2023-12-28 06:05:06,027][106226] Updated weights for policy 0, policy_version 1505916 (0.0008) [2023-12-28 06:05:06,073][106226] Updated weights for policy 0, policy_version 1505926 (0.0009) [2023-12-28 06:05:06,133][106226] Updated weights for policy 0, policy_version 1505936 (0.0008) [2023-12-28 06:05:06,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 772104192. Throughput: 0: 9843.8, 1: 9977.3. Samples: 772119492. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:06,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-4.559')] [2023-12-28 06:05:06,243][106225] Updated weights for policy 1, policy_version 1509629 (0.0008) [2023-12-28 06:05:06,299][106225] Updated weights for policy 1, policy_version 1509639 (0.0008) [2023-12-28 06:05:06,359][106225] Updated weights for policy 1, policy_version 1509649 (0.0008) [2023-12-28 06:05:06,969][106225] Updated weights for policy 1, policy_version 1509659 (0.0008) [2023-12-28 06:05:06,984][106226] Updated weights for policy 0, policy_version 1505946 (0.0008) [2023-12-28 06:05:07,020][106225] Updated weights for policy 1, policy_version 1509669 (0.0010) [2023-12-28 06:05:07,039][106226] Updated weights for policy 0, policy_version 1505956 (0.0006) [2023-12-28 06:05:07,072][106225] Updated weights for policy 1, policy_version 1509679 (0.0010) [2023-12-28 06:05:07,094][106226] Updated weights for policy 0, policy_version 1505966 (0.0006) [2023-12-28 06:05:07,150][106226] Updated weights for policy 0, policy_version 1505976 (0.0008) [2023-12-28 06:05:07,777][106226] Updated weights for policy 0, policy_version 1505986 (0.0007) [2023-12-28 06:05:07,786][106225] Updated weights for policy 1, policy_version 1509689 (0.0010) [2023-12-28 06:05:07,841][106226] Updated weights for policy 0, policy_version 1505996 (0.0010) [2023-12-28 06:05:07,847][106225] Updated weights for policy 1, policy_version 1509699 (0.0011) [2023-12-28 06:05:07,904][106226] Updated weights for policy 0, policy_version 1506006 (0.0006) [2023-12-28 06:05:07,913][106225] Updated weights for policy 1, policy_version 1509709 (0.0011) [2023-12-28 06:05:07,975][106225] Updated weights for policy 1, policy_version 1509719 (0.0011) [2023-12-28 06:05:08,629][106226] Updated weights for policy 0, policy_version 1506016 (0.0007) [2023-12-28 06:05:08,688][106226] Updated weights for policy 0, policy_version 1506026 (0.0006) [2023-12-28 06:05:08,703][106225] Updated weights for policy 1, policy_version 1509729 (0.0011) [2023-12-28 06:05:08,750][106226] Updated weights for policy 0, policy_version 1506036 (0.0008) [2023-12-28 06:05:08,758][106225] Updated weights for policy 1, policy_version 1509739 (0.0010) [2023-12-28 06:05:08,818][106225] Updated weights for policy 1, policy_version 1509749 (0.0010) [2023-12-28 06:05:09,529][106226] Updated weights for policy 0, policy_version 1506046 (0.0009) [2023-12-28 06:05:09,562][106225] Updated weights for policy 1, policy_version 1509759 (0.0007) [2023-12-28 06:05:09,593][106226] Updated weights for policy 0, policy_version 1506056 (0.0008) [2023-12-28 06:05:09,625][106225] Updated weights for policy 1, policy_version 1509769 (0.0006) [2023-12-28 06:05:09,661][106226] Updated weights for policy 0, policy_version 1506066 (0.0008) [2023-12-28 06:05:09,684][106225] Updated weights for policy 1, policy_version 1509779 (0.0007) [2023-12-28 06:05:10,410][106225] Updated weights for policy 1, policy_version 1509789 (0.0006) [2023-12-28 06:05:10,463][106226] Updated weights for policy 0, policy_version 1506076 (0.0008) [2023-12-28 06:05:10,477][106225] Updated weights for policy 1, policy_version 1509799 (0.0007) [2023-12-28 06:05:10,515][106226] Updated weights for policy 0, policy_version 1506086 (0.0006) [2023-12-28 06:05:10,529][106225] Updated weights for policy 1, policy_version 1509809 (0.0006) [2023-12-28 06:05:10,572][106226] Updated weights for policy 0, policy_version 1506096 (0.0007) [2023-12-28 06:05:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 772202496. Throughput: 0: 9853.4, 1: 9992.7. Samples: 772177588. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:11,175][105115] Avg episode reward: [(0, '-4.841'), (1, '-4.861')] [2023-12-28 06:05:11,181][106225] Updated weights for policy 1, policy_version 1509819 (0.0007) [2023-12-28 06:05:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001506104_385638400.pth... [2023-12-28 06:05:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001504984_385351680.pth [2023-12-28 06:05:11,223][106226] Updated weights for policy 0, policy_version 1506106 (0.0007) [2023-12-28 06:05:11,241][106225] Updated weights for policy 1, policy_version 1509829 (0.0008) [2023-12-28 06:05:11,291][106226] Updated weights for policy 0, policy_version 1506116 (0.0006) [2023-12-28 06:05:11,301][106225] Updated weights for policy 1, policy_version 1509839 (0.0009) [2023-12-28 06:05:11,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001509848_386572288.pth... [2023-12-28 06:05:11,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001508664_386269184.pth [2023-12-28 06:05:11,354][106226] Updated weights for policy 0, policy_version 1506126 (0.0007) [2023-12-28 06:05:11,429][106226] Updated weights for policy 0, policy_version 1506136 (0.0008) [2023-12-28 06:05:12,125][106225] Updated weights for policy 1, policy_version 1509849 (0.0008) [2023-12-28 06:05:12,174][106226] Updated weights for policy 0, policy_version 1506146 (0.0009) [2023-12-28 06:05:12,188][106225] Updated weights for policy 1, policy_version 1509859 (0.0011) [2023-12-28 06:05:12,245][106226] Updated weights for policy 0, policy_version 1506156 (0.0007) [2023-12-28 06:05:12,249][106225] Updated weights for policy 1, policy_version 1509869 (0.0010) [2023-12-28 06:05:12,316][106226] Updated weights for policy 0, policy_version 1506166 (0.0009) [2023-12-28 06:05:12,324][106225] Updated weights for policy 1, policy_version 1509879 (0.0010) [2023-12-28 06:05:13,042][106226] Updated weights for policy 0, policy_version 1506176 (0.0007) [2023-12-28 06:05:13,066][106225] Updated weights for policy 1, policy_version 1509889 (0.0010) [2023-12-28 06:05:13,095][106226] Updated weights for policy 0, policy_version 1506186 (0.0005) [2023-12-28 06:05:13,113][106225] Updated weights for policy 1, policy_version 1509899 (0.0009) [2023-12-28 06:05:13,148][106226] Updated weights for policy 0, policy_version 1506196 (0.0006) [2023-12-28 06:05:13,173][106225] Updated weights for policy 1, policy_version 1509909 (0.0007) [2023-12-28 06:05:13,874][106226] Updated weights for policy 0, policy_version 1506206 (0.0008) [2023-12-28 06:05:13,896][106225] Updated weights for policy 1, policy_version 1509919 (0.0006) [2023-12-28 06:05:13,932][106226] Updated weights for policy 0, policy_version 1506216 (0.0008) [2023-12-28 06:05:13,946][106225] Updated weights for policy 1, policy_version 1509929 (0.0006) [2023-12-28 06:05:13,994][106225] Updated weights for policy 1, policy_version 1509939 (0.0008) [2023-12-28 06:05:13,997][106226] Updated weights for policy 0, policy_version 1506226 (0.0009) [2023-12-28 06:05:14,720][106226] Updated weights for policy 0, policy_version 1506236 (0.0008) [2023-12-28 06:05:14,737][106225] Updated weights for policy 1, policy_version 1509949 (0.0008) [2023-12-28 06:05:14,786][106226] Updated weights for policy 0, policy_version 1506246 (0.0007) [2023-12-28 06:05:14,798][106225] Updated weights for policy 1, policy_version 1509959 (0.0008) [2023-12-28 06:05:14,851][106226] Updated weights for policy 0, policy_version 1506256 (0.0007) [2023-12-28 06:05:14,853][106225] Updated weights for policy 1, policy_version 1509969 (0.0007) [2023-12-28 06:05:15,481][106225] Updated weights for policy 1, policy_version 1509979 (0.0006) [2023-12-28 06:05:15,544][106225] Updated weights for policy 1, policy_version 1509989 (0.0009) [2023-12-28 06:05:15,607][106225] Updated weights for policy 1, policy_version 1509999 (0.0008) [2023-12-28 06:05:15,608][106226] Updated weights for policy 0, policy_version 1506266 (0.0008) [2023-12-28 06:05:15,673][106226] Updated weights for policy 0, policy_version 1506276 (0.0010) [2023-12-28 06:05:15,738][106226] Updated weights for policy 0, policy_version 1506286 (0.0008) [2023-12-28 06:05:15,793][106226] Updated weights for policy 0, policy_version 1506296 (0.0009) [2023-12-28 06:05:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 772300800. Throughput: 0: 9712.3, 1: 9893.8. Samples: 772290700. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:16,176][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.614')] [2023-12-28 06:05:16,327][106225] Updated weights for policy 1, policy_version 1510009 (0.0009) [2023-12-28 06:05:16,389][106225] Updated weights for policy 1, policy_version 1510019 (0.0008) [2023-12-28 06:05:16,449][106225] Updated weights for policy 1, policy_version 1510029 (0.0010) [2023-12-28 06:05:16,509][106225] Updated weights for policy 1, policy_version 1510039 (0.0010) [2023-12-28 06:05:16,515][106226] Updated weights for policy 0, policy_version 1506306 (0.0005) [2023-12-28 06:05:16,571][106226] Updated weights for policy 0, policy_version 1506316 (0.0008) [2023-12-28 06:05:16,628][106226] Updated weights for policy 0, policy_version 1506326 (0.0010) [2023-12-28 06:05:17,203][106225] Updated weights for policy 1, policy_version 1510049 (0.0009) [2023-12-28 06:05:17,257][106225] Updated weights for policy 1, policy_version 1510059 (0.0005) [2023-12-28 06:05:17,257][106226] Updated weights for policy 0, policy_version 1506336 (0.0009) [2023-12-28 06:05:17,314][106226] Updated weights for policy 0, policy_version 1506346 (0.0008) [2023-12-28 06:05:17,317][106225] Updated weights for policy 1, policy_version 1510069 (0.0005) [2023-12-28 06:05:17,371][106226] Updated weights for policy 0, policy_version 1506356 (0.0007) [2023-12-28 06:05:17,925][106225] Updated weights for policy 1, policy_version 1510079 (0.0009) [2023-12-28 06:05:17,977][106225] Updated weights for policy 1, policy_version 1510089 (0.0010) [2023-12-28 06:05:18,040][106225] Updated weights for policy 1, policy_version 1510099 (0.0010) [2023-12-28 06:05:18,132][106226] Updated weights for policy 0, policy_version 1506366 (0.0009) [2023-12-28 06:05:18,181][106226] Updated weights for policy 0, policy_version 1506376 (0.0009) [2023-12-28 06:05:18,236][106226] Updated weights for policy 0, policy_version 1506386 (0.0009) [2023-12-28 06:05:18,740][106225] Updated weights for policy 1, policy_version 1510109 (0.0009) [2023-12-28 06:05:18,797][106225] Updated weights for policy 1, policy_version 1510119 (0.0009) [2023-12-28 06:05:18,857][106225] Updated weights for policy 1, policy_version 1510129 (0.0009) [2023-12-28 06:05:19,009][106226] Updated weights for policy 0, policy_version 1506396 (0.0008) [2023-12-28 06:05:19,063][106226] Updated weights for policy 0, policy_version 1506406 (0.0008) [2023-12-28 06:05:19,126][106226] Updated weights for policy 0, policy_version 1506416 (0.0009) [2023-12-28 06:05:19,642][106225] Updated weights for policy 1, policy_version 1510139 (0.0008) [2023-12-28 06:05:19,696][106225] Updated weights for policy 1, policy_version 1510149 (0.0010) [2023-12-28 06:05:19,755][106225] Updated weights for policy 1, policy_version 1510159 (0.0010) [2023-12-28 06:05:19,838][106226] Updated weights for policy 0, policy_version 1506426 (0.0009) [2023-12-28 06:05:19,899][106226] Updated weights for policy 0, policy_version 1506436 (0.0008) [2023-12-28 06:05:19,971][106226] Updated weights for policy 0, policy_version 1506446 (0.0008) [2023-12-28 06:05:20,034][106226] Updated weights for policy 0, policy_version 1506456 (0.0008) [2023-12-28 06:05:20,470][106225] Updated weights for policy 1, policy_version 1510169 (0.0008) [2023-12-28 06:05:20,536][106225] Updated weights for policy 1, policy_version 1510179 (0.0005) [2023-12-28 06:05:20,601][106225] Updated weights for policy 1, policy_version 1510189 (0.0009) [2023-12-28 06:05:20,653][106225] Updated weights for policy 1, policy_version 1510199 (0.0007) [2023-12-28 06:05:20,814][106226] Updated weights for policy 0, policy_version 1506466 (0.0008) [2023-12-28 06:05:20,887][106226] Updated weights for policy 0, policy_version 1506476 (0.0009) [2023-12-28 06:05:20,962][106226] Updated weights for policy 0, policy_version 1506486 (0.0009) [2023-12-28 06:05:21,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 772399104. Throughput: 0: 9609.0, 1: 9808.1. Samples: 772406832. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:21,175][105115] Avg episode reward: [(0, '-4.786'), (1, '-4.803')] [2023-12-28 06:05:21,279][106225] Updated weights for policy 1, policy_version 1510209 (0.0008) [2023-12-28 06:05:21,342][106225] Updated weights for policy 1, policy_version 1510219 (0.0010) [2023-12-28 06:05:21,408][106225] Updated weights for policy 1, policy_version 1510229 (0.0008) [2023-12-28 06:05:21,788][106226] Updated weights for policy 0, policy_version 1506496 (0.0009) [2023-12-28 06:05:21,852][106226] Updated weights for policy 0, policy_version 1506506 (0.0008) [2023-12-28 06:05:21,920][106226] Updated weights for policy 0, policy_version 1506516 (0.0008) [2023-12-28 06:05:22,175][106225] Updated weights for policy 1, policy_version 1510239 (0.0007) [2023-12-28 06:05:22,240][106225] Updated weights for policy 1, policy_version 1510249 (0.0011) [2023-12-28 06:05:22,307][106225] Updated weights for policy 1, policy_version 1510259 (0.0011) [2023-12-28 06:05:22,572][106226] Updated weights for policy 0, policy_version 1506526 (0.0007) [2023-12-28 06:05:22,640][106226] Updated weights for policy 0, policy_version 1506536 (0.0006) [2023-12-28 06:05:22,710][106226] Updated weights for policy 0, policy_version 1506546 (0.0009) [2023-12-28 06:05:23,003][106225] Updated weights for policy 1, policy_version 1510269 (0.0008) [2023-12-28 06:05:23,057][106225] Updated weights for policy 1, policy_version 1510279 (0.0010) [2023-12-28 06:05:23,109][106225] Updated weights for policy 1, policy_version 1510289 (0.0007) [2023-12-28 06:05:23,366][106226] Updated weights for policy 0, policy_version 1506556 (0.0009) [2023-12-28 06:05:23,414][106226] Updated weights for policy 0, policy_version 1506566 (0.0005) [2023-12-28 06:05:23,480][106226] Updated weights for policy 0, policy_version 1506576 (0.0008) [2023-12-28 06:05:23,747][106225] Updated weights for policy 1, policy_version 1510299 (0.0006) [2023-12-28 06:05:23,797][106225] Updated weights for policy 1, policy_version 1510309 (0.0008) [2023-12-28 06:05:23,849][106225] Updated weights for policy 1, policy_version 1510319 (0.0008) [2023-12-28 06:05:24,136][106226] Updated weights for policy 0, policy_version 1506586 (0.0009) [2023-12-28 06:05:24,205][106226] Updated weights for policy 0, policy_version 1506596 (0.0006) [2023-12-28 06:05:24,261][106226] Updated weights for policy 0, policy_version 1506606 (0.0009) [2023-12-28 06:05:24,319][106226] Updated weights for policy 0, policy_version 1506616 (0.0009) [2023-12-28 06:05:24,512][106225] Updated weights for policy 1, policy_version 1510329 (0.0008) [2023-12-28 06:05:24,574][106225] Updated weights for policy 1, policy_version 1510339 (0.0006) [2023-12-28 06:05:24,633][106225] Updated weights for policy 1, policy_version 1510349 (0.0008) [2023-12-28 06:05:24,684][106225] Updated weights for policy 1, policy_version 1510359 (0.0008) [2023-12-28 06:05:25,091][106226] Updated weights for policy 0, policy_version 1506626 (0.0010) [2023-12-28 06:05:25,154][106226] Updated weights for policy 0, policy_version 1506636 (0.0006) [2023-12-28 06:05:25,222][106226] Updated weights for policy 0, policy_version 1506646 (0.0006) [2023-12-28 06:05:25,265][106225] Updated weights for policy 1, policy_version 1510369 (0.0006) [2023-12-28 06:05:25,336][106225] Updated weights for policy 1, policy_version 1510379 (0.0005) [2023-12-28 06:05:25,393][106225] Updated weights for policy 1, policy_version 1510389 (0.0005) [2023-12-28 06:05:25,837][106226] Updated weights for policy 0, policy_version 1506656 (0.0006) [2023-12-28 06:05:25,891][106226] Updated weights for policy 0, policy_version 1506666 (0.0005) [2023-12-28 06:05:25,912][106225] Updated weights for policy 1, policy_version 1510399 (0.0006) [2023-12-28 06:05:25,948][106226] Updated weights for policy 0, policy_version 1506676 (0.0006) [2023-12-28 06:05:25,969][106225] Updated weights for policy 1, policy_version 1510409 (0.0007) [2023-12-28 06:05:26,026][106225] Updated weights for policy 1, policy_version 1510419 (0.0009) [2023-12-28 06:05:26,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 772505600. Throughput: 0: 9608.6, 1: 9798.8. Samples: 772466464. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:26,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.545')] [2023-12-28 06:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001510424_386719744.pth... [2023-12-28 06:05:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001506680_385785856.pth... [2023-12-28 06:05:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001509272_386424832.pth [2023-12-28 06:05:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001505560_385499136.pth [2023-12-28 06:05:26,574][106226] Updated weights for policy 0, policy_version 1506686 (0.0009) [2023-12-28 06:05:26,631][106226] Updated weights for policy 0, policy_version 1506696 (0.0011) [2023-12-28 06:05:26,688][106226] Updated weights for policy 0, policy_version 1506706 (0.0011) [2023-12-28 06:05:26,761][106225] Updated weights for policy 1, policy_version 1510429 (0.0008) [2023-12-28 06:05:26,817][106225] Updated weights for policy 1, policy_version 1510439 (0.0009) [2023-12-28 06:05:26,870][106225] Updated weights for policy 1, policy_version 1510449 (0.0008) [2023-12-28 06:05:27,344][106226] Updated weights for policy 0, policy_version 1506716 (0.0011) [2023-12-28 06:05:27,400][106226] Updated weights for policy 0, policy_version 1506726 (0.0010) [2023-12-28 06:05:27,453][106226] Updated weights for policy 0, policy_version 1506736 (0.0005) [2023-12-28 06:05:27,613][106225] Updated weights for policy 1, policy_version 1510459 (0.0009) [2023-12-28 06:05:27,673][106225] Updated weights for policy 1, policy_version 1510469 (0.0008) [2023-12-28 06:05:27,732][106225] Updated weights for policy 1, policy_version 1510479 (0.0007) [2023-12-28 06:05:28,097][106226] Updated weights for policy 0, policy_version 1506746 (0.0006) [2023-12-28 06:05:28,148][106226] Updated weights for policy 0, policy_version 1506756 (0.0010) [2023-12-28 06:05:28,204][106226] Updated weights for policy 0, policy_version 1506766 (0.0005) [2023-12-28 06:05:28,262][106226] Updated weights for policy 0, policy_version 1506776 (0.0005) [2023-12-28 06:05:28,465][106225] Updated weights for policy 1, policy_version 1510489 (0.0007) [2023-12-28 06:05:28,529][106225] Updated weights for policy 1, policy_version 1510499 (0.0005) [2023-12-28 06:05:28,592][106225] Updated weights for policy 1, policy_version 1510509 (0.0006) [2023-12-28 06:05:28,655][106225] Updated weights for policy 1, policy_version 1510519 (0.0008) [2023-12-28 06:05:28,937][106226] Updated weights for policy 0, policy_version 1506786 (0.0008) [2023-12-28 06:05:28,997][106226] Updated weights for policy 0, policy_version 1506796 (0.0007) [2023-12-28 06:05:29,051][106226] Updated weights for policy 0, policy_version 1506806 (0.0008) [2023-12-28 06:05:29,312][106225] Updated weights for policy 1, policy_version 1510529 (0.0008) [2023-12-28 06:05:29,376][106225] Updated weights for policy 1, policy_version 1510539 (0.0008) [2023-12-28 06:05:29,436][106225] Updated weights for policy 1, policy_version 1510549 (0.0008) [2023-12-28 06:05:29,715][106226] Updated weights for policy 0, policy_version 1506816 (0.0006) [2023-12-28 06:05:29,766][106226] Updated weights for policy 0, policy_version 1506826 (0.0008) [2023-12-28 06:05:29,814][106226] Updated weights for policy 0, policy_version 1506836 (0.0008) [2023-12-28 06:05:30,195][106225] Updated weights for policy 1, policy_version 1510559 (0.0008) [2023-12-28 06:05:30,253][106225] Updated weights for policy 1, policy_version 1510569 (0.0008) [2023-12-28 06:05:30,313][106225] Updated weights for policy 1, policy_version 1510579 (0.0008) [2023-12-28 06:05:30,570][106226] Updated weights for policy 0, policy_version 1506846 (0.0008) [2023-12-28 06:05:30,626][106226] Updated weights for policy 0, policy_version 1506856 (0.0009) [2023-12-28 06:05:30,680][106226] Updated weights for policy 0, policy_version 1506866 (0.0008) [2023-12-28 06:05:31,077][106225] Updated weights for policy 1, policy_version 1510589 (0.0009) [2023-12-28 06:05:31,137][106225] Updated weights for policy 1, policy_version 1510599 (0.0009) [2023-12-28 06:05:31,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 772595712. Throughput: 0: 9676.8, 1: 9928.5. Samples: 772590040. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:31,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-4.977')] [2023-12-28 06:05:31,201][106225] Updated weights for policy 1, policy_version 1510609 (0.0009) [2023-12-28 06:05:31,317][106226] Updated weights for policy 0, policy_version 1506876 (0.0007) [2023-12-28 06:05:31,390][106226] Updated weights for policy 0, policy_version 1506886 (0.0007) [2023-12-28 06:05:31,438][106226] Updated weights for policy 0, policy_version 1506896 (0.0005) [2023-12-28 06:05:31,952][106225] Updated weights for policy 1, policy_version 1510619 (0.0009) [2023-12-28 06:05:32,010][106225] Updated weights for policy 1, policy_version 1510629 (0.0008) [2023-12-28 06:05:32,069][106225] Updated weights for policy 1, policy_version 1510639 (0.0008) [2023-12-28 06:05:32,093][106226] Updated weights for policy 0, policy_version 1506906 (0.0005) [2023-12-28 06:05:32,160][106226] Updated weights for policy 0, policy_version 1506917 (0.0009) [2023-12-28 06:05:32,225][106226] Updated weights for policy 0, policy_version 1506927 (0.0008) [2023-12-28 06:05:32,844][106225] Updated weights for policy 1, policy_version 1510649 (0.0007) [2023-12-28 06:05:32,881][106226] Updated weights for policy 0, policy_version 1506937 (0.0008) [2023-12-28 06:05:32,892][106225] Updated weights for policy 1, policy_version 1510659 (0.0009) [2023-12-28 06:05:32,939][106226] Updated weights for policy 0, policy_version 1506947 (0.0005) [2023-12-28 06:05:32,947][106225] Updated weights for policy 1, policy_version 1510669 (0.0008) [2023-12-28 06:05:32,996][106225] Updated weights for policy 1, policy_version 1510679 (0.0008) [2023-12-28 06:05:33,002][106226] Updated weights for policy 0, policy_version 1506957 (0.0006) [2023-12-28 06:05:33,061][106226] Updated weights for policy 0, policy_version 1506967 (0.0008) [2023-12-28 06:05:33,605][106226] Updated weights for policy 0, policy_version 1506977 (0.0007) [2023-12-28 06:05:33,646][106225] Updated weights for policy 1, policy_version 1510689 (0.0007) [2023-12-28 06:05:33,689][106226] Updated weights for policy 0, policy_version 1506987 (0.0006) [2023-12-28 06:05:33,702][106225] Updated weights for policy 1, policy_version 1510699 (0.0008) [2023-12-28 06:05:33,749][106226] Updated weights for policy 0, policy_version 1506997 (0.0006) [2023-12-28 06:05:33,756][106225] Updated weights for policy 1, policy_version 1510709 (0.0007) [2023-12-28 06:05:34,311][106226] Updated weights for policy 0, policy_version 1507007 (0.0008) [2023-12-28 06:05:34,366][106226] Updated weights for policy 0, policy_version 1507017 (0.0009) [2023-12-28 06:05:34,426][106226] Updated weights for policy 0, policy_version 1507027 (0.0009) [2023-12-28 06:05:34,520][106225] Updated weights for policy 1, policy_version 1510719 (0.0008) [2023-12-28 06:05:34,586][106225] Updated weights for policy 1, policy_version 1510729 (0.0007) [2023-12-28 06:05:34,650][106225] Updated weights for policy 1, policy_version 1510739 (0.0008) [2023-12-28 06:05:35,167][106226] Updated weights for policy 0, policy_version 1507037 (0.0009) [2023-12-28 06:05:35,224][106226] Updated weights for policy 0, policy_version 1507047 (0.0010) [2023-12-28 06:05:35,276][106226] Updated weights for policy 0, policy_version 1507057 (0.0010) [2023-12-28 06:05:35,337][106225] Updated weights for policy 1, policy_version 1510749 (0.0006) [2023-12-28 06:05:35,382][106225] Updated weights for policy 1, policy_version 1510759 (0.0005) [2023-12-28 06:05:35,428][106225] Updated weights for policy 1, policy_version 1510769 (0.0005) [2023-12-28 06:05:35,900][106226] Updated weights for policy 0, policy_version 1507067 (0.0009) [2023-12-28 06:05:35,953][106226] Updated weights for policy 0, policy_version 1507077 (0.0005) [2023-12-28 06:05:36,024][106226] Updated weights for policy 0, policy_version 1507087 (0.0010) [2023-12-28 06:05:36,150][106225] Updated weights for policy 1, policy_version 1510779 (0.0006) [2023-12-28 06:05:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 772702208. Throughput: 0: 9784.8, 1: 9868.6. Samples: 772711656. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:36,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-4.825')] [2023-12-28 06:05:36,216][106225] Updated weights for policy 1, policy_version 1510789 (0.0008) [2023-12-28 06:05:36,278][106225] Updated weights for policy 1, policy_version 1510799 (0.0008) [2023-12-28 06:05:36,727][106226] Updated weights for policy 0, policy_version 1507097 (0.0011) [2023-12-28 06:05:36,792][106226] Updated weights for policy 0, policy_version 1507107 (0.0011) [2023-12-28 06:05:36,856][106226] Updated weights for policy 0, policy_version 1507117 (0.0011) [2023-12-28 06:05:36,921][106226] Updated weights for policy 0, policy_version 1507127 (0.0011) [2023-12-28 06:05:37,031][106225] Updated weights for policy 1, policy_version 1510809 (0.0008) [2023-12-28 06:05:37,086][106225] Updated weights for policy 1, policy_version 1510819 (0.0008) [2023-12-28 06:05:37,144][106225] Updated weights for policy 1, policy_version 1510829 (0.0008) [2023-12-28 06:05:37,193][106225] Updated weights for policy 1, policy_version 1510839 (0.0009) [2023-12-28 06:05:37,585][106226] Updated weights for policy 0, policy_version 1507137 (0.0008) [2023-12-28 06:05:37,638][106226] Updated weights for policy 0, policy_version 1507147 (0.0009) [2023-12-28 06:05:37,693][106226] Updated weights for policy 0, policy_version 1507157 (0.0009) [2023-12-28 06:05:37,963][106225] Updated weights for policy 1, policy_version 1510849 (0.0008) [2023-12-28 06:05:38,031][106225] Updated weights for policy 1, policy_version 1510859 (0.0008) [2023-12-28 06:05:38,099][106225] Updated weights for policy 1, policy_version 1510869 (0.0009) [2023-12-28 06:05:38,389][106226] Updated weights for policy 0, policy_version 1507167 (0.0009) [2023-12-28 06:05:38,444][106226] Updated weights for policy 0, policy_version 1507177 (0.0008) [2023-12-28 06:05:38,503][106226] Updated weights for policy 0, policy_version 1507187 (0.0009) [2023-12-28 06:05:38,879][106225] Updated weights for policy 1, policy_version 1510879 (0.0008) [2023-12-28 06:05:38,936][106225] Updated weights for policy 1, policy_version 1510889 (0.0010) [2023-12-28 06:05:38,994][106225] Updated weights for policy 1, policy_version 1510899 (0.0009) [2023-12-28 06:05:39,142][106226] Updated weights for policy 0, policy_version 1507197 (0.0007) [2023-12-28 06:05:39,198][106226] Updated weights for policy 0, policy_version 1507207 (0.0009) [2023-12-28 06:05:39,263][106226] Updated weights for policy 0, policy_version 1507217 (0.0008) [2023-12-28 06:05:39,753][106225] Updated weights for policy 1, policy_version 1510909 (0.0008) [2023-12-28 06:05:39,817][106225] Updated weights for policy 1, policy_version 1510919 (0.0007) [2023-12-28 06:05:39,885][106225] Updated weights for policy 1, policy_version 1510929 (0.0006) [2023-12-28 06:05:39,958][106226] Updated weights for policy 0, policy_version 1507227 (0.0007) [2023-12-28 06:05:40,024][106226] Updated weights for policy 0, policy_version 1507237 (0.0010) [2023-12-28 06:05:40,089][106226] Updated weights for policy 0, policy_version 1507247 (0.0011) [2023-12-28 06:05:40,620][106225] Updated weights for policy 1, policy_version 1510939 (0.0008) [2023-12-28 06:05:40,685][106225] Updated weights for policy 1, policy_version 1510949 (0.0008) [2023-12-28 06:05:40,751][106225] Updated weights for policy 1, policy_version 1510959 (0.0008) [2023-12-28 06:05:40,787][106226] Updated weights for policy 0, policy_version 1507257 (0.0011) [2023-12-28 06:05:40,852][106226] Updated weights for policy 0, policy_version 1507267 (0.0011) [2023-12-28 06:05:40,915][106226] Updated weights for policy 0, policy_version 1507277 (0.0011) [2023-12-28 06:05:40,972][106226] Updated weights for policy 0, policy_version 1507287 (0.0011) [2023-12-28 06:05:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 772800512. Throughput: 0: 9795.8, 1: 9814.4. Samples: 772769136. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:41,176][105115] Avg episode reward: [(0, '-4.623'), (1, '-5.076')] [2023-12-28 06:05:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001510968_386859008.pth... [2023-12-28 06:05:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001507288_385941504.pth... [2023-12-28 06:05:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001506104_385638400.pth [2023-12-28 06:05:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001509848_386572288.pth [2023-12-28 06:05:41,495][106225] Updated weights for policy 1, policy_version 1510969 (0.0008) [2023-12-28 06:05:41,561][106225] Updated weights for policy 1, policy_version 1510979 (0.0008) [2023-12-28 06:05:41,630][106225] Updated weights for policy 1, policy_version 1510989 (0.0009) [2023-12-28 06:05:41,690][106225] Updated weights for policy 1, policy_version 1510999 (0.0009) [2023-12-28 06:05:41,816][106226] Updated weights for policy 0, policy_version 1507297 (0.0008) [2023-12-28 06:05:41,872][106226] Updated weights for policy 0, policy_version 1507307 (0.0006) [2023-12-28 06:05:41,940][106226] Updated weights for policy 0, policy_version 1507317 (0.0006) [2023-12-28 06:05:42,485][106225] Updated weights for policy 1, policy_version 1511009 (0.0009) [2023-12-28 06:05:42,544][106225] Updated weights for policy 1, policy_version 1511019 (0.0009) [2023-12-28 06:05:42,603][106225] Updated weights for policy 1, policy_version 1511029 (0.0009) [2023-12-28 06:05:42,668][106226] Updated weights for policy 0, policy_version 1507327 (0.0008) [2023-12-28 06:05:42,734][106226] Updated weights for policy 0, policy_version 1507337 (0.0009) [2023-12-28 06:05:42,801][106226] Updated weights for policy 0, policy_version 1507347 (0.0009) [2023-12-28 06:05:43,377][106225] Updated weights for policy 1, policy_version 1511039 (0.0010) [2023-12-28 06:05:43,430][106225] Updated weights for policy 1, policy_version 1511049 (0.0010) [2023-12-28 06:05:43,485][106225] Updated weights for policy 1, policy_version 1511059 (0.0011) [2023-12-28 06:05:43,488][106226] Updated weights for policy 0, policy_version 1507357 (0.0007) [2023-12-28 06:05:43,552][106226] Updated weights for policy 0, policy_version 1507367 (0.0007) [2023-12-28 06:05:43,607][106226] Updated weights for policy 0, policy_version 1507377 (0.0008) [2023-12-28 06:05:44,123][106225] Updated weights for policy 1, policy_version 1511069 (0.0008) [2023-12-28 06:05:44,175][106225] Updated weights for policy 1, policy_version 1511079 (0.0007) [2023-12-28 06:05:44,223][106225] Updated weights for policy 1, policy_version 1511089 (0.0005) [2023-12-28 06:05:44,306][106226] Updated weights for policy 0, policy_version 1507387 (0.0008) [2023-12-28 06:05:44,369][106226] Updated weights for policy 0, policy_version 1507397 (0.0008) [2023-12-28 06:05:44,433][106226] Updated weights for policy 0, policy_version 1507407 (0.0011) [2023-12-28 06:05:44,899][106225] Updated weights for policy 1, policy_version 1511099 (0.0007) [2023-12-28 06:05:44,966][106225] Updated weights for policy 1, policy_version 1511109 (0.0006) [2023-12-28 06:05:45,036][106225] Updated weights for policy 1, policy_version 1511119 (0.0006) [2023-12-28 06:05:45,169][106226] Updated weights for policy 0, policy_version 1507417 (0.0011) [2023-12-28 06:05:45,239][106226] Updated weights for policy 0, policy_version 1507427 (0.0011) [2023-12-28 06:05:45,297][106226] Updated weights for policy 0, policy_version 1507437 (0.0009) [2023-12-28 06:05:45,358][106226] Updated weights for policy 0, policy_version 1507447 (0.0008) [2023-12-28 06:05:45,671][106225] Updated weights for policy 1, policy_version 1511129 (0.0006) [2023-12-28 06:05:45,727][106225] Updated weights for policy 1, policy_version 1511139 (0.0007) [2023-12-28 06:05:45,795][106225] Updated weights for policy 1, policy_version 1511149 (0.0008) [2023-12-28 06:05:45,865][106225] Updated weights for policy 1, policy_version 1511159 (0.0010) [2023-12-28 06:05:45,981][106226] Updated weights for policy 0, policy_version 1507457 (0.0008) [2023-12-28 06:05:46,040][106226] Updated weights for policy 0, policy_version 1507467 (0.0007) [2023-12-28 06:05:46,097][106226] Updated weights for policy 0, policy_version 1507477 (0.0009) [2023-12-28 06:05:46,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 772898816. Throughput: 0: 9815.9, 1: 9817.7. Samples: 772883464. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:46,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.582')] [2023-12-28 06:05:46,601][106225] Updated weights for policy 1, policy_version 1511169 (0.0008) [2023-12-28 06:05:46,670][106225] Updated weights for policy 1, policy_version 1511179 (0.0008) [2023-12-28 06:05:46,725][106225] Updated weights for policy 1, policy_version 1511189 (0.0008) [2023-12-28 06:05:46,808][106226] Updated weights for policy 0, policy_version 1507487 (0.0009) [2023-12-28 06:05:46,867][106226] Updated weights for policy 0, policy_version 1507497 (0.0009) [2023-12-28 06:05:46,923][106226] Updated weights for policy 0, policy_version 1507507 (0.0008) [2023-12-28 06:05:47,434][106225] Updated weights for policy 1, policy_version 1511199 (0.0008) [2023-12-28 06:05:47,491][106225] Updated weights for policy 1, policy_version 1511209 (0.0007) [2023-12-28 06:05:47,562][106225] Updated weights for policy 1, policy_version 1511219 (0.0005) [2023-12-28 06:05:47,680][106226] Updated weights for policy 0, policy_version 1507517 (0.0009) [2023-12-28 06:05:47,739][106226] Updated weights for policy 0, policy_version 1507527 (0.0009) [2023-12-28 06:05:47,794][106226] Updated weights for policy 0, policy_version 1507537 (0.0009) [2023-12-28 06:05:48,114][106225] Updated weights for policy 1, policy_version 1511229 (0.0007) [2023-12-28 06:05:48,170][106225] Updated weights for policy 1, policy_version 1511239 (0.0007) [2023-12-28 06:05:48,234][106225] Updated weights for policy 1, policy_version 1511249 (0.0008) [2023-12-28 06:05:48,587][106226] Updated weights for policy 0, policy_version 1507547 (0.0009) [2023-12-28 06:05:48,647][106226] Updated weights for policy 0, policy_version 1507557 (0.0006) [2023-12-28 06:05:48,704][106226] Updated weights for policy 0, policy_version 1507567 (0.0009) [2023-12-28 06:05:48,961][106225] Updated weights for policy 1, policy_version 1511259 (0.0009) [2023-12-28 06:05:49,016][106225] Updated weights for policy 1, policy_version 1511269 (0.0009) [2023-12-28 06:05:49,074][106225] Updated weights for policy 1, policy_version 1511279 (0.0008) [2023-12-28 06:05:49,309][106226] Updated weights for policy 0, policy_version 1507577 (0.0009) [2023-12-28 06:05:49,378][106226] Updated weights for policy 0, policy_version 1507587 (0.0010) [2023-12-28 06:05:49,442][106226] Updated weights for policy 0, policy_version 1507597 (0.0008) [2023-12-28 06:05:49,507][106226] Updated weights for policy 0, policy_version 1507607 (0.0010) [2023-12-28 06:05:49,774][106225] Updated weights for policy 1, policy_version 1511289 (0.0007) [2023-12-28 06:05:49,839][106225] Updated weights for policy 1, policy_version 1511299 (0.0008) [2023-12-28 06:05:49,897][106225] Updated weights for policy 1, policy_version 1511309 (0.0008) [2023-12-28 06:05:49,968][106225] Updated weights for policy 1, policy_version 1511319 (0.0008) [2023-12-28 06:05:50,168][106226] Updated weights for policy 0, policy_version 1507617 (0.0009) [2023-12-28 06:05:50,233][106226] Updated weights for policy 0, policy_version 1507627 (0.0009) [2023-12-28 06:05:50,300][106226] Updated weights for policy 0, policy_version 1507637 (0.0009) [2023-12-28 06:05:50,665][106225] Updated weights for policy 1, policy_version 1511329 (0.0006) [2023-12-28 06:05:50,724][106225] Updated weights for policy 1, policy_version 1511339 (0.0007) [2023-12-28 06:05:50,786][106225] Updated weights for policy 1, policy_version 1511349 (0.0008) [2023-12-28 06:05:51,109][106226] Updated weights for policy 0, policy_version 1507647 (0.0008) [2023-12-28 06:05:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 772988928. Throughput: 0: 9814.6, 1: 9790.4. Samples: 773001720. Policy #0 lag: (min: 31.0, avg: 31.2, max: 38.0) [2023-12-28 06:05:51,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-4.851')] [2023-12-28 06:05:51,178][106226] Updated weights for policy 0, policy_version 1507657 (0.0009) [2023-12-28 06:05:51,246][106226] Updated weights for policy 0, policy_version 1507667 (0.0008) [2023-12-28 06:05:51,427][106225] Updated weights for policy 1, policy_version 1511359 (0.0008) [2023-12-28 06:05:51,495][106225] Updated weights for policy 1, policy_version 1511369 (0.0008) [2023-12-28 06:05:51,559][106225] Updated weights for policy 1, policy_version 1511379 (0.0008) [2023-12-28 06:05:51,954][106226] Updated weights for policy 0, policy_version 1507677 (0.0009) [2023-12-28 06:05:52,002][106226] Updated weights for policy 0, policy_version 1507687 (0.0008) [2023-12-28 06:05:52,051][106226] Updated weights for policy 0, policy_version 1507697 (0.0009) [2023-12-28 06:05:52,309][106225] Updated weights for policy 1, policy_version 1511389 (0.0008) [2023-12-28 06:05:52,380][106225] Updated weights for policy 1, policy_version 1511399 (0.0008) [2023-12-28 06:05:52,448][106225] Updated weights for policy 1, policy_version 1511409 (0.0009) [2023-12-28 06:05:52,844][106226] Updated weights for policy 0, policy_version 1507707 (0.0009) [2023-12-28 06:05:52,896][106226] Updated weights for policy 0, policy_version 1507717 (0.0007) [2023-12-28 06:05:52,951][106226] Updated weights for policy 0, policy_version 1507727 (0.0007) [2023-12-28 06:05:53,044][106225] Updated weights for policy 1, policy_version 1511419 (0.0009) [2023-12-28 06:05:53,116][106225] Updated weights for policy 1, policy_version 1511430 (0.0008) [2023-12-28 06:05:53,180][106225] Updated weights for policy 1, policy_version 1511440 (0.0009) [2023-12-28 06:05:53,652][106226] Updated weights for policy 0, policy_version 1507737 (0.0007) [2023-12-28 06:05:53,707][106226] Updated weights for policy 0, policy_version 1507747 (0.0008) [2023-12-28 06:05:53,758][106226] Updated weights for policy 0, policy_version 1507757 (0.0007) [2023-12-28 06:05:53,807][106226] Updated weights for policy 0, policy_version 1507767 (0.0007) [2023-12-28 06:05:53,920][106225] Updated weights for policy 1, policy_version 1511450 (0.0008) [2023-12-28 06:05:53,967][106225] Updated weights for policy 1, policy_version 1511460 (0.0010) [2023-12-28 06:05:54,020][106225] Updated weights for policy 1, policy_version 1511470 (0.0010) [2023-12-28 06:05:54,070][106225] Updated weights for policy 1, policy_version 1511480 (0.0010) [2023-12-28 06:05:54,470][106226] Updated weights for policy 0, policy_version 1507777 (0.0009) [2023-12-28 06:05:54,539][106226] Updated weights for policy 0, policy_version 1507787 (0.0010) [2023-12-28 06:05:54,606][106226] Updated weights for policy 0, policy_version 1507797 (0.0008) [2023-12-28 06:05:54,774][106225] Updated weights for policy 1, policy_version 1511490 (0.0010) [2023-12-28 06:05:54,824][106225] Updated weights for policy 1, policy_version 1511500 (0.0010) [2023-12-28 06:05:54,874][106225] Updated weights for policy 1, policy_version 1511510 (0.0010) [2023-12-28 06:05:55,304][106226] Updated weights for policy 0, policy_version 1507807 (0.0008) [2023-12-28 06:05:55,365][106226] Updated weights for policy 0, policy_version 1507817 (0.0008) [2023-12-28 06:05:55,425][106226] Updated weights for policy 0, policy_version 1507827 (0.0008) [2023-12-28 06:05:55,613][106225] Updated weights for policy 1, policy_version 1511520 (0.0010) [2023-12-28 06:05:55,666][106225] Updated weights for policy 1, policy_version 1511530 (0.0010) [2023-12-28 06:05:55,723][106225] Updated weights for policy 1, policy_version 1511540 (0.0010) [2023-12-28 06:05:56,147][106226] Updated weights for policy 0, policy_version 1507837 (0.0009) [2023-12-28 06:05:56,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 773087232. Throughput: 0: 9815.2, 1: 9796.9. Samples: 773060132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:05:56,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.636')] [2023-12-28 06:05:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001511544_387006464.pth... [2023-12-28 06:05:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001510424_386719744.pth [2023-12-28 06:05:56,204][106226] Updated weights for policy 0, policy_version 1507847 (0.0010) [2023-12-28 06:05:56,252][106226] Updated weights for policy 0, policy_version 1507857 (0.0010) [2023-12-28 06:05:56,283][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001507864_386088960.pth... [2023-12-28 06:05:56,287][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001506680_385785856.pth [2023-12-28 06:05:56,399][106225] Updated weights for policy 1, policy_version 1511550 (0.0009) [2023-12-28 06:05:56,452][106225] Updated weights for policy 1, policy_version 1511560 (0.0010) [2023-12-28 06:05:56,502][106225] Updated weights for policy 1, policy_version 1511570 (0.0010) [2023-12-28 06:05:56,889][106226] Updated weights for policy 0, policy_version 1507867 (0.0009) [2023-12-28 06:05:56,944][106226] Updated weights for policy 0, policy_version 1507877 (0.0005) [2023-12-28 06:05:57,000][106226] Updated weights for policy 0, policy_version 1507887 (0.0005) [2023-12-28 06:05:57,204][106225] Updated weights for policy 1, policy_version 1511580 (0.0008) [2023-12-28 06:05:57,265][106225] Updated weights for policy 1, policy_version 1511590 (0.0005) [2023-12-28 06:05:57,330][106225] Updated weights for policy 1, policy_version 1511600 (0.0006) [2023-12-28 06:05:57,525][106226] Updated weights for policy 0, policy_version 1507897 (0.0005) [2023-12-28 06:05:57,584][106226] Updated weights for policy 0, policy_version 1507907 (0.0010) [2023-12-28 06:05:57,650][106226] Updated weights for policy 0, policy_version 1507917 (0.0011) [2023-12-28 06:05:57,712][106226] Updated weights for policy 0, policy_version 1507927 (0.0010) [2023-12-28 06:05:57,934][106225] Updated weights for policy 1, policy_version 1511610 (0.0006) [2023-12-28 06:05:57,989][106225] Updated weights for policy 1, policy_version 1511620 (0.0009) [2023-12-28 06:05:58,047][106225] Updated weights for policy 1, policy_version 1511630 (0.0010) [2023-12-28 06:05:58,106][106225] Updated weights for policy 1, policy_version 1511640 (0.0010) [2023-12-28 06:05:58,431][106226] Updated weights for policy 0, policy_version 1507937 (0.0012) [2023-12-28 06:05:58,491][106226] Updated weights for policy 0, policy_version 1507947 (0.0010) [2023-12-28 06:05:58,558][106226] Updated weights for policy 0, policy_version 1507957 (0.0010) [2023-12-28 06:05:58,878][106225] Updated weights for policy 1, policy_version 1511650 (0.0009) [2023-12-28 06:05:58,953][106225] Updated weights for policy 1, policy_version 1511660 (0.0008) [2023-12-28 06:05:59,019][106225] Updated weights for policy 1, policy_version 1511670 (0.0008) [2023-12-28 06:05:59,396][106226] Updated weights for policy 0, policy_version 1507967 (0.0010) [2023-12-28 06:05:59,462][106226] Updated weights for policy 0, policy_version 1507977 (0.0011) [2023-12-28 06:05:59,525][106226] Updated weights for policy 0, policy_version 1507987 (0.0011) [2023-12-28 06:05:59,825][106225] Updated weights for policy 1, policy_version 1511680 (0.0007) [2023-12-28 06:05:59,893][106225] Updated weights for policy 1, policy_version 1511690 (0.0008) [2023-12-28 06:05:59,960][106225] Updated weights for policy 1, policy_version 1511700 (0.0008) [2023-12-28 06:06:00,207][106226] Updated weights for policy 0, policy_version 1507997 (0.0010) [2023-12-28 06:06:00,267][106226] Updated weights for policy 0, policy_version 1508007 (0.0010) [2023-12-28 06:06:00,324][106226] Updated weights for policy 0, policy_version 1508017 (0.0005) [2023-12-28 06:06:00,685][106225] Updated weights for policy 1, policy_version 1511710 (0.0006) [2023-12-28 06:06:00,735][106225] Updated weights for policy 1, policy_version 1511720 (0.0007) [2023-12-28 06:06:00,783][106225] Updated weights for policy 1, policy_version 1511730 (0.0008) [2023-12-28 06:06:00,957][106226] Updated weights for policy 0, policy_version 1508028 (0.0008) [2023-12-28 06:06:01,013][106226] Updated weights for policy 0, policy_version 1508038 (0.0005) [2023-12-28 06:06:01,077][106226] Updated weights for policy 0, policy_version 1508048 (0.0007) [2023-12-28 06:06:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 773193728. Throughput: 0: 9914.7, 1: 9840.2. Samples: 773179668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:01,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.765')] [2023-12-28 06:06:01,506][106225] Updated weights for policy 1, policy_version 1511740 (0.0009) [2023-12-28 06:06:01,566][106225] Updated weights for policy 1, policy_version 1511750 (0.0008) [2023-12-28 06:06:01,637][106225] Updated weights for policy 1, policy_version 1511760 (0.0006) [2023-12-28 06:06:01,843][106226] Updated weights for policy 0, policy_version 1508058 (0.0009) [2023-12-28 06:06:01,914][106226] Updated weights for policy 0, policy_version 1508068 (0.0010) [2023-12-28 06:06:01,962][106226] Updated weights for policy 0, policy_version 1508078 (0.0009) [2023-12-28 06:06:02,016][106226] Updated weights for policy 0, policy_version 1508088 (0.0009) [2023-12-28 06:06:02,287][106225] Updated weights for policy 1, policy_version 1511770 (0.0007) [2023-12-28 06:06:02,350][106225] Updated weights for policy 1, policy_version 1511780 (0.0008) [2023-12-28 06:06:02,411][106225] Updated weights for policy 1, policy_version 1511790 (0.0008) [2023-12-28 06:06:02,464][106225] Updated weights for policy 1, policy_version 1511800 (0.0009) [2023-12-28 06:06:02,749][106226] Updated weights for policy 0, policy_version 1508098 (0.0008) [2023-12-28 06:06:02,814][106226] Updated weights for policy 0, policy_version 1508108 (0.0010) [2023-12-28 06:06:02,870][106226] Updated weights for policy 0, policy_version 1508118 (0.0009) [2023-12-28 06:06:03,108][106225] Updated weights for policy 1, policy_version 1511810 (0.0005) [2023-12-28 06:06:03,160][106225] Updated weights for policy 1, policy_version 1511820 (0.0005) [2023-12-28 06:06:03,216][106225] Updated weights for policy 1, policy_version 1511830 (0.0008) [2023-12-28 06:06:03,663][106226] Updated weights for policy 0, policy_version 1508128 (0.0008) [2023-12-28 06:06:03,715][106226] Updated weights for policy 0, policy_version 1508138 (0.0009) [2023-12-28 06:06:03,764][106226] Updated weights for policy 0, policy_version 1508148 (0.0008) [2023-12-28 06:06:03,870][106225] Updated weights for policy 1, policy_version 1511840 (0.0008) [2023-12-28 06:06:03,934][106225] Updated weights for policy 1, policy_version 1511850 (0.0007) [2023-12-28 06:06:03,995][106225] Updated weights for policy 1, policy_version 1511860 (0.0009) [2023-12-28 06:06:04,520][106226] Updated weights for policy 0, policy_version 1508158 (0.0009) [2023-12-28 06:06:04,574][106226] Updated weights for policy 0, policy_version 1508168 (0.0009) [2023-12-28 06:06:04,630][106226] Updated weights for policy 0, policy_version 1508178 (0.0009) [2023-12-28 06:06:04,688][106225] Updated weights for policy 1, policy_version 1511870 (0.0008) [2023-12-28 06:06:04,743][106225] Updated weights for policy 1, policy_version 1511880 (0.0008) [2023-12-28 06:06:04,794][106225] Updated weights for policy 1, policy_version 1511890 (0.0008) [2023-12-28 06:06:05,391][106226] Updated weights for policy 0, policy_version 1508188 (0.0008) [2023-12-28 06:06:05,437][106226] Updated weights for policy 0, policy_version 1508198 (0.0008) [2023-12-28 06:06:05,493][106226] Updated weights for policy 0, policy_version 1508208 (0.0008) [2023-12-28 06:06:05,506][106225] Updated weights for policy 1, policy_version 1511900 (0.0007) [2023-12-28 06:06:05,559][106225] Updated weights for policy 1, policy_version 1511910 (0.0007) [2023-12-28 06:06:05,607][106225] Updated weights for policy 1, policy_version 1511920 (0.0008) [2023-12-28 06:06:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 773283840. Throughput: 0: 9928.1, 1: 9844.2. Samples: 773296584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:06,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.741')] [2023-12-28 06:06:06,208][106226] Updated weights for policy 0, policy_version 1508218 (0.0006) [2023-12-28 06:06:06,267][106226] Updated weights for policy 0, policy_version 1508228 (0.0008) [2023-12-28 06:06:06,324][106226] Updated weights for policy 0, policy_version 1508238 (0.0009) [2023-12-28 06:06:06,378][106225] Updated weights for policy 1, policy_version 1511930 (0.0008) [2023-12-28 06:06:06,380][106226] Updated weights for policy 0, policy_version 1508248 (0.0008) [2023-12-28 06:06:06,437][106225] Updated weights for policy 1, policy_version 1511940 (0.0008) [2023-12-28 06:06:06,495][106225] Updated weights for policy 1, policy_version 1511950 (0.0008) [2023-12-28 06:06:06,561][106225] Updated weights for policy 1, policy_version 1511960 (0.0008) [2023-12-28 06:06:07,127][106226] Updated weights for policy 0, policy_version 1508258 (0.0007) [2023-12-28 06:06:07,149][106225] Updated weights for policy 1, policy_version 1511970 (0.0007) [2023-12-28 06:06:07,176][106226] Updated weights for policy 0, policy_version 1508268 (0.0006) [2023-12-28 06:06:07,201][106225] Updated weights for policy 1, policy_version 1511980 (0.0008) [2023-12-28 06:06:07,232][106226] Updated weights for policy 0, policy_version 1508278 (0.0006) [2023-12-28 06:06:07,261][106225] Updated weights for policy 1, policy_version 1511990 (0.0008) [2023-12-28 06:06:07,962][106225] Updated weights for policy 1, policy_version 1512000 (0.0009) [2023-12-28 06:06:07,998][106226] Updated weights for policy 0, policy_version 1508288 (0.0007) [2023-12-28 06:06:08,017][106225] Updated weights for policy 1, policy_version 1512010 (0.0007) [2023-12-28 06:06:08,057][106226] Updated weights for policy 0, policy_version 1508298 (0.0006) [2023-12-28 06:06:08,072][106225] Updated weights for policy 1, policy_version 1512020 (0.0007) [2023-12-28 06:06:08,119][106226] Updated weights for policy 0, policy_version 1508308 (0.0007) [2023-12-28 06:06:08,741][106226] Updated weights for policy 0, policy_version 1508318 (0.0008) [2023-12-28 06:06:08,804][106226] Updated weights for policy 0, policy_version 1508328 (0.0009) [2023-12-28 06:06:08,830][106225] Updated weights for policy 1, policy_version 1512030 (0.0006) [2023-12-28 06:06:08,866][106226] Updated weights for policy 0, policy_version 1508338 (0.0008) [2023-12-28 06:06:08,890][106225] Updated weights for policy 1, policy_version 1512040 (0.0007) [2023-12-28 06:06:08,951][106225] Updated weights for policy 1, policy_version 1512050 (0.0009) [2023-12-28 06:06:09,572][106226] Updated weights for policy 0, policy_version 1508348 (0.0007) [2023-12-28 06:06:09,638][106226] Updated weights for policy 0, policy_version 1508358 (0.0008) [2023-12-28 06:06:09,695][106225] Updated weights for policy 1, policy_version 1512060 (0.0007) [2023-12-28 06:06:09,701][106226] Updated weights for policy 0, policy_version 1508368 (0.0007) [2023-12-28 06:06:09,761][106225] Updated weights for policy 1, policy_version 1512070 (0.0009) [2023-12-28 06:06:09,821][106225] Updated weights for policy 1, policy_version 1512080 (0.0008) [2023-12-28 06:06:10,422][106226] Updated weights for policy 0, policy_version 1508378 (0.0009) [2023-12-28 06:06:10,485][106226] Updated weights for policy 0, policy_version 1508388 (0.0008) [2023-12-28 06:06:10,549][106226] Updated weights for policy 0, policy_version 1508398 (0.0009) [2023-12-28 06:06:10,561][106225] Updated weights for policy 1, policy_version 1512090 (0.0009) [2023-12-28 06:06:10,606][106226] Updated weights for policy 0, policy_version 1508408 (0.0008) [2023-12-28 06:06:10,625][106225] Updated weights for policy 1, policy_version 1512100 (0.0006) [2023-12-28 06:06:10,680][106225] Updated weights for policy 1, policy_version 1512110 (0.0008) [2023-12-28 06:06:10,745][106225] Updated weights for policy 1, policy_version 1512120 (0.0009) [2023-12-28 06:06:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 773382144. Throughput: 0: 9925.9, 1: 9839.8. Samples: 773355920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:11,175][105115] Avg episode reward: [(0, '-4.999'), (1, '-4.453')] [2023-12-28 06:06:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001508408_386228224.pth... [2023-12-28 06:06:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001512120_387153920.pth... [2023-12-28 06:06:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001507288_385941504.pth [2023-12-28 06:06:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001510968_386859008.pth [2023-12-28 06:06:11,373][106226] Updated weights for policy 0, policy_version 1508418 (0.0008) [2023-12-28 06:06:11,431][106225] Updated weights for policy 1, policy_version 1512130 (0.0009) [2023-12-28 06:06:11,441][106226] Updated weights for policy 0, policy_version 1508428 (0.0008) [2023-12-28 06:06:11,501][106225] Updated weights for policy 1, policy_version 1512140 (0.0009) [2023-12-28 06:06:11,502][106226] Updated weights for policy 0, policy_version 1508438 (0.0008) [2023-12-28 06:06:11,567][106225] Updated weights for policy 1, policy_version 1512150 (0.0009) [2023-12-28 06:06:12,241][106226] Updated weights for policy 0, policy_version 1508448 (0.0009) [2023-12-28 06:06:12,308][106226] Updated weights for policy 0, policy_version 1508458 (0.0007) [2023-12-28 06:06:12,319][106225] Updated weights for policy 1, policy_version 1512160 (0.0009) [2023-12-28 06:06:12,378][106226] Updated weights for policy 0, policy_version 1508468 (0.0007) [2023-12-28 06:06:12,386][106225] Updated weights for policy 1, policy_version 1512170 (0.0007) [2023-12-28 06:06:12,452][106225] Updated weights for policy 1, policy_version 1512180 (0.0005) [2023-12-28 06:06:13,082][106226] Updated weights for policy 0, policy_version 1508478 (0.0009) [2023-12-28 06:06:13,143][106226] Updated weights for policy 0, policy_version 1508488 (0.0009) [2023-12-28 06:06:13,163][106225] Updated weights for policy 1, policy_version 1512190 (0.0008) [2023-12-28 06:06:13,204][106226] Updated weights for policy 0, policy_version 1508498 (0.0008) [2023-12-28 06:06:13,224][106225] Updated weights for policy 1, policy_version 1512200 (0.0010) [2023-12-28 06:06:13,279][106225] Updated weights for policy 1, policy_version 1512210 (0.0010) [2023-12-28 06:06:13,863][106226] Updated weights for policy 0, policy_version 1508508 (0.0007) [2023-12-28 06:06:13,919][106226] Updated weights for policy 0, policy_version 1508518 (0.0008) [2023-12-28 06:06:13,981][106226] Updated weights for policy 0, policy_version 1508528 (0.0008) [2023-12-28 06:06:14,054][106225] Updated weights for policy 1, policy_version 1512220 (0.0009) [2023-12-28 06:06:14,107][106225] Updated weights for policy 1, policy_version 1512230 (0.0008) [2023-12-28 06:06:14,159][106225] Updated weights for policy 1, policy_version 1512240 (0.0008) [2023-12-28 06:06:14,645][106226] Updated weights for policy 0, policy_version 1508538 (0.0008) [2023-12-28 06:06:14,706][106226] Updated weights for policy 0, policy_version 1508548 (0.0009) [2023-12-28 06:06:14,762][106226] Updated weights for policy 0, policy_version 1508558 (0.0007) [2023-12-28 06:06:14,832][106226] Updated weights for policy 0, policy_version 1508568 (0.0008) [2023-12-28 06:06:14,890][106225] Updated weights for policy 1, policy_version 1512250 (0.0008) [2023-12-28 06:06:14,960][106225] Updated weights for policy 1, policy_version 1512260 (0.0006) [2023-12-28 06:06:15,032][106225] Updated weights for policy 1, policy_version 1512270 (0.0007) [2023-12-28 06:06:15,094][106225] Updated weights for policy 1, policy_version 1512280 (0.0009) [2023-12-28 06:06:15,631][106226] Updated weights for policy 0, policy_version 1508578 (0.0008) [2023-12-28 06:06:15,685][106226] Updated weights for policy 0, policy_version 1508588 (0.0009) [2023-12-28 06:06:15,698][106225] Updated weights for policy 1, policy_version 1512290 (0.0009) [2023-12-28 06:06:15,735][106226] Updated weights for policy 0, policy_version 1508598 (0.0006) [2023-12-28 06:06:15,744][106225] Updated weights for policy 1, policy_version 1512300 (0.0006) [2023-12-28 06:06:15,800][106225] Updated weights for policy 1, policy_version 1512310 (0.0008) [2023-12-28 06:06:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 773480448. Throughput: 0: 9838.2, 1: 9702.4. Samples: 773469372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:16,176][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.702')] [2023-12-28 06:06:16,367][106226] Updated weights for policy 0, policy_version 1508608 (0.0007) [2023-12-28 06:06:16,422][106226] Updated weights for policy 0, policy_version 1508618 (0.0005) [2023-12-28 06:06:16,472][106226] Updated weights for policy 0, policy_version 1508628 (0.0005) [2023-12-28 06:06:16,621][106225] Updated weights for policy 1, policy_version 1512320 (0.0008) [2023-12-28 06:06:16,683][106225] Updated weights for policy 1, policy_version 1512330 (0.0008) [2023-12-28 06:06:16,749][106225] Updated weights for policy 1, policy_version 1512340 (0.0008) [2023-12-28 06:06:17,077][106226] Updated weights for policy 0, policy_version 1508638 (0.0006) [2023-12-28 06:06:17,140][106226] Updated weights for policy 0, policy_version 1508648 (0.0008) [2023-12-28 06:06:17,198][106226] Updated weights for policy 0, policy_version 1508658 (0.0005) [2023-12-28 06:06:17,563][106225] Updated weights for policy 1, policy_version 1512350 (0.0009) [2023-12-28 06:06:17,624][106225] Updated weights for policy 1, policy_version 1512360 (0.0008) [2023-12-28 06:06:17,682][106225] Updated weights for policy 1, policy_version 1512370 (0.0010) [2023-12-28 06:06:17,721][106226] Updated weights for policy 0, policy_version 1508668 (0.0006) [2023-12-28 06:06:17,767][106226] Updated weights for policy 0, policy_version 1508678 (0.0005) [2023-12-28 06:06:17,817][106226] Updated weights for policy 0, policy_version 1508688 (0.0005) [2023-12-28 06:06:18,436][106226] Updated weights for policy 0, policy_version 1508698 (0.0006) [2023-12-28 06:06:18,496][106225] Updated weights for policy 1, policy_version 1512380 (0.0009) [2023-12-28 06:06:18,498][106226] Updated weights for policy 0, policy_version 1508708 (0.0007) [2023-12-28 06:06:18,548][106225] Updated weights for policy 1, policy_version 1512390 (0.0006) [2023-12-28 06:06:18,554][106226] Updated weights for policy 0, policy_version 1508718 (0.0006) [2023-12-28 06:06:18,611][106226] Updated weights for policy 0, policy_version 1508728 (0.0008) [2023-12-28 06:06:18,614][106225] Updated weights for policy 1, policy_version 1512400 (0.0008) [2023-12-28 06:06:19,229][106226] Updated weights for policy 0, policy_version 1508738 (0.0006) [2023-12-28 06:06:19,294][106226] Updated weights for policy 0, policy_version 1508748 (0.0007) [2023-12-28 06:06:19,364][106226] Updated weights for policy 0, policy_version 1508758 (0.0008) [2023-12-28 06:06:19,397][106225] Updated weights for policy 1, policy_version 1512410 (0.0007) [2023-12-28 06:06:19,455][106225] Updated weights for policy 1, policy_version 1512420 (0.0008) [2023-12-28 06:06:19,514][106225] Updated weights for policy 1, policy_version 1512430 (0.0009) [2023-12-28 06:06:19,576][106225] Updated weights for policy 1, policy_version 1512440 (0.0006) [2023-12-28 06:06:20,023][106226] Updated weights for policy 0, policy_version 1508768 (0.0010) [2023-12-28 06:06:20,090][106226] Updated weights for policy 0, policy_version 1508778 (0.0007) [2023-12-28 06:06:20,157][106226] Updated weights for policy 0, policy_version 1508788 (0.0009) [2023-12-28 06:06:20,213][106225] Updated weights for policy 1, policy_version 1512450 (0.0009) [2023-12-28 06:06:20,277][106225] Updated weights for policy 1, policy_version 1512460 (0.0011) [2023-12-28 06:06:20,340][106225] Updated weights for policy 1, policy_version 1512470 (0.0010) [2023-12-28 06:06:20,854][106226] Updated weights for policy 0, policy_version 1508798 (0.0011) [2023-12-28 06:06:20,919][106226] Updated weights for policy 0, policy_version 1508808 (0.0011) [2023-12-28 06:06:20,977][106226] Updated weights for policy 0, policy_version 1508818 (0.0011) [2023-12-28 06:06:21,080][106225] Updated weights for policy 1, policy_version 1512480 (0.0009) [2023-12-28 06:06:21,143][106225] Updated weights for policy 1, policy_version 1512490 (0.0009) [2023-12-28 06:06:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 773578752. Throughput: 0: 9843.5, 1: 9663.1. Samples: 773589460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:21,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-4.703')] [2023-12-28 06:06:21,207][106225] Updated weights for policy 1, policy_version 1512500 (0.0008) [2023-12-28 06:06:21,751][106226] Updated weights for policy 0, policy_version 1508828 (0.0010) [2023-12-28 06:06:21,815][106226] Updated weights for policy 0, policy_version 1508838 (0.0010) [2023-12-28 06:06:21,877][106226] Updated weights for policy 0, policy_version 1508848 (0.0007) [2023-12-28 06:06:22,020][106225] Updated weights for policy 1, policy_version 1512510 (0.0007) [2023-12-28 06:06:22,083][106225] Updated weights for policy 1, policy_version 1512520 (0.0008) [2023-12-28 06:06:22,150][106225] Updated weights for policy 1, policy_version 1512530 (0.0006) [2023-12-28 06:06:22,638][106226] Updated weights for policy 0, policy_version 1508858 (0.0011) [2023-12-28 06:06:22,699][106226] Updated weights for policy 0, policy_version 1508868 (0.0011) [2023-12-28 06:06:22,770][106226] Updated weights for policy 0, policy_version 1508878 (0.0011) [2023-12-28 06:06:22,793][106225] Updated weights for policy 1, policy_version 1512540 (0.0007) [2023-12-28 06:06:22,832][106226] Updated weights for policy 0, policy_version 1508888 (0.0011) [2023-12-28 06:06:22,852][106225] Updated weights for policy 1, policy_version 1512550 (0.0008) [2023-12-28 06:06:22,905][106225] Updated weights for policy 1, policy_version 1512560 (0.0007) [2023-12-28 06:06:23,557][106226] Updated weights for policy 0, policy_version 1508898 (0.0011) [2023-12-28 06:06:23,579][106225] Updated weights for policy 1, policy_version 1512570 (0.0006) [2023-12-28 06:06:23,611][106226] Updated weights for policy 0, policy_version 1508908 (0.0010) [2023-12-28 06:06:23,638][106225] Updated weights for policy 1, policy_version 1512580 (0.0009) [2023-12-28 06:06:23,674][106226] Updated weights for policy 0, policy_version 1508918 (0.0011) [2023-12-28 06:06:23,692][106225] Updated weights for policy 1, policy_version 1512590 (0.0008) [2023-12-28 06:06:23,747][106225] Updated weights for policy 1, policy_version 1512600 (0.0006) [2023-12-28 06:06:24,406][106226] Updated weights for policy 0, policy_version 1508928 (0.0011) [2023-12-28 06:06:24,421][106225] Updated weights for policy 1, policy_version 1512610 (0.0010) [2023-12-28 06:06:24,470][106226] Updated weights for policy 0, policy_version 1508938 (0.0010) [2023-12-28 06:06:24,480][106225] Updated weights for policy 1, policy_version 1512620 (0.0009) [2023-12-28 06:06:24,525][106226] Updated weights for policy 0, policy_version 1508948 (0.0010) [2023-12-28 06:06:24,537][106225] Updated weights for policy 1, policy_version 1512630 (0.0008) [2023-12-28 06:06:25,098][106225] Updated weights for policy 1, policy_version 1512640 (0.0005) [2023-12-28 06:06:25,142][106226] Updated weights for policy 0, policy_version 1508958 (0.0008) [2023-12-28 06:06:25,165][106225] Updated weights for policy 1, policy_version 1512650 (0.0006) [2023-12-28 06:06:25,209][106226] Updated weights for policy 0, policy_version 1508968 (0.0006) [2023-12-28 06:06:25,229][106225] Updated weights for policy 1, policy_version 1512660 (0.0010) [2023-12-28 06:06:25,265][106226] Updated weights for policy 0, policy_version 1508978 (0.0009) [2023-12-28 06:06:25,862][106225] Updated weights for policy 1, policy_version 1512670 (0.0011) [2023-12-28 06:06:25,869][106226] Updated weights for policy 0, policy_version 1508988 (0.0009) [2023-12-28 06:06:25,929][106225] Updated weights for policy 1, policy_version 1512680 (0.0010) [2023-12-28 06:06:25,932][106226] Updated weights for policy 0, policy_version 1508998 (0.0007) [2023-12-28 06:06:25,984][106225] Updated weights for policy 1, policy_version 1512690 (0.0010) [2023-12-28 06:06:25,988][106226] Updated weights for policy 0, policy_version 1509008 (0.0007) [2023-12-28 06:06:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 773685248. Throughput: 0: 9794.1, 1: 9695.0. Samples: 773646144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:26,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.366')] [2023-12-28 06:06:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001512696_387301376.pth... [2023-12-28 06:06:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001509016_386383872.pth... [2023-12-28 06:06:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001511544_387006464.pth [2023-12-28 06:06:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001507864_386088960.pth [2023-12-28 06:06:26,631][106226] Updated weights for policy 0, policy_version 1509018 (0.0007) [2023-12-28 06:06:26,682][106226] Updated weights for policy 0, policy_version 1509028 (0.0006) [2023-12-28 06:06:26,704][106225] Updated weights for policy 1, policy_version 1512700 (0.0010) [2023-12-28 06:06:26,734][106226] Updated weights for policy 0, policy_version 1509038 (0.0006) [2023-12-28 06:06:26,755][106225] Updated weights for policy 1, policy_version 1512710 (0.0010) [2023-12-28 06:06:26,786][106226] Updated weights for policy 0, policy_version 1509048 (0.0005) [2023-12-28 06:06:26,801][106225] Updated weights for policy 1, policy_version 1512720 (0.0010) [2023-12-28 06:06:27,466][106226] Updated weights for policy 0, policy_version 1509058 (0.0005) [2023-12-28 06:06:27,467][106225] Updated weights for policy 1, policy_version 1512730 (0.0009) [2023-12-28 06:06:27,521][106225] Updated weights for policy 1, policy_version 1512740 (0.0005) [2023-12-28 06:06:27,527][106226] Updated weights for policy 0, policy_version 1509068 (0.0006) [2023-12-28 06:06:27,565][106225] Updated weights for policy 1, policy_version 1512750 (0.0005) [2023-12-28 06:06:27,578][106226] Updated weights for policy 0, policy_version 1509078 (0.0005) [2023-12-28 06:06:27,614][106225] Updated weights for policy 1, policy_version 1512760 (0.0005) [2023-12-28 06:06:28,138][106225] Updated weights for policy 1, policy_version 1512770 (0.0005) [2023-12-28 06:06:28,188][106225] Updated weights for policy 1, policy_version 1512780 (0.0005) [2023-12-28 06:06:28,205][106226] Updated weights for policy 0, policy_version 1509088 (0.0009) [2023-12-28 06:06:28,237][106225] Updated weights for policy 1, policy_version 1512790 (0.0005) [2023-12-28 06:06:28,252][106226] Updated weights for policy 0, policy_version 1509098 (0.0008) [2023-12-28 06:06:28,302][106226] Updated weights for policy 0, policy_version 1509108 (0.0010) [2023-12-28 06:06:28,852][106225] Updated weights for policy 1, policy_version 1512800 (0.0006) [2023-12-28 06:06:28,914][106225] Updated weights for policy 1, policy_version 1512810 (0.0006) [2023-12-28 06:06:28,978][106225] Updated weights for policy 1, policy_version 1512820 (0.0005) [2023-12-28 06:06:29,056][106226] Updated weights for policy 0, policy_version 1509118 (0.0010) [2023-12-28 06:06:29,102][106226] Updated weights for policy 0, policy_version 1509128 (0.0010) [2023-12-28 06:06:29,148][106226] Updated weights for policy 0, policy_version 1509138 (0.0010) [2023-12-28 06:06:29,562][106225] Updated weights for policy 1, policy_version 1512830 (0.0008) [2023-12-28 06:06:29,625][106225] Updated weights for policy 1, policy_version 1512840 (0.0011) [2023-12-28 06:06:29,690][106225] Updated weights for policy 1, policy_version 1512850 (0.0011) [2023-12-28 06:06:29,905][106226] Updated weights for policy 0, policy_version 1509148 (0.0009) [2023-12-28 06:06:29,977][106226] Updated weights for policy 0, policy_version 1509158 (0.0006) [2023-12-28 06:06:30,046][106226] Updated weights for policy 0, policy_version 1509168 (0.0006) [2023-12-28 06:06:30,443][106225] Updated weights for policy 1, policy_version 1512860 (0.0011) [2023-12-28 06:06:30,499][106225] Updated weights for policy 1, policy_version 1512870 (0.0006) [2023-12-28 06:06:30,562][106225] Updated weights for policy 1, policy_version 1512880 (0.0005) [2023-12-28 06:06:30,721][106226] Updated weights for policy 0, policy_version 1509178 (0.0007) [2023-12-28 06:06:30,770][106226] Updated weights for policy 0, policy_version 1509188 (0.0007) [2023-12-28 06:06:30,817][106226] Updated weights for policy 0, policy_version 1509198 (0.0008) [2023-12-28 06:06:30,864][106226] Updated weights for policy 0, policy_version 1509208 (0.0008) [2023-12-28 06:06:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 773783552. Throughput: 0: 9899.8, 1: 9889.7. Samples: 773773992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:31,175][105115] Avg episode reward: [(0, '-4.856'), (1, '-4.609')] [2023-12-28 06:06:31,226][106225] Updated weights for policy 1, policy_version 1512890 (0.0008) [2023-12-28 06:06:31,285][106225] Updated weights for policy 1, policy_version 1512900 (0.0008) [2023-12-28 06:06:31,345][106225] Updated weights for policy 1, policy_version 1512910 (0.0008) [2023-12-28 06:06:31,409][106225] Updated weights for policy 1, policy_version 1512920 (0.0008) [2023-12-28 06:06:31,658][106226] Updated weights for policy 0, policy_version 1509218 (0.0007) [2023-12-28 06:06:31,721][106226] Updated weights for policy 0, policy_version 1509228 (0.0008) [2023-12-28 06:06:31,796][106226] Updated weights for policy 0, policy_version 1509238 (0.0012) [2023-12-28 06:06:32,131][106225] Updated weights for policy 1, policy_version 1512930 (0.0010) [2023-12-28 06:06:32,181][106225] Updated weights for policy 1, policy_version 1512940 (0.0009) [2023-12-28 06:06:32,232][106225] Updated weights for policy 1, policy_version 1512950 (0.0005) [2023-12-28 06:06:32,570][106226] Updated weights for policy 0, policy_version 1509248 (0.0006) [2023-12-28 06:06:32,638][106226] Updated weights for policy 0, policy_version 1509258 (0.0007) [2023-12-28 06:06:32,712][106226] Updated weights for policy 0, policy_version 1509268 (0.0005) [2023-12-28 06:06:32,867][106225] Updated weights for policy 1, policy_version 1512960 (0.0009) [2023-12-28 06:06:32,916][106225] Updated weights for policy 1, policy_version 1512970 (0.0010) [2023-12-28 06:06:32,972][106225] Updated weights for policy 1, policy_version 1512980 (0.0010) [2023-12-28 06:06:33,313][106226] Updated weights for policy 0, policy_version 1509278 (0.0006) [2023-12-28 06:06:33,379][106226] Updated weights for policy 0, policy_version 1509288 (0.0005) [2023-12-28 06:06:33,429][106226] Updated weights for policy 0, policy_version 1509298 (0.0010) [2023-12-28 06:06:33,663][106225] Updated weights for policy 1, policy_version 1512990 (0.0008) [2023-12-28 06:06:33,707][106225] Updated weights for policy 1, policy_version 1513000 (0.0005) [2023-12-28 06:06:33,760][106225] Updated weights for policy 1, policy_version 1513010 (0.0005) [2023-12-28 06:06:34,080][106226] Updated weights for policy 0, policy_version 1509308 (0.0010) [2023-12-28 06:06:34,141][106226] Updated weights for policy 0, policy_version 1509318 (0.0010) [2023-12-28 06:06:34,207][106226] Updated weights for policy 0, policy_version 1509328 (0.0008) [2023-12-28 06:06:34,349][106225] Updated weights for policy 1, policy_version 1513020 (0.0007) [2023-12-28 06:06:34,407][106225] Updated weights for policy 1, policy_version 1513030 (0.0006) [2023-12-28 06:06:34,464][106225] Updated weights for policy 1, policy_version 1513040 (0.0007) [2023-12-28 06:06:34,971][106226] Updated weights for policy 0, policy_version 1509338 (0.0008) [2023-12-28 06:06:35,030][106226] Updated weights for policy 0, policy_version 1509348 (0.0009) [2023-12-28 06:06:35,076][106225] Updated weights for policy 1, policy_version 1513050 (0.0008) [2023-12-28 06:06:35,093][106226] Updated weights for policy 0, policy_version 1509358 (0.0007) [2023-12-28 06:06:35,132][106225] Updated weights for policy 1, policy_version 1513060 (0.0006) [2023-12-28 06:06:35,151][106226] Updated weights for policy 0, policy_version 1509368 (0.0008) [2023-12-28 06:06:35,188][106225] Updated weights for policy 1, policy_version 1513070 (0.0007) [2023-12-28 06:06:35,247][106225] Updated weights for policy 1, policy_version 1513080 (0.0009) [2023-12-28 06:06:35,793][106225] Updated weights for policy 1, policy_version 1513090 (0.0005) [2023-12-28 06:06:35,850][106225] Updated weights for policy 1, policy_version 1513100 (0.0008) [2023-12-28 06:06:35,910][106225] Updated weights for policy 1, policy_version 1513110 (0.0010) [2023-12-28 06:06:35,961][106226] Updated weights for policy 0, policy_version 1509378 (0.0008) [2023-12-28 06:06:36,016][106226] Updated weights for policy 0, policy_version 1509388 (0.0009) [2023-12-28 06:06:36,066][106226] Updated weights for policy 0, policy_version 1509398 (0.0009) [2023-12-28 06:06:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 773890048. Throughput: 0: 9862.9, 1: 9974.6. Samples: 773894408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:36,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.533')] [2023-12-28 06:06:36,575][106225] Updated weights for policy 1, policy_version 1513120 (0.0010) [2023-12-28 06:06:36,636][106225] Updated weights for policy 1, policy_version 1513130 (0.0010) [2023-12-28 06:06:36,703][106225] Updated weights for policy 1, policy_version 1513140 (0.0011) [2023-12-28 06:06:36,846][106226] Updated weights for policy 0, policy_version 1509408 (0.0007) [2023-12-28 06:06:36,909][106226] Updated weights for policy 0, policy_version 1509418 (0.0008) [2023-12-28 06:06:36,974][106226] Updated weights for policy 0, policy_version 1509428 (0.0008) [2023-12-28 06:06:37,427][106225] Updated weights for policy 1, policy_version 1513150 (0.0010) [2023-12-28 06:06:37,477][106225] Updated weights for policy 1, policy_version 1513160 (0.0010) [2023-12-28 06:06:37,525][106225] Updated weights for policy 1, policy_version 1513170 (0.0010) [2023-12-28 06:06:37,647][106226] Updated weights for policy 0, policy_version 1509438 (0.0008) [2023-12-28 06:06:37,706][106226] Updated weights for policy 0, policy_version 1509448 (0.0008) [2023-12-28 06:06:37,757][106226] Updated weights for policy 0, policy_version 1509458 (0.0008) [2023-12-28 06:06:38,267][106225] Updated weights for policy 1, policy_version 1513180 (0.0010) [2023-12-28 06:06:38,325][106225] Updated weights for policy 1, policy_version 1513190 (0.0010) [2023-12-28 06:06:38,396][106225] Updated weights for policy 1, policy_version 1513200 (0.0007) [2023-12-28 06:06:38,444][106226] Updated weights for policy 0, policy_version 1509468 (0.0006) [2023-12-28 06:06:38,515][106226] Updated weights for policy 0, policy_version 1509478 (0.0006) [2023-12-28 06:06:38,579][106226] Updated weights for policy 0, policy_version 1509488 (0.0008) [2023-12-28 06:06:39,020][106225] Updated weights for policy 1, policy_version 1513210 (0.0009) [2023-12-28 06:06:39,070][106225] Updated weights for policy 1, policy_version 1513220 (0.0007) [2023-12-28 06:06:39,125][106225] Updated weights for policy 1, policy_version 1513230 (0.0005) [2023-12-28 06:06:39,188][106225] Updated weights for policy 1, policy_version 1513240 (0.0005) [2023-12-28 06:06:39,309][106226] Updated weights for policy 0, policy_version 1509498 (0.0008) [2023-12-28 06:06:39,387][106226] Updated weights for policy 0, policy_version 1509508 (0.0008) [2023-12-28 06:06:39,454][106226] Updated weights for policy 0, policy_version 1509518 (0.0008) [2023-12-28 06:06:39,516][106226] Updated weights for policy 0, policy_version 1509528 (0.0008) [2023-12-28 06:06:39,978][106225] Updated weights for policy 1, policy_version 1513250 (0.0010) [2023-12-28 06:06:40,037][106225] Updated weights for policy 1, policy_version 1513260 (0.0011) [2023-12-28 06:06:40,092][106225] Updated weights for policy 1, policy_version 1513270 (0.0010) [2023-12-28 06:06:40,243][106226] Updated weights for policy 0, policy_version 1509538 (0.0008) [2023-12-28 06:06:40,308][106226] Updated weights for policy 0, policy_version 1509548 (0.0008) [2023-12-28 06:06:40,369][106226] Updated weights for policy 0, policy_version 1509558 (0.0008) [2023-12-28 06:06:40,802][106225] Updated weights for policy 1, policy_version 1513280 (0.0006) [2023-12-28 06:06:40,853][106225] Updated weights for policy 1, policy_version 1513290 (0.0005) [2023-12-28 06:06:40,902][106225] Updated weights for policy 1, policy_version 1513300 (0.0005) [2023-12-28 06:06:41,170][106226] Updated weights for policy 0, policy_version 1509568 (0.0008) [2023-12-28 06:06:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 773980160. Throughput: 0: 9882.2, 1: 9967.3. Samples: 773953364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:41,175][105115] Avg episode reward: [(0, '-4.867'), (1, '-4.788')] [2023-12-28 06:06:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001513304_387457024.pth... [2023-12-28 06:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001512120_387153920.pth [2023-12-28 06:06:41,231][106226] Updated weights for policy 0, policy_version 1509578 (0.0008) [2023-12-28 06:06:41,303][106226] Updated weights for policy 0, policy_version 1509588 (0.0007) [2023-12-28 06:06:41,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001509592_386531328.pth... [2023-12-28 06:06:41,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001508408_386228224.pth [2023-12-28 06:06:41,620][106225] Updated weights for policy 1, policy_version 1513310 (0.0008) [2023-12-28 06:06:41,684][106225] Updated weights for policy 1, policy_version 1513320 (0.0009) [2023-12-28 06:06:41,752][106225] Updated weights for policy 1, policy_version 1513330 (0.0008) [2023-12-28 06:06:42,016][106226] Updated weights for policy 0, policy_version 1509598 (0.0007) [2023-12-28 06:06:42,076][106226] Updated weights for policy 0, policy_version 1509608 (0.0008) [2023-12-28 06:06:42,139][106226] Updated weights for policy 0, policy_version 1509618 (0.0009) [2023-12-28 06:06:42,442][106225] Updated weights for policy 1, policy_version 1513340 (0.0010) [2023-12-28 06:06:42,530][106225] Updated weights for policy 1, policy_version 1513350 (0.0009) [2023-12-28 06:06:42,602][106225] Updated weights for policy 1, policy_version 1513360 (0.0011) [2023-12-28 06:06:42,893][106226] Updated weights for policy 0, policy_version 1509628 (0.0008) [2023-12-28 06:06:42,952][106226] Updated weights for policy 0, policy_version 1509638 (0.0011) [2023-12-28 06:06:43,008][106226] Updated weights for policy 0, policy_version 1509648 (0.0007) [2023-12-28 06:06:43,290][106225] Updated weights for policy 1, policy_version 1513370 (0.0011) [2023-12-28 06:06:43,343][106225] Updated weights for policy 1, policy_version 1513380 (0.0010) [2023-12-28 06:06:43,399][106225] Updated weights for policy 1, policy_version 1513390 (0.0010) [2023-12-28 06:06:43,446][106225] Updated weights for policy 1, policy_version 1513400 (0.0010) [2023-12-28 06:06:43,616][106226] Updated weights for policy 0, policy_version 1509658 (0.0005) [2023-12-28 06:06:43,662][106226] Updated weights for policy 0, policy_version 1509668 (0.0005) [2023-12-28 06:06:43,720][106226] Updated weights for policy 0, policy_version 1509678 (0.0006) [2023-12-28 06:06:43,774][106226] Updated weights for policy 0, policy_version 1509688 (0.0009) [2023-12-28 06:06:44,132][106225] Updated weights for policy 1, policy_version 1513410 (0.0008) [2023-12-28 06:06:44,190][106225] Updated weights for policy 1, policy_version 1513420 (0.0010) [2023-12-28 06:06:44,248][106225] Updated weights for policy 1, policy_version 1513430 (0.0010) [2023-12-28 06:06:44,457][106226] Updated weights for policy 0, policy_version 1509698 (0.0010) [2023-12-28 06:06:44,522][106226] Updated weights for policy 0, policy_version 1509708 (0.0011) [2023-12-28 06:06:44,584][106226] Updated weights for policy 0, policy_version 1509718 (0.0011) [2023-12-28 06:06:44,958][106225] Updated weights for policy 1, policy_version 1513440 (0.0010) [2023-12-28 06:06:45,021][106225] Updated weights for policy 1, policy_version 1513450 (0.0011) [2023-12-28 06:06:45,086][106225] Updated weights for policy 1, policy_version 1513460 (0.0011) [2023-12-28 06:06:45,336][106226] Updated weights for policy 0, policy_version 1509728 (0.0008) [2023-12-28 06:06:45,398][106226] Updated weights for policy 0, policy_version 1509738 (0.0008) [2023-12-28 06:06:45,461][106226] Updated weights for policy 0, policy_version 1509748 (0.0009) [2023-12-28 06:06:45,809][106225] Updated weights for policy 1, policy_version 1513470 (0.0009) [2023-12-28 06:06:45,869][106225] Updated weights for policy 1, policy_version 1513480 (0.0009) [2023-12-28 06:06:45,925][106225] Updated weights for policy 1, policy_version 1513490 (0.0009) [2023-12-28 06:06:46,068][106226] Updated weights for policy 0, policy_version 1509758 (0.0008) [2023-12-28 06:06:46,123][106226] Updated weights for policy 0, policy_version 1509768 (0.0008) [2023-12-28 06:06:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 774078464. Throughput: 0: 9814.0, 1: 9958.0. Samples: 774069412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:46,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.705')] [2023-12-28 06:06:46,193][106226] Updated weights for policy 0, policy_version 1509778 (0.0006) [2023-12-28 06:06:46,579][106225] Updated weights for policy 1, policy_version 1513500 (0.0008) [2023-12-28 06:06:46,627][106225] Updated weights for policy 1, policy_version 1513510 (0.0005) [2023-12-28 06:06:46,678][106225] Updated weights for policy 1, policy_version 1513520 (0.0005) [2023-12-28 06:06:46,914][106226] Updated weights for policy 0, policy_version 1509788 (0.0007) [2023-12-28 06:06:46,967][106226] Updated weights for policy 0, policy_version 1509798 (0.0005) [2023-12-28 06:06:47,025][106226] Updated weights for policy 0, policy_version 1509808 (0.0005) [2023-12-28 06:06:47,389][106225] Updated weights for policy 1, policy_version 1513530 (0.0007) [2023-12-28 06:06:47,444][106225] Updated weights for policy 1, policy_version 1513540 (0.0008) [2023-12-28 06:06:47,499][106225] Updated weights for policy 1, policy_version 1513550 (0.0008) [2023-12-28 06:06:47,557][106225] Updated weights for policy 1, policy_version 1513560 (0.0008) [2023-12-28 06:06:47,689][106226] Updated weights for policy 0, policy_version 1509818 (0.0008) [2023-12-28 06:06:47,747][106226] Updated weights for policy 0, policy_version 1509828 (0.0009) [2023-12-28 06:06:47,793][106226] Updated weights for policy 0, policy_version 1509838 (0.0008) [2023-12-28 06:06:47,846][106226] Updated weights for policy 0, policy_version 1509848 (0.0009) [2023-12-28 06:06:48,260][106225] Updated weights for policy 1, policy_version 1513570 (0.0005) [2023-12-28 06:06:48,321][106225] Updated weights for policy 1, policy_version 1513580 (0.0006) [2023-12-28 06:06:48,388][106225] Updated weights for policy 1, policy_version 1513591 (0.0009) [2023-12-28 06:06:48,614][106226] Updated weights for policy 0, policy_version 1509858 (0.0006) [2023-12-28 06:06:48,678][106226] Updated weights for policy 0, policy_version 1509868 (0.0006) [2023-12-28 06:06:48,741][106226] Updated weights for policy 0, policy_version 1509878 (0.0006) [2023-12-28 06:06:49,099][106225] Updated weights for policy 1, policy_version 1513601 (0.0010) [2023-12-28 06:06:49,155][106225] Updated weights for policy 1, policy_version 1513611 (0.0010) [2023-12-28 06:06:49,216][106225] Updated weights for policy 1, policy_version 1513621 (0.0010) [2023-12-28 06:06:49,385][106226] Updated weights for policy 0, policy_version 1509888 (0.0008) [2023-12-28 06:06:49,447][106226] Updated weights for policy 0, policy_version 1509898 (0.0008) [2023-12-28 06:06:49,505][106226] Updated weights for policy 0, policy_version 1509908 (0.0008) [2023-12-28 06:06:49,946][106225] Updated weights for policy 1, policy_version 1513631 (0.0009) [2023-12-28 06:06:50,000][106225] Updated weights for policy 1, policy_version 1513641 (0.0010) [2023-12-28 06:06:50,061][106225] Updated weights for policy 1, policy_version 1513651 (0.0010) [2023-12-28 06:06:50,234][106226] Updated weights for policy 0, policy_version 1509918 (0.0005) [2023-12-28 06:06:50,302][106226] Updated weights for policy 0, policy_version 1509928 (0.0008) [2023-12-28 06:06:50,363][106226] Updated weights for policy 0, policy_version 1509938 (0.0009) [2023-12-28 06:06:50,796][106225] Updated weights for policy 1, policy_version 1513661 (0.0008) [2023-12-28 06:06:50,862][106225] Updated weights for policy 1, policy_version 1513671 (0.0008) [2023-12-28 06:06:50,925][106225] Updated weights for policy 1, policy_version 1513681 (0.0007) [2023-12-28 06:06:51,151][106226] Updated weights for policy 0, policy_version 1509948 (0.0009) [2023-12-28 06:06:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 774176768. Throughput: 0: 9855.1, 1: 9937.0. Samples: 774187228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:51,175][105115] Avg episode reward: [(0, '-4.868'), (1, '-4.685')] [2023-12-28 06:06:51,209][106226] Updated weights for policy 0, policy_version 1509958 (0.0006) [2023-12-28 06:06:51,268][106226] Updated weights for policy 0, policy_version 1509968 (0.0007) [2023-12-28 06:06:51,562][106225] Updated weights for policy 1, policy_version 1513691 (0.0006) [2023-12-28 06:06:51,629][106225] Updated weights for policy 1, policy_version 1513701 (0.0007) [2023-12-28 06:06:51,693][106225] Updated weights for policy 1, policy_version 1513711 (0.0006) [2023-12-28 06:06:51,935][106226] Updated weights for policy 0, policy_version 1509978 (0.0007) [2023-12-28 06:06:52,004][106226] Updated weights for policy 0, policy_version 1509988 (0.0009) [2023-12-28 06:06:52,067][106226] Updated weights for policy 0, policy_version 1509998 (0.0006) [2023-12-28 06:06:52,122][106226] Updated weights for policy 0, policy_version 1510008 (0.0008) [2023-12-28 06:06:52,353][106225] Updated weights for policy 1, policy_version 1513721 (0.0009) [2023-12-28 06:06:52,419][106225] Updated weights for policy 1, policy_version 1513731 (0.0008) [2023-12-28 06:06:52,481][106225] Updated weights for policy 1, policy_version 1513741 (0.0009) [2023-12-28 06:06:52,538][106225] Updated weights for policy 1, policy_version 1513751 (0.0009) [2023-12-28 06:06:52,854][106226] Updated weights for policy 0, policy_version 1510018 (0.0009) [2023-12-28 06:06:52,922][106226] Updated weights for policy 0, policy_version 1510028 (0.0006) [2023-12-28 06:06:52,988][106226] Updated weights for policy 0, policy_version 1510038 (0.0005) [2023-12-28 06:06:53,280][106225] Updated weights for policy 1, policy_version 1513761 (0.0007) [2023-12-28 06:06:53,335][106225] Updated weights for policy 1, policy_version 1513771 (0.0008) [2023-12-28 06:06:53,389][106225] Updated weights for policy 1, policy_version 1513781 (0.0008) [2023-12-28 06:06:53,651][106226] Updated weights for policy 0, policy_version 1510048 (0.0009) [2023-12-28 06:06:53,712][106226] Updated weights for policy 0, policy_version 1510058 (0.0008) [2023-12-28 06:06:53,775][106226] Updated weights for policy 0, policy_version 1510068 (0.0009) [2023-12-28 06:06:54,096][106225] Updated weights for policy 1, policy_version 1513791 (0.0007) [2023-12-28 06:06:54,159][106225] Updated weights for policy 1, policy_version 1513801 (0.0008) [2023-12-28 06:06:54,213][106225] Updated weights for policy 1, policy_version 1513811 (0.0007) [2023-12-28 06:06:54,556][106226] Updated weights for policy 0, policy_version 1510078 (0.0009) [2023-12-28 06:06:54,615][106226] Updated weights for policy 0, policy_version 1510088 (0.0009) [2023-12-28 06:06:54,676][106226] Updated weights for policy 0, policy_version 1510098 (0.0008) [2023-12-28 06:06:54,893][106225] Updated weights for policy 1, policy_version 1513821 (0.0007) [2023-12-28 06:06:54,952][106225] Updated weights for policy 1, policy_version 1513831 (0.0008) [2023-12-28 06:06:55,010][106225] Updated weights for policy 1, policy_version 1513841 (0.0009) [2023-12-28 06:06:55,302][106226] Updated weights for policy 0, policy_version 1510108 (0.0008) [2023-12-28 06:06:55,354][106226] Updated weights for policy 0, policy_version 1510118 (0.0007) [2023-12-28 06:06:55,412][106226] Updated weights for policy 0, policy_version 1510128 (0.0005) [2023-12-28 06:06:55,733][106225] Updated weights for policy 1, policy_version 1513851 (0.0007) [2023-12-28 06:06:55,796][106225] Updated weights for policy 1, policy_version 1513861 (0.0007) [2023-12-28 06:06:55,848][106225] Updated weights for policy 1, policy_version 1513871 (0.0009) [2023-12-28 06:06:56,138][106226] Updated weights for policy 0, policy_version 1510138 (0.0007) [2023-12-28 06:06:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 774275072. Throughput: 0: 9844.6, 1: 9922.0. Samples: 774245416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:06:56,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.877')] [2023-12-28 06:06:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001513880_387604480.pth... [2023-12-28 06:06:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001512696_387301376.pth [2023-12-28 06:06:56,195][106226] Updated weights for policy 0, policy_version 1510148 (0.0008) [2023-12-28 06:06:56,249][106226] Updated weights for policy 0, policy_version 1510158 (0.0008) [2023-12-28 06:06:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001510168_386678784.pth... [2023-12-28 06:06:56,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001509016_386383872.pth [2023-12-28 06:06:56,297][106226] Updated weights for policy 0, policy_version 1510168 (0.0009) [2023-12-28 06:06:56,480][106225] Updated weights for policy 1, policy_version 1513881 (0.0008) [2023-12-28 06:06:56,534][106225] Updated weights for policy 1, policy_version 1513891 (0.0005) [2023-12-28 06:06:56,585][106225] Updated weights for policy 1, policy_version 1513901 (0.0005) [2023-12-28 06:06:56,637][106225] Updated weights for policy 1, policy_version 1513911 (0.0005) [2023-12-28 06:06:57,093][106226] Updated weights for policy 0, policy_version 1510178 (0.0007) [2023-12-28 06:06:57,154][106226] Updated weights for policy 0, policy_version 1510188 (0.0005) [2023-12-28 06:06:57,209][106226] Updated weights for policy 0, policy_version 1510198 (0.0005) [2023-12-28 06:06:57,248][106225] Updated weights for policy 1, policy_version 1513921 (0.0006) [2023-12-28 06:06:57,303][106225] Updated weights for policy 1, policy_version 1513931 (0.0007) [2023-12-28 06:06:57,366][106225] Updated weights for policy 1, policy_version 1513941 (0.0008) [2023-12-28 06:06:57,748][106226] Updated weights for policy 0, policy_version 1510208 (0.0007) [2023-12-28 06:06:57,805][106226] Updated weights for policy 0, policy_version 1510218 (0.0009) [2023-12-28 06:06:57,853][106226] Updated weights for policy 0, policy_version 1510228 (0.0008) [2023-12-28 06:06:57,989][106225] Updated weights for policy 1, policy_version 1513951 (0.0007) [2023-12-28 06:06:58,048][106225] Updated weights for policy 1, policy_version 1513961 (0.0005) [2023-12-28 06:06:58,110][106225] Updated weights for policy 1, policy_version 1513971 (0.0005) [2023-12-28 06:06:58,617][106226] Updated weights for policy 0, policy_version 1510238 (0.0009) [2023-12-28 06:06:58,681][106226] Updated weights for policy 0, policy_version 1510248 (0.0008) [2023-12-28 06:06:58,742][106226] Updated weights for policy 0, policy_version 1510258 (0.0008) [2023-12-28 06:06:58,798][106225] Updated weights for policy 1, policy_version 1513981 (0.0008) [2023-12-28 06:06:58,866][106225] Updated weights for policy 1, policy_version 1513991 (0.0010) [2023-12-28 06:06:58,943][106225] Updated weights for policy 1, policy_version 1514001 (0.0008) [2023-12-28 06:06:59,524][106226] Updated weights for policy 0, policy_version 1510268 (0.0007) [2023-12-28 06:06:59,592][106226] Updated weights for policy 0, policy_version 1510278 (0.0006) [2023-12-28 06:06:59,651][106226] Updated weights for policy 0, policy_version 1510288 (0.0008) [2023-12-28 06:06:59,779][106225] Updated weights for policy 1, policy_version 1514011 (0.0008) [2023-12-28 06:06:59,848][106225] Updated weights for policy 1, policy_version 1514021 (0.0007) [2023-12-28 06:06:59,910][106225] Updated weights for policy 1, policy_version 1514031 (0.0007) [2023-12-28 06:07:00,346][106226] Updated weights for policy 0, policy_version 1510298 (0.0008) [2023-12-28 06:07:00,403][106226] Updated weights for policy 0, policy_version 1510308 (0.0006) [2023-12-28 06:07:00,452][106226] Updated weights for policy 0, policy_version 1510318 (0.0005) [2023-12-28 06:07:00,504][106226] Updated weights for policy 0, policy_version 1510328 (0.0005) [2023-12-28 06:07:00,625][106225] Updated weights for policy 1, policy_version 1514041 (0.0007) [2023-12-28 06:07:00,675][106225] Updated weights for policy 1, policy_version 1514051 (0.0010) [2023-12-28 06:07:00,725][106225] Updated weights for policy 1, policy_version 1514061 (0.0009) [2023-12-28 06:07:00,791][106225] Updated weights for policy 1, policy_version 1514071 (0.0010) [2023-12-28 06:07:01,054][106226] Updated weights for policy 0, policy_version 1510338 (0.0008) [2023-12-28 06:07:01,112][106226] Updated weights for policy 0, policy_version 1510348 (0.0008) [2023-12-28 06:07:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 774373376. Throughput: 0: 9863.8, 1: 10033.1. Samples: 774364728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:01,175][105115] Avg episode reward: [(0, '-4.482'), (1, '-4.692')] [2023-12-28 06:07:01,179][106226] Updated weights for policy 0, policy_version 1510358 (0.0008) [2023-12-28 06:07:01,628][106225] Updated weights for policy 1, policy_version 1514081 (0.0008) [2023-12-28 06:07:01,693][106225] Updated weights for policy 1, policy_version 1514091 (0.0008) [2023-12-28 06:07:01,770][106225] Updated weights for policy 1, policy_version 1514101 (0.0009) [2023-12-28 06:07:01,880][106226] Updated weights for policy 0, policy_version 1510368 (0.0006) [2023-12-28 06:07:01,940][106226] Updated weights for policy 0, policy_version 1510378 (0.0008) [2023-12-28 06:07:01,992][106226] Updated weights for policy 0, policy_version 1510388 (0.0008) [2023-12-28 06:07:02,524][106225] Updated weights for policy 1, policy_version 1514111 (0.0009) [2023-12-28 06:07:02,578][106225] Updated weights for policy 1, policy_version 1514121 (0.0009) [2023-12-28 06:07:02,633][106225] Updated weights for policy 1, policy_version 1514131 (0.0008) [2023-12-28 06:07:02,680][106226] Updated weights for policy 0, policy_version 1510398 (0.0007) [2023-12-28 06:07:02,736][106226] Updated weights for policy 0, policy_version 1510408 (0.0007) [2023-12-28 06:07:02,796][106226] Updated weights for policy 0, policy_version 1510418 (0.0007) [2023-12-28 06:07:03,293][106225] Updated weights for policy 1, policy_version 1514141 (0.0007) [2023-12-28 06:07:03,342][106225] Updated weights for policy 1, policy_version 1514151 (0.0008) [2023-12-28 06:07:03,404][106225] Updated weights for policy 1, policy_version 1514161 (0.0009) [2023-12-28 06:07:03,417][106226] Updated weights for policy 0, policy_version 1510428 (0.0007) [2023-12-28 06:07:03,470][106226] Updated weights for policy 0, policy_version 1510438 (0.0010) [2023-12-28 06:07:03,527][106226] Updated weights for policy 0, policy_version 1510448 (0.0010) [2023-12-28 06:07:04,094][106225] Updated weights for policy 1, policy_version 1514171 (0.0006) [2023-12-28 06:07:04,151][106225] Updated weights for policy 1, policy_version 1514181 (0.0008) [2023-12-28 06:07:04,180][106226] Updated weights for policy 0, policy_version 1510458 (0.0010) [2023-12-28 06:07:04,215][106225] Updated weights for policy 1, policy_version 1514191 (0.0007) [2023-12-28 06:07:04,241][106226] Updated weights for policy 0, policy_version 1510468 (0.0009) [2023-12-28 06:07:04,302][106226] Updated weights for policy 0, policy_version 1510478 (0.0008) [2023-12-28 06:07:04,362][106226] Updated weights for policy 0, policy_version 1510488 (0.0009) [2023-12-28 06:07:04,933][106225] Updated weights for policy 1, policy_version 1514201 (0.0007) [2023-12-28 06:07:04,992][106225] Updated weights for policy 1, policy_version 1514211 (0.0008) [2023-12-28 06:07:05,041][106225] Updated weights for policy 1, policy_version 1514221 (0.0008) [2023-12-28 06:07:05,085][106226] Updated weights for policy 0, policy_version 1510498 (0.0005) [2023-12-28 06:07:05,090][106225] Updated weights for policy 1, policy_version 1514231 (0.0008) [2023-12-28 06:07:05,142][106226] Updated weights for policy 0, policy_version 1510508 (0.0005) [2023-12-28 06:07:05,201][106226] Updated weights for policy 0, policy_version 1510518 (0.0005) [2023-12-28 06:07:05,738][106226] Updated weights for policy 0, policy_version 1510528 (0.0005) [2023-12-28 06:07:05,805][106226] Updated weights for policy 0, policy_version 1510538 (0.0006) [2023-12-28 06:07:05,874][106226] Updated weights for policy 0, policy_version 1510548 (0.0006) [2023-12-28 06:07:05,881][106225] Updated weights for policy 1, policy_version 1514241 (0.0006) [2023-12-28 06:07:05,939][106225] Updated weights for policy 1, policy_version 1514251 (0.0007) [2023-12-28 06:07:06,002][106225] Updated weights for policy 1, policy_version 1514261 (0.0006) [2023-12-28 06:07:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 774479872. Throughput: 0: 9851.7, 1: 10054.6. Samples: 774485240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:06,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.814')] [2023-12-28 06:07:06,479][106226] Updated weights for policy 0, policy_version 1510558 (0.0006) [2023-12-28 06:07:06,553][106226] Updated weights for policy 0, policy_version 1510568 (0.0006) [2023-12-28 06:07:06,626][106226] Updated weights for policy 0, policy_version 1510578 (0.0006) [2023-12-28 06:07:06,666][106225] Updated weights for policy 1, policy_version 1514271 (0.0007) [2023-12-28 06:07:06,719][106225] Updated weights for policy 1, policy_version 1514281 (0.0006) [2023-12-28 06:07:06,786][106225] Updated weights for policy 1, policy_version 1514291 (0.0007) [2023-12-28 06:07:07,173][106226] Updated weights for policy 0, policy_version 1510588 (0.0008) [2023-12-28 06:07:07,236][106226] Updated weights for policy 0, policy_version 1510598 (0.0005) [2023-12-28 06:07:07,293][106226] Updated weights for policy 0, policy_version 1510608 (0.0005) [2023-12-28 06:07:07,470][106225] Updated weights for policy 1, policy_version 1514301 (0.0010) [2023-12-28 06:07:07,527][106225] Updated weights for policy 1, policy_version 1514311 (0.0010) [2023-12-28 06:07:07,576][106225] Updated weights for policy 1, policy_version 1514321 (0.0009) [2023-12-28 06:07:07,870][106226] Updated weights for policy 0, policy_version 1510618 (0.0008) [2023-12-28 06:07:07,932][106226] Updated weights for policy 0, policy_version 1510628 (0.0011) [2023-12-28 06:07:07,981][106226] Updated weights for policy 0, policy_version 1510638 (0.0010) [2023-12-28 06:07:08,040][106226] Updated weights for policy 0, policy_version 1510648 (0.0011) [2023-12-28 06:07:08,222][106225] Updated weights for policy 1, policy_version 1514331 (0.0005) [2023-12-28 06:07:08,284][106225] Updated weights for policy 1, policy_version 1514341 (0.0005) [2023-12-28 06:07:08,351][106225] Updated weights for policy 1, policy_version 1514351 (0.0007) [2023-12-28 06:07:08,823][106226] Updated weights for policy 0, policy_version 1510658 (0.0009) [2023-12-28 06:07:08,889][106226] Updated weights for policy 0, policy_version 1510668 (0.0010) [2023-12-28 06:07:08,894][106225] Updated weights for policy 1, policy_version 1514361 (0.0010) [2023-12-28 06:07:08,954][106226] Updated weights for policy 0, policy_version 1510678 (0.0007) [2023-12-28 06:07:08,956][106225] Updated weights for policy 1, policy_version 1514371 (0.0010) [2023-12-28 06:07:09,011][106225] Updated weights for policy 1, policy_version 1514381 (0.0010) [2023-12-28 06:07:09,078][106225] Updated weights for policy 1, policy_version 1514391 (0.0007) [2023-12-28 06:07:09,635][106226] Updated weights for policy 0, policy_version 1510688 (0.0010) [2023-12-28 06:07:09,690][106226] Updated weights for policy 0, policy_version 1510698 (0.0011) [2023-12-28 06:07:09,742][106226] Updated weights for policy 0, policy_version 1510708 (0.0011) [2023-12-28 06:07:09,792][106225] Updated weights for policy 1, policy_version 1514401 (0.0010) [2023-12-28 06:07:09,861][106225] Updated weights for policy 1, policy_version 1514411 (0.0011) [2023-12-28 06:07:09,921][106225] Updated weights for policy 1, policy_version 1514421 (0.0010) [2023-12-28 06:07:10,452][106226] Updated weights for policy 0, policy_version 1510718 (0.0010) [2023-12-28 06:07:10,521][106226] Updated weights for policy 0, policy_version 1510728 (0.0006) [2023-12-28 06:07:10,589][106226] Updated weights for policy 0, policy_version 1510738 (0.0005) [2023-12-28 06:07:10,666][106225] Updated weights for policy 1, policy_version 1514431 (0.0009) [2023-12-28 06:07:10,716][106225] Updated weights for policy 1, policy_version 1514441 (0.0009) [2023-12-28 06:07:10,768][106225] Updated weights for policy 1, policy_version 1514451 (0.0008) [2023-12-28 06:07:11,153][106226] Updated weights for policy 0, policy_version 1510748 (0.0008) [2023-12-28 06:07:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 774578176. Throughput: 0: 9933.2, 1: 10121.4. Samples: 774548600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:11,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-5.081')] [2023-12-28 06:07:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001514456_387751936.pth... [2023-12-28 06:07:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001513304_387457024.pth [2023-12-28 06:07:11,217][106226] Updated weights for policy 0, policy_version 1510758 (0.0009) [2023-12-28 06:07:11,285][106226] Updated weights for policy 0, policy_version 1510768 (0.0009) [2023-12-28 06:07:11,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001510776_386834432.pth... [2023-12-28 06:07:11,354][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001509592_386531328.pth [2023-12-28 06:07:11,520][106225] Updated weights for policy 1, policy_version 1514461 (0.0007) [2023-12-28 06:07:11,584][106225] Updated weights for policy 1, policy_version 1514471 (0.0009) [2023-12-28 06:07:11,667][106225] Updated weights for policy 1, policy_version 1514481 (0.0008) [2023-12-28 06:07:12,091][106226] Updated weights for policy 0, policy_version 1510778 (0.0010) [2023-12-28 06:07:12,153][106226] Updated weights for policy 0, policy_version 1510788 (0.0009) [2023-12-28 06:07:12,200][106226] Updated weights for policy 0, policy_version 1510798 (0.0008) [2023-12-28 06:07:12,257][106226] Updated weights for policy 0, policy_version 1510808 (0.0008) [2023-12-28 06:07:12,414][106225] Updated weights for policy 1, policy_version 1514491 (0.0007) [2023-12-28 06:07:12,476][106225] Updated weights for policy 1, policy_version 1514501 (0.0007) [2023-12-28 06:07:12,535][106225] Updated weights for policy 1, policy_version 1514511 (0.0009) [2023-12-28 06:07:13,057][106226] Updated weights for policy 0, policy_version 1510818 (0.0008) [2023-12-28 06:07:13,125][106226] Updated weights for policy 0, policy_version 1510828 (0.0006) [2023-12-28 06:07:13,195][106226] Updated weights for policy 0, policy_version 1510838 (0.0005) [2023-12-28 06:07:13,270][106225] Updated weights for policy 1, policy_version 1514521 (0.0008) [2023-12-28 06:07:13,332][106225] Updated weights for policy 1, policy_version 1514531 (0.0007) [2023-12-28 06:07:13,397][106225] Updated weights for policy 1, policy_version 1514541 (0.0009) [2023-12-28 06:07:13,455][106225] Updated weights for policy 1, policy_version 1514551 (0.0008) [2023-12-28 06:07:13,840][106226] Updated weights for policy 0, policy_version 1510848 (0.0008) [2023-12-28 06:07:13,895][106226] Updated weights for policy 0, policy_version 1510858 (0.0008) [2023-12-28 06:07:13,952][106226] Updated weights for policy 0, policy_version 1510868 (0.0009) [2023-12-28 06:07:14,088][106225] Updated weights for policy 1, policy_version 1514561 (0.0006) [2023-12-28 06:07:14,138][106225] Updated weights for policy 1, policy_version 1514571 (0.0008) [2023-12-28 06:07:14,192][106225] Updated weights for policy 1, policy_version 1514581 (0.0008) [2023-12-28 06:07:14,729][106226] Updated weights for policy 0, policy_version 1510878 (0.0008) [2023-12-28 06:07:14,797][106226] Updated weights for policy 0, policy_version 1510888 (0.0008) [2023-12-28 06:07:14,861][106226] Updated weights for policy 0, policy_version 1510898 (0.0011) [2023-12-28 06:07:14,910][106225] Updated weights for policy 1, policy_version 1514591 (0.0008) [2023-12-28 06:07:14,972][106225] Updated weights for policy 1, policy_version 1514601 (0.0008) [2023-12-28 06:07:15,029][106225] Updated weights for policy 1, policy_version 1514611 (0.0008) [2023-12-28 06:07:15,581][106226] Updated weights for policy 0, policy_version 1510908 (0.0007) [2023-12-28 06:07:15,653][106226] Updated weights for policy 0, policy_version 1510918 (0.0005) [2023-12-28 06:07:15,725][106226] Updated weights for policy 0, policy_version 1510928 (0.0010) [2023-12-28 06:07:15,740][106225] Updated weights for policy 1, policy_version 1514621 (0.0007) [2023-12-28 06:07:15,790][106225] Updated weights for policy 1, policy_version 1514631 (0.0008) [2023-12-28 06:07:15,844][106225] Updated weights for policy 1, policy_version 1514641 (0.0008) [2023-12-28 06:07:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 774676480. Throughput: 0: 9848.1, 1: 9934.3. Samples: 774664196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:16,175][105115] Avg episode reward: [(0, '-4.864'), (1, '-4.832')] [2023-12-28 06:07:16,272][106226] Updated weights for policy 0, policy_version 1510938 (0.0008) [2023-12-28 06:07:16,325][106226] Updated weights for policy 0, policy_version 1510948 (0.0008) [2023-12-28 06:07:16,378][106226] Updated weights for policy 0, policy_version 1510958 (0.0009) [2023-12-28 06:07:16,454][106226] Updated weights for policy 0, policy_version 1510968 (0.0011) [2023-12-28 06:07:16,536][106225] Updated weights for policy 1, policy_version 1514651 (0.0008) [2023-12-28 06:07:16,597][106225] Updated weights for policy 1, policy_version 1514661 (0.0008) [2023-12-28 06:07:16,660][106225] Updated weights for policy 1, policy_version 1514671 (0.0006) [2023-12-28 06:07:17,155][106226] Updated weights for policy 0, policy_version 1510978 (0.0010) [2023-12-28 06:07:17,228][106226] Updated weights for policy 0, policy_version 1510988 (0.0011) [2023-12-28 06:07:17,250][106225] Updated weights for policy 1, policy_version 1514681 (0.0005) [2023-12-28 06:07:17,288][106226] Updated weights for policy 0, policy_version 1510998 (0.0010) [2023-12-28 06:07:17,304][106225] Updated weights for policy 1, policy_version 1514691 (0.0006) [2023-12-28 06:07:17,357][106225] Updated weights for policy 1, policy_version 1514701 (0.0010) [2023-12-28 06:07:17,412][106225] Updated weights for policy 1, policy_version 1514711 (0.0005) [2023-12-28 06:07:17,963][106226] Updated weights for policy 0, policy_version 1511008 (0.0006) [2023-12-28 06:07:17,968][106225] Updated weights for policy 1, policy_version 1514721 (0.0010) [2023-12-28 06:07:18,024][106226] Updated weights for policy 0, policy_version 1511018 (0.0005) [2023-12-28 06:07:18,026][106225] Updated weights for policy 1, policy_version 1514731 (0.0010) [2023-12-28 06:07:18,083][106226] Updated weights for policy 0, policy_version 1511028 (0.0008) [2023-12-28 06:07:18,083][106225] Updated weights for policy 1, policy_version 1514741 (0.0010) [2023-12-28 06:07:18,759][106225] Updated weights for policy 1, policy_version 1514751 (0.0009) [2023-12-28 06:07:18,776][106226] Updated weights for policy 0, policy_version 1511038 (0.0009) [2023-12-28 06:07:18,820][106225] Updated weights for policy 1, policy_version 1514761 (0.0005) [2023-12-28 06:07:18,840][106226] Updated weights for policy 0, policy_version 1511048 (0.0008) [2023-12-28 06:07:18,884][106225] Updated weights for policy 1, policy_version 1514771 (0.0006) [2023-12-28 06:07:18,902][106226] Updated weights for policy 0, policy_version 1511058 (0.0006) [2023-12-28 06:07:19,607][106225] Updated weights for policy 1, policy_version 1514781 (0.0008) [2023-12-28 06:07:19,638][106226] Updated weights for policy 0, policy_version 1511068 (0.0009) [2023-12-28 06:07:19,664][106225] Updated weights for policy 1, policy_version 1514791 (0.0005) [2023-12-28 06:07:19,699][106226] Updated weights for policy 0, policy_version 1511078 (0.0011) [2023-12-28 06:07:19,719][106225] Updated weights for policy 1, policy_version 1514801 (0.0008) [2023-12-28 06:07:19,755][106226] Updated weights for policy 0, policy_version 1511088 (0.0011) [2023-12-28 06:07:20,431][106225] Updated weights for policy 1, policy_version 1514811 (0.0006) [2023-12-28 06:07:20,480][106225] Updated weights for policy 1, policy_version 1514821 (0.0008) [2023-12-28 06:07:20,530][106225] Updated weights for policy 1, policy_version 1514831 (0.0008) [2023-12-28 06:07:20,570][106226] Updated weights for policy 0, policy_version 1511098 (0.0010) [2023-12-28 06:07:20,631][106226] Updated weights for policy 0, policy_version 1511108 (0.0009) [2023-12-28 06:07:20,684][106226] Updated weights for policy 0, policy_version 1511118 (0.0008) [2023-12-28 06:07:20,744][106226] Updated weights for policy 0, policy_version 1511128 (0.0009) [2023-12-28 06:07:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 774774784. Throughput: 0: 9899.0, 1: 9884.5. Samples: 774784668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:21,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.860')] [2023-12-28 06:07:21,332][106225] Updated weights for policy 1, policy_version 1514841 (0.0008) [2023-12-28 06:07:21,406][106225] Updated weights for policy 1, policy_version 1514851 (0.0008) [2023-12-28 06:07:21,462][106225] Updated weights for policy 1, policy_version 1514861 (0.0008) [2023-12-28 06:07:21,521][106225] Updated weights for policy 1, policy_version 1514871 (0.0006) [2023-12-28 06:07:21,523][106226] Updated weights for policy 0, policy_version 1511138 (0.0007) [2023-12-28 06:07:21,589][106226] Updated weights for policy 0, policy_version 1511148 (0.0008) [2023-12-28 06:07:21,659][106226] Updated weights for policy 0, policy_version 1511158 (0.0009) [2023-12-28 06:07:22,246][106225] Updated weights for policy 1, policy_version 1514881 (0.0009) [2023-12-28 06:07:22,307][106225] Updated weights for policy 1, policy_version 1514891 (0.0008) [2023-12-28 06:07:22,371][106225] Updated weights for policy 1, policy_version 1514901 (0.0008) [2023-12-28 06:07:22,413][106226] Updated weights for policy 0, policy_version 1511168 (0.0008) [2023-12-28 06:07:22,472][106226] Updated weights for policy 0, policy_version 1511178 (0.0009) [2023-12-28 06:07:22,530][106226] Updated weights for policy 0, policy_version 1511188 (0.0008) [2023-12-28 06:07:23,060][106225] Updated weights for policy 1, policy_version 1514911 (0.0007) [2023-12-28 06:07:23,115][106225] Updated weights for policy 1, policy_version 1514921 (0.0008) [2023-12-28 06:07:23,161][106225] Updated weights for policy 1, policy_version 1514931 (0.0009) [2023-12-28 06:07:23,251][106226] Updated weights for policy 0, policy_version 1511198 (0.0009) [2023-12-28 06:07:23,313][106226] Updated weights for policy 0, policy_version 1511208 (0.0009) [2023-12-28 06:07:23,373][106226] Updated weights for policy 0, policy_version 1511218 (0.0009) [2023-12-28 06:07:23,921][106225] Updated weights for policy 1, policy_version 1514941 (0.0008) [2023-12-28 06:07:23,986][106225] Updated weights for policy 1, policy_version 1514951 (0.0009) [2023-12-28 06:07:24,051][106225] Updated weights for policy 1, policy_version 1514961 (0.0010) [2023-12-28 06:07:24,088][106226] Updated weights for policy 0, policy_version 1511228 (0.0008) [2023-12-28 06:07:24,148][106226] Updated weights for policy 0, policy_version 1511238 (0.0008) [2023-12-28 06:07:24,210][106226] Updated weights for policy 0, policy_version 1511248 (0.0007) [2023-12-28 06:07:24,688][106225] Updated weights for policy 1, policy_version 1514971 (0.0007) [2023-12-28 06:07:24,741][106225] Updated weights for policy 1, policy_version 1514981 (0.0008) [2023-12-28 06:07:24,798][106225] Updated weights for policy 1, policy_version 1514991 (0.0005) [2023-12-28 06:07:24,928][106226] Updated weights for policy 0, policy_version 1511258 (0.0007) [2023-12-28 06:07:24,982][106226] Updated weights for policy 0, policy_version 1511268 (0.0009) [2023-12-28 06:07:25,046][106226] Updated weights for policy 0, policy_version 1511278 (0.0005) [2023-12-28 06:07:25,101][106226] Updated weights for policy 0, policy_version 1511288 (0.0006) [2023-12-28 06:07:25,540][106225] Updated weights for policy 1, policy_version 1515001 (0.0009) [2023-12-28 06:07:25,591][106225] Updated weights for policy 1, policy_version 1515011 (0.0007) [2023-12-28 06:07:25,644][106225] Updated weights for policy 1, policy_version 1515021 (0.0005) [2023-12-28 06:07:25,700][106225] Updated weights for policy 1, policy_version 1515031 (0.0006) [2023-12-28 06:07:25,795][106226] Updated weights for policy 0, policy_version 1511298 (0.0009) [2023-12-28 06:07:25,843][106226] Updated weights for policy 0, policy_version 1511308 (0.0008) [2023-12-28 06:07:25,892][106226] Updated weights for policy 0, policy_version 1511319 (0.0007) [2023-12-28 06:07:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 774873088. Throughput: 0: 9868.7, 1: 9867.9. Samples: 774841512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:26,176][105115] Avg episode reward: [(0, '-4.677'), (1, '-4.556')] [2023-12-28 06:07:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001515032_387899392.pth... [2023-12-28 06:07:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001511320_386973696.pth... [2023-12-28 06:07:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001510168_386678784.pth [2023-12-28 06:07:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001513880_387604480.pth [2023-12-28 06:07:26,336][106225] Updated weights for policy 1, policy_version 1515041 (0.0005) [2023-12-28 06:07:26,394][106225] Updated weights for policy 1, policy_version 1515051 (0.0005) [2023-12-28 06:07:26,451][106225] Updated weights for policy 1, policy_version 1515061 (0.0008) [2023-12-28 06:07:26,586][106226] Updated weights for policy 0, policy_version 1511329 (0.0008) [2023-12-28 06:07:26,649][106226] Updated weights for policy 0, policy_version 1511339 (0.0008) [2023-12-28 06:07:26,711][106226] Updated weights for policy 0, policy_version 1511349 (0.0006) [2023-12-28 06:07:27,048][106225] Updated weights for policy 1, policy_version 1515071 (0.0006) [2023-12-28 06:07:27,110][106225] Updated weights for policy 1, policy_version 1515081 (0.0005) [2023-12-28 06:07:27,168][106225] Updated weights for policy 1, policy_version 1515091 (0.0005) [2023-12-28 06:07:27,276][106226] Updated weights for policy 0, policy_version 1511359 (0.0009) [2023-12-28 06:07:27,336][106226] Updated weights for policy 0, policy_version 1511369 (0.0009) [2023-12-28 06:07:27,396][106226] Updated weights for policy 0, policy_version 1511379 (0.0010) [2023-12-28 06:07:27,690][106225] Updated weights for policy 1, policy_version 1515101 (0.0007) [2023-12-28 06:07:27,746][106225] Updated weights for policy 1, policy_version 1515111 (0.0008) [2023-12-28 06:07:27,800][106225] Updated weights for policy 1, policy_version 1515121 (0.0008) [2023-12-28 06:07:28,080][106226] Updated weights for policy 0, policy_version 1511389 (0.0010) [2023-12-28 06:07:28,126][106226] Updated weights for policy 0, policy_version 1511399 (0.0010) [2023-12-28 06:07:28,187][106226] Updated weights for policy 0, policy_version 1511409 (0.0009) [2023-12-28 06:07:28,450][106225] Updated weights for policy 1, policy_version 1515131 (0.0008) [2023-12-28 06:07:28,501][106225] Updated weights for policy 1, policy_version 1515141 (0.0008) [2023-12-28 06:07:28,562][106225] Updated weights for policy 1, policy_version 1515151 (0.0008) [2023-12-28 06:07:28,879][106226] Updated weights for policy 0, policy_version 1511419 (0.0008) [2023-12-28 06:07:28,934][106226] Updated weights for policy 0, policy_version 1511429 (0.0007) [2023-12-28 06:07:28,990][106226] Updated weights for policy 0, policy_version 1511439 (0.0005) [2023-12-28 06:07:29,284][106225] Updated weights for policy 1, policy_version 1515161 (0.0007) [2023-12-28 06:07:29,350][106225] Updated weights for policy 1, policy_version 1515171 (0.0010) [2023-12-28 06:07:29,414][106225] Updated weights for policy 1, policy_version 1515181 (0.0011) [2023-12-28 06:07:29,469][106225] Updated weights for policy 1, policy_version 1515191 (0.0010) [2023-12-28 06:07:29,687][106226] Updated weights for policy 0, policy_version 1511449 (0.0006) [2023-12-28 06:07:29,745][106226] Updated weights for policy 0, policy_version 1511459 (0.0008) [2023-12-28 06:07:29,812][106226] Updated weights for policy 0, policy_version 1511469 (0.0010) [2023-12-28 06:07:29,881][106226] Updated weights for policy 0, policy_version 1511479 (0.0008) [2023-12-28 06:07:30,147][106225] Updated weights for policy 1, policy_version 1515201 (0.0007) [2023-12-28 06:07:30,203][106225] Updated weights for policy 1, policy_version 1515211 (0.0009) [2023-12-28 06:07:30,262][106225] Updated weights for policy 1, policy_version 1515221 (0.0008) [2023-12-28 06:07:30,620][106226] Updated weights for policy 0, policy_version 1511489 (0.0008) [2023-12-28 06:07:30,676][106226] Updated weights for policy 0, policy_version 1511499 (0.0009) [2023-12-28 06:07:30,728][106226] Updated weights for policy 0, policy_version 1511509 (0.0008) [2023-12-28 06:07:30,928][106225] Updated weights for policy 1, policy_version 1515231 (0.0008) [2023-12-28 06:07:30,977][106225] Updated weights for policy 1, policy_version 1515241 (0.0008) [2023-12-28 06:07:31,041][106225] Updated weights for policy 1, policy_version 1515251 (0.0008) [2023-12-28 06:07:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 774979584. Throughput: 0: 9934.5, 1: 9961.5. Samples: 774964732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:31,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.558')] [2023-12-28 06:07:31,469][106226] Updated weights for policy 0, policy_version 1511519 (0.0008) [2023-12-28 06:07:31,522][106226] Updated weights for policy 0, policy_version 1511529 (0.0008) [2023-12-28 06:07:31,572][106226] Updated weights for policy 0, policy_version 1511539 (0.0009) [2023-12-28 06:07:31,752][106225] Updated weights for policy 1, policy_version 1515261 (0.0008) [2023-12-28 06:07:31,814][106225] Updated weights for policy 1, policy_version 1515271 (0.0007) [2023-12-28 06:07:31,874][106225] Updated weights for policy 1, policy_version 1515281 (0.0005) [2023-12-28 06:07:32,378][106226] Updated weights for policy 0, policy_version 1511549 (0.0007) [2023-12-28 06:07:32,439][106226] Updated weights for policy 0, policy_version 1511559 (0.0008) [2023-12-28 06:07:32,502][106226] Updated weights for policy 0, policy_version 1511569 (0.0009) [2023-12-28 06:07:32,517][106225] Updated weights for policy 1, policy_version 1515291 (0.0006) [2023-12-28 06:07:32,578][106225] Updated weights for policy 1, policy_version 1515301 (0.0006) [2023-12-28 06:07:32,641][106225] Updated weights for policy 1, policy_version 1515311 (0.0009) [2023-12-28 06:07:33,184][106226] Updated weights for policy 0, policy_version 1511579 (0.0008) [2023-12-28 06:07:33,238][106226] Updated weights for policy 0, policy_version 1511589 (0.0008) [2023-12-28 06:07:33,255][106225] Updated weights for policy 1, policy_version 1515321 (0.0009) [2023-12-28 06:07:33,305][106225] Updated weights for policy 1, policy_version 1515331 (0.0008) [2023-12-28 06:07:33,306][106226] Updated weights for policy 0, policy_version 1511599 (0.0005) [2023-12-28 06:07:33,354][106225] Updated weights for policy 1, policy_version 1515341 (0.0008) [2023-12-28 06:07:33,403][106225] Updated weights for policy 1, policy_version 1515351 (0.0009) [2023-12-28 06:07:33,921][106226] Updated weights for policy 0, policy_version 1511609 (0.0005) [2023-12-28 06:07:33,981][106226] Updated weights for policy 0, policy_version 1511619 (0.0005) [2023-12-28 06:07:34,029][106226] Updated weights for policy 0, policy_version 1511629 (0.0005) [2023-12-28 06:07:34,074][106225] Updated weights for policy 1, policy_version 1515361 (0.0006) [2023-12-28 06:07:34,084][106226] Updated weights for policy 0, policy_version 1511639 (0.0005) [2023-12-28 06:07:34,137][106225] Updated weights for policy 1, policy_version 1515371 (0.0006) [2023-12-28 06:07:34,205][106225] Updated weights for policy 1, policy_version 1515381 (0.0007) [2023-12-28 06:07:34,693][106226] Updated weights for policy 0, policy_version 1511649 (0.0007) [2023-12-28 06:07:34,755][106226] Updated weights for policy 0, policy_version 1511659 (0.0008) [2023-12-28 06:07:34,812][106226] Updated weights for policy 0, policy_version 1511669 (0.0007) [2023-12-28 06:07:34,909][106225] Updated weights for policy 1, policy_version 1515391 (0.0009) [2023-12-28 06:07:34,953][106225] Updated weights for policy 1, policy_version 1515401 (0.0010) [2023-12-28 06:07:34,999][106225] Updated weights for policy 1, policy_version 1515411 (0.0010) [2023-12-28 06:07:35,569][106225] Updated weights for policy 1, policy_version 1515421 (0.0006) [2023-12-28 06:07:35,611][106226] Updated weights for policy 0, policy_version 1511679 (0.0008) [2023-12-28 06:07:35,617][106225] Updated weights for policy 1, policy_version 1515431 (0.0005) [2023-12-28 06:07:35,660][106226] Updated weights for policy 0, policy_version 1511689 (0.0008) [2023-12-28 06:07:35,662][106225] Updated weights for policy 1, policy_version 1515441 (0.0005) [2023-12-28 06:07:35,710][106226] Updated weights for policy 0, policy_version 1511699 (0.0009) [2023-12-28 06:07:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 775077888. Throughput: 0: 9939.7, 1: 10061.0. Samples: 775087264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:36,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.568')] [2023-12-28 06:07:36,327][106225] Updated weights for policy 1, policy_version 1515451 (0.0007) [2023-12-28 06:07:36,380][106226] Updated weights for policy 0, policy_version 1511709 (0.0009) [2023-12-28 06:07:36,387][106225] Updated weights for policy 1, policy_version 1515461 (0.0007) [2023-12-28 06:07:36,449][106226] Updated weights for policy 0, policy_version 1511719 (0.0006) [2023-12-28 06:07:36,451][106225] Updated weights for policy 1, policy_version 1515471 (0.0007) [2023-12-28 06:07:36,517][106226] Updated weights for policy 0, policy_version 1511729 (0.0008) [2023-12-28 06:07:37,123][106225] Updated weights for policy 1, policy_version 1515481 (0.0006) [2023-12-28 06:07:37,151][106226] Updated weights for policy 0, policy_version 1511739 (0.0008) [2023-12-28 06:07:37,189][106225] Updated weights for policy 1, policy_version 1515491 (0.0007) [2023-12-28 06:07:37,199][106226] Updated weights for policy 0, policy_version 1511749 (0.0007) [2023-12-28 06:07:37,252][106226] Updated weights for policy 0, policy_version 1511759 (0.0008) [2023-12-28 06:07:37,255][106225] Updated weights for policy 1, policy_version 1515501 (0.0007) [2023-12-28 06:07:37,320][106225] Updated weights for policy 1, policy_version 1515511 (0.0007) [2023-12-28 06:07:37,831][106226] Updated weights for policy 0, policy_version 1511769 (0.0007) [2023-12-28 06:07:37,893][106226] Updated weights for policy 0, policy_version 1511779 (0.0008) [2023-12-28 06:07:37,944][106226] Updated weights for policy 0, policy_version 1511789 (0.0008) [2023-12-28 06:07:38,001][106226] Updated weights for policy 0, policy_version 1511799 (0.0009) [2023-12-28 06:07:38,053][106225] Updated weights for policy 1, policy_version 1515521 (0.0008) [2023-12-28 06:07:38,105][106225] Updated weights for policy 1, policy_version 1515531 (0.0009) [2023-12-28 06:07:38,153][106225] Updated weights for policy 1, policy_version 1515541 (0.0008) [2023-12-28 06:07:38,704][106226] Updated weights for policy 0, policy_version 1511809 (0.0008) [2023-12-28 06:07:38,766][106226] Updated weights for policy 0, policy_version 1511819 (0.0009) [2023-12-28 06:07:38,830][106226] Updated weights for policy 0, policy_version 1511829 (0.0008) [2023-12-28 06:07:38,845][106225] Updated weights for policy 1, policy_version 1515551 (0.0006) [2023-12-28 06:07:38,910][106225] Updated weights for policy 1, policy_version 1515561 (0.0006) [2023-12-28 06:07:38,971][106225] Updated weights for policy 1, policy_version 1515571 (0.0005) [2023-12-28 06:07:39,634][106225] Updated weights for policy 1, policy_version 1515581 (0.0006) [2023-12-28 06:07:39,643][106226] Updated weights for policy 0, policy_version 1511839 (0.0010) [2023-12-28 06:07:39,699][106225] Updated weights for policy 1, policy_version 1515591 (0.0008) [2023-12-28 06:07:39,706][106226] Updated weights for policy 0, policy_version 1511849 (0.0009) [2023-12-28 06:07:39,765][106225] Updated weights for policy 1, policy_version 1515601 (0.0008) [2023-12-28 06:07:39,774][106226] Updated weights for policy 0, policy_version 1511859 (0.0011) [2023-12-28 06:07:40,427][106225] Updated weights for policy 1, policy_version 1515611 (0.0007) [2023-12-28 06:07:40,484][106226] Updated weights for policy 0, policy_version 1511869 (0.0008) [2023-12-28 06:07:40,491][106225] Updated weights for policy 1, policy_version 1515621 (0.0007) [2023-12-28 06:07:40,537][106226] Updated weights for policy 0, policy_version 1511879 (0.0008) [2023-12-28 06:07:40,558][106225] Updated weights for policy 1, policy_version 1515631 (0.0007) [2023-12-28 06:07:40,594][106226] Updated weights for policy 0, policy_version 1511889 (0.0010) [2023-12-28 06:07:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 775176192. Throughput: 0: 9986.1, 1: 10076.3. Samples: 775148228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:41,175][105115] Avg episode reward: [(0, '-5.042'), (1, '-5.049')] [2023-12-28 06:07:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001515640_388055040.pth... [2023-12-28 06:07:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001511896_387121152.pth... [2023-12-28 06:07:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001510776_386834432.pth [2023-12-28 06:07:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001514456_387751936.pth [2023-12-28 06:07:41,312][106225] Updated weights for policy 1, policy_version 1515641 (0.0010) [2023-12-28 06:07:41,368][106225] Updated weights for policy 1, policy_version 1515651 (0.0008) [2023-12-28 06:07:41,372][106226] Updated weights for policy 0, policy_version 1511899 (0.0009) [2023-12-28 06:07:41,440][106225] Updated weights for policy 1, policy_version 1515661 (0.0009) [2023-12-28 06:07:41,442][106226] Updated weights for policy 0, policy_version 1511909 (0.0008) [2023-12-28 06:07:41,501][106225] Updated weights for policy 1, policy_version 1515671 (0.0008) [2023-12-28 06:07:41,504][106226] Updated weights for policy 0, policy_version 1511919 (0.0007) [2023-12-28 06:07:42,192][106225] Updated weights for policy 1, policy_version 1515681 (0.0007) [2023-12-28 06:07:42,260][106225] Updated weights for policy 1, policy_version 1515691 (0.0010) [2023-12-28 06:07:42,264][106226] Updated weights for policy 0, policy_version 1511929 (0.0009) [2023-12-28 06:07:42,324][106225] Updated weights for policy 1, policy_version 1515701 (0.0010) [2023-12-28 06:07:42,327][106226] Updated weights for policy 0, policy_version 1511939 (0.0007) [2023-12-28 06:07:42,396][106226] Updated weights for policy 0, policy_version 1511949 (0.0009) [2023-12-28 06:07:42,459][106226] Updated weights for policy 0, policy_version 1511959 (0.0008) [2023-12-28 06:07:43,067][106225] Updated weights for policy 1, policy_version 1515711 (0.0008) [2023-12-28 06:07:43,125][106225] Updated weights for policy 1, policy_version 1515721 (0.0008) [2023-12-28 06:07:43,165][106226] Updated weights for policy 0, policy_version 1511969 (0.0007) [2023-12-28 06:07:43,182][106225] Updated weights for policy 1, policy_version 1515731 (0.0007) [2023-12-28 06:07:43,219][106226] Updated weights for policy 0, policy_version 1511979 (0.0006) [2023-12-28 06:07:43,281][106226] Updated weights for policy 0, policy_version 1511989 (0.0009) [2023-12-28 06:07:43,856][106225] Updated weights for policy 1, policy_version 1515741 (0.0007) [2023-12-28 06:07:43,911][106225] Updated weights for policy 1, policy_version 1515751 (0.0007) [2023-12-28 06:07:43,921][106226] Updated weights for policy 0, policy_version 1511999 (0.0010) [2023-12-28 06:07:43,967][106225] Updated weights for policy 1, policy_version 1515761 (0.0007) [2023-12-28 06:07:43,974][106226] Updated weights for policy 0, policy_version 1512009 (0.0010) [2023-12-28 06:07:44,025][106226] Updated weights for policy 0, policy_version 1512019 (0.0010) [2023-12-28 06:07:44,688][106225] Updated weights for policy 1, policy_version 1515771 (0.0008) [2023-12-28 06:07:44,701][106226] Updated weights for policy 0, policy_version 1512029 (0.0010) [2023-12-28 06:07:44,744][106225] Updated weights for policy 1, policy_version 1515781 (0.0005) [2023-12-28 06:07:44,759][106226] Updated weights for policy 0, policy_version 1512039 (0.0011) [2023-12-28 06:07:44,816][106225] Updated weights for policy 1, policy_version 1515791 (0.0007) [2023-12-28 06:07:44,832][106226] Updated weights for policy 0, policy_version 1512049 (0.0011) [2023-12-28 06:07:45,465][106225] Updated weights for policy 1, policy_version 1515801 (0.0007) [2023-12-28 06:07:45,514][106226] Updated weights for policy 0, policy_version 1512059 (0.0010) [2023-12-28 06:07:45,524][106225] Updated weights for policy 1, policy_version 1515811 (0.0008) [2023-12-28 06:07:45,579][106226] Updated weights for policy 0, policy_version 1512069 (0.0011) [2023-12-28 06:07:45,581][106225] Updated weights for policy 1, policy_version 1515821 (0.0005) [2023-12-28 06:07:45,645][106226] Updated weights for policy 0, policy_version 1512079 (0.0011) [2023-12-28 06:07:45,647][106225] Updated weights for policy 1, policy_version 1515831 (0.0006) [2023-12-28 06:07:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 775274496. Throughput: 0: 9978.6, 1: 10032.6. Samples: 775265236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:46,175][105115] Avg episode reward: [(0, '-4.845'), (1, '-5.027')] [2023-12-28 06:07:46,320][106226] Updated weights for policy 0, policy_version 1512089 (0.0011) [2023-12-28 06:07:46,380][106226] Updated weights for policy 0, policy_version 1512099 (0.0011) [2023-12-28 06:07:46,394][106225] Updated weights for policy 1, policy_version 1515841 (0.0007) [2023-12-28 06:07:46,441][106226] Updated weights for policy 0, policy_version 1512109 (0.0011) [2023-12-28 06:07:46,451][106225] Updated weights for policy 1, policy_version 1515851 (0.0005) [2023-12-28 06:07:46,507][106226] Updated weights for policy 0, policy_version 1512119 (0.0011) [2023-12-28 06:07:46,513][106225] Updated weights for policy 1, policy_version 1515861 (0.0006) [2023-12-28 06:07:47,224][106226] Updated weights for policy 0, policy_version 1512129 (0.0011) [2023-12-28 06:07:47,246][106225] Updated weights for policy 1, policy_version 1515871 (0.0006) [2023-12-28 06:07:47,271][106226] Updated weights for policy 0, policy_version 1512139 (0.0010) [2023-12-28 06:07:47,290][106225] Updated weights for policy 1, policy_version 1515881 (0.0005) [2023-12-28 06:07:47,326][106226] Updated weights for policy 0, policy_version 1512149 (0.0011) [2023-12-28 06:07:47,343][106225] Updated weights for policy 1, policy_version 1515891 (0.0006) [2023-12-28 06:07:48,000][106226] Updated weights for policy 0, policy_version 1512159 (0.0010) [2023-12-28 06:07:48,065][106226] Updated weights for policy 0, policy_version 1512169 (0.0010) [2023-12-28 06:07:48,115][106225] Updated weights for policy 1, policy_version 1515901 (0.0007) [2023-12-28 06:07:48,131][106226] Updated weights for policy 0, policy_version 1512179 (0.0011) [2023-12-28 06:07:48,170][106225] Updated weights for policy 1, policy_version 1515911 (0.0007) [2023-12-28 06:07:48,218][106225] Updated weights for policy 1, policy_version 1515921 (0.0008) [2023-12-28 06:07:48,830][106226] Updated weights for policy 0, policy_version 1512189 (0.0010) [2023-12-28 06:07:48,887][106226] Updated weights for policy 0, policy_version 1512199 (0.0011) [2023-12-28 06:07:48,934][106225] Updated weights for policy 1, policy_version 1515931 (0.0007) [2023-12-28 06:07:48,948][106226] Updated weights for policy 0, policy_version 1512209 (0.0010) [2023-12-28 06:07:48,984][106225] Updated weights for policy 1, policy_version 1515941 (0.0010) [2023-12-28 06:07:49,029][106225] Updated weights for policy 1, policy_version 1515951 (0.0007) [2023-12-28 06:07:49,665][106226] Updated weights for policy 0, policy_version 1512219 (0.0009) [2023-12-28 06:07:49,683][106225] Updated weights for policy 1, policy_version 1515961 (0.0006) [2023-12-28 06:07:49,729][106226] Updated weights for policy 0, policy_version 1512229 (0.0005) [2023-12-28 06:07:49,745][106225] Updated weights for policy 1, policy_version 1515971 (0.0010) [2023-12-28 06:07:49,792][106226] Updated weights for policy 0, policy_version 1512239 (0.0006) [2023-12-28 06:07:49,803][106225] Updated weights for policy 1, policy_version 1515981 (0.0010) [2023-12-28 06:07:49,863][106225] Updated weights for policy 1, policy_version 1515991 (0.0010) [2023-12-28 06:07:50,422][106226] Updated weights for policy 0, policy_version 1512249 (0.0007) [2023-12-28 06:07:50,489][106226] Updated weights for policy 0, policy_version 1512259 (0.0009) [2023-12-28 06:07:50,539][106226] Updated weights for policy 0, policy_version 1512269 (0.0008) [2023-12-28 06:07:50,608][106226] Updated weights for policy 0, policy_version 1512279 (0.0007) [2023-12-28 06:07:50,655][106225] Updated weights for policy 1, policy_version 1516001 (0.0008) [2023-12-28 06:07:50,721][106225] Updated weights for policy 1, policy_version 1516011 (0.0008) [2023-12-28 06:07:50,783][106225] Updated weights for policy 1, policy_version 1516021 (0.0008) [2023-12-28 06:07:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 775372800. Throughput: 0: 9900.1, 1: 10053.8. Samples: 775383164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:07:51,176][105115] Avg episode reward: [(0, '-4.721'), (1, '-4.638')] [2023-12-28 06:07:51,303][106226] Updated weights for policy 0, policy_version 1512289 (0.0007) [2023-12-28 06:07:51,376][106226] Updated weights for policy 0, policy_version 1512299 (0.0008) [2023-12-28 06:07:51,438][106226] Updated weights for policy 0, policy_version 1512309 (0.0009) [2023-12-28 06:07:51,581][106225] Updated weights for policy 1, policy_version 1516031 (0.0008) [2023-12-28 06:07:51,642][106225] Updated weights for policy 1, policy_version 1516041 (0.0007) [2023-12-28 06:07:51,701][106225] Updated weights for policy 1, policy_version 1516051 (0.0005) [2023-12-28 06:07:52,115][106226] Updated weights for policy 0, policy_version 1512319 (0.0010) [2023-12-28 06:07:52,165][106226] Updated weights for policy 0, policy_version 1512329 (0.0011) [2023-12-28 06:07:52,222][106226] Updated weights for policy 0, policy_version 1512339 (0.0011) [2023-12-28 06:07:52,417][106225] Updated weights for policy 1, policy_version 1516061 (0.0007) [2023-12-28 06:07:52,482][106225] Updated weights for policy 1, policy_version 1516071 (0.0009) [2023-12-28 06:07:52,537][106225] Updated weights for policy 1, policy_version 1516081 (0.0008) [2023-12-28 06:07:52,884][106226] Updated weights for policy 0, policy_version 1512349 (0.0011) [2023-12-28 06:07:52,948][106226] Updated weights for policy 0, policy_version 1512359 (0.0010) [2023-12-28 06:07:53,011][106226] Updated weights for policy 0, policy_version 1512369 (0.0010) [2023-12-28 06:07:53,269][106225] Updated weights for policy 1, policy_version 1516091 (0.0010) [2023-12-28 06:07:53,326][106225] Updated weights for policy 1, policy_version 1516101 (0.0009) [2023-12-28 06:07:53,389][106225] Updated weights for policy 1, policy_version 1516111 (0.0005) [2023-12-28 06:07:53,577][106226] Updated weights for policy 0, policy_version 1512379 (0.0008) [2023-12-28 06:07:53,627][106226] Updated weights for policy 0, policy_version 1512389 (0.0010) [2023-12-28 06:07:53,680][106226] Updated weights for policy 0, policy_version 1512399 (0.0010) [2023-12-28 06:07:53,947][106225] Updated weights for policy 1, policy_version 1516121 (0.0005) [2023-12-28 06:07:53,998][106225] Updated weights for policy 1, policy_version 1516131 (0.0005) [2023-12-28 06:07:54,052][106225] Updated weights for policy 1, policy_version 1516141 (0.0006) [2023-12-28 06:07:54,102][106225] Updated weights for policy 1, policy_version 1516151 (0.0009) [2023-12-28 06:07:54,401][106226] Updated weights for policy 0, policy_version 1512409 (0.0009) [2023-12-28 06:07:54,463][106226] Updated weights for policy 0, policy_version 1512419 (0.0008) [2023-12-28 06:07:54,525][106226] Updated weights for policy 0, policy_version 1512429 (0.0008) [2023-12-28 06:07:54,581][106226] Updated weights for policy 0, policy_version 1512439 (0.0008) [2023-12-28 06:07:54,814][106225] Updated weights for policy 1, policy_version 1516161 (0.0010) [2023-12-28 06:07:54,882][106225] Updated weights for policy 1, policy_version 1516171 (0.0010) [2023-12-28 06:07:54,942][106225] Updated weights for policy 1, policy_version 1516181 (0.0010) [2023-12-28 06:07:55,290][106226] Updated weights for policy 0, policy_version 1512449 (0.0007) [2023-12-28 06:07:55,351][106226] Updated weights for policy 0, policy_version 1512459 (0.0008) [2023-12-28 06:07:55,421][106226] Updated weights for policy 0, policy_version 1512469 (0.0008) [2023-12-28 06:07:55,555][106225] Updated weights for policy 1, policy_version 1516191 (0.0007) [2023-12-28 06:07:55,606][106225] Updated weights for policy 1, policy_version 1516201 (0.0005) [2023-12-28 06:07:55,655][106225] Updated weights for policy 1, policy_version 1516211 (0.0005) [2023-12-28 06:07:56,088][106226] Updated weights for policy 0, policy_version 1512479 (0.0007) [2023-12-28 06:07:56,144][106226] Updated weights for policy 0, policy_version 1512489 (0.0005) [2023-12-28 06:07:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 775471104. Throughput: 0: 9890.7, 1: 9997.6. Samples: 775443572. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:07:56,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.474')] [2023-12-28 06:07:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001516216_388202496.pth... [2023-12-28 06:07:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001515032_387899392.pth [2023-12-28 06:07:56,201][106226] Updated weights for policy 0, policy_version 1512499 (0.0006) [2023-12-28 06:07:56,226][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001512504_387276800.pth... [2023-12-28 06:07:56,228][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001511320_386973696.pth [2023-12-28 06:07:56,328][106225] Updated weights for policy 1, policy_version 1516221 (0.0008) [2023-12-28 06:07:56,387][106225] Updated weights for policy 1, policy_version 1516231 (0.0007) [2023-12-28 06:07:56,455][106225] Updated weights for policy 1, policy_version 1516241 (0.0005) [2023-12-28 06:07:56,893][106226] Updated weights for policy 0, policy_version 1512509 (0.0007) [2023-12-28 06:07:56,958][106226] Updated weights for policy 0, policy_version 1512519 (0.0009) [2023-12-28 06:07:56,999][106225] Updated weights for policy 1, policy_version 1516251 (0.0007) [2023-12-28 06:07:57,026][106226] Updated weights for policy 0, policy_version 1512529 (0.0011) [2023-12-28 06:07:57,054][106225] Updated weights for policy 1, policy_version 1516261 (0.0010) [2023-12-28 06:07:57,105][106225] Updated weights for policy 1, policy_version 1516271 (0.0010) [2023-12-28 06:07:57,637][106226] Updated weights for policy 0, policy_version 1512539 (0.0009) [2023-12-28 06:07:57,702][106226] Updated weights for policy 0, policy_version 1512549 (0.0006) [2023-12-28 06:07:57,767][106226] Updated weights for policy 0, policy_version 1512559 (0.0005) [2023-12-28 06:07:57,823][106225] Updated weights for policy 1, policy_version 1516281 (0.0010) [2023-12-28 06:07:57,882][106225] Updated weights for policy 1, policy_version 1516291 (0.0010) [2023-12-28 06:07:57,941][106225] Updated weights for policy 1, policy_version 1516301 (0.0010) [2023-12-28 06:07:58,002][106225] Updated weights for policy 1, policy_version 1516311 (0.0010) [2023-12-28 06:07:58,413][106226] Updated weights for policy 0, policy_version 1512569 (0.0006) [2023-12-28 06:07:58,480][106226] Updated weights for policy 0, policy_version 1512579 (0.0008) [2023-12-28 06:07:58,547][106226] Updated weights for policy 0, policy_version 1512589 (0.0008) [2023-12-28 06:07:58,610][106226] Updated weights for policy 0, policy_version 1512599 (0.0008) [2023-12-28 06:07:58,784][106225] Updated weights for policy 1, policy_version 1516321 (0.0009) [2023-12-28 06:07:58,849][106225] Updated weights for policy 1, policy_version 1516331 (0.0009) [2023-12-28 06:07:58,903][106225] Updated weights for policy 1, policy_version 1516341 (0.0009) [2023-12-28 06:07:59,481][106226] Updated weights for policy 0, policy_version 1512609 (0.0010) [2023-12-28 06:07:59,543][106226] Updated weights for policy 0, policy_version 1512619 (0.0010) [2023-12-28 06:07:59,604][106226] Updated weights for policy 0, policy_version 1512629 (0.0010) [2023-12-28 06:07:59,709][106225] Updated weights for policy 1, policy_version 1516351 (0.0010) [2023-12-28 06:07:59,768][106225] Updated weights for policy 1, policy_version 1516361 (0.0010) [2023-12-28 06:07:59,827][106225] Updated weights for policy 1, policy_version 1516371 (0.0010) [2023-12-28 06:08:00,329][106226] Updated weights for policy 0, policy_version 1512639 (0.0010) [2023-12-28 06:08:00,388][106226] Updated weights for policy 0, policy_version 1512649 (0.0011) [2023-12-28 06:08:00,451][106226] Updated weights for policy 0, policy_version 1512659 (0.0011) [2023-12-28 06:08:00,466][106225] Updated weights for policy 1, policy_version 1516381 (0.0009) [2023-12-28 06:08:00,516][106225] Updated weights for policy 1, policy_version 1516391 (0.0010) [2023-12-28 06:08:00,568][106225] Updated weights for policy 1, policy_version 1516401 (0.0010) [2023-12-28 06:08:01,122][106226] Updated weights for policy 0, policy_version 1512669 (0.0008) [2023-12-28 06:08:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 775569408. Throughput: 0: 9897.3, 1: 10079.9. Samples: 775563172. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:01,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.757')] [2023-12-28 06:08:01,198][106226] Updated weights for policy 0, policy_version 1512679 (0.0007) [2023-12-28 06:08:01,269][106226] Updated weights for policy 0, policy_version 1512689 (0.0008) [2023-12-28 06:08:01,306][106225] Updated weights for policy 1, policy_version 1516411 (0.0010) [2023-12-28 06:08:01,372][106225] Updated weights for policy 1, policy_version 1516421 (0.0008) [2023-12-28 06:08:01,434][106225] Updated weights for policy 1, policy_version 1516431 (0.0008) [2023-12-28 06:08:01,975][106226] Updated weights for policy 0, policy_version 1512699 (0.0007) [2023-12-28 06:08:02,030][106226] Updated weights for policy 0, policy_version 1512709 (0.0008) [2023-12-28 06:08:02,091][106226] Updated weights for policy 0, policy_version 1512719 (0.0009) [2023-12-28 06:08:02,157][106225] Updated weights for policy 1, policy_version 1516441 (0.0008) [2023-12-28 06:08:02,213][106225] Updated weights for policy 1, policy_version 1516451 (0.0010) [2023-12-28 06:08:02,273][106225] Updated weights for policy 1, policy_version 1516461 (0.0011) [2023-12-28 06:08:02,330][106225] Updated weights for policy 1, policy_version 1516471 (0.0011) [2023-12-28 06:08:02,793][106226] Updated weights for policy 0, policy_version 1512729 (0.0010) [2023-12-28 06:08:02,845][106226] Updated weights for policy 0, policy_version 1512739 (0.0007) [2023-12-28 06:08:02,897][106226] Updated weights for policy 0, policy_version 1512749 (0.0008) [2023-12-28 06:08:02,950][106226] Updated weights for policy 0, policy_version 1512759 (0.0008) [2023-12-28 06:08:03,074][106225] Updated weights for policy 1, policy_version 1516481 (0.0010) [2023-12-28 06:08:03,123][106225] Updated weights for policy 1, policy_version 1516491 (0.0010) [2023-12-28 06:08:03,176][106225] Updated weights for policy 1, policy_version 1516501 (0.0010) [2023-12-28 06:08:03,634][106226] Updated weights for policy 0, policy_version 1512769 (0.0008) [2023-12-28 06:08:03,685][106226] Updated weights for policy 0, policy_version 1512779 (0.0009) [2023-12-28 06:08:03,736][106226] Updated weights for policy 0, policy_version 1512789 (0.0008) [2023-12-28 06:08:03,803][106225] Updated weights for policy 1, policy_version 1516511 (0.0010) [2023-12-28 06:08:03,861][106225] Updated weights for policy 1, policy_version 1516521 (0.0010) [2023-12-28 06:08:03,919][106225] Updated weights for policy 1, policy_version 1516531 (0.0006) [2023-12-28 06:08:04,401][106226] Updated weights for policy 0, policy_version 1512799 (0.0010) [2023-12-28 06:08:04,458][106226] Updated weights for policy 0, policy_version 1512809 (0.0010) [2023-12-28 06:08:04,507][106226] Updated weights for policy 0, policy_version 1512819 (0.0010) [2023-12-28 06:08:04,675][106225] Updated weights for policy 1, policy_version 1516541 (0.0008) [2023-12-28 06:08:04,724][106225] Updated weights for policy 1, policy_version 1516551 (0.0008) [2023-12-28 06:08:04,776][106225] Updated weights for policy 1, policy_version 1516561 (0.0006) [2023-12-28 06:08:05,185][106226] Updated weights for policy 0, policy_version 1512829 (0.0008) [2023-12-28 06:08:05,244][106226] Updated weights for policy 0, policy_version 1512839 (0.0005) [2023-12-28 06:08:05,309][106226] Updated weights for policy 0, policy_version 1512849 (0.0005) [2023-12-28 06:08:05,503][106225] Updated weights for policy 1, policy_version 1516571 (0.0007) [2023-12-28 06:08:05,560][106225] Updated weights for policy 1, policy_version 1516581 (0.0005) [2023-12-28 06:08:05,627][106225] Updated weights for policy 1, policy_version 1516591 (0.0007) [2023-12-28 06:08:05,882][106226] Updated weights for policy 0, policy_version 1512859 (0.0005) [2023-12-28 06:08:05,952][106226] Updated weights for policy 0, policy_version 1512869 (0.0005) [2023-12-28 06:08:06,019][106226] Updated weights for policy 0, policy_version 1512879 (0.0005) [2023-12-28 06:08:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 775675904. Throughput: 0: 9956.7, 1: 10033.1. Samples: 775684212. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:06,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-4.740')] [2023-12-28 06:08:06,254][106225] Updated weights for policy 1, policy_version 1516601 (0.0006) [2023-12-28 06:08:06,317][106225] Updated weights for policy 1, policy_version 1516611 (0.0008) [2023-12-28 06:08:06,376][106225] Updated weights for policy 1, policy_version 1516621 (0.0008) [2023-12-28 06:08:06,432][106225] Updated weights for policy 1, policy_version 1516631 (0.0008) [2023-12-28 06:08:06,593][106226] Updated weights for policy 0, policy_version 1512889 (0.0010) [2023-12-28 06:08:06,661][106226] Updated weights for policy 0, policy_version 1512899 (0.0009) [2023-12-28 06:08:06,719][106226] Updated weights for policy 0, policy_version 1512909 (0.0011) [2023-12-28 06:08:06,780][106226] Updated weights for policy 0, policy_version 1512919 (0.0011) [2023-12-28 06:08:07,147][106225] Updated weights for policy 1, policy_version 1516641 (0.0009) [2023-12-28 06:08:07,197][106225] Updated weights for policy 1, policy_version 1516651 (0.0008) [2023-12-28 06:08:07,246][106225] Updated weights for policy 1, policy_version 1516661 (0.0008) [2023-12-28 06:08:07,381][106226] Updated weights for policy 0, policy_version 1512929 (0.0009) [2023-12-28 06:08:07,438][106226] Updated weights for policy 0, policy_version 1512939 (0.0006) [2023-12-28 06:08:07,491][106226] Updated weights for policy 0, policy_version 1512949 (0.0005) [2023-12-28 06:08:08,010][106225] Updated weights for policy 1, policy_version 1516671 (0.0008) [2023-12-28 06:08:08,068][106225] Updated weights for policy 1, policy_version 1516681 (0.0009) [2023-12-28 06:08:08,118][106225] Updated weights for policy 1, policy_version 1516691 (0.0008) [2023-12-28 06:08:08,138][106226] Updated weights for policy 0, policy_version 1512959 (0.0009) [2023-12-28 06:08:08,194][106226] Updated weights for policy 0, policy_version 1512969 (0.0010) [2023-12-28 06:08:08,248][106226] Updated weights for policy 0, policy_version 1512979 (0.0010) [2023-12-28 06:08:08,899][106225] Updated weights for policy 1, policy_version 1516701 (0.0008) [2023-12-28 06:08:08,953][106225] Updated weights for policy 1, policy_version 1516711 (0.0007) [2023-12-28 06:08:08,965][106226] Updated weights for policy 0, policy_version 1512989 (0.0011) [2023-12-28 06:08:09,012][106225] Updated weights for policy 1, policy_version 1516721 (0.0008) [2023-12-28 06:08:09,029][106226] Updated weights for policy 0, policy_version 1512999 (0.0011) [2023-12-28 06:08:09,094][106226] Updated weights for policy 0, policy_version 1513009 (0.0010) [2023-12-28 06:08:09,813][106225] Updated weights for policy 1, policy_version 1516731 (0.0006) [2023-12-28 06:08:09,883][106225] Updated weights for policy 1, policy_version 1516741 (0.0009) [2023-12-28 06:08:09,911][106226] Updated weights for policy 0, policy_version 1513019 (0.0008) [2023-12-28 06:08:09,955][106225] Updated weights for policy 1, policy_version 1516751 (0.0009) [2023-12-28 06:08:09,981][106226] Updated weights for policy 0, policy_version 1513029 (0.0008) [2023-12-28 06:08:10,047][106226] Updated weights for policy 0, policy_version 1513039 (0.0008) [2023-12-28 06:08:10,664][106225] Updated weights for policy 1, policy_version 1516761 (0.0009) [2023-12-28 06:08:10,722][106225] Updated weights for policy 1, policy_version 1516771 (0.0008) [2023-12-28 06:08:10,761][106226] Updated weights for policy 0, policy_version 1513049 (0.0008) [2023-12-28 06:08:10,775][106225] Updated weights for policy 1, policy_version 1516781 (0.0008) [2023-12-28 06:08:10,819][106226] Updated weights for policy 0, policy_version 1513059 (0.0008) [2023-12-28 06:08:10,839][106225] Updated weights for policy 1, policy_version 1516791 (0.0006) [2023-12-28 06:08:10,879][106226] Updated weights for policy 0, policy_version 1513069 (0.0008) [2023-12-28 06:08:10,932][106226] Updated weights for policy 0, policy_version 1513079 (0.0008) [2023-12-28 06:08:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 775774208. Throughput: 0: 10034.1, 1: 10035.4. Samples: 775744636. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:11,175][105115] Avg episode reward: [(0, '-4.702'), (1, '-4.616')] [2023-12-28 06:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001513080_387424256.pth... [2023-12-28 06:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001516792_388349952.pth... [2023-12-28 06:08:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001511896_387121152.pth [2023-12-28 06:08:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001515640_388055040.pth [2023-12-28 06:08:11,538][106225] Updated weights for policy 1, policy_version 1516801 (0.0008) [2023-12-28 06:08:11,609][106225] Updated weights for policy 1, policy_version 1516811 (0.0007) [2023-12-28 06:08:11,685][106225] Updated weights for policy 1, policy_version 1516821 (0.0008) [2023-12-28 06:08:11,764][106226] Updated weights for policy 0, policy_version 1513089 (0.0008) [2023-12-28 06:08:11,829][106226] Updated weights for policy 0, policy_version 1513099 (0.0007) [2023-12-28 06:08:11,893][106226] Updated weights for policy 0, policy_version 1513109 (0.0008) [2023-12-28 06:08:12,396][106225] Updated weights for policy 1, policy_version 1516831 (0.0007) [2023-12-28 06:08:12,459][106225] Updated weights for policy 1, policy_version 1516841 (0.0008) [2023-12-28 06:08:12,514][106225] Updated weights for policy 1, policy_version 1516851 (0.0009) [2023-12-28 06:08:12,606][106226] Updated weights for policy 0, policy_version 1513119 (0.0007) [2023-12-28 06:08:12,665][106226] Updated weights for policy 0, policy_version 1513129 (0.0008) [2023-12-28 06:08:12,724][106226] Updated weights for policy 0, policy_version 1513139 (0.0008) [2023-12-28 06:08:13,264][106225] Updated weights for policy 1, policy_version 1516861 (0.0010) [2023-12-28 06:08:13,315][106225] Updated weights for policy 1, policy_version 1516871 (0.0010) [2023-12-28 06:08:13,362][106226] Updated weights for policy 0, policy_version 1513149 (0.0007) [2023-12-28 06:08:13,375][106225] Updated weights for policy 1, policy_version 1516881 (0.0010) [2023-12-28 06:08:13,425][106226] Updated weights for policy 0, policy_version 1513159 (0.0006) [2023-12-28 06:08:13,483][106226] Updated weights for policy 0, policy_version 1513169 (0.0005) [2023-12-28 06:08:14,011][106225] Updated weights for policy 1, policy_version 1516891 (0.0009) [2023-12-28 06:08:14,063][106225] Updated weights for policy 1, policy_version 1516901 (0.0006) [2023-12-28 06:08:14,124][106225] Updated weights for policy 1, policy_version 1516911 (0.0008) [2023-12-28 06:08:14,168][106226] Updated weights for policy 0, policy_version 1513179 (0.0007) [2023-12-28 06:08:14,226][106226] Updated weights for policy 0, policy_version 1513189 (0.0008) [2023-12-28 06:08:14,282][106226] Updated weights for policy 0, policy_version 1513199 (0.0008) [2023-12-28 06:08:14,826][106225] Updated weights for policy 1, policy_version 1516921 (0.0008) [2023-12-28 06:08:14,886][106225] Updated weights for policy 1, policy_version 1516931 (0.0009) [2023-12-28 06:08:14,948][106225] Updated weights for policy 1, policy_version 1516941 (0.0007) [2023-12-28 06:08:15,013][106225] Updated weights for policy 1, policy_version 1516951 (0.0008) [2023-12-28 06:08:15,023][106226] Updated weights for policy 0, policy_version 1513209 (0.0008) [2023-12-28 06:08:15,092][106226] Updated weights for policy 0, policy_version 1513219 (0.0009) [2023-12-28 06:08:15,155][106226] Updated weights for policy 0, policy_version 1513229 (0.0008) [2023-12-28 06:08:15,215][106226] Updated weights for policy 0, policy_version 1513239 (0.0008) [2023-12-28 06:08:15,728][106225] Updated weights for policy 1, policy_version 1516961 (0.0008) [2023-12-28 06:08:15,783][106225] Updated weights for policy 1, policy_version 1516971 (0.0008) [2023-12-28 06:08:15,843][106225] Updated weights for policy 1, policy_version 1516981 (0.0009) [2023-12-28 06:08:15,942][106226] Updated weights for policy 0, policy_version 1513249 (0.0009) [2023-12-28 06:08:16,001][106226] Updated weights for policy 0, policy_version 1513259 (0.0008) [2023-12-28 06:08:16,057][106226] Updated weights for policy 0, policy_version 1513269 (0.0007) [2023-12-28 06:08:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 775872512. Throughput: 0: 9963.8, 1: 9919.2. Samples: 775859468. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:16,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-4.471')] [2023-12-28 06:08:16,603][106225] Updated weights for policy 1, policy_version 1516991 (0.0006) [2023-12-28 06:08:16,655][106225] Updated weights for policy 1, policy_version 1517001 (0.0005) [2023-12-28 06:08:16,710][106225] Updated weights for policy 1, policy_version 1517011 (0.0006) [2023-12-28 06:08:16,759][106226] Updated weights for policy 0, policy_version 1513279 (0.0009) [2023-12-28 06:08:16,810][106226] Updated weights for policy 0, policy_version 1513289 (0.0009) [2023-12-28 06:08:16,860][106226] Updated weights for policy 0, policy_version 1513299 (0.0008) [2023-12-28 06:08:17,268][106225] Updated weights for policy 1, policy_version 1517021 (0.0005) [2023-12-28 06:08:17,317][106225] Updated weights for policy 1, policy_version 1517031 (0.0005) [2023-12-28 06:08:17,361][106225] Updated weights for policy 1, policy_version 1517041 (0.0005) [2023-12-28 06:08:17,706][106226] Updated weights for policy 0, policy_version 1513309 (0.0008) [2023-12-28 06:08:17,753][106226] Updated weights for policy 0, policy_version 1513319 (0.0008) [2023-12-28 06:08:17,803][106226] Updated weights for policy 0, policy_version 1513329 (0.0007) [2023-12-28 06:08:17,973][106225] Updated weights for policy 1, policy_version 1517051 (0.0005) [2023-12-28 06:08:18,040][106225] Updated weights for policy 1, policy_version 1517061 (0.0006) [2023-12-28 06:08:18,094][106225] Updated weights for policy 1, policy_version 1517071 (0.0008) [2023-12-28 06:08:18,565][106226] Updated weights for policy 0, policy_version 1513339 (0.0008) [2023-12-28 06:08:18,621][106226] Updated weights for policy 0, policy_version 1513349 (0.0008) [2023-12-28 06:08:18,683][106226] Updated weights for policy 0, policy_version 1513359 (0.0008) [2023-12-28 06:08:18,779][106225] Updated weights for policy 1, policy_version 1517081 (0.0010) [2023-12-28 06:08:18,846][106225] Updated weights for policy 1, policy_version 1517091 (0.0011) [2023-12-28 06:08:18,907][106225] Updated weights for policy 1, policy_version 1517101 (0.0010) [2023-12-28 06:08:18,971][106225] Updated weights for policy 1, policy_version 1517111 (0.0010) [2023-12-28 06:08:19,482][106226] Updated weights for policy 0, policy_version 1513369 (0.0008) [2023-12-28 06:08:19,541][106226] Updated weights for policy 0, policy_version 1513379 (0.0008) [2023-12-28 06:08:19,594][106226] Updated weights for policy 0, policy_version 1513389 (0.0008) [2023-12-28 06:08:19,637][106225] Updated weights for policy 1, policy_version 1517121 (0.0010) [2023-12-28 06:08:19,646][106226] Updated weights for policy 0, policy_version 1513399 (0.0008) [2023-12-28 06:08:19,701][106225] Updated weights for policy 1, policy_version 1517131 (0.0007) [2023-12-28 06:08:19,763][106225] Updated weights for policy 1, policy_version 1517141 (0.0009) [2023-12-28 06:08:20,411][106226] Updated weights for policy 0, policy_version 1513409 (0.0008) [2023-12-28 06:08:20,476][106226] Updated weights for policy 0, policy_version 1513419 (0.0007) [2023-12-28 06:08:20,505][106225] Updated weights for policy 1, policy_version 1517151 (0.0010) [2023-12-28 06:08:20,539][106226] Updated weights for policy 0, policy_version 1513429 (0.0006) [2023-12-28 06:08:20,571][106225] Updated weights for policy 1, policy_version 1517161 (0.0011) [2023-12-28 06:08:20,639][106225] Updated weights for policy 1, policy_version 1517171 (0.0011) [2023-12-28 06:08:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 775962624. Throughput: 0: 9868.7, 1: 9848.7. Samples: 775974540. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:21,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.814')] [2023-12-28 06:08:21,318][106226] Updated weights for policy 0, policy_version 1513439 (0.0008) [2023-12-28 06:08:21,318][106225] Updated weights for policy 1, policy_version 1517181 (0.0010) [2023-12-28 06:08:21,387][106226] Updated weights for policy 0, policy_version 1513449 (0.0008) [2023-12-28 06:08:21,388][106225] Updated weights for policy 1, policy_version 1517191 (0.0008) [2023-12-28 06:08:21,451][106225] Updated weights for policy 1, policy_version 1517201 (0.0007) [2023-12-28 06:08:21,453][106226] Updated weights for policy 0, policy_version 1513459 (0.0007) [2023-12-28 06:08:22,152][106226] Updated weights for policy 0, policy_version 1513469 (0.0007) [2023-12-28 06:08:22,166][106225] Updated weights for policy 1, policy_version 1517211 (0.0007) [2023-12-28 06:08:22,214][106226] Updated weights for policy 0, policy_version 1513479 (0.0007) [2023-12-28 06:08:22,237][106225] Updated weights for policy 1, policy_version 1517221 (0.0006) [2023-12-28 06:08:22,281][106226] Updated weights for policy 0, policy_version 1513489 (0.0011) [2023-12-28 06:08:22,298][106225] Updated weights for policy 1, policy_version 1517231 (0.0011) [2023-12-28 06:08:22,957][106226] Updated weights for policy 0, policy_version 1513499 (0.0010) [2023-12-28 06:08:23,026][106226] Updated weights for policy 0, policy_version 1513509 (0.0011) [2023-12-28 06:08:23,090][106226] Updated weights for policy 0, policy_version 1513519 (0.0011) [2023-12-28 06:08:23,100][106225] Updated weights for policy 1, policy_version 1517241 (0.0007) [2023-12-28 06:08:23,162][106225] Updated weights for policy 1, policy_version 1517251 (0.0008) [2023-12-28 06:08:23,222][106225] Updated weights for policy 1, policy_version 1517261 (0.0008) [2023-12-28 06:08:23,270][106225] Updated weights for policy 1, policy_version 1517271 (0.0008) [2023-12-28 06:08:23,651][106226] Updated weights for policy 0, policy_version 1513529 (0.0006) [2023-12-28 06:08:23,706][106226] Updated weights for policy 0, policy_version 1513539 (0.0005) [2023-12-28 06:08:23,760][106226] Updated weights for policy 0, policy_version 1513549 (0.0005) [2023-12-28 06:08:23,815][106226] Updated weights for policy 0, policy_version 1513559 (0.0007) [2023-12-28 06:08:24,100][106225] Updated weights for policy 1, policy_version 1517281 (0.0009) [2023-12-28 06:08:24,149][106225] Updated weights for policy 1, policy_version 1517291 (0.0007) [2023-12-28 06:08:24,212][106225] Updated weights for policy 1, policy_version 1517301 (0.0007) [2023-12-28 06:08:24,384][106226] Updated weights for policy 0, policy_version 1513569 (0.0005) [2023-12-28 06:08:24,433][106226] Updated weights for policy 0, policy_version 1513579 (0.0008) [2023-12-28 06:08:24,496][106226] Updated weights for policy 0, policy_version 1513589 (0.0009) [2023-12-28 06:08:24,968][106225] Updated weights for policy 1, policy_version 1517311 (0.0007) [2023-12-28 06:08:25,033][106225] Updated weights for policy 1, policy_version 1517321 (0.0009) [2023-12-28 06:08:25,093][106225] Updated weights for policy 1, policy_version 1517331 (0.0008) [2023-12-28 06:08:25,209][106226] Updated weights for policy 0, policy_version 1513599 (0.0009) [2023-12-28 06:08:25,260][106226] Updated weights for policy 0, policy_version 1513609 (0.0008) [2023-12-28 06:08:25,321][106226] Updated weights for policy 0, policy_version 1513619 (0.0008) [2023-12-28 06:08:25,794][106225] Updated weights for policy 1, policy_version 1517341 (0.0009) [2023-12-28 06:08:25,864][106225] Updated weights for policy 1, policy_version 1517351 (0.0008) [2023-12-28 06:08:25,910][106225] Updated weights for policy 1, policy_version 1517361 (0.0009) [2023-12-28 06:08:26,034][106226] Updated weights for policy 0, policy_version 1513629 (0.0007) [2023-12-28 06:08:26,093][106226] Updated weights for policy 0, policy_version 1513639 (0.0009) [2023-12-28 06:08:26,142][106226] Updated weights for policy 0, policy_version 1513649 (0.0008) [2023-12-28 06:08:26,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 776060928. Throughput: 0: 9877.5, 1: 9800.8. Samples: 776033748. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:26,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.447')] [2023-12-28 06:08:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001517368_388497408.pth... [2023-12-28 06:08:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001513656_387571712.pth... [2023-12-28 06:08:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001516216_388202496.pth [2023-12-28 06:08:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001512504_387276800.pth [2023-12-28 06:08:26,584][106225] Updated weights for policy 1, policy_version 1517371 (0.0008) [2023-12-28 06:08:26,629][106225] Updated weights for policy 1, policy_version 1517381 (0.0005) [2023-12-28 06:08:26,680][106225] Updated weights for policy 1, policy_version 1517391 (0.0005) [2023-12-28 06:08:26,934][106226] Updated weights for policy 0, policy_version 1513659 (0.0007) [2023-12-28 06:08:26,991][106226] Updated weights for policy 0, policy_version 1513669 (0.0007) [2023-12-28 06:08:27,059][106226] Updated weights for policy 0, policy_version 1513679 (0.0009) [2023-12-28 06:08:27,304][106225] Updated weights for policy 1, policy_version 1517401 (0.0006) [2023-12-28 06:08:27,358][106225] Updated weights for policy 1, policy_version 1517411 (0.0010) [2023-12-28 06:08:27,410][106225] Updated weights for policy 1, policy_version 1517421 (0.0010) [2023-12-28 06:08:27,465][106225] Updated weights for policy 1, policy_version 1517431 (0.0010) [2023-12-28 06:08:27,779][106226] Updated weights for policy 0, policy_version 1513689 (0.0008) [2023-12-28 06:08:27,827][106226] Updated weights for policy 0, policy_version 1513699 (0.0007) [2023-12-28 06:08:27,876][106226] Updated weights for policy 0, policy_version 1513709 (0.0008) [2023-12-28 06:08:27,926][106226] Updated weights for policy 0, policy_version 1513719 (0.0009) [2023-12-28 06:08:28,030][106225] Updated weights for policy 1, policy_version 1517441 (0.0010) [2023-12-28 06:08:28,086][106225] Updated weights for policy 1, policy_version 1517451 (0.0010) [2023-12-28 06:08:28,132][106225] Updated weights for policy 1, policy_version 1517461 (0.0010) [2023-12-28 06:08:28,649][106226] Updated weights for policy 0, policy_version 1513729 (0.0008) [2023-12-28 06:08:28,704][106226] Updated weights for policy 0, policy_version 1513739 (0.0008) [2023-12-28 06:08:28,758][106226] Updated weights for policy 0, policy_version 1513749 (0.0008) [2023-12-28 06:08:28,866][106225] Updated weights for policy 1, policy_version 1517471 (0.0011) [2023-12-28 06:08:28,925][106225] Updated weights for policy 1, policy_version 1517481 (0.0010) [2023-12-28 06:08:28,971][106225] Updated weights for policy 1, policy_version 1517491 (0.0008) [2023-12-28 06:08:29,474][106226] Updated weights for policy 0, policy_version 1513759 (0.0008) [2023-12-28 06:08:29,534][106226] Updated weights for policy 0, policy_version 1513769 (0.0008) [2023-12-28 06:08:29,600][106226] Updated weights for policy 0, policy_version 1513779 (0.0008) [2023-12-28 06:08:29,706][106225] Updated weights for policy 1, policy_version 1517501 (0.0007) [2023-12-28 06:08:29,773][106225] Updated weights for policy 1, policy_version 1517511 (0.0008) [2023-12-28 06:08:29,844][106225] Updated weights for policy 1, policy_version 1517521 (0.0010) [2023-12-28 06:08:30,283][106226] Updated weights for policy 0, policy_version 1513789 (0.0009) [2023-12-28 06:08:30,337][106226] Updated weights for policy 0, policy_version 1513799 (0.0009) [2023-12-28 06:08:30,397][106226] Updated weights for policy 0, policy_version 1513809 (0.0008) [2023-12-28 06:08:30,586][106225] Updated weights for policy 1, policy_version 1517531 (0.0008) [2023-12-28 06:08:30,638][106225] Updated weights for policy 1, policy_version 1517541 (0.0008) [2023-12-28 06:08:30,682][106225] Updated weights for policy 1, policy_version 1517551 (0.0008) [2023-12-28 06:08:31,161][106226] Updated weights for policy 0, policy_version 1513819 (0.0009) [2023-12-28 06:08:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 776159232. Throughput: 0: 9885.2, 1: 9842.4. Samples: 776152980. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:31,175][105115] Avg episode reward: [(0, '-4.833'), (1, '-4.539')] [2023-12-28 06:08:31,229][106226] Updated weights for policy 0, policy_version 1513829 (0.0008) [2023-12-28 06:08:31,291][106226] Updated weights for policy 0, policy_version 1513839 (0.0007) [2023-12-28 06:08:31,327][106225] Updated weights for policy 1, policy_version 1517561 (0.0008) [2023-12-28 06:08:31,396][106225] Updated weights for policy 1, policy_version 1517571 (0.0008) [2023-12-28 06:08:31,464][106225] Updated weights for policy 1, policy_version 1517581 (0.0008) [2023-12-28 06:08:31,538][106225] Updated weights for policy 1, policy_version 1517591 (0.0010) [2023-12-28 06:08:32,005][106226] Updated weights for policy 0, policy_version 1513849 (0.0008) [2023-12-28 06:08:32,064][106226] Updated weights for policy 0, policy_version 1513859 (0.0009) [2023-12-28 06:08:32,132][106226] Updated weights for policy 0, policy_version 1513869 (0.0008) [2023-12-28 06:08:32,187][106226] Updated weights for policy 0, policy_version 1513879 (0.0009) [2023-12-28 06:08:32,287][106225] Updated weights for policy 1, policy_version 1517601 (0.0006) [2023-12-28 06:08:32,353][106225] Updated weights for policy 1, policy_version 1517611 (0.0007) [2023-12-28 06:08:32,405][106225] Updated weights for policy 1, policy_version 1517621 (0.0006) [2023-12-28 06:08:32,960][106226] Updated weights for policy 0, policy_version 1513889 (0.0009) [2023-12-28 06:08:33,018][106226] Updated weights for policy 0, policy_version 1513899 (0.0007) [2023-12-28 06:08:33,047][106225] Updated weights for policy 1, policy_version 1517631 (0.0007) [2023-12-28 06:08:33,069][106226] Updated weights for policy 0, policy_version 1513909 (0.0005) [2023-12-28 06:08:33,096][106225] Updated weights for policy 1, policy_version 1517641 (0.0009) [2023-12-28 06:08:33,150][106225] Updated weights for policy 1, policy_version 1517651 (0.0008) [2023-12-28 06:08:33,751][106226] Updated weights for policy 0, policy_version 1513919 (0.0007) [2023-12-28 06:08:33,810][106226] Updated weights for policy 0, policy_version 1513929 (0.0008) [2023-12-28 06:08:33,836][106225] Updated weights for policy 1, policy_version 1517661 (0.0009) [2023-12-28 06:08:33,861][106226] Updated weights for policy 0, policy_version 1513939 (0.0007) [2023-12-28 06:08:33,892][106225] Updated weights for policy 1, policy_version 1517671 (0.0010) [2023-12-28 06:08:33,959][106225] Updated weights for policy 1, policy_version 1517681 (0.0008) [2023-12-28 06:08:34,653][106225] Updated weights for policy 1, policy_version 1517691 (0.0006) [2023-12-28 06:08:34,663][106226] Updated weights for policy 0, policy_version 1513949 (0.0008) [2023-12-28 06:08:34,717][106225] Updated weights for policy 1, policy_version 1517701 (0.0005) [2023-12-28 06:08:34,724][106226] Updated weights for policy 0, policy_version 1513959 (0.0009) [2023-12-28 06:08:34,780][106225] Updated weights for policy 1, policy_version 1517711 (0.0006) [2023-12-28 06:08:34,781][106226] Updated weights for policy 0, policy_version 1513969 (0.0008) [2023-12-28 06:08:35,378][106225] Updated weights for policy 1, policy_version 1517721 (0.0006) [2023-12-28 06:08:35,441][106225] Updated weights for policy 1, policy_version 1517731 (0.0010) [2023-12-28 06:08:35,508][106225] Updated weights for policy 1, policy_version 1517741 (0.0010) [2023-12-28 06:08:35,514][106226] Updated weights for policy 0, policy_version 1513979 (0.0008) [2023-12-28 06:08:35,558][106226] Updated weights for policy 0, policy_version 1513989 (0.0007) [2023-12-28 06:08:35,561][106225] Updated weights for policy 1, policy_version 1517751 (0.0010) [2023-12-28 06:08:35,611][106226] Updated weights for policy 0, policy_version 1513999 (0.0007) [2023-12-28 06:08:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 776257536. Throughput: 0: 9830.2, 1: 9898.6. Samples: 776270956. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:36,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.719')] [2023-12-28 06:08:36,211][106225] Updated weights for policy 1, policy_version 1517761 (0.0010) [2023-12-28 06:08:36,272][106226] Updated weights for policy 0, policy_version 1514009 (0.0006) [2023-12-28 06:08:36,280][106225] Updated weights for policy 1, policy_version 1517771 (0.0009) [2023-12-28 06:08:36,336][106226] Updated weights for policy 0, policy_version 1514019 (0.0010) [2023-12-28 06:08:36,345][106225] Updated weights for policy 1, policy_version 1517781 (0.0010) [2023-12-28 06:08:36,398][106226] Updated weights for policy 0, policy_version 1514029 (0.0011) [2023-12-28 06:08:36,467][106226] Updated weights for policy 0, policy_version 1514039 (0.0011) [2023-12-28 06:08:36,997][106225] Updated weights for policy 1, policy_version 1517791 (0.0007) [2023-12-28 06:08:37,057][106225] Updated weights for policy 1, policy_version 1517801 (0.0006) [2023-12-28 06:08:37,112][106225] Updated weights for policy 1, policy_version 1517811 (0.0007) [2023-12-28 06:08:37,143][106226] Updated weights for policy 0, policy_version 1514049 (0.0008) [2023-12-28 06:08:37,215][106226] Updated weights for policy 0, policy_version 1514059 (0.0008) [2023-12-28 06:08:37,277][106226] Updated weights for policy 0, policy_version 1514069 (0.0008) [2023-12-28 06:08:37,670][106225] Updated weights for policy 1, policy_version 1517821 (0.0006) [2023-12-28 06:08:37,733][106225] Updated weights for policy 1, policy_version 1517831 (0.0005) [2023-12-28 06:08:37,781][106225] Updated weights for policy 1, policy_version 1517841 (0.0005) [2023-12-28 06:08:37,953][106226] Updated weights for policy 0, policy_version 1514079 (0.0010) [2023-12-28 06:08:38,010][106226] Updated weights for policy 0, policy_version 1514089 (0.0010) [2023-12-28 06:08:38,063][106226] Updated weights for policy 0, policy_version 1514099 (0.0010) [2023-12-28 06:08:38,420][106225] Updated weights for policy 1, policy_version 1517851 (0.0006) [2023-12-28 06:08:38,473][106225] Updated weights for policy 1, policy_version 1517861 (0.0008) [2023-12-28 06:08:38,535][106225] Updated weights for policy 1, policy_version 1517871 (0.0007) [2023-12-28 06:08:38,747][106226] Updated weights for policy 0, policy_version 1514109 (0.0008) [2023-12-28 06:08:38,810][106226] Updated weights for policy 0, policy_version 1514119 (0.0010) [2023-12-28 06:08:38,860][106226] Updated weights for policy 0, policy_version 1514129 (0.0010) [2023-12-28 06:08:39,242][106225] Updated weights for policy 1, policy_version 1517881 (0.0006) [2023-12-28 06:08:39,313][106225] Updated weights for policy 1, policy_version 1517891 (0.0009) [2023-12-28 06:08:39,387][106225] Updated weights for policy 1, policy_version 1517901 (0.0008) [2023-12-28 06:08:39,450][106225] Updated weights for policy 1, policy_version 1517911 (0.0007) [2023-12-28 06:08:39,663][106226] Updated weights for policy 0, policy_version 1514139 (0.0009) [2023-12-28 06:08:39,731][106226] Updated weights for policy 0, policy_version 1514149 (0.0008) [2023-12-28 06:08:39,800][106226] Updated weights for policy 0, policy_version 1514159 (0.0011) [2023-12-28 06:08:40,122][106225] Updated weights for policy 1, policy_version 1517921 (0.0008) [2023-12-28 06:08:40,181][106225] Updated weights for policy 1, policy_version 1517931 (0.0008) [2023-12-28 06:08:40,237][106225] Updated weights for policy 1, policy_version 1517941 (0.0008) [2023-12-28 06:08:40,399][106226] Updated weights for policy 0, policy_version 1514169 (0.0009) [2023-12-28 06:08:40,454][106226] Updated weights for policy 0, policy_version 1514179 (0.0008) [2023-12-28 06:08:40,508][106226] Updated weights for policy 0, policy_version 1514189 (0.0008) [2023-12-28 06:08:40,559][106226] Updated weights for policy 0, policy_version 1514199 (0.0008) [2023-12-28 06:08:40,939][106225] Updated weights for policy 1, policy_version 1517951 (0.0008) [2023-12-28 06:08:40,990][106225] Updated weights for policy 1, policy_version 1517961 (0.0009) [2023-12-28 06:08:41,050][106225] Updated weights for policy 1, policy_version 1517971 (0.0008) [2023-12-28 06:08:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 776364032. Throughput: 0: 9798.0, 1: 9965.4. Samples: 776332924. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:41,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.807')] [2023-12-28 06:08:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001517976_388653056.pth... [2023-12-28 06:08:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001514200_387710976.pth... [2023-12-28 06:08:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001516792_388349952.pth [2023-12-28 06:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001513080_387424256.pth [2023-12-28 06:08:41,317][106226] Updated weights for policy 0, policy_version 1514209 (0.0008) [2023-12-28 06:08:41,391][106226] Updated weights for policy 0, policy_version 1514219 (0.0007) [2023-12-28 06:08:41,459][106226] Updated weights for policy 0, policy_version 1514229 (0.0007) [2023-12-28 06:08:41,872][106225] Updated weights for policy 1, policy_version 1517981 (0.0007) [2023-12-28 06:08:41,936][106225] Updated weights for policy 1, policy_version 1517991 (0.0008) [2023-12-28 06:08:42,005][106225] Updated weights for policy 1, policy_version 1518001 (0.0009) [2023-12-28 06:08:42,187][106226] Updated weights for policy 0, policy_version 1514239 (0.0006) [2023-12-28 06:08:42,251][106226] Updated weights for policy 0, policy_version 1514249 (0.0007) [2023-12-28 06:08:42,317][106226] Updated weights for policy 0, policy_version 1514259 (0.0009) [2023-12-28 06:08:42,656][106225] Updated weights for policy 1, policy_version 1518011 (0.0007) [2023-12-28 06:08:42,712][106225] Updated weights for policy 1, policy_version 1518021 (0.0005) [2023-12-28 06:08:42,772][106225] Updated weights for policy 1, policy_version 1518031 (0.0005) [2023-12-28 06:08:43,070][106226] Updated weights for policy 0, policy_version 1514269 (0.0009) [2023-12-28 06:08:43,124][106226] Updated weights for policy 0, policy_version 1514279 (0.0008) [2023-12-28 06:08:43,183][106226] Updated weights for policy 0, policy_version 1514289 (0.0009) [2023-12-28 06:08:43,424][106225] Updated weights for policy 1, policy_version 1518041 (0.0007) [2023-12-28 06:08:43,481][106225] Updated weights for policy 1, policy_version 1518051 (0.0008) [2023-12-28 06:08:43,539][106225] Updated weights for policy 1, policy_version 1518061 (0.0006) [2023-12-28 06:08:43,602][106225] Updated weights for policy 1, policy_version 1518071 (0.0007) [2023-12-28 06:08:43,857][106226] Updated weights for policy 0, policy_version 1514299 (0.0007) [2023-12-28 06:08:43,925][106226] Updated weights for policy 0, policy_version 1514309 (0.0005) [2023-12-28 06:08:43,989][106226] Updated weights for policy 0, policy_version 1514319 (0.0006) [2023-12-28 06:08:44,232][106225] Updated weights for policy 1, policy_version 1518081 (0.0009) [2023-12-28 06:08:44,296][106225] Updated weights for policy 1, policy_version 1518091 (0.0005) [2023-12-28 06:08:44,349][106225] Updated weights for policy 1, policy_version 1518101 (0.0005) [2023-12-28 06:08:44,645][106226] Updated weights for policy 0, policy_version 1514329 (0.0006) [2023-12-28 06:08:44,701][106226] Updated weights for policy 0, policy_version 1514339 (0.0006) [2023-12-28 06:08:44,764][106226] Updated weights for policy 0, policy_version 1514349 (0.0007) [2023-12-28 06:08:44,828][106226] Updated weights for policy 0, policy_version 1514359 (0.0007) [2023-12-28 06:08:44,936][106225] Updated weights for policy 1, policy_version 1518111 (0.0008) [2023-12-28 06:08:44,997][106225] Updated weights for policy 1, policy_version 1518121 (0.0008) [2023-12-28 06:08:45,057][106225] Updated weights for policy 1, policy_version 1518131 (0.0008) [2023-12-28 06:08:45,522][106226] Updated weights for policy 0, policy_version 1514369 (0.0010) [2023-12-28 06:08:45,583][106226] Updated weights for policy 0, policy_version 1514379 (0.0009) [2023-12-28 06:08:45,653][106226] Updated weights for policy 0, policy_version 1514389 (0.0011) [2023-12-28 06:08:45,711][106225] Updated weights for policy 1, policy_version 1518141 (0.0007) [2023-12-28 06:08:45,765][106225] Updated weights for policy 1, policy_version 1518151 (0.0006) [2023-12-28 06:08:45,814][106225] Updated weights for policy 1, policy_version 1518161 (0.0008) [2023-12-28 06:08:46,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 776462336. Throughput: 0: 9790.9, 1: 9958.1. Samples: 776451872. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:46,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-4.720')] [2023-12-28 06:08:46,402][106226] Updated weights for policy 0, policy_version 1514399 (0.0009) [2023-12-28 06:08:46,451][106226] Updated weights for policy 0, policy_version 1514409 (0.0008) [2023-12-28 06:08:46,499][106226] Updated weights for policy 0, policy_version 1514419 (0.0009) [2023-12-28 06:08:46,530][106225] Updated weights for policy 1, policy_version 1518171 (0.0007) [2023-12-28 06:08:46,589][106225] Updated weights for policy 1, policy_version 1518181 (0.0008) [2023-12-28 06:08:46,648][106225] Updated weights for policy 1, policy_version 1518191 (0.0008) [2023-12-28 06:08:47,251][106226] Updated weights for policy 0, policy_version 1514429 (0.0008) [2023-12-28 06:08:47,313][106226] Updated weights for policy 0, policy_version 1514439 (0.0008) [2023-12-28 06:08:47,377][106226] Updated weights for policy 0, policy_version 1514449 (0.0009) [2023-12-28 06:08:47,379][106225] Updated weights for policy 1, policy_version 1518201 (0.0008) [2023-12-28 06:08:47,431][106225] Updated weights for policy 1, policy_version 1518211 (0.0006) [2023-12-28 06:08:47,480][106225] Updated weights for policy 1, policy_version 1518221 (0.0008) [2023-12-28 06:08:47,536][106225] Updated weights for policy 1, policy_version 1518231 (0.0007) [2023-12-28 06:08:48,131][106226] Updated weights for policy 0, policy_version 1514459 (0.0009) [2023-12-28 06:08:48,179][106226] Updated weights for policy 0, policy_version 1514469 (0.0009) [2023-12-28 06:08:48,204][106225] Updated weights for policy 1, policy_version 1518241 (0.0007) [2023-12-28 06:08:48,244][106226] Updated weights for policy 0, policy_version 1514479 (0.0007) [2023-12-28 06:08:48,256][106225] Updated weights for policy 1, policy_version 1518251 (0.0007) [2023-12-28 06:08:48,323][106225] Updated weights for policy 1, policy_version 1518261 (0.0008) [2023-12-28 06:08:48,917][106226] Updated weights for policy 0, policy_version 1514489 (0.0007) [2023-12-28 06:08:48,969][106226] Updated weights for policy 0, policy_version 1514499 (0.0008) [2023-12-28 06:08:49,024][106226] Updated weights for policy 0, policy_version 1514509 (0.0009) [2023-12-28 06:08:49,089][106225] Updated weights for policy 1, policy_version 1518271 (0.0007) [2023-12-28 06:08:49,090][106226] Updated weights for policy 0, policy_version 1514519 (0.0009) [2023-12-28 06:08:49,144][106225] Updated weights for policy 1, policy_version 1518281 (0.0006) [2023-12-28 06:08:49,212][106225] Updated weights for policy 1, policy_version 1518291 (0.0006) [2023-12-28 06:08:49,806][106225] Updated weights for policy 1, policy_version 1518301 (0.0009) [2023-12-28 06:08:49,865][106225] Updated weights for policy 1, policy_version 1518311 (0.0008) [2023-12-28 06:08:49,889][106226] Updated weights for policy 0, policy_version 1514529 (0.0007) [2023-12-28 06:08:49,931][106225] Updated weights for policy 1, policy_version 1518321 (0.0008) [2023-12-28 06:08:49,950][106226] Updated weights for policy 0, policy_version 1514539 (0.0007) [2023-12-28 06:08:50,012][106226] Updated weights for policy 0, policy_version 1514549 (0.0009) [2023-12-28 06:08:50,673][106225] Updated weights for policy 1, policy_version 1518331 (0.0009) [2023-12-28 06:08:50,740][106225] Updated weights for policy 1, policy_version 1518341 (0.0008) [2023-12-28 06:08:50,742][106226] Updated weights for policy 0, policy_version 1514559 (0.0007) [2023-12-28 06:08:50,797][106225] Updated weights for policy 1, policy_version 1518351 (0.0007) [2023-12-28 06:08:50,804][106226] Updated weights for policy 0, policy_version 1514569 (0.0006) [2023-12-28 06:08:50,873][106226] Updated weights for policy 0, policy_version 1514579 (0.0007) [2023-12-28 06:08:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 776560640. Throughput: 0: 9702.0, 1: 9968.4. Samples: 776569380. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:51,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.674')] [2023-12-28 06:08:51,462][106226] Updated weights for policy 0, policy_version 1514589 (0.0009) [2023-12-28 06:08:51,491][106225] Updated weights for policy 1, policy_version 1518361 (0.0007) [2023-12-28 06:08:51,516][106226] Updated weights for policy 0, policy_version 1514599 (0.0008) [2023-12-28 06:08:51,543][106225] Updated weights for policy 1, policy_version 1518371 (0.0006) [2023-12-28 06:08:51,578][106226] Updated weights for policy 0, policy_version 1514609 (0.0008) [2023-12-28 06:08:51,612][106225] Updated weights for policy 1, policy_version 1518381 (0.0008) [2023-12-28 06:08:51,675][106225] Updated weights for policy 1, policy_version 1518391 (0.0007) [2023-12-28 06:08:52,273][106226] Updated weights for policy 0, policy_version 1514619 (0.0008) [2023-12-28 06:08:52,319][106225] Updated weights for policy 1, policy_version 1518401 (0.0006) [2023-12-28 06:08:52,330][106226] Updated weights for policy 0, policy_version 1514629 (0.0009) [2023-12-28 06:08:52,389][106225] Updated weights for policy 1, policy_version 1518411 (0.0006) [2023-12-28 06:08:52,395][106226] Updated weights for policy 0, policy_version 1514639 (0.0008) [2023-12-28 06:08:52,445][106225] Updated weights for policy 1, policy_version 1518421 (0.0007) [2023-12-28 06:08:53,149][106226] Updated weights for policy 0, policy_version 1514649 (0.0006) [2023-12-28 06:08:53,166][106225] Updated weights for policy 1, policy_version 1518431 (0.0008) [2023-12-28 06:08:53,207][106226] Updated weights for policy 0, policy_version 1514659 (0.0006) [2023-12-28 06:08:53,223][106225] Updated weights for policy 1, policy_version 1518441 (0.0006) [2023-12-28 06:08:53,262][106226] Updated weights for policy 0, policy_version 1514669 (0.0007) [2023-12-28 06:08:53,285][106225] Updated weights for policy 1, policy_version 1518451 (0.0008) [2023-12-28 06:08:53,321][106226] Updated weights for policy 0, policy_version 1514679 (0.0005) [2023-12-28 06:08:53,874][106226] Updated weights for policy 0, policy_version 1514689 (0.0005) [2023-12-28 06:08:53,937][106226] Updated weights for policy 0, policy_version 1514699 (0.0005) [2023-12-28 06:08:54,005][106226] Updated weights for policy 0, policy_version 1514709 (0.0005) [2023-12-28 06:08:54,093][106225] Updated weights for policy 1, policy_version 1518461 (0.0007) [2023-12-28 06:08:54,153][106225] Updated weights for policy 1, policy_version 1518471 (0.0008) [2023-12-28 06:08:54,208][106225] Updated weights for policy 1, policy_version 1518481 (0.0008) [2023-12-28 06:08:54,564][106226] Updated weights for policy 0, policy_version 1514719 (0.0005) [2023-12-28 06:08:54,621][106226] Updated weights for policy 0, policy_version 1514729 (0.0007) [2023-12-28 06:08:54,692][106226] Updated weights for policy 0, policy_version 1514739 (0.0005) [2023-12-28 06:08:55,027][106225] Updated weights for policy 1, policy_version 1518491 (0.0009) [2023-12-28 06:08:55,072][106225] Updated weights for policy 1, policy_version 1518501 (0.0008) [2023-12-28 06:08:55,133][106225] Updated weights for policy 1, policy_version 1518511 (0.0009) [2023-12-28 06:08:55,356][106226] Updated weights for policy 0, policy_version 1514749 (0.0007) [2023-12-28 06:08:55,413][106226] Updated weights for policy 0, policy_version 1514759 (0.0009) [2023-12-28 06:08:55,470][106226] Updated weights for policy 0, policy_version 1514769 (0.0009) [2023-12-28 06:08:55,860][106225] Updated weights for policy 1, policy_version 1518521 (0.0008) [2023-12-28 06:08:55,917][106225] Updated weights for policy 1, policy_version 1518531 (0.0009) [2023-12-28 06:08:55,966][106225] Updated weights for policy 1, policy_version 1518541 (0.0007) [2023-12-28 06:08:56,020][106225] Updated weights for policy 1, policy_version 1518552 (0.0009) [2023-12-28 06:08:56,143][106226] Updated weights for policy 0, policy_version 1514779 (0.0009) [2023-12-28 06:08:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 776658944. Throughput: 0: 9706.8, 1: 9964.5. Samples: 776629840. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:08:56,175][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.852')] [2023-12-28 06:08:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001518552_388800512.pth... [2023-12-28 06:08:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001517368_388497408.pth [2023-12-28 06:08:56,199][106226] Updated weights for policy 0, policy_version 1514789 (0.0008) [2023-12-28 06:08:56,252][106226] Updated weights for policy 0, policy_version 1514799 (0.0008) [2023-12-28 06:08:56,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001514808_387866624.pth... [2023-12-28 06:08:56,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001513656_387571712.pth [2023-12-28 06:08:56,681][106225] Updated weights for policy 1, policy_version 1518562 (0.0008) [2023-12-28 06:08:56,735][106225] Updated weights for policy 1, policy_version 1518572 (0.0008) [2023-12-28 06:08:56,793][106225] Updated weights for policy 1, policy_version 1518582 (0.0006) [2023-12-28 06:08:57,030][106226] Updated weights for policy 0, policy_version 1514809 (0.0007) [2023-12-28 06:08:57,091][106226] Updated weights for policy 0, policy_version 1514819 (0.0005) [2023-12-28 06:08:57,137][106226] Updated weights for policy 0, policy_version 1514829 (0.0005) [2023-12-28 06:08:57,185][106226] Updated weights for policy 0, policy_version 1514839 (0.0005) [2023-12-28 06:08:57,513][106225] Updated weights for policy 1, policy_version 1518592 (0.0008) [2023-12-28 06:08:57,565][106225] Updated weights for policy 1, policy_version 1518602 (0.0007) [2023-12-28 06:08:57,613][106225] Updated weights for policy 1, policy_version 1518612 (0.0007) [2023-12-28 06:08:57,759][106226] Updated weights for policy 0, policy_version 1514849 (0.0010) [2023-12-28 06:08:57,805][106226] Updated weights for policy 0, policy_version 1514859 (0.0010) [2023-12-28 06:08:57,861][106226] Updated weights for policy 0, policy_version 1514869 (0.0010) [2023-12-28 06:08:58,252][106225] Updated weights for policy 1, policy_version 1518622 (0.0007) [2023-12-28 06:08:58,312][106225] Updated weights for policy 1, policy_version 1518632 (0.0009) [2023-12-28 06:08:58,380][106225] Updated weights for policy 1, policy_version 1518642 (0.0009) [2023-12-28 06:08:58,610][106226] Updated weights for policy 0, policy_version 1514879 (0.0009) [2023-12-28 06:08:58,673][106226] Updated weights for policy 0, policy_version 1514889 (0.0010) [2023-12-28 06:08:58,747][106226] Updated weights for policy 0, policy_version 1514900 (0.0009) [2023-12-28 06:08:59,195][106225] Updated weights for policy 1, policy_version 1518652 (0.0008) [2023-12-28 06:08:59,263][106225] Updated weights for policy 1, policy_version 1518662 (0.0012) [2023-12-28 06:08:59,327][106225] Updated weights for policy 1, policy_version 1518672 (0.0010) [2023-12-28 06:08:59,503][106226] Updated weights for policy 0, policy_version 1514910 (0.0010) [2023-12-28 06:08:59,566][106226] Updated weights for policy 0, policy_version 1514920 (0.0010) [2023-12-28 06:08:59,627][106226] Updated weights for policy 0, policy_version 1514930 (0.0011) [2023-12-28 06:09:00,083][106225] Updated weights for policy 1, policy_version 1518682 (0.0009) [2023-12-28 06:09:00,144][106225] Updated weights for policy 1, policy_version 1518692 (0.0010) [2023-12-28 06:09:00,190][106225] Updated weights for policy 1, policy_version 1518702 (0.0010) [2023-12-28 06:09:00,238][106225] Updated weights for policy 1, policy_version 1518712 (0.0010) [2023-12-28 06:09:00,332][106226] Updated weights for policy 0, policy_version 1514940 (0.0009) [2023-12-28 06:09:00,395][106226] Updated weights for policy 0, policy_version 1514950 (0.0009) [2023-12-28 06:09:00,454][106226] Updated weights for policy 0, policy_version 1514960 (0.0008) [2023-12-28 06:09:00,884][106225] Updated weights for policy 1, policy_version 1518722 (0.0010) [2023-12-28 06:09:00,933][106225] Updated weights for policy 1, policy_version 1518732 (0.0010) [2023-12-28 06:09:00,977][106225] Updated weights for policy 1, policy_version 1518742 (0.0010) [2023-12-28 06:09:01,124][106226] Updated weights for policy 0, policy_version 1514970 (0.0009) [2023-12-28 06:09:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 776757248. Throughput: 0: 9767.8, 1: 9948.7. Samples: 776746712. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:01,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.808')] [2023-12-28 06:09:01,192][106226] Updated weights for policy 0, policy_version 1514980 (0.0008) [2023-12-28 06:09:01,252][106226] Updated weights for policy 0, policy_version 1514990 (0.0007) [2023-12-28 06:09:01,304][106226] Updated weights for policy 0, policy_version 1515000 (0.0010) [2023-12-28 06:09:01,709][106225] Updated weights for policy 1, policy_version 1518752 (0.0010) [2023-12-28 06:09:01,778][106225] Updated weights for policy 1, policy_version 1518762 (0.0011) [2023-12-28 06:09:01,835][106225] Updated weights for policy 1, policy_version 1518772 (0.0010) [2023-12-28 06:09:02,078][106226] Updated weights for policy 0, policy_version 1515010 (0.0008) [2023-12-28 06:09:02,131][106226] Updated weights for policy 0, policy_version 1515020 (0.0008) [2023-12-28 06:09:02,191][106226] Updated weights for policy 0, policy_version 1515030 (0.0008) [2023-12-28 06:09:02,567][106225] Updated weights for policy 1, policy_version 1518782 (0.0011) [2023-12-28 06:09:02,621][106225] Updated weights for policy 1, policy_version 1518792 (0.0010) [2023-12-28 06:09:02,684][106225] Updated weights for policy 1, policy_version 1518802 (0.0007) [2023-12-28 06:09:02,900][106226] Updated weights for policy 0, policy_version 1515040 (0.0010) [2023-12-28 06:09:02,967][106226] Updated weights for policy 0, policy_version 1515050 (0.0010) [2023-12-28 06:09:03,027][106226] Updated weights for policy 0, policy_version 1515060 (0.0008) [2023-12-28 06:09:03,342][106225] Updated weights for policy 1, policy_version 1518812 (0.0007) [2023-12-28 06:09:03,393][106225] Updated weights for policy 1, policy_version 1518822 (0.0005) [2023-12-28 06:09:03,438][106225] Updated weights for policy 1, policy_version 1518832 (0.0005) [2023-12-28 06:09:03,554][106226] Updated weights for policy 0, policy_version 1515070 (0.0005) [2023-12-28 06:09:03,607][106226] Updated weights for policy 0, policy_version 1515080 (0.0005) [2023-12-28 06:09:03,658][106226] Updated weights for policy 0, policy_version 1515090 (0.0005) [2023-12-28 06:09:04,060][106225] Updated weights for policy 1, policy_version 1518842 (0.0006) [2023-12-28 06:09:04,128][106225] Updated weights for policy 1, policy_version 1518852 (0.0006) [2023-12-28 06:09:04,183][106225] Updated weights for policy 1, policy_version 1518862 (0.0006) [2023-12-28 06:09:04,245][106225] Updated weights for policy 1, policy_version 1518872 (0.0006) [2023-12-28 06:09:04,308][106226] Updated weights for policy 0, policy_version 1515100 (0.0005) [2023-12-28 06:09:04,377][106226] Updated weights for policy 0, policy_version 1515110 (0.0006) [2023-12-28 06:09:04,442][106226] Updated weights for policy 0, policy_version 1515120 (0.0008) [2023-12-28 06:09:04,886][106225] Updated weights for policy 1, policy_version 1518882 (0.0005) [2023-12-28 06:09:04,945][106225] Updated weights for policy 1, policy_version 1518892 (0.0006) [2023-12-28 06:09:04,996][106225] Updated weights for policy 1, policy_version 1518902 (0.0005) [2023-12-28 06:09:05,037][106226] Updated weights for policy 0, policy_version 1515130 (0.0009) [2023-12-28 06:09:05,091][106226] Updated weights for policy 0, policy_version 1515140 (0.0011) [2023-12-28 06:09:05,151][106226] Updated weights for policy 0, policy_version 1515150 (0.0011) [2023-12-28 06:09:05,204][106226] Updated weights for policy 0, policy_version 1515160 (0.0011) [2023-12-28 06:09:05,544][106225] Updated weights for policy 1, policy_version 1518912 (0.0005) [2023-12-28 06:09:05,594][106225] Updated weights for policy 1, policy_version 1518922 (0.0006) [2023-12-28 06:09:05,650][106225] Updated weights for policy 1, policy_version 1518932 (0.0010) [2023-12-28 06:09:05,917][106226] Updated weights for policy 0, policy_version 1515170 (0.0011) [2023-12-28 06:09:05,974][106226] Updated weights for policy 0, policy_version 1515180 (0.0011) [2023-12-28 06:09:06,020][106226] Updated weights for policy 0, policy_version 1515190 (0.0010) [2023-12-28 06:09:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 776863744. Throughput: 0: 9912.7, 1: 10016.4. Samples: 776871352. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:06,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.778')] [2023-12-28 06:09:06,352][106225] Updated weights for policy 1, policy_version 1518942 (0.0008) [2023-12-28 06:09:06,408][106225] Updated weights for policy 1, policy_version 1518952 (0.0005) [2023-12-28 06:09:06,465][106225] Updated weights for policy 1, policy_version 1518962 (0.0006) [2023-12-28 06:09:06,765][106226] Updated weights for policy 0, policy_version 1515200 (0.0011) [2023-12-28 06:09:06,822][106226] Updated weights for policy 0, policy_version 1515210 (0.0011) [2023-12-28 06:09:06,886][106226] Updated weights for policy 0, policy_version 1515220 (0.0011) [2023-12-28 06:09:07,095][106225] Updated weights for policy 1, policy_version 1518972 (0.0007) [2023-12-28 06:09:07,150][106225] Updated weights for policy 1, policy_version 1518982 (0.0008) [2023-12-28 06:09:07,216][106225] Updated weights for policy 1, policy_version 1518992 (0.0008) [2023-12-28 06:09:07,606][106226] Updated weights for policy 0, policy_version 1515230 (0.0011) [2023-12-28 06:09:07,663][106226] Updated weights for policy 0, policy_version 1515240 (0.0011) [2023-12-28 06:09:07,717][106226] Updated weights for policy 0, policy_version 1515250 (0.0011) [2023-12-28 06:09:07,972][106225] Updated weights for policy 1, policy_version 1519002 (0.0008) [2023-12-28 06:09:08,037][106225] Updated weights for policy 1, policy_version 1519012 (0.0008) [2023-12-28 06:09:08,104][106225] Updated weights for policy 1, policy_version 1519022 (0.0006) [2023-12-28 06:09:08,159][106225] Updated weights for policy 1, policy_version 1519032 (0.0008) [2023-12-28 06:09:08,420][106226] Updated weights for policy 0, policy_version 1515260 (0.0010) [2023-12-28 06:09:08,484][106226] Updated weights for policy 0, policy_version 1515270 (0.0011) [2023-12-28 06:09:08,537][106226] Updated weights for policy 0, policy_version 1515280 (0.0010) [2023-12-28 06:09:08,866][106225] Updated weights for policy 1, policy_version 1519042 (0.0010) [2023-12-28 06:09:08,916][106225] Updated weights for policy 1, policy_version 1519052 (0.0008) [2023-12-28 06:09:08,962][106225] Updated weights for policy 1, policy_version 1519062 (0.0010) [2023-12-28 06:09:09,198][106226] Updated weights for policy 0, policy_version 1515290 (0.0007) [2023-12-28 06:09:09,268][106226] Updated weights for policy 0, policy_version 1515300 (0.0008) [2023-12-28 06:09:09,336][106226] Updated weights for policy 0, policy_version 1515310 (0.0010) [2023-12-28 06:09:09,407][106226] Updated weights for policy 0, policy_version 1515320 (0.0010) [2023-12-28 06:09:09,718][106225] Updated weights for policy 1, policy_version 1519072 (0.0010) [2023-12-28 06:09:09,783][106225] Updated weights for policy 1, policy_version 1519082 (0.0011) [2023-12-28 06:09:09,850][106225] Updated weights for policy 1, policy_version 1519092 (0.0008) [2023-12-28 06:09:10,141][106226] Updated weights for policy 0, policy_version 1515330 (0.0010) [2023-12-28 06:09:10,206][106226] Updated weights for policy 0, policy_version 1515340 (0.0011) [2023-12-28 06:09:10,271][106226] Updated weights for policy 0, policy_version 1515350 (0.0011) [2023-12-28 06:09:10,533][106225] Updated weights for policy 1, policy_version 1519102 (0.0007) [2023-12-28 06:09:10,602][106225] Updated weights for policy 1, policy_version 1519112 (0.0005) [2023-12-28 06:09:10,651][106225] Updated weights for policy 1, policy_version 1519122 (0.0005) [2023-12-28 06:09:10,905][106226] Updated weights for policy 0, policy_version 1515360 (0.0010) [2023-12-28 06:09:10,953][106226] Updated weights for policy 0, policy_version 1515370 (0.0010) [2023-12-28 06:09:11,011][106226] Updated weights for policy 0, policy_version 1515380 (0.0010) [2023-12-28 06:09:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 776962048. Throughput: 0: 9866.6, 1: 10064.0. Samples: 776930628. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:11,175][105115] Avg episode reward: [(0, '-4.809'), (1, '-5.056')] [2023-12-28 06:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001515384_388014080.pth... [2023-12-28 06:09:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001519128_388947968.pth... [2023-12-28 06:09:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001517976_388653056.pth [2023-12-28 06:09:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001514200_387710976.pth [2023-12-28 06:09:11,313][106225] Updated weights for policy 1, policy_version 1519132 (0.0007) [2023-12-28 06:09:11,382][106225] Updated weights for policy 1, policy_version 1519142 (0.0009) [2023-12-28 06:09:11,450][106225] Updated weights for policy 1, policy_version 1519152 (0.0009) [2023-12-28 06:09:11,815][106226] Updated weights for policy 0, policy_version 1515390 (0.0010) [2023-12-28 06:09:11,873][106226] Updated weights for policy 0, policy_version 1515400 (0.0011) [2023-12-28 06:09:11,924][106226] Updated weights for policy 0, policy_version 1515410 (0.0010) [2023-12-28 06:09:12,213][106225] Updated weights for policy 1, policy_version 1519162 (0.0008) [2023-12-28 06:09:12,270][106225] Updated weights for policy 1, policy_version 1519172 (0.0008) [2023-12-28 06:09:12,338][106225] Updated weights for policy 1, policy_version 1519182 (0.0008) [2023-12-28 06:09:12,407][106225] Updated weights for policy 1, policy_version 1519192 (0.0008) [2023-12-28 06:09:12,662][106226] Updated weights for policy 0, policy_version 1515420 (0.0011) [2023-12-28 06:09:12,713][106226] Updated weights for policy 0, policy_version 1515430 (0.0011) [2023-12-28 06:09:12,768][106226] Updated weights for policy 0, policy_version 1515440 (0.0011) [2023-12-28 06:09:13,012][106225] Updated weights for policy 1, policy_version 1519202 (0.0007) [2023-12-28 06:09:13,059][106225] Updated weights for policy 1, policy_version 1519212 (0.0008) [2023-12-28 06:09:13,111][106225] Updated weights for policy 1, policy_version 1519222 (0.0007) [2023-12-28 06:09:13,503][106226] Updated weights for policy 0, policy_version 1515450 (0.0011) [2023-12-28 06:09:13,560][106226] Updated weights for policy 0, policy_version 1515460 (0.0011) [2023-12-28 06:09:13,613][106226] Updated weights for policy 0, policy_version 1515470 (0.0010) [2023-12-28 06:09:13,672][106226] Updated weights for policy 0, policy_version 1515480 (0.0010) [2023-12-28 06:09:13,818][106225] Updated weights for policy 1, policy_version 1519232 (0.0006) [2023-12-28 06:09:13,862][106225] Updated weights for policy 1, policy_version 1519242 (0.0005) [2023-12-28 06:09:13,908][106225] Updated weights for policy 1, policy_version 1519252 (0.0006) [2023-12-28 06:09:14,353][106226] Updated weights for policy 0, policy_version 1515490 (0.0011) [2023-12-28 06:09:14,406][106226] Updated weights for policy 0, policy_version 1515500 (0.0010) [2023-12-28 06:09:14,459][106226] Updated weights for policy 0, policy_version 1515510 (0.0010) [2023-12-28 06:09:14,489][106225] Updated weights for policy 1, policy_version 1519262 (0.0006) [2023-12-28 06:09:14,541][106225] Updated weights for policy 1, policy_version 1519272 (0.0007) [2023-12-28 06:09:14,605][106225] Updated weights for policy 1, policy_version 1519282 (0.0007) [2023-12-28 06:09:15,215][106226] Updated weights for policy 0, policy_version 1515520 (0.0011) [2023-12-28 06:09:15,258][106225] Updated weights for policy 1, policy_version 1519292 (0.0008) [2023-12-28 06:09:15,282][106226] Updated weights for policy 0, policy_version 1515530 (0.0010) [2023-12-28 06:09:15,331][106225] Updated weights for policy 1, policy_version 1519302 (0.0008) [2023-12-28 06:09:15,343][106226] Updated weights for policy 0, policy_version 1515540 (0.0010) [2023-12-28 06:09:15,395][106225] Updated weights for policy 1, policy_version 1519312 (0.0008) [2023-12-28 06:09:16,020][106226] Updated weights for policy 0, policy_version 1515550 (0.0011) [2023-12-28 06:09:16,070][106226] Updated weights for policy 0, policy_version 1515560 (0.0010) [2023-12-28 06:09:16,119][106225] Updated weights for policy 1, policy_version 1519322 (0.0008) [2023-12-28 06:09:16,121][106226] Updated weights for policy 0, policy_version 1515570 (0.0011) [2023-12-28 06:09:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 777060352. Throughput: 0: 9857.7, 1: 10058.7. Samples: 777049216. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:16,175][105115] Avg episode reward: [(0, '-4.878'), (1, '-4.670')] [2023-12-28 06:09:16,178][106225] Updated weights for policy 1, policy_version 1519332 (0.0008) [2023-12-28 06:09:16,247][106225] Updated weights for policy 1, policy_version 1519342 (0.0007) [2023-12-28 06:09:16,314][106225] Updated weights for policy 1, policy_version 1519352 (0.0008) [2023-12-28 06:09:16,856][106226] Updated weights for policy 0, policy_version 1515580 (0.0009) [2023-12-28 06:09:16,925][106226] Updated weights for policy 0, policy_version 1515590 (0.0006) [2023-12-28 06:09:16,983][106226] Updated weights for policy 0, policy_version 1515600 (0.0007) [2023-12-28 06:09:16,986][106225] Updated weights for policy 1, policy_version 1519362 (0.0006) [2023-12-28 06:09:17,051][106225] Updated weights for policy 1, policy_version 1519372 (0.0007) [2023-12-28 06:09:17,119][106225] Updated weights for policy 1, policy_version 1519382 (0.0008) [2023-12-28 06:09:17,580][106226] Updated weights for policy 0, policy_version 1515610 (0.0007) [2023-12-28 06:09:17,637][106226] Updated weights for policy 0, policy_version 1515620 (0.0005) [2023-12-28 06:09:17,690][106226] Updated weights for policy 0, policy_version 1515630 (0.0009) [2023-12-28 06:09:17,755][106226] Updated weights for policy 0, policy_version 1515640 (0.0009) [2023-12-28 06:09:17,811][106225] Updated weights for policy 1, policy_version 1519392 (0.0006) [2023-12-28 06:09:17,875][106225] Updated weights for policy 1, policy_version 1519402 (0.0006) [2023-12-28 06:09:17,928][106225] Updated weights for policy 1, policy_version 1519412 (0.0008) [2023-12-28 06:09:18,428][106226] Updated weights for policy 0, policy_version 1515650 (0.0008) [2023-12-28 06:09:18,497][106226] Updated weights for policy 0, policy_version 1515660 (0.0009) [2023-12-28 06:09:18,554][106226] Updated weights for policy 0, policy_version 1515670 (0.0008) [2023-12-28 06:09:18,664][106225] Updated weights for policy 1, policy_version 1519422 (0.0008) [2023-12-28 06:09:18,722][106225] Updated weights for policy 1, policy_version 1519432 (0.0009) [2023-12-28 06:09:18,771][106225] Updated weights for policy 1, policy_version 1519442 (0.0008) [2023-12-28 06:09:19,263][106226] Updated weights for policy 0, policy_version 1515680 (0.0009) [2023-12-28 06:09:19,317][106226] Updated weights for policy 0, policy_version 1515690 (0.0008) [2023-12-28 06:09:19,388][106226] Updated weights for policy 0, policy_version 1515700 (0.0008) [2023-12-28 06:09:19,573][106225] Updated weights for policy 1, policy_version 1519452 (0.0008) [2023-12-28 06:09:19,635][106225] Updated weights for policy 1, policy_version 1519462 (0.0009) [2023-12-28 06:09:19,689][106225] Updated weights for policy 1, policy_version 1519472 (0.0010) [2023-12-28 06:09:20,102][106226] Updated weights for policy 0, policy_version 1515710 (0.0008) [2023-12-28 06:09:20,167][106226] Updated weights for policy 0, policy_version 1515720 (0.0010) [2023-12-28 06:09:20,236][106226] Updated weights for policy 0, policy_version 1515730 (0.0011) [2023-12-28 06:09:20,418][106225] Updated weights for policy 1, policy_version 1519482 (0.0010) [2023-12-28 06:09:20,477][106225] Updated weights for policy 1, policy_version 1519492 (0.0011) [2023-12-28 06:09:20,531][106225] Updated weights for policy 1, policy_version 1519502 (0.0010) [2023-12-28 06:09:20,593][106225] Updated weights for policy 1, policy_version 1519512 (0.0009) [2023-12-28 06:09:20,978][106226] Updated weights for policy 0, policy_version 1515740 (0.0009) [2023-12-28 06:09:21,042][106226] Updated weights for policy 0, policy_version 1515750 (0.0009) [2023-12-28 06:09:21,104][106226] Updated weights for policy 0, policy_version 1515760 (0.0008) [2023-12-28 06:09:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 777158656. Throughput: 0: 9885.6, 1: 10006.2. Samples: 777166096. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:21,175][105115] Avg episode reward: [(0, '-4.782'), (1, '-4.646')] [2023-12-28 06:09:21,237][106225] Updated weights for policy 1, policy_version 1519522 (0.0009) [2023-12-28 06:09:21,304][106225] Updated weights for policy 1, policy_version 1519532 (0.0009) [2023-12-28 06:09:21,370][106225] Updated weights for policy 1, policy_version 1519542 (0.0010) [2023-12-28 06:09:21,983][106226] Updated weights for policy 0, policy_version 1515770 (0.0007) [2023-12-28 06:09:22,044][106226] Updated weights for policy 0, policy_version 1515780 (0.0007) [2023-12-28 06:09:22,099][106226] Updated weights for policy 0, policy_version 1515790 (0.0008) [2023-12-28 06:09:22,124][106225] Updated weights for policy 1, policy_version 1519552 (0.0007) [2023-12-28 06:09:22,160][106226] Updated weights for policy 0, policy_version 1515800 (0.0008) [2023-12-28 06:09:22,177][106225] Updated weights for policy 1, policy_version 1519562 (0.0008) [2023-12-28 06:09:22,234][106225] Updated weights for policy 1, policy_version 1519572 (0.0009) [2023-12-28 06:09:22,908][106226] Updated weights for policy 0, policy_version 1515810 (0.0011) [2023-12-28 06:09:22,959][106226] Updated weights for policy 0, policy_version 1515820 (0.0010) [2023-12-28 06:09:22,988][106225] Updated weights for policy 1, policy_version 1519582 (0.0007) [2023-12-28 06:09:23,024][106226] Updated weights for policy 0, policy_version 1515830 (0.0011) [2023-12-28 06:09:23,048][106225] Updated weights for policy 1, policy_version 1519592 (0.0008) [2023-12-28 06:09:23,111][106225] Updated weights for policy 1, policy_version 1519602 (0.0009) [2023-12-28 06:09:23,720][106225] Updated weights for policy 1, policy_version 1519612 (0.0008) [2023-12-28 06:09:23,735][106226] Updated weights for policy 0, policy_version 1515840 (0.0010) [2023-12-28 06:09:23,775][106225] Updated weights for policy 1, policy_version 1519622 (0.0007) [2023-12-28 06:09:23,795][106226] Updated weights for policy 0, policy_version 1515850 (0.0010) [2023-12-28 06:09:23,838][106225] Updated weights for policy 1, policy_version 1519632 (0.0006) [2023-12-28 06:09:23,858][106226] Updated weights for policy 0, policy_version 1515860 (0.0010) [2023-12-28 06:09:24,534][106225] Updated weights for policy 1, policy_version 1519642 (0.0006) [2023-12-28 06:09:24,556][106226] Updated weights for policy 0, policy_version 1515870 (0.0010) [2023-12-28 06:09:24,593][106225] Updated weights for policy 1, policy_version 1519652 (0.0006) [2023-12-28 06:09:24,610][106226] Updated weights for policy 0, policy_version 1515880 (0.0010) [2023-12-28 06:09:24,643][106225] Updated weights for policy 1, policy_version 1519662 (0.0005) [2023-12-28 06:09:24,660][106226] Updated weights for policy 0, policy_version 1515890 (0.0010) [2023-12-28 06:09:24,686][106225] Updated weights for policy 1, policy_version 1519672 (0.0005) [2023-12-28 06:09:25,339][106226] Updated weights for policy 0, policy_version 1515900 (0.0008) [2023-12-28 06:09:25,401][106226] Updated weights for policy 0, policy_version 1515910 (0.0005) [2023-12-28 06:09:25,450][106225] Updated weights for policy 1, policy_version 1519682 (0.0007) [2023-12-28 06:09:25,463][106226] Updated weights for policy 0, policy_version 1515920 (0.0007) [2023-12-28 06:09:25,505][106225] Updated weights for policy 1, policy_version 1519692 (0.0007) [2023-12-28 06:09:25,570][106225] Updated weights for policy 1, policy_version 1519702 (0.0009) [2023-12-28 06:09:25,998][106226] Updated weights for policy 0, policy_version 1515930 (0.0006) [2023-12-28 06:09:26,046][106226] Updated weights for policy 0, policy_version 1515940 (0.0005) [2023-12-28 06:09:26,100][106226] Updated weights for policy 0, policy_version 1515950 (0.0005) [2023-12-28 06:09:26,162][106226] Updated weights for policy 0, policy_version 1515960 (0.0005) [2023-12-28 06:09:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 777256960. Throughput: 0: 9841.4, 1: 9955.7. Samples: 777223796. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:26,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.590')] [2023-12-28 06:09:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001519704_389095424.pth... [2023-12-28 06:09:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001515960_388161536.pth... [2023-12-28 06:09:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001518552_388800512.pth [2023-12-28 06:09:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001514808_387866624.pth [2023-12-28 06:09:26,393][106225] Updated weights for policy 1, policy_version 1519713 (0.0010) [2023-12-28 06:09:26,449][106225] Updated weights for policy 1, policy_version 1519723 (0.0008) [2023-12-28 06:09:26,508][106225] Updated weights for policy 1, policy_version 1519733 (0.0009) [2023-12-28 06:09:26,735][106226] Updated weights for policy 0, policy_version 1515970 (0.0005) [2023-12-28 06:09:26,781][106226] Updated weights for policy 0, policy_version 1515980 (0.0005) [2023-12-28 06:09:26,838][106226] Updated weights for policy 0, policy_version 1515990 (0.0006) [2023-12-28 06:09:27,325][106225] Updated weights for policy 1, policy_version 1519743 (0.0009) [2023-12-28 06:09:27,386][106225] Updated weights for policy 1, policy_version 1519753 (0.0009) [2023-12-28 06:09:27,448][106225] Updated weights for policy 1, policy_version 1519763 (0.0009) [2023-12-28 06:09:27,455][106226] Updated weights for policy 0, policy_version 1516000 (0.0006) [2023-12-28 06:09:27,510][106226] Updated weights for policy 0, policy_version 1516010 (0.0007) [2023-12-28 06:09:27,558][106226] Updated weights for policy 0, policy_version 1516020 (0.0006) [2023-12-28 06:09:28,205][106226] Updated weights for policy 0, policy_version 1516030 (0.0007) [2023-12-28 06:09:28,207][106225] Updated weights for policy 1, policy_version 1519773 (0.0006) [2023-12-28 06:09:28,261][106226] Updated weights for policy 0, policy_version 1516040 (0.0007) [2023-12-28 06:09:28,265][106225] Updated weights for policy 1, policy_version 1519783 (0.0006) [2023-12-28 06:09:28,325][106226] Updated weights for policy 0, policy_version 1516050 (0.0009) [2023-12-28 06:09:28,333][106225] Updated weights for policy 1, policy_version 1519793 (0.0005) [2023-12-28 06:09:28,988][106226] Updated weights for policy 0, policy_version 1516060 (0.0008) [2023-12-28 06:09:29,035][106225] Updated weights for policy 1, policy_version 1519803 (0.0007) [2023-12-28 06:09:29,039][106226] Updated weights for policy 0, policy_version 1516070 (0.0008) [2023-12-28 06:09:29,090][106225] Updated weights for policy 1, policy_version 1519813 (0.0006) [2023-12-28 06:09:29,095][106226] Updated weights for policy 0, policy_version 1516080 (0.0006) [2023-12-28 06:09:29,143][106225] Updated weights for policy 1, policy_version 1519823 (0.0006) [2023-12-28 06:09:29,842][106226] Updated weights for policy 0, policy_version 1516090 (0.0006) [2023-12-28 06:09:29,905][106226] Updated weights for policy 0, policy_version 1516100 (0.0008) [2023-12-28 06:09:29,908][106225] Updated weights for policy 1, policy_version 1519833 (0.0009) [2023-12-28 06:09:29,975][106225] Updated weights for policy 1, policy_version 1519843 (0.0007) [2023-12-28 06:09:29,976][106226] Updated weights for policy 0, policy_version 1516110 (0.0007) [2023-12-28 06:09:30,030][106225] Updated weights for policy 1, policy_version 1519853 (0.0006) [2023-12-28 06:09:30,037][106226] Updated weights for policy 0, policy_version 1516120 (0.0009) [2023-12-28 06:09:30,084][106225] Updated weights for policy 1, policy_version 1519863 (0.0008) [2023-12-28 06:09:30,705][106226] Updated weights for policy 0, policy_version 1516130 (0.0006) [2023-12-28 06:09:30,762][106226] Updated weights for policy 0, policy_version 1516140 (0.0009) [2023-12-28 06:09:30,821][106226] Updated weights for policy 0, policy_version 1516150 (0.0008) [2023-12-28 06:09:30,831][106225] Updated weights for policy 1, policy_version 1519873 (0.0008) [2023-12-28 06:09:30,876][106225] Updated weights for policy 1, policy_version 1519883 (0.0008) [2023-12-28 06:09:30,928][106225] Updated weights for policy 1, policy_version 1519893 (0.0008) [2023-12-28 06:09:31,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 777355264. Throughput: 0: 9966.8, 1: 9838.0. Samples: 777343092. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:31,175][105115] Avg episode reward: [(0, '-4.936'), (1, '-4.571')] [2023-12-28 06:09:31,518][106226] Updated weights for policy 0, policy_version 1516160 (0.0007) [2023-12-28 06:09:31,583][106226] Updated weights for policy 0, policy_version 1516170 (0.0009) [2023-12-28 06:09:31,640][106226] Updated weights for policy 0, policy_version 1516180 (0.0007) [2023-12-28 06:09:31,654][106225] Updated weights for policy 1, policy_version 1519903 (0.0008) [2023-12-28 06:09:31,712][106225] Updated weights for policy 1, policy_version 1519913 (0.0009) [2023-12-28 06:09:31,774][106225] Updated weights for policy 1, policy_version 1519923 (0.0008) [2023-12-28 06:09:32,406][106226] Updated weights for policy 0, policy_version 1516190 (0.0009) [2023-12-28 06:09:32,462][106226] Updated weights for policy 0, policy_version 1516200 (0.0008) [2023-12-28 06:09:32,510][106225] Updated weights for policy 1, policy_version 1519933 (0.0007) [2023-12-28 06:09:32,516][106226] Updated weights for policy 0, policy_version 1516210 (0.0008) [2023-12-28 06:09:32,571][106225] Updated weights for policy 1, policy_version 1519943 (0.0007) [2023-12-28 06:09:32,630][106225] Updated weights for policy 1, policy_version 1519953 (0.0008) [2023-12-28 06:09:33,205][106226] Updated weights for policy 0, policy_version 1516220 (0.0007) [2023-12-28 06:09:33,252][106226] Updated weights for policy 0, policy_version 1516230 (0.0005) [2023-12-28 06:09:33,303][106226] Updated weights for policy 0, policy_version 1516240 (0.0005) [2023-12-28 06:09:33,403][106225] Updated weights for policy 1, policy_version 1519963 (0.0009) [2023-12-28 06:09:33,461][106225] Updated weights for policy 1, policy_version 1519973 (0.0006) [2023-12-28 06:09:33,526][106225] Updated weights for policy 1, policy_version 1519983 (0.0005) [2023-12-28 06:09:33,820][106226] Updated weights for policy 0, policy_version 1516250 (0.0005) [2023-12-28 06:09:33,878][106226] Updated weights for policy 0, policy_version 1516260 (0.0007) [2023-12-28 06:09:33,924][106226] Updated weights for policy 0, policy_version 1516270 (0.0006) [2023-12-28 06:09:33,989][106226] Updated weights for policy 0, policy_version 1516280 (0.0006) [2023-12-28 06:09:34,288][106225] Updated weights for policy 1, policy_version 1519993 (0.0006) [2023-12-28 06:09:34,353][106225] Updated weights for policy 1, policy_version 1520003 (0.0008) [2023-12-28 06:09:34,405][106225] Updated weights for policy 1, policy_version 1520013 (0.0008) [2023-12-28 06:09:34,460][106225] Updated weights for policy 1, policy_version 1520023 (0.0006) [2023-12-28 06:09:34,633][106226] Updated weights for policy 0, policy_version 1516290 (0.0011) [2023-12-28 06:09:34,692][106226] Updated weights for policy 0, policy_version 1516300 (0.0008) [2023-12-28 06:09:34,757][106226] Updated weights for policy 0, policy_version 1516310 (0.0005) [2023-12-28 06:09:35,135][106225] Updated weights for policy 1, policy_version 1520033 (0.0008) [2023-12-28 06:09:35,180][106225] Updated weights for policy 1, policy_version 1520043 (0.0007) [2023-12-28 06:09:35,227][106225] Updated weights for policy 1, policy_version 1520053 (0.0008) [2023-12-28 06:09:35,451][106226] Updated weights for policy 0, policy_version 1516320 (0.0011) [2023-12-28 06:09:35,503][106226] Updated weights for policy 0, policy_version 1516330 (0.0010) [2023-12-28 06:09:35,553][106226] Updated weights for policy 0, policy_version 1516340 (0.0010) [2023-12-28 06:09:35,896][106225] Updated weights for policy 1, policy_version 1520063 (0.0008) [2023-12-28 06:09:35,952][106225] Updated weights for policy 1, policy_version 1520073 (0.0008) [2023-12-28 06:09:36,005][106225] Updated weights for policy 1, policy_version 1520083 (0.0007) [2023-12-28 06:09:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 777453568. Throughput: 0: 10064.6, 1: 9781.6. Samples: 777462460. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:36,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.805')] [2023-12-28 06:09:36,311][106226] Updated weights for policy 0, policy_version 1516350 (0.0009) [2023-12-28 06:09:36,371][106226] Updated weights for policy 0, policy_version 1516360 (0.0008) [2023-12-28 06:09:36,448][106226] Updated weights for policy 0, policy_version 1516370 (0.0008) [2023-12-28 06:09:36,767][106225] Updated weights for policy 1, policy_version 1520093 (0.0008) [2023-12-28 06:09:36,829][106225] Updated weights for policy 1, policy_version 1520103 (0.0008) [2023-12-28 06:09:36,895][106225] Updated weights for policy 1, policy_version 1520113 (0.0009) [2023-12-28 06:09:37,164][106226] Updated weights for policy 0, policy_version 1516380 (0.0007) [2023-12-28 06:09:37,217][106226] Updated weights for policy 0, policy_version 1516390 (0.0008) [2023-12-28 06:09:37,267][106226] Updated weights for policy 0, policy_version 1516400 (0.0007) [2023-12-28 06:09:37,516][106225] Updated weights for policy 1, policy_version 1520123 (0.0008) [2023-12-28 06:09:37,568][106225] Updated weights for policy 1, policy_version 1520133 (0.0007) [2023-12-28 06:09:37,616][106225] Updated weights for policy 1, policy_version 1520143 (0.0010) [2023-12-28 06:09:37,965][106226] Updated weights for policy 0, policy_version 1516410 (0.0006) [2023-12-28 06:09:38,021][106226] Updated weights for policy 0, policy_version 1516420 (0.0008) [2023-12-28 06:09:38,081][106226] Updated weights for policy 0, policy_version 1516430 (0.0005) [2023-12-28 06:09:38,138][106226] Updated weights for policy 0, policy_version 1516440 (0.0006) [2023-12-28 06:09:38,240][106225] Updated weights for policy 1, policy_version 1520153 (0.0009) [2023-12-28 06:09:38,290][106225] Updated weights for policy 1, policy_version 1520163 (0.0010) [2023-12-28 06:09:38,354][106225] Updated weights for policy 1, policy_version 1520173 (0.0010) [2023-12-28 06:09:38,420][106225] Updated weights for policy 1, policy_version 1520183 (0.0011) [2023-12-28 06:09:38,824][106226] Updated weights for policy 0, policy_version 1516450 (0.0011) [2023-12-28 06:09:38,885][106226] Updated weights for policy 0, policy_version 1516460 (0.0011) [2023-12-28 06:09:38,938][106226] Updated weights for policy 0, policy_version 1516470 (0.0006) [2023-12-28 06:09:39,147][106225] Updated weights for policy 1, policy_version 1520193 (0.0010) [2023-12-28 06:09:39,211][106225] Updated weights for policy 1, policy_version 1520203 (0.0010) [2023-12-28 06:09:39,282][106225] Updated weights for policy 1, policy_version 1520213 (0.0010) [2023-12-28 06:09:39,637][106226] Updated weights for policy 0, policy_version 1516480 (0.0008) [2023-12-28 06:09:39,703][106226] Updated weights for policy 0, policy_version 1516490 (0.0009) [2023-12-28 06:09:39,777][106226] Updated weights for policy 0, policy_version 1516500 (0.0009) [2023-12-28 06:09:40,035][106225] Updated weights for policy 1, policy_version 1520223 (0.0008) [2023-12-28 06:09:40,101][106225] Updated weights for policy 1, policy_version 1520233 (0.0009) [2023-12-28 06:09:40,168][106225] Updated weights for policy 1, policy_version 1520243 (0.0009) [2023-12-28 06:09:40,520][106226] Updated weights for policy 0, policy_version 1516510 (0.0007) [2023-12-28 06:09:40,586][106226] Updated weights for policy 0, policy_version 1516520 (0.0007) [2023-12-28 06:09:40,654][106226] Updated weights for policy 0, policy_version 1516530 (0.0009) [2023-12-28 06:09:40,872][106225] Updated weights for policy 1, policy_version 1520253 (0.0009) [2023-12-28 06:09:40,927][106225] Updated weights for policy 1, policy_version 1520263 (0.0008) [2023-12-28 06:09:40,974][106225] Updated weights for policy 1, policy_version 1520273 (0.0009) [2023-12-28 06:09:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 777551872. Throughput: 0: 10018.2, 1: 9825.7. Samples: 777522816. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:41,175][105115] Avg episode reward: [(0, '-4.948'), (1, '-4.870')] [2023-12-28 06:09:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001520280_389242880.pth... [2023-12-28 06:09:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001516536_388308992.pth... [2023-12-28 06:09:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001519128_388947968.pth [2023-12-28 06:09:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001515384_388014080.pth [2023-12-28 06:09:41,347][106226] Updated weights for policy 0, policy_version 1516540 (0.0009) [2023-12-28 06:09:41,419][106226] Updated weights for policy 0, policy_version 1516550 (0.0008) [2023-12-28 06:09:41,492][106226] Updated weights for policy 0, policy_version 1516560 (0.0009) [2023-12-28 06:09:41,750][106225] Updated weights for policy 1, policy_version 1520284 (0.0009) [2023-12-28 06:09:41,818][106225] Updated weights for policy 1, policy_version 1520294 (0.0007) [2023-12-28 06:09:41,880][106225] Updated weights for policy 1, policy_version 1520304 (0.0008) [2023-12-28 06:09:42,247][106226] Updated weights for policy 0, policy_version 1516570 (0.0007) [2023-12-28 06:09:42,314][106226] Updated weights for policy 0, policy_version 1516580 (0.0011) [2023-12-28 06:09:42,380][106226] Updated weights for policy 0, policy_version 1516590 (0.0010) [2023-12-28 06:09:42,434][106226] Updated weights for policy 0, policy_version 1516600 (0.0008) [2023-12-28 06:09:42,615][106225] Updated weights for policy 1, policy_version 1520314 (0.0008) [2023-12-28 06:09:42,676][106225] Updated weights for policy 1, policy_version 1520324 (0.0010) [2023-12-28 06:09:42,740][106225] Updated weights for policy 1, policy_version 1520334 (0.0007) [2023-12-28 06:09:42,803][106225] Updated weights for policy 1, policy_version 1520344 (0.0005) [2023-12-28 06:09:43,103][106226] Updated weights for policy 0, policy_version 1516610 (0.0010) [2023-12-28 06:09:43,161][106226] Updated weights for policy 0, policy_version 1516620 (0.0005) [2023-12-28 06:09:43,221][106226] Updated weights for policy 0, policy_version 1516630 (0.0005) [2023-12-28 06:09:43,445][106225] Updated weights for policy 1, policy_version 1520354 (0.0006) [2023-12-28 06:09:43,493][106225] Updated weights for policy 1, policy_version 1520364 (0.0008) [2023-12-28 06:09:43,539][106225] Updated weights for policy 1, policy_version 1520374 (0.0005) [2023-12-28 06:09:43,844][106226] Updated weights for policy 0, policy_version 1516640 (0.0010) [2023-12-28 06:09:43,894][106226] Updated weights for policy 0, policy_version 1516650 (0.0010) [2023-12-28 06:09:43,944][106226] Updated weights for policy 0, policy_version 1516660 (0.0010) [2023-12-28 06:09:44,201][106225] Updated weights for policy 1, policy_version 1520384 (0.0008) [2023-12-28 06:09:44,259][106225] Updated weights for policy 1, policy_version 1520394 (0.0008) [2023-12-28 06:09:44,315][106225] Updated weights for policy 1, policy_version 1520404 (0.0007) [2023-12-28 06:09:44,654][106226] Updated weights for policy 0, policy_version 1516670 (0.0007) [2023-12-28 06:09:44,704][106226] Updated weights for policy 0, policy_version 1516680 (0.0005) [2023-12-28 06:09:44,763][106226] Updated weights for policy 0, policy_version 1516690 (0.0006) [2023-12-28 06:09:44,941][106225] Updated weights for policy 1, policy_version 1520414 (0.0006) [2023-12-28 06:09:45,002][106225] Updated weights for policy 1, policy_version 1520424 (0.0009) [2023-12-28 06:09:45,064][106225] Updated weights for policy 1, policy_version 1520434 (0.0010) [2023-12-28 06:09:45,350][106226] Updated weights for policy 0, policy_version 1516700 (0.0008) [2023-12-28 06:09:45,412][106226] Updated weights for policy 0, policy_version 1516710 (0.0011) [2023-12-28 06:09:45,467][106226] Updated weights for policy 0, policy_version 1516720 (0.0011) [2023-12-28 06:09:45,707][106225] Updated weights for policy 1, policy_version 1520444 (0.0010) [2023-12-28 06:09:45,764][106225] Updated weights for policy 1, policy_version 1520454 (0.0010) [2023-12-28 06:09:45,820][106225] Updated weights for policy 1, policy_version 1520464 (0.0010) [2023-12-28 06:09:46,113][106226] Updated weights for policy 0, policy_version 1516730 (0.0009) [2023-12-28 06:09:46,161][106226] Updated weights for policy 0, policy_version 1516740 (0.0006) [2023-12-28 06:09:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 777650176. Throughput: 0: 9997.4, 1: 9865.9. Samples: 777640564. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:46,175][105115] Avg episode reward: [(0, '-4.831'), (1, '-4.764')] [2023-12-28 06:09:46,220][106226] Updated weights for policy 0, policy_version 1516750 (0.0009) [2023-12-28 06:09:46,299][106226] Updated weights for policy 0, policy_version 1516760 (0.0009) [2023-12-28 06:09:46,517][106225] Updated weights for policy 1, policy_version 1520474 (0.0010) [2023-12-28 06:09:46,580][106225] Updated weights for policy 1, policy_version 1520484 (0.0010) [2023-12-28 06:09:46,637][106225] Updated weights for policy 1, policy_version 1520494 (0.0010) [2023-12-28 06:09:46,689][106225] Updated weights for policy 1, policy_version 1520504 (0.0006) [2023-12-28 06:09:46,849][106226] Updated weights for policy 0, policy_version 1516770 (0.0010) [2023-12-28 06:09:46,901][106226] Updated weights for policy 0, policy_version 1516780 (0.0010) [2023-12-28 06:09:46,955][106226] Updated weights for policy 0, policy_version 1516790 (0.0010) [2023-12-28 06:09:47,295][106225] Updated weights for policy 1, policy_version 1520514 (0.0007) [2023-12-28 06:09:47,349][106225] Updated weights for policy 1, policy_version 1520524 (0.0006) [2023-12-28 06:09:47,406][106225] Updated weights for policy 1, policy_version 1520534 (0.0009) [2023-12-28 06:09:47,665][106226] Updated weights for policy 0, policy_version 1516800 (0.0011) [2023-12-28 06:09:47,722][106226] Updated weights for policy 0, policy_version 1516810 (0.0011) [2023-12-28 06:09:47,787][106226] Updated weights for policy 0, policy_version 1516820 (0.0010) [2023-12-28 06:09:48,059][106225] Updated weights for policy 1, policy_version 1520544 (0.0008) [2023-12-28 06:09:48,120][106225] Updated weights for policy 1, policy_version 1520554 (0.0007) [2023-12-28 06:09:48,187][106225] Updated weights for policy 1, policy_version 1520564 (0.0006) [2023-12-28 06:09:48,545][106226] Updated weights for policy 0, policy_version 1516830 (0.0011) [2023-12-28 06:09:48,615][106226] Updated weights for policy 0, policy_version 1516840 (0.0011) [2023-12-28 06:09:48,678][106226] Updated weights for policy 0, policy_version 1516850 (0.0012) [2023-12-28 06:09:48,937][106225] Updated weights for policy 1, policy_version 1520574 (0.0008) [2023-12-28 06:09:48,998][106225] Updated weights for policy 1, policy_version 1520584 (0.0008) [2023-12-28 06:09:49,054][106225] Updated weights for policy 1, policy_version 1520594 (0.0007) [2023-12-28 06:09:49,435][106226] Updated weights for policy 0, policy_version 1516860 (0.0009) [2023-12-28 06:09:49,502][106226] Updated weights for policy 0, policy_version 1516870 (0.0008) [2023-12-28 06:09:49,565][106226] Updated weights for policy 0, policy_version 1516880 (0.0011) [2023-12-28 06:09:49,800][106225] Updated weights for policy 1, policy_version 1520604 (0.0008) [2023-12-28 06:09:49,890][106225] Updated weights for policy 1, policy_version 1520614 (0.0008) [2023-12-28 06:09:49,959][106225] Updated weights for policy 1, policy_version 1520624 (0.0009) [2023-12-28 06:09:50,268][106226] Updated weights for policy 0, policy_version 1516890 (0.0010) [2023-12-28 06:09:50,328][106226] Updated weights for policy 0, policy_version 1516900 (0.0007) [2023-12-28 06:09:50,387][106226] Updated weights for policy 0, policy_version 1516910 (0.0008) [2023-12-28 06:09:50,450][106226] Updated weights for policy 0, policy_version 1516920 (0.0008) [2023-12-28 06:09:50,723][106225] Updated weights for policy 1, policy_version 1520634 (0.0008) [2023-12-28 06:09:50,788][106225] Updated weights for policy 1, policy_version 1520644 (0.0009) [2023-12-28 06:09:50,850][106225] Updated weights for policy 1, policy_version 1520654 (0.0011) [2023-12-28 06:09:50,915][106225] Updated weights for policy 1, policy_version 1520664 (0.0011) [2023-12-28 06:09:51,125][106226] Updated weights for policy 0, policy_version 1516930 (0.0009) [2023-12-28 06:09:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 777748480. Throughput: 0: 9970.4, 1: 9779.4. Samples: 777760092. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-28 06:09:51,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.735')] [2023-12-28 06:09:51,185][106226] Updated weights for policy 0, policy_version 1516940 (0.0008) [2023-12-28 06:09:51,242][106226] Updated weights for policy 0, policy_version 1516950 (0.0007) [2023-12-28 06:09:51,685][106225] Updated weights for policy 1, policy_version 1520674 (0.0008) [2023-12-28 06:09:51,756][106225] Updated weights for policy 1, policy_version 1520684 (0.0009) [2023-12-28 06:09:51,823][106225] Updated weights for policy 1, policy_version 1520694 (0.0008) [2023-12-28 06:09:52,011][106226] Updated weights for policy 0, policy_version 1516960 (0.0007) [2023-12-28 06:09:52,073][106226] Updated weights for policy 0, policy_version 1516970 (0.0006) [2023-12-28 06:09:52,132][106226] Updated weights for policy 0, policy_version 1516980 (0.0005) [2023-12-28 06:09:52,562][106225] Updated weights for policy 1, policy_version 1520704 (0.0010) [2023-12-28 06:09:52,626][106225] Updated weights for policy 1, policy_version 1520714 (0.0010) [2023-12-28 06:09:52,691][106225] Updated weights for policy 1, policy_version 1520724 (0.0011) [2023-12-28 06:09:52,820][106226] Updated weights for policy 0, policy_version 1516990 (0.0007) [2023-12-28 06:09:52,878][106226] Updated weights for policy 0, policy_version 1517000 (0.0008) [2023-12-28 06:09:52,936][106226] Updated weights for policy 0, policy_version 1517010 (0.0007) [2023-12-28 06:09:53,392][106225] Updated weights for policy 1, policy_version 1520734 (0.0009) [2023-12-28 06:09:53,451][106225] Updated weights for policy 1, policy_version 1520744 (0.0008) [2023-12-28 06:09:53,505][106225] Updated weights for policy 1, policy_version 1520754 (0.0009) [2023-12-28 06:09:53,646][106226] Updated weights for policy 0, policy_version 1517020 (0.0008) [2023-12-28 06:09:53,700][106226] Updated weights for policy 0, policy_version 1517030 (0.0009) [2023-12-28 06:09:53,750][106226] Updated weights for policy 0, policy_version 1517040 (0.0007) [2023-12-28 06:09:54,241][106225] Updated weights for policy 1, policy_version 1520764 (0.0008) [2023-12-28 06:09:54,306][106225] Updated weights for policy 1, policy_version 1520774 (0.0005) [2023-12-28 06:09:54,363][106225] Updated weights for policy 1, policy_version 1520784 (0.0008) [2023-12-28 06:09:54,461][106226] Updated weights for policy 0, policy_version 1517050 (0.0008) [2023-12-28 06:09:54,524][106226] Updated weights for policy 0, policy_version 1517060 (0.0008) [2023-12-28 06:09:54,594][106226] Updated weights for policy 0, policy_version 1517070 (0.0006) [2023-12-28 06:09:54,657][106226] Updated weights for policy 0, policy_version 1517080 (0.0007) [2023-12-28 06:09:55,078][106225] Updated weights for policy 1, policy_version 1520794 (0.0007) [2023-12-28 06:09:55,126][106225] Updated weights for policy 1, policy_version 1520804 (0.0008) [2023-12-28 06:09:55,182][106225] Updated weights for policy 1, policy_version 1520814 (0.0008) [2023-12-28 06:09:55,242][106225] Updated weights for policy 1, policy_version 1520824 (0.0007) [2023-12-28 06:09:55,275][106226] Updated weights for policy 0, policy_version 1517090 (0.0008) [2023-12-28 06:09:55,345][106226] Updated weights for policy 0, policy_version 1517100 (0.0008) [2023-12-28 06:09:55,413][106226] Updated weights for policy 0, policy_version 1517110 (0.0007) [2023-12-28 06:09:55,875][106225] Updated weights for policy 1, policy_version 1520834 (0.0006) [2023-12-28 06:09:55,931][106225] Updated weights for policy 1, policy_version 1520844 (0.0008) [2023-12-28 06:09:55,984][106225] Updated weights for policy 1, policy_version 1520854 (0.0008) [2023-12-28 06:09:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 777846784. Throughput: 0: 9952.8, 1: 9729.8. Samples: 777816344. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:09:56,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.499')] [2023-12-28 06:09:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001520856_389390336.pth... [2023-12-28 06:09:56,192][106226] Updated weights for policy 0, policy_version 1517120 (0.0006) [2023-12-28 06:09:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001519704_389095424.pth [2023-12-28 06:09:56,242][106226] Updated weights for policy 0, policy_version 1517130 (0.0005) [2023-12-28 06:09:56,305][106226] Updated weights for policy 0, policy_version 1517140 (0.0007) [2023-12-28 06:09:56,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001517144_388464640.pth... [2023-12-28 06:09:56,331][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001515960_388161536.pth [2023-12-28 06:09:56,623][106225] Updated weights for policy 1, policy_version 1520864 (0.0006) [2023-12-28 06:09:56,690][106225] Updated weights for policy 1, policy_version 1520874 (0.0005) [2023-12-28 06:09:56,758][106225] Updated weights for policy 1, policy_version 1520884 (0.0005) [2023-12-28 06:09:57,003][106226] Updated weights for policy 0, policy_version 1517150 (0.0008) [2023-12-28 06:09:57,057][106226] Updated weights for policy 0, policy_version 1517160 (0.0005) [2023-12-28 06:09:57,119][106226] Updated weights for policy 0, policy_version 1517170 (0.0005) [2023-12-28 06:09:57,387][106225] Updated weights for policy 1, policy_version 1520894 (0.0005) [2023-12-28 06:09:57,443][106225] Updated weights for policy 1, policy_version 1520904 (0.0006) [2023-12-28 06:09:57,490][106225] Updated weights for policy 1, policy_version 1520914 (0.0008) [2023-12-28 06:09:57,751][106226] Updated weights for policy 0, policy_version 1517180 (0.0007) [2023-12-28 06:09:57,804][106226] Updated weights for policy 0, policy_version 1517190 (0.0008) [2023-12-28 06:09:57,852][106226] Updated weights for policy 0, policy_version 1517200 (0.0008) [2023-12-28 06:09:58,095][106225] Updated weights for policy 1, policy_version 1520924 (0.0007) [2023-12-28 06:09:58,159][106225] Updated weights for policy 1, policy_version 1520934 (0.0005) [2023-12-28 06:09:58,229][106225] Updated weights for policy 1, policy_version 1520944 (0.0007) [2023-12-28 06:09:58,643][106226] Updated weights for policy 0, policy_version 1517210 (0.0008) [2023-12-28 06:09:58,707][106226] Updated weights for policy 0, policy_version 1517220 (0.0009) [2023-12-28 06:09:58,779][106226] Updated weights for policy 0, policy_version 1517230 (0.0009) [2023-12-28 06:09:58,855][106226] Updated weights for policy 0, policy_version 1517240 (0.0008) [2023-12-28 06:09:59,027][106225] Updated weights for policy 1, policy_version 1520954 (0.0008) [2023-12-28 06:09:59,087][106225] Updated weights for policy 1, policy_version 1520964 (0.0009) [2023-12-28 06:09:59,147][106225] Updated weights for policy 1, policy_version 1520974 (0.0009) [2023-12-28 06:09:59,208][106225] Updated weights for policy 1, policy_version 1520984 (0.0007) [2023-12-28 06:09:59,643][106226] Updated weights for policy 0, policy_version 1517250 (0.0009) [2023-12-28 06:09:59,707][106226] Updated weights for policy 0, policy_version 1517260 (0.0009) [2023-12-28 06:09:59,765][106226] Updated weights for policy 0, policy_version 1517270 (0.0010) [2023-12-28 06:09:59,876][106225] Updated weights for policy 1, policy_version 1520994 (0.0008) [2023-12-28 06:09:59,935][106225] Updated weights for policy 1, policy_version 1521004 (0.0007) [2023-12-28 06:10:00,002][106225] Updated weights for policy 1, policy_version 1521014 (0.0008) [2023-12-28 06:10:00,474][106226] Updated weights for policy 0, policy_version 1517280 (0.0007) [2023-12-28 06:10:00,533][106226] Updated weights for policy 0, policy_version 1517290 (0.0009) [2023-12-28 06:10:00,593][106226] Updated weights for policy 0, policy_version 1517300 (0.0007) [2023-12-28 06:10:00,747][106225] Updated weights for policy 1, policy_version 1521024 (0.0008) [2023-12-28 06:10:00,798][106225] Updated weights for policy 1, policy_version 1521034 (0.0009) [2023-12-28 06:10:00,849][106225] Updated weights for policy 1, policy_version 1521045 (0.0008) [2023-12-28 06:10:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 777945088. Throughput: 0: 9932.4, 1: 9755.3. Samples: 777935164. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:01,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.791')] [2023-12-28 06:10:01,271][106226] Updated weights for policy 0, policy_version 1517310 (0.0007) [2023-12-28 06:10:01,333][106226] Updated weights for policy 0, policy_version 1517320 (0.0008) [2023-12-28 06:10:01,396][106226] Updated weights for policy 0, policy_version 1517330 (0.0009) [2023-12-28 06:10:01,634][106225] Updated weights for policy 1, policy_version 1521055 (0.0008) [2023-12-28 06:10:01,705][106225] Updated weights for policy 1, policy_version 1521065 (0.0008) [2023-12-28 06:10:01,774][106225] Updated weights for policy 1, policy_version 1521075 (0.0008) [2023-12-28 06:10:02,139][106226] Updated weights for policy 0, policy_version 1517340 (0.0008) [2023-12-28 06:10:02,203][106226] Updated weights for policy 0, policy_version 1517350 (0.0008) [2023-12-28 06:10:02,268][106226] Updated weights for policy 0, policy_version 1517360 (0.0006) [2023-12-28 06:10:02,487][106225] Updated weights for policy 1, policy_version 1521085 (0.0008) [2023-12-28 06:10:02,545][106225] Updated weights for policy 1, policy_version 1521095 (0.0008) [2023-12-28 06:10:02,598][106225] Updated weights for policy 1, policy_version 1521105 (0.0008) [2023-12-28 06:10:02,894][106226] Updated weights for policy 0, policy_version 1517370 (0.0006) [2023-12-28 06:10:02,949][106226] Updated weights for policy 0, policy_version 1517380 (0.0005) [2023-12-28 06:10:03,009][106226] Updated weights for policy 0, policy_version 1517390 (0.0006) [2023-12-28 06:10:03,072][106226] Updated weights for policy 0, policy_version 1517400 (0.0005) [2023-12-28 06:10:03,377][106225] Updated weights for policy 1, policy_version 1521115 (0.0009) [2023-12-28 06:10:03,424][106225] Updated weights for policy 1, policy_version 1521125 (0.0008) [2023-12-28 06:10:03,488][106225] Updated weights for policy 1, policy_version 1521135 (0.0009) [2023-12-28 06:10:03,579][106226] Updated weights for policy 0, policy_version 1517410 (0.0005) [2023-12-28 06:10:03,629][106226] Updated weights for policy 0, policy_version 1517420 (0.0005) [2023-12-28 06:10:03,684][106226] Updated weights for policy 0, policy_version 1517430 (0.0005) [2023-12-28 06:10:04,193][106225] Updated weights for policy 1, policy_version 1521145 (0.0009) [2023-12-28 06:10:04,259][106225] Updated weights for policy 1, policy_version 1521155 (0.0007) [2023-12-28 06:10:04,316][106225] Updated weights for policy 1, policy_version 1521165 (0.0008) [2023-12-28 06:10:04,371][106226] Updated weights for policy 0, policy_version 1517440 (0.0006) [2023-12-28 06:10:04,376][106225] Updated weights for policy 1, policy_version 1521175 (0.0007) [2023-12-28 06:10:04,429][106226] Updated weights for policy 0, policy_version 1517450 (0.0008) [2023-12-28 06:10:04,492][106226] Updated weights for policy 0, policy_version 1517460 (0.0009) [2023-12-28 06:10:05,076][106225] Updated weights for policy 1, policy_version 1521185 (0.0008) [2023-12-28 06:10:05,137][106225] Updated weights for policy 1, policy_version 1521195 (0.0007) [2023-12-28 06:10:05,185][106226] Updated weights for policy 0, policy_version 1517470 (0.0008) [2023-12-28 06:10:05,195][106225] Updated weights for policy 1, policy_version 1521205 (0.0005) [2023-12-28 06:10:05,235][106226] Updated weights for policy 0, policy_version 1517480 (0.0007) [2023-12-28 06:10:05,291][106226] Updated weights for policy 0, policy_version 1517490 (0.0009) [2023-12-28 06:10:05,885][106225] Updated weights for policy 1, policy_version 1521215 (0.0008) [2023-12-28 06:10:05,946][106225] Updated weights for policy 1, policy_version 1521225 (0.0008) [2023-12-28 06:10:06,001][106225] Updated weights for policy 1, policy_version 1521235 (0.0008) [2023-12-28 06:10:06,022][106226] Updated weights for policy 0, policy_version 1517500 (0.0009) [2023-12-28 06:10:06,078][106226] Updated weights for policy 0, policy_version 1517510 (0.0009) [2023-12-28 06:10:06,154][106226] Updated weights for policy 0, policy_version 1517520 (0.0009) [2023-12-28 06:10:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 778043392. Throughput: 0: 9999.9, 1: 9739.8. Samples: 778054376. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:06,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.751')] [2023-12-28 06:10:06,769][106225] Updated weights for policy 1, policy_version 1521245 (0.0008) [2023-12-28 06:10:06,814][106226] Updated weights for policy 0, policy_version 1517530 (0.0011) [2023-12-28 06:10:06,831][106225] Updated weights for policy 1, policy_version 1521255 (0.0007) [2023-12-28 06:10:06,871][106226] Updated weights for policy 0, policy_version 1517540 (0.0011) [2023-12-28 06:10:06,881][106225] Updated weights for policy 1, policy_version 1521265 (0.0005) [2023-12-28 06:10:06,922][106226] Updated weights for policy 0, policy_version 1517550 (0.0011) [2023-12-28 06:10:06,972][106226] Updated weights for policy 0, policy_version 1517560 (0.0010) [2023-12-28 06:10:07,540][106225] Updated weights for policy 1, policy_version 1521275 (0.0005) [2023-12-28 06:10:07,586][106225] Updated weights for policy 1, policy_version 1521285 (0.0005) [2023-12-28 06:10:07,642][106225] Updated weights for policy 1, policy_version 1521295 (0.0005) [2023-12-28 06:10:07,658][106226] Updated weights for policy 0, policy_version 1517570 (0.0011) [2023-12-28 06:10:07,705][106226] Updated weights for policy 0, policy_version 1517580 (0.0011) [2023-12-28 06:10:07,755][106226] Updated weights for policy 0, policy_version 1517590 (0.0010) [2023-12-28 06:10:08,261][106225] Updated weights for policy 1, policy_version 1521305 (0.0005) [2023-12-28 06:10:08,340][106225] Updated weights for policy 1, policy_version 1521315 (0.0006) [2023-12-28 06:10:08,406][106225] Updated weights for policy 1, policy_version 1521325 (0.0009) [2023-12-28 06:10:08,463][106225] Updated weights for policy 1, policy_version 1521335 (0.0008) [2023-12-28 06:10:08,513][106226] Updated weights for policy 0, policy_version 1517600 (0.0009) [2023-12-28 06:10:08,569][106226] Updated weights for policy 0, policy_version 1517610 (0.0009) [2023-12-28 06:10:08,619][106226] Updated weights for policy 0, policy_version 1517620 (0.0009) [2023-12-28 06:10:09,191][106225] Updated weights for policy 1, policy_version 1521345 (0.0009) [2023-12-28 06:10:09,256][106225] Updated weights for policy 1, policy_version 1521355 (0.0009) [2023-12-28 06:10:09,310][106225] Updated weights for policy 1, policy_version 1521365 (0.0008) [2023-12-28 06:10:09,360][106226] Updated weights for policy 0, policy_version 1517630 (0.0009) [2023-12-28 06:10:09,435][106226] Updated weights for policy 0, policy_version 1517640 (0.0008) [2023-12-28 06:10:09,500][106226] Updated weights for policy 0, policy_version 1517650 (0.0009) [2023-12-28 06:10:10,059][106225] Updated weights for policy 1, policy_version 1521375 (0.0009) [2023-12-28 06:10:10,124][106225] Updated weights for policy 1, policy_version 1521385 (0.0009) [2023-12-28 06:10:10,191][106225] Updated weights for policy 1, policy_version 1521395 (0.0009) [2023-12-28 06:10:10,249][106226] Updated weights for policy 0, policy_version 1517660 (0.0007) [2023-12-28 06:10:10,316][106226] Updated weights for policy 0, policy_version 1517670 (0.0007) [2023-12-28 06:10:10,383][106226] Updated weights for policy 0, policy_version 1517680 (0.0007) [2023-12-28 06:10:10,904][106225] Updated weights for policy 1, policy_version 1521405 (0.0008) [2023-12-28 06:10:10,968][106225] Updated weights for policy 1, policy_version 1521415 (0.0008) [2023-12-28 06:10:11,031][106225] Updated weights for policy 1, policy_version 1521425 (0.0008) [2023-12-28 06:10:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 778141696. Throughput: 0: 10047.1, 1: 9738.8. Samples: 778114160. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:11,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.848')] [2023-12-28 06:10:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001521432_389537792.pth... [2023-12-28 06:10:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001520280_389242880.pth [2023-12-28 06:10:11,198][106226] Updated weights for policy 0, policy_version 1517690 (0.0008) [2023-12-28 06:10:11,272][106226] Updated weights for policy 0, policy_version 1517700 (0.0009) [2023-12-28 06:10:11,344][106226] Updated weights for policy 0, policy_version 1517710 (0.0009) [2023-12-28 06:10:11,410][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001517720_388612096.pth... [2023-12-28 06:10:11,412][106226] Updated weights for policy 0, policy_version 1517720 (0.0008) [2023-12-28 06:10:11,414][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001516536_388308992.pth [2023-12-28 06:10:11,813][106225] Updated weights for policy 1, policy_version 1521435 (0.0013) [2023-12-28 06:10:11,864][106225] Updated weights for policy 1, policy_version 1521445 (0.0009) [2023-12-28 06:10:11,923][106225] Updated weights for policy 1, policy_version 1521455 (0.0006) [2023-12-28 06:10:12,181][106226] Updated weights for policy 0, policy_version 1517730 (0.0006) [2023-12-28 06:10:12,246][106226] Updated weights for policy 0, policy_version 1517740 (0.0008) [2023-12-28 06:10:12,307][106226] Updated weights for policy 0, policy_version 1517750 (0.0009) [2023-12-28 06:10:12,644][106225] Updated weights for policy 1, policy_version 1521465 (0.0009) [2023-12-28 06:10:12,705][106225] Updated weights for policy 1, policy_version 1521475 (0.0010) [2023-12-28 06:10:12,766][106225] Updated weights for policy 1, policy_version 1521485 (0.0010) [2023-12-28 06:10:12,826][106225] Updated weights for policy 1, policy_version 1521495 (0.0010) [2023-12-28 06:10:12,995][106226] Updated weights for policy 0, policy_version 1517760 (0.0010) [2023-12-28 06:10:13,047][106226] Updated weights for policy 0, policy_version 1517770 (0.0009) [2023-12-28 06:10:13,105][106226] Updated weights for policy 0, policy_version 1517780 (0.0006) [2023-12-28 06:10:13,474][106225] Updated weights for policy 1, policy_version 1521505 (0.0006) [2023-12-28 06:10:13,525][106225] Updated weights for policy 1, policy_version 1521515 (0.0009) [2023-12-28 06:10:13,573][106225] Updated weights for policy 1, policy_version 1521525 (0.0009) [2023-12-28 06:10:13,821][106226] Updated weights for policy 0, policy_version 1517790 (0.0008) [2023-12-28 06:10:13,873][106226] Updated weights for policy 0, policy_version 1517800 (0.0010) [2023-12-28 06:10:13,930][106226] Updated weights for policy 0, policy_version 1517810 (0.0009) [2023-12-28 06:10:14,218][106225] Updated weights for policy 1, policy_version 1521535 (0.0006) [2023-12-28 06:10:14,291][106225] Updated weights for policy 1, policy_version 1521545 (0.0008) [2023-12-28 06:10:14,355][106225] Updated weights for policy 1, policy_version 1521555 (0.0008) [2023-12-28 06:10:14,706][106226] Updated weights for policy 0, policy_version 1517820 (0.0006) [2023-12-28 06:10:14,770][106226] Updated weights for policy 0, policy_version 1517830 (0.0007) [2023-12-28 06:10:14,834][106226] Updated weights for policy 0, policy_version 1517840 (0.0009) [2023-12-28 06:10:14,997][106225] Updated weights for policy 1, policy_version 1521565 (0.0008) [2023-12-28 06:10:15,057][106225] Updated weights for policy 1, policy_version 1521575 (0.0008) [2023-12-28 06:10:15,114][106225] Updated weights for policy 1, policy_version 1521585 (0.0007) [2023-12-28 06:10:15,563][106226] Updated weights for policy 0, policy_version 1517850 (0.0009) [2023-12-28 06:10:15,617][106226] Updated weights for policy 0, policy_version 1517860 (0.0008) [2023-12-28 06:10:15,675][106226] Updated weights for policy 0, policy_version 1517870 (0.0009) [2023-12-28 06:10:15,784][106225] Updated weights for policy 1, policy_version 1521595 (0.0009) [2023-12-28 06:10:15,838][106225] Updated weights for policy 1, policy_version 1521605 (0.0010) [2023-12-28 06:10:15,897][106225] Updated weights for policy 1, policy_version 1521615 (0.0010) [2023-12-28 06:10:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 778240000. Throughput: 0: 9849.8, 1: 9817.6. Samples: 778228128. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:16,175][105115] Avg episode reward: [(0, '-4.921'), (1, '-4.769')] [2023-12-28 06:10:16,320][106226] Updated weights for policy 0, policy_version 1517881 (0.0009) [2023-12-28 06:10:16,388][106226] Updated weights for policy 0, policy_version 1517891 (0.0005) [2023-12-28 06:10:16,455][106226] Updated weights for policy 0, policy_version 1517901 (0.0005) [2023-12-28 06:10:16,507][106225] Updated weights for policy 1, policy_version 1521625 (0.0009) [2023-12-28 06:10:16,512][106226] Updated weights for policy 0, policy_version 1517911 (0.0005) [2023-12-28 06:10:16,556][106225] Updated weights for policy 1, policy_version 1521635 (0.0008) [2023-12-28 06:10:16,607][106225] Updated weights for policy 1, policy_version 1521645 (0.0005) [2023-12-28 06:10:16,671][106225] Updated weights for policy 1, policy_version 1521655 (0.0006) [2023-12-28 06:10:16,988][106226] Updated weights for policy 0, policy_version 1517921 (0.0010) [2023-12-28 06:10:17,035][106226] Updated weights for policy 0, policy_version 1517931 (0.0010) [2023-12-28 06:10:17,081][106226] Updated weights for policy 0, policy_version 1517941 (0.0010) [2023-12-28 06:10:17,363][106225] Updated weights for policy 1, policy_version 1521665 (0.0006) [2023-12-28 06:10:17,415][106225] Updated weights for policy 1, policy_version 1521675 (0.0006) [2023-12-28 06:10:17,465][106225] Updated weights for policy 1, policy_version 1521685 (0.0008) [2023-12-28 06:10:17,818][106226] Updated weights for policy 0, policy_version 1517951 (0.0010) [2023-12-28 06:10:17,871][106226] Updated weights for policy 0, policy_version 1517961 (0.0010) [2023-12-28 06:10:17,942][106226] Updated weights for policy 0, policy_version 1517971 (0.0009) [2023-12-28 06:10:18,025][106225] Updated weights for policy 1, policy_version 1521695 (0.0009) [2023-12-28 06:10:18,081][106225] Updated weights for policy 1, policy_version 1521705 (0.0006) [2023-12-28 06:10:18,136][106225] Updated weights for policy 1, policy_version 1521715 (0.0005) [2023-12-28 06:10:18,623][106226] Updated weights for policy 0, policy_version 1517981 (0.0009) [2023-12-28 06:10:18,686][106226] Updated weights for policy 0, policy_version 1517991 (0.0011) [2023-12-28 06:10:18,751][106226] Updated weights for policy 0, policy_version 1518001 (0.0010) [2023-12-28 06:10:18,857][106225] Updated weights for policy 1, policy_version 1521725 (0.0008) [2023-12-28 06:10:18,913][106225] Updated weights for policy 1, policy_version 1521735 (0.0006) [2023-12-28 06:10:18,970][106225] Updated weights for policy 1, policy_version 1521745 (0.0006) [2023-12-28 06:10:19,513][106226] Updated weights for policy 0, policy_version 1518011 (0.0011) [2023-12-28 06:10:19,579][106226] Updated weights for policy 0, policy_version 1518021 (0.0008) [2023-12-28 06:10:19,642][106226] Updated weights for policy 0, policy_version 1518031 (0.0007) [2023-12-28 06:10:19,712][106225] Updated weights for policy 1, policy_version 1521755 (0.0006) [2023-12-28 06:10:19,762][106225] Updated weights for policy 1, policy_version 1521765 (0.0007) [2023-12-28 06:10:19,818][106225] Updated weights for policy 1, policy_version 1521775 (0.0007) [2023-12-28 06:10:20,439][106226] Updated weights for policy 0, policy_version 1518041 (0.0008) [2023-12-28 06:10:20,501][106226] Updated weights for policy 0, policy_version 1518051 (0.0011) [2023-12-28 06:10:20,566][106226] Updated weights for policy 0, policy_version 1518061 (0.0010) [2023-12-28 06:10:20,620][106225] Updated weights for policy 1, policy_version 1521785 (0.0008) [2023-12-28 06:10:20,633][106226] Updated weights for policy 0, policy_version 1518071 (0.0013) [2023-12-28 06:10:20,680][106225] Updated weights for policy 1, policy_version 1521795 (0.0007) [2023-12-28 06:10:20,745][106225] Updated weights for policy 1, policy_version 1521805 (0.0007) [2023-12-28 06:10:20,802][106225] Updated weights for policy 1, policy_version 1521815 (0.0008) [2023-12-28 06:10:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 778338304. Throughput: 0: 9791.7, 1: 9904.5. Samples: 778348792. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:21,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.948')] [2023-12-28 06:10:21,431][106226] Updated weights for policy 0, policy_version 1518081 (0.0008) [2023-12-28 06:10:21,489][106226] Updated weights for policy 0, policy_version 1518091 (0.0009) [2023-12-28 06:10:21,544][106226] Updated weights for policy 0, policy_version 1518101 (0.0009) [2023-12-28 06:10:21,603][106225] Updated weights for policy 1, policy_version 1521825 (0.0009) [2023-12-28 06:10:21,666][106225] Updated weights for policy 1, policy_version 1521835 (0.0009) [2023-12-28 06:10:21,725][106225] Updated weights for policy 1, policy_version 1521845 (0.0009) [2023-12-28 06:10:22,297][106226] Updated weights for policy 0, policy_version 1518111 (0.0007) [2023-12-28 06:10:22,366][106226] Updated weights for policy 0, policy_version 1518121 (0.0008) [2023-12-28 06:10:22,433][106226] Updated weights for policy 0, policy_version 1518131 (0.0009) [2023-12-28 06:10:22,531][106225] Updated weights for policy 1, policy_version 1521855 (0.0009) [2023-12-28 06:10:22,584][106225] Updated weights for policy 1, policy_version 1521865 (0.0009) [2023-12-28 06:10:22,645][106225] Updated weights for policy 1, policy_version 1521875 (0.0009) [2023-12-28 06:10:23,148][106226] Updated weights for policy 0, policy_version 1518141 (0.0007) [2023-12-28 06:10:23,209][106226] Updated weights for policy 0, policy_version 1518151 (0.0005) [2023-12-28 06:10:23,272][106226] Updated weights for policy 0, policy_version 1518161 (0.0008) [2023-12-28 06:10:23,439][106225] Updated weights for policy 1, policy_version 1521885 (0.0010) [2023-12-28 06:10:23,500][106225] Updated weights for policy 1, policy_version 1521895 (0.0011) [2023-12-28 06:10:23,557][106225] Updated weights for policy 1, policy_version 1521905 (0.0006) [2023-12-28 06:10:24,028][106226] Updated weights for policy 0, policy_version 1518171 (0.0007) [2023-12-28 06:10:24,077][106225] Updated weights for policy 1, policy_version 1521915 (0.0007) [2023-12-28 06:10:24,087][106226] Updated weights for policy 0, policy_version 1518181 (0.0008) [2023-12-28 06:10:24,134][106225] Updated weights for policy 1, policy_version 1521925 (0.0010) [2023-12-28 06:10:24,140][106226] Updated weights for policy 0, policy_version 1518191 (0.0005) [2023-12-28 06:10:24,185][106225] Updated weights for policy 1, policy_version 1521935 (0.0010) [2023-12-28 06:10:24,874][106225] Updated weights for policy 1, policy_version 1521945 (0.0006) [2023-12-28 06:10:24,883][106226] Updated weights for policy 0, policy_version 1518201 (0.0006) [2023-12-28 06:10:24,927][106225] Updated weights for policy 1, policy_version 1521955 (0.0010) [2023-12-28 06:10:24,941][106226] Updated weights for policy 0, policy_version 1518211 (0.0005) [2023-12-28 06:10:24,984][106225] Updated weights for policy 1, policy_version 1521965 (0.0010) [2023-12-28 06:10:24,997][106226] Updated weights for policy 0, policy_version 1518221 (0.0006) [2023-12-28 06:10:25,038][106225] Updated weights for policy 1, policy_version 1521975 (0.0010) [2023-12-28 06:10:25,045][106226] Updated weights for policy 0, policy_version 1518231 (0.0009) [2023-12-28 06:10:25,710][106226] Updated weights for policy 0, policy_version 1518241 (0.0008) [2023-12-28 06:10:25,767][106226] Updated weights for policy 0, policy_version 1518251 (0.0010) [2023-12-28 06:10:25,771][106225] Updated weights for policy 1, policy_version 1521985 (0.0011) [2023-12-28 06:10:25,819][106226] Updated weights for policy 0, policy_version 1518261 (0.0010) [2023-12-28 06:10:25,834][106225] Updated weights for policy 1, policy_version 1521995 (0.0010) [2023-12-28 06:10:25,895][106225] Updated weights for policy 1, policy_version 1522005 (0.0010) [2023-12-28 06:10:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 778436608. Throughput: 0: 9745.9, 1: 9821.6. Samples: 778403352. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:26,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.591')] [2023-12-28 06:10:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001518264_388751360.pth... [2023-12-28 06:10:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001522008_389685248.pth... [2023-12-28 06:10:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001517144_388464640.pth [2023-12-28 06:10:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001520856_389390336.pth [2023-12-28 06:10:26,508][106226] Updated weights for policy 0, policy_version 1518271 (0.0009) [2023-12-28 06:10:26,517][106225] Updated weights for policy 1, policy_version 1522015 (0.0007) [2023-12-28 06:10:26,570][106226] Updated weights for policy 0, policy_version 1518281 (0.0008) [2023-12-28 06:10:26,578][106225] Updated weights for policy 1, policy_version 1522025 (0.0005) [2023-12-28 06:10:26,631][106226] Updated weights for policy 0, policy_version 1518291 (0.0008) [2023-12-28 06:10:26,634][106225] Updated weights for policy 1, policy_version 1522035 (0.0010) [2023-12-28 06:10:27,212][106226] Updated weights for policy 0, policy_version 1518301 (0.0007) [2023-12-28 06:10:27,278][106226] Updated weights for policy 0, policy_version 1518311 (0.0005) [2023-12-28 06:10:27,335][106226] Updated weights for policy 0, policy_version 1518321 (0.0007) [2023-12-28 06:10:27,340][106225] Updated weights for policy 1, policy_version 1522045 (0.0008) [2023-12-28 06:10:27,394][106225] Updated weights for policy 1, policy_version 1522055 (0.0005) [2023-12-28 06:10:27,440][106225] Updated weights for policy 1, policy_version 1522065 (0.0005) [2023-12-28 06:10:27,987][106225] Updated weights for policy 1, policy_version 1522075 (0.0006) [2023-12-28 06:10:27,988][106226] Updated weights for policy 0, policy_version 1518331 (0.0007) [2023-12-28 06:10:28,044][106225] Updated weights for policy 1, policy_version 1522085 (0.0009) [2023-12-28 06:10:28,052][106226] Updated weights for policy 0, policy_version 1518341 (0.0005) [2023-12-28 06:10:28,098][106225] Updated weights for policy 1, policy_version 1522095 (0.0010) [2023-12-28 06:10:28,113][106226] Updated weights for policy 0, policy_version 1518351 (0.0005) [2023-12-28 06:10:28,728][106225] Updated weights for policy 1, policy_version 1522105 (0.0008) [2023-12-28 06:10:28,763][106226] Updated weights for policy 0, policy_version 1518361 (0.0005) [2023-12-28 06:10:28,789][106225] Updated weights for policy 1, policy_version 1522115 (0.0010) [2023-12-28 06:10:28,823][106226] Updated weights for policy 0, policy_version 1518371 (0.0008) [2023-12-28 06:10:28,850][106225] Updated weights for policy 1, policy_version 1522125 (0.0010) [2023-12-28 06:10:28,881][106226] Updated weights for policy 0, policy_version 1518381 (0.0011) [2023-12-28 06:10:28,908][106225] Updated weights for policy 1, policy_version 1522135 (0.0010) [2023-12-28 06:10:28,941][106226] Updated weights for policy 0, policy_version 1518391 (0.0011) [2023-12-28 06:10:29,585][106225] Updated weights for policy 1, policy_version 1522145 (0.0008) [2023-12-28 06:10:29,634][106226] Updated weights for policy 0, policy_version 1518401 (0.0011) [2023-12-28 06:10:29,640][106225] Updated weights for policy 1, policy_version 1522155 (0.0007) [2023-12-28 06:10:29,698][106226] Updated weights for policy 0, policy_version 1518411 (0.0011) [2023-12-28 06:10:29,705][106225] Updated weights for policy 1, policy_version 1522165 (0.0007) [2023-12-28 06:10:29,762][106226] Updated weights for policy 0, policy_version 1518421 (0.0011) [2023-12-28 06:10:30,436][106225] Updated weights for policy 1, policy_version 1522175 (0.0008) [2023-12-28 06:10:30,492][106226] Updated weights for policy 0, policy_version 1518431 (0.0011) [2023-12-28 06:10:30,494][106225] Updated weights for policy 1, policy_version 1522185 (0.0009) [2023-12-28 06:10:30,553][106225] Updated weights for policy 1, policy_version 1522195 (0.0006) [2023-12-28 06:10:30,553][106226] Updated weights for policy 0, policy_version 1518441 (0.0011) [2023-12-28 06:10:30,610][106226] Updated weights for policy 0, policy_version 1518451 (0.0011) [2023-12-28 06:10:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 778534912. Throughput: 0: 9799.6, 1: 9921.4. Samples: 778528012. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:31,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-4.935')] [2023-12-28 06:10:31,295][106226] Updated weights for policy 0, policy_version 1518461 (0.0011) [2023-12-28 06:10:31,309][106225] Updated weights for policy 1, policy_version 1522205 (0.0008) [2023-12-28 06:10:31,358][106226] Updated weights for policy 0, policy_version 1518471 (0.0011) [2023-12-28 06:10:31,368][106225] Updated weights for policy 1, policy_version 1522215 (0.0007) [2023-12-28 06:10:31,418][106226] Updated weights for policy 0, policy_version 1518481 (0.0011) [2023-12-28 06:10:31,430][106225] Updated weights for policy 1, policy_version 1522225 (0.0008) [2023-12-28 06:10:32,129][106225] Updated weights for policy 1, policy_version 1522235 (0.0007) [2023-12-28 06:10:32,173][106226] Updated weights for policy 0, policy_version 1518491 (0.0010) [2023-12-28 06:10:32,183][106225] Updated weights for policy 1, policy_version 1522245 (0.0008) [2023-12-28 06:10:32,234][106226] Updated weights for policy 0, policy_version 1518501 (0.0007) [2023-12-28 06:10:32,239][106225] Updated weights for policy 1, policy_version 1522255 (0.0007) [2023-12-28 06:10:32,295][106226] Updated weights for policy 0, policy_version 1518511 (0.0007) [2023-12-28 06:10:32,990][106225] Updated weights for policy 1, policy_version 1522265 (0.0008) [2023-12-28 06:10:33,017][106226] Updated weights for policy 0, policy_version 1518521 (0.0009) [2023-12-28 06:10:33,045][106225] Updated weights for policy 1, policy_version 1522275 (0.0008) [2023-12-28 06:10:33,066][106226] Updated weights for policy 0, policy_version 1518531 (0.0005) [2023-12-28 06:10:33,095][106225] Updated weights for policy 1, policy_version 1522285 (0.0008) [2023-12-28 06:10:33,116][106226] Updated weights for policy 0, policy_version 1518541 (0.0009) [2023-12-28 06:10:33,150][106225] Updated weights for policy 1, policy_version 1522295 (0.0006) [2023-12-28 06:10:33,164][106226] Updated weights for policy 0, policy_version 1518551 (0.0007) [2023-12-28 06:10:33,843][106225] Updated weights for policy 1, policy_version 1522305 (0.0006) [2023-12-28 06:10:33,863][106226] Updated weights for policy 0, policy_version 1518561 (0.0005) [2023-12-28 06:10:33,891][106225] Updated weights for policy 1, policy_version 1522315 (0.0005) [2023-12-28 06:10:33,914][106226] Updated weights for policy 0, policy_version 1518571 (0.0008) [2023-12-28 06:10:33,949][106225] Updated weights for policy 1, policy_version 1522325 (0.0005) [2023-12-28 06:10:33,965][106226] Updated weights for policy 0, policy_version 1518581 (0.0008) [2023-12-28 06:10:34,617][106225] Updated weights for policy 1, policy_version 1522335 (0.0005) [2023-12-28 06:10:34,647][106226] Updated weights for policy 0, policy_version 1518591 (0.0009) [2023-12-28 06:10:34,678][106225] Updated weights for policy 1, policy_version 1522345 (0.0007) [2023-12-28 06:10:34,710][106226] Updated weights for policy 0, policy_version 1518601 (0.0009) [2023-12-28 06:10:34,740][106225] Updated weights for policy 1, policy_version 1522355 (0.0010) [2023-12-28 06:10:34,764][106226] Updated weights for policy 0, policy_version 1518611 (0.0008) [2023-12-28 06:10:35,341][106226] Updated weights for policy 0, policy_version 1518621 (0.0009) [2023-12-28 06:10:35,375][106225] Updated weights for policy 1, policy_version 1522365 (0.0010) [2023-12-28 06:10:35,401][106226] Updated weights for policy 0, policy_version 1518631 (0.0010) [2023-12-28 06:10:35,427][106225] Updated weights for policy 1, policy_version 1522375 (0.0007) [2023-12-28 06:10:35,455][106226] Updated weights for policy 0, policy_version 1518641 (0.0010) [2023-12-28 06:10:35,487][106225] Updated weights for policy 1, policy_version 1522385 (0.0010) [2023-12-28 06:10:36,151][106226] Updated weights for policy 0, policy_version 1518651 (0.0010) [2023-12-28 06:10:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 778633216. Throughput: 0: 9808.6, 1: 9922.8. Samples: 778648008. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:36,175][105115] Avg episode reward: [(0, '-4.996'), (1, '-4.847')] [2023-12-28 06:10:36,204][106225] Updated weights for policy 1, policy_version 1522395 (0.0010) [2023-12-28 06:10:36,214][106226] Updated weights for policy 0, policy_version 1518661 (0.0009) [2023-12-28 06:10:36,255][106225] Updated weights for policy 1, policy_version 1522405 (0.0010) [2023-12-28 06:10:36,275][106226] Updated weights for policy 0, policy_version 1518671 (0.0007) [2023-12-28 06:10:36,314][106225] Updated weights for policy 1, policy_version 1522415 (0.0008) [2023-12-28 06:10:36,923][106226] Updated weights for policy 0, policy_version 1518681 (0.0010) [2023-12-28 06:10:36,937][106225] Updated weights for policy 1, policy_version 1522425 (0.0008) [2023-12-28 06:10:36,984][106226] Updated weights for policy 0, policy_version 1518691 (0.0007) [2023-12-28 06:10:36,990][106225] Updated weights for policy 1, policy_version 1522435 (0.0007) [2023-12-28 06:10:37,039][106226] Updated weights for policy 0, policy_version 1518701 (0.0011) [2023-12-28 06:10:37,047][106225] Updated weights for policy 1, policy_version 1522445 (0.0006) [2023-12-28 06:10:37,094][106226] Updated weights for policy 0, policy_version 1518711 (0.0011) [2023-12-28 06:10:37,100][106225] Updated weights for policy 1, policy_version 1522455 (0.0005) [2023-12-28 06:10:37,765][106226] Updated weights for policy 0, policy_version 1518721 (0.0009) [2023-12-28 06:10:37,818][106226] Updated weights for policy 0, policy_version 1518731 (0.0008) [2023-12-28 06:10:37,837][106225] Updated weights for policy 1, policy_version 1522465 (0.0008) [2023-12-28 06:10:37,871][106226] Updated weights for policy 0, policy_version 1518741 (0.0008) [2023-12-28 06:10:37,885][106225] Updated weights for policy 1, policy_version 1522475 (0.0005) [2023-12-28 06:10:37,933][106225] Updated weights for policy 1, policy_version 1522485 (0.0005) [2023-12-28 06:10:38,635][106226] Updated weights for policy 0, policy_version 1518751 (0.0007) [2023-12-28 06:10:38,644][106225] Updated weights for policy 1, policy_version 1522495 (0.0007) [2023-12-28 06:10:38,694][106226] Updated weights for policy 0, policy_version 1518761 (0.0007) [2023-12-28 06:10:38,706][106225] Updated weights for policy 1, policy_version 1522505 (0.0007) [2023-12-28 06:10:38,755][106226] Updated weights for policy 0, policy_version 1518771 (0.0007) [2023-12-28 06:10:38,768][106225] Updated weights for policy 1, policy_version 1522515 (0.0007) [2023-12-28 06:10:39,451][106225] Updated weights for policy 1, policy_version 1522525 (0.0009) [2023-12-28 06:10:39,499][106226] Updated weights for policy 0, policy_version 1518781 (0.0006) [2023-12-28 06:10:39,513][106225] Updated weights for policy 1, policy_version 1522535 (0.0007) [2023-12-28 06:10:39,563][106226] Updated weights for policy 0, policy_version 1518791 (0.0006) [2023-12-28 06:10:39,573][106225] Updated weights for policy 1, policy_version 1522545 (0.0006) [2023-12-28 06:10:39,621][106226] Updated weights for policy 0, policy_version 1518801 (0.0007) [2023-12-28 06:10:40,384][106225] Updated weights for policy 1, policy_version 1522555 (0.0008) [2023-12-28 06:10:40,402][106226] Updated weights for policy 0, policy_version 1518811 (0.0008) [2023-12-28 06:10:40,445][106225] Updated weights for policy 1, policy_version 1522565 (0.0006) [2023-12-28 06:10:40,458][106226] Updated weights for policy 0, policy_version 1518821 (0.0008) [2023-12-28 06:10:40,497][106225] Updated weights for policy 1, policy_version 1522575 (0.0005) [2023-12-28 06:10:40,519][106226] Updated weights for policy 0, policy_version 1518831 (0.0008) [2023-12-28 06:10:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 778731520. Throughput: 0: 9831.7, 1: 9979.1. Samples: 778707832. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:41,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.823')] [2023-12-28 06:10:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001522584_389832704.pth... [2023-12-28 06:10:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001518840_388898816.pth... [2023-12-28 06:10:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001521432_389537792.pth [2023-12-28 06:10:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001517720_388612096.pth [2023-12-28 06:10:41,206][106225] Updated weights for policy 1, policy_version 1522585 (0.0005) [2023-12-28 06:10:41,271][106225] Updated weights for policy 1, policy_version 1522595 (0.0007) [2023-12-28 06:10:41,297][106226] Updated weights for policy 0, policy_version 1518841 (0.0008) [2023-12-28 06:10:41,342][106225] Updated weights for policy 1, policy_version 1522605 (0.0007) [2023-12-28 06:10:41,369][106226] Updated weights for policy 0, policy_version 1518851 (0.0006) [2023-12-28 06:10:41,414][106225] Updated weights for policy 1, policy_version 1522615 (0.0008) [2023-12-28 06:10:41,439][106226] Updated weights for policy 0, policy_version 1518861 (0.0009) [2023-12-28 06:10:41,502][106226] Updated weights for policy 0, policy_version 1518871 (0.0009) [2023-12-28 06:10:42,168][106225] Updated weights for policy 1, policy_version 1522625 (0.0008) [2023-12-28 06:10:42,198][106226] Updated weights for policy 0, policy_version 1518881 (0.0008) [2023-12-28 06:10:42,233][106225] Updated weights for policy 1, policy_version 1522635 (0.0006) [2023-12-28 06:10:42,261][106226] Updated weights for policy 0, policy_version 1518891 (0.0008) [2023-12-28 06:10:42,299][106225] Updated weights for policy 1, policy_version 1522645 (0.0008) [2023-12-28 06:10:42,325][106226] Updated weights for policy 0, policy_version 1518901 (0.0008) [2023-12-28 06:10:42,914][106225] Updated weights for policy 1, policy_version 1522655 (0.0007) [2023-12-28 06:10:42,973][106225] Updated weights for policy 1, policy_version 1522665 (0.0009) [2023-12-28 06:10:43,025][106225] Updated weights for policy 1, policy_version 1522675 (0.0009) [2023-12-28 06:10:43,131][106226] Updated weights for policy 0, policy_version 1518911 (0.0008) [2023-12-28 06:10:43,199][106226] Updated weights for policy 0, policy_version 1518921 (0.0006) [2023-12-28 06:10:43,261][106226] Updated weights for policy 0, policy_version 1518931 (0.0005) [2023-12-28 06:10:43,631][106225] Updated weights for policy 1, policy_version 1522685 (0.0007) [2023-12-28 06:10:43,683][106225] Updated weights for policy 1, policy_version 1522695 (0.0005) [2023-12-28 06:10:43,734][106225] Updated weights for policy 1, policy_version 1522705 (0.0005) [2023-12-28 06:10:43,867][106226] Updated weights for policy 0, policy_version 1518941 (0.0007) [2023-12-28 06:10:43,924][106226] Updated weights for policy 0, policy_version 1518951 (0.0010) [2023-12-28 06:10:43,981][106226] Updated weights for policy 0, policy_version 1518961 (0.0010) [2023-12-28 06:10:44,300][106225] Updated weights for policy 1, policy_version 1522715 (0.0006) [2023-12-28 06:10:44,358][106225] Updated weights for policy 1, policy_version 1522725 (0.0008) [2023-12-28 06:10:44,414][106225] Updated weights for policy 1, policy_version 1522735 (0.0007) [2023-12-28 06:10:44,653][106226] Updated weights for policy 0, policy_version 1518971 (0.0009) [2023-12-28 06:10:44,712][106226] Updated weights for policy 0, policy_version 1518981 (0.0010) [2023-12-28 06:10:44,782][106226] Updated weights for policy 0, policy_version 1518991 (0.0009) [2023-12-28 06:10:45,089][106225] Updated weights for policy 1, policy_version 1522745 (0.0007) [2023-12-28 06:10:45,156][106225] Updated weights for policy 1, policy_version 1522755 (0.0008) [2023-12-28 06:10:45,224][106225] Updated weights for policy 1, policy_version 1522765 (0.0007) [2023-12-28 06:10:45,288][106225] Updated weights for policy 1, policy_version 1522775 (0.0010) [2023-12-28 06:10:45,434][106226] Updated weights for policy 0, policy_version 1519001 (0.0010) [2023-12-28 06:10:45,495][106226] Updated weights for policy 0, policy_version 1519011 (0.0008) [2023-12-28 06:10:45,553][106226] Updated weights for policy 0, policy_version 1519021 (0.0008) [2023-12-28 06:10:45,610][106226] Updated weights for policy 0, policy_version 1519031 (0.0008) [2023-12-28 06:10:46,007][106225] Updated weights for policy 1, policy_version 1522785 (0.0006) [2023-12-28 06:10:46,058][106225] Updated weights for policy 1, policy_version 1522795 (0.0005) [2023-12-28 06:10:46,107][106225] Updated weights for policy 1, policy_version 1522805 (0.0005) [2023-12-28 06:10:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 778838016. Throughput: 0: 9843.6, 1: 9951.4. Samples: 778825940. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:46,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-5.032')] [2023-12-28 06:10:46,368][106226] Updated weights for policy 0, policy_version 1519041 (0.0006) [2023-12-28 06:10:46,421][106226] Updated weights for policy 0, policy_version 1519051 (0.0006) [2023-12-28 06:10:46,488][106226] Updated weights for policy 0, policy_version 1519061 (0.0009) [2023-12-28 06:10:46,681][106225] Updated weights for policy 1, policy_version 1522815 (0.0007) [2023-12-28 06:10:46,736][106225] Updated weights for policy 1, policy_version 1522825 (0.0009) [2023-12-28 06:10:46,781][106225] Updated weights for policy 1, policy_version 1522835 (0.0008) [2023-12-28 06:10:47,191][106226] Updated weights for policy 0, policy_version 1519071 (0.0008) [2023-12-28 06:10:47,256][106226] Updated weights for policy 0, policy_version 1519081 (0.0009) [2023-12-28 06:10:47,322][106226] Updated weights for policy 0, policy_version 1519091 (0.0007) [2023-12-28 06:10:47,441][106225] Updated weights for policy 1, policy_version 1522845 (0.0009) [2023-12-28 06:10:47,498][106225] Updated weights for policy 1, policy_version 1522855 (0.0010) [2023-12-28 06:10:47,559][106225] Updated weights for policy 1, policy_version 1522865 (0.0010) [2023-12-28 06:10:47,928][106226] Updated weights for policy 0, policy_version 1519101 (0.0007) [2023-12-28 06:10:47,987][106226] Updated weights for policy 0, policy_version 1519111 (0.0007) [2023-12-28 06:10:48,052][106226] Updated weights for policy 0, policy_version 1519121 (0.0006) [2023-12-28 06:10:48,316][106225] Updated weights for policy 1, policy_version 1522875 (0.0009) [2023-12-28 06:10:48,389][106225] Updated weights for policy 1, policy_version 1522885 (0.0009) [2023-12-28 06:10:48,451][106225] Updated weights for policy 1, policy_version 1522895 (0.0006) [2023-12-28 06:10:48,712][106226] Updated weights for policy 0, policy_version 1519131 (0.0007) [2023-12-28 06:10:48,772][106226] Updated weights for policy 0, policy_version 1519141 (0.0009) [2023-12-28 06:10:48,832][106226] Updated weights for policy 0, policy_version 1519151 (0.0009) [2023-12-28 06:10:49,087][106225] Updated weights for policy 1, policy_version 1522905 (0.0008) [2023-12-28 06:10:49,148][106225] Updated weights for policy 1, policy_version 1522915 (0.0008) [2023-12-28 06:10:49,212][106225] Updated weights for policy 1, policy_version 1522925 (0.0008) [2023-12-28 06:10:49,286][106225] Updated weights for policy 1, policy_version 1522935 (0.0008) [2023-12-28 06:10:49,626][106226] Updated weights for policy 0, policy_version 1519161 (0.0009) [2023-12-28 06:10:49,687][106226] Updated weights for policy 0, policy_version 1519171 (0.0011) [2023-12-28 06:10:49,745][106226] Updated weights for policy 0, policy_version 1519181 (0.0011) [2023-12-28 06:10:49,811][106226] Updated weights for policy 0, policy_version 1519191 (0.0011) [2023-12-28 06:10:50,024][106225] Updated weights for policy 1, policy_version 1522945 (0.0006) [2023-12-28 06:10:50,087][106225] Updated weights for policy 1, policy_version 1522955 (0.0006) [2023-12-28 06:10:50,153][106225] Updated weights for policy 1, policy_version 1522965 (0.0008) [2023-12-28 06:10:50,591][106226] Updated weights for policy 0, policy_version 1519201 (0.0010) [2023-12-28 06:10:50,649][106226] Updated weights for policy 0, policy_version 1519211 (0.0009) [2023-12-28 06:10:50,711][106226] Updated weights for policy 0, policy_version 1519221 (0.0009) [2023-12-28 06:10:50,855][106225] Updated weights for policy 1, policy_version 1522975 (0.0008) [2023-12-28 06:10:50,923][106225] Updated weights for policy 1, policy_version 1522985 (0.0009) [2023-12-28 06:10:50,978][106225] Updated weights for policy 1, policy_version 1522995 (0.0010) [2023-12-28 06:10:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 778936320. Throughput: 0: 9766.2, 1: 10016.2. Samples: 778944584. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:51,175][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.632')] [2023-12-28 06:10:51,371][106226] Updated weights for policy 0, policy_version 1519231 (0.0009) [2023-12-28 06:10:51,439][106226] Updated weights for policy 0, policy_version 1519241 (0.0009) [2023-12-28 06:10:51,498][106226] Updated weights for policy 0, policy_version 1519251 (0.0008) [2023-12-28 06:10:51,770][106225] Updated weights for policy 1, policy_version 1523005 (0.0009) [2023-12-28 06:10:51,839][106225] Updated weights for policy 1, policy_version 1523015 (0.0007) [2023-12-28 06:10:51,907][106225] Updated weights for policy 1, policy_version 1523025 (0.0008) [2023-12-28 06:10:52,257][106226] Updated weights for policy 0, policy_version 1519261 (0.0009) [2023-12-28 06:10:52,320][106226] Updated weights for policy 0, policy_version 1519271 (0.0008) [2023-12-28 06:10:52,396][106226] Updated weights for policy 0, policy_version 1519281 (0.0009) [2023-12-28 06:10:52,531][106225] Updated weights for policy 1, policy_version 1523035 (0.0006) [2023-12-28 06:10:52,589][106225] Updated weights for policy 1, policy_version 1523045 (0.0009) [2023-12-28 06:10:52,637][106225] Updated weights for policy 1, policy_version 1523055 (0.0006) [2023-12-28 06:10:53,020][106226] Updated weights for policy 0, policy_version 1519291 (0.0008) [2023-12-28 06:10:53,077][106226] Updated weights for policy 0, policy_version 1519301 (0.0009) [2023-12-28 06:10:53,132][106226] Updated weights for policy 0, policy_version 1519311 (0.0009) [2023-12-28 06:10:53,271][106225] Updated weights for policy 1, policy_version 1523065 (0.0006) [2023-12-28 06:10:53,328][106225] Updated weights for policy 1, policy_version 1523075 (0.0007) [2023-12-28 06:10:53,386][106225] Updated weights for policy 1, policy_version 1523085 (0.0005) [2023-12-28 06:10:53,451][106225] Updated weights for policy 1, policy_version 1523095 (0.0006) [2023-12-28 06:10:53,955][106226] Updated weights for policy 0, policy_version 1519321 (0.0009) [2023-12-28 06:10:54,010][106226] Updated weights for policy 0, policy_version 1519331 (0.0006) [2023-12-28 06:10:54,012][106225] Updated weights for policy 1, policy_version 1523105 (0.0007) [2023-12-28 06:10:54,060][106225] Updated weights for policy 1, policy_version 1523115 (0.0007) [2023-12-28 06:10:54,066][106226] Updated weights for policy 0, policy_version 1519341 (0.0008) [2023-12-28 06:10:54,109][106225] Updated weights for policy 1, policy_version 1523125 (0.0007) [2023-12-28 06:10:54,111][106226] Updated weights for policy 0, policy_version 1519351 (0.0006) [2023-12-28 06:10:54,795][106225] Updated weights for policy 1, policy_version 1523135 (0.0009) [2023-12-28 06:10:54,854][106225] Updated weights for policy 1, policy_version 1523145 (0.0010) [2023-12-28 06:10:54,887][106226] Updated weights for policy 0, policy_version 1519361 (0.0008) [2023-12-28 06:10:54,911][106225] Updated weights for policy 1, policy_version 1523155 (0.0010) [2023-12-28 06:10:54,944][106226] Updated weights for policy 0, policy_version 1519371 (0.0005) [2023-12-28 06:10:55,000][106226] Updated weights for policy 0, policy_version 1519381 (0.0009) [2023-12-28 06:10:55,560][106225] Updated weights for policy 1, policy_version 1523165 (0.0008) [2023-12-28 06:10:55,620][106225] Updated weights for policy 1, policy_version 1523175 (0.0008) [2023-12-28 06:10:55,676][106225] Updated weights for policy 1, policy_version 1523185 (0.0007) [2023-12-28 06:10:55,758][106226] Updated weights for policy 0, policy_version 1519391 (0.0007) [2023-12-28 06:10:55,823][106226] Updated weights for policy 0, policy_version 1519401 (0.0010) [2023-12-28 06:10:55,887][106226] Updated weights for policy 0, policy_version 1519411 (0.0011) [2023-12-28 06:10:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 779034624. Throughput: 0: 9722.7, 1: 10029.4. Samples: 779003004. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:10:56,175][105115] Avg episode reward: [(0, '-4.747'), (1, '-4.932')] [2023-12-28 06:10:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001519416_389046272.pth... [2023-12-28 06:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001523192_389988352.pth... [2023-12-28 06:10:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001522008_389685248.pth [2023-12-28 06:10:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001518264_388751360.pth [2023-12-28 06:10:56,435][106225] Updated weights for policy 1, policy_version 1523195 (0.0007) [2023-12-28 06:10:56,488][106225] Updated weights for policy 1, policy_version 1523205 (0.0010) [2023-12-28 06:10:56,518][106226] Updated weights for policy 0, policy_version 1519421 (0.0008) [2023-12-28 06:10:56,545][106225] Updated weights for policy 1, policy_version 1523215 (0.0008) [2023-12-28 06:10:56,573][106226] Updated weights for policy 0, policy_version 1519431 (0.0006) [2023-12-28 06:10:56,625][106226] Updated weights for policy 0, policy_version 1519441 (0.0007) [2023-12-28 06:10:57,214][106226] Updated weights for policy 0, policy_version 1519451 (0.0007) [2023-12-28 06:10:57,251][106225] Updated weights for policy 1, policy_version 1523225 (0.0010) [2023-12-28 06:10:57,275][106226] Updated weights for policy 0, policy_version 1519461 (0.0011) [2023-12-28 06:10:57,311][106225] Updated weights for policy 1, policy_version 1523235 (0.0007) [2023-12-28 06:10:57,326][106226] Updated weights for policy 0, policy_version 1519471 (0.0007) [2023-12-28 06:10:57,368][106225] Updated weights for policy 1, policy_version 1523245 (0.0006) [2023-12-28 06:10:57,434][106225] Updated weights for policy 1, policy_version 1523255 (0.0005) [2023-12-28 06:10:57,957][106225] Updated weights for policy 1, policy_version 1523265 (0.0005) [2023-12-28 06:10:57,974][106226] Updated weights for policy 0, policy_version 1519481 (0.0010) [2023-12-28 06:10:58,011][106225] Updated weights for policy 1, policy_version 1523275 (0.0005) [2023-12-28 06:10:58,024][106226] Updated weights for policy 0, policy_version 1519491 (0.0010) [2023-12-28 06:10:58,063][106225] Updated weights for policy 1, policy_version 1523285 (0.0006) [2023-12-28 06:10:58,082][106226] Updated weights for policy 0, policy_version 1519501 (0.0008) [2023-12-28 06:10:58,136][106226] Updated weights for policy 0, policy_version 1519511 (0.0009) [2023-12-28 06:10:58,716][106225] Updated weights for policy 1, policy_version 1523295 (0.0009) [2023-12-28 06:10:58,777][106225] Updated weights for policy 1, policy_version 1523305 (0.0011) [2023-12-28 06:10:58,844][106225] Updated weights for policy 1, policy_version 1523315 (0.0008) [2023-12-28 06:10:58,886][106226] Updated weights for policy 0, policy_version 1519521 (0.0008) [2023-12-28 06:10:58,952][106226] Updated weights for policy 0, policy_version 1519531 (0.0008) [2023-12-28 06:10:59,024][106226] Updated weights for policy 0, policy_version 1519541 (0.0008) [2023-12-28 06:10:59,635][106225] Updated weights for policy 1, policy_version 1523325 (0.0008) [2023-12-28 06:10:59,690][106225] Updated weights for policy 1, policy_version 1523335 (0.0008) [2023-12-28 06:10:59,743][106225] Updated weights for policy 1, policy_version 1523345 (0.0009) [2023-12-28 06:10:59,786][106226] Updated weights for policy 0, policy_version 1519551 (0.0006) [2023-12-28 06:10:59,853][106226] Updated weights for policy 0, policy_version 1519561 (0.0007) [2023-12-28 06:10:59,916][106226] Updated weights for policy 0, policy_version 1519571 (0.0006) [2023-12-28 06:11:00,543][106225] Updated weights for policy 1, policy_version 1523355 (0.0009) [2023-12-28 06:11:00,551][106226] Updated weights for policy 0, policy_version 1519581 (0.0007) [2023-12-28 06:11:00,595][106225] Updated weights for policy 1, policy_version 1523365 (0.0007) [2023-12-28 06:11:00,606][106226] Updated weights for policy 0, policy_version 1519591 (0.0007) [2023-12-28 06:11:00,646][106225] Updated weights for policy 1, policy_version 1523375 (0.0008) [2023-12-28 06:11:00,662][106226] Updated weights for policy 0, policy_version 1519601 (0.0006) [2023-12-28 06:11:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 779132928. Throughput: 0: 9826.8, 1: 10068.8. Samples: 779123428. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:01,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.507')] [2023-12-28 06:11:01,284][106226] Updated weights for policy 0, policy_version 1519611 (0.0006) [2023-12-28 06:11:01,343][106226] Updated weights for policy 0, policy_version 1519621 (0.0006) [2023-12-28 06:11:01,417][106226] Updated weights for policy 0, policy_version 1519631 (0.0008) [2023-12-28 06:11:01,480][106225] Updated weights for policy 1, policy_version 1523385 (0.0008) [2023-12-28 06:11:01,535][106225] Updated weights for policy 1, policy_version 1523395 (0.0008) [2023-12-28 06:11:01,587][106225] Updated weights for policy 1, policy_version 1523405 (0.0008) [2023-12-28 06:11:01,659][106225] Updated weights for policy 1, policy_version 1523415 (0.0008) [2023-12-28 06:11:02,123][106226] Updated weights for policy 0, policy_version 1519641 (0.0009) [2023-12-28 06:11:02,191][106226] Updated weights for policy 0, policy_version 1519651 (0.0008) [2023-12-28 06:11:02,245][106226] Updated weights for policy 0, policy_version 1519661 (0.0006) [2023-12-28 06:11:02,309][106226] Updated weights for policy 0, policy_version 1519671 (0.0008) [2023-12-28 06:11:02,362][106225] Updated weights for policy 1, policy_version 1523425 (0.0010) [2023-12-28 06:11:02,427][106225] Updated weights for policy 1, policy_version 1523435 (0.0011) [2023-12-28 06:11:02,482][106225] Updated weights for policy 1, policy_version 1523445 (0.0011) [2023-12-28 06:11:02,947][106226] Updated weights for policy 0, policy_version 1519681 (0.0006) [2023-12-28 06:11:02,999][106226] Updated weights for policy 0, policy_version 1519691 (0.0005) [2023-12-28 06:11:03,054][106226] Updated weights for policy 0, policy_version 1519701 (0.0005) [2023-12-28 06:11:03,135][106225] Updated weights for policy 1, policy_version 1523455 (0.0010) [2023-12-28 06:11:03,189][106225] Updated weights for policy 1, policy_version 1523465 (0.0010) [2023-12-28 06:11:03,257][106225] Updated weights for policy 1, policy_version 1523475 (0.0009) [2023-12-28 06:11:03,713][106226] Updated weights for policy 0, policy_version 1519711 (0.0008) [2023-12-28 06:11:03,759][106226] Updated weights for policy 0, policy_version 1519721 (0.0007) [2023-12-28 06:11:03,808][106226] Updated weights for policy 0, policy_version 1519731 (0.0008) [2023-12-28 06:11:03,859][106225] Updated weights for policy 1, policy_version 1523485 (0.0009) [2023-12-28 06:11:03,925][106225] Updated weights for policy 1, policy_version 1523495 (0.0008) [2023-12-28 06:11:03,988][106225] Updated weights for policy 1, policy_version 1523505 (0.0008) [2023-12-28 06:11:04,559][106226] Updated weights for policy 0, policy_version 1519741 (0.0006) [2023-12-28 06:11:04,616][106226] Updated weights for policy 0, policy_version 1519751 (0.0006) [2023-12-28 06:11:04,677][106226] Updated weights for policy 0, policy_version 1519761 (0.0008) [2023-12-28 06:11:04,677][106225] Updated weights for policy 1, policy_version 1523515 (0.0009) [2023-12-28 06:11:04,733][106225] Updated weights for policy 1, policy_version 1523525 (0.0010) [2023-12-28 06:11:04,795][106225] Updated weights for policy 1, policy_version 1523535 (0.0010) [2023-12-28 06:11:05,264][106226] Updated weights for policy 0, policy_version 1519771 (0.0007) [2023-12-28 06:11:05,322][106226] Updated weights for policy 0, policy_version 1519781 (0.0005) [2023-12-28 06:11:05,385][106226] Updated weights for policy 0, policy_version 1519791 (0.0006) [2023-12-28 06:11:05,512][106225] Updated weights for policy 1, policy_version 1523545 (0.0010) [2023-12-28 06:11:05,568][106225] Updated weights for policy 1, policy_version 1523555 (0.0010) [2023-12-28 06:11:05,623][106225] Updated weights for policy 1, policy_version 1523565 (0.0010) [2023-12-28 06:11:05,682][106225] Updated weights for policy 1, policy_version 1523575 (0.0010) [2023-12-28 06:11:05,925][106226] Updated weights for policy 0, policy_version 1519801 (0.0010) [2023-12-28 06:11:05,981][106226] Updated weights for policy 0, policy_version 1519811 (0.0011) [2023-12-28 06:11:06,045][106226] Updated weights for policy 0, policy_version 1519821 (0.0010) [2023-12-28 06:11:06,108][106226] Updated weights for policy 0, policy_version 1519831 (0.0010) [2023-12-28 06:11:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 779239424. Throughput: 0: 9922.7, 1: 10001.7. Samples: 779245388. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:06,175][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.405')] [2023-12-28 06:11:06,415][106225] Updated weights for policy 1, policy_version 1523585 (0.0010) [2023-12-28 06:11:06,476][106225] Updated weights for policy 1, policy_version 1523595 (0.0011) [2023-12-28 06:11:06,537][106225] Updated weights for policy 1, policy_version 1523605 (0.0011) [2023-12-28 06:11:06,783][106226] Updated weights for policy 0, policy_version 1519841 (0.0009) [2023-12-28 06:11:06,850][106226] Updated weights for policy 0, policy_version 1519851 (0.0009) [2023-12-28 06:11:06,905][106226] Updated weights for policy 0, policy_version 1519861 (0.0007) [2023-12-28 06:11:07,293][106225] Updated weights for policy 1, policy_version 1523615 (0.0007) [2023-12-28 06:11:07,347][106225] Updated weights for policy 1, policy_version 1523625 (0.0005) [2023-12-28 06:11:07,396][106225] Updated weights for policy 1, policy_version 1523635 (0.0005) [2023-12-28 06:11:07,556][106226] Updated weights for policy 0, policy_version 1519871 (0.0008) [2023-12-28 06:11:07,612][106226] Updated weights for policy 0, policy_version 1519881 (0.0009) [2023-12-28 06:11:07,670][106226] Updated weights for policy 0, policy_version 1519891 (0.0009) [2023-12-28 06:11:08,065][106225] Updated weights for policy 1, policy_version 1523645 (0.0007) [2023-12-28 06:11:08,113][106225] Updated weights for policy 1, policy_version 1523655 (0.0007) [2023-12-28 06:11:08,162][106225] Updated weights for policy 1, policy_version 1523665 (0.0005) [2023-12-28 06:11:08,438][106226] Updated weights for policy 0, policy_version 1519901 (0.0009) [2023-12-28 06:11:08,503][106226] Updated weights for policy 0, policy_version 1519911 (0.0009) [2023-12-28 06:11:08,571][106226] Updated weights for policy 0, policy_version 1519921 (0.0009) [2023-12-28 06:11:08,835][106225] Updated weights for policy 1, policy_version 1523675 (0.0006) [2023-12-28 06:11:08,898][106225] Updated weights for policy 1, policy_version 1523685 (0.0008) [2023-12-28 06:11:08,956][106225] Updated weights for policy 1, policy_version 1523695 (0.0007) [2023-12-28 06:11:09,336][106226] Updated weights for policy 0, policy_version 1519931 (0.0009) [2023-12-28 06:11:09,409][106226] Updated weights for policy 0, policy_version 1519941 (0.0008) [2023-12-28 06:11:09,469][106226] Updated weights for policy 0, policy_version 1519951 (0.0008) [2023-12-28 06:11:09,597][106225] Updated weights for policy 1, policy_version 1523705 (0.0005) [2023-12-28 06:11:09,654][106225] Updated weights for policy 1, policy_version 1523715 (0.0009) [2023-12-28 06:11:09,718][106225] Updated weights for policy 1, policy_version 1523725 (0.0009) [2023-12-28 06:11:09,779][106225] Updated weights for policy 1, policy_version 1523735 (0.0009) [2023-12-28 06:11:10,189][106226] Updated weights for policy 0, policy_version 1519961 (0.0009) [2023-12-28 06:11:10,242][106226] Updated weights for policy 0, policy_version 1519971 (0.0009) [2023-12-28 06:11:10,299][106226] Updated weights for policy 0, policy_version 1519981 (0.0006) [2023-12-28 06:11:10,362][106226] Updated weights for policy 0, policy_version 1519991 (0.0005) [2023-12-28 06:11:10,604][106225] Updated weights for policy 1, policy_version 1523745 (0.0009) [2023-12-28 06:11:10,663][106225] Updated weights for policy 1, policy_version 1523755 (0.0009) [2023-12-28 06:11:10,713][106225] Updated weights for policy 1, policy_version 1523765 (0.0009) [2023-12-28 06:11:10,916][106226] Updated weights for policy 0, policy_version 1520001 (0.0006) [2023-12-28 06:11:10,972][106226] Updated weights for policy 0, policy_version 1520011 (0.0006) [2023-12-28 06:11:11,046][106226] Updated weights for policy 0, policy_version 1520021 (0.0008) [2023-12-28 06:11:11,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 779337728. Throughput: 0: 9961.2, 1: 10066.9. Samples: 779304620. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:11,175][105115] Avg episode reward: [(0, '-4.867'), (1, '-4.555')] [2023-12-28 06:11:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001523768_390135808.pth... [2023-12-28 06:11:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001520024_389201920.pth... [2023-12-28 06:11:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001518840_388898816.pth [2023-12-28 06:11:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001522584_389832704.pth [2023-12-28 06:11:11,527][106225] Updated weights for policy 1, policy_version 1523775 (0.0008) [2023-12-28 06:11:11,592][106225] Updated weights for policy 1, policy_version 1523785 (0.0008) [2023-12-28 06:11:11,661][106225] Updated weights for policy 1, policy_version 1523795 (0.0008) [2023-12-28 06:11:11,800][106226] Updated weights for policy 0, policy_version 1520031 (0.0008) [2023-12-28 06:11:11,866][106226] Updated weights for policy 0, policy_version 1520041 (0.0008) [2023-12-28 06:11:11,935][106226] Updated weights for policy 0, policy_version 1520051 (0.0008) [2023-12-28 06:11:12,395][106225] Updated weights for policy 1, policy_version 1523805 (0.0009) [2023-12-28 06:11:12,459][106225] Updated weights for policy 1, policy_version 1523815 (0.0009) [2023-12-28 06:11:12,522][106225] Updated weights for policy 1, policy_version 1523825 (0.0006) [2023-12-28 06:11:12,606][106226] Updated weights for policy 0, policy_version 1520061 (0.0008) [2023-12-28 06:11:12,678][106226] Updated weights for policy 0, policy_version 1520071 (0.0008) [2023-12-28 06:11:12,740][106226] Updated weights for policy 0, policy_version 1520081 (0.0006) [2023-12-28 06:11:13,197][106225] Updated weights for policy 1, policy_version 1523835 (0.0010) [2023-12-28 06:11:13,251][106225] Updated weights for policy 1, policy_version 1523845 (0.0010) [2023-12-28 06:11:13,311][106225] Updated weights for policy 1, policy_version 1523855 (0.0010) [2023-12-28 06:11:13,394][106226] Updated weights for policy 0, policy_version 1520091 (0.0006) [2023-12-28 06:11:13,451][106226] Updated weights for policy 0, policy_version 1520101 (0.0008) [2023-12-28 06:11:13,506][106226] Updated weights for policy 0, policy_version 1520111 (0.0006) [2023-12-28 06:11:14,032][106225] Updated weights for policy 1, policy_version 1523865 (0.0010) [2023-12-28 06:11:14,091][106225] Updated weights for policy 1, policy_version 1523875 (0.0010) [2023-12-28 06:11:14,152][106225] Updated weights for policy 1, policy_version 1523885 (0.0010) [2023-12-28 06:11:14,182][106226] Updated weights for policy 0, policy_version 1520121 (0.0007) [2023-12-28 06:11:14,210][106225] Updated weights for policy 1, policy_version 1523895 (0.0006) [2023-12-28 06:11:14,242][106226] Updated weights for policy 0, policy_version 1520131 (0.0007) [2023-12-28 06:11:14,299][106226] Updated weights for policy 0, policy_version 1520141 (0.0006) [2023-12-28 06:11:14,351][106226] Updated weights for policy 0, policy_version 1520151 (0.0005) [2023-12-28 06:11:14,856][106225] Updated weights for policy 1, policy_version 1523905 (0.0008) [2023-12-28 06:11:14,915][106225] Updated weights for policy 1, policy_version 1523915 (0.0008) [2023-12-28 06:11:14,979][106225] Updated weights for policy 1, policy_version 1523925 (0.0008) [2023-12-28 06:11:15,043][106226] Updated weights for policy 0, policy_version 1520161 (0.0008) [2023-12-28 06:11:15,105][106226] Updated weights for policy 0, policy_version 1520171 (0.0007) [2023-12-28 06:11:15,174][106226] Updated weights for policy 0, policy_version 1520181 (0.0006) [2023-12-28 06:11:15,610][106225] Updated weights for policy 1, policy_version 1523935 (0.0007) [2023-12-28 06:11:15,672][106225] Updated weights for policy 1, policy_version 1523945 (0.0006) [2023-12-28 06:11:15,728][106225] Updated weights for policy 1, policy_version 1523955 (0.0010) [2023-12-28 06:11:15,864][106226] Updated weights for policy 0, policy_version 1520191 (0.0007) [2023-12-28 06:11:15,911][106226] Updated weights for policy 0, policy_version 1520201 (0.0008) [2023-12-28 06:11:15,963][106226] Updated weights for policy 0, policy_version 1520211 (0.0007) [2023-12-28 06:11:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 779436032. Throughput: 0: 9936.7, 1: 9928.7. Samples: 779421952. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:16,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-4.585')] [2023-12-28 06:11:16,365][106225] Updated weights for policy 1, policy_version 1523965 (0.0008) [2023-12-28 06:11:16,420][106225] Updated weights for policy 1, policy_version 1523975 (0.0005) [2023-12-28 06:11:16,473][106225] Updated weights for policy 1, policy_version 1523985 (0.0005) [2023-12-28 06:11:16,756][106226] Updated weights for policy 0, policy_version 1520221 (0.0007) [2023-12-28 06:11:16,821][106226] Updated weights for policy 0, policy_version 1520231 (0.0008) [2023-12-28 06:11:16,867][106226] Updated weights for policy 0, policy_version 1520241 (0.0007) [2023-12-28 06:11:17,069][106225] Updated weights for policy 1, policy_version 1523995 (0.0007) [2023-12-28 06:11:17,130][106225] Updated weights for policy 1, policy_version 1524005 (0.0010) [2023-12-28 06:11:17,195][106225] Updated weights for policy 1, policy_version 1524015 (0.0010) [2023-12-28 06:11:17,586][106226] Updated weights for policy 0, policy_version 1520251 (0.0008) [2023-12-28 06:11:17,646][106226] Updated weights for policy 0, policy_version 1520261 (0.0008) [2023-12-28 06:11:17,703][106226] Updated weights for policy 0, policy_version 1520271 (0.0010) [2023-12-28 06:11:17,788][106225] Updated weights for policy 1, policy_version 1524025 (0.0010) [2023-12-28 06:11:17,835][106225] Updated weights for policy 1, policy_version 1524035 (0.0005) [2023-12-28 06:11:17,886][106225] Updated weights for policy 1, policy_version 1524045 (0.0005) [2023-12-28 06:11:17,934][106225] Updated weights for policy 1, policy_version 1524055 (0.0007) [2023-12-28 06:11:18,466][106226] Updated weights for policy 0, policy_version 1520281 (0.0009) [2023-12-28 06:11:18,519][106226] Updated weights for policy 0, policy_version 1520291 (0.0009) [2023-12-28 06:11:18,581][106226] Updated weights for policy 0, policy_version 1520301 (0.0008) [2023-12-28 06:11:18,644][106226] Updated weights for policy 0, policy_version 1520311 (0.0009) [2023-12-28 06:11:18,678][106225] Updated weights for policy 1, policy_version 1524065 (0.0007) [2023-12-28 06:11:18,740][106225] Updated weights for policy 1, policy_version 1524075 (0.0007) [2023-12-28 06:11:18,803][106225] Updated weights for policy 1, policy_version 1524085 (0.0008) [2023-12-28 06:11:19,284][106226] Updated weights for policy 0, policy_version 1520321 (0.0007) [2023-12-28 06:11:19,341][106226] Updated weights for policy 0, policy_version 1520331 (0.0007) [2023-12-28 06:11:19,413][106226] Updated weights for policy 0, policy_version 1520341 (0.0008) [2023-12-28 06:11:19,587][106225] Updated weights for policy 1, policy_version 1524095 (0.0009) [2023-12-28 06:11:19,654][106225] Updated weights for policy 1, policy_version 1524105 (0.0010) [2023-12-28 06:11:19,720][106225] Updated weights for policy 1, policy_version 1524115 (0.0009) [2023-12-28 06:11:20,091][106226] Updated weights for policy 0, policy_version 1520351 (0.0007) [2023-12-28 06:11:20,159][106226] Updated weights for policy 0, policy_version 1520361 (0.0006) [2023-12-28 06:11:20,223][106226] Updated weights for policy 0, policy_version 1520371 (0.0006) [2023-12-28 06:11:20,550][106225] Updated weights for policy 1, policy_version 1524125 (0.0009) [2023-12-28 06:11:20,630][106225] Updated weights for policy 1, policy_version 1524135 (0.0009) [2023-12-28 06:11:20,699][106225] Updated weights for policy 1, policy_version 1524145 (0.0009) [2023-12-28 06:11:20,920][106226] Updated weights for policy 0, policy_version 1520381 (0.0007) [2023-12-28 06:11:20,983][106226] Updated weights for policy 0, policy_version 1520391 (0.0008) [2023-12-28 06:11:21,059][106226] Updated weights for policy 0, policy_version 1520401 (0.0009) [2023-12-28 06:11:21,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 779534336. Throughput: 0: 9889.2, 1: 9942.4. Samples: 779540432. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:21,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.626')] [2023-12-28 06:11:21,481][106225] Updated weights for policy 1, policy_version 1524155 (0.0009) [2023-12-28 06:11:21,540][106225] Updated weights for policy 1, policy_version 1524165 (0.0008) [2023-12-28 06:11:21,606][106225] Updated weights for policy 1, policy_version 1524175 (0.0008) [2023-12-28 06:11:21,861][106226] Updated weights for policy 0, policy_version 1520411 (0.0008) [2023-12-28 06:11:21,920][106226] Updated weights for policy 0, policy_version 1520421 (0.0006) [2023-12-28 06:11:21,985][106226] Updated weights for policy 0, policy_version 1520431 (0.0008) [2023-12-28 06:11:22,427][106225] Updated weights for policy 1, policy_version 1524185 (0.0009) [2023-12-28 06:11:22,489][106225] Updated weights for policy 1, policy_version 1524195 (0.0008) [2023-12-28 06:11:22,551][106225] Updated weights for policy 1, policy_version 1524205 (0.0008) [2023-12-28 06:11:22,613][106225] Updated weights for policy 1, policy_version 1524215 (0.0008) [2023-12-28 06:11:22,702][106226] Updated weights for policy 0, policy_version 1520441 (0.0009) [2023-12-28 06:11:22,766][106226] Updated weights for policy 0, policy_version 1520451 (0.0009) [2023-12-28 06:11:22,828][106226] Updated weights for policy 0, policy_version 1520461 (0.0006) [2023-12-28 06:11:22,895][106226] Updated weights for policy 0, policy_version 1520471 (0.0006) [2023-12-28 06:11:23,411][106226] Updated weights for policy 0, policy_version 1520481 (0.0006) [2023-12-28 06:11:23,433][106225] Updated weights for policy 1, policy_version 1524225 (0.0007) [2023-12-28 06:11:23,469][106226] Updated weights for policy 0, policy_version 1520491 (0.0010) [2023-12-28 06:11:23,489][106225] Updated weights for policy 1, policy_version 1524235 (0.0008) [2023-12-28 06:11:23,525][106226] Updated weights for policy 0, policy_version 1520501 (0.0011) [2023-12-28 06:11:23,535][106225] Updated weights for policy 1, policy_version 1524245 (0.0007) [2023-12-28 06:11:24,235][106226] Updated weights for policy 0, policy_version 1520511 (0.0007) [2023-12-28 06:11:24,285][106225] Updated weights for policy 1, policy_version 1524255 (0.0009) [2023-12-28 06:11:24,287][106226] Updated weights for policy 0, policy_version 1520521 (0.0005) [2023-12-28 06:11:24,332][106225] Updated weights for policy 1, policy_version 1524265 (0.0010) [2023-12-28 06:11:24,334][106226] Updated weights for policy 0, policy_version 1520531 (0.0005) [2023-12-28 06:11:24,379][106225] Updated weights for policy 1, policy_version 1524275 (0.0010) [2023-12-28 06:11:25,037][106226] Updated weights for policy 0, policy_version 1520541 (0.0005) [2023-12-28 06:11:25,067][106225] Updated weights for policy 1, policy_version 1524285 (0.0008) [2023-12-28 06:11:25,098][106226] Updated weights for policy 0, policy_version 1520551 (0.0006) [2023-12-28 06:11:25,124][106225] Updated weights for policy 1, policy_version 1524295 (0.0010) [2023-12-28 06:11:25,164][106226] Updated weights for policy 0, policy_version 1520561 (0.0006) [2023-12-28 06:11:25,180][106225] Updated weights for policy 1, policy_version 1524305 (0.0008) [2023-12-28 06:11:25,776][106226] Updated weights for policy 0, policy_version 1520571 (0.0006) [2023-12-28 06:11:25,832][106226] Updated weights for policy 0, policy_version 1520581 (0.0006) [2023-12-28 06:11:25,891][106226] Updated weights for policy 0, policy_version 1520591 (0.0008) [2023-12-28 06:11:25,920][106225] Updated weights for policy 1, policy_version 1524315 (0.0008) [2023-12-28 06:11:25,966][106225] Updated weights for policy 1, policy_version 1524325 (0.0006) [2023-12-28 06:11:26,016][106225] Updated weights for policy 1, policy_version 1524335 (0.0008) [2023-12-28 06:11:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 779632640. Throughput: 0: 9901.8, 1: 9850.1. Samples: 779596668. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:26,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.861')] [2023-12-28 06:11:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001524344_390283264.pth... [2023-12-28 06:11:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001520600_389349376.pth... [2023-12-28 06:11:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001523192_389988352.pth [2023-12-28 06:11:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001519416_389046272.pth [2023-12-28 06:11:26,470][106226] Updated weights for policy 0, policy_version 1520601 (0.0007) [2023-12-28 06:11:26,534][106226] Updated weights for policy 0, policy_version 1520611 (0.0009) [2023-12-28 06:11:26,590][106226] Updated weights for policy 0, policy_version 1520621 (0.0009) [2023-12-28 06:11:26,637][106226] Updated weights for policy 0, policy_version 1520631 (0.0007) [2023-12-28 06:11:26,653][106225] Updated weights for policy 1, policy_version 1524345 (0.0006) [2023-12-28 06:11:26,710][106225] Updated weights for policy 1, policy_version 1524355 (0.0009) [2023-12-28 06:11:26,760][106225] Updated weights for policy 1, policy_version 1524365 (0.0009) [2023-12-28 06:11:26,818][106225] Updated weights for policy 1, policy_version 1524375 (0.0006) [2023-12-28 06:11:27,282][106226] Updated weights for policy 0, policy_version 1520641 (0.0007) [2023-12-28 06:11:27,338][106226] Updated weights for policy 0, policy_version 1520651 (0.0010) [2023-12-28 06:11:27,391][106226] Updated weights for policy 0, policy_version 1520661 (0.0010) [2023-12-28 06:11:27,464][106225] Updated weights for policy 1, policy_version 1524385 (0.0010) [2023-12-28 06:11:27,519][106225] Updated weights for policy 1, policy_version 1524395 (0.0005) [2023-12-28 06:11:27,569][106225] Updated weights for policy 1, policy_version 1524405 (0.0005) [2023-12-28 06:11:28,036][106226] Updated weights for policy 0, policy_version 1520671 (0.0008) [2023-12-28 06:11:28,081][106226] Updated weights for policy 0, policy_version 1520681 (0.0010) [2023-12-28 06:11:28,127][106226] Updated weights for policy 0, policy_version 1520691 (0.0010) [2023-12-28 06:11:28,213][106225] Updated weights for policy 1, policy_version 1524415 (0.0009) [2023-12-28 06:11:28,266][106225] Updated weights for policy 1, policy_version 1524425 (0.0010) [2023-12-28 06:11:28,311][106225] Updated weights for policy 1, policy_version 1524435 (0.0010) [2023-12-28 06:11:28,862][106226] Updated weights for policy 0, policy_version 1520701 (0.0010) [2023-12-28 06:11:28,914][106226] Updated weights for policy 0, policy_version 1520711 (0.0009) [2023-12-28 06:11:28,972][106226] Updated weights for policy 0, policy_version 1520721 (0.0008) [2023-12-28 06:11:29,018][106225] Updated weights for policy 1, policy_version 1524445 (0.0008) [2023-12-28 06:11:29,078][106225] Updated weights for policy 1, policy_version 1524455 (0.0007) [2023-12-28 06:11:29,143][106225] Updated weights for policy 1, policy_version 1524465 (0.0009) [2023-12-28 06:11:29,614][106226] Updated weights for policy 0, policy_version 1520731 (0.0009) [2023-12-28 06:11:29,681][106226] Updated weights for policy 0, policy_version 1520741 (0.0006) [2023-12-28 06:11:29,744][106226] Updated weights for policy 0, policy_version 1520751 (0.0005) [2023-12-28 06:11:29,817][106225] Updated weights for policy 1, policy_version 1524475 (0.0009) [2023-12-28 06:11:29,883][106225] Updated weights for policy 1, policy_version 1524485 (0.0010) [2023-12-28 06:11:29,953][106225] Updated weights for policy 1, policy_version 1524495 (0.0006) [2023-12-28 06:11:30,404][106226] Updated weights for policy 0, policy_version 1520761 (0.0005) [2023-12-28 06:11:30,456][106226] Updated weights for policy 0, policy_version 1520771 (0.0009) [2023-12-28 06:11:30,502][106226] Updated weights for policy 0, policy_version 1520781 (0.0010) [2023-12-28 06:11:30,548][106226] Updated weights for policy 0, policy_version 1520791 (0.0010) [2023-12-28 06:11:30,578][106225] Updated weights for policy 1, policy_version 1524505 (0.0009) [2023-12-28 06:11:30,631][106225] Updated weights for policy 1, policy_version 1524515 (0.0010) [2023-12-28 06:11:30,684][106225] Updated weights for policy 1, policy_version 1524525 (0.0010) [2023-12-28 06:11:30,737][106225] Updated weights for policy 1, policy_version 1524535 (0.0009) [2023-12-28 06:11:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 779730944. Throughput: 0: 10029.0, 1: 9882.2. Samples: 779721940. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:31,175][105115] Avg episode reward: [(0, '-4.733'), (1, '-4.590')] [2023-12-28 06:11:31,286][106226] Updated weights for policy 0, policy_version 1520801 (0.0007) [2023-12-28 06:11:31,348][106226] Updated weights for policy 0, policy_version 1520811 (0.0010) [2023-12-28 06:11:31,351][106225] Updated weights for policy 1, policy_version 1524545 (0.0011) [2023-12-28 06:11:31,416][106225] Updated weights for policy 1, policy_version 1524555 (0.0010) [2023-12-28 06:11:31,425][106226] Updated weights for policy 0, policy_version 1520821 (0.0010) [2023-12-28 06:11:31,478][106225] Updated weights for policy 1, policy_version 1524565 (0.0010) [2023-12-28 06:11:32,160][106226] Updated weights for policy 0, policy_version 1520831 (0.0007) [2023-12-28 06:11:32,175][106225] Updated weights for policy 1, policy_version 1524575 (0.0009) [2023-12-28 06:11:32,218][106226] Updated weights for policy 0, policy_version 1520841 (0.0006) [2023-12-28 06:11:32,230][106225] Updated weights for policy 1, policy_version 1524585 (0.0010) [2023-12-28 06:11:32,278][106226] Updated weights for policy 0, policy_version 1520851 (0.0007) [2023-12-28 06:11:32,288][106225] Updated weights for policy 1, policy_version 1524595 (0.0010) [2023-12-28 06:11:32,876][106226] Updated weights for policy 0, policy_version 1520861 (0.0007) [2023-12-28 06:11:32,940][106226] Updated weights for policy 0, policy_version 1520871 (0.0008) [2023-12-28 06:11:32,996][106226] Updated weights for policy 0, policy_version 1520881 (0.0008) [2023-12-28 06:11:33,025][106225] Updated weights for policy 1, policy_version 1524605 (0.0010) [2023-12-28 06:11:33,081][106225] Updated weights for policy 1, policy_version 1524615 (0.0010) [2023-12-28 06:11:33,143][106225] Updated weights for policy 1, policy_version 1524625 (0.0010) [2023-12-28 06:11:33,709][106226] Updated weights for policy 0, policy_version 1520891 (0.0007) [2023-12-28 06:11:33,766][106226] Updated weights for policy 0, policy_version 1520901 (0.0008) [2023-12-28 06:11:33,812][106226] Updated weights for policy 0, policy_version 1520911 (0.0007) [2023-12-28 06:11:33,848][106225] Updated weights for policy 1, policy_version 1524635 (0.0010) [2023-12-28 06:11:33,901][106225] Updated weights for policy 1, policy_version 1524645 (0.0010) [2023-12-28 06:11:33,960][106225] Updated weights for policy 1, policy_version 1524655 (0.0010) [2023-12-28 06:11:34,559][106226] Updated weights for policy 0, policy_version 1520921 (0.0008) [2023-12-28 06:11:34,627][106226] Updated weights for policy 0, policy_version 1520931 (0.0008) [2023-12-28 06:11:34,691][106226] Updated weights for policy 0, policy_version 1520941 (0.0007) [2023-12-28 06:11:34,702][106225] Updated weights for policy 1, policy_version 1524665 (0.0010) [2023-12-28 06:11:34,744][106226] Updated weights for policy 0, policy_version 1520951 (0.0007) [2023-12-28 06:11:34,763][106225] Updated weights for policy 1, policy_version 1524675 (0.0010) [2023-12-28 06:11:34,823][106225] Updated weights for policy 1, policy_version 1524685 (0.0010) [2023-12-28 06:11:34,876][106225] Updated weights for policy 1, policy_version 1524695 (0.0010) [2023-12-28 06:11:35,450][106226] Updated weights for policy 0, policy_version 1520961 (0.0006) [2023-12-28 06:11:35,473][106225] Updated weights for policy 1, policy_version 1524705 (0.0007) [2023-12-28 06:11:35,518][106226] Updated weights for policy 0, policy_version 1520971 (0.0005) [2023-12-28 06:11:35,531][106225] Updated weights for policy 1, policy_version 1524715 (0.0006) [2023-12-28 06:11:35,576][106226] Updated weights for policy 0, policy_version 1520981 (0.0007) [2023-12-28 06:11:35,587][106225] Updated weights for policy 1, policy_version 1524725 (0.0006) [2023-12-28 06:11:36,152][106225] Updated weights for policy 1, policy_version 1524735 (0.0007) [2023-12-28 06:11:36,162][106226] Updated weights for policy 0, policy_version 1520991 (0.0006) [2023-12-28 06:11:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 779829248. Throughput: 0: 10062.2, 1: 9908.6. Samples: 779843272. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:36,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.753')] [2023-12-28 06:11:36,212][106225] Updated weights for policy 1, policy_version 1524745 (0.0007) [2023-12-28 06:11:36,227][106226] Updated weights for policy 0, policy_version 1521001 (0.0006) [2023-12-28 06:11:36,269][106225] Updated weights for policy 1, policy_version 1524755 (0.0006) [2023-12-28 06:11:36,293][106226] Updated weights for policy 0, policy_version 1521011 (0.0007) [2023-12-28 06:11:36,906][106226] Updated weights for policy 0, policy_version 1521021 (0.0007) [2023-12-28 06:11:36,963][106226] Updated weights for policy 0, policy_version 1521031 (0.0005) [2023-12-28 06:11:37,025][106226] Updated weights for policy 0, policy_version 1521041 (0.0007) [2023-12-28 06:11:37,033][106225] Updated weights for policy 1, policy_version 1524765 (0.0007) [2023-12-28 06:11:37,084][106225] Updated weights for policy 1, policy_version 1524775 (0.0006) [2023-12-28 06:11:37,141][106225] Updated weights for policy 1, policy_version 1524785 (0.0009) [2023-12-28 06:11:37,695][106226] Updated weights for policy 0, policy_version 1521051 (0.0007) [2023-12-28 06:11:37,764][106226] Updated weights for policy 0, policy_version 1521061 (0.0006) [2023-12-28 06:11:37,820][106225] Updated weights for policy 1, policy_version 1524795 (0.0007) [2023-12-28 06:11:37,822][106226] Updated weights for policy 0, policy_version 1521071 (0.0006) [2023-12-28 06:11:37,881][106225] Updated weights for policy 1, policy_version 1524805 (0.0010) [2023-12-28 06:11:37,939][106225] Updated weights for policy 1, policy_version 1524815 (0.0010) [2023-12-28 06:11:38,520][106226] Updated weights for policy 0, policy_version 1521081 (0.0007) [2023-12-28 06:11:38,581][106226] Updated weights for policy 0, policy_version 1521091 (0.0008) [2023-12-28 06:11:38,643][106226] Updated weights for policy 0, policy_version 1521101 (0.0008) [2023-12-28 06:11:38,681][106225] Updated weights for policy 1, policy_version 1524825 (0.0011) [2023-12-28 06:11:38,703][106226] Updated weights for policy 0, policy_version 1521111 (0.0007) [2023-12-28 06:11:38,739][106225] Updated weights for policy 1, policy_version 1524835 (0.0010) [2023-12-28 06:11:38,803][106225] Updated weights for policy 1, policy_version 1524845 (0.0010) [2023-12-28 06:11:38,868][106225] Updated weights for policy 1, policy_version 1524855 (0.0010) [2023-12-28 06:11:39,471][106226] Updated weights for policy 0, policy_version 1521121 (0.0008) [2023-12-28 06:11:39,535][106226] Updated weights for policy 0, policy_version 1521131 (0.0008) [2023-12-28 06:11:39,600][106226] Updated weights for policy 0, policy_version 1521141 (0.0007) [2023-12-28 06:11:39,605][106225] Updated weights for policy 1, policy_version 1524865 (0.0007) [2023-12-28 06:11:39,653][106225] Updated weights for policy 1, policy_version 1524875 (0.0008) [2023-12-28 06:11:39,700][106225] Updated weights for policy 1, policy_version 1524885 (0.0008) [2023-12-28 06:11:40,235][106226] Updated weights for policy 0, policy_version 1521151 (0.0008) [2023-12-28 06:11:40,307][106226] Updated weights for policy 0, policy_version 1521161 (0.0008) [2023-12-28 06:11:40,362][106226] Updated weights for policy 0, policy_version 1521171 (0.0007) [2023-12-28 06:11:40,507][106225] Updated weights for policy 1, policy_version 1524895 (0.0009) [2023-12-28 06:11:40,567][106225] Updated weights for policy 1, policy_version 1524905 (0.0009) [2023-12-28 06:11:40,627][106225] Updated weights for policy 1, policy_version 1524915 (0.0009) [2023-12-28 06:11:40,991][106226] Updated weights for policy 0, policy_version 1521181 (0.0007) [2023-12-28 06:11:41,061][106226] Updated weights for policy 0, policy_version 1521191 (0.0007) [2023-12-28 06:11:41,124][106226] Updated weights for policy 0, policy_version 1521201 (0.0008) [2023-12-28 06:11:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 779927552. Throughput: 0: 10113.2, 1: 9898.3. Samples: 779903520. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:41,175][105115] Avg episode reward: [(0, '-4.830'), (1, '-4.576')] [2023-12-28 06:11:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001524920_390430720.pth... [2023-12-28 06:11:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001521208_389505024.pth... [2023-12-28 06:11:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001523768_390135808.pth [2023-12-28 06:11:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001520024_389201920.pth [2023-12-28 06:11:41,330][106225] Updated weights for policy 1, policy_version 1524925 (0.0008) [2023-12-28 06:11:41,403][106225] Updated weights for policy 1, policy_version 1524935 (0.0008) [2023-12-28 06:11:41,465][106225] Updated weights for policy 1, policy_version 1524945 (0.0009) [2023-12-28 06:11:41,876][106226] Updated weights for policy 0, policy_version 1521211 (0.0007) [2023-12-28 06:11:41,940][106226] Updated weights for policy 0, policy_version 1521221 (0.0008) [2023-12-28 06:11:41,996][106226] Updated weights for policy 0, policy_version 1521231 (0.0010) [2023-12-28 06:11:42,271][106225] Updated weights for policy 1, policy_version 1524955 (0.0010) [2023-12-28 06:11:42,340][106225] Updated weights for policy 1, policy_version 1524965 (0.0009) [2023-12-28 06:11:42,407][106225] Updated weights for policy 1, policy_version 1524975 (0.0009) [2023-12-28 06:11:42,589][106226] Updated weights for policy 0, policy_version 1521241 (0.0008) [2023-12-28 06:11:42,647][106226] Updated weights for policy 0, policy_version 1521251 (0.0007) [2023-12-28 06:11:42,709][106226] Updated weights for policy 0, policy_version 1521261 (0.0009) [2023-12-28 06:11:42,768][106226] Updated weights for policy 0, policy_version 1521271 (0.0009) [2023-12-28 06:11:43,219][106225] Updated weights for policy 1, policy_version 1524985 (0.0010) [2023-12-28 06:11:43,276][106225] Updated weights for policy 1, policy_version 1524995 (0.0010) [2023-12-28 06:11:43,323][106225] Updated weights for policy 1, policy_version 1525005 (0.0010) [2023-12-28 06:11:43,351][106226] Updated weights for policy 0, policy_version 1521281 (0.0009) [2023-12-28 06:11:43,380][106225] Updated weights for policy 1, policy_version 1525015 (0.0010) [2023-12-28 06:11:43,406][106226] Updated weights for policy 0, policy_version 1521291 (0.0009) [2023-12-28 06:11:43,455][106226] Updated weights for policy 0, policy_version 1521301 (0.0010) [2023-12-28 06:11:43,962][106225] Updated weights for policy 1, policy_version 1525025 (0.0006) [2023-12-28 06:11:44,028][106225] Updated weights for policy 1, policy_version 1525035 (0.0005) [2023-12-28 06:11:44,087][106225] Updated weights for policy 1, policy_version 1525045 (0.0005) [2023-12-28 06:11:44,182][106226] Updated weights for policy 0, policy_version 1521311 (0.0010) [2023-12-28 06:11:44,248][106226] Updated weights for policy 0, policy_version 1521321 (0.0010) [2023-12-28 06:11:44,303][106226] Updated weights for policy 0, policy_version 1521331 (0.0010) [2023-12-28 06:11:44,669][106225] Updated weights for policy 1, policy_version 1525055 (0.0008) [2023-12-28 06:11:44,738][106225] Updated weights for policy 1, policy_version 1525065 (0.0011) [2023-12-28 06:11:44,813][106225] Updated weights for policy 1, policy_version 1525075 (0.0010) [2023-12-28 06:11:44,915][106226] Updated weights for policy 0, policy_version 1521341 (0.0009) [2023-12-28 06:11:44,980][106226] Updated weights for policy 0, policy_version 1521351 (0.0011) [2023-12-28 06:11:45,043][106226] Updated weights for policy 0, policy_version 1521361 (0.0009) [2023-12-28 06:11:45,521][106225] Updated weights for policy 1, policy_version 1525085 (0.0009) [2023-12-28 06:11:45,570][106225] Updated weights for policy 1, policy_version 1525095 (0.0010) [2023-12-28 06:11:45,630][106225] Updated weights for policy 1, policy_version 1525105 (0.0010) [2023-12-28 06:11:45,769][106226] Updated weights for policy 0, policy_version 1521371 (0.0010) [2023-12-28 06:11:45,819][106226] Updated weights for policy 0, policy_version 1521381 (0.0010) [2023-12-28 06:11:45,866][106226] Updated weights for policy 0, policy_version 1521391 (0.0010) [2023-12-28 06:11:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 780034048. Throughput: 0: 10165.7, 1: 9829.7. Samples: 780023220. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:46,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-4.641')] [2023-12-28 06:11:46,192][106225] Updated weights for policy 1, policy_version 1525115 (0.0009) [2023-12-28 06:11:46,251][106225] Updated weights for policy 1, policy_version 1525125 (0.0005) [2023-12-28 06:11:46,303][106225] Updated weights for policy 1, policy_version 1525135 (0.0005) [2023-12-28 06:11:46,498][106226] Updated weights for policy 0, policy_version 1521401 (0.0010) [2023-12-28 06:11:46,547][106226] Updated weights for policy 0, policy_version 1521411 (0.0008) [2023-12-28 06:11:46,595][106226] Updated weights for policy 0, policy_version 1521421 (0.0005) [2023-12-28 06:11:46,655][106226] Updated weights for policy 0, policy_version 1521431 (0.0005) [2023-12-28 06:11:46,901][106225] Updated weights for policy 1, policy_version 1525145 (0.0005) [2023-12-28 06:11:46,948][106225] Updated weights for policy 1, policy_version 1525155 (0.0005) [2023-12-28 06:11:47,006][106225] Updated weights for policy 1, policy_version 1525165 (0.0005) [2023-12-28 06:11:47,053][106225] Updated weights for policy 1, policy_version 1525175 (0.0005) [2023-12-28 06:11:47,315][106226] Updated weights for policy 0, policy_version 1521441 (0.0005) [2023-12-28 06:11:47,377][106226] Updated weights for policy 0, policy_version 1521451 (0.0005) [2023-12-28 06:11:47,435][106226] Updated weights for policy 0, policy_version 1521461 (0.0005) [2023-12-28 06:11:47,695][106225] Updated weights for policy 1, policy_version 1525185 (0.0010) [2023-12-28 06:11:47,749][106225] Updated weights for policy 1, policy_version 1525195 (0.0010) [2023-12-28 06:11:47,810][106225] Updated weights for policy 1, policy_version 1525205 (0.0010) [2023-12-28 06:11:48,050][106226] Updated weights for policy 0, policy_version 1521471 (0.0007) [2023-12-28 06:11:48,104][106226] Updated weights for policy 0, policy_version 1521481 (0.0008) [2023-12-28 06:11:48,164][106226] Updated weights for policy 0, policy_version 1521491 (0.0008) [2023-12-28 06:11:48,525][106225] Updated weights for policy 1, policy_version 1525215 (0.0010) [2023-12-28 06:11:48,582][106225] Updated weights for policy 1, policy_version 1525225 (0.0010) [2023-12-28 06:11:48,644][106225] Updated weights for policy 1, policy_version 1525235 (0.0010) [2023-12-28 06:11:48,840][106226] Updated weights for policy 0, policy_version 1521501 (0.0008) [2023-12-28 06:11:48,902][106226] Updated weights for policy 0, policy_version 1521511 (0.0009) [2023-12-28 06:11:48,952][106226] Updated weights for policy 0, policy_version 1521521 (0.0007) [2023-12-28 06:11:49,376][106225] Updated weights for policy 1, policy_version 1525245 (0.0009) [2023-12-28 06:11:49,440][106225] Updated weights for policy 1, policy_version 1525255 (0.0010) [2023-12-28 06:11:49,498][106225] Updated weights for policy 1, policy_version 1525265 (0.0010) [2023-12-28 06:11:49,679][106226] Updated weights for policy 0, policy_version 1521531 (0.0007) [2023-12-28 06:11:49,744][106226] Updated weights for policy 0, policy_version 1521541 (0.0008) [2023-12-28 06:11:49,810][106226] Updated weights for policy 0, policy_version 1521551 (0.0007) [2023-12-28 06:11:50,269][106225] Updated weights for policy 1, policy_version 1525275 (0.0010) [2023-12-28 06:11:50,332][106225] Updated weights for policy 1, policy_version 1525285 (0.0009) [2023-12-28 06:11:50,421][106225] Updated weights for policy 1, policy_version 1525295 (0.0008) [2023-12-28 06:11:50,516][106226] Updated weights for policy 0, policy_version 1521561 (0.0009) [2023-12-28 06:11:50,578][106226] Updated weights for policy 0, policy_version 1521571 (0.0008) [2023-12-28 06:11:50,643][106226] Updated weights for policy 0, policy_version 1521581 (0.0009) [2023-12-28 06:11:50,703][106226] Updated weights for policy 0, policy_version 1521591 (0.0008) [2023-12-28 06:11:51,070][106225] Updated weights for policy 1, policy_version 1525305 (0.0008) [2023-12-28 06:11:51,134][106225] Updated weights for policy 1, policy_version 1525315 (0.0008) [2023-12-28 06:11:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 780132352. Throughput: 0: 10082.1, 1: 9892.3. Samples: 780144236. Policy #0 lag: (min: 16.0, avg: 45.4, max: 48.0) [2023-12-28 06:11:51,175][105115] Avg episode reward: [(0, '-4.680'), (1, '-4.624')] [2023-12-28 06:11:51,202][106225] Updated weights for policy 1, policy_version 1525325 (0.0008) [2023-12-28 06:11:51,271][106225] Updated weights for policy 1, policy_version 1525335 (0.0008) [2023-12-28 06:11:51,555][106226] Updated weights for policy 0, policy_version 1521601 (0.0009) [2023-12-28 06:11:51,616][106226] Updated weights for policy 0, policy_version 1521611 (0.0008) [2023-12-28 06:11:51,688][106226] Updated weights for policy 0, policy_version 1521621 (0.0008) [2023-12-28 06:11:52,023][106225] Updated weights for policy 1, policy_version 1525345 (0.0006) [2023-12-28 06:11:52,083][106225] Updated weights for policy 1, policy_version 1525355 (0.0007) [2023-12-28 06:11:52,142][106225] Updated weights for policy 1, policy_version 1525365 (0.0006) [2023-12-28 06:11:52,463][106226] Updated weights for policy 0, policy_version 1521631 (0.0008) [2023-12-28 06:11:52,522][106226] Updated weights for policy 0, policy_version 1521641 (0.0008) [2023-12-28 06:11:52,578][106226] Updated weights for policy 0, policy_version 1521651 (0.0008) [2023-12-28 06:11:52,793][106225] Updated weights for policy 1, policy_version 1525375 (0.0009) [2023-12-28 06:11:52,853][106225] Updated weights for policy 1, policy_version 1525385 (0.0011) [2023-12-28 06:11:52,900][106225] Updated weights for policy 1, policy_version 1525395 (0.0007) [2023-12-28 06:11:53,161][106226] Updated weights for policy 0, policy_version 1521661 (0.0007) [2023-12-28 06:11:53,218][106226] Updated weights for policy 0, policy_version 1521671 (0.0007) [2023-12-28 06:11:53,270][106226] Updated weights for policy 0, policy_version 1521681 (0.0010) [2023-12-28 06:11:53,569][106225] Updated weights for policy 1, policy_version 1525405 (0.0008) [2023-12-28 06:11:53,627][106225] Updated weights for policy 1, policy_version 1525415 (0.0008) [2023-12-28 06:11:53,688][106225] Updated weights for policy 1, policy_version 1525425 (0.0010) [2023-12-28 06:11:53,876][106226] Updated weights for policy 0, policy_version 1521691 (0.0010) [2023-12-28 06:11:53,941][106226] Updated weights for policy 0, policy_version 1521701 (0.0009) [2023-12-28 06:11:54,012][106226] Updated weights for policy 0, policy_version 1521711 (0.0009) [2023-12-28 06:11:54,358][106225] Updated weights for policy 1, policy_version 1525435 (0.0010) [2023-12-28 06:11:54,411][106225] Updated weights for policy 1, policy_version 1525445 (0.0007) [2023-12-28 06:11:54,464][106225] Updated weights for policy 1, policy_version 1525455 (0.0008) [2023-12-28 06:11:54,623][106226] Updated weights for policy 0, policy_version 1521721 (0.0010) [2023-12-28 06:11:54,680][106226] Updated weights for policy 0, policy_version 1521731 (0.0010) [2023-12-28 06:11:54,729][106226] Updated weights for policy 0, policy_version 1521741 (0.0008) [2023-12-28 06:11:54,781][106226] Updated weights for policy 0, policy_version 1521751 (0.0010) [2023-12-28 06:11:55,211][106225] Updated weights for policy 1, policy_version 1525465 (0.0009) [2023-12-28 06:11:55,272][106225] Updated weights for policy 1, policy_version 1525475 (0.0008) [2023-12-28 06:11:55,332][106225] Updated weights for policy 1, policy_version 1525485 (0.0007) [2023-12-28 06:11:55,390][106225] Updated weights for policy 1, policy_version 1525495 (0.0008) [2023-12-28 06:11:55,487][106226] Updated weights for policy 0, policy_version 1521761 (0.0010) [2023-12-28 06:11:55,545][106226] Updated weights for policy 0, policy_version 1521771 (0.0010) [2023-12-28 06:11:55,591][106226] Updated weights for policy 0, policy_version 1521781 (0.0010) [2023-12-28 06:11:56,100][106225] Updated weights for policy 1, policy_version 1525505 (0.0006) [2023-12-28 06:11:56,155][106225] Updated weights for policy 1, policy_version 1525515 (0.0007) [2023-12-28 06:11:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 780230656. Throughput: 0: 10103.8, 1: 9894.6. Samples: 780204548. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:11:56,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.720')] [2023-12-28 06:11:56,214][106225] Updated weights for policy 1, policy_version 1525525 (0.0005) [2023-12-28 06:11:56,221][106226] Updated weights for policy 0, policy_version 1521791 (0.0010) [2023-12-28 06:11:56,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001525528_390586368.pth... [2023-12-28 06:11:56,233][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001524344_390283264.pth [2023-12-28 06:11:56,284][106226] Updated weights for policy 0, policy_version 1521801 (0.0010) [2023-12-28 06:11:56,342][106226] Updated weights for policy 0, policy_version 1521811 (0.0010) [2023-12-28 06:11:56,372][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001521816_389660672.pth... [2023-12-28 06:11:56,377][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001520600_389349376.pth [2023-12-28 06:11:56,823][106225] Updated weights for policy 1, policy_version 1525535 (0.0009) [2023-12-28 06:11:56,885][106225] Updated weights for policy 1, policy_version 1525545 (0.0009) [2023-12-28 06:11:56,947][106225] Updated weights for policy 1, policy_version 1525555 (0.0005) [2023-12-28 06:11:57,066][106226] Updated weights for policy 0, policy_version 1521821 (0.0010) [2023-12-28 06:11:57,122][106226] Updated weights for policy 0, policy_version 1521831 (0.0010) [2023-12-28 06:11:57,176][106226] Updated weights for policy 0, policy_version 1521841 (0.0011) [2023-12-28 06:11:57,506][106225] Updated weights for policy 1, policy_version 1525565 (0.0006) [2023-12-28 06:11:57,560][106225] Updated weights for policy 1, policy_version 1525575 (0.0006) [2023-12-28 06:11:57,621][106225] Updated weights for policy 1, policy_version 1525585 (0.0010) [2023-12-28 06:11:57,867][106226] Updated weights for policy 0, policy_version 1521851 (0.0011) [2023-12-28 06:11:57,916][106226] Updated weights for policy 0, policy_version 1521861 (0.0010) [2023-12-28 06:11:57,971][106226] Updated weights for policy 0, policy_version 1521871 (0.0010) [2023-12-28 06:11:58,199][106225] Updated weights for policy 1, policy_version 1525595 (0.0009) [2023-12-28 06:11:58,261][106225] Updated weights for policy 1, policy_version 1525605 (0.0009) [2023-12-28 06:11:58,325][106225] Updated weights for policy 1, policy_version 1525615 (0.0010) [2023-12-28 06:11:58,714][106226] Updated weights for policy 0, policy_version 1521881 (0.0011) [2023-12-28 06:11:58,778][106226] Updated weights for policy 0, policy_version 1521891 (0.0012) [2023-12-28 06:11:58,838][106226] Updated weights for policy 0, policy_version 1521901 (0.0009) [2023-12-28 06:11:58,903][106226] Updated weights for policy 0, policy_version 1521911 (0.0009) [2023-12-28 06:11:59,097][106225] Updated weights for policy 1, policy_version 1525625 (0.0010) [2023-12-28 06:11:59,154][106225] Updated weights for policy 1, policy_version 1525635 (0.0009) [2023-12-28 06:11:59,210][106225] Updated weights for policy 1, policy_version 1525645 (0.0009) [2023-12-28 06:11:59,277][106225] Updated weights for policy 1, policy_version 1525655 (0.0009) [2023-12-28 06:11:59,784][106226] Updated weights for policy 0, policy_version 1521921 (0.0008) [2023-12-28 06:11:59,852][106226] Updated weights for policy 0, policy_version 1521931 (0.0009) [2023-12-28 06:11:59,902][106226] Updated weights for policy 0, policy_version 1521941 (0.0007) [2023-12-28 06:12:00,138][106225] Updated weights for policy 1, policy_version 1525665 (0.0008) [2023-12-28 06:12:00,196][106225] Updated weights for policy 1, policy_version 1525675 (0.0008) [2023-12-28 06:12:00,258][106225] Updated weights for policy 1, policy_version 1525685 (0.0008) [2023-12-28 06:12:00,587][106226] Updated weights for policy 0, policy_version 1521951 (0.0009) [2023-12-28 06:12:00,641][106226] Updated weights for policy 0, policy_version 1521961 (0.0005) [2023-12-28 06:12:00,697][106226] Updated weights for policy 0, policy_version 1521971 (0.0007) [2023-12-28 06:12:00,930][106225] Updated weights for policy 1, policy_version 1525695 (0.0006) [2023-12-28 06:12:00,982][106225] Updated weights for policy 1, policy_version 1525705 (0.0007) [2023-12-28 06:12:01,042][106225] Updated weights for policy 1, policy_version 1525715 (0.0009) [2023-12-28 06:12:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 780337152. Throughput: 0: 10064.3, 1: 9966.7. Samples: 780323352. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:01,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.910')] [2023-12-28 06:12:01,357][106226] Updated weights for policy 0, policy_version 1521981 (0.0008) [2023-12-28 06:12:01,427][106226] Updated weights for policy 0, policy_version 1521991 (0.0009) [2023-12-28 06:12:01,482][106226] Updated weights for policy 0, policy_version 1522001 (0.0008) [2023-12-28 06:12:01,824][106225] Updated weights for policy 1, policy_version 1525725 (0.0006) [2023-12-28 06:12:01,875][106225] Updated weights for policy 1, policy_version 1525735 (0.0005) [2023-12-28 06:12:01,932][106225] Updated weights for policy 1, policy_version 1525745 (0.0005) [2023-12-28 06:12:02,142][106226] Updated weights for policy 0, policy_version 1522011 (0.0008) [2023-12-28 06:12:02,214][106226] Updated weights for policy 0, policy_version 1522021 (0.0005) [2023-12-28 06:12:02,281][106226] Updated weights for policy 0, policy_version 1522031 (0.0007) [2023-12-28 06:12:02,518][106225] Updated weights for policy 1, policy_version 1525755 (0.0005) [2023-12-28 06:12:02,583][106225] Updated weights for policy 1, policy_version 1525765 (0.0007) [2023-12-28 06:12:02,644][106225] Updated weights for policy 1, policy_version 1525775 (0.0008) [2023-12-28 06:12:02,884][106226] Updated weights for policy 0, policy_version 1522041 (0.0008) [2023-12-28 06:12:02,934][106226] Updated weights for policy 0, policy_version 1522051 (0.0009) [2023-12-28 06:12:02,983][106226] Updated weights for policy 0, policy_version 1522061 (0.0009) [2023-12-28 06:12:03,032][106226] Updated weights for policy 0, policy_version 1522071 (0.0008) [2023-12-28 06:12:03,361][106225] Updated weights for policy 1, policy_version 1525785 (0.0009) [2023-12-28 06:12:03,414][106225] Updated weights for policy 1, policy_version 1525795 (0.0008) [2023-12-28 06:12:03,471][106225] Updated weights for policy 1, policy_version 1525805 (0.0008) [2023-12-28 06:12:03,522][106225] Updated weights for policy 1, policy_version 1525815 (0.0008) [2023-12-28 06:12:03,745][106226] Updated weights for policy 0, policy_version 1522081 (0.0008) [2023-12-28 06:12:03,791][106226] Updated weights for policy 0, policy_version 1522091 (0.0008) [2023-12-28 06:12:03,847][106226] Updated weights for policy 0, policy_version 1522101 (0.0008) [2023-12-28 06:12:04,242][106225] Updated weights for policy 1, policy_version 1525825 (0.0008) [2023-12-28 06:12:04,294][106225] Updated weights for policy 1, policy_version 1525835 (0.0009) [2023-12-28 06:12:04,354][106225] Updated weights for policy 1, policy_version 1525845 (0.0008) [2023-12-28 06:12:04,619][106226] Updated weights for policy 0, policy_version 1522111 (0.0008) [2023-12-28 06:12:04,675][106226] Updated weights for policy 0, policy_version 1522121 (0.0008) [2023-12-28 06:12:04,728][106226] Updated weights for policy 0, policy_version 1522131 (0.0008) [2023-12-28 06:12:05,061][106225] Updated weights for policy 1, policy_version 1525855 (0.0007) [2023-12-28 06:12:05,116][106225] Updated weights for policy 1, policy_version 1525865 (0.0006) [2023-12-28 06:12:05,180][106225] Updated weights for policy 1, policy_version 1525875 (0.0008) [2023-12-28 06:12:05,484][106226] Updated weights for policy 0, policy_version 1522141 (0.0009) [2023-12-28 06:12:05,540][106226] Updated weights for policy 0, policy_version 1522151 (0.0008) [2023-12-28 06:12:05,594][106226] Updated weights for policy 0, policy_version 1522161 (0.0009) [2023-12-28 06:12:05,772][106225] Updated weights for policy 1, policy_version 1525885 (0.0006) [2023-12-28 06:12:05,830][106225] Updated weights for policy 1, policy_version 1525895 (0.0005) [2023-12-28 06:12:05,879][106225] Updated weights for policy 1, policy_version 1525905 (0.0006) [2023-12-28 06:12:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 780435456. Throughput: 0: 10093.9, 1: 9977.5. Samples: 780443644. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:06,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.637')] [2023-12-28 06:12:06,390][106226] Updated weights for policy 0, policy_version 1522171 (0.0009) [2023-12-28 06:12:06,451][106226] Updated weights for policy 0, policy_version 1522181 (0.0009) [2023-12-28 06:12:06,512][106226] Updated weights for policy 0, policy_version 1522191 (0.0008) [2023-12-28 06:12:06,554][106225] Updated weights for policy 1, policy_version 1525915 (0.0008) [2023-12-28 06:12:06,616][106225] Updated weights for policy 1, policy_version 1525925 (0.0008) [2023-12-28 06:12:06,681][106225] Updated weights for policy 1, policy_version 1525935 (0.0009) [2023-12-28 06:12:07,237][106226] Updated weights for policy 0, policy_version 1522201 (0.0008) [2023-12-28 06:12:07,302][106226] Updated weights for policy 0, policy_version 1522211 (0.0008) [2023-12-28 06:12:07,365][106226] Updated weights for policy 0, policy_version 1522221 (0.0009) [2023-12-28 06:12:07,416][106225] Updated weights for policy 1, policy_version 1525945 (0.0008) [2023-12-28 06:12:07,422][106226] Updated weights for policy 0, policy_version 1522231 (0.0008) [2023-12-28 06:12:07,464][106225] Updated weights for policy 1, policy_version 1525955 (0.0008) [2023-12-28 06:12:07,521][106225] Updated weights for policy 1, policy_version 1525965 (0.0008) [2023-12-28 06:12:07,581][106225] Updated weights for policy 1, policy_version 1525976 (0.0009) [2023-12-28 06:12:08,140][106226] Updated weights for policy 0, policy_version 1522241 (0.0008) [2023-12-28 06:12:08,201][106226] Updated weights for policy 0, policy_version 1522251 (0.0008) [2023-12-28 06:12:08,248][106225] Updated weights for policy 1, policy_version 1525986 (0.0006) [2023-12-28 06:12:08,258][106226] Updated weights for policy 0, policy_version 1522261 (0.0007) [2023-12-28 06:12:08,305][106225] Updated weights for policy 1, policy_version 1525996 (0.0006) [2023-12-28 06:12:08,368][106225] Updated weights for policy 1, policy_version 1526006 (0.0007) [2023-12-28 06:12:09,015][106226] Updated weights for policy 0, policy_version 1522271 (0.0007) [2023-12-28 06:12:09,074][106226] Updated weights for policy 0, policy_version 1522281 (0.0006) [2023-12-28 06:12:09,086][106225] Updated weights for policy 1, policy_version 1526016 (0.0007) [2023-12-28 06:12:09,139][106226] Updated weights for policy 0, policy_version 1522291 (0.0006) [2023-12-28 06:12:09,154][106225] Updated weights for policy 1, policy_version 1526026 (0.0007) [2023-12-28 06:12:09,217][106225] Updated weights for policy 1, policy_version 1526036 (0.0007) [2023-12-28 06:12:09,798][106226] Updated weights for policy 0, policy_version 1522301 (0.0008) [2023-12-28 06:12:09,862][106226] Updated weights for policy 0, policy_version 1522311 (0.0008) [2023-12-28 06:12:09,927][106226] Updated weights for policy 0, policy_version 1522321 (0.0009) [2023-12-28 06:12:09,973][106225] Updated weights for policy 1, policy_version 1526046 (0.0007) [2023-12-28 06:12:10,027][106225] Updated weights for policy 1, policy_version 1526056 (0.0008) [2023-12-28 06:12:10,080][106225] Updated weights for policy 1, policy_version 1526066 (0.0008) [2023-12-28 06:12:10,645][106226] Updated weights for policy 0, policy_version 1522331 (0.0008) [2023-12-28 06:12:10,695][106226] Updated weights for policy 0, policy_version 1522341 (0.0010) [2023-12-28 06:12:10,746][106226] Updated weights for policy 0, policy_version 1522351 (0.0010) [2023-12-28 06:12:10,833][106225] Updated weights for policy 1, policy_version 1526076 (0.0007) [2023-12-28 06:12:10,886][106225] Updated weights for policy 1, policy_version 1526086 (0.0005) [2023-12-28 06:12:10,940][106225] Updated weights for policy 1, policy_version 1526096 (0.0007) [2023-12-28 06:12:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 780533760. Throughput: 0: 10064.7, 1: 10062.9. Samples: 780502404. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:11,175][105115] Avg episode reward: [(0, '-4.777'), (1, '-4.856')] [2023-12-28 06:12:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001522360_389799936.pth... [2023-12-28 06:12:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001526104_390733824.pth... [2023-12-28 06:12:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001521208_389505024.pth [2023-12-28 06:12:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001524920_390430720.pth [2023-12-28 06:12:11,508][106226] Updated weights for policy 0, policy_version 1522361 (0.0010) [2023-12-28 06:12:11,576][106226] Updated weights for policy 0, policy_version 1522371 (0.0011) [2023-12-28 06:12:11,643][106226] Updated weights for policy 0, policy_version 1522381 (0.0009) [2023-12-28 06:12:11,680][106225] Updated weights for policy 1, policy_version 1526106 (0.0010) [2023-12-28 06:12:11,719][106226] Updated weights for policy 0, policy_version 1522391 (0.0009) [2023-12-28 06:12:11,748][106225] Updated weights for policy 1, policy_version 1526116 (0.0008) [2023-12-28 06:12:11,801][106225] Updated weights for policy 1, policy_version 1526126 (0.0008) [2023-12-28 06:12:11,850][106225] Updated weights for policy 1, policy_version 1526136 (0.0008) [2023-12-28 06:12:12,450][106226] Updated weights for policy 0, policy_version 1522401 (0.0008) [2023-12-28 06:12:12,508][106226] Updated weights for policy 0, policy_version 1522411 (0.0008) [2023-12-28 06:12:12,567][106226] Updated weights for policy 0, policy_version 1522421 (0.0008) [2023-12-28 06:12:12,595][106225] Updated weights for policy 1, policy_version 1526146 (0.0010) [2023-12-28 06:12:12,647][106225] Updated weights for policy 1, policy_version 1526156 (0.0010) [2023-12-28 06:12:12,696][106225] Updated weights for policy 1, policy_version 1526166 (0.0005) [2023-12-28 06:12:13,309][106226] Updated weights for policy 0, policy_version 1522431 (0.0009) [2023-12-28 06:12:13,363][106226] Updated weights for policy 0, policy_version 1522441 (0.0010) [2023-12-28 06:12:13,389][106225] Updated weights for policy 1, policy_version 1526176 (0.0006) [2023-12-28 06:12:13,413][106226] Updated weights for policy 0, policy_version 1522451 (0.0010) [2023-12-28 06:12:13,433][106225] Updated weights for policy 1, policy_version 1526186 (0.0005) [2023-12-28 06:12:13,497][106225] Updated weights for policy 1, policy_version 1526196 (0.0007) [2023-12-28 06:12:13,992][106226] Updated weights for policy 0, policy_version 1522461 (0.0010) [2023-12-28 06:12:14,058][106226] Updated weights for policy 0, policy_version 1522471 (0.0010) [2023-12-28 06:12:14,111][106226] Updated weights for policy 0, policy_version 1522481 (0.0010) [2023-12-28 06:12:14,133][106225] Updated weights for policy 1, policy_version 1526206 (0.0010) [2023-12-28 06:12:14,190][106225] Updated weights for policy 1, policy_version 1526216 (0.0010) [2023-12-28 06:12:14,251][106225] Updated weights for policy 1, policy_version 1526226 (0.0010) [2023-12-28 06:12:14,818][106226] Updated weights for policy 0, policy_version 1522491 (0.0010) [2023-12-28 06:12:14,882][106225] Updated weights for policy 1, policy_version 1526236 (0.0009) [2023-12-28 06:12:14,884][106226] Updated weights for policy 0, policy_version 1522501 (0.0011) [2023-12-28 06:12:14,942][106225] Updated weights for policy 1, policy_version 1526246 (0.0008) [2023-12-28 06:12:14,950][106226] Updated weights for policy 0, policy_version 1522511 (0.0011) [2023-12-28 06:12:15,003][106225] Updated weights for policy 1, policy_version 1526256 (0.0007) [2023-12-28 06:12:15,658][106226] Updated weights for policy 0, policy_version 1522521 (0.0011) [2023-12-28 06:12:15,724][106226] Updated weights for policy 0, policy_version 1522531 (0.0011) [2023-12-28 06:12:15,742][106225] Updated weights for policy 1, policy_version 1526266 (0.0008) [2023-12-28 06:12:15,783][106226] Updated weights for policy 0, policy_version 1522541 (0.0010) [2023-12-28 06:12:15,796][106225] Updated weights for policy 1, policy_version 1526276 (0.0008) [2023-12-28 06:12:15,839][106226] Updated weights for policy 0, policy_version 1522551 (0.0010) [2023-12-28 06:12:15,849][106225] Updated weights for policy 1, policy_version 1526286 (0.0006) [2023-12-28 06:12:15,912][106225] Updated weights for policy 1, policy_version 1526296 (0.0007) [2023-12-28 06:12:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 780632064. Throughput: 0: 9943.3, 1: 9988.2. Samples: 780618864. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:16,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.932')] [2023-12-28 06:12:16,481][106226] Updated weights for policy 0, policy_version 1522561 (0.0011) [2023-12-28 06:12:16,546][106226] Updated weights for policy 0, policy_version 1522571 (0.0011) [2023-12-28 06:12:16,609][106225] Updated weights for policy 1, policy_version 1526306 (0.0006) [2023-12-28 06:12:16,610][106226] Updated weights for policy 0, policy_version 1522581 (0.0011) [2023-12-28 06:12:16,654][106225] Updated weights for policy 1, policy_version 1526316 (0.0007) [2023-12-28 06:12:16,714][106225] Updated weights for policy 1, policy_version 1526326 (0.0007) [2023-12-28 06:12:17,267][106226] Updated weights for policy 0, policy_version 1522591 (0.0010) [2023-12-28 06:12:17,321][106226] Updated weights for policy 0, policy_version 1522601 (0.0010) [2023-12-28 06:12:17,380][106226] Updated weights for policy 0, policy_version 1522611 (0.0010) [2023-12-28 06:12:17,443][106225] Updated weights for policy 1, policy_version 1526336 (0.0008) [2023-12-28 06:12:17,504][106225] Updated weights for policy 1, policy_version 1526346 (0.0005) [2023-12-28 06:12:17,566][106225] Updated weights for policy 1, policy_version 1526356 (0.0006) [2023-12-28 06:12:18,093][106226] Updated weights for policy 0, policy_version 1522621 (0.0011) [2023-12-28 06:12:18,156][106226] Updated weights for policy 0, policy_version 1522631 (0.0010) [2023-12-28 06:12:18,214][106226] Updated weights for policy 0, policy_version 1522641 (0.0010) [2023-12-28 06:12:18,227][106225] Updated weights for policy 1, policy_version 1526366 (0.0005) [2023-12-28 06:12:18,283][106225] Updated weights for policy 1, policy_version 1526376 (0.0007) [2023-12-28 06:12:18,342][106225] Updated weights for policy 1, policy_version 1526386 (0.0006) [2023-12-28 06:12:18,918][106226] Updated weights for policy 0, policy_version 1522651 (0.0009) [2023-12-28 06:12:18,979][106226] Updated weights for policy 0, policy_version 1522661 (0.0005) [2023-12-28 06:12:19,020][106225] Updated weights for policy 1, policy_version 1526396 (0.0006) [2023-12-28 06:12:19,041][106226] Updated weights for policy 0, policy_version 1522671 (0.0010) [2023-12-28 06:12:19,075][106225] Updated weights for policy 1, policy_version 1526406 (0.0006) [2023-12-28 06:12:19,137][106225] Updated weights for policy 1, policy_version 1526416 (0.0009) [2023-12-28 06:12:19,730][106226] Updated weights for policy 0, policy_version 1522681 (0.0010) [2023-12-28 06:12:19,792][106226] Updated weights for policy 0, policy_version 1522691 (0.0011) [2023-12-28 06:12:19,817][106225] Updated weights for policy 1, policy_version 1526426 (0.0008) [2023-12-28 06:12:19,862][106226] Updated weights for policy 0, policy_version 1522701 (0.0008) [2023-12-28 06:12:19,882][106225] Updated weights for policy 1, policy_version 1526436 (0.0009) [2023-12-28 06:12:19,925][106226] Updated weights for policy 0, policy_version 1522711 (0.0006) [2023-12-28 06:12:19,942][106225] Updated weights for policy 1, policy_version 1526446 (0.0008) [2023-12-28 06:12:20,007][106225] Updated weights for policy 1, policy_version 1526456 (0.0009) [2023-12-28 06:12:20,662][106226] Updated weights for policy 0, policy_version 1522721 (0.0008) [2023-12-28 06:12:20,729][106226] Updated weights for policy 0, policy_version 1522731 (0.0008) [2023-12-28 06:12:20,735][106225] Updated weights for policy 1, policy_version 1526466 (0.0008) [2023-12-28 06:12:20,798][106225] Updated weights for policy 1, policy_version 1526476 (0.0008) [2023-12-28 06:12:20,799][106226] Updated weights for policy 0, policy_version 1522741 (0.0008) [2023-12-28 06:12:20,864][106225] Updated weights for policy 1, policy_version 1526486 (0.0008) [2023-12-28 06:12:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 780730368. Throughput: 0: 9929.2, 1: 9934.5. Samples: 780737140. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:21,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.685')] [2023-12-28 06:12:21,571][106226] Updated weights for policy 0, policy_version 1522751 (0.0007) [2023-12-28 06:12:21,647][106226] Updated weights for policy 0, policy_version 1522761 (0.0009) [2023-12-28 06:12:21,651][106225] Updated weights for policy 1, policy_version 1526496 (0.0008) [2023-12-28 06:12:21,724][106226] Updated weights for policy 0, policy_version 1522771 (0.0008) [2023-12-28 06:12:21,736][106225] Updated weights for policy 1, policy_version 1526506 (0.0008) [2023-12-28 06:12:21,805][106225] Updated weights for policy 1, policy_version 1526516 (0.0008) [2023-12-28 06:12:22,480][106226] Updated weights for policy 0, policy_version 1522781 (0.0008) [2023-12-28 06:12:22,540][106226] Updated weights for policy 0, policy_version 1522791 (0.0008) [2023-12-28 06:12:22,559][106225] Updated weights for policy 1, policy_version 1526526 (0.0009) [2023-12-28 06:12:22,603][106226] Updated weights for policy 0, policy_version 1522801 (0.0008) [2023-12-28 06:12:22,612][106225] Updated weights for policy 1, policy_version 1526536 (0.0009) [2023-12-28 06:12:22,670][106225] Updated weights for policy 1, policy_version 1526546 (0.0009) [2023-12-28 06:12:23,347][106226] Updated weights for policy 0, policy_version 1522811 (0.0008) [2023-12-28 06:12:23,405][106226] Updated weights for policy 0, policy_version 1522821 (0.0008) [2023-12-28 06:12:23,414][106225] Updated weights for policy 1, policy_version 1526556 (0.0009) [2023-12-28 06:12:23,461][106225] Updated weights for policy 1, policy_version 1526566 (0.0006) [2023-12-28 06:12:23,470][106226] Updated weights for policy 0, policy_version 1522831 (0.0008) [2023-12-28 06:12:23,510][106225] Updated weights for policy 1, policy_version 1526576 (0.0006) [2023-12-28 06:12:24,175][106226] Updated weights for policy 0, policy_version 1522841 (0.0007) [2023-12-28 06:12:24,232][106226] Updated weights for policy 0, policy_version 1522851 (0.0009) [2023-12-28 06:12:24,259][106225] Updated weights for policy 1, policy_version 1526586 (0.0008) [2023-12-28 06:12:24,294][106226] Updated weights for policy 0, policy_version 1522861 (0.0007) [2023-12-28 06:12:24,312][106225] Updated weights for policy 1, policy_version 1526596 (0.0006) [2023-12-28 06:12:24,355][106226] Updated weights for policy 0, policy_version 1522871 (0.0009) [2023-12-28 06:12:24,365][106225] Updated weights for policy 1, policy_version 1526606 (0.0006) [2023-12-28 06:12:24,415][106225] Updated weights for policy 1, policy_version 1526616 (0.0009) [2023-12-28 06:12:25,031][106226] Updated weights for policy 0, policy_version 1522881 (0.0010) [2023-12-28 06:12:25,077][106226] Updated weights for policy 0, policy_version 1522891 (0.0005) [2023-12-28 06:12:25,137][106226] Updated weights for policy 0, policy_version 1522901 (0.0005) [2023-12-28 06:12:25,210][106225] Updated weights for policy 1, policy_version 1526626 (0.0009) [2023-12-28 06:12:25,264][106225] Updated weights for policy 1, policy_version 1526636 (0.0007) [2023-12-28 06:12:25,317][106225] Updated weights for policy 1, policy_version 1526646 (0.0007) [2023-12-28 06:12:25,780][106226] Updated weights for policy 0, policy_version 1522911 (0.0009) [2023-12-28 06:12:25,841][106226] Updated weights for policy 0, policy_version 1522921 (0.0008) [2023-12-28 06:12:25,903][106226] Updated weights for policy 0, policy_version 1522931 (0.0009) [2023-12-28 06:12:26,051][106225] Updated weights for policy 1, policy_version 1526656 (0.0008) [2023-12-28 06:12:26,102][106225] Updated weights for policy 1, policy_version 1526667 (0.0009) [2023-12-28 06:12:26,161][106225] Updated weights for policy 1, policy_version 1526677 (0.0008) [2023-12-28 06:12:26,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 780820480. Throughput: 0: 9875.8, 1: 9872.7. Samples: 780792204. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:26,175][105115] Avg episode reward: [(0, '-4.743'), (1, '-4.706')] [2023-12-28 06:12:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001526680_390881280.pth... [2023-12-28 06:12:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001522936_389947392.pth... [2023-12-28 06:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001525528_390586368.pth [2023-12-28 06:12:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001521816_389660672.pth [2023-12-28 06:12:26,577][106226] Updated weights for policy 0, policy_version 1522941 (0.0009) [2023-12-28 06:12:26,635][106226] Updated weights for policy 0, policy_version 1522951 (0.0007) [2023-12-28 06:12:26,691][106226] Updated weights for policy 0, policy_version 1522961 (0.0010) [2023-12-28 06:12:26,928][106225] Updated weights for policy 1, policy_version 1526687 (0.0008) [2023-12-28 06:12:26,984][106225] Updated weights for policy 1, policy_version 1526697 (0.0008) [2023-12-28 06:12:27,048][106225] Updated weights for policy 1, policy_version 1526707 (0.0008) [2023-12-28 06:12:27,352][106226] Updated weights for policy 0, policy_version 1522971 (0.0009) [2023-12-28 06:12:27,414][106226] Updated weights for policy 0, policy_version 1522981 (0.0005) [2023-12-28 06:12:27,472][106226] Updated weights for policy 0, policy_version 1522991 (0.0005) [2023-12-28 06:12:27,713][106225] Updated weights for policy 1, policy_version 1526717 (0.0008) [2023-12-28 06:12:27,758][106225] Updated weights for policy 1, policy_version 1526727 (0.0005) [2023-12-28 06:12:27,808][106225] Updated weights for policy 1, policy_version 1526737 (0.0005) [2023-12-28 06:12:28,079][106226] Updated weights for policy 0, policy_version 1523001 (0.0005) [2023-12-28 06:12:28,150][106226] Updated weights for policy 0, policy_version 1523011 (0.0006) [2023-12-28 06:12:28,204][106226] Updated weights for policy 0, policy_version 1523021 (0.0005) [2023-12-28 06:12:28,259][106226] Updated weights for policy 0, policy_version 1523031 (0.0005) [2023-12-28 06:12:28,444][106225] Updated weights for policy 1, policy_version 1526747 (0.0007) [2023-12-28 06:12:28,503][106225] Updated weights for policy 1, policy_version 1526757 (0.0010) [2023-12-28 06:12:28,560][106225] Updated weights for policy 1, policy_version 1526767 (0.0010) [2023-12-28 06:12:28,866][106226] Updated weights for policy 0, policy_version 1523041 (0.0010) [2023-12-28 06:12:28,923][106226] Updated weights for policy 0, policy_version 1523051 (0.0010) [2023-12-28 06:12:28,983][106226] Updated weights for policy 0, policy_version 1523061 (0.0007) [2023-12-28 06:12:29,348][106225] Updated weights for policy 1, policy_version 1526777 (0.0010) [2023-12-28 06:12:29,414][106225] Updated weights for policy 1, policy_version 1526787 (0.0008) [2023-12-28 06:12:29,474][106225] Updated weights for policy 1, policy_version 1526797 (0.0007) [2023-12-28 06:12:29,526][106225] Updated weights for policy 1, policy_version 1526807 (0.0005) [2023-12-28 06:12:29,588][106226] Updated weights for policy 0, policy_version 1523071 (0.0006) [2023-12-28 06:12:29,657][106226] Updated weights for policy 0, policy_version 1523081 (0.0010) [2023-12-28 06:12:29,714][106226] Updated weights for policy 0, policy_version 1523091 (0.0010) [2023-12-28 06:12:30,218][106225] Updated weights for policy 1, policy_version 1526817 (0.0008) [2023-12-28 06:12:30,277][106225] Updated weights for policy 1, policy_version 1526827 (0.0007) [2023-12-28 06:12:30,336][106225] Updated weights for policy 1, policy_version 1526837 (0.0008) [2023-12-28 06:12:30,402][106226] Updated weights for policy 0, policy_version 1523101 (0.0008) [2023-12-28 06:12:30,457][106226] Updated weights for policy 0, policy_version 1523111 (0.0007) [2023-12-28 06:12:30,505][106226] Updated weights for policy 0, policy_version 1523121 (0.0008) [2023-12-28 06:12:31,035][106225] Updated weights for policy 1, policy_version 1526847 (0.0006) [2023-12-28 06:12:31,089][106226] Updated weights for policy 0, policy_version 1523131 (0.0009) [2023-12-28 06:12:31,098][106225] Updated weights for policy 1, policy_version 1526857 (0.0007) [2023-12-28 06:12:31,159][106226] Updated weights for policy 0, policy_version 1523141 (0.0007) [2023-12-28 06:12:31,163][106225] Updated weights for policy 1, policy_version 1526867 (0.0008) [2023-12-28 06:12:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 780918784. Throughput: 0: 9913.6, 1: 9893.0. Samples: 780914516. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:31,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-4.775')] [2023-12-28 06:12:31,220][106226] Updated weights for policy 0, policy_version 1523151 (0.0011) [2023-12-28 06:12:31,874][106225] Updated weights for policy 1, policy_version 1526877 (0.0010) [2023-12-28 06:12:31,928][106225] Updated weights for policy 1, policy_version 1526887 (0.0010) [2023-12-28 06:12:31,966][106226] Updated weights for policy 0, policy_version 1523161 (0.0011) [2023-12-28 06:12:31,995][106225] Updated weights for policy 1, policy_version 1526897 (0.0005) [2023-12-28 06:12:32,027][106226] Updated weights for policy 0, policy_version 1523171 (0.0011) [2023-12-28 06:12:32,087][106226] Updated weights for policy 0, policy_version 1523181 (0.0010) [2023-12-28 06:12:32,147][106226] Updated weights for policy 0, policy_version 1523191 (0.0011) [2023-12-28 06:12:32,685][106225] Updated weights for policy 1, policy_version 1526907 (0.0010) [2023-12-28 06:12:32,744][106225] Updated weights for policy 1, policy_version 1526917 (0.0009) [2023-12-28 06:12:32,795][106225] Updated weights for policy 1, policy_version 1526927 (0.0005) [2023-12-28 06:12:32,872][106226] Updated weights for policy 0, policy_version 1523201 (0.0010) [2023-12-28 06:12:32,935][106226] Updated weights for policy 0, policy_version 1523211 (0.0010) [2023-12-28 06:12:32,998][106226] Updated weights for policy 0, policy_version 1523221 (0.0010) [2023-12-28 06:12:33,413][106225] Updated weights for policy 1, policy_version 1526937 (0.0008) [2023-12-28 06:12:33,465][106225] Updated weights for policy 1, policy_version 1526947 (0.0008) [2023-12-28 06:12:33,517][106225] Updated weights for policy 1, policy_version 1526957 (0.0010) [2023-12-28 06:12:33,576][106225] Updated weights for policy 1, policy_version 1526967 (0.0010) [2023-12-28 06:12:33,638][106226] Updated weights for policy 0, policy_version 1523231 (0.0007) [2023-12-28 06:12:33,687][106226] Updated weights for policy 0, policy_version 1523241 (0.0005) [2023-12-28 06:12:33,756][106226] Updated weights for policy 0, policy_version 1523251 (0.0007) [2023-12-28 06:12:34,279][106225] Updated weights for policy 1, policy_version 1526977 (0.0009) [2023-12-28 06:12:34,341][106225] Updated weights for policy 1, policy_version 1526987 (0.0008) [2023-12-28 06:12:34,350][106226] Updated weights for policy 0, policy_version 1523261 (0.0007) [2023-12-28 06:12:34,402][106225] Updated weights for policy 1, policy_version 1526997 (0.0006) [2023-12-28 06:12:34,408][106226] Updated weights for policy 0, policy_version 1523271 (0.0009) [2023-12-28 06:12:34,470][106226] Updated weights for policy 0, policy_version 1523281 (0.0007) [2023-12-28 06:12:34,973][106225] Updated weights for policy 1, policy_version 1527007 (0.0006) [2023-12-28 06:12:35,021][106225] Updated weights for policy 1, policy_version 1527017 (0.0005) [2023-12-28 06:12:35,060][106226] Updated weights for policy 0, policy_version 1523291 (0.0007) [2023-12-28 06:12:35,089][106225] Updated weights for policy 1, policy_version 1527027 (0.0007) [2023-12-28 06:12:35,114][106226] Updated weights for policy 0, policy_version 1523301 (0.0006) [2023-12-28 06:12:35,162][106226] Updated weights for policy 0, policy_version 1523311 (0.0008) [2023-12-28 06:12:35,742][106225] Updated weights for policy 1, policy_version 1527037 (0.0008) [2023-12-28 06:12:35,798][106225] Updated weights for policy 1, policy_version 1527047 (0.0005) [2023-12-28 06:12:35,848][106226] Updated weights for policy 0, policy_version 1523321 (0.0008) [2023-12-28 06:12:35,858][106225] Updated weights for policy 1, policy_version 1527057 (0.0007) [2023-12-28 06:12:35,910][106226] Updated weights for policy 0, policy_version 1523331 (0.0008) [2023-12-28 06:12:35,975][106226] Updated weights for policy 0, policy_version 1523341 (0.0009) [2023-12-28 06:12:36,030][106226] Updated weights for policy 0, policy_version 1523351 (0.0008) [2023-12-28 06:12:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 781033472. Throughput: 0: 9962.5, 1: 9910.5. Samples: 781038520. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:36,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.812')] [2023-12-28 06:12:36,636][106225] Updated weights for policy 1, policy_version 1527067 (0.0006) [2023-12-28 06:12:36,663][106226] Updated weights for policy 0, policy_version 1523361 (0.0010) [2023-12-28 06:12:36,700][106225] Updated weights for policy 1, policy_version 1527077 (0.0006) [2023-12-28 06:12:36,728][106226] Updated weights for policy 0, policy_version 1523371 (0.0011) [2023-12-28 06:12:36,756][106225] Updated weights for policy 1, policy_version 1527087 (0.0006) [2023-12-28 06:12:36,785][106226] Updated weights for policy 0, policy_version 1523381 (0.0010) [2023-12-28 06:12:37,383][106225] Updated weights for policy 1, policy_version 1527097 (0.0006) [2023-12-28 06:12:37,450][106225] Updated weights for policy 1, policy_version 1527107 (0.0008) [2023-12-28 06:12:37,457][106226] Updated weights for policy 0, policy_version 1523391 (0.0007) [2023-12-28 06:12:37,516][106225] Updated weights for policy 1, policy_version 1527117 (0.0010) [2023-12-28 06:12:37,518][106226] Updated weights for policy 0, policy_version 1523401 (0.0005) [2023-12-28 06:12:37,578][106226] Updated weights for policy 0, policy_version 1523411 (0.0006) [2023-12-28 06:12:37,584][106225] Updated weights for policy 1, policy_version 1527127 (0.0010) [2023-12-28 06:12:38,152][106225] Updated weights for policy 1, policy_version 1527137 (0.0006) [2023-12-28 06:12:38,205][106225] Updated weights for policy 1, policy_version 1527147 (0.0007) [2023-12-28 06:12:38,237][106226] Updated weights for policy 0, policy_version 1523421 (0.0009) [2023-12-28 06:12:38,254][106225] Updated weights for policy 1, policy_version 1527157 (0.0007) [2023-12-28 06:12:38,283][106226] Updated weights for policy 0, policy_version 1523431 (0.0010) [2023-12-28 06:12:38,338][106226] Updated weights for policy 0, policy_version 1523441 (0.0010) [2023-12-28 06:12:38,939][106225] Updated weights for policy 1, policy_version 1527167 (0.0007) [2023-12-28 06:12:38,988][106225] Updated weights for policy 1, policy_version 1527177 (0.0005) [2023-12-28 06:12:39,054][106225] Updated weights for policy 1, policy_version 1527187 (0.0005) [2023-12-28 06:12:39,087][106226] Updated weights for policy 0, policy_version 1523451 (0.0009) [2023-12-28 06:12:39,154][106226] Updated weights for policy 0, policy_version 1523461 (0.0006) [2023-12-28 06:12:39,217][106226] Updated weights for policy 0, policy_version 1523471 (0.0006) [2023-12-28 06:12:39,710][106225] Updated weights for policy 1, policy_version 1527197 (0.0007) [2023-12-28 06:12:39,774][106225] Updated weights for policy 1, policy_version 1527207 (0.0009) [2023-12-28 06:12:39,844][106225] Updated weights for policy 1, policy_version 1527217 (0.0009) [2023-12-28 06:12:39,905][106226] Updated weights for policy 0, policy_version 1523481 (0.0009) [2023-12-28 06:12:39,970][106226] Updated weights for policy 0, policy_version 1523491 (0.0009) [2023-12-28 06:12:40,037][106226] Updated weights for policy 0, policy_version 1523501 (0.0009) [2023-12-28 06:12:40,097][106226] Updated weights for policy 0, policy_version 1523511 (0.0008) [2023-12-28 06:12:40,559][106225] Updated weights for policy 1, policy_version 1527227 (0.0008) [2023-12-28 06:12:40,620][106225] Updated weights for policy 1, policy_version 1527237 (0.0010) [2023-12-28 06:12:40,676][106225] Updated weights for policy 1, policy_version 1527247 (0.0010) [2023-12-28 06:12:40,791][106226] Updated weights for policy 0, policy_version 1523521 (0.0008) [2023-12-28 06:12:40,837][106226] Updated weights for policy 0, policy_version 1523531 (0.0007) [2023-12-28 06:12:40,889][106226] Updated weights for policy 0, policy_version 1523541 (0.0005) [2023-12-28 06:12:41,175][105115] Fps is (10 sec: 21299.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 781131776. Throughput: 0: 9977.7, 1: 9947.7. Samples: 781101192. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:41,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.517')] [2023-12-28 06:12:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001527256_391028736.pth... [2023-12-28 06:12:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001523544_390103040.pth... [2023-12-28 06:12:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001522360_389799936.pth [2023-12-28 06:12:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001526104_390733824.pth [2023-12-28 06:12:41,292][106225] Updated weights for policy 1, policy_version 1527257 (0.0010) [2023-12-28 06:12:41,363][106225] Updated weights for policy 1, policy_version 1527267 (0.0013) [2023-12-28 06:12:41,430][106225] Updated weights for policy 1, policy_version 1527277 (0.0010) [2023-12-28 06:12:41,495][106225] Updated weights for policy 1, policy_version 1527287 (0.0011) [2023-12-28 06:12:41,607][106226] Updated weights for policy 0, policy_version 1523551 (0.0006) [2023-12-28 06:12:41,680][106226] Updated weights for policy 0, policy_version 1523561 (0.0007) [2023-12-28 06:12:41,747][106226] Updated weights for policy 0, policy_version 1523571 (0.0007) [2023-12-28 06:12:42,211][106225] Updated weights for policy 1, policy_version 1527297 (0.0006) [2023-12-28 06:12:42,284][106225] Updated weights for policy 1, policy_version 1527307 (0.0007) [2023-12-28 06:12:42,352][106225] Updated weights for policy 1, policy_version 1527317 (0.0009) [2023-12-28 06:12:42,474][106226] Updated weights for policy 0, policy_version 1523581 (0.0009) [2023-12-28 06:12:42,539][106226] Updated weights for policy 0, policy_version 1523591 (0.0007) [2023-12-28 06:12:42,610][106226] Updated weights for policy 0, policy_version 1523601 (0.0008) [2023-12-28 06:12:43,046][106225] Updated weights for policy 1, policy_version 1527327 (0.0010) [2023-12-28 06:12:43,106][106225] Updated weights for policy 1, policy_version 1527337 (0.0010) [2023-12-28 06:12:43,165][106225] Updated weights for policy 1, policy_version 1527347 (0.0008) [2023-12-28 06:12:43,318][106226] Updated weights for policy 0, policy_version 1523611 (0.0007) [2023-12-28 06:12:43,382][106226] Updated weights for policy 0, policy_version 1523621 (0.0005) [2023-12-28 06:12:43,438][106226] Updated weights for policy 0, policy_version 1523631 (0.0005) [2023-12-28 06:12:43,801][106225] Updated weights for policy 1, policy_version 1527357 (0.0005) [2023-12-28 06:12:43,858][106225] Updated weights for policy 1, policy_version 1527367 (0.0005) [2023-12-28 06:12:43,914][106225] Updated weights for policy 1, policy_version 1527377 (0.0005) [2023-12-28 06:12:44,087][106226] Updated weights for policy 0, policy_version 1523641 (0.0006) [2023-12-28 06:12:44,149][106226] Updated weights for policy 0, policy_version 1523651 (0.0011) [2023-12-28 06:12:44,212][106226] Updated weights for policy 0, policy_version 1523661 (0.0008) [2023-12-28 06:12:44,262][106226] Updated weights for policy 0, policy_version 1523671 (0.0010) [2023-12-28 06:12:44,497][106225] Updated weights for policy 1, policy_version 1527387 (0.0007) [2023-12-28 06:12:44,559][106225] Updated weights for policy 1, policy_version 1527397 (0.0010) [2023-12-28 06:12:44,616][106225] Updated weights for policy 1, policy_version 1527407 (0.0005) [2023-12-28 06:12:44,959][106226] Updated weights for policy 0, policy_version 1523681 (0.0007) [2023-12-28 06:12:45,022][106226] Updated weights for policy 0, policy_version 1523691 (0.0007) [2023-12-28 06:12:45,083][106226] Updated weights for policy 0, policy_version 1523701 (0.0007) [2023-12-28 06:12:45,289][106225] Updated weights for policy 1, policy_version 1527417 (0.0008) [2023-12-28 06:12:45,346][106225] Updated weights for policy 1, policy_version 1527427 (0.0011) [2023-12-28 06:12:45,407][106225] Updated weights for policy 1, policy_version 1527437 (0.0010) [2023-12-28 06:12:45,470][106225] Updated weights for policy 1, policy_version 1527447 (0.0005) [2023-12-28 06:12:45,841][106226] Updated weights for policy 0, policy_version 1523711 (0.0008) [2023-12-28 06:12:45,899][106226] Updated weights for policy 0, policy_version 1523721 (0.0009) [2023-12-28 06:12:45,952][106226] Updated weights for policy 0, policy_version 1523731 (0.0007) [2023-12-28 06:12:46,014][106225] Updated weights for policy 1, policy_version 1527457 (0.0005) [2023-12-28 06:12:46,084][106225] Updated weights for policy 1, policy_version 1527467 (0.0007) [2023-12-28 06:12:46,151][106225] Updated weights for policy 1, policy_version 1527477 (0.0010) [2023-12-28 06:12:46,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 781238272. Throughput: 0: 9988.3, 1: 9959.8. Samples: 781221016. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:46,175][105115] Avg episode reward: [(0, '-4.958'), (1, '-4.840')] [2023-12-28 06:12:46,705][106226] Updated weights for policy 0, policy_version 1523741 (0.0007) [2023-12-28 06:12:46,711][106225] Updated weights for policy 1, policy_version 1527487 (0.0009) [2023-12-28 06:12:46,756][106226] Updated weights for policy 0, policy_version 1523751 (0.0007) [2023-12-28 06:12:46,769][106225] Updated weights for policy 1, policy_version 1527497 (0.0005) [2023-12-28 06:12:46,818][106226] Updated weights for policy 0, policy_version 1523761 (0.0008) [2023-12-28 06:12:46,830][106225] Updated weights for policy 1, policy_version 1527507 (0.0005) [2023-12-28 06:12:47,381][106226] Updated weights for policy 0, policy_version 1523771 (0.0005) [2023-12-28 06:12:47,413][106225] Updated weights for policy 1, policy_version 1527517 (0.0008) [2023-12-28 06:12:47,438][106226] Updated weights for policy 0, policy_version 1523781 (0.0006) [2023-12-28 06:12:47,463][106225] Updated weights for policy 1, policy_version 1527527 (0.0010) [2023-12-28 06:12:47,502][106226] Updated weights for policy 0, policy_version 1523791 (0.0007) [2023-12-28 06:12:47,515][106225] Updated weights for policy 1, policy_version 1527537 (0.0010) [2023-12-28 06:12:48,195][106225] Updated weights for policy 1, policy_version 1527547 (0.0010) [2023-12-28 06:12:48,213][106226] Updated weights for policy 0, policy_version 1523801 (0.0006) [2023-12-28 06:12:48,263][106225] Updated weights for policy 1, policy_version 1527557 (0.0010) [2023-12-28 06:12:48,271][106226] Updated weights for policy 0, policy_version 1523811 (0.0007) [2023-12-28 06:12:48,330][106226] Updated weights for policy 0, policy_version 1523821 (0.0007) [2023-12-28 06:12:48,330][106225] Updated weights for policy 1, policy_version 1527567 (0.0011) [2023-12-28 06:12:48,390][106226] Updated weights for policy 0, policy_version 1523831 (0.0008) [2023-12-28 06:12:49,006][106225] Updated weights for policy 1, policy_version 1527577 (0.0010) [2023-12-28 06:12:49,066][106225] Updated weights for policy 1, policy_version 1527587 (0.0010) [2023-12-28 06:12:49,116][106225] Updated weights for policy 1, policy_version 1527597 (0.0010) [2023-12-28 06:12:49,154][106226] Updated weights for policy 0, policy_version 1523841 (0.0006) [2023-12-28 06:12:49,168][106225] Updated weights for policy 1, policy_version 1527607 (0.0010) [2023-12-28 06:12:49,207][106226] Updated weights for policy 0, policy_version 1523851 (0.0007) [2023-12-28 06:12:49,279][106226] Updated weights for policy 0, policy_version 1523861 (0.0008) [2023-12-28 06:12:49,958][106226] Updated weights for policy 0, policy_version 1523871 (0.0008) [2023-12-28 06:12:49,986][106225] Updated weights for policy 1, policy_version 1527617 (0.0008) [2023-12-28 06:12:50,022][106226] Updated weights for policy 0, policy_version 1523881 (0.0007) [2023-12-28 06:12:50,051][106225] Updated weights for policy 1, policy_version 1527627 (0.0007) [2023-12-28 06:12:50,084][106226] Updated weights for policy 0, policy_version 1523891 (0.0005) [2023-12-28 06:12:50,113][106225] Updated weights for policy 1, policy_version 1527637 (0.0006) [2023-12-28 06:12:50,739][106226] Updated weights for policy 0, policy_version 1523901 (0.0008) [2023-12-28 06:12:50,804][106225] Updated weights for policy 1, policy_version 1527647 (0.0006) [2023-12-28 06:12:50,807][106226] Updated weights for policy 0, policy_version 1523911 (0.0009) [2023-12-28 06:12:50,867][106225] Updated weights for policy 1, policy_version 1527657 (0.0008) [2023-12-28 06:12:50,877][106226] Updated weights for policy 0, policy_version 1523921 (0.0006) [2023-12-28 06:12:50,927][106225] Updated weights for policy 1, policy_version 1527667 (0.0006) [2023-12-28 06:12:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 781336576. Throughput: 0: 9961.3, 1: 10008.5. Samples: 781342280. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:51,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.788')] [2023-12-28 06:12:51,646][106226] Updated weights for policy 0, policy_version 1523931 (0.0009) [2023-12-28 06:12:51,647][106225] Updated weights for policy 1, policy_version 1527677 (0.0007) [2023-12-28 06:12:51,705][106226] Updated weights for policy 0, policy_version 1523941 (0.0007) [2023-12-28 06:12:51,707][106225] Updated weights for policy 1, policy_version 1527687 (0.0007) [2023-12-28 06:12:51,771][106226] Updated weights for policy 0, policy_version 1523951 (0.0007) [2023-12-28 06:12:51,781][106225] Updated weights for policy 1, policy_version 1527697 (0.0006) [2023-12-28 06:12:52,420][106225] Updated weights for policy 1, policy_version 1527707 (0.0008) [2023-12-28 06:12:52,489][106225] Updated weights for policy 1, policy_version 1527717 (0.0008) [2023-12-28 06:12:52,556][106226] Updated weights for policy 0, policy_version 1523961 (0.0007) [2023-12-28 06:12:52,559][106225] Updated weights for policy 1, policy_version 1527727 (0.0007) [2023-12-28 06:12:52,623][106226] Updated weights for policy 0, policy_version 1523971 (0.0008) [2023-12-28 06:12:52,689][106226] Updated weights for policy 0, policy_version 1523981 (0.0010) [2023-12-28 06:12:52,751][106226] Updated weights for policy 0, policy_version 1523991 (0.0009) [2023-12-28 06:12:53,207][106225] Updated weights for policy 1, policy_version 1527737 (0.0008) [2023-12-28 06:12:53,262][106225] Updated weights for policy 1, policy_version 1527747 (0.0009) [2023-12-28 06:12:53,320][106225] Updated weights for policy 1, policy_version 1527757 (0.0007) [2023-12-28 06:12:53,384][106225] Updated weights for policy 1, policy_version 1527767 (0.0006) [2023-12-28 06:12:53,456][106226] Updated weights for policy 0, policy_version 1524001 (0.0009) [2023-12-28 06:12:53,527][106226] Updated weights for policy 0, policy_version 1524011 (0.0008) [2023-12-28 06:12:53,592][106226] Updated weights for policy 0, policy_version 1524021 (0.0008) [2023-12-28 06:12:54,069][106225] Updated weights for policy 1, policy_version 1527777 (0.0010) [2023-12-28 06:12:54,123][106225] Updated weights for policy 1, policy_version 1527787 (0.0010) [2023-12-28 06:12:54,181][106225] Updated weights for policy 1, policy_version 1527797 (0.0007) [2023-12-28 06:12:54,316][106226] Updated weights for policy 0, policy_version 1524031 (0.0009) [2023-12-28 06:12:54,363][106226] Updated weights for policy 0, policy_version 1524041 (0.0010) [2023-12-28 06:12:54,412][106226] Updated weights for policy 0, policy_version 1524051 (0.0010) [2023-12-28 06:12:54,900][106225] Updated weights for policy 1, policy_version 1527807 (0.0010) [2023-12-28 06:12:54,951][106225] Updated weights for policy 1, policy_version 1527817 (0.0010) [2023-12-28 06:12:55,003][106225] Updated weights for policy 1, policy_version 1527827 (0.0011) [2023-12-28 06:12:55,098][106226] Updated weights for policy 0, policy_version 1524061 (0.0010) [2023-12-28 06:12:55,152][106226] Updated weights for policy 0, policy_version 1524071 (0.0009) [2023-12-28 06:12:55,207][106226] Updated weights for policy 0, policy_version 1524081 (0.0008) [2023-12-28 06:12:55,705][106225] Updated weights for policy 1, policy_version 1527837 (0.0010) [2023-12-28 06:12:55,758][106225] Updated weights for policy 1, policy_version 1527847 (0.0010) [2023-12-28 06:12:55,808][106225] Updated weights for policy 1, policy_version 1527857 (0.0010) [2023-12-28 06:12:55,930][106226] Updated weights for policy 0, policy_version 1524091 (0.0011) [2023-12-28 06:12:55,992][106226] Updated weights for policy 0, policy_version 1524101 (0.0008) [2023-12-28 06:12:56,054][106226] Updated weights for policy 0, policy_version 1524111 (0.0006) [2023-12-28 06:12:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 781434880. Throughput: 0: 9943.1, 1: 10005.3. Samples: 781400080. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:12:56,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.673')] [2023-12-28 06:12:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001524120_390250496.pth... [2023-12-28 06:12:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001527864_391184384.pth... [2023-12-28 06:12:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001522936_389947392.pth [2023-12-28 06:12:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001526680_390881280.pth [2023-12-28 06:12:56,519][106225] Updated weights for policy 1, policy_version 1527867 (0.0010) [2023-12-28 06:12:56,571][106225] Updated weights for policy 1, policy_version 1527877 (0.0010) [2023-12-28 06:12:56,618][106225] Updated weights for policy 1, policy_version 1527887 (0.0009) [2023-12-28 06:12:56,626][106226] Updated weights for policy 0, policy_version 1524121 (0.0005) [2023-12-28 06:12:56,679][106226] Updated weights for policy 0, policy_version 1524131 (0.0005) [2023-12-28 06:12:56,733][106226] Updated weights for policy 0, policy_version 1524141 (0.0006) [2023-12-28 06:12:56,792][106226] Updated weights for policy 0, policy_version 1524151 (0.0008) [2023-12-28 06:12:57,341][106225] Updated weights for policy 1, policy_version 1527897 (0.0009) [2023-12-28 06:12:57,404][106225] Updated weights for policy 1, policy_version 1527907 (0.0009) [2023-12-28 06:12:57,461][106225] Updated weights for policy 1, policy_version 1527917 (0.0010) [2023-12-28 06:12:57,504][106226] Updated weights for policy 0, policy_version 1524161 (0.0010) [2023-12-28 06:12:57,522][106225] Updated weights for policy 1, policy_version 1527927 (0.0007) [2023-12-28 06:12:57,565][106226] Updated weights for policy 0, policy_version 1524171 (0.0010) [2023-12-28 06:12:57,625][106226] Updated weights for policy 0, policy_version 1524181 (0.0008) [2023-12-28 06:12:58,207][106225] Updated weights for policy 1, policy_version 1527937 (0.0006) [2023-12-28 06:12:58,267][106226] Updated weights for policy 0, policy_version 1524191 (0.0007) [2023-12-28 06:12:58,276][106225] Updated weights for policy 1, policy_version 1527947 (0.0007) [2023-12-28 06:12:58,334][106226] Updated weights for policy 0, policy_version 1524202 (0.0010) [2023-12-28 06:12:58,342][106225] Updated weights for policy 1, policy_version 1527958 (0.0008) [2023-12-28 06:12:58,400][106226] Updated weights for policy 0, policy_version 1524212 (0.0008) [2023-12-28 06:12:59,074][106225] Updated weights for policy 1, policy_version 1527968 (0.0007) [2023-12-28 06:12:59,135][106225] Updated weights for policy 1, policy_version 1527978 (0.0008) [2023-12-28 06:12:59,157][106226] Updated weights for policy 0, policy_version 1524222 (0.0009) [2023-12-28 06:12:59,195][106225] Updated weights for policy 1, policy_version 1527988 (0.0008) [2023-12-28 06:12:59,210][106226] Updated weights for policy 0, policy_version 1524232 (0.0008) [2023-12-28 06:12:59,285][106226] Updated weights for policy 0, policy_version 1524242 (0.0008) [2023-12-28 06:12:59,924][106225] Updated weights for policy 1, policy_version 1527998 (0.0006) [2023-12-28 06:12:59,988][106225] Updated weights for policy 1, policy_version 1528008 (0.0007) [2023-12-28 06:13:00,051][106225] Updated weights for policy 1, policy_version 1528018 (0.0009) [2023-12-28 06:13:00,052][106226] Updated weights for policy 0, policy_version 1524252 (0.0007) [2023-12-28 06:13:00,114][106226] Updated weights for policy 0, policy_version 1524262 (0.0005) [2023-12-28 06:13:00,164][106226] Updated weights for policy 0, policy_version 1524272 (0.0006) [2023-12-28 06:13:00,761][106225] Updated weights for policy 1, policy_version 1528028 (0.0009) [2023-12-28 06:13:00,807][106225] Updated weights for policy 1, policy_version 1528038 (0.0010) [2023-12-28 06:13:00,833][106226] Updated weights for policy 0, policy_version 1524282 (0.0005) [2023-12-28 06:13:00,861][106225] Updated weights for policy 1, policy_version 1528048 (0.0010) [2023-12-28 06:13:00,885][106226] Updated weights for policy 0, policy_version 1524292 (0.0006) [2023-12-28 06:13:00,942][106226] Updated weights for policy 0, policy_version 1524302 (0.0007) [2023-12-28 06:13:00,988][106226] Updated weights for policy 0, policy_version 1524312 (0.0007) [2023-12-28 06:13:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 781533184. Throughput: 0: 9968.8, 1: 10014.3. Samples: 781518104. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:01,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.700')] [2023-12-28 06:13:01,633][106225] Updated weights for policy 1, policy_version 1528058 (0.0009) [2023-12-28 06:13:01,699][106225] Updated weights for policy 1, policy_version 1528068 (0.0008) [2023-12-28 06:13:01,764][106225] Updated weights for policy 1, policy_version 1528078 (0.0008) [2023-12-28 06:13:01,776][106226] Updated weights for policy 0, policy_version 1524322 (0.0008) [2023-12-28 06:13:01,811][106225] Updated weights for policy 1, policy_version 1528088 (0.0008) [2023-12-28 06:13:01,847][106226] Updated weights for policy 0, policy_version 1524332 (0.0008) [2023-12-28 06:13:01,909][106226] Updated weights for policy 0, policy_version 1524342 (0.0007) [2023-12-28 06:13:02,473][106225] Updated weights for policy 1, policy_version 1528098 (0.0005) [2023-12-28 06:13:02,529][106225] Updated weights for policy 1, policy_version 1528108 (0.0005) [2023-12-28 06:13:02,582][106225] Updated weights for policy 1, policy_version 1528118 (0.0006) [2023-12-28 06:13:02,712][106226] Updated weights for policy 0, policy_version 1524352 (0.0008) [2023-12-28 06:13:02,770][106226] Updated weights for policy 0, policy_version 1524362 (0.0010) [2023-12-28 06:13:02,828][106226] Updated weights for policy 0, policy_version 1524372 (0.0009) [2023-12-28 06:13:03,151][106225] Updated weights for policy 1, policy_version 1528128 (0.0005) [2023-12-28 06:13:03,197][106225] Updated weights for policy 1, policy_version 1528138 (0.0005) [2023-12-28 06:13:03,256][106225] Updated weights for policy 1, policy_version 1528148 (0.0005) [2023-12-28 06:13:03,589][106226] Updated weights for policy 0, policy_version 1524382 (0.0010) [2023-12-28 06:13:03,638][106226] Updated weights for policy 0, policy_version 1524392 (0.0010) [2023-12-28 06:13:03,683][106226] Updated weights for policy 0, policy_version 1524402 (0.0010) [2023-12-28 06:13:03,936][106225] Updated weights for policy 1, policy_version 1528158 (0.0008) [2023-12-28 06:13:04,000][106225] Updated weights for policy 1, policy_version 1528168 (0.0008) [2023-12-28 06:13:04,048][106225] Updated weights for policy 1, policy_version 1528178 (0.0008) [2023-12-28 06:13:04,409][106226] Updated weights for policy 0, policy_version 1524412 (0.0008) [2023-12-28 06:13:04,462][106226] Updated weights for policy 0, policy_version 1524422 (0.0008) [2023-12-28 06:13:04,513][106226] Updated weights for policy 0, policy_version 1524432 (0.0008) [2023-12-28 06:13:04,839][106225] Updated weights for policy 1, policy_version 1528188 (0.0007) [2023-12-28 06:13:04,897][106225] Updated weights for policy 1, policy_version 1528198 (0.0007) [2023-12-28 06:13:04,963][106225] Updated weights for policy 1, policy_version 1528208 (0.0008) [2023-12-28 06:13:05,125][106226] Updated weights for policy 0, policy_version 1524442 (0.0008) [2023-12-28 06:13:05,184][106226] Updated weights for policy 0, policy_version 1524452 (0.0007) [2023-12-28 06:13:05,238][106226] Updated weights for policy 0, policy_version 1524462 (0.0010) [2023-12-28 06:13:05,286][106226] Updated weights for policy 0, policy_version 1524472 (0.0010) [2023-12-28 06:13:05,687][106225] Updated weights for policy 1, policy_version 1528218 (0.0007) [2023-12-28 06:13:05,741][106225] Updated weights for policy 1, policy_version 1528228 (0.0007) [2023-12-28 06:13:05,797][106225] Updated weights for policy 1, policy_version 1528238 (0.0007) [2023-12-28 06:13:05,860][106225] Updated weights for policy 1, policy_version 1528248 (0.0009) [2023-12-28 06:13:05,950][106226] Updated weights for policy 0, policy_version 1524482 (0.0010) [2023-12-28 06:13:05,997][106226] Updated weights for policy 0, policy_version 1524492 (0.0010) [2023-12-28 06:13:06,052][106226] Updated weights for policy 0, policy_version 1524502 (0.0010) [2023-12-28 06:13:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 781631488. Throughput: 0: 9953.7, 1: 10032.2. Samples: 781636504. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:06,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.728')] [2023-12-28 06:13:06,556][106225] Updated weights for policy 1, policy_version 1528258 (0.0006) [2023-12-28 06:13:06,625][106225] Updated weights for policy 1, policy_version 1528268 (0.0006) [2023-12-28 06:13:06,691][106225] Updated weights for policy 1, policy_version 1528278 (0.0006) [2023-12-28 06:13:06,691][106226] Updated weights for policy 0, policy_version 1524512 (0.0011) [2023-12-28 06:13:06,749][106226] Updated weights for policy 0, policy_version 1524522 (0.0011) [2023-12-28 06:13:06,796][106226] Updated weights for policy 0, policy_version 1524532 (0.0010) [2023-12-28 06:13:07,221][106225] Updated weights for policy 1, policy_version 1528288 (0.0007) [2023-12-28 06:13:07,268][106225] Updated weights for policy 1, policy_version 1528298 (0.0006) [2023-12-28 06:13:07,314][106225] Updated weights for policy 1, policy_version 1528308 (0.0005) [2023-12-28 06:13:07,509][106226] Updated weights for policy 0, policy_version 1524542 (0.0010) [2023-12-28 06:13:07,576][106226] Updated weights for policy 0, policy_version 1524552 (0.0009) [2023-12-28 06:13:07,631][106226] Updated weights for policy 0, policy_version 1524562 (0.0005) [2023-12-28 06:13:08,002][106225] Updated weights for policy 1, policy_version 1528318 (0.0006) [2023-12-28 06:13:08,061][106225] Updated weights for policy 1, policy_version 1528328 (0.0006) [2023-12-28 06:13:08,121][106225] Updated weights for policy 1, policy_version 1528338 (0.0008) [2023-12-28 06:13:08,228][106226] Updated weights for policy 0, policy_version 1524572 (0.0005) [2023-12-28 06:13:08,285][106226] Updated weights for policy 0, policy_version 1524582 (0.0005) [2023-12-28 06:13:08,373][106226] Updated weights for policy 0, policy_version 1524592 (0.0009) [2023-12-28 06:13:08,787][106225] Updated weights for policy 1, policy_version 1528348 (0.0010) [2023-12-28 06:13:08,837][106225] Updated weights for policy 1, policy_version 1528358 (0.0010) [2023-12-28 06:13:08,885][106225] Updated weights for policy 1, policy_version 1528368 (0.0010) [2023-12-28 06:13:09,049][106226] Updated weights for policy 0, policy_version 1524602 (0.0011) [2023-12-28 06:13:09,110][106226] Updated weights for policy 0, policy_version 1524612 (0.0010) [2023-12-28 06:13:09,168][106226] Updated weights for policy 0, policy_version 1524622 (0.0011) [2023-12-28 06:13:09,235][106226] Updated weights for policy 0, policy_version 1524632 (0.0009) [2023-12-28 06:13:09,608][106225] Updated weights for policy 1, policy_version 1528378 (0.0009) [2023-12-28 06:13:09,668][106225] Updated weights for policy 1, policy_version 1528388 (0.0006) [2023-12-28 06:13:09,721][106225] Updated weights for policy 1, policy_version 1528398 (0.0006) [2023-12-28 06:13:09,786][106225] Updated weights for policy 1, policy_version 1528408 (0.0006) [2023-12-28 06:13:09,989][106226] Updated weights for policy 0, policy_version 1524642 (0.0010) [2023-12-28 06:13:10,051][106226] Updated weights for policy 0, policy_version 1524652 (0.0008) [2023-12-28 06:13:10,111][106226] Updated weights for policy 0, policy_version 1524662 (0.0007) [2023-12-28 06:13:10,454][106225] Updated weights for policy 1, policy_version 1528418 (0.0010) [2023-12-28 06:13:10,511][106225] Updated weights for policy 1, policy_version 1528428 (0.0008) [2023-12-28 06:13:10,568][106225] Updated weights for policy 1, policy_version 1528438 (0.0009) [2023-12-28 06:13:10,843][106226] Updated weights for policy 0, policy_version 1524672 (0.0008) [2023-12-28 06:13:10,899][106226] Updated weights for policy 0, policy_version 1524682 (0.0008) [2023-12-28 06:13:10,952][106226] Updated weights for policy 0, policy_version 1524692 (0.0008) [2023-12-28 06:13:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 781729792. Throughput: 0: 10039.5, 1: 10134.0. Samples: 781700016. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:11,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.798')] [2023-12-28 06:13:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001528440_391331840.pth... [2023-12-28 06:13:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001524696_390397952.pth... [2023-12-28 06:13:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001523544_390103040.pth [2023-12-28 06:13:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001527256_391028736.pth [2023-12-28 06:13:11,342][106225] Updated weights for policy 1, policy_version 1528448 (0.0009) [2023-12-28 06:13:11,413][106225] Updated weights for policy 1, policy_version 1528458 (0.0007) [2023-12-28 06:13:11,479][106225] Updated weights for policy 1, policy_version 1528468 (0.0005) [2023-12-28 06:13:11,790][106226] Updated weights for policy 0, policy_version 1524702 (0.0009) [2023-12-28 06:13:11,847][106226] Updated weights for policy 0, policy_version 1524712 (0.0009) [2023-12-28 06:13:11,902][106226] Updated weights for policy 0, policy_version 1524722 (0.0008) [2023-12-28 06:13:12,237][106225] Updated weights for policy 1, policy_version 1528478 (0.0008) [2023-12-28 06:13:12,306][106225] Updated weights for policy 1, policy_version 1528488 (0.0008) [2023-12-28 06:13:12,384][106225] Updated weights for policy 1, policy_version 1528498 (0.0007) [2023-12-28 06:13:12,699][106226] Updated weights for policy 0, policy_version 1524732 (0.0008) [2023-12-28 06:13:12,757][106226] Updated weights for policy 0, policy_version 1524742 (0.0006) [2023-12-28 06:13:12,824][106226] Updated weights for policy 0, policy_version 1524752 (0.0009) [2023-12-28 06:13:12,992][106225] Updated weights for policy 1, policy_version 1528508 (0.0006) [2023-12-28 06:13:13,054][106225] Updated weights for policy 1, policy_version 1528518 (0.0005) [2023-12-28 06:13:13,112][106225] Updated weights for policy 1, policy_version 1528528 (0.0006) [2023-12-28 06:13:13,451][106226] Updated weights for policy 0, policy_version 1524762 (0.0009) [2023-12-28 06:13:13,500][106226] Updated weights for policy 0, policy_version 1524772 (0.0006) [2023-12-28 06:13:13,558][106226] Updated weights for policy 0, policy_version 1524782 (0.0008) [2023-12-28 06:13:13,613][106226] Updated weights for policy 0, policy_version 1524792 (0.0010) [2023-12-28 06:13:13,706][106225] Updated weights for policy 1, policy_version 1528538 (0.0009) [2023-12-28 06:13:13,761][106225] Updated weights for policy 1, policy_version 1528548 (0.0008) [2023-12-28 06:13:13,805][106225] Updated weights for policy 1, policy_version 1528558 (0.0005) [2023-12-28 06:13:13,852][106225] Updated weights for policy 1, policy_version 1528568 (0.0005) [2023-12-28 06:13:14,238][106226] Updated weights for policy 0, policy_version 1524802 (0.0009) [2023-12-28 06:13:14,310][106226] Updated weights for policy 0, policy_version 1524812 (0.0006) [2023-12-28 06:13:14,382][106226] Updated weights for policy 0, policy_version 1524822 (0.0005) [2023-12-28 06:13:14,533][106225] Updated weights for policy 1, policy_version 1528578 (0.0011) [2023-12-28 06:13:14,596][106225] Updated weights for policy 1, policy_version 1528588 (0.0006) [2023-12-28 06:13:14,652][106225] Updated weights for policy 1, policy_version 1528598 (0.0006) [2023-12-28 06:13:15,002][106226] Updated weights for policy 0, policy_version 1524832 (0.0008) [2023-12-28 06:13:15,067][106226] Updated weights for policy 0, policy_version 1524842 (0.0009) [2023-12-28 06:13:15,129][106226] Updated weights for policy 0, policy_version 1524852 (0.0008) [2023-12-28 06:13:15,326][106225] Updated weights for policy 1, policy_version 1528608 (0.0009) [2023-12-28 06:13:15,387][106225] Updated weights for policy 1, policy_version 1528618 (0.0010) [2023-12-28 06:13:15,446][106225] Updated weights for policy 1, policy_version 1528628 (0.0010) [2023-12-28 06:13:15,786][106226] Updated weights for policy 0, policy_version 1524862 (0.0008) [2023-12-28 06:13:15,842][106226] Updated weights for policy 0, policy_version 1524872 (0.0008) [2023-12-28 06:13:15,905][106226] Updated weights for policy 0, policy_version 1524882 (0.0008) [2023-12-28 06:13:16,151][106225] Updated weights for policy 1, policy_version 1528638 (0.0007) [2023-12-28 06:13:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 781828096. Throughput: 0: 9910.1, 1: 10180.2. Samples: 781818580. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:16,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.622')] [2023-12-28 06:13:16,209][106225] Updated weights for policy 1, policy_version 1528648 (0.0005) [2023-12-28 06:13:16,270][106225] Updated weights for policy 1, policy_version 1528658 (0.0005) [2023-12-28 06:13:16,712][106226] Updated weights for policy 0, policy_version 1524892 (0.0007) [2023-12-28 06:13:16,761][106225] Updated weights for policy 1, policy_version 1528668 (0.0007) [2023-12-28 06:13:16,772][106226] Updated weights for policy 0, policy_version 1524902 (0.0010) [2023-12-28 06:13:16,812][106225] Updated weights for policy 1, policy_version 1528678 (0.0010) [2023-12-28 06:13:16,822][106226] Updated weights for policy 0, policy_version 1524912 (0.0009) [2023-12-28 06:13:16,865][106225] Updated weights for policy 1, policy_version 1528688 (0.0010) [2023-12-28 06:13:17,509][106225] Updated weights for policy 1, policy_version 1528698 (0.0008) [2023-12-28 06:13:17,518][106226] Updated weights for policy 0, policy_version 1524922 (0.0007) [2023-12-28 06:13:17,559][106225] Updated weights for policy 1, policy_version 1528708 (0.0005) [2023-12-28 06:13:17,572][106226] Updated weights for policy 0, policy_version 1524932 (0.0009) [2023-12-28 06:13:17,613][106225] Updated weights for policy 1, policy_version 1528718 (0.0009) [2023-12-28 06:13:17,628][106226] Updated weights for policy 0, policy_version 1524942 (0.0010) [2023-12-28 06:13:17,660][106225] Updated weights for policy 1, policy_version 1528728 (0.0008) [2023-12-28 06:13:17,671][106226] Updated weights for policy 0, policy_version 1524952 (0.0010) [2023-12-28 06:13:18,370][106226] Updated weights for policy 0, policy_version 1524962 (0.0008) [2023-12-28 06:13:18,388][106225] Updated weights for policy 1, policy_version 1528738 (0.0009) [2023-12-28 06:13:18,431][106226] Updated weights for policy 0, policy_version 1524972 (0.0008) [2023-12-28 06:13:18,450][106225] Updated weights for policy 1, policy_version 1528748 (0.0011) [2023-12-28 06:13:18,488][106226] Updated weights for policy 0, policy_version 1524982 (0.0006) [2023-12-28 06:13:18,505][106225] Updated weights for policy 1, policy_version 1528758 (0.0010) [2023-12-28 06:13:19,177][106225] Updated weights for policy 1, policy_version 1528768 (0.0006) [2023-12-28 06:13:19,192][106226] Updated weights for policy 0, policy_version 1524992 (0.0006) [2023-12-28 06:13:19,264][106226] Updated weights for policy 0, policy_version 1525002 (0.0008) [2023-12-28 06:13:19,270][106225] Updated weights for policy 1, policy_version 1528778 (0.0009) [2023-12-28 06:13:19,331][106226] Updated weights for policy 0, policy_version 1525012 (0.0008) [2023-12-28 06:13:19,339][106225] Updated weights for policy 1, policy_version 1528788 (0.0010) [2023-12-28 06:13:20,057][106226] Updated weights for policy 0, policy_version 1525022 (0.0011) [2023-12-28 06:13:20,120][106226] Updated weights for policy 0, policy_version 1525032 (0.0011) [2023-12-28 06:13:20,152][106225] Updated weights for policy 1, policy_version 1528798 (0.0010) [2023-12-28 06:13:20,183][106226] Updated weights for policy 0, policy_version 1525042 (0.0009) [2023-12-28 06:13:20,222][106225] Updated weights for policy 1, policy_version 1528808 (0.0006) [2023-12-28 06:13:20,282][106225] Updated weights for policy 1, policy_version 1528818 (0.0008) [2023-12-28 06:13:20,834][106226] Updated weights for policy 0, policy_version 1525052 (0.0010) [2023-12-28 06:13:20,895][106226] Updated weights for policy 0, policy_version 1525062 (0.0011) [2023-12-28 06:13:20,961][106226] Updated weights for policy 0, policy_version 1525072 (0.0011) [2023-12-28 06:13:21,068][106225] Updated weights for policy 1, policy_version 1528828 (0.0008) [2023-12-28 06:13:21,132][106225] Updated weights for policy 1, policy_version 1528838 (0.0009) [2023-12-28 06:13:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 781926400. Throughput: 0: 9827.9, 1: 10143.7. Samples: 781937240. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:21,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-4.834')] [2023-12-28 06:13:21,189][106225] Updated weights for policy 1, policy_version 1528848 (0.0008) [2023-12-28 06:13:21,715][106226] Updated weights for policy 0, policy_version 1525082 (0.0010) [2023-12-28 06:13:21,790][106226] Updated weights for policy 0, policy_version 1525092 (0.0007) [2023-12-28 06:13:21,843][106226] Updated weights for policy 0, policy_version 1525102 (0.0009) [2023-12-28 06:13:21,891][106226] Updated weights for policy 0, policy_version 1525112 (0.0009) [2023-12-28 06:13:21,974][106225] Updated weights for policy 1, policy_version 1528858 (0.0010) [2023-12-28 06:13:22,038][106225] Updated weights for policy 1, policy_version 1528868 (0.0009) [2023-12-28 06:13:22,098][106225] Updated weights for policy 1, policy_version 1528878 (0.0008) [2023-12-28 06:13:22,152][106225] Updated weights for policy 1, policy_version 1528888 (0.0009) [2023-12-28 06:13:22,601][106226] Updated weights for policy 0, policy_version 1525122 (0.0008) [2023-12-28 06:13:22,660][106226] Updated weights for policy 0, policy_version 1525132 (0.0009) [2023-12-28 06:13:22,716][106226] Updated weights for policy 0, policy_version 1525142 (0.0008) [2023-12-28 06:13:22,941][106225] Updated weights for policy 1, policy_version 1528898 (0.0010) [2023-12-28 06:13:23,002][106225] Updated weights for policy 1, policy_version 1528908 (0.0010) [2023-12-28 06:13:23,062][106225] Updated weights for policy 1, policy_version 1528918 (0.0010) [2023-12-28 06:13:23,425][106226] Updated weights for policy 0, policy_version 1525152 (0.0008) [2023-12-28 06:13:23,478][106226] Updated weights for policy 0, policy_version 1525162 (0.0006) [2023-12-28 06:13:23,528][106226] Updated weights for policy 0, policy_version 1525172 (0.0007) [2023-12-28 06:13:23,740][106225] Updated weights for policy 1, policy_version 1528928 (0.0010) [2023-12-28 06:13:23,800][106225] Updated weights for policy 1, policy_version 1528938 (0.0006) [2023-12-28 06:13:23,864][106225] Updated weights for policy 1, policy_version 1528948 (0.0007) [2023-12-28 06:13:24,319][106226] Updated weights for policy 0, policy_version 1525182 (0.0007) [2023-12-28 06:13:24,365][106226] Updated weights for policy 0, policy_version 1525192 (0.0008) [2023-12-28 06:13:24,413][106226] Updated weights for policy 0, policy_version 1525202 (0.0008) [2023-12-28 06:13:24,466][106225] Updated weights for policy 1, policy_version 1528958 (0.0009) [2023-12-28 06:13:24,527][106225] Updated weights for policy 1, policy_version 1528968 (0.0010) [2023-12-28 06:13:24,590][106225] Updated weights for policy 1, policy_version 1528978 (0.0008) [2023-12-28 06:13:25,194][106226] Updated weights for policy 0, policy_version 1525212 (0.0008) [2023-12-28 06:13:25,242][106225] Updated weights for policy 1, policy_version 1528988 (0.0007) [2023-12-28 06:13:25,259][106226] Updated weights for policy 0, policy_version 1525222 (0.0006) [2023-12-28 06:13:25,292][106225] Updated weights for policy 1, policy_version 1528998 (0.0010) [2023-12-28 06:13:25,313][106226] Updated weights for policy 0, policy_version 1525232 (0.0005) [2023-12-28 06:13:25,345][106225] Updated weights for policy 1, policy_version 1529008 (0.0010) [2023-12-28 06:13:25,911][106226] Updated weights for policy 0, policy_version 1525242 (0.0008) [2023-12-28 06:13:25,954][106225] Updated weights for policy 1, policy_version 1529018 (0.0009) [2023-12-28 06:13:25,971][106226] Updated weights for policy 0, policy_version 1525252 (0.0005) [2023-12-28 06:13:26,000][106225] Updated weights for policy 1, policy_version 1529028 (0.0007) [2023-12-28 06:13:26,027][106226] Updated weights for policy 0, policy_version 1525262 (0.0005) [2023-12-28 06:13:26,056][106225] Updated weights for policy 1, policy_version 1529038 (0.0008) [2023-12-28 06:13:26,080][106226] Updated weights for policy 0, policy_version 1525272 (0.0007) [2023-12-28 06:13:26,112][106225] Updated weights for policy 1, policy_version 1529048 (0.0005) [2023-12-28 06:13:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20206.8, 300 sec: 19910.7). Total num frames: 782032896. Throughput: 0: 9775.7, 1: 10057.2. Samples: 781993676. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:26,176][105115] Avg episode reward: [(0, '-4.821'), (1, '-4.680')] [2023-12-28 06:13:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001529048_391487488.pth... [2023-12-28 06:13:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001525272_390545408.pth... [2023-12-28 06:13:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001527864_391184384.pth [2023-12-28 06:13:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001524120_390250496.pth [2023-12-28 06:13:26,708][106226] Updated weights for policy 0, policy_version 1525282 (0.0005) [2023-12-28 06:13:26,766][106226] Updated weights for policy 0, policy_version 1525292 (0.0006) [2023-12-28 06:13:26,808][106225] Updated weights for policy 1, policy_version 1529058 (0.0010) [2023-12-28 06:13:26,824][106226] Updated weights for policy 0, policy_version 1525302 (0.0009) [2023-12-28 06:13:26,861][106225] Updated weights for policy 1, policy_version 1529068 (0.0010) [2023-12-28 06:13:26,910][106225] Updated weights for policy 1, policy_version 1529078 (0.0010) [2023-12-28 06:13:27,424][106226] Updated weights for policy 0, policy_version 1525312 (0.0010) [2023-12-28 06:13:27,477][106226] Updated weights for policy 0, policy_version 1525322 (0.0010) [2023-12-28 06:13:27,540][106226] Updated weights for policy 0, policy_version 1525332 (0.0011) [2023-12-28 06:13:27,635][106225] Updated weights for policy 1, policy_version 1529088 (0.0010) [2023-12-28 06:13:27,691][106225] Updated weights for policy 1, policy_version 1529098 (0.0010) [2023-12-28 06:13:27,755][106225] Updated weights for policy 1, policy_version 1529108 (0.0010) [2023-12-28 06:13:28,237][106226] Updated weights for policy 0, policy_version 1525342 (0.0010) [2023-12-28 06:13:28,290][106226] Updated weights for policy 0, policy_version 1525352 (0.0010) [2023-12-28 06:13:28,342][106226] Updated weights for policy 0, policy_version 1525362 (0.0009) [2023-12-28 06:13:28,400][106225] Updated weights for policy 1, policy_version 1529118 (0.0010) [2023-12-28 06:13:28,453][106225] Updated weights for policy 1, policy_version 1529128 (0.0006) [2023-12-28 06:13:28,508][106225] Updated weights for policy 1, policy_version 1529138 (0.0009) [2023-12-28 06:13:29,041][106226] Updated weights for policy 0, policy_version 1525372 (0.0011) [2023-12-28 06:13:29,093][106226] Updated weights for policy 0, policy_version 1525382 (0.0010) [2023-12-28 06:13:29,138][106226] Updated weights for policy 0, policy_version 1525392 (0.0010) [2023-12-28 06:13:29,224][106225] Updated weights for policy 1, policy_version 1529148 (0.0010) [2023-12-28 06:13:29,283][106225] Updated weights for policy 1, policy_version 1529158 (0.0008) [2023-12-28 06:13:29,338][106225] Updated weights for policy 1, policy_version 1529168 (0.0009) [2023-12-28 06:13:29,828][106226] Updated weights for policy 0, policy_version 1525402 (0.0007) [2023-12-28 06:13:29,895][106226] Updated weights for policy 0, policy_version 1525412 (0.0007) [2023-12-28 06:13:29,963][106226] Updated weights for policy 0, policy_version 1525422 (0.0009) [2023-12-28 06:13:30,027][106226] Updated weights for policy 0, policy_version 1525432 (0.0008) [2023-12-28 06:13:30,088][106225] Updated weights for policy 1, policy_version 1529178 (0.0008) [2023-12-28 06:13:30,149][106225] Updated weights for policy 1, policy_version 1529188 (0.0005) [2023-12-28 06:13:30,200][106225] Updated weights for policy 1, policy_version 1529198 (0.0006) [2023-12-28 06:13:30,247][106225] Updated weights for policy 1, policy_version 1529208 (0.0005) [2023-12-28 06:13:30,689][106226] Updated weights for policy 0, policy_version 1525442 (0.0006) [2023-12-28 06:13:30,736][106226] Updated weights for policy 0, policy_version 1525452 (0.0008) [2023-12-28 06:13:30,792][106226] Updated weights for policy 0, policy_version 1525462 (0.0008) [2023-12-28 06:13:30,922][106225] Updated weights for policy 1, policy_version 1529218 (0.0007) [2023-12-28 06:13:30,974][106225] Updated weights for policy 1, policy_version 1529228 (0.0005) [2023-12-28 06:13:31,031][106225] Updated weights for policy 1, policy_version 1529238 (0.0006) [2023-12-28 06:13:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19910.7). Total num frames: 782131200. Throughput: 0: 9830.7, 1: 10065.4. Samples: 782116336. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:31,175][105115] Avg episode reward: [(0, '-4.840'), (1, '-4.663')] [2023-12-28 06:13:31,520][106226] Updated weights for policy 0, policy_version 1525472 (0.0010) [2023-12-28 06:13:31,584][106226] Updated weights for policy 0, policy_version 1525482 (0.0011) [2023-12-28 06:13:31,650][106226] Updated weights for policy 0, policy_version 1525492 (0.0010) [2023-12-28 06:13:31,780][106225] Updated weights for policy 1, policy_version 1529248 (0.0008) [2023-12-28 06:13:31,838][106225] Updated weights for policy 1, policy_version 1529258 (0.0006) [2023-12-28 06:13:31,895][106225] Updated weights for policy 1, policy_version 1529268 (0.0006) [2023-12-28 06:13:32,298][106226] Updated weights for policy 0, policy_version 1525502 (0.0009) [2023-12-28 06:13:32,364][106226] Updated weights for policy 0, policy_version 1525512 (0.0008) [2023-12-28 06:13:32,416][106226] Updated weights for policy 0, policy_version 1525522 (0.0009) [2023-12-28 06:13:32,634][106225] Updated weights for policy 1, policy_version 1529278 (0.0009) [2023-12-28 06:13:32,681][106225] Updated weights for policy 1, policy_version 1529288 (0.0010) [2023-12-28 06:13:32,732][106225] Updated weights for policy 1, policy_version 1529298 (0.0010) [2023-12-28 06:13:33,126][106226] Updated weights for policy 0, policy_version 1525532 (0.0008) [2023-12-28 06:13:33,192][106226] Updated weights for policy 0, policy_version 1525542 (0.0009) [2023-12-28 06:13:33,246][106226] Updated weights for policy 0, policy_version 1525552 (0.0008) [2023-12-28 06:13:33,434][106225] Updated weights for policy 1, policy_version 1529308 (0.0008) [2023-12-28 06:13:33,496][106225] Updated weights for policy 1, policy_version 1529318 (0.0006) [2023-12-28 06:13:33,556][106225] Updated weights for policy 1, policy_version 1529328 (0.0008) [2023-12-28 06:13:33,891][106226] Updated weights for policy 0, policy_version 1525562 (0.0008) [2023-12-28 06:13:33,957][106226] Updated weights for policy 0, policy_version 1525572 (0.0005) [2023-12-28 06:13:34,012][106226] Updated weights for policy 0, policy_version 1525582 (0.0005) [2023-12-28 06:13:34,059][106226] Updated weights for policy 0, policy_version 1525592 (0.0005) [2023-12-28 06:13:34,212][106225] Updated weights for policy 1, policy_version 1529338 (0.0008) [2023-12-28 06:13:34,272][106225] Updated weights for policy 1, policy_version 1529348 (0.0010) [2023-12-28 06:13:34,334][106225] Updated weights for policy 1, policy_version 1529358 (0.0011) [2023-12-28 06:13:34,397][106225] Updated weights for policy 1, policy_version 1529368 (0.0011) [2023-12-28 06:13:34,743][106226] Updated weights for policy 0, policy_version 1525602 (0.0008) [2023-12-28 06:13:34,805][106226] Updated weights for policy 0, policy_version 1525612 (0.0008) [2023-12-28 06:13:34,871][106226] Updated weights for policy 0, policy_version 1525622 (0.0009) [2023-12-28 06:13:35,066][106225] Updated weights for policy 1, policy_version 1529378 (0.0009) [2023-12-28 06:13:35,120][106225] Updated weights for policy 1, policy_version 1529388 (0.0007) [2023-12-28 06:13:35,178][106225] Updated weights for policy 1, policy_version 1529398 (0.0005) [2023-12-28 06:13:35,588][106226] Updated weights for policy 0, policy_version 1525632 (0.0008) [2023-12-28 06:13:35,644][106226] Updated weights for policy 0, policy_version 1525642 (0.0007) [2023-12-28 06:13:35,696][106226] Updated weights for policy 0, policy_version 1525652 (0.0007) [2023-12-28 06:13:35,870][106225] Updated weights for policy 1, policy_version 1529408 (0.0010) [2023-12-28 06:13:35,931][106225] Updated weights for policy 1, policy_version 1529418 (0.0010) [2023-12-28 06:13:35,989][106225] Updated weights for policy 1, policy_version 1529428 (0.0010) [2023-12-28 06:13:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 782229504. Throughput: 0: 9890.0, 1: 10012.8. Samples: 782237908. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:36,175][105115] Avg episode reward: [(0, '-4.728'), (1, '-4.589')] [2023-12-28 06:13:36,341][106226] Updated weights for policy 0, policy_version 1525662 (0.0007) [2023-12-28 06:13:36,414][106226] Updated weights for policy 0, policy_version 1525672 (0.0006) [2023-12-28 06:13:36,478][106226] Updated weights for policy 0, policy_version 1525682 (0.0008) [2023-12-28 06:13:36,655][106225] Updated weights for policy 1, policy_version 1529438 (0.0010) [2023-12-28 06:13:36,721][106225] Updated weights for policy 1, policy_version 1529448 (0.0010) [2023-12-28 06:13:36,778][106225] Updated weights for policy 1, policy_version 1529458 (0.0010) [2023-12-28 06:13:37,063][106226] Updated weights for policy 0, policy_version 1525692 (0.0008) [2023-12-28 06:13:37,113][106226] Updated weights for policy 0, policy_version 1525702 (0.0010) [2023-12-28 06:13:37,161][106226] Updated weights for policy 0, policy_version 1525712 (0.0010) [2023-12-28 06:13:37,357][106225] Updated weights for policy 1, policy_version 1529468 (0.0010) [2023-12-28 06:13:37,421][106225] Updated weights for policy 1, policy_version 1529478 (0.0010) [2023-12-28 06:13:37,477][106225] Updated weights for policy 1, policy_version 1529488 (0.0007) [2023-12-28 06:13:37,831][106226] Updated weights for policy 0, policy_version 1525722 (0.0010) [2023-12-28 06:13:37,898][106226] Updated weights for policy 0, policy_version 1525732 (0.0010) [2023-12-28 06:13:37,959][106226] Updated weights for policy 0, policy_version 1525742 (0.0006) [2023-12-28 06:13:38,023][106226] Updated weights for policy 0, policy_version 1525752 (0.0006) [2023-12-28 06:13:38,057][106225] Updated weights for policy 1, policy_version 1529498 (0.0006) [2023-12-28 06:13:38,120][106225] Updated weights for policy 1, policy_version 1529508 (0.0006) [2023-12-28 06:13:38,181][106225] Updated weights for policy 1, policy_version 1529518 (0.0008) [2023-12-28 06:13:38,235][106225] Updated weights for policy 1, policy_version 1529528 (0.0006) [2023-12-28 06:13:38,729][106226] Updated weights for policy 0, policy_version 1525762 (0.0011) [2023-12-28 06:13:38,793][106226] Updated weights for policy 0, policy_version 1525772 (0.0011) [2023-12-28 06:13:38,853][106226] Updated weights for policy 0, policy_version 1525782 (0.0011) [2023-12-28 06:13:38,916][106225] Updated weights for policy 1, policy_version 1529538 (0.0008) [2023-12-28 06:13:38,978][106225] Updated weights for policy 1, policy_version 1529548 (0.0005) [2023-12-28 06:13:39,040][106225] Updated weights for policy 1, policy_version 1529558 (0.0005) [2023-12-28 06:13:39,618][106226] Updated weights for policy 0, policy_version 1525792 (0.0009) [2023-12-28 06:13:39,632][106225] Updated weights for policy 1, policy_version 1529568 (0.0006) [2023-12-28 06:13:39,677][106226] Updated weights for policy 0, policy_version 1525802 (0.0007) [2023-12-28 06:13:39,699][106225] Updated weights for policy 1, policy_version 1529578 (0.0006) [2023-12-28 06:13:39,737][106226] Updated weights for policy 0, policy_version 1525812 (0.0008) [2023-12-28 06:13:39,759][106225] Updated weights for policy 1, policy_version 1529588 (0.0007) [2023-12-28 06:13:40,440][106225] Updated weights for policy 1, policy_version 1529598 (0.0009) [2023-12-28 06:13:40,499][106225] Updated weights for policy 1, policy_version 1529608 (0.0008) [2023-12-28 06:13:40,528][106226] Updated weights for policy 0, policy_version 1525822 (0.0008) [2023-12-28 06:13:40,558][106225] Updated weights for policy 1, policy_version 1529618 (0.0008) [2023-12-28 06:13:40,589][106226] Updated weights for policy 0, policy_version 1525832 (0.0010) [2023-12-28 06:13:40,645][106226] Updated weights for policy 0, policy_version 1525842 (0.0008) [2023-12-28 06:13:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 782327808. Throughput: 0: 9956.9, 1: 10072.4. Samples: 782301400. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:41,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-4.471')] [2023-12-28 06:13:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001529624_391634944.pth... [2023-12-28 06:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001525848_390692864.pth... [2023-12-28 06:13:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001528440_391331840.pth [2023-12-28 06:13:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001529624_391634944.pth [2023-12-28 06:13:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001524696_390397952.pth [2023-12-28 06:13:41,188][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001525848_390692864.pth [2023-12-28 06:13:41,269][106225] Updated weights for policy 1, policy_version 1529628 (0.0010) [2023-12-28 06:13:41,330][106225] Updated weights for policy 1, policy_version 1529638 (0.0008) [2023-12-28 06:13:41,397][106225] Updated weights for policy 1, policy_version 1529648 (0.0009) [2023-12-28 06:13:41,434][106226] Updated weights for policy 0, policy_version 1525852 (0.0008) [2023-12-28 06:13:41,493][106226] Updated weights for policy 0, policy_version 1525862 (0.0008) [2023-12-28 06:13:41,555][106226] Updated weights for policy 0, policy_version 1525872 (0.0007) [2023-12-28 06:13:42,152][106225] Updated weights for policy 1, policy_version 1529658 (0.0007) [2023-12-28 06:13:42,219][106225] Updated weights for policy 1, policy_version 1529668 (0.0007) [2023-12-28 06:13:42,287][106225] Updated weights for policy 1, policy_version 1529678 (0.0008) [2023-12-28 06:13:42,333][106226] Updated weights for policy 0, policy_version 1525882 (0.0008) [2023-12-28 06:13:42,356][106225] Updated weights for policy 1, policy_version 1529688 (0.0008) [2023-12-28 06:13:42,404][106226] Updated weights for policy 0, policy_version 1525892 (0.0009) [2023-12-28 06:13:42,472][106226] Updated weights for policy 0, policy_version 1525902 (0.0009) [2023-12-28 06:13:42,536][106226] Updated weights for policy 0, policy_version 1525912 (0.0007) [2023-12-28 06:13:42,961][106225] Updated weights for policy 1, policy_version 1529698 (0.0008) [2023-12-28 06:13:43,022][106225] Updated weights for policy 1, policy_version 1529708 (0.0010) [2023-12-28 06:13:43,086][106225] Updated weights for policy 1, policy_version 1529718 (0.0006) [2023-12-28 06:13:43,283][106226] Updated weights for policy 0, policy_version 1525922 (0.0008) [2023-12-28 06:13:43,344][106226] Updated weights for policy 0, policy_version 1525932 (0.0008) [2023-12-28 06:13:43,402][106226] Updated weights for policy 0, policy_version 1525942 (0.0006) [2023-12-28 06:13:43,763][106225] Updated weights for policy 1, policy_version 1529728 (0.0009) [2023-12-28 06:13:43,813][106225] Updated weights for policy 1, policy_version 1529738 (0.0010) [2023-12-28 06:13:43,863][106225] Updated weights for policy 1, policy_version 1529748 (0.0010) [2023-12-28 06:13:44,030][106226] Updated weights for policy 0, policy_version 1525952 (0.0005) [2023-12-28 06:13:44,089][106226] Updated weights for policy 0, policy_version 1525962 (0.0008) [2023-12-28 06:13:44,153][106226] Updated weights for policy 0, policy_version 1525972 (0.0008) [2023-12-28 06:13:44,574][106225] Updated weights for policy 1, policy_version 1529758 (0.0009) [2023-12-28 06:13:44,624][106225] Updated weights for policy 1, policy_version 1529768 (0.0008) [2023-12-28 06:13:44,678][106225] Updated weights for policy 1, policy_version 1529778 (0.0009) [2023-12-28 06:13:44,826][106226] Updated weights for policy 0, policy_version 1525982 (0.0007) [2023-12-28 06:13:44,884][106226] Updated weights for policy 0, policy_version 1525992 (0.0006) [2023-12-28 06:13:44,946][106226] Updated weights for policy 0, policy_version 1526002 (0.0007) [2023-12-28 06:13:45,445][106225] Updated weights for policy 1, policy_version 1529788 (0.0009) [2023-12-28 06:13:45,494][106225] Updated weights for policy 1, policy_version 1529798 (0.0009) [2023-12-28 06:13:45,547][106225] Updated weights for policy 1, policy_version 1529808 (0.0007) [2023-12-28 06:13:45,560][106226] Updated weights for policy 0, policy_version 1526012 (0.0006) [2023-12-28 06:13:45,613][106226] Updated weights for policy 0, policy_version 1526022 (0.0006) [2023-12-28 06:13:45,681][106226] Updated weights for policy 0, policy_version 1526032 (0.0005) [2023-12-28 06:13:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 782426112. Throughput: 0: 9890.4, 1: 10090.1. Samples: 782417228. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:46,175][105115] Avg episode reward: [(0, '-5.074'), (1, '-4.953')] [2023-12-28 06:13:46,217][106226] Updated weights for policy 0, policy_version 1526042 (0.0005) [2023-12-28 06:13:46,282][106226] Updated weights for policy 0, policy_version 1526052 (0.0005) [2023-12-28 06:13:46,334][106226] Updated weights for policy 0, policy_version 1526062 (0.0005) [2023-12-28 06:13:46,356][106225] Updated weights for policy 1, policy_version 1529818 (0.0008) [2023-12-28 06:13:46,392][106226] Updated weights for policy 0, policy_version 1526072 (0.0006) [2023-12-28 06:13:46,407][106225] Updated weights for policy 1, policy_version 1529828 (0.0008) [2023-12-28 06:13:46,461][106225] Updated weights for policy 1, policy_version 1529838 (0.0008) [2023-12-28 06:13:46,519][106225] Updated weights for policy 1, policy_version 1529848 (0.0008) [2023-12-28 06:13:47,024][106226] Updated weights for policy 0, policy_version 1526082 (0.0011) [2023-12-28 06:13:47,084][106226] Updated weights for policy 0, policy_version 1526092 (0.0011) [2023-12-28 06:13:47,148][106226] Updated weights for policy 0, policy_version 1526102 (0.0011) [2023-12-28 06:13:47,271][106225] Updated weights for policy 1, policy_version 1529858 (0.0008) [2023-12-28 06:13:47,324][106225] Updated weights for policy 1, policy_version 1529868 (0.0007) [2023-12-28 06:13:47,388][106225] Updated weights for policy 1, policy_version 1529878 (0.0008) [2023-12-28 06:13:47,867][106226] Updated weights for policy 0, policy_version 1526112 (0.0008) [2023-12-28 06:13:47,923][106226] Updated weights for policy 0, policy_version 1526122 (0.0005) [2023-12-28 06:13:47,973][106226] Updated weights for policy 0, policy_version 1526132 (0.0006) [2023-12-28 06:13:48,008][106225] Updated weights for policy 1, policy_version 1529888 (0.0007) [2023-12-28 06:13:48,070][106225] Updated weights for policy 1, policy_version 1529898 (0.0008) [2023-12-28 06:13:48,137][106225] Updated weights for policy 1, policy_version 1529908 (0.0007) [2023-12-28 06:13:48,687][106226] Updated weights for policy 0, policy_version 1526142 (0.0009) [2023-12-28 06:13:48,756][106226] Updated weights for policy 0, policy_version 1526152 (0.0009) [2023-12-28 06:13:48,817][106226] Updated weights for policy 0, policy_version 1526162 (0.0009) [2023-12-28 06:13:48,839][106225] Updated weights for policy 1, policy_version 1529918 (0.0005) [2023-12-28 06:13:48,905][106225] Updated weights for policy 1, policy_version 1529928 (0.0006) [2023-12-28 06:13:48,961][106225] Updated weights for policy 1, policy_version 1529938 (0.0005) [2023-12-28 06:13:49,474][106226] Updated weights for policy 0, policy_version 1526172 (0.0007) [2023-12-28 06:13:49,530][106226] Updated weights for policy 0, policy_version 1526182 (0.0006) [2023-12-28 06:13:49,582][106225] Updated weights for policy 1, policy_version 1529948 (0.0007) [2023-12-28 06:13:49,583][106226] Updated weights for policy 0, policy_version 1526192 (0.0009) [2023-12-28 06:13:49,641][106225] Updated weights for policy 1, policy_version 1529958 (0.0009) [2023-12-28 06:13:49,706][106225] Updated weights for policy 1, policy_version 1529968 (0.0007) [2023-12-28 06:13:50,262][106226] Updated weights for policy 0, policy_version 1526202 (0.0009) [2023-12-28 06:13:50,321][106226] Updated weights for policy 0, policy_version 1526212 (0.0008) [2023-12-28 06:13:50,384][106226] Updated weights for policy 0, policy_version 1526222 (0.0008) [2023-12-28 06:13:50,437][106225] Updated weights for policy 1, policy_version 1529978 (0.0008) [2023-12-28 06:13:50,447][106226] Updated weights for policy 0, policy_version 1526232 (0.0008) [2023-12-28 06:13:50,499][106225] Updated weights for policy 1, policy_version 1529988 (0.0010) [2023-12-28 06:13:50,553][106225] Updated weights for policy 1, policy_version 1529998 (0.0008) [2023-12-28 06:13:50,619][106225] Updated weights for policy 1, policy_version 1530008 (0.0008) [2023-12-28 06:13:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 782524416. Throughput: 0: 9976.5, 1: 10056.6. Samples: 782537996. Policy #0 lag: (min: 18.0, avg: 38.4, max: 50.0) [2023-12-28 06:13:51,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.607')] [2023-12-28 06:13:51,179][106226] Updated weights for policy 0, policy_version 1526242 (0.0011) [2023-12-28 06:13:51,244][106226] Updated weights for policy 0, policy_version 1526252 (0.0011) [2023-12-28 06:13:51,317][106226] Updated weights for policy 0, policy_version 1526262 (0.0006) [2023-12-28 06:13:51,411][106225] Updated weights for policy 1, policy_version 1530018 (0.0009) [2023-12-28 06:13:51,475][106225] Updated weights for policy 1, policy_version 1530028 (0.0008) [2023-12-28 06:13:51,543][106225] Updated weights for policy 1, policy_version 1530038 (0.0008) [2023-12-28 06:13:52,066][106226] Updated weights for policy 0, policy_version 1526272 (0.0010) [2023-12-28 06:13:52,130][106226] Updated weights for policy 0, policy_version 1526282 (0.0011) [2023-12-28 06:13:52,187][106226] Updated weights for policy 0, policy_version 1526292 (0.0010) [2023-12-28 06:13:52,302][106225] Updated weights for policy 1, policy_version 1530048 (0.0008) [2023-12-28 06:13:52,358][106225] Updated weights for policy 1, policy_version 1530058 (0.0009) [2023-12-28 06:13:52,425][106225] Updated weights for policy 1, policy_version 1530068 (0.0006) [2023-12-28 06:13:52,885][106226] Updated weights for policy 0, policy_version 1526302 (0.0011) [2023-12-28 06:13:52,940][106226] Updated weights for policy 0, policy_version 1526312 (0.0011) [2023-12-28 06:13:52,990][106226] Updated weights for policy 0, policy_version 1526322 (0.0010) [2023-12-28 06:13:53,127][106225] Updated weights for policy 1, policy_version 1530078 (0.0007) [2023-12-28 06:13:53,182][106225] Updated weights for policy 1, policy_version 1530088 (0.0006) [2023-12-28 06:13:53,232][106225] Updated weights for policy 1, policy_version 1530098 (0.0005) [2023-12-28 06:13:53,651][106226] Updated weights for policy 0, policy_version 1526332 (0.0008) [2023-12-28 06:13:53,705][106226] Updated weights for policy 0, policy_version 1526342 (0.0006) [2023-12-28 06:13:53,756][106226] Updated weights for policy 0, policy_version 1526352 (0.0007) [2023-12-28 06:13:53,907][106225] Updated weights for policy 1, policy_version 1530108 (0.0005) [2023-12-28 06:13:53,963][106225] Updated weights for policy 1, policy_version 1530118 (0.0005) [2023-12-28 06:13:54,008][106225] Updated weights for policy 1, policy_version 1530128 (0.0005) [2023-12-28 06:13:54,415][106226] Updated weights for policy 0, policy_version 1526362 (0.0006) [2023-12-28 06:13:54,481][106226] Updated weights for policy 0, policy_version 1526372 (0.0009) [2023-12-28 06:13:54,544][106226] Updated weights for policy 0, policy_version 1526382 (0.0009) [2023-12-28 06:13:54,611][106226] Updated weights for policy 0, policy_version 1526392 (0.0007) [2023-12-28 06:13:54,668][106225] Updated weights for policy 1, policy_version 1530138 (0.0007) [2023-12-28 06:13:54,718][106225] Updated weights for policy 1, policy_version 1530148 (0.0007) [2023-12-28 06:13:54,766][106225] Updated weights for policy 1, policy_version 1530158 (0.0007) [2023-12-28 06:13:54,820][106225] Updated weights for policy 1, policy_version 1530168 (0.0007) [2023-12-28 06:13:55,323][106226] Updated weights for policy 0, policy_version 1526402 (0.0011) [2023-12-28 06:13:55,384][106226] Updated weights for policy 0, policy_version 1526412 (0.0011) [2023-12-28 06:13:55,444][106226] Updated weights for policy 0, policy_version 1526422 (0.0011) [2023-12-28 06:13:55,572][106225] Updated weights for policy 1, policy_version 1530178 (0.0008) [2023-12-28 06:13:55,631][106225] Updated weights for policy 1, policy_version 1530188 (0.0008) [2023-12-28 06:13:55,690][106225] Updated weights for policy 1, policy_version 1530198 (0.0007) [2023-12-28 06:13:56,167][106226] Updated weights for policy 0, policy_version 1526432 (0.0011) [2023-12-28 06:13:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 782622720. Throughput: 0: 9934.4, 1: 9982.5. Samples: 782596276. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:13:56,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.388')] [2023-12-28 06:13:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001530200_391782400.pth... [2023-12-28 06:13:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001529048_391487488.pth [2023-12-28 06:13:56,233][106226] Updated weights for policy 0, policy_version 1526442 (0.0011) [2023-12-28 06:13:56,269][106225] Updated weights for policy 1, policy_version 1530208 (0.0006) [2023-12-28 06:13:56,296][106226] Updated weights for policy 0, policy_version 1526453 (0.0011) [2023-12-28 06:13:56,310][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001526456_390848512.pth... [2023-12-28 06:13:56,313][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001525272_390545408.pth [2023-12-28 06:13:56,335][106225] Updated weights for policy 1, policy_version 1530218 (0.0005) [2023-12-28 06:13:56,398][106225] Updated weights for policy 1, policy_version 1530228 (0.0005) [2023-12-28 06:13:56,874][106226] Updated weights for policy 0, policy_version 1526463 (0.0007) [2023-12-28 06:13:56,930][106226] Updated weights for policy 0, policy_version 1526473 (0.0007) [2023-12-28 06:13:56,959][106225] Updated weights for policy 1, policy_version 1530238 (0.0009) [2023-12-28 06:13:56,977][106226] Updated weights for policy 0, policy_version 1526483 (0.0005) [2023-12-28 06:13:57,012][106225] Updated weights for policy 1, policy_version 1530248 (0.0010) [2023-12-28 06:13:57,060][106225] Updated weights for policy 1, policy_version 1530258 (0.0010) [2023-12-28 06:13:57,652][106225] Updated weights for policy 1, policy_version 1530268 (0.0008) [2023-12-28 06:13:57,700][106226] Updated weights for policy 0, policy_version 1526493 (0.0006) [2023-12-28 06:13:57,713][106225] Updated weights for policy 1, policy_version 1530278 (0.0010) [2023-12-28 06:13:57,754][106226] Updated weights for policy 0, policy_version 1526503 (0.0006) [2023-12-28 06:13:57,775][106225] Updated weights for policy 1, policy_version 1530288 (0.0011) [2023-12-28 06:13:57,812][106226] Updated weights for policy 0, policy_version 1526513 (0.0007) [2023-12-28 06:13:58,531][106225] Updated weights for policy 1, policy_version 1530298 (0.0011) [2023-12-28 06:13:58,587][106226] Updated weights for policy 0, policy_version 1526523 (0.0007) [2023-12-28 06:13:58,593][106225] Updated weights for policy 1, policy_version 1530308 (0.0011) [2023-12-28 06:13:58,649][106226] Updated weights for policy 0, policy_version 1526533 (0.0007) [2023-12-28 06:13:58,657][106225] Updated weights for policy 1, policy_version 1530318 (0.0009) [2023-12-28 06:13:58,712][106226] Updated weights for policy 0, policy_version 1526543 (0.0008) [2023-12-28 06:13:58,722][106225] Updated weights for policy 1, policy_version 1530328 (0.0010) [2023-12-28 06:13:59,510][106226] Updated weights for policy 0, policy_version 1526553 (0.0007) [2023-12-28 06:13:59,547][106225] Updated weights for policy 1, policy_version 1530338 (0.0005) [2023-12-28 06:13:59,577][106226] Updated weights for policy 0, policy_version 1526563 (0.0008) [2023-12-28 06:13:59,606][106225] Updated weights for policy 1, policy_version 1530348 (0.0007) [2023-12-28 06:13:59,639][106226] Updated weights for policy 0, policy_version 1526573 (0.0007) [2023-12-28 06:13:59,658][106225] Updated weights for policy 1, policy_version 1530358 (0.0008) [2023-12-28 06:13:59,703][106226] Updated weights for policy 0, policy_version 1526583 (0.0007) [2023-12-28 06:14:00,351][106225] Updated weights for policy 1, policy_version 1530368 (0.0010) [2023-12-28 06:14:00,398][106225] Updated weights for policy 1, policy_version 1530378 (0.0009) [2023-12-28 06:14:00,423][106226] Updated weights for policy 0, policy_version 1526593 (0.0006) [2023-12-28 06:14:00,445][106225] Updated weights for policy 1, policy_version 1530388 (0.0010) [2023-12-28 06:14:00,470][106226] Updated weights for policy 0, policy_version 1526603 (0.0006) [2023-12-28 06:14:00,522][106226] Updated weights for policy 0, policy_version 1526613 (0.0008) [2023-12-28 06:14:01,153][106225] Updated weights for policy 1, policy_version 1530398 (0.0010) [2023-12-28 06:14:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 782721024. Throughput: 0: 9927.3, 1: 9997.5. Samples: 782715196. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:01,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.825')] [2023-12-28 06:14:01,214][106225] Updated weights for policy 1, policy_version 1530408 (0.0007) [2023-12-28 06:14:01,274][106225] Updated weights for policy 1, policy_version 1530418 (0.0008) [2023-12-28 06:14:01,291][106226] Updated weights for policy 0, policy_version 1526623 (0.0007) [2023-12-28 06:14:01,347][106226] Updated weights for policy 0, policy_version 1526633 (0.0009) [2023-12-28 06:14:01,414][106226] Updated weights for policy 0, policy_version 1526643 (0.0008) [2023-12-28 06:14:02,024][106225] Updated weights for policy 1, policy_version 1530428 (0.0007) [2023-12-28 06:14:02,083][106225] Updated weights for policy 1, policy_version 1530438 (0.0009) [2023-12-28 06:14:02,144][106225] Updated weights for policy 1, policy_version 1530448 (0.0008) [2023-12-28 06:14:02,165][106226] Updated weights for policy 0, policy_version 1526653 (0.0007) [2023-12-28 06:14:02,226][106226] Updated weights for policy 0, policy_version 1526663 (0.0008) [2023-12-28 06:14:02,287][106226] Updated weights for policy 0, policy_version 1526673 (0.0007) [2023-12-28 06:14:02,897][106225] Updated weights for policy 1, policy_version 1530458 (0.0005) [2023-12-28 06:14:02,960][106226] Updated weights for policy 0, policy_version 1526683 (0.0008) [2023-12-28 06:14:02,966][106225] Updated weights for policy 1, policy_version 1530468 (0.0007) [2023-12-28 06:14:03,010][106226] Updated weights for policy 0, policy_version 1526693 (0.0005) [2023-12-28 06:14:03,027][106225] Updated weights for policy 1, policy_version 1530478 (0.0008) [2023-12-28 06:14:03,072][106226] Updated weights for policy 0, policy_version 1526703 (0.0005) [2023-12-28 06:14:03,090][106225] Updated weights for policy 1, policy_version 1530488 (0.0008) [2023-12-28 06:14:03,686][106226] Updated weights for policy 0, policy_version 1526713 (0.0007) [2023-12-28 06:14:03,739][106226] Updated weights for policy 0, policy_version 1526723 (0.0008) [2023-12-28 06:14:03,789][106225] Updated weights for policy 1, policy_version 1530498 (0.0008) [2023-12-28 06:14:03,796][106226] Updated weights for policy 0, policy_version 1526733 (0.0005) [2023-12-28 06:14:03,854][106225] Updated weights for policy 1, policy_version 1530508 (0.0006) [2023-12-28 06:14:03,862][106226] Updated weights for policy 0, policy_version 1526743 (0.0006) [2023-12-28 06:14:03,910][106225] Updated weights for policy 1, policy_version 1530518 (0.0009) [2023-12-28 06:14:04,574][106226] Updated weights for policy 0, policy_version 1526753 (0.0010) [2023-12-28 06:14:04,634][106225] Updated weights for policy 1, policy_version 1530528 (0.0006) [2023-12-28 06:14:04,634][106226] Updated weights for policy 0, policy_version 1526763 (0.0008) [2023-12-28 06:14:04,690][106226] Updated weights for policy 0, policy_version 1526773 (0.0007) [2023-12-28 06:14:04,693][106225] Updated weights for policy 1, policy_version 1530538 (0.0006) [2023-12-28 06:14:04,747][106225] Updated weights for policy 1, policy_version 1530548 (0.0008) [2023-12-28 06:14:05,319][106225] Updated weights for policy 1, policy_version 1530558 (0.0006) [2023-12-28 06:14:05,381][106225] Updated weights for policy 1, policy_version 1530568 (0.0009) [2023-12-28 06:14:05,430][106225] Updated weights for policy 1, policy_version 1530578 (0.0010) [2023-12-28 06:14:05,452][106226] Updated weights for policy 0, policy_version 1526783 (0.0006) [2023-12-28 06:14:05,500][106226] Updated weights for policy 0, policy_version 1526793 (0.0008) [2023-12-28 06:14:05,546][106226] Updated weights for policy 0, policy_version 1526803 (0.0008) [2023-12-28 06:14:06,059][106225] Updated weights for policy 1, policy_version 1530588 (0.0009) [2023-12-28 06:14:06,118][106225] Updated weights for policy 1, policy_version 1530598 (0.0010) [2023-12-28 06:14:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 782819328. Throughput: 0: 9917.5, 1: 9970.8. Samples: 782832216. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:06,175][105115] Avg episode reward: [(0, '-5.011'), (1, '-4.573')] [2023-12-28 06:14:06,176][106225] Updated weights for policy 1, policy_version 1530608 (0.0010) [2023-12-28 06:14:06,326][106226] Updated weights for policy 0, policy_version 1526813 (0.0008) [2023-12-28 06:14:06,389][106226] Updated weights for policy 0, policy_version 1526823 (0.0008) [2023-12-28 06:14:06,448][106226] Updated weights for policy 0, policy_version 1526833 (0.0008) [2023-12-28 06:14:06,880][106225] Updated weights for policy 1, policy_version 1530618 (0.0010) [2023-12-28 06:14:06,932][106225] Updated weights for policy 1, policy_version 1530628 (0.0008) [2023-12-28 06:14:06,988][106225] Updated weights for policy 1, policy_version 1530638 (0.0008) [2023-12-28 06:14:07,040][106225] Updated weights for policy 1, policy_version 1530648 (0.0008) [2023-12-28 06:14:07,184][106226] Updated weights for policy 0, policy_version 1526843 (0.0008) [2023-12-28 06:14:07,248][106226] Updated weights for policy 0, policy_version 1526853 (0.0010) [2023-12-28 06:14:07,308][106226] Updated weights for policy 0, policy_version 1526863 (0.0009) [2023-12-28 06:14:07,642][106225] Updated weights for policy 1, policy_version 1530658 (0.0008) [2023-12-28 06:14:07,693][106225] Updated weights for policy 1, policy_version 1530668 (0.0005) [2023-12-28 06:14:07,747][106225] Updated weights for policy 1, policy_version 1530678 (0.0007) [2023-12-28 06:14:08,096][106226] Updated weights for policy 0, policy_version 1526873 (0.0009) [2023-12-28 06:14:08,163][106226] Updated weights for policy 0, policy_version 1526883 (0.0009) [2023-12-28 06:14:08,226][106226] Updated weights for policy 0, policy_version 1526893 (0.0009) [2023-12-28 06:14:08,296][106226] Updated weights for policy 0, policy_version 1526903 (0.0008) [2023-12-28 06:14:08,393][106225] Updated weights for policy 1, policy_version 1530688 (0.0007) [2023-12-28 06:14:08,447][106225] Updated weights for policy 1, policy_version 1530698 (0.0010) [2023-12-28 06:14:08,502][106225] Updated weights for policy 1, policy_version 1530708 (0.0008) [2023-12-28 06:14:09,064][106226] Updated weights for policy 0, policy_version 1526913 (0.0009) [2023-12-28 06:14:09,114][106226] Updated weights for policy 0, policy_version 1526923 (0.0008) [2023-12-28 06:14:09,164][106225] Updated weights for policy 1, policy_version 1530718 (0.0008) [2023-12-28 06:14:09,166][106226] Updated weights for policy 0, policy_version 1526933 (0.0006) [2023-12-28 06:14:09,231][106225] Updated weights for policy 1, policy_version 1530728 (0.0008) [2023-12-28 06:14:09,295][106225] Updated weights for policy 1, policy_version 1530738 (0.0009) [2023-12-28 06:14:09,993][106226] Updated weights for policy 0, policy_version 1526943 (0.0008) [2023-12-28 06:14:10,052][106226] Updated weights for policy 0, policy_version 1526953 (0.0009) [2023-12-28 06:14:10,079][106225] Updated weights for policy 1, policy_version 1530748 (0.0008) [2023-12-28 06:14:10,114][106226] Updated weights for policy 0, policy_version 1526963 (0.0009) [2023-12-28 06:14:10,139][106225] Updated weights for policy 1, policy_version 1530758 (0.0006) [2023-12-28 06:14:10,202][106225] Updated weights for policy 1, policy_version 1530768 (0.0005) [2023-12-28 06:14:10,822][106225] Updated weights for policy 1, policy_version 1530778 (0.0006) [2023-12-28 06:14:10,874][106226] Updated weights for policy 0, policy_version 1526973 (0.0007) [2023-12-28 06:14:10,880][106225] Updated weights for policy 1, policy_version 1530788 (0.0007) [2023-12-28 06:14:10,929][106226] Updated weights for policy 0, policy_version 1526983 (0.0007) [2023-12-28 06:14:10,936][106225] Updated weights for policy 1, policy_version 1530798 (0.0007) [2023-12-28 06:14:10,988][106226] Updated weights for policy 0, policy_version 1526993 (0.0007) [2023-12-28 06:14:10,993][106225] Updated weights for policy 1, policy_version 1530808 (0.0006) [2023-12-28 06:14:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 782925824. Throughput: 0: 9890.2, 1: 10059.4. Samples: 782891404. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:11,175][105115] Avg episode reward: [(0, '-4.853'), (1, '-4.863')] [2023-12-28 06:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001530808_391938048.pth... [2023-12-28 06:14:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001527000_390987776.pth... [2023-12-28 06:14:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001525848_390692864.pth [2023-12-28 06:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001529624_391634944.pth [2023-12-28 06:14:11,749][106226] Updated weights for policy 0, policy_version 1527003 (0.0010) [2023-12-28 06:14:11,786][106225] Updated weights for policy 1, policy_version 1530818 (0.0007) [2023-12-28 06:14:11,821][106226] Updated weights for policy 0, policy_version 1527013 (0.0006) [2023-12-28 06:14:11,851][106225] Updated weights for policy 1, policy_version 1530828 (0.0009) [2023-12-28 06:14:11,892][106226] Updated weights for policy 0, policy_version 1527023 (0.0007) [2023-12-28 06:14:11,914][106225] Updated weights for policy 1, policy_version 1530838 (0.0009) [2023-12-28 06:14:12,612][106225] Updated weights for policy 1, policy_version 1530848 (0.0009) [2023-12-28 06:14:12,674][106226] Updated weights for policy 0, policy_version 1527033 (0.0007) [2023-12-28 06:14:12,676][106225] Updated weights for policy 1, policy_version 1530858 (0.0008) [2023-12-28 06:14:12,730][106225] Updated weights for policy 1, policy_version 1530868 (0.0007) [2023-12-28 06:14:12,734][106226] Updated weights for policy 0, policy_version 1527043 (0.0007) [2023-12-28 06:14:12,798][106226] Updated weights for policy 0, policy_version 1527053 (0.0008) [2023-12-28 06:14:12,846][106226] Updated weights for policy 0, policy_version 1527063 (0.0008) [2023-12-28 06:14:13,376][106225] Updated weights for policy 1, policy_version 1530878 (0.0007) [2023-12-28 06:14:13,425][106225] Updated weights for policy 1, policy_version 1530888 (0.0008) [2023-12-28 06:14:13,479][106225] Updated weights for policy 1, policy_version 1530898 (0.0008) [2023-12-28 06:14:13,617][106226] Updated weights for policy 0, policy_version 1527073 (0.0009) [2023-12-28 06:14:13,676][106226] Updated weights for policy 0, policy_version 1527083 (0.0007) [2023-12-28 06:14:13,752][106226] Updated weights for policy 0, policy_version 1527093 (0.0010) [2023-12-28 06:14:14,111][106225] Updated weights for policy 1, policy_version 1530908 (0.0008) [2023-12-28 06:14:14,163][106225] Updated weights for policy 1, policy_version 1530918 (0.0008) [2023-12-28 06:14:14,208][106225] Updated weights for policy 1, policy_version 1530928 (0.0008) [2023-12-28 06:14:14,507][106226] Updated weights for policy 0, policy_version 1527103 (0.0009) [2023-12-28 06:14:14,569][106226] Updated weights for policy 0, policy_version 1527113 (0.0010) [2023-12-28 06:14:14,631][106226] Updated weights for policy 0, policy_version 1527123 (0.0008) [2023-12-28 06:14:14,953][106225] Updated weights for policy 1, policy_version 1530938 (0.0009) [2023-12-28 06:14:15,013][106225] Updated weights for policy 1, policy_version 1530948 (0.0009) [2023-12-28 06:14:15,069][106225] Updated weights for policy 1, policy_version 1530958 (0.0009) [2023-12-28 06:14:15,133][106225] Updated weights for policy 1, policy_version 1530968 (0.0009) [2023-12-28 06:14:15,283][106226] Updated weights for policy 0, policy_version 1527133 (0.0008) [2023-12-28 06:14:15,348][106226] Updated weights for policy 0, policy_version 1527143 (0.0009) [2023-12-28 06:14:15,416][106226] Updated weights for policy 0, policy_version 1527153 (0.0009) [2023-12-28 06:14:15,872][106225] Updated weights for policy 1, policy_version 1530978 (0.0009) [2023-12-28 06:14:15,929][106225] Updated weights for policy 1, policy_version 1530988 (0.0008) [2023-12-28 06:14:15,988][106225] Updated weights for policy 1, policy_version 1530998 (0.0007) [2023-12-28 06:14:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 783015936. Throughput: 0: 9753.3, 1: 10041.9. Samples: 783007124. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:16,175][105115] Avg episode reward: [(0, '-4.850'), (1, '-4.804')] [2023-12-28 06:14:16,180][106226] Updated weights for policy 0, policy_version 1527163 (0.0009) [2023-12-28 06:14:16,229][106226] Updated weights for policy 0, policy_version 1527173 (0.0009) [2023-12-28 06:14:16,290][106226] Updated weights for policy 0, policy_version 1527183 (0.0010) [2023-12-28 06:14:16,609][106225] Updated weights for policy 1, policy_version 1531008 (0.0007) [2023-12-28 06:14:16,669][106225] Updated weights for policy 1, policy_version 1531018 (0.0009) [2023-12-28 06:14:16,729][106225] Updated weights for policy 1, policy_version 1531028 (0.0009) [2023-12-28 06:14:16,956][106226] Updated weights for policy 0, policy_version 1527193 (0.0008) [2023-12-28 06:14:17,021][106226] Updated weights for policy 0, policy_version 1527203 (0.0005) [2023-12-28 06:14:17,074][106226] Updated weights for policy 0, policy_version 1527213 (0.0008) [2023-12-28 06:14:17,133][106226] Updated weights for policy 0, policy_version 1527223 (0.0007) [2023-12-28 06:14:17,535][106225] Updated weights for policy 1, policy_version 1531038 (0.0008) [2023-12-28 06:14:17,592][106225] Updated weights for policy 1, policy_version 1531048 (0.0008) [2023-12-28 06:14:17,654][106225] Updated weights for policy 1, policy_version 1531058 (0.0008) [2023-12-28 06:14:17,737][106226] Updated weights for policy 0, policy_version 1527233 (0.0010) [2023-12-28 06:14:17,801][106226] Updated weights for policy 0, policy_version 1527243 (0.0011) [2023-12-28 06:14:17,862][106226] Updated weights for policy 0, policy_version 1527253 (0.0005) [2023-12-28 06:14:18,428][106225] Updated weights for policy 1, policy_version 1531068 (0.0008) [2023-12-28 06:14:18,483][106225] Updated weights for policy 1, policy_version 1531078 (0.0007) [2023-12-28 06:14:18,533][106225] Updated weights for policy 1, policy_version 1531088 (0.0008) [2023-12-28 06:14:18,555][106226] Updated weights for policy 0, policy_version 1527263 (0.0010) [2023-12-28 06:14:18,615][106226] Updated weights for policy 0, policy_version 1527273 (0.0011) [2023-12-28 06:14:18,677][106226] Updated weights for policy 0, policy_version 1527283 (0.0011) [2023-12-28 06:14:19,286][106225] Updated weights for policy 1, policy_version 1531098 (0.0006) [2023-12-28 06:14:19,341][106225] Updated weights for policy 1, policy_version 1531108 (0.0008) [2023-12-28 06:14:19,408][106226] Updated weights for policy 0, policy_version 1527293 (0.0010) [2023-12-28 06:14:19,409][106225] Updated weights for policy 1, policy_version 1531118 (0.0008) [2023-12-28 06:14:19,468][106226] Updated weights for policy 0, policy_version 1527303 (0.0008) [2023-12-28 06:14:19,471][106225] Updated weights for policy 1, policy_version 1531128 (0.0006) [2023-12-28 06:14:19,530][106226] Updated weights for policy 0, policy_version 1527313 (0.0008) [2023-12-28 06:14:20,221][106226] Updated weights for policy 0, policy_version 1527323 (0.0008) [2023-12-28 06:14:20,273][106225] Updated weights for policy 1, policy_version 1531138 (0.0009) [2023-12-28 06:14:20,278][106226] Updated weights for policy 0, policy_version 1527333 (0.0006) [2023-12-28 06:14:20,335][106226] Updated weights for policy 0, policy_version 1527343 (0.0006) [2023-12-28 06:14:20,337][106225] Updated weights for policy 1, policy_version 1531148 (0.0008) [2023-12-28 06:14:20,394][106225] Updated weights for policy 1, policy_version 1531158 (0.0007) [2023-12-28 06:14:20,967][106226] Updated weights for policy 0, policy_version 1527353 (0.0007) [2023-12-28 06:14:21,030][106226] Updated weights for policy 0, policy_version 1527363 (0.0006) [2023-12-28 06:14:21,098][106226] Updated weights for policy 0, policy_version 1527373 (0.0008) [2023-12-28 06:14:21,160][106226] Updated weights for policy 0, policy_version 1527383 (0.0008) [2023-12-28 06:14:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 783114240. Throughput: 0: 9726.1, 1: 9932.2. Samples: 783122532. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:21,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.832')] [2023-12-28 06:14:21,224][106225] Updated weights for policy 1, policy_version 1531168 (0.0008) [2023-12-28 06:14:21,289][106225] Updated weights for policy 1, policy_version 1531178 (0.0008) [2023-12-28 06:14:21,355][106225] Updated weights for policy 1, policy_version 1531188 (0.0009) [2023-12-28 06:14:21,860][106226] Updated weights for policy 0, policy_version 1527393 (0.0006) [2023-12-28 06:14:21,927][106226] Updated weights for policy 0, policy_version 1527403 (0.0008) [2023-12-28 06:14:21,992][106226] Updated weights for policy 0, policy_version 1527413 (0.0009) [2023-12-28 06:14:22,110][106225] Updated weights for policy 1, policy_version 1531198 (0.0009) [2023-12-28 06:14:22,175][106225] Updated weights for policy 1, policy_version 1531208 (0.0007) [2023-12-28 06:14:22,237][106225] Updated weights for policy 1, policy_version 1531218 (0.0006) [2023-12-28 06:14:22,707][106226] Updated weights for policy 0, policy_version 1527423 (0.0007) [2023-12-28 06:14:22,773][106226] Updated weights for policy 0, policy_version 1527433 (0.0008) [2023-12-28 06:14:22,840][106226] Updated weights for policy 0, policy_version 1527443 (0.0009) [2023-12-28 06:14:23,003][106225] Updated weights for policy 1, policy_version 1531228 (0.0009) [2023-12-28 06:14:23,061][106225] Updated weights for policy 1, policy_version 1531238 (0.0009) [2023-12-28 06:14:23,123][106225] Updated weights for policy 1, policy_version 1531248 (0.0009) [2023-12-28 06:14:23,452][106226] Updated weights for policy 0, policy_version 1527453 (0.0008) [2023-12-28 06:14:23,500][106226] Updated weights for policy 0, policy_version 1527463 (0.0008) [2023-12-28 06:14:23,555][106226] Updated weights for policy 0, policy_version 1527473 (0.0009) [2023-12-28 06:14:23,886][106225] Updated weights for policy 1, policy_version 1531258 (0.0009) [2023-12-28 06:14:23,946][106225] Updated weights for policy 1, policy_version 1531268 (0.0010) [2023-12-28 06:14:24,026][106225] Updated weights for policy 1, policy_version 1531278 (0.0010) [2023-12-28 06:14:24,079][106225] Updated weights for policy 1, policy_version 1531288 (0.0010) [2023-12-28 06:14:24,311][106226] Updated weights for policy 0, policy_version 1527483 (0.0009) [2023-12-28 06:14:24,358][106226] Updated weights for policy 0, policy_version 1527493 (0.0008) [2023-12-28 06:14:24,405][106226] Updated weights for policy 0, policy_version 1527503 (0.0008) [2023-12-28 06:14:24,732][106225] Updated weights for policy 1, policy_version 1531298 (0.0007) [2023-12-28 06:14:24,785][106225] Updated weights for policy 1, policy_version 1531308 (0.0005) [2023-12-28 06:14:24,837][106225] Updated weights for policy 1, policy_version 1531318 (0.0005) [2023-12-28 06:14:25,199][106226] Updated weights for policy 0, policy_version 1527513 (0.0008) [2023-12-28 06:14:25,256][106226] Updated weights for policy 0, policy_version 1527523 (0.0007) [2023-12-28 06:14:25,310][106226] Updated weights for policy 0, policy_version 1527533 (0.0005) [2023-12-28 06:14:25,360][106226] Updated weights for policy 0, policy_version 1527543 (0.0009) [2023-12-28 06:14:25,460][106225] Updated weights for policy 1, policy_version 1531328 (0.0005) [2023-12-28 06:14:25,521][106225] Updated weights for policy 1, policy_version 1531338 (0.0005) [2023-12-28 06:14:25,582][106225] Updated weights for policy 1, policy_version 1531348 (0.0006) [2023-12-28 06:14:26,089][106226] Updated weights for policy 0, policy_version 1527553 (0.0009) [2023-12-28 06:14:26,153][106226] Updated weights for policy 0, policy_version 1527563 (0.0008) [2023-12-28 06:14:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 783204352. Throughput: 0: 9685.8, 1: 9812.9. Samples: 783178840. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:26,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.450')] [2023-12-28 06:14:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001531352_392077312.pth... [2023-12-28 06:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001530200_391782400.pth [2023-12-28 06:14:26,206][106226] Updated weights for policy 0, policy_version 1527573 (0.0008) [2023-12-28 06:14:26,217][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001527576_391135232.pth... [2023-12-28 06:14:26,220][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001526456_390848512.pth [2023-12-28 06:14:26,242][106225] Updated weights for policy 1, policy_version 1531358 (0.0009) [2023-12-28 06:14:26,294][106225] Updated weights for policy 1, policy_version 1531368 (0.0008) [2023-12-28 06:14:26,353][106225] Updated weights for policy 1, policy_version 1531378 (0.0009) [2023-12-28 06:14:26,916][106226] Updated weights for policy 0, policy_version 1527583 (0.0008) [2023-12-28 06:14:26,967][106226] Updated weights for policy 0, policy_version 1527593 (0.0008) [2023-12-28 06:14:26,971][106225] Updated weights for policy 1, policy_version 1531388 (0.0008) [2023-12-28 06:14:27,024][106226] Updated weights for policy 0, policy_version 1527603 (0.0008) [2023-12-28 06:14:27,028][106225] Updated weights for policy 1, policy_version 1531398 (0.0005) [2023-12-28 06:14:27,083][106225] Updated weights for policy 1, policy_version 1531408 (0.0005) [2023-12-28 06:14:27,648][106225] Updated weights for policy 1, policy_version 1531418 (0.0005) [2023-12-28 06:14:27,706][106225] Updated weights for policy 1, policy_version 1531428 (0.0005) [2023-12-28 06:14:27,772][106225] Updated weights for policy 1, policy_version 1531438 (0.0008) [2023-12-28 06:14:27,802][106226] Updated weights for policy 0, policy_version 1527613 (0.0008) [2023-12-28 06:14:27,829][106225] Updated weights for policy 1, policy_version 1531448 (0.0009) [2023-12-28 06:14:27,862][106226] Updated weights for policy 0, policy_version 1527623 (0.0007) [2023-12-28 06:14:27,925][106226] Updated weights for policy 0, policy_version 1527633 (0.0007) [2023-12-28 06:14:28,515][106225] Updated weights for policy 1, policy_version 1531458 (0.0010) [2023-12-28 06:14:28,572][106225] Updated weights for policy 1, policy_version 1531468 (0.0011) [2023-12-28 06:14:28,627][106225] Updated weights for policy 1, policy_version 1531478 (0.0010) [2023-12-28 06:14:28,682][106226] Updated weights for policy 0, policy_version 1527643 (0.0008) [2023-12-28 06:14:28,735][106226] Updated weights for policy 0, policy_version 1527653 (0.0008) [2023-12-28 06:14:28,788][106226] Updated weights for policy 0, policy_version 1527663 (0.0007) [2023-12-28 06:14:29,386][106225] Updated weights for policy 1, policy_version 1531488 (0.0009) [2023-12-28 06:14:29,440][106225] Updated weights for policy 1, policy_version 1531498 (0.0007) [2023-12-28 06:14:29,487][106225] Updated weights for policy 1, policy_version 1531508 (0.0007) [2023-12-28 06:14:29,535][106226] Updated weights for policy 0, policy_version 1527673 (0.0008) [2023-12-28 06:14:29,597][106226] Updated weights for policy 0, policy_version 1527683 (0.0009) [2023-12-28 06:14:29,649][106226] Updated weights for policy 0, policy_version 1527693 (0.0008) [2023-12-28 06:14:29,700][106226] Updated weights for policy 0, policy_version 1527703 (0.0008) [2023-12-28 06:14:30,194][106225] Updated weights for policy 1, policy_version 1531518 (0.0008) [2023-12-28 06:14:30,250][106225] Updated weights for policy 1, policy_version 1531528 (0.0009) [2023-12-28 06:14:30,310][106225] Updated weights for policy 1, policy_version 1531538 (0.0009) [2023-12-28 06:14:30,436][106226] Updated weights for policy 0, policy_version 1527713 (0.0009) [2023-12-28 06:14:30,498][106226] Updated weights for policy 0, policy_version 1527723 (0.0008) [2023-12-28 06:14:30,560][106226] Updated weights for policy 0, policy_version 1527733 (0.0008) [2023-12-28 06:14:30,982][106225] Updated weights for policy 1, policy_version 1531548 (0.0008) [2023-12-28 06:14:31,033][106225] Updated weights for policy 1, policy_version 1531558 (0.0007) [2023-12-28 06:14:31,095][106225] Updated weights for policy 1, policy_version 1531568 (0.0008) [2023-12-28 06:14:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783310848. Throughput: 0: 9691.8, 1: 9873.2. Samples: 783297648. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:31,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.882')] [2023-12-28 06:14:31,292][106226] Updated weights for policy 0, policy_version 1527743 (0.0009) [2023-12-28 06:14:31,361][106226] Updated weights for policy 0, policy_version 1527753 (0.0009) [2023-12-28 06:14:31,426][106226] Updated weights for policy 0, policy_version 1527763 (0.0007) [2023-12-28 06:14:31,848][106225] Updated weights for policy 1, policy_version 1531578 (0.0008) [2023-12-28 06:14:31,908][106225] Updated weights for policy 1, policy_version 1531588 (0.0008) [2023-12-28 06:14:31,968][106225] Updated weights for policy 1, policy_version 1531598 (0.0009) [2023-12-28 06:14:32,029][106225] Updated weights for policy 1, policy_version 1531608 (0.0008) [2023-12-28 06:14:32,089][106226] Updated weights for policy 0, policy_version 1527773 (0.0007) [2023-12-28 06:14:32,150][106226] Updated weights for policy 0, policy_version 1527783 (0.0008) [2023-12-28 06:14:32,210][106226] Updated weights for policy 0, policy_version 1527793 (0.0008) [2023-12-28 06:14:32,755][106225] Updated weights for policy 1, policy_version 1531618 (0.0006) [2023-12-28 06:14:32,814][106225] Updated weights for policy 1, policy_version 1531628 (0.0009) [2023-12-28 06:14:32,874][106225] Updated weights for policy 1, policy_version 1531638 (0.0007) [2023-12-28 06:14:32,890][106226] Updated weights for policy 0, policy_version 1527803 (0.0007) [2023-12-28 06:14:32,947][106226] Updated weights for policy 0, policy_version 1527813 (0.0005) [2023-12-28 06:14:33,000][106226] Updated weights for policy 0, policy_version 1527823 (0.0005) [2023-12-28 06:14:33,477][106225] Updated weights for policy 1, policy_version 1531648 (0.0006) [2023-12-28 06:14:33,547][106225] Updated weights for policy 1, policy_version 1531658 (0.0006) [2023-12-28 06:14:33,568][106226] Updated weights for policy 0, policy_version 1527833 (0.0005) [2023-12-28 06:14:33,615][106225] Updated weights for policy 1, policy_version 1531668 (0.0006) [2023-12-28 06:14:33,625][106226] Updated weights for policy 0, policy_version 1527843 (0.0007) [2023-12-28 06:14:33,677][106226] Updated weights for policy 0, policy_version 1527853 (0.0006) [2023-12-28 06:14:33,727][106226] Updated weights for policy 0, policy_version 1527863 (0.0007) [2023-12-28 06:14:34,303][106225] Updated weights for policy 1, policy_version 1531678 (0.0008) [2023-12-28 06:14:34,350][106225] Updated weights for policy 1, policy_version 1531688 (0.0007) [2023-12-28 06:14:34,409][106225] Updated weights for policy 1, policy_version 1531698 (0.0006) [2023-12-28 06:14:34,413][106226] Updated weights for policy 0, policy_version 1527873 (0.0011) [2023-12-28 06:14:34,479][106226] Updated weights for policy 0, policy_version 1527883 (0.0011) [2023-12-28 06:14:34,541][106226] Updated weights for policy 0, policy_version 1527893 (0.0011) [2023-12-28 06:14:35,157][106225] Updated weights for policy 1, policy_version 1531708 (0.0009) [2023-12-28 06:14:35,204][106225] Updated weights for policy 1, policy_version 1531718 (0.0010) [2023-12-28 06:14:35,251][106226] Updated weights for policy 0, policy_version 1527903 (0.0011) [2023-12-28 06:14:35,257][106225] Updated weights for policy 1, policy_version 1531728 (0.0010) [2023-12-28 06:14:35,306][106226] Updated weights for policy 0, policy_version 1527913 (0.0010) [2023-12-28 06:14:35,359][106226] Updated weights for policy 0, policy_version 1527923 (0.0010) [2023-12-28 06:14:35,915][106226] Updated weights for policy 0, policy_version 1527933 (0.0011) [2023-12-28 06:14:35,965][106226] Updated weights for policy 0, policy_version 1527943 (0.0010) [2023-12-28 06:14:35,994][106225] Updated weights for policy 1, policy_version 1531738 (0.0010) [2023-12-28 06:14:36,019][106226] Updated weights for policy 0, policy_version 1527953 (0.0010) [2023-12-28 06:14:36,044][106225] Updated weights for policy 1, policy_version 1531748 (0.0010) [2023-12-28 06:14:36,098][106225] Updated weights for policy 1, policy_version 1531758 (0.0010) [2023-12-28 06:14:36,162][106225] Updated weights for policy 1, policy_version 1531768 (0.0009) [2023-12-28 06:14:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 783417344. Throughput: 0: 9675.6, 1: 9905.2. Samples: 783419128. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:36,175][105115] Avg episode reward: [(0, '-4.911'), (1, '-4.537')] [2023-12-28 06:14:36,664][106226] Updated weights for policy 0, policy_version 1527963 (0.0010) [2023-12-28 06:14:36,728][106226] Updated weights for policy 0, policy_version 1527973 (0.0011) [2023-12-28 06:14:36,789][106226] Updated weights for policy 0, policy_version 1527983 (0.0011) [2023-12-28 06:14:36,911][106225] Updated weights for policy 1, policy_version 1531778 (0.0006) [2023-12-28 06:14:36,969][106225] Updated weights for policy 1, policy_version 1531788 (0.0009) [2023-12-28 06:14:37,031][106225] Updated weights for policy 1, policy_version 1531798 (0.0010) [2023-12-28 06:14:37,467][106226] Updated weights for policy 0, policy_version 1527993 (0.0010) [2023-12-28 06:14:37,523][106226] Updated weights for policy 0, policy_version 1528003 (0.0006) [2023-12-28 06:14:37,577][106226] Updated weights for policy 0, policy_version 1528013 (0.0007) [2023-12-28 06:14:37,637][106226] Updated weights for policy 0, policy_version 1528023 (0.0009) [2023-12-28 06:14:37,723][106225] Updated weights for policy 1, policy_version 1531808 (0.0008) [2023-12-28 06:14:37,789][106225] Updated weights for policy 1, policy_version 1531818 (0.0005) [2023-12-28 06:14:37,847][106225] Updated weights for policy 1, policy_version 1531828 (0.0005) [2023-12-28 06:14:38,310][106226] Updated weights for policy 0, policy_version 1528033 (0.0008) [2023-12-28 06:14:38,381][106226] Updated weights for policy 0, policy_version 1528043 (0.0008) [2023-12-28 06:14:38,438][106226] Updated weights for policy 0, policy_version 1528053 (0.0008) [2023-12-28 06:14:38,552][106225] Updated weights for policy 1, policy_version 1531838 (0.0008) [2023-12-28 06:14:38,612][106225] Updated weights for policy 1, policy_version 1531848 (0.0009) [2023-12-28 06:14:38,670][106225] Updated weights for policy 1, policy_version 1531858 (0.0008) [2023-12-28 06:14:39,173][106226] Updated weights for policy 0, policy_version 1528063 (0.0008) [2023-12-28 06:14:39,244][106226] Updated weights for policy 0, policy_version 1528073 (0.0008) [2023-12-28 06:14:39,312][106226] Updated weights for policy 0, policy_version 1528083 (0.0007) [2023-12-28 06:14:39,496][106225] Updated weights for policy 1, policy_version 1531868 (0.0008) [2023-12-28 06:14:39,564][106225] Updated weights for policy 1, policy_version 1531878 (0.0010) [2023-12-28 06:14:39,631][106225] Updated weights for policy 1, policy_version 1531888 (0.0008) [2023-12-28 06:14:40,026][106226] Updated weights for policy 0, policy_version 1528093 (0.0009) [2023-12-28 06:14:40,088][106226] Updated weights for policy 0, policy_version 1528103 (0.0006) [2023-12-28 06:14:40,147][106226] Updated weights for policy 0, policy_version 1528113 (0.0008) [2023-12-28 06:14:40,411][106225] Updated weights for policy 1, policy_version 1531898 (0.0008) [2023-12-28 06:14:40,460][106225] Updated weights for policy 1, policy_version 1531908 (0.0008) [2023-12-28 06:14:40,512][106225] Updated weights for policy 1, policy_version 1531918 (0.0005) [2023-12-28 06:14:40,570][106225] Updated weights for policy 1, policy_version 1531928 (0.0009) [2023-12-28 06:14:40,850][106226] Updated weights for policy 0, policy_version 1528123 (0.0008) [2023-12-28 06:14:40,915][106226] Updated weights for policy 0, policy_version 1528133 (0.0005) [2023-12-28 06:14:40,982][106226] Updated weights for policy 0, policy_version 1528143 (0.0006) [2023-12-28 06:14:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783507456. Throughput: 0: 9697.5, 1: 9914.9. Samples: 783478836. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:41,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.402')] [2023-12-28 06:14:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001531928_392224768.pth... [2023-12-28 06:14:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001528152_391282688.pth... [2023-12-28 06:14:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001527000_390987776.pth [2023-12-28 06:14:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001530808_391938048.pth [2023-12-28 06:14:41,348][106225] Updated weights for policy 1, policy_version 1531938 (0.0008) [2023-12-28 06:14:41,418][106225] Updated weights for policy 1, policy_version 1531948 (0.0007) [2023-12-28 06:14:41,484][106225] Updated weights for policy 1, policy_version 1531958 (0.0006) [2023-12-28 06:14:41,686][106226] Updated weights for policy 0, policy_version 1528153 (0.0009) [2023-12-28 06:14:41,759][106226] Updated weights for policy 0, policy_version 1528163 (0.0008) [2023-12-28 06:14:41,819][106226] Updated weights for policy 0, policy_version 1528173 (0.0009) [2023-12-28 06:14:41,877][106226] Updated weights for policy 0, policy_version 1528183 (0.0009) [2023-12-28 06:14:42,207][106225] Updated weights for policy 1, policy_version 1531968 (0.0009) [2023-12-28 06:14:42,273][106225] Updated weights for policy 1, policy_version 1531978 (0.0008) [2023-12-28 06:14:42,334][106225] Updated weights for policy 1, policy_version 1531988 (0.0009) [2023-12-28 06:14:42,578][106226] Updated weights for policy 0, policy_version 1528193 (0.0009) [2023-12-28 06:14:42,631][106226] Updated weights for policy 0, policy_version 1528203 (0.0008) [2023-12-28 06:14:42,702][106226] Updated weights for policy 0, policy_version 1528213 (0.0009) [2023-12-28 06:14:43,128][106225] Updated weights for policy 1, policy_version 1531998 (0.0008) [2023-12-28 06:14:43,187][106225] Updated weights for policy 1, policy_version 1532008 (0.0009) [2023-12-28 06:14:43,249][106225] Updated weights for policy 1, policy_version 1532018 (0.0008) [2023-12-28 06:14:43,355][106226] Updated weights for policy 0, policy_version 1528223 (0.0009) [2023-12-28 06:14:43,408][106226] Updated weights for policy 0, policy_version 1528233 (0.0009) [2023-12-28 06:14:43,462][106226] Updated weights for policy 0, policy_version 1528243 (0.0008) [2023-12-28 06:14:43,971][106225] Updated weights for policy 1, policy_version 1532028 (0.0009) [2023-12-28 06:14:44,019][106225] Updated weights for policy 1, policy_version 1532038 (0.0006) [2023-12-28 06:14:44,084][106225] Updated weights for policy 1, policy_version 1532048 (0.0008) [2023-12-28 06:14:44,168][106226] Updated weights for policy 0, policy_version 1528253 (0.0008) [2023-12-28 06:14:44,227][106226] Updated weights for policy 0, policy_version 1528263 (0.0009) [2023-12-28 06:14:44,278][106226] Updated weights for policy 0, policy_version 1528273 (0.0008) [2023-12-28 06:14:44,776][106225] Updated weights for policy 1, policy_version 1532058 (0.0008) [2023-12-28 06:14:44,847][106225] Updated weights for policy 1, policy_version 1532068 (0.0007) [2023-12-28 06:14:44,906][106225] Updated weights for policy 1, policy_version 1532078 (0.0007) [2023-12-28 06:14:44,968][106225] Updated weights for policy 1, policy_version 1532088 (0.0005) [2023-12-28 06:14:45,032][106226] Updated weights for policy 0, policy_version 1528283 (0.0008) [2023-12-28 06:14:45,101][106226] Updated weights for policy 0, policy_version 1528293 (0.0010) [2023-12-28 06:14:45,168][106226] Updated weights for policy 0, policy_version 1528303 (0.0006) [2023-12-28 06:14:45,630][106225] Updated weights for policy 1, policy_version 1532098 (0.0010) [2023-12-28 06:14:45,690][106225] Updated weights for policy 1, policy_version 1532108 (0.0006) [2023-12-28 06:14:45,746][106225] Updated weights for policy 1, policy_version 1532118 (0.0005) [2023-12-28 06:14:45,769][106226] Updated weights for policy 0, policy_version 1528313 (0.0006) [2023-12-28 06:14:45,840][106226] Updated weights for policy 0, policy_version 1528323 (0.0006) [2023-12-28 06:14:45,899][106226] Updated weights for policy 0, policy_version 1528333 (0.0009) [2023-12-28 06:14:45,966][106226] Updated weights for policy 0, policy_version 1528343 (0.0007) [2023-12-28 06:14:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783605760. Throughput: 0: 9711.9, 1: 9790.0. Samples: 783592784. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:46,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.829')] [2023-12-28 06:14:46,460][106225] Updated weights for policy 1, policy_version 1532128 (0.0009) [2023-12-28 06:14:46,516][106225] Updated weights for policy 1, policy_version 1532138 (0.0006) [2023-12-28 06:14:46,579][106225] Updated weights for policy 1, policy_version 1532148 (0.0009) [2023-12-28 06:14:46,597][106226] Updated weights for policy 0, policy_version 1528353 (0.0008) [2023-12-28 06:14:46,653][106226] Updated weights for policy 0, policy_version 1528363 (0.0010) [2023-12-28 06:14:46,716][106226] Updated weights for policy 0, policy_version 1528373 (0.0010) [2023-12-28 06:14:47,297][106225] Updated weights for policy 1, policy_version 1532158 (0.0010) [2023-12-28 06:14:47,350][106225] Updated weights for policy 1, policy_version 1532169 (0.0009) [2023-12-28 06:14:47,367][106226] Updated weights for policy 0, policy_version 1528383 (0.0007) [2023-12-28 06:14:47,406][106225] Updated weights for policy 1, policy_version 1532179 (0.0008) [2023-12-28 06:14:47,423][106226] Updated weights for policy 0, policy_version 1528393 (0.0005) [2023-12-28 06:14:47,469][106226] Updated weights for policy 0, policy_version 1528403 (0.0005) [2023-12-28 06:14:48,020][106226] Updated weights for policy 0, policy_version 1528413 (0.0006) [2023-12-28 06:14:48,082][106226] Updated weights for policy 0, policy_version 1528423 (0.0006) [2023-12-28 06:14:48,121][106225] Updated weights for policy 1, policy_version 1532189 (0.0007) [2023-12-28 06:14:48,147][106226] Updated weights for policy 0, policy_version 1528433 (0.0006) [2023-12-28 06:14:48,168][106225] Updated weights for policy 1, policy_version 1532199 (0.0005) [2023-12-28 06:14:48,212][106225] Updated weights for policy 1, policy_version 1532209 (0.0006) [2023-12-28 06:14:48,793][106226] Updated weights for policy 0, policy_version 1528443 (0.0008) [2023-12-28 06:14:48,856][106226] Updated weights for policy 0, policy_version 1528453 (0.0008) [2023-12-28 06:14:48,913][106226] Updated weights for policy 0, policy_version 1528463 (0.0007) [2023-12-28 06:14:49,011][106225] Updated weights for policy 1, policy_version 1532219 (0.0009) [2023-12-28 06:14:49,066][106225] Updated weights for policy 1, policy_version 1532229 (0.0008) [2023-12-28 06:14:49,127][106225] Updated weights for policy 1, policy_version 1532239 (0.0008) [2023-12-28 06:14:49,616][106226] Updated weights for policy 0, policy_version 1528473 (0.0007) [2023-12-28 06:14:49,672][106226] Updated weights for policy 0, policy_version 1528483 (0.0009) [2023-12-28 06:14:49,719][106226] Updated weights for policy 0, policy_version 1528493 (0.0006) [2023-12-28 06:14:49,778][106226] Updated weights for policy 0, policy_version 1528503 (0.0007) [2023-12-28 06:14:49,889][106225] Updated weights for policy 1, policy_version 1532249 (0.0008) [2023-12-28 06:14:49,945][106225] Updated weights for policy 1, policy_version 1532259 (0.0008) [2023-12-28 06:14:50,009][106225] Updated weights for policy 1, policy_version 1532269 (0.0007) [2023-12-28 06:14:50,066][106225] Updated weights for policy 1, policy_version 1532279 (0.0006) [2023-12-28 06:14:50,565][106226] Updated weights for policy 0, policy_version 1528513 (0.0009) [2023-12-28 06:14:50,634][106226] Updated weights for policy 0, policy_version 1528523 (0.0008) [2023-12-28 06:14:50,705][106226] Updated weights for policy 0, policy_version 1528533 (0.0008) [2023-12-28 06:14:50,734][106225] Updated weights for policy 1, policy_version 1532289 (0.0007) [2023-12-28 06:14:50,799][106225] Updated weights for policy 1, policy_version 1532299 (0.0008) [2023-12-28 06:14:50,858][106225] Updated weights for policy 1, policy_version 1532309 (0.0008) [2023-12-28 06:14:51,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783704064. Throughput: 0: 9797.8, 1: 9767.6. Samples: 783712656. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:51,179][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.667')] [2023-12-28 06:14:51,502][106226] Updated weights for policy 0, policy_version 1528543 (0.0008) [2023-12-28 06:14:51,554][106226] Updated weights for policy 0, policy_version 1528553 (0.0007) [2023-12-28 06:14:51,614][106226] Updated weights for policy 0, policy_version 1528563 (0.0006) [2023-12-28 06:14:51,629][106225] Updated weights for policy 1, policy_version 1532319 (0.0008) [2023-12-28 06:14:51,690][106225] Updated weights for policy 1, policy_version 1532329 (0.0008) [2023-12-28 06:14:51,753][106225] Updated weights for policy 1, policy_version 1532339 (0.0009) [2023-12-28 06:14:52,232][106226] Updated weights for policy 0, policy_version 1528573 (0.0008) [2023-12-28 06:14:52,297][106226] Updated weights for policy 0, policy_version 1528583 (0.0008) [2023-12-28 06:14:52,354][106226] Updated weights for policy 0, policy_version 1528593 (0.0009) [2023-12-28 06:14:52,561][106225] Updated weights for policy 1, policy_version 1532349 (0.0009) [2023-12-28 06:14:52,624][106225] Updated weights for policy 1, policy_version 1532359 (0.0008) [2023-12-28 06:14:52,690][106225] Updated weights for policy 1, policy_version 1532369 (0.0008) [2023-12-28 06:14:53,069][106226] Updated weights for policy 0, policy_version 1528603 (0.0008) [2023-12-28 06:14:53,130][106226] Updated weights for policy 0, policy_version 1528613 (0.0008) [2023-12-28 06:14:53,177][106226] Updated weights for policy 0, policy_version 1528623 (0.0009) [2023-12-28 06:14:53,380][106225] Updated weights for policy 1, policy_version 1532379 (0.0009) [2023-12-28 06:14:53,430][106225] Updated weights for policy 1, policy_version 1532389 (0.0006) [2023-12-28 06:14:53,495][106225] Updated weights for policy 1, policy_version 1532399 (0.0010) [2023-12-28 06:14:53,845][106226] Updated weights for policy 0, policy_version 1528633 (0.0007) [2023-12-28 06:14:53,909][106226] Updated weights for policy 0, policy_version 1528643 (0.0006) [2023-12-28 06:14:53,969][106226] Updated weights for policy 0, policy_version 1528653 (0.0008) [2023-12-28 06:14:54,025][106226] Updated weights for policy 0, policy_version 1528663 (0.0009) [2023-12-28 06:14:54,063][106225] Updated weights for policy 1, policy_version 1532409 (0.0008) [2023-12-28 06:14:54,120][106225] Updated weights for policy 1, policy_version 1532419 (0.0005) [2023-12-28 06:14:54,182][106225] Updated weights for policy 1, policy_version 1532429 (0.0008) [2023-12-28 06:14:54,243][106225] Updated weights for policy 1, policy_version 1532439 (0.0007) [2023-12-28 06:14:54,766][106226] Updated weights for policy 0, policy_version 1528673 (0.0006) [2023-12-28 06:14:54,833][106226] Updated weights for policy 0, policy_version 1528683 (0.0005) [2023-12-28 06:14:54,892][106225] Updated weights for policy 1, policy_version 1532449 (0.0005) [2023-12-28 06:14:54,894][106226] Updated weights for policy 0, policy_version 1528693 (0.0010) [2023-12-28 06:14:54,957][106225] Updated weights for policy 1, policy_version 1532459 (0.0005) [2023-12-28 06:14:55,026][106225] Updated weights for policy 1, policy_version 1532469 (0.0006) [2023-12-28 06:14:55,557][106226] Updated weights for policy 0, policy_version 1528703 (0.0010) [2023-12-28 06:14:55,612][106226] Updated weights for policy 0, policy_version 1528713 (0.0010) [2023-12-28 06:14:55,661][106226] Updated weights for policy 0, policy_version 1528723 (0.0010) [2023-12-28 06:14:55,699][106225] Updated weights for policy 1, policy_version 1532479 (0.0008) [2023-12-28 06:14:55,758][106225] Updated weights for policy 1, policy_version 1532489 (0.0006) [2023-12-28 06:14:55,814][106225] Updated weights for policy 1, policy_version 1532499 (0.0006) [2023-12-28 06:14:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783802368. Throughput: 0: 9867.8, 1: 9692.0. Samples: 783771596. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:14:56,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.983')] [2023-12-28 06:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001532504_392372224.pth... [2023-12-28 06:14:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001528728_391430144.pth... [2023-12-28 06:14:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001527576_391135232.pth [2023-12-28 06:14:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001531352_392077312.pth [2023-12-28 06:14:56,388][106226] Updated weights for policy 0, policy_version 1528733 (0.0011) [2023-12-28 06:14:56,422][106225] Updated weights for policy 1, policy_version 1532509 (0.0008) [2023-12-28 06:14:56,439][106226] Updated weights for policy 0, policy_version 1528743 (0.0011) [2023-12-28 06:14:56,477][106225] Updated weights for policy 1, policy_version 1532519 (0.0010) [2023-12-28 06:14:56,504][106226] Updated weights for policy 0, policy_version 1528753 (0.0011) [2023-12-28 06:14:56,533][106225] Updated weights for policy 1, policy_version 1532529 (0.0007) [2023-12-28 06:14:57,210][106226] Updated weights for policy 0, policy_version 1528763 (0.0010) [2023-12-28 06:14:57,241][106225] Updated weights for policy 1, policy_version 1532539 (0.0006) [2023-12-28 06:14:57,257][106226] Updated weights for policy 0, policy_version 1528773 (0.0010) [2023-12-28 06:14:57,303][106225] Updated weights for policy 1, policy_version 1532549 (0.0005) [2023-12-28 06:14:57,308][106226] Updated weights for policy 0, policy_version 1528783 (0.0010) [2023-12-28 06:14:57,360][106225] Updated weights for policy 1, policy_version 1532559 (0.0009) [2023-12-28 06:14:58,028][106226] Updated weights for policy 0, policy_version 1528793 (0.0010) [2023-12-28 06:14:58,030][106225] Updated weights for policy 1, policy_version 1532569 (0.0010) [2023-12-28 06:14:58,093][106225] Updated weights for policy 1, policy_version 1532579 (0.0008) [2023-12-28 06:14:58,093][106226] Updated weights for policy 0, policy_version 1528803 (0.0011) [2023-12-28 06:14:58,156][106225] Updated weights for policy 1, policy_version 1532589 (0.0008) [2023-12-28 06:14:58,156][106226] Updated weights for policy 0, policy_version 1528813 (0.0010) [2023-12-28 06:14:58,215][106225] Updated weights for policy 1, policy_version 1532599 (0.0008) [2023-12-28 06:14:58,222][106226] Updated weights for policy 0, policy_version 1528823 (0.0011) [2023-12-28 06:14:59,048][106225] Updated weights for policy 1, policy_version 1532609 (0.0007) [2023-12-28 06:14:59,098][106226] Updated weights for policy 0, policy_version 1528833 (0.0007) [2023-12-28 06:14:59,102][106225] Updated weights for policy 1, policy_version 1532619 (0.0008) [2023-12-28 06:14:59,153][106226] Updated weights for policy 0, policy_version 1528843 (0.0008) [2023-12-28 06:14:59,158][106225] Updated weights for policy 1, policy_version 1532629 (0.0008) [2023-12-28 06:14:59,214][106226] Updated weights for policy 0, policy_version 1528853 (0.0006) [2023-12-28 06:14:59,859][106225] Updated weights for policy 1, policy_version 1532639 (0.0007) [2023-12-28 06:14:59,881][106226] Updated weights for policy 0, policy_version 1528863 (0.0007) [2023-12-28 06:14:59,923][106225] Updated weights for policy 1, policy_version 1532649 (0.0007) [2023-12-28 06:14:59,944][106226] Updated weights for policy 0, policy_version 1528873 (0.0007) [2023-12-28 06:14:59,983][106225] Updated weights for policy 1, policy_version 1532659 (0.0007) [2023-12-28 06:15:00,005][106226] Updated weights for policy 0, policy_version 1528883 (0.0008) [2023-12-28 06:15:00,653][106226] Updated weights for policy 0, policy_version 1528893 (0.0007) [2023-12-28 06:15:00,698][106226] Updated weights for policy 0, policy_version 1528903 (0.0005) [2023-12-28 06:15:00,727][106225] Updated weights for policy 1, policy_version 1532669 (0.0007) [2023-12-28 06:15:00,746][106226] Updated weights for policy 0, policy_version 1528913 (0.0005) [2023-12-28 06:15:00,789][106225] Updated weights for policy 1, policy_version 1532679 (0.0005) [2023-12-28 06:15:00,851][106225] Updated weights for policy 1, policy_version 1532689 (0.0006) [2023-12-28 06:15:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783900672. Throughput: 0: 9913.7, 1: 9696.1. Samples: 783889564. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:01,175][105115] Avg episode reward: [(0, '-4.767'), (1, '-4.853')] [2023-12-28 06:15:01,453][106226] Updated weights for policy 0, policy_version 1528923 (0.0005) [2023-12-28 06:15:01,509][106225] Updated weights for policy 1, policy_version 1532699 (0.0006) [2023-12-28 06:15:01,511][106226] Updated weights for policy 0, policy_version 1528933 (0.0005) [2023-12-28 06:15:01,564][106225] Updated weights for policy 1, policy_version 1532709 (0.0005) [2023-12-28 06:15:01,570][106226] Updated weights for policy 0, policy_version 1528943 (0.0007) [2023-12-28 06:15:01,625][106225] Updated weights for policy 1, policy_version 1532719 (0.0006) [2023-12-28 06:15:02,273][106226] Updated weights for policy 0, policy_version 1528953 (0.0007) [2023-12-28 06:15:02,334][106226] Updated weights for policy 0, policy_version 1528963 (0.0007) [2023-12-28 06:15:02,394][106225] Updated weights for policy 1, policy_version 1532729 (0.0008) [2023-12-28 06:15:02,408][106226] Updated weights for policy 0, policy_version 1528973 (0.0008) [2023-12-28 06:15:02,453][106225] Updated weights for policy 1, policy_version 1532739 (0.0006) [2023-12-28 06:15:02,463][106226] Updated weights for policy 0, policy_version 1528983 (0.0010) [2023-12-28 06:15:02,502][106225] Updated weights for policy 1, policy_version 1532749 (0.0007) [2023-12-28 06:15:02,553][106225] Updated weights for policy 1, policy_version 1532759 (0.0006) [2023-12-28 06:15:03,127][106225] Updated weights for policy 1, policy_version 1532769 (0.0006) [2023-12-28 06:15:03,153][106226] Updated weights for policy 0, policy_version 1528993 (0.0010) [2023-12-28 06:15:03,191][106225] Updated weights for policy 1, policy_version 1532779 (0.0008) [2023-12-28 06:15:03,204][106226] Updated weights for policy 0, policy_version 1529003 (0.0010) [2023-12-28 06:15:03,252][106226] Updated weights for policy 0, policy_version 1529013 (0.0008) [2023-12-28 06:15:03,254][106225] Updated weights for policy 1, policy_version 1532789 (0.0008) [2023-12-28 06:15:03,871][106225] Updated weights for policy 1, policy_version 1532799 (0.0008) [2023-12-28 06:15:03,930][106226] Updated weights for policy 0, policy_version 1529023 (0.0008) [2023-12-28 06:15:03,930][106225] Updated weights for policy 1, policy_version 1532809 (0.0006) [2023-12-28 06:15:03,993][106226] Updated weights for policy 0, policy_version 1529033 (0.0010) [2023-12-28 06:15:03,995][106225] Updated weights for policy 1, policy_version 1532819 (0.0009) [2023-12-28 06:15:04,058][106226] Updated weights for policy 0, policy_version 1529043 (0.0011) [2023-12-28 06:15:04,639][106225] Updated weights for policy 1, policy_version 1532829 (0.0009) [2023-12-28 06:15:04,696][106225] Updated weights for policy 1, policy_version 1532839 (0.0007) [2023-12-28 06:15:04,743][106225] Updated weights for policy 1, policy_version 1532849 (0.0008) [2023-12-28 06:15:04,771][106226] Updated weights for policy 0, policy_version 1529053 (0.0008) [2023-12-28 06:15:04,830][106226] Updated weights for policy 0, policy_version 1529063 (0.0005) [2023-12-28 06:15:04,879][106226] Updated weights for policy 0, policy_version 1529073 (0.0005) [2023-12-28 06:15:05,358][106225] Updated weights for policy 1, policy_version 1532859 (0.0009) [2023-12-28 06:15:05,408][106226] Updated weights for policy 0, policy_version 1529083 (0.0007) [2023-12-28 06:15:05,409][106225] Updated weights for policy 1, policy_version 1532869 (0.0005) [2023-12-28 06:15:05,461][106225] Updated weights for policy 1, policy_version 1532879 (0.0005) [2023-12-28 06:15:05,461][106226] Updated weights for policy 0, policy_version 1529093 (0.0011) [2023-12-28 06:15:05,515][106226] Updated weights for policy 0, policy_version 1529103 (0.0011) [2023-12-28 06:15:06,093][106225] Updated weights for policy 1, policy_version 1532889 (0.0006) [2023-12-28 06:15:06,159][106225] Updated weights for policy 1, policy_version 1532899 (0.0007) [2023-12-28 06:15:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 783998976. Throughput: 0: 9969.9, 1: 9860.7. Samples: 784014908. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:06,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-4.311')] [2023-12-28 06:15:06,210][106226] Updated weights for policy 0, policy_version 1529113 (0.0010) [2023-12-28 06:15:06,222][106225] Updated weights for policy 1, policy_version 1532909 (0.0005) [2023-12-28 06:15:06,276][106225] Updated weights for policy 1, policy_version 1532919 (0.0009) [2023-12-28 06:15:06,281][106226] Updated weights for policy 0, policy_version 1529123 (0.0008) [2023-12-28 06:15:06,341][106226] Updated weights for policy 0, policy_version 1529133 (0.0008) [2023-12-28 06:15:06,400][106226] Updated weights for policy 0, policy_version 1529143 (0.0008) [2023-12-28 06:15:06,968][106225] Updated weights for policy 1, policy_version 1532929 (0.0008) [2023-12-28 06:15:07,029][106225] Updated weights for policy 1, policy_version 1532939 (0.0010) [2023-12-28 06:15:07,087][106225] Updated weights for policy 1, policy_version 1532949 (0.0010) [2023-12-28 06:15:07,089][106226] Updated weights for policy 0, policy_version 1529153 (0.0011) [2023-12-28 06:15:07,143][106226] Updated weights for policy 0, policy_version 1529163 (0.0011) [2023-12-28 06:15:07,190][106226] Updated weights for policy 0, policy_version 1529173 (0.0010) [2023-12-28 06:15:07,783][106225] Updated weights for policy 1, policy_version 1532959 (0.0010) [2023-12-28 06:15:07,839][106226] Updated weights for policy 0, policy_version 1529183 (0.0007) [2023-12-28 06:15:07,839][106225] Updated weights for policy 1, policy_version 1532969 (0.0005) [2023-12-28 06:15:07,894][106226] Updated weights for policy 0, policy_version 1529193 (0.0006) [2023-12-28 06:15:07,897][106225] Updated weights for policy 1, policy_version 1532979 (0.0006) [2023-12-28 06:15:07,954][106226] Updated weights for policy 0, policy_version 1529203 (0.0005) [2023-12-28 06:15:08,497][106225] Updated weights for policy 1, policy_version 1532989 (0.0007) [2023-12-28 06:15:08,556][106225] Updated weights for policy 1, policy_version 1532999 (0.0008) [2023-12-28 06:15:08,612][106225] Updated weights for policy 1, policy_version 1533009 (0.0008) [2023-12-28 06:15:08,633][106226] Updated weights for policy 0, policy_version 1529213 (0.0006) [2023-12-28 06:15:08,695][106226] Updated weights for policy 0, policy_version 1529223 (0.0008) [2023-12-28 06:15:08,759][106226] Updated weights for policy 0, policy_version 1529233 (0.0005) [2023-12-28 06:15:09,332][106225] Updated weights for policy 1, policy_version 1533019 (0.0007) [2023-12-28 06:15:09,396][106225] Updated weights for policy 1, policy_version 1533029 (0.0009) [2023-12-28 06:15:09,464][106225] Updated weights for policy 1, policy_version 1533039 (0.0007) [2023-12-28 06:15:09,480][106226] Updated weights for policy 0, policy_version 1529243 (0.0009) [2023-12-28 06:15:09,540][106226] Updated weights for policy 0, policy_version 1529253 (0.0009) [2023-12-28 06:15:09,604][106226] Updated weights for policy 0, policy_version 1529263 (0.0011) [2023-12-28 06:15:10,168][106225] Updated weights for policy 1, policy_version 1533049 (0.0008) [2023-12-28 06:15:10,230][106225] Updated weights for policy 1, policy_version 1533059 (0.0010) [2023-12-28 06:15:10,293][106225] Updated weights for policy 1, policy_version 1533069 (0.0011) [2023-12-28 06:15:10,356][106225] Updated weights for policy 1, policy_version 1533079 (0.0010) [2023-12-28 06:15:10,372][106226] Updated weights for policy 0, policy_version 1529273 (0.0010) [2023-12-28 06:15:10,441][106226] Updated weights for policy 0, policy_version 1529283 (0.0007) [2023-12-28 06:15:10,514][106226] Updated weights for policy 0, policy_version 1529293 (0.0009) [2023-12-28 06:15:10,573][106226] Updated weights for policy 0, policy_version 1529303 (0.0007) [2023-12-28 06:15:11,080][106225] Updated weights for policy 1, policy_version 1533092 (0.0008) [2023-12-28 06:15:11,146][106225] Updated weights for policy 1, policy_version 1533102 (0.0012) [2023-12-28 06:15:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 784097280. Throughput: 0: 9995.4, 1: 9928.9. Samples: 784075432. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:11,175][105115] Avg episode reward: [(0, '-4.884'), (1, '-4.548')] [2023-12-28 06:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001529304_391577600.pth... [2023-12-28 06:15:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001528152_391282688.pth [2023-12-28 06:15:11,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001533112_392527872.pth... [2023-12-28 06:15:11,214][106225] Updated weights for policy 1, policy_version 1533112 (0.0009) [2023-12-28 06:15:11,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001531928_392224768.pth [2023-12-28 06:15:11,270][106226] Updated weights for policy 0, policy_version 1529313 (0.0008) [2023-12-28 06:15:11,337][106226] Updated weights for policy 0, policy_version 1529323 (0.0007) [2023-12-28 06:15:11,416][106226] Updated weights for policy 0, policy_version 1529333 (0.0009) [2023-12-28 06:15:12,018][106225] Updated weights for policy 1, policy_version 1533122 (0.0011) [2023-12-28 06:15:12,072][106225] Updated weights for policy 1, policy_version 1533132 (0.0010) [2023-12-28 06:15:12,136][106225] Updated weights for policy 1, policy_version 1533142 (0.0010) [2023-12-28 06:15:12,191][106226] Updated weights for policy 0, policy_version 1529343 (0.0007) [2023-12-28 06:15:12,239][106226] Updated weights for policy 0, policy_version 1529353 (0.0006) [2023-12-28 06:15:12,309][106226] Updated weights for policy 0, policy_version 1529363 (0.0009) [2023-12-28 06:15:12,901][106225] Updated weights for policy 1, policy_version 1533152 (0.0009) [2023-12-28 06:15:12,959][106226] Updated weights for policy 0, policy_version 1529373 (0.0007) [2023-12-28 06:15:12,961][106225] Updated weights for policy 1, policy_version 1533162 (0.0008) [2023-12-28 06:15:13,007][106226] Updated weights for policy 0, policy_version 1529383 (0.0005) [2023-12-28 06:15:13,026][106225] Updated weights for policy 1, policy_version 1533172 (0.0008) [2023-12-28 06:15:13,065][106226] Updated weights for policy 0, policy_version 1529393 (0.0007) [2023-12-28 06:15:13,758][106226] Updated weights for policy 0, policy_version 1529403 (0.0010) [2023-12-28 06:15:13,787][106225] Updated weights for policy 1, policy_version 1533182 (0.0006) [2023-12-28 06:15:13,826][106226] Updated weights for policy 0, policy_version 1529413 (0.0011) [2023-12-28 06:15:13,849][106225] Updated weights for policy 1, policy_version 1533192 (0.0006) [2023-12-28 06:15:13,892][106226] Updated weights for policy 0, policy_version 1529423 (0.0011) [2023-12-28 06:15:13,908][106225] Updated weights for policy 1, policy_version 1533202 (0.0006) [2023-12-28 06:15:14,524][106226] Updated weights for policy 0, policy_version 1529433 (0.0010) [2023-12-28 06:15:14,558][106225] Updated weights for policy 1, policy_version 1533212 (0.0006) [2023-12-28 06:15:14,571][106226] Updated weights for policy 0, policy_version 1529443 (0.0006) [2023-12-28 06:15:14,613][106225] Updated weights for policy 1, policy_version 1533222 (0.0009) [2023-12-28 06:15:14,627][106226] Updated weights for policy 0, policy_version 1529453 (0.0008) [2023-12-28 06:15:14,671][106225] Updated weights for policy 1, policy_version 1533232 (0.0005) [2023-12-28 06:15:14,688][106226] Updated weights for policy 0, policy_version 1529463 (0.0011) [2023-12-28 06:15:15,374][106225] Updated weights for policy 1, policy_version 1533242 (0.0007) [2023-12-28 06:15:15,435][106225] Updated weights for policy 1, policy_version 1533252 (0.0008) [2023-12-28 06:15:15,453][106226] Updated weights for policy 0, policy_version 1529473 (0.0008) [2023-12-28 06:15:15,495][106225] Updated weights for policy 1, policy_version 1533262 (0.0006) [2023-12-28 06:15:15,512][106226] Updated weights for policy 0, policy_version 1529483 (0.0011) [2023-12-28 06:15:15,558][106225] Updated weights for policy 1, policy_version 1533272 (0.0006) [2023-12-28 06:15:15,560][106226] Updated weights for policy 0, policy_version 1529493 (0.0011) [2023-12-28 06:15:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 784195584. Throughput: 0: 10026.7, 1: 9793.1. Samples: 784189536. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:16,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.714')] [2023-12-28 06:15:16,229][106226] Updated weights for policy 0, policy_version 1529503 (0.0009) [2023-12-28 06:15:16,283][106226] Updated weights for policy 0, policy_version 1529513 (0.0010) [2023-12-28 06:15:16,314][106225] Updated weights for policy 1, policy_version 1533282 (0.0007) [2023-12-28 06:15:16,341][106226] Updated weights for policy 0, policy_version 1529523 (0.0008) [2023-12-28 06:15:16,371][106225] Updated weights for policy 1, policy_version 1533292 (0.0010) [2023-12-28 06:15:16,424][106225] Updated weights for policy 1, policy_version 1533302 (0.0010) [2023-12-28 06:15:16,903][106226] Updated weights for policy 0, policy_version 1529533 (0.0008) [2023-12-28 06:15:16,961][106226] Updated weights for policy 0, policy_version 1529543 (0.0011) [2023-12-28 06:15:16,979][106225] Updated weights for policy 1, policy_version 1533312 (0.0006) [2023-12-28 06:15:17,026][106226] Updated weights for policy 0, policy_version 1529553 (0.0011) [2023-12-28 06:15:17,030][106225] Updated weights for policy 1, policy_version 1533322 (0.0010) [2023-12-28 06:15:17,085][106225] Updated weights for policy 1, policy_version 1533332 (0.0011) [2023-12-28 06:15:17,745][106226] Updated weights for policy 0, policy_version 1529563 (0.0010) [2023-12-28 06:15:17,791][106225] Updated weights for policy 1, policy_version 1533342 (0.0010) [2023-12-28 06:15:17,803][106226] Updated weights for policy 0, policy_version 1529573 (0.0008) [2023-12-28 06:15:17,848][106225] Updated weights for policy 1, policy_version 1533352 (0.0010) [2023-12-28 06:15:17,854][106226] Updated weights for policy 0, policy_version 1529583 (0.0008) [2023-12-28 06:15:17,909][106225] Updated weights for policy 1, policy_version 1533362 (0.0010) [2023-12-28 06:15:18,552][106226] Updated weights for policy 0, policy_version 1529593 (0.0006) [2023-12-28 06:15:18,608][106226] Updated weights for policy 0, policy_version 1529603 (0.0008) [2023-12-28 06:15:18,611][106225] Updated weights for policy 1, policy_version 1533372 (0.0009) [2023-12-28 06:15:18,667][106225] Updated weights for policy 1, policy_version 1533382 (0.0007) [2023-12-28 06:15:18,668][106226] Updated weights for policy 0, policy_version 1529613 (0.0009) [2023-12-28 06:15:18,725][106225] Updated weights for policy 1, policy_version 1533392 (0.0008) [2023-12-28 06:15:18,728][106226] Updated weights for policy 0, policy_version 1529623 (0.0007) [2023-12-28 06:15:19,386][106226] Updated weights for policy 0, policy_version 1529633 (0.0010) [2023-12-28 06:15:19,444][106225] Updated weights for policy 1, policy_version 1533402 (0.0008) [2023-12-28 06:15:19,452][106226] Updated weights for policy 0, policy_version 1529643 (0.0008) [2023-12-28 06:15:19,509][106225] Updated weights for policy 1, policy_version 1533412 (0.0008) [2023-12-28 06:15:19,522][106226] Updated weights for policy 0, policy_version 1529653 (0.0008) [2023-12-28 06:15:19,572][106225] Updated weights for policy 1, policy_version 1533422 (0.0008) [2023-12-28 06:15:19,638][106225] Updated weights for policy 1, policy_version 1533432 (0.0008) [2023-12-28 06:15:20,253][106226] Updated weights for policy 0, policy_version 1529663 (0.0011) [2023-12-28 06:15:20,318][106226] Updated weights for policy 0, policy_version 1529673 (0.0008) [2023-12-28 06:15:20,386][106226] Updated weights for policy 0, policy_version 1529683 (0.0008) [2023-12-28 06:15:20,437][106225] Updated weights for policy 1, policy_version 1533442 (0.0009) [2023-12-28 06:15:20,503][106225] Updated weights for policy 1, policy_version 1533452 (0.0008) [2023-12-28 06:15:20,573][106225] Updated weights for policy 1, policy_version 1533462 (0.0008) [2023-12-28 06:15:21,064][106226] Updated weights for policy 0, policy_version 1529693 (0.0008) [2023-12-28 06:15:21,130][106226] Updated weights for policy 0, policy_version 1529703 (0.0011) [2023-12-28 06:15:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 784293888. Throughput: 0: 10001.3, 1: 9762.8. Samples: 784308512. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:21,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.605')] [2023-12-28 06:15:21,200][106226] Updated weights for policy 0, policy_version 1529713 (0.0012) [2023-12-28 06:15:21,402][106225] Updated weights for policy 1, policy_version 1533472 (0.0008) [2023-12-28 06:15:21,462][106225] Updated weights for policy 1, policy_version 1533482 (0.0008) [2023-12-28 06:15:21,522][106225] Updated weights for policy 1, policy_version 1533492 (0.0008) [2023-12-28 06:15:21,997][106226] Updated weights for policy 0, policy_version 1529723 (0.0009) [2023-12-28 06:15:22,064][106226] Updated weights for policy 0, policy_version 1529733 (0.0008) [2023-12-28 06:15:22,139][106226] Updated weights for policy 0, policy_version 1529744 (0.0008) [2023-12-28 06:15:22,307][106225] Updated weights for policy 1, policy_version 1533502 (0.0008) [2023-12-28 06:15:22,373][106225] Updated weights for policy 1, policy_version 1533512 (0.0009) [2023-12-28 06:15:22,431][106225] Updated weights for policy 1, policy_version 1533522 (0.0009) [2023-12-28 06:15:22,880][106226] Updated weights for policy 0, policy_version 1529754 (0.0008) [2023-12-28 06:15:22,928][106226] Updated weights for policy 0, policy_version 1529764 (0.0009) [2023-12-28 06:15:22,977][106226] Updated weights for policy 0, policy_version 1529774 (0.0008) [2023-12-28 06:15:23,022][106226] Updated weights for policy 0, policy_version 1529784 (0.0008) [2023-12-28 06:15:23,179][106225] Updated weights for policy 1, policy_version 1533532 (0.0008) [2023-12-28 06:15:23,235][106225] Updated weights for policy 1, policy_version 1533542 (0.0008) [2023-12-28 06:15:23,295][106225] Updated weights for policy 1, policy_version 1533552 (0.0009) [2023-12-28 06:15:23,691][106226] Updated weights for policy 0, policy_version 1529794 (0.0009) [2023-12-28 06:15:23,745][106226] Updated weights for policy 0, policy_version 1529804 (0.0007) [2023-12-28 06:15:23,801][106226] Updated weights for policy 0, policy_version 1529814 (0.0005) [2023-12-28 06:15:24,074][106225] Updated weights for policy 1, policy_version 1533562 (0.0008) [2023-12-28 06:15:24,125][106225] Updated weights for policy 1, policy_version 1533572 (0.0008) [2023-12-28 06:15:24,181][106225] Updated weights for policy 1, policy_version 1533582 (0.0009) [2023-12-28 06:15:24,238][106225] Updated weights for policy 1, policy_version 1533592 (0.0008) [2023-12-28 06:15:24,386][106226] Updated weights for policy 0, policy_version 1529824 (0.0005) [2023-12-28 06:15:24,432][106226] Updated weights for policy 0, policy_version 1529834 (0.0006) [2023-12-28 06:15:24,482][106226] Updated weights for policy 0, policy_version 1529844 (0.0009) [2023-12-28 06:15:24,998][106225] Updated weights for policy 1, policy_version 1533602 (0.0009) [2023-12-28 06:15:25,051][106225] Updated weights for policy 1, policy_version 1533612 (0.0008) [2023-12-28 06:15:25,104][106225] Updated weights for policy 1, policy_version 1533622 (0.0009) [2023-12-28 06:15:25,156][106226] Updated weights for policy 0, policy_version 1529854 (0.0007) [2023-12-28 06:15:25,211][106226] Updated weights for policy 0, policy_version 1529864 (0.0005) [2023-12-28 06:15:25,269][106226] Updated weights for policy 0, policy_version 1529874 (0.0005) [2023-12-28 06:15:25,809][106225] Updated weights for policy 1, policy_version 1533632 (0.0008) [2023-12-28 06:15:25,866][106225] Updated weights for policy 1, policy_version 1533642 (0.0008) [2023-12-28 06:15:25,932][106225] Updated weights for policy 1, policy_version 1533652 (0.0006) [2023-12-28 06:15:25,939][106226] Updated weights for policy 0, policy_version 1529884 (0.0007) [2023-12-28 06:15:26,003][106226] Updated weights for policy 0, policy_version 1529894 (0.0008) [2023-12-28 06:15:26,066][106226] Updated weights for policy 0, policy_version 1529904 (0.0008) [2023-12-28 06:15:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 784400384. Throughput: 0: 9969.7, 1: 9716.3. Samples: 784364704. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:26,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.764')] [2023-12-28 06:15:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001529912_391733248.pth... [2023-12-28 06:15:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001533656_392667136.pth... [2023-12-28 06:15:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001528728_391430144.pth [2023-12-28 06:15:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001532504_392372224.pth [2023-12-28 06:15:26,601][106225] Updated weights for policy 1, policy_version 1533662 (0.0008) [2023-12-28 06:15:26,657][106225] Updated weights for policy 1, policy_version 1533672 (0.0008) [2023-12-28 06:15:26,705][106225] Updated weights for policy 1, policy_version 1533682 (0.0008) [2023-12-28 06:15:26,795][106226] Updated weights for policy 0, policy_version 1529914 (0.0008) [2023-12-28 06:15:26,860][106226] Updated weights for policy 0, policy_version 1529924 (0.0008) [2023-12-28 06:15:26,913][106226] Updated weights for policy 0, policy_version 1529934 (0.0008) [2023-12-28 06:15:26,960][106226] Updated weights for policy 0, policy_version 1529944 (0.0008) [2023-12-28 06:15:27,471][106225] Updated weights for policy 1, policy_version 1533692 (0.0009) [2023-12-28 06:15:27,530][106225] Updated weights for policy 1, policy_version 1533702 (0.0008) [2023-12-28 06:15:27,578][106225] Updated weights for policy 1, policy_version 1533712 (0.0008) [2023-12-28 06:15:27,615][106226] Updated weights for policy 0, policy_version 1529954 (0.0006) [2023-12-28 06:15:27,674][106226] Updated weights for policy 0, policy_version 1529964 (0.0005) [2023-12-28 06:15:27,740][106226] Updated weights for policy 0, policy_version 1529974 (0.0005) [2023-12-28 06:15:28,290][106226] Updated weights for policy 0, policy_version 1529984 (0.0008) [2023-12-28 06:15:28,338][106225] Updated weights for policy 1, policy_version 1533722 (0.0008) [2023-12-28 06:15:28,362][106226] Updated weights for policy 0, policy_version 1529994 (0.0010) [2023-12-28 06:15:28,400][106225] Updated weights for policy 1, policy_version 1533732 (0.0008) [2023-12-28 06:15:28,426][106226] Updated weights for policy 0, policy_version 1530004 (0.0007) [2023-12-28 06:15:28,466][106225] Updated weights for policy 1, policy_version 1533742 (0.0009) [2023-12-28 06:15:28,519][106225] Updated weights for policy 1, policy_version 1533752 (0.0008) [2023-12-28 06:15:29,156][106226] Updated weights for policy 0, policy_version 1530014 (0.0007) [2023-12-28 06:15:29,216][106226] Updated weights for policy 0, policy_version 1530024 (0.0008) [2023-12-28 06:15:29,243][106225] Updated weights for policy 1, policy_version 1533762 (0.0010) [2023-12-28 06:15:29,280][106226] Updated weights for policy 0, policy_version 1530034 (0.0006) [2023-12-28 06:15:29,300][106225] Updated weights for policy 1, policy_version 1533772 (0.0009) [2023-12-28 06:15:29,373][106225] Updated weights for policy 1, policy_version 1533782 (0.0010) [2023-12-28 06:15:29,919][106226] Updated weights for policy 0, policy_version 1530044 (0.0009) [2023-12-28 06:15:29,985][106226] Updated weights for policy 0, policy_version 1530054 (0.0009) [2023-12-28 06:15:30,043][106226] Updated weights for policy 0, policy_version 1530064 (0.0008) [2023-12-28 06:15:30,068][106225] Updated weights for policy 1, policy_version 1533792 (0.0010) [2023-12-28 06:15:30,116][106225] Updated weights for policy 1, policy_version 1533802 (0.0010) [2023-12-28 06:15:30,163][106225] Updated weights for policy 1, policy_version 1533812 (0.0010) [2023-12-28 06:15:30,784][106226] Updated weights for policy 0, policy_version 1530074 (0.0007) [2023-12-28 06:15:30,833][106226] Updated weights for policy 0, policy_version 1530084 (0.0007) [2023-12-28 06:15:30,858][106225] Updated weights for policy 1, policy_version 1533822 (0.0010) [2023-12-28 06:15:30,887][106226] Updated weights for policy 0, policy_version 1530094 (0.0009) [2023-12-28 06:15:30,914][106225] Updated weights for policy 1, policy_version 1533832 (0.0008) [2023-12-28 06:15:30,943][106226] Updated weights for policy 0, policy_version 1530104 (0.0010) [2023-12-28 06:15:30,972][106225] Updated weights for policy 1, policy_version 1533842 (0.0007) [2023-12-28 06:15:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 784498688. Throughput: 0: 10060.1, 1: 9746.2. Samples: 784484068. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:31,175][105115] Avg episode reward: [(0, '-4.843'), (1, '-4.728')] [2023-12-28 06:15:31,683][106225] Updated weights for policy 1, policy_version 1533852 (0.0008) [2023-12-28 06:15:31,748][106225] Updated weights for policy 1, policy_version 1533862 (0.0007) [2023-12-28 06:15:31,752][106226] Updated weights for policy 0, policy_version 1530114 (0.0009) [2023-12-28 06:15:31,805][106225] Updated weights for policy 1, policy_version 1533872 (0.0008) [2023-12-28 06:15:31,818][106226] Updated weights for policy 0, policy_version 1530124 (0.0005) [2023-12-28 06:15:31,885][106226] Updated weights for policy 0, policy_version 1530134 (0.0006) [2023-12-28 06:15:32,518][106225] Updated weights for policy 1, policy_version 1533882 (0.0008) [2023-12-28 06:15:32,573][106225] Updated weights for policy 1, policy_version 1533892 (0.0008) [2023-12-28 06:15:32,624][106226] Updated weights for policy 0, policy_version 1530144 (0.0009) [2023-12-28 06:15:32,630][106225] Updated weights for policy 1, policy_version 1533902 (0.0008) [2023-12-28 06:15:32,677][106226] Updated weights for policy 0, policy_version 1530154 (0.0008) [2023-12-28 06:15:32,684][106225] Updated weights for policy 1, policy_version 1533912 (0.0006) [2023-12-28 06:15:32,730][106226] Updated weights for policy 0, policy_version 1530164 (0.0007) [2023-12-28 06:15:33,342][106225] Updated weights for policy 1, policy_version 1533922 (0.0007) [2023-12-28 06:15:33,392][106226] Updated weights for policy 0, policy_version 1530174 (0.0009) [2023-12-28 06:15:33,398][106225] Updated weights for policy 1, policy_version 1533932 (0.0005) [2023-12-28 06:15:33,441][106226] Updated weights for policy 0, policy_version 1530184 (0.0008) [2023-12-28 06:15:33,459][106225] Updated weights for policy 1, policy_version 1533942 (0.0006) [2023-12-28 06:15:33,493][106226] Updated weights for policy 0, policy_version 1530194 (0.0007) [2023-12-28 06:15:34,056][106225] Updated weights for policy 1, policy_version 1533952 (0.0008) [2023-12-28 06:15:34,107][106225] Updated weights for policy 1, policy_version 1533962 (0.0008) [2023-12-28 06:15:34,171][106225] Updated weights for policy 1, policy_version 1533972 (0.0008) [2023-12-28 06:15:34,255][106226] Updated weights for policy 0, policy_version 1530204 (0.0007) [2023-12-28 06:15:34,316][106226] Updated weights for policy 0, policy_version 1530214 (0.0006) [2023-12-28 06:15:34,372][106226] Updated weights for policy 0, policy_version 1530224 (0.0005) [2023-12-28 06:15:34,915][106226] Updated weights for policy 0, policy_version 1530234 (0.0006) [2023-12-28 06:15:34,949][106225] Updated weights for policy 1, policy_version 1533982 (0.0007) [2023-12-28 06:15:34,972][106226] Updated weights for policy 0, policy_version 1530244 (0.0009) [2023-12-28 06:15:35,001][106225] Updated weights for policy 1, policy_version 1533992 (0.0008) [2023-12-28 06:15:35,032][106226] Updated weights for policy 0, policy_version 1530254 (0.0006) [2023-12-28 06:15:35,063][106225] Updated weights for policy 1, policy_version 1534002 (0.0009) [2023-12-28 06:15:35,089][106226] Updated weights for policy 0, policy_version 1530264 (0.0008) [2023-12-28 06:15:35,636][106225] Updated weights for policy 1, policy_version 1534012 (0.0008) [2023-12-28 06:15:35,694][106225] Updated weights for policy 1, policy_version 1534022 (0.0007) [2023-12-28 06:15:35,743][106225] Updated weights for policy 1, policy_version 1534032 (0.0009) [2023-12-28 06:15:35,772][106226] Updated weights for policy 0, policy_version 1530274 (0.0006) [2023-12-28 06:15:35,823][106226] Updated weights for policy 0, policy_version 1530284 (0.0005) [2023-12-28 06:15:35,872][106226] Updated weights for policy 0, policy_version 1530294 (0.0005) [2023-12-28 06:15:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 784596992. Throughput: 0: 10024.6, 1: 9829.7. Samples: 784606100. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:36,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-4.709')] [2023-12-28 06:15:36,448][106226] Updated weights for policy 0, policy_version 1530304 (0.0006) [2023-12-28 06:15:36,515][106226] Updated weights for policy 0, policy_version 1530314 (0.0008) [2023-12-28 06:15:36,534][106225] Updated weights for policy 1, policy_version 1534042 (0.0008) [2023-12-28 06:15:36,578][106226] Updated weights for policy 0, policy_version 1530324 (0.0008) [2023-12-28 06:15:36,597][106225] Updated weights for policy 1, policy_version 1534052 (0.0009) [2023-12-28 06:15:36,659][106225] Updated weights for policy 1, policy_version 1534062 (0.0009) [2023-12-28 06:15:36,722][106225] Updated weights for policy 1, policy_version 1534072 (0.0009) [2023-12-28 06:15:37,287][106226] Updated weights for policy 0, policy_version 1530334 (0.0009) [2023-12-28 06:15:37,359][106226] Updated weights for policy 0, policy_version 1530344 (0.0009) [2023-12-28 06:15:37,422][106226] Updated weights for policy 0, policy_version 1530354 (0.0007) [2023-12-28 06:15:37,444][106225] Updated weights for policy 1, policy_version 1534082 (0.0007) [2023-12-28 06:15:37,502][106225] Updated weights for policy 1, policy_version 1534092 (0.0008) [2023-12-28 06:15:37,557][106225] Updated weights for policy 1, policy_version 1534102 (0.0008) [2023-12-28 06:15:38,121][106226] Updated weights for policy 0, policy_version 1530364 (0.0009) [2023-12-28 06:15:38,170][106226] Updated weights for policy 0, policy_version 1530374 (0.0008) [2023-12-28 06:15:38,222][106226] Updated weights for policy 0, policy_version 1530384 (0.0009) [2023-12-28 06:15:38,284][106225] Updated weights for policy 1, policy_version 1534112 (0.0008) [2023-12-28 06:15:38,344][106225] Updated weights for policy 1, policy_version 1534122 (0.0008) [2023-12-28 06:15:38,404][106225] Updated weights for policy 1, policy_version 1534132 (0.0008) [2023-12-28 06:15:38,921][106226] Updated weights for policy 0, policy_version 1530394 (0.0007) [2023-12-28 06:15:38,979][106226] Updated weights for policy 0, policy_version 1530404 (0.0009) [2023-12-28 06:15:39,034][106226] Updated weights for policy 0, policy_version 1530414 (0.0008) [2023-12-28 06:15:39,144][106225] Updated weights for policy 1, policy_version 1534142 (0.0009) [2023-12-28 06:15:39,213][106225] Updated weights for policy 1, policy_version 1534152 (0.0008) [2023-12-28 06:15:39,279][106225] Updated weights for policy 1, policy_version 1534162 (0.0009) [2023-12-28 06:15:39,786][106226] Updated weights for policy 0, policy_version 1530425 (0.0009) [2023-12-28 06:15:39,858][106226] Updated weights for policy 0, policy_version 1530435 (0.0009) [2023-12-28 06:15:39,918][106226] Updated weights for policy 0, policy_version 1530445 (0.0008) [2023-12-28 06:15:39,988][106226] Updated weights for policy 0, policy_version 1530455 (0.0008) [2023-12-28 06:15:40,081][106225] Updated weights for policy 1, policy_version 1534172 (0.0008) [2023-12-28 06:15:40,149][106225] Updated weights for policy 1, policy_version 1534182 (0.0009) [2023-12-28 06:15:40,218][106225] Updated weights for policy 1, policy_version 1534192 (0.0008) [2023-12-28 06:15:40,712][106226] Updated weights for policy 0, policy_version 1530465 (0.0008) [2023-12-28 06:15:40,768][106226] Updated weights for policy 0, policy_version 1530475 (0.0009) [2023-12-28 06:15:40,830][106226] Updated weights for policy 0, policy_version 1530485 (0.0008) [2023-12-28 06:15:40,941][106225] Updated weights for policy 1, policy_version 1534202 (0.0008) [2023-12-28 06:15:41,003][106225] Updated weights for policy 1, policy_version 1534212 (0.0006) [2023-12-28 06:15:41,068][106225] Updated weights for policy 1, policy_version 1534222 (0.0009) [2023-12-28 06:15:41,139][106225] Updated weights for policy 1, policy_version 1534232 (0.0010) [2023-12-28 06:15:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 784695296. Throughput: 0: 10001.2, 1: 9810.0. Samples: 784663104. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:41,175][105115] Avg episode reward: [(0, '-5.018'), (1, '-4.671')] [2023-12-28 06:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001534232_392814592.pth... [2023-12-28 06:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001530488_391880704.pth... [2023-12-28 06:15:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001533112_392527872.pth [2023-12-28 06:15:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001529304_391577600.pth [2023-12-28 06:15:41,615][106226] Updated weights for policy 0, policy_version 1530495 (0.0010) [2023-12-28 06:15:41,683][106226] Updated weights for policy 0, policy_version 1530505 (0.0008) [2023-12-28 06:15:41,764][106226] Updated weights for policy 0, policy_version 1530515 (0.0009) [2023-12-28 06:15:41,944][106225] Updated weights for policy 1, policy_version 1534242 (0.0011) [2023-12-28 06:15:41,995][106225] Updated weights for policy 1, policy_version 1534252 (0.0010) [2023-12-28 06:15:42,054][106225] Updated weights for policy 1, policy_version 1534262 (0.0011) [2023-12-28 06:15:42,448][106226] Updated weights for policy 0, policy_version 1530525 (0.0009) [2023-12-28 06:15:42,506][106226] Updated weights for policy 0, policy_version 1530535 (0.0009) [2023-12-28 06:15:42,564][106226] Updated weights for policy 0, policy_version 1530545 (0.0007) [2023-12-28 06:15:42,829][106225] Updated weights for policy 1, policy_version 1534272 (0.0008) [2023-12-28 06:15:42,884][106225] Updated weights for policy 1, policy_version 1534282 (0.0008) [2023-12-28 06:15:42,945][106225] Updated weights for policy 1, policy_version 1534292 (0.0006) [2023-12-28 06:15:43,292][106226] Updated weights for policy 0, policy_version 1530555 (0.0009) [2023-12-28 06:15:43,342][106226] Updated weights for policy 0, policy_version 1530565 (0.0010) [2023-12-28 06:15:43,389][106226] Updated weights for policy 0, policy_version 1530575 (0.0010) [2023-12-28 06:15:43,620][106225] Updated weights for policy 1, policy_version 1534302 (0.0009) [2023-12-28 06:15:43,681][106225] Updated weights for policy 1, policy_version 1534312 (0.0010) [2023-12-28 06:15:43,746][106225] Updated weights for policy 1, policy_version 1534322 (0.0011) [2023-12-28 06:15:44,146][106226] Updated weights for policy 0, policy_version 1530585 (0.0011) [2023-12-28 06:15:44,206][106226] Updated weights for policy 0, policy_version 1530595 (0.0011) [2023-12-28 06:15:44,259][106226] Updated weights for policy 0, policy_version 1530605 (0.0010) [2023-12-28 06:15:44,316][106226] Updated weights for policy 0, policy_version 1530615 (0.0010) [2023-12-28 06:15:44,395][106225] Updated weights for policy 1, policy_version 1534332 (0.0010) [2023-12-28 06:15:44,458][106225] Updated weights for policy 1, policy_version 1534342 (0.0008) [2023-12-28 06:15:44,529][106225] Updated weights for policy 1, policy_version 1534352 (0.0008) [2023-12-28 06:15:44,941][106226] Updated weights for policy 0, policy_version 1530625 (0.0006) [2023-12-28 06:15:44,996][106226] Updated weights for policy 0, policy_version 1530635 (0.0006) [2023-12-28 06:15:45,066][106226] Updated weights for policy 0, policy_version 1530645 (0.0006) [2023-12-28 06:15:45,225][106225] Updated weights for policy 1, policy_version 1534362 (0.0008) [2023-12-28 06:15:45,294][106225] Updated weights for policy 1, policy_version 1534372 (0.0009) [2023-12-28 06:15:45,359][106225] Updated weights for policy 1, policy_version 1534382 (0.0011) [2023-12-28 06:15:45,425][106225] Updated weights for policy 1, policy_version 1534392 (0.0011) [2023-12-28 06:15:45,658][106226] Updated weights for policy 0, policy_version 1530655 (0.0009) [2023-12-28 06:15:45,711][106226] Updated weights for policy 0, policy_version 1530665 (0.0010) [2023-12-28 06:15:45,761][106226] Updated weights for policy 0, policy_version 1530675 (0.0010) [2023-12-28 06:15:46,055][106225] Updated weights for policy 1, policy_version 1534402 (0.0005) [2023-12-28 06:15:46,111][106225] Updated weights for policy 1, policy_version 1534412 (0.0008) [2023-12-28 06:15:46,168][106225] Updated weights for policy 1, policy_version 1534422 (0.0010) [2023-12-28 06:15:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 784785408. Throughput: 0: 10016.3, 1: 9739.4. Samples: 784778568. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:46,175][105115] Avg episode reward: [(0, '-4.810'), (1, '-4.740')] [2023-12-28 06:15:46,412][106226] Updated weights for policy 0, policy_version 1530685 (0.0006) [2023-12-28 06:15:46,473][106226] Updated weights for policy 0, policy_version 1530695 (0.0008) [2023-12-28 06:15:46,532][106226] Updated weights for policy 0, policy_version 1530705 (0.0010) [2023-12-28 06:15:46,857][106225] Updated weights for policy 1, policy_version 1534432 (0.0008) [2023-12-28 06:15:46,919][106225] Updated weights for policy 1, policy_version 1534442 (0.0008) [2023-12-28 06:15:46,986][106225] Updated weights for policy 1, policy_version 1534452 (0.0010) [2023-12-28 06:15:47,202][106226] Updated weights for policy 0, policy_version 1530715 (0.0010) [2023-12-28 06:15:47,254][106226] Updated weights for policy 0, policy_version 1530725 (0.0010) [2023-12-28 06:15:47,307][106226] Updated weights for policy 0, policy_version 1530735 (0.0010) [2023-12-28 06:15:47,589][106225] Updated weights for policy 1, policy_version 1534462 (0.0007) [2023-12-28 06:15:47,649][106225] Updated weights for policy 1, policy_version 1534472 (0.0006) [2023-12-28 06:15:47,702][106225] Updated weights for policy 1, policy_version 1534482 (0.0008) [2023-12-28 06:15:47,893][106226] Updated weights for policy 0, policy_version 1530745 (0.0009) [2023-12-28 06:15:47,949][106226] Updated weights for policy 0, policy_version 1530755 (0.0010) [2023-12-28 06:15:47,999][106226] Updated weights for policy 0, policy_version 1530765 (0.0010) [2023-12-28 06:15:48,058][106226] Updated weights for policy 0, policy_version 1530775 (0.0010) [2023-12-28 06:15:48,269][106225] Updated weights for policy 1, policy_version 1534492 (0.0005) [2023-12-28 06:15:48,323][106225] Updated weights for policy 1, policy_version 1534502 (0.0005) [2023-12-28 06:15:48,389][106225] Updated weights for policy 1, policy_version 1534512 (0.0009) [2023-12-28 06:15:48,705][106226] Updated weights for policy 0, policy_version 1530785 (0.0011) [2023-12-28 06:15:48,763][106226] Updated weights for policy 0, policy_version 1530795 (0.0011) [2023-12-28 06:15:48,827][106226] Updated weights for policy 0, policy_version 1530805 (0.0011) [2023-12-28 06:15:49,093][106225] Updated weights for policy 1, policy_version 1534522 (0.0009) [2023-12-28 06:15:49,146][106225] Updated weights for policy 1, policy_version 1534532 (0.0008) [2023-12-28 06:15:49,195][106225] Updated weights for policy 1, policy_version 1534542 (0.0008) [2023-12-28 06:15:49,255][106225] Updated weights for policy 1, policy_version 1534552 (0.0008) [2023-12-28 06:15:49,500][106226] Updated weights for policy 0, policy_version 1530815 (0.0009) [2023-12-28 06:15:49,558][106226] Updated weights for policy 0, policy_version 1530825 (0.0008) [2023-12-28 06:15:49,606][106226] Updated weights for policy 0, policy_version 1530835 (0.0009) [2023-12-28 06:15:50,037][106225] Updated weights for policy 1, policy_version 1534562 (0.0006) [2023-12-28 06:15:50,103][106225] Updated weights for policy 1, policy_version 1534572 (0.0009) [2023-12-28 06:15:50,165][106225] Updated weights for policy 1, policy_version 1534582 (0.0008) [2023-12-28 06:15:50,336][106226] Updated weights for policy 0, policy_version 1530845 (0.0008) [2023-12-28 06:15:50,399][106226] Updated weights for policy 0, policy_version 1530855 (0.0007) [2023-12-28 06:15:50,463][106226] Updated weights for policy 0, policy_version 1530865 (0.0008) [2023-12-28 06:15:50,852][106225] Updated weights for policy 1, policy_version 1534592 (0.0009) [2023-12-28 06:15:50,913][106225] Updated weights for policy 1, policy_version 1534602 (0.0008) [2023-12-28 06:15:50,973][106225] Updated weights for policy 1, policy_version 1534612 (0.0009) [2023-12-28 06:15:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 784891904. Throughput: 0: 10009.3, 1: 9702.8. Samples: 784901952. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-28 06:15:51,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.610')] [2023-12-28 06:15:51,176][106226] Updated weights for policy 0, policy_version 1530875 (0.0008) [2023-12-28 06:15:51,240][106226] Updated weights for policy 0, policy_version 1530885 (0.0009) [2023-12-28 06:15:51,306][106226] Updated weights for policy 0, policy_version 1530895 (0.0009) [2023-12-28 06:15:51,671][106225] Updated weights for policy 1, policy_version 1534622 (0.0008) [2023-12-28 06:15:51,740][106225] Updated weights for policy 1, policy_version 1534632 (0.0008) [2023-12-28 06:15:51,800][106225] Updated weights for policy 1, policy_version 1534642 (0.0009) [2023-12-28 06:15:52,072][106226] Updated weights for policy 0, policy_version 1530905 (0.0012) [2023-12-28 06:15:52,130][106226] Updated weights for policy 0, policy_version 1530915 (0.0008) [2023-12-28 06:15:52,192][106226] Updated weights for policy 0, policy_version 1530925 (0.0006) [2023-12-28 06:15:52,259][106226] Updated weights for policy 0, policy_version 1530935 (0.0006) [2023-12-28 06:15:52,457][106225] Updated weights for policy 1, policy_version 1534652 (0.0010) [2023-12-28 06:15:52,518][106225] Updated weights for policy 1, policy_version 1534662 (0.0008) [2023-12-28 06:15:52,591][106225] Updated weights for policy 1, policy_version 1534672 (0.0006) [2023-12-28 06:15:52,935][106226] Updated weights for policy 0, policy_version 1530945 (0.0010) [2023-12-28 06:15:52,982][106226] Updated weights for policy 0, policy_version 1530955 (0.0010) [2023-12-28 06:15:53,028][106226] Updated weights for policy 0, policy_version 1530965 (0.0010) [2023-12-28 06:15:53,270][106225] Updated weights for policy 1, policy_version 1534682 (0.0009) [2023-12-28 06:15:53,333][106225] Updated weights for policy 1, policy_version 1534692 (0.0010) [2023-12-28 06:15:53,386][106225] Updated weights for policy 1, policy_version 1534702 (0.0010) [2023-12-28 06:15:53,436][106225] Updated weights for policy 1, policy_version 1534712 (0.0010) [2023-12-28 06:15:53,716][106226] Updated weights for policy 0, policy_version 1530975 (0.0009) [2023-12-28 06:15:53,780][106226] Updated weights for policy 0, policy_version 1530985 (0.0007) [2023-12-28 06:15:53,836][106226] Updated weights for policy 0, policy_version 1530995 (0.0007) [2023-12-28 06:15:54,110][106225] Updated weights for policy 1, policy_version 1534722 (0.0010) [2023-12-28 06:15:54,167][106225] Updated weights for policy 1, policy_version 1534732 (0.0005) [2023-12-28 06:15:54,221][106225] Updated weights for policy 1, policy_version 1534742 (0.0005) [2023-12-28 06:15:54,509][106226] Updated weights for policy 0, policy_version 1531005 (0.0009) [2023-12-28 06:15:54,565][106226] Updated weights for policy 0, policy_version 1531015 (0.0005) [2023-12-28 06:15:54,617][106226] Updated weights for policy 0, policy_version 1531025 (0.0007) [2023-12-28 06:15:54,859][106225] Updated weights for policy 1, policy_version 1534752 (0.0009) [2023-12-28 06:15:54,910][106225] Updated weights for policy 1, policy_version 1534762 (0.0008) [2023-12-28 06:15:54,956][106225] Updated weights for policy 1, policy_version 1534772 (0.0010) [2023-12-28 06:15:55,341][106226] Updated weights for policy 0, policy_version 1531035 (0.0008) [2023-12-28 06:15:55,401][106226] Updated weights for policy 0, policy_version 1531045 (0.0006) [2023-12-28 06:15:55,455][106226] Updated weights for policy 0, policy_version 1531055 (0.0005) [2023-12-28 06:15:55,649][106225] Updated weights for policy 1, policy_version 1534782 (0.0009) [2023-12-28 06:15:55,716][106225] Updated weights for policy 1, policy_version 1534792 (0.0007) [2023-12-28 06:15:55,770][106225] Updated weights for policy 1, policy_version 1534802 (0.0008) [2023-12-28 06:15:56,113][106226] Updated weights for policy 0, policy_version 1531065 (0.0007) [2023-12-28 06:15:56,167][106226] Updated weights for policy 0, policy_version 1531075 (0.0009) [2023-12-28 06:15:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 784990208. Throughput: 0: 9983.1, 1: 9693.5. Samples: 784960880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:15:56,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.753')] [2023-12-28 06:15:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001534808_392962048.pth... [2023-12-28 06:15:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001533656_392667136.pth [2023-12-28 06:15:56,224][106226] Updated weights for policy 0, policy_version 1531085 (0.0008) [2023-12-28 06:15:56,279][106226] Updated weights for policy 0, policy_version 1531095 (0.0008) [2023-12-28 06:15:56,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001531096_392036352.pth... [2023-12-28 06:15:56,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001529912_391733248.pth [2023-12-28 06:15:56,388][106225] Updated weights for policy 1, policy_version 1534812 (0.0007) [2023-12-28 06:15:56,456][106225] Updated weights for policy 1, policy_version 1534822 (0.0005) [2023-12-28 06:15:56,511][106225] Updated weights for policy 1, policy_version 1534832 (0.0008) [2023-12-28 06:15:57,039][106226] Updated weights for policy 0, policy_version 1531105 (0.0007) [2023-12-28 06:15:57,092][106226] Updated weights for policy 0, policy_version 1531115 (0.0008) [2023-12-28 06:15:57,131][106225] Updated weights for policy 1, policy_version 1534842 (0.0009) [2023-12-28 06:15:57,152][106226] Updated weights for policy 0, policy_version 1531125 (0.0008) [2023-12-28 06:15:57,188][106225] Updated weights for policy 1, policy_version 1534852 (0.0010) [2023-12-28 06:15:57,241][106225] Updated weights for policy 1, policy_version 1534862 (0.0009) [2023-12-28 06:15:57,288][106225] Updated weights for policy 1, policy_version 1534872 (0.0008) [2023-12-28 06:15:57,898][106226] Updated weights for policy 0, policy_version 1531135 (0.0008) [2023-12-28 06:15:57,954][106226] Updated weights for policy 0, policy_version 1531145 (0.0008) [2023-12-28 06:15:58,008][106226] Updated weights for policy 0, policy_version 1531155 (0.0008) [2023-12-28 06:15:58,023][106225] Updated weights for policy 1, policy_version 1534882 (0.0011) [2023-12-28 06:15:58,080][106225] Updated weights for policy 1, policy_version 1534892 (0.0010) [2023-12-28 06:15:58,146][106225] Updated weights for policy 1, policy_version 1534902 (0.0011) [2023-12-28 06:15:58,900][106226] Updated weights for policy 0, policy_version 1531165 (0.0007) [2023-12-28 06:15:58,933][106225] Updated weights for policy 1, policy_version 1534912 (0.0008) [2023-12-28 06:15:58,973][106226] Updated weights for policy 0, policy_version 1531175 (0.0008) [2023-12-28 06:15:58,999][106225] Updated weights for policy 1, policy_version 1534922 (0.0006) [2023-12-28 06:15:59,039][106226] Updated weights for policy 0, policy_version 1531185 (0.0008) [2023-12-28 06:15:59,057][106225] Updated weights for policy 1, policy_version 1534932 (0.0007) [2023-12-28 06:15:59,771][106226] Updated weights for policy 0, policy_version 1531195 (0.0008) [2023-12-28 06:15:59,820][106226] Updated weights for policy 0, policy_version 1531205 (0.0008) [2023-12-28 06:15:59,865][106225] Updated weights for policy 1, policy_version 1534942 (0.0008) [2023-12-28 06:15:59,888][106226] Updated weights for policy 0, policy_version 1531215 (0.0007) [2023-12-28 06:15:59,928][106225] Updated weights for policy 1, policy_version 1534952 (0.0006) [2023-12-28 06:15:59,984][106225] Updated weights for policy 1, policy_version 1534962 (0.0006) [2023-12-28 06:16:00,582][106226] Updated weights for policy 0, policy_version 1531225 (0.0007) [2023-12-28 06:16:00,637][106226] Updated weights for policy 0, policy_version 1531235 (0.0006) [2023-12-28 06:16:00,654][106225] Updated weights for policy 1, policy_version 1534972 (0.0007) [2023-12-28 06:16:00,698][106226] Updated weights for policy 0, policy_version 1531245 (0.0008) [2023-12-28 06:16:00,716][106225] Updated weights for policy 1, policy_version 1534982 (0.0006) [2023-12-28 06:16:00,750][106226] Updated weights for policy 0, policy_version 1531255 (0.0010) [2023-12-28 06:16:00,767][106225] Updated weights for policy 1, policy_version 1534992 (0.0005) [2023-12-28 06:16:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 785088512. Throughput: 0: 9951.0, 1: 9779.8. Samples: 785077424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:01,175][105115] Avg episode reward: [(0, '-4.928'), (1, '-4.674')] [2023-12-28 06:16:01,400][106225] Updated weights for policy 1, policy_version 1535002 (0.0006) [2023-12-28 06:16:01,441][106226] Updated weights for policy 0, policy_version 1531265 (0.0008) [2023-12-28 06:16:01,459][106225] Updated weights for policy 1, policy_version 1535012 (0.0006) [2023-12-28 06:16:01,505][106226] Updated weights for policy 0, policy_version 1531275 (0.0008) [2023-12-28 06:16:01,512][106225] Updated weights for policy 1, policy_version 1535022 (0.0006) [2023-12-28 06:16:01,569][106225] Updated weights for policy 1, policy_version 1535032 (0.0006) [2023-12-28 06:16:01,574][106226] Updated weights for policy 0, policy_version 1531285 (0.0008) [2023-12-28 06:16:02,254][106226] Updated weights for policy 0, policy_version 1531295 (0.0007) [2023-12-28 06:16:02,313][106226] Updated weights for policy 0, policy_version 1531305 (0.0006) [2023-12-28 06:16:02,318][106225] Updated weights for policy 1, policy_version 1535043 (0.0010) [2023-12-28 06:16:02,369][106226] Updated weights for policy 0, policy_version 1531315 (0.0007) [2023-12-28 06:16:02,377][106225] Updated weights for policy 1, policy_version 1535053 (0.0007) [2023-12-28 06:16:02,433][106225] Updated weights for policy 1, policy_version 1535063 (0.0006) [2023-12-28 06:16:03,040][106226] Updated weights for policy 0, policy_version 1531325 (0.0008) [2023-12-28 06:16:03,088][106226] Updated weights for policy 0, policy_version 1531335 (0.0007) [2023-12-28 06:16:03,105][106225] Updated weights for policy 1, policy_version 1535073 (0.0006) [2023-12-28 06:16:03,152][106226] Updated weights for policy 0, policy_version 1531345 (0.0007) [2023-12-28 06:16:03,162][106225] Updated weights for policy 1, policy_version 1535083 (0.0007) [2023-12-28 06:16:03,211][106225] Updated weights for policy 1, policy_version 1535093 (0.0006) [2023-12-28 06:16:03,866][106226] Updated weights for policy 0, policy_version 1531355 (0.0009) [2023-12-28 06:16:03,928][106226] Updated weights for policy 0, policy_version 1531365 (0.0011) [2023-12-28 06:16:03,952][106225] Updated weights for policy 1, policy_version 1535103 (0.0007) [2023-12-28 06:16:03,989][106226] Updated weights for policy 0, policy_version 1531375 (0.0011) [2023-12-28 06:16:04,015][106225] Updated weights for policy 1, policy_version 1535113 (0.0006) [2023-12-28 06:16:04,076][106225] Updated weights for policy 1, policy_version 1535123 (0.0008) [2023-12-28 06:16:04,650][106226] Updated weights for policy 0, policy_version 1531385 (0.0009) [2023-12-28 06:16:04,704][106226] Updated weights for policy 0, policy_version 1531395 (0.0005) [2023-12-28 06:16:04,759][106226] Updated weights for policy 0, policy_version 1531405 (0.0006) [2023-12-28 06:16:04,812][106226] Updated weights for policy 0, policy_version 1531415 (0.0007) [2023-12-28 06:16:04,858][106225] Updated weights for policy 1, policy_version 1535133 (0.0009) [2023-12-28 06:16:04,912][106225] Updated weights for policy 1, policy_version 1535143 (0.0008) [2023-12-28 06:16:04,961][106225] Updated weights for policy 1, policy_version 1535153 (0.0008) [2023-12-28 06:16:05,438][106226] Updated weights for policy 0, policy_version 1531425 (0.0005) [2023-12-28 06:16:05,501][106226] Updated weights for policy 0, policy_version 1531435 (0.0005) [2023-12-28 06:16:05,570][106226] Updated weights for policy 0, policy_version 1531445 (0.0008) [2023-12-28 06:16:05,735][106225] Updated weights for policy 1, policy_version 1535163 (0.0009) [2023-12-28 06:16:05,799][106225] Updated weights for policy 1, policy_version 1535173 (0.0008) [2023-12-28 06:16:05,857][106225] Updated weights for policy 1, policy_version 1535183 (0.0008) [2023-12-28 06:16:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 785186816. Throughput: 0: 9985.5, 1: 9780.3. Samples: 785197972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:06,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.575')] [2023-12-28 06:16:06,203][106226] Updated weights for policy 0, policy_version 1531455 (0.0009) [2023-12-28 06:16:06,269][106226] Updated weights for policy 0, policy_version 1531465 (0.0008) [2023-12-28 06:16:06,329][106226] Updated weights for policy 0, policy_version 1531475 (0.0006) [2023-12-28 06:16:06,596][106225] Updated weights for policy 1, policy_version 1535193 (0.0008) [2023-12-28 06:16:06,655][106225] Updated weights for policy 1, policy_version 1535203 (0.0006) [2023-12-28 06:16:06,712][106225] Updated weights for policy 1, policy_version 1535213 (0.0005) [2023-12-28 06:16:06,770][106225] Updated weights for policy 1, policy_version 1535223 (0.0007) [2023-12-28 06:16:07,047][106226] Updated weights for policy 0, policy_version 1531485 (0.0007) [2023-12-28 06:16:07,101][106226] Updated weights for policy 0, policy_version 1531495 (0.0008) [2023-12-28 06:16:07,162][106226] Updated weights for policy 0, policy_version 1531505 (0.0005) [2023-12-28 06:16:07,449][106225] Updated weights for policy 1, policy_version 1535233 (0.0008) [2023-12-28 06:16:07,505][106225] Updated weights for policy 1, policy_version 1535243 (0.0008) [2023-12-28 06:16:07,568][106225] Updated weights for policy 1, policy_version 1535253 (0.0007) [2023-12-28 06:16:07,799][106226] Updated weights for policy 0, policy_version 1531515 (0.0006) [2023-12-28 06:16:07,848][106226] Updated weights for policy 0, policy_version 1531525 (0.0010) [2023-12-28 06:16:07,902][106226] Updated weights for policy 0, policy_version 1531535 (0.0010) [2023-12-28 06:16:08,166][106225] Updated weights for policy 1, policy_version 1535263 (0.0006) [2023-12-28 06:16:08,229][106225] Updated weights for policy 1, policy_version 1535273 (0.0006) [2023-12-28 06:16:08,283][106225] Updated weights for policy 1, policy_version 1535283 (0.0005) [2023-12-28 06:16:08,724][106226] Updated weights for policy 0, policy_version 1531545 (0.0008) [2023-12-28 06:16:08,790][106226] Updated weights for policy 0, policy_version 1531555 (0.0008) [2023-12-28 06:16:08,854][106226] Updated weights for policy 0, policy_version 1531565 (0.0009) [2023-12-28 06:16:08,912][106226] Updated weights for policy 0, policy_version 1531575 (0.0009) [2023-12-28 06:16:08,939][106225] Updated weights for policy 1, policy_version 1535293 (0.0006) [2023-12-28 06:16:09,000][106225] Updated weights for policy 1, policy_version 1535303 (0.0006) [2023-12-28 06:16:09,069][106225] Updated weights for policy 1, policy_version 1535313 (0.0005) [2023-12-28 06:16:09,688][106225] Updated weights for policy 1, policy_version 1535323 (0.0007) [2023-12-28 06:16:09,704][106226] Updated weights for policy 0, policy_version 1531585 (0.0005) [2023-12-28 06:16:09,747][106225] Updated weights for policy 1, policy_version 1535333 (0.0011) [2023-12-28 06:16:09,764][106226] Updated weights for policy 0, policy_version 1531595 (0.0006) [2023-12-28 06:16:09,808][106225] Updated weights for policy 1, policy_version 1535343 (0.0011) [2023-12-28 06:16:09,828][106226] Updated weights for policy 0, policy_version 1531605 (0.0009) [2023-12-28 06:16:10,548][106225] Updated weights for policy 1, policy_version 1535353 (0.0010) [2023-12-28 06:16:10,559][106226] Updated weights for policy 0, policy_version 1531615 (0.0008) [2023-12-28 06:16:10,600][106225] Updated weights for policy 1, policy_version 1535363 (0.0010) [2023-12-28 06:16:10,614][106226] Updated weights for policy 0, policy_version 1531625 (0.0005) [2023-12-28 06:16:10,654][106225] Updated weights for policy 1, policy_version 1535373 (0.0010) [2023-12-28 06:16:10,671][106226] Updated weights for policy 0, policy_version 1531635 (0.0005) [2023-12-28 06:16:10,707][106225] Updated weights for policy 1, policy_version 1535383 (0.0010) [2023-12-28 06:16:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 785285120. Throughput: 0: 9966.2, 1: 9872.1. Samples: 785257428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:11,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-4.807')] [2023-12-28 06:16:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001535384_393109504.pth... [2023-12-28 06:16:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001531640_392175616.pth... [2023-12-28 06:16:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001534232_392814592.pth [2023-12-28 06:16:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001530488_391880704.pth [2023-12-28 06:16:11,469][106225] Updated weights for policy 1, policy_version 1535393 (0.0011) [2023-12-28 06:16:11,483][106226] Updated weights for policy 0, policy_version 1531645 (0.0006) [2023-12-28 06:16:11,535][106225] Updated weights for policy 1, policy_version 1535403 (0.0008) [2023-12-28 06:16:11,552][106226] Updated weights for policy 0, policy_version 1531655 (0.0006) [2023-12-28 06:16:11,599][106225] Updated weights for policy 1, policy_version 1535413 (0.0007) [2023-12-28 06:16:11,614][106226] Updated weights for policy 0, policy_version 1531665 (0.0008) [2023-12-28 06:16:12,294][106225] Updated weights for policy 1, policy_version 1535423 (0.0008) [2023-12-28 06:16:12,365][106225] Updated weights for policy 1, policy_version 1535433 (0.0010) [2023-12-28 06:16:12,387][106226] Updated weights for policy 0, policy_version 1531675 (0.0009) [2023-12-28 06:16:12,430][106225] Updated weights for policy 1, policy_version 1535443 (0.0011) [2023-12-28 06:16:12,451][106226] Updated weights for policy 0, policy_version 1531685 (0.0006) [2023-12-28 06:16:12,521][106226] Updated weights for policy 0, policy_version 1531695 (0.0008) [2023-12-28 06:16:13,075][106225] Updated weights for policy 1, policy_version 1535453 (0.0006) [2023-12-28 06:16:13,116][106226] Updated weights for policy 0, policy_version 1531705 (0.0008) [2023-12-28 06:16:13,133][106225] Updated weights for policy 1, policy_version 1535463 (0.0009) [2023-12-28 06:16:13,176][106226] Updated weights for policy 0, policy_version 1531715 (0.0007) [2023-12-28 06:16:13,196][106225] Updated weights for policy 1, policy_version 1535473 (0.0007) [2023-12-28 06:16:13,238][106226] Updated weights for policy 0, policy_version 1531725 (0.0007) [2023-12-28 06:16:13,288][106226] Updated weights for policy 0, policy_version 1531735 (0.0008) [2023-12-28 06:16:13,837][106225] Updated weights for policy 1, policy_version 1535483 (0.0008) [2023-12-28 06:16:13,903][106225] Updated weights for policy 1, policy_version 1535493 (0.0011) [2023-12-28 06:16:13,971][106225] Updated weights for policy 1, policy_version 1535503 (0.0011) [2023-12-28 06:16:14,021][106226] Updated weights for policy 0, policy_version 1531745 (0.0007) [2023-12-28 06:16:14,079][106226] Updated weights for policy 0, policy_version 1531755 (0.0005) [2023-12-28 06:16:14,142][106226] Updated weights for policy 0, policy_version 1531765 (0.0007) [2023-12-28 06:16:14,676][106225] Updated weights for policy 1, policy_version 1535513 (0.0010) [2023-12-28 06:16:14,732][106225] Updated weights for policy 1, policy_version 1535523 (0.0005) [2023-12-28 06:16:14,804][106225] Updated weights for policy 1, policy_version 1535533 (0.0008) [2023-12-28 06:16:14,806][106226] Updated weights for policy 0, policy_version 1531775 (0.0008) [2023-12-28 06:16:14,858][106226] Updated weights for policy 0, policy_version 1531785 (0.0006) [2023-12-28 06:16:14,861][106225] Updated weights for policy 1, policy_version 1535543 (0.0008) [2023-12-28 06:16:14,927][106226] Updated weights for policy 0, policy_version 1531795 (0.0006) [2023-12-28 06:16:15,573][106226] Updated weights for policy 0, policy_version 1531805 (0.0009) [2023-12-28 06:16:15,595][106225] Updated weights for policy 1, policy_version 1535553 (0.0010) [2023-12-28 06:16:15,628][106226] Updated weights for policy 0, policy_version 1531815 (0.0007) [2023-12-28 06:16:15,648][106225] Updated weights for policy 1, policy_version 1535563 (0.0010) [2023-12-28 06:16:15,685][106226] Updated weights for policy 0, policy_version 1531825 (0.0005) [2023-12-28 06:16:15,695][106225] Updated weights for policy 1, policy_version 1535573 (0.0010) [2023-12-28 06:16:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 785383424. Throughput: 0: 9853.5, 1: 9924.2. Samples: 785374064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:16,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.407')] [2023-12-28 06:16:16,321][106225] Updated weights for policy 1, policy_version 1535583 (0.0010) [2023-12-28 06:16:16,370][106225] Updated weights for policy 1, policy_version 1535593 (0.0010) [2023-12-28 06:16:16,420][106225] Updated weights for policy 1, policy_version 1535603 (0.0010) [2023-12-28 06:16:16,431][106226] Updated weights for policy 0, policy_version 1531835 (0.0006) [2023-12-28 06:16:16,476][106226] Updated weights for policy 0, policy_version 1531845 (0.0005) [2023-12-28 06:16:16,531][106226] Updated weights for policy 0, policy_version 1531855 (0.0007) [2023-12-28 06:16:17,132][106225] Updated weights for policy 1, policy_version 1535613 (0.0010) [2023-12-28 06:16:17,179][106225] Updated weights for policy 1, policy_version 1535623 (0.0010) [2023-12-28 06:16:17,192][106226] Updated weights for policy 0, policy_version 1531865 (0.0007) [2023-12-28 06:16:17,229][106225] Updated weights for policy 1, policy_version 1535633 (0.0010) [2023-12-28 06:16:17,250][106226] Updated weights for policy 0, policy_version 1531875 (0.0005) [2023-12-28 06:16:17,307][106226] Updated weights for policy 0, policy_version 1531885 (0.0008) [2023-12-28 06:16:17,364][106226] Updated weights for policy 0, policy_version 1531895 (0.0008) [2023-12-28 06:16:17,967][106225] Updated weights for policy 1, policy_version 1535643 (0.0010) [2023-12-28 06:16:17,983][106226] Updated weights for policy 0, policy_version 1531905 (0.0009) [2023-12-28 06:16:18,028][106225] Updated weights for policy 1, policy_version 1535653 (0.0009) [2023-12-28 06:16:18,055][106226] Updated weights for policy 0, policy_version 1531915 (0.0006) [2023-12-28 06:16:18,081][106225] Updated weights for policy 1, policy_version 1535663 (0.0010) [2023-12-28 06:16:18,111][106226] Updated weights for policy 0, policy_version 1531925 (0.0007) [2023-12-28 06:16:18,702][106226] Updated weights for policy 0, policy_version 1531935 (0.0006) [2023-12-28 06:16:18,764][106226] Updated weights for policy 0, policy_version 1531945 (0.0005) [2023-12-28 06:16:18,789][106225] Updated weights for policy 1, policy_version 1535673 (0.0010) [2023-12-28 06:16:18,825][106226] Updated weights for policy 0, policy_version 1531955 (0.0006) [2023-12-28 06:16:18,850][106225] Updated weights for policy 1, policy_version 1535683 (0.0011) [2023-12-28 06:16:18,909][106225] Updated weights for policy 1, policy_version 1535693 (0.0008) [2023-12-28 06:16:18,972][106225] Updated weights for policy 1, policy_version 1535703 (0.0010) [2023-12-28 06:16:19,582][106226] Updated weights for policy 0, policy_version 1531965 (0.0007) [2023-12-28 06:16:19,651][106226] Updated weights for policy 0, policy_version 1531975 (0.0008) [2023-12-28 06:16:19,716][106226] Updated weights for policy 0, policy_version 1531985 (0.0005) [2023-12-28 06:16:19,722][106225] Updated weights for policy 1, policy_version 1535713 (0.0010) [2023-12-28 06:16:19,787][106225] Updated weights for policy 1, policy_version 1535723 (0.0010) [2023-12-28 06:16:19,853][106225] Updated weights for policy 1, policy_version 1535733 (0.0010) [2023-12-28 06:16:20,506][106226] Updated weights for policy 0, policy_version 1531995 (0.0006) [2023-12-28 06:16:20,572][106226] Updated weights for policy 0, policy_version 1532005 (0.0006) [2023-12-28 06:16:20,609][106225] Updated weights for policy 1, policy_version 1535743 (0.0009) [2023-12-28 06:16:20,641][106226] Updated weights for policy 0, policy_version 1532015 (0.0007) [2023-12-28 06:16:20,672][106225] Updated weights for policy 1, policy_version 1535753 (0.0006) [2023-12-28 06:16:20,736][106225] Updated weights for policy 1, policy_version 1535763 (0.0006) [2023-12-28 06:16:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 785481728. Throughput: 0: 9866.5, 1: 9841.1. Samples: 785492948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:21,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-4.561')] [2023-12-28 06:16:21,278][106226] Updated weights for policy 0, policy_version 1532025 (0.0006) [2023-12-28 06:16:21,340][106226] Updated weights for policy 0, policy_version 1532035 (0.0008) [2023-12-28 06:16:21,411][106226] Updated weights for policy 0, policy_version 1532045 (0.0009) [2023-12-28 06:16:21,443][106225] Updated weights for policy 1, policy_version 1535773 (0.0007) [2023-12-28 06:16:21,468][106226] Updated weights for policy 0, policy_version 1532055 (0.0005) [2023-12-28 06:16:21,502][106225] Updated weights for policy 1, policy_version 1535783 (0.0008) [2023-12-28 06:16:21,554][106225] Updated weights for policy 1, policy_version 1535793 (0.0008) [2023-12-28 06:16:22,218][106226] Updated weights for policy 0, policy_version 1532065 (0.0009) [2023-12-28 06:16:22,282][106225] Updated weights for policy 1, policy_version 1535803 (0.0008) [2023-12-28 06:16:22,292][106226] Updated weights for policy 0, policy_version 1532075 (0.0008) [2023-12-28 06:16:22,347][106225] Updated weights for policy 1, policy_version 1535813 (0.0007) [2023-12-28 06:16:22,361][106226] Updated weights for policy 0, policy_version 1532085 (0.0007) [2023-12-28 06:16:22,412][106225] Updated weights for policy 1, policy_version 1535823 (0.0009) [2023-12-28 06:16:23,021][106226] Updated weights for policy 0, policy_version 1532095 (0.0006) [2023-12-28 06:16:23,084][106226] Updated weights for policy 0, policy_version 1532105 (0.0007) [2023-12-28 06:16:23,088][106225] Updated weights for policy 1, policy_version 1535833 (0.0008) [2023-12-28 06:16:23,140][106225] Updated weights for policy 1, policy_version 1535843 (0.0006) [2023-12-28 06:16:23,144][106226] Updated weights for policy 0, policy_version 1532115 (0.0009) [2023-12-28 06:16:23,194][106225] Updated weights for policy 1, policy_version 1535853 (0.0008) [2023-12-28 06:16:23,242][106225] Updated weights for policy 1, policy_version 1535863 (0.0008) [2023-12-28 06:16:23,820][106226] Updated weights for policy 0, policy_version 1532125 (0.0010) [2023-12-28 06:16:23,841][106225] Updated weights for policy 1, policy_version 1535873 (0.0006) [2023-12-28 06:16:23,871][106226] Updated weights for policy 0, policy_version 1532135 (0.0010) [2023-12-28 06:16:23,897][106225] Updated weights for policy 1, policy_version 1535883 (0.0006) [2023-12-28 06:16:23,935][106226] Updated weights for policy 0, policy_version 1532145 (0.0007) [2023-12-28 06:16:23,957][106225] Updated weights for policy 1, policy_version 1535893 (0.0008) [2023-12-28 06:16:24,618][106226] Updated weights for policy 0, policy_version 1532155 (0.0006) [2023-12-28 06:16:24,676][106226] Updated weights for policy 0, policy_version 1532165 (0.0009) [2023-12-28 06:16:24,688][106225] Updated weights for policy 1, policy_version 1535903 (0.0008) [2023-12-28 06:16:24,729][106226] Updated weights for policy 0, policy_version 1532175 (0.0007) [2023-12-28 06:16:24,735][106225] Updated weights for policy 1, policy_version 1535913 (0.0007) [2023-12-28 06:16:24,780][106225] Updated weights for policy 1, policy_version 1535923 (0.0007) [2023-12-28 06:16:25,399][106226] Updated weights for policy 0, policy_version 1532185 (0.0008) [2023-12-28 06:16:25,447][106226] Updated weights for policy 0, policy_version 1532195 (0.0008) [2023-12-28 06:16:25,495][106226] Updated weights for policy 0, policy_version 1532205 (0.0008) [2023-12-28 06:16:25,545][106226] Updated weights for policy 0, policy_version 1532215 (0.0009) [2023-12-28 06:16:25,552][106225] Updated weights for policy 1, policy_version 1535933 (0.0008) [2023-12-28 06:16:25,609][106225] Updated weights for policy 1, policy_version 1535943 (0.0006) [2023-12-28 06:16:25,668][106225] Updated weights for policy 1, policy_version 1535953 (0.0009) [2023-12-28 06:16:26,140][106226] Updated weights for policy 0, policy_version 1532225 (0.0008) [2023-12-28 06:16:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 785580032. Throughput: 0: 9859.7, 1: 9901.0. Samples: 785552332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:26,175][105115] Avg episode reward: [(0, '-4.741'), (1, '-5.000')] [2023-12-28 06:16:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001535960_393256960.pth... [2023-12-28 06:16:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001534808_392962048.pth [2023-12-28 06:16:26,194][106226] Updated weights for policy 0, policy_version 1532235 (0.0007) [2023-12-28 06:16:26,246][106226] Updated weights for policy 0, policy_version 1532245 (0.0006) [2023-12-28 06:16:26,260][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001532248_392331264.pth... [2023-12-28 06:16:26,263][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001531096_392036352.pth [2023-12-28 06:16:26,466][106225] Updated weights for policy 1, policy_version 1535963 (0.0008) [2023-12-28 06:16:26,524][106225] Updated weights for policy 1, policy_version 1535973 (0.0009) [2023-12-28 06:16:26,590][106225] Updated weights for policy 1, policy_version 1535983 (0.0009) [2023-12-28 06:16:26,818][106226] Updated weights for policy 0, policy_version 1532255 (0.0008) [2023-12-28 06:16:26,866][106226] Updated weights for policy 0, policy_version 1532265 (0.0009) [2023-12-28 06:16:26,916][106226] Updated weights for policy 0, policy_version 1532275 (0.0008) [2023-12-28 06:16:27,383][106225] Updated weights for policy 1, policy_version 1535993 (0.0007) [2023-12-28 06:16:27,437][106225] Updated weights for policy 1, policy_version 1536003 (0.0008) [2023-12-28 06:16:27,492][106225] Updated weights for policy 1, policy_version 1536013 (0.0008) [2023-12-28 06:16:27,545][106225] Updated weights for policy 1, policy_version 1536023 (0.0008) [2023-12-28 06:16:27,569][106226] Updated weights for policy 0, policy_version 1532285 (0.0008) [2023-12-28 06:16:27,624][106226] Updated weights for policy 0, policy_version 1532295 (0.0009) [2023-12-28 06:16:27,683][106226] Updated weights for policy 0, policy_version 1532305 (0.0008) [2023-12-28 06:16:28,234][106225] Updated weights for policy 1, policy_version 1536033 (0.0008) [2023-12-28 06:16:28,293][106225] Updated weights for policy 1, policy_version 1536043 (0.0009) [2023-12-28 06:16:28,370][106225] Updated weights for policy 1, policy_version 1536053 (0.0008) [2023-12-28 06:16:28,421][106226] Updated weights for policy 0, policy_version 1532315 (0.0008) [2023-12-28 06:16:28,484][106226] Updated weights for policy 0, policy_version 1532325 (0.0009) [2023-12-28 06:16:28,551][106226] Updated weights for policy 0, policy_version 1532335 (0.0009) [2023-12-28 06:16:29,172][106225] Updated weights for policy 1, policy_version 1536063 (0.0007) [2023-12-28 06:16:29,244][106225] Updated weights for policy 1, policy_version 1536073 (0.0007) [2023-12-28 06:16:29,256][106226] Updated weights for policy 0, policy_version 1532345 (0.0007) [2023-12-28 06:16:29,304][106225] Updated weights for policy 1, policy_version 1536083 (0.0008) [2023-12-28 06:16:29,322][106226] Updated weights for policy 0, policy_version 1532355 (0.0009) [2023-12-28 06:16:29,386][106226] Updated weights for policy 0, policy_version 1532365 (0.0009) [2023-12-28 06:16:29,442][106226] Updated weights for policy 0, policy_version 1532375 (0.0009) [2023-12-28 06:16:30,068][106225] Updated weights for policy 1, policy_version 1536093 (0.0009) [2023-12-28 06:16:30,122][106225] Updated weights for policy 1, policy_version 1536103 (0.0008) [2023-12-28 06:16:30,148][106226] Updated weights for policy 0, policy_version 1532385 (0.0006) [2023-12-28 06:16:30,189][106225] Updated weights for policy 1, policy_version 1536113 (0.0007) [2023-12-28 06:16:30,216][106226] Updated weights for policy 0, policy_version 1532395 (0.0008) [2023-12-28 06:16:30,281][106226] Updated weights for policy 0, policy_version 1532405 (0.0008) [2023-12-28 06:16:30,916][106226] Updated weights for policy 0, policy_version 1532415 (0.0009) [2023-12-28 06:16:30,960][106225] Updated weights for policy 1, policy_version 1536123 (0.0007) [2023-12-28 06:16:30,978][106226] Updated weights for policy 0, policy_version 1532425 (0.0008) [2023-12-28 06:16:31,009][106225] Updated weights for policy 1, policy_version 1536133 (0.0006) [2023-12-28 06:16:31,032][106226] Updated weights for policy 0, policy_version 1532435 (0.0007) [2023-12-28 06:16:31,070][106225] Updated weights for policy 1, policy_version 1536143 (0.0008) [2023-12-28 06:16:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 785686528. Throughput: 0: 9954.5, 1: 9861.9. Samples: 785670304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:31,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.025')] [2023-12-28 06:16:31,760][106226] Updated weights for policy 0, policy_version 1532445 (0.0008) [2023-12-28 06:16:31,815][106226] Updated weights for policy 0, policy_version 1532455 (0.0008) [2023-12-28 06:16:31,850][106225] Updated weights for policy 1, policy_version 1536153 (0.0008) [2023-12-28 06:16:31,875][106226] Updated weights for policy 0, policy_version 1532465 (0.0009) [2023-12-28 06:16:31,904][106225] Updated weights for policy 1, policy_version 1536163 (0.0007) [2023-12-28 06:16:31,970][106225] Updated weights for policy 1, policy_version 1536173 (0.0008) [2023-12-28 06:16:32,032][106225] Updated weights for policy 1, policy_version 1536183 (0.0008) [2023-12-28 06:16:32,656][106225] Updated weights for policy 1, policy_version 1536193 (0.0010) [2023-12-28 06:16:32,667][106226] Updated weights for policy 0, policy_version 1532475 (0.0008) [2023-12-28 06:16:32,709][106225] Updated weights for policy 1, policy_version 1536203 (0.0006) [2023-12-28 06:16:32,721][106226] Updated weights for policy 0, policy_version 1532485 (0.0009) [2023-12-28 06:16:32,764][106225] Updated weights for policy 1, policy_version 1536213 (0.0008) [2023-12-28 06:16:32,782][106226] Updated weights for policy 0, policy_version 1532495 (0.0009) [2023-12-28 06:16:33,443][106226] Updated weights for policy 0, policy_version 1532505 (0.0009) [2023-12-28 06:16:33,506][106225] Updated weights for policy 1, policy_version 1536223 (0.0006) [2023-12-28 06:16:33,509][106226] Updated weights for policy 0, policy_version 1532515 (0.0011) [2023-12-28 06:16:33,555][106225] Updated weights for policy 1, policy_version 1536233 (0.0005) [2023-12-28 06:16:33,568][106226] Updated weights for policy 0, policy_version 1532525 (0.0010) [2023-12-28 06:16:33,619][106225] Updated weights for policy 1, policy_version 1536243 (0.0006) [2023-12-28 06:16:33,621][106226] Updated weights for policy 0, policy_version 1532535 (0.0010) [2023-12-28 06:16:34,182][106225] Updated weights for policy 1, policy_version 1536253 (0.0008) [2023-12-28 06:16:34,240][106225] Updated weights for policy 1, policy_version 1536263 (0.0007) [2023-12-28 06:16:34,313][106225] Updated weights for policy 1, policy_version 1536273 (0.0009) [2023-12-28 06:16:34,369][106226] Updated weights for policy 0, policy_version 1532545 (0.0011) [2023-12-28 06:16:34,427][106226] Updated weights for policy 0, policy_version 1532555 (0.0011) [2023-12-28 06:16:34,488][106226] Updated weights for policy 0, policy_version 1532566 (0.0010) [2023-12-28 06:16:35,026][106225] Updated weights for policy 1, policy_version 1536283 (0.0008) [2023-12-28 06:16:35,097][106225] Updated weights for policy 1, policy_version 1536293 (0.0007) [2023-12-28 06:16:35,130][106226] Updated weights for policy 0, policy_version 1532576 (0.0006) [2023-12-28 06:16:35,152][106225] Updated weights for policy 1, policy_version 1536303 (0.0010) [2023-12-28 06:16:35,182][106226] Updated weights for policy 0, policy_version 1532586 (0.0005) [2023-12-28 06:16:35,236][106226] Updated weights for policy 0, policy_version 1532596 (0.0005) [2023-12-28 06:16:35,833][106226] Updated weights for policy 0, policy_version 1532606 (0.0007) [2023-12-28 06:16:35,838][106225] Updated weights for policy 1, policy_version 1536313 (0.0010) [2023-12-28 06:16:35,891][106225] Updated weights for policy 1, policy_version 1536323 (0.0010) [2023-12-28 06:16:35,897][106226] Updated weights for policy 0, policy_version 1532616 (0.0009) [2023-12-28 06:16:35,941][106225] Updated weights for policy 1, policy_version 1536333 (0.0010) [2023-12-28 06:16:35,954][106226] Updated weights for policy 0, policy_version 1532626 (0.0010) [2023-12-28 06:16:35,998][106225] Updated weights for policy 1, policy_version 1536343 (0.0010) [2023-12-28 06:16:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 785784832. Throughput: 0: 9908.8, 1: 9820.3. Samples: 785789760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:36,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-4.547')] [2023-12-28 06:16:36,682][106225] Updated weights for policy 1, policy_version 1536353 (0.0007) [2023-12-28 06:16:36,687][106226] Updated weights for policy 0, policy_version 1532636 (0.0010) [2023-12-28 06:16:36,746][106225] Updated weights for policy 1, policy_version 1536363 (0.0006) [2023-12-28 06:16:36,755][106226] Updated weights for policy 0, policy_version 1532646 (0.0009) [2023-12-28 06:16:36,796][106225] Updated weights for policy 1, policy_version 1536373 (0.0006) [2023-12-28 06:16:36,821][106226] Updated weights for policy 0, policy_version 1532656 (0.0009) [2023-12-28 06:16:37,445][106225] Updated weights for policy 1, policy_version 1536383 (0.0010) [2023-12-28 06:16:37,491][106226] Updated weights for policy 0, policy_version 1532666 (0.0008) [2023-12-28 06:16:37,494][106225] Updated weights for policy 1, policy_version 1536393 (0.0008) [2023-12-28 06:16:37,544][106226] Updated weights for policy 0, policy_version 1532676 (0.0008) [2023-12-28 06:16:37,546][106225] Updated weights for policy 1, policy_version 1536403 (0.0006) [2023-12-28 06:16:37,596][106226] Updated weights for policy 0, policy_version 1532686 (0.0006) [2023-12-28 06:16:37,646][106226] Updated weights for policy 0, policy_version 1532696 (0.0008) [2023-12-28 06:16:38,246][106225] Updated weights for policy 1, policy_version 1536413 (0.0010) [2023-12-28 06:16:38,307][106225] Updated weights for policy 1, policy_version 1536423 (0.0010) [2023-12-28 06:16:38,347][106226] Updated weights for policy 0, policy_version 1532706 (0.0009) [2023-12-28 06:16:38,368][106225] Updated weights for policy 1, policy_version 1536433 (0.0009) [2023-12-28 06:16:38,408][106226] Updated weights for policy 0, policy_version 1532716 (0.0008) [2023-12-28 06:16:38,467][106226] Updated weights for policy 0, policy_version 1532726 (0.0008) [2023-12-28 06:16:39,090][106225] Updated weights for policy 1, policy_version 1536443 (0.0010) [2023-12-28 06:16:39,141][106225] Updated weights for policy 1, policy_version 1536453 (0.0010) [2023-12-28 06:16:39,185][106226] Updated weights for policy 0, policy_version 1532736 (0.0007) [2023-12-28 06:16:39,197][106225] Updated weights for policy 1, policy_version 1536463 (0.0010) [2023-12-28 06:16:39,249][106226] Updated weights for policy 0, policy_version 1532746 (0.0007) [2023-12-28 06:16:39,318][106226] Updated weights for policy 0, policy_version 1532756 (0.0008) [2023-12-28 06:16:39,919][106225] Updated weights for policy 1, policy_version 1536473 (0.0010) [2023-12-28 06:16:39,979][106225] Updated weights for policy 1, policy_version 1536483 (0.0007) [2023-12-28 06:16:40,044][106225] Updated weights for policy 1, policy_version 1536493 (0.0009) [2023-12-28 06:16:40,087][106226] Updated weights for policy 0, policy_version 1532766 (0.0008) [2023-12-28 06:16:40,106][106225] Updated weights for policy 1, policy_version 1536503 (0.0011) [2023-12-28 06:16:40,148][106226] Updated weights for policy 0, policy_version 1532776 (0.0009) [2023-12-28 06:16:40,209][106226] Updated weights for policy 0, policy_version 1532786 (0.0008) [2023-12-28 06:16:40,731][106225] Updated weights for policy 1, policy_version 1536513 (0.0006) [2023-12-28 06:16:40,793][106225] Updated weights for policy 1, policy_version 1536523 (0.0005) [2023-12-28 06:16:40,840][106225] Updated weights for policy 1, policy_version 1536533 (0.0005) [2023-12-28 06:16:40,948][106226] Updated weights for policy 0, policy_version 1532796 (0.0008) [2023-12-28 06:16:41,012][106226] Updated weights for policy 0, policy_version 1532806 (0.0006) [2023-12-28 06:16:41,080][106226] Updated weights for policy 0, policy_version 1532816 (0.0008) [2023-12-28 06:16:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 785883136. Throughput: 0: 9921.8, 1: 9833.3. Samples: 785849860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:41,175][105115] Avg episode reward: [(0, '-4.847'), (1, '-4.636')] [2023-12-28 06:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001532824_392478720.pth... [2023-12-28 06:16:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001536536_393404416.pth... [2023-12-28 06:16:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001531640_392175616.pth [2023-12-28 06:16:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001535384_393109504.pth [2023-12-28 06:16:41,581][106225] Updated weights for policy 1, policy_version 1536543 (0.0007) [2023-12-28 06:16:41,638][106225] Updated weights for policy 1, policy_version 1536553 (0.0008) [2023-12-28 06:16:41,706][106225] Updated weights for policy 1, policy_version 1536563 (0.0008) [2023-12-28 06:16:41,838][106226] Updated weights for policy 0, policy_version 1532826 (0.0009) [2023-12-28 06:16:41,903][106226] Updated weights for policy 0, policy_version 1532836 (0.0009) [2023-12-28 06:16:41,965][106226] Updated weights for policy 0, policy_version 1532846 (0.0008) [2023-12-28 06:16:42,028][106226] Updated weights for policy 0, policy_version 1532856 (0.0009) [2023-12-28 06:16:42,473][106225] Updated weights for policy 1, policy_version 1536573 (0.0009) [2023-12-28 06:16:42,533][106225] Updated weights for policy 1, policy_version 1536583 (0.0007) [2023-12-28 06:16:42,586][106225] Updated weights for policy 1, policy_version 1536593 (0.0008) [2023-12-28 06:16:42,777][106226] Updated weights for policy 0, policy_version 1532866 (0.0008) [2023-12-28 06:16:42,835][106226] Updated weights for policy 0, policy_version 1532876 (0.0008) [2023-12-28 06:16:42,893][106226] Updated weights for policy 0, policy_version 1532886 (0.0008) [2023-12-28 06:16:43,336][106225] Updated weights for policy 1, policy_version 1536603 (0.0009) [2023-12-28 06:16:43,387][106225] Updated weights for policy 1, policy_version 1536613 (0.0008) [2023-12-28 06:16:43,438][106225] Updated weights for policy 1, policy_version 1536623 (0.0008) [2023-12-28 06:16:43,558][106226] Updated weights for policy 0, policy_version 1532896 (0.0006) [2023-12-28 06:16:43,620][106226] Updated weights for policy 0, policy_version 1532906 (0.0007) [2023-12-28 06:16:43,688][106226] Updated weights for policy 0, policy_version 1532916 (0.0009) [2023-12-28 06:16:44,219][106225] Updated weights for policy 1, policy_version 1536633 (0.0008) [2023-12-28 06:16:44,273][106226] Updated weights for policy 0, policy_version 1532926 (0.0006) [2023-12-28 06:16:44,276][106225] Updated weights for policy 1, policy_version 1536643 (0.0007) [2023-12-28 06:16:44,340][106226] Updated weights for policy 0, policy_version 1532936 (0.0006) [2023-12-28 06:16:44,341][106225] Updated weights for policy 1, policy_version 1536653 (0.0008) [2023-12-28 06:16:44,403][106226] Updated weights for policy 0, policy_version 1532946 (0.0006) [2023-12-28 06:16:44,404][106225] Updated weights for policy 1, policy_version 1536663 (0.0009) [2023-12-28 06:16:45,075][106226] Updated weights for policy 0, policy_version 1532956 (0.0010) [2023-12-28 06:16:45,128][106225] Updated weights for policy 1, policy_version 1536673 (0.0006) [2023-12-28 06:16:45,141][106226] Updated weights for policy 0, policy_version 1532966 (0.0011) [2023-12-28 06:16:45,189][106225] Updated weights for policy 1, policy_version 1536683 (0.0006) [2023-12-28 06:16:45,200][106226] Updated weights for policy 0, policy_version 1532976 (0.0011) [2023-12-28 06:16:45,246][106225] Updated weights for policy 1, policy_version 1536693 (0.0007) [2023-12-28 06:16:45,906][106226] Updated weights for policy 0, policy_version 1532986 (0.0010) [2023-12-28 06:16:45,912][106225] Updated weights for policy 1, policy_version 1536703 (0.0007) [2023-12-28 06:16:45,955][106226] Updated weights for policy 0, policy_version 1532996 (0.0006) [2023-12-28 06:16:45,979][106225] Updated weights for policy 1, policy_version 1536713 (0.0006) [2023-12-28 06:16:46,008][106226] Updated weights for policy 0, policy_version 1533006 (0.0006) [2023-12-28 06:16:46,034][106225] Updated weights for policy 1, policy_version 1536723 (0.0008) [2023-12-28 06:16:46,061][106226] Updated weights for policy 0, policy_version 1533016 (0.0005) [2023-12-28 06:16:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 785981440. Throughput: 0: 9960.4, 1: 9766.6. Samples: 785965136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:46,175][105115] Avg episode reward: [(0, '-4.811'), (1, '-4.883')] [2023-12-28 06:16:46,692][106226] Updated weights for policy 0, policy_version 1533026 (0.0005) [2023-12-28 06:16:46,751][106225] Updated weights for policy 1, policy_version 1536733 (0.0007) [2023-12-28 06:16:46,755][106226] Updated weights for policy 0, policy_version 1533036 (0.0005) [2023-12-28 06:16:46,811][106225] Updated weights for policy 1, policy_version 1536743 (0.0007) [2023-12-28 06:16:46,816][106226] Updated weights for policy 0, policy_version 1533046 (0.0009) [2023-12-28 06:16:46,862][106225] Updated weights for policy 1, policy_version 1536753 (0.0006) [2023-12-28 06:16:47,396][106226] Updated weights for policy 0, policy_version 1533056 (0.0008) [2023-12-28 06:16:47,413][106225] Updated weights for policy 1, policy_version 1536763 (0.0005) [2023-12-28 06:16:47,455][106226] Updated weights for policy 0, policy_version 1533066 (0.0010) [2023-12-28 06:16:47,472][106225] Updated weights for policy 1, policy_version 1536773 (0.0005) [2023-12-28 06:16:47,509][106226] Updated weights for policy 0, policy_version 1533076 (0.0010) [2023-12-28 06:16:47,526][106225] Updated weights for policy 1, policy_version 1536783 (0.0005) [2023-12-28 06:16:48,157][106226] Updated weights for policy 0, policy_version 1533086 (0.0009) [2023-12-28 06:16:48,208][106225] Updated weights for policy 1, policy_version 1536793 (0.0007) [2023-12-28 06:16:48,218][106226] Updated weights for policy 0, policy_version 1533096 (0.0011) [2023-12-28 06:16:48,257][106225] Updated weights for policy 1, policy_version 1536803 (0.0008) [2023-12-28 06:16:48,273][106226] Updated weights for policy 0, policy_version 1533106 (0.0009) [2023-12-28 06:16:48,313][106225] Updated weights for policy 1, policy_version 1536813 (0.0006) [2023-12-28 06:16:48,375][106225] Updated weights for policy 1, policy_version 1536823 (0.0008) [2023-12-28 06:16:48,944][106226] Updated weights for policy 0, policy_version 1533116 (0.0006) [2023-12-28 06:16:49,008][106226] Updated weights for policy 0, policy_version 1533126 (0.0006) [2023-12-28 06:16:49,069][106225] Updated weights for policy 1, policy_version 1536833 (0.0009) [2023-12-28 06:16:49,070][106226] Updated weights for policy 0, policy_version 1533136 (0.0007) [2023-12-28 06:16:49,121][106225] Updated weights for policy 1, policy_version 1536843 (0.0005) [2023-12-28 06:16:49,176][106225] Updated weights for policy 1, policy_version 1536853 (0.0006) [2023-12-28 06:16:49,684][106226] Updated weights for policy 0, policy_version 1533146 (0.0008) [2023-12-28 06:16:49,748][106226] Updated weights for policy 0, policy_version 1533156 (0.0011) [2023-12-28 06:16:49,809][106226] Updated weights for policy 0, policy_version 1533166 (0.0011) [2023-12-28 06:16:49,868][106226] Updated weights for policy 0, policy_version 1533176 (0.0009) [2023-12-28 06:16:49,894][106225] Updated weights for policy 1, policy_version 1536863 (0.0009) [2023-12-28 06:16:49,967][106225] Updated weights for policy 1, policy_version 1536873 (0.0009) [2023-12-28 06:16:50,026][106225] Updated weights for policy 1, policy_version 1536883 (0.0010) [2023-12-28 06:16:50,555][106226] Updated weights for policy 0, policy_version 1533186 (0.0011) [2023-12-28 06:16:50,626][106226] Updated weights for policy 0, policy_version 1533196 (0.0007) [2023-12-28 06:16:50,695][106226] Updated weights for policy 0, policy_version 1533206 (0.0009) [2023-12-28 06:16:50,770][106225] Updated weights for policy 1, policy_version 1536893 (0.0010) [2023-12-28 06:16:50,836][106225] Updated weights for policy 1, policy_version 1536903 (0.0008) [2023-12-28 06:16:50,897][106225] Updated weights for policy 1, policy_version 1536913 (0.0008) [2023-12-28 06:16:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 786079744. Throughput: 0: 9952.7, 1: 9822.9. Samples: 786087876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:51,175][105115] Avg episode reward: [(0, '-4.785'), (1, '-5.031')] [2023-12-28 06:16:51,463][106226] Updated weights for policy 0, policy_version 1533216 (0.0009) [2023-12-28 06:16:51,526][106226] Updated weights for policy 0, policy_version 1533226 (0.0011) [2023-12-28 06:16:51,595][106226] Updated weights for policy 0, policy_version 1533236 (0.0008) [2023-12-28 06:16:51,632][106225] Updated weights for policy 1, policy_version 1536923 (0.0009) [2023-12-28 06:16:51,694][106225] Updated weights for policy 1, policy_version 1536933 (0.0011) [2023-12-28 06:16:51,762][106225] Updated weights for policy 1, policy_version 1536943 (0.0010) [2023-12-28 06:16:52,366][106226] Updated weights for policy 0, policy_version 1533246 (0.0008) [2023-12-28 06:16:52,422][106226] Updated weights for policy 0, policy_version 1533256 (0.0008) [2023-12-28 06:16:52,484][106226] Updated weights for policy 0, policy_version 1533266 (0.0008) [2023-12-28 06:16:52,492][106225] Updated weights for policy 1, policy_version 1536953 (0.0010) [2023-12-28 06:16:52,557][106225] Updated weights for policy 1, policy_version 1536963 (0.0006) [2023-12-28 06:16:52,625][106225] Updated weights for policy 1, policy_version 1536973 (0.0007) [2023-12-28 06:16:52,680][106225] Updated weights for policy 1, policy_version 1536983 (0.0008) [2023-12-28 06:16:53,200][106226] Updated weights for policy 0, policy_version 1533276 (0.0006) [2023-12-28 06:16:53,255][106226] Updated weights for policy 0, policy_version 1533286 (0.0005) [2023-12-28 06:16:53,315][106226] Updated weights for policy 0, policy_version 1533296 (0.0005) [2023-12-28 06:16:53,408][106225] Updated weights for policy 1, policy_version 1536993 (0.0009) [2023-12-28 06:16:53,462][106225] Updated weights for policy 1, policy_version 1537003 (0.0009) [2023-12-28 06:16:53,520][106225] Updated weights for policy 1, policy_version 1537013 (0.0008) [2023-12-28 06:16:53,913][106226] Updated weights for policy 0, policy_version 1533306 (0.0006) [2023-12-28 06:16:53,968][106226] Updated weights for policy 0, policy_version 1533316 (0.0008) [2023-12-28 06:16:54,017][106226] Updated weights for policy 0, policy_version 1533326 (0.0006) [2023-12-28 06:16:54,075][106226] Updated weights for policy 0, policy_version 1533336 (0.0010) [2023-12-28 06:16:54,189][106225] Updated weights for policy 1, policy_version 1537023 (0.0008) [2023-12-28 06:16:54,236][106225] Updated weights for policy 1, policy_version 1537033 (0.0005) [2023-12-28 06:16:54,290][106225] Updated weights for policy 1, policy_version 1537043 (0.0005) [2023-12-28 06:16:54,778][106226] Updated weights for policy 0, policy_version 1533346 (0.0005) [2023-12-28 06:16:54,841][106225] Updated weights for policy 1, policy_version 1537053 (0.0005) [2023-12-28 06:16:54,845][106226] Updated weights for policy 0, policy_version 1533356 (0.0008) [2023-12-28 06:16:54,895][106225] Updated weights for policy 1, policy_version 1537063 (0.0005) [2023-12-28 06:16:54,916][106226] Updated weights for policy 0, policy_version 1533366 (0.0008) [2023-12-28 06:16:54,942][106225] Updated weights for policy 1, policy_version 1537073 (0.0005) [2023-12-28 06:16:55,562][106226] Updated weights for policy 0, policy_version 1533376 (0.0006) [2023-12-28 06:16:55,582][106225] Updated weights for policy 1, policy_version 1537083 (0.0008) [2023-12-28 06:16:55,625][106226] Updated weights for policy 0, policy_version 1533386 (0.0011) [2023-12-28 06:16:55,631][106225] Updated weights for policy 1, policy_version 1537093 (0.0005) [2023-12-28 06:16:55,675][106226] Updated weights for policy 0, policy_version 1533396 (0.0010) [2023-12-28 06:16:55,685][106225] Updated weights for policy 1, policy_version 1537103 (0.0006) [2023-12-28 06:16:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 786178048. Throughput: 0: 9975.5, 1: 9759.9. Samples: 786145524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:16:56,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.538')] [2023-12-28 06:16:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001537112_393551872.pth... [2023-12-28 06:16:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001533400_392626176.pth... [2023-12-28 06:16:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001535960_393256960.pth [2023-12-28 06:16:56,203][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001532248_392331264.pth [2023-12-28 06:16:56,372][106226] Updated weights for policy 0, policy_version 1533406 (0.0010) [2023-12-28 06:16:56,378][106225] Updated weights for policy 1, policy_version 1537113 (0.0005) [2023-12-28 06:16:56,432][106226] Updated weights for policy 0, policy_version 1533416 (0.0009) [2023-12-28 06:16:56,436][106225] Updated weights for policy 1, policy_version 1537123 (0.0007) [2023-12-28 06:16:56,485][106225] Updated weights for policy 1, policy_version 1537133 (0.0008) [2023-12-28 06:16:56,495][106226] Updated weights for policy 0, policy_version 1533426 (0.0007) [2023-12-28 06:16:56,533][106225] Updated weights for policy 1, policy_version 1537143 (0.0007) [2023-12-28 06:16:57,008][106226] Updated weights for policy 0, policy_version 1533436 (0.0006) [2023-12-28 06:16:57,056][106226] Updated weights for policy 0, policy_version 1533446 (0.0005) [2023-12-28 06:16:57,112][106226] Updated weights for policy 0, policy_version 1533456 (0.0009) [2023-12-28 06:16:57,327][106225] Updated weights for policy 1, policy_version 1537153 (0.0008) [2023-12-28 06:16:57,379][106225] Updated weights for policy 1, policy_version 1537163 (0.0007) [2023-12-28 06:16:57,435][106225] Updated weights for policy 1, policy_version 1537173 (0.0005) [2023-12-28 06:16:57,797][106226] Updated weights for policy 0, policy_version 1533466 (0.0010) [2023-12-28 06:16:57,853][106226] Updated weights for policy 0, policy_version 1533476 (0.0010) [2023-12-28 06:16:57,909][106226] Updated weights for policy 0, policy_version 1533486 (0.0010) [2023-12-28 06:16:57,961][106226] Updated weights for policy 0, policy_version 1533496 (0.0010) [2023-12-28 06:16:58,109][106225] Updated weights for policy 1, policy_version 1537183 (0.0007) [2023-12-28 06:16:58,169][106225] Updated weights for policy 1, policy_version 1537193 (0.0008) [2023-12-28 06:16:58,235][106225] Updated weights for policy 1, policy_version 1537203 (0.0009) [2023-12-28 06:16:58,705][106226] Updated weights for policy 0, policy_version 1533506 (0.0007) [2023-12-28 06:16:58,775][106226] Updated weights for policy 0, policy_version 1533516 (0.0007) [2023-12-28 06:16:58,844][106226] Updated weights for policy 0, policy_version 1533526 (0.0009) [2023-12-28 06:16:59,126][106225] Updated weights for policy 1, policy_version 1537213 (0.0007) [2023-12-28 06:16:59,196][106225] Updated weights for policy 1, policy_version 1537223 (0.0008) [2023-12-28 06:16:59,275][106225] Updated weights for policy 1, policy_version 1537233 (0.0008) [2023-12-28 06:16:59,750][106226] Updated weights for policy 0, policy_version 1533536 (0.0009) [2023-12-28 06:16:59,815][106226] Updated weights for policy 0, policy_version 1533546 (0.0009) [2023-12-28 06:16:59,888][106226] Updated weights for policy 0, policy_version 1533556 (0.0007) [2023-12-28 06:17:00,095][106225] Updated weights for policy 1, policy_version 1537244 (0.0009) [2023-12-28 06:17:00,194][106225] Updated weights for policy 1, policy_version 1537254 (0.0006) [2023-12-28 06:17:00,259][106225] Updated weights for policy 1, policy_version 1537264 (0.0006) [2023-12-28 06:17:00,619][106226] Updated weights for policy 0, policy_version 1533566 (0.0010) [2023-12-28 06:17:00,673][106226] Updated weights for policy 0, policy_version 1533576 (0.0011) [2023-12-28 06:17:00,725][106226] Updated weights for policy 0, policy_version 1533586 (0.0010) [2023-12-28 06:17:00,838][106225] Updated weights for policy 1, policy_version 1537274 (0.0008) [2023-12-28 06:17:00,901][106225] Updated weights for policy 1, policy_version 1537284 (0.0007) [2023-12-28 06:17:00,961][106225] Updated weights for policy 1, policy_version 1537294 (0.0008) [2023-12-28 06:17:01,022][106225] Updated weights for policy 1, policy_version 1537304 (0.0009) [2023-12-28 06:17:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 786276352. Throughput: 0: 10008.1, 1: 9746.3. Samples: 786263012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:01,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.619')] [2023-12-28 06:17:01,496][106226] Updated weights for policy 0, policy_version 1533596 (0.0010) [2023-12-28 06:17:01,554][106226] Updated weights for policy 0, policy_version 1533606 (0.0006) [2023-12-28 06:17:01,618][106226] Updated weights for policy 0, policy_version 1533616 (0.0006) [2023-12-28 06:17:01,780][106225] Updated weights for policy 1, policy_version 1537314 (0.0010) [2023-12-28 06:17:01,838][106225] Updated weights for policy 1, policy_version 1537324 (0.0011) [2023-12-28 06:17:01,888][106225] Updated weights for policy 1, policy_version 1537334 (0.0010) [2023-12-28 06:17:02,276][106226] Updated weights for policy 0, policy_version 1533626 (0.0008) [2023-12-28 06:17:02,340][106226] Updated weights for policy 0, policy_version 1533636 (0.0006) [2023-12-28 06:17:02,402][106226] Updated weights for policy 0, policy_version 1533646 (0.0007) [2023-12-28 06:17:02,468][106226] Updated weights for policy 0, policy_version 1533656 (0.0006) [2023-12-28 06:17:02,626][106225] Updated weights for policy 1, policy_version 1537344 (0.0010) [2023-12-28 06:17:02,692][106225] Updated weights for policy 1, policy_version 1537354 (0.0010) [2023-12-28 06:17:02,750][106225] Updated weights for policy 1, policy_version 1537364 (0.0010) [2023-12-28 06:17:03,060][106226] Updated weights for policy 0, policy_version 1533666 (0.0010) [2023-12-28 06:17:03,126][106226] Updated weights for policy 0, policy_version 1533676 (0.0008) [2023-12-28 06:17:03,185][106226] Updated weights for policy 0, policy_version 1533686 (0.0005) [2023-12-28 06:17:03,312][106225] Updated weights for policy 1, policy_version 1537374 (0.0007) [2023-12-28 06:17:03,359][106225] Updated weights for policy 1, policy_version 1537384 (0.0005) [2023-12-28 06:17:03,412][106225] Updated weights for policy 1, policy_version 1537394 (0.0005) [2023-12-28 06:17:03,829][106226] Updated weights for policy 0, policy_version 1533696 (0.0005) [2023-12-28 06:17:03,896][106226] Updated weights for policy 0, policy_version 1533706 (0.0008) [2023-12-28 06:17:03,948][106226] Updated weights for policy 0, policy_version 1533716 (0.0008) [2023-12-28 06:17:04,084][106225] Updated weights for policy 1, policy_version 1537404 (0.0006) [2023-12-28 06:17:04,156][106225] Updated weights for policy 1, policy_version 1537414 (0.0007) [2023-12-28 06:17:04,213][106225] Updated weights for policy 1, policy_version 1537424 (0.0011) [2023-12-28 06:17:04,643][106226] Updated weights for policy 0, policy_version 1533726 (0.0007) [2023-12-28 06:17:04,699][106226] Updated weights for policy 0, policy_version 1533736 (0.0005) [2023-12-28 06:17:04,752][106226] Updated weights for policy 0, policy_version 1533746 (0.0005) [2023-12-28 06:17:04,869][106225] Updated weights for policy 1, policy_version 1537434 (0.0010) [2023-12-28 06:17:04,920][106225] Updated weights for policy 1, policy_version 1537444 (0.0005) [2023-12-28 06:17:04,976][106225] Updated weights for policy 1, policy_version 1537454 (0.0005) [2023-12-28 06:17:05,034][106225] Updated weights for policy 1, policy_version 1537464 (0.0007) [2023-12-28 06:17:05,359][106226] Updated weights for policy 0, policy_version 1533756 (0.0008) [2023-12-28 06:17:05,415][106226] Updated weights for policy 0, policy_version 1533766 (0.0010) [2023-12-28 06:17:05,462][106226] Updated weights for policy 0, policy_version 1533776 (0.0010) [2023-12-28 06:17:05,604][106225] Updated weights for policy 1, policy_version 1537474 (0.0006) [2023-12-28 06:17:05,667][106225] Updated weights for policy 1, policy_version 1537484 (0.0009) [2023-12-28 06:17:05,715][106225] Updated weights for policy 1, policy_version 1537494 (0.0007) [2023-12-28 06:17:06,080][106226] Updated weights for policy 0, policy_version 1533786 (0.0010) [2023-12-28 06:17:06,140][106226] Updated weights for policy 0, policy_version 1533796 (0.0008) [2023-12-28 06:17:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 786374656. Throughput: 0: 10048.2, 1: 9850.4. Samples: 786388384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:06,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.463')] [2023-12-28 06:17:06,206][106226] Updated weights for policy 0, policy_version 1533806 (0.0006) [2023-12-28 06:17:06,280][106226] Updated weights for policy 0, policy_version 1533816 (0.0006) [2023-12-28 06:17:06,392][106225] Updated weights for policy 1, policy_version 1537504 (0.0007) [2023-12-28 06:17:06,456][106225] Updated weights for policy 1, policy_version 1537514 (0.0011) [2023-12-28 06:17:06,525][106225] Updated weights for policy 1, policy_version 1537524 (0.0010) [2023-12-28 06:17:06,903][106226] Updated weights for policy 0, policy_version 1533826 (0.0010) [2023-12-28 06:17:06,954][106226] Updated weights for policy 0, policy_version 1533836 (0.0007) [2023-12-28 06:17:07,012][106226] Updated weights for policy 0, policy_version 1533846 (0.0007) [2023-12-28 06:17:07,074][106225] Updated weights for policy 1, policy_version 1537534 (0.0007) [2023-12-28 06:17:07,131][106225] Updated weights for policy 1, policy_version 1537544 (0.0005) [2023-12-28 06:17:07,194][106225] Updated weights for policy 1, policy_version 1537554 (0.0005) [2023-12-28 06:17:07,649][106226] Updated weights for policy 0, policy_version 1533856 (0.0006) [2023-12-28 06:17:07,710][106226] Updated weights for policy 0, policy_version 1533866 (0.0005) [2023-12-28 06:17:07,726][106225] Updated weights for policy 1, policy_version 1537564 (0.0006) [2023-12-28 06:17:07,770][106226] Updated weights for policy 0, policy_version 1533876 (0.0007) [2023-12-28 06:17:07,781][106225] Updated weights for policy 1, policy_version 1537574 (0.0006) [2023-12-28 06:17:07,851][106225] Updated weights for policy 1, policy_version 1537584 (0.0006) [2023-12-28 06:17:08,399][106226] Updated weights for policy 0, policy_version 1533886 (0.0008) [2023-12-28 06:17:08,425][106225] Updated weights for policy 1, policy_version 1537594 (0.0006) [2023-12-28 06:17:08,461][106226] Updated weights for policy 0, policy_version 1533896 (0.0007) [2023-12-28 06:17:08,485][106225] Updated weights for policy 1, policy_version 1537604 (0.0008) [2023-12-28 06:17:08,516][106226] Updated weights for policy 0, policy_version 1533906 (0.0008) [2023-12-28 06:17:08,536][106225] Updated weights for policy 1, policy_version 1537614 (0.0008) [2023-12-28 06:17:08,596][106225] Updated weights for policy 1, policy_version 1537624 (0.0008) [2023-12-28 06:17:09,100][106226] Updated weights for policy 0, policy_version 1533916 (0.0006) [2023-12-28 06:17:09,164][106226] Updated weights for policy 0, policy_version 1533926 (0.0005) [2023-12-28 06:17:09,219][106226] Updated weights for policy 0, policy_version 1533936 (0.0008) [2023-12-28 06:17:09,403][106225] Updated weights for policy 1, policy_version 1537634 (0.0010) [2023-12-28 06:17:09,465][106225] Updated weights for policy 1, policy_version 1537644 (0.0009) [2023-12-28 06:17:09,535][106225] Updated weights for policy 1, policy_version 1537654 (0.0009) [2023-12-28 06:17:09,873][106226] Updated weights for policy 0, policy_version 1533946 (0.0007) [2023-12-28 06:17:09,942][106226] Updated weights for policy 0, policy_version 1533956 (0.0008) [2023-12-28 06:17:10,008][106226] Updated weights for policy 0, policy_version 1533966 (0.0008) [2023-12-28 06:17:10,075][106226] Updated weights for policy 0, policy_version 1533976 (0.0008) [2023-12-28 06:17:10,300][106225] Updated weights for policy 1, policy_version 1537664 (0.0007) [2023-12-28 06:17:10,361][106225] Updated weights for policy 1, policy_version 1537674 (0.0007) [2023-12-28 06:17:10,428][106225] Updated weights for policy 1, policy_version 1537684 (0.0008) [2023-12-28 06:17:10,682][106226] Updated weights for policy 0, policy_version 1533986 (0.0009) [2023-12-28 06:17:10,737][106226] Updated weights for policy 0, policy_version 1533996 (0.0008) [2023-12-28 06:17:10,786][106226] Updated weights for policy 0, policy_version 1534006 (0.0007) [2023-12-28 06:17:11,107][106225] Updated weights for policy 1, policy_version 1537694 (0.0008) [2023-12-28 06:17:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 786481152. Throughput: 0: 10121.2, 1: 9927.8. Samples: 786454540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:11,175][106225] Updated weights for policy 1, policy_version 1537704 (0.0009) [2023-12-28 06:17:11,175][105115] Avg episode reward: [(0, '-5.136'), (1, '-4.639')] [2023-12-28 06:17:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001534008_392781824.pth... [2023-12-28 06:17:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001532824_392478720.pth [2023-12-28 06:17:11,245][106225] Updated weights for policy 1, policy_version 1537714 (0.0010) [2023-12-28 06:17:11,285][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001537720_393707520.pth... [2023-12-28 06:17:11,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001536536_393404416.pth [2023-12-28 06:17:11,493][106226] Updated weights for policy 0, policy_version 1534016 (0.0006) [2023-12-28 06:17:11,562][106226] Updated weights for policy 0, policy_version 1534026 (0.0006) [2023-12-28 06:17:11,625][106226] Updated weights for policy 0, policy_version 1534036 (0.0006) [2023-12-28 06:17:12,039][106225] Updated weights for policy 1, policy_version 1537724 (0.0009) [2023-12-28 06:17:12,094][106225] Updated weights for policy 1, policy_version 1537734 (0.0005) [2023-12-28 06:17:12,163][106225] Updated weights for policy 1, policy_version 1537744 (0.0006) [2023-12-28 06:17:12,322][106226] Updated weights for policy 0, policy_version 1534046 (0.0007) [2023-12-28 06:17:12,392][106226] Updated weights for policy 0, policy_version 1534056 (0.0006) [2023-12-28 06:17:12,460][106226] Updated weights for policy 0, policy_version 1534066 (0.0007) [2023-12-28 06:17:12,857][106225] Updated weights for policy 1, policy_version 1537754 (0.0006) [2023-12-28 06:17:12,914][106225] Updated weights for policy 1, policy_version 1537764 (0.0009) [2023-12-28 06:17:12,965][106225] Updated weights for policy 1, policy_version 1537774 (0.0007) [2023-12-28 06:17:13,023][106225] Updated weights for policy 1, policy_version 1537784 (0.0005) [2023-12-28 06:17:13,063][106226] Updated weights for policy 0, policy_version 1534076 (0.0009) [2023-12-28 06:17:13,125][106226] Updated weights for policy 0, policy_version 1534086 (0.0011) [2023-12-28 06:17:13,176][106226] Updated weights for policy 0, policy_version 1534096 (0.0009) [2023-12-28 06:17:13,675][106225] Updated weights for policy 1, policy_version 1537794 (0.0010) [2023-12-28 06:17:13,741][106225] Updated weights for policy 1, policy_version 1537804 (0.0010) [2023-12-28 06:17:13,757][106226] Updated weights for policy 0, policy_version 1534106 (0.0006) [2023-12-28 06:17:13,801][106225] Updated weights for policy 1, policy_version 1537814 (0.0010) [2023-12-28 06:17:13,803][106226] Updated weights for policy 0, policy_version 1534116 (0.0006) [2023-12-28 06:17:13,862][106226] Updated weights for policy 0, policy_version 1534126 (0.0010) [2023-12-28 06:17:13,913][106226] Updated weights for policy 0, policy_version 1534136 (0.0010) [2023-12-28 06:17:14,437][106225] Updated weights for policy 1, policy_version 1537824 (0.0007) [2023-12-28 06:17:14,487][106225] Updated weights for policy 1, policy_version 1537834 (0.0005) [2023-12-28 06:17:14,546][106225] Updated weights for policy 1, policy_version 1537844 (0.0006) [2023-12-28 06:17:14,576][106226] Updated weights for policy 0, policy_version 1534146 (0.0010) [2023-12-28 06:17:14,638][106226] Updated weights for policy 0, policy_version 1534156 (0.0011) [2023-12-28 06:17:14,686][106226] Updated weights for policy 0, policy_version 1534166 (0.0011) [2023-12-28 06:17:15,290][106225] Updated weights for policy 1, policy_version 1537854 (0.0010) [2023-12-28 06:17:15,347][106225] Updated weights for policy 1, policy_version 1537864 (0.0008) [2023-12-28 06:17:15,397][106225] Updated weights for policy 1, policy_version 1537874 (0.0009) [2023-12-28 06:17:15,474][106226] Updated weights for policy 0, policy_version 1534176 (0.0008) [2023-12-28 06:17:15,539][106226] Updated weights for policy 0, policy_version 1534186 (0.0010) [2023-12-28 06:17:15,602][106226] Updated weights for policy 0, policy_version 1534196 (0.0008) [2023-12-28 06:17:15,981][106225] Updated weights for policy 1, policy_version 1537884 (0.0008) [2023-12-28 06:17:16,044][106225] Updated weights for policy 1, policy_version 1537894 (0.0005) [2023-12-28 06:17:16,103][106225] Updated weights for policy 1, policy_version 1537904 (0.0007) [2023-12-28 06:17:16,175][105115] Fps is (10 sec: 21298.7, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 786587648. Throughput: 0: 10112.3, 1: 9978.3. Samples: 786574384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:16,176][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.547')] [2023-12-28 06:17:16,233][106226] Updated weights for policy 0, policy_version 1534206 (0.0007) [2023-12-28 06:17:16,299][106226] Updated weights for policy 0, policy_version 1534216 (0.0005) [2023-12-28 06:17:16,365][106226] Updated weights for policy 0, policy_version 1534226 (0.0006) [2023-12-28 06:17:16,724][106225] Updated weights for policy 1, policy_version 1537914 (0.0008) [2023-12-28 06:17:16,776][106225] Updated weights for policy 1, policy_version 1537924 (0.0007) [2023-12-28 06:17:16,835][106225] Updated weights for policy 1, policy_version 1537934 (0.0006) [2023-12-28 06:17:16,888][106225] Updated weights for policy 1, policy_version 1537944 (0.0005) [2023-12-28 06:17:16,988][106226] Updated weights for policy 0, policy_version 1534236 (0.0008) [2023-12-28 06:17:17,052][106226] Updated weights for policy 0, policy_version 1534246 (0.0008) [2023-12-28 06:17:17,114][106226] Updated weights for policy 0, policy_version 1534256 (0.0009) [2023-12-28 06:17:17,462][106225] Updated weights for policy 1, policy_version 1537954 (0.0008) [2023-12-28 06:17:17,519][106225] Updated weights for policy 1, policy_version 1537964 (0.0006) [2023-12-28 06:17:17,578][106225] Updated weights for policy 1, policy_version 1537974 (0.0006) [2023-12-28 06:17:17,682][106226] Updated weights for policy 0, policy_version 1534266 (0.0007) [2023-12-28 06:17:17,749][106226] Updated weights for policy 0, policy_version 1534276 (0.0011) [2023-12-28 06:17:17,808][106226] Updated weights for policy 0, policy_version 1534286 (0.0009) [2023-12-28 06:17:17,866][106226] Updated weights for policy 0, policy_version 1534296 (0.0005) [2023-12-28 06:17:18,111][106225] Updated weights for policy 1, policy_version 1537984 (0.0005) [2023-12-28 06:17:18,156][106225] Updated weights for policy 1, policy_version 1537994 (0.0005) [2023-12-28 06:17:18,217][106225] Updated weights for policy 1, policy_version 1538004 (0.0005) [2023-12-28 06:17:18,550][106226] Updated weights for policy 0, policy_version 1534306 (0.0009) [2023-12-28 06:17:18,615][106226] Updated weights for policy 0, policy_version 1534316 (0.0007) [2023-12-28 06:17:18,683][106226] Updated weights for policy 0, policy_version 1534326 (0.0006) [2023-12-28 06:17:18,799][106225] Updated weights for policy 1, policy_version 1538014 (0.0009) [2023-12-28 06:17:18,869][106225] Updated weights for policy 1, policy_version 1538024 (0.0010) [2023-12-28 06:17:18,933][106225] Updated weights for policy 1, policy_version 1538034 (0.0010) [2023-12-28 06:17:19,257][106226] Updated weights for policy 0, policy_version 1534336 (0.0009) [2023-12-28 06:17:19,322][106226] Updated weights for policy 0, policy_version 1534346 (0.0011) [2023-12-28 06:17:19,393][106226] Updated weights for policy 0, policy_version 1534356 (0.0011) [2023-12-28 06:17:19,622][106225] Updated weights for policy 1, policy_version 1538044 (0.0011) [2023-12-28 06:17:19,684][106225] Updated weights for policy 1, policy_version 1538054 (0.0009) [2023-12-28 06:17:19,734][106225] Updated weights for policy 1, policy_version 1538064 (0.0010) [2023-12-28 06:17:20,139][106226] Updated weights for policy 0, policy_version 1534366 (0.0010) [2023-12-28 06:17:20,198][106226] Updated weights for policy 0, policy_version 1534376 (0.0006) [2023-12-28 06:17:20,262][106226] Updated weights for policy 0, policy_version 1534386 (0.0010) [2023-12-28 06:17:20,486][106225] Updated weights for policy 1, policy_version 1538074 (0.0011) [2023-12-28 06:17:20,542][106225] Updated weights for policy 1, policy_version 1538084 (0.0008) [2023-12-28 06:17:20,604][106225] Updated weights for policy 1, policy_version 1538094 (0.0008) [2023-12-28 06:17:20,664][106225] Updated weights for policy 1, policy_version 1538104 (0.0008) [2023-12-28 06:17:20,967][106226] Updated weights for policy 0, policy_version 1534396 (0.0011) [2023-12-28 06:17:21,039][106226] Updated weights for policy 0, policy_version 1534407 (0.0010) [2023-12-28 06:17:21,107][106226] Updated weights for policy 0, policy_version 1534417 (0.0010) [2023-12-28 06:17:21,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20207.0, 300 sec: 19910.7). Total num frames: 786694144. Throughput: 0: 10160.6, 1: 10078.6. Samples: 786700524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:21,175][105115] Avg episode reward: [(0, '-5.062'), (1, '-4.389')] [2023-12-28 06:17:21,443][106225] Updated weights for policy 1, policy_version 1538114 (0.0008) [2023-12-28 06:17:21,505][106225] Updated weights for policy 1, policy_version 1538124 (0.0008) [2023-12-28 06:17:21,567][106225] Updated weights for policy 1, policy_version 1538134 (0.0007) [2023-12-28 06:17:21,876][106226] Updated weights for policy 0, policy_version 1534427 (0.0009) [2023-12-28 06:17:21,950][106226] Updated weights for policy 0, policy_version 1534437 (0.0006) [2023-12-28 06:17:22,014][106226] Updated weights for policy 0, policy_version 1534447 (0.0008) [2023-12-28 06:17:22,374][106225] Updated weights for policy 1, policy_version 1538144 (0.0008) [2023-12-28 06:17:22,445][106225] Updated weights for policy 1, policy_version 1538154 (0.0008) [2023-12-28 06:17:22,507][106225] Updated weights for policy 1, policy_version 1538164 (0.0007) [2023-12-28 06:17:22,765][106226] Updated weights for policy 0, policy_version 1534457 (0.0008) [2023-12-28 06:17:22,826][106226] Updated weights for policy 0, policy_version 1534467 (0.0008) [2023-12-28 06:17:22,885][106226] Updated weights for policy 0, policy_version 1534477 (0.0009) [2023-12-28 06:17:22,943][106226] Updated weights for policy 0, policy_version 1534487 (0.0009) [2023-12-28 06:17:23,156][106225] Updated weights for policy 1, policy_version 1538174 (0.0007) [2023-12-28 06:17:23,210][106225] Updated weights for policy 1, policy_version 1538184 (0.0009) [2023-12-28 06:17:23,268][106225] Updated weights for policy 1, policy_version 1538194 (0.0010) [2023-12-28 06:17:23,722][106226] Updated weights for policy 0, policy_version 1534497 (0.0008) [2023-12-28 06:17:23,783][106226] Updated weights for policy 0, policy_version 1534507 (0.0008) [2023-12-28 06:17:23,837][106226] Updated weights for policy 0, policy_version 1534517 (0.0008) [2023-12-28 06:17:23,955][106225] Updated weights for policy 1, policy_version 1538204 (0.0008) [2023-12-28 06:17:24,004][106225] Updated weights for policy 1, policy_version 1538214 (0.0005) [2023-12-28 06:17:24,061][106225] Updated weights for policy 1, policy_version 1538224 (0.0005) [2023-12-28 06:17:24,460][106226] Updated weights for policy 0, policy_version 1534527 (0.0009) [2023-12-28 06:17:24,513][106226] Updated weights for policy 0, policy_version 1534537 (0.0008) [2023-12-28 06:17:24,569][106226] Updated weights for policy 0, policy_version 1534547 (0.0008) [2023-12-28 06:17:24,639][106225] Updated weights for policy 1, policy_version 1538234 (0.0006) [2023-12-28 06:17:24,694][106225] Updated weights for policy 1, policy_version 1538244 (0.0010) [2023-12-28 06:17:24,750][106225] Updated weights for policy 1, policy_version 1538254 (0.0010) [2023-12-28 06:17:24,810][106225] Updated weights for policy 1, policy_version 1538264 (0.0010) [2023-12-28 06:17:25,309][106226] Updated weights for policy 0, policy_version 1534557 (0.0006) [2023-12-28 06:17:25,366][106226] Updated weights for policy 0, policy_version 1534567 (0.0006) [2023-12-28 06:17:25,423][106226] Updated weights for policy 0, policy_version 1534577 (0.0008) [2023-12-28 06:17:25,532][106225] Updated weights for policy 1, policy_version 1538274 (0.0010) [2023-12-28 06:17:25,588][106225] Updated weights for policy 1, policy_version 1538284 (0.0010) [2023-12-28 06:17:25,648][106225] Updated weights for policy 1, policy_version 1538294 (0.0010) [2023-12-28 06:17:26,157][106226] Updated weights for policy 0, policy_version 1534587 (0.0007) [2023-12-28 06:17:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 786784256. Throughput: 0: 10099.3, 1: 10039.3. Samples: 786756096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:26,175][105115] Avg episode reward: [(0, '-4.982'), (1, '-4.578')] [2023-12-28 06:17:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001538296_393854976.pth... [2023-12-28 06:17:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001537112_393551872.pth [2023-12-28 06:17:26,217][106226] Updated weights for policy 0, policy_version 1534597 (0.0006) [2023-12-28 06:17:26,261][106225] Updated weights for policy 1, policy_version 1538304 (0.0010) [2023-12-28 06:17:26,271][106226] Updated weights for policy 0, policy_version 1534607 (0.0007) [2023-12-28 06:17:26,315][106225] Updated weights for policy 1, policy_version 1538314 (0.0010) [2023-12-28 06:17:26,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001534616_392937472.pth... [2023-12-28 06:17:26,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001533400_392626176.pth [2023-12-28 06:17:26,373][106225] Updated weights for policy 1, policy_version 1538324 (0.0011) [2023-12-28 06:17:26,870][106226] Updated weights for policy 0, policy_version 1534617 (0.0005) [2023-12-28 06:17:26,924][106226] Updated weights for policy 0, policy_version 1534627 (0.0008) [2023-12-28 06:17:26,967][106226] Updated weights for policy 0, policy_version 1534637 (0.0010) [2023-12-28 06:17:27,014][106226] Updated weights for policy 0, policy_version 1534647 (0.0010) [2023-12-28 06:17:27,023][106225] Updated weights for policy 1, policy_version 1538334 (0.0007) [2023-12-28 06:17:27,074][106225] Updated weights for policy 1, policy_version 1538344 (0.0005) [2023-12-28 06:17:27,132][106225] Updated weights for policy 1, policy_version 1538354 (0.0005) [2023-12-28 06:17:27,697][106225] Updated weights for policy 1, policy_version 1538364 (0.0007) [2023-12-28 06:17:27,759][106225] Updated weights for policy 1, policy_version 1538374 (0.0008) [2023-12-28 06:17:27,828][106226] Updated weights for policy 0, policy_version 1534657 (0.0006) [2023-12-28 06:17:27,828][106225] Updated weights for policy 1, policy_version 1538384 (0.0005) [2023-12-28 06:17:27,887][106226] Updated weights for policy 0, policy_version 1534667 (0.0005) [2023-12-28 06:17:27,943][106226] Updated weights for policy 0, policy_version 1534677 (0.0005) [2023-12-28 06:17:28,419][106225] Updated weights for policy 1, policy_version 1538394 (0.0006) [2023-12-28 06:17:28,475][106225] Updated weights for policy 1, policy_version 1538404 (0.0007) [2023-12-28 06:17:28,537][106225] Updated weights for policy 1, policy_version 1538414 (0.0008) [2023-12-28 06:17:28,595][106225] Updated weights for policy 1, policy_version 1538424 (0.0007) [2023-12-28 06:17:28,613][106226] Updated weights for policy 0, policy_version 1534687 (0.0007) [2023-12-28 06:17:28,672][106226] Updated weights for policy 0, policy_version 1534697 (0.0009) [2023-12-28 06:17:28,738][106226] Updated weights for policy 0, policy_version 1534707 (0.0009) [2023-12-28 06:17:29,253][106225] Updated weights for policy 1, policy_version 1538434 (0.0009) [2023-12-28 06:17:29,307][106225] Updated weights for policy 1, policy_version 1538444 (0.0008) [2023-12-28 06:17:29,364][106225] Updated weights for policy 1, policy_version 1538454 (0.0009) [2023-12-28 06:17:29,581][106226] Updated weights for policy 0, policy_version 1534717 (0.0009) [2023-12-28 06:17:29,634][106226] Updated weights for policy 0, policy_version 1534727 (0.0008) [2023-12-28 06:17:29,691][106226] Updated weights for policy 0, policy_version 1534737 (0.0009) [2023-12-28 06:17:30,105][106225] Updated weights for policy 1, policy_version 1538464 (0.0008) [2023-12-28 06:17:30,158][106225] Updated weights for policy 1, policy_version 1538474 (0.0009) [2023-12-28 06:17:30,217][106225] Updated weights for policy 1, policy_version 1538484 (0.0008) [2023-12-28 06:17:30,481][106226] Updated weights for policy 0, policy_version 1534747 (0.0009) [2023-12-28 06:17:30,544][106226] Updated weights for policy 0, policy_version 1534757 (0.0010) [2023-12-28 06:17:30,602][106226] Updated weights for policy 0, policy_version 1534767 (0.0009) [2023-12-28 06:17:30,835][106225] Updated weights for policy 1, policy_version 1538494 (0.0008) [2023-12-28 06:17:30,892][106225] Updated weights for policy 1, policy_version 1538504 (0.0008) [2023-12-28 06:17:30,956][106225] Updated weights for policy 1, policy_version 1538514 (0.0006) [2023-12-28 06:17:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 786890752. Throughput: 0: 10105.0, 1: 10198.0. Samples: 786878772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:31,175][105115] Avg episode reward: [(0, '-5.068'), (1, '-4.776')] [2023-12-28 06:17:31,388][106226] Updated weights for policy 0, policy_version 1534777 (0.0009) [2023-12-28 06:17:31,451][106226] Updated weights for policy 0, policy_version 1534787 (0.0008) [2023-12-28 06:17:31,520][106226] Updated weights for policy 0, policy_version 1534797 (0.0008) [2023-12-28 06:17:31,589][106226] Updated weights for policy 0, policy_version 1534807 (0.0009) [2023-12-28 06:17:31,690][106225] Updated weights for policy 1, policy_version 1538524 (0.0006) [2023-12-28 06:17:31,760][106225] Updated weights for policy 1, policy_version 1538534 (0.0009) [2023-12-28 06:17:31,827][106225] Updated weights for policy 1, policy_version 1538544 (0.0008) [2023-12-28 06:17:32,332][106226] Updated weights for policy 0, policy_version 1534817 (0.0008) [2023-12-28 06:17:32,399][106226] Updated weights for policy 0, policy_version 1534827 (0.0008) [2023-12-28 06:17:32,460][106226] Updated weights for policy 0, policy_version 1534837 (0.0006) [2023-12-28 06:17:32,568][106225] Updated weights for policy 1, policy_version 1538554 (0.0007) [2023-12-28 06:17:32,635][106225] Updated weights for policy 1, policy_version 1538564 (0.0010) [2023-12-28 06:17:32,699][106225] Updated weights for policy 1, policy_version 1538574 (0.0007) [2023-12-28 06:17:32,762][106225] Updated weights for policy 1, policy_version 1538584 (0.0006) [2023-12-28 06:17:33,161][106226] Updated weights for policy 0, policy_version 1534847 (0.0007) [2023-12-28 06:17:33,212][106226] Updated weights for policy 0, policy_version 1534857 (0.0008) [2023-12-28 06:17:33,265][106226] Updated weights for policy 0, policy_version 1534867 (0.0008) [2023-12-28 06:17:33,424][106225] Updated weights for policy 1, policy_version 1538594 (0.0010) [2023-12-28 06:17:33,489][106225] Updated weights for policy 1, policy_version 1538604 (0.0010) [2023-12-28 06:17:33,551][106225] Updated weights for policy 1, policy_version 1538614 (0.0010) [2023-12-28 06:17:33,972][106226] Updated weights for policy 0, policy_version 1534877 (0.0007) [2023-12-28 06:17:34,021][106226] Updated weights for policy 0, policy_version 1534887 (0.0007) [2023-12-28 06:17:34,070][106226] Updated weights for policy 0, policy_version 1534897 (0.0007) [2023-12-28 06:17:34,262][106225] Updated weights for policy 1, policy_version 1538624 (0.0009) [2023-12-28 06:17:34,320][106225] Updated weights for policy 1, policy_version 1538634 (0.0010) [2023-12-28 06:17:34,383][106225] Updated weights for policy 1, policy_version 1538644 (0.0010) [2023-12-28 06:17:34,846][106226] Updated weights for policy 0, policy_version 1534907 (0.0008) [2023-12-28 06:17:34,900][106226] Updated weights for policy 0, policy_version 1534917 (0.0010) [2023-12-28 06:17:34,959][106226] Updated weights for policy 0, policy_version 1534927 (0.0010) [2023-12-28 06:17:35,103][106225] Updated weights for policy 1, policy_version 1538654 (0.0011) [2023-12-28 06:17:35,161][106225] Updated weights for policy 1, policy_version 1538664 (0.0010) [2023-12-28 06:17:35,207][106225] Updated weights for policy 1, policy_version 1538674 (0.0010) [2023-12-28 06:17:35,674][106226] Updated weights for policy 0, policy_version 1534937 (0.0011) [2023-12-28 06:17:35,730][106226] Updated weights for policy 0, policy_version 1534947 (0.0010) [2023-12-28 06:17:35,780][106226] Updated weights for policy 0, policy_version 1534957 (0.0010) [2023-12-28 06:17:35,829][106226] Updated weights for policy 0, policy_version 1534967 (0.0010) [2023-12-28 06:17:35,931][106225] Updated weights for policy 1, policy_version 1538684 (0.0010) [2023-12-28 06:17:35,987][106225] Updated weights for policy 1, policy_version 1538694 (0.0010) [2023-12-28 06:17:36,040][106225] Updated weights for policy 1, policy_version 1538704 (0.0010) [2023-12-28 06:17:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 786989056. Throughput: 0: 9999.7, 1: 10150.3. Samples: 786994628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:36,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.622')] [2023-12-28 06:17:36,531][106226] Updated weights for policy 0, policy_version 1534977 (0.0007) [2023-12-28 06:17:36,588][106226] Updated weights for policy 0, policy_version 1534987 (0.0009) [2023-12-28 06:17:36,650][106226] Updated weights for policy 0, policy_version 1534997 (0.0009) [2023-12-28 06:17:36,778][106225] Updated weights for policy 1, policy_version 1538714 (0.0010) [2023-12-28 06:17:36,827][106225] Updated weights for policy 1, policy_version 1538724 (0.0008) [2023-12-28 06:17:36,881][106225] Updated weights for policy 1, policy_version 1538734 (0.0008) [2023-12-28 06:17:36,927][106225] Updated weights for policy 1, policy_version 1538744 (0.0008) [2023-12-28 06:17:37,376][106226] Updated weights for policy 0, policy_version 1535007 (0.0010) [2023-12-28 06:17:37,445][106226] Updated weights for policy 0, policy_version 1535017 (0.0010) [2023-12-28 06:17:37,500][106226] Updated weights for policy 0, policy_version 1535027 (0.0009) [2023-12-28 06:17:37,588][106225] Updated weights for policy 1, policy_version 1538754 (0.0008) [2023-12-28 06:17:37,635][106225] Updated weights for policy 1, policy_version 1538764 (0.0008) [2023-12-28 06:17:37,681][106225] Updated weights for policy 1, policy_version 1538774 (0.0007) [2023-12-28 06:17:38,278][106226] Updated weights for policy 0, policy_version 1535037 (0.0009) [2023-12-28 06:17:38,341][106226] Updated weights for policy 0, policy_version 1535047 (0.0009) [2023-12-28 06:17:38,368][106225] Updated weights for policy 1, policy_version 1538784 (0.0008) [2023-12-28 06:17:38,403][106226] Updated weights for policy 0, policy_version 1535057 (0.0006) [2023-12-28 06:17:38,434][106225] Updated weights for policy 1, policy_version 1538794 (0.0008) [2023-12-28 06:17:38,496][106225] Updated weights for policy 1, policy_version 1538804 (0.0008) [2023-12-28 06:17:39,104][106226] Updated weights for policy 0, policy_version 1535067 (0.0007) [2023-12-28 06:17:39,157][106226] Updated weights for policy 0, policy_version 1535077 (0.0008) [2023-12-28 06:17:39,214][106226] Updated weights for policy 0, policy_version 1535087 (0.0006) [2023-12-28 06:17:39,233][106225] Updated weights for policy 1, policy_version 1538814 (0.0008) [2023-12-28 06:17:39,294][106225] Updated weights for policy 1, policy_version 1538824 (0.0008) [2023-12-28 06:17:39,371][106225] Updated weights for policy 1, policy_version 1538834 (0.0008) [2023-12-28 06:17:39,969][106226] Updated weights for policy 0, policy_version 1535097 (0.0008) [2023-12-28 06:17:39,980][106225] Updated weights for policy 1, policy_version 1538844 (0.0007) [2023-12-28 06:17:40,029][106226] Updated weights for policy 0, policy_version 1535107 (0.0006) [2023-12-28 06:17:40,038][106225] Updated weights for policy 1, policy_version 1538854 (0.0008) [2023-12-28 06:17:40,086][106226] Updated weights for policy 0, policy_version 1535117 (0.0007) [2023-12-28 06:17:40,105][106225] Updated weights for policy 1, policy_version 1538864 (0.0008) [2023-12-28 06:17:40,143][106226] Updated weights for policy 0, policy_version 1535127 (0.0007) [2023-12-28 06:17:40,852][106225] Updated weights for policy 1, policy_version 1538874 (0.0008) [2023-12-28 06:17:40,854][106226] Updated weights for policy 0, policy_version 1535137 (0.0008) [2023-12-28 06:17:40,906][106225] Updated weights for policy 1, policy_version 1538884 (0.0008) [2023-12-28 06:17:40,908][106226] Updated weights for policy 0, policy_version 1535147 (0.0006) [2023-12-28 06:17:40,958][106225] Updated weights for policy 1, policy_version 1538894 (0.0006) [2023-12-28 06:17:40,964][106226] Updated weights for policy 0, policy_version 1535157 (0.0007) [2023-12-28 06:17:41,012][106225] Updated weights for policy 1, policy_version 1538904 (0.0008) [2023-12-28 06:17:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 787087360. Throughput: 0: 9986.2, 1: 10189.3. Samples: 787053420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:41,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.716')] [2023-12-28 06:17:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001538904_394010624.pth... [2023-12-28 06:17:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001535160_393076736.pth... [2023-12-28 06:17:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001534008_392781824.pth [2023-12-28 06:17:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001537720_393707520.pth [2023-12-28 06:17:41,739][106226] Updated weights for policy 0, policy_version 1535167 (0.0007) [2023-12-28 06:17:41,814][106226] Updated weights for policy 0, policy_version 1535177 (0.0008) [2023-12-28 06:17:41,825][106225] Updated weights for policy 1, policy_version 1538914 (0.0006) [2023-12-28 06:17:41,870][106226] Updated weights for policy 0, policy_version 1535187 (0.0007) [2023-12-28 06:17:41,884][106225] Updated weights for policy 1, policy_version 1538924 (0.0006) [2023-12-28 06:17:41,945][106225] Updated weights for policy 1, policy_version 1538934 (0.0005) [2023-12-28 06:17:42,622][106225] Updated weights for policy 1, policy_version 1538944 (0.0006) [2023-12-28 06:17:42,630][106226] Updated weights for policy 0, policy_version 1535197 (0.0008) [2023-12-28 06:17:42,681][106225] Updated weights for policy 1, policy_version 1538954 (0.0005) [2023-12-28 06:17:42,688][106226] Updated weights for policy 0, policy_version 1535207 (0.0009) [2023-12-28 06:17:42,741][106226] Updated weights for policy 0, policy_version 1535217 (0.0009) [2023-12-28 06:17:42,744][106225] Updated weights for policy 1, policy_version 1538964 (0.0005) [2023-12-28 06:17:43,286][106225] Updated weights for policy 1, policy_version 1538974 (0.0007) [2023-12-28 06:17:43,346][106225] Updated weights for policy 1, policy_version 1538984 (0.0009) [2023-12-28 06:17:43,407][106225] Updated weights for policy 1, policy_version 1538994 (0.0008) [2023-12-28 06:17:43,542][106226] Updated weights for policy 0, policy_version 1535227 (0.0008) [2023-12-28 06:17:43,591][106226] Updated weights for policy 0, policy_version 1535237 (0.0009) [2023-12-28 06:17:43,643][106226] Updated weights for policy 0, policy_version 1535247 (0.0008) [2023-12-28 06:17:44,078][106225] Updated weights for policy 1, policy_version 1539004 (0.0008) [2023-12-28 06:17:44,129][106225] Updated weights for policy 1, policy_version 1539014 (0.0008) [2023-12-28 06:17:44,178][106225] Updated weights for policy 1, policy_version 1539024 (0.0008) [2023-12-28 06:17:44,389][106226] Updated weights for policy 0, policy_version 1535257 (0.0008) [2023-12-28 06:17:44,441][106226] Updated weights for policy 0, policy_version 1535267 (0.0008) [2023-12-28 06:17:44,496][106226] Updated weights for policy 0, policy_version 1535277 (0.0008) [2023-12-28 06:17:44,559][106226] Updated weights for policy 0, policy_version 1535287 (0.0007) [2023-12-28 06:17:44,941][106225] Updated weights for policy 1, policy_version 1539034 (0.0008) [2023-12-28 06:17:45,004][106225] Updated weights for policy 1, policy_version 1539044 (0.0008) [2023-12-28 06:17:45,067][106225] Updated weights for policy 1, policy_version 1539054 (0.0008) [2023-12-28 06:17:45,130][106225] Updated weights for policy 1, policy_version 1539064 (0.0008) [2023-12-28 06:17:45,302][106226] Updated weights for policy 0, policy_version 1535297 (0.0008) [2023-12-28 06:17:45,363][106226] Updated weights for policy 0, policy_version 1535307 (0.0008) [2023-12-28 06:17:45,415][106226] Updated weights for policy 0, policy_version 1535317 (0.0008) [2023-12-28 06:17:45,822][106225] Updated weights for policy 1, policy_version 1539074 (0.0006) [2023-12-28 06:17:45,867][106225] Updated weights for policy 1, policy_version 1539084 (0.0008) [2023-12-28 06:17:45,919][106225] Updated weights for policy 1, policy_version 1539094 (0.0008) [2023-12-28 06:17:46,174][106226] Updated weights for policy 0, policy_version 1535327 (0.0008) [2023-12-28 06:17:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 787177472. Throughput: 0: 9900.5, 1: 10219.0. Samples: 787168392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:46,176][105115] Avg episode reward: [(0, '-4.784'), (1, '-4.709')] [2023-12-28 06:17:46,226][106226] Updated weights for policy 0, policy_version 1535337 (0.0005) [2023-12-28 06:17:46,275][106226] Updated weights for policy 0, policy_version 1535347 (0.0005) [2023-12-28 06:17:46,621][106225] Updated weights for policy 1, policy_version 1539104 (0.0009) [2023-12-28 06:17:46,672][106225] Updated weights for policy 1, policy_version 1539114 (0.0007) [2023-12-28 06:17:46,718][106225] Updated weights for policy 1, policy_version 1539124 (0.0007) [2023-12-28 06:17:46,848][106226] Updated weights for policy 0, policy_version 1535357 (0.0005) [2023-12-28 06:17:46,911][106226] Updated weights for policy 0, policy_version 1535367 (0.0005) [2023-12-28 06:17:46,962][106226] Updated weights for policy 0, policy_version 1535377 (0.0006) [2023-12-28 06:17:47,496][106225] Updated weights for policy 1, policy_version 1539134 (0.0008) [2023-12-28 06:17:47,543][106225] Updated weights for policy 1, policy_version 1539144 (0.0008) [2023-12-28 06:17:47,597][106225] Updated weights for policy 1, policy_version 1539154 (0.0008) [2023-12-28 06:17:47,607][106226] Updated weights for policy 0, policy_version 1535387 (0.0009) [2023-12-28 06:17:47,653][106226] Updated weights for policy 0, policy_version 1535397 (0.0008) [2023-12-28 06:17:47,713][106226] Updated weights for policy 0, policy_version 1535407 (0.0010) [2023-12-28 06:17:48,302][106226] Updated weights for policy 0, policy_version 1535417 (0.0010) [2023-12-28 06:17:48,361][106226] Updated weights for policy 0, policy_version 1535427 (0.0009) [2023-12-28 06:17:48,422][106225] Updated weights for policy 1, policy_version 1539164 (0.0007) [2023-12-28 06:17:48,427][106226] Updated weights for policy 0, policy_version 1535437 (0.0008) [2023-12-28 06:17:48,481][106225] Updated weights for policy 1, policy_version 1539174 (0.0009) [2023-12-28 06:17:48,486][106226] Updated weights for policy 0, policy_version 1535447 (0.0009) [2023-12-28 06:17:48,540][106225] Updated weights for policy 1, policy_version 1539184 (0.0008) [2023-12-28 06:17:49,225][106225] Updated weights for policy 1, policy_version 1539194 (0.0008) [2023-12-28 06:17:49,228][106226] Updated weights for policy 0, policy_version 1535457 (0.0008) [2023-12-28 06:17:49,292][106225] Updated weights for policy 1, policy_version 1539204 (0.0007) [2023-12-28 06:17:49,293][106226] Updated weights for policy 0, policy_version 1535467 (0.0009) [2023-12-28 06:17:49,357][106225] Updated weights for policy 1, policy_version 1539214 (0.0007) [2023-12-28 06:17:49,363][106226] Updated weights for policy 0, policy_version 1535477 (0.0008) [2023-12-28 06:17:49,419][106225] Updated weights for policy 1, policy_version 1539224 (0.0008) [2023-12-28 06:17:50,010][106226] Updated weights for policy 0, policy_version 1535487 (0.0008) [2023-12-28 06:17:50,069][106226] Updated weights for policy 0, policy_version 1535497 (0.0010) [2023-12-28 06:17:50,126][106226] Updated weights for policy 0, policy_version 1535507 (0.0009) [2023-12-28 06:17:50,195][106225] Updated weights for policy 1, policy_version 1539234 (0.0008) [2023-12-28 06:17:50,245][106225] Updated weights for policy 1, policy_version 1539244 (0.0008) [2023-12-28 06:17:50,312][106225] Updated weights for policy 1, policy_version 1539254 (0.0009) [2023-12-28 06:17:50,910][106226] Updated weights for policy 0, policy_version 1535517 (0.0008) [2023-12-28 06:17:50,966][106226] Updated weights for policy 0, policy_version 1535527 (0.0008) [2023-12-28 06:17:51,027][106226] Updated weights for policy 0, policy_version 1535537 (0.0008) [2023-12-28 06:17:51,029][106225] Updated weights for policy 1, policy_version 1539264 (0.0006) [2023-12-28 06:17:51,095][106225] Updated weights for policy 1, policy_version 1539274 (0.0008) [2023-12-28 06:17:51,153][106225] Updated weights for policy 1, policy_version 1539284 (0.0008) [2023-12-28 06:17:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 787283968. Throughput: 0: 9848.8, 1: 10088.3. Samples: 787285556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:51,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.624')] [2023-12-28 06:17:51,827][106225] Updated weights for policy 1, policy_version 1539294 (0.0012) [2023-12-28 06:17:51,845][106226] Updated weights for policy 0, policy_version 1535547 (0.0007) [2023-12-28 06:17:51,888][106225] Updated weights for policy 1, policy_version 1539304 (0.0010) [2023-12-28 06:17:51,900][106226] Updated weights for policy 0, policy_version 1535557 (0.0008) [2023-12-28 06:17:51,945][106225] Updated weights for policy 1, policy_version 1539314 (0.0010) [2023-12-28 06:17:51,963][106226] Updated weights for policy 0, policy_version 1535567 (0.0006) [2023-12-28 06:17:52,698][106226] Updated weights for policy 0, policy_version 1535577 (0.0008) [2023-12-28 06:17:52,708][106225] Updated weights for policy 1, policy_version 1539324 (0.0008) [2023-12-28 06:17:52,756][106226] Updated weights for policy 0, policy_version 1535587 (0.0006) [2023-12-28 06:17:52,758][106225] Updated weights for policy 1, policy_version 1539334 (0.0010) [2023-12-28 06:17:52,812][106225] Updated weights for policy 1, policy_version 1539344 (0.0010) [2023-12-28 06:17:52,822][106226] Updated weights for policy 0, policy_version 1535597 (0.0006) [2023-12-28 06:17:52,879][106226] Updated weights for policy 0, policy_version 1535607 (0.0007) [2023-12-28 06:17:53,475][106225] Updated weights for policy 1, policy_version 1539354 (0.0007) [2023-12-28 06:17:53,536][106225] Updated weights for policy 1, policy_version 1539364 (0.0007) [2023-12-28 06:17:53,588][106225] Updated weights for policy 1, policy_version 1539374 (0.0008) [2023-12-28 06:17:53,620][106226] Updated weights for policy 0, policy_version 1535617 (0.0008) [2023-12-28 06:17:53,635][106225] Updated weights for policy 1, policy_version 1539384 (0.0008) [2023-12-28 06:17:53,684][106226] Updated weights for policy 0, policy_version 1535627 (0.0009) [2023-12-28 06:17:53,745][106226] Updated weights for policy 0, policy_version 1535637 (0.0008) [2023-12-28 06:17:54,289][106225] Updated weights for policy 1, policy_version 1539394 (0.0009) [2023-12-28 06:17:54,345][106225] Updated weights for policy 1, policy_version 1539404 (0.0007) [2023-12-28 06:17:54,400][106225] Updated weights for policy 1, policy_version 1539414 (0.0008) [2023-12-28 06:17:54,495][106226] Updated weights for policy 0, policy_version 1535647 (0.0008) [2023-12-28 06:17:54,548][106226] Updated weights for policy 0, policy_version 1535657 (0.0008) [2023-12-28 06:17:54,606][106226] Updated weights for policy 0, policy_version 1535667 (0.0009) [2023-12-28 06:17:54,990][106225] Updated weights for policy 1, policy_version 1539424 (0.0006) [2023-12-28 06:17:55,049][106225] Updated weights for policy 1, policy_version 1539434 (0.0005) [2023-12-28 06:17:55,109][106225] Updated weights for policy 1, policy_version 1539444 (0.0005) [2023-12-28 06:17:55,405][106226] Updated weights for policy 0, policy_version 1535677 (0.0010) [2023-12-28 06:17:55,461][106226] Updated weights for policy 0, policy_version 1535687 (0.0006) [2023-12-28 06:17:55,529][106226] Updated weights for policy 0, policy_version 1535697 (0.0007) [2023-12-28 06:17:55,632][106225] Updated weights for policy 1, policy_version 1539454 (0.0008) [2023-12-28 06:17:55,694][106225] Updated weights for policy 1, policy_version 1539464 (0.0008) [2023-12-28 06:17:55,746][106225] Updated weights for policy 1, policy_version 1539474 (0.0009) [2023-12-28 06:17:56,144][106226] Updated weights for policy 0, policy_version 1535707 (0.0007) [2023-12-28 06:17:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 787374080. Throughput: 0: 9734.9, 1: 9988.4. Samples: 787342084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:17:56,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-4.374')] [2023-12-28 06:17:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001539480_394158080.pth... [2023-12-28 06:17:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001538296_393854976.pth [2023-12-28 06:17:56,207][106226] Updated weights for policy 0, policy_version 1535717 (0.0006) [2023-12-28 06:17:56,261][106226] Updated weights for policy 0, policy_version 1535727 (0.0005) [2023-12-28 06:17:56,320][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001535736_393224192.pth... [2023-12-28 06:17:56,323][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001534616_392937472.pth [2023-12-28 06:17:56,489][106225] Updated weights for policy 1, policy_version 1539484 (0.0008) [2023-12-28 06:17:56,542][106225] Updated weights for policy 1, policy_version 1539494 (0.0008) [2023-12-28 06:17:56,590][106225] Updated weights for policy 1, policy_version 1539504 (0.0008) [2023-12-28 06:17:56,891][106226] Updated weights for policy 0, policy_version 1535737 (0.0006) [2023-12-28 06:17:56,937][106226] Updated weights for policy 0, policy_version 1535747 (0.0005) [2023-12-28 06:17:57,000][106226] Updated weights for policy 0, policy_version 1535757 (0.0005) [2023-12-28 06:17:57,068][106226] Updated weights for policy 0, policy_version 1535767 (0.0005) [2023-12-28 06:17:57,350][106225] Updated weights for policy 1, policy_version 1539514 (0.0008) [2023-12-28 06:17:57,417][106225] Updated weights for policy 1, policy_version 1539524 (0.0008) [2023-12-28 06:17:57,486][106225] Updated weights for policy 1, policy_version 1539534 (0.0010) [2023-12-28 06:17:57,541][106225] Updated weights for policy 1, policy_version 1539544 (0.0009) [2023-12-28 06:17:57,588][106226] Updated weights for policy 0, policy_version 1535777 (0.0006) [2023-12-28 06:17:57,640][106226] Updated weights for policy 0, policy_version 1535787 (0.0005) [2023-12-28 06:17:57,693][106226] Updated weights for policy 0, policy_version 1535797 (0.0005) [2023-12-28 06:17:58,157][106225] Updated weights for policy 1, policy_version 1539554 (0.0009) [2023-12-28 06:17:58,203][106225] Updated weights for policy 1, policy_version 1539564 (0.0009) [2023-12-28 06:17:58,203][106226] Updated weights for policy 0, policy_version 1535807 (0.0006) [2023-12-28 06:17:58,266][106225] Updated weights for policy 1, policy_version 1539574 (0.0007) [2023-12-28 06:17:58,271][106226] Updated weights for policy 0, policy_version 1535817 (0.0008) [2023-12-28 06:17:58,350][106226] Updated weights for policy 0, policy_version 1535828 (0.0008) [2023-12-28 06:17:59,081][106225] Updated weights for policy 1, policy_version 1539584 (0.0008) [2023-12-28 06:17:59,139][106225] Updated weights for policy 1, policy_version 1539594 (0.0008) [2023-12-28 06:17:59,174][106226] Updated weights for policy 0, policy_version 1535838 (0.0009) [2023-12-28 06:17:59,205][106225] Updated weights for policy 1, policy_version 1539604 (0.0008) [2023-12-28 06:17:59,242][106226] Updated weights for policy 0, policy_version 1535848 (0.0008) [2023-12-28 06:17:59,308][106226] Updated weights for policy 0, policy_version 1535858 (0.0009) [2023-12-28 06:17:59,981][106225] Updated weights for policy 1, policy_version 1539614 (0.0007) [2023-12-28 06:18:00,047][106225] Updated weights for policy 1, policy_version 1539624 (0.0008) [2023-12-28 06:18:00,113][106225] Updated weights for policy 1, policy_version 1539634 (0.0007) [2023-12-28 06:18:00,144][106226] Updated weights for policy 0, policy_version 1535868 (0.0009) [2023-12-28 06:18:00,203][106226] Updated weights for policy 0, policy_version 1535878 (0.0008) [2023-12-28 06:18:00,261][106226] Updated weights for policy 0, policy_version 1535888 (0.0007) [2023-12-28 06:18:00,822][106225] Updated weights for policy 1, policy_version 1539644 (0.0007) [2023-12-28 06:18:00,871][106225] Updated weights for policy 1, policy_version 1539654 (0.0008) [2023-12-28 06:18:00,916][106225] Updated weights for policy 1, policy_version 1539664 (0.0008) [2023-12-28 06:18:00,969][106226] Updated weights for policy 0, policy_version 1535898 (0.0008) [2023-12-28 06:18:01,025][106226] Updated weights for policy 0, policy_version 1535908 (0.0009) [2023-12-28 06:18:01,090][106226] Updated weights for policy 0, policy_version 1535918 (0.0009) [2023-12-28 06:18:01,152][106226] Updated weights for policy 0, policy_version 1535928 (0.0006) [2023-12-28 06:18:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 787480576. Throughput: 0: 9712.0, 1: 10072.1. Samples: 787464660. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:01,175][105115] Avg episode reward: [(0, '-4.880'), (1, '-4.579')] [2023-12-28 06:18:01,731][106225] Updated weights for policy 1, policy_version 1539674 (0.0009) [2023-12-28 06:18:01,786][106225] Updated weights for policy 1, policy_version 1539684 (0.0008) [2023-12-28 06:18:01,811][106226] Updated weights for policy 0, policy_version 1535938 (0.0008) [2023-12-28 06:18:01,836][106225] Updated weights for policy 1, policy_version 1539694 (0.0008) [2023-12-28 06:18:01,869][106226] Updated weights for policy 0, policy_version 1535948 (0.0007) [2023-12-28 06:18:01,897][106225] Updated weights for policy 1, policy_version 1539704 (0.0005) [2023-12-28 06:18:01,921][106226] Updated weights for policy 0, policy_version 1535958 (0.0009) [2023-12-28 06:18:02,540][106225] Updated weights for policy 1, policy_version 1539714 (0.0008) [2023-12-28 06:18:02,594][106225] Updated weights for policy 1, policy_version 1539724 (0.0007) [2023-12-28 06:18:02,643][106225] Updated weights for policy 1, policy_version 1539734 (0.0007) [2023-12-28 06:18:02,682][106226] Updated weights for policy 0, policy_version 1535968 (0.0008) [2023-12-28 06:18:02,744][106226] Updated weights for policy 0, policy_version 1535978 (0.0009) [2023-12-28 06:18:02,801][106226] Updated weights for policy 0, policy_version 1535988 (0.0007) [2023-12-28 06:18:03,411][106225] Updated weights for policy 1, policy_version 1539744 (0.0008) [2023-12-28 06:18:03,446][106226] Updated weights for policy 0, policy_version 1535998 (0.0008) [2023-12-28 06:18:03,460][106225] Updated weights for policy 1, policy_version 1539754 (0.0007) [2023-12-28 06:18:03,493][106226] Updated weights for policy 0, policy_version 1536008 (0.0010) [2023-12-28 06:18:03,517][106225] Updated weights for policy 1, policy_version 1539764 (0.0005) [2023-12-28 06:18:03,546][106226] Updated weights for policy 0, policy_version 1536018 (0.0010) [2023-12-28 06:18:04,260][106225] Updated weights for policy 1, policy_version 1539774 (0.0007) [2023-12-28 06:18:04,288][106226] Updated weights for policy 0, policy_version 1536028 (0.0011) [2023-12-28 06:18:04,315][106225] Updated weights for policy 1, policy_version 1539784 (0.0007) [2023-12-28 06:18:04,349][106226] Updated weights for policy 0, policy_version 1536038 (0.0011) [2023-12-28 06:18:04,375][106225] Updated weights for policy 1, policy_version 1539794 (0.0006) [2023-12-28 06:18:04,403][106226] Updated weights for policy 0, policy_version 1536048 (0.0009) [2023-12-28 06:18:05,102][106226] Updated weights for policy 0, policy_version 1536058 (0.0009) [2023-12-28 06:18:05,112][106225] Updated weights for policy 1, policy_version 1539804 (0.0006) [2023-12-28 06:18:05,159][106226] Updated weights for policy 0, policy_version 1536068 (0.0007) [2023-12-28 06:18:05,169][106225] Updated weights for policy 1, policy_version 1539814 (0.0006) [2023-12-28 06:18:05,218][106226] Updated weights for policy 0, policy_version 1536078 (0.0006) [2023-12-28 06:18:05,228][106225] Updated weights for policy 1, policy_version 1539824 (0.0006) [2023-12-28 06:18:05,273][106226] Updated weights for policy 0, policy_version 1536088 (0.0007) [2023-12-28 06:18:05,838][106226] Updated weights for policy 0, policy_version 1536098 (0.0005) [2023-12-28 06:18:05,907][106226] Updated weights for policy 0, policy_version 1536108 (0.0005) [2023-12-28 06:18:05,921][106225] Updated weights for policy 1, policy_version 1539834 (0.0006) [2023-12-28 06:18:05,962][106226] Updated weights for policy 0, policy_version 1536118 (0.0005) [2023-12-28 06:18:05,976][106225] Updated weights for policy 1, policy_version 1539844 (0.0007) [2023-12-28 06:18:06,028][106225] Updated weights for policy 1, policy_version 1539854 (0.0008) [2023-12-28 06:18:06,080][106225] Updated weights for policy 1, policy_version 1539864 (0.0007) [2023-12-28 06:18:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 787578880. Throughput: 0: 9682.5, 1: 9913.7. Samples: 787582356. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:06,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-4.545')] [2023-12-28 06:18:06,649][106226] Updated weights for policy 0, policy_version 1536128 (0.0007) [2023-12-28 06:18:06,712][106226] Updated weights for policy 0, policy_version 1536138 (0.0006) [2023-12-28 06:18:06,738][106225] Updated weights for policy 1, policy_version 1539874 (0.0006) [2023-12-28 06:18:06,770][106226] Updated weights for policy 0, policy_version 1536148 (0.0006) [2023-12-28 06:18:06,802][106225] Updated weights for policy 1, policy_version 1539884 (0.0006) [2023-12-28 06:18:06,861][106225] Updated weights for policy 1, policy_version 1539894 (0.0006) [2023-12-28 06:18:07,395][106225] Updated weights for policy 1, policy_version 1539904 (0.0006) [2023-12-28 06:18:07,403][106226] Updated weights for policy 0, policy_version 1536158 (0.0009) [2023-12-28 06:18:07,443][106225] Updated weights for policy 1, policy_version 1539914 (0.0005) [2023-12-28 06:18:07,454][106226] Updated weights for policy 0, policy_version 1536168 (0.0005) [2023-12-28 06:18:07,507][106225] Updated weights for policy 1, policy_version 1539924 (0.0005) [2023-12-28 06:18:07,517][106226] Updated weights for policy 0, policy_version 1536178 (0.0005) [2023-12-28 06:18:08,116][106225] Updated weights for policy 1, policy_version 1539934 (0.0007) [2023-12-28 06:18:08,122][106226] Updated weights for policy 0, policy_version 1536188 (0.0007) [2023-12-28 06:18:08,165][106225] Updated weights for policy 1, policy_version 1539944 (0.0009) [2023-12-28 06:18:08,185][106226] Updated weights for policy 0, policy_version 1536198 (0.0006) [2023-12-28 06:18:08,230][106225] Updated weights for policy 1, policy_version 1539954 (0.0007) [2023-12-28 06:18:08,238][106226] Updated weights for policy 0, policy_version 1536208 (0.0006) [2023-12-28 06:18:08,910][106226] Updated weights for policy 0, policy_version 1536218 (0.0008) [2023-12-28 06:18:08,927][106225] Updated weights for policy 1, policy_version 1539964 (0.0007) [2023-12-28 06:18:08,981][106226] Updated weights for policy 0, policy_version 1536228 (0.0005) [2023-12-28 06:18:08,982][106225] Updated weights for policy 1, policy_version 1539974 (0.0008) [2023-12-28 06:18:09,032][106226] Updated weights for policy 0, policy_version 1536238 (0.0008) [2023-12-28 06:18:09,038][106225] Updated weights for policy 1, policy_version 1539984 (0.0008) [2023-12-28 06:18:09,089][106226] Updated weights for policy 0, policy_version 1536248 (0.0010) [2023-12-28 06:18:09,757][106226] Updated weights for policy 0, policy_version 1536258 (0.0008) [2023-12-28 06:18:09,824][106226] Updated weights for policy 0, policy_version 1536268 (0.0010) [2023-12-28 06:18:09,870][106225] Updated weights for policy 1, policy_version 1539994 (0.0006) [2023-12-28 06:18:09,892][106226] Updated weights for policy 0, policy_version 1536278 (0.0008) [2023-12-28 06:18:09,934][106225] Updated weights for policy 1, policy_version 1540004 (0.0007) [2023-12-28 06:18:09,999][106225] Updated weights for policy 1, policy_version 1540014 (0.0009) [2023-12-28 06:18:10,064][106225] Updated weights for policy 1, policy_version 1540024 (0.0007) [2023-12-28 06:18:10,617][106226] Updated weights for policy 0, policy_version 1536288 (0.0006) [2023-12-28 06:18:10,674][106226] Updated weights for policy 0, policy_version 1536298 (0.0006) [2023-12-28 06:18:10,724][106226] Updated weights for policy 0, policy_version 1536308 (0.0007) [2023-12-28 06:18:10,844][106225] Updated weights for policy 1, policy_version 1540034 (0.0007) [2023-12-28 06:18:10,897][106225] Updated weights for policy 1, policy_version 1540044 (0.0009) [2023-12-28 06:18:10,946][106225] Updated weights for policy 1, policy_version 1540054 (0.0009) [2023-12-28 06:18:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 787677184. Throughput: 0: 9778.9, 1: 10025.0. Samples: 787647272. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:11,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-4.975')] [2023-12-28 06:18:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001540056_394305536.pth... [2023-12-28 06:18:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001536312_393371648.pth... [2023-12-28 06:18:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001538904_394010624.pth [2023-12-28 06:18:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001535160_393076736.pth [2023-12-28 06:18:11,541][106226] Updated weights for policy 0, policy_version 1536318 (0.0008) [2023-12-28 06:18:11,598][106226] Updated weights for policy 0, policy_version 1536328 (0.0008) [2023-12-28 06:18:11,670][106226] Updated weights for policy 0, policy_version 1536338 (0.0009) [2023-12-28 06:18:11,707][106225] Updated weights for policy 1, policy_version 1540064 (0.0008) [2023-12-28 06:18:11,772][106225] Updated weights for policy 1, policy_version 1540074 (0.0009) [2023-12-28 06:18:11,820][106225] Updated weights for policy 1, policy_version 1540084 (0.0009) [2023-12-28 06:18:12,355][106226] Updated weights for policy 0, policy_version 1536348 (0.0009) [2023-12-28 06:18:12,425][106226] Updated weights for policy 0, policy_version 1536358 (0.0008) [2023-12-28 06:18:12,486][106226] Updated weights for policy 0, policy_version 1536368 (0.0008) [2023-12-28 06:18:12,620][106225] Updated weights for policy 1, policy_version 1540094 (0.0008) [2023-12-28 06:18:12,667][106225] Updated weights for policy 1, policy_version 1540104 (0.0006) [2023-12-28 06:18:12,724][106225] Updated weights for policy 1, policy_version 1540114 (0.0009) [2023-12-28 06:18:13,130][106226] Updated weights for policy 0, policy_version 1536378 (0.0008) [2023-12-28 06:18:13,186][106226] Updated weights for policy 0, policy_version 1536388 (0.0011) [2023-12-28 06:18:13,236][106226] Updated weights for policy 0, policy_version 1536398 (0.0010) [2023-12-28 06:18:13,289][106226] Updated weights for policy 0, policy_version 1536408 (0.0007) [2023-12-28 06:18:13,438][106225] Updated weights for policy 1, policy_version 1540124 (0.0009) [2023-12-28 06:18:13,502][106225] Updated weights for policy 1, policy_version 1540134 (0.0010) [2023-12-28 06:18:13,565][106225] Updated weights for policy 1, policy_version 1540144 (0.0010) [2023-12-28 06:18:13,894][106226] Updated weights for policy 0, policy_version 1536418 (0.0007) [2023-12-28 06:18:13,943][106226] Updated weights for policy 0, policy_version 1536428 (0.0007) [2023-12-28 06:18:14,001][106226] Updated weights for policy 0, policy_version 1536438 (0.0007) [2023-12-28 06:18:14,271][106225] Updated weights for policy 1, policy_version 1540154 (0.0010) [2023-12-28 06:18:14,325][106225] Updated weights for policy 1, policy_version 1540164 (0.0010) [2023-12-28 06:18:14,375][106225] Updated weights for policy 1, policy_version 1540174 (0.0010) [2023-12-28 06:18:14,434][106225] Updated weights for policy 1, policy_version 1540184 (0.0010) [2023-12-28 06:18:14,626][106226] Updated weights for policy 0, policy_version 1536448 (0.0007) [2023-12-28 06:18:14,676][106226] Updated weights for policy 0, policy_version 1536458 (0.0008) [2023-12-28 06:18:14,725][106226] Updated weights for policy 0, policy_version 1536468 (0.0007) [2023-12-28 06:18:15,197][106225] Updated weights for policy 1, policy_version 1540194 (0.0010) [2023-12-28 06:18:15,260][106225] Updated weights for policy 1, policy_version 1540204 (0.0010) [2023-12-28 06:18:15,319][106225] Updated weights for policy 1, policy_version 1540214 (0.0011) [2023-12-28 06:18:15,499][106226] Updated weights for policy 0, policy_version 1536478 (0.0009) [2023-12-28 06:18:15,565][106226] Updated weights for policy 0, policy_version 1536488 (0.0010) [2023-12-28 06:18:15,629][106226] Updated weights for policy 0, policy_version 1536498 (0.0011) [2023-12-28 06:18:16,041][106225] Updated weights for policy 1, policy_version 1540224 (0.0010) [2023-12-28 06:18:16,097][106225] Updated weights for policy 1, policy_version 1540234 (0.0008) [2023-12-28 06:18:16,145][106225] Updated weights for policy 1, policy_version 1540244 (0.0005) [2023-12-28 06:18:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 787775488. Throughput: 0: 9814.4, 1: 9823.1. Samples: 787762460. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:16,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.125')] [2023-12-28 06:18:16,176][106141] Saving new best policy, reward=-4.125! [2023-12-28 06:18:16,283][106226] Updated weights for policy 0, policy_version 1536508 (0.0011) [2023-12-28 06:18:16,336][106226] Updated weights for policy 0, policy_version 1536518 (0.0010) [2023-12-28 06:18:16,386][106226] Updated weights for policy 0, policy_version 1536528 (0.0010) [2023-12-28 06:18:16,710][106225] Updated weights for policy 1, policy_version 1540254 (0.0005) [2023-12-28 06:18:16,766][106225] Updated weights for policy 1, policy_version 1540264 (0.0005) [2023-12-28 06:18:16,829][106225] Updated weights for policy 1, policy_version 1540274 (0.0010) [2023-12-28 06:18:17,105][106226] Updated weights for policy 0, policy_version 1536538 (0.0011) [2023-12-28 06:18:17,164][106226] Updated weights for policy 0, policy_version 1536548 (0.0010) [2023-12-28 06:18:17,234][106226] Updated weights for policy 0, policy_version 1536558 (0.0011) [2023-12-28 06:18:17,296][106226] Updated weights for policy 0, policy_version 1536568 (0.0010) [2023-12-28 06:18:17,430][106225] Updated weights for policy 1, policy_version 1540284 (0.0008) [2023-12-28 06:18:17,494][106225] Updated weights for policy 1, policy_version 1540294 (0.0009) [2023-12-28 06:18:17,556][106225] Updated weights for policy 1, policy_version 1540304 (0.0008) [2023-12-28 06:18:17,984][106226] Updated weights for policy 0, policy_version 1536578 (0.0005) [2023-12-28 06:18:18,037][106226] Updated weights for policy 0, policy_version 1536588 (0.0005) [2023-12-28 06:18:18,085][106226] Updated weights for policy 0, policy_version 1536598 (0.0005) [2023-12-28 06:18:18,191][106225] Updated weights for policy 1, policy_version 1540314 (0.0006) [2023-12-28 06:18:18,248][106225] Updated weights for policy 1, policy_version 1540324 (0.0010) [2023-12-28 06:18:18,298][106225] Updated weights for policy 1, policy_version 1540334 (0.0010) [2023-12-28 06:18:18,361][106225] Updated weights for policy 1, policy_version 1540344 (0.0010) [2023-12-28 06:18:18,691][106226] Updated weights for policy 0, policy_version 1536608 (0.0007) [2023-12-28 06:18:18,750][106226] Updated weights for policy 0, policy_version 1536618 (0.0007) [2023-12-28 06:18:18,809][106226] Updated weights for policy 0, policy_version 1536628 (0.0009) [2023-12-28 06:18:19,015][106225] Updated weights for policy 1, policy_version 1540354 (0.0008) [2023-12-28 06:18:19,066][106225] Updated weights for policy 1, policy_version 1540364 (0.0009) [2023-12-28 06:18:19,123][106225] Updated weights for policy 1, policy_version 1540374 (0.0009) [2023-12-28 06:18:19,530][106226] Updated weights for policy 0, policy_version 1536638 (0.0009) [2023-12-28 06:18:19,593][106226] Updated weights for policy 0, policy_version 1536648 (0.0006) [2023-12-28 06:18:19,656][106226] Updated weights for policy 0, policy_version 1536658 (0.0008) [2023-12-28 06:18:19,937][106225] Updated weights for policy 1, policy_version 1540384 (0.0008) [2023-12-28 06:18:19,999][106225] Updated weights for policy 1, policy_version 1540394 (0.0008) [2023-12-28 06:18:20,057][106225] Updated weights for policy 1, policy_version 1540404 (0.0008) [2023-12-28 06:18:20,389][106226] Updated weights for policy 0, policy_version 1536668 (0.0009) [2023-12-28 06:18:20,457][106226] Updated weights for policy 0, policy_version 1536678 (0.0008) [2023-12-28 06:18:20,516][106226] Updated weights for policy 0, policy_version 1536688 (0.0008) [2023-12-28 06:18:20,765][106225] Updated weights for policy 1, policy_version 1540414 (0.0009) [2023-12-28 06:18:20,827][106225] Updated weights for policy 1, policy_version 1540424 (0.0011) [2023-12-28 06:18:20,885][106225] Updated weights for policy 1, policy_version 1540434 (0.0011) [2023-12-28 06:18:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 787873792. Throughput: 0: 9871.0, 1: 9870.4. Samples: 787882992. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:21,175][105115] Avg episode reward: [(0, '-4.904'), (1, '-4.704')] [2023-12-28 06:18:21,315][106226] Updated weights for policy 0, policy_version 1536698 (0.0008) [2023-12-28 06:18:21,386][106226] Updated weights for policy 0, policy_version 1536708 (0.0009) [2023-12-28 06:18:21,452][106226] Updated weights for policy 0, policy_version 1536718 (0.0008) [2023-12-28 06:18:21,515][106226] Updated weights for policy 0, policy_version 1536728 (0.0008) [2023-12-28 06:18:21,658][106225] Updated weights for policy 1, policy_version 1540444 (0.0010) [2023-12-28 06:18:21,728][106225] Updated weights for policy 1, policy_version 1540454 (0.0009) [2023-12-28 06:18:21,795][106225] Updated weights for policy 1, policy_version 1540464 (0.0008) [2023-12-28 06:18:22,331][106226] Updated weights for policy 0, policy_version 1536738 (0.0008) [2023-12-28 06:18:22,396][106226] Updated weights for policy 0, policy_version 1536748 (0.0009) [2023-12-28 06:18:22,456][106226] Updated weights for policy 0, policy_version 1536758 (0.0008) [2023-12-28 06:18:22,541][106225] Updated weights for policy 1, policy_version 1540474 (0.0009) [2023-12-28 06:18:22,603][106225] Updated weights for policy 1, policy_version 1540484 (0.0007) [2023-12-28 06:18:22,666][106225] Updated weights for policy 1, policy_version 1540494 (0.0006) [2023-12-28 06:18:22,732][106225] Updated weights for policy 1, policy_version 1540504 (0.0007) [2023-12-28 06:18:23,136][106226] Updated weights for policy 0, policy_version 1536768 (0.0006) [2023-12-28 06:18:23,195][106226] Updated weights for policy 0, policy_version 1536778 (0.0006) [2023-12-28 06:18:23,256][106226] Updated weights for policy 0, policy_version 1536788 (0.0005) [2023-12-28 06:18:23,470][106225] Updated weights for policy 1, policy_version 1540514 (0.0007) [2023-12-28 06:18:23,519][106225] Updated weights for policy 1, policy_version 1540524 (0.0009) [2023-12-28 06:18:23,574][106225] Updated weights for policy 1, policy_version 1540534 (0.0009) [2023-12-28 06:18:23,765][106226] Updated weights for policy 0, policy_version 1536798 (0.0006) [2023-12-28 06:18:23,824][106226] Updated weights for policy 0, policy_version 1536808 (0.0005) [2023-12-28 06:18:23,879][106226] Updated weights for policy 0, policy_version 1536818 (0.0005) [2023-12-28 06:18:24,337][106225] Updated weights for policy 1, policy_version 1540544 (0.0009) [2023-12-28 06:18:24,394][106225] Updated weights for policy 1, policy_version 1540554 (0.0009) [2023-12-28 06:18:24,448][106225] Updated weights for policy 1, policy_version 1540564 (0.0010) [2023-12-28 06:18:24,471][106226] Updated weights for policy 0, policy_version 1536828 (0.0006) [2023-12-28 06:18:24,521][106226] Updated weights for policy 0, policy_version 1536838 (0.0007) [2023-12-28 06:18:24,571][106226] Updated weights for policy 0, policy_version 1536848 (0.0008) [2023-12-28 06:18:25,185][106225] Updated weights for policy 1, policy_version 1540574 (0.0010) [2023-12-28 06:18:25,235][106225] Updated weights for policy 1, policy_version 1540584 (0.0007) [2023-12-28 06:18:25,245][106226] Updated weights for policy 0, policy_version 1536858 (0.0007) [2023-12-28 06:18:25,281][106225] Updated weights for policy 1, policy_version 1540594 (0.0009) [2023-12-28 06:18:25,299][106226] Updated weights for policy 0, policy_version 1536868 (0.0005) [2023-12-28 06:18:25,356][106226] Updated weights for policy 0, policy_version 1536878 (0.0005) [2023-12-28 06:18:25,415][106226] Updated weights for policy 0, policy_version 1536888 (0.0007) [2023-12-28 06:18:25,950][106225] Updated weights for policy 1, policy_version 1540605 (0.0008) [2023-12-28 06:18:26,009][106226] Updated weights for policy 0, policy_version 1536898 (0.0006) [2023-12-28 06:18:26,009][106225] Updated weights for policy 1, policy_version 1540615 (0.0008) [2023-12-28 06:18:26,061][106225] Updated weights for policy 1, policy_version 1540625 (0.0008) [2023-12-28 06:18:26,062][106226] Updated weights for policy 0, policy_version 1536908 (0.0005) [2023-12-28 06:18:26,116][106226] Updated weights for policy 0, policy_version 1536918 (0.0005) [2023-12-28 06:18:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 787980288. Throughput: 0: 9922.0, 1: 9803.4. Samples: 787941064. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:26,175][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.635')] [2023-12-28 06:18:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001540632_394452992.pth... [2023-12-28 06:18:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001536920_393527296.pth... [2023-12-28 06:18:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001539480_394158080.pth [2023-12-28 06:18:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001535736_393224192.pth [2023-12-28 06:18:26,682][106226] Updated weights for policy 0, policy_version 1536928 (0.0009) [2023-12-28 06:18:26,732][106226] Updated weights for policy 0, policy_version 1536938 (0.0010) [2023-12-28 06:18:26,753][106225] Updated weights for policy 1, policy_version 1540635 (0.0008) [2023-12-28 06:18:26,796][106226] Updated weights for policy 0, policy_version 1536948 (0.0011) [2023-12-28 06:18:26,814][106225] Updated weights for policy 1, policy_version 1540645 (0.0005) [2023-12-28 06:18:26,863][106225] Updated weights for policy 1, policy_version 1540655 (0.0005) [2023-12-28 06:18:27,390][106225] Updated weights for policy 1, policy_version 1540665 (0.0007) [2023-12-28 06:18:27,437][106225] Updated weights for policy 1, policy_version 1540675 (0.0005) [2023-12-28 06:18:27,484][106226] Updated weights for policy 0, policy_version 1536958 (0.0010) [2023-12-28 06:18:27,486][106225] Updated weights for policy 1, policy_version 1540685 (0.0006) [2023-12-28 06:18:27,533][106226] Updated weights for policy 0, policy_version 1536968 (0.0010) [2023-12-28 06:18:27,536][106225] Updated weights for policy 1, policy_version 1540695 (0.0006) [2023-12-28 06:18:27,591][106226] Updated weights for policy 0, policy_version 1536978 (0.0010) [2023-12-28 06:18:28,155][106225] Updated weights for policy 1, policy_version 1540705 (0.0010) [2023-12-28 06:18:28,218][106225] Updated weights for policy 1, policy_version 1540715 (0.0010) [2023-12-28 06:18:28,272][106225] Updated weights for policy 1, policy_version 1540725 (0.0010) [2023-12-28 06:18:28,276][106226] Updated weights for policy 0, policy_version 1536988 (0.0010) [2023-12-28 06:18:28,329][106226] Updated weights for policy 0, policy_version 1536998 (0.0010) [2023-12-28 06:18:28,393][106226] Updated weights for policy 0, policy_version 1537008 (0.0009) [2023-12-28 06:18:28,963][106225] Updated weights for policy 1, policy_version 1540735 (0.0007) [2023-12-28 06:18:29,013][106225] Updated weights for policy 1, policy_version 1540745 (0.0005) [2023-12-28 06:18:29,056][106226] Updated weights for policy 0, policy_version 1537018 (0.0011) [2023-12-28 06:18:29,065][106225] Updated weights for policy 1, policy_version 1540755 (0.0005) [2023-12-28 06:18:29,105][106226] Updated weights for policy 0, policy_version 1537028 (0.0010) [2023-12-28 06:18:29,151][106226] Updated weights for policy 0, policy_version 1537038 (0.0010) [2023-12-28 06:18:29,205][106226] Updated weights for policy 0, policy_version 1537048 (0.0009) [2023-12-28 06:18:29,783][106225] Updated weights for policy 1, policy_version 1540765 (0.0007) [2023-12-28 06:18:29,850][106225] Updated weights for policy 1, policy_version 1540775 (0.0010) [2023-12-28 06:18:29,895][106226] Updated weights for policy 0, policy_version 1537058 (0.0007) [2023-12-28 06:18:29,913][106225] Updated weights for policy 1, policy_version 1540785 (0.0006) [2023-12-28 06:18:29,965][106226] Updated weights for policy 0, policy_version 1537068 (0.0008) [2023-12-28 06:18:30,029][106226] Updated weights for policy 0, policy_version 1537078 (0.0009) [2023-12-28 06:18:30,618][106225] Updated weights for policy 1, policy_version 1540795 (0.0011) [2023-12-28 06:18:30,674][106225] Updated weights for policy 1, policy_version 1540805 (0.0009) [2023-12-28 06:18:30,727][106225] Updated weights for policy 1, policy_version 1540815 (0.0006) [2023-12-28 06:18:30,728][106226] Updated weights for policy 0, policy_version 1537088 (0.0008) [2023-12-28 06:18:30,776][106226] Updated weights for policy 0, policy_version 1537098 (0.0006) [2023-12-28 06:18:30,839][106226] Updated weights for policy 0, policy_version 1537108 (0.0009) [2023-12-28 06:18:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 788078592. Throughput: 0: 10115.7, 1: 9863.2. Samples: 788067440. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:31,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.920')] [2023-12-28 06:18:31,557][106225] Updated weights for policy 1, policy_version 1540825 (0.0007) [2023-12-28 06:18:31,629][106225] Updated weights for policy 1, policy_version 1540835 (0.0008) [2023-12-28 06:18:31,691][106225] Updated weights for policy 1, policy_version 1540845 (0.0007) [2023-12-28 06:18:31,693][106226] Updated weights for policy 0, policy_version 1537118 (0.0009) [2023-12-28 06:18:31,762][106225] Updated weights for policy 1, policy_version 1540855 (0.0009) [2023-12-28 06:18:31,765][106226] Updated weights for policy 0, policy_version 1537128 (0.0008) [2023-12-28 06:18:31,829][106226] Updated weights for policy 0, policy_version 1537138 (0.0009) [2023-12-28 06:18:32,502][106225] Updated weights for policy 1, policy_version 1540865 (0.0008) [2023-12-28 06:18:32,554][106226] Updated weights for policy 0, policy_version 1537148 (0.0009) [2023-12-28 06:18:32,563][106225] Updated weights for policy 1, policy_version 1540875 (0.0008) [2023-12-28 06:18:32,610][106226] Updated weights for policy 0, policy_version 1537158 (0.0008) [2023-12-28 06:18:32,626][106225] Updated weights for policy 1, policy_version 1540885 (0.0009) [2023-12-28 06:18:32,676][106226] Updated weights for policy 0, policy_version 1537168 (0.0005) [2023-12-28 06:18:33,267][106225] Updated weights for policy 1, policy_version 1540895 (0.0006) [2023-12-28 06:18:33,317][106225] Updated weights for policy 1, policy_version 1540905 (0.0008) [2023-12-28 06:18:33,360][106225] Updated weights for policy 1, policy_version 1540915 (0.0008) [2023-12-28 06:18:33,394][106226] Updated weights for policy 0, policy_version 1537178 (0.0006) [2023-12-28 06:18:33,441][106226] Updated weights for policy 0, policy_version 1537188 (0.0005) [2023-12-28 06:18:33,488][106226] Updated weights for policy 0, policy_version 1537198 (0.0007) [2023-12-28 06:18:33,539][106226] Updated weights for policy 0, policy_version 1537208 (0.0008) [2023-12-28 06:18:33,961][106225] Updated weights for policy 1, policy_version 1540925 (0.0007) [2023-12-28 06:18:34,024][106225] Updated weights for policy 1, policy_version 1540935 (0.0005) [2023-12-28 06:18:34,083][106225] Updated weights for policy 1, policy_version 1540945 (0.0005) [2023-12-28 06:18:34,121][106226] Updated weights for policy 0, policy_version 1537218 (0.0009) [2023-12-28 06:18:34,203][106226] Updated weights for policy 0, policy_version 1537228 (0.0011) [2023-12-28 06:18:34,251][106226] Updated weights for policy 0, policy_version 1537238 (0.0010) [2023-12-28 06:18:34,735][106225] Updated weights for policy 1, policy_version 1540955 (0.0006) [2023-12-28 06:18:34,803][106225] Updated weights for policy 1, policy_version 1540965 (0.0010) [2023-12-28 06:18:34,866][106225] Updated weights for policy 1, policy_version 1540975 (0.0007) [2023-12-28 06:18:34,912][106226] Updated weights for policy 0, policy_version 1537248 (0.0007) [2023-12-28 06:18:34,970][106226] Updated weights for policy 0, policy_version 1537258 (0.0006) [2023-12-28 06:18:35,035][106226] Updated weights for policy 0, policy_version 1537268 (0.0007) [2023-12-28 06:18:35,620][106225] Updated weights for policy 1, policy_version 1540985 (0.0008) [2023-12-28 06:18:35,659][106226] Updated weights for policy 0, policy_version 1537278 (0.0007) [2023-12-28 06:18:35,673][106225] Updated weights for policy 1, policy_version 1540995 (0.0006) [2023-12-28 06:18:35,726][106226] Updated weights for policy 0, policy_version 1537288 (0.0006) [2023-12-28 06:18:35,728][106225] Updated weights for policy 1, policy_version 1541005 (0.0007) [2023-12-28 06:18:35,776][106225] Updated weights for policy 1, policy_version 1541015 (0.0007) [2023-12-28 06:18:35,793][106226] Updated weights for policy 0, policy_version 1537298 (0.0007) [2023-12-28 06:18:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 788176896. Throughput: 0: 10128.1, 1: 9912.7. Samples: 788187392. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:36,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.483')] [2023-12-28 06:18:36,364][106226] Updated weights for policy 0, policy_version 1537308 (0.0007) [2023-12-28 06:18:36,422][106226] Updated weights for policy 0, policy_version 1537318 (0.0011) [2023-12-28 06:18:36,484][106226] Updated weights for policy 0, policy_version 1537328 (0.0009) [2023-12-28 06:18:36,553][106225] Updated weights for policy 1, policy_version 1541025 (0.0009) [2023-12-28 06:18:36,603][106225] Updated weights for policy 1, policy_version 1541035 (0.0009) [2023-12-28 06:18:36,662][106225] Updated weights for policy 1, policy_version 1541045 (0.0009) [2023-12-28 06:18:37,292][106226] Updated weights for policy 0, policy_version 1537338 (0.0009) [2023-12-28 06:18:37,359][106226] Updated weights for policy 0, policy_version 1537348 (0.0011) [2023-12-28 06:18:37,392][106225] Updated weights for policy 1, policy_version 1541055 (0.0006) [2023-12-28 06:18:37,416][106226] Updated weights for policy 0, policy_version 1537358 (0.0010) [2023-12-28 06:18:37,437][106225] Updated weights for policy 1, policy_version 1541065 (0.0008) [2023-12-28 06:18:37,473][106226] Updated weights for policy 0, policy_version 1537368 (0.0011) [2023-12-28 06:18:37,488][106225] Updated weights for policy 1, policy_version 1541075 (0.0006) [2023-12-28 06:18:38,157][106226] Updated weights for policy 0, policy_version 1537378 (0.0005) [2023-12-28 06:18:38,208][106226] Updated weights for policy 0, policy_version 1537388 (0.0005) [2023-12-28 06:18:38,267][106225] Updated weights for policy 1, policy_version 1541085 (0.0008) [2023-12-28 06:18:38,271][106226] Updated weights for policy 0, policy_version 1537398 (0.0005) [2023-12-28 06:18:38,326][106225] Updated weights for policy 1, policy_version 1541095 (0.0008) [2023-12-28 06:18:38,389][106225] Updated weights for policy 1, policy_version 1541105 (0.0007) [2023-12-28 06:18:38,923][106226] Updated weights for policy 0, policy_version 1537408 (0.0010) [2023-12-28 06:18:38,977][106226] Updated weights for policy 0, policy_version 1537418 (0.0010) [2023-12-28 06:18:39,024][106226] Updated weights for policy 0, policy_version 1537428 (0.0010) [2023-12-28 06:18:39,145][106225] Updated weights for policy 1, policy_version 1541115 (0.0007) [2023-12-28 06:18:39,214][106225] Updated weights for policy 1, policy_version 1541125 (0.0009) [2023-12-28 06:18:39,280][106225] Updated weights for policy 1, policy_version 1541135 (0.0007) [2023-12-28 06:18:39,802][106226] Updated weights for policy 0, policy_version 1537438 (0.0009) [2023-12-28 06:18:39,867][106226] Updated weights for policy 0, policy_version 1537448 (0.0009) [2023-12-28 06:18:39,946][106226] Updated weights for policy 0, policy_version 1537458 (0.0008) [2023-12-28 06:18:40,069][106225] Updated weights for policy 1, policy_version 1541145 (0.0007) [2023-12-28 06:18:40,133][106225] Updated weights for policy 1, policy_version 1541155 (0.0011) [2023-12-28 06:18:40,200][106225] Updated weights for policy 1, policy_version 1541165 (0.0011) [2023-12-28 06:18:40,262][106225] Updated weights for policy 1, policy_version 1541175 (0.0011) [2023-12-28 06:18:40,683][106226] Updated weights for policy 0, policy_version 1537468 (0.0008) [2023-12-28 06:18:40,744][106226] Updated weights for policy 0, policy_version 1537478 (0.0008) [2023-12-28 06:18:40,792][106226] Updated weights for policy 0, policy_version 1537488 (0.0007) [2023-12-28 06:18:40,984][106225] Updated weights for policy 1, policy_version 1541185 (0.0010) [2023-12-28 06:18:41,052][106225] Updated weights for policy 1, policy_version 1541195 (0.0011) [2023-12-28 06:18:41,120][106225] Updated weights for policy 1, policy_version 1541205 (0.0011) [2023-12-28 06:18:41,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 788275200. Throughput: 0: 10163.8, 1: 9878.1. Samples: 788243972. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:41,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.812')] [2023-12-28 06:18:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001541208_394600448.pth... [2023-12-28 06:18:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001537496_393674752.pth... [2023-12-28 06:18:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001540056_394305536.pth [2023-12-28 06:18:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001536312_393371648.pth [2023-12-28 06:18:41,569][106226] Updated weights for policy 0, policy_version 1537498 (0.0008) [2023-12-28 06:18:41,639][106226] Updated weights for policy 0, policy_version 1537508 (0.0008) [2023-12-28 06:18:41,704][106226] Updated weights for policy 0, policy_version 1537518 (0.0006) [2023-12-28 06:18:41,779][106226] Updated weights for policy 0, policy_version 1537528 (0.0008) [2023-12-28 06:18:41,896][106225] Updated weights for policy 1, policy_version 1541215 (0.0008) [2023-12-28 06:18:41,959][106225] Updated weights for policy 1, policy_version 1541225 (0.0006) [2023-12-28 06:18:42,026][106225] Updated weights for policy 1, policy_version 1541235 (0.0009) [2023-12-28 06:18:42,531][106226] Updated weights for policy 0, policy_version 1537538 (0.0009) [2023-12-28 06:18:42,603][106226] Updated weights for policy 0, policy_version 1537548 (0.0009) [2023-12-28 06:18:42,671][106226] Updated weights for policy 0, policy_version 1537558 (0.0008) [2023-12-28 06:18:42,751][106225] Updated weights for policy 1, policy_version 1541245 (0.0007) [2023-12-28 06:18:42,812][106225] Updated weights for policy 1, policy_version 1541255 (0.0008) [2023-12-28 06:18:42,866][106225] Updated weights for policy 1, policy_version 1541265 (0.0008) [2023-12-28 06:18:43,411][106226] Updated weights for policy 0, policy_version 1537568 (0.0008) [2023-12-28 06:18:43,476][106226] Updated weights for policy 0, policy_version 1537578 (0.0008) [2023-12-28 06:18:43,541][106226] Updated weights for policy 0, policy_version 1537588 (0.0008) [2023-12-28 06:18:43,567][106225] Updated weights for policy 1, policy_version 1541275 (0.0006) [2023-12-28 06:18:43,626][106225] Updated weights for policy 1, policy_version 1541285 (0.0009) [2023-12-28 06:18:43,692][106225] Updated weights for policy 1, policy_version 1541295 (0.0008) [2023-12-28 06:18:44,255][106226] Updated weights for policy 0, policy_version 1537598 (0.0009) [2023-12-28 06:18:44,310][106226] Updated weights for policy 0, policy_version 1537608 (0.0008) [2023-12-28 06:18:44,350][106225] Updated weights for policy 1, policy_version 1541305 (0.0009) [2023-12-28 06:18:44,371][106226] Updated weights for policy 0, policy_version 1537618 (0.0008) [2023-12-28 06:18:44,408][106225] Updated weights for policy 1, policy_version 1541315 (0.0007) [2023-12-28 06:18:44,471][106225] Updated weights for policy 1, policy_version 1541325 (0.0007) [2023-12-28 06:18:44,531][106225] Updated weights for policy 1, policy_version 1541335 (0.0008) [2023-12-28 06:18:45,117][106226] Updated weights for policy 0, policy_version 1537628 (0.0009) [2023-12-28 06:18:45,187][106226] Updated weights for policy 0, policy_version 1537638 (0.0006) [2023-12-28 06:18:45,214][106225] Updated weights for policy 1, policy_version 1541345 (0.0008) [2023-12-28 06:18:45,255][106226] Updated weights for policy 0, policy_version 1537648 (0.0007) [2023-12-28 06:18:45,274][106225] Updated weights for policy 1, policy_version 1541355 (0.0007) [2023-12-28 06:18:45,322][106225] Updated weights for policy 1, policy_version 1541365 (0.0007) [2023-12-28 06:18:45,796][106226] Updated weights for policy 0, policy_version 1537658 (0.0006) [2023-12-28 06:18:45,858][106226] Updated weights for policy 0, policy_version 1537668 (0.0007) [2023-12-28 06:18:45,922][106226] Updated weights for policy 0, policy_version 1537678 (0.0005) [2023-12-28 06:18:45,976][106226] Updated weights for policy 0, policy_version 1537688 (0.0005) [2023-12-28 06:18:46,100][106225] Updated weights for policy 1, policy_version 1541375 (0.0006) [2023-12-28 06:18:46,158][106225] Updated weights for policy 1, policy_version 1541385 (0.0005) [2023-12-28 06:18:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 788365312. Throughput: 0: 10046.7, 1: 9768.8. Samples: 788356360. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:46,175][105115] Avg episode reward: [(0, '-4.983'), (1, '-4.643')] [2023-12-28 06:18:46,216][106225] Updated weights for policy 1, policy_version 1541395 (0.0005) [2023-12-28 06:18:46,569][106226] Updated weights for policy 0, policy_version 1537698 (0.0010) [2023-12-28 06:18:46,625][106226] Updated weights for policy 0, policy_version 1537708 (0.0008) [2023-12-28 06:18:46,680][106226] Updated weights for policy 0, policy_version 1537718 (0.0006) [2023-12-28 06:18:46,850][106225] Updated weights for policy 1, policy_version 1541405 (0.0008) [2023-12-28 06:18:46,907][106225] Updated weights for policy 1, policy_version 1541415 (0.0007) [2023-12-28 06:18:46,964][106225] Updated weights for policy 1, policy_version 1541425 (0.0008) [2023-12-28 06:18:47,275][106226] Updated weights for policy 0, policy_version 1537728 (0.0005) [2023-12-28 06:18:47,327][106226] Updated weights for policy 0, policy_version 1537738 (0.0009) [2023-12-28 06:18:47,375][106226] Updated weights for policy 0, policy_version 1537748 (0.0008) [2023-12-28 06:18:47,586][106225] Updated weights for policy 1, policy_version 1541435 (0.0009) [2023-12-28 06:18:47,639][106225] Updated weights for policy 1, policy_version 1541445 (0.0005) [2023-12-28 06:18:47,692][106225] Updated weights for policy 1, policy_version 1541455 (0.0005) [2023-12-28 06:18:48,035][106226] Updated weights for policy 0, policy_version 1537758 (0.0009) [2023-12-28 06:18:48,089][106226] Updated weights for policy 0, policy_version 1537768 (0.0010) [2023-12-28 06:18:48,146][106226] Updated weights for policy 0, policy_version 1537778 (0.0010) [2023-12-28 06:18:48,219][106225] Updated weights for policy 1, policy_version 1541465 (0.0009) [2023-12-28 06:18:48,280][106225] Updated weights for policy 1, policy_version 1541475 (0.0010) [2023-12-28 06:18:48,350][106225] Updated weights for policy 1, policy_version 1541486 (0.0009) [2023-12-28 06:18:48,417][106225] Updated weights for policy 1, policy_version 1541496 (0.0011) [2023-12-28 06:18:48,851][106226] Updated weights for policy 0, policy_version 1537788 (0.0010) [2023-12-28 06:18:48,906][106226] Updated weights for policy 0, policy_version 1537798 (0.0010) [2023-12-28 06:18:48,966][106226] Updated weights for policy 0, policy_version 1537808 (0.0010) [2023-12-28 06:18:49,128][106225] Updated weights for policy 1, policy_version 1541506 (0.0005) [2023-12-28 06:18:49,180][106225] Updated weights for policy 1, policy_version 1541516 (0.0005) [2023-12-28 06:18:49,252][106225] Updated weights for policy 1, policy_version 1541526 (0.0009) [2023-12-28 06:18:49,651][106226] Updated weights for policy 0, policy_version 1537818 (0.0006) [2023-12-28 06:18:49,700][106226] Updated weights for policy 0, policy_version 1537828 (0.0008) [2023-12-28 06:18:49,749][106226] Updated weights for policy 0, policy_version 1537838 (0.0008) [2023-12-28 06:18:49,804][106226] Updated weights for policy 0, policy_version 1537848 (0.0008) [2023-12-28 06:18:49,976][106225] Updated weights for policy 1, policy_version 1541536 (0.0008) [2023-12-28 06:18:50,032][106225] Updated weights for policy 1, policy_version 1541546 (0.0008) [2023-12-28 06:18:50,080][106225] Updated weights for policy 1, policy_version 1541556 (0.0008) [2023-12-28 06:18:50,570][106226] Updated weights for policy 0, policy_version 1537858 (0.0011) [2023-12-28 06:18:50,630][106226] Updated weights for policy 0, policy_version 1537868 (0.0011) [2023-12-28 06:18:50,688][106226] Updated weights for policy 0, policy_version 1537878 (0.0011) [2023-12-28 06:18:50,857][106225] Updated weights for policy 1, policy_version 1541566 (0.0008) [2023-12-28 06:18:50,909][106225] Updated weights for policy 1, policy_version 1541576 (0.0008) [2023-12-28 06:18:50,968][106225] Updated weights for policy 1, policy_version 1541586 (0.0010) [2023-12-28 06:18:51,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 788471808. Throughput: 0: 10074.6, 1: 9866.5. Samples: 788479704. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:51,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.739')] [2023-12-28 06:18:51,358][106226] Updated weights for policy 0, policy_version 1537888 (0.0008) [2023-12-28 06:18:51,417][106226] Updated weights for policy 0, policy_version 1537898 (0.0008) [2023-12-28 06:18:51,472][106226] Updated weights for policy 0, policy_version 1537908 (0.0008) [2023-12-28 06:18:51,724][106225] Updated weights for policy 1, policy_version 1541596 (0.0008) [2023-12-28 06:18:51,797][106225] Updated weights for policy 1, policy_version 1541606 (0.0007) [2023-12-28 06:18:51,862][106225] Updated weights for policy 1, policy_version 1541616 (0.0008) [2023-12-28 06:18:52,244][106226] Updated weights for policy 0, policy_version 1537918 (0.0008) [2023-12-28 06:18:52,309][106226] Updated weights for policy 0, policy_version 1537928 (0.0008) [2023-12-28 06:18:52,377][106226] Updated weights for policy 0, policy_version 1537938 (0.0008) [2023-12-28 06:18:52,518][106225] Updated weights for policy 1, policy_version 1541626 (0.0007) [2023-12-28 06:18:52,581][106225] Updated weights for policy 1, policy_version 1541636 (0.0008) [2023-12-28 06:18:52,642][106225] Updated weights for policy 1, policy_version 1541646 (0.0009) [2023-12-28 06:18:52,703][106225] Updated weights for policy 1, policy_version 1541656 (0.0008) [2023-12-28 06:18:53,119][106226] Updated weights for policy 0, policy_version 1537948 (0.0008) [2023-12-28 06:18:53,181][106226] Updated weights for policy 0, policy_version 1537958 (0.0009) [2023-12-28 06:18:53,227][106226] Updated weights for policy 0, policy_version 1537968 (0.0008) [2023-12-28 06:18:53,394][106225] Updated weights for policy 1, policy_version 1541666 (0.0009) [2023-12-28 06:18:53,453][106225] Updated weights for policy 1, policy_version 1541676 (0.0008) [2023-12-28 06:18:53,514][106225] Updated weights for policy 1, policy_version 1541686 (0.0008) [2023-12-28 06:18:53,996][106226] Updated weights for policy 0, policy_version 1537978 (0.0008) [2023-12-28 06:18:54,058][106226] Updated weights for policy 0, policy_version 1537988 (0.0006) [2023-12-28 06:18:54,112][106226] Updated weights for policy 0, policy_version 1537998 (0.0006) [2023-12-28 06:18:54,140][106225] Updated weights for policy 1, policy_version 1541696 (0.0009) [2023-12-28 06:18:54,173][106226] Updated weights for policy 0, policy_version 1538008 (0.0005) [2023-12-28 06:18:54,211][106225] Updated weights for policy 1, policy_version 1541706 (0.0008) [2023-12-28 06:18:54,278][106225] Updated weights for policy 1, policy_version 1541716 (0.0008) [2023-12-28 06:18:54,686][106226] Updated weights for policy 0, policy_version 1538018 (0.0005) [2023-12-28 06:18:54,739][106226] Updated weights for policy 0, policy_version 1538028 (0.0005) [2023-12-28 06:18:54,801][106226] Updated weights for policy 0, policy_version 1538038 (0.0009) [2023-12-28 06:18:54,960][106225] Updated weights for policy 1, policy_version 1541726 (0.0009) [2023-12-28 06:18:55,022][106225] Updated weights for policy 1, policy_version 1541736 (0.0007) [2023-12-28 06:18:55,083][106225] Updated weights for policy 1, policy_version 1541746 (0.0005) [2023-12-28 06:18:55,450][106226] Updated weights for policy 0, policy_version 1538048 (0.0009) [2023-12-28 06:18:55,510][106226] Updated weights for policy 0, policy_version 1538058 (0.0011) [2023-12-28 06:18:55,559][106226] Updated weights for policy 0, policy_version 1538068 (0.0010) [2023-12-28 06:18:55,745][106225] Updated weights for policy 1, policy_version 1541756 (0.0006) [2023-12-28 06:18:55,799][106225] Updated weights for policy 1, policy_version 1541766 (0.0008) [2023-12-28 06:18:55,857][106225] Updated weights for policy 1, policy_version 1541776 (0.0010) [2023-12-28 06:18:56,173][106226] Updated weights for policy 0, policy_version 1538078 (0.0008) [2023-12-28 06:18:56,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 788570112. Throughput: 0: 10005.2, 1: 9771.6. Samples: 788537224. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:18:56,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.516')] [2023-12-28 06:18:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001541784_394747904.pth... [2023-12-28 06:18:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001540632_394452992.pth [2023-12-28 06:18:56,226][106226] Updated weights for policy 0, policy_version 1538088 (0.0008) [2023-12-28 06:18:56,271][106226] Updated weights for policy 0, policy_version 1538098 (0.0008) [2023-12-28 06:18:56,299][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001538104_393830400.pth... [2023-12-28 06:18:56,302][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001536920_393527296.pth [2023-12-28 06:18:56,619][106225] Updated weights for policy 1, policy_version 1541786 (0.0007) [2023-12-28 06:18:56,682][106225] Updated weights for policy 1, policy_version 1541796 (0.0005) [2023-12-28 06:18:56,753][106225] Updated weights for policy 1, policy_version 1541806 (0.0005) [2023-12-28 06:18:56,801][106225] Updated weights for policy 1, policy_version 1541816 (0.0006) [2023-12-28 06:18:56,850][106226] Updated weights for policy 0, policy_version 1538108 (0.0007) [2023-12-28 06:18:56,908][106226] Updated weights for policy 0, policy_version 1538118 (0.0009) [2023-12-28 06:18:56,957][106226] Updated weights for policy 0, policy_version 1538128 (0.0008) [2023-12-28 06:18:57,405][106225] Updated weights for policy 1, policy_version 1541826 (0.0005) [2023-12-28 06:18:57,456][106225] Updated weights for policy 1, policy_version 1541836 (0.0005) [2023-12-28 06:18:57,506][106225] Updated weights for policy 1, policy_version 1541846 (0.0005) [2023-12-28 06:18:57,744][106226] Updated weights for policy 0, policy_version 1538138 (0.0009) [2023-12-28 06:18:57,799][106226] Updated weights for policy 0, policy_version 1538148 (0.0009) [2023-12-28 06:18:57,861][106226] Updated weights for policy 0, policy_version 1538158 (0.0009) [2023-12-28 06:18:57,927][106226] Updated weights for policy 0, policy_version 1538168 (0.0009) [2023-12-28 06:18:58,029][106225] Updated weights for policy 1, policy_version 1541856 (0.0006) [2023-12-28 06:18:58,077][106225] Updated weights for policy 1, policy_version 1541866 (0.0005) [2023-12-28 06:18:58,145][106225] Updated weights for policy 1, policy_version 1541876 (0.0007) [2023-12-28 06:18:58,709][106226] Updated weights for policy 0, policy_version 1538178 (0.0008) [2023-12-28 06:18:58,778][106226] Updated weights for policy 0, policy_version 1538188 (0.0009) [2023-12-28 06:18:58,841][106226] Updated weights for policy 0, policy_version 1538198 (0.0009) [2023-12-28 06:18:58,938][106225] Updated weights for policy 1, policy_version 1541886 (0.0009) [2023-12-28 06:18:58,999][106225] Updated weights for policy 1, policy_version 1541896 (0.0010) [2023-12-28 06:18:59,066][106225] Updated weights for policy 1, policy_version 1541906 (0.0008) [2023-12-28 06:18:59,636][106226] Updated weights for policy 0, policy_version 1538208 (0.0007) [2023-12-28 06:18:59,705][106226] Updated weights for policy 0, policy_version 1538218 (0.0006) [2023-12-28 06:18:59,750][106225] Updated weights for policy 1, policy_version 1541916 (0.0009) [2023-12-28 06:18:59,763][106226] Updated weights for policy 0, policy_version 1538228 (0.0010) [2023-12-28 06:18:59,814][106225] Updated weights for policy 1, policy_version 1541926 (0.0008) [2023-12-28 06:18:59,881][106225] Updated weights for policy 1, policy_version 1541936 (0.0010) [2023-12-28 06:19:00,455][106226] Updated weights for policy 0, policy_version 1538238 (0.0008) [2023-12-28 06:19:00,513][106226] Updated weights for policy 0, policy_version 1538248 (0.0010) [2023-12-28 06:19:00,569][106226] Updated weights for policy 0, policy_version 1538258 (0.0010) [2023-12-28 06:19:00,589][106225] Updated weights for policy 1, policy_version 1541946 (0.0009) [2023-12-28 06:19:00,639][106225] Updated weights for policy 1, policy_version 1541956 (0.0010) [2023-12-28 06:19:00,686][106225] Updated weights for policy 1, policy_version 1541966 (0.0010) [2023-12-28 06:19:00,736][106225] Updated weights for policy 1, policy_version 1541976 (0.0010) [2023-12-28 06:19:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 788668416. Throughput: 0: 10020.3, 1: 9909.6. Samples: 788659308. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:01,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.786')] [2023-12-28 06:19:01,296][106226] Updated weights for policy 0, policy_version 1538268 (0.0011) [2023-12-28 06:19:01,370][106226] Updated weights for policy 0, policy_version 1538278 (0.0011) [2023-12-28 06:19:01,441][106226] Updated weights for policy 0, policy_version 1538288 (0.0008) [2023-12-28 06:19:01,492][106225] Updated weights for policy 1, policy_version 1541986 (0.0009) [2023-12-28 06:19:01,552][106225] Updated weights for policy 1, policy_version 1541996 (0.0009) [2023-12-28 06:19:01,612][106225] Updated weights for policy 1, policy_version 1542006 (0.0008) [2023-12-28 06:19:02,161][106226] Updated weights for policy 0, policy_version 1538298 (0.0007) [2023-12-28 06:19:02,223][106226] Updated weights for policy 0, policy_version 1538308 (0.0011) [2023-12-28 06:19:02,286][106225] Updated weights for policy 1, policy_version 1542016 (0.0008) [2023-12-28 06:19:02,290][106226] Updated weights for policy 0, policy_version 1538318 (0.0010) [2023-12-28 06:19:02,345][106225] Updated weights for policy 1, policy_version 1542026 (0.0007) [2023-12-28 06:19:02,351][106226] Updated weights for policy 0, policy_version 1538328 (0.0010) [2023-12-28 06:19:02,407][106225] Updated weights for policy 1, policy_version 1542036 (0.0009) [2023-12-28 06:19:03,059][106225] Updated weights for policy 1, policy_version 1542046 (0.0008) [2023-12-28 06:19:03,114][106225] Updated weights for policy 1, policy_version 1542056 (0.0007) [2023-12-28 06:19:03,120][106226] Updated weights for policy 0, policy_version 1538338 (0.0006) [2023-12-28 06:19:03,168][106225] Updated weights for policy 1, policy_version 1542066 (0.0007) [2023-12-28 06:19:03,182][106226] Updated weights for policy 0, policy_version 1538348 (0.0007) [2023-12-28 06:19:03,249][106226] Updated weights for policy 0, policy_version 1538358 (0.0006) [2023-12-28 06:19:03,762][106225] Updated weights for policy 1, policy_version 1542076 (0.0006) [2023-12-28 06:19:03,812][106225] Updated weights for policy 1, policy_version 1542086 (0.0007) [2023-12-28 06:19:03,874][106225] Updated weights for policy 1, policy_version 1542096 (0.0010) [2023-12-28 06:19:03,906][106226] Updated weights for policy 0, policy_version 1538368 (0.0008) [2023-12-28 06:19:03,961][106226] Updated weights for policy 0, policy_version 1538378 (0.0008) [2023-12-28 06:19:04,016][106226] Updated weights for policy 0, policy_version 1538388 (0.0008) [2023-12-28 06:19:04,613][106225] Updated weights for policy 1, policy_version 1542106 (0.0010) [2023-12-28 06:19:04,663][106225] Updated weights for policy 1, policy_version 1542116 (0.0010) [2023-12-28 06:19:04,715][106225] Updated weights for policy 1, policy_version 1542126 (0.0010) [2023-12-28 06:19:04,766][106225] Updated weights for policy 1, policy_version 1542136 (0.0010) [2023-12-28 06:19:04,776][106226] Updated weights for policy 0, policy_version 1538398 (0.0009) [2023-12-28 06:19:04,829][106226] Updated weights for policy 0, policy_version 1538408 (0.0006) [2023-12-28 06:19:04,893][106226] Updated weights for policy 0, policy_version 1538418 (0.0009) [2023-12-28 06:19:05,396][106225] Updated weights for policy 1, policy_version 1542146 (0.0005) [2023-12-28 06:19:05,441][106226] Updated weights for policy 0, policy_version 1538428 (0.0009) [2023-12-28 06:19:05,456][106225] Updated weights for policy 1, policy_version 1542156 (0.0007) [2023-12-28 06:19:05,495][106226] Updated weights for policy 0, policy_version 1538438 (0.0006) [2023-12-28 06:19:05,514][106225] Updated weights for policy 1, policy_version 1542166 (0.0010) [2023-12-28 06:19:05,545][106226] Updated weights for policy 0, policy_version 1538448 (0.0008) [2023-12-28 06:19:06,114][106226] Updated weights for policy 0, policy_version 1538458 (0.0006) [2023-12-28 06:19:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 788766720. Throughput: 0: 10036.8, 1: 9914.8. Samples: 788780816. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:06,175][105115] Avg episode reward: [(0, '-4.670'), (1, '-4.721')] [2023-12-28 06:19:06,179][106226] Updated weights for policy 0, policy_version 1538468 (0.0010) [2023-12-28 06:19:06,243][106226] Updated weights for policy 0, policy_version 1538478 (0.0009) [2023-12-28 06:19:06,258][106225] Updated weights for policy 1, policy_version 1542176 (0.0008) [2023-12-28 06:19:06,311][106226] Updated weights for policy 0, policy_version 1538488 (0.0011) [2023-12-28 06:19:06,323][106225] Updated weights for policy 1, policy_version 1542186 (0.0008) [2023-12-28 06:19:06,387][106225] Updated weights for policy 1, policy_version 1542196 (0.0008) [2023-12-28 06:19:06,990][106226] Updated weights for policy 0, policy_version 1538498 (0.0011) [2023-12-28 06:19:07,047][106226] Updated weights for policy 0, policy_version 1538508 (0.0010) [2023-12-28 06:19:07,108][106226] Updated weights for policy 0, policy_version 1538518 (0.0010) [2023-12-28 06:19:07,130][106225] Updated weights for policy 1, policy_version 1542206 (0.0007) [2023-12-28 06:19:07,188][106225] Updated weights for policy 1, policy_version 1542216 (0.0008) [2023-12-28 06:19:07,254][106225] Updated weights for policy 1, policy_version 1542226 (0.0007) [2023-12-28 06:19:07,834][106226] Updated weights for policy 0, policy_version 1538528 (0.0011) [2023-12-28 06:19:07,849][106225] Updated weights for policy 1, policy_version 1542236 (0.0009) [2023-12-28 06:19:07,884][106226] Updated weights for policy 0, policy_version 1538538 (0.0010) [2023-12-28 06:19:07,894][106225] Updated weights for policy 1, policy_version 1542246 (0.0009) [2023-12-28 06:19:07,932][106226] Updated weights for policy 0, policy_version 1538548 (0.0010) [2023-12-28 06:19:07,946][106225] Updated weights for policy 1, policy_version 1542256 (0.0007) [2023-12-28 06:19:08,637][106226] Updated weights for policy 0, policy_version 1538558 (0.0010) [2023-12-28 06:19:08,666][106225] Updated weights for policy 1, policy_version 1542266 (0.0010) [2023-12-28 06:19:08,691][106226] Updated weights for policy 0, policy_version 1538568 (0.0008) [2023-12-28 06:19:08,728][106225] Updated weights for policy 1, policy_version 1542276 (0.0010) [2023-12-28 06:19:08,753][106226] Updated weights for policy 0, policy_version 1538578 (0.0006) [2023-12-28 06:19:08,789][106225] Updated weights for policy 1, policy_version 1542286 (0.0010) [2023-12-28 06:19:08,849][106225] Updated weights for policy 1, policy_version 1542296 (0.0006) [2023-12-28 06:19:09,497][106225] Updated weights for policy 1, policy_version 1542306 (0.0007) [2023-12-28 06:19:09,525][106226] Updated weights for policy 0, policy_version 1538588 (0.0010) [2023-12-28 06:19:09,559][106225] Updated weights for policy 1, policy_version 1542316 (0.0008) [2023-12-28 06:19:09,586][106226] Updated weights for policy 0, policy_version 1538598 (0.0010) [2023-12-28 06:19:09,617][106225] Updated weights for policy 1, policy_version 1542326 (0.0007) [2023-12-28 06:19:09,651][106226] Updated weights for policy 0, policy_version 1538608 (0.0010) [2023-12-28 06:19:10,345][106225] Updated weights for policy 1, policy_version 1542336 (0.0010) [2023-12-28 06:19:10,397][106225] Updated weights for policy 1, policy_version 1542346 (0.0009) [2023-12-28 06:19:10,430][106226] Updated weights for policy 0, policy_version 1538618 (0.0010) [2023-12-28 06:19:10,445][106225] Updated weights for policy 1, policy_version 1542356 (0.0010) [2023-12-28 06:19:10,491][106226] Updated weights for policy 0, policy_version 1538628 (0.0005) [2023-12-28 06:19:10,562][106226] Updated weights for policy 0, policy_version 1538638 (0.0005) [2023-12-28 06:19:10,632][106226] Updated weights for policy 0, policy_version 1538648 (0.0006) [2023-12-28 06:19:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 788865024. Throughput: 0: 9990.0, 1: 9975.7. Samples: 788839520. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:11,175][105115] Avg episode reward: [(0, '-4.837'), (1, '-4.752')] [2023-12-28 06:19:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001538648_393969664.pth... [2023-12-28 06:19:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001537496_393674752.pth [2023-12-28 06:19:11,214][106225] Updated weights for policy 1, policy_version 1542366 (0.0008) [2023-12-28 06:19:11,274][106225] Updated weights for policy 1, policy_version 1542376 (0.0007) [2023-12-28 06:19:11,310][106226] Updated weights for policy 0, policy_version 1538658 (0.0009) [2023-12-28 06:19:11,327][106225] Updated weights for policy 1, policy_version 1542386 (0.0008) [2023-12-28 06:19:11,369][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001542392_394903552.pth... [2023-12-28 06:19:11,374][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001541208_394600448.pth [2023-12-28 06:19:11,385][106226] Updated weights for policy 0, policy_version 1538668 (0.0008) [2023-12-28 06:19:11,453][106226] Updated weights for policy 0, policy_version 1538678 (0.0009) [2023-12-28 06:19:12,039][106225] Updated weights for policy 1, policy_version 1542396 (0.0009) [2023-12-28 06:19:12,100][106225] Updated weights for policy 1, policy_version 1542406 (0.0010) [2023-12-28 06:19:12,160][106225] Updated weights for policy 1, policy_version 1542416 (0.0010) [2023-12-28 06:19:12,275][106226] Updated weights for policy 0, policy_version 1538688 (0.0009) [2023-12-28 06:19:12,340][106226] Updated weights for policy 0, policy_version 1538698 (0.0008) [2023-12-28 06:19:12,410][106226] Updated weights for policy 0, policy_version 1538708 (0.0009) [2023-12-28 06:19:12,910][106225] Updated weights for policy 1, policy_version 1542426 (0.0009) [2023-12-28 06:19:12,958][106225] Updated weights for policy 1, policy_version 1542436 (0.0007) [2023-12-28 06:19:13,016][106225] Updated weights for policy 1, policy_version 1542446 (0.0008) [2023-12-28 06:19:13,075][106225] Updated weights for policy 1, policy_version 1542456 (0.0007) [2023-12-28 06:19:13,079][106226] Updated weights for policy 0, policy_version 1538718 (0.0008) [2023-12-28 06:19:13,134][106226] Updated weights for policy 0, policy_version 1538728 (0.0009) [2023-12-28 06:19:13,184][106226] Updated weights for policy 0, policy_version 1538738 (0.0005) [2023-12-28 06:19:13,770][106225] Updated weights for policy 1, policy_version 1542466 (0.0006) [2023-12-28 06:19:13,828][106225] Updated weights for policy 1, policy_version 1542476 (0.0005) [2023-12-28 06:19:13,873][106225] Updated weights for policy 1, policy_version 1542486 (0.0005) [2023-12-28 06:19:13,875][106226] Updated weights for policy 0, policy_version 1538748 (0.0007) [2023-12-28 06:19:13,942][106226] Updated weights for policy 0, policy_version 1538758 (0.0010) [2023-12-28 06:19:13,995][106226] Updated weights for policy 0, policy_version 1538768 (0.0010) [2023-12-28 06:19:14,435][106225] Updated weights for policy 1, policy_version 1542496 (0.0007) [2023-12-28 06:19:14,485][106225] Updated weights for policy 1, policy_version 1542506 (0.0007) [2023-12-28 06:19:14,542][106225] Updated weights for policy 1, policy_version 1542516 (0.0008) [2023-12-28 06:19:14,702][106226] Updated weights for policy 0, policy_version 1538778 (0.0010) [2023-12-28 06:19:14,766][106226] Updated weights for policy 0, policy_version 1538788 (0.0010) [2023-12-28 06:19:14,830][106226] Updated weights for policy 0, policy_version 1538798 (0.0007) [2023-12-28 06:19:14,896][106226] Updated weights for policy 0, policy_version 1538808 (0.0011) [2023-12-28 06:19:15,262][106225] Updated weights for policy 1, policy_version 1542526 (0.0008) [2023-12-28 06:19:15,336][106225] Updated weights for policy 1, policy_version 1542536 (0.0008) [2023-12-28 06:19:15,402][106225] Updated weights for policy 1, policy_version 1542546 (0.0007) [2023-12-28 06:19:15,608][106226] Updated weights for policy 0, policy_version 1538818 (0.0011) [2023-12-28 06:19:15,673][106226] Updated weights for policy 0, policy_version 1538828 (0.0011) [2023-12-28 06:19:15,741][106226] Updated weights for policy 0, policy_version 1538838 (0.0011) [2023-12-28 06:19:16,105][106225] Updated weights for policy 1, policy_version 1542556 (0.0009) [2023-12-28 06:19:16,164][106225] Updated weights for policy 1, policy_version 1542566 (0.0008) [2023-12-28 06:19:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 788963328. Throughput: 0: 9854.3, 1: 9911.9. Samples: 788956920. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:16,175][105115] Avg episode reward: [(0, '-4.563'), (1, '-4.673')] [2023-12-28 06:19:16,221][106225] Updated weights for policy 1, policy_version 1542576 (0.0008) [2023-12-28 06:19:16,434][106226] Updated weights for policy 0, policy_version 1538848 (0.0010) [2023-12-28 06:19:16,487][106226] Updated weights for policy 0, policy_version 1538858 (0.0010) [2023-12-28 06:19:16,545][106226] Updated weights for policy 0, policy_version 1538868 (0.0011) [2023-12-28 06:19:16,891][106225] Updated weights for policy 1, policy_version 1542586 (0.0005) [2023-12-28 06:19:16,947][106225] Updated weights for policy 1, policy_version 1542596 (0.0005) [2023-12-28 06:19:16,993][106225] Updated weights for policy 1, policy_version 1542606 (0.0005) [2023-12-28 06:19:17,045][106225] Updated weights for policy 1, policy_version 1542616 (0.0007) [2023-12-28 06:19:17,258][106226] Updated weights for policy 0, policy_version 1538878 (0.0009) [2023-12-28 06:19:17,309][106226] Updated weights for policy 0, policy_version 1538888 (0.0008) [2023-12-28 06:19:17,365][106226] Updated weights for policy 0, policy_version 1538898 (0.0009) [2023-12-28 06:19:17,721][106225] Updated weights for policy 1, policy_version 1542626 (0.0008) [2023-12-28 06:19:17,779][106225] Updated weights for policy 1, policy_version 1542636 (0.0009) [2023-12-28 06:19:17,833][106225] Updated weights for policy 1, policy_version 1542646 (0.0009) [2023-12-28 06:19:18,036][106226] Updated weights for policy 0, policy_version 1538908 (0.0008) [2023-12-28 06:19:18,087][106226] Updated weights for policy 0, policy_version 1538918 (0.0008) [2023-12-28 06:19:18,143][106226] Updated weights for policy 0, policy_version 1538928 (0.0008) [2023-12-28 06:19:18,564][106225] Updated weights for policy 1, policy_version 1542656 (0.0010) [2023-12-28 06:19:18,631][106225] Updated weights for policy 1, policy_version 1542666 (0.0007) [2023-12-28 06:19:18,695][106225] Updated weights for policy 1, policy_version 1542676 (0.0008) [2023-12-28 06:19:18,943][106226] Updated weights for policy 0, policy_version 1538938 (0.0009) [2023-12-28 06:19:19,011][106226] Updated weights for policy 0, policy_version 1538948 (0.0009) [2023-12-28 06:19:19,081][106226] Updated weights for policy 0, policy_version 1538958 (0.0009) [2023-12-28 06:19:19,144][106226] Updated weights for policy 0, policy_version 1538968 (0.0008) [2023-12-28 06:19:19,270][106225] Updated weights for policy 1, policy_version 1542686 (0.0009) [2023-12-28 06:19:19,333][106225] Updated weights for policy 1, policy_version 1542696 (0.0006) [2023-12-28 06:19:19,404][106225] Updated weights for policy 1, policy_version 1542706 (0.0009) [2023-12-28 06:19:19,857][106226] Updated weights for policy 0, policy_version 1538978 (0.0009) [2023-12-28 06:19:19,924][106226] Updated weights for policy 0, policy_version 1538988 (0.0009) [2023-12-28 06:19:19,984][106226] Updated weights for policy 0, policy_version 1538998 (0.0009) [2023-12-28 06:19:20,120][106225] Updated weights for policy 1, policy_version 1542716 (0.0009) [2023-12-28 06:19:20,181][106225] Updated weights for policy 1, policy_version 1542726 (0.0009) [2023-12-28 06:19:20,245][106225] Updated weights for policy 1, policy_version 1542736 (0.0009) [2023-12-28 06:19:20,735][106226] Updated weights for policy 0, policy_version 1539008 (0.0006) [2023-12-28 06:19:20,803][106226] Updated weights for policy 0, policy_version 1539018 (0.0006) [2023-12-28 06:19:20,876][106226] Updated weights for policy 0, policy_version 1539028 (0.0010) [2023-12-28 06:19:20,973][106225] Updated weights for policy 1, policy_version 1542746 (0.0009) [2023-12-28 06:19:21,048][106225] Updated weights for policy 1, policy_version 1542756 (0.0007) [2023-12-28 06:19:21,117][106225] Updated weights for policy 1, policy_version 1542766 (0.0007) [2023-12-28 06:19:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 789061632. Throughput: 0: 9783.8, 1: 9932.6. Samples: 789074632. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:21,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.382')] [2023-12-28 06:19:21,187][106225] Updated weights for policy 1, policy_version 1542776 (0.0007) [2023-12-28 06:19:21,575][106226] Updated weights for policy 0, policy_version 1539038 (0.0011) [2023-12-28 06:19:21,645][106226] Updated weights for policy 0, policy_version 1539048 (0.0009) [2023-12-28 06:19:21,712][106226] Updated weights for policy 0, policy_version 1539058 (0.0011) [2023-12-28 06:19:21,943][106225] Updated weights for policy 1, policy_version 1542786 (0.0008) [2023-12-28 06:19:21,997][106225] Updated weights for policy 1, policy_version 1542796 (0.0008) [2023-12-28 06:19:22,067][106225] Updated weights for policy 1, policy_version 1542806 (0.0008) [2023-12-28 06:19:22,390][106226] Updated weights for policy 0, policy_version 1539068 (0.0009) [2023-12-28 06:19:22,448][106226] Updated weights for policy 0, policy_version 1539078 (0.0011) [2023-12-28 06:19:22,503][106226] Updated weights for policy 0, policy_version 1539088 (0.0011) [2023-12-28 06:19:22,854][106225] Updated weights for policy 1, policy_version 1542816 (0.0007) [2023-12-28 06:19:22,913][106225] Updated weights for policy 1, policy_version 1542826 (0.0006) [2023-12-28 06:19:22,967][106225] Updated weights for policy 1, policy_version 1542836 (0.0005) [2023-12-28 06:19:23,251][106226] Updated weights for policy 0, policy_version 1539098 (0.0010) [2023-12-28 06:19:23,305][106226] Updated weights for policy 0, policy_version 1539108 (0.0007) [2023-12-28 06:19:23,358][106226] Updated weights for policy 0, policy_version 1539118 (0.0007) [2023-12-28 06:19:23,402][106226] Updated weights for policy 0, policy_version 1539128 (0.0007) [2023-12-28 06:19:23,650][106225] Updated weights for policy 1, policy_version 1542846 (0.0007) [2023-12-28 06:19:23,710][106225] Updated weights for policy 1, policy_version 1542856 (0.0008) [2023-12-28 06:19:23,763][106225] Updated weights for policy 1, policy_version 1542866 (0.0008) [2023-12-28 06:19:24,082][106226] Updated weights for policy 0, policy_version 1539138 (0.0007) [2023-12-28 06:19:24,150][106226] Updated weights for policy 0, policy_version 1539148 (0.0008) [2023-12-28 06:19:24,222][106226] Updated weights for policy 0, policy_version 1539158 (0.0006) [2023-12-28 06:19:24,424][106225] Updated weights for policy 1, policy_version 1542876 (0.0007) [2023-12-28 06:19:24,472][106225] Updated weights for policy 1, policy_version 1542886 (0.0007) [2023-12-28 06:19:24,524][106225] Updated weights for policy 1, policy_version 1542896 (0.0008) [2023-12-28 06:19:24,868][106226] Updated weights for policy 0, policy_version 1539168 (0.0008) [2023-12-28 06:19:24,914][106226] Updated weights for policy 0, policy_version 1539178 (0.0008) [2023-12-28 06:19:24,970][106226] Updated weights for policy 0, policy_version 1539188 (0.0008) [2023-12-28 06:19:25,139][106225] Updated weights for policy 1, policy_version 1542906 (0.0007) [2023-12-28 06:19:25,186][106225] Updated weights for policy 1, policy_version 1542916 (0.0008) [2023-12-28 06:19:25,238][106225] Updated weights for policy 1, policy_version 1542926 (0.0008) [2023-12-28 06:19:25,300][106225] Updated weights for policy 1, policy_version 1542936 (0.0005) [2023-12-28 06:19:25,719][106226] Updated weights for policy 0, policy_version 1539198 (0.0007) [2023-12-28 06:19:25,776][106226] Updated weights for policy 0, policy_version 1539208 (0.0007) [2023-12-28 06:19:25,833][106226] Updated weights for policy 0, policy_version 1539218 (0.0011) [2023-12-28 06:19:25,919][106225] Updated weights for policy 1, policy_version 1542946 (0.0005) [2023-12-28 06:19:25,975][106225] Updated weights for policy 1, policy_version 1542956 (0.0006) [2023-12-28 06:19:26,027][106225] Updated weights for policy 1, policy_version 1542966 (0.0005) [2023-12-28 06:19:26,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 789168128. Throughput: 0: 9802.5, 1: 9942.8. Samples: 789132516. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:26,176][105115] Avg episode reward: [(0, '-4.764'), (1, '-4.713')] [2023-12-28 06:19:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001542968_395051008.pth... [2023-12-28 06:19:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001539224_394117120.pth... [2023-12-28 06:19:26,197][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001538104_393830400.pth [2023-12-28 06:19:26,197][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001541784_394747904.pth [2023-12-28 06:19:26,392][106226] Updated weights for policy 0, policy_version 1539228 (0.0005) [2023-12-28 06:19:26,444][106226] Updated weights for policy 0, policy_version 1539238 (0.0005) [2023-12-28 06:19:26,499][106226] Updated weights for policy 0, policy_version 1539248 (0.0008) [2023-12-28 06:19:26,604][106225] Updated weights for policy 1, policy_version 1542976 (0.0009) [2023-12-28 06:19:26,654][106225] Updated weights for policy 1, policy_version 1542986 (0.0010) [2023-12-28 06:19:26,721][106225] Updated weights for policy 1, policy_version 1542996 (0.0010) [2023-12-28 06:19:27,176][106226] Updated weights for policy 0, policy_version 1539258 (0.0008) [2023-12-28 06:19:27,226][106226] Updated weights for policy 0, policy_version 1539268 (0.0009) [2023-12-28 06:19:27,281][106226] Updated weights for policy 0, policy_version 1539279 (0.0010) [2023-12-28 06:19:27,321][106225] Updated weights for policy 1, policy_version 1543006 (0.0010) [2023-12-28 06:19:27,370][106225] Updated weights for policy 1, policy_version 1543016 (0.0010) [2023-12-28 06:19:27,420][106225] Updated weights for policy 1, policy_version 1543026 (0.0006) [2023-12-28 06:19:27,981][106226] Updated weights for policy 0, policy_version 1539289 (0.0005) [2023-12-28 06:19:27,983][106225] Updated weights for policy 1, policy_version 1543036 (0.0008) [2023-12-28 06:19:28,039][106226] Updated weights for policy 0, policy_version 1539299 (0.0006) [2023-12-28 06:19:28,044][106225] Updated weights for policy 1, policy_version 1543046 (0.0009) [2023-12-28 06:19:28,102][106226] Updated weights for policy 0, policy_version 1539309 (0.0008) [2023-12-28 06:19:28,106][106225] Updated weights for policy 1, policy_version 1543056 (0.0005) [2023-12-28 06:19:28,153][106226] Updated weights for policy 0, policy_version 1539319 (0.0006) [2023-12-28 06:19:28,644][106225] Updated weights for policy 1, policy_version 1543066 (0.0006) [2023-12-28 06:19:28,691][106225] Updated weights for policy 1, policy_version 1543076 (0.0010) [2023-12-28 06:19:28,751][106225] Updated weights for policy 1, policy_version 1543086 (0.0010) [2023-12-28 06:19:28,813][106225] Updated weights for policy 1, policy_version 1543096 (0.0010) [2023-12-28 06:19:28,879][106226] Updated weights for policy 0, policy_version 1539329 (0.0006) [2023-12-28 06:19:28,942][106226] Updated weights for policy 0, policy_version 1539339 (0.0008) [2023-12-28 06:19:29,000][106226] Updated weights for policy 0, policy_version 1539349 (0.0009) [2023-12-28 06:19:29,481][106225] Updated weights for policy 1, policy_version 1543106 (0.0008) [2023-12-28 06:19:29,539][106225] Updated weights for policy 1, policy_version 1543116 (0.0008) [2023-12-28 06:19:29,598][106225] Updated weights for policy 1, policy_version 1543126 (0.0008) [2023-12-28 06:19:29,733][106226] Updated weights for policy 0, policy_version 1539359 (0.0009) [2023-12-28 06:19:29,787][106226] Updated weights for policy 0, policy_version 1539369 (0.0008) [2023-12-28 06:19:29,844][106226] Updated weights for policy 0, policy_version 1539379 (0.0009) [2023-12-28 06:19:30,363][106225] Updated weights for policy 1, policy_version 1543136 (0.0008) [2023-12-28 06:19:30,420][106225] Updated weights for policy 1, policy_version 1543146 (0.0006) [2023-12-28 06:19:30,482][106225] Updated weights for policy 1, policy_version 1543156 (0.0008) [2023-12-28 06:19:30,565][106226] Updated weights for policy 0, policy_version 1539389 (0.0007) [2023-12-28 06:19:30,628][106226] Updated weights for policy 0, policy_version 1539399 (0.0008) [2023-12-28 06:19:30,689][106226] Updated weights for policy 0, policy_version 1539409 (0.0009) [2023-12-28 06:19:31,121][106225] Updated weights for policy 1, policy_version 1543166 (0.0008) [2023-12-28 06:19:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 789266432. Throughput: 0: 9904.3, 1: 10173.1. Samples: 789259840. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:31,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.702')] [2023-12-28 06:19:31,189][106225] Updated weights for policy 1, policy_version 1543176 (0.0008) [2023-12-28 06:19:31,249][106225] Updated weights for policy 1, policy_version 1543186 (0.0009) [2023-12-28 06:19:31,428][106226] Updated weights for policy 0, policy_version 1539419 (0.0007) [2023-12-28 06:19:31,488][106226] Updated weights for policy 0, policy_version 1539429 (0.0006) [2023-12-28 06:19:31,543][106226] Updated weights for policy 0, policy_version 1539439 (0.0005) [2023-12-28 06:19:31,959][106225] Updated weights for policy 1, policy_version 1543196 (0.0009) [2023-12-28 06:19:32,017][106225] Updated weights for policy 1, policy_version 1543206 (0.0009) [2023-12-28 06:19:32,072][106225] Updated weights for policy 1, policy_version 1543216 (0.0009) [2023-12-28 06:19:32,263][106226] Updated weights for policy 0, policy_version 1539449 (0.0006) [2023-12-28 06:19:32,327][106226] Updated weights for policy 0, policy_version 1539459 (0.0007) [2023-12-28 06:19:32,400][106226] Updated weights for policy 0, policy_version 1539469 (0.0008) [2023-12-28 06:19:32,457][106226] Updated weights for policy 0, policy_version 1539479 (0.0008) [2023-12-28 06:19:32,804][106225] Updated weights for policy 1, policy_version 1543226 (0.0010) [2023-12-28 06:19:32,868][106225] Updated weights for policy 1, policy_version 1543236 (0.0010) [2023-12-28 06:19:32,927][106225] Updated weights for policy 1, policy_version 1543246 (0.0009) [2023-12-28 06:19:32,993][106225] Updated weights for policy 1, policy_version 1543256 (0.0008) [2023-12-28 06:19:33,114][106226] Updated weights for policy 0, policy_version 1539489 (0.0007) [2023-12-28 06:19:33,170][106226] Updated weights for policy 0, policy_version 1539499 (0.0005) [2023-12-28 06:19:33,224][106226] Updated weights for policy 0, policy_version 1539509 (0.0007) [2023-12-28 06:19:33,733][106225] Updated weights for policy 1, policy_version 1543266 (0.0006) [2023-12-28 06:19:33,777][106226] Updated weights for policy 0, policy_version 1539519 (0.0006) [2023-12-28 06:19:33,785][106225] Updated weights for policy 1, policy_version 1543276 (0.0005) [2023-12-28 06:19:33,824][106226] Updated weights for policy 0, policy_version 1539529 (0.0005) [2023-12-28 06:19:33,848][106225] Updated weights for policy 1, policy_version 1543286 (0.0005) [2023-12-28 06:19:33,868][106226] Updated weights for policy 0, policy_version 1539539 (0.0005) [2023-12-28 06:19:34,504][106225] Updated weights for policy 1, policy_version 1543296 (0.0008) [2023-12-28 06:19:34,563][106226] Updated weights for policy 0, policy_version 1539549 (0.0006) [2023-12-28 06:19:34,565][106225] Updated weights for policy 1, policy_version 1543306 (0.0008) [2023-12-28 06:19:34,619][106226] Updated weights for policy 0, policy_version 1539559 (0.0007) [2023-12-28 06:19:34,626][106225] Updated weights for policy 1, policy_version 1543316 (0.0006) [2023-12-28 06:19:34,689][106226] Updated weights for policy 0, policy_version 1539569 (0.0009) [2023-12-28 06:19:35,346][106225] Updated weights for policy 1, policy_version 1543326 (0.0006) [2023-12-28 06:19:35,403][106225] Updated weights for policy 1, policy_version 1543336 (0.0005) [2023-12-28 06:19:35,431][106226] Updated weights for policy 0, policy_version 1539579 (0.0009) [2023-12-28 06:19:35,464][106225] Updated weights for policy 1, policy_version 1543346 (0.0007) [2023-12-28 06:19:35,489][106226] Updated weights for policy 0, policy_version 1539589 (0.0008) [2023-12-28 06:19:35,542][106226] Updated weights for policy 0, policy_version 1539599 (0.0008) [2023-12-28 06:19:36,131][106225] Updated weights for policy 1, policy_version 1543356 (0.0006) [2023-12-28 06:19:36,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 789364736. Throughput: 0: 9863.0, 1: 10130.4. Samples: 789379400. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:36,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.501')] [2023-12-28 06:19:36,188][106225] Updated weights for policy 1, policy_version 1543366 (0.0008) [2023-12-28 06:19:36,246][106225] Updated weights for policy 1, policy_version 1543376 (0.0009) [2023-12-28 06:19:36,287][106226] Updated weights for policy 0, policy_version 1539609 (0.0009) [2023-12-28 06:19:36,355][106226] Updated weights for policy 0, policy_version 1539619 (0.0009) [2023-12-28 06:19:36,421][106226] Updated weights for policy 0, policy_version 1539629 (0.0008) [2023-12-28 06:19:36,484][106226] Updated weights for policy 0, policy_version 1539639 (0.0009) [2023-12-28 06:19:36,946][106225] Updated weights for policy 1, policy_version 1543386 (0.0008) [2023-12-28 06:19:37,008][106225] Updated weights for policy 1, policy_version 1543396 (0.0009) [2023-12-28 06:19:37,066][106225] Updated weights for policy 1, policy_version 1543406 (0.0008) [2023-12-28 06:19:37,128][106225] Updated weights for policy 1, policy_version 1543416 (0.0008) [2023-12-28 06:19:37,181][106226] Updated weights for policy 0, policy_version 1539649 (0.0008) [2023-12-28 06:19:37,231][106226] Updated weights for policy 0, policy_version 1539659 (0.0008) [2023-12-28 06:19:37,292][106226] Updated weights for policy 0, policy_version 1539669 (0.0010) [2023-12-28 06:19:37,783][106225] Updated weights for policy 1, policy_version 1543426 (0.0008) [2023-12-28 06:19:37,845][106225] Updated weights for policy 1, policy_version 1543436 (0.0009) [2023-12-28 06:19:37,899][106225] Updated weights for policy 1, policy_version 1543446 (0.0008) [2023-12-28 06:19:38,045][106226] Updated weights for policy 0, policy_version 1539679 (0.0008) [2023-12-28 06:19:38,099][106226] Updated weights for policy 0, policy_version 1539689 (0.0009) [2023-12-28 06:19:38,154][106226] Updated weights for policy 0, policy_version 1539699 (0.0008) [2023-12-28 06:19:38,592][106225] Updated weights for policy 1, policy_version 1543456 (0.0008) [2023-12-28 06:19:38,653][106225] Updated weights for policy 1, policy_version 1543466 (0.0009) [2023-12-28 06:19:38,713][106225] Updated weights for policy 1, policy_version 1543476 (0.0008) [2023-12-28 06:19:38,927][106226] Updated weights for policy 0, policy_version 1539709 (0.0009) [2023-12-28 06:19:38,986][106226] Updated weights for policy 0, policy_version 1539719 (0.0009) [2023-12-28 06:19:39,034][106226] Updated weights for policy 0, policy_version 1539729 (0.0008) [2023-12-28 06:19:39,509][106225] Updated weights for policy 1, policy_version 1543486 (0.0008) [2023-12-28 06:19:39,561][106225] Updated weights for policy 1, policy_version 1543496 (0.0008) [2023-12-28 06:19:39,613][106225] Updated weights for policy 1, policy_version 1543506 (0.0010) [2023-12-28 06:19:39,751][106226] Updated weights for policy 0, policy_version 1539739 (0.0007) [2023-12-28 06:19:39,820][106226] Updated weights for policy 0, policy_version 1539749 (0.0011) [2023-12-28 06:19:39,891][106226] Updated weights for policy 0, policy_version 1539759 (0.0009) [2023-12-28 06:19:40,388][106225] Updated weights for policy 1, policy_version 1543516 (0.0009) [2023-12-28 06:19:40,438][106225] Updated weights for policy 1, policy_version 1543526 (0.0008) [2023-12-28 06:19:40,491][106225] Updated weights for policy 1, policy_version 1543536 (0.0010) [2023-12-28 06:19:40,574][106226] Updated weights for policy 0, policy_version 1539769 (0.0008) [2023-12-28 06:19:40,638][106226] Updated weights for policy 0, policy_version 1539779 (0.0005) [2023-12-28 06:19:40,703][106226] Updated weights for policy 0, policy_version 1539789 (0.0005) [2023-12-28 06:19:40,764][106226] Updated weights for policy 0, policy_version 1539799 (0.0005) [2023-12-28 06:19:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 789463040. Throughput: 0: 9857.5, 1: 10142.7. Samples: 789437232. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:41,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.944')] [2023-12-28 06:19:41,181][106225] Updated weights for policy 1, policy_version 1543546 (0.0008) [2023-12-28 06:19:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001539800_394264576.pth... [2023-12-28 06:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001538648_393969664.pth [2023-12-28 06:19:41,239][106225] Updated weights for policy 1, policy_version 1543556 (0.0009) [2023-12-28 06:19:41,304][106225] Updated weights for policy 1, policy_version 1543566 (0.0009) [2023-12-28 06:19:41,363][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001543576_395206656.pth... [2023-12-28 06:19:41,364][106225] Updated weights for policy 1, policy_version 1543576 (0.0007) [2023-12-28 06:19:41,365][106226] Updated weights for policy 0, policy_version 1539809 (0.0009) [2023-12-28 06:19:41,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001542392_394903552.pth [2023-12-28 06:19:41,435][106226] Updated weights for policy 0, policy_version 1539819 (0.0010) [2023-12-28 06:19:41,500][106226] Updated weights for policy 0, policy_version 1539829 (0.0009) [2023-12-28 06:19:42,131][106225] Updated weights for policy 1, policy_version 1543586 (0.0011) [2023-12-28 06:19:42,172][106226] Updated weights for policy 0, policy_version 1539839 (0.0008) [2023-12-28 06:19:42,193][106225] Updated weights for policy 1, policy_version 1543596 (0.0011) [2023-12-28 06:19:42,232][106226] Updated weights for policy 0, policy_version 1539849 (0.0010) [2023-12-28 06:19:42,256][106225] Updated weights for policy 1, policy_version 1543606 (0.0010) [2023-12-28 06:19:42,294][106226] Updated weights for policy 0, policy_version 1539859 (0.0011) [2023-12-28 06:19:42,968][106225] Updated weights for policy 1, policy_version 1543616 (0.0008) [2023-12-28 06:19:43,019][106225] Updated weights for policy 1, policy_version 1543626 (0.0007) [2023-12-28 06:19:43,025][106226] Updated weights for policy 0, policy_version 1539869 (0.0011) [2023-12-28 06:19:43,063][106225] Updated weights for policy 1, policy_version 1543636 (0.0005) [2023-12-28 06:19:43,075][106226] Updated weights for policy 0, policy_version 1539879 (0.0010) [2023-12-28 06:19:43,129][106226] Updated weights for policy 0, policy_version 1539889 (0.0010) [2023-12-28 06:19:43,825][106225] Updated weights for policy 1, policy_version 1543646 (0.0007) [2023-12-28 06:19:43,849][106226] Updated weights for policy 0, policy_version 1539899 (0.0010) [2023-12-28 06:19:43,886][106225] Updated weights for policy 1, policy_version 1543656 (0.0009) [2023-12-28 06:19:43,899][106226] Updated weights for policy 0, policy_version 1539909 (0.0010) [2023-12-28 06:19:43,943][106225] Updated weights for policy 1, policy_version 1543666 (0.0006) [2023-12-28 06:19:43,951][106226] Updated weights for policy 0, policy_version 1539919 (0.0010) [2023-12-28 06:19:44,672][106225] Updated weights for policy 1, policy_version 1543676 (0.0006) [2023-12-28 06:19:44,674][106226] Updated weights for policy 0, policy_version 1539929 (0.0010) [2023-12-28 06:19:44,720][106225] Updated weights for policy 1, policy_version 1543686 (0.0006) [2023-12-28 06:19:44,734][106226] Updated weights for policy 0, policy_version 1539939 (0.0010) [2023-12-28 06:19:44,774][106225] Updated weights for policy 1, policy_version 1543696 (0.0007) [2023-12-28 06:19:44,796][106226] Updated weights for policy 0, policy_version 1539949 (0.0009) [2023-12-28 06:19:44,861][106226] Updated weights for policy 0, policy_version 1539959 (0.0010) [2023-12-28 06:19:45,495][106225] Updated weights for policy 1, policy_version 1543706 (0.0007) [2023-12-28 06:19:45,562][106225] Updated weights for policy 1, policy_version 1543716 (0.0008) [2023-12-28 06:19:45,564][106226] Updated weights for policy 0, policy_version 1539969 (0.0007) [2023-12-28 06:19:45,627][106225] Updated weights for policy 1, policy_version 1543726 (0.0008) [2023-12-28 06:19:45,632][106226] Updated weights for policy 0, policy_version 1539979 (0.0008) [2023-12-28 06:19:45,678][106225] Updated weights for policy 1, policy_version 1543736 (0.0006) [2023-12-28 06:19:45,696][106226] Updated weights for policy 0, policy_version 1539989 (0.0007) [2023-12-28 06:19:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 789561344. Throughput: 0: 9820.2, 1: 10030.7. Samples: 789552596. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:46,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.588')] [2023-12-28 06:19:46,398][106225] Updated weights for policy 1, policy_version 1543746 (0.0008) [2023-12-28 06:19:46,402][106226] Updated weights for policy 0, policy_version 1539999 (0.0008) [2023-12-28 06:19:46,453][106226] Updated weights for policy 0, policy_version 1540009 (0.0008) [2023-12-28 06:19:46,458][106225] Updated weights for policy 1, policy_version 1543756 (0.0009) [2023-12-28 06:19:46,498][106226] Updated weights for policy 0, policy_version 1540019 (0.0007) [2023-12-28 06:19:46,518][106225] Updated weights for policy 1, policy_version 1543766 (0.0007) [2023-12-28 06:19:47,162][106226] Updated weights for policy 0, policy_version 1540029 (0.0007) [2023-12-28 06:19:47,214][106226] Updated weights for policy 0, policy_version 1540039 (0.0005) [2023-12-28 06:19:47,266][106225] Updated weights for policy 1, policy_version 1543776 (0.0008) [2023-12-28 06:19:47,271][106226] Updated weights for policy 0, policy_version 1540049 (0.0005) [2023-12-28 06:19:47,320][106225] Updated weights for policy 1, policy_version 1543786 (0.0007) [2023-12-28 06:19:47,372][106225] Updated weights for policy 1, policy_version 1543796 (0.0007) [2023-12-28 06:19:47,836][106226] Updated weights for policy 0, policy_version 1540059 (0.0008) [2023-12-28 06:19:47,886][106226] Updated weights for policy 0, policy_version 1540069 (0.0010) [2023-12-28 06:19:47,936][106226] Updated weights for policy 0, policy_version 1540079 (0.0006) [2023-12-28 06:19:48,073][106225] Updated weights for policy 1, policy_version 1543806 (0.0007) [2023-12-28 06:19:48,135][106225] Updated weights for policy 1, policy_version 1543816 (0.0005) [2023-12-28 06:19:48,207][106225] Updated weights for policy 1, policy_version 1543826 (0.0005) [2023-12-28 06:19:48,658][106226] Updated weights for policy 0, policy_version 1540089 (0.0006) [2023-12-28 06:19:48,727][106226] Updated weights for policy 0, policy_version 1540099 (0.0011) [2023-12-28 06:19:48,764][106225] Updated weights for policy 1, policy_version 1543836 (0.0007) [2023-12-28 06:19:48,790][106226] Updated weights for policy 0, policy_version 1540109 (0.0008) [2023-12-28 06:19:48,827][106225] Updated weights for policy 1, policy_version 1543846 (0.0007) [2023-12-28 06:19:48,849][106226] Updated weights for policy 0, policy_version 1540119 (0.0009) [2023-12-28 06:19:48,888][106225] Updated weights for policy 1, policy_version 1543856 (0.0005) [2023-12-28 06:19:49,516][106226] Updated weights for policy 0, policy_version 1540129 (0.0010) [2023-12-28 06:19:49,567][106226] Updated weights for policy 0, policy_version 1540139 (0.0011) [2023-12-28 06:19:49,621][106226] Updated weights for policy 0, policy_version 1540149 (0.0011) [2023-12-28 06:19:49,631][106225] Updated weights for policy 1, policy_version 1543866 (0.0006) [2023-12-28 06:19:49,689][106225] Updated weights for policy 1, policy_version 1543876 (0.0008) [2023-12-28 06:19:49,753][106225] Updated weights for policy 1, policy_version 1543886 (0.0007) [2023-12-28 06:19:49,807][106225] Updated weights for policy 1, policy_version 1543896 (0.0008) [2023-12-28 06:19:50,353][106226] Updated weights for policy 0, policy_version 1540159 (0.0011) [2023-12-28 06:19:50,411][106226] Updated weights for policy 0, policy_version 1540169 (0.0011) [2023-12-28 06:19:50,465][106226] Updated weights for policy 0, policy_version 1540179 (0.0011) [2023-12-28 06:19:50,587][106225] Updated weights for policy 1, policy_version 1543906 (0.0008) [2023-12-28 06:19:50,654][106225] Updated weights for policy 1, policy_version 1543916 (0.0006) [2023-12-28 06:19:50,710][106225] Updated weights for policy 1, policy_version 1543926 (0.0008) [2023-12-28 06:19:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 789659648. Throughput: 0: 9833.4, 1: 9971.8. Samples: 789672052. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:51,175][105115] Avg episode reward: [(0, '-4.822'), (1, '-4.755')] [2023-12-28 06:19:51,229][106226] Updated weights for policy 0, policy_version 1540189 (0.0011) [2023-12-28 06:19:51,302][106226] Updated weights for policy 0, policy_version 1540199 (0.0014) [2023-12-28 06:19:51,372][106226] Updated weights for policy 0, policy_version 1540209 (0.0011) [2023-12-28 06:19:51,417][106225] Updated weights for policy 1, policy_version 1543936 (0.0008) [2023-12-28 06:19:51,484][106225] Updated weights for policy 1, policy_version 1543946 (0.0010) [2023-12-28 06:19:51,543][106225] Updated weights for policy 1, policy_version 1543956 (0.0010) [2023-12-28 06:19:52,097][106226] Updated weights for policy 0, policy_version 1540219 (0.0014) [2023-12-28 06:19:52,161][106226] Updated weights for policy 0, policy_version 1540229 (0.0011) [2023-12-28 06:19:52,177][106225] Updated weights for policy 1, policy_version 1543966 (0.0008) [2023-12-28 06:19:52,215][106226] Updated weights for policy 0, policy_version 1540239 (0.0010) [2023-12-28 06:19:52,243][106225] Updated weights for policy 1, policy_version 1543976 (0.0006) [2023-12-28 06:19:52,310][106225] Updated weights for policy 1, policy_version 1543986 (0.0006) [2023-12-28 06:19:52,884][106226] Updated weights for policy 0, policy_version 1540249 (0.0010) [2023-12-28 06:19:52,924][106225] Updated weights for policy 1, policy_version 1543996 (0.0006) [2023-12-28 06:19:52,948][106226] Updated weights for policy 0, policy_version 1540259 (0.0011) [2023-12-28 06:19:52,984][106225] Updated weights for policy 1, policy_version 1544006 (0.0008) [2023-12-28 06:19:53,012][106226] Updated weights for policy 0, policy_version 1540269 (0.0007) [2023-12-28 06:19:53,041][106225] Updated weights for policy 1, policy_version 1544016 (0.0006) [2023-12-28 06:19:53,074][106226] Updated weights for policy 0, policy_version 1540279 (0.0010) [2023-12-28 06:19:53,739][106226] Updated weights for policy 0, policy_version 1540289 (0.0009) [2023-12-28 06:19:53,775][106225] Updated weights for policy 1, policy_version 1544026 (0.0006) [2023-12-28 06:19:53,795][106226] Updated weights for policy 0, policy_version 1540299 (0.0007) [2023-12-28 06:19:53,839][106225] Updated weights for policy 1, policy_version 1544036 (0.0009) [2023-12-28 06:19:53,855][106226] Updated weights for policy 0, policy_version 1540309 (0.0007) [2023-12-28 06:19:53,890][106225] Updated weights for policy 1, policy_version 1544046 (0.0007) [2023-12-28 06:19:53,935][106225] Updated weights for policy 1, policy_version 1544056 (0.0009) [2023-12-28 06:19:54,556][106226] Updated weights for policy 0, policy_version 1540319 (0.0008) [2023-12-28 06:19:54,604][106226] Updated weights for policy 0, policy_version 1540329 (0.0008) [2023-12-28 06:19:54,666][106226] Updated weights for policy 0, policy_version 1540339 (0.0007) [2023-12-28 06:19:54,671][106225] Updated weights for policy 1, policy_version 1544066 (0.0009) [2023-12-28 06:19:54,727][106225] Updated weights for policy 1, policy_version 1544076 (0.0008) [2023-12-28 06:19:54,808][106225] Updated weights for policy 1, policy_version 1544086 (0.0008) [2023-12-28 06:19:55,359][106226] Updated weights for policy 0, policy_version 1540349 (0.0008) [2023-12-28 06:19:55,404][106226] Updated weights for policy 0, policy_version 1540359 (0.0009) [2023-12-28 06:19:55,463][106226] Updated weights for policy 0, policy_version 1540369 (0.0008) [2023-12-28 06:19:55,464][106225] Updated weights for policy 1, policy_version 1544096 (0.0007) [2023-12-28 06:19:55,513][106225] Updated weights for policy 1, policy_version 1544106 (0.0006) [2023-12-28 06:19:55,560][106225] Updated weights for policy 1, policy_version 1544116 (0.0008) [2023-12-28 06:19:56,164][106226] Updated weights for policy 0, policy_version 1540379 (0.0007) [2023-12-28 06:19:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 789757952. Throughput: 0: 9845.2, 1: 9991.8. Samples: 789732184. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-28 06:19:56,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.877')] [2023-12-28 06:19:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001544120_395345920.pth... [2023-12-28 06:19:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001542968_395051008.pth [2023-12-28 06:19:56,217][106226] Updated weights for policy 0, policy_version 1540389 (0.0005) [2023-12-28 06:19:56,277][106226] Updated weights for policy 0, policy_version 1540399 (0.0006) [2023-12-28 06:19:56,294][106225] Updated weights for policy 1, policy_version 1544126 (0.0006) [2023-12-28 06:19:56,337][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001540408_394420224.pth... [2023-12-28 06:19:56,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001539224_394117120.pth [2023-12-28 06:19:56,364][106225] Updated weights for policy 1, policy_version 1544136 (0.0005) [2023-12-28 06:19:56,426][106225] Updated weights for policy 1, policy_version 1544146 (0.0006) [2023-12-28 06:19:56,920][106226] Updated weights for policy 0, policy_version 1540409 (0.0006) [2023-12-28 06:19:56,971][106226] Updated weights for policy 0, policy_version 1540419 (0.0005) [2023-12-28 06:19:57,006][106225] Updated weights for policy 1, policy_version 1544156 (0.0005) [2023-12-28 06:19:57,030][106226] Updated weights for policy 0, policy_version 1540429 (0.0005) [2023-12-28 06:19:57,056][106225] Updated weights for policy 1, policy_version 1544166 (0.0008) [2023-12-28 06:19:57,085][106226] Updated weights for policy 0, policy_version 1540439 (0.0005) [2023-12-28 06:19:57,110][106225] Updated weights for policy 1, policy_version 1544176 (0.0008) [2023-12-28 06:19:57,736][106226] Updated weights for policy 0, policy_version 1540449 (0.0005) [2023-12-28 06:19:57,785][106225] Updated weights for policy 1, policy_version 1544186 (0.0009) [2023-12-28 06:19:57,798][106226] Updated weights for policy 0, policy_version 1540459 (0.0006) [2023-12-28 06:19:57,841][106225] Updated weights for policy 1, policy_version 1544196 (0.0005) [2023-12-28 06:19:57,854][106226] Updated weights for policy 0, policy_version 1540469 (0.0008) [2023-12-28 06:19:57,899][106225] Updated weights for policy 1, policy_version 1544206 (0.0005) [2023-12-28 06:19:57,964][106225] Updated weights for policy 1, policy_version 1544216 (0.0005) [2023-12-28 06:19:58,569][106225] Updated weights for policy 1, policy_version 1544226 (0.0008) [2023-12-28 06:19:58,630][106225] Updated weights for policy 1, policy_version 1544236 (0.0006) [2023-12-28 06:19:58,632][106226] Updated weights for policy 0, policy_version 1540479 (0.0008) [2023-12-28 06:19:58,695][106226] Updated weights for policy 0, policy_version 1540489 (0.0008) [2023-12-28 06:19:58,698][106225] Updated weights for policy 1, policy_version 1544246 (0.0007) [2023-12-28 06:19:58,749][106226] Updated weights for policy 0, policy_version 1540499 (0.0008) [2023-12-28 06:19:59,460][106225] Updated weights for policy 1, policy_version 1544256 (0.0007) [2023-12-28 06:19:59,513][106225] Updated weights for policy 1, policy_version 1544266 (0.0007) [2023-12-28 06:19:59,570][106226] Updated weights for policy 0, policy_version 1540509 (0.0009) [2023-12-28 06:19:59,570][106225] Updated weights for policy 1, policy_version 1544276 (0.0008) [2023-12-28 06:19:59,638][106226] Updated weights for policy 0, policy_version 1540519 (0.0009) [2023-12-28 06:19:59,701][106226] Updated weights for policy 0, policy_version 1540529 (0.0010) [2023-12-28 06:20:00,226][106225] Updated weights for policy 1, policy_version 1544286 (0.0006) [2023-12-28 06:20:00,295][106225] Updated weights for policy 1, policy_version 1544296 (0.0005) [2023-12-28 06:20:00,366][106225] Updated weights for policy 1, policy_version 1544306 (0.0007) [2023-12-28 06:20:00,390][106226] Updated weights for policy 0, policy_version 1540539 (0.0009) [2023-12-28 06:20:00,455][106226] Updated weights for policy 0, policy_version 1540549 (0.0006) [2023-12-28 06:20:00,509][106226] Updated weights for policy 0, policy_version 1540559 (0.0006) [2023-12-28 06:20:01,062][106225] Updated weights for policy 1, policy_version 1544316 (0.0007) [2023-12-28 06:20:01,117][106225] Updated weights for policy 1, policy_version 1544326 (0.0009) [2023-12-28 06:20:01,157][106226] Updated weights for policy 0, policy_version 1540569 (0.0006) [2023-12-28 06:20:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 789856256. Throughput: 0: 9865.1, 1: 10003.6. Samples: 789851016. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:01,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.734')] [2023-12-28 06:20:01,177][106225] Updated weights for policy 1, policy_version 1544336 (0.0008) [2023-12-28 06:20:01,220][106226] Updated weights for policy 0, policy_version 1540579 (0.0008) [2023-12-28 06:20:01,284][106226] Updated weights for policy 0, policy_version 1540589 (0.0009) [2023-12-28 06:20:01,346][106226] Updated weights for policy 0, policy_version 1540599 (0.0008) [2023-12-28 06:20:01,952][106225] Updated weights for policy 1, policy_version 1544346 (0.0007) [2023-12-28 06:20:01,992][106226] Updated weights for policy 0, policy_version 1540609 (0.0006) [2023-12-28 06:20:02,001][106225] Updated weights for policy 1, policy_version 1544356 (0.0009) [2023-12-28 06:20:02,050][106226] Updated weights for policy 0, policy_version 1540619 (0.0008) [2023-12-28 06:20:02,054][106225] Updated weights for policy 1, policy_version 1544366 (0.0007) [2023-12-28 06:20:02,105][106226] Updated weights for policy 0, policy_version 1540629 (0.0008) [2023-12-28 06:20:02,107][106225] Updated weights for policy 1, policy_version 1544376 (0.0007) [2023-12-28 06:20:02,800][106226] Updated weights for policy 0, policy_version 1540639 (0.0009) [2023-12-28 06:20:02,837][106225] Updated weights for policy 1, policy_version 1544386 (0.0006) [2023-12-28 06:20:02,859][106226] Updated weights for policy 0, policy_version 1540649 (0.0011) [2023-12-28 06:20:02,904][106225] Updated weights for policy 1, policy_version 1544396 (0.0006) [2023-12-28 06:20:02,916][106226] Updated weights for policy 0, policy_version 1540659 (0.0010) [2023-12-28 06:20:02,966][106225] Updated weights for policy 1, policy_version 1544406 (0.0010) [2023-12-28 06:20:03,508][106225] Updated weights for policy 1, policy_version 1544416 (0.0009) [2023-12-28 06:20:03,551][106226] Updated weights for policy 0, policy_version 1540669 (0.0008) [2023-12-28 06:20:03,556][106225] Updated weights for policy 1, policy_version 1544426 (0.0008) [2023-12-28 06:20:03,604][106225] Updated weights for policy 1, policy_version 1544436 (0.0006) [2023-12-28 06:20:03,605][106226] Updated weights for policy 0, policy_version 1540679 (0.0011) [2023-12-28 06:20:03,661][106226] Updated weights for policy 0, policy_version 1540689 (0.0011) [2023-12-28 06:20:04,404][106226] Updated weights for policy 0, policy_version 1540699 (0.0010) [2023-12-28 06:20:04,421][106225] Updated weights for policy 1, policy_version 1544446 (0.0007) [2023-12-28 06:20:04,472][106226] Updated weights for policy 0, policy_version 1540709 (0.0011) [2023-12-28 06:20:04,482][106225] Updated weights for policy 1, policy_version 1544456 (0.0006) [2023-12-28 06:20:04,523][106226] Updated weights for policy 0, policy_version 1540719 (0.0007) [2023-12-28 06:20:04,545][106225] Updated weights for policy 1, policy_version 1544466 (0.0008) [2023-12-28 06:20:05,043][106226] Updated weights for policy 0, policy_version 1540729 (0.0006) [2023-12-28 06:20:05,104][106226] Updated weights for policy 0, policy_version 1540739 (0.0005) [2023-12-28 06:20:05,168][106226] Updated weights for policy 0, policy_version 1540749 (0.0006) [2023-12-28 06:20:05,224][106226] Updated weights for policy 0, policy_version 1540759 (0.0006) [2023-12-28 06:20:05,324][106225] Updated weights for policy 1, policy_version 1544476 (0.0008) [2023-12-28 06:20:05,386][106225] Updated weights for policy 1, policy_version 1544486 (0.0009) [2023-12-28 06:20:05,452][106225] Updated weights for policy 1, policy_version 1544496 (0.0010) [2023-12-28 06:20:05,794][106226] Updated weights for policy 0, policy_version 1540769 (0.0010) [2023-12-28 06:20:05,853][106226] Updated weights for policy 0, policy_version 1540779 (0.0010) [2023-12-28 06:20:05,913][106226] Updated weights for policy 0, policy_version 1540789 (0.0007) [2023-12-28 06:20:06,086][106225] Updated weights for policy 1, policy_version 1544506 (0.0007) [2023-12-28 06:20:06,147][106225] Updated weights for policy 1, policy_version 1544516 (0.0010) [2023-12-28 06:20:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 789962752. Throughput: 0: 10003.3, 1: 9972.9. Samples: 789973560. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:06,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.718')] [2023-12-28 06:20:06,211][106225] Updated weights for policy 1, policy_version 1544526 (0.0010) [2023-12-28 06:20:06,273][106225] Updated weights for policy 1, policy_version 1544536 (0.0010) [2023-12-28 06:20:06,626][106226] Updated weights for policy 0, policy_version 1540799 (0.0011) [2023-12-28 06:20:06,683][106226] Updated weights for policy 0, policy_version 1540809 (0.0011) [2023-12-28 06:20:06,744][106226] Updated weights for policy 0, policy_version 1540819 (0.0009) [2023-12-28 06:20:06,992][106225] Updated weights for policy 1, policy_version 1544546 (0.0010) [2023-12-28 06:20:07,039][106225] Updated weights for policy 1, policy_version 1544556 (0.0010) [2023-12-28 06:20:07,099][106225] Updated weights for policy 1, policy_version 1544566 (0.0010) [2023-12-28 06:20:07,396][106226] Updated weights for policy 0, policy_version 1540829 (0.0006) [2023-12-28 06:20:07,450][106226] Updated weights for policy 0, policy_version 1540839 (0.0005) [2023-12-28 06:20:07,502][106226] Updated weights for policy 0, policy_version 1540849 (0.0008) [2023-12-28 06:20:07,816][106225] Updated weights for policy 1, policy_version 1544576 (0.0010) [2023-12-28 06:20:07,867][106225] Updated weights for policy 1, policy_version 1544586 (0.0010) [2023-12-28 06:20:07,926][106225] Updated weights for policy 1, policy_version 1544596 (0.0010) [2023-12-28 06:20:08,084][106226] Updated weights for policy 0, policy_version 1540859 (0.0011) [2023-12-28 06:20:08,144][106226] Updated weights for policy 0, policy_version 1540869 (0.0010) [2023-12-28 06:20:08,198][106226] Updated weights for policy 0, policy_version 1540879 (0.0009) [2023-12-28 06:20:08,626][106225] Updated weights for policy 1, policy_version 1544606 (0.0010) [2023-12-28 06:20:08,677][106225] Updated weights for policy 1, policy_version 1544616 (0.0010) [2023-12-28 06:20:08,732][106225] Updated weights for policy 1, policy_version 1544626 (0.0010) [2023-12-28 06:20:08,937][106226] Updated weights for policy 0, policy_version 1540889 (0.0008) [2023-12-28 06:20:08,997][106226] Updated weights for policy 0, policy_version 1540899 (0.0005) [2023-12-28 06:20:09,053][106226] Updated weights for policy 0, policy_version 1540909 (0.0005) [2023-12-28 06:20:09,101][106226] Updated weights for policy 0, policy_version 1540919 (0.0007) [2023-12-28 06:20:09,498][106225] Updated weights for policy 1, policy_version 1544636 (0.0009) [2023-12-28 06:20:09,560][106225] Updated weights for policy 1, policy_version 1544646 (0.0006) [2023-12-28 06:20:09,627][106225] Updated weights for policy 1, policy_version 1544656 (0.0010) [2023-12-28 06:20:09,790][106226] Updated weights for policy 0, policy_version 1540929 (0.0010) [2023-12-28 06:20:09,859][106226] Updated weights for policy 0, policy_version 1540939 (0.0011) [2023-12-28 06:20:09,919][106226] Updated weights for policy 0, policy_version 1540949 (0.0008) [2023-12-28 06:20:10,401][106225] Updated weights for policy 1, policy_version 1544666 (0.0010) [2023-12-28 06:20:10,458][106225] Updated weights for policy 1, policy_version 1544676 (0.0008) [2023-12-28 06:20:10,510][106225] Updated weights for policy 1, policy_version 1544686 (0.0008) [2023-12-28 06:20:10,560][106225] Updated weights for policy 1, policy_version 1544696 (0.0008) [2023-12-28 06:20:10,696][106226] Updated weights for policy 0, policy_version 1540959 (0.0008) [2023-12-28 06:20:10,750][106226] Updated weights for policy 0, policy_version 1540969 (0.0008) [2023-12-28 06:20:10,808][106226] Updated weights for policy 0, policy_version 1540979 (0.0007) [2023-12-28 06:20:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 790061056. Throughput: 0: 10033.9, 1: 10012.5. Samples: 790034600. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:11,175][105115] Avg episode reward: [(0, '-4.987'), (1, '-4.626')] [2023-12-28 06:20:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001544696_395493376.pth... [2023-12-28 06:20:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001540984_394567680.pth... [2023-12-28 06:20:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001543576_395206656.pth [2023-12-28 06:20:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001539800_394264576.pth [2023-12-28 06:20:11,327][106225] Updated weights for policy 1, policy_version 1544706 (0.0009) [2023-12-28 06:20:11,400][106225] Updated weights for policy 1, policy_version 1544716 (0.0008) [2023-12-28 06:20:11,459][106225] Updated weights for policy 1, policy_version 1544726 (0.0010) [2023-12-28 06:20:11,543][106226] Updated weights for policy 0, policy_version 1540989 (0.0009) [2023-12-28 06:20:11,609][106226] Updated weights for policy 0, policy_version 1540999 (0.0008) [2023-12-28 06:20:11,679][106226] Updated weights for policy 0, policy_version 1541009 (0.0008) [2023-12-28 06:20:12,192][106225] Updated weights for policy 1, policy_version 1544736 (0.0009) [2023-12-28 06:20:12,261][106225] Updated weights for policy 1, policy_version 1544746 (0.0007) [2023-12-28 06:20:12,324][106225] Updated weights for policy 1, policy_version 1544756 (0.0007) [2023-12-28 06:20:12,451][106226] Updated weights for policy 0, policy_version 1541019 (0.0009) [2023-12-28 06:20:12,510][106226] Updated weights for policy 0, policy_version 1541029 (0.0008) [2023-12-28 06:20:12,578][106226] Updated weights for policy 0, policy_version 1541039 (0.0008) [2023-12-28 06:20:12,955][106225] Updated weights for policy 1, policy_version 1544766 (0.0008) [2023-12-28 06:20:13,020][106225] Updated weights for policy 1, policy_version 1544776 (0.0007) [2023-12-28 06:20:13,083][106225] Updated weights for policy 1, policy_version 1544786 (0.0010) [2023-12-28 06:20:13,252][106226] Updated weights for policy 0, policy_version 1541049 (0.0010) [2023-12-28 06:20:13,304][106226] Updated weights for policy 0, policy_version 1541059 (0.0008) [2023-12-28 06:20:13,360][106226] Updated weights for policy 0, policy_version 1541069 (0.0008) [2023-12-28 06:20:13,407][106226] Updated weights for policy 0, policy_version 1541079 (0.0008) [2023-12-28 06:20:13,731][106225] Updated weights for policy 1, policy_version 1544796 (0.0008) [2023-12-28 06:20:13,793][106225] Updated weights for policy 1, policy_version 1544806 (0.0005) [2023-12-28 06:20:13,861][106225] Updated weights for policy 1, policy_version 1544816 (0.0008) [2023-12-28 06:20:14,093][106226] Updated weights for policy 0, policy_version 1541089 (0.0009) [2023-12-28 06:20:14,153][106226] Updated weights for policy 0, policy_version 1541099 (0.0008) [2023-12-28 06:20:14,211][106226] Updated weights for policy 0, policy_version 1541109 (0.0007) [2023-12-28 06:20:14,526][106225] Updated weights for policy 1, policy_version 1544826 (0.0008) [2023-12-28 06:20:14,577][106225] Updated weights for policy 1, policy_version 1544836 (0.0007) [2023-12-28 06:20:14,627][106225] Updated weights for policy 1, policy_version 1544846 (0.0010) [2023-12-28 06:20:14,674][106225] Updated weights for policy 1, policy_version 1544856 (0.0010) [2023-12-28 06:20:14,846][106226] Updated weights for policy 0, policy_version 1541119 (0.0009) [2023-12-28 06:20:14,900][106226] Updated weights for policy 0, policy_version 1541129 (0.0010) [2023-12-28 06:20:14,962][106226] Updated weights for policy 0, policy_version 1541139 (0.0009) [2023-12-28 06:20:15,404][106225] Updated weights for policy 1, policy_version 1544866 (0.0005) [2023-12-28 06:20:15,461][106225] Updated weights for policy 1, policy_version 1544876 (0.0005) [2023-12-28 06:20:15,520][106225] Updated weights for policy 1, policy_version 1544886 (0.0007) [2023-12-28 06:20:15,634][106226] Updated weights for policy 0, policy_version 1541149 (0.0008) [2023-12-28 06:20:15,682][106226] Updated weights for policy 0, policy_version 1541159 (0.0008) [2023-12-28 06:20:15,736][106226] Updated weights for policy 0, policy_version 1541169 (0.0008) [2023-12-28 06:20:16,153][106225] Updated weights for policy 1, policy_version 1544896 (0.0006) [2023-12-28 06:20:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 790159360. Throughput: 0: 9978.1, 1: 9805.8. Samples: 790150116. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:16,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-4.710')] [2023-12-28 06:20:16,211][106225] Updated weights for policy 1, policy_version 1544906 (0.0009) [2023-12-28 06:20:16,263][106225] Updated weights for policy 1, policy_version 1544916 (0.0010) [2023-12-28 06:20:16,564][106226] Updated weights for policy 0, policy_version 1541179 (0.0007) [2023-12-28 06:20:16,620][106226] Updated weights for policy 0, policy_version 1541189 (0.0005) [2023-12-28 06:20:16,673][106226] Updated weights for policy 0, policy_version 1541199 (0.0007) [2023-12-28 06:20:16,926][106225] Updated weights for policy 1, policy_version 1544926 (0.0010) [2023-12-28 06:20:16,991][106225] Updated weights for policy 1, policy_version 1544936 (0.0011) [2023-12-28 06:20:17,050][106225] Updated weights for policy 1, policy_version 1544946 (0.0009) [2023-12-28 06:20:17,362][106226] Updated weights for policy 0, policy_version 1541209 (0.0008) [2023-12-28 06:20:17,418][106226] Updated weights for policy 0, policy_version 1541219 (0.0009) [2023-12-28 06:20:17,469][106226] Updated weights for policy 0, policy_version 1541229 (0.0008) [2023-12-28 06:20:17,530][106226] Updated weights for policy 0, policy_version 1541239 (0.0005) [2023-12-28 06:20:17,630][106225] Updated weights for policy 1, policy_version 1544956 (0.0008) [2023-12-28 06:20:17,680][106225] Updated weights for policy 1, policy_version 1544966 (0.0010) [2023-12-28 06:20:17,731][106225] Updated weights for policy 1, policy_version 1544976 (0.0010) [2023-12-28 06:20:18,169][106226] Updated weights for policy 0, policy_version 1541249 (0.0010) [2023-12-28 06:20:18,238][106226] Updated weights for policy 0, policy_version 1541259 (0.0009) [2023-12-28 06:20:18,311][106226] Updated weights for policy 0, policy_version 1541269 (0.0010) [2023-12-28 06:20:18,410][106225] Updated weights for policy 1, policy_version 1544986 (0.0010) [2023-12-28 06:20:18,469][106225] Updated weights for policy 1, policy_version 1544996 (0.0007) [2023-12-28 06:20:18,528][106225] Updated weights for policy 1, policy_version 1545006 (0.0010) [2023-12-28 06:20:18,593][106225] Updated weights for policy 1, policy_version 1545016 (0.0009) [2023-12-28 06:20:19,005][106226] Updated weights for policy 0, policy_version 1541279 (0.0008) [2023-12-28 06:20:19,056][106226] Updated weights for policy 0, policy_version 1541289 (0.0008) [2023-12-28 06:20:19,107][106226] Updated weights for policy 0, policy_version 1541299 (0.0008) [2023-12-28 06:20:19,331][106225] Updated weights for policy 1, policy_version 1545026 (0.0008) [2023-12-28 06:20:19,399][106225] Updated weights for policy 1, policy_version 1545036 (0.0008) [2023-12-28 06:20:19,458][106225] Updated weights for policy 1, policy_version 1545046 (0.0008) [2023-12-28 06:20:19,890][106226] Updated weights for policy 0, policy_version 1541309 (0.0007) [2023-12-28 06:20:19,961][106226] Updated weights for policy 0, policy_version 1541319 (0.0008) [2023-12-28 06:20:20,027][106226] Updated weights for policy 0, policy_version 1541329 (0.0009) [2023-12-28 06:20:20,236][106225] Updated weights for policy 1, policy_version 1545056 (0.0007) [2023-12-28 06:20:20,302][106225] Updated weights for policy 1, policy_version 1545066 (0.0009) [2023-12-28 06:20:20,364][106225] Updated weights for policy 1, policy_version 1545076 (0.0007) [2023-12-28 06:20:20,802][106226] Updated weights for policy 0, policy_version 1541339 (0.0008) [2023-12-28 06:20:20,854][106226] Updated weights for policy 0, policy_version 1541349 (0.0008) [2023-12-28 06:20:20,908][106226] Updated weights for policy 0, policy_version 1541359 (0.0005) [2023-12-28 06:20:21,006][106225] Updated weights for policy 1, policy_version 1545086 (0.0006) [2023-12-28 06:20:21,077][106225] Updated weights for policy 1, policy_version 1545096 (0.0008) [2023-12-28 06:20:21,134][106225] Updated weights for policy 1, policy_version 1545106 (0.0007) [2023-12-28 06:20:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 790257664. Throughput: 0: 9928.3, 1: 9850.2. Samples: 790269436. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:21,175][105115] Avg episode reward: [(0, '-4.729'), (1, '-4.531')] [2023-12-28 06:20:21,707][106226] Updated weights for policy 0, policy_version 1541369 (0.0006) [2023-12-28 06:20:21,773][106226] Updated weights for policy 0, policy_version 1541379 (0.0008) [2023-12-28 06:20:21,840][106226] Updated weights for policy 0, policy_version 1541389 (0.0008) [2023-12-28 06:20:21,844][106225] Updated weights for policy 1, policy_version 1545116 (0.0007) [2023-12-28 06:20:21,900][106226] Updated weights for policy 0, policy_version 1541399 (0.0008) [2023-12-28 06:20:21,903][106225] Updated weights for policy 1, policy_version 1545126 (0.0006) [2023-12-28 06:20:21,958][106225] Updated weights for policy 1, policy_version 1545136 (0.0007) [2023-12-28 06:20:22,694][106225] Updated weights for policy 1, policy_version 1545146 (0.0008) [2023-12-28 06:20:22,722][106226] Updated weights for policy 0, policy_version 1541409 (0.0009) [2023-12-28 06:20:22,754][106225] Updated weights for policy 1, policy_version 1545156 (0.0006) [2023-12-28 06:20:22,777][106226] Updated weights for policy 0, policy_version 1541419 (0.0007) [2023-12-28 06:20:22,811][106225] Updated weights for policy 1, policy_version 1545166 (0.0006) [2023-12-28 06:20:22,836][106226] Updated weights for policy 0, policy_version 1541429 (0.0008) [2023-12-28 06:20:22,872][106225] Updated weights for policy 1, policy_version 1545176 (0.0007) [2023-12-28 06:20:23,443][106226] Updated weights for policy 0, policy_version 1541439 (0.0006) [2023-12-28 06:20:23,499][106226] Updated weights for policy 0, policy_version 1541449 (0.0005) [2023-12-28 06:20:23,523][106225] Updated weights for policy 1, policy_version 1545186 (0.0008) [2023-12-28 06:20:23,551][106226] Updated weights for policy 0, policy_version 1541459 (0.0006) [2023-12-28 06:20:23,577][106225] Updated weights for policy 1, policy_version 1545196 (0.0007) [2023-12-28 06:20:23,639][106225] Updated weights for policy 1, policy_version 1545206 (0.0009) [2023-12-28 06:20:24,118][106226] Updated weights for policy 0, policy_version 1541469 (0.0008) [2023-12-28 06:20:24,178][106226] Updated weights for policy 0, policy_version 1541479 (0.0010) [2023-12-28 06:20:24,232][106226] Updated weights for policy 0, policy_version 1541489 (0.0010) [2023-12-28 06:20:24,280][106225] Updated weights for policy 1, policy_version 1545216 (0.0006) [2023-12-28 06:20:24,343][106225] Updated weights for policy 1, policy_version 1545226 (0.0005) [2023-12-28 06:20:24,401][106225] Updated weights for policy 1, policy_version 1545236 (0.0005) [2023-12-28 06:20:24,946][106226] Updated weights for policy 0, policy_version 1541499 (0.0010) [2023-12-28 06:20:25,002][106226] Updated weights for policy 0, policy_version 1541509 (0.0008) [2023-12-28 06:20:25,063][106226] Updated weights for policy 0, policy_version 1541519 (0.0008) [2023-12-28 06:20:25,073][106225] Updated weights for policy 1, policy_version 1545246 (0.0007) [2023-12-28 06:20:25,132][106225] Updated weights for policy 1, policy_version 1545256 (0.0005) [2023-12-28 06:20:25,195][106225] Updated weights for policy 1, policy_version 1545266 (0.0007) [2023-12-28 06:20:25,787][106225] Updated weights for policy 1, policy_version 1545276 (0.0008) [2023-12-28 06:20:25,818][106226] Updated weights for policy 0, policy_version 1541529 (0.0007) [2023-12-28 06:20:25,840][106225] Updated weights for policy 1, policy_version 1545286 (0.0006) [2023-12-28 06:20:25,873][106226] Updated weights for policy 0, policy_version 1541539 (0.0007) [2023-12-28 06:20:25,895][106225] Updated weights for policy 1, policy_version 1545296 (0.0006) [2023-12-28 06:20:25,921][106226] Updated weights for policy 0, policy_version 1541549 (0.0005) [2023-12-28 06:20:25,966][106226] Updated weights for policy 0, policy_version 1541559 (0.0008) [2023-12-28 06:20:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 790364160. Throughput: 0: 9975.4, 1: 9848.9. Samples: 790329324. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:26,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.643')] [2023-12-28 06:20:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001545304_395649024.pth... [2023-12-28 06:20:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001541560_394715136.pth... [2023-12-28 06:20:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001544120_395345920.pth [2023-12-28 06:20:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001540408_394420224.pth [2023-12-28 06:20:26,649][106225] Updated weights for policy 1, policy_version 1545306 (0.0007) [2023-12-28 06:20:26,678][106226] Updated weights for policy 0, policy_version 1541569 (0.0008) [2023-12-28 06:20:26,707][106225] Updated weights for policy 1, policy_version 1545316 (0.0006) [2023-12-28 06:20:26,739][106226] Updated weights for policy 0, policy_version 1541579 (0.0008) [2023-12-28 06:20:26,762][106225] Updated weights for policy 1, policy_version 1545326 (0.0005) [2023-12-28 06:20:26,796][106226] Updated weights for policy 0, policy_version 1541589 (0.0008) [2023-12-28 06:20:26,822][106225] Updated weights for policy 1, policy_version 1545336 (0.0009) [2023-12-28 06:20:27,363][106225] Updated weights for policy 1, policy_version 1545346 (0.0005) [2023-12-28 06:20:27,421][106225] Updated weights for policy 1, policy_version 1545356 (0.0005) [2023-12-28 06:20:27,481][106225] Updated weights for policy 1, policy_version 1545366 (0.0006) [2023-12-28 06:20:27,519][106226] Updated weights for policy 0, policy_version 1541599 (0.0009) [2023-12-28 06:20:27,584][106226] Updated weights for policy 0, policy_version 1541609 (0.0008) [2023-12-28 06:20:27,641][106226] Updated weights for policy 0, policy_version 1541619 (0.0009) [2023-12-28 06:20:28,134][106225] Updated weights for policy 1, policy_version 1545376 (0.0008) [2023-12-28 06:20:28,179][106225] Updated weights for policy 1, policy_version 1545386 (0.0006) [2023-12-28 06:20:28,224][106225] Updated weights for policy 1, policy_version 1545396 (0.0005) [2023-12-28 06:20:28,307][106226] Updated weights for policy 0, policy_version 1541629 (0.0007) [2023-12-28 06:20:28,370][106226] Updated weights for policy 0, policy_version 1541639 (0.0008) [2023-12-28 06:20:28,424][106226] Updated weights for policy 0, policy_version 1541649 (0.0009) [2023-12-28 06:20:28,889][106225] Updated weights for policy 1, policy_version 1545406 (0.0005) [2023-12-28 06:20:28,947][106225] Updated weights for policy 1, policy_version 1545416 (0.0008) [2023-12-28 06:20:28,991][106225] Updated weights for policy 1, policy_version 1545426 (0.0008) [2023-12-28 06:20:29,132][106226] Updated weights for policy 0, policy_version 1541659 (0.0009) [2023-12-28 06:20:29,182][106226] Updated weights for policy 0, policy_version 1541669 (0.0006) [2023-12-28 06:20:29,246][106226] Updated weights for policy 0, policy_version 1541679 (0.0007) [2023-12-28 06:20:29,652][106225] Updated weights for policy 1, policy_version 1545436 (0.0008) [2023-12-28 06:20:29,712][106225] Updated weights for policy 1, policy_version 1545446 (0.0008) [2023-12-28 06:20:29,763][106225] Updated weights for policy 1, policy_version 1545456 (0.0005) [2023-12-28 06:20:29,957][106226] Updated weights for policy 0, policy_version 1541689 (0.0006) [2023-12-28 06:20:30,019][106226] Updated weights for policy 0, policy_version 1541699 (0.0009) [2023-12-28 06:20:30,076][106226] Updated weights for policy 0, policy_version 1541709 (0.0009) [2023-12-28 06:20:30,131][106226] Updated weights for policy 0, policy_version 1541719 (0.0009) [2023-12-28 06:20:30,395][106225] Updated weights for policy 1, policy_version 1545466 (0.0005) [2023-12-28 06:20:30,462][106225] Updated weights for policy 1, policy_version 1545476 (0.0008) [2023-12-28 06:20:30,514][106225] Updated weights for policy 1, policy_version 1545486 (0.0005) [2023-12-28 06:20:30,564][106225] Updated weights for policy 1, policy_version 1545496 (0.0005) [2023-12-28 06:20:30,783][106226] Updated weights for policy 0, policy_version 1541729 (0.0006) [2023-12-28 06:20:30,836][106226] Updated weights for policy 0, policy_version 1541739 (0.0005) [2023-12-28 06:20:30,890][106226] Updated weights for policy 0, policy_version 1541749 (0.0007) [2023-12-28 06:20:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 790462464. Throughput: 0: 9958.0, 1: 10026.6. Samples: 790451900. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:31,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-4.610')] [2023-12-28 06:20:31,222][106225] Updated weights for policy 1, policy_version 1545506 (0.0005) [2023-12-28 06:20:31,280][106225] Updated weights for policy 1, policy_version 1545516 (0.0007) [2023-12-28 06:20:31,344][106225] Updated weights for policy 1, policy_version 1545526 (0.0008) [2023-12-28 06:20:31,551][106226] Updated weights for policy 0, policy_version 1541759 (0.0009) [2023-12-28 06:20:31,612][106226] Updated weights for policy 0, policy_version 1541769 (0.0010) [2023-12-28 06:20:31,676][106226] Updated weights for policy 0, policy_version 1541779 (0.0011) [2023-12-28 06:20:32,040][106225] Updated weights for policy 1, policy_version 1545536 (0.0008) [2023-12-28 06:20:32,099][106225] Updated weights for policy 1, policy_version 1545546 (0.0007) [2023-12-28 06:20:32,154][106225] Updated weights for policy 1, policy_version 1545556 (0.0008) [2023-12-28 06:20:32,433][106226] Updated weights for policy 0, policy_version 1541789 (0.0011) [2023-12-28 06:20:32,486][106226] Updated weights for policy 0, policy_version 1541799 (0.0010) [2023-12-28 06:20:32,547][106226] Updated weights for policy 0, policy_version 1541809 (0.0010) [2023-12-28 06:20:32,878][106225] Updated weights for policy 1, policy_version 1545566 (0.0008) [2023-12-28 06:20:32,931][106225] Updated weights for policy 1, policy_version 1545576 (0.0008) [2023-12-28 06:20:32,983][106225] Updated weights for policy 1, policy_version 1545586 (0.0008) [2023-12-28 06:20:33,230][106226] Updated weights for policy 0, policy_version 1541819 (0.0009) [2023-12-28 06:20:33,287][106226] Updated weights for policy 0, policy_version 1541829 (0.0006) [2023-12-28 06:20:33,341][106226] Updated weights for policy 0, policy_version 1541839 (0.0006) [2023-12-28 06:20:33,764][106225] Updated weights for policy 1, policy_version 1545596 (0.0008) [2023-12-28 06:20:33,819][106225] Updated weights for policy 1, policy_version 1545606 (0.0008) [2023-12-28 06:20:33,879][106225] Updated weights for policy 1, policy_version 1545616 (0.0009) [2023-12-28 06:20:33,928][106226] Updated weights for policy 0, policy_version 1541849 (0.0005) [2023-12-28 06:20:33,998][106226] Updated weights for policy 0, policy_version 1541859 (0.0005) [2023-12-28 06:20:34,065][106226] Updated weights for policy 0, policy_version 1541869 (0.0007) [2023-12-28 06:20:34,130][106226] Updated weights for policy 0, policy_version 1541879 (0.0009) [2023-12-28 06:20:34,595][106225] Updated weights for policy 1, policy_version 1545626 (0.0009) [2023-12-28 06:20:34,664][106225] Updated weights for policy 1, policy_version 1545636 (0.0009) [2023-12-28 06:20:34,729][106225] Updated weights for policy 1, policy_version 1545646 (0.0006) [2023-12-28 06:20:34,798][106225] Updated weights for policy 1, policy_version 1545656 (0.0007) [2023-12-28 06:20:34,870][106226] Updated weights for policy 0, policy_version 1541889 (0.0009) [2023-12-28 06:20:34,932][106226] Updated weights for policy 0, policy_version 1541899 (0.0007) [2023-12-28 06:20:34,997][106226] Updated weights for policy 0, policy_version 1541909 (0.0007) [2023-12-28 06:20:35,362][106225] Updated weights for policy 1, policy_version 1545666 (0.0005) [2023-12-28 06:20:35,418][106225] Updated weights for policy 1, policy_version 1545676 (0.0007) [2023-12-28 06:20:35,472][106225] Updated weights for policy 1, policy_version 1545686 (0.0005) [2023-12-28 06:20:35,573][106226] Updated weights for policy 0, policy_version 1541919 (0.0007) [2023-12-28 06:20:35,639][106226] Updated weights for policy 0, policy_version 1541929 (0.0005) [2023-12-28 06:20:35,695][106226] Updated weights for policy 0, policy_version 1541939 (0.0005) [2023-12-28 06:20:36,144][106225] Updated weights for policy 1, policy_version 1545696 (0.0009) [2023-12-28 06:20:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 790560768. Throughput: 0: 9990.1, 1: 10088.1. Samples: 790575568. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:36,175][105115] Avg episode reward: [(0, '-4.791'), (1, '-4.488')] [2023-12-28 06:20:36,205][106225] Updated weights for policy 1, policy_version 1545706 (0.0010) [2023-12-28 06:20:36,272][106225] Updated weights for policy 1, policy_version 1545716 (0.0010) [2023-12-28 06:20:36,338][106226] Updated weights for policy 0, policy_version 1541949 (0.0008) [2023-12-28 06:20:36,412][106226] Updated weights for policy 0, policy_version 1541959 (0.0011) [2023-12-28 06:20:36,473][106226] Updated weights for policy 0, policy_version 1541969 (0.0011) [2023-12-28 06:20:36,915][106225] Updated weights for policy 1, policy_version 1545726 (0.0007) [2023-12-28 06:20:36,984][106225] Updated weights for policy 1, policy_version 1545736 (0.0005) [2023-12-28 06:20:37,049][106225] Updated weights for policy 1, policy_version 1545746 (0.0007) [2023-12-28 06:20:37,073][106226] Updated weights for policy 0, policy_version 1541979 (0.0009) [2023-12-28 06:20:37,138][106226] Updated weights for policy 0, policy_version 1541989 (0.0008) [2023-12-28 06:20:37,201][106226] Updated weights for policy 0, policy_version 1541999 (0.0006) [2023-12-28 06:20:37,667][106225] Updated weights for policy 1, policy_version 1545756 (0.0010) [2023-12-28 06:20:37,730][106225] Updated weights for policy 1, policy_version 1545766 (0.0010) [2023-12-28 06:20:37,793][106225] Updated weights for policy 1, policy_version 1545776 (0.0010) [2023-12-28 06:20:37,804][106226] Updated weights for policy 0, policy_version 1542009 (0.0006) [2023-12-28 06:20:37,867][106226] Updated weights for policy 0, policy_version 1542019 (0.0005) [2023-12-28 06:20:37,925][106226] Updated weights for policy 0, policy_version 1542029 (0.0005) [2023-12-28 06:20:37,981][106226] Updated weights for policy 0, policy_version 1542039 (0.0005) [2023-12-28 06:20:38,416][106225] Updated weights for policy 1, policy_version 1545786 (0.0010) [2023-12-28 06:20:38,477][106225] Updated weights for policy 1, policy_version 1545796 (0.0010) [2023-12-28 06:20:38,535][106225] Updated weights for policy 1, policy_version 1545806 (0.0010) [2023-12-28 06:20:38,596][106225] Updated weights for policy 1, policy_version 1545816 (0.0010) [2023-12-28 06:20:38,663][106226] Updated weights for policy 0, policy_version 1542049 (0.0007) [2023-12-28 06:20:38,723][106226] Updated weights for policy 0, policy_version 1542059 (0.0008) [2023-12-28 06:20:38,786][106226] Updated weights for policy 0, policy_version 1542069 (0.0008) [2023-12-28 06:20:39,318][106225] Updated weights for policy 1, policy_version 1545826 (0.0010) [2023-12-28 06:20:39,383][106225] Updated weights for policy 1, policy_version 1545836 (0.0008) [2023-12-28 06:20:39,447][106225] Updated weights for policy 1, policy_version 1545846 (0.0010) [2023-12-28 06:20:39,484][106226] Updated weights for policy 0, policy_version 1542079 (0.0009) [2023-12-28 06:20:39,544][106226] Updated weights for policy 0, policy_version 1542089 (0.0007) [2023-12-28 06:20:39,602][106226] Updated weights for policy 0, policy_version 1542099 (0.0007) [2023-12-28 06:20:40,232][106225] Updated weights for policy 1, policy_version 1545856 (0.0008) [2023-12-28 06:20:40,298][106225] Updated weights for policy 1, policy_version 1545866 (0.0009) [2023-12-28 06:20:40,351][106225] Updated weights for policy 1, policy_version 1545876 (0.0008) [2023-12-28 06:20:40,372][106226] Updated weights for policy 0, policy_version 1542109 (0.0008) [2023-12-28 06:20:40,432][106226] Updated weights for policy 0, policy_version 1542119 (0.0008) [2023-12-28 06:20:40,492][106226] Updated weights for policy 0, policy_version 1542129 (0.0009) [2023-12-28 06:20:41,082][106225] Updated weights for policy 1, policy_version 1545886 (0.0008) [2023-12-28 06:20:41,155][106225] Updated weights for policy 1, policy_version 1545896 (0.0007) [2023-12-28 06:20:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 790659072. Throughput: 0: 10032.7, 1: 10093.7. Samples: 790637872. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:41,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.751')] [2023-12-28 06:20:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001542136_394862592.pth... [2023-12-28 06:20:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001540984_394567680.pth [2023-12-28 06:20:41,216][106225] Updated weights for policy 1, policy_version 1545906 (0.0008) [2023-12-28 06:20:41,250][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001545912_395804672.pth... [2023-12-28 06:20:41,256][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001544696_395493376.pth [2023-12-28 06:20:41,273][106226] Updated weights for policy 0, policy_version 1542139 (0.0009) [2023-12-28 06:20:41,334][106226] Updated weights for policy 0, policy_version 1542149 (0.0009) [2023-12-28 06:20:41,410][106226] Updated weights for policy 0, policy_version 1542159 (0.0008) [2023-12-28 06:20:41,979][106225] Updated weights for policy 1, policy_version 1545916 (0.0008) [2023-12-28 06:20:42,049][106225] Updated weights for policy 1, policy_version 1545926 (0.0008) [2023-12-28 06:20:42,109][106225] Updated weights for policy 1, policy_version 1545936 (0.0008) [2023-12-28 06:20:42,145][106226] Updated weights for policy 0, policy_version 1542169 (0.0008) [2023-12-28 06:20:42,209][106226] Updated weights for policy 0, policy_version 1542179 (0.0006) [2023-12-28 06:20:42,274][106226] Updated weights for policy 0, policy_version 1542189 (0.0007) [2023-12-28 06:20:42,340][106226] Updated weights for policy 0, policy_version 1542199 (0.0008) [2023-12-28 06:20:42,804][106225] Updated weights for policy 1, policy_version 1545946 (0.0008) [2023-12-28 06:20:42,864][106225] Updated weights for policy 1, policy_version 1545956 (0.0009) [2023-12-28 06:20:42,921][106225] Updated weights for policy 1, policy_version 1545966 (0.0008) [2023-12-28 06:20:42,988][106225] Updated weights for policy 1, policy_version 1545976 (0.0008) [2023-12-28 06:20:43,033][106226] Updated weights for policy 0, policy_version 1542209 (0.0009) [2023-12-28 06:20:43,088][106226] Updated weights for policy 0, policy_version 1542219 (0.0010) [2023-12-28 06:20:43,150][106226] Updated weights for policy 0, policy_version 1542229 (0.0008) [2023-12-28 06:20:43,688][106225] Updated weights for policy 1, policy_version 1545986 (0.0005) [2023-12-28 06:20:43,738][106225] Updated weights for policy 1, policy_version 1545996 (0.0008) [2023-12-28 06:20:43,787][106225] Updated weights for policy 1, policy_version 1546006 (0.0008) [2023-12-28 06:20:43,889][106226] Updated weights for policy 0, policy_version 1542239 (0.0008) [2023-12-28 06:20:43,939][106226] Updated weights for policy 0, policy_version 1542249 (0.0010) [2023-12-28 06:20:43,998][106226] Updated weights for policy 0, policy_version 1542259 (0.0008) [2023-12-28 06:20:44,422][106225] Updated weights for policy 1, policy_version 1546016 (0.0007) [2023-12-28 06:20:44,489][106225] Updated weights for policy 1, policy_version 1546026 (0.0010) [2023-12-28 06:20:44,558][106225] Updated weights for policy 1, policy_version 1546036 (0.0007) [2023-12-28 06:20:44,649][106226] Updated weights for policy 0, policy_version 1542269 (0.0007) [2023-12-28 06:20:44,698][106226] Updated weights for policy 0, policy_version 1542279 (0.0010) [2023-12-28 06:20:44,746][106226] Updated weights for policy 0, policy_version 1542289 (0.0010) [2023-12-28 06:20:45,171][106225] Updated weights for policy 1, policy_version 1546046 (0.0009) [2023-12-28 06:20:45,240][106225] Updated weights for policy 1, policy_version 1546056 (0.0011) [2023-12-28 06:20:45,303][106225] Updated weights for policy 1, policy_version 1546066 (0.0007) [2023-12-28 06:20:45,514][106226] Updated weights for policy 0, policy_version 1542299 (0.0009) [2023-12-28 06:20:45,582][106226] Updated weights for policy 0, policy_version 1542309 (0.0005) [2023-12-28 06:20:45,643][106226] Updated weights for policy 0, policy_version 1542319 (0.0008) [2023-12-28 06:20:45,990][106225] Updated weights for policy 1, policy_version 1546076 (0.0008) [2023-12-28 06:20:46,042][106225] Updated weights for policy 1, policy_version 1546086 (0.0007) [2023-12-28 06:20:46,093][106225] Updated weights for policy 1, policy_version 1546096 (0.0008) [2023-12-28 06:20:46,174][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 790765568. Throughput: 0: 10001.2, 1: 10041.9. Samples: 790752952. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:46,175][105115] Avg episode reward: [(0, '-4.758'), (1, '-4.492')] [2023-12-28 06:20:46,199][106226] Updated weights for policy 0, policy_version 1542329 (0.0010) [2023-12-28 06:20:46,262][106226] Updated weights for policy 0, policy_version 1542339 (0.0009) [2023-12-28 06:20:46,322][106226] Updated weights for policy 0, policy_version 1542349 (0.0011) [2023-12-28 06:20:46,379][106226] Updated weights for policy 0, policy_version 1542359 (0.0010) [2023-12-28 06:20:46,824][106225] Updated weights for policy 1, policy_version 1546106 (0.0010) [2023-12-28 06:20:46,883][106225] Updated weights for policy 1, policy_version 1546116 (0.0010) [2023-12-28 06:20:46,939][106225] Updated weights for policy 1, policy_version 1546126 (0.0010) [2023-12-28 06:20:47,002][106225] Updated weights for policy 1, policy_version 1546136 (0.0010) [2023-12-28 06:20:47,093][106226] Updated weights for policy 0, policy_version 1542369 (0.0006) [2023-12-28 06:20:47,150][106226] Updated weights for policy 0, policy_version 1542379 (0.0005) [2023-12-28 06:20:47,211][106226] Updated weights for policy 0, policy_version 1542389 (0.0006) [2023-12-28 06:20:47,624][106225] Updated weights for policy 1, policy_version 1546146 (0.0005) [2023-12-28 06:20:47,680][106225] Updated weights for policy 1, policy_version 1546156 (0.0005) [2023-12-28 06:20:47,749][106225] Updated weights for policy 1, policy_version 1546166 (0.0006) [2023-12-28 06:20:47,767][106226] Updated weights for policy 0, policy_version 1542399 (0.0009) [2023-12-28 06:20:47,829][106226] Updated weights for policy 0, policy_version 1542409 (0.0011) [2023-12-28 06:20:47,889][106226] Updated weights for policy 0, policy_version 1542419 (0.0010) [2023-12-28 06:20:48,351][106225] Updated weights for policy 1, policy_version 1546176 (0.0007) [2023-12-28 06:20:48,410][106225] Updated weights for policy 1, policy_version 1546186 (0.0009) [2023-12-28 06:20:48,467][106225] Updated weights for policy 1, policy_version 1546196 (0.0010) [2023-12-28 06:20:48,606][106226] Updated weights for policy 0, policy_version 1542429 (0.0009) [2023-12-28 06:20:48,661][106226] Updated weights for policy 0, policy_version 1542439 (0.0008) [2023-12-28 06:20:48,720][106226] Updated weights for policy 0, policy_version 1542449 (0.0008) [2023-12-28 06:20:49,121][106225] Updated weights for policy 1, policy_version 1546206 (0.0008) [2023-12-28 06:20:49,184][106225] Updated weights for policy 1, policy_version 1546216 (0.0005) [2023-12-28 06:20:49,254][106225] Updated weights for policy 1, policy_version 1546226 (0.0009) [2023-12-28 06:20:49,474][106226] Updated weights for policy 0, policy_version 1542459 (0.0008) [2023-12-28 06:20:49,532][106226] Updated weights for policy 0, policy_version 1542469 (0.0008) [2023-12-28 06:20:49,593][106226] Updated weights for policy 0, policy_version 1542479 (0.0006) [2023-12-28 06:20:49,936][106225] Updated weights for policy 1, policy_version 1546236 (0.0008) [2023-12-28 06:20:49,993][106225] Updated weights for policy 1, policy_version 1546246 (0.0008) [2023-12-28 06:20:50,051][106225] Updated weights for policy 1, policy_version 1546256 (0.0008) [2023-12-28 06:20:50,257][106226] Updated weights for policy 0, policy_version 1542489 (0.0006) [2023-12-28 06:20:50,318][106226] Updated weights for policy 0, policy_version 1542499 (0.0011) [2023-12-28 06:20:50,382][106226] Updated weights for policy 0, policy_version 1542509 (0.0011) [2023-12-28 06:20:50,442][106226] Updated weights for policy 0, policy_version 1542519 (0.0011) [2023-12-28 06:20:50,804][106225] Updated weights for policy 1, policy_version 1546266 (0.0008) [2023-12-28 06:20:50,864][106225] Updated weights for policy 1, policy_version 1546276 (0.0010) [2023-12-28 06:20:50,932][106225] Updated weights for policy 1, policy_version 1546286 (0.0011) [2023-12-28 06:20:50,998][106225] Updated weights for policy 1, policy_version 1546296 (0.0010) [2023-12-28 06:20:51,166][106226] Updated weights for policy 0, policy_version 1542529 (0.0010) [2023-12-28 06:20:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 790863872. Throughput: 0: 9939.0, 1: 10097.5. Samples: 790875204. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:51,175][105115] Avg episode reward: [(0, '-4.821'), (1, '-4.665')] [2023-12-28 06:20:51,229][106226] Updated weights for policy 0, policy_version 1542539 (0.0009) [2023-12-28 06:20:51,293][106226] Updated weights for policy 0, policy_version 1542549 (0.0012) [2023-12-28 06:20:51,710][106225] Updated weights for policy 1, policy_version 1546306 (0.0011) [2023-12-28 06:20:51,775][106225] Updated weights for policy 1, policy_version 1546316 (0.0011) [2023-12-28 06:20:51,829][106225] Updated weights for policy 1, policy_version 1546326 (0.0010) [2023-12-28 06:20:52,036][106226] Updated weights for policy 0, policy_version 1542559 (0.0011) [2023-12-28 06:20:52,099][106226] Updated weights for policy 0, policy_version 1542569 (0.0008) [2023-12-28 06:20:52,151][106226] Updated weights for policy 0, policy_version 1542579 (0.0007) [2023-12-28 06:20:52,571][106225] Updated weights for policy 1, policy_version 1546336 (0.0008) [2023-12-28 06:20:52,627][106225] Updated weights for policy 1, policy_version 1546346 (0.0008) [2023-12-28 06:20:52,684][106225] Updated weights for policy 1, policy_version 1546356 (0.0009) [2023-12-28 06:20:52,853][106226] Updated weights for policy 0, policy_version 1542589 (0.0009) [2023-12-28 06:20:52,904][106226] Updated weights for policy 0, policy_version 1542599 (0.0008) [2023-12-28 06:20:52,960][106226] Updated weights for policy 0, policy_version 1542609 (0.0008) [2023-12-28 06:20:53,450][106225] Updated weights for policy 1, policy_version 1546366 (0.0009) [2023-12-28 06:20:53,511][106225] Updated weights for policy 1, policy_version 1546376 (0.0009) [2023-12-28 06:20:53,565][106225] Updated weights for policy 1, policy_version 1546386 (0.0008) [2023-12-28 06:20:53,633][106226] Updated weights for policy 0, policy_version 1542619 (0.0006) [2023-12-28 06:20:53,694][106226] Updated weights for policy 0, policy_version 1542629 (0.0005) [2023-12-28 06:20:53,747][106226] Updated weights for policy 0, policy_version 1542639 (0.0009) [2023-12-28 06:20:54,220][106225] Updated weights for policy 1, policy_version 1546396 (0.0007) [2023-12-28 06:20:54,275][106225] Updated weights for policy 1, policy_version 1546406 (0.0005) [2023-12-28 06:20:54,331][106225] Updated weights for policy 1, policy_version 1546416 (0.0008) [2023-12-28 06:20:54,494][106226] Updated weights for policy 0, policy_version 1542649 (0.0009) [2023-12-28 06:20:54,553][106226] Updated weights for policy 0, policy_version 1542659 (0.0009) [2023-12-28 06:20:54,611][106226] Updated weights for policy 0, policy_version 1542669 (0.0008) [2023-12-28 06:20:54,669][106226] Updated weights for policy 0, policy_version 1542679 (0.0008) [2023-12-28 06:20:55,019][106225] Updated weights for policy 1, policy_version 1546426 (0.0009) [2023-12-28 06:20:55,076][106225] Updated weights for policy 1, policy_version 1546436 (0.0010) [2023-12-28 06:20:55,126][106225] Updated weights for policy 1, policy_version 1546446 (0.0010) [2023-12-28 06:20:55,182][106225] Updated weights for policy 1, policy_version 1546456 (0.0010) [2023-12-28 06:20:55,422][106226] Updated weights for policy 0, policy_version 1542689 (0.0008) [2023-12-28 06:20:55,477][106226] Updated weights for policy 0, policy_version 1542699 (0.0008) [2023-12-28 06:20:55,532][106226] Updated weights for policy 0, policy_version 1542709 (0.0009) [2023-12-28 06:20:55,826][106225] Updated weights for policy 1, policy_version 1546466 (0.0005) [2023-12-28 06:20:55,881][106225] Updated weights for policy 1, policy_version 1546476 (0.0005) [2023-12-28 06:20:55,935][106225] Updated weights for policy 1, policy_version 1546486 (0.0005) [2023-12-28 06:20:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20070.3, 300 sec: 19910.7). Total num frames: 790962176. Throughput: 0: 9892.0, 1: 10043.1. Samples: 790931684. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:20:56,176][105115] Avg episode reward: [(0, '-4.910'), (1, '-5.105')] [2023-12-28 06:20:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001546488_395952128.pth... [2023-12-28 06:20:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001542712_395010048.pth... [2023-12-28 06:20:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001541560_394715136.pth [2023-12-28 06:20:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001545304_395649024.pth [2023-12-28 06:20:56,368][106226] Updated weights for policy 0, policy_version 1542719 (0.0009) [2023-12-28 06:20:56,422][106226] Updated weights for policy 0, policy_version 1542729 (0.0009) [2023-12-28 06:20:56,484][106226] Updated weights for policy 0, policy_version 1542739 (0.0009) [2023-12-28 06:20:56,505][106225] Updated weights for policy 1, policy_version 1546496 (0.0007) [2023-12-28 06:20:56,559][106225] Updated weights for policy 1, policy_version 1546506 (0.0008) [2023-12-28 06:20:56,614][106225] Updated weights for policy 1, policy_version 1546516 (0.0008) [2023-12-28 06:20:57,193][106226] Updated weights for policy 0, policy_version 1542749 (0.0007) [2023-12-28 06:20:57,245][106226] Updated weights for policy 0, policy_version 1542759 (0.0008) [2023-12-28 06:20:57,300][106226] Updated weights for policy 0, policy_version 1542769 (0.0008) [2023-12-28 06:20:57,329][106225] Updated weights for policy 1, policy_version 1546526 (0.0007) [2023-12-28 06:20:57,387][106225] Updated weights for policy 1, policy_version 1546536 (0.0007) [2023-12-28 06:20:57,438][106225] Updated weights for policy 1, policy_version 1546546 (0.0009) [2023-12-28 06:20:57,987][106226] Updated weights for policy 0, policy_version 1542779 (0.0008) [2023-12-28 06:20:58,044][106226] Updated weights for policy 0, policy_version 1542789 (0.0009) [2023-12-28 06:20:58,096][106226] Updated weights for policy 0, policy_version 1542799 (0.0009) [2023-12-28 06:20:58,167][106225] Updated weights for policy 1, policy_version 1546556 (0.0008) [2023-12-28 06:20:58,227][106225] Updated weights for policy 1, policy_version 1546566 (0.0008) [2023-12-28 06:20:58,285][106225] Updated weights for policy 1, policy_version 1546576 (0.0008) [2023-12-28 06:20:58,854][106226] Updated weights for policy 0, policy_version 1542809 (0.0008) [2023-12-28 06:20:58,925][106226] Updated weights for policy 0, policy_version 1542819 (0.0007) [2023-12-28 06:20:58,996][106226] Updated weights for policy 0, policy_version 1542829 (0.0007) [2023-12-28 06:20:59,063][106226] Updated weights for policy 0, policy_version 1542839 (0.0008) [2023-12-28 06:20:59,149][106225] Updated weights for policy 1, policy_version 1546587 (0.0008) [2023-12-28 06:20:59,212][106225] Updated weights for policy 1, policy_version 1546597 (0.0008) [2023-12-28 06:20:59,279][106225] Updated weights for policy 1, policy_version 1546607 (0.0009) [2023-12-28 06:20:59,770][106226] Updated weights for policy 0, policy_version 1542849 (0.0008) [2023-12-28 06:20:59,832][106226] Updated weights for policy 0, policy_version 1542859 (0.0008) [2023-12-28 06:20:59,908][106226] Updated weights for policy 0, policy_version 1542869 (0.0006) [2023-12-28 06:21:00,036][106225] Updated weights for policy 1, policy_version 1546617 (0.0008) [2023-12-28 06:21:00,098][106225] Updated weights for policy 1, policy_version 1546627 (0.0008) [2023-12-28 06:21:00,147][106225] Updated weights for policy 1, policy_version 1546637 (0.0008) [2023-12-28 06:21:00,206][106225] Updated weights for policy 1, policy_version 1546647 (0.0008) [2023-12-28 06:21:00,570][106226] Updated weights for policy 0, policy_version 1542879 (0.0009) [2023-12-28 06:21:00,625][106226] Updated weights for policy 0, policy_version 1542889 (0.0006) [2023-12-28 06:21:00,678][106226] Updated weights for policy 0, policy_version 1542899 (0.0005) [2023-12-28 06:21:00,889][106225] Updated weights for policy 1, policy_version 1546657 (0.0009) [2023-12-28 06:21:00,948][106225] Updated weights for policy 1, policy_version 1546667 (0.0009) [2023-12-28 06:21:01,008][106225] Updated weights for policy 1, policy_version 1546677 (0.0008) [2023-12-28 06:21:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 791060480. Throughput: 0: 9861.1, 1: 10099.9. Samples: 791048360. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:01,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.502')] [2023-12-28 06:21:01,296][106226] Updated weights for policy 0, policy_version 1542909 (0.0006) [2023-12-28 06:21:01,359][106226] Updated weights for policy 0, policy_version 1542919 (0.0007) [2023-12-28 06:21:01,427][106226] Updated weights for policy 0, policy_version 1542929 (0.0007) [2023-12-28 06:21:01,743][106225] Updated weights for policy 1, policy_version 1546687 (0.0007) [2023-12-28 06:21:01,815][106225] Updated weights for policy 1, policy_version 1546697 (0.0010) [2023-12-28 06:21:01,871][106225] Updated weights for policy 1, policy_version 1546707 (0.0006) [2023-12-28 06:21:02,076][106226] Updated weights for policy 0, policy_version 1542939 (0.0009) [2023-12-28 06:21:02,126][106226] Updated weights for policy 0, policy_version 1542949 (0.0008) [2023-12-28 06:21:02,173][106226] Updated weights for policy 0, policy_version 1542959 (0.0005) [2023-12-28 06:21:02,519][106225] Updated weights for policy 1, policy_version 1546717 (0.0006) [2023-12-28 06:21:02,575][106225] Updated weights for policy 1, policy_version 1546727 (0.0006) [2023-12-28 06:21:02,634][106225] Updated weights for policy 1, policy_version 1546737 (0.0008) [2023-12-28 06:21:02,828][106226] Updated weights for policy 0, policy_version 1542969 (0.0005) [2023-12-28 06:21:02,896][106226] Updated weights for policy 0, policy_version 1542979 (0.0006) [2023-12-28 06:21:02,964][106226] Updated weights for policy 0, policy_version 1542989 (0.0008) [2023-12-28 06:21:03,019][106226] Updated weights for policy 0, policy_version 1542999 (0.0010) [2023-12-28 06:21:03,272][106225] Updated weights for policy 1, policy_version 1546747 (0.0008) [2023-12-28 06:21:03,324][106225] Updated weights for policy 1, policy_version 1546757 (0.0005) [2023-12-28 06:21:03,380][106225] Updated weights for policy 1, policy_version 1546767 (0.0005) [2023-12-28 06:21:03,623][106226] Updated weights for policy 0, policy_version 1543009 (0.0010) [2023-12-28 06:21:03,683][106226] Updated weights for policy 0, policy_version 1543019 (0.0010) [2023-12-28 06:21:03,742][106226] Updated weights for policy 0, policy_version 1543029 (0.0010) [2023-12-28 06:21:04,079][106225] Updated weights for policy 1, policy_version 1546777 (0.0009) [2023-12-28 06:21:04,142][106225] Updated weights for policy 1, policy_version 1546788 (0.0010) [2023-12-28 06:21:04,200][106225] Updated weights for policy 1, policy_version 1546798 (0.0009) [2023-12-28 06:21:04,266][106225] Updated weights for policy 1, policy_version 1546808 (0.0009) [2023-12-28 06:21:04,485][106226] Updated weights for policy 0, policy_version 1543039 (0.0009) [2023-12-28 06:21:04,550][106226] Updated weights for policy 0, policy_version 1543049 (0.0009) [2023-12-28 06:21:04,620][106226] Updated weights for policy 0, policy_version 1543059 (0.0009) [2023-12-28 06:21:05,076][106225] Updated weights for policy 1, policy_version 1546818 (0.0009) [2023-12-28 06:21:05,137][106225] Updated weights for policy 1, policy_version 1546828 (0.0008) [2023-12-28 06:21:05,200][106225] Updated weights for policy 1, policy_version 1546838 (0.0009) [2023-12-28 06:21:05,288][106226] Updated weights for policy 0, policy_version 1543069 (0.0008) [2023-12-28 06:21:05,351][106226] Updated weights for policy 0, policy_version 1543079 (0.0008) [2023-12-28 06:21:05,400][106226] Updated weights for policy 0, policy_version 1543089 (0.0008) [2023-12-28 06:21:05,907][106225] Updated weights for policy 1, policy_version 1546848 (0.0009) [2023-12-28 06:21:05,963][106225] Updated weights for policy 1, policy_version 1546858 (0.0008) [2023-12-28 06:21:06,012][106225] Updated weights for policy 1, policy_version 1546868 (0.0008) [2023-12-28 06:21:06,155][106226] Updated weights for policy 0, policy_version 1543099 (0.0007) [2023-12-28 06:21:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 791158784. Throughput: 0: 9931.6, 1: 10053.8. Samples: 791168776. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:06,175][105115] Avg episode reward: [(0, '-4.703'), (1, '-4.618')] [2023-12-28 06:21:06,215][106226] Updated weights for policy 0, policy_version 1543109 (0.0008) [2023-12-28 06:21:06,279][106226] Updated weights for policy 0, policy_version 1543119 (0.0009) [2023-12-28 06:21:06,760][106225] Updated weights for policy 1, policy_version 1546878 (0.0008) [2023-12-28 06:21:06,821][106225] Updated weights for policy 1, policy_version 1546888 (0.0009) [2023-12-28 06:21:06,887][106225] Updated weights for policy 1, policy_version 1546898 (0.0009) [2023-12-28 06:21:06,896][106226] Updated weights for policy 0, policy_version 1543129 (0.0008) [2023-12-28 06:21:06,947][106226] Updated weights for policy 0, policy_version 1543139 (0.0006) [2023-12-28 06:21:07,008][106226] Updated weights for policy 0, policy_version 1543149 (0.0005) [2023-12-28 06:21:07,067][106226] Updated weights for policy 0, policy_version 1543159 (0.0005) [2023-12-28 06:21:07,592][106225] Updated weights for policy 1, policy_version 1546908 (0.0007) [2023-12-28 06:21:07,606][106226] Updated weights for policy 0, policy_version 1543169 (0.0008) [2023-12-28 06:21:07,636][106225] Updated weights for policy 1, policy_version 1546918 (0.0005) [2023-12-28 06:21:07,662][106226] Updated weights for policy 0, policy_version 1543179 (0.0009) [2023-12-28 06:21:07,687][106225] Updated weights for policy 1, policy_version 1546928 (0.0005) [2023-12-28 06:21:07,727][106226] Updated weights for policy 0, policy_version 1543189 (0.0007) [2023-12-28 06:21:08,292][106225] Updated weights for policy 1, policy_version 1546938 (0.0006) [2023-12-28 06:21:08,350][106225] Updated weights for policy 1, policy_version 1546948 (0.0006) [2023-12-28 06:21:08,417][106225] Updated weights for policy 1, policy_version 1546958 (0.0007) [2023-12-28 06:21:08,442][106226] Updated weights for policy 0, policy_version 1543199 (0.0008) [2023-12-28 06:21:08,475][106225] Updated weights for policy 1, policy_version 1546968 (0.0006) [2023-12-28 06:21:08,502][106226] Updated weights for policy 0, policy_version 1543209 (0.0007) [2023-12-28 06:21:08,562][106226] Updated weights for policy 0, policy_version 1543219 (0.0008) [2023-12-28 06:21:09,163][106225] Updated weights for policy 1, policy_version 1546978 (0.0008) [2023-12-28 06:21:09,219][106225] Updated weights for policy 1, policy_version 1546988 (0.0008) [2023-12-28 06:21:09,283][106225] Updated weights for policy 1, policy_version 1546998 (0.0007) [2023-12-28 06:21:09,321][106226] Updated weights for policy 0, policy_version 1543229 (0.0007) [2023-12-28 06:21:09,391][106226] Updated weights for policy 0, policy_version 1543239 (0.0008) [2023-12-28 06:21:09,462][106226] Updated weights for policy 0, policy_version 1543249 (0.0008) [2023-12-28 06:21:10,016][106225] Updated weights for policy 1, policy_version 1547008 (0.0006) [2023-12-28 06:21:10,080][106225] Updated weights for policy 1, policy_version 1547018 (0.0006) [2023-12-28 06:21:10,144][106225] Updated weights for policy 1, policy_version 1547028 (0.0007) [2023-12-28 06:21:10,166][106226] Updated weights for policy 0, policy_version 1543259 (0.0007) [2023-12-28 06:21:10,229][106226] Updated weights for policy 0, policy_version 1543269 (0.0008) [2023-12-28 06:21:10,292][106226] Updated weights for policy 0, policy_version 1543279 (0.0006) [2023-12-28 06:21:10,737][106225] Updated weights for policy 1, policy_version 1547038 (0.0007) [2023-12-28 06:21:10,790][106225] Updated weights for policy 1, policy_version 1547048 (0.0009) [2023-12-28 06:21:10,837][106225] Updated weights for policy 1, policy_version 1547058 (0.0008) [2023-12-28 06:21:10,889][106226] Updated weights for policy 0, policy_version 1543289 (0.0007) [2023-12-28 06:21:10,945][106226] Updated weights for policy 0, policy_version 1543299 (0.0010) [2023-12-28 06:21:11,000][106226] Updated weights for policy 0, policy_version 1543309 (0.0008) [2023-12-28 06:21:11,069][106226] Updated weights for policy 0, policy_version 1543319 (0.0008) [2023-12-28 06:21:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 791265280. Throughput: 0: 9956.0, 1: 10057.5. Samples: 791229928. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:11,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.630')] [2023-12-28 06:21:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001547064_396099584.pth... [2023-12-28 06:21:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001543320_395165696.pth... [2023-12-28 06:21:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001542136_394862592.pth [2023-12-28 06:21:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001545912_395804672.pth [2023-12-28 06:21:11,683][106225] Updated weights for policy 1, policy_version 1547068 (0.0007) [2023-12-28 06:21:11,760][106225] Updated weights for policy 1, policy_version 1547078 (0.0008) [2023-12-28 06:21:11,823][106225] Updated weights for policy 1, policy_version 1547088 (0.0008) [2023-12-28 06:21:11,829][106226] Updated weights for policy 0, policy_version 1543329 (0.0011) [2023-12-28 06:21:11,897][106226] Updated weights for policy 0, policy_version 1543339 (0.0011) [2023-12-28 06:21:11,964][106226] Updated weights for policy 0, policy_version 1543349 (0.0011) [2023-12-28 06:21:12,611][106225] Updated weights for policy 1, policy_version 1547098 (0.0007) [2023-12-28 06:21:12,664][106226] Updated weights for policy 0, policy_version 1543359 (0.0010) [2023-12-28 06:21:12,671][106225] Updated weights for policy 1, policy_version 1547108 (0.0007) [2023-12-28 06:21:12,722][106226] Updated weights for policy 0, policy_version 1543369 (0.0011) [2023-12-28 06:21:12,728][106225] Updated weights for policy 1, policy_version 1547118 (0.0008) [2023-12-28 06:21:12,781][106226] Updated weights for policy 0, policy_version 1543379 (0.0011) [2023-12-28 06:21:12,786][106225] Updated weights for policy 1, policy_version 1547128 (0.0005) [2023-12-28 06:21:13,496][106226] Updated weights for policy 0, policy_version 1543389 (0.0009) [2023-12-28 06:21:13,543][106225] Updated weights for policy 1, policy_version 1547138 (0.0007) [2023-12-28 06:21:13,549][106226] Updated weights for policy 0, policy_version 1543399 (0.0008) [2023-12-28 06:21:13,601][106225] Updated weights for policy 1, policy_version 1547148 (0.0007) [2023-12-28 06:21:13,608][106226] Updated weights for policy 0, policy_version 1543409 (0.0006) [2023-12-28 06:21:13,662][106225] Updated weights for policy 1, policy_version 1547158 (0.0005) [2023-12-28 06:21:14,353][106225] Updated weights for policy 1, policy_version 1547168 (0.0008) [2023-12-28 06:21:14,356][106226] Updated weights for policy 0, policy_version 1543419 (0.0008) [2023-12-28 06:21:14,415][106225] Updated weights for policy 1, policy_version 1547178 (0.0007) [2023-12-28 06:21:14,417][106226] Updated weights for policy 0, policy_version 1543429 (0.0006) [2023-12-28 06:21:14,469][106226] Updated weights for policy 0, policy_version 1543439 (0.0007) [2023-12-28 06:21:14,480][106225] Updated weights for policy 1, policy_version 1547188 (0.0008) [2023-12-28 06:21:15,160][106226] Updated weights for policy 0, policy_version 1543449 (0.0007) [2023-12-28 06:21:15,229][106226] Updated weights for policy 0, policy_version 1543459 (0.0007) [2023-12-28 06:21:15,242][106225] Updated weights for policy 1, policy_version 1547198 (0.0009) [2023-12-28 06:21:15,288][106226] Updated weights for policy 0, policy_version 1543469 (0.0010) [2023-12-28 06:21:15,294][106225] Updated weights for policy 1, policy_version 1547208 (0.0006) [2023-12-28 06:21:15,349][106225] Updated weights for policy 1, policy_version 1547218 (0.0007) [2023-12-28 06:21:15,350][106226] Updated weights for policy 0, policy_version 1543479 (0.0007) [2023-12-28 06:21:15,872][106226] Updated weights for policy 0, policy_version 1543489 (0.0010) [2023-12-28 06:21:15,936][106226] Updated weights for policy 0, policy_version 1543499 (0.0011) [2023-12-28 06:21:15,986][106226] Updated weights for policy 0, policy_version 1543509 (0.0008) [2023-12-28 06:21:16,174][106225] Updated weights for policy 1, policy_version 1547228 (0.0009) [2023-12-28 06:21:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 791355392. Throughput: 0: 9965.2, 1: 9896.4. Samples: 791345668. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:16,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-4.546')] [2023-12-28 06:21:16,238][106225] Updated weights for policy 1, policy_version 1547238 (0.0008) [2023-12-28 06:21:16,297][106225] Updated weights for policy 1, policy_version 1547248 (0.0008) [2023-12-28 06:21:16,578][106226] Updated weights for policy 0, policy_version 1543519 (0.0007) [2023-12-28 06:21:16,646][106226] Updated weights for policy 0, policy_version 1543529 (0.0008) [2023-12-28 06:21:16,711][106226] Updated weights for policy 0, policy_version 1543539 (0.0008) [2023-12-28 06:21:17,070][106225] Updated weights for policy 1, policy_version 1547258 (0.0008) [2023-12-28 06:21:17,125][106225] Updated weights for policy 1, policy_version 1547268 (0.0006) [2023-12-28 06:21:17,189][106225] Updated weights for policy 1, policy_version 1547278 (0.0005) [2023-12-28 06:21:17,238][106225] Updated weights for policy 1, policy_version 1547288 (0.0005) [2023-12-28 06:21:17,397][106226] Updated weights for policy 0, policy_version 1543549 (0.0008) [2023-12-28 06:21:17,450][106226] Updated weights for policy 0, policy_version 1543559 (0.0009) [2023-12-28 06:21:17,519][106226] Updated weights for policy 0, policy_version 1543569 (0.0005) [2023-12-28 06:21:17,883][106225] Updated weights for policy 1, policy_version 1547298 (0.0009) [2023-12-28 06:21:17,951][106225] Updated weights for policy 1, policy_version 1547308 (0.0009) [2023-12-28 06:21:18,010][106225] Updated weights for policy 1, policy_version 1547318 (0.0008) [2023-12-28 06:21:18,142][106226] Updated weights for policy 0, policy_version 1543579 (0.0008) [2023-12-28 06:21:18,198][106226] Updated weights for policy 0, policy_version 1543589 (0.0006) [2023-12-28 06:21:18,252][106226] Updated weights for policy 0, policy_version 1543599 (0.0005) [2023-12-28 06:21:18,688][106225] Updated weights for policy 1, policy_version 1547328 (0.0008) [2023-12-28 06:21:18,751][106225] Updated weights for policy 1, policy_version 1547338 (0.0008) [2023-12-28 06:21:18,818][106225] Updated weights for policy 1, policy_version 1547348 (0.0009) [2023-12-28 06:21:18,950][106226] Updated weights for policy 0, policy_version 1543609 (0.0006) [2023-12-28 06:21:18,998][106226] Updated weights for policy 0, policy_version 1543619 (0.0008) [2023-12-28 06:21:19,045][106226] Updated weights for policy 0, policy_version 1543629 (0.0008) [2023-12-28 06:21:19,088][106226] Updated weights for policy 0, policy_version 1543639 (0.0008) [2023-12-28 06:21:19,577][106225] Updated weights for policy 1, policy_version 1547358 (0.0008) [2023-12-28 06:21:19,636][106225] Updated weights for policy 1, policy_version 1547368 (0.0009) [2023-12-28 06:21:19,691][106225] Updated weights for policy 1, policy_version 1547378 (0.0008) [2023-12-28 06:21:19,947][106226] Updated weights for policy 0, policy_version 1543649 (0.0008) [2023-12-28 06:21:20,001][106226] Updated weights for policy 0, policy_version 1543659 (0.0009) [2023-12-28 06:21:20,062][106226] Updated weights for policy 0, policy_version 1543669 (0.0008) [2023-12-28 06:21:20,438][106225] Updated weights for policy 1, policy_version 1547388 (0.0008) [2023-12-28 06:21:20,507][106225] Updated weights for policy 1, policy_version 1547398 (0.0008) [2023-12-28 06:21:20,558][106225] Updated weights for policy 1, policy_version 1547408 (0.0008) [2023-12-28 06:21:20,777][106226] Updated weights for policy 0, policy_version 1543679 (0.0009) [2023-12-28 06:21:20,845][106226] Updated weights for policy 0, policy_version 1543689 (0.0007) [2023-12-28 06:21:20,903][106226] Updated weights for policy 0, policy_version 1543699 (0.0009) [2023-12-28 06:21:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 791453696. Throughput: 0: 9951.3, 1: 9777.6. Samples: 791463372. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:21,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-4.675')] [2023-12-28 06:21:21,339][106225] Updated weights for policy 1, policy_version 1547418 (0.0008) [2023-12-28 06:21:21,414][106225] Updated weights for policy 1, policy_version 1547428 (0.0010) [2023-12-28 06:21:21,478][106225] Updated weights for policy 1, policy_version 1547438 (0.0007) [2023-12-28 06:21:21,544][106225] Updated weights for policy 1, policy_version 1547448 (0.0008) [2023-12-28 06:21:21,656][106226] Updated weights for policy 0, policy_version 1543709 (0.0008) [2023-12-28 06:21:21,721][106226] Updated weights for policy 0, policy_version 1543719 (0.0008) [2023-12-28 06:21:21,791][106226] Updated weights for policy 0, policy_version 1543729 (0.0008) [2023-12-28 06:21:22,294][106225] Updated weights for policy 1, policy_version 1547458 (0.0007) [2023-12-28 06:21:22,366][106225] Updated weights for policy 1, policy_version 1547468 (0.0007) [2023-12-28 06:21:22,427][106225] Updated weights for policy 1, policy_version 1547478 (0.0008) [2023-12-28 06:21:22,562][106226] Updated weights for policy 0, policy_version 1543739 (0.0008) [2023-12-28 06:21:22,622][106226] Updated weights for policy 0, policy_version 1543749 (0.0008) [2023-12-28 06:21:22,677][106226] Updated weights for policy 0, policy_version 1543759 (0.0008) [2023-12-28 06:21:23,198][106225] Updated weights for policy 1, policy_version 1547488 (0.0006) [2023-12-28 06:21:23,256][106225] Updated weights for policy 1, policy_version 1547498 (0.0006) [2023-12-28 06:21:23,283][106226] Updated weights for policy 0, policy_version 1543769 (0.0007) [2023-12-28 06:21:23,308][106225] Updated weights for policy 1, policy_version 1547508 (0.0007) [2023-12-28 06:21:23,337][106226] Updated weights for policy 0, policy_version 1543779 (0.0007) [2023-12-28 06:21:23,391][106226] Updated weights for policy 0, policy_version 1543789 (0.0008) [2023-12-28 06:21:23,439][106226] Updated weights for policy 0, policy_version 1543799 (0.0008) [2023-12-28 06:21:24,004][106225] Updated weights for policy 1, policy_version 1547518 (0.0007) [2023-12-28 06:21:24,052][106225] Updated weights for policy 1, policy_version 1547528 (0.0008) [2023-12-28 06:21:24,097][106225] Updated weights for policy 1, policy_version 1547538 (0.0008) [2023-12-28 06:21:24,163][106226] Updated weights for policy 0, policy_version 1543809 (0.0009) [2023-12-28 06:21:24,211][106226] Updated weights for policy 0, policy_version 1543819 (0.0008) [2023-12-28 06:21:24,264][106226] Updated weights for policy 0, policy_version 1543829 (0.0008) [2023-12-28 06:21:24,804][106225] Updated weights for policy 1, policy_version 1547548 (0.0008) [2023-12-28 06:21:24,851][106225] Updated weights for policy 1, policy_version 1547558 (0.0008) [2023-12-28 06:21:24,896][106225] Updated weights for policy 1, policy_version 1547568 (0.0008) [2023-12-28 06:21:25,018][106226] Updated weights for policy 0, policy_version 1543839 (0.0008) [2023-12-28 06:21:25,075][106226] Updated weights for policy 0, policy_version 1543849 (0.0010) [2023-12-28 06:21:25,129][106226] Updated weights for policy 0, policy_version 1543859 (0.0010) [2023-12-28 06:21:25,620][106225] Updated weights for policy 1, policy_version 1547578 (0.0007) [2023-12-28 06:21:25,671][106225] Updated weights for policy 1, policy_version 1547588 (0.0005) [2023-12-28 06:21:25,716][106225] Updated weights for policy 1, policy_version 1547598 (0.0005) [2023-12-28 06:21:25,767][106225] Updated weights for policy 1, policy_version 1547608 (0.0005) [2023-12-28 06:21:25,796][106226] Updated weights for policy 0, policy_version 1543869 (0.0009) [2023-12-28 06:21:25,846][106226] Updated weights for policy 0, policy_version 1543879 (0.0009) [2023-12-28 06:21:25,902][106226] Updated weights for policy 0, policy_version 1543889 (0.0005) [2023-12-28 06:21:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 791552000. Throughput: 0: 9902.0, 1: 9717.0. Samples: 791520732. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:26,176][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.734')] [2023-12-28 06:21:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001543896_395313152.pth... [2023-12-28 06:21:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001547608_396238848.pth... [2023-12-28 06:21:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001546488_395952128.pth [2023-12-28 06:21:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001542712_395010048.pth [2023-12-28 06:21:26,398][106225] Updated weights for policy 1, policy_version 1547618 (0.0009) [2023-12-28 06:21:26,443][106225] Updated weights for policy 1, policy_version 1547628 (0.0007) [2023-12-28 06:21:26,489][106225] Updated weights for policy 1, policy_version 1547638 (0.0007) [2023-12-28 06:21:26,580][106226] Updated weights for policy 0, policy_version 1543899 (0.0009) [2023-12-28 06:21:26,636][106226] Updated weights for policy 0, policy_version 1543909 (0.0010) [2023-12-28 06:21:26,700][106226] Updated weights for policy 0, policy_version 1543919 (0.0011) [2023-12-28 06:21:27,171][106225] Updated weights for policy 1, policy_version 1547648 (0.0010) [2023-12-28 06:21:27,225][106225] Updated weights for policy 1, policy_version 1547658 (0.0010) [2023-12-28 06:21:27,279][106225] Updated weights for policy 1, policy_version 1547668 (0.0010) [2023-12-28 06:21:27,373][106226] Updated weights for policy 0, policy_version 1543929 (0.0010) [2023-12-28 06:21:27,434][106226] Updated weights for policy 0, policy_version 1543939 (0.0005) [2023-12-28 06:21:27,489][106226] Updated weights for policy 0, policy_version 1543949 (0.0005) [2023-12-28 06:21:27,542][106226] Updated weights for policy 0, policy_version 1543959 (0.0008) [2023-12-28 06:21:27,938][106225] Updated weights for policy 1, policy_version 1547678 (0.0009) [2023-12-28 06:21:27,990][106225] Updated weights for policy 1, policy_version 1547688 (0.0006) [2023-12-28 06:21:28,044][106225] Updated weights for policy 1, policy_version 1547698 (0.0007) [2023-12-28 06:21:28,182][106226] Updated weights for policy 0, policy_version 1543969 (0.0010) [2023-12-28 06:21:28,241][106226] Updated weights for policy 0, policy_version 1543979 (0.0010) [2023-12-28 06:21:28,290][106226] Updated weights for policy 0, policy_version 1543989 (0.0010) [2023-12-28 06:21:28,776][106225] Updated weights for policy 1, policy_version 1547708 (0.0008) [2023-12-28 06:21:28,832][106225] Updated weights for policy 1, policy_version 1547718 (0.0008) [2023-12-28 06:21:28,885][106225] Updated weights for policy 1, policy_version 1547728 (0.0007) [2023-12-28 06:21:28,921][106226] Updated weights for policy 0, policy_version 1543999 (0.0011) [2023-12-28 06:21:28,979][106226] Updated weights for policy 0, policy_version 1544009 (0.0010) [2023-12-28 06:21:29,029][106226] Updated weights for policy 0, policy_version 1544019 (0.0010) [2023-12-28 06:21:29,594][106225] Updated weights for policy 1, policy_version 1547738 (0.0006) [2023-12-28 06:21:29,655][106225] Updated weights for policy 1, policy_version 1547748 (0.0005) [2023-12-28 06:21:29,715][106225] Updated weights for policy 1, policy_version 1547758 (0.0006) [2023-12-28 06:21:29,721][106226] Updated weights for policy 0, policy_version 1544029 (0.0008) [2023-12-28 06:21:29,772][106225] Updated weights for policy 1, policy_version 1547768 (0.0009) [2023-12-28 06:21:29,785][106226] Updated weights for policy 0, policy_version 1544039 (0.0007) [2023-12-28 06:21:29,849][106226] Updated weights for policy 0, policy_version 1544049 (0.0008) [2023-12-28 06:21:30,479][106226] Updated weights for policy 0, policy_version 1544059 (0.0008) [2023-12-28 06:21:30,505][106225] Updated weights for policy 1, policy_version 1547778 (0.0006) [2023-12-28 06:21:30,529][106226] Updated weights for policy 0, policy_version 1544069 (0.0008) [2023-12-28 06:21:30,559][106225] Updated weights for policy 1, policy_version 1547788 (0.0008) [2023-12-28 06:21:30,580][106226] Updated weights for policy 0, policy_version 1544079 (0.0005) [2023-12-28 06:21:30,615][106225] Updated weights for policy 1, policy_version 1547798 (0.0007) [2023-12-28 06:21:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 791650304. Throughput: 0: 9998.2, 1: 9782.0. Samples: 791643064. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:31,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-4.647')] [2023-12-28 06:21:31,290][106225] Updated weights for policy 1, policy_version 1547808 (0.0008) [2023-12-28 06:21:31,341][106226] Updated weights for policy 0, policy_version 1544089 (0.0007) [2023-12-28 06:21:31,345][106225] Updated weights for policy 1, policy_version 1547818 (0.0008) [2023-12-28 06:21:31,405][106226] Updated weights for policy 0, policy_version 1544099 (0.0008) [2023-12-28 06:21:31,414][106225] Updated weights for policy 1, policy_version 1547828 (0.0008) [2023-12-28 06:21:31,465][106226] Updated weights for policy 0, policy_version 1544109 (0.0008) [2023-12-28 06:21:31,525][106226] Updated weights for policy 0, policy_version 1544119 (0.0009) [2023-12-28 06:21:32,075][106225] Updated weights for policy 1, policy_version 1547838 (0.0006) [2023-12-28 06:21:32,123][106225] Updated weights for policy 1, policy_version 1547848 (0.0005) [2023-12-28 06:21:32,171][106225] Updated weights for policy 1, policy_version 1547858 (0.0005) [2023-12-28 06:21:32,340][106226] Updated weights for policy 0, policy_version 1544129 (0.0008) [2023-12-28 06:21:32,407][106226] Updated weights for policy 0, policy_version 1544139 (0.0008) [2023-12-28 06:21:32,478][106226] Updated weights for policy 0, policy_version 1544149 (0.0008) [2023-12-28 06:21:32,811][106225] Updated weights for policy 1, policy_version 1547868 (0.0006) [2023-12-28 06:21:32,860][106225] Updated weights for policy 1, policy_version 1547878 (0.0008) [2023-12-28 06:21:32,917][106225] Updated weights for policy 1, policy_version 1547888 (0.0008) [2023-12-28 06:21:33,161][106226] Updated weights for policy 0, policy_version 1544159 (0.0006) [2023-12-28 06:21:33,216][106226] Updated weights for policy 0, policy_version 1544169 (0.0005) [2023-12-28 06:21:33,274][106226] Updated weights for policy 0, policy_version 1544179 (0.0005) [2023-12-28 06:21:33,624][106225] Updated weights for policy 1, policy_version 1547898 (0.0008) [2023-12-28 06:21:33,675][106225] Updated weights for policy 1, policy_version 1547908 (0.0009) [2023-12-28 06:21:33,724][106225] Updated weights for policy 1, policy_version 1547918 (0.0010) [2023-12-28 06:21:33,779][106225] Updated weights for policy 1, policy_version 1547928 (0.0010) [2023-12-28 06:21:33,816][106226] Updated weights for policy 0, policy_version 1544189 (0.0006) [2023-12-28 06:21:33,860][106226] Updated weights for policy 0, policy_version 1544199 (0.0007) [2023-12-28 06:21:33,911][106226] Updated weights for policy 0, policy_version 1544209 (0.0008) [2023-12-28 06:21:34,521][106225] Updated weights for policy 1, policy_version 1547938 (0.0010) [2023-12-28 06:21:34,578][106225] Updated weights for policy 1, policy_version 1547948 (0.0010) [2023-12-28 06:21:34,640][106225] Updated weights for policy 1, policy_version 1547958 (0.0011) [2023-12-28 06:21:34,655][106226] Updated weights for policy 0, policy_version 1544219 (0.0008) [2023-12-28 06:21:34,706][106226] Updated weights for policy 0, policy_version 1544229 (0.0008) [2023-12-28 06:21:34,768][106226] Updated weights for policy 0, policy_version 1544239 (0.0008) [2023-12-28 06:21:35,338][106225] Updated weights for policy 1, policy_version 1547968 (0.0006) [2023-12-28 06:21:35,398][106225] Updated weights for policy 1, policy_version 1547978 (0.0006) [2023-12-28 06:21:35,470][106225] Updated weights for policy 1, policy_version 1547988 (0.0009) [2023-12-28 06:21:35,510][106226] Updated weights for policy 0, policy_version 1544249 (0.0007) [2023-12-28 06:21:35,577][106226] Updated weights for policy 0, policy_version 1544259 (0.0006) [2023-12-28 06:21:35,632][106226] Updated weights for policy 0, policy_version 1544269 (0.0006) [2023-12-28 06:21:35,690][106226] Updated weights for policy 0, policy_version 1544279 (0.0010) [2023-12-28 06:21:36,149][106225] Updated weights for policy 1, policy_version 1547998 (0.0007) [2023-12-28 06:21:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 791748608. Throughput: 0: 9965.4, 1: 9763.6. Samples: 791763008. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:36,175][105115] Avg episode reward: [(0, '-4.894'), (1, '-4.877')] [2023-12-28 06:21:36,213][106225] Updated weights for policy 1, policy_version 1548008 (0.0006) [2023-12-28 06:21:36,274][106225] Updated weights for policy 1, policy_version 1548018 (0.0006) [2023-12-28 06:21:36,387][106226] Updated weights for policy 0, policy_version 1544289 (0.0009) [2023-12-28 06:21:36,452][106226] Updated weights for policy 0, policy_version 1544299 (0.0009) [2023-12-28 06:21:36,523][106226] Updated weights for policy 0, policy_version 1544309 (0.0010) [2023-12-28 06:21:36,837][106225] Updated weights for policy 1, policy_version 1548028 (0.0005) [2023-12-28 06:21:36,898][106225] Updated weights for policy 1, policy_version 1548038 (0.0006) [2023-12-28 06:21:36,964][106225] Updated weights for policy 1, policy_version 1548048 (0.0007) [2023-12-28 06:21:37,313][106226] Updated weights for policy 0, policy_version 1544319 (0.0011) [2023-12-28 06:21:37,368][106226] Updated weights for policy 0, policy_version 1544329 (0.0011) [2023-12-28 06:21:37,430][106226] Updated weights for policy 0, policy_version 1544339 (0.0011) [2023-12-28 06:21:37,641][106225] Updated weights for policy 1, policy_version 1548058 (0.0008) [2023-12-28 06:21:37,702][106225] Updated weights for policy 1, policy_version 1548068 (0.0008) [2023-12-28 06:21:37,757][106225] Updated weights for policy 1, policy_version 1548078 (0.0008) [2023-12-28 06:21:37,820][106225] Updated weights for policy 1, policy_version 1548088 (0.0009) [2023-12-28 06:21:38,148][106226] Updated weights for policy 0, policy_version 1544349 (0.0008) [2023-12-28 06:21:38,197][106226] Updated weights for policy 0, policy_version 1544359 (0.0008) [2023-12-28 06:21:38,256][106226] Updated weights for policy 0, policy_version 1544369 (0.0009) [2023-12-28 06:21:38,469][106225] Updated weights for policy 1, policy_version 1548098 (0.0009) [2023-12-28 06:21:38,525][106225] Updated weights for policy 1, policy_version 1548108 (0.0009) [2023-12-28 06:21:38,576][106225] Updated weights for policy 1, policy_version 1548118 (0.0008) [2023-12-28 06:21:39,014][106226] Updated weights for policy 0, policy_version 1544379 (0.0009) [2023-12-28 06:21:39,071][106226] Updated weights for policy 0, policy_version 1544389 (0.0010) [2023-12-28 06:21:39,116][106226] Updated weights for policy 0, policy_version 1544399 (0.0007) [2023-12-28 06:21:39,280][106225] Updated weights for policy 1, policy_version 1548128 (0.0008) [2023-12-28 06:21:39,339][106225] Updated weights for policy 1, policy_version 1548138 (0.0008) [2023-12-28 06:21:39,402][106225] Updated weights for policy 1, policy_version 1548148 (0.0008) [2023-12-28 06:21:39,878][106226] Updated weights for policy 0, policy_version 1544409 (0.0006) [2023-12-28 06:21:39,940][106226] Updated weights for policy 0, policy_version 1544419 (0.0010) [2023-12-28 06:21:40,003][106226] Updated weights for policy 0, policy_version 1544429 (0.0011) [2023-12-28 06:21:40,064][106226] Updated weights for policy 0, policy_version 1544439 (0.0007) [2023-12-28 06:21:40,089][106225] Updated weights for policy 1, policy_version 1548158 (0.0008) [2023-12-28 06:21:40,148][106225] Updated weights for policy 1, policy_version 1548168 (0.0008) [2023-12-28 06:21:40,208][106225] Updated weights for policy 1, policy_version 1548178 (0.0008) [2023-12-28 06:21:40,826][106226] Updated weights for policy 0, policy_version 1544449 (0.0009) [2023-12-28 06:21:40,881][106225] Updated weights for policy 1, policy_version 1548188 (0.0007) [2023-12-28 06:21:40,885][106226] Updated weights for policy 0, policy_version 1544459 (0.0008) [2023-12-28 06:21:40,933][106226] Updated weights for policy 0, policy_version 1544469 (0.0007) [2023-12-28 06:21:40,943][106225] Updated weights for policy 1, policy_version 1548198 (0.0005) [2023-12-28 06:21:41,010][106225] Updated weights for policy 1, policy_version 1548208 (0.0005) [2023-12-28 06:21:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 791855104. Throughput: 0: 9933.7, 1: 9832.7. Samples: 791821172. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:41,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.652')] [2023-12-28 06:21:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001544472_395460608.pth... [2023-12-28 06:21:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001548216_396394496.pth... [2023-12-28 06:21:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001543320_395165696.pth [2023-12-28 06:21:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001547064_396099584.pth [2023-12-28 06:21:41,727][106226] Updated weights for policy 0, policy_version 1544479 (0.0010) [2023-12-28 06:21:41,747][106225] Updated weights for policy 1, policy_version 1548218 (0.0009) [2023-12-28 06:21:41,792][106226] Updated weights for policy 0, policy_version 1544489 (0.0011) [2023-12-28 06:21:41,810][106225] Updated weights for policy 1, policy_version 1548228 (0.0006) [2023-12-28 06:21:41,846][106226] Updated weights for policy 0, policy_version 1544499 (0.0011) [2023-12-28 06:21:41,868][106225] Updated weights for policy 1, policy_version 1548238 (0.0006) [2023-12-28 06:21:41,930][106225] Updated weights for policy 1, policy_version 1548248 (0.0008) [2023-12-28 06:21:42,601][106226] Updated weights for policy 0, policy_version 1544509 (0.0010) [2023-12-28 06:21:42,656][106226] Updated weights for policy 0, policy_version 1544519 (0.0007) [2023-12-28 06:21:42,698][106225] Updated weights for policy 1, policy_version 1548258 (0.0007) [2023-12-28 06:21:42,716][106226] Updated weights for policy 0, policy_version 1544529 (0.0007) [2023-12-28 06:21:42,757][106225] Updated weights for policy 1, policy_version 1548268 (0.0007) [2023-12-28 06:21:42,816][106225] Updated weights for policy 1, policy_version 1548278 (0.0009) [2023-12-28 06:21:43,463][106225] Updated weights for policy 1, policy_version 1548288 (0.0010) [2023-12-28 06:21:43,475][106226] Updated weights for policy 0, policy_version 1544539 (0.0008) [2023-12-28 06:21:43,537][106225] Updated weights for policy 1, policy_version 1548298 (0.0007) [2023-12-28 06:21:43,538][106226] Updated weights for policy 0, policy_version 1544549 (0.0007) [2023-12-28 06:21:43,590][106225] Updated weights for policy 1, policy_version 1548308 (0.0006) [2023-12-28 06:21:43,599][106226] Updated weights for policy 0, policy_version 1544559 (0.0009) [2023-12-28 06:21:44,198][106225] Updated weights for policy 1, policy_version 1548318 (0.0007) [2023-12-28 06:21:44,263][106225] Updated weights for policy 1, policy_version 1548328 (0.0005) [2023-12-28 06:21:44,320][106225] Updated weights for policy 1, policy_version 1548338 (0.0007) [2023-12-28 06:21:44,381][106226] Updated weights for policy 0, policy_version 1544569 (0.0009) [2023-12-28 06:21:44,438][106226] Updated weights for policy 0, policy_version 1544579 (0.0009) [2023-12-28 06:21:44,504][106226] Updated weights for policy 0, policy_version 1544589 (0.0009) [2023-12-28 06:21:44,563][106226] Updated weights for policy 0, policy_version 1544599 (0.0009) [2023-12-28 06:21:44,948][106225] Updated weights for policy 1, policy_version 1548348 (0.0008) [2023-12-28 06:21:45,010][106225] Updated weights for policy 1, policy_version 1548358 (0.0008) [2023-12-28 06:21:45,076][106225] Updated weights for policy 1, policy_version 1548368 (0.0008) [2023-12-28 06:21:45,286][106226] Updated weights for policy 0, policy_version 1544609 (0.0009) [2023-12-28 06:21:45,349][106226] Updated weights for policy 0, policy_version 1544619 (0.0009) [2023-12-28 06:21:45,413][106226] Updated weights for policy 0, policy_version 1544629 (0.0009) [2023-12-28 06:21:45,776][106225] Updated weights for policy 1, policy_version 1548378 (0.0008) [2023-12-28 06:21:45,828][106225] Updated weights for policy 1, policy_version 1548388 (0.0008) [2023-12-28 06:21:45,883][106225] Updated weights for policy 1, policy_version 1548398 (0.0009) [2023-12-28 06:21:45,934][106225] Updated weights for policy 1, policy_version 1548408 (0.0009) [2023-12-28 06:21:46,128][106226] Updated weights for policy 0, policy_version 1544639 (0.0009) [2023-12-28 06:21:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 791945216. Throughput: 0: 9916.3, 1: 9839.7. Samples: 791937380. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:46,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-4.720')] [2023-12-28 06:21:46,187][106226] Updated weights for policy 0, policy_version 1544649 (0.0008) [2023-12-28 06:21:46,248][106226] Updated weights for policy 0, policy_version 1544659 (0.0008) [2023-12-28 06:21:46,571][106225] Updated weights for policy 1, policy_version 1548418 (0.0005) [2023-12-28 06:21:46,636][106225] Updated weights for policy 1, policy_version 1548428 (0.0009) [2023-12-28 06:21:46,706][106225] Updated weights for policy 1, policy_version 1548438 (0.0009) [2023-12-28 06:21:47,012][106226] Updated weights for policy 0, policy_version 1544669 (0.0008) [2023-12-28 06:21:47,063][106226] Updated weights for policy 0, policy_version 1544679 (0.0006) [2023-12-28 06:21:47,112][106226] Updated weights for policy 0, policy_version 1544689 (0.0010) [2023-12-28 06:21:47,341][106225] Updated weights for policy 1, policy_version 1548448 (0.0010) [2023-12-28 06:21:47,400][106225] Updated weights for policy 1, policy_version 1548458 (0.0010) [2023-12-28 06:21:47,459][106225] Updated weights for policy 1, policy_version 1548468 (0.0010) [2023-12-28 06:21:47,721][106226] Updated weights for policy 0, policy_version 1544699 (0.0006) [2023-12-28 06:21:47,785][106226] Updated weights for policy 0, policy_version 1544709 (0.0008) [2023-12-28 06:21:47,843][106226] Updated weights for policy 0, policy_version 1544719 (0.0008) [2023-12-28 06:21:48,151][106225] Updated weights for policy 1, policy_version 1548478 (0.0007) [2023-12-28 06:21:48,221][106225] Updated weights for policy 1, policy_version 1548488 (0.0007) [2023-12-28 06:21:48,284][106225] Updated weights for policy 1, policy_version 1548498 (0.0008) [2023-12-28 06:21:48,456][106226] Updated weights for policy 0, policy_version 1544729 (0.0010) [2023-12-28 06:21:48,519][106226] Updated weights for policy 0, policy_version 1544739 (0.0011) [2023-12-28 06:21:48,583][106226] Updated weights for policy 0, policy_version 1544749 (0.0011) [2023-12-28 06:21:48,643][106226] Updated weights for policy 0, policy_version 1544759 (0.0011) [2023-12-28 06:21:49,015][106225] Updated weights for policy 1, policy_version 1548508 (0.0008) [2023-12-28 06:21:49,076][106225] Updated weights for policy 1, policy_version 1548518 (0.0008) [2023-12-28 06:21:49,149][106225] Updated weights for policy 1, policy_version 1548528 (0.0009) [2023-12-28 06:21:49,286][106226] Updated weights for policy 0, policy_version 1544769 (0.0008) [2023-12-28 06:21:49,343][106226] Updated weights for policy 0, policy_version 1544779 (0.0008) [2023-12-28 06:21:49,412][106226] Updated weights for policy 0, policy_version 1544789 (0.0009) [2023-12-28 06:21:49,893][106225] Updated weights for policy 1, policy_version 1548538 (0.0009) [2023-12-28 06:21:49,962][106225] Updated weights for policy 1, policy_version 1548548 (0.0006) [2023-12-28 06:21:50,028][106225] Updated weights for policy 1, policy_version 1548558 (0.0008) [2023-12-28 06:21:50,085][106225] Updated weights for policy 1, policy_version 1548568 (0.0008) [2023-12-28 06:21:50,132][106226] Updated weights for policy 0, policy_version 1544799 (0.0009) [2023-12-28 06:21:50,188][106226] Updated weights for policy 0, policy_version 1544809 (0.0010) [2023-12-28 06:21:50,239][106226] Updated weights for policy 0, policy_version 1544819 (0.0009) [2023-12-28 06:21:50,653][106225] Updated weights for policy 1, policy_version 1548578 (0.0009) [2023-12-28 06:21:50,707][106225] Updated weights for policy 1, policy_version 1548588 (0.0005) [2023-12-28 06:21:50,757][106225] Updated weights for policy 1, policy_version 1548598 (0.0007) [2023-12-28 06:21:51,022][106226] Updated weights for policy 0, policy_version 1544829 (0.0009) [2023-12-28 06:21:51,092][106226] Updated weights for policy 0, policy_version 1544839 (0.0008) [2023-12-28 06:21:51,166][106226] Updated weights for policy 0, policy_version 1544849 (0.0008) [2023-12-28 06:21:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 792043520. Throughput: 0: 9861.3, 1: 9877.2. Samples: 792057012. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:51,175][105115] Avg episode reward: [(0, '-4.937'), (1, '-4.731')] [2023-12-28 06:21:51,512][106225] Updated weights for policy 1, policy_version 1548608 (0.0006) [2023-12-28 06:21:51,576][106225] Updated weights for policy 1, policy_version 1548618 (0.0006) [2023-12-28 06:21:51,642][106225] Updated weights for policy 1, policy_version 1548628 (0.0007) [2023-12-28 06:21:51,891][106226] Updated weights for policy 0, policy_version 1544859 (0.0009) [2023-12-28 06:21:51,963][106226] Updated weights for policy 0, policy_version 1544869 (0.0009) [2023-12-28 06:21:52,031][106226] Updated weights for policy 0, policy_version 1544879 (0.0009) [2023-12-28 06:21:52,300][106225] Updated weights for policy 1, policy_version 1548638 (0.0008) [2023-12-28 06:21:52,362][106225] Updated weights for policy 1, policy_version 1548648 (0.0009) [2023-12-28 06:21:52,420][106225] Updated weights for policy 1, policy_version 1548658 (0.0008) [2023-12-28 06:21:52,738][106226] Updated weights for policy 0, policy_version 1544889 (0.0008) [2023-12-28 06:21:52,803][106226] Updated weights for policy 0, policy_version 1544899 (0.0006) [2023-12-28 06:21:52,866][106226] Updated weights for policy 0, policy_version 1544909 (0.0008) [2023-12-28 06:21:52,925][106226] Updated weights for policy 0, policy_version 1544919 (0.0009) [2023-12-28 06:21:53,140][106225] Updated weights for policy 1, policy_version 1548668 (0.0007) [2023-12-28 06:21:53,197][106225] Updated weights for policy 1, policy_version 1548678 (0.0006) [2023-12-28 06:21:53,253][106225] Updated weights for policy 1, policy_version 1548688 (0.0007) [2023-12-28 06:21:53,582][106226] Updated weights for policy 0, policy_version 1544929 (0.0006) [2023-12-28 06:21:53,635][106226] Updated weights for policy 0, policy_version 1544939 (0.0005) [2023-12-28 06:21:53,699][106226] Updated weights for policy 0, policy_version 1544949 (0.0007) [2023-12-28 06:21:54,007][106225] Updated weights for policy 1, policy_version 1548698 (0.0009) [2023-12-28 06:21:54,064][106225] Updated weights for policy 1, policy_version 1548708 (0.0010) [2023-12-28 06:21:54,116][106225] Updated weights for policy 1, policy_version 1548718 (0.0008) [2023-12-28 06:21:54,177][106225] Updated weights for policy 1, policy_version 1548728 (0.0009) [2023-12-28 06:21:54,254][106226] Updated weights for policy 0, policy_version 1544959 (0.0009) [2023-12-28 06:21:54,305][106226] Updated weights for policy 0, policy_version 1544969 (0.0007) [2023-12-28 06:21:54,354][106226] Updated weights for policy 0, policy_version 1544979 (0.0006) [2023-12-28 06:21:54,912][106225] Updated weights for policy 1, policy_version 1548738 (0.0008) [2023-12-28 06:21:54,959][106225] Updated weights for policy 1, policy_version 1548748 (0.0008) [2023-12-28 06:21:55,010][106225] Updated weights for policy 1, policy_version 1548758 (0.0007) [2023-12-28 06:21:55,028][106226] Updated weights for policy 0, policy_version 1544989 (0.0009) [2023-12-28 06:21:55,074][106226] Updated weights for policy 0, policy_version 1544999 (0.0010) [2023-12-28 06:21:55,129][106226] Updated weights for policy 0, policy_version 1545009 (0.0011) [2023-12-28 06:21:55,698][106225] Updated weights for policy 1, policy_version 1548768 (0.0007) [2023-12-28 06:21:55,748][106225] Updated weights for policy 1, policy_version 1548778 (0.0007) [2023-12-28 06:21:55,788][106226] Updated weights for policy 0, policy_version 1545019 (0.0010) [2023-12-28 06:21:55,805][106225] Updated weights for policy 1, policy_version 1548788 (0.0006) [2023-12-28 06:21:55,844][106226] Updated weights for policy 0, policy_version 1545029 (0.0010) [2023-12-28 06:21:55,897][106226] Updated weights for policy 0, policy_version 1545039 (0.0010) [2023-12-28 06:21:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 792150016. Throughput: 0: 9842.3, 1: 9852.1. Samples: 792116180. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:21:56,176][105115] Avg episode reward: [(0, '-4.680'), (1, '-4.281')] [2023-12-28 06:21:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001548792_396541952.pth... [2023-12-28 06:21:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001545048_395608064.pth... [2023-12-28 06:21:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001547608_396238848.pth [2023-12-28 06:21:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001543896_395313152.pth [2023-12-28 06:21:56,502][106225] Updated weights for policy 1, policy_version 1548798 (0.0009) [2023-12-28 06:21:56,538][106226] Updated weights for policy 0, policy_version 1545049 (0.0008) [2023-12-28 06:21:56,558][106225] Updated weights for policy 1, policy_version 1548808 (0.0010) [2023-12-28 06:21:56,596][106226] Updated weights for policy 0, policy_version 1545059 (0.0005) [2023-12-28 06:21:56,602][106225] Updated weights for policy 1, policy_version 1548818 (0.0010) [2023-12-28 06:21:56,652][106226] Updated weights for policy 0, policy_version 1545069 (0.0005) [2023-12-28 06:21:56,703][106226] Updated weights for policy 0, policy_version 1545079 (0.0007) [2023-12-28 06:21:57,219][106225] Updated weights for policy 1, policy_version 1548828 (0.0008) [2023-12-28 06:21:57,267][106225] Updated weights for policy 1, policy_version 1548838 (0.0008) [2023-12-28 06:21:57,321][106225] Updated weights for policy 1, policy_version 1548848 (0.0008) [2023-12-28 06:21:57,324][106226] Updated weights for policy 0, policy_version 1545089 (0.0010) [2023-12-28 06:21:57,374][106226] Updated weights for policy 0, policy_version 1545099 (0.0010) [2023-12-28 06:21:57,420][106226] Updated weights for policy 0, policy_version 1545109 (0.0010) [2023-12-28 06:21:57,953][106225] Updated weights for policy 1, policy_version 1548858 (0.0007) [2023-12-28 06:21:57,998][106225] Updated weights for policy 1, policy_version 1548868 (0.0010) [2023-12-28 06:21:58,051][106225] Updated weights for policy 1, policy_version 1548878 (0.0010) [2023-12-28 06:21:58,070][106226] Updated weights for policy 0, policy_version 1545119 (0.0007) [2023-12-28 06:21:58,107][106225] Updated weights for policy 1, policy_version 1548888 (0.0005) [2023-12-28 06:21:58,120][106226] Updated weights for policy 0, policy_version 1545129 (0.0008) [2023-12-28 06:21:58,168][106226] Updated weights for policy 0, policy_version 1545139 (0.0010) [2023-12-28 06:21:58,904][106225] Updated weights for policy 1, policy_version 1548898 (0.0008) [2023-12-28 06:21:58,966][106225] Updated weights for policy 1, policy_version 1548908 (0.0008) [2023-12-28 06:21:59,032][106225] Updated weights for policy 1, policy_version 1548918 (0.0011) [2023-12-28 06:21:59,101][106226] Updated weights for policy 0, policy_version 1545149 (0.0009) [2023-12-28 06:21:59,163][106226] Updated weights for policy 0, policy_version 1545159 (0.0007) [2023-12-28 06:21:59,231][106226] Updated weights for policy 0, policy_version 1545169 (0.0007) [2023-12-28 06:21:59,746][106225] Updated weights for policy 1, policy_version 1548928 (0.0007) [2023-12-28 06:21:59,812][106225] Updated weights for policy 1, policy_version 1548938 (0.0006) [2023-12-28 06:21:59,878][106225] Updated weights for policy 1, policy_version 1548948 (0.0007) [2023-12-28 06:21:59,941][106226] Updated weights for policy 0, policy_version 1545179 (0.0008) [2023-12-28 06:21:59,992][106226] Updated weights for policy 0, policy_version 1545189 (0.0010) [2023-12-28 06:22:00,051][106226] Updated weights for policy 0, policy_version 1545199 (0.0010) [2023-12-28 06:22:00,508][106225] Updated weights for policy 1, policy_version 1548958 (0.0007) [2023-12-28 06:22:00,561][106225] Updated weights for policy 1, policy_version 1548968 (0.0006) [2023-12-28 06:22:00,623][106225] Updated weights for policy 1, policy_version 1548978 (0.0007) [2023-12-28 06:22:00,751][106226] Updated weights for policy 0, policy_version 1545209 (0.0010) [2023-12-28 06:22:00,815][106226] Updated weights for policy 0, policy_version 1545219 (0.0008) [2023-12-28 06:22:00,870][106226] Updated weights for policy 0, policy_version 1545229 (0.0010) [2023-12-28 06:22:00,927][106226] Updated weights for policy 0, policy_version 1545239 (0.0009) [2023-12-28 06:22:01,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 792248320. Throughput: 0: 9882.9, 1: 9925.0. Samples: 792237024. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:01,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.649')] [2023-12-28 06:22:01,252][106225] Updated weights for policy 1, policy_version 1548988 (0.0009) [2023-12-28 06:22:01,309][106225] Updated weights for policy 1, policy_version 1548998 (0.0007) [2023-12-28 06:22:01,377][106225] Updated weights for policy 1, policy_version 1549008 (0.0008) [2023-12-28 06:22:01,608][106226] Updated weights for policy 0, policy_version 1545249 (0.0007) [2023-12-28 06:22:01,671][106226] Updated weights for policy 0, policy_version 1545259 (0.0009) [2023-12-28 06:22:01,736][106226] Updated weights for policy 0, policy_version 1545269 (0.0007) [2023-12-28 06:22:02,095][106225] Updated weights for policy 1, policy_version 1549018 (0.0008) [2023-12-28 06:22:02,162][106225] Updated weights for policy 1, policy_version 1549028 (0.0005) [2023-12-28 06:22:02,221][106225] Updated weights for policy 1, policy_version 1549038 (0.0005) [2023-12-28 06:22:02,284][106225] Updated weights for policy 1, policy_version 1549048 (0.0007) [2023-12-28 06:22:02,415][106226] Updated weights for policy 0, policy_version 1545279 (0.0010) [2023-12-28 06:22:02,481][106226] Updated weights for policy 0, policy_version 1545289 (0.0009) [2023-12-28 06:22:02,551][106226] Updated weights for policy 0, policy_version 1545299 (0.0009) [2023-12-28 06:22:02,902][106225] Updated weights for policy 1, policy_version 1549058 (0.0006) [2023-12-28 06:22:02,967][106225] Updated weights for policy 1, policy_version 1549068 (0.0005) [2023-12-28 06:22:03,020][106225] Updated weights for policy 1, policy_version 1549078 (0.0005) [2023-12-28 06:22:03,243][106226] Updated weights for policy 0, policy_version 1545309 (0.0009) [2023-12-28 06:22:03,299][106226] Updated weights for policy 0, policy_version 1545319 (0.0010) [2023-12-28 06:22:03,353][106226] Updated weights for policy 0, policy_version 1545329 (0.0006) [2023-12-28 06:22:03,673][106225] Updated weights for policy 1, policy_version 1549088 (0.0006) [2023-12-28 06:22:03,725][106225] Updated weights for policy 1, policy_version 1549098 (0.0007) [2023-12-28 06:22:03,777][106225] Updated weights for policy 1, policy_version 1549108 (0.0008) [2023-12-28 06:22:03,916][106226] Updated weights for policy 0, policy_version 1545339 (0.0005) [2023-12-28 06:22:03,976][106226] Updated weights for policy 0, policy_version 1545349 (0.0009) [2023-12-28 06:22:04,034][106226] Updated weights for policy 0, policy_version 1545359 (0.0008) [2023-12-28 06:22:04,424][106225] Updated weights for policy 1, policy_version 1549118 (0.0008) [2023-12-28 06:22:04,473][106225] Updated weights for policy 1, policy_version 1549128 (0.0009) [2023-12-28 06:22:04,519][106225] Updated weights for policy 1, policy_version 1549138 (0.0008) [2023-12-28 06:22:04,752][106226] Updated weights for policy 0, policy_version 1545369 (0.0006) [2023-12-28 06:22:04,804][106226] Updated weights for policy 0, policy_version 1545379 (0.0005) [2023-12-28 06:22:04,862][106226] Updated weights for policy 0, policy_version 1545389 (0.0005) [2023-12-28 06:22:04,925][106226] Updated weights for policy 0, policy_version 1545399 (0.0005) [2023-12-28 06:22:05,160][106225] Updated weights for policy 1, policy_version 1549148 (0.0006) [2023-12-28 06:22:05,216][106225] Updated weights for policy 1, policy_version 1549158 (0.0007) [2023-12-28 06:22:05,272][106225] Updated weights for policy 1, policy_version 1549168 (0.0006) [2023-12-28 06:22:05,564][106226] Updated weights for policy 0, policy_version 1545409 (0.0010) [2023-12-28 06:22:05,619][106226] Updated weights for policy 0, policy_version 1545419 (0.0010) [2023-12-28 06:22:05,675][106226] Updated weights for policy 0, policy_version 1545429 (0.0010) [2023-12-28 06:22:05,936][106225] Updated weights for policy 1, policy_version 1549178 (0.0008) [2023-12-28 06:22:05,997][106225] Updated weights for policy 1, policy_version 1549188 (0.0007) [2023-12-28 06:22:06,057][106225] Updated weights for policy 1, policy_version 1549198 (0.0007) [2023-12-28 06:22:06,120][106225] Updated weights for policy 1, policy_version 1549208 (0.0008) [2023-12-28 06:22:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 792354816. Throughput: 0: 9876.5, 1: 10087.9. Samples: 792361772. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:06,175][105115] Avg episode reward: [(0, '-5.037'), (1, '-4.735')] [2023-12-28 06:22:06,389][106226] Updated weights for policy 0, policy_version 1545439 (0.0009) [2023-12-28 06:22:06,453][106226] Updated weights for policy 0, policy_version 1545449 (0.0007) [2023-12-28 06:22:06,520][106226] Updated weights for policy 0, policy_version 1545459 (0.0008) [2023-12-28 06:22:06,848][106225] Updated weights for policy 1, policy_version 1549218 (0.0008) [2023-12-28 06:22:06,900][106225] Updated weights for policy 1, policy_version 1549228 (0.0007) [2023-12-28 06:22:06,962][106225] Updated weights for policy 1, policy_version 1549238 (0.0008) [2023-12-28 06:22:07,199][106226] Updated weights for policy 0, policy_version 1545469 (0.0010) [2023-12-28 06:22:07,256][106226] Updated weights for policy 0, policy_version 1545479 (0.0011) [2023-12-28 06:22:07,314][106226] Updated weights for policy 0, policy_version 1545489 (0.0011) [2023-12-28 06:22:07,688][106225] Updated weights for policy 1, policy_version 1549248 (0.0007) [2023-12-28 06:22:07,742][106225] Updated weights for policy 1, policy_version 1549258 (0.0008) [2023-12-28 06:22:07,803][106225] Updated weights for policy 1, policy_version 1549268 (0.0008) [2023-12-28 06:22:08,050][106226] Updated weights for policy 0, policy_version 1545499 (0.0009) [2023-12-28 06:22:08,117][106226] Updated weights for policy 0, policy_version 1545509 (0.0006) [2023-12-28 06:22:08,175][106226] Updated weights for policy 0, policy_version 1545519 (0.0006) [2023-12-28 06:22:08,537][106225] Updated weights for policy 1, policy_version 1549278 (0.0011) [2023-12-28 06:22:08,588][106225] Updated weights for policy 1, policy_version 1549288 (0.0010) [2023-12-28 06:22:08,649][106225] Updated weights for policy 1, policy_version 1549298 (0.0010) [2023-12-28 06:22:08,885][106226] Updated weights for policy 0, policy_version 1545529 (0.0007) [2023-12-28 06:22:08,941][106226] Updated weights for policy 0, policy_version 1545539 (0.0006) [2023-12-28 06:22:08,990][106226] Updated weights for policy 0, policy_version 1545549 (0.0005) [2023-12-28 06:22:09,034][106226] Updated weights for policy 0, policy_version 1545559 (0.0005) [2023-12-28 06:22:09,333][106225] Updated weights for policy 1, policy_version 1549308 (0.0009) [2023-12-28 06:22:09,404][106225] Updated weights for policy 1, policy_version 1549318 (0.0009) [2023-12-28 06:22:09,473][106225] Updated weights for policy 1, policy_version 1549328 (0.0009) [2023-12-28 06:22:09,802][106226] Updated weights for policy 0, policy_version 1545569 (0.0007) [2023-12-28 06:22:09,870][106226] Updated weights for policy 0, policy_version 1545579 (0.0009) [2023-12-28 06:22:09,934][106226] Updated weights for policy 0, policy_version 1545589 (0.0008) [2023-12-28 06:22:10,180][106225] Updated weights for policy 1, policy_version 1549338 (0.0010) [2023-12-28 06:22:10,233][106225] Updated weights for policy 1, policy_version 1549348 (0.0009) [2023-12-28 06:22:10,290][106225] Updated weights for policy 1, policy_version 1549358 (0.0008) [2023-12-28 06:22:10,339][106225] Updated weights for policy 1, policy_version 1549368 (0.0008) [2023-12-28 06:22:10,684][106226] Updated weights for policy 0, policy_version 1545599 (0.0009) [2023-12-28 06:22:10,750][106226] Updated weights for policy 0, policy_version 1545609 (0.0009) [2023-12-28 06:22:10,813][106226] Updated weights for policy 0, policy_version 1545619 (0.0005) [2023-12-28 06:22:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 792444928. Throughput: 0: 9888.0, 1: 10090.7. Samples: 792419768. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:11,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.701')] [2023-12-28 06:22:11,175][106225] Updated weights for policy 1, policy_version 1549378 (0.0010) [2023-12-28 06:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001545624_395755520.pth... [2023-12-28 06:22:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001544472_395460608.pth [2023-12-28 06:22:11,238][106225] Updated weights for policy 1, policy_version 1549388 (0.0010) [2023-12-28 06:22:11,304][106225] Updated weights for policy 1, policy_version 1549398 (0.0011) [2023-12-28 06:22:11,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001549400_396697600.pth... [2023-12-28 06:22:11,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001548216_396394496.pth [2023-12-28 06:22:11,537][106226] Updated weights for policy 0, policy_version 1545629 (0.0008) [2023-12-28 06:22:11,592][106226] Updated weights for policy 0, policy_version 1545639 (0.0011) [2023-12-28 06:22:11,665][106226] Updated weights for policy 0, policy_version 1545649 (0.0009) [2023-12-28 06:22:12,092][106225] Updated weights for policy 1, policy_version 1549408 (0.0010) [2023-12-28 06:22:12,152][106225] Updated weights for policy 1, policy_version 1549418 (0.0008) [2023-12-28 06:22:12,205][106225] Updated weights for policy 1, policy_version 1549428 (0.0008) [2023-12-28 06:22:12,389][106226] Updated weights for policy 0, policy_version 1545659 (0.0011) [2023-12-28 06:22:12,449][106226] Updated weights for policy 0, policy_version 1545669 (0.0009) [2023-12-28 06:22:12,510][106226] Updated weights for policy 0, policy_version 1545679 (0.0011) [2023-12-28 06:22:12,962][106225] Updated weights for policy 1, policy_version 1549438 (0.0008) [2023-12-28 06:22:13,018][106225] Updated weights for policy 1, policy_version 1549448 (0.0008) [2023-12-28 06:22:13,085][106225] Updated weights for policy 1, policy_version 1549458 (0.0010) [2023-12-28 06:22:13,171][106226] Updated weights for policy 0, policy_version 1545689 (0.0010) [2023-12-28 06:22:13,223][106226] Updated weights for policy 0, policy_version 1545699 (0.0005) [2023-12-28 06:22:13,272][106226] Updated weights for policy 0, policy_version 1545709 (0.0005) [2023-12-28 06:22:13,328][106226] Updated weights for policy 0, policy_version 1545719 (0.0005) [2023-12-28 06:22:13,697][106225] Updated weights for policy 1, policy_version 1549468 (0.0008) [2023-12-28 06:22:13,757][106225] Updated weights for policy 1, policy_version 1549478 (0.0009) [2023-12-28 06:22:13,822][106225] Updated weights for policy 1, policy_version 1549488 (0.0009) [2023-12-28 06:22:13,845][106226] Updated weights for policy 0, policy_version 1545729 (0.0005) [2023-12-28 06:22:13,902][106226] Updated weights for policy 0, policy_version 1545739 (0.0010) [2023-12-28 06:22:13,963][106226] Updated weights for policy 0, policy_version 1545749 (0.0007) [2023-12-28 06:22:14,521][106226] Updated weights for policy 0, policy_version 1545759 (0.0009) [2023-12-28 06:22:14,553][106225] Updated weights for policy 1, policy_version 1549498 (0.0007) [2023-12-28 06:22:14,578][106226] Updated weights for policy 0, policy_version 1545769 (0.0010) [2023-12-28 06:22:14,614][106225] Updated weights for policy 1, policy_version 1549508 (0.0009) [2023-12-28 06:22:14,637][106226] Updated weights for policy 0, policy_version 1545779 (0.0008) [2023-12-28 06:22:14,660][106225] Updated weights for policy 1, policy_version 1549518 (0.0010) [2023-12-28 06:22:14,721][106225] Updated weights for policy 1, policy_version 1549528 (0.0010) [2023-12-28 06:22:15,292][106226] Updated weights for policy 0, policy_version 1545789 (0.0008) [2023-12-28 06:22:15,361][106226] Updated weights for policy 0, policy_version 1545799 (0.0008) [2023-12-28 06:22:15,418][106226] Updated weights for policy 0, policy_version 1545809 (0.0011) [2023-12-28 06:22:15,452][106225] Updated weights for policy 1, policy_version 1549538 (0.0007) [2023-12-28 06:22:15,501][106225] Updated weights for policy 1, policy_version 1549548 (0.0007) [2023-12-28 06:22:15,550][106225] Updated weights for policy 1, policy_version 1549558 (0.0006) [2023-12-28 06:22:16,064][106226] Updated weights for policy 0, policy_version 1545819 (0.0010) [2023-12-28 06:22:16,120][106226] Updated weights for policy 0, policy_version 1545829 (0.0009) [2023-12-28 06:22:16,169][106226] Updated weights for policy 0, policy_version 1545839 (0.0009) [2023-12-28 06:22:16,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 792543232. Throughput: 0: 9901.5, 1: 10006.0. Samples: 792538900. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:16,175][105115] Avg episode reward: [(0, '-5.077'), (1, '-4.450')] [2023-12-28 06:22:16,282][106225] Updated weights for policy 1, policy_version 1549568 (0.0009) [2023-12-28 06:22:16,341][106225] Updated weights for policy 1, policy_version 1549578 (0.0008) [2023-12-28 06:22:16,399][106225] Updated weights for policy 1, policy_version 1549588 (0.0008) [2023-12-28 06:22:16,864][106226] Updated weights for policy 0, policy_version 1545849 (0.0008) [2023-12-28 06:22:16,921][106226] Updated weights for policy 0, policy_version 1545859 (0.0006) [2023-12-28 06:22:16,986][106226] Updated weights for policy 0, policy_version 1545869 (0.0009) [2023-12-28 06:22:17,047][106226] Updated weights for policy 0, policy_version 1545879 (0.0011) [2023-12-28 06:22:17,185][106225] Updated weights for policy 1, policy_version 1549598 (0.0008) [2023-12-28 06:22:17,246][106225] Updated weights for policy 1, policy_version 1549608 (0.0008) [2023-12-28 06:22:17,310][106225] Updated weights for policy 1, policy_version 1549618 (0.0007) [2023-12-28 06:22:17,761][106226] Updated weights for policy 0, policy_version 1545889 (0.0006) [2023-12-28 06:22:17,815][106226] Updated weights for policy 0, policy_version 1545899 (0.0005) [2023-12-28 06:22:17,877][106226] Updated weights for policy 0, policy_version 1545909 (0.0008) [2023-12-28 06:22:17,887][106225] Updated weights for policy 1, policy_version 1549628 (0.0008) [2023-12-28 06:22:17,950][106225] Updated weights for policy 1, policy_version 1549638 (0.0005) [2023-12-28 06:22:18,023][106225] Updated weights for policy 1, policy_version 1549648 (0.0007) [2023-12-28 06:22:18,479][106226] Updated weights for policy 0, policy_version 1545919 (0.0008) [2023-12-28 06:22:18,532][106226] Updated weights for policy 0, policy_version 1545929 (0.0009) [2023-12-28 06:22:18,591][106226] Updated weights for policy 0, policy_version 1545939 (0.0008) [2023-12-28 06:22:18,615][106225] Updated weights for policy 1, policy_version 1549658 (0.0009) [2023-12-28 06:22:18,664][106225] Updated weights for policy 1, policy_version 1549668 (0.0008) [2023-12-28 06:22:18,723][106225] Updated weights for policy 1, policy_version 1549678 (0.0008) [2023-12-28 06:22:18,775][106225] Updated weights for policy 1, policy_version 1549688 (0.0008) [2023-12-28 06:22:19,296][106226] Updated weights for policy 0, policy_version 1545949 (0.0008) [2023-12-28 06:22:19,365][106226] Updated weights for policy 0, policy_version 1545959 (0.0007) [2023-12-28 06:22:19,431][106226] Updated weights for policy 0, policy_version 1545969 (0.0006) [2023-12-28 06:22:19,464][106225] Updated weights for policy 1, policy_version 1549698 (0.0006) [2023-12-28 06:22:19,547][106225] Updated weights for policy 1, policy_version 1549708 (0.0008) [2023-12-28 06:22:19,620][106225] Updated weights for policy 1, policy_version 1549718 (0.0009) [2023-12-28 06:22:20,099][106226] Updated weights for policy 0, policy_version 1545979 (0.0006) [2023-12-28 06:22:20,157][106226] Updated weights for policy 0, policy_version 1545989 (0.0006) [2023-12-28 06:22:20,225][106226] Updated weights for policy 0, policy_version 1545999 (0.0006) [2023-12-28 06:22:20,319][106225] Updated weights for policy 1, policy_version 1549728 (0.0008) [2023-12-28 06:22:20,379][106225] Updated weights for policy 1, policy_version 1549738 (0.0008) [2023-12-28 06:22:20,442][106225] Updated weights for policy 1, policy_version 1549748 (0.0008) [2023-12-28 06:22:20,928][106226] Updated weights for policy 0, policy_version 1546009 (0.0008) [2023-12-28 06:22:20,987][106226] Updated weights for policy 0, policy_version 1546019 (0.0008) [2023-12-28 06:22:21,054][106226] Updated weights for policy 0, policy_version 1546029 (0.0008) [2023-12-28 06:22:21,114][106226] Updated weights for policy 0, policy_version 1546039 (0.0008) [2023-12-28 06:22:21,159][106225] Updated weights for policy 1, policy_version 1549758 (0.0008) [2023-12-28 06:22:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 792649728. Throughput: 0: 9904.2, 1: 9988.7. Samples: 792658188. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:21,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.516')] [2023-12-28 06:22:21,224][106225] Updated weights for policy 1, policy_version 1549768 (0.0006) [2023-12-28 06:22:21,285][106225] Updated weights for policy 1, policy_version 1549778 (0.0007) [2023-12-28 06:22:21,941][106225] Updated weights for policy 1, policy_version 1549788 (0.0006) [2023-12-28 06:22:21,949][106226] Updated weights for policy 0, policy_version 1546049 (0.0008) [2023-12-28 06:22:22,001][106225] Updated weights for policy 1, policy_version 1549798 (0.0006) [2023-12-28 06:22:22,012][106226] Updated weights for policy 0, policy_version 1546059 (0.0008) [2023-12-28 06:22:22,056][106225] Updated weights for policy 1, policy_version 1549808 (0.0007) [2023-12-28 06:22:22,072][106226] Updated weights for policy 0, policy_version 1546069 (0.0008) [2023-12-28 06:22:22,782][106225] Updated weights for policy 1, policy_version 1549818 (0.0009) [2023-12-28 06:22:22,835][106225] Updated weights for policy 1, policy_version 1549828 (0.0008) [2023-12-28 06:22:22,842][106226] Updated weights for policy 0, policy_version 1546079 (0.0009) [2023-12-28 06:22:22,889][106225] Updated weights for policy 1, policy_version 1549838 (0.0007) [2023-12-28 06:22:22,899][106226] Updated weights for policy 0, policy_version 1546089 (0.0007) [2023-12-28 06:22:22,937][106225] Updated weights for policy 1, policy_version 1549848 (0.0006) [2023-12-28 06:22:22,955][106226] Updated weights for policy 0, policy_version 1546099 (0.0007) [2023-12-28 06:22:23,567][106226] Updated weights for policy 0, policy_version 1546109 (0.0009) [2023-12-28 06:22:23,623][106226] Updated weights for policy 0, policy_version 1546119 (0.0008) [2023-12-28 06:22:23,680][106226] Updated weights for policy 0, policy_version 1546129 (0.0008) [2023-12-28 06:22:23,727][106225] Updated weights for policy 1, policy_version 1549858 (0.0007) [2023-12-28 06:22:23,789][106225] Updated weights for policy 1, policy_version 1549868 (0.0008) [2023-12-28 06:22:23,850][106225] Updated weights for policy 1, policy_version 1549878 (0.0008) [2023-12-28 06:22:24,421][106226] Updated weights for policy 0, policy_version 1546139 (0.0008) [2023-12-28 06:22:24,477][106226] Updated weights for policy 0, policy_version 1546149 (0.0008) [2023-12-28 06:22:24,527][106226] Updated weights for policy 0, policy_version 1546159 (0.0007) [2023-12-28 06:22:24,544][106225] Updated weights for policy 1, policy_version 1549888 (0.0008) [2023-12-28 06:22:24,596][106225] Updated weights for policy 1, policy_version 1549898 (0.0008) [2023-12-28 06:22:24,651][106225] Updated weights for policy 1, policy_version 1549908 (0.0009) [2023-12-28 06:22:25,248][106226] Updated weights for policy 0, policy_version 1546169 (0.0006) [2023-12-28 06:22:25,318][106226] Updated weights for policy 0, policy_version 1546179 (0.0005) [2023-12-28 06:22:25,364][106225] Updated weights for policy 1, policy_version 1549918 (0.0006) [2023-12-28 06:22:25,386][106226] Updated weights for policy 0, policy_version 1546189 (0.0005) [2023-12-28 06:22:25,426][106225] Updated weights for policy 1, policy_version 1549928 (0.0006) [2023-12-28 06:22:25,450][106226] Updated weights for policy 0, policy_version 1546199 (0.0006) [2023-12-28 06:22:25,476][106225] Updated weights for policy 1, policy_version 1549938 (0.0009) [2023-12-28 06:22:25,930][106226] Updated weights for policy 0, policy_version 1546209 (0.0005) [2023-12-28 06:22:25,977][106226] Updated weights for policy 0, policy_version 1546219 (0.0005) [2023-12-28 06:22:26,022][106226] Updated weights for policy 0, policy_version 1546229 (0.0005) [2023-12-28 06:22:26,172][106225] Updated weights for policy 1, policy_version 1549948 (0.0009) [2023-12-28 06:22:26,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 792748032. Throughput: 0: 9917.9, 1: 9965.7. Samples: 792715932. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:26,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.652')] [2023-12-28 06:22:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001546232_395911168.pth... [2023-12-28 06:22:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001545048_395608064.pth [2023-12-28 06:22:26,236][106225] Updated weights for policy 1, policy_version 1549958 (0.0008) [2023-12-28 06:22:26,296][106225] Updated weights for policy 1, policy_version 1549968 (0.0008) [2023-12-28 06:22:26,338][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001549976_396845056.pth... [2023-12-28 06:22:26,341][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001548792_396541952.pth [2023-12-28 06:22:26,715][106226] Updated weights for policy 0, policy_version 1546239 (0.0005) [2023-12-28 06:22:26,767][106226] Updated weights for policy 0, policy_version 1546249 (0.0005) [2023-12-28 06:22:26,814][106226] Updated weights for policy 0, policy_version 1546259 (0.0005) [2023-12-28 06:22:26,903][106225] Updated weights for policy 1, policy_version 1549978 (0.0009) [2023-12-28 06:22:26,952][106225] Updated weights for policy 1, policy_version 1549988 (0.0006) [2023-12-28 06:22:27,008][106225] Updated weights for policy 1, policy_version 1549998 (0.0005) [2023-12-28 06:22:27,065][106225] Updated weights for policy 1, policy_version 1550008 (0.0005) [2023-12-28 06:22:27,416][106226] Updated weights for policy 0, policy_version 1546269 (0.0005) [2023-12-28 06:22:27,474][106226] Updated weights for policy 0, policy_version 1546279 (0.0005) [2023-12-28 06:22:27,526][106226] Updated weights for policy 0, policy_version 1546289 (0.0005) [2023-12-28 06:22:27,730][106225] Updated weights for policy 1, policy_version 1550018 (0.0008) [2023-12-28 06:22:27,775][106225] Updated weights for policy 1, policy_version 1550028 (0.0005) [2023-12-28 06:22:27,825][106225] Updated weights for policy 1, policy_version 1550038 (0.0005) [2023-12-28 06:22:28,048][106226] Updated weights for policy 0, policy_version 1546299 (0.0005) [2023-12-28 06:22:28,098][106226] Updated weights for policy 0, policy_version 1546309 (0.0008) [2023-12-28 06:22:28,145][106226] Updated weights for policy 0, policy_version 1546319 (0.0007) [2023-12-28 06:22:28,450][106225] Updated weights for policy 1, policy_version 1550048 (0.0008) [2023-12-28 06:22:28,516][106225] Updated weights for policy 1, policy_version 1550058 (0.0008) [2023-12-28 06:22:28,578][106225] Updated weights for policy 1, policy_version 1550068 (0.0008) [2023-12-28 06:22:28,773][106226] Updated weights for policy 0, policy_version 1546329 (0.0009) [2023-12-28 06:22:28,836][106226] Updated weights for policy 0, policy_version 1546339 (0.0006) [2023-12-28 06:22:28,894][106226] Updated weights for policy 0, policy_version 1546349 (0.0008) [2023-12-28 06:22:28,953][106226] Updated weights for policy 0, policy_version 1546359 (0.0006) [2023-12-28 06:22:29,396][106225] Updated weights for policy 1, policy_version 1550078 (0.0008) [2023-12-28 06:22:29,457][106225] Updated weights for policy 1, policy_version 1550088 (0.0008) [2023-12-28 06:22:29,529][106225] Updated weights for policy 1, policy_version 1550098 (0.0008) [2023-12-28 06:22:29,613][106226] Updated weights for policy 0, policy_version 1546369 (0.0008) [2023-12-28 06:22:29,674][106226] Updated weights for policy 0, policy_version 1546379 (0.0008) [2023-12-28 06:22:29,737][106226] Updated weights for policy 0, policy_version 1546389 (0.0007) [2023-12-28 06:22:30,302][106225] Updated weights for policy 1, policy_version 1550108 (0.0007) [2023-12-28 06:22:30,362][106225] Updated weights for policy 1, policy_version 1550118 (0.0007) [2023-12-28 06:22:30,407][106226] Updated weights for policy 0, policy_version 1546399 (0.0005) [2023-12-28 06:22:30,419][106225] Updated weights for policy 1, policy_version 1550128 (0.0006) [2023-12-28 06:22:30,467][106226] Updated weights for policy 0, policy_version 1546409 (0.0006) [2023-12-28 06:22:30,514][106226] Updated weights for policy 0, policy_version 1546419 (0.0005) [2023-12-28 06:22:30,968][106225] Updated weights for policy 1, policy_version 1550138 (0.0006) [2023-12-28 06:22:31,035][106225] Updated weights for policy 1, policy_version 1550148 (0.0007) [2023-12-28 06:22:31,085][106226] Updated weights for policy 0, policy_version 1546429 (0.0006) [2023-12-28 06:22:31,098][106225] Updated weights for policy 1, policy_version 1550158 (0.0008) [2023-12-28 06:22:31,155][106226] Updated weights for policy 0, policy_version 1546439 (0.0009) [2023-12-28 06:22:31,161][106225] Updated weights for policy 1, policy_version 1550168 (0.0008) [2023-12-28 06:22:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 792854528. Throughput: 0: 10152.9, 1: 9947.2. Samples: 792841884. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:31,175][105115] Avg episode reward: [(0, '-5.054'), (1, '-4.443')] [2023-12-28 06:22:31,222][106226] Updated weights for policy 0, policy_version 1546450 (0.0010) [2023-12-28 06:22:31,806][106225] Updated weights for policy 1, policy_version 1550178 (0.0007) [2023-12-28 06:22:31,869][106225] Updated weights for policy 1, policy_version 1550188 (0.0008) [2023-12-28 06:22:31,927][106225] Updated weights for policy 1, policy_version 1550198 (0.0008) [2023-12-28 06:22:31,966][106226] Updated weights for policy 0, policy_version 1546460 (0.0009) [2023-12-28 06:22:32,021][106226] Updated weights for policy 0, policy_version 1546470 (0.0008) [2023-12-28 06:22:32,086][106226] Updated weights for policy 0, policy_version 1546480 (0.0009) [2023-12-28 06:22:32,569][106225] Updated weights for policy 1, policy_version 1550208 (0.0005) [2023-12-28 06:22:32,637][106225] Updated weights for policy 1, policy_version 1550218 (0.0006) [2023-12-28 06:22:32,696][106225] Updated weights for policy 1, policy_version 1550228 (0.0008) [2023-12-28 06:22:32,754][106226] Updated weights for policy 0, policy_version 1546490 (0.0008) [2023-12-28 06:22:32,821][106226] Updated weights for policy 0, policy_version 1546500 (0.0009) [2023-12-28 06:22:32,882][106226] Updated weights for policy 0, policy_version 1546510 (0.0010) [2023-12-28 06:22:32,940][106226] Updated weights for policy 0, policy_version 1546520 (0.0008) [2023-12-28 06:22:33,343][106225] Updated weights for policy 1, policy_version 1550238 (0.0009) [2023-12-28 06:22:33,395][106225] Updated weights for policy 1, policy_version 1550248 (0.0007) [2023-12-28 06:22:33,457][106225] Updated weights for policy 1, policy_version 1550258 (0.0005) [2023-12-28 06:22:33,606][106226] Updated weights for policy 0, policy_version 1546530 (0.0010) [2023-12-28 06:22:33,658][106226] Updated weights for policy 0, policy_version 1546540 (0.0010) [2023-12-28 06:22:33,728][106226] Updated weights for policy 0, policy_version 1546550 (0.0010) [2023-12-28 06:22:34,147][106225] Updated weights for policy 1, policy_version 1550268 (0.0006) [2023-12-28 06:22:34,207][106225] Updated weights for policy 1, policy_version 1550278 (0.0009) [2023-12-28 06:22:34,268][106225] Updated weights for policy 1, policy_version 1550288 (0.0008) [2023-12-28 06:22:34,426][106226] Updated weights for policy 0, policy_version 1546560 (0.0007) [2023-12-28 06:22:34,486][106226] Updated weights for policy 0, policy_version 1546570 (0.0008) [2023-12-28 06:22:34,542][106226] Updated weights for policy 0, policy_version 1546580 (0.0007) [2023-12-28 06:22:34,945][106225] Updated weights for policy 1, policy_version 1550298 (0.0009) [2023-12-28 06:22:35,000][106225] Updated weights for policy 1, policy_version 1550308 (0.0005) [2023-12-28 06:22:35,061][106225] Updated weights for policy 1, policy_version 1550318 (0.0005) [2023-12-28 06:22:35,123][106225] Updated weights for policy 1, policy_version 1550328 (0.0005) [2023-12-28 06:22:35,240][106226] Updated weights for policy 0, policy_version 1546590 (0.0009) [2023-12-28 06:22:35,298][106226] Updated weights for policy 0, policy_version 1546600 (0.0010) [2023-12-28 06:22:35,368][106226] Updated weights for policy 0, policy_version 1546610 (0.0009) [2023-12-28 06:22:35,636][106225] Updated weights for policy 1, policy_version 1550338 (0.0009) [2023-12-28 06:22:35,684][106225] Updated weights for policy 1, policy_version 1550348 (0.0007) [2023-12-28 06:22:35,738][106225] Updated weights for policy 1, policy_version 1550358 (0.0009) [2023-12-28 06:22:36,006][106226] Updated weights for policy 0, policy_version 1546620 (0.0007) [2023-12-28 06:22:36,061][106226] Updated weights for policy 0, policy_version 1546630 (0.0007) [2023-12-28 06:22:36,136][106226] Updated weights for policy 0, policy_version 1546640 (0.0009) [2023-12-28 06:22:36,174][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 792952832. Throughput: 0: 10203.1, 1: 10004.2. Samples: 792966340. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:36,175][105115] Avg episode reward: [(0, '-4.907'), (1, '-4.826')] [2023-12-28 06:22:36,478][106225] Updated weights for policy 1, policy_version 1550368 (0.0008) [2023-12-28 06:22:36,541][106225] Updated weights for policy 1, policy_version 1550378 (0.0008) [2023-12-28 06:22:36,593][106225] Updated weights for policy 1, policy_version 1550388 (0.0008) [2023-12-28 06:22:36,865][106226] Updated weights for policy 0, policy_version 1546650 (0.0010) [2023-12-28 06:22:36,917][106226] Updated weights for policy 0, policy_version 1546660 (0.0007) [2023-12-28 06:22:36,981][106226] Updated weights for policy 0, policy_version 1546670 (0.0011) [2023-12-28 06:22:37,052][106226] Updated weights for policy 0, policy_version 1546680 (0.0007) [2023-12-28 06:22:37,261][106225] Updated weights for policy 1, policy_version 1550398 (0.0007) [2023-12-28 06:22:37,326][106225] Updated weights for policy 1, policy_version 1550408 (0.0006) [2023-12-28 06:22:37,376][106225] Updated weights for policy 1, policy_version 1550418 (0.0008) [2023-12-28 06:22:37,685][106226] Updated weights for policy 0, policy_version 1546690 (0.0007) [2023-12-28 06:22:37,744][106226] Updated weights for policy 0, policy_version 1546700 (0.0008) [2023-12-28 06:22:37,807][106226] Updated weights for policy 0, policy_version 1546710 (0.0009) [2023-12-28 06:22:38,017][106225] Updated weights for policy 1, policy_version 1550428 (0.0007) [2023-12-28 06:22:38,074][106225] Updated weights for policy 1, policy_version 1550438 (0.0008) [2023-12-28 06:22:38,137][106225] Updated weights for policy 1, policy_version 1550448 (0.0008) [2023-12-28 06:22:38,470][106226] Updated weights for policy 0, policy_version 1546720 (0.0011) [2023-12-28 06:22:38,538][106226] Updated weights for policy 0, policy_version 1546730 (0.0011) [2023-12-28 06:22:38,601][106226] Updated weights for policy 0, policy_version 1546740 (0.0011) [2023-12-28 06:22:38,847][106225] Updated weights for policy 1, policy_version 1550458 (0.0008) [2023-12-28 06:22:38,902][106225] Updated weights for policy 1, policy_version 1550468 (0.0008) [2023-12-28 06:22:38,959][106225] Updated weights for policy 1, policy_version 1550478 (0.0007) [2023-12-28 06:22:39,001][106225] Updated weights for policy 1, policy_version 1550488 (0.0007) [2023-12-28 06:22:39,322][106226] Updated weights for policy 0, policy_version 1546750 (0.0011) [2023-12-28 06:22:39,396][106226] Updated weights for policy 0, policy_version 1546760 (0.0010) [2023-12-28 06:22:39,461][106226] Updated weights for policy 0, policy_version 1546770 (0.0011) [2023-12-28 06:22:39,777][106225] Updated weights for policy 1, policy_version 1550498 (0.0008) [2023-12-28 06:22:39,837][106225] Updated weights for policy 1, policy_version 1550508 (0.0007) [2023-12-28 06:22:39,904][106225] Updated weights for policy 1, policy_version 1550518 (0.0008) [2023-12-28 06:22:40,166][106226] Updated weights for policy 0, policy_version 1546780 (0.0011) [2023-12-28 06:22:40,232][106226] Updated weights for policy 0, policy_version 1546790 (0.0011) [2023-12-28 06:22:40,294][106226] Updated weights for policy 0, policy_version 1546800 (0.0007) [2023-12-28 06:22:40,708][106225] Updated weights for policy 1, policy_version 1550528 (0.0008) [2023-12-28 06:22:40,769][106225] Updated weights for policy 1, policy_version 1550538 (0.0007) [2023-12-28 06:22:40,830][106225] Updated weights for policy 1, policy_version 1550548 (0.0007) [2023-12-28 06:22:40,944][106226] Updated weights for policy 0, policy_version 1546810 (0.0008) [2023-12-28 06:22:40,990][106226] Updated weights for policy 0, policy_version 1546820 (0.0010) [2023-12-28 06:22:41,048][106226] Updated weights for policy 0, policy_version 1546830 (0.0010) [2023-12-28 06:22:41,104][106226] Updated weights for policy 0, policy_version 1546840 (0.0010) [2023-12-28 06:22:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 793059328. Throughput: 0: 10184.6, 1: 10044.8. Samples: 793026504. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:41,176][105115] Avg episode reward: [(0, '-5.110'), (1, '-4.594')] [2023-12-28 06:22:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001546840_396066816.pth... [2023-12-28 06:22:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001550552_396992512.pth... [2023-12-28 06:22:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001549400_396697600.pth [2023-12-28 06:22:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001545624_395755520.pth [2023-12-28 06:22:41,579][106225] Updated weights for policy 1, policy_version 1550558 (0.0007) [2023-12-28 06:22:41,651][106225] Updated weights for policy 1, policy_version 1550568 (0.0008) [2023-12-28 06:22:41,717][106225] Updated weights for policy 1, policy_version 1550578 (0.0007) [2023-12-28 06:22:41,918][106226] Updated weights for policy 0, policy_version 1546850 (0.0008) [2023-12-28 06:22:41,977][106226] Updated weights for policy 0, policy_version 1546860 (0.0009) [2023-12-28 06:22:42,038][106226] Updated weights for policy 0, policy_version 1546870 (0.0009) [2023-12-28 06:22:42,473][106225] Updated weights for policy 1, policy_version 1550588 (0.0010) [2023-12-28 06:22:42,530][106225] Updated weights for policy 1, policy_version 1550598 (0.0007) [2023-12-28 06:22:42,593][106225] Updated weights for policy 1, policy_version 1550608 (0.0009) [2023-12-28 06:22:42,758][106226] Updated weights for policy 0, policy_version 1546880 (0.0010) [2023-12-28 06:22:42,827][106226] Updated weights for policy 0, policy_version 1546890 (0.0011) [2023-12-28 06:22:42,882][106226] Updated weights for policy 0, policy_version 1546900 (0.0011) [2023-12-28 06:22:43,273][106225] Updated weights for policy 1, policy_version 1550618 (0.0007) [2023-12-28 06:22:43,345][106225] Updated weights for policy 1, policy_version 1550628 (0.0006) [2023-12-28 06:22:43,404][106225] Updated weights for policy 1, policy_version 1550638 (0.0010) [2023-12-28 06:22:43,459][106225] Updated weights for policy 1, policy_version 1550648 (0.0005) [2023-12-28 06:22:43,519][106226] Updated weights for policy 0, policy_version 1546910 (0.0008) [2023-12-28 06:22:43,586][106226] Updated weights for policy 0, policy_version 1546920 (0.0005) [2023-12-28 06:22:43,651][106226] Updated weights for policy 0, policy_version 1546930 (0.0005) [2023-12-28 06:22:44,090][106225] Updated weights for policy 1, policy_version 1550658 (0.0010) [2023-12-28 06:22:44,133][106226] Updated weights for policy 0, policy_version 1546940 (0.0006) [2023-12-28 06:22:44,146][106225] Updated weights for policy 1, policy_version 1550668 (0.0010) [2023-12-28 06:22:44,194][106226] Updated weights for policy 0, policy_version 1546950 (0.0005) [2023-12-28 06:22:44,200][106225] Updated weights for policy 1, policy_version 1550678 (0.0010) [2023-12-28 06:22:44,255][106226] Updated weights for policy 0, policy_version 1546960 (0.0007) [2023-12-28 06:22:44,915][106226] Updated weights for policy 0, policy_version 1546970 (0.0007) [2023-12-28 06:22:44,944][106225] Updated weights for policy 1, policy_version 1550688 (0.0011) [2023-12-28 06:22:44,977][106226] Updated weights for policy 0, policy_version 1546980 (0.0006) [2023-12-28 06:22:45,003][106225] Updated weights for policy 1, policy_version 1550698 (0.0010) [2023-12-28 06:22:45,034][106226] Updated weights for policy 0, policy_version 1546990 (0.0006) [2023-12-28 06:22:45,058][106225] Updated weights for policy 1, policy_version 1550708 (0.0010) [2023-12-28 06:22:45,088][106226] Updated weights for policy 0, policy_version 1547000 (0.0008) [2023-12-28 06:22:45,760][106225] Updated weights for policy 1, policy_version 1550718 (0.0007) [2023-12-28 06:22:45,828][106225] Updated weights for policy 1, policy_version 1550728 (0.0005) [2023-12-28 06:22:45,833][106226] Updated weights for policy 0, policy_version 1547010 (0.0005) [2023-12-28 06:22:45,887][106225] Updated weights for policy 1, policy_version 1550738 (0.0009) [2023-12-28 06:22:45,894][106226] Updated weights for policy 0, policy_version 1547020 (0.0005) [2023-12-28 06:22:45,961][106226] Updated weights for policy 0, policy_version 1547030 (0.0005) [2023-12-28 06:22:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19910.7). Total num frames: 793157632. Throughput: 0: 10202.6, 1: 9966.0. Samples: 793144608. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:46,175][105115] Avg episode reward: [(0, '-4.914'), (1, '-4.760')] [2023-12-28 06:22:46,520][106225] Updated weights for policy 1, policy_version 1550748 (0.0008) [2023-12-28 06:22:46,561][106226] Updated weights for policy 0, policy_version 1547040 (0.0005) [2023-12-28 06:22:46,582][106225] Updated weights for policy 1, policy_version 1550758 (0.0006) [2023-12-28 06:22:46,625][106226] Updated weights for policy 0, policy_version 1547050 (0.0005) [2023-12-28 06:22:46,639][106225] Updated weights for policy 1, policy_version 1550768 (0.0009) [2023-12-28 06:22:46,687][106226] Updated weights for policy 0, policy_version 1547060 (0.0006) [2023-12-28 06:22:47,310][106225] Updated weights for policy 1, policy_version 1550778 (0.0010) [2023-12-28 06:22:47,370][106225] Updated weights for policy 1, policy_version 1550788 (0.0009) [2023-12-28 06:22:47,380][106226] Updated weights for policy 0, policy_version 1547070 (0.0007) [2023-12-28 06:22:47,430][106225] Updated weights for policy 1, policy_version 1550798 (0.0006) [2023-12-28 06:22:47,443][106226] Updated weights for policy 0, policy_version 1547080 (0.0007) [2023-12-28 06:22:47,483][106225] Updated weights for policy 1, policy_version 1550808 (0.0006) [2023-12-28 06:22:47,509][106226] Updated weights for policy 0, policy_version 1547090 (0.0008) [2023-12-28 06:22:48,205][106226] Updated weights for policy 0, policy_version 1547100 (0.0008) [2023-12-28 06:22:48,258][106226] Updated weights for policy 0, policy_version 1547110 (0.0005) [2023-12-28 06:22:48,289][106225] Updated weights for policy 1, policy_version 1550818 (0.0008) [2023-12-28 06:22:48,309][106226] Updated weights for policy 0, policy_version 1547120 (0.0005) [2023-12-28 06:22:48,359][106225] Updated weights for policy 1, policy_version 1550828 (0.0008) [2023-12-28 06:22:48,430][106225] Updated weights for policy 1, policy_version 1550838 (0.0008) [2023-12-28 06:22:49,023][106226] Updated weights for policy 0, policy_version 1547130 (0.0008) [2023-12-28 06:22:49,088][106226] Updated weights for policy 0, policy_version 1547140 (0.0005) [2023-12-28 06:22:49,113][106225] Updated weights for policy 1, policy_version 1550848 (0.0007) [2023-12-28 06:22:49,142][106226] Updated weights for policy 0, policy_version 1547150 (0.0007) [2023-12-28 06:22:49,171][106225] Updated weights for policy 1, policy_version 1550858 (0.0005) [2023-12-28 06:22:49,193][106226] Updated weights for policy 0, policy_version 1547160 (0.0006) [2023-12-28 06:22:49,222][106225] Updated weights for policy 1, policy_version 1550868 (0.0007) [2023-12-28 06:22:49,896][106226] Updated weights for policy 0, policy_version 1547170 (0.0009) [2023-12-28 06:22:49,969][106226] Updated weights for policy 0, policy_version 1547180 (0.0009) [2023-12-28 06:22:50,035][106226] Updated weights for policy 0, policy_version 1547190 (0.0009) [2023-12-28 06:22:50,041][106225] Updated weights for policy 1, policy_version 1550878 (0.0007) [2023-12-28 06:22:50,101][106225] Updated weights for policy 1, policy_version 1550888 (0.0008) [2023-12-28 06:22:50,154][106225] Updated weights for policy 1, policy_version 1550898 (0.0008) [2023-12-28 06:22:50,807][106226] Updated weights for policy 0, policy_version 1547200 (0.0008) [2023-12-28 06:22:50,861][106226] Updated weights for policy 0, policy_version 1547210 (0.0008) [2023-12-28 06:22:50,883][106225] Updated weights for policy 1, policy_version 1550908 (0.0010) [2023-12-28 06:22:50,924][106226] Updated weights for policy 0, policy_version 1547220 (0.0005) [2023-12-28 06:22:50,944][106225] Updated weights for policy 1, policy_version 1550918 (0.0010) [2023-12-28 06:22:51,006][106225] Updated weights for policy 1, policy_version 1550928 (0.0010) [2023-12-28 06:22:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20207.0, 300 sec: 19938.5). Total num frames: 793255936. Throughput: 0: 10141.6, 1: 9848.9. Samples: 793261344. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:51,175][105115] Avg episode reward: [(0, '-4.848'), (1, '-4.674')] [2023-12-28 06:22:51,711][106226] Updated weights for policy 0, policy_version 1547230 (0.0008) [2023-12-28 06:22:51,766][106225] Updated weights for policy 1, policy_version 1550938 (0.0010) [2023-12-28 06:22:51,777][106226] Updated weights for policy 0, policy_version 1547240 (0.0007) [2023-12-28 06:22:51,830][106225] Updated weights for policy 1, policy_version 1550948 (0.0008) [2023-12-28 06:22:51,839][106226] Updated weights for policy 0, policy_version 1547250 (0.0006) [2023-12-28 06:22:51,896][106225] Updated weights for policy 1, policy_version 1550958 (0.0009) [2023-12-28 06:22:51,949][106225] Updated weights for policy 1, policy_version 1550968 (0.0009) [2023-12-28 06:22:52,469][106226] Updated weights for policy 0, policy_version 1547260 (0.0007) [2023-12-28 06:22:52,521][106226] Updated weights for policy 0, policy_version 1547270 (0.0008) [2023-12-28 06:22:52,575][106226] Updated weights for policy 0, policy_version 1547280 (0.0008) [2023-12-28 06:22:52,618][106225] Updated weights for policy 1, policy_version 1550978 (0.0008) [2023-12-28 06:22:52,681][106225] Updated weights for policy 1, policy_version 1550988 (0.0005) [2023-12-28 06:22:52,746][106225] Updated weights for policy 1, policy_version 1550998 (0.0006) [2023-12-28 06:22:53,254][106226] Updated weights for policy 0, policy_version 1547290 (0.0006) [2023-12-28 06:22:53,303][106226] Updated weights for policy 0, policy_version 1547300 (0.0008) [2023-12-28 06:22:53,350][106226] Updated weights for policy 0, policy_version 1547310 (0.0009) [2023-12-28 06:22:53,406][106226] Updated weights for policy 0, policy_version 1547320 (0.0008) [2023-12-28 06:22:53,458][106225] Updated weights for policy 1, policy_version 1551008 (0.0009) [2023-12-28 06:22:53,520][106225] Updated weights for policy 1, policy_version 1551018 (0.0008) [2023-12-28 06:22:53,580][106225] Updated weights for policy 1, policy_version 1551028 (0.0008) [2023-12-28 06:22:54,051][106226] Updated weights for policy 0, policy_version 1547330 (0.0005) [2023-12-28 06:22:54,097][106226] Updated weights for policy 0, policy_version 1547340 (0.0005) [2023-12-28 06:22:54,153][106226] Updated weights for policy 0, policy_version 1547350 (0.0005) [2023-12-28 06:22:54,272][106225] Updated weights for policy 1, policy_version 1551038 (0.0009) [2023-12-28 06:22:54,329][106225] Updated weights for policy 1, policy_version 1551048 (0.0007) [2023-12-28 06:22:54,382][106225] Updated weights for policy 1, policy_version 1551058 (0.0008) [2023-12-28 06:22:54,740][106226] Updated weights for policy 0, policy_version 1547360 (0.0009) [2023-12-28 06:22:54,816][106226] Updated weights for policy 0, policy_version 1547370 (0.0008) [2023-12-28 06:22:54,884][106226] Updated weights for policy 0, policy_version 1547380 (0.0009) [2023-12-28 06:22:55,072][106225] Updated weights for policy 1, policy_version 1551068 (0.0010) [2023-12-28 06:22:55,122][106225] Updated weights for policy 1, policy_version 1551078 (0.0009) [2023-12-28 06:22:55,167][106225] Updated weights for policy 1, policy_version 1551088 (0.0008) [2023-12-28 06:22:55,495][106226] Updated weights for policy 0, policy_version 1547390 (0.0008) [2023-12-28 06:22:55,539][106226] Updated weights for policy 0, policy_version 1547400 (0.0008) [2023-12-28 06:22:55,590][106226] Updated weights for policy 0, policy_version 1547410 (0.0009) [2023-12-28 06:22:55,951][106225] Updated weights for policy 1, policy_version 1551098 (0.0009) [2023-12-28 06:22:56,006][106225] Updated weights for policy 1, policy_version 1551108 (0.0008) [2023-12-28 06:22:56,054][106225] Updated weights for policy 1, policy_version 1551118 (0.0008) [2023-12-28 06:22:56,109][106225] Updated weights for policy 1, policy_version 1551128 (0.0009) [2023-12-28 06:22:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 793354240. Throughput: 0: 10166.8, 1: 9854.3. Samples: 793320720. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:22:56,176][105115] Avg episode reward: [(0, '-5.022'), (1, '-4.747')] [2023-12-28 06:22:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001547416_396214272.pth... [2023-12-28 06:22:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001551128_397139968.pth... [2023-12-28 06:22:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001546232_395911168.pth [2023-12-28 06:22:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001549976_396845056.pth [2023-12-28 06:22:56,280][106226] Updated weights for policy 0, policy_version 1547420 (0.0008) [2023-12-28 06:22:56,328][106226] Updated weights for policy 0, policy_version 1547430 (0.0007) [2023-12-28 06:22:56,391][106226] Updated weights for policy 0, policy_version 1547440 (0.0005) [2023-12-28 06:22:56,913][106225] Updated weights for policy 1, policy_version 1551138 (0.0008) [2023-12-28 06:22:56,960][106225] Updated weights for policy 1, policy_version 1551148 (0.0008) [2023-12-28 06:22:56,982][106226] Updated weights for policy 0, policy_version 1547450 (0.0006) [2023-12-28 06:22:57,015][106225] Updated weights for policy 1, policy_version 1551158 (0.0006) [2023-12-28 06:22:57,039][106226] Updated weights for policy 0, policy_version 1547460 (0.0008) [2023-12-28 06:22:57,097][106226] Updated weights for policy 0, policy_version 1547470 (0.0008) [2023-12-28 06:22:57,159][106226] Updated weights for policy 0, policy_version 1547480 (0.0009) [2023-12-28 06:22:57,680][106225] Updated weights for policy 1, policy_version 1551168 (0.0009) [2023-12-28 06:22:57,746][106225] Updated weights for policy 1, policy_version 1551178 (0.0008) [2023-12-28 06:22:57,807][106225] Updated weights for policy 1, policy_version 1551188 (0.0009) [2023-12-28 06:22:57,894][106226] Updated weights for policy 0, policy_version 1547490 (0.0008) [2023-12-28 06:22:57,937][106226] Updated weights for policy 0, policy_version 1547500 (0.0008) [2023-12-28 06:22:57,991][106226] Updated weights for policy 0, policy_version 1547510 (0.0009) [2023-12-28 06:22:58,543][106225] Updated weights for policy 1, policy_version 1551198 (0.0008) [2023-12-28 06:22:58,605][106225] Updated weights for policy 1, policy_version 1551208 (0.0007) [2023-12-28 06:22:58,669][106225] Updated weights for policy 1, policy_version 1551218 (0.0009) [2023-12-28 06:22:58,754][106226] Updated weights for policy 0, policy_version 1547520 (0.0008) [2023-12-28 06:22:58,822][106226] Updated weights for policy 0, policy_version 1547530 (0.0007) [2023-12-28 06:22:58,891][106226] Updated weights for policy 0, policy_version 1547540 (0.0008) [2023-12-28 06:22:59,463][106225] Updated weights for policy 1, policy_version 1551228 (0.0011) [2023-12-28 06:22:59,509][106225] Updated weights for policy 1, policy_version 1551238 (0.0009) [2023-12-28 06:22:59,555][106225] Updated weights for policy 1, policy_version 1551248 (0.0010) [2023-12-28 06:22:59,642][106226] Updated weights for policy 0, policy_version 1547550 (0.0008) [2023-12-28 06:22:59,705][106226] Updated weights for policy 0, policy_version 1547560 (0.0006) [2023-12-28 06:22:59,762][106226] Updated weights for policy 0, policy_version 1547570 (0.0006) [2023-12-28 06:23:00,245][106225] Updated weights for policy 1, policy_version 1551258 (0.0010) [2023-12-28 06:23:00,291][106225] Updated weights for policy 1, policy_version 1551268 (0.0010) [2023-12-28 06:23:00,349][106225] Updated weights for policy 1, policy_version 1551278 (0.0010) [2023-12-28 06:23:00,404][106225] Updated weights for policy 1, policy_version 1551288 (0.0011) [2023-12-28 06:23:00,494][106226] Updated weights for policy 0, policy_version 1547580 (0.0008) [2023-12-28 06:23:00,551][106226] Updated weights for policy 0, policy_version 1547590 (0.0007) [2023-12-28 06:23:00,607][106226] Updated weights for policy 0, policy_version 1547600 (0.0009) [2023-12-28 06:23:01,069][106225] Updated weights for policy 1, policy_version 1551298 (0.0008) [2023-12-28 06:23:01,142][106225] Updated weights for policy 1, policy_version 1551308 (0.0009) [2023-12-28 06:23:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 793444352. Throughput: 0: 10151.2, 1: 9849.3. Samples: 793438924. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:01,175][105115] Avg episode reward: [(0, '-4.722'), (1, '-4.863')] [2023-12-28 06:23:01,208][106225] Updated weights for policy 1, policy_version 1551318 (0.0009) [2023-12-28 06:23:01,363][106226] Updated weights for policy 0, policy_version 1547610 (0.0009) [2023-12-28 06:23:01,425][106226] Updated weights for policy 0, policy_version 1547620 (0.0007) [2023-12-28 06:23:01,495][106226] Updated weights for policy 0, policy_version 1547630 (0.0006) [2023-12-28 06:23:01,557][106226] Updated weights for policy 0, policy_version 1547640 (0.0007) [2023-12-28 06:23:01,911][106225] Updated weights for policy 1, policy_version 1551328 (0.0008) [2023-12-28 06:23:01,964][106225] Updated weights for policy 1, policy_version 1551338 (0.0007) [2023-12-28 06:23:02,021][106225] Updated weights for policy 1, policy_version 1551348 (0.0006) [2023-12-28 06:23:02,291][106226] Updated weights for policy 0, policy_version 1547650 (0.0008) [2023-12-28 06:23:02,359][106226] Updated weights for policy 0, policy_version 1547660 (0.0008) [2023-12-28 06:23:02,426][106226] Updated weights for policy 0, policy_version 1547671 (0.0010) [2023-12-28 06:23:02,676][106225] Updated weights for policy 1, policy_version 1551358 (0.0008) [2023-12-28 06:23:02,734][106225] Updated weights for policy 1, policy_version 1551368 (0.0010) [2023-12-28 06:23:02,792][106225] Updated weights for policy 1, policy_version 1551378 (0.0010) [2023-12-28 06:23:03,199][106226] Updated weights for policy 0, policy_version 1547681 (0.0008) [2023-12-28 06:23:03,248][106226] Updated weights for policy 0, policy_version 1547691 (0.0010) [2023-12-28 06:23:03,302][106226] Updated weights for policy 0, policy_version 1547701 (0.0009) [2023-12-28 06:23:03,356][106225] Updated weights for policy 1, policy_version 1551388 (0.0010) [2023-12-28 06:23:03,403][106225] Updated weights for policy 1, policy_version 1551398 (0.0010) [2023-12-28 06:23:03,454][106225] Updated weights for policy 1, policy_version 1551408 (0.0005) [2023-12-28 06:23:04,088][106226] Updated weights for policy 0, policy_version 1547711 (0.0008) [2023-12-28 06:23:04,109][106225] Updated weights for policy 1, policy_version 1551418 (0.0006) [2023-12-28 06:23:04,155][106226] Updated weights for policy 0, policy_version 1547721 (0.0006) [2023-12-28 06:23:04,168][106225] Updated weights for policy 1, policy_version 1551428 (0.0010) [2023-12-28 06:23:04,220][106226] Updated weights for policy 0, policy_version 1547731 (0.0006) [2023-12-28 06:23:04,227][106225] Updated weights for policy 1, policy_version 1551438 (0.0010) [2023-12-28 06:23:04,289][106225] Updated weights for policy 1, policy_version 1551448 (0.0006) [2023-12-28 06:23:04,936][106226] Updated weights for policy 0, policy_version 1547741 (0.0006) [2023-12-28 06:23:04,940][106225] Updated weights for policy 1, policy_version 1551458 (0.0010) [2023-12-28 06:23:04,987][106225] Updated weights for policy 1, policy_version 1551468 (0.0010) [2023-12-28 06:23:04,994][106226] Updated weights for policy 0, policy_version 1547751 (0.0005) [2023-12-28 06:23:05,047][106225] Updated weights for policy 1, policy_version 1551478 (0.0010) [2023-12-28 06:23:05,057][106226] Updated weights for policy 0, policy_version 1547761 (0.0005) [2023-12-28 06:23:05,709][106226] Updated weights for policy 0, policy_version 1547771 (0.0010) [2023-12-28 06:23:05,773][106226] Updated weights for policy 0, policy_version 1547781 (0.0010) [2023-12-28 06:23:05,776][106225] Updated weights for policy 1, policy_version 1551488 (0.0010) [2023-12-28 06:23:05,827][106226] Updated weights for policy 0, policy_version 1547791 (0.0010) [2023-12-28 06:23:05,834][106225] Updated weights for policy 1, policy_version 1551498 (0.0010) [2023-12-28 06:23:05,902][106225] Updated weights for policy 1, policy_version 1551508 (0.0010) [2023-12-28 06:23:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 793550848. Throughput: 0: 10069.8, 1: 9933.2. Samples: 793558324. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:06,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-4.544')] [2023-12-28 06:23:06,556][106226] Updated weights for policy 0, policy_version 1547801 (0.0010) [2023-12-28 06:23:06,603][106225] Updated weights for policy 1, policy_version 1551518 (0.0010) [2023-12-28 06:23:06,624][106226] Updated weights for policy 0, policy_version 1547811 (0.0011) [2023-12-28 06:23:06,664][106225] Updated weights for policy 1, policy_version 1551528 (0.0010) [2023-12-28 06:23:06,680][106226] Updated weights for policy 0, policy_version 1547821 (0.0011) [2023-12-28 06:23:06,726][106225] Updated weights for policy 1, policy_version 1551538 (0.0010) [2023-12-28 06:23:06,738][106226] Updated weights for policy 0, policy_version 1547831 (0.0010) [2023-12-28 06:23:07,390][106225] Updated weights for policy 1, policy_version 1551548 (0.0010) [2023-12-28 06:23:07,437][106226] Updated weights for policy 0, policy_version 1547841 (0.0011) [2023-12-28 06:23:07,452][106225] Updated weights for policy 1, policy_version 1551558 (0.0011) [2023-12-28 06:23:07,487][106226] Updated weights for policy 0, policy_version 1547851 (0.0010) [2023-12-28 06:23:07,510][106225] Updated weights for policy 1, policy_version 1551568 (0.0010) [2023-12-28 06:23:07,545][106226] Updated weights for policy 0, policy_version 1547861 (0.0011) [2023-12-28 06:23:08,114][106225] Updated weights for policy 1, policy_version 1551578 (0.0010) [2023-12-28 06:23:08,164][106225] Updated weights for policy 1, policy_version 1551588 (0.0007) [2023-12-28 06:23:08,216][106225] Updated weights for policy 1, policy_version 1551598 (0.0008) [2023-12-28 06:23:08,268][106225] Updated weights for policy 1, policy_version 1551608 (0.0008) [2023-12-28 06:23:08,314][106226] Updated weights for policy 0, policy_version 1547871 (0.0010) [2023-12-28 06:23:08,386][106226] Updated weights for policy 0, policy_version 1547881 (0.0007) [2023-12-28 06:23:08,447][106226] Updated weights for policy 0, policy_version 1547891 (0.0006) [2023-12-28 06:23:08,920][106225] Updated weights for policy 1, policy_version 1551618 (0.0005) [2023-12-28 06:23:08,985][106225] Updated weights for policy 1, policy_version 1551628 (0.0006) [2023-12-28 06:23:09,046][106225] Updated weights for policy 1, policy_version 1551638 (0.0008) [2023-12-28 06:23:09,206][106226] Updated weights for policy 0, policy_version 1547901 (0.0007) [2023-12-28 06:23:09,271][106226] Updated weights for policy 0, policy_version 1547911 (0.0009) [2023-12-28 06:23:09,340][106226] Updated weights for policy 0, policy_version 1547921 (0.0009) [2023-12-28 06:23:09,765][106225] Updated weights for policy 1, policy_version 1551648 (0.0009) [2023-12-28 06:23:09,817][106225] Updated weights for policy 1, policy_version 1551658 (0.0008) [2023-12-28 06:23:09,885][106225] Updated weights for policy 1, policy_version 1551668 (0.0007) [2023-12-28 06:23:10,122][106226] Updated weights for policy 0, policy_version 1547931 (0.0009) [2023-12-28 06:23:10,175][106226] Updated weights for policy 0, policy_version 1547941 (0.0008) [2023-12-28 06:23:10,238][106226] Updated weights for policy 0, policy_version 1547951 (0.0010) [2023-12-28 06:23:10,488][106225] Updated weights for policy 1, policy_version 1551678 (0.0007) [2023-12-28 06:23:10,548][106225] Updated weights for policy 1, policy_version 1551688 (0.0009) [2023-12-28 06:23:10,610][106225] Updated weights for policy 1, policy_version 1551698 (0.0006) [2023-12-28 06:23:11,031][106226] Updated weights for policy 0, policy_version 1547961 (0.0010) [2023-12-28 06:23:11,095][106226] Updated weights for policy 0, policy_version 1547971 (0.0008) [2023-12-28 06:23:11,172][106226] Updated weights for policy 0, policy_version 1547981 (0.0007) [2023-12-28 06:23:11,178][105115] Fps is (10 sec: 19653.8, 60 sec: 19932.7, 300 sec: 19882.7). Total num frames: 793640960. Throughput: 0: 10069.1, 1: 9960.6. Samples: 793617344. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:11,179][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.552')] [2023-12-28 06:23:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001551704_397287424.pth... [2023-12-28 06:23:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001550552_396992512.pth [2023-12-28 06:23:11,239][106226] Updated weights for policy 0, policy_version 1547991 (0.0008) [2023-12-28 06:23:11,244][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001547992_396361728.pth... [2023-12-28 06:23:11,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001546840_396066816.pth [2023-12-28 06:23:11,347][106225] Updated weights for policy 1, policy_version 1551708 (0.0008) [2023-12-28 06:23:11,416][106225] Updated weights for policy 1, policy_version 1551718 (0.0008) [2023-12-28 06:23:11,469][106225] Updated weights for policy 1, policy_version 1551728 (0.0008) [2023-12-28 06:23:12,026][106226] Updated weights for policy 0, policy_version 1548001 (0.0009) [2023-12-28 06:23:12,087][106226] Updated weights for policy 0, policy_version 1548011 (0.0009) [2023-12-28 06:23:12,149][106226] Updated weights for policy 0, policy_version 1548021 (0.0008) [2023-12-28 06:23:12,234][106225] Updated weights for policy 1, policy_version 1551738 (0.0008) [2023-12-28 06:23:12,297][106225] Updated weights for policy 1, policy_version 1551748 (0.0008) [2023-12-28 06:23:12,364][106225] Updated weights for policy 1, policy_version 1551758 (0.0009) [2023-12-28 06:23:12,428][106225] Updated weights for policy 1, policy_version 1551768 (0.0008) [2023-12-28 06:23:12,840][106226] Updated weights for policy 0, policy_version 1548031 (0.0007) [2023-12-28 06:23:12,898][106226] Updated weights for policy 0, policy_version 1548041 (0.0005) [2023-12-28 06:23:12,964][106226] Updated weights for policy 0, policy_version 1548051 (0.0005) [2023-12-28 06:23:13,151][106225] Updated weights for policy 1, policy_version 1551778 (0.0010) [2023-12-28 06:23:13,203][106225] Updated weights for policy 1, policy_version 1551788 (0.0005) [2023-12-28 06:23:13,261][106225] Updated weights for policy 1, policy_version 1551798 (0.0005) [2023-12-28 06:23:13,542][106226] Updated weights for policy 0, policy_version 1548061 (0.0007) [2023-12-28 06:23:13,607][106226] Updated weights for policy 0, policy_version 1548071 (0.0005) [2023-12-28 06:23:13,664][106226] Updated weights for policy 0, policy_version 1548081 (0.0006) [2023-12-28 06:23:13,809][106225] Updated weights for policy 1, policy_version 1551808 (0.0005) [2023-12-28 06:23:13,874][106225] Updated weights for policy 1, policy_version 1551818 (0.0005) [2023-12-28 06:23:13,931][106225] Updated weights for policy 1, policy_version 1551828 (0.0006) [2023-12-28 06:23:14,285][106226] Updated weights for policy 0, policy_version 1548091 (0.0008) [2023-12-28 06:23:14,335][106226] Updated weights for policy 0, policy_version 1548101 (0.0010) [2023-12-28 06:23:14,387][106226] Updated weights for policy 0, policy_version 1548111 (0.0010) [2023-12-28 06:23:14,527][106225] Updated weights for policy 1, policy_version 1551838 (0.0008) [2023-12-28 06:23:14,589][106225] Updated weights for policy 1, policy_version 1551848 (0.0010) [2023-12-28 06:23:14,645][106225] Updated weights for policy 1, policy_version 1551858 (0.0010) [2023-12-28 06:23:15,089][106226] Updated weights for policy 0, policy_version 1548121 (0.0010) [2023-12-28 06:23:15,157][106226] Updated weights for policy 0, policy_version 1548131 (0.0011) [2023-12-28 06:23:15,215][106226] Updated weights for policy 0, policy_version 1548141 (0.0011) [2023-12-28 06:23:15,280][106226] Updated weights for policy 0, policy_version 1548151 (0.0011) [2023-12-28 06:23:15,405][106225] Updated weights for policy 1, policy_version 1551868 (0.0010) [2023-12-28 06:23:15,464][106225] Updated weights for policy 1, policy_version 1551878 (0.0010) [2023-12-28 06:23:15,513][106225] Updated weights for policy 1, policy_version 1551888 (0.0010) [2023-12-28 06:23:15,966][106226] Updated weights for policy 0, policy_version 1548161 (0.0010) [2023-12-28 06:23:16,030][106226] Updated weights for policy 0, policy_version 1548171 (0.0011) [2023-12-28 06:23:16,084][106226] Updated weights for policy 0, policy_version 1548181 (0.0010) [2023-12-28 06:23:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 793747456. Throughput: 0: 9896.2, 1: 9981.1. Samples: 793736360. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:16,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-4.363')] [2023-12-28 06:23:16,230][106225] Updated weights for policy 1, policy_version 1551898 (0.0010) [2023-12-28 06:23:16,293][106225] Updated weights for policy 1, policy_version 1551908 (0.0010) [2023-12-28 06:23:16,352][106225] Updated weights for policy 1, policy_version 1551918 (0.0010) [2023-12-28 06:23:16,413][106225] Updated weights for policy 1, policy_version 1551928 (0.0010) [2023-12-28 06:23:16,773][106226] Updated weights for policy 0, policy_version 1548191 (0.0010) [2023-12-28 06:23:16,822][106226] Updated weights for policy 0, policy_version 1548201 (0.0009) [2023-12-28 06:23:16,875][106226] Updated weights for policy 0, policy_version 1548211 (0.0010) [2023-12-28 06:23:16,986][106225] Updated weights for policy 1, policy_version 1551938 (0.0005) [2023-12-28 06:23:17,044][106225] Updated weights for policy 1, policy_version 1551948 (0.0005) [2023-12-28 06:23:17,104][106225] Updated weights for policy 1, policy_version 1551958 (0.0005) [2023-12-28 06:23:17,501][106226] Updated weights for policy 0, policy_version 1548221 (0.0011) [2023-12-28 06:23:17,559][106226] Updated weights for policy 0, policy_version 1548231 (0.0010) [2023-12-28 06:23:17,622][106226] Updated weights for policy 0, policy_version 1548241 (0.0009) [2023-12-28 06:23:17,651][106225] Updated weights for policy 1, policy_version 1551968 (0.0007) [2023-12-28 06:23:17,709][106225] Updated weights for policy 1, policy_version 1551978 (0.0007) [2023-12-28 06:23:17,775][106225] Updated weights for policy 1, policy_version 1551988 (0.0009) [2023-12-28 06:23:18,324][106226] Updated weights for policy 0, policy_version 1548251 (0.0011) [2023-12-28 06:23:18,390][106226] Updated weights for policy 0, policy_version 1548261 (0.0010) [2023-12-28 06:23:18,456][106226] Updated weights for policy 0, policy_version 1548271 (0.0011) [2023-12-28 06:23:18,530][106225] Updated weights for policy 1, policy_version 1551998 (0.0008) [2023-12-28 06:23:18,584][106225] Updated weights for policy 1, policy_version 1552008 (0.0008) [2023-12-28 06:23:18,632][106225] Updated weights for policy 1, policy_version 1552018 (0.0008) [2023-12-28 06:23:19,156][106226] Updated weights for policy 0, policy_version 1548281 (0.0009) [2023-12-28 06:23:19,206][106226] Updated weights for policy 0, policy_version 1548291 (0.0010) [2023-12-28 06:23:19,270][106226] Updated weights for policy 0, policy_version 1548301 (0.0010) [2023-12-28 06:23:19,335][106226] Updated weights for policy 0, policy_version 1548311 (0.0011) [2023-12-28 06:23:19,395][106225] Updated weights for policy 1, policy_version 1552028 (0.0008) [2023-12-28 06:23:19,454][106225] Updated weights for policy 1, policy_version 1552038 (0.0008) [2023-12-28 06:23:19,519][106225] Updated weights for policy 1, policy_version 1552048 (0.0008) [2023-12-28 06:23:20,131][106226] Updated weights for policy 0, policy_version 1548321 (0.0011) [2023-12-28 06:23:20,185][106226] Updated weights for policy 0, policy_version 1548331 (0.0011) [2023-12-28 06:23:20,253][106226] Updated weights for policy 0, policy_version 1548341 (0.0011) [2023-12-28 06:23:20,282][106225] Updated weights for policy 1, policy_version 1552058 (0.0008) [2023-12-28 06:23:20,339][106225] Updated weights for policy 1, policy_version 1552068 (0.0005) [2023-12-28 06:23:20,395][106225] Updated weights for policy 1, policy_version 1552078 (0.0006) [2023-12-28 06:23:20,457][106225] Updated weights for policy 1, policy_version 1552088 (0.0005) [2023-12-28 06:23:20,963][106226] Updated weights for policy 0, policy_version 1548351 (0.0007) [2023-12-28 06:23:21,015][106226] Updated weights for policy 0, policy_version 1548361 (0.0006) [2023-12-28 06:23:21,086][106226] Updated weights for policy 0, policy_version 1548371 (0.0009) [2023-12-28 06:23:21,175][105115] Fps is (10 sec: 20487.1, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 793845760. Throughput: 0: 9848.5, 1: 9916.3. Samples: 793855760. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:21,175][105115] Avg episode reward: [(0, '-4.687'), (1, '-4.992')] [2023-12-28 06:23:21,187][106225] Updated weights for policy 1, policy_version 1552098 (0.0009) [2023-12-28 06:23:21,257][106225] Updated weights for policy 1, policy_version 1552108 (0.0007) [2023-12-28 06:23:21,326][106225] Updated weights for policy 1, policy_version 1552118 (0.0007) [2023-12-28 06:23:21,791][106226] Updated weights for policy 0, policy_version 1548381 (0.0010) [2023-12-28 06:23:21,854][106226] Updated weights for policy 0, policy_version 1548391 (0.0011) [2023-12-28 06:23:21,909][106226] Updated weights for policy 0, policy_version 1548401 (0.0011) [2023-12-28 06:23:22,096][106225] Updated weights for policy 1, policy_version 1552128 (0.0007) [2023-12-28 06:23:22,165][106225] Updated weights for policy 1, policy_version 1552138 (0.0008) [2023-12-28 06:23:22,236][106225] Updated weights for policy 1, policy_version 1552148 (0.0008) [2023-12-28 06:23:22,640][106226] Updated weights for policy 0, policy_version 1548411 (0.0010) [2023-12-28 06:23:22,703][106226] Updated weights for policy 0, policy_version 1548421 (0.0006) [2023-12-28 06:23:22,765][106226] Updated weights for policy 0, policy_version 1548431 (0.0007) [2023-12-28 06:23:23,000][106225] Updated weights for policy 1, policy_version 1552158 (0.0009) [2023-12-28 06:23:23,061][106225] Updated weights for policy 1, policy_version 1552168 (0.0007) [2023-12-28 06:23:23,122][106225] Updated weights for policy 1, policy_version 1552178 (0.0006) [2023-12-28 06:23:23,349][106226] Updated weights for policy 0, policy_version 1548441 (0.0008) [2023-12-28 06:23:23,405][106226] Updated weights for policy 0, policy_version 1548451 (0.0010) [2023-12-28 06:23:23,469][106226] Updated weights for policy 0, policy_version 1548461 (0.0007) [2023-12-28 06:23:23,535][106226] Updated weights for policy 0, policy_version 1548471 (0.0011) [2023-12-28 06:23:23,729][106225] Updated weights for policy 1, policy_version 1552188 (0.0005) [2023-12-28 06:23:23,797][106225] Updated weights for policy 1, policy_version 1552198 (0.0005) [2023-12-28 06:23:23,851][106225] Updated weights for policy 1, policy_version 1552208 (0.0005) [2023-12-28 06:23:24,147][106226] Updated weights for policy 0, policy_version 1548481 (0.0011) [2023-12-28 06:23:24,209][106226] Updated weights for policy 0, policy_version 1548491 (0.0011) [2023-12-28 06:23:24,259][106226] Updated weights for policy 0, policy_version 1548501 (0.0010) [2023-12-28 06:23:24,424][106225] Updated weights for policy 1, policy_version 1552218 (0.0006) [2023-12-28 06:23:24,484][106225] Updated weights for policy 1, policy_version 1552228 (0.0010) [2023-12-28 06:23:24,538][106225] Updated weights for policy 1, policy_version 1552238 (0.0010) [2023-12-28 06:23:24,592][106225] Updated weights for policy 1, policy_version 1552248 (0.0010) [2023-12-28 06:23:24,881][106226] Updated weights for policy 0, policy_version 1548511 (0.0007) [2023-12-28 06:23:24,936][106226] Updated weights for policy 0, policy_version 1548521 (0.0006) [2023-12-28 06:23:24,988][106226] Updated weights for policy 0, policy_version 1548531 (0.0010) [2023-12-28 06:23:25,291][106225] Updated weights for policy 1, policy_version 1552258 (0.0007) [2023-12-28 06:23:25,351][106225] Updated weights for policy 1, policy_version 1552268 (0.0005) [2023-12-28 06:23:25,412][106225] Updated weights for policy 1, policy_version 1552278 (0.0010) [2023-12-28 06:23:25,673][106226] Updated weights for policy 0, policy_version 1548541 (0.0010) [2023-12-28 06:23:25,722][106226] Updated weights for policy 0, policy_version 1548551 (0.0010) [2023-12-28 06:23:25,773][106226] Updated weights for policy 0, policy_version 1548561 (0.0011) [2023-12-28 06:23:26,081][106225] Updated weights for policy 1, policy_version 1552288 (0.0010) [2023-12-28 06:23:26,141][106225] Updated weights for policy 1, policy_version 1552298 (0.0010) [2023-12-28 06:23:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 793944064. Throughput: 0: 9879.0, 1: 9871.6. Samples: 793915280. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:26,175][105115] Avg episode reward: [(0, '-4.783'), (1, '-4.796')] [2023-12-28 06:23:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001548568_396509184.pth... [2023-12-28 06:23:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001547416_396214272.pth [2023-12-28 06:23:26,188][106225] Updated weights for policy 1, policy_version 1552308 (0.0010) [2023-12-28 06:23:26,205][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001552312_397443072.pth... [2023-12-28 06:23:26,208][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001551128_397139968.pth [2023-12-28 06:23:26,473][106226] Updated weights for policy 0, policy_version 1548571 (0.0010) [2023-12-28 06:23:26,535][106226] Updated weights for policy 0, policy_version 1548581 (0.0010) [2023-12-28 06:23:26,592][106226] Updated weights for policy 0, policy_version 1548591 (0.0010) [2023-12-28 06:23:26,857][106225] Updated weights for policy 1, policy_version 1552318 (0.0007) [2023-12-28 06:23:26,909][106225] Updated weights for policy 1, policy_version 1552328 (0.0005) [2023-12-28 06:23:26,954][106225] Updated weights for policy 1, policy_version 1552338 (0.0005) [2023-12-28 06:23:27,192][106226] Updated weights for policy 0, policy_version 1548601 (0.0009) [2023-12-28 06:23:27,254][106226] Updated weights for policy 0, policy_version 1548611 (0.0010) [2023-12-28 06:23:27,309][106226] Updated weights for policy 0, policy_version 1548621 (0.0010) [2023-12-28 06:23:27,363][106226] Updated weights for policy 0, policy_version 1548631 (0.0010) [2023-12-28 06:23:27,617][106225] Updated weights for policy 1, policy_version 1552348 (0.0007) [2023-12-28 06:23:27,667][106225] Updated weights for policy 1, policy_version 1552358 (0.0007) [2023-12-28 06:23:27,714][106225] Updated weights for policy 1, policy_version 1552368 (0.0007) [2023-12-28 06:23:28,030][106226] Updated weights for policy 0, policy_version 1548641 (0.0010) [2023-12-28 06:23:28,078][106226] Updated weights for policy 0, policy_version 1548651 (0.0010) [2023-12-28 06:23:28,130][106226] Updated weights for policy 0, policy_version 1548661 (0.0010) [2023-12-28 06:23:28,431][106225] Updated weights for policy 1, policy_version 1552378 (0.0007) [2023-12-28 06:23:28,497][106225] Updated weights for policy 1, policy_version 1552388 (0.0006) [2023-12-28 06:23:28,565][106225] Updated weights for policy 1, policy_version 1552398 (0.0005) [2023-12-28 06:23:28,628][106225] Updated weights for policy 1, policy_version 1552408 (0.0007) [2023-12-28 06:23:28,786][106226] Updated weights for policy 0, policy_version 1548671 (0.0010) [2023-12-28 06:23:28,860][106226] Updated weights for policy 0, policy_version 1548681 (0.0011) [2023-12-28 06:23:28,924][106226] Updated weights for policy 0, policy_version 1548691 (0.0010) [2023-12-28 06:23:29,310][106225] Updated weights for policy 1, policy_version 1552418 (0.0006) [2023-12-28 06:23:29,372][106225] Updated weights for policy 1, policy_version 1552428 (0.0008) [2023-12-28 06:23:29,424][106225] Updated weights for policy 1, policy_version 1552438 (0.0008) [2023-12-28 06:23:29,516][106226] Updated weights for policy 0, policy_version 1548701 (0.0008) [2023-12-28 06:23:29,568][106226] Updated weights for policy 0, policy_version 1548711 (0.0005) [2023-12-28 06:23:29,625][106226] Updated weights for policy 0, policy_version 1548721 (0.0008) [2023-12-28 06:23:30,146][106225] Updated weights for policy 1, policy_version 1552448 (0.0007) [2023-12-28 06:23:30,199][106225] Updated weights for policy 1, policy_version 1552458 (0.0008) [2023-12-28 06:23:30,238][106226] Updated weights for policy 0, policy_version 1548731 (0.0007) [2023-12-28 06:23:30,251][106225] Updated weights for policy 1, policy_version 1552468 (0.0009) [2023-12-28 06:23:30,300][106226] Updated weights for policy 0, policy_version 1548741 (0.0010) [2023-12-28 06:23:30,366][106226] Updated weights for policy 0, policy_version 1548751 (0.0010) [2023-12-28 06:23:30,923][106225] Updated weights for policy 1, policy_version 1552478 (0.0008) [2023-12-28 06:23:30,981][106225] Updated weights for policy 1, policy_version 1552488 (0.0009) [2023-12-28 06:23:30,986][106226] Updated weights for policy 0, policy_version 1548761 (0.0006) [2023-12-28 06:23:31,032][106225] Updated weights for policy 1, policy_version 1552498 (0.0009) [2023-12-28 06:23:31,054][106226] Updated weights for policy 0, policy_version 1548771 (0.0007) [2023-12-28 06:23:31,111][106226] Updated weights for policy 0, policy_version 1548781 (0.0008) [2023-12-28 06:23:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 794050560. Throughput: 0: 9940.1, 1: 9976.8. Samples: 794040868. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:31,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.611')] [2023-12-28 06:23:31,180][106226] Updated weights for policy 0, policy_version 1548791 (0.0008) [2023-12-28 06:23:31,864][106225] Updated weights for policy 1, policy_version 1552508 (0.0007) [2023-12-28 06:23:31,870][106226] Updated weights for policy 0, policy_version 1548801 (0.0007) [2023-12-28 06:23:31,911][106225] Updated weights for policy 1, policy_version 1552518 (0.0005) [2023-12-28 06:23:31,932][106226] Updated weights for policy 0, policy_version 1548811 (0.0008) [2023-12-28 06:23:31,962][106225] Updated weights for policy 1, policy_version 1552528 (0.0005) [2023-12-28 06:23:31,987][106226] Updated weights for policy 0, policy_version 1548821 (0.0007) [2023-12-28 06:23:32,688][106225] Updated weights for policy 1, policy_version 1552538 (0.0007) [2023-12-28 06:23:32,716][106226] Updated weights for policy 0, policy_version 1548831 (0.0006) [2023-12-28 06:23:32,747][106225] Updated weights for policy 1, policy_version 1552548 (0.0008) [2023-12-28 06:23:32,770][106226] Updated weights for policy 0, policy_version 1548841 (0.0005) [2023-12-28 06:23:32,804][106225] Updated weights for policy 1, policy_version 1552558 (0.0008) [2023-12-28 06:23:32,826][106226] Updated weights for policy 0, policy_version 1548851 (0.0005) [2023-12-28 06:23:32,861][106225] Updated weights for policy 1, policy_version 1552568 (0.0008) [2023-12-28 06:23:33,428][106226] Updated weights for policy 0, policy_version 1548861 (0.0005) [2023-12-28 06:23:33,475][106226] Updated weights for policy 0, policy_version 1548871 (0.0005) [2023-12-28 06:23:33,537][106226] Updated weights for policy 0, policy_version 1548881 (0.0005) [2023-12-28 06:23:33,656][106225] Updated weights for policy 1, policy_version 1552578 (0.0009) [2023-12-28 06:23:33,709][106225] Updated weights for policy 1, policy_version 1552588 (0.0009) [2023-12-28 06:23:33,762][106225] Updated weights for policy 1, policy_version 1552598 (0.0009) [2023-12-28 06:23:34,050][106226] Updated weights for policy 0, policy_version 1548891 (0.0005) [2023-12-28 06:23:34,106][106226] Updated weights for policy 0, policy_version 1548901 (0.0005) [2023-12-28 06:23:34,171][106226] Updated weights for policy 0, policy_version 1548911 (0.0007) [2023-12-28 06:23:34,606][106225] Updated weights for policy 1, policy_version 1552608 (0.0008) [2023-12-28 06:23:34,655][106225] Updated weights for policy 1, policy_version 1552618 (0.0008) [2023-12-28 06:23:34,712][106225] Updated weights for policy 1, policy_version 1552628 (0.0008) [2023-12-28 06:23:34,866][106226] Updated weights for policy 0, policy_version 1548921 (0.0008) [2023-12-28 06:23:34,919][106226] Updated weights for policy 0, policy_version 1548931 (0.0010) [2023-12-28 06:23:34,973][106226] Updated weights for policy 0, policy_version 1548941 (0.0010) [2023-12-28 06:23:35,023][106226] Updated weights for policy 0, policy_version 1548951 (0.0010) [2023-12-28 06:23:35,403][106225] Updated weights for policy 1, policy_version 1552638 (0.0007) [2023-12-28 06:23:35,448][106225] Updated weights for policy 1, policy_version 1552648 (0.0007) [2023-12-28 06:23:35,503][106225] Updated weights for policy 1, policy_version 1552659 (0.0009) [2023-12-28 06:23:35,701][106226] Updated weights for policy 0, policy_version 1548961 (0.0009) [2023-12-28 06:23:35,764][106226] Updated weights for policy 0, policy_version 1548971 (0.0008) [2023-12-28 06:23:35,814][106226] Updated weights for policy 0, policy_version 1548981 (0.0010) [2023-12-28 06:23:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 794148864. Throughput: 0: 10041.4, 1: 9933.2. Samples: 794160196. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:36,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.793')] [2023-12-28 06:23:36,243][106225] Updated weights for policy 1, policy_version 1552669 (0.0008) [2023-12-28 06:23:36,302][106225] Updated weights for policy 1, policy_version 1552679 (0.0008) [2023-12-28 06:23:36,355][106225] Updated weights for policy 1, policy_version 1552689 (0.0008) [2023-12-28 06:23:36,510][106226] Updated weights for policy 0, policy_version 1548991 (0.0011) [2023-12-28 06:23:36,567][106226] Updated weights for policy 0, policy_version 1549001 (0.0011) [2023-12-28 06:23:36,622][106226] Updated weights for policy 0, policy_version 1549011 (0.0011) [2023-12-28 06:23:37,120][106225] Updated weights for policy 1, policy_version 1552699 (0.0007) [2023-12-28 06:23:37,180][106225] Updated weights for policy 1, policy_version 1552709 (0.0008) [2023-12-28 06:23:37,237][106225] Updated weights for policy 1, policy_version 1552719 (0.0007) [2023-12-28 06:23:37,274][106226] Updated weights for policy 0, policy_version 1549021 (0.0009) [2023-12-28 06:23:37,333][106226] Updated weights for policy 0, policy_version 1549031 (0.0005) [2023-12-28 06:23:37,400][106226] Updated weights for policy 0, policy_version 1549041 (0.0007) [2023-12-28 06:23:37,918][106225] Updated weights for policy 1, policy_version 1552729 (0.0008) [2023-12-28 06:23:37,981][106225] Updated weights for policy 1, policy_version 1552739 (0.0008) [2023-12-28 06:23:38,045][106225] Updated weights for policy 1, policy_version 1552749 (0.0008) [2023-12-28 06:23:38,098][106226] Updated weights for policy 0, policy_version 1549051 (0.0011) [2023-12-28 06:23:38,102][106225] Updated weights for policy 1, policy_version 1552759 (0.0007) [2023-12-28 06:23:38,149][106226] Updated weights for policy 0, policy_version 1549061 (0.0010) [2023-12-28 06:23:38,208][106226] Updated weights for policy 0, policy_version 1549071 (0.0006) [2023-12-28 06:23:38,858][106225] Updated weights for policy 1, policy_version 1552769 (0.0009) [2023-12-28 06:23:38,924][106225] Updated weights for policy 1, policy_version 1552779 (0.0008) [2023-12-28 06:23:38,939][106226] Updated weights for policy 0, policy_version 1549081 (0.0006) [2023-12-28 06:23:38,978][106225] Updated weights for policy 1, policy_version 1552789 (0.0006) [2023-12-28 06:23:38,996][106226] Updated weights for policy 0, policy_version 1549091 (0.0008) [2023-12-28 06:23:39,062][106226] Updated weights for policy 0, policy_version 1549101 (0.0008) [2023-12-28 06:23:39,126][106226] Updated weights for policy 0, policy_version 1549111 (0.0009) [2023-12-28 06:23:39,745][106225] Updated weights for policy 1, policy_version 1552799 (0.0007) [2023-12-28 06:23:39,807][106225] Updated weights for policy 1, policy_version 1552809 (0.0009) [2023-12-28 06:23:39,859][106226] Updated weights for policy 0, policy_version 1549121 (0.0007) [2023-12-28 06:23:39,873][106225] Updated weights for policy 1, policy_version 1552819 (0.0007) [2023-12-28 06:23:39,922][106226] Updated weights for policy 0, policy_version 1549131 (0.0009) [2023-12-28 06:23:39,985][106226] Updated weights for policy 0, policy_version 1549141 (0.0009) [2023-12-28 06:23:40,676][106225] Updated weights for policy 1, policy_version 1552829 (0.0009) [2023-12-28 06:23:40,714][106226] Updated weights for policy 0, policy_version 1549151 (0.0006) [2023-12-28 06:23:40,734][106225] Updated weights for policy 1, policy_version 1552839 (0.0009) [2023-12-28 06:23:40,769][106226] Updated weights for policy 0, policy_version 1549161 (0.0006) [2023-12-28 06:23:40,795][106225] Updated weights for policy 1, policy_version 1552849 (0.0008) [2023-12-28 06:23:40,824][106226] Updated weights for policy 0, policy_version 1549171 (0.0008) [2023-12-28 06:23:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19938.5). Total num frames: 794247168. Throughput: 0: 10017.4, 1: 9946.2. Samples: 794219076. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:41,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.645')] [2023-12-28 06:23:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001552856_397582336.pth... [2023-12-28 06:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001549176_396664832.pth... [2023-12-28 06:23:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001551704_397287424.pth [2023-12-28 06:23:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001547992_396361728.pth [2023-12-28 06:23:41,558][106225] Updated weights for policy 1, policy_version 1552859 (0.0008) [2023-12-28 06:23:41,593][106226] Updated weights for policy 0, policy_version 1549181 (0.0006) [2023-12-28 06:23:41,621][106225] Updated weights for policy 1, policy_version 1552869 (0.0010) [2023-12-28 06:23:41,662][106226] Updated weights for policy 0, policy_version 1549191 (0.0008) [2023-12-28 06:23:41,688][106225] Updated weights for policy 1, policy_version 1552879 (0.0009) [2023-12-28 06:23:41,728][106226] Updated weights for policy 0, policy_version 1549201 (0.0007) [2023-12-28 06:23:42,428][106226] Updated weights for policy 0, policy_version 1549211 (0.0009) [2023-12-28 06:23:42,455][106225] Updated weights for policy 1, policy_version 1552889 (0.0008) [2023-12-28 06:23:42,485][106226] Updated weights for policy 0, policy_version 1549221 (0.0008) [2023-12-28 06:23:42,516][106225] Updated weights for policy 1, policy_version 1552899 (0.0008) [2023-12-28 06:23:42,537][106226] Updated weights for policy 0, policy_version 1549231 (0.0008) [2023-12-28 06:23:42,580][106225] Updated weights for policy 1, policy_version 1552909 (0.0009) [2023-12-28 06:23:42,637][106225] Updated weights for policy 1, policy_version 1552919 (0.0008) [2023-12-28 06:23:43,286][106226] Updated weights for policy 0, policy_version 1549241 (0.0008) [2023-12-28 06:23:43,334][106226] Updated weights for policy 0, policy_version 1549251 (0.0008) [2023-12-28 06:23:43,375][106225] Updated weights for policy 1, policy_version 1552929 (0.0008) [2023-12-28 06:23:43,382][106226] Updated weights for policy 0, policy_version 1549261 (0.0007) [2023-12-28 06:23:43,427][106225] Updated weights for policy 1, policy_version 1552939 (0.0008) [2023-12-28 06:23:43,432][106226] Updated weights for policy 0, policy_version 1549271 (0.0007) [2023-12-28 06:23:43,486][106225] Updated weights for policy 1, policy_version 1552949 (0.0007) [2023-12-28 06:23:44,168][106225] Updated weights for policy 1, policy_version 1552959 (0.0008) [2023-12-28 06:23:44,200][106226] Updated weights for policy 0, policy_version 1549281 (0.0008) [2023-12-28 06:23:44,221][106225] Updated weights for policy 1, policy_version 1552969 (0.0006) [2023-12-28 06:23:44,250][106226] Updated weights for policy 0, policy_version 1549291 (0.0007) [2023-12-28 06:23:44,268][106225] Updated weights for policy 1, policy_version 1552979 (0.0005) [2023-12-28 06:23:44,306][106226] Updated weights for policy 0, policy_version 1549301 (0.0007) [2023-12-28 06:23:45,024][106225] Updated weights for policy 1, policy_version 1552989 (0.0007) [2023-12-28 06:23:45,054][106226] Updated weights for policy 0, policy_version 1549311 (0.0008) [2023-12-28 06:23:45,079][106225] Updated weights for policy 1, policy_version 1552999 (0.0007) [2023-12-28 06:23:45,107][106226] Updated weights for policy 0, policy_version 1549321 (0.0008) [2023-12-28 06:23:45,141][106225] Updated weights for policy 1, policy_version 1553009 (0.0007) [2023-12-28 06:23:45,167][106226] Updated weights for policy 0, policy_version 1549331 (0.0011) [2023-12-28 06:23:45,833][106226] Updated weights for policy 0, policy_version 1549341 (0.0009) [2023-12-28 06:23:45,892][106226] Updated weights for policy 0, policy_version 1549351 (0.0007) [2023-12-28 06:23:45,899][106225] Updated weights for policy 1, policy_version 1553019 (0.0007) [2023-12-28 06:23:45,948][106226] Updated weights for policy 0, policy_version 1549361 (0.0005) [2023-12-28 06:23:45,951][106225] Updated weights for policy 1, policy_version 1553029 (0.0008) [2023-12-28 06:23:46,000][106225] Updated weights for policy 1, policy_version 1553039 (0.0007) [2023-12-28 06:23:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 794345472. Throughput: 0: 9916.3, 1: 9909.5. Samples: 794331084. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:46,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.733')] [2023-12-28 06:23:46,654][106226] Updated weights for policy 0, policy_version 1549371 (0.0007) [2023-12-28 06:23:46,705][106225] Updated weights for policy 1, policy_version 1553049 (0.0008) [2023-12-28 06:23:46,718][106226] Updated weights for policy 0, policy_version 1549381 (0.0008) [2023-12-28 06:23:46,755][106225] Updated weights for policy 1, policy_version 1553059 (0.0007) [2023-12-28 06:23:46,781][106226] Updated weights for policy 0, policy_version 1549391 (0.0006) [2023-12-28 06:23:46,812][106225] Updated weights for policy 1, policy_version 1553069 (0.0008) [2023-12-28 06:23:46,871][106225] Updated weights for policy 1, policy_version 1553079 (0.0009) [2023-12-28 06:23:47,373][106226] Updated weights for policy 0, policy_version 1549401 (0.0005) [2023-12-28 06:23:47,437][106226] Updated weights for policy 0, policy_version 1549411 (0.0008) [2023-12-28 06:23:47,492][106226] Updated weights for policy 0, policy_version 1549421 (0.0008) [2023-12-28 06:23:47,548][106226] Updated weights for policy 0, policy_version 1549431 (0.0008) [2023-12-28 06:23:47,630][106225] Updated weights for policy 1, policy_version 1553089 (0.0009) [2023-12-28 06:23:47,683][106225] Updated weights for policy 1, policy_version 1553099 (0.0008) [2023-12-28 06:23:47,744][106225] Updated weights for policy 1, policy_version 1553109 (0.0009) [2023-12-28 06:23:48,201][106226] Updated weights for policy 0, policy_version 1549441 (0.0006) [2023-12-28 06:23:48,262][106226] Updated weights for policy 0, policy_version 1549451 (0.0008) [2023-12-28 06:23:48,326][106226] Updated weights for policy 0, policy_version 1549461 (0.0008) [2023-12-28 06:23:48,547][106225] Updated weights for policy 1, policy_version 1553119 (0.0009) [2023-12-28 06:23:48,607][106225] Updated weights for policy 1, policy_version 1553129 (0.0008) [2023-12-28 06:23:48,662][106225] Updated weights for policy 1, policy_version 1553139 (0.0008) [2023-12-28 06:23:49,033][106226] Updated weights for policy 0, policy_version 1549471 (0.0008) [2023-12-28 06:23:49,094][106226] Updated weights for policy 0, policy_version 1549481 (0.0008) [2023-12-28 06:23:49,160][106226] Updated weights for policy 0, policy_version 1549491 (0.0009) [2023-12-28 06:23:49,396][106225] Updated weights for policy 1, policy_version 1553149 (0.0008) [2023-12-28 06:23:49,455][106225] Updated weights for policy 1, policy_version 1553159 (0.0009) [2023-12-28 06:23:49,503][106225] Updated weights for policy 1, policy_version 1553169 (0.0008) [2023-12-28 06:23:49,798][106226] Updated weights for policy 0, policy_version 1549501 (0.0009) [2023-12-28 06:23:49,868][106226] Updated weights for policy 0, policy_version 1549511 (0.0008) [2023-12-28 06:23:49,938][106226] Updated weights for policy 0, policy_version 1549521 (0.0009) [2023-12-28 06:23:50,287][106225] Updated weights for policy 1, policy_version 1553179 (0.0009) [2023-12-28 06:23:50,354][106225] Updated weights for policy 1, policy_version 1553189 (0.0009) [2023-12-28 06:23:50,415][106225] Updated weights for policy 1, policy_version 1553199 (0.0007) [2023-12-28 06:23:50,732][106226] Updated weights for policy 0, policy_version 1549531 (0.0008) [2023-12-28 06:23:50,792][106226] Updated weights for policy 0, policy_version 1549541 (0.0008) [2023-12-28 06:23:50,860][106226] Updated weights for policy 0, policy_version 1549551 (0.0008) [2023-12-28 06:23:51,084][106225] Updated weights for policy 1, policy_version 1553209 (0.0008) [2023-12-28 06:23:51,138][106225] Updated weights for policy 1, policy_version 1553219 (0.0009) [2023-12-28 06:23:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 794435584. Throughput: 0: 9996.4, 1: 9748.6. Samples: 794446844. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:51,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-4.373')] [2023-12-28 06:23:51,202][106225] Updated weights for policy 1, policy_version 1553229 (0.0008) [2023-12-28 06:23:51,265][106225] Updated weights for policy 1, policy_version 1553239 (0.0009) [2023-12-28 06:23:51,638][106226] Updated weights for policy 0, policy_version 1549561 (0.0009) [2023-12-28 06:23:51,696][106226] Updated weights for policy 0, policy_version 1549571 (0.0009) [2023-12-28 06:23:51,762][106226] Updated weights for policy 0, policy_version 1549581 (0.0008) [2023-12-28 06:23:51,816][106226] Updated weights for policy 0, policy_version 1549591 (0.0008) [2023-12-28 06:23:52,018][106225] Updated weights for policy 1, policy_version 1553249 (0.0009) [2023-12-28 06:23:52,077][106225] Updated weights for policy 1, policy_version 1553259 (0.0008) [2023-12-28 06:23:52,132][106225] Updated weights for policy 1, policy_version 1553269 (0.0008) [2023-12-28 06:23:52,581][106226] Updated weights for policy 0, policy_version 1549601 (0.0008) [2023-12-28 06:23:52,634][106226] Updated weights for policy 0, policy_version 1549611 (0.0009) [2023-12-28 06:23:52,688][106226] Updated weights for policy 0, policy_version 1549621 (0.0009) [2023-12-28 06:23:52,840][106225] Updated weights for policy 1, policy_version 1553279 (0.0007) [2023-12-28 06:23:52,891][106225] Updated weights for policy 1, policy_version 1553289 (0.0009) [2023-12-28 06:23:52,938][106225] Updated weights for policy 1, policy_version 1553299 (0.0007) [2023-12-28 06:23:53,375][106226] Updated weights for policy 0, policy_version 1549631 (0.0006) [2023-12-28 06:23:53,429][106226] Updated weights for policy 0, policy_version 1549641 (0.0005) [2023-12-28 06:23:53,493][106226] Updated weights for policy 0, policy_version 1549651 (0.0005) [2023-12-28 06:23:53,599][106225] Updated weights for policy 1, policy_version 1553309 (0.0008) [2023-12-28 06:23:53,666][106225] Updated weights for policy 1, policy_version 1553319 (0.0007) [2023-12-28 06:23:53,718][106225] Updated weights for policy 1, policy_version 1553329 (0.0005) [2023-12-28 06:23:54,125][106226] Updated weights for policy 0, policy_version 1549661 (0.0005) [2023-12-28 06:23:54,184][106226] Updated weights for policy 0, policy_version 1549671 (0.0008) [2023-12-28 06:23:54,238][106226] Updated weights for policy 0, policy_version 1549681 (0.0006) [2023-12-28 06:23:54,288][106225] Updated weights for policy 1, policy_version 1553339 (0.0006) [2023-12-28 06:23:54,337][106225] Updated weights for policy 1, policy_version 1553349 (0.0008) [2023-12-28 06:23:54,382][106225] Updated weights for policy 1, policy_version 1553359 (0.0008) [2023-12-28 06:23:54,945][106226] Updated weights for policy 0, policy_version 1549691 (0.0006) [2023-12-28 06:23:54,998][106225] Updated weights for policy 1, policy_version 1553369 (0.0008) [2023-12-28 06:23:55,013][106226] Updated weights for policy 0, policy_version 1549701 (0.0007) [2023-12-28 06:23:55,060][106225] Updated weights for policy 1, policy_version 1553379 (0.0008) [2023-12-28 06:23:55,073][106226] Updated weights for policy 0, policy_version 1549711 (0.0007) [2023-12-28 06:23:55,113][106225] Updated weights for policy 1, policy_version 1553389 (0.0007) [2023-12-28 06:23:55,166][106225] Updated weights for policy 1, policy_version 1553399 (0.0009) [2023-12-28 06:23:55,654][106226] Updated weights for policy 0, policy_version 1549721 (0.0006) [2023-12-28 06:23:55,715][106226] Updated weights for policy 0, policy_version 1549731 (0.0007) [2023-12-28 06:23:55,768][106226] Updated weights for policy 0, policy_version 1549741 (0.0006) [2023-12-28 06:23:55,828][106226] Updated weights for policy 0, policy_version 1549751 (0.0007) [2023-12-28 06:23:55,899][106225] Updated weights for policy 1, policy_version 1553409 (0.0009) [2023-12-28 06:23:55,954][106225] Updated weights for policy 1, policy_version 1553419 (0.0006) [2023-12-28 06:23:56,013][106225] Updated weights for policy 1, policy_version 1553429 (0.0007) [2023-12-28 06:23:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 794542080. Throughput: 0: 10030.4, 1: 9728.2. Samples: 794506416. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 06:23:56,176][105115] Avg episode reward: [(0, '-4.991'), (1, '-4.597')] [2023-12-28 06:23:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001553432_397729792.pth... [2023-12-28 06:23:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001549752_396812288.pth... [2023-12-28 06:23:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001552312_397443072.pth [2023-12-28 06:23:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001548568_396509184.pth [2023-12-28 06:23:56,465][106226] Updated weights for policy 0, policy_version 1549761 (0.0006) [2023-12-28 06:23:56,530][106226] Updated weights for policy 0, policy_version 1549771 (0.0006) [2023-12-28 06:23:56,592][106226] Updated weights for policy 0, policy_version 1549781 (0.0006) [2023-12-28 06:23:56,598][106225] Updated weights for policy 1, policy_version 1553439 (0.0006) [2023-12-28 06:23:56,650][106225] Updated weights for policy 1, policy_version 1553449 (0.0005) [2023-12-28 06:23:56,702][106225] Updated weights for policy 1, policy_version 1553459 (0.0005) [2023-12-28 06:23:57,271][106225] Updated weights for policy 1, policy_version 1553469 (0.0005) [2023-12-28 06:23:57,313][106226] Updated weights for policy 0, policy_version 1549791 (0.0005) [2023-12-28 06:23:57,327][106225] Updated weights for policy 1, policy_version 1553479 (0.0006) [2023-12-28 06:23:57,363][106226] Updated weights for policy 0, policy_version 1549801 (0.0007) [2023-12-28 06:23:57,374][106225] Updated weights for policy 1, policy_version 1553489 (0.0006) [2023-12-28 06:23:57,413][106226] Updated weights for policy 0, policy_version 1549811 (0.0006) [2023-12-28 06:23:57,972][106225] Updated weights for policy 1, policy_version 1553499 (0.0006) [2023-12-28 06:23:58,006][106226] Updated weights for policy 0, policy_version 1549821 (0.0008) [2023-12-28 06:23:58,025][106225] Updated weights for policy 1, policy_version 1553509 (0.0005) [2023-12-28 06:23:58,066][106226] Updated weights for policy 0, policy_version 1549831 (0.0009) [2023-12-28 06:23:58,078][106225] Updated weights for policy 1, policy_version 1553519 (0.0005) [2023-12-28 06:23:58,124][106226] Updated weights for policy 0, policy_version 1549841 (0.0008) [2023-12-28 06:23:58,827][106225] Updated weights for policy 1, policy_version 1553529 (0.0006) [2023-12-28 06:23:58,892][106225] Updated weights for policy 1, policy_version 1553539 (0.0008) [2023-12-28 06:23:58,892][106226] Updated weights for policy 0, policy_version 1549851 (0.0009) [2023-12-28 06:23:58,967][106225] Updated weights for policy 1, policy_version 1553549 (0.0008) [2023-12-28 06:23:58,971][106226] Updated weights for policy 0, policy_version 1549862 (0.0009) [2023-12-28 06:23:59,024][106226] Updated weights for policy 0, policy_version 1549872 (0.0009) [2023-12-28 06:23:59,028][106225] Updated weights for policy 1, policy_version 1553559 (0.0009) [2023-12-28 06:23:59,817][106226] Updated weights for policy 0, policy_version 1549882 (0.0009) [2023-12-28 06:23:59,861][106225] Updated weights for policy 1, policy_version 1553569 (0.0007) [2023-12-28 06:23:59,882][106226] Updated weights for policy 0, policy_version 1549892 (0.0009) [2023-12-28 06:23:59,923][106225] Updated weights for policy 1, policy_version 1553579 (0.0006) [2023-12-28 06:23:59,950][106226] Updated weights for policy 0, policy_version 1549902 (0.0010) [2023-12-28 06:23:59,995][106225] Updated weights for policy 1, policy_version 1553589 (0.0008) [2023-12-28 06:24:00,011][106226] Updated weights for policy 0, policy_version 1549912 (0.0009) [2023-12-28 06:24:00,649][106225] Updated weights for policy 1, policy_version 1553599 (0.0006) [2023-12-28 06:24:00,703][106225] Updated weights for policy 1, policy_version 1553609 (0.0005) [2023-12-28 06:24:00,708][106226] Updated weights for policy 0, policy_version 1549922 (0.0010) [2023-12-28 06:24:00,755][106225] Updated weights for policy 1, policy_version 1553619 (0.0006) [2023-12-28 06:24:00,757][106226] Updated weights for policy 0, policy_version 1549932 (0.0010) [2023-12-28 06:24:00,812][106226] Updated weights for policy 0, policy_version 1549942 (0.0010) [2023-12-28 06:24:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 794640384. Throughput: 0: 10058.1, 1: 9778.1. Samples: 794628992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:01,175][105115] Avg episode reward: [(0, '-5.073'), (1, '-4.787')] [2023-12-28 06:24:01,437][106225] Updated weights for policy 1, policy_version 1553629 (0.0007) [2023-12-28 06:24:01,480][106226] Updated weights for policy 0, policy_version 1549952 (0.0009) [2023-12-28 06:24:01,489][106225] Updated weights for policy 1, policy_version 1553639 (0.0005) [2023-12-28 06:24:01,544][106226] Updated weights for policy 0, policy_version 1549962 (0.0008) [2023-12-28 06:24:01,547][106225] Updated weights for policy 1, policy_version 1553649 (0.0006) [2023-12-28 06:24:01,606][106226] Updated weights for policy 0, policy_version 1549972 (0.0009) [2023-12-28 06:24:02,277][106225] Updated weights for policy 1, policy_version 1553659 (0.0006) [2023-12-28 06:24:02,338][106225] Updated weights for policy 1, policy_version 1553669 (0.0008) [2023-12-28 06:24:02,362][106226] Updated weights for policy 0, policy_version 1549982 (0.0006) [2023-12-28 06:24:02,400][106225] Updated weights for policy 1, policy_version 1553679 (0.0008) [2023-12-28 06:24:02,427][106226] Updated weights for policy 0, policy_version 1549992 (0.0009) [2023-12-28 06:24:02,497][106226] Updated weights for policy 0, policy_version 1550002 (0.0005) [2023-12-28 06:24:03,165][106225] Updated weights for policy 1, policy_version 1553689 (0.0007) [2023-12-28 06:24:03,172][106226] Updated weights for policy 0, policy_version 1550012 (0.0006) [2023-12-28 06:24:03,219][106225] Updated weights for policy 1, policy_version 1553699 (0.0008) [2023-12-28 06:24:03,225][106226] Updated weights for policy 0, policy_version 1550022 (0.0006) [2023-12-28 06:24:03,273][106226] Updated weights for policy 0, policy_version 1550032 (0.0006) [2023-12-28 06:24:03,276][106225] Updated weights for policy 1, policy_version 1553709 (0.0005) [2023-12-28 06:24:03,329][106225] Updated weights for policy 1, policy_version 1553719 (0.0005) [2023-12-28 06:24:03,916][106225] Updated weights for policy 1, policy_version 1553729 (0.0008) [2023-12-28 06:24:03,929][106226] Updated weights for policy 0, policy_version 1550042 (0.0008) [2023-12-28 06:24:03,974][106225] Updated weights for policy 1, policy_version 1553739 (0.0008) [2023-12-28 06:24:03,988][106226] Updated weights for policy 0, policy_version 1550052 (0.0005) [2023-12-28 06:24:04,030][106225] Updated weights for policy 1, policy_version 1553749 (0.0009) [2023-12-28 06:24:04,051][106226] Updated weights for policy 0, policy_version 1550062 (0.0008) [2023-12-28 06:24:04,119][106226] Updated weights for policy 0, policy_version 1550072 (0.0008) [2023-12-28 06:24:04,730][106226] Updated weights for policy 0, policy_version 1550082 (0.0007) [2023-12-28 06:24:04,764][106225] Updated weights for policy 1, policy_version 1553759 (0.0010) [2023-12-28 06:24:04,787][106226] Updated weights for policy 0, policy_version 1550092 (0.0006) [2023-12-28 06:24:04,823][106225] Updated weights for policy 1, policy_version 1553769 (0.0010) [2023-12-28 06:24:04,835][106226] Updated weights for policy 0, policy_version 1550102 (0.0005) [2023-12-28 06:24:04,883][106225] Updated weights for policy 1, policy_version 1553779 (0.0010) [2023-12-28 06:24:05,413][106226] Updated weights for policy 0, policy_version 1550112 (0.0005) [2023-12-28 06:24:05,468][106226] Updated weights for policy 0, policy_version 1550122 (0.0005) [2023-12-28 06:24:05,521][106226] Updated weights for policy 0, policy_version 1550132 (0.0005) [2023-12-28 06:24:05,607][106225] Updated weights for policy 1, policy_version 1553789 (0.0011) [2023-12-28 06:24:05,663][106225] Updated weights for policy 1, policy_version 1553799 (0.0010) [2023-12-28 06:24:05,716][106225] Updated weights for policy 1, policy_version 1553809 (0.0010) [2023-12-28 06:24:06,125][106226] Updated weights for policy 0, policy_version 1550142 (0.0008) [2023-12-28 06:24:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 794738688. Throughput: 0: 10152.3, 1: 9761.9. Samples: 794751896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:06,175][105115] Avg episode reward: [(0, '-5.075'), (1, '-4.401')] [2023-12-28 06:24:06,195][106226] Updated weights for policy 0, policy_version 1550152 (0.0007) [2023-12-28 06:24:06,271][106226] Updated weights for policy 0, policy_version 1550162 (0.0008) [2023-12-28 06:24:06,435][106225] Updated weights for policy 1, policy_version 1553819 (0.0010) [2023-12-28 06:24:06,501][106225] Updated weights for policy 1, policy_version 1553829 (0.0007) [2023-12-28 06:24:06,564][106225] Updated weights for policy 1, policy_version 1553839 (0.0009) [2023-12-28 06:24:06,907][106226] Updated weights for policy 0, policy_version 1550172 (0.0007) [2023-12-28 06:24:06,967][106226] Updated weights for policy 0, policy_version 1550182 (0.0009) [2023-12-28 06:24:07,027][106226] Updated weights for policy 0, policy_version 1550192 (0.0008) [2023-12-28 06:24:07,308][106225] Updated weights for policy 1, policy_version 1553849 (0.0008) [2023-12-28 06:24:07,371][106225] Updated weights for policy 1, policy_version 1553859 (0.0009) [2023-12-28 06:24:07,431][106225] Updated weights for policy 1, policy_version 1553869 (0.0008) [2023-12-28 06:24:07,491][106225] Updated weights for policy 1, policy_version 1553879 (0.0008) [2023-12-28 06:24:07,725][106226] Updated weights for policy 0, policy_version 1550202 (0.0008) [2023-12-28 06:24:07,793][106226] Updated weights for policy 0, policy_version 1550212 (0.0005) [2023-12-28 06:24:07,861][106226] Updated weights for policy 0, policy_version 1550222 (0.0005) [2023-12-28 06:24:07,921][106226] Updated weights for policy 0, policy_version 1550232 (0.0005) [2023-12-28 06:24:08,161][106225] Updated weights for policy 1, policy_version 1553889 (0.0008) [2023-12-28 06:24:08,222][106225] Updated weights for policy 1, policy_version 1553899 (0.0006) [2023-12-28 06:24:08,276][106225] Updated weights for policy 1, policy_version 1553909 (0.0005) [2023-12-28 06:24:08,507][106226] Updated weights for policy 0, policy_version 1550242 (0.0011) [2023-12-28 06:24:08,574][106226] Updated weights for policy 0, policy_version 1550252 (0.0010) [2023-12-28 06:24:08,631][106226] Updated weights for policy 0, policy_version 1550262 (0.0010) [2023-12-28 06:24:08,933][106225] Updated weights for policy 1, policy_version 1553919 (0.0009) [2023-12-28 06:24:08,994][106225] Updated weights for policy 1, policy_version 1553929 (0.0011) [2023-12-28 06:24:09,059][106225] Updated weights for policy 1, policy_version 1553939 (0.0010) [2023-12-28 06:24:09,341][106226] Updated weights for policy 0, policy_version 1550272 (0.0010) [2023-12-28 06:24:09,421][106226] Updated weights for policy 0, policy_version 1550282 (0.0009) [2023-12-28 06:24:09,488][106226] Updated weights for policy 0, policy_version 1550292 (0.0008) [2023-12-28 06:24:09,906][106225] Updated weights for policy 1, policy_version 1553949 (0.0009) [2023-12-28 06:24:09,972][106225] Updated weights for policy 1, policy_version 1553959 (0.0008) [2023-12-28 06:24:10,045][106225] Updated weights for policy 1, policy_version 1553969 (0.0008) [2023-12-28 06:24:10,308][106226] Updated weights for policy 0, policy_version 1550302 (0.0008) [2023-12-28 06:24:10,360][106226] Updated weights for policy 0, policy_version 1550312 (0.0008) [2023-12-28 06:24:10,419][106226] Updated weights for policy 0, policy_version 1550322 (0.0006) [2023-12-28 06:24:10,768][106225] Updated weights for policy 1, policy_version 1553979 (0.0008) [2023-12-28 06:24:10,835][106225] Updated weights for policy 1, policy_version 1553989 (0.0007) [2023-12-28 06:24:10,903][106225] Updated weights for policy 1, policy_version 1553999 (0.0007) [2023-12-28 06:24:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19935.0, 300 sec: 19910.7). Total num frames: 794836992. Throughput: 0: 10156.3, 1: 9785.8. Samples: 794812672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:11,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.665')] [2023-12-28 06:24:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001554008_397877248.pth... [2023-12-28 06:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001552856_397582336.pth [2023-12-28 06:24:11,191][106226] Updated weights for policy 0, policy_version 1550332 (0.0008) [2023-12-28 06:24:11,255][106226] Updated weights for policy 0, policy_version 1550342 (0.0007) [2023-12-28 06:24:11,323][106226] Updated weights for policy 0, policy_version 1550352 (0.0008) [2023-12-28 06:24:11,379][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001550360_396967936.pth... [2023-12-28 06:24:11,383][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001549176_396664832.pth [2023-12-28 06:24:11,655][106225] Updated weights for policy 1, policy_version 1554009 (0.0008) [2023-12-28 06:24:11,719][106225] Updated weights for policy 1, policy_version 1554019 (0.0009) [2023-12-28 06:24:11,787][106225] Updated weights for policy 1, policy_version 1554029 (0.0010) [2023-12-28 06:24:11,845][106225] Updated weights for policy 1, policy_version 1554039 (0.0011) [2023-12-28 06:24:12,034][106226] Updated weights for policy 0, policy_version 1550362 (0.0009) [2023-12-28 06:24:12,103][106226] Updated weights for policy 0, policy_version 1550372 (0.0007) [2023-12-28 06:24:12,170][106226] Updated weights for policy 0, policy_version 1550382 (0.0008) [2023-12-28 06:24:12,225][106226] Updated weights for policy 0, policy_version 1550392 (0.0008) [2023-12-28 06:24:12,556][106225] Updated weights for policy 1, policy_version 1554049 (0.0008) [2023-12-28 06:24:12,620][106225] Updated weights for policy 1, policy_version 1554059 (0.0011) [2023-12-28 06:24:12,682][106225] Updated weights for policy 1, policy_version 1554069 (0.0011) [2023-12-28 06:24:12,936][106226] Updated weights for policy 0, policy_version 1550402 (0.0005) [2023-12-28 06:24:13,006][106226] Updated weights for policy 0, policy_version 1550412 (0.0008) [2023-12-28 06:24:13,070][106226] Updated weights for policy 0, policy_version 1550422 (0.0008) [2023-12-28 06:24:13,383][106225] Updated weights for policy 1, policy_version 1554079 (0.0009) [2023-12-28 06:24:13,432][106225] Updated weights for policy 1, policy_version 1554089 (0.0008) [2023-12-28 06:24:13,482][106225] Updated weights for policy 1, policy_version 1554099 (0.0009) [2023-12-28 06:24:13,696][106226] Updated weights for policy 0, policy_version 1550432 (0.0006) [2023-12-28 06:24:13,747][106226] Updated weights for policy 0, policy_version 1550442 (0.0009) [2023-12-28 06:24:13,799][106226] Updated weights for policy 0, policy_version 1550452 (0.0007) [2023-12-28 06:24:14,169][106225] Updated weights for policy 1, policy_version 1554109 (0.0008) [2023-12-28 06:24:14,222][106225] Updated weights for policy 1, policy_version 1554119 (0.0009) [2023-12-28 06:24:14,281][106225] Updated weights for policy 1, policy_version 1554129 (0.0008) [2023-12-28 06:24:14,441][106226] Updated weights for policy 0, policy_version 1550462 (0.0007) [2023-12-28 06:24:14,502][106226] Updated weights for policy 0, policy_version 1550472 (0.0007) [2023-12-28 06:24:14,554][106226] Updated weights for policy 0, policy_version 1550482 (0.0008) [2023-12-28 06:24:15,082][106225] Updated weights for policy 1, policy_version 1554139 (0.0009) [2023-12-28 06:24:15,139][106225] Updated weights for policy 1, policy_version 1554149 (0.0009) [2023-12-28 06:24:15,195][106225] Updated weights for policy 1, policy_version 1554159 (0.0008) [2023-12-28 06:24:15,229][106226] Updated weights for policy 0, policy_version 1550492 (0.0007) [2023-12-28 06:24:15,290][106226] Updated weights for policy 0, policy_version 1550502 (0.0008) [2023-12-28 06:24:15,340][106226] Updated weights for policy 0, policy_version 1550512 (0.0008) [2023-12-28 06:24:15,835][106225] Updated weights for policy 1, policy_version 1554169 (0.0007) [2023-12-28 06:24:15,893][106225] Updated weights for policy 1, policy_version 1554179 (0.0009) [2023-12-28 06:24:15,943][106225] Updated weights for policy 1, policy_version 1554189 (0.0008) [2023-12-28 06:24:15,992][106225] Updated weights for policy 1, policy_version 1554199 (0.0008) [2023-12-28 06:24:16,112][106226] Updated weights for policy 0, policy_version 1550522 (0.0009) [2023-12-28 06:24:16,161][106226] Updated weights for policy 0, policy_version 1550532 (0.0008) [2023-12-28 06:24:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 794935296. Throughput: 0: 10020.1, 1: 9656.7. Samples: 794926324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:16,175][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.641')] [2023-12-28 06:24:16,217][106226] Updated weights for policy 0, policy_version 1550542 (0.0009) [2023-12-28 06:24:16,272][106226] Updated weights for policy 0, policy_version 1550552 (0.0008) [2023-12-28 06:24:16,738][106225] Updated weights for policy 1, policy_version 1554209 (0.0009) [2023-12-28 06:24:16,796][106225] Updated weights for policy 1, policy_version 1554219 (0.0009) [2023-12-28 06:24:16,860][106225] Updated weights for policy 1, policy_version 1554229 (0.0008) [2023-12-28 06:24:16,918][106226] Updated weights for policy 0, policy_version 1550562 (0.0008) [2023-12-28 06:24:16,968][106226] Updated weights for policy 0, policy_version 1550572 (0.0009) [2023-12-28 06:24:17,027][106226] Updated weights for policy 0, policy_version 1550582 (0.0008) [2023-12-28 06:24:17,600][106225] Updated weights for policy 1, policy_version 1554239 (0.0009) [2023-12-28 06:24:17,653][106225] Updated weights for policy 1, policy_version 1554249 (0.0008) [2023-12-28 06:24:17,704][106225] Updated weights for policy 1, policy_version 1554260 (0.0010) [2023-12-28 06:24:17,716][106226] Updated weights for policy 0, policy_version 1550592 (0.0006) [2023-12-28 06:24:17,770][106226] Updated weights for policy 0, policy_version 1550602 (0.0005) [2023-12-28 06:24:17,823][106226] Updated weights for policy 0, policy_version 1550612 (0.0005) [2023-12-28 06:24:18,504][106225] Updated weights for policy 1, policy_version 1554270 (0.0008) [2023-12-28 06:24:18,505][106226] Updated weights for policy 0, policy_version 1550622 (0.0008) [2023-12-28 06:24:18,562][106225] Updated weights for policy 1, policy_version 1554280 (0.0006) [2023-12-28 06:24:18,564][106226] Updated weights for policy 0, policy_version 1550632 (0.0006) [2023-12-28 06:24:18,628][106225] Updated weights for policy 1, policy_version 1554290 (0.0007) [2023-12-28 06:24:18,630][106226] Updated weights for policy 0, policy_version 1550642 (0.0008) [2023-12-28 06:24:19,262][106226] Updated weights for policy 0, policy_version 1550652 (0.0007) [2023-12-28 06:24:19,323][106226] Updated weights for policy 0, policy_version 1550662 (0.0009) [2023-12-28 06:24:19,334][106225] Updated weights for policy 1, policy_version 1554300 (0.0008) [2023-12-28 06:24:19,392][106226] Updated weights for policy 0, policy_version 1550672 (0.0008) [2023-12-28 06:24:19,411][106225] Updated weights for policy 1, policy_version 1554310 (0.0010) [2023-12-28 06:24:19,474][106225] Updated weights for policy 1, policy_version 1554320 (0.0010) [2023-12-28 06:24:20,166][106226] Updated weights for policy 0, policy_version 1550682 (0.0009) [2023-12-28 06:24:20,219][106225] Updated weights for policy 1, policy_version 1554330 (0.0010) [2023-12-28 06:24:20,224][106226] Updated weights for policy 0, policy_version 1550692 (0.0009) [2023-12-28 06:24:20,281][106225] Updated weights for policy 1, policy_version 1554340 (0.0007) [2023-12-28 06:24:20,290][106226] Updated weights for policy 0, policy_version 1550702 (0.0010) [2023-12-28 06:24:20,341][106225] Updated weights for policy 1, policy_version 1554350 (0.0006) [2023-12-28 06:24:20,351][106226] Updated weights for policy 0, policy_version 1550712 (0.0008) [2023-12-28 06:24:20,401][106225] Updated weights for policy 1, policy_version 1554360 (0.0009) [2023-12-28 06:24:21,120][106226] Updated weights for policy 0, policy_version 1550722 (0.0008) [2023-12-28 06:24:21,155][106225] Updated weights for policy 1, policy_version 1554370 (0.0007) [2023-12-28 06:24:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 795025408. Throughput: 0: 9919.5, 1: 9678.9. Samples: 795042124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:21,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-4.489')] [2023-12-28 06:24:21,181][106226] Updated weights for policy 0, policy_version 1550732 (0.0009) [2023-12-28 06:24:21,215][106225] Updated weights for policy 1, policy_version 1554380 (0.0008) [2023-12-28 06:24:21,246][106226] Updated weights for policy 0, policy_version 1550742 (0.0008) [2023-12-28 06:24:21,295][106225] Updated weights for policy 1, policy_version 1554390 (0.0008) [2023-12-28 06:24:21,997][106225] Updated weights for policy 1, policy_version 1554400 (0.0006) [2023-12-28 06:24:22,066][106225] Updated weights for policy 1, policy_version 1554410 (0.0007) [2023-12-28 06:24:22,072][106226] Updated weights for policy 0, policy_version 1550752 (0.0007) [2023-12-28 06:24:22,132][106225] Updated weights for policy 1, policy_version 1554420 (0.0006) [2023-12-28 06:24:22,141][106226] Updated weights for policy 0, policy_version 1550762 (0.0008) [2023-12-28 06:24:22,207][106226] Updated weights for policy 0, policy_version 1550772 (0.0008) [2023-12-28 06:24:22,854][106225] Updated weights for policy 1, policy_version 1554430 (0.0008) [2023-12-28 06:24:22,913][106225] Updated weights for policy 1, policy_version 1554440 (0.0008) [2023-12-28 06:24:22,954][106226] Updated weights for policy 0, policy_version 1550782 (0.0009) [2023-12-28 06:24:22,968][106225] Updated weights for policy 1, policy_version 1554450 (0.0006) [2023-12-28 06:24:23,001][106226] Updated weights for policy 0, policy_version 1550792 (0.0011) [2023-12-28 06:24:23,066][106226] Updated weights for policy 0, policy_version 1550802 (0.0011) [2023-12-28 06:24:23,587][106225] Updated weights for policy 1, policy_version 1554460 (0.0005) [2023-12-28 06:24:23,652][106225] Updated weights for policy 1, policy_version 1554470 (0.0005) [2023-12-28 06:24:23,716][106225] Updated weights for policy 1, policy_version 1554480 (0.0005) [2023-12-28 06:24:23,747][106226] Updated weights for policy 0, policy_version 1550812 (0.0008) [2023-12-28 06:24:23,794][106226] Updated weights for policy 0, policy_version 1550822 (0.0005) [2023-12-28 06:24:23,842][106226] Updated weights for policy 0, policy_version 1550832 (0.0005) [2023-12-28 06:24:24,336][106225] Updated weights for policy 1, policy_version 1554490 (0.0007) [2023-12-28 06:24:24,386][106225] Updated weights for policy 1, policy_version 1554500 (0.0008) [2023-12-28 06:24:24,436][106225] Updated weights for policy 1, policy_version 1554510 (0.0008) [2023-12-28 06:24:24,494][106225] Updated weights for policy 1, policy_version 1554520 (0.0008) [2023-12-28 06:24:24,502][106226] Updated weights for policy 0, policy_version 1550842 (0.0006) [2023-12-28 06:24:24,549][106226] Updated weights for policy 0, policy_version 1550852 (0.0010) [2023-12-28 06:24:24,602][106226] Updated weights for policy 0, policy_version 1550862 (0.0010) [2023-12-28 06:24:24,651][106226] Updated weights for policy 0, policy_version 1550872 (0.0009) [2023-12-28 06:24:25,176][106225] Updated weights for policy 1, policy_version 1554530 (0.0009) [2023-12-28 06:24:25,236][106225] Updated weights for policy 1, policy_version 1554540 (0.0007) [2023-12-28 06:24:25,282][106226] Updated weights for policy 0, policy_version 1550882 (0.0010) [2023-12-28 06:24:25,294][106225] Updated weights for policy 1, policy_version 1554550 (0.0006) [2023-12-28 06:24:25,337][106226] Updated weights for policy 0, policy_version 1550892 (0.0008) [2023-12-28 06:24:25,397][106226] Updated weights for policy 0, policy_version 1550902 (0.0010) [2023-12-28 06:24:25,919][106225] Updated weights for policy 1, policy_version 1554560 (0.0008) [2023-12-28 06:24:25,970][106225] Updated weights for policy 1, policy_version 1554570 (0.0005) [2023-12-28 06:24:26,031][106225] Updated weights for policy 1, policy_version 1554580 (0.0008) [2023-12-28 06:24:26,104][106226] Updated weights for policy 0, policy_version 1550912 (0.0006) [2023-12-28 06:24:26,160][106226] Updated weights for policy 0, policy_version 1550922 (0.0005) [2023-12-28 06:24:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 795131904. Throughput: 0: 9887.8, 1: 9710.7. Samples: 795101012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:26,176][105115] Avg episode reward: [(0, '-4.739'), (1, '-4.776')] [2023-12-28 06:24:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001554584_398024704.pth... [2023-12-28 06:24:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001553432_397729792.pth [2023-12-28 06:24:26,222][106226] Updated weights for policy 0, policy_version 1550932 (0.0007) [2023-12-28 06:24:26,250][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001550936_397115392.pth... [2023-12-28 06:24:26,255][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001549752_396812288.pth [2023-12-28 06:24:26,627][106225] Updated weights for policy 1, policy_version 1554590 (0.0006) [2023-12-28 06:24:26,672][106225] Updated weights for policy 1, policy_version 1554600 (0.0005) [2023-12-28 06:24:26,718][106225] Updated weights for policy 1, policy_version 1554610 (0.0005) [2023-12-28 06:24:26,964][106226] Updated weights for policy 0, policy_version 1550942 (0.0008) [2023-12-28 06:24:27,011][106226] Updated weights for policy 0, policy_version 1550952 (0.0008) [2023-12-28 06:24:27,060][106226] Updated weights for policy 0, policy_version 1550962 (0.0008) [2023-12-28 06:24:27,380][106225] Updated weights for policy 1, policy_version 1554620 (0.0007) [2023-12-28 06:24:27,430][106225] Updated weights for policy 1, policy_version 1554630 (0.0007) [2023-12-28 06:24:27,488][106225] Updated weights for policy 1, policy_version 1554640 (0.0008) [2023-12-28 06:24:27,761][106226] Updated weights for policy 0, policy_version 1550972 (0.0009) [2023-12-28 06:24:27,806][106226] Updated weights for policy 0, policy_version 1550982 (0.0008) [2023-12-28 06:24:27,850][106226] Updated weights for policy 0, policy_version 1550992 (0.0008) [2023-12-28 06:24:28,212][106225] Updated weights for policy 1, policy_version 1554650 (0.0009) [2023-12-28 06:24:28,260][106225] Updated weights for policy 1, policy_version 1554660 (0.0008) [2023-12-28 06:24:28,308][106225] Updated weights for policy 1, policy_version 1554670 (0.0008) [2023-12-28 06:24:28,370][106225] Updated weights for policy 1, policy_version 1554680 (0.0009) [2023-12-28 06:24:28,610][106226] Updated weights for policy 0, policy_version 1551002 (0.0008) [2023-12-28 06:24:28,662][106226] Updated weights for policy 0, policy_version 1551012 (0.0008) [2023-12-28 06:24:28,714][106226] Updated weights for policy 0, policy_version 1551022 (0.0008) [2023-12-28 06:24:28,776][106226] Updated weights for policy 0, policy_version 1551032 (0.0008) [2023-12-28 06:24:29,105][106225] Updated weights for policy 1, policy_version 1554690 (0.0007) [2023-12-28 06:24:29,154][106225] Updated weights for policy 1, policy_version 1554700 (0.0006) [2023-12-28 06:24:29,213][106225] Updated weights for policy 1, policy_version 1554710 (0.0008) [2023-12-28 06:24:29,484][106226] Updated weights for policy 0, policy_version 1551042 (0.0008) [2023-12-28 06:24:29,553][106226] Updated weights for policy 0, policy_version 1551052 (0.0009) [2023-12-28 06:24:29,617][106226] Updated weights for policy 0, policy_version 1551062 (0.0008) [2023-12-28 06:24:29,967][106225] Updated weights for policy 1, policy_version 1554720 (0.0008) [2023-12-28 06:24:30,033][106225] Updated weights for policy 1, policy_version 1554730 (0.0006) [2023-12-28 06:24:30,084][106225] Updated weights for policy 1, policy_version 1554740 (0.0005) [2023-12-28 06:24:30,355][106226] Updated weights for policy 0, policy_version 1551072 (0.0007) [2023-12-28 06:24:30,411][106226] Updated weights for policy 0, policy_version 1551082 (0.0008) [2023-12-28 06:24:30,467][106226] Updated weights for policy 0, policy_version 1551092 (0.0009) [2023-12-28 06:24:30,815][106225] Updated weights for policy 1, policy_version 1554750 (0.0007) [2023-12-28 06:24:30,862][106225] Updated weights for policy 1, policy_version 1554760 (0.0008) [2023-12-28 06:24:30,907][106225] Updated weights for policy 1, policy_version 1554770 (0.0008) [2023-12-28 06:24:31,086][106226] Updated weights for policy 0, policy_version 1551102 (0.0009) [2023-12-28 06:24:31,151][106226] Updated weights for policy 0, policy_version 1551112 (0.0009) [2023-12-28 06:24:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 795230208. Throughput: 0: 9954.8, 1: 9846.1. Samples: 795222124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:31,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.670')] [2023-12-28 06:24:31,206][106226] Updated weights for policy 0, policy_version 1551122 (0.0008) [2023-12-28 06:24:31,679][106225] Updated weights for policy 1, policy_version 1554780 (0.0007) [2023-12-28 06:24:31,747][106225] Updated weights for policy 1, policy_version 1554790 (0.0008) [2023-12-28 06:24:31,803][106225] Updated weights for policy 1, policy_version 1554800 (0.0007) [2023-12-28 06:24:31,997][106226] Updated weights for policy 0, policy_version 1551132 (0.0008) [2023-12-28 06:24:32,045][106226] Updated weights for policy 0, policy_version 1551142 (0.0008) [2023-12-28 06:24:32,095][106226] Updated weights for policy 0, policy_version 1551152 (0.0007) [2023-12-28 06:24:32,509][106225] Updated weights for policy 1, policy_version 1554810 (0.0006) [2023-12-28 06:24:32,563][106225] Updated weights for policy 1, policy_version 1554820 (0.0008) [2023-12-28 06:24:32,622][106225] Updated weights for policy 1, policy_version 1554830 (0.0008) [2023-12-28 06:24:32,677][106225] Updated weights for policy 1, policy_version 1554840 (0.0008) [2023-12-28 06:24:32,874][106226] Updated weights for policy 0, policy_version 1551162 (0.0008) [2023-12-28 06:24:32,931][106226] Updated weights for policy 0, policy_version 1551172 (0.0005) [2023-12-28 06:24:32,977][106226] Updated weights for policy 0, policy_version 1551182 (0.0005) [2023-12-28 06:24:33,030][106226] Updated weights for policy 0, policy_version 1551192 (0.0005) [2023-12-28 06:24:33,496][106225] Updated weights for policy 1, policy_version 1554850 (0.0007) [2023-12-28 06:24:33,562][106225] Updated weights for policy 1, policy_version 1554860 (0.0008) [2023-12-28 06:24:33,622][106226] Updated weights for policy 0, policy_version 1551202 (0.0011) [2023-12-28 06:24:33,628][106225] Updated weights for policy 1, policy_version 1554870 (0.0006) [2023-12-28 06:24:33,683][106226] Updated weights for policy 0, policy_version 1551212 (0.0010) [2023-12-28 06:24:33,733][106226] Updated weights for policy 0, policy_version 1551222 (0.0010) [2023-12-28 06:24:34,321][106225] Updated weights for policy 1, policy_version 1554880 (0.0008) [2023-12-28 06:24:34,381][106225] Updated weights for policy 1, policy_version 1554890 (0.0008) [2023-12-28 06:24:34,435][106225] Updated weights for policy 1, policy_version 1554900 (0.0007) [2023-12-28 06:24:34,461][106226] Updated weights for policy 0, policy_version 1551232 (0.0008) [2023-12-28 06:24:34,517][106226] Updated weights for policy 0, policy_version 1551242 (0.0008) [2023-12-28 06:24:34,583][106226] Updated weights for policy 0, policy_version 1551252 (0.0009) [2023-12-28 06:24:35,182][106226] Updated weights for policy 0, policy_version 1551262 (0.0008) [2023-12-28 06:24:35,233][106225] Updated weights for policy 1, policy_version 1554910 (0.0007) [2023-12-28 06:24:35,235][106226] Updated weights for policy 0, policy_version 1551272 (0.0007) [2023-12-28 06:24:35,283][106225] Updated weights for policy 1, policy_version 1554920 (0.0006) [2023-12-28 06:24:35,286][106226] Updated weights for policy 0, policy_version 1551282 (0.0007) [2023-12-28 06:24:35,330][106225] Updated weights for policy 1, policy_version 1554930 (0.0007) [2023-12-28 06:24:35,871][106226] Updated weights for policy 0, policy_version 1551292 (0.0007) [2023-12-28 06:24:35,928][106226] Updated weights for policy 0, policy_version 1551302 (0.0006) [2023-12-28 06:24:35,989][106226] Updated weights for policy 0, policy_version 1551312 (0.0006) [2023-12-28 06:24:36,042][106225] Updated weights for policy 1, policy_version 1554940 (0.0005) [2023-12-28 06:24:36,100][106225] Updated weights for policy 1, policy_version 1554950 (0.0007) [2023-12-28 06:24:36,171][106225] Updated weights for policy 1, policy_version 1554960 (0.0006) [2023-12-28 06:24:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 795328512. Throughput: 0: 10006.9, 1: 9853.9. Samples: 795340584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:36,175][105115] Avg episode reward: [(0, '-5.027'), (1, '-4.797')] [2023-12-28 06:24:36,678][106226] Updated weights for policy 0, policy_version 1551322 (0.0006) [2023-12-28 06:24:36,734][106226] Updated weights for policy 0, policy_version 1551332 (0.0008) [2023-12-28 06:24:36,819][106225] Updated weights for policy 1, policy_version 1554970 (0.0006) [2023-12-28 06:24:36,822][106226] Updated weights for policy 0, policy_version 1551342 (0.0008) [2023-12-28 06:24:36,881][106225] Updated weights for policy 1, policy_version 1554980 (0.0006) [2023-12-28 06:24:36,886][106226] Updated weights for policy 0, policy_version 1551352 (0.0008) [2023-12-28 06:24:36,938][106225] Updated weights for policy 1, policy_version 1554990 (0.0008) [2023-12-28 06:24:36,991][106225] Updated weights for policy 1, policy_version 1555000 (0.0008) [2023-12-28 06:24:37,607][106226] Updated weights for policy 0, policy_version 1551362 (0.0009) [2023-12-28 06:24:37,666][106226] Updated weights for policy 0, policy_version 1551372 (0.0008) [2023-12-28 06:24:37,718][106225] Updated weights for policy 1, policy_version 1555010 (0.0008) [2023-12-28 06:24:37,722][106226] Updated weights for policy 0, policy_version 1551382 (0.0006) [2023-12-28 06:24:37,776][106225] Updated weights for policy 1, policy_version 1555020 (0.0009) [2023-12-28 06:24:37,830][106225] Updated weights for policy 1, policy_version 1555030 (0.0008) [2023-12-28 06:24:38,355][106226] Updated weights for policy 0, policy_version 1551392 (0.0009) [2023-12-28 06:24:38,411][106226] Updated weights for policy 0, policy_version 1551402 (0.0008) [2023-12-28 06:24:38,480][106226] Updated weights for policy 0, policy_version 1551412 (0.0009) [2023-12-28 06:24:38,657][106225] Updated weights for policy 1, policy_version 1555040 (0.0009) [2023-12-28 06:24:38,717][106225] Updated weights for policy 1, policy_version 1555050 (0.0008) [2023-12-28 06:24:38,776][106225] Updated weights for policy 1, policy_version 1555060 (0.0008) [2023-12-28 06:24:39,194][106226] Updated weights for policy 0, policy_version 1551422 (0.0007) [2023-12-28 06:24:39,263][106226] Updated weights for policy 0, policy_version 1551432 (0.0007) [2023-12-28 06:24:39,326][106226] Updated weights for policy 0, policy_version 1551442 (0.0008) [2023-12-28 06:24:39,533][106225] Updated weights for policy 1, policy_version 1555070 (0.0008) [2023-12-28 06:24:39,599][106225] Updated weights for policy 1, policy_version 1555080 (0.0008) [2023-12-28 06:24:39,649][106225] Updated weights for policy 1, policy_version 1555090 (0.0006) [2023-12-28 06:24:40,184][106226] Updated weights for policy 0, policy_version 1551452 (0.0009) [2023-12-28 06:24:40,244][106226] Updated weights for policy 0, policy_version 1551462 (0.0009) [2023-12-28 06:24:40,304][106226] Updated weights for policy 0, policy_version 1551472 (0.0009) [2023-12-28 06:24:40,389][106225] Updated weights for policy 1, policy_version 1555100 (0.0007) [2023-12-28 06:24:40,450][106225] Updated weights for policy 1, policy_version 1555110 (0.0008) [2023-12-28 06:24:40,506][106225] Updated weights for policy 1, policy_version 1555120 (0.0009) [2023-12-28 06:24:40,964][106226] Updated weights for policy 0, policy_version 1551482 (0.0009) [2023-12-28 06:24:41,036][106226] Updated weights for policy 0, policy_version 1551492 (0.0008) [2023-12-28 06:24:41,102][106226] Updated weights for policy 0, policy_version 1551502 (0.0008) [2023-12-28 06:24:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 795418624. Throughput: 0: 9997.0, 1: 9817.8. Samples: 795398080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:41,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.582')] [2023-12-28 06:24:41,180][106226] Updated weights for policy 0, policy_version 1551512 (0.0008) [2023-12-28 06:24:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001555128_398163968.pth... [2023-12-28 06:24:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001551512_397262848.pth... [2023-12-28 06:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001550360_396967936.pth [2023-12-28 06:24:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001554008_397877248.pth [2023-12-28 06:24:41,336][106225] Updated weights for policy 1, policy_version 1555130 (0.0009) [2023-12-28 06:24:41,409][106225] Updated weights for policy 1, policy_version 1555140 (0.0009) [2023-12-28 06:24:41,474][106225] Updated weights for policy 1, policy_version 1555150 (0.0006) [2023-12-28 06:24:41,542][106225] Updated weights for policy 1, policy_version 1555160 (0.0008) [2023-12-28 06:24:41,945][106226] Updated weights for policy 0, policy_version 1551522 (0.0010) [2023-12-28 06:24:42,009][106226] Updated weights for policy 0, policy_version 1551532 (0.0010) [2023-12-28 06:24:42,074][106226] Updated weights for policy 0, policy_version 1551542 (0.0008) [2023-12-28 06:24:42,235][106225] Updated weights for policy 1, policy_version 1555170 (0.0008) [2023-12-28 06:24:42,303][106225] Updated weights for policy 1, policy_version 1555180 (0.0008) [2023-12-28 06:24:42,367][106225] Updated weights for policy 1, policy_version 1555190 (0.0008) [2023-12-28 06:24:42,773][106226] Updated weights for policy 0, policy_version 1551552 (0.0008) [2023-12-28 06:24:42,836][106226] Updated weights for policy 0, policy_version 1551562 (0.0009) [2023-12-28 06:24:42,893][106226] Updated weights for policy 0, policy_version 1551572 (0.0008) [2023-12-28 06:24:43,069][106225] Updated weights for policy 1, policy_version 1555200 (0.0009) [2023-12-28 06:24:43,126][106225] Updated weights for policy 1, policy_version 1555210 (0.0009) [2023-12-28 06:24:43,180][106225] Updated weights for policy 1, policy_version 1555220 (0.0008) [2023-12-28 06:24:43,579][106226] Updated weights for policy 0, policy_version 1551582 (0.0005) [2023-12-28 06:24:43,647][106226] Updated weights for policy 0, policy_version 1551592 (0.0005) [2023-12-28 06:24:43,713][106226] Updated weights for policy 0, policy_version 1551602 (0.0006) [2023-12-28 06:24:43,943][106225] Updated weights for policy 1, policy_version 1555230 (0.0008) [2023-12-28 06:24:43,993][106225] Updated weights for policy 1, policy_version 1555240 (0.0008) [2023-12-28 06:24:44,039][106225] Updated weights for policy 1, policy_version 1555250 (0.0008) [2023-12-28 06:24:44,365][106226] Updated weights for policy 0, policy_version 1551612 (0.0009) [2023-12-28 06:24:44,419][106226] Updated weights for policy 0, policy_version 1551622 (0.0008) [2023-12-28 06:24:44,475][106226] Updated weights for policy 0, policy_version 1551632 (0.0005) [2023-12-28 06:24:44,738][106225] Updated weights for policy 1, policy_version 1555260 (0.0006) [2023-12-28 06:24:44,813][106225] Updated weights for policy 1, policy_version 1555270 (0.0008) [2023-12-28 06:24:44,877][106225] Updated weights for policy 1, policy_version 1555280 (0.0009) [2023-12-28 06:24:45,096][106226] Updated weights for policy 0, policy_version 1551642 (0.0005) [2023-12-28 06:24:45,163][106226] Updated weights for policy 0, policy_version 1551652 (0.0007) [2023-12-28 06:24:45,227][106226] Updated weights for policy 0, policy_version 1551662 (0.0009) [2023-12-28 06:24:45,285][106226] Updated weights for policy 0, policy_version 1551672 (0.0008) [2023-12-28 06:24:45,568][106225] Updated weights for policy 1, policy_version 1555290 (0.0007) [2023-12-28 06:24:45,616][106225] Updated weights for policy 1, policy_version 1555300 (0.0008) [2023-12-28 06:24:45,666][106225] Updated weights for policy 1, policy_version 1555310 (0.0009) [2023-12-28 06:24:45,715][106225] Updated weights for policy 1, policy_version 1555320 (0.0009) [2023-12-28 06:24:45,940][106226] Updated weights for policy 0, policy_version 1551682 (0.0009) [2023-12-28 06:24:45,988][106226] Updated weights for policy 0, policy_version 1551692 (0.0009) [2023-12-28 06:24:46,049][106226] Updated weights for policy 0, policy_version 1551702 (0.0009) [2023-12-28 06:24:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 795525120. Throughput: 0: 9969.0, 1: 9667.6. Samples: 795512644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:46,176][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.611')] [2023-12-28 06:24:46,404][106225] Updated weights for policy 1, policy_version 1555330 (0.0009) [2023-12-28 06:24:46,470][106225] Updated weights for policy 1, policy_version 1555340 (0.0008) [2023-12-28 06:24:46,525][106225] Updated weights for policy 1, policy_version 1555350 (0.0007) [2023-12-28 06:24:46,851][106226] Updated weights for policy 0, policy_version 1551712 (0.0010) [2023-12-28 06:24:46,905][106226] Updated weights for policy 0, policy_version 1551722 (0.0009) [2023-12-28 06:24:46,960][106226] Updated weights for policy 0, policy_version 1551732 (0.0008) [2023-12-28 06:24:47,102][106225] Updated weights for policy 1, policy_version 1555360 (0.0009) [2023-12-28 06:24:47,153][106225] Updated weights for policy 1, policy_version 1555370 (0.0008) [2023-12-28 06:24:47,216][106225] Updated weights for policy 1, policy_version 1555380 (0.0006) [2023-12-28 06:24:47,579][106226] Updated weights for policy 0, policy_version 1551742 (0.0006) [2023-12-28 06:24:47,640][106226] Updated weights for policy 0, policy_version 1551752 (0.0005) [2023-12-28 06:24:47,695][106226] Updated weights for policy 0, policy_version 1551762 (0.0005) [2023-12-28 06:24:47,865][106225] Updated weights for policy 1, policy_version 1555390 (0.0006) [2023-12-28 06:24:47,922][106225] Updated weights for policy 1, policy_version 1555400 (0.0006) [2023-12-28 06:24:47,977][106225] Updated weights for policy 1, policy_version 1555410 (0.0006) [2023-12-28 06:24:48,338][106226] Updated weights for policy 0, policy_version 1551772 (0.0008) [2023-12-28 06:24:48,399][106226] Updated weights for policy 0, policy_version 1551782 (0.0009) [2023-12-28 06:24:48,459][106226] Updated weights for policy 0, policy_version 1551792 (0.0011) [2023-12-28 06:24:48,719][106225] Updated weights for policy 1, policy_version 1555420 (0.0008) [2023-12-28 06:24:48,784][106225] Updated weights for policy 1, policy_version 1555430 (0.0011) [2023-12-28 06:24:48,849][106225] Updated weights for policy 1, policy_version 1555440 (0.0011) [2023-12-28 06:24:49,121][106226] Updated weights for policy 0, policy_version 1551802 (0.0011) [2023-12-28 06:24:49,188][106226] Updated weights for policy 0, policy_version 1551812 (0.0011) [2023-12-28 06:24:49,254][106226] Updated weights for policy 0, policy_version 1551822 (0.0010) [2023-12-28 06:24:49,315][106226] Updated weights for policy 0, policy_version 1551832 (0.0011) [2023-12-28 06:24:49,598][106225] Updated weights for policy 1, policy_version 1555450 (0.0010) [2023-12-28 06:24:49,660][106225] Updated weights for policy 1, policy_version 1555460 (0.0010) [2023-12-28 06:24:49,715][106225] Updated weights for policy 1, policy_version 1555470 (0.0010) [2023-12-28 06:24:49,779][106225] Updated weights for policy 1, policy_version 1555480 (0.0010) [2023-12-28 06:24:50,040][106226] Updated weights for policy 0, policy_version 1551842 (0.0008) [2023-12-28 06:24:50,106][106226] Updated weights for policy 0, policy_version 1551852 (0.0006) [2023-12-28 06:24:50,170][106226] Updated weights for policy 0, policy_version 1551862 (0.0011) [2023-12-28 06:24:50,523][106225] Updated weights for policy 1, policy_version 1555490 (0.0008) [2023-12-28 06:24:50,580][106225] Updated weights for policy 1, policy_version 1555500 (0.0007) [2023-12-28 06:24:50,637][106225] Updated weights for policy 1, policy_version 1555510 (0.0008) [2023-12-28 06:24:50,856][106226] Updated weights for policy 0, policy_version 1551872 (0.0007) [2023-12-28 06:24:50,928][106226] Updated weights for policy 0, policy_version 1551882 (0.0006) [2023-12-28 06:24:50,989][106226] Updated weights for policy 0, policy_version 1551892 (0.0006) [2023-12-28 06:24:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 795623424. Throughput: 0: 9898.5, 1: 9662.1. Samples: 795632124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:51,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.667')] [2023-12-28 06:24:51,431][106225] Updated weights for policy 1, policy_version 1555520 (0.0008) [2023-12-28 06:24:51,491][106225] Updated weights for policy 1, policy_version 1555530 (0.0009) [2023-12-28 06:24:51,556][106225] Updated weights for policy 1, policy_version 1555540 (0.0006) [2023-12-28 06:24:51,697][106226] Updated weights for policy 0, policy_version 1551902 (0.0007) [2023-12-28 06:24:51,766][106226] Updated weights for policy 0, policy_version 1551912 (0.0009) [2023-12-28 06:24:51,828][106226] Updated weights for policy 0, policy_version 1551922 (0.0008) [2023-12-28 06:24:52,274][106225] Updated weights for policy 1, policy_version 1555550 (0.0006) [2023-12-28 06:24:52,331][106225] Updated weights for policy 1, policy_version 1555560 (0.0009) [2023-12-28 06:24:52,388][106225] Updated weights for policy 1, policy_version 1555570 (0.0008) [2023-12-28 06:24:52,555][106226] Updated weights for policy 0, policy_version 1551932 (0.0009) [2023-12-28 06:24:52,607][106226] Updated weights for policy 0, policy_version 1551942 (0.0006) [2023-12-28 06:24:52,665][106226] Updated weights for policy 0, policy_version 1551952 (0.0006) [2023-12-28 06:24:53,191][106225] Updated weights for policy 1, policy_version 1555580 (0.0009) [2023-12-28 06:24:53,249][106225] Updated weights for policy 1, policy_version 1555590 (0.0010) [2023-12-28 06:24:53,264][106226] Updated weights for policy 0, policy_version 1551962 (0.0005) [2023-12-28 06:24:53,310][106225] Updated weights for policy 1, policy_version 1555600 (0.0010) [2023-12-28 06:24:53,322][106226] Updated weights for policy 0, policy_version 1551972 (0.0006) [2023-12-28 06:24:53,389][106226] Updated weights for policy 0, policy_version 1551982 (0.0008) [2023-12-28 06:24:53,449][106226] Updated weights for policy 0, policy_version 1551992 (0.0008) [2023-12-28 06:24:54,021][106225] Updated weights for policy 1, policy_version 1555610 (0.0010) [2023-12-28 06:24:54,087][106225] Updated weights for policy 1, policy_version 1555620 (0.0008) [2023-12-28 06:24:54,133][106226] Updated weights for policy 0, policy_version 1552002 (0.0008) [2023-12-28 06:24:54,139][106225] Updated weights for policy 1, policy_version 1555630 (0.0006) [2023-12-28 06:24:54,179][106226] Updated weights for policy 0, policy_version 1552012 (0.0005) [2023-12-28 06:24:54,184][106225] Updated weights for policy 1, policy_version 1555640 (0.0009) [2023-12-28 06:24:54,232][106226] Updated weights for policy 0, policy_version 1552022 (0.0009) [2023-12-28 06:24:54,775][106225] Updated weights for policy 1, policy_version 1555650 (0.0005) [2023-12-28 06:24:54,826][106225] Updated weights for policy 1, policy_version 1555660 (0.0005) [2023-12-28 06:24:54,893][106225] Updated weights for policy 1, policy_version 1555670 (0.0005) [2023-12-28 06:24:55,029][106226] Updated weights for policy 0, policy_version 1552032 (0.0007) [2023-12-28 06:24:55,080][106226] Updated weights for policy 0, policy_version 1552042 (0.0005) [2023-12-28 06:24:55,138][106226] Updated weights for policy 0, policy_version 1552052 (0.0008) [2023-12-28 06:24:55,420][106225] Updated weights for policy 1, policy_version 1555680 (0.0005) [2023-12-28 06:24:55,479][106225] Updated weights for policy 1, policy_version 1555690 (0.0005) [2023-12-28 06:24:55,545][106225] Updated weights for policy 1, policy_version 1555700 (0.0005) [2023-12-28 06:24:55,862][106226] Updated weights for policy 0, policy_version 1552062 (0.0010) [2023-12-28 06:24:55,908][106226] Updated weights for policy 0, policy_version 1552072 (0.0010) [2023-12-28 06:24:55,958][106226] Updated weights for policy 0, policy_version 1552082 (0.0010) [2023-12-28 06:24:56,071][106225] Updated weights for policy 1, policy_version 1555710 (0.0007) [2023-12-28 06:24:56,138][106225] Updated weights for policy 1, policy_version 1555720 (0.0006) [2023-12-28 06:24:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 795721728. Throughput: 0: 9873.2, 1: 9621.1. Samples: 795689912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:24:56,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-4.823')] [2023-12-28 06:24:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001552088_397410304.pth... [2023-12-28 06:24:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001550936_397115392.pth [2023-12-28 06:24:56,200][106225] Updated weights for policy 1, policy_version 1555730 (0.0006) [2023-12-28 06:24:56,231][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001555736_398319616.pth... [2023-12-28 06:24:56,234][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001554584_398024704.pth [2023-12-28 06:24:56,625][106226] Updated weights for policy 0, policy_version 1552092 (0.0009) [2023-12-28 06:24:56,683][106226] Updated weights for policy 0, policy_version 1552102 (0.0010) [2023-12-28 06:24:56,745][106226] Updated weights for policy 0, policy_version 1552112 (0.0010) [2023-12-28 06:24:56,760][106225] Updated weights for policy 1, policy_version 1555740 (0.0005) [2023-12-28 06:24:56,820][106225] Updated weights for policy 1, policy_version 1555750 (0.0009) [2023-12-28 06:24:56,879][106225] Updated weights for policy 1, policy_version 1555760 (0.0010) [2023-12-28 06:24:57,437][106226] Updated weights for policy 0, policy_version 1552122 (0.0010) [2023-12-28 06:24:57,496][106226] Updated weights for policy 0, policy_version 1552132 (0.0006) [2023-12-28 06:24:57,561][106226] Updated weights for policy 0, policy_version 1552142 (0.0006) [2023-12-28 06:24:57,563][106225] Updated weights for policy 1, policy_version 1555770 (0.0010) [2023-12-28 06:24:57,609][106225] Updated weights for policy 1, policy_version 1555780 (0.0010) [2023-12-28 06:24:57,615][106226] Updated weights for policy 0, policy_version 1552152 (0.0005) [2023-12-28 06:24:57,652][106225] Updated weights for policy 1, policy_version 1555790 (0.0010) [2023-12-28 06:24:57,698][106225] Updated weights for policy 1, policy_version 1555800 (0.0010) [2023-12-28 06:24:58,198][106226] Updated weights for policy 0, policy_version 1552162 (0.0005) [2023-12-28 06:24:58,270][106226] Updated weights for policy 0, policy_version 1552172 (0.0007) [2023-12-28 06:24:58,332][106226] Updated weights for policy 0, policy_version 1552182 (0.0008) [2023-12-28 06:24:58,345][106225] Updated weights for policy 1, policy_version 1555810 (0.0007) [2023-12-28 06:24:58,413][106225] Updated weights for policy 1, policy_version 1555820 (0.0008) [2023-12-28 06:24:58,477][106225] Updated weights for policy 1, policy_version 1555830 (0.0008) [2023-12-28 06:24:59,109][106226] Updated weights for policy 0, policy_version 1552192 (0.0012) [2023-12-28 06:24:59,170][106226] Updated weights for policy 0, policy_version 1552202 (0.0009) [2023-12-28 06:24:59,240][106226] Updated weights for policy 0, policy_version 1552212 (0.0010) [2023-12-28 06:24:59,275][106225] Updated weights for policy 1, policy_version 1555840 (0.0009) [2023-12-28 06:24:59,339][106225] Updated weights for policy 1, policy_version 1555850 (0.0009) [2023-12-28 06:24:59,408][106225] Updated weights for policy 1, policy_version 1555860 (0.0009) [2023-12-28 06:24:59,918][106226] Updated weights for policy 0, policy_version 1552222 (0.0006) [2023-12-28 06:24:59,989][106226] Updated weights for policy 0, policy_version 1552232 (0.0007) [2023-12-28 06:25:00,055][106226] Updated weights for policy 0, policy_version 1552242 (0.0006) [2023-12-28 06:25:00,166][106225] Updated weights for policy 1, policy_version 1555870 (0.0006) [2023-12-28 06:25:00,237][106225] Updated weights for policy 1, policy_version 1555880 (0.0006) [2023-12-28 06:25:00,306][106225] Updated weights for policy 1, policy_version 1555890 (0.0009) [2023-12-28 06:25:00,659][106226] Updated weights for policy 0, policy_version 1552252 (0.0007) [2023-12-28 06:25:00,702][106226] Updated weights for policy 0, policy_version 1552262 (0.0008) [2023-12-28 06:25:00,749][106226] Updated weights for policy 0, policy_version 1552272 (0.0008) [2023-12-28 06:25:00,965][106225] Updated weights for policy 1, policy_version 1555900 (0.0009) [2023-12-28 06:25:01,019][106225] Updated weights for policy 1, policy_version 1555910 (0.0009) [2023-12-28 06:25:01,088][106225] Updated weights for policy 1, policy_version 1555920 (0.0008) [2023-12-28 06:25:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 795828224. Throughput: 0: 9891.6, 1: 9813.9. Samples: 795813068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:01,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.731')] [2023-12-28 06:25:01,515][106226] Updated weights for policy 0, policy_version 1552282 (0.0008) [2023-12-28 06:25:01,576][106226] Updated weights for policy 0, policy_version 1552292 (0.0008) [2023-12-28 06:25:01,642][106226] Updated weights for policy 0, policy_version 1552302 (0.0008) [2023-12-28 06:25:01,704][106226] Updated weights for policy 0, policy_version 1552312 (0.0006) [2023-12-28 06:25:01,820][106225] Updated weights for policy 1, policy_version 1555930 (0.0008) [2023-12-28 06:25:01,874][106225] Updated weights for policy 1, policy_version 1555940 (0.0008) [2023-12-28 06:25:01,932][106225] Updated weights for policy 1, policy_version 1555950 (0.0007) [2023-12-28 06:25:02,001][106225] Updated weights for policy 1, policy_version 1555960 (0.0005) [2023-12-28 06:25:02,405][106226] Updated weights for policy 0, policy_version 1552322 (0.0008) [2023-12-28 06:25:02,475][106226] Updated weights for policy 0, policy_version 1552332 (0.0008) [2023-12-28 06:25:02,540][106226] Updated weights for policy 0, policy_version 1552342 (0.0008) [2023-12-28 06:25:02,641][106225] Updated weights for policy 1, policy_version 1555970 (0.0005) [2023-12-28 06:25:02,709][106225] Updated weights for policy 1, policy_version 1555980 (0.0006) [2023-12-28 06:25:02,758][106225] Updated weights for policy 1, policy_version 1555990 (0.0009) [2023-12-28 06:25:03,132][106226] Updated weights for policy 0, policy_version 1552352 (0.0006) [2023-12-28 06:25:03,188][106226] Updated weights for policy 0, policy_version 1552362 (0.0005) [2023-12-28 06:25:03,246][106226] Updated weights for policy 0, policy_version 1552372 (0.0005) [2023-12-28 06:25:03,508][106225] Updated weights for policy 1, policy_version 1556000 (0.0009) [2023-12-28 06:25:03,562][106225] Updated weights for policy 1, policy_version 1556010 (0.0007) [2023-12-28 06:25:03,616][106225] Updated weights for policy 1, policy_version 1556020 (0.0009) [2023-12-28 06:25:03,876][106226] Updated weights for policy 0, policy_version 1552382 (0.0010) [2023-12-28 06:25:03,938][106226] Updated weights for policy 0, policy_version 1552392 (0.0011) [2023-12-28 06:25:03,999][106226] Updated weights for policy 0, policy_version 1552402 (0.0011) [2023-12-28 06:25:04,415][106225] Updated weights for policy 1, policy_version 1556030 (0.0008) [2023-12-28 06:25:04,468][106225] Updated weights for policy 1, policy_version 1556040 (0.0008) [2023-12-28 06:25:04,519][106225] Updated weights for policy 1, policy_version 1556050 (0.0008) [2023-12-28 06:25:04,683][106226] Updated weights for policy 0, policy_version 1552412 (0.0008) [2023-12-28 06:25:04,732][106226] Updated weights for policy 0, policy_version 1552422 (0.0005) [2023-12-28 06:25:04,789][106226] Updated weights for policy 0, policy_version 1552432 (0.0005) [2023-12-28 06:25:05,355][106225] Updated weights for policy 1, policy_version 1556060 (0.0008) [2023-12-28 06:25:05,363][106226] Updated weights for policy 0, policy_version 1552442 (0.0005) [2023-12-28 06:25:05,414][106226] Updated weights for policy 0, policy_version 1552452 (0.0005) [2023-12-28 06:25:05,416][106225] Updated weights for policy 1, policy_version 1556070 (0.0008) [2023-12-28 06:25:05,464][106226] Updated weights for policy 0, policy_version 1552462 (0.0010) [2023-12-28 06:25:05,493][106225] Updated weights for policy 1, policy_version 1556080 (0.0005) [2023-12-28 06:25:05,514][106226] Updated weights for policy 0, policy_version 1552472 (0.0010) [2023-12-28 06:25:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 795918336. Throughput: 0: 9987.1, 1: 9800.5. Samples: 795932568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:06,175][105115] Avg episode reward: [(0, '-4.734'), (1, '-4.725')] [2023-12-28 06:25:06,203][106225] Updated weights for policy 1, policy_version 1556090 (0.0007) [2023-12-28 06:25:06,244][106226] Updated weights for policy 0, policy_version 1552482 (0.0008) [2023-12-28 06:25:06,255][106225] Updated weights for policy 1, policy_version 1556100 (0.0006) [2023-12-28 06:25:06,307][106226] Updated weights for policy 0, policy_version 1552492 (0.0008) [2023-12-28 06:25:06,311][106225] Updated weights for policy 1, policy_version 1556110 (0.0010) [2023-12-28 06:25:06,369][106226] Updated weights for policy 0, policy_version 1552502 (0.0006) [2023-12-28 06:25:06,372][106225] Updated weights for policy 1, policy_version 1556120 (0.0008) [2023-12-28 06:25:06,933][106226] Updated weights for policy 0, policy_version 1552512 (0.0006) [2023-12-28 06:25:06,998][106226] Updated weights for policy 0, policy_version 1552522 (0.0007) [2023-12-28 06:25:07,058][106226] Updated weights for policy 0, policy_version 1552532 (0.0008) [2023-12-28 06:25:07,191][106225] Updated weights for policy 1, policy_version 1556130 (0.0008) [2023-12-28 06:25:07,250][106225] Updated weights for policy 1, policy_version 1556140 (0.0010) [2023-12-28 06:25:07,301][106225] Updated weights for policy 1, policy_version 1556150 (0.0009) [2023-12-28 06:25:07,684][106226] Updated weights for policy 0, policy_version 1552542 (0.0009) [2023-12-28 06:25:07,732][106226] Updated weights for policy 0, policy_version 1552552 (0.0008) [2023-12-28 06:25:07,787][106226] Updated weights for policy 0, policy_version 1552562 (0.0009) [2023-12-28 06:25:08,008][106225] Updated weights for policy 1, policy_version 1556160 (0.0007) [2023-12-28 06:25:08,057][106225] Updated weights for policy 1, policy_version 1556170 (0.0008) [2023-12-28 06:25:08,116][106225] Updated weights for policy 1, policy_version 1556180 (0.0008) [2023-12-28 06:25:08,499][106226] Updated weights for policy 0, policy_version 1552572 (0.0007) [2023-12-28 06:25:08,563][106226] Updated weights for policy 0, policy_version 1552582 (0.0007) [2023-12-28 06:25:08,627][106226] Updated weights for policy 0, policy_version 1552592 (0.0008) [2023-12-28 06:25:08,818][106225] Updated weights for policy 1, policy_version 1556190 (0.0009) [2023-12-28 06:25:08,878][106225] Updated weights for policy 1, policy_version 1556200 (0.0005) [2023-12-28 06:25:08,937][106225] Updated weights for policy 1, policy_version 1556210 (0.0005) [2023-12-28 06:25:09,407][106226] Updated weights for policy 0, policy_version 1552602 (0.0008) [2023-12-28 06:25:09,471][106226] Updated weights for policy 0, policy_version 1552612 (0.0008) [2023-12-28 06:25:09,543][106226] Updated weights for policy 0, policy_version 1552622 (0.0006) [2023-12-28 06:25:09,587][106225] Updated weights for policy 1, policy_version 1556220 (0.0006) [2023-12-28 06:25:09,609][106226] Updated weights for policy 0, policy_version 1552632 (0.0007) [2023-12-28 06:25:09,647][106225] Updated weights for policy 1, policy_version 1556230 (0.0006) [2023-12-28 06:25:09,709][106225] Updated weights for policy 1, policy_version 1556240 (0.0008) [2023-12-28 06:25:10,343][106226] Updated weights for policy 0, policy_version 1552642 (0.0008) [2023-12-28 06:25:10,411][106226] Updated weights for policy 0, policy_version 1552652 (0.0008) [2023-12-28 06:25:10,444][106225] Updated weights for policy 1, policy_version 1556250 (0.0007) [2023-12-28 06:25:10,474][106226] Updated weights for policy 0, policy_version 1552662 (0.0008) [2023-12-28 06:25:10,505][106225] Updated weights for policy 1, policy_version 1556260 (0.0010) [2023-12-28 06:25:10,566][106225] Updated weights for policy 1, policy_version 1556270 (0.0010) [2023-12-28 06:25:10,636][106225] Updated weights for policy 1, policy_version 1556280 (0.0011) [2023-12-28 06:25:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 796016640. Throughput: 0: 10041.0, 1: 9751.4. Samples: 795991664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:11,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.525')] [2023-12-28 06:25:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001556280_398458880.pth... [2023-12-28 06:25:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001555128_398163968.pth [2023-12-28 06:25:11,232][106226] Updated weights for policy 0, policy_version 1552672 (0.0007) [2023-12-28 06:25:11,297][106226] Updated weights for policy 0, policy_version 1552682 (0.0007) [2023-12-28 06:25:11,369][106226] Updated weights for policy 0, policy_version 1552692 (0.0008) [2023-12-28 06:25:11,394][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001552696_397565952.pth... [2023-12-28 06:25:11,397][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001551512_397262848.pth [2023-12-28 06:25:11,399][106225] Updated weights for policy 1, policy_version 1556290 (0.0012) [2023-12-28 06:25:11,462][106225] Updated weights for policy 1, policy_version 1556300 (0.0008) [2023-12-28 06:25:11,531][106225] Updated weights for policy 1, policy_version 1556310 (0.0008) [2023-12-28 06:25:12,094][106226] Updated weights for policy 0, policy_version 1552702 (0.0008) [2023-12-28 06:25:12,153][106226] Updated weights for policy 0, policy_version 1552712 (0.0008) [2023-12-28 06:25:12,212][106226] Updated weights for policy 0, policy_version 1552722 (0.0008) [2023-12-28 06:25:12,298][106225] Updated weights for policy 1, policy_version 1556320 (0.0009) [2023-12-28 06:25:12,362][106225] Updated weights for policy 1, policy_version 1556330 (0.0007) [2023-12-28 06:25:12,420][106225] Updated weights for policy 1, policy_version 1556340 (0.0006) [2023-12-28 06:25:12,940][106226] Updated weights for policy 0, policy_version 1552732 (0.0008) [2023-12-28 06:25:13,004][106226] Updated weights for policy 0, policy_version 1552742 (0.0006) [2023-12-28 06:25:13,067][106226] Updated weights for policy 0, policy_version 1552752 (0.0008) [2023-12-28 06:25:13,122][106225] Updated weights for policy 1, policy_version 1556350 (0.0006) [2023-12-28 06:25:13,177][106225] Updated weights for policy 1, policy_version 1556360 (0.0005) [2023-12-28 06:25:13,243][106225] Updated weights for policy 1, policy_version 1556370 (0.0007) [2023-12-28 06:25:13,699][106226] Updated weights for policy 0, policy_version 1552762 (0.0007) [2023-12-28 06:25:13,756][106226] Updated weights for policy 0, policy_version 1552772 (0.0008) [2023-12-28 06:25:13,813][106226] Updated weights for policy 0, policy_version 1552782 (0.0007) [2023-12-28 06:25:13,816][106225] Updated weights for policy 1, policy_version 1556380 (0.0008) [2023-12-28 06:25:13,870][106225] Updated weights for policy 1, policy_version 1556390 (0.0006) [2023-12-28 06:25:13,877][106226] Updated weights for policy 0, policy_version 1552792 (0.0009) [2023-12-28 06:25:13,919][106225] Updated weights for policy 1, policy_version 1556400 (0.0007) [2023-12-28 06:25:14,534][106226] Updated weights for policy 0, policy_version 1552802 (0.0005) [2023-12-28 06:25:14,596][106226] Updated weights for policy 0, policy_version 1552812 (0.0005) [2023-12-28 06:25:14,629][106225] Updated weights for policy 1, policy_version 1556410 (0.0008) [2023-12-28 06:25:14,650][106226] Updated weights for policy 0, policy_version 1552822 (0.0008) [2023-12-28 06:25:14,685][106225] Updated weights for policy 1, policy_version 1556420 (0.0007) [2023-12-28 06:25:14,744][106225] Updated weights for policy 1, policy_version 1556430 (0.0009) [2023-12-28 06:25:14,815][106225] Updated weights for policy 1, policy_version 1556440 (0.0008) [2023-12-28 06:25:15,373][106226] Updated weights for policy 0, policy_version 1552832 (0.0009) [2023-12-28 06:25:15,420][106226] Updated weights for policy 0, policy_version 1552842 (0.0008) [2023-12-28 06:25:15,472][106226] Updated weights for policy 0, policy_version 1552852 (0.0008) [2023-12-28 06:25:15,522][106225] Updated weights for policy 1, policy_version 1556450 (0.0008) [2023-12-28 06:25:15,582][106225] Updated weights for policy 1, policy_version 1556460 (0.0009) [2023-12-28 06:25:15,649][106225] Updated weights for policy 1, policy_version 1556470 (0.0009) [2023-12-28 06:25:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 796114944. Throughput: 0: 10002.1, 1: 9694.4. Samples: 796108476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:16,176][105115] Avg episode reward: [(0, '-4.827'), (1, '-4.724')] [2023-12-28 06:25:16,189][106226] Updated weights for policy 0, policy_version 1552862 (0.0008) [2023-12-28 06:25:16,236][106226] Updated weights for policy 0, policy_version 1552872 (0.0008) [2023-12-28 06:25:16,286][106225] Updated weights for policy 1, policy_version 1556480 (0.0006) [2023-12-28 06:25:16,293][106226] Updated weights for policy 0, policy_version 1552882 (0.0008) [2023-12-28 06:25:16,334][106225] Updated weights for policy 1, policy_version 1556490 (0.0005) [2023-12-28 06:25:16,387][106225] Updated weights for policy 1, policy_version 1556500 (0.0005) [2023-12-28 06:25:16,980][106225] Updated weights for policy 1, policy_version 1556510 (0.0008) [2023-12-28 06:25:17,027][106225] Updated weights for policy 1, policy_version 1556520 (0.0010) [2023-12-28 06:25:17,076][106225] Updated weights for policy 1, policy_version 1556530 (0.0010) [2023-12-28 06:25:17,089][106226] Updated weights for policy 0, policy_version 1552892 (0.0008) [2023-12-28 06:25:17,149][106226] Updated weights for policy 0, policy_version 1552902 (0.0008) [2023-12-28 06:25:17,202][106226] Updated weights for policy 0, policy_version 1552912 (0.0009) [2023-12-28 06:25:17,693][106225] Updated weights for policy 1, policy_version 1556540 (0.0010) [2023-12-28 06:25:17,745][106225] Updated weights for policy 1, policy_version 1556550 (0.0008) [2023-12-28 06:25:17,797][106225] Updated weights for policy 1, policy_version 1556560 (0.0008) [2023-12-28 06:25:17,987][106226] Updated weights for policy 0, policy_version 1552922 (0.0009) [2023-12-28 06:25:18,041][106226] Updated weights for policy 0, policy_version 1552932 (0.0009) [2023-12-28 06:25:18,093][106226] Updated weights for policy 0, policy_version 1552942 (0.0008) [2023-12-28 06:25:18,150][106226] Updated weights for policy 0, policy_version 1552952 (0.0009) [2023-12-28 06:25:18,541][106225] Updated weights for policy 1, policy_version 1556570 (0.0008) [2023-12-28 06:25:18,601][106225] Updated weights for policy 1, policy_version 1556580 (0.0006) [2023-12-28 06:25:18,656][106225] Updated weights for policy 1, policy_version 1556590 (0.0005) [2023-12-28 06:25:18,709][106225] Updated weights for policy 1, policy_version 1556600 (0.0005) [2023-12-28 06:25:18,952][106226] Updated weights for policy 0, policy_version 1552962 (0.0010) [2023-12-28 06:25:19,006][106226] Updated weights for policy 0, policy_version 1552972 (0.0009) [2023-12-28 06:25:19,057][106226] Updated weights for policy 0, policy_version 1552982 (0.0009) [2023-12-28 06:25:19,279][106225] Updated weights for policy 1, policy_version 1556610 (0.0009) [2023-12-28 06:25:19,355][106225] Updated weights for policy 1, policy_version 1556620 (0.0007) [2023-12-28 06:25:19,424][106225] Updated weights for policy 1, policy_version 1556630 (0.0009) [2023-12-28 06:25:19,888][106226] Updated weights for policy 0, policy_version 1552992 (0.0007) [2023-12-28 06:25:19,959][106226] Updated weights for policy 0, policy_version 1553002 (0.0008) [2023-12-28 06:25:20,026][106226] Updated weights for policy 0, policy_version 1553012 (0.0007) [2023-12-28 06:25:20,051][106225] Updated weights for policy 1, policy_version 1556640 (0.0008) [2023-12-28 06:25:20,121][106225] Updated weights for policy 1, policy_version 1556650 (0.0008) [2023-12-28 06:25:20,186][106225] Updated weights for policy 1, policy_version 1556660 (0.0009) [2023-12-28 06:25:20,697][106226] Updated weights for policy 0, policy_version 1553022 (0.0007) [2023-12-28 06:25:20,754][106226] Updated weights for policy 0, policy_version 1553032 (0.0005) [2023-12-28 06:25:20,813][106226] Updated weights for policy 0, policy_version 1553042 (0.0006) [2023-12-28 06:25:20,930][106225] Updated weights for policy 1, policy_version 1556670 (0.0007) [2023-12-28 06:25:20,997][106225] Updated weights for policy 1, policy_version 1556680 (0.0006) [2023-12-28 06:25:21,065][106225] Updated weights for policy 1, policy_version 1556690 (0.0008) [2023-12-28 06:25:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 796221440. Throughput: 0: 9852.8, 1: 9834.2. Samples: 796226496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:21,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.692')] [2023-12-28 06:25:21,607][106226] Updated weights for policy 0, policy_version 1553052 (0.0007) [2023-12-28 06:25:21,671][106226] Updated weights for policy 0, policy_version 1553062 (0.0006) [2023-12-28 06:25:21,735][106226] Updated weights for policy 0, policy_version 1553072 (0.0009) [2023-12-28 06:25:21,807][106225] Updated weights for policy 1, policy_version 1556700 (0.0008) [2023-12-28 06:25:21,865][106225] Updated weights for policy 1, policy_version 1556710 (0.0008) [2023-12-28 06:25:21,924][106225] Updated weights for policy 1, policy_version 1556720 (0.0009) [2023-12-28 06:25:22,382][106226] Updated weights for policy 0, policy_version 1553082 (0.0006) [2023-12-28 06:25:22,446][106226] Updated weights for policy 0, policy_version 1553092 (0.0008) [2023-12-28 06:25:22,515][106226] Updated weights for policy 0, policy_version 1553102 (0.0007) [2023-12-28 06:25:22,582][106226] Updated weights for policy 0, policy_version 1553112 (0.0008) [2023-12-28 06:25:22,735][106225] Updated weights for policy 1, policy_version 1556730 (0.0009) [2023-12-28 06:25:22,784][106225] Updated weights for policy 1, policy_version 1556740 (0.0008) [2023-12-28 06:25:22,832][106225] Updated weights for policy 1, policy_version 1556750 (0.0010) [2023-12-28 06:25:22,891][106225] Updated weights for policy 1, policy_version 1556760 (0.0009) [2023-12-28 06:25:23,209][106226] Updated weights for policy 0, policy_version 1553122 (0.0005) [2023-12-28 06:25:23,267][106226] Updated weights for policy 0, policy_version 1553132 (0.0008) [2023-12-28 06:25:23,330][106226] Updated weights for policy 0, policy_version 1553142 (0.0007) [2023-12-28 06:25:23,624][106225] Updated weights for policy 1, policy_version 1556770 (0.0010) [2023-12-28 06:25:23,678][106225] Updated weights for policy 1, policy_version 1556780 (0.0010) [2023-12-28 06:25:23,741][106225] Updated weights for policy 1, policy_version 1556790 (0.0010) [2023-12-28 06:25:23,991][106226] Updated weights for policy 0, policy_version 1553152 (0.0010) [2023-12-28 06:25:24,057][106226] Updated weights for policy 0, policy_version 1553162 (0.0010) [2023-12-28 06:25:24,120][106226] Updated weights for policy 0, policy_version 1553172 (0.0010) [2023-12-28 06:25:24,458][106225] Updated weights for policy 1, policy_version 1556800 (0.0008) [2023-12-28 06:25:24,518][106225] Updated weights for policy 1, policy_version 1556810 (0.0008) [2023-12-28 06:25:24,582][106225] Updated weights for policy 1, policy_version 1556820 (0.0008) [2023-12-28 06:25:24,827][106226] Updated weights for policy 0, policy_version 1553182 (0.0010) [2023-12-28 06:25:24,893][106226] Updated weights for policy 0, policy_version 1553192 (0.0010) [2023-12-28 06:25:24,962][106226] Updated weights for policy 0, policy_version 1553202 (0.0010) [2023-12-28 06:25:25,241][106225] Updated weights for policy 1, policy_version 1556830 (0.0010) [2023-12-28 06:25:25,298][106225] Updated weights for policy 1, policy_version 1556840 (0.0010) [2023-12-28 06:25:25,347][106225] Updated weights for policy 1, policy_version 1556850 (0.0010) [2023-12-28 06:25:25,640][106226] Updated weights for policy 0, policy_version 1553212 (0.0010) [2023-12-28 06:25:25,696][106226] Updated weights for policy 0, policy_version 1553222 (0.0010) [2023-12-28 06:25:25,745][106226] Updated weights for policy 0, policy_version 1553232 (0.0010) [2023-12-28 06:25:26,015][106225] Updated weights for policy 1, policy_version 1556860 (0.0010) [2023-12-28 06:25:26,071][106225] Updated weights for policy 1, policy_version 1556870 (0.0010) [2023-12-28 06:25:26,125][106225] Updated weights for policy 1, policy_version 1556880 (0.0010) [2023-12-28 06:25:26,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 796319744. Throughput: 0: 9875.6, 1: 9824.2. Samples: 796284572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:26,176][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.713')] [2023-12-28 06:25:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001556888_398614528.pth... [2023-12-28 06:25:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001553240_397705216.pth... [2023-12-28 06:25:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001555736_398319616.pth [2023-12-28 06:25:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001552088_397410304.pth [2023-12-28 06:25:26,459][106226] Updated weights for policy 0, policy_version 1553242 (0.0010) [2023-12-28 06:25:26,516][106226] Updated weights for policy 0, policy_version 1553252 (0.0010) [2023-12-28 06:25:26,572][106226] Updated weights for policy 0, policy_version 1553262 (0.0010) [2023-12-28 06:25:26,619][106226] Updated weights for policy 0, policy_version 1553272 (0.0010) [2023-12-28 06:25:26,674][106225] Updated weights for policy 1, policy_version 1556890 (0.0006) [2023-12-28 06:25:26,720][106225] Updated weights for policy 1, policy_version 1556900 (0.0005) [2023-12-28 06:25:26,767][106225] Updated weights for policy 1, policy_version 1556910 (0.0006) [2023-12-28 06:25:26,813][106225] Updated weights for policy 1, policy_version 1556920 (0.0010) [2023-12-28 06:25:27,324][106226] Updated weights for policy 0, policy_version 1553282 (0.0006) [2023-12-28 06:25:27,377][106226] Updated weights for policy 0, policy_version 1553292 (0.0010) [2023-12-28 06:25:27,423][106226] Updated weights for policy 0, policy_version 1553302 (0.0010) [2023-12-28 06:25:27,518][106225] Updated weights for policy 1, policy_version 1556930 (0.0010) [2023-12-28 06:25:27,564][106225] Updated weights for policy 1, policy_version 1556940 (0.0010) [2023-12-28 06:25:27,610][106225] Updated weights for policy 1, policy_version 1556950 (0.0010) [2023-12-28 06:25:28,117][106226] Updated weights for policy 0, policy_version 1553312 (0.0010) [2023-12-28 06:25:28,182][106226] Updated weights for policy 0, policy_version 1553322 (0.0010) [2023-12-28 06:25:28,228][106226] Updated weights for policy 0, policy_version 1553332 (0.0010) [2023-12-28 06:25:28,308][106225] Updated weights for policy 1, policy_version 1556960 (0.0007) [2023-12-28 06:25:28,374][106225] Updated weights for policy 1, policy_version 1556970 (0.0009) [2023-12-28 06:25:28,428][106225] Updated weights for policy 1, policy_version 1556980 (0.0010) [2023-12-28 06:25:28,962][106226] Updated weights for policy 0, policy_version 1553342 (0.0010) [2023-12-28 06:25:29,007][106226] Updated weights for policy 0, policy_version 1553352 (0.0010) [2023-12-28 06:25:29,056][106226] Updated weights for policy 0, policy_version 1553362 (0.0010) [2023-12-28 06:25:29,093][106225] Updated weights for policy 1, policy_version 1556990 (0.0010) [2023-12-28 06:25:29,146][106225] Updated weights for policy 1, policy_version 1557000 (0.0010) [2023-12-28 06:25:29,204][106225] Updated weights for policy 1, policy_version 1557010 (0.0008) [2023-12-28 06:25:29,847][106226] Updated weights for policy 0, policy_version 1553372 (0.0010) [2023-12-28 06:25:29,915][106226] Updated weights for policy 0, policy_version 1553382 (0.0007) [2023-12-28 06:25:29,930][106225] Updated weights for policy 1, policy_version 1557020 (0.0008) [2023-12-28 06:25:29,985][106226] Updated weights for policy 0, policy_version 1553392 (0.0007) [2023-12-28 06:25:29,998][106225] Updated weights for policy 1, policy_version 1557030 (0.0008) [2023-12-28 06:25:30,061][106225] Updated weights for policy 1, policy_version 1557040 (0.0008) [2023-12-28 06:25:30,614][106226] Updated weights for policy 0, policy_version 1553402 (0.0007) [2023-12-28 06:25:30,663][106226] Updated weights for policy 0, policy_version 1553412 (0.0006) [2023-12-28 06:25:30,719][106226] Updated weights for policy 0, policy_version 1553422 (0.0005) [2023-12-28 06:25:30,774][106226] Updated weights for policy 0, policy_version 1553432 (0.0005) [2023-12-28 06:25:30,821][106225] Updated weights for policy 1, policy_version 1557050 (0.0009) [2023-12-28 06:25:30,883][106225] Updated weights for policy 1, policy_version 1557060 (0.0009) [2023-12-28 06:25:30,945][106225] Updated weights for policy 1, policy_version 1557070 (0.0007) [2023-12-28 06:25:31,001][106225] Updated weights for policy 1, policy_version 1557080 (0.0005) [2023-12-28 06:25:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 796418048. Throughput: 0: 9883.9, 1: 9961.7. Samples: 796405696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:31,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.533')] [2023-12-28 06:25:31,408][106226] Updated weights for policy 0, policy_version 1553442 (0.0008) [2023-12-28 06:25:31,472][106226] Updated weights for policy 0, policy_version 1553452 (0.0008) [2023-12-28 06:25:31,529][106226] Updated weights for policy 0, policy_version 1553462 (0.0009) [2023-12-28 06:25:31,738][106225] Updated weights for policy 1, policy_version 1557090 (0.0007) [2023-12-28 06:25:31,798][106225] Updated weights for policy 1, policy_version 1557100 (0.0006) [2023-12-28 06:25:31,850][106225] Updated weights for policy 1, policy_version 1557110 (0.0007) [2023-12-28 06:25:32,226][106226] Updated weights for policy 0, policy_version 1553472 (0.0006) [2023-12-28 06:25:32,284][106226] Updated weights for policy 0, policy_version 1553482 (0.0008) [2023-12-28 06:25:32,343][106226] Updated weights for policy 0, policy_version 1553492 (0.0009) [2023-12-28 06:25:32,587][106225] Updated weights for policy 1, policy_version 1557120 (0.0009) [2023-12-28 06:25:32,646][106225] Updated weights for policy 1, policy_version 1557130 (0.0008) [2023-12-28 06:25:32,709][106225] Updated weights for policy 1, policy_version 1557140 (0.0008) [2023-12-28 06:25:33,003][106226] Updated weights for policy 0, policy_version 1553502 (0.0009) [2023-12-28 06:25:33,053][106226] Updated weights for policy 0, policy_version 1553512 (0.0008) [2023-12-28 06:25:33,111][106226] Updated weights for policy 0, policy_version 1553522 (0.0008) [2023-12-28 06:25:33,352][106225] Updated weights for policy 1, policy_version 1557150 (0.0008) [2023-12-28 06:25:33,410][106225] Updated weights for policy 1, policy_version 1557160 (0.0008) [2023-12-28 06:25:33,467][106225] Updated weights for policy 1, policy_version 1557170 (0.0008) [2023-12-28 06:25:33,859][106226] Updated weights for policy 0, policy_version 1553532 (0.0008) [2023-12-28 06:25:33,918][106226] Updated weights for policy 0, policy_version 1553542 (0.0008) [2023-12-28 06:25:33,977][106226] Updated weights for policy 0, policy_version 1553552 (0.0008) [2023-12-28 06:25:34,191][106225] Updated weights for policy 1, policy_version 1557180 (0.0008) [2023-12-28 06:25:34,244][106225] Updated weights for policy 1, policy_version 1557190 (0.0008) [2023-12-28 06:25:34,302][106225] Updated weights for policy 1, policy_version 1557200 (0.0007) [2023-12-28 06:25:34,659][106226] Updated weights for policy 0, policy_version 1553562 (0.0008) [2023-12-28 06:25:34,711][106226] Updated weights for policy 0, policy_version 1553572 (0.0005) [2023-12-28 06:25:34,770][106226] Updated weights for policy 0, policy_version 1553582 (0.0006) [2023-12-28 06:25:34,832][106226] Updated weights for policy 0, policy_version 1553592 (0.0009) [2023-12-28 06:25:35,109][106225] Updated weights for policy 1, policy_version 1557210 (0.0008) [2023-12-28 06:25:35,165][106225] Updated weights for policy 1, policy_version 1557220 (0.0007) [2023-12-28 06:25:35,216][106225] Updated weights for policy 1, policy_version 1557230 (0.0009) [2023-12-28 06:25:35,265][106225] Updated weights for policy 1, policy_version 1557240 (0.0008) [2023-12-28 06:25:35,462][106226] Updated weights for policy 0, policy_version 1553602 (0.0005) [2023-12-28 06:25:35,522][106226] Updated weights for policy 0, policy_version 1553612 (0.0005) [2023-12-28 06:25:35,580][106226] Updated weights for policy 0, policy_version 1553622 (0.0008) [2023-12-28 06:25:36,042][106225] Updated weights for policy 1, policy_version 1557250 (0.0007) [2023-12-28 06:25:36,093][106225] Updated weights for policy 1, policy_version 1557260 (0.0007) [2023-12-28 06:25:36,158][106225] Updated weights for policy 1, policy_version 1557270 (0.0007) [2023-12-28 06:25:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 796516352. Throughput: 0: 9911.5, 1: 9897.1. Samples: 796523512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:36,176][105115] Avg episode reward: [(0, '-4.629'), (1, '-4.838')] [2023-12-28 06:25:36,285][106226] Updated weights for policy 0, policy_version 1553632 (0.0009) [2023-12-28 06:25:36,349][106226] Updated weights for policy 0, policy_version 1553642 (0.0009) [2023-12-28 06:25:36,413][106226] Updated weights for policy 0, policy_version 1553652 (0.0009) [2023-12-28 06:25:36,876][106225] Updated weights for policy 1, policy_version 1557280 (0.0007) [2023-12-28 06:25:36,927][106225] Updated weights for policy 1, policy_version 1557290 (0.0008) [2023-12-28 06:25:36,983][106225] Updated weights for policy 1, policy_version 1557300 (0.0008) [2023-12-28 06:25:37,064][106226] Updated weights for policy 0, policy_version 1553662 (0.0009) [2023-12-28 06:25:37,110][106226] Updated weights for policy 0, policy_version 1553672 (0.0009) [2023-12-28 06:25:37,159][106226] Updated weights for policy 0, policy_version 1553682 (0.0005) [2023-12-28 06:25:37,738][106226] Updated weights for policy 0, policy_version 1553692 (0.0005) [2023-12-28 06:25:37,751][106225] Updated weights for policy 1, policy_version 1557310 (0.0008) [2023-12-28 06:25:37,794][106226] Updated weights for policy 0, policy_version 1553702 (0.0006) [2023-12-28 06:25:37,812][106225] Updated weights for policy 1, policy_version 1557320 (0.0008) [2023-12-28 06:25:37,852][106226] Updated weights for policy 0, policy_version 1553712 (0.0005) [2023-12-28 06:25:37,860][106225] Updated weights for policy 1, policy_version 1557330 (0.0008) [2023-12-28 06:25:38,437][106226] Updated weights for policy 0, policy_version 1553722 (0.0005) [2023-12-28 06:25:38,500][106226] Updated weights for policy 0, policy_version 1553732 (0.0006) [2023-12-28 06:25:38,555][106226] Updated weights for policy 0, policy_version 1553742 (0.0006) [2023-12-28 06:25:38,621][106226] Updated weights for policy 0, policy_version 1553752 (0.0009) [2023-12-28 06:25:38,679][106225] Updated weights for policy 1, policy_version 1557340 (0.0007) [2023-12-28 06:25:38,729][106225] Updated weights for policy 1, policy_version 1557350 (0.0009) [2023-12-28 06:25:38,782][106225] Updated weights for policy 1, policy_version 1557360 (0.0009) [2023-12-28 06:25:39,201][106226] Updated weights for policy 0, policy_version 1553762 (0.0010) [2023-12-28 06:25:39,267][106226] Updated weights for policy 0, policy_version 1553772 (0.0008) [2023-12-28 06:25:39,318][106226] Updated weights for policy 0, policy_version 1553782 (0.0008) [2023-12-28 06:25:39,646][106225] Updated weights for policy 1, policy_version 1557370 (0.0009) [2023-12-28 06:25:39,696][106225] Updated weights for policy 1, policy_version 1557380 (0.0008) [2023-12-28 06:25:39,751][106225] Updated weights for policy 1, policy_version 1557390 (0.0008) [2023-12-28 06:25:39,814][106225] Updated weights for policy 1, policy_version 1557400 (0.0008) [2023-12-28 06:25:40,045][106226] Updated weights for policy 0, policy_version 1553792 (0.0010) [2023-12-28 06:25:40,116][106226] Updated weights for policy 0, policy_version 1553802 (0.0011) [2023-12-28 06:25:40,176][106226] Updated weights for policy 0, policy_version 1553812 (0.0009) [2023-12-28 06:25:40,633][106225] Updated weights for policy 1, policy_version 1557410 (0.0010) [2023-12-28 06:25:40,683][106225] Updated weights for policy 1, policy_version 1557420 (0.0010) [2023-12-28 06:25:40,746][106225] Updated weights for policy 1, policy_version 1557430 (0.0011) [2023-12-28 06:25:40,901][106226] Updated weights for policy 0, policy_version 1553822 (0.0009) [2023-12-28 06:25:40,970][106226] Updated weights for policy 0, policy_version 1553832 (0.0008) [2023-12-28 06:25:41,027][106226] Updated weights for policy 0, policy_version 1553842 (0.0007) [2023-12-28 06:25:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 796614656. Throughput: 0: 9982.1, 1: 9895.6. Samples: 796584412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:41,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-4.766')] [2023-12-28 06:25:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001557432_398753792.pth... [2023-12-28 06:25:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001553848_397860864.pth... [2023-12-28 06:25:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001556280_398458880.pth [2023-12-28 06:25:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001552696_397565952.pth [2023-12-28 06:25:41,527][106225] Updated weights for policy 1, policy_version 1557440 (0.0009) [2023-12-28 06:25:41,590][106225] Updated weights for policy 1, policy_version 1557450 (0.0008) [2023-12-28 06:25:41,662][106225] Updated weights for policy 1, policy_version 1557460 (0.0008) [2023-12-28 06:25:41,867][106226] Updated weights for policy 0, policy_version 1553852 (0.0008) [2023-12-28 06:25:41,940][106226] Updated weights for policy 0, policy_version 1553862 (0.0007) [2023-12-28 06:25:42,007][106226] Updated weights for policy 0, policy_version 1553872 (0.0011) [2023-12-28 06:25:42,461][106225] Updated weights for policy 1, policy_version 1557470 (0.0008) [2023-12-28 06:25:42,512][106225] Updated weights for policy 1, policy_version 1557480 (0.0008) [2023-12-28 06:25:42,563][106225] Updated weights for policy 1, policy_version 1557490 (0.0007) [2023-12-28 06:25:42,742][106226] Updated weights for policy 0, policy_version 1553882 (0.0009) [2023-12-28 06:25:42,793][106226] Updated weights for policy 0, policy_version 1553892 (0.0005) [2023-12-28 06:25:42,853][106226] Updated weights for policy 0, policy_version 1553902 (0.0006) [2023-12-28 06:25:42,924][106226] Updated weights for policy 0, policy_version 1553912 (0.0009) [2023-12-28 06:25:43,327][106225] Updated weights for policy 1, policy_version 1557500 (0.0009) [2023-12-28 06:25:43,389][106225] Updated weights for policy 1, policy_version 1557510 (0.0010) [2023-12-28 06:25:43,449][106225] Updated weights for policy 1, policy_version 1557520 (0.0009) [2023-12-28 06:25:43,559][106226] Updated weights for policy 0, policy_version 1553922 (0.0010) [2023-12-28 06:25:43,625][106226] Updated weights for policy 0, policy_version 1553932 (0.0010) [2023-12-28 06:25:43,688][106226] Updated weights for policy 0, policy_version 1553942 (0.0010) [2023-12-28 06:25:44,062][106225] Updated weights for policy 1, policy_version 1557530 (0.0010) [2023-12-28 06:25:44,132][106225] Updated weights for policy 1, policy_version 1557540 (0.0009) [2023-12-28 06:25:44,182][106225] Updated weights for policy 1, policy_version 1557550 (0.0009) [2023-12-28 06:25:44,231][106225] Updated weights for policy 1, policy_version 1557560 (0.0008) [2023-12-28 06:25:44,356][106226] Updated weights for policy 0, policy_version 1553952 (0.0008) [2023-12-28 06:25:44,417][106226] Updated weights for policy 0, policy_version 1553962 (0.0011) [2023-12-28 06:25:44,471][106226] Updated weights for policy 0, policy_version 1553972 (0.0011) [2023-12-28 06:25:44,966][106225] Updated weights for policy 1, policy_version 1557570 (0.0008) [2023-12-28 06:25:45,026][106225] Updated weights for policy 1, policy_version 1557580 (0.0008) [2023-12-28 06:25:45,089][106225] Updated weights for policy 1, policy_version 1557590 (0.0008) [2023-12-28 06:25:45,202][106226] Updated weights for policy 0, policy_version 1553982 (0.0011) [2023-12-28 06:25:45,270][106226] Updated weights for policy 0, policy_version 1553992 (0.0011) [2023-12-28 06:25:45,335][106226] Updated weights for policy 0, policy_version 1554002 (0.0011) [2023-12-28 06:25:45,763][106225] Updated weights for policy 1, policy_version 1557600 (0.0010) [2023-12-28 06:25:45,821][106225] Updated weights for policy 1, policy_version 1557610 (0.0006) [2023-12-28 06:25:45,881][106225] Updated weights for policy 1, policy_version 1557620 (0.0005) [2023-12-28 06:25:45,941][106226] Updated weights for policy 0, policy_version 1554012 (0.0009) [2023-12-28 06:25:45,990][106226] Updated weights for policy 0, policy_version 1554022 (0.0005) [2023-12-28 06:25:46,038][106226] Updated weights for policy 0, policy_version 1554032 (0.0008) [2023-12-28 06:25:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 796712960. Throughput: 0: 9958.6, 1: 9686.6. Samples: 796697108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:46,176][105115] Avg episode reward: [(0, '-4.821'), (1, '-4.467')] [2023-12-28 06:25:46,429][106225] Updated weights for policy 1, policy_version 1557630 (0.0006) [2023-12-28 06:25:46,476][106225] Updated weights for policy 1, policy_version 1557640 (0.0006) [2023-12-28 06:25:46,527][106225] Updated weights for policy 1, policy_version 1557650 (0.0005) [2023-12-28 06:25:46,598][106226] Updated weights for policy 0, policy_version 1554042 (0.0008) [2023-12-28 06:25:46,657][106226] Updated weights for policy 0, policy_version 1554052 (0.0010) [2023-12-28 06:25:46,708][106226] Updated weights for policy 0, policy_version 1554062 (0.0010) [2023-12-28 06:25:46,757][106226] Updated weights for policy 0, policy_version 1554072 (0.0010) [2023-12-28 06:25:47,107][106225] Updated weights for policy 1, policy_version 1557660 (0.0007) [2023-12-28 06:25:47,168][106225] Updated weights for policy 1, policy_version 1557670 (0.0009) [2023-12-28 06:25:47,220][106225] Updated weights for policy 1, policy_version 1557680 (0.0005) [2023-12-28 06:25:47,372][106226] Updated weights for policy 0, policy_version 1554082 (0.0010) [2023-12-28 06:25:47,442][106226] Updated weights for policy 0, policy_version 1554092 (0.0011) [2023-12-28 06:25:47,514][106226] Updated weights for policy 0, policy_version 1554102 (0.0010) [2023-12-28 06:25:47,735][106225] Updated weights for policy 1, policy_version 1557690 (0.0006) [2023-12-28 06:25:47,785][106225] Updated weights for policy 1, policy_version 1557700 (0.0010) [2023-12-28 06:25:47,835][106225] Updated weights for policy 1, policy_version 1557710 (0.0010) [2023-12-28 06:25:47,884][106225] Updated weights for policy 1, policy_version 1557720 (0.0010) [2023-12-28 06:25:48,106][106226] Updated weights for policy 0, policy_version 1554112 (0.0007) [2023-12-28 06:25:48,171][106226] Updated weights for policy 0, policy_version 1554122 (0.0005) [2023-12-28 06:25:48,233][106226] Updated weights for policy 0, policy_version 1554132 (0.0008) [2023-12-28 06:25:48,601][106225] Updated weights for policy 1, policy_version 1557730 (0.0010) [2023-12-28 06:25:48,655][106225] Updated weights for policy 1, policy_version 1557740 (0.0011) [2023-12-28 06:25:48,703][106225] Updated weights for policy 1, policy_version 1557750 (0.0010) [2023-12-28 06:25:48,793][106226] Updated weights for policy 0, policy_version 1554142 (0.0005) [2023-12-28 06:25:48,863][106226] Updated weights for policy 0, policy_version 1554152 (0.0008) [2023-12-28 06:25:48,929][106226] Updated weights for policy 0, policy_version 1554162 (0.0006) [2023-12-28 06:25:49,497][106225] Updated weights for policy 1, policy_version 1557760 (0.0008) [2023-12-28 06:25:49,562][106225] Updated weights for policy 1, policy_version 1557770 (0.0007) [2023-12-28 06:25:49,584][106226] Updated weights for policy 0, policy_version 1554172 (0.0007) [2023-12-28 06:25:49,628][106225] Updated weights for policy 1, policy_version 1557780 (0.0006) [2023-12-28 06:25:49,642][106226] Updated weights for policy 0, policy_version 1554182 (0.0007) [2023-12-28 06:25:49,708][106226] Updated weights for policy 0, policy_version 1554192 (0.0008) [2023-12-28 06:25:50,353][106226] Updated weights for policy 0, policy_version 1554202 (0.0006) [2023-12-28 06:25:50,365][106225] Updated weights for policy 1, policy_version 1557790 (0.0007) [2023-12-28 06:25:50,413][106226] Updated weights for policy 0, policy_version 1554212 (0.0009) [2023-12-28 06:25:50,423][106225] Updated weights for policy 1, policy_version 1557800 (0.0007) [2023-12-28 06:25:50,465][106226] Updated weights for policy 0, policy_version 1554222 (0.0006) [2023-12-28 06:25:50,488][106225] Updated weights for policy 1, policy_version 1557810 (0.0008) [2023-12-28 06:25:50,513][106226] Updated weights for policy 0, policy_version 1554232 (0.0008) [2023-12-28 06:25:51,116][106225] Updated weights for policy 1, policy_version 1557820 (0.0006) [2023-12-28 06:25:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 796811264. Throughput: 0: 9984.4, 1: 9839.2. Samples: 796824628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:51,175][105115] Avg episode reward: [(0, '-4.919'), (1, '-4.588')] [2023-12-28 06:25:51,187][106225] Updated weights for policy 1, policy_version 1557830 (0.0008) [2023-12-28 06:25:51,255][106225] Updated weights for policy 1, policy_version 1557840 (0.0008) [2023-12-28 06:25:51,356][106226] Updated weights for policy 0, policy_version 1554242 (0.0006) [2023-12-28 06:25:51,428][106226] Updated weights for policy 0, policy_version 1554252 (0.0006) [2023-12-28 06:25:51,496][106226] Updated weights for policy 0, policy_version 1554262 (0.0010) [2023-12-28 06:25:51,950][106225] Updated weights for policy 1, policy_version 1557850 (0.0009) [2023-12-28 06:25:52,010][106225] Updated weights for policy 1, policy_version 1557860 (0.0009) [2023-12-28 06:25:52,066][106225] Updated weights for policy 1, policy_version 1557870 (0.0008) [2023-12-28 06:25:52,121][106225] Updated weights for policy 1, policy_version 1557880 (0.0008) [2023-12-28 06:25:52,152][106226] Updated weights for policy 0, policy_version 1554272 (0.0008) [2023-12-28 06:25:52,204][106226] Updated weights for policy 0, policy_version 1554282 (0.0008) [2023-12-28 06:25:52,268][106226] Updated weights for policy 0, policy_version 1554292 (0.0009) [2023-12-28 06:25:52,834][106225] Updated weights for policy 1, policy_version 1557890 (0.0009) [2023-12-28 06:25:52,896][106225] Updated weights for policy 1, policy_version 1557900 (0.0009) [2023-12-28 06:25:52,952][106225] Updated weights for policy 1, policy_version 1557910 (0.0010) [2023-12-28 06:25:53,060][106226] Updated weights for policy 0, policy_version 1554302 (0.0008) [2023-12-28 06:25:53,110][106226] Updated weights for policy 0, policy_version 1554312 (0.0008) [2023-12-28 06:25:53,160][106226] Updated weights for policy 0, policy_version 1554322 (0.0007) [2023-12-28 06:25:53,616][106225] Updated weights for policy 1, policy_version 1557920 (0.0010) [2023-12-28 06:25:53,669][106225] Updated weights for policy 1, policy_version 1557930 (0.0009) [2023-12-28 06:25:53,719][106225] Updated weights for policy 1, policy_version 1557940 (0.0005) [2023-12-28 06:25:53,908][106226] Updated weights for policy 0, policy_version 1554332 (0.0008) [2023-12-28 06:25:53,958][106226] Updated weights for policy 0, policy_version 1554342 (0.0008) [2023-12-28 06:25:54,008][106226] Updated weights for policy 0, policy_version 1554352 (0.0008) [2023-12-28 06:25:54,352][106225] Updated weights for policy 1, policy_version 1557950 (0.0005) [2023-12-28 06:25:54,415][106225] Updated weights for policy 1, policy_version 1557960 (0.0005) [2023-12-28 06:25:54,477][106225] Updated weights for policy 1, policy_version 1557970 (0.0005) [2023-12-28 06:25:54,832][106226] Updated weights for policy 0, policy_version 1554362 (0.0008) [2023-12-28 06:25:54,883][106226] Updated weights for policy 0, policy_version 1554372 (0.0009) [2023-12-28 06:25:54,937][106226] Updated weights for policy 0, policy_version 1554382 (0.0008) [2023-12-28 06:25:54,996][106225] Updated weights for policy 1, policy_version 1557980 (0.0006) [2023-12-28 06:25:55,000][106226] Updated weights for policy 0, policy_version 1554392 (0.0007) [2023-12-28 06:25:55,065][106225] Updated weights for policy 1, policy_version 1557990 (0.0007) [2023-12-28 06:25:55,139][106225] Updated weights for policy 1, policy_version 1558000 (0.0007) [2023-12-28 06:25:55,724][106225] Updated weights for policy 1, policy_version 1558010 (0.0008) [2023-12-28 06:25:55,780][106225] Updated weights for policy 1, policy_version 1558020 (0.0006) [2023-12-28 06:25:55,787][106226] Updated weights for policy 0, policy_version 1554402 (0.0008) [2023-12-28 06:25:55,841][106225] Updated weights for policy 1, policy_version 1558030 (0.0006) [2023-12-28 06:25:55,848][106226] Updated weights for policy 0, policy_version 1554412 (0.0009) [2023-12-28 06:25:55,900][106225] Updated weights for policy 1, policy_version 1558040 (0.0005) [2023-12-28 06:25:55,906][106226] Updated weights for policy 0, policy_version 1554422 (0.0009) [2023-12-28 06:25:56,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 796917760. Throughput: 0: 9927.4, 1: 9881.9. Samples: 796883080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:25:56,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.595')] [2023-12-28 06:25:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001558040_398909440.pth... [2023-12-28 06:25:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001554424_398008320.pth... [2023-12-28 06:25:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001553240_397705216.pth [2023-12-28 06:25:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001556888_398614528.pth [2023-12-28 06:25:56,433][106225] Updated weights for policy 1, policy_version 1558050 (0.0005) [2023-12-28 06:25:56,495][106225] Updated weights for policy 1, policy_version 1558060 (0.0005) [2023-12-28 06:25:56,560][106225] Updated weights for policy 1, policy_version 1558070 (0.0005) [2023-12-28 06:25:56,753][106226] Updated weights for policy 0, policy_version 1554432 (0.0008) [2023-12-28 06:25:56,802][106226] Updated weights for policy 0, policy_version 1554442 (0.0008) [2023-12-28 06:25:56,852][106226] Updated weights for policy 0, policy_version 1554452 (0.0009) [2023-12-28 06:25:57,054][106225] Updated weights for policy 1, policy_version 1558080 (0.0007) [2023-12-28 06:25:57,104][106225] Updated weights for policy 1, policy_version 1558090 (0.0006) [2023-12-28 06:25:57,159][106225] Updated weights for policy 1, policy_version 1558100 (0.0006) [2023-12-28 06:25:57,578][106226] Updated weights for policy 0, policy_version 1554462 (0.0007) [2023-12-28 06:25:57,631][106226] Updated weights for policy 0, policy_version 1554472 (0.0007) [2023-12-28 06:25:57,680][106226] Updated weights for policy 0, policy_version 1554482 (0.0009) [2023-12-28 06:25:57,720][106225] Updated weights for policy 1, policy_version 1558110 (0.0005) [2023-12-28 06:25:57,778][106225] Updated weights for policy 1, policy_version 1558120 (0.0005) [2023-12-28 06:25:57,845][106225] Updated weights for policy 1, policy_version 1558130 (0.0005) [2023-12-28 06:25:58,341][106226] Updated weights for policy 0, policy_version 1554492 (0.0007) [2023-12-28 06:25:58,411][106226] Updated weights for policy 0, policy_version 1554502 (0.0009) [2023-12-28 06:25:58,474][106225] Updated weights for policy 1, policy_version 1558140 (0.0009) [2023-12-28 06:25:58,476][106226] Updated weights for policy 0, policy_version 1554512 (0.0007) [2023-12-28 06:25:58,532][106225] Updated weights for policy 1, policy_version 1558150 (0.0010) [2023-12-28 06:25:58,585][106225] Updated weights for policy 1, policy_version 1558160 (0.0007) [2023-12-28 06:25:59,201][106226] Updated weights for policy 0, policy_version 1554522 (0.0006) [2023-12-28 06:25:59,269][106226] Updated weights for policy 0, policy_version 1554532 (0.0008) [2023-12-28 06:25:59,337][106226] Updated weights for policy 0, policy_version 1554542 (0.0008) [2023-12-28 06:25:59,376][106225] Updated weights for policy 1, policy_version 1558170 (0.0008) [2023-12-28 06:25:59,410][106226] Updated weights for policy 0, policy_version 1554552 (0.0010) [2023-12-28 06:25:59,436][106225] Updated weights for policy 1, policy_version 1558180 (0.0009) [2023-12-28 06:25:59,495][106225] Updated weights for policy 1, policy_version 1558190 (0.0010) [2023-12-28 06:25:59,556][106225] Updated weights for policy 1, policy_version 1558200 (0.0010) [2023-12-28 06:26:00,174][106226] Updated weights for policy 0, policy_version 1554562 (0.0011) [2023-12-28 06:26:00,238][106226] Updated weights for policy 0, policy_version 1554572 (0.0010) [2023-12-28 06:26:00,250][106225] Updated weights for policy 1, policy_version 1558210 (0.0008) [2023-12-28 06:26:00,296][106226] Updated weights for policy 0, policy_version 1554582 (0.0011) [2023-12-28 06:26:00,312][106225] Updated weights for policy 1, policy_version 1558220 (0.0007) [2023-12-28 06:26:00,376][106225] Updated weights for policy 1, policy_version 1558230 (0.0010) [2023-12-28 06:26:00,949][106226] Updated weights for policy 0, policy_version 1554592 (0.0010) [2023-12-28 06:26:01,012][106226] Updated weights for policy 0, policy_version 1554602 (0.0010) [2023-12-28 06:26:01,084][106226] Updated weights for policy 0, policy_version 1554612 (0.0011) [2023-12-28 06:26:01,090][106225] Updated weights for policy 1, policy_version 1558240 (0.0010) [2023-12-28 06:26:01,157][106225] Updated weights for policy 1, policy_version 1558250 (0.0009) [2023-12-28 06:26:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 797016064. Throughput: 0: 9881.2, 1: 10058.3. Samples: 797005748. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:01,175][105115] Avg episode reward: [(0, '-4.717'), (1, '-4.522')] [2023-12-28 06:26:01,227][106225] Updated weights for policy 1, policy_version 1558260 (0.0009) [2023-12-28 06:26:01,816][106226] Updated weights for policy 0, policy_version 1554622 (0.0010) [2023-12-28 06:26:01,879][106226] Updated weights for policy 0, policy_version 1554632 (0.0008) [2023-12-28 06:26:01,938][106225] Updated weights for policy 1, policy_version 1558270 (0.0008) [2023-12-28 06:26:01,940][106226] Updated weights for policy 0, policy_version 1554642 (0.0007) [2023-12-28 06:26:01,994][106225] Updated weights for policy 1, policy_version 1558280 (0.0007) [2023-12-28 06:26:02,055][106225] Updated weights for policy 1, policy_version 1558290 (0.0008) [2023-12-28 06:26:02,678][106226] Updated weights for policy 0, policy_version 1554652 (0.0009) [2023-12-28 06:26:02,718][106225] Updated weights for policy 1, policy_version 1558300 (0.0007) [2023-12-28 06:26:02,743][106226] Updated weights for policy 0, policy_version 1554662 (0.0009) [2023-12-28 06:26:02,779][106225] Updated weights for policy 1, policy_version 1558310 (0.0008) [2023-12-28 06:26:02,796][106226] Updated weights for policy 0, policy_version 1554672 (0.0006) [2023-12-28 06:26:02,842][106225] Updated weights for policy 1, policy_version 1558320 (0.0008) [2023-12-28 06:26:03,399][106226] Updated weights for policy 0, policy_version 1554682 (0.0008) [2023-12-28 06:26:03,452][106226] Updated weights for policy 0, policy_version 1554692 (0.0010) [2023-12-28 06:26:03,499][106225] Updated weights for policy 1, policy_version 1558330 (0.0008) [2023-12-28 06:26:03,509][106226] Updated weights for policy 0, policy_version 1554702 (0.0010) [2023-12-28 06:26:03,546][106225] Updated weights for policy 1, policy_version 1558340 (0.0008) [2023-12-28 06:26:03,558][106226] Updated weights for policy 0, policy_version 1554712 (0.0010) [2023-12-28 06:26:03,595][106225] Updated weights for policy 1, policy_version 1558350 (0.0007) [2023-12-28 06:26:03,651][106225] Updated weights for policy 1, policy_version 1558360 (0.0007) [2023-12-28 06:26:04,328][106226] Updated weights for policy 0, policy_version 1554722 (0.0006) [2023-12-28 06:26:04,385][106226] Updated weights for policy 0, policy_version 1554732 (0.0007) [2023-12-28 06:26:04,397][106225] Updated weights for policy 1, policy_version 1558370 (0.0006) [2023-12-28 06:26:04,448][106226] Updated weights for policy 0, policy_version 1554742 (0.0007) [2023-12-28 06:26:04,466][106225] Updated weights for policy 1, policy_version 1558380 (0.0008) [2023-12-28 06:26:04,536][106225] Updated weights for policy 1, policy_version 1558390 (0.0008) [2023-12-28 06:26:05,004][106226] Updated weights for policy 0, policy_version 1554752 (0.0006) [2023-12-28 06:26:05,066][106226] Updated weights for policy 0, policy_version 1554762 (0.0006) [2023-12-28 06:26:05,122][106226] Updated weights for policy 0, policy_version 1554772 (0.0006) [2023-12-28 06:26:05,305][106225] Updated weights for policy 1, policy_version 1558400 (0.0007) [2023-12-28 06:26:05,360][106225] Updated weights for policy 1, policy_version 1558410 (0.0006) [2023-12-28 06:26:05,423][106225] Updated weights for policy 1, policy_version 1558420 (0.0008) [2023-12-28 06:26:05,820][106226] Updated weights for policy 0, policy_version 1554782 (0.0007) [2023-12-28 06:26:05,876][106226] Updated weights for policy 0, policy_version 1554792 (0.0008) [2023-12-28 06:26:05,936][106226] Updated weights for policy 0, policy_version 1554802 (0.0009) [2023-12-28 06:26:06,057][106225] Updated weights for policy 1, policy_version 1558430 (0.0008) [2023-12-28 06:26:06,123][106225] Updated weights for policy 1, policy_version 1558440 (0.0008) [2023-12-28 06:26:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 797114368. Throughput: 0: 9980.2, 1: 9983.3. Samples: 797124852. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:06,175][105115] Avg episode reward: [(0, '-4.834'), (1, '-4.658')] [2023-12-28 06:26:06,187][106225] Updated weights for policy 1, policy_version 1558450 (0.0007) [2023-12-28 06:26:06,636][106226] Updated weights for policy 0, policy_version 1554812 (0.0007) [2023-12-28 06:26:06,701][106226] Updated weights for policy 0, policy_version 1554822 (0.0006) [2023-12-28 06:26:06,758][106226] Updated weights for policy 0, policy_version 1554832 (0.0009) [2023-12-28 06:26:06,901][106225] Updated weights for policy 1, policy_version 1558460 (0.0007) [2023-12-28 06:26:06,954][106225] Updated weights for policy 1, policy_version 1558470 (0.0009) [2023-12-28 06:26:07,011][106225] Updated weights for policy 1, policy_version 1558480 (0.0009) [2023-12-28 06:26:07,407][106226] Updated weights for policy 0, policy_version 1554842 (0.0007) [2023-12-28 06:26:07,460][106226] Updated weights for policy 0, policy_version 1554852 (0.0009) [2023-12-28 06:26:07,516][106226] Updated weights for policy 0, policy_version 1554862 (0.0008) [2023-12-28 06:26:07,573][106226] Updated weights for policy 0, policy_version 1554872 (0.0005) [2023-12-28 06:26:07,773][106225] Updated weights for policy 1, policy_version 1558490 (0.0010) [2023-12-28 06:26:07,825][106225] Updated weights for policy 1, policy_version 1558500 (0.0007) [2023-12-28 06:26:07,878][106225] Updated weights for policy 1, policy_version 1558510 (0.0009) [2023-12-28 06:26:07,928][106225] Updated weights for policy 1, policy_version 1558520 (0.0009) [2023-12-28 06:26:08,235][106226] Updated weights for policy 0, policy_version 1554882 (0.0008) [2023-12-28 06:26:08,283][106226] Updated weights for policy 0, policy_version 1554892 (0.0005) [2023-12-28 06:26:08,333][106226] Updated weights for policy 0, policy_version 1554902 (0.0006) [2023-12-28 06:26:08,708][106225] Updated weights for policy 1, policy_version 1558530 (0.0008) [2023-12-28 06:26:08,773][106225] Updated weights for policy 1, policy_version 1558540 (0.0008) [2023-12-28 06:26:08,830][106225] Updated weights for policy 1, policy_version 1558550 (0.0008) [2023-12-28 06:26:09,029][106226] Updated weights for policy 0, policy_version 1554912 (0.0009) [2023-12-28 06:26:09,079][106226] Updated weights for policy 0, policy_version 1554922 (0.0008) [2023-12-28 06:26:09,131][106226] Updated weights for policy 0, policy_version 1554932 (0.0008) [2023-12-28 06:26:09,556][106225] Updated weights for policy 1, policy_version 1558560 (0.0008) [2023-12-28 06:26:09,616][106225] Updated weights for policy 1, policy_version 1558570 (0.0009) [2023-12-28 06:26:09,679][106225] Updated weights for policy 1, policy_version 1558580 (0.0008) [2023-12-28 06:26:09,944][106226] Updated weights for policy 0, policy_version 1554942 (0.0009) [2023-12-28 06:26:10,005][106226] Updated weights for policy 0, policy_version 1554952 (0.0009) [2023-12-28 06:26:10,071][106226] Updated weights for policy 0, policy_version 1554962 (0.0009) [2023-12-28 06:26:10,415][106225] Updated weights for policy 1, policy_version 1558590 (0.0008) [2023-12-28 06:26:10,478][106225] Updated weights for policy 1, policy_version 1558600 (0.0007) [2023-12-28 06:26:10,543][106225] Updated weights for policy 1, policy_version 1558610 (0.0006) [2023-12-28 06:26:10,812][106226] Updated weights for policy 0, policy_version 1554972 (0.0009) [2023-12-28 06:26:10,865][106226] Updated weights for policy 0, policy_version 1554982 (0.0006) [2023-12-28 06:26:10,922][106226] Updated weights for policy 0, policy_version 1554992 (0.0006) [2023-12-28 06:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 797212672. Throughput: 0: 9990.2, 1: 9998.3. Samples: 797184048. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:11,175][105115] Avg episode reward: [(0, '-5.146'), (1, '-4.730')] [2023-12-28 06:26:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001555000_398155776.pth... [2023-12-28 06:26:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001553848_397860864.pth [2023-12-28 06:26:11,206][106225] Updated weights for policy 1, policy_version 1558620 (0.0008) [2023-12-28 06:26:11,273][106225] Updated weights for policy 1, policy_version 1558630 (0.0009) [2023-12-28 06:26:11,342][106225] Updated weights for policy 1, policy_version 1558640 (0.0009) [2023-12-28 06:26:11,401][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001558648_399065088.pth... [2023-12-28 06:26:11,407][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001557432_398753792.pth [2023-12-28 06:26:11,785][106226] Updated weights for policy 0, policy_version 1555002 (0.0007) [2023-12-28 06:26:11,852][106226] Updated weights for policy 0, policy_version 1555012 (0.0008) [2023-12-28 06:26:11,912][106226] Updated weights for policy 0, policy_version 1555022 (0.0009) [2023-12-28 06:26:11,980][106226] Updated weights for policy 0, policy_version 1555032 (0.0010) [2023-12-28 06:26:12,110][106225] Updated weights for policy 1, policy_version 1558650 (0.0008) [2023-12-28 06:26:12,162][106225] Updated weights for policy 1, policy_version 1558660 (0.0008) [2023-12-28 06:26:12,213][106225] Updated weights for policy 1, policy_version 1558670 (0.0007) [2023-12-28 06:26:12,275][106225] Updated weights for policy 1, policy_version 1558680 (0.0007) [2023-12-28 06:26:12,731][106226] Updated weights for policy 0, policy_version 1555042 (0.0010) [2023-12-28 06:26:12,804][106226] Updated weights for policy 0, policy_version 1555052 (0.0011) [2023-12-28 06:26:12,864][106226] Updated weights for policy 0, policy_version 1555062 (0.0011) [2023-12-28 06:26:13,029][106225] Updated weights for policy 1, policy_version 1558690 (0.0010) [2023-12-28 06:26:13,076][106225] Updated weights for policy 1, policy_version 1558700 (0.0010) [2023-12-28 06:26:13,127][106225] Updated weights for policy 1, policy_version 1558710 (0.0010) [2023-12-28 06:26:13,516][106226] Updated weights for policy 0, policy_version 1555072 (0.0010) [2023-12-28 06:26:13,582][106226] Updated weights for policy 0, policy_version 1555082 (0.0010) [2023-12-28 06:26:13,645][106226] Updated weights for policy 0, policy_version 1555092 (0.0010) [2023-12-28 06:26:13,811][106225] Updated weights for policy 1, policy_version 1558720 (0.0010) [2023-12-28 06:26:13,871][106225] Updated weights for policy 1, policy_version 1558730 (0.0010) [2023-12-28 06:26:13,924][106225] Updated weights for policy 1, policy_version 1558740 (0.0010) [2023-12-28 06:26:14,325][106226] Updated weights for policy 0, policy_version 1555102 (0.0009) [2023-12-28 06:26:14,387][106226] Updated weights for policy 0, policy_version 1555112 (0.0009) [2023-12-28 06:26:14,443][106226] Updated weights for policy 0, policy_version 1555122 (0.0005) [2023-12-28 06:26:14,608][106225] Updated weights for policy 1, policy_version 1558750 (0.0010) [2023-12-28 06:26:14,658][106225] Updated weights for policy 1, policy_version 1558760 (0.0010) [2023-12-28 06:26:14,705][106225] Updated weights for policy 1, policy_version 1558770 (0.0010) [2023-12-28 06:26:15,016][106226] Updated weights for policy 0, policy_version 1555132 (0.0007) [2023-12-28 06:26:15,083][106226] Updated weights for policy 0, policy_version 1555142 (0.0010) [2023-12-28 06:26:15,151][106226] Updated weights for policy 0, policy_version 1555152 (0.0010) [2023-12-28 06:26:15,515][106225] Updated weights for policy 1, policy_version 1558780 (0.0010) [2023-12-28 06:26:15,576][106225] Updated weights for policy 1, policy_version 1558790 (0.0009) [2023-12-28 06:26:15,634][106225] Updated weights for policy 1, policy_version 1558800 (0.0005) [2023-12-28 06:26:15,717][106226] Updated weights for policy 0, policy_version 1555162 (0.0006) [2023-12-28 06:26:15,767][106226] Updated weights for policy 0, policy_version 1555172 (0.0010) [2023-12-28 06:26:15,816][106226] Updated weights for policy 0, policy_version 1555182 (0.0010) [2023-12-28 06:26:15,869][106226] Updated weights for policy 0, policy_version 1555192 (0.0010) [2023-12-28 06:26:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19934.0, 300 sec: 19855.2). Total num frames: 797310976. Throughput: 0: 9971.7, 1: 9895.5. Samples: 797299724. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:16,175][105115] Avg episode reward: [(0, '-4.478'), (1, '-4.707')] [2023-12-28 06:26:16,243][106225] Updated weights for policy 1, policy_version 1558810 (0.0005) [2023-12-28 06:26:16,304][106225] Updated weights for policy 1, policy_version 1558820 (0.0009) [2023-12-28 06:26:16,363][106225] Updated weights for policy 1, policy_version 1558830 (0.0007) [2023-12-28 06:26:16,410][106225] Updated weights for policy 1, policy_version 1558840 (0.0010) [2023-12-28 06:26:16,489][106226] Updated weights for policy 0, policy_version 1555202 (0.0011) [2023-12-28 06:26:16,536][106226] Updated weights for policy 0, policy_version 1555212 (0.0010) [2023-12-28 06:26:16,596][106226] Updated weights for policy 0, policy_version 1555222 (0.0011) [2023-12-28 06:26:17,098][106225] Updated weights for policy 1, policy_version 1558850 (0.0010) [2023-12-28 06:26:17,157][106225] Updated weights for policy 1, policy_version 1558860 (0.0010) [2023-12-28 06:26:17,214][106225] Updated weights for policy 1, policy_version 1558870 (0.0010) [2023-12-28 06:26:17,319][106226] Updated weights for policy 0, policy_version 1555232 (0.0010) [2023-12-28 06:26:17,376][106226] Updated weights for policy 0, policy_version 1555242 (0.0010) [2023-12-28 06:26:17,422][106226] Updated weights for policy 0, policy_version 1555252 (0.0010) [2023-12-28 06:26:17,927][106225] Updated weights for policy 1, policy_version 1558880 (0.0010) [2023-12-28 06:26:17,984][106225] Updated weights for policy 1, policy_version 1558890 (0.0010) [2023-12-28 06:26:18,041][106225] Updated weights for policy 1, policy_version 1558900 (0.0010) [2023-12-28 06:26:18,138][106226] Updated weights for policy 0, policy_version 1555262 (0.0010) [2023-12-28 06:26:18,191][106226] Updated weights for policy 0, policy_version 1555272 (0.0010) [2023-12-28 06:26:18,248][106226] Updated weights for policy 0, policy_version 1555282 (0.0010) [2023-12-28 06:26:18,689][106225] Updated weights for policy 1, policy_version 1558910 (0.0011) [2023-12-28 06:26:18,750][106225] Updated weights for policy 1, policy_version 1558920 (0.0010) [2023-12-28 06:26:18,814][106225] Updated weights for policy 1, policy_version 1558930 (0.0011) [2023-12-28 06:26:18,991][106226] Updated weights for policy 0, policy_version 1555292 (0.0009) [2023-12-28 06:26:19,043][106226] Updated weights for policy 0, policy_version 1555302 (0.0008) [2023-12-28 06:26:19,103][106226] Updated weights for policy 0, policy_version 1555312 (0.0008) [2023-12-28 06:26:19,550][106225] Updated weights for policy 1, policy_version 1558940 (0.0010) [2023-12-28 06:26:19,603][106225] Updated weights for policy 1, policy_version 1558950 (0.0007) [2023-12-28 06:26:19,660][106225] Updated weights for policy 1, policy_version 1558960 (0.0009) [2023-12-28 06:26:19,922][106226] Updated weights for policy 0, policy_version 1555322 (0.0009) [2023-12-28 06:26:19,988][106226] Updated weights for policy 0, policy_version 1555332 (0.0008) [2023-12-28 06:26:20,053][106226] Updated weights for policy 0, policy_version 1555342 (0.0009) [2023-12-28 06:26:20,116][106226] Updated weights for policy 0, policy_version 1555352 (0.0008) [2023-12-28 06:26:20,412][106225] Updated weights for policy 1, policy_version 1558970 (0.0008) [2023-12-28 06:26:20,466][106225] Updated weights for policy 1, policy_version 1558980 (0.0008) [2023-12-28 06:26:20,529][106225] Updated weights for policy 1, policy_version 1558990 (0.0006) [2023-12-28 06:26:20,608][106225] Updated weights for policy 1, policy_version 1559000 (0.0007) [2023-12-28 06:26:20,893][106226] Updated weights for policy 0, policy_version 1555362 (0.0009) [2023-12-28 06:26:20,951][106226] Updated weights for policy 0, policy_version 1555372 (0.0008) [2023-12-28 06:26:21,009][106226] Updated weights for policy 0, policy_version 1555382 (0.0006) [2023-12-28 06:26:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 797409280. Throughput: 0: 9919.5, 1: 9952.0. Samples: 797417728. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:21,175][105115] Avg episode reward: [(0, '-4.887'), (1, '-4.704')] [2023-12-28 06:26:21,303][106225] Updated weights for policy 1, policy_version 1559010 (0.0008) [2023-12-28 06:26:21,368][106225] Updated weights for policy 1, policy_version 1559020 (0.0008) [2023-12-28 06:26:21,442][106225] Updated weights for policy 1, policy_version 1559030 (0.0010) [2023-12-28 06:26:21,812][106226] Updated weights for policy 0, policy_version 1555392 (0.0008) [2023-12-28 06:26:21,865][106226] Updated weights for policy 0, policy_version 1555402 (0.0008) [2023-12-28 06:26:21,928][106226] Updated weights for policy 0, policy_version 1555412 (0.0008) [2023-12-28 06:26:22,172][106225] Updated weights for policy 1, policy_version 1559040 (0.0007) [2023-12-28 06:26:22,240][106225] Updated weights for policy 1, policy_version 1559050 (0.0007) [2023-12-28 06:26:22,314][106225] Updated weights for policy 1, policy_version 1559060 (0.0008) [2023-12-28 06:26:22,680][106226] Updated weights for policy 0, policy_version 1555422 (0.0007) [2023-12-28 06:26:22,737][106226] Updated weights for policy 0, policy_version 1555432 (0.0008) [2023-12-28 06:26:22,801][106226] Updated weights for policy 0, policy_version 1555442 (0.0009) [2023-12-28 06:26:23,006][106225] Updated weights for policy 1, policy_version 1559070 (0.0007) [2023-12-28 06:26:23,058][106225] Updated weights for policy 1, policy_version 1559080 (0.0005) [2023-12-28 06:26:23,113][106225] Updated weights for policy 1, policy_version 1559090 (0.0005) [2023-12-28 06:26:23,560][106226] Updated weights for policy 0, policy_version 1555452 (0.0008) [2023-12-28 06:26:23,622][106226] Updated weights for policy 0, policy_version 1555462 (0.0007) [2023-12-28 06:26:23,690][106226] Updated weights for policy 0, policy_version 1555472 (0.0010) [2023-12-28 06:26:23,700][106225] Updated weights for policy 1, policy_version 1559100 (0.0005) [2023-12-28 06:26:23,754][106225] Updated weights for policy 1, policy_version 1559110 (0.0006) [2023-12-28 06:26:23,814][106225] Updated weights for policy 1, policy_version 1559120 (0.0007) [2023-12-28 06:26:24,415][106225] Updated weights for policy 1, policy_version 1559130 (0.0005) [2023-12-28 06:26:24,428][106226] Updated weights for policy 0, policy_version 1555482 (0.0011) [2023-12-28 06:26:24,465][106225] Updated weights for policy 1, policy_version 1559140 (0.0005) [2023-12-28 06:26:24,478][106226] Updated weights for policy 0, policy_version 1555492 (0.0010) [2023-12-28 06:26:24,520][106225] Updated weights for policy 1, policy_version 1559150 (0.0009) [2023-12-28 06:26:24,527][106226] Updated weights for policy 0, policy_version 1555502 (0.0009) [2023-12-28 06:26:24,578][106226] Updated weights for policy 0, policy_version 1555512 (0.0005) [2023-12-28 06:26:24,587][106225] Updated weights for policy 1, policy_version 1559160 (0.0008) [2023-12-28 06:26:25,233][106225] Updated weights for policy 1, policy_version 1559170 (0.0010) [2023-12-28 06:26:25,256][106226] Updated weights for policy 0, policy_version 1555522 (0.0010) [2023-12-28 06:26:25,289][106225] Updated weights for policy 1, policy_version 1559180 (0.0010) [2023-12-28 06:26:25,313][106226] Updated weights for policy 0, policy_version 1555532 (0.0006) [2023-12-28 06:26:25,349][106225] Updated weights for policy 1, policy_version 1559190 (0.0010) [2023-12-28 06:26:25,374][106226] Updated weights for policy 0, policy_version 1555542 (0.0006) [2023-12-28 06:26:26,029][106226] Updated weights for policy 0, policy_version 1555552 (0.0007) [2023-12-28 06:26:26,060][106225] Updated weights for policy 1, policy_version 1559200 (0.0010) [2023-12-28 06:26:26,089][106226] Updated weights for policy 0, policy_version 1555562 (0.0008) [2023-12-28 06:26:26,111][106225] Updated weights for policy 1, policy_version 1559210 (0.0010) [2023-12-28 06:26:26,144][106226] Updated weights for policy 0, policy_version 1555572 (0.0007) [2023-12-28 06:26:26,160][106225] Updated weights for policy 1, policy_version 1559220 (0.0010) [2023-12-28 06:26:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 797507584. Throughput: 0: 9787.0, 1: 10012.0. Samples: 797475368. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:26,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.460')] [2023-12-28 06:26:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001555576_398303232.pth... [2023-12-28 06:26:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001554424_398008320.pth [2023-12-28 06:26:26,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001559224_399212544.pth... [2023-12-28 06:26:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001558040_398909440.pth [2023-12-28 06:26:26,719][106226] Updated weights for policy 0, policy_version 1555582 (0.0006) [2023-12-28 06:26:26,777][106226] Updated weights for policy 0, policy_version 1555592 (0.0006) [2023-12-28 06:26:26,823][106226] Updated weights for policy 0, policy_version 1555602 (0.0005) [2023-12-28 06:26:26,895][106225] Updated weights for policy 1, policy_version 1559230 (0.0010) [2023-12-28 06:26:26,948][106225] Updated weights for policy 1, policy_version 1559240 (0.0010) [2023-12-28 06:26:27,005][106225] Updated weights for policy 1, policy_version 1559250 (0.0010) [2023-12-28 06:26:27,333][106226] Updated weights for policy 0, policy_version 1555612 (0.0007) [2023-12-28 06:26:27,382][106226] Updated weights for policy 0, policy_version 1555622 (0.0008) [2023-12-28 06:26:27,434][106226] Updated weights for policy 0, policy_version 1555632 (0.0008) [2023-12-28 06:26:27,708][106225] Updated weights for policy 1, policy_version 1559260 (0.0010) [2023-12-28 06:26:27,761][106225] Updated weights for policy 1, policy_version 1559270 (0.0010) [2023-12-28 06:26:27,816][106225] Updated weights for policy 1, policy_version 1559280 (0.0010) [2023-12-28 06:26:28,107][106226] Updated weights for policy 0, policy_version 1555642 (0.0008) [2023-12-28 06:26:28,160][106226] Updated weights for policy 0, policy_version 1555652 (0.0008) [2023-12-28 06:26:28,207][106226] Updated weights for policy 0, policy_version 1555662 (0.0008) [2023-12-28 06:26:28,252][106226] Updated weights for policy 0, policy_version 1555672 (0.0006) [2023-12-28 06:26:28,538][106225] Updated weights for policy 1, policy_version 1559290 (0.0009) [2023-12-28 06:26:28,595][106225] Updated weights for policy 1, policy_version 1559300 (0.0010) [2023-12-28 06:26:28,652][106225] Updated weights for policy 1, policy_version 1559310 (0.0010) [2023-12-28 06:26:28,701][106225] Updated weights for policy 1, policy_version 1559320 (0.0010) [2023-12-28 06:26:28,957][106226] Updated weights for policy 0, policy_version 1555682 (0.0010) [2023-12-28 06:26:29,012][106226] Updated weights for policy 0, policy_version 1555692 (0.0009) [2023-12-28 06:26:29,071][106226] Updated weights for policy 0, policy_version 1555702 (0.0005) [2023-12-28 06:26:29,460][106225] Updated weights for policy 1, policy_version 1559330 (0.0007) [2023-12-28 06:26:29,519][106225] Updated weights for policy 1, policy_version 1559340 (0.0007) [2023-12-28 06:26:29,579][106225] Updated weights for policy 1, policy_version 1559350 (0.0008) [2023-12-28 06:26:29,747][106226] Updated weights for policy 0, policy_version 1555712 (0.0009) [2023-12-28 06:26:29,803][106226] Updated weights for policy 0, policy_version 1555722 (0.0010) [2023-12-28 06:26:29,864][106226] Updated weights for policy 0, policy_version 1555732 (0.0010) [2023-12-28 06:26:30,266][106225] Updated weights for policy 1, policy_version 1559360 (0.0007) [2023-12-28 06:26:30,323][106225] Updated weights for policy 1, policy_version 1559370 (0.0008) [2023-12-28 06:26:30,387][106225] Updated weights for policy 1, policy_version 1559380 (0.0009) [2023-12-28 06:26:30,541][106226] Updated weights for policy 0, policy_version 1555742 (0.0008) [2023-12-28 06:26:30,610][106226] Updated weights for policy 0, policy_version 1555752 (0.0006) [2023-12-28 06:26:30,676][106226] Updated weights for policy 0, policy_version 1555762 (0.0006) [2023-12-28 06:26:31,036][106225] Updated weights for policy 1, policy_version 1559390 (0.0008) [2023-12-28 06:26:31,104][106225] Updated weights for policy 1, policy_version 1559400 (0.0010) [2023-12-28 06:26:31,168][106225] Updated weights for policy 1, policy_version 1559410 (0.0008) [2023-12-28 06:26:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 797605888. Throughput: 0: 9928.6, 1: 10123.9. Samples: 797599464. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:31,175][105115] Avg episode reward: [(0, '-4.773'), (1, '-4.933')] [2023-12-28 06:26:31,204][106226] Updated weights for policy 0, policy_version 1555772 (0.0008) [2023-12-28 06:26:31,262][106226] Updated weights for policy 0, policy_version 1555782 (0.0007) [2023-12-28 06:26:31,327][106226] Updated weights for policy 0, policy_version 1555792 (0.0010) [2023-12-28 06:26:31,839][106225] Updated weights for policy 1, policy_version 1559420 (0.0007) [2023-12-28 06:26:31,910][106225] Updated weights for policy 1, policy_version 1559430 (0.0008) [2023-12-28 06:26:31,975][106225] Updated weights for policy 1, policy_version 1559440 (0.0008) [2023-12-28 06:26:32,084][106226] Updated weights for policy 0, policy_version 1555802 (0.0009) [2023-12-28 06:26:32,146][106226] Updated weights for policy 0, policy_version 1555812 (0.0009) [2023-12-28 06:26:32,206][106226] Updated weights for policy 0, policy_version 1555822 (0.0008) [2023-12-28 06:26:32,270][106226] Updated weights for policy 0, policy_version 1555832 (0.0007) [2023-12-28 06:26:32,680][106225] Updated weights for policy 1, policy_version 1559450 (0.0008) [2023-12-28 06:26:32,743][106225] Updated weights for policy 1, policy_version 1559460 (0.0008) [2023-12-28 06:26:32,795][106225] Updated weights for policy 1, policy_version 1559470 (0.0009) [2023-12-28 06:26:32,855][106225] Updated weights for policy 1, policy_version 1559480 (0.0008) [2023-12-28 06:26:32,966][106226] Updated weights for policy 0, policy_version 1555842 (0.0010) [2023-12-28 06:26:33,028][106226] Updated weights for policy 0, policy_version 1555852 (0.0011) [2023-12-28 06:26:33,092][106226] Updated weights for policy 0, policy_version 1555862 (0.0006) [2023-12-28 06:26:33,637][106226] Updated weights for policy 0, policy_version 1555872 (0.0007) [2023-12-28 06:26:33,638][106225] Updated weights for policy 1, policy_version 1559490 (0.0007) [2023-12-28 06:26:33,689][106225] Updated weights for policy 1, policy_version 1559500 (0.0008) [2023-12-28 06:26:33,693][106226] Updated weights for policy 0, policy_version 1555882 (0.0006) [2023-12-28 06:26:33,738][106225] Updated weights for policy 1, policy_version 1559510 (0.0008) [2023-12-28 06:26:33,745][106226] Updated weights for policy 0, policy_version 1555892 (0.0007) [2023-12-28 06:26:34,305][106226] Updated weights for policy 0, policy_version 1555902 (0.0009) [2023-12-28 06:26:34,361][106226] Updated weights for policy 0, policy_version 1555912 (0.0009) [2023-12-28 06:26:34,428][106226] Updated weights for policy 0, policy_version 1555922 (0.0009) [2023-12-28 06:26:34,543][106225] Updated weights for policy 1, policy_version 1559520 (0.0008) [2023-12-28 06:26:34,600][106225] Updated weights for policy 1, policy_version 1559530 (0.0008) [2023-12-28 06:26:34,657][106225] Updated weights for policy 1, policy_version 1559540 (0.0009) [2023-12-28 06:26:35,084][106226] Updated weights for policy 0, policy_version 1555932 (0.0010) [2023-12-28 06:26:35,137][106226] Updated weights for policy 0, policy_version 1555942 (0.0011) [2023-12-28 06:26:35,194][106226] Updated weights for policy 0, policy_version 1555952 (0.0010) [2023-12-28 06:26:35,368][106225] Updated weights for policy 1, policy_version 1559550 (0.0007) [2023-12-28 06:26:35,437][106225] Updated weights for policy 1, policy_version 1559560 (0.0006) [2023-12-28 06:26:35,500][106225] Updated weights for policy 1, policy_version 1559570 (0.0005) [2023-12-28 06:26:35,855][106226] Updated weights for policy 0, policy_version 1555962 (0.0009) [2023-12-28 06:26:35,924][106226] Updated weights for policy 0, policy_version 1555972 (0.0005) [2023-12-28 06:26:35,989][106226] Updated weights for policy 0, policy_version 1555982 (0.0005) [2023-12-28 06:26:36,028][106225] Updated weights for policy 1, policy_version 1559580 (0.0006) [2023-12-28 06:26:36,051][106226] Updated weights for policy 0, policy_version 1555992 (0.0005) [2023-12-28 06:26:36,071][106225] Updated weights for policy 1, policy_version 1559590 (0.0006) [2023-12-28 06:26:36,120][106225] Updated weights for policy 1, policy_version 1559600 (0.0006) [2023-12-28 06:26:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 797720576. Throughput: 0: 9941.8, 1: 10022.2. Samples: 797723008. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:36,175][105115] Avg episode reward: [(0, '-4.797'), (1, '-4.514')] [2023-12-28 06:26:36,675][106226] Updated weights for policy 0, policy_version 1556002 (0.0008) [2023-12-28 06:26:36,727][106226] Updated weights for policy 0, policy_version 1556012 (0.0006) [2023-12-28 06:26:36,777][106226] Updated weights for policy 0, policy_version 1556022 (0.0005) [2023-12-28 06:26:36,859][106225] Updated weights for policy 1, policy_version 1559610 (0.0008) [2023-12-28 06:26:36,908][106225] Updated weights for policy 1, policy_version 1559620 (0.0009) [2023-12-28 06:26:36,954][106225] Updated weights for policy 1, policy_version 1559630 (0.0008) [2023-12-28 06:26:36,999][106225] Updated weights for policy 1, policy_version 1559640 (0.0008) [2023-12-28 06:26:37,421][106226] Updated weights for policy 0, policy_version 1556032 (0.0008) [2023-12-28 06:26:37,477][106226] Updated weights for policy 0, policy_version 1556042 (0.0006) [2023-12-28 06:26:37,526][106226] Updated weights for policy 0, policy_version 1556052 (0.0005) [2023-12-28 06:26:37,807][106225] Updated weights for policy 1, policy_version 1559650 (0.0011) [2023-12-28 06:26:37,868][106225] Updated weights for policy 1, policy_version 1559660 (0.0010) [2023-12-28 06:26:37,933][106225] Updated weights for policy 1, policy_version 1559670 (0.0005) [2023-12-28 06:26:38,126][106226] Updated weights for policy 0, policy_version 1556062 (0.0005) [2023-12-28 06:26:38,181][106226] Updated weights for policy 0, policy_version 1556072 (0.0006) [2023-12-28 06:26:38,248][106226] Updated weights for policy 0, policy_version 1556082 (0.0005) [2023-12-28 06:26:38,611][106225] Updated weights for policy 1, policy_version 1559680 (0.0007) [2023-12-28 06:26:38,659][106225] Updated weights for policy 1, policy_version 1559690 (0.0009) [2023-12-28 06:26:38,722][106225] Updated weights for policy 1, policy_version 1559700 (0.0008) [2023-12-28 06:26:38,831][106226] Updated weights for policy 0, policy_version 1556092 (0.0007) [2023-12-28 06:26:38,899][106226] Updated weights for policy 0, policy_version 1556102 (0.0006) [2023-12-28 06:26:38,965][106226] Updated weights for policy 0, policy_version 1556112 (0.0006) [2023-12-28 06:26:39,480][106225] Updated weights for policy 1, policy_version 1559710 (0.0009) [2023-12-28 06:26:39,549][106225] Updated weights for policy 1, policy_version 1559720 (0.0011) [2023-12-28 06:26:39,617][106225] Updated weights for policy 1, policy_version 1559730 (0.0011) [2023-12-28 06:26:39,635][106226] Updated weights for policy 0, policy_version 1556122 (0.0007) [2023-12-28 06:26:39,700][106226] Updated weights for policy 0, policy_version 1556132 (0.0007) [2023-12-28 06:26:39,772][106226] Updated weights for policy 0, policy_version 1556142 (0.0006) [2023-12-28 06:26:39,836][106226] Updated weights for policy 0, policy_version 1556152 (0.0009) [2023-12-28 06:26:40,254][106225] Updated weights for policy 1, policy_version 1559740 (0.0009) [2023-12-28 06:26:40,315][106225] Updated weights for policy 1, policy_version 1559750 (0.0008) [2023-12-28 06:26:40,378][106225] Updated weights for policy 1, policy_version 1559760 (0.0008) [2023-12-28 06:26:40,580][106226] Updated weights for policy 0, policy_version 1556162 (0.0011) [2023-12-28 06:26:40,646][106226] Updated weights for policy 0, policy_version 1556172 (0.0010) [2023-12-28 06:26:40,712][106226] Updated weights for policy 0, policy_version 1556182 (0.0010) [2023-12-28 06:26:40,984][106225] Updated weights for policy 1, policy_version 1559770 (0.0009) [2023-12-28 06:26:41,045][106225] Updated weights for policy 1, policy_version 1559780 (0.0008) [2023-12-28 06:26:41,112][106225] Updated weights for policy 1, policy_version 1559790 (0.0008) [2023-12-28 06:26:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 797810688. Throughput: 0: 10037.7, 1: 10002.3. Samples: 797784880. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:41,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.654')] [2023-12-28 06:26:41,180][106225] Updated weights for policy 1, policy_version 1559800 (0.0008) [2023-12-28 06:26:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001559800_399360000.pth... [2023-12-28 06:26:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001556184_398458880.pth... [2023-12-28 06:26:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001558648_399065088.pth [2023-12-28 06:26:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001555000_398155776.pth [2023-12-28 06:26:41,517][106226] Updated weights for policy 0, policy_version 1556192 (0.0006) [2023-12-28 06:26:41,580][106226] Updated weights for policy 0, policy_version 1556202 (0.0007) [2023-12-28 06:26:41,647][106226] Updated weights for policy 0, policy_version 1556212 (0.0008) [2023-12-28 06:26:41,939][106225] Updated weights for policy 1, policy_version 1559810 (0.0009) [2023-12-28 06:26:41,997][106225] Updated weights for policy 1, policy_version 1559820 (0.0008) [2023-12-28 06:26:42,045][106225] Updated weights for policy 1, policy_version 1559830 (0.0008) [2023-12-28 06:26:42,399][106226] Updated weights for policy 0, policy_version 1556222 (0.0009) [2023-12-28 06:26:42,473][106226] Updated weights for policy 0, policy_version 1556232 (0.0008) [2023-12-28 06:26:42,541][106226] Updated weights for policy 0, policy_version 1556242 (0.0009) [2023-12-28 06:26:42,815][106225] Updated weights for policy 1, policy_version 1559840 (0.0008) [2023-12-28 06:26:42,879][106225] Updated weights for policy 1, policy_version 1559850 (0.0007) [2023-12-28 06:26:42,947][106225] Updated weights for policy 1, policy_version 1559860 (0.0008) [2023-12-28 06:26:43,282][106226] Updated weights for policy 0, policy_version 1556252 (0.0009) [2023-12-28 06:26:43,334][106226] Updated weights for policy 0, policy_version 1556262 (0.0006) [2023-12-28 06:26:43,388][106226] Updated weights for policy 0, policy_version 1556272 (0.0008) [2023-12-28 06:26:43,609][106225] Updated weights for policy 1, policy_version 1559870 (0.0008) [2023-12-28 06:26:43,657][106225] Updated weights for policy 1, policy_version 1559880 (0.0008) [2023-12-28 06:26:43,719][106225] Updated weights for policy 1, policy_version 1559890 (0.0008) [2023-12-28 06:26:44,040][106226] Updated weights for policy 0, policy_version 1556282 (0.0008) [2023-12-28 06:26:44,086][106226] Updated weights for policy 0, policy_version 1556292 (0.0005) [2023-12-28 06:26:44,136][106226] Updated weights for policy 0, policy_version 1556302 (0.0005) [2023-12-28 06:26:44,192][106226] Updated weights for policy 0, policy_version 1556312 (0.0006) [2023-12-28 06:26:44,530][106225] Updated weights for policy 1, policy_version 1559900 (0.0010) [2023-12-28 06:26:44,595][106225] Updated weights for policy 1, policy_version 1559910 (0.0009) [2023-12-28 06:26:44,648][106225] Updated weights for policy 1, policy_version 1559920 (0.0008) [2023-12-28 06:26:44,786][106226] Updated weights for policy 0, policy_version 1556322 (0.0007) [2023-12-28 06:26:44,846][106226] Updated weights for policy 0, policy_version 1556332 (0.0008) [2023-12-28 06:26:44,906][106226] Updated weights for policy 0, policy_version 1556342 (0.0008) [2023-12-28 06:26:45,405][106225] Updated weights for policy 1, policy_version 1559930 (0.0009) [2023-12-28 06:26:45,457][106225] Updated weights for policy 1, policy_version 1559940 (0.0005) [2023-12-28 06:26:45,520][106225] Updated weights for policy 1, policy_version 1559950 (0.0009) [2023-12-28 06:26:45,574][106225] Updated weights for policy 1, policy_version 1559960 (0.0009) [2023-12-28 06:26:45,607][106226] Updated weights for policy 0, policy_version 1556352 (0.0009) [2023-12-28 06:26:45,657][106226] Updated weights for policy 0, policy_version 1556362 (0.0008) [2023-12-28 06:26:45,708][106226] Updated weights for policy 0, policy_version 1556372 (0.0008) [2023-12-28 06:26:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 797908992. Throughput: 0: 10086.7, 1: 9793.1. Samples: 797900340. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:46,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-4.717')] [2023-12-28 06:26:46,217][106225] Updated weights for policy 1, policy_version 1559970 (0.0005) [2023-12-28 06:26:46,271][106225] Updated weights for policy 1, policy_version 1559980 (0.0007) [2023-12-28 06:26:46,321][106225] Updated weights for policy 1, policy_version 1559990 (0.0008) [2023-12-28 06:26:46,411][106226] Updated weights for policy 0, policy_version 1556382 (0.0008) [2023-12-28 06:26:46,478][106226] Updated weights for policy 0, policy_version 1556392 (0.0008) [2023-12-28 06:26:46,536][106226] Updated weights for policy 0, policy_version 1556402 (0.0006) [2023-12-28 06:26:46,955][106225] Updated weights for policy 1, policy_version 1560000 (0.0006) [2023-12-28 06:26:47,021][106225] Updated weights for policy 1, policy_version 1560010 (0.0006) [2023-12-28 06:26:47,084][106225] Updated weights for policy 1, policy_version 1560020 (0.0005) [2023-12-28 06:26:47,104][106226] Updated weights for policy 0, policy_version 1556412 (0.0007) [2023-12-28 06:26:47,157][106226] Updated weights for policy 0, policy_version 1556422 (0.0005) [2023-12-28 06:26:47,209][106226] Updated weights for policy 0, policy_version 1556432 (0.0006) [2023-12-28 06:26:47,686][106225] Updated weights for policy 1, policy_version 1560030 (0.0007) [2023-12-28 06:26:47,749][106225] Updated weights for policy 1, policy_version 1560040 (0.0008) [2023-12-28 06:26:47,803][106225] Updated weights for policy 1, policy_version 1560050 (0.0007) [2023-12-28 06:26:47,854][106226] Updated weights for policy 0, policy_version 1556442 (0.0006) [2023-12-28 06:26:47,911][106226] Updated weights for policy 0, policy_version 1556452 (0.0010) [2023-12-28 06:26:47,961][106226] Updated weights for policy 0, policy_version 1556462 (0.0011) [2023-12-28 06:26:48,018][106226] Updated weights for policy 0, policy_version 1556472 (0.0008) [2023-12-28 06:26:48,427][106225] Updated weights for policy 1, policy_version 1560060 (0.0008) [2023-12-28 06:26:48,488][106225] Updated weights for policy 1, policy_version 1560070 (0.0008) [2023-12-28 06:26:48,555][106225] Updated weights for policy 1, policy_version 1560080 (0.0009) [2023-12-28 06:26:48,643][106226] Updated weights for policy 0, policy_version 1556482 (0.0011) [2023-12-28 06:26:48,692][106226] Updated weights for policy 0, policy_version 1556492 (0.0008) [2023-12-28 06:26:48,743][106226] Updated weights for policy 0, policy_version 1556502 (0.0010) [2023-12-28 06:26:49,310][106225] Updated weights for policy 1, policy_version 1560090 (0.0008) [2023-12-28 06:26:49,379][106225] Updated weights for policy 1, policy_version 1560100 (0.0008) [2023-12-28 06:26:49,443][106225] Updated weights for policy 1, policy_version 1560110 (0.0007) [2023-12-28 06:26:49,447][106226] Updated weights for policy 0, policy_version 1556512 (0.0008) [2023-12-28 06:26:49,492][106225] Updated weights for policy 1, policy_version 1560120 (0.0008) [2023-12-28 06:26:49,509][106226] Updated weights for policy 0, policy_version 1556522 (0.0006) [2023-12-28 06:26:49,571][106226] Updated weights for policy 0, policy_version 1556532 (0.0008) [2023-12-28 06:26:50,266][106225] Updated weights for policy 1, policy_version 1560130 (0.0008) [2023-12-28 06:26:50,284][106226] Updated weights for policy 0, policy_version 1556542 (0.0007) [2023-12-28 06:26:50,315][106225] Updated weights for policy 1, policy_version 1560140 (0.0006) [2023-12-28 06:26:50,332][106226] Updated weights for policy 0, policy_version 1556552 (0.0008) [2023-12-28 06:26:50,370][106225] Updated weights for policy 1, policy_version 1560150 (0.0008) [2023-12-28 06:26:50,384][106226] Updated weights for policy 0, policy_version 1556562 (0.0007) [2023-12-28 06:26:51,051][106226] Updated weights for policy 0, policy_version 1556572 (0.0009) [2023-12-28 06:26:51,077][106225] Updated weights for policy 1, policy_version 1560160 (0.0007) [2023-12-28 06:26:51,116][106226] Updated weights for policy 0, policy_version 1556582 (0.0007) [2023-12-28 06:26:51,144][106225] Updated weights for policy 1, policy_version 1560170 (0.0008) [2023-12-28 06:26:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 798007296. Throughput: 0: 10150.3, 1: 9822.9. Samples: 798023648. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:51,175][105115] Avg episode reward: [(0, '-4.979'), (1, '-4.747')] [2023-12-28 06:26:51,179][106226] Updated weights for policy 0, policy_version 1556592 (0.0008) [2023-12-28 06:26:51,208][106225] Updated weights for policy 1, policy_version 1560180 (0.0008) [2023-12-28 06:26:51,967][106226] Updated weights for policy 0, policy_version 1556602 (0.0007) [2023-12-28 06:26:52,035][106226] Updated weights for policy 0, policy_version 1556612 (0.0007) [2023-12-28 06:26:52,043][106225] Updated weights for policy 1, policy_version 1560190 (0.0008) [2023-12-28 06:26:52,095][106226] Updated weights for policy 0, policy_version 1556622 (0.0008) [2023-12-28 06:26:52,108][106225] Updated weights for policy 1, policy_version 1560200 (0.0005) [2023-12-28 06:26:52,160][106226] Updated weights for policy 0, policy_version 1556632 (0.0009) [2023-12-28 06:26:52,174][106225] Updated weights for policy 1, policy_version 1560210 (0.0005) [2023-12-28 06:26:52,831][106226] Updated weights for policy 0, policy_version 1556642 (0.0006) [2023-12-28 06:26:52,883][106226] Updated weights for policy 0, policy_version 1556652 (0.0008) [2023-12-28 06:26:52,883][106225] Updated weights for policy 1, policy_version 1560220 (0.0010) [2023-12-28 06:26:52,943][106226] Updated weights for policy 0, policy_version 1556662 (0.0005) [2023-12-28 06:26:52,944][106225] Updated weights for policy 1, policy_version 1560230 (0.0007) [2023-12-28 06:26:53,014][106225] Updated weights for policy 1, policy_version 1560240 (0.0006) [2023-12-28 06:26:53,557][106225] Updated weights for policy 1, policy_version 1560250 (0.0008) [2023-12-28 06:26:53,605][106226] Updated weights for policy 0, policy_version 1556672 (0.0009) [2023-12-28 06:26:53,609][106225] Updated weights for policy 1, policy_version 1560260 (0.0005) [2023-12-28 06:26:53,664][106226] Updated weights for policy 0, policy_version 1556682 (0.0010) [2023-12-28 06:26:53,665][106225] Updated weights for policy 1, policy_version 1560270 (0.0009) [2023-12-28 06:26:53,715][106226] Updated weights for policy 0, policy_version 1556692 (0.0010) [2023-12-28 06:26:54,286][106225] Updated weights for policy 1, policy_version 1560281 (0.0009) [2023-12-28 06:26:54,346][106225] Updated weights for policy 1, policy_version 1560291 (0.0005) [2023-12-28 06:26:54,411][106225] Updated weights for policy 1, policy_version 1560301 (0.0005) [2023-12-28 06:26:54,431][106226] Updated weights for policy 0, policy_version 1556702 (0.0010) [2023-12-28 06:26:54,474][106225] Updated weights for policy 1, policy_version 1560311 (0.0006) [2023-12-28 06:26:54,484][106226] Updated weights for policy 0, policy_version 1556712 (0.0008) [2023-12-28 06:26:54,535][106226] Updated weights for policy 0, policy_version 1556722 (0.0005) [2023-12-28 06:26:55,073][106225] Updated weights for policy 1, policy_version 1560321 (0.0007) [2023-12-28 06:26:55,133][106225] Updated weights for policy 1, policy_version 1560331 (0.0008) [2023-12-28 06:26:55,180][106225] Updated weights for policy 1, policy_version 1560341 (0.0007) [2023-12-28 06:26:55,218][106226] Updated weights for policy 0, policy_version 1556732 (0.0007) [2023-12-28 06:26:55,277][106226] Updated weights for policy 0, policy_version 1556742 (0.0010) [2023-12-28 06:26:55,333][106226] Updated weights for policy 0, policy_version 1556752 (0.0010) [2023-12-28 06:26:55,840][106225] Updated weights for policy 1, policy_version 1560351 (0.0006) [2023-12-28 06:26:55,904][106225] Updated weights for policy 1, policy_version 1560361 (0.0005) [2023-12-28 06:26:55,938][106226] Updated weights for policy 0, policy_version 1556762 (0.0008) [2023-12-28 06:26:55,968][106225] Updated weights for policy 1, policy_version 1560371 (0.0005) [2023-12-28 06:26:55,993][106226] Updated weights for policy 0, policy_version 1556772 (0.0007) [2023-12-28 06:26:56,042][106226] Updated weights for policy 0, policy_version 1556782 (0.0008) [2023-12-28 06:26:56,089][106226] Updated weights for policy 0, policy_version 1556792 (0.0008) [2023-12-28 06:26:56,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 798121984. Throughput: 0: 10118.5, 1: 9872.3. Samples: 798083632. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:26:56,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-4.741')] [2023-12-28 06:26:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001560376_399507456.pth... [2023-12-28 06:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001556792_398614528.pth... [2023-12-28 06:26:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001559224_399212544.pth [2023-12-28 06:26:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001555576_398303232.pth [2023-12-28 06:26:56,493][106225] Updated weights for policy 1, policy_version 1560381 (0.0005) [2023-12-28 06:26:56,551][106225] Updated weights for policy 1, policy_version 1560391 (0.0008) [2023-12-28 06:26:56,601][106225] Updated weights for policy 1, policy_version 1560401 (0.0008) [2023-12-28 06:26:56,787][106226] Updated weights for policy 0, policy_version 1556802 (0.0006) [2023-12-28 06:26:56,840][106226] Updated weights for policy 0, policy_version 1556812 (0.0005) [2023-12-28 06:26:56,895][106226] Updated weights for policy 0, policy_version 1556822 (0.0005) [2023-12-28 06:26:57,344][106225] Updated weights for policy 1, policy_version 1560411 (0.0009) [2023-12-28 06:26:57,395][106225] Updated weights for policy 1, policy_version 1560421 (0.0005) [2023-12-28 06:26:57,451][106225] Updated weights for policy 1, policy_version 1560431 (0.0006) [2023-12-28 06:26:57,511][106226] Updated weights for policy 0, policy_version 1556832 (0.0008) [2023-12-28 06:26:57,575][106226] Updated weights for policy 0, policy_version 1556842 (0.0005) [2023-12-28 06:26:57,631][106226] Updated weights for policy 0, policy_version 1556852 (0.0005) [2023-12-28 06:26:58,131][106225] Updated weights for policy 1, policy_version 1560441 (0.0008) [2023-12-28 06:26:58,184][106225] Updated weights for policy 1, policy_version 1560451 (0.0008) [2023-12-28 06:26:58,200][106226] Updated weights for policy 0, policy_version 1556862 (0.0007) [2023-12-28 06:26:58,247][106225] Updated weights for policy 1, policy_version 1560461 (0.0009) [2023-12-28 06:26:58,266][106226] Updated weights for policy 0, policy_version 1556872 (0.0007) [2023-12-28 06:26:58,311][106225] Updated weights for policy 1, policy_version 1560471 (0.0008) [2023-12-28 06:26:58,330][106226] Updated weights for policy 0, policy_version 1556882 (0.0008) [2023-12-28 06:26:59,079][106225] Updated weights for policy 1, policy_version 1560481 (0.0009) [2023-12-28 06:26:59,103][106226] Updated weights for policy 0, policy_version 1556892 (0.0009) [2023-12-28 06:26:59,141][106225] Updated weights for policy 1, policy_version 1560491 (0.0007) [2023-12-28 06:26:59,159][106226] Updated weights for policy 0, policy_version 1556902 (0.0006) [2023-12-28 06:26:59,201][106225] Updated weights for policy 1, policy_version 1560501 (0.0006) [2023-12-28 06:26:59,244][106226] Updated weights for policy 0, policy_version 1556912 (0.0006) [2023-12-28 06:26:59,863][106225] Updated weights for policy 1, policy_version 1560511 (0.0009) [2023-12-28 06:26:59,931][106225] Updated weights for policy 1, policy_version 1560521 (0.0007) [2023-12-28 06:26:59,997][106226] Updated weights for policy 0, policy_version 1556922 (0.0008) [2023-12-28 06:26:59,999][106225] Updated weights for policy 1, policy_version 1560531 (0.0008) [2023-12-28 06:27:00,058][106226] Updated weights for policy 0, policy_version 1556932 (0.0008) [2023-12-28 06:27:00,119][106226] Updated weights for policy 0, policy_version 1556942 (0.0009) [2023-12-28 06:27:00,180][106226] Updated weights for policy 0, policy_version 1556952 (0.0009) [2023-12-28 06:27:00,619][106225] Updated weights for policy 1, policy_version 1560541 (0.0006) [2023-12-28 06:27:00,664][106225] Updated weights for policy 1, policy_version 1560551 (0.0005) [2023-12-28 06:27:00,716][106225] Updated weights for policy 1, policy_version 1560561 (0.0005) [2023-12-28 06:27:00,858][106226] Updated weights for policy 0, policy_version 1556962 (0.0006) [2023-12-28 06:27:00,921][106226] Updated weights for policy 0, policy_version 1556972 (0.0009) [2023-12-28 06:27:00,978][106226] Updated weights for policy 0, policy_version 1556982 (0.0008) [2023-12-28 06:27:01,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 798220288. Throughput: 0: 10185.9, 1: 9956.9. Samples: 798206148. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:01,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.469')] [2023-12-28 06:27:01,405][106225] Updated weights for policy 1, policy_version 1560571 (0.0005) [2023-12-28 06:27:01,470][106225] Updated weights for policy 1, policy_version 1560581 (0.0006) [2023-12-28 06:27:01,535][106225] Updated weights for policy 1, policy_version 1560591 (0.0007) [2023-12-28 06:27:01,710][106226] Updated weights for policy 0, policy_version 1556992 (0.0010) [2023-12-28 06:27:01,780][106226] Updated weights for policy 0, policy_version 1557002 (0.0010) [2023-12-28 06:27:01,843][106226] Updated weights for policy 0, policy_version 1557012 (0.0008) [2023-12-28 06:27:02,269][106225] Updated weights for policy 1, policy_version 1560601 (0.0007) [2023-12-28 06:27:02,334][106225] Updated weights for policy 1, policy_version 1560611 (0.0009) [2023-12-28 06:27:02,392][106225] Updated weights for policy 1, policy_version 1560621 (0.0008) [2023-12-28 06:27:02,430][106226] Updated weights for policy 0, policy_version 1557022 (0.0006) [2023-12-28 06:27:02,447][106225] Updated weights for policy 1, policy_version 1560631 (0.0007) [2023-12-28 06:27:02,486][106226] Updated weights for policy 0, policy_version 1557032 (0.0008) [2023-12-28 06:27:02,551][106226] Updated weights for policy 0, policy_version 1557042 (0.0007) [2023-12-28 06:27:03,194][106225] Updated weights for policy 1, policy_version 1560641 (0.0010) [2023-12-28 06:27:03,218][106226] Updated weights for policy 0, policy_version 1557052 (0.0007) [2023-12-28 06:27:03,258][106225] Updated weights for policy 1, policy_version 1560651 (0.0010) [2023-12-28 06:27:03,269][106226] Updated weights for policy 0, policy_version 1557062 (0.0009) [2023-12-28 06:27:03,311][106225] Updated weights for policy 1, policy_version 1560661 (0.0010) [2023-12-28 06:27:03,320][106226] Updated weights for policy 0, policy_version 1557072 (0.0006) [2023-12-28 06:27:04,032][106225] Updated weights for policy 1, policy_version 1560671 (0.0010) [2023-12-28 06:27:04,037][106226] Updated weights for policy 0, policy_version 1557082 (0.0007) [2023-12-28 06:27:04,092][106225] Updated weights for policy 1, policy_version 1560681 (0.0010) [2023-12-28 06:27:04,095][106226] Updated weights for policy 0, policy_version 1557092 (0.0005) [2023-12-28 06:27:04,154][106225] Updated weights for policy 1, policy_version 1560691 (0.0010) [2023-12-28 06:27:04,160][106226] Updated weights for policy 0, policy_version 1557102 (0.0008) [2023-12-28 06:27:04,223][106226] Updated weights for policy 0, policy_version 1557112 (0.0007) [2023-12-28 06:27:04,877][106225] Updated weights for policy 1, policy_version 1560701 (0.0009) [2023-12-28 06:27:04,937][106225] Updated weights for policy 1, policy_version 1560711 (0.0007) [2023-12-28 06:27:04,954][106226] Updated weights for policy 0, policy_version 1557122 (0.0011) [2023-12-28 06:27:04,998][106225] Updated weights for policy 1, policy_version 1560721 (0.0005) [2023-12-28 06:27:05,011][106226] Updated weights for policy 0, policy_version 1557132 (0.0011) [2023-12-28 06:27:05,068][106226] Updated weights for policy 0, policy_version 1557142 (0.0011) [2023-12-28 06:27:05,575][106225] Updated weights for policy 1, policy_version 1560731 (0.0005) [2023-12-28 06:27:05,640][106225] Updated weights for policy 1, policy_version 1560741 (0.0005) [2023-12-28 06:27:05,700][106225] Updated weights for policy 1, policy_version 1560751 (0.0005) [2023-12-28 06:27:05,782][106226] Updated weights for policy 0, policy_version 1557152 (0.0007) [2023-12-28 06:27:05,840][106226] Updated weights for policy 0, policy_version 1557162 (0.0006) [2023-12-28 06:27:05,884][106226] Updated weights for policy 0, policy_version 1557172 (0.0006) [2023-12-28 06:27:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 798318592. Throughput: 0: 10225.1, 1: 10004.9. Samples: 798328076. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:06,175][105115] Avg episode reward: [(0, '-4.766'), (1, '-4.866')] [2023-12-28 06:27:06,377][106225] Updated weights for policy 1, policy_version 1560761 (0.0005) [2023-12-28 06:27:06,441][106225] Updated weights for policy 1, policy_version 1560771 (0.0009) [2023-12-28 06:27:06,483][106226] Updated weights for policy 0, policy_version 1557182 (0.0006) [2023-12-28 06:27:06,493][106225] Updated weights for policy 1, policy_version 1560781 (0.0007) [2023-12-28 06:27:06,545][106225] Updated weights for policy 1, policy_version 1560791 (0.0006) [2023-12-28 06:27:06,550][106226] Updated weights for policy 0, policy_version 1557192 (0.0009) [2023-12-28 06:27:06,605][106226] Updated weights for policy 0, policy_version 1557202 (0.0011) [2023-12-28 06:27:07,255][106225] Updated weights for policy 1, policy_version 1560801 (0.0006) [2023-12-28 06:27:07,310][106225] Updated weights for policy 1, policy_version 1560811 (0.0008) [2023-12-28 06:27:07,316][106226] Updated weights for policy 0, policy_version 1557212 (0.0011) [2023-12-28 06:27:07,359][106225] Updated weights for policy 1, policy_version 1560821 (0.0006) [2023-12-28 06:27:07,369][106226] Updated weights for policy 0, policy_version 1557222 (0.0010) [2023-12-28 06:27:07,426][106226] Updated weights for policy 0, policy_version 1557232 (0.0010) [2023-12-28 06:27:07,978][106225] Updated weights for policy 1, policy_version 1560831 (0.0005) [2023-12-28 06:27:08,030][106226] Updated weights for policy 0, policy_version 1557242 (0.0010) [2023-12-28 06:27:08,039][106225] Updated weights for policy 1, policy_version 1560841 (0.0005) [2023-12-28 06:27:08,090][106226] Updated weights for policy 0, policy_version 1557252 (0.0011) [2023-12-28 06:27:08,093][106225] Updated weights for policy 1, policy_version 1560851 (0.0005) [2023-12-28 06:27:08,146][106226] Updated weights for policy 0, policy_version 1557262 (0.0010) [2023-12-28 06:27:08,212][106226] Updated weights for policy 0, policy_version 1557272 (0.0009) [2023-12-28 06:27:08,707][106225] Updated weights for policy 1, policy_version 1560861 (0.0005) [2023-12-28 06:27:08,768][106225] Updated weights for policy 1, policy_version 1560871 (0.0006) [2023-12-28 06:27:08,793][106226] Updated weights for policy 0, policy_version 1557282 (0.0006) [2023-12-28 06:27:08,834][106225] Updated weights for policy 1, policy_version 1560881 (0.0010) [2023-12-28 06:27:08,860][106226] Updated weights for policy 0, policy_version 1557292 (0.0008) [2023-12-28 06:27:08,922][106226] Updated weights for policy 0, policy_version 1557302 (0.0009) [2023-12-28 06:27:09,544][106225] Updated weights for policy 1, policy_version 1560891 (0.0011) [2023-12-28 06:27:09,582][106226] Updated weights for policy 0, policy_version 1557312 (0.0009) [2023-12-28 06:27:09,605][106225] Updated weights for policy 1, policy_version 1560901 (0.0011) [2023-12-28 06:27:09,642][106226] Updated weights for policy 0, policy_version 1557322 (0.0006) [2023-12-28 06:27:09,665][106225] Updated weights for policy 1, policy_version 1560911 (0.0009) [2023-12-28 06:27:09,703][106226] Updated weights for policy 0, policy_version 1557332 (0.0007) [2023-12-28 06:27:10,362][106225] Updated weights for policy 1, policy_version 1560921 (0.0007) [2023-12-28 06:27:10,433][106225] Updated weights for policy 1, policy_version 1560931 (0.0006) [2023-12-28 06:27:10,450][106226] Updated weights for policy 0, policy_version 1557342 (0.0007) [2023-12-28 06:27:10,492][106225] Updated weights for policy 1, policy_version 1560941 (0.0008) [2023-12-28 06:27:10,502][106226] Updated weights for policy 0, policy_version 1557352 (0.0006) [2023-12-28 06:27:10,550][106225] Updated weights for policy 1, policy_version 1560951 (0.0006) [2023-12-28 06:27:10,551][106226] Updated weights for policy 0, policy_version 1557362 (0.0008) [2023-12-28 06:27:11,086][106225] Updated weights for policy 1, policy_version 1560961 (0.0010) [2023-12-28 06:27:11,160][106225] Updated weights for policy 1, policy_version 1560971 (0.0012) [2023-12-28 06:27:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 798416896. Throughput: 0: 10336.3, 1: 10038.0. Samples: 798392208. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:11,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-4.727')] [2023-12-28 06:27:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001557368_398761984.pth... [2023-12-28 06:27:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001556184_398458880.pth [2023-12-28 06:27:11,218][106225] Updated weights for policy 1, policy_version 1560981 (0.0010) [2023-12-28 06:27:11,234][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001560984_399663104.pth... [2023-12-28 06:27:11,237][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001559800_399360000.pth [2023-12-28 06:27:11,421][106226] Updated weights for policy 0, policy_version 1557372 (0.0008) [2023-12-28 06:27:11,487][106226] Updated weights for policy 0, policy_version 1557382 (0.0008) [2023-12-28 06:27:11,554][106226] Updated weights for policy 0, policy_version 1557392 (0.0008) [2023-12-28 06:27:11,962][106225] Updated weights for policy 1, policy_version 1560991 (0.0007) [2023-12-28 06:27:12,027][106225] Updated weights for policy 1, policy_version 1561001 (0.0011) [2023-12-28 06:27:12,096][106225] Updated weights for policy 1, policy_version 1561011 (0.0010) [2023-12-28 06:27:12,334][106226] Updated weights for policy 0, policy_version 1557402 (0.0006) [2023-12-28 06:27:12,405][106226] Updated weights for policy 0, policy_version 1557412 (0.0008) [2023-12-28 06:27:12,460][106226] Updated weights for policy 0, policy_version 1557422 (0.0010) [2023-12-28 06:27:12,509][106226] Updated weights for policy 0, policy_version 1557432 (0.0008) [2023-12-28 06:27:12,754][106225] Updated weights for policy 1, policy_version 1561021 (0.0011) [2023-12-28 06:27:12,825][106225] Updated weights for policy 1, policy_version 1561031 (0.0011) [2023-12-28 06:27:12,882][106225] Updated weights for policy 1, policy_version 1561041 (0.0010) [2023-12-28 06:27:13,218][106226] Updated weights for policy 0, policy_version 1557442 (0.0010) [2023-12-28 06:27:13,283][106226] Updated weights for policy 0, policy_version 1557452 (0.0009) [2023-12-28 06:27:13,350][106226] Updated weights for policy 0, policy_version 1557462 (0.0006) [2023-12-28 06:27:13,556][106225] Updated weights for policy 1, policy_version 1561051 (0.0006) [2023-12-28 06:27:13,604][106225] Updated weights for policy 1, policy_version 1561061 (0.0006) [2023-12-28 06:27:13,651][106225] Updated weights for policy 1, policy_version 1561071 (0.0010) [2023-12-28 06:27:13,905][106226] Updated weights for policy 0, policy_version 1557472 (0.0005) [2023-12-28 06:27:13,961][106226] Updated weights for policy 0, policy_version 1557482 (0.0005) [2023-12-28 06:27:14,007][106226] Updated weights for policy 0, policy_version 1557492 (0.0005) [2023-12-28 06:27:14,396][106225] Updated weights for policy 1, policy_version 1561081 (0.0011) [2023-12-28 06:27:14,442][106225] Updated weights for policy 1, policy_version 1561091 (0.0007) [2023-12-28 06:27:14,506][106225] Updated weights for policy 1, policy_version 1561101 (0.0007) [2023-12-28 06:27:14,561][106225] Updated weights for policy 1, policy_version 1561111 (0.0010) [2023-12-28 06:27:14,604][106226] Updated weights for policy 0, policy_version 1557502 (0.0007) [2023-12-28 06:27:14,666][106226] Updated weights for policy 0, policy_version 1557512 (0.0008) [2023-12-28 06:27:14,722][106226] Updated weights for policy 0, policy_version 1557522 (0.0008) [2023-12-28 06:27:15,271][106225] Updated weights for policy 1, policy_version 1561121 (0.0010) [2023-12-28 06:27:15,326][106225] Updated weights for policy 1, policy_version 1561131 (0.0011) [2023-12-28 06:27:15,381][106225] Updated weights for policy 1, policy_version 1561141 (0.0010) [2023-12-28 06:27:15,494][106226] Updated weights for policy 0, policy_version 1557532 (0.0007) [2023-12-28 06:27:15,548][106226] Updated weights for policy 0, policy_version 1557542 (0.0008) [2023-12-28 06:27:15,599][106226] Updated weights for policy 0, policy_version 1557552 (0.0007) [2023-12-28 06:27:16,117][106225] Updated weights for policy 1, policy_version 1561151 (0.0010) [2023-12-28 06:27:16,152][106226] Updated weights for policy 0, policy_version 1557562 (0.0006) [2023-12-28 06:27:16,170][106225] Updated weights for policy 1, policy_version 1561161 (0.0010) [2023-12-28 06:27:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 798515200. Throughput: 0: 10225.9, 1: 10034.3. Samples: 798511172. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:16,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.573')] [2023-12-28 06:27:16,206][106226] Updated weights for policy 0, policy_version 1557572 (0.0005) [2023-12-28 06:27:16,228][106225] Updated weights for policy 1, policy_version 1561171 (0.0010) [2023-12-28 06:27:16,265][106226] Updated weights for policy 0, policy_version 1557582 (0.0006) [2023-12-28 06:27:16,323][106226] Updated weights for policy 0, policy_version 1557592 (0.0005) [2023-12-28 06:27:16,869][106226] Updated weights for policy 0, policy_version 1557602 (0.0007) [2023-12-28 06:27:16,937][106226] Updated weights for policy 0, policy_version 1557612 (0.0009) [2023-12-28 06:27:16,984][106225] Updated weights for policy 1, policy_version 1561181 (0.0010) [2023-12-28 06:27:16,996][106226] Updated weights for policy 0, policy_version 1557622 (0.0010) [2023-12-28 06:27:17,047][106225] Updated weights for policy 1, policy_version 1561191 (0.0010) [2023-12-28 06:27:17,107][106225] Updated weights for policy 1, policy_version 1561201 (0.0010) [2023-12-28 06:27:17,654][106226] Updated weights for policy 0, policy_version 1557632 (0.0009) [2023-12-28 06:27:17,700][106226] Updated weights for policy 0, policy_version 1557642 (0.0008) [2023-12-28 06:27:17,751][106226] Updated weights for policy 0, policy_version 1557652 (0.0009) [2023-12-28 06:27:17,794][106225] Updated weights for policy 1, policy_version 1561211 (0.0009) [2023-12-28 06:27:17,845][106225] Updated weights for policy 1, policy_version 1561221 (0.0005) [2023-12-28 06:27:17,890][106225] Updated weights for policy 1, policy_version 1561231 (0.0005) [2023-12-28 06:27:18,526][106225] Updated weights for policy 1, policy_version 1561241 (0.0005) [2023-12-28 06:27:18,535][106226] Updated weights for policy 0, policy_version 1557662 (0.0010) [2023-12-28 06:27:18,588][106225] Updated weights for policy 1, policy_version 1561251 (0.0006) [2023-12-28 06:27:18,596][106226] Updated weights for policy 0, policy_version 1557672 (0.0008) [2023-12-28 06:27:18,640][106225] Updated weights for policy 1, policy_version 1561261 (0.0005) [2023-12-28 06:27:18,654][106226] Updated weights for policy 0, policy_version 1557682 (0.0009) [2023-12-28 06:27:18,696][106225] Updated weights for policy 1, policy_version 1561271 (0.0006) [2023-12-28 06:27:19,339][106225] Updated weights for policy 1, policy_version 1561281 (0.0008) [2023-12-28 06:27:19,407][106225] Updated weights for policy 1, policy_version 1561291 (0.0009) [2023-12-28 06:27:19,411][106226] Updated weights for policy 0, policy_version 1557692 (0.0008) [2023-12-28 06:27:19,469][106225] Updated weights for policy 1, policy_version 1561301 (0.0011) [2023-12-28 06:27:19,471][106226] Updated weights for policy 0, policy_version 1557702 (0.0008) [2023-12-28 06:27:19,537][106226] Updated weights for policy 0, policy_version 1557712 (0.0008) [2023-12-28 06:27:20,256][106225] Updated weights for policy 1, policy_version 1561311 (0.0010) [2023-12-28 06:27:20,258][106226] Updated weights for policy 0, policy_version 1557722 (0.0009) [2023-12-28 06:27:20,315][106225] Updated weights for policy 1, policy_version 1561321 (0.0010) [2023-12-28 06:27:20,317][106226] Updated weights for policy 0, policy_version 1557732 (0.0006) [2023-12-28 06:27:20,374][106225] Updated weights for policy 1, policy_version 1561331 (0.0008) [2023-12-28 06:27:20,375][106226] Updated weights for policy 0, policy_version 1557742 (0.0008) [2023-12-28 06:27:20,431][106226] Updated weights for policy 0, policy_version 1557752 (0.0007) [2023-12-28 06:27:21,006][106225] Updated weights for policy 1, policy_version 1561341 (0.0007) [2023-12-28 06:27:21,073][106225] Updated weights for policy 1, policy_version 1561351 (0.0009) [2023-12-28 06:27:21,137][106225] Updated weights for policy 1, policy_version 1561361 (0.0009) [2023-12-28 06:27:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 798613504. Throughput: 0: 10137.1, 1: 10042.3. Samples: 798631080. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:21,175][105115] Avg episode reward: [(0, '-4.813'), (1, '-4.689')] [2023-12-28 06:27:21,184][106226] Updated weights for policy 0, policy_version 1557762 (0.0007) [2023-12-28 06:27:21,253][106226] Updated weights for policy 0, policy_version 1557772 (0.0008) [2023-12-28 06:27:21,320][106226] Updated weights for policy 0, policy_version 1557782 (0.0008) [2023-12-28 06:27:21,911][106225] Updated weights for policy 1, policy_version 1561371 (0.0010) [2023-12-28 06:27:21,982][106225] Updated weights for policy 1, policy_version 1561381 (0.0011) [2023-12-28 06:27:22,047][106225] Updated weights for policy 1, policy_version 1561391 (0.0010) [2023-12-28 06:27:22,049][106226] Updated weights for policy 0, policy_version 1557792 (0.0006) [2023-12-28 06:27:22,108][106226] Updated weights for policy 0, policy_version 1557802 (0.0007) [2023-12-28 06:27:22,170][106226] Updated weights for policy 0, policy_version 1557812 (0.0007) [2023-12-28 06:27:22,761][106225] Updated weights for policy 1, policy_version 1561401 (0.0011) [2023-12-28 06:27:22,822][106225] Updated weights for policy 1, policy_version 1561411 (0.0011) [2023-12-28 06:27:22,883][106225] Updated weights for policy 1, policy_version 1561421 (0.0010) [2023-12-28 06:27:22,927][106226] Updated weights for policy 0, policy_version 1557822 (0.0009) [2023-12-28 06:27:22,940][106225] Updated weights for policy 1, policy_version 1561431 (0.0010) [2023-12-28 06:27:22,986][106226] Updated weights for policy 0, policy_version 1557832 (0.0011) [2023-12-28 06:27:23,046][106226] Updated weights for policy 0, policy_version 1557842 (0.0011) [2023-12-28 06:27:23,659][106225] Updated weights for policy 1, policy_version 1561441 (0.0010) [2023-12-28 06:27:23,711][106225] Updated weights for policy 1, policy_version 1561451 (0.0005) [2023-12-28 06:27:23,751][106226] Updated weights for policy 0, policy_version 1557852 (0.0009) [2023-12-28 06:27:23,757][106225] Updated weights for policy 1, policy_version 1561461 (0.0005) [2023-12-28 06:27:23,809][106226] Updated weights for policy 0, policy_version 1557862 (0.0011) [2023-12-28 06:27:23,863][106226] Updated weights for policy 0, policy_version 1557872 (0.0010) [2023-12-28 06:27:24,329][106225] Updated weights for policy 1, policy_version 1561471 (0.0009) [2023-12-28 06:27:24,390][106225] Updated weights for policy 1, policy_version 1561481 (0.0010) [2023-12-28 06:27:24,458][106225] Updated weights for policy 1, policy_version 1561491 (0.0007) [2023-12-28 06:27:24,590][106226] Updated weights for policy 0, policy_version 1557882 (0.0010) [2023-12-28 06:27:24,646][106226] Updated weights for policy 0, policy_version 1557892 (0.0010) [2023-12-28 06:27:24,706][106226] Updated weights for policy 0, policy_version 1557902 (0.0010) [2023-12-28 06:27:24,763][106226] Updated weights for policy 0, policy_version 1557912 (0.0011) [2023-12-28 06:27:24,998][106225] Updated weights for policy 1, policy_version 1561501 (0.0005) [2023-12-28 06:27:25,056][106225] Updated weights for policy 1, policy_version 1561511 (0.0006) [2023-12-28 06:27:25,112][106225] Updated weights for policy 1, policy_version 1561521 (0.0005) [2023-12-28 06:27:25,477][106226] Updated weights for policy 0, policy_version 1557922 (0.0009) [2023-12-28 06:27:25,526][106226] Updated weights for policy 0, policy_version 1557932 (0.0005) [2023-12-28 06:27:25,572][106226] Updated weights for policy 0, policy_version 1557942 (0.0008) [2023-12-28 06:27:25,768][106225] Updated weights for policy 1, policy_version 1561531 (0.0007) [2023-12-28 06:27:25,827][106225] Updated weights for policy 1, policy_version 1561541 (0.0010) [2023-12-28 06:27:25,883][106225] Updated weights for policy 1, policy_version 1561551 (0.0010) [2023-12-28 06:27:26,115][106226] Updated weights for policy 0, policy_version 1557952 (0.0009) [2023-12-28 06:27:26,168][106226] Updated weights for policy 0, policy_version 1557962 (0.0010) [2023-12-28 06:27:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19883.0). Total num frames: 798720000. Throughput: 0: 10040.6, 1: 10022.8. Samples: 798687736. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:26,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.472')] [2023-12-28 06:27:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001561560_399810560.pth... [2023-12-28 06:27:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001560376_399507456.pth [2023-12-28 06:27:26,218][106226] Updated weights for policy 0, policy_version 1557972 (0.0008) [2023-12-28 06:27:26,241][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001557976_398917632.pth... [2023-12-28 06:27:26,246][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001556792_398614528.pth [2023-12-28 06:27:26,601][106225] Updated weights for policy 1, policy_version 1561561 (0.0010) [2023-12-28 06:27:26,648][106225] Updated weights for policy 1, policy_version 1561571 (0.0010) [2023-12-28 06:27:26,709][106225] Updated weights for policy 1, policy_version 1561581 (0.0010) [2023-12-28 06:27:26,761][106225] Updated weights for policy 1, policy_version 1561591 (0.0010) [2023-12-28 06:27:26,795][106226] Updated weights for policy 0, policy_version 1557982 (0.0006) [2023-12-28 06:27:26,840][106226] Updated weights for policy 0, policy_version 1557992 (0.0005) [2023-12-28 06:27:26,894][106226] Updated weights for policy 0, policy_version 1558002 (0.0008) [2023-12-28 06:27:27,477][106225] Updated weights for policy 1, policy_version 1561601 (0.0010) [2023-12-28 06:27:27,535][106225] Updated weights for policy 1, policy_version 1561611 (0.0010) [2023-12-28 06:27:27,560][106226] Updated weights for policy 0, policy_version 1558012 (0.0010) [2023-12-28 06:27:27,587][106225] Updated weights for policy 1, policy_version 1561621 (0.0010) [2023-12-28 06:27:27,610][106226] Updated weights for policy 0, policy_version 1558022 (0.0010) [2023-12-28 06:27:27,663][106226] Updated weights for policy 0, policy_version 1558032 (0.0010) [2023-12-28 06:27:28,291][106225] Updated weights for policy 1, policy_version 1561631 (0.0010) [2023-12-28 06:27:28,345][106225] Updated weights for policy 1, policy_version 1561641 (0.0010) [2023-12-28 06:27:28,400][106226] Updated weights for policy 0, policy_version 1558042 (0.0009) [2023-12-28 06:27:28,409][106225] Updated weights for policy 1, policy_version 1561651 (0.0010) [2023-12-28 06:27:28,455][106226] Updated weights for policy 0, policy_version 1558052 (0.0006) [2023-12-28 06:27:28,511][106226] Updated weights for policy 0, policy_version 1558062 (0.0008) [2023-12-28 06:27:28,569][106226] Updated weights for policy 0, policy_version 1558072 (0.0008) [2023-12-28 06:27:29,134][106225] Updated weights for policy 1, policy_version 1561661 (0.0010) [2023-12-28 06:27:29,196][106225] Updated weights for policy 1, policy_version 1561671 (0.0010) [2023-12-28 06:27:29,256][106226] Updated weights for policy 0, policy_version 1558082 (0.0007) [2023-12-28 06:27:29,259][106225] Updated weights for policy 1, policy_version 1561681 (0.0009) [2023-12-28 06:27:29,310][106226] Updated weights for policy 0, policy_version 1558092 (0.0009) [2023-12-28 06:27:29,375][106226] Updated weights for policy 0, policy_version 1558102 (0.0008) [2023-12-28 06:27:29,954][106225] Updated weights for policy 1, policy_version 1561691 (0.0009) [2023-12-28 06:27:30,023][106225] Updated weights for policy 1, policy_version 1561701 (0.0008) [2023-12-28 06:27:30,042][106226] Updated weights for policy 0, policy_version 1558112 (0.0008) [2023-12-28 06:27:30,087][106225] Updated weights for policy 1, policy_version 1561711 (0.0009) [2023-12-28 06:27:30,101][106226] Updated weights for policy 0, policy_version 1558122 (0.0007) [2023-12-28 06:27:30,161][106226] Updated weights for policy 0, policy_version 1558132 (0.0008) [2023-12-28 06:27:30,734][106225] Updated weights for policy 1, policy_version 1561721 (0.0008) [2023-12-28 06:27:30,787][106225] Updated weights for policy 1, policy_version 1561731 (0.0006) [2023-12-28 06:27:30,845][106225] Updated weights for policy 1, policy_version 1561741 (0.0005) [2023-12-28 06:27:30,893][106225] Updated weights for policy 1, policy_version 1561751 (0.0005) [2023-12-28 06:27:30,923][106226] Updated weights for policy 0, policy_version 1558142 (0.0007) [2023-12-28 06:27:30,974][106226] Updated weights for policy 0, policy_version 1558152 (0.0005) [2023-12-28 06:27:31,030][106226] Updated weights for policy 0, policy_version 1558162 (0.0006) [2023-12-28 06:27:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20343.5, 300 sec: 19910.7). Total num frames: 798826496. Throughput: 0: 10148.3, 1: 10122.2. Samples: 798812512. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:31,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-4.519')] [2023-12-28 06:27:31,653][106225] Updated weights for policy 1, policy_version 1561761 (0.0007) [2023-12-28 06:27:31,721][106225] Updated weights for policy 1, policy_version 1561771 (0.0008) [2023-12-28 06:27:31,736][106226] Updated weights for policy 0, policy_version 1558172 (0.0008) [2023-12-28 06:27:31,788][106225] Updated weights for policy 1, policy_version 1561781 (0.0006) [2023-12-28 06:27:31,799][106226] Updated weights for policy 0, policy_version 1558182 (0.0008) [2023-12-28 06:27:31,861][106226] Updated weights for policy 0, policy_version 1558192 (0.0008) [2023-12-28 06:27:32,485][106225] Updated weights for policy 1, policy_version 1561791 (0.0009) [2023-12-28 06:27:32,517][106226] Updated weights for policy 0, policy_version 1558202 (0.0009) [2023-12-28 06:27:32,547][106225] Updated weights for policy 1, policy_version 1561801 (0.0006) [2023-12-28 06:27:32,580][106226] Updated weights for policy 0, policy_version 1558212 (0.0007) [2023-12-28 06:27:32,605][106225] Updated weights for policy 1, policy_version 1561811 (0.0007) [2023-12-28 06:27:32,639][106226] Updated weights for policy 0, policy_version 1558222 (0.0006) [2023-12-28 06:27:32,694][106226] Updated weights for policy 0, policy_version 1558232 (0.0009) [2023-12-28 06:27:33,323][106225] Updated weights for policy 1, policy_version 1561821 (0.0007) [2023-12-28 06:27:33,365][106226] Updated weights for policy 0, policy_version 1558242 (0.0006) [2023-12-28 06:27:33,374][106225] Updated weights for policy 1, policy_version 1561831 (0.0007) [2023-12-28 06:27:33,412][106226] Updated weights for policy 0, policy_version 1558252 (0.0006) [2023-12-28 06:27:33,430][106225] Updated weights for policy 1, policy_version 1561841 (0.0007) [2023-12-28 06:27:33,460][106226] Updated weights for policy 0, policy_version 1558262 (0.0006) [2023-12-28 06:27:34,126][106225] Updated weights for policy 1, policy_version 1561851 (0.0006) [2023-12-28 06:27:34,194][106226] Updated weights for policy 0, policy_version 1558272 (0.0007) [2023-12-28 06:27:34,203][106225] Updated weights for policy 1, policy_version 1561861 (0.0008) [2023-12-28 06:27:34,261][106226] Updated weights for policy 0, policy_version 1558282 (0.0008) [2023-12-28 06:27:34,263][106225] Updated weights for policy 1, policy_version 1561871 (0.0007) [2023-12-28 06:27:34,324][106226] Updated weights for policy 0, policy_version 1558292 (0.0007) [2023-12-28 06:27:34,985][106226] Updated weights for policy 0, policy_version 1558302 (0.0009) [2023-12-28 06:27:35,025][106225] Updated weights for policy 1, policy_version 1561881 (0.0007) [2023-12-28 06:27:35,050][106226] Updated weights for policy 0, policy_version 1558312 (0.0011) [2023-12-28 06:27:35,087][106225] Updated weights for policy 1, policy_version 1561891 (0.0005) [2023-12-28 06:27:35,111][106226] Updated weights for policy 0, policy_version 1558322 (0.0011) [2023-12-28 06:27:35,134][106225] Updated weights for policy 1, policy_version 1561901 (0.0007) [2023-12-28 06:27:35,179][106225] Updated weights for policy 1, policy_version 1561911 (0.0007) [2023-12-28 06:27:35,700][106226] Updated weights for policy 0, policy_version 1558332 (0.0008) [2023-12-28 06:27:35,765][106226] Updated weights for policy 0, policy_version 1558342 (0.0010) [2023-12-28 06:27:35,823][106226] Updated weights for policy 0, policy_version 1558352 (0.0011) [2023-12-28 06:27:35,955][106225] Updated weights for policy 1, policy_version 1561921 (0.0008) [2023-12-28 06:27:36,012][106225] Updated weights for policy 1, policy_version 1561931 (0.0008) [2023-12-28 06:27:36,071][106225] Updated weights for policy 1, policy_version 1561941 (0.0009) [2023-12-28 06:27:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 798924800. Throughput: 0: 10105.4, 1: 10062.6. Samples: 798931208. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:36,175][105115] Avg episode reward: [(0, '-4.686'), (1, '-4.815')] [2023-12-28 06:27:36,459][106226] Updated weights for policy 0, policy_version 1558362 (0.0007) [2023-12-28 06:27:36,517][106226] Updated weights for policy 0, policy_version 1558372 (0.0008) [2023-12-28 06:27:36,579][106226] Updated weights for policy 0, policy_version 1558382 (0.0008) [2023-12-28 06:27:36,641][106226] Updated weights for policy 0, policy_version 1558392 (0.0008) [2023-12-28 06:27:36,809][106225] Updated weights for policy 1, policy_version 1561951 (0.0010) [2023-12-28 06:27:36,867][106225] Updated weights for policy 1, policy_version 1561961 (0.0010) [2023-12-28 06:27:36,918][106225] Updated weights for policy 1, policy_version 1561971 (0.0010) [2023-12-28 06:27:37,397][106226] Updated weights for policy 0, policy_version 1558402 (0.0011) [2023-12-28 06:27:37,456][106226] Updated weights for policy 0, policy_version 1558412 (0.0011) [2023-12-28 06:27:37,514][106226] Updated weights for policy 0, policy_version 1558422 (0.0011) [2023-12-28 06:27:37,561][106225] Updated weights for policy 1, policy_version 1561981 (0.0009) [2023-12-28 06:27:37,625][106225] Updated weights for policy 1, policy_version 1561991 (0.0005) [2023-12-28 06:27:37,685][106225] Updated weights for policy 1, policy_version 1562001 (0.0006) [2023-12-28 06:27:38,160][106226] Updated weights for policy 0, policy_version 1558432 (0.0006) [2023-12-28 06:27:38,209][106226] Updated weights for policy 0, policy_version 1558442 (0.0005) [2023-12-28 06:27:38,257][106226] Updated weights for policy 0, policy_version 1558452 (0.0005) [2023-12-28 06:27:38,353][106225] Updated weights for policy 1, policy_version 1562011 (0.0010) [2023-12-28 06:27:38,419][106225] Updated weights for policy 1, policy_version 1562021 (0.0011) [2023-12-28 06:27:38,486][106225] Updated weights for policy 1, policy_version 1562031 (0.0006) [2023-12-28 06:27:38,945][106226] Updated weights for policy 0, policy_version 1558462 (0.0009) [2023-12-28 06:27:39,005][106226] Updated weights for policy 0, policy_version 1558472 (0.0010) [2023-12-28 06:27:39,059][106226] Updated weights for policy 0, policy_version 1558482 (0.0006) [2023-12-28 06:27:39,159][106225] Updated weights for policy 1, policy_version 1562041 (0.0006) [2023-12-28 06:27:39,222][106225] Updated weights for policy 1, policy_version 1562051 (0.0011) [2023-12-28 06:27:39,290][106225] Updated weights for policy 1, policy_version 1562061 (0.0011) [2023-12-28 06:27:39,346][106225] Updated weights for policy 1, policy_version 1562071 (0.0011) [2023-12-28 06:27:39,763][106226] Updated weights for policy 0, policy_version 1558492 (0.0010) [2023-12-28 06:27:39,826][106226] Updated weights for policy 0, policy_version 1558502 (0.0010) [2023-12-28 06:27:39,896][106226] Updated weights for policy 0, policy_version 1558512 (0.0008) [2023-12-28 06:27:40,119][106225] Updated weights for policy 1, policy_version 1562081 (0.0010) [2023-12-28 06:27:40,179][106225] Updated weights for policy 1, policy_version 1562091 (0.0009) [2023-12-28 06:27:40,241][106225] Updated weights for policy 1, policy_version 1562101 (0.0010) [2023-12-28 06:27:40,532][106226] Updated weights for policy 0, policy_version 1558522 (0.0008) [2023-12-28 06:27:40,598][106226] Updated weights for policy 0, policy_version 1558532 (0.0009) [2023-12-28 06:27:40,658][106226] Updated weights for policy 0, policy_version 1558542 (0.0008) [2023-12-28 06:27:40,719][106226] Updated weights for policy 0, policy_version 1558552 (0.0008) [2023-12-28 06:27:41,006][106225] Updated weights for policy 1, policy_version 1562111 (0.0009) [2023-12-28 06:27:41,075][106225] Updated weights for policy 1, policy_version 1562121 (0.0010) [2023-12-28 06:27:41,146][106225] Updated weights for policy 1, policy_version 1562131 (0.0009) [2023-12-28 06:27:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 799014912. Throughput: 0: 10117.7, 1: 10062.6. Samples: 798991744. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:41,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.696')] [2023-12-28 06:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001558552_399065088.pth... [2023-12-28 06:27:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001562136_399958016.pth... [2023-12-28 06:27:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001557368_398761984.pth [2023-12-28 06:27:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001560984_399663104.pth [2023-12-28 06:27:41,505][106226] Updated weights for policy 0, policy_version 1558562 (0.0009) [2023-12-28 06:27:41,558][106226] Updated weights for policy 0, policy_version 1558572 (0.0009) [2023-12-28 06:27:41,625][106226] Updated weights for policy 0, policy_version 1558582 (0.0008) [2023-12-28 06:27:41,966][106225] Updated weights for policy 1, policy_version 1562141 (0.0009) [2023-12-28 06:27:42,041][106225] Updated weights for policy 1, policy_version 1562151 (0.0009) [2023-12-28 06:27:42,113][106225] Updated weights for policy 1, policy_version 1562161 (0.0009) [2023-12-28 06:27:42,395][106226] Updated weights for policy 0, policy_version 1558592 (0.0008) [2023-12-28 06:27:42,447][106226] Updated weights for policy 0, policy_version 1558602 (0.0008) [2023-12-28 06:27:42,506][106226] Updated weights for policy 0, policy_version 1558612 (0.0008) [2023-12-28 06:27:42,778][106225] Updated weights for policy 1, policy_version 1562171 (0.0008) [2023-12-28 06:27:42,841][106225] Updated weights for policy 1, policy_version 1562181 (0.0009) [2023-12-28 06:27:42,891][106225] Updated weights for policy 1, policy_version 1562191 (0.0008) [2023-12-28 06:27:43,170][106226] Updated weights for policy 0, policy_version 1558622 (0.0006) [2023-12-28 06:27:43,232][106226] Updated weights for policy 0, policy_version 1558632 (0.0005) [2023-12-28 06:27:43,289][106226] Updated weights for policy 0, policy_version 1558642 (0.0005) [2023-12-28 06:27:43,732][106225] Updated weights for policy 1, policy_version 1562201 (0.0008) [2023-12-28 06:27:43,787][106225] Updated weights for policy 1, policy_version 1562211 (0.0008) [2023-12-28 06:27:43,813][106226] Updated weights for policy 0, policy_version 1558652 (0.0006) [2023-12-28 06:27:43,847][106225] Updated weights for policy 1, policy_version 1562221 (0.0008) [2023-12-28 06:27:43,873][106226] Updated weights for policy 0, policy_version 1558662 (0.0006) [2023-12-28 06:27:43,906][106225] Updated weights for policy 1, policy_version 1562231 (0.0005) [2023-12-28 06:27:43,930][106226] Updated weights for policy 0, policy_version 1558672 (0.0008) [2023-12-28 06:27:44,649][106225] Updated weights for policy 1, policy_version 1562241 (0.0007) [2023-12-28 06:27:44,692][106226] Updated weights for policy 0, policy_version 1558682 (0.0007) [2023-12-28 06:27:44,708][106225] Updated weights for policy 1, policy_version 1562251 (0.0010) [2023-12-28 06:27:44,744][106226] Updated weights for policy 0, policy_version 1558692 (0.0006) [2023-12-28 06:27:44,774][106225] Updated weights for policy 1, policy_version 1562261 (0.0010) [2023-12-28 06:27:44,821][106226] Updated weights for policy 0, policy_version 1558702 (0.0009) [2023-12-28 06:27:44,888][106226] Updated weights for policy 0, policy_version 1558712 (0.0009) [2023-12-28 06:27:45,533][106225] Updated weights for policy 1, policy_version 1562271 (0.0009) [2023-12-28 06:27:45,593][106225] Updated weights for policy 1, policy_version 1562281 (0.0009) [2023-12-28 06:27:45,651][106225] Updated weights for policy 1, policy_version 1562291 (0.0007) [2023-12-28 06:27:45,706][106226] Updated weights for policy 0, policy_version 1558722 (0.0008) [2023-12-28 06:27:45,767][106226] Updated weights for policy 0, policy_version 1558732 (0.0008) [2023-12-28 06:27:45,831][106226] Updated weights for policy 0, policy_version 1558742 (0.0007) [2023-12-28 06:27:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 799113216. Throughput: 0: 10062.7, 1: 9906.1. Samples: 799104744. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:46,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.417')] [2023-12-28 06:27:46,438][106225] Updated weights for policy 1, policy_version 1562301 (0.0008) [2023-12-28 06:27:46,463][106226] Updated weights for policy 0, policy_version 1558752 (0.0007) [2023-12-28 06:27:46,502][106225] Updated weights for policy 1, policy_version 1562311 (0.0008) [2023-12-28 06:27:46,529][106226] Updated weights for policy 0, policy_version 1558762 (0.0007) [2023-12-28 06:27:46,566][106225] Updated weights for policy 1, policy_version 1562321 (0.0008) [2023-12-28 06:27:46,598][106226] Updated weights for policy 0, policy_version 1558772 (0.0005) [2023-12-28 06:27:47,193][106225] Updated weights for policy 1, policy_version 1562331 (0.0007) [2023-12-28 06:27:47,230][106226] Updated weights for policy 0, policy_version 1558782 (0.0007) [2023-12-28 06:27:47,253][106225] Updated weights for policy 1, policy_version 1562341 (0.0005) [2023-12-28 06:27:47,283][106226] Updated weights for policy 0, policy_version 1558792 (0.0008) [2023-12-28 06:27:47,313][106225] Updated weights for policy 1, policy_version 1562351 (0.0007) [2023-12-28 06:27:47,347][106226] Updated weights for policy 0, policy_version 1558802 (0.0009) [2023-12-28 06:27:47,990][106225] Updated weights for policy 1, policy_version 1562361 (0.0010) [2023-12-28 06:27:48,049][106225] Updated weights for policy 1, policy_version 1562371 (0.0010) [2023-12-28 06:27:48,070][106226] Updated weights for policy 0, policy_version 1558812 (0.0008) [2023-12-28 06:27:48,106][106225] Updated weights for policy 1, policy_version 1562381 (0.0010) [2023-12-28 06:27:48,113][106226] Updated weights for policy 0, policy_version 1558822 (0.0010) [2023-12-28 06:27:48,160][106226] Updated weights for policy 0, policy_version 1558832 (0.0010) [2023-12-28 06:27:48,167][106225] Updated weights for policy 1, policy_version 1562391 (0.0010) [2023-12-28 06:27:48,859][106225] Updated weights for policy 1, policy_version 1562401 (0.0011) [2023-12-28 06:27:48,923][106225] Updated weights for policy 1, policy_version 1562411 (0.0010) [2023-12-28 06:27:48,979][106226] Updated weights for policy 0, policy_version 1558842 (0.0010) [2023-12-28 06:27:48,991][106225] Updated weights for policy 1, policy_version 1562421 (0.0011) [2023-12-28 06:27:49,037][106226] Updated weights for policy 0, policy_version 1558852 (0.0009) [2023-12-28 06:27:49,098][106226] Updated weights for policy 0, policy_version 1558862 (0.0008) [2023-12-28 06:27:49,152][106226] Updated weights for policy 0, policy_version 1558872 (0.0008) [2023-12-28 06:27:49,687][106225] Updated weights for policy 1, policy_version 1562431 (0.0010) [2023-12-28 06:27:49,747][106225] Updated weights for policy 1, policy_version 1562441 (0.0010) [2023-12-28 06:27:49,811][106225] Updated weights for policy 1, policy_version 1562451 (0.0008) [2023-12-28 06:27:49,922][106226] Updated weights for policy 0, policy_version 1558882 (0.0008) [2023-12-28 06:27:49,987][106226] Updated weights for policy 0, policy_version 1558892 (0.0008) [2023-12-28 06:27:50,047][106226] Updated weights for policy 0, policy_version 1558902 (0.0007) [2023-12-28 06:27:50,613][106225] Updated weights for policy 1, policy_version 1562461 (0.0009) [2023-12-28 06:27:50,670][106225] Updated weights for policy 1, policy_version 1562471 (0.0007) [2023-12-28 06:27:50,731][106225] Updated weights for policy 1, policy_version 1562481 (0.0008) [2023-12-28 06:27:50,741][106226] Updated weights for policy 0, policy_version 1558912 (0.0009) [2023-12-28 06:27:50,807][106226] Updated weights for policy 0, policy_version 1558922 (0.0009) [2023-12-28 06:27:50,868][106226] Updated weights for policy 0, policy_version 1558932 (0.0008) [2023-12-28 06:27:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 799211520. Throughput: 0: 9998.7, 1: 9823.0. Samples: 799220052. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:51,175][105115] Avg episode reward: [(0, '-4.829'), (1, '-4.669')] [2023-12-28 06:27:51,456][106225] Updated weights for policy 1, policy_version 1562491 (0.0007) [2023-12-28 06:27:51,513][106225] Updated weights for policy 1, policy_version 1562501 (0.0008) [2023-12-28 06:27:51,579][106225] Updated weights for policy 1, policy_version 1562511 (0.0006) [2023-12-28 06:27:51,644][106226] Updated weights for policy 0, policy_version 1558942 (0.0009) [2023-12-28 06:27:51,703][106226] Updated weights for policy 0, policy_version 1558952 (0.0007) [2023-12-28 06:27:51,776][106226] Updated weights for policy 0, policy_version 1558962 (0.0010) [2023-12-28 06:27:52,266][106225] Updated weights for policy 1, policy_version 1562521 (0.0009) [2023-12-28 06:27:52,326][106225] Updated weights for policy 1, policy_version 1562531 (0.0010) [2023-12-28 06:27:52,395][106225] Updated weights for policy 1, policy_version 1562541 (0.0010) [2023-12-28 06:27:52,457][106225] Updated weights for policy 1, policy_version 1562551 (0.0008) [2023-12-28 06:27:52,461][106226] Updated weights for policy 0, policy_version 1558972 (0.0009) [2023-12-28 06:27:52,525][106226] Updated weights for policy 0, policy_version 1558982 (0.0006) [2023-12-28 06:27:52,593][106226] Updated weights for policy 0, policy_version 1558992 (0.0006) [2023-12-28 06:27:53,040][106225] Updated weights for policy 1, policy_version 1562561 (0.0007) [2023-12-28 06:27:53,086][106225] Updated weights for policy 1, policy_version 1562571 (0.0010) [2023-12-28 06:27:53,145][106225] Updated weights for policy 1, policy_version 1562581 (0.0010) [2023-12-28 06:27:53,206][106226] Updated weights for policy 0, policy_version 1559002 (0.0006) [2023-12-28 06:27:53,262][106226] Updated weights for policy 0, policy_version 1559012 (0.0005) [2023-12-28 06:27:53,311][106226] Updated weights for policy 0, policy_version 1559022 (0.0007) [2023-12-28 06:27:53,364][106226] Updated weights for policy 0, policy_version 1559032 (0.0008) [2023-12-28 06:27:53,745][106225] Updated weights for policy 1, policy_version 1562591 (0.0008) [2023-12-28 06:27:53,799][106225] Updated weights for policy 1, policy_version 1562601 (0.0010) [2023-12-28 06:27:53,868][106225] Updated weights for policy 1, policy_version 1562611 (0.0010) [2023-12-28 06:27:54,112][106226] Updated weights for policy 0, policy_version 1559042 (0.0006) [2023-12-28 06:27:54,167][106226] Updated weights for policy 0, policy_version 1559052 (0.0009) [2023-12-28 06:27:54,218][106226] Updated weights for policy 0, policy_version 1559062 (0.0010) [2023-12-28 06:27:54,556][106225] Updated weights for policy 1, policy_version 1562621 (0.0010) [2023-12-28 06:27:54,613][106225] Updated weights for policy 1, policy_version 1562631 (0.0010) [2023-12-28 06:27:54,659][106225] Updated weights for policy 1, policy_version 1562641 (0.0010) [2023-12-28 06:27:54,917][106226] Updated weights for policy 0, policy_version 1559072 (0.0010) [2023-12-28 06:27:54,967][106226] Updated weights for policy 0, policy_version 1559082 (0.0010) [2023-12-28 06:27:55,028][106226] Updated weights for policy 0, policy_version 1559092 (0.0011) [2023-12-28 06:27:55,355][106225] Updated weights for policy 1, policy_version 1562651 (0.0009) [2023-12-28 06:27:55,401][106225] Updated weights for policy 1, policy_version 1562661 (0.0007) [2023-12-28 06:27:55,449][106225] Updated weights for policy 1, policy_version 1562671 (0.0008) [2023-12-28 06:27:55,781][106226] Updated weights for policy 0, policy_version 1559102 (0.0009) [2023-12-28 06:27:55,841][106226] Updated weights for policy 0, policy_version 1559112 (0.0008) [2023-12-28 06:27:55,895][106226] Updated weights for policy 0, policy_version 1559122 (0.0009) [2023-12-28 06:27:56,012][106225] Updated weights for policy 1, policy_version 1562681 (0.0006) [2023-12-28 06:27:56,075][106225] Updated weights for policy 1, policy_version 1562691 (0.0010) [2023-12-28 06:27:56,131][106225] Updated weights for policy 1, policy_version 1562701 (0.0009) [2023-12-28 06:27:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19882.9). Total num frames: 799309824. Throughput: 0: 9943.5, 1: 9816.4. Samples: 799281408. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:27:56,176][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.707')] [2023-12-28 06:27:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001559128_399212544.pth... [2023-12-28 06:27:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001557976_398917632.pth [2023-12-28 06:27:56,195][106225] Updated weights for policy 1, policy_version 1562711 (0.0009) [2023-12-28 06:27:56,200][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001562712_400105472.pth... [2023-12-28 06:27:56,204][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001561560_399810560.pth [2023-12-28 06:27:56,645][106226] Updated weights for policy 0, policy_version 1559132 (0.0007) [2023-12-28 06:27:56,716][106226] Updated weights for policy 0, policy_version 1559142 (0.0008) [2023-12-28 06:27:56,778][106226] Updated weights for policy 0, policy_version 1559152 (0.0006) [2023-12-28 06:27:56,799][106225] Updated weights for policy 1, policy_version 1562721 (0.0006) [2023-12-28 06:27:56,853][106225] Updated weights for policy 1, policy_version 1562731 (0.0005) [2023-12-28 06:27:56,904][106225] Updated weights for policy 1, policy_version 1562741 (0.0005) [2023-12-28 06:27:57,280][106226] Updated weights for policy 0, policy_version 1559162 (0.0005) [2023-12-28 06:27:57,333][106226] Updated weights for policy 0, policy_version 1559172 (0.0005) [2023-12-28 06:27:57,392][106226] Updated weights for policy 0, policy_version 1559182 (0.0006) [2023-12-28 06:27:57,441][106226] Updated weights for policy 0, policy_version 1559192 (0.0007) [2023-12-28 06:27:57,593][106225] Updated weights for policy 1, policy_version 1562751 (0.0009) [2023-12-28 06:27:57,636][106225] Updated weights for policy 1, policy_version 1562761 (0.0010) [2023-12-28 06:27:57,681][106225] Updated weights for policy 1, policy_version 1562771 (0.0010) [2023-12-28 06:27:58,101][106226] Updated weights for policy 0, policy_version 1559202 (0.0005) [2023-12-28 06:27:58,156][106226] Updated weights for policy 0, policy_version 1559212 (0.0005) [2023-12-28 06:27:58,212][106226] Updated weights for policy 0, policy_version 1559222 (0.0006) [2023-12-28 06:27:58,411][106225] Updated weights for policy 1, policy_version 1562781 (0.0010) [2023-12-28 06:27:58,478][106225] Updated weights for policy 1, policy_version 1562791 (0.0011) [2023-12-28 06:27:58,542][106225] Updated weights for policy 1, policy_version 1562801 (0.0010) [2023-12-28 06:27:58,956][106226] Updated weights for policy 0, policy_version 1559232 (0.0006) [2023-12-28 06:27:59,017][106226] Updated weights for policy 0, policy_version 1559242 (0.0008) [2023-12-28 06:27:59,071][106226] Updated weights for policy 0, policy_version 1559252 (0.0008) [2023-12-28 06:27:59,258][106225] Updated weights for policy 1, policy_version 1562811 (0.0010) [2023-12-28 06:27:59,320][106225] Updated weights for policy 1, policy_version 1562821 (0.0008) [2023-12-28 06:27:59,383][106225] Updated weights for policy 1, policy_version 1562831 (0.0008) [2023-12-28 06:27:59,761][106226] Updated weights for policy 0, policy_version 1559262 (0.0008) [2023-12-28 06:27:59,828][106226] Updated weights for policy 0, policy_version 1559272 (0.0008) [2023-12-28 06:27:59,890][106226] Updated weights for policy 0, policy_version 1559282 (0.0009) [2023-12-28 06:28:00,139][106225] Updated weights for policy 1, policy_version 1562841 (0.0008) [2023-12-28 06:28:00,196][106225] Updated weights for policy 1, policy_version 1562851 (0.0009) [2023-12-28 06:28:00,252][106225] Updated weights for policy 1, policy_version 1562861 (0.0009) [2023-12-28 06:28:00,306][106225] Updated weights for policy 1, policy_version 1562871 (0.0010) [2023-12-28 06:28:00,688][106226] Updated weights for policy 0, policy_version 1559292 (0.0008) [2023-12-28 06:28:00,747][106226] Updated weights for policy 0, policy_version 1559302 (0.0008) [2023-12-28 06:28:00,803][106226] Updated weights for policy 0, policy_version 1559312 (0.0008) [2023-12-28 06:28:00,942][106225] Updated weights for policy 1, policy_version 1562881 (0.0006) [2023-12-28 06:28:00,990][106225] Updated weights for policy 1, policy_version 1562891 (0.0005) [2023-12-28 06:28:01,064][106225] Updated weights for policy 1, policy_version 1562901 (0.0008) [2023-12-28 06:28:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 799416320. Throughput: 0: 9953.9, 1: 9846.8. Samples: 799402208. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:01,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.655')] [2023-12-28 06:28:01,583][106226] Updated weights for policy 0, policy_version 1559322 (0.0010) [2023-12-28 06:28:01,645][106226] Updated weights for policy 0, policy_version 1559332 (0.0009) [2023-12-28 06:28:01,704][106226] Updated weights for policy 0, policy_version 1559342 (0.0011) [2023-12-28 06:28:01,723][106225] Updated weights for policy 1, policy_version 1562911 (0.0007) [2023-12-28 06:28:01,781][106226] Updated weights for policy 0, policy_version 1559352 (0.0011) [2023-12-28 06:28:01,785][106225] Updated weights for policy 1, policy_version 1562921 (0.0010) [2023-12-28 06:28:01,845][106225] Updated weights for policy 1, policy_version 1562931 (0.0010) [2023-12-28 06:28:02,497][106226] Updated weights for policy 0, policy_version 1559362 (0.0011) [2023-12-28 06:28:02,507][106225] Updated weights for policy 1, policy_version 1562941 (0.0011) [2023-12-28 06:28:02,561][106226] Updated weights for policy 0, policy_version 1559372 (0.0010) [2023-12-28 06:28:02,562][106225] Updated weights for policy 1, policy_version 1562951 (0.0010) [2023-12-28 06:28:02,617][106225] Updated weights for policy 1, policy_version 1562961 (0.0011) [2023-12-28 06:28:02,625][106226] Updated weights for policy 0, policy_version 1559382 (0.0011) [2023-12-28 06:28:03,298][106225] Updated weights for policy 1, policy_version 1562971 (0.0010) [2023-12-28 06:28:03,327][106226] Updated weights for policy 0, policy_version 1559392 (0.0011) [2023-12-28 06:28:03,341][106225] Updated weights for policy 1, policy_version 1562981 (0.0006) [2023-12-28 06:28:03,383][106226] Updated weights for policy 0, policy_version 1559402 (0.0010) [2023-12-28 06:28:03,395][106225] Updated weights for policy 1, policy_version 1562991 (0.0009) [2023-12-28 06:28:03,445][106226] Updated weights for policy 0, policy_version 1559412 (0.0010) [2023-12-28 06:28:04,087][106225] Updated weights for policy 1, policy_version 1563001 (0.0007) [2023-12-28 06:28:04,095][106226] Updated weights for policy 0, policy_version 1559422 (0.0009) [2023-12-28 06:28:04,149][106225] Updated weights for policy 1, policy_version 1563011 (0.0011) [2023-12-28 06:28:04,159][106226] Updated weights for policy 0, policy_version 1559432 (0.0006) [2023-12-28 06:28:04,208][106225] Updated weights for policy 1, policy_version 1563021 (0.0007) [2023-12-28 06:28:04,222][106226] Updated weights for policy 0, policy_version 1559442 (0.0007) [2023-12-28 06:28:04,265][106225] Updated weights for policy 1, policy_version 1563031 (0.0006) [2023-12-28 06:28:04,971][106226] Updated weights for policy 0, policy_version 1559452 (0.0007) [2023-12-28 06:28:04,981][106225] Updated weights for policy 1, policy_version 1563041 (0.0008) [2023-12-28 06:28:05,041][106226] Updated weights for policy 0, policy_version 1559462 (0.0008) [2023-12-28 06:28:05,046][106225] Updated weights for policy 1, policy_version 1563051 (0.0008) [2023-12-28 06:28:05,100][106226] Updated weights for policy 0, policy_version 1559472 (0.0006) [2023-12-28 06:28:05,106][106225] Updated weights for policy 1, policy_version 1563061 (0.0007) [2023-12-28 06:28:05,759][106225] Updated weights for policy 1, policy_version 1563071 (0.0005) [2023-12-28 06:28:05,822][106225] Updated weights for policy 1, policy_version 1563081 (0.0005) [2023-12-28 06:28:05,878][106225] Updated weights for policy 1, policy_version 1563091 (0.0005) [2023-12-28 06:28:05,901][106226] Updated weights for policy 0, policy_version 1559482 (0.0007) [2023-12-28 06:28:05,954][106226] Updated weights for policy 0, policy_version 1559492 (0.0009) [2023-12-28 06:28:06,020][106226] Updated weights for policy 0, policy_version 1559502 (0.0008) [2023-12-28 06:28:06,079][106226] Updated weights for policy 0, policy_version 1559512 (0.0009) [2023-12-28 06:28:06,174][105115] Fps is (10 sec: 20480.8, 60 sec: 19933.9, 300 sec: 19911.0). Total num frames: 799514624. Throughput: 0: 9842.9, 1: 9900.5. Samples: 799519528. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:06,175][105115] Avg episode reward: [(0, '-5.004'), (1, '-4.486')] [2023-12-28 06:28:06,408][106225] Updated weights for policy 1, policy_version 1563101 (0.0007) [2023-12-28 06:28:06,464][106225] Updated weights for policy 1, policy_version 1563111 (0.0005) [2023-12-28 06:28:06,531][106225] Updated weights for policy 1, policy_version 1563121 (0.0006) [2023-12-28 06:28:06,898][106226] Updated weights for policy 0, policy_version 1559522 (0.0006) [2023-12-28 06:28:06,952][106226] Updated weights for policy 0, policy_version 1559532 (0.0008) [2023-12-28 06:28:07,005][106226] Updated weights for policy 0, policy_version 1559542 (0.0009) [2023-12-28 06:28:07,208][106225] Updated weights for policy 1, policy_version 1563131 (0.0007) [2023-12-28 06:28:07,264][106225] Updated weights for policy 1, policy_version 1563141 (0.0009) [2023-12-28 06:28:07,313][106225] Updated weights for policy 1, policy_version 1563151 (0.0010) [2023-12-28 06:28:07,567][106226] Updated weights for policy 0, policy_version 1559552 (0.0007) [2023-12-28 06:28:07,621][106226] Updated weights for policy 0, policy_version 1559562 (0.0009) [2023-12-28 06:28:07,676][106226] Updated weights for policy 0, policy_version 1559572 (0.0008) [2023-12-28 06:28:08,048][106225] Updated weights for policy 1, policy_version 1563161 (0.0008) [2023-12-28 06:28:08,102][106225] Updated weights for policy 1, policy_version 1563171 (0.0005) [2023-12-28 06:28:08,159][106225] Updated weights for policy 1, policy_version 1563181 (0.0005) [2023-12-28 06:28:08,207][106225] Updated weights for policy 1, policy_version 1563191 (0.0007) [2023-12-28 06:28:08,357][106226] Updated weights for policy 0, policy_version 1559582 (0.0007) [2023-12-28 06:28:08,416][106226] Updated weights for policy 0, policy_version 1559592 (0.0009) [2023-12-28 06:28:08,479][106226] Updated weights for policy 0, policy_version 1559602 (0.0010) [2023-12-28 06:28:08,952][106225] Updated weights for policy 1, policy_version 1563201 (0.0009) [2023-12-28 06:28:09,005][106225] Updated weights for policy 1, policy_version 1563211 (0.0008) [2023-12-28 06:28:09,053][106225] Updated weights for policy 1, policy_version 1563221 (0.0008) [2023-12-28 06:28:09,110][106226] Updated weights for policy 0, policy_version 1559612 (0.0010) [2023-12-28 06:28:09,166][106226] Updated weights for policy 0, policy_version 1559622 (0.0006) [2023-12-28 06:28:09,224][106226] Updated weights for policy 0, policy_version 1559632 (0.0006) [2023-12-28 06:28:09,883][106225] Updated weights for policy 1, policy_version 1563231 (0.0008) [2023-12-28 06:28:09,913][106226] Updated weights for policy 0, policy_version 1559642 (0.0008) [2023-12-28 06:28:09,947][106225] Updated weights for policy 1, policy_version 1563241 (0.0010) [2023-12-28 06:28:09,978][106226] Updated weights for policy 0, policy_version 1559652 (0.0008) [2023-12-28 06:28:10,016][106225] Updated weights for policy 1, policy_version 1563251 (0.0010) [2023-12-28 06:28:10,038][106226] Updated weights for policy 0, policy_version 1559662 (0.0008) [2023-12-28 06:28:10,097][106226] Updated weights for policy 0, policy_version 1559672 (0.0008) [2023-12-28 06:28:10,728][106225] Updated weights for policy 1, policy_version 1563261 (0.0008) [2023-12-28 06:28:10,788][106225] Updated weights for policy 1, policy_version 1563271 (0.0010) [2023-12-28 06:28:10,821][106226] Updated weights for policy 0, policy_version 1559682 (0.0006) [2023-12-28 06:28:10,850][106225] Updated weights for policy 1, policy_version 1563281 (0.0010) [2023-12-28 06:28:10,879][106226] Updated weights for policy 0, policy_version 1559692 (0.0006) [2023-12-28 06:28:10,930][106226] Updated weights for policy 0, policy_version 1559702 (0.0009) [2023-12-28 06:28:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 799612928. Throughput: 0: 9908.9, 1: 9957.6. Samples: 799581728. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:11,175][105115] Avg episode reward: [(0, '-4.726'), (1, '-4.622')] [2023-12-28 06:28:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001563288_400252928.pth... [2023-12-28 06:28:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001559704_399360000.pth... [2023-12-28 06:28:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001562136_399958016.pth [2023-12-28 06:28:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001558552_399065088.pth [2023-12-28 06:28:11,647][106225] Updated weights for policy 1, policy_version 1563291 (0.0010) [2023-12-28 06:28:11,694][106226] Updated weights for policy 0, policy_version 1559712 (0.0007) [2023-12-28 06:28:11,713][106225] Updated weights for policy 1, policy_version 1563301 (0.0010) [2023-12-28 06:28:11,764][106226] Updated weights for policy 0, policy_version 1559722 (0.0009) [2023-12-28 06:28:11,786][106225] Updated weights for policy 1, policy_version 1563311 (0.0010) [2023-12-28 06:28:11,819][106226] Updated weights for policy 0, policy_version 1559732 (0.0005) [2023-12-28 06:28:12,538][106225] Updated weights for policy 1, policy_version 1563321 (0.0010) [2023-12-28 06:28:12,556][106226] Updated weights for policy 0, policy_version 1559742 (0.0008) [2023-12-28 06:28:12,599][106225] Updated weights for policy 1, policy_version 1563331 (0.0006) [2023-12-28 06:28:12,616][106226] Updated weights for policy 0, policy_version 1559752 (0.0007) [2023-12-28 06:28:12,665][106225] Updated weights for policy 1, policy_version 1563341 (0.0006) [2023-12-28 06:28:12,681][106226] Updated weights for policy 0, policy_version 1559762 (0.0009) [2023-12-28 06:28:12,734][106225] Updated weights for policy 1, policy_version 1563351 (0.0006) [2023-12-28 06:28:13,372][106226] Updated weights for policy 0, policy_version 1559772 (0.0008) [2023-12-28 06:28:13,383][106225] Updated weights for policy 1, policy_version 1563361 (0.0005) [2023-12-28 06:28:13,417][106226] Updated weights for policy 0, policy_version 1559782 (0.0008) [2023-12-28 06:28:13,442][106225] Updated weights for policy 1, policy_version 1563371 (0.0005) [2023-12-28 06:28:13,465][106226] Updated weights for policy 0, policy_version 1559792 (0.0008) [2023-12-28 06:28:13,500][106225] Updated weights for policy 1, policy_version 1563381 (0.0005) [2023-12-28 06:28:14,048][106225] Updated weights for policy 1, policy_version 1563391 (0.0006) [2023-12-28 06:28:14,112][106225] Updated weights for policy 1, policy_version 1563401 (0.0005) [2023-12-28 06:28:14,171][106225] Updated weights for policy 1, policy_version 1563411 (0.0005) [2023-12-28 06:28:14,294][106226] Updated weights for policy 0, policy_version 1559802 (0.0008) [2023-12-28 06:28:14,359][106226] Updated weights for policy 0, policy_version 1559812 (0.0009) [2023-12-28 06:28:14,428][106226] Updated weights for policy 0, policy_version 1559822 (0.0005) [2023-12-28 06:28:14,481][106226] Updated weights for policy 0, policy_version 1559832 (0.0006) [2023-12-28 06:28:14,782][106225] Updated weights for policy 1, policy_version 1563421 (0.0007) [2023-12-28 06:28:14,851][106225] Updated weights for policy 1, policy_version 1563431 (0.0008) [2023-12-28 06:28:14,912][106225] Updated weights for policy 1, policy_version 1563441 (0.0008) [2023-12-28 06:28:15,180][106226] Updated weights for policy 0, policy_version 1559842 (0.0008) [2023-12-28 06:28:15,247][106226] Updated weights for policy 0, policy_version 1559852 (0.0008) [2023-12-28 06:28:15,310][106226] Updated weights for policy 0, policy_version 1559862 (0.0008) [2023-12-28 06:28:15,650][106225] Updated weights for policy 1, policy_version 1563451 (0.0007) [2023-12-28 06:28:15,708][106225] Updated weights for policy 1, policy_version 1563461 (0.0005) [2023-12-28 06:28:15,767][106225] Updated weights for policy 1, policy_version 1563471 (0.0006) [2023-12-28 06:28:16,068][106226] Updated weights for policy 0, policy_version 1559872 (0.0007) [2023-12-28 06:28:16,120][106226] Updated weights for policy 0, policy_version 1559882 (0.0006) [2023-12-28 06:28:16,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 799703040. Throughput: 0: 9787.4, 1: 9879.2. Samples: 799697516. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:16,175][106226] Updated weights for policy 0, policy_version 1559892 (0.0006) [2023-12-28 06:28:16,176][105115] Avg episode reward: [(0, '-4.936'), (1, '-4.621')] [2023-12-28 06:28:16,316][106225] Updated weights for policy 1, policy_version 1563481 (0.0006) [2023-12-28 06:28:16,380][106225] Updated weights for policy 1, policy_version 1563491 (0.0010) [2023-12-28 06:28:16,447][106225] Updated weights for policy 1, policy_version 1563501 (0.0008) [2023-12-28 06:28:16,510][106225] Updated weights for policy 1, policy_version 1563511 (0.0009) [2023-12-28 06:28:16,785][106226] Updated weights for policy 0, policy_version 1559902 (0.0005) [2023-12-28 06:28:16,857][106226] Updated weights for policy 0, policy_version 1559912 (0.0010) [2023-12-28 06:28:16,917][106226] Updated weights for policy 0, policy_version 1559922 (0.0008) [2023-12-28 06:28:17,090][106225] Updated weights for policy 1, policy_version 1563521 (0.0006) [2023-12-28 06:28:17,142][106225] Updated weights for policy 1, policy_version 1563531 (0.0008) [2023-12-28 06:28:17,194][106225] Updated weights for policy 1, policy_version 1563541 (0.0008) [2023-12-28 06:28:17,648][106226] Updated weights for policy 0, policy_version 1559932 (0.0008) [2023-12-28 06:28:17,702][106226] Updated weights for policy 0, policy_version 1559942 (0.0008) [2023-12-28 06:28:17,759][106226] Updated weights for policy 0, policy_version 1559952 (0.0007) [2023-12-28 06:28:17,923][106225] Updated weights for policy 1, policy_version 1563551 (0.0007) [2023-12-28 06:28:17,972][106225] Updated weights for policy 1, policy_version 1563561 (0.0010) [2023-12-28 06:28:18,019][106225] Updated weights for policy 1, policy_version 1563571 (0.0010) [2023-12-28 06:28:18,517][106226] Updated weights for policy 0, policy_version 1559962 (0.0008) [2023-12-28 06:28:18,580][106226] Updated weights for policy 0, policy_version 1559972 (0.0008) [2023-12-28 06:28:18,640][106226] Updated weights for policy 0, policy_version 1559982 (0.0008) [2023-12-28 06:28:18,700][106226] Updated weights for policy 0, policy_version 1559992 (0.0009) [2023-12-28 06:28:18,700][106225] Updated weights for policy 1, policy_version 1563581 (0.0010) [2023-12-28 06:28:18,751][106225] Updated weights for policy 1, policy_version 1563591 (0.0010) [2023-12-28 06:28:18,814][106225] Updated weights for policy 1, policy_version 1563601 (0.0009) [2023-12-28 06:28:19,449][106225] Updated weights for policy 1, policy_version 1563611 (0.0007) [2023-12-28 06:28:19,476][106226] Updated weights for policy 0, policy_version 1560002 (0.0006) [2023-12-28 06:28:19,517][106225] Updated weights for policy 1, policy_version 1563621 (0.0008) [2023-12-28 06:28:19,536][106226] Updated weights for policy 0, policy_version 1560012 (0.0008) [2023-12-28 06:28:19,573][106225] Updated weights for policy 1, policy_version 1563631 (0.0009) [2023-12-28 06:28:19,601][106226] Updated weights for policy 0, policy_version 1560022 (0.0007) [2023-12-28 06:28:20,304][106225] Updated weights for policy 1, policy_version 1563641 (0.0009) [2023-12-28 06:28:20,314][106226] Updated weights for policy 0, policy_version 1560032 (0.0008) [2023-12-28 06:28:20,365][106225] Updated weights for policy 1, policy_version 1563651 (0.0007) [2023-12-28 06:28:20,376][106226] Updated weights for policy 0, policy_version 1560042 (0.0008) [2023-12-28 06:28:20,423][106225] Updated weights for policy 1, policy_version 1563661 (0.0007) [2023-12-28 06:28:20,433][106226] Updated weights for policy 0, policy_version 1560052 (0.0006) [2023-12-28 06:28:20,487][106225] Updated weights for policy 1, policy_version 1563671 (0.0009) [2023-12-28 06:28:21,167][106226] Updated weights for policy 0, policy_version 1560062 (0.0006) [2023-12-28 06:28:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 799801344. Throughput: 0: 9706.7, 1: 9953.1. Samples: 799815896. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:21,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.637')] [2023-12-28 06:28:21,224][106226] Updated weights for policy 0, policy_version 1560072 (0.0009) [2023-12-28 06:28:21,266][106225] Updated weights for policy 1, policy_version 1563681 (0.0011) [2023-12-28 06:28:21,287][106226] Updated weights for policy 0, policy_version 1560082 (0.0008) [2023-12-28 06:28:21,321][106225] Updated weights for policy 1, policy_version 1563691 (0.0009) [2023-12-28 06:28:21,393][106225] Updated weights for policy 1, policy_version 1563701 (0.0009) [2023-12-28 06:28:22,098][106226] Updated weights for policy 0, policy_version 1560092 (0.0007) [2023-12-28 06:28:22,141][106225] Updated weights for policy 1, policy_version 1563711 (0.0010) [2023-12-28 06:28:22,158][106226] Updated weights for policy 0, policy_version 1560102 (0.0006) [2023-12-28 06:28:22,199][106225] Updated weights for policy 1, policy_version 1563721 (0.0010) [2023-12-28 06:28:22,214][106226] Updated weights for policy 0, policy_version 1560112 (0.0008) [2023-12-28 06:28:22,260][106225] Updated weights for policy 1, policy_version 1563731 (0.0011) [2023-12-28 06:28:22,826][106226] Updated weights for policy 0, policy_version 1560122 (0.0006) [2023-12-28 06:28:22,888][106226] Updated weights for policy 0, policy_version 1560132 (0.0009) [2023-12-28 06:28:22,949][106226] Updated weights for policy 0, policy_version 1560142 (0.0008) [2023-12-28 06:28:22,976][106225] Updated weights for policy 1, policy_version 1563741 (0.0009) [2023-12-28 06:28:23,008][106226] Updated weights for policy 0, policy_version 1560152 (0.0006) [2023-12-28 06:28:23,040][106225] Updated weights for policy 1, policy_version 1563751 (0.0008) [2023-12-28 06:28:23,103][106225] Updated weights for policy 1, policy_version 1563761 (0.0009) [2023-12-28 06:28:23,675][106225] Updated weights for policy 1, policy_version 1563771 (0.0008) [2023-12-28 06:28:23,701][106226] Updated weights for policy 0, policy_version 1560162 (0.0005) [2023-12-28 06:28:23,735][106225] Updated weights for policy 1, policy_version 1563781 (0.0006) [2023-12-28 06:28:23,756][106226] Updated weights for policy 0, policy_version 1560172 (0.0005) [2023-12-28 06:28:23,790][106225] Updated weights for policy 1, policy_version 1563791 (0.0008) [2023-12-28 06:28:23,811][106226] Updated weights for policy 0, policy_version 1560182 (0.0008) [2023-12-28 06:28:24,407][106225] Updated weights for policy 1, policy_version 1563801 (0.0006) [2023-12-28 06:28:24,461][106225] Updated weights for policy 1, policy_version 1563811 (0.0005) [2023-12-28 06:28:24,486][106226] Updated weights for policy 0, policy_version 1560192 (0.0006) [2023-12-28 06:28:24,523][106225] Updated weights for policy 1, policy_version 1563821 (0.0005) [2023-12-28 06:28:24,546][106226] Updated weights for policy 0, policy_version 1560202 (0.0005) [2023-12-28 06:28:24,581][106225] Updated weights for policy 1, policy_version 1563831 (0.0006) [2023-12-28 06:28:24,600][106226] Updated weights for policy 0, policy_version 1560212 (0.0006) [2023-12-28 06:28:25,254][106225] Updated weights for policy 1, policy_version 1563841 (0.0006) [2023-12-28 06:28:25,255][106226] Updated weights for policy 0, policy_version 1560222 (0.0009) [2023-12-28 06:28:25,317][106225] Updated weights for policy 1, policy_version 1563851 (0.0005) [2023-12-28 06:28:25,317][106226] Updated weights for policy 0, policy_version 1560232 (0.0006) [2023-12-28 06:28:25,372][106225] Updated weights for policy 1, policy_version 1563861 (0.0005) [2023-12-28 06:28:25,375][106226] Updated weights for policy 0, policy_version 1560242 (0.0007) [2023-12-28 06:28:25,973][106226] Updated weights for policy 0, policy_version 1560252 (0.0007) [2023-12-28 06:28:25,991][106225] Updated weights for policy 1, policy_version 1563871 (0.0006) [2023-12-28 06:28:26,025][106226] Updated weights for policy 0, policy_version 1560262 (0.0008) [2023-12-28 06:28:26,050][106225] Updated weights for policy 1, policy_version 1563881 (0.0008) [2023-12-28 06:28:26,071][106226] Updated weights for policy 0, policy_version 1560272 (0.0007) [2023-12-28 06:28:26,107][106225] Updated weights for policy 1, policy_version 1563891 (0.0008) [2023-12-28 06:28:26,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 799916032. Throughput: 0: 9700.6, 1: 9933.4. Samples: 799875276. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:26,176][105115] Avg episode reward: [(0, '-4.886'), (1, '-4.480')] [2023-12-28 06:28:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001560280_399507456.pth... [2023-12-28 06:28:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001563896_400408576.pth... [2023-12-28 06:28:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001559128_399212544.pth [2023-12-28 06:28:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001562712_400105472.pth [2023-12-28 06:28:26,763][106225] Updated weights for policy 1, policy_version 1563901 (0.0006) [2023-12-28 06:28:26,797][106226] Updated weights for policy 0, policy_version 1560282 (0.0008) [2023-12-28 06:28:26,814][106225] Updated weights for policy 1, policy_version 1563911 (0.0005) [2023-12-28 06:28:26,861][106226] Updated weights for policy 0, policy_version 1560292 (0.0008) [2023-12-28 06:28:26,872][106225] Updated weights for policy 1, policy_version 1563921 (0.0005) [2023-12-28 06:28:26,907][106226] Updated weights for policy 0, policy_version 1560302 (0.0007) [2023-12-28 06:28:26,967][106226] Updated weights for policy 0, policy_version 1560312 (0.0010) [2023-12-28 06:28:27,462][106225] Updated weights for policy 1, policy_version 1563931 (0.0005) [2023-12-28 06:28:27,512][106225] Updated weights for policy 1, policy_version 1563941 (0.0005) [2023-12-28 06:28:27,559][106225] Updated weights for policy 1, policy_version 1563951 (0.0005) [2023-12-28 06:28:27,773][106226] Updated weights for policy 0, policy_version 1560322 (0.0005) [2023-12-28 06:28:27,820][106226] Updated weights for policy 0, policy_version 1560332 (0.0005) [2023-12-28 06:28:27,878][106226] Updated weights for policy 0, policy_version 1560342 (0.0005) [2023-12-28 06:28:28,131][106225] Updated weights for policy 1, policy_version 1563961 (0.0006) [2023-12-28 06:28:28,185][106225] Updated weights for policy 1, policy_version 1563971 (0.0009) [2023-12-28 06:28:28,233][106225] Updated weights for policy 1, policy_version 1563981 (0.0008) [2023-12-28 06:28:28,288][106225] Updated weights for policy 1, policy_version 1563992 (0.0009) [2023-12-28 06:28:28,434][106226] Updated weights for policy 0, policy_version 1560352 (0.0008) [2023-12-28 06:28:28,493][106226] Updated weights for policy 0, policy_version 1560362 (0.0008) [2023-12-28 06:28:28,552][106226] Updated weights for policy 0, policy_version 1560372 (0.0009) [2023-12-28 06:28:29,053][106225] Updated weights for policy 1, policy_version 1564002 (0.0009) [2023-12-28 06:28:29,115][106225] Updated weights for policy 1, policy_version 1564012 (0.0009) [2023-12-28 06:28:29,179][106225] Updated weights for policy 1, policy_version 1564022 (0.0008) [2023-12-28 06:28:29,268][106226] Updated weights for policy 0, policy_version 1560382 (0.0009) [2023-12-28 06:28:29,329][106226] Updated weights for policy 0, policy_version 1560392 (0.0009) [2023-12-28 06:28:29,393][106226] Updated weights for policy 0, policy_version 1560402 (0.0009) [2023-12-28 06:28:29,948][106225] Updated weights for policy 1, policy_version 1564032 (0.0009) [2023-12-28 06:28:30,019][106225] Updated weights for policy 1, policy_version 1564042 (0.0010) [2023-12-28 06:28:30,068][106225] Updated weights for policy 1, policy_version 1564052 (0.0005) [2023-12-28 06:28:30,075][106226] Updated weights for policy 0, policy_version 1560412 (0.0008) [2023-12-28 06:28:30,130][106226] Updated weights for policy 0, policy_version 1560422 (0.0007) [2023-12-28 06:28:30,193][106226] Updated weights for policy 0, policy_version 1560432 (0.0006) [2023-12-28 06:28:30,786][106225] Updated weights for policy 1, policy_version 1564062 (0.0008) [2023-12-28 06:28:30,836][106225] Updated weights for policy 1, policy_version 1564072 (0.0010) [2023-12-28 06:28:30,850][106226] Updated weights for policy 0, policy_version 1560442 (0.0005) [2023-12-28 06:28:30,889][106225] Updated weights for policy 1, policy_version 1564082 (0.0010) [2023-12-28 06:28:30,913][106226] Updated weights for policy 0, policy_version 1560452 (0.0005) [2023-12-28 06:28:30,969][106226] Updated weights for policy 0, policy_version 1560462 (0.0005) [2023-12-28 06:28:31,025][106226] Updated weights for policy 0, policy_version 1560472 (0.0006) [2023-12-28 06:28:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 800014336. Throughput: 0: 9768.2, 1: 10127.4. Samples: 800000044. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:31,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.815')] [2023-12-28 06:28:31,649][106225] Updated weights for policy 1, policy_version 1564092 (0.0010) [2023-12-28 06:28:31,713][106225] Updated weights for policy 1, policy_version 1564102 (0.0006) [2023-12-28 06:28:31,765][106226] Updated weights for policy 0, policy_version 1560482 (0.0008) [2023-12-28 06:28:31,781][106225] Updated weights for policy 1, policy_version 1564112 (0.0010) [2023-12-28 06:28:31,823][106226] Updated weights for policy 0, policy_version 1560492 (0.0006) [2023-12-28 06:28:31,894][106226] Updated weights for policy 0, policy_version 1560502 (0.0005) [2023-12-28 06:28:32,480][106225] Updated weights for policy 1, policy_version 1564122 (0.0009) [2023-12-28 06:28:32,484][106226] Updated weights for policy 0, policy_version 1560512 (0.0010) [2023-12-28 06:28:32,535][106225] Updated weights for policy 1, policy_version 1564132 (0.0005) [2023-12-28 06:28:32,540][106226] Updated weights for policy 0, policy_version 1560522 (0.0009) [2023-12-28 06:28:32,589][106225] Updated weights for policy 1, policy_version 1564142 (0.0005) [2023-12-28 06:28:32,595][106226] Updated weights for policy 0, policy_version 1560532 (0.0010) [2023-12-28 06:28:32,641][106225] Updated weights for policy 1, policy_version 1564152 (0.0005) [2023-12-28 06:28:33,247][106225] Updated weights for policy 1, policy_version 1564162 (0.0010) [2023-12-28 06:28:33,303][106225] Updated weights for policy 1, policy_version 1564172 (0.0010) [2023-12-28 06:28:33,327][106226] Updated weights for policy 0, policy_version 1560542 (0.0010) [2023-12-28 06:28:33,363][106225] Updated weights for policy 1, policy_version 1564182 (0.0010) [2023-12-28 06:28:33,381][106226] Updated weights for policy 0, policy_version 1560552 (0.0007) [2023-12-28 06:28:33,438][106226] Updated weights for policy 0, policy_version 1560562 (0.0008) [2023-12-28 06:28:34,062][106225] Updated weights for policy 1, policy_version 1564192 (0.0007) [2023-12-28 06:28:34,114][106225] Updated weights for policy 1, policy_version 1564202 (0.0005) [2023-12-28 06:28:34,184][106225] Updated weights for policy 1, policy_version 1564212 (0.0010) [2023-12-28 06:28:34,206][106226] Updated weights for policy 0, policy_version 1560572 (0.0009) [2023-12-28 06:28:34,268][106226] Updated weights for policy 0, policy_version 1560582 (0.0011) [2023-12-28 06:28:34,333][106226] Updated weights for policy 0, policy_version 1560592 (0.0011) [2023-12-28 06:28:34,814][106225] Updated weights for policy 1, policy_version 1564222 (0.0006) [2023-12-28 06:28:34,867][106225] Updated weights for policy 1, policy_version 1564232 (0.0005) [2023-12-28 06:28:34,914][106226] Updated weights for policy 0, policy_version 1560602 (0.0009) [2023-12-28 06:28:34,922][106225] Updated weights for policy 1, policy_version 1564242 (0.0005) [2023-12-28 06:28:34,976][106226] Updated weights for policy 0, policy_version 1560612 (0.0006) [2023-12-28 06:28:35,027][106226] Updated weights for policy 0, policy_version 1560622 (0.0008) [2023-12-28 06:28:35,082][106226] Updated weights for policy 0, policy_version 1560632 (0.0010) [2023-12-28 06:28:35,566][106225] Updated weights for policy 1, policy_version 1564252 (0.0008) [2023-12-28 06:28:35,628][106225] Updated weights for policy 1, policy_version 1564262 (0.0011) [2023-12-28 06:28:35,682][106225] Updated weights for policy 1, policy_version 1564272 (0.0010) [2023-12-28 06:28:35,794][106226] Updated weights for policy 0, policy_version 1560642 (0.0010) [2023-12-28 06:28:35,850][106226] Updated weights for policy 0, policy_version 1560652 (0.0008) [2023-12-28 06:28:35,905][106226] Updated weights for policy 0, policy_version 1560662 (0.0006) [2023-12-28 06:28:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 800112640. Throughput: 0: 9835.5, 1: 10192.4. Samples: 800121304. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:36,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.366')] [2023-12-28 06:28:36,363][106225] Updated weights for policy 1, policy_version 1564282 (0.0009) [2023-12-28 06:28:36,426][106225] Updated weights for policy 1, policy_version 1564292 (0.0008) [2023-12-28 06:28:36,492][106225] Updated weights for policy 1, policy_version 1564302 (0.0008) [2023-12-28 06:28:36,541][106226] Updated weights for policy 0, policy_version 1560672 (0.0006) [2023-12-28 06:28:36,558][106225] Updated weights for policy 1, policy_version 1564312 (0.0010) [2023-12-28 06:28:36,607][106226] Updated weights for policy 0, policy_version 1560682 (0.0008) [2023-12-28 06:28:36,671][106226] Updated weights for policy 0, policy_version 1560692 (0.0008) [2023-12-28 06:28:37,276][106225] Updated weights for policy 1, policy_version 1564322 (0.0010) [2023-12-28 06:28:37,333][106225] Updated weights for policy 1, policy_version 1564332 (0.0010) [2023-12-28 06:28:37,339][106226] Updated weights for policy 0, policy_version 1560702 (0.0010) [2023-12-28 06:28:37,391][106225] Updated weights for policy 1, policy_version 1564342 (0.0010) [2023-12-28 06:28:37,400][106226] Updated weights for policy 0, policy_version 1560712 (0.0011) [2023-12-28 06:28:37,464][106226] Updated weights for policy 0, policy_version 1560722 (0.0010) [2023-12-28 06:28:38,066][106226] Updated weights for policy 0, policy_version 1560732 (0.0009) [2023-12-28 06:28:38,109][106225] Updated weights for policy 1, policy_version 1564352 (0.0010) [2023-12-28 06:28:38,121][106226] Updated weights for policy 0, policy_version 1560742 (0.0009) [2023-12-28 06:28:38,159][106225] Updated weights for policy 1, policy_version 1564362 (0.0010) [2023-12-28 06:28:38,173][106226] Updated weights for policy 0, policy_version 1560752 (0.0006) [2023-12-28 06:28:38,207][106225] Updated weights for policy 1, policy_version 1564372 (0.0010) [2023-12-28 06:28:38,859][106226] Updated weights for policy 0, policy_version 1560762 (0.0006) [2023-12-28 06:28:38,925][106226] Updated weights for policy 0, policy_version 1560772 (0.0008) [2023-12-28 06:28:38,952][106225] Updated weights for policy 1, policy_version 1564382 (0.0007) [2023-12-28 06:28:38,982][106226] Updated weights for policy 0, policy_version 1560782 (0.0006) [2023-12-28 06:28:39,018][106225] Updated weights for policy 1, policy_version 1564392 (0.0008) [2023-12-28 06:28:39,035][106226] Updated weights for policy 0, policy_version 1560792 (0.0006) [2023-12-28 06:28:39,084][106225] Updated weights for policy 1, policy_version 1564402 (0.0008) [2023-12-28 06:28:39,784][106226] Updated weights for policy 0, policy_version 1560802 (0.0009) [2023-12-28 06:28:39,841][106225] Updated weights for policy 1, policy_version 1564412 (0.0008) [2023-12-28 06:28:39,852][106226] Updated weights for policy 0, policy_version 1560812 (0.0008) [2023-12-28 06:28:39,901][106225] Updated weights for policy 1, policy_version 1564422 (0.0008) [2023-12-28 06:28:39,921][106226] Updated weights for policy 0, policy_version 1560822 (0.0007) [2023-12-28 06:28:39,968][106225] Updated weights for policy 1, policy_version 1564432 (0.0008) [2023-12-28 06:28:40,652][106226] Updated weights for policy 0, policy_version 1560832 (0.0008) [2023-12-28 06:28:40,692][106225] Updated weights for policy 1, policy_version 1564442 (0.0008) [2023-12-28 06:28:40,713][106226] Updated weights for policy 0, policy_version 1560842 (0.0008) [2023-12-28 06:28:40,750][106225] Updated weights for policy 1, policy_version 1564452 (0.0006) [2023-12-28 06:28:40,770][106226] Updated weights for policy 0, policy_version 1560852 (0.0007) [2023-12-28 06:28:40,808][106225] Updated weights for policy 1, policy_version 1564462 (0.0005) [2023-12-28 06:28:40,862][106225] Updated weights for policy 1, policy_version 1564472 (0.0005) [2023-12-28 06:28:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 800210944. Throughput: 0: 9868.3, 1: 10138.5. Samples: 800181712. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:41,176][105115] Avg episode reward: [(0, '-4.573'), (1, '-4.638')] [2023-12-28 06:28:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001564472_400556032.pth... [2023-12-28 06:28:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001560856_399654912.pth... [2023-12-28 06:28:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001559704_399360000.pth [2023-12-28 06:28:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001563288_400252928.pth [2023-12-28 06:28:41,540][106225] Updated weights for policy 1, policy_version 1564482 (0.0009) [2023-12-28 06:28:41,596][106226] Updated weights for policy 0, policy_version 1560862 (0.0007) [2023-12-28 06:28:41,603][106225] Updated weights for policy 1, policy_version 1564492 (0.0007) [2023-12-28 06:28:41,663][106226] Updated weights for policy 0, policy_version 1560872 (0.0008) [2023-12-28 06:28:41,673][106225] Updated weights for policy 1, policy_version 1564502 (0.0008) [2023-12-28 06:28:41,734][106226] Updated weights for policy 0, policy_version 1560882 (0.0007) [2023-12-28 06:28:42,425][106225] Updated weights for policy 1, policy_version 1564512 (0.0008) [2023-12-28 06:28:42,486][106225] Updated weights for policy 1, policy_version 1564522 (0.0008) [2023-12-28 06:28:42,498][106226] Updated weights for policy 0, policy_version 1560892 (0.0009) [2023-12-28 06:28:42,548][106225] Updated weights for policy 1, policy_version 1564532 (0.0009) [2023-12-28 06:28:42,555][106226] Updated weights for policy 0, policy_version 1560902 (0.0010) [2023-12-28 06:28:42,610][106226] Updated weights for policy 0, policy_version 1560912 (0.0011) [2023-12-28 06:28:43,188][106225] Updated weights for policy 1, policy_version 1564542 (0.0007) [2023-12-28 06:28:43,246][106225] Updated weights for policy 1, policy_version 1564552 (0.0008) [2023-12-28 06:28:43,299][106225] Updated weights for policy 1, policy_version 1564562 (0.0008) [2023-12-28 06:28:43,335][106226] Updated weights for policy 0, policy_version 1560922 (0.0010) [2023-12-28 06:28:43,395][106226] Updated weights for policy 0, policy_version 1560932 (0.0010) [2023-12-28 06:28:43,458][106226] Updated weights for policy 0, policy_version 1560942 (0.0010) [2023-12-28 06:28:43,514][106226] Updated weights for policy 0, policy_version 1560952 (0.0010) [2023-12-28 06:28:44,028][106225] Updated weights for policy 1, policy_version 1564572 (0.0007) [2023-12-28 06:28:44,089][106225] Updated weights for policy 1, policy_version 1564582 (0.0007) [2023-12-28 06:28:44,146][106225] Updated weights for policy 1, policy_version 1564592 (0.0008) [2023-12-28 06:28:44,213][106226] Updated weights for policy 0, policy_version 1560962 (0.0006) [2023-12-28 06:28:44,260][106226] Updated weights for policy 0, policy_version 1560972 (0.0010) [2023-12-28 06:28:44,313][106226] Updated weights for policy 0, policy_version 1560982 (0.0010) [2023-12-28 06:28:44,870][106225] Updated weights for policy 1, policy_version 1564602 (0.0009) [2023-12-28 06:28:44,908][106226] Updated weights for policy 0, policy_version 1560992 (0.0011) [2023-12-28 06:28:44,935][106225] Updated weights for policy 1, policy_version 1564612 (0.0007) [2023-12-28 06:28:44,973][106226] Updated weights for policy 0, policy_version 1561002 (0.0011) [2023-12-28 06:28:44,984][106225] Updated weights for policy 1, policy_version 1564622 (0.0007) [2023-12-28 06:28:45,040][106226] Updated weights for policy 0, policy_version 1561012 (0.0011) [2023-12-28 06:28:45,047][106225] Updated weights for policy 1, policy_version 1564632 (0.0008) [2023-12-28 06:28:45,699][106226] Updated weights for policy 0, policy_version 1561022 (0.0010) [2023-12-28 06:28:45,760][106226] Updated weights for policy 0, policy_version 1561032 (0.0011) [2023-12-28 06:28:45,822][106226] Updated weights for policy 0, policy_version 1561042 (0.0011) [2023-12-28 06:28:45,848][106225] Updated weights for policy 1, policy_version 1564642 (0.0007) [2023-12-28 06:28:45,918][106225] Updated weights for policy 1, policy_version 1564652 (0.0010) [2023-12-28 06:28:45,985][106225] Updated weights for policy 1, policy_version 1564662 (0.0009) [2023-12-28 06:28:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 800309248. Throughput: 0: 9819.6, 1: 10058.8. Samples: 800296740. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:46,175][105115] Avg episode reward: [(0, '-4.815'), (1, '-4.771')] [2023-12-28 06:28:46,435][106226] Updated weights for policy 0, policy_version 1561052 (0.0009) [2023-12-28 06:28:46,499][106226] Updated weights for policy 0, policy_version 1561062 (0.0011) [2023-12-28 06:28:46,551][106226] Updated weights for policy 0, policy_version 1561072 (0.0006) [2023-12-28 06:28:46,686][106225] Updated weights for policy 1, policy_version 1564672 (0.0008) [2023-12-28 06:28:46,737][106225] Updated weights for policy 1, policy_version 1564682 (0.0009) [2023-12-28 06:28:46,790][106225] Updated weights for policy 1, policy_version 1564692 (0.0008) [2023-12-28 06:28:47,092][106226] Updated weights for policy 0, policy_version 1561082 (0.0005) [2023-12-28 06:28:47,162][106226] Updated weights for policy 0, policy_version 1561092 (0.0005) [2023-12-28 06:28:47,227][106226] Updated weights for policy 0, policy_version 1561102 (0.0009) [2023-12-28 06:28:47,282][106226] Updated weights for policy 0, policy_version 1561112 (0.0011) [2023-12-28 06:28:47,578][106225] Updated weights for policy 1, policy_version 1564703 (0.0007) [2023-12-28 06:28:47,630][106225] Updated weights for policy 1, policy_version 1564713 (0.0008) [2023-12-28 06:28:47,683][106225] Updated weights for policy 1, policy_version 1564723 (0.0005) [2023-12-28 06:28:47,938][106226] Updated weights for policy 0, policy_version 1561122 (0.0011) [2023-12-28 06:28:47,991][106226] Updated weights for policy 0, policy_version 1561132 (0.0006) [2023-12-28 06:28:48,048][106226] Updated weights for policy 0, policy_version 1561142 (0.0006) [2023-12-28 06:28:48,243][106225] Updated weights for policy 1, policy_version 1564733 (0.0005) [2023-12-28 06:28:48,300][106225] Updated weights for policy 1, policy_version 1564743 (0.0005) [2023-12-28 06:28:48,365][106225] Updated weights for policy 1, policy_version 1564753 (0.0006) [2023-12-28 06:28:48,710][106226] Updated weights for policy 0, policy_version 1561152 (0.0010) [2023-12-28 06:28:48,764][106226] Updated weights for policy 0, policy_version 1561162 (0.0011) [2023-12-28 06:28:48,815][106226] Updated weights for policy 0, policy_version 1561172 (0.0010) [2023-12-28 06:28:49,001][106225] Updated weights for policy 1, policy_version 1564763 (0.0006) [2023-12-28 06:28:49,062][106225] Updated weights for policy 1, policy_version 1564773 (0.0008) [2023-12-28 06:28:49,123][106225] Updated weights for policy 1, policy_version 1564783 (0.0008) [2023-12-28 06:28:49,566][106226] Updated weights for policy 0, policy_version 1561182 (0.0008) [2023-12-28 06:28:49,616][106226] Updated weights for policy 0, policy_version 1561192 (0.0006) [2023-12-28 06:28:49,685][106226] Updated weights for policy 0, policy_version 1561202 (0.0006) [2023-12-28 06:28:49,911][106225] Updated weights for policy 1, policy_version 1564793 (0.0009) [2023-12-28 06:28:49,972][106225] Updated weights for policy 1, policy_version 1564803 (0.0007) [2023-12-28 06:28:50,036][106225] Updated weights for policy 1, policy_version 1564813 (0.0005) [2023-12-28 06:28:50,100][106225] Updated weights for policy 1, policy_version 1564823 (0.0007) [2023-12-28 06:28:50,339][106226] Updated weights for policy 0, policy_version 1561212 (0.0011) [2023-12-28 06:28:50,412][106226] Updated weights for policy 0, policy_version 1561222 (0.0011) [2023-12-28 06:28:50,474][106226] Updated weights for policy 0, policy_version 1561232 (0.0011) [2023-12-28 06:28:50,828][106225] Updated weights for policy 1, policy_version 1564833 (0.0008) [2023-12-28 06:28:50,884][106225] Updated weights for policy 1, policy_version 1564843 (0.0010) [2023-12-28 06:28:50,952][106225] Updated weights for policy 1, policy_version 1564853 (0.0010) [2023-12-28 06:28:51,075][106226] Updated weights for policy 0, policy_version 1561242 (0.0011) [2023-12-28 06:28:51,134][106226] Updated weights for policy 0, policy_version 1561252 (0.0010) [2023-12-28 06:28:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 800407552. Throughput: 0: 9988.6, 1: 9986.2. Samples: 800418396. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:51,175][105115] Avg episode reward: [(0, '-4.795'), (1, '-5.007')] [2023-12-28 06:28:51,196][106226] Updated weights for policy 0, policy_version 1561262 (0.0008) [2023-12-28 06:28:51,267][106226] Updated weights for policy 0, policy_version 1561272 (0.0008) [2023-12-28 06:28:51,656][106225] Updated weights for policy 1, policy_version 1564863 (0.0009) [2023-12-28 06:28:51,711][106225] Updated weights for policy 1, policy_version 1564873 (0.0010) [2023-12-28 06:28:51,783][106225] Updated weights for policy 1, policy_version 1564883 (0.0009) [2023-12-28 06:28:52,139][106226] Updated weights for policy 0, policy_version 1561282 (0.0011) [2023-12-28 06:28:52,207][106226] Updated weights for policy 0, policy_version 1561292 (0.0008) [2023-12-28 06:28:52,276][106226] Updated weights for policy 0, policy_version 1561302 (0.0007) [2023-12-28 06:28:52,474][106225] Updated weights for policy 1, policy_version 1564893 (0.0007) [2023-12-28 06:28:52,529][106225] Updated weights for policy 1, policy_version 1564903 (0.0010) [2023-12-28 06:28:52,587][106225] Updated weights for policy 1, policy_version 1564913 (0.0010) [2023-12-28 06:28:52,864][106226] Updated weights for policy 0, policy_version 1561312 (0.0006) [2023-12-28 06:28:52,928][106226] Updated weights for policy 0, policy_version 1561322 (0.0005) [2023-12-28 06:28:52,992][106226] Updated weights for policy 0, policy_version 1561332 (0.0005) [2023-12-28 06:28:53,300][106225] Updated weights for policy 1, policy_version 1564923 (0.0010) [2023-12-28 06:28:53,359][106225] Updated weights for policy 1, policy_version 1564933 (0.0010) [2023-12-28 06:28:53,408][106225] Updated weights for policy 1, policy_version 1564943 (0.0010) [2023-12-28 06:28:53,580][106226] Updated weights for policy 0, policy_version 1561342 (0.0009) [2023-12-28 06:28:53,640][106226] Updated weights for policy 0, policy_version 1561352 (0.0011) [2023-12-28 06:28:53,701][106226] Updated weights for policy 0, policy_version 1561362 (0.0009) [2023-12-28 06:28:54,057][106225] Updated weights for policy 1, policy_version 1564953 (0.0010) [2023-12-28 06:28:54,114][106225] Updated weights for policy 1, policy_version 1564963 (0.0008) [2023-12-28 06:28:54,172][106225] Updated weights for policy 1, policy_version 1564973 (0.0008) [2023-12-28 06:28:54,222][106225] Updated weights for policy 1, policy_version 1564983 (0.0008) [2023-12-28 06:28:54,386][106226] Updated weights for policy 0, policy_version 1561372 (0.0008) [2023-12-28 06:28:54,446][106226] Updated weights for policy 0, policy_version 1561382 (0.0011) [2023-12-28 06:28:54,506][106226] Updated weights for policy 0, policy_version 1561392 (0.0011) [2023-12-28 06:28:54,962][106225] Updated weights for policy 1, policy_version 1564993 (0.0008) [2023-12-28 06:28:55,020][106225] Updated weights for policy 1, policy_version 1565003 (0.0009) [2023-12-28 06:28:55,065][106225] Updated weights for policy 1, policy_version 1565013 (0.0009) [2023-12-28 06:28:55,232][106226] Updated weights for policy 0, policy_version 1561402 (0.0011) [2023-12-28 06:28:55,282][106226] Updated weights for policy 0, policy_version 1561412 (0.0010) [2023-12-28 06:28:55,328][106226] Updated weights for policy 0, policy_version 1561422 (0.0010) [2023-12-28 06:28:55,377][106226] Updated weights for policy 0, policy_version 1561432 (0.0010) [2023-12-28 06:28:55,882][106225] Updated weights for policy 1, policy_version 1565023 (0.0008) [2023-12-28 06:28:55,944][106225] Updated weights for policy 1, policy_version 1565033 (0.0007) [2023-12-28 06:28:55,988][106226] Updated weights for policy 0, policy_version 1561442 (0.0008) [2023-12-28 06:28:55,994][106225] Updated weights for policy 1, policy_version 1565043 (0.0005) [2023-12-28 06:28:56,047][106226] Updated weights for policy 0, policy_version 1561452 (0.0008) [2023-12-28 06:28:56,108][106226] Updated weights for policy 0, policy_version 1561462 (0.0011) [2023-12-28 06:28:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19910.7). Total num frames: 800514048. Throughput: 0: 9973.4, 1: 9957.3. Samples: 800478612. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:28:56,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.662')] [2023-12-28 06:28:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001561464_399810560.pth... [2023-12-28 06:28:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001565048_400703488.pth... [2023-12-28 06:28:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001560280_399507456.pth [2023-12-28 06:28:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001563896_400408576.pth [2023-12-28 06:28:56,735][106225] Updated weights for policy 1, policy_version 1565053 (0.0009) [2023-12-28 06:28:56,771][106226] Updated weights for policy 0, policy_version 1561472 (0.0006) [2023-12-28 06:28:56,783][106225] Updated weights for policy 1, policy_version 1565063 (0.0008) [2023-12-28 06:28:56,819][106226] Updated weights for policy 0, policy_version 1561482 (0.0005) [2023-12-28 06:28:56,827][106225] Updated weights for policy 1, policy_version 1565073 (0.0008) [2023-12-28 06:28:56,869][106226] Updated weights for policy 0, policy_version 1561492 (0.0005) [2023-12-28 06:28:57,436][106226] Updated weights for policy 0, policy_version 1561502 (0.0005) [2023-12-28 06:28:57,503][106226] Updated weights for policy 0, policy_version 1561512 (0.0005) [2023-12-28 06:28:57,568][106226] Updated weights for policy 0, policy_version 1561522 (0.0006) [2023-12-28 06:28:57,588][106225] Updated weights for policy 1, policy_version 1565083 (0.0007) [2023-12-28 06:28:57,641][106225] Updated weights for policy 1, policy_version 1565093 (0.0007) [2023-12-28 06:28:57,695][106225] Updated weights for policy 1, policy_version 1565103 (0.0009) [2023-12-28 06:28:58,105][106226] Updated weights for policy 0, policy_version 1561532 (0.0006) [2023-12-28 06:28:58,162][106226] Updated weights for policy 0, policy_version 1561542 (0.0005) [2023-12-28 06:28:58,227][106226] Updated weights for policy 0, policy_version 1561552 (0.0009) [2023-12-28 06:28:58,422][106225] Updated weights for policy 1, policy_version 1565113 (0.0006) [2023-12-28 06:28:58,490][106225] Updated weights for policy 1, policy_version 1565123 (0.0008) [2023-12-28 06:28:58,556][106225] Updated weights for policy 1, policy_version 1565133 (0.0008) [2023-12-28 06:28:58,619][106225] Updated weights for policy 1, policy_version 1565143 (0.0008) [2023-12-28 06:28:59,010][106226] Updated weights for policy 0, policy_version 1561562 (0.0009) [2023-12-28 06:28:59,072][106226] Updated weights for policy 0, policy_version 1561572 (0.0008) [2023-12-28 06:28:59,119][106226] Updated weights for policy 0, policy_version 1561582 (0.0007) [2023-12-28 06:28:59,173][106226] Updated weights for policy 0, policy_version 1561592 (0.0007) [2023-12-28 06:28:59,389][106225] Updated weights for policy 1, policy_version 1565153 (0.0007) [2023-12-28 06:28:59,452][106225] Updated weights for policy 1, policy_version 1565163 (0.0007) [2023-12-28 06:28:59,510][106225] Updated weights for policy 1, policy_version 1565173 (0.0005) [2023-12-28 06:28:59,934][106226] Updated weights for policy 0, policy_version 1561602 (0.0007) [2023-12-28 06:28:59,995][106226] Updated weights for policy 0, policy_version 1561612 (0.0009) [2023-12-28 06:29:00,058][106226] Updated weights for policy 0, policy_version 1561622 (0.0011) [2023-12-28 06:29:00,157][106225] Updated weights for policy 1, policy_version 1565183 (0.0007) [2023-12-28 06:29:00,204][106225] Updated weights for policy 1, policy_version 1565193 (0.0008) [2023-12-28 06:29:00,257][106225] Updated weights for policy 1, policy_version 1565203 (0.0007) [2023-12-28 06:29:00,762][106226] Updated weights for policy 0, policy_version 1561632 (0.0010) [2023-12-28 06:29:00,813][106226] Updated weights for policy 0, policy_version 1561642 (0.0010) [2023-12-28 06:29:00,875][106226] Updated weights for policy 0, policy_version 1561652 (0.0010) [2023-12-28 06:29:00,955][106225] Updated weights for policy 1, policy_version 1565213 (0.0006) [2023-12-28 06:29:01,012][106225] Updated weights for policy 1, policy_version 1565223 (0.0005) [2023-12-28 06:29:01,079][106225] Updated weights for policy 1, policy_version 1565233 (0.0008) [2023-12-28 06:29:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 800612352. Throughput: 0: 10064.1, 1: 9917.5. Samples: 800596680. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:01,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.564')] [2023-12-28 06:29:01,564][106226] Updated weights for policy 0, policy_version 1561662 (0.0010) [2023-12-28 06:29:01,614][106226] Updated weights for policy 0, policy_version 1561672 (0.0010) [2023-12-28 06:29:01,672][106226] Updated weights for policy 0, policy_version 1561682 (0.0011) [2023-12-28 06:29:01,825][106225] Updated weights for policy 1, policy_version 1565243 (0.0007) [2023-12-28 06:29:01,875][106225] Updated weights for policy 1, policy_version 1565253 (0.0008) [2023-12-28 06:29:01,934][106225] Updated weights for policy 1, policy_version 1565263 (0.0006) [2023-12-28 06:29:02,376][106226] Updated weights for policy 0, policy_version 1561692 (0.0012) [2023-12-28 06:29:02,429][106226] Updated weights for policy 0, policy_version 1561702 (0.0010) [2023-12-28 06:29:02,481][106226] Updated weights for policy 0, policy_version 1561712 (0.0009) [2023-12-28 06:29:02,676][106225] Updated weights for policy 1, policy_version 1565273 (0.0008) [2023-12-28 06:29:02,731][106225] Updated weights for policy 1, policy_version 1565283 (0.0008) [2023-12-28 06:29:02,780][106225] Updated weights for policy 1, policy_version 1565293 (0.0008) [2023-12-28 06:29:02,832][106225] Updated weights for policy 1, policy_version 1565303 (0.0008) [2023-12-28 06:29:03,118][106226] Updated weights for policy 0, policy_version 1561722 (0.0008) [2023-12-28 06:29:03,180][106226] Updated weights for policy 0, policy_version 1561732 (0.0005) [2023-12-28 06:29:03,230][106226] Updated weights for policy 0, policy_version 1561742 (0.0008) [2023-12-28 06:29:03,291][106226] Updated weights for policy 0, policy_version 1561752 (0.0009) [2023-12-28 06:29:03,632][106225] Updated weights for policy 1, policy_version 1565313 (0.0009) [2023-12-28 06:29:03,691][106225] Updated weights for policy 1, policy_version 1565323 (0.0008) [2023-12-28 06:29:03,739][106225] Updated weights for policy 1, policy_version 1565333 (0.0008) [2023-12-28 06:29:03,912][106226] Updated weights for policy 0, policy_version 1561762 (0.0008) [2023-12-28 06:29:03,974][106226] Updated weights for policy 0, policy_version 1561772 (0.0008) [2023-12-28 06:29:04,029][106226] Updated weights for policy 0, policy_version 1561782 (0.0008) [2023-12-28 06:29:04,494][106225] Updated weights for policy 1, policy_version 1565343 (0.0006) [2023-12-28 06:29:04,551][106225] Updated weights for policy 1, policy_version 1565353 (0.0005) [2023-12-28 06:29:04,608][106225] Updated weights for policy 1, policy_version 1565363 (0.0006) [2023-12-28 06:29:04,772][106226] Updated weights for policy 0, policy_version 1561792 (0.0006) [2023-12-28 06:29:04,830][106226] Updated weights for policy 0, policy_version 1561802 (0.0007) [2023-12-28 06:29:04,880][106226] Updated weights for policy 0, policy_version 1561812 (0.0011) [2023-12-28 06:29:05,264][106225] Updated weights for policy 1, policy_version 1565373 (0.0007) [2023-12-28 06:29:05,325][106225] Updated weights for policy 1, policy_version 1565383 (0.0006) [2023-12-28 06:29:05,396][106225] Updated weights for policy 1, policy_version 1565393 (0.0010) [2023-12-28 06:29:05,481][106226] Updated weights for policy 0, policy_version 1561822 (0.0007) [2023-12-28 06:29:05,553][106226] Updated weights for policy 0, policy_version 1561832 (0.0007) [2023-12-28 06:29:05,622][106226] Updated weights for policy 0, policy_version 1561842 (0.0005) [2023-12-28 06:29:06,135][106225] Updated weights for policy 1, policy_version 1565403 (0.0007) [2023-12-28 06:29:06,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 800702464. Throughput: 0: 10178.0, 1: 9828.4. Samples: 800716184. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:06,175][105115] Avg episode reward: [(0, '-4.827'), (1, '-4.370')] [2023-12-28 06:29:06,193][106225] Updated weights for policy 1, policy_version 1565413 (0.0007) [2023-12-28 06:29:06,258][106225] Updated weights for policy 1, policy_version 1565423 (0.0007) [2023-12-28 06:29:06,290][106226] Updated weights for policy 0, policy_version 1561852 (0.0008) [2023-12-28 06:29:06,353][106226] Updated weights for policy 0, policy_version 1561862 (0.0011) [2023-12-28 06:29:06,404][106226] Updated weights for policy 0, policy_version 1561872 (0.0010) [2023-12-28 06:29:06,856][106225] Updated weights for policy 1, policy_version 1565433 (0.0008) [2023-12-28 06:29:06,916][106225] Updated weights for policy 1, policy_version 1565443 (0.0005) [2023-12-28 06:29:06,981][106225] Updated weights for policy 1, policy_version 1565453 (0.0006) [2023-12-28 06:29:07,032][106225] Updated weights for policy 1, policy_version 1565463 (0.0005) [2023-12-28 06:29:07,062][106226] Updated weights for policy 0, policy_version 1561882 (0.0010) [2023-12-28 06:29:07,118][106226] Updated weights for policy 0, policy_version 1561892 (0.0005) [2023-12-28 06:29:07,185][106226] Updated weights for policy 0, policy_version 1561902 (0.0006) [2023-12-28 06:29:07,243][106226] Updated weights for policy 0, policy_version 1561912 (0.0007) [2023-12-28 06:29:07,632][106225] Updated weights for policy 1, policy_version 1565473 (0.0007) [2023-12-28 06:29:07,699][106225] Updated weights for policy 1, policy_version 1565483 (0.0008) [2023-12-28 06:29:07,765][106225] Updated weights for policy 1, policy_version 1565493 (0.0009) [2023-12-28 06:29:07,816][106226] Updated weights for policy 0, policy_version 1561922 (0.0009) [2023-12-28 06:29:07,874][106226] Updated weights for policy 0, policy_version 1561932 (0.0009) [2023-12-28 06:29:07,929][106226] Updated weights for policy 0, policy_version 1561942 (0.0008) [2023-12-28 06:29:08,518][106226] Updated weights for policy 0, policy_version 1561952 (0.0008) [2023-12-28 06:29:08,552][106225] Updated weights for policy 1, policy_version 1565503 (0.0006) [2023-12-28 06:29:08,583][106226] Updated weights for policy 0, policy_version 1561962 (0.0008) [2023-12-28 06:29:08,614][106225] Updated weights for policy 1, policy_version 1565513 (0.0007) [2023-12-28 06:29:08,651][106226] Updated weights for policy 0, policy_version 1561972 (0.0008) [2023-12-28 06:29:08,673][106225] Updated weights for policy 1, policy_version 1565523 (0.0007) [2023-12-28 06:29:09,334][106226] Updated weights for policy 0, policy_version 1561982 (0.0008) [2023-12-28 06:29:09,402][106226] Updated weights for policy 0, policy_version 1561992 (0.0009) [2023-12-28 06:29:09,467][106226] Updated weights for policy 0, policy_version 1562002 (0.0008) [2023-12-28 06:29:09,480][106225] Updated weights for policy 1, policy_version 1565533 (0.0008) [2023-12-28 06:29:09,551][106225] Updated weights for policy 1, policy_version 1565543 (0.0009) [2023-12-28 06:29:09,614][106225] Updated weights for policy 1, policy_version 1565553 (0.0006) [2023-12-28 06:29:10,171][106226] Updated weights for policy 0, policy_version 1562012 (0.0009) [2023-12-28 06:29:10,241][106226] Updated weights for policy 0, policy_version 1562022 (0.0008) [2023-12-28 06:29:10,301][106226] Updated weights for policy 0, policy_version 1562032 (0.0009) [2023-12-28 06:29:10,328][106225] Updated weights for policy 1, policy_version 1565563 (0.0006) [2023-12-28 06:29:10,391][106225] Updated weights for policy 1, policy_version 1565573 (0.0008) [2023-12-28 06:29:10,457][106225] Updated weights for policy 1, policy_version 1565583 (0.0010) [2023-12-28 06:29:11,040][106226] Updated weights for policy 0, policy_version 1562042 (0.0008) [2023-12-28 06:29:11,104][106225] Updated weights for policy 1, policy_version 1565593 (0.0008) [2023-12-28 06:29:11,113][106226] Updated weights for policy 0, policy_version 1562052 (0.0008) [2023-12-28 06:29:11,171][106225] Updated weights for policy 1, policy_version 1565603 (0.0008) [2023-12-28 06:29:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 800800768. Throughput: 0: 10240.3, 1: 9838.1. Samples: 800778800. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:11,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.848')] [2023-12-28 06:29:11,181][106226] Updated weights for policy 0, policy_version 1562062 (0.0008) [2023-12-28 06:29:11,240][106225] Updated weights for policy 1, policy_version 1565613 (0.0006) [2023-12-28 06:29:11,242][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001562072_399966208.pth... [2023-12-28 06:29:11,243][106226] Updated weights for policy 0, policy_version 1562072 (0.0009) [2023-12-28 06:29:11,247][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001560856_399654912.pth [2023-12-28 06:29:11,308][106225] Updated weights for policy 1, policy_version 1565623 (0.0006) [2023-12-28 06:29:11,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001565624_400850944.pth... [2023-12-28 06:29:11,317][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001564472_400556032.pth [2023-12-28 06:29:12,010][106225] Updated weights for policy 1, policy_version 1565633 (0.0008) [2023-12-28 06:29:12,072][106225] Updated weights for policy 1, policy_version 1565643 (0.0006) [2023-12-28 06:29:12,074][106226] Updated weights for policy 0, policy_version 1562082 (0.0008) [2023-12-28 06:29:12,131][106225] Updated weights for policy 1, policy_version 1565653 (0.0007) [2023-12-28 06:29:12,133][106226] Updated weights for policy 0, policy_version 1562092 (0.0006) [2023-12-28 06:29:12,190][106226] Updated weights for policy 0, policy_version 1562102 (0.0007) [2023-12-28 06:29:12,833][106226] Updated weights for policy 0, policy_version 1562112 (0.0007) [2023-12-28 06:29:12,893][106226] Updated weights for policy 0, policy_version 1562122 (0.0010) [2023-12-28 06:29:12,939][106225] Updated weights for policy 1, policy_version 1565663 (0.0008) [2023-12-28 06:29:12,952][106226] Updated weights for policy 0, policy_version 1562132 (0.0008) [2023-12-28 06:29:12,991][106225] Updated weights for policy 1, policy_version 1565673 (0.0007) [2023-12-28 06:29:13,054][106225] Updated weights for policy 1, policy_version 1565683 (0.0008) [2023-12-28 06:29:13,584][106226] Updated weights for policy 0, policy_version 1562142 (0.0007) [2023-12-28 06:29:13,632][106226] Updated weights for policy 0, policy_version 1562152 (0.0005) [2023-12-28 06:29:13,678][106225] Updated weights for policy 1, policy_version 1565693 (0.0008) [2023-12-28 06:29:13,683][106226] Updated weights for policy 0, policy_version 1562162 (0.0005) [2023-12-28 06:29:13,724][106225] Updated weights for policy 1, policy_version 1565703 (0.0009) [2023-12-28 06:29:13,770][106225] Updated weights for policy 1, policy_version 1565713 (0.0008) [2023-12-28 06:29:14,282][106226] Updated weights for policy 0, policy_version 1562172 (0.0006) [2023-12-28 06:29:14,332][106226] Updated weights for policy 0, policy_version 1562182 (0.0009) [2023-12-28 06:29:14,380][106226] Updated weights for policy 0, policy_version 1562192 (0.0008) [2023-12-28 06:29:14,495][106225] Updated weights for policy 1, policy_version 1565723 (0.0007) [2023-12-28 06:29:14,545][106225] Updated weights for policy 1, policy_version 1565733 (0.0007) [2023-12-28 06:29:14,601][106225] Updated weights for policy 1, policy_version 1565743 (0.0007) [2023-12-28 06:29:15,146][106226] Updated weights for policy 0, policy_version 1562202 (0.0010) [2023-12-28 06:29:15,197][106226] Updated weights for policy 0, policy_version 1562212 (0.0011) [2023-12-28 06:29:15,252][106226] Updated weights for policy 0, policy_version 1562222 (0.0011) [2023-12-28 06:29:15,310][106226] Updated weights for policy 0, policy_version 1562232 (0.0011) [2023-12-28 06:29:15,369][106225] Updated weights for policy 1, policy_version 1565753 (0.0008) [2023-12-28 06:29:15,430][106225] Updated weights for policy 1, policy_version 1565763 (0.0008) [2023-12-28 06:29:15,495][106225] Updated weights for policy 1, policy_version 1565773 (0.0008) [2023-12-28 06:29:15,552][106225] Updated weights for policy 1, policy_version 1565783 (0.0007) [2023-12-28 06:29:16,060][106226] Updated weights for policy 0, policy_version 1562242 (0.0011) [2023-12-28 06:29:16,123][106226] Updated weights for policy 0, policy_version 1562252 (0.0009) [2023-12-28 06:29:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19910.7). Total num frames: 800899072. Throughput: 0: 10189.9, 1: 9721.2. Samples: 800896040. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:16,175][105115] Avg episode reward: [(0, '-4.929'), (1, '-4.865')] [2023-12-28 06:29:16,184][106226] Updated weights for policy 0, policy_version 1562262 (0.0010) [2023-12-28 06:29:16,303][106225] Updated weights for policy 1, policy_version 1565793 (0.0006) [2023-12-28 06:29:16,368][106225] Updated weights for policy 1, policy_version 1565803 (0.0009) [2023-12-28 06:29:16,421][106225] Updated weights for policy 1, policy_version 1565813 (0.0010) [2023-12-28 06:29:16,835][106226] Updated weights for policy 0, policy_version 1562272 (0.0011) [2023-12-28 06:29:16,883][106226] Updated weights for policy 0, policy_version 1562282 (0.0010) [2023-12-28 06:29:16,932][106226] Updated weights for policy 0, policy_version 1562292 (0.0011) [2023-12-28 06:29:17,120][106225] Updated weights for policy 1, policy_version 1565823 (0.0009) [2023-12-28 06:29:17,184][106225] Updated weights for policy 1, policy_version 1565833 (0.0007) [2023-12-28 06:29:17,242][106225] Updated weights for policy 1, policy_version 1565843 (0.0008) [2023-12-28 06:29:17,692][106226] Updated weights for policy 0, policy_version 1562302 (0.0011) [2023-12-28 06:29:17,753][106226] Updated weights for policy 0, policy_version 1562312 (0.0011) [2023-12-28 06:29:17,805][106226] Updated weights for policy 0, policy_version 1562322 (0.0010) [2023-12-28 06:29:17,982][106225] Updated weights for policy 1, policy_version 1565853 (0.0008) [2023-12-28 06:29:18,043][106225] Updated weights for policy 1, policy_version 1565863 (0.0007) [2023-12-28 06:29:18,107][106225] Updated weights for policy 1, policy_version 1565873 (0.0008) [2023-12-28 06:29:18,509][106226] Updated weights for policy 0, policy_version 1562332 (0.0010) [2023-12-28 06:29:18,565][106226] Updated weights for policy 0, policy_version 1562342 (0.0008) [2023-12-28 06:29:18,619][106226] Updated weights for policy 0, policy_version 1562352 (0.0006) [2023-12-28 06:29:18,873][106225] Updated weights for policy 1, policy_version 1565883 (0.0008) [2023-12-28 06:29:18,925][106225] Updated weights for policy 1, policy_version 1565893 (0.0008) [2023-12-28 06:29:18,979][106225] Updated weights for policy 1, policy_version 1565903 (0.0009) [2023-12-28 06:29:19,280][106226] Updated weights for policy 0, policy_version 1562362 (0.0008) [2023-12-28 06:29:19,344][106226] Updated weights for policy 0, policy_version 1562372 (0.0009) [2023-12-28 06:29:19,405][106226] Updated weights for policy 0, policy_version 1562382 (0.0009) [2023-12-28 06:29:19,454][106226] Updated weights for policy 0, policy_version 1562392 (0.0009) [2023-12-28 06:29:19,718][106225] Updated weights for policy 1, policy_version 1565913 (0.0008) [2023-12-28 06:29:19,785][106225] Updated weights for policy 1, policy_version 1565923 (0.0006) [2023-12-28 06:29:19,850][106225] Updated weights for policy 1, policy_version 1565933 (0.0009) [2023-12-28 06:29:19,925][106225] Updated weights for policy 1, policy_version 1565943 (0.0009) [2023-12-28 06:29:20,325][106226] Updated weights for policy 0, policy_version 1562402 (0.0008) [2023-12-28 06:29:20,385][106226] Updated weights for policy 0, policy_version 1562412 (0.0008) [2023-12-28 06:29:20,448][106226] Updated weights for policy 0, policy_version 1562422 (0.0008) [2023-12-28 06:29:20,633][106225] Updated weights for policy 1, policy_version 1565953 (0.0008) [2023-12-28 06:29:20,699][106225] Updated weights for policy 1, policy_version 1565963 (0.0007) [2023-12-28 06:29:20,753][106225] Updated weights for policy 1, policy_version 1565973 (0.0006) [2023-12-28 06:29:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 800997376. Throughput: 0: 10104.3, 1: 9629.4. Samples: 801009320. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:21,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.827')] [2023-12-28 06:29:21,187][106226] Updated weights for policy 0, policy_version 1562432 (0.0010) [2023-12-28 06:29:21,253][106226] Updated weights for policy 0, policy_version 1562442 (0.0011) [2023-12-28 06:29:21,310][106226] Updated weights for policy 0, policy_version 1562452 (0.0008) [2023-12-28 06:29:21,532][106225] Updated weights for policy 1, policy_version 1565983 (0.0006) [2023-12-28 06:29:21,597][106225] Updated weights for policy 1, policy_version 1565993 (0.0008) [2023-12-28 06:29:21,665][106225] Updated weights for policy 1, policy_version 1566003 (0.0008) [2023-12-28 06:29:22,058][106226] Updated weights for policy 0, policy_version 1562462 (0.0008) [2023-12-28 06:29:22,114][106226] Updated weights for policy 0, policy_version 1562472 (0.0009) [2023-12-28 06:29:22,176][106226] Updated weights for policy 0, policy_version 1562482 (0.0008) [2023-12-28 06:29:22,395][106225] Updated weights for policy 1, policy_version 1566013 (0.0009) [2023-12-28 06:29:22,460][106225] Updated weights for policy 1, policy_version 1566023 (0.0008) [2023-12-28 06:29:22,529][106225] Updated weights for policy 1, policy_version 1566033 (0.0007) [2023-12-28 06:29:22,947][106226] Updated weights for policy 0, policy_version 1562492 (0.0008) [2023-12-28 06:29:23,012][106226] Updated weights for policy 0, policy_version 1562502 (0.0009) [2023-12-28 06:29:23,071][106226] Updated weights for policy 0, policy_version 1562512 (0.0009) [2023-12-28 06:29:23,255][106225] Updated weights for policy 1, policy_version 1566043 (0.0008) [2023-12-28 06:29:23,322][106225] Updated weights for policy 1, policy_version 1566053 (0.0006) [2023-12-28 06:29:23,385][106225] Updated weights for policy 1, policy_version 1566063 (0.0005) [2023-12-28 06:29:23,657][106226] Updated weights for policy 0, policy_version 1562522 (0.0006) [2023-12-28 06:29:23,717][106226] Updated weights for policy 0, policy_version 1562532 (0.0009) [2023-12-28 06:29:23,776][106226] Updated weights for policy 0, policy_version 1562542 (0.0008) [2023-12-28 06:29:23,828][106226] Updated weights for policy 0, policy_version 1562552 (0.0008) [2023-12-28 06:29:24,030][106225] Updated weights for policy 1, policy_version 1566073 (0.0006) [2023-12-28 06:29:24,088][106225] Updated weights for policy 1, policy_version 1566083 (0.0006) [2023-12-28 06:29:24,144][106225] Updated weights for policy 1, policy_version 1566093 (0.0005) [2023-12-28 06:29:24,210][106225] Updated weights for policy 1, policy_version 1566103 (0.0005) [2023-12-28 06:29:24,642][106226] Updated weights for policy 0, policy_version 1562562 (0.0010) [2023-12-28 06:29:24,703][106226] Updated weights for policy 0, policy_version 1562572 (0.0010) [2023-12-28 06:29:24,736][106225] Updated weights for policy 1, policy_version 1566113 (0.0005) [2023-12-28 06:29:24,748][106226] Updated weights for policy 0, policy_version 1562582 (0.0008) [2023-12-28 06:29:24,781][106225] Updated weights for policy 1, policy_version 1566123 (0.0006) [2023-12-28 06:29:24,834][106225] Updated weights for policy 1, policy_version 1566133 (0.0005) [2023-12-28 06:29:25,432][106225] Updated weights for policy 1, policy_version 1566143 (0.0009) [2023-12-28 06:29:25,488][106225] Updated weights for policy 1, policy_version 1566153 (0.0010) [2023-12-28 06:29:25,531][106225] Updated weights for policy 1, policy_version 1566163 (0.0010) [2023-12-28 06:29:25,537][106226] Updated weights for policy 0, policy_version 1562592 (0.0006) [2023-12-28 06:29:25,590][106226] Updated weights for policy 0, policy_version 1562602 (0.0008) [2023-12-28 06:29:25,646][106226] Updated weights for policy 0, policy_version 1562612 (0.0008) [2023-12-28 06:29:26,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 801095680. Throughput: 0: 10062.5, 1: 9615.3. Samples: 801067216. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:26,176][105115] Avg episode reward: [(0, '-4.945'), (1, '-4.821')] [2023-12-28 06:29:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001566168_400990208.pth... [2023-12-28 06:29:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001562616_400105472.pth... [2023-12-28 06:29:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001565048_400703488.pth [2023-12-28 06:29:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001561464_399810560.pth [2023-12-28 06:29:26,265][106225] Updated weights for policy 1, policy_version 1566173 (0.0010) [2023-12-28 06:29:26,314][106225] Updated weights for policy 1, policy_version 1566183 (0.0010) [2023-12-28 06:29:26,363][106226] Updated weights for policy 0, policy_version 1562622 (0.0006) [2023-12-28 06:29:26,371][106225] Updated weights for policy 1, policy_version 1566193 (0.0010) [2023-12-28 06:29:26,418][106226] Updated weights for policy 0, policy_version 1562632 (0.0010) [2023-12-28 06:29:26,475][106226] Updated weights for policy 0, policy_version 1562642 (0.0010) [2023-12-28 06:29:26,975][106225] Updated weights for policy 1, policy_version 1566203 (0.0009) [2023-12-28 06:29:27,023][106225] Updated weights for policy 1, policy_version 1566213 (0.0005) [2023-12-28 06:29:27,080][106225] Updated weights for policy 1, policy_version 1566223 (0.0007) [2023-12-28 06:29:27,118][106226] Updated weights for policy 0, policy_version 1562652 (0.0007) [2023-12-28 06:29:27,175][106226] Updated weights for policy 0, policy_version 1562662 (0.0010) [2023-12-28 06:29:27,228][106226] Updated weights for policy 0, policy_version 1562672 (0.0009) [2023-12-28 06:29:27,710][106225] Updated weights for policy 1, policy_version 1566233 (0.0006) [2023-12-28 06:29:27,767][106225] Updated weights for policy 1, policy_version 1566243 (0.0005) [2023-12-28 06:29:27,812][106225] Updated weights for policy 1, policy_version 1566253 (0.0005) [2023-12-28 06:29:27,872][106225] Updated weights for policy 1, policy_version 1566263 (0.0005) [2023-12-28 06:29:27,945][106226] Updated weights for policy 0, policy_version 1562682 (0.0005) [2023-12-28 06:29:28,006][106226] Updated weights for policy 0, policy_version 1562692 (0.0005) [2023-12-28 06:29:28,061][106226] Updated weights for policy 0, policy_version 1562702 (0.0006) [2023-12-28 06:29:28,110][106226] Updated weights for policy 0, policy_version 1562712 (0.0008) [2023-12-28 06:29:28,418][106225] Updated weights for policy 1, policy_version 1566273 (0.0006) [2023-12-28 06:29:28,482][106225] Updated weights for policy 1, policy_version 1566283 (0.0006) [2023-12-28 06:29:28,542][106225] Updated weights for policy 1, policy_version 1566293 (0.0006) [2023-12-28 06:29:28,824][106226] Updated weights for policy 0, policy_version 1562722 (0.0008) [2023-12-28 06:29:28,871][106226] Updated weights for policy 0, policy_version 1562732 (0.0008) [2023-12-28 06:29:28,926][106226] Updated weights for policy 0, policy_version 1562742 (0.0008) [2023-12-28 06:29:29,112][106225] Updated weights for policy 1, policy_version 1566303 (0.0007) [2023-12-28 06:29:29,163][106225] Updated weights for policy 1, policy_version 1566313 (0.0008) [2023-12-28 06:29:29,227][106225] Updated weights for policy 1, policy_version 1566323 (0.0008) [2023-12-28 06:29:29,726][106226] Updated weights for policy 0, policy_version 1562752 (0.0009) [2023-12-28 06:29:29,776][106226] Updated weights for policy 0, policy_version 1562762 (0.0009) [2023-12-28 06:29:29,849][106226] Updated weights for policy 0, policy_version 1562772 (0.0009) [2023-12-28 06:29:29,870][106225] Updated weights for policy 1, policy_version 1566333 (0.0008) [2023-12-28 06:29:29,937][106225] Updated weights for policy 1, policy_version 1566343 (0.0006) [2023-12-28 06:29:30,009][106225] Updated weights for policy 1, policy_version 1566353 (0.0008) [2023-12-28 06:29:30,504][106226] Updated weights for policy 0, policy_version 1562782 (0.0010) [2023-12-28 06:29:30,566][106226] Updated weights for policy 0, policy_version 1562792 (0.0008) [2023-12-28 06:29:30,627][106226] Updated weights for policy 0, policy_version 1562802 (0.0005) [2023-12-28 06:29:30,678][106225] Updated weights for policy 1, policy_version 1566363 (0.0008) [2023-12-28 06:29:30,728][106225] Updated weights for policy 1, policy_version 1566373 (0.0008) [2023-12-28 06:29:30,774][106225] Updated weights for policy 1, policy_version 1566383 (0.0007) [2023-12-28 06:29:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 801202176. Throughput: 0: 10051.8, 1: 9826.6. Samples: 801191264. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:31,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.665')] [2023-12-28 06:29:31,260][106226] Updated weights for policy 0, policy_version 1562812 (0.0006) [2023-12-28 06:29:31,320][106226] Updated weights for policy 0, policy_version 1562822 (0.0008) [2023-12-28 06:29:31,386][106226] Updated weights for policy 0, policy_version 1562832 (0.0008) [2023-12-28 06:29:31,582][106225] Updated weights for policy 1, policy_version 1566393 (0.0008) [2023-12-28 06:29:31,645][106225] Updated weights for policy 1, policy_version 1566403 (0.0007) [2023-12-28 06:29:31,712][106225] Updated weights for policy 1, policy_version 1566413 (0.0008) [2023-12-28 06:29:31,782][106225] Updated weights for policy 1, policy_version 1566423 (0.0009) [2023-12-28 06:29:32,116][106226] Updated weights for policy 0, policy_version 1562842 (0.0009) [2023-12-28 06:29:32,170][106226] Updated weights for policy 0, policy_version 1562852 (0.0009) [2023-12-28 06:29:32,222][106226] Updated weights for policy 0, policy_version 1562862 (0.0008) [2023-12-28 06:29:32,290][106226] Updated weights for policy 0, policy_version 1562872 (0.0007) [2023-12-28 06:29:32,495][106225] Updated weights for policy 1, policy_version 1566433 (0.0009) [2023-12-28 06:29:32,559][106225] Updated weights for policy 1, policy_version 1566443 (0.0008) [2023-12-28 06:29:32,623][106225] Updated weights for policy 1, policy_version 1566453 (0.0008) [2023-12-28 06:29:32,993][106226] Updated weights for policy 0, policy_version 1562882 (0.0008) [2023-12-28 06:29:33,040][106226] Updated weights for policy 0, policy_version 1562892 (0.0008) [2023-12-28 06:29:33,104][106226] Updated weights for policy 0, policy_version 1562902 (0.0007) [2023-12-28 06:29:33,224][106225] Updated weights for policy 1, policy_version 1566463 (0.0009) [2023-12-28 06:29:33,293][106225] Updated weights for policy 1, policy_version 1566473 (0.0010) [2023-12-28 06:29:33,340][106225] Updated weights for policy 1, policy_version 1566483 (0.0010) [2023-12-28 06:29:33,803][106226] Updated weights for policy 0, policy_version 1562912 (0.0008) [2023-12-28 06:29:33,852][106226] Updated weights for policy 0, policy_version 1562922 (0.0008) [2023-12-28 06:29:33,904][106226] Updated weights for policy 0, policy_version 1562932 (0.0008) [2023-12-28 06:29:34,052][106225] Updated weights for policy 1, policy_version 1566493 (0.0010) [2023-12-28 06:29:34,102][106225] Updated weights for policy 1, policy_version 1566503 (0.0010) [2023-12-28 06:29:34,168][106225] Updated weights for policy 1, policy_version 1566513 (0.0009) [2023-12-28 06:29:34,599][106226] Updated weights for policy 0, policy_version 1562942 (0.0008) [2023-12-28 06:29:34,665][106226] Updated weights for policy 0, policy_version 1562952 (0.0008) [2023-12-28 06:29:34,739][106226] Updated weights for policy 0, policy_version 1562962 (0.0009) [2023-12-28 06:29:34,876][106225] Updated weights for policy 1, policy_version 1566523 (0.0007) [2023-12-28 06:29:34,922][106225] Updated weights for policy 1, policy_version 1566533 (0.0010) [2023-12-28 06:29:34,977][106225] Updated weights for policy 1, policy_version 1566543 (0.0009) [2023-12-28 06:29:35,321][106226] Updated weights for policy 0, policy_version 1562972 (0.0007) [2023-12-28 06:29:35,370][106226] Updated weights for policy 0, policy_version 1562982 (0.0005) [2023-12-28 06:29:35,422][106226] Updated weights for policy 0, policy_version 1562992 (0.0006) [2023-12-28 06:29:35,639][106225] Updated weights for policy 1, policy_version 1566553 (0.0010) [2023-12-28 06:29:35,689][106225] Updated weights for policy 1, policy_version 1566563 (0.0010) [2023-12-28 06:29:35,748][106225] Updated weights for policy 1, policy_version 1566573 (0.0009) [2023-12-28 06:29:35,801][106225] Updated weights for policy 1, policy_version 1566583 (0.0010) [2023-12-28 06:29:36,146][106226] Updated weights for policy 0, policy_version 1563002 (0.0008) [2023-12-28 06:29:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 801300480. Throughput: 0: 10007.4, 1: 9864.4. Samples: 801312628. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:36,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-4.264')] [2023-12-28 06:29:36,202][106226] Updated weights for policy 0, policy_version 1563012 (0.0008) [2023-12-28 06:29:36,269][106226] Updated weights for policy 0, policy_version 1563022 (0.0008) [2023-12-28 06:29:36,339][106226] Updated weights for policy 0, policy_version 1563032 (0.0008) [2023-12-28 06:29:36,509][106225] Updated weights for policy 1, policy_version 1566593 (0.0006) [2023-12-28 06:29:36,570][106225] Updated weights for policy 1, policy_version 1566603 (0.0006) [2023-12-28 06:29:36,628][106225] Updated weights for policy 1, policy_version 1566613 (0.0010) [2023-12-28 06:29:37,060][106226] Updated weights for policy 0, policy_version 1563042 (0.0008) [2023-12-28 06:29:37,123][106226] Updated weights for policy 0, policy_version 1563052 (0.0007) [2023-12-28 06:29:37,174][106226] Updated weights for policy 0, policy_version 1563062 (0.0008) [2023-12-28 06:29:37,269][106225] Updated weights for policy 1, policy_version 1566623 (0.0010) [2023-12-28 06:29:37,333][106225] Updated weights for policy 1, policy_version 1566633 (0.0011) [2023-12-28 06:29:37,397][106225] Updated weights for policy 1, policy_version 1566643 (0.0010) [2023-12-28 06:29:37,921][106226] Updated weights for policy 0, policy_version 1563072 (0.0006) [2023-12-28 06:29:37,975][106226] Updated weights for policy 0, policy_version 1563082 (0.0007) [2023-12-28 06:29:38,038][106226] Updated weights for policy 0, policy_version 1563092 (0.0007) [2023-12-28 06:29:38,083][106225] Updated weights for policy 1, policy_version 1566653 (0.0009) [2023-12-28 06:29:38,133][106225] Updated weights for policy 1, policy_version 1566663 (0.0010) [2023-12-28 06:29:38,178][106225] Updated weights for policy 1, policy_version 1566673 (0.0010) [2023-12-28 06:29:38,613][106226] Updated weights for policy 0, policy_version 1563102 (0.0005) [2023-12-28 06:29:38,681][106226] Updated weights for policy 0, policy_version 1563112 (0.0006) [2023-12-28 06:29:38,747][106226] Updated weights for policy 0, policy_version 1563122 (0.0006) [2023-12-28 06:29:38,970][106225] Updated weights for policy 1, policy_version 1566683 (0.0009) [2023-12-28 06:29:39,023][106225] Updated weights for policy 1, policy_version 1566693 (0.0005) [2023-12-28 06:29:39,082][106225] Updated weights for policy 1, policy_version 1566703 (0.0005) [2023-12-28 06:29:39,517][106226] Updated weights for policy 0, policy_version 1563132 (0.0009) [2023-12-28 06:29:39,577][106226] Updated weights for policy 0, policy_version 1563142 (0.0008) [2023-12-28 06:29:39,636][106226] Updated weights for policy 0, policy_version 1563152 (0.0008) [2023-12-28 06:29:39,746][106225] Updated weights for policy 1, policy_version 1566713 (0.0006) [2023-12-28 06:29:39,808][106225] Updated weights for policy 1, policy_version 1566723 (0.0009) [2023-12-28 06:29:39,875][106225] Updated weights for policy 1, policy_version 1566733 (0.0009) [2023-12-28 06:29:39,935][106225] Updated weights for policy 1, policy_version 1566743 (0.0010) [2023-12-28 06:29:40,378][106226] Updated weights for policy 0, policy_version 1563162 (0.0008) [2023-12-28 06:29:40,433][106226] Updated weights for policy 0, policy_version 1563172 (0.0006) [2023-12-28 06:29:40,484][106226] Updated weights for policy 0, policy_version 1563182 (0.0006) [2023-12-28 06:29:40,543][106226] Updated weights for policy 0, policy_version 1563192 (0.0007) [2023-12-28 06:29:40,699][106225] Updated weights for policy 1, policy_version 1566753 (0.0010) [2023-12-28 06:29:40,760][106225] Updated weights for policy 1, policy_version 1566763 (0.0010) [2023-12-28 06:29:40,811][106225] Updated weights for policy 1, policy_version 1566773 (0.0008) [2023-12-28 06:29:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 801398784. Throughput: 0: 9991.9, 1: 9870.8. Samples: 801372432. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:41,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-4.311')] [2023-12-28 06:29:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001563192_400252928.pth... [2023-12-28 06:29:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001566776_401145856.pth... [2023-12-28 06:29:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001562072_399966208.pth [2023-12-28 06:29:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001565624_400850944.pth [2023-12-28 06:29:41,284][106226] Updated weights for policy 0, policy_version 1563202 (0.0007) [2023-12-28 06:29:41,350][106226] Updated weights for policy 0, policy_version 1563212 (0.0007) [2023-12-28 06:29:41,422][106226] Updated weights for policy 0, policy_version 1563222 (0.0007) [2023-12-28 06:29:41,596][106225] Updated weights for policy 1, policy_version 1566783 (0.0009) [2023-12-28 06:29:41,666][106225] Updated weights for policy 1, policy_version 1566793 (0.0008) [2023-12-28 06:29:41,728][106225] Updated weights for policy 1, policy_version 1566803 (0.0009) [2023-12-28 06:29:42,040][106226] Updated weights for policy 0, policy_version 1563232 (0.0007) [2023-12-28 06:29:42,090][106226] Updated weights for policy 0, policy_version 1563242 (0.0009) [2023-12-28 06:29:42,140][106226] Updated weights for policy 0, policy_version 1563252 (0.0009) [2023-12-28 06:29:42,497][106225] Updated weights for policy 1, policy_version 1566813 (0.0007) [2023-12-28 06:29:42,564][106225] Updated weights for policy 1, policy_version 1566823 (0.0006) [2023-12-28 06:29:42,629][106225] Updated weights for policy 1, policy_version 1566833 (0.0006) [2023-12-28 06:29:42,922][106226] Updated weights for policy 0, policy_version 1563262 (0.0009) [2023-12-28 06:29:42,970][106226] Updated weights for policy 0, policy_version 1563272 (0.0008) [2023-12-28 06:29:43,026][106226] Updated weights for policy 0, policy_version 1563282 (0.0008) [2023-12-28 06:29:43,219][106225] Updated weights for policy 1, policy_version 1566843 (0.0007) [2023-12-28 06:29:43,269][106225] Updated weights for policy 1, policy_version 1566853 (0.0008) [2023-12-28 06:29:43,328][106225] Updated weights for policy 1, policy_version 1566863 (0.0009) [2023-12-28 06:29:43,758][106226] Updated weights for policy 0, policy_version 1563292 (0.0008) [2023-12-28 06:29:43,821][106226] Updated weights for policy 0, policy_version 1563302 (0.0009) [2023-12-28 06:29:43,876][106226] Updated weights for policy 0, policy_version 1563312 (0.0008) [2023-12-28 06:29:44,062][106225] Updated weights for policy 1, policy_version 1566873 (0.0008) [2023-12-28 06:29:44,112][106225] Updated weights for policy 1, policy_version 1566883 (0.0009) [2023-12-28 06:29:44,163][106225] Updated weights for policy 1, policy_version 1566893 (0.0008) [2023-12-28 06:29:44,219][106225] Updated weights for policy 1, policy_version 1566903 (0.0009) [2023-12-28 06:29:44,551][106226] Updated weights for policy 0, policy_version 1563322 (0.0009) [2023-12-28 06:29:44,611][106226] Updated weights for policy 0, policy_version 1563332 (0.0009) [2023-12-28 06:29:44,670][106226] Updated weights for policy 0, policy_version 1563342 (0.0010) [2023-12-28 06:29:44,730][106226] Updated weights for policy 0, policy_version 1563352 (0.0010) [2023-12-28 06:29:44,978][106225] Updated weights for policy 1, policy_version 1566913 (0.0008) [2023-12-28 06:29:45,044][106225] Updated weights for policy 1, policy_version 1566923 (0.0008) [2023-12-28 06:29:45,108][106225] Updated weights for policy 1, policy_version 1566933 (0.0008) [2023-12-28 06:29:45,498][106226] Updated weights for policy 0, policy_version 1563362 (0.0009) [2023-12-28 06:29:45,557][106226] Updated weights for policy 0, policy_version 1563372 (0.0007) [2023-12-28 06:29:45,611][106226] Updated weights for policy 0, policy_version 1563382 (0.0005) [2023-12-28 06:29:45,782][106225] Updated weights for policy 1, policy_version 1566943 (0.0008) [2023-12-28 06:29:45,831][106225] Updated weights for policy 1, policy_version 1566953 (0.0009) [2023-12-28 06:29:45,881][106225] Updated weights for policy 1, policy_version 1566963 (0.0008) [2023-12-28 06:29:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 801497088. Throughput: 0: 9907.2, 1: 9888.8. Samples: 801487500. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:46,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.790')] [2023-12-28 06:29:46,203][106226] Updated weights for policy 0, policy_version 1563392 (0.0005) [2023-12-28 06:29:46,251][106226] Updated weights for policy 0, policy_version 1563402 (0.0005) [2023-12-28 06:29:46,304][106226] Updated weights for policy 0, policy_version 1563412 (0.0005) [2023-12-28 06:29:46,648][106225] Updated weights for policy 1, policy_version 1566973 (0.0007) [2023-12-28 06:29:46,706][106225] Updated weights for policy 1, policy_version 1566983 (0.0006) [2023-12-28 06:29:46,758][106225] Updated weights for policy 1, policy_version 1566993 (0.0009) [2023-12-28 06:29:46,871][106226] Updated weights for policy 0, policy_version 1563422 (0.0006) [2023-12-28 06:29:46,933][106226] Updated weights for policy 0, policy_version 1563432 (0.0009) [2023-12-28 06:29:46,980][106226] Updated weights for policy 0, policy_version 1563442 (0.0006) [2023-12-28 06:29:47,497][106225] Updated weights for policy 1, policy_version 1567003 (0.0007) [2023-12-28 06:29:47,562][106225] Updated weights for policy 1, policy_version 1567013 (0.0007) [2023-12-28 06:29:47,611][106226] Updated weights for policy 0, policy_version 1563452 (0.0006) [2023-12-28 06:29:47,626][106225] Updated weights for policy 1, policy_version 1567023 (0.0009) [2023-12-28 06:29:47,676][106226] Updated weights for policy 0, policy_version 1563462 (0.0008) [2023-12-28 06:29:47,738][106226] Updated weights for policy 0, policy_version 1563472 (0.0009) [2023-12-28 06:29:48,318][106226] Updated weights for policy 0, policy_version 1563482 (0.0006) [2023-12-28 06:29:48,365][106225] Updated weights for policy 1, policy_version 1567033 (0.0007) [2023-12-28 06:29:48,388][106226] Updated weights for policy 0, policy_version 1563492 (0.0008) [2023-12-28 06:29:48,428][106225] Updated weights for policy 1, policy_version 1567043 (0.0007) [2023-12-28 06:29:48,450][106226] Updated weights for policy 0, policy_version 1563502 (0.0008) [2023-12-28 06:29:48,481][106225] Updated weights for policy 1, policy_version 1567053 (0.0008) [2023-12-28 06:29:48,506][106226] Updated weights for policy 0, policy_version 1563512 (0.0008) [2023-12-28 06:29:48,541][106225] Updated weights for policy 1, policy_version 1567063 (0.0007) [2023-12-28 06:29:49,191][106226] Updated weights for policy 0, policy_version 1563522 (0.0009) [2023-12-28 06:29:49,260][106226] Updated weights for policy 0, policy_version 1563532 (0.0009) [2023-12-28 06:29:49,326][106226] Updated weights for policy 0, policy_version 1563542 (0.0007) [2023-12-28 06:29:49,331][106225] Updated weights for policy 1, policy_version 1567073 (0.0008) [2023-12-28 06:29:49,419][106225] Updated weights for policy 1, policy_version 1567083 (0.0007) [2023-12-28 06:29:49,476][106225] Updated weights for policy 1, policy_version 1567093 (0.0008) [2023-12-28 06:29:50,083][106226] Updated weights for policy 0, policy_version 1563552 (0.0009) [2023-12-28 06:29:50,128][106225] Updated weights for policy 1, policy_version 1567103 (0.0008) [2023-12-28 06:29:50,145][106226] Updated weights for policy 0, policy_version 1563562 (0.0006) [2023-12-28 06:29:50,187][106225] Updated weights for policy 1, policy_version 1567113 (0.0007) [2023-12-28 06:29:50,206][106226] Updated weights for policy 0, policy_version 1563572 (0.0006) [2023-12-28 06:29:50,249][106225] Updated weights for policy 1, policy_version 1567123 (0.0008) [2023-12-28 06:29:50,929][106226] Updated weights for policy 0, policy_version 1563582 (0.0008) [2023-12-28 06:29:50,986][106226] Updated weights for policy 0, policy_version 1563592 (0.0009) [2023-12-28 06:29:51,047][106226] Updated weights for policy 0, policy_version 1563602 (0.0009) [2023-12-28 06:29:51,056][106225] Updated weights for policy 1, policy_version 1567133 (0.0009) [2023-12-28 06:29:51,109][106225] Updated weights for policy 1, policy_version 1567143 (0.0009) [2023-12-28 06:29:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 801595392. Throughput: 0: 9894.8, 1: 9891.4. Samples: 801606568. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:51,175][106225] Updated weights for policy 1, policy_version 1567153 (0.0009) [2023-12-28 06:29:51,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.553')] [2023-12-28 06:29:51,901][106226] Updated weights for policy 0, policy_version 1563612 (0.0010) [2023-12-28 06:29:51,952][106225] Updated weights for policy 1, policy_version 1567163 (0.0009) [2023-12-28 06:29:51,968][106226] Updated weights for policy 0, policy_version 1563622 (0.0011) [2023-12-28 06:29:52,012][106225] Updated weights for policy 1, policy_version 1567173 (0.0010) [2023-12-28 06:29:52,029][106226] Updated weights for policy 0, policy_version 1563632 (0.0011) [2023-12-28 06:29:52,075][106225] Updated weights for policy 1, policy_version 1567183 (0.0010) [2023-12-28 06:29:52,733][106225] Updated weights for policy 1, policy_version 1567193 (0.0010) [2023-12-28 06:29:52,764][106226] Updated weights for policy 0, policy_version 1563642 (0.0010) [2023-12-28 06:29:52,792][106225] Updated weights for policy 1, policy_version 1567203 (0.0006) [2023-12-28 06:29:52,819][106226] Updated weights for policy 0, policy_version 1563652 (0.0008) [2023-12-28 06:29:52,845][106225] Updated weights for policy 1, policy_version 1567213 (0.0009) [2023-12-28 06:29:52,882][106226] Updated weights for policy 0, policy_version 1563662 (0.0010) [2023-12-28 06:29:52,910][106225] Updated weights for policy 1, policy_version 1567223 (0.0010) [2023-12-28 06:29:52,944][106226] Updated weights for policy 0, policy_version 1563672 (0.0011) [2023-12-28 06:29:53,500][106225] Updated weights for policy 1, policy_version 1567233 (0.0006) [2023-12-28 06:29:53,555][106225] Updated weights for policy 1, policy_version 1567243 (0.0005) [2023-12-28 06:29:53,618][106225] Updated weights for policy 1, policy_version 1567253 (0.0008) [2023-12-28 06:29:53,671][106226] Updated weights for policy 0, policy_version 1563682 (0.0010) [2023-12-28 06:29:53,731][106226] Updated weights for policy 0, policy_version 1563692 (0.0007) [2023-12-28 06:29:53,785][106226] Updated weights for policy 0, policy_version 1563702 (0.0005) [2023-12-28 06:29:54,299][106225] Updated weights for policy 1, policy_version 1567263 (0.0009) [2023-12-28 06:29:54,367][106225] Updated weights for policy 1, policy_version 1567273 (0.0008) [2023-12-28 06:29:54,429][106225] Updated weights for policy 1, policy_version 1567283 (0.0008) [2023-12-28 06:29:54,458][106226] Updated weights for policy 0, policy_version 1563712 (0.0006) [2023-12-28 06:29:54,523][106226] Updated weights for policy 0, policy_version 1563722 (0.0009) [2023-12-28 06:29:54,585][106226] Updated weights for policy 0, policy_version 1563732 (0.0008) [2023-12-28 06:29:55,071][106225] Updated weights for policy 1, policy_version 1567293 (0.0009) [2023-12-28 06:29:55,131][106225] Updated weights for policy 1, policy_version 1567303 (0.0009) [2023-12-28 06:29:55,161][106226] Updated weights for policy 0, policy_version 1563742 (0.0006) [2023-12-28 06:29:55,188][106225] Updated weights for policy 1, policy_version 1567313 (0.0008) [2023-12-28 06:29:55,219][106226] Updated weights for policy 0, policy_version 1563752 (0.0006) [2023-12-28 06:29:55,286][106226] Updated weights for policy 0, policy_version 1563762 (0.0007) [2023-12-28 06:29:55,738][106225] Updated weights for policy 1, policy_version 1567323 (0.0005) [2023-12-28 06:29:55,804][106225] Updated weights for policy 1, policy_version 1567333 (0.0006) [2023-12-28 06:29:55,865][106225] Updated weights for policy 1, policy_version 1567343 (0.0008) [2023-12-28 06:29:56,001][106226] Updated weights for policy 0, policy_version 1563772 (0.0009) [2023-12-28 06:29:56,063][106226] Updated weights for policy 0, policy_version 1563782 (0.0009) [2023-12-28 06:29:56,121][106226] Updated weights for policy 0, policy_version 1563792 (0.0008) [2023-12-28 06:29:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 801701888. Throughput: 0: 9798.4, 1: 9880.0. Samples: 801664336. Policy #0 lag: (min: 11.0, avg: 19.1, max: 43.0) [2023-12-28 06:29:56,176][105115] Avg episode reward: [(0, '-4.717'), (1, '-4.710')] [2023-12-28 06:29:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001567352_401293312.pth... [2023-12-28 06:29:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001563800_400408576.pth... [2023-12-28 06:29:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001562616_400105472.pth [2023-12-28 06:29:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001566168_400990208.pth [2023-12-28 06:29:56,467][106225] Updated weights for policy 1, policy_version 1567353 (0.0008) [2023-12-28 06:29:56,524][106225] Updated weights for policy 1, policy_version 1567363 (0.0005) [2023-12-28 06:29:56,576][106225] Updated weights for policy 1, policy_version 1567373 (0.0005) [2023-12-28 06:29:56,632][106225] Updated weights for policy 1, policy_version 1567383 (0.0005) [2023-12-28 06:29:56,902][106226] Updated weights for policy 0, policy_version 1563802 (0.0006) [2023-12-28 06:29:56,947][106226] Updated weights for policy 0, policy_version 1563812 (0.0008) [2023-12-28 06:29:56,997][106226] Updated weights for policy 0, policy_version 1563822 (0.0008) [2023-12-28 06:29:57,062][106226] Updated weights for policy 0, policy_version 1563832 (0.0006) [2023-12-28 06:29:57,204][106225] Updated weights for policy 1, policy_version 1567393 (0.0007) [2023-12-28 06:29:57,263][106225] Updated weights for policy 1, policy_version 1567403 (0.0005) [2023-12-28 06:29:57,315][106225] Updated weights for policy 1, policy_version 1567413 (0.0006) [2023-12-28 06:29:57,762][106226] Updated weights for policy 0, policy_version 1563842 (0.0008) [2023-12-28 06:29:57,816][106226] Updated weights for policy 0, policy_version 1563852 (0.0008) [2023-12-28 06:29:57,869][106226] Updated weights for policy 0, policy_version 1563862 (0.0008) [2023-12-28 06:29:57,980][106225] Updated weights for policy 1, policy_version 1567423 (0.0007) [2023-12-28 06:29:58,028][106225] Updated weights for policy 1, policy_version 1567433 (0.0008) [2023-12-28 06:29:58,077][106225] Updated weights for policy 1, policy_version 1567443 (0.0008) [2023-12-28 06:29:58,642][106226] Updated weights for policy 0, policy_version 1563872 (0.0009) [2023-12-28 06:29:58,711][106226] Updated weights for policy 0, policy_version 1563882 (0.0008) [2023-12-28 06:29:58,778][106226] Updated weights for policy 0, policy_version 1563892 (0.0009) [2023-12-28 06:29:58,911][106225] Updated weights for policy 1, policy_version 1567453 (0.0008) [2023-12-28 06:29:58,963][106225] Updated weights for policy 1, policy_version 1567463 (0.0006) [2023-12-28 06:29:59,022][106225] Updated weights for policy 1, policy_version 1567473 (0.0008) [2023-12-28 06:29:59,547][106226] Updated weights for policy 0, policy_version 1563902 (0.0009) [2023-12-28 06:29:59,610][106226] Updated weights for policy 0, policy_version 1563912 (0.0011) [2023-12-28 06:29:59,680][106226] Updated weights for policy 0, policy_version 1563922 (0.0011) [2023-12-28 06:29:59,759][106225] Updated weights for policy 1, policy_version 1567483 (0.0007) [2023-12-28 06:29:59,825][106225] Updated weights for policy 1, policy_version 1567493 (0.0006) [2023-12-28 06:29:59,887][106225] Updated weights for policy 1, policy_version 1567503 (0.0007) [2023-12-28 06:30:00,417][106226] Updated weights for policy 0, policy_version 1563932 (0.0010) [2023-12-28 06:30:00,478][106226] Updated weights for policy 0, policy_version 1563942 (0.0007) [2023-12-28 06:30:00,514][106225] Updated weights for policy 1, policy_version 1567513 (0.0006) [2023-12-28 06:30:00,544][106226] Updated weights for policy 0, policy_version 1563952 (0.0007) [2023-12-28 06:30:00,572][106225] Updated weights for policy 1, policy_version 1567523 (0.0005) [2023-12-28 06:30:00,628][106225] Updated weights for policy 1, policy_version 1567533 (0.0005) [2023-12-28 06:30:00,674][106225] Updated weights for policy 1, policy_version 1567543 (0.0005) [2023-12-28 06:30:01,116][106226] Updated weights for policy 0, policy_version 1563962 (0.0008) [2023-12-28 06:30:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19910.7). Total num frames: 801792000. Throughput: 0: 9764.0, 1: 9967.2. Samples: 801783948. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:01,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.654')] [2023-12-28 06:30:01,184][106226] Updated weights for policy 0, policy_version 1563972 (0.0008) [2023-12-28 06:30:01,247][106226] Updated weights for policy 0, policy_version 1563982 (0.0009) [2023-12-28 06:30:01,298][106225] Updated weights for policy 1, policy_version 1567553 (0.0008) [2023-12-28 06:30:01,307][106226] Updated weights for policy 0, policy_version 1563992 (0.0011) [2023-12-28 06:30:01,360][106225] Updated weights for policy 1, policy_version 1567563 (0.0008) [2023-12-28 06:30:01,418][106225] Updated weights for policy 1, policy_version 1567573 (0.0008) [2023-12-28 06:30:02,102][106226] Updated weights for policy 0, policy_version 1564002 (0.0011) [2023-12-28 06:30:02,162][106226] Updated weights for policy 0, policy_version 1564012 (0.0011) [2023-12-28 06:30:02,191][106225] Updated weights for policy 1, policy_version 1567583 (0.0008) [2023-12-28 06:30:02,212][106226] Updated weights for policy 0, policy_version 1564022 (0.0010) [2023-12-28 06:30:02,236][106225] Updated weights for policy 1, policy_version 1567593 (0.0006) [2023-12-28 06:30:02,292][106225] Updated weights for policy 1, policy_version 1567603 (0.0008) [2023-12-28 06:30:02,864][106226] Updated weights for policy 0, policy_version 1564032 (0.0010) [2023-12-28 06:30:02,928][106226] Updated weights for policy 0, policy_version 1564042 (0.0008) [2023-12-28 06:30:02,974][106226] Updated weights for policy 0, policy_version 1564052 (0.0005) [2023-12-28 06:30:03,092][106225] Updated weights for policy 1, policy_version 1567613 (0.0008) [2023-12-28 06:30:03,138][106225] Updated weights for policy 1, policy_version 1567623 (0.0008) [2023-12-28 06:30:03,188][106225] Updated weights for policy 1, policy_version 1567633 (0.0008) [2023-12-28 06:30:03,667][106226] Updated weights for policy 0, policy_version 1564062 (0.0005) [2023-12-28 06:30:03,730][106226] Updated weights for policy 0, policy_version 1564072 (0.0006) [2023-12-28 06:30:03,785][106226] Updated weights for policy 0, policy_version 1564082 (0.0010) [2023-12-28 06:30:03,818][106225] Updated weights for policy 1, policy_version 1567643 (0.0007) [2023-12-28 06:30:03,886][106225] Updated weights for policy 1, policy_version 1567653 (0.0008) [2023-12-28 06:30:03,950][106225] Updated weights for policy 1, policy_version 1567663 (0.0008) [2023-12-28 06:30:04,454][106226] Updated weights for policy 0, policy_version 1564092 (0.0010) [2023-12-28 06:30:04,518][106226] Updated weights for policy 0, policy_version 1564102 (0.0010) [2023-12-28 06:30:04,574][106226] Updated weights for policy 0, policy_version 1564112 (0.0010) [2023-12-28 06:30:04,627][106225] Updated weights for policy 1, policy_version 1567673 (0.0008) [2023-12-28 06:30:04,674][106225] Updated weights for policy 1, policy_version 1567683 (0.0008) [2023-12-28 06:30:04,727][106225] Updated weights for policy 1, policy_version 1567693 (0.0007) [2023-12-28 06:30:04,781][106225] Updated weights for policy 1, policy_version 1567703 (0.0007) [2023-12-28 06:30:05,275][106226] Updated weights for policy 0, policy_version 1564122 (0.0010) [2023-12-28 06:30:05,330][106226] Updated weights for policy 0, policy_version 1564132 (0.0010) [2023-12-28 06:30:05,389][106226] Updated weights for policy 0, policy_version 1564142 (0.0010) [2023-12-28 06:30:05,438][106226] Updated weights for policy 0, policy_version 1564152 (0.0010) [2023-12-28 06:30:05,502][106225] Updated weights for policy 1, policy_version 1567713 (0.0008) [2023-12-28 06:30:05,565][106225] Updated weights for policy 1, policy_version 1567723 (0.0010) [2023-12-28 06:30:05,611][106225] Updated weights for policy 1, policy_version 1567733 (0.0010) [2023-12-28 06:30:06,039][106226] Updated weights for policy 0, policy_version 1564162 (0.0009) [2023-12-28 06:30:06,100][106226] Updated weights for policy 0, policy_version 1564172 (0.0009) [2023-12-28 06:30:06,174][106226] Updated weights for policy 0, policy_version 1564183 (0.0007) [2023-12-28 06:30:06,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 801890304. Throughput: 0: 9860.2, 1: 10052.4. Samples: 801905384. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:06,175][105115] Avg episode reward: [(0, '-4.751'), (1, '-4.732')] [2023-12-28 06:30:06,370][106225] Updated weights for policy 1, policy_version 1567743 (0.0010) [2023-12-28 06:30:06,432][106225] Updated weights for policy 1, policy_version 1567753 (0.0008) [2023-12-28 06:30:06,500][106225] Updated weights for policy 1, policy_version 1567763 (0.0006) [2023-12-28 06:30:06,887][106226] Updated weights for policy 0, policy_version 1564193 (0.0010) [2023-12-28 06:30:06,949][106226] Updated weights for policy 0, policy_version 1564203 (0.0011) [2023-12-28 06:30:07,002][106226] Updated weights for policy 0, policy_version 1564213 (0.0010) [2023-12-28 06:30:07,093][106225] Updated weights for policy 1, policy_version 1567773 (0.0006) [2023-12-28 06:30:07,152][106225] Updated weights for policy 1, policy_version 1567783 (0.0006) [2023-12-28 06:30:07,227][106225] Updated weights for policy 1, policy_version 1567793 (0.0008) [2023-12-28 06:30:07,630][106226] Updated weights for policy 0, policy_version 1564223 (0.0007) [2023-12-28 06:30:07,700][106226] Updated weights for policy 0, policy_version 1564233 (0.0005) [2023-12-28 06:30:07,761][106226] Updated weights for policy 0, policy_version 1564243 (0.0005) [2023-12-28 06:30:07,804][106225] Updated weights for policy 1, policy_version 1567803 (0.0010) [2023-12-28 06:30:07,853][106225] Updated weights for policy 1, policy_version 1567813 (0.0008) [2023-12-28 06:30:07,906][106225] Updated weights for policy 1, policy_version 1567823 (0.0009) [2023-12-28 06:30:08,322][106226] Updated weights for policy 0, policy_version 1564253 (0.0007) [2023-12-28 06:30:08,387][106226] Updated weights for policy 0, policy_version 1564263 (0.0008) [2023-12-28 06:30:08,450][106226] Updated weights for policy 0, policy_version 1564273 (0.0007) [2023-12-28 06:30:08,640][106225] Updated weights for policy 1, policy_version 1567833 (0.0006) [2023-12-28 06:30:08,693][106225] Updated weights for policy 1, policy_version 1567843 (0.0008) [2023-12-28 06:30:08,753][106225] Updated weights for policy 1, policy_version 1567853 (0.0009) [2023-12-28 06:30:08,818][106225] Updated weights for policy 1, policy_version 1567863 (0.0009) [2023-12-28 06:30:09,129][106226] Updated weights for policy 0, policy_version 1564283 (0.0006) [2023-12-28 06:30:09,194][106226] Updated weights for policy 0, policy_version 1564293 (0.0006) [2023-12-28 06:30:09,262][106226] Updated weights for policy 0, policy_version 1564303 (0.0009) [2023-12-28 06:30:09,631][106225] Updated weights for policy 1, policy_version 1567873 (0.0008) [2023-12-28 06:30:09,686][106225] Updated weights for policy 1, policy_version 1567883 (0.0008) [2023-12-28 06:30:09,747][106225] Updated weights for policy 1, policy_version 1567893 (0.0008) [2023-12-28 06:30:09,994][106226] Updated weights for policy 0, policy_version 1564313 (0.0008) [2023-12-28 06:30:10,063][106226] Updated weights for policy 0, policy_version 1564323 (0.0008) [2023-12-28 06:30:10,131][106226] Updated weights for policy 0, policy_version 1564333 (0.0009) [2023-12-28 06:30:10,202][106226] Updated weights for policy 0, policy_version 1564343 (0.0009) [2023-12-28 06:30:10,530][106225] Updated weights for policy 1, policy_version 1567903 (0.0007) [2023-12-28 06:30:10,590][106225] Updated weights for policy 1, policy_version 1567913 (0.0007) [2023-12-28 06:30:10,655][106225] Updated weights for policy 1, policy_version 1567923 (0.0006) [2023-12-28 06:30:10,903][106226] Updated weights for policy 0, policy_version 1564353 (0.0010) [2023-12-28 06:30:10,962][106226] Updated weights for policy 0, policy_version 1564363 (0.0009) [2023-12-28 06:30:11,023][106226] Updated weights for policy 0, policy_version 1564373 (0.0008) [2023-12-28 06:30:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 801996800. Throughput: 0: 9916.7, 1: 10103.0. Samples: 801968096. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:11,175][105115] Avg episode reward: [(0, '-4.912'), (1, '-4.461')] [2023-12-28 06:30:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001567928_401440768.pth... [2023-12-28 06:30:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001564376_400556032.pth... [2023-12-28 06:30:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001566776_401145856.pth [2023-12-28 06:30:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001563192_400252928.pth [2023-12-28 06:30:11,462][106225] Updated weights for policy 1, policy_version 1567933 (0.0006) [2023-12-28 06:30:11,529][106225] Updated weights for policy 1, policy_version 1567943 (0.0008) [2023-12-28 06:30:11,585][106225] Updated weights for policy 1, policy_version 1567953 (0.0009) [2023-12-28 06:30:11,819][106226] Updated weights for policy 0, policy_version 1564383 (0.0009) [2023-12-28 06:30:11,879][106226] Updated weights for policy 0, policy_version 1564393 (0.0006) [2023-12-28 06:30:11,942][106226] Updated weights for policy 0, policy_version 1564403 (0.0006) [2023-12-28 06:30:12,363][106225] Updated weights for policy 1, policy_version 1567963 (0.0009) [2023-12-28 06:30:12,430][106225] Updated weights for policy 1, policy_version 1567973 (0.0008) [2023-12-28 06:30:12,493][106225] Updated weights for policy 1, policy_version 1567983 (0.0008) [2023-12-28 06:30:12,648][106226] Updated weights for policy 0, policy_version 1564413 (0.0008) [2023-12-28 06:30:12,709][106226] Updated weights for policy 0, policy_version 1564423 (0.0007) [2023-12-28 06:30:12,779][106226] Updated weights for policy 0, policy_version 1564433 (0.0007) [2023-12-28 06:30:13,244][106225] Updated weights for policy 1, policy_version 1567993 (0.0008) [2023-12-28 06:30:13,294][106225] Updated weights for policy 1, policy_version 1568003 (0.0005) [2023-12-28 06:30:13,347][106225] Updated weights for policy 1, policy_version 1568013 (0.0008) [2023-12-28 06:30:13,404][106225] Updated weights for policy 1, policy_version 1568023 (0.0007) [2023-12-28 06:30:13,449][106226] Updated weights for policy 0, policy_version 1564443 (0.0009) [2023-12-28 06:30:13,516][106226] Updated weights for policy 0, policy_version 1564453 (0.0010) [2023-12-28 06:30:13,578][106226] Updated weights for policy 0, policy_version 1564463 (0.0010) [2023-12-28 06:30:13,998][106225] Updated weights for policy 1, policy_version 1568033 (0.0007) [2023-12-28 06:30:14,064][106225] Updated weights for policy 1, policy_version 1568043 (0.0007) [2023-12-28 06:30:14,124][106225] Updated weights for policy 1, policy_version 1568053 (0.0006) [2023-12-28 06:30:14,233][106226] Updated weights for policy 0, policy_version 1564473 (0.0008) [2023-12-28 06:30:14,291][106226] Updated weights for policy 0, policy_version 1564483 (0.0007) [2023-12-28 06:30:14,350][106226] Updated weights for policy 0, policy_version 1564493 (0.0009) [2023-12-28 06:30:14,418][106226] Updated weights for policy 0, policy_version 1564503 (0.0011) [2023-12-28 06:30:14,717][106225] Updated weights for policy 1, policy_version 1568063 (0.0007) [2023-12-28 06:30:14,790][106225] Updated weights for policy 1, policy_version 1568073 (0.0007) [2023-12-28 06:30:14,859][106225] Updated weights for policy 1, policy_version 1568083 (0.0008) [2023-12-28 06:30:15,187][106226] Updated weights for policy 0, policy_version 1564513 (0.0010) [2023-12-28 06:30:15,253][106226] Updated weights for policy 0, policy_version 1564523 (0.0010) [2023-12-28 06:30:15,322][106226] Updated weights for policy 0, policy_version 1564533 (0.0011) [2023-12-28 06:30:15,602][106225] Updated weights for policy 1, policy_version 1568093 (0.0008) [2023-12-28 06:30:15,652][106225] Updated weights for policy 1, policy_version 1568103 (0.0008) [2023-12-28 06:30:15,707][106225] Updated weights for policy 1, policy_version 1568113 (0.0008) [2023-12-28 06:30:16,001][106226] Updated weights for policy 0, policy_version 1564543 (0.0008) [2023-12-28 06:30:16,060][106226] Updated weights for policy 0, policy_version 1564553 (0.0006) [2023-12-28 06:30:16,122][106226] Updated weights for policy 0, policy_version 1564563 (0.0008) [2023-12-28 06:30:16,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 802095104. Throughput: 0: 9916.6, 1: 9876.9. Samples: 802081972. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:16,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.753')] [2023-12-28 06:30:16,493][106225] Updated weights for policy 1, policy_version 1568123 (0.0009) [2023-12-28 06:30:16,552][106225] Updated weights for policy 1, policy_version 1568133 (0.0009) [2023-12-28 06:30:16,609][106225] Updated weights for policy 1, policy_version 1568143 (0.0008) [2023-12-28 06:30:16,768][106226] Updated weights for policy 0, policy_version 1564573 (0.0009) [2023-12-28 06:30:16,818][106226] Updated weights for policy 0, policy_version 1564583 (0.0007) [2023-12-28 06:30:16,873][106226] Updated weights for policy 0, policy_version 1564593 (0.0006) [2023-12-28 06:30:17,378][106225] Updated weights for policy 1, policy_version 1568153 (0.0008) [2023-12-28 06:30:17,439][106225] Updated weights for policy 1, policy_version 1568163 (0.0007) [2023-12-28 06:30:17,502][106225] Updated weights for policy 1, policy_version 1568173 (0.0006) [2023-12-28 06:30:17,543][106226] Updated weights for policy 0, policy_version 1564603 (0.0005) [2023-12-28 06:30:17,557][106225] Updated weights for policy 1, policy_version 1568183 (0.0008) [2023-12-28 06:30:17,603][106226] Updated weights for policy 0, policy_version 1564613 (0.0009) [2023-12-28 06:30:17,650][106226] Updated weights for policy 0, policy_version 1564623 (0.0008) [2023-12-28 06:30:18,287][106225] Updated weights for policy 1, policy_version 1568193 (0.0008) [2023-12-28 06:30:18,355][106226] Updated weights for policy 0, policy_version 1564633 (0.0008) [2023-12-28 06:30:18,363][106225] Updated weights for policy 1, policy_version 1568203 (0.0009) [2023-12-28 06:30:18,414][106226] Updated weights for policy 0, policy_version 1564643 (0.0009) [2023-12-28 06:30:18,430][106225] Updated weights for policy 1, policy_version 1568213 (0.0009) [2023-12-28 06:30:18,487][106226] Updated weights for policy 0, policy_version 1564653 (0.0007) [2023-12-28 06:30:18,542][106226] Updated weights for policy 0, policy_version 1564663 (0.0008) [2023-12-28 06:30:19,185][106225] Updated weights for policy 1, policy_version 1568223 (0.0007) [2023-12-28 06:30:19,250][106225] Updated weights for policy 1, policy_version 1568233 (0.0008) [2023-12-28 06:30:19,269][106226] Updated weights for policy 0, policy_version 1564673 (0.0009) [2023-12-28 06:30:19,313][106225] Updated weights for policy 1, policy_version 1568243 (0.0008) [2023-12-28 06:30:19,335][106226] Updated weights for policy 0, policy_version 1564683 (0.0010) [2023-12-28 06:30:19,405][106226] Updated weights for policy 0, policy_version 1564693 (0.0011) [2023-12-28 06:30:20,177][106225] Updated weights for policy 1, policy_version 1568253 (0.0007) [2023-12-28 06:30:20,185][106226] Updated weights for policy 0, policy_version 1564703 (0.0009) [2023-12-28 06:30:20,233][106225] Updated weights for policy 1, policy_version 1568263 (0.0007) [2023-12-28 06:30:20,254][106226] Updated weights for policy 0, policy_version 1564713 (0.0008) [2023-12-28 06:30:20,292][106225] Updated weights for policy 1, policy_version 1568273 (0.0008) [2023-12-28 06:30:20,321][106226] Updated weights for policy 0, policy_version 1564723 (0.0006) [2023-12-28 06:30:20,981][106226] Updated weights for policy 0, policy_version 1564733 (0.0009) [2023-12-28 06:30:20,988][106225] Updated weights for policy 1, policy_version 1568283 (0.0008) [2023-12-28 06:30:21,042][106226] Updated weights for policy 0, policy_version 1564743 (0.0010) [2023-12-28 06:30:21,063][106225] Updated weights for policy 1, policy_version 1568293 (0.0009) [2023-12-28 06:30:21,128][106226] Updated weights for policy 0, policy_version 1564753 (0.0010) [2023-12-28 06:30:21,137][106225] Updated weights for policy 1, policy_version 1568303 (0.0008) [2023-12-28 06:30:21,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 802177024. Throughput: 0: 9856.3, 1: 9757.0. Samples: 802195228. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:21,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.634')] [2023-12-28 06:30:21,860][106226] Updated weights for policy 0, policy_version 1564763 (0.0009) [2023-12-28 06:30:21,927][106226] Updated weights for policy 0, policy_version 1564773 (0.0008) [2023-12-28 06:30:21,969][106225] Updated weights for policy 1, policy_version 1568313 (0.0008) [2023-12-28 06:30:21,992][106226] Updated weights for policy 0, policy_version 1564783 (0.0007) [2023-12-28 06:30:22,028][106225] Updated weights for policy 1, policy_version 1568323 (0.0007) [2023-12-28 06:30:22,083][106225] Updated weights for policy 1, policy_version 1568333 (0.0006) [2023-12-28 06:30:22,139][106225] Updated weights for policy 1, policy_version 1568343 (0.0009) [2023-12-28 06:30:22,684][106226] Updated weights for policy 0, policy_version 1564793 (0.0006) [2023-12-28 06:30:22,752][106226] Updated weights for policy 0, policy_version 1564803 (0.0009) [2023-12-28 06:30:22,812][106226] Updated weights for policy 0, policy_version 1564813 (0.0009) [2023-12-28 06:30:22,883][106225] Updated weights for policy 1, policy_version 1568353 (0.0007) [2023-12-28 06:30:22,892][106226] Updated weights for policy 0, policy_version 1564823 (0.0008) [2023-12-28 06:30:22,944][106225] Updated weights for policy 1, policy_version 1568363 (0.0008) [2023-12-28 06:30:23,001][106225] Updated weights for policy 1, policy_version 1568373 (0.0009) [2023-12-28 06:30:23,542][106226] Updated weights for policy 0, policy_version 1564833 (0.0006) [2023-12-28 06:30:23,612][106226] Updated weights for policy 0, policy_version 1564843 (0.0006) [2023-12-28 06:30:23,679][106226] Updated weights for policy 0, policy_version 1564853 (0.0006) [2023-12-28 06:30:23,741][106225] Updated weights for policy 1, policy_version 1568383 (0.0006) [2023-12-28 06:30:23,799][106225] Updated weights for policy 1, policy_version 1568393 (0.0006) [2023-12-28 06:30:23,858][106225] Updated weights for policy 1, policy_version 1568403 (0.0007) [2023-12-28 06:30:24,295][106226] Updated weights for policy 0, policy_version 1564863 (0.0005) [2023-12-28 06:30:24,358][106226] Updated weights for policy 0, policy_version 1564873 (0.0007) [2023-12-28 06:30:24,388][106225] Updated weights for policy 1, policy_version 1568413 (0.0005) [2023-12-28 06:30:24,414][106226] Updated weights for policy 0, policy_version 1564883 (0.0007) [2023-12-28 06:30:24,442][106225] Updated weights for policy 1, policy_version 1568423 (0.0005) [2023-12-28 06:30:24,504][106225] Updated weights for policy 1, policy_version 1568433 (0.0008) [2023-12-28 06:30:25,049][106226] Updated weights for policy 0, policy_version 1564893 (0.0007) [2023-12-28 06:30:25,120][106226] Updated weights for policy 0, policy_version 1564903 (0.0006) [2023-12-28 06:30:25,168][106225] Updated weights for policy 1, policy_version 1568443 (0.0008) [2023-12-28 06:30:25,182][106226] Updated weights for policy 0, policy_version 1564913 (0.0006) [2023-12-28 06:30:25,234][106225] Updated weights for policy 1, policy_version 1568453 (0.0005) [2023-12-28 06:30:25,293][106225] Updated weights for policy 1, policy_version 1568463 (0.0007) [2023-12-28 06:30:25,731][106226] Updated weights for policy 0, policy_version 1564923 (0.0007) [2023-12-28 06:30:25,784][106226] Updated weights for policy 0, policy_version 1564933 (0.0010) [2023-12-28 06:30:25,800][106225] Updated weights for policy 1, policy_version 1568473 (0.0005) [2023-12-28 06:30:25,834][106226] Updated weights for policy 0, policy_version 1564943 (0.0010) [2023-12-28 06:30:25,868][106225] Updated weights for policy 1, policy_version 1568483 (0.0006) [2023-12-28 06:30:25,924][106225] Updated weights for policy 1, policy_version 1568493 (0.0009) [2023-12-28 06:30:25,974][106225] Updated weights for policy 1, policy_version 1568503 (0.0007) [2023-12-28 06:30:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 802291712. Throughput: 0: 9865.7, 1: 9700.2. Samples: 802252900. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:26,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-4.774')] [2023-12-28 06:30:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001564952_400703488.pth... [2023-12-28 06:30:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001568504_401588224.pth... [2023-12-28 06:30:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001567352_401293312.pth [2023-12-28 06:30:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001563800_400408576.pth [2023-12-28 06:30:26,538][106226] Updated weights for policy 0, policy_version 1564953 (0.0010) [2023-12-28 06:30:26,586][106226] Updated weights for policy 0, policy_version 1564963 (0.0008) [2023-12-28 06:30:26,633][106226] Updated weights for policy 0, policy_version 1564973 (0.0008) [2023-12-28 06:30:26,685][106225] Updated weights for policy 1, policy_version 1568513 (0.0006) [2023-12-28 06:30:26,691][106226] Updated weights for policy 0, policy_version 1564983 (0.0007) [2023-12-28 06:30:26,740][106225] Updated weights for policy 1, policy_version 1568523 (0.0007) [2023-12-28 06:30:26,802][106225] Updated weights for policy 1, policy_version 1568533 (0.0009) [2023-12-28 06:30:27,294][106226] Updated weights for policy 0, policy_version 1564993 (0.0005) [2023-12-28 06:30:27,352][106226] Updated weights for policy 0, policy_version 1565003 (0.0006) [2023-12-28 06:30:27,417][106226] Updated weights for policy 0, policy_version 1565013 (0.0005) [2023-12-28 06:30:27,441][106225] Updated weights for policy 1, policy_version 1568543 (0.0008) [2023-12-28 06:30:27,487][106225] Updated weights for policy 1, policy_version 1568553 (0.0005) [2023-12-28 06:30:27,537][106225] Updated weights for policy 1, policy_version 1568563 (0.0005) [2023-12-28 06:30:28,012][106226] Updated weights for policy 0, policy_version 1565023 (0.0007) [2023-12-28 06:30:28,060][106226] Updated weights for policy 0, policy_version 1565033 (0.0005) [2023-12-28 06:30:28,069][106225] Updated weights for policy 1, policy_version 1568573 (0.0005) [2023-12-28 06:30:28,118][106226] Updated weights for policy 0, policy_version 1565043 (0.0005) [2023-12-28 06:30:28,130][106225] Updated weights for policy 1, policy_version 1568583 (0.0008) [2023-12-28 06:30:28,185][106225] Updated weights for policy 1, policy_version 1568593 (0.0008) [2023-12-28 06:30:28,809][106226] Updated weights for policy 0, policy_version 1565053 (0.0008) [2023-12-28 06:30:28,871][106226] Updated weights for policy 0, policy_version 1565063 (0.0011) [2023-12-28 06:30:28,898][106225] Updated weights for policy 1, policy_version 1568603 (0.0009) [2023-12-28 06:30:28,928][106226] Updated weights for policy 0, policy_version 1565073 (0.0011) [2023-12-28 06:30:28,953][106225] Updated weights for policy 1, policy_version 1568613 (0.0006) [2023-12-28 06:30:29,010][106225] Updated weights for policy 1, policy_version 1568623 (0.0008) [2023-12-28 06:30:29,631][106226] Updated weights for policy 0, policy_version 1565083 (0.0010) [2023-12-28 06:30:29,675][106225] Updated weights for policy 1, policy_version 1568633 (0.0007) [2023-12-28 06:30:29,690][106226] Updated weights for policy 0, policy_version 1565093 (0.0005) [2023-12-28 06:30:29,723][106225] Updated weights for policy 1, policy_version 1568643 (0.0008) [2023-12-28 06:30:29,746][106226] Updated weights for policy 0, policy_version 1565103 (0.0005) [2023-12-28 06:30:29,772][106225] Updated weights for policy 1, policy_version 1568653 (0.0008) [2023-12-28 06:30:29,820][106225] Updated weights for policy 1, policy_version 1568663 (0.0007) [2023-12-28 06:30:30,416][106226] Updated weights for policy 0, policy_version 1565113 (0.0007) [2023-12-28 06:30:30,487][106226] Updated weights for policy 0, policy_version 1565123 (0.0011) [2023-12-28 06:30:30,554][106226] Updated weights for policy 0, policy_version 1565133 (0.0011) [2023-12-28 06:30:30,581][106225] Updated weights for policy 1, policy_version 1568673 (0.0009) [2023-12-28 06:30:30,608][106226] Updated weights for policy 0, policy_version 1565143 (0.0010) [2023-12-28 06:30:30,637][106225] Updated weights for policy 1, policy_version 1568683 (0.0009) [2023-12-28 06:30:30,694][106225] Updated weights for policy 1, policy_version 1568693 (0.0009) [2023-12-28 06:30:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 802390016. Throughput: 0: 10004.7, 1: 9877.6. Samples: 802382204. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:31,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.461')] [2023-12-28 06:30:31,192][106226] Updated weights for policy 0, policy_version 1565153 (0.0011) [2023-12-28 06:30:31,254][106226] Updated weights for policy 0, policy_version 1565163 (0.0007) [2023-12-28 06:30:31,315][106226] Updated weights for policy 0, policy_version 1565173 (0.0009) [2023-12-28 06:30:31,510][106225] Updated weights for policy 1, policy_version 1568703 (0.0009) [2023-12-28 06:30:31,568][106225] Updated weights for policy 1, policy_version 1568713 (0.0010) [2023-12-28 06:30:31,624][106225] Updated weights for policy 1, policy_version 1568723 (0.0008) [2023-12-28 06:30:31,967][106226] Updated weights for policy 0, policy_version 1565183 (0.0009) [2023-12-28 06:30:32,030][106226] Updated weights for policy 0, policy_version 1565193 (0.0006) [2023-12-28 06:30:32,091][106226] Updated weights for policy 0, policy_version 1565203 (0.0005) [2023-12-28 06:30:32,450][106225] Updated weights for policy 1, policy_version 1568733 (0.0008) [2023-12-28 06:30:32,499][106225] Updated weights for policy 1, policy_version 1568743 (0.0008) [2023-12-28 06:30:32,556][106225] Updated weights for policy 1, policy_version 1568753 (0.0008) [2023-12-28 06:30:32,753][106226] Updated weights for policy 0, policy_version 1565213 (0.0005) [2023-12-28 06:30:32,802][106226] Updated weights for policy 0, policy_version 1565223 (0.0008) [2023-12-28 06:30:32,847][106226] Updated weights for policy 0, policy_version 1565233 (0.0008) [2023-12-28 06:30:33,241][106225] Updated weights for policy 1, policy_version 1568763 (0.0009) [2023-12-28 06:30:33,292][106225] Updated weights for policy 1, policy_version 1568773 (0.0008) [2023-12-28 06:30:33,350][106225] Updated weights for policy 1, policy_version 1568783 (0.0006) [2023-12-28 06:30:33,581][106226] Updated weights for policy 0, policy_version 1565243 (0.0008) [2023-12-28 06:30:33,626][106226] Updated weights for policy 0, policy_version 1565253 (0.0007) [2023-12-28 06:30:33,672][106226] Updated weights for policy 0, policy_version 1565263 (0.0005) [2023-12-28 06:30:34,080][106225] Updated weights for policy 1, policy_version 1568793 (0.0007) [2023-12-28 06:30:34,140][106225] Updated weights for policy 1, policy_version 1568803 (0.0008) [2023-12-28 06:30:34,200][106225] Updated weights for policy 1, policy_version 1568813 (0.0009) [2023-12-28 06:30:34,255][106225] Updated weights for policy 1, policy_version 1568823 (0.0008) [2023-12-28 06:30:34,298][106226] Updated weights for policy 0, policy_version 1565273 (0.0006) [2023-12-28 06:30:34,358][106226] Updated weights for policy 0, policy_version 1565283 (0.0009) [2023-12-28 06:30:34,407][106226] Updated weights for policy 0, policy_version 1565293 (0.0009) [2023-12-28 06:30:34,466][106226] Updated weights for policy 0, policy_version 1565303 (0.0008) [2023-12-28 06:30:34,987][106225] Updated weights for policy 1, policy_version 1568833 (0.0006) [2023-12-28 06:30:35,043][106225] Updated weights for policy 1, policy_version 1568843 (0.0005) [2023-12-28 06:30:35,108][106225] Updated weights for policy 1, policy_version 1568853 (0.0007) [2023-12-28 06:30:35,180][106226] Updated weights for policy 0, policy_version 1565313 (0.0006) [2023-12-28 06:30:35,236][106226] Updated weights for policy 0, policy_version 1565323 (0.0007) [2023-12-28 06:30:35,289][106226] Updated weights for policy 0, policy_version 1565333 (0.0006) [2023-12-28 06:30:35,791][106225] Updated weights for policy 1, policy_version 1568863 (0.0007) [2023-12-28 06:30:35,857][106225] Updated weights for policy 1, policy_version 1568873 (0.0010) [2023-12-28 06:30:35,917][106225] Updated weights for policy 1, policy_version 1568883 (0.0010) [2023-12-28 06:30:35,942][106226] Updated weights for policy 0, policy_version 1565343 (0.0007) [2023-12-28 06:30:35,999][106226] Updated weights for policy 0, policy_version 1565353 (0.0008) [2023-12-28 06:30:36,061][106226] Updated weights for policy 0, policy_version 1565363 (0.0008) [2023-12-28 06:30:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 802496512. Throughput: 0: 10023.2, 1: 9863.4. Samples: 802501464. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:36,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.740')] [2023-12-28 06:30:36,651][106225] Updated weights for policy 1, policy_version 1568893 (0.0010) [2023-12-28 06:30:36,709][106225] Updated weights for policy 1, policy_version 1568903 (0.0011) [2023-12-28 06:30:36,765][106226] Updated weights for policy 0, policy_version 1565373 (0.0007) [2023-12-28 06:30:36,767][106225] Updated weights for policy 1, policy_version 1568913 (0.0011) [2023-12-28 06:30:36,820][106226] Updated weights for policy 0, policy_version 1565383 (0.0006) [2023-12-28 06:30:36,878][106226] Updated weights for policy 0, policy_version 1565393 (0.0008) [2023-12-28 06:30:37,477][106225] Updated weights for policy 1, policy_version 1568923 (0.0010) [2023-12-28 06:30:37,528][106225] Updated weights for policy 1, policy_version 1568933 (0.0010) [2023-12-28 06:30:37,582][106225] Updated weights for policy 1, policy_version 1568943 (0.0011) [2023-12-28 06:30:37,638][106226] Updated weights for policy 0, policy_version 1565403 (0.0007) [2023-12-28 06:30:37,699][106226] Updated weights for policy 0, policy_version 1565413 (0.0008) [2023-12-28 06:30:37,764][106226] Updated weights for policy 0, policy_version 1565423 (0.0008) [2023-12-28 06:30:38,305][106225] Updated weights for policy 1, policy_version 1568953 (0.0010) [2023-12-28 06:30:38,374][106225] Updated weights for policy 1, policy_version 1568964 (0.0009) [2023-12-28 06:30:38,433][106225] Updated weights for policy 1, policy_version 1568974 (0.0007) [2023-12-28 06:30:38,453][106226] Updated weights for policy 0, policy_version 1565433 (0.0006) [2023-12-28 06:30:38,498][106225] Updated weights for policy 1, policy_version 1568984 (0.0005) [2023-12-28 06:30:38,513][106226] Updated weights for policy 0, policy_version 1565443 (0.0009) [2023-12-28 06:30:38,569][106226] Updated weights for policy 0, policy_version 1565453 (0.0010) [2023-12-28 06:30:38,619][106226] Updated weights for policy 0, policy_version 1565463 (0.0009) [2023-12-28 06:30:39,070][106225] Updated weights for policy 1, policy_version 1568994 (0.0008) [2023-12-28 06:30:39,117][106225] Updated weights for policy 1, policy_version 1569004 (0.0008) [2023-12-28 06:30:39,169][106225] Updated weights for policy 1, policy_version 1569014 (0.0008) [2023-12-28 06:30:39,474][106226] Updated weights for policy 0, policy_version 1565473 (0.0008) [2023-12-28 06:30:39,534][106226] Updated weights for policy 0, policy_version 1565483 (0.0008) [2023-12-28 06:30:39,597][106226] Updated weights for policy 0, policy_version 1565493 (0.0008) [2023-12-28 06:30:39,856][106225] Updated weights for policy 1, policy_version 1569024 (0.0008) [2023-12-28 06:30:39,923][106225] Updated weights for policy 1, policy_version 1569034 (0.0007) [2023-12-28 06:30:39,991][106225] Updated weights for policy 1, policy_version 1569044 (0.0009) [2023-12-28 06:30:40,372][106226] Updated weights for policy 0, policy_version 1565503 (0.0008) [2023-12-28 06:30:40,438][106226] Updated weights for policy 0, policy_version 1565513 (0.0008) [2023-12-28 06:30:40,499][106226] Updated weights for policy 0, policy_version 1565523 (0.0008) [2023-12-28 06:30:40,677][106225] Updated weights for policy 1, policy_version 1569054 (0.0007) [2023-12-28 06:30:40,729][106225] Updated weights for policy 1, policy_version 1569064 (0.0005) [2023-12-28 06:30:40,798][106225] Updated weights for policy 1, policy_version 1569074 (0.0007) [2023-12-28 06:30:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 802586624. Throughput: 0: 10022.3, 1: 9864.0. Samples: 802559212. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:41,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-4.930')] [2023-12-28 06:30:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001569080_401735680.pth... [2023-12-28 06:30:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001565528_400850944.pth... [2023-12-28 06:30:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001564376_400556032.pth [2023-12-28 06:30:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001567928_401440768.pth [2023-12-28 06:30:41,287][106226] Updated weights for policy 0, policy_version 1565533 (0.0008) [2023-12-28 06:30:41,360][106226] Updated weights for policy 0, policy_version 1565543 (0.0007) [2023-12-28 06:30:41,426][106226] Updated weights for policy 0, policy_version 1565553 (0.0009) [2023-12-28 06:30:41,480][106225] Updated weights for policy 1, policy_version 1569084 (0.0006) [2023-12-28 06:30:41,544][106225] Updated weights for policy 1, policy_version 1569094 (0.0006) [2023-12-28 06:30:41,601][106225] Updated weights for policy 1, policy_version 1569104 (0.0006) [2023-12-28 06:30:42,164][106226] Updated weights for policy 0, policy_version 1565563 (0.0009) [2023-12-28 06:30:42,226][106226] Updated weights for policy 0, policy_version 1565573 (0.0011) [2023-12-28 06:30:42,287][106226] Updated weights for policy 0, policy_version 1565583 (0.0011) [2023-12-28 06:30:42,328][106225] Updated weights for policy 1, policy_version 1569114 (0.0007) [2023-12-28 06:30:42,394][106225] Updated weights for policy 1, policy_version 1569124 (0.0007) [2023-12-28 06:30:42,444][106225] Updated weights for policy 1, policy_version 1569134 (0.0008) [2023-12-28 06:30:42,494][106225] Updated weights for policy 1, policy_version 1569144 (0.0007) [2023-12-28 06:30:43,007][106226] Updated weights for policy 0, policy_version 1565593 (0.0011) [2023-12-28 06:30:43,061][106226] Updated weights for policy 0, policy_version 1565603 (0.0010) [2023-12-28 06:30:43,117][106226] Updated weights for policy 0, policy_version 1565613 (0.0010) [2023-12-28 06:30:43,180][106226] Updated weights for policy 0, policy_version 1565623 (0.0011) [2023-12-28 06:30:43,239][106225] Updated weights for policy 1, policy_version 1569154 (0.0010) [2023-12-28 06:30:43,289][106225] Updated weights for policy 1, policy_version 1569164 (0.0010) [2023-12-28 06:30:43,338][106225] Updated weights for policy 1, policy_version 1569174 (0.0010) [2023-12-28 06:30:43,896][106226] Updated weights for policy 0, policy_version 1565633 (0.0010) [2023-12-28 06:30:43,958][106226] Updated weights for policy 0, policy_version 1565643 (0.0010) [2023-12-28 06:30:44,021][106226] Updated weights for policy 0, policy_version 1565653 (0.0010) [2023-12-28 06:30:44,072][106225] Updated weights for policy 1, policy_version 1569184 (0.0010) [2023-12-28 06:30:44,131][106225] Updated weights for policy 1, policy_version 1569194 (0.0010) [2023-12-28 06:30:44,190][106225] Updated weights for policy 1, policy_version 1569204 (0.0010) [2023-12-28 06:30:44,722][106226] Updated weights for policy 0, policy_version 1565663 (0.0010) [2023-12-28 06:30:44,789][106226] Updated weights for policy 0, policy_version 1565673 (0.0007) [2023-12-28 06:30:44,832][106225] Updated weights for policy 1, policy_version 1569214 (0.0009) [2023-12-28 06:30:44,854][106226] Updated weights for policy 0, policy_version 1565683 (0.0011) [2023-12-28 06:30:44,891][106225] Updated weights for policy 1, policy_version 1569224 (0.0006) [2023-12-28 06:30:44,949][106225] Updated weights for policy 1, policy_version 1569234 (0.0008) [2023-12-28 06:30:45,556][106226] Updated weights for policy 0, policy_version 1565693 (0.0010) [2023-12-28 06:30:45,614][106226] Updated weights for policy 0, policy_version 1565703 (0.0005) [2023-12-28 06:30:45,629][106225] Updated weights for policy 1, policy_version 1569244 (0.0008) [2023-12-28 06:30:45,668][106226] Updated weights for policy 0, policy_version 1565713 (0.0006) [2023-12-28 06:30:45,691][106225] Updated weights for policy 1, policy_version 1569254 (0.0008) [2023-12-28 06:30:45,741][106225] Updated weights for policy 1, policy_version 1569264 (0.0007) [2023-12-28 06:30:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 802684928. Throughput: 0: 9985.8, 1: 9818.5. Samples: 802675140. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:46,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.851')] [2023-12-28 06:30:46,231][106226] Updated weights for policy 0, policy_version 1565723 (0.0007) [2023-12-28 06:30:46,293][106226] Updated weights for policy 0, policy_version 1565733 (0.0007) [2023-12-28 06:30:46,363][106226] Updated weights for policy 0, policy_version 1565743 (0.0006) [2023-12-28 06:30:46,542][106225] Updated weights for policy 1, policy_version 1569274 (0.0009) [2023-12-28 06:30:46,594][106225] Updated weights for policy 1, policy_version 1569284 (0.0007) [2023-12-28 06:30:46,644][106225] Updated weights for policy 1, policy_version 1569294 (0.0008) [2023-12-28 06:30:46,691][106225] Updated weights for policy 1, policy_version 1569304 (0.0008) [2023-12-28 06:30:46,977][106226] Updated weights for policy 0, policy_version 1565753 (0.0008) [2023-12-28 06:30:47,032][106226] Updated weights for policy 0, policy_version 1565763 (0.0005) [2023-12-28 06:30:47,082][106226] Updated weights for policy 0, policy_version 1565773 (0.0005) [2023-12-28 06:30:47,147][106226] Updated weights for policy 0, policy_version 1565783 (0.0006) [2023-12-28 06:30:47,461][106225] Updated weights for policy 1, policy_version 1569314 (0.0010) [2023-12-28 06:30:47,514][106225] Updated weights for policy 1, policy_version 1569324 (0.0008) [2023-12-28 06:30:47,571][106225] Updated weights for policy 1, policy_version 1569334 (0.0009) [2023-12-28 06:30:47,668][106226] Updated weights for policy 0, policy_version 1565793 (0.0005) [2023-12-28 06:30:47,717][106226] Updated weights for policy 0, policy_version 1565803 (0.0005) [2023-12-28 06:30:47,779][106226] Updated weights for policy 0, policy_version 1565813 (0.0005) [2023-12-28 06:30:48,346][106226] Updated weights for policy 0, policy_version 1565823 (0.0007) [2023-12-28 06:30:48,412][106226] Updated weights for policy 0, policy_version 1565833 (0.0007) [2023-12-28 06:30:48,425][106225] Updated weights for policy 1, policy_version 1569344 (0.0009) [2023-12-28 06:30:48,477][106226] Updated weights for policy 0, policy_version 1565843 (0.0006) [2023-12-28 06:30:48,491][106225] Updated weights for policy 1, policy_version 1569354 (0.0011) [2023-12-28 06:30:48,554][106225] Updated weights for policy 1, policy_version 1569364 (0.0009) [2023-12-28 06:30:49,124][106226] Updated weights for policy 0, policy_version 1565853 (0.0008) [2023-12-28 06:30:49,179][106226] Updated weights for policy 0, policy_version 1565863 (0.0007) [2023-12-28 06:30:49,250][106226] Updated weights for policy 0, policy_version 1565873 (0.0008) [2023-12-28 06:30:49,354][106225] Updated weights for policy 1, policy_version 1569374 (0.0008) [2023-12-28 06:30:49,421][106225] Updated weights for policy 1, policy_version 1569384 (0.0009) [2023-12-28 06:30:49,484][106225] Updated weights for policy 1, policy_version 1569394 (0.0008) [2023-12-28 06:30:49,993][106226] Updated weights for policy 0, policy_version 1565883 (0.0007) [2023-12-28 06:30:50,053][106226] Updated weights for policy 0, policy_version 1565893 (0.0008) [2023-12-28 06:30:50,109][106226] Updated weights for policy 0, policy_version 1565903 (0.0009) [2023-12-28 06:30:50,161][106225] Updated weights for policy 1, policy_version 1569404 (0.0005) [2023-12-28 06:30:50,221][106225] Updated weights for policy 1, policy_version 1569414 (0.0006) [2023-12-28 06:30:50,287][106225] Updated weights for policy 1, policy_version 1569424 (0.0007) [2023-12-28 06:30:50,814][106226] Updated weights for policy 0, policy_version 1565913 (0.0007) [2023-12-28 06:30:50,884][106226] Updated weights for policy 0, policy_version 1565923 (0.0010) [2023-12-28 06:30:50,947][106226] Updated weights for policy 0, policy_version 1565933 (0.0007) [2023-12-28 06:30:50,969][106225] Updated weights for policy 1, policy_version 1569434 (0.0008) [2023-12-28 06:30:51,008][106226] Updated weights for policy 0, policy_version 1565943 (0.0007) [2023-12-28 06:30:51,033][106225] Updated weights for policy 1, policy_version 1569444 (0.0008) [2023-12-28 06:30:51,098][106225] Updated weights for policy 1, policy_version 1569454 (0.0008) [2023-12-28 06:30:51,166][106225] Updated weights for policy 1, policy_version 1569464 (0.0008) [2023-12-28 06:30:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 802791424. Throughput: 0: 10046.1, 1: 9709.1. Samples: 802794368. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:51,175][105115] Avg episode reward: [(0, '-4.908'), (1, '-4.594')] [2023-12-28 06:30:51,720][106226] Updated weights for policy 0, policy_version 1565953 (0.0009) [2023-12-28 06:30:51,783][106226] Updated weights for policy 0, policy_version 1565963 (0.0009) [2023-12-28 06:30:51,844][106226] Updated weights for policy 0, policy_version 1565973 (0.0009) [2023-12-28 06:30:51,945][106225] Updated weights for policy 1, policy_version 1569474 (0.0009) [2023-12-28 06:30:52,009][106225] Updated weights for policy 1, policy_version 1569484 (0.0006) [2023-12-28 06:30:52,067][106225] Updated weights for policy 1, policy_version 1569494 (0.0009) [2023-12-28 06:30:52,573][106226] Updated weights for policy 0, policy_version 1565983 (0.0009) [2023-12-28 06:30:52,627][106226] Updated weights for policy 0, policy_version 1565993 (0.0009) [2023-12-28 06:30:52,677][106226] Updated weights for policy 0, policy_version 1566003 (0.0008) [2023-12-28 06:30:52,730][106225] Updated weights for policy 1, policy_version 1569504 (0.0006) [2023-12-28 06:30:52,796][106225] Updated weights for policy 1, policy_version 1569514 (0.0005) [2023-12-28 06:30:52,858][106225] Updated weights for policy 1, policy_version 1569524 (0.0006) [2023-12-28 06:30:53,367][106226] Updated weights for policy 0, policy_version 1566013 (0.0009) [2023-12-28 06:30:53,423][106226] Updated weights for policy 0, policy_version 1566023 (0.0010) [2023-12-28 06:30:53,476][106226] Updated weights for policy 0, policy_version 1566033 (0.0010) [2023-12-28 06:30:53,520][106225] Updated weights for policy 1, policy_version 1569534 (0.0007) [2023-12-28 06:30:53,573][106225] Updated weights for policy 1, policy_version 1569544 (0.0008) [2023-12-28 06:30:53,631][106225] Updated weights for policy 1, policy_version 1569554 (0.0008) [2023-12-28 06:30:54,202][106226] Updated weights for policy 0, policy_version 1566043 (0.0010) [2023-12-28 06:30:54,259][106226] Updated weights for policy 0, policy_version 1566053 (0.0011) [2023-12-28 06:30:54,306][106226] Updated weights for policy 0, policy_version 1566063 (0.0010) [2023-12-28 06:30:54,366][106225] Updated weights for policy 1, policy_version 1569564 (0.0008) [2023-12-28 06:30:54,417][106225] Updated weights for policy 1, policy_version 1569574 (0.0008) [2023-12-28 06:30:54,474][106225] Updated weights for policy 1, policy_version 1569584 (0.0008) [2023-12-28 06:30:54,931][106226] Updated weights for policy 0, policy_version 1566073 (0.0009) [2023-12-28 06:30:54,990][106226] Updated weights for policy 0, policy_version 1566083 (0.0006) [2023-12-28 06:30:55,049][106226] Updated weights for policy 0, policy_version 1566093 (0.0007) [2023-12-28 06:30:55,106][106226] Updated weights for policy 0, policy_version 1566103 (0.0006) [2023-12-28 06:30:55,257][106225] Updated weights for policy 1, policy_version 1569594 (0.0008) [2023-12-28 06:30:55,321][106225] Updated weights for policy 1, policy_version 1569604 (0.0008) [2023-12-28 06:30:55,372][106225] Updated weights for policy 1, policy_version 1569614 (0.0008) [2023-12-28 06:30:55,434][106225] Updated weights for policy 1, policy_version 1569624 (0.0009) [2023-12-28 06:30:55,772][106226] Updated weights for policy 0, policy_version 1566113 (0.0008) [2023-12-28 06:30:55,832][106226] Updated weights for policy 0, policy_version 1566123 (0.0006) [2023-12-28 06:30:55,886][106226] Updated weights for policy 0, policy_version 1566133 (0.0007) [2023-12-28 06:30:56,164][106225] Updated weights for policy 1, policy_version 1569634 (0.0009) [2023-12-28 06:30:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 802881536. Throughput: 0: 9985.3, 1: 9675.9. Samples: 802852852. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:30:56,175][105115] Avg episode reward: [(0, '-4.850'), (1, '-4.429')] [2023-12-28 06:30:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001566136_401006592.pth... [2023-12-28 06:30:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001564952_400703488.pth [2023-12-28 06:30:56,225][106225] Updated weights for policy 1, policy_version 1569644 (0.0008) [2023-12-28 06:30:56,277][106225] Updated weights for policy 1, policy_version 1569654 (0.0008) [2023-12-28 06:30:56,288][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001569656_401883136.pth... [2023-12-28 06:30:56,292][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001568504_401588224.pth [2023-12-28 06:30:56,531][106226] Updated weights for policy 0, policy_version 1566143 (0.0008) [2023-12-28 06:30:56,583][106226] Updated weights for policy 0, policy_version 1566153 (0.0009) [2023-12-28 06:30:56,637][106226] Updated weights for policy 0, policy_version 1566163 (0.0008) [2023-12-28 06:30:56,969][106225] Updated weights for policy 1, policy_version 1569664 (0.0006) [2023-12-28 06:30:57,014][106225] Updated weights for policy 1, policy_version 1569674 (0.0005) [2023-12-28 06:30:57,061][106225] Updated weights for policy 1, policy_version 1569684 (0.0005) [2023-12-28 06:30:57,452][106226] Updated weights for policy 0, policy_version 1566173 (0.0008) [2023-12-28 06:30:57,504][106226] Updated weights for policy 0, policy_version 1566183 (0.0009) [2023-12-28 06:30:57,551][106226] Updated weights for policy 0, policy_version 1566193 (0.0008) [2023-12-28 06:30:57,677][106225] Updated weights for policy 1, policy_version 1569694 (0.0007) [2023-12-28 06:30:57,738][106225] Updated weights for policy 1, policy_version 1569704 (0.0007) [2023-12-28 06:30:57,790][106225] Updated weights for policy 1, policy_version 1569714 (0.0009) [2023-12-28 06:30:58,196][106226] Updated weights for policy 0, policy_version 1566203 (0.0008) [2023-12-28 06:30:58,256][106226] Updated weights for policy 0, policy_version 1566213 (0.0008) [2023-12-28 06:30:58,325][106226] Updated weights for policy 0, policy_version 1566223 (0.0008) [2023-12-28 06:30:58,523][106225] Updated weights for policy 1, policy_version 1569724 (0.0008) [2023-12-28 06:30:58,591][106225] Updated weights for policy 1, policy_version 1569734 (0.0008) [2023-12-28 06:30:58,657][106225] Updated weights for policy 1, policy_version 1569744 (0.0008) [2023-12-28 06:30:59,058][106226] Updated weights for policy 0, policy_version 1566233 (0.0008) [2023-12-28 06:30:59,108][106226] Updated weights for policy 0, policy_version 1566243 (0.0008) [2023-12-28 06:30:59,169][106226] Updated weights for policy 0, policy_version 1566253 (0.0007) [2023-12-28 06:30:59,222][106226] Updated weights for policy 0, policy_version 1566263 (0.0008) [2023-12-28 06:30:59,433][106225] Updated weights for policy 1, policy_version 1569754 (0.0009) [2023-12-28 06:30:59,496][106225] Updated weights for policy 1, policy_version 1569764 (0.0011) [2023-12-28 06:30:59,557][106225] Updated weights for policy 1, policy_version 1569774 (0.0010) [2023-12-28 06:30:59,617][106225] Updated weights for policy 1, policy_version 1569784 (0.0010) [2023-12-28 06:31:00,051][106226] Updated weights for policy 0, policy_version 1566273 (0.0006) [2023-12-28 06:31:00,113][106226] Updated weights for policy 0, policy_version 1566283 (0.0008) [2023-12-28 06:31:00,178][106226] Updated weights for policy 0, policy_version 1566293 (0.0009) [2023-12-28 06:31:00,300][106225] Updated weights for policy 1, policy_version 1569794 (0.0006) [2023-12-28 06:31:00,356][106225] Updated weights for policy 1, policy_version 1569804 (0.0007) [2023-12-28 06:31:00,402][106225] Updated weights for policy 1, policy_version 1569814 (0.0008) [2023-12-28 06:31:00,878][106226] Updated weights for policy 0, policy_version 1566303 (0.0008) [2023-12-28 06:31:00,936][106226] Updated weights for policy 0, policy_version 1566313 (0.0008) [2023-12-28 06:31:00,984][106226] Updated weights for policy 0, policy_version 1566323 (0.0008) [2023-12-28 06:31:01,083][106225] Updated weights for policy 1, policy_version 1569824 (0.0008) [2023-12-28 06:31:01,138][106225] Updated weights for policy 1, policy_version 1569834 (0.0008) [2023-12-28 06:31:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 802979840. Throughput: 0: 10035.1, 1: 9701.0. Samples: 802970096. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:01,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-4.788')] [2023-12-28 06:31:01,205][106225] Updated weights for policy 1, policy_version 1569844 (0.0007) [2023-12-28 06:31:01,763][106226] Updated weights for policy 0, policy_version 1566333 (0.0009) [2023-12-28 06:31:01,821][106226] Updated weights for policy 0, policy_version 1566343 (0.0008) [2023-12-28 06:31:01,886][106226] Updated weights for policy 0, policy_version 1566353 (0.0005) [2023-12-28 06:31:01,951][106225] Updated weights for policy 1, policy_version 1569854 (0.0008) [2023-12-28 06:31:02,003][106225] Updated weights for policy 1, policy_version 1569864 (0.0008) [2023-12-28 06:31:02,073][106225] Updated weights for policy 1, policy_version 1569874 (0.0006) [2023-12-28 06:31:02,563][106226] Updated weights for policy 0, policy_version 1566363 (0.0007) [2023-12-28 06:31:02,620][106226] Updated weights for policy 0, policy_version 1566373 (0.0007) [2023-12-28 06:31:02,672][106226] Updated weights for policy 0, policy_version 1566383 (0.0008) [2023-12-28 06:31:02,797][106225] Updated weights for policy 1, policy_version 1569884 (0.0008) [2023-12-28 06:31:02,851][106225] Updated weights for policy 1, policy_version 1569894 (0.0009) [2023-12-28 06:31:02,903][106225] Updated weights for policy 1, policy_version 1569904 (0.0009) [2023-12-28 06:31:03,410][106226] Updated weights for policy 0, policy_version 1566393 (0.0008) [2023-12-28 06:31:03,469][106226] Updated weights for policy 0, policy_version 1566403 (0.0008) [2023-12-28 06:31:03,520][106226] Updated weights for policy 0, policy_version 1566413 (0.0007) [2023-12-28 06:31:03,573][106226] Updated weights for policy 0, policy_version 1566423 (0.0008) [2023-12-28 06:31:03,628][106225] Updated weights for policy 1, policy_version 1569914 (0.0009) [2023-12-28 06:31:03,685][106225] Updated weights for policy 1, policy_version 1569924 (0.0010) [2023-12-28 06:31:03,745][106225] Updated weights for policy 1, policy_version 1569934 (0.0010) [2023-12-28 06:31:03,807][106225] Updated weights for policy 1, policy_version 1569944 (0.0010) [2023-12-28 06:31:04,303][106226] Updated weights for policy 0, policy_version 1566433 (0.0010) [2023-12-28 06:31:04,368][106226] Updated weights for policy 0, policy_version 1566443 (0.0011) [2023-12-28 06:31:04,427][106226] Updated weights for policy 0, policy_version 1566453 (0.0010) [2023-12-28 06:31:04,564][106225] Updated weights for policy 1, policy_version 1569954 (0.0011) [2023-12-28 06:31:04,626][106225] Updated weights for policy 1, policy_version 1569964 (0.0010) [2023-12-28 06:31:04,686][106225] Updated weights for policy 1, policy_version 1569974 (0.0010) [2023-12-28 06:31:04,989][106226] Updated weights for policy 0, policy_version 1566463 (0.0006) [2023-12-28 06:31:05,038][106226] Updated weights for policy 0, policy_version 1566473 (0.0005) [2023-12-28 06:31:05,085][106226] Updated weights for policy 0, policy_version 1566483 (0.0009) [2023-12-28 06:31:05,389][106225] Updated weights for policy 1, policy_version 1569984 (0.0010) [2023-12-28 06:31:05,442][106225] Updated weights for policy 1, policy_version 1569994 (0.0010) [2023-12-28 06:31:05,510][106225] Updated weights for policy 1, policy_version 1570004 (0.0007) [2023-12-28 06:31:05,659][106226] Updated weights for policy 0, policy_version 1566493 (0.0010) [2023-12-28 06:31:05,721][106226] Updated weights for policy 0, policy_version 1566503 (0.0011) [2023-12-28 06:31:05,784][106226] Updated weights for policy 0, policy_version 1566513 (0.0010) [2023-12-28 06:31:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 803078144. Throughput: 0: 10077.4, 1: 9787.1. Samples: 803089132. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:06,175][105115] Avg episode reward: [(0, '-4.685'), (1, '-4.489')] [2023-12-28 06:31:06,221][106225] Updated weights for policy 1, policy_version 1570014 (0.0008) [2023-12-28 06:31:06,288][106225] Updated weights for policy 1, policy_version 1570024 (0.0008) [2023-12-28 06:31:06,347][106225] Updated weights for policy 1, policy_version 1570034 (0.0008) [2023-12-28 06:31:06,512][106226] Updated weights for policy 0, policy_version 1566523 (0.0009) [2023-12-28 06:31:06,579][106226] Updated weights for policy 0, policy_version 1566533 (0.0006) [2023-12-28 06:31:06,650][106226] Updated weights for policy 0, policy_version 1566543 (0.0007) [2023-12-28 06:31:07,121][106225] Updated weights for policy 1, policy_version 1570044 (0.0008) [2023-12-28 06:31:07,185][106225] Updated weights for policy 1, policy_version 1570054 (0.0006) [2023-12-28 06:31:07,239][106225] Updated weights for policy 1, policy_version 1570064 (0.0008) [2023-12-28 06:31:07,326][106226] Updated weights for policy 0, policy_version 1566553 (0.0011) [2023-12-28 06:31:07,392][106226] Updated weights for policy 0, policy_version 1566563 (0.0011) [2023-12-28 06:31:07,453][106226] Updated weights for policy 0, policy_version 1566573 (0.0011) [2023-12-28 06:31:07,510][106226] Updated weights for policy 0, policy_version 1566583 (0.0010) [2023-12-28 06:31:07,883][106225] Updated weights for policy 1, policy_version 1570074 (0.0009) [2023-12-28 06:31:07,929][106225] Updated weights for policy 1, policy_version 1570084 (0.0005) [2023-12-28 06:31:07,977][106225] Updated weights for policy 1, policy_version 1570094 (0.0005) [2023-12-28 06:31:08,047][106225] Updated weights for policy 1, policy_version 1570104 (0.0008) [2023-12-28 06:31:08,171][106226] Updated weights for policy 0, policy_version 1566593 (0.0010) [2023-12-28 06:31:08,217][106226] Updated weights for policy 0, policy_version 1566603 (0.0010) [2023-12-28 06:31:08,267][106226] Updated weights for policy 0, policy_version 1566613 (0.0010) [2023-12-28 06:31:08,609][106225] Updated weights for policy 1, policy_version 1570114 (0.0007) [2023-12-28 06:31:08,664][106225] Updated weights for policy 1, policy_version 1570124 (0.0010) [2023-12-28 06:31:08,725][106225] Updated weights for policy 1, policy_version 1570134 (0.0010) [2023-12-28 06:31:09,009][106226] Updated weights for policy 0, policy_version 1566623 (0.0010) [2023-12-28 06:31:09,059][106226] Updated weights for policy 0, policy_version 1566633 (0.0010) [2023-12-28 06:31:09,119][106226] Updated weights for policy 0, policy_version 1566643 (0.0010) [2023-12-28 06:31:09,460][106225] Updated weights for policy 1, policy_version 1570144 (0.0008) [2023-12-28 06:31:09,528][106225] Updated weights for policy 1, policy_version 1570154 (0.0010) [2023-12-28 06:31:09,588][106225] Updated weights for policy 1, policy_version 1570164 (0.0010) [2023-12-28 06:31:09,867][106226] Updated weights for policy 0, policy_version 1566653 (0.0009) [2023-12-28 06:31:09,939][106226] Updated weights for policy 0, policy_version 1566663 (0.0007) [2023-12-28 06:31:09,998][106226] Updated weights for policy 0, policy_version 1566673 (0.0006) [2023-12-28 06:31:10,287][106225] Updated weights for policy 1, policy_version 1570174 (0.0006) [2023-12-28 06:31:10,355][106225] Updated weights for policy 1, policy_version 1570184 (0.0007) [2023-12-28 06:31:10,412][106225] Updated weights for policy 1, policy_version 1570194 (0.0006) [2023-12-28 06:31:10,660][106226] Updated weights for policy 0, policy_version 1566683 (0.0008) [2023-12-28 06:31:10,706][106226] Updated weights for policy 0, policy_version 1566693 (0.0005) [2023-12-28 06:31:10,764][106226] Updated weights for policy 0, policy_version 1566703 (0.0007) [2023-12-28 06:31:11,002][106225] Updated weights for policy 1, policy_version 1570204 (0.0008) [2023-12-28 06:31:11,078][106225] Updated weights for policy 1, policy_version 1570214 (0.0009) [2023-12-28 06:31:11,146][106225] Updated weights for policy 1, policy_version 1570224 (0.0008) [2023-12-28 06:31:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 803176448. Throughput: 0: 10060.6, 1: 9864.0. Samples: 803149504. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:11,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-4.497')] [2023-12-28 06:31:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001566712_401154048.pth... [2023-12-28 06:31:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001565528_400850944.pth [2023-12-28 06:31:11,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001570232_402030592.pth... [2023-12-28 06:31:11,204][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001569080_401735680.pth [2023-12-28 06:31:11,530][106226] Updated weights for policy 0, policy_version 1566713 (0.0009) [2023-12-28 06:31:11,587][106226] Updated weights for policy 0, policy_version 1566723 (0.0009) [2023-12-28 06:31:11,662][106226] Updated weights for policy 0, policy_version 1566733 (0.0009) [2023-12-28 06:31:11,724][106226] Updated weights for policy 0, policy_version 1566743 (0.0009) [2023-12-28 06:31:11,955][106225] Updated weights for policy 1, policy_version 1570234 (0.0008) [2023-12-28 06:31:12,023][106225] Updated weights for policy 1, policy_version 1570244 (0.0007) [2023-12-28 06:31:12,092][106225] Updated weights for policy 1, policy_version 1570254 (0.0009) [2023-12-28 06:31:12,158][106225] Updated weights for policy 1, policy_version 1570264 (0.0007) [2023-12-28 06:31:12,504][106226] Updated weights for policy 0, policy_version 1566753 (0.0008) [2023-12-28 06:31:12,561][106226] Updated weights for policy 0, policy_version 1566763 (0.0008) [2023-12-28 06:31:12,624][106226] Updated weights for policy 0, policy_version 1566773 (0.0009) [2023-12-28 06:31:12,832][106225] Updated weights for policy 1, policy_version 1570274 (0.0008) [2023-12-28 06:31:12,892][106225] Updated weights for policy 1, policy_version 1570284 (0.0009) [2023-12-28 06:31:12,944][106225] Updated weights for policy 1, policy_version 1570294 (0.0008) [2023-12-28 06:31:13,288][106226] Updated weights for policy 0, policy_version 1566783 (0.0009) [2023-12-28 06:31:13,335][106226] Updated weights for policy 0, policy_version 1566793 (0.0009) [2023-12-28 06:31:13,383][106226] Updated weights for policy 0, policy_version 1566803 (0.0009) [2023-12-28 06:31:13,657][106225] Updated weights for policy 1, policy_version 1570304 (0.0009) [2023-12-28 06:31:13,713][106225] Updated weights for policy 1, policy_version 1570314 (0.0008) [2023-12-28 06:31:13,768][106225] Updated weights for policy 1, policy_version 1570324 (0.0009) [2023-12-28 06:31:14,108][106226] Updated weights for policy 0, policy_version 1566813 (0.0009) [2023-12-28 06:31:14,163][106226] Updated weights for policy 0, policy_version 1566823 (0.0008) [2023-12-28 06:31:14,224][106226] Updated weights for policy 0, policy_version 1566833 (0.0008) [2023-12-28 06:31:14,502][106225] Updated weights for policy 1, policy_version 1570334 (0.0009) [2023-12-28 06:31:14,555][106225] Updated weights for policy 1, policy_version 1570344 (0.0010) [2023-12-28 06:31:14,612][106225] Updated weights for policy 1, policy_version 1570354 (0.0010) [2023-12-28 06:31:14,934][106226] Updated weights for policy 0, policy_version 1566843 (0.0008) [2023-12-28 06:31:14,999][106226] Updated weights for policy 0, policy_version 1566853 (0.0008) [2023-12-28 06:31:15,063][106226] Updated weights for policy 0, policy_version 1566863 (0.0008) [2023-12-28 06:31:15,387][106225] Updated weights for policy 1, policy_version 1570364 (0.0010) [2023-12-28 06:31:15,451][106225] Updated weights for policy 1, policy_version 1570374 (0.0010) [2023-12-28 06:31:15,505][106225] Updated weights for policy 1, policy_version 1570384 (0.0011) [2023-12-28 06:31:15,785][106226] Updated weights for policy 0, policy_version 1566873 (0.0008) [2023-12-28 06:31:15,841][106226] Updated weights for policy 0, policy_version 1566883 (0.0008) [2023-12-28 06:31:15,890][106226] Updated weights for policy 0, policy_version 1566893 (0.0007) [2023-12-28 06:31:15,939][106226] Updated weights for policy 0, policy_version 1566903 (0.0007) [2023-12-28 06:31:16,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 803274752. Throughput: 0: 9923.7, 1: 9705.3. Samples: 803265512. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:16,176][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.839')] [2023-12-28 06:31:16,214][106225] Updated weights for policy 1, policy_version 1570394 (0.0009) [2023-12-28 06:31:16,267][106225] Updated weights for policy 1, policy_version 1570404 (0.0010) [2023-12-28 06:31:16,320][106225] Updated weights for policy 1, policy_version 1570414 (0.0010) [2023-12-28 06:31:16,382][106225] Updated weights for policy 1, policy_version 1570424 (0.0010) [2023-12-28 06:31:16,654][106226] Updated weights for policy 0, policy_version 1566913 (0.0006) [2023-12-28 06:31:16,714][106226] Updated weights for policy 0, policy_version 1566923 (0.0006) [2023-12-28 06:31:16,763][106226] Updated weights for policy 0, policy_version 1566933 (0.0007) [2023-12-28 06:31:17,101][106225] Updated weights for policy 1, policy_version 1570434 (0.0010) [2023-12-28 06:31:17,152][106225] Updated weights for policy 1, policy_version 1570444 (0.0010) [2023-12-28 06:31:17,208][106225] Updated weights for policy 1, policy_version 1570454 (0.0010) [2023-12-28 06:31:17,463][106226] Updated weights for policy 0, policy_version 1566943 (0.0008) [2023-12-28 06:31:17,529][106226] Updated weights for policy 0, policy_version 1566953 (0.0010) [2023-12-28 06:31:17,592][106226] Updated weights for policy 0, policy_version 1566963 (0.0010) [2023-12-28 06:31:17,835][106225] Updated weights for policy 1, policy_version 1570464 (0.0006) [2023-12-28 06:31:17,881][106225] Updated weights for policy 1, policy_version 1570474 (0.0006) [2023-12-28 06:31:17,931][106225] Updated weights for policy 1, policy_version 1570484 (0.0006) [2023-12-28 06:31:18,358][106226] Updated weights for policy 0, policy_version 1566973 (0.0008) [2023-12-28 06:31:18,422][106226] Updated weights for policy 0, policy_version 1566983 (0.0007) [2023-12-28 06:31:18,486][106226] Updated weights for policy 0, policy_version 1566993 (0.0008) [2023-12-28 06:31:18,613][106225] Updated weights for policy 1, policy_version 1570494 (0.0007) [2023-12-28 06:31:18,672][106225] Updated weights for policy 1, policy_version 1570504 (0.0006) [2023-12-28 06:31:18,733][106225] Updated weights for policy 1, policy_version 1570514 (0.0005) [2023-12-28 06:31:19,080][106226] Updated weights for policy 0, policy_version 1567003 (0.0007) [2023-12-28 06:31:19,139][106226] Updated weights for policy 0, policy_version 1567013 (0.0010) [2023-12-28 06:31:19,210][106226] Updated weights for policy 0, policy_version 1567023 (0.0006) [2023-12-28 06:31:19,393][106225] Updated weights for policy 1, policy_version 1570524 (0.0008) [2023-12-28 06:31:19,449][106225] Updated weights for policy 1, policy_version 1570534 (0.0008) [2023-12-28 06:31:19,513][106225] Updated weights for policy 1, policy_version 1570544 (0.0009) [2023-12-28 06:31:19,918][106226] Updated weights for policy 0, policy_version 1567033 (0.0010) [2023-12-28 06:31:19,993][106226] Updated weights for policy 0, policy_version 1567043 (0.0010) [2023-12-28 06:31:20,046][106226] Updated weights for policy 0, policy_version 1567053 (0.0011) [2023-12-28 06:31:20,099][106226] Updated weights for policy 0, policy_version 1567063 (0.0011) [2023-12-28 06:31:20,314][106225] Updated weights for policy 1, policy_version 1570554 (0.0009) [2023-12-28 06:31:20,374][106225] Updated weights for policy 1, policy_version 1570564 (0.0008) [2023-12-28 06:31:20,430][106225] Updated weights for policy 1, policy_version 1570574 (0.0008) [2023-12-28 06:31:20,494][106225] Updated weights for policy 1, policy_version 1570584 (0.0008) [2023-12-28 06:31:20,874][106226] Updated weights for policy 0, policy_version 1567073 (0.0011) [2023-12-28 06:31:20,939][106226] Updated weights for policy 0, policy_version 1567083 (0.0011) [2023-12-28 06:31:21,004][106226] Updated weights for policy 0, policy_version 1567093 (0.0011) [2023-12-28 06:31:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 803373056. Throughput: 0: 9826.3, 1: 9747.3. Samples: 803382276. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:21,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.559')] [2023-12-28 06:31:21,257][106225] Updated weights for policy 1, policy_version 1570594 (0.0008) [2023-12-28 06:31:21,316][106225] Updated weights for policy 1, policy_version 1570604 (0.0008) [2023-12-28 06:31:21,383][106225] Updated weights for policy 1, policy_version 1570614 (0.0007) [2023-12-28 06:31:21,856][106226] Updated weights for policy 0, policy_version 1567103 (0.0009) [2023-12-28 06:31:21,923][106226] Updated weights for policy 0, policy_version 1567113 (0.0009) [2023-12-28 06:31:21,986][106226] Updated weights for policy 0, policy_version 1567123 (0.0008) [2023-12-28 06:31:22,137][106225] Updated weights for policy 1, policy_version 1570624 (0.0008) [2023-12-28 06:31:22,197][106225] Updated weights for policy 1, policy_version 1570634 (0.0008) [2023-12-28 06:31:22,261][106225] Updated weights for policy 1, policy_version 1570644 (0.0010) [2023-12-28 06:31:22,740][106226] Updated weights for policy 0, policy_version 1567133 (0.0009) [2023-12-28 06:31:22,798][106226] Updated weights for policy 0, policy_version 1567143 (0.0009) [2023-12-28 06:31:22,858][106226] Updated weights for policy 0, policy_version 1567153 (0.0009) [2023-12-28 06:31:22,974][106225] Updated weights for policy 1, policy_version 1570654 (0.0008) [2023-12-28 06:31:23,031][106225] Updated weights for policy 1, policy_version 1570664 (0.0009) [2023-12-28 06:31:23,090][106225] Updated weights for policy 1, policy_version 1570674 (0.0009) [2023-12-28 06:31:23,533][106226] Updated weights for policy 0, policy_version 1567163 (0.0009) [2023-12-28 06:31:23,594][106226] Updated weights for policy 0, policy_version 1567173 (0.0011) [2023-12-28 06:31:23,660][106226] Updated weights for policy 0, policy_version 1567183 (0.0011) [2023-12-28 06:31:23,715][106225] Updated weights for policy 1, policy_version 1570684 (0.0007) [2023-12-28 06:31:23,769][106225] Updated weights for policy 1, policy_version 1570694 (0.0005) [2023-12-28 06:31:23,818][106225] Updated weights for policy 1, policy_version 1570704 (0.0005) [2023-12-28 06:31:24,321][106226] Updated weights for policy 0, policy_version 1567193 (0.0010) [2023-12-28 06:31:24,380][106226] Updated weights for policy 0, policy_version 1567203 (0.0010) [2023-12-28 06:31:24,436][106226] Updated weights for policy 0, policy_version 1567213 (0.0010) [2023-12-28 06:31:24,442][106225] Updated weights for policy 1, policy_version 1570714 (0.0006) [2023-12-28 06:31:24,492][106226] Updated weights for policy 0, policy_version 1567223 (0.0006) [2023-12-28 06:31:24,495][106225] Updated weights for policy 1, policy_version 1570724 (0.0010) [2023-12-28 06:31:24,544][106225] Updated weights for policy 1, policy_version 1570734 (0.0010) [2023-12-28 06:31:24,598][106225] Updated weights for policy 1, policy_version 1570744 (0.0010) [2023-12-28 06:31:25,123][106226] Updated weights for policy 0, policy_version 1567233 (0.0010) [2023-12-28 06:31:25,192][106226] Updated weights for policy 0, policy_version 1567243 (0.0010) [2023-12-28 06:31:25,251][106226] Updated weights for policy 0, policy_version 1567253 (0.0010) [2023-12-28 06:31:25,322][106225] Updated weights for policy 1, policy_version 1570754 (0.0007) [2023-12-28 06:31:25,376][106225] Updated weights for policy 1, policy_version 1570764 (0.0009) [2023-12-28 06:31:25,457][106225] Updated weights for policy 1, policy_version 1570774 (0.0007) [2023-12-28 06:31:25,943][106226] Updated weights for policy 0, policy_version 1567263 (0.0011) [2023-12-28 06:31:26,009][106225] Updated weights for policy 1, policy_version 1570784 (0.0007) [2023-12-28 06:31:26,013][106226] Updated weights for policy 0, policy_version 1567273 (0.0010) [2023-12-28 06:31:26,056][106225] Updated weights for policy 1, policy_version 1570794 (0.0006) [2023-12-28 06:31:26,079][106226] Updated weights for policy 0, policy_version 1567283 (0.0010) [2023-12-28 06:31:26,108][106225] Updated weights for policy 1, policy_version 1570804 (0.0006) [2023-12-28 06:31:26,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 803479552. Throughput: 0: 9844.5, 1: 9740.9. Samples: 803440552. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:26,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.405')] [2023-12-28 06:31:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001567288_401301504.pth... [2023-12-28 06:31:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001570808_402178048.pth... [2023-12-28 06:31:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001566136_401006592.pth [2023-12-28 06:31:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001569656_401883136.pth [2023-12-28 06:31:26,755][106226] Updated weights for policy 0, policy_version 1567293 (0.0011) [2023-12-28 06:31:26,767][106225] Updated weights for policy 1, policy_version 1570814 (0.0009) [2023-12-28 06:31:26,817][106226] Updated weights for policy 0, policy_version 1567303 (0.0010) [2023-12-28 06:31:26,830][106225] Updated weights for policy 1, policy_version 1570824 (0.0009) [2023-12-28 06:31:26,883][106226] Updated weights for policy 0, policy_version 1567313 (0.0011) [2023-12-28 06:31:26,888][106225] Updated weights for policy 1, policy_version 1570834 (0.0008) [2023-12-28 06:31:27,513][106225] Updated weights for policy 1, policy_version 1570844 (0.0009) [2023-12-28 06:31:27,567][106225] Updated weights for policy 1, policy_version 1570854 (0.0006) [2023-12-28 06:31:27,576][106226] Updated weights for policy 0, policy_version 1567323 (0.0010) [2023-12-28 06:31:27,625][106225] Updated weights for policy 1, policy_version 1570864 (0.0005) [2023-12-28 06:31:27,638][106226] Updated weights for policy 0, policy_version 1567333 (0.0010) [2023-12-28 06:31:27,703][106226] Updated weights for policy 0, policy_version 1567343 (0.0010) [2023-12-28 06:31:28,201][106225] Updated weights for policy 1, policy_version 1570874 (0.0005) [2023-12-28 06:31:28,248][106225] Updated weights for policy 1, policy_version 1570884 (0.0006) [2023-12-28 06:31:28,293][106225] Updated weights for policy 1, policy_version 1570894 (0.0010) [2023-12-28 06:31:28,344][106225] Updated weights for policy 1, policy_version 1570904 (0.0010) [2023-12-28 06:31:28,372][106226] Updated weights for policy 0, policy_version 1567353 (0.0010) [2023-12-28 06:31:28,435][106226] Updated weights for policy 0, policy_version 1567363 (0.0006) [2023-12-28 06:31:28,497][106226] Updated weights for policy 0, policy_version 1567373 (0.0007) [2023-12-28 06:31:28,554][106226] Updated weights for policy 0, policy_version 1567383 (0.0010) [2023-12-28 06:31:28,990][106225] Updated weights for policy 1, policy_version 1570914 (0.0008) [2023-12-28 06:31:29,047][106225] Updated weights for policy 1, policy_version 1570924 (0.0007) [2023-12-28 06:31:29,100][106225] Updated weights for policy 1, policy_version 1570934 (0.0007) [2023-12-28 06:31:29,242][106226] Updated weights for policy 0, policy_version 1567393 (0.0010) [2023-12-28 06:31:29,307][106226] Updated weights for policy 0, policy_version 1567403 (0.0008) [2023-12-28 06:31:29,376][106226] Updated weights for policy 0, policy_version 1567413 (0.0008) [2023-12-28 06:31:29,916][106225] Updated weights for policy 1, policy_version 1570944 (0.0009) [2023-12-28 06:31:29,977][106226] Updated weights for policy 0, policy_version 1567423 (0.0011) [2023-12-28 06:31:29,980][106225] Updated weights for policy 1, policy_version 1570954 (0.0008) [2023-12-28 06:31:30,034][106225] Updated weights for policy 1, policy_version 1570964 (0.0006) [2023-12-28 06:31:30,036][106226] Updated weights for policy 0, policy_version 1567433 (0.0011) [2023-12-28 06:31:30,087][106226] Updated weights for policy 0, policy_version 1567443 (0.0010) [2023-12-28 06:31:30,738][106226] Updated weights for policy 0, policy_version 1567453 (0.0010) [2023-12-28 06:31:30,784][106226] Updated weights for policy 0, policy_version 1567463 (0.0010) [2023-12-28 06:31:30,791][106225] Updated weights for policy 1, policy_version 1570974 (0.0006) [2023-12-28 06:31:30,837][106225] Updated weights for policy 1, policy_version 1570984 (0.0008) [2023-12-28 06:31:30,844][106226] Updated weights for policy 0, policy_version 1567473 (0.0010) [2023-12-28 06:31:30,881][106225] Updated weights for policy 1, policy_version 1570994 (0.0005) [2023-12-28 06:31:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 803577856. Throughput: 0: 9955.3, 1: 9829.5. Samples: 803565456. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:31,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.620')] [2023-12-28 06:31:31,555][106225] Updated weights for policy 1, policy_version 1571004 (0.0008) [2023-12-28 06:31:31,609][106226] Updated weights for policy 0, policy_version 1567483 (0.0010) [2023-12-28 06:31:31,611][106225] Updated weights for policy 1, policy_version 1571014 (0.0008) [2023-12-28 06:31:31,676][106226] Updated weights for policy 0, policy_version 1567493 (0.0008) [2023-12-28 06:31:31,676][106225] Updated weights for policy 1, policy_version 1571024 (0.0009) [2023-12-28 06:31:31,734][106226] Updated weights for policy 0, policy_version 1567503 (0.0006) [2023-12-28 06:31:32,425][106225] Updated weights for policy 1, policy_version 1571034 (0.0008) [2023-12-28 06:31:32,470][106226] Updated weights for policy 0, policy_version 1567513 (0.0008) [2023-12-28 06:31:32,476][106225] Updated weights for policy 1, policy_version 1571044 (0.0007) [2023-12-28 06:31:32,534][106225] Updated weights for policy 1, policy_version 1571054 (0.0005) [2023-12-28 06:31:32,535][106226] Updated weights for policy 0, policy_version 1567523 (0.0008) [2023-12-28 06:31:32,592][106225] Updated weights for policy 1, policy_version 1571064 (0.0007) [2023-12-28 06:31:32,594][106226] Updated weights for policy 0, policy_version 1567533 (0.0007) [2023-12-28 06:31:32,659][106226] Updated weights for policy 0, policy_version 1567543 (0.0009) [2023-12-28 06:31:33,307][106225] Updated weights for policy 1, policy_version 1571074 (0.0008) [2023-12-28 06:31:33,345][106226] Updated weights for policy 0, policy_version 1567553 (0.0007) [2023-12-28 06:31:33,359][106225] Updated weights for policy 1, policy_version 1571084 (0.0007) [2023-12-28 06:31:33,409][106225] Updated weights for policy 1, policy_version 1571094 (0.0007) [2023-12-28 06:31:33,411][106226] Updated weights for policy 0, policy_version 1567563 (0.0007) [2023-12-28 06:31:33,465][106226] Updated weights for policy 0, policy_version 1567573 (0.0005) [2023-12-28 06:31:33,989][106226] Updated weights for policy 0, policy_version 1567583 (0.0008) [2023-12-28 06:31:34,038][106226] Updated weights for policy 0, policy_version 1567593 (0.0008) [2023-12-28 06:31:34,089][106226] Updated weights for policy 0, policy_version 1567603 (0.0009) [2023-12-28 06:31:34,212][106225] Updated weights for policy 1, policy_version 1571104 (0.0008) [2023-12-28 06:31:34,271][106225] Updated weights for policy 1, policy_version 1571114 (0.0007) [2023-12-28 06:31:34,335][106225] Updated weights for policy 1, policy_version 1571124 (0.0008) [2023-12-28 06:31:34,929][106226] Updated weights for policy 0, policy_version 1567613 (0.0008) [2023-12-28 06:31:34,959][106225] Updated weights for policy 1, policy_version 1571134 (0.0009) [2023-12-28 06:31:34,981][106226] Updated weights for policy 0, policy_version 1567623 (0.0005) [2023-12-28 06:31:35,021][106225] Updated weights for policy 1, policy_version 1571144 (0.0010) [2023-12-28 06:31:35,035][106226] Updated weights for policy 0, policy_version 1567633 (0.0008) [2023-12-28 06:31:35,077][106225] Updated weights for policy 1, policy_version 1571154 (0.0010) [2023-12-28 06:31:35,730][106225] Updated weights for policy 1, policy_version 1571164 (0.0008) [2023-12-28 06:31:35,775][106226] Updated weights for policy 0, policy_version 1567643 (0.0008) [2023-12-28 06:31:35,784][106225] Updated weights for policy 1, policy_version 1571174 (0.0005) [2023-12-28 06:31:35,837][106226] Updated weights for policy 0, policy_version 1567653 (0.0008) [2023-12-28 06:31:35,843][106225] Updated weights for policy 1, policy_version 1571184 (0.0006) [2023-12-28 06:31:35,899][106226] Updated weights for policy 0, policy_version 1567663 (0.0007) [2023-12-28 06:31:36,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 803676160. Throughput: 0: 9862.4, 1: 9904.4. Samples: 803683876. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:36,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.004')] [2023-12-28 06:31:36,573][106226] Updated weights for policy 0, policy_version 1567673 (0.0005) [2023-12-28 06:31:36,578][106225] Updated weights for policy 1, policy_version 1571194 (0.0009) [2023-12-28 06:31:36,633][106225] Updated weights for policy 1, policy_version 1571204 (0.0007) [2023-12-28 06:31:36,639][106226] Updated weights for policy 0, policy_version 1567683 (0.0007) [2023-12-28 06:31:36,692][106225] Updated weights for policy 1, policy_version 1571214 (0.0006) [2023-12-28 06:31:36,702][106226] Updated weights for policy 0, policy_version 1567693 (0.0007) [2023-12-28 06:31:36,750][106225] Updated weights for policy 1, policy_version 1571224 (0.0007) [2023-12-28 06:31:36,770][106226] Updated weights for policy 0, policy_version 1567703 (0.0008) [2023-12-28 06:31:37,403][106226] Updated weights for policy 0, policy_version 1567713 (0.0008) [2023-12-28 06:31:37,451][106226] Updated weights for policy 0, policy_version 1567723 (0.0008) [2023-12-28 06:31:37,506][106226] Updated weights for policy 0, policy_version 1567733 (0.0006) [2023-12-28 06:31:37,515][106225] Updated weights for policy 1, policy_version 1571234 (0.0008) [2023-12-28 06:31:37,567][106225] Updated weights for policy 1, policy_version 1571244 (0.0008) [2023-12-28 06:31:37,617][106225] Updated weights for policy 1, policy_version 1571254 (0.0008) [2023-12-28 06:31:38,237][106225] Updated weights for policy 1, policy_version 1571264 (0.0006) [2023-12-28 06:31:38,288][106226] Updated weights for policy 0, policy_version 1567743 (0.0007) [2023-12-28 06:31:38,295][106225] Updated weights for policy 1, policy_version 1571274 (0.0005) [2023-12-28 06:31:38,350][106226] Updated weights for policy 0, policy_version 1567753 (0.0007) [2023-12-28 06:31:38,360][106225] Updated weights for policy 1, policy_version 1571284 (0.0007) [2023-12-28 06:31:38,420][106226] Updated weights for policy 0, policy_version 1567763 (0.0007) [2023-12-28 06:31:39,027][106226] Updated weights for policy 0, policy_version 1567773 (0.0006) [2023-12-28 06:31:39,086][106226] Updated weights for policy 0, policy_version 1567783 (0.0008) [2023-12-28 06:31:39,103][106225] Updated weights for policy 1, policy_version 1571294 (0.0007) [2023-12-28 06:31:39,145][106226] Updated weights for policy 0, policy_version 1567793 (0.0007) [2023-12-28 06:31:39,162][106225] Updated weights for policy 1, policy_version 1571304 (0.0006) [2023-12-28 06:31:39,240][106225] Updated weights for policy 1, policy_version 1571314 (0.0009) [2023-12-28 06:31:39,886][106226] Updated weights for policy 0, policy_version 1567803 (0.0008) [2023-12-28 06:31:39,947][106226] Updated weights for policy 0, policy_version 1567813 (0.0008) [2023-12-28 06:31:39,947][106225] Updated weights for policy 1, policy_version 1571324 (0.0008) [2023-12-28 06:31:40,009][106226] Updated weights for policy 0, policy_version 1567823 (0.0007) [2023-12-28 06:31:40,015][106225] Updated weights for policy 1, policy_version 1571334 (0.0008) [2023-12-28 06:31:40,082][106225] Updated weights for policy 1, policy_version 1571344 (0.0008) [2023-12-28 06:31:40,647][106226] Updated weights for policy 0, policy_version 1567833 (0.0006) [2023-12-28 06:31:40,704][106226] Updated weights for policy 0, policy_version 1567843 (0.0005) [2023-12-28 06:31:40,750][106226] Updated weights for policy 0, policy_version 1567853 (0.0005) [2023-12-28 06:31:40,798][106225] Updated weights for policy 1, policy_version 1571354 (0.0008) [2023-12-28 06:31:40,810][106226] Updated weights for policy 0, policy_version 1567863 (0.0007) [2023-12-28 06:31:40,859][106225] Updated weights for policy 1, policy_version 1571364 (0.0005) [2023-12-28 06:31:40,927][106225] Updated weights for policy 1, policy_version 1571374 (0.0005) [2023-12-28 06:31:40,993][106225] Updated weights for policy 1, policy_version 1571384 (0.0005) [2023-12-28 06:31:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 803774464. Throughput: 0: 9891.0, 1: 9894.3. Samples: 803743192. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:41,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-4.658')] [2023-12-28 06:31:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001567864_401448960.pth... [2023-12-28 06:31:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001571384_402325504.pth... [2023-12-28 06:31:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001570232_402030592.pth [2023-12-28 06:31:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001566712_401154048.pth [2023-12-28 06:31:41,540][106226] Updated weights for policy 0, policy_version 1567873 (0.0007) [2023-12-28 06:31:41,604][106226] Updated weights for policy 0, policy_version 1567883 (0.0009) [2023-12-28 06:31:41,661][106225] Updated weights for policy 1, policy_version 1571394 (0.0010) [2023-12-28 06:31:41,670][106226] Updated weights for policy 0, policy_version 1567893 (0.0008) [2023-12-28 06:31:41,728][106225] Updated weights for policy 1, policy_version 1571404 (0.0008) [2023-12-28 06:31:41,795][106225] Updated weights for policy 1, policy_version 1571414 (0.0010) [2023-12-28 06:31:42,470][106225] Updated weights for policy 1, policy_version 1571424 (0.0010) [2023-12-28 06:31:42,488][106226] Updated weights for policy 0, policy_version 1567903 (0.0008) [2023-12-28 06:31:42,518][106225] Updated weights for policy 1, policy_version 1571434 (0.0009) [2023-12-28 06:31:42,552][106226] Updated weights for policy 0, policy_version 1567913 (0.0007) [2023-12-28 06:31:42,562][106225] Updated weights for policy 1, policy_version 1571444 (0.0009) [2023-12-28 06:31:42,615][106226] Updated weights for policy 0, policy_version 1567923 (0.0008) [2023-12-28 06:31:43,349][106225] Updated weights for policy 1, policy_version 1571454 (0.0010) [2023-12-28 06:31:43,352][106226] Updated weights for policy 0, policy_version 1567933 (0.0009) [2023-12-28 06:31:43,403][106225] Updated weights for policy 1, policy_version 1571464 (0.0010) [2023-12-28 06:31:43,403][106226] Updated weights for policy 0, policy_version 1567943 (0.0011) [2023-12-28 06:31:43,457][106226] Updated weights for policy 0, policy_version 1567953 (0.0011) [2023-12-28 06:31:43,471][106225] Updated weights for policy 1, policy_version 1571474 (0.0010) [2023-12-28 06:31:44,106][106225] Updated weights for policy 1, policy_version 1571484 (0.0010) [2023-12-28 06:31:44,140][106226] Updated weights for policy 0, policy_version 1567963 (0.0009) [2023-12-28 06:31:44,153][106225] Updated weights for policy 1, policy_version 1571494 (0.0010) [2023-12-28 06:31:44,201][106226] Updated weights for policy 0, policy_version 1567973 (0.0006) [2023-12-28 06:31:44,211][106225] Updated weights for policy 1, policy_version 1571504 (0.0010) [2023-12-28 06:31:44,257][106226] Updated weights for policy 0, policy_version 1567983 (0.0006) [2023-12-28 06:31:44,939][106226] Updated weights for policy 0, policy_version 1567993 (0.0008) [2023-12-28 06:31:44,948][106225] Updated weights for policy 1, policy_version 1571514 (0.0010) [2023-12-28 06:31:45,001][106226] Updated weights for policy 0, policy_version 1568003 (0.0011) [2023-12-28 06:31:45,007][106225] Updated weights for policy 1, policy_version 1571524 (0.0010) [2023-12-28 06:31:45,065][106225] Updated weights for policy 1, policy_version 1571534 (0.0010) [2023-12-28 06:31:45,066][106226] Updated weights for policy 0, policy_version 1568013 (0.0010) [2023-12-28 06:31:45,122][106225] Updated weights for policy 1, policy_version 1571544 (0.0010) [2023-12-28 06:31:45,127][106226] Updated weights for policy 0, policy_version 1568023 (0.0011) [2023-12-28 06:31:45,816][106226] Updated weights for policy 0, policy_version 1568033 (0.0006) [2023-12-28 06:31:45,843][106225] Updated weights for policy 1, policy_version 1571554 (0.0010) [2023-12-28 06:31:45,880][106226] Updated weights for policy 0, policy_version 1568043 (0.0009) [2023-12-28 06:31:45,902][106225] Updated weights for policy 1, policy_version 1571564 (0.0009) [2023-12-28 06:31:45,937][106226] Updated weights for policy 0, policy_version 1568053 (0.0010) [2023-12-28 06:31:45,953][106225] Updated weights for policy 1, policy_version 1571574 (0.0005) [2023-12-28 06:31:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 803872768. Throughput: 0: 9863.8, 1: 9892.6. Samples: 803859136. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:46,175][105115] Avg episode reward: [(0, '-4.782'), (1, '-4.739')] [2023-12-28 06:31:46,588][106225] Updated weights for policy 1, policy_version 1571584 (0.0009) [2023-12-28 06:31:46,605][106226] Updated weights for policy 0, policy_version 1568063 (0.0010) [2023-12-28 06:31:46,635][106225] Updated weights for policy 1, policy_version 1571594 (0.0010) [2023-12-28 06:31:46,653][106226] Updated weights for policy 0, policy_version 1568073 (0.0011) [2023-12-28 06:31:46,686][106225] Updated weights for policy 1, policy_version 1571604 (0.0010) [2023-12-28 06:31:46,710][106226] Updated weights for policy 0, policy_version 1568083 (0.0009) [2023-12-28 06:31:47,403][106226] Updated weights for policy 0, policy_version 1568093 (0.0011) [2023-12-28 06:31:47,409][106225] Updated weights for policy 1, policy_version 1571614 (0.0007) [2023-12-28 06:31:47,461][106226] Updated weights for policy 0, policy_version 1568103 (0.0011) [2023-12-28 06:31:47,462][106225] Updated weights for policy 1, policy_version 1571624 (0.0007) [2023-12-28 06:31:47,521][106225] Updated weights for policy 1, policy_version 1571634 (0.0007) [2023-12-28 06:31:47,521][106226] Updated weights for policy 0, policy_version 1568113 (0.0011) [2023-12-28 06:31:48,116][106225] Updated weights for policy 1, policy_version 1571644 (0.0009) [2023-12-28 06:31:48,170][106225] Updated weights for policy 1, policy_version 1571654 (0.0007) [2023-12-28 06:31:48,212][106226] Updated weights for policy 0, policy_version 1568123 (0.0010) [2023-12-28 06:31:48,231][106225] Updated weights for policy 1, policy_version 1571664 (0.0007) [2023-12-28 06:31:48,260][106226] Updated weights for policy 0, policy_version 1568133 (0.0011) [2023-12-28 06:31:48,310][106226] Updated weights for policy 0, policy_version 1568143 (0.0010) [2023-12-28 06:31:48,998][106225] Updated weights for policy 1, policy_version 1571674 (0.0010) [2023-12-28 06:31:49,056][106225] Updated weights for policy 1, policy_version 1571684 (0.0010) [2023-12-28 06:31:49,062][106226] Updated weights for policy 0, policy_version 1568153 (0.0010) [2023-12-28 06:31:49,116][106225] Updated weights for policy 1, policy_version 1571694 (0.0010) [2023-12-28 06:31:49,121][106226] Updated weights for policy 0, policy_version 1568163 (0.0009) [2023-12-28 06:31:49,170][106225] Updated weights for policy 1, policy_version 1571704 (0.0010) [2023-12-28 06:31:49,176][106226] Updated weights for policy 0, policy_version 1568173 (0.0006) [2023-12-28 06:31:49,245][106226] Updated weights for policy 0, policy_version 1568183 (0.0009) [2023-12-28 06:31:49,824][106225] Updated weights for policy 1, policy_version 1571714 (0.0009) [2023-12-28 06:31:49,888][106225] Updated weights for policy 1, policy_version 1571724 (0.0009) [2023-12-28 06:31:49,938][106226] Updated weights for policy 0, policy_version 1568193 (0.0008) [2023-12-28 06:31:49,957][106225] Updated weights for policy 1, policy_version 1571734 (0.0008) [2023-12-28 06:31:49,996][106226] Updated weights for policy 0, policy_version 1568203 (0.0009) [2023-12-28 06:31:50,059][106226] Updated weights for policy 0, policy_version 1568213 (0.0009) [2023-12-28 06:31:50,733][106225] Updated weights for policy 1, policy_version 1571744 (0.0010) [2023-12-28 06:31:50,789][106226] Updated weights for policy 0, policy_version 1568223 (0.0007) [2023-12-28 06:31:50,794][106225] Updated weights for policy 1, policy_version 1571754 (0.0010) [2023-12-28 06:31:50,855][106226] Updated weights for policy 0, policy_version 1568233 (0.0006) [2023-12-28 06:31:50,857][106225] Updated weights for policy 1, policy_version 1571764 (0.0011) [2023-12-28 06:31:50,915][106226] Updated weights for policy 0, policy_version 1568243 (0.0008) [2023-12-28 06:31:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 803971072. Throughput: 0: 9824.4, 1: 9926.7. Samples: 803977936. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:51,175][105115] Avg episode reward: [(0, '-4.826'), (1, '-4.721')] [2023-12-28 06:31:51,579][106226] Updated weights for policy 0, policy_version 1568253 (0.0008) [2023-12-28 06:31:51,614][106225] Updated weights for policy 1, policy_version 1571774 (0.0010) [2023-12-28 06:31:51,639][106226] Updated weights for policy 0, policy_version 1568263 (0.0008) [2023-12-28 06:31:51,679][106225] Updated weights for policy 1, policy_version 1571784 (0.0008) [2023-12-28 06:31:51,694][106226] Updated weights for policy 0, policy_version 1568273 (0.0007) [2023-12-28 06:31:51,746][106225] Updated weights for policy 1, policy_version 1571794 (0.0008) [2023-12-28 06:31:52,445][106226] Updated weights for policy 0, policy_version 1568283 (0.0008) [2023-12-28 06:31:52,506][106226] Updated weights for policy 0, policy_version 1568293 (0.0009) [2023-12-28 06:31:52,520][106225] Updated weights for policy 1, policy_version 1571804 (0.0009) [2023-12-28 06:31:52,565][106226] Updated weights for policy 0, policy_version 1568303 (0.0005) [2023-12-28 06:31:52,578][106225] Updated weights for policy 1, policy_version 1571814 (0.0010) [2023-12-28 06:31:52,635][106225] Updated weights for policy 1, policy_version 1571824 (0.0010) [2023-12-28 06:31:53,299][106226] Updated weights for policy 0, policy_version 1568313 (0.0008) [2023-12-28 06:31:53,345][106226] Updated weights for policy 0, policy_version 1568323 (0.0008) [2023-12-28 06:31:53,372][106225] Updated weights for policy 1, policy_version 1571834 (0.0011) [2023-12-28 06:31:53,403][106226] Updated weights for policy 0, policy_version 1568333 (0.0008) [2023-12-28 06:31:53,423][106225] Updated weights for policy 1, policy_version 1571844 (0.0010) [2023-12-28 06:31:53,460][106226] Updated weights for policy 0, policy_version 1568343 (0.0006) [2023-12-28 06:31:53,481][106225] Updated weights for policy 1, policy_version 1571854 (0.0010) [2023-12-28 06:31:53,534][106225] Updated weights for policy 1, policy_version 1571864 (0.0010) [2023-12-28 06:31:54,188][106225] Updated weights for policy 1, policy_version 1571874 (0.0008) [2023-12-28 06:31:54,229][106226] Updated weights for policy 0, policy_version 1568353 (0.0007) [2023-12-28 06:31:54,250][106225] Updated weights for policy 1, policy_version 1571884 (0.0007) [2023-12-28 06:31:54,285][106226] Updated weights for policy 0, policy_version 1568363 (0.0008) [2023-12-28 06:31:54,307][106225] Updated weights for policy 1, policy_version 1571894 (0.0007) [2023-12-28 06:31:54,345][106226] Updated weights for policy 0, policy_version 1568373 (0.0008) [2023-12-28 06:31:54,969][106225] Updated weights for policy 1, policy_version 1571904 (0.0007) [2023-12-28 06:31:55,028][106225] Updated weights for policy 1, policy_version 1571914 (0.0008) [2023-12-28 06:31:55,064][106226] Updated weights for policy 0, policy_version 1568383 (0.0006) [2023-12-28 06:31:55,085][106225] Updated weights for policy 1, policy_version 1571924 (0.0009) [2023-12-28 06:31:55,129][106226] Updated weights for policy 0, policy_version 1568393 (0.0007) [2023-12-28 06:31:55,178][106226] Updated weights for policy 0, policy_version 1568403 (0.0009) [2023-12-28 06:31:55,817][106225] Updated weights for policy 1, policy_version 1571934 (0.0006) [2023-12-28 06:31:55,850][106226] Updated weights for policy 0, policy_version 1568413 (0.0007) [2023-12-28 06:31:55,880][106225] Updated weights for policy 1, policy_version 1571944 (0.0005) [2023-12-28 06:31:55,911][106226] Updated weights for policy 0, policy_version 1568423 (0.0005) [2023-12-28 06:31:55,939][106225] Updated weights for policy 1, policy_version 1571954 (0.0006) [2023-12-28 06:31:55,975][106226] Updated weights for policy 0, policy_version 1568433 (0.0005) [2023-12-28 06:31:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 804069376. Throughput: 0: 9791.3, 1: 9856.9. Samples: 804033672. Policy #0 lag: (min: 20.0, avg: 22.9, max: 52.0) [2023-12-28 06:31:56,175][105115] Avg episode reward: [(0, '-4.697'), (1, '-4.761')] [2023-12-28 06:31:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001568440_401596416.pth... [2023-12-28 06:31:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001571960_402472960.pth... [2023-12-28 06:31:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001567288_401301504.pth [2023-12-28 06:31:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001570808_402178048.pth [2023-12-28 06:31:56,524][106225] Updated weights for policy 1, policy_version 1571964 (0.0005) [2023-12-28 06:31:56,589][106225] Updated weights for policy 1, policy_version 1571974 (0.0006) [2023-12-28 06:31:56,600][106226] Updated weights for policy 0, policy_version 1568443 (0.0007) [2023-12-28 06:31:56,644][106225] Updated weights for policy 1, policy_version 1571984 (0.0005) [2023-12-28 06:31:56,652][106226] Updated weights for policy 0, policy_version 1568453 (0.0010) [2023-12-28 06:31:56,701][106226] Updated weights for policy 0, policy_version 1568463 (0.0010) [2023-12-28 06:31:57,153][106225] Updated weights for policy 1, policy_version 1571994 (0.0005) [2023-12-28 06:31:57,212][106225] Updated weights for policy 1, policy_version 1572004 (0.0005) [2023-12-28 06:31:57,265][106225] Updated weights for policy 1, policy_version 1572014 (0.0007) [2023-12-28 06:31:57,314][106225] Updated weights for policy 1, policy_version 1572024 (0.0010) [2023-12-28 06:31:57,363][106226] Updated weights for policy 0, policy_version 1568473 (0.0010) [2023-12-28 06:31:57,425][106226] Updated weights for policy 0, policy_version 1568483 (0.0005) [2023-12-28 06:31:57,480][106226] Updated weights for policy 0, policy_version 1568493 (0.0005) [2023-12-28 06:31:57,527][106226] Updated weights for policy 0, policy_version 1568503 (0.0005) [2023-12-28 06:31:57,992][106225] Updated weights for policy 1, policy_version 1572034 (0.0010) [2023-12-28 06:31:58,044][106225] Updated weights for policy 1, policy_version 1572044 (0.0010) [2023-12-28 06:31:58,089][106225] Updated weights for policy 1, policy_version 1572054 (0.0010) [2023-12-28 06:31:58,154][106226] Updated weights for policy 0, policy_version 1568513 (0.0010) [2023-12-28 06:31:58,218][106226] Updated weights for policy 0, policy_version 1568523 (0.0010) [2023-12-28 06:31:58,277][106226] Updated weights for policy 0, policy_version 1568533 (0.0008) [2023-12-28 06:31:58,939][106225] Updated weights for policy 1, policy_version 1572064 (0.0009) [2023-12-28 06:31:59,000][106225] Updated weights for policy 1, policy_version 1572074 (0.0009) [2023-12-28 06:31:59,053][106225] Updated weights for policy 1, policy_version 1572084 (0.0009) [2023-12-28 06:31:59,085][106226] Updated weights for policy 0, policy_version 1568543 (0.0008) [2023-12-28 06:31:59,150][106226] Updated weights for policy 0, policy_version 1568553 (0.0009) [2023-12-28 06:31:59,215][106226] Updated weights for policy 0, policy_version 1568563 (0.0011) [2023-12-28 06:31:59,857][106225] Updated weights for policy 1, policy_version 1572094 (0.0008) [2023-12-28 06:31:59,912][106225] Updated weights for policy 1, policy_version 1572104 (0.0009) [2023-12-28 06:31:59,971][106225] Updated weights for policy 1, policy_version 1572114 (0.0009) [2023-12-28 06:32:00,022][106226] Updated weights for policy 0, policy_version 1568573 (0.0008) [2023-12-28 06:32:00,083][106226] Updated weights for policy 0, policy_version 1568583 (0.0005) [2023-12-28 06:32:00,145][106226] Updated weights for policy 0, policy_version 1568593 (0.0005) [2023-12-28 06:32:00,760][106225] Updated weights for policy 1, policy_version 1572124 (0.0009) [2023-12-28 06:32:00,803][106226] Updated weights for policy 0, policy_version 1568603 (0.0006) [2023-12-28 06:32:00,809][106225] Updated weights for policy 1, policy_version 1572134 (0.0007) [2023-12-28 06:32:00,856][106225] Updated weights for policy 1, policy_version 1572144 (0.0009) [2023-12-28 06:32:00,862][106226] Updated weights for policy 0, policy_version 1568613 (0.0008) [2023-12-28 06:32:00,911][106226] Updated weights for policy 0, policy_version 1568623 (0.0006) [2023-12-28 06:32:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 804167680. Throughput: 0: 9834.7, 1: 9920.1. Samples: 804154472. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:01,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.546')] [2023-12-28 06:32:01,564][106225] Updated weights for policy 1, policy_version 1572154 (0.0007) [2023-12-28 06:32:01,623][106225] Updated weights for policy 1, policy_version 1572164 (0.0010) [2023-12-28 06:32:01,662][106226] Updated weights for policy 0, policy_version 1568633 (0.0007) [2023-12-28 06:32:01,688][106225] Updated weights for policy 1, policy_version 1572174 (0.0011) [2023-12-28 06:32:01,724][106226] Updated weights for policy 0, policy_version 1568643 (0.0007) [2023-12-28 06:32:01,756][106225] Updated weights for policy 1, policy_version 1572184 (0.0010) [2023-12-28 06:32:01,791][106226] Updated weights for policy 0, policy_version 1568653 (0.0010) [2023-12-28 06:32:01,854][106226] Updated weights for policy 0, policy_version 1568663 (0.0010) [2023-12-28 06:32:02,484][106225] Updated weights for policy 1, policy_version 1572194 (0.0010) [2023-12-28 06:32:02,539][106225] Updated weights for policy 1, policy_version 1572204 (0.0010) [2023-12-28 06:32:02,557][106226] Updated weights for policy 0, policy_version 1568673 (0.0010) [2023-12-28 06:32:02,591][106225] Updated weights for policy 1, policy_version 1572214 (0.0010) [2023-12-28 06:32:02,615][106226] Updated weights for policy 0, policy_version 1568683 (0.0010) [2023-12-28 06:32:02,675][106226] Updated weights for policy 0, policy_version 1568693 (0.0009) [2023-12-28 06:32:03,274][106226] Updated weights for policy 0, policy_version 1568703 (0.0006) [2023-12-28 06:32:03,281][106225] Updated weights for policy 1, policy_version 1572224 (0.0006) [2023-12-28 06:32:03,325][106226] Updated weights for policy 0, policy_version 1568713 (0.0005) [2023-12-28 06:32:03,338][106225] Updated weights for policy 1, policy_version 1572234 (0.0005) [2023-12-28 06:32:03,387][106226] Updated weights for policy 0, policy_version 1568723 (0.0007) [2023-12-28 06:32:03,400][106225] Updated weights for policy 1, policy_version 1572244 (0.0006) [2023-12-28 06:32:03,949][106225] Updated weights for policy 1, policy_version 1572254 (0.0008) [2023-12-28 06:32:04,011][106225] Updated weights for policy 1, policy_version 1572264 (0.0009) [2023-12-28 06:32:04,017][106226] Updated weights for policy 0, policy_version 1568733 (0.0006) [2023-12-28 06:32:04,065][106225] Updated weights for policy 1, policy_version 1572274 (0.0007) [2023-12-28 06:32:04,087][106226] Updated weights for policy 0, policy_version 1568743 (0.0008) [2023-12-28 06:32:04,154][106226] Updated weights for policy 0, policy_version 1568753 (0.0009) [2023-12-28 06:32:04,749][106225] Updated weights for policy 1, policy_version 1572284 (0.0008) [2023-12-28 06:32:04,752][106226] Updated weights for policy 0, policy_version 1568763 (0.0008) [2023-12-28 06:32:04,804][106226] Updated weights for policy 0, policy_version 1568773 (0.0007) [2023-12-28 06:32:04,808][106225] Updated weights for policy 1, policy_version 1572294 (0.0009) [2023-12-28 06:32:04,865][106225] Updated weights for policy 1, policy_version 1572304 (0.0007) [2023-12-28 06:32:04,867][106226] Updated weights for policy 0, policy_version 1568783 (0.0008) [2023-12-28 06:32:05,409][106225] Updated weights for policy 1, policy_version 1572314 (0.0007) [2023-12-28 06:32:05,460][106225] Updated weights for policy 1, policy_version 1572324 (0.0006) [2023-12-28 06:32:05,479][106226] Updated weights for policy 0, policy_version 1568793 (0.0006) [2023-12-28 06:32:05,512][106225] Updated weights for policy 1, policy_version 1572334 (0.0007) [2023-12-28 06:32:05,534][106226] Updated weights for policy 0, policy_version 1568803 (0.0006) [2023-12-28 06:32:05,566][106225] Updated weights for policy 1, policy_version 1572344 (0.0006) [2023-12-28 06:32:05,585][106226] Updated weights for policy 0, policy_version 1568813 (0.0007) [2023-12-28 06:32:05,636][106226] Updated weights for policy 0, policy_version 1568823 (0.0009) [2023-12-28 06:32:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 804265984. Throughput: 0: 9917.3, 1: 10001.1. Samples: 804278604. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:06,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-4.702')] [2023-12-28 06:32:06,223][106225] Updated weights for policy 1, policy_version 1572354 (0.0008) [2023-12-28 06:32:06,294][106225] Updated weights for policy 1, policy_version 1572364 (0.0009) [2023-12-28 06:32:06,350][106225] Updated weights for policy 1, policy_version 1572374 (0.0008) [2023-12-28 06:32:06,386][106226] Updated weights for policy 0, policy_version 1568833 (0.0007) [2023-12-28 06:32:06,442][106226] Updated weights for policy 0, policy_version 1568843 (0.0009) [2023-12-28 06:32:06,500][106226] Updated weights for policy 0, policy_version 1568853 (0.0008) [2023-12-28 06:32:07,101][106225] Updated weights for policy 1, policy_version 1572384 (0.0008) [2023-12-28 06:32:07,147][106226] Updated weights for policy 0, policy_version 1568863 (0.0009) [2023-12-28 06:32:07,157][106225] Updated weights for policy 1, policy_version 1572394 (0.0008) [2023-12-28 06:32:07,205][106226] Updated weights for policy 0, policy_version 1568873 (0.0011) [2023-12-28 06:32:07,209][106225] Updated weights for policy 1, policy_version 1572404 (0.0008) [2023-12-28 06:32:07,267][106226] Updated weights for policy 0, policy_version 1568883 (0.0011) [2023-12-28 06:32:07,858][106225] Updated weights for policy 1, policy_version 1572414 (0.0007) [2023-12-28 06:32:07,908][106225] Updated weights for policy 1, policy_version 1572424 (0.0005) [2023-12-28 06:32:07,920][106226] Updated weights for policy 0, policy_version 1568893 (0.0009) [2023-12-28 06:32:07,965][106225] Updated weights for policy 1, policy_version 1572434 (0.0006) [2023-12-28 06:32:07,989][106226] Updated weights for policy 0, policy_version 1568903 (0.0006) [2023-12-28 06:32:08,041][106226] Updated weights for policy 0, policy_version 1568913 (0.0007) [2023-12-28 06:32:08,593][106225] Updated weights for policy 1, policy_version 1572444 (0.0007) [2023-12-28 06:32:08,655][106225] Updated weights for policy 1, policy_version 1572454 (0.0008) [2023-12-28 06:32:08,720][106225] Updated weights for policy 1, policy_version 1572464 (0.0009) [2023-12-28 06:32:08,731][106226] Updated weights for policy 0, policy_version 1568923 (0.0008) [2023-12-28 06:32:08,795][106226] Updated weights for policy 0, policy_version 1568933 (0.0007) [2023-12-28 06:32:08,857][106226] Updated weights for policy 0, policy_version 1568943 (0.0008) [2023-12-28 06:32:09,339][106225] Updated weights for policy 1, policy_version 1572474 (0.0008) [2023-12-28 06:32:09,400][106225] Updated weights for policy 1, policy_version 1572484 (0.0008) [2023-12-28 06:32:09,457][106225] Updated weights for policy 1, policy_version 1572494 (0.0007) [2023-12-28 06:32:09,526][106225] Updated weights for policy 1, policy_version 1572504 (0.0007) [2023-12-28 06:32:09,597][106226] Updated weights for policy 0, policy_version 1568953 (0.0006) [2023-12-28 06:32:09,661][106226] Updated weights for policy 0, policy_version 1568963 (0.0007) [2023-12-28 06:32:09,727][106226] Updated weights for policy 0, policy_version 1568973 (0.0008) [2023-12-28 06:32:09,794][106226] Updated weights for policy 0, policy_version 1568983 (0.0009) [2023-12-28 06:32:10,262][106225] Updated weights for policy 1, policy_version 1572514 (0.0009) [2023-12-28 06:32:10,326][106225] Updated weights for policy 1, policy_version 1572524 (0.0009) [2023-12-28 06:32:10,397][106225] Updated weights for policy 1, policy_version 1572534 (0.0009) [2023-12-28 06:32:10,516][106226] Updated weights for policy 0, policy_version 1568993 (0.0008) [2023-12-28 06:32:10,578][106226] Updated weights for policy 0, policy_version 1569003 (0.0009) [2023-12-28 06:32:10,643][106226] Updated weights for policy 0, policy_version 1569013 (0.0009) [2023-12-28 06:32:11,145][106225] Updated weights for policy 1, policy_version 1572544 (0.0008) [2023-12-28 06:32:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 804364288. Throughput: 0: 9951.1, 1: 10035.5. Samples: 804339952. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:11,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-4.505')] [2023-12-28 06:32:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001569016_401743872.pth... [2023-12-28 06:32:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001567864_401448960.pth [2023-12-28 06:32:11,216][106225] Updated weights for policy 1, policy_version 1572554 (0.0008) [2023-12-28 06:32:11,287][106225] Updated weights for policy 1, policy_version 1572564 (0.0008) [2023-12-28 06:32:11,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001572568_402628608.pth... [2023-12-28 06:32:11,319][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001571384_402325504.pth [2023-12-28 06:32:11,398][106226] Updated weights for policy 0, policy_version 1569025 (0.0009) [2023-12-28 06:32:11,450][106226] Updated weights for policy 0, policy_version 1569035 (0.0008) [2023-12-28 06:32:11,505][106226] Updated weights for policy 0, policy_version 1569045 (0.0008) [2023-12-28 06:32:12,000][106225] Updated weights for policy 1, policy_version 1572574 (0.0007) [2023-12-28 06:32:12,060][106225] Updated weights for policy 1, policy_version 1572584 (0.0008) [2023-12-28 06:32:12,122][106225] Updated weights for policy 1, policy_version 1572594 (0.0008) [2023-12-28 06:32:12,316][106226] Updated weights for policy 0, policy_version 1569055 (0.0008) [2023-12-28 06:32:12,391][106226] Updated weights for policy 0, policy_version 1569065 (0.0009) [2023-12-28 06:32:12,458][106226] Updated weights for policy 0, policy_version 1569075 (0.0009) [2023-12-28 06:32:12,837][106225] Updated weights for policy 1, policy_version 1572604 (0.0008) [2023-12-28 06:32:12,899][106225] Updated weights for policy 1, policy_version 1572614 (0.0007) [2023-12-28 06:32:12,964][106225] Updated weights for policy 1, policy_version 1572624 (0.0009) [2023-12-28 06:32:13,158][106226] Updated weights for policy 0, policy_version 1569085 (0.0009) [2023-12-28 06:32:13,212][106226] Updated weights for policy 0, policy_version 1569095 (0.0009) [2023-12-28 06:32:13,265][106226] Updated weights for policy 0, policy_version 1569105 (0.0008) [2023-12-28 06:32:13,648][106225] Updated weights for policy 1, policy_version 1572635 (0.0009) [2023-12-28 06:32:13,702][106225] Updated weights for policy 1, policy_version 1572645 (0.0010) [2023-12-28 06:32:13,758][106225] Updated weights for policy 1, policy_version 1572655 (0.0009) [2023-12-28 06:32:14,018][106226] Updated weights for policy 0, policy_version 1569115 (0.0008) [2023-12-28 06:32:14,081][106226] Updated weights for policy 0, policy_version 1569125 (0.0008) [2023-12-28 06:32:14,140][106226] Updated weights for policy 0, policy_version 1569135 (0.0008) [2023-12-28 06:32:14,442][106225] Updated weights for policy 1, policy_version 1572665 (0.0006) [2023-12-28 06:32:14,493][106225] Updated weights for policy 1, policy_version 1572675 (0.0011) [2023-12-28 06:32:14,551][106225] Updated weights for policy 1, policy_version 1572685 (0.0010) [2023-12-28 06:32:14,605][106225] Updated weights for policy 1, policy_version 1572695 (0.0010) [2023-12-28 06:32:14,876][106226] Updated weights for policy 0, policy_version 1569145 (0.0007) [2023-12-28 06:32:14,940][106226] Updated weights for policy 0, policy_version 1569155 (0.0008) [2023-12-28 06:32:15,003][106226] Updated weights for policy 0, policy_version 1569165 (0.0009) [2023-12-28 06:32:15,064][106226] Updated weights for policy 0, policy_version 1569175 (0.0009) [2023-12-28 06:32:15,403][106225] Updated weights for policy 1, policy_version 1572705 (0.0009) [2023-12-28 06:32:15,464][106225] Updated weights for policy 1, policy_version 1572715 (0.0009) [2023-12-28 06:32:15,524][106225] Updated weights for policy 1, policy_version 1572725 (0.0008) [2023-12-28 06:32:15,711][106226] Updated weights for policy 0, policy_version 1569185 (0.0008) [2023-12-28 06:32:15,769][106226] Updated weights for policy 0, policy_version 1569195 (0.0008) [2023-12-28 06:32:15,826][106226] Updated weights for policy 0, policy_version 1569205 (0.0009) [2023-12-28 06:32:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 804462592. Throughput: 0: 9832.6, 1: 9916.1. Samples: 804454148. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:16,175][105115] Avg episode reward: [(0, '-4.670'), (1, '-4.735')] [2023-12-28 06:32:16,295][106225] Updated weights for policy 1, policy_version 1572735 (0.0006) [2023-12-28 06:32:16,347][106225] Updated weights for policy 1, policy_version 1572745 (0.0005) [2023-12-28 06:32:16,410][106225] Updated weights for policy 1, policy_version 1572755 (0.0005) [2023-12-28 06:32:16,500][106226] Updated weights for policy 0, policy_version 1569215 (0.0005) [2023-12-28 06:32:16,553][106226] Updated weights for policy 0, policy_version 1569225 (0.0005) [2023-12-28 06:32:16,598][106226] Updated weights for policy 0, policy_version 1569235 (0.0005) [2023-12-28 06:32:16,994][106225] Updated weights for policy 1, policy_version 1572765 (0.0005) [2023-12-28 06:32:17,048][106225] Updated weights for policy 1, policy_version 1572775 (0.0005) [2023-12-28 06:32:17,101][106225] Updated weights for policy 1, policy_version 1572785 (0.0005) [2023-12-28 06:32:17,320][106226] Updated weights for policy 0, policy_version 1569245 (0.0005) [2023-12-28 06:32:17,372][106226] Updated weights for policy 0, policy_version 1569255 (0.0006) [2023-12-28 06:32:17,421][106226] Updated weights for policy 0, policy_version 1569265 (0.0009) [2023-12-28 06:32:17,649][106225] Updated weights for policy 1, policy_version 1572795 (0.0008) [2023-12-28 06:32:17,707][106225] Updated weights for policy 1, policy_version 1572805 (0.0007) [2023-12-28 06:32:17,769][106225] Updated weights for policy 1, policy_version 1572815 (0.0007) [2023-12-28 06:32:18,159][106226] Updated weights for policy 0, policy_version 1569275 (0.0007) [2023-12-28 06:32:18,220][106226] Updated weights for policy 0, policy_version 1569285 (0.0008) [2023-12-28 06:32:18,279][106226] Updated weights for policy 0, policy_version 1569295 (0.0008) [2023-12-28 06:32:18,459][106225] Updated weights for policy 1, policy_version 1572825 (0.0010) [2023-12-28 06:32:18,523][106225] Updated weights for policy 1, policy_version 1572835 (0.0006) [2023-12-28 06:32:18,585][106225] Updated weights for policy 1, policy_version 1572845 (0.0008) [2023-12-28 06:32:18,641][106225] Updated weights for policy 1, policy_version 1572855 (0.0008) [2023-12-28 06:32:19,006][106226] Updated weights for policy 0, policy_version 1569305 (0.0007) [2023-12-28 06:32:19,061][106226] Updated weights for policy 0, policy_version 1569315 (0.0008) [2023-12-28 06:32:19,124][106226] Updated weights for policy 0, policy_version 1569325 (0.0008) [2023-12-28 06:32:19,184][106226] Updated weights for policy 0, policy_version 1569335 (0.0007) [2023-12-28 06:32:19,322][106225] Updated weights for policy 1, policy_version 1572865 (0.0006) [2023-12-28 06:32:19,388][106225] Updated weights for policy 1, policy_version 1572875 (0.0009) [2023-12-28 06:32:19,440][106225] Updated weights for policy 1, policy_version 1572885 (0.0008) [2023-12-28 06:32:19,958][106226] Updated weights for policy 0, policy_version 1569345 (0.0007) [2023-12-28 06:32:20,031][106226] Updated weights for policy 0, policy_version 1569355 (0.0006) [2023-12-28 06:32:20,099][106226] Updated weights for policy 0, policy_version 1569365 (0.0007) [2023-12-28 06:32:20,145][106225] Updated weights for policy 1, policy_version 1572895 (0.0008) [2023-12-28 06:32:20,210][106225] Updated weights for policy 1, policy_version 1572905 (0.0010) [2023-12-28 06:32:20,275][106225] Updated weights for policy 1, policy_version 1572915 (0.0008) [2023-12-28 06:32:20,807][106226] Updated weights for policy 0, policy_version 1569375 (0.0008) [2023-12-28 06:32:20,872][106226] Updated weights for policy 0, policy_version 1569385 (0.0009) [2023-12-28 06:32:20,935][106226] Updated weights for policy 0, policy_version 1569395 (0.0008) [2023-12-28 06:32:20,950][106225] Updated weights for policy 1, policy_version 1572925 (0.0009) [2023-12-28 06:32:21,016][106225] Updated weights for policy 1, policy_version 1572935 (0.0007) [2023-12-28 06:32:21,092][106225] Updated weights for policy 1, policy_version 1572946 (0.0008) [2023-12-28 06:32:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 804569088. Throughput: 0: 9794.8, 1: 9974.2. Samples: 804573480. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:21,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.533')] [2023-12-28 06:32:21,762][106226] Updated weights for policy 0, policy_version 1569405 (0.0007) [2023-12-28 06:32:21,815][106226] Updated weights for policy 0, policy_version 1569415 (0.0006) [2023-12-28 06:32:21,878][106226] Updated weights for policy 0, policy_version 1569425 (0.0007) [2023-12-28 06:32:21,888][106225] Updated weights for policy 1, policy_version 1572956 (0.0009) [2023-12-28 06:32:21,949][106225] Updated weights for policy 1, policy_version 1572966 (0.0007) [2023-12-28 06:32:22,016][106225] Updated weights for policy 1, policy_version 1572976 (0.0009) [2023-12-28 06:32:22,637][106226] Updated weights for policy 0, policy_version 1569435 (0.0007) [2023-12-28 06:32:22,698][106226] Updated weights for policy 0, policy_version 1569445 (0.0009) [2023-12-28 06:32:22,742][106225] Updated weights for policy 1, policy_version 1572986 (0.0009) [2023-12-28 06:32:22,769][106226] Updated weights for policy 0, policy_version 1569455 (0.0009) [2023-12-28 06:32:22,804][106225] Updated weights for policy 1, policy_version 1572996 (0.0010) [2023-12-28 06:32:22,866][106225] Updated weights for policy 1, policy_version 1573006 (0.0009) [2023-12-28 06:32:22,928][106225] Updated weights for policy 1, policy_version 1573016 (0.0008) [2023-12-28 06:32:23,435][106226] Updated weights for policy 0, policy_version 1569465 (0.0009) [2023-12-28 06:32:23,498][106226] Updated weights for policy 0, policy_version 1569475 (0.0009) [2023-12-28 06:32:23,556][106226] Updated weights for policy 0, policy_version 1569485 (0.0008) [2023-12-28 06:32:23,610][106226] Updated weights for policy 0, policy_version 1569495 (0.0008) [2023-12-28 06:32:23,613][106225] Updated weights for policy 1, policy_version 1573026 (0.0010) [2023-12-28 06:32:23,666][106225] Updated weights for policy 1, policy_version 1573036 (0.0006) [2023-12-28 06:32:23,728][106225] Updated weights for policy 1, policy_version 1573046 (0.0008) [2023-12-28 06:32:24,241][106226] Updated weights for policy 0, policy_version 1569505 (0.0005) [2023-12-28 06:32:24,303][106226] Updated weights for policy 0, policy_version 1569515 (0.0008) [2023-12-28 06:32:24,364][106226] Updated weights for policy 0, policy_version 1569525 (0.0010) [2023-12-28 06:32:24,419][106225] Updated weights for policy 1, policy_version 1573056 (0.0006) [2023-12-28 06:32:24,484][106225] Updated weights for policy 1, policy_version 1573066 (0.0007) [2023-12-28 06:32:24,548][106225] Updated weights for policy 1, policy_version 1573076 (0.0006) [2023-12-28 06:32:25,016][106226] Updated weights for policy 0, policy_version 1569535 (0.0011) [2023-12-28 06:32:25,073][106226] Updated weights for policy 0, policy_version 1569545 (0.0010) [2023-12-28 06:32:25,128][106226] Updated weights for policy 0, policy_version 1569555 (0.0010) [2023-12-28 06:32:25,173][106225] Updated weights for policy 1, policy_version 1573086 (0.0006) [2023-12-28 06:32:25,232][106225] Updated weights for policy 1, policy_version 1573096 (0.0007) [2023-12-28 06:32:25,285][106225] Updated weights for policy 1, policy_version 1573106 (0.0007) [2023-12-28 06:32:25,820][106226] Updated weights for policy 0, policy_version 1569565 (0.0009) [2023-12-28 06:32:25,875][106226] Updated weights for policy 0, policy_version 1569575 (0.0010) [2023-12-28 06:32:25,905][106225] Updated weights for policy 1, policy_version 1573116 (0.0007) [2023-12-28 06:32:25,931][106226] Updated weights for policy 0, policy_version 1569585 (0.0007) [2023-12-28 06:32:25,961][106225] Updated weights for policy 1, policy_version 1573126 (0.0006) [2023-12-28 06:32:26,021][106225] Updated weights for policy 1, policy_version 1573136 (0.0007) [2023-12-28 06:32:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 804667392. Throughput: 0: 9764.1, 1: 9950.4. Samples: 804630344. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:26,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.322')] [2023-12-28 06:32:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001573144_402776064.pth... [2023-12-28 06:32:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001569592_401891328.pth... [2023-12-28 06:32:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001571960_402472960.pth [2023-12-28 06:32:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001568440_401596416.pth [2023-12-28 06:32:26,671][106225] Updated weights for policy 1, policy_version 1573146 (0.0008) [2023-12-28 06:32:26,719][106226] Updated weights for policy 0, policy_version 1569595 (0.0008) [2023-12-28 06:32:26,730][106225] Updated weights for policy 1, policy_version 1573156 (0.0005) [2023-12-28 06:32:26,773][106226] Updated weights for policy 0, policy_version 1569605 (0.0007) [2023-12-28 06:32:26,787][106225] Updated weights for policy 1, policy_version 1573166 (0.0006) [2023-12-28 06:32:26,821][106226] Updated weights for policy 0, policy_version 1569615 (0.0006) [2023-12-28 06:32:26,836][106225] Updated weights for policy 1, policy_version 1573176 (0.0005) [2023-12-28 06:32:27,426][106225] Updated weights for policy 1, policy_version 1573186 (0.0005) [2023-12-28 06:32:27,489][106225] Updated weights for policy 1, policy_version 1573196 (0.0005) [2023-12-28 06:32:27,540][106225] Updated weights for policy 1, policy_version 1573206 (0.0005) [2023-12-28 06:32:27,603][106226] Updated weights for policy 0, policy_version 1569625 (0.0007) [2023-12-28 06:32:27,663][106226] Updated weights for policy 0, policy_version 1569635 (0.0009) [2023-12-28 06:32:27,719][106226] Updated weights for policy 0, policy_version 1569645 (0.0009) [2023-12-28 06:32:27,775][106226] Updated weights for policy 0, policy_version 1569655 (0.0008) [2023-12-28 06:32:28,149][106225] Updated weights for policy 1, policy_version 1573216 (0.0007) [2023-12-28 06:32:28,210][106225] Updated weights for policy 1, policy_version 1573226 (0.0008) [2023-12-28 06:32:28,264][106225] Updated weights for policy 1, policy_version 1573236 (0.0005) [2023-12-28 06:32:28,442][106226] Updated weights for policy 0, policy_version 1569665 (0.0008) [2023-12-28 06:32:28,500][106226] Updated weights for policy 0, policy_version 1569675 (0.0008) [2023-12-28 06:32:28,566][106226] Updated weights for policy 0, policy_version 1569685 (0.0009) [2023-12-28 06:32:28,950][106225] Updated weights for policy 1, policy_version 1573246 (0.0010) [2023-12-28 06:32:28,992][106225] Updated weights for policy 1, policy_version 1573256 (0.0010) [2023-12-28 06:32:29,044][106225] Updated weights for policy 1, policy_version 1573266 (0.0010) [2023-12-28 06:32:29,354][106226] Updated weights for policy 0, policy_version 1569695 (0.0007) [2023-12-28 06:32:29,426][106226] Updated weights for policy 0, policy_version 1569705 (0.0009) [2023-12-28 06:32:29,489][106226] Updated weights for policy 0, policy_version 1569715 (0.0010) [2023-12-28 06:32:29,717][106225] Updated weights for policy 1, policy_version 1573276 (0.0010) [2023-12-28 06:32:29,778][106225] Updated weights for policy 1, policy_version 1573286 (0.0010) [2023-12-28 06:32:29,845][106225] Updated weights for policy 1, policy_version 1573296 (0.0010) [2023-12-28 06:32:30,271][106226] Updated weights for policy 0, policy_version 1569725 (0.0010) [2023-12-28 06:32:30,327][106226] Updated weights for policy 0, policy_version 1569735 (0.0010) [2023-12-28 06:32:30,381][106226] Updated weights for policy 0, policy_version 1569745 (0.0010) [2023-12-28 06:32:30,431][106225] Updated weights for policy 1, policy_version 1573306 (0.0007) [2023-12-28 06:32:30,478][106225] Updated weights for policy 1, policy_version 1573316 (0.0010) [2023-12-28 06:32:30,527][106225] Updated weights for policy 1, policy_version 1573326 (0.0010) [2023-12-28 06:32:30,577][106225] Updated weights for policy 1, policy_version 1573336 (0.0010) [2023-12-28 06:32:31,067][106226] Updated weights for policy 0, policy_version 1569755 (0.0010) [2023-12-28 06:32:31,126][106226] Updated weights for policy 0, policy_version 1569765 (0.0009) [2023-12-28 06:32:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 804757504. Throughput: 0: 9749.9, 1: 10087.4. Samples: 804751812. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:31,175][105115] Avg episode reward: [(0, '-4.681'), (1, '-4.938')] [2023-12-28 06:32:31,198][106226] Updated weights for policy 0, policy_version 1569775 (0.0008) [2023-12-28 06:32:31,200][106225] Updated weights for policy 1, policy_version 1573346 (0.0008) [2023-12-28 06:32:31,264][106225] Updated weights for policy 1, policy_version 1573356 (0.0010) [2023-12-28 06:32:31,329][106225] Updated weights for policy 1, policy_version 1573366 (0.0010) [2023-12-28 06:32:31,912][106226] Updated weights for policy 0, policy_version 1569785 (0.0007) [2023-12-28 06:32:31,969][106226] Updated weights for policy 0, policy_version 1569795 (0.0008) [2023-12-28 06:32:32,027][106226] Updated weights for policy 0, policy_version 1569805 (0.0007) [2023-12-28 06:32:32,045][106225] Updated weights for policy 1, policy_version 1573376 (0.0010) [2023-12-28 06:32:32,091][106226] Updated weights for policy 0, policy_version 1569815 (0.0009) [2023-12-28 06:32:32,105][106225] Updated weights for policy 1, policy_version 1573386 (0.0010) [2023-12-28 06:32:32,166][106225] Updated weights for policy 1, policy_version 1573396 (0.0010) [2023-12-28 06:32:32,826][106226] Updated weights for policy 0, policy_version 1569825 (0.0008) [2023-12-28 06:32:32,862][106225] Updated weights for policy 1, policy_version 1573406 (0.0007) [2023-12-28 06:32:32,883][106226] Updated weights for policy 0, policy_version 1569835 (0.0008) [2023-12-28 06:32:32,917][106225] Updated weights for policy 1, policy_version 1573416 (0.0006) [2023-12-28 06:32:32,934][106226] Updated weights for policy 0, policy_version 1569845 (0.0006) [2023-12-28 06:32:32,965][106225] Updated weights for policy 1, policy_version 1573426 (0.0007) [2023-12-28 06:32:33,573][106226] Updated weights for policy 0, policy_version 1569855 (0.0010) [2023-12-28 06:32:33,622][106226] Updated weights for policy 0, policy_version 1569865 (0.0010) [2023-12-28 06:32:33,666][106225] Updated weights for policy 1, policy_version 1573436 (0.0008) [2023-12-28 06:32:33,688][106226] Updated weights for policy 0, policy_version 1569875 (0.0011) [2023-12-28 06:32:33,720][106225] Updated weights for policy 1, policy_version 1573446 (0.0005) [2023-12-28 06:32:33,782][106225] Updated weights for policy 1, policy_version 1573456 (0.0008) [2023-12-28 06:32:34,429][106226] Updated weights for policy 0, policy_version 1569885 (0.0009) [2023-12-28 06:32:34,440][106225] Updated weights for policy 1, policy_version 1573466 (0.0006) [2023-12-28 06:32:34,494][106226] Updated weights for policy 0, policy_version 1569895 (0.0011) [2023-12-28 06:32:34,506][106225] Updated weights for policy 1, policy_version 1573476 (0.0008) [2023-12-28 06:32:34,557][106226] Updated weights for policy 0, policy_version 1569905 (0.0010) [2023-12-28 06:32:34,571][106225] Updated weights for policy 1, policy_version 1573486 (0.0005) [2023-12-28 06:32:34,637][106225] Updated weights for policy 1, policy_version 1573496 (0.0007) [2023-12-28 06:32:35,146][106226] Updated weights for policy 0, policy_version 1569915 (0.0009) [2023-12-28 06:32:35,209][106226] Updated weights for policy 0, policy_version 1569925 (0.0005) [2023-12-28 06:32:35,270][106226] Updated weights for policy 0, policy_version 1569935 (0.0005) [2023-12-28 06:32:35,302][106225] Updated weights for policy 1, policy_version 1573506 (0.0005) [2023-12-28 06:32:35,348][106225] Updated weights for policy 1, policy_version 1573516 (0.0005) [2023-12-28 06:32:35,403][106225] Updated weights for policy 1, policy_version 1573526 (0.0005) [2023-12-28 06:32:35,817][106226] Updated weights for policy 0, policy_version 1569945 (0.0006) [2023-12-28 06:32:35,867][106226] Updated weights for policy 0, policy_version 1569955 (0.0010) [2023-12-28 06:32:35,918][106226] Updated weights for policy 0, policy_version 1569965 (0.0010) [2023-12-28 06:32:35,942][106225] Updated weights for policy 1, policy_version 1573536 (0.0009) [2023-12-28 06:32:35,982][106226] Updated weights for policy 0, policy_version 1569975 (0.0011) [2023-12-28 06:32:35,992][106225] Updated weights for policy 1, policy_version 1573546 (0.0010) [2023-12-28 06:32:36,043][106225] Updated weights for policy 1, policy_version 1573556 (0.0010) [2023-12-28 06:32:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 804872192. Throughput: 0: 9809.1, 1: 10145.2. Samples: 804875880. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:36,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-4.786')] [2023-12-28 06:32:36,688][106226] Updated weights for policy 0, policy_version 1569985 (0.0011) [2023-12-28 06:32:36,752][106226] Updated weights for policy 0, policy_version 1569995 (0.0011) [2023-12-28 06:32:36,765][106225] Updated weights for policy 1, policy_version 1573566 (0.0010) [2023-12-28 06:32:36,807][106226] Updated weights for policy 0, policy_version 1570005 (0.0010) [2023-12-28 06:32:36,823][106225] Updated weights for policy 1, policy_version 1573576 (0.0010) [2023-12-28 06:32:36,884][106225] Updated weights for policy 1, policy_version 1573586 (0.0010) [2023-12-28 06:32:37,529][106226] Updated weights for policy 0, policy_version 1570015 (0.0006) [2023-12-28 06:32:37,584][106226] Updated weights for policy 0, policy_version 1570025 (0.0008) [2023-12-28 06:32:37,601][106225] Updated weights for policy 1, policy_version 1573596 (0.0009) [2023-12-28 06:32:37,643][106226] Updated weights for policy 0, policy_version 1570035 (0.0010) [2023-12-28 06:32:37,659][106225] Updated weights for policy 1, policy_version 1573606 (0.0006) [2023-12-28 06:32:37,721][106225] Updated weights for policy 1, policy_version 1573616 (0.0011) [2023-12-28 06:32:38,361][106226] Updated weights for policy 0, policy_version 1570045 (0.0009) [2023-12-28 06:32:38,405][106225] Updated weights for policy 1, policy_version 1573626 (0.0007) [2023-12-28 06:32:38,423][106226] Updated weights for policy 0, policy_version 1570055 (0.0008) [2023-12-28 06:32:38,461][106225] Updated weights for policy 1, policy_version 1573636 (0.0009) [2023-12-28 06:32:38,479][106226] Updated weights for policy 0, policy_version 1570065 (0.0007) [2023-12-28 06:32:38,516][106225] Updated weights for policy 1, policy_version 1573646 (0.0010) [2023-12-28 06:32:38,573][106225] Updated weights for policy 1, policy_version 1573656 (0.0010) [2023-12-28 06:32:39,212][106226] Updated weights for policy 0, policy_version 1570075 (0.0006) [2023-12-28 06:32:39,285][106226] Updated weights for policy 0, policy_version 1570085 (0.0006) [2023-12-28 06:32:39,310][106225] Updated weights for policy 1, policy_version 1573666 (0.0011) [2023-12-28 06:32:39,353][106226] Updated weights for policy 0, policy_version 1570095 (0.0007) [2023-12-28 06:32:39,377][106225] Updated weights for policy 1, policy_version 1573676 (0.0009) [2023-12-28 06:32:39,448][106225] Updated weights for policy 1, policy_version 1573686 (0.0009) [2023-12-28 06:32:40,101][106226] Updated weights for policy 0, policy_version 1570105 (0.0007) [2023-12-28 06:32:40,166][106226] Updated weights for policy 0, policy_version 1570115 (0.0008) [2023-12-28 06:32:40,197][106225] Updated weights for policy 1, policy_version 1573696 (0.0007) [2023-12-28 06:32:40,228][106226] Updated weights for policy 0, policy_version 1570125 (0.0008) [2023-12-28 06:32:40,263][106225] Updated weights for policy 1, policy_version 1573706 (0.0008) [2023-12-28 06:32:40,292][106226] Updated weights for policy 0, policy_version 1570135 (0.0006) [2023-12-28 06:32:40,329][106225] Updated weights for policy 1, policy_version 1573716 (0.0008) [2023-12-28 06:32:40,981][106225] Updated weights for policy 1, policy_version 1573726 (0.0006) [2023-12-28 06:32:41,027][106226] Updated weights for policy 0, policy_version 1570145 (0.0008) [2023-12-28 06:32:41,049][106225] Updated weights for policy 1, policy_version 1573736 (0.0007) [2023-12-28 06:32:41,090][106226] Updated weights for policy 0, policy_version 1570155 (0.0006) [2023-12-28 06:32:41,110][106225] Updated weights for policy 1, policy_version 1573746 (0.0007) [2023-12-28 06:32:41,156][106226] Updated weights for policy 0, policy_version 1570165 (0.0007) [2023-12-28 06:32:41,175][105115] Fps is (10 sec: 21298.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 804970496. Throughput: 0: 9833.4, 1: 10196.8. Samples: 804935040. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:41,176][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.771')] [2023-12-28 06:32:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001573752_402931712.pth... [2023-12-28 06:32:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001570168_402038784.pth... [2023-12-28 06:32:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001572568_402628608.pth [2023-12-28 06:32:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001569016_401743872.pth [2023-12-28 06:32:41,864][106225] Updated weights for policy 1, policy_version 1573756 (0.0008) [2023-12-28 06:32:41,928][106225] Updated weights for policy 1, policy_version 1573766 (0.0008) [2023-12-28 06:32:41,951][106226] Updated weights for policy 0, policy_version 1570175 (0.0009) [2023-12-28 06:32:41,988][106225] Updated weights for policy 1, policy_version 1573776 (0.0009) [2023-12-28 06:32:42,013][106226] Updated weights for policy 0, policy_version 1570185 (0.0008) [2023-12-28 06:32:42,067][106226] Updated weights for policy 0, policy_version 1570195 (0.0006) [2023-12-28 06:32:42,747][106225] Updated weights for policy 1, policy_version 1573786 (0.0009) [2023-12-28 06:32:42,787][106226] Updated weights for policy 0, policy_version 1570205 (0.0006) [2023-12-28 06:32:42,804][106225] Updated weights for policy 1, policy_version 1573796 (0.0008) [2023-12-28 06:32:42,841][106226] Updated weights for policy 0, policy_version 1570215 (0.0007) [2023-12-28 06:32:42,859][106225] Updated weights for policy 1, policy_version 1573806 (0.0006) [2023-12-28 06:32:42,903][106226] Updated weights for policy 0, policy_version 1570225 (0.0008) [2023-12-28 06:32:42,917][106225] Updated weights for policy 1, policy_version 1573816 (0.0006) [2023-12-28 06:32:43,620][106226] Updated weights for policy 0, policy_version 1570235 (0.0007) [2023-12-28 06:32:43,633][106225] Updated weights for policy 1, policy_version 1573826 (0.0009) [2023-12-28 06:32:43,670][106226] Updated weights for policy 0, policy_version 1570245 (0.0006) [2023-12-28 06:32:43,688][106225] Updated weights for policy 1, policy_version 1573836 (0.0006) [2023-12-28 06:32:43,721][106226] Updated weights for policy 0, policy_version 1570255 (0.0006) [2023-12-28 06:32:43,739][106225] Updated weights for policy 1, policy_version 1573846 (0.0007) [2023-12-28 06:32:44,347][106225] Updated weights for policy 1, policy_version 1573856 (0.0008) [2023-12-28 06:32:44,395][106225] Updated weights for policy 1, policy_version 1573866 (0.0008) [2023-12-28 06:32:44,445][106225] Updated weights for policy 1, policy_version 1573876 (0.0007) [2023-12-28 06:32:44,497][106226] Updated weights for policy 0, policy_version 1570265 (0.0007) [2023-12-28 06:32:44,551][106226] Updated weights for policy 0, policy_version 1570275 (0.0006) [2023-12-28 06:32:44,609][106226] Updated weights for policy 0, policy_version 1570285 (0.0007) [2023-12-28 06:32:44,657][106226] Updated weights for policy 0, policy_version 1570295 (0.0008) [2023-12-28 06:32:45,195][106225] Updated weights for policy 1, policy_version 1573886 (0.0007) [2023-12-28 06:32:45,258][106225] Updated weights for policy 1, policy_version 1573896 (0.0009) [2023-12-28 06:32:45,318][106225] Updated weights for policy 1, policy_version 1573906 (0.0008) [2023-12-28 06:32:45,391][106226] Updated weights for policy 0, policy_version 1570305 (0.0009) [2023-12-28 06:32:45,444][106226] Updated weights for policy 0, policy_version 1570315 (0.0008) [2023-12-28 06:32:45,495][106226] Updated weights for policy 0, policy_version 1570325 (0.0008) [2023-12-28 06:32:45,990][106225] Updated weights for policy 1, policy_version 1573916 (0.0009) [2023-12-28 06:32:46,039][106225] Updated weights for policy 1, policy_version 1573926 (0.0009) [2023-12-28 06:32:46,091][106225] Updated weights for policy 1, policy_version 1573936 (0.0009) [2023-12-28 06:32:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 805060608. Throughput: 0: 9755.3, 1: 10128.0. Samples: 805049220. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:46,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.680')] [2023-12-28 06:32:46,260][106226] Updated weights for policy 0, policy_version 1570335 (0.0008) [2023-12-28 06:32:46,319][106226] Updated weights for policy 0, policy_version 1570345 (0.0008) [2023-12-28 06:32:46,382][106226] Updated weights for policy 0, policy_version 1570355 (0.0009) [2023-12-28 06:32:46,784][106225] Updated weights for policy 1, policy_version 1573946 (0.0009) [2023-12-28 06:32:46,836][106225] Updated weights for policy 1, policy_version 1573956 (0.0009) [2023-12-28 06:32:46,895][106225] Updated weights for policy 1, policy_version 1573966 (0.0009) [2023-12-28 06:32:46,949][106225] Updated weights for policy 1, policy_version 1573976 (0.0009) [2023-12-28 06:32:47,133][106226] Updated weights for policy 0, policy_version 1570365 (0.0008) [2023-12-28 06:32:47,201][106226] Updated weights for policy 0, policy_version 1570375 (0.0010) [2023-12-28 06:32:47,261][106226] Updated weights for policy 0, policy_version 1570385 (0.0007) [2023-12-28 06:32:47,657][106225] Updated weights for policy 1, policy_version 1573986 (0.0008) [2023-12-28 06:32:47,721][106225] Updated weights for policy 1, policy_version 1573996 (0.0009) [2023-12-28 06:32:47,777][106225] Updated weights for policy 1, policy_version 1574006 (0.0007) [2023-12-28 06:32:47,980][106226] Updated weights for policy 0, policy_version 1570395 (0.0009) [2023-12-28 06:32:48,042][106226] Updated weights for policy 0, policy_version 1570405 (0.0008) [2023-12-28 06:32:48,106][106226] Updated weights for policy 0, policy_version 1570415 (0.0008) [2023-12-28 06:32:48,469][106225] Updated weights for policy 1, policy_version 1574016 (0.0010) [2023-12-28 06:32:48,523][106225] Updated weights for policy 1, policy_version 1574026 (0.0010) [2023-12-28 06:32:48,573][106225] Updated weights for policy 1, policy_version 1574036 (0.0010) [2023-12-28 06:32:48,843][106226] Updated weights for policy 0, policy_version 1570425 (0.0007) [2023-12-28 06:32:48,893][106226] Updated weights for policy 0, policy_version 1570435 (0.0008) [2023-12-28 06:32:48,943][106226] Updated weights for policy 0, policy_version 1570445 (0.0007) [2023-12-28 06:32:48,993][106226] Updated weights for policy 0, policy_version 1570455 (0.0007) [2023-12-28 06:32:49,254][106225] Updated weights for policy 1, policy_version 1574046 (0.0009) [2023-12-28 06:32:49,327][106225] Updated weights for policy 1, policy_version 1574056 (0.0010) [2023-12-28 06:32:49,394][106225] Updated weights for policy 1, policy_version 1574066 (0.0009) [2023-12-28 06:32:49,695][106226] Updated weights for policy 0, policy_version 1570465 (0.0008) [2023-12-28 06:32:49,753][106226] Updated weights for policy 0, policy_version 1570475 (0.0006) [2023-12-28 06:32:49,811][106226] Updated weights for policy 0, policy_version 1570485 (0.0010) [2023-12-28 06:32:50,057][106225] Updated weights for policy 1, policy_version 1574076 (0.0010) [2023-12-28 06:32:50,119][106225] Updated weights for policy 1, policy_version 1574086 (0.0010) [2023-12-28 06:32:50,190][106225] Updated weights for policy 1, policy_version 1574096 (0.0011) [2023-12-28 06:32:50,483][106226] Updated weights for policy 0, policy_version 1570495 (0.0007) [2023-12-28 06:32:50,555][106226] Updated weights for policy 0, policy_version 1570505 (0.0006) [2023-12-28 06:32:50,616][106226] Updated weights for policy 0, policy_version 1570515 (0.0009) [2023-12-28 06:32:50,908][106225] Updated weights for policy 1, policy_version 1574106 (0.0011) [2023-12-28 06:32:50,970][106225] Updated weights for policy 1, policy_version 1574116 (0.0008) [2023-12-28 06:32:51,038][106225] Updated weights for policy 1, policy_version 1574126 (0.0010) [2023-12-28 06:32:51,102][106225] Updated weights for policy 1, policy_version 1574136 (0.0006) [2023-12-28 06:32:51,175][105115] Fps is (10 sec: 18842.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 805158912. Throughput: 0: 9665.1, 1: 10078.7. Samples: 805167072. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:51,175][105115] Avg episode reward: [(0, '-4.946'), (1, '-4.937')] [2023-12-28 06:32:51,300][106226] Updated weights for policy 0, policy_version 1570525 (0.0009) [2023-12-28 06:32:51,370][106226] Updated weights for policy 0, policy_version 1570535 (0.0009) [2023-12-28 06:32:51,435][106226] Updated weights for policy 0, policy_version 1570545 (0.0009) [2023-12-28 06:32:51,880][106225] Updated weights for policy 1, policy_version 1574146 (0.0006) [2023-12-28 06:32:51,950][106225] Updated weights for policy 1, policy_version 1574156 (0.0006) [2023-12-28 06:32:52,011][106225] Updated weights for policy 1, policy_version 1574166 (0.0008) [2023-12-28 06:32:52,202][106226] Updated weights for policy 0, policy_version 1570555 (0.0010) [2023-12-28 06:32:52,254][106226] Updated weights for policy 0, policy_version 1570565 (0.0007) [2023-12-28 06:32:52,316][106226] Updated weights for policy 0, policy_version 1570575 (0.0007) [2023-12-28 06:32:52,773][106225] Updated weights for policy 1, policy_version 1574176 (0.0006) [2023-12-28 06:32:52,843][106225] Updated weights for policy 1, policy_version 1574186 (0.0007) [2023-12-28 06:32:52,909][106225] Updated weights for policy 1, policy_version 1574196 (0.0008) [2023-12-28 06:32:53,071][106226] Updated weights for policy 0, policy_version 1570585 (0.0007) [2023-12-28 06:32:53,131][106226] Updated weights for policy 0, policy_version 1570595 (0.0010) [2023-12-28 06:32:53,185][106226] Updated weights for policy 0, policy_version 1570605 (0.0010) [2023-12-28 06:32:53,238][106226] Updated weights for policy 0, policy_version 1570615 (0.0006) [2023-12-28 06:32:53,609][106225] Updated weights for policy 1, policy_version 1574206 (0.0007) [2023-12-28 06:32:53,670][106225] Updated weights for policy 1, policy_version 1574216 (0.0008) [2023-12-28 06:32:53,725][106225] Updated weights for policy 1, policy_version 1574226 (0.0007) [2023-12-28 06:32:53,953][106226] Updated weights for policy 0, policy_version 1570625 (0.0010) [2023-12-28 06:32:54,018][106226] Updated weights for policy 0, policy_version 1570635 (0.0011) [2023-12-28 06:32:54,082][106226] Updated weights for policy 0, policy_version 1570645 (0.0010) [2023-12-28 06:32:54,461][106225] Updated weights for policy 1, policy_version 1574236 (0.0008) [2023-12-28 06:32:54,522][106225] Updated weights for policy 1, policy_version 1574246 (0.0007) [2023-12-28 06:32:54,586][106225] Updated weights for policy 1, policy_version 1574256 (0.0007) [2023-12-28 06:32:54,786][106226] Updated weights for policy 0, policy_version 1570655 (0.0010) [2023-12-28 06:32:54,845][106226] Updated weights for policy 0, policy_version 1570665 (0.0011) [2023-12-28 06:32:54,902][106226] Updated weights for policy 0, policy_version 1570675 (0.0010) [2023-12-28 06:32:55,291][106225] Updated weights for policy 1, policy_version 1574266 (0.0008) [2023-12-28 06:32:55,341][106225] Updated weights for policy 1, policy_version 1574276 (0.0010) [2023-12-28 06:32:55,391][106225] Updated weights for policy 1, policy_version 1574286 (0.0010) [2023-12-28 06:32:55,442][106225] Updated weights for policy 1, policy_version 1574296 (0.0009) [2023-12-28 06:32:55,496][106226] Updated weights for policy 0, policy_version 1570685 (0.0010) [2023-12-28 06:32:55,539][106226] Updated weights for policy 0, policy_version 1570695 (0.0010) [2023-12-28 06:32:55,593][106226] Updated weights for policy 0, policy_version 1570705 (0.0011) [2023-12-28 06:32:56,057][106225] Updated weights for policy 1, policy_version 1574306 (0.0007) [2023-12-28 06:32:56,110][106225] Updated weights for policy 1, policy_version 1574316 (0.0007) [2023-12-28 06:32:56,161][106225] Updated weights for policy 1, policy_version 1574326 (0.0007) [2023-12-28 06:32:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 805257216. Throughput: 0: 9616.3, 1: 9999.7. Samples: 805222672. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:32:56,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.850')] [2023-12-28 06:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001574328_403079168.pth... [2023-12-28 06:32:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001570712_402178048.pth... [2023-12-28 06:32:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001573144_402776064.pth [2023-12-28 06:32:56,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001569592_401891328.pth [2023-12-28 06:32:56,290][106226] Updated weights for policy 0, policy_version 1570715 (0.0009) [2023-12-28 06:32:56,354][106226] Updated weights for policy 0, policy_version 1570725 (0.0010) [2023-12-28 06:32:56,400][106226] Updated weights for policy 0, policy_version 1570735 (0.0010) [2023-12-28 06:32:56,901][106225] Updated weights for policy 1, policy_version 1574336 (0.0008) [2023-12-28 06:32:56,944][106225] Updated weights for policy 1, policy_version 1574346 (0.0008) [2023-12-28 06:32:56,989][106225] Updated weights for policy 1, policy_version 1574356 (0.0007) [2023-12-28 06:32:57,091][106226] Updated weights for policy 0, policy_version 1570745 (0.0010) [2023-12-28 06:32:57,143][106226] Updated weights for policy 0, policy_version 1570755 (0.0005) [2023-12-28 06:32:57,202][106226] Updated weights for policy 0, policy_version 1570765 (0.0005) [2023-12-28 06:32:57,254][106226] Updated weights for policy 0, policy_version 1570775 (0.0005) [2023-12-28 06:32:57,777][106225] Updated weights for policy 1, policy_version 1574366 (0.0007) [2023-12-28 06:32:57,835][106225] Updated weights for policy 1, policy_version 1574376 (0.0005) [2023-12-28 06:32:57,871][106226] Updated weights for policy 0, policy_version 1570785 (0.0005) [2023-12-28 06:32:57,894][106225] Updated weights for policy 1, policy_version 1574386 (0.0005) [2023-12-28 06:32:57,922][106226] Updated weights for policy 0, policy_version 1570795 (0.0005) [2023-12-28 06:32:58,009][106226] Updated weights for policy 0, policy_version 1570805 (0.0006) [2023-12-28 06:32:58,531][106225] Updated weights for policy 1, policy_version 1574396 (0.0007) [2023-12-28 06:32:58,589][106225] Updated weights for policy 1, policy_version 1574406 (0.0008) [2023-12-28 06:32:58,642][106225] Updated weights for policy 1, policy_version 1574416 (0.0008) [2023-12-28 06:32:58,658][106226] Updated weights for policy 0, policy_version 1570815 (0.0009) [2023-12-28 06:32:58,725][106226] Updated weights for policy 0, policy_version 1570825 (0.0007) [2023-12-28 06:32:58,798][106226] Updated weights for policy 0, policy_version 1570835 (0.0008) [2023-12-28 06:32:59,547][106226] Updated weights for policy 0, policy_version 1570845 (0.0007) [2023-12-28 06:32:59,576][106225] Updated weights for policy 1, policy_version 1574426 (0.0007) [2023-12-28 06:32:59,598][106226] Updated weights for policy 0, policy_version 1570855 (0.0006) [2023-12-28 06:32:59,639][106225] Updated weights for policy 1, policy_version 1574436 (0.0006) [2023-12-28 06:32:59,649][106226] Updated weights for policy 0, policy_version 1570865 (0.0010) [2023-12-28 06:32:59,695][106225] Updated weights for policy 1, policy_version 1574446 (0.0006) [2023-12-28 06:32:59,756][106225] Updated weights for policy 1, policy_version 1574456 (0.0008) [2023-12-28 06:33:00,334][106226] Updated weights for policy 0, policy_version 1570875 (0.0011) [2023-12-28 06:33:00,396][106226] Updated weights for policy 0, policy_version 1570885 (0.0008) [2023-12-28 06:33:00,457][106226] Updated weights for policy 0, policy_version 1570895 (0.0008) [2023-12-28 06:33:00,543][106225] Updated weights for policy 1, policy_version 1574466 (0.0008) [2023-12-28 06:33:00,599][106225] Updated weights for policy 1, policy_version 1574476 (0.0008) [2023-12-28 06:33:00,647][106225] Updated weights for policy 1, policy_version 1574486 (0.0008) [2023-12-28 06:33:01,071][106226] Updated weights for policy 0, policy_version 1570905 (0.0007) [2023-12-28 06:33:01,136][106226] Updated weights for policy 0, policy_version 1570915 (0.0010) [2023-12-28 06:33:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 805347328. Throughput: 0: 9746.7, 1: 9977.3. Samples: 805341724. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:01,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-4.866')] [2023-12-28 06:33:01,203][106226] Updated weights for policy 0, policy_version 1570925 (0.0008) [2023-12-28 06:33:01,261][106226] Updated weights for policy 0, policy_version 1570935 (0.0007) [2023-12-28 06:33:01,448][106225] Updated weights for policy 1, policy_version 1574496 (0.0008) [2023-12-28 06:33:01,501][106225] Updated weights for policy 1, policy_version 1574506 (0.0007) [2023-12-28 06:33:01,570][106225] Updated weights for policy 1, policy_version 1574516 (0.0009) [2023-12-28 06:33:01,922][106226] Updated weights for policy 0, policy_version 1570945 (0.0008) [2023-12-28 06:33:01,980][106226] Updated weights for policy 0, policy_version 1570955 (0.0009) [2023-12-28 06:33:02,029][106226] Updated weights for policy 0, policy_version 1570965 (0.0009) [2023-12-28 06:33:02,304][106225] Updated weights for policy 1, policy_version 1574526 (0.0008) [2023-12-28 06:33:02,366][106225] Updated weights for policy 1, policy_version 1574536 (0.0007) [2023-12-28 06:33:02,424][106225] Updated weights for policy 1, policy_version 1574546 (0.0006) [2023-12-28 06:33:02,725][106226] Updated weights for policy 0, policy_version 1570975 (0.0006) [2023-12-28 06:33:02,779][106226] Updated weights for policy 0, policy_version 1570985 (0.0005) [2023-12-28 06:33:02,835][106226] Updated weights for policy 0, policy_version 1570995 (0.0005) [2023-12-28 06:33:03,129][106225] Updated weights for policy 1, policy_version 1574556 (0.0006) [2023-12-28 06:33:03,190][106225] Updated weights for policy 1, policy_version 1574566 (0.0009) [2023-12-28 06:33:03,247][106225] Updated weights for policy 1, policy_version 1574576 (0.0005) [2023-12-28 06:33:03,363][106226] Updated weights for policy 0, policy_version 1571005 (0.0005) [2023-12-28 06:33:03,409][106226] Updated weights for policy 0, policy_version 1571015 (0.0006) [2023-12-28 06:33:03,453][106226] Updated weights for policy 0, policy_version 1571025 (0.0008) [2023-12-28 06:33:03,975][106225] Updated weights for policy 1, policy_version 1574586 (0.0009) [2023-12-28 06:33:04,031][106225] Updated weights for policy 1, policy_version 1574596 (0.0009) [2023-12-28 06:33:04,090][106225] Updated weights for policy 1, policy_version 1574606 (0.0008) [2023-12-28 06:33:04,128][106226] Updated weights for policy 0, policy_version 1571035 (0.0008) [2023-12-28 06:33:04,152][106225] Updated weights for policy 1, policy_version 1574616 (0.0009) [2023-12-28 06:33:04,192][106226] Updated weights for policy 0, policy_version 1571045 (0.0008) [2023-12-28 06:33:04,258][106226] Updated weights for policy 0, policy_version 1571055 (0.0008) [2023-12-28 06:33:04,851][106225] Updated weights for policy 1, policy_version 1574626 (0.0008) [2023-12-28 06:33:04,899][106226] Updated weights for policy 0, policy_version 1571065 (0.0010) [2023-12-28 06:33:04,910][106225] Updated weights for policy 1, policy_version 1574636 (0.0007) [2023-12-28 06:33:04,949][106226] Updated weights for policy 0, policy_version 1571075 (0.0007) [2023-12-28 06:33:04,972][106225] Updated weights for policy 1, policy_version 1574646 (0.0006) [2023-12-28 06:33:05,004][106226] Updated weights for policy 0, policy_version 1571085 (0.0006) [2023-12-28 06:33:05,063][106226] Updated weights for policy 0, policy_version 1571095 (0.0008) [2023-12-28 06:33:05,693][106226] Updated weights for policy 0, policy_version 1571105 (0.0006) [2023-12-28 06:33:05,696][106225] Updated weights for policy 1, policy_version 1574656 (0.0006) [2023-12-28 06:33:05,745][106225] Updated weights for policy 1, policy_version 1574666 (0.0006) [2023-12-28 06:33:05,751][106226] Updated weights for policy 0, policy_version 1571115 (0.0007) [2023-12-28 06:33:05,808][106225] Updated weights for policy 1, policy_version 1574676 (0.0008) [2023-12-28 06:33:05,808][106226] Updated weights for policy 0, policy_version 1571125 (0.0008) [2023-12-28 06:33:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 805453824. Throughput: 0: 9883.1, 1: 9877.1. Samples: 805462688. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:06,175][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.700')] [2023-12-28 06:33:06,527][106226] Updated weights for policy 0, policy_version 1571135 (0.0008) [2023-12-28 06:33:06,541][106225] Updated weights for policy 1, policy_version 1574686 (0.0007) [2023-12-28 06:33:06,591][106225] Updated weights for policy 1, policy_version 1574696 (0.0007) [2023-12-28 06:33:06,593][106226] Updated weights for policy 0, policy_version 1571145 (0.0007) [2023-12-28 06:33:06,652][106225] Updated weights for policy 1, policy_version 1574706 (0.0006) [2023-12-28 06:33:06,654][106226] Updated weights for policy 0, policy_version 1571155 (0.0006) [2023-12-28 06:33:07,337][106225] Updated weights for policy 1, policy_version 1574716 (0.0006) [2023-12-28 06:33:07,383][106226] Updated weights for policy 0, policy_version 1571165 (0.0006) [2023-12-28 06:33:07,398][106225] Updated weights for policy 1, policy_version 1574726 (0.0009) [2023-12-28 06:33:07,443][106226] Updated weights for policy 0, policy_version 1571175 (0.0006) [2023-12-28 06:33:07,450][106225] Updated weights for policy 1, policy_version 1574736 (0.0010) [2023-12-28 06:33:07,511][106226] Updated weights for policy 0, policy_version 1571185 (0.0007) [2023-12-28 06:33:08,090][106225] Updated weights for policy 1, policy_version 1574746 (0.0010) [2023-12-28 06:33:08,157][106225] Updated weights for policy 1, policy_version 1574756 (0.0010) [2023-12-28 06:33:08,215][106225] Updated weights for policy 1, policy_version 1574766 (0.0011) [2023-12-28 06:33:08,236][106226] Updated weights for policy 0, policy_version 1571195 (0.0008) [2023-12-28 06:33:08,278][106225] Updated weights for policy 1, policy_version 1574776 (0.0007) [2023-12-28 06:33:08,296][106226] Updated weights for policy 0, policy_version 1571205 (0.0007) [2023-12-28 06:33:08,363][106226] Updated weights for policy 0, policy_version 1571215 (0.0008) [2023-12-28 06:33:08,966][106225] Updated weights for policy 1, policy_version 1574786 (0.0008) [2023-12-28 06:33:09,017][106225] Updated weights for policy 1, policy_version 1574796 (0.0007) [2023-12-28 06:33:09,072][106225] Updated weights for policy 1, policy_version 1574806 (0.0006) [2023-12-28 06:33:09,102][106226] Updated weights for policy 0, policy_version 1571225 (0.0009) [2023-12-28 06:33:09,162][106226] Updated weights for policy 0, policy_version 1571235 (0.0011) [2023-12-28 06:33:09,231][106226] Updated weights for policy 0, policy_version 1571245 (0.0011) [2023-12-28 06:33:09,287][106226] Updated weights for policy 0, policy_version 1571255 (0.0011) [2023-12-28 06:33:09,884][106225] Updated weights for policy 1, policy_version 1574816 (0.0007) [2023-12-28 06:33:09,954][106225] Updated weights for policy 1, policy_version 1574826 (0.0008) [2023-12-28 06:33:09,954][106226] Updated weights for policy 0, policy_version 1571265 (0.0009) [2023-12-28 06:33:10,009][106225] Updated weights for policy 1, policy_version 1574836 (0.0007) [2023-12-28 06:33:10,019][106226] Updated weights for policy 0, policy_version 1571275 (0.0007) [2023-12-28 06:33:10,087][106226] Updated weights for policy 0, policy_version 1571285 (0.0007) [2023-12-28 06:33:10,711][106226] Updated weights for policy 0, policy_version 1571295 (0.0008) [2023-12-28 06:33:10,762][106226] Updated weights for policy 0, policy_version 1571305 (0.0008) [2023-12-28 06:33:10,800][106225] Updated weights for policy 1, policy_version 1574846 (0.0006) [2023-12-28 06:33:10,817][106226] Updated weights for policy 0, policy_version 1571315 (0.0008) [2023-12-28 06:33:10,860][106225] Updated weights for policy 1, policy_version 1574856 (0.0008) [2023-12-28 06:33:10,926][106225] Updated weights for policy 1, policy_version 1574866 (0.0007) [2023-12-28 06:33:11,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 805552128. Throughput: 0: 9861.2, 1: 9927.6. Samples: 805520840. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:11,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.722')] [2023-12-28 06:33:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001574872_403218432.pth... [2023-12-28 06:33:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001571320_402333696.pth... [2023-12-28 06:33:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001570168_402038784.pth [2023-12-28 06:33:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001573752_402931712.pth [2023-12-28 06:33:11,536][106226] Updated weights for policy 0, policy_version 1571325 (0.0008) [2023-12-28 06:33:11,601][106226] Updated weights for policy 0, policy_version 1571335 (0.0009) [2023-12-28 06:33:11,667][106226] Updated weights for policy 0, policy_version 1571345 (0.0008) [2023-12-28 06:33:11,680][106225] Updated weights for policy 1, policy_version 1574876 (0.0006) [2023-12-28 06:33:11,751][106225] Updated weights for policy 1, policy_version 1574886 (0.0009) [2023-12-28 06:33:11,810][106225] Updated weights for policy 1, policy_version 1574896 (0.0008) [2023-12-28 06:33:12,392][106226] Updated weights for policy 0, policy_version 1571355 (0.0006) [2023-12-28 06:33:12,453][106226] Updated weights for policy 0, policy_version 1571365 (0.0009) [2023-12-28 06:33:12,507][106226] Updated weights for policy 0, policy_version 1571375 (0.0009) [2023-12-28 06:33:12,594][106225] Updated weights for policy 1, policy_version 1574906 (0.0008) [2023-12-28 06:33:12,654][106225] Updated weights for policy 1, policy_version 1574916 (0.0009) [2023-12-28 06:33:12,717][106225] Updated weights for policy 1, policy_version 1574926 (0.0008) [2023-12-28 06:33:12,792][106225] Updated weights for policy 1, policy_version 1574936 (0.0010) [2023-12-28 06:33:13,183][106226] Updated weights for policy 0, policy_version 1571385 (0.0008) [2023-12-28 06:33:13,237][106226] Updated weights for policy 0, policy_version 1571395 (0.0009) [2023-12-28 06:33:13,286][106226] Updated weights for policy 0, policy_version 1571405 (0.0009) [2023-12-28 06:33:13,344][106226] Updated weights for policy 0, policy_version 1571415 (0.0008) [2023-12-28 06:33:13,451][106225] Updated weights for policy 1, policy_version 1574946 (0.0010) [2023-12-28 06:33:13,507][106225] Updated weights for policy 1, policy_version 1574956 (0.0011) [2023-12-28 06:33:13,559][106225] Updated weights for policy 1, policy_version 1574966 (0.0010) [2023-12-28 06:33:13,981][106226] Updated weights for policy 0, policy_version 1571425 (0.0006) [2023-12-28 06:33:14,033][106226] Updated weights for policy 0, policy_version 1571435 (0.0005) [2023-12-28 06:33:14,093][106226] Updated weights for policy 0, policy_version 1571445 (0.0005) [2023-12-28 06:33:14,254][106225] Updated weights for policy 1, policy_version 1574976 (0.0009) [2023-12-28 06:33:14,303][106225] Updated weights for policy 1, policy_version 1574986 (0.0008) [2023-12-28 06:33:14,361][106225] Updated weights for policy 1, policy_version 1574996 (0.0008) [2023-12-28 06:33:14,633][106226] Updated weights for policy 0, policy_version 1571455 (0.0005) [2023-12-28 06:33:14,681][106226] Updated weights for policy 0, policy_version 1571465 (0.0005) [2023-12-28 06:33:14,726][106226] Updated weights for policy 0, policy_version 1571475 (0.0005) [2023-12-28 06:33:15,217][106225] Updated weights for policy 1, policy_version 1575006 (0.0008) [2023-12-28 06:33:15,279][106225] Updated weights for policy 1, policy_version 1575016 (0.0008) [2023-12-28 06:33:15,332][106225] Updated weights for policy 1, policy_version 1575026 (0.0008) [2023-12-28 06:33:15,350][106226] Updated weights for policy 0, policy_version 1571485 (0.0008) [2023-12-28 06:33:15,410][106226] Updated weights for policy 0, policy_version 1571495 (0.0010) [2023-12-28 06:33:15,473][106226] Updated weights for policy 0, policy_version 1571505 (0.0011) [2023-12-28 06:33:16,085][106226] Updated weights for policy 0, policy_version 1571515 (0.0008) [2023-12-28 06:33:16,124][106225] Updated weights for policy 1, policy_version 1575036 (0.0007) [2023-12-28 06:33:16,139][106226] Updated weights for policy 0, policy_version 1571525 (0.0011) [2023-12-28 06:33:16,170][106225] Updated weights for policy 1, policy_version 1575046 (0.0006) [2023-12-28 06:33:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 805642240. Throughput: 0: 9987.2, 1: 9723.3. Samples: 805638784. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:16,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.328')] [2023-12-28 06:33:16,186][106226] Updated weights for policy 0, policy_version 1571535 (0.0010) [2023-12-28 06:33:16,220][106225] Updated weights for policy 1, policy_version 1575056 (0.0007) [2023-12-28 06:33:16,904][106225] Updated weights for policy 1, policy_version 1575066 (0.0007) [2023-12-28 06:33:16,910][106226] Updated weights for policy 0, policy_version 1571545 (0.0010) [2023-12-28 06:33:16,958][106226] Updated weights for policy 0, policy_version 1571555 (0.0005) [2023-12-28 06:33:16,961][106225] Updated weights for policy 1, policy_version 1575076 (0.0006) [2023-12-28 06:33:17,003][106226] Updated weights for policy 0, policy_version 1571565 (0.0008) [2023-12-28 06:33:17,017][106225] Updated weights for policy 1, policy_version 1575086 (0.0007) [2023-12-28 06:33:17,049][106226] Updated weights for policy 0, policy_version 1571575 (0.0007) [2023-12-28 06:33:17,075][106225] Updated weights for policy 1, policy_version 1575096 (0.0009) [2023-12-28 06:33:17,754][106225] Updated weights for policy 1, policy_version 1575106 (0.0010) [2023-12-28 06:33:17,758][106226] Updated weights for policy 0, policy_version 1571585 (0.0011) [2023-12-28 06:33:17,809][106225] Updated weights for policy 1, policy_version 1575116 (0.0010) [2023-12-28 06:33:17,809][106226] Updated weights for policy 0, policy_version 1571595 (0.0011) [2023-12-28 06:33:17,857][106226] Updated weights for policy 0, policy_version 1571605 (0.0010) [2023-12-28 06:33:17,866][106225] Updated weights for policy 1, policy_version 1575126 (0.0010) [2023-12-28 06:33:18,528][106226] Updated weights for policy 0, policy_version 1571615 (0.0009) [2023-12-28 06:33:18,588][106226] Updated weights for policy 0, policy_version 1571625 (0.0007) [2023-12-28 06:33:18,588][106225] Updated weights for policy 1, policy_version 1575136 (0.0011) [2023-12-28 06:33:18,653][106226] Updated weights for policy 0, policy_version 1571635 (0.0009) [2023-12-28 06:33:18,656][106225] Updated weights for policy 1, policy_version 1575146 (0.0010) [2023-12-28 06:33:18,715][106225] Updated weights for policy 1, policy_version 1575156 (0.0008) [2023-12-28 06:33:19,415][106226] Updated weights for policy 0, policy_version 1571645 (0.0008) [2023-12-28 06:33:19,419][106225] Updated weights for policy 1, policy_version 1575166 (0.0007) [2023-12-28 06:33:19,473][106225] Updated weights for policy 1, policy_version 1575176 (0.0007) [2023-12-28 06:33:19,475][106226] Updated weights for policy 0, policy_version 1571655 (0.0010) [2023-12-28 06:33:19,527][106225] Updated weights for policy 1, policy_version 1575186 (0.0008) [2023-12-28 06:33:19,537][106226] Updated weights for policy 0, policy_version 1571665 (0.0008) [2023-12-28 06:33:20,223][106226] Updated weights for policy 0, policy_version 1571675 (0.0007) [2023-12-28 06:33:20,290][106226] Updated weights for policy 0, policy_version 1571685 (0.0006) [2023-12-28 06:33:20,333][106225] Updated weights for policy 1, policy_version 1575196 (0.0007) [2023-12-28 06:33:20,350][106226] Updated weights for policy 0, policy_version 1571695 (0.0006) [2023-12-28 06:33:20,392][106225] Updated weights for policy 1, policy_version 1575206 (0.0008) [2023-12-28 06:33:20,437][106225] Updated weights for policy 1, policy_version 1575216 (0.0006) [2023-12-28 06:33:21,029][106226] Updated weights for policy 0, policy_version 1571705 (0.0007) [2023-12-28 06:33:21,079][106225] Updated weights for policy 1, policy_version 1575226 (0.0006) [2023-12-28 06:33:21,099][106226] Updated weights for policy 0, policy_version 1571715 (0.0009) [2023-12-28 06:33:21,136][106225] Updated weights for policy 1, policy_version 1575236 (0.0007) [2023-12-28 06:33:21,173][106226] Updated weights for policy 0, policy_version 1571725 (0.0008) [2023-12-28 06:33:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 805740544. Throughput: 0: 9971.1, 1: 9616.8. Samples: 805757336. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:21,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.754')] [2023-12-28 06:33:21,204][106225] Updated weights for policy 1, policy_version 1575246 (0.0008) [2023-12-28 06:33:21,236][106226] Updated weights for policy 0, policy_version 1571735 (0.0007) [2023-12-28 06:33:21,269][106225] Updated weights for policy 1, policy_version 1575256 (0.0008) [2023-12-28 06:33:22,007][106226] Updated weights for policy 0, policy_version 1571745 (0.0009) [2023-12-28 06:33:22,018][106225] Updated weights for policy 1, policy_version 1575266 (0.0007) [2023-12-28 06:33:22,068][106226] Updated weights for policy 0, policy_version 1571755 (0.0006) [2023-12-28 06:33:22,082][106225] Updated weights for policy 1, policy_version 1575276 (0.0006) [2023-12-28 06:33:22,130][106226] Updated weights for policy 0, policy_version 1571765 (0.0009) [2023-12-28 06:33:22,146][106225] Updated weights for policy 1, policy_version 1575286 (0.0006) [2023-12-28 06:33:22,861][106225] Updated weights for policy 1, policy_version 1575296 (0.0008) [2023-12-28 06:33:22,927][106225] Updated weights for policy 1, policy_version 1575306 (0.0006) [2023-12-28 06:33:22,957][106226] Updated weights for policy 0, policy_version 1571775 (0.0008) [2023-12-28 06:33:22,980][106225] Updated weights for policy 1, policy_version 1575316 (0.0006) [2023-12-28 06:33:23,027][106226] Updated weights for policy 0, policy_version 1571785 (0.0008) [2023-12-28 06:33:23,096][106226] Updated weights for policy 0, policy_version 1571795 (0.0008) [2023-12-28 06:33:23,636][106225] Updated weights for policy 1, policy_version 1575326 (0.0007) [2023-12-28 06:33:23,681][106226] Updated weights for policy 0, policy_version 1571805 (0.0007) [2023-12-28 06:33:23,693][106225] Updated weights for policy 1, policy_version 1575336 (0.0006) [2023-12-28 06:33:23,739][106226] Updated weights for policy 0, policy_version 1571815 (0.0007) [2023-12-28 06:33:23,742][106225] Updated weights for policy 1, policy_version 1575346 (0.0005) [2023-12-28 06:33:23,792][106226] Updated weights for policy 0, policy_version 1571825 (0.0006) [2023-12-28 06:33:24,391][106225] Updated weights for policy 1, policy_version 1575356 (0.0006) [2023-12-28 06:33:24,438][106225] Updated weights for policy 1, policy_version 1575366 (0.0008) [2023-12-28 06:33:24,465][106226] Updated weights for policy 0, policy_version 1571835 (0.0007) [2023-12-28 06:33:24,501][106225] Updated weights for policy 1, policy_version 1575376 (0.0008) [2023-12-28 06:33:24,518][106226] Updated weights for policy 0, policy_version 1571845 (0.0008) [2023-12-28 06:33:24,562][106226] Updated weights for policy 0, policy_version 1571855 (0.0006) [2023-12-28 06:33:25,125][106225] Updated weights for policy 1, policy_version 1575386 (0.0007) [2023-12-28 06:33:25,198][106225] Updated weights for policy 1, policy_version 1575396 (0.0006) [2023-12-28 06:33:25,223][106226] Updated weights for policy 0, policy_version 1571865 (0.0007) [2023-12-28 06:33:25,262][106225] Updated weights for policy 1, policy_version 1575406 (0.0005) [2023-12-28 06:33:25,283][106226] Updated weights for policy 0, policy_version 1571875 (0.0006) [2023-12-28 06:33:25,321][106225] Updated weights for policy 1, policy_version 1575416 (0.0007) [2023-12-28 06:33:25,341][106226] Updated weights for policy 0, policy_version 1571885 (0.0007) [2023-12-28 06:33:25,391][106226] Updated weights for policy 0, policy_version 1571895 (0.0005) [2023-12-28 06:33:25,910][106226] Updated weights for policy 0, policy_version 1571905 (0.0005) [2023-12-28 06:33:25,961][106226] Updated weights for policy 0, policy_version 1571915 (0.0005) [2023-12-28 06:33:26,005][106225] Updated weights for policy 1, policy_version 1575426 (0.0008) [2023-12-28 06:33:26,012][106226] Updated weights for policy 0, policy_version 1571925 (0.0006) [2023-12-28 06:33:26,055][106225] Updated weights for policy 1, policy_version 1575436 (0.0008) [2023-12-28 06:33:26,107][106225] Updated weights for policy 1, policy_version 1575446 (0.0008) [2023-12-28 06:33:26,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 805855232. Throughput: 0: 9948.2, 1: 9606.8. Samples: 805815012. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:26,175][105115] Avg episode reward: [(0, '-5.001'), (1, '-4.615')] [2023-12-28 06:33:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001575448_403365888.pth... [2023-12-28 06:33:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001571928_402489344.pth... [2023-12-28 06:33:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001574328_403079168.pth [2023-12-28 06:33:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001570712_402178048.pth [2023-12-28 06:33:26,659][106226] Updated weights for policy 0, policy_version 1571935 (0.0008) [2023-12-28 06:33:26,717][106226] Updated weights for policy 0, policy_version 1571945 (0.0008) [2023-12-28 06:33:26,786][106226] Updated weights for policy 0, policy_version 1571955 (0.0009) [2023-12-28 06:33:26,837][106225] Updated weights for policy 1, policy_version 1575456 (0.0007) [2023-12-28 06:33:26,896][106225] Updated weights for policy 1, policy_version 1575466 (0.0008) [2023-12-28 06:33:26,957][106225] Updated weights for policy 1, policy_version 1575476 (0.0008) [2023-12-28 06:33:27,478][106226] Updated weights for policy 0, policy_version 1571965 (0.0008) [2023-12-28 06:33:27,530][106226] Updated weights for policy 0, policy_version 1571975 (0.0008) [2023-12-28 06:33:27,586][106226] Updated weights for policy 0, policy_version 1571985 (0.0009) [2023-12-28 06:33:27,663][106225] Updated weights for policy 1, policy_version 1575486 (0.0008) [2023-12-28 06:33:27,711][106225] Updated weights for policy 1, policy_version 1575496 (0.0008) [2023-12-28 06:33:27,766][106225] Updated weights for policy 1, policy_version 1575506 (0.0005) [2023-12-28 06:33:28,270][106226] Updated weights for policy 0, policy_version 1571995 (0.0008) [2023-12-28 06:33:28,349][106226] Updated weights for policy 0, policy_version 1572005 (0.0006) [2023-12-28 06:33:28,408][106226] Updated weights for policy 0, policy_version 1572015 (0.0006) [2023-12-28 06:33:28,451][106225] Updated weights for policy 1, policy_version 1575516 (0.0007) [2023-12-28 06:33:28,516][106225] Updated weights for policy 1, policy_version 1575526 (0.0008) [2023-12-28 06:33:28,569][106225] Updated weights for policy 1, policy_version 1575536 (0.0008) [2023-12-28 06:33:29,058][106226] Updated weights for policy 0, policy_version 1572025 (0.0007) [2023-12-28 06:33:29,124][106226] Updated weights for policy 0, policy_version 1572035 (0.0005) [2023-12-28 06:33:29,179][106226] Updated weights for policy 0, policy_version 1572045 (0.0005) [2023-12-28 06:33:29,247][106226] Updated weights for policy 0, policy_version 1572055 (0.0006) [2023-12-28 06:33:29,330][106225] Updated weights for policy 1, policy_version 1575546 (0.0009) [2023-12-28 06:33:29,397][106225] Updated weights for policy 1, policy_version 1575556 (0.0008) [2023-12-28 06:33:29,451][106225] Updated weights for policy 1, policy_version 1575566 (0.0006) [2023-12-28 06:33:29,514][106225] Updated weights for policy 1, policy_version 1575576 (0.0006) [2023-12-28 06:33:29,985][106226] Updated weights for policy 0, policy_version 1572065 (0.0007) [2023-12-28 06:33:30,046][106226] Updated weights for policy 0, policy_version 1572075 (0.0006) [2023-12-28 06:33:30,120][106226] Updated weights for policy 0, policy_version 1572085 (0.0007) [2023-12-28 06:33:30,147][106225] Updated weights for policy 1, policy_version 1575586 (0.0008) [2023-12-28 06:33:30,210][106225] Updated weights for policy 1, policy_version 1575596 (0.0006) [2023-12-28 06:33:30,269][106225] Updated weights for policy 1, policy_version 1575606 (0.0008) [2023-12-28 06:33:30,703][106226] Updated weights for policy 0, policy_version 1572095 (0.0007) [2023-12-28 06:33:30,760][106226] Updated weights for policy 0, policy_version 1572105 (0.0009) [2023-12-28 06:33:30,813][106226] Updated weights for policy 0, policy_version 1572115 (0.0009) [2023-12-28 06:33:30,886][106225] Updated weights for policy 1, policy_version 1575616 (0.0006) [2023-12-28 06:33:30,941][106225] Updated weights for policy 1, policy_version 1575626 (0.0005) [2023-12-28 06:33:30,991][106225] Updated weights for policy 1, policy_version 1575636 (0.0009) [2023-12-28 06:33:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 805953536. Throughput: 0: 10107.8, 1: 9655.3. Samples: 805938560. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:31,175][105115] Avg episode reward: [(0, '-5.153'), (1, '-4.515')] [2023-12-28 06:33:31,541][106226] Updated weights for policy 0, policy_version 1572125 (0.0008) [2023-12-28 06:33:31,608][106226] Updated weights for policy 0, policy_version 1572135 (0.0008) [2023-12-28 06:33:31,664][106225] Updated weights for policy 1, policy_version 1575646 (0.0009) [2023-12-28 06:33:31,676][106226] Updated weights for policy 0, policy_version 1572145 (0.0008) [2023-12-28 06:33:31,731][106225] Updated weights for policy 1, policy_version 1575656 (0.0007) [2023-12-28 06:33:31,805][106225] Updated weights for policy 1, policy_version 1575666 (0.0008) [2023-12-28 06:33:32,317][106226] Updated weights for policy 0, policy_version 1572155 (0.0009) [2023-12-28 06:33:32,378][106226] Updated weights for policy 0, policy_version 1572165 (0.0009) [2023-12-28 06:33:32,441][106226] Updated weights for policy 0, policy_version 1572175 (0.0010) [2023-12-28 06:33:32,552][106225] Updated weights for policy 1, policy_version 1575676 (0.0010) [2023-12-28 06:33:32,613][106225] Updated weights for policy 1, policy_version 1575686 (0.0008) [2023-12-28 06:33:32,659][106225] Updated weights for policy 1, policy_version 1575696 (0.0008) [2023-12-28 06:33:33,119][106226] Updated weights for policy 0, policy_version 1572185 (0.0008) [2023-12-28 06:33:33,169][106226] Updated weights for policy 0, policy_version 1572195 (0.0005) [2023-12-28 06:33:33,227][106226] Updated weights for policy 0, policy_version 1572205 (0.0006) [2023-12-28 06:33:33,277][106226] Updated weights for policy 0, policy_version 1572215 (0.0008) [2023-12-28 06:33:33,418][106225] Updated weights for policy 1, policy_version 1575706 (0.0007) [2023-12-28 06:33:33,483][106225] Updated weights for policy 1, policy_version 1575716 (0.0005) [2023-12-28 06:33:33,551][106225] Updated weights for policy 1, policy_version 1575726 (0.0006) [2023-12-28 06:33:33,618][106225] Updated weights for policy 1, policy_version 1575736 (0.0006) [2023-12-28 06:33:33,854][106226] Updated weights for policy 0, policy_version 1572225 (0.0005) [2023-12-28 06:33:33,918][106226] Updated weights for policy 0, policy_version 1572235 (0.0005) [2023-12-28 06:33:33,974][106226] Updated weights for policy 0, policy_version 1572245 (0.0005) [2023-12-28 06:33:34,165][106225] Updated weights for policy 1, policy_version 1575746 (0.0007) [2023-12-28 06:33:34,225][106225] Updated weights for policy 1, policy_version 1575756 (0.0006) [2023-12-28 06:33:34,281][106225] Updated weights for policy 1, policy_version 1575766 (0.0007) [2023-12-28 06:33:34,632][106226] Updated weights for policy 0, policy_version 1572255 (0.0008) [2023-12-28 06:33:34,696][106226] Updated weights for policy 0, policy_version 1572265 (0.0010) [2023-12-28 06:33:34,754][106226] Updated weights for policy 0, policy_version 1572275 (0.0010) [2023-12-28 06:33:34,903][106225] Updated weights for policy 1, policy_version 1575776 (0.0006) [2023-12-28 06:33:34,948][106225] Updated weights for policy 1, policy_version 1575786 (0.0007) [2023-12-28 06:33:34,999][106225] Updated weights for policy 1, policy_version 1575796 (0.0005) [2023-12-28 06:33:35,561][106226] Updated weights for policy 0, policy_version 1572285 (0.0008) [2023-12-28 06:33:35,594][106225] Updated weights for policy 1, policy_version 1575806 (0.0007) [2023-12-28 06:33:35,614][106226] Updated weights for policy 0, policy_version 1572295 (0.0007) [2023-12-28 06:33:35,648][106225] Updated weights for policy 1, policy_version 1575816 (0.0007) [2023-12-28 06:33:35,662][106226] Updated weights for policy 0, policy_version 1572305 (0.0005) [2023-12-28 06:33:35,695][106225] Updated weights for policy 1, policy_version 1575826 (0.0005) [2023-12-28 06:33:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 806051840. Throughput: 0: 10168.4, 1: 9713.3. Samples: 806061748. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:36,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.649')] [2023-12-28 06:33:36,381][106225] Updated weights for policy 1, policy_version 1575836 (0.0008) [2023-12-28 06:33:36,437][106225] Updated weights for policy 1, policy_version 1575846 (0.0006) [2023-12-28 06:33:36,448][106226] Updated weights for policy 0, policy_version 1572315 (0.0006) [2023-12-28 06:33:36,498][106225] Updated weights for policy 1, policy_version 1575856 (0.0006) [2023-12-28 06:33:36,508][106226] Updated weights for policy 0, policy_version 1572325 (0.0008) [2023-12-28 06:33:36,570][106226] Updated weights for policy 0, policy_version 1572335 (0.0009) [2023-12-28 06:33:37,091][106225] Updated weights for policy 1, policy_version 1575866 (0.0007) [2023-12-28 06:33:37,142][106225] Updated weights for policy 1, policy_version 1575876 (0.0006) [2023-12-28 06:33:37,202][106225] Updated weights for policy 1, policy_version 1575886 (0.0010) [2023-12-28 06:33:37,259][106225] Updated weights for policy 1, policy_version 1575896 (0.0010) [2023-12-28 06:33:37,395][106226] Updated weights for policy 0, policy_version 1572345 (0.0008) [2023-12-28 06:33:37,457][106226] Updated weights for policy 0, policy_version 1572355 (0.0009) [2023-12-28 06:33:37,515][106226] Updated weights for policy 0, policy_version 1572365 (0.0010) [2023-12-28 06:33:37,574][106226] Updated weights for policy 0, policy_version 1572375 (0.0007) [2023-12-28 06:33:37,855][106225] Updated weights for policy 1, policy_version 1575906 (0.0006) [2023-12-28 06:33:37,923][106225] Updated weights for policy 1, policy_version 1575916 (0.0008) [2023-12-28 06:33:37,988][106225] Updated weights for policy 1, policy_version 1575926 (0.0006) [2023-12-28 06:33:38,387][106226] Updated weights for policy 0, policy_version 1572385 (0.0008) [2023-12-28 06:33:38,446][106226] Updated weights for policy 0, policy_version 1572395 (0.0007) [2023-12-28 06:33:38,517][106226] Updated weights for policy 0, policy_version 1572405 (0.0009) [2023-12-28 06:33:38,574][106225] Updated weights for policy 1, policy_version 1575936 (0.0006) [2023-12-28 06:33:38,642][106225] Updated weights for policy 1, policy_version 1575946 (0.0006) [2023-12-28 06:33:38,709][106225] Updated weights for policy 1, policy_version 1575956 (0.0008) [2023-12-28 06:33:39,260][106225] Updated weights for policy 1, policy_version 1575966 (0.0007) [2023-12-28 06:33:39,324][106225] Updated weights for policy 1, policy_version 1575976 (0.0007) [2023-12-28 06:33:39,341][106226] Updated weights for policy 0, policy_version 1572415 (0.0008) [2023-12-28 06:33:39,393][106225] Updated weights for policy 1, policy_version 1575986 (0.0009) [2023-12-28 06:33:39,411][106226] Updated weights for policy 0, policy_version 1572425 (0.0009) [2023-12-28 06:33:39,474][106226] Updated weights for policy 0, policy_version 1572435 (0.0008) [2023-12-28 06:33:40,136][106225] Updated weights for policy 1, policy_version 1575996 (0.0008) [2023-12-28 06:33:40,196][106225] Updated weights for policy 1, policy_version 1576006 (0.0008) [2023-12-28 06:33:40,208][106226] Updated weights for policy 0, policy_version 1572445 (0.0008) [2023-12-28 06:33:40,262][106225] Updated weights for policy 1, policy_version 1576016 (0.0008) [2023-12-28 06:33:40,273][106226] Updated weights for policy 0, policy_version 1572455 (0.0007) [2023-12-28 06:33:40,333][106226] Updated weights for policy 0, policy_version 1572465 (0.0007) [2023-12-28 06:33:40,924][106225] Updated weights for policy 1, policy_version 1576026 (0.0008) [2023-12-28 06:33:40,947][106226] Updated weights for policy 0, policy_version 1572475 (0.0005) [2023-12-28 06:33:40,972][106225] Updated weights for policy 1, policy_version 1576036 (0.0005) [2023-12-28 06:33:41,006][106226] Updated weights for policy 0, policy_version 1572485 (0.0006) [2023-12-28 06:33:41,027][106225] Updated weights for policy 1, policy_version 1576046 (0.0006) [2023-12-28 06:33:41,086][106226] Updated weights for policy 0, policy_version 1572495 (0.0008) [2023-12-28 06:33:41,092][106225] Updated weights for policy 1, policy_version 1576056 (0.0008) [2023-12-28 06:33:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 806158336. Throughput: 0: 10124.2, 1: 9854.7. Samples: 806121724. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:41,175][105115] Avg episode reward: [(0, '-4.890'), (1, '-4.697')] [2023-12-28 06:33:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001572504_402636800.pth... [2023-12-28 06:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001576056_403521536.pth... [2023-12-28 06:33:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001571320_402333696.pth [2023-12-28 06:33:41,185][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001572504_402636800.pth [2023-12-28 06:33:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001574872_403218432.pth [2023-12-28 06:33:41,186][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001576056_403521536.pth [2023-12-28 06:33:41,803][106226] Updated weights for policy 0, policy_version 1572505 (0.0007) [2023-12-28 06:33:41,857][106226] Updated weights for policy 0, policy_version 1572515 (0.0009) [2023-12-28 06:33:41,901][106225] Updated weights for policy 1, policy_version 1576066 (0.0009) [2023-12-28 06:33:41,915][106226] Updated weights for policy 0, policy_version 1572525 (0.0009) [2023-12-28 06:33:41,962][106225] Updated weights for policy 1, policy_version 1576076 (0.0009) [2023-12-28 06:33:41,977][106226] Updated weights for policy 0, policy_version 1572535 (0.0009) [2023-12-28 06:33:42,027][106225] Updated weights for policy 1, policy_version 1576086 (0.0009) [2023-12-28 06:33:42,839][106226] Updated weights for policy 0, policy_version 1572545 (0.0006) [2023-12-28 06:33:42,847][106225] Updated weights for policy 1, policy_version 1576096 (0.0008) [2023-12-28 06:33:42,893][106225] Updated weights for policy 1, policy_version 1576106 (0.0008) [2023-12-28 06:33:42,897][106226] Updated weights for policy 0, policy_version 1572555 (0.0005) [2023-12-28 06:33:42,950][106225] Updated weights for policy 1, policy_version 1576116 (0.0008) [2023-12-28 06:33:42,955][106226] Updated weights for policy 0, policy_version 1572565 (0.0006) [2023-12-28 06:33:43,522][106226] Updated weights for policy 0, policy_version 1572575 (0.0005) [2023-12-28 06:33:43,582][106226] Updated weights for policy 0, policy_version 1572585 (0.0005) [2023-12-28 06:33:43,635][106226] Updated weights for policy 0, policy_version 1572595 (0.0008) [2023-12-28 06:33:43,765][106225] Updated weights for policy 1, policy_version 1576126 (0.0006) [2023-12-28 06:33:43,815][106225] Updated weights for policy 1, policy_version 1576136 (0.0005) [2023-12-28 06:33:43,870][106225] Updated weights for policy 1, policy_version 1576146 (0.0005) [2023-12-28 06:33:44,285][106226] Updated weights for policy 0, policy_version 1572605 (0.0008) [2023-12-28 06:33:44,340][106226] Updated weights for policy 0, policy_version 1572615 (0.0008) [2023-12-28 06:33:44,402][106226] Updated weights for policy 0, policy_version 1572625 (0.0008) [2023-12-28 06:33:44,518][106225] Updated weights for policy 1, policy_version 1576156 (0.0007) [2023-12-28 06:33:44,564][106225] Updated weights for policy 1, policy_version 1576166 (0.0008) [2023-12-28 06:33:44,609][106225] Updated weights for policy 1, policy_version 1576176 (0.0008) [2023-12-28 06:33:45,150][106226] Updated weights for policy 0, policy_version 1572635 (0.0007) [2023-12-28 06:33:45,217][106226] Updated weights for policy 0, policy_version 1572645 (0.0006) [2023-12-28 06:33:45,287][106226] Updated weights for policy 0, policy_version 1572655 (0.0006) [2023-12-28 06:33:45,434][106225] Updated weights for policy 1, policy_version 1576186 (0.0008) [2023-12-28 06:33:45,490][106225] Updated weights for policy 1, policy_version 1576196 (0.0010) [2023-12-28 06:33:45,540][106225] Updated weights for policy 1, policy_version 1576206 (0.0010) [2023-12-28 06:33:45,590][106225] Updated weights for policy 1, policy_version 1576216 (0.0005) [2023-12-28 06:33:45,844][106226] Updated weights for policy 0, policy_version 1572665 (0.0006) [2023-12-28 06:33:45,893][106226] Updated weights for policy 0, policy_version 1572675 (0.0005) [2023-12-28 06:33:45,943][106226] Updated weights for policy 0, policy_version 1572685 (0.0010) [2023-12-28 06:33:45,994][106226] Updated weights for policy 0, policy_version 1572695 (0.0010) [2023-12-28 06:33:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 806248448. Throughput: 0: 10066.1, 1: 9849.6. Samples: 806237932. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:46,176][105115] Avg episode reward: [(0, '-4.943'), (1, '-4.521')] [2023-12-28 06:33:46,213][106225] Updated weights for policy 1, policy_version 1576226 (0.0010) [2023-12-28 06:33:46,261][106225] Updated weights for policy 1, policy_version 1576236 (0.0009) [2023-12-28 06:33:46,313][106225] Updated weights for policy 1, policy_version 1576246 (0.0005) [2023-12-28 06:33:46,698][106226] Updated weights for policy 0, policy_version 1572705 (0.0008) [2023-12-28 06:33:46,752][106226] Updated weights for policy 0, policy_version 1572715 (0.0008) [2023-12-28 06:33:46,811][106226] Updated weights for policy 0, policy_version 1572725 (0.0005) [2023-12-28 06:33:46,894][106225] Updated weights for policy 1, policy_version 1576256 (0.0005) [2023-12-28 06:33:46,949][106225] Updated weights for policy 1, policy_version 1576266 (0.0005) [2023-12-28 06:33:47,009][106225] Updated weights for policy 1, policy_version 1576276 (0.0009) [2023-12-28 06:33:47,413][106226] Updated weights for policy 0, policy_version 1572735 (0.0007) [2023-12-28 06:33:47,464][106226] Updated weights for policy 0, policy_version 1572745 (0.0008) [2023-12-28 06:33:47,517][106226] Updated weights for policy 0, policy_version 1572755 (0.0008) [2023-12-28 06:33:47,618][106225] Updated weights for policy 1, policy_version 1576286 (0.0007) [2023-12-28 06:33:47,672][106225] Updated weights for policy 1, policy_version 1576296 (0.0007) [2023-12-28 06:33:47,725][106225] Updated weights for policy 1, policy_version 1576306 (0.0008) [2023-12-28 06:33:48,302][106226] Updated weights for policy 0, policy_version 1572765 (0.0009) [2023-12-28 06:33:48,367][106226] Updated weights for policy 0, policy_version 1572775 (0.0008) [2023-12-28 06:33:48,388][106225] Updated weights for policy 1, policy_version 1576316 (0.0008) [2023-12-28 06:33:48,437][106226] Updated weights for policy 0, policy_version 1572785 (0.0008) [2023-12-28 06:33:48,445][106225] Updated weights for policy 1, policy_version 1576326 (0.0007) [2023-12-28 06:33:48,501][106225] Updated weights for policy 1, policy_version 1576336 (0.0007) [2023-12-28 06:33:49,184][106225] Updated weights for policy 1, policy_version 1576346 (0.0007) [2023-12-28 06:33:49,203][106226] Updated weights for policy 0, policy_version 1572795 (0.0007) [2023-12-28 06:33:49,248][106225] Updated weights for policy 1, policy_version 1576356 (0.0009) [2023-12-28 06:33:49,284][106226] Updated weights for policy 0, policy_version 1572805 (0.0009) [2023-12-28 06:33:49,310][106225] Updated weights for policy 1, policy_version 1576366 (0.0006) [2023-12-28 06:33:49,351][106226] Updated weights for policy 0, policy_version 1572815 (0.0008) [2023-12-28 06:33:49,378][106225] Updated weights for policy 1, policy_version 1576376 (0.0009) [2023-12-28 06:33:50,103][106226] Updated weights for policy 0, policy_version 1572825 (0.0008) [2023-12-28 06:33:50,125][106225] Updated weights for policy 1, policy_version 1576386 (0.0007) [2023-12-28 06:33:50,159][106226] Updated weights for policy 0, policy_version 1572835 (0.0008) [2023-12-28 06:33:50,182][106225] Updated weights for policy 1, policy_version 1576396 (0.0007) [2023-12-28 06:33:50,215][106226] Updated weights for policy 0, policy_version 1572845 (0.0008) [2023-12-28 06:33:50,244][106225] Updated weights for policy 1, policy_version 1576406 (0.0005) [2023-12-28 06:33:50,270][106226] Updated weights for policy 0, policy_version 1572855 (0.0008) [2023-12-28 06:33:50,947][106225] Updated weights for policy 1, policy_version 1576416 (0.0008) [2023-12-28 06:33:51,009][106225] Updated weights for policy 1, policy_version 1576426 (0.0008) [2023-12-28 06:33:51,066][106226] Updated weights for policy 0, policy_version 1572865 (0.0007) [2023-12-28 06:33:51,080][106225] Updated weights for policy 1, policy_version 1576436 (0.0008) [2023-12-28 06:33:51,129][106226] Updated weights for policy 0, policy_version 1572875 (0.0007) [2023-12-28 06:33:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 806346752. Throughput: 0: 9935.1, 1: 9968.1. Samples: 806358332. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:51,175][105115] Avg episode reward: [(0, '-4.816'), (1, '-4.515')] [2023-12-28 06:33:51,194][106226] Updated weights for policy 0, policy_version 1572885 (0.0009) [2023-12-28 06:33:51,722][106225] Updated weights for policy 1, policy_version 1576446 (0.0007) [2023-12-28 06:33:51,793][106225] Updated weights for policy 1, policy_version 1576456 (0.0007) [2023-12-28 06:33:51,853][106225] Updated weights for policy 1, policy_version 1576466 (0.0008) [2023-12-28 06:33:51,969][106226] Updated weights for policy 0, policy_version 1572895 (0.0009) [2023-12-28 06:33:52,026][106226] Updated weights for policy 0, policy_version 1572905 (0.0009) [2023-12-28 06:33:52,084][106226] Updated weights for policy 0, policy_version 1572915 (0.0008) [2023-12-28 06:33:52,463][106225] Updated weights for policy 1, policy_version 1576476 (0.0008) [2023-12-28 06:33:52,533][106225] Updated weights for policy 1, policy_version 1576486 (0.0009) [2023-12-28 06:33:52,602][106225] Updated weights for policy 1, policy_version 1576496 (0.0008) [2023-12-28 06:33:52,915][106226] Updated weights for policy 0, policy_version 1572925 (0.0010) [2023-12-28 06:33:52,977][106226] Updated weights for policy 0, policy_version 1572935 (0.0009) [2023-12-28 06:33:53,040][106226] Updated weights for policy 0, policy_version 1572945 (0.0009) [2023-12-28 06:33:53,320][106225] Updated weights for policy 1, policy_version 1576506 (0.0008) [2023-12-28 06:33:53,376][106225] Updated weights for policy 1, policy_version 1576516 (0.0009) [2023-12-28 06:33:53,431][106225] Updated weights for policy 1, policy_version 1576526 (0.0009) [2023-12-28 06:33:53,493][106225] Updated weights for policy 1, policy_version 1576536 (0.0010) [2023-12-28 06:33:53,677][106226] Updated weights for policy 0, policy_version 1572955 (0.0008) [2023-12-28 06:33:53,732][106226] Updated weights for policy 0, policy_version 1572965 (0.0005) [2023-12-28 06:33:53,787][106226] Updated weights for policy 0, policy_version 1572975 (0.0005) [2023-12-28 06:33:54,220][106225] Updated weights for policy 1, policy_version 1576546 (0.0005) [2023-12-28 06:33:54,269][106225] Updated weights for policy 1, policy_version 1576556 (0.0005) [2023-12-28 06:33:54,324][106225] Updated weights for policy 1, policy_version 1576566 (0.0007) [2023-12-28 06:33:54,325][106226] Updated weights for policy 0, policy_version 1572985 (0.0005) [2023-12-28 06:33:54,384][106226] Updated weights for policy 0, policy_version 1572995 (0.0007) [2023-12-28 06:33:54,435][106226] Updated weights for policy 0, policy_version 1573005 (0.0009) [2023-12-28 06:33:54,484][106226] Updated weights for policy 0, policy_version 1573015 (0.0008) [2023-12-28 06:33:54,909][106225] Updated weights for policy 1, policy_version 1576576 (0.0006) [2023-12-28 06:33:54,961][106225] Updated weights for policy 1, policy_version 1576586 (0.0005) [2023-12-28 06:33:55,017][106225] Updated weights for policy 1, policy_version 1576596 (0.0007) [2023-12-28 06:33:55,294][106226] Updated weights for policy 0, policy_version 1573025 (0.0009) [2023-12-28 06:33:55,343][106226] Updated weights for policy 0, policy_version 1573035 (0.0007) [2023-12-28 06:33:55,403][106226] Updated weights for policy 0, policy_version 1573045 (0.0009) [2023-12-28 06:33:55,659][106225] Updated weights for policy 1, policy_version 1576606 (0.0007) [2023-12-28 06:33:55,721][106225] Updated weights for policy 1, policy_version 1576616 (0.0009) [2023-12-28 06:33:55,774][106225] Updated weights for policy 1, policy_version 1576626 (0.0008) [2023-12-28 06:33:56,139][106226] Updated weights for policy 0, policy_version 1573055 (0.0008) [2023-12-28 06:33:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 806445056. Throughput: 0: 9955.7, 1: 9952.1. Samples: 806416692. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 06:33:56,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.549')] [2023-12-28 06:33:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001576632_403668992.pth... [2023-12-28 06:33:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001575448_403365888.pth [2023-12-28 06:33:56,191][106226] Updated weights for policy 0, policy_version 1573065 (0.0009) [2023-12-28 06:33:56,241][106226] Updated weights for policy 0, policy_version 1573075 (0.0008) [2023-12-28 06:33:56,261][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001573080_402784256.pth... [2023-12-28 06:33:56,264][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001571928_402489344.pth [2023-12-28 06:33:56,462][106225] Updated weights for policy 1, policy_version 1576636 (0.0008) [2023-12-28 06:33:56,520][106225] Updated weights for policy 1, policy_version 1576646 (0.0008) [2023-12-28 06:33:56,580][106225] Updated weights for policy 1, policy_version 1576656 (0.0008) [2023-12-28 06:33:56,963][106226] Updated weights for policy 0, policy_version 1573085 (0.0008) [2023-12-28 06:33:57,008][106226] Updated weights for policy 0, policy_version 1573095 (0.0008) [2023-12-28 06:33:57,057][106226] Updated weights for policy 0, policy_version 1573105 (0.0005) [2023-12-28 06:33:57,237][106225] Updated weights for policy 1, policy_version 1576666 (0.0006) [2023-12-28 06:33:57,291][106225] Updated weights for policy 1, policy_version 1576676 (0.0008) [2023-12-28 06:33:57,359][106225] Updated weights for policy 1, policy_version 1576686 (0.0007) [2023-12-28 06:33:57,418][106225] Updated weights for policy 1, policy_version 1576696 (0.0006) [2023-12-28 06:33:57,669][106226] Updated weights for policy 0, policy_version 1573115 (0.0005) [2023-12-28 06:33:57,731][106226] Updated weights for policy 0, policy_version 1573125 (0.0007) [2023-12-28 06:33:57,793][106226] Updated weights for policy 0, policy_version 1573135 (0.0009) [2023-12-28 06:33:58,076][106225] Updated weights for policy 1, policy_version 1576706 (0.0010) [2023-12-28 06:33:58,132][106225] Updated weights for policy 1, policy_version 1576716 (0.0010) [2023-12-28 06:33:58,192][106225] Updated weights for policy 1, policy_version 1576726 (0.0010) [2023-12-28 06:33:58,405][106226] Updated weights for policy 0, policy_version 1573145 (0.0007) [2023-12-28 06:33:58,464][106226] Updated weights for policy 0, policy_version 1573155 (0.0008) [2023-12-28 06:33:58,524][106226] Updated weights for policy 0, policy_version 1573165 (0.0008) [2023-12-28 06:33:58,580][106226] Updated weights for policy 0, policy_version 1573175 (0.0008) [2023-12-28 06:33:58,946][106225] Updated weights for policy 1, policy_version 1576736 (0.0010) [2023-12-28 06:33:59,042][106225] Updated weights for policy 1, policy_version 1576746 (0.0010) [2023-12-28 06:33:59,102][106225] Updated weights for policy 1, policy_version 1576756 (0.0010) [2023-12-28 06:33:59,406][106226] Updated weights for policy 0, policy_version 1573185 (0.0009) [2023-12-28 06:33:59,468][106226] Updated weights for policy 0, policy_version 1573195 (0.0009) [2023-12-28 06:33:59,536][106226] Updated weights for policy 0, policy_version 1573205 (0.0009) [2023-12-28 06:33:59,820][106225] Updated weights for policy 1, policy_version 1576766 (0.0009) [2023-12-28 06:33:59,880][106225] Updated weights for policy 1, policy_version 1576776 (0.0007) [2023-12-28 06:33:59,939][106225] Updated weights for policy 1, policy_version 1576786 (0.0007) [2023-12-28 06:34:00,273][106226] Updated weights for policy 0, policy_version 1573215 (0.0008) [2023-12-28 06:34:00,323][106226] Updated weights for policy 0, policy_version 1573225 (0.0009) [2023-12-28 06:34:00,381][106226] Updated weights for policy 0, policy_version 1573235 (0.0008) [2023-12-28 06:34:00,607][106225] Updated weights for policy 1, policy_version 1576796 (0.0007) [2023-12-28 06:34:00,674][106225] Updated weights for policy 1, policy_version 1576806 (0.0009) [2023-12-28 06:34:00,729][106225] Updated weights for policy 1, policy_version 1576816 (0.0007) [2023-12-28 06:34:01,059][106226] Updated weights for policy 0, policy_version 1573245 (0.0010) [2023-12-28 06:34:01,117][106226] Updated weights for policy 0, policy_version 1573255 (0.0009) [2023-12-28 06:34:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 806543360. Throughput: 0: 9868.7, 1: 10083.5. Samples: 806536636. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:01,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.509')] [2023-12-28 06:34:01,188][106226] Updated weights for policy 0, policy_version 1573265 (0.0008) [2023-12-28 06:34:01,444][106225] Updated weights for policy 1, policy_version 1576826 (0.0007) [2023-12-28 06:34:01,495][106225] Updated weights for policy 1, policy_version 1576836 (0.0008) [2023-12-28 06:34:01,556][106225] Updated weights for policy 1, policy_version 1576846 (0.0008) [2023-12-28 06:34:01,610][106225] Updated weights for policy 1, policy_version 1576856 (0.0008) [2023-12-28 06:34:01,882][106226] Updated weights for policy 0, policy_version 1573275 (0.0008) [2023-12-28 06:34:01,947][106226] Updated weights for policy 0, policy_version 1573285 (0.0007) [2023-12-28 06:34:02,007][106226] Updated weights for policy 0, policy_version 1573295 (0.0007) [2023-12-28 06:34:02,415][106225] Updated weights for policy 1, policy_version 1576866 (0.0008) [2023-12-28 06:34:02,476][106225] Updated weights for policy 1, policy_version 1576876 (0.0010) [2023-12-28 06:34:02,536][106225] Updated weights for policy 1, policy_version 1576886 (0.0010) [2023-12-28 06:34:02,615][106226] Updated weights for policy 0, policy_version 1573305 (0.0006) [2023-12-28 06:34:02,676][106226] Updated weights for policy 0, policy_version 1573315 (0.0008) [2023-12-28 06:34:02,744][106226] Updated weights for policy 0, policy_version 1573325 (0.0007) [2023-12-28 06:34:02,806][106226] Updated weights for policy 0, policy_version 1573335 (0.0006) [2023-12-28 06:34:03,161][106225] Updated weights for policy 1, policy_version 1576896 (0.0010) [2023-12-28 06:34:03,207][106225] Updated weights for policy 1, policy_version 1576906 (0.0010) [2023-12-28 06:34:03,261][106225] Updated weights for policy 1, policy_version 1576916 (0.0010) [2023-12-28 06:34:03,509][106226] Updated weights for policy 0, policy_version 1573345 (0.0008) [2023-12-28 06:34:03,557][106226] Updated weights for policy 0, policy_version 1573355 (0.0007) [2023-12-28 06:34:03,621][106226] Updated weights for policy 0, policy_version 1573365 (0.0008) [2023-12-28 06:34:03,993][106225] Updated weights for policy 1, policy_version 1576926 (0.0008) [2023-12-28 06:34:04,046][106225] Updated weights for policy 1, policy_version 1576936 (0.0006) [2023-12-28 06:34:04,100][106225] Updated weights for policy 1, policy_version 1576946 (0.0007) [2023-12-28 06:34:04,361][106226] Updated weights for policy 0, policy_version 1573375 (0.0008) [2023-12-28 06:34:04,423][106226] Updated weights for policy 0, policy_version 1573385 (0.0007) [2023-12-28 06:34:04,487][106226] Updated weights for policy 0, policy_version 1573395 (0.0005) [2023-12-28 06:34:04,908][106225] Updated weights for policy 1, policy_version 1576956 (0.0007) [2023-12-28 06:34:04,955][106225] Updated weights for policy 1, policy_version 1576966 (0.0005) [2023-12-28 06:34:05,002][106225] Updated weights for policy 1, policy_version 1576976 (0.0005) [2023-12-28 06:34:05,002][106226] Updated weights for policy 0, policy_version 1573405 (0.0005) [2023-12-28 06:34:05,068][106226] Updated weights for policy 0, policy_version 1573415 (0.0006) [2023-12-28 06:34:05,121][106226] Updated weights for policy 0, policy_version 1573425 (0.0008) [2023-12-28 06:34:05,588][106225] Updated weights for policy 1, policy_version 1576986 (0.0006) [2023-12-28 06:34:05,642][106225] Updated weights for policy 1, policy_version 1576996 (0.0008) [2023-12-28 06:34:05,692][106226] Updated weights for policy 0, policy_version 1573435 (0.0009) [2023-12-28 06:34:05,698][106225] Updated weights for policy 1, policy_version 1577006 (0.0005) [2023-12-28 06:34:05,750][106226] Updated weights for policy 0, policy_version 1573445 (0.0010) [2023-12-28 06:34:05,759][106225] Updated weights for policy 1, policy_version 1577016 (0.0005) [2023-12-28 06:34:05,796][106226] Updated weights for policy 0, policy_version 1573455 (0.0010) [2023-12-28 06:34:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 806649856. Throughput: 0: 9909.8, 1: 10120.6. Samples: 806658704. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:06,175][105115] Avg episode reward: [(0, '-4.855'), (1, '-4.593')] [2023-12-28 06:34:06,360][106225] Updated weights for policy 1, policy_version 1577026 (0.0011) [2023-12-28 06:34:06,401][106226] Updated weights for policy 0, policy_version 1573465 (0.0010) [2023-12-28 06:34:06,419][106225] Updated weights for policy 1, policy_version 1577036 (0.0011) [2023-12-28 06:34:06,467][106226] Updated weights for policy 0, policy_version 1573475 (0.0009) [2023-12-28 06:34:06,483][106225] Updated weights for policy 1, policy_version 1577046 (0.0011) [2023-12-28 06:34:06,526][106226] Updated weights for policy 0, policy_version 1573485 (0.0011) [2023-12-28 06:34:06,590][106226] Updated weights for policy 0, policy_version 1573495 (0.0010) [2023-12-28 06:34:07,194][106225] Updated weights for policy 1, policy_version 1577056 (0.0007) [2023-12-28 06:34:07,207][106226] Updated weights for policy 0, policy_version 1573505 (0.0007) [2023-12-28 06:34:07,254][106225] Updated weights for policy 1, policy_version 1577066 (0.0005) [2023-12-28 06:34:07,267][106226] Updated weights for policy 0, policy_version 1573515 (0.0007) [2023-12-28 06:34:07,316][106225] Updated weights for policy 1, policy_version 1577076 (0.0007) [2023-12-28 06:34:07,323][106226] Updated weights for policy 0, policy_version 1573525 (0.0005) [2023-12-28 06:34:07,999][106225] Updated weights for policy 1, policy_version 1577086 (0.0008) [2023-12-28 06:34:08,021][106226] Updated weights for policy 0, policy_version 1573535 (0.0007) [2023-12-28 06:34:08,061][106225] Updated weights for policy 1, policy_version 1577096 (0.0007) [2023-12-28 06:34:08,085][106226] Updated weights for policy 0, policy_version 1573545 (0.0008) [2023-12-28 06:34:08,122][106225] Updated weights for policy 1, policy_version 1577106 (0.0007) [2023-12-28 06:34:08,145][106226] Updated weights for policy 0, policy_version 1573555 (0.0008) [2023-12-28 06:34:08,156][106141] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000001 [2023-12-28 06:34:08,818][106225] Updated weights for policy 1, policy_version 1577116 (0.0007) [2023-12-28 06:34:08,865][106225] Updated weights for policy 1, policy_version 1577126 (0.0006) [2023-12-28 06:34:08,915][106225] Updated weights for policy 1, policy_version 1577136 (0.0008) [2023-12-28 06:34:08,941][106226] Updated weights for policy 0, policy_version 1573565 (0.0007) [2023-12-28 06:34:08,988][106226] Updated weights for policy 0, policy_version 1573575 (0.0006) [2023-12-28 06:34:09,036][106226] Updated weights for policy 0, policy_version 1573585 (0.0010) [2023-12-28 06:34:09,652][106225] Updated weights for policy 1, policy_version 1577146 (0.0008) [2023-12-28 06:34:09,717][106225] Updated weights for policy 1, policy_version 1577156 (0.0009) [2023-12-28 06:34:09,769][106226] Updated weights for policy 0, policy_version 1573595 (0.0009) [2023-12-28 06:34:09,775][106225] Updated weights for policy 1, policy_version 1577166 (0.0008) [2023-12-28 06:34:09,830][106226] Updated weights for policy 0, policy_version 1573605 (0.0007) [2023-12-28 06:34:09,841][106225] Updated weights for policy 1, policy_version 1577176 (0.0007) [2023-12-28 06:34:09,903][106226] Updated weights for policy 0, policy_version 1573615 (0.0008) [2023-12-28 06:34:10,551][106225] Updated weights for policy 1, policy_version 1577186 (0.0008) [2023-12-28 06:34:10,583][106226] Updated weights for policy 0, policy_version 1573625 (0.0008) [2023-12-28 06:34:10,614][106225] Updated weights for policy 1, policy_version 1577196 (0.0007) [2023-12-28 06:34:10,632][106226] Updated weights for policy 0, policy_version 1573635 (0.0006) [2023-12-28 06:34:10,671][106225] Updated weights for policy 1, policy_version 1577206 (0.0007) [2023-12-28 06:34:10,681][106226] Updated weights for policy 0, policy_version 1573645 (0.0007) [2023-12-28 06:34:10,743][106226] Updated weights for policy 0, policy_version 1573655 (0.0008) [2023-12-28 06:34:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 806748160. Throughput: 0: 9951.6, 1: 10159.0. Samples: 806719988. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:11,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-4.589')] [2023-12-28 06:34:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001577208_403816448.pth... [2023-12-28 06:34:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001573656_402931712.pth... [2023-12-28 06:34:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001572504_402636800.pth [2023-12-28 06:34:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001576056_403521536.pth [2023-12-28 06:34:11,398][106225] Updated weights for policy 1, policy_version 1577216 (0.0008) [2023-12-28 06:34:11,454][106225] Updated weights for policy 1, policy_version 1577226 (0.0010) [2023-12-28 06:34:11,513][106225] Updated weights for policy 1, policy_version 1577236 (0.0011) [2023-12-28 06:34:11,591][106226] Updated weights for policy 0, policy_version 1573665 (0.0009) [2023-12-28 06:34:11,660][106226] Updated weights for policy 0, policy_version 1573675 (0.0009) [2023-12-28 06:34:11,723][106226] Updated weights for policy 0, policy_version 1573685 (0.0007) [2023-12-28 06:34:12,265][106225] Updated weights for policy 1, policy_version 1577246 (0.0009) [2023-12-28 06:34:12,331][106225] Updated weights for policy 1, policy_version 1577256 (0.0008) [2023-12-28 06:34:12,394][106225] Updated weights for policy 1, policy_version 1577266 (0.0008) [2023-12-28 06:34:12,497][106226] Updated weights for policy 0, policy_version 1573695 (0.0008) [2023-12-28 06:34:12,555][106226] Updated weights for policy 0, policy_version 1573705 (0.0008) [2023-12-28 06:34:12,609][106226] Updated weights for policy 0, policy_version 1573715 (0.0009) [2023-12-28 06:34:13,100][106225] Updated weights for policy 1, policy_version 1577276 (0.0008) [2023-12-28 06:34:13,153][106225] Updated weights for policy 1, policy_version 1577286 (0.0007) [2023-12-28 06:34:13,218][106225] Updated weights for policy 1, policy_version 1577296 (0.0008) [2023-12-28 06:34:13,333][106226] Updated weights for policy 0, policy_version 1573725 (0.0010) [2023-12-28 06:34:13,389][106226] Updated weights for policy 0, policy_version 1573735 (0.0010) [2023-12-28 06:34:13,445][106226] Updated weights for policy 0, policy_version 1573745 (0.0010) [2023-12-28 06:34:13,951][106225] Updated weights for policy 1, policy_version 1577306 (0.0008) [2023-12-28 06:34:14,018][106225] Updated weights for policy 1, policy_version 1577316 (0.0008) [2023-12-28 06:34:14,081][106225] Updated weights for policy 1, policy_version 1577326 (0.0008) [2023-12-28 06:34:14,139][106226] Updated weights for policy 0, policy_version 1573755 (0.0010) [2023-12-28 06:34:14,147][106225] Updated weights for policy 1, policy_version 1577336 (0.0008) [2023-12-28 06:34:14,184][106226] Updated weights for policy 0, policy_version 1573765 (0.0010) [2023-12-28 06:34:14,230][106226] Updated weights for policy 0, policy_version 1573775 (0.0010) [2023-12-28 06:34:14,760][106225] Updated weights for policy 1, policy_version 1577346 (0.0006) [2023-12-28 06:34:14,830][106225] Updated weights for policy 1, policy_version 1577356 (0.0008) [2023-12-28 06:34:14,895][106225] Updated weights for policy 1, policy_version 1577366 (0.0008) [2023-12-28 06:34:14,980][106226] Updated weights for policy 0, policy_version 1573785 (0.0010) [2023-12-28 06:34:15,042][106226] Updated weights for policy 0, policy_version 1573795 (0.0011) [2023-12-28 06:34:15,101][106226] Updated weights for policy 0, policy_version 1573805 (0.0011) [2023-12-28 06:34:15,167][106226] Updated weights for policy 0, policy_version 1573815 (0.0011) [2023-12-28 06:34:15,648][106225] Updated weights for policy 1, policy_version 1577376 (0.0007) [2023-12-28 06:34:15,695][106225] Updated weights for policy 1, policy_version 1577386 (0.0005) [2023-12-28 06:34:15,739][106225] Updated weights for policy 1, policy_version 1577396 (0.0005) [2023-12-28 06:34:15,888][106226] Updated weights for policy 0, policy_version 1573825 (0.0010) [2023-12-28 06:34:15,956][106226] Updated weights for policy 0, policy_version 1573835 (0.0008) [2023-12-28 06:34:16,025][106226] Updated weights for policy 0, policy_version 1573845 (0.0008) [2023-12-28 06:34:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 806846464. Throughput: 0: 9806.7, 1: 10106.0. Samples: 806834628. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:16,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-4.486')] [2023-12-28 06:34:16,381][106225] Updated weights for policy 1, policy_version 1577406 (0.0008) [2023-12-28 06:34:16,435][106225] Updated weights for policy 1, policy_version 1577416 (0.0010) [2023-12-28 06:34:16,489][106225] Updated weights for policy 1, policy_version 1577426 (0.0010) [2023-12-28 06:34:16,589][106226] Updated weights for policy 0, policy_version 1573855 (0.0008) [2023-12-28 06:34:16,642][106226] Updated weights for policy 0, policy_version 1573865 (0.0010) [2023-12-28 06:34:16,699][106226] Updated weights for policy 0, policy_version 1573875 (0.0011) [2023-12-28 06:34:17,128][106225] Updated weights for policy 1, policy_version 1577436 (0.0010) [2023-12-28 06:34:17,178][106225] Updated weights for policy 1, policy_version 1577446 (0.0010) [2023-12-28 06:34:17,229][106225] Updated weights for policy 1, policy_version 1577456 (0.0010) [2023-12-28 06:34:17,416][106226] Updated weights for policy 0, policy_version 1573885 (0.0010) [2023-12-28 06:34:17,466][106226] Updated weights for policy 0, policy_version 1573895 (0.0010) [2023-12-28 06:34:17,516][106226] Updated weights for policy 0, policy_version 1573905 (0.0010) [2023-12-28 06:34:17,962][106225] Updated weights for policy 1, policy_version 1577466 (0.0009) [2023-12-28 06:34:18,014][106225] Updated weights for policy 1, policy_version 1577476 (0.0009) [2023-12-28 06:34:18,077][106225] Updated weights for policy 1, policy_version 1577486 (0.0010) [2023-12-28 06:34:18,080][106226] Updated weights for policy 0, policy_version 1573915 (0.0009) [2023-12-28 06:34:18,131][106226] Updated weights for policy 0, policy_version 1573925 (0.0010) [2023-12-28 06:34:18,141][106225] Updated weights for policy 1, policy_version 1577496 (0.0009) [2023-12-28 06:34:18,186][106226] Updated weights for policy 0, policy_version 1573935 (0.0010) [2023-12-28 06:34:18,847][106225] Updated weights for policy 1, policy_version 1577506 (0.0010) [2023-12-28 06:34:18,904][106225] Updated weights for policy 1, policy_version 1577516 (0.0010) [2023-12-28 06:34:18,929][106226] Updated weights for policy 0, policy_version 1573945 (0.0010) [2023-12-28 06:34:18,961][106225] Updated weights for policy 1, policy_version 1577526 (0.0010) [2023-12-28 06:34:18,998][106226] Updated weights for policy 0, policy_version 1573955 (0.0006) [2023-12-28 06:34:19,055][106226] Updated weights for policy 0, policy_version 1573965 (0.0008) [2023-12-28 06:34:19,112][106226] Updated weights for policy 0, policy_version 1573975 (0.0007) [2023-12-28 06:34:19,686][106225] Updated weights for policy 1, policy_version 1577536 (0.0011) [2023-12-28 06:34:19,757][106225] Updated weights for policy 1, policy_version 1577546 (0.0010) [2023-12-28 06:34:19,833][106225] Updated weights for policy 1, policy_version 1577556 (0.0010) [2023-12-28 06:34:19,898][106226] Updated weights for policy 0, policy_version 1573985 (0.0010) [2023-12-28 06:34:19,963][106226] Updated weights for policy 0, policy_version 1573995 (0.0011) [2023-12-28 06:34:20,028][106226] Updated weights for policy 0, policy_version 1574005 (0.0011) [2023-12-28 06:34:20,568][106225] Updated weights for policy 1, policy_version 1577566 (0.0009) [2023-12-28 06:34:20,640][106225] Updated weights for policy 1, policy_version 1577576 (0.0008) [2023-12-28 06:34:20,705][106225] Updated weights for policy 1, policy_version 1577586 (0.0007) [2023-12-28 06:34:20,729][106226] Updated weights for policy 0, policy_version 1574015 (0.0010) [2023-12-28 06:34:20,795][106226] Updated weights for policy 0, policy_version 1574025 (0.0011) [2023-12-28 06:34:20,859][106226] Updated weights for policy 0, policy_version 1574035 (0.0011) [2023-12-28 06:34:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 806944768. Throughput: 0: 9791.8, 1: 10021.9. Samples: 806953364. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:21,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-5.013')] [2023-12-28 06:34:21,460][106225] Updated weights for policy 1, policy_version 1577596 (0.0007) [2023-12-28 06:34:21,524][106225] Updated weights for policy 1, policy_version 1577606 (0.0008) [2023-12-28 06:34:21,585][106225] Updated weights for policy 1, policy_version 1577616 (0.0008) [2023-12-28 06:34:21,644][106226] Updated weights for policy 0, policy_version 1574045 (0.0010) [2023-12-28 06:34:21,712][106226] Updated weights for policy 0, policy_version 1574055 (0.0011) [2023-12-28 06:34:21,784][106226] Updated weights for policy 0, policy_version 1574065 (0.0009) [2023-12-28 06:34:22,401][106225] Updated weights for policy 1, policy_version 1577626 (0.0009) [2023-12-28 06:34:22,472][106225] Updated weights for policy 1, policy_version 1577636 (0.0009) [2023-12-28 06:34:22,492][106226] Updated weights for policy 0, policy_version 1574075 (0.0007) [2023-12-28 06:34:22,539][106225] Updated weights for policy 1, policy_version 1577646 (0.0008) [2023-12-28 06:34:22,557][106226] Updated weights for policy 0, policy_version 1574085 (0.0007) [2023-12-28 06:34:22,594][106225] Updated weights for policy 1, policy_version 1577656 (0.0006) [2023-12-28 06:34:22,614][106226] Updated weights for policy 0, policy_version 1574095 (0.0009) [2023-12-28 06:34:23,293][106225] Updated weights for policy 1, policy_version 1577666 (0.0009) [2023-12-28 06:34:23,321][106226] Updated weights for policy 0, policy_version 1574105 (0.0006) [2023-12-28 06:34:23,350][106225] Updated weights for policy 1, policy_version 1577676 (0.0008) [2023-12-28 06:34:23,388][106226] Updated weights for policy 0, policy_version 1574115 (0.0006) [2023-12-28 06:34:23,412][106225] Updated weights for policy 1, policy_version 1577686 (0.0008) [2023-12-28 06:34:23,449][106226] Updated weights for policy 0, policy_version 1574125 (0.0009) [2023-12-28 06:34:23,516][106226] Updated weights for policy 0, policy_version 1574135 (0.0009) [2023-12-28 06:34:24,182][106226] Updated weights for policy 0, policy_version 1574145 (0.0007) [2023-12-28 06:34:24,197][106225] Updated weights for policy 1, policy_version 1577696 (0.0007) [2023-12-28 06:34:24,236][106226] Updated weights for policy 0, policy_version 1574155 (0.0009) [2023-12-28 06:34:24,252][106225] Updated weights for policy 1, policy_version 1577706 (0.0006) [2023-12-28 06:34:24,296][106226] Updated weights for policy 0, policy_version 1574165 (0.0009) [2023-12-28 06:34:24,311][106225] Updated weights for policy 1, policy_version 1577716 (0.0007) [2023-12-28 06:34:25,000][106226] Updated weights for policy 0, policy_version 1574175 (0.0006) [2023-12-28 06:34:25,020][106225] Updated weights for policy 1, policy_version 1577726 (0.0006) [2023-12-28 06:34:25,062][106226] Updated weights for policy 0, policy_version 1574185 (0.0008) [2023-12-28 06:34:25,070][106225] Updated weights for policy 1, policy_version 1577736 (0.0005) [2023-12-28 06:34:25,125][106226] Updated weights for policy 0, policy_version 1574195 (0.0010) [2023-12-28 06:34:25,127][106225] Updated weights for policy 1, policy_version 1577746 (0.0006) [2023-12-28 06:34:25,772][106226] Updated weights for policy 0, policy_version 1574205 (0.0008) [2023-12-28 06:34:25,815][106225] Updated weights for policy 1, policy_version 1577756 (0.0010) [2023-12-28 06:34:25,831][106226] Updated weights for policy 0, policy_version 1574215 (0.0005) [2023-12-28 06:34:25,873][106225] Updated weights for policy 1, policy_version 1577766 (0.0010) [2023-12-28 06:34:25,885][106226] Updated weights for policy 0, policy_version 1574225 (0.0005) [2023-12-28 06:34:25,927][106225] Updated weights for policy 1, policy_version 1577776 (0.0009) [2023-12-28 06:34:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 807043072. Throughput: 0: 9836.5, 1: 9881.2. Samples: 807009024. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:26,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.728')] [2023-12-28 06:34:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001577784_403963904.pth... [2023-12-28 06:34:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001574232_403079168.pth... [2023-12-28 06:34:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001573080_402784256.pth [2023-12-28 06:34:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001576632_403668992.pth [2023-12-28 06:34:26,390][106226] Updated weights for policy 0, policy_version 1574235 (0.0005) [2023-12-28 06:34:26,443][106226] Updated weights for policy 0, policy_version 1574245 (0.0005) [2023-12-28 06:34:26,501][106226] Updated weights for policy 0, policy_version 1574255 (0.0008) [2023-12-28 06:34:26,561][106225] Updated weights for policy 1, policy_version 1577786 (0.0005) [2023-12-28 06:34:26,622][106225] Updated weights for policy 1, policy_version 1577796 (0.0006) [2023-12-28 06:34:26,669][106225] Updated weights for policy 1, policy_version 1577806 (0.0006) [2023-12-28 06:34:26,719][106225] Updated weights for policy 1, policy_version 1577816 (0.0005) [2023-12-28 06:34:27,038][106226] Updated weights for policy 0, policy_version 1574265 (0.0010) [2023-12-28 06:34:27,105][106226] Updated weights for policy 0, policy_version 1574275 (0.0005) [2023-12-28 06:34:27,169][106226] Updated weights for policy 0, policy_version 1574285 (0.0007) [2023-12-28 06:34:27,220][106226] Updated weights for policy 0, policy_version 1574295 (0.0008) [2023-12-28 06:34:27,262][106225] Updated weights for policy 1, policy_version 1577826 (0.0010) [2023-12-28 06:34:27,318][106225] Updated weights for policy 1, policy_version 1577836 (0.0010) [2023-12-28 06:34:27,378][106225] Updated weights for policy 1, policy_version 1577846 (0.0006) [2023-12-28 06:34:27,871][106226] Updated weights for policy 0, policy_version 1574305 (0.0006) [2023-12-28 06:34:27,910][106225] Updated weights for policy 1, policy_version 1577856 (0.0005) [2023-12-28 06:34:27,921][106226] Updated weights for policy 0, policy_version 1574315 (0.0005) [2023-12-28 06:34:27,971][106225] Updated weights for policy 1, policy_version 1577866 (0.0005) [2023-12-28 06:34:27,975][106226] Updated weights for policy 0, policy_version 1574325 (0.0005) [2023-12-28 06:34:28,029][106225] Updated weights for policy 1, policy_version 1577876 (0.0005) [2023-12-28 06:34:28,570][106226] Updated weights for policy 0, policy_version 1574335 (0.0009) [2023-12-28 06:34:28,619][106225] Updated weights for policy 1, policy_version 1577886 (0.0008) [2023-12-28 06:34:28,629][106226] Updated weights for policy 0, policy_version 1574345 (0.0011) [2023-12-28 06:34:28,679][106225] Updated weights for policy 1, policy_version 1577896 (0.0010) [2023-12-28 06:34:28,691][106226] Updated weights for policy 0, policy_version 1574355 (0.0011) [2023-12-28 06:34:28,740][106225] Updated weights for policy 1, policy_version 1577906 (0.0010) [2023-12-28 06:34:29,368][106225] Updated weights for policy 1, policy_version 1577916 (0.0009) [2023-12-28 06:34:29,419][106225] Updated weights for policy 1, policy_version 1577926 (0.0006) [2023-12-28 06:34:29,434][106226] Updated weights for policy 0, policy_version 1574365 (0.0009) [2023-12-28 06:34:29,471][106225] Updated weights for policy 1, policy_version 1577936 (0.0007) [2023-12-28 06:34:29,492][106226] Updated weights for policy 0, policy_version 1574375 (0.0008) [2023-12-28 06:34:29,540][106226] Updated weights for policy 0, policy_version 1574385 (0.0008) [2023-12-28 06:34:30,182][106226] Updated weights for policy 0, policy_version 1574395 (0.0006) [2023-12-28 06:34:30,216][106225] Updated weights for policy 1, policy_version 1577946 (0.0009) [2023-12-28 06:34:30,241][106226] Updated weights for policy 0, policy_version 1574405 (0.0008) [2023-12-28 06:34:30,271][106225] Updated weights for policy 1, policy_version 1577956 (0.0005) [2023-12-28 06:34:30,293][106226] Updated weights for policy 0, policy_version 1574415 (0.0007) [2023-12-28 06:34:30,328][106225] Updated weights for policy 1, policy_version 1577966 (0.0007) [2023-12-28 06:34:30,379][106225] Updated weights for policy 1, policy_version 1577976 (0.0008) [2023-12-28 06:34:30,859][106226] Updated weights for policy 0, policy_version 1574425 (0.0007) [2023-12-28 06:34:30,916][106226] Updated weights for policy 0, policy_version 1574435 (0.0009) [2023-12-28 06:34:30,970][106226] Updated weights for policy 0, policy_version 1574445 (0.0008) [2023-12-28 06:34:31,025][106226] Updated weights for policy 0, policy_version 1574455 (0.0008) [2023-12-28 06:34:31,066][106225] Updated weights for policy 1, policy_version 1577986 (0.0008) [2023-12-28 06:34:31,127][106225] Updated weights for policy 1, policy_version 1577996 (0.0007) [2023-12-28 06:34:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 807149568. Throughput: 0: 9975.0, 1: 10046.8. Samples: 807138916. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:31,175][105115] Avg episode reward: [(0, '-4.685'), (1, '-4.589')] [2023-12-28 06:34:31,192][106225] Updated weights for policy 1, policy_version 1578006 (0.0007) [2023-12-28 06:34:31,772][106226] Updated weights for policy 0, policy_version 1574465 (0.0008) [2023-12-28 06:34:31,833][106226] Updated weights for policy 0, policy_version 1574475 (0.0008) [2023-12-28 06:34:31,897][106226] Updated weights for policy 0, policy_version 1574485 (0.0007) [2023-12-28 06:34:31,943][106225] Updated weights for policy 1, policy_version 1578016 (0.0008) [2023-12-28 06:34:32,000][106225] Updated weights for policy 1, policy_version 1578026 (0.0008) [2023-12-28 06:34:32,058][106225] Updated weights for policy 1, policy_version 1578036 (0.0008) [2023-12-28 06:34:32,585][106226] Updated weights for policy 0, policy_version 1574495 (0.0006) [2023-12-28 06:34:32,639][106226] Updated weights for policy 0, policy_version 1574505 (0.0008) [2023-12-28 06:34:32,698][106226] Updated weights for policy 0, policy_version 1574515 (0.0009) [2023-12-28 06:34:32,790][106225] Updated weights for policy 1, policy_version 1578046 (0.0008) [2023-12-28 06:34:32,844][106225] Updated weights for policy 1, policy_version 1578056 (0.0008) [2023-12-28 06:34:32,907][106225] Updated weights for policy 1, policy_version 1578066 (0.0008) [2023-12-28 06:34:33,419][106226] Updated weights for policy 0, policy_version 1574525 (0.0006) [2023-12-28 06:34:33,466][106226] Updated weights for policy 0, policy_version 1574535 (0.0008) [2023-12-28 06:34:33,510][106226] Updated weights for policy 0, policy_version 1574545 (0.0008) [2023-12-28 06:34:33,562][106225] Updated weights for policy 1, policy_version 1578076 (0.0006) [2023-12-28 06:34:33,618][106225] Updated weights for policy 1, policy_version 1578086 (0.0008) [2023-12-28 06:34:33,681][106225] Updated weights for policy 1, policy_version 1578096 (0.0008) [2023-12-28 06:34:34,288][106226] Updated weights for policy 0, policy_version 1574555 (0.0008) [2023-12-28 06:34:34,355][106226] Updated weights for policy 0, policy_version 1574565 (0.0009) [2023-12-28 06:34:34,409][106225] Updated weights for policy 1, policy_version 1578106 (0.0009) [2023-12-28 06:34:34,424][106226] Updated weights for policy 0, policy_version 1574575 (0.0008) [2023-12-28 06:34:34,461][106225] Updated weights for policy 1, policy_version 1578116 (0.0007) [2023-12-28 06:34:34,513][106225] Updated weights for policy 1, policy_version 1578126 (0.0008) [2023-12-28 06:34:34,563][106225] Updated weights for policy 1, policy_version 1578136 (0.0008) [2023-12-28 06:34:35,174][106226] Updated weights for policy 0, policy_version 1574585 (0.0007) [2023-12-28 06:34:35,230][106226] Updated weights for policy 0, policy_version 1574595 (0.0008) [2023-12-28 06:34:35,278][106226] Updated weights for policy 0, policy_version 1574605 (0.0006) [2023-12-28 06:34:35,280][106225] Updated weights for policy 1, policy_version 1578146 (0.0006) [2023-12-28 06:34:35,336][106226] Updated weights for policy 0, policy_version 1574615 (0.0005) [2023-12-28 06:34:35,338][106225] Updated weights for policy 1, policy_version 1578156 (0.0008) [2023-12-28 06:34:35,395][106225] Updated weights for policy 1, policy_version 1578166 (0.0008) [2023-12-28 06:34:36,009][106226] Updated weights for policy 0, policy_version 1574625 (0.0007) [2023-12-28 06:34:36,060][106226] Updated weights for policy 0, policy_version 1574635 (0.0005) [2023-12-28 06:34:36,130][106226] Updated weights for policy 0, policy_version 1574645 (0.0006) [2023-12-28 06:34:36,149][106225] Updated weights for policy 1, policy_version 1578176 (0.0007) [2023-12-28 06:34:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 807247872. Throughput: 0: 10008.6, 1: 9963.5. Samples: 807257072. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:36,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.588')] [2023-12-28 06:34:36,200][106225] Updated weights for policy 1, policy_version 1578186 (0.0008) [2023-12-28 06:34:36,262][106225] Updated weights for policy 1, policy_version 1578196 (0.0008) [2023-12-28 06:34:36,783][106226] Updated weights for policy 0, policy_version 1574655 (0.0008) [2023-12-28 06:34:36,837][106226] Updated weights for policy 0, policy_version 1574665 (0.0008) [2023-12-28 06:34:36,895][106226] Updated weights for policy 0, policy_version 1574675 (0.0008) [2023-12-28 06:34:37,028][106225] Updated weights for policy 1, policy_version 1578206 (0.0008) [2023-12-28 06:34:37,073][106225] Updated weights for policy 1, policy_version 1578216 (0.0008) [2023-12-28 06:34:37,128][106225] Updated weights for policy 1, policy_version 1578226 (0.0008) [2023-12-28 06:34:37,654][106226] Updated weights for policy 0, policy_version 1574685 (0.0009) [2023-12-28 06:34:37,712][106226] Updated weights for policy 0, policy_version 1574695 (0.0009) [2023-12-28 06:34:37,773][106226] Updated weights for policy 0, policy_version 1574705 (0.0009) [2023-12-28 06:34:37,819][106225] Updated weights for policy 1, policy_version 1578236 (0.0008) [2023-12-28 06:34:37,883][106225] Updated weights for policy 1, policy_version 1578246 (0.0008) [2023-12-28 06:34:37,944][106225] Updated weights for policy 1, policy_version 1578256 (0.0009) [2023-12-28 06:34:38,528][106226] Updated weights for policy 0, policy_version 1574715 (0.0008) [2023-12-28 06:34:38,594][106226] Updated weights for policy 0, policy_version 1574725 (0.0006) [2023-12-28 06:34:38,629][106225] Updated weights for policy 1, policy_version 1578266 (0.0007) [2023-12-28 06:34:38,659][106226] Updated weights for policy 0, policy_version 1574735 (0.0006) [2023-12-28 06:34:38,681][106225] Updated weights for policy 1, policy_version 1578276 (0.0010) [2023-12-28 06:34:38,733][106225] Updated weights for policy 1, policy_version 1578286 (0.0010) [2023-12-28 06:34:38,794][106225] Updated weights for policy 1, policy_version 1578296 (0.0010) [2023-12-28 06:34:39,212][106226] Updated weights for policy 0, policy_version 1574745 (0.0006) [2023-12-28 06:34:39,279][106226] Updated weights for policy 0, policy_version 1574755 (0.0008) [2023-12-28 06:34:39,345][106226] Updated weights for policy 0, policy_version 1574765 (0.0007) [2023-12-28 06:34:39,414][106226] Updated weights for policy 0, policy_version 1574775 (0.0009) [2023-12-28 06:34:39,573][106225] Updated weights for policy 1, policy_version 1578306 (0.0005) [2023-12-28 06:34:39,640][106225] Updated weights for policy 1, policy_version 1578316 (0.0006) [2023-12-28 06:34:39,701][106225] Updated weights for policy 1, policy_version 1578326 (0.0006) [2023-12-28 06:34:40,204][106226] Updated weights for policy 0, policy_version 1574785 (0.0008) [2023-12-28 06:34:40,267][106226] Updated weights for policy 0, policy_version 1574795 (0.0008) [2023-12-28 06:34:40,328][106226] Updated weights for policy 0, policy_version 1574805 (0.0009) [2023-12-28 06:34:40,370][106225] Updated weights for policy 1, policy_version 1578336 (0.0010) [2023-12-28 06:34:40,435][106225] Updated weights for policy 1, policy_version 1578346 (0.0010) [2023-12-28 06:34:40,495][106225] Updated weights for policy 1, policy_version 1578356 (0.0010) [2023-12-28 06:34:41,080][106226] Updated weights for policy 0, policy_version 1574815 (0.0009) [2023-12-28 06:34:41,161][106226] Updated weights for policy 0, policy_version 1574825 (0.0007) [2023-12-28 06:34:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 807337984. Throughput: 0: 10023.1, 1: 9951.9. Samples: 807315568. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:41,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.569')] [2023-12-28 06:34:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001578360_404111360.pth... [2023-12-28 06:34:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001577208_403816448.pth [2023-12-28 06:34:41,234][106226] Updated weights for policy 0, policy_version 1574835 (0.0006) [2023-12-28 06:34:41,268][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001574840_403234816.pth... [2023-12-28 06:34:41,272][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001573656_402931712.pth [2023-12-28 06:34:41,296][106225] Updated weights for policy 1, policy_version 1578366 (0.0008) [2023-12-28 06:34:41,357][106225] Updated weights for policy 1, policy_version 1578376 (0.0008) [2023-12-28 06:34:41,424][106225] Updated weights for policy 1, policy_version 1578386 (0.0009) [2023-12-28 06:34:41,972][106226] Updated weights for policy 0, policy_version 1574845 (0.0008) [2023-12-28 06:34:42,036][106226] Updated weights for policy 0, policy_version 1574855 (0.0007) [2023-12-28 06:34:42,111][106226] Updated weights for policy 0, policy_version 1574865 (0.0005) [2023-12-28 06:34:42,176][106225] Updated weights for policy 1, policy_version 1578396 (0.0007) [2023-12-28 06:34:42,236][106225] Updated weights for policy 1, policy_version 1578406 (0.0006) [2023-12-28 06:34:42,301][106225] Updated weights for policy 1, policy_version 1578416 (0.0007) [2023-12-28 06:34:42,788][106226] Updated weights for policy 0, policy_version 1574875 (0.0008) [2023-12-28 06:34:42,852][106226] Updated weights for policy 0, policy_version 1574885 (0.0006) [2023-12-28 06:34:42,912][106226] Updated weights for policy 0, policy_version 1574895 (0.0006) [2023-12-28 06:34:43,040][106225] Updated weights for policy 1, policy_version 1578426 (0.0008) [2023-12-28 06:34:43,109][106225] Updated weights for policy 1, policy_version 1578436 (0.0010) [2023-12-28 06:34:43,174][106225] Updated weights for policy 1, policy_version 1578446 (0.0008) [2023-12-28 06:34:43,243][106225] Updated weights for policy 1, policy_version 1578456 (0.0008) [2023-12-28 06:34:43,464][106226] Updated weights for policy 0, policy_version 1574905 (0.0006) [2023-12-28 06:34:43,530][106226] Updated weights for policy 0, policy_version 1574915 (0.0008) [2023-12-28 06:34:43,586][106226] Updated weights for policy 0, policy_version 1574925 (0.0011) [2023-12-28 06:34:43,646][106226] Updated weights for policy 0, policy_version 1574935 (0.0011) [2023-12-28 06:34:43,969][106225] Updated weights for policy 1, policy_version 1578466 (0.0008) [2023-12-28 06:34:44,032][106225] Updated weights for policy 1, policy_version 1578476 (0.0008) [2023-12-28 06:34:44,095][106225] Updated weights for policy 1, policy_version 1578486 (0.0009) [2023-12-28 06:34:44,227][106226] Updated weights for policy 0, policy_version 1574945 (0.0006) [2023-12-28 06:34:44,292][106226] Updated weights for policy 0, policy_version 1574955 (0.0005) [2023-12-28 06:34:44,352][106226] Updated weights for policy 0, policy_version 1574965 (0.0005) [2023-12-28 06:34:44,816][106225] Updated weights for policy 1, policy_version 1578496 (0.0007) [2023-12-28 06:34:44,883][106225] Updated weights for policy 1, policy_version 1578506 (0.0008) [2023-12-28 06:34:44,915][106226] Updated weights for policy 0, policy_version 1574975 (0.0007) [2023-12-28 06:34:44,946][106225] Updated weights for policy 1, policy_version 1578516 (0.0007) [2023-12-28 06:34:44,978][106226] Updated weights for policy 0, policy_version 1574985 (0.0007) [2023-12-28 06:34:45,052][106226] Updated weights for policy 0, policy_version 1574995 (0.0009) [2023-12-28 06:34:45,560][106225] Updated weights for policy 1, policy_version 1578526 (0.0009) [2023-12-28 06:34:45,612][106225] Updated weights for policy 1, policy_version 1578536 (0.0010) [2023-12-28 06:34:45,668][106225] Updated weights for policy 1, policy_version 1578546 (0.0008) [2023-12-28 06:34:45,842][106226] Updated weights for policy 0, policy_version 1575005 (0.0009) [2023-12-28 06:34:45,891][106226] Updated weights for policy 0, policy_version 1575015 (0.0007) [2023-12-28 06:34:45,942][106226] Updated weights for policy 0, policy_version 1575025 (0.0005) [2023-12-28 06:34:46,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 807444480. Throughput: 0: 10071.2, 1: 9847.0. Samples: 807432956. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:46,176][105115] Avg episode reward: [(0, '-5.062'), (1, '-4.872')] [2023-12-28 06:34:46,350][106225] Updated weights for policy 1, policy_version 1578556 (0.0009) [2023-12-28 06:34:46,396][106225] Updated weights for policy 1, policy_version 1578566 (0.0010) [2023-12-28 06:34:46,451][106225] Updated weights for policy 1, policy_version 1578576 (0.0008) [2023-12-28 06:34:46,611][106226] Updated weights for policy 0, policy_version 1575035 (0.0006) [2023-12-28 06:34:46,667][106226] Updated weights for policy 0, policy_version 1575045 (0.0008) [2023-12-28 06:34:46,721][106226] Updated weights for policy 0, policy_version 1575055 (0.0008) [2023-12-28 06:34:47,154][106225] Updated weights for policy 1, policy_version 1578586 (0.0006) [2023-12-28 06:34:47,210][106225] Updated weights for policy 1, policy_version 1578596 (0.0010) [2023-12-28 06:34:47,269][106225] Updated weights for policy 1, policy_version 1578606 (0.0010) [2023-12-28 06:34:47,330][106225] Updated weights for policy 1, policy_version 1578616 (0.0010) [2023-12-28 06:34:47,380][106226] Updated weights for policy 0, policy_version 1575065 (0.0008) [2023-12-28 06:34:47,431][106226] Updated weights for policy 0, policy_version 1575075 (0.0009) [2023-12-28 06:34:47,488][106226] Updated weights for policy 0, policy_version 1575085 (0.0008) [2023-12-28 06:34:47,544][106226] Updated weights for policy 0, policy_version 1575095 (0.0008) [2023-12-28 06:34:48,020][106225] Updated weights for policy 1, policy_version 1578626 (0.0010) [2023-12-28 06:34:48,076][106225] Updated weights for policy 1, policy_version 1578636 (0.0010) [2023-12-28 06:34:48,127][106225] Updated weights for policy 1, policy_version 1578646 (0.0009) [2023-12-28 06:34:48,305][106226] Updated weights for policy 0, policy_version 1575105 (0.0008) [2023-12-28 06:34:48,374][106226] Updated weights for policy 0, policy_version 1575115 (0.0007) [2023-12-28 06:34:48,439][106226] Updated weights for policy 0, policy_version 1575125 (0.0007) [2023-12-28 06:34:48,819][106225] Updated weights for policy 1, policy_version 1578656 (0.0010) [2023-12-28 06:34:48,885][106225] Updated weights for policy 1, policy_version 1578666 (0.0011) [2023-12-28 06:34:48,950][106225] Updated weights for policy 1, policy_version 1578676 (0.0011) [2023-12-28 06:34:49,173][106226] Updated weights for policy 0, policy_version 1575135 (0.0006) [2023-12-28 06:34:49,235][106226] Updated weights for policy 0, policy_version 1575145 (0.0006) [2023-12-28 06:34:49,309][106226] Updated weights for policy 0, policy_version 1575155 (0.0008) [2023-12-28 06:34:49,682][106225] Updated weights for policy 1, policy_version 1578686 (0.0011) [2023-12-28 06:34:49,747][106225] Updated weights for policy 1, policy_version 1578696 (0.0010) [2023-12-28 06:34:49,818][106225] Updated weights for policy 1, policy_version 1578706 (0.0006) [2023-12-28 06:34:49,940][106226] Updated weights for policy 0, policy_version 1575165 (0.0008) [2023-12-28 06:34:50,005][106226] Updated weights for policy 0, policy_version 1575175 (0.0009) [2023-12-28 06:34:50,073][106226] Updated weights for policy 0, policy_version 1575185 (0.0009) [2023-12-28 06:34:50,429][106225] Updated weights for policy 1, policy_version 1578716 (0.0008) [2023-12-28 06:34:50,492][106225] Updated weights for policy 1, policy_version 1578726 (0.0009) [2023-12-28 06:34:50,548][106225] Updated weights for policy 1, policy_version 1578736 (0.0009) [2023-12-28 06:34:50,825][106226] Updated weights for policy 0, policy_version 1575195 (0.0008) [2023-12-28 06:34:50,873][106226] Updated weights for policy 0, policy_version 1575205 (0.0008) [2023-12-28 06:34:50,933][106226] Updated weights for policy 0, policy_version 1575215 (0.0009) [2023-12-28 06:34:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 807542784. Throughput: 0: 9962.1, 1: 9870.9. Samples: 807551188. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:51,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.712')] [2023-12-28 06:34:51,231][106225] Updated weights for policy 1, policy_version 1578746 (0.0008) [2023-12-28 06:34:51,292][106225] Updated weights for policy 1, policy_version 1578756 (0.0008) [2023-12-28 06:34:51,356][106225] Updated weights for policy 1, policy_version 1578766 (0.0009) [2023-12-28 06:34:51,421][106225] Updated weights for policy 1, policy_version 1578776 (0.0009) [2023-12-28 06:34:51,673][106226] Updated weights for policy 0, policy_version 1575225 (0.0008) [2023-12-28 06:34:51,742][106226] Updated weights for policy 0, policy_version 1575235 (0.0007) [2023-12-28 06:34:51,802][106226] Updated weights for policy 0, policy_version 1575245 (0.0008) [2023-12-28 06:34:51,864][106226] Updated weights for policy 0, policy_version 1575255 (0.0008) [2023-12-28 06:34:52,209][106225] Updated weights for policy 1, policy_version 1578786 (0.0009) [2023-12-28 06:34:52,271][106225] Updated weights for policy 1, policy_version 1578796 (0.0008) [2023-12-28 06:34:52,330][106225] Updated weights for policy 1, policy_version 1578806 (0.0008) [2023-12-28 06:34:52,545][106226] Updated weights for policy 0, policy_version 1575265 (0.0007) [2023-12-28 06:34:52,593][106226] Updated weights for policy 0, policy_version 1575275 (0.0007) [2023-12-28 06:34:52,640][106226] Updated weights for policy 0, policy_version 1575285 (0.0007) [2023-12-28 06:34:53,136][106225] Updated weights for policy 1, policy_version 1578816 (0.0008) [2023-12-28 06:34:53,195][106225] Updated weights for policy 1, policy_version 1578826 (0.0008) [2023-12-28 06:34:53,253][106225] Updated weights for policy 1, policy_version 1578836 (0.0008) [2023-12-28 06:34:53,347][106226] Updated weights for policy 0, policy_version 1575295 (0.0007) [2023-12-28 06:34:53,396][106226] Updated weights for policy 0, policy_version 1575305 (0.0008) [2023-12-28 06:34:53,445][106226] Updated weights for policy 0, policy_version 1575315 (0.0008) [2023-12-28 06:34:54,004][106225] Updated weights for policy 1, policy_version 1578846 (0.0008) [2023-12-28 06:34:54,069][106225] Updated weights for policy 1, policy_version 1578856 (0.0006) [2023-12-28 06:34:54,128][106225] Updated weights for policy 1, policy_version 1578866 (0.0008) [2023-12-28 06:34:54,183][106226] Updated weights for policy 0, policy_version 1575325 (0.0008) [2023-12-28 06:34:54,245][106226] Updated weights for policy 0, policy_version 1575335 (0.0007) [2023-12-28 06:34:54,308][106226] Updated weights for policy 0, policy_version 1575345 (0.0008) [2023-12-28 06:34:54,797][106225] Updated weights for policy 1, policy_version 1578876 (0.0008) [2023-12-28 06:34:54,850][106225] Updated weights for policy 1, policy_version 1578886 (0.0010) [2023-12-28 06:34:54,904][106225] Updated weights for policy 1, policy_version 1578896 (0.0010) [2023-12-28 06:34:55,069][106226] Updated weights for policy 0, policy_version 1575355 (0.0009) [2023-12-28 06:34:55,123][106226] Updated weights for policy 0, policy_version 1575365 (0.0009) [2023-12-28 06:34:55,173][106226] Updated weights for policy 0, policy_version 1575375 (0.0007) [2023-12-28 06:34:55,580][106225] Updated weights for policy 1, policy_version 1578906 (0.0010) [2023-12-28 06:34:55,637][106225] Updated weights for policy 1, policy_version 1578916 (0.0009) [2023-12-28 06:34:55,697][106225] Updated weights for policy 1, policy_version 1578926 (0.0008) [2023-12-28 06:34:55,758][106225] Updated weights for policy 1, policy_version 1578936 (0.0009) [2023-12-28 06:34:55,878][106226] Updated weights for policy 0, policy_version 1575385 (0.0007) [2023-12-28 06:34:55,932][106226] Updated weights for policy 0, policy_version 1575395 (0.0009) [2023-12-28 06:34:55,983][106226] Updated weights for policy 0, policy_version 1575405 (0.0008) [2023-12-28 06:34:56,041][106226] Updated weights for policy 0, policy_version 1575415 (0.0008) [2023-12-28 06:34:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 807641088. Throughput: 0: 9962.9, 1: 9783.9. Samples: 807608596. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:34:56,175][105115] Avg episode reward: [(0, '-4.748'), (1, '-4.474')] [2023-12-28 06:34:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001578936_404258816.pth... [2023-12-28 06:34:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001575416_403382272.pth... [2023-12-28 06:34:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001577784_403963904.pth [2023-12-28 06:34:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001574232_403079168.pth [2023-12-28 06:34:56,403][106225] Updated weights for policy 1, policy_version 1578946 (0.0009) [2023-12-28 06:34:56,459][106225] Updated weights for policy 1, policy_version 1578956 (0.0008) [2023-12-28 06:34:56,515][106225] Updated weights for policy 1, policy_version 1578966 (0.0008) [2023-12-28 06:34:56,843][106226] Updated weights for policy 0, policy_version 1575425 (0.0009) [2023-12-28 06:34:56,893][106226] Updated weights for policy 0, policy_version 1575435 (0.0009) [2023-12-28 06:34:56,946][106226] Updated weights for policy 0, policy_version 1575445 (0.0008) [2023-12-28 06:34:57,105][106225] Updated weights for policy 1, policy_version 1578976 (0.0009) [2023-12-28 06:34:57,164][106225] Updated weights for policy 1, policy_version 1578986 (0.0008) [2023-12-28 06:34:57,222][106225] Updated weights for policy 1, policy_version 1578996 (0.0008) [2023-12-28 06:34:57,653][106226] Updated weights for policy 0, policy_version 1575455 (0.0008) [2023-12-28 06:34:57,716][106226] Updated weights for policy 0, policy_version 1575465 (0.0008) [2023-12-28 06:34:57,776][106226] Updated weights for policy 0, policy_version 1575475 (0.0008) [2023-12-28 06:34:57,957][106225] Updated weights for policy 1, policy_version 1579006 (0.0009) [2023-12-28 06:34:58,004][106225] Updated weights for policy 1, policy_version 1579016 (0.0008) [2023-12-28 06:34:58,059][106225] Updated weights for policy 1, policy_version 1579026 (0.0008) [2023-12-28 06:34:58,517][106226] Updated weights for policy 0, policy_version 1575485 (0.0009) [2023-12-28 06:34:58,582][106226] Updated weights for policy 0, policy_version 1575495 (0.0009) [2023-12-28 06:34:58,647][106226] Updated weights for policy 0, policy_version 1575505 (0.0008) [2023-12-28 06:34:58,864][106225] Updated weights for policy 1, policy_version 1579036 (0.0008) [2023-12-28 06:34:58,932][106225] Updated weights for policy 1, policy_version 1579046 (0.0008) [2023-12-28 06:34:58,996][106225] Updated weights for policy 1, policy_version 1579056 (0.0009) [2023-12-28 06:34:59,359][106226] Updated weights for policy 0, policy_version 1575515 (0.0009) [2023-12-28 06:34:59,419][106226] Updated weights for policy 0, policy_version 1575525 (0.0007) [2023-12-28 06:34:59,474][106226] Updated weights for policy 0, policy_version 1575535 (0.0005) [2023-12-28 06:34:59,831][106225] Updated weights for policy 1, policy_version 1579066 (0.0009) [2023-12-28 06:34:59,898][106225] Updated weights for policy 1, policy_version 1579076 (0.0009) [2023-12-28 06:34:59,970][106225] Updated weights for policy 1, policy_version 1579086 (0.0008) [2023-12-28 06:35:00,033][106225] Updated weights for policy 1, policy_version 1579096 (0.0008) [2023-12-28 06:35:00,124][106226] Updated weights for policy 0, policy_version 1575545 (0.0007) [2023-12-28 06:35:00,182][106226] Updated weights for policy 0, policy_version 1575555 (0.0009) [2023-12-28 06:35:00,244][106226] Updated weights for policy 0, policy_version 1575565 (0.0008) [2023-12-28 06:35:00,309][106226] Updated weights for policy 0, policy_version 1575575 (0.0008) [2023-12-28 06:35:00,743][106225] Updated weights for policy 1, policy_version 1579106 (0.0008) [2023-12-28 06:35:00,802][106225] Updated weights for policy 1, policy_version 1579116 (0.0008) [2023-12-28 06:35:00,850][106225] Updated weights for policy 1, policy_version 1579126 (0.0008) [2023-12-28 06:35:01,001][106226] Updated weights for policy 0, policy_version 1575585 (0.0008) [2023-12-28 06:35:01,057][106226] Updated weights for policy 0, policy_version 1575595 (0.0007) [2023-12-28 06:35:01,119][106226] Updated weights for policy 0, policy_version 1575605 (0.0009) [2023-12-28 06:35:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 807739392. Throughput: 0: 9988.5, 1: 9812.3. Samples: 807725664. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:01,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.587')] [2023-12-28 06:35:01,651][106225] Updated weights for policy 1, policy_version 1579136 (0.0009) [2023-12-28 06:35:01,713][106225] Updated weights for policy 1, policy_version 1579146 (0.0006) [2023-12-28 06:35:01,776][106225] Updated weights for policy 1, policy_version 1579156 (0.0008) [2023-12-28 06:35:01,823][106226] Updated weights for policy 0, policy_version 1575615 (0.0008) [2023-12-28 06:35:01,876][106226] Updated weights for policy 0, policy_version 1575625 (0.0008) [2023-12-28 06:35:01,923][106226] Updated weights for policy 0, policy_version 1575635 (0.0008) [2023-12-28 06:35:02,509][106225] Updated weights for policy 1, policy_version 1579166 (0.0007) [2023-12-28 06:35:02,566][106225] Updated weights for policy 1, policy_version 1579176 (0.0008) [2023-12-28 06:35:02,626][106225] Updated weights for policy 1, policy_version 1579186 (0.0008) [2023-12-28 06:35:02,687][106226] Updated weights for policy 0, policy_version 1575645 (0.0009) [2023-12-28 06:35:02,737][106226] Updated weights for policy 0, policy_version 1575655 (0.0008) [2023-12-28 06:35:02,795][106226] Updated weights for policy 0, policy_version 1575665 (0.0009) [2023-12-28 06:35:03,350][106225] Updated weights for policy 1, policy_version 1579196 (0.0009) [2023-12-28 06:35:03,402][106225] Updated weights for policy 1, policy_version 1579206 (0.0008) [2023-12-28 06:35:03,453][106225] Updated weights for policy 1, policy_version 1579216 (0.0008) [2023-12-28 06:35:03,514][106226] Updated weights for policy 0, policy_version 1575675 (0.0008) [2023-12-28 06:35:03,568][106226] Updated weights for policy 0, policy_version 1575685 (0.0008) [2023-12-28 06:35:03,611][106226] Updated weights for policy 0, policy_version 1575695 (0.0008) [2023-12-28 06:35:04,217][106225] Updated weights for policy 1, policy_version 1579226 (0.0008) [2023-12-28 06:35:04,281][106225] Updated weights for policy 1, policy_version 1579236 (0.0008) [2023-12-28 06:35:04,345][106225] Updated weights for policy 1, policy_version 1579246 (0.0008) [2023-12-28 06:35:04,358][106226] Updated weights for policy 0, policy_version 1575705 (0.0009) [2023-12-28 06:35:04,410][106225] Updated weights for policy 1, policy_version 1579256 (0.0006) [2023-12-28 06:35:04,416][106226] Updated weights for policy 0, policy_version 1575715 (0.0011) [2023-12-28 06:35:04,480][106226] Updated weights for policy 0, policy_version 1575725 (0.0011) [2023-12-28 06:35:04,529][106226] Updated weights for policy 0, policy_version 1575735 (0.0011) [2023-12-28 06:35:05,134][106225] Updated weights for policy 1, policy_version 1579266 (0.0008) [2023-12-28 06:35:05,192][106225] Updated weights for policy 1, policy_version 1579276 (0.0008) [2023-12-28 06:35:05,232][106226] Updated weights for policy 0, policy_version 1575745 (0.0010) [2023-12-28 06:35:05,258][106225] Updated weights for policy 1, policy_version 1579286 (0.0009) [2023-12-28 06:35:05,278][106226] Updated weights for policy 0, policy_version 1575755 (0.0010) [2023-12-28 06:35:05,325][106226] Updated weights for policy 0, policy_version 1575765 (0.0010) [2023-12-28 06:35:05,956][106225] Updated weights for policy 1, policy_version 1579296 (0.0010) [2023-12-28 06:35:05,999][106225] Updated weights for policy 1, policy_version 1579306 (0.0010) [2023-12-28 06:35:06,007][106226] Updated weights for policy 0, policy_version 1575775 (0.0010) [2023-12-28 06:35:06,056][106225] Updated weights for policy 1, policy_version 1579316 (0.0010) [2023-12-28 06:35:06,065][106226] Updated weights for policy 0, policy_version 1575785 (0.0010) [2023-12-28 06:35:06,129][106226] Updated weights for policy 0, policy_version 1575795 (0.0010) [2023-12-28 06:35:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 807837696. Throughput: 0: 9963.2, 1: 9749.8. Samples: 807840448. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:06,175][105115] Avg episode reward: [(0, '-4.689'), (1, '-4.582')] [2023-12-28 06:35:06,754][106226] Updated weights for policy 0, policy_version 1575805 (0.0006) [2023-12-28 06:35:06,797][106225] Updated weights for policy 1, policy_version 1579326 (0.0009) [2023-12-28 06:35:06,816][106226] Updated weights for policy 0, policy_version 1575815 (0.0005) [2023-12-28 06:35:06,865][106225] Updated weights for policy 1, policy_version 1579336 (0.0009) [2023-12-28 06:35:06,886][106226] Updated weights for policy 0, policy_version 1575825 (0.0006) [2023-12-28 06:35:06,920][106225] Updated weights for policy 1, policy_version 1579346 (0.0007) [2023-12-28 06:35:07,468][106226] Updated weights for policy 0, policy_version 1575835 (0.0005) [2023-12-28 06:35:07,524][106226] Updated weights for policy 0, policy_version 1575845 (0.0005) [2023-12-28 06:35:07,541][106225] Updated weights for policy 1, policy_version 1579356 (0.0007) [2023-12-28 06:35:07,588][106226] Updated weights for policy 0, policy_version 1575855 (0.0006) [2023-12-28 06:35:07,593][106225] Updated weights for policy 1, policy_version 1579366 (0.0005) [2023-12-28 06:35:07,651][106225] Updated weights for policy 1, policy_version 1579376 (0.0006) [2023-12-28 06:35:08,185][106226] Updated weights for policy 0, policy_version 1575865 (0.0007) [2023-12-28 06:35:08,219][106225] Updated weights for policy 1, policy_version 1579386 (0.0010) [2023-12-28 06:35:08,238][106226] Updated weights for policy 0, policy_version 1575875 (0.0007) [2023-12-28 06:35:08,266][106225] Updated weights for policy 1, policy_version 1579396 (0.0010) [2023-12-28 06:35:08,297][106226] Updated weights for policy 0, policy_version 1575885 (0.0007) [2023-12-28 06:35:08,317][106225] Updated weights for policy 1, policy_version 1579406 (0.0010) [2023-12-28 06:35:08,366][106226] Updated weights for policy 0, policy_version 1575895 (0.0007) [2023-12-28 06:35:08,385][106225] Updated weights for policy 1, policy_version 1579416 (0.0010) [2023-12-28 06:35:09,096][106225] Updated weights for policy 1, policy_version 1579426 (0.0009) [2023-12-28 06:35:09,116][106226] Updated weights for policy 0, policy_version 1575905 (0.0006) [2023-12-28 06:35:09,145][106225] Updated weights for policy 1, policy_version 1579436 (0.0008) [2023-12-28 06:35:09,178][106226] Updated weights for policy 0, policy_version 1575915 (0.0006) [2023-12-28 06:35:09,195][106225] Updated weights for policy 1, policy_version 1579446 (0.0008) [2023-12-28 06:35:09,246][106226] Updated weights for policy 0, policy_version 1575925 (0.0007) [2023-12-28 06:35:09,947][106225] Updated weights for policy 1, policy_version 1579456 (0.0008) [2023-12-28 06:35:09,954][106226] Updated weights for policy 0, policy_version 1575935 (0.0010) [2023-12-28 06:35:10,015][106225] Updated weights for policy 1, policy_version 1579466 (0.0007) [2023-12-28 06:35:10,017][106226] Updated weights for policy 0, policy_version 1575945 (0.0009) [2023-12-28 06:35:10,083][106225] Updated weights for policy 1, policy_version 1579476 (0.0008) [2023-12-28 06:35:10,085][106226] Updated weights for policy 0, policy_version 1575955 (0.0006) [2023-12-28 06:35:10,795][106225] Updated weights for policy 1, policy_version 1579486 (0.0008) [2023-12-28 06:35:10,834][106226] Updated weights for policy 0, policy_version 1575965 (0.0007) [2023-12-28 06:35:10,849][106225] Updated weights for policy 1, policy_version 1579496 (0.0005) [2023-12-28 06:35:10,898][106226] Updated weights for policy 0, policy_version 1575975 (0.0006) [2023-12-28 06:35:10,902][106225] Updated weights for policy 1, policy_version 1579506 (0.0006) [2023-12-28 06:35:10,963][106226] Updated weights for policy 0, policy_version 1575985 (0.0005) [2023-12-28 06:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 807936000. Throughput: 0: 10047.5, 1: 9833.0. Samples: 807903644. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:11,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-4.750')] [2023-12-28 06:35:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001579512_404406272.pth... [2023-12-28 06:35:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001575992_403529728.pth... [2023-12-28 06:35:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001574840_403234816.pth [2023-12-28 06:35:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001578360_404111360.pth [2023-12-28 06:35:11,629][106225] Updated weights for policy 1, policy_version 1579516 (0.0007) [2023-12-28 06:35:11,694][106225] Updated weights for policy 1, policy_version 1579526 (0.0008) [2023-12-28 06:35:11,700][106226] Updated weights for policy 0, policy_version 1575995 (0.0008) [2023-12-28 06:35:11,765][106225] Updated weights for policy 1, policy_version 1579536 (0.0009) [2023-12-28 06:35:11,771][106226] Updated weights for policy 0, policy_version 1576005 (0.0008) [2023-12-28 06:35:11,834][106226] Updated weights for policy 0, policy_version 1576015 (0.0008) [2023-12-28 06:35:12,470][106225] Updated weights for policy 1, policy_version 1579546 (0.0007) [2023-12-28 06:35:12,535][106225] Updated weights for policy 1, policy_version 1579556 (0.0010) [2023-12-28 06:35:12,595][106226] Updated weights for policy 0, policy_version 1576025 (0.0009) [2023-12-28 06:35:12,597][106225] Updated weights for policy 1, policy_version 1579566 (0.0010) [2023-12-28 06:35:12,655][106226] Updated weights for policy 0, policy_version 1576035 (0.0007) [2023-12-28 06:35:12,660][106225] Updated weights for policy 1, policy_version 1579576 (0.0008) [2023-12-28 06:35:12,714][106226] Updated weights for policy 0, policy_version 1576045 (0.0008) [2023-12-28 06:35:12,773][106226] Updated weights for policy 0, policy_version 1576055 (0.0008) [2023-12-28 06:35:13,313][106225] Updated weights for policy 1, policy_version 1579586 (0.0010) [2023-12-28 06:35:13,363][106225] Updated weights for policy 1, policy_version 1579596 (0.0010) [2023-12-28 06:35:13,419][106225] Updated weights for policy 1, policy_version 1579606 (0.0010) [2023-12-28 06:35:13,453][106226] Updated weights for policy 0, policy_version 1576065 (0.0007) [2023-12-28 06:35:13,503][106226] Updated weights for policy 0, policy_version 1576075 (0.0008) [2023-12-28 06:35:13,550][106226] Updated weights for policy 0, policy_version 1576085 (0.0007) [2023-12-28 06:35:14,149][106225] Updated weights for policy 1, policy_version 1579616 (0.0010) [2023-12-28 06:35:14,211][106225] Updated weights for policy 1, policy_version 1579626 (0.0010) [2023-12-28 06:35:14,268][106225] Updated weights for policy 1, policy_version 1579636 (0.0005) [2023-12-28 06:35:14,301][106226] Updated weights for policy 0, policy_version 1576095 (0.0008) [2023-12-28 06:35:14,349][106226] Updated weights for policy 0, policy_version 1576105 (0.0005) [2023-12-28 06:35:14,412][106226] Updated weights for policy 0, policy_version 1576115 (0.0006) [2023-12-28 06:35:14,918][106225] Updated weights for policy 1, policy_version 1579646 (0.0007) [2023-12-28 06:35:14,982][106225] Updated weights for policy 1, policy_version 1579656 (0.0008) [2023-12-28 06:35:15,048][106225] Updated weights for policy 1, policy_version 1579666 (0.0008) [2023-12-28 06:35:15,095][106226] Updated weights for policy 0, policy_version 1576125 (0.0008) [2023-12-28 06:35:15,158][106226] Updated weights for policy 0, policy_version 1576135 (0.0011) [2023-12-28 06:35:15,221][106226] Updated weights for policy 0, policy_version 1576145 (0.0011) [2023-12-28 06:35:15,833][106225] Updated weights for policy 1, policy_version 1579676 (0.0007) [2023-12-28 06:35:15,849][106226] Updated weights for policy 0, policy_version 1576155 (0.0009) [2023-12-28 06:35:15,898][106225] Updated weights for policy 1, policy_version 1579686 (0.0006) [2023-12-28 06:35:15,907][106226] Updated weights for policy 0, policy_version 1576165 (0.0007) [2023-12-28 06:35:15,966][106226] Updated weights for policy 0, policy_version 1576175 (0.0008) [2023-12-28 06:35:15,967][106225] Updated weights for policy 1, policy_version 1579696 (0.0006) [2023-12-28 06:35:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 808034304. Throughput: 0: 9875.1, 1: 9711.6. Samples: 808020316. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:16,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.660')] [2023-12-28 06:35:16,553][106226] Updated weights for policy 0, policy_version 1576185 (0.0006) [2023-12-28 06:35:16,610][106226] Updated weights for policy 0, policy_version 1576195 (0.0005) [2023-12-28 06:35:16,677][106226] Updated weights for policy 0, policy_version 1576205 (0.0007) [2023-12-28 06:35:16,679][106225] Updated weights for policy 1, policy_version 1579706 (0.0007) [2023-12-28 06:35:16,734][106226] Updated weights for policy 0, policy_version 1576215 (0.0005) [2023-12-28 06:35:16,739][106225] Updated weights for policy 1, policy_version 1579716 (0.0008) [2023-12-28 06:35:16,793][106225] Updated weights for policy 1, policy_version 1579726 (0.0009) [2023-12-28 06:35:16,853][106225] Updated weights for policy 1, policy_version 1579736 (0.0006) [2023-12-28 06:35:17,340][106226] Updated weights for policy 0, policy_version 1576225 (0.0006) [2023-12-28 06:35:17,394][106226] Updated weights for policy 0, policy_version 1576235 (0.0005) [2023-12-28 06:35:17,443][106226] Updated weights for policy 0, policy_version 1576245 (0.0005) [2023-12-28 06:35:17,475][106225] Updated weights for policy 1, policy_version 1579746 (0.0007) [2023-12-28 06:35:17,537][106225] Updated weights for policy 1, policy_version 1579756 (0.0009) [2023-12-28 06:35:17,607][106225] Updated weights for policy 1, policy_version 1579766 (0.0008) [2023-12-28 06:35:17,988][106226] Updated weights for policy 0, policy_version 1576255 (0.0008) [2023-12-28 06:35:18,046][106226] Updated weights for policy 0, policy_version 1576265 (0.0010) [2023-12-28 06:35:18,099][106226] Updated weights for policy 0, policy_version 1576275 (0.0010) [2023-12-28 06:35:18,199][106225] Updated weights for policy 1, policy_version 1579776 (0.0006) [2023-12-28 06:35:18,259][106225] Updated weights for policy 1, policy_version 1579786 (0.0008) [2023-12-28 06:35:18,316][106225] Updated weights for policy 1, policy_version 1579796 (0.0008) [2023-12-28 06:35:18,765][106226] Updated weights for policy 0, policy_version 1576285 (0.0008) [2023-12-28 06:35:18,827][106226] Updated weights for policy 0, policy_version 1576295 (0.0009) [2023-12-28 06:35:18,892][106226] Updated weights for policy 0, policy_version 1576305 (0.0006) [2023-12-28 06:35:18,970][106225] Updated weights for policy 1, policy_version 1579806 (0.0006) [2023-12-28 06:35:19,026][106225] Updated weights for policy 1, policy_version 1579816 (0.0005) [2023-12-28 06:35:19,078][106225] Updated weights for policy 1, policy_version 1579826 (0.0009) [2023-12-28 06:35:19,567][106226] Updated weights for policy 0, policy_version 1576315 (0.0009) [2023-12-28 06:35:19,624][106226] Updated weights for policy 0, policy_version 1576325 (0.0008) [2023-12-28 06:35:19,684][106226] Updated weights for policy 0, policy_version 1576335 (0.0008) [2023-12-28 06:35:19,711][106225] Updated weights for policy 1, policy_version 1579836 (0.0010) [2023-12-28 06:35:19,772][106225] Updated weights for policy 1, policy_version 1579846 (0.0010) [2023-12-28 06:35:19,837][106225] Updated weights for policy 1, policy_version 1579856 (0.0010) [2023-12-28 06:35:20,476][106226] Updated weights for policy 0, policy_version 1576345 (0.0006) [2023-12-28 06:35:20,536][106226] Updated weights for policy 0, policy_version 1576355 (0.0008) [2023-12-28 06:35:20,617][106226] Updated weights for policy 0, policy_version 1576365 (0.0008) [2023-12-28 06:35:20,618][106225] Updated weights for policy 1, policy_version 1579866 (0.0008) [2023-12-28 06:35:20,676][106226] Updated weights for policy 0, policy_version 1576375 (0.0007) [2023-12-28 06:35:20,681][106225] Updated weights for policy 1, policy_version 1579876 (0.0010) [2023-12-28 06:35:20,735][106225] Updated weights for policy 1, policy_version 1579886 (0.0010) [2023-12-28 06:35:20,798][106225] Updated weights for policy 1, policy_version 1579896 (0.0008) [2023-12-28 06:35:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 808132608. Throughput: 0: 9930.6, 1: 9744.4. Samples: 808142448. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:21,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.518')] [2023-12-28 06:35:21,484][106226] Updated weights for policy 0, policy_version 1576385 (0.0008) [2023-12-28 06:35:21,533][106225] Updated weights for policy 1, policy_version 1579906 (0.0007) [2023-12-28 06:35:21,543][106226] Updated weights for policy 0, policy_version 1576395 (0.0008) [2023-12-28 06:35:21,589][106225] Updated weights for policy 1, policy_version 1579916 (0.0007) [2023-12-28 06:35:21,599][106226] Updated weights for policy 0, policy_version 1576405 (0.0008) [2023-12-28 06:35:21,655][106225] Updated weights for policy 1, policy_version 1579926 (0.0009) [2023-12-28 06:35:22,331][106225] Updated weights for policy 1, policy_version 1579936 (0.0009) [2023-12-28 06:35:22,399][106225] Updated weights for policy 1, policy_version 1579946 (0.0007) [2023-12-28 06:35:22,417][106226] Updated weights for policy 0, policy_version 1576415 (0.0007) [2023-12-28 06:35:22,462][106225] Updated weights for policy 1, policy_version 1579956 (0.0008) [2023-12-28 06:35:22,482][106226] Updated weights for policy 0, policy_version 1576425 (0.0007) [2023-12-28 06:35:22,546][106226] Updated weights for policy 0, policy_version 1576435 (0.0009) [2023-12-28 06:35:23,070][106225] Updated weights for policy 1, policy_version 1579966 (0.0005) [2023-12-28 06:35:23,120][106225] Updated weights for policy 1, policy_version 1579976 (0.0005) [2023-12-28 06:35:23,173][106225] Updated weights for policy 1, policy_version 1579986 (0.0006) [2023-12-28 06:35:23,354][106226] Updated weights for policy 0, policy_version 1576445 (0.0010) [2023-12-28 06:35:23,402][106226] Updated weights for policy 0, policy_version 1576455 (0.0010) [2023-12-28 06:35:23,470][106226] Updated weights for policy 0, policy_version 1576465 (0.0006) [2023-12-28 06:35:23,767][106225] Updated weights for policy 1, policy_version 1579996 (0.0008) [2023-12-28 06:35:23,825][106225] Updated weights for policy 1, policy_version 1580006 (0.0008) [2023-12-28 06:35:23,881][106225] Updated weights for policy 1, policy_version 1580016 (0.0008) [2023-12-28 06:35:24,145][106226] Updated weights for policy 0, policy_version 1576475 (0.0007) [2023-12-28 06:35:24,208][106226] Updated weights for policy 0, policy_version 1576485 (0.0010) [2023-12-28 06:35:24,269][106226] Updated weights for policy 0, policy_version 1576495 (0.0010) [2023-12-28 06:35:24,623][106225] Updated weights for policy 1, policy_version 1580026 (0.0007) [2023-12-28 06:35:24,687][106225] Updated weights for policy 1, policy_version 1580036 (0.0005) [2023-12-28 06:35:24,756][106225] Updated weights for policy 1, policy_version 1580046 (0.0005) [2023-12-28 06:35:24,812][106225] Updated weights for policy 1, policy_version 1580056 (0.0005) [2023-12-28 06:35:24,848][106226] Updated weights for policy 0, policy_version 1576505 (0.0006) [2023-12-28 06:35:24,904][106226] Updated weights for policy 0, policy_version 1576515 (0.0010) [2023-12-28 06:35:24,962][106226] Updated weights for policy 0, policy_version 1576525 (0.0010) [2023-12-28 06:35:25,019][106226] Updated weights for policy 0, policy_version 1576535 (0.0011) [2023-12-28 06:35:25,417][106225] Updated weights for policy 1, policy_version 1580066 (0.0006) [2023-12-28 06:35:25,484][106225] Updated weights for policy 1, policy_version 1580076 (0.0008) [2023-12-28 06:35:25,547][106225] Updated weights for policy 1, policy_version 1580086 (0.0008) [2023-12-28 06:35:25,741][106226] Updated weights for policy 0, policy_version 1576545 (0.0011) [2023-12-28 06:35:25,814][106226] Updated weights for policy 0, policy_version 1576555 (0.0011) [2023-12-28 06:35:25,879][106226] Updated weights for policy 0, policy_version 1576565 (0.0011) [2023-12-28 06:35:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 808230912. Throughput: 0: 9876.1, 1: 9811.0. Samples: 808201484. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:26,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-4.654')] [2023-12-28 06:35:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001576568_403677184.pth... [2023-12-28 06:35:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001575416_403382272.pth [2023-12-28 06:35:26,195][106225] Updated weights for policy 1, policy_version 1580096 (0.0006) [2023-12-28 06:35:26,259][106225] Updated weights for policy 1, policy_version 1580106 (0.0007) [2023-12-28 06:35:26,319][106225] Updated weights for policy 1, policy_version 1580116 (0.0007) [2023-12-28 06:35:26,343][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001580120_404561920.pth... [2023-12-28 06:35:26,347][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001578936_404258816.pth [2023-12-28 06:35:26,499][106226] Updated weights for policy 0, policy_version 1576575 (0.0010) [2023-12-28 06:35:26,558][106226] Updated weights for policy 0, policy_version 1576585 (0.0009) [2023-12-28 06:35:26,614][106226] Updated weights for policy 0, policy_version 1576595 (0.0005) [2023-12-28 06:35:26,950][106225] Updated weights for policy 1, policy_version 1580126 (0.0007) [2023-12-28 06:35:26,994][106225] Updated weights for policy 1, policy_version 1580136 (0.0007) [2023-12-28 06:35:27,039][106225] Updated weights for policy 1, policy_version 1580146 (0.0007) [2023-12-28 06:35:27,283][106226] Updated weights for policy 0, policy_version 1576605 (0.0008) [2023-12-28 06:35:27,333][106226] Updated weights for policy 0, policy_version 1576615 (0.0011) [2023-12-28 06:35:27,387][106226] Updated weights for policy 0, policy_version 1576625 (0.0010) [2023-12-28 06:35:27,729][106225] Updated weights for policy 1, policy_version 1580156 (0.0007) [2023-12-28 06:35:27,779][106225] Updated weights for policy 1, policy_version 1580166 (0.0005) [2023-12-28 06:35:27,824][106225] Updated weights for policy 1, policy_version 1580176 (0.0006) [2023-12-28 06:35:28,095][106226] Updated weights for policy 0, policy_version 1576635 (0.0010) [2023-12-28 06:35:28,146][106226] Updated weights for policy 0, policy_version 1576645 (0.0009) [2023-12-28 06:35:28,193][106226] Updated weights for policy 0, policy_version 1576655 (0.0006) [2023-12-28 06:35:28,472][106225] Updated weights for policy 1, policy_version 1580186 (0.0008) [2023-12-28 06:35:28,532][106225] Updated weights for policy 1, policy_version 1580196 (0.0008) [2023-12-28 06:35:28,584][106225] Updated weights for policy 1, policy_version 1580206 (0.0009) [2023-12-28 06:35:28,643][106225] Updated weights for policy 1, policy_version 1580216 (0.0009) [2023-12-28 06:35:28,867][106226] Updated weights for policy 0, policy_version 1576665 (0.0006) [2023-12-28 06:35:28,918][106226] Updated weights for policy 0, policy_version 1576675 (0.0006) [2023-12-28 06:35:28,967][106226] Updated weights for policy 0, policy_version 1576685 (0.0005) [2023-12-28 06:35:29,019][106226] Updated weights for policy 0, policy_version 1576695 (0.0005) [2023-12-28 06:35:29,426][106225] Updated weights for policy 1, policy_version 1580226 (0.0008) [2023-12-28 06:35:29,494][106225] Updated weights for policy 1, policy_version 1580236 (0.0007) [2023-12-28 06:35:29,564][106225] Updated weights for policy 1, policy_version 1580246 (0.0010) [2023-12-28 06:35:29,655][106226] Updated weights for policy 0, policy_version 1576705 (0.0006) [2023-12-28 06:35:29,713][106226] Updated weights for policy 0, policy_version 1576715 (0.0008) [2023-12-28 06:35:29,779][106226] Updated weights for policy 0, policy_version 1576725 (0.0007) [2023-12-28 06:35:30,216][106225] Updated weights for policy 1, policy_version 1580256 (0.0006) [2023-12-28 06:35:30,277][106225] Updated weights for policy 1, policy_version 1580266 (0.0005) [2023-12-28 06:35:30,337][106225] Updated weights for policy 1, policy_version 1580276 (0.0006) [2023-12-28 06:35:30,521][106226] Updated weights for policy 0, policy_version 1576735 (0.0008) [2023-12-28 06:35:30,571][106226] Updated weights for policy 0, policy_version 1576745 (0.0008) [2023-12-28 06:35:30,621][106226] Updated weights for policy 0, policy_version 1576755 (0.0008) [2023-12-28 06:35:30,970][106225] Updated weights for policy 1, policy_version 1580286 (0.0010) [2023-12-28 06:35:31,038][106225] Updated weights for policy 1, policy_version 1580296 (0.0010) [2023-12-28 06:35:31,106][106225] Updated weights for policy 1, policy_version 1580306 (0.0010) [2023-12-28 06:35:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 808337408. Throughput: 0: 9898.2, 1: 9913.6. Samples: 808324480. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:31,175][105115] Avg episode reward: [(0, '-4.975'), (1, '-4.732')] [2023-12-28 06:35:31,299][106226] Updated weights for policy 0, policy_version 1576765 (0.0007) [2023-12-28 06:35:31,374][106226] Updated weights for policy 0, policy_version 1576775 (0.0007) [2023-12-28 06:35:31,467][106226] Updated weights for policy 0, policy_version 1576785 (0.0006) [2023-12-28 06:35:31,870][106225] Updated weights for policy 1, policy_version 1580316 (0.0010) [2023-12-28 06:35:31,926][106225] Updated weights for policy 1, policy_version 1580326 (0.0007) [2023-12-28 06:35:31,974][106225] Updated weights for policy 1, policy_version 1580336 (0.0005) [2023-12-28 06:35:32,070][106226] Updated weights for policy 0, policy_version 1576795 (0.0007) [2023-12-28 06:35:32,134][106226] Updated weights for policy 0, policy_version 1576805 (0.0009) [2023-12-28 06:35:32,195][106226] Updated weights for policy 0, policy_version 1576815 (0.0009) [2023-12-28 06:35:32,593][106225] Updated weights for policy 1, policy_version 1580346 (0.0008) [2023-12-28 06:35:32,644][106225] Updated weights for policy 1, policy_version 1580356 (0.0008) [2023-12-28 06:35:32,702][106225] Updated weights for policy 1, policy_version 1580366 (0.0007) [2023-12-28 06:35:32,759][106225] Updated weights for policy 1, policy_version 1580376 (0.0006) [2023-12-28 06:35:32,938][106226] Updated weights for policy 0, policy_version 1576825 (0.0010) [2023-12-28 06:35:32,987][106226] Updated weights for policy 0, policy_version 1576835 (0.0010) [2023-12-28 06:35:33,040][106226] Updated weights for policy 0, policy_version 1576845 (0.0010) [2023-12-28 06:35:33,093][106226] Updated weights for policy 0, policy_version 1576855 (0.0010) [2023-12-28 06:35:33,360][106225] Updated weights for policy 1, policy_version 1580386 (0.0005) [2023-12-28 06:35:33,422][106225] Updated weights for policy 1, policy_version 1580396 (0.0007) [2023-12-28 06:35:33,472][106225] Updated weights for policy 1, policy_version 1580406 (0.0005) [2023-12-28 06:35:33,789][106226] Updated weights for policy 0, policy_version 1576865 (0.0006) [2023-12-28 06:35:33,860][106226] Updated weights for policy 0, policy_version 1576875 (0.0008) [2023-12-28 06:35:33,913][106226] Updated weights for policy 0, policy_version 1576885 (0.0010) [2023-12-28 06:35:34,042][106225] Updated weights for policy 1, policy_version 1580416 (0.0005) [2023-12-28 06:35:34,108][106225] Updated weights for policy 1, policy_version 1580426 (0.0006) [2023-12-28 06:35:34,170][106225] Updated weights for policy 1, policy_version 1580436 (0.0011) [2023-12-28 06:35:34,543][106226] Updated weights for policy 0, policy_version 1576895 (0.0010) [2023-12-28 06:35:34,608][106226] Updated weights for policy 0, policy_version 1576905 (0.0008) [2023-12-28 06:35:34,665][106226] Updated weights for policy 0, policy_version 1576915 (0.0006) [2023-12-28 06:35:34,878][106225] Updated weights for policy 1, policy_version 1580446 (0.0009) [2023-12-28 06:35:34,942][106225] Updated weights for policy 1, policy_version 1580456 (0.0008) [2023-12-28 06:35:35,002][106225] Updated weights for policy 1, policy_version 1580466 (0.0008) [2023-12-28 06:35:35,389][106226] Updated weights for policy 0, policy_version 1576925 (0.0009) [2023-12-28 06:35:35,448][106226] Updated weights for policy 0, policy_version 1576935 (0.0011) [2023-12-28 06:35:35,502][106226] Updated weights for policy 0, policy_version 1576945 (0.0010) [2023-12-28 06:35:35,707][106225] Updated weights for policy 1, policy_version 1580476 (0.0008) [2023-12-28 06:35:35,758][106225] Updated weights for policy 1, policy_version 1580486 (0.0008) [2023-12-28 06:35:35,804][106225] Updated weights for policy 1, policy_version 1580496 (0.0007) [2023-12-28 06:35:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 808435712. Throughput: 0: 9937.3, 1: 9960.6. Samples: 808446596. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:36,175][105115] Avg episode reward: [(0, '-4.804'), (1, '-4.629')] [2023-12-28 06:35:36,212][106226] Updated weights for policy 0, policy_version 1576955 (0.0011) [2023-12-28 06:35:36,276][106226] Updated weights for policy 0, policy_version 1576965 (0.0011) [2023-12-28 06:35:36,343][106226] Updated weights for policy 0, policy_version 1576975 (0.0011) [2023-12-28 06:35:36,579][106225] Updated weights for policy 1, policy_version 1580506 (0.0009) [2023-12-28 06:35:36,642][106225] Updated weights for policy 1, policy_version 1580516 (0.0011) [2023-12-28 06:35:36,703][106225] Updated weights for policy 1, policy_version 1580526 (0.0010) [2023-12-28 06:35:36,761][106225] Updated weights for policy 1, policy_version 1580536 (0.0010) [2023-12-28 06:35:37,074][106226] Updated weights for policy 0, policy_version 1576986 (0.0010) [2023-12-28 06:35:37,137][106226] Updated weights for policy 0, policy_version 1576996 (0.0011) [2023-12-28 06:35:37,200][106226] Updated weights for policy 0, policy_version 1577006 (0.0011) [2023-12-28 06:35:37,260][106226] Updated weights for policy 0, policy_version 1577016 (0.0010) [2023-12-28 06:35:37,472][106225] Updated weights for policy 1, policy_version 1580546 (0.0009) [2023-12-28 06:35:37,535][106225] Updated weights for policy 1, policy_version 1580556 (0.0008) [2023-12-28 06:35:37,593][106225] Updated weights for policy 1, policy_version 1580566 (0.0010) [2023-12-28 06:35:37,954][106226] Updated weights for policy 0, policy_version 1577026 (0.0007) [2023-12-28 06:35:38,004][106226] Updated weights for policy 0, policy_version 1577036 (0.0008) [2023-12-28 06:35:38,062][106226] Updated weights for policy 0, policy_version 1577046 (0.0009) [2023-12-28 06:35:38,128][106225] Updated weights for policy 1, policy_version 1580576 (0.0006) [2023-12-28 06:35:38,184][106225] Updated weights for policy 1, policy_version 1580586 (0.0008) [2023-12-28 06:35:38,237][106225] Updated weights for policy 1, policy_version 1580596 (0.0008) [2023-12-28 06:35:38,829][106226] Updated weights for policy 0, policy_version 1577056 (0.0009) [2023-12-28 06:35:38,908][106226] Updated weights for policy 0, policy_version 1577066 (0.0008) [2023-12-28 06:35:38,923][106225] Updated weights for policy 1, policy_version 1580606 (0.0008) [2023-12-28 06:35:38,969][106226] Updated weights for policy 0, policy_version 1577076 (0.0007) [2023-12-28 06:35:38,989][106225] Updated weights for policy 1, policy_version 1580616 (0.0007) [2023-12-28 06:35:39,042][106225] Updated weights for policy 1, policy_version 1580626 (0.0008) [2023-12-28 06:35:39,699][106226] Updated weights for policy 0, policy_version 1577086 (0.0007) [2023-12-28 06:35:39,770][106226] Updated weights for policy 0, policy_version 1577096 (0.0009) [2023-12-28 06:35:39,783][106225] Updated weights for policy 1, policy_version 1580636 (0.0007) [2023-12-28 06:35:39,837][106226] Updated weights for policy 0, policy_version 1577106 (0.0008) [2023-12-28 06:35:39,850][106225] Updated weights for policy 1, policy_version 1580646 (0.0008) [2023-12-28 06:35:39,913][106225] Updated weights for policy 1, policy_version 1580656 (0.0008) [2023-12-28 06:35:40,535][106226] Updated weights for policy 0, policy_version 1577116 (0.0008) [2023-12-28 06:35:40,585][106226] Updated weights for policy 0, policy_version 1577126 (0.0008) [2023-12-28 06:35:40,626][106225] Updated weights for policy 1, policy_version 1580666 (0.0008) [2023-12-28 06:35:40,643][106226] Updated weights for policy 0, policy_version 1577136 (0.0008) [2023-12-28 06:35:40,679][106225] Updated weights for policy 1, policy_version 1580676 (0.0006) [2023-12-28 06:35:40,728][106225] Updated weights for policy 1, policy_version 1580686 (0.0007) [2023-12-28 06:35:40,781][106225] Updated weights for policy 1, policy_version 1580696 (0.0005) [2023-12-28 06:35:41,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 808534016. Throughput: 0: 9902.8, 1: 10027.2. Samples: 808505444. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:41,175][105115] Avg episode reward: [(0, '-4.854'), (1, '-4.970')] [2023-12-28 06:35:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001580696_404709376.pth... [2023-12-28 06:35:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001577144_403824640.pth... [2023-12-28 06:35:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001575992_403529728.pth [2023-12-28 06:35:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001579512_404406272.pth [2023-12-28 06:35:41,442][106225] Updated weights for policy 1, policy_version 1580706 (0.0008) [2023-12-28 06:35:41,469][106226] Updated weights for policy 0, policy_version 1577146 (0.0007) [2023-12-28 06:35:41,491][106225] Updated weights for policy 1, policy_version 1580716 (0.0007) [2023-12-28 06:35:41,527][106226] Updated weights for policy 0, policy_version 1577156 (0.0007) [2023-12-28 06:35:41,545][106225] Updated weights for policy 1, policy_version 1580726 (0.0006) [2023-12-28 06:35:41,590][106226] Updated weights for policy 0, policy_version 1577166 (0.0006) [2023-12-28 06:35:41,654][106226] Updated weights for policy 0, policy_version 1577176 (0.0009) [2023-12-28 06:35:42,275][106225] Updated weights for policy 1, policy_version 1580736 (0.0008) [2023-12-28 06:35:42,346][106225] Updated weights for policy 1, policy_version 1580746 (0.0008) [2023-12-28 06:35:42,411][106225] Updated weights for policy 1, policy_version 1580756 (0.0008) [2023-12-28 06:35:42,418][106226] Updated weights for policy 0, policy_version 1577186 (0.0006) [2023-12-28 06:35:42,479][106226] Updated weights for policy 0, policy_version 1577196 (0.0005) [2023-12-28 06:35:42,532][106226] Updated weights for policy 0, policy_version 1577206 (0.0007) [2023-12-28 06:35:43,095][106225] Updated weights for policy 1, policy_version 1580766 (0.0009) [2023-12-28 06:35:43,155][106225] Updated weights for policy 1, policy_version 1580776 (0.0010) [2023-12-28 06:35:43,218][106225] Updated weights for policy 1, policy_version 1580786 (0.0010) [2023-12-28 06:35:43,249][106226] Updated weights for policy 0, policy_version 1577216 (0.0009) [2023-12-28 06:35:43,305][106226] Updated weights for policy 0, policy_version 1577226 (0.0008) [2023-12-28 06:35:43,364][106226] Updated weights for policy 0, policy_version 1577236 (0.0007) [2023-12-28 06:35:43,906][106225] Updated weights for policy 1, policy_version 1580796 (0.0011) [2023-12-28 06:35:43,966][106225] Updated weights for policy 1, policy_version 1580806 (0.0010) [2023-12-28 06:35:43,994][106226] Updated weights for policy 0, policy_version 1577246 (0.0008) [2023-12-28 06:35:44,023][106225] Updated weights for policy 1, policy_version 1580816 (0.0010) [2023-12-28 06:35:44,051][106226] Updated weights for policy 0, policy_version 1577256 (0.0006) [2023-12-28 06:35:44,114][106226] Updated weights for policy 0, policy_version 1577266 (0.0005) [2023-12-28 06:35:44,666][106226] Updated weights for policy 0, policy_version 1577276 (0.0006) [2023-12-28 06:35:44,731][106226] Updated weights for policy 0, policy_version 1577286 (0.0005) [2023-12-28 06:35:44,749][106225] Updated weights for policy 1, policy_version 1580826 (0.0010) [2023-12-28 06:35:44,801][106226] Updated weights for policy 0, policy_version 1577296 (0.0008) [2023-12-28 06:35:44,823][106225] Updated weights for policy 1, policy_version 1580836 (0.0008) [2023-12-28 06:35:44,888][106225] Updated weights for policy 1, policy_version 1580846 (0.0009) [2023-12-28 06:35:44,955][106225] Updated weights for policy 1, policy_version 1580856 (0.0008) [2023-12-28 06:35:45,480][106226] Updated weights for policy 0, policy_version 1577306 (0.0008) [2023-12-28 06:35:45,532][106226] Updated weights for policy 0, policy_version 1577316 (0.0008) [2023-12-28 06:35:45,576][106226] Updated weights for policy 0, policy_version 1577326 (0.0008) [2023-12-28 06:35:45,623][106226] Updated weights for policy 0, policy_version 1577336 (0.0007) [2023-12-28 06:35:45,650][106225] Updated weights for policy 1, policy_version 1580866 (0.0008) [2023-12-28 06:35:45,699][106225] Updated weights for policy 1, policy_version 1580876 (0.0008) [2023-12-28 06:35:45,744][106225] Updated weights for policy 1, policy_version 1580886 (0.0008) [2023-12-28 06:35:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 808632320. Throughput: 0: 9926.0, 1: 10015.6. Samples: 808623040. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:46,175][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.673')] [2023-12-28 06:35:46,262][106226] Updated weights for policy 0, policy_version 1577346 (0.0006) [2023-12-28 06:35:46,314][106226] Updated weights for policy 0, policy_version 1577356 (0.0005) [2023-12-28 06:35:46,369][106226] Updated weights for policy 0, policy_version 1577366 (0.0005) [2023-12-28 06:35:46,586][106225] Updated weights for policy 1, policy_version 1580896 (0.0008) [2023-12-28 06:35:46,638][106225] Updated weights for policy 1, policy_version 1580906 (0.0008) [2023-12-28 06:35:46,687][106225] Updated weights for policy 1, policy_version 1580916 (0.0008) [2023-12-28 06:35:46,980][106226] Updated weights for policy 0, policy_version 1577376 (0.0005) [2023-12-28 06:35:47,035][106226] Updated weights for policy 0, policy_version 1577386 (0.0008) [2023-12-28 06:35:47,084][106226] Updated weights for policy 0, policy_version 1577396 (0.0008) [2023-12-28 06:35:47,435][106225] Updated weights for policy 1, policy_version 1580926 (0.0008) [2023-12-28 06:35:47,497][106225] Updated weights for policy 1, policy_version 1580936 (0.0008) [2023-12-28 06:35:47,556][106225] Updated weights for policy 1, policy_version 1580946 (0.0008) [2023-12-28 06:35:47,759][106226] Updated weights for policy 0, policy_version 1577406 (0.0008) [2023-12-28 06:35:47,817][106226] Updated weights for policy 0, policy_version 1577416 (0.0009) [2023-12-28 06:35:47,872][106226] Updated weights for policy 0, policy_version 1577426 (0.0008) [2023-12-28 06:35:48,266][106225] Updated weights for policy 1, policy_version 1580956 (0.0009) [2023-12-28 06:35:48,319][106225] Updated weights for policy 1, policy_version 1580966 (0.0006) [2023-12-28 06:35:48,401][106225] Updated weights for policy 1, policy_version 1580976 (0.0008) [2023-12-28 06:35:48,601][106226] Updated weights for policy 0, policy_version 1577436 (0.0008) [2023-12-28 06:35:48,659][106226] Updated weights for policy 0, policy_version 1577446 (0.0008) [2023-12-28 06:35:48,718][106226] Updated weights for policy 0, policy_version 1577456 (0.0009) [2023-12-28 06:35:49,137][106225] Updated weights for policy 1, policy_version 1580986 (0.0009) [2023-12-28 06:35:49,185][106225] Updated weights for policy 1, policy_version 1580996 (0.0008) [2023-12-28 06:35:49,247][106225] Updated weights for policy 1, policy_version 1581006 (0.0008) [2023-12-28 06:35:49,306][106225] Updated weights for policy 1, policy_version 1581016 (0.0009) [2023-12-28 06:35:49,445][106226] Updated weights for policy 0, policy_version 1577466 (0.0009) [2023-12-28 06:35:49,504][106226] Updated weights for policy 0, policy_version 1577476 (0.0008) [2023-12-28 06:35:49,552][106226] Updated weights for policy 0, policy_version 1577486 (0.0009) [2023-12-28 06:35:49,607][106226] Updated weights for policy 0, policy_version 1577496 (0.0009) [2023-12-28 06:35:50,072][106225] Updated weights for policy 1, policy_version 1581026 (0.0008) [2023-12-28 06:35:50,125][106225] Updated weights for policy 1, policy_version 1581036 (0.0007) [2023-12-28 06:35:50,178][106225] Updated weights for policy 1, policy_version 1581046 (0.0007) [2023-12-28 06:35:50,387][106226] Updated weights for policy 0, policy_version 1577506 (0.0009) [2023-12-28 06:35:50,451][106226] Updated weights for policy 0, policy_version 1577516 (0.0009) [2023-12-28 06:35:50,508][106226] Updated weights for policy 0, policy_version 1577526 (0.0009) [2023-12-28 06:35:50,908][106225] Updated weights for policy 1, policy_version 1581056 (0.0008) [2023-12-28 06:35:50,958][106225] Updated weights for policy 1, policy_version 1581066 (0.0008) [2023-12-28 06:35:51,017][106225] Updated weights for policy 1, policy_version 1581076 (0.0008) [2023-12-28 06:35:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 808730624. Throughput: 0: 9950.0, 1: 10017.8. Samples: 808738996. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:51,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.863')] [2023-12-28 06:35:51,255][106226] Updated weights for policy 0, policy_version 1577536 (0.0006) [2023-12-28 06:35:51,315][106226] Updated weights for policy 0, policy_version 1577546 (0.0009) [2023-12-28 06:35:51,387][106226] Updated weights for policy 0, policy_version 1577556 (0.0009) [2023-12-28 06:35:51,883][106225] Updated weights for policy 1, policy_version 1581086 (0.0009) [2023-12-28 06:35:51,935][106225] Updated weights for policy 1, policy_version 1581096 (0.0008) [2023-12-28 06:35:51,984][106225] Updated weights for policy 1, policy_version 1581106 (0.0008) [2023-12-28 06:35:52,128][106226] Updated weights for policy 0, policy_version 1577566 (0.0008) [2023-12-28 06:35:52,176][106226] Updated weights for policy 0, policy_version 1577576 (0.0008) [2023-12-28 06:35:52,226][106226] Updated weights for policy 0, policy_version 1577586 (0.0008) [2023-12-28 06:35:52,703][106225] Updated weights for policy 1, policy_version 1581116 (0.0007) [2023-12-28 06:35:52,765][106225] Updated weights for policy 1, policy_version 1581126 (0.0007) [2023-12-28 06:35:52,813][106225] Updated weights for policy 1, policy_version 1581136 (0.0008) [2023-12-28 06:35:53,047][106226] Updated weights for policy 0, policy_version 1577596 (0.0009) [2023-12-28 06:35:53,105][106226] Updated weights for policy 0, policy_version 1577606 (0.0009) [2023-12-28 06:35:53,162][106226] Updated weights for policy 0, policy_version 1577616 (0.0009) [2023-12-28 06:35:53,521][106225] Updated weights for policy 1, policy_version 1581146 (0.0008) [2023-12-28 06:35:53,579][106225] Updated weights for policy 1, policy_version 1581156 (0.0009) [2023-12-28 06:35:53,641][106225] Updated weights for policy 1, policy_version 1581166 (0.0009) [2023-12-28 06:35:53,703][106225] Updated weights for policy 1, policy_version 1581176 (0.0009) [2023-12-28 06:35:53,790][106226] Updated weights for policy 0, policy_version 1577626 (0.0010) [2023-12-28 06:35:53,846][106226] Updated weights for policy 0, policy_version 1577636 (0.0010) [2023-12-28 06:35:53,896][106226] Updated weights for policy 0, policy_version 1577646 (0.0010) [2023-12-28 06:35:53,962][106226] Updated weights for policy 0, policy_version 1577656 (0.0007) [2023-12-28 06:35:54,469][106225] Updated weights for policy 1, policy_version 1581186 (0.0007) [2023-12-28 06:35:54,516][106225] Updated weights for policy 1, policy_version 1581196 (0.0008) [2023-12-28 06:35:54,569][106225] Updated weights for policy 1, policy_version 1581206 (0.0008) [2023-12-28 06:35:54,655][106226] Updated weights for policy 0, policy_version 1577666 (0.0011) [2023-12-28 06:35:54,715][106226] Updated weights for policy 0, policy_version 1577676 (0.0010) [2023-12-28 06:35:54,782][106226] Updated weights for policy 0, policy_version 1577686 (0.0010) [2023-12-28 06:35:55,298][106225] Updated weights for policy 1, policy_version 1581216 (0.0007) [2023-12-28 06:35:55,345][106225] Updated weights for policy 1, policy_version 1581226 (0.0008) [2023-12-28 06:35:55,389][106225] Updated weights for policy 1, policy_version 1581236 (0.0007) [2023-12-28 06:35:55,482][106226] Updated weights for policy 0, policy_version 1577696 (0.0008) [2023-12-28 06:35:55,547][106226] Updated weights for policy 0, policy_version 1577706 (0.0008) [2023-12-28 06:35:55,603][106226] Updated weights for policy 0, policy_version 1577716 (0.0008) [2023-12-28 06:35:56,024][106225] Updated weights for policy 1, policy_version 1581246 (0.0007) [2023-12-28 06:35:56,092][106225] Updated weights for policy 1, policy_version 1581256 (0.0006) [2023-12-28 06:35:56,152][106225] Updated weights for policy 1, policy_version 1581266 (0.0009) [2023-12-28 06:35:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 808820736. Throughput: 0: 9877.0, 1: 9942.7. Samples: 808795528. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-28 06:35:56,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.401')] [2023-12-28 06:35:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001581272_404856832.pth... [2023-12-28 06:35:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001580120_404561920.pth [2023-12-28 06:35:56,212][106226] Updated weights for policy 0, policy_version 1577726 (0.0008) [2023-12-28 06:35:56,283][106226] Updated weights for policy 0, policy_version 1577736 (0.0011) [2023-12-28 06:35:56,350][106226] Updated weights for policy 0, policy_version 1577746 (0.0011) [2023-12-28 06:35:56,379][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001577752_403980288.pth... [2023-12-28 06:35:56,382][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001576568_403677184.pth [2023-12-28 06:35:56,725][106225] Updated weights for policy 1, policy_version 1581276 (0.0007) [2023-12-28 06:35:56,778][106225] Updated weights for policy 1, policy_version 1581286 (0.0007) [2023-12-28 06:35:56,825][106225] Updated weights for policy 1, policy_version 1581296 (0.0008) [2023-12-28 06:35:56,983][106226] Updated weights for policy 0, policy_version 1577756 (0.0009) [2023-12-28 06:35:57,043][106226] Updated weights for policy 0, policy_version 1577766 (0.0009) [2023-12-28 06:35:57,099][106226] Updated weights for policy 0, policy_version 1577776 (0.0009) [2023-12-28 06:35:57,542][106225] Updated weights for policy 1, policy_version 1581306 (0.0007) [2023-12-28 06:35:57,598][106225] Updated weights for policy 1, policy_version 1581316 (0.0009) [2023-12-28 06:35:57,648][106225] Updated weights for policy 1, policy_version 1581326 (0.0008) [2023-12-28 06:35:57,693][106225] Updated weights for policy 1, policy_version 1581336 (0.0008) [2023-12-28 06:35:57,748][106226] Updated weights for policy 0, policy_version 1577786 (0.0006) [2023-12-28 06:35:57,799][106226] Updated weights for policy 0, policy_version 1577796 (0.0005) [2023-12-28 06:35:57,850][106226] Updated weights for policy 0, policy_version 1577806 (0.0005) [2023-12-28 06:35:57,904][106226] Updated weights for policy 0, policy_version 1577816 (0.0005) [2023-12-28 06:35:58,498][106225] Updated weights for policy 1, policy_version 1581346 (0.0008) [2023-12-28 06:35:58,537][106226] Updated weights for policy 0, policy_version 1577826 (0.0008) [2023-12-28 06:35:58,564][106225] Updated weights for policy 1, policy_version 1581356 (0.0008) [2023-12-28 06:35:58,603][106226] Updated weights for policy 0, policy_version 1577836 (0.0008) [2023-12-28 06:35:58,629][106225] Updated weights for policy 1, policy_version 1581366 (0.0007) [2023-12-28 06:35:58,669][106226] Updated weights for policy 0, policy_version 1577846 (0.0008) [2023-12-28 06:35:59,405][106225] Updated weights for policy 1, policy_version 1581376 (0.0008) [2023-12-28 06:35:59,464][106225] Updated weights for policy 1, policy_version 1581386 (0.0009) [2023-12-28 06:35:59,501][106226] Updated weights for policy 0, policy_version 1577856 (0.0008) [2023-12-28 06:35:59,511][106225] Updated weights for policy 1, policy_version 1581396 (0.0006) [2023-12-28 06:35:59,549][106226] Updated weights for policy 0, policy_version 1577866 (0.0006) [2023-12-28 06:35:59,614][106226] Updated weights for policy 0, policy_version 1577876 (0.0010) [2023-12-28 06:36:00,269][106225] Updated weights for policy 1, policy_version 1581406 (0.0006) [2023-12-28 06:36:00,289][106226] Updated weights for policy 0, policy_version 1577886 (0.0010) [2023-12-28 06:36:00,332][106225] Updated weights for policy 1, policy_version 1581416 (0.0006) [2023-12-28 06:36:00,349][106226] Updated weights for policy 0, policy_version 1577896 (0.0010) [2023-12-28 06:36:00,392][106225] Updated weights for policy 1, policy_version 1581426 (0.0006) [2023-12-28 06:36:00,413][106226] Updated weights for policy 0, policy_version 1577906 (0.0009) [2023-12-28 06:36:00,954][106226] Updated weights for policy 0, policy_version 1577916 (0.0006) [2023-12-28 06:36:01,000][106226] Updated weights for policy 0, policy_version 1577926 (0.0007) [2023-12-28 06:36:01,062][106226] Updated weights for policy 0, policy_version 1577936 (0.0008) [2023-12-28 06:36:01,075][106225] Updated weights for policy 1, policy_version 1581436 (0.0007) [2023-12-28 06:36:01,134][106225] Updated weights for policy 1, policy_version 1581446 (0.0009) [2023-12-28 06:36:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 808927232. Throughput: 0: 9944.5, 1: 9930.1. Samples: 808914676. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:01,175][105115] Avg episode reward: [(0, '-4.892'), (1, '-4.759')] [2023-12-28 06:36:01,193][106225] Updated weights for policy 1, policy_version 1581456 (0.0009) [2023-12-28 06:36:01,762][106226] Updated weights for policy 0, policy_version 1577946 (0.0007) [2023-12-28 06:36:01,826][106226] Updated weights for policy 0, policy_version 1577956 (0.0008) [2023-12-28 06:36:01,889][106226] Updated weights for policy 0, policy_version 1577966 (0.0007) [2023-12-28 06:36:01,898][106225] Updated weights for policy 1, policy_version 1581466 (0.0009) [2023-12-28 06:36:01,950][106226] Updated weights for policy 0, policy_version 1577976 (0.0006) [2023-12-28 06:36:01,959][106225] Updated weights for policy 1, policy_version 1581476 (0.0008) [2023-12-28 06:36:02,034][106225] Updated weights for policy 1, policy_version 1581486 (0.0007) [2023-12-28 06:36:02,100][106225] Updated weights for policy 1, policy_version 1581496 (0.0008) [2023-12-28 06:36:02,615][106226] Updated weights for policy 0, policy_version 1577986 (0.0009) [2023-12-28 06:36:02,677][106226] Updated weights for policy 0, policy_version 1577996 (0.0008) [2023-12-28 06:36:02,733][106226] Updated weights for policy 0, policy_version 1578006 (0.0006) [2023-12-28 06:36:02,766][106225] Updated weights for policy 1, policy_version 1581506 (0.0008) [2023-12-28 06:36:02,831][106225] Updated weights for policy 1, policy_version 1581516 (0.0008) [2023-12-28 06:36:02,890][106225] Updated weights for policy 1, policy_version 1581526 (0.0008) [2023-12-28 06:36:03,432][106226] Updated weights for policy 0, policy_version 1578016 (0.0006) [2023-12-28 06:36:03,480][106226] Updated weights for policy 0, policy_version 1578026 (0.0005) [2023-12-28 06:36:03,524][106226] Updated weights for policy 0, policy_version 1578036 (0.0007) [2023-12-28 06:36:03,650][106225] Updated weights for policy 1, policy_version 1581536 (0.0008) [2023-12-28 06:36:03,707][106225] Updated weights for policy 1, policy_version 1581546 (0.0009) [2023-12-28 06:36:03,766][106225] Updated weights for policy 1, policy_version 1581556 (0.0008) [2023-12-28 06:36:04,224][106226] Updated weights for policy 0, policy_version 1578046 (0.0008) [2023-12-28 06:36:04,283][106226] Updated weights for policy 0, policy_version 1578056 (0.0008) [2023-12-28 06:36:04,338][106226] Updated weights for policy 0, policy_version 1578066 (0.0008) [2023-12-28 06:36:04,494][106225] Updated weights for policy 1, policy_version 1581566 (0.0008) [2023-12-28 06:36:04,543][106225] Updated weights for policy 1, policy_version 1581576 (0.0008) [2023-12-28 06:36:04,591][106225] Updated weights for policy 1, policy_version 1581586 (0.0009) [2023-12-28 06:36:04,973][106226] Updated weights for policy 0, policy_version 1578076 (0.0007) [2023-12-28 06:36:05,024][106226] Updated weights for policy 0, policy_version 1578086 (0.0005) [2023-12-28 06:36:05,077][106226] Updated weights for policy 0, policy_version 1578096 (0.0006) [2023-12-28 06:36:05,402][106225] Updated weights for policy 1, policy_version 1581596 (0.0008) [2023-12-28 06:36:05,465][106225] Updated weights for policy 1, policy_version 1581606 (0.0008) [2023-12-28 06:36:05,519][106225] Updated weights for policy 1, policy_version 1581616 (0.0009) [2023-12-28 06:36:05,638][106226] Updated weights for policy 0, policy_version 1578106 (0.0008) [2023-12-28 06:36:05,694][106226] Updated weights for policy 0, policy_version 1578116 (0.0008) [2023-12-28 06:36:05,745][106226] Updated weights for policy 0, policy_version 1578126 (0.0008) [2023-12-28 06:36:05,793][106226] Updated weights for policy 0, policy_version 1578136 (0.0008) [2023-12-28 06:36:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 809025536. Throughput: 0: 9980.7, 1: 9886.6. Samples: 809036476. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:06,175][105115] Avg episode reward: [(0, '-5.069'), (1, '-4.578')] [2023-12-28 06:36:06,243][106225] Updated weights for policy 1, policy_version 1581626 (0.0008) [2023-12-28 06:36:06,312][106225] Updated weights for policy 1, policy_version 1581636 (0.0006) [2023-12-28 06:36:06,382][106225] Updated weights for policy 1, policy_version 1581646 (0.0009) [2023-12-28 06:36:06,441][106225] Updated weights for policy 1, policy_version 1581656 (0.0008) [2023-12-28 06:36:06,557][106226] Updated weights for policy 0, policy_version 1578146 (0.0008) [2023-12-28 06:36:06,613][106226] Updated weights for policy 0, policy_version 1578156 (0.0008) [2023-12-28 06:36:06,669][106226] Updated weights for policy 0, policy_version 1578166 (0.0009) [2023-12-28 06:36:07,137][106225] Updated weights for policy 1, policy_version 1581666 (0.0009) [2023-12-28 06:36:07,182][106225] Updated weights for policy 1, policy_version 1581676 (0.0008) [2023-12-28 06:36:07,230][106225] Updated weights for policy 1, policy_version 1581686 (0.0008) [2023-12-28 06:36:07,367][106226] Updated weights for policy 0, policy_version 1578176 (0.0006) [2023-12-28 06:36:07,430][106226] Updated weights for policy 0, policy_version 1578186 (0.0005) [2023-12-28 06:36:07,495][106226] Updated weights for policy 0, policy_version 1578196 (0.0008) [2023-12-28 06:36:07,805][106225] Updated weights for policy 1, policy_version 1581696 (0.0005) [2023-12-28 06:36:07,850][106225] Updated weights for policy 1, policy_version 1581706 (0.0006) [2023-12-28 06:36:07,896][106225] Updated weights for policy 1, policy_version 1581716 (0.0006) [2023-12-28 06:36:08,218][106226] Updated weights for policy 0, policy_version 1578206 (0.0008) [2023-12-28 06:36:08,280][106226] Updated weights for policy 0, policy_version 1578216 (0.0010) [2023-12-28 06:36:08,340][106226] Updated weights for policy 0, policy_version 1578226 (0.0010) [2023-12-28 06:36:08,488][106225] Updated weights for policy 1, policy_version 1581726 (0.0007) [2023-12-28 06:36:08,551][106225] Updated weights for policy 1, policy_version 1581736 (0.0008) [2023-12-28 06:36:08,610][106225] Updated weights for policy 1, policy_version 1581746 (0.0008) [2023-12-28 06:36:09,166][106226] Updated weights for policy 0, policy_version 1578236 (0.0009) [2023-12-28 06:36:09,226][106226] Updated weights for policy 0, policy_version 1578246 (0.0009) [2023-12-28 06:36:09,302][106226] Updated weights for policy 0, policy_version 1578256 (0.0009) [2023-12-28 06:36:09,320][106225] Updated weights for policy 1, policy_version 1581756 (0.0009) [2023-12-28 06:36:09,384][106225] Updated weights for policy 1, policy_version 1581766 (0.0010) [2023-12-28 06:36:09,451][106225] Updated weights for policy 1, policy_version 1581776 (0.0010) [2023-12-28 06:36:10,066][106226] Updated weights for policy 0, policy_version 1578266 (0.0009) [2023-12-28 06:36:10,122][106226] Updated weights for policy 0, policy_version 1578276 (0.0008) [2023-12-28 06:36:10,178][106226] Updated weights for policy 0, policy_version 1578286 (0.0009) [2023-12-28 06:36:10,220][106225] Updated weights for policy 1, policy_version 1581786 (0.0008) [2023-12-28 06:36:10,240][106226] Updated weights for policy 0, policy_version 1578296 (0.0009) [2023-12-28 06:36:10,280][106225] Updated weights for policy 1, policy_version 1581796 (0.0006) [2023-12-28 06:36:10,336][106225] Updated weights for policy 1, policy_version 1581806 (0.0006) [2023-12-28 06:36:10,395][106225] Updated weights for policy 1, policy_version 1581816 (0.0007) [2023-12-28 06:36:11,003][106226] Updated weights for policy 0, policy_version 1578306 (0.0009) [2023-12-28 06:36:11,068][106226] Updated weights for policy 0, policy_version 1578316 (0.0009) [2023-12-28 06:36:11,108][106225] Updated weights for policy 1, policy_version 1581826 (0.0008) [2023-12-28 06:36:11,137][106226] Updated weights for policy 0, policy_version 1578326 (0.0008) [2023-12-28 06:36:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 809123840. Throughput: 0: 10005.6, 1: 9883.0. Samples: 809096472. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:11,175][106225] Updated weights for policy 1, policy_version 1581836 (0.0009) [2023-12-28 06:36:11,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.471')] [2023-12-28 06:36:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001578328_404127744.pth... [2023-12-28 06:36:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001577144_403824640.pth [2023-12-28 06:36:11,244][106225] Updated weights for policy 1, policy_version 1581846 (0.0008) [2023-12-28 06:36:11,258][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001581848_405004288.pth... [2023-12-28 06:36:11,262][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001580696_404709376.pth [2023-12-28 06:36:11,887][106226] Updated weights for policy 0, policy_version 1578336 (0.0008) [2023-12-28 06:36:11,944][106226] Updated weights for policy 0, policy_version 1578346 (0.0009) [2023-12-28 06:36:12,000][106226] Updated weights for policy 0, policy_version 1578356 (0.0006) [2023-12-28 06:36:12,009][106225] Updated weights for policy 1, policy_version 1581856 (0.0008) [2023-12-28 06:36:12,075][106225] Updated weights for policy 1, policy_version 1581866 (0.0008) [2023-12-28 06:36:12,142][106225] Updated weights for policy 1, policy_version 1581876 (0.0008) [2023-12-28 06:36:12,722][106226] Updated weights for policy 0, policy_version 1578366 (0.0006) [2023-12-28 06:36:12,778][106226] Updated weights for policy 0, policy_version 1578376 (0.0009) [2023-12-28 06:36:12,839][106226] Updated weights for policy 0, policy_version 1578386 (0.0007) [2023-12-28 06:36:12,893][106225] Updated weights for policy 1, policy_version 1581886 (0.0009) [2023-12-28 06:36:12,947][106225] Updated weights for policy 1, policy_version 1581896 (0.0008) [2023-12-28 06:36:13,001][106225] Updated weights for policy 1, policy_version 1581906 (0.0008) [2023-12-28 06:36:13,500][106226] Updated weights for policy 0, policy_version 1578396 (0.0007) [2023-12-28 06:36:13,560][106226] Updated weights for policy 0, policy_version 1578406 (0.0009) [2023-12-28 06:36:13,614][106226] Updated weights for policy 0, policy_version 1578416 (0.0008) [2023-12-28 06:36:13,714][106225] Updated weights for policy 1, policy_version 1581916 (0.0008) [2023-12-28 06:36:13,762][106225] Updated weights for policy 1, policy_version 1581926 (0.0008) [2023-12-28 06:36:13,817][106225] Updated weights for policy 1, policy_version 1581936 (0.0008) [2023-12-28 06:36:14,358][106226] Updated weights for policy 0, policy_version 1578426 (0.0008) [2023-12-28 06:36:14,406][106226] Updated weights for policy 0, policy_version 1578436 (0.0008) [2023-12-28 06:36:14,455][106226] Updated weights for policy 0, policy_version 1578446 (0.0008) [2023-12-28 06:36:14,510][106226] Updated weights for policy 0, policy_version 1578456 (0.0009) [2023-12-28 06:36:14,522][106225] Updated weights for policy 1, policy_version 1581946 (0.0006) [2023-12-28 06:36:14,583][106225] Updated weights for policy 1, policy_version 1581956 (0.0009) [2023-12-28 06:36:14,636][106225] Updated weights for policy 1, policy_version 1581966 (0.0008) [2023-12-28 06:36:14,694][106225] Updated weights for policy 1, policy_version 1581976 (0.0009) [2023-12-28 06:36:15,176][106226] Updated weights for policy 0, policy_version 1578466 (0.0006) [2023-12-28 06:36:15,249][106226] Updated weights for policy 0, policy_version 1578476 (0.0006) [2023-12-28 06:36:15,315][106226] Updated weights for policy 0, policy_version 1578486 (0.0006) [2023-12-28 06:36:15,436][106225] Updated weights for policy 1, policy_version 1581986 (0.0008) [2023-12-28 06:36:15,487][106225] Updated weights for policy 1, policy_version 1581996 (0.0007) [2023-12-28 06:36:15,538][106225] Updated weights for policy 1, policy_version 1582006 (0.0008) [2023-12-28 06:36:15,983][106226] Updated weights for policy 0, policy_version 1578496 (0.0008) [2023-12-28 06:36:16,039][106226] Updated weights for policy 0, policy_version 1578506 (0.0008) [2023-12-28 06:36:16,092][106226] Updated weights for policy 0, policy_version 1578516 (0.0008) [2023-12-28 06:36:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 809222144. Throughput: 0: 9896.9, 1: 9790.8. Samples: 809210432. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:16,176][105115] Avg episode reward: [(0, '-5.023'), (1, '-4.794')] [2023-12-28 06:36:16,221][106225] Updated weights for policy 1, policy_version 1582016 (0.0009) [2023-12-28 06:36:16,278][106225] Updated weights for policy 1, policy_version 1582026 (0.0007) [2023-12-28 06:36:16,330][106225] Updated weights for policy 1, policy_version 1582036 (0.0007) [2023-12-28 06:36:16,654][106226] Updated weights for policy 0, policy_version 1578526 (0.0007) [2023-12-28 06:36:16,700][106226] Updated weights for policy 0, policy_version 1578536 (0.0008) [2023-12-28 06:36:16,746][106226] Updated weights for policy 0, policy_version 1578546 (0.0008) [2023-12-28 06:36:17,097][106225] Updated weights for policy 1, policy_version 1582046 (0.0009) [2023-12-28 06:36:17,146][106225] Updated weights for policy 1, policy_version 1582056 (0.0008) [2023-12-28 06:36:17,209][106225] Updated weights for policy 1, policy_version 1582066 (0.0007) [2023-12-28 06:36:17,420][106226] Updated weights for policy 0, policy_version 1578556 (0.0008) [2023-12-28 06:36:17,465][106226] Updated weights for policy 0, policy_version 1578566 (0.0008) [2023-12-28 06:36:17,519][106226] Updated weights for policy 0, policy_version 1578576 (0.0007) [2023-12-28 06:36:17,938][106225] Updated weights for policy 1, policy_version 1582076 (0.0008) [2023-12-28 06:36:17,992][106225] Updated weights for policy 1, policy_version 1582086 (0.0008) [2023-12-28 06:36:18,062][106225] Updated weights for policy 1, policy_version 1582096 (0.0009) [2023-12-28 06:36:18,189][106226] Updated weights for policy 0, policy_version 1578586 (0.0005) [2023-12-28 06:36:18,248][106226] Updated weights for policy 0, policy_version 1578596 (0.0007) [2023-12-28 06:36:18,300][106226] Updated weights for policy 0, policy_version 1578606 (0.0009) [2023-12-28 06:36:18,363][106226] Updated weights for policy 0, policy_version 1578616 (0.0008) [2023-12-28 06:36:18,835][106225] Updated weights for policy 1, policy_version 1582106 (0.0006) [2023-12-28 06:36:18,900][106225] Updated weights for policy 1, policy_version 1582116 (0.0008) [2023-12-28 06:36:18,960][106225] Updated weights for policy 1, policy_version 1582126 (0.0007) [2023-12-28 06:36:19,021][106225] Updated weights for policy 1, policy_version 1582136 (0.0007) [2023-12-28 06:36:19,108][106226] Updated weights for policy 0, policy_version 1578626 (0.0005) [2023-12-28 06:36:19,167][106226] Updated weights for policy 0, policy_version 1578636 (0.0008) [2023-12-28 06:36:19,232][106226] Updated weights for policy 0, policy_version 1578646 (0.0009) [2023-12-28 06:36:19,840][106225] Updated weights for policy 1, policy_version 1582146 (0.0011) [2023-12-28 06:36:19,881][106226] Updated weights for policy 0, policy_version 1578656 (0.0007) [2023-12-28 06:36:19,902][106225] Updated weights for policy 1, policy_version 1582156 (0.0011) [2023-12-28 06:36:19,945][106226] Updated weights for policy 0, policy_version 1578666 (0.0007) [2023-12-28 06:36:19,963][106225] Updated weights for policy 1, policy_version 1582166 (0.0010) [2023-12-28 06:36:20,016][106226] Updated weights for policy 0, policy_version 1578676 (0.0007) [2023-12-28 06:36:20,653][106225] Updated weights for policy 1, policy_version 1582176 (0.0007) [2023-12-28 06:36:20,715][106225] Updated weights for policy 1, policy_version 1582186 (0.0009) [2023-12-28 06:36:20,716][106226] Updated weights for policy 0, policy_version 1578686 (0.0009) [2023-12-28 06:36:20,778][106226] Updated weights for policy 0, policy_version 1578696 (0.0007) [2023-12-28 06:36:20,779][106225] Updated weights for policy 1, policy_version 1582196 (0.0009) [2023-12-28 06:36:20,837][106226] Updated weights for policy 0, policy_version 1578706 (0.0006) [2023-12-28 06:36:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 809320448. Throughput: 0: 9954.8, 1: 9668.1. Samples: 809329628. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:21,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-4.716')] [2023-12-28 06:36:21,548][106226] Updated weights for policy 0, policy_version 1578716 (0.0006) [2023-12-28 06:36:21,589][106225] Updated weights for policy 1, policy_version 1582206 (0.0008) [2023-12-28 06:36:21,619][106226] Updated weights for policy 0, policy_version 1578726 (0.0007) [2023-12-28 06:36:21,660][106225] Updated weights for policy 1, policy_version 1582216 (0.0006) [2023-12-28 06:36:21,684][106226] Updated weights for policy 0, policy_version 1578736 (0.0009) [2023-12-28 06:36:21,731][106225] Updated weights for policy 1, policy_version 1582226 (0.0007) [2023-12-28 06:36:22,389][106225] Updated weights for policy 1, policy_version 1582236 (0.0008) [2023-12-28 06:36:22,453][106226] Updated weights for policy 0, policy_version 1578746 (0.0007) [2023-12-28 06:36:22,454][106225] Updated weights for policy 1, policy_version 1582246 (0.0009) [2023-12-28 06:36:22,507][106226] Updated weights for policy 0, policy_version 1578756 (0.0008) [2023-12-28 06:36:22,521][106225] Updated weights for policy 1, policy_version 1582256 (0.0008) [2023-12-28 06:36:22,567][106226] Updated weights for policy 0, policy_version 1578766 (0.0007) [2023-12-28 06:36:22,630][106226] Updated weights for policy 0, policy_version 1578776 (0.0009) [2023-12-28 06:36:23,269][106225] Updated weights for policy 1, policy_version 1582266 (0.0010) [2023-12-28 06:36:23,326][106225] Updated weights for policy 1, policy_version 1582276 (0.0010) [2023-12-28 06:36:23,364][106226] Updated weights for policy 0, policy_version 1578786 (0.0007) [2023-12-28 06:36:23,386][106225] Updated weights for policy 1, policy_version 1582286 (0.0009) [2023-12-28 06:36:23,420][106226] Updated weights for policy 0, policy_version 1578796 (0.0006) [2023-12-28 06:36:23,447][106225] Updated weights for policy 1, policy_version 1582296 (0.0005) [2023-12-28 06:36:23,488][106226] Updated weights for policy 0, policy_version 1578806 (0.0006) [2023-12-28 06:36:24,083][106225] Updated weights for policy 1, policy_version 1582306 (0.0008) [2023-12-28 06:36:24,098][106226] Updated weights for policy 0, policy_version 1578816 (0.0006) [2023-12-28 06:36:24,151][106225] Updated weights for policy 1, policy_version 1582316 (0.0008) [2023-12-28 06:36:24,154][106226] Updated weights for policy 0, policy_version 1578826 (0.0007) [2023-12-28 06:36:24,207][106226] Updated weights for policy 0, policy_version 1578836 (0.0007) [2023-12-28 06:36:24,217][106225] Updated weights for policy 1, policy_version 1582326 (0.0008) [2023-12-28 06:36:24,908][106225] Updated weights for policy 1, policy_version 1582336 (0.0006) [2023-12-28 06:36:24,962][106226] Updated weights for policy 0, policy_version 1578846 (0.0008) [2023-12-28 06:36:24,972][106225] Updated weights for policy 1, policy_version 1582346 (0.0005) [2023-12-28 06:36:25,017][106226] Updated weights for policy 0, policy_version 1578856 (0.0007) [2023-12-28 06:36:25,031][106225] Updated weights for policy 1, policy_version 1582356 (0.0005) [2023-12-28 06:36:25,086][106226] Updated weights for policy 0, policy_version 1578866 (0.0005) [2023-12-28 06:36:25,541][106225] Updated weights for policy 1, policy_version 1582366 (0.0007) [2023-12-28 06:36:25,589][106225] Updated weights for policy 1, policy_version 1582376 (0.0008) [2023-12-28 06:36:25,640][106225] Updated weights for policy 1, policy_version 1582386 (0.0008) [2023-12-28 06:36:25,783][106226] Updated weights for policy 0, policy_version 1578876 (0.0008) [2023-12-28 06:36:25,842][106226] Updated weights for policy 0, policy_version 1578886 (0.0008) [2023-12-28 06:36:25,912][106226] Updated weights for policy 0, policy_version 1578896 (0.0010) [2023-12-28 06:36:26,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 809418752. Throughput: 0: 9974.5, 1: 9628.4. Samples: 809387572. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:26,175][105115] Avg episode reward: [(0, '-4.947'), (1, '-4.684')] [2023-12-28 06:36:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001578904_404275200.pth... [2023-12-28 06:36:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001582392_405143552.pth... [2023-12-28 06:36:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001577752_403980288.pth [2023-12-28 06:36:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001581272_404856832.pth [2023-12-28 06:36:26,326][106225] Updated weights for policy 1, policy_version 1582396 (0.0008) [2023-12-28 06:36:26,382][106225] Updated weights for policy 1, policy_version 1582406 (0.0006) [2023-12-28 06:36:26,439][106225] Updated weights for policy 1, policy_version 1582416 (0.0008) [2023-12-28 06:36:26,671][106226] Updated weights for policy 0, policy_version 1578906 (0.0009) [2023-12-28 06:36:26,723][106226] Updated weights for policy 0, policy_version 1578916 (0.0009) [2023-12-28 06:36:26,776][106226] Updated weights for policy 0, policy_version 1578926 (0.0009) [2023-12-28 06:36:26,830][106226] Updated weights for policy 0, policy_version 1578936 (0.0008) [2023-12-28 06:36:27,176][106225] Updated weights for policy 1, policy_version 1582426 (0.0009) [2023-12-28 06:36:27,237][106225] Updated weights for policy 1, policy_version 1582436 (0.0008) [2023-12-28 06:36:27,298][106225] Updated weights for policy 1, policy_version 1582446 (0.0009) [2023-12-28 06:36:27,362][106225] Updated weights for policy 1, policy_version 1582456 (0.0009) [2023-12-28 06:36:27,590][106226] Updated weights for policy 0, policy_version 1578946 (0.0010) [2023-12-28 06:36:27,646][106226] Updated weights for policy 0, policy_version 1578956 (0.0008) [2023-12-28 06:36:27,696][106226] Updated weights for policy 0, policy_version 1578966 (0.0009) [2023-12-28 06:36:28,110][106225] Updated weights for policy 1, policy_version 1582466 (0.0007) [2023-12-28 06:36:28,158][106225] Updated weights for policy 1, policy_version 1582476 (0.0008) [2023-12-28 06:36:28,221][106225] Updated weights for policy 1, policy_version 1582486 (0.0009) [2023-12-28 06:36:28,450][106226] Updated weights for policy 0, policy_version 1578976 (0.0008) [2023-12-28 06:36:28,512][106226] Updated weights for policy 0, policy_version 1578986 (0.0008) [2023-12-28 06:36:28,574][106226] Updated weights for policy 0, policy_version 1578996 (0.0008) [2023-12-28 06:36:28,977][106225] Updated weights for policy 1, policy_version 1582496 (0.0008) [2023-12-28 06:36:29,041][106225] Updated weights for policy 1, policy_version 1582506 (0.0008) [2023-12-28 06:36:29,094][106225] Updated weights for policy 1, policy_version 1582516 (0.0007) [2023-12-28 06:36:29,224][106226] Updated weights for policy 0, policy_version 1579006 (0.0007) [2023-12-28 06:36:29,291][106226] Updated weights for policy 0, policy_version 1579016 (0.0008) [2023-12-28 06:36:29,360][106226] Updated weights for policy 0, policy_version 1579026 (0.0010) [2023-12-28 06:36:29,881][106225] Updated weights for policy 1, policy_version 1582526 (0.0008) [2023-12-28 06:36:29,939][106225] Updated weights for policy 1, policy_version 1582536 (0.0007) [2023-12-28 06:36:30,005][106225] Updated weights for policy 1, policy_version 1582546 (0.0009) [2023-12-28 06:36:30,120][106226] Updated weights for policy 0, policy_version 1579036 (0.0009) [2023-12-28 06:36:30,170][106226] Updated weights for policy 0, policy_version 1579046 (0.0009) [2023-12-28 06:36:30,220][106226] Updated weights for policy 0, policy_version 1579056 (0.0010) [2023-12-28 06:36:30,785][106225] Updated weights for policy 1, policy_version 1582556 (0.0008) [2023-12-28 06:36:30,843][106225] Updated weights for policy 1, policy_version 1582566 (0.0010) [2023-12-28 06:36:30,846][106226] Updated weights for policy 0, policy_version 1579066 (0.0007) [2023-12-28 06:36:30,893][106225] Updated weights for policy 1, policy_version 1582576 (0.0008) [2023-12-28 06:36:30,903][106226] Updated weights for policy 0, policy_version 1579076 (0.0005) [2023-12-28 06:36:30,963][106226] Updated weights for policy 0, policy_version 1579086 (0.0006) [2023-12-28 06:36:31,029][106226] Updated weights for policy 0, policy_version 1579096 (0.0011) [2023-12-28 06:36:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 809517056. Throughput: 0: 9925.6, 1: 9635.6. Samples: 809503296. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:31,175][105115] Avg episode reward: [(0, '-5.049'), (1, '-4.687')] [2023-12-28 06:36:31,657][106225] Updated weights for policy 1, policy_version 1582586 (0.0008) [2023-12-28 06:36:31,722][106225] Updated weights for policy 1, policy_version 1582596 (0.0007) [2023-12-28 06:36:31,734][106226] Updated weights for policy 0, policy_version 1579106 (0.0010) [2023-12-28 06:36:31,787][106225] Updated weights for policy 1, policy_version 1582606 (0.0008) [2023-12-28 06:36:31,790][106226] Updated weights for policy 0, policy_version 1579116 (0.0007) [2023-12-28 06:36:31,849][106225] Updated weights for policy 1, policy_version 1582616 (0.0007) [2023-12-28 06:36:31,851][106226] Updated weights for policy 0, policy_version 1579126 (0.0007) [2023-12-28 06:36:32,555][106225] Updated weights for policy 1, policy_version 1582626 (0.0006) [2023-12-28 06:36:32,575][106226] Updated weights for policy 0, policy_version 1579136 (0.0009) [2023-12-28 06:36:32,616][106225] Updated weights for policy 1, policy_version 1582636 (0.0006) [2023-12-28 06:36:32,636][106226] Updated weights for policy 0, policy_version 1579146 (0.0007) [2023-12-28 06:36:32,673][106225] Updated weights for policy 1, policy_version 1582646 (0.0008) [2023-12-28 06:36:32,697][106226] Updated weights for policy 0, policy_version 1579156 (0.0005) [2023-12-28 06:36:33,295][106226] Updated weights for policy 0, policy_version 1579166 (0.0006) [2023-12-28 06:36:33,342][106226] Updated weights for policy 0, policy_version 1579176 (0.0005) [2023-12-28 06:36:33,392][106226] Updated weights for policy 0, policy_version 1579186 (0.0005) [2023-12-28 06:36:33,436][106225] Updated weights for policy 1, policy_version 1582656 (0.0010) [2023-12-28 06:36:33,492][106225] Updated weights for policy 1, policy_version 1582667 (0.0008) [2023-12-28 06:36:33,540][106225] Updated weights for policy 1, policy_version 1582677 (0.0010) [2023-12-28 06:36:33,966][106226] Updated weights for policy 0, policy_version 1579196 (0.0007) [2023-12-28 06:36:34,015][106226] Updated weights for policy 0, policy_version 1579206 (0.0010) [2023-12-28 06:36:34,078][106226] Updated weights for policy 0, policy_version 1579216 (0.0010) [2023-12-28 06:36:34,258][106225] Updated weights for policy 1, policy_version 1582687 (0.0009) [2023-12-28 06:36:34,320][106225] Updated weights for policy 1, policy_version 1582697 (0.0008) [2023-12-28 06:36:34,375][106225] Updated weights for policy 1, policy_version 1582707 (0.0008) [2023-12-28 06:36:34,817][106226] Updated weights for policy 0, policy_version 1579226 (0.0008) [2023-12-28 06:36:34,863][106226] Updated weights for policy 0, policy_version 1579236 (0.0010) [2023-12-28 06:36:34,909][106226] Updated weights for policy 0, policy_version 1579246 (0.0010) [2023-12-28 06:36:34,964][106226] Updated weights for policy 0, policy_version 1579256 (0.0006) [2023-12-28 06:36:35,091][106225] Updated weights for policy 1, policy_version 1582717 (0.0007) [2023-12-28 06:36:35,157][106225] Updated weights for policy 1, policy_version 1582727 (0.0005) [2023-12-28 06:36:35,224][106225] Updated weights for policy 1, policy_version 1582737 (0.0005) [2023-12-28 06:36:35,580][106226] Updated weights for policy 0, policy_version 1579266 (0.0005) [2023-12-28 06:36:35,632][106226] Updated weights for policy 0, policy_version 1579276 (0.0005) [2023-12-28 06:36:35,682][106226] Updated weights for policy 0, policy_version 1579286 (0.0006) [2023-12-28 06:36:35,818][106225] Updated weights for policy 1, policy_version 1582747 (0.0005) [2023-12-28 06:36:35,868][106225] Updated weights for policy 1, policy_version 1582757 (0.0005) [2023-12-28 06:36:35,924][106225] Updated weights for policy 1, policy_version 1582767 (0.0007) [2023-12-28 06:36:36,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 809615360. Throughput: 0: 9995.0, 1: 9670.1. Samples: 809623924. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:36,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.517')] [2023-12-28 06:36:36,316][106226] Updated weights for policy 0, policy_version 1579296 (0.0009) [2023-12-28 06:36:36,375][106226] Updated weights for policy 0, policy_version 1579306 (0.0009) [2023-12-28 06:36:36,434][106226] Updated weights for policy 0, policy_version 1579316 (0.0008) [2023-12-28 06:36:36,538][106225] Updated weights for policy 1, policy_version 1582777 (0.0007) [2023-12-28 06:36:36,603][106225] Updated weights for policy 1, policy_version 1582787 (0.0006) [2023-12-28 06:36:36,667][106225] Updated weights for policy 1, policy_version 1582797 (0.0009) [2023-12-28 06:36:36,725][106225] Updated weights for policy 1, policy_version 1582807 (0.0011) [2023-12-28 06:36:37,153][106226] Updated weights for policy 0, policy_version 1579326 (0.0010) [2023-12-28 06:36:37,210][106226] Updated weights for policy 0, policy_version 1579336 (0.0010) [2023-12-28 06:36:37,267][106226] Updated weights for policy 0, policy_version 1579346 (0.0010) [2023-12-28 06:36:37,358][106225] Updated weights for policy 1, policy_version 1582817 (0.0006) [2023-12-28 06:36:37,404][106225] Updated weights for policy 1, policy_version 1582827 (0.0006) [2023-12-28 06:36:37,463][106225] Updated weights for policy 1, policy_version 1582837 (0.0006) [2023-12-28 06:36:37,939][106226] Updated weights for policy 0, policy_version 1579356 (0.0010) [2023-12-28 06:36:37,997][106226] Updated weights for policy 0, policy_version 1579366 (0.0010) [2023-12-28 06:36:38,045][106225] Updated weights for policy 1, policy_version 1582847 (0.0006) [2023-12-28 06:36:38,058][106226] Updated weights for policy 0, policy_version 1579376 (0.0008) [2023-12-28 06:36:38,107][106225] Updated weights for policy 1, policy_version 1582857 (0.0005) [2023-12-28 06:36:38,170][106225] Updated weights for policy 1, policy_version 1582867 (0.0005) [2023-12-28 06:36:38,732][106225] Updated weights for policy 1, policy_version 1582877 (0.0007) [2023-12-28 06:36:38,792][106225] Updated weights for policy 1, policy_version 1582887 (0.0008) [2023-12-28 06:36:38,852][106225] Updated weights for policy 1, policy_version 1582897 (0.0008) [2023-12-28 06:36:38,903][106226] Updated weights for policy 0, policy_version 1579386 (0.0008) [2023-12-28 06:36:38,957][106226] Updated weights for policy 0, policy_version 1579396 (0.0008) [2023-12-28 06:36:39,012][106226] Updated weights for policy 0, policy_version 1579406 (0.0008) [2023-12-28 06:36:39,069][106226] Updated weights for policy 0, policy_version 1579416 (0.0010) [2023-12-28 06:36:39,582][106225] Updated weights for policy 1, policy_version 1582907 (0.0008) [2023-12-28 06:36:39,644][106225] Updated weights for policy 1, policy_version 1582917 (0.0009) [2023-12-28 06:36:39,698][106225] Updated weights for policy 1, policy_version 1582927 (0.0008) [2023-12-28 06:36:39,908][106226] Updated weights for policy 0, policy_version 1579426 (0.0009) [2023-12-28 06:36:39,981][106226] Updated weights for policy 0, policy_version 1579436 (0.0009) [2023-12-28 06:36:40,049][106226] Updated weights for policy 0, policy_version 1579446 (0.0009) [2023-12-28 06:36:40,479][106225] Updated weights for policy 1, policy_version 1582937 (0.0008) [2023-12-28 06:36:40,529][106225] Updated weights for policy 1, policy_version 1582947 (0.0009) [2023-12-28 06:36:40,583][106225] Updated weights for policy 1, policy_version 1582957 (0.0009) [2023-12-28 06:36:40,636][106225] Updated weights for policy 1, policy_version 1582968 (0.0010) [2023-12-28 06:36:40,701][106226] Updated weights for policy 0, policy_version 1579456 (0.0008) [2023-12-28 06:36:40,752][106226] Updated weights for policy 0, policy_version 1579466 (0.0008) [2023-12-28 06:36:40,808][106226] Updated weights for policy 0, policy_version 1579476 (0.0008) [2023-12-28 06:36:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 809713664. Throughput: 0: 9987.1, 1: 9804.8. Samples: 809686164. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:41,175][105115] Avg episode reward: [(0, '-4.720'), (1, '-4.538')] [2023-12-28 06:36:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001582968_405291008.pth... [2023-12-28 06:36:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001579480_404422656.pth... [2023-12-28 06:36:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001578328_404127744.pth [2023-12-28 06:36:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001581848_405004288.pth [2023-12-28 06:36:41,457][106225] Updated weights for policy 1, policy_version 1582978 (0.0009) [2023-12-28 06:36:41,512][106225] Updated weights for policy 1, policy_version 1582988 (0.0009) [2023-12-28 06:36:41,565][106225] Updated weights for policy 1, policy_version 1582998 (0.0009) [2023-12-28 06:36:41,605][106226] Updated weights for policy 0, policy_version 1579486 (0.0009) [2023-12-28 06:36:41,678][106226] Updated weights for policy 0, policy_version 1579496 (0.0009) [2023-12-28 06:36:41,749][106226] Updated weights for policy 0, policy_version 1579506 (0.0009) [2023-12-28 06:36:42,473][106225] Updated weights for policy 1, policy_version 1583008 (0.0006) [2023-12-28 06:36:42,541][106225] Updated weights for policy 1, policy_version 1583018 (0.0008) [2023-12-28 06:36:42,605][106225] Updated weights for policy 1, policy_version 1583028 (0.0009) [2023-12-28 06:36:42,615][106226] Updated weights for policy 0, policy_version 1579516 (0.0008) [2023-12-28 06:36:42,673][106226] Updated weights for policy 0, policy_version 1579526 (0.0007) [2023-12-28 06:36:42,734][106226] Updated weights for policy 0, policy_version 1579536 (0.0008) [2023-12-28 06:36:43,336][106226] Updated weights for policy 0, policy_version 1579546 (0.0007) [2023-12-28 06:36:43,350][106225] Updated weights for policy 1, policy_version 1583038 (0.0007) [2023-12-28 06:36:43,401][106226] Updated weights for policy 0, policy_version 1579556 (0.0007) [2023-12-28 06:36:43,407][106225] Updated weights for policy 1, policy_version 1583048 (0.0008) [2023-12-28 06:36:43,460][106225] Updated weights for policy 1, policy_version 1583058 (0.0008) [2023-12-28 06:36:43,462][106226] Updated weights for policy 0, policy_version 1579566 (0.0007) [2023-12-28 06:36:43,518][106226] Updated weights for policy 0, policy_version 1579576 (0.0007) [2023-12-28 06:36:44,144][106225] Updated weights for policy 1, policy_version 1583068 (0.0008) [2023-12-28 06:36:44,203][106225] Updated weights for policy 1, policy_version 1583078 (0.0007) [2023-12-28 06:36:44,235][106226] Updated weights for policy 0, policy_version 1579586 (0.0010) [2023-12-28 06:36:44,257][106225] Updated weights for policy 1, policy_version 1583088 (0.0010) [2023-12-28 06:36:44,291][106226] Updated weights for policy 0, policy_version 1579596 (0.0010) [2023-12-28 06:36:44,345][106226] Updated weights for policy 0, policy_version 1579606 (0.0009) [2023-12-28 06:36:44,964][106225] Updated weights for policy 1, policy_version 1583098 (0.0010) [2023-12-28 06:36:45,020][106225] Updated weights for policy 1, policy_version 1583108 (0.0008) [2023-12-28 06:36:45,057][106226] Updated weights for policy 0, policy_version 1579616 (0.0008) [2023-12-28 06:36:45,074][106225] Updated weights for policy 1, policy_version 1583118 (0.0007) [2023-12-28 06:36:45,118][106226] Updated weights for policy 0, policy_version 1579626 (0.0007) [2023-12-28 06:36:45,132][106225] Updated weights for policy 1, policy_version 1583128 (0.0008) [2023-12-28 06:36:45,182][106226] Updated weights for policy 0, policy_version 1579636 (0.0009) [2023-12-28 06:36:45,805][106226] Updated weights for policy 0, policy_version 1579646 (0.0007) [2023-12-28 06:36:45,834][106225] Updated weights for policy 1, policy_version 1583138 (0.0009) [2023-12-28 06:36:45,857][106226] Updated weights for policy 0, policy_version 1579656 (0.0005) [2023-12-28 06:36:45,880][106225] Updated weights for policy 1, policy_version 1583148 (0.0008) [2023-12-28 06:36:45,911][106226] Updated weights for policy 0, policy_version 1579666 (0.0007) [2023-12-28 06:36:45,926][106225] Updated weights for policy 1, policy_version 1583158 (0.0008) [2023-12-28 06:36:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 809811968. Throughput: 0: 9904.0, 1: 9713.5. Samples: 809797464. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:46,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-4.764')] [2023-12-28 06:36:46,579][106225] Updated weights for policy 1, policy_version 1583168 (0.0007) [2023-12-28 06:36:46,625][106225] Updated weights for policy 1, policy_version 1583178 (0.0010) [2023-12-28 06:36:46,642][106226] Updated weights for policy 0, policy_version 1579676 (0.0008) [2023-12-28 06:36:46,679][106225] Updated weights for policy 1, policy_version 1583188 (0.0010) [2023-12-28 06:36:46,696][106226] Updated weights for policy 0, policy_version 1579686 (0.0005) [2023-12-28 06:36:46,755][106226] Updated weights for policy 0, policy_version 1579696 (0.0009) [2023-12-28 06:36:47,283][106225] Updated weights for policy 1, policy_version 1583198 (0.0008) [2023-12-28 06:36:47,326][106225] Updated weights for policy 1, policy_version 1583208 (0.0007) [2023-12-28 06:36:47,380][106225] Updated weights for policy 1, policy_version 1583218 (0.0009) [2023-12-28 06:36:47,399][106226] Updated weights for policy 0, policy_version 1579706 (0.0009) [2023-12-28 06:36:47,457][106226] Updated weights for policy 0, policy_version 1579716 (0.0005) [2023-12-28 06:36:47,512][106226] Updated weights for policy 0, policy_version 1579726 (0.0006) [2023-12-28 06:36:47,559][106226] Updated weights for policy 0, policy_version 1579736 (0.0005) [2023-12-28 06:36:47,982][106225] Updated weights for policy 1, policy_version 1583228 (0.0009) [2023-12-28 06:36:48,039][106225] Updated weights for policy 1, policy_version 1583238 (0.0010) [2023-12-28 06:36:48,084][106225] Updated weights for policy 1, policy_version 1583248 (0.0007) [2023-12-28 06:36:48,152][106226] Updated weights for policy 0, policy_version 1579746 (0.0010) [2023-12-28 06:36:48,205][106226] Updated weights for policy 0, policy_version 1579756 (0.0010) [2023-12-28 06:36:48,261][106226] Updated weights for policy 0, policy_version 1579766 (0.0006) [2023-12-28 06:36:48,795][106225] Updated weights for policy 1, policy_version 1583258 (0.0006) [2023-12-28 06:36:48,849][106225] Updated weights for policy 1, policy_version 1583268 (0.0010) [2023-12-28 06:36:48,890][106226] Updated weights for policy 0, policy_version 1579776 (0.0007) [2023-12-28 06:36:48,903][106225] Updated weights for policy 1, policy_version 1583278 (0.0010) [2023-12-28 06:36:48,946][106226] Updated weights for policy 0, policy_version 1579786 (0.0007) [2023-12-28 06:36:48,970][106225] Updated weights for policy 1, policy_version 1583288 (0.0008) [2023-12-28 06:36:49,001][106226] Updated weights for policy 0, policy_version 1579796 (0.0006) [2023-12-28 06:36:49,679][106226] Updated weights for policy 0, policy_version 1579806 (0.0009) [2023-12-28 06:36:49,731][106226] Updated weights for policy 0, policy_version 1579816 (0.0006) [2023-12-28 06:36:49,733][106225] Updated weights for policy 1, policy_version 1583298 (0.0007) [2023-12-28 06:36:49,792][106225] Updated weights for policy 1, policy_version 1583308 (0.0006) [2023-12-28 06:36:49,794][106226] Updated weights for policy 0, policy_version 1579826 (0.0008) [2023-12-28 06:36:49,858][106225] Updated weights for policy 1, policy_version 1583318 (0.0008) [2023-12-28 06:36:50,574][106226] Updated weights for policy 0, policy_version 1579836 (0.0007) [2023-12-28 06:36:50,615][106225] Updated weights for policy 1, policy_version 1583328 (0.0008) [2023-12-28 06:36:50,637][106226] Updated weights for policy 0, policy_version 1579846 (0.0007) [2023-12-28 06:36:50,672][106225] Updated weights for policy 1, policy_version 1583338 (0.0007) [2023-12-28 06:36:50,686][106226] Updated weights for policy 0, policy_version 1579856 (0.0006) [2023-12-28 06:36:50,725][106225] Updated weights for policy 1, policy_version 1583348 (0.0008) [2023-12-28 06:36:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 809910272. Throughput: 0: 9853.6, 1: 9786.0. Samples: 809920260. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:51,175][105115] Avg episode reward: [(0, '-4.877'), (1, '-4.604')] [2023-12-28 06:36:51,443][106226] Updated weights for policy 0, policy_version 1579866 (0.0008) [2023-12-28 06:36:51,502][106225] Updated weights for policy 1, policy_version 1583358 (0.0007) [2023-12-28 06:36:51,502][106226] Updated weights for policy 0, policy_version 1579876 (0.0010) [2023-12-28 06:36:51,564][106225] Updated weights for policy 1, policy_version 1583368 (0.0005) [2023-12-28 06:36:51,567][106226] Updated weights for policy 0, policy_version 1579886 (0.0011) [2023-12-28 06:36:51,628][106226] Updated weights for policy 0, policy_version 1579896 (0.0012) [2023-12-28 06:36:51,629][106225] Updated weights for policy 1, policy_version 1583378 (0.0007) [2023-12-28 06:36:52,313][106225] Updated weights for policy 1, policy_version 1583388 (0.0009) [2023-12-28 06:36:52,371][106225] Updated weights for policy 1, policy_version 1583398 (0.0011) [2023-12-28 06:36:52,395][106226] Updated weights for policy 0, policy_version 1579906 (0.0007) [2023-12-28 06:36:52,439][106225] Updated weights for policy 1, policy_version 1583408 (0.0006) [2023-12-28 06:36:52,466][106226] Updated weights for policy 0, policy_version 1579916 (0.0008) [2023-12-28 06:36:52,533][106226] Updated weights for policy 0, policy_version 1579926 (0.0006) [2023-12-28 06:36:53,083][106225] Updated weights for policy 1, policy_version 1583418 (0.0006) [2023-12-28 06:36:53,149][106225] Updated weights for policy 1, policy_version 1583428 (0.0009) [2023-12-28 06:36:53,202][106225] Updated weights for policy 1, policy_version 1583438 (0.0009) [2023-12-28 06:36:53,231][106226] Updated weights for policy 0, policy_version 1579936 (0.0007) [2023-12-28 06:36:53,256][106225] Updated weights for policy 1, policy_version 1583448 (0.0008) [2023-12-28 06:36:53,293][106226] Updated weights for policy 0, policy_version 1579946 (0.0005) [2023-12-28 06:36:53,361][106226] Updated weights for policy 0, policy_version 1579956 (0.0005) [2023-12-28 06:36:53,967][106225] Updated weights for policy 1, policy_version 1583458 (0.0009) [2023-12-28 06:36:53,977][106226] Updated weights for policy 0, policy_version 1579966 (0.0005) [2023-12-28 06:36:54,020][106225] Updated weights for policy 1, policy_version 1583468 (0.0008) [2023-12-28 06:36:54,031][106226] Updated weights for policy 0, policy_version 1579976 (0.0005) [2023-12-28 06:36:54,070][106225] Updated weights for policy 1, policy_version 1583478 (0.0008) [2023-12-28 06:36:54,092][106226] Updated weights for policy 0, policy_version 1579986 (0.0007) [2023-12-28 06:36:54,785][106226] Updated weights for policy 0, policy_version 1579996 (0.0007) [2023-12-28 06:36:54,805][106225] Updated weights for policy 1, policy_version 1583488 (0.0006) [2023-12-28 06:36:54,843][106226] Updated weights for policy 0, policy_version 1580006 (0.0006) [2023-12-28 06:36:54,865][106225] Updated weights for policy 1, policy_version 1583498 (0.0007) [2023-12-28 06:36:54,901][106226] Updated weights for policy 0, policy_version 1580016 (0.0007) [2023-12-28 06:36:54,920][106225] Updated weights for policy 1, policy_version 1583508 (0.0009) [2023-12-28 06:36:55,491][106225] Updated weights for policy 1, policy_version 1583518 (0.0007) [2023-12-28 06:36:55,537][106225] Updated weights for policy 1, policy_version 1583528 (0.0005) [2023-12-28 06:36:55,586][106225] Updated weights for policy 1, policy_version 1583538 (0.0008) [2023-12-28 06:36:55,662][106226] Updated weights for policy 0, policy_version 1580026 (0.0010) [2023-12-28 06:36:55,725][106226] Updated weights for policy 0, policy_version 1580036 (0.0008) [2023-12-28 06:36:55,789][106226] Updated weights for policy 0, policy_version 1580046 (0.0009) [2023-12-28 06:36:55,842][106226] Updated weights for policy 0, policy_version 1580056 (0.0008) [2023-12-28 06:36:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 810008576. Throughput: 0: 9883.1, 1: 9738.1. Samples: 809979428. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:36:56,175][105115] Avg episode reward: [(0, '-4.852'), (1, '-4.892')] [2023-12-28 06:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001583544_405438464.pth... [2023-12-28 06:36:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001580056_404570112.pth... [2023-12-28 06:36:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001578904_404275200.pth [2023-12-28 06:36:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001582392_405143552.pth [2023-12-28 06:36:56,231][106225] Updated weights for policy 1, policy_version 1583548 (0.0007) [2023-12-28 06:36:56,285][106225] Updated weights for policy 1, policy_version 1583558 (0.0006) [2023-12-28 06:36:56,337][106225] Updated weights for policy 1, policy_version 1583568 (0.0006) [2023-12-28 06:36:56,563][106226] Updated weights for policy 0, policy_version 1580066 (0.0008) [2023-12-28 06:36:56,621][106226] Updated weights for policy 0, policy_version 1580076 (0.0009) [2023-12-28 06:36:56,679][106226] Updated weights for policy 0, policy_version 1580086 (0.0008) [2023-12-28 06:36:56,944][106225] Updated weights for policy 1, policy_version 1583578 (0.0005) [2023-12-28 06:36:56,999][106225] Updated weights for policy 1, policy_version 1583588 (0.0006) [2023-12-28 06:36:57,049][106225] Updated weights for policy 1, policy_version 1583598 (0.0007) [2023-12-28 06:36:57,103][106225] Updated weights for policy 1, policy_version 1583608 (0.0005) [2023-12-28 06:36:57,397][106226] Updated weights for policy 0, policy_version 1580096 (0.0008) [2023-12-28 06:36:57,455][106226] Updated weights for policy 0, policy_version 1580106 (0.0009) [2023-12-28 06:36:57,520][106226] Updated weights for policy 0, policy_version 1580116 (0.0008) [2023-12-28 06:36:57,672][106225] Updated weights for policy 1, policy_version 1583618 (0.0010) [2023-12-28 06:36:57,739][106225] Updated weights for policy 1, policy_version 1583628 (0.0010) [2023-12-28 06:36:57,796][106225] Updated weights for policy 1, policy_version 1583638 (0.0010) [2023-12-28 06:36:58,198][106226] Updated weights for policy 0, policy_version 1580126 (0.0008) [2023-12-28 06:36:58,263][106226] Updated weights for policy 0, policy_version 1580136 (0.0009) [2023-12-28 06:36:58,331][106226] Updated weights for policy 0, policy_version 1580146 (0.0008) [2023-12-28 06:36:58,535][106225] Updated weights for policy 1, policy_version 1583648 (0.0011) [2023-12-28 06:36:58,602][106225] Updated weights for policy 1, policy_version 1583658 (0.0011) [2023-12-28 06:36:58,669][106225] Updated weights for policy 1, policy_version 1583668 (0.0010) [2023-12-28 06:36:59,226][106226] Updated weights for policy 0, policy_version 1580156 (0.0010) [2023-12-28 06:36:59,297][106226] Updated weights for policy 0, policy_version 1580166 (0.0010) [2023-12-28 06:36:59,362][106226] Updated weights for policy 0, policy_version 1580176 (0.0009) [2023-12-28 06:36:59,503][106225] Updated weights for policy 1, policy_version 1583678 (0.0009) [2023-12-28 06:36:59,553][106225] Updated weights for policy 1, policy_version 1583688 (0.0007) [2023-12-28 06:36:59,602][106225] Updated weights for policy 1, policy_version 1583698 (0.0008) [2023-12-28 06:37:00,135][106226] Updated weights for policy 0, policy_version 1580186 (0.0008) [2023-12-28 06:37:00,194][106226] Updated weights for policy 0, policy_version 1580196 (0.0009) [2023-12-28 06:37:00,244][106226] Updated weights for policy 0, policy_version 1580206 (0.0008) [2023-12-28 06:37:00,302][106226] Updated weights for policy 0, policy_version 1580216 (0.0011) [2023-12-28 06:37:00,402][106225] Updated weights for policy 1, policy_version 1583708 (0.0008) [2023-12-28 06:37:00,451][106225] Updated weights for policy 1, policy_version 1583718 (0.0009) [2023-12-28 06:37:00,507][106225] Updated weights for policy 1, policy_version 1583728 (0.0008) [2023-12-28 06:37:00,919][106226] Updated weights for policy 0, policy_version 1580226 (0.0007) [2023-12-28 06:37:00,976][106226] Updated weights for policy 0, policy_version 1580236 (0.0006) [2023-12-28 06:37:01,048][106226] Updated weights for policy 0, policy_version 1580246 (0.0007) [2023-12-28 06:37:01,103][106225] Updated weights for policy 1, policy_version 1583738 (0.0007) [2023-12-28 06:37:01,171][106225] Updated weights for policy 1, policy_version 1583748 (0.0008) [2023-12-28 06:37:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 810106880. Throughput: 0: 9848.2, 1: 9834.0. Samples: 810096128. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:01,175][105115] Avg episode reward: [(0, '-4.981'), (1, '-4.436')] [2023-12-28 06:37:01,232][106225] Updated weights for policy 1, policy_version 1583758 (0.0006) [2023-12-28 06:37:01,302][106225] Updated weights for policy 1, policy_version 1583768 (0.0008) [2023-12-28 06:37:01,822][106226] Updated weights for policy 0, policy_version 1580256 (0.0010) [2023-12-28 06:37:01,878][106226] Updated weights for policy 0, policy_version 1580266 (0.0008) [2023-12-28 06:37:01,929][106226] Updated weights for policy 0, policy_version 1580276 (0.0008) [2023-12-28 06:37:01,952][106225] Updated weights for policy 1, policy_version 1583778 (0.0008) [2023-12-28 06:37:02,009][106225] Updated weights for policy 1, policy_version 1583788 (0.0008) [2023-12-28 06:37:02,076][106225] Updated weights for policy 1, policy_version 1583798 (0.0008) [2023-12-28 06:37:02,693][106226] Updated weights for policy 0, policy_version 1580286 (0.0008) [2023-12-28 06:37:02,717][106225] Updated weights for policy 1, policy_version 1583808 (0.0006) [2023-12-28 06:37:02,752][106226] Updated weights for policy 0, policy_version 1580296 (0.0008) [2023-12-28 06:37:02,776][106225] Updated weights for policy 1, policy_version 1583818 (0.0010) [2023-12-28 06:37:02,810][106226] Updated weights for policy 0, policy_version 1580306 (0.0006) [2023-12-28 06:37:02,832][106225] Updated weights for policy 1, policy_version 1583828 (0.0007) [2023-12-28 06:37:03,405][106226] Updated weights for policy 0, policy_version 1580316 (0.0006) [2023-12-28 06:37:03,454][106226] Updated weights for policy 0, policy_version 1580326 (0.0006) [2023-12-28 06:37:03,502][106226] Updated weights for policy 0, policy_version 1580336 (0.0005) [2023-12-28 06:37:03,583][106225] Updated weights for policy 1, policy_version 1583838 (0.0009) [2023-12-28 06:37:03,636][106225] Updated weights for policy 1, policy_version 1583848 (0.0008) [2023-12-28 06:37:03,685][106225] Updated weights for policy 1, policy_version 1583858 (0.0009) [2023-12-28 06:37:04,047][106226] Updated weights for policy 0, policy_version 1580346 (0.0005) [2023-12-28 06:37:04,112][106226] Updated weights for policy 0, policy_version 1580356 (0.0006) [2023-12-28 06:37:04,180][106226] Updated weights for policy 0, policy_version 1580366 (0.0009) [2023-12-28 06:37:04,242][106226] Updated weights for policy 0, policy_version 1580376 (0.0011) [2023-12-28 06:37:04,436][106225] Updated weights for policy 1, policy_version 1583869 (0.0008) [2023-12-28 06:37:04,493][106225] Updated weights for policy 1, policy_version 1583879 (0.0005) [2023-12-28 06:37:04,554][106225] Updated weights for policy 1, policy_version 1583889 (0.0007) [2023-12-28 06:37:04,796][106226] Updated weights for policy 0, policy_version 1580386 (0.0007) [2023-12-28 06:37:04,846][106226] Updated weights for policy 0, policy_version 1580396 (0.0007) [2023-12-28 06:37:04,897][106226] Updated weights for policy 0, policy_version 1580406 (0.0008) [2023-12-28 06:37:05,223][106225] Updated weights for policy 1, policy_version 1583899 (0.0008) [2023-12-28 06:37:05,286][106225] Updated weights for policy 1, policy_version 1583909 (0.0010) [2023-12-28 06:37:05,351][106225] Updated weights for policy 1, policy_version 1583919 (0.0010) [2023-12-28 06:37:05,579][106226] Updated weights for policy 0, policy_version 1580416 (0.0006) [2023-12-28 06:37:05,632][106226] Updated weights for policy 0, policy_version 1580427 (0.0008) [2023-12-28 06:37:05,680][106226] Updated weights for policy 0, policy_version 1580437 (0.0007) [2023-12-28 06:37:05,931][106225] Updated weights for policy 1, policy_version 1583929 (0.0006) [2023-12-28 06:37:05,994][106225] Updated weights for policy 1, policy_version 1583939 (0.0005) [2023-12-28 06:37:06,061][106225] Updated weights for policy 1, policy_version 1583949 (0.0005) [2023-12-28 06:37:06,126][106225] Updated weights for policy 1, policy_version 1583959 (0.0010) [2023-12-28 06:37:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 810213376. Throughput: 0: 9855.6, 1: 9916.7. Samples: 810219380. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:06,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-4.616')] [2023-12-28 06:37:06,492][106226] Updated weights for policy 0, policy_version 1580447 (0.0011) [2023-12-28 06:37:06,555][106226] Updated weights for policy 0, policy_version 1580457 (0.0010) [2023-12-28 06:37:06,619][106226] Updated weights for policy 0, policy_version 1580467 (0.0011) [2023-12-28 06:37:06,858][106225] Updated weights for policy 1, policy_version 1583969 (0.0010) [2023-12-28 06:37:06,917][106225] Updated weights for policy 1, policy_version 1583979 (0.0008) [2023-12-28 06:37:06,978][106225] Updated weights for policy 1, policy_version 1583989 (0.0005) [2023-12-28 06:37:07,307][106226] Updated weights for policy 0, policy_version 1580477 (0.0011) [2023-12-28 06:37:07,356][106226] Updated weights for policy 0, policy_version 1580487 (0.0007) [2023-12-28 06:37:07,411][106226] Updated weights for policy 0, policy_version 1580497 (0.0005) [2023-12-28 06:37:07,513][106225] Updated weights for policy 1, policy_version 1583999 (0.0007) [2023-12-28 06:37:07,566][106225] Updated weights for policy 1, policy_version 1584009 (0.0008) [2023-12-28 06:37:07,609][106225] Updated weights for policy 1, policy_version 1584019 (0.0007) [2023-12-28 06:37:08,090][106226] Updated weights for policy 0, policy_version 1580507 (0.0009) [2023-12-28 06:37:08,139][106226] Updated weights for policy 0, policy_version 1580517 (0.0009) [2023-12-28 06:37:08,195][106226] Updated weights for policy 0, policy_version 1580527 (0.0010) [2023-12-28 06:37:08,203][106225] Updated weights for policy 1, policy_version 1584029 (0.0006) [2023-12-28 06:37:08,254][106225] Updated weights for policy 1, policy_version 1584039 (0.0006) [2023-12-28 06:37:08,302][106225] Updated weights for policy 1, policy_version 1584049 (0.0008) [2023-12-28 06:37:08,922][106226] Updated weights for policy 0, policy_version 1580537 (0.0008) [2023-12-28 06:37:08,969][106226] Updated weights for policy 0, policy_version 1580547 (0.0011) [2023-12-28 06:37:09,016][106226] Updated weights for policy 0, policy_version 1580557 (0.0010) [2023-12-28 06:37:09,072][106226] Updated weights for policy 0, policy_version 1580567 (0.0010) [2023-12-28 06:37:09,081][106225] Updated weights for policy 1, policy_version 1584059 (0.0008) [2023-12-28 06:37:09,143][106225] Updated weights for policy 1, policy_version 1584069 (0.0005) [2023-12-28 06:37:09,208][106225] Updated weights for policy 1, policy_version 1584079 (0.0005) [2023-12-28 06:37:09,876][106226] Updated weights for policy 0, policy_version 1580577 (0.0009) [2023-12-28 06:37:09,904][106225] Updated weights for policy 1, policy_version 1584089 (0.0007) [2023-12-28 06:37:09,947][106226] Updated weights for policy 0, policy_version 1580587 (0.0008) [2023-12-28 06:37:09,966][106225] Updated weights for policy 1, policy_version 1584099 (0.0007) [2023-12-28 06:37:10,012][106226] Updated weights for policy 0, policy_version 1580597 (0.0008) [2023-12-28 06:37:10,030][106225] Updated weights for policy 1, policy_version 1584109 (0.0006) [2023-12-28 06:37:10,086][106225] Updated weights for policy 1, policy_version 1584119 (0.0007) [2023-12-28 06:37:10,693][106225] Updated weights for policy 1, policy_version 1584129 (0.0008) [2023-12-28 06:37:10,741][106225] Updated weights for policy 1, policy_version 1584139 (0.0008) [2023-12-28 06:37:10,784][106226] Updated weights for policy 0, policy_version 1580607 (0.0008) [2023-12-28 06:37:10,790][106225] Updated weights for policy 1, policy_version 1584149 (0.0005) [2023-12-28 06:37:10,832][106226] Updated weights for policy 0, policy_version 1580617 (0.0008) [2023-12-28 06:37:10,886][106226] Updated weights for policy 0, policy_version 1580627 (0.0009) [2023-12-28 06:37:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 810311680. Throughput: 0: 9859.4, 1: 9999.0. Samples: 810281204. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:11,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.667')] [2023-12-28 06:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001584152_405594112.pth... [2023-12-28 06:37:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001580632_404717568.pth... [2023-12-28 06:37:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001582968_405291008.pth [2023-12-28 06:37:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001579480_404422656.pth [2023-12-28 06:37:11,522][106225] Updated weights for policy 1, policy_version 1584159 (0.0008) [2023-12-28 06:37:11,588][106225] Updated weights for policy 1, policy_version 1584169 (0.0010) [2023-12-28 06:37:11,647][106226] Updated weights for policy 0, policy_version 1580637 (0.0008) [2023-12-28 06:37:11,662][106225] Updated weights for policy 1, policy_version 1584179 (0.0008) [2023-12-28 06:37:11,715][106226] Updated weights for policy 0, policy_version 1580647 (0.0007) [2023-12-28 06:37:11,779][106226] Updated weights for policy 0, policy_version 1580657 (0.0009) [2023-12-28 06:37:12,471][106225] Updated weights for policy 1, policy_version 1584189 (0.0008) [2023-12-28 06:37:12,519][106225] Updated weights for policy 1, policy_version 1584199 (0.0008) [2023-12-28 06:37:12,546][106226] Updated weights for policy 0, policy_version 1580667 (0.0011) [2023-12-28 06:37:12,575][106225] Updated weights for policy 1, policy_version 1584209 (0.0006) [2023-12-28 06:37:12,603][106226] Updated weights for policy 0, policy_version 1580677 (0.0010) [2023-12-28 06:37:12,663][106226] Updated weights for policy 0, policy_version 1580687 (0.0010) [2023-12-28 06:37:13,325][106225] Updated weights for policy 1, policy_version 1584219 (0.0009) [2023-12-28 06:37:13,359][106226] Updated weights for policy 0, policy_version 1580697 (0.0010) [2023-12-28 06:37:13,386][106225] Updated weights for policy 1, policy_version 1584229 (0.0009) [2023-12-28 06:37:13,413][106226] Updated weights for policy 0, policy_version 1580707 (0.0005) [2023-12-28 06:37:13,444][106225] Updated weights for policy 1, policy_version 1584239 (0.0006) [2023-12-28 06:37:13,471][106226] Updated weights for policy 0, policy_version 1580717 (0.0005) [2023-12-28 06:37:13,520][106226] Updated weights for policy 0, policy_version 1580727 (0.0005) [2023-12-28 06:37:14,084][106226] Updated weights for policy 0, policy_version 1580737 (0.0008) [2023-12-28 06:37:14,091][106225] Updated weights for policy 1, policy_version 1584249 (0.0005) [2023-12-28 06:37:14,141][106226] Updated weights for policy 0, policy_version 1580747 (0.0008) [2023-12-28 06:37:14,150][106225] Updated weights for policy 1, policy_version 1584259 (0.0005) [2023-12-28 06:37:14,204][106226] Updated weights for policy 0, policy_version 1580757 (0.0006) [2023-12-28 06:37:14,216][106225] Updated weights for policy 1, policy_version 1584269 (0.0008) [2023-12-28 06:37:14,277][106225] Updated weights for policy 1, policy_version 1584279 (0.0010) [2023-12-28 06:37:14,776][106226] Updated weights for policy 0, policy_version 1580767 (0.0009) [2023-12-28 06:37:14,836][106226] Updated weights for policy 0, policy_version 1580777 (0.0008) [2023-12-28 06:37:14,886][106226] Updated weights for policy 0, policy_version 1580787 (0.0006) [2023-12-28 06:37:15,068][106225] Updated weights for policy 1, policy_version 1584289 (0.0009) [2023-12-28 06:37:15,124][106225] Updated weights for policy 1, policy_version 1584299 (0.0008) [2023-12-28 06:37:15,184][106225] Updated weights for policy 1, policy_version 1584309 (0.0008) [2023-12-28 06:37:15,578][106226] Updated weights for policy 0, policy_version 1580797 (0.0007) [2023-12-28 06:37:15,635][106226] Updated weights for policy 0, policy_version 1580807 (0.0008) [2023-12-28 06:37:15,690][106226] Updated weights for policy 0, policy_version 1580817 (0.0008) [2023-12-28 06:37:15,897][106225] Updated weights for policy 1, policy_version 1584319 (0.0008) [2023-12-28 06:37:15,949][106225] Updated weights for policy 1, policy_version 1584329 (0.0008) [2023-12-28 06:37:16,000][106225] Updated weights for policy 1, policy_version 1584339 (0.0008) [2023-12-28 06:37:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 810409984. Throughput: 0: 9913.2, 1: 9977.7. Samples: 810398384. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:16,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.645')] [2023-12-28 06:37:16,431][106226] Updated weights for policy 0, policy_version 1580827 (0.0007) [2023-12-28 06:37:16,481][106226] Updated weights for policy 0, policy_version 1580837 (0.0007) [2023-12-28 06:37:16,530][106226] Updated weights for policy 0, policy_version 1580847 (0.0009) [2023-12-28 06:37:16,748][106225] Updated weights for policy 1, policy_version 1584349 (0.0008) [2023-12-28 06:37:16,797][106225] Updated weights for policy 1, policy_version 1584359 (0.0008) [2023-12-28 06:37:16,856][106225] Updated weights for policy 1, policy_version 1584369 (0.0008) [2023-12-28 06:37:17,224][106226] Updated weights for policy 0, policy_version 1580857 (0.0008) [2023-12-28 06:37:17,284][106226] Updated weights for policy 0, policy_version 1580867 (0.0008) [2023-12-28 06:37:17,344][106226] Updated weights for policy 0, policy_version 1580877 (0.0008) [2023-12-28 06:37:17,403][106226] Updated weights for policy 0, policy_version 1580887 (0.0009) [2023-12-28 06:37:17,598][106225] Updated weights for policy 1, policy_version 1584379 (0.0008) [2023-12-28 06:37:17,650][106225] Updated weights for policy 1, policy_version 1584389 (0.0008) [2023-12-28 06:37:17,701][106225] Updated weights for policy 1, policy_version 1584399 (0.0009) [2023-12-28 06:37:18,113][106226] Updated weights for policy 0, policy_version 1580897 (0.0008) [2023-12-28 06:37:18,168][106226] Updated weights for policy 0, policy_version 1580907 (0.0008) [2023-12-28 06:37:18,221][106226] Updated weights for policy 0, policy_version 1580917 (0.0008) [2023-12-28 06:37:18,455][106225] Updated weights for policy 1, policy_version 1584409 (0.0008) [2023-12-28 06:37:18,527][106225] Updated weights for policy 1, policy_version 1584419 (0.0008) [2023-12-28 06:37:18,592][106225] Updated weights for policy 1, policy_version 1584429 (0.0007) [2023-12-28 06:37:18,662][106225] Updated weights for policy 1, policy_version 1584439 (0.0007) [2023-12-28 06:37:18,949][106226] Updated weights for policy 0, policy_version 1580927 (0.0006) [2023-12-28 06:37:19,006][106226] Updated weights for policy 0, policy_version 1580937 (0.0005) [2023-12-28 06:37:19,065][106226] Updated weights for policy 0, policy_version 1580947 (0.0005) [2023-12-28 06:37:19,400][106225] Updated weights for policy 1, policy_version 1584449 (0.0008) [2023-12-28 06:37:19,466][106225] Updated weights for policy 1, policy_version 1584459 (0.0008) [2023-12-28 06:37:19,531][106225] Updated weights for policy 1, policy_version 1584469 (0.0009) [2023-12-28 06:37:19,786][106226] Updated weights for policy 0, policy_version 1580957 (0.0008) [2023-12-28 06:37:19,854][106226] Updated weights for policy 0, policy_version 1580967 (0.0008) [2023-12-28 06:37:19,918][106226] Updated weights for policy 0, policy_version 1580977 (0.0007) [2023-12-28 06:37:20,244][106225] Updated weights for policy 1, policy_version 1584479 (0.0009) [2023-12-28 06:37:20,305][106225] Updated weights for policy 1, policy_version 1584489 (0.0009) [2023-12-28 06:37:20,358][106225] Updated weights for policy 1, policy_version 1584499 (0.0009) [2023-12-28 06:37:20,573][106226] Updated weights for policy 0, policy_version 1580987 (0.0007) [2023-12-28 06:37:20,640][106226] Updated weights for policy 0, policy_version 1580997 (0.0008) [2023-12-28 06:37:20,707][106226] Updated weights for policy 0, policy_version 1581007 (0.0008) [2023-12-28 06:37:21,158][106225] Updated weights for policy 1, policy_version 1584509 (0.0008) [2023-12-28 06:37:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 810500096. Throughput: 0: 9813.6, 1: 9938.3. Samples: 810512760. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:21,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.563')] [2023-12-28 06:37:21,225][106225] Updated weights for policy 1, policy_version 1584519 (0.0008) [2023-12-28 06:37:21,294][106225] Updated weights for policy 1, policy_version 1584529 (0.0009) [2023-12-28 06:37:21,453][106226] Updated weights for policy 0, policy_version 1581017 (0.0009) [2023-12-28 06:37:21,501][106226] Updated weights for policy 0, policy_version 1581027 (0.0009) [2023-12-28 06:37:21,547][106226] Updated weights for policy 0, policy_version 1581037 (0.0008) [2023-12-28 06:37:21,600][106226] Updated weights for policy 0, policy_version 1581047 (0.0009) [2023-12-28 06:37:22,005][106225] Updated weights for policy 1, policy_version 1584539 (0.0009) [2023-12-28 06:37:22,061][106225] Updated weights for policy 1, policy_version 1584549 (0.0008) [2023-12-28 06:37:22,123][106225] Updated weights for policy 1, policy_version 1584559 (0.0007) [2023-12-28 06:37:22,404][106226] Updated weights for policy 0, policy_version 1581057 (0.0008) [2023-12-28 06:37:22,461][106226] Updated weights for policy 0, policy_version 1581067 (0.0008) [2023-12-28 06:37:22,511][106226] Updated weights for policy 0, policy_version 1581077 (0.0007) [2023-12-28 06:37:22,891][106225] Updated weights for policy 1, policy_version 1584569 (0.0009) [2023-12-28 06:37:22,950][106225] Updated weights for policy 1, policy_version 1584579 (0.0008) [2023-12-28 06:37:23,013][106225] Updated weights for policy 1, policy_version 1584589 (0.0008) [2023-12-28 06:37:23,080][106225] Updated weights for policy 1, policy_version 1584599 (0.0009) [2023-12-28 06:37:23,223][106226] Updated weights for policy 0, policy_version 1581087 (0.0007) [2023-12-28 06:37:23,278][106226] Updated weights for policy 0, policy_version 1581097 (0.0006) [2023-12-28 06:37:23,327][106226] Updated weights for policy 0, policy_version 1581107 (0.0009) [2023-12-28 06:37:23,804][106225] Updated weights for policy 1, policy_version 1584609 (0.0006) [2023-12-28 06:37:23,872][106225] Updated weights for policy 1, policy_version 1584619 (0.0006) [2023-12-28 06:37:23,932][106225] Updated weights for policy 1, policy_version 1584629 (0.0010) [2023-12-28 06:37:24,027][106226] Updated weights for policy 0, policy_version 1581117 (0.0007) [2023-12-28 06:37:24,080][106226] Updated weights for policy 0, policy_version 1581127 (0.0005) [2023-12-28 06:37:24,145][106226] Updated weights for policy 0, policy_version 1581137 (0.0008) [2023-12-28 06:37:24,532][106225] Updated weights for policy 1, policy_version 1584639 (0.0010) [2023-12-28 06:37:24,586][106225] Updated weights for policy 1, policy_version 1584649 (0.0010) [2023-12-28 06:37:24,646][106225] Updated weights for policy 1, policy_version 1584659 (0.0010) [2023-12-28 06:37:24,732][106226] Updated weights for policy 0, policy_version 1581147 (0.0009) [2023-12-28 06:37:24,785][106226] Updated weights for policy 0, policy_version 1581157 (0.0010) [2023-12-28 06:37:24,849][106226] Updated weights for policy 0, policy_version 1581167 (0.0010) [2023-12-28 06:37:25,377][106225] Updated weights for policy 1, policy_version 1584669 (0.0010) [2023-12-28 06:37:25,433][106225] Updated weights for policy 1, policy_version 1584679 (0.0010) [2023-12-28 06:37:25,499][106225] Updated weights for policy 1, policy_version 1584689 (0.0006) [2023-12-28 06:37:25,568][106226] Updated weights for policy 0, policy_version 1581177 (0.0009) [2023-12-28 06:37:25,617][106226] Updated weights for policy 0, policy_version 1581187 (0.0010) [2023-12-28 06:37:25,663][106226] Updated weights for policy 0, policy_version 1581197 (0.0010) [2023-12-28 06:37:25,713][106226] Updated weights for policy 0, policy_version 1581207 (0.0011) [2023-12-28 06:37:26,142][106225] Updated weights for policy 1, policy_version 1584699 (0.0006) [2023-12-28 06:37:26,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 810598400. Throughput: 0: 9831.9, 1: 9811.0. Samples: 810570092. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:26,175][105115] Avg episode reward: [(0, '-4.891'), (1, '-4.606')] [2023-12-28 06:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001581208_404865024.pth... [2023-12-28 06:37:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001580056_404570112.pth [2023-12-28 06:37:26,208][106225] Updated weights for policy 1, policy_version 1584709 (0.0008) [2023-12-28 06:37:26,272][106225] Updated weights for policy 1, policy_version 1584719 (0.0008) [2023-12-28 06:37:26,326][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001584728_405741568.pth... [2023-12-28 06:37:26,331][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001583544_405438464.pth [2023-12-28 06:37:26,464][106226] Updated weights for policy 0, policy_version 1581217 (0.0010) [2023-12-28 06:37:26,526][106226] Updated weights for policy 0, policy_version 1581227 (0.0010) [2023-12-28 06:37:26,582][106226] Updated weights for policy 0, policy_version 1581237 (0.0010) [2023-12-28 06:37:26,873][106225] Updated weights for policy 1, policy_version 1584729 (0.0008) [2023-12-28 06:37:26,937][106225] Updated weights for policy 1, policy_version 1584739 (0.0005) [2023-12-28 06:37:26,990][106225] Updated weights for policy 1, policy_version 1584749 (0.0005) [2023-12-28 06:37:27,049][106225] Updated weights for policy 1, policy_version 1584759 (0.0010) [2023-12-28 06:37:27,282][106226] Updated weights for policy 0, policy_version 1581247 (0.0010) [2023-12-28 06:37:27,337][106226] Updated weights for policy 0, policy_version 1581257 (0.0009) [2023-12-28 06:37:27,387][106226] Updated weights for policy 0, policy_version 1581267 (0.0010) [2023-12-28 06:37:27,718][106225] Updated weights for policy 1, policy_version 1584769 (0.0010) [2023-12-28 06:37:27,771][106225] Updated weights for policy 1, policy_version 1584779 (0.0011) [2023-12-28 06:37:27,825][106225] Updated weights for policy 1, policy_version 1584790 (0.0005) [2023-12-28 06:37:28,096][106226] Updated weights for policy 0, policy_version 1581277 (0.0010) [2023-12-28 06:37:28,154][106226] Updated weights for policy 0, policy_version 1581287 (0.0011) [2023-12-28 06:37:28,215][106226] Updated weights for policy 0, policy_version 1581297 (0.0011) [2023-12-28 06:37:28,541][106225] Updated weights for policy 1, policy_version 1584800 (0.0009) [2023-12-28 06:37:28,605][106225] Updated weights for policy 1, policy_version 1584810 (0.0007) [2023-12-28 06:37:28,666][106225] Updated weights for policy 1, policy_version 1584820 (0.0010) [2023-12-28 06:37:28,857][106226] Updated weights for policy 0, policy_version 1581307 (0.0009) [2023-12-28 06:37:28,912][106226] Updated weights for policy 0, policy_version 1581317 (0.0010) [2023-12-28 06:37:28,971][106226] Updated weights for policy 0, policy_version 1581327 (0.0009) [2023-12-28 06:37:29,323][106225] Updated weights for policy 1, policy_version 1584830 (0.0009) [2023-12-28 06:37:29,393][106225] Updated weights for policy 1, policy_version 1584840 (0.0010) [2023-12-28 06:37:29,450][106225] Updated weights for policy 1, policy_version 1584850 (0.0010) [2023-12-28 06:37:29,634][106226] Updated weights for policy 0, policy_version 1581337 (0.0010) [2023-12-28 06:37:29,696][106226] Updated weights for policy 0, policy_version 1581347 (0.0011) [2023-12-28 06:37:29,760][106226] Updated weights for policy 0, policy_version 1581357 (0.0010) [2023-12-28 06:37:29,826][106226] Updated weights for policy 0, policy_version 1581367 (0.0009) [2023-12-28 06:37:30,115][106225] Updated weights for policy 1, policy_version 1584860 (0.0009) [2023-12-28 06:37:30,181][106225] Updated weights for policy 1, policy_version 1584870 (0.0011) [2023-12-28 06:37:30,239][106225] Updated weights for policy 1, policy_version 1584880 (0.0010) [2023-12-28 06:37:30,581][106226] Updated weights for policy 0, policy_version 1581377 (0.0009) [2023-12-28 06:37:30,631][106226] Updated weights for policy 0, policy_version 1581387 (0.0009) [2023-12-28 06:37:30,680][106226] Updated weights for policy 0, policy_version 1581397 (0.0009) [2023-12-28 06:37:30,842][106225] Updated weights for policy 1, policy_version 1584890 (0.0010) [2023-12-28 06:37:30,900][106225] Updated weights for policy 1, policy_version 1584900 (0.0005) [2023-12-28 06:37:30,952][106225] Updated weights for policy 1, policy_version 1584910 (0.0010) [2023-12-28 06:37:31,001][106225] Updated weights for policy 1, policy_version 1584920 (0.0010) [2023-12-28 06:37:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 810704896. Throughput: 0: 9911.8, 1: 9980.7. Samples: 810692628. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:31,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.743')] [2023-12-28 06:37:31,412][106226] Updated weights for policy 0, policy_version 1581407 (0.0008) [2023-12-28 06:37:31,475][106226] Updated weights for policy 0, policy_version 1581417 (0.0009) [2023-12-28 06:37:31,543][106226] Updated weights for policy 0, policy_version 1581427 (0.0006) [2023-12-28 06:37:31,706][106225] Updated weights for policy 1, policy_version 1584930 (0.0006) [2023-12-28 06:37:31,779][106225] Updated weights for policy 1, policy_version 1584940 (0.0008) [2023-12-28 06:37:31,840][106225] Updated weights for policy 1, policy_version 1584950 (0.0007) [2023-12-28 06:37:32,255][106226] Updated weights for policy 0, policy_version 1581437 (0.0008) [2023-12-28 06:37:32,319][106226] Updated weights for policy 0, policy_version 1581447 (0.0008) [2023-12-28 06:37:32,384][106226] Updated weights for policy 0, policy_version 1581457 (0.0009) [2023-12-28 06:37:32,491][106225] Updated weights for policy 1, policy_version 1584960 (0.0007) [2023-12-28 06:37:32,552][106225] Updated weights for policy 1, policy_version 1584970 (0.0008) [2023-12-28 06:37:32,617][106225] Updated weights for policy 1, policy_version 1584980 (0.0008) [2023-12-28 06:37:33,035][106226] Updated weights for policy 0, policy_version 1581467 (0.0009) [2023-12-28 06:37:33,088][106226] Updated weights for policy 0, policy_version 1581478 (0.0008) [2023-12-28 06:37:33,141][106226] Updated weights for policy 0, policy_version 1581488 (0.0005) [2023-12-28 06:37:33,257][106225] Updated weights for policy 1, policy_version 1584990 (0.0005) [2023-12-28 06:37:33,323][106225] Updated weights for policy 1, policy_version 1585000 (0.0005) [2023-12-28 06:37:33,390][106225] Updated weights for policy 1, policy_version 1585010 (0.0005) [2023-12-28 06:37:33,784][106226] Updated weights for policy 0, policy_version 1581498 (0.0006) [2023-12-28 06:37:33,840][106226] Updated weights for policy 0, policy_version 1581508 (0.0010) [2023-12-28 06:37:33,901][106226] Updated weights for policy 0, policy_version 1581518 (0.0010) [2023-12-28 06:37:33,907][106225] Updated weights for policy 1, policy_version 1585020 (0.0005) [2023-12-28 06:37:33,953][106225] Updated weights for policy 1, policy_version 1585030 (0.0005) [2023-12-28 06:37:33,958][106226] Updated weights for policy 0, policy_version 1581528 (0.0010) [2023-12-28 06:37:33,998][106225] Updated weights for policy 1, policy_version 1585040 (0.0008) [2023-12-28 06:37:34,675][106225] Updated weights for policy 1, policy_version 1585050 (0.0007) [2023-12-28 06:37:34,700][106226] Updated weights for policy 0, policy_version 1581538 (0.0008) [2023-12-28 06:37:34,737][106225] Updated weights for policy 1, policy_version 1585060 (0.0006) [2023-12-28 06:37:34,759][106226] Updated weights for policy 0, policy_version 1581548 (0.0007) [2023-12-28 06:37:34,796][106225] Updated weights for policy 1, policy_version 1585070 (0.0006) [2023-12-28 06:37:34,821][106226] Updated weights for policy 0, policy_version 1581558 (0.0007) [2023-12-28 06:37:34,853][106225] Updated weights for policy 1, policy_version 1585080 (0.0006) [2023-12-28 06:37:35,516][106226] Updated weights for policy 0, policy_version 1581568 (0.0007) [2023-12-28 06:37:35,552][106225] Updated weights for policy 1, policy_version 1585090 (0.0008) [2023-12-28 06:37:35,560][106226] Updated weights for policy 0, policy_version 1581578 (0.0007) [2023-12-28 06:37:35,607][106226] Updated weights for policy 0, policy_version 1581588 (0.0007) [2023-12-28 06:37:35,611][106225] Updated weights for policy 1, policy_version 1585100 (0.0008) [2023-12-28 06:37:35,668][106225] Updated weights for policy 1, policy_version 1585110 (0.0008) [2023-12-28 06:37:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 810803200. Throughput: 0: 9857.0, 1: 10020.6. Samples: 810814748. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:36,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-4.605')] [2023-12-28 06:37:36,329][106226] Updated weights for policy 0, policy_version 1581598 (0.0009) [2023-12-28 06:37:36,397][106226] Updated weights for policy 0, policy_version 1581608 (0.0009) [2023-12-28 06:37:36,404][106225] Updated weights for policy 1, policy_version 1585120 (0.0007) [2023-12-28 06:37:36,455][106225] Updated weights for policy 1, policy_version 1585130 (0.0008) [2023-12-28 06:37:36,462][106226] Updated weights for policy 0, policy_version 1581618 (0.0009) [2023-12-28 06:37:36,516][106225] Updated weights for policy 1, policy_version 1585140 (0.0009) [2023-12-28 06:37:37,189][106226] Updated weights for policy 0, policy_version 1581628 (0.0008) [2023-12-28 06:37:37,236][106226] Updated weights for policy 0, policy_version 1581638 (0.0011) [2023-12-28 06:37:37,258][106225] Updated weights for policy 1, policy_version 1585150 (0.0007) [2023-12-28 06:37:37,294][106226] Updated weights for policy 0, policy_version 1581648 (0.0011) [2023-12-28 06:37:37,309][106225] Updated weights for policy 1, policy_version 1585160 (0.0006) [2023-12-28 06:37:37,358][106225] Updated weights for policy 1, policy_version 1585170 (0.0007) [2023-12-28 06:37:38,013][106226] Updated weights for policy 0, policy_version 1581658 (0.0009) [2023-12-28 06:37:38,073][106226] Updated weights for policy 0, policy_version 1581668 (0.0007) [2023-12-28 06:37:38,133][106226] Updated weights for policy 0, policy_version 1581678 (0.0010) [2023-12-28 06:37:38,135][106225] Updated weights for policy 1, policy_version 1585180 (0.0007) [2023-12-28 06:37:38,181][106225] Updated weights for policy 1, policy_version 1585190 (0.0007) [2023-12-28 06:37:38,191][106226] Updated weights for policy 0, policy_version 1581688 (0.0011) [2023-12-28 06:37:38,234][106225] Updated weights for policy 1, policy_version 1585200 (0.0007) [2023-12-28 06:37:38,917][106226] Updated weights for policy 0, policy_version 1581698 (0.0011) [2023-12-28 06:37:38,977][106226] Updated weights for policy 0, policy_version 1581708 (0.0011) [2023-12-28 06:37:38,991][106225] Updated weights for policy 1, policy_version 1585210 (0.0007) [2023-12-28 06:37:39,040][106226] Updated weights for policy 0, policy_version 1581718 (0.0011) [2023-12-28 06:37:39,041][106225] Updated weights for policy 1, policy_version 1585220 (0.0008) [2023-12-28 06:37:39,087][106225] Updated weights for policy 1, policy_version 1585230 (0.0008) [2023-12-28 06:37:39,133][106225] Updated weights for policy 1, policy_version 1585240 (0.0008) [2023-12-28 06:37:39,777][106226] Updated weights for policy 0, policy_version 1581728 (0.0011) [2023-12-28 06:37:39,844][106226] Updated weights for policy 0, policy_version 1581738 (0.0011) [2023-12-28 06:37:39,909][106226] Updated weights for policy 0, policy_version 1581748 (0.0011) [2023-12-28 06:37:39,957][106225] Updated weights for policy 1, policy_version 1585250 (0.0008) [2023-12-28 06:37:40,024][106225] Updated weights for policy 1, policy_version 1585260 (0.0008) [2023-12-28 06:37:40,079][106225] Updated weights for policy 1, policy_version 1585270 (0.0009) [2023-12-28 06:37:40,649][106226] Updated weights for policy 0, policy_version 1581758 (0.0009) [2023-12-28 06:37:40,698][106226] Updated weights for policy 0, policy_version 1581768 (0.0005) [2023-12-28 06:37:40,762][106226] Updated weights for policy 0, policy_version 1581778 (0.0005) [2023-12-28 06:37:40,800][106225] Updated weights for policy 1, policy_version 1585280 (0.0006) [2023-12-28 06:37:40,859][106225] Updated weights for policy 1, policy_version 1585290 (0.0005) [2023-12-28 06:37:40,912][106225] Updated weights for policy 1, policy_version 1585300 (0.0006) [2023-12-28 06:37:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 810901504. Throughput: 0: 9838.5, 1: 9984.3. Samples: 810871452. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:41,175][105115] Avg episode reward: [(0, '-4.765'), (1, '-4.810')] [2023-12-28 06:37:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001585304_405889024.pth... [2023-12-28 06:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001581784_405012480.pth... [2023-12-28 06:37:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001584152_405594112.pth [2023-12-28 06:37:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001580632_404717568.pth [2023-12-28 06:37:41,450][106226] Updated weights for policy 0, policy_version 1581788 (0.0007) [2023-12-28 06:37:41,512][106226] Updated weights for policy 0, policy_version 1581798 (0.0009) [2023-12-28 06:37:41,570][106225] Updated weights for policy 1, policy_version 1585310 (0.0008) [2023-12-28 06:37:41,570][106226] Updated weights for policy 0, policy_version 1581808 (0.0009) [2023-12-28 06:37:41,638][106225] Updated weights for policy 1, policy_version 1585320 (0.0008) [2023-12-28 06:37:41,711][106225] Updated weights for policy 1, policy_version 1585330 (0.0009) [2023-12-28 06:37:42,313][106226] Updated weights for policy 0, policy_version 1581818 (0.0009) [2023-12-28 06:37:42,389][106226] Updated weights for policy 0, policy_version 1581828 (0.0007) [2023-12-28 06:37:42,403][106225] Updated weights for policy 1, policy_version 1585340 (0.0008) [2023-12-28 06:37:42,455][106226] Updated weights for policy 0, policy_version 1581838 (0.0007) [2023-12-28 06:37:42,466][106225] Updated weights for policy 1, policy_version 1585350 (0.0006) [2023-12-28 06:37:42,517][106226] Updated weights for policy 0, policy_version 1581848 (0.0008) [2023-12-28 06:37:42,527][106225] Updated weights for policy 1, policy_version 1585360 (0.0006) [2023-12-28 06:37:43,221][106225] Updated weights for policy 1, policy_version 1585370 (0.0006) [2023-12-28 06:37:43,246][106226] Updated weights for policy 0, policy_version 1581858 (0.0011) [2023-12-28 06:37:43,276][106225] Updated weights for policy 1, policy_version 1585380 (0.0006) [2023-12-28 06:37:43,300][106226] Updated weights for policy 0, policy_version 1581868 (0.0011) [2023-12-28 06:37:43,337][106225] Updated weights for policy 1, policy_version 1585390 (0.0006) [2023-12-28 06:37:43,369][106226] Updated weights for policy 0, policy_version 1581878 (0.0011) [2023-12-28 06:37:43,392][106225] Updated weights for policy 1, policy_version 1585400 (0.0006) [2023-12-28 06:37:43,987][106226] Updated weights for policy 0, policy_version 1581888 (0.0009) [2023-12-28 06:37:44,048][106226] Updated weights for policy 0, policy_version 1581898 (0.0006) [2023-12-28 06:37:44,105][106226] Updated weights for policy 0, policy_version 1581908 (0.0006) [2023-12-28 06:37:44,146][106225] Updated weights for policy 1, policy_version 1585410 (0.0006) [2023-12-28 06:37:44,201][106225] Updated weights for policy 1, policy_version 1585420 (0.0007) [2023-12-28 06:37:44,254][106225] Updated weights for policy 1, policy_version 1585430 (0.0007) [2023-12-28 06:37:44,778][106226] Updated weights for policy 0, policy_version 1581918 (0.0008) [2023-12-28 06:37:44,850][106226] Updated weights for policy 0, policy_version 1581928 (0.0010) [2023-12-28 06:37:44,915][106226] Updated weights for policy 0, policy_version 1581938 (0.0011) [2023-12-28 06:37:45,027][106225] Updated weights for policy 1, policy_version 1585440 (0.0010) [2023-12-28 06:37:45,095][106225] Updated weights for policy 1, policy_version 1585450 (0.0011) [2023-12-28 06:37:45,147][106225] Updated weights for policy 1, policy_version 1585460 (0.0010) [2023-12-28 06:37:45,631][106226] Updated weights for policy 0, policy_version 1581948 (0.0011) [2023-12-28 06:37:45,691][106226] Updated weights for policy 0, policy_version 1581958 (0.0011) [2023-12-28 06:37:45,751][106226] Updated weights for policy 0, policy_version 1581968 (0.0011) [2023-12-28 06:37:45,856][106225] Updated weights for policy 1, policy_version 1585470 (0.0009) [2023-12-28 06:37:45,906][106225] Updated weights for policy 1, policy_version 1585480 (0.0008) [2023-12-28 06:37:45,955][106225] Updated weights for policy 1, policy_version 1585490 (0.0008) [2023-12-28 06:37:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 810999808. Throughput: 0: 9895.5, 1: 9915.9. Samples: 810987640. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:46,175][105115] Avg episode reward: [(0, '-4.805'), (1, '-4.987')] [2023-12-28 06:37:46,392][106226] Updated weights for policy 0, policy_version 1581978 (0.0011) [2023-12-28 06:37:46,446][106226] Updated weights for policy 0, policy_version 1581988 (0.0010) [2023-12-28 06:37:46,513][106226] Updated weights for policy 0, policy_version 1581998 (0.0011) [2023-12-28 06:37:46,578][106226] Updated weights for policy 0, policy_version 1582008 (0.0011) [2023-12-28 06:37:46,585][106225] Updated weights for policy 1, policy_version 1585500 (0.0007) [2023-12-28 06:37:46,642][106225] Updated weights for policy 1, policy_version 1585510 (0.0008) [2023-12-28 06:37:46,699][106225] Updated weights for policy 1, policy_version 1585520 (0.0007) [2023-12-28 06:37:47,280][106226] Updated weights for policy 0, policy_version 1582018 (0.0011) [2023-12-28 06:37:47,340][106226] Updated weights for policy 0, policy_version 1582028 (0.0010) [2023-12-28 06:37:47,399][106226] Updated weights for policy 0, policy_version 1582038 (0.0010) [2023-12-28 06:37:47,407][106225] Updated weights for policy 1, policy_version 1585530 (0.0007) [2023-12-28 06:37:47,466][106225] Updated weights for policy 1, policy_version 1585540 (0.0009) [2023-12-28 06:37:47,522][106225] Updated weights for policy 1, policy_version 1585550 (0.0010) [2023-12-28 06:37:47,582][106225] Updated weights for policy 1, policy_version 1585560 (0.0010) [2023-12-28 06:37:48,133][106226] Updated weights for policy 0, policy_version 1582048 (0.0008) [2023-12-28 06:37:48,182][106226] Updated weights for policy 0, policy_version 1582058 (0.0008) [2023-12-28 06:37:48,230][106225] Updated weights for policy 1, policy_version 1585570 (0.0010) [2023-12-28 06:37:48,240][106226] Updated weights for policy 0, policy_version 1582068 (0.0005) [2023-12-28 06:37:48,287][106225] Updated weights for policy 1, policy_version 1585580 (0.0009) [2023-12-28 06:37:48,348][106225] Updated weights for policy 1, policy_version 1585590 (0.0010) [2023-12-28 06:37:49,000][106225] Updated weights for policy 1, policy_version 1585600 (0.0010) [2023-12-28 06:37:49,023][106226] Updated weights for policy 0, policy_version 1582078 (0.0007) [2023-12-28 06:37:49,060][106225] Updated weights for policy 1, policy_version 1585610 (0.0010) [2023-12-28 06:37:49,073][106226] Updated weights for policy 0, policy_version 1582088 (0.0005) [2023-12-28 06:37:49,107][106225] Updated weights for policy 1, policy_version 1585620 (0.0010) [2023-12-28 06:37:49,121][106226] Updated weights for policy 0, policy_version 1582098 (0.0005) [2023-12-28 06:37:49,846][106226] Updated weights for policy 0, policy_version 1582108 (0.0007) [2023-12-28 06:37:49,894][106225] Updated weights for policy 1, policy_version 1585630 (0.0010) [2023-12-28 06:37:49,912][106226] Updated weights for policy 0, policy_version 1582118 (0.0008) [2023-12-28 06:37:49,967][106225] Updated weights for policy 1, policy_version 1585640 (0.0009) [2023-12-28 06:37:49,980][106226] Updated weights for policy 0, policy_version 1582128 (0.0010) [2023-12-28 06:37:50,031][106225] Updated weights for policy 1, policy_version 1585650 (0.0009) [2023-12-28 06:37:50,669][106226] Updated weights for policy 0, policy_version 1582138 (0.0010) [2023-12-28 06:37:50,728][106225] Updated weights for policy 1, policy_version 1585660 (0.0009) [2023-12-28 06:37:50,732][106226] Updated weights for policy 0, policy_version 1582148 (0.0011) [2023-12-28 06:37:50,789][106225] Updated weights for policy 1, policy_version 1585670 (0.0010) [2023-12-28 06:37:50,796][106226] Updated weights for policy 0, policy_version 1582158 (0.0011) [2023-12-28 06:37:50,843][106225] Updated weights for policy 1, policy_version 1585680 (0.0010) [2023-12-28 06:37:50,857][106226] Updated weights for policy 0, policy_version 1582168 (0.0010) [2023-12-28 06:37:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 811098112. Throughput: 0: 9808.0, 1: 9894.6. Samples: 811106004. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:51,176][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.516')] [2023-12-28 06:37:51,559][106226] Updated weights for policy 0, policy_version 1582178 (0.0010) [2023-12-28 06:37:51,599][106225] Updated weights for policy 1, policy_version 1585690 (0.0010) [2023-12-28 06:37:51,622][106226] Updated weights for policy 0, policy_version 1582188 (0.0010) [2023-12-28 06:37:51,663][106225] Updated weights for policy 1, policy_version 1585700 (0.0008) [2023-12-28 06:37:51,683][106226] Updated weights for policy 0, policy_version 1582198 (0.0011) [2023-12-28 06:37:51,724][106225] Updated weights for policy 1, policy_version 1585710 (0.0009) [2023-12-28 06:37:51,794][106225] Updated weights for policy 1, policy_version 1585720 (0.0009) [2023-12-28 06:37:52,420][106225] Updated weights for policy 1, policy_version 1585730 (0.0010) [2023-12-28 06:37:52,461][106226] Updated weights for policy 0, policy_version 1582208 (0.0007) [2023-12-28 06:37:52,478][106225] Updated weights for policy 1, policy_version 1585740 (0.0010) [2023-12-28 06:37:52,512][106226] Updated weights for policy 0, policy_version 1582218 (0.0006) [2023-12-28 06:37:52,526][106225] Updated weights for policy 1, policy_version 1585750 (0.0009) [2023-12-28 06:37:52,564][106226] Updated weights for policy 0, policy_version 1582228 (0.0008) [2023-12-28 06:37:53,095][106225] Updated weights for policy 1, policy_version 1585760 (0.0005) [2023-12-28 06:37:53,146][106225] Updated weights for policy 1, policy_version 1585770 (0.0005) [2023-12-28 06:37:53,195][106225] Updated weights for policy 1, policy_version 1585780 (0.0005) [2023-12-28 06:37:53,351][106226] Updated weights for policy 0, policy_version 1582238 (0.0008) [2023-12-28 06:37:53,402][106226] Updated weights for policy 0, policy_version 1582248 (0.0005) [2023-12-28 06:37:53,453][106226] Updated weights for policy 0, policy_version 1582258 (0.0006) [2023-12-28 06:37:53,770][106225] Updated weights for policy 1, policy_version 1585790 (0.0006) [2023-12-28 06:37:53,836][106225] Updated weights for policy 1, policy_version 1585800 (0.0011) [2023-12-28 06:37:53,899][106225] Updated weights for policy 1, policy_version 1585810 (0.0008) [2023-12-28 06:37:54,004][106226] Updated weights for policy 0, policy_version 1582268 (0.0005) [2023-12-28 06:37:54,059][106226] Updated weights for policy 0, policy_version 1582278 (0.0005) [2023-12-28 06:37:54,118][106226] Updated weights for policy 0, policy_version 1582288 (0.0006) [2023-12-28 06:37:54,549][106225] Updated weights for policy 1, policy_version 1585820 (0.0007) [2023-12-28 06:37:54,608][106225] Updated weights for policy 1, policy_version 1585830 (0.0010) [2023-12-28 06:37:54,668][106225] Updated weights for policy 1, policy_version 1585840 (0.0010) [2023-12-28 06:37:54,725][106226] Updated weights for policy 0, policy_version 1582298 (0.0006) [2023-12-28 06:37:54,786][106226] Updated weights for policy 0, policy_version 1582308 (0.0008) [2023-12-28 06:37:54,845][106226] Updated weights for policy 0, policy_version 1582318 (0.0008) [2023-12-28 06:37:54,895][106226] Updated weights for policy 0, policy_version 1582328 (0.0008) [2023-12-28 06:37:55,406][106225] Updated weights for policy 1, policy_version 1585850 (0.0010) [2023-12-28 06:37:55,467][106225] Updated weights for policy 1, policy_version 1585860 (0.0005) [2023-12-28 06:37:55,529][106225] Updated weights for policy 1, policy_version 1585870 (0.0005) [2023-12-28 06:37:55,596][106225] Updated weights for policy 1, policy_version 1585880 (0.0006) [2023-12-28 06:37:55,699][106226] Updated weights for policy 0, policy_version 1582338 (0.0011) [2023-12-28 06:37:55,756][106226] Updated weights for policy 0, policy_version 1582348 (0.0011) [2023-12-28 06:37:55,817][106226] Updated weights for policy 0, policy_version 1582358 (0.0008) [2023-12-28 06:37:56,145][106225] Updated weights for policy 1, policy_version 1585890 (0.0005) [2023-12-28 06:37:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 811196416. Throughput: 0: 9806.8, 1: 9895.2. Samples: 811167796. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:37:56,175][105115] Avg episode reward: [(0, '-4.742'), (1, '-4.546')] [2023-12-28 06:37:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001582360_405159936.pth... [2023-12-28 06:37:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001581208_404865024.pth [2023-12-28 06:37:56,198][106225] Updated weights for policy 1, policy_version 1585900 (0.0005) [2023-12-28 06:37:56,248][106225] Updated weights for policy 1, policy_version 1585910 (0.0006) [2023-12-28 06:37:56,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001585912_406044672.pth... [2023-12-28 06:37:56,258][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001584728_405741568.pth [2023-12-28 06:37:56,384][106226] Updated weights for policy 0, policy_version 1582368 (0.0006) [2023-12-28 06:37:56,440][106226] Updated weights for policy 0, policy_version 1582378 (0.0005) [2023-12-28 06:37:56,496][106226] Updated weights for policy 0, policy_version 1582388 (0.0005) [2023-12-28 06:37:56,868][106225] Updated weights for policy 1, policy_version 1585920 (0.0008) [2023-12-28 06:37:56,918][106225] Updated weights for policy 1, policy_version 1585930 (0.0008) [2023-12-28 06:37:56,966][106225] Updated weights for policy 1, policy_version 1585940 (0.0007) [2023-12-28 06:37:57,123][106226] Updated weights for policy 0, policy_version 1582398 (0.0008) [2023-12-28 06:37:57,172][106226] Updated weights for policy 0, policy_version 1582408 (0.0010) [2023-12-28 06:37:57,231][106226] Updated weights for policy 0, policy_version 1582418 (0.0010) [2023-12-28 06:37:57,710][106225] Updated weights for policy 1, policy_version 1585950 (0.0008) [2023-12-28 06:37:57,768][106225] Updated weights for policy 1, policy_version 1585960 (0.0009) [2023-12-28 06:37:57,820][106225] Updated weights for policy 1, policy_version 1585970 (0.0007) [2023-12-28 06:37:57,858][106226] Updated weights for policy 0, policy_version 1582428 (0.0008) [2023-12-28 06:37:57,926][106226] Updated weights for policy 0, policy_version 1582438 (0.0005) [2023-12-28 06:37:57,982][106226] Updated weights for policy 0, policy_version 1582448 (0.0007) [2023-12-28 06:37:58,626][106226] Updated weights for policy 0, policy_version 1582458 (0.0006) [2023-12-28 06:37:58,691][106226] Updated weights for policy 0, policy_version 1582468 (0.0011) [2023-12-28 06:37:58,708][106225] Updated weights for policy 1, policy_version 1585980 (0.0008) [2023-12-28 06:37:58,758][106226] Updated weights for policy 0, policy_version 1582478 (0.0009) [2023-12-28 06:37:58,773][106225] Updated weights for policy 1, policy_version 1585990 (0.0009) [2023-12-28 06:37:58,828][106226] Updated weights for policy 0, policy_version 1582488 (0.0009) [2023-12-28 06:37:58,842][106225] Updated weights for policy 1, policy_version 1586000 (0.0008) [2023-12-28 06:37:59,692][106226] Updated weights for policy 0, policy_version 1582498 (0.0009) [2023-12-28 06:37:59,753][106225] Updated weights for policy 1, policy_version 1586010 (0.0008) [2023-12-28 06:37:59,754][106226] Updated weights for policy 0, policy_version 1582508 (0.0008) [2023-12-28 06:37:59,809][106225] Updated weights for policy 1, policy_version 1586020 (0.0009) [2023-12-28 06:37:59,816][106226] Updated weights for policy 0, policy_version 1582518 (0.0008) [2023-12-28 06:37:59,876][106225] Updated weights for policy 1, policy_version 1586030 (0.0009) [2023-12-28 06:37:59,935][106225] Updated weights for policy 1, policy_version 1586040 (0.0010) [2023-12-28 06:38:00,539][106226] Updated weights for policy 0, policy_version 1582528 (0.0009) [2023-12-28 06:38:00,597][106226] Updated weights for policy 0, policy_version 1582538 (0.0010) [2023-12-28 06:38:00,648][106225] Updated weights for policy 1, policy_version 1586050 (0.0010) [2023-12-28 06:38:00,657][106226] Updated weights for policy 0, policy_version 1582548 (0.0010) [2023-12-28 06:38:00,707][106225] Updated weights for policy 1, policy_version 1586060 (0.0010) [2023-12-28 06:38:00,763][106225] Updated weights for policy 1, policy_version 1586070 (0.0006) [2023-12-28 06:38:01,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 811294720. Throughput: 0: 9830.3, 1: 9886.7. Samples: 811285648. Policy #0 lag: (min: 31.0, avg: 31.7, max: 46.0) [2023-12-28 06:38:01,175][105115] Avg episode reward: [(0, '-4.932'), (1, '-4.475')] [2023-12-28 06:38:01,442][106226] Updated weights for policy 0, policy_version 1582558 (0.0008) [2023-12-28 06:38:01,499][106226] Updated weights for policy 0, policy_version 1582568 (0.0006) [2023-12-28 06:38:01,504][106225] Updated weights for policy 1, policy_version 1586080 (0.0010) [2023-12-28 06:38:01,556][106226] Updated weights for policy 0, policy_version 1582578 (0.0006) [2023-12-28 06:38:01,564][106225] Updated weights for policy 1, policy_version 1586090 (0.0010) [2023-12-28 06:38:01,645][106225] Updated weights for policy 1, policy_version 1586100 (0.0012) [2023-12-28 06:38:02,256][106226] Updated weights for policy 0, policy_version 1582588 (0.0008) [2023-12-28 06:38:02,321][106226] Updated weights for policy 0, policy_version 1582598 (0.0008) [2023-12-28 06:38:02,326][106225] Updated weights for policy 1, policy_version 1586110 (0.0009) [2023-12-28 06:38:02,388][106226] Updated weights for policy 0, policy_version 1582608 (0.0008) [2023-12-28 06:38:02,396][106225] Updated weights for policy 1, policy_version 1586120 (0.0011) [2023-12-28 06:38:02,456][106225] Updated weights for policy 1, policy_version 1586130 (0.0010) [2023-12-28 06:38:03,054][106225] Updated weights for policy 1, policy_version 1586140 (0.0010) [2023-12-28 06:38:03,075][106226] Updated weights for policy 0, policy_version 1582618 (0.0009) [2023-12-28 06:38:03,100][106225] Updated weights for policy 1, policy_version 1586150 (0.0010) [2023-12-28 06:38:03,135][106226] Updated weights for policy 0, policy_version 1582628 (0.0008) [2023-12-28 06:38:03,150][106225] Updated weights for policy 1, policy_version 1586160 (0.0010) [2023-12-28 06:38:03,182][106226] Updated weights for policy 0, policy_version 1582638 (0.0008) [2023-12-28 06:38:03,228][106226] Updated weights for policy 0, policy_version 1582648 (0.0007) [2023-12-28 06:38:03,789][106225] Updated weights for policy 1, policy_version 1586170 (0.0009) [2023-12-28 06:38:03,851][106225] Updated weights for policy 1, policy_version 1586180 (0.0007) [2023-12-28 06:38:03,917][106225] Updated weights for policy 1, policy_version 1586190 (0.0009) [2023-12-28 06:38:03,972][106226] Updated weights for policy 0, policy_version 1582658 (0.0008) [2023-12-28 06:38:03,979][106225] Updated weights for policy 1, policy_version 1586200 (0.0006) [2023-12-28 06:38:04,029][106226] Updated weights for policy 0, policy_version 1582668 (0.0011) [2023-12-28 06:38:04,082][106226] Updated weights for policy 0, policy_version 1582678 (0.0008) [2023-12-28 06:38:04,644][106225] Updated weights for policy 1, policy_version 1586210 (0.0005) [2023-12-28 06:38:04,709][106225] Updated weights for policy 1, policy_version 1586220 (0.0010) [2023-12-28 06:38:04,769][106225] Updated weights for policy 1, policy_version 1586230 (0.0010) [2023-12-28 06:38:04,813][106226] Updated weights for policy 0, policy_version 1582688 (0.0008) [2023-12-28 06:38:04,859][106226] Updated weights for policy 0, policy_version 1582698 (0.0007) [2023-12-28 06:38:04,907][106226] Updated weights for policy 0, policy_version 1582708 (0.0008) [2023-12-28 06:38:05,394][106225] Updated weights for policy 1, policy_version 1586240 (0.0010) [2023-12-28 06:38:05,444][106225] Updated weights for policy 1, policy_version 1586250 (0.0010) [2023-12-28 06:38:05,500][106225] Updated weights for policy 1, policy_version 1586260 (0.0010) [2023-12-28 06:38:05,687][106226] Updated weights for policy 0, policy_version 1582718 (0.0008) [2023-12-28 06:38:05,736][106226] Updated weights for policy 0, policy_version 1582728 (0.0007) [2023-12-28 06:38:05,794][106226] Updated weights for policy 0, policy_version 1582738 (0.0008) [2023-12-28 06:38:06,094][106225] Updated weights for policy 1, policy_version 1586270 (0.0007) [2023-12-28 06:38:06,166][106225] Updated weights for policy 1, policy_version 1586280 (0.0006) [2023-12-28 06:38:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 811393024. Throughput: 0: 9810.9, 1: 10004.5. Samples: 811404456. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:06,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-4.543')] [2023-12-28 06:38:06,222][106225] Updated weights for policy 1, policy_version 1586290 (0.0006) [2023-12-28 06:38:06,627][106226] Updated weights for policy 0, policy_version 1582748 (0.0009) [2023-12-28 06:38:06,689][106226] Updated weights for policy 0, policy_version 1582758 (0.0008) [2023-12-28 06:38:06,772][106226] Updated weights for policy 0, policy_version 1582768 (0.0009) [2023-12-28 06:38:06,837][106225] Updated weights for policy 1, policy_version 1586300 (0.0006) [2023-12-28 06:38:06,891][106225] Updated weights for policy 1, policy_version 1586310 (0.0010) [2023-12-28 06:38:06,949][106225] Updated weights for policy 1, policy_version 1586320 (0.0006) [2023-12-28 06:38:07,493][106225] Updated weights for policy 1, policy_version 1586330 (0.0005) [2023-12-28 06:38:07,559][106225] Updated weights for policy 1, policy_version 1586340 (0.0005) [2023-12-28 06:38:07,559][106226] Updated weights for policy 0, policy_version 1582778 (0.0011) [2023-12-28 06:38:07,608][106226] Updated weights for policy 0, policy_version 1582788 (0.0008) [2023-12-28 06:38:07,613][106225] Updated weights for policy 1, policy_version 1586350 (0.0005) [2023-12-28 06:38:07,656][106226] Updated weights for policy 0, policy_version 1582798 (0.0007) [2023-12-28 06:38:07,665][106225] Updated weights for policy 1, policy_version 1586360 (0.0008) [2023-12-28 06:38:07,704][106226] Updated weights for policy 0, policy_version 1582808 (0.0007) [2023-12-28 06:38:08,276][106225] Updated weights for policy 1, policy_version 1586370 (0.0005) [2023-12-28 06:38:08,336][106225] Updated weights for policy 1, policy_version 1586380 (0.0006) [2023-12-28 06:38:08,395][106226] Updated weights for policy 0, policy_version 1582818 (0.0009) [2023-12-28 06:38:08,397][106225] Updated weights for policy 1, policy_version 1586390 (0.0006) [2023-12-28 06:38:08,455][106226] Updated weights for policy 0, policy_version 1582828 (0.0008) [2023-12-28 06:38:08,518][106226] Updated weights for policy 0, policy_version 1582838 (0.0009) [2023-12-28 06:38:08,980][106225] Updated weights for policy 1, policy_version 1586400 (0.0007) [2023-12-28 06:38:09,044][106225] Updated weights for policy 1, policy_version 1586410 (0.0005) [2023-12-28 06:38:09,100][106225] Updated weights for policy 1, policy_version 1586420 (0.0006) [2023-12-28 06:38:09,308][106226] Updated weights for policy 0, policy_version 1582848 (0.0008) [2023-12-28 06:38:09,375][106226] Updated weights for policy 0, policy_version 1582858 (0.0008) [2023-12-28 06:38:09,442][106226] Updated weights for policy 0, policy_version 1582868 (0.0009) [2023-12-28 06:38:09,847][106225] Updated weights for policy 1, policy_version 1586430 (0.0009) [2023-12-28 06:38:09,922][106225] Updated weights for policy 1, policy_version 1586440 (0.0010) [2023-12-28 06:38:09,987][106225] Updated weights for policy 1, policy_version 1586450 (0.0009) [2023-12-28 06:38:10,190][106226] Updated weights for policy 0, policy_version 1582878 (0.0009) [2023-12-28 06:38:10,256][106226] Updated weights for policy 0, policy_version 1582888 (0.0008) [2023-12-28 06:38:10,319][106226] Updated weights for policy 0, policy_version 1582898 (0.0008) [2023-12-28 06:38:10,724][106225] Updated weights for policy 1, policy_version 1586460 (0.0006) [2023-12-28 06:38:10,778][106225] Updated weights for policy 1, policy_version 1586470 (0.0005) [2023-12-28 06:38:10,836][106225] Updated weights for policy 1, policy_version 1586480 (0.0006) [2023-12-28 06:38:11,025][106226] Updated weights for policy 0, policy_version 1582908 (0.0009) [2023-12-28 06:38:11,094][106226] Updated weights for policy 0, policy_version 1582918 (0.0009) [2023-12-28 06:38:11,164][106226] Updated weights for policy 0, policy_version 1582928 (0.0009) [2023-12-28 06:38:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 811491328. Throughput: 0: 9773.2, 1: 10146.4. Samples: 811466476. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:11,175][105115] Avg episode reward: [(0, '-4.808'), (1, '-4.470')] [2023-12-28 06:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001586488_406192128.pth... [2023-12-28 06:38:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001585304_405889024.pth [2023-12-28 06:38:11,214][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001582936_405307392.pth... [2023-12-28 06:38:11,218][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001581784_405012480.pth [2023-12-28 06:38:11,584][106225] Updated weights for policy 1, policy_version 1586490 (0.0008) [2023-12-28 06:38:11,650][106225] Updated weights for policy 1, policy_version 1586500 (0.0008) [2023-12-28 06:38:11,708][106225] Updated weights for policy 1, policy_version 1586510 (0.0006) [2023-12-28 06:38:11,782][106225] Updated weights for policy 1, policy_version 1586520 (0.0008) [2023-12-28 06:38:11,963][106226] Updated weights for policy 0, policy_version 1582938 (0.0009) [2023-12-28 06:38:12,026][106226] Updated weights for policy 0, policy_version 1582948 (0.0008) [2023-12-28 06:38:12,079][106226] Updated weights for policy 0, policy_version 1582958 (0.0009) [2023-12-28 06:38:12,139][106226] Updated weights for policy 0, policy_version 1582968 (0.0008) [2023-12-28 06:38:12,463][106225] Updated weights for policy 1, policy_version 1586530 (0.0006) [2023-12-28 06:38:12,533][106225] Updated weights for policy 1, policy_version 1586540 (0.0006) [2023-12-28 06:38:12,602][106225] Updated weights for policy 1, policy_version 1586550 (0.0006) [2023-12-28 06:38:12,934][106226] Updated weights for policy 0, policy_version 1582978 (0.0010) [2023-12-28 06:38:12,991][106226] Updated weights for policy 0, policy_version 1582988 (0.0010) [2023-12-28 06:38:13,055][106226] Updated weights for policy 0, policy_version 1582998 (0.0008) [2023-12-28 06:38:13,130][106225] Updated weights for policy 1, policy_version 1586560 (0.0006) [2023-12-28 06:38:13,191][106225] Updated weights for policy 1, policy_version 1586570 (0.0006) [2023-12-28 06:38:13,249][106225] Updated weights for policy 1, policy_version 1586580 (0.0006) [2023-12-28 06:38:13,821][106226] Updated weights for policy 0, policy_version 1583008 (0.0008) [2023-12-28 06:38:13,882][106226] Updated weights for policy 0, policy_version 1583018 (0.0008) [2023-12-28 06:38:13,913][106225] Updated weights for policy 1, policy_version 1586590 (0.0007) [2023-12-28 06:38:13,936][106226] Updated weights for policy 0, policy_version 1583028 (0.0008) [2023-12-28 06:38:13,962][106225] Updated weights for policy 1, policy_version 1586600 (0.0007) [2023-12-28 06:38:14,009][106225] Updated weights for policy 1, policy_version 1586610 (0.0008) [2023-12-28 06:38:14,659][106225] Updated weights for policy 1, policy_version 1586620 (0.0007) [2023-12-28 06:38:14,688][106226] Updated weights for policy 0, policy_version 1583038 (0.0008) [2023-12-28 06:38:14,707][106225] Updated weights for policy 1, policy_version 1586630 (0.0005) [2023-12-28 06:38:14,740][106226] Updated weights for policy 0, policy_version 1583048 (0.0008) [2023-12-28 06:38:14,753][106225] Updated weights for policy 1, policy_version 1586640 (0.0005) [2023-12-28 06:38:14,797][106226] Updated weights for policy 0, policy_version 1583058 (0.0009) [2023-12-28 06:38:15,385][106225] Updated weights for policy 1, policy_version 1586650 (0.0007) [2023-12-28 06:38:15,431][106225] Updated weights for policy 1, policy_version 1586660 (0.0006) [2023-12-28 06:38:15,480][106225] Updated weights for policy 1, policy_version 1586670 (0.0007) [2023-12-28 06:38:15,525][106225] Updated weights for policy 1, policy_version 1586680 (0.0009) [2023-12-28 06:38:15,620][106226] Updated weights for policy 0, policy_version 1583068 (0.0008) [2023-12-28 06:38:15,675][106226] Updated weights for policy 0, policy_version 1583078 (0.0008) [2023-12-28 06:38:15,731][106226] Updated weights for policy 0, policy_version 1583088 (0.0008) [2023-12-28 06:38:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 811589632. Throughput: 0: 9639.4, 1: 10119.5. Samples: 811581780. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:16,175][105115] Avg episode reward: [(0, '-4.899'), (1, '-4.616')] [2023-12-28 06:38:16,243][106225] Updated weights for policy 1, policy_version 1586690 (0.0008) [2023-12-28 06:38:16,302][106225] Updated weights for policy 1, policy_version 1586700 (0.0008) [2023-12-28 06:38:16,348][106225] Updated weights for policy 1, policy_version 1586710 (0.0008) [2023-12-28 06:38:16,474][106226] Updated weights for policy 0, policy_version 1583098 (0.0008) [2023-12-28 06:38:16,535][106226] Updated weights for policy 0, policy_version 1583108 (0.0008) [2023-12-28 06:38:16,595][106226] Updated weights for policy 0, policy_version 1583118 (0.0008) [2023-12-28 06:38:16,646][106226] Updated weights for policy 0, policy_version 1583128 (0.0008) [2023-12-28 06:38:17,075][106225] Updated weights for policy 1, policy_version 1586720 (0.0006) [2023-12-28 06:38:17,123][106225] Updated weights for policy 1, policy_version 1586730 (0.0005) [2023-12-28 06:38:17,174][106225] Updated weights for policy 1, policy_version 1586740 (0.0005) [2023-12-28 06:38:17,396][106226] Updated weights for policy 0, policy_version 1583138 (0.0009) [2023-12-28 06:38:17,449][106226] Updated weights for policy 0, policy_version 1583148 (0.0009) [2023-12-28 06:38:17,505][106226] Updated weights for policy 0, policy_version 1583158 (0.0008) [2023-12-28 06:38:17,791][106225] Updated weights for policy 1, policy_version 1586750 (0.0009) [2023-12-28 06:38:17,852][106225] Updated weights for policy 1, policy_version 1586760 (0.0009) [2023-12-28 06:38:17,911][106225] Updated weights for policy 1, policy_version 1586770 (0.0008) [2023-12-28 06:38:18,261][106226] Updated weights for policy 0, policy_version 1583168 (0.0009) [2023-12-28 06:38:18,328][106226] Updated weights for policy 0, policy_version 1583178 (0.0009) [2023-12-28 06:38:18,398][106226] Updated weights for policy 0, policy_version 1583188 (0.0007) [2023-12-28 06:38:18,606][106225] Updated weights for policy 1, policy_version 1586780 (0.0008) [2023-12-28 06:38:18,664][106225] Updated weights for policy 1, policy_version 1586790 (0.0008) [2023-12-28 06:38:18,726][106225] Updated weights for policy 1, policy_version 1586800 (0.0009) [2023-12-28 06:38:19,112][106226] Updated weights for policy 0, policy_version 1583198 (0.0009) [2023-12-28 06:38:19,167][106226] Updated weights for policy 0, policy_version 1583208 (0.0009) [2023-12-28 06:38:19,237][106226] Updated weights for policy 0, policy_version 1583218 (0.0008) [2023-12-28 06:38:19,467][106225] Updated weights for policy 1, policy_version 1586810 (0.0009) [2023-12-28 06:38:19,534][106225] Updated weights for policy 1, policy_version 1586820 (0.0008) [2023-12-28 06:38:19,596][106225] Updated weights for policy 1, policy_version 1586830 (0.0008) [2023-12-28 06:38:19,651][106225] Updated weights for policy 1, policy_version 1586840 (0.0008) [2023-12-28 06:38:20,034][106226] Updated weights for policy 0, policy_version 1583228 (0.0008) [2023-12-28 06:38:20,100][106226] Updated weights for policy 0, policy_version 1583238 (0.0008) [2023-12-28 06:38:20,167][106226] Updated weights for policy 0, policy_version 1583248 (0.0008) [2023-12-28 06:38:20,425][106225] Updated weights for policy 1, policy_version 1586850 (0.0007) [2023-12-28 06:38:20,488][106225] Updated weights for policy 1, policy_version 1586860 (0.0005) [2023-12-28 06:38:20,581][106225] Updated weights for policy 1, policy_version 1586870 (0.0007) [2023-12-28 06:38:20,903][106226] Updated weights for policy 0, policy_version 1583258 (0.0009) [2023-12-28 06:38:20,971][106226] Updated weights for policy 0, policy_version 1583268 (0.0006) [2023-12-28 06:38:21,041][106226] Updated weights for policy 0, policy_version 1583278 (0.0013) [2023-12-28 06:38:21,110][106226] Updated weights for policy 0, policy_version 1583288 (0.0009) [2023-12-28 06:38:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 811687936. Throughput: 0: 9553.8, 1: 10059.2. Samples: 811697332. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:21,175][105115] Avg episode reward: [(0, '-4.803'), (1, '-4.412')] [2023-12-28 06:38:21,218][106225] Updated weights for policy 1, policy_version 1586880 (0.0010) [2023-12-28 06:38:21,284][106225] Updated weights for policy 1, policy_version 1586890 (0.0011) [2023-12-28 06:38:21,350][106225] Updated weights for policy 1, policy_version 1586900 (0.0011) [2023-12-28 06:38:21,797][106226] Updated weights for policy 0, policy_version 1583298 (0.0008) [2023-12-28 06:38:21,859][106226] Updated weights for policy 0, policy_version 1583308 (0.0008) [2023-12-28 06:38:21,910][106226] Updated weights for policy 0, policy_version 1583318 (0.0008) [2023-12-28 06:38:22,079][106225] Updated weights for policy 1, policy_version 1586910 (0.0010) [2023-12-28 06:38:22,146][106225] Updated weights for policy 1, policy_version 1586920 (0.0011) [2023-12-28 06:38:22,206][106225] Updated weights for policy 1, policy_version 1586930 (0.0009) [2023-12-28 06:38:22,680][106226] Updated weights for policy 0, policy_version 1583328 (0.0006) [2023-12-28 06:38:22,743][106226] Updated weights for policy 0, policy_version 1583338 (0.0006) [2023-12-28 06:38:22,804][106226] Updated weights for policy 0, policy_version 1583348 (0.0005) [2023-12-28 06:38:22,966][106225] Updated weights for policy 1, policy_version 1586940 (0.0008) [2023-12-28 06:38:23,034][106225] Updated weights for policy 1, policy_version 1586950 (0.0008) [2023-12-28 06:38:23,094][106225] Updated weights for policy 1, policy_version 1586960 (0.0006) [2023-12-28 06:38:23,408][106226] Updated weights for policy 0, policy_version 1583358 (0.0008) [2023-12-28 06:38:23,460][106226] Updated weights for policy 0, policy_version 1583368 (0.0010) [2023-12-28 06:38:23,514][106226] Updated weights for policy 0, policy_version 1583378 (0.0010) [2023-12-28 06:38:23,760][106225] Updated weights for policy 1, policy_version 1586970 (0.0005) [2023-12-28 06:38:23,821][106225] Updated weights for policy 1, policy_version 1586980 (0.0005) [2023-12-28 06:38:23,876][106225] Updated weights for policy 1, policy_version 1586990 (0.0005) [2023-12-28 06:38:23,922][106225] Updated weights for policy 1, policy_version 1587000 (0.0005) [2023-12-28 06:38:24,134][106226] Updated weights for policy 0, policy_version 1583388 (0.0008) [2023-12-28 06:38:24,201][106226] Updated weights for policy 0, policy_version 1583398 (0.0006) [2023-12-28 06:38:24,262][106226] Updated weights for policy 0, policy_version 1583408 (0.0006) [2023-12-28 06:38:24,657][106225] Updated weights for policy 1, policy_version 1587010 (0.0009) [2023-12-28 06:38:24,713][106225] Updated weights for policy 1, policy_version 1587020 (0.0008) [2023-12-28 06:38:24,766][106225] Updated weights for policy 1, policy_version 1587030 (0.0007) [2023-12-28 06:38:24,800][106226] Updated weights for policy 0, policy_version 1583418 (0.0006) [2023-12-28 06:38:24,850][106226] Updated weights for policy 0, policy_version 1583428 (0.0010) [2023-12-28 06:38:24,897][106226] Updated weights for policy 0, policy_version 1583438 (0.0010) [2023-12-28 06:38:24,944][106226] Updated weights for policy 0, policy_version 1583448 (0.0010) [2023-12-28 06:38:25,512][106225] Updated weights for policy 1, policy_version 1587040 (0.0009) [2023-12-28 06:38:25,577][106225] Updated weights for policy 1, policy_version 1587050 (0.0009) [2023-12-28 06:38:25,642][106225] Updated weights for policy 1, policy_version 1587060 (0.0008) [2023-12-28 06:38:25,700][106226] Updated weights for policy 0, policy_version 1583458 (0.0009) [2023-12-28 06:38:25,759][106226] Updated weights for policy 0, policy_version 1583468 (0.0006) [2023-12-28 06:38:25,823][106226] Updated weights for policy 0, policy_version 1583478 (0.0008) [2023-12-28 06:38:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 811786240. Throughput: 0: 9583.9, 1: 10081.5. Samples: 811756396. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:26,175][105115] Avg episode reward: [(0, '-5.020'), (1, '-4.464')] [2023-12-28 06:38:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001587064_406339584.pth... [2023-12-28 06:38:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001583480_405446656.pth... [2023-12-28 06:38:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001582360_405159936.pth [2023-12-28 06:38:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001585912_406044672.pth [2023-12-28 06:38:26,244][106225] Updated weights for policy 1, policy_version 1587070 (0.0008) [2023-12-28 06:38:26,307][106225] Updated weights for policy 1, policy_version 1587080 (0.0010) [2023-12-28 06:38:26,370][106225] Updated weights for policy 1, policy_version 1587090 (0.0010) [2023-12-28 06:38:26,476][106226] Updated weights for policy 0, policy_version 1583488 (0.0009) [2023-12-28 06:38:26,536][106226] Updated weights for policy 0, policy_version 1583498 (0.0008) [2023-12-28 06:38:26,595][106226] Updated weights for policy 0, policy_version 1583508 (0.0009) [2023-12-28 06:38:27,029][106225] Updated weights for policy 1, policy_version 1587100 (0.0010) [2023-12-28 06:38:27,072][106225] Updated weights for policy 1, policy_version 1587110 (0.0007) [2023-12-28 06:38:27,129][106225] Updated weights for policy 1, policy_version 1587120 (0.0007) [2023-12-28 06:38:27,321][106226] Updated weights for policy 0, policy_version 1583518 (0.0009) [2023-12-28 06:38:27,383][106226] Updated weights for policy 0, policy_version 1583528 (0.0009) [2023-12-28 06:38:27,430][106226] Updated weights for policy 0, policy_version 1583538 (0.0008) [2023-12-28 06:38:27,712][106225] Updated weights for policy 1, policy_version 1587130 (0.0008) [2023-12-28 06:38:27,772][106225] Updated weights for policy 1, policy_version 1587140 (0.0007) [2023-12-28 06:38:27,821][106225] Updated weights for policy 1, policy_version 1587150 (0.0005) [2023-12-28 06:38:27,872][106225] Updated weights for policy 1, policy_version 1587160 (0.0005) [2023-12-28 06:38:28,238][106226] Updated weights for policy 0, policy_version 1583548 (0.0008) [2023-12-28 06:38:28,289][106226] Updated weights for policy 0, policy_version 1583558 (0.0007) [2023-12-28 06:38:28,345][106226] Updated weights for policy 0, policy_version 1583568 (0.0006) [2023-12-28 06:38:28,428][106225] Updated weights for policy 1, policy_version 1587170 (0.0007) [2023-12-28 06:38:28,485][106225] Updated weights for policy 1, policy_version 1587180 (0.0006) [2023-12-28 06:38:28,541][106225] Updated weights for policy 1, policy_version 1587190 (0.0005) [2023-12-28 06:38:29,088][106226] Updated weights for policy 0, policy_version 1583578 (0.0009) [2023-12-28 06:38:29,136][106226] Updated weights for policy 0, policy_version 1583588 (0.0008) [2023-12-28 06:38:29,183][106226] Updated weights for policy 0, policy_version 1583598 (0.0008) [2023-12-28 06:38:29,219][106225] Updated weights for policy 1, policy_version 1587200 (0.0007) [2023-12-28 06:38:29,241][106226] Updated weights for policy 0, policy_version 1583608 (0.0007) [2023-12-28 06:38:29,290][106225] Updated weights for policy 1, policy_version 1587210 (0.0009) [2023-12-28 06:38:29,357][106225] Updated weights for policy 1, policy_version 1587220 (0.0008) [2023-12-28 06:38:30,031][106225] Updated weights for policy 1, policy_version 1587230 (0.0008) [2023-12-28 06:38:30,048][106226] Updated weights for policy 0, policy_version 1583618 (0.0006) [2023-12-28 06:38:30,091][106225] Updated weights for policy 1, policy_version 1587240 (0.0008) [2023-12-28 06:38:30,102][106226] Updated weights for policy 0, policy_version 1583628 (0.0006) [2023-12-28 06:38:30,157][106225] Updated weights for policy 1, policy_version 1587250 (0.0007) [2023-12-28 06:38:30,160][106226] Updated weights for policy 0, policy_version 1583638 (0.0008) [2023-12-28 06:38:30,862][106226] Updated weights for policy 0, policy_version 1583648 (0.0008) [2023-12-28 06:38:30,904][106225] Updated weights for policy 1, policy_version 1587260 (0.0007) [2023-12-28 06:38:30,922][106226] Updated weights for policy 0, policy_version 1583658 (0.0009) [2023-12-28 06:38:30,952][106225] Updated weights for policy 1, policy_version 1587270 (0.0007) [2023-12-28 06:38:30,974][106226] Updated weights for policy 0, policy_version 1583668 (0.0006) [2023-12-28 06:38:31,011][106225] Updated weights for policy 1, policy_version 1587280 (0.0008) [2023-12-28 06:38:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 811892736. Throughput: 0: 9597.1, 1: 10191.5. Samples: 811878124. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:31,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.587')] [2023-12-28 06:38:31,733][106225] Updated weights for policy 1, policy_version 1587290 (0.0008) [2023-12-28 06:38:31,800][106225] Updated weights for policy 1, policy_version 1587300 (0.0010) [2023-12-28 06:38:31,812][106226] Updated weights for policy 0, policy_version 1583678 (0.0007) [2023-12-28 06:38:31,855][106225] Updated weights for policy 1, policy_version 1587310 (0.0009) [2023-12-28 06:38:31,868][106226] Updated weights for policy 0, policy_version 1583688 (0.0006) [2023-12-28 06:38:31,910][106225] Updated weights for policy 1, policy_version 1587320 (0.0009) [2023-12-28 06:38:31,922][106226] Updated weights for policy 0, policy_version 1583698 (0.0007) [2023-12-28 06:38:32,662][106225] Updated weights for policy 1, policy_version 1587330 (0.0008) [2023-12-28 06:38:32,691][106226] Updated weights for policy 0, policy_version 1583708 (0.0006) [2023-12-28 06:38:32,724][106225] Updated weights for policy 1, policy_version 1587340 (0.0007) [2023-12-28 06:38:32,751][106226] Updated weights for policy 0, policy_version 1583718 (0.0009) [2023-12-28 06:38:32,784][106225] Updated weights for policy 1, policy_version 1587350 (0.0007) [2023-12-28 06:38:32,812][106226] Updated weights for policy 0, policy_version 1583728 (0.0011) [2023-12-28 06:38:33,495][106225] Updated weights for policy 1, policy_version 1587360 (0.0008) [2023-12-28 06:38:33,511][106226] Updated weights for policy 0, policy_version 1583738 (0.0011) [2023-12-28 06:38:33,550][106225] Updated weights for policy 1, policy_version 1587370 (0.0007) [2023-12-28 06:38:33,574][106226] Updated weights for policy 0, policy_version 1583748 (0.0011) [2023-12-28 06:38:33,607][106225] Updated weights for policy 1, policy_version 1587380 (0.0005) [2023-12-28 06:38:33,627][106226] Updated weights for policy 0, policy_version 1583758 (0.0010) [2023-12-28 06:38:33,688][106226] Updated weights for policy 0, policy_version 1583768 (0.0010) [2023-12-28 06:38:34,196][106225] Updated weights for policy 1, policy_version 1587390 (0.0007) [2023-12-28 06:38:34,252][106225] Updated weights for policy 1, policy_version 1587400 (0.0009) [2023-12-28 06:38:34,300][106225] Updated weights for policy 1, policy_version 1587410 (0.0008) [2023-12-28 06:38:34,453][106226] Updated weights for policy 0, policy_version 1583778 (0.0011) [2023-12-28 06:38:34,512][106226] Updated weights for policy 0, policy_version 1583788 (0.0011) [2023-12-28 06:38:34,573][106226] Updated weights for policy 0, policy_version 1583798 (0.0011) [2023-12-28 06:38:35,023][106225] Updated weights for policy 1, policy_version 1587420 (0.0007) [2023-12-28 06:38:35,075][106225] Updated weights for policy 1, policy_version 1587430 (0.0005) [2023-12-28 06:38:35,131][106225] Updated weights for policy 1, policy_version 1587440 (0.0005) [2023-12-28 06:38:35,282][106226] Updated weights for policy 0, policy_version 1583808 (0.0007) [2023-12-28 06:38:35,351][106226] Updated weights for policy 0, policy_version 1583818 (0.0006) [2023-12-28 06:38:35,415][106226] Updated weights for policy 0, policy_version 1583828 (0.0008) [2023-12-28 06:38:35,703][106225] Updated weights for policy 1, policy_version 1587450 (0.0006) [2023-12-28 06:38:35,757][106225] Updated weights for policy 1, policy_version 1587460 (0.0010) [2023-12-28 06:38:35,811][106225] Updated weights for policy 1, policy_version 1587470 (0.0010) [2023-12-28 06:38:35,854][106225] Updated weights for policy 1, policy_version 1587480 (0.0010) [2023-12-28 06:38:36,058][106226] Updated weights for policy 0, policy_version 1583838 (0.0006) [2023-12-28 06:38:36,140][106226] Updated weights for policy 0, policy_version 1583848 (0.0007) [2023-12-28 06:38:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 811982848. Throughput: 0: 9582.2, 1: 10194.4. Samples: 811995944. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:36,175][105115] Avg episode reward: [(0, '-4.693'), (1, '-4.675')] [2023-12-28 06:38:36,199][106226] Updated weights for policy 0, policy_version 1583858 (0.0008) [2023-12-28 06:38:36,574][106225] Updated weights for policy 1, policy_version 1587490 (0.0010) [2023-12-28 06:38:36,639][106225] Updated weights for policy 1, policy_version 1587500 (0.0011) [2023-12-28 06:38:36,701][106225] Updated weights for policy 1, policy_version 1587510 (0.0011) [2023-12-28 06:38:36,897][106226] Updated weights for policy 0, policy_version 1583868 (0.0008) [2023-12-28 06:38:36,949][106226] Updated weights for policy 0, policy_version 1583878 (0.0010) [2023-12-28 06:38:37,003][106226] Updated weights for policy 0, policy_version 1583889 (0.0009) [2023-12-28 06:38:37,305][106225] Updated weights for policy 1, policy_version 1587520 (0.0007) [2023-12-28 06:38:37,374][106225] Updated weights for policy 1, policy_version 1587530 (0.0008) [2023-12-28 06:38:37,439][106225] Updated weights for policy 1, policy_version 1587540 (0.0010) [2023-12-28 06:38:37,741][106226] Updated weights for policy 0, policy_version 1583899 (0.0007) [2023-12-28 06:38:37,784][106226] Updated weights for policy 0, policy_version 1583909 (0.0008) [2023-12-28 06:38:37,834][106226] Updated weights for policy 0, policy_version 1583919 (0.0008) [2023-12-28 06:38:38,071][106225] Updated weights for policy 1, policy_version 1587550 (0.0010) [2023-12-28 06:38:38,118][106225] Updated weights for policy 1, policy_version 1587560 (0.0010) [2023-12-28 06:38:38,171][106225] Updated weights for policy 1, policy_version 1587570 (0.0010) [2023-12-28 06:38:38,612][106226] Updated weights for policy 0, policy_version 1583929 (0.0008) [2023-12-28 06:38:38,663][106226] Updated weights for policy 0, policy_version 1583939 (0.0008) [2023-12-28 06:38:38,718][106226] Updated weights for policy 0, policy_version 1583949 (0.0008) [2023-12-28 06:38:38,769][106226] Updated weights for policy 0, policy_version 1583959 (0.0009) [2023-12-28 06:38:38,866][106225] Updated weights for policy 1, policy_version 1587580 (0.0010) [2023-12-28 06:38:38,926][106225] Updated weights for policy 1, policy_version 1587590 (0.0010) [2023-12-28 06:38:38,987][106225] Updated weights for policy 1, policy_version 1587600 (0.0010) [2023-12-28 06:38:39,579][106226] Updated weights for policy 0, policy_version 1583969 (0.0008) [2023-12-28 06:38:39,644][106226] Updated weights for policy 0, policy_version 1583979 (0.0009) [2023-12-28 06:38:39,706][106226] Updated weights for policy 0, policy_version 1583989 (0.0008) [2023-12-28 06:38:39,722][106225] Updated weights for policy 1, policy_version 1587610 (0.0010) [2023-12-28 06:38:39,784][106225] Updated weights for policy 1, policy_version 1587620 (0.0010) [2023-12-28 06:38:39,856][106225] Updated weights for policy 1, policy_version 1587630 (0.0010) [2023-12-28 06:38:39,911][106225] Updated weights for policy 1, policy_version 1587640 (0.0008) [2023-12-28 06:38:40,484][106226] Updated weights for policy 0, policy_version 1583999 (0.0009) [2023-12-28 06:38:40,536][106226] Updated weights for policy 0, policy_version 1584009 (0.0011) [2023-12-28 06:38:40,604][106226] Updated weights for policy 0, policy_version 1584019 (0.0009) [2023-12-28 06:38:40,681][106225] Updated weights for policy 1, policy_version 1587650 (0.0010) [2023-12-28 06:38:40,749][106225] Updated weights for policy 1, policy_version 1587660 (0.0010) [2023-12-28 06:38:40,800][106225] Updated weights for policy 1, policy_version 1587670 (0.0010) [2023-12-28 06:38:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 812081152. Throughput: 0: 9557.2, 1: 10170.2. Samples: 812055528. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:41,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.747')] [2023-12-28 06:38:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001587672_406495232.pth... [2023-12-28 06:38:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001584024_405585920.pth... [2023-12-28 06:38:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001586488_406192128.pth [2023-12-28 06:38:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001582936_405307392.pth [2023-12-28 06:38:41,302][106226] Updated weights for policy 0, policy_version 1584029 (0.0007) [2023-12-28 06:38:41,377][106226] Updated weights for policy 0, policy_version 1584039 (0.0008) [2023-12-28 06:38:41,441][106226] Updated weights for policy 0, policy_version 1584049 (0.0008) [2023-12-28 06:38:41,566][106225] Updated weights for policy 1, policy_version 1587680 (0.0008) [2023-12-28 06:38:41,631][106225] Updated weights for policy 1, policy_version 1587690 (0.0010) [2023-12-28 06:38:41,697][106225] Updated weights for policy 1, policy_version 1587700 (0.0008) [2023-12-28 06:38:42,212][106226] Updated weights for policy 0, policy_version 1584059 (0.0007) [2023-12-28 06:38:42,283][106226] Updated weights for policy 0, policy_version 1584069 (0.0007) [2023-12-28 06:38:42,353][106226] Updated weights for policy 0, policy_version 1584079 (0.0007) [2023-12-28 06:38:42,481][106225] Updated weights for policy 1, policy_version 1587710 (0.0008) [2023-12-28 06:38:42,537][106225] Updated weights for policy 1, policy_version 1587720 (0.0008) [2023-12-28 06:38:42,587][106225] Updated weights for policy 1, policy_version 1587730 (0.0008) [2023-12-28 06:38:42,960][106226] Updated weights for policy 0, policy_version 1584089 (0.0008) [2023-12-28 06:38:43,009][106226] Updated weights for policy 0, policy_version 1584099 (0.0009) [2023-12-28 06:38:43,057][106226] Updated weights for policy 0, policy_version 1584109 (0.0008) [2023-12-28 06:38:43,107][106226] Updated weights for policy 0, policy_version 1584119 (0.0009) [2023-12-28 06:38:43,301][106225] Updated weights for policy 1, policy_version 1587740 (0.0009) [2023-12-28 06:38:43,348][106225] Updated weights for policy 1, policy_version 1587750 (0.0008) [2023-12-28 06:38:43,403][106225] Updated weights for policy 1, policy_version 1587760 (0.0008) [2023-12-28 06:38:43,866][106226] Updated weights for policy 0, policy_version 1584129 (0.0009) [2023-12-28 06:38:43,922][106226] Updated weights for policy 0, policy_version 1584139 (0.0008) [2023-12-28 06:38:43,981][106226] Updated weights for policy 0, policy_version 1584149 (0.0008) [2023-12-28 06:38:44,127][106225] Updated weights for policy 1, policy_version 1587770 (0.0008) [2023-12-28 06:38:44,182][106225] Updated weights for policy 1, policy_version 1587780 (0.0008) [2023-12-28 06:38:44,230][106225] Updated weights for policy 1, policy_version 1587790 (0.0008) [2023-12-28 06:38:44,275][106225] Updated weights for policy 1, policy_version 1587800 (0.0005) [2023-12-28 06:38:44,744][106226] Updated weights for policy 0, policy_version 1584159 (0.0008) [2023-12-28 06:38:44,813][106226] Updated weights for policy 0, policy_version 1584169 (0.0008) [2023-12-28 06:38:44,872][106226] Updated weights for policy 0, policy_version 1584179 (0.0008) [2023-12-28 06:38:44,987][106225] Updated weights for policy 1, policy_version 1587810 (0.0008) [2023-12-28 06:38:45,045][106225] Updated weights for policy 1, policy_version 1587820 (0.0008) [2023-12-28 06:38:45,106][106225] Updated weights for policy 1, policy_version 1587830 (0.0007) [2023-12-28 06:38:45,536][106226] Updated weights for policy 0, policy_version 1584189 (0.0009) [2023-12-28 06:38:45,598][106226] Updated weights for policy 0, policy_version 1584199 (0.0011) [2023-12-28 06:38:45,655][106226] Updated weights for policy 0, policy_version 1584209 (0.0006) [2023-12-28 06:38:45,902][106225] Updated weights for policy 1, policy_version 1587840 (0.0008) [2023-12-28 06:38:45,961][106225] Updated weights for policy 1, policy_version 1587850 (0.0007) [2023-12-28 06:38:46,010][106225] Updated weights for policy 1, policy_version 1587860 (0.0008) [2023-12-28 06:38:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 812179456. Throughput: 0: 9465.7, 1: 10150.3. Samples: 812168372. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:46,176][105115] Avg episode reward: [(0, '-4.780'), (1, '-4.620')] [2023-12-28 06:38:46,287][106226] Updated weights for policy 0, policy_version 1584219 (0.0005) [2023-12-28 06:38:46,344][106226] Updated weights for policy 0, policy_version 1584229 (0.0005) [2023-12-28 06:38:46,402][106226] Updated weights for policy 0, policy_version 1584239 (0.0006) [2023-12-28 06:38:46,779][106225] Updated weights for policy 1, policy_version 1587870 (0.0007) [2023-12-28 06:38:46,841][106225] Updated weights for policy 1, policy_version 1587880 (0.0007) [2023-12-28 06:38:46,909][106225] Updated weights for policy 1, policy_version 1587890 (0.0008) [2023-12-28 06:38:46,951][106226] Updated weights for policy 0, policy_version 1584249 (0.0006) [2023-12-28 06:38:47,004][106226] Updated weights for policy 0, policy_version 1584259 (0.0008) [2023-12-28 06:38:47,057][106226] Updated weights for policy 0, policy_version 1584269 (0.0006) [2023-12-28 06:38:47,109][106226] Updated weights for policy 0, policy_version 1584279 (0.0005) [2023-12-28 06:38:47,606][106225] Updated weights for policy 1, policy_version 1587900 (0.0009) [2023-12-28 06:38:47,653][106225] Updated weights for policy 1, policy_version 1587910 (0.0008) [2023-12-28 06:38:47,704][106225] Updated weights for policy 1, policy_version 1587920 (0.0008) [2023-12-28 06:38:47,762][106226] Updated weights for policy 0, policy_version 1584289 (0.0005) [2023-12-28 06:38:47,818][106226] Updated weights for policy 0, policy_version 1584299 (0.0007) [2023-12-28 06:38:47,876][106226] Updated weights for policy 0, policy_version 1584309 (0.0006) [2023-12-28 06:38:48,444][106226] Updated weights for policy 0, policy_version 1584319 (0.0007) [2023-12-28 06:38:48,500][106226] Updated weights for policy 0, policy_version 1584329 (0.0006) [2023-12-28 06:38:48,523][106225] Updated weights for policy 1, policy_version 1587930 (0.0008) [2023-12-28 06:38:48,561][106226] Updated weights for policy 0, policy_version 1584339 (0.0008) [2023-12-28 06:38:48,583][106225] Updated weights for policy 1, policy_version 1587940 (0.0008) [2023-12-28 06:38:48,648][106225] Updated weights for policy 1, policy_version 1587950 (0.0008) [2023-12-28 06:38:48,707][106225] Updated weights for policy 1, policy_version 1587960 (0.0009) [2023-12-28 06:38:49,286][106226] Updated weights for policy 0, policy_version 1584349 (0.0007) [2023-12-28 06:38:49,355][106226] Updated weights for policy 0, policy_version 1584359 (0.0008) [2023-12-28 06:38:49,418][106226] Updated weights for policy 0, policy_version 1584369 (0.0007) [2023-12-28 06:38:49,451][106225] Updated weights for policy 1, policy_version 1587970 (0.0008) [2023-12-28 06:38:49,513][106225] Updated weights for policy 1, policy_version 1587980 (0.0008) [2023-12-28 06:38:49,574][106225] Updated weights for policy 1, policy_version 1587990 (0.0008) [2023-12-28 06:38:50,057][106226] Updated weights for policy 0, policy_version 1584379 (0.0006) [2023-12-28 06:38:50,119][106226] Updated weights for policy 0, policy_version 1584389 (0.0009) [2023-12-28 06:38:50,189][106226] Updated weights for policy 0, policy_version 1584399 (0.0010) [2023-12-28 06:38:50,299][106225] Updated weights for policy 1, policy_version 1588000 (0.0006) [2023-12-28 06:38:50,363][106225] Updated weights for policy 1, policy_version 1588010 (0.0009) [2023-12-28 06:38:50,419][106225] Updated weights for policy 1, policy_version 1588020 (0.0006) [2023-12-28 06:38:50,972][106226] Updated weights for policy 0, policy_version 1584409 (0.0009) [2023-12-28 06:38:51,035][106226] Updated weights for policy 0, policy_version 1584419 (0.0008) [2023-12-28 06:38:51,065][106225] Updated weights for policy 1, policy_version 1588030 (0.0009) [2023-12-28 06:38:51,100][106226] Updated weights for policy 0, policy_version 1584429 (0.0009) [2023-12-28 06:38:51,128][106225] Updated weights for policy 1, policy_version 1588040 (0.0008) [2023-12-28 06:38:51,168][106226] Updated weights for policy 0, policy_version 1584439 (0.0007) [2023-12-28 06:38:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 812277760. Throughput: 0: 9583.0, 1: 10039.5. Samples: 812287464. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:51,175][105115] Avg episode reward: [(0, '-4.939'), (1, '-4.555')] [2023-12-28 06:38:51,189][106225] Updated weights for policy 1, policy_version 1588050 (0.0010) [2023-12-28 06:38:51,907][106226] Updated weights for policy 0, policy_version 1584449 (0.0007) [2023-12-28 06:38:51,922][106225] Updated weights for policy 1, policy_version 1588060 (0.0010) [2023-12-28 06:38:51,966][106226] Updated weights for policy 0, policy_version 1584459 (0.0008) [2023-12-28 06:38:51,982][106225] Updated weights for policy 1, policy_version 1588070 (0.0011) [2023-12-28 06:38:52,027][106226] Updated weights for policy 0, policy_version 1584469 (0.0006) [2023-12-28 06:38:52,041][106225] Updated weights for policy 1, policy_version 1588080 (0.0011) [2023-12-28 06:38:52,645][106226] Updated weights for policy 0, policy_version 1584479 (0.0008) [2023-12-28 06:38:52,711][106226] Updated weights for policy 0, policy_version 1584489 (0.0008) [2023-12-28 06:38:52,772][106226] Updated weights for policy 0, policy_version 1584499 (0.0008) [2023-12-28 06:38:52,778][106225] Updated weights for policy 1, policy_version 1588090 (0.0011) [2023-12-28 06:38:52,839][106225] Updated weights for policy 1, policy_version 1588100 (0.0010) [2023-12-28 06:38:52,906][106225] Updated weights for policy 1, policy_version 1588110 (0.0010) [2023-12-28 06:38:52,969][106225] Updated weights for policy 1, policy_version 1588120 (0.0010) [2023-12-28 06:38:53,377][106226] Updated weights for policy 0, policy_version 1584509 (0.0009) [2023-12-28 06:38:53,437][106226] Updated weights for policy 0, policy_version 1584519 (0.0010) [2023-12-28 06:38:53,492][106226] Updated weights for policy 0, policy_version 1584529 (0.0010) [2023-12-28 06:38:53,672][106225] Updated weights for policy 1, policy_version 1588130 (0.0007) [2023-12-28 06:38:53,717][106225] Updated weights for policy 1, policy_version 1588140 (0.0005) [2023-12-28 06:38:53,764][106225] Updated weights for policy 1, policy_version 1588150 (0.0005) [2023-12-28 06:38:54,146][106226] Updated weights for policy 0, policy_version 1584539 (0.0010) [2023-12-28 06:38:54,211][106226] Updated weights for policy 0, policy_version 1584549 (0.0008) [2023-12-28 06:38:54,262][106226] Updated weights for policy 0, policy_version 1584559 (0.0008) [2023-12-28 06:38:54,335][106225] Updated weights for policy 1, policy_version 1588160 (0.0007) [2023-12-28 06:38:54,385][106225] Updated weights for policy 1, policy_version 1588170 (0.0008) [2023-12-28 06:38:54,443][106225] Updated weights for policy 1, policy_version 1588180 (0.0008) [2023-12-28 06:38:54,880][106226] Updated weights for policy 0, policy_version 1584569 (0.0010) [2023-12-28 06:38:54,941][106226] Updated weights for policy 0, policy_version 1584579 (0.0005) [2023-12-28 06:38:55,005][106226] Updated weights for policy 0, policy_version 1584589 (0.0009) [2023-12-28 06:38:55,069][106226] Updated weights for policy 0, policy_version 1584599 (0.0011) [2023-12-28 06:38:55,231][106225] Updated weights for policy 1, policy_version 1588190 (0.0007) [2023-12-28 06:38:55,273][106225] Updated weights for policy 1, policy_version 1588200 (0.0008) [2023-12-28 06:38:55,318][106225] Updated weights for policy 1, policy_version 1588210 (0.0005) [2023-12-28 06:38:55,746][106226] Updated weights for policy 0, policy_version 1584609 (0.0009) [2023-12-28 06:38:55,796][106226] Updated weights for policy 0, policy_version 1584619 (0.0008) [2023-12-28 06:38:55,845][106226] Updated weights for policy 0, policy_version 1584629 (0.0008) [2023-12-28 06:38:56,041][106225] Updated weights for policy 1, policy_version 1588220 (0.0007) [2023-12-28 06:38:56,096][106225] Updated weights for policy 1, policy_version 1588230 (0.0008) [2023-12-28 06:38:56,152][106225] Updated weights for policy 1, policy_version 1588240 (0.0008) [2023-12-28 06:38:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 812376064. Throughput: 0: 9657.9, 1: 9906.7. Samples: 812346888. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:38:56,175][105115] Avg episode reward: [(0, '-5.014'), (1, '-4.685')] [2023-12-28 06:38:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001584632_405741568.pth... [2023-12-28 06:38:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001583480_405446656.pth [2023-12-28 06:38:56,194][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001588248_406642688.pth... [2023-12-28 06:38:56,198][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001587064_406339584.pth [2023-12-28 06:38:56,594][106226] Updated weights for policy 0, policy_version 1584639 (0.0009) [2023-12-28 06:38:56,642][106226] Updated weights for policy 0, policy_version 1584649 (0.0008) [2023-12-28 06:38:56,697][106226] Updated weights for policy 0, policy_version 1584659 (0.0008) [2023-12-28 06:38:56,898][106225] Updated weights for policy 1, policy_version 1588250 (0.0008) [2023-12-28 06:38:56,945][106225] Updated weights for policy 1, policy_version 1588260 (0.0008) [2023-12-28 06:38:57,000][106225] Updated weights for policy 1, policy_version 1588270 (0.0007) [2023-12-28 06:38:57,059][106225] Updated weights for policy 1, policy_version 1588280 (0.0006) [2023-12-28 06:38:57,311][106226] Updated weights for policy 0, policy_version 1584669 (0.0009) [2023-12-28 06:38:57,372][106226] Updated weights for policy 0, policy_version 1584679 (0.0007) [2023-12-28 06:38:57,423][106226] Updated weights for policy 0, policy_version 1584689 (0.0005) [2023-12-28 06:38:57,847][106225] Updated weights for policy 1, policy_version 1588290 (0.0008) [2023-12-28 06:38:57,896][106225] Updated weights for policy 1, policy_version 1588300 (0.0007) [2023-12-28 06:38:57,948][106225] Updated weights for policy 1, policy_version 1588310 (0.0008) [2023-12-28 06:38:58,073][106226] Updated weights for policy 0, policy_version 1584699 (0.0007) [2023-12-28 06:38:58,125][106226] Updated weights for policy 0, policy_version 1584709 (0.0010) [2023-12-28 06:38:58,170][106226] Updated weights for policy 0, policy_version 1584719 (0.0010) [2023-12-28 06:38:58,724][106225] Updated weights for policy 1, policy_version 1588320 (0.0007) [2023-12-28 06:38:58,792][106225] Updated weights for policy 1, policy_version 1588330 (0.0008) [2023-12-28 06:38:58,865][106225] Updated weights for policy 1, policy_version 1588340 (0.0008) [2023-12-28 06:38:59,030][106226] Updated weights for policy 0, policy_version 1584729 (0.0010) [2023-12-28 06:38:59,092][106226] Updated weights for policy 0, policy_version 1584739 (0.0008) [2023-12-28 06:38:59,148][106226] Updated weights for policy 0, policy_version 1584749 (0.0009) [2023-12-28 06:38:59,195][106226] Updated weights for policy 0, policy_version 1584759 (0.0007) [2023-12-28 06:38:59,585][106225] Updated weights for policy 1, policy_version 1588350 (0.0007) [2023-12-28 06:38:59,644][106225] Updated weights for policy 1, policy_version 1588360 (0.0008) [2023-12-28 06:38:59,702][106225] Updated weights for policy 1, policy_version 1588370 (0.0008) [2023-12-28 06:38:59,970][106226] Updated weights for policy 0, policy_version 1584769 (0.0009) [2023-12-28 06:39:00,027][106226] Updated weights for policy 0, policy_version 1584779 (0.0009) [2023-12-28 06:39:00,095][106226] Updated weights for policy 0, policy_version 1584789 (0.0009) [2023-12-28 06:39:00,441][106225] Updated weights for policy 1, policy_version 1588380 (0.0009) [2023-12-28 06:39:00,489][106225] Updated weights for policy 1, policy_version 1588390 (0.0008) [2023-12-28 06:39:00,552][106225] Updated weights for policy 1, policy_version 1588400 (0.0008) [2023-12-28 06:39:00,793][106226] Updated weights for policy 0, policy_version 1584799 (0.0008) [2023-12-28 06:39:00,854][106226] Updated weights for policy 0, policy_version 1584809 (0.0008) [2023-12-28 06:39:00,913][106226] Updated weights for policy 0, policy_version 1584819 (0.0008) [2023-12-28 06:39:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 812474368. Throughput: 0: 9763.3, 1: 9829.9. Samples: 812463472. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:01,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.654')] [2023-12-28 06:39:01,311][106225] Updated weights for policy 1, policy_version 1588410 (0.0008) [2023-12-28 06:39:01,382][106225] Updated weights for policy 1, policy_version 1588420 (0.0007) [2023-12-28 06:39:01,448][106225] Updated weights for policy 1, policy_version 1588430 (0.0009) [2023-12-28 06:39:01,509][106225] Updated weights for policy 1, policy_version 1588440 (0.0007) [2023-12-28 06:39:01,636][106226] Updated weights for policy 0, policy_version 1584829 (0.0008) [2023-12-28 06:39:01,698][106226] Updated weights for policy 0, policy_version 1584839 (0.0010) [2023-12-28 06:39:01,758][106226] Updated weights for policy 0, policy_version 1584849 (0.0008) [2023-12-28 06:39:02,204][106225] Updated weights for policy 1, policy_version 1588450 (0.0008) [2023-12-28 06:39:02,264][106225] Updated weights for policy 1, policy_version 1588460 (0.0008) [2023-12-28 06:39:02,330][106225] Updated weights for policy 1, policy_version 1588470 (0.0008) [2023-12-28 06:39:02,468][106226] Updated weights for policy 0, policy_version 1584859 (0.0008) [2023-12-28 06:39:02,531][106226] Updated weights for policy 0, policy_version 1584869 (0.0005) [2023-12-28 06:39:02,590][106226] Updated weights for policy 0, policy_version 1584879 (0.0006) [2023-12-28 06:39:03,042][106225] Updated weights for policy 1, policy_version 1588480 (0.0006) [2023-12-28 06:39:03,109][106225] Updated weights for policy 1, policy_version 1588490 (0.0009) [2023-12-28 06:39:03,155][106226] Updated weights for policy 0, policy_version 1584889 (0.0006) [2023-12-28 06:39:03,167][106225] Updated weights for policy 1, policy_version 1588500 (0.0008) [2023-12-28 06:39:03,204][106226] Updated weights for policy 0, policy_version 1584899 (0.0009) [2023-12-28 06:39:03,254][106226] Updated weights for policy 0, policy_version 1584909 (0.0009) [2023-12-28 06:39:03,310][106226] Updated weights for policy 0, policy_version 1584919 (0.0008) [2023-12-28 06:39:03,812][106225] Updated weights for policy 1, policy_version 1588510 (0.0005) [2023-12-28 06:39:03,876][106225] Updated weights for policy 1, policy_version 1588520 (0.0007) [2023-12-28 06:39:03,939][106225] Updated weights for policy 1, policy_version 1588530 (0.0006) [2023-12-28 06:39:03,986][106226] Updated weights for policy 0, policy_version 1584929 (0.0009) [2023-12-28 06:39:04,050][106226] Updated weights for policy 0, policy_version 1584939 (0.0009) [2023-12-28 06:39:04,113][106226] Updated weights for policy 0, policy_version 1584949 (0.0010) [2023-12-28 06:39:04,557][106225] Updated weights for policy 1, policy_version 1588540 (0.0007) [2023-12-28 06:39:04,618][106225] Updated weights for policy 1, policy_version 1588550 (0.0009) [2023-12-28 06:39:04,685][106225] Updated weights for policy 1, policy_version 1588560 (0.0009) [2023-12-28 06:39:04,864][106226] Updated weights for policy 0, policy_version 1584959 (0.0008) [2023-12-28 06:39:04,913][106226] Updated weights for policy 0, policy_version 1584969 (0.0008) [2023-12-28 06:39:04,965][106226] Updated weights for policy 0, policy_version 1584979 (0.0006) [2023-12-28 06:39:05,380][106225] Updated weights for policy 1, policy_version 1588570 (0.0008) [2023-12-28 06:39:05,436][106225] Updated weights for policy 1, policy_version 1588580 (0.0007) [2023-12-28 06:39:05,499][106225] Updated weights for policy 1, policy_version 1588590 (0.0009) [2023-12-28 06:39:05,561][106225] Updated weights for policy 1, policy_version 1588600 (0.0009) [2023-12-28 06:39:05,583][106226] Updated weights for policy 0, policy_version 1584989 (0.0008) [2023-12-28 06:39:05,639][106226] Updated weights for policy 0, policy_version 1584999 (0.0010) [2023-12-28 06:39:05,695][106226] Updated weights for policy 0, policy_version 1585009 (0.0010) [2023-12-28 06:39:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 812572672. Throughput: 0: 9890.8, 1: 9803.9. Samples: 812583596. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:06,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.903')] [2023-12-28 06:39:06,269][106225] Updated weights for policy 1, policy_version 1588610 (0.0007) [2023-12-28 06:39:06,334][106225] Updated weights for policy 1, policy_version 1588620 (0.0008) [2023-12-28 06:39:06,353][106226] Updated weights for policy 0, policy_version 1585019 (0.0010) [2023-12-28 06:39:06,397][106225] Updated weights for policy 1, policy_version 1588630 (0.0006) [2023-12-28 06:39:06,413][106226] Updated weights for policy 0, policy_version 1585029 (0.0010) [2023-12-28 06:39:06,481][106226] Updated weights for policy 0, policy_version 1585039 (0.0011) [2023-12-28 06:39:07,064][106225] Updated weights for policy 1, policy_version 1588640 (0.0009) [2023-12-28 06:39:07,111][106225] Updated weights for policy 1, policy_version 1588650 (0.0009) [2023-12-28 06:39:07,163][106225] Updated weights for policy 1, policy_version 1588660 (0.0007) [2023-12-28 06:39:07,184][106226] Updated weights for policy 0, policy_version 1585049 (0.0008) [2023-12-28 06:39:07,246][106226] Updated weights for policy 0, policy_version 1585059 (0.0010) [2023-12-28 06:39:07,311][106226] Updated weights for policy 0, policy_version 1585069 (0.0009) [2023-12-28 06:39:07,373][106226] Updated weights for policy 0, policy_version 1585079 (0.0008) [2023-12-28 06:39:07,839][106225] Updated weights for policy 1, policy_version 1588670 (0.0007) [2023-12-28 06:39:07,905][106225] Updated weights for policy 1, policy_version 1588680 (0.0008) [2023-12-28 06:39:07,966][106225] Updated weights for policy 1, policy_version 1588690 (0.0008) [2023-12-28 06:39:07,970][106226] Updated weights for policy 0, policy_version 1585089 (0.0007) [2023-12-28 06:39:08,031][106226] Updated weights for policy 0, policy_version 1585099 (0.0009) [2023-12-28 06:39:08,086][106226] Updated weights for policy 0, policy_version 1585109 (0.0007) [2023-12-28 06:39:08,645][106225] Updated weights for policy 1, policy_version 1588700 (0.0009) [2023-12-28 06:39:08,697][106226] Updated weights for policy 0, policy_version 1585119 (0.0008) [2023-12-28 06:39:08,709][106225] Updated weights for policy 1, policy_version 1588710 (0.0009) [2023-12-28 06:39:08,751][106226] Updated weights for policy 0, policy_version 1585129 (0.0007) [2023-12-28 06:39:08,773][106225] Updated weights for policy 1, policy_version 1588720 (0.0011) [2023-12-28 06:39:08,813][106226] Updated weights for policy 0, policy_version 1585139 (0.0006) [2023-12-28 06:39:09,511][106226] Updated weights for policy 0, policy_version 1585149 (0.0007) [2023-12-28 06:39:09,528][106225] Updated weights for policy 1, policy_version 1588730 (0.0010) [2023-12-28 06:39:09,567][106226] Updated weights for policy 0, policy_version 1585159 (0.0005) [2023-12-28 06:39:09,586][106225] Updated weights for policy 1, policy_version 1588740 (0.0008) [2023-12-28 06:39:09,624][106226] Updated weights for policy 0, policy_version 1585169 (0.0005) [2023-12-28 06:39:09,654][106225] Updated weights for policy 1, policy_version 1588750 (0.0009) [2023-12-28 06:39:09,716][106225] Updated weights for policy 1, policy_version 1588760 (0.0009) [2023-12-28 06:39:10,297][106226] Updated weights for policy 0, policy_version 1585179 (0.0005) [2023-12-28 06:39:10,359][106226] Updated weights for policy 0, policy_version 1585189 (0.0008) [2023-12-28 06:39:10,422][106226] Updated weights for policy 0, policy_version 1585199 (0.0011) [2023-12-28 06:39:10,522][106225] Updated weights for policy 1, policy_version 1588770 (0.0007) [2023-12-28 06:39:10,580][106225] Updated weights for policy 1, policy_version 1588780 (0.0008) [2023-12-28 06:39:10,642][106225] Updated weights for policy 1, policy_version 1588790 (0.0008) [2023-12-28 06:39:11,151][106226] Updated weights for policy 0, policy_version 1585209 (0.0011) [2023-12-28 06:39:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 812670976. Throughput: 0: 9925.8, 1: 9838.1. Samples: 812645768. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:11,175][105115] Avg episode reward: [(0, '-4.961'), (1, '-4.197')] [2023-12-28 06:39:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001588792_406781952.pth... [2023-12-28 06:39:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001587672_406495232.pth [2023-12-28 06:39:11,223][106226] Updated weights for policy 0, policy_version 1585219 (0.0011) [2023-12-28 06:39:11,296][106226] Updated weights for policy 0, policy_version 1585229 (0.0010) [2023-12-28 06:39:11,372][106226] Updated weights for policy 0, policy_version 1585239 (0.0013) [2023-12-28 06:39:11,374][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001585240_405897216.pth... [2023-12-28 06:39:11,379][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001584024_405585920.pth [2023-12-28 06:39:11,447][106225] Updated weights for policy 1, policy_version 1588800 (0.0008) [2023-12-28 06:39:11,503][106225] Updated weights for policy 1, policy_version 1588810 (0.0008) [2023-12-28 06:39:11,558][106225] Updated weights for policy 1, policy_version 1588820 (0.0008) [2023-12-28 06:39:12,066][106226] Updated weights for policy 0, policy_version 1585249 (0.0011) [2023-12-28 06:39:12,133][106226] Updated weights for policy 0, policy_version 1585259 (0.0011) [2023-12-28 06:39:12,198][106226] Updated weights for policy 0, policy_version 1585269 (0.0009) [2023-12-28 06:39:12,273][106225] Updated weights for policy 1, policy_version 1588830 (0.0008) [2023-12-28 06:39:12,340][106225] Updated weights for policy 1, policy_version 1588840 (0.0007) [2023-12-28 06:39:12,414][106225] Updated weights for policy 1, policy_version 1588850 (0.0007) [2023-12-28 06:39:12,919][106226] Updated weights for policy 0, policy_version 1585279 (0.0010) [2023-12-28 06:39:12,978][106226] Updated weights for policy 0, policy_version 1585289 (0.0011) [2023-12-28 06:39:13,045][106226] Updated weights for policy 0, policy_version 1585299 (0.0011) [2023-12-28 06:39:13,087][106225] Updated weights for policy 1, policy_version 1588860 (0.0008) [2023-12-28 06:39:13,144][106225] Updated weights for policy 1, policy_version 1588870 (0.0008) [2023-12-28 06:39:13,191][106225] Updated weights for policy 1, policy_version 1588880 (0.0008) [2023-12-28 06:39:13,691][106226] Updated weights for policy 0, policy_version 1585309 (0.0010) [2023-12-28 06:39:13,742][106226] Updated weights for policy 0, policy_version 1585319 (0.0009) [2023-12-28 06:39:13,789][106226] Updated weights for policy 0, policy_version 1585329 (0.0007) [2023-12-28 06:39:13,921][106225] Updated weights for policy 1, policy_version 1588890 (0.0008) [2023-12-28 06:39:13,971][106225] Updated weights for policy 1, policy_version 1588900 (0.0008) [2023-12-28 06:39:14,017][106225] Updated weights for policy 1, policy_version 1588910 (0.0009) [2023-12-28 06:39:14,066][106225] Updated weights for policy 1, policy_version 1588920 (0.0008) [2023-12-28 06:39:14,478][106226] Updated weights for policy 0, policy_version 1585339 (0.0008) [2023-12-28 06:39:14,533][106226] Updated weights for policy 0, policy_version 1585349 (0.0006) [2023-12-28 06:39:14,597][106226] Updated weights for policy 0, policy_version 1585359 (0.0007) [2023-12-28 06:39:14,707][106225] Updated weights for policy 1, policy_version 1588930 (0.0008) [2023-12-28 06:39:14,776][106225] Updated weights for policy 1, policy_version 1588940 (0.0008) [2023-12-28 06:39:14,834][106225] Updated weights for policy 1, policy_version 1588950 (0.0008) [2023-12-28 06:39:15,277][106226] Updated weights for policy 0, policy_version 1585369 (0.0010) [2023-12-28 06:39:15,342][106226] Updated weights for policy 0, policy_version 1585379 (0.0010) [2023-12-28 06:39:15,403][106226] Updated weights for policy 0, policy_version 1585389 (0.0011) [2023-12-28 06:39:15,468][106226] Updated weights for policy 0, policy_version 1585399 (0.0007) [2023-12-28 06:39:15,595][106225] Updated weights for policy 1, policy_version 1588960 (0.0007) [2023-12-28 06:39:15,661][106225] Updated weights for policy 1, policy_version 1588970 (0.0005) [2023-12-28 06:39:15,729][106225] Updated weights for policy 1, policy_version 1588980 (0.0005) [2023-12-28 06:39:16,079][106226] Updated weights for policy 0, policy_version 1585409 (0.0011) [2023-12-28 06:39:16,148][106226] Updated weights for policy 0, policy_version 1585419 (0.0010) [2023-12-28 06:39:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 812769280. Throughput: 0: 9940.0, 1: 9708.4. Samples: 812762300. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:16,175][105115] Avg episode reward: [(0, '-4.825'), (1, '-4.867')] [2023-12-28 06:39:16,219][106226] Updated weights for policy 0, policy_version 1585429 (0.0008) [2023-12-28 06:39:16,253][106225] Updated weights for policy 1, policy_version 1588990 (0.0007) [2023-12-28 06:39:16,305][106225] Updated weights for policy 1, policy_version 1589000 (0.0007) [2023-12-28 06:39:16,357][106225] Updated weights for policy 1, policy_version 1589010 (0.0007) [2023-12-28 06:39:16,757][106226] Updated weights for policy 0, policy_version 1585439 (0.0005) [2023-12-28 06:39:16,813][106226] Updated weights for policy 0, policy_version 1585449 (0.0005) [2023-12-28 06:39:16,875][106226] Updated weights for policy 0, policy_version 1585459 (0.0005) [2023-12-28 06:39:17,121][106225] Updated weights for policy 1, policy_version 1589020 (0.0006) [2023-12-28 06:39:17,166][106225] Updated weights for policy 1, policy_version 1589030 (0.0008) [2023-12-28 06:39:17,223][106225] Updated weights for policy 1, policy_version 1589040 (0.0009) [2023-12-28 06:39:17,487][106226] Updated weights for policy 0, policy_version 1585469 (0.0005) [2023-12-28 06:39:17,543][106226] Updated weights for policy 0, policy_version 1585479 (0.0008) [2023-12-28 06:39:17,592][106226] Updated weights for policy 0, policy_version 1585489 (0.0008) [2023-12-28 06:39:17,919][106225] Updated weights for policy 1, policy_version 1589050 (0.0008) [2023-12-28 06:39:17,967][106225] Updated weights for policy 1, policy_version 1589060 (0.0008) [2023-12-28 06:39:18,018][106225] Updated weights for policy 1, policy_version 1589070 (0.0008) [2023-12-28 06:39:18,071][106225] Updated weights for policy 1, policy_version 1589080 (0.0008) [2023-12-28 06:39:18,313][106226] Updated weights for policy 0, policy_version 1585499 (0.0009) [2023-12-28 06:39:18,381][106226] Updated weights for policy 0, policy_version 1585509 (0.0009) [2023-12-28 06:39:18,439][106226] Updated weights for policy 0, policy_version 1585519 (0.0009) [2023-12-28 06:39:18,841][106225] Updated weights for policy 1, policy_version 1589090 (0.0009) [2023-12-28 06:39:18,897][106225] Updated weights for policy 1, policy_version 1589100 (0.0007) [2023-12-28 06:39:18,942][106225] Updated weights for policy 1, policy_version 1589110 (0.0008) [2023-12-28 06:39:19,169][106226] Updated weights for policy 0, policy_version 1585529 (0.0008) [2023-12-28 06:39:19,232][106226] Updated weights for policy 0, policy_version 1585539 (0.0009) [2023-12-28 06:39:19,295][106226] Updated weights for policy 0, policy_version 1585549 (0.0010) [2023-12-28 06:39:19,358][106226] Updated weights for policy 0, policy_version 1585559 (0.0007) [2023-12-28 06:39:19,679][106225] Updated weights for policy 1, policy_version 1589120 (0.0009) [2023-12-28 06:39:19,738][106225] Updated weights for policy 1, policy_version 1589130 (0.0009) [2023-12-28 06:39:19,797][106225] Updated weights for policy 1, policy_version 1589140 (0.0009) [2023-12-28 06:39:20,143][106226] Updated weights for policy 0, policy_version 1585569 (0.0009) [2023-12-28 06:39:20,204][106226] Updated weights for policy 0, policy_version 1585579 (0.0008) [2023-12-28 06:39:20,266][106226] Updated weights for policy 0, policy_version 1585589 (0.0007) [2023-12-28 06:39:20,597][106225] Updated weights for policy 1, policy_version 1589150 (0.0008) [2023-12-28 06:39:20,664][106225] Updated weights for policy 1, policy_version 1589160 (0.0007) [2023-12-28 06:39:20,727][106225] Updated weights for policy 1, policy_version 1589170 (0.0006) [2023-12-28 06:39:21,073][106226] Updated weights for policy 0, policy_version 1585599 (0.0010) [2023-12-28 06:39:21,142][106226] Updated weights for policy 0, policy_version 1585609 (0.0008) [2023-12-28 06:39:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 812867584. Throughput: 0: 9981.7, 1: 9671.4. Samples: 812880332. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:21,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.736')] [2023-12-28 06:39:21,207][106226] Updated weights for policy 0, policy_version 1585619 (0.0007) [2023-12-28 06:39:21,371][106225] Updated weights for policy 1, policy_version 1589180 (0.0008) [2023-12-28 06:39:21,434][106225] Updated weights for policy 1, policy_version 1589190 (0.0011) [2023-12-28 06:39:21,492][106225] Updated weights for policy 1, policy_version 1589200 (0.0011) [2023-12-28 06:39:21,926][106226] Updated weights for policy 0, policy_version 1585629 (0.0008) [2023-12-28 06:39:21,986][106226] Updated weights for policy 0, policy_version 1585639 (0.0008) [2023-12-28 06:39:22,049][106226] Updated weights for policy 0, policy_version 1585649 (0.0008) [2023-12-28 06:39:22,269][106225] Updated weights for policy 1, policy_version 1589210 (0.0010) [2023-12-28 06:39:22,337][106225] Updated weights for policy 1, policy_version 1589220 (0.0008) [2023-12-28 06:39:22,405][106225] Updated weights for policy 1, policy_version 1589230 (0.0008) [2023-12-28 06:39:22,464][106225] Updated weights for policy 1, policy_version 1589240 (0.0008) [2023-12-28 06:39:22,792][106226] Updated weights for policy 0, policy_version 1585659 (0.0008) [2023-12-28 06:39:22,853][106226] Updated weights for policy 0, policy_version 1585669 (0.0008) [2023-12-28 06:39:22,916][106226] Updated weights for policy 0, policy_version 1585679 (0.0008) [2023-12-28 06:39:23,196][106225] Updated weights for policy 1, policy_version 1589250 (0.0010) [2023-12-28 06:39:23,254][106225] Updated weights for policy 1, policy_version 1589260 (0.0010) [2023-12-28 06:39:23,311][106225] Updated weights for policy 1, policy_version 1589270 (0.0011) [2023-12-28 06:39:23,611][106226] Updated weights for policy 0, policy_version 1585689 (0.0007) [2023-12-28 06:39:23,676][106226] Updated weights for policy 0, policy_version 1585699 (0.0007) [2023-12-28 06:39:23,740][106226] Updated weights for policy 0, policy_version 1585709 (0.0008) [2023-12-28 06:39:23,792][106226] Updated weights for policy 0, policy_version 1585719 (0.0008) [2023-12-28 06:39:23,969][106225] Updated weights for policy 1, policy_version 1589280 (0.0006) [2023-12-28 06:39:24,026][106225] Updated weights for policy 1, policy_version 1589290 (0.0006) [2023-12-28 06:39:24,085][106225] Updated weights for policy 1, policy_version 1589300 (0.0005) [2023-12-28 06:39:24,422][106226] Updated weights for policy 0, policy_version 1585729 (0.0010) [2023-12-28 06:39:24,480][106226] Updated weights for policy 0, policy_version 1585739 (0.0010) [2023-12-28 06:39:24,527][106226] Updated weights for policy 0, policy_version 1585749 (0.0007) [2023-12-28 06:39:24,805][106225] Updated weights for policy 1, policy_version 1589310 (0.0009) [2023-12-28 06:39:24,862][106225] Updated weights for policy 1, policy_version 1589320 (0.0008) [2023-12-28 06:39:24,912][106225] Updated weights for policy 1, policy_version 1589330 (0.0009) [2023-12-28 06:39:25,113][106226] Updated weights for policy 0, policy_version 1585759 (0.0009) [2023-12-28 06:39:25,174][106226] Updated weights for policy 0, policy_version 1585769 (0.0009) [2023-12-28 06:39:25,242][106226] Updated weights for policy 0, policy_version 1585779 (0.0008) [2023-12-28 06:39:25,563][106225] Updated weights for policy 1, policy_version 1589340 (0.0008) [2023-12-28 06:39:25,623][106225] Updated weights for policy 1, policy_version 1589350 (0.0010) [2023-12-28 06:39:25,682][106225] Updated weights for policy 1, policy_version 1589360 (0.0009) [2023-12-28 06:39:25,923][106226] Updated weights for policy 0, policy_version 1585789 (0.0010) [2023-12-28 06:39:25,978][106226] Updated weights for policy 0, policy_version 1585799 (0.0007) [2023-12-28 06:39:26,038][106226] Updated weights for policy 0, policy_version 1585809 (0.0009) [2023-12-28 06:39:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 812974080. Throughput: 0: 10002.3, 1: 9615.0. Samples: 812938308. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:26,175][105115] Avg episode reward: [(0, '-4.819'), (1, '-4.715')] [2023-12-28 06:39:26,178][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001589368_406929408.pth... [2023-12-28 06:39:26,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001585816_406044672.pth... [2023-12-28 06:39:26,182][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001588248_406642688.pth [2023-12-28 06:39:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001584632_405741568.pth [2023-12-28 06:39:26,339][106225] Updated weights for policy 1, policy_version 1589370 (0.0008) [2023-12-28 06:39:26,396][106225] Updated weights for policy 1, policy_version 1589380 (0.0010) [2023-12-28 06:39:26,457][106225] Updated weights for policy 1, policy_version 1589390 (0.0010) [2023-12-28 06:39:26,521][106225] Updated weights for policy 1, policy_version 1589400 (0.0010) [2023-12-28 06:39:26,800][106226] Updated weights for policy 0, policy_version 1585819 (0.0011) [2023-12-28 06:39:26,855][106226] Updated weights for policy 0, policy_version 1585829 (0.0010) [2023-12-28 06:39:26,898][106226] Updated weights for policy 0, policy_version 1585839 (0.0010) [2023-12-28 06:39:27,215][106225] Updated weights for policy 1, policy_version 1589410 (0.0008) [2023-12-28 06:39:27,274][106225] Updated weights for policy 1, policy_version 1589420 (0.0008) [2023-12-28 06:39:27,334][106225] Updated weights for policy 1, policy_version 1589430 (0.0008) [2023-12-28 06:39:27,619][106226] Updated weights for policy 0, policy_version 1585849 (0.0010) [2023-12-28 06:39:27,669][106226] Updated weights for policy 0, policy_version 1585859 (0.0005) [2023-12-28 06:39:27,719][106226] Updated weights for policy 0, policy_version 1585869 (0.0007) [2023-12-28 06:39:27,770][106226] Updated weights for policy 0, policy_version 1585879 (0.0010) [2023-12-28 06:39:27,979][106225] Updated weights for policy 1, policy_version 1589440 (0.0007) [2023-12-28 06:39:28,030][106225] Updated weights for policy 1, policy_version 1589450 (0.0006) [2023-12-28 06:39:28,086][106225] Updated weights for policy 1, policy_version 1589460 (0.0005) [2023-12-28 06:39:28,476][106226] Updated weights for policy 0, policy_version 1585889 (0.0008) [2023-12-28 06:39:28,534][106226] Updated weights for policy 0, policy_version 1585899 (0.0008) [2023-12-28 06:39:28,588][106226] Updated weights for policy 0, policy_version 1585909 (0.0008) [2023-12-28 06:39:28,750][106225] Updated weights for policy 1, policy_version 1589470 (0.0007) [2023-12-28 06:39:28,807][106225] Updated weights for policy 1, policy_version 1589480 (0.0009) [2023-12-28 06:39:28,857][106225] Updated weights for policy 1, policy_version 1589490 (0.0009) [2023-12-28 06:39:29,341][106226] Updated weights for policy 0, policy_version 1585919 (0.0008) [2023-12-28 06:39:29,410][106226] Updated weights for policy 0, policy_version 1585929 (0.0009) [2023-12-28 06:39:29,470][106226] Updated weights for policy 0, policy_version 1585939 (0.0010) [2023-12-28 06:39:29,620][106225] Updated weights for policy 1, policy_version 1589500 (0.0008) [2023-12-28 06:39:29,691][106225] Updated weights for policy 1, policy_version 1589510 (0.0009) [2023-12-28 06:39:29,757][106225] Updated weights for policy 1, policy_version 1589520 (0.0006) [2023-12-28 06:39:30,095][106226] Updated weights for policy 0, policy_version 1585949 (0.0011) [2023-12-28 06:39:30,153][106226] Updated weights for policy 0, policy_version 1585959 (0.0011) [2023-12-28 06:39:30,214][106226] Updated weights for policy 0, policy_version 1585969 (0.0011) [2023-12-28 06:39:30,450][106225] Updated weights for policy 1, policy_version 1589530 (0.0007) [2023-12-28 06:39:30,503][106225] Updated weights for policy 1, policy_version 1589540 (0.0007) [2023-12-28 06:39:30,554][106225] Updated weights for policy 1, policy_version 1589550 (0.0010) [2023-12-28 06:39:30,607][106225] Updated weights for policy 1, policy_version 1589560 (0.0010) [2023-12-28 06:39:30,906][106226] Updated weights for policy 0, policy_version 1585979 (0.0010) [2023-12-28 06:39:30,965][106226] Updated weights for policy 0, policy_version 1585989 (0.0011) [2023-12-28 06:39:31,035][106226] Updated weights for policy 0, policy_version 1585999 (0.0011) [2023-12-28 06:39:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 813072384. Throughput: 0: 10108.6, 1: 9710.2. Samples: 813060220. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:31,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-4.460')] [2023-12-28 06:39:31,227][106225] Updated weights for policy 1, policy_version 1589570 (0.0009) [2023-12-28 06:39:31,296][106225] Updated weights for policy 1, policy_version 1589580 (0.0011) [2023-12-28 06:39:31,365][106225] Updated weights for policy 1, policy_version 1589590 (0.0009) [2023-12-28 06:39:31,791][106226] Updated weights for policy 0, policy_version 1586009 (0.0010) [2023-12-28 06:39:31,853][106226] Updated weights for policy 0, policy_version 1586019 (0.0007) [2023-12-28 06:39:31,907][106226] Updated weights for policy 0, policy_version 1586029 (0.0009) [2023-12-28 06:39:31,970][106226] Updated weights for policy 0, policy_version 1586039 (0.0006) [2023-12-28 06:39:32,161][106225] Updated weights for policy 1, policy_version 1589600 (0.0007) [2023-12-28 06:39:32,218][106225] Updated weights for policy 1, policy_version 1589610 (0.0006) [2023-12-28 06:39:32,279][106225] Updated weights for policy 1, policy_version 1589620 (0.0007) [2023-12-28 06:39:32,683][106226] Updated weights for policy 0, policy_version 1586049 (0.0008) [2023-12-28 06:39:32,729][106226] Updated weights for policy 0, policy_version 1586059 (0.0008) [2023-12-28 06:39:32,776][106226] Updated weights for policy 0, policy_version 1586069 (0.0008) [2023-12-28 06:39:32,925][106225] Updated weights for policy 1, policy_version 1589630 (0.0007) [2023-12-28 06:39:32,978][106225] Updated weights for policy 1, policy_version 1589640 (0.0008) [2023-12-28 06:39:33,034][106225] Updated weights for policy 1, policy_version 1589650 (0.0008) [2023-12-28 06:39:33,505][106226] Updated weights for policy 0, policy_version 1586079 (0.0010) [2023-12-28 06:39:33,560][106226] Updated weights for policy 0, policy_version 1586089 (0.0010) [2023-12-28 06:39:33,614][106226] Updated weights for policy 0, policy_version 1586099 (0.0007) [2023-12-28 06:39:33,790][106225] Updated weights for policy 1, policy_version 1589660 (0.0008) [2023-12-28 06:39:33,838][106225] Updated weights for policy 1, policy_version 1589670 (0.0008) [2023-12-28 06:39:33,906][106225] Updated weights for policy 1, policy_version 1589680 (0.0005) [2023-12-28 06:39:34,237][106226] Updated weights for policy 0, policy_version 1586109 (0.0008) [2023-12-28 06:39:34,300][106226] Updated weights for policy 0, policy_version 1586119 (0.0011) [2023-12-28 06:39:34,363][106226] Updated weights for policy 0, policy_version 1586129 (0.0009) [2023-12-28 06:39:34,575][106225] Updated weights for policy 1, policy_version 1589690 (0.0006) [2023-12-28 06:39:34,636][106225] Updated weights for policy 1, policy_version 1589700 (0.0010) [2023-12-28 06:39:34,699][106225] Updated weights for policy 1, policy_version 1589710 (0.0010) [2023-12-28 06:39:34,764][106225] Updated weights for policy 1, policy_version 1589720 (0.0010) [2023-12-28 06:39:35,067][106226] Updated weights for policy 0, policy_version 1586139 (0.0010) [2023-12-28 06:39:35,117][106226] Updated weights for policy 0, policy_version 1586149 (0.0011) [2023-12-28 06:39:35,166][106226] Updated weights for policy 0, policy_version 1586159 (0.0010) [2023-12-28 06:39:35,455][106225] Updated weights for policy 1, policy_version 1589730 (0.0010) [2023-12-28 06:39:35,505][106225] Updated weights for policy 1, policy_version 1589740 (0.0010) [2023-12-28 06:39:35,554][106225] Updated weights for policy 1, policy_version 1589750 (0.0010) [2023-12-28 06:39:35,878][106226] Updated weights for policy 0, policy_version 1586169 (0.0010) [2023-12-28 06:39:35,937][106226] Updated weights for policy 0, policy_version 1586179 (0.0010) [2023-12-28 06:39:35,997][106226] Updated weights for policy 0, policy_version 1586189 (0.0010) [2023-12-28 06:39:36,056][106226] Updated weights for policy 0, policy_version 1586199 (0.0010) [2023-12-28 06:39:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 813170688. Throughput: 0: 10029.2, 1: 9780.9. Samples: 813178920. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:36,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-4.716')] [2023-12-28 06:39:36,320][106225] Updated weights for policy 1, policy_version 1589760 (0.0010) [2023-12-28 06:39:36,379][106225] Updated weights for policy 1, policy_version 1589770 (0.0010) [2023-12-28 06:39:36,445][106225] Updated weights for policy 1, policy_version 1589780 (0.0010) [2023-12-28 06:39:36,766][106226] Updated weights for policy 0, policy_version 1586209 (0.0011) [2023-12-28 06:39:36,817][106226] Updated weights for policy 0, policy_version 1586219 (0.0010) [2023-12-28 06:39:36,869][106226] Updated weights for policy 0, policy_version 1586229 (0.0011) [2023-12-28 06:39:37,184][106225] Updated weights for policy 1, policy_version 1589790 (0.0011) [2023-12-28 06:39:37,241][106225] Updated weights for policy 1, policy_version 1589800 (0.0010) [2023-12-28 06:39:37,288][106225] Updated weights for policy 1, policy_version 1589810 (0.0010) [2023-12-28 06:39:37,579][106226] Updated weights for policy 0, policy_version 1586239 (0.0011) [2023-12-28 06:39:37,640][106226] Updated weights for policy 0, policy_version 1586249 (0.0011) [2023-12-28 06:39:37,708][106226] Updated weights for policy 0, policy_version 1586259 (0.0011) [2023-12-28 06:39:38,023][106225] Updated weights for policy 1, policy_version 1589820 (0.0008) [2023-12-28 06:39:38,084][106225] Updated weights for policy 1, policy_version 1589830 (0.0007) [2023-12-28 06:39:38,142][106225] Updated weights for policy 1, policy_version 1589840 (0.0007) [2023-12-28 06:39:38,399][106226] Updated weights for policy 0, policy_version 1586269 (0.0011) [2023-12-28 06:39:38,467][106226] Updated weights for policy 0, policy_version 1586279 (0.0011) [2023-12-28 06:39:38,530][106226] Updated weights for policy 0, policy_version 1586289 (0.0010) [2023-12-28 06:39:38,894][106225] Updated weights for policy 1, policy_version 1589850 (0.0010) [2023-12-28 06:39:38,948][106225] Updated weights for policy 1, policy_version 1589860 (0.0010) [2023-12-28 06:39:38,994][106225] Updated weights for policy 1, policy_version 1589870 (0.0006) [2023-12-28 06:39:39,048][106225] Updated weights for policy 1, policy_version 1589880 (0.0005) [2023-12-28 06:39:39,242][106226] Updated weights for policy 0, policy_version 1586299 (0.0010) [2023-12-28 06:39:39,311][106226] Updated weights for policy 0, policy_version 1586309 (0.0007) [2023-12-28 06:39:39,386][106226] Updated weights for policy 0, policy_version 1586319 (0.0008) [2023-12-28 06:39:39,790][106225] Updated weights for policy 1, policy_version 1589890 (0.0008) [2023-12-28 06:39:39,856][106225] Updated weights for policy 1, policy_version 1589900 (0.0008) [2023-12-28 06:39:39,925][106225] Updated weights for policy 1, policy_version 1589910 (0.0009) [2023-12-28 06:39:40,033][106226] Updated weights for policy 0, policy_version 1586329 (0.0008) [2023-12-28 06:39:40,092][106226] Updated weights for policy 0, policy_version 1586339 (0.0008) [2023-12-28 06:39:40,152][106226] Updated weights for policy 0, policy_version 1586349 (0.0008) [2023-12-28 06:39:40,213][106226] Updated weights for policy 0, policy_version 1586359 (0.0008) [2023-12-28 06:39:40,660][106225] Updated weights for policy 1, policy_version 1589920 (0.0010) [2023-12-28 06:39:40,723][106225] Updated weights for policy 1, policy_version 1589930 (0.0010) [2023-12-28 06:39:40,787][106225] Updated weights for policy 1, policy_version 1589940 (0.0010) [2023-12-28 06:39:40,881][106226] Updated weights for policy 0, policy_version 1586369 (0.0008) [2023-12-28 06:39:40,939][106226] Updated weights for policy 0, policy_version 1586379 (0.0008) [2023-12-28 06:39:40,996][106226] Updated weights for policy 0, policy_version 1586389 (0.0008) [2023-12-28 06:39:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 813268992. Throughput: 0: 10000.3, 1: 9779.3. Samples: 813236968. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:41,175][105115] Avg episode reward: [(0, '-5.035'), (1, '-4.779')] [2023-12-28 06:39:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001589944_407076864.pth... [2023-12-28 06:39:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001586392_406192128.pth... [2023-12-28 06:39:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001588792_406781952.pth [2023-12-28 06:39:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001585240_405897216.pth [2023-12-28 06:39:41,520][106225] Updated weights for policy 1, policy_version 1589950 (0.0008) [2023-12-28 06:39:41,591][106225] Updated weights for policy 1, policy_version 1589960 (0.0007) [2023-12-28 06:39:41,658][106225] Updated weights for policy 1, policy_version 1589970 (0.0010) [2023-12-28 06:39:41,778][106226] Updated weights for policy 0, policy_version 1586399 (0.0008) [2023-12-28 06:39:41,837][106226] Updated weights for policy 0, policy_version 1586409 (0.0008) [2023-12-28 06:39:41,899][106226] Updated weights for policy 0, policy_version 1586419 (0.0007) [2023-12-28 06:39:42,405][106225] Updated weights for policy 1, policy_version 1589980 (0.0010) [2023-12-28 06:39:42,467][106225] Updated weights for policy 1, policy_version 1589990 (0.0008) [2023-12-28 06:39:42,534][106225] Updated weights for policy 1, policy_version 1590000 (0.0010) [2023-12-28 06:39:42,631][106226] Updated weights for policy 0, policy_version 1586429 (0.0007) [2023-12-28 06:39:42,692][106226] Updated weights for policy 0, policy_version 1586439 (0.0008) [2023-12-28 06:39:42,745][106226] Updated weights for policy 0, policy_version 1586449 (0.0008) [2023-12-28 06:39:43,241][106225] Updated weights for policy 1, policy_version 1590010 (0.0010) [2023-12-28 06:39:43,297][106225] Updated weights for policy 1, policy_version 1590020 (0.0010) [2023-12-28 06:39:43,357][106225] Updated weights for policy 1, policy_version 1590030 (0.0010) [2023-12-28 06:39:43,391][106226] Updated weights for policy 0, policy_version 1586459 (0.0011) [2023-12-28 06:39:43,412][106225] Updated weights for policy 1, policy_version 1590040 (0.0010) [2023-12-28 06:39:43,453][106226] Updated weights for policy 0, policy_version 1586469 (0.0010) [2023-12-28 06:39:43,516][106226] Updated weights for policy 0, policy_version 1586479 (0.0008) [2023-12-28 06:39:44,047][106225] Updated weights for policy 1, policy_version 1590050 (0.0008) [2023-12-28 06:39:44,096][106226] Updated weights for policy 0, policy_version 1586489 (0.0005) [2023-12-28 06:39:44,102][106225] Updated weights for policy 1, policy_version 1590060 (0.0007) [2023-12-28 06:39:44,157][106225] Updated weights for policy 1, policy_version 1590070 (0.0006) [2023-12-28 06:39:44,158][106226] Updated weights for policy 0, policy_version 1586499 (0.0007) [2023-12-28 06:39:44,215][106226] Updated weights for policy 0, policy_version 1586509 (0.0010) [2023-12-28 06:39:44,272][106226] Updated weights for policy 0, policy_version 1586519 (0.0011) [2023-12-28 06:39:44,927][106225] Updated weights for policy 1, policy_version 1590080 (0.0009) [2023-12-28 06:39:44,984][106226] Updated weights for policy 0, policy_version 1586529 (0.0008) [2023-12-28 06:39:44,989][106225] Updated weights for policy 1, policy_version 1590090 (0.0007) [2023-12-28 06:39:45,050][106226] Updated weights for policy 0, policy_version 1586539 (0.0006) [2023-12-28 06:39:45,051][106225] Updated weights for policy 1, policy_version 1590100 (0.0008) [2023-12-28 06:39:45,105][106226] Updated weights for policy 0, policy_version 1586549 (0.0008) [2023-12-28 06:39:45,695][106226] Updated weights for policy 0, policy_version 1586559 (0.0008) [2023-12-28 06:39:45,740][106226] Updated weights for policy 0, policy_version 1586569 (0.0009) [2023-12-28 06:39:45,788][106226] Updated weights for policy 0, policy_version 1586579 (0.0008) [2023-12-28 06:39:45,819][106225] Updated weights for policy 1, policy_version 1590110 (0.0009) [2023-12-28 06:39:45,877][106225] Updated weights for policy 1, policy_version 1590120 (0.0010) [2023-12-28 06:39:45,934][106225] Updated weights for policy 1, policy_version 1590130 (0.0010) [2023-12-28 06:39:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 813367296. Throughput: 0: 10019.0, 1: 9771.1. Samples: 813354028. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:46,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-4.698')] [2023-12-28 06:39:46,443][106226] Updated weights for policy 0, policy_version 1586589 (0.0006) [2023-12-28 06:39:46,500][106226] Updated weights for policy 0, policy_version 1586599 (0.0005) [2023-12-28 06:39:46,551][106226] Updated weights for policy 0, policy_version 1586609 (0.0005) [2023-12-28 06:39:46,653][106225] Updated weights for policy 1, policy_version 1590140 (0.0010) [2023-12-28 06:39:46,714][106225] Updated weights for policy 1, policy_version 1590150 (0.0010) [2023-12-28 06:39:46,771][106225] Updated weights for policy 1, policy_version 1590160 (0.0008) [2023-12-28 06:39:47,177][106226] Updated weights for policy 0, policy_version 1586619 (0.0005) [2023-12-28 06:39:47,230][106226] Updated weights for policy 0, policy_version 1586629 (0.0005) [2023-12-28 06:39:47,283][106226] Updated weights for policy 0, policy_version 1586639 (0.0005) [2023-12-28 06:39:47,500][106225] Updated weights for policy 1, policy_version 1590170 (0.0008) [2023-12-28 06:39:47,551][106225] Updated weights for policy 1, policy_version 1590180 (0.0005) [2023-12-28 06:39:47,605][106225] Updated weights for policy 1, policy_version 1590190 (0.0005) [2023-12-28 06:39:47,656][106225] Updated weights for policy 1, policy_version 1590200 (0.0007) [2023-12-28 06:39:47,919][106226] Updated weights for policy 0, policy_version 1586649 (0.0006) [2023-12-28 06:39:47,987][106226] Updated weights for policy 0, policy_version 1586659 (0.0008) [2023-12-28 06:39:48,038][106226] Updated weights for policy 0, policy_version 1586669 (0.0007) [2023-12-28 06:39:48,093][106226] Updated weights for policy 0, policy_version 1586679 (0.0009) [2023-12-28 06:39:48,235][106225] Updated weights for policy 1, policy_version 1590210 (0.0006) [2023-12-28 06:39:48,283][106225] Updated weights for policy 1, policy_version 1590220 (0.0008) [2023-12-28 06:39:48,335][106225] Updated weights for policy 1, policy_version 1590230 (0.0008) [2023-12-28 06:39:48,810][106226] Updated weights for policy 0, policy_version 1586689 (0.0009) [2023-12-28 06:39:48,869][106226] Updated weights for policy 0, policy_version 1586699 (0.0009) [2023-12-28 06:39:48,921][106226] Updated weights for policy 0, policy_version 1586709 (0.0008) [2023-12-28 06:39:49,113][106225] Updated weights for policy 1, policy_version 1590240 (0.0009) [2023-12-28 06:39:49,171][106225] Updated weights for policy 1, policy_version 1590250 (0.0008) [2023-12-28 06:39:49,247][106225] Updated weights for policy 1, policy_version 1590260 (0.0008) [2023-12-28 06:39:49,618][106226] Updated weights for policy 0, policy_version 1586719 (0.0006) [2023-12-28 06:39:49,692][106226] Updated weights for policy 0, policy_version 1586729 (0.0010) [2023-12-28 06:39:49,761][106226] Updated weights for policy 0, policy_version 1586739 (0.0008) [2023-12-28 06:39:49,980][106225] Updated weights for policy 1, policy_version 1590270 (0.0008) [2023-12-28 06:39:50,040][106225] Updated weights for policy 1, policy_version 1590280 (0.0008) [2023-12-28 06:39:50,096][106225] Updated weights for policy 1, policy_version 1590290 (0.0008) [2023-12-28 06:39:50,480][106226] Updated weights for policy 0, policy_version 1586749 (0.0008) [2023-12-28 06:39:50,532][106226] Updated weights for policy 0, policy_version 1586759 (0.0008) [2023-12-28 06:39:50,599][106226] Updated weights for policy 0, policy_version 1586769 (0.0008) [2023-12-28 06:39:50,803][106225] Updated weights for policy 1, policy_version 1590300 (0.0007) [2023-12-28 06:39:50,863][106225] Updated weights for policy 1, policy_version 1590310 (0.0006) [2023-12-28 06:39:50,919][106225] Updated weights for policy 1, policy_version 1590320 (0.0006) [2023-12-28 06:39:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 813465600. Throughput: 0: 10012.1, 1: 9752.4. Samples: 813472996. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:51,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.576')] [2023-12-28 06:39:51,380][106226] Updated weights for policy 0, policy_version 1586779 (0.0009) [2023-12-28 06:39:51,443][106226] Updated weights for policy 0, policy_version 1586789 (0.0006) [2023-12-28 06:39:51,512][106226] Updated weights for policy 0, policy_version 1586799 (0.0006) [2023-12-28 06:39:51,620][106225] Updated weights for policy 1, policy_version 1590330 (0.0007) [2023-12-28 06:39:51,692][106225] Updated weights for policy 1, policy_version 1590340 (0.0006) [2023-12-28 06:39:51,765][106225] Updated weights for policy 1, policy_version 1590350 (0.0008) [2023-12-28 06:39:51,830][106225] Updated weights for policy 1, policy_version 1590360 (0.0008) [2023-12-28 06:39:52,165][106226] Updated weights for policy 0, policy_version 1586809 (0.0008) [2023-12-28 06:39:52,223][106226] Updated weights for policy 0, policy_version 1586819 (0.0006) [2023-12-28 06:39:52,285][106226] Updated weights for policy 0, policy_version 1586829 (0.0007) [2023-12-28 06:39:52,351][106226] Updated weights for policy 0, policy_version 1586839 (0.0008) [2023-12-28 06:39:52,509][106225] Updated weights for policy 1, policy_version 1590370 (0.0008) [2023-12-28 06:39:52,560][106225] Updated weights for policy 1, policy_version 1590380 (0.0008) [2023-12-28 06:39:52,611][106225] Updated weights for policy 1, policy_version 1590390 (0.0007) [2023-12-28 06:39:53,100][106226] Updated weights for policy 0, policy_version 1586849 (0.0008) [2023-12-28 06:39:53,152][106226] Updated weights for policy 0, policy_version 1586859 (0.0009) [2023-12-28 06:39:53,175][106225] Updated weights for policy 1, policy_version 1590400 (0.0007) [2023-12-28 06:39:53,207][106226] Updated weights for policy 0, policy_version 1586869 (0.0008) [2023-12-28 06:39:53,226][106225] Updated weights for policy 1, policy_version 1590410 (0.0005) [2023-12-28 06:39:53,277][106225] Updated weights for policy 1, policy_version 1590420 (0.0009) [2023-12-28 06:39:53,959][106225] Updated weights for policy 1, policy_version 1590430 (0.0010) [2023-12-28 06:39:53,965][106226] Updated weights for policy 0, policy_version 1586879 (0.0006) [2023-12-28 06:39:54,013][106225] Updated weights for policy 1, policy_version 1590440 (0.0010) [2023-12-28 06:39:54,016][106226] Updated weights for policy 0, policy_version 1586889 (0.0006) [2023-12-28 06:39:54,061][106225] Updated weights for policy 1, policy_version 1590450 (0.0010) [2023-12-28 06:39:54,070][106226] Updated weights for policy 0, policy_version 1586899 (0.0006) [2023-12-28 06:39:54,691][106225] Updated weights for policy 1, policy_version 1590460 (0.0010) [2023-12-28 06:39:54,741][106225] Updated weights for policy 1, policy_version 1590470 (0.0010) [2023-12-28 06:39:54,786][106225] Updated weights for policy 1, policy_version 1590480 (0.0010) [2023-12-28 06:39:54,856][106226] Updated weights for policy 0, policy_version 1586909 (0.0007) [2023-12-28 06:39:54,920][106226] Updated weights for policy 0, policy_version 1586919 (0.0008) [2023-12-28 06:39:54,973][106226] Updated weights for policy 0, policy_version 1586929 (0.0008) [2023-12-28 06:39:55,415][106225] Updated weights for policy 1, policy_version 1590490 (0.0008) [2023-12-28 06:39:55,466][106225] Updated weights for policy 1, policy_version 1590500 (0.0005) [2023-12-28 06:39:55,513][106225] Updated weights for policy 1, policy_version 1590510 (0.0006) [2023-12-28 06:39:55,562][106225] Updated weights for policy 1, policy_version 1590520 (0.0005) [2023-12-28 06:39:55,796][106226] Updated weights for policy 0, policy_version 1586939 (0.0008) [2023-12-28 06:39:55,853][106226] Updated weights for policy 0, policy_version 1586949 (0.0008) [2023-12-28 06:39:55,904][106226] Updated weights for policy 0, policy_version 1586959 (0.0008) [2023-12-28 06:39:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 813563904. Throughput: 0: 9937.6, 1: 9771.6. Samples: 813532684. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:39:56,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.562')] [2023-12-28 06:39:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001586968_406339584.pth... [2023-12-28 06:39:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001585816_406044672.pth [2023-12-28 06:39:56,203][106225] Updated weights for policy 1, policy_version 1590530 (0.0010) [2023-12-28 06:39:56,266][106225] Updated weights for policy 1, policy_version 1590540 (0.0010) [2023-12-28 06:39:56,322][106225] Updated weights for policy 1, policy_version 1590550 (0.0010) [2023-12-28 06:39:56,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001590552_407232512.pth... [2023-12-28 06:39:56,337][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001589368_406929408.pth [2023-12-28 06:39:56,657][106226] Updated weights for policy 0, policy_version 1586969 (0.0008) [2023-12-28 06:39:56,717][106226] Updated weights for policy 0, policy_version 1586979 (0.0008) [2023-12-28 06:39:56,778][106226] Updated weights for policy 0, policy_version 1586989 (0.0010) [2023-12-28 06:39:56,846][106226] Updated weights for policy 0, policy_version 1586999 (0.0009) [2023-12-28 06:39:56,946][106225] Updated weights for policy 1, policy_version 1590560 (0.0006) [2023-12-28 06:39:56,990][106225] Updated weights for policy 1, policy_version 1590570 (0.0005) [2023-12-28 06:39:57,033][106225] Updated weights for policy 1, policy_version 1590580 (0.0005) [2023-12-28 06:39:57,559][106225] Updated weights for policy 1, policy_version 1590590 (0.0005) [2023-12-28 06:39:57,617][106225] Updated weights for policy 1, policy_version 1590600 (0.0006) [2023-12-28 06:39:57,669][106226] Updated weights for policy 0, policy_version 1587009 (0.0006) [2023-12-28 06:39:57,679][106225] Updated weights for policy 1, policy_version 1590610 (0.0008) [2023-12-28 06:39:57,729][106226] Updated weights for policy 0, policy_version 1587019 (0.0009) [2023-12-28 06:39:57,777][106226] Updated weights for policy 0, policy_version 1587029 (0.0008) [2023-12-28 06:39:58,289][106225] Updated weights for policy 1, policy_version 1590620 (0.0007) [2023-12-28 06:39:58,364][106225] Updated weights for policy 1, policy_version 1590630 (0.0009) [2023-12-28 06:39:58,428][106225] Updated weights for policy 1, policy_version 1590640 (0.0008) [2023-12-28 06:39:58,605][106226] Updated weights for policy 0, policy_version 1587039 (0.0008) [2023-12-28 06:39:58,683][106226] Updated weights for policy 0, policy_version 1587049 (0.0009) [2023-12-28 06:39:58,743][106226] Updated weights for policy 0, policy_version 1587059 (0.0008) [2023-12-28 06:39:59,229][106225] Updated weights for policy 1, policy_version 1590650 (0.0009) [2023-12-28 06:39:59,296][106225] Updated weights for policy 1, policy_version 1590660 (0.0009) [2023-12-28 06:39:59,360][106225] Updated weights for policy 1, policy_version 1590670 (0.0008) [2023-12-28 06:39:59,417][106225] Updated weights for policy 1, policy_version 1590680 (0.0006) [2023-12-28 06:39:59,534][106226] Updated weights for policy 0, policy_version 1587069 (0.0008) [2023-12-28 06:39:59,598][106226] Updated weights for policy 0, policy_version 1587079 (0.0005) [2023-12-28 06:39:59,653][106226] Updated weights for policy 0, policy_version 1587089 (0.0007) [2023-12-28 06:40:00,111][106225] Updated weights for policy 1, policy_version 1590690 (0.0007) [2023-12-28 06:40:00,158][106225] Updated weights for policy 1, policy_version 1590700 (0.0005) [2023-12-28 06:40:00,217][106225] Updated weights for policy 1, policy_version 1590710 (0.0006) [2023-12-28 06:40:00,339][106226] Updated weights for policy 0, policy_version 1587099 (0.0008) [2023-12-28 06:40:00,389][106226] Updated weights for policy 0, policy_version 1587109 (0.0006) [2023-12-28 06:40:00,457][106226] Updated weights for policy 0, policy_version 1587119 (0.0008) [2023-12-28 06:40:00,847][106225] Updated weights for policy 1, policy_version 1590720 (0.0008) [2023-12-28 06:40:00,894][106225] Updated weights for policy 1, policy_version 1590730 (0.0008) [2023-12-28 06:40:00,939][106225] Updated weights for policy 1, policy_version 1590740 (0.0008) [2023-12-28 06:40:01,171][106226] Updated weights for policy 0, policy_version 1587129 (0.0008) [2023-12-28 06:40:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 813662208. Throughput: 0: 9809.0, 1: 9925.9. Samples: 813650376. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-28 06:40:01,175][105115] Avg episode reward: [(0, '-4.800'), (1, '-4.744')] [2023-12-28 06:40:01,240][106226] Updated weights for policy 0, policy_version 1587139 (0.0007) [2023-12-28 06:40:01,296][106226] Updated weights for policy 0, policy_version 1587149 (0.0008) [2023-12-28 06:40:01,361][106226] Updated weights for policy 0, policy_version 1587159 (0.0007) [2023-12-28 06:40:01,815][106225] Updated weights for policy 1, policy_version 1590750 (0.0006) [2023-12-28 06:40:01,881][106225] Updated weights for policy 1, policy_version 1590760 (0.0005) [2023-12-28 06:40:01,938][106225] Updated weights for policy 1, policy_version 1590770 (0.0005) [2023-12-28 06:40:02,126][106226] Updated weights for policy 0, policy_version 1587169 (0.0009) [2023-12-28 06:40:02,187][106226] Updated weights for policy 0, policy_version 1587179 (0.0008) [2023-12-28 06:40:02,256][106226] Updated weights for policy 0, policy_version 1587189 (0.0007) [2023-12-28 06:40:02,618][106225] Updated weights for policy 1, policy_version 1590780 (0.0006) [2023-12-28 06:40:02,684][106225] Updated weights for policy 1, policy_version 1590790 (0.0009) [2023-12-28 06:40:02,743][106225] Updated weights for policy 1, policy_version 1590800 (0.0009) [2023-12-28 06:40:02,957][106226] Updated weights for policy 0, policy_version 1587199 (0.0006) [2023-12-28 06:40:03,015][106226] Updated weights for policy 0, policy_version 1587209 (0.0008) [2023-12-28 06:40:03,076][106226] Updated weights for policy 0, policy_version 1587219 (0.0010) [2023-12-28 06:40:03,427][106225] Updated weights for policy 1, policy_version 1590810 (0.0006) [2023-12-28 06:40:03,485][106225] Updated weights for policy 1, policy_version 1590820 (0.0007) [2023-12-28 06:40:03,538][106225] Updated weights for policy 1, policy_version 1590830 (0.0007) [2023-12-28 06:40:03,597][106225] Updated weights for policy 1, policy_version 1590840 (0.0008) [2023-12-28 06:40:03,700][106226] Updated weights for policy 0, policy_version 1587229 (0.0011) [2023-12-28 06:40:03,750][106226] Updated weights for policy 0, policy_version 1587239 (0.0010) [2023-12-28 06:40:03,803][106226] Updated weights for policy 0, policy_version 1587249 (0.0010) [2023-12-28 06:40:04,345][106225] Updated weights for policy 1, policy_version 1590850 (0.0009) [2023-12-28 06:40:04,411][106225] Updated weights for policy 1, policy_version 1590860 (0.0008) [2023-12-28 06:40:04,474][106225] Updated weights for policy 1, policy_version 1590870 (0.0010) [2023-12-28 06:40:04,509][106226] Updated weights for policy 0, policy_version 1587259 (0.0008) [2023-12-28 06:40:04,575][106226] Updated weights for policy 0, policy_version 1587269 (0.0005) [2023-12-28 06:40:04,643][106226] Updated weights for policy 0, policy_version 1587279 (0.0009) [2023-12-28 06:40:05,161][106225] Updated weights for policy 1, policy_version 1590880 (0.0009) [2023-12-28 06:40:05,223][106225] Updated weights for policy 1, policy_version 1590890 (0.0008) [2023-12-28 06:40:05,255][106226] Updated weights for policy 0, policy_version 1587289 (0.0010) [2023-12-28 06:40:05,283][106225] Updated weights for policy 1, policy_version 1590900 (0.0008) [2023-12-28 06:40:05,313][106226] Updated weights for policy 0, policy_version 1587299 (0.0010) [2023-12-28 06:40:05,370][106226] Updated weights for policy 0, policy_version 1587309 (0.0010) [2023-12-28 06:40:05,423][106226] Updated weights for policy 0, policy_version 1587319 (0.0010) [2023-12-28 06:40:05,908][106225] Updated weights for policy 1, policy_version 1590910 (0.0008) [2023-12-28 06:40:05,967][106225] Updated weights for policy 1, policy_version 1590920 (0.0008) [2023-12-28 06:40:06,026][106225] Updated weights for policy 1, policy_version 1590930 (0.0008) [2023-12-28 06:40:06,149][106226] Updated weights for policy 0, policy_version 1587329 (0.0007) [2023-12-28 06:40:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 813760512. Throughput: 0: 9818.1, 1: 9952.5. Samples: 813770004. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:06,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.506')] [2023-12-28 06:40:06,212][106226] Updated weights for policy 0, policy_version 1587339 (0.0007) [2023-12-28 06:40:06,273][106226] Updated weights for policy 0, policy_version 1587349 (0.0005) [2023-12-28 06:40:06,787][106225] Updated weights for policy 1, policy_version 1590940 (0.0009) [2023-12-28 06:40:06,839][106225] Updated weights for policy 1, policy_version 1590950 (0.0006) [2023-12-28 06:40:06,888][106225] Updated weights for policy 1, policy_version 1590960 (0.0005) [2023-12-28 06:40:06,945][106226] Updated weights for policy 0, policy_version 1587359 (0.0007) [2023-12-28 06:40:07,015][106226] Updated weights for policy 0, policy_version 1587369 (0.0007) [2023-12-28 06:40:07,078][106226] Updated weights for policy 0, policy_version 1587379 (0.0007) [2023-12-28 06:40:07,509][106225] Updated weights for policy 1, policy_version 1590970 (0.0006) [2023-12-28 06:40:07,573][106225] Updated weights for policy 1, policy_version 1590980 (0.0008) [2023-12-28 06:40:07,631][106225] Updated weights for policy 1, policy_version 1590990 (0.0008) [2023-12-28 06:40:07,699][106225] Updated weights for policy 1, policy_version 1591000 (0.0006) [2023-12-28 06:40:07,843][106226] Updated weights for policy 0, policy_version 1587389 (0.0009) [2023-12-28 06:40:07,896][106226] Updated weights for policy 0, policy_version 1587399 (0.0008) [2023-12-28 06:40:07,960][106226] Updated weights for policy 0, policy_version 1587409 (0.0009) [2023-12-28 06:40:08,371][106225] Updated weights for policy 1, policy_version 1591010 (0.0008) [2023-12-28 06:40:08,430][106225] Updated weights for policy 1, policy_version 1591020 (0.0008) [2023-12-28 06:40:08,489][106225] Updated weights for policy 1, policy_version 1591030 (0.0006) [2023-12-28 06:40:08,694][106226] Updated weights for policy 0, policy_version 1587419 (0.0006) [2023-12-28 06:40:08,756][106226] Updated weights for policy 0, policy_version 1587429 (0.0009) [2023-12-28 06:40:08,813][106226] Updated weights for policy 0, policy_version 1587439 (0.0008) [2023-12-28 06:40:09,172][106225] Updated weights for policy 1, policy_version 1591040 (0.0008) [2023-12-28 06:40:09,245][106225] Updated weights for policy 1, policy_version 1591050 (0.0009) [2023-12-28 06:40:09,301][106225] Updated weights for policy 1, policy_version 1591060 (0.0008) [2023-12-28 06:40:09,530][106226] Updated weights for policy 0, policy_version 1587449 (0.0009) [2023-12-28 06:40:09,595][106226] Updated weights for policy 0, policy_version 1587459 (0.0009) [2023-12-28 06:40:09,660][106226] Updated weights for policy 0, policy_version 1587469 (0.0009) [2023-12-28 06:40:09,727][106226] Updated weights for policy 0, policy_version 1587479 (0.0010) [2023-12-28 06:40:09,985][106225] Updated weights for policy 1, policy_version 1591070 (0.0007) [2023-12-28 06:40:10,055][106225] Updated weights for policy 1, policy_version 1591080 (0.0008) [2023-12-28 06:40:10,117][106225] Updated weights for policy 1, policy_version 1591090 (0.0008) [2023-12-28 06:40:10,538][106226] Updated weights for policy 0, policy_version 1587489 (0.0006) [2023-12-28 06:40:10,599][106226] Updated weights for policy 0, policy_version 1587499 (0.0005) [2023-12-28 06:40:10,662][106226] Updated weights for policy 0, policy_version 1587509 (0.0009) [2023-12-28 06:40:10,798][106225] Updated weights for policy 1, policy_version 1591100 (0.0007) [2023-12-28 06:40:10,858][106225] Updated weights for policy 1, policy_version 1591110 (0.0010) [2023-12-28 06:40:10,917][106225] Updated weights for policy 1, policy_version 1591120 (0.0009) [2023-12-28 06:40:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 813858816. Throughput: 0: 9803.8, 1: 9986.4. Samples: 813828868. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:11,175][105115] Avg episode reward: [(0, '-4.943'), (1, '-4.386')] [2023-12-28 06:40:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001591128_407379968.pth... [2023-12-28 06:40:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001587512_406478848.pth... [2023-12-28 06:40:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001586392_406192128.pth [2023-12-28 06:40:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001589944_407076864.pth [2023-12-28 06:40:11,429][106226] Updated weights for policy 0, policy_version 1587519 (0.0008) [2023-12-28 06:40:11,491][106226] Updated weights for policy 0, policy_version 1587529 (0.0007) [2023-12-28 06:40:11,556][106226] Updated weights for policy 0, policy_version 1587539 (0.0009) [2023-12-28 06:40:11,676][106225] Updated weights for policy 1, policy_version 1591130 (0.0010) [2023-12-28 06:40:11,737][106225] Updated weights for policy 1, policy_version 1591140 (0.0009) [2023-12-28 06:40:11,803][106225] Updated weights for policy 1, policy_version 1591150 (0.0008) [2023-12-28 06:40:11,867][106225] Updated weights for policy 1, policy_version 1591160 (0.0009) [2023-12-28 06:40:12,293][106226] Updated weights for policy 0, policy_version 1587549 (0.0010) [2023-12-28 06:40:12,355][106226] Updated weights for policy 0, policy_version 1587559 (0.0009) [2023-12-28 06:40:12,423][106226] Updated weights for policy 0, policy_version 1587569 (0.0009) [2023-12-28 06:40:12,613][106225] Updated weights for policy 1, policy_version 1591170 (0.0009) [2023-12-28 06:40:12,676][106225] Updated weights for policy 1, policy_version 1591180 (0.0008) [2023-12-28 06:40:12,747][106225] Updated weights for policy 1, policy_version 1591190 (0.0009) [2023-12-28 06:40:13,182][106226] Updated weights for policy 0, policy_version 1587579 (0.0007) [2023-12-28 06:40:13,243][106226] Updated weights for policy 0, policy_version 1587589 (0.0007) [2023-12-28 06:40:13,295][106226] Updated weights for policy 0, policy_version 1587599 (0.0005) [2023-12-28 06:40:13,367][106225] Updated weights for policy 1, policy_version 1591200 (0.0007) [2023-12-28 06:40:13,429][106225] Updated weights for policy 1, policy_version 1591210 (0.0005) [2023-12-28 06:40:13,491][106225] Updated weights for policy 1, policy_version 1591220 (0.0005) [2023-12-28 06:40:13,844][106226] Updated weights for policy 0, policy_version 1587609 (0.0006) [2023-12-28 06:40:13,901][106226] Updated weights for policy 0, policy_version 1587619 (0.0008) [2023-12-28 06:40:13,962][106226] Updated weights for policy 0, policy_version 1587629 (0.0005) [2023-12-28 06:40:14,011][106225] Updated weights for policy 1, policy_version 1591230 (0.0005) [2023-12-28 06:40:14,026][106226] Updated weights for policy 0, policy_version 1587639 (0.0005) [2023-12-28 06:40:14,067][106225] Updated weights for policy 1, policy_version 1591240 (0.0005) [2023-12-28 06:40:14,123][106225] Updated weights for policy 1, policy_version 1591250 (0.0006) [2023-12-28 06:40:14,625][106226] Updated weights for policy 0, policy_version 1587649 (0.0006) [2023-12-28 06:40:14,675][106226] Updated weights for policy 0, policy_version 1587659 (0.0006) [2023-12-28 06:40:14,706][106225] Updated weights for policy 1, policy_version 1591260 (0.0009) [2023-12-28 06:40:14,737][106226] Updated weights for policy 0, policy_version 1587669 (0.0005) [2023-12-28 06:40:14,755][106225] Updated weights for policy 1, policy_version 1591270 (0.0008) [2023-12-28 06:40:14,823][106225] Updated weights for policy 1, policy_version 1591280 (0.0008) [2023-12-28 06:40:15,477][106225] Updated weights for policy 1, policy_version 1591290 (0.0007) [2023-12-28 06:40:15,526][106226] Updated weights for policy 0, policy_version 1587679 (0.0006) [2023-12-28 06:40:15,537][106225] Updated weights for policy 1, policy_version 1591300 (0.0008) [2023-12-28 06:40:15,585][106225] Updated weights for policy 1, policy_version 1591310 (0.0005) [2023-12-28 06:40:15,586][106226] Updated weights for policy 0, policy_version 1587689 (0.0008) [2023-12-28 06:40:15,631][106225] Updated weights for policy 1, policy_version 1591320 (0.0005) [2023-12-28 06:40:15,639][106226] Updated weights for policy 0, policy_version 1587699 (0.0008) [2023-12-28 06:40:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 813957120. Throughput: 0: 9757.7, 1: 9991.8. Samples: 813948948. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:16,175][105115] Avg episode reward: [(0, '-4.907'), (1, '-4.927')] [2023-12-28 06:40:16,335][106225] Updated weights for policy 1, policy_version 1591330 (0.0008) [2023-12-28 06:40:16,341][106226] Updated weights for policy 0, policy_version 1587709 (0.0007) [2023-12-28 06:40:16,391][106225] Updated weights for policy 1, policy_version 1591340 (0.0007) [2023-12-28 06:40:16,401][106226] Updated weights for policy 0, policy_version 1587719 (0.0009) [2023-12-28 06:40:16,453][106225] Updated weights for policy 1, policy_version 1591350 (0.0008) [2023-12-28 06:40:16,455][106226] Updated weights for policy 0, policy_version 1587729 (0.0006) [2023-12-28 06:40:17,142][106226] Updated weights for policy 0, policy_version 1587739 (0.0007) [2023-12-28 06:40:17,198][106225] Updated weights for policy 1, policy_version 1591360 (0.0006) [2023-12-28 06:40:17,198][106226] Updated weights for policy 0, policy_version 1587749 (0.0009) [2023-12-28 06:40:17,252][106225] Updated weights for policy 1, policy_version 1591370 (0.0010) [2023-12-28 06:40:17,257][106226] Updated weights for policy 0, policy_version 1587759 (0.0008) [2023-12-28 06:40:17,305][106225] Updated weights for policy 1, policy_version 1591380 (0.0010) [2023-12-28 06:40:17,861][106225] Updated weights for policy 1, policy_version 1591390 (0.0006) [2023-12-28 06:40:17,910][106225] Updated weights for policy 1, policy_version 1591400 (0.0006) [2023-12-28 06:40:17,951][106226] Updated weights for policy 0, policy_version 1587769 (0.0005) [2023-12-28 06:40:17,968][106225] Updated weights for policy 1, policy_version 1591410 (0.0008) [2023-12-28 06:40:18,001][106226] Updated weights for policy 0, policy_version 1587779 (0.0007) [2023-12-28 06:40:18,068][106226] Updated weights for policy 0, policy_version 1587789 (0.0009) [2023-12-28 06:40:18,130][106226] Updated weights for policy 0, policy_version 1587799 (0.0007) [2023-12-28 06:40:18,579][106225] Updated weights for policy 1, policy_version 1591420 (0.0005) [2023-12-28 06:40:18,631][106225] Updated weights for policy 1, policy_version 1591430 (0.0005) [2023-12-28 06:40:18,689][106225] Updated weights for policy 1, policy_version 1591440 (0.0005) [2023-12-28 06:40:18,928][106226] Updated weights for policy 0, policy_version 1587809 (0.0006) [2023-12-28 06:40:19,001][106226] Updated weights for policy 0, policy_version 1587819 (0.0006) [2023-12-28 06:40:19,071][106226] Updated weights for policy 0, policy_version 1587829 (0.0005) [2023-12-28 06:40:19,353][106225] Updated weights for policy 1, policy_version 1591450 (0.0006) [2023-12-28 06:40:19,431][106225] Updated weights for policy 1, policy_version 1591460 (0.0010) [2023-12-28 06:40:19,493][106225] Updated weights for policy 1, policy_version 1591470 (0.0008) [2023-12-28 06:40:19,559][106225] Updated weights for policy 1, policy_version 1591480 (0.0010) [2023-12-28 06:40:19,745][106226] Updated weights for policy 0, policy_version 1587839 (0.0006) [2023-12-28 06:40:19,816][106226] Updated weights for policy 0, policy_version 1587849 (0.0007) [2023-12-28 06:40:19,883][106226] Updated weights for policy 0, policy_version 1587859 (0.0008) [2023-12-28 06:40:20,259][106225] Updated weights for policy 1, policy_version 1591490 (0.0006) [2023-12-28 06:40:20,324][106225] Updated weights for policy 1, policy_version 1591500 (0.0006) [2023-12-28 06:40:20,389][106225] Updated weights for policy 1, policy_version 1591510 (0.0008) [2023-12-28 06:40:20,635][106226] Updated weights for policy 0, policy_version 1587870 (0.0010) [2023-12-28 06:40:20,703][106226] Updated weights for policy 0, policy_version 1587880 (0.0010) [2023-12-28 06:40:20,773][106226] Updated weights for policy 0, policy_version 1587890 (0.0007) [2023-12-28 06:40:21,094][106225] Updated weights for policy 1, policy_version 1591520 (0.0009) [2023-12-28 06:40:21,159][106225] Updated weights for policy 1, policy_version 1591530 (0.0009) [2023-12-28 06:40:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 814055424. Throughput: 0: 9706.4, 1: 10057.9. Samples: 814068312. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:21,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-4.617')] [2023-12-28 06:40:21,222][106225] Updated weights for policy 1, policy_version 1591540 (0.0008) [2023-12-28 06:40:21,567][106226] Updated weights for policy 0, policy_version 1587900 (0.0009) [2023-12-28 06:40:21,630][106226] Updated weights for policy 0, policy_version 1587910 (0.0008) [2023-12-28 06:40:21,700][106226] Updated weights for policy 0, policy_version 1587920 (0.0008) [2023-12-28 06:40:22,098][106225] Updated weights for policy 1, policy_version 1591550 (0.0008) [2023-12-28 06:40:22,154][106225] Updated weights for policy 1, policy_version 1591560 (0.0009) [2023-12-28 06:40:22,209][106225] Updated weights for policy 1, policy_version 1591570 (0.0009) [2023-12-28 06:40:22,400][106226] Updated weights for policy 0, policy_version 1587930 (0.0008) [2023-12-28 06:40:22,453][106226] Updated weights for policy 0, policy_version 1587940 (0.0008) [2023-12-28 06:40:22,511][106226] Updated weights for policy 0, policy_version 1587950 (0.0008) [2023-12-28 06:40:22,569][106226] Updated weights for policy 0, policy_version 1587960 (0.0008) [2023-12-28 06:40:22,995][106225] Updated weights for policy 1, policy_version 1591580 (0.0009) [2023-12-28 06:40:23,048][106225] Updated weights for policy 1, policy_version 1591590 (0.0008) [2023-12-28 06:40:23,106][106225] Updated weights for policy 1, policy_version 1591600 (0.0010) [2023-12-28 06:40:23,328][106226] Updated weights for policy 0, policy_version 1587970 (0.0008) [2023-12-28 06:40:23,378][106226] Updated weights for policy 0, policy_version 1587980 (0.0008) [2023-12-28 06:40:23,438][106226] Updated weights for policy 0, policy_version 1587991 (0.0009) [2023-12-28 06:40:23,672][106225] Updated weights for policy 1, policy_version 1591610 (0.0007) [2023-12-28 06:40:23,740][106225] Updated weights for policy 1, policy_version 1591620 (0.0008) [2023-12-28 06:40:23,807][106225] Updated weights for policy 1, policy_version 1591630 (0.0008) [2023-12-28 06:40:23,867][106225] Updated weights for policy 1, policy_version 1591640 (0.0009) [2023-12-28 06:40:24,163][106226] Updated weights for policy 0, policy_version 1588001 (0.0006) [2023-12-28 06:40:24,215][106226] Updated weights for policy 0, policy_version 1588011 (0.0005) [2023-12-28 06:40:24,262][106226] Updated weights for policy 0, policy_version 1588021 (0.0005) [2023-12-28 06:40:24,531][106225] Updated weights for policy 1, policy_version 1591650 (0.0005) [2023-12-28 06:40:24,592][106225] Updated weights for policy 1, policy_version 1591660 (0.0005) [2023-12-28 06:40:24,649][106225] Updated weights for policy 1, policy_version 1591670 (0.0005) [2023-12-28 06:40:24,821][106226] Updated weights for policy 0, policy_version 1588031 (0.0005) [2023-12-28 06:40:24,875][106226] Updated weights for policy 0, policy_version 1588041 (0.0005) [2023-12-28 06:40:24,924][106226] Updated weights for policy 0, policy_version 1588051 (0.0005) [2023-12-28 06:40:25,310][106225] Updated weights for policy 1, policy_version 1591680 (0.0007) [2023-12-28 06:40:25,381][106225] Updated weights for policy 1, policy_version 1591690 (0.0009) [2023-12-28 06:40:25,435][106225] Updated weights for policy 1, policy_version 1591700 (0.0008) [2023-12-28 06:40:25,475][106226] Updated weights for policy 0, policy_version 1588061 (0.0007) [2023-12-28 06:40:25,531][106226] Updated weights for policy 0, policy_version 1588071 (0.0009) [2023-12-28 06:40:25,587][106226] Updated weights for policy 0, policy_version 1588081 (0.0008) [2023-12-28 06:40:26,165][106225] Updated weights for policy 1, policy_version 1591710 (0.0008) [2023-12-28 06:40:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 814153728. Throughput: 0: 9662.9, 1: 10059.9. Samples: 814124496. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:26,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.709')] [2023-12-28 06:40:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001588088_406626304.pth... [2023-12-28 06:40:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001586968_406339584.pth [2023-12-28 06:40:26,214][106225] Updated weights for policy 1, policy_version 1591720 (0.0008) [2023-12-28 06:40:26,248][106226] Updated weights for policy 0, policy_version 1588091 (0.0008) [2023-12-28 06:40:26,267][106225] Updated weights for policy 1, policy_version 1591730 (0.0008) [2023-12-28 06:40:26,301][106226] Updated weights for policy 0, policy_version 1588101 (0.0005) [2023-12-28 06:40:26,301][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001591736_407535616.pth... [2023-12-28 06:40:26,305][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001590552_407232512.pth [2023-12-28 06:40:26,352][106226] Updated weights for policy 0, policy_version 1588111 (0.0007) [2023-12-28 06:40:26,974][106225] Updated weights for policy 1, policy_version 1591740 (0.0007) [2023-12-28 06:40:27,027][106226] Updated weights for policy 0, policy_version 1588121 (0.0010) [2023-12-28 06:40:27,030][106225] Updated weights for policy 1, policy_version 1591750 (0.0006) [2023-12-28 06:40:27,077][106226] Updated weights for policy 0, policy_version 1588131 (0.0008) [2023-12-28 06:40:27,080][106225] Updated weights for policy 1, policy_version 1591760 (0.0008) [2023-12-28 06:40:27,131][106226] Updated weights for policy 0, policy_version 1588141 (0.0007) [2023-12-28 06:40:27,193][106226] Updated weights for policy 0, policy_version 1588151 (0.0009) [2023-12-28 06:40:27,737][106225] Updated weights for policy 1, policy_version 1591770 (0.0007) [2023-12-28 06:40:27,803][106225] Updated weights for policy 1, policy_version 1591780 (0.0009) [2023-12-28 06:40:27,818][106226] Updated weights for policy 0, policy_version 1588161 (0.0008) [2023-12-28 06:40:27,859][106225] Updated weights for policy 1, policy_version 1591790 (0.0007) [2023-12-28 06:40:27,872][106226] Updated weights for policy 0, policy_version 1588171 (0.0008) [2023-12-28 06:40:27,920][106225] Updated weights for policy 1, policy_version 1591800 (0.0007) [2023-12-28 06:40:27,938][106226] Updated weights for policy 0, policy_version 1588181 (0.0007) [2023-12-28 06:40:28,527][106226] Updated weights for policy 0, policy_version 1588191 (0.0009) [2023-12-28 06:40:28,581][106226] Updated weights for policy 0, policy_version 1588201 (0.0008) [2023-12-28 06:40:28,627][106225] Updated weights for policy 1, policy_version 1591810 (0.0007) [2023-12-28 06:40:28,638][106226] Updated weights for policy 0, policy_version 1588211 (0.0010) [2023-12-28 06:40:28,685][106225] Updated weights for policy 1, policy_version 1591820 (0.0008) [2023-12-28 06:40:28,747][106225] Updated weights for policy 1, policy_version 1591830 (0.0008) [2023-12-28 06:40:29,370][106226] Updated weights for policy 0, policy_version 1588221 (0.0009) [2023-12-28 06:40:29,432][106226] Updated weights for policy 0, policy_version 1588231 (0.0006) [2023-12-28 06:40:29,484][106225] Updated weights for policy 1, policy_version 1591840 (0.0008) [2023-12-28 06:40:29,488][106226] Updated weights for policy 0, policy_version 1588241 (0.0006) [2023-12-28 06:40:29,535][106225] Updated weights for policy 1, policy_version 1591850 (0.0008) [2023-12-28 06:40:29,582][106225] Updated weights for policy 1, policy_version 1591860 (0.0008) [2023-12-28 06:40:30,185][106226] Updated weights for policy 0, policy_version 1588251 (0.0009) [2023-12-28 06:40:30,252][106226] Updated weights for policy 0, policy_version 1588261 (0.0005) [2023-12-28 06:40:30,315][106226] Updated weights for policy 0, policy_version 1588271 (0.0008) [2023-12-28 06:40:30,368][106225] Updated weights for policy 1, policy_version 1591870 (0.0008) [2023-12-28 06:40:30,428][106225] Updated weights for policy 1, policy_version 1591880 (0.0010) [2023-12-28 06:40:30,485][106225] Updated weights for policy 1, policy_version 1591890 (0.0009) [2023-12-28 06:40:30,851][106226] Updated weights for policy 0, policy_version 1588281 (0.0006) [2023-12-28 06:40:30,911][106226] Updated weights for policy 0, policy_version 1588291 (0.0006) [2023-12-28 06:40:30,964][106226] Updated weights for policy 0, policy_version 1588301 (0.0008) [2023-12-28 06:40:31,017][106226] Updated weights for policy 0, policy_version 1588311 (0.0009) [2023-12-28 06:40:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 814260224. Throughput: 0: 9786.3, 1: 10093.0. Samples: 814248596. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:31,175][105115] Avg episode reward: [(0, '-5.086'), (1, '-4.953')] [2023-12-28 06:40:31,265][106225] Updated weights for policy 1, policy_version 1591900 (0.0009) [2023-12-28 06:40:31,327][106225] Updated weights for policy 1, policy_version 1591910 (0.0008) [2023-12-28 06:40:31,392][106225] Updated weights for policy 1, policy_version 1591920 (0.0007) [2023-12-28 06:40:31,776][106226] Updated weights for policy 0, policy_version 1588321 (0.0008) [2023-12-28 06:40:31,834][106226] Updated weights for policy 0, policy_version 1588331 (0.0008) [2023-12-28 06:40:31,893][106226] Updated weights for policy 0, policy_version 1588341 (0.0009) [2023-12-28 06:40:32,091][106225] Updated weights for policy 1, policy_version 1591930 (0.0007) [2023-12-28 06:40:32,149][106225] Updated weights for policy 1, policy_version 1591940 (0.0008) [2023-12-28 06:40:32,211][106225] Updated weights for policy 1, policy_version 1591950 (0.0009) [2023-12-28 06:40:32,276][106225] Updated weights for policy 1, policy_version 1591960 (0.0008) [2023-12-28 06:40:32,711][106226] Updated weights for policy 0, policy_version 1588351 (0.0008) [2023-12-28 06:40:32,771][106226] Updated weights for policy 0, policy_version 1588361 (0.0009) [2023-12-28 06:40:32,827][106226] Updated weights for policy 0, policy_version 1588371 (0.0008) [2023-12-28 06:40:32,985][106225] Updated weights for policy 1, policy_version 1591970 (0.0009) [2023-12-28 06:40:33,042][106225] Updated weights for policy 1, policy_version 1591980 (0.0010) [2023-12-28 06:40:33,091][106225] Updated weights for policy 1, policy_version 1591990 (0.0010) [2023-12-28 06:40:33,572][106226] Updated weights for policy 0, policy_version 1588381 (0.0009) [2023-12-28 06:40:33,627][106226] Updated weights for policy 0, policy_version 1588391 (0.0006) [2023-12-28 06:40:33,686][106226] Updated weights for policy 0, policy_version 1588401 (0.0007) [2023-12-28 06:40:33,787][106225] Updated weights for policy 1, policy_version 1592000 (0.0009) [2023-12-28 06:40:33,836][106225] Updated weights for policy 1, policy_version 1592010 (0.0005) [2023-12-28 06:40:33,884][106225] Updated weights for policy 1, policy_version 1592020 (0.0005) [2023-12-28 06:40:34,417][106226] Updated weights for policy 0, policy_version 1588411 (0.0007) [2023-12-28 06:40:34,472][106226] Updated weights for policy 0, policy_version 1588421 (0.0007) [2023-12-28 06:40:34,525][106226] Updated weights for policy 0, policy_version 1588431 (0.0007) [2023-12-28 06:40:34,617][106225] Updated weights for policy 1, policy_version 1592030 (0.0008) [2023-12-28 06:40:34,671][106225] Updated weights for policy 1, policy_version 1592040 (0.0010) [2023-12-28 06:40:34,732][106225] Updated weights for policy 1, policy_version 1592050 (0.0010) [2023-12-28 06:40:35,306][106225] Updated weights for policy 1, policy_version 1592060 (0.0010) [2023-12-28 06:40:35,352][106226] Updated weights for policy 0, policy_version 1588441 (0.0008) [2023-12-28 06:40:35,362][106225] Updated weights for policy 1, policy_version 1592070 (0.0010) [2023-12-28 06:40:35,411][106226] Updated weights for policy 0, policy_version 1588451 (0.0007) [2023-12-28 06:40:35,427][106225] Updated weights for policy 1, policy_version 1592080 (0.0010) [2023-12-28 06:40:35,473][106226] Updated weights for policy 0, policy_version 1588461 (0.0010) [2023-12-28 06:40:35,530][106226] Updated weights for policy 0, policy_version 1588471 (0.0008) [2023-12-28 06:40:36,101][106225] Updated weights for policy 1, policy_version 1592090 (0.0007) [2023-12-28 06:40:36,166][106225] Updated weights for policy 1, policy_version 1592100 (0.0008) [2023-12-28 06:40:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 814350336. Throughput: 0: 9706.8, 1: 10134.9. Samples: 814365868. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:36,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.864')] [2023-12-28 06:40:36,234][106225] Updated weights for policy 1, policy_version 1592110 (0.0007) [2023-12-28 06:40:36,261][106226] Updated weights for policy 0, policy_version 1588481 (0.0009) [2023-12-28 06:40:36,296][106225] Updated weights for policy 1, policy_version 1592120 (0.0006) [2023-12-28 06:40:36,332][106226] Updated weights for policy 0, policy_version 1588491 (0.0010) [2023-12-28 06:40:36,401][106226] Updated weights for policy 0, policy_version 1588501 (0.0010) [2023-12-28 06:40:36,990][106226] Updated weights for policy 0, policy_version 1588511 (0.0007) [2023-12-28 06:40:37,018][106225] Updated weights for policy 1, policy_version 1592130 (0.0006) [2023-12-28 06:40:37,052][106226] Updated weights for policy 0, policy_version 1588521 (0.0006) [2023-12-28 06:40:37,075][106225] Updated weights for policy 1, policy_version 1592140 (0.0007) [2023-12-28 06:40:37,113][106226] Updated weights for policy 0, policy_version 1588531 (0.0006) [2023-12-28 06:40:37,136][106225] Updated weights for policy 1, policy_version 1592150 (0.0009) [2023-12-28 06:40:37,710][106226] Updated weights for policy 0, policy_version 1588541 (0.0006) [2023-12-28 06:40:37,767][106226] Updated weights for policy 0, policy_version 1588551 (0.0006) [2023-12-28 06:40:37,819][106226] Updated weights for policy 0, policy_version 1588561 (0.0005) [2023-12-28 06:40:37,904][106225] Updated weights for policy 1, policy_version 1592160 (0.0010) [2023-12-28 06:40:37,971][106225] Updated weights for policy 1, policy_version 1592170 (0.0010) [2023-12-28 06:40:38,029][106225] Updated weights for policy 1, policy_version 1592180 (0.0010) [2023-12-28 06:40:38,466][106226] Updated weights for policy 0, policy_version 1588571 (0.0006) [2023-12-28 06:40:38,528][106226] Updated weights for policy 0, policy_version 1588581 (0.0008) [2023-12-28 06:40:38,593][106226] Updated weights for policy 0, policy_version 1588591 (0.0008) [2023-12-28 06:40:38,779][106225] Updated weights for policy 1, policy_version 1592190 (0.0011) [2023-12-28 06:40:38,851][106225] Updated weights for policy 1, policy_version 1592200 (0.0011) [2023-12-28 06:40:38,923][106225] Updated weights for policy 1, policy_version 1592210 (0.0007) [2023-12-28 06:40:39,352][106226] Updated weights for policy 0, policy_version 1588601 (0.0008) [2023-12-28 06:40:39,424][106226] Updated weights for policy 0, policy_version 1588611 (0.0008) [2023-12-28 06:40:39,480][106226] Updated weights for policy 0, policy_version 1588621 (0.0008) [2023-12-28 06:40:39,543][106226] Updated weights for policy 0, policy_version 1588631 (0.0007) [2023-12-28 06:40:39,604][106225] Updated weights for policy 1, policy_version 1592220 (0.0008) [2023-12-28 06:40:39,673][106225] Updated weights for policy 1, policy_version 1592230 (0.0011) [2023-12-28 06:40:39,743][106225] Updated weights for policy 1, policy_version 1592240 (0.0007) [2023-12-28 06:40:40,288][106226] Updated weights for policy 0, policy_version 1588641 (0.0009) [2023-12-28 06:40:40,348][106226] Updated weights for policy 0, policy_version 1588651 (0.0008) [2023-12-28 06:40:40,423][106226] Updated weights for policy 0, policy_version 1588661 (0.0006) [2023-12-28 06:40:40,440][106225] Updated weights for policy 1, policy_version 1592250 (0.0006) [2023-12-28 06:40:40,501][106225] Updated weights for policy 1, policy_version 1592260 (0.0007) [2023-12-28 06:40:40,556][106225] Updated weights for policy 1, policy_version 1592270 (0.0008) [2023-12-28 06:40:40,604][106225] Updated weights for policy 1, policy_version 1592280 (0.0008) [2023-12-28 06:40:41,101][106226] Updated weights for policy 0, policy_version 1588671 (0.0008) [2023-12-28 06:40:41,160][106226] Updated weights for policy 0, policy_version 1588681 (0.0010) [2023-12-28 06:40:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 814448640. Throughput: 0: 9773.8, 1: 10075.8. Samples: 814425916. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:41,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.653')] [2023-12-28 06:40:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001592280_407674880.pth... [2023-12-28 06:40:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001591128_407379968.pth [2023-12-28 06:40:41,226][106226] Updated weights for policy 0, policy_version 1588691 (0.0010) [2023-12-28 06:40:41,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001588696_406781952.pth... [2023-12-28 06:40:41,260][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001587512_406478848.pth [2023-12-28 06:40:41,366][106225] Updated weights for policy 1, policy_version 1592290 (0.0008) [2023-12-28 06:40:41,426][106225] Updated weights for policy 1, policy_version 1592300 (0.0008) [2023-12-28 06:40:41,491][106225] Updated weights for policy 1, policy_version 1592310 (0.0008) [2023-12-28 06:40:42,031][106226] Updated weights for policy 0, policy_version 1588701 (0.0008) [2023-12-28 06:40:42,099][106226] Updated weights for policy 0, policy_version 1588711 (0.0009) [2023-12-28 06:40:42,162][106226] Updated weights for policy 0, policy_version 1588721 (0.0007) [2023-12-28 06:40:42,180][106225] Updated weights for policy 1, policy_version 1592320 (0.0008) [2023-12-28 06:40:42,240][106225] Updated weights for policy 1, policy_version 1592330 (0.0008) [2023-12-28 06:40:42,302][106225] Updated weights for policy 1, policy_version 1592340 (0.0009) [2023-12-28 06:40:42,922][106226] Updated weights for policy 0, policy_version 1588731 (0.0007) [2023-12-28 06:40:42,978][106226] Updated weights for policy 0, policy_version 1588741 (0.0009) [2023-12-28 06:40:43,031][106226] Updated weights for policy 0, policy_version 1588751 (0.0009) [2023-12-28 06:40:43,035][106225] Updated weights for policy 1, policy_version 1592350 (0.0007) [2023-12-28 06:40:43,086][106225] Updated weights for policy 1, policy_version 1592360 (0.0005) [2023-12-28 06:40:43,136][106225] Updated weights for policy 1, policy_version 1592370 (0.0008) [2023-12-28 06:40:43,774][106225] Updated weights for policy 1, policy_version 1592380 (0.0007) [2023-12-28 06:40:43,803][106226] Updated weights for policy 0, policy_version 1588761 (0.0008) [2023-12-28 06:40:43,827][106225] Updated weights for policy 1, policy_version 1592390 (0.0005) [2023-12-28 06:40:43,866][106226] Updated weights for policy 0, policy_version 1588771 (0.0008) [2023-12-28 06:40:43,875][106225] Updated weights for policy 1, policy_version 1592400 (0.0005) [2023-12-28 06:40:43,933][106226] Updated weights for policy 0, policy_version 1588781 (0.0008) [2023-12-28 06:40:43,988][106226] Updated weights for policy 0, policy_version 1588791 (0.0008) [2023-12-28 06:40:44,448][106225] Updated weights for policy 1, policy_version 1592410 (0.0005) [2023-12-28 06:40:44,513][106225] Updated weights for policy 1, policy_version 1592420 (0.0005) [2023-12-28 06:40:44,578][106225] Updated weights for policy 1, policy_version 1592430 (0.0005) [2023-12-28 06:40:44,639][106225] Updated weights for policy 1, policy_version 1592440 (0.0005) [2023-12-28 06:40:44,809][106226] Updated weights for policy 0, policy_version 1588801 (0.0009) [2023-12-28 06:40:44,870][106226] Updated weights for policy 0, policy_version 1588811 (0.0008) [2023-12-28 06:40:44,936][106226] Updated weights for policy 0, policy_version 1588821 (0.0008) [2023-12-28 06:40:45,323][106225] Updated weights for policy 1, policy_version 1592450 (0.0008) [2023-12-28 06:40:45,379][106225] Updated weights for policy 1, policy_version 1592460 (0.0008) [2023-12-28 06:40:45,434][106225] Updated weights for policy 1, policy_version 1592470 (0.0006) [2023-12-28 06:40:45,678][106226] Updated weights for policy 0, policy_version 1588831 (0.0006) [2023-12-28 06:40:45,743][106226] Updated weights for policy 0, policy_version 1588841 (0.0006) [2023-12-28 06:40:45,801][106226] Updated weights for policy 0, policy_version 1588851 (0.0009) [2023-12-28 06:40:46,010][106225] Updated weights for policy 1, policy_version 1592480 (0.0005) [2023-12-28 06:40:46,071][106225] Updated weights for policy 1, policy_version 1592490 (0.0007) [2023-12-28 06:40:46,124][106225] Updated weights for policy 1, policy_version 1592500 (0.0009) [2023-12-28 06:40:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 814555136. Throughput: 0: 9785.2, 1: 9996.8. Samples: 814540564. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:46,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.656')] [2023-12-28 06:40:46,477][106226] Updated weights for policy 0, policy_version 1588861 (0.0009) [2023-12-28 06:40:46,541][106226] Updated weights for policy 0, policy_version 1588871 (0.0008) [2023-12-28 06:40:46,600][106226] Updated weights for policy 0, policy_version 1588881 (0.0008) [2023-12-28 06:40:46,811][106225] Updated weights for policy 1, policy_version 1592510 (0.0006) [2023-12-28 06:40:46,874][106225] Updated weights for policy 1, policy_version 1592520 (0.0005) [2023-12-28 06:40:46,927][106225] Updated weights for policy 1, policy_version 1592530 (0.0005) [2023-12-28 06:40:47,408][106226] Updated weights for policy 0, policy_version 1588891 (0.0007) [2023-12-28 06:40:47,460][106225] Updated weights for policy 1, policy_version 1592540 (0.0005) [2023-12-28 06:40:47,461][106226] Updated weights for policy 0, policy_version 1588901 (0.0009) [2023-12-28 06:40:47,513][106225] Updated weights for policy 1, policy_version 1592550 (0.0006) [2023-12-28 06:40:47,515][106226] Updated weights for policy 0, policy_version 1588911 (0.0007) [2023-12-28 06:40:47,568][106225] Updated weights for policy 1, policy_version 1592560 (0.0007) [2023-12-28 06:40:48,170][106225] Updated weights for policy 1, policy_version 1592570 (0.0008) [2023-12-28 06:40:48,227][106225] Updated weights for policy 1, policy_version 1592580 (0.0006) [2023-12-28 06:40:48,281][106225] Updated weights for policy 1, policy_version 1592590 (0.0005) [2023-12-28 06:40:48,331][106226] Updated weights for policy 0, policy_version 1588921 (0.0006) [2023-12-28 06:40:48,346][106225] Updated weights for policy 1, policy_version 1592600 (0.0007) [2023-12-28 06:40:48,400][106226] Updated weights for policy 0, policy_version 1588931 (0.0007) [2023-12-28 06:40:48,462][106226] Updated weights for policy 0, policy_version 1588941 (0.0008) [2023-12-28 06:40:48,528][106226] Updated weights for policy 0, policy_version 1588951 (0.0009) [2023-12-28 06:40:48,996][106225] Updated weights for policy 1, policy_version 1592610 (0.0007) [2023-12-28 06:40:49,043][106225] Updated weights for policy 1, policy_version 1592620 (0.0005) [2023-12-28 06:40:49,090][106225] Updated weights for policy 1, policy_version 1592630 (0.0008) [2023-12-28 06:40:49,206][106226] Updated weights for policy 0, policy_version 1588961 (0.0006) [2023-12-28 06:40:49,275][106226] Updated weights for policy 0, policy_version 1588971 (0.0012) [2023-12-28 06:40:49,332][106226] Updated weights for policy 0, policy_version 1588981 (0.0009) [2023-12-28 06:40:49,843][106225] Updated weights for policy 1, policy_version 1592640 (0.0009) [2023-12-28 06:40:49,903][106225] Updated weights for policy 1, policy_version 1592650 (0.0008) [2023-12-28 06:40:49,961][106225] Updated weights for policy 1, policy_version 1592660 (0.0009) [2023-12-28 06:40:50,086][106226] Updated weights for policy 0, policy_version 1588991 (0.0007) [2023-12-28 06:40:50,145][106226] Updated weights for policy 0, policy_version 1589001 (0.0008) [2023-12-28 06:40:50,212][106226] Updated weights for policy 0, policy_version 1589011 (0.0009) [2023-12-28 06:40:50,677][106225] Updated weights for policy 1, policy_version 1592670 (0.0009) [2023-12-28 06:40:50,740][106225] Updated weights for policy 1, policy_version 1592680 (0.0009) [2023-12-28 06:40:50,806][106225] Updated weights for policy 1, policy_version 1592690 (0.0009) [2023-12-28 06:40:50,904][106226] Updated weights for policy 0, policy_version 1589021 (0.0008) [2023-12-28 06:40:50,966][106226] Updated weights for policy 0, policy_version 1589031 (0.0008) [2023-12-28 06:40:51,032][106226] Updated weights for policy 0, policy_version 1589041 (0.0009) [2023-12-28 06:40:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 814653440. Throughput: 0: 9705.9, 1: 10066.7. Samples: 814659776. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:51,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-4.557')] [2023-12-28 06:40:51,516][106225] Updated weights for policy 1, policy_version 1592700 (0.0010) [2023-12-28 06:40:51,583][106225] Updated weights for policy 1, policy_version 1592710 (0.0010) [2023-12-28 06:40:51,656][106225] Updated weights for policy 1, policy_version 1592720 (0.0008) [2023-12-28 06:40:51,742][106226] Updated weights for policy 0, policy_version 1589051 (0.0008) [2023-12-28 06:40:51,813][106226] Updated weights for policy 0, policy_version 1589061 (0.0008) [2023-12-28 06:40:51,877][106226] Updated weights for policy 0, policy_version 1589071 (0.0008) [2023-12-28 06:40:52,443][106225] Updated weights for policy 1, policy_version 1592730 (0.0008) [2023-12-28 06:40:52,498][106225] Updated weights for policy 1, policy_version 1592740 (0.0006) [2023-12-28 06:40:52,555][106225] Updated weights for policy 1, policy_version 1592750 (0.0010) [2023-12-28 06:40:52,616][106225] Updated weights for policy 1, policy_version 1592760 (0.0010) [2023-12-28 06:40:52,626][106226] Updated weights for policy 0, policy_version 1589081 (0.0008) [2023-12-28 06:40:52,686][106226] Updated weights for policy 0, policy_version 1589091 (0.0008) [2023-12-28 06:40:52,752][106226] Updated weights for policy 0, policy_version 1589101 (0.0008) [2023-12-28 06:40:52,816][106226] Updated weights for policy 0, policy_version 1589111 (0.0008) [2023-12-28 06:40:53,321][106225] Updated weights for policy 1, policy_version 1592770 (0.0010) [2023-12-28 06:40:53,375][106225] Updated weights for policy 1, policy_version 1592780 (0.0010) [2023-12-28 06:40:53,428][106225] Updated weights for policy 1, policy_version 1592790 (0.0010) [2023-12-28 06:40:53,541][106226] Updated weights for policy 0, policy_version 1589121 (0.0008) [2023-12-28 06:40:53,603][106226] Updated weights for policy 0, policy_version 1589131 (0.0008) [2023-12-28 06:40:53,671][106226] Updated weights for policy 0, policy_version 1589141 (0.0009) [2023-12-28 06:40:54,108][106225] Updated weights for policy 1, policy_version 1592800 (0.0006) [2023-12-28 06:40:54,160][106225] Updated weights for policy 1, policy_version 1592810 (0.0006) [2023-12-28 06:40:54,207][106225] Updated weights for policy 1, policy_version 1592820 (0.0005) [2023-12-28 06:40:54,336][106226] Updated weights for policy 0, policy_version 1589151 (0.0007) [2023-12-28 06:40:54,401][106226] Updated weights for policy 0, policy_version 1589161 (0.0005) [2023-12-28 06:40:54,466][106226] Updated weights for policy 0, policy_version 1589171 (0.0008) [2023-12-28 06:40:54,806][106225] Updated weights for policy 1, policy_version 1592830 (0.0006) [2023-12-28 06:40:54,861][106225] Updated weights for policy 1, policy_version 1592840 (0.0005) [2023-12-28 06:40:54,949][106225] Updated weights for policy 1, policy_version 1592850 (0.0005) [2023-12-28 06:40:55,103][106226] Updated weights for policy 0, policy_version 1589181 (0.0008) [2023-12-28 06:40:55,154][106226] Updated weights for policy 0, policy_version 1589191 (0.0008) [2023-12-28 06:40:55,207][106226] Updated weights for policy 0, policy_version 1589201 (0.0007) [2023-12-28 06:40:55,562][106225] Updated weights for policy 1, policy_version 1592860 (0.0007) [2023-12-28 06:40:55,615][106225] Updated weights for policy 1, policy_version 1592870 (0.0010) [2023-12-28 06:40:55,664][106225] Updated weights for policy 1, policy_version 1592880 (0.0010) [2023-12-28 06:40:55,937][106226] Updated weights for policy 0, policy_version 1589211 (0.0008) [2023-12-28 06:40:55,983][106226] Updated weights for policy 0, policy_version 1589221 (0.0008) [2023-12-28 06:40:56,035][106226] Updated weights for policy 0, policy_version 1589231 (0.0008) [2023-12-28 06:40:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 814751744. Throughput: 0: 9714.5, 1: 10023.8. Samples: 814717088. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:40:56,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.709')] [2023-12-28 06:40:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001592888_407830528.pth... [2023-12-28 06:40:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001589240_406921216.pth... [2023-12-28 06:40:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001591736_407535616.pth [2023-12-28 06:40:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001588088_406626304.pth [2023-12-28 06:40:56,380][106225] Updated weights for policy 1, policy_version 1592890 (0.0010) [2023-12-28 06:40:56,433][106225] Updated weights for policy 1, policy_version 1592900 (0.0010) [2023-12-28 06:40:56,479][106225] Updated weights for policy 1, policy_version 1592910 (0.0010) [2023-12-28 06:40:56,543][106225] Updated weights for policy 1, policy_version 1592920 (0.0010) [2023-12-28 06:40:56,775][106226] Updated weights for policy 0, policy_version 1589241 (0.0007) [2023-12-28 06:40:56,828][106226] Updated weights for policy 0, policy_version 1589251 (0.0008) [2023-12-28 06:40:56,881][106226] Updated weights for policy 0, policy_version 1589261 (0.0008) [2023-12-28 06:40:56,937][106226] Updated weights for policy 0, policy_version 1589271 (0.0008) [2023-12-28 06:40:57,282][106225] Updated weights for policy 1, policy_version 1592930 (0.0008) [2023-12-28 06:40:57,333][106225] Updated weights for policy 1, policy_version 1592940 (0.0008) [2023-12-28 06:40:57,390][106225] Updated weights for policy 1, policy_version 1592950 (0.0007) [2023-12-28 06:40:57,654][106226] Updated weights for policy 0, policy_version 1589281 (0.0006) [2023-12-28 06:40:57,719][106226] Updated weights for policy 0, policy_version 1589291 (0.0006) [2023-12-28 06:40:57,764][106226] Updated weights for policy 0, policy_version 1589301 (0.0008) [2023-12-28 06:40:58,103][106225] Updated weights for policy 1, policy_version 1592960 (0.0008) [2023-12-28 06:40:58,154][106225] Updated weights for policy 1, policy_version 1592970 (0.0008) [2023-12-28 06:40:58,217][106225] Updated weights for policy 1, policy_version 1592980 (0.0008) [2023-12-28 06:40:58,339][106226] Updated weights for policy 0, policy_version 1589311 (0.0009) [2023-12-28 06:40:58,403][106226] Updated weights for policy 0, policy_version 1589321 (0.0009) [2023-12-28 06:40:58,478][106226] Updated weights for policy 0, policy_version 1589331 (0.0009) [2023-12-28 06:40:59,030][106225] Updated weights for policy 1, policy_version 1592990 (0.0008) [2023-12-28 06:40:59,086][106225] Updated weights for policy 1, policy_version 1593000 (0.0008) [2023-12-28 06:40:59,153][106225] Updated weights for policy 1, policy_version 1593010 (0.0007) [2023-12-28 06:40:59,302][106226] Updated weights for policy 0, policy_version 1589341 (0.0007) [2023-12-28 06:40:59,368][106226] Updated weights for policy 0, policy_version 1589351 (0.0006) [2023-12-28 06:40:59,442][106226] Updated weights for policy 0, policy_version 1589361 (0.0008) [2023-12-28 06:40:59,960][106225] Updated weights for policy 1, policy_version 1593020 (0.0008) [2023-12-28 06:41:00,023][106225] Updated weights for policy 1, policy_version 1593030 (0.0007) [2023-12-28 06:41:00,050][106226] Updated weights for policy 0, policy_version 1589371 (0.0007) [2023-12-28 06:41:00,087][106225] Updated weights for policy 1, policy_version 1593040 (0.0008) [2023-12-28 06:41:00,111][106226] Updated weights for policy 0, policy_version 1589381 (0.0010) [2023-12-28 06:41:00,166][106226] Updated weights for policy 0, policy_version 1589391 (0.0007) [2023-12-28 06:41:00,713][106225] Updated weights for policy 1, policy_version 1593050 (0.0008) [2023-12-28 06:41:00,768][106225] Updated weights for policy 1, policy_version 1593060 (0.0009) [2023-12-28 06:41:00,817][106225] Updated weights for policy 1, policy_version 1593070 (0.0007) [2023-12-28 06:41:00,827][106226] Updated weights for policy 0, policy_version 1589401 (0.0008) [2023-12-28 06:41:00,865][106225] Updated weights for policy 1, policy_version 1593080 (0.0006) [2023-12-28 06:41:00,885][106226] Updated weights for policy 0, policy_version 1589411 (0.0008) [2023-12-28 06:41:00,937][106226] Updated weights for policy 0, policy_version 1589421 (0.0008) [2023-12-28 06:41:00,989][106226] Updated weights for policy 0, policy_version 1589431 (0.0008) [2023-12-28 06:41:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 814850048. Throughput: 0: 9735.5, 1: 9973.6. Samples: 814835856. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:01,175][105115] Avg episode reward: [(0, '-4.639'), (1, '-4.716')] [2023-12-28 06:41:01,609][106225] Updated weights for policy 1, policy_version 1593090 (0.0011) [2023-12-28 06:41:01,669][106225] Updated weights for policy 1, policy_version 1593100 (0.0009) [2023-12-28 06:41:01,732][106225] Updated weights for policy 1, policy_version 1593110 (0.0010) [2023-12-28 06:41:01,785][106226] Updated weights for policy 0, policy_version 1589441 (0.0009) [2023-12-28 06:41:01,848][106226] Updated weights for policy 0, policy_version 1589451 (0.0008) [2023-12-28 06:41:01,905][106226] Updated weights for policy 0, policy_version 1589461 (0.0009) [2023-12-28 06:41:02,412][106225] Updated weights for policy 1, policy_version 1593120 (0.0009) [2023-12-28 06:41:02,473][106225] Updated weights for policy 1, policy_version 1593130 (0.0010) [2023-12-28 06:41:02,537][106225] Updated weights for policy 1, policy_version 1593140 (0.0009) [2023-12-28 06:41:02,604][106226] Updated weights for policy 0, policy_version 1589471 (0.0009) [2023-12-28 06:41:02,662][106226] Updated weights for policy 0, policy_version 1589481 (0.0008) [2023-12-28 06:41:02,720][106226] Updated weights for policy 0, policy_version 1589491 (0.0010) [2023-12-28 06:41:03,186][106225] Updated weights for policy 1, policy_version 1593150 (0.0006) [2023-12-28 06:41:03,240][106225] Updated weights for policy 1, policy_version 1593160 (0.0006) [2023-12-28 06:41:03,304][106225] Updated weights for policy 1, policy_version 1593170 (0.0006) [2023-12-28 06:41:03,427][106226] Updated weights for policy 0, policy_version 1589501 (0.0008) [2023-12-28 06:41:03,494][106226] Updated weights for policy 0, policy_version 1589511 (0.0007) [2023-12-28 06:41:03,546][106226] Updated weights for policy 0, policy_version 1589521 (0.0009) [2023-12-28 06:41:03,909][106225] Updated weights for policy 1, policy_version 1593180 (0.0007) [2023-12-28 06:41:03,971][106225] Updated weights for policy 1, policy_version 1593190 (0.0008) [2023-12-28 06:41:04,030][106225] Updated weights for policy 1, policy_version 1593200 (0.0009) [2023-12-28 06:41:04,285][106226] Updated weights for policy 0, policy_version 1589531 (0.0009) [2023-12-28 06:41:04,345][106226] Updated weights for policy 0, policy_version 1589541 (0.0009) [2023-12-28 06:41:04,409][106226] Updated weights for policy 0, policy_version 1589551 (0.0008) [2023-12-28 06:41:04,713][106225] Updated weights for policy 1, policy_version 1593210 (0.0008) [2023-12-28 06:41:04,768][106225] Updated weights for policy 1, policy_version 1593220 (0.0008) [2023-12-28 06:41:04,817][106225] Updated weights for policy 1, policy_version 1593230 (0.0008) [2023-12-28 06:41:04,866][106225] Updated weights for policy 1, policy_version 1593240 (0.0008) [2023-12-28 06:41:05,137][106226] Updated weights for policy 0, policy_version 1589561 (0.0008) [2023-12-28 06:41:05,203][106226] Updated weights for policy 0, policy_version 1589571 (0.0009) [2023-12-28 06:41:05,258][106226] Updated weights for policy 0, policy_version 1589581 (0.0008) [2023-12-28 06:41:05,308][106226] Updated weights for policy 0, policy_version 1589591 (0.0009) [2023-12-28 06:41:05,624][106225] Updated weights for policy 1, policy_version 1593250 (0.0009) [2023-12-28 06:41:05,686][106225] Updated weights for policy 1, policy_version 1593260 (0.0008) [2023-12-28 06:41:05,746][106225] Updated weights for policy 1, policy_version 1593270 (0.0008) [2023-12-28 06:41:06,059][106226] Updated weights for policy 0, policy_version 1589601 (0.0009) [2023-12-28 06:41:06,127][106226] Updated weights for policy 0, policy_version 1589611 (0.0009) [2023-12-28 06:41:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 814940160. Throughput: 0: 9743.9, 1: 9926.0. Samples: 814953460. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:06,175][105115] Avg episode reward: [(0, '-4.870'), (1, '-4.417')] [2023-12-28 06:41:06,186][106226] Updated weights for policy 0, policy_version 1589621 (0.0008) [2023-12-28 06:41:06,428][106225] Updated weights for policy 1, policy_version 1593280 (0.0010) [2023-12-28 06:41:06,491][106225] Updated weights for policy 1, policy_version 1593290 (0.0010) [2023-12-28 06:41:06,555][106225] Updated weights for policy 1, policy_version 1593300 (0.0011) [2023-12-28 06:41:06,854][106226] Updated weights for policy 0, policy_version 1589631 (0.0008) [2023-12-28 06:41:06,916][106226] Updated weights for policy 0, policy_version 1589641 (0.0008) [2023-12-28 06:41:06,971][106226] Updated weights for policy 0, policy_version 1589651 (0.0007) [2023-12-28 06:41:07,258][106225] Updated weights for policy 1, policy_version 1593310 (0.0008) [2023-12-28 06:41:07,319][106225] Updated weights for policy 1, policy_version 1593320 (0.0007) [2023-12-28 06:41:07,374][106225] Updated weights for policy 1, policy_version 1593330 (0.0007) [2023-12-28 06:41:07,643][106226] Updated weights for policy 0, policy_version 1589661 (0.0009) [2023-12-28 06:41:07,708][106226] Updated weights for policy 0, policy_version 1589671 (0.0009) [2023-12-28 06:41:07,770][106226] Updated weights for policy 0, policy_version 1589681 (0.0009) [2023-12-28 06:41:07,965][106225] Updated weights for policy 1, policy_version 1593340 (0.0005) [2023-12-28 06:41:08,028][106225] Updated weights for policy 1, policy_version 1593350 (0.0005) [2023-12-28 06:41:08,093][106225] Updated weights for policy 1, policy_version 1593360 (0.0005) [2023-12-28 06:41:08,498][106226] Updated weights for policy 0, policy_version 1589691 (0.0008) [2023-12-28 06:41:08,562][106226] Updated weights for policy 0, policy_version 1589701 (0.0006) [2023-12-28 06:41:08,622][106226] Updated weights for policy 0, policy_version 1589711 (0.0008) [2023-12-28 06:41:08,681][106225] Updated weights for policy 1, policy_version 1593370 (0.0006) [2023-12-28 06:41:08,745][106225] Updated weights for policy 1, policy_version 1593380 (0.0008) [2023-12-28 06:41:08,803][106225] Updated weights for policy 1, policy_version 1593390 (0.0008) [2023-12-28 06:41:08,864][106225] Updated weights for policy 1, policy_version 1593400 (0.0008) [2023-12-28 06:41:09,335][106226] Updated weights for policy 0, policy_version 1589721 (0.0009) [2023-12-28 06:41:09,417][106226] Updated weights for policy 0, policy_version 1589731 (0.0010) [2023-12-28 06:41:09,478][106226] Updated weights for policy 0, policy_version 1589741 (0.0008) [2023-12-28 06:41:09,539][106226] Updated weights for policy 0, policy_version 1589751 (0.0009) [2023-12-28 06:41:09,636][106225] Updated weights for policy 1, policy_version 1593410 (0.0007) [2023-12-28 06:41:09,702][106225] Updated weights for policy 1, policy_version 1593420 (0.0009) [2023-12-28 06:41:09,761][106225] Updated weights for policy 1, policy_version 1593430 (0.0010) [2023-12-28 06:41:10,273][106226] Updated weights for policy 0, policy_version 1589761 (0.0006) [2023-12-28 06:41:10,343][106226] Updated weights for policy 0, policy_version 1589771 (0.0006) [2023-12-28 06:41:10,406][106226] Updated weights for policy 0, policy_version 1589781 (0.0010) [2023-12-28 06:41:10,509][106225] Updated weights for policy 1, policy_version 1593440 (0.0008) [2023-12-28 06:41:10,570][106225] Updated weights for policy 1, policy_version 1593450 (0.0009) [2023-12-28 06:41:10,629][106225] Updated weights for policy 1, policy_version 1593460 (0.0008) [2023-12-28 06:41:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 815038464. Throughput: 0: 9793.5, 1: 10002.2. Samples: 815015304. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:11,175][105115] Avg episode reward: [(0, '-4.790'), (1, '-4.587')] [2023-12-28 06:41:11,179][106226] Updated weights for policy 0, policy_version 1589791 (0.0008) [2023-12-28 06:41:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001593464_407977984.pth... [2023-12-28 06:41:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001592280_407674880.pth [2023-12-28 06:41:11,230][106226] Updated weights for policy 0, policy_version 1589801 (0.0008) [2023-12-28 06:41:11,300][106226] Updated weights for policy 0, policy_version 1589811 (0.0007) [2023-12-28 06:41:11,311][106225] Updated weights for policy 1, policy_version 1593470 (0.0007) [2023-12-28 06:41:11,367][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001589816_407068672.pth... [2023-12-28 06:41:11,372][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001588696_406781952.pth [2023-12-28 06:41:11,382][106225] Updated weights for policy 1, policy_version 1593480 (0.0008) [2023-12-28 06:41:11,437][106225] Updated weights for policy 1, policy_version 1593490 (0.0009) [2023-12-28 06:41:12,031][106226] Updated weights for policy 0, policy_version 1589821 (0.0006) [2023-12-28 06:41:12,083][106226] Updated weights for policy 0, policy_version 1589831 (0.0005) [2023-12-28 06:41:12,147][106226] Updated weights for policy 0, policy_version 1589841 (0.0008) [2023-12-28 06:41:12,245][106225] Updated weights for policy 1, policy_version 1593500 (0.0008) [2023-12-28 06:41:12,305][106225] Updated weights for policy 1, policy_version 1593510 (0.0009) [2023-12-28 06:41:12,369][106225] Updated weights for policy 1, policy_version 1593520 (0.0008) [2023-12-28 06:41:12,906][106226] Updated weights for policy 0, policy_version 1589851 (0.0008) [2023-12-28 06:41:12,969][106226] Updated weights for policy 0, policy_version 1589861 (0.0005) [2023-12-28 06:41:13,034][106226] Updated weights for policy 0, policy_version 1589871 (0.0005) [2023-12-28 06:41:13,104][106225] Updated weights for policy 1, policy_version 1593530 (0.0008) [2023-12-28 06:41:13,172][106225] Updated weights for policy 1, policy_version 1593540 (0.0007) [2023-12-28 06:41:13,234][106225] Updated weights for policy 1, policy_version 1593550 (0.0008) [2023-12-28 06:41:13,301][106225] Updated weights for policy 1, policy_version 1593560 (0.0008) [2023-12-28 06:41:13,660][106226] Updated weights for policy 0, policy_version 1589881 (0.0006) [2023-12-28 06:41:13,721][106226] Updated weights for policy 0, policy_version 1589891 (0.0009) [2023-12-28 06:41:13,768][106226] Updated weights for policy 0, policy_version 1589901 (0.0008) [2023-12-28 06:41:13,830][106226] Updated weights for policy 0, policy_version 1589911 (0.0009) [2023-12-28 06:41:13,891][106225] Updated weights for policy 1, policy_version 1593570 (0.0005) [2023-12-28 06:41:13,958][106225] Updated weights for policy 1, policy_version 1593580 (0.0006) [2023-12-28 06:41:14,021][106225] Updated weights for policy 1, policy_version 1593590 (0.0005) [2023-12-28 06:41:14,539][106226] Updated weights for policy 0, policy_version 1589921 (0.0008) [2023-12-28 06:41:14,568][106225] Updated weights for policy 1, policy_version 1593600 (0.0005) [2023-12-28 06:41:14,600][106226] Updated weights for policy 0, policy_version 1589931 (0.0011) [2023-12-28 06:41:14,622][106225] Updated weights for policy 1, policy_version 1593610 (0.0008) [2023-12-28 06:41:14,649][106226] Updated weights for policy 0, policy_version 1589941 (0.0006) [2023-12-28 06:41:14,673][106225] Updated weights for policy 1, policy_version 1593620 (0.0007) [2023-12-28 06:41:15,301][106225] Updated weights for policy 1, policy_version 1593630 (0.0007) [2023-12-28 06:41:15,310][106226] Updated weights for policy 0, policy_version 1589951 (0.0006) [2023-12-28 06:41:15,356][106225] Updated weights for policy 1, policy_version 1593640 (0.0006) [2023-12-28 06:41:15,378][106226] Updated weights for policy 0, policy_version 1589961 (0.0008) [2023-12-28 06:41:15,416][106225] Updated weights for policy 1, policy_version 1593650 (0.0006) [2023-12-28 06:41:15,440][106226] Updated weights for policy 0, policy_version 1589971 (0.0008) [2023-12-28 06:41:16,055][106226] Updated weights for policy 0, policy_version 1589981 (0.0006) [2023-12-28 06:41:16,115][106226] Updated weights for policy 0, policy_version 1589991 (0.0008) [2023-12-28 06:41:16,127][106225] Updated weights for policy 1, policy_version 1593660 (0.0008) [2023-12-28 06:41:16,165][106226] Updated weights for policy 0, policy_version 1590001 (0.0006) [2023-12-28 06:41:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 815136768. Throughput: 0: 9625.3, 1: 10006.0. Samples: 815132008. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:16,175][106225] Updated weights for policy 1, policy_version 1593670 (0.0006) [2023-12-28 06:41:16,176][105115] Avg episode reward: [(0, '-4.781'), (1, '-4.611')] [2023-12-28 06:41:16,235][106225] Updated weights for policy 1, policy_version 1593680 (0.0009) [2023-12-28 06:41:16,876][106226] Updated weights for policy 0, policy_version 1590011 (0.0006) [2023-12-28 06:41:16,930][106226] Updated weights for policy 0, policy_version 1590021 (0.0006) [2023-12-28 06:41:16,985][106225] Updated weights for policy 1, policy_version 1593690 (0.0008) [2023-12-28 06:41:16,990][106226] Updated weights for policy 0, policy_version 1590031 (0.0006) [2023-12-28 06:41:17,048][106225] Updated weights for policy 1, policy_version 1593700 (0.0008) [2023-12-28 06:41:17,114][106225] Updated weights for policy 1, policy_version 1593710 (0.0009) [2023-12-28 06:41:17,170][106225] Updated weights for policy 1, policy_version 1593720 (0.0008) [2023-12-28 06:41:17,672][106226] Updated weights for policy 0, policy_version 1590041 (0.0005) [2023-12-28 06:41:17,729][106226] Updated weights for policy 0, policy_version 1590051 (0.0006) [2023-12-28 06:41:17,779][106226] Updated weights for policy 0, policy_version 1590061 (0.0008) [2023-12-28 06:41:17,835][106226] Updated weights for policy 0, policy_version 1590071 (0.0008) [2023-12-28 06:41:17,890][106225] Updated weights for policy 1, policy_version 1593730 (0.0005) [2023-12-28 06:41:17,939][106225] Updated weights for policy 1, policy_version 1593740 (0.0010) [2023-12-28 06:41:17,999][106225] Updated weights for policy 1, policy_version 1593750 (0.0010) [2023-12-28 06:41:18,587][106226] Updated weights for policy 0, policy_version 1590081 (0.0008) [2023-12-28 06:41:18,651][106226] Updated weights for policy 0, policy_version 1590091 (0.0008) [2023-12-28 06:41:18,660][106225] Updated weights for policy 1, policy_version 1593760 (0.0006) [2023-12-28 06:41:18,717][106226] Updated weights for policy 0, policy_version 1590101 (0.0008) [2023-12-28 06:41:18,717][106225] Updated weights for policy 1, policy_version 1593770 (0.0006) [2023-12-28 06:41:18,781][106225] Updated weights for policy 1, policy_version 1593780 (0.0007) [2023-12-28 06:41:19,315][106225] Updated weights for policy 1, policy_version 1593790 (0.0007) [2023-12-28 06:41:19,379][106225] Updated weights for policy 1, policy_version 1593800 (0.0007) [2023-12-28 06:41:19,440][106225] Updated weights for policy 1, policy_version 1593810 (0.0008) [2023-12-28 06:41:19,491][106226] Updated weights for policy 0, policy_version 1590111 (0.0008) [2023-12-28 06:41:19,554][106226] Updated weights for policy 0, policy_version 1590121 (0.0007) [2023-12-28 06:41:19,618][106226] Updated weights for policy 0, policy_version 1590131 (0.0008) [2023-12-28 06:41:20,162][106225] Updated weights for policy 1, policy_version 1593820 (0.0008) [2023-12-28 06:41:20,228][106225] Updated weights for policy 1, policy_version 1593830 (0.0009) [2023-12-28 06:41:20,285][106225] Updated weights for policy 1, policy_version 1593840 (0.0007) [2023-12-28 06:41:20,351][106226] Updated weights for policy 0, policy_version 1590141 (0.0007) [2023-12-28 06:41:20,401][106226] Updated weights for policy 0, policy_version 1590151 (0.0005) [2023-12-28 06:41:20,465][106226] Updated weights for policy 0, policy_version 1590161 (0.0006) [2023-12-28 06:41:21,089][106225] Updated weights for policy 1, policy_version 1593850 (0.0009) [2023-12-28 06:41:21,151][106225] Updated weights for policy 1, policy_version 1593860 (0.0009) [2023-12-28 06:41:21,160][106226] Updated weights for policy 0, policy_version 1590171 (0.0006) [2023-12-28 06:41:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 815235072. Throughput: 0: 9659.5, 1: 10005.0. Samples: 815250768. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:21,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.475')] [2023-12-28 06:41:21,208][106225] Updated weights for policy 1, policy_version 1593870 (0.0008) [2023-12-28 06:41:21,222][106226] Updated weights for policy 0, policy_version 1590181 (0.0006) [2023-12-28 06:41:21,267][106225] Updated weights for policy 1, policy_version 1593880 (0.0006) [2023-12-28 06:41:21,287][106226] Updated weights for policy 0, policy_version 1590191 (0.0007) [2023-12-28 06:41:21,937][106226] Updated weights for policy 0, policy_version 1590201 (0.0007) [2023-12-28 06:41:22,004][106226] Updated weights for policy 0, policy_version 1590211 (0.0008) [2023-12-28 06:41:22,068][106226] Updated weights for policy 0, policy_version 1590221 (0.0009) [2023-12-28 06:41:22,132][106226] Updated weights for policy 0, policy_version 1590231 (0.0008) [2023-12-28 06:41:22,138][106225] Updated weights for policy 1, policy_version 1593890 (0.0009) [2023-12-28 06:41:22,197][106225] Updated weights for policy 1, policy_version 1593900 (0.0008) [2023-12-28 06:41:22,258][106225] Updated weights for policy 1, policy_version 1593910 (0.0009) [2023-12-28 06:41:22,864][106226] Updated weights for policy 0, policy_version 1590241 (0.0009) [2023-12-28 06:41:22,931][106226] Updated weights for policy 0, policy_version 1590251 (0.0009) [2023-12-28 06:41:22,991][106226] Updated weights for policy 0, policy_version 1590261 (0.0008) [2023-12-28 06:41:23,016][106225] Updated weights for policy 1, policy_version 1593920 (0.0008) [2023-12-28 06:41:23,075][106225] Updated weights for policy 1, policy_version 1593930 (0.0008) [2023-12-28 06:41:23,124][106225] Updated weights for policy 1, policy_version 1593940 (0.0006) [2023-12-28 06:41:23,659][106226] Updated weights for policy 0, policy_version 1590271 (0.0007) [2023-12-28 06:41:23,695][106225] Updated weights for policy 1, policy_version 1593950 (0.0005) [2023-12-28 06:41:23,713][106226] Updated weights for policy 0, policy_version 1590281 (0.0007) [2023-12-28 06:41:23,764][106225] Updated weights for policy 1, policy_version 1593960 (0.0005) [2023-12-28 06:41:23,768][106226] Updated weights for policy 0, policy_version 1590291 (0.0006) [2023-12-28 06:41:23,830][106225] Updated weights for policy 1, policy_version 1593970 (0.0005) [2023-12-28 06:41:24,421][106225] Updated weights for policy 1, policy_version 1593980 (0.0006) [2023-12-28 06:41:24,451][106226] Updated weights for policy 0, policy_version 1590301 (0.0007) [2023-12-28 06:41:24,469][106225] Updated weights for policy 1, policy_version 1593990 (0.0006) [2023-12-28 06:41:24,507][106226] Updated weights for policy 0, policy_version 1590311 (0.0006) [2023-12-28 06:41:24,518][106225] Updated weights for policy 1, policy_version 1594000 (0.0008) [2023-12-28 06:41:24,563][106226] Updated weights for policy 0, policy_version 1590321 (0.0005) [2023-12-28 06:41:25,153][106226] Updated weights for policy 0, policy_version 1590331 (0.0008) [2023-12-28 06:41:25,206][106226] Updated weights for policy 0, policy_version 1590341 (0.0010) [2023-12-28 06:41:25,262][106226] Updated weights for policy 0, policy_version 1590351 (0.0007) [2023-12-28 06:41:25,302][106225] Updated weights for policy 1, policy_version 1594010 (0.0007) [2023-12-28 06:41:25,357][106225] Updated weights for policy 1, policy_version 1594020 (0.0008) [2023-12-28 06:41:25,412][106225] Updated weights for policy 1, policy_version 1594030 (0.0007) [2023-12-28 06:41:25,462][106225] Updated weights for policy 1, policy_version 1594040 (0.0007) [2023-12-28 06:41:25,899][106226] Updated weights for policy 0, policy_version 1590361 (0.0010) [2023-12-28 06:41:25,961][106226] Updated weights for policy 0, policy_version 1590371 (0.0010) [2023-12-28 06:41:26,019][106226] Updated weights for policy 0, policy_version 1590381 (0.0009) [2023-12-28 06:41:26,067][106226] Updated weights for policy 0, policy_version 1590391 (0.0005) [2023-12-28 06:41:26,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 815341568. Throughput: 0: 9619.1, 1: 10010.1. Samples: 815309228. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:26,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.535')] [2023-12-28 06:41:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001590392_407216128.pth... [2023-12-28 06:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001589240_406921216.pth [2023-12-28 06:41:26,253][106225] Updated weights for policy 1, policy_version 1594050 (0.0008) [2023-12-28 06:41:26,305][106225] Updated weights for policy 1, policy_version 1594060 (0.0007) [2023-12-28 06:41:26,360][106225] Updated weights for policy 1, policy_version 1594070 (0.0007) [2023-12-28 06:41:26,369][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001594072_408133632.pth... [2023-12-28 06:41:26,373][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001592888_407830528.pth [2023-12-28 06:41:26,656][106226] Updated weights for policy 0, policy_version 1590401 (0.0005) [2023-12-28 06:41:26,701][106226] Updated weights for policy 0, policy_version 1590411 (0.0005) [2023-12-28 06:41:26,747][106226] Updated weights for policy 0, policy_version 1590421 (0.0005) [2023-12-28 06:41:27,116][106225] Updated weights for policy 1, policy_version 1594080 (0.0008) [2023-12-28 06:41:27,179][106225] Updated weights for policy 1, policy_version 1594090 (0.0008) [2023-12-28 06:41:27,237][106225] Updated weights for policy 1, policy_version 1594100 (0.0008) [2023-12-28 06:41:27,429][106226] Updated weights for policy 0, policy_version 1590431 (0.0008) [2023-12-28 06:41:27,491][106226] Updated weights for policy 0, policy_version 1590441 (0.0008) [2023-12-28 06:41:27,554][106226] Updated weights for policy 0, policy_version 1590451 (0.0008) [2023-12-28 06:41:27,929][106225] Updated weights for policy 1, policy_version 1594110 (0.0008) [2023-12-28 06:41:27,980][106225] Updated weights for policy 1, policy_version 1594120 (0.0009) [2023-12-28 06:41:28,038][106225] Updated weights for policy 1, policy_version 1594130 (0.0008) [2023-12-28 06:41:28,226][106226] Updated weights for policy 0, policy_version 1590461 (0.0007) [2023-12-28 06:41:28,273][106226] Updated weights for policy 0, policy_version 1590471 (0.0005) [2023-12-28 06:41:28,323][106226] Updated weights for policy 0, policy_version 1590481 (0.0008) [2023-12-28 06:41:28,819][106225] Updated weights for policy 1, policy_version 1594140 (0.0008) [2023-12-28 06:41:28,873][106225] Updated weights for policy 1, policy_version 1594150 (0.0007) [2023-12-28 06:41:28,929][106225] Updated weights for policy 1, policy_version 1594160 (0.0008) [2023-12-28 06:41:29,029][106226] Updated weights for policy 0, policy_version 1590491 (0.0010) [2023-12-28 06:41:29,079][106226] Updated weights for policy 0, policy_version 1590501 (0.0010) [2023-12-28 06:41:29,133][106226] Updated weights for policy 0, policy_version 1590511 (0.0010) [2023-12-28 06:41:29,674][106225] Updated weights for policy 1, policy_version 1594170 (0.0007) [2023-12-28 06:41:29,727][106225] Updated weights for policy 1, policy_version 1594180 (0.0005) [2023-12-28 06:41:29,764][106226] Updated weights for policy 0, policy_version 1590521 (0.0010) [2023-12-28 06:41:29,782][106225] Updated weights for policy 1, policy_version 1594190 (0.0008) [2023-12-28 06:41:29,830][106226] Updated weights for policy 0, policy_version 1590531 (0.0006) [2023-12-28 06:41:29,844][106225] Updated weights for policy 1, policy_version 1594200 (0.0009) [2023-12-28 06:41:29,893][106226] Updated weights for policy 0, policy_version 1590541 (0.0009) [2023-12-28 06:41:29,959][106226] Updated weights for policy 0, policy_version 1590551 (0.0008) [2023-12-28 06:41:30,592][106225] Updated weights for policy 1, policy_version 1594210 (0.0007) [2023-12-28 06:41:30,606][106226] Updated weights for policy 0, policy_version 1590561 (0.0005) [2023-12-28 06:41:30,647][106225] Updated weights for policy 1, policy_version 1594220 (0.0007) [2023-12-28 06:41:30,660][106226] Updated weights for policy 0, policy_version 1590571 (0.0005) [2023-12-28 06:41:30,702][106225] Updated weights for policy 1, policy_version 1594230 (0.0008) [2023-12-28 06:41:30,713][106226] Updated weights for policy 0, policy_version 1590581 (0.0005) [2023-12-28 06:41:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 815439872. Throughput: 0: 9836.2, 1: 9946.9. Samples: 815430808. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:31,175][105115] Avg episode reward: [(0, '-4.895'), (1, '-4.665')] [2023-12-28 06:41:31,297][106226] Updated weights for policy 0, policy_version 1590591 (0.0007) [2023-12-28 06:41:31,370][106226] Updated weights for policy 0, policy_version 1590601 (0.0008) [2023-12-28 06:41:31,422][106225] Updated weights for policy 1, policy_version 1594240 (0.0008) [2023-12-28 06:41:31,424][106226] Updated weights for policy 0, policy_version 1590611 (0.0007) [2023-12-28 06:41:31,489][106225] Updated weights for policy 1, policy_version 1594250 (0.0008) [2023-12-28 06:41:31,559][106225] Updated weights for policy 1, policy_version 1594260 (0.0009) [2023-12-28 06:41:32,022][106226] Updated weights for policy 0, policy_version 1590621 (0.0007) [2023-12-28 06:41:32,089][106226] Updated weights for policy 0, policy_version 1590631 (0.0009) [2023-12-28 06:41:32,158][106226] Updated weights for policy 0, policy_version 1590641 (0.0009) [2023-12-28 06:41:32,232][106225] Updated weights for policy 1, policy_version 1594270 (0.0008) [2023-12-28 06:41:32,295][106225] Updated weights for policy 1, policy_version 1594280 (0.0008) [2023-12-28 06:41:32,355][106225] Updated weights for policy 1, policy_version 1594290 (0.0007) [2023-12-28 06:41:32,943][106226] Updated weights for policy 0, policy_version 1590651 (0.0008) [2023-12-28 06:41:32,956][106225] Updated weights for policy 1, policy_version 1594300 (0.0008) [2023-12-28 06:41:32,997][106226] Updated weights for policy 0, policy_version 1590661 (0.0006) [2023-12-28 06:41:33,017][106225] Updated weights for policy 1, policy_version 1594310 (0.0010) [2023-12-28 06:41:33,048][106226] Updated weights for policy 0, policy_version 1590671 (0.0007) [2023-12-28 06:41:33,077][106225] Updated weights for policy 1, policy_version 1594320 (0.0010) [2023-12-28 06:41:33,607][106226] Updated weights for policy 0, policy_version 1590681 (0.0007) [2023-12-28 06:41:33,679][106226] Updated weights for policy 0, policy_version 1590691 (0.0006) [2023-12-28 06:41:33,734][106226] Updated weights for policy 0, policy_version 1590701 (0.0008) [2023-12-28 06:41:33,736][106225] Updated weights for policy 1, policy_version 1594330 (0.0010) [2023-12-28 06:41:33,788][106225] Updated weights for policy 1, policy_version 1594340 (0.0006) [2023-12-28 06:41:33,790][106226] Updated weights for policy 0, policy_version 1590711 (0.0006) [2023-12-28 06:41:33,840][106225] Updated weights for policy 1, policy_version 1594350 (0.0008) [2023-12-28 06:41:33,885][106225] Updated weights for policy 1, policy_version 1594360 (0.0009) [2023-12-28 06:41:34,541][106226] Updated weights for policy 0, policy_version 1590721 (0.0010) [2023-12-28 06:41:34,578][106225] Updated weights for policy 1, policy_version 1594370 (0.0008) [2023-12-28 06:41:34,605][106226] Updated weights for policy 0, policy_version 1590731 (0.0009) [2023-12-28 06:41:34,638][106225] Updated weights for policy 1, policy_version 1594380 (0.0006) [2023-12-28 06:41:34,666][106226] Updated weights for policy 0, policy_version 1590741 (0.0011) [2023-12-28 06:41:34,697][106225] Updated weights for policy 1, policy_version 1594390 (0.0006) [2023-12-28 06:41:35,303][106226] Updated weights for policy 0, policy_version 1590751 (0.0007) [2023-12-28 06:41:35,365][106226] Updated weights for policy 0, policy_version 1590761 (0.0005) [2023-12-28 06:41:35,421][106225] Updated weights for policy 1, policy_version 1594400 (0.0008) [2023-12-28 06:41:35,423][106226] Updated weights for policy 0, policy_version 1590771 (0.0005) [2023-12-28 06:41:35,485][106225] Updated weights for policy 1, policy_version 1594410 (0.0010) [2023-12-28 06:41:35,536][106225] Updated weights for policy 1, policy_version 1594420 (0.0008) [2023-12-28 06:41:35,975][106226] Updated weights for policy 0, policy_version 1590781 (0.0007) [2023-12-28 06:41:36,042][106226] Updated weights for policy 0, policy_version 1590791 (0.0005) [2023-12-28 06:41:36,090][106226] Updated weights for policy 0, policy_version 1590801 (0.0008) [2023-12-28 06:41:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 815546368. Throughput: 0: 9992.4, 1: 9881.5. Samples: 815554100. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:36,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.904')] [2023-12-28 06:41:36,254][106225] Updated weights for policy 1, policy_version 1594431 (0.0008) [2023-12-28 06:41:36,321][106225] Updated weights for policy 1, policy_version 1594441 (0.0005) [2023-12-28 06:41:36,387][106225] Updated weights for policy 1, policy_version 1594451 (0.0005) [2023-12-28 06:41:36,839][106226] Updated weights for policy 0, policy_version 1590811 (0.0010) [2023-12-28 06:41:36,892][106226] Updated weights for policy 0, policy_version 1590821 (0.0011) [2023-12-28 06:41:36,953][106226] Updated weights for policy 0, policy_version 1590831 (0.0011) [2023-12-28 06:41:37,042][106225] Updated weights for policy 1, policy_version 1594461 (0.0008) [2023-12-28 06:41:37,101][106225] Updated weights for policy 1, policy_version 1594471 (0.0010) [2023-12-28 06:41:37,161][106225] Updated weights for policy 1, policy_version 1594481 (0.0010) [2023-12-28 06:41:37,572][106226] Updated weights for policy 0, policy_version 1590841 (0.0010) [2023-12-28 06:41:37,626][106226] Updated weights for policy 0, policy_version 1590851 (0.0011) [2023-12-28 06:41:37,680][106226] Updated weights for policy 0, policy_version 1590861 (0.0011) [2023-12-28 06:41:37,738][106226] Updated weights for policy 0, policy_version 1590871 (0.0011) [2023-12-28 06:41:37,763][106225] Updated weights for policy 1, policy_version 1594491 (0.0009) [2023-12-28 06:41:37,812][106225] Updated weights for policy 1, policy_version 1594501 (0.0006) [2023-12-28 06:41:37,860][106225] Updated weights for policy 1, policy_version 1594511 (0.0005) [2023-12-28 06:41:38,372][106226] Updated weights for policy 0, policy_version 1590881 (0.0010) [2023-12-28 06:41:38,428][106226] Updated weights for policy 0, policy_version 1590891 (0.0011) [2023-12-28 06:41:38,483][106225] Updated weights for policy 1, policy_version 1594521 (0.0005) [2023-12-28 06:41:38,486][106226] Updated weights for policy 0, policy_version 1590901 (0.0011) [2023-12-28 06:41:38,543][106225] Updated weights for policy 1, policy_version 1594531 (0.0007) [2023-12-28 06:41:38,599][106225] Updated weights for policy 1, policy_version 1594541 (0.0007) [2023-12-28 06:41:38,661][106225] Updated weights for policy 1, policy_version 1594551 (0.0008) [2023-12-28 06:41:39,190][106226] Updated weights for policy 0, policy_version 1590911 (0.0011) [2023-12-28 06:41:39,267][106226] Updated weights for policy 0, policy_version 1590921 (0.0009) [2023-12-28 06:41:39,285][106225] Updated weights for policy 1, policy_version 1594561 (0.0007) [2023-12-28 06:41:39,323][106226] Updated weights for policy 0, policy_version 1590931 (0.0007) [2023-12-28 06:41:39,361][106225] Updated weights for policy 1, policy_version 1594571 (0.0006) [2023-12-28 06:41:39,430][106225] Updated weights for policy 1, policy_version 1594581 (0.0009) [2023-12-28 06:41:40,040][106226] Updated weights for policy 0, policy_version 1590941 (0.0008) [2023-12-28 06:41:40,099][106226] Updated weights for policy 0, policy_version 1590951 (0.0009) [2023-12-28 06:41:40,165][106226] Updated weights for policy 0, policy_version 1590961 (0.0007) [2023-12-28 06:41:40,171][106225] Updated weights for policy 1, policy_version 1594591 (0.0008) [2023-12-28 06:41:40,231][106225] Updated weights for policy 1, policy_version 1594601 (0.0007) [2023-12-28 06:41:40,290][106225] Updated weights for policy 1, policy_version 1594611 (0.0009) [2023-12-28 06:41:40,902][106226] Updated weights for policy 0, policy_version 1590971 (0.0009) [2023-12-28 06:41:40,959][106226] Updated weights for policy 0, policy_version 1590981 (0.0010) [2023-12-28 06:41:41,009][106225] Updated weights for policy 1, policy_version 1594621 (0.0009) [2023-12-28 06:41:41,014][106226] Updated weights for policy 0, policy_version 1590991 (0.0011) [2023-12-28 06:41:41,076][106225] Updated weights for policy 1, policy_version 1594631 (0.0007) [2023-12-28 06:41:41,151][106225] Updated weights for policy 1, policy_version 1594641 (0.0006) [2023-12-28 06:41:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 815644672. Throughput: 0: 10031.9, 1: 9952.7. Samples: 815616396. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:41,175][105115] Avg episode reward: [(0, '-4.883'), (1, '-4.721')] [2023-12-28 06:41:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001591000_407371776.pth... [2023-12-28 06:41:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001589816_407068672.pth [2023-12-28 06:41:41,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001594648_408281088.pth... [2023-12-28 06:41:41,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001593464_407977984.pth [2023-12-28 06:41:41,825][106226] Updated weights for policy 0, policy_version 1591001 (0.0008) [2023-12-28 06:41:41,894][106225] Updated weights for policy 1, policy_version 1594651 (0.0008) [2023-12-28 06:41:41,900][106226] Updated weights for policy 0, policy_version 1591011 (0.0006) [2023-12-28 06:41:41,959][106225] Updated weights for policy 1, policy_version 1594661 (0.0006) [2023-12-28 06:41:41,970][106226] Updated weights for policy 0, policy_version 1591021 (0.0008) [2023-12-28 06:41:42,016][106225] Updated weights for policy 1, policy_version 1594671 (0.0007) [2023-12-28 06:41:42,038][106226] Updated weights for policy 0, policy_version 1591031 (0.0008) [2023-12-28 06:41:42,755][106226] Updated weights for policy 0, policy_version 1591041 (0.0008) [2023-12-28 06:41:42,796][106225] Updated weights for policy 1, policy_version 1594681 (0.0008) [2023-12-28 06:41:42,811][106226] Updated weights for policy 0, policy_version 1591051 (0.0007) [2023-12-28 06:41:42,863][106226] Updated weights for policy 0, policy_version 1591061 (0.0007) [2023-12-28 06:41:42,864][106225] Updated weights for policy 1, policy_version 1594691 (0.0010) [2023-12-28 06:41:42,926][106225] Updated weights for policy 1, policy_version 1594701 (0.0010) [2023-12-28 06:41:42,993][106225] Updated weights for policy 1, policy_version 1594711 (0.0010) [2023-12-28 06:41:43,565][106226] Updated weights for policy 0, policy_version 1591071 (0.0008) [2023-12-28 06:41:43,625][106225] Updated weights for policy 1, policy_version 1594721 (0.0006) [2023-12-28 06:41:43,629][106226] Updated weights for policy 0, policy_version 1591081 (0.0008) [2023-12-28 06:41:43,684][106225] Updated weights for policy 1, policy_version 1594731 (0.0005) [2023-12-28 06:41:43,695][106226] Updated weights for policy 0, policy_version 1591091 (0.0006) [2023-12-28 06:41:43,733][106225] Updated weights for policy 1, policy_version 1594741 (0.0005) [2023-12-28 06:41:44,254][106226] Updated weights for policy 0, policy_version 1591101 (0.0008) [2023-12-28 06:41:44,275][106225] Updated weights for policy 1, policy_version 1594751 (0.0006) [2023-12-28 06:41:44,318][106226] Updated weights for policy 0, policy_version 1591111 (0.0010) [2023-12-28 06:41:44,323][106225] Updated weights for policy 1, policy_version 1594761 (0.0006) [2023-12-28 06:41:44,376][106225] Updated weights for policy 1, policy_version 1594771 (0.0007) [2023-12-28 06:41:44,385][106226] Updated weights for policy 0, policy_version 1591121 (0.0011) [2023-12-28 06:41:45,035][106225] Updated weights for policy 1, policy_version 1594781 (0.0008) [2023-12-28 06:41:45,097][106225] Updated weights for policy 1, policy_version 1594791 (0.0008) [2023-12-28 06:41:45,120][106226] Updated weights for policy 0, policy_version 1591131 (0.0010) [2023-12-28 06:41:45,157][106225] Updated weights for policy 1, policy_version 1594801 (0.0006) [2023-12-28 06:41:45,185][106226] Updated weights for policy 0, policy_version 1591141 (0.0007) [2023-12-28 06:41:45,240][106226] Updated weights for policy 0, policy_version 1591151 (0.0006) [2023-12-28 06:41:45,788][106225] Updated weights for policy 1, policy_version 1594811 (0.0009) [2023-12-28 06:41:45,834][106225] Updated weights for policy 1, policy_version 1594821 (0.0005) [2023-12-28 06:41:45,864][106226] Updated weights for policy 0, policy_version 1591161 (0.0006) [2023-12-28 06:41:45,880][106225] Updated weights for policy 1, policy_version 1594831 (0.0005) [2023-12-28 06:41:45,912][106226] Updated weights for policy 0, policy_version 1591171 (0.0005) [2023-12-28 06:41:45,962][106226] Updated weights for policy 0, policy_version 1591181 (0.0005) [2023-12-28 06:41:46,011][106226] Updated weights for policy 0, policy_version 1591191 (0.0008) [2023-12-28 06:41:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 815751168. Throughput: 0: 9992.8, 1: 9986.6. Samples: 815734932. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:46,175][105115] Avg episode reward: [(0, '-4.801'), (1, '-4.531')] [2023-12-28 06:41:46,423][106225] Updated weights for policy 1, policy_version 1594841 (0.0005) [2023-12-28 06:41:46,474][106225] Updated weights for policy 1, policy_version 1594851 (0.0005) [2023-12-28 06:41:46,527][106225] Updated weights for policy 1, policy_version 1594861 (0.0005) [2023-12-28 06:41:46,574][106225] Updated weights for policy 1, policy_version 1594871 (0.0005) [2023-12-28 06:41:46,589][106226] Updated weights for policy 0, policy_version 1591201 (0.0007) [2023-12-28 06:41:46,646][106226] Updated weights for policy 0, policy_version 1591211 (0.0008) [2023-12-28 06:41:46,705][106226] Updated weights for policy 0, policy_version 1591221 (0.0006) [2023-12-28 06:41:47,198][106225] Updated weights for policy 1, policy_version 1594881 (0.0008) [2023-12-28 06:41:47,265][106225] Updated weights for policy 1, policy_version 1594891 (0.0006) [2023-12-28 06:41:47,290][106226] Updated weights for policy 0, policy_version 1591231 (0.0005) [2023-12-28 06:41:47,329][106225] Updated weights for policy 1, policy_version 1594901 (0.0010) [2023-12-28 06:41:47,347][106226] Updated weights for policy 0, policy_version 1591241 (0.0005) [2023-12-28 06:41:47,401][106226] Updated weights for policy 0, policy_version 1591251 (0.0005) [2023-12-28 06:41:47,876][106225] Updated weights for policy 1, policy_version 1594911 (0.0007) [2023-12-28 06:41:47,927][106225] Updated weights for policy 1, policy_version 1594921 (0.0005) [2023-12-28 06:41:47,977][106225] Updated weights for policy 1, policy_version 1594931 (0.0005) [2023-12-28 06:41:48,080][106226] Updated weights for policy 0, policy_version 1591261 (0.0007) [2023-12-28 06:41:48,138][106226] Updated weights for policy 0, policy_version 1591271 (0.0010) [2023-12-28 06:41:48,200][106226] Updated weights for policy 0, policy_version 1591281 (0.0007) [2023-12-28 06:41:48,637][106225] Updated weights for policy 1, policy_version 1594941 (0.0008) [2023-12-28 06:41:48,697][106225] Updated weights for policy 1, policy_version 1594951 (0.0009) [2023-12-28 06:41:48,749][106225] Updated weights for policy 1, policy_version 1594961 (0.0008) [2023-12-28 06:41:48,885][106226] Updated weights for policy 0, policy_version 1591291 (0.0006) [2023-12-28 06:41:48,940][106226] Updated weights for policy 0, policy_version 1591301 (0.0008) [2023-12-28 06:41:48,992][106226] Updated weights for policy 0, policy_version 1591311 (0.0008) [2023-12-28 06:41:49,494][106225] Updated weights for policy 1, policy_version 1594971 (0.0009) [2023-12-28 06:41:49,557][106225] Updated weights for policy 1, policy_version 1594981 (0.0009) [2023-12-28 06:41:49,618][106225] Updated weights for policy 1, policy_version 1594991 (0.0006) [2023-12-28 06:41:49,746][106226] Updated weights for policy 0, policy_version 1591321 (0.0009) [2023-12-28 06:41:49,798][106226] Updated weights for policy 0, policy_version 1591331 (0.0008) [2023-12-28 06:41:49,862][106226] Updated weights for policy 0, policy_version 1591341 (0.0007) [2023-12-28 06:41:49,923][106226] Updated weights for policy 0, policy_version 1591351 (0.0008) [2023-12-28 06:41:50,324][106225] Updated weights for policy 1, policy_version 1595001 (0.0008) [2023-12-28 06:41:50,380][106225] Updated weights for policy 1, policy_version 1595011 (0.0009) [2023-12-28 06:41:50,442][106225] Updated weights for policy 1, policy_version 1595021 (0.0008) [2023-12-28 06:41:50,509][106225] Updated weights for policy 1, policy_version 1595031 (0.0009) [2023-12-28 06:41:50,639][106226] Updated weights for policy 0, policy_version 1591361 (0.0008) [2023-12-28 06:41:50,710][106226] Updated weights for policy 0, policy_version 1591371 (0.0010) [2023-12-28 06:41:50,780][106226] Updated weights for policy 0, policy_version 1591381 (0.0008) [2023-12-28 06:41:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 815849472. Throughput: 0: 10086.8, 1: 10057.4. Samples: 815859948. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:51,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.521')] [2023-12-28 06:41:51,268][106225] Updated weights for policy 1, policy_version 1595041 (0.0008) [2023-12-28 06:41:51,327][106225] Updated weights for policy 1, policy_version 1595051 (0.0008) [2023-12-28 06:41:51,403][106225] Updated weights for policy 1, policy_version 1595061 (0.0007) [2023-12-28 06:41:51,518][106226] Updated weights for policy 0, policy_version 1591391 (0.0009) [2023-12-28 06:41:51,575][106226] Updated weights for policy 0, policy_version 1591401 (0.0008) [2023-12-28 06:41:51,644][106226] Updated weights for policy 0, policy_version 1591411 (0.0009) [2023-12-28 06:41:52,163][106225] Updated weights for policy 1, policy_version 1595071 (0.0008) [2023-12-28 06:41:52,220][106225] Updated weights for policy 1, policy_version 1595081 (0.0008) [2023-12-28 06:41:52,283][106225] Updated weights for policy 1, policy_version 1595091 (0.0009) [2023-12-28 06:41:52,413][106226] Updated weights for policy 0, policy_version 1591421 (0.0009) [2023-12-28 06:41:52,475][106226] Updated weights for policy 0, policy_version 1591431 (0.0008) [2023-12-28 06:41:52,536][106226] Updated weights for policy 0, policy_version 1591441 (0.0008) [2023-12-28 06:41:53,029][106225] Updated weights for policy 1, policy_version 1595101 (0.0009) [2023-12-28 06:41:53,080][106225] Updated weights for policy 1, policy_version 1595111 (0.0008) [2023-12-28 06:41:53,128][106225] Updated weights for policy 1, policy_version 1595121 (0.0008) [2023-12-28 06:41:53,223][106226] Updated weights for policy 0, policy_version 1591451 (0.0009) [2023-12-28 06:41:53,273][106226] Updated weights for policy 0, policy_version 1591461 (0.0008) [2023-12-28 06:41:53,327][106226] Updated weights for policy 0, policy_version 1591471 (0.0008) [2023-12-28 06:41:53,870][106225] Updated weights for policy 1, policy_version 1595131 (0.0008) [2023-12-28 06:41:53,933][106225] Updated weights for policy 1, policy_version 1595141 (0.0008) [2023-12-28 06:41:53,982][106225] Updated weights for policy 1, policy_version 1595151 (0.0008) [2023-12-28 06:41:54,061][106226] Updated weights for policy 0, policy_version 1591481 (0.0008) [2023-12-28 06:41:54,112][106226] Updated weights for policy 0, policy_version 1591491 (0.0008) [2023-12-28 06:41:54,160][106226] Updated weights for policy 0, policy_version 1591501 (0.0008) [2023-12-28 06:41:54,220][106226] Updated weights for policy 0, policy_version 1591511 (0.0009) [2023-12-28 06:41:54,733][106225] Updated weights for policy 1, policy_version 1595161 (0.0008) [2023-12-28 06:41:54,788][106225] Updated weights for policy 1, policy_version 1595171 (0.0009) [2023-12-28 06:41:54,845][106225] Updated weights for policy 1, policy_version 1595181 (0.0008) [2023-12-28 06:41:54,905][106225] Updated weights for policy 1, policy_version 1595191 (0.0007) [2023-12-28 06:41:54,920][106226] Updated weights for policy 0, policy_version 1591521 (0.0007) [2023-12-28 06:41:54,973][106226] Updated weights for policy 0, policy_version 1591531 (0.0009) [2023-12-28 06:41:55,045][106226] Updated weights for policy 0, policy_version 1591541 (0.0008) [2023-12-28 06:41:55,526][106225] Updated weights for policy 1, policy_version 1595201 (0.0008) [2023-12-28 06:41:55,578][106225] Updated weights for policy 1, policy_version 1595211 (0.0009) [2023-12-28 06:41:55,627][106225] Updated weights for policy 1, policy_version 1595221 (0.0009) [2023-12-28 06:41:55,780][106226] Updated weights for policy 0, policy_version 1591551 (0.0009) [2023-12-28 06:41:55,829][106226] Updated weights for policy 0, policy_version 1591561 (0.0008) [2023-12-28 06:41:55,879][106226] Updated weights for policy 0, policy_version 1591571 (0.0008) [2023-12-28 06:41:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 815947776. Throughput: 0: 10058.8, 1: 9974.1. Samples: 815916788. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:41:56,176][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.843')] [2023-12-28 06:41:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001591576_407519232.pth... [2023-12-28 06:41:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001595224_408428544.pth... [2023-12-28 06:41:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001590392_407216128.pth [2023-12-28 06:41:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001594072_408133632.pth [2023-12-28 06:41:56,298][106225] Updated weights for policy 1, policy_version 1595231 (0.0006) [2023-12-28 06:41:56,358][106225] Updated weights for policy 1, policy_version 1595241 (0.0005) [2023-12-28 06:41:56,419][106225] Updated weights for policy 1, policy_version 1595251 (0.0005) [2023-12-28 06:41:56,577][106226] Updated weights for policy 0, policy_version 1591581 (0.0007) [2023-12-28 06:41:56,634][106226] Updated weights for policy 0, policy_version 1591591 (0.0007) [2023-12-28 06:41:56,697][106226] Updated weights for policy 0, policy_version 1591601 (0.0009) [2023-12-28 06:41:56,985][106225] Updated weights for policy 1, policy_version 1595261 (0.0005) [2023-12-28 06:41:57,042][106225] Updated weights for policy 1, policy_version 1595271 (0.0005) [2023-12-28 06:41:57,087][106225] Updated weights for policy 1, policy_version 1595281 (0.0005) [2023-12-28 06:41:57,292][106226] Updated weights for policy 0, policy_version 1591611 (0.0006) [2023-12-28 06:41:57,357][106226] Updated weights for policy 0, policy_version 1591621 (0.0007) [2023-12-28 06:41:57,412][106226] Updated weights for policy 0, policy_version 1591631 (0.0005) [2023-12-28 06:41:57,746][106225] Updated weights for policy 1, policy_version 1595291 (0.0005) [2023-12-28 06:41:57,802][106225] Updated weights for policy 1, policy_version 1595301 (0.0008) [2023-12-28 06:41:57,859][106225] Updated weights for policy 1, policy_version 1595311 (0.0008) [2023-12-28 06:41:58,039][106226] Updated weights for policy 0, policy_version 1591641 (0.0007) [2023-12-28 06:41:58,111][106226] Updated weights for policy 0, policy_version 1591651 (0.0008) [2023-12-28 06:41:58,170][106226] Updated weights for policy 0, policy_version 1591661 (0.0008) [2023-12-28 06:41:58,236][106226] Updated weights for policy 0, policy_version 1591671 (0.0009) [2023-12-28 06:41:58,567][106225] Updated weights for policy 1, policy_version 1595321 (0.0008) [2023-12-28 06:41:58,637][106225] Updated weights for policy 1, policy_version 1595332 (0.0008) [2023-12-28 06:41:58,703][106225] Updated weights for policy 1, policy_version 1595342 (0.0008) [2023-12-28 06:41:58,766][106225] Updated weights for policy 1, policy_version 1595352 (0.0008) [2023-12-28 06:41:59,077][106226] Updated weights for policy 0, policy_version 1591681 (0.0008) [2023-12-28 06:41:59,147][106226] Updated weights for policy 0, policy_version 1591691 (0.0006) [2023-12-28 06:41:59,201][106226] Updated weights for policy 0, policy_version 1591701 (0.0007) [2023-12-28 06:41:59,550][106225] Updated weights for policy 1, policy_version 1595362 (0.0005) [2023-12-28 06:41:59,606][106225] Updated weights for policy 1, policy_version 1595372 (0.0006) [2023-12-28 06:41:59,671][106225] Updated weights for policy 1, policy_version 1595382 (0.0010) [2023-12-28 06:41:59,898][106226] Updated weights for policy 0, policy_version 1591711 (0.0009) [2023-12-28 06:41:59,967][106226] Updated weights for policy 0, policy_version 1591721 (0.0011) [2023-12-28 06:42:00,023][106226] Updated weights for policy 0, policy_version 1591731 (0.0007) [2023-12-28 06:42:00,377][106225] Updated weights for policy 1, policy_version 1595392 (0.0010) [2023-12-28 06:42:00,434][106225] Updated weights for policy 1, policy_version 1595402 (0.0010) [2023-12-28 06:42:00,493][106225] Updated weights for policy 1, policy_version 1595412 (0.0010) [2023-12-28 06:42:00,613][106226] Updated weights for policy 0, policy_version 1591741 (0.0005) [2023-12-28 06:42:00,666][106226] Updated weights for policy 0, policy_version 1591751 (0.0005) [2023-12-28 06:42:00,718][106226] Updated weights for policy 0, policy_version 1591761 (0.0005) [2023-12-28 06:42:01,100][106225] Updated weights for policy 1, policy_version 1595422 (0.0008) [2023-12-28 06:42:01,165][106225] Updated weights for policy 1, policy_version 1595432 (0.0007) [2023-12-28 06:42:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 816046080. Throughput: 0: 10090.4, 1: 10013.5. Samples: 816036684. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-28 06:42:01,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.763')] [2023-12-28 06:42:01,226][106225] Updated weights for policy 1, policy_version 1595442 (0.0010) [2023-12-28 06:42:01,330][106226] Updated weights for policy 0, policy_version 1591771 (0.0007) [2023-12-28 06:42:01,391][106226] Updated weights for policy 0, policy_version 1591781 (0.0010) [2023-12-28 06:42:01,453][106226] Updated weights for policy 0, policy_version 1591791 (0.0008) [2023-12-28 06:42:01,954][106225] Updated weights for policy 1, policy_version 1595452 (0.0011) [2023-12-28 06:42:02,015][106225] Updated weights for policy 1, policy_version 1595462 (0.0010) [2023-12-28 06:42:02,071][106225] Updated weights for policy 1, policy_version 1595472 (0.0008) [2023-12-28 06:42:02,160][106226] Updated weights for policy 0, policy_version 1591801 (0.0008) [2023-12-28 06:42:02,215][106226] Updated weights for policy 0, policy_version 1591811 (0.0008) [2023-12-28 06:42:02,267][106226] Updated weights for policy 0, policy_version 1591821 (0.0009) [2023-12-28 06:42:02,330][106226] Updated weights for policy 0, policy_version 1591831 (0.0009) [2023-12-28 06:42:02,785][106225] Updated weights for policy 1, policy_version 1595482 (0.0009) [2023-12-28 06:42:02,847][106225] Updated weights for policy 1, policy_version 1595492 (0.0010) [2023-12-28 06:42:02,893][106225] Updated weights for policy 1, policy_version 1595502 (0.0006) [2023-12-28 06:42:02,907][106226] Updated weights for policy 0, policy_version 1591841 (0.0006) [2023-12-28 06:42:02,936][106225] Updated weights for policy 1, policy_version 1595512 (0.0009) [2023-12-28 06:42:02,955][106226] Updated weights for policy 0, policy_version 1591851 (0.0006) [2023-12-28 06:42:03,001][106226] Updated weights for policy 0, policy_version 1591861 (0.0008) [2023-12-28 06:42:03,605][106225] Updated weights for policy 1, policy_version 1595522 (0.0010) [2023-12-28 06:42:03,665][106225] Updated weights for policy 1, policy_version 1595532 (0.0010) [2023-12-28 06:42:03,727][106225] Updated weights for policy 1, policy_version 1595542 (0.0010) [2023-12-28 06:42:03,778][106226] Updated weights for policy 0, policy_version 1591871 (0.0008) [2023-12-28 06:42:03,842][106226] Updated weights for policy 0, policy_version 1591881 (0.0008) [2023-12-28 06:42:03,909][106226] Updated weights for policy 0, policy_version 1591891 (0.0009) [2023-12-28 06:42:04,501][106225] Updated weights for policy 1, policy_version 1595552 (0.0006) [2023-12-28 06:42:04,561][106225] Updated weights for policy 1, policy_version 1595562 (0.0005) [2023-12-28 06:42:04,621][106225] Updated weights for policy 1, policy_version 1595572 (0.0007) [2023-12-28 06:42:04,712][106226] Updated weights for policy 0, policy_version 1591901 (0.0008) [2023-12-28 06:42:04,776][106226] Updated weights for policy 0, policy_version 1591911 (0.0008) [2023-12-28 06:42:04,840][106226] Updated weights for policy 0, policy_version 1591921 (0.0007) [2023-12-28 06:42:05,211][106225] Updated weights for policy 1, policy_version 1595582 (0.0005) [2023-12-28 06:42:05,260][106225] Updated weights for policy 1, policy_version 1595592 (0.0005) [2023-12-28 06:42:05,311][106225] Updated weights for policy 1, policy_version 1595602 (0.0009) [2023-12-28 06:42:05,483][106226] Updated weights for policy 0, policy_version 1591931 (0.0007) [2023-12-28 06:42:05,548][106226] Updated weights for policy 0, policy_version 1591941 (0.0006) [2023-12-28 06:42:05,613][106226] Updated weights for policy 0, policy_version 1591951 (0.0005) [2023-12-28 06:42:05,998][106225] Updated weights for policy 1, policy_version 1595612 (0.0009) [2023-12-28 06:42:06,055][106225] Updated weights for policy 1, policy_version 1595622 (0.0009) [2023-12-28 06:42:06,124][106225] Updated weights for policy 1, policy_version 1595632 (0.0008) [2023-12-28 06:42:06,129][106226] Updated weights for policy 0, policy_version 1591961 (0.0005) [2023-12-28 06:42:06,175][105115] Fps is (10 sec: 20480.5, 60 sec: 20206.9, 300 sec: 19799.6). Total num frames: 816152576. Throughput: 0: 10183.7, 1: 10037.6. Samples: 816160724. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:06,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.538')] [2023-12-28 06:42:06,192][106226] Updated weights for policy 0, policy_version 1591971 (0.0010) [2023-12-28 06:42:06,259][106226] Updated weights for policy 0, policy_version 1591981 (0.0008) [2023-12-28 06:42:06,320][106226] Updated weights for policy 0, policy_version 1591991 (0.0006) [2023-12-28 06:42:06,909][106225] Updated weights for policy 1, policy_version 1595642 (0.0008) [2023-12-28 06:42:06,973][106225] Updated weights for policy 1, policy_version 1595652 (0.0009) [2023-12-28 06:42:07,017][106226] Updated weights for policy 0, policy_version 1592001 (0.0006) [2023-12-28 06:42:07,033][106225] Updated weights for policy 1, policy_version 1595662 (0.0008) [2023-12-28 06:42:07,083][106226] Updated weights for policy 0, policy_version 1592011 (0.0006) [2023-12-28 06:42:07,088][106225] Updated weights for policy 1, policy_version 1595672 (0.0007) [2023-12-28 06:42:07,149][106226] Updated weights for policy 0, policy_version 1592021 (0.0008) [2023-12-28 06:42:07,753][106225] Updated weights for policy 1, policy_version 1595682 (0.0005) [2023-12-28 06:42:07,817][106225] Updated weights for policy 1, policy_version 1595692 (0.0006) [2023-12-28 06:42:07,868][106225] Updated weights for policy 1, policy_version 1595702 (0.0006) [2023-12-28 06:42:07,897][106226] Updated weights for policy 0, policy_version 1592031 (0.0008) [2023-12-28 06:42:07,952][106226] Updated weights for policy 0, policy_version 1592041 (0.0008) [2023-12-28 06:42:08,011][106226] Updated weights for policy 0, policy_version 1592051 (0.0009) [2023-12-28 06:42:08,484][106225] Updated weights for policy 1, policy_version 1595712 (0.0009) [2023-12-28 06:42:08,548][106225] Updated weights for policy 1, policy_version 1595722 (0.0010) [2023-12-28 06:42:08,613][106225] Updated weights for policy 1, policy_version 1595732 (0.0010) [2023-12-28 06:42:08,791][106226] Updated weights for policy 0, policy_version 1592061 (0.0009) [2023-12-28 06:42:08,841][106226] Updated weights for policy 0, policy_version 1592071 (0.0008) [2023-12-28 06:42:08,886][106226] Updated weights for policy 0, policy_version 1592081 (0.0008) [2023-12-28 06:42:09,252][106225] Updated weights for policy 1, policy_version 1595742 (0.0010) [2023-12-28 06:42:09,313][106225] Updated weights for policy 1, policy_version 1595752 (0.0009) [2023-12-28 06:42:09,378][106225] Updated weights for policy 1, policy_version 1595762 (0.0009) [2023-12-28 06:42:09,606][106226] Updated weights for policy 0, policy_version 1592091 (0.0008) [2023-12-28 06:42:09,673][106226] Updated weights for policy 0, policy_version 1592101 (0.0009) [2023-12-28 06:42:09,739][106226] Updated weights for policy 0, policy_version 1592111 (0.0008) [2023-12-28 06:42:10,075][106225] Updated weights for policy 1, policy_version 1595772 (0.0008) [2023-12-28 06:42:10,127][106225] Updated weights for policy 1, policy_version 1595782 (0.0008) [2023-12-28 06:42:10,194][106225] Updated weights for policy 1, policy_version 1595792 (0.0007) [2023-12-28 06:42:10,508][106226] Updated weights for policy 0, policy_version 1592121 (0.0009) [2023-12-28 06:42:10,579][106226] Updated weights for policy 0, policy_version 1592131 (0.0011) [2023-12-28 06:42:10,637][106226] Updated weights for policy 0, policy_version 1592141 (0.0011) [2023-12-28 06:42:10,684][106226] Updated weights for policy 0, policy_version 1592151 (0.0011) [2023-12-28 06:42:10,856][106225] Updated weights for policy 1, policy_version 1595802 (0.0007) [2023-12-28 06:42:10,917][106225] Updated weights for policy 1, policy_version 1595812 (0.0006) [2023-12-28 06:42:10,981][106225] Updated weights for policy 1, policy_version 1595822 (0.0006) [2023-12-28 06:42:11,044][106225] Updated weights for policy 1, policy_version 1595832 (0.0008) [2023-12-28 06:42:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19799.6). Total num frames: 816250880. Throughput: 0: 10151.6, 1: 10059.5. Samples: 816218728. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:11,175][105115] Avg episode reward: [(0, '-5.102'), (1, '-4.566')] [2023-12-28 06:42:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001595832_408584192.pth... [2023-12-28 06:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001592152_407666688.pth... [2023-12-28 06:42:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001591000_407371776.pth [2023-12-28 06:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001594648_408281088.pth [2023-12-28 06:42:11,479][106226] Updated weights for policy 0, policy_version 1592161 (0.0010) [2023-12-28 06:42:11,545][106226] Updated weights for policy 0, policy_version 1592171 (0.0011) [2023-12-28 06:42:11,599][106226] Updated weights for policy 0, policy_version 1592181 (0.0011) [2023-12-28 06:42:11,855][106225] Updated weights for policy 1, policy_version 1595842 (0.0009) [2023-12-28 06:42:11,921][106225] Updated weights for policy 1, policy_version 1595852 (0.0006) [2023-12-28 06:42:11,986][106225] Updated weights for policy 1, policy_version 1595862 (0.0006) [2023-12-28 06:42:12,421][106226] Updated weights for policy 0, policy_version 1592191 (0.0010) [2023-12-28 06:42:12,475][106226] Updated weights for policy 0, policy_version 1592201 (0.0012) [2023-12-28 06:42:12,525][106226] Updated weights for policy 0, policy_version 1592211 (0.0011) [2023-12-28 06:42:12,670][106225] Updated weights for policy 1, policy_version 1595872 (0.0008) [2023-12-28 06:42:12,725][106225] Updated weights for policy 1, policy_version 1595882 (0.0008) [2023-12-28 06:42:12,786][106225] Updated weights for policy 1, policy_version 1595892 (0.0008) [2023-12-28 06:42:13,276][106226] Updated weights for policy 0, policy_version 1592221 (0.0011) [2023-12-28 06:42:13,333][106226] Updated weights for policy 0, policy_version 1592231 (0.0010) [2023-12-28 06:42:13,397][106226] Updated weights for policy 0, policy_version 1592241 (0.0011) [2023-12-28 06:42:13,409][106225] Updated weights for policy 1, policy_version 1595902 (0.0006) [2023-12-28 06:42:13,460][106225] Updated weights for policy 1, policy_version 1595912 (0.0005) [2023-12-28 06:42:13,518][106225] Updated weights for policy 1, policy_version 1595922 (0.0007) [2023-12-28 06:42:14,048][106226] Updated weights for policy 0, policy_version 1592251 (0.0009) [2023-12-28 06:42:14,102][106226] Updated weights for policy 0, policy_version 1592261 (0.0006) [2023-12-28 06:42:14,154][106226] Updated weights for policy 0, policy_version 1592271 (0.0008) [2023-12-28 06:42:14,243][106225] Updated weights for policy 1, policy_version 1595932 (0.0007) [2023-12-28 06:42:14,300][106225] Updated weights for policy 1, policy_version 1595942 (0.0007) [2023-12-28 06:42:14,357][106225] Updated weights for policy 1, policy_version 1595952 (0.0008) [2023-12-28 06:42:14,831][106226] Updated weights for policy 0, policy_version 1592281 (0.0011) [2023-12-28 06:42:14,888][106226] Updated weights for policy 0, policy_version 1592291 (0.0008) [2023-12-28 06:42:14,942][106226] Updated weights for policy 0, policy_version 1592301 (0.0009) [2023-12-28 06:42:14,998][106226] Updated weights for policy 0, policy_version 1592311 (0.0008) [2023-12-28 06:42:15,058][106225] Updated weights for policy 1, policy_version 1595962 (0.0008) [2023-12-28 06:42:15,114][106225] Updated weights for policy 1, policy_version 1595972 (0.0009) [2023-12-28 06:42:15,178][106225] Updated weights for policy 1, policy_version 1595982 (0.0008) [2023-12-28 06:42:15,239][106225] Updated weights for policy 1, policy_version 1595992 (0.0008) [2023-12-28 06:42:15,736][106226] Updated weights for policy 0, policy_version 1592321 (0.0011) [2023-12-28 06:42:15,804][106226] Updated weights for policy 0, policy_version 1592331 (0.0011) [2023-12-28 06:42:15,867][106226] Updated weights for policy 0, policy_version 1592341 (0.0009) [2023-12-28 06:42:15,914][106225] Updated weights for policy 1, policy_version 1596002 (0.0008) [2023-12-28 06:42:15,970][106225] Updated weights for policy 1, policy_version 1596012 (0.0009) [2023-12-28 06:42:16,025][106225] Updated weights for policy 1, policy_version 1596022 (0.0009) [2023-12-28 06:42:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 20206.9, 300 sec: 19827.4). Total num frames: 816349184. Throughput: 0: 9991.0, 1: 10110.8. Samples: 816335392. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:16,176][105115] Avg episode reward: [(0, '-4.750'), (1, '-4.752')] [2023-12-28 06:42:16,449][106226] Updated weights for policy 0, policy_version 1592351 (0.0010) [2023-12-28 06:42:16,504][106226] Updated weights for policy 0, policy_version 1592361 (0.0005) [2023-12-28 06:42:16,564][106226] Updated weights for policy 0, policy_version 1592371 (0.0005) [2023-12-28 06:42:16,845][106225] Updated weights for policy 1, policy_version 1596032 (0.0008) [2023-12-28 06:42:16,896][106225] Updated weights for policy 1, policy_version 1596042 (0.0008) [2023-12-28 06:42:16,946][106225] Updated weights for policy 1, policy_version 1596052 (0.0007) [2023-12-28 06:42:17,126][106226] Updated weights for policy 0, policy_version 1592381 (0.0008) [2023-12-28 06:42:17,177][106226] Updated weights for policy 0, policy_version 1592391 (0.0010) [2023-12-28 06:42:17,239][106226] Updated weights for policy 0, policy_version 1592401 (0.0010) [2023-12-28 06:42:17,718][106225] Updated weights for policy 1, policy_version 1596062 (0.0008) [2023-12-28 06:42:17,776][106225] Updated weights for policy 1, policy_version 1596072 (0.0007) [2023-12-28 06:42:17,838][106225] Updated weights for policy 1, policy_version 1596082 (0.0009) [2023-12-28 06:42:17,935][106226] Updated weights for policy 0, policy_version 1592411 (0.0011) [2023-12-28 06:42:17,992][106226] Updated weights for policy 0, policy_version 1592421 (0.0011) [2023-12-28 06:42:18,056][106226] Updated weights for policy 0, policy_version 1592431 (0.0010) [2023-12-28 06:42:18,505][106225] Updated weights for policy 1, policy_version 1596092 (0.0010) [2023-12-28 06:42:18,561][106225] Updated weights for policy 1, policy_version 1596102 (0.0009) [2023-12-28 06:42:18,613][106225] Updated weights for policy 1, policy_version 1596112 (0.0008) [2023-12-28 06:42:18,682][106226] Updated weights for policy 0, policy_version 1592441 (0.0011) [2023-12-28 06:42:18,741][106226] Updated weights for policy 0, policy_version 1592451 (0.0011) [2023-12-28 06:42:18,794][106226] Updated weights for policy 0, policy_version 1592461 (0.0011) [2023-12-28 06:42:18,845][106226] Updated weights for policy 0, policy_version 1592471 (0.0011) [2023-12-28 06:42:19,383][106225] Updated weights for policy 1, policy_version 1596122 (0.0008) [2023-12-28 06:42:19,446][106225] Updated weights for policy 1, policy_version 1596132 (0.0010) [2023-12-28 06:42:19,515][106225] Updated weights for policy 1, policy_version 1596142 (0.0010) [2023-12-28 06:42:19,568][106225] Updated weights for policy 1, policy_version 1596152 (0.0009) [2023-12-28 06:42:19,589][106226] Updated weights for policy 0, policy_version 1592481 (0.0008) [2023-12-28 06:42:19,645][106226] Updated weights for policy 0, policy_version 1592491 (0.0008) [2023-12-28 06:42:19,708][106226] Updated weights for policy 0, policy_version 1592501 (0.0008) [2023-12-28 06:42:20,342][106225] Updated weights for policy 1, policy_version 1596162 (0.0008) [2023-12-28 06:42:20,405][106225] Updated weights for policy 1, policy_version 1596172 (0.0007) [2023-12-28 06:42:20,431][106226] Updated weights for policy 0, policy_version 1592511 (0.0008) [2023-12-28 06:42:20,461][106225] Updated weights for policy 1, policy_version 1596182 (0.0007) [2023-12-28 06:42:20,491][106226] Updated weights for policy 0, policy_version 1592521 (0.0007) [2023-12-28 06:42:20,549][106226] Updated weights for policy 0, policy_version 1592531 (0.0009) [2023-12-28 06:42:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 816439296. Throughput: 0: 9934.4, 1: 10024.7. Samples: 816452260. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:21,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-4.572')] [2023-12-28 06:42:21,207][106225] Updated weights for policy 1, policy_version 1596192 (0.0008) [2023-12-28 06:42:21,262][106225] Updated weights for policy 1, policy_version 1596202 (0.0010) [2023-12-28 06:42:21,307][106226] Updated weights for policy 0, policy_version 1592541 (0.0007) [2023-12-28 06:42:21,326][106225] Updated weights for policy 1, policy_version 1596212 (0.0008) [2023-12-28 06:42:21,380][106226] Updated weights for policy 0, policy_version 1592551 (0.0008) [2023-12-28 06:42:21,448][106226] Updated weights for policy 0, policy_version 1592561 (0.0007) [2023-12-28 06:42:22,127][106226] Updated weights for policy 0, policy_version 1592571 (0.0008) [2023-12-28 06:42:22,138][106225] Updated weights for policy 1, policy_version 1596222 (0.0007) [2023-12-28 06:42:22,188][106226] Updated weights for policy 0, policy_version 1592581 (0.0009) [2023-12-28 06:42:22,206][106225] Updated weights for policy 1, policy_version 1596232 (0.0008) [2023-12-28 06:42:22,251][106226] Updated weights for policy 0, policy_version 1592591 (0.0006) [2023-12-28 06:42:22,273][106225] Updated weights for policy 1, policy_version 1596242 (0.0007) [2023-12-28 06:42:22,985][106226] Updated weights for policy 0, policy_version 1592601 (0.0007) [2023-12-28 06:42:23,004][106225] Updated weights for policy 1, policy_version 1596252 (0.0010) [2023-12-28 06:42:23,042][106226] Updated weights for policy 0, policy_version 1592611 (0.0006) [2023-12-28 06:42:23,062][106225] Updated weights for policy 1, policy_version 1596262 (0.0010) [2023-12-28 06:42:23,100][106226] Updated weights for policy 0, policy_version 1592621 (0.0007) [2023-12-28 06:42:23,126][106225] Updated weights for policy 1, policy_version 1596272 (0.0010) [2023-12-28 06:42:23,158][106226] Updated weights for policy 0, policy_version 1592631 (0.0007) [2023-12-28 06:42:23,678][106225] Updated weights for policy 1, policy_version 1596282 (0.0011) [2023-12-28 06:42:23,696][106226] Updated weights for policy 0, policy_version 1592641 (0.0008) [2023-12-28 06:42:23,733][106225] Updated weights for policy 1, policy_version 1596292 (0.0007) [2023-12-28 06:42:23,757][106226] Updated weights for policy 0, policy_version 1592651 (0.0007) [2023-12-28 06:42:23,791][106225] Updated weights for policy 1, policy_version 1596302 (0.0007) [2023-12-28 06:42:23,815][106226] Updated weights for policy 0, policy_version 1592661 (0.0007) [2023-12-28 06:42:23,846][106225] Updated weights for policy 1, policy_version 1596312 (0.0007) [2023-12-28 06:42:24,399][106226] Updated weights for policy 0, policy_version 1592671 (0.0006) [2023-12-28 06:42:24,449][106226] Updated weights for policy 0, policy_version 1592681 (0.0005) [2023-12-28 06:42:24,504][106226] Updated weights for policy 0, policy_version 1592691 (0.0005) [2023-12-28 06:42:24,527][106225] Updated weights for policy 1, policy_version 1596322 (0.0010) [2023-12-28 06:42:24,586][106225] Updated weights for policy 1, policy_version 1596332 (0.0010) [2023-12-28 06:42:24,629][106225] Updated weights for policy 1, policy_version 1596342 (0.0010) [2023-12-28 06:42:25,167][106226] Updated weights for policy 0, policy_version 1592701 (0.0006) [2023-12-28 06:42:25,220][106226] Updated weights for policy 0, policy_version 1592711 (0.0005) [2023-12-28 06:42:25,269][106226] Updated weights for policy 0, policy_version 1592721 (0.0006) [2023-12-28 06:42:25,376][106225] Updated weights for policy 1, policy_version 1596352 (0.0010) [2023-12-28 06:42:25,428][106225] Updated weights for policy 1, policy_version 1596362 (0.0007) [2023-12-28 06:42:25,481][106225] Updated weights for policy 1, policy_version 1596372 (0.0005) [2023-12-28 06:42:25,963][106226] Updated weights for policy 0, policy_version 1592731 (0.0007) [2023-12-28 06:42:26,036][106226] Updated weights for policy 0, policy_version 1592741 (0.0006) [2023-12-28 06:42:26,094][106226] Updated weights for policy 0, policy_version 1592751 (0.0009) [2023-12-28 06:42:26,104][106225] Updated weights for policy 1, policy_version 1596382 (0.0007) [2023-12-28 06:42:26,158][106225] Updated weights for policy 1, policy_version 1596392 (0.0005) [2023-12-28 06:42:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 816545792. Throughput: 0: 9947.7, 1: 9981.1. Samples: 816513188. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:26,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-4.838')] [2023-12-28 06:42:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001592760_407822336.pth... [2023-12-28 06:42:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001591576_407519232.pth [2023-12-28 06:42:26,217][106225] Updated weights for policy 1, policy_version 1596402 (0.0005) [2023-12-28 06:42:26,260][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001596408_408731648.pth... [2023-12-28 06:42:26,265][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001595224_408428544.pth [2023-12-28 06:42:26,723][106226] Updated weights for policy 0, policy_version 1592761 (0.0010) [2023-12-28 06:42:26,739][106225] Updated weights for policy 1, policy_version 1596412 (0.0005) [2023-12-28 06:42:26,781][106226] Updated weights for policy 0, policy_version 1592771 (0.0005) [2023-12-28 06:42:26,790][106225] Updated weights for policy 1, policy_version 1596422 (0.0005) [2023-12-28 06:42:26,839][106226] Updated weights for policy 0, policy_version 1592781 (0.0006) [2023-12-28 06:42:26,849][106225] Updated weights for policy 1, policy_version 1596432 (0.0006) [2023-12-28 06:42:26,900][106226] Updated weights for policy 0, policy_version 1592791 (0.0005) [2023-12-28 06:42:27,360][106225] Updated weights for policy 1, policy_version 1596442 (0.0005) [2023-12-28 06:42:27,406][106226] Updated weights for policy 0, policy_version 1592801 (0.0006) [2023-12-28 06:42:27,415][106225] Updated weights for policy 1, policy_version 1596452 (0.0006) [2023-12-28 06:42:27,472][106226] Updated weights for policy 0, policy_version 1592811 (0.0008) [2023-12-28 06:42:27,481][106225] Updated weights for policy 1, policy_version 1596462 (0.0008) [2023-12-28 06:42:27,536][106226] Updated weights for policy 0, policy_version 1592821 (0.0005) [2023-12-28 06:42:27,541][106225] Updated weights for policy 1, policy_version 1596472 (0.0006) [2023-12-28 06:42:28,110][106226] Updated weights for policy 0, policy_version 1592831 (0.0008) [2023-12-28 06:42:28,154][106226] Updated weights for policy 0, policy_version 1592841 (0.0008) [2023-12-28 06:42:28,204][106226] Updated weights for policy 0, policy_version 1592851 (0.0008) [2023-12-28 06:42:28,261][106225] Updated weights for policy 1, policy_version 1596482 (0.0008) [2023-12-28 06:42:28,317][106225] Updated weights for policy 1, policy_version 1596492 (0.0008) [2023-12-28 06:42:28,378][106225] Updated weights for policy 1, policy_version 1596502 (0.0008) [2023-12-28 06:42:28,893][106226] Updated weights for policy 0, policy_version 1592861 (0.0007) [2023-12-28 06:42:28,946][106226] Updated weights for policy 0, policy_version 1592871 (0.0006) [2023-12-28 06:42:29,008][106226] Updated weights for policy 0, policy_version 1592881 (0.0005) [2023-12-28 06:42:29,095][106225] Updated weights for policy 1, policy_version 1596512 (0.0008) [2023-12-28 06:42:29,163][106225] Updated weights for policy 1, policy_version 1596522 (0.0009) [2023-12-28 06:42:29,212][106225] Updated weights for policy 1, policy_version 1596532 (0.0008) [2023-12-28 06:42:29,621][106226] Updated weights for policy 0, policy_version 1592891 (0.0006) [2023-12-28 06:42:29,687][106226] Updated weights for policy 0, policy_version 1592901 (0.0006) [2023-12-28 06:42:29,750][106226] Updated weights for policy 0, policy_version 1592911 (0.0008) [2023-12-28 06:42:29,935][106225] Updated weights for policy 1, policy_version 1596542 (0.0009) [2023-12-28 06:42:29,988][106225] Updated weights for policy 1, policy_version 1596552 (0.0009) [2023-12-28 06:42:30,041][106225] Updated weights for policy 1, policy_version 1596562 (0.0009) [2023-12-28 06:42:30,486][106226] Updated weights for policy 0, policy_version 1592921 (0.0008) [2023-12-28 06:42:30,533][106226] Updated weights for policy 0, policy_version 1592931 (0.0005) [2023-12-28 06:42:30,580][106226] Updated weights for policy 0, policy_version 1592941 (0.0007) [2023-12-28 06:42:30,632][106226] Updated weights for policy 0, policy_version 1592951 (0.0008) [2023-12-28 06:42:30,681][106225] Updated weights for policy 1, policy_version 1596572 (0.0007) [2023-12-28 06:42:30,728][106225] Updated weights for policy 1, policy_version 1596582 (0.0005) [2023-12-28 06:42:30,788][106225] Updated weights for policy 1, policy_version 1596592 (0.0005) [2023-12-28 06:42:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 20207.0, 300 sec: 19827.4). Total num frames: 816652288. Throughput: 0: 10114.2, 1: 10035.3. Samples: 816641656. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:31,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.758')] [2023-12-28 06:42:31,256][106226] Updated weights for policy 0, policy_version 1592961 (0.0008) [2023-12-28 06:42:31,329][106226] Updated weights for policy 0, policy_version 1592971 (0.0009) [2023-12-28 06:42:31,395][106226] Updated weights for policy 0, policy_version 1592981 (0.0009) [2023-12-28 06:42:31,423][106225] Updated weights for policy 1, policy_version 1596602 (0.0006) [2023-12-28 06:42:31,475][106225] Updated weights for policy 1, policy_version 1596612 (0.0009) [2023-12-28 06:42:31,524][106225] Updated weights for policy 1, policy_version 1596622 (0.0009) [2023-12-28 06:42:31,582][106225] Updated weights for policy 1, policy_version 1596632 (0.0008) [2023-12-28 06:42:32,099][106226] Updated weights for policy 0, policy_version 1592991 (0.0008) [2023-12-28 06:42:32,160][106226] Updated weights for policy 0, policy_version 1593001 (0.0009) [2023-12-28 06:42:32,217][106226] Updated weights for policy 0, policy_version 1593011 (0.0007) [2023-12-28 06:42:32,376][106225] Updated weights for policy 1, policy_version 1596642 (0.0008) [2023-12-28 06:42:32,443][106225] Updated weights for policy 1, policy_version 1596652 (0.0006) [2023-12-28 06:42:32,502][106225] Updated weights for policy 1, policy_version 1596662 (0.0005) [2023-12-28 06:42:33,023][106226] Updated weights for policy 0, policy_version 1593021 (0.0009) [2023-12-28 06:42:33,060][106225] Updated weights for policy 1, policy_version 1596672 (0.0005) [2023-12-28 06:42:33,080][106226] Updated weights for policy 0, policy_version 1593031 (0.0010) [2023-12-28 06:42:33,119][106225] Updated weights for policy 1, policy_version 1596682 (0.0005) [2023-12-28 06:42:33,141][106226] Updated weights for policy 0, policy_version 1593041 (0.0010) [2023-12-28 06:42:33,177][106225] Updated weights for policy 1, policy_version 1596692 (0.0006) [2023-12-28 06:42:33,789][106225] Updated weights for policy 1, policy_version 1596702 (0.0005) [2023-12-28 06:42:33,837][106226] Updated weights for policy 0, policy_version 1593051 (0.0011) [2023-12-28 06:42:33,849][106225] Updated weights for policy 1, policy_version 1596712 (0.0006) [2023-12-28 06:42:33,884][106226] Updated weights for policy 0, policy_version 1593061 (0.0010) [2023-12-28 06:42:33,905][106225] Updated weights for policy 1, policy_version 1596722 (0.0005) [2023-12-28 06:42:33,934][106226] Updated weights for policy 0, policy_version 1593071 (0.0010) [2023-12-28 06:42:34,573][106225] Updated weights for policy 1, policy_version 1596732 (0.0008) [2023-12-28 06:42:34,635][106225] Updated weights for policy 1, policy_version 1596742 (0.0010) [2023-12-28 06:42:34,699][106226] Updated weights for policy 0, policy_version 1593081 (0.0010) [2023-12-28 06:42:34,701][106225] Updated weights for policy 1, policy_version 1596752 (0.0011) [2023-12-28 06:42:34,760][106226] Updated weights for policy 0, policy_version 1593091 (0.0008) [2023-12-28 06:42:34,819][106226] Updated weights for policy 0, policy_version 1593101 (0.0008) [2023-12-28 06:42:34,882][106226] Updated weights for policy 0, policy_version 1593111 (0.0008) [2023-12-28 06:42:35,378][106225] Updated weights for policy 1, policy_version 1596762 (0.0011) [2023-12-28 06:42:35,440][106225] Updated weights for policy 1, policy_version 1596772 (0.0011) [2023-12-28 06:42:35,505][106225] Updated weights for policy 1, policy_version 1596782 (0.0010) [2023-12-28 06:42:35,566][106225] Updated weights for policy 1, policy_version 1596792 (0.0010) [2023-12-28 06:42:35,630][106226] Updated weights for policy 0, policy_version 1593121 (0.0010) [2023-12-28 06:42:35,686][106226] Updated weights for policy 0, policy_version 1593131 (0.0010) [2023-12-28 06:42:35,742][106226] Updated weights for policy 0, policy_version 1593141 (0.0011) [2023-12-28 06:42:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 816750592. Throughput: 0: 10035.8, 1: 10019.4. Samples: 816762432. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:36,175][105115] Avg episode reward: [(0, '-5.039'), (1, '-4.734')] [2023-12-28 06:42:36,236][106225] Updated weights for policy 1, policy_version 1596802 (0.0008) [2023-12-28 06:42:36,295][106225] Updated weights for policy 1, policy_version 1596812 (0.0008) [2023-12-28 06:42:36,354][106225] Updated weights for policy 1, policy_version 1596822 (0.0008) [2023-12-28 06:42:36,461][106226] Updated weights for policy 0, policy_version 1593151 (0.0011) [2023-12-28 06:42:36,529][106226] Updated weights for policy 0, policy_version 1593161 (0.0011) [2023-12-28 06:42:36,591][106226] Updated weights for policy 0, policy_version 1593171 (0.0011) [2023-12-28 06:42:37,120][106225] Updated weights for policy 1, policy_version 1596832 (0.0010) [2023-12-28 06:42:37,183][106225] Updated weights for policy 1, policy_version 1596842 (0.0010) [2023-12-28 06:42:37,213][106226] Updated weights for policy 0, policy_version 1593181 (0.0011) [2023-12-28 06:42:37,241][106225] Updated weights for policy 1, policy_version 1596852 (0.0010) [2023-12-28 06:42:37,263][106226] Updated weights for policy 0, policy_version 1593191 (0.0010) [2023-12-28 06:42:37,319][106226] Updated weights for policy 0, policy_version 1593201 (0.0006) [2023-12-28 06:42:37,957][106225] Updated weights for policy 1, policy_version 1596862 (0.0009) [2023-12-28 06:42:37,978][106226] Updated weights for policy 0, policy_version 1593211 (0.0010) [2023-12-28 06:42:38,009][106225] Updated weights for policy 1, policy_version 1596872 (0.0010) [2023-12-28 06:42:38,033][106226] Updated weights for policy 0, policy_version 1593221 (0.0011) [2023-12-28 06:42:38,061][106225] Updated weights for policy 1, policy_version 1596882 (0.0007) [2023-12-28 06:42:38,084][106226] Updated weights for policy 0, policy_version 1593231 (0.0010) [2023-12-28 06:42:38,764][106225] Updated weights for policy 1, policy_version 1596892 (0.0007) [2023-12-28 06:42:38,830][106225] Updated weights for policy 1, policy_version 1596902 (0.0008) [2023-12-28 06:42:38,849][106226] Updated weights for policy 0, policy_version 1593241 (0.0011) [2023-12-28 06:42:38,887][106225] Updated weights for policy 1, policy_version 1596912 (0.0007) [2023-12-28 06:42:38,911][106226] Updated weights for policy 0, policy_version 1593251 (0.0011) [2023-12-28 06:42:38,972][106226] Updated weights for policy 0, policy_version 1593261 (0.0010) [2023-12-28 06:42:39,029][106226] Updated weights for policy 0, policy_version 1593271 (0.0009) [2023-12-28 06:42:39,609][106225] Updated weights for policy 1, policy_version 1596922 (0.0006) [2023-12-28 06:42:39,676][106225] Updated weights for policy 1, policy_version 1596932 (0.0008) [2023-12-28 06:42:39,729][106225] Updated weights for policy 1, policy_version 1596942 (0.0010) [2023-12-28 06:42:39,792][106225] Updated weights for policy 1, policy_version 1596952 (0.0006) [2023-12-28 06:42:39,792][106226] Updated weights for policy 0, policy_version 1593281 (0.0009) [2023-12-28 06:42:39,858][106226] Updated weights for policy 0, policy_version 1593291 (0.0009) [2023-12-28 06:42:39,928][106226] Updated weights for policy 0, policy_version 1593301 (0.0009) [2023-12-28 06:42:40,470][106225] Updated weights for policy 1, policy_version 1596962 (0.0008) [2023-12-28 06:42:40,528][106225] Updated weights for policy 1, policy_version 1596972 (0.0010) [2023-12-28 06:42:40,582][106225] Updated weights for policy 1, policy_version 1596982 (0.0008) [2023-12-28 06:42:40,635][106226] Updated weights for policy 0, policy_version 1593311 (0.0009) [2023-12-28 06:42:40,691][106226] Updated weights for policy 0, policy_version 1593321 (0.0009) [2023-12-28 06:42:40,747][106226] Updated weights for policy 0, policy_version 1593331 (0.0005) [2023-12-28 06:42:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 816848896. Throughput: 0: 10066.3, 1: 10041.8. Samples: 816821648. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:41,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.727')] [2023-12-28 06:42:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001596984_408879104.pth... [2023-12-28 06:42:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001593336_407969792.pth... [2023-12-28 06:42:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001595832_408584192.pth [2023-12-28 06:42:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001592152_407666688.pth [2023-12-28 06:42:41,351][106225] Updated weights for policy 1, policy_version 1596992 (0.0008) [2023-12-28 06:42:41,420][106225] Updated weights for policy 1, policy_version 1597002 (0.0008) [2023-12-28 06:42:41,469][106226] Updated weights for policy 0, policy_version 1593341 (0.0006) [2023-12-28 06:42:41,471][106225] Updated weights for policy 1, policy_version 1597012 (0.0008) [2023-12-28 06:42:41,530][106226] Updated weights for policy 0, policy_version 1593351 (0.0007) [2023-12-28 06:42:41,594][106226] Updated weights for policy 0, policy_version 1593361 (0.0008) [2023-12-28 06:42:42,224][106225] Updated weights for policy 1, policy_version 1597022 (0.0009) [2023-12-28 06:42:42,272][106226] Updated weights for policy 0, policy_version 1593371 (0.0007) [2023-12-28 06:42:42,294][106225] Updated weights for policy 1, policy_version 1597032 (0.0008) [2023-12-28 06:42:42,333][106226] Updated weights for policy 0, policy_version 1593381 (0.0007) [2023-12-28 06:42:42,362][106225] Updated weights for policy 1, policy_version 1597042 (0.0009) [2023-12-28 06:42:42,416][106226] Updated weights for policy 0, policy_version 1593391 (0.0008) [2023-12-28 06:42:43,000][106225] Updated weights for policy 1, policy_version 1597052 (0.0009) [2023-12-28 06:42:43,051][106226] Updated weights for policy 0, policy_version 1593401 (0.0008) [2023-12-28 06:42:43,053][106225] Updated weights for policy 1, policy_version 1597062 (0.0008) [2023-12-28 06:42:43,105][106225] Updated weights for policy 1, policy_version 1597072 (0.0008) [2023-12-28 06:42:43,116][106226] Updated weights for policy 0, policy_version 1593411 (0.0007) [2023-12-28 06:42:43,174][106226] Updated weights for policy 0, policy_version 1593421 (0.0009) [2023-12-28 06:42:43,229][106226] Updated weights for policy 0, policy_version 1593431 (0.0008) [2023-12-28 06:42:43,741][106225] Updated weights for policy 1, policy_version 1597082 (0.0006) [2023-12-28 06:42:43,810][106225] Updated weights for policy 1, policy_version 1597092 (0.0005) [2023-12-28 06:42:43,875][106225] Updated weights for policy 1, policy_version 1597102 (0.0005) [2023-12-28 06:42:43,935][106225] Updated weights for policy 1, policy_version 1597112 (0.0005) [2023-12-28 06:42:44,010][106226] Updated weights for policy 0, policy_version 1593441 (0.0009) [2023-12-28 06:42:44,061][106226] Updated weights for policy 0, policy_version 1593451 (0.0009) [2023-12-28 06:42:44,118][106226] Updated weights for policy 0, policy_version 1593461 (0.0008) [2023-12-28 06:42:44,455][106225] Updated weights for policy 1, policy_version 1597122 (0.0006) [2023-12-28 06:42:44,501][106225] Updated weights for policy 1, policy_version 1597132 (0.0008) [2023-12-28 06:42:44,545][106225] Updated weights for policy 1, policy_version 1597142 (0.0008) [2023-12-28 06:42:44,953][106226] Updated weights for policy 0, policy_version 1593471 (0.0006) [2023-12-28 06:42:45,022][106226] Updated weights for policy 0, policy_version 1593481 (0.0008) [2023-12-28 06:42:45,090][106226] Updated weights for policy 0, policy_version 1593491 (0.0009) [2023-12-28 06:42:45,206][106225] Updated weights for policy 1, policy_version 1597152 (0.0010) [2023-12-28 06:42:45,266][106225] Updated weights for policy 1, policy_version 1597162 (0.0011) [2023-12-28 06:42:45,324][106225] Updated weights for policy 1, policy_version 1597172 (0.0011) [2023-12-28 06:42:45,790][106226] Updated weights for policy 0, policy_version 1593501 (0.0009) [2023-12-28 06:42:45,851][106226] Updated weights for policy 0, policy_version 1593511 (0.0008) [2023-12-28 06:42:45,909][106226] Updated weights for policy 0, policy_version 1593521 (0.0008) [2023-12-28 06:42:46,035][106225] Updated weights for policy 1, policy_version 1597182 (0.0010) [2023-12-28 06:42:46,093][106225] Updated weights for policy 1, policy_version 1597192 (0.0011) [2023-12-28 06:42:46,157][106225] Updated weights for policy 1, policy_version 1597202 (0.0010) [2023-12-28 06:42:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 816947200. Throughput: 0: 10010.8, 1: 10025.1. Samples: 816938296. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:46,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.730')] [2023-12-28 06:42:46,515][106226] Updated weights for policy 0, policy_version 1593531 (0.0008) [2023-12-28 06:42:46,571][106226] Updated weights for policy 0, policy_version 1593541 (0.0008) [2023-12-28 06:42:46,636][106226] Updated weights for policy 0, policy_version 1593551 (0.0008) [2023-12-28 06:42:46,706][106225] Updated weights for policy 1, policy_version 1597212 (0.0007) [2023-12-28 06:42:46,765][106225] Updated weights for policy 1, policy_version 1597222 (0.0006) [2023-12-28 06:42:46,815][106225] Updated weights for policy 1, policy_version 1597232 (0.0006) [2023-12-28 06:42:47,344][106225] Updated weights for policy 1, policy_version 1597242 (0.0005) [2023-12-28 06:42:47,396][106225] Updated weights for policy 1, policy_version 1597252 (0.0008) [2023-12-28 06:42:47,418][106226] Updated weights for policy 0, policy_version 1593561 (0.0008) [2023-12-28 06:42:47,447][106225] Updated weights for policy 1, policy_version 1597262 (0.0007) [2023-12-28 06:42:47,466][106226] Updated weights for policy 0, policy_version 1593571 (0.0008) [2023-12-28 06:42:47,496][106225] Updated weights for policy 1, policy_version 1597272 (0.0007) [2023-12-28 06:42:47,522][106226] Updated weights for policy 0, policy_version 1593581 (0.0008) [2023-12-28 06:42:47,567][106226] Updated weights for policy 0, policy_version 1593591 (0.0008) [2023-12-28 06:42:48,227][106225] Updated weights for policy 1, policy_version 1597282 (0.0009) [2023-12-28 06:42:48,285][106225] Updated weights for policy 1, policy_version 1597292 (0.0009) [2023-12-28 06:42:48,321][106226] Updated weights for policy 0, policy_version 1593601 (0.0008) [2023-12-28 06:42:48,354][106225] Updated weights for policy 1, policy_version 1597302 (0.0008) [2023-12-28 06:42:48,386][106226] Updated weights for policy 0, policy_version 1593611 (0.0007) [2023-12-28 06:42:48,447][106226] Updated weights for policy 0, policy_version 1593621 (0.0007) [2023-12-28 06:42:49,064][106226] Updated weights for policy 0, policy_version 1593631 (0.0006) [2023-12-28 06:42:49,127][106226] Updated weights for policy 0, policy_version 1593641 (0.0006) [2023-12-28 06:42:49,142][106225] Updated weights for policy 1, policy_version 1597312 (0.0008) [2023-12-28 06:42:49,180][106226] Updated weights for policy 0, policy_version 1593651 (0.0005) [2023-12-28 06:42:49,199][106225] Updated weights for policy 1, policy_version 1597322 (0.0008) [2023-12-28 06:42:49,281][106225] Updated weights for policy 1, policy_version 1597332 (0.0009) [2023-12-28 06:42:49,822][106226] Updated weights for policy 0, policy_version 1593661 (0.0007) [2023-12-28 06:42:49,890][106226] Updated weights for policy 0, policy_version 1593671 (0.0007) [2023-12-28 06:42:49,954][106226] Updated weights for policy 0, policy_version 1593681 (0.0009) [2023-12-28 06:42:50,012][106225] Updated weights for policy 1, policy_version 1597342 (0.0007) [2023-12-28 06:42:50,074][106225] Updated weights for policy 1, policy_version 1597352 (0.0008) [2023-12-28 06:42:50,127][106225] Updated weights for policy 1, policy_version 1597362 (0.0009) [2023-12-28 06:42:50,697][106226] Updated weights for policy 0, policy_version 1593691 (0.0009) [2023-12-28 06:42:50,758][106226] Updated weights for policy 0, policy_version 1593701 (0.0006) [2023-12-28 06:42:50,826][106226] Updated weights for policy 0, policy_version 1593711 (0.0006) [2023-12-28 06:42:50,938][106225] Updated weights for policy 1, policy_version 1597372 (0.0009) [2023-12-28 06:42:51,008][106225] Updated weights for policy 1, policy_version 1597382 (0.0009) [2023-12-28 06:42:51,079][106225] Updated weights for policy 1, policy_version 1597392 (0.0009) [2023-12-28 06:42:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 817053696. Throughput: 0: 9950.3, 1: 10025.3. Samples: 817059624. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:51,175][105115] Avg episode reward: [(0, '-4.951'), (1, '-4.545')] [2023-12-28 06:42:51,469][106226] Updated weights for policy 0, policy_version 1593721 (0.0006) [2023-12-28 06:42:51,528][106226] Updated weights for policy 0, policy_version 1593731 (0.0008) [2023-12-28 06:42:51,589][106226] Updated weights for policy 0, policy_version 1593741 (0.0009) [2023-12-28 06:42:51,660][106226] Updated weights for policy 0, policy_version 1593751 (0.0009) [2023-12-28 06:42:51,852][106225] Updated weights for policy 1, policy_version 1597402 (0.0008) [2023-12-28 06:42:51,898][106225] Updated weights for policy 1, policy_version 1597412 (0.0008) [2023-12-28 06:42:51,957][106225] Updated weights for policy 1, policy_version 1597422 (0.0008) [2023-12-28 06:42:52,016][106225] Updated weights for policy 1, policy_version 1597432 (0.0008) [2023-12-28 06:42:52,394][106226] Updated weights for policy 0, policy_version 1593761 (0.0008) [2023-12-28 06:42:52,454][106226] Updated weights for policy 0, policy_version 1593771 (0.0008) [2023-12-28 06:42:52,510][106226] Updated weights for policy 0, policy_version 1593781 (0.0008) [2023-12-28 06:42:52,781][106225] Updated weights for policy 1, policy_version 1597442 (0.0010) [2023-12-28 06:42:52,832][106225] Updated weights for policy 1, policy_version 1597452 (0.0009) [2023-12-28 06:42:52,894][106225] Updated weights for policy 1, policy_version 1597463 (0.0009) [2023-12-28 06:42:53,204][106226] Updated weights for policy 0, policy_version 1593791 (0.0008) [2023-12-28 06:42:53,269][106226] Updated weights for policy 0, policy_version 1593801 (0.0009) [2023-12-28 06:42:53,334][106226] Updated weights for policy 0, policy_version 1593811 (0.0007) [2023-12-28 06:42:53,575][106225] Updated weights for policy 1, policy_version 1597473 (0.0009) [2023-12-28 06:42:53,626][106225] Updated weights for policy 1, policy_version 1597483 (0.0008) [2023-12-28 06:42:53,677][106225] Updated weights for policy 1, policy_version 1597493 (0.0008) [2023-12-28 06:42:54,037][106226] Updated weights for policy 0, policy_version 1593821 (0.0008) [2023-12-28 06:42:54,097][106226] Updated weights for policy 0, policy_version 1593831 (0.0008) [2023-12-28 06:42:54,162][106226] Updated weights for policy 0, policy_version 1593841 (0.0009) [2023-12-28 06:42:54,407][106225] Updated weights for policy 1, policy_version 1597503 (0.0008) [2023-12-28 06:42:54,478][106225] Updated weights for policy 1, policy_version 1597513 (0.0009) [2023-12-28 06:42:54,532][106225] Updated weights for policy 1, policy_version 1597523 (0.0008) [2023-12-28 06:42:54,887][106226] Updated weights for policy 0, policy_version 1593851 (0.0008) [2023-12-28 06:42:54,944][106226] Updated weights for policy 0, policy_version 1593861 (0.0006) [2023-12-28 06:42:54,995][106226] Updated weights for policy 0, policy_version 1593871 (0.0006) [2023-12-28 06:42:55,249][106225] Updated weights for policy 1, policy_version 1597533 (0.0008) [2023-12-28 06:42:55,309][106225] Updated weights for policy 1, policy_version 1597543 (0.0007) [2023-12-28 06:42:55,378][106225] Updated weights for policy 1, policy_version 1597553 (0.0008) [2023-12-28 06:42:55,618][106226] Updated weights for policy 0, policy_version 1593881 (0.0006) [2023-12-28 06:42:55,677][106226] Updated weights for policy 0, policy_version 1593891 (0.0010) [2023-12-28 06:42:55,737][106226] Updated weights for policy 0, policy_version 1593901 (0.0010) [2023-12-28 06:42:55,787][106226] Updated weights for policy 0, policy_version 1593911 (0.0010) [2023-12-28 06:42:56,128][106225] Updated weights for policy 1, policy_version 1597563 (0.0010) [2023-12-28 06:42:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19934.0, 300 sec: 19827.4). Total num frames: 817143808. Throughput: 0: 9973.4, 1: 9980.7. Samples: 817116664. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:42:56,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.536')] [2023-12-28 06:42:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001593912_408117248.pth... [2023-12-28 06:42:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001592760_407822336.pth [2023-12-28 06:42:56,190][106225] Updated weights for policy 1, policy_version 1597573 (0.0007) [2023-12-28 06:42:56,252][106225] Updated weights for policy 1, policy_version 1597583 (0.0008) [2023-12-28 06:42:56,299][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001597592_409034752.pth... [2023-12-28 06:42:56,303][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001596408_408731648.pth [2023-12-28 06:42:56,454][106226] Updated weights for policy 0, policy_version 1593921 (0.0010) [2023-12-28 06:42:56,507][106226] Updated weights for policy 0, policy_version 1593931 (0.0010) [2023-12-28 06:42:56,553][106226] Updated weights for policy 0, policy_version 1593941 (0.0010) [2023-12-28 06:42:56,986][106225] Updated weights for policy 1, policy_version 1597593 (0.0007) [2023-12-28 06:42:57,032][106225] Updated weights for policy 1, policy_version 1597603 (0.0008) [2023-12-28 06:42:57,078][106225] Updated weights for policy 1, policy_version 1597613 (0.0007) [2023-12-28 06:42:57,131][106225] Updated weights for policy 1, policy_version 1597623 (0.0008) [2023-12-28 06:42:57,231][106226] Updated weights for policy 0, policy_version 1593951 (0.0010) [2023-12-28 06:42:57,281][106226] Updated weights for policy 0, policy_version 1593961 (0.0010) [2023-12-28 06:42:57,344][106226] Updated weights for policy 0, policy_version 1593971 (0.0011) [2023-12-28 06:42:57,759][106225] Updated weights for policy 1, policy_version 1597633 (0.0008) [2023-12-28 06:42:57,812][106225] Updated weights for policy 1, policy_version 1597643 (0.0008) [2023-12-28 06:42:57,870][106225] Updated weights for policy 1, policy_version 1597653 (0.0008) [2023-12-28 06:42:58,062][106226] Updated weights for policy 0, policy_version 1593981 (0.0011) [2023-12-28 06:42:58,119][106226] Updated weights for policy 0, policy_version 1593991 (0.0010) [2023-12-28 06:42:58,183][106226] Updated weights for policy 0, policy_version 1594001 (0.0010) [2023-12-28 06:42:58,650][106225] Updated weights for policy 1, policy_version 1597663 (0.0008) [2023-12-28 06:42:58,713][106225] Updated weights for policy 1, policy_version 1597673 (0.0009) [2023-12-28 06:42:58,781][106225] Updated weights for policy 1, policy_version 1597683 (0.0009) [2023-12-28 06:42:59,008][106226] Updated weights for policy 0, policy_version 1594011 (0.0009) [2023-12-28 06:42:59,069][106226] Updated weights for policy 0, policy_version 1594021 (0.0008) [2023-12-28 06:42:59,131][106226] Updated weights for policy 0, policy_version 1594031 (0.0008) [2023-12-28 06:42:59,624][106225] Updated weights for policy 1, policy_version 1597693 (0.0009) [2023-12-28 06:42:59,684][106225] Updated weights for policy 1, policy_version 1597703 (0.0010) [2023-12-28 06:42:59,732][106225] Updated weights for policy 1, policy_version 1597713 (0.0010) [2023-12-28 06:42:59,814][106226] Updated weights for policy 0, policy_version 1594041 (0.0009) [2023-12-28 06:42:59,881][106226] Updated weights for policy 0, policy_version 1594051 (0.0007) [2023-12-28 06:42:59,942][106226] Updated weights for policy 0, policy_version 1594061 (0.0009) [2023-12-28 06:43:00,003][106226] Updated weights for policy 0, policy_version 1594071 (0.0009) [2023-12-28 06:43:00,468][106225] Updated weights for policy 1, policy_version 1597723 (0.0009) [2023-12-28 06:43:00,523][106225] Updated weights for policy 1, policy_version 1597733 (0.0005) [2023-12-28 06:43:00,576][106225] Updated weights for policy 1, policy_version 1597743 (0.0005) [2023-12-28 06:43:00,687][106226] Updated weights for policy 0, policy_version 1594081 (0.0009) [2023-12-28 06:43:00,750][106226] Updated weights for policy 0, policy_version 1594091 (0.0006) [2023-12-28 06:43:00,807][106226] Updated weights for policy 0, policy_version 1594101 (0.0007) [2023-12-28 06:43:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 817242112. Throughput: 0: 10027.1, 1: 9917.3. Samples: 817232888. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:01,175][105115] Avg episode reward: [(0, '-4.685'), (1, '-4.788')] [2023-12-28 06:43:01,201][106225] Updated weights for policy 1, policy_version 1597753 (0.0005) [2023-12-28 06:43:01,260][106225] Updated weights for policy 1, policy_version 1597763 (0.0006) [2023-12-28 06:43:01,327][106225] Updated weights for policy 1, policy_version 1597773 (0.0006) [2023-12-28 06:43:01,394][106225] Updated weights for policy 1, policy_version 1597783 (0.0008) [2023-12-28 06:43:01,493][106226] Updated weights for policy 0, policy_version 1594111 (0.0008) [2023-12-28 06:43:01,556][106226] Updated weights for policy 0, policy_version 1594121 (0.0009) [2023-12-28 06:43:01,617][106226] Updated weights for policy 0, policy_version 1594131 (0.0008) [2023-12-28 06:43:02,106][106225] Updated weights for policy 1, policy_version 1597793 (0.0006) [2023-12-28 06:43:02,162][106225] Updated weights for policy 1, policy_version 1597803 (0.0005) [2023-12-28 06:43:02,217][106225] Updated weights for policy 1, policy_version 1597813 (0.0005) [2023-12-28 06:43:02,336][106226] Updated weights for policy 0, policy_version 1594141 (0.0007) [2023-12-28 06:43:02,403][106226] Updated weights for policy 0, policy_version 1594151 (0.0010) [2023-12-28 06:43:02,467][106226] Updated weights for policy 0, policy_version 1594161 (0.0011) [2023-12-28 06:43:02,872][106225] Updated weights for policy 1, policy_version 1597823 (0.0008) [2023-12-28 06:43:02,921][106225] Updated weights for policy 1, policy_version 1597833 (0.0007) [2023-12-28 06:43:02,970][106225] Updated weights for policy 1, policy_version 1597843 (0.0007) [2023-12-28 06:43:03,156][106226] Updated weights for policy 0, policy_version 1594171 (0.0010) [2023-12-28 06:43:03,214][106226] Updated weights for policy 0, policy_version 1594181 (0.0010) [2023-12-28 06:43:03,270][106226] Updated weights for policy 0, policy_version 1594191 (0.0010) [2023-12-28 06:43:03,726][106225] Updated weights for policy 1, policy_version 1597853 (0.0008) [2023-12-28 06:43:03,781][106225] Updated weights for policy 1, policy_version 1597863 (0.0005) [2023-12-28 06:43:03,799][106226] Updated weights for policy 0, policy_version 1594201 (0.0006) [2023-12-28 06:43:03,835][106225] Updated weights for policy 1, policy_version 1597873 (0.0006) [2023-12-28 06:43:03,870][106226] Updated weights for policy 0, policy_version 1594211 (0.0011) [2023-12-28 06:43:03,940][106226] Updated weights for policy 0, policy_version 1594221 (0.0011) [2023-12-28 06:43:04,000][106226] Updated weights for policy 0, policy_version 1594231 (0.0010) [2023-12-28 06:43:04,473][106225] Updated weights for policy 1, policy_version 1597883 (0.0006) [2023-12-28 06:43:04,530][106225] Updated weights for policy 1, policy_version 1597893 (0.0007) [2023-12-28 06:43:04,583][106225] Updated weights for policy 1, policy_version 1597903 (0.0008) [2023-12-28 06:43:04,680][106226] Updated weights for policy 0, policy_version 1594241 (0.0009) [2023-12-28 06:43:04,733][106226] Updated weights for policy 0, policy_version 1594251 (0.0006) [2023-12-28 06:43:04,779][106226] Updated weights for policy 0, policy_version 1594261 (0.0007) [2023-12-28 06:43:05,251][106225] Updated weights for policy 1, policy_version 1597913 (0.0007) [2023-12-28 06:43:05,317][106225] Updated weights for policy 1, policy_version 1597923 (0.0009) [2023-12-28 06:43:05,370][106225] Updated weights for policy 1, policy_version 1597933 (0.0008) [2023-12-28 06:43:05,429][106226] Updated weights for policy 0, policy_version 1594271 (0.0007) [2023-12-28 06:43:05,430][106225] Updated weights for policy 1, policy_version 1597943 (0.0007) [2023-12-28 06:43:05,494][106226] Updated weights for policy 0, policy_version 1594281 (0.0008) [2023-12-28 06:43:05,556][106226] Updated weights for policy 0, policy_version 1594291 (0.0008) [2023-12-28 06:43:06,159][106225] Updated weights for policy 1, policy_version 1597953 (0.0007) [2023-12-28 06:43:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 817340416. Throughput: 0: 10029.1, 1: 10025.4. Samples: 817354716. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:06,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.425')] [2023-12-28 06:43:06,226][106225] Updated weights for policy 1, policy_version 1597963 (0.0009) [2023-12-28 06:43:06,294][106225] Updated weights for policy 1, policy_version 1597973 (0.0007) [2023-12-28 06:43:06,330][106226] Updated weights for policy 0, policy_version 1594301 (0.0008) [2023-12-28 06:43:06,382][106226] Updated weights for policy 0, policy_version 1594311 (0.0008) [2023-12-28 06:43:06,445][106226] Updated weights for policy 0, policy_version 1594321 (0.0008) [2023-12-28 06:43:07,004][106225] Updated weights for policy 1, policy_version 1597983 (0.0009) [2023-12-28 06:43:07,064][106225] Updated weights for policy 1, policy_version 1597993 (0.0010) [2023-12-28 06:43:07,122][106225] Updated weights for policy 1, policy_version 1598003 (0.0010) [2023-12-28 06:43:07,209][106226] Updated weights for policy 0, policy_version 1594331 (0.0008) [2023-12-28 06:43:07,276][106226] Updated weights for policy 0, policy_version 1594341 (0.0006) [2023-12-28 06:43:07,330][106226] Updated weights for policy 0, policy_version 1594351 (0.0006) [2023-12-28 06:43:07,818][106225] Updated weights for policy 1, policy_version 1598013 (0.0008) [2023-12-28 06:43:07,865][106225] Updated weights for policy 1, policy_version 1598023 (0.0005) [2023-12-28 06:43:07,893][106226] Updated weights for policy 0, policy_version 1594361 (0.0006) [2023-12-28 06:43:07,917][106225] Updated weights for policy 1, policy_version 1598033 (0.0008) [2023-12-28 06:43:07,952][106226] Updated weights for policy 0, policy_version 1594371 (0.0011) [2023-12-28 06:43:08,010][106226] Updated weights for policy 0, policy_version 1594381 (0.0010) [2023-12-28 06:43:08,064][106226] Updated weights for policy 0, policy_version 1594391 (0.0010) [2023-12-28 06:43:08,581][106225] Updated weights for policy 1, policy_version 1598043 (0.0008) [2023-12-28 06:43:08,651][106225] Updated weights for policy 1, policy_version 1598053 (0.0007) [2023-12-28 06:43:08,723][106225] Updated weights for policy 1, policy_version 1598063 (0.0007) [2023-12-28 06:43:08,770][106226] Updated weights for policy 0, policy_version 1594401 (0.0010) [2023-12-28 06:43:08,824][106226] Updated weights for policy 0, policy_version 1594411 (0.0010) [2023-12-28 06:43:08,892][106226] Updated weights for policy 0, policy_version 1594421 (0.0011) [2023-12-28 06:43:09,328][106225] Updated weights for policy 1, policy_version 1598073 (0.0007) [2023-12-28 06:43:09,400][106225] Updated weights for policy 1, policy_version 1598083 (0.0008) [2023-12-28 06:43:09,465][106225] Updated weights for policy 1, policy_version 1598093 (0.0008) [2023-12-28 06:43:09,530][106225] Updated weights for policy 1, policy_version 1598103 (0.0009) [2023-12-28 06:43:09,627][106226] Updated weights for policy 0, policy_version 1594431 (0.0009) [2023-12-28 06:43:09,686][106226] Updated weights for policy 0, policy_version 1594441 (0.0008) [2023-12-28 06:43:09,746][106226] Updated weights for policy 0, policy_version 1594451 (0.0009) [2023-12-28 06:43:10,319][106225] Updated weights for policy 1, policy_version 1598113 (0.0008) [2023-12-28 06:43:10,379][106225] Updated weights for policy 1, policy_version 1598123 (0.0008) [2023-12-28 06:43:10,436][106226] Updated weights for policy 0, policy_version 1594461 (0.0008) [2023-12-28 06:43:10,443][106225] Updated weights for policy 1, policy_version 1598133 (0.0007) [2023-12-28 06:43:10,492][106226] Updated weights for policy 0, policy_version 1594471 (0.0008) [2023-12-28 06:43:10,557][106226] Updated weights for policy 0, policy_version 1594481 (0.0010) [2023-12-28 06:43:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 817438720. Throughput: 0: 9996.5, 1: 10028.9. Samples: 817414332. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:11,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.465')] [2023-12-28 06:43:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001594488_408264704.pth... [2023-12-28 06:43:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001593336_407969792.pth [2023-12-28 06:43:11,212][106225] Updated weights for policy 1, policy_version 1598143 (0.0007) [2023-12-28 06:43:11,224][106226] Updated weights for policy 0, policy_version 1594491 (0.0008) [2023-12-28 06:43:11,279][106225] Updated weights for policy 1, policy_version 1598153 (0.0008) [2023-12-28 06:43:11,294][106226] Updated weights for policy 0, policy_version 1594501 (0.0008) [2023-12-28 06:43:11,338][106225] Updated weights for policy 1, policy_version 1598163 (0.0008) [2023-12-28 06:43:11,357][106226] Updated weights for policy 0, policy_version 1594511 (0.0007) [2023-12-28 06:43:11,375][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001598168_409182208.pth... [2023-12-28 06:43:11,380][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001596984_408879104.pth [2023-12-28 06:43:12,067][106225] Updated weights for policy 1, policy_version 1598173 (0.0008) [2023-12-28 06:43:12,133][106225] Updated weights for policy 1, policy_version 1598183 (0.0008) [2023-12-28 06:43:12,140][106226] Updated weights for policy 0, policy_version 1594522 (0.0010) [2023-12-28 06:43:12,187][106225] Updated weights for policy 1, policy_version 1598193 (0.0007) [2023-12-28 06:43:12,194][106226] Updated weights for policy 0, policy_version 1594532 (0.0011) [2023-12-28 06:43:12,245][106226] Updated weights for policy 0, policy_version 1594542 (0.0011) [2023-12-28 06:43:12,312][106226] Updated weights for policy 0, policy_version 1594552 (0.0008) [2023-12-28 06:43:12,904][106225] Updated weights for policy 1, policy_version 1598203 (0.0007) [2023-12-28 06:43:12,969][106225] Updated weights for policy 1, policy_version 1598213 (0.0008) [2023-12-28 06:43:13,021][106226] Updated weights for policy 0, policy_version 1594562 (0.0009) [2023-12-28 06:43:13,026][106225] Updated weights for policy 1, policy_version 1598223 (0.0005) [2023-12-28 06:43:13,084][106226] Updated weights for policy 0, policy_version 1594572 (0.0007) [2023-12-28 06:43:13,144][106226] Updated weights for policy 0, policy_version 1594582 (0.0007) [2023-12-28 06:43:13,763][106225] Updated weights for policy 1, policy_version 1598233 (0.0007) [2023-12-28 06:43:13,789][106226] Updated weights for policy 0, policy_version 1594592 (0.0006) [2023-12-28 06:43:13,820][106225] Updated weights for policy 1, policy_version 1598243 (0.0007) [2023-12-28 06:43:13,838][106226] Updated weights for policy 0, policy_version 1594602 (0.0006) [2023-12-28 06:43:13,879][106225] Updated weights for policy 1, policy_version 1598253 (0.0008) [2023-12-28 06:43:13,894][106226] Updated weights for policy 0, policy_version 1594612 (0.0008) [2023-12-28 06:43:13,941][106225] Updated weights for policy 1, policy_version 1598263 (0.0007) [2023-12-28 06:43:14,601][106226] Updated weights for policy 0, policy_version 1594622 (0.0008) [2023-12-28 06:43:14,615][106225] Updated weights for policy 1, policy_version 1598273 (0.0008) [2023-12-28 06:43:14,659][106226] Updated weights for policy 0, policy_version 1594632 (0.0006) [2023-12-28 06:43:14,665][106225] Updated weights for policy 1, policy_version 1598283 (0.0006) [2023-12-28 06:43:14,714][106226] Updated weights for policy 0, policy_version 1594642 (0.0006) [2023-12-28 06:43:14,728][106225] Updated weights for policy 1, policy_version 1598293 (0.0006) [2023-12-28 06:43:15,340][106225] Updated weights for policy 1, policy_version 1598303 (0.0008) [2023-12-28 06:43:15,396][106225] Updated weights for policy 1, policy_version 1598313 (0.0008) [2023-12-28 06:43:15,454][106225] Updated weights for policy 1, policy_version 1598323 (0.0008) [2023-12-28 06:43:15,480][106226] Updated weights for policy 0, policy_version 1594652 (0.0007) [2023-12-28 06:43:15,544][106226] Updated weights for policy 0, policy_version 1594662 (0.0008) [2023-12-28 06:43:15,605][106226] Updated weights for policy 0, policy_version 1594672 (0.0008) [2023-12-28 06:43:16,130][106225] Updated weights for policy 1, policy_version 1598333 (0.0006) [2023-12-28 06:43:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 817537024. Throughput: 0: 9848.1, 1: 9897.3. Samples: 817530200. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:16,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.615')] [2023-12-28 06:43:16,187][106225] Updated weights for policy 1, policy_version 1598343 (0.0005) [2023-12-28 06:43:16,248][106225] Updated weights for policy 1, policy_version 1598353 (0.0007) [2023-12-28 06:43:16,274][106226] Updated weights for policy 0, policy_version 1594682 (0.0008) [2023-12-28 06:43:16,330][106226] Updated weights for policy 0, policy_version 1594692 (0.0005) [2023-12-28 06:43:16,383][106226] Updated weights for policy 0, policy_version 1594702 (0.0007) [2023-12-28 06:43:16,450][106226] Updated weights for policy 0, policy_version 1594712 (0.0011) [2023-12-28 06:43:16,952][106225] Updated weights for policy 1, policy_version 1598363 (0.0009) [2023-12-28 06:43:17,007][106225] Updated weights for policy 1, policy_version 1598373 (0.0008) [2023-12-28 06:43:17,071][106225] Updated weights for policy 1, policy_version 1598383 (0.0007) [2023-12-28 06:43:17,153][106226] Updated weights for policy 0, policy_version 1594722 (0.0011) [2023-12-28 06:43:17,212][106226] Updated weights for policy 0, policy_version 1594732 (0.0011) [2023-12-28 06:43:17,280][106226] Updated weights for policy 0, policy_version 1594742 (0.0011) [2023-12-28 06:43:17,742][106225] Updated weights for policy 1, policy_version 1598393 (0.0008) [2023-12-28 06:43:17,795][106225] Updated weights for policy 1, policy_version 1598403 (0.0009) [2023-12-28 06:43:17,842][106225] Updated weights for policy 1, policy_version 1598413 (0.0007) [2023-12-28 06:43:17,894][106225] Updated weights for policy 1, policy_version 1598423 (0.0006) [2023-12-28 06:43:17,977][106226] Updated weights for policy 0, policy_version 1594752 (0.0010) [2023-12-28 06:43:18,043][106226] Updated weights for policy 0, policy_version 1594762 (0.0010) [2023-12-28 06:43:18,110][106226] Updated weights for policy 0, policy_version 1594772 (0.0010) [2023-12-28 06:43:18,595][106225] Updated weights for policy 1, policy_version 1598433 (0.0008) [2023-12-28 06:43:18,652][106225] Updated weights for policy 1, policy_version 1598443 (0.0008) [2023-12-28 06:43:18,707][106225] Updated weights for policy 1, policy_version 1598453 (0.0008) [2023-12-28 06:43:18,782][106226] Updated weights for policy 0, policy_version 1594782 (0.0011) [2023-12-28 06:43:18,836][106226] Updated weights for policy 0, policy_version 1594792 (0.0011) [2023-12-28 06:43:18,890][106226] Updated weights for policy 0, policy_version 1594802 (0.0011) [2023-12-28 06:43:19,419][106225] Updated weights for policy 1, policy_version 1598463 (0.0009) [2023-12-28 06:43:19,484][106225] Updated weights for policy 1, policy_version 1598473 (0.0010) [2023-12-28 06:43:19,548][106225] Updated weights for policy 1, policy_version 1598483 (0.0008) [2023-12-28 06:43:19,633][106226] Updated weights for policy 0, policy_version 1594812 (0.0009) [2023-12-28 06:43:19,688][106226] Updated weights for policy 0, policy_version 1594822 (0.0011) [2023-12-28 06:43:19,746][106226] Updated weights for policy 0, policy_version 1594832 (0.0010) [2023-12-28 06:43:20,302][106225] Updated weights for policy 1, policy_version 1598493 (0.0008) [2023-12-28 06:43:20,357][106225] Updated weights for policy 1, policy_version 1598503 (0.0006) [2023-12-28 06:43:20,417][106225] Updated weights for policy 1, policy_version 1598513 (0.0006) [2023-12-28 06:43:20,537][106226] Updated weights for policy 0, policy_version 1594842 (0.0007) [2023-12-28 06:43:20,605][106226] Updated weights for policy 0, policy_version 1594852 (0.0009) [2023-12-28 06:43:20,667][106226] Updated weights for policy 0, policy_version 1594862 (0.0008) [2023-12-28 06:43:20,732][106226] Updated weights for policy 0, policy_version 1594872 (0.0008) [2023-12-28 06:43:21,138][106225] Updated weights for policy 1, policy_version 1598523 (0.0010) [2023-12-28 06:43:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 817635328. Throughput: 0: 9846.3, 1: 9851.1. Samples: 817648816. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:21,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.544')] [2023-12-28 06:43:21,208][106225] Updated weights for policy 1, policy_version 1598533 (0.0010) [2023-12-28 06:43:21,279][106225] Updated weights for policy 1, policy_version 1598543 (0.0008) [2023-12-28 06:43:21,476][106226] Updated weights for policy 0, policy_version 1594882 (0.0009) [2023-12-28 06:43:21,539][106226] Updated weights for policy 0, policy_version 1594892 (0.0008) [2023-12-28 06:43:21,601][106226] Updated weights for policy 0, policy_version 1594902 (0.0008) [2023-12-28 06:43:21,992][106225] Updated weights for policy 1, policy_version 1598553 (0.0010) [2023-12-28 06:43:22,050][106225] Updated weights for policy 1, policy_version 1598563 (0.0006) [2023-12-28 06:43:22,101][106225] Updated weights for policy 1, policy_version 1598573 (0.0006) [2023-12-28 06:43:22,160][106225] Updated weights for policy 1, policy_version 1598583 (0.0008) [2023-12-28 06:43:22,420][106226] Updated weights for policy 0, policy_version 1594912 (0.0009) [2023-12-28 06:43:22,474][106226] Updated weights for policy 0, policy_version 1594922 (0.0009) [2023-12-28 06:43:22,537][106226] Updated weights for policy 0, policy_version 1594932 (0.0009) [2023-12-28 06:43:22,850][106225] Updated weights for policy 1, policy_version 1598593 (0.0006) [2023-12-28 06:43:22,898][106225] Updated weights for policy 1, policy_version 1598603 (0.0007) [2023-12-28 06:43:22,951][106225] Updated weights for policy 1, policy_version 1598613 (0.0008) [2023-12-28 06:43:23,292][106226] Updated weights for policy 0, policy_version 1594942 (0.0009) [2023-12-28 06:43:23,356][106226] Updated weights for policy 0, policy_version 1594952 (0.0008) [2023-12-28 06:43:23,428][106226] Updated weights for policy 0, policy_version 1594962 (0.0005) [2023-12-28 06:43:23,606][106225] Updated weights for policy 1, policy_version 1598623 (0.0010) [2023-12-28 06:43:23,656][106225] Updated weights for policy 1, policy_version 1598633 (0.0010) [2023-12-28 06:43:23,708][106225] Updated weights for policy 1, policy_version 1598643 (0.0010) [2023-12-28 06:43:23,934][106226] Updated weights for policy 0, policy_version 1594972 (0.0006) [2023-12-28 06:43:23,994][106226] Updated weights for policy 0, policy_version 1594982 (0.0008) [2023-12-28 06:43:24,051][106226] Updated weights for policy 0, policy_version 1594992 (0.0007) [2023-12-28 06:43:24,436][106225] Updated weights for policy 1, policy_version 1598653 (0.0010) [2023-12-28 06:43:24,487][106225] Updated weights for policy 1, policy_version 1598663 (0.0010) [2023-12-28 06:43:24,546][106225] Updated weights for policy 1, policy_version 1598673 (0.0010) [2023-12-28 06:43:24,769][106226] Updated weights for policy 0, policy_version 1595002 (0.0008) [2023-12-28 06:43:24,829][106226] Updated weights for policy 0, policy_version 1595012 (0.0009) [2023-12-28 06:43:24,884][106226] Updated weights for policy 0, policy_version 1595022 (0.0010) [2023-12-28 06:43:24,940][106226] Updated weights for policy 0, policy_version 1595032 (0.0010) [2023-12-28 06:43:25,223][106225] Updated weights for policy 1, policy_version 1598683 (0.0009) [2023-12-28 06:43:25,272][106225] Updated weights for policy 1, policy_version 1598693 (0.0009) [2023-12-28 06:43:25,319][106225] Updated weights for policy 1, policy_version 1598703 (0.0007) [2023-12-28 06:43:25,528][106226] Updated weights for policy 0, policy_version 1595042 (0.0010) [2023-12-28 06:43:25,576][106226] Updated weights for policy 0, policy_version 1595052 (0.0010) [2023-12-28 06:43:25,627][106226] Updated weights for policy 0, policy_version 1595062 (0.0005) [2023-12-28 06:43:25,905][106225] Updated weights for policy 1, policy_version 1598713 (0.0009) [2023-12-28 06:43:25,958][106225] Updated weights for policy 1, policy_version 1598723 (0.0005) [2023-12-28 06:43:26,009][106225] Updated weights for policy 1, policy_version 1598733 (0.0006) [2023-12-28 06:43:26,059][106225] Updated weights for policy 1, policy_version 1598743 (0.0008) [2023-12-28 06:43:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 817741824. Throughput: 0: 9824.0, 1: 9859.7. Samples: 817707416. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:26,176][105115] Avg episode reward: [(0, '-4.917'), (1, '-4.596')] [2023-12-28 06:43:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001598744_409329664.pth... [2023-12-28 06:43:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001595064_408412160.pth... [2023-12-28 06:43:26,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001597592_409034752.pth [2023-12-28 06:43:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001593912_408117248.pth [2023-12-28 06:43:26,269][106226] Updated weights for policy 0, policy_version 1595072 (0.0010) [2023-12-28 06:43:26,326][106226] Updated weights for policy 0, policy_version 1595082 (0.0009) [2023-12-28 06:43:26,380][106226] Updated weights for policy 0, policy_version 1595092 (0.0010) [2023-12-28 06:43:26,709][106225] Updated weights for policy 1, policy_version 1598753 (0.0008) [2023-12-28 06:43:26,772][106225] Updated weights for policy 1, policy_version 1598763 (0.0009) [2023-12-28 06:43:26,836][106225] Updated weights for policy 1, policy_version 1598773 (0.0007) [2023-12-28 06:43:26,964][106226] Updated weights for policy 0, policy_version 1595102 (0.0011) [2023-12-28 06:43:27,015][106226] Updated weights for policy 0, policy_version 1595112 (0.0010) [2023-12-28 06:43:27,064][106226] Updated weights for policy 0, policy_version 1595122 (0.0010) [2023-12-28 06:43:27,478][106225] Updated weights for policy 1, policy_version 1598783 (0.0007) [2023-12-28 06:43:27,531][106225] Updated weights for policy 1, policy_version 1598793 (0.0007) [2023-12-28 06:43:27,580][106225] Updated weights for policy 1, policy_version 1598803 (0.0008) [2023-12-28 06:43:27,726][106226] Updated weights for policy 0, policy_version 1595132 (0.0008) [2023-12-28 06:43:27,785][106226] Updated weights for policy 0, policy_version 1595142 (0.0006) [2023-12-28 06:43:27,840][106226] Updated weights for policy 0, policy_version 1595152 (0.0005) [2023-12-28 06:43:28,387][106225] Updated weights for policy 1, policy_version 1598813 (0.0008) [2023-12-28 06:43:28,440][106225] Updated weights for policy 1, policy_version 1598823 (0.0008) [2023-12-28 06:43:28,482][106226] Updated weights for policy 0, policy_version 1595162 (0.0006) [2023-12-28 06:43:28,525][106225] Updated weights for policy 1, policy_version 1598833 (0.0007) [2023-12-28 06:43:28,539][106226] Updated weights for policy 0, policy_version 1595172 (0.0010) [2023-12-28 06:43:28,599][106226] Updated weights for policy 0, policy_version 1595182 (0.0011) [2023-12-28 06:43:28,659][106226] Updated weights for policy 0, policy_version 1595192 (0.0010) [2023-12-28 06:43:29,283][106226] Updated weights for policy 0, policy_version 1595202 (0.0008) [2023-12-28 06:43:29,285][106225] Updated weights for policy 1, policy_version 1598843 (0.0006) [2023-12-28 06:43:29,344][106225] Updated weights for policy 1, policy_version 1598853 (0.0008) [2023-12-28 06:43:29,352][106226] Updated weights for policy 0, policy_version 1595212 (0.0007) [2023-12-28 06:43:29,406][106225] Updated weights for policy 1, policy_version 1598863 (0.0005) [2023-12-28 06:43:29,418][106226] Updated weights for policy 0, policy_version 1595222 (0.0006) [2023-12-28 06:43:30,003][106225] Updated weights for policy 1, policy_version 1598873 (0.0006) [2023-12-28 06:43:30,040][106226] Updated weights for policy 0, policy_version 1595232 (0.0006) [2023-12-28 06:43:30,056][106225] Updated weights for policy 1, policy_version 1598883 (0.0007) [2023-12-28 06:43:30,106][106225] Updated weights for policy 1, policy_version 1598893 (0.0007) [2023-12-28 06:43:30,107][106226] Updated weights for policy 0, policy_version 1595242 (0.0006) [2023-12-28 06:43:30,157][106225] Updated weights for policy 1, policy_version 1598903 (0.0007) [2023-12-28 06:43:30,176][106226] Updated weights for policy 0, policy_version 1595252 (0.0006) [2023-12-28 06:43:30,786][106225] Updated weights for policy 1, policy_version 1598913 (0.0008) [2023-12-28 06:43:30,813][106226] Updated weights for policy 0, policy_version 1595262 (0.0005) [2023-12-28 06:43:30,834][106225] Updated weights for policy 1, policy_version 1598923 (0.0008) [2023-12-28 06:43:30,863][106226] Updated weights for policy 0, policy_version 1595272 (0.0007) [2023-12-28 06:43:30,882][106225] Updated weights for policy 1, policy_version 1598933 (0.0008) [2023-12-28 06:43:30,912][106226] Updated weights for policy 0, policy_version 1595282 (0.0008) [2023-12-28 06:43:31,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 817848320. Throughput: 0: 10014.6, 1: 9881.1. Samples: 817833604. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:31,175][105115] Avg episode reward: [(0, '-4.788'), (1, '-4.738')] [2023-12-28 06:43:31,610][106226] Updated weights for policy 0, policy_version 1595292 (0.0008) [2023-12-28 06:43:31,673][106225] Updated weights for policy 1, policy_version 1598943 (0.0006) [2023-12-28 06:43:31,679][106226] Updated weights for policy 0, policy_version 1595302 (0.0008) [2023-12-28 06:43:31,737][106225] Updated weights for policy 1, policy_version 1598953 (0.0007) [2023-12-28 06:43:31,743][106226] Updated weights for policy 0, policy_version 1595312 (0.0007) [2023-12-28 06:43:31,800][106225] Updated weights for policy 1, policy_version 1598963 (0.0008) [2023-12-28 06:43:32,406][106226] Updated weights for policy 0, policy_version 1595322 (0.0007) [2023-12-28 06:43:32,476][106226] Updated weights for policy 0, policy_version 1595332 (0.0010) [2023-12-28 06:43:32,503][106225] Updated weights for policy 1, policy_version 1598973 (0.0007) [2023-12-28 06:43:32,534][106226] Updated weights for policy 0, policy_version 1595342 (0.0008) [2023-12-28 06:43:32,557][106225] Updated weights for policy 1, policy_version 1598983 (0.0007) [2023-12-28 06:43:32,591][106226] Updated weights for policy 0, policy_version 1595352 (0.0008) [2023-12-28 06:43:32,614][106225] Updated weights for policy 1, policy_version 1598993 (0.0008) [2023-12-28 06:43:33,203][106225] Updated weights for policy 1, policy_version 1599003 (0.0008) [2023-12-28 06:43:33,252][106225] Updated weights for policy 1, policy_version 1599013 (0.0006) [2023-12-28 06:43:33,306][106225] Updated weights for policy 1, policy_version 1599023 (0.0005) [2023-12-28 06:43:33,368][106226] Updated weights for policy 0, policy_version 1595362 (0.0008) [2023-12-28 06:43:33,415][106226] Updated weights for policy 0, policy_version 1595372 (0.0007) [2023-12-28 06:43:33,468][106226] Updated weights for policy 0, policy_version 1595382 (0.0008) [2023-12-28 06:43:33,863][106225] Updated weights for policy 1, policy_version 1599033 (0.0006) [2023-12-28 06:43:33,923][106225] Updated weights for policy 1, policy_version 1599043 (0.0005) [2023-12-28 06:43:33,982][106225] Updated weights for policy 1, policy_version 1599053 (0.0005) [2023-12-28 06:43:34,041][106225] Updated weights for policy 1, policy_version 1599063 (0.0008) [2023-12-28 06:43:34,269][106226] Updated weights for policy 0, policy_version 1595392 (0.0010) [2023-12-28 06:43:34,323][106226] Updated weights for policy 0, policy_version 1595402 (0.0011) [2023-12-28 06:43:34,382][106226] Updated weights for policy 0, policy_version 1595412 (0.0010) [2023-12-28 06:43:34,630][106225] Updated weights for policy 1, policy_version 1599073 (0.0006) [2023-12-28 06:43:34,693][106225] Updated weights for policy 1, policy_version 1599083 (0.0007) [2023-12-28 06:43:34,752][106225] Updated weights for policy 1, policy_version 1599093 (0.0007) [2023-12-28 06:43:35,134][106226] Updated weights for policy 0, policy_version 1595422 (0.0010) [2023-12-28 06:43:35,200][106226] Updated weights for policy 0, policy_version 1595432 (0.0008) [2023-12-28 06:43:35,261][106226] Updated weights for policy 0, policy_version 1595442 (0.0008) [2023-12-28 06:43:35,353][106225] Updated weights for policy 1, policy_version 1599103 (0.0009) [2023-12-28 06:43:35,413][106225] Updated weights for policy 1, policy_version 1599113 (0.0010) [2023-12-28 06:43:35,464][106225] Updated weights for policy 1, policy_version 1599123 (0.0010) [2023-12-28 06:43:35,942][106226] Updated weights for policy 0, policy_version 1595452 (0.0009) [2023-12-28 06:43:35,989][106226] Updated weights for policy 0, policy_version 1595462 (0.0010) [2023-12-28 06:43:36,050][106226] Updated weights for policy 0, policy_version 1595472 (0.0010) [2023-12-28 06:43:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 817946624. Throughput: 0: 9944.4, 1: 9962.5. Samples: 817955436. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:36,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.690')] [2023-12-28 06:43:36,213][106225] Updated weights for policy 1, policy_version 1599133 (0.0009) [2023-12-28 06:43:36,282][106225] Updated weights for policy 1, policy_version 1599143 (0.0011) [2023-12-28 06:43:36,355][106225] Updated weights for policy 1, policy_version 1599153 (0.0011) [2023-12-28 06:43:36,705][106226] Updated weights for policy 0, policy_version 1595482 (0.0009) [2023-12-28 06:43:36,771][106226] Updated weights for policy 0, policy_version 1595492 (0.0011) [2023-12-28 06:43:36,835][106226] Updated weights for policy 0, policy_version 1595502 (0.0011) [2023-12-28 06:43:36,898][106226] Updated weights for policy 0, policy_version 1595512 (0.0011) [2023-12-28 06:43:37,077][106225] Updated weights for policy 1, policy_version 1599163 (0.0010) [2023-12-28 06:43:37,128][106225] Updated weights for policy 1, policy_version 1599173 (0.0008) [2023-12-28 06:43:37,187][106225] Updated weights for policy 1, policy_version 1599183 (0.0008) [2023-12-28 06:43:37,610][106226] Updated weights for policy 0, policy_version 1595522 (0.0009) [2023-12-28 06:43:37,667][106226] Updated weights for policy 0, policy_version 1595532 (0.0009) [2023-12-28 06:43:37,721][106226] Updated weights for policy 0, policy_version 1595542 (0.0009) [2023-12-28 06:43:37,936][106225] Updated weights for policy 1, policy_version 1599193 (0.0008) [2023-12-28 06:43:37,995][106225] Updated weights for policy 1, policy_version 1599203 (0.0009) [2023-12-28 06:43:38,056][106225] Updated weights for policy 1, policy_version 1599213 (0.0006) [2023-12-28 06:43:38,109][106225] Updated weights for policy 1, policy_version 1599223 (0.0005) [2023-12-28 06:43:38,486][106226] Updated weights for policy 0, policy_version 1595552 (0.0008) [2023-12-28 06:43:38,535][106226] Updated weights for policy 0, policy_version 1595562 (0.0008) [2023-12-28 06:43:38,587][106226] Updated weights for policy 0, policy_version 1595572 (0.0009) [2023-12-28 06:43:38,721][106225] Updated weights for policy 1, policy_version 1599233 (0.0009) [2023-12-28 06:43:38,784][106225] Updated weights for policy 1, policy_version 1599243 (0.0010) [2023-12-28 06:43:38,846][106225] Updated weights for policy 1, policy_version 1599253 (0.0006) [2023-12-28 06:43:39,470][106226] Updated weights for policy 0, policy_version 1595582 (0.0009) [2023-12-28 06:43:39,532][106226] Updated weights for policy 0, policy_version 1595592 (0.0009) [2023-12-28 06:43:39,547][106225] Updated weights for policy 1, policy_version 1599263 (0.0006) [2023-12-28 06:43:39,596][106226] Updated weights for policy 0, policy_version 1595602 (0.0007) [2023-12-28 06:43:39,610][106225] Updated weights for policy 1, policy_version 1599273 (0.0006) [2023-12-28 06:43:39,669][106225] Updated weights for policy 1, policy_version 1599283 (0.0007) [2023-12-28 06:43:40,323][106226] Updated weights for policy 0, policy_version 1595612 (0.0006) [2023-12-28 06:43:40,387][106226] Updated weights for policy 0, policy_version 1595622 (0.0007) [2023-12-28 06:43:40,432][106225] Updated weights for policy 1, policy_version 1599293 (0.0008) [2023-12-28 06:43:40,454][106226] Updated weights for policy 0, policy_version 1595632 (0.0006) [2023-12-28 06:43:40,491][106225] Updated weights for policy 1, policy_version 1599303 (0.0007) [2023-12-28 06:43:40,557][106225] Updated weights for policy 1, policy_version 1599313 (0.0008) [2023-12-28 06:43:41,067][106226] Updated weights for policy 0, policy_version 1595642 (0.0006) [2023-12-28 06:43:41,131][106226] Updated weights for policy 0, policy_version 1595652 (0.0008) [2023-12-28 06:43:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 818036736. Throughput: 0: 9923.4, 1: 9996.4. Samples: 818013052. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:41,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.700')] [2023-12-28 06:43:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001599320_409477120.pth... [2023-12-28 06:43:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001598168_409182208.pth [2023-12-28 06:43:41,201][106226] Updated weights for policy 0, policy_version 1595662 (0.0007) [2023-12-28 06:43:41,261][106225] Updated weights for policy 1, policy_version 1599323 (0.0009) [2023-12-28 06:43:41,283][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001595672_408567808.pth... [2023-12-28 06:43:41,285][106226] Updated weights for policy 0, policy_version 1595672 (0.0007) [2023-12-28 06:43:41,288][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001594488_408264704.pth [2023-12-28 06:43:41,324][106225] Updated weights for policy 1, policy_version 1599333 (0.0007) [2023-12-28 06:43:41,394][106225] Updated weights for policy 1, policy_version 1599343 (0.0009) [2023-12-28 06:43:42,073][106225] Updated weights for policy 1, policy_version 1599353 (0.0008) [2023-12-28 06:43:42,096][106226] Updated weights for policy 0, policy_version 1595682 (0.0008) [2023-12-28 06:43:42,134][106225] Updated weights for policy 1, policy_version 1599363 (0.0006) [2023-12-28 06:43:42,152][106226] Updated weights for policy 0, policy_version 1595692 (0.0007) [2023-12-28 06:43:42,196][106225] Updated weights for policy 1, policy_version 1599373 (0.0006) [2023-12-28 06:43:42,210][106226] Updated weights for policy 0, policy_version 1595702 (0.0007) [2023-12-28 06:43:42,258][106225] Updated weights for policy 1, policy_version 1599383 (0.0008) [2023-12-28 06:43:42,870][106226] Updated weights for policy 0, policy_version 1595712 (0.0007) [2023-12-28 06:43:42,922][106226] Updated weights for policy 0, policy_version 1595722 (0.0009) [2023-12-28 06:43:42,972][106226] Updated weights for policy 0, policy_version 1595732 (0.0007) [2023-12-28 06:43:42,999][106225] Updated weights for policy 1, policy_version 1599393 (0.0008) [2023-12-28 06:43:43,052][106225] Updated weights for policy 1, policy_version 1599403 (0.0009) [2023-12-28 06:43:43,117][106225] Updated weights for policy 1, policy_version 1599413 (0.0008) [2023-12-28 06:43:43,723][106226] Updated weights for policy 0, policy_version 1595742 (0.0007) [2023-12-28 06:43:43,775][106226] Updated weights for policy 0, policy_version 1595752 (0.0009) [2023-12-28 06:43:43,824][106226] Updated weights for policy 0, policy_version 1595762 (0.0008) [2023-12-28 06:43:43,859][106225] Updated weights for policy 1, policy_version 1599423 (0.0007) [2023-12-28 06:43:43,921][106225] Updated weights for policy 1, policy_version 1599433 (0.0007) [2023-12-28 06:43:43,975][106225] Updated weights for policy 1, policy_version 1599443 (0.0008) [2023-12-28 06:43:44,499][106226] Updated weights for policy 0, policy_version 1595772 (0.0007) [2023-12-28 06:43:44,551][106226] Updated weights for policy 0, policy_version 1595782 (0.0005) [2023-12-28 06:43:44,632][106226] Updated weights for policy 0, policy_version 1595792 (0.0005) [2023-12-28 06:43:44,751][106225] Updated weights for policy 1, policy_version 1599453 (0.0008) [2023-12-28 06:43:44,815][106225] Updated weights for policy 1, policy_version 1599463 (0.0008) [2023-12-28 06:43:44,872][106225] Updated weights for policy 1, policy_version 1599473 (0.0009) [2023-12-28 06:43:45,239][106226] Updated weights for policy 0, policy_version 1595802 (0.0006) [2023-12-28 06:43:45,292][106226] Updated weights for policy 0, policy_version 1595812 (0.0009) [2023-12-28 06:43:45,342][106226] Updated weights for policy 0, policy_version 1595822 (0.0008) [2023-12-28 06:43:45,391][106226] Updated weights for policy 0, policy_version 1595832 (0.0009) [2023-12-28 06:43:45,618][106225] Updated weights for policy 1, policy_version 1599483 (0.0009) [2023-12-28 06:43:45,684][106225] Updated weights for policy 1, policy_version 1599493 (0.0010) [2023-12-28 06:43:45,745][106225] Updated weights for policy 1, policy_version 1599503 (0.0008) [2023-12-28 06:43:46,108][106226] Updated weights for policy 0, policy_version 1595842 (0.0008) [2023-12-28 06:43:46,153][106226] Updated weights for policy 0, policy_version 1595852 (0.0009) [2023-12-28 06:43:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 818135040. Throughput: 0: 9917.9, 1: 9993.6. Samples: 818128904. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:46,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.567')] [2023-12-28 06:43:46,200][106226] Updated weights for policy 0, policy_version 1595862 (0.0008) [2023-12-28 06:43:46,472][106225] Updated weights for policy 1, policy_version 1599513 (0.0008) [2023-12-28 06:43:46,533][106225] Updated weights for policy 1, policy_version 1599523 (0.0009) [2023-12-28 06:43:46,595][106225] Updated weights for policy 1, policy_version 1599533 (0.0008) [2023-12-28 06:43:46,661][106225] Updated weights for policy 1, policy_version 1599543 (0.0009) [2023-12-28 06:43:46,880][106226] Updated weights for policy 0, policy_version 1595872 (0.0006) [2023-12-28 06:43:46,934][106226] Updated weights for policy 0, policy_version 1595882 (0.0008) [2023-12-28 06:43:46,986][106226] Updated weights for policy 0, policy_version 1595892 (0.0008) [2023-12-28 06:43:47,393][106225] Updated weights for policy 1, policy_version 1599553 (0.0006) [2023-12-28 06:43:47,450][106225] Updated weights for policy 1, policy_version 1599563 (0.0005) [2023-12-28 06:43:47,501][106225] Updated weights for policy 1, policy_version 1599573 (0.0005) [2023-12-28 06:43:47,740][106226] Updated weights for policy 0, policy_version 1595902 (0.0008) [2023-12-28 06:43:47,799][106226] Updated weights for policy 0, policy_version 1595912 (0.0009) [2023-12-28 06:43:47,850][106226] Updated weights for policy 0, policy_version 1595922 (0.0008) [2023-12-28 06:43:48,101][106225] Updated weights for policy 1, policy_version 1599583 (0.0008) [2023-12-28 06:43:48,160][106225] Updated weights for policy 1, policy_version 1599593 (0.0009) [2023-12-28 06:43:48,220][106225] Updated weights for policy 1, policy_version 1599603 (0.0009) [2023-12-28 06:43:48,578][106226] Updated weights for policy 0, policy_version 1595932 (0.0009) [2023-12-28 06:43:48,641][106226] Updated weights for policy 0, policy_version 1595942 (0.0008) [2023-12-28 06:43:48,708][106226] Updated weights for policy 0, policy_version 1595952 (0.0009) [2023-12-28 06:43:48,980][106225] Updated weights for policy 1, policy_version 1599613 (0.0009) [2023-12-28 06:43:49,040][106225] Updated weights for policy 1, policy_version 1599623 (0.0007) [2023-12-28 06:43:49,098][106225] Updated weights for policy 1, policy_version 1599633 (0.0007) [2023-12-28 06:43:49,472][106226] Updated weights for policy 0, policy_version 1595962 (0.0008) [2023-12-28 06:43:49,532][106226] Updated weights for policy 0, policy_version 1595972 (0.0008) [2023-12-28 06:43:49,587][106226] Updated weights for policy 0, policy_version 1595982 (0.0008) [2023-12-28 06:43:49,644][106226] Updated weights for policy 0, policy_version 1595992 (0.0010) [2023-12-28 06:43:49,767][106225] Updated weights for policy 1, policy_version 1599643 (0.0006) [2023-12-28 06:43:49,852][106225] Updated weights for policy 1, policy_version 1599653 (0.0006) [2023-12-28 06:43:49,912][106225] Updated weights for policy 1, policy_version 1599663 (0.0010) [2023-12-28 06:43:50,424][106226] Updated weights for policy 0, policy_version 1596002 (0.0008) [2023-12-28 06:43:50,487][106226] Updated weights for policy 0, policy_version 1596012 (0.0008) [2023-12-28 06:43:50,535][106226] Updated weights for policy 0, policy_version 1596022 (0.0008) [2023-12-28 06:43:50,609][106225] Updated weights for policy 1, policy_version 1599673 (0.0011) [2023-12-28 06:43:50,675][106225] Updated weights for policy 1, policy_version 1599683 (0.0009) [2023-12-28 06:43:50,726][106225] Updated weights for policy 1, policy_version 1599693 (0.0008) [2023-12-28 06:43:50,777][106225] Updated weights for policy 1, policy_version 1599703 (0.0008) [2023-12-28 06:43:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 818233344. Throughput: 0: 9837.0, 1: 9941.3. Samples: 818244736. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:51,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.840')] [2023-12-28 06:43:51,260][106226] Updated weights for policy 0, policy_version 1596032 (0.0008) [2023-12-28 06:43:51,315][106226] Updated weights for policy 0, policy_version 1596042 (0.0008) [2023-12-28 06:43:51,380][106226] Updated weights for policy 0, policy_version 1596052 (0.0009) [2023-12-28 06:43:51,547][106225] Updated weights for policy 1, policy_version 1599713 (0.0010) [2023-12-28 06:43:51,604][106225] Updated weights for policy 1, policy_version 1599723 (0.0010) [2023-12-28 06:43:51,683][106225] Updated weights for policy 1, policy_version 1599733 (0.0007) [2023-12-28 06:43:52,101][106226] Updated weights for policy 0, policy_version 1596062 (0.0009) [2023-12-28 06:43:52,162][106226] Updated weights for policy 0, policy_version 1596072 (0.0008) [2023-12-28 06:43:52,223][106226] Updated weights for policy 0, policy_version 1596082 (0.0009) [2023-12-28 06:43:52,454][106225] Updated weights for policy 1, policy_version 1599743 (0.0008) [2023-12-28 06:43:52,519][106225] Updated weights for policy 1, policy_version 1599753 (0.0009) [2023-12-28 06:43:52,584][106225] Updated weights for policy 1, policy_version 1599763 (0.0008) [2023-12-28 06:43:52,989][106226] Updated weights for policy 0, policy_version 1596092 (0.0009) [2023-12-28 06:43:53,046][106226] Updated weights for policy 0, policy_version 1596102 (0.0006) [2023-12-28 06:43:53,105][106226] Updated weights for policy 0, policy_version 1596112 (0.0005) [2023-12-28 06:43:53,281][106225] Updated weights for policy 1, policy_version 1599773 (0.0007) [2023-12-28 06:43:53,333][106225] Updated weights for policy 1, policy_version 1599783 (0.0008) [2023-12-28 06:43:53,390][106225] Updated weights for policy 1, policy_version 1599793 (0.0007) [2023-12-28 06:43:53,838][106226] Updated weights for policy 0, policy_version 1596122 (0.0008) [2023-12-28 06:43:53,885][106226] Updated weights for policy 0, policy_version 1596132 (0.0008) [2023-12-28 06:43:53,935][106226] Updated weights for policy 0, policy_version 1596142 (0.0009) [2023-12-28 06:43:53,978][106225] Updated weights for policy 1, policy_version 1599803 (0.0007) [2023-12-28 06:43:53,984][106226] Updated weights for policy 0, policy_version 1596152 (0.0007) [2023-12-28 06:43:54,038][106225] Updated weights for policy 1, policy_version 1599813 (0.0009) [2023-12-28 06:43:54,102][106225] Updated weights for policy 1, policy_version 1599823 (0.0006) [2023-12-28 06:43:54,674][106225] Updated weights for policy 1, policy_version 1599833 (0.0009) [2023-12-28 06:43:54,732][106225] Updated weights for policy 1, policy_version 1599843 (0.0008) [2023-12-28 06:43:54,782][106225] Updated weights for policy 1, policy_version 1599853 (0.0008) [2023-12-28 06:43:54,821][106226] Updated weights for policy 0, policy_version 1596162 (0.0008) [2023-12-28 06:43:54,838][106225] Updated weights for policy 1, policy_version 1599863 (0.0005) [2023-12-28 06:43:54,877][106226] Updated weights for policy 0, policy_version 1596172 (0.0009) [2023-12-28 06:43:54,937][106226] Updated weights for policy 0, policy_version 1596182 (0.0007) [2023-12-28 06:43:55,437][106225] Updated weights for policy 1, policy_version 1599873 (0.0008) [2023-12-28 06:43:55,501][106225] Updated weights for policy 1, policy_version 1599883 (0.0008) [2023-12-28 06:43:55,552][106225] Updated weights for policy 1, policy_version 1599893 (0.0008) [2023-12-28 06:43:55,704][106226] Updated weights for policy 0, policy_version 1596192 (0.0010) [2023-12-28 06:43:55,764][106226] Updated weights for policy 0, policy_version 1596202 (0.0011) [2023-12-28 06:43:55,820][106226] Updated weights for policy 0, policy_version 1596212 (0.0008) [2023-12-28 06:43:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 818331648. Throughput: 0: 9787.5, 1: 9917.1. Samples: 818301036. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:43:56,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.728')] [2023-12-28 06:43:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001599896_409624576.pth... [2023-12-28 06:43:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001596216_408707072.pth... [2023-12-28 06:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001595064_408412160.pth [2023-12-28 06:43:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001598744_409329664.pth [2023-12-28 06:43:56,267][106225] Updated weights for policy 1, policy_version 1599903 (0.0010) [2023-12-28 06:43:56,330][106225] Updated weights for policy 1, policy_version 1599913 (0.0009) [2023-12-28 06:43:56,393][106225] Updated weights for policy 1, policy_version 1599923 (0.0006) [2023-12-28 06:43:56,461][106226] Updated weights for policy 0, policy_version 1596222 (0.0009) [2023-12-28 06:43:56,526][106226] Updated weights for policy 0, policy_version 1596232 (0.0009) [2023-12-28 06:43:56,588][106226] Updated weights for policy 0, policy_version 1596242 (0.0009) [2023-12-28 06:43:56,995][106225] Updated weights for policy 1, policy_version 1599933 (0.0007) [2023-12-28 06:43:57,045][106225] Updated weights for policy 1, policy_version 1599943 (0.0009) [2023-12-28 06:43:57,093][106225] Updated weights for policy 1, policy_version 1599953 (0.0005) [2023-12-28 06:43:57,177][106226] Updated weights for policy 0, policy_version 1596252 (0.0007) [2023-12-28 06:43:57,235][106226] Updated weights for policy 0, policy_version 1596262 (0.0005) [2023-12-28 06:43:57,290][106226] Updated weights for policy 0, policy_version 1596272 (0.0006) [2023-12-28 06:43:57,802][106225] Updated weights for policy 1, policy_version 1599963 (0.0008) [2023-12-28 06:43:57,846][106226] Updated weights for policy 0, policy_version 1596282 (0.0006) [2023-12-28 06:43:57,863][106225] Updated weights for policy 1, policy_version 1599973 (0.0009) [2023-12-28 06:43:57,913][106226] Updated weights for policy 0, policy_version 1596292 (0.0006) [2023-12-28 06:43:57,925][106225] Updated weights for policy 1, policy_version 1599983 (0.0008) [2023-12-28 06:43:57,975][106226] Updated weights for policy 0, policy_version 1596302 (0.0008) [2023-12-28 06:43:58,021][106226] Updated weights for policy 0, policy_version 1596312 (0.0008) [2023-12-28 06:43:58,716][106225] Updated weights for policy 1, policy_version 1599993 (0.0006) [2023-12-28 06:43:58,786][106225] Updated weights for policy 1, policy_version 1600003 (0.0010) [2023-12-28 06:43:58,848][106226] Updated weights for policy 0, policy_version 1596322 (0.0008) [2023-12-28 06:43:58,850][106225] Updated weights for policy 1, policy_version 1600013 (0.0007) [2023-12-28 06:43:58,917][106225] Updated weights for policy 1, policy_version 1600023 (0.0008) [2023-12-28 06:43:58,920][106226] Updated weights for policy 0, policy_version 1596332 (0.0008) [2023-12-28 06:43:58,980][106226] Updated weights for policy 0, policy_version 1596342 (0.0007) [2023-12-28 06:43:59,747][106225] Updated weights for policy 1, policy_version 1600033 (0.0006) [2023-12-28 06:43:59,748][106226] Updated weights for policy 0, policy_version 1596352 (0.0007) [2023-12-28 06:43:59,799][106225] Updated weights for policy 1, policy_version 1600043 (0.0005) [2023-12-28 06:43:59,801][106226] Updated weights for policy 0, policy_version 1596362 (0.0008) [2023-12-28 06:43:59,861][106225] Updated weights for policy 1, policy_version 1600053 (0.0007) [2023-12-28 06:43:59,863][106226] Updated weights for policy 0, policy_version 1596372 (0.0009) [2023-12-28 06:44:00,456][106225] Updated weights for policy 1, policy_version 1600063 (0.0007) [2023-12-28 06:44:00,504][106225] Updated weights for policy 1, policy_version 1600073 (0.0008) [2023-12-28 06:44:00,551][106225] Updated weights for policy 1, policy_version 1600083 (0.0008) [2023-12-28 06:44:00,687][106226] Updated weights for policy 0, policy_version 1596382 (0.0007) [2023-12-28 06:44:00,745][106226] Updated weights for policy 0, policy_version 1596392 (0.0008) [2023-12-28 06:44:00,796][106226] Updated weights for policy 0, policy_version 1596402 (0.0008) [2023-12-28 06:44:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 818429952. Throughput: 0: 9785.3, 1: 10003.6. Samples: 818420696. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-28 06:44:01,175][105115] Avg episode reward: [(0, '-4.692'), (1, '-4.581')] [2023-12-28 06:44:01,295][106225] Updated weights for policy 1, policy_version 1600093 (0.0009) [2023-12-28 06:44:01,361][106225] Updated weights for policy 1, policy_version 1600103 (0.0008) [2023-12-28 06:44:01,423][106225] Updated weights for policy 1, policy_version 1600113 (0.0008) [2023-12-28 06:44:01,563][106226] Updated weights for policy 0, policy_version 1596412 (0.0008) [2023-12-28 06:44:01,617][106226] Updated weights for policy 0, policy_version 1596422 (0.0008) [2023-12-28 06:44:01,683][106226] Updated weights for policy 0, policy_version 1596432 (0.0008) [2023-12-28 06:44:02,100][106225] Updated weights for policy 1, policy_version 1600123 (0.0007) [2023-12-28 06:44:02,163][106225] Updated weights for policy 1, policy_version 1600133 (0.0008) [2023-12-28 06:44:02,231][106225] Updated weights for policy 1, policy_version 1600143 (0.0011) [2023-12-28 06:44:02,358][106226] Updated weights for policy 0, policy_version 1596442 (0.0009) [2023-12-28 06:44:02,421][106226] Updated weights for policy 0, policy_version 1596452 (0.0008) [2023-12-28 06:44:02,489][106226] Updated weights for policy 0, policy_version 1596462 (0.0008) [2023-12-28 06:44:02,539][106226] Updated weights for policy 0, policy_version 1596472 (0.0007) [2023-12-28 06:44:02,827][106225] Updated weights for policy 1, policy_version 1600153 (0.0007) [2023-12-28 06:44:02,885][106225] Updated weights for policy 1, policy_version 1600163 (0.0005) [2023-12-28 06:44:02,948][106225] Updated weights for policy 1, policy_version 1600173 (0.0005) [2023-12-28 06:44:03,004][106225] Updated weights for policy 1, policy_version 1600183 (0.0005) [2023-12-28 06:44:03,265][106226] Updated weights for policy 0, policy_version 1596482 (0.0007) [2023-12-28 06:44:03,326][106226] Updated weights for policy 0, policy_version 1596492 (0.0007) [2023-12-28 06:44:03,384][106226] Updated weights for policy 0, policy_version 1596502 (0.0005) [2023-12-28 06:44:03,618][106225] Updated weights for policy 1, policy_version 1600193 (0.0009) [2023-12-28 06:44:03,676][106225] Updated weights for policy 1, policy_version 1600203 (0.0010) [2023-12-28 06:44:03,732][106225] Updated weights for policy 1, policy_version 1600213 (0.0010) [2023-12-28 06:44:03,992][106226] Updated weights for policy 0, policy_version 1596512 (0.0008) [2023-12-28 06:44:04,051][106226] Updated weights for policy 0, policy_version 1596522 (0.0008) [2023-12-28 06:44:04,106][106226] Updated weights for policy 0, policy_version 1596532 (0.0008) [2023-12-28 06:44:04,386][106225] Updated weights for policy 1, policy_version 1600223 (0.0009) [2023-12-28 06:44:04,447][106225] Updated weights for policy 1, policy_version 1600233 (0.0008) [2023-12-28 06:44:04,508][106225] Updated weights for policy 1, policy_version 1600243 (0.0008) [2023-12-28 06:44:04,737][106226] Updated weights for policy 0, policy_version 1596542 (0.0007) [2023-12-28 06:44:04,795][106226] Updated weights for policy 0, policy_version 1596552 (0.0008) [2023-12-28 06:44:04,856][106226] Updated weights for policy 0, policy_version 1596562 (0.0009) [2023-12-28 06:44:05,090][106225] Updated weights for policy 1, policy_version 1600253 (0.0009) [2023-12-28 06:44:05,160][106225] Updated weights for policy 1, policy_version 1600263 (0.0010) [2023-12-28 06:44:05,226][106225] Updated weights for policy 1, policy_version 1600273 (0.0010) [2023-12-28 06:44:05,497][106226] Updated weights for policy 0, policy_version 1596572 (0.0009) [2023-12-28 06:44:05,568][106226] Updated weights for policy 0, policy_version 1596582 (0.0008) [2023-12-28 06:44:05,636][106226] Updated weights for policy 0, policy_version 1596592 (0.0008) [2023-12-28 06:44:05,858][106225] Updated weights for policy 1, policy_version 1600283 (0.0009) [2023-12-28 06:44:05,910][106225] Updated weights for policy 1, policy_version 1600293 (0.0009) [2023-12-28 06:44:05,957][106225] Updated weights for policy 1, policy_version 1600303 (0.0010) [2023-12-28 06:44:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 818536448. Throughput: 0: 9846.0, 1: 10084.4. Samples: 818545680. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:06,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.660')] [2023-12-28 06:44:06,302][106226] Updated weights for policy 0, policy_version 1596602 (0.0010) [2023-12-28 06:44:06,366][106226] Updated weights for policy 0, policy_version 1596612 (0.0011) [2023-12-28 06:44:06,430][106226] Updated weights for policy 0, policy_version 1596622 (0.0010) [2023-12-28 06:44:06,489][106226] Updated weights for policy 0, policy_version 1596632 (0.0011) [2023-12-28 06:44:06,704][106225] Updated weights for policy 1, policy_version 1600313 (0.0010) [2023-12-28 06:44:06,767][106225] Updated weights for policy 1, policy_version 1600323 (0.0010) [2023-12-28 06:44:06,837][106225] Updated weights for policy 1, policy_version 1600333 (0.0011) [2023-12-28 06:44:06,897][106225] Updated weights for policy 1, policy_version 1600343 (0.0007) [2023-12-28 06:44:07,164][106226] Updated weights for policy 0, policy_version 1596642 (0.0008) [2023-12-28 06:44:07,231][106226] Updated weights for policy 0, policy_version 1596652 (0.0010) [2023-12-28 06:44:07,293][106226] Updated weights for policy 0, policy_version 1596662 (0.0006) [2023-12-28 06:44:07,630][106225] Updated weights for policy 1, policy_version 1600353 (0.0008) [2023-12-28 06:44:07,688][106225] Updated weights for policy 1, policy_version 1600363 (0.0009) [2023-12-28 06:44:07,737][106225] Updated weights for policy 1, policy_version 1600373 (0.0008) [2023-12-28 06:44:07,932][106226] Updated weights for policy 0, policy_version 1596672 (0.0009) [2023-12-28 06:44:07,986][106226] Updated weights for policy 0, policy_version 1596682 (0.0011) [2023-12-28 06:44:08,041][106226] Updated weights for policy 0, policy_version 1596692 (0.0010) [2023-12-28 06:44:08,445][106225] Updated weights for policy 1, policy_version 1600383 (0.0008) [2023-12-28 06:44:08,509][106225] Updated weights for policy 1, policy_version 1600393 (0.0008) [2023-12-28 06:44:08,565][106225] Updated weights for policy 1, policy_version 1600403 (0.0008) [2023-12-28 06:44:08,766][106226] Updated weights for policy 0, policy_version 1596702 (0.0009) [2023-12-28 06:44:08,833][106226] Updated weights for policy 0, policy_version 1596712 (0.0010) [2023-12-28 06:44:08,898][106226] Updated weights for policy 0, policy_version 1596722 (0.0009) [2023-12-28 06:44:09,196][106225] Updated weights for policy 1, policy_version 1600413 (0.0007) [2023-12-28 06:44:09,280][106225] Updated weights for policy 1, policy_version 1600423 (0.0008) [2023-12-28 06:44:09,339][106225] Updated weights for policy 1, policy_version 1600433 (0.0007) [2023-12-28 06:44:09,655][106226] Updated weights for policy 0, policy_version 1596732 (0.0007) [2023-12-28 06:44:09,723][106226] Updated weights for policy 0, policy_version 1596742 (0.0007) [2023-12-28 06:44:09,786][106226] Updated weights for policy 0, policy_version 1596752 (0.0006) [2023-12-28 06:44:10,054][106225] Updated weights for policy 1, policy_version 1600443 (0.0008) [2023-12-28 06:44:10,114][106225] Updated weights for policy 1, policy_version 1600453 (0.0008) [2023-12-28 06:44:10,170][106225] Updated weights for policy 1, policy_version 1600463 (0.0008) [2023-12-28 06:44:10,491][106226] Updated weights for policy 0, policy_version 1596762 (0.0007) [2023-12-28 06:44:10,555][106226] Updated weights for policy 0, policy_version 1596772 (0.0009) [2023-12-28 06:44:10,615][106226] Updated weights for policy 0, policy_version 1596782 (0.0008) [2023-12-28 06:44:10,683][106226] Updated weights for policy 0, policy_version 1596792 (0.0005) [2023-12-28 06:44:10,828][106225] Updated weights for policy 1, policy_version 1600473 (0.0008) [2023-12-28 06:44:10,896][106225] Updated weights for policy 1, policy_version 1600483 (0.0005) [2023-12-28 06:44:10,948][106225] Updated weights for policy 1, policy_version 1600493 (0.0005) [2023-12-28 06:44:10,996][106225] Updated weights for policy 1, policy_version 1600503 (0.0005) [2023-12-28 06:44:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 818634752. Throughput: 0: 9855.2, 1: 10056.4. Samples: 818603436. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:11,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.756')] [2023-12-28 06:44:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001600504_409780224.pth... [2023-12-28 06:44:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001596792_408854528.pth... [2023-12-28 06:44:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001599320_409477120.pth [2023-12-28 06:44:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001595672_408567808.pth [2023-12-28 06:44:11,448][106226] Updated weights for policy 0, policy_version 1596802 (0.0008) [2023-12-28 06:44:11,514][106226] Updated weights for policy 0, policy_version 1596812 (0.0008) [2023-12-28 06:44:11,572][106226] Updated weights for policy 0, policy_version 1596822 (0.0009) [2023-12-28 06:44:11,663][106225] Updated weights for policy 1, policy_version 1600513 (0.0008) [2023-12-28 06:44:11,722][106225] Updated weights for policy 1, policy_version 1600523 (0.0007) [2023-12-28 06:44:11,789][106225] Updated weights for policy 1, policy_version 1600533 (0.0008) [2023-12-28 06:44:12,291][106226] Updated weights for policy 0, policy_version 1596832 (0.0009) [2023-12-28 06:44:12,357][106226] Updated weights for policy 0, policy_version 1596842 (0.0008) [2023-12-28 06:44:12,426][106226] Updated weights for policy 0, policy_version 1596852 (0.0009) [2023-12-28 06:44:12,507][106225] Updated weights for policy 1, policy_version 1600543 (0.0006) [2023-12-28 06:44:12,560][106225] Updated weights for policy 1, policy_version 1600553 (0.0008) [2023-12-28 06:44:12,620][106225] Updated weights for policy 1, policy_version 1600563 (0.0008) [2023-12-28 06:44:13,047][106226] Updated weights for policy 0, policy_version 1596862 (0.0010) [2023-12-28 06:44:13,108][106226] Updated weights for policy 0, policy_version 1596872 (0.0008) [2023-12-28 06:44:13,172][106226] Updated weights for policy 0, policy_version 1596882 (0.0008) [2023-12-28 06:44:13,379][106225] Updated weights for policy 1, policy_version 1600573 (0.0008) [2023-12-28 06:44:13,438][106225] Updated weights for policy 1, policy_version 1600583 (0.0009) [2023-12-28 06:44:13,503][106225] Updated weights for policy 1, policy_version 1600593 (0.0007) [2023-12-28 06:44:13,834][106226] Updated weights for policy 0, policy_version 1596892 (0.0009) [2023-12-28 06:44:13,904][106226] Updated weights for policy 0, policy_version 1596902 (0.0009) [2023-12-28 06:44:13,968][106226] Updated weights for policy 0, policy_version 1596912 (0.0008) [2023-12-28 06:44:14,217][106225] Updated weights for policy 1, policy_version 1600603 (0.0009) [2023-12-28 06:44:14,262][106225] Updated weights for policy 1, policy_version 1600613 (0.0008) [2023-12-28 06:44:14,311][106225] Updated weights for policy 1, policy_version 1600623 (0.0009) [2023-12-28 06:44:14,704][106226] Updated weights for policy 0, policy_version 1596922 (0.0009) [2023-12-28 06:44:14,766][106226] Updated weights for policy 0, policy_version 1596932 (0.0008) [2023-12-28 06:44:14,833][106226] Updated weights for policy 0, policy_version 1596942 (0.0008) [2023-12-28 06:44:14,906][106226] Updated weights for policy 0, policy_version 1596952 (0.0011) [2023-12-28 06:44:15,052][106225] Updated weights for policy 1, policy_version 1600633 (0.0008) [2023-12-28 06:44:15,115][106225] Updated weights for policy 1, policy_version 1600643 (0.0007) [2023-12-28 06:44:15,175][106225] Updated weights for policy 1, policy_version 1600653 (0.0008) [2023-12-28 06:44:15,228][106225] Updated weights for policy 1, policy_version 1600663 (0.0009) [2023-12-28 06:44:15,648][106226] Updated weights for policy 0, policy_version 1596962 (0.0008) [2023-12-28 06:44:15,712][106226] Updated weights for policy 0, policy_version 1596972 (0.0008) [2023-12-28 06:44:15,785][106226] Updated weights for policy 0, policy_version 1596982 (0.0008) [2023-12-28 06:44:15,924][106225] Updated weights for policy 1, policy_version 1600673 (0.0006) [2023-12-28 06:44:15,986][106225] Updated weights for policy 1, policy_version 1600683 (0.0005) [2023-12-28 06:44:16,054][106225] Updated weights for policy 1, policy_version 1600693 (0.0007) [2023-12-28 06:44:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 818733056. Throughput: 0: 9682.4, 1: 10001.9. Samples: 818719400. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:16,175][105115] Avg episode reward: [(0, '-4.657'), (1, '-4.691')] [2023-12-28 06:44:16,489][106226] Updated weights for policy 0, policy_version 1596992 (0.0010) [2023-12-28 06:44:16,543][106226] Updated weights for policy 0, policy_version 1597002 (0.0010) [2023-12-28 06:44:16,606][106226] Updated weights for policy 0, policy_version 1597012 (0.0011) [2023-12-28 06:44:16,638][106225] Updated weights for policy 1, policy_version 1600703 (0.0006) [2023-12-28 06:44:16,699][106225] Updated weights for policy 1, policy_version 1600713 (0.0005) [2023-12-28 06:44:16,763][106225] Updated weights for policy 1, policy_version 1600723 (0.0005) [2023-12-28 06:44:17,239][106226] Updated weights for policy 0, policy_version 1597022 (0.0010) [2023-12-28 06:44:17,304][106226] Updated weights for policy 0, policy_version 1597032 (0.0010) [2023-12-28 06:44:17,363][106225] Updated weights for policy 1, policy_version 1600733 (0.0005) [2023-12-28 06:44:17,374][106226] Updated weights for policy 0, policy_version 1597042 (0.0011) [2023-12-28 06:44:17,413][106225] Updated weights for policy 1, policy_version 1600743 (0.0006) [2023-12-28 06:44:17,462][106225] Updated weights for policy 1, policy_version 1600753 (0.0006) [2023-12-28 06:44:18,062][106226] Updated weights for policy 0, policy_version 1597052 (0.0008) [2023-12-28 06:44:18,091][106225] Updated weights for policy 1, policy_version 1600763 (0.0007) [2023-12-28 06:44:18,121][106226] Updated weights for policy 0, policy_version 1597062 (0.0006) [2023-12-28 06:44:18,148][106225] Updated weights for policy 1, policy_version 1600773 (0.0008) [2023-12-28 06:44:18,178][106226] Updated weights for policy 0, policy_version 1597072 (0.0008) [2023-12-28 06:44:18,203][106225] Updated weights for policy 1, policy_version 1600783 (0.0005) [2023-12-28 06:44:18,861][106225] Updated weights for policy 1, policy_version 1600793 (0.0006) [2023-12-28 06:44:18,877][106226] Updated weights for policy 0, policy_version 1597082 (0.0011) [2023-12-28 06:44:18,914][106225] Updated weights for policy 1, policy_version 1600803 (0.0006) [2023-12-28 06:44:18,931][106226] Updated weights for policy 0, policy_version 1597092 (0.0011) [2023-12-28 06:44:18,968][106225] Updated weights for policy 1, policy_version 1600813 (0.0006) [2023-12-28 06:44:18,992][106226] Updated weights for policy 0, policy_version 1597102 (0.0011) [2023-12-28 06:44:19,015][106225] Updated weights for policy 1, policy_version 1600823 (0.0007) [2023-12-28 06:44:19,053][106226] Updated weights for policy 0, policy_version 1597112 (0.0011) [2023-12-28 06:44:19,803][106225] Updated weights for policy 1, policy_version 1600833 (0.0006) [2023-12-28 06:44:19,812][106226] Updated weights for policy 0, policy_version 1597122 (0.0007) [2023-12-28 06:44:19,873][106225] Updated weights for policy 1, policy_version 1600843 (0.0008) [2023-12-28 06:44:19,881][106226] Updated weights for policy 0, policy_version 1597132 (0.0008) [2023-12-28 06:44:19,941][106225] Updated weights for policy 1, policy_version 1600853 (0.0008) [2023-12-28 06:44:19,948][106226] Updated weights for policy 0, policy_version 1597142 (0.0008) [2023-12-28 06:44:20,698][106225] Updated weights for policy 1, policy_version 1600863 (0.0010) [2023-12-28 06:44:20,728][106226] Updated weights for policy 0, policy_version 1597152 (0.0006) [2023-12-28 06:44:20,765][106225] Updated weights for policy 1, policy_version 1600873 (0.0010) [2023-12-28 06:44:20,789][106226] Updated weights for policy 0, policy_version 1597162 (0.0008) [2023-12-28 06:44:20,829][106225] Updated weights for policy 1, policy_version 1600883 (0.0011) [2023-12-28 06:44:20,846][106226] Updated weights for policy 0, policy_version 1597172 (0.0008) [2023-12-28 06:44:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 818831360. Throughput: 0: 9696.1, 1: 9946.2. Samples: 818839340. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:21,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.550')] [2023-12-28 06:44:21,617][106226] Updated weights for policy 0, policy_version 1597182 (0.0008) [2023-12-28 06:44:21,629][106225] Updated weights for policy 1, policy_version 1600893 (0.0009) [2023-12-28 06:44:21,680][106226] Updated weights for policy 0, policy_version 1597192 (0.0009) [2023-12-28 06:44:21,696][106225] Updated weights for policy 1, policy_version 1600903 (0.0008) [2023-12-28 06:44:21,752][106226] Updated weights for policy 0, policy_version 1597202 (0.0007) [2023-12-28 06:44:21,761][106225] Updated weights for policy 1, policy_version 1600913 (0.0008) [2023-12-28 06:44:22,475][106226] Updated weights for policy 0, policy_version 1597212 (0.0006) [2023-12-28 06:44:22,524][106225] Updated weights for policy 1, policy_version 1600923 (0.0009) [2023-12-28 06:44:22,543][106226] Updated weights for policy 0, policy_version 1597222 (0.0006) [2023-12-28 06:44:22,591][106225] Updated weights for policy 1, policy_version 1600933 (0.0009) [2023-12-28 06:44:22,606][106226] Updated weights for policy 0, policy_version 1597232 (0.0009) [2023-12-28 06:44:22,643][106225] Updated weights for policy 1, policy_version 1600943 (0.0010) [2023-12-28 06:44:23,297][106226] Updated weights for policy 0, policy_version 1597242 (0.0008) [2023-12-28 06:44:23,328][106225] Updated weights for policy 1, policy_version 1600953 (0.0011) [2023-12-28 06:44:23,354][106226] Updated weights for policy 0, policy_version 1597252 (0.0007) [2023-12-28 06:44:23,385][106225] Updated weights for policy 1, policy_version 1600963 (0.0010) [2023-12-28 06:44:23,413][106226] Updated weights for policy 0, policy_version 1597262 (0.0005) [2023-12-28 06:44:23,440][106225] Updated weights for policy 1, policy_version 1600973 (0.0010) [2023-12-28 06:44:23,471][106226] Updated weights for policy 0, policy_version 1597272 (0.0005) [2023-12-28 06:44:23,502][106225] Updated weights for policy 1, policy_version 1600983 (0.0011) [2023-12-28 06:44:24,103][106226] Updated weights for policy 0, policy_version 1597282 (0.0008) [2023-12-28 06:44:24,143][106225] Updated weights for policy 1, policy_version 1600993 (0.0006) [2023-12-28 06:44:24,160][106226] Updated weights for policy 0, policy_version 1597292 (0.0009) [2023-12-28 06:44:24,200][106225] Updated weights for policy 1, policy_version 1601003 (0.0005) [2023-12-28 06:44:24,217][106226] Updated weights for policy 0, policy_version 1597302 (0.0008) [2023-12-28 06:44:24,261][106225] Updated weights for policy 1, policy_version 1601013 (0.0009) [2023-12-28 06:44:24,878][106226] Updated weights for policy 0, policy_version 1597312 (0.0008) [2023-12-28 06:44:24,941][106226] Updated weights for policy 0, policy_version 1597322 (0.0007) [2023-12-28 06:44:24,942][106225] Updated weights for policy 1, policy_version 1601023 (0.0009) [2023-12-28 06:44:24,997][106226] Updated weights for policy 0, policy_version 1597332 (0.0006) [2023-12-28 06:44:25,003][106225] Updated weights for policy 1, policy_version 1601034 (0.0008) [2023-12-28 06:44:25,060][106225] Updated weights for policy 1, policy_version 1601044 (0.0007) [2023-12-28 06:44:25,650][106226] Updated weights for policy 0, policy_version 1597342 (0.0008) [2023-12-28 06:44:25,712][106226] Updated weights for policy 0, policy_version 1597352 (0.0008) [2023-12-28 06:44:25,763][106225] Updated weights for policy 1, policy_version 1601054 (0.0007) [2023-12-28 06:44:25,781][106226] Updated weights for policy 0, policy_version 1597362 (0.0005) [2023-12-28 06:44:25,823][106225] Updated weights for policy 1, policy_version 1601064 (0.0006) [2023-12-28 06:44:25,882][106225] Updated weights for policy 1, policy_version 1601074 (0.0005) [2023-12-28 06:44:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 818929664. Throughput: 0: 9724.9, 1: 9909.1. Samples: 818896580. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:26,175][105115] Avg episode reward: [(0, '-4.727'), (1, '-4.514')] [2023-12-28 06:44:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001597368_409001984.pth... [2023-12-28 06:44:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001601080_409927680.pth... [2023-12-28 06:44:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001596216_408707072.pth [2023-12-28 06:44:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001599896_409624576.pth [2023-12-28 06:44:26,430][106225] Updated weights for policy 1, policy_version 1601084 (0.0006) [2023-12-28 06:44:26,449][106226] Updated weights for policy 0, policy_version 1597372 (0.0005) [2023-12-28 06:44:26,485][106225] Updated weights for policy 1, policy_version 1601094 (0.0007) [2023-12-28 06:44:26,499][106226] Updated weights for policy 0, policy_version 1597382 (0.0005) [2023-12-28 06:44:26,537][106225] Updated weights for policy 1, policy_version 1601104 (0.0008) [2023-12-28 06:44:26,551][106226] Updated weights for policy 0, policy_version 1597392 (0.0005) [2023-12-28 06:44:27,216][106226] Updated weights for policy 0, policy_version 1597402 (0.0006) [2023-12-28 06:44:27,221][106225] Updated weights for policy 1, policy_version 1601114 (0.0007) [2023-12-28 06:44:27,267][106226] Updated weights for policy 0, policy_version 1597412 (0.0005) [2023-12-28 06:44:27,277][106225] Updated weights for policy 1, policy_version 1601124 (0.0008) [2023-12-28 06:44:27,321][106226] Updated weights for policy 0, policy_version 1597422 (0.0006) [2023-12-28 06:44:27,333][106225] Updated weights for policy 1, policy_version 1601134 (0.0007) [2023-12-28 06:44:27,373][106226] Updated weights for policy 0, policy_version 1597432 (0.0005) [2023-12-28 06:44:27,393][106225] Updated weights for policy 1, policy_version 1601144 (0.0005) [2023-12-28 06:44:28,020][106225] Updated weights for policy 1, policy_version 1601154 (0.0008) [2023-12-28 06:44:28,037][106226] Updated weights for policy 0, policy_version 1597442 (0.0010) [2023-12-28 06:44:28,072][106225] Updated weights for policy 1, policy_version 1601164 (0.0005) [2023-12-28 06:44:28,093][106226] Updated weights for policy 0, policy_version 1597452 (0.0010) [2023-12-28 06:44:28,129][106225] Updated weights for policy 1, policy_version 1601174 (0.0005) [2023-12-28 06:44:28,153][106226] Updated weights for policy 0, policy_version 1597462 (0.0010) [2023-12-28 06:44:28,778][106225] Updated weights for policy 1, policy_version 1601184 (0.0006) [2023-12-28 06:44:28,832][106225] Updated weights for policy 1, policy_version 1601194 (0.0006) [2023-12-28 06:44:28,882][106226] Updated weights for policy 0, policy_version 1597472 (0.0006) [2023-12-28 06:44:28,894][106225] Updated weights for policy 1, policy_version 1601204 (0.0009) [2023-12-28 06:44:28,942][106226] Updated weights for policy 0, policy_version 1597482 (0.0006) [2023-12-28 06:44:29,004][106226] Updated weights for policy 0, policy_version 1597492 (0.0006) [2023-12-28 06:44:29,579][106225] Updated weights for policy 1, policy_version 1601214 (0.0009) [2023-12-28 06:44:29,633][106225] Updated weights for policy 1, policy_version 1601224 (0.0010) [2023-12-28 06:44:29,697][106225] Updated weights for policy 1, policy_version 1601234 (0.0010) [2023-12-28 06:44:29,715][106226] Updated weights for policy 0, policy_version 1597502 (0.0008) [2023-12-28 06:44:29,773][106226] Updated weights for policy 0, policy_version 1597512 (0.0008) [2023-12-28 06:44:29,836][106226] Updated weights for policy 0, policy_version 1597522 (0.0008) [2023-12-28 06:44:30,304][106225] Updated weights for policy 1, policy_version 1601244 (0.0010) [2023-12-28 06:44:30,361][106225] Updated weights for policy 1, policy_version 1601254 (0.0010) [2023-12-28 06:44:30,414][106225] Updated weights for policy 1, policy_version 1601264 (0.0009) [2023-12-28 06:44:30,566][106226] Updated weights for policy 0, policy_version 1597532 (0.0007) [2023-12-28 06:44:30,630][106226] Updated weights for policy 0, policy_version 1597542 (0.0008) [2023-12-28 06:44:30,682][106226] Updated weights for policy 0, policy_version 1597552 (0.0009) [2023-12-28 06:44:31,167][106225] Updated weights for policy 1, policy_version 1601274 (0.0009) [2023-12-28 06:44:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 819027968. Throughput: 0: 9766.0, 1: 10045.5. Samples: 819020420. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:31,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.613')] [2023-12-28 06:44:31,225][106225] Updated weights for policy 1, policy_version 1601284 (0.0008) [2023-12-28 06:44:31,284][106225] Updated weights for policy 1, policy_version 1601294 (0.0008) [2023-12-28 06:44:31,304][106226] Updated weights for policy 0, policy_version 1597562 (0.0007) [2023-12-28 06:44:31,343][106225] Updated weights for policy 1, policy_version 1601304 (0.0008) [2023-12-28 06:44:31,370][106226] Updated weights for policy 0, policy_version 1597572 (0.0007) [2023-12-28 06:44:31,432][106226] Updated weights for policy 0, policy_version 1597582 (0.0009) [2023-12-28 06:44:31,490][106226] Updated weights for policy 0, policy_version 1597592 (0.0009) [2023-12-28 06:44:32,105][106225] Updated weights for policy 1, policy_version 1601314 (0.0005) [2023-12-28 06:44:32,156][106225] Updated weights for policy 1, policy_version 1601324 (0.0005) [2023-12-28 06:44:32,172][106226] Updated weights for policy 0, policy_version 1597602 (0.0008) [2023-12-28 06:44:32,213][106225] Updated weights for policy 1, policy_version 1601334 (0.0006) [2023-12-28 06:44:32,223][106226] Updated weights for policy 0, policy_version 1597612 (0.0006) [2023-12-28 06:44:32,282][106226] Updated weights for policy 0, policy_version 1597622 (0.0009) [2023-12-28 06:44:32,851][106225] Updated weights for policy 1, policy_version 1601344 (0.0006) [2023-12-28 06:44:32,905][106225] Updated weights for policy 1, policy_version 1601354 (0.0005) [2023-12-28 06:44:32,960][106225] Updated weights for policy 1, policy_version 1601364 (0.0005) [2023-12-28 06:44:33,041][106226] Updated weights for policy 0, policy_version 1597632 (0.0008) [2023-12-28 06:44:33,093][106226] Updated weights for policy 0, policy_version 1597642 (0.0008) [2023-12-28 06:44:33,150][106226] Updated weights for policy 0, policy_version 1597652 (0.0008) [2023-12-28 06:44:33,619][106225] Updated weights for policy 1, policy_version 1601374 (0.0007) [2023-12-28 06:44:33,677][106225] Updated weights for policy 1, policy_version 1601384 (0.0007) [2023-12-28 06:44:33,727][106225] Updated weights for policy 1, policy_version 1601394 (0.0007) [2023-12-28 06:44:33,862][106226] Updated weights for policy 0, policy_version 1597662 (0.0006) [2023-12-28 06:44:33,917][106226] Updated weights for policy 0, policy_version 1597672 (0.0005) [2023-12-28 06:44:33,972][106226] Updated weights for policy 0, policy_version 1597682 (0.0005) [2023-12-28 06:44:34,524][106225] Updated weights for policy 1, policy_version 1601404 (0.0008) [2023-12-28 06:44:34,577][106225] Updated weights for policy 1, policy_version 1601414 (0.0008) [2023-12-28 06:44:34,578][106226] Updated weights for policy 0, policy_version 1597692 (0.0006) [2023-12-28 06:44:34,637][106225] Updated weights for policy 1, policy_version 1601424 (0.0006) [2023-12-28 06:44:34,637][106226] Updated weights for policy 0, policy_version 1597702 (0.0008) [2023-12-28 06:44:34,703][106226] Updated weights for policy 0, policy_version 1597712 (0.0008) [2023-12-28 06:44:35,318][106226] Updated weights for policy 0, policy_version 1597722 (0.0007) [2023-12-28 06:44:35,372][106225] Updated weights for policy 1, policy_version 1601434 (0.0006) [2023-12-28 06:44:35,378][106226] Updated weights for policy 0, policy_version 1597732 (0.0008) [2023-12-28 06:44:35,430][106225] Updated weights for policy 1, policy_version 1601444 (0.0007) [2023-12-28 06:44:35,436][106226] Updated weights for policy 0, policy_version 1597742 (0.0006) [2023-12-28 06:44:35,481][106225] Updated weights for policy 1, policy_version 1601454 (0.0006) [2023-12-28 06:44:35,495][106226] Updated weights for policy 0, policy_version 1597752 (0.0007) [2023-12-28 06:44:35,527][106225] Updated weights for policy 1, policy_version 1601464 (0.0007) [2023-12-28 06:44:36,080][106226] Updated weights for policy 0, policy_version 1597762 (0.0006) [2023-12-28 06:44:36,107][106225] Updated weights for policy 1, policy_version 1601474 (0.0008) [2023-12-28 06:44:36,148][106226] Updated weights for policy 0, policy_version 1597772 (0.0008) [2023-12-28 06:44:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 819126272. Throughput: 0: 9878.9, 1: 10074.8. Samples: 819142652. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:36,175][105115] Avg episode reward: [(0, '-4.787'), (1, '-4.779')] [2023-12-28 06:44:36,178][106225] Updated weights for policy 1, policy_version 1601484 (0.0008) [2023-12-28 06:44:36,202][106226] Updated weights for policy 0, policy_version 1597782 (0.0006) [2023-12-28 06:44:36,236][106225] Updated weights for policy 1, policy_version 1601494 (0.0006) [2023-12-28 06:44:36,911][106225] Updated weights for policy 1, policy_version 1601504 (0.0008) [2023-12-28 06:44:36,962][106225] Updated weights for policy 1, policy_version 1601514 (0.0008) [2023-12-28 06:44:36,987][106226] Updated weights for policy 0, policy_version 1597792 (0.0008) [2023-12-28 06:44:37,018][106225] Updated weights for policy 1, policy_version 1601524 (0.0006) [2023-12-28 06:44:37,061][106226] Updated weights for policy 0, policy_version 1597802 (0.0009) [2023-12-28 06:44:37,121][106226] Updated weights for policy 0, policy_version 1597812 (0.0008) [2023-12-28 06:44:37,729][106225] Updated weights for policy 1, policy_version 1601534 (0.0008) [2023-12-28 06:44:37,790][106225] Updated weights for policy 1, policy_version 1601544 (0.0008) [2023-12-28 06:44:37,848][106225] Updated weights for policy 1, policy_version 1601554 (0.0007) [2023-12-28 06:44:37,863][106226] Updated weights for policy 0, policy_version 1597822 (0.0008) [2023-12-28 06:44:37,922][106226] Updated weights for policy 0, policy_version 1597832 (0.0008) [2023-12-28 06:44:37,978][106226] Updated weights for policy 0, policy_version 1597842 (0.0007) [2023-12-28 06:44:38,473][106225] Updated weights for policy 1, policy_version 1601564 (0.0007) [2023-12-28 06:44:38,541][106225] Updated weights for policy 1, policy_version 1601574 (0.0009) [2023-12-28 06:44:38,601][106225] Updated weights for policy 1, policy_version 1601584 (0.0008) [2023-12-28 06:44:38,716][106226] Updated weights for policy 0, policy_version 1597852 (0.0009) [2023-12-28 06:44:38,779][106226] Updated weights for policy 0, policy_version 1597862 (0.0008) [2023-12-28 06:44:38,839][106226] Updated weights for policy 0, policy_version 1597872 (0.0009) [2023-12-28 06:44:39,383][106225] Updated weights for policy 1, policy_version 1601594 (0.0009) [2023-12-28 06:44:39,452][106225] Updated weights for policy 1, policy_version 1601604 (0.0009) [2023-12-28 06:44:39,511][106225] Updated weights for policy 1, policy_version 1601614 (0.0009) [2023-12-28 06:44:39,574][106225] Updated weights for policy 1, policy_version 1601624 (0.0008) [2023-12-28 06:44:39,635][106226] Updated weights for policy 0, policy_version 1597882 (0.0009) [2023-12-28 06:44:39,698][106226] Updated weights for policy 0, policy_version 1597892 (0.0008) [2023-12-28 06:44:39,768][106226] Updated weights for policy 0, policy_version 1597902 (0.0008) [2023-12-28 06:44:39,832][106226] Updated weights for policy 0, policy_version 1597912 (0.0009) [2023-12-28 06:44:40,334][106225] Updated weights for policy 1, policy_version 1601634 (0.0009) [2023-12-28 06:44:40,402][106225] Updated weights for policy 1, policy_version 1601644 (0.0007) [2023-12-28 06:44:40,464][106225] Updated weights for policy 1, policy_version 1601654 (0.0007) [2023-12-28 06:44:40,556][106226] Updated weights for policy 0, policy_version 1597922 (0.0007) [2023-12-28 06:44:40,621][106226] Updated weights for policy 0, policy_version 1597932 (0.0008) [2023-12-28 06:44:40,686][106226] Updated weights for policy 0, policy_version 1597942 (0.0007) [2023-12-28 06:44:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 819224576. Throughput: 0: 9867.9, 1: 10128.2. Samples: 819200860. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:41,175][105115] Avg episode reward: [(0, '-4.844'), (1, '-4.877')] [2023-12-28 06:44:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001597944_409149440.pth... [2023-12-28 06:44:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001596792_408854528.pth [2023-12-28 06:44:41,225][106225] Updated weights for policy 1, policy_version 1601664 (0.0009) [2023-12-28 06:44:41,285][106225] Updated weights for policy 1, policy_version 1601674 (0.0008) [2023-12-28 06:44:41,353][106225] Updated weights for policy 1, policy_version 1601684 (0.0008) [2023-12-28 06:44:41,383][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001601688_410083328.pth... [2023-12-28 06:44:41,388][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001600504_409780224.pth [2023-12-28 06:44:41,417][106226] Updated weights for policy 0, policy_version 1597952 (0.0008) [2023-12-28 06:44:41,474][106226] Updated weights for policy 0, policy_version 1597962 (0.0009) [2023-12-28 06:44:41,536][106226] Updated weights for policy 0, policy_version 1597972 (0.0009) [2023-12-28 06:44:42,131][106225] Updated weights for policy 1, policy_version 1601694 (0.0008) [2023-12-28 06:44:42,199][106225] Updated weights for policy 1, policy_version 1601704 (0.0007) [2023-12-28 06:44:42,255][106225] Updated weights for policy 1, policy_version 1601714 (0.0007) [2023-12-28 06:44:42,273][106226] Updated weights for policy 0, policy_version 1597982 (0.0011) [2023-12-28 06:44:42,339][106226] Updated weights for policy 0, policy_version 1597992 (0.0010) [2023-12-28 06:44:42,409][106226] Updated weights for policy 0, policy_version 1598002 (0.0009) [2023-12-28 06:44:43,089][106225] Updated weights for policy 1, policy_version 1601724 (0.0008) [2023-12-28 06:44:43,146][106226] Updated weights for policy 0, policy_version 1598012 (0.0008) [2023-12-28 06:44:43,153][106225] Updated weights for policy 1, policy_version 1601734 (0.0008) [2023-12-28 06:44:43,199][106225] Updated weights for policy 1, policy_version 1601744 (0.0007) [2023-12-28 06:44:43,211][106226] Updated weights for policy 0, policy_version 1598022 (0.0005) [2023-12-28 06:44:43,277][106226] Updated weights for policy 0, policy_version 1598032 (0.0005) [2023-12-28 06:44:43,812][106225] Updated weights for policy 1, policy_version 1601754 (0.0008) [2023-12-28 06:44:43,851][106226] Updated weights for policy 0, policy_version 1598042 (0.0006) [2023-12-28 06:44:43,874][106225] Updated weights for policy 1, policy_version 1601764 (0.0006) [2023-12-28 06:44:43,918][106226] Updated weights for policy 0, policy_version 1598052 (0.0008) [2023-12-28 06:44:43,939][106225] Updated weights for policy 1, policy_version 1601774 (0.0005) [2023-12-28 06:44:43,983][106226] Updated weights for policy 0, policy_version 1598062 (0.0008) [2023-12-28 06:44:44,000][106225] Updated weights for policy 1, policy_version 1601784 (0.0005) [2023-12-28 06:44:44,037][106226] Updated weights for policy 0, policy_version 1598072 (0.0009) [2023-12-28 06:44:44,622][106225] Updated weights for policy 1, policy_version 1601794 (0.0005) [2023-12-28 06:44:44,686][106225] Updated weights for policy 1, policy_version 1601804 (0.0009) [2023-12-28 06:44:44,738][106225] Updated weights for policy 1, policy_version 1601814 (0.0007) [2023-12-28 06:44:44,805][106226] Updated weights for policy 0, policy_version 1598082 (0.0009) [2023-12-28 06:44:44,881][106226] Updated weights for policy 0, policy_version 1598092 (0.0009) [2023-12-28 06:44:44,952][106226] Updated weights for policy 0, policy_version 1598102 (0.0008) [2023-12-28 06:44:45,400][106225] Updated weights for policy 1, policy_version 1601824 (0.0009) [2023-12-28 06:44:45,451][106225] Updated weights for policy 1, policy_version 1601834 (0.0008) [2023-12-28 06:44:45,504][106225] Updated weights for policy 1, policy_version 1601844 (0.0005) [2023-12-28 06:44:45,696][106226] Updated weights for policy 0, policy_version 1598112 (0.0010) [2023-12-28 06:44:45,746][106226] Updated weights for policy 0, policy_version 1598122 (0.0008) [2023-12-28 06:44:45,795][106226] Updated weights for policy 0, policy_version 1598132 (0.0008) [2023-12-28 06:44:46,059][106225] Updated weights for policy 1, policy_version 1601854 (0.0008) [2023-12-28 06:44:46,116][106225] Updated weights for policy 1, policy_version 1601864 (0.0008) [2023-12-28 06:44:46,169][106225] Updated weights for policy 1, policy_version 1601874 (0.0006) [2023-12-28 06:44:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 819322880. Throughput: 0: 9834.8, 1: 10030.6. Samples: 819314640. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:46,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.896')] [2023-12-28 06:44:46,369][106226] Updated weights for policy 0, policy_version 1598142 (0.0005) [2023-12-28 06:44:46,425][106226] Updated weights for policy 0, policy_version 1598152 (0.0005) [2023-12-28 06:44:46,482][106226] Updated weights for policy 0, policy_version 1598162 (0.0005) [2023-12-28 06:44:46,758][106225] Updated weights for policy 1, policy_version 1601884 (0.0007) [2023-12-28 06:44:46,829][106225] Updated weights for policy 1, policy_version 1601894 (0.0010) [2023-12-28 06:44:46,898][106225] Updated weights for policy 1, policy_version 1601904 (0.0010) [2023-12-28 06:44:47,014][106226] Updated weights for policy 0, policy_version 1598172 (0.0006) [2023-12-28 06:44:47,069][106226] Updated weights for policy 0, policy_version 1598182 (0.0008) [2023-12-28 06:44:47,127][106226] Updated weights for policy 0, policy_version 1598192 (0.0008) [2023-12-28 06:44:47,482][106225] Updated weights for policy 1, policy_version 1601914 (0.0009) [2023-12-28 06:44:47,542][106225] Updated weights for policy 1, policy_version 1601924 (0.0006) [2023-12-28 06:44:47,593][106225] Updated weights for policy 1, policy_version 1601934 (0.0007) [2023-12-28 06:44:47,648][106225] Updated weights for policy 1, policy_version 1601944 (0.0009) [2023-12-28 06:44:47,821][106226] Updated weights for policy 0, policy_version 1598202 (0.0009) [2023-12-28 06:44:47,873][106226] Updated weights for policy 0, policy_version 1598212 (0.0009) [2023-12-28 06:44:47,929][106226] Updated weights for policy 0, policy_version 1598222 (0.0010) [2023-12-28 06:44:47,982][106226] Updated weights for policy 0, policy_version 1598232 (0.0008) [2023-12-28 06:44:48,314][106225] Updated weights for policy 1, policy_version 1601954 (0.0009) [2023-12-28 06:44:48,376][106225] Updated weights for policy 1, policy_version 1601964 (0.0007) [2023-12-28 06:44:48,434][106225] Updated weights for policy 1, policy_version 1601974 (0.0008) [2023-12-28 06:44:48,677][106226] Updated weights for policy 0, policy_version 1598242 (0.0009) [2023-12-28 06:44:48,740][106226] Updated weights for policy 0, policy_version 1598252 (0.0008) [2023-12-28 06:44:48,804][106226] Updated weights for policy 0, policy_version 1598262 (0.0009) [2023-12-28 06:44:49,086][106225] Updated weights for policy 1, policy_version 1601984 (0.0010) [2023-12-28 06:44:49,141][106225] Updated weights for policy 1, policy_version 1601994 (0.0008) [2023-12-28 06:44:49,196][106225] Updated weights for policy 1, policy_version 1602004 (0.0009) [2023-12-28 06:44:49,471][106226] Updated weights for policy 0, policy_version 1598272 (0.0006) [2023-12-28 06:44:49,530][106226] Updated weights for policy 0, policy_version 1598282 (0.0006) [2023-12-28 06:44:49,589][106226] Updated weights for policy 0, policy_version 1598292 (0.0007) [2023-12-28 06:44:49,992][106225] Updated weights for policy 1, policy_version 1602014 (0.0007) [2023-12-28 06:44:50,055][106225] Updated weights for policy 1, policy_version 1602024 (0.0009) [2023-12-28 06:44:50,120][106225] Updated weights for policy 1, policy_version 1602034 (0.0009) [2023-12-28 06:44:50,192][106226] Updated weights for policy 0, policy_version 1598302 (0.0008) [2023-12-28 06:44:50,245][106226] Updated weights for policy 0, policy_version 1598312 (0.0009) [2023-12-28 06:44:50,312][106226] Updated weights for policy 0, policy_version 1598322 (0.0009) [2023-12-28 06:44:50,856][106225] Updated weights for policy 1, policy_version 1602044 (0.0009) [2023-12-28 06:44:50,914][106225] Updated weights for policy 1, policy_version 1602054 (0.0006) [2023-12-28 06:44:50,978][106225] Updated weights for policy 1, policy_version 1602064 (0.0006) [2023-12-28 06:44:51,044][106226] Updated weights for policy 0, policy_version 1598332 (0.0007) [2023-12-28 06:44:51,106][106226] Updated weights for policy 0, policy_version 1598342 (0.0008) [2023-12-28 06:44:51,174][106226] Updated weights for policy 0, policy_version 1598352 (0.0008) [2023-12-28 06:44:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 819429376. Throughput: 0: 9888.5, 1: 10000.8. Samples: 819440700. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:51,175][105115] Avg episode reward: [(0, '-4.198'), (1, '-4.751')] [2023-12-28 06:44:51,712][106225] Updated weights for policy 1, policy_version 1602074 (0.0008) [2023-12-28 06:44:51,781][106225] Updated weights for policy 1, policy_version 1602084 (0.0009) [2023-12-28 06:44:51,843][106225] Updated weights for policy 1, policy_version 1602094 (0.0010) [2023-12-28 06:44:51,905][106225] Updated weights for policy 1, policy_version 1602104 (0.0010) [2023-12-28 06:44:51,967][106226] Updated weights for policy 0, policy_version 1598362 (0.0010) [2023-12-28 06:44:52,028][106226] Updated weights for policy 0, policy_version 1598372 (0.0009) [2023-12-28 06:44:52,090][106226] Updated weights for policy 0, policy_version 1598382 (0.0008) [2023-12-28 06:44:52,154][106226] Updated weights for policy 0, policy_version 1598392 (0.0008) [2023-12-28 06:44:52,585][106225] Updated weights for policy 1, policy_version 1602114 (0.0007) [2023-12-28 06:44:52,647][106225] Updated weights for policy 1, policy_version 1602124 (0.0008) [2023-12-28 06:44:52,712][106225] Updated weights for policy 1, policy_version 1602134 (0.0008) [2023-12-28 06:44:52,934][106226] Updated weights for policy 0, policy_version 1598402 (0.0011) [2023-12-28 06:44:52,994][106226] Updated weights for policy 0, policy_version 1598412 (0.0010) [2023-12-28 06:44:53,057][106226] Updated weights for policy 0, policy_version 1598422 (0.0010) [2023-12-28 06:44:53,333][106225] Updated weights for policy 1, policy_version 1602144 (0.0006) [2023-12-28 06:44:53,399][106225] Updated weights for policy 1, policy_version 1602154 (0.0005) [2023-12-28 06:44:53,444][106225] Updated weights for policy 1, policy_version 1602164 (0.0005) [2023-12-28 06:44:53,745][106226] Updated weights for policy 0, policy_version 1598432 (0.0010) [2023-12-28 06:44:53,798][106226] Updated weights for policy 0, policy_version 1598442 (0.0010) [2023-12-28 06:44:53,857][106226] Updated weights for policy 0, policy_version 1598452 (0.0010) [2023-12-28 06:44:54,104][106225] Updated weights for policy 1, policy_version 1602174 (0.0007) [2023-12-28 06:44:54,153][106225] Updated weights for policy 1, policy_version 1602184 (0.0005) [2023-12-28 06:44:54,208][106225] Updated weights for policy 1, policy_version 1602194 (0.0005) [2023-12-28 06:44:54,554][106226] Updated weights for policy 0, policy_version 1598462 (0.0011) [2023-12-28 06:44:54,601][106226] Updated weights for policy 0, policy_version 1598472 (0.0010) [2023-12-28 06:44:54,655][106226] Updated weights for policy 0, policy_version 1598482 (0.0010) [2023-12-28 06:44:54,901][106225] Updated weights for policy 1, policy_version 1602204 (0.0008) [2023-12-28 06:44:54,957][106225] Updated weights for policy 1, policy_version 1602214 (0.0010) [2023-12-28 06:44:55,016][106225] Updated weights for policy 1, policy_version 1602224 (0.0009) [2023-12-28 06:44:55,399][106226] Updated weights for policy 0, policy_version 1598492 (0.0009) [2023-12-28 06:44:55,451][106226] Updated weights for policy 0, policy_version 1598502 (0.0008) [2023-12-28 06:44:55,512][106226] Updated weights for policy 0, policy_version 1598512 (0.0005) [2023-12-28 06:44:55,722][106225] Updated weights for policy 1, policy_version 1602234 (0.0007) [2023-12-28 06:44:55,788][106225] Updated weights for policy 1, policy_version 1602244 (0.0007) [2023-12-28 06:44:55,843][106225] Updated weights for policy 1, policy_version 1602254 (0.0005) [2023-12-28 06:44:55,899][106225] Updated weights for policy 1, policy_version 1602264 (0.0006) [2023-12-28 06:44:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 819527680. Throughput: 0: 9842.4, 1: 10039.1. Samples: 819498100. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:44:56,175][105115] Avg episode reward: [(0, '-4.706'), (1, '-4.496')] [2023-12-28 06:44:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001602264_410230784.pth... [2023-12-28 06:44:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001601080_409927680.pth [2023-12-28 06:44:56,189][106226] Updated weights for policy 0, policy_version 1598522 (0.0006) [2023-12-28 06:44:56,248][106226] Updated weights for policy 0, policy_version 1598532 (0.0009) [2023-12-28 06:44:56,310][106226] Updated weights for policy 0, policy_version 1598542 (0.0009) [2023-12-28 06:44:56,373][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001598552_409305088.pth... [2023-12-28 06:44:56,376][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001597368_409001984.pth [2023-12-28 06:44:56,376][106226] Updated weights for policy 0, policy_version 1598552 (0.0009) [2023-12-28 06:44:56,486][106225] Updated weights for policy 1, policy_version 1602274 (0.0005) [2023-12-28 06:44:56,544][106225] Updated weights for policy 1, policy_version 1602284 (0.0005) [2023-12-28 06:44:56,604][106225] Updated weights for policy 1, policy_version 1602294 (0.0005) [2023-12-28 06:44:57,115][106226] Updated weights for policy 0, policy_version 1598562 (0.0010) [2023-12-28 06:44:57,161][106226] Updated weights for policy 0, policy_version 1598572 (0.0010) [2023-12-28 06:44:57,211][106226] Updated weights for policy 0, policy_version 1598582 (0.0010) [2023-12-28 06:44:57,232][106225] Updated weights for policy 1, policy_version 1602304 (0.0006) [2023-12-28 06:44:57,279][106225] Updated weights for policy 1, policy_version 1602314 (0.0008) [2023-12-28 06:44:57,333][106225] Updated weights for policy 1, policy_version 1602324 (0.0007) [2023-12-28 06:44:57,945][106226] Updated weights for policy 0, policy_version 1598592 (0.0011) [2023-12-28 06:44:57,998][106226] Updated weights for policy 0, policy_version 1598602 (0.0010) [2023-12-28 06:44:58,064][106226] Updated weights for policy 0, policy_version 1598612 (0.0011) [2023-12-28 06:44:58,074][106225] Updated weights for policy 1, policy_version 1602334 (0.0006) [2023-12-28 06:44:58,118][106225] Updated weights for policy 1, policy_version 1602344 (0.0007) [2023-12-28 06:44:58,163][106225] Updated weights for policy 1, policy_version 1602354 (0.0007) [2023-12-28 06:44:58,821][106226] Updated weights for policy 0, policy_version 1598622 (0.0012) [2023-12-28 06:44:58,892][106226] Updated weights for policy 0, policy_version 1598632 (0.0008) [2023-12-28 06:44:58,962][106226] Updated weights for policy 0, policy_version 1598642 (0.0008) [2023-12-28 06:44:58,987][106225] Updated weights for policy 1, policy_version 1602364 (0.0007) [2023-12-28 06:44:59,051][106225] Updated weights for policy 1, policy_version 1602374 (0.0007) [2023-12-28 06:44:59,114][106225] Updated weights for policy 1, policy_version 1602384 (0.0008) [2023-12-28 06:44:59,841][106226] Updated weights for policy 0, policy_version 1598652 (0.0009) [2023-12-28 06:44:59,843][106225] Updated weights for policy 1, policy_version 1602394 (0.0008) [2023-12-28 06:44:59,904][106226] Updated weights for policy 0, policy_version 1598662 (0.0009) [2023-12-28 06:44:59,908][106225] Updated weights for policy 1, policy_version 1602404 (0.0007) [2023-12-28 06:44:59,972][106226] Updated weights for policy 0, policy_version 1598672 (0.0007) [2023-12-28 06:44:59,976][106225] Updated weights for policy 1, policy_version 1602414 (0.0008) [2023-12-28 06:45:00,031][106225] Updated weights for policy 1, policy_version 1602424 (0.0010) [2023-12-28 06:45:00,673][106226] Updated weights for policy 0, policy_version 1598682 (0.0008) [2023-12-28 06:45:00,722][106225] Updated weights for policy 1, policy_version 1602434 (0.0005) [2023-12-28 06:45:00,735][106226] Updated weights for policy 0, policy_version 1598692 (0.0008) [2023-12-28 06:45:00,780][106225] Updated weights for policy 1, policy_version 1602444 (0.0005) [2023-12-28 06:45:00,791][106226] Updated weights for policy 0, policy_version 1598702 (0.0008) [2023-12-28 06:45:00,837][106225] Updated weights for policy 1, policy_version 1602454 (0.0005) [2023-12-28 06:45:00,845][106226] Updated weights for policy 0, policy_version 1598712 (0.0008) [2023-12-28 06:45:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 819625984. Throughput: 0: 9820.4, 1: 10065.0. Samples: 819614240. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:01,175][105115] Avg episode reward: [(0, '-4.817'), (1, '-4.523')] [2023-12-28 06:45:01,450][106225] Updated weights for policy 1, policy_version 1602464 (0.0008) [2023-12-28 06:45:01,511][106225] Updated weights for policy 1, policy_version 1602474 (0.0006) [2023-12-28 06:45:01,577][106225] Updated weights for policy 1, policy_version 1602484 (0.0006) [2023-12-28 06:45:01,624][106226] Updated weights for policy 0, policy_version 1598722 (0.0007) [2023-12-28 06:45:01,683][106226] Updated weights for policy 0, policy_version 1598732 (0.0008) [2023-12-28 06:45:01,752][106226] Updated weights for policy 0, policy_version 1598742 (0.0008) [2023-12-28 06:45:02,200][106225] Updated weights for policy 1, policy_version 1602494 (0.0006) [2023-12-28 06:45:02,252][106225] Updated weights for policy 1, policy_version 1602504 (0.0009) [2023-12-28 06:45:02,317][106225] Updated weights for policy 1, policy_version 1602514 (0.0010) [2023-12-28 06:45:02,504][106226] Updated weights for policy 0, policy_version 1598752 (0.0008) [2023-12-28 06:45:02,552][106226] Updated weights for policy 0, policy_version 1598762 (0.0005) [2023-12-28 06:45:02,616][106226] Updated weights for policy 0, policy_version 1598772 (0.0007) [2023-12-28 06:45:03,053][106225] Updated weights for policy 1, policy_version 1602524 (0.0010) [2023-12-28 06:45:03,101][106225] Updated weights for policy 1, policy_version 1602534 (0.0010) [2023-12-28 06:45:03,154][106225] Updated weights for policy 1, policy_version 1602544 (0.0010) [2023-12-28 06:45:03,263][106226] Updated weights for policy 0, policy_version 1598782 (0.0008) [2023-12-28 06:45:03,310][106226] Updated weights for policy 0, policy_version 1598792 (0.0010) [2023-12-28 06:45:03,352][106226] Updated weights for policy 0, policy_version 1598802 (0.0010) [2023-12-28 06:45:03,772][106225] Updated weights for policy 1, policy_version 1602554 (0.0009) [2023-12-28 06:45:03,818][106225] Updated weights for policy 1, policy_version 1602564 (0.0008) [2023-12-28 06:45:03,879][106225] Updated weights for policy 1, policy_version 1602574 (0.0008) [2023-12-28 06:45:03,942][106225] Updated weights for policy 1, policy_version 1602584 (0.0008) [2023-12-28 06:45:04,050][106226] Updated weights for policy 0, policy_version 1598812 (0.0010) [2023-12-28 06:45:04,104][106226] Updated weights for policy 0, policy_version 1598822 (0.0010) [2023-12-28 06:45:04,169][106226] Updated weights for policy 0, policy_version 1598832 (0.0011) [2023-12-28 06:45:04,611][106225] Updated weights for policy 1, policy_version 1602594 (0.0009) [2023-12-28 06:45:04,660][106225] Updated weights for policy 1, policy_version 1602604 (0.0009) [2023-12-28 06:45:04,711][106225] Updated weights for policy 1, policy_version 1602614 (0.0007) [2023-12-28 06:45:04,828][106226] Updated weights for policy 0, policy_version 1598842 (0.0010) [2023-12-28 06:45:04,877][106226] Updated weights for policy 0, policy_version 1598852 (0.0008) [2023-12-28 06:45:04,926][106226] Updated weights for policy 0, policy_version 1598862 (0.0009) [2023-12-28 06:45:04,987][106226] Updated weights for policy 0, policy_version 1598872 (0.0005) [2023-12-28 06:45:05,371][106225] Updated weights for policy 1, policy_version 1602624 (0.0006) [2023-12-28 06:45:05,432][106225] Updated weights for policy 1, policy_version 1602634 (0.0005) [2023-12-28 06:45:05,495][106225] Updated weights for policy 1, policy_version 1602644 (0.0005) [2023-12-28 06:45:05,642][106226] Updated weights for policy 0, policy_version 1598882 (0.0007) [2023-12-28 06:45:05,695][106226] Updated weights for policy 0, policy_version 1598892 (0.0009) [2023-12-28 06:45:05,750][106226] Updated weights for policy 0, policy_version 1598902 (0.0008) [2023-12-28 06:45:06,094][106225] Updated weights for policy 1, policy_version 1602654 (0.0006) [2023-12-28 06:45:06,168][106225] Updated weights for policy 1, policy_version 1602664 (0.0007) [2023-12-28 06:45:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 819724288. Throughput: 0: 9860.4, 1: 10083.4. Samples: 819736808. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:06,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-4.748')] [2023-12-28 06:45:06,233][106225] Updated weights for policy 1, policy_version 1602674 (0.0007) [2023-12-28 06:45:06,436][106226] Updated weights for policy 0, policy_version 1598912 (0.0008) [2023-12-28 06:45:06,496][106226] Updated weights for policy 0, policy_version 1598922 (0.0006) [2023-12-28 06:45:06,556][106226] Updated weights for policy 0, policy_version 1598932 (0.0007) [2023-12-28 06:45:06,956][106225] Updated weights for policy 1, policy_version 1602684 (0.0010) [2023-12-28 06:45:07,022][106225] Updated weights for policy 1, policy_version 1602694 (0.0011) [2023-12-28 06:45:07,080][106225] Updated weights for policy 1, policy_version 1602704 (0.0007) [2023-12-28 06:45:07,261][106226] Updated weights for policy 0, policy_version 1598942 (0.0007) [2023-12-28 06:45:07,325][106226] Updated weights for policy 0, policy_version 1598952 (0.0008) [2023-12-28 06:45:07,391][106226] Updated weights for policy 0, policy_version 1598962 (0.0007) [2023-12-28 06:45:07,808][106225] Updated weights for policy 1, policy_version 1602714 (0.0010) [2023-12-28 06:45:07,865][106225] Updated weights for policy 1, policy_version 1602724 (0.0010) [2023-12-28 06:45:07,926][106225] Updated weights for policy 1, policy_version 1602734 (0.0010) [2023-12-28 06:45:07,989][106225] Updated weights for policy 1, policy_version 1602744 (0.0010) [2023-12-28 06:45:08,050][106226] Updated weights for policy 0, policy_version 1598972 (0.0008) [2023-12-28 06:45:08,116][106226] Updated weights for policy 0, policy_version 1598982 (0.0008) [2023-12-28 06:45:08,174][106226] Updated weights for policy 0, policy_version 1598992 (0.0006) [2023-12-28 06:45:08,767][106225] Updated weights for policy 1, policy_version 1602754 (0.0008) [2023-12-28 06:45:08,826][106225] Updated weights for policy 1, policy_version 1602764 (0.0008) [2023-12-28 06:45:08,830][106226] Updated weights for policy 0, policy_version 1599002 (0.0006) [2023-12-28 06:45:08,887][106225] Updated weights for policy 1, policy_version 1602774 (0.0008) [2023-12-28 06:45:08,893][106226] Updated weights for policy 0, policy_version 1599012 (0.0008) [2023-12-28 06:45:08,958][106226] Updated weights for policy 0, policy_version 1599022 (0.0007) [2023-12-28 06:45:09,016][106226] Updated weights for policy 0, policy_version 1599032 (0.0007) [2023-12-28 06:45:09,717][106226] Updated weights for policy 0, policy_version 1599042 (0.0009) [2023-12-28 06:45:09,719][106225] Updated weights for policy 1, policy_version 1602784 (0.0007) [2023-12-28 06:45:09,776][106226] Updated weights for policy 0, policy_version 1599052 (0.0011) [2023-12-28 06:45:09,782][106225] Updated weights for policy 1, policy_version 1602794 (0.0006) [2023-12-28 06:45:09,838][106226] Updated weights for policy 0, policy_version 1599062 (0.0011) [2023-12-28 06:45:09,848][106225] Updated weights for policy 1, policy_version 1602804 (0.0007) [2023-12-28 06:45:10,528][106226] Updated weights for policy 0, policy_version 1599072 (0.0009) [2023-12-28 06:45:10,589][106226] Updated weights for policy 0, policy_version 1599082 (0.0008) [2023-12-28 06:45:10,653][106226] Updated weights for policy 0, policy_version 1599092 (0.0006) [2023-12-28 06:45:10,666][106225] Updated weights for policy 1, policy_version 1602814 (0.0008) [2023-12-28 06:45:10,733][106225] Updated weights for policy 1, policy_version 1602824 (0.0007) [2023-12-28 06:45:10,801][106225] Updated weights for policy 1, policy_version 1602834 (0.0007) [2023-12-28 06:45:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 819822592. Throughput: 0: 9879.6, 1: 10105.9. Samples: 819795932. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:11,176][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.523')] [2023-12-28 06:45:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001602840_410378240.pth... [2023-12-28 06:45:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001599096_409444352.pth... [2023-12-28 06:45:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001597944_409149440.pth [2023-12-28 06:45:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001601688_410083328.pth [2023-12-28 06:45:11,370][106226] Updated weights for policy 0, policy_version 1599102 (0.0008) [2023-12-28 06:45:11,440][106226] Updated weights for policy 0, policy_version 1599112 (0.0009) [2023-12-28 06:45:11,505][106226] Updated weights for policy 0, policy_version 1599122 (0.0008) [2023-12-28 06:45:11,526][106225] Updated weights for policy 1, policy_version 1602844 (0.0006) [2023-12-28 06:45:11,587][106225] Updated weights for policy 1, policy_version 1602854 (0.0007) [2023-12-28 06:45:11,667][106225] Updated weights for policy 1, policy_version 1602864 (0.0008) [2023-12-28 06:45:12,281][106226] Updated weights for policy 0, policy_version 1599132 (0.0010) [2023-12-28 06:45:12,345][106226] Updated weights for policy 0, policy_version 1599142 (0.0011) [2023-12-28 06:45:12,411][106226] Updated weights for policy 0, policy_version 1599152 (0.0010) [2023-12-28 06:45:12,428][106225] Updated weights for policy 1, policy_version 1602874 (0.0008) [2023-12-28 06:45:12,481][106225] Updated weights for policy 1, policy_version 1602884 (0.0007) [2023-12-28 06:45:12,541][106225] Updated weights for policy 1, policy_version 1602894 (0.0005) [2023-12-28 06:45:12,606][106225] Updated weights for policy 1, policy_version 1602904 (0.0009) [2023-12-28 06:45:13,035][106226] Updated weights for policy 0, policy_version 1599162 (0.0009) [2023-12-28 06:45:13,086][106226] Updated weights for policy 0, policy_version 1599172 (0.0009) [2023-12-28 06:45:13,152][106226] Updated weights for policy 0, policy_version 1599182 (0.0007) [2023-12-28 06:45:13,210][106226] Updated weights for policy 0, policy_version 1599192 (0.0005) [2023-12-28 06:45:13,357][106225] Updated weights for policy 1, policy_version 1602914 (0.0008) [2023-12-28 06:45:13,406][106225] Updated weights for policy 1, policy_version 1602924 (0.0007) [2023-12-28 06:45:13,465][106225] Updated weights for policy 1, policy_version 1602934 (0.0007) [2023-12-28 06:45:13,817][106226] Updated weights for policy 0, policy_version 1599202 (0.0006) [2023-12-28 06:45:13,878][106226] Updated weights for policy 0, policy_version 1599212 (0.0006) [2023-12-28 06:45:13,942][106226] Updated weights for policy 0, policy_version 1599222 (0.0006) [2023-12-28 06:45:14,269][106225] Updated weights for policy 1, policy_version 1602944 (0.0008) [2023-12-28 06:45:14,330][106225] Updated weights for policy 1, policy_version 1602954 (0.0008) [2023-12-28 06:45:14,400][106225] Updated weights for policy 1, policy_version 1602964 (0.0009) [2023-12-28 06:45:14,571][106226] Updated weights for policy 0, policy_version 1599232 (0.0008) [2023-12-28 06:45:14,633][106226] Updated weights for policy 0, policy_version 1599242 (0.0009) [2023-12-28 06:45:14,694][106226] Updated weights for policy 0, policy_version 1599252 (0.0006) [2023-12-28 06:45:15,257][106225] Updated weights for policy 1, policy_version 1602974 (0.0008) [2023-12-28 06:45:15,329][106225] Updated weights for policy 1, policy_version 1602984 (0.0008) [2023-12-28 06:45:15,347][106226] Updated weights for policy 0, policy_version 1599262 (0.0007) [2023-12-28 06:45:15,394][106225] Updated weights for policy 1, policy_version 1602994 (0.0010) [2023-12-28 06:45:15,413][106226] Updated weights for policy 0, policy_version 1599272 (0.0008) [2023-12-28 06:45:15,481][106226] Updated weights for policy 0, policy_version 1599282 (0.0007) [2023-12-28 06:45:16,115][106225] Updated weights for policy 1, policy_version 1603004 (0.0009) [2023-12-28 06:45:16,171][106226] Updated weights for policy 0, policy_version 1599292 (0.0006) [2023-12-28 06:45:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 819912704. Throughput: 0: 9866.5, 1: 9893.7. Samples: 819909628. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:16,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.962')] [2023-12-28 06:45:16,177][106225] Updated weights for policy 1, policy_version 1603014 (0.0008) [2023-12-28 06:45:16,225][106226] Updated weights for policy 0, policy_version 1599302 (0.0007) [2023-12-28 06:45:16,231][106225] Updated weights for policy 1, policy_version 1603024 (0.0007) [2023-12-28 06:45:16,286][106226] Updated weights for policy 0, policy_version 1599312 (0.0007) [2023-12-28 06:45:16,962][106225] Updated weights for policy 1, policy_version 1603034 (0.0007) [2023-12-28 06:45:17,013][106226] Updated weights for policy 0, policy_version 1599322 (0.0008) [2023-12-28 06:45:17,022][106225] Updated weights for policy 1, policy_version 1603044 (0.0008) [2023-12-28 06:45:17,072][106226] Updated weights for policy 0, policy_version 1599332 (0.0010) [2023-12-28 06:45:17,079][106225] Updated weights for policy 1, policy_version 1603054 (0.0009) [2023-12-28 06:45:17,129][106226] Updated weights for policy 0, policy_version 1599342 (0.0008) [2023-12-28 06:45:17,139][106225] Updated weights for policy 1, policy_version 1603064 (0.0007) [2023-12-28 06:45:17,192][106226] Updated weights for policy 0, policy_version 1599352 (0.0009) [2023-12-28 06:45:17,818][106225] Updated weights for policy 1, policy_version 1603074 (0.0008) [2023-12-28 06:45:17,865][106225] Updated weights for policy 1, policy_version 1603084 (0.0005) [2023-12-28 06:45:17,923][106225] Updated weights for policy 1, policy_version 1603094 (0.0005) [2023-12-28 06:45:17,924][106226] Updated weights for policy 0, policy_version 1599362 (0.0006) [2023-12-28 06:45:17,987][106226] Updated weights for policy 0, policy_version 1599372 (0.0007) [2023-12-28 06:45:18,049][106226] Updated weights for policy 0, policy_version 1599382 (0.0009) [2023-12-28 06:45:18,588][106225] Updated weights for policy 1, policy_version 1603104 (0.0006) [2023-12-28 06:45:18,651][106225] Updated weights for policy 1, policy_version 1603114 (0.0008) [2023-12-28 06:45:18,714][106225] Updated weights for policy 1, policy_version 1603124 (0.0008) [2023-12-28 06:45:18,778][106226] Updated weights for policy 0, policy_version 1599392 (0.0008) [2023-12-28 06:45:18,843][106226] Updated weights for policy 0, policy_version 1599402 (0.0009) [2023-12-28 06:45:18,911][106226] Updated weights for policy 0, policy_version 1599412 (0.0009) [2023-12-28 06:45:19,532][106225] Updated weights for policy 1, policy_version 1603134 (0.0008) [2023-12-28 06:45:19,597][106225] Updated weights for policy 1, policy_version 1603144 (0.0008) [2023-12-28 06:45:19,659][106225] Updated weights for policy 1, policy_version 1603154 (0.0006) [2023-12-28 06:45:19,691][106226] Updated weights for policy 0, policy_version 1599422 (0.0009) [2023-12-28 06:45:19,758][106226] Updated weights for policy 0, policy_version 1599432 (0.0008) [2023-12-28 06:45:19,828][106226] Updated weights for policy 0, policy_version 1599442 (0.0008) [2023-12-28 06:45:20,372][106225] Updated weights for policy 1, policy_version 1603164 (0.0008) [2023-12-28 06:45:20,427][106225] Updated weights for policy 1, policy_version 1603174 (0.0009) [2023-12-28 06:45:20,488][106225] Updated weights for policy 1, policy_version 1603184 (0.0007) [2023-12-28 06:45:20,640][106226] Updated weights for policy 0, policy_version 1599452 (0.0009) [2023-12-28 06:45:20,703][106226] Updated weights for policy 0, policy_version 1599462 (0.0008) [2023-12-28 06:45:20,767][106226] Updated weights for policy 0, policy_version 1599472 (0.0008) [2023-12-28 06:45:21,175][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 820011008. Throughput: 0: 9700.3, 1: 9823.5. Samples: 820021224. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:21,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.445')] [2023-12-28 06:45:21,254][106225] Updated weights for policy 1, policy_version 1603194 (0.0007) [2023-12-28 06:45:21,315][106225] Updated weights for policy 1, policy_version 1603204 (0.0011) [2023-12-28 06:45:21,388][106225] Updated weights for policy 1, policy_version 1603214 (0.0012) [2023-12-28 06:45:21,460][106225] Updated weights for policy 1, policy_version 1603224 (0.0011) [2023-12-28 06:45:21,577][106226] Updated weights for policy 0, policy_version 1599482 (0.0008) [2023-12-28 06:45:21,646][106226] Updated weights for policy 0, policy_version 1599492 (0.0009) [2023-12-28 06:45:21,708][106226] Updated weights for policy 0, policy_version 1599502 (0.0009) [2023-12-28 06:45:21,783][106226] Updated weights for policy 0, policy_version 1599512 (0.0008) [2023-12-28 06:45:22,235][106225] Updated weights for policy 1, policy_version 1603234 (0.0011) [2023-12-28 06:45:22,303][106225] Updated weights for policy 1, policy_version 1603244 (0.0007) [2023-12-28 06:45:22,368][106225] Updated weights for policy 1, policy_version 1603254 (0.0009) [2023-12-28 06:45:22,567][106226] Updated weights for policy 0, policy_version 1599522 (0.0009) [2023-12-28 06:45:22,633][106226] Updated weights for policy 0, policy_version 1599532 (0.0011) [2023-12-28 06:45:22,704][106226] Updated weights for policy 0, policy_version 1599542 (0.0009) [2023-12-28 06:45:23,033][106225] Updated weights for policy 1, policy_version 1603264 (0.0010) [2023-12-28 06:45:23,086][106225] Updated weights for policy 1, policy_version 1603274 (0.0010) [2023-12-28 06:45:23,138][106225] Updated weights for policy 1, policy_version 1603284 (0.0010) [2023-12-28 06:45:23,369][106226] Updated weights for policy 0, policy_version 1599552 (0.0011) [2023-12-28 06:45:23,424][106226] Updated weights for policy 0, policy_version 1599562 (0.0011) [2023-12-28 06:45:23,484][106226] Updated weights for policy 0, policy_version 1599572 (0.0010) [2023-12-28 06:45:23,877][106225] Updated weights for policy 1, policy_version 1603294 (0.0007) [2023-12-28 06:45:23,943][106225] Updated weights for policy 1, policy_version 1603304 (0.0005) [2023-12-28 06:45:24,005][106225] Updated weights for policy 1, policy_version 1603314 (0.0009) [2023-12-28 06:45:24,101][106226] Updated weights for policy 0, policy_version 1599582 (0.0007) [2023-12-28 06:45:24,161][106226] Updated weights for policy 0, policy_version 1599592 (0.0008) [2023-12-28 06:45:24,208][106226] Updated weights for policy 0, policy_version 1599602 (0.0010) [2023-12-28 06:45:24,706][106225] Updated weights for policy 1, policy_version 1603324 (0.0010) [2023-12-28 06:45:24,751][106225] Updated weights for policy 1, policy_version 1603334 (0.0009) [2023-12-28 06:45:24,797][106225] Updated weights for policy 1, policy_version 1603344 (0.0005) [2023-12-28 06:45:24,920][106226] Updated weights for policy 0, policy_version 1599612 (0.0011) [2023-12-28 06:45:24,979][106226] Updated weights for policy 0, policy_version 1599622 (0.0011) [2023-12-28 06:45:25,031][106226] Updated weights for policy 0, policy_version 1599632 (0.0008) [2023-12-28 06:45:25,479][106225] Updated weights for policy 1, policy_version 1603354 (0.0006) [2023-12-28 06:45:25,529][106225] Updated weights for policy 1, policy_version 1603364 (0.0010) [2023-12-28 06:45:25,579][106225] Updated weights for policy 1, policy_version 1603374 (0.0010) [2023-12-28 06:45:25,623][106225] Updated weights for policy 1, policy_version 1603384 (0.0010) [2023-12-28 06:45:25,696][106226] Updated weights for policy 0, policy_version 1599642 (0.0008) [2023-12-28 06:45:25,760][106226] Updated weights for policy 0, policy_version 1599652 (0.0011) [2023-12-28 06:45:25,817][106226] Updated weights for policy 0, policy_version 1599662 (0.0008) [2023-12-28 06:45:25,874][106226] Updated weights for policy 0, policy_version 1599672 (0.0010) [2023-12-28 06:45:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 820109312. Throughput: 0: 9744.5, 1: 9752.0. Samples: 820078200. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:26,175][105115] Avg episode reward: [(0, '-4.789'), (1, '-4.533')] [2023-12-28 06:45:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001603384_410517504.pth... [2023-12-28 06:45:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001599672_409591808.pth... [2023-12-28 06:45:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001602264_410230784.pth [2023-12-28 06:45:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001598552_409305088.pth [2023-12-28 06:45:26,285][106225] Updated weights for policy 1, policy_version 1603394 (0.0008) [2023-12-28 06:45:26,341][106225] Updated weights for policy 1, policy_version 1603404 (0.0010) [2023-12-28 06:45:26,401][106225] Updated weights for policy 1, policy_version 1603414 (0.0010) [2023-12-28 06:45:26,474][106226] Updated weights for policy 0, policy_version 1599682 (0.0005) [2023-12-28 06:45:26,535][106226] Updated weights for policy 0, policy_version 1599692 (0.0009) [2023-12-28 06:45:26,581][106226] Updated weights for policy 0, policy_version 1599702 (0.0010) [2023-12-28 06:45:27,052][106225] Updated weights for policy 1, policy_version 1603424 (0.0006) [2023-12-28 06:45:27,098][106225] Updated weights for policy 1, policy_version 1603434 (0.0005) [2023-12-28 06:45:27,145][106225] Updated weights for policy 1, policy_version 1603444 (0.0007) [2023-12-28 06:45:27,259][106226] Updated weights for policy 0, policy_version 1599712 (0.0006) [2023-12-28 06:45:27,316][106226] Updated weights for policy 0, policy_version 1599722 (0.0006) [2023-12-28 06:45:27,369][106226] Updated weights for policy 0, policy_version 1599732 (0.0008) [2023-12-28 06:45:27,816][106225] Updated weights for policy 1, policy_version 1603454 (0.0006) [2023-12-28 06:45:27,862][106225] Updated weights for policy 1, policy_version 1603464 (0.0005) [2023-12-28 06:45:27,910][106225] Updated weights for policy 1, policy_version 1603474 (0.0007) [2023-12-28 06:45:27,961][106226] Updated weights for policy 0, policy_version 1599742 (0.0007) [2023-12-28 06:45:28,013][106226] Updated weights for policy 0, policy_version 1599752 (0.0008) [2023-12-28 06:45:28,064][106226] Updated weights for policy 0, policy_version 1599762 (0.0006) [2023-12-28 06:45:28,641][106225] Updated weights for policy 1, policy_version 1603484 (0.0008) [2023-12-28 06:45:28,713][106225] Updated weights for policy 1, policy_version 1603494 (0.0008) [2023-12-28 06:45:28,742][106226] Updated weights for policy 0, policy_version 1599772 (0.0005) [2023-12-28 06:45:28,761][106225] Updated weights for policy 1, policy_version 1603504 (0.0008) [2023-12-28 06:45:28,801][106226] Updated weights for policy 0, policy_version 1599782 (0.0007) [2023-12-28 06:45:28,860][106226] Updated weights for policy 0, policy_version 1599792 (0.0009) [2023-12-28 06:45:29,541][106225] Updated weights for policy 1, policy_version 1603514 (0.0008) [2023-12-28 06:45:29,583][106226] Updated weights for policy 0, policy_version 1599802 (0.0008) [2023-12-28 06:45:29,593][106225] Updated weights for policy 1, policy_version 1603524 (0.0008) [2023-12-28 06:45:29,646][106226] Updated weights for policy 0, policy_version 1599812 (0.0007) [2023-12-28 06:45:29,651][106225] Updated weights for policy 1, policy_version 1603534 (0.0008) [2023-12-28 06:45:29,709][106226] Updated weights for policy 0, policy_version 1599822 (0.0008) [2023-12-28 06:45:29,709][106225] Updated weights for policy 1, policy_version 1603544 (0.0007) [2023-12-28 06:45:29,773][106226] Updated weights for policy 0, policy_version 1599832 (0.0010) [2023-12-28 06:45:30,387][106225] Updated weights for policy 1, policy_version 1603554 (0.0008) [2023-12-28 06:45:30,420][106226] Updated weights for policy 0, policy_version 1599842 (0.0005) [2023-12-28 06:45:30,449][106225] Updated weights for policy 1, policy_version 1603564 (0.0006) [2023-12-28 06:45:30,481][106226] Updated weights for policy 0, policy_version 1599852 (0.0005) [2023-12-28 06:45:30,507][106225] Updated weights for policy 1, policy_version 1603574 (0.0005) [2023-12-28 06:45:30,532][106226] Updated weights for policy 0, policy_version 1599862 (0.0005) [2023-12-28 06:45:31,046][106226] Updated weights for policy 0, policy_version 1599872 (0.0006) [2023-12-28 06:45:31,102][106225] Updated weights for policy 1, policy_version 1603584 (0.0009) [2023-12-28 06:45:31,110][106226] Updated weights for policy 0, policy_version 1599882 (0.0008) [2023-12-28 06:45:31,157][106225] Updated weights for policy 1, policy_version 1603594 (0.0008) [2023-12-28 06:45:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 820207616. Throughput: 0: 9851.6, 1: 9833.9. Samples: 820200492. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:31,175][105115] Avg episode reward: [(0, '-4.885'), (1, '-4.864')] [2023-12-28 06:45:31,181][106226] Updated weights for policy 0, policy_version 1599892 (0.0008) [2023-12-28 06:45:31,226][106225] Updated weights for policy 1, policy_version 1603604 (0.0011) [2023-12-28 06:45:31,905][106226] Updated weights for policy 0, policy_version 1599902 (0.0007) [2023-12-28 06:45:31,952][106226] Updated weights for policy 0, policy_version 1599912 (0.0005) [2023-12-28 06:45:32,004][106226] Updated weights for policy 0, policy_version 1599922 (0.0006) [2023-12-28 06:45:32,010][106225] Updated weights for policy 1, policy_version 1603614 (0.0010) [2023-12-28 06:45:32,057][106225] Updated weights for policy 1, policy_version 1603624 (0.0010) [2023-12-28 06:45:32,108][106225] Updated weights for policy 1, policy_version 1603634 (0.0010) [2023-12-28 06:45:32,727][106226] Updated weights for policy 0, policy_version 1599932 (0.0007) [2023-12-28 06:45:32,774][106225] Updated weights for policy 1, policy_version 1603644 (0.0010) [2023-12-28 06:45:32,785][106226] Updated weights for policy 0, policy_version 1599942 (0.0007) [2023-12-28 06:45:32,839][106225] Updated weights for policy 1, policy_version 1603654 (0.0009) [2023-12-28 06:45:32,842][106226] Updated weights for policy 0, policy_version 1599952 (0.0006) [2023-12-28 06:45:32,902][106225] Updated weights for policy 1, policy_version 1603664 (0.0008) [2023-12-28 06:45:33,484][106225] Updated weights for policy 1, policy_version 1603674 (0.0007) [2023-12-28 06:45:33,543][106225] Updated weights for policy 1, policy_version 1603684 (0.0010) [2023-12-28 06:45:33,599][106225] Updated weights for policy 1, policy_version 1603694 (0.0010) [2023-12-28 06:45:33,623][106226] Updated weights for policy 0, policy_version 1599962 (0.0006) [2023-12-28 06:45:33,658][106225] Updated weights for policy 1, policy_version 1603704 (0.0010) [2023-12-28 06:45:33,673][106226] Updated weights for policy 0, policy_version 1599972 (0.0006) [2023-12-28 06:45:33,735][106226] Updated weights for policy 0, policy_version 1599982 (0.0008) [2023-12-28 06:45:33,796][106226] Updated weights for policy 0, policy_version 1599992 (0.0005) [2023-12-28 06:45:34,408][106225] Updated weights for policy 1, policy_version 1603714 (0.0008) [2023-12-28 06:45:34,475][106225] Updated weights for policy 1, policy_version 1603724 (0.0008) [2023-12-28 06:45:34,490][106226] Updated weights for policy 0, policy_version 1600002 (0.0011) [2023-12-28 06:45:34,538][106225] Updated weights for policy 1, policy_version 1603734 (0.0008) [2023-12-28 06:45:34,548][106226] Updated weights for policy 0, policy_version 1600012 (0.0010) [2023-12-28 06:45:34,604][106226] Updated weights for policy 0, policy_version 1600022 (0.0007) [2023-12-28 06:45:35,170][106225] Updated weights for policy 1, policy_version 1603744 (0.0006) [2023-12-28 06:45:35,223][106226] Updated weights for policy 0, policy_version 1600032 (0.0008) [2023-12-28 06:45:35,223][106225] Updated weights for policy 1, policy_version 1603754 (0.0005) [2023-12-28 06:45:35,276][106226] Updated weights for policy 0, policy_version 1600042 (0.0010) [2023-12-28 06:45:35,281][106225] Updated weights for policy 1, policy_version 1603764 (0.0006) [2023-12-28 06:45:35,330][106226] Updated weights for policy 0, policy_version 1600052 (0.0010) [2023-12-28 06:45:35,868][106225] Updated weights for policy 1, policy_version 1603774 (0.0010) [2023-12-28 06:45:35,917][106225] Updated weights for policy 1, policy_version 1603784 (0.0010) [2023-12-28 06:45:35,931][106226] Updated weights for policy 0, policy_version 1600062 (0.0010) [2023-12-28 06:45:35,977][106225] Updated weights for policy 1, policy_version 1603794 (0.0010) [2023-12-28 06:45:35,988][106226] Updated weights for policy 0, policy_version 1600072 (0.0007) [2023-12-28 06:45:36,049][106226] Updated weights for policy 0, policy_version 1600082 (0.0007) [2023-12-28 06:45:36,175][105115] Fps is (10 sec: 21298.7, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 820322304. Throughput: 0: 9830.3, 1: 9828.3. Samples: 820325344. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:36,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.667')] [2023-12-28 06:45:36,770][106226] Updated weights for policy 0, policy_version 1600092 (0.0007) [2023-12-28 06:45:36,780][106225] Updated weights for policy 1, policy_version 1603804 (0.0009) [2023-12-28 06:45:36,829][106226] Updated weights for policy 0, policy_version 1600102 (0.0008) [2023-12-28 06:45:36,848][106225] Updated weights for policy 1, policy_version 1603814 (0.0008) [2023-12-28 06:45:36,881][106226] Updated weights for policy 0, policy_version 1600112 (0.0007) [2023-12-28 06:45:36,911][106225] Updated weights for policy 1, policy_version 1603824 (0.0008) [2023-12-28 06:45:37,402][106226] Updated weights for policy 0, policy_version 1600122 (0.0005) [2023-12-28 06:45:37,460][106226] Updated weights for policy 0, policy_version 1600132 (0.0005) [2023-12-28 06:45:37,514][106226] Updated weights for policy 0, policy_version 1600142 (0.0005) [2023-12-28 06:45:37,521][106225] Updated weights for policy 1, policy_version 1603834 (0.0006) [2023-12-28 06:45:37,565][106226] Updated weights for policy 0, policy_version 1600152 (0.0006) [2023-12-28 06:45:37,585][106225] Updated weights for policy 1, policy_version 1603844 (0.0005) [2023-12-28 06:45:37,635][106225] Updated weights for policy 1, policy_version 1603854 (0.0007) [2023-12-28 06:45:37,685][106225] Updated weights for policy 1, policy_version 1603864 (0.0008) [2023-12-28 06:45:38,275][106226] Updated weights for policy 0, policy_version 1600162 (0.0007) [2023-12-28 06:45:38,347][106226] Updated weights for policy 0, policy_version 1600172 (0.0009) [2023-12-28 06:45:38,368][106225] Updated weights for policy 1, policy_version 1603874 (0.0007) [2023-12-28 06:45:38,418][106226] Updated weights for policy 0, policy_version 1600182 (0.0009) [2023-12-28 06:45:38,437][106225] Updated weights for policy 1, policy_version 1603884 (0.0006) [2023-12-28 06:45:38,503][106225] Updated weights for policy 1, policy_version 1603894 (0.0009) [2023-12-28 06:45:39,111][106226] Updated weights for policy 0, policy_version 1600192 (0.0006) [2023-12-28 06:45:39,166][106226] Updated weights for policy 0, policy_version 1600202 (0.0011) [2023-12-28 06:45:39,186][106225] Updated weights for policy 1, policy_version 1603904 (0.0007) [2023-12-28 06:45:39,221][106226] Updated weights for policy 0, policy_version 1600212 (0.0010) [2023-12-28 06:45:39,255][106225] Updated weights for policy 1, policy_version 1603914 (0.0009) [2023-12-28 06:45:39,316][106225] Updated weights for policy 1, policy_version 1603924 (0.0008) [2023-12-28 06:45:40,023][106226] Updated weights for policy 0, policy_version 1600222 (0.0009) [2023-12-28 06:45:40,078][106226] Updated weights for policy 0, policy_version 1600232 (0.0006) [2023-12-28 06:45:40,085][106225] Updated weights for policy 1, policy_version 1603934 (0.0007) [2023-12-28 06:45:40,140][106226] Updated weights for policy 0, policy_version 1600242 (0.0006) [2023-12-28 06:45:40,148][106225] Updated weights for policy 1, policy_version 1603944 (0.0009) [2023-12-28 06:45:40,212][106225] Updated weights for policy 1, policy_version 1603954 (0.0009) [2023-12-28 06:45:40,811][106226] Updated weights for policy 0, policy_version 1600252 (0.0007) [2023-12-28 06:45:40,879][106226] Updated weights for policy 0, policy_version 1600262 (0.0009) [2023-12-28 06:45:40,929][106225] Updated weights for policy 1, policy_version 1603964 (0.0009) [2023-12-28 06:45:40,936][106226] Updated weights for policy 0, policy_version 1600272 (0.0008) [2023-12-28 06:45:40,989][106225] Updated weights for policy 1, policy_version 1603974 (0.0007) [2023-12-28 06:45:41,054][106225] Updated weights for policy 1, policy_version 1603984 (0.0008) [2023-12-28 06:45:41,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 820420608. Throughput: 0: 9916.1, 1: 9831.6. Samples: 820386748. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:41,175][105115] Avg episode reward: [(0, '-4.780'), (1, '-4.981')] [2023-12-28 06:45:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001603992_410673152.pth... [2023-12-28 06:45:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001600280_409747456.pth... [2023-12-28 06:45:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001599096_409444352.pth [2023-12-28 06:45:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001602840_410378240.pth [2023-12-28 06:45:41,718][106226] Updated weights for policy 0, policy_version 1600282 (0.0006) [2023-12-28 06:45:41,790][106226] Updated weights for policy 0, policy_version 1600292 (0.0008) [2023-12-28 06:45:41,854][106226] Updated weights for policy 0, policy_version 1600302 (0.0009) [2023-12-28 06:45:41,919][106226] Updated weights for policy 0, policy_version 1600312 (0.0009) [2023-12-28 06:45:41,926][106225] Updated weights for policy 1, policy_version 1603994 (0.0009) [2023-12-28 06:45:41,990][106225] Updated weights for policy 1, policy_version 1604004 (0.0009) [2023-12-28 06:45:42,044][106225] Updated weights for policy 1, policy_version 1604014 (0.0009) [2023-12-28 06:45:42,095][106225] Updated weights for policy 1, policy_version 1604024 (0.0008) [2023-12-28 06:45:42,594][106226] Updated weights for policy 0, policy_version 1600322 (0.0009) [2023-12-28 06:45:42,653][106226] Updated weights for policy 0, policy_version 1600332 (0.0008) [2023-12-28 06:45:42,720][106226] Updated weights for policy 0, policy_version 1600342 (0.0009) [2023-12-28 06:45:42,865][106225] Updated weights for policy 1, policy_version 1604034 (0.0007) [2023-12-28 06:45:42,917][106225] Updated weights for policy 1, policy_version 1604044 (0.0009) [2023-12-28 06:45:42,967][106225] Updated weights for policy 1, policy_version 1604054 (0.0007) [2023-12-28 06:45:43,468][106226] Updated weights for policy 0, policy_version 1600352 (0.0008) [2023-12-28 06:45:43,532][106226] Updated weights for policy 0, policy_version 1600362 (0.0007) [2023-12-28 06:45:43,591][106226] Updated weights for policy 0, policy_version 1600372 (0.0009) [2023-12-28 06:45:43,635][106225] Updated weights for policy 1, policy_version 1604064 (0.0008) [2023-12-28 06:45:43,687][106225] Updated weights for policy 1, policy_version 1604074 (0.0008) [2023-12-28 06:45:43,740][106225] Updated weights for policy 1, policy_version 1604084 (0.0008) [2023-12-28 06:45:44,292][106226] Updated weights for policy 0, policy_version 1600382 (0.0009) [2023-12-28 06:45:44,355][106226] Updated weights for policy 0, policy_version 1600392 (0.0008) [2023-12-28 06:45:44,408][106226] Updated weights for policy 0, policy_version 1600402 (0.0009) [2023-12-28 06:45:44,490][106225] Updated weights for policy 1, policy_version 1604094 (0.0010) [2023-12-28 06:45:44,552][106225] Updated weights for policy 1, policy_version 1604104 (0.0009) [2023-12-28 06:45:44,614][106225] Updated weights for policy 1, policy_version 1604114 (0.0008) [2023-12-28 06:45:45,175][106226] Updated weights for policy 0, policy_version 1600412 (0.0007) [2023-12-28 06:45:45,232][106226] Updated weights for policy 0, policy_version 1600422 (0.0007) [2023-12-28 06:45:45,287][106226] Updated weights for policy 0, policy_version 1600432 (0.0007) [2023-12-28 06:45:45,348][106225] Updated weights for policy 1, policy_version 1604124 (0.0006) [2023-12-28 06:45:45,404][106225] Updated weights for policy 1, policy_version 1604134 (0.0009) [2023-12-28 06:45:45,467][106225] Updated weights for policy 1, policy_version 1604144 (0.0009) [2023-12-28 06:45:45,942][106226] Updated weights for policy 0, policy_version 1600442 (0.0008) [2023-12-28 06:45:46,002][106226] Updated weights for policy 0, policy_version 1600452 (0.0005) [2023-12-28 06:45:46,056][106226] Updated weights for policy 0, policy_version 1600462 (0.0006) [2023-12-28 06:45:46,103][106225] Updated weights for policy 1, policy_version 1604154 (0.0008) [2023-12-28 06:45:46,113][106226] Updated weights for policy 0, policy_version 1600472 (0.0008) [2023-12-28 06:45:46,164][106225] Updated weights for policy 1, policy_version 1604164 (0.0005) [2023-12-28 06:45:46,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 820510720. Throughput: 0: 9922.7, 1: 9741.9. Samples: 820499144. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:46,175][105115] Avg episode reward: [(0, '-4.920'), (1, '-4.499')] [2023-12-28 06:45:46,214][106225] Updated weights for policy 1, policy_version 1604174 (0.0005) [2023-12-28 06:45:46,268][106225] Updated weights for policy 1, policy_version 1604184 (0.0009) [2023-12-28 06:45:46,715][106226] Updated weights for policy 0, policy_version 1600482 (0.0010) [2023-12-28 06:45:46,777][106226] Updated weights for policy 0, policy_version 1600492 (0.0009) [2023-12-28 06:45:46,833][106225] Updated weights for policy 1, policy_version 1604194 (0.0005) [2023-12-28 06:45:46,838][106226] Updated weights for policy 0, policy_version 1600503 (0.0009) [2023-12-28 06:45:46,885][106225] Updated weights for policy 1, policy_version 1604204 (0.0005) [2023-12-28 06:45:46,942][106225] Updated weights for policy 1, policy_version 1604214 (0.0005) [2023-12-28 06:45:47,450][106226] Updated weights for policy 0, policy_version 1600513 (0.0010) [2023-12-28 06:45:47,513][106226] Updated weights for policy 0, policy_version 1600523 (0.0010) [2023-12-28 06:45:47,555][106225] Updated weights for policy 1, policy_version 1604224 (0.0005) [2023-12-28 06:45:47,563][106226] Updated weights for policy 0, policy_version 1600533 (0.0010) [2023-12-28 06:45:47,614][106225] Updated weights for policy 1, policy_version 1604234 (0.0005) [2023-12-28 06:45:47,670][106225] Updated weights for policy 1, policy_version 1604244 (0.0005) [2023-12-28 06:45:48,223][106226] Updated weights for policy 0, policy_version 1600543 (0.0008) [2023-12-28 06:45:48,250][106225] Updated weights for policy 1, policy_version 1604254 (0.0006) [2023-12-28 06:45:48,273][106226] Updated weights for policy 0, policy_version 1600553 (0.0010) [2023-12-28 06:45:48,301][106225] Updated weights for policy 1, policy_version 1604264 (0.0005) [2023-12-28 06:45:48,332][106226] Updated weights for policy 0, policy_version 1600563 (0.0010) [2023-12-28 06:45:48,364][106225] Updated weights for policy 1, policy_version 1604274 (0.0007) [2023-12-28 06:45:48,961][106226] Updated weights for policy 0, policy_version 1600573 (0.0008) [2023-12-28 06:45:49,017][106226] Updated weights for policy 0, policy_version 1600583 (0.0005) [2023-12-28 06:45:49,075][106226] Updated weights for policy 0, policy_version 1600593 (0.0010) [2023-12-28 06:45:49,143][106225] Updated weights for policy 1, policy_version 1604284 (0.0007) [2023-12-28 06:45:49,195][106225] Updated weights for policy 1, policy_version 1604294 (0.0007) [2023-12-28 06:45:49,263][106225] Updated weights for policy 1, policy_version 1604304 (0.0008) [2023-12-28 06:45:49,769][106226] Updated weights for policy 0, policy_version 1600603 (0.0009) [2023-12-28 06:45:49,836][106226] Updated weights for policy 0, policy_version 1600613 (0.0007) [2023-12-28 06:45:49,900][106226] Updated weights for policy 0, policy_version 1600623 (0.0010) [2023-12-28 06:45:49,963][106225] Updated weights for policy 1, policy_version 1604314 (0.0008) [2023-12-28 06:45:50,022][106225] Updated weights for policy 1, policy_version 1604324 (0.0008) [2023-12-28 06:45:50,084][106225] Updated weights for policy 1, policy_version 1604334 (0.0006) [2023-12-28 06:45:50,141][106225] Updated weights for policy 1, policy_version 1604344 (0.0006) [2023-12-28 06:45:50,699][106225] Updated weights for policy 1, policy_version 1604354 (0.0009) [2023-12-28 06:45:50,724][106226] Updated weights for policy 0, policy_version 1600633 (0.0010) [2023-12-28 06:45:50,757][106225] Updated weights for policy 1, policy_version 1604364 (0.0008) [2023-12-28 06:45:50,784][106226] Updated weights for policy 0, policy_version 1600643 (0.0007) [2023-12-28 06:45:50,823][106225] Updated weights for policy 1, policy_version 1604374 (0.0006) [2023-12-28 06:45:50,837][106226] Updated weights for policy 0, policy_version 1600653 (0.0007) [2023-12-28 06:45:50,900][106226] Updated weights for policy 0, policy_version 1600663 (0.0008) [2023-12-28 06:45:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 820617216. Throughput: 0: 9965.9, 1: 9763.8. Samples: 820624644. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:51,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.749')] [2023-12-28 06:45:51,502][106225] Updated weights for policy 1, policy_version 1604384 (0.0008) [2023-12-28 06:45:51,562][106225] Updated weights for policy 1, policy_version 1604394 (0.0009) [2023-12-28 06:45:51,624][106225] Updated weights for policy 1, policy_version 1604404 (0.0007) [2023-12-28 06:45:51,713][106226] Updated weights for policy 0, policy_version 1600673 (0.0009) [2023-12-28 06:45:51,785][106226] Updated weights for policy 0, policy_version 1600683 (0.0010) [2023-12-28 06:45:51,842][106226] Updated weights for policy 0, policy_version 1600693 (0.0008) [2023-12-28 06:45:52,332][106225] Updated weights for policy 1, policy_version 1604414 (0.0008) [2023-12-28 06:45:52,398][106225] Updated weights for policy 1, policy_version 1604424 (0.0008) [2023-12-28 06:45:52,456][106225] Updated weights for policy 1, policy_version 1604434 (0.0008) [2023-12-28 06:45:52,612][106226] Updated weights for policy 0, policy_version 1600703 (0.0006) [2023-12-28 06:45:52,660][106226] Updated weights for policy 0, policy_version 1600713 (0.0005) [2023-12-28 06:45:52,708][106226] Updated weights for policy 0, policy_version 1600723 (0.0008) [2023-12-28 06:45:53,250][106225] Updated weights for policy 1, policy_version 1604444 (0.0007) [2023-12-28 06:45:53,296][106225] Updated weights for policy 1, policy_version 1604454 (0.0005) [2023-12-28 06:45:53,315][106226] Updated weights for policy 0, policy_version 1600733 (0.0009) [2023-12-28 06:45:53,344][106225] Updated weights for policy 1, policy_version 1604464 (0.0005) [2023-12-28 06:45:53,378][106226] Updated weights for policy 0, policy_version 1600743 (0.0010) [2023-12-28 06:45:53,428][106226] Updated weights for policy 0, policy_version 1600753 (0.0010) [2023-12-28 06:45:53,899][106225] Updated weights for policy 1, policy_version 1604474 (0.0005) [2023-12-28 06:45:53,960][106225] Updated weights for policy 1, policy_version 1604484 (0.0009) [2023-12-28 06:45:54,018][106225] Updated weights for policy 1, policy_version 1604494 (0.0009) [2023-12-28 06:45:54,076][106225] Updated weights for policy 1, policy_version 1604504 (0.0008) [2023-12-28 06:45:54,091][106226] Updated weights for policy 0, policy_version 1600763 (0.0010) [2023-12-28 06:45:54,148][106226] Updated weights for policy 0, policy_version 1600773 (0.0009) [2023-12-28 06:45:54,209][106226] Updated weights for policy 0, policy_version 1600783 (0.0009) [2023-12-28 06:45:54,681][106225] Updated weights for policy 1, policy_version 1604514 (0.0008) [2023-12-28 06:45:54,737][106225] Updated weights for policy 1, policy_version 1604524 (0.0008) [2023-12-28 06:45:54,788][106225] Updated weights for policy 1, policy_version 1604534 (0.0009) [2023-12-28 06:45:54,860][106226] Updated weights for policy 0, policy_version 1600793 (0.0008) [2023-12-28 06:45:54,911][106226] Updated weights for policy 0, policy_version 1600803 (0.0009) [2023-12-28 06:45:54,969][106226] Updated weights for policy 0, policy_version 1600813 (0.0009) [2023-12-28 06:45:55,030][106226] Updated weights for policy 0, policy_version 1600823 (0.0006) [2023-12-28 06:45:55,419][106225] Updated weights for policy 1, policy_version 1604544 (0.0006) [2023-12-28 06:45:55,465][106225] Updated weights for policy 1, policy_version 1604554 (0.0008) [2023-12-28 06:45:55,515][106225] Updated weights for policy 1, policy_version 1604564 (0.0008) [2023-12-28 06:45:55,783][106226] Updated weights for policy 0, policy_version 1600833 (0.0009) [2023-12-28 06:45:55,831][106226] Updated weights for policy 0, policy_version 1600843 (0.0008) [2023-12-28 06:45:55,881][106226] Updated weights for policy 0, policy_version 1600853 (0.0010) [2023-12-28 06:45:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 820715520. Throughput: 0: 9959.2, 1: 9790.0. Samples: 820684640. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:45:56,175][105115] Avg episode reward: [(0, '-4.793'), (1, '-4.622')] [2023-12-28 06:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001604568_410820608.pth... [2023-12-28 06:45:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001600856_409894912.pth... [2023-12-28 06:45:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001603384_410517504.pth [2023-12-28 06:45:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001599672_409591808.pth [2023-12-28 06:45:56,261][106225] Updated weights for policy 1, policy_version 1604574 (0.0008) [2023-12-28 06:45:56,320][106225] Updated weights for policy 1, policy_version 1604584 (0.0009) [2023-12-28 06:45:56,379][106225] Updated weights for policy 1, policy_version 1604594 (0.0008) [2023-12-28 06:45:56,561][106226] Updated weights for policy 0, policy_version 1600863 (0.0008) [2023-12-28 06:45:56,618][106226] Updated weights for policy 0, policy_version 1600873 (0.0008) [2023-12-28 06:45:56,673][106226] Updated weights for policy 0, policy_version 1600883 (0.0008) [2023-12-28 06:45:57,057][106225] Updated weights for policy 1, policy_version 1604604 (0.0007) [2023-12-28 06:45:57,122][106225] Updated weights for policy 1, policy_version 1604614 (0.0005) [2023-12-28 06:45:57,178][106225] Updated weights for policy 1, policy_version 1604624 (0.0005) [2023-12-28 06:45:57,393][106226] Updated weights for policy 0, policy_version 1600893 (0.0007) [2023-12-28 06:45:57,445][106226] Updated weights for policy 0, policy_version 1600903 (0.0005) [2023-12-28 06:45:57,496][106226] Updated weights for policy 0, policy_version 1600913 (0.0005) [2023-12-28 06:45:57,796][106225] Updated weights for policy 1, policy_version 1604634 (0.0009) [2023-12-28 06:45:57,852][106225] Updated weights for policy 1, policy_version 1604644 (0.0008) [2023-12-28 06:45:57,911][106225] Updated weights for policy 1, policy_version 1604654 (0.0008) [2023-12-28 06:45:57,963][106225] Updated weights for policy 1, policy_version 1604664 (0.0005) [2023-12-28 06:45:58,025][106226] Updated weights for policy 0, policy_version 1600923 (0.0005) [2023-12-28 06:45:58,076][106226] Updated weights for policy 0, policy_version 1600933 (0.0005) [2023-12-28 06:45:58,125][106226] Updated weights for policy 0, policy_version 1600943 (0.0006) [2023-12-28 06:45:58,655][106225] Updated weights for policy 1, policy_version 1604674 (0.0006) [2023-12-28 06:45:58,726][106225] Updated weights for policy 1, policy_version 1604684 (0.0007) [2023-12-28 06:45:58,801][106225] Updated weights for policy 1, policy_version 1604694 (0.0008) [2023-12-28 06:45:58,947][106226] Updated weights for policy 0, policy_version 1600953 (0.0008) [2023-12-28 06:45:59,012][106226] Updated weights for policy 0, policy_version 1600963 (0.0010) [2023-12-28 06:45:59,073][106226] Updated weights for policy 0, policy_version 1600973 (0.0009) [2023-12-28 06:45:59,134][106226] Updated weights for policy 0, policy_version 1600983 (0.0011) [2023-12-28 06:45:59,672][106225] Updated weights for policy 1, policy_version 1604704 (0.0008) [2023-12-28 06:45:59,731][106225] Updated weights for policy 1, policy_version 1604714 (0.0009) [2023-12-28 06:45:59,782][106225] Updated weights for policy 1, policy_version 1604724 (0.0009) [2023-12-28 06:45:59,834][106226] Updated weights for policy 0, policy_version 1600993 (0.0009) [2023-12-28 06:45:59,904][106226] Updated weights for policy 0, policy_version 1601003 (0.0009) [2023-12-28 06:45:59,961][106226] Updated weights for policy 0, policy_version 1601013 (0.0009) [2023-12-28 06:46:00,543][106225] Updated weights for policy 1, policy_version 1604734 (0.0009) [2023-12-28 06:46:00,591][106225] Updated weights for policy 1, policy_version 1604744 (0.0009) [2023-12-28 06:46:00,639][106226] Updated weights for policy 0, policy_version 1601023 (0.0007) [2023-12-28 06:46:00,650][106225] Updated weights for policy 1, policy_version 1604754 (0.0007) [2023-12-28 06:46:00,695][106226] Updated weights for policy 0, policy_version 1601033 (0.0007) [2023-12-28 06:46:00,763][106226] Updated weights for policy 0, policy_version 1601043 (0.0008) [2023-12-28 06:46:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 820813824. Throughput: 0: 9947.9, 1: 9942.0. Samples: 820804676. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-28 06:46:01,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.433')] [2023-12-28 06:46:01,269][106225] Updated weights for policy 1, policy_version 1604764 (0.0006) [2023-12-28 06:46:01,328][106225] Updated weights for policy 1, policy_version 1604774 (0.0007) [2023-12-28 06:46:01,389][106225] Updated weights for policy 1, policy_version 1604784 (0.0007) [2023-12-28 06:46:01,574][106226] Updated weights for policy 0, policy_version 1601053 (0.0008) [2023-12-28 06:46:01,642][106226] Updated weights for policy 0, policy_version 1601063 (0.0008) [2023-12-28 06:46:01,703][106226] Updated weights for policy 0, policy_version 1601073 (0.0010) [2023-12-28 06:46:02,088][106225] Updated weights for policy 1, policy_version 1604794 (0.0005) [2023-12-28 06:46:02,143][106225] Updated weights for policy 1, policy_version 1604804 (0.0006) [2023-12-28 06:46:02,202][106225] Updated weights for policy 1, policy_version 1604814 (0.0009) [2023-12-28 06:46:02,290][106225] Updated weights for policy 1, policy_version 1604824 (0.0010) [2023-12-28 06:46:02,419][106226] Updated weights for policy 0, policy_version 1601084 (0.0010) [2023-12-28 06:46:02,487][106226] Updated weights for policy 0, policy_version 1601094 (0.0008) [2023-12-28 06:46:02,547][106226] Updated weights for policy 0, policy_version 1601104 (0.0007) [2023-12-28 06:46:02,914][106225] Updated weights for policy 1, policy_version 1604834 (0.0010) [2023-12-28 06:46:02,964][106225] Updated weights for policy 1, policy_version 1604844 (0.0010) [2023-12-28 06:46:03,010][106225] Updated weights for policy 1, policy_version 1604854 (0.0010) [2023-12-28 06:46:03,171][106226] Updated weights for policy 0, policy_version 1601114 (0.0007) [2023-12-28 06:46:03,217][106226] Updated weights for policy 0, policy_version 1601124 (0.0005) [2023-12-28 06:46:03,271][106226] Updated weights for policy 0, policy_version 1601134 (0.0005) [2023-12-28 06:46:03,331][106226] Updated weights for policy 0, policy_version 1601144 (0.0005) [2023-12-28 06:46:03,724][106225] Updated weights for policy 1, policy_version 1604864 (0.0007) [2023-12-28 06:46:03,790][106225] Updated weights for policy 1, policy_version 1604874 (0.0006) [2023-12-28 06:46:03,850][106226] Updated weights for policy 0, policy_version 1601154 (0.0007) [2023-12-28 06:46:03,857][106225] Updated weights for policy 1, policy_version 1604884 (0.0007) [2023-12-28 06:46:03,912][106226] Updated weights for policy 0, policy_version 1601164 (0.0011) [2023-12-28 06:46:03,980][106226] Updated weights for policy 0, policy_version 1601174 (0.0007) [2023-12-28 06:46:04,422][106225] Updated weights for policy 1, policy_version 1604894 (0.0007) [2023-12-28 06:46:04,481][106225] Updated weights for policy 1, policy_version 1604904 (0.0007) [2023-12-28 06:46:04,546][106225] Updated weights for policy 1, policy_version 1604914 (0.0009) [2023-12-28 06:46:04,731][106226] Updated weights for policy 0, policy_version 1601184 (0.0007) [2023-12-28 06:46:04,792][106226] Updated weights for policy 0, policy_version 1601194 (0.0008) [2023-12-28 06:46:04,847][106226] Updated weights for policy 0, policy_version 1601204 (0.0007) [2023-12-28 06:46:05,248][106225] Updated weights for policy 1, policy_version 1604924 (0.0011) [2023-12-28 06:46:05,298][106225] Updated weights for policy 1, policy_version 1604934 (0.0010) [2023-12-28 06:46:05,347][106225] Updated weights for policy 1, policy_version 1604944 (0.0010) [2023-12-28 06:46:05,560][106226] Updated weights for policy 0, policy_version 1601214 (0.0008) [2023-12-28 06:46:05,617][106226] Updated weights for policy 0, policy_version 1601224 (0.0007) [2023-12-28 06:46:05,669][106226] Updated weights for policy 0, policy_version 1601234 (0.0008) [2023-12-28 06:46:05,977][106225] Updated weights for policy 1, policy_version 1604954 (0.0009) [2023-12-28 06:46:06,054][106225] Updated weights for policy 1, policy_version 1604964 (0.0005) [2023-12-28 06:46:06,127][106225] Updated weights for policy 1, policy_version 1604974 (0.0009) [2023-12-28 06:46:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 820912128. Throughput: 0: 10053.0, 1: 10067.2. Samples: 820926632. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:06,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.616')] [2023-12-28 06:46:06,191][106225] Updated weights for policy 1, policy_version 1604984 (0.0010) [2023-12-28 06:46:06,437][106226] Updated weights for policy 0, policy_version 1601244 (0.0007) [2023-12-28 06:46:06,505][106226] Updated weights for policy 0, policy_version 1601254 (0.0006) [2023-12-28 06:46:06,570][106226] Updated weights for policy 0, policy_version 1601264 (0.0011) [2023-12-28 06:46:06,797][106225] Updated weights for policy 1, policy_version 1604994 (0.0010) [2023-12-28 06:46:06,858][106225] Updated weights for policy 1, policy_version 1605004 (0.0010) [2023-12-28 06:46:06,918][106225] Updated weights for policy 1, policy_version 1605014 (0.0010) [2023-12-28 06:46:07,208][106226] Updated weights for policy 0, policy_version 1601274 (0.0010) [2023-12-28 06:46:07,267][106226] Updated weights for policy 0, policy_version 1601284 (0.0005) [2023-12-28 06:46:07,323][106226] Updated weights for policy 0, policy_version 1601294 (0.0006) [2023-12-28 06:46:07,369][106226] Updated weights for policy 0, policy_version 1601304 (0.0010) [2023-12-28 06:46:07,583][106225] Updated weights for policy 1, policy_version 1605024 (0.0008) [2023-12-28 06:46:07,638][106225] Updated weights for policy 1, policy_version 1605034 (0.0009) [2023-12-28 06:46:07,693][106225] Updated weights for policy 1, policy_version 1605044 (0.0009) [2023-12-28 06:46:07,933][106226] Updated weights for policy 0, policy_version 1601314 (0.0005) [2023-12-28 06:46:07,997][106226] Updated weights for policy 0, policy_version 1601324 (0.0007) [2023-12-28 06:46:08,050][106226] Updated weights for policy 0, policy_version 1601334 (0.0008) [2023-12-28 06:46:08,359][106225] Updated weights for policy 1, policy_version 1605054 (0.0009) [2023-12-28 06:46:08,417][106225] Updated weights for policy 1, policy_version 1605064 (0.0008) [2023-12-28 06:46:08,476][106225] Updated weights for policy 1, policy_version 1605074 (0.0008) [2023-12-28 06:46:08,712][106226] Updated weights for policy 0, policy_version 1601344 (0.0010) [2023-12-28 06:46:08,779][106226] Updated weights for policy 0, policy_version 1601354 (0.0011) [2023-12-28 06:46:08,847][106226] Updated weights for policy 0, policy_version 1601364 (0.0011) [2023-12-28 06:46:09,241][106225] Updated weights for policy 1, policy_version 1605084 (0.0008) [2023-12-28 06:46:09,304][106225] Updated weights for policy 1, policy_version 1605094 (0.0010) [2023-12-28 06:46:09,378][106225] Updated weights for policy 1, policy_version 1605104 (0.0010) [2023-12-28 06:46:09,638][106226] Updated weights for policy 0, policy_version 1601374 (0.0009) [2023-12-28 06:46:09,701][106226] Updated weights for policy 0, policy_version 1601384 (0.0009) [2023-12-28 06:46:09,761][106226] Updated weights for policy 0, policy_version 1601394 (0.0008) [2023-12-28 06:46:10,121][106225] Updated weights for policy 1, policy_version 1605114 (0.0009) [2023-12-28 06:46:10,171][106225] Updated weights for policy 1, policy_version 1605124 (0.0009) [2023-12-28 06:46:10,216][106225] Updated weights for policy 1, policy_version 1605134 (0.0009) [2023-12-28 06:46:10,268][106225] Updated weights for policy 1, policy_version 1605144 (0.0008) [2023-12-28 06:46:10,529][106226] Updated weights for policy 0, policy_version 1601404 (0.0008) [2023-12-28 06:46:10,593][106226] Updated weights for policy 0, policy_version 1601414 (0.0005) [2023-12-28 06:46:10,660][106226] Updated weights for policy 0, policy_version 1601424 (0.0008) [2023-12-28 06:46:11,006][106225] Updated weights for policy 1, policy_version 1605154 (0.0008) [2023-12-28 06:46:11,073][106225] Updated weights for policy 1, policy_version 1605164 (0.0007) [2023-12-28 06:46:11,137][106225] Updated weights for policy 1, policy_version 1605174 (0.0009) [2023-12-28 06:46:11,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 821018624. Throughput: 0: 10111.3, 1: 10142.2. Samples: 820989612. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:11,176][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.651')] [2023-12-28 06:46:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001605176_410976256.pth... [2023-12-28 06:46:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001601432_410042368.pth... [2023-12-28 06:46:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001600280_409747456.pth [2023-12-28 06:46:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001603992_410673152.pth [2023-12-28 06:46:11,338][106226] Updated weights for policy 0, policy_version 1601434 (0.0010) [2023-12-28 06:46:11,410][106226] Updated weights for policy 0, policy_version 1601444 (0.0008) [2023-12-28 06:46:11,473][106226] Updated weights for policy 0, policy_version 1601454 (0.0006) [2023-12-28 06:46:11,538][106226] Updated weights for policy 0, policy_version 1601464 (0.0007) [2023-12-28 06:46:11,943][106225] Updated weights for policy 1, policy_version 1605184 (0.0009) [2023-12-28 06:46:12,007][106225] Updated weights for policy 1, policy_version 1605194 (0.0008) [2023-12-28 06:46:12,067][106225] Updated weights for policy 1, policy_version 1605204 (0.0009) [2023-12-28 06:46:12,243][106226] Updated weights for policy 0, policy_version 1601474 (0.0006) [2023-12-28 06:46:12,307][106226] Updated weights for policy 0, policy_version 1601484 (0.0008) [2023-12-28 06:46:12,378][106226] Updated weights for policy 0, policy_version 1601494 (0.0008) [2023-12-28 06:46:12,773][106225] Updated weights for policy 1, policy_version 1605214 (0.0008) [2023-12-28 06:46:12,835][106225] Updated weights for policy 1, policy_version 1605224 (0.0009) [2023-12-28 06:46:12,899][106225] Updated weights for policy 1, policy_version 1605234 (0.0007) [2023-12-28 06:46:13,114][106226] Updated weights for policy 0, policy_version 1601504 (0.0010) [2023-12-28 06:46:13,168][106226] Updated weights for policy 0, policy_version 1601514 (0.0008) [2023-12-28 06:46:13,223][106226] Updated weights for policy 0, policy_version 1601524 (0.0010) [2023-12-28 06:46:13,627][106225] Updated weights for policy 1, policy_version 1605245 (0.0007) [2023-12-28 06:46:13,676][106225] Updated weights for policy 1, policy_version 1605255 (0.0009) [2023-12-28 06:46:13,724][106225] Updated weights for policy 1, policy_version 1605265 (0.0008) [2023-12-28 06:46:13,796][106226] Updated weights for policy 0, policy_version 1601534 (0.0008) [2023-12-28 06:46:13,856][106226] Updated weights for policy 0, policy_version 1601544 (0.0009) [2023-12-28 06:46:13,911][106226] Updated weights for policy 0, policy_version 1601554 (0.0006) [2023-12-28 06:46:14,503][106225] Updated weights for policy 1, policy_version 1605275 (0.0008) [2023-12-28 06:46:14,557][106225] Updated weights for policy 1, policy_version 1605285 (0.0008) [2023-12-28 06:46:14,594][106226] Updated weights for policy 0, policy_version 1601564 (0.0006) [2023-12-28 06:46:14,618][106225] Updated weights for policy 1, policy_version 1605295 (0.0007) [2023-12-28 06:46:14,670][106226] Updated weights for policy 0, policy_version 1601574 (0.0008) [2023-12-28 06:46:14,732][106226] Updated weights for policy 0, policy_version 1601584 (0.0008) [2023-12-28 06:46:15,371][106225] Updated weights for policy 1, policy_version 1605305 (0.0008) [2023-12-28 06:46:15,432][106225] Updated weights for policy 1, policy_version 1605315 (0.0008) [2023-12-28 06:46:15,433][106226] Updated weights for policy 0, policy_version 1601594 (0.0008) [2023-12-28 06:46:15,475][106225] Updated weights for policy 1, policy_version 1605325 (0.0005) [2023-12-28 06:46:15,488][106226] Updated weights for policy 0, policy_version 1601604 (0.0008) [2023-12-28 06:46:15,522][106225] Updated weights for policy 1, policy_version 1605335 (0.0006) [2023-12-28 06:46:15,546][106226] Updated weights for policy 0, policy_version 1601614 (0.0007) [2023-12-28 06:46:15,604][106226] Updated weights for policy 0, policy_version 1601624 (0.0008) [2023-12-28 06:46:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 821108736. Throughput: 0: 10022.7, 1: 10027.0. Samples: 821102728. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:16,175][105115] Avg episode reward: [(0, '-4.744'), (1, '-4.632')] [2023-12-28 06:46:16,218][106225] Updated weights for policy 1, policy_version 1605345 (0.0008) [2023-12-28 06:46:16,270][106225] Updated weights for policy 1, policy_version 1605355 (0.0008) [2023-12-28 06:46:16,318][106225] Updated weights for policy 1, policy_version 1605365 (0.0006) [2023-12-28 06:46:16,337][106226] Updated weights for policy 0, policy_version 1601634 (0.0006) [2023-12-28 06:46:16,399][106226] Updated weights for policy 0, policy_version 1601644 (0.0009) [2023-12-28 06:46:16,465][106226] Updated weights for policy 0, policy_version 1601654 (0.0009) [2023-12-28 06:46:17,077][106225] Updated weights for policy 1, policy_version 1605375 (0.0008) [2023-12-28 06:46:17,133][106225] Updated weights for policy 1, policy_version 1605385 (0.0007) [2023-12-28 06:46:17,142][106226] Updated weights for policy 0, policy_version 1601664 (0.0007) [2023-12-28 06:46:17,182][106225] Updated weights for policy 1, policy_version 1605395 (0.0006) [2023-12-28 06:46:17,199][106226] Updated weights for policy 0, policy_version 1601674 (0.0006) [2023-12-28 06:46:17,247][106226] Updated weights for policy 0, policy_version 1601684 (0.0008) [2023-12-28 06:46:17,841][106225] Updated weights for policy 1, policy_version 1605405 (0.0007) [2023-12-28 06:46:17,899][106225] Updated weights for policy 1, policy_version 1605415 (0.0009) [2023-12-28 06:46:17,957][106225] Updated weights for policy 1, policy_version 1605425 (0.0008) [2023-12-28 06:46:17,962][106226] Updated weights for policy 0, policy_version 1601694 (0.0008) [2023-12-28 06:46:18,014][106226] Updated weights for policy 0, policy_version 1601704 (0.0010) [2023-12-28 06:46:18,062][106226] Updated weights for policy 0, policy_version 1601714 (0.0011) [2023-12-28 06:46:18,681][106225] Updated weights for policy 1, policy_version 1605435 (0.0009) [2023-12-28 06:46:18,741][106225] Updated weights for policy 1, policy_version 1605445 (0.0007) [2023-12-28 06:46:18,774][106226] Updated weights for policy 0, policy_version 1601724 (0.0011) [2023-12-28 06:46:18,807][106225] Updated weights for policy 1, policy_version 1605455 (0.0006) [2023-12-28 06:46:18,835][106226] Updated weights for policy 0, policy_version 1601734 (0.0010) [2023-12-28 06:46:18,893][106226] Updated weights for policy 0, policy_version 1601744 (0.0011) [2023-12-28 06:46:19,553][106225] Updated weights for policy 1, policy_version 1605465 (0.0006) [2023-12-28 06:46:19,594][106226] Updated weights for policy 0, policy_version 1601754 (0.0011) [2023-12-28 06:46:19,616][106225] Updated weights for policy 1, policy_version 1605475 (0.0007) [2023-12-28 06:46:19,663][106226] Updated weights for policy 0, policy_version 1601764 (0.0011) [2023-12-28 06:46:19,677][106225] Updated weights for policy 1, policy_version 1605485 (0.0008) [2023-12-28 06:46:19,740][106225] Updated weights for policy 1, policy_version 1605495 (0.0009) [2023-12-28 06:46:19,751][106226] Updated weights for policy 0, policy_version 1601774 (0.0011) [2023-12-28 06:46:19,819][106226] Updated weights for policy 0, policy_version 1601784 (0.0012) [2023-12-28 06:46:20,511][106225] Updated weights for policy 1, policy_version 1605505 (0.0006) [2023-12-28 06:46:20,530][106226] Updated weights for policy 0, policy_version 1601794 (0.0011) [2023-12-28 06:46:20,570][106225] Updated weights for policy 1, policy_version 1605515 (0.0008) [2023-12-28 06:46:20,597][106226] Updated weights for policy 0, policy_version 1601804 (0.0009) [2023-12-28 06:46:20,629][106225] Updated weights for policy 1, policy_version 1605525 (0.0006) [2023-12-28 06:46:20,656][106226] Updated weights for policy 0, policy_version 1601814 (0.0010) [2023-12-28 06:46:21,175][105115] Fps is (10 sec: 18842.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 821207040. Throughput: 0: 9924.0, 1: 9906.1. Samples: 821217692. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:21,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.582')] [2023-12-28 06:46:21,342][106225] Updated weights for policy 1, policy_version 1605535 (0.0008) [2023-12-28 06:46:21,369][106226] Updated weights for policy 0, policy_version 1601824 (0.0009) [2023-12-28 06:46:21,413][106225] Updated weights for policy 1, policy_version 1605545 (0.0007) [2023-12-28 06:46:21,435][106226] Updated weights for policy 0, policy_version 1601834 (0.0010) [2023-12-28 06:46:21,476][106225] Updated weights for policy 1, policy_version 1605555 (0.0006) [2023-12-28 06:46:21,505][106226] Updated weights for policy 0, policy_version 1601844 (0.0011) [2023-12-28 06:46:22,189][106226] Updated weights for policy 0, policy_version 1601854 (0.0008) [2023-12-28 06:46:22,200][106225] Updated weights for policy 1, policy_version 1605565 (0.0006) [2023-12-28 06:46:22,245][106226] Updated weights for policy 0, policy_version 1601864 (0.0008) [2023-12-28 06:46:22,255][106225] Updated weights for policy 1, policy_version 1605575 (0.0006) [2023-12-28 06:46:22,310][106226] Updated weights for policy 0, policy_version 1601874 (0.0008) [2023-12-28 06:46:22,315][106225] Updated weights for policy 1, policy_version 1605585 (0.0006) [2023-12-28 06:46:22,990][106226] Updated weights for policy 0, policy_version 1601884 (0.0008) [2023-12-28 06:46:23,035][106225] Updated weights for policy 1, policy_version 1605595 (0.0008) [2023-12-28 06:46:23,045][106226] Updated weights for policy 0, policy_version 1601894 (0.0008) [2023-12-28 06:46:23,096][106226] Updated weights for policy 0, policy_version 1601904 (0.0009) [2023-12-28 06:46:23,100][106225] Updated weights for policy 1, policy_version 1605605 (0.0005) [2023-12-28 06:46:23,152][106225] Updated weights for policy 1, policy_version 1605615 (0.0005) [2023-12-28 06:46:23,752][106225] Updated weights for policy 1, policy_version 1605625 (0.0008) [2023-12-28 06:46:23,799][106225] Updated weights for policy 1, policy_version 1605635 (0.0008) [2023-12-28 06:46:23,854][106225] Updated weights for policy 1, policy_version 1605645 (0.0008) [2023-12-28 06:46:23,881][106226] Updated weights for policy 0, policy_version 1601914 (0.0007) [2023-12-28 06:46:23,913][106225] Updated weights for policy 1, policy_version 1605655 (0.0008) [2023-12-28 06:46:23,942][106226] Updated weights for policy 0, policy_version 1601924 (0.0008) [2023-12-28 06:46:24,008][106226] Updated weights for policy 0, policy_version 1601934 (0.0009) [2023-12-28 06:46:24,068][106226] Updated weights for policy 0, policy_version 1601944 (0.0008) [2023-12-28 06:46:24,675][106225] Updated weights for policy 1, policy_version 1605665 (0.0008) [2023-12-28 06:46:24,729][106226] Updated weights for policy 0, policy_version 1601954 (0.0008) [2023-12-28 06:46:24,733][106225] Updated weights for policy 1, policy_version 1605675 (0.0006) [2023-12-28 06:46:24,785][106226] Updated weights for policy 0, policy_version 1601964 (0.0011) [2023-12-28 06:46:24,788][106225] Updated weights for policy 1, policy_version 1605685 (0.0005) [2023-12-28 06:46:24,842][106226] Updated weights for policy 0, policy_version 1601974 (0.0010) [2023-12-28 06:46:25,429][106225] Updated weights for policy 1, policy_version 1605695 (0.0007) [2023-12-28 06:46:25,435][106226] Updated weights for policy 0, policy_version 1601984 (0.0006) [2023-12-28 06:46:25,489][106225] Updated weights for policy 1, policy_version 1605705 (0.0008) [2023-12-28 06:46:25,494][106226] Updated weights for policy 0, policy_version 1601994 (0.0006) [2023-12-28 06:46:25,550][106225] Updated weights for policy 1, policy_version 1605715 (0.0009) [2023-12-28 06:46:25,556][106226] Updated weights for policy 0, policy_version 1602004 (0.0007) [2023-12-28 06:46:26,153][106225] Updated weights for policy 1, policy_version 1605725 (0.0007) [2023-12-28 06:46:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 821305344. Throughput: 0: 9870.8, 1: 9901.8. Samples: 821276520. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:26,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.585')] [2023-12-28 06:46:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001602008_410189824.pth... [2023-12-28 06:46:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001600856_409894912.pth [2023-12-28 06:46:26,212][106225] Updated weights for policy 1, policy_version 1605735 (0.0006) [2023-12-28 06:46:26,271][106226] Updated weights for policy 0, policy_version 1602014 (0.0009) [2023-12-28 06:46:26,272][106225] Updated weights for policy 1, policy_version 1605745 (0.0009) [2023-12-28 06:46:26,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001605752_411123712.pth... [2023-12-28 06:46:26,311][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001604568_410820608.pth [2023-12-28 06:46:26,335][106226] Updated weights for policy 0, policy_version 1602024 (0.0011) [2023-12-28 06:46:26,403][106226] Updated weights for policy 0, policy_version 1602034 (0.0011) [2023-12-28 06:46:26,921][106225] Updated weights for policy 1, policy_version 1605755 (0.0007) [2023-12-28 06:46:26,967][106225] Updated weights for policy 1, policy_version 1605765 (0.0007) [2023-12-28 06:46:27,009][106226] Updated weights for policy 0, policy_version 1602044 (0.0011) [2023-12-28 06:46:27,015][106225] Updated weights for policy 1, policy_version 1605775 (0.0007) [2023-12-28 06:46:27,066][106226] Updated weights for policy 0, policy_version 1602054 (0.0010) [2023-12-28 06:46:27,125][106226] Updated weights for policy 0, policy_version 1602064 (0.0010) [2023-12-28 06:46:27,726][106225] Updated weights for policy 1, policy_version 1605785 (0.0006) [2023-12-28 06:46:27,784][106225] Updated weights for policy 1, policy_version 1605795 (0.0006) [2023-12-28 06:46:27,831][106225] Updated weights for policy 1, policy_version 1605805 (0.0005) [2023-12-28 06:46:27,835][106226] Updated weights for policy 0, policy_version 1602074 (0.0010) [2023-12-28 06:46:27,883][106225] Updated weights for policy 1, policy_version 1605815 (0.0006) [2023-12-28 06:46:27,884][106226] Updated weights for policy 0, policy_version 1602084 (0.0010) [2023-12-28 06:46:27,940][106226] Updated weights for policy 0, policy_version 1602094 (0.0009) [2023-12-28 06:46:28,002][106226] Updated weights for policy 0, policy_version 1602104 (0.0005) [2023-12-28 06:46:28,614][106225] Updated weights for policy 1, policy_version 1605825 (0.0008) [2023-12-28 06:46:28,659][106226] Updated weights for policy 0, policy_version 1602114 (0.0005) [2023-12-28 06:46:28,679][106225] Updated weights for policy 1, policy_version 1605835 (0.0008) [2023-12-28 06:46:28,711][106226] Updated weights for policy 0, policy_version 1602124 (0.0007) [2023-12-28 06:46:28,734][106225] Updated weights for policy 1, policy_version 1605845 (0.0007) [2023-12-28 06:46:28,770][106226] Updated weights for policy 0, policy_version 1602134 (0.0010) [2023-12-28 06:46:29,470][106225] Updated weights for policy 1, policy_version 1605855 (0.0007) [2023-12-28 06:46:29,506][106226] Updated weights for policy 0, policy_version 1602144 (0.0011) [2023-12-28 06:46:29,526][106225] Updated weights for policy 1, policy_version 1605865 (0.0006) [2023-12-28 06:46:29,565][106226] Updated weights for policy 0, policy_version 1602154 (0.0011) [2023-12-28 06:46:29,588][106225] Updated weights for policy 1, policy_version 1605875 (0.0009) [2023-12-28 06:46:29,630][106226] Updated weights for policy 0, policy_version 1602164 (0.0011) [2023-12-28 06:46:30,276][106225] Updated weights for policy 1, policy_version 1605885 (0.0005) [2023-12-28 06:46:30,325][106226] Updated weights for policy 0, policy_version 1602174 (0.0009) [2023-12-28 06:46:30,339][106225] Updated weights for policy 1, policy_version 1605895 (0.0006) [2023-12-28 06:46:30,388][106226] Updated weights for policy 0, policy_version 1602184 (0.0008) [2023-12-28 06:46:30,395][106225] Updated weights for policy 1, policy_version 1605905 (0.0006) [2023-12-28 06:46:30,449][106226] Updated weights for policy 0, policy_version 1602194 (0.0006) [2023-12-28 06:46:30,940][106225] Updated weights for policy 1, policy_version 1605915 (0.0006) [2023-12-28 06:46:30,994][106225] Updated weights for policy 1, policy_version 1605925 (0.0005) [2023-12-28 06:46:31,058][106225] Updated weights for policy 1, policy_version 1605935 (0.0007) [2023-12-28 06:46:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 821411840. Throughput: 0: 9988.0, 1: 10004.9. Samples: 821398824. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:31,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.691')] [2023-12-28 06:46:31,257][106226] Updated weights for policy 0, policy_version 1602204 (0.0009) [2023-12-28 06:46:31,318][106226] Updated weights for policy 0, policy_version 1602214 (0.0007) [2023-12-28 06:46:31,385][106226] Updated weights for policy 0, policy_version 1602224 (0.0009) [2023-12-28 06:46:31,733][106225] Updated weights for policy 1, policy_version 1605945 (0.0009) [2023-12-28 06:46:31,786][106225] Updated weights for policy 1, policy_version 1605955 (0.0008) [2023-12-28 06:46:31,840][106225] Updated weights for policy 1, policy_version 1605965 (0.0008) [2023-12-28 06:46:31,894][106225] Updated weights for policy 1, policy_version 1605975 (0.0008) [2023-12-28 06:46:32,117][106226] Updated weights for policy 0, policy_version 1602234 (0.0008) [2023-12-28 06:46:32,173][106226] Updated weights for policy 0, policy_version 1602244 (0.0011) [2023-12-28 06:46:32,225][106226] Updated weights for policy 0, policy_version 1602254 (0.0007) [2023-12-28 06:46:32,291][106226] Updated weights for policy 0, policy_version 1602264 (0.0007) [2023-12-28 06:46:32,639][106225] Updated weights for policy 1, policy_version 1605985 (0.0006) [2023-12-28 06:46:32,708][106225] Updated weights for policy 1, policy_version 1605995 (0.0006) [2023-12-28 06:46:32,769][106225] Updated weights for policy 1, policy_version 1606005 (0.0008) [2023-12-28 06:46:32,947][106226] Updated weights for policy 0, policy_version 1602274 (0.0005) [2023-12-28 06:46:33,007][106226] Updated weights for policy 0, policy_version 1602284 (0.0006) [2023-12-28 06:46:33,063][106226] Updated weights for policy 0, policy_version 1602294 (0.0010) [2023-12-28 06:46:33,445][106225] Updated weights for policy 1, policy_version 1606015 (0.0008) [2023-12-28 06:46:33,498][106225] Updated weights for policy 1, policy_version 1606025 (0.0008) [2023-12-28 06:46:33,556][106225] Updated weights for policy 1, policy_version 1606035 (0.0008) [2023-12-28 06:46:33,746][106226] Updated weights for policy 0, policy_version 1602304 (0.0011) [2023-12-28 06:46:33,811][106226] Updated weights for policy 0, policy_version 1602314 (0.0010) [2023-12-28 06:46:33,858][106226] Updated weights for policy 0, policy_version 1602324 (0.0010) [2023-12-28 06:46:34,223][106225] Updated weights for policy 1, policy_version 1606045 (0.0007) [2023-12-28 06:46:34,284][106225] Updated weights for policy 1, policy_version 1606055 (0.0007) [2023-12-28 06:46:34,346][106225] Updated weights for policy 1, policy_version 1606065 (0.0008) [2023-12-28 06:46:34,556][106226] Updated weights for policy 0, policy_version 1602334 (0.0011) [2023-12-28 06:46:34,621][106226] Updated weights for policy 0, policy_version 1602344 (0.0011) [2023-12-28 06:46:34,682][106226] Updated weights for policy 0, policy_version 1602354 (0.0011) [2023-12-28 06:46:35,008][106225] Updated weights for policy 1, policy_version 1606075 (0.0008) [2023-12-28 06:46:35,065][106225] Updated weights for policy 1, policy_version 1606085 (0.0008) [2023-12-28 06:46:35,122][106225] Updated weights for policy 1, policy_version 1606095 (0.0008) [2023-12-28 06:46:35,378][106226] Updated weights for policy 0, policy_version 1602364 (0.0011) [2023-12-28 06:46:35,426][106226] Updated weights for policy 0, policy_version 1602374 (0.0007) [2023-12-28 06:46:35,473][106226] Updated weights for policy 0, policy_version 1602384 (0.0010) [2023-12-28 06:46:35,798][106225] Updated weights for policy 1, policy_version 1606105 (0.0008) [2023-12-28 06:46:35,855][106225] Updated weights for policy 1, policy_version 1606115 (0.0008) [2023-12-28 06:46:35,916][106225] Updated weights for policy 1, policy_version 1606125 (0.0006) [2023-12-28 06:46:35,976][106225] Updated weights for policy 1, policy_version 1606135 (0.0006) [2023-12-28 06:46:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 821510144. Throughput: 0: 9930.7, 1: 9963.4. Samples: 821519880. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:36,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.870')] [2023-12-28 06:46:36,201][106226] Updated weights for policy 0, policy_version 1602394 (0.0010) [2023-12-28 06:46:36,265][106226] Updated weights for policy 0, policy_version 1602404 (0.0008) [2023-12-28 06:46:36,325][106226] Updated weights for policy 0, policy_version 1602414 (0.0008) [2023-12-28 06:46:36,386][106226] Updated weights for policy 0, policy_version 1602424 (0.0008) [2023-12-28 06:46:36,634][106225] Updated weights for policy 1, policy_version 1606145 (0.0008) [2023-12-28 06:46:36,686][106225] Updated weights for policy 1, policy_version 1606155 (0.0008) [2023-12-28 06:46:36,744][106225] Updated weights for policy 1, policy_version 1606165 (0.0008) [2023-12-28 06:46:37,111][106226] Updated weights for policy 0, policy_version 1602434 (0.0011) [2023-12-28 06:46:37,165][106226] Updated weights for policy 0, policy_version 1602444 (0.0011) [2023-12-28 06:46:37,219][106226] Updated weights for policy 0, policy_version 1602454 (0.0010) [2023-12-28 06:46:37,536][106225] Updated weights for policy 1, policy_version 1606175 (0.0009) [2023-12-28 06:46:37,598][106225] Updated weights for policy 1, policy_version 1606185 (0.0008) [2023-12-28 06:46:37,656][106225] Updated weights for policy 1, policy_version 1606195 (0.0009) [2023-12-28 06:46:37,788][106226] Updated weights for policy 0, policy_version 1602464 (0.0009) [2023-12-28 06:46:37,840][106226] Updated weights for policy 0, policy_version 1602474 (0.0010) [2023-12-28 06:46:37,893][106226] Updated weights for policy 0, policy_version 1602484 (0.0010) [2023-12-28 06:46:38,326][106225] Updated weights for policy 1, policy_version 1606205 (0.0009) [2023-12-28 06:46:38,385][106225] Updated weights for policy 1, policy_version 1606215 (0.0008) [2023-12-28 06:46:38,443][106225] Updated weights for policy 1, policy_version 1606225 (0.0007) [2023-12-28 06:46:38,637][106226] Updated weights for policy 0, policy_version 1602494 (0.0011) [2023-12-28 06:46:38,687][106226] Updated weights for policy 0, policy_version 1602504 (0.0010) [2023-12-28 06:46:38,749][106226] Updated weights for policy 0, policy_version 1602514 (0.0011) [2023-12-28 06:46:39,102][106225] Updated weights for policy 1, policy_version 1606235 (0.0007) [2023-12-28 06:46:39,165][106225] Updated weights for policy 1, policy_version 1606245 (0.0005) [2023-12-28 06:46:39,223][106225] Updated weights for policy 1, policy_version 1606255 (0.0007) [2023-12-28 06:46:39,505][106226] Updated weights for policy 0, policy_version 1602524 (0.0009) [2023-12-28 06:46:39,570][106226] Updated weights for policy 0, policy_version 1602534 (0.0011) [2023-12-28 06:46:39,635][106226] Updated weights for policy 0, policy_version 1602544 (0.0011) [2023-12-28 06:46:40,050][106225] Updated weights for policy 1, policy_version 1606265 (0.0009) [2023-12-28 06:46:40,116][106225] Updated weights for policy 1, policy_version 1606275 (0.0008) [2023-12-28 06:46:40,185][106225] Updated weights for policy 1, policy_version 1606285 (0.0007) [2023-12-28 06:46:40,247][106225] Updated weights for policy 1, policy_version 1606295 (0.0006) [2023-12-28 06:46:40,399][106226] Updated weights for policy 0, policy_version 1602554 (0.0011) [2023-12-28 06:46:40,460][106226] Updated weights for policy 0, policy_version 1602564 (0.0009) [2023-12-28 06:46:40,529][106226] Updated weights for policy 0, policy_version 1602574 (0.0009) [2023-12-28 06:46:40,591][106226] Updated weights for policy 0, policy_version 1602584 (0.0009) [2023-12-28 06:46:40,938][106225] Updated weights for policy 1, policy_version 1606305 (0.0008) [2023-12-28 06:46:40,988][106225] Updated weights for policy 1, policy_version 1606315 (0.0009) [2023-12-28 06:46:41,057][106225] Updated weights for policy 1, policy_version 1606325 (0.0007) [2023-12-28 06:46:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 821608448. Throughput: 0: 9930.6, 1: 9947.1. Samples: 821579136. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:41,175][105115] Avg episode reward: [(0, '-4.714'), (1, '-4.667')] [2023-12-28 06:46:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001606328_411271168.pth... [2023-12-28 06:46:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001602584_410337280.pth... [2023-12-28 06:46:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001605176_410976256.pth [2023-12-28 06:46:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001601432_410042368.pth [2023-12-28 06:46:41,314][106226] Updated weights for policy 0, policy_version 1602594 (0.0008) [2023-12-28 06:46:41,381][106226] Updated weights for policy 0, policy_version 1602604 (0.0008) [2023-12-28 06:46:41,438][106226] Updated weights for policy 0, policy_version 1602614 (0.0008) [2023-12-28 06:46:41,930][106225] Updated weights for policy 1, policy_version 1606335 (0.0008) [2023-12-28 06:46:41,993][106225] Updated weights for policy 1, policy_version 1606345 (0.0008) [2023-12-28 06:46:42,052][106225] Updated weights for policy 1, policy_version 1606355 (0.0008) [2023-12-28 06:46:42,203][106226] Updated weights for policy 0, policy_version 1602624 (0.0008) [2023-12-28 06:46:42,263][106226] Updated weights for policy 0, policy_version 1602634 (0.0009) [2023-12-28 06:46:42,331][106226] Updated weights for policy 0, policy_version 1602644 (0.0008) [2023-12-28 06:46:42,809][106225] Updated weights for policy 1, policy_version 1606365 (0.0008) [2023-12-28 06:46:42,876][106225] Updated weights for policy 1, policy_version 1606375 (0.0009) [2023-12-28 06:46:42,936][106225] Updated weights for policy 1, policy_version 1606385 (0.0008) [2023-12-28 06:46:43,112][106226] Updated weights for policy 0, policy_version 1602654 (0.0008) [2023-12-28 06:46:43,170][106226] Updated weights for policy 0, policy_version 1602664 (0.0009) [2023-12-28 06:46:43,231][106226] Updated weights for policy 0, policy_version 1602674 (0.0007) [2023-12-28 06:46:43,675][106225] Updated weights for policy 1, policy_version 1606395 (0.0008) [2023-12-28 06:46:43,727][106225] Updated weights for policy 1, policy_version 1606405 (0.0009) [2023-12-28 06:46:43,777][106225] Updated weights for policy 1, policy_version 1606415 (0.0009) [2023-12-28 06:46:43,891][106226] Updated weights for policy 0, policy_version 1602684 (0.0007) [2023-12-28 06:46:43,949][106226] Updated weights for policy 0, policy_version 1602694 (0.0008) [2023-12-28 06:46:44,011][106226] Updated weights for policy 0, policy_version 1602704 (0.0008) [2023-12-28 06:46:44,479][106225] Updated weights for policy 1, policy_version 1606425 (0.0008) [2023-12-28 06:46:44,532][106225] Updated weights for policy 1, policy_version 1606435 (0.0008) [2023-12-28 06:46:44,579][106225] Updated weights for policy 1, policy_version 1606445 (0.0010) [2023-12-28 06:46:44,625][106225] Updated weights for policy 1, policy_version 1606455 (0.0006) [2023-12-28 06:46:44,784][106226] Updated weights for policy 0, policy_version 1602714 (0.0008) [2023-12-28 06:46:44,847][106226] Updated weights for policy 0, policy_version 1602724 (0.0009) [2023-12-28 06:46:44,912][106226] Updated weights for policy 0, policy_version 1602734 (0.0008) [2023-12-28 06:46:44,968][106226] Updated weights for policy 0, policy_version 1602744 (0.0010) [2023-12-28 06:46:45,343][106225] Updated weights for policy 1, policy_version 1606465 (0.0008) [2023-12-28 06:46:45,397][106225] Updated weights for policy 1, policy_version 1606475 (0.0008) [2023-12-28 06:46:45,447][106225] Updated weights for policy 1, policy_version 1606485 (0.0008) [2023-12-28 06:46:45,692][106226] Updated weights for policy 0, policy_version 1602754 (0.0010) [2023-12-28 06:46:45,742][106226] Updated weights for policy 0, policy_version 1602764 (0.0010) [2023-12-28 06:46:45,792][106226] Updated weights for policy 0, policy_version 1602774 (0.0010) [2023-12-28 06:46:46,162][106225] Updated weights for policy 1, policy_version 1606495 (0.0008) [2023-12-28 06:46:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 821698560. Throughput: 0: 9842.8, 1: 9866.2. Samples: 821691584. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:46,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-5.018')] [2023-12-28 06:46:46,210][106225] Updated weights for policy 1, policy_version 1606505 (0.0008) [2023-12-28 06:46:46,258][106225] Updated weights for policy 1, policy_version 1606515 (0.0008) [2023-12-28 06:46:46,477][106226] Updated weights for policy 0, policy_version 1602784 (0.0010) [2023-12-28 06:46:46,533][106226] Updated weights for policy 0, policy_version 1602794 (0.0010) [2023-12-28 06:46:46,589][106226] Updated weights for policy 0, policy_version 1602804 (0.0011) [2023-12-28 06:46:47,030][106225] Updated weights for policy 1, policy_version 1606526 (0.0007) [2023-12-28 06:46:47,076][106225] Updated weights for policy 1, policy_version 1606536 (0.0006) [2023-12-28 06:46:47,123][106225] Updated weights for policy 1, policy_version 1606546 (0.0010) [2023-12-28 06:46:47,298][106226] Updated weights for policy 0, policy_version 1602814 (0.0010) [2023-12-28 06:46:47,347][106226] Updated weights for policy 0, policy_version 1602824 (0.0008) [2023-12-28 06:46:47,391][106226] Updated weights for policy 0, policy_version 1602834 (0.0005) [2023-12-28 06:46:47,736][106225] Updated weights for policy 1, policy_version 1606556 (0.0010) [2023-12-28 06:46:47,786][106225] Updated weights for policy 1, policy_version 1606566 (0.0010) [2023-12-28 06:46:47,833][106225] Updated weights for policy 1, policy_version 1606576 (0.0010) [2023-12-28 06:46:48,111][106226] Updated weights for policy 0, policy_version 1602844 (0.0006) [2023-12-28 06:46:48,183][106226] Updated weights for policy 0, policy_version 1602854 (0.0005) [2023-12-28 06:46:48,239][106226] Updated weights for policy 0, policy_version 1602864 (0.0006) [2023-12-28 06:46:48,490][106225] Updated weights for policy 1, policy_version 1606586 (0.0009) [2023-12-28 06:46:48,560][106225] Updated weights for policy 1, policy_version 1606596 (0.0007) [2023-12-28 06:46:48,624][106225] Updated weights for policy 1, policy_version 1606606 (0.0008) [2023-12-28 06:46:48,688][106225] Updated weights for policy 1, policy_version 1606616 (0.0009) [2023-12-28 06:46:48,877][106226] Updated weights for policy 0, policy_version 1602874 (0.0006) [2023-12-28 06:46:48,949][106226] Updated weights for policy 0, policy_version 1602884 (0.0007) [2023-12-28 06:46:49,005][106226] Updated weights for policy 0, policy_version 1602894 (0.0008) [2023-12-28 06:46:49,060][106226] Updated weights for policy 0, policy_version 1602904 (0.0008) [2023-12-28 06:46:49,404][106225] Updated weights for policy 1, policy_version 1606626 (0.0010) [2023-12-28 06:46:49,463][106225] Updated weights for policy 1, policy_version 1606636 (0.0006) [2023-12-28 06:46:49,527][106225] Updated weights for policy 1, policy_version 1606646 (0.0006) [2023-12-28 06:46:49,781][106226] Updated weights for policy 0, policy_version 1602914 (0.0008) [2023-12-28 06:46:49,845][106226] Updated weights for policy 0, policy_version 1602924 (0.0009) [2023-12-28 06:46:49,908][106226] Updated weights for policy 0, policy_version 1602934 (0.0009) [2023-12-28 06:46:50,180][106225] Updated weights for policy 1, policy_version 1606656 (0.0007) [2023-12-28 06:46:50,245][106225] Updated weights for policy 1, policy_version 1606666 (0.0006) [2023-12-28 06:46:50,308][106225] Updated weights for policy 1, policy_version 1606676 (0.0005) [2023-12-28 06:46:50,629][106226] Updated weights for policy 0, policy_version 1602944 (0.0008) [2023-12-28 06:46:50,694][106226] Updated weights for policy 0, policy_version 1602954 (0.0009) [2023-12-28 06:46:50,754][106226] Updated weights for policy 0, policy_version 1602964 (0.0008) [2023-12-28 06:46:50,935][106225] Updated weights for policy 1, policy_version 1606686 (0.0007) [2023-12-28 06:46:50,999][106225] Updated weights for policy 1, policy_version 1606696 (0.0006) [2023-12-28 06:46:51,066][106225] Updated weights for policy 1, policy_version 1606706 (0.0007) [2023-12-28 06:46:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 821805056. Throughput: 0: 9836.0, 1: 9841.7. Samples: 821812128. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:51,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.802')] [2023-12-28 06:46:51,442][106226] Updated weights for policy 0, policy_version 1602974 (0.0009) [2023-12-28 06:46:51,509][106226] Updated weights for policy 0, policy_version 1602984 (0.0009) [2023-12-28 06:46:51,569][106226] Updated weights for policy 0, policy_version 1602994 (0.0009) [2023-12-28 06:46:51,729][106225] Updated weights for policy 1, policy_version 1606716 (0.0008) [2023-12-28 06:46:51,797][106225] Updated weights for policy 1, policy_version 1606726 (0.0006) [2023-12-28 06:46:51,866][106225] Updated weights for policy 1, policy_version 1606736 (0.0008) [2023-12-28 06:46:52,298][106226] Updated weights for policy 0, policy_version 1603004 (0.0009) [2023-12-28 06:46:52,366][106226] Updated weights for policy 0, policy_version 1603014 (0.0008) [2023-12-28 06:46:52,429][106226] Updated weights for policy 0, policy_version 1603024 (0.0011) [2023-12-28 06:46:52,549][106225] Updated weights for policy 1, policy_version 1606746 (0.0007) [2023-12-28 06:46:52,609][106225] Updated weights for policy 1, policy_version 1606756 (0.0008) [2023-12-28 06:46:52,667][106225] Updated weights for policy 1, policy_version 1606766 (0.0008) [2023-12-28 06:46:52,721][106225] Updated weights for policy 1, policy_version 1606776 (0.0007) [2023-12-28 06:46:53,130][106226] Updated weights for policy 0, policy_version 1603034 (0.0010) [2023-12-28 06:46:53,190][106226] Updated weights for policy 0, policy_version 1603044 (0.0010) [2023-12-28 06:46:53,245][106226] Updated weights for policy 0, policy_version 1603054 (0.0010) [2023-12-28 06:46:53,301][106226] Updated weights for policy 0, policy_version 1603064 (0.0010) [2023-12-28 06:46:53,381][106225] Updated weights for policy 1, policy_version 1606786 (0.0008) [2023-12-28 06:46:53,428][106225] Updated weights for policy 1, policy_version 1606796 (0.0007) [2023-12-28 06:46:53,483][106225] Updated weights for policy 1, policy_version 1606806 (0.0008) [2023-12-28 06:46:53,894][106226] Updated weights for policy 0, policy_version 1603074 (0.0005) [2023-12-28 06:46:53,958][106226] Updated weights for policy 0, policy_version 1603084 (0.0005) [2023-12-28 06:46:54,024][106226] Updated weights for policy 0, policy_version 1603094 (0.0005) [2023-12-28 06:46:54,102][106225] Updated weights for policy 1, policy_version 1606816 (0.0006) [2023-12-28 06:46:54,165][106225] Updated weights for policy 1, policy_version 1606826 (0.0006) [2023-12-28 06:46:54,232][106225] Updated weights for policy 1, policy_version 1606836 (0.0006) [2023-12-28 06:46:54,532][106226] Updated weights for policy 0, policy_version 1603104 (0.0005) [2023-12-28 06:46:54,584][106226] Updated weights for policy 0, policy_version 1603114 (0.0006) [2023-12-28 06:46:54,632][106226] Updated weights for policy 0, policy_version 1603124 (0.0005) [2023-12-28 06:46:54,821][106225] Updated weights for policy 1, policy_version 1606846 (0.0010) [2023-12-28 06:46:54,886][106225] Updated weights for policy 1, policy_version 1606856 (0.0010) [2023-12-28 06:46:54,935][106225] Updated weights for policy 1, policy_version 1606866 (0.0010) [2023-12-28 06:46:55,199][106226] Updated weights for policy 0, policy_version 1603134 (0.0007) [2023-12-28 06:46:55,252][106226] Updated weights for policy 0, policy_version 1603144 (0.0007) [2023-12-28 06:46:55,303][106226] Updated weights for policy 0, policy_version 1603154 (0.0008) [2023-12-28 06:46:55,605][106225] Updated weights for policy 1, policy_version 1606876 (0.0010) [2023-12-28 06:46:55,674][106225] Updated weights for policy 1, policy_version 1606886 (0.0010) [2023-12-28 06:46:55,723][106225] Updated weights for policy 1, policy_version 1606896 (0.0010) [2023-12-28 06:46:55,885][106226] Updated weights for policy 0, policy_version 1603164 (0.0006) [2023-12-28 06:46:55,933][106226] Updated weights for policy 0, policy_version 1603174 (0.0005) [2023-12-28 06:46:55,976][106226] Updated weights for policy 0, policy_version 1603184 (0.0005) [2023-12-28 06:46:56,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 821911552. Throughput: 0: 9813.0, 1: 9818.4. Samples: 821873016. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:46:56,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.792')] [2023-12-28 06:46:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001606904_411418624.pth... [2023-12-28 06:46:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001603192_410492928.pth... [2023-12-28 06:46:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001605752_411123712.pth [2023-12-28 06:46:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001602008_410189824.pth [2023-12-28 06:46:56,426][106225] Updated weights for policy 1, policy_version 1606906 (0.0010) [2023-12-28 06:46:56,476][106225] Updated weights for policy 1, policy_version 1606916 (0.0010) [2023-12-28 06:46:56,518][106225] Updated weights for policy 1, policy_version 1606926 (0.0010) [2023-12-28 06:46:56,563][106225] Updated weights for policy 1, policy_version 1606936 (0.0010) [2023-12-28 06:46:56,587][106226] Updated weights for policy 0, policy_version 1603194 (0.0006) [2023-12-28 06:46:56,632][106226] Updated weights for policy 0, policy_version 1603204 (0.0010) [2023-12-28 06:46:56,684][106226] Updated weights for policy 0, policy_version 1603214 (0.0010) [2023-12-28 06:46:56,730][106226] Updated weights for policy 0, policy_version 1603224 (0.0010) [2023-12-28 06:46:57,302][106225] Updated weights for policy 1, policy_version 1606946 (0.0010) [2023-12-28 06:46:57,365][106225] Updated weights for policy 1, policy_version 1606956 (0.0009) [2023-12-28 06:46:57,419][106225] Updated weights for policy 1, policy_version 1606966 (0.0010) [2023-12-28 06:46:57,450][106226] Updated weights for policy 0, policy_version 1603234 (0.0007) [2023-12-28 06:46:57,506][106226] Updated weights for policy 0, policy_version 1603244 (0.0009) [2023-12-28 06:46:57,568][106226] Updated weights for policy 0, policy_version 1603254 (0.0008) [2023-12-28 06:46:58,105][106225] Updated weights for policy 1, policy_version 1606976 (0.0009) [2023-12-28 06:46:58,160][106225] Updated weights for policy 1, policy_version 1606986 (0.0008) [2023-12-28 06:46:58,221][106225] Updated weights for policy 1, policy_version 1606996 (0.0008) [2023-12-28 06:46:58,318][106226] Updated weights for policy 0, policy_version 1603264 (0.0010) [2023-12-28 06:46:58,396][106226] Updated weights for policy 0, policy_version 1603274 (0.0008) [2023-12-28 06:46:58,460][106226] Updated weights for policy 0, policy_version 1603284 (0.0007) [2023-12-28 06:46:59,074][106225] Updated weights for policy 1, policy_version 1607006 (0.0007) [2023-12-28 06:46:59,138][106225] Updated weights for policy 1, policy_version 1607016 (0.0007) [2023-12-28 06:46:59,198][106225] Updated weights for policy 1, policy_version 1607026 (0.0006) [2023-12-28 06:46:59,317][106226] Updated weights for policy 0, policy_version 1603294 (0.0010) [2023-12-28 06:46:59,390][106226] Updated weights for policy 0, policy_version 1603304 (0.0011) [2023-12-28 06:46:59,443][106226] Updated weights for policy 0, policy_version 1603314 (0.0011) [2023-12-28 06:46:59,853][106225] Updated weights for policy 1, policy_version 1607036 (0.0009) [2023-12-28 06:46:59,913][106225] Updated weights for policy 1, policy_version 1607046 (0.0010) [2023-12-28 06:46:59,981][106225] Updated weights for policy 1, policy_version 1607056 (0.0010) [2023-12-28 06:47:00,212][106226] Updated weights for policy 0, policy_version 1603324 (0.0011) [2023-12-28 06:47:00,269][106226] Updated weights for policy 0, policy_version 1603334 (0.0010) [2023-12-28 06:47:00,340][106226] Updated weights for policy 0, policy_version 1603344 (0.0011) [2023-12-28 06:47:00,658][106225] Updated weights for policy 1, policy_version 1607066 (0.0011) [2023-12-28 06:47:00,708][106225] Updated weights for policy 1, policy_version 1607076 (0.0008) [2023-12-28 06:47:00,757][106225] Updated weights for policy 1, policy_version 1607086 (0.0009) [2023-12-28 06:47:00,807][106225] Updated weights for policy 1, policy_version 1607096 (0.0010) [2023-12-28 06:47:00,895][106226] Updated weights for policy 0, policy_version 1603354 (0.0006) [2023-12-28 06:47:00,963][106226] Updated weights for policy 0, policy_version 1603364 (0.0005) [2023-12-28 06:47:01,034][106226] Updated weights for policy 0, policy_version 1603374 (0.0006) [2023-12-28 06:47:01,108][106226] Updated weights for policy 0, policy_version 1603384 (0.0007) [2023-12-28 06:47:01,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 822009856. Throughput: 0: 9905.0, 1: 9937.2. Samples: 821995628. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:01,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.634')] [2023-12-28 06:47:01,524][106225] Updated weights for policy 1, policy_version 1607106 (0.0011) [2023-12-28 06:47:01,584][106225] Updated weights for policy 1, policy_version 1607116 (0.0010) [2023-12-28 06:47:01,662][106225] Updated weights for policy 1, policy_version 1607126 (0.0011) [2023-12-28 06:47:01,730][106226] Updated weights for policy 0, policy_version 1603394 (0.0008) [2023-12-28 06:47:01,790][106226] Updated weights for policy 0, policy_version 1603404 (0.0007) [2023-12-28 06:47:01,845][106226] Updated weights for policy 0, policy_version 1603414 (0.0005) [2023-12-28 06:47:02,384][106225] Updated weights for policy 1, policy_version 1607136 (0.0009) [2023-12-28 06:47:02,443][106225] Updated weights for policy 1, policy_version 1607146 (0.0006) [2023-12-28 06:47:02,462][106226] Updated weights for policy 0, policy_version 1603424 (0.0007) [2023-12-28 06:47:02,505][106225] Updated weights for policy 1, policy_version 1607156 (0.0009) [2023-12-28 06:47:02,527][106226] Updated weights for policy 0, policy_version 1603434 (0.0007) [2023-12-28 06:47:02,586][106226] Updated weights for policy 0, policy_version 1603444 (0.0009) [2023-12-28 06:47:03,113][106225] Updated weights for policy 1, policy_version 1607166 (0.0007) [2023-12-28 06:47:03,161][106225] Updated weights for policy 1, policy_version 1607176 (0.0008) [2023-12-28 06:47:03,206][106225] Updated weights for policy 1, policy_version 1607186 (0.0008) [2023-12-28 06:47:03,306][106226] Updated weights for policy 0, policy_version 1603454 (0.0009) [2023-12-28 06:47:03,355][106226] Updated weights for policy 0, policy_version 1603464 (0.0009) [2023-12-28 06:47:03,404][106226] Updated weights for policy 0, policy_version 1603474 (0.0009) [2023-12-28 06:47:03,852][106225] Updated weights for policy 1, policy_version 1607196 (0.0008) [2023-12-28 06:47:03,919][106225] Updated weights for policy 1, policy_version 1607206 (0.0007) [2023-12-28 06:47:03,977][106225] Updated weights for policy 1, policy_version 1607216 (0.0008) [2023-12-28 06:47:04,116][106226] Updated weights for policy 0, policy_version 1603484 (0.0009) [2023-12-28 06:47:04,177][106226] Updated weights for policy 0, policy_version 1603494 (0.0010) [2023-12-28 06:47:04,234][106226] Updated weights for policy 0, policy_version 1603504 (0.0009) [2023-12-28 06:47:04,694][106225] Updated weights for policy 1, policy_version 1607226 (0.0008) [2023-12-28 06:47:04,753][106225] Updated weights for policy 1, policy_version 1607236 (0.0008) [2023-12-28 06:47:04,810][106225] Updated weights for policy 1, policy_version 1607246 (0.0009) [2023-12-28 06:47:04,864][106225] Updated weights for policy 1, policy_version 1607256 (0.0010) [2023-12-28 06:47:04,910][106226] Updated weights for policy 0, policy_version 1603514 (0.0008) [2023-12-28 06:47:04,966][106226] Updated weights for policy 0, policy_version 1603524 (0.0006) [2023-12-28 06:47:05,029][106226] Updated weights for policy 0, policy_version 1603534 (0.0009) [2023-12-28 06:47:05,087][106226] Updated weights for policy 0, policy_version 1603544 (0.0008) [2023-12-28 06:47:05,592][106225] Updated weights for policy 1, policy_version 1607266 (0.0005) [2023-12-28 06:47:05,649][106225] Updated weights for policy 1, policy_version 1607276 (0.0008) [2023-12-28 06:47:05,703][106225] Updated weights for policy 1, policy_version 1607286 (0.0008) [2023-12-28 06:47:05,791][106226] Updated weights for policy 0, policy_version 1603554 (0.0008) [2023-12-28 06:47:05,860][106226] Updated weights for policy 0, policy_version 1603564 (0.0009) [2023-12-28 06:47:05,918][106226] Updated weights for policy 0, policy_version 1603574 (0.0009) [2023-12-28 06:47:06,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 822108160. Throughput: 0: 9970.6, 1: 10004.1. Samples: 822116552. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:06,176][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.468')] [2023-12-28 06:47:06,438][106225] Updated weights for policy 1, policy_version 1607296 (0.0008) [2023-12-28 06:47:06,501][106225] Updated weights for policy 1, policy_version 1607306 (0.0008) [2023-12-28 06:47:06,567][106225] Updated weights for policy 1, policy_version 1607316 (0.0009) [2023-12-28 06:47:06,652][106226] Updated weights for policy 0, policy_version 1603584 (0.0009) [2023-12-28 06:47:06,709][106226] Updated weights for policy 0, policy_version 1603594 (0.0009) [2023-12-28 06:47:06,758][106226] Updated weights for policy 0, policy_version 1603604 (0.0009) [2023-12-28 06:47:07,295][106225] Updated weights for policy 1, policy_version 1607326 (0.0008) [2023-12-28 06:47:07,353][106225] Updated weights for policy 1, policy_version 1607336 (0.0008) [2023-12-28 06:47:07,412][106225] Updated weights for policy 1, policy_version 1607346 (0.0009) [2023-12-28 06:47:07,462][106226] Updated weights for policy 0, policy_version 1603614 (0.0007) [2023-12-28 06:47:07,510][106226] Updated weights for policy 0, policy_version 1603624 (0.0008) [2023-12-28 06:47:07,561][106226] Updated weights for policy 0, policy_version 1603635 (0.0009) [2023-12-28 06:47:08,160][106225] Updated weights for policy 1, policy_version 1607356 (0.0009) [2023-12-28 06:47:08,210][106225] Updated weights for policy 1, policy_version 1607366 (0.0010) [2023-12-28 06:47:08,224][106226] Updated weights for policy 0, policy_version 1603645 (0.0009) [2023-12-28 06:47:08,270][106225] Updated weights for policy 1, policy_version 1607376 (0.0010) [2023-12-28 06:47:08,274][106226] Updated weights for policy 0, policy_version 1603655 (0.0010) [2023-12-28 06:47:08,332][106226] Updated weights for policy 0, policy_version 1603665 (0.0009) [2023-12-28 06:47:08,911][106225] Updated weights for policy 1, policy_version 1607386 (0.0009) [2023-12-28 06:47:08,958][106225] Updated weights for policy 1, policy_version 1607396 (0.0005) [2023-12-28 06:47:09,006][106225] Updated weights for policy 1, policy_version 1607406 (0.0010) [2023-12-28 06:47:09,050][106226] Updated weights for policy 0, policy_version 1603675 (0.0008) [2023-12-28 06:47:09,056][106225] Updated weights for policy 1, policy_version 1607416 (0.0010) [2023-12-28 06:47:09,111][106226] Updated weights for policy 0, policy_version 1603685 (0.0010) [2023-12-28 06:47:09,166][106226] Updated weights for policy 0, policy_version 1603695 (0.0010) [2023-12-28 06:47:09,722][106225] Updated weights for policy 1, policy_version 1607426 (0.0010) [2023-12-28 06:47:09,784][106225] Updated weights for policy 1, policy_version 1607436 (0.0011) [2023-12-28 06:47:09,851][106225] Updated weights for policy 1, policy_version 1607446 (0.0010) [2023-12-28 06:47:10,010][106226] Updated weights for policy 0, policy_version 1603705 (0.0010) [2023-12-28 06:47:10,074][106226] Updated weights for policy 0, policy_version 1603715 (0.0008) [2023-12-28 06:47:10,136][106226] Updated weights for policy 0, policy_version 1603725 (0.0011) [2023-12-28 06:47:10,199][106226] Updated weights for policy 0, policy_version 1603735 (0.0011) [2023-12-28 06:47:10,614][106225] Updated weights for policy 1, policy_version 1607456 (0.0011) [2023-12-28 06:47:10,672][106225] Updated weights for policy 1, policy_version 1607466 (0.0011) [2023-12-28 06:47:10,737][106225] Updated weights for policy 1, policy_version 1607476 (0.0011) [2023-12-28 06:47:10,929][106226] Updated weights for policy 0, policy_version 1603745 (0.0011) [2023-12-28 06:47:10,990][106226] Updated weights for policy 0, policy_version 1603755 (0.0011) [2023-12-28 06:47:11,054][106226] Updated weights for policy 0, policy_version 1603765 (0.0010) [2023-12-28 06:47:11,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 822206464. Throughput: 0: 10005.1, 1: 9978.7. Samples: 822175792. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:11,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-4.553')] [2023-12-28 06:47:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001607480_411566080.pth... [2023-12-28 06:47:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001603768_410640384.pth... [2023-12-28 06:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001602584_410337280.pth [2023-12-28 06:47:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001606328_411271168.pth [2023-12-28 06:47:11,496][106225] Updated weights for policy 1, policy_version 1607486 (0.0008) [2023-12-28 06:47:11,560][106225] Updated weights for policy 1, policy_version 1607496 (0.0007) [2023-12-28 06:47:11,628][106225] Updated weights for policy 1, policy_version 1607506 (0.0008) [2023-12-28 06:47:11,877][106226] Updated weights for policy 0, policy_version 1603775 (0.0009) [2023-12-28 06:47:11,951][106226] Updated weights for policy 0, policy_version 1603785 (0.0007) [2023-12-28 06:47:12,020][106226] Updated weights for policy 0, policy_version 1603795 (0.0008) [2023-12-28 06:47:12,384][106225] Updated weights for policy 1, policy_version 1607516 (0.0010) [2023-12-28 06:47:12,444][106225] Updated weights for policy 1, policy_version 1607526 (0.0008) [2023-12-28 06:47:12,501][106225] Updated weights for policy 1, policy_version 1607536 (0.0009) [2023-12-28 06:47:12,688][106226] Updated weights for policy 0, policy_version 1603805 (0.0008) [2023-12-28 06:47:12,751][106226] Updated weights for policy 0, policy_version 1603815 (0.0008) [2023-12-28 06:47:12,809][106226] Updated weights for policy 0, policy_version 1603825 (0.0006) [2023-12-28 06:47:13,226][106225] Updated weights for policy 1, policy_version 1607546 (0.0009) [2023-12-28 06:47:13,285][106225] Updated weights for policy 1, policy_version 1607556 (0.0008) [2023-12-28 06:47:13,342][106225] Updated weights for policy 1, policy_version 1607566 (0.0009) [2023-12-28 06:47:13,405][106225] Updated weights for policy 1, policy_version 1607576 (0.0008) [2023-12-28 06:47:13,468][106226] Updated weights for policy 0, policy_version 1603835 (0.0006) [2023-12-28 06:47:13,520][106226] Updated weights for policy 0, policy_version 1603845 (0.0008) [2023-12-28 06:47:13,578][106226] Updated weights for policy 0, policy_version 1603855 (0.0009) [2023-12-28 06:47:14,009][106225] Updated weights for policy 1, policy_version 1607586 (0.0005) [2023-12-28 06:47:14,068][106225] Updated weights for policy 1, policy_version 1607596 (0.0008) [2023-12-28 06:47:14,132][106225] Updated weights for policy 1, policy_version 1607606 (0.0008) [2023-12-28 06:47:14,317][106226] Updated weights for policy 0, policy_version 1603865 (0.0009) [2023-12-28 06:47:14,374][106226] Updated weights for policy 0, policy_version 1603875 (0.0010) [2023-12-28 06:47:14,435][106226] Updated weights for policy 0, policy_version 1603885 (0.0010) [2023-12-28 06:47:14,498][106226] Updated weights for policy 0, policy_version 1603895 (0.0011) [2023-12-28 06:47:14,803][106225] Updated weights for policy 1, policy_version 1607616 (0.0008) [2023-12-28 06:47:14,864][106225] Updated weights for policy 1, policy_version 1607626 (0.0006) [2023-12-28 06:47:14,922][106225] Updated weights for policy 1, policy_version 1607636 (0.0005) [2023-12-28 06:47:15,210][106226] Updated weights for policy 0, policy_version 1603905 (0.0008) [2023-12-28 06:47:15,272][106226] Updated weights for policy 0, policy_version 1603915 (0.0011) [2023-12-28 06:47:15,341][106226] Updated weights for policy 0, policy_version 1603925 (0.0011) [2023-12-28 06:47:15,553][106225] Updated weights for policy 1, policy_version 1607646 (0.0007) [2023-12-28 06:47:15,604][106225] Updated weights for policy 1, policy_version 1607656 (0.0008) [2023-12-28 06:47:15,661][106225] Updated weights for policy 1, policy_version 1607666 (0.0008) [2023-12-28 06:47:16,037][106226] Updated weights for policy 0, policy_version 1603935 (0.0011) [2023-12-28 06:47:16,086][106226] Updated weights for policy 0, policy_version 1603945 (0.0010) [2023-12-28 06:47:16,149][106226] Updated weights for policy 0, policy_version 1603955 (0.0008) [2023-12-28 06:47:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 822296576. Throughput: 0: 9874.4, 1: 9953.9. Samples: 822291104. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:16,175][105115] Avg episode reward: [(0, '-4.652'), (1, '-4.629')] [2023-12-28 06:47:16,293][106225] Updated weights for policy 1, policy_version 1607676 (0.0008) [2023-12-28 06:47:16,346][106225] Updated weights for policy 1, policy_version 1607686 (0.0008) [2023-12-28 06:47:16,392][106225] Updated weights for policy 1, policy_version 1607696 (0.0008) [2023-12-28 06:47:16,843][106226] Updated weights for policy 0, policy_version 1603965 (0.0008) [2023-12-28 06:47:16,899][106226] Updated weights for policy 0, policy_version 1603975 (0.0010) [2023-12-28 06:47:16,962][106226] Updated weights for policy 0, policy_version 1603985 (0.0008) [2023-12-28 06:47:17,088][106225] Updated weights for policy 1, policy_version 1607706 (0.0008) [2023-12-28 06:47:17,134][106225] Updated weights for policy 1, policy_version 1607716 (0.0007) [2023-12-28 06:47:17,187][106225] Updated weights for policy 1, policy_version 1607726 (0.0005) [2023-12-28 06:47:17,236][106225] Updated weights for policy 1, policy_version 1607736 (0.0005) [2023-12-28 06:47:17,633][106226] Updated weights for policy 0, policy_version 1603995 (0.0009) [2023-12-28 06:47:17,686][106226] Updated weights for policy 0, policy_version 1604005 (0.0009) [2023-12-28 06:47:17,751][106226] Updated weights for policy 0, policy_version 1604015 (0.0010) [2023-12-28 06:47:17,852][106225] Updated weights for policy 1, policy_version 1607746 (0.0010) [2023-12-28 06:47:17,902][106225] Updated weights for policy 1, policy_version 1607756 (0.0010) [2023-12-28 06:47:17,957][106225] Updated weights for policy 1, policy_version 1607766 (0.0009) [2023-12-28 06:47:18,482][106226] Updated weights for policy 0, policy_version 1604025 (0.0010) [2023-12-28 06:47:18,541][106226] Updated weights for policy 0, policy_version 1604035 (0.0010) [2023-12-28 06:47:18,595][106226] Updated weights for policy 0, policy_version 1604045 (0.0010) [2023-12-28 06:47:18,646][106225] Updated weights for policy 1, policy_version 1607776 (0.0008) [2023-12-28 06:47:18,647][106226] Updated weights for policy 0, policy_version 1604055 (0.0011) [2023-12-28 06:47:18,695][106225] Updated weights for policy 1, policy_version 1607786 (0.0008) [2023-12-28 06:47:18,747][106225] Updated weights for policy 1, policy_version 1607796 (0.0008) [2023-12-28 06:47:19,326][106226] Updated weights for policy 0, policy_version 1604065 (0.0010) [2023-12-28 06:47:19,391][106226] Updated weights for policy 0, policy_version 1604075 (0.0008) [2023-12-28 06:47:19,417][106225] Updated weights for policy 1, policy_version 1607806 (0.0007) [2023-12-28 06:47:19,444][106226] Updated weights for policy 0, policy_version 1604085 (0.0006) [2023-12-28 06:47:19,481][106225] Updated weights for policy 1, policy_version 1607816 (0.0006) [2023-12-28 06:47:19,543][106225] Updated weights for policy 1, policy_version 1607826 (0.0007) [2023-12-28 06:47:20,212][106226] Updated weights for policy 0, policy_version 1604095 (0.0008) [2023-12-28 06:47:20,278][106225] Updated weights for policy 1, policy_version 1607836 (0.0007) [2023-12-28 06:47:20,279][106226] Updated weights for policy 0, policy_version 1604105 (0.0009) [2023-12-28 06:47:20,343][106225] Updated weights for policy 1, policy_version 1607846 (0.0008) [2023-12-28 06:47:20,348][106226] Updated weights for policy 0, policy_version 1604115 (0.0008) [2023-12-28 06:47:20,402][106225] Updated weights for policy 1, policy_version 1607856 (0.0007) [2023-12-28 06:47:21,039][106226] Updated weights for policy 0, policy_version 1604125 (0.0007) [2023-12-28 06:47:21,108][106226] Updated weights for policy 0, policy_version 1604135 (0.0007) [2023-12-28 06:47:21,174][106226] Updated weights for policy 0, policy_version 1604145 (0.0008) [2023-12-28 06:47:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 822394880. Throughput: 0: 9870.5, 1: 9958.6. Samples: 822412188. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:21,175][105115] Avg episode reward: [(0, '-4.704'), (1, '-4.554')] [2023-12-28 06:47:21,197][106225] Updated weights for policy 1, policy_version 1607866 (0.0009) [2023-12-28 06:47:21,268][106225] Updated weights for policy 1, policy_version 1607876 (0.0011) [2023-12-28 06:47:21,325][106225] Updated weights for policy 1, policy_version 1607886 (0.0010) [2023-12-28 06:47:21,394][106225] Updated weights for policy 1, policy_version 1607896 (0.0008) [2023-12-28 06:47:21,921][106226] Updated weights for policy 0, policy_version 1604155 (0.0006) [2023-12-28 06:47:21,982][106226] Updated weights for policy 0, policy_version 1604165 (0.0006) [2023-12-28 06:47:22,036][106226] Updated weights for policy 0, policy_version 1604175 (0.0008) [2023-12-28 06:47:22,091][106225] Updated weights for policy 1, policy_version 1607906 (0.0007) [2023-12-28 06:47:22,159][106225] Updated weights for policy 1, policy_version 1607916 (0.0009) [2023-12-28 06:47:22,218][106225] Updated weights for policy 1, policy_version 1607926 (0.0007) [2023-12-28 06:47:22,697][106226] Updated weights for policy 0, policy_version 1604185 (0.0007) [2023-12-28 06:47:22,760][106226] Updated weights for policy 0, policy_version 1604195 (0.0009) [2023-12-28 06:47:22,820][106226] Updated weights for policy 0, policy_version 1604205 (0.0010) [2023-12-28 06:47:22,884][106226] Updated weights for policy 0, policy_version 1604215 (0.0008) [2023-12-28 06:47:22,949][106225] Updated weights for policy 1, policy_version 1607936 (0.0009) [2023-12-28 06:47:23,001][106225] Updated weights for policy 1, policy_version 1607946 (0.0010) [2023-12-28 06:47:23,052][106225] Updated weights for policy 1, policy_version 1607956 (0.0010) [2023-12-28 06:47:23,514][106226] Updated weights for policy 0, policy_version 1604225 (0.0010) [2023-12-28 06:47:23,571][106226] Updated weights for policy 0, policy_version 1604235 (0.0006) [2023-12-28 06:47:23,627][106226] Updated weights for policy 0, policy_version 1604245 (0.0009) [2023-12-28 06:47:23,710][106225] Updated weights for policy 1, policy_version 1607966 (0.0010) [2023-12-28 06:47:23,764][106225] Updated weights for policy 1, policy_version 1607976 (0.0009) [2023-12-28 06:47:23,830][106225] Updated weights for policy 1, policy_version 1607986 (0.0005) [2023-12-28 06:47:24,336][106226] Updated weights for policy 0, policy_version 1604255 (0.0009) [2023-12-28 06:47:24,390][106226] Updated weights for policy 0, policy_version 1604265 (0.0010) [2023-12-28 06:47:24,405][106225] Updated weights for policy 1, policy_version 1607996 (0.0007) [2023-12-28 06:47:24,447][106226] Updated weights for policy 0, policy_version 1604275 (0.0011) [2023-12-28 06:47:24,462][106225] Updated weights for policy 1, policy_version 1608006 (0.0010) [2023-12-28 06:47:24,518][106225] Updated weights for policy 1, policy_version 1608016 (0.0010) [2023-12-28 06:47:25,168][106226] Updated weights for policy 0, policy_version 1604285 (0.0010) [2023-12-28 06:47:25,220][106226] Updated weights for policy 0, policy_version 1604295 (0.0010) [2023-12-28 06:47:25,240][106225] Updated weights for policy 1, policy_version 1608026 (0.0010) [2023-12-28 06:47:25,276][106226] Updated weights for policy 0, policy_version 1604305 (0.0010) [2023-12-28 06:47:25,296][106225] Updated weights for policy 1, policy_version 1608036 (0.0010) [2023-12-28 06:47:25,349][106225] Updated weights for policy 1, policy_version 1608046 (0.0010) [2023-12-28 06:47:25,408][106225] Updated weights for policy 1, policy_version 1608056 (0.0010) [2023-12-28 06:47:25,998][106226] Updated weights for policy 0, policy_version 1604315 (0.0010) [2023-12-28 06:47:26,062][106226] Updated weights for policy 0, policy_version 1604325 (0.0011) [2023-12-28 06:47:26,106][106225] Updated weights for policy 1, policy_version 1608066 (0.0010) [2023-12-28 06:47:26,119][106226] Updated weights for policy 0, policy_version 1604335 (0.0011) [2023-12-28 06:47:26,156][106225] Updated weights for policy 1, policy_version 1608076 (0.0010) [2023-12-28 06:47:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 822501376. Throughput: 0: 9862.0, 1: 9949.9. Samples: 822470672. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:26,175][105115] Avg episode reward: [(0, '-4.719'), (1, '-4.483')] [2023-12-28 06:47:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001604344_410787840.pth... [2023-12-28 06:47:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001603192_410492928.pth [2023-12-28 06:47:26,205][106225] Updated weights for policy 1, policy_version 1608086 (0.0010) [2023-12-28 06:47:26,214][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001608088_411721728.pth... [2023-12-28 06:47:26,217][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001606904_411418624.pth [2023-12-28 06:47:26,823][106226] Updated weights for policy 0, policy_version 1604345 (0.0010) [2023-12-28 06:47:26,885][106226] Updated weights for policy 0, policy_version 1604355 (0.0006) [2023-12-28 06:47:26,904][106225] Updated weights for policy 1, policy_version 1608096 (0.0010) [2023-12-28 06:47:26,932][106226] Updated weights for policy 0, policy_version 1604365 (0.0005) [2023-12-28 06:47:26,957][106225] Updated weights for policy 1, policy_version 1608106 (0.0010) [2023-12-28 06:47:26,991][106226] Updated weights for policy 0, policy_version 1604375 (0.0010) [2023-12-28 06:47:27,005][106225] Updated weights for policy 1, policy_version 1608116 (0.0010) [2023-12-28 06:47:27,640][106225] Updated weights for policy 1, policy_version 1608126 (0.0010) [2023-12-28 06:47:27,692][106225] Updated weights for policy 1, policy_version 1608136 (0.0007) [2023-12-28 06:47:27,705][106226] Updated weights for policy 0, policy_version 1604385 (0.0006) [2023-12-28 06:47:27,740][106225] Updated weights for policy 1, policy_version 1608146 (0.0007) [2023-12-28 06:47:27,756][106226] Updated weights for policy 0, policy_version 1604395 (0.0005) [2023-12-28 06:47:27,805][106226] Updated weights for policy 0, policy_version 1604405 (0.0005) [2023-12-28 06:47:28,333][106226] Updated weights for policy 0, policy_version 1604415 (0.0006) [2023-12-28 06:47:28,350][106225] Updated weights for policy 1, policy_version 1608156 (0.0007) [2023-12-28 06:47:28,397][106226] Updated weights for policy 0, policy_version 1604425 (0.0008) [2023-12-28 06:47:28,411][106225] Updated weights for policy 1, policy_version 1608166 (0.0011) [2023-12-28 06:47:28,445][106226] Updated weights for policy 0, policy_version 1604435 (0.0006) [2023-12-28 06:47:28,466][106225] Updated weights for policy 1, policy_version 1608176 (0.0010) [2023-12-28 06:47:29,143][106226] Updated weights for policy 0, policy_version 1604445 (0.0005) [2023-12-28 06:47:29,171][106225] Updated weights for policy 1, policy_version 1608186 (0.0010) [2023-12-28 06:47:29,219][106226] Updated weights for policy 0, policy_version 1604455 (0.0006) [2023-12-28 06:47:29,228][106225] Updated weights for policy 1, policy_version 1608196 (0.0008) [2023-12-28 06:47:29,284][106226] Updated weights for policy 0, policy_version 1604465 (0.0007) [2023-12-28 06:47:29,293][106225] Updated weights for policy 1, policy_version 1608206 (0.0007) [2023-12-28 06:47:29,353][106225] Updated weights for policy 1, policy_version 1608216 (0.0007) [2023-12-28 06:47:29,916][106226] Updated weights for policy 0, policy_version 1604475 (0.0007) [2023-12-28 06:47:29,987][106226] Updated weights for policy 0, policy_version 1604485 (0.0010) [2023-12-28 06:47:30,048][106226] Updated weights for policy 0, policy_version 1604495 (0.0011) [2023-12-28 06:47:30,093][106225] Updated weights for policy 1, policy_version 1608226 (0.0007) [2023-12-28 06:47:30,146][106225] Updated weights for policy 1, policy_version 1608236 (0.0008) [2023-12-28 06:47:30,204][106225] Updated weights for policy 1, policy_version 1608246 (0.0008) [2023-12-28 06:47:30,708][106226] Updated weights for policy 0, policy_version 1604505 (0.0010) [2023-12-28 06:47:30,774][106226] Updated weights for policy 0, policy_version 1604515 (0.0010) [2023-12-28 06:47:30,842][106226] Updated weights for policy 0, policy_version 1604525 (0.0006) [2023-12-28 06:47:30,914][106226] Updated weights for policy 0, policy_version 1604535 (0.0005) [2023-12-28 06:47:30,934][106225] Updated weights for policy 1, policy_version 1608256 (0.0006) [2023-12-28 06:47:30,981][106225] Updated weights for policy 1, policy_version 1608266 (0.0005) [2023-12-28 06:47:31,036][106225] Updated weights for policy 1, policy_version 1608276 (0.0006) [2023-12-28 06:47:31,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 822607872. Throughput: 0: 9983.3, 1: 10067.0. Samples: 822593848. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:31,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.613')] [2023-12-28 06:47:31,592][106226] Updated weights for policy 0, policy_version 1604545 (0.0010) [2023-12-28 06:47:31,659][106226] Updated weights for policy 0, policy_version 1604555 (0.0009) [2023-12-28 06:47:31,723][106226] Updated weights for policy 0, policy_version 1604565 (0.0011) [2023-12-28 06:47:31,791][106225] Updated weights for policy 1, policy_version 1608286 (0.0009) [2023-12-28 06:47:31,850][106225] Updated weights for policy 1, policy_version 1608296 (0.0008) [2023-12-28 06:47:31,897][106225] Updated weights for policy 1, policy_version 1608306 (0.0008) [2023-12-28 06:47:32,410][106226] Updated weights for policy 0, policy_version 1604575 (0.0011) [2023-12-28 06:47:32,470][106226] Updated weights for policy 0, policy_version 1604585 (0.0008) [2023-12-28 06:47:32,524][106226] Updated weights for policy 0, policy_version 1604595 (0.0008) [2023-12-28 06:47:32,677][106225] Updated weights for policy 1, policy_version 1608316 (0.0009) [2023-12-28 06:47:32,735][106225] Updated weights for policy 1, policy_version 1608326 (0.0010) [2023-12-28 06:47:32,795][106225] Updated weights for policy 1, policy_version 1608336 (0.0010) [2023-12-28 06:47:33,196][106226] Updated weights for policy 0, policy_version 1604605 (0.0009) [2023-12-28 06:47:33,258][106226] Updated weights for policy 0, policy_version 1604615 (0.0005) [2023-12-28 06:47:33,311][106226] Updated weights for policy 0, policy_version 1604625 (0.0005) [2023-12-28 06:47:33,516][106225] Updated weights for policy 1, policy_version 1608346 (0.0010) [2023-12-28 06:47:33,572][106225] Updated weights for policy 1, policy_version 1608356 (0.0010) [2023-12-28 06:47:33,635][106225] Updated weights for policy 1, policy_version 1608366 (0.0010) [2023-12-28 06:47:33,700][106225] Updated weights for policy 1, policy_version 1608376 (0.0010) [2023-12-28 06:47:33,824][106226] Updated weights for policy 0, policy_version 1604635 (0.0005) [2023-12-28 06:47:33,894][106226] Updated weights for policy 0, policy_version 1604645 (0.0005) [2023-12-28 06:47:33,959][106226] Updated weights for policy 0, policy_version 1604655 (0.0005) [2023-12-28 06:47:34,388][106225] Updated weights for policy 1, policy_version 1608386 (0.0008) [2023-12-28 06:47:34,444][106225] Updated weights for policy 1, policy_version 1608396 (0.0008) [2023-12-28 06:47:34,492][106225] Updated weights for policy 1, policy_version 1608406 (0.0008) [2023-12-28 06:47:34,559][106226] Updated weights for policy 0, policy_version 1604665 (0.0006) [2023-12-28 06:47:34,623][106226] Updated weights for policy 0, policy_version 1604675 (0.0011) [2023-12-28 06:47:34,690][106226] Updated weights for policy 0, policy_version 1604685 (0.0008) [2023-12-28 06:47:34,744][106226] Updated weights for policy 0, policy_version 1604695 (0.0008) [2023-12-28 06:47:35,215][106225] Updated weights for policy 1, policy_version 1608416 (0.0009) [2023-12-28 06:47:35,262][106225] Updated weights for policy 1, policy_version 1608426 (0.0008) [2023-12-28 06:47:35,315][106225] Updated weights for policy 1, policy_version 1608436 (0.0009) [2023-12-28 06:47:35,453][106226] Updated weights for policy 0, policy_version 1604705 (0.0006) [2023-12-28 06:47:35,507][106226] Updated weights for policy 0, policy_version 1604715 (0.0008) [2023-12-28 06:47:35,567][106226] Updated weights for policy 0, policy_version 1604725 (0.0008) [2023-12-28 06:47:36,077][106225] Updated weights for policy 1, policy_version 1608446 (0.0006) [2023-12-28 06:47:36,148][106225] Updated weights for policy 1, policy_version 1608456 (0.0008) [2023-12-28 06:47:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 822697984. Throughput: 0: 10057.4, 1: 9978.7. Samples: 822713748. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:36,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.574')] [2023-12-28 06:47:36,216][106225] Updated weights for policy 1, policy_version 1608466 (0.0008) [2023-12-28 06:47:36,230][106226] Updated weights for policy 0, policy_version 1604735 (0.0007) [2023-12-28 06:47:36,299][106226] Updated weights for policy 0, policy_version 1604745 (0.0007) [2023-12-28 06:47:36,365][106226] Updated weights for policy 0, policy_version 1604755 (0.0009) [2023-12-28 06:47:36,894][106225] Updated weights for policy 1, policy_version 1608476 (0.0008) [2023-12-28 06:47:36,963][106225] Updated weights for policy 1, policy_version 1608486 (0.0009) [2023-12-28 06:47:37,023][106225] Updated weights for policy 1, policy_version 1608496 (0.0009) [2023-12-28 06:47:37,121][106226] Updated weights for policy 0, policy_version 1604765 (0.0007) [2023-12-28 06:47:37,170][106226] Updated weights for policy 0, policy_version 1604775 (0.0005) [2023-12-28 06:47:37,217][106226] Updated weights for policy 0, policy_version 1604785 (0.0005) [2023-12-28 06:47:37,631][106225] Updated weights for policy 1, policy_version 1608506 (0.0008) [2023-12-28 06:47:37,679][106225] Updated weights for policy 1, policy_version 1608516 (0.0008) [2023-12-28 06:47:37,738][106225] Updated weights for policy 1, policy_version 1608526 (0.0008) [2023-12-28 06:47:37,795][106225] Updated weights for policy 1, policy_version 1608536 (0.0006) [2023-12-28 06:47:37,875][106226] Updated weights for policy 0, policy_version 1604795 (0.0006) [2023-12-28 06:47:37,924][106226] Updated weights for policy 0, policy_version 1604805 (0.0009) [2023-12-28 06:47:37,977][106226] Updated weights for policy 0, policy_version 1604815 (0.0008) [2023-12-28 06:47:38,488][106225] Updated weights for policy 1, policy_version 1608546 (0.0010) [2023-12-28 06:47:38,552][106225] Updated weights for policy 1, policy_version 1608556 (0.0010) [2023-12-28 06:47:38,619][106225] Updated weights for policy 1, policy_version 1608566 (0.0010) [2023-12-28 06:47:38,748][106226] Updated weights for policy 0, policy_version 1604825 (0.0009) [2023-12-28 06:47:38,802][106226] Updated weights for policy 0, policy_version 1604835 (0.0008) [2023-12-28 06:47:38,860][106226] Updated weights for policy 0, policy_version 1604845 (0.0008) [2023-12-28 06:47:38,919][106226] Updated weights for policy 0, policy_version 1604855 (0.0008) [2023-12-28 06:47:39,350][106225] Updated weights for policy 1, policy_version 1608576 (0.0009) [2023-12-28 06:47:39,420][106225] Updated weights for policy 1, policy_version 1608586 (0.0008) [2023-12-28 06:47:39,490][106225] Updated weights for policy 1, policy_version 1608596 (0.0007) [2023-12-28 06:47:39,690][106226] Updated weights for policy 0, policy_version 1604865 (0.0009) [2023-12-28 06:47:39,751][106226] Updated weights for policy 0, policy_version 1604875 (0.0009) [2023-12-28 06:47:39,805][106226] Updated weights for policy 0, policy_version 1604885 (0.0008) [2023-12-28 06:47:40,306][106225] Updated weights for policy 1, policy_version 1608606 (0.0009) [2023-12-28 06:47:40,371][106225] Updated weights for policy 1, policy_version 1608616 (0.0008) [2023-12-28 06:47:40,440][106225] Updated weights for policy 1, policy_version 1608626 (0.0009) [2023-12-28 06:47:40,527][106226] Updated weights for policy 0, policy_version 1604895 (0.0008) [2023-12-28 06:47:40,588][106226] Updated weights for policy 0, policy_version 1604905 (0.0009) [2023-12-28 06:47:40,655][106226] Updated weights for policy 0, policy_version 1604915 (0.0009) [2023-12-28 06:47:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 822796288. Throughput: 0: 10006.6, 1: 9986.8. Samples: 822772724. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:41,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.574')] [2023-12-28 06:47:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001604920_410935296.pth... [2023-12-28 06:47:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001603768_410640384.pth [2023-12-28 06:47:41,210][106225] Updated weights for policy 1, policy_version 1608636 (0.0008) [2023-12-28 06:47:41,275][106225] Updated weights for policy 1, policy_version 1608646 (0.0007) [2023-12-28 06:47:41,343][106225] Updated weights for policy 1, policy_version 1608656 (0.0008) [2023-12-28 06:47:41,399][106226] Updated weights for policy 0, policy_version 1604925 (0.0008) [2023-12-28 06:47:41,404][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001608664_411869184.pth... [2023-12-28 06:47:41,411][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001607480_411566080.pth [2023-12-28 06:47:41,460][106226] Updated weights for policy 0, policy_version 1604935 (0.0008) [2023-12-28 06:47:41,517][106226] Updated weights for policy 0, policy_version 1604945 (0.0008) [2023-12-28 06:47:42,179][106226] Updated weights for policy 0, policy_version 1604955 (0.0008) [2023-12-28 06:47:42,194][106225] Updated weights for policy 1, policy_version 1608666 (0.0008) [2023-12-28 06:47:42,240][106226] Updated weights for policy 0, policy_version 1604965 (0.0008) [2023-12-28 06:47:42,254][106225] Updated weights for policy 1, policy_version 1608676 (0.0006) [2023-12-28 06:47:42,302][106226] Updated weights for policy 0, policy_version 1604975 (0.0006) [2023-12-28 06:47:42,317][106225] Updated weights for policy 1, policy_version 1608686 (0.0008) [2023-12-28 06:47:42,383][106225] Updated weights for policy 1, policy_version 1608696 (0.0007) [2023-12-28 06:47:42,961][106226] Updated weights for policy 0, policy_version 1604985 (0.0009) [2023-12-28 06:47:43,014][106226] Updated weights for policy 0, policy_version 1604995 (0.0008) [2023-12-28 06:47:43,063][106226] Updated weights for policy 0, policy_version 1605005 (0.0008) [2023-12-28 06:47:43,113][106226] Updated weights for policy 0, policy_version 1605015 (0.0009) [2023-12-28 06:47:43,155][106225] Updated weights for policy 1, policy_version 1608706 (0.0007) [2023-12-28 06:47:43,205][106225] Updated weights for policy 1, policy_version 1608716 (0.0008) [2023-12-28 06:47:43,257][106225] Updated weights for policy 1, policy_version 1608726 (0.0008) [2023-12-28 06:47:43,827][106226] Updated weights for policy 0, policy_version 1605025 (0.0005) [2023-12-28 06:47:43,887][106226] Updated weights for policy 0, policy_version 1605035 (0.0005) [2023-12-28 06:47:43,948][106226] Updated weights for policy 0, policy_version 1605045 (0.0006) [2023-12-28 06:47:44,031][106225] Updated weights for policy 1, policy_version 1608736 (0.0008) [2023-12-28 06:47:44,083][106225] Updated weights for policy 1, policy_version 1608746 (0.0008) [2023-12-28 06:47:44,135][106225] Updated weights for policy 1, policy_version 1608756 (0.0008) [2023-12-28 06:47:44,544][106226] Updated weights for policy 0, policy_version 1605055 (0.0007) [2023-12-28 06:47:44,601][106226] Updated weights for policy 0, policy_version 1605065 (0.0005) [2023-12-28 06:47:44,658][106226] Updated weights for policy 0, policy_version 1605075 (0.0006) [2023-12-28 06:47:44,863][106225] Updated weights for policy 1, policy_version 1608766 (0.0006) [2023-12-28 06:47:44,929][106225] Updated weights for policy 1, policy_version 1608776 (0.0008) [2023-12-28 06:47:44,991][106225] Updated weights for policy 1, policy_version 1608786 (0.0007) [2023-12-28 06:47:45,330][106226] Updated weights for policy 0, policy_version 1605086 (0.0007) [2023-12-28 06:47:45,397][106226] Updated weights for policy 0, policy_version 1605096 (0.0008) [2023-12-28 06:47:45,464][106226] Updated weights for policy 0, policy_version 1605106 (0.0008) [2023-12-28 06:47:45,659][106225] Updated weights for policy 1, policy_version 1608796 (0.0007) [2023-12-28 06:47:45,711][106225] Updated weights for policy 1, policy_version 1608806 (0.0009) [2023-12-28 06:47:45,771][106225] Updated weights for policy 1, policy_version 1608816 (0.0010) [2023-12-28 06:47:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 822894592. Throughput: 0: 9971.6, 1: 9844.1. Samples: 822887336. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:46,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.661')] [2023-12-28 06:47:46,186][106226] Updated weights for policy 0, policy_version 1605116 (0.0008) [2023-12-28 06:47:46,244][106226] Updated weights for policy 0, policy_version 1605126 (0.0008) [2023-12-28 06:47:46,299][106226] Updated weights for policy 0, policy_version 1605136 (0.0008) [2023-12-28 06:47:46,480][106225] Updated weights for policy 1, policy_version 1608826 (0.0010) [2023-12-28 06:47:46,527][106225] Updated weights for policy 1, policy_version 1608836 (0.0008) [2023-12-28 06:47:46,581][106225] Updated weights for policy 1, policy_version 1608846 (0.0008) [2023-12-28 06:47:46,627][106225] Updated weights for policy 1, policy_version 1608856 (0.0007) [2023-12-28 06:47:47,042][106226] Updated weights for policy 0, policy_version 1605146 (0.0009) [2023-12-28 06:47:47,092][106226] Updated weights for policy 0, policy_version 1605156 (0.0010) [2023-12-28 06:47:47,148][106226] Updated weights for policy 0, policy_version 1605166 (0.0010) [2023-12-28 06:47:47,204][106226] Updated weights for policy 0, policy_version 1605176 (0.0010) [2023-12-28 06:47:47,392][106225] Updated weights for policy 1, policy_version 1608866 (0.0008) [2023-12-28 06:47:47,452][106225] Updated weights for policy 1, policy_version 1608876 (0.0008) [2023-12-28 06:47:47,508][106225] Updated weights for policy 1, policy_version 1608886 (0.0009) [2023-12-28 06:47:47,889][106226] Updated weights for policy 0, policy_version 1605186 (0.0005) [2023-12-28 06:47:47,947][106226] Updated weights for policy 0, policy_version 1605196 (0.0005) [2023-12-28 06:47:48,007][106226] Updated weights for policy 0, policy_version 1605206 (0.0006) [2023-12-28 06:47:48,161][106225] Updated weights for policy 1, policy_version 1608896 (0.0006) [2023-12-28 06:47:48,207][106225] Updated weights for policy 1, policy_version 1608906 (0.0005) [2023-12-28 06:47:48,251][106225] Updated weights for policy 1, policy_version 1608916 (0.0005) [2023-12-28 06:47:48,584][106226] Updated weights for policy 0, policy_version 1605216 (0.0010) [2023-12-28 06:47:48,648][106226] Updated weights for policy 0, policy_version 1605226 (0.0011) [2023-12-28 06:47:48,709][106226] Updated weights for policy 0, policy_version 1605236 (0.0009) [2023-12-28 06:47:48,987][106225] Updated weights for policy 1, policy_version 1608926 (0.0006) [2023-12-28 06:47:49,045][106225] Updated weights for policy 1, policy_version 1608936 (0.0007) [2023-12-28 06:47:49,102][106225] Updated weights for policy 1, policy_version 1608946 (0.0005) [2023-12-28 06:47:49,392][106226] Updated weights for policy 0, policy_version 1605246 (0.0007) [2023-12-28 06:47:49,455][106226] Updated weights for policy 0, policy_version 1605256 (0.0007) [2023-12-28 06:47:49,510][106226] Updated weights for policy 0, policy_version 1605266 (0.0009) [2023-12-28 06:47:49,769][106225] Updated weights for policy 1, policy_version 1608956 (0.0007) [2023-12-28 06:47:49,829][106225] Updated weights for policy 1, policy_version 1608966 (0.0008) [2023-12-28 06:47:49,891][106225] Updated weights for policy 1, policy_version 1608976 (0.0006) [2023-12-28 06:47:50,269][106226] Updated weights for policy 0, policy_version 1605276 (0.0010) [2023-12-28 06:47:50,336][106226] Updated weights for policy 0, policy_version 1605286 (0.0008) [2023-12-28 06:47:50,398][106226] Updated weights for policy 0, policy_version 1605296 (0.0008) [2023-12-28 06:47:50,626][106225] Updated weights for policy 1, policy_version 1608986 (0.0008) [2023-12-28 06:47:50,693][106225] Updated weights for policy 1, policy_version 1608996 (0.0008) [2023-12-28 06:47:50,754][106225] Updated weights for policy 1, policy_version 1609006 (0.0007) [2023-12-28 06:47:50,815][106225] Updated weights for policy 1, policy_version 1609016 (0.0006) [2023-12-28 06:47:51,162][106226] Updated weights for policy 0, policy_version 1605306 (0.0008) [2023-12-28 06:47:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 822992896. Throughput: 0: 9932.9, 1: 9821.2. Samples: 823005484. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:51,177][105115] Avg episode reward: [(0, '-4.628'), (1, '-4.710')] [2023-12-28 06:47:51,230][106226] Updated weights for policy 0, policy_version 1605316 (0.0007) [2023-12-28 06:47:51,298][106226] Updated weights for policy 0, policy_version 1605326 (0.0008) [2023-12-28 06:47:51,370][106226] Updated weights for policy 0, policy_version 1605336 (0.0010) [2023-12-28 06:47:51,485][106225] Updated weights for policy 1, policy_version 1609026 (0.0009) [2023-12-28 06:47:51,547][106225] Updated weights for policy 1, policy_version 1609036 (0.0008) [2023-12-28 06:47:51,604][106225] Updated weights for policy 1, policy_version 1609046 (0.0008) [2023-12-28 06:47:52,054][106226] Updated weights for policy 0, policy_version 1605346 (0.0009) [2023-12-28 06:47:52,114][106226] Updated weights for policy 0, policy_version 1605356 (0.0009) [2023-12-28 06:47:52,159][106226] Updated weights for policy 0, policy_version 1605366 (0.0008) [2023-12-28 06:47:52,387][106225] Updated weights for policy 1, policy_version 1609056 (0.0008) [2023-12-28 06:47:52,449][106225] Updated weights for policy 1, policy_version 1609066 (0.0008) [2023-12-28 06:47:52,506][106225] Updated weights for policy 1, policy_version 1609076 (0.0008) [2023-12-28 06:47:52,861][106226] Updated weights for policy 0, policy_version 1605376 (0.0009) [2023-12-28 06:47:52,925][106226] Updated weights for policy 0, policy_version 1605386 (0.0005) [2023-12-28 06:47:52,977][106226] Updated weights for policy 0, policy_version 1605396 (0.0007) [2023-12-28 06:47:53,285][106225] Updated weights for policy 1, policy_version 1609086 (0.0008) [2023-12-28 06:47:53,354][106225] Updated weights for policy 1, policy_version 1609096 (0.0008) [2023-12-28 06:47:53,419][106225] Updated weights for policy 1, policy_version 1609106 (0.0009) [2023-12-28 06:47:53,558][106226] Updated weights for policy 0, policy_version 1605406 (0.0007) [2023-12-28 06:47:53,610][106226] Updated weights for policy 0, policy_version 1605416 (0.0005) [2023-12-28 06:47:53,669][106226] Updated weights for policy 0, policy_version 1605426 (0.0005) [2023-12-28 06:47:54,131][106225] Updated weights for policy 1, policy_version 1609116 (0.0008) [2023-12-28 06:47:54,182][106225] Updated weights for policy 1, policy_version 1609126 (0.0007) [2023-12-28 06:47:54,238][106225] Updated weights for policy 1, policy_version 1609136 (0.0007) [2023-12-28 06:47:54,274][106226] Updated weights for policy 0, policy_version 1605436 (0.0007) [2023-12-28 06:47:54,328][106226] Updated weights for policy 0, policy_version 1605446 (0.0010) [2023-12-28 06:47:54,382][106226] Updated weights for policy 0, policy_version 1605456 (0.0010) [2023-12-28 06:47:54,997][106225] Updated weights for policy 1, policy_version 1609146 (0.0008) [2023-12-28 06:47:55,013][106226] Updated weights for policy 0, policy_version 1605466 (0.0009) [2023-12-28 06:47:55,047][106225] Updated weights for policy 1, policy_version 1609156 (0.0007) [2023-12-28 06:47:55,070][106226] Updated weights for policy 0, policy_version 1605476 (0.0006) [2023-12-28 06:47:55,096][106225] Updated weights for policy 1, policy_version 1609166 (0.0007) [2023-12-28 06:47:55,129][106226] Updated weights for policy 0, policy_version 1605486 (0.0007) [2023-12-28 06:47:55,143][106225] Updated weights for policy 1, policy_version 1609176 (0.0006) [2023-12-28 06:47:55,189][106226] Updated weights for policy 0, policy_version 1605496 (0.0008) [2023-12-28 06:47:55,790][106226] Updated weights for policy 0, policy_version 1605506 (0.0005) [2023-12-28 06:47:55,842][106226] Updated weights for policy 0, policy_version 1605516 (0.0008) [2023-12-28 06:47:55,911][106226] Updated weights for policy 0, policy_version 1605526 (0.0005) [2023-12-28 06:47:55,967][106225] Updated weights for policy 1, policy_version 1609186 (0.0009) [2023-12-28 06:47:56,017][106225] Updated weights for policy 1, policy_version 1609196 (0.0007) [2023-12-28 06:47:56,071][106225] Updated weights for policy 1, policy_version 1609206 (0.0007) [2023-12-28 06:47:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 823099392. Throughput: 0: 9956.2, 1: 9785.5. Samples: 823064168. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:47:56,176][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.870')] [2023-12-28 06:47:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001609208_412008448.pth... [2023-12-28 06:47:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001605528_411090944.pth... [2023-12-28 06:47:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001604344_410787840.pth [2023-12-28 06:47:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001608088_411721728.pth [2023-12-28 06:47:56,550][106226] Updated weights for policy 0, policy_version 1605536 (0.0007) [2023-12-28 06:47:56,594][106226] Updated weights for policy 0, policy_version 1605546 (0.0008) [2023-12-28 06:47:56,642][106226] Updated weights for policy 0, policy_version 1605556 (0.0010) [2023-12-28 06:47:56,710][106225] Updated weights for policy 1, policy_version 1609216 (0.0009) [2023-12-28 06:47:56,759][106225] Updated weights for policy 1, policy_version 1609226 (0.0010) [2023-12-28 06:47:56,815][106225] Updated weights for policy 1, policy_version 1609236 (0.0009) [2023-12-28 06:47:57,320][106226] Updated weights for policy 0, policy_version 1605566 (0.0006) [2023-12-28 06:47:57,383][106226] Updated weights for policy 0, policy_version 1605576 (0.0005) [2023-12-28 06:47:57,432][106225] Updated weights for policy 1, policy_version 1609246 (0.0009) [2023-12-28 06:47:57,450][106226] Updated weights for policy 0, policy_version 1605586 (0.0005) [2023-12-28 06:47:57,492][106225] Updated weights for policy 1, policy_version 1609256 (0.0010) [2023-12-28 06:47:57,547][106225] Updated weights for policy 1, policy_version 1609266 (0.0009) [2023-12-28 06:47:58,088][106225] Updated weights for policy 1, policy_version 1609276 (0.0005) [2023-12-28 06:47:58,140][106225] Updated weights for policy 1, policy_version 1609286 (0.0005) [2023-12-28 06:47:58,140][106226] Updated weights for policy 0, policy_version 1605596 (0.0008) [2023-12-28 06:47:58,191][106226] Updated weights for policy 0, policy_version 1605606 (0.0008) [2023-12-28 06:47:58,193][106225] Updated weights for policy 1, policy_version 1609296 (0.0005) [2023-12-28 06:47:58,252][106226] Updated weights for policy 0, policy_version 1605616 (0.0008) [2023-12-28 06:47:58,890][106225] Updated weights for policy 1, policy_version 1609306 (0.0008) [2023-12-28 06:47:58,953][106225] Updated weights for policy 1, policy_version 1609316 (0.0010) [2023-12-28 06:47:59,019][106225] Updated weights for policy 1, policy_version 1609326 (0.0008) [2023-12-28 06:47:59,053][106226] Updated weights for policy 0, policy_version 1605626 (0.0007) [2023-12-28 06:47:59,067][106225] Updated weights for policy 1, policy_version 1609336 (0.0007) [2023-12-28 06:47:59,115][106226] Updated weights for policy 0, policy_version 1605636 (0.0007) [2023-12-28 06:47:59,182][106226] Updated weights for policy 0, policy_version 1605646 (0.0008) [2023-12-28 06:47:59,249][106226] Updated weights for policy 0, policy_version 1605656 (0.0008) [2023-12-28 06:47:59,834][106225] Updated weights for policy 1, policy_version 1609346 (0.0009) [2023-12-28 06:47:59,893][106225] Updated weights for policy 1, policy_version 1609356 (0.0010) [2023-12-28 06:47:59,954][106225] Updated weights for policy 1, policy_version 1609366 (0.0009) [2023-12-28 06:48:00,035][106226] Updated weights for policy 0, policy_version 1605666 (0.0006) [2023-12-28 06:48:00,105][106226] Updated weights for policy 0, policy_version 1605676 (0.0006) [2023-12-28 06:48:00,163][106226] Updated weights for policy 0, policy_version 1605686 (0.0006) [2023-12-28 06:48:00,677][106225] Updated weights for policy 1, policy_version 1609376 (0.0008) [2023-12-28 06:48:00,743][106225] Updated weights for policy 1, policy_version 1609386 (0.0008) [2023-12-28 06:48:00,745][106226] Updated weights for policy 0, policy_version 1605696 (0.0007) [2023-12-28 06:48:00,804][106226] Updated weights for policy 0, policy_version 1605706 (0.0008) [2023-12-28 06:48:00,805][106225] Updated weights for policy 1, policy_version 1609396 (0.0009) [2023-12-28 06:48:00,869][106226] Updated weights for policy 0, policy_version 1605716 (0.0009) [2023-12-28 06:48:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 823197696. Throughput: 0: 10049.4, 1: 9833.1. Samples: 823185816. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 06:48:01,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.693')] [2023-12-28 06:48:01,512][106225] Updated weights for policy 1, policy_version 1609406 (0.0008) [2023-12-28 06:48:01,573][106225] Updated weights for policy 1, policy_version 1609416 (0.0007) [2023-12-28 06:48:01,603][106226] Updated weights for policy 0, policy_version 1605726 (0.0008) [2023-12-28 06:48:01,644][106225] Updated weights for policy 1, policy_version 1609426 (0.0007) [2023-12-28 06:48:01,667][106226] Updated weights for policy 0, policy_version 1605736 (0.0008) [2023-12-28 06:48:01,727][106226] Updated weights for policy 0, policy_version 1605746 (0.0008) [2023-12-28 06:48:02,315][106225] Updated weights for policy 1, policy_version 1609436 (0.0006) [2023-12-28 06:48:02,326][106226] Updated weights for policy 0, policy_version 1605756 (0.0008) [2023-12-28 06:48:02,379][106225] Updated weights for policy 1, policy_version 1609446 (0.0007) [2023-12-28 06:48:02,391][106226] Updated weights for policy 0, policy_version 1605766 (0.0008) [2023-12-28 06:48:02,431][106225] Updated weights for policy 1, policy_version 1609456 (0.0007) [2023-12-28 06:48:02,450][106226] Updated weights for policy 0, policy_version 1605776 (0.0008) [2023-12-28 06:48:03,005][106225] Updated weights for policy 1, policy_version 1609466 (0.0008) [2023-12-28 06:48:03,063][106225] Updated weights for policy 1, policy_version 1609476 (0.0008) [2023-12-28 06:48:03,120][106225] Updated weights for policy 1, policy_version 1609486 (0.0008) [2023-12-28 06:48:03,175][106225] Updated weights for policy 1, policy_version 1609496 (0.0008) [2023-12-28 06:48:03,218][106226] Updated weights for policy 0, policy_version 1605786 (0.0008) [2023-12-28 06:48:03,278][106226] Updated weights for policy 0, policy_version 1605796 (0.0008) [2023-12-28 06:48:03,335][106226] Updated weights for policy 0, policy_version 1605806 (0.0008) [2023-12-28 06:48:03,389][106226] Updated weights for policy 0, policy_version 1605816 (0.0008) [2023-12-28 06:48:03,846][106225] Updated weights for policy 1, policy_version 1609506 (0.0006) [2023-12-28 06:48:03,913][106225] Updated weights for policy 1, policy_version 1609516 (0.0007) [2023-12-28 06:48:03,974][106225] Updated weights for policy 1, policy_version 1609526 (0.0010) [2023-12-28 06:48:04,133][106226] Updated weights for policy 0, policy_version 1605826 (0.0008) [2023-12-28 06:48:04,195][106226] Updated weights for policy 0, policy_version 1605836 (0.0008) [2023-12-28 06:48:04,254][106226] Updated weights for policy 0, policy_version 1605846 (0.0007) [2023-12-28 06:48:04,664][106225] Updated weights for policy 1, policy_version 1609536 (0.0010) [2023-12-28 06:48:04,720][106225] Updated weights for policy 1, policy_version 1609546 (0.0009) [2023-12-28 06:48:04,780][106225] Updated weights for policy 1, policy_version 1609556 (0.0006) [2023-12-28 06:48:04,958][106226] Updated weights for policy 0, policy_version 1605856 (0.0006) [2023-12-28 06:48:05,024][106226] Updated weights for policy 0, policy_version 1605866 (0.0005) [2023-12-28 06:48:05,084][106226] Updated weights for policy 0, policy_version 1605876 (0.0007) [2023-12-28 06:48:05,338][106225] Updated weights for policy 1, policy_version 1609566 (0.0006) [2023-12-28 06:48:05,388][106225] Updated weights for policy 1, policy_version 1609576 (0.0005) [2023-12-28 06:48:05,449][106225] Updated weights for policy 1, policy_version 1609586 (0.0005) [2023-12-28 06:48:05,675][106226] Updated weights for policy 0, policy_version 1605886 (0.0011) [2023-12-28 06:48:05,740][106226] Updated weights for policy 0, policy_version 1605896 (0.0005) [2023-12-28 06:48:05,790][106226] Updated weights for policy 0, policy_version 1605906 (0.0006) [2023-12-28 06:48:05,962][106225] Updated weights for policy 1, policy_version 1609596 (0.0005) [2023-12-28 06:48:06,022][106225] Updated weights for policy 1, policy_version 1609606 (0.0010) [2023-12-28 06:48:06,077][106225] Updated weights for policy 1, policy_version 1609616 (0.0010) [2023-12-28 06:48:06,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 823304192. Throughput: 0: 10092.3, 1: 9846.7. Samples: 823309440. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:06,175][105115] Avg episode reward: [(0, '-4.713'), (1, '-4.677')] [2023-12-28 06:48:06,427][106226] Updated weights for policy 0, policy_version 1605916 (0.0008) [2023-12-28 06:48:06,495][106226] Updated weights for policy 0, policy_version 1605926 (0.0008) [2023-12-28 06:48:06,560][106226] Updated weights for policy 0, policy_version 1605936 (0.0008) [2023-12-28 06:48:06,805][106225] Updated weights for policy 1, policy_version 1609626 (0.0010) [2023-12-28 06:48:06,877][106225] Updated weights for policy 1, policy_version 1609636 (0.0009) [2023-12-28 06:48:06,937][106225] Updated weights for policy 1, policy_version 1609646 (0.0010) [2023-12-28 06:48:07,001][106225] Updated weights for policy 1, policy_version 1609656 (0.0010) [2023-12-28 06:48:07,160][106226] Updated weights for policy 0, policy_version 1605946 (0.0008) [2023-12-28 06:48:07,216][106226] Updated weights for policy 0, policy_version 1605956 (0.0008) [2023-12-28 06:48:07,270][106226] Updated weights for policy 0, policy_version 1605966 (0.0005) [2023-12-28 06:48:07,332][106226] Updated weights for policy 0, policy_version 1605976 (0.0006) [2023-12-28 06:48:07,673][106225] Updated weights for policy 1, policy_version 1609666 (0.0006) [2023-12-28 06:48:07,732][106225] Updated weights for policy 1, policy_version 1609676 (0.0005) [2023-12-28 06:48:07,792][106225] Updated weights for policy 1, policy_version 1609686 (0.0005) [2023-12-28 06:48:07,919][106226] Updated weights for policy 0, policy_version 1605986 (0.0006) [2023-12-28 06:48:07,980][106226] Updated weights for policy 0, policy_version 1605996 (0.0005) [2023-12-28 06:48:08,039][106226] Updated weights for policy 0, policy_version 1606006 (0.0005) [2023-12-28 06:48:08,475][106225] Updated weights for policy 1, policy_version 1609696 (0.0007) [2023-12-28 06:48:08,538][106225] Updated weights for policy 1, policy_version 1609706 (0.0008) [2023-12-28 06:48:08,602][106225] Updated weights for policy 1, policy_version 1609716 (0.0008) [2023-12-28 06:48:08,620][106226] Updated weights for policy 0, policy_version 1606016 (0.0010) [2023-12-28 06:48:08,681][106226] Updated weights for policy 0, policy_version 1606026 (0.0010) [2023-12-28 06:48:08,739][106226] Updated weights for policy 0, policy_version 1606036 (0.0009) [2023-12-28 06:48:09,355][106226] Updated weights for policy 0, policy_version 1606046 (0.0009) [2023-12-28 06:48:09,423][106225] Updated weights for policy 1, policy_version 1609726 (0.0016) [2023-12-28 06:48:09,426][106226] Updated weights for policy 0, policy_version 1606056 (0.0009) [2023-12-28 06:48:09,482][106225] Updated weights for policy 1, policy_version 1609736 (0.0010) [2023-12-28 06:48:09,497][106226] Updated weights for policy 0, policy_version 1606066 (0.0011) [2023-12-28 06:48:09,538][106225] Updated weights for policy 1, policy_version 1609746 (0.0011) [2023-12-28 06:48:10,167][106226] Updated weights for policy 0, policy_version 1606076 (0.0009) [2023-12-28 06:48:10,235][106226] Updated weights for policy 0, policy_version 1606086 (0.0007) [2023-12-28 06:48:10,302][106226] Updated weights for policy 0, policy_version 1606096 (0.0007) [2023-12-28 06:48:10,329][106225] Updated weights for policy 1, policy_version 1609756 (0.0010) [2023-12-28 06:48:10,393][106225] Updated weights for policy 1, policy_version 1609766 (0.0006) [2023-12-28 06:48:10,459][106225] Updated weights for policy 1, policy_version 1609776 (0.0010) [2023-12-28 06:48:10,939][106226] Updated weights for policy 0, policy_version 1606106 (0.0009) [2023-12-28 06:48:10,997][106226] Updated weights for policy 0, policy_version 1606116 (0.0011) [2023-12-28 06:48:11,059][106226] Updated weights for policy 0, policy_version 1606126 (0.0009) [2023-12-28 06:48:11,118][106226] Updated weights for policy 0, policy_version 1606136 (0.0008) [2023-12-28 06:48:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 823402496. Throughput: 0: 10175.7, 1: 9870.3. Samples: 823372740. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:11,175][105115] Avg episode reward: [(0, '-4.373'), (1, '-4.478')] [2023-12-28 06:48:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001609784_412155904.pth... [2023-12-28 06:48:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001606136_411246592.pth... [2023-12-28 06:48:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001608664_411869184.pth [2023-12-28 06:48:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001604920_410935296.pth [2023-12-28 06:48:11,231][106225] Updated weights for policy 1, policy_version 1609786 (0.0008) [2023-12-28 06:48:11,308][106225] Updated weights for policy 1, policy_version 1609796 (0.0010) [2023-12-28 06:48:11,377][106225] Updated weights for policy 1, policy_version 1609806 (0.0010) [2023-12-28 06:48:11,455][106225] Updated weights for policy 1, policy_version 1609816 (0.0010) [2023-12-28 06:48:11,985][106226] Updated weights for policy 0, policy_version 1606146 (0.0007) [2023-12-28 06:48:12,049][106226] Updated weights for policy 0, policy_version 1606156 (0.0007) [2023-12-28 06:48:12,115][106226] Updated weights for policy 0, policy_version 1606166 (0.0008) [2023-12-28 06:48:12,167][106225] Updated weights for policy 1, policy_version 1609826 (0.0008) [2023-12-28 06:48:12,226][106225] Updated weights for policy 1, policy_version 1609836 (0.0009) [2023-12-28 06:48:12,284][106225] Updated weights for policy 1, policy_version 1609846 (0.0008) [2023-12-28 06:48:12,838][106226] Updated weights for policy 0, policy_version 1606176 (0.0009) [2023-12-28 06:48:12,897][106226] Updated weights for policy 0, policy_version 1606186 (0.0009) [2023-12-28 06:48:12,945][106226] Updated weights for policy 0, policy_version 1606196 (0.0008) [2023-12-28 06:48:13,002][106225] Updated weights for policy 1, policy_version 1609856 (0.0007) [2023-12-28 06:48:13,056][106225] Updated weights for policy 1, policy_version 1609866 (0.0008) [2023-12-28 06:48:13,101][106225] Updated weights for policy 1, policy_version 1609876 (0.0008) [2023-12-28 06:48:13,617][106226] Updated weights for policy 0, policy_version 1606206 (0.0007) [2023-12-28 06:48:13,682][106226] Updated weights for policy 0, policy_version 1606216 (0.0005) [2023-12-28 06:48:13,738][106226] Updated weights for policy 0, policy_version 1606226 (0.0005) [2023-12-28 06:48:13,822][106225] Updated weights for policy 1, policy_version 1609886 (0.0009) [2023-12-28 06:48:13,881][106225] Updated weights for policy 1, policy_version 1609896 (0.0010) [2023-12-28 06:48:13,931][106225] Updated weights for policy 1, policy_version 1609906 (0.0010) [2023-12-28 06:48:14,352][106226] Updated weights for policy 0, policy_version 1606236 (0.0006) [2023-12-28 06:48:14,399][106226] Updated weights for policy 0, policy_version 1606246 (0.0008) [2023-12-28 06:48:14,447][106226] Updated weights for policy 0, policy_version 1606256 (0.0007) [2023-12-28 06:48:14,652][106225] Updated weights for policy 1, policy_version 1609916 (0.0010) [2023-12-28 06:48:14,709][106225] Updated weights for policy 1, policy_version 1609926 (0.0010) [2023-12-28 06:48:14,755][106225] Updated weights for policy 1, policy_version 1609936 (0.0010) [2023-12-28 06:48:15,179][106226] Updated weights for policy 0, policy_version 1606266 (0.0008) [2023-12-28 06:48:15,244][106226] Updated weights for policy 0, policy_version 1606276 (0.0006) [2023-12-28 06:48:15,309][106226] Updated weights for policy 0, policy_version 1606286 (0.0006) [2023-12-28 06:48:15,373][106226] Updated weights for policy 0, policy_version 1606296 (0.0008) [2023-12-28 06:48:15,468][106225] Updated weights for policy 1, policy_version 1609946 (0.0010) [2023-12-28 06:48:15,523][106225] Updated weights for policy 1, policy_version 1609956 (0.0010) [2023-12-28 06:48:15,573][106225] Updated weights for policy 1, policy_version 1609966 (0.0009) [2023-12-28 06:48:15,640][106225] Updated weights for policy 1, policy_version 1609976 (0.0008) [2023-12-28 06:48:15,981][106226] Updated weights for policy 0, policy_version 1606306 (0.0008) [2023-12-28 06:48:16,048][106226] Updated weights for policy 0, policy_version 1606316 (0.0009) [2023-12-28 06:48:16,119][106226] Updated weights for policy 0, policy_version 1606326 (0.0007) [2023-12-28 06:48:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 823500800. Throughput: 0: 10130.6, 1: 9743.5. Samples: 823488184. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:16,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.763')] [2023-12-28 06:48:16,287][106225] Updated weights for policy 1, policy_version 1609986 (0.0007) [2023-12-28 06:48:16,340][106225] Updated weights for policy 1, policy_version 1609996 (0.0009) [2023-12-28 06:48:16,391][106225] Updated weights for policy 1, policy_version 1610006 (0.0010) [2023-12-28 06:48:16,726][106226] Updated weights for policy 0, policy_version 1606336 (0.0008) [2023-12-28 06:48:16,776][106226] Updated weights for policy 0, policy_version 1606346 (0.0010) [2023-12-28 06:48:16,826][106226] Updated weights for policy 0, policy_version 1606356 (0.0008) [2023-12-28 06:48:17,097][106225] Updated weights for policy 1, policy_version 1610016 (0.0010) [2023-12-28 06:48:17,146][106225] Updated weights for policy 1, policy_version 1610026 (0.0010) [2023-12-28 06:48:17,196][106225] Updated weights for policy 1, policy_version 1610036 (0.0010) [2023-12-28 06:48:17,525][106226] Updated weights for policy 0, policy_version 1606366 (0.0008) [2023-12-28 06:48:17,571][106226] Updated weights for policy 0, policy_version 1606376 (0.0005) [2023-12-28 06:48:17,630][106226] Updated weights for policy 0, policy_version 1606386 (0.0006) [2023-12-28 06:48:17,851][106225] Updated weights for policy 1, policy_version 1610046 (0.0010) [2023-12-28 06:48:17,905][106225] Updated weights for policy 1, policy_version 1610056 (0.0010) [2023-12-28 06:48:17,966][106225] Updated weights for policy 1, policy_version 1610066 (0.0010) [2023-12-28 06:48:18,199][106226] Updated weights for policy 0, policy_version 1606396 (0.0006) [2023-12-28 06:48:18,249][106226] Updated weights for policy 0, policy_version 1606406 (0.0009) [2023-12-28 06:48:18,306][106226] Updated weights for policy 0, policy_version 1606416 (0.0008) [2023-12-28 06:48:18,678][106225] Updated weights for policy 1, policy_version 1610076 (0.0010) [2023-12-28 06:48:18,745][106225] Updated weights for policy 1, policy_version 1610086 (0.0010) [2023-12-28 06:48:18,812][106225] Updated weights for policy 1, policy_version 1610096 (0.0006) [2023-12-28 06:48:18,973][106226] Updated weights for policy 0, policy_version 1606426 (0.0011) [2023-12-28 06:48:19,037][106226] Updated weights for policy 0, policy_version 1606436 (0.0008) [2023-12-28 06:48:19,098][106226] Updated weights for policy 0, policy_version 1606446 (0.0006) [2023-12-28 06:48:19,165][106226] Updated weights for policy 0, policy_version 1606456 (0.0009) [2023-12-28 06:48:19,439][106225] Updated weights for policy 1, policy_version 1610106 (0.0005) [2023-12-28 06:48:19,502][106225] Updated weights for policy 1, policy_version 1610116 (0.0006) [2023-12-28 06:48:19,566][106225] Updated weights for policy 1, policy_version 1610126 (0.0008) [2023-12-28 06:48:19,630][106225] Updated weights for policy 1, policy_version 1610136 (0.0008) [2023-12-28 06:48:19,850][106226] Updated weights for policy 0, policy_version 1606466 (0.0006) [2023-12-28 06:48:19,919][106226] Updated weights for policy 0, policy_version 1606476 (0.0006) [2023-12-28 06:48:19,987][106226] Updated weights for policy 0, policy_version 1606486 (0.0008) [2023-12-28 06:48:20,320][106225] Updated weights for policy 1, policy_version 1610146 (0.0006) [2023-12-28 06:48:20,379][106225] Updated weights for policy 1, policy_version 1610156 (0.0006) [2023-12-28 06:48:20,446][106225] Updated weights for policy 1, policy_version 1610166 (0.0006) [2023-12-28 06:48:20,619][106226] Updated weights for policy 0, policy_version 1606496 (0.0008) [2023-12-28 06:48:20,668][106226] Updated weights for policy 0, policy_version 1606506 (0.0008) [2023-12-28 06:48:20,724][106226] Updated weights for policy 0, policy_version 1606516 (0.0008) [2023-12-28 06:48:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 823599104. Throughput: 0: 10129.7, 1: 9826.3. Samples: 823611768. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:21,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.480')] [2023-12-28 06:48:21,208][106225] Updated weights for policy 1, policy_version 1610176 (0.0007) [2023-12-28 06:48:21,270][106225] Updated weights for policy 1, policy_version 1610186 (0.0007) [2023-12-28 06:48:21,341][106225] Updated weights for policy 1, policy_version 1610196 (0.0008) [2023-12-28 06:48:21,546][106226] Updated weights for policy 0, policy_version 1606526 (0.0008) [2023-12-28 06:48:21,594][106226] Updated weights for policy 0, policy_version 1606536 (0.0007) [2023-12-28 06:48:21,659][106226] Updated weights for policy 0, policy_version 1606546 (0.0009) [2023-12-28 06:48:22,098][106225] Updated weights for policy 1, policy_version 1610206 (0.0010) [2023-12-28 06:48:22,160][106225] Updated weights for policy 1, policy_version 1610216 (0.0011) [2023-12-28 06:48:22,221][106225] Updated weights for policy 1, policy_version 1610226 (0.0011) [2023-12-28 06:48:22,454][106226] Updated weights for policy 0, policy_version 1606556 (0.0008) [2023-12-28 06:48:22,512][106226] Updated weights for policy 0, policy_version 1606566 (0.0009) [2023-12-28 06:48:22,569][106226] Updated weights for policy 0, policy_version 1606576 (0.0011) [2023-12-28 06:48:22,986][106225] Updated weights for policy 1, policy_version 1610236 (0.0011) [2023-12-28 06:48:23,044][106225] Updated weights for policy 1, policy_version 1610246 (0.0011) [2023-12-28 06:48:23,098][106225] Updated weights for policy 1, policy_version 1610256 (0.0010) [2023-12-28 06:48:23,299][106226] Updated weights for policy 0, policy_version 1606586 (0.0010) [2023-12-28 06:48:23,360][106226] Updated weights for policy 0, policy_version 1606596 (0.0011) [2023-12-28 06:48:23,417][106226] Updated weights for policy 0, policy_version 1606606 (0.0010) [2023-12-28 06:48:23,470][106226] Updated weights for policy 0, policy_version 1606616 (0.0010) [2023-12-28 06:48:23,815][106225] Updated weights for policy 1, policy_version 1610266 (0.0010) [2023-12-28 06:48:23,873][106225] Updated weights for policy 1, policy_version 1610276 (0.0010) [2023-12-28 06:48:23,932][106225] Updated weights for policy 1, policy_version 1610286 (0.0010) [2023-12-28 06:48:23,988][106225] Updated weights for policy 1, policy_version 1610296 (0.0010) [2023-12-28 06:48:24,073][106226] Updated weights for policy 0, policy_version 1606626 (0.0005) [2023-12-28 06:48:24,117][106226] Updated weights for policy 0, policy_version 1606636 (0.0005) [2023-12-28 06:48:24,177][106226] Updated weights for policy 0, policy_version 1606646 (0.0005) [2023-12-28 06:48:24,714][106225] Updated weights for policy 1, policy_version 1610306 (0.0010) [2023-12-28 06:48:24,774][106225] Updated weights for policy 1, policy_version 1610316 (0.0010) [2023-12-28 06:48:24,822][106226] Updated weights for policy 0, policy_version 1606656 (0.0007) [2023-12-28 06:48:24,830][106225] Updated weights for policy 1, policy_version 1610326 (0.0008) [2023-12-28 06:48:24,878][106226] Updated weights for policy 0, policy_version 1606666 (0.0008) [2023-12-28 06:48:24,941][106226] Updated weights for policy 0, policy_version 1606676 (0.0005) [2023-12-28 06:48:25,400][106225] Updated weights for policy 1, policy_version 1610336 (0.0009) [2023-12-28 06:48:25,453][106225] Updated weights for policy 1, policy_version 1610346 (0.0010) [2023-12-28 06:48:25,484][106226] Updated weights for policy 0, policy_version 1606686 (0.0007) [2023-12-28 06:48:25,500][106225] Updated weights for policy 1, policy_version 1610356 (0.0010) [2023-12-28 06:48:25,540][106226] Updated weights for policy 0, policy_version 1606696 (0.0006) [2023-12-28 06:48:25,595][106226] Updated weights for policy 0, policy_version 1606706 (0.0005) [2023-12-28 06:48:26,131][106225] Updated weights for policy 1, policy_version 1610366 (0.0007) [2023-12-28 06:48:26,144][106226] Updated weights for policy 0, policy_version 1606716 (0.0008) [2023-12-28 06:48:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 823697408. Throughput: 0: 10144.7, 1: 9764.7. Samples: 823668640. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:26,175][105115] Avg episode reward: [(0, '-4.289'), (1, '-4.978')] [2023-12-28 06:48:26,185][106225] Updated weights for policy 1, policy_version 1610376 (0.0005) [2023-12-28 06:48:26,205][106226] Updated weights for policy 0, policy_version 1606726 (0.0010) [2023-12-28 06:48:26,232][106225] Updated weights for policy 1, policy_version 1610386 (0.0005) [2023-12-28 06:48:26,259][106226] Updated weights for policy 0, policy_version 1606736 (0.0010) [2023-12-28 06:48:26,262][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001610392_412311552.pth... [2023-12-28 06:48:26,265][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001609208_412008448.pth [2023-12-28 06:48:26,296][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001606744_411402240.pth... [2023-12-28 06:48:26,299][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001605528_411090944.pth [2023-12-28 06:48:26,814][106226] Updated weights for policy 0, policy_version 1606746 (0.0009) [2023-12-28 06:48:26,836][106225] Updated weights for policy 1, policy_version 1610396 (0.0008) [2023-12-28 06:48:26,864][106226] Updated weights for policy 0, policy_version 1606756 (0.0005) [2023-12-28 06:48:26,896][106225] Updated weights for policy 1, policy_version 1610406 (0.0005) [2023-12-28 06:48:26,922][106226] Updated weights for policy 0, policy_version 1606766 (0.0006) [2023-12-28 06:48:26,945][106225] Updated weights for policy 1, policy_version 1610416 (0.0005) [2023-12-28 06:48:26,982][106226] Updated weights for policy 0, policy_version 1606776 (0.0010) [2023-12-28 06:48:27,500][106225] Updated weights for policy 1, policy_version 1610426 (0.0006) [2023-12-28 06:48:27,516][106226] Updated weights for policy 0, policy_version 1606786 (0.0005) [2023-12-28 06:48:27,562][106225] Updated weights for policy 1, policy_version 1610436 (0.0010) [2023-12-28 06:48:27,578][106226] Updated weights for policy 0, policy_version 1606796 (0.0005) [2023-12-28 06:48:27,618][106225] Updated weights for policy 1, policy_version 1610446 (0.0010) [2023-12-28 06:48:27,641][106226] Updated weights for policy 0, policy_version 1606806 (0.0010) [2023-12-28 06:48:27,670][106225] Updated weights for policy 1, policy_version 1610456 (0.0010) [2023-12-28 06:48:28,296][106226] Updated weights for policy 0, policy_version 1606816 (0.0010) [2023-12-28 06:48:28,357][106226] Updated weights for policy 0, policy_version 1606826 (0.0011) [2023-12-28 06:48:28,381][106225] Updated weights for policy 1, policy_version 1610466 (0.0010) [2023-12-28 06:48:28,417][106226] Updated weights for policy 0, policy_version 1606836 (0.0011) [2023-12-28 06:48:28,441][106225] Updated weights for policy 1, policy_version 1610476 (0.0010) [2023-12-28 06:48:28,501][106225] Updated weights for policy 1, policy_version 1610486 (0.0010) [2023-12-28 06:48:29,131][106226] Updated weights for policy 0, policy_version 1606846 (0.0010) [2023-12-28 06:48:29,186][106226] Updated weights for policy 0, policy_version 1606856 (0.0010) [2023-12-28 06:48:29,215][106225] Updated weights for policy 1, policy_version 1610496 (0.0010) [2023-12-28 06:48:29,262][106226] Updated weights for policy 0, policy_version 1606866 (0.0009) [2023-12-28 06:48:29,276][106225] Updated weights for policy 1, policy_version 1610506 (0.0010) [2023-12-28 06:48:29,331][106225] Updated weights for policy 1, policy_version 1610516 (0.0009) [2023-12-28 06:48:29,963][106226] Updated weights for policy 0, policy_version 1606876 (0.0009) [2023-12-28 06:48:29,964][106225] Updated weights for policy 1, policy_version 1610526 (0.0009) [2023-12-28 06:48:30,023][106225] Updated weights for policy 1, policy_version 1610536 (0.0008) [2023-12-28 06:48:30,023][106226] Updated weights for policy 0, policy_version 1606886 (0.0007) [2023-12-28 06:48:30,072][106225] Updated weights for policy 1, policy_version 1610546 (0.0008) [2023-12-28 06:48:30,084][106226] Updated weights for policy 0, policy_version 1606896 (0.0010) [2023-12-28 06:48:30,724][106225] Updated weights for policy 1, policy_version 1610556 (0.0009) [2023-12-28 06:48:30,791][106225] Updated weights for policy 1, policy_version 1610566 (0.0009) [2023-12-28 06:48:30,823][106226] Updated weights for policy 0, policy_version 1606906 (0.0007) [2023-12-28 06:48:30,850][106225] Updated weights for policy 1, policy_version 1610576 (0.0011) [2023-12-28 06:48:30,881][106226] Updated weights for policy 0, policy_version 1606916 (0.0011) [2023-12-28 06:48:30,935][106226] Updated weights for policy 0, policy_version 1606926 (0.0010) [2023-12-28 06:48:30,992][106226] Updated weights for policy 0, policy_version 1606936 (0.0010) [2023-12-28 06:48:31,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 823812096. Throughput: 0: 10266.8, 1: 9992.8. Samples: 823799020. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:31,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.844')] [2023-12-28 06:48:31,632][106225] Updated weights for policy 1, policy_version 1610586 (0.0010) [2023-12-28 06:48:31,664][106226] Updated weights for policy 0, policy_version 1606946 (0.0008) [2023-12-28 06:48:31,692][106225] Updated weights for policy 1, policy_version 1610596 (0.0010) [2023-12-28 06:48:31,728][106226] Updated weights for policy 0, policy_version 1606956 (0.0009) [2023-12-28 06:48:31,765][106225] Updated weights for policy 1, policy_version 1610606 (0.0008) [2023-12-28 06:48:31,795][106226] Updated weights for policy 0, policy_version 1606966 (0.0008) [2023-12-28 06:48:31,830][106225] Updated weights for policy 1, policy_version 1610616 (0.0011) [2023-12-28 06:48:32,443][106226] Updated weights for policy 0, policy_version 1606976 (0.0006) [2023-12-28 06:48:32,508][106226] Updated weights for policy 0, policy_version 1606986 (0.0006) [2023-12-28 06:48:32,517][106225] Updated weights for policy 1, policy_version 1610626 (0.0011) [2023-12-28 06:48:32,569][106226] Updated weights for policy 0, policy_version 1606996 (0.0006) [2023-12-28 06:48:32,578][106225] Updated weights for policy 1, policy_version 1610636 (0.0011) [2023-12-28 06:48:32,639][106225] Updated weights for policy 1, policy_version 1610646 (0.0011) [2023-12-28 06:48:33,113][106226] Updated weights for policy 0, policy_version 1607006 (0.0006) [2023-12-28 06:48:33,177][106226] Updated weights for policy 0, policy_version 1607016 (0.0009) [2023-12-28 06:48:33,235][106226] Updated weights for policy 0, policy_version 1607026 (0.0011) [2023-12-28 06:48:33,322][106225] Updated weights for policy 1, policy_version 1610656 (0.0006) [2023-12-28 06:48:33,370][106225] Updated weights for policy 1, policy_version 1610666 (0.0005) [2023-12-28 06:48:33,417][106225] Updated weights for policy 1, policy_version 1610676 (0.0005) [2023-12-28 06:48:33,767][106226] Updated weights for policy 0, policy_version 1607036 (0.0007) [2023-12-28 06:48:33,830][106226] Updated weights for policy 0, policy_version 1607046 (0.0006) [2023-12-28 06:48:33,894][106226] Updated weights for policy 0, policy_version 1607056 (0.0010) [2023-12-28 06:48:33,984][106225] Updated weights for policy 1, policy_version 1610686 (0.0008) [2023-12-28 06:48:34,039][106225] Updated weights for policy 1, policy_version 1610696 (0.0010) [2023-12-28 06:48:34,099][106225] Updated weights for policy 1, policy_version 1610706 (0.0010) [2023-12-28 06:48:34,614][106226] Updated weights for policy 0, policy_version 1607066 (0.0008) [2023-12-28 06:48:34,674][106226] Updated weights for policy 0, policy_version 1607076 (0.0008) [2023-12-28 06:48:34,733][106226] Updated weights for policy 0, policy_version 1607086 (0.0008) [2023-12-28 06:48:34,793][106226] Updated weights for policy 0, policy_version 1607096 (0.0008) [2023-12-28 06:48:34,823][106225] Updated weights for policy 1, policy_version 1610716 (0.0010) [2023-12-28 06:48:34,877][106225] Updated weights for policy 1, policy_version 1610726 (0.0010) [2023-12-28 06:48:34,931][106225] Updated weights for policy 1, policy_version 1610736 (0.0009) [2023-12-28 06:48:35,548][106226] Updated weights for policy 0, policy_version 1607106 (0.0008) [2023-12-28 06:48:35,602][106226] Updated weights for policy 0, policy_version 1607116 (0.0008) [2023-12-28 06:48:35,608][106225] Updated weights for policy 1, policy_version 1610746 (0.0006) [2023-12-28 06:48:35,657][106225] Updated weights for policy 1, policy_version 1610756 (0.0005) [2023-12-28 06:48:35,665][106226] Updated weights for policy 0, policy_version 1607126 (0.0009) [2023-12-28 06:48:35,713][106225] Updated weights for policy 1, policy_version 1610766 (0.0005) [2023-12-28 06:48:35,776][106225] Updated weights for policy 1, policy_version 1610776 (0.0007) [2023-12-28 06:48:36,174][105115] Fps is (10 sec: 21299.4, 60 sec: 20207.0, 300 sec: 19910.7). Total num frames: 823910400. Throughput: 0: 10317.6, 1: 10029.2. Samples: 823921088. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:36,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.895')] [2023-12-28 06:48:36,431][106226] Updated weights for policy 0, policy_version 1607136 (0.0010) [2023-12-28 06:48:36,438][106225] Updated weights for policy 1, policy_version 1610786 (0.0010) [2023-12-28 06:48:36,500][106226] Updated weights for policy 0, policy_version 1607146 (0.0011) [2023-12-28 06:48:36,529][106225] Updated weights for policy 1, policy_version 1610796 (0.0011) [2023-12-28 06:48:36,569][106226] Updated weights for policy 0, policy_version 1607156 (0.0011) [2023-12-28 06:48:36,591][106225] Updated weights for policy 1, policy_version 1610806 (0.0011) [2023-12-28 06:48:37,267][106226] Updated weights for policy 0, policy_version 1607166 (0.0009) [2023-12-28 06:48:37,291][106225] Updated weights for policy 1, policy_version 1610816 (0.0011) [2023-12-28 06:48:37,317][106226] Updated weights for policy 0, policy_version 1607176 (0.0008) [2023-12-28 06:48:37,339][106225] Updated weights for policy 1, policy_version 1610826 (0.0010) [2023-12-28 06:48:37,369][106226] Updated weights for policy 0, policy_version 1607186 (0.0006) [2023-12-28 06:48:37,394][106225] Updated weights for policy 1, policy_version 1610836 (0.0010) [2023-12-28 06:48:38,035][106225] Updated weights for policy 1, policy_version 1610846 (0.0007) [2023-12-28 06:48:38,092][106225] Updated weights for policy 1, policy_version 1610856 (0.0006) [2023-12-28 06:48:38,096][106226] Updated weights for policy 0, policy_version 1607196 (0.0007) [2023-12-28 06:48:38,143][106225] Updated weights for policy 1, policy_version 1610866 (0.0006) [2023-12-28 06:48:38,145][106226] Updated weights for policy 0, policy_version 1607206 (0.0008) [2023-12-28 06:48:38,197][106226] Updated weights for policy 0, policy_version 1607216 (0.0006) [2023-12-28 06:48:38,880][106226] Updated weights for policy 0, policy_version 1607226 (0.0007) [2023-12-28 06:48:38,897][106225] Updated weights for policy 1, policy_version 1610876 (0.0006) [2023-12-28 06:48:38,930][106226] Updated weights for policy 0, policy_version 1607236 (0.0006) [2023-12-28 06:48:38,956][106225] Updated weights for policy 1, policy_version 1610886 (0.0006) [2023-12-28 06:48:38,989][106226] Updated weights for policy 0, policy_version 1607246 (0.0006) [2023-12-28 06:48:39,009][106225] Updated weights for policy 1, policy_version 1610896 (0.0007) [2023-12-28 06:48:39,054][106226] Updated weights for policy 0, policy_version 1607256 (0.0009) [2023-12-28 06:48:39,704][106225] Updated weights for policy 1, policy_version 1610906 (0.0006) [2023-12-28 06:48:39,755][106226] Updated weights for policy 0, policy_version 1607266 (0.0008) [2023-12-28 06:48:39,762][106225] Updated weights for policy 1, policy_version 1610916 (0.0008) [2023-12-28 06:48:39,821][106226] Updated weights for policy 0, policy_version 1607276 (0.0008) [2023-12-28 06:48:39,827][106225] Updated weights for policy 1, policy_version 1610926 (0.0007) [2023-12-28 06:48:39,883][106226] Updated weights for policy 0, policy_version 1607286 (0.0008) [2023-12-28 06:48:39,894][106225] Updated weights for policy 1, policy_version 1610936 (0.0007) [2023-12-28 06:48:40,601][106226] Updated weights for policy 0, policy_version 1607296 (0.0008) [2023-12-28 06:48:40,620][106225] Updated weights for policy 1, policy_version 1610946 (0.0007) [2023-12-28 06:48:40,655][106226] Updated weights for policy 0, policy_version 1607306 (0.0008) [2023-12-28 06:48:40,683][106225] Updated weights for policy 1, policy_version 1610956 (0.0008) [2023-12-28 06:48:40,709][106226] Updated weights for policy 0, policy_version 1607316 (0.0007) [2023-12-28 06:48:40,741][106225] Updated weights for policy 1, policy_version 1610966 (0.0008) [2023-12-28 06:48:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 824008704. Throughput: 0: 10270.7, 1: 10092.3. Samples: 823980500. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:41,176][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.404')] [2023-12-28 06:48:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001610968_412459008.pth... [2023-12-28 06:48:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001607320_411549696.pth... [2023-12-28 06:48:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001609784_412155904.pth [2023-12-28 06:48:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001606136_411246592.pth [2023-12-28 06:48:41,484][106225] Updated weights for policy 1, policy_version 1610976 (0.0008) [2023-12-28 06:48:41,488][106226] Updated weights for policy 0, policy_version 1607326 (0.0008) [2023-12-28 06:48:41,546][106225] Updated weights for policy 1, policy_version 1610986 (0.0008) [2023-12-28 06:48:41,552][106226] Updated weights for policy 0, policy_version 1607336 (0.0008) [2023-12-28 06:48:41,610][106225] Updated weights for policy 1, policy_version 1610996 (0.0006) [2023-12-28 06:48:41,621][106226] Updated weights for policy 0, policy_version 1607346 (0.0007) [2023-12-28 06:48:42,307][106225] Updated weights for policy 1, policy_version 1611006 (0.0007) [2023-12-28 06:48:42,377][106225] Updated weights for policy 1, policy_version 1611016 (0.0008) [2023-12-28 06:48:42,437][106226] Updated weights for policy 0, policy_version 1607356 (0.0008) [2023-12-28 06:48:42,446][106225] Updated weights for policy 1, policy_version 1611026 (0.0009) [2023-12-28 06:48:42,504][106226] Updated weights for policy 0, policy_version 1607366 (0.0007) [2023-12-28 06:48:42,565][106226] Updated weights for policy 0, policy_version 1607376 (0.0009) [2023-12-28 06:48:43,179][106226] Updated weights for policy 0, policy_version 1607386 (0.0006) [2023-12-28 06:48:43,216][106225] Updated weights for policy 1, policy_version 1611036 (0.0008) [2023-12-28 06:48:43,235][106226] Updated weights for policy 0, policy_version 1607396 (0.0005) [2023-12-28 06:48:43,266][106225] Updated weights for policy 1, policy_version 1611046 (0.0008) [2023-12-28 06:48:43,287][106226] Updated weights for policy 0, policy_version 1607406 (0.0005) [2023-12-28 06:48:43,327][106225] Updated weights for policy 1, policy_version 1611056 (0.0007) [2023-12-28 06:48:43,340][106226] Updated weights for policy 0, policy_version 1607416 (0.0007) [2023-12-28 06:48:43,996][106226] Updated weights for policy 0, policy_version 1607426 (0.0008) [2023-12-28 06:48:44,045][106226] Updated weights for policy 0, policy_version 1607436 (0.0008) [2023-12-28 06:48:44,081][106225] Updated weights for policy 1, policy_version 1611066 (0.0008) [2023-12-28 06:48:44,106][106226] Updated weights for policy 0, policy_version 1607446 (0.0006) [2023-12-28 06:48:44,144][106225] Updated weights for policy 1, policy_version 1611076 (0.0007) [2023-12-28 06:48:44,207][106225] Updated weights for policy 1, policy_version 1611086 (0.0009) [2023-12-28 06:48:44,252][106225] Updated weights for policy 1, policy_version 1611096 (0.0009) [2023-12-28 06:48:44,814][106226] Updated weights for policy 0, policy_version 1607456 (0.0008) [2023-12-28 06:48:44,863][106226] Updated weights for policy 0, policy_version 1607466 (0.0008) [2023-12-28 06:48:44,923][106226] Updated weights for policy 0, policy_version 1607476 (0.0009) [2023-12-28 06:48:45,017][106225] Updated weights for policy 1, policy_version 1611106 (0.0008) [2023-12-28 06:48:45,079][106225] Updated weights for policy 1, policy_version 1611116 (0.0007) [2023-12-28 06:48:45,147][106225] Updated weights for policy 1, policy_version 1611126 (0.0008) [2023-12-28 06:48:45,670][106226] Updated weights for policy 0, policy_version 1607486 (0.0008) [2023-12-28 06:48:45,731][106226] Updated weights for policy 0, policy_version 1607496 (0.0008) [2023-12-28 06:48:45,783][106226] Updated weights for policy 0, policy_version 1607506 (0.0009) [2023-12-28 06:48:45,856][106225] Updated weights for policy 1, policy_version 1611136 (0.0008) [2023-12-28 06:48:45,915][106225] Updated weights for policy 1, policy_version 1611146 (0.0008) [2023-12-28 06:48:45,975][106225] Updated weights for policy 1, policy_version 1611156 (0.0009) [2023-12-28 06:48:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 824107008. Throughput: 0: 10211.2, 1: 9983.0. Samples: 824094556. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:46,175][105115] Avg episode reward: [(0, '-4.603'), (1, '-4.725')] [2023-12-28 06:48:46,455][106226] Updated weights for policy 0, policy_version 1607516 (0.0008) [2023-12-28 06:48:46,514][106226] Updated weights for policy 0, policy_version 1607526 (0.0008) [2023-12-28 06:48:46,574][106226] Updated weights for policy 0, policy_version 1607536 (0.0007) [2023-12-28 06:48:46,754][106225] Updated weights for policy 1, policy_version 1611166 (0.0008) [2023-12-28 06:48:46,811][106225] Updated weights for policy 1, policy_version 1611176 (0.0008) [2023-12-28 06:48:46,863][106225] Updated weights for policy 1, policy_version 1611186 (0.0009) [2023-12-28 06:48:47,309][106226] Updated weights for policy 0, policy_version 1607546 (0.0009) [2023-12-28 06:48:47,357][106226] Updated weights for policy 0, policy_version 1607556 (0.0008) [2023-12-28 06:48:47,406][106226] Updated weights for policy 0, policy_version 1607566 (0.0008) [2023-12-28 06:48:47,454][106226] Updated weights for policy 0, policy_version 1607576 (0.0008) [2023-12-28 06:48:47,547][106225] Updated weights for policy 1, policy_version 1611196 (0.0008) [2023-12-28 06:48:47,605][106225] Updated weights for policy 1, policy_version 1611206 (0.0008) [2023-12-28 06:48:47,661][106225] Updated weights for policy 1, policy_version 1611216 (0.0009) [2023-12-28 06:48:48,203][106226] Updated weights for policy 0, policy_version 1607586 (0.0008) [2023-12-28 06:48:48,258][106226] Updated weights for policy 0, policy_version 1607596 (0.0008) [2023-12-28 06:48:48,312][106226] Updated weights for policy 0, policy_version 1607606 (0.0007) [2023-12-28 06:48:48,396][106225] Updated weights for policy 1, policy_version 1611226 (0.0009) [2023-12-28 06:48:48,461][106225] Updated weights for policy 1, policy_version 1611236 (0.0011) [2023-12-28 06:48:48,527][106225] Updated weights for policy 1, policy_version 1611246 (0.0010) [2023-12-28 06:48:48,589][106225] Updated weights for policy 1, policy_version 1611256 (0.0011) [2023-12-28 06:48:48,951][106226] Updated weights for policy 0, policy_version 1607616 (0.0007) [2023-12-28 06:48:49,014][106226] Updated weights for policy 0, policy_version 1607626 (0.0005) [2023-12-28 06:48:49,076][106226] Updated weights for policy 0, policy_version 1607636 (0.0008) [2023-12-28 06:48:49,267][106225] Updated weights for policy 1, policy_version 1611266 (0.0007) [2023-12-28 06:48:49,341][106225] Updated weights for policy 1, policy_version 1611277 (0.0008) [2023-12-28 06:48:49,403][106225] Updated weights for policy 1, policy_version 1611287 (0.0008) [2023-12-28 06:48:49,820][106226] Updated weights for policy 0, policy_version 1607646 (0.0010) [2023-12-28 06:48:49,893][106226] Updated weights for policy 0, policy_version 1607656 (0.0008) [2023-12-28 06:48:49,960][106226] Updated weights for policy 0, policy_version 1607666 (0.0008) [2023-12-28 06:48:50,120][106225] Updated weights for policy 1, policy_version 1611297 (0.0008) [2023-12-28 06:48:50,181][106225] Updated weights for policy 1, policy_version 1611307 (0.0009) [2023-12-28 06:48:50,236][106225] Updated weights for policy 1, policy_version 1611317 (0.0008) [2023-12-28 06:48:50,710][106226] Updated weights for policy 0, policy_version 1607676 (0.0009) [2023-12-28 06:48:50,775][106226] Updated weights for policy 0, policy_version 1607686 (0.0009) [2023-12-28 06:48:50,833][106226] Updated weights for policy 0, policy_version 1607696 (0.0008) [2023-12-28 06:48:50,975][106225] Updated weights for policy 1, policy_version 1611327 (0.0006) [2023-12-28 06:48:51,041][106225] Updated weights for policy 1, policy_version 1611337 (0.0006) [2023-12-28 06:48:51,104][106225] Updated weights for policy 1, policy_version 1611347 (0.0008) [2023-12-28 06:48:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 824205312. Throughput: 0: 10140.8, 1: 9862.8. Samples: 824209600. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:51,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.757')] [2023-12-28 06:48:51,642][106226] Updated weights for policy 0, policy_version 1607706 (0.0008) [2023-12-28 06:48:51,708][106226] Updated weights for policy 0, policy_version 1607716 (0.0009) [2023-12-28 06:48:51,783][106226] Updated weights for policy 0, policy_version 1607726 (0.0008) [2023-12-28 06:48:51,806][106225] Updated weights for policy 1, policy_version 1611357 (0.0007) [2023-12-28 06:48:51,836][106226] Updated weights for policy 0, policy_version 1607736 (0.0007) [2023-12-28 06:48:51,868][106225] Updated weights for policy 1, policy_version 1611367 (0.0007) [2023-12-28 06:48:51,921][106225] Updated weights for policy 1, policy_version 1611377 (0.0008) [2023-12-28 06:48:52,551][106226] Updated weights for policy 0, policy_version 1607746 (0.0009) [2023-12-28 06:48:52,630][106226] Updated weights for policy 0, policy_version 1607756 (0.0008) [2023-12-28 06:48:52,667][106225] Updated weights for policy 1, policy_version 1611387 (0.0008) [2023-12-28 06:48:52,689][106226] Updated weights for policy 0, policy_version 1607766 (0.0008) [2023-12-28 06:48:52,725][106225] Updated weights for policy 1, policy_version 1611397 (0.0008) [2023-12-28 06:48:52,781][106225] Updated weights for policy 1, policy_version 1611407 (0.0009) [2023-12-28 06:48:53,431][106226] Updated weights for policy 0, policy_version 1607776 (0.0005) [2023-12-28 06:48:53,435][106225] Updated weights for policy 1, policy_version 1611417 (0.0009) [2023-12-28 06:48:53,492][106226] Updated weights for policy 0, policy_version 1607786 (0.0006) [2023-12-28 06:48:53,500][106225] Updated weights for policy 1, policy_version 1611427 (0.0008) [2023-12-28 06:48:53,553][106226] Updated weights for policy 0, policy_version 1607796 (0.0005) [2023-12-28 06:48:53,561][106225] Updated weights for policy 1, policy_version 1611437 (0.0009) [2023-12-28 06:48:53,626][106225] Updated weights for policy 1, policy_version 1611447 (0.0008) [2023-12-28 06:48:54,148][106226] Updated weights for policy 0, policy_version 1607806 (0.0008) [2023-12-28 06:48:54,206][106226] Updated weights for policy 0, policy_version 1607816 (0.0008) [2023-12-28 06:48:54,257][106226] Updated weights for policy 0, policy_version 1607826 (0.0007) [2023-12-28 06:48:54,287][106225] Updated weights for policy 1, policy_version 1611457 (0.0008) [2023-12-28 06:48:54,330][106225] Updated weights for policy 1, policy_version 1611467 (0.0008) [2023-12-28 06:48:54,375][106225] Updated weights for policy 1, policy_version 1611477 (0.0008) [2023-12-28 06:48:54,945][106226] Updated weights for policy 0, policy_version 1607836 (0.0007) [2023-12-28 06:48:55,008][106226] Updated weights for policy 0, policy_version 1607846 (0.0008) [2023-12-28 06:48:55,074][106226] Updated weights for policy 0, policy_version 1607856 (0.0008) [2023-12-28 06:48:55,144][106225] Updated weights for policy 1, policy_version 1611487 (0.0008) [2023-12-28 06:48:55,198][106225] Updated weights for policy 1, policy_version 1611497 (0.0007) [2023-12-28 06:48:55,250][106225] Updated weights for policy 1, policy_version 1611507 (0.0008) [2023-12-28 06:48:55,748][106226] Updated weights for policy 0, policy_version 1607866 (0.0008) [2023-12-28 06:48:55,806][106226] Updated weights for policy 0, policy_version 1607876 (0.0005) [2023-12-28 06:48:55,867][106226] Updated weights for policy 0, policy_version 1607886 (0.0005) [2023-12-28 06:48:55,916][106226] Updated weights for policy 0, policy_version 1607896 (0.0008) [2023-12-28 06:48:56,026][106225] Updated weights for policy 1, policy_version 1611517 (0.0009) [2023-12-28 06:48:56,073][106225] Updated weights for policy 1, policy_version 1611527 (0.0007) [2023-12-28 06:48:56,130][106225] Updated weights for policy 1, policy_version 1611537 (0.0009) [2023-12-28 06:48:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 824303616. Throughput: 0: 10050.9, 1: 9840.7. Samples: 824267864. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:48:56,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-4.820')] [2023-12-28 06:48:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001607896_411697152.pth... [2023-12-28 06:48:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001611544_412606464.pth... [2023-12-28 06:48:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001610392_412311552.pth [2023-12-28 06:48:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001606744_411402240.pth [2023-12-28 06:48:56,598][106226] Updated weights for policy 0, policy_version 1607906 (0.0008) [2023-12-28 06:48:56,651][106226] Updated weights for policy 0, policy_version 1607916 (0.0009) [2023-12-28 06:48:56,701][106226] Updated weights for policy 0, policy_version 1607926 (0.0010) [2023-12-28 06:48:56,728][106225] Updated weights for policy 1, policy_version 1611547 (0.0009) [2023-12-28 06:48:56,786][106225] Updated weights for policy 1, policy_version 1611557 (0.0005) [2023-12-28 06:48:56,839][106225] Updated weights for policy 1, policy_version 1611567 (0.0005) [2023-12-28 06:48:57,328][106226] Updated weights for policy 0, policy_version 1607936 (0.0008) [2023-12-28 06:48:57,374][106225] Updated weights for policy 1, policy_version 1611577 (0.0006) [2023-12-28 06:48:57,390][106226] Updated weights for policy 0, policy_version 1607946 (0.0010) [2023-12-28 06:48:57,427][106225] Updated weights for policy 1, policy_version 1611587 (0.0006) [2023-12-28 06:48:57,449][106226] Updated weights for policy 0, policy_version 1607956 (0.0009) [2023-12-28 06:48:57,474][106225] Updated weights for policy 1, policy_version 1611597 (0.0006) [2023-12-28 06:48:57,525][106225] Updated weights for policy 1, policy_version 1611607 (0.0008) [2023-12-28 06:48:58,052][106226] Updated weights for policy 0, policy_version 1607966 (0.0008) [2023-12-28 06:48:58,102][106226] Updated weights for policy 0, policy_version 1607976 (0.0010) [2023-12-28 06:48:58,161][106226] Updated weights for policy 0, policy_version 1607986 (0.0006) [2023-12-28 06:48:58,175][106225] Updated weights for policy 1, policy_version 1611617 (0.0008) [2023-12-28 06:48:58,235][106225] Updated weights for policy 1, policy_version 1611627 (0.0009) [2023-12-28 06:48:58,299][106225] Updated weights for policy 1, policy_version 1611637 (0.0007) [2023-12-28 06:48:58,932][106226] Updated weights for policy 0, policy_version 1607996 (0.0007) [2023-12-28 06:48:59,000][106226] Updated weights for policy 0, policy_version 1608006 (0.0008) [2023-12-28 06:48:59,060][106226] Updated weights for policy 0, policy_version 1608016 (0.0009) [2023-12-28 06:48:59,128][106225] Updated weights for policy 1, policy_version 1611647 (0.0007) [2023-12-28 06:48:59,190][106225] Updated weights for policy 1, policy_version 1611657 (0.0008) [2023-12-28 06:48:59,257][106225] Updated weights for policy 1, policy_version 1611667 (0.0009) [2023-12-28 06:48:59,811][106226] Updated weights for policy 0, policy_version 1608026 (0.0010) [2023-12-28 06:48:59,880][106226] Updated weights for policy 0, policy_version 1608036 (0.0008) [2023-12-28 06:48:59,946][106226] Updated weights for policy 0, policy_version 1608046 (0.0011) [2023-12-28 06:49:00,014][106226] Updated weights for policy 0, policy_version 1608056 (0.0010) [2023-12-28 06:49:00,026][106225] Updated weights for policy 1, policy_version 1611677 (0.0008) [2023-12-28 06:49:00,076][106225] Updated weights for policy 1, policy_version 1611687 (0.0009) [2023-12-28 06:49:00,123][106225] Updated weights for policy 1, policy_version 1611697 (0.0010) [2023-12-28 06:49:00,672][106226] Updated weights for policy 0, policy_version 1608066 (0.0010) [2023-12-28 06:49:00,737][106226] Updated weights for policy 0, policy_version 1608076 (0.0010) [2023-12-28 06:49:00,793][106226] Updated weights for policy 0, policy_version 1608086 (0.0010) [2023-12-28 06:49:00,843][106225] Updated weights for policy 1, policy_version 1611707 (0.0008) [2023-12-28 06:49:00,892][106225] Updated weights for policy 1, policy_version 1611717 (0.0010) [2023-12-28 06:49:00,957][106225] Updated weights for policy 1, policy_version 1611727 (0.0010) [2023-12-28 06:49:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 824401920. Throughput: 0: 10080.4, 1: 9931.4. Samples: 824388712. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:01,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.540')] [2023-12-28 06:49:01,498][106226] Updated weights for policy 0, policy_version 1608096 (0.0009) [2023-12-28 06:49:01,562][106226] Updated weights for policy 0, policy_version 1608106 (0.0010) [2023-12-28 06:49:01,625][106226] Updated weights for policy 0, policy_version 1608116 (0.0010) [2023-12-28 06:49:01,710][106225] Updated weights for policy 1, policy_version 1611737 (0.0009) [2023-12-28 06:49:01,767][106225] Updated weights for policy 1, policy_version 1611747 (0.0008) [2023-12-28 06:49:01,816][106225] Updated weights for policy 1, policy_version 1611757 (0.0008) [2023-12-28 06:49:01,874][106225] Updated weights for policy 1, policy_version 1611767 (0.0010) [2023-12-28 06:49:02,326][106226] Updated weights for policy 0, policy_version 1608126 (0.0010) [2023-12-28 06:49:02,388][106226] Updated weights for policy 0, policy_version 1608136 (0.0009) [2023-12-28 06:49:02,445][106226] Updated weights for policy 0, policy_version 1608146 (0.0007) [2023-12-28 06:49:02,617][106225] Updated weights for policy 1, policy_version 1611777 (0.0010) [2023-12-28 06:49:02,674][106225] Updated weights for policy 1, policy_version 1611787 (0.0010) [2023-12-28 06:49:02,739][106225] Updated weights for policy 1, policy_version 1611797 (0.0010) [2023-12-28 06:49:03,127][106226] Updated weights for policy 0, policy_version 1608156 (0.0009) [2023-12-28 06:49:03,189][106226] Updated weights for policy 0, policy_version 1608166 (0.0010) [2023-12-28 06:49:03,248][106226] Updated weights for policy 0, policy_version 1608176 (0.0010) [2023-12-28 06:49:03,432][106225] Updated weights for policy 1, policy_version 1611807 (0.0010) [2023-12-28 06:49:03,495][106225] Updated weights for policy 1, policy_version 1611817 (0.0010) [2023-12-28 06:49:03,564][106225] Updated weights for policy 1, policy_version 1611827 (0.0011) [2023-12-28 06:49:03,854][106226] Updated weights for policy 0, policy_version 1608186 (0.0010) [2023-12-28 06:49:03,930][106226] Updated weights for policy 0, policy_version 1608196 (0.0008) [2023-12-28 06:49:03,990][106226] Updated weights for policy 0, policy_version 1608206 (0.0006) [2023-12-28 06:49:04,052][106226] Updated weights for policy 0, policy_version 1608216 (0.0010) [2023-12-28 06:49:04,284][106225] Updated weights for policy 1, policy_version 1611837 (0.0008) [2023-12-28 06:49:04,351][106225] Updated weights for policy 1, policy_version 1611847 (0.0007) [2023-12-28 06:49:04,414][106225] Updated weights for policy 1, policy_version 1611857 (0.0008) [2023-12-28 06:49:04,711][106226] Updated weights for policy 0, policy_version 1608226 (0.0011) [2023-12-28 06:49:04,768][106226] Updated weights for policy 0, policy_version 1608236 (0.0010) [2023-12-28 06:49:04,827][106226] Updated weights for policy 0, policy_version 1608246 (0.0010) [2023-12-28 06:49:05,133][106225] Updated weights for policy 1, policy_version 1611867 (0.0009) [2023-12-28 06:49:05,192][106225] Updated weights for policy 1, policy_version 1611877 (0.0010) [2023-12-28 06:49:05,251][106225] Updated weights for policy 1, policy_version 1611887 (0.0008) [2023-12-28 06:49:05,532][106226] Updated weights for policy 0, policy_version 1608256 (0.0010) [2023-12-28 06:49:05,597][106226] Updated weights for policy 0, policy_version 1608266 (0.0011) [2023-12-28 06:49:05,658][106226] Updated weights for policy 0, policy_version 1608276 (0.0010) [2023-12-28 06:49:05,922][106225] Updated weights for policy 1, policy_version 1611897 (0.0006) [2023-12-28 06:49:05,979][106225] Updated weights for policy 1, policy_version 1611907 (0.0008) [2023-12-28 06:49:06,043][106225] Updated weights for policy 1, policy_version 1611917 (0.0005) [2023-12-28 06:49:06,110][106225] Updated weights for policy 1, policy_version 1611927 (0.0010) [2023-12-28 06:49:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 824500224. Throughput: 0: 10038.9, 1: 9864.5. Samples: 824507424. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:06,180][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.478')] [2023-12-28 06:49:06,356][106226] Updated weights for policy 0, policy_version 1608286 (0.0009) [2023-12-28 06:49:06,411][106226] Updated weights for policy 0, policy_version 1608296 (0.0008) [2023-12-28 06:49:06,471][106226] Updated weights for policy 0, policy_version 1608306 (0.0008) [2023-12-28 06:49:06,758][106225] Updated weights for policy 1, policy_version 1611937 (0.0006) [2023-12-28 06:49:06,824][106225] Updated weights for policy 1, policy_version 1611947 (0.0005) [2023-12-28 06:49:06,890][106225] Updated weights for policy 1, policy_version 1611957 (0.0006) [2023-12-28 06:49:07,184][106226] Updated weights for policy 0, policy_version 1608316 (0.0009) [2023-12-28 06:49:07,242][106226] Updated weights for policy 0, policy_version 1608326 (0.0011) [2023-12-28 06:49:07,303][106226] Updated weights for policy 0, policy_version 1608336 (0.0010) [2023-12-28 06:49:07,495][106225] Updated weights for policy 1, policy_version 1611967 (0.0006) [2023-12-28 06:49:07,546][106225] Updated weights for policy 1, policy_version 1611977 (0.0005) [2023-12-28 06:49:07,601][106225] Updated weights for policy 1, policy_version 1611987 (0.0005) [2023-12-28 06:49:07,937][106226] Updated weights for policy 0, policy_version 1608346 (0.0009) [2023-12-28 06:49:07,990][106226] Updated weights for policy 0, policy_version 1608356 (0.0010) [2023-12-28 06:49:08,048][106226] Updated weights for policy 0, policy_version 1608366 (0.0010) [2023-12-28 06:49:08,114][106226] Updated weights for policy 0, policy_version 1608376 (0.0010) [2023-12-28 06:49:08,251][106225] Updated weights for policy 1, policy_version 1611997 (0.0008) [2023-12-28 06:49:08,305][106225] Updated weights for policy 1, policy_version 1612007 (0.0010) [2023-12-28 06:49:08,366][106225] Updated weights for policy 1, policy_version 1612017 (0.0010) [2023-12-28 06:49:08,820][106226] Updated weights for policy 0, policy_version 1608386 (0.0006) [2023-12-28 06:49:08,885][106226] Updated weights for policy 0, policy_version 1608396 (0.0006) [2023-12-28 06:49:08,951][106226] Updated weights for policy 0, policy_version 1608406 (0.0006) [2023-12-28 06:49:09,098][106225] Updated weights for policy 1, policy_version 1612027 (0.0009) [2023-12-28 06:49:09,158][106225] Updated weights for policy 1, policy_version 1612037 (0.0009) [2023-12-28 06:49:09,205][106225] Updated weights for policy 1, policy_version 1612047 (0.0010) [2023-12-28 06:49:09,632][106226] Updated weights for policy 0, policy_version 1608416 (0.0007) [2023-12-28 06:49:09,697][106226] Updated weights for policy 0, policy_version 1608426 (0.0008) [2023-12-28 06:49:09,762][106226] Updated weights for policy 0, policy_version 1608436 (0.0011) [2023-12-28 06:49:09,972][106225] Updated weights for policy 1, policy_version 1612057 (0.0010) [2023-12-28 06:49:10,040][106225] Updated weights for policy 1, policy_version 1612067 (0.0010) [2023-12-28 06:49:10,091][106225] Updated weights for policy 1, policy_version 1612077 (0.0010) [2023-12-28 06:49:10,143][106225] Updated weights for policy 1, policy_version 1612087 (0.0010) [2023-12-28 06:49:10,449][106226] Updated weights for policy 0, policy_version 1608446 (0.0008) [2023-12-28 06:49:10,519][106226] Updated weights for policy 0, policy_version 1608456 (0.0009) [2023-12-28 06:49:10,584][106226] Updated weights for policy 0, policy_version 1608466 (0.0008) [2023-12-28 06:49:10,816][106225] Updated weights for policy 1, policy_version 1612097 (0.0010) [2023-12-28 06:49:10,869][106225] Updated weights for policy 1, policy_version 1612107 (0.0009) [2023-12-28 06:49:10,929][106225] Updated weights for policy 1, policy_version 1612117 (0.0008) [2023-12-28 06:49:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 824598528. Throughput: 0: 10069.4, 1: 9937.8. Samples: 824568964. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:11,175][105115] Avg episode reward: [(0, '-4.807'), (1, '-4.576')] [2023-12-28 06:49:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001612120_412753920.pth... [2023-12-28 06:49:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001610968_412459008.pth [2023-12-28 06:49:11,212][106226] Updated weights for policy 0, policy_version 1608476 (0.0007) [2023-12-28 06:49:11,275][106226] Updated weights for policy 0, policy_version 1608486 (0.0008) [2023-12-28 06:49:11,335][106226] Updated weights for policy 0, policy_version 1608496 (0.0008) [2023-12-28 06:49:11,389][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001608504_411852800.pth... [2023-12-28 06:49:11,393][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001607320_411549696.pth [2023-12-28 06:49:11,753][106225] Updated weights for policy 1, policy_version 1612127 (0.0010) [2023-12-28 06:49:11,815][106225] Updated weights for policy 1, policy_version 1612137 (0.0008) [2023-12-28 06:49:11,873][106225] Updated weights for policy 1, policy_version 1612147 (0.0008) [2023-12-28 06:49:12,012][106226] Updated weights for policy 0, policy_version 1608506 (0.0009) [2023-12-28 06:49:12,077][106226] Updated weights for policy 0, policy_version 1608516 (0.0009) [2023-12-28 06:49:12,141][106226] Updated weights for policy 0, policy_version 1608526 (0.0008) [2023-12-28 06:49:12,204][106226] Updated weights for policy 0, policy_version 1608536 (0.0008) [2023-12-28 06:49:12,643][106225] Updated weights for policy 1, policy_version 1612157 (0.0009) [2023-12-28 06:49:12,705][106225] Updated weights for policy 1, policy_version 1612167 (0.0011) [2023-12-28 06:49:12,764][106225] Updated weights for policy 1, policy_version 1612177 (0.0010) [2023-12-28 06:49:12,957][106226] Updated weights for policy 0, policy_version 1608546 (0.0008) [2023-12-28 06:49:13,022][106226] Updated weights for policy 0, policy_version 1608556 (0.0007) [2023-12-28 06:49:13,078][106226] Updated weights for policy 0, policy_version 1608566 (0.0009) [2023-12-28 06:49:13,457][106225] Updated weights for policy 1, policy_version 1612187 (0.0009) [2023-12-28 06:49:13,518][106225] Updated weights for policy 1, policy_version 1612197 (0.0005) [2023-12-28 06:49:13,584][106225] Updated weights for policy 1, policy_version 1612207 (0.0005) [2023-12-28 06:49:13,723][106226] Updated weights for policy 0, policy_version 1608576 (0.0008) [2023-12-28 06:49:13,773][106226] Updated weights for policy 0, policy_version 1608586 (0.0009) [2023-12-28 06:49:13,836][106226] Updated weights for policy 0, policy_version 1608596 (0.0011) [2023-12-28 06:49:14,167][106225] Updated weights for policy 1, policy_version 1612217 (0.0007) [2023-12-28 06:49:14,217][106225] Updated weights for policy 1, policy_version 1612227 (0.0010) [2023-12-28 06:49:14,274][106225] Updated weights for policy 1, policy_version 1612237 (0.0009) [2023-12-28 06:49:14,340][106225] Updated weights for policy 1, policy_version 1612247 (0.0010) [2023-12-28 06:49:14,539][106226] Updated weights for policy 0, policy_version 1608606 (0.0009) [2023-12-28 06:49:14,595][106226] Updated weights for policy 0, policy_version 1608616 (0.0010) [2023-12-28 06:49:14,645][106226] Updated weights for policy 0, policy_version 1608626 (0.0010) [2023-12-28 06:49:15,062][106225] Updated weights for policy 1, policy_version 1612257 (0.0006) [2023-12-28 06:49:15,123][106225] Updated weights for policy 1, policy_version 1612267 (0.0008) [2023-12-28 06:49:15,179][106225] Updated weights for policy 1, policy_version 1612277 (0.0010) [2023-12-28 06:49:15,409][106226] Updated weights for policy 0, policy_version 1608636 (0.0010) [2023-12-28 06:49:15,475][106226] Updated weights for policy 0, policy_version 1608646 (0.0009) [2023-12-28 06:49:15,538][106226] Updated weights for policy 0, policy_version 1608656 (0.0011) [2023-12-28 06:49:15,843][106225] Updated weights for policy 1, policy_version 1612287 (0.0007) [2023-12-28 06:49:15,902][106225] Updated weights for policy 1, policy_version 1612297 (0.0008) [2023-12-28 06:49:15,964][106225] Updated weights for policy 1, policy_version 1612307 (0.0008) [2023-12-28 06:49:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 824696832. Throughput: 0: 9913.7, 1: 9799.0. Samples: 824686092. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:16,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.785')] [2023-12-28 06:49:16,265][106226] Updated weights for policy 0, policy_version 1608666 (0.0010) [2023-12-28 06:49:16,329][106226] Updated weights for policy 0, policy_version 1608676 (0.0008) [2023-12-28 06:49:16,390][106226] Updated weights for policy 0, policy_version 1608686 (0.0008) [2023-12-28 06:49:16,446][106226] Updated weights for policy 0, policy_version 1608696 (0.0008) [2023-12-28 06:49:16,694][106225] Updated weights for policy 1, policy_version 1612317 (0.0009) [2023-12-28 06:49:16,744][106225] Updated weights for policy 1, policy_version 1612327 (0.0010) [2023-12-28 06:49:16,811][106225] Updated weights for policy 1, policy_version 1612337 (0.0010) [2023-12-28 06:49:17,198][106226] Updated weights for policy 0, policy_version 1608706 (0.0008) [2023-12-28 06:49:17,253][106226] Updated weights for policy 0, policy_version 1608716 (0.0008) [2023-12-28 06:49:17,303][106226] Updated weights for policy 0, policy_version 1608726 (0.0008) [2023-12-28 06:49:17,530][106225] Updated weights for policy 1, policy_version 1612347 (0.0010) [2023-12-28 06:49:17,586][106225] Updated weights for policy 1, policy_version 1612357 (0.0010) [2023-12-28 06:49:17,635][106225] Updated weights for policy 1, policy_version 1612367 (0.0010) [2023-12-28 06:49:18,050][106226] Updated weights for policy 0, policy_version 1608736 (0.0007) [2023-12-28 06:49:18,098][106226] Updated weights for policy 0, policy_version 1608746 (0.0008) [2023-12-28 06:49:18,149][106226] Updated weights for policy 0, policy_version 1608756 (0.0007) [2023-12-28 06:49:18,390][106225] Updated weights for policy 1, policy_version 1612377 (0.0010) [2023-12-28 06:49:18,452][106225] Updated weights for policy 1, policy_version 1612387 (0.0011) [2023-12-28 06:49:18,513][106225] Updated weights for policy 1, policy_version 1612397 (0.0010) [2023-12-28 06:49:18,567][106225] Updated weights for policy 1, policy_version 1612407 (0.0010) [2023-12-28 06:49:18,926][106226] Updated weights for policy 0, policy_version 1608766 (0.0008) [2023-12-28 06:49:18,978][106226] Updated weights for policy 0, policy_version 1608776 (0.0008) [2023-12-28 06:49:19,028][106226] Updated weights for policy 0, policy_version 1608786 (0.0008) [2023-12-28 06:49:19,299][106225] Updated weights for policy 1, policy_version 1612417 (0.0010) [2023-12-28 06:49:19,362][106225] Updated weights for policy 1, policy_version 1612427 (0.0010) [2023-12-28 06:49:19,422][106225] Updated weights for policy 1, policy_version 1612437 (0.0010) [2023-12-28 06:49:19,828][106226] Updated weights for policy 0, policy_version 1608796 (0.0007) [2023-12-28 06:49:19,896][106226] Updated weights for policy 0, policy_version 1608806 (0.0009) [2023-12-28 06:49:19,965][106226] Updated weights for policy 0, policy_version 1608816 (0.0008) [2023-12-28 06:49:20,088][106225] Updated weights for policy 1, policy_version 1612447 (0.0013) [2023-12-28 06:49:20,154][106225] Updated weights for policy 1, policy_version 1612457 (0.0011) [2023-12-28 06:49:20,212][106225] Updated weights for policy 1, policy_version 1612467 (0.0010) [2023-12-28 06:49:20,729][106226] Updated weights for policy 0, policy_version 1608826 (0.0008) [2023-12-28 06:49:20,791][106226] Updated weights for policy 0, policy_version 1608836 (0.0008) [2023-12-28 06:49:20,857][106226] Updated weights for policy 0, policy_version 1608846 (0.0007) [2023-12-28 06:49:20,920][106226] Updated weights for policy 0, policy_version 1608856 (0.0008) [2023-12-28 06:49:20,957][106225] Updated weights for policy 1, policy_version 1612477 (0.0010) [2023-12-28 06:49:21,010][106225] Updated weights for policy 1, policy_version 1612487 (0.0010) [2023-12-28 06:49:21,075][106225] Updated weights for policy 1, policy_version 1612497 (0.0010) [2023-12-28 06:49:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 824795136. Throughput: 0: 9776.0, 1: 9737.9. Samples: 824799216. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:21,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.744')] [2023-12-28 06:49:21,733][106226] Updated weights for policy 0, policy_version 1608866 (0.0008) [2023-12-28 06:49:21,796][106226] Updated weights for policy 0, policy_version 1608876 (0.0007) [2023-12-28 06:49:21,860][106226] Updated weights for policy 0, policy_version 1608886 (0.0008) [2023-12-28 06:49:21,888][106225] Updated weights for policy 1, policy_version 1612507 (0.0011) [2023-12-28 06:49:21,951][106225] Updated weights for policy 1, policy_version 1612517 (0.0008) [2023-12-28 06:49:22,013][106225] Updated weights for policy 1, policy_version 1612527 (0.0010) [2023-12-28 06:49:22,653][106226] Updated weights for policy 0, policy_version 1608896 (0.0007) [2023-12-28 06:49:22,711][106226] Updated weights for policy 0, policy_version 1608906 (0.0008) [2023-12-28 06:49:22,749][106225] Updated weights for policy 1, policy_version 1612537 (0.0010) [2023-12-28 06:49:22,768][106226] Updated weights for policy 0, policy_version 1608916 (0.0009) [2023-12-28 06:49:22,808][106225] Updated weights for policy 1, policy_version 1612547 (0.0010) [2023-12-28 06:49:22,870][106225] Updated weights for policy 1, policy_version 1612557 (0.0011) [2023-12-28 06:49:22,931][106225] Updated weights for policy 1, policy_version 1612567 (0.0011) [2023-12-28 06:49:23,527][106226] Updated weights for policy 0, policy_version 1608926 (0.0009) [2023-12-28 06:49:23,579][106226] Updated weights for policy 0, policy_version 1608936 (0.0008) [2023-12-28 06:49:23,594][106225] Updated weights for policy 1, policy_version 1612577 (0.0010) [2023-12-28 06:49:23,627][106226] Updated weights for policy 0, policy_version 1608946 (0.0005) [2023-12-28 06:49:23,645][106225] Updated weights for policy 1, policy_version 1612587 (0.0010) [2023-12-28 06:49:23,698][106225] Updated weights for policy 1, policy_version 1612597 (0.0007) [2023-12-28 06:49:24,332][106225] Updated weights for policy 1, policy_version 1612607 (0.0008) [2023-12-28 06:49:24,358][106226] Updated weights for policy 0, policy_version 1608956 (0.0007) [2023-12-28 06:49:24,389][106225] Updated weights for policy 1, policy_version 1612617 (0.0006) [2023-12-28 06:49:24,414][106226] Updated weights for policy 0, policy_version 1608966 (0.0007) [2023-12-28 06:49:24,448][106225] Updated weights for policy 1, policy_version 1612627 (0.0007) [2023-12-28 06:49:24,472][106226] Updated weights for policy 0, policy_version 1608976 (0.0006) [2023-12-28 06:49:25,034][106225] Updated weights for policy 1, policy_version 1612637 (0.0006) [2023-12-28 06:49:25,087][106225] Updated weights for policy 1, policy_version 1612647 (0.0005) [2023-12-28 06:49:25,135][106225] Updated weights for policy 1, policy_version 1612657 (0.0007) [2023-12-28 06:49:25,160][106226] Updated weights for policy 0, policy_version 1608986 (0.0007) [2023-12-28 06:49:25,210][106226] Updated weights for policy 0, policy_version 1608996 (0.0008) [2023-12-28 06:49:25,272][106226] Updated weights for policy 0, policy_version 1609006 (0.0008) [2023-12-28 06:49:25,320][106226] Updated weights for policy 0, policy_version 1609016 (0.0009) [2023-12-28 06:49:25,823][106225] Updated weights for policy 1, policy_version 1612667 (0.0006) [2023-12-28 06:49:25,880][106225] Updated weights for policy 1, policy_version 1612677 (0.0005) [2023-12-28 06:49:25,935][106225] Updated weights for policy 1, policy_version 1612687 (0.0005) [2023-12-28 06:49:26,070][106226] Updated weights for policy 0, policy_version 1609026 (0.0008) [2023-12-28 06:49:26,127][106226] Updated weights for policy 0, policy_version 1609036 (0.0008) [2023-12-28 06:49:26,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 824885248. Throughput: 0: 9730.7, 1: 9685.1. Samples: 824854208. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:26,176][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.955')] [2023-12-28 06:49:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001612696_412901376.pth... [2023-12-28 06:49:26,186][106226] Updated weights for policy 0, policy_version 1609046 (0.0009) [2023-12-28 06:49:26,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001609048_411992064.pth... [2023-12-28 06:49:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001611544_412606464.pth [2023-12-28 06:49:26,197][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001607896_411697152.pth [2023-12-28 06:49:26,483][106225] Updated weights for policy 1, policy_version 1612697 (0.0006) [2023-12-28 06:49:26,532][106225] Updated weights for policy 1, policy_version 1612707 (0.0005) [2023-12-28 06:49:26,579][106225] Updated weights for policy 1, policy_version 1612717 (0.0008) [2023-12-28 06:49:26,625][106225] Updated weights for policy 1, policy_version 1612727 (0.0010) [2023-12-28 06:49:26,799][106226] Updated weights for policy 0, policy_version 1609056 (0.0008) [2023-12-28 06:49:26,860][106226] Updated weights for policy 0, policy_version 1609066 (0.0007) [2023-12-28 06:49:26,917][106226] Updated weights for policy 0, policy_version 1609076 (0.0008) [2023-12-28 06:49:27,341][106225] Updated weights for policy 1, policy_version 1612737 (0.0008) [2023-12-28 06:49:27,387][106225] Updated weights for policy 1, policy_version 1612747 (0.0008) [2023-12-28 06:49:27,430][106225] Updated weights for policy 1, policy_version 1612757 (0.0007) [2023-12-28 06:49:27,645][106226] Updated weights for policy 0, policy_version 1609086 (0.0009) [2023-12-28 06:49:27,713][106226] Updated weights for policy 0, policy_version 1609096 (0.0009) [2023-12-28 06:49:27,771][106226] Updated weights for policy 0, policy_version 1609106 (0.0008) [2023-12-28 06:49:28,026][106225] Updated weights for policy 1, policy_version 1612767 (0.0007) [2023-12-28 06:49:28,075][106225] Updated weights for policy 1, policy_version 1612777 (0.0007) [2023-12-28 06:49:28,120][106225] Updated weights for policy 1, policy_version 1612787 (0.0005) [2023-12-28 06:49:28,507][106226] Updated weights for policy 0, policy_version 1609116 (0.0009) [2023-12-28 06:49:28,565][106226] Updated weights for policy 0, policy_version 1609126 (0.0008) [2023-12-28 06:49:28,624][106226] Updated weights for policy 0, policy_version 1609136 (0.0008) [2023-12-28 06:49:28,811][106225] Updated weights for policy 1, policy_version 1612797 (0.0006) [2023-12-28 06:49:28,875][106225] Updated weights for policy 1, policy_version 1612807 (0.0009) [2023-12-28 06:49:28,934][106225] Updated weights for policy 1, policy_version 1612817 (0.0008) [2023-12-28 06:49:29,355][106226] Updated weights for policy 0, policy_version 1609146 (0.0009) [2023-12-28 06:49:29,418][106226] Updated weights for policy 0, policy_version 1609156 (0.0008) [2023-12-28 06:49:29,482][106226] Updated weights for policy 0, policy_version 1609166 (0.0009) [2023-12-28 06:49:29,542][106226] Updated weights for policy 0, policy_version 1609176 (0.0006) [2023-12-28 06:49:29,571][106225] Updated weights for policy 1, policy_version 1612827 (0.0007) [2023-12-28 06:49:29,621][106225] Updated weights for policy 1, policy_version 1612837 (0.0010) [2023-12-28 06:49:29,668][106225] Updated weights for policy 1, policy_version 1612847 (0.0010) [2023-12-28 06:49:30,244][106226] Updated weights for policy 0, policy_version 1609186 (0.0007) [2023-12-28 06:49:30,309][106226] Updated weights for policy 0, policy_version 1609196 (0.0008) [2023-12-28 06:49:30,373][106226] Updated weights for policy 0, policy_version 1609206 (0.0008) [2023-12-28 06:49:30,427][106225] Updated weights for policy 1, policy_version 1612857 (0.0010) [2023-12-28 06:49:30,477][106225] Updated weights for policy 1, policy_version 1612867 (0.0010) [2023-12-28 06:49:30,527][106225] Updated weights for policy 1, policy_version 1612877 (0.0010) [2023-12-28 06:49:30,587][106225] Updated weights for policy 1, policy_version 1612887 (0.0007) [2023-12-28 06:49:31,070][106226] Updated weights for policy 0, policy_version 1609216 (0.0007) [2023-12-28 06:49:31,137][106226] Updated weights for policy 0, policy_version 1609226 (0.0008) [2023-12-28 06:49:31,175][105115] Fps is (10 sec: 18840.1, 60 sec: 19524.0, 300 sec: 19855.1). Total num frames: 824983552. Throughput: 0: 9756.2, 1: 9886.9. Samples: 824978508. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:31,176][105115] Avg episode reward: [(0, '-4.478'), (1, '-4.561')] [2023-12-28 06:49:31,200][106226] Updated weights for policy 0, policy_version 1609236 (0.0009) [2023-12-28 06:49:31,305][106225] Updated weights for policy 1, policy_version 1612897 (0.0008) [2023-12-28 06:49:31,375][106225] Updated weights for policy 1, policy_version 1612907 (0.0009) [2023-12-28 06:49:31,439][106225] Updated weights for policy 1, policy_version 1612917 (0.0009) [2023-12-28 06:49:31,930][106226] Updated weights for policy 0, policy_version 1609246 (0.0009) [2023-12-28 06:49:31,979][106226] Updated weights for policy 0, policy_version 1609256 (0.0008) [2023-12-28 06:49:32,042][106226] Updated weights for policy 0, policy_version 1609266 (0.0009) [2023-12-28 06:49:32,135][106225] Updated weights for policy 1, policy_version 1612927 (0.0005) [2023-12-28 06:49:32,183][106225] Updated weights for policy 1, policy_version 1612937 (0.0008) [2023-12-28 06:49:32,230][106225] Updated weights for policy 1, policy_version 1612947 (0.0008) [2023-12-28 06:49:32,841][106226] Updated weights for policy 0, policy_version 1609276 (0.0008) [2023-12-28 06:49:32,865][106225] Updated weights for policy 1, policy_version 1612957 (0.0010) [2023-12-28 06:49:32,901][106226] Updated weights for policy 0, policy_version 1609286 (0.0006) [2023-12-28 06:49:32,924][106225] Updated weights for policy 1, policy_version 1612967 (0.0009) [2023-12-28 06:49:32,959][106226] Updated weights for policy 0, policy_version 1609296 (0.0006) [2023-12-28 06:49:32,983][106225] Updated weights for policy 1, policy_version 1612977 (0.0010) [2023-12-28 06:49:33,557][106225] Updated weights for policy 1, policy_version 1612987 (0.0009) [2023-12-28 06:49:33,615][106225] Updated weights for policy 1, policy_version 1612997 (0.0006) [2023-12-28 06:49:33,670][106225] Updated weights for policy 1, policy_version 1613007 (0.0009) [2023-12-28 06:49:33,740][106226] Updated weights for policy 0, policy_version 1609306 (0.0007) [2023-12-28 06:49:33,793][106226] Updated weights for policy 0, policy_version 1609316 (0.0008) [2023-12-28 06:49:33,859][106226] Updated weights for policy 0, policy_version 1609326 (0.0009) [2023-12-28 06:49:33,921][106226] Updated weights for policy 0, policy_version 1609336 (0.0010) [2023-12-28 06:49:34,188][106225] Updated weights for policy 1, policy_version 1613017 (0.0005) [2023-12-28 06:49:34,258][106225] Updated weights for policy 1, policy_version 1613027 (0.0006) [2023-12-28 06:49:34,329][106225] Updated weights for policy 1, policy_version 1613037 (0.0009) [2023-12-28 06:49:34,391][106225] Updated weights for policy 1, policy_version 1613047 (0.0011) [2023-12-28 06:49:34,744][106226] Updated weights for policy 0, policy_version 1609346 (0.0008) [2023-12-28 06:49:34,800][106226] Updated weights for policy 0, policy_version 1609356 (0.0008) [2023-12-28 06:49:34,860][106226] Updated weights for policy 0, policy_version 1609366 (0.0008) [2023-12-28 06:49:35,058][106225] Updated weights for policy 1, policy_version 1613057 (0.0008) [2023-12-28 06:49:35,109][106225] Updated weights for policy 1, policy_version 1613067 (0.0007) [2023-12-28 06:49:35,170][106225] Updated weights for policy 1, policy_version 1613077 (0.0007) [2023-12-28 06:49:35,594][106226] Updated weights for policy 0, policy_version 1609376 (0.0008) [2023-12-28 06:49:35,651][106226] Updated weights for policy 0, policy_version 1609386 (0.0008) [2023-12-28 06:49:35,697][106226] Updated weights for policy 0, policy_version 1609396 (0.0008) [2023-12-28 06:49:35,884][106225] Updated weights for policy 1, policy_version 1613087 (0.0011) [2023-12-28 06:49:35,946][106225] Updated weights for policy 1, policy_version 1613097 (0.0009) [2023-12-28 06:49:36,002][106225] Updated weights for policy 1, policy_version 1613107 (0.0008) [2023-12-28 06:49:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 825090048. Throughput: 0: 9701.0, 1: 10014.7. Samples: 825096808. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:36,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-5.047')] [2023-12-28 06:49:36,461][106226] Updated weights for policy 0, policy_version 1609406 (0.0006) [2023-12-28 06:49:36,528][106226] Updated weights for policy 0, policy_version 1609416 (0.0006) [2023-12-28 06:49:36,586][106226] Updated weights for policy 0, policy_version 1609426 (0.0006) [2023-12-28 06:49:36,763][106225] Updated weights for policy 1, policy_version 1613117 (0.0009) [2023-12-28 06:49:36,822][106225] Updated weights for policy 1, policy_version 1613127 (0.0010) [2023-12-28 06:49:36,886][106225] Updated weights for policy 1, policy_version 1613137 (0.0008) [2023-12-28 06:49:37,202][106226] Updated weights for policy 0, policy_version 1609436 (0.0009) [2023-12-28 06:49:37,261][106226] Updated weights for policy 0, policy_version 1609446 (0.0011) [2023-12-28 06:49:37,315][106226] Updated weights for policy 0, policy_version 1609456 (0.0009) [2023-12-28 06:49:37,607][106225] Updated weights for policy 1, policy_version 1613147 (0.0008) [2023-12-28 06:49:37,670][106225] Updated weights for policy 1, policy_version 1613157 (0.0007) [2023-12-28 06:49:37,725][106225] Updated weights for policy 1, policy_version 1613167 (0.0007) [2023-12-28 06:49:37,999][106226] Updated weights for policy 0, policy_version 1609466 (0.0008) [2023-12-28 06:49:38,058][106226] Updated weights for policy 0, policy_version 1609476 (0.0009) [2023-12-28 06:49:38,120][106226] Updated weights for policy 0, policy_version 1609486 (0.0010) [2023-12-28 06:49:38,184][106226] Updated weights for policy 0, policy_version 1609496 (0.0010) [2023-12-28 06:49:38,441][106225] Updated weights for policy 1, policy_version 1613177 (0.0007) [2023-12-28 06:49:38,505][106225] Updated weights for policy 1, policy_version 1613187 (0.0009) [2023-12-28 06:49:38,561][106225] Updated weights for policy 1, policy_version 1613197 (0.0009) [2023-12-28 06:49:38,627][106225] Updated weights for policy 1, policy_version 1613207 (0.0010) [2023-12-28 06:49:38,842][106226] Updated weights for policy 0, policy_version 1609506 (0.0009) [2023-12-28 06:49:38,896][106226] Updated weights for policy 0, policy_version 1609516 (0.0009) [2023-12-28 06:49:38,951][106226] Updated weights for policy 0, policy_version 1609526 (0.0008) [2023-12-28 06:49:39,250][106225] Updated weights for policy 1, policy_version 1613217 (0.0007) [2023-12-28 06:49:39,315][106225] Updated weights for policy 1, policy_version 1613227 (0.0009) [2023-12-28 06:49:39,383][106225] Updated weights for policy 1, policy_version 1613237 (0.0008) [2023-12-28 06:49:39,787][106226] Updated weights for policy 0, policy_version 1609536 (0.0007) [2023-12-28 06:49:39,856][106226] Updated weights for policy 0, policy_version 1609546 (0.0008) [2023-12-28 06:49:39,909][106226] Updated weights for policy 0, policy_version 1609556 (0.0009) [2023-12-28 06:49:40,126][106225] Updated weights for policy 1, policy_version 1613247 (0.0008) [2023-12-28 06:49:40,180][106225] Updated weights for policy 1, policy_version 1613257 (0.0009) [2023-12-28 06:49:40,237][106225] Updated weights for policy 1, policy_version 1613267 (0.0009) [2023-12-28 06:49:40,676][106226] Updated weights for policy 0, policy_version 1609566 (0.0009) [2023-12-28 06:49:40,729][106226] Updated weights for policy 0, policy_version 1609576 (0.0008) [2023-12-28 06:49:40,783][106226] Updated weights for policy 0, policy_version 1609586 (0.0008) [2023-12-28 06:49:40,914][106225] Updated weights for policy 1, policy_version 1613277 (0.0008) [2023-12-28 06:49:40,961][106225] Updated weights for policy 1, policy_version 1613287 (0.0008) [2023-12-28 06:49:41,008][106225] Updated weights for policy 1, policy_version 1613297 (0.0008) [2023-12-28 06:49:41,175][105115] Fps is (10 sec: 20481.3, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 825188352. Throughput: 0: 9727.1, 1: 9995.6. Samples: 825155388. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:41,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.689')] [2023-12-28 06:49:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001609592_412131328.pth... [2023-12-28 06:49:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001613304_413057024.pth... [2023-12-28 06:49:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001608504_411852800.pth [2023-12-28 06:49:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001612120_412753920.pth [2023-12-28 06:49:41,586][106226] Updated weights for policy 0, policy_version 1609596 (0.0009) [2023-12-28 06:49:41,653][106226] Updated weights for policy 0, policy_version 1609606 (0.0008) [2023-12-28 06:49:41,711][106226] Updated weights for policy 0, policy_version 1609616 (0.0008) [2023-12-28 06:49:41,846][106225] Updated weights for policy 1, policy_version 1613307 (0.0007) [2023-12-28 06:49:41,915][106225] Updated weights for policy 1, policy_version 1613317 (0.0008) [2023-12-28 06:49:41,971][106225] Updated weights for policy 1, policy_version 1613327 (0.0008) [2023-12-28 06:49:42,485][106226] Updated weights for policy 0, policy_version 1609626 (0.0008) [2023-12-28 06:49:42,537][106226] Updated weights for policy 0, policy_version 1609636 (0.0009) [2023-12-28 06:49:42,592][106226] Updated weights for policy 0, policy_version 1609646 (0.0006) [2023-12-28 06:49:42,654][106226] Updated weights for policy 0, policy_version 1609656 (0.0007) [2023-12-28 06:49:42,706][106225] Updated weights for policy 1, policy_version 1613337 (0.0008) [2023-12-28 06:49:42,762][106225] Updated weights for policy 1, policy_version 1613347 (0.0008) [2023-12-28 06:49:42,811][106225] Updated weights for policy 1, policy_version 1613357 (0.0008) [2023-12-28 06:49:42,868][106225] Updated weights for policy 1, policy_version 1613367 (0.0008) [2023-12-28 06:49:43,441][106226] Updated weights for policy 0, policy_version 1609666 (0.0006) [2023-12-28 06:49:43,508][106226] Updated weights for policy 0, policy_version 1609676 (0.0006) [2023-12-28 06:49:43,544][106225] Updated weights for policy 1, policy_version 1613377 (0.0009) [2023-12-28 06:49:43,575][106226] Updated weights for policy 0, policy_version 1609686 (0.0006) [2023-12-28 06:49:43,605][106225] Updated weights for policy 1, policy_version 1613387 (0.0007) [2023-12-28 06:49:43,657][106225] Updated weights for policy 1, policy_version 1613397 (0.0008) [2023-12-28 06:49:44,220][106226] Updated weights for policy 0, policy_version 1609696 (0.0009) [2023-12-28 06:49:44,283][106226] Updated weights for policy 0, policy_version 1609706 (0.0008) [2023-12-28 06:49:44,340][106226] Updated weights for policy 0, policy_version 1609716 (0.0008) [2023-12-28 06:49:44,354][106225] Updated weights for policy 1, policy_version 1613407 (0.0006) [2023-12-28 06:49:44,405][106225] Updated weights for policy 1, policy_version 1613417 (0.0007) [2023-12-28 06:49:44,461][106225] Updated weights for policy 1, policy_version 1613427 (0.0009) [2023-12-28 06:49:45,093][106226] Updated weights for policy 0, policy_version 1609726 (0.0008) [2023-12-28 06:49:45,114][106225] Updated weights for policy 1, policy_version 1613437 (0.0007) [2023-12-28 06:49:45,153][106226] Updated weights for policy 0, policy_version 1609736 (0.0009) [2023-12-28 06:49:45,162][106225] Updated weights for policy 1, policy_version 1613447 (0.0007) [2023-12-28 06:49:45,203][106226] Updated weights for policy 0, policy_version 1609746 (0.0007) [2023-12-28 06:49:45,213][106225] Updated weights for policy 1, policy_version 1613457 (0.0006) [2023-12-28 06:49:45,807][106225] Updated weights for policy 1, policy_version 1613467 (0.0007) [2023-12-28 06:49:45,878][106225] Updated weights for policy 1, policy_version 1613478 (0.0007) [2023-12-28 06:49:45,930][106225] Updated weights for policy 1, policy_version 1613488 (0.0005) [2023-12-28 06:49:46,020][106226] Updated weights for policy 0, policy_version 1609756 (0.0008) [2023-12-28 06:49:46,067][106226] Updated weights for policy 0, policy_version 1609766 (0.0008) [2023-12-28 06:49:46,118][106226] Updated weights for policy 0, policy_version 1609776 (0.0007) [2023-12-28 06:49:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 825286656. Throughput: 0: 9606.5, 1: 9987.6. Samples: 825270452. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:46,176][105115] Avg episode reward: [(0, '-4.988'), (1, '-4.605')] [2023-12-28 06:49:46,515][106225] Updated weights for policy 1, policy_version 1613498 (0.0006) [2023-12-28 06:49:46,585][106225] Updated weights for policy 1, policy_version 1613508 (0.0011) [2023-12-28 06:49:46,651][106225] Updated weights for policy 1, policy_version 1613518 (0.0008) [2023-12-28 06:49:46,720][106225] Updated weights for policy 1, policy_version 1613528 (0.0006) [2023-12-28 06:49:46,869][106226] Updated weights for policy 0, policy_version 1609786 (0.0006) [2023-12-28 06:49:46,941][106226] Updated weights for policy 0, policy_version 1609796 (0.0009) [2023-12-28 06:49:47,006][106226] Updated weights for policy 0, policy_version 1609806 (0.0008) [2023-12-28 06:49:47,070][106226] Updated weights for policy 0, policy_version 1609816 (0.0008) [2023-12-28 06:49:47,370][106225] Updated weights for policy 1, policy_version 1613538 (0.0010) [2023-12-28 06:49:47,425][106225] Updated weights for policy 1, policy_version 1613548 (0.0010) [2023-12-28 06:49:47,485][106225] Updated weights for policy 1, policy_version 1613558 (0.0010) [2023-12-28 06:49:47,792][106226] Updated weights for policy 0, policy_version 1609826 (0.0007) [2023-12-28 06:49:47,840][106226] Updated weights for policy 0, policy_version 1609836 (0.0007) [2023-12-28 06:49:47,884][106226] Updated weights for policy 0, policy_version 1609846 (0.0008) [2023-12-28 06:49:48,155][106225] Updated weights for policy 1, policy_version 1613568 (0.0009) [2023-12-28 06:49:48,202][106225] Updated weights for policy 1, policy_version 1613578 (0.0010) [2023-12-28 06:49:48,259][106225] Updated weights for policy 1, policy_version 1613588 (0.0010) [2023-12-28 06:49:48,706][106226] Updated weights for policy 0, policy_version 1609856 (0.0008) [2023-12-28 06:49:48,764][106226] Updated weights for policy 0, policy_version 1609866 (0.0008) [2023-12-28 06:49:48,823][106226] Updated weights for policy 0, policy_version 1609876 (0.0009) [2023-12-28 06:49:48,921][106225] Updated weights for policy 1, policy_version 1613598 (0.0009) [2023-12-28 06:49:48,972][106225] Updated weights for policy 1, policy_version 1613608 (0.0009) [2023-12-28 06:49:49,027][106225] Updated weights for policy 1, policy_version 1613618 (0.0008) [2023-12-28 06:49:49,575][106226] Updated weights for policy 0, policy_version 1609886 (0.0008) [2023-12-28 06:49:49,638][106226] Updated weights for policy 0, policy_version 1609896 (0.0008) [2023-12-28 06:49:49,697][106226] Updated weights for policy 0, policy_version 1609906 (0.0008) [2023-12-28 06:49:49,806][106225] Updated weights for policy 1, policy_version 1613628 (0.0008) [2023-12-28 06:49:49,873][106225] Updated weights for policy 1, policy_version 1613638 (0.0008) [2023-12-28 06:49:49,925][106225] Updated weights for policy 1, policy_version 1613648 (0.0009) [2023-12-28 06:49:50,420][106226] Updated weights for policy 0, policy_version 1609916 (0.0009) [2023-12-28 06:49:50,473][106226] Updated weights for policy 0, policy_version 1609926 (0.0010) [2023-12-28 06:49:50,528][106226] Updated weights for policy 0, policy_version 1609936 (0.0011) [2023-12-28 06:49:50,681][106225] Updated weights for policy 1, policy_version 1613658 (0.0008) [2023-12-28 06:49:50,744][106225] Updated weights for policy 1, policy_version 1613668 (0.0008) [2023-12-28 06:49:50,819][106225] Updated weights for policy 1, policy_version 1613678 (0.0009) [2023-12-28 06:49:50,893][106225] Updated weights for policy 1, policy_version 1613688 (0.0010) [2023-12-28 06:49:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 825376768. Throughput: 0: 9498.8, 1: 10082.6. Samples: 825388584. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:51,175][105115] Avg episode reward: [(0, '-4.740'), (1, '-4.678')] [2023-12-28 06:49:51,228][106226] Updated weights for policy 0, policy_version 1609946 (0.0011) [2023-12-28 06:49:51,287][106226] Updated weights for policy 0, policy_version 1609956 (0.0010) [2023-12-28 06:49:51,348][106226] Updated weights for policy 0, policy_version 1609966 (0.0007) [2023-12-28 06:49:51,419][106226] Updated weights for policy 0, policy_version 1609976 (0.0010) [2023-12-28 06:49:51,589][106225] Updated weights for policy 1, policy_version 1613698 (0.0008) [2023-12-28 06:49:51,650][106225] Updated weights for policy 1, policy_version 1613708 (0.0008) [2023-12-28 06:49:51,715][106225] Updated weights for policy 1, policy_version 1613718 (0.0007) [2023-12-28 06:49:52,139][106226] Updated weights for policy 0, policy_version 1609986 (0.0005) [2023-12-28 06:49:52,190][106226] Updated weights for policy 0, policy_version 1609996 (0.0005) [2023-12-28 06:49:52,247][106226] Updated weights for policy 0, policy_version 1610006 (0.0005) [2023-12-28 06:49:52,468][106225] Updated weights for policy 1, policy_version 1613728 (0.0006) [2023-12-28 06:49:52,532][106225] Updated weights for policy 1, policy_version 1613738 (0.0006) [2023-12-28 06:49:52,597][106225] Updated weights for policy 1, policy_version 1613748 (0.0008) [2023-12-28 06:49:52,981][106226] Updated weights for policy 0, policy_version 1610016 (0.0006) [2023-12-28 06:49:53,041][106226] Updated weights for policy 0, policy_version 1610026 (0.0005) [2023-12-28 06:49:53,094][106226] Updated weights for policy 0, policy_version 1610036 (0.0008) [2023-12-28 06:49:53,317][106225] Updated weights for policy 1, policy_version 1613758 (0.0008) [2023-12-28 06:49:53,372][106225] Updated weights for policy 1, policy_version 1613768 (0.0008) [2023-12-28 06:49:53,430][106225] Updated weights for policy 1, policy_version 1613778 (0.0008) [2023-12-28 06:49:53,772][106226] Updated weights for policy 0, policy_version 1610046 (0.0008) [2023-12-28 06:49:53,833][106226] Updated weights for policy 0, policy_version 1610056 (0.0005) [2023-12-28 06:49:53,885][106226] Updated weights for policy 0, policy_version 1610066 (0.0005) [2023-12-28 06:49:54,132][106225] Updated weights for policy 1, policy_version 1613788 (0.0009) [2023-12-28 06:49:54,193][106225] Updated weights for policy 1, policy_version 1613798 (0.0009) [2023-12-28 06:49:54,260][106225] Updated weights for policy 1, policy_version 1613808 (0.0008) [2023-12-28 06:49:54,425][106226] Updated weights for policy 0, policy_version 1610076 (0.0007) [2023-12-28 06:49:54,480][106226] Updated weights for policy 0, policy_version 1610086 (0.0008) [2023-12-28 06:49:54,539][106226] Updated weights for policy 0, policy_version 1610096 (0.0009) [2023-12-28 06:49:54,974][106225] Updated weights for policy 1, policy_version 1613818 (0.0009) [2023-12-28 06:49:55,035][106225] Updated weights for policy 1, policy_version 1613828 (0.0010) [2023-12-28 06:49:55,101][106225] Updated weights for policy 1, policy_version 1613838 (0.0010) [2023-12-28 06:49:55,112][106226] Updated weights for policy 0, policy_version 1610106 (0.0007) [2023-12-28 06:49:55,158][106225] Updated weights for policy 1, policy_version 1613848 (0.0007) [2023-12-28 06:49:55,167][106226] Updated weights for policy 0, policy_version 1610116 (0.0007) [2023-12-28 06:49:55,221][106226] Updated weights for policy 0, policy_version 1610126 (0.0009) [2023-12-28 06:49:55,273][106226] Updated weights for policy 0, policy_version 1610136 (0.0008) [2023-12-28 06:49:55,879][106225] Updated weights for policy 1, policy_version 1613858 (0.0008) [2023-12-28 06:49:55,939][106225] Updated weights for policy 1, policy_version 1613868 (0.0008) [2023-12-28 06:49:56,003][106225] Updated weights for policy 1, policy_version 1613878 (0.0007) [2023-12-28 06:49:56,005][106226] Updated weights for policy 0, policy_version 1610146 (0.0008) [2023-12-28 06:49:56,061][106226] Updated weights for policy 0, policy_version 1610156 (0.0008) [2023-12-28 06:49:56,121][106226] Updated weights for policy 0, policy_version 1610166 (0.0009) [2023-12-28 06:49:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 825483264. Throughput: 0: 9491.7, 1: 10014.2. Samples: 825446732. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:49:56,176][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.284')] [2023-12-28 06:49:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001610168_412278784.pth... [2023-12-28 06:49:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001613880_413204480.pth... [2023-12-28 06:49:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001609048_411992064.pth [2023-12-28 06:49:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001612696_412901376.pth [2023-12-28 06:49:56,718][106225] Updated weights for policy 1, policy_version 1613888 (0.0007) [2023-12-28 06:49:56,774][106225] Updated weights for policy 1, policy_version 1613898 (0.0008) [2023-12-28 06:49:56,830][106225] Updated weights for policy 1, policy_version 1613908 (0.0007) [2023-12-28 06:49:56,850][106226] Updated weights for policy 0, policy_version 1610176 (0.0010) [2023-12-28 06:49:56,899][106226] Updated weights for policy 0, policy_version 1610186 (0.0010) [2023-12-28 06:49:56,954][106226] Updated weights for policy 0, policy_version 1610196 (0.0010) [2023-12-28 06:49:57,583][106225] Updated weights for policy 1, policy_version 1613918 (0.0006) [2023-12-28 06:49:57,588][106226] Updated weights for policy 0, policy_version 1610206 (0.0010) [2023-12-28 06:49:57,648][106225] Updated weights for policy 1, policy_version 1613928 (0.0006) [2023-12-28 06:49:57,651][106226] Updated weights for policy 0, policy_version 1610216 (0.0008) [2023-12-28 06:49:57,699][106226] Updated weights for policy 0, policy_version 1610226 (0.0005) [2023-12-28 06:49:57,699][106225] Updated weights for policy 1, policy_version 1613938 (0.0008) [2023-12-28 06:49:58,417][106226] Updated weights for policy 0, policy_version 1610236 (0.0006) [2023-12-28 06:49:58,459][106225] Updated weights for policy 1, policy_version 1613948 (0.0008) [2023-12-28 06:49:58,481][106226] Updated weights for policy 0, policy_version 1610246 (0.0009) [2023-12-28 06:49:58,525][106225] Updated weights for policy 1, policy_version 1613958 (0.0007) [2023-12-28 06:49:58,546][106226] Updated weights for policy 0, policy_version 1610256 (0.0010) [2023-12-28 06:49:58,586][106225] Updated weights for policy 1, policy_version 1613968 (0.0007) [2023-12-28 06:49:59,384][106226] Updated weights for policy 0, policy_version 1610266 (0.0007) [2023-12-28 06:49:59,456][106226] Updated weights for policy 0, policy_version 1610276 (0.0009) [2023-12-28 06:49:59,467][106225] Updated weights for policy 1, policy_version 1613978 (0.0007) [2023-12-28 06:49:59,515][106226] Updated weights for policy 0, policy_version 1610286 (0.0009) [2023-12-28 06:49:59,523][106225] Updated weights for policy 1, policy_version 1613988 (0.0007) [2023-12-28 06:49:59,575][106226] Updated weights for policy 0, policy_version 1610296 (0.0007) [2023-12-28 06:49:59,577][106225] Updated weights for policy 1, policy_version 1613998 (0.0009) [2023-12-28 06:49:59,628][106225] Updated weights for policy 1, policy_version 1614008 (0.0008) [2023-12-28 06:50:00,241][106226] Updated weights for policy 0, policy_version 1610306 (0.0009) [2023-12-28 06:50:00,309][106226] Updated weights for policy 0, policy_version 1610316 (0.0011) [2023-12-28 06:50:00,360][106226] Updated weights for policy 0, policy_version 1610326 (0.0007) [2023-12-28 06:50:00,363][106225] Updated weights for policy 1, policy_version 1614018 (0.0006) [2023-12-28 06:50:00,424][106225] Updated weights for policy 1, policy_version 1614028 (0.0006) [2023-12-28 06:50:00,476][106225] Updated weights for policy 1, policy_version 1614038 (0.0008) [2023-12-28 06:50:00,984][106226] Updated weights for policy 0, policy_version 1610336 (0.0005) [2023-12-28 06:50:01,046][106226] Updated weights for policy 0, policy_version 1610346 (0.0008) [2023-12-28 06:50:01,050][106225] Updated weights for policy 1, policy_version 1614048 (0.0008) [2023-12-28 06:50:01,107][106226] Updated weights for policy 0, policy_version 1610356 (0.0010) [2023-12-28 06:50:01,112][106225] Updated weights for policy 1, policy_version 1614058 (0.0006) [2023-12-28 06:50:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 825573376. Throughput: 0: 9522.3, 1: 9956.2. Samples: 825562624. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 06:50:01,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.720')] [2023-12-28 06:50:01,180][106225] Updated weights for policy 1, policy_version 1614068 (0.0007) [2023-12-28 06:50:01,816][106226] Updated weights for policy 0, policy_version 1610366 (0.0010) [2023-12-28 06:50:01,873][106226] Updated weights for policy 0, policy_version 1610376 (0.0008) [2023-12-28 06:50:01,908][106225] Updated weights for policy 1, policy_version 1614078 (0.0007) [2023-12-28 06:50:01,931][106226] Updated weights for policy 0, policy_version 1610386 (0.0008) [2023-12-28 06:50:01,967][106225] Updated weights for policy 1, policy_version 1614088 (0.0007) [2023-12-28 06:50:02,020][106225] Updated weights for policy 1, policy_version 1614098 (0.0008) [2023-12-28 06:50:02,678][106226] Updated weights for policy 0, policy_version 1610396 (0.0007) [2023-12-28 06:50:02,710][106225] Updated weights for policy 1, policy_version 1614108 (0.0008) [2023-12-28 06:50:02,739][106226] Updated weights for policy 0, policy_version 1610406 (0.0009) [2023-12-28 06:50:02,767][106225] Updated weights for policy 1, policy_version 1614118 (0.0007) [2023-12-28 06:50:02,791][106226] Updated weights for policy 0, policy_version 1610416 (0.0006) [2023-12-28 06:50:02,827][106225] Updated weights for policy 1, policy_version 1614128 (0.0008) [2023-12-28 06:50:03,410][106226] Updated weights for policy 0, policy_version 1610426 (0.0005) [2023-12-28 06:50:03,460][106226] Updated weights for policy 0, policy_version 1610436 (0.0005) [2023-12-28 06:50:03,506][106226] Updated weights for policy 0, policy_version 1610446 (0.0005) [2023-12-28 06:50:03,510][106225] Updated weights for policy 1, policy_version 1614138 (0.0008) [2023-12-28 06:50:03,556][106225] Updated weights for policy 1, policy_version 1614148 (0.0007) [2023-12-28 06:50:03,565][106226] Updated weights for policy 0, policy_version 1610456 (0.0009) [2023-12-28 06:50:03,603][106225] Updated weights for policy 1, policy_version 1614158 (0.0006) [2023-12-28 06:50:03,652][106225] Updated weights for policy 1, policy_version 1614168 (0.0009) [2023-12-28 06:50:04,162][106226] Updated weights for policy 0, policy_version 1610466 (0.0006) [2023-12-28 06:50:04,234][106226] Updated weights for policy 0, policy_version 1610476 (0.0006) [2023-12-28 06:50:04,299][106226] Updated weights for policy 0, policy_version 1610486 (0.0007) [2023-12-28 06:50:04,341][106225] Updated weights for policy 1, policy_version 1614178 (0.0011) [2023-12-28 06:50:04,404][106225] Updated weights for policy 1, policy_version 1614188 (0.0010) [2023-12-28 06:50:04,468][106225] Updated weights for policy 1, policy_version 1614198 (0.0010) [2023-12-28 06:50:04,964][106226] Updated weights for policy 0, policy_version 1610496 (0.0007) [2023-12-28 06:50:05,026][106226] Updated weights for policy 0, policy_version 1610506 (0.0007) [2023-12-28 06:50:05,098][106226] Updated weights for policy 0, policy_version 1610516 (0.0005) [2023-12-28 06:50:05,172][106225] Updated weights for policy 1, policy_version 1614208 (0.0010) [2023-12-28 06:50:05,229][106225] Updated weights for policy 1, policy_version 1614218 (0.0009) [2023-12-28 06:50:05,288][106225] Updated weights for policy 1, policy_version 1614228 (0.0005) [2023-12-28 06:50:05,713][106226] Updated weights for policy 0, policy_version 1610526 (0.0005) [2023-12-28 06:50:05,779][106226] Updated weights for policy 0, policy_version 1610536 (0.0005) [2023-12-28 06:50:05,838][106226] Updated weights for policy 0, policy_version 1610546 (0.0005) [2023-12-28 06:50:05,900][106225] Updated weights for policy 1, policy_version 1614238 (0.0010) [2023-12-28 06:50:05,963][106225] Updated weights for policy 1, policy_version 1614248 (0.0010) [2023-12-28 06:50:06,023][106225] Updated weights for policy 1, policy_version 1614258 (0.0010) [2023-12-28 06:50:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 825679872. Throughput: 0: 9713.6, 1: 10043.6. Samples: 825688288. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:06,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-4.685')] [2023-12-28 06:50:06,471][106226] Updated weights for policy 0, policy_version 1610556 (0.0008) [2023-12-28 06:50:06,532][106226] Updated weights for policy 0, policy_version 1610566 (0.0011) [2023-12-28 06:50:06,597][106226] Updated weights for policy 0, policy_version 1610576 (0.0008) [2023-12-28 06:50:06,731][106225] Updated weights for policy 1, policy_version 1614268 (0.0008) [2023-12-28 06:50:06,787][106225] Updated weights for policy 1, policy_version 1614278 (0.0008) [2023-12-28 06:50:06,845][106225] Updated weights for policy 1, policy_version 1614288 (0.0007) [2023-12-28 06:50:07,338][106226] Updated weights for policy 0, policy_version 1610586 (0.0010) [2023-12-28 06:50:07,393][106226] Updated weights for policy 0, policy_version 1610596 (0.0011) [2023-12-28 06:50:07,446][106226] Updated weights for policy 0, policy_version 1610606 (0.0009) [2023-12-28 06:50:07,506][106226] Updated weights for policy 0, policy_version 1610616 (0.0011) [2023-12-28 06:50:07,520][106225] Updated weights for policy 1, policy_version 1614298 (0.0008) [2023-12-28 06:50:07,580][106225] Updated weights for policy 1, policy_version 1614308 (0.0010) [2023-12-28 06:50:07,642][106225] Updated weights for policy 1, policy_version 1614318 (0.0011) [2023-12-28 06:50:07,700][106225] Updated weights for policy 1, policy_version 1614328 (0.0010) [2023-12-28 06:50:08,140][106226] Updated weights for policy 0, policy_version 1610626 (0.0011) [2023-12-28 06:50:08,203][106226] Updated weights for policy 0, policy_version 1610636 (0.0011) [2023-12-28 06:50:08,254][106226] Updated weights for policy 0, policy_version 1610646 (0.0010) [2023-12-28 06:50:08,412][106225] Updated weights for policy 1, policy_version 1614338 (0.0008) [2023-12-28 06:50:08,474][106225] Updated weights for policy 1, policy_version 1614348 (0.0008) [2023-12-28 06:50:08,529][106225] Updated weights for policy 1, policy_version 1614358 (0.0007) [2023-12-28 06:50:08,985][106226] Updated weights for policy 0, policy_version 1610656 (0.0008) [2023-12-28 06:50:09,050][106226] Updated weights for policy 0, policy_version 1610666 (0.0011) [2023-12-28 06:50:09,112][106226] Updated weights for policy 0, policy_version 1610676 (0.0010) [2023-12-28 06:50:09,267][106225] Updated weights for policy 1, policy_version 1614369 (0.0008) [2023-12-28 06:50:09,329][106225] Updated weights for policy 1, policy_version 1614379 (0.0011) [2023-12-28 06:50:09,398][106225] Updated weights for policy 1, policy_version 1614389 (0.0010) [2023-12-28 06:50:09,750][106226] Updated weights for policy 0, policy_version 1610686 (0.0008) [2023-12-28 06:50:09,813][106226] Updated weights for policy 0, policy_version 1610696 (0.0009) [2023-12-28 06:50:09,878][106226] Updated weights for policy 0, policy_version 1610706 (0.0009) [2023-12-28 06:50:10,102][106225] Updated weights for policy 1, policy_version 1614399 (0.0008) [2023-12-28 06:50:10,161][106225] Updated weights for policy 1, policy_version 1614409 (0.0008) [2023-12-28 06:50:10,215][106225] Updated weights for policy 1, policy_version 1614419 (0.0009) [2023-12-28 06:50:10,645][106226] Updated weights for policy 0, policy_version 1610716 (0.0009) [2023-12-28 06:50:10,691][106226] Updated weights for policy 0, policy_version 1610726 (0.0008) [2023-12-28 06:50:10,742][106226] Updated weights for policy 0, policy_version 1610736 (0.0008) [2023-12-28 06:50:10,939][106225] Updated weights for policy 1, policy_version 1614429 (0.0008) [2023-12-28 06:50:11,002][106225] Updated weights for policy 1, policy_version 1614439 (0.0009) [2023-12-28 06:50:11,072][106225] Updated weights for policy 1, policy_version 1614449 (0.0008) [2023-12-28 06:50:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 825778176. Throughput: 0: 9762.1, 1: 10090.4. Samples: 825747564. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:11,175][105115] Avg episode reward: [(0, '-4.736'), (1, '-4.593')] [2023-12-28 06:50:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001614456_413351936.pth... [2023-12-28 06:50:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001610744_412426240.pth... [2023-12-28 06:50:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001613304_413057024.pth [2023-12-28 06:50:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001609592_412131328.pth [2023-12-28 06:50:11,501][106226] Updated weights for policy 0, policy_version 1610746 (0.0009) [2023-12-28 06:50:11,570][106226] Updated weights for policy 0, policy_version 1610756 (0.0010) [2023-12-28 06:50:11,644][106226] Updated weights for policy 0, policy_version 1610766 (0.0009) [2023-12-28 06:50:11,710][106226] Updated weights for policy 0, policy_version 1610776 (0.0010) [2023-12-28 06:50:11,800][106225] Updated weights for policy 1, policy_version 1614459 (0.0007) [2023-12-28 06:50:11,867][106225] Updated weights for policy 1, policy_version 1614469 (0.0007) [2023-12-28 06:50:11,928][106225] Updated weights for policy 1, policy_version 1614479 (0.0008) [2023-12-28 06:50:12,410][106226] Updated weights for policy 0, policy_version 1610786 (0.0008) [2023-12-28 06:50:12,469][106226] Updated weights for policy 0, policy_version 1610796 (0.0008) [2023-12-28 06:50:12,527][106226] Updated weights for policy 0, policy_version 1610806 (0.0008) [2023-12-28 06:50:12,678][106225] Updated weights for policy 1, policy_version 1614489 (0.0008) [2023-12-28 06:50:12,737][106225] Updated weights for policy 1, policy_version 1614499 (0.0008) [2023-12-28 06:50:12,800][106225] Updated weights for policy 1, policy_version 1614509 (0.0008) [2023-12-28 06:50:12,866][106225] Updated weights for policy 1, policy_version 1614519 (0.0008) [2023-12-28 06:50:13,221][106226] Updated weights for policy 0, policy_version 1610816 (0.0008) [2023-12-28 06:50:13,287][106226] Updated weights for policy 0, policy_version 1610826 (0.0009) [2023-12-28 06:50:13,342][106226] Updated weights for policy 0, policy_version 1610836 (0.0008) [2023-12-28 06:50:13,611][106225] Updated weights for policy 1, policy_version 1614529 (0.0008) [2023-12-28 06:50:13,664][106225] Updated weights for policy 1, policy_version 1614539 (0.0008) [2023-12-28 06:50:13,724][106225] Updated weights for policy 1, policy_version 1614549 (0.0009) [2023-12-28 06:50:14,064][106226] Updated weights for policy 0, policy_version 1610846 (0.0009) [2023-12-28 06:50:14,127][106226] Updated weights for policy 0, policy_version 1610856 (0.0009) [2023-12-28 06:50:14,187][106226] Updated weights for policy 0, policy_version 1610866 (0.0008) [2023-12-28 06:50:14,416][106225] Updated weights for policy 1, policy_version 1614559 (0.0008) [2023-12-28 06:50:14,475][106225] Updated weights for policy 1, policy_version 1614569 (0.0009) [2023-12-28 06:50:14,525][106225] Updated weights for policy 1, policy_version 1614579 (0.0008) [2023-12-28 06:50:14,970][106226] Updated weights for policy 0, policy_version 1610876 (0.0010) [2023-12-28 06:50:15,034][106226] Updated weights for policy 0, policy_version 1610886 (0.0009) [2023-12-28 06:50:15,096][106226] Updated weights for policy 0, policy_version 1610896 (0.0009) [2023-12-28 06:50:15,224][106225] Updated weights for policy 1, policy_version 1614589 (0.0008) [2023-12-28 06:50:15,294][106225] Updated weights for policy 1, policy_version 1614599 (0.0007) [2023-12-28 06:50:15,352][106225] Updated weights for policy 1, policy_version 1614609 (0.0011) [2023-12-28 06:50:15,861][106226] Updated weights for policy 0, policy_version 1610906 (0.0009) [2023-12-28 06:50:15,917][106226] Updated weights for policy 0, policy_version 1610916 (0.0008) [2023-12-28 06:50:15,971][106226] Updated weights for policy 0, policy_version 1610926 (0.0008) [2023-12-28 06:50:16,032][106226] Updated weights for policy 0, policy_version 1610936 (0.0008) [2023-12-28 06:50:16,054][106225] Updated weights for policy 1, policy_version 1614619 (0.0010) [2023-12-28 06:50:16,117][106225] Updated weights for policy 1, policy_version 1614629 (0.0010) [2023-12-28 06:50:16,173][106225] Updated weights for policy 1, policy_version 1614639 (0.0010) [2023-12-28 06:50:16,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 825868288. Throughput: 0: 9712.8, 1: 9888.5. Samples: 825860552. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:16,176][105115] Avg episode reward: [(0, '-4.633'), (1, '-4.735')] [2023-12-28 06:50:16,768][106226] Updated weights for policy 0, policy_version 1610946 (0.0008) [2023-12-28 06:50:16,828][106225] Updated weights for policy 1, policy_version 1614649 (0.0010) [2023-12-28 06:50:16,828][106226] Updated weights for policy 0, policy_version 1610956 (0.0008) [2023-12-28 06:50:16,885][106226] Updated weights for policy 0, policy_version 1610966 (0.0009) [2023-12-28 06:50:16,888][106225] Updated weights for policy 1, policy_version 1614659 (0.0009) [2023-12-28 06:50:16,949][106225] Updated weights for policy 1, policy_version 1614669 (0.0009) [2023-12-28 06:50:17,015][106225] Updated weights for policy 1, policy_version 1614679 (0.0010) [2023-12-28 06:50:17,539][106226] Updated weights for policy 0, policy_version 1610976 (0.0006) [2023-12-28 06:50:17,590][106226] Updated weights for policy 0, policy_version 1610986 (0.0005) [2023-12-28 06:50:17,648][106226] Updated weights for policy 0, policy_version 1610996 (0.0005) [2023-12-28 06:50:17,714][106225] Updated weights for policy 1, policy_version 1614689 (0.0006) [2023-12-28 06:50:17,776][106225] Updated weights for policy 1, policy_version 1614699 (0.0005) [2023-12-28 06:50:17,843][106225] Updated weights for policy 1, policy_version 1614709 (0.0010) [2023-12-28 06:50:18,205][106226] Updated weights for policy 0, policy_version 1611006 (0.0007) [2023-12-28 06:50:18,267][106226] Updated weights for policy 0, policy_version 1611016 (0.0007) [2023-12-28 06:50:18,324][106226] Updated weights for policy 0, policy_version 1611026 (0.0006) [2023-12-28 06:50:18,508][106225] Updated weights for policy 1, policy_version 1614719 (0.0010) [2023-12-28 06:50:18,559][106225] Updated weights for policy 1, policy_version 1614729 (0.0010) [2023-12-28 06:50:18,606][106225] Updated weights for policy 1, policy_version 1614739 (0.0010) [2023-12-28 06:50:19,052][106226] Updated weights for policy 0, policy_version 1611036 (0.0008) [2023-12-28 06:50:19,109][106226] Updated weights for policy 0, policy_version 1611046 (0.0007) [2023-12-28 06:50:19,164][106226] Updated weights for policy 0, policy_version 1611056 (0.0006) [2023-12-28 06:50:19,357][106225] Updated weights for policy 1, policy_version 1614749 (0.0008) [2023-12-28 06:50:19,423][106225] Updated weights for policy 1, policy_version 1614759 (0.0008) [2023-12-28 06:50:19,476][106225] Updated weights for policy 1, policy_version 1614769 (0.0010) [2023-12-28 06:50:19,914][106226] Updated weights for policy 0, policy_version 1611066 (0.0006) [2023-12-28 06:50:19,978][106226] Updated weights for policy 0, policy_version 1611076 (0.0008) [2023-12-28 06:50:20,040][106226] Updated weights for policy 0, policy_version 1611086 (0.0008) [2023-12-28 06:50:20,098][106226] Updated weights for policy 0, policy_version 1611096 (0.0008) [2023-12-28 06:50:20,226][106225] Updated weights for policy 1, policy_version 1614779 (0.0009) [2023-12-28 06:50:20,285][106225] Updated weights for policy 1, policy_version 1614789 (0.0011) [2023-12-28 06:50:20,341][106225] Updated weights for policy 1, policy_version 1614799 (0.0011) [2023-12-28 06:50:20,893][106226] Updated weights for policy 0, policy_version 1611106 (0.0008) [2023-12-28 06:50:20,953][106226] Updated weights for policy 0, policy_version 1611116 (0.0008) [2023-12-28 06:50:21,020][106226] Updated weights for policy 0, policy_version 1611126 (0.0009) [2023-12-28 06:50:21,061][106225] Updated weights for policy 1, policy_version 1614809 (0.0010) [2023-12-28 06:50:21,127][106225] Updated weights for policy 1, policy_version 1614819 (0.0009) [2023-12-28 06:50:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.2, 300 sec: 19855.2). Total num frames: 825966592. Throughput: 0: 9785.1, 1: 9786.0. Samples: 825977508. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:21,175][105115] Avg episode reward: [(0, '-4.884'), (1, '-4.402')] [2023-12-28 06:50:21,198][106225] Updated weights for policy 1, policy_version 1614829 (0.0007) [2023-12-28 06:50:21,258][106225] Updated weights for policy 1, policy_version 1614839 (0.0008) [2023-12-28 06:50:21,791][106226] Updated weights for policy 0, policy_version 1611136 (0.0011) [2023-12-28 06:50:21,857][106226] Updated weights for policy 0, policy_version 1611146 (0.0010) [2023-12-28 06:50:21,919][106226] Updated weights for policy 0, policy_version 1611156 (0.0008) [2023-12-28 06:50:22,017][106225] Updated weights for policy 1, policy_version 1614849 (0.0007) [2023-12-28 06:50:22,079][106225] Updated weights for policy 1, policy_version 1614859 (0.0008) [2023-12-28 06:50:22,139][106225] Updated weights for policy 1, policy_version 1614869 (0.0007) [2023-12-28 06:50:22,688][106226] Updated weights for policy 0, policy_version 1611166 (0.0010) [2023-12-28 06:50:22,744][106226] Updated weights for policy 0, policy_version 1611176 (0.0009) [2023-12-28 06:50:22,802][106226] Updated weights for policy 0, policy_version 1611186 (0.0007) [2023-12-28 06:50:22,808][106225] Updated weights for policy 1, policy_version 1614879 (0.0006) [2023-12-28 06:50:22,869][106225] Updated weights for policy 1, policy_version 1614889 (0.0007) [2023-12-28 06:50:22,935][106225] Updated weights for policy 1, policy_version 1614899 (0.0009) [2023-12-28 06:50:23,463][106226] Updated weights for policy 0, policy_version 1611196 (0.0007) [2023-12-28 06:50:23,521][106225] Updated weights for policy 1, policy_version 1614909 (0.0006) [2023-12-28 06:50:23,524][106226] Updated weights for policy 0, policy_version 1611206 (0.0008) [2023-12-28 06:50:23,573][106225] Updated weights for policy 1, policy_version 1614919 (0.0006) [2023-12-28 06:50:23,584][106226] Updated weights for policy 0, policy_version 1611216 (0.0007) [2023-12-28 06:50:23,625][106225] Updated weights for policy 1, policy_version 1614929 (0.0006) [2023-12-28 06:50:24,283][106226] Updated weights for policy 0, policy_version 1611226 (0.0008) [2023-12-28 06:50:24,330][106225] Updated weights for policy 1, policy_version 1614939 (0.0009) [2023-12-28 06:50:24,348][106226] Updated weights for policy 0, policy_version 1611236 (0.0008) [2023-12-28 06:50:24,396][106225] Updated weights for policy 1, policy_version 1614949 (0.0010) [2023-12-28 06:50:24,405][106226] Updated weights for policy 0, policy_version 1611246 (0.0006) [2023-12-28 06:50:24,457][106225] Updated weights for policy 1, policy_version 1614959 (0.0010) [2023-12-28 06:50:24,472][106226] Updated weights for policy 0, policy_version 1611256 (0.0010) [2023-12-28 06:50:25,155][106225] Updated weights for policy 1, policy_version 1614969 (0.0010) [2023-12-28 06:50:25,155][106226] Updated weights for policy 0, policy_version 1611266 (0.0011) [2023-12-28 06:50:25,206][106226] Updated weights for policy 0, policy_version 1611276 (0.0011) [2023-12-28 06:50:25,209][106225] Updated weights for policy 1, policy_version 1614979 (0.0010) [2023-12-28 06:50:25,256][106226] Updated weights for policy 0, policy_version 1611286 (0.0010) [2023-12-28 06:50:25,267][106225] Updated weights for policy 1, policy_version 1614989 (0.0005) [2023-12-28 06:50:25,329][106225] Updated weights for policy 1, policy_version 1614999 (0.0009) [2023-12-28 06:50:25,870][106226] Updated weights for policy 0, policy_version 1611296 (0.0006) [2023-12-28 06:50:25,923][106226] Updated weights for policy 0, policy_version 1611306 (0.0006) [2023-12-28 06:50:25,974][106226] Updated weights for policy 0, policy_version 1611316 (0.0006) [2023-12-28 06:50:25,981][106225] Updated weights for policy 1, policy_version 1615009 (0.0007) [2023-12-28 06:50:26,037][106225] Updated weights for policy 1, policy_version 1615019 (0.0007) [2023-12-28 06:50:26,091][106225] Updated weights for policy 1, policy_version 1615029 (0.0008) [2023-12-28 06:50:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19882.9). Total num frames: 826073088. Throughput: 0: 9745.6, 1: 9829.5. Samples: 826036268. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:26,175][105115] Avg episode reward: [(0, '-4.933'), (1, '-4.510')] [2023-12-28 06:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001615032_413499392.pth... [2023-12-28 06:50:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001611320_412573696.pth... [2023-12-28 06:50:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001613880_413204480.pth [2023-12-28 06:50:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001610168_412278784.pth [2023-12-28 06:50:26,653][106226] Updated weights for policy 0, policy_version 1611326 (0.0010) [2023-12-28 06:50:26,718][106226] Updated weights for policy 0, policy_version 1611336 (0.0010) [2023-12-28 06:50:26,753][106225] Updated weights for policy 1, policy_version 1615039 (0.0006) [2023-12-28 06:50:26,784][106226] Updated weights for policy 0, policy_version 1611346 (0.0010) [2023-12-28 06:50:26,810][106225] Updated weights for policy 1, policy_version 1615049 (0.0008) [2023-12-28 06:50:26,870][106225] Updated weights for policy 1, policy_version 1615059 (0.0009) [2023-12-28 06:50:27,337][106226] Updated weights for policy 0, policy_version 1611356 (0.0010) [2023-12-28 06:50:27,405][106226] Updated weights for policy 0, policy_version 1611366 (0.0010) [2023-12-28 06:50:27,474][106226] Updated weights for policy 0, policy_version 1611376 (0.0010) [2023-12-28 06:50:27,549][106225] Updated weights for policy 1, policy_version 1615069 (0.0007) [2023-12-28 06:50:27,605][106225] Updated weights for policy 1, policy_version 1615079 (0.0005) [2023-12-28 06:50:27,662][106225] Updated weights for policy 1, policy_version 1615089 (0.0006) [2023-12-28 06:50:28,152][106226] Updated weights for policy 0, policy_version 1611386 (0.0011) [2023-12-28 06:50:28,208][106225] Updated weights for policy 1, policy_version 1615099 (0.0006) [2023-12-28 06:50:28,208][106226] Updated weights for policy 0, policy_version 1611396 (0.0010) [2023-12-28 06:50:28,259][106226] Updated weights for policy 0, policy_version 1611406 (0.0009) [2023-12-28 06:50:28,271][106225] Updated weights for policy 1, policy_version 1615109 (0.0005) [2023-12-28 06:50:28,319][106226] Updated weights for policy 0, policy_version 1611416 (0.0009) [2023-12-28 06:50:28,336][106225] Updated weights for policy 1, policy_version 1615119 (0.0006) [2023-12-28 06:50:28,945][106226] Updated weights for policy 0, policy_version 1611426 (0.0008) [2023-12-28 06:50:28,950][106225] Updated weights for policy 1, policy_version 1615129 (0.0007) [2023-12-28 06:50:28,999][106226] Updated weights for policy 0, policy_version 1611436 (0.0007) [2023-12-28 06:50:29,009][106225] Updated weights for policy 1, policy_version 1615139 (0.0007) [2023-12-28 06:50:29,052][106226] Updated weights for policy 0, policy_version 1611446 (0.0006) [2023-12-28 06:50:29,066][106225] Updated weights for policy 1, policy_version 1615149 (0.0006) [2023-12-28 06:50:29,121][106225] Updated weights for policy 1, policy_version 1615159 (0.0008) [2023-12-28 06:50:29,819][106226] Updated weights for policy 0, policy_version 1611456 (0.0010) [2023-12-28 06:50:29,887][106225] Updated weights for policy 1, policy_version 1615169 (0.0010) [2023-12-28 06:50:29,887][106226] Updated weights for policy 0, policy_version 1611466 (0.0009) [2023-12-28 06:50:29,945][106225] Updated weights for policy 1, policy_version 1615179 (0.0009) [2023-12-28 06:50:29,960][106226] Updated weights for policy 0, policy_version 1611476 (0.0008) [2023-12-28 06:50:30,005][106225] Updated weights for policy 1, policy_version 1615189 (0.0009) [2023-12-28 06:50:30,636][106226] Updated weights for policy 0, policy_version 1611486 (0.0006) [2023-12-28 06:50:30,663][106225] Updated weights for policy 1, policy_version 1615199 (0.0007) [2023-12-28 06:50:30,709][106226] Updated weights for policy 0, policy_version 1611496 (0.0005) [2023-12-28 06:50:30,721][106225] Updated weights for policy 1, policy_version 1615209 (0.0005) [2023-12-28 06:50:30,771][106226] Updated weights for policy 0, policy_version 1611506 (0.0007) [2023-12-28 06:50:30,781][106225] Updated weights for policy 1, policy_version 1615219 (0.0005) [2023-12-28 06:50:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.6, 300 sec: 19827.4). Total num frames: 826171392. Throughput: 0: 9896.1, 1: 9869.7. Samples: 826159904. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:31,175][105115] Avg episode reward: [(0, '-4.862'), (1, '-4.952')] [2023-12-28 06:50:31,384][106225] Updated weights for policy 1, policy_version 1615229 (0.0006) [2023-12-28 06:50:31,445][106225] Updated weights for policy 1, policy_version 1615239 (0.0010) [2023-12-28 06:50:31,471][106226] Updated weights for policy 0, policy_version 1611516 (0.0010) [2023-12-28 06:50:31,505][106225] Updated weights for policy 1, policy_version 1615249 (0.0010) [2023-12-28 06:50:31,531][106226] Updated weights for policy 0, policy_version 1611526 (0.0006) [2023-12-28 06:50:31,594][106226] Updated weights for policy 0, policy_version 1611536 (0.0008) [2023-12-28 06:50:32,230][106225] Updated weights for policy 1, policy_version 1615259 (0.0010) [2023-12-28 06:50:32,294][106225] Updated weights for policy 1, policy_version 1615269 (0.0008) [2023-12-28 06:50:32,351][106225] Updated weights for policy 1, policy_version 1615279 (0.0008) [2023-12-28 06:50:32,361][106226] Updated weights for policy 0, policy_version 1611546 (0.0008) [2023-12-28 06:50:32,424][106226] Updated weights for policy 0, policy_version 1611556 (0.0008) [2023-12-28 06:50:32,483][106226] Updated weights for policy 0, policy_version 1611566 (0.0007) [2023-12-28 06:50:32,543][106226] Updated weights for policy 0, policy_version 1611576 (0.0008) [2023-12-28 06:50:33,013][106225] Updated weights for policy 1, policy_version 1615289 (0.0007) [2023-12-28 06:50:33,066][106225] Updated weights for policy 1, policy_version 1615299 (0.0008) [2023-12-28 06:50:33,123][106225] Updated weights for policy 1, policy_version 1615309 (0.0005) [2023-12-28 06:50:33,177][106225] Updated weights for policy 1, policy_version 1615319 (0.0005) [2023-12-28 06:50:33,229][106226] Updated weights for policy 0, policy_version 1611586 (0.0008) [2023-12-28 06:50:33,284][106226] Updated weights for policy 0, policy_version 1611596 (0.0008) [2023-12-28 06:50:33,335][106226] Updated weights for policy 0, policy_version 1611606 (0.0008) [2023-12-28 06:50:33,831][106225] Updated weights for policy 1, policy_version 1615329 (0.0006) [2023-12-28 06:50:33,873][106225] Updated weights for policy 1, policy_version 1615339 (0.0005) [2023-12-28 06:50:33,928][106225] Updated weights for policy 1, policy_version 1615349 (0.0005) [2023-12-28 06:50:34,111][106226] Updated weights for policy 0, policy_version 1611616 (0.0008) [2023-12-28 06:50:34,175][106226] Updated weights for policy 0, policy_version 1611626 (0.0009) [2023-12-28 06:50:34,237][106226] Updated weights for policy 0, policy_version 1611636 (0.0008) [2023-12-28 06:50:34,577][106225] Updated weights for policy 1, policy_version 1615359 (0.0007) [2023-12-28 06:50:34,643][106225] Updated weights for policy 1, policy_version 1615369 (0.0007) [2023-12-28 06:50:34,709][106225] Updated weights for policy 1, policy_version 1615379 (0.0005) [2023-12-28 06:50:34,938][106226] Updated weights for policy 0, policy_version 1611646 (0.0007) [2023-12-28 06:50:35,008][106226] Updated weights for policy 0, policy_version 1611656 (0.0010) [2023-12-28 06:50:35,070][106226] Updated weights for policy 0, policy_version 1611666 (0.0008) [2023-12-28 06:50:35,247][106225] Updated weights for policy 1, policy_version 1615389 (0.0005) [2023-12-28 06:50:35,311][106225] Updated weights for policy 1, policy_version 1615399 (0.0007) [2023-12-28 06:50:35,371][106225] Updated weights for policy 1, policy_version 1615409 (0.0007) [2023-12-28 06:50:35,833][106226] Updated weights for policy 0, policy_version 1611676 (0.0009) [2023-12-28 06:50:35,884][106226] Updated weights for policy 0, policy_version 1611686 (0.0008) [2023-12-28 06:50:35,935][106226] Updated weights for policy 0, policy_version 1611696 (0.0005) [2023-12-28 06:50:35,961][106225] Updated weights for policy 1, policy_version 1615419 (0.0007) [2023-12-28 06:50:36,018][106225] Updated weights for policy 1, policy_version 1615429 (0.0005) [2023-12-28 06:50:36,078][106225] Updated weights for policy 1, policy_version 1615439 (0.0009) [2023-12-28 06:50:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 826277888. Throughput: 0: 9923.2, 1: 9923.2. Samples: 826281672. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:36,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.630')] [2023-12-28 06:50:36,678][106226] Updated weights for policy 0, policy_version 1611706 (0.0006) [2023-12-28 06:50:36,734][106226] Updated weights for policy 0, policy_version 1611716 (0.0008) [2023-12-28 06:50:36,747][106225] Updated weights for policy 1, policy_version 1615449 (0.0008) [2023-12-28 06:50:36,786][106226] Updated weights for policy 0, policy_version 1611726 (0.0006) [2023-12-28 06:50:36,793][106225] Updated weights for policy 1, policy_version 1615459 (0.0008) [2023-12-28 06:50:36,834][106226] Updated weights for policy 0, policy_version 1611736 (0.0007) [2023-12-28 06:50:36,840][106225] Updated weights for policy 1, policy_version 1615469 (0.0006) [2023-12-28 06:50:36,896][106225] Updated weights for policy 1, policy_version 1615479 (0.0007) [2023-12-28 06:50:37,613][106225] Updated weights for policy 1, policy_version 1615489 (0.0005) [2023-12-28 06:50:37,615][106226] Updated weights for policy 0, policy_version 1611746 (0.0009) [2023-12-28 06:50:37,670][106226] Updated weights for policy 0, policy_version 1611756 (0.0008) [2023-12-28 06:50:37,678][106225] Updated weights for policy 1, policy_version 1615499 (0.0006) [2023-12-28 06:50:37,726][106226] Updated weights for policy 0, policy_version 1611766 (0.0007) [2023-12-28 06:50:37,735][106225] Updated weights for policy 1, policy_version 1615509 (0.0007) [2023-12-28 06:50:38,363][106225] Updated weights for policy 1, policy_version 1615519 (0.0009) [2023-12-28 06:50:38,426][106225] Updated weights for policy 1, policy_version 1615529 (0.0008) [2023-12-28 06:50:38,487][106225] Updated weights for policy 1, policy_version 1615539 (0.0007) [2023-12-28 06:50:38,506][106226] Updated weights for policy 0, policy_version 1611776 (0.0006) [2023-12-28 06:50:38,570][106226] Updated weights for policy 0, policy_version 1611786 (0.0009) [2023-12-28 06:50:38,635][106226] Updated weights for policy 0, policy_version 1611796 (0.0009) [2023-12-28 06:50:39,201][106225] Updated weights for policy 1, policy_version 1615549 (0.0010) [2023-12-28 06:50:39,267][106225] Updated weights for policy 1, policy_version 1615559 (0.0010) [2023-12-28 06:50:39,328][106225] Updated weights for policy 1, policy_version 1615569 (0.0008) [2023-12-28 06:50:39,394][106226] Updated weights for policy 0, policy_version 1611806 (0.0008) [2023-12-28 06:50:39,462][106226] Updated weights for policy 0, policy_version 1611816 (0.0008) [2023-12-28 06:50:39,528][106226] Updated weights for policy 0, policy_version 1611826 (0.0008) [2023-12-28 06:50:40,150][106225] Updated weights for policy 1, policy_version 1615579 (0.0009) [2023-12-28 06:50:40,213][106225] Updated weights for policy 1, policy_version 1615589 (0.0008) [2023-12-28 06:50:40,248][106226] Updated weights for policy 0, policy_version 1611836 (0.0008) [2023-12-28 06:50:40,274][106225] Updated weights for policy 1, policy_version 1615599 (0.0008) [2023-12-28 06:50:40,303][106226] Updated weights for policy 0, policy_version 1611846 (0.0005) [2023-12-28 06:50:40,359][106226] Updated weights for policy 0, policy_version 1611856 (0.0007) [2023-12-28 06:50:40,917][106225] Updated weights for policy 1, policy_version 1615609 (0.0008) [2023-12-28 06:50:40,968][106225] Updated weights for policy 1, policy_version 1615619 (0.0007) [2023-12-28 06:50:41,017][106225] Updated weights for policy 1, policy_version 1615629 (0.0005) [2023-12-28 06:50:41,083][106225] Updated weights for policy 1, policy_version 1615639 (0.0008) [2023-12-28 06:50:41,124][106226] Updated weights for policy 0, policy_version 1611866 (0.0009) [2023-12-28 06:50:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 826368000. Throughput: 0: 9862.4, 1: 9977.9. Samples: 826339540. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:41,175][105115] Avg episode reward: [(0, '-4.812'), (1, '-4.794')] [2023-12-28 06:50:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001615640_413655040.pth... [2023-12-28 06:50:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001614456_413351936.pth [2023-12-28 06:50:41,200][106226] Updated weights for policy 0, policy_version 1611876 (0.0009) [2023-12-28 06:50:41,272][106226] Updated weights for policy 0, policy_version 1611886 (0.0008) [2023-12-28 06:50:41,336][106226] Updated weights for policy 0, policy_version 1611896 (0.0008) [2023-12-28 06:50:41,336][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001611896_412721152.pth... [2023-12-28 06:50:41,341][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001610744_412426240.pth [2023-12-28 06:50:41,911][106225] Updated weights for policy 1, policy_version 1615649 (0.0008) [2023-12-28 06:50:41,976][106225] Updated weights for policy 1, policy_version 1615659 (0.0008) [2023-12-28 06:50:42,039][106225] Updated weights for policy 1, policy_version 1615669 (0.0008) [2023-12-28 06:50:42,052][106226] Updated weights for policy 0, policy_version 1611906 (0.0007) [2023-12-28 06:50:42,111][106226] Updated weights for policy 0, policy_version 1611916 (0.0007) [2023-12-28 06:50:42,168][106226] Updated weights for policy 0, policy_version 1611926 (0.0008) [2023-12-28 06:50:42,747][106225] Updated weights for policy 1, policy_version 1615679 (0.0006) [2023-12-28 06:50:42,812][106225] Updated weights for policy 1, policy_version 1615689 (0.0005) [2023-12-28 06:50:42,878][106225] Updated weights for policy 1, policy_version 1615699 (0.0009) [2023-12-28 06:50:42,935][106226] Updated weights for policy 0, policy_version 1611936 (0.0008) [2023-12-28 06:50:42,984][106226] Updated weights for policy 0, policy_version 1611946 (0.0008) [2023-12-28 06:50:43,033][106226] Updated weights for policy 0, policy_version 1611956 (0.0008) [2023-12-28 06:50:43,569][106225] Updated weights for policy 1, policy_version 1615709 (0.0008) [2023-12-28 06:50:43,619][106225] Updated weights for policy 1, policy_version 1615719 (0.0009) [2023-12-28 06:50:43,666][106225] Updated weights for policy 1, policy_version 1615729 (0.0009) [2023-12-28 06:50:43,681][106226] Updated weights for policy 0, policy_version 1611966 (0.0007) [2023-12-28 06:50:43,745][106226] Updated weights for policy 0, policy_version 1611976 (0.0005) [2023-12-28 06:50:43,815][106226] Updated weights for policy 0, policy_version 1611986 (0.0005) [2023-12-28 06:50:44,366][106226] Updated weights for policy 0, policy_version 1611996 (0.0007) [2023-12-28 06:50:44,387][106225] Updated weights for policy 1, policy_version 1615739 (0.0008) [2023-12-28 06:50:44,425][106226] Updated weights for policy 0, policy_version 1612006 (0.0007) [2023-12-28 06:50:44,441][106225] Updated weights for policy 1, policy_version 1615749 (0.0008) [2023-12-28 06:50:44,480][106226] Updated weights for policy 0, policy_version 1612016 (0.0009) [2023-12-28 06:50:44,494][106225] Updated weights for policy 1, policy_version 1615759 (0.0006) [2023-12-28 06:50:45,184][106226] Updated weights for policy 0, policy_version 1612026 (0.0007) [2023-12-28 06:50:45,247][106226] Updated weights for policy 0, policy_version 1612036 (0.0006) [2023-12-28 06:50:45,266][106225] Updated weights for policy 1, policy_version 1615769 (0.0007) [2023-12-28 06:50:45,301][106226] Updated weights for policy 0, policy_version 1612046 (0.0008) [2023-12-28 06:50:45,329][106225] Updated weights for policy 1, policy_version 1615779 (0.0008) [2023-12-28 06:50:45,352][106226] Updated weights for policy 0, policy_version 1612056 (0.0009) [2023-12-28 06:50:45,388][106225] Updated weights for policy 1, policy_version 1615789 (0.0008) [2023-12-28 06:50:45,442][106225] Updated weights for policy 1, policy_version 1615799 (0.0008) [2023-12-28 06:50:46,030][106226] Updated weights for policy 0, policy_version 1612066 (0.0010) [2023-12-28 06:50:46,077][106226] Updated weights for policy 0, policy_version 1612076 (0.0010) [2023-12-28 06:50:46,124][106226] Updated weights for policy 0, policy_version 1612086 (0.0010) [2023-12-28 06:50:46,168][106225] Updated weights for policy 1, policy_version 1615809 (0.0007) [2023-12-28 06:50:46,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 826466304. Throughput: 0: 9826.2, 1: 10015.3. Samples: 826455492. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:46,175][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.694')] [2023-12-28 06:50:46,224][106225] Updated weights for policy 1, policy_version 1615819 (0.0007) [2023-12-28 06:50:46,274][106225] Updated weights for policy 1, policy_version 1615829 (0.0008) [2023-12-28 06:50:46,878][106226] Updated weights for policy 0, policy_version 1612096 (0.0010) [2023-12-28 06:50:46,934][106226] Updated weights for policy 0, policy_version 1612106 (0.0010) [2023-12-28 06:50:47,004][106226] Updated weights for policy 0, policy_version 1612116 (0.0011) [2023-12-28 06:50:47,015][106225] Updated weights for policy 1, policy_version 1615839 (0.0007) [2023-12-28 06:50:47,075][106225] Updated weights for policy 1, policy_version 1615849 (0.0007) [2023-12-28 06:50:47,129][106225] Updated weights for policy 1, policy_version 1615859 (0.0008) [2023-12-28 06:50:47,714][106226] Updated weights for policy 0, policy_version 1612126 (0.0011) [2023-12-28 06:50:47,773][106226] Updated weights for policy 0, policy_version 1612136 (0.0010) [2023-12-28 06:50:47,819][106226] Updated weights for policy 0, policy_version 1612146 (0.0010) [2023-12-28 06:50:47,879][106225] Updated weights for policy 1, policy_version 1615869 (0.0007) [2023-12-28 06:50:47,939][106225] Updated weights for policy 1, policy_version 1615879 (0.0008) [2023-12-28 06:50:48,002][106225] Updated weights for policy 1, policy_version 1615889 (0.0007) [2023-12-28 06:50:48,548][106226] Updated weights for policy 0, policy_version 1612156 (0.0009) [2023-12-28 06:50:48,618][106226] Updated weights for policy 0, policy_version 1612166 (0.0008) [2023-12-28 06:50:48,686][106226] Updated weights for policy 0, policy_version 1612176 (0.0009) [2023-12-28 06:50:48,730][106225] Updated weights for policy 1, policy_version 1615899 (0.0007) [2023-12-28 06:50:48,785][106225] Updated weights for policy 1, policy_version 1615909 (0.0009) [2023-12-28 06:50:48,839][106225] Updated weights for policy 1, policy_version 1615919 (0.0009) [2023-12-28 06:50:49,328][106226] Updated weights for policy 0, policy_version 1612186 (0.0009) [2023-12-28 06:50:49,396][106226] Updated weights for policy 0, policy_version 1612196 (0.0008) [2023-12-28 06:50:49,461][106226] Updated weights for policy 0, policy_version 1612206 (0.0006) [2023-12-28 06:50:49,526][106226] Updated weights for policy 0, policy_version 1612216 (0.0008) [2023-12-28 06:50:49,592][106225] Updated weights for policy 1, policy_version 1615929 (0.0008) [2023-12-28 06:50:49,653][106225] Updated weights for policy 1, policy_version 1615939 (0.0010) [2023-12-28 06:50:49,707][106225] Updated weights for policy 1, policy_version 1615949 (0.0010) [2023-12-28 06:50:49,774][106225] Updated weights for policy 1, policy_version 1615959 (0.0009) [2023-12-28 06:50:50,193][106226] Updated weights for policy 0, policy_version 1612226 (0.0008) [2023-12-28 06:50:50,252][106226] Updated weights for policy 0, policy_version 1612236 (0.0008) [2023-12-28 06:50:50,320][106226] Updated weights for policy 0, policy_version 1612246 (0.0009) [2023-12-28 06:50:50,525][106225] Updated weights for policy 1, policy_version 1615969 (0.0010) [2023-12-28 06:50:50,589][106225] Updated weights for policy 1, policy_version 1615979 (0.0009) [2023-12-28 06:50:50,650][106225] Updated weights for policy 1, policy_version 1615989 (0.0010) [2023-12-28 06:50:51,081][106226] Updated weights for policy 0, policy_version 1612256 (0.0008) [2023-12-28 06:50:51,147][106226] Updated weights for policy 0, policy_version 1612266 (0.0008) [2023-12-28 06:50:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 826556416. Throughput: 0: 9708.3, 1: 9884.3. Samples: 826569956. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:51,175][105115] Avg episode reward: [(0, '-4.769'), (1, '-4.690')] [2023-12-28 06:50:51,199][106226] Updated weights for policy 0, policy_version 1612276 (0.0008) [2023-12-28 06:50:51,455][106225] Updated weights for policy 1, policy_version 1615999 (0.0009) [2023-12-28 06:50:51,504][106225] Updated weights for policy 1, policy_version 1616009 (0.0009) [2023-12-28 06:50:51,560][106225] Updated weights for policy 1, policy_version 1616019 (0.0008) [2023-12-28 06:50:51,957][106226] Updated weights for policy 0, policy_version 1612286 (0.0007) [2023-12-28 06:50:52,025][106226] Updated weights for policy 0, policy_version 1612296 (0.0006) [2023-12-28 06:50:52,089][106226] Updated weights for policy 0, policy_version 1612306 (0.0008) [2023-12-28 06:50:52,286][106225] Updated weights for policy 1, policy_version 1616029 (0.0008) [2023-12-28 06:50:52,354][106225] Updated weights for policy 1, policy_version 1616039 (0.0006) [2023-12-28 06:50:52,416][106225] Updated weights for policy 1, policy_version 1616049 (0.0008) [2023-12-28 06:50:52,796][106226] Updated weights for policy 0, policy_version 1612316 (0.0008) [2023-12-28 06:50:52,851][106226] Updated weights for policy 0, policy_version 1612326 (0.0005) [2023-12-28 06:50:52,904][106226] Updated weights for policy 0, policy_version 1612336 (0.0006) [2023-12-28 06:50:53,127][106225] Updated weights for policy 1, policy_version 1616059 (0.0008) [2023-12-28 06:50:53,182][106225] Updated weights for policy 1, policy_version 1616069 (0.0009) [2023-12-28 06:50:53,231][106225] Updated weights for policy 1, policy_version 1616079 (0.0008) [2023-12-28 06:50:53,539][106226] Updated weights for policy 0, policy_version 1612346 (0.0006) [2023-12-28 06:50:53,585][106226] Updated weights for policy 0, policy_version 1612356 (0.0008) [2023-12-28 06:50:53,636][106226] Updated weights for policy 0, policy_version 1612366 (0.0008) [2023-12-28 06:50:53,691][106226] Updated weights for policy 0, policy_version 1612376 (0.0005) [2023-12-28 06:50:54,032][106225] Updated weights for policy 1, policy_version 1616089 (0.0008) [2023-12-28 06:50:54,093][106225] Updated weights for policy 1, policy_version 1616099 (0.0008) [2023-12-28 06:50:54,150][106225] Updated weights for policy 1, policy_version 1616109 (0.0006) [2023-12-28 06:50:54,207][106225] Updated weights for policy 1, policy_version 1616119 (0.0008) [2023-12-28 06:50:54,278][106226] Updated weights for policy 0, policy_version 1612386 (0.0006) [2023-12-28 06:50:54,335][106226] Updated weights for policy 0, policy_version 1612396 (0.0006) [2023-12-28 06:50:54,388][106226] Updated weights for policy 0, policy_version 1612406 (0.0005) [2023-12-28 06:50:54,906][106226] Updated weights for policy 0, policy_version 1612416 (0.0008) [2023-12-28 06:50:54,957][106226] Updated weights for policy 0, policy_version 1612426 (0.0007) [2023-12-28 06:50:55,009][106225] Updated weights for policy 1, policy_version 1616129 (0.0009) [2023-12-28 06:50:55,013][106226] Updated weights for policy 0, policy_version 1612436 (0.0005) [2023-12-28 06:50:55,065][106225] Updated weights for policy 1, policy_version 1616139 (0.0008) [2023-12-28 06:50:55,120][106225] Updated weights for policy 1, policy_version 1616149 (0.0009) [2023-12-28 06:50:55,669][106226] Updated weights for policy 0, policy_version 1612446 (0.0007) [2023-12-28 06:50:55,731][106226] Updated weights for policy 0, policy_version 1612456 (0.0008) [2023-12-28 06:50:55,786][106226] Updated weights for policy 0, policy_version 1612466 (0.0008) [2023-12-28 06:50:55,872][106225] Updated weights for policy 1, policy_version 1616159 (0.0008) [2023-12-28 06:50:55,927][106225] Updated weights for policy 1, policy_version 1616169 (0.0005) [2023-12-28 06:50:55,985][106225] Updated weights for policy 1, policy_version 1616179 (0.0008) [2023-12-28 06:50:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 826662912. Throughput: 0: 9737.9, 1: 9849.7. Samples: 826629008. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:50:56,175][105115] Avg episode reward: [(0, '-4.668'), (1, '-4.764')] [2023-12-28 06:50:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001616184_413794304.pth... [2023-12-28 06:50:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001612472_412868608.pth... [2023-12-28 06:50:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001615032_413499392.pth [2023-12-28 06:50:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001611320_412573696.pth [2023-12-28 06:50:56,553][106226] Updated weights for policy 0, policy_version 1612476 (0.0009) [2023-12-28 06:50:56,603][106226] Updated weights for policy 0, policy_version 1612486 (0.0008) [2023-12-28 06:50:56,610][106225] Updated weights for policy 1, policy_version 1616189 (0.0008) [2023-12-28 06:50:56,651][106226] Updated weights for policy 0, policy_version 1612496 (0.0007) [2023-12-28 06:50:56,654][106225] Updated weights for policy 1, policy_version 1616199 (0.0005) [2023-12-28 06:50:56,705][106225] Updated weights for policy 1, policy_version 1616209 (0.0006) [2023-12-28 06:50:57,312][106226] Updated weights for policy 0, policy_version 1612506 (0.0007) [2023-12-28 06:50:57,335][106225] Updated weights for policy 1, policy_version 1616219 (0.0008) [2023-12-28 06:50:57,379][106226] Updated weights for policy 0, policy_version 1612516 (0.0006) [2023-12-28 06:50:57,402][106225] Updated weights for policy 1, policy_version 1616229 (0.0008) [2023-12-28 06:50:57,440][106226] Updated weights for policy 0, policy_version 1612526 (0.0005) [2023-12-28 06:50:57,466][106225] Updated weights for policy 1, policy_version 1616239 (0.0008) [2023-12-28 06:50:57,496][106226] Updated weights for policy 0, policy_version 1612536 (0.0005) [2023-12-28 06:50:58,083][106226] Updated weights for policy 0, policy_version 1612546 (0.0005) [2023-12-28 06:50:58,130][106225] Updated weights for policy 1, policy_version 1616249 (0.0009) [2023-12-28 06:50:58,141][106226] Updated weights for policy 0, policy_version 1612556 (0.0005) [2023-12-28 06:50:58,182][106225] Updated weights for policy 1, policy_version 1616259 (0.0008) [2023-12-28 06:50:58,201][106226] Updated weights for policy 0, policy_version 1612566 (0.0005) [2023-12-28 06:50:58,242][106225] Updated weights for policy 1, policy_version 1616269 (0.0006) [2023-12-28 06:50:58,303][106225] Updated weights for policy 1, policy_version 1616279 (0.0006) [2023-12-28 06:50:58,981][106226] Updated weights for policy 0, policy_version 1612576 (0.0009) [2023-12-28 06:50:59,038][106226] Updated weights for policy 0, policy_version 1612586 (0.0007) [2023-12-28 06:50:59,096][106226] Updated weights for policy 0, policy_version 1612596 (0.0007) [2023-12-28 06:50:59,111][106225] Updated weights for policy 1, policy_version 1616289 (0.0008) [2023-12-28 06:50:59,168][106225] Updated weights for policy 1, policy_version 1616299 (0.0007) [2023-12-28 06:50:59,238][106225] Updated weights for policy 1, policy_version 1616309 (0.0008) [2023-12-28 06:50:59,885][106225] Updated weights for policy 1, policy_version 1616319 (0.0008) [2023-12-28 06:50:59,908][106226] Updated weights for policy 0, policy_version 1612606 (0.0008) [2023-12-28 06:50:59,951][106225] Updated weights for policy 1, policy_version 1616329 (0.0008) [2023-12-28 06:50:59,972][106226] Updated weights for policy 0, policy_version 1612616 (0.0009) [2023-12-28 06:51:00,012][106225] Updated weights for policy 1, policy_version 1616339 (0.0008) [2023-12-28 06:51:00,032][106226] Updated weights for policy 0, policy_version 1612626 (0.0008) [2023-12-28 06:51:00,738][106225] Updated weights for policy 1, policy_version 1616349 (0.0009) [2023-12-28 06:51:00,750][106226] Updated weights for policy 0, policy_version 1612636 (0.0008) [2023-12-28 06:51:00,803][106225] Updated weights for policy 1, policy_version 1616359 (0.0010) [2023-12-28 06:51:00,805][106226] Updated weights for policy 0, policy_version 1612646 (0.0007) [2023-12-28 06:51:00,863][106226] Updated weights for policy 0, policy_version 1612656 (0.0007) [2023-12-28 06:51:00,864][106225] Updated weights for policy 1, policy_version 1616369 (0.0009) [2023-12-28 06:51:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 826761216. Throughput: 0: 9834.2, 1: 9895.6. Samples: 826748388. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:01,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.883')] [2023-12-28 06:51:01,556][106225] Updated weights for policy 1, policy_version 1616379 (0.0007) [2023-12-28 06:51:01,601][106226] Updated weights for policy 0, policy_version 1612666 (0.0007) [2023-12-28 06:51:01,605][106225] Updated weights for policy 1, policy_version 1616389 (0.0008) [2023-12-28 06:51:01,662][106226] Updated weights for policy 0, policy_version 1612676 (0.0008) [2023-12-28 06:51:01,670][106225] Updated weights for policy 1, policy_version 1616399 (0.0007) [2023-12-28 06:51:01,727][106226] Updated weights for policy 0, policy_version 1612686 (0.0008) [2023-12-28 06:51:01,788][106226] Updated weights for policy 0, policy_version 1612696 (0.0008) [2023-12-28 06:51:02,418][106225] Updated weights for policy 1, policy_version 1616409 (0.0008) [2023-12-28 06:51:02,476][106225] Updated weights for policy 1, policy_version 1616419 (0.0006) [2023-12-28 06:51:02,538][106225] Updated weights for policy 1, policy_version 1616429 (0.0006) [2023-12-28 06:51:02,552][106226] Updated weights for policy 0, policy_version 1612706 (0.0006) [2023-12-28 06:51:02,600][106225] Updated weights for policy 1, policy_version 1616439 (0.0006) [2023-12-28 06:51:02,615][106226] Updated weights for policy 0, policy_version 1612716 (0.0007) [2023-12-28 06:51:02,669][106226] Updated weights for policy 0, policy_version 1612726 (0.0009) [2023-12-28 06:51:03,223][106226] Updated weights for policy 0, policy_version 1612736 (0.0006) [2023-12-28 06:51:03,274][106226] Updated weights for policy 0, policy_version 1612746 (0.0006) [2023-12-28 06:51:03,329][106226] Updated weights for policy 0, policy_version 1612756 (0.0007) [2023-12-28 06:51:03,330][106225] Updated weights for policy 1, policy_version 1616449 (0.0005) [2023-12-28 06:51:03,391][106225] Updated weights for policy 1, policy_version 1616459 (0.0006) [2023-12-28 06:51:03,451][106225] Updated weights for policy 1, policy_version 1616469 (0.0007) [2023-12-28 06:51:03,966][106226] Updated weights for policy 0, policy_version 1612766 (0.0008) [2023-12-28 06:51:04,023][106226] Updated weights for policy 0, policy_version 1612776 (0.0006) [2023-12-28 06:51:04,085][106226] Updated weights for policy 0, policy_version 1612786 (0.0008) [2023-12-28 06:51:04,166][106225] Updated weights for policy 1, policy_version 1616479 (0.0007) [2023-12-28 06:51:04,231][106225] Updated weights for policy 1, policy_version 1616489 (0.0006) [2023-12-28 06:51:04,297][106225] Updated weights for policy 1, policy_version 1616499 (0.0009) [2023-12-28 06:51:04,704][106226] Updated weights for policy 0, policy_version 1612796 (0.0006) [2023-12-28 06:51:04,765][106226] Updated weights for policy 0, policy_version 1612806 (0.0007) [2023-12-28 06:51:04,823][106226] Updated weights for policy 0, policy_version 1612816 (0.0009) [2023-12-28 06:51:04,998][106225] Updated weights for policy 1, policy_version 1616509 (0.0009) [2023-12-28 06:51:05,051][106225] Updated weights for policy 1, policy_version 1616519 (0.0008) [2023-12-28 06:51:05,102][106225] Updated weights for policy 1, policy_version 1616529 (0.0007) [2023-12-28 06:51:05,457][106226] Updated weights for policy 0, policy_version 1612826 (0.0008) [2023-12-28 06:51:05,511][106226] Updated weights for policy 0, policy_version 1612836 (0.0009) [2023-12-28 06:51:05,562][106226] Updated weights for policy 0, policy_version 1612846 (0.0006) [2023-12-28 06:51:05,620][106226] Updated weights for policy 0, policy_version 1612856 (0.0005) [2023-12-28 06:51:05,883][106225] Updated weights for policy 1, policy_version 1616539 (0.0008) [2023-12-28 06:51:05,948][106225] Updated weights for policy 1, policy_version 1616549 (0.0008) [2023-12-28 06:51:06,006][106225] Updated weights for policy 1, policy_version 1616559 (0.0008) [2023-12-28 06:51:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 826859520. Throughput: 0: 9940.2, 1: 9867.2. Samples: 826868840. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:06,175][105115] Avg episode reward: [(0, '-4.397'), (1, '-4.758')] [2023-12-28 06:51:06,246][106226] Updated weights for policy 0, policy_version 1612866 (0.0008) [2023-12-28 06:51:06,301][106226] Updated weights for policy 0, policy_version 1612876 (0.0007) [2023-12-28 06:51:06,354][106226] Updated weights for policy 0, policy_version 1612886 (0.0007) [2023-12-28 06:51:06,780][106225] Updated weights for policy 1, policy_version 1616569 (0.0008) [2023-12-28 06:51:06,841][106225] Updated weights for policy 1, policy_version 1616579 (0.0009) [2023-12-28 06:51:06,904][106225] Updated weights for policy 1, policy_version 1616589 (0.0009) [2023-12-28 06:51:06,967][106225] Updated weights for policy 1, policy_version 1616599 (0.0009) [2023-12-28 06:51:07,011][106226] Updated weights for policy 0, policy_version 1612896 (0.0006) [2023-12-28 06:51:07,063][106226] Updated weights for policy 0, policy_version 1612906 (0.0005) [2023-12-28 06:51:07,114][106226] Updated weights for policy 0, policy_version 1612916 (0.0006) [2023-12-28 06:51:07,725][106225] Updated weights for policy 1, policy_version 1616609 (0.0008) [2023-12-28 06:51:07,747][106226] Updated weights for policy 0, policy_version 1612926 (0.0008) [2023-12-28 06:51:07,780][106225] Updated weights for policy 1, policy_version 1616619 (0.0007) [2023-12-28 06:51:07,798][106226] Updated weights for policy 0, policy_version 1612936 (0.0006) [2023-12-28 06:51:07,831][106225] Updated weights for policy 1, policy_version 1616629 (0.0007) [2023-12-28 06:51:07,861][106226] Updated weights for policy 0, policy_version 1612946 (0.0007) [2023-12-28 06:51:08,560][106225] Updated weights for policy 1, policy_version 1616639 (0.0008) [2023-12-28 06:51:08,570][106226] Updated weights for policy 0, policy_version 1612956 (0.0008) [2023-12-28 06:51:08,618][106225] Updated weights for policy 1, policy_version 1616649 (0.0008) [2023-12-28 06:51:08,630][106226] Updated weights for policy 0, policy_version 1612966 (0.0008) [2023-12-28 06:51:08,675][106225] Updated weights for policy 1, policy_version 1616659 (0.0006) [2023-12-28 06:51:08,689][106226] Updated weights for policy 0, policy_version 1612976 (0.0007) [2023-12-28 06:51:09,392][106226] Updated weights for policy 0, policy_version 1612986 (0.0008) [2023-12-28 06:51:09,436][106225] Updated weights for policy 1, policy_version 1616669 (0.0007) [2023-12-28 06:51:09,457][106226] Updated weights for policy 0, policy_version 1612996 (0.0007) [2023-12-28 06:51:09,501][106225] Updated weights for policy 1, policy_version 1616679 (0.0006) [2023-12-28 06:51:09,508][106226] Updated weights for policy 0, policy_version 1613006 (0.0008) [2023-12-28 06:51:09,568][106226] Updated weights for policy 0, policy_version 1613016 (0.0009) [2023-12-28 06:51:09,568][106225] Updated weights for policy 1, policy_version 1616689 (0.0009) [2023-12-28 06:51:10,195][106225] Updated weights for policy 1, policy_version 1616699 (0.0006) [2023-12-28 06:51:10,268][106225] Updated weights for policy 1, policy_version 1616709 (0.0007) [2023-12-28 06:51:10,321][106225] Updated weights for policy 1, policy_version 1616719 (0.0008) [2023-12-28 06:51:10,390][106226] Updated weights for policy 0, policy_version 1613026 (0.0007) [2023-12-28 06:51:10,456][106226] Updated weights for policy 0, policy_version 1613036 (0.0007) [2023-12-28 06:51:10,515][106226] Updated weights for policy 0, policy_version 1613046 (0.0007) [2023-12-28 06:51:11,071][106225] Updated weights for policy 1, policy_version 1616729 (0.0007) [2023-12-28 06:51:11,135][106225] Updated weights for policy 1, policy_version 1616739 (0.0008) [2023-12-28 06:51:11,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 826949632. Throughput: 0: 9986.3, 1: 9814.1. Samples: 826927280. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:11,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.712')] [2023-12-28 06:51:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001613048_413016064.pth... [2023-12-28 06:51:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001611896_412721152.pth [2023-12-28 06:51:11,207][106225] Updated weights for policy 1, policy_version 1616749 (0.0008) [2023-12-28 06:51:11,266][106226] Updated weights for policy 0, policy_version 1613056 (0.0007) [2023-12-28 06:51:11,274][106225] Updated weights for policy 1, policy_version 1616759 (0.0008) [2023-12-28 06:51:11,278][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001616760_413941760.pth... [2023-12-28 06:51:11,282][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001615640_413655040.pth [2023-12-28 06:51:11,324][106226] Updated weights for policy 0, policy_version 1613066 (0.0009) [2023-12-28 06:51:11,393][106226] Updated weights for policy 0, policy_version 1613076 (0.0008) [2023-12-28 06:51:12,084][106225] Updated weights for policy 1, policy_version 1616769 (0.0008) [2023-12-28 06:51:12,099][106226] Updated weights for policy 0, policy_version 1613086 (0.0007) [2023-12-28 06:51:12,165][106226] Updated weights for policy 0, policy_version 1613096 (0.0007) [2023-12-28 06:51:12,167][106225] Updated weights for policy 1, policy_version 1616779 (0.0009) [2023-12-28 06:51:12,226][106226] Updated weights for policy 0, policy_version 1613106 (0.0008) [2023-12-28 06:51:12,228][106225] Updated weights for policy 1, policy_version 1616789 (0.0006) [2023-12-28 06:51:12,865][106225] Updated weights for policy 1, policy_version 1616799 (0.0008) [2023-12-28 06:51:12,890][106226] Updated weights for policy 0, policy_version 1613116 (0.0006) [2023-12-28 06:51:12,922][106225] Updated weights for policy 1, policy_version 1616809 (0.0009) [2023-12-28 06:51:12,953][106226] Updated weights for policy 0, policy_version 1613126 (0.0005) [2023-12-28 06:51:12,979][106225] Updated weights for policy 1, policy_version 1616819 (0.0008) [2023-12-28 06:51:13,014][106226] Updated weights for policy 0, policy_version 1613136 (0.0006) [2023-12-28 06:51:13,547][106226] Updated weights for policy 0, policy_version 1613146 (0.0007) [2023-12-28 06:51:13,608][106226] Updated weights for policy 0, policy_version 1613156 (0.0006) [2023-12-28 06:51:13,631][106225] Updated weights for policy 1, policy_version 1616829 (0.0007) [2023-12-28 06:51:13,664][106226] Updated weights for policy 0, policy_version 1613166 (0.0006) [2023-12-28 06:51:13,687][106225] Updated weights for policy 1, policy_version 1616839 (0.0010) [2023-12-28 06:51:13,727][106226] Updated weights for policy 0, policy_version 1613176 (0.0005) [2023-12-28 06:51:13,751][106225] Updated weights for policy 1, policy_version 1616849 (0.0010) [2023-12-28 06:51:14,249][106226] Updated weights for policy 0, policy_version 1613186 (0.0005) [2023-12-28 06:51:14,309][106226] Updated weights for policy 0, policy_version 1613196 (0.0009) [2023-12-28 06:51:14,374][106226] Updated weights for policy 0, policy_version 1613206 (0.0007) [2023-12-28 06:51:14,457][106225] Updated weights for policy 1, policy_version 1616859 (0.0009) [2023-12-28 06:51:14,511][106225] Updated weights for policy 1, policy_version 1616869 (0.0006) [2023-12-28 06:51:14,565][106225] Updated weights for policy 1, policy_version 1616879 (0.0006) [2023-12-28 06:51:15,019][106226] Updated weights for policy 0, policy_version 1613216 (0.0008) [2023-12-28 06:51:15,086][106226] Updated weights for policy 0, policy_version 1613226 (0.0009) [2023-12-28 06:51:15,152][106226] Updated weights for policy 0, policy_version 1613236 (0.0008) [2023-12-28 06:51:15,238][106225] Updated weights for policy 1, policy_version 1616889 (0.0007) [2023-12-28 06:51:15,301][106225] Updated weights for policy 1, policy_version 1616899 (0.0009) [2023-12-28 06:51:15,369][106225] Updated weights for policy 1, policy_version 1616909 (0.0006) [2023-12-28 06:51:15,428][106225] Updated weights for policy 1, policy_version 1616919 (0.0007) [2023-12-28 06:51:15,868][106226] Updated weights for policy 0, policy_version 1613246 (0.0007) [2023-12-28 06:51:15,923][106226] Updated weights for policy 0, policy_version 1613256 (0.0009) [2023-12-28 06:51:15,973][106226] Updated weights for policy 0, policy_version 1613266 (0.0009) [2023-12-28 06:51:16,071][106225] Updated weights for policy 1, policy_version 1616929 (0.0008) [2023-12-28 06:51:16,137][106225] Updated weights for policy 1, policy_version 1616939 (0.0009) [2023-12-28 06:51:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 827056128. Throughput: 0: 9968.1, 1: 9741.7. Samples: 827046844. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:16,175][105115] Avg episode reward: [(0, '-4.039'), (1, '-4.567')] [2023-12-28 06:51:16,195][106225] Updated weights for policy 1, policy_version 1616949 (0.0008) [2023-12-28 06:51:16,716][106226] Updated weights for policy 0, policy_version 1613276 (0.0008) [2023-12-28 06:51:16,771][106226] Updated weights for policy 0, policy_version 1613286 (0.0008) [2023-12-28 06:51:16,820][106226] Updated weights for policy 0, policy_version 1613296 (0.0009) [2023-12-28 06:51:16,856][106225] Updated weights for policy 1, policy_version 1616959 (0.0008) [2023-12-28 06:51:16,900][106225] Updated weights for policy 1, policy_version 1616969 (0.0005) [2023-12-28 06:51:16,950][106225] Updated weights for policy 1, policy_version 1616979 (0.0005) [2023-12-28 06:51:17,579][106226] Updated weights for policy 0, policy_version 1613306 (0.0007) [2023-12-28 06:51:17,644][106226] Updated weights for policy 0, policy_version 1613316 (0.0007) [2023-12-28 06:51:17,657][106225] Updated weights for policy 1, policy_version 1616989 (0.0008) [2023-12-28 06:51:17,705][106226] Updated weights for policy 0, policy_version 1613326 (0.0009) [2023-12-28 06:51:17,718][106225] Updated weights for policy 1, policy_version 1616999 (0.0007) [2023-12-28 06:51:17,766][106226] Updated weights for policy 0, policy_version 1613336 (0.0008) [2023-12-28 06:51:17,773][106225] Updated weights for policy 1, policy_version 1617009 (0.0006) [2023-12-28 06:51:18,493][106225] Updated weights for policy 1, policy_version 1617019 (0.0007) [2023-12-28 06:51:18,498][106226] Updated weights for policy 0, policy_version 1613346 (0.0009) [2023-12-28 06:51:18,549][106225] Updated weights for policy 1, policy_version 1617029 (0.0008) [2023-12-28 06:51:18,559][106226] Updated weights for policy 0, policy_version 1613356 (0.0006) [2023-12-28 06:51:18,605][106225] Updated weights for policy 1, policy_version 1617039 (0.0006) [2023-12-28 06:51:18,619][106226] Updated weights for policy 0, policy_version 1613366 (0.0007) [2023-12-28 06:51:19,353][106226] Updated weights for policy 0, policy_version 1613376 (0.0007) [2023-12-28 06:51:19,382][106225] Updated weights for policy 1, policy_version 1617049 (0.0007) [2023-12-28 06:51:19,414][106226] Updated weights for policy 0, policy_version 1613386 (0.0007) [2023-12-28 06:51:19,442][106225] Updated weights for policy 1, policy_version 1617059 (0.0007) [2023-12-28 06:51:19,476][106226] Updated weights for policy 0, policy_version 1613396 (0.0008) [2023-12-28 06:51:19,507][106225] Updated weights for policy 1, policy_version 1617069 (0.0006) [2023-12-28 06:51:19,577][106225] Updated weights for policy 1, policy_version 1617079 (0.0009) [2023-12-28 06:51:20,243][106226] Updated weights for policy 0, policy_version 1613406 (0.0006) [2023-12-28 06:51:20,312][106226] Updated weights for policy 0, policy_version 1613416 (0.0006) [2023-12-28 06:51:20,356][106225] Updated weights for policy 1, policy_version 1617089 (0.0008) [2023-12-28 06:51:20,377][106226] Updated weights for policy 0, policy_version 1613426 (0.0006) [2023-12-28 06:51:20,417][106225] Updated weights for policy 1, policy_version 1617099 (0.0006) [2023-12-28 06:51:20,484][106225] Updated weights for policy 1, policy_version 1617109 (0.0006) [2023-12-28 06:51:21,087][106226] Updated weights for policy 0, policy_version 1613436 (0.0007) [2023-12-28 06:51:21,151][106226] Updated weights for policy 0, policy_version 1613446 (0.0010) [2023-12-28 06:51:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 827146240. Throughput: 0: 9954.7, 1: 9607.1. Samples: 827161948. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:21,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.706')] [2023-12-28 06:51:21,215][106226] Updated weights for policy 0, policy_version 1613456 (0.0010) [2023-12-28 06:51:21,218][106225] Updated weights for policy 1, policy_version 1617119 (0.0006) [2023-12-28 06:51:21,281][106225] Updated weights for policy 1, policy_version 1617129 (0.0006) [2023-12-28 06:51:21,344][106225] Updated weights for policy 1, policy_version 1617139 (0.0008) [2023-12-28 06:51:21,920][106226] Updated weights for policy 0, policy_version 1613466 (0.0010) [2023-12-28 06:51:21,988][106226] Updated weights for policy 0, policy_version 1613476 (0.0010) [2023-12-28 06:51:22,053][106226] Updated weights for policy 0, policy_version 1613486 (0.0008) [2023-12-28 06:51:22,115][106226] Updated weights for policy 0, policy_version 1613496 (0.0009) [2023-12-28 06:51:22,130][106225] Updated weights for policy 1, policy_version 1617149 (0.0007) [2023-12-28 06:51:22,191][106225] Updated weights for policy 1, policy_version 1617159 (0.0009) [2023-12-28 06:51:22,255][106225] Updated weights for policy 1, policy_version 1617169 (0.0009) [2023-12-28 06:51:22,865][106226] Updated weights for policy 0, policy_version 1613506 (0.0011) [2023-12-28 06:51:22,929][106226] Updated weights for policy 0, policy_version 1613516 (0.0011) [2023-12-28 06:51:22,993][106226] Updated weights for policy 0, policy_version 1613526 (0.0011) [2023-12-28 06:51:23,034][106225] Updated weights for policy 1, policy_version 1617179 (0.0008) [2023-12-28 06:51:23,092][106225] Updated weights for policy 1, policy_version 1617189 (0.0007) [2023-12-28 06:51:23,158][106225] Updated weights for policy 1, policy_version 1617199 (0.0008) [2023-12-28 06:51:23,552][106226] Updated weights for policy 0, policy_version 1613536 (0.0009) [2023-12-28 06:51:23,615][106226] Updated weights for policy 0, policy_version 1613546 (0.0010) [2023-12-28 06:51:23,677][106226] Updated weights for policy 0, policy_version 1613556 (0.0010) [2023-12-28 06:51:23,821][106225] Updated weights for policy 1, policy_version 1617209 (0.0008) [2023-12-28 06:51:23,873][106225] Updated weights for policy 1, policy_version 1617219 (0.0005) [2023-12-28 06:51:23,919][106225] Updated weights for policy 1, policy_version 1617229 (0.0005) [2023-12-28 06:51:23,972][106225] Updated weights for policy 1, policy_version 1617239 (0.0006) [2023-12-28 06:51:24,291][106226] Updated weights for policy 0, policy_version 1613566 (0.0010) [2023-12-28 06:51:24,350][106226] Updated weights for policy 0, policy_version 1613576 (0.0010) [2023-12-28 06:51:24,418][106226] Updated weights for policy 0, policy_version 1613586 (0.0011) [2023-12-28 06:51:24,629][106225] Updated weights for policy 1, policy_version 1617249 (0.0006) [2023-12-28 06:51:24,678][106225] Updated weights for policy 1, policy_version 1617259 (0.0006) [2023-12-28 06:51:24,729][106225] Updated weights for policy 1, policy_version 1617269 (0.0007) [2023-12-28 06:51:25,118][106226] Updated weights for policy 0, policy_version 1613596 (0.0009) [2023-12-28 06:51:25,173][106226] Updated weights for policy 0, policy_version 1613606 (0.0006) [2023-12-28 06:51:25,233][106226] Updated weights for policy 0, policy_version 1613616 (0.0007) [2023-12-28 06:51:25,263][106225] Updated weights for policy 1, policy_version 1617279 (0.0005) [2023-12-28 06:51:25,321][106225] Updated weights for policy 1, policy_version 1617289 (0.0005) [2023-12-28 06:51:25,377][106225] Updated weights for policy 1, policy_version 1617299 (0.0005) [2023-12-28 06:51:25,773][106226] Updated weights for policy 0, policy_version 1613626 (0.0006) [2023-12-28 06:51:25,835][106226] Updated weights for policy 0, policy_version 1613636 (0.0005) [2023-12-28 06:51:25,898][106226] Updated weights for policy 0, policy_version 1613646 (0.0005) [2023-12-28 06:51:25,959][106226] Updated weights for policy 0, policy_version 1613656 (0.0007) [2023-12-28 06:51:25,976][106225] Updated weights for policy 1, policy_version 1617309 (0.0007) [2023-12-28 06:51:26,032][106225] Updated weights for policy 1, policy_version 1617319 (0.0008) [2023-12-28 06:51:26,094][106225] Updated weights for policy 1, policy_version 1617329 (0.0007) [2023-12-28 06:51:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 827260928. Throughput: 0: 10028.0, 1: 9553.3. Samples: 827220704. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:26,176][105115] Avg episode reward: [(0, '-4.859'), (1, '-4.691')] [2023-12-28 06:51:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001613656_413171712.pth... [2023-12-28 06:51:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001617336_414089216.pth... [2023-12-28 06:51:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001616184_413794304.pth [2023-12-28 06:51:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001612472_412868608.pth [2023-12-28 06:51:26,569][106226] Updated weights for policy 0, policy_version 1613666 (0.0008) [2023-12-28 06:51:26,626][106226] Updated weights for policy 0, policy_version 1613676 (0.0010) [2023-12-28 06:51:26,689][106226] Updated weights for policy 0, policy_version 1613686 (0.0006) [2023-12-28 06:51:26,730][106225] Updated weights for policy 1, policy_version 1617339 (0.0006) [2023-12-28 06:51:26,774][106225] Updated weights for policy 1, policy_version 1617349 (0.0005) [2023-12-28 06:51:26,826][106225] Updated weights for policy 1, policy_version 1617359 (0.0005) [2023-12-28 06:51:27,316][106226] Updated weights for policy 0, policy_version 1613696 (0.0008) [2023-12-28 06:51:27,379][106226] Updated weights for policy 0, policy_version 1613706 (0.0007) [2023-12-28 06:51:27,436][106226] Updated weights for policy 0, policy_version 1613716 (0.0009) [2023-12-28 06:51:27,439][106225] Updated weights for policy 1, policy_version 1617369 (0.0005) [2023-12-28 06:51:27,507][106225] Updated weights for policy 1, policy_version 1617379 (0.0005) [2023-12-28 06:51:27,562][106225] Updated weights for policy 1, policy_version 1617389 (0.0005) [2023-12-28 06:51:27,616][106225] Updated weights for policy 1, policy_version 1617399 (0.0005) [2023-12-28 06:51:28,138][106226] Updated weights for policy 0, policy_version 1613726 (0.0006) [2023-12-28 06:51:28,222][106225] Updated weights for policy 1, policy_version 1617409 (0.0010) [2023-12-28 06:51:28,229][106226] Updated weights for policy 0, policy_version 1613736 (0.0006) [2023-12-28 06:51:28,277][106225] Updated weights for policy 1, policy_version 1617419 (0.0010) [2023-12-28 06:51:28,296][106226] Updated weights for policy 0, policy_version 1613746 (0.0005) [2023-12-28 06:51:28,337][106225] Updated weights for policy 1, policy_version 1617429 (0.0009) [2023-12-28 06:51:28,984][106226] Updated weights for policy 0, policy_version 1613756 (0.0006) [2023-12-28 06:51:29,050][106226] Updated weights for policy 0, policy_version 1613766 (0.0005) [2023-12-28 06:51:29,066][106225] Updated weights for policy 1, policy_version 1617439 (0.0010) [2023-12-28 06:51:29,113][106226] Updated weights for policy 0, policy_version 1613776 (0.0006) [2023-12-28 06:51:29,125][106225] Updated weights for policy 1, policy_version 1617449 (0.0010) [2023-12-28 06:51:29,184][106225] Updated weights for policy 1, policy_version 1617459 (0.0010) [2023-12-28 06:51:29,841][106226] Updated weights for policy 0, policy_version 1613786 (0.0006) [2023-12-28 06:51:29,909][106226] Updated weights for policy 0, policy_version 1613796 (0.0007) [2023-12-28 06:51:29,949][106225] Updated weights for policy 1, policy_version 1617469 (0.0009) [2023-12-28 06:51:29,984][106226] Updated weights for policy 0, policy_version 1613806 (0.0006) [2023-12-28 06:51:30,012][106225] Updated weights for policy 1, policy_version 1617479 (0.0007) [2023-12-28 06:51:30,042][106226] Updated weights for policy 0, policy_version 1613816 (0.0005) [2023-12-28 06:51:30,063][106225] Updated weights for policy 1, policy_version 1617489 (0.0009) [2023-12-28 06:51:30,606][106226] Updated weights for policy 0, policy_version 1613826 (0.0005) [2023-12-28 06:51:30,664][106226] Updated weights for policy 0, policy_version 1613836 (0.0005) [2023-12-28 06:51:30,725][106226] Updated weights for policy 0, policy_version 1613846 (0.0005) [2023-12-28 06:51:30,784][106225] Updated weights for policy 1, policy_version 1617499 (0.0008) [2023-12-28 06:51:30,840][106225] Updated weights for policy 1, policy_version 1617509 (0.0007) [2023-12-28 06:51:30,895][106225] Updated weights for policy 1, policy_version 1617519 (0.0005) [2023-12-28 06:51:31,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 827359232. Throughput: 0: 10078.1, 1: 9717.1. Samples: 827346276. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:31,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.555')] [2023-12-28 06:51:31,396][106226] Updated weights for policy 0, policy_version 1613856 (0.0008) [2023-12-28 06:51:31,450][106226] Updated weights for policy 0, policy_version 1613866 (0.0008) [2023-12-28 06:51:31,500][106226] Updated weights for policy 0, policy_version 1613876 (0.0008) [2023-12-28 06:51:31,640][106225] Updated weights for policy 1, policy_version 1617529 (0.0007) [2023-12-28 06:51:31,708][106225] Updated weights for policy 1, policy_version 1617539 (0.0007) [2023-12-28 06:51:31,778][106225] Updated weights for policy 1, policy_version 1617549 (0.0008) [2023-12-28 06:51:31,837][106225] Updated weights for policy 1, policy_version 1617559 (0.0008) [2023-12-28 06:51:32,353][106226] Updated weights for policy 0, policy_version 1613886 (0.0009) [2023-12-28 06:51:32,426][106226] Updated weights for policy 0, policy_version 1613897 (0.0009) [2023-12-28 06:51:32,473][106225] Updated weights for policy 1, policy_version 1617569 (0.0007) [2023-12-28 06:51:32,477][106226] Updated weights for policy 0, policy_version 1613907 (0.0008) [2023-12-28 06:51:32,531][106225] Updated weights for policy 1, policy_version 1617579 (0.0006) [2023-12-28 06:51:32,590][106225] Updated weights for policy 1, policy_version 1617589 (0.0008) [2023-12-28 06:51:33,169][106226] Updated weights for policy 0, policy_version 1613917 (0.0007) [2023-12-28 06:51:33,233][106226] Updated weights for policy 0, policy_version 1613927 (0.0006) [2023-12-28 06:51:33,290][106226] Updated weights for policy 0, policy_version 1613937 (0.0005) [2023-12-28 06:51:33,302][106225] Updated weights for policy 1, policy_version 1617599 (0.0008) [2023-12-28 06:51:33,345][106225] Updated weights for policy 1, policy_version 1617609 (0.0007) [2023-12-28 06:51:33,393][106225] Updated weights for policy 1, policy_version 1617619 (0.0008) [2023-12-28 06:51:33,796][106226] Updated weights for policy 0, policy_version 1613947 (0.0007) [2023-12-28 06:51:33,852][106226] Updated weights for policy 0, policy_version 1613957 (0.0007) [2023-12-28 06:51:33,901][106226] Updated weights for policy 0, policy_version 1613967 (0.0008) [2023-12-28 06:51:34,074][106225] Updated weights for policy 1, policy_version 1617629 (0.0008) [2023-12-28 06:51:34,132][106225] Updated weights for policy 1, policy_version 1617639 (0.0010) [2023-12-28 06:51:34,194][106225] Updated weights for policy 1, policy_version 1617649 (0.0011) [2023-12-28 06:51:34,634][106226] Updated weights for policy 0, policy_version 1613977 (0.0007) [2023-12-28 06:51:34,693][106226] Updated weights for policy 0, policy_version 1613987 (0.0008) [2023-12-28 06:51:34,743][106226] Updated weights for policy 0, policy_version 1613997 (0.0007) [2023-12-28 06:51:34,797][106226] Updated weights for policy 0, policy_version 1614007 (0.0008) [2023-12-28 06:51:34,914][106225] Updated weights for policy 1, policy_version 1617659 (0.0010) [2023-12-28 06:51:34,970][106225] Updated weights for policy 1, policy_version 1617669 (0.0010) [2023-12-28 06:51:35,033][106225] Updated weights for policy 1, policy_version 1617679 (0.0010) [2023-12-28 06:51:35,539][106226] Updated weights for policy 0, policy_version 1614017 (0.0008) [2023-12-28 06:51:35,588][106226] Updated weights for policy 0, policy_version 1614027 (0.0007) [2023-12-28 06:51:35,642][106226] Updated weights for policy 0, policy_version 1614037 (0.0008) [2023-12-28 06:51:35,740][106225] Updated weights for policy 1, policy_version 1617689 (0.0010) [2023-12-28 06:51:35,789][106225] Updated weights for policy 1, policy_version 1617699 (0.0010) [2023-12-28 06:51:35,845][106225] Updated weights for policy 1, policy_version 1617709 (0.0010) [2023-12-28 06:51:35,904][106225] Updated weights for policy 1, policy_version 1617719 (0.0010) [2023-12-28 06:51:36,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 827457536. Throughput: 0: 10134.0, 1: 9797.1. Samples: 827466852. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:36,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.617')] [2023-12-28 06:51:36,453][106226] Updated weights for policy 0, policy_version 1614047 (0.0008) [2023-12-28 06:51:36,521][106226] Updated weights for policy 0, policy_version 1614057 (0.0008) [2023-12-28 06:51:36,561][106225] Updated weights for policy 1, policy_version 1617729 (0.0009) [2023-12-28 06:51:36,573][106226] Updated weights for policy 0, policy_version 1614067 (0.0007) [2023-12-28 06:51:36,626][106225] Updated weights for policy 1, policy_version 1617739 (0.0010) [2023-12-28 06:51:36,684][106225] Updated weights for policy 1, policy_version 1617749 (0.0011) [2023-12-28 06:51:37,181][106226] Updated weights for policy 0, policy_version 1614077 (0.0007) [2023-12-28 06:51:37,244][106226] Updated weights for policy 0, policy_version 1614087 (0.0007) [2023-12-28 06:51:37,302][106226] Updated weights for policy 0, policy_version 1614097 (0.0008) [2023-12-28 06:51:37,351][106225] Updated weights for policy 1, policy_version 1617759 (0.0010) [2023-12-28 06:51:37,418][106225] Updated weights for policy 1, policy_version 1617769 (0.0011) [2023-12-28 06:51:37,475][106225] Updated weights for policy 1, policy_version 1617779 (0.0010) [2023-12-28 06:51:37,958][106226] Updated weights for policy 0, policy_version 1614107 (0.0007) [2023-12-28 06:51:38,021][106226] Updated weights for policy 0, policy_version 1614117 (0.0008) [2023-12-28 06:51:38,073][106226] Updated weights for policy 0, policy_version 1614127 (0.0008) [2023-12-28 06:51:38,180][106225] Updated weights for policy 1, policy_version 1617789 (0.0009) [2023-12-28 06:51:38,240][106225] Updated weights for policy 1, policy_version 1617799 (0.0009) [2023-12-28 06:51:38,307][106225] Updated weights for policy 1, policy_version 1617809 (0.0008) [2023-12-28 06:51:38,784][106226] Updated weights for policy 0, policy_version 1614137 (0.0009) [2023-12-28 06:51:38,844][106226] Updated weights for policy 0, policy_version 1614147 (0.0008) [2023-12-28 06:51:38,902][106226] Updated weights for policy 0, policy_version 1614157 (0.0008) [2023-12-28 06:51:38,961][106226] Updated weights for policy 0, policy_version 1614167 (0.0008) [2023-12-28 06:51:39,062][106225] Updated weights for policy 1, policy_version 1617819 (0.0008) [2023-12-28 06:51:39,115][106225] Updated weights for policy 1, policy_version 1617829 (0.0005) [2023-12-28 06:51:39,173][106225] Updated weights for policy 1, policy_version 1617839 (0.0005) [2023-12-28 06:51:39,716][106226] Updated weights for policy 0, policy_version 1614177 (0.0010) [2023-12-28 06:51:39,777][106226] Updated weights for policy 0, policy_version 1614187 (0.0011) [2023-12-28 06:51:39,849][106226] Updated weights for policy 0, policy_version 1614197 (0.0010) [2023-12-28 06:51:39,956][106225] Updated weights for policy 1, policy_version 1617849 (0.0007) [2023-12-28 06:51:40,025][106225] Updated weights for policy 1, policy_version 1617859 (0.0011) [2023-12-28 06:51:40,083][106225] Updated weights for policy 1, policy_version 1617869 (0.0008) [2023-12-28 06:51:40,145][106225] Updated weights for policy 1, policy_version 1617879 (0.0009) [2023-12-28 06:51:40,564][106226] Updated weights for policy 0, policy_version 1614207 (0.0011) [2023-12-28 06:51:40,611][106226] Updated weights for policy 0, policy_version 1614217 (0.0010) [2023-12-28 06:51:40,658][106226] Updated weights for policy 0, policy_version 1614227 (0.0010) [2023-12-28 06:51:40,856][106225] Updated weights for policy 1, policy_version 1617889 (0.0010) [2023-12-28 06:51:40,910][106225] Updated weights for policy 1, policy_version 1617899 (0.0010) [2023-12-28 06:51:40,958][106225] Updated weights for policy 1, policy_version 1617909 (0.0008) [2023-12-28 06:51:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 827555840. Throughput: 0: 10120.6, 1: 9818.2. Samples: 827526252. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:41,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.629')] [2023-12-28 06:51:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001614232_413319168.pth... [2023-12-28 06:51:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001617912_414236672.pth... [2023-12-28 06:51:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001616760_413941760.pth [2023-12-28 06:51:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001613048_413016064.pth [2023-12-28 06:51:41,428][106226] Updated weights for policy 0, policy_version 1614237 (0.0008) [2023-12-28 06:51:41,487][106226] Updated weights for policy 0, policy_version 1614247 (0.0006) [2023-12-28 06:51:41,547][106226] Updated weights for policy 0, policy_version 1614257 (0.0007) [2023-12-28 06:51:41,789][106225] Updated weights for policy 1, policy_version 1617919 (0.0010) [2023-12-28 06:51:41,840][106225] Updated weights for policy 1, policy_version 1617929 (0.0010) [2023-12-28 06:51:41,896][106225] Updated weights for policy 1, policy_version 1617939 (0.0007) [2023-12-28 06:51:42,246][106226] Updated weights for policy 0, policy_version 1614267 (0.0007) [2023-12-28 06:51:42,317][106226] Updated weights for policy 0, policy_version 1614277 (0.0008) [2023-12-28 06:51:42,385][106226] Updated weights for policy 0, policy_version 1614287 (0.0009) [2023-12-28 06:51:42,600][106225] Updated weights for policy 1, policy_version 1617949 (0.0008) [2023-12-28 06:51:42,664][106225] Updated weights for policy 1, policy_version 1617959 (0.0011) [2023-12-28 06:51:42,728][106225] Updated weights for policy 1, policy_version 1617969 (0.0011) [2023-12-28 06:51:43,029][106226] Updated weights for policy 0, policy_version 1614297 (0.0010) [2023-12-28 06:51:43,082][106226] Updated weights for policy 0, policy_version 1614307 (0.0008) [2023-12-28 06:51:43,132][106226] Updated weights for policy 0, policy_version 1614317 (0.0007) [2023-12-28 06:51:43,198][106226] Updated weights for policy 0, policy_version 1614327 (0.0009) [2023-12-28 06:51:43,398][106225] Updated weights for policy 1, policy_version 1617979 (0.0010) [2023-12-28 06:51:43,450][106225] Updated weights for policy 1, policy_version 1617989 (0.0008) [2023-12-28 06:51:43,509][106225] Updated weights for policy 1, policy_version 1617999 (0.0009) [2023-12-28 06:51:43,871][106226] Updated weights for policy 0, policy_version 1614337 (0.0007) [2023-12-28 06:51:43,942][106226] Updated weights for policy 0, policy_version 1614347 (0.0008) [2023-12-28 06:51:44,013][106226] Updated weights for policy 0, policy_version 1614357 (0.0008) [2023-12-28 06:51:44,175][106225] Updated weights for policy 1, policy_version 1618009 (0.0009) [2023-12-28 06:51:44,233][106225] Updated weights for policy 1, policy_version 1618019 (0.0005) [2023-12-28 06:51:44,291][106225] Updated weights for policy 1, policy_version 1618029 (0.0005) [2023-12-28 06:51:44,346][106225] Updated weights for policy 1, policy_version 1618039 (0.0005) [2023-12-28 06:51:44,671][106226] Updated weights for policy 0, policy_version 1614367 (0.0009) [2023-12-28 06:51:44,721][106226] Updated weights for policy 0, policy_version 1614377 (0.0009) [2023-12-28 06:51:44,777][106226] Updated weights for policy 0, policy_version 1614387 (0.0007) [2023-12-28 06:51:44,874][106225] Updated weights for policy 1, policy_version 1618049 (0.0010) [2023-12-28 06:51:44,925][106225] Updated weights for policy 1, policy_version 1618059 (0.0010) [2023-12-28 06:51:44,973][106225] Updated weights for policy 1, policy_version 1618069 (0.0010) [2023-12-28 06:51:45,513][106226] Updated weights for policy 0, policy_version 1614397 (0.0008) [2023-12-28 06:51:45,572][106226] Updated weights for policy 0, policy_version 1614407 (0.0007) [2023-12-28 06:51:45,627][106226] Updated weights for policy 0, policy_version 1614417 (0.0005) [2023-12-28 06:51:45,721][106225] Updated weights for policy 1, policy_version 1618079 (0.0010) [2023-12-28 06:51:45,784][106225] Updated weights for policy 1, policy_version 1618089 (0.0010) [2023-12-28 06:51:45,835][106225] Updated weights for policy 1, policy_version 1618099 (0.0010) [2023-12-28 06:51:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 827654144. Throughput: 0: 10055.3, 1: 9839.4. Samples: 827643648. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:46,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.285')] [2023-12-28 06:51:46,303][106226] Updated weights for policy 0, policy_version 1614427 (0.0007) [2023-12-28 06:51:46,354][106226] Updated weights for policy 0, policy_version 1614437 (0.0010) [2023-12-28 06:51:46,411][106226] Updated weights for policy 0, policy_version 1614447 (0.0010) [2023-12-28 06:51:46,548][106225] Updated weights for policy 1, policy_version 1618109 (0.0010) [2023-12-28 06:51:46,603][106225] Updated weights for policy 1, policy_version 1618119 (0.0010) [2023-12-28 06:51:46,651][106225] Updated weights for policy 1, policy_version 1618129 (0.0009) [2023-12-28 06:51:46,997][106226] Updated weights for policy 0, policy_version 1614457 (0.0010) [2023-12-28 06:51:47,064][106226] Updated weights for policy 0, policy_version 1614467 (0.0005) [2023-12-28 06:51:47,127][106226] Updated weights for policy 0, policy_version 1614477 (0.0011) [2023-12-28 06:51:47,186][106226] Updated weights for policy 0, policy_version 1614487 (0.0011) [2023-12-28 06:51:47,300][106225] Updated weights for policy 1, policy_version 1618139 (0.0009) [2023-12-28 06:51:47,365][106225] Updated weights for policy 1, policy_version 1618149 (0.0007) [2023-12-28 06:51:47,426][106225] Updated weights for policy 1, policy_version 1618159 (0.0008) [2023-12-28 06:51:47,869][106226] Updated weights for policy 0, policy_version 1614497 (0.0009) [2023-12-28 06:51:47,932][106226] Updated weights for policy 0, policy_version 1614507 (0.0008) [2023-12-28 06:51:47,999][106226] Updated weights for policy 0, policy_version 1614517 (0.0007) [2023-12-28 06:51:48,096][106225] Updated weights for policy 1, policy_version 1618169 (0.0007) [2023-12-28 06:51:48,163][106225] Updated weights for policy 1, policy_version 1618179 (0.0007) [2023-12-28 06:51:48,227][106225] Updated weights for policy 1, policy_version 1618189 (0.0007) [2023-12-28 06:51:48,290][106225] Updated weights for policy 1, policy_version 1618199 (0.0006) [2023-12-28 06:51:48,758][106226] Updated weights for policy 0, policy_version 1614527 (0.0009) [2023-12-28 06:51:48,822][106226] Updated weights for policy 0, policy_version 1614537 (0.0008) [2023-12-28 06:51:48,888][106226] Updated weights for policy 0, policy_version 1614547 (0.0008) [2023-12-28 06:51:48,957][106225] Updated weights for policy 1, policy_version 1618209 (0.0008) [2023-12-28 06:51:49,016][106225] Updated weights for policy 1, policy_version 1618219 (0.0009) [2023-12-28 06:51:49,077][106225] Updated weights for policy 1, policy_version 1618229 (0.0008) [2023-12-28 06:51:49,584][106226] Updated weights for policy 0, policy_version 1614557 (0.0008) [2023-12-28 06:51:49,634][106226] Updated weights for policy 0, policy_version 1614567 (0.0008) [2023-12-28 06:51:49,684][106226] Updated weights for policy 0, policy_version 1614577 (0.0007) [2023-12-28 06:51:49,881][106225] Updated weights for policy 1, policy_version 1618239 (0.0009) [2023-12-28 06:51:49,936][106225] Updated weights for policy 1, policy_version 1618249 (0.0011) [2023-12-28 06:51:49,995][106225] Updated weights for policy 1, policy_version 1618259 (0.0010) [2023-12-28 06:51:50,425][106226] Updated weights for policy 0, policy_version 1614587 (0.0007) [2023-12-28 06:51:50,490][106226] Updated weights for policy 0, policy_version 1614597 (0.0007) [2023-12-28 06:51:50,545][106226] Updated weights for policy 0, policy_version 1614607 (0.0008) [2023-12-28 06:51:50,729][106225] Updated weights for policy 1, policy_version 1618269 (0.0009) [2023-12-28 06:51:50,800][106225] Updated weights for policy 1, policy_version 1618279 (0.0011) [2023-12-28 06:51:50,865][106225] Updated weights for policy 1, policy_version 1618289 (0.0010) [2023-12-28 06:51:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 827752448. Throughput: 0: 9979.1, 1: 9875.7. Samples: 827762304. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:51,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.501')] [2023-12-28 06:51:51,257][106226] Updated weights for policy 0, policy_version 1614617 (0.0009) [2023-12-28 06:51:51,325][106226] Updated weights for policy 0, policy_version 1614627 (0.0008) [2023-12-28 06:51:51,397][106226] Updated weights for policy 0, policy_version 1614637 (0.0008) [2023-12-28 06:51:51,454][106226] Updated weights for policy 0, policy_version 1614647 (0.0008) [2023-12-28 06:51:51,598][106225] Updated weights for policy 1, policy_version 1618299 (0.0010) [2023-12-28 06:51:51,662][106225] Updated weights for policy 1, policy_version 1618309 (0.0008) [2023-12-28 06:51:51,719][106225] Updated weights for policy 1, policy_version 1618319 (0.0007) [2023-12-28 06:51:52,123][106226] Updated weights for policy 0, policy_version 1614657 (0.0009) [2023-12-28 06:51:52,188][106226] Updated weights for policy 0, policy_version 1614667 (0.0008) [2023-12-28 06:51:52,250][106226] Updated weights for policy 0, policy_version 1614677 (0.0009) [2023-12-28 06:51:52,472][106225] Updated weights for policy 1, policy_version 1618329 (0.0007) [2023-12-28 06:51:52,532][106225] Updated weights for policy 1, policy_version 1618339 (0.0009) [2023-12-28 06:51:52,587][106225] Updated weights for policy 1, policy_version 1618349 (0.0006) [2023-12-28 06:51:52,644][106225] Updated weights for policy 1, policy_version 1618359 (0.0006) [2023-12-28 06:51:53,063][106226] Updated weights for policy 0, policy_version 1614687 (0.0008) [2023-12-28 06:51:53,113][106226] Updated weights for policy 0, policy_version 1614697 (0.0008) [2023-12-28 06:51:53,166][106226] Updated weights for policy 0, policy_version 1614707 (0.0008) [2023-12-28 06:51:53,237][106225] Updated weights for policy 1, policy_version 1618369 (0.0010) [2023-12-28 06:51:53,298][106225] Updated weights for policy 1, policy_version 1618379 (0.0010) [2023-12-28 06:51:53,358][106225] Updated weights for policy 1, policy_version 1618389 (0.0010) [2023-12-28 06:51:53,829][106226] Updated weights for policy 0, policy_version 1614717 (0.0008) [2023-12-28 06:51:53,882][106226] Updated weights for policy 0, policy_version 1614727 (0.0006) [2023-12-28 06:51:53,928][106226] Updated weights for policy 0, policy_version 1614737 (0.0005) [2023-12-28 06:51:54,071][106225] Updated weights for policy 1, policy_version 1618399 (0.0007) [2023-12-28 06:51:54,119][106225] Updated weights for policy 1, policy_version 1618409 (0.0005) [2023-12-28 06:51:54,170][106225] Updated weights for policy 1, policy_version 1618419 (0.0008) [2023-12-28 06:51:54,576][106226] Updated weights for policy 0, policy_version 1614747 (0.0005) [2023-12-28 06:51:54,637][106226] Updated weights for policy 0, policy_version 1614757 (0.0005) [2023-12-28 06:51:54,700][106226] Updated weights for policy 0, policy_version 1614767 (0.0006) [2023-12-28 06:51:54,849][106225] Updated weights for policy 1, policy_version 1618429 (0.0010) [2023-12-28 06:51:54,906][106225] Updated weights for policy 1, policy_version 1618439 (0.0010) [2023-12-28 06:51:54,967][106225] Updated weights for policy 1, policy_version 1618449 (0.0010) [2023-12-28 06:51:55,419][106226] Updated weights for policy 0, policy_version 1614777 (0.0009) [2023-12-28 06:51:55,487][106226] Updated weights for policy 0, policy_version 1614787 (0.0009) [2023-12-28 06:51:55,550][106226] Updated weights for policy 0, policy_version 1614797 (0.0011) [2023-12-28 06:51:55,565][106225] Updated weights for policy 1, policy_version 1618459 (0.0011) [2023-12-28 06:51:55,615][106225] Updated weights for policy 1, policy_version 1618469 (0.0010) [2023-12-28 06:51:55,616][106226] Updated weights for policy 0, policy_version 1614807 (0.0010) [2023-12-28 06:51:55,662][106225] Updated weights for policy 1, policy_version 1618479 (0.0010) [2023-12-28 06:51:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 827850752. Throughput: 0: 9937.6, 1: 9915.5. Samples: 827820668. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:51:56,175][105115] Avg episode reward: [(0, '-4.167'), (1, '-4.756')] [2023-12-28 06:51:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001614808_413466624.pth... [2023-12-28 06:51:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001618488_414384128.pth... [2023-12-28 06:51:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001613656_413171712.pth [2023-12-28 06:51:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001617336_414089216.pth [2023-12-28 06:51:56,287][106226] Updated weights for policy 0, policy_version 1614817 (0.0008) [2023-12-28 06:51:56,333][106226] Updated weights for policy 0, policy_version 1614827 (0.0008) [2023-12-28 06:51:56,393][106226] Updated weights for policy 0, policy_version 1614837 (0.0008) [2023-12-28 06:51:56,399][106225] Updated weights for policy 1, policy_version 1618489 (0.0010) [2023-12-28 06:51:56,472][106225] Updated weights for policy 1, policy_version 1618499 (0.0010) [2023-12-28 06:51:56,528][106225] Updated weights for policy 1, policy_version 1618509 (0.0010) [2023-12-28 06:51:56,595][106225] Updated weights for policy 1, policy_version 1618519 (0.0010) [2023-12-28 06:51:57,036][106226] Updated weights for policy 0, policy_version 1614847 (0.0007) [2023-12-28 06:51:57,094][106226] Updated weights for policy 0, policy_version 1614857 (0.0005) [2023-12-28 06:51:57,153][106226] Updated weights for policy 0, policy_version 1614867 (0.0005) [2023-12-28 06:51:57,280][106225] Updated weights for policy 1, policy_version 1618529 (0.0008) [2023-12-28 06:51:57,339][106225] Updated weights for policy 1, policy_version 1618539 (0.0006) [2023-12-28 06:51:57,400][106225] Updated weights for policy 1, policy_version 1618549 (0.0007) [2023-12-28 06:51:57,702][106226] Updated weights for policy 0, policy_version 1614877 (0.0006) [2023-12-28 06:51:57,757][106226] Updated weights for policy 0, policy_version 1614887 (0.0008) [2023-12-28 06:51:57,812][106226] Updated weights for policy 0, policy_version 1614897 (0.0009) [2023-12-28 06:51:58,060][106225] Updated weights for policy 1, policy_version 1618559 (0.0008) [2023-12-28 06:51:58,108][106225] Updated weights for policy 1, policy_version 1618569 (0.0009) [2023-12-28 06:51:58,173][106225] Updated weights for policy 1, policy_version 1618579 (0.0007) [2023-12-28 06:51:58,437][106226] Updated weights for policy 0, policy_version 1614907 (0.0007) [2023-12-28 06:51:58,500][106226] Updated weights for policy 0, policy_version 1614917 (0.0009) [2023-12-28 06:51:58,564][106226] Updated weights for policy 0, policy_version 1614927 (0.0008) [2023-12-28 06:51:59,004][106225] Updated weights for policy 1, policy_version 1618589 (0.0007) [2023-12-28 06:51:59,068][106225] Updated weights for policy 1, policy_version 1618599 (0.0008) [2023-12-28 06:51:59,131][106225] Updated weights for policy 1, policy_version 1618609 (0.0008) [2023-12-28 06:51:59,394][106226] Updated weights for policy 0, policy_version 1614937 (0.0007) [2023-12-28 06:51:59,461][106226] Updated weights for policy 0, policy_version 1614947 (0.0006) [2023-12-28 06:51:59,527][106226] Updated weights for policy 0, policy_version 1614957 (0.0006) [2023-12-28 06:51:59,592][106226] Updated weights for policy 0, policy_version 1614967 (0.0005) [2023-12-28 06:51:59,858][106225] Updated weights for policy 1, policy_version 1618619 (0.0009) [2023-12-28 06:51:59,919][106225] Updated weights for policy 1, policy_version 1618629 (0.0008) [2023-12-28 06:51:59,982][106225] Updated weights for policy 1, policy_version 1618639 (0.0008) [2023-12-28 06:52:00,231][106226] Updated weights for policy 0, policy_version 1614977 (0.0010) [2023-12-28 06:52:00,295][106226] Updated weights for policy 0, policy_version 1614987 (0.0011) [2023-12-28 06:52:00,352][106226] Updated weights for policy 0, policy_version 1614997 (0.0010) [2023-12-28 06:52:00,759][106225] Updated weights for policy 1, policy_version 1618649 (0.0008) [2023-12-28 06:52:00,813][106225] Updated weights for policy 1, policy_version 1618659 (0.0008) [2023-12-28 06:52:00,864][106225] Updated weights for policy 1, policy_version 1618669 (0.0007) [2023-12-28 06:52:00,911][106225] Updated weights for policy 1, policy_version 1618679 (0.0009) [2023-12-28 06:52:00,999][106226] Updated weights for policy 0, policy_version 1615007 (0.0009) [2023-12-28 06:52:01,059][106226] Updated weights for policy 0, policy_version 1615017 (0.0009) [2023-12-28 06:52:01,112][106226] Updated weights for policy 0, policy_version 1615027 (0.0006) [2023-12-28 06:52:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 827957248. Throughput: 0: 9952.5, 1: 9926.1. Samples: 827941380. Policy #0 lag: (min: 19.0, avg: 29.3, max: 51.0) [2023-12-28 06:52:01,175][105115] Avg episode reward: [(0, '-4.779'), (1, '-4.913')] [2023-12-28 06:52:01,580][106225] Updated weights for policy 1, policy_version 1618689 (0.0010) [2023-12-28 06:52:01,644][106225] Updated weights for policy 1, policy_version 1618699 (0.0010) [2023-12-28 06:52:01,710][106225] Updated weights for policy 1, policy_version 1618709 (0.0006) [2023-12-28 06:52:01,868][106226] Updated weights for policy 0, policy_version 1615037 (0.0010) [2023-12-28 06:52:01,920][106226] Updated weights for policy 0, policy_version 1615047 (0.0006) [2023-12-28 06:52:01,980][106226] Updated weights for policy 0, policy_version 1615057 (0.0006) [2023-12-28 06:52:02,420][106225] Updated weights for policy 1, policy_version 1618719 (0.0011) [2023-12-28 06:52:02,480][106225] Updated weights for policy 1, policy_version 1618729 (0.0007) [2023-12-28 06:52:02,544][106225] Updated weights for policy 1, policy_version 1618739 (0.0005) [2023-12-28 06:52:02,583][106226] Updated weights for policy 0, policy_version 1615067 (0.0006) [2023-12-28 06:52:02,649][106226] Updated weights for policy 0, policy_version 1615077 (0.0009) [2023-12-28 06:52:02,713][106226] Updated weights for policy 0, policy_version 1615087 (0.0010) [2023-12-28 06:52:03,188][106225] Updated weights for policy 1, policy_version 1618749 (0.0009) [2023-12-28 06:52:03,234][106225] Updated weights for policy 1, policy_version 1618759 (0.0007) [2023-12-28 06:52:03,280][106225] Updated weights for policy 1, policy_version 1618769 (0.0005) [2023-12-28 06:52:03,421][106226] Updated weights for policy 0, policy_version 1615097 (0.0010) [2023-12-28 06:52:03,477][106226] Updated weights for policy 0, policy_version 1615107 (0.0010) [2023-12-28 06:52:03,535][106226] Updated weights for policy 0, policy_version 1615117 (0.0010) [2023-12-28 06:52:03,593][106226] Updated weights for policy 0, policy_version 1615127 (0.0010) [2023-12-28 06:52:03,978][106225] Updated weights for policy 1, policy_version 1618779 (0.0006) [2023-12-28 06:52:04,043][106225] Updated weights for policy 1, policy_version 1618789 (0.0008) [2023-12-28 06:52:04,105][106225] Updated weights for policy 1, policy_version 1618799 (0.0011) [2023-12-28 06:52:04,317][106226] Updated weights for policy 0, policy_version 1615137 (0.0011) [2023-12-28 06:52:04,380][106226] Updated weights for policy 0, policy_version 1615147 (0.0010) [2023-12-28 06:52:04,443][106226] Updated weights for policy 0, policy_version 1615157 (0.0007) [2023-12-28 06:52:04,814][106225] Updated weights for policy 1, policy_version 1618809 (0.0010) [2023-12-28 06:52:04,867][106225] Updated weights for policy 1, policy_version 1618819 (0.0010) [2023-12-28 06:52:04,930][106225] Updated weights for policy 1, policy_version 1618829 (0.0010) [2023-12-28 06:52:04,992][106225] Updated weights for policy 1, policy_version 1618839 (0.0010) [2023-12-28 06:52:05,099][106226] Updated weights for policy 0, policy_version 1615167 (0.0009) [2023-12-28 06:52:05,159][106226] Updated weights for policy 0, policy_version 1615177 (0.0011) [2023-12-28 06:52:05,221][106226] Updated weights for policy 0, policy_version 1615187 (0.0008) [2023-12-28 06:52:05,688][106225] Updated weights for policy 1, policy_version 1618849 (0.0006) [2023-12-28 06:52:05,754][106225] Updated weights for policy 1, policy_version 1618859 (0.0006) [2023-12-28 06:52:05,814][106225] Updated weights for policy 1, policy_version 1618869 (0.0006) [2023-12-28 06:52:05,827][106226] Updated weights for policy 0, policy_version 1615197 (0.0005) [2023-12-28 06:52:05,888][106226] Updated weights for policy 0, policy_version 1615207 (0.0005) [2023-12-28 06:52:05,943][106226] Updated weights for policy 0, policy_version 1615217 (0.0005) [2023-12-28 06:52:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 828055552. Throughput: 0: 10068.8, 1: 9951.8. Samples: 828062876. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:06,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.894')] [2023-12-28 06:52:06,450][106225] Updated weights for policy 1, policy_version 1618879 (0.0008) [2023-12-28 06:52:06,518][106225] Updated weights for policy 1, policy_version 1618889 (0.0008) [2023-12-28 06:52:06,573][106226] Updated weights for policy 0, policy_version 1615227 (0.0005) [2023-12-28 06:52:06,583][106225] Updated weights for policy 1, policy_version 1618899 (0.0009) [2023-12-28 06:52:06,636][106226] Updated weights for policy 0, policy_version 1615237 (0.0008) [2023-12-28 06:52:06,694][106226] Updated weights for policy 0, policy_version 1615247 (0.0009) [2023-12-28 06:52:07,239][106225] Updated weights for policy 1, policy_version 1618909 (0.0008) [2023-12-28 06:52:07,297][106225] Updated weights for policy 1, policy_version 1618919 (0.0010) [2023-12-28 06:52:07,360][106225] Updated weights for policy 1, policy_version 1618929 (0.0009) [2023-12-28 06:52:07,457][106226] Updated weights for policy 0, policy_version 1615257 (0.0008) [2023-12-28 06:52:07,506][106226] Updated weights for policy 0, policy_version 1615267 (0.0005) [2023-12-28 06:52:07,565][106226] Updated weights for policy 0, policy_version 1615277 (0.0005) [2023-12-28 06:52:07,623][106226] Updated weights for policy 0, policy_version 1615287 (0.0005) [2023-12-28 06:52:08,028][106225] Updated weights for policy 1, policy_version 1618939 (0.0007) [2023-12-28 06:52:08,078][106225] Updated weights for policy 1, policy_version 1618949 (0.0005) [2023-12-28 06:52:08,136][106225] Updated weights for policy 1, policy_version 1618959 (0.0006) [2023-12-28 06:52:08,180][106226] Updated weights for policy 0, policy_version 1615297 (0.0008) [2023-12-28 06:52:08,240][106226] Updated weights for policy 0, policy_version 1615307 (0.0010) [2023-12-28 06:52:08,296][106226] Updated weights for policy 0, policy_version 1615317 (0.0007) [2023-12-28 06:52:08,886][106225] Updated weights for policy 1, policy_version 1618969 (0.0007) [2023-12-28 06:52:08,892][106226] Updated weights for policy 0, policy_version 1615327 (0.0010) [2023-12-28 06:52:08,949][106225] Updated weights for policy 1, policy_version 1618979 (0.0006) [2023-12-28 06:52:08,958][106226] Updated weights for policy 0, policy_version 1615337 (0.0008) [2023-12-28 06:52:09,000][106225] Updated weights for policy 1, policy_version 1618989 (0.0008) [2023-12-28 06:52:09,019][106226] Updated weights for policy 0, policy_version 1615347 (0.0005) [2023-12-28 06:52:09,050][106225] Updated weights for policy 1, policy_version 1618999 (0.0008) [2023-12-28 06:52:09,696][106226] Updated weights for policy 0, policy_version 1615357 (0.0005) [2023-12-28 06:52:09,755][106226] Updated weights for policy 0, policy_version 1615367 (0.0007) [2023-12-28 06:52:09,811][106226] Updated weights for policy 0, policy_version 1615377 (0.0011) [2023-12-28 06:52:09,863][106225] Updated weights for policy 1, policy_version 1619009 (0.0008) [2023-12-28 06:52:09,929][106225] Updated weights for policy 1, policy_version 1619019 (0.0008) [2023-12-28 06:52:09,986][106225] Updated weights for policy 1, policy_version 1619029 (0.0009) [2023-12-28 06:52:10,458][106226] Updated weights for policy 0, policy_version 1615387 (0.0009) [2023-12-28 06:52:10,525][106226] Updated weights for policy 0, policy_version 1615397 (0.0009) [2023-12-28 06:52:10,584][106226] Updated weights for policy 0, policy_version 1615407 (0.0009) [2023-12-28 06:52:10,748][106225] Updated weights for policy 1, policy_version 1619039 (0.0007) [2023-12-28 06:52:10,819][106225] Updated weights for policy 1, policy_version 1619049 (0.0005) [2023-12-28 06:52:10,877][106225] Updated weights for policy 1, policy_version 1619059 (0.0006) [2023-12-28 06:52:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 828153856. Throughput: 0: 10090.3, 1: 10001.5. Samples: 828124836. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:11,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.840')] [2023-12-28 06:52:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001619064_414531584.pth... [2023-12-28 06:52:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001615416_413622272.pth... [2023-12-28 06:52:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001614232_413319168.pth [2023-12-28 06:52:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001617912_414236672.pth [2023-12-28 06:52:11,366][106226] Updated weights for policy 0, policy_version 1615417 (0.0009) [2023-12-28 06:52:11,437][106226] Updated weights for policy 0, policy_version 1615427 (0.0008) [2023-12-28 06:52:11,502][106226] Updated weights for policy 0, policy_version 1615437 (0.0008) [2023-12-28 06:52:11,567][106226] Updated weights for policy 0, policy_version 1615447 (0.0008) [2023-12-28 06:52:11,596][106225] Updated weights for policy 1, policy_version 1619069 (0.0008) [2023-12-28 06:52:11,675][106225] Updated weights for policy 1, policy_version 1619079 (0.0009) [2023-12-28 06:52:11,742][106225] Updated weights for policy 1, policy_version 1619089 (0.0007) [2023-12-28 06:52:12,306][106226] Updated weights for policy 0, policy_version 1615457 (0.0010) [2023-12-28 06:52:12,378][106225] Updated weights for policy 1, policy_version 1619099 (0.0008) [2023-12-28 06:52:12,388][106226] Updated weights for policy 0, policy_version 1615467 (0.0008) [2023-12-28 06:52:12,440][106225] Updated weights for policy 1, policy_version 1619109 (0.0006) [2023-12-28 06:52:12,448][106226] Updated weights for policy 0, policy_version 1615477 (0.0008) [2023-12-28 06:52:12,499][106225] Updated weights for policy 1, policy_version 1619119 (0.0006) [2023-12-28 06:52:13,044][106225] Updated weights for policy 1, policy_version 1619129 (0.0007) [2023-12-28 06:52:13,102][106225] Updated weights for policy 1, policy_version 1619139 (0.0007) [2023-12-28 06:52:13,155][106225] Updated weights for policy 1, policy_version 1619149 (0.0007) [2023-12-28 06:52:13,203][106225] Updated weights for policy 1, policy_version 1619159 (0.0006) [2023-12-28 06:52:13,227][106226] Updated weights for policy 0, policy_version 1615487 (0.0006) [2023-12-28 06:52:13,283][106226] Updated weights for policy 0, policy_version 1615497 (0.0008) [2023-12-28 06:52:13,339][106226] Updated weights for policy 0, policy_version 1615507 (0.0009) [2023-12-28 06:52:13,905][106225] Updated weights for policy 1, policy_version 1619169 (0.0010) [2023-12-28 06:52:13,968][106225] Updated weights for policy 1, policy_version 1619179 (0.0010) [2023-12-28 06:52:14,018][106225] Updated weights for policy 1, policy_version 1619189 (0.0010) [2023-12-28 06:52:14,020][106226] Updated weights for policy 0, policy_version 1615517 (0.0006) [2023-12-28 06:52:14,077][106226] Updated weights for policy 0, policy_version 1615527 (0.0006) [2023-12-28 06:52:14,140][106226] Updated weights for policy 0, policy_version 1615537 (0.0006) [2023-12-28 06:52:14,701][106225] Updated weights for policy 1, policy_version 1619199 (0.0010) [2023-12-28 06:52:14,752][106225] Updated weights for policy 1, policy_version 1619209 (0.0010) [2023-12-28 06:52:14,762][106226] Updated weights for policy 0, policy_version 1615547 (0.0006) [2023-12-28 06:52:14,815][106225] Updated weights for policy 1, policy_version 1619219 (0.0007) [2023-12-28 06:52:14,830][106226] Updated weights for policy 0, policy_version 1615557 (0.0009) [2023-12-28 06:52:14,888][106226] Updated weights for policy 0, policy_version 1615567 (0.0011) [2023-12-28 06:52:15,542][106225] Updated weights for policy 1, policy_version 1619229 (0.0010) [2023-12-28 06:52:15,595][106225] Updated weights for policy 1, policy_version 1619239 (0.0010) [2023-12-28 06:52:15,626][106226] Updated weights for policy 0, policy_version 1615577 (0.0011) [2023-12-28 06:52:15,647][106225] Updated weights for policy 1, policy_version 1619249 (0.0010) [2023-12-28 06:52:15,683][106226] Updated weights for policy 0, policy_version 1615587 (0.0011) [2023-12-28 06:52:15,739][106226] Updated weights for policy 0, policy_version 1615597 (0.0010) [2023-12-28 06:52:15,795][106226] Updated weights for policy 0, policy_version 1615607 (0.0010) [2023-12-28 06:52:16,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 828252160. Throughput: 0: 10029.6, 1: 9889.8. Samples: 828242648. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:16,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-4.486')] [2023-12-28 06:52:16,355][106225] Updated weights for policy 1, policy_version 1619259 (0.0011) [2023-12-28 06:52:16,422][106225] Updated weights for policy 1, policy_version 1619269 (0.0007) [2023-12-28 06:52:16,482][106225] Updated weights for policy 1, policy_version 1619279 (0.0005) [2023-12-28 06:52:16,501][106226] Updated weights for policy 0, policy_version 1615617 (0.0008) [2023-12-28 06:52:16,561][106226] Updated weights for policy 0, policy_version 1615627 (0.0009) [2023-12-28 06:52:16,618][106226] Updated weights for policy 0, policy_version 1615637 (0.0008) [2023-12-28 06:52:17,124][106225] Updated weights for policy 1, policy_version 1619289 (0.0007) [2023-12-28 06:52:17,181][106225] Updated weights for policy 1, policy_version 1619299 (0.0010) [2023-12-28 06:52:17,246][106225] Updated weights for policy 1, policy_version 1619309 (0.0010) [2023-12-28 06:52:17,292][106225] Updated weights for policy 1, policy_version 1619319 (0.0010) [2023-12-28 06:52:17,342][106226] Updated weights for policy 0, policy_version 1615647 (0.0006) [2023-12-28 06:52:17,392][106226] Updated weights for policy 0, policy_version 1615657 (0.0005) [2023-12-28 06:52:17,443][106226] Updated weights for policy 0, policy_version 1615667 (0.0007) [2023-12-28 06:52:17,900][106225] Updated weights for policy 1, policy_version 1619329 (0.0006) [2023-12-28 06:52:17,953][106225] Updated weights for policy 1, policy_version 1619339 (0.0007) [2023-12-28 06:52:18,009][106225] Updated weights for policy 1, policy_version 1619349 (0.0010) [2023-12-28 06:52:18,084][106226] Updated weights for policy 0, policy_version 1615677 (0.0008) [2023-12-28 06:52:18,152][106226] Updated weights for policy 0, policy_version 1615687 (0.0011) [2023-12-28 06:52:18,218][106226] Updated weights for policy 0, policy_version 1615697 (0.0011) [2023-12-28 06:52:18,747][106225] Updated weights for policy 1, policy_version 1619359 (0.0010) [2023-12-28 06:52:18,812][106225] Updated weights for policy 1, policy_version 1619369 (0.0010) [2023-12-28 06:52:18,875][106225] Updated weights for policy 1, policy_version 1619379 (0.0010) [2023-12-28 06:52:18,922][106226] Updated weights for policy 0, policy_version 1615707 (0.0010) [2023-12-28 06:52:18,969][106226] Updated weights for policy 0, policy_version 1615717 (0.0007) [2023-12-28 06:52:19,026][106226] Updated weights for policy 0, policy_version 1615727 (0.0008) [2023-12-28 06:52:19,601][106225] Updated weights for policy 1, policy_version 1619389 (0.0010) [2023-12-28 06:52:19,663][106225] Updated weights for policy 1, policy_version 1619399 (0.0011) [2023-12-28 06:52:19,725][106225] Updated weights for policy 1, policy_version 1619409 (0.0010) [2023-12-28 06:52:19,802][106226] Updated weights for policy 0, policy_version 1615737 (0.0008) [2023-12-28 06:52:19,867][106226] Updated weights for policy 0, policy_version 1615747 (0.0008) [2023-12-28 06:52:19,931][106226] Updated weights for policy 0, policy_version 1615757 (0.0009) [2023-12-28 06:52:19,997][106226] Updated weights for policy 0, policy_version 1615767 (0.0007) [2023-12-28 06:52:20,450][106225] Updated weights for policy 1, policy_version 1619419 (0.0007) [2023-12-28 06:52:20,509][106225] Updated weights for policy 1, policy_version 1619429 (0.0010) [2023-12-28 06:52:20,563][106225] Updated weights for policy 1, policy_version 1619439 (0.0009) [2023-12-28 06:52:20,741][106226] Updated weights for policy 0, policy_version 1615777 (0.0009) [2023-12-28 06:52:20,795][106226] Updated weights for policy 0, policy_version 1615787 (0.0006) [2023-12-28 06:52:20,861][106226] Updated weights for policy 0, policy_version 1615797 (0.0006) [2023-12-28 06:52:21,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 828350464. Throughput: 0: 9966.0, 1: 9873.0. Samples: 828359608. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:21,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-4.364')] [2023-12-28 06:52:21,358][106225] Updated weights for policy 1, policy_version 1619449 (0.0009) [2023-12-28 06:52:21,431][106225] Updated weights for policy 1, policy_version 1619459 (0.0008) [2023-12-28 06:52:21,483][106225] Updated weights for policy 1, policy_version 1619469 (0.0008) [2023-12-28 06:52:21,545][106225] Updated weights for policy 1, policy_version 1619479 (0.0008) [2023-12-28 06:52:21,564][106226] Updated weights for policy 0, policy_version 1615807 (0.0006) [2023-12-28 06:52:21,635][106226] Updated weights for policy 0, policy_version 1615817 (0.0008) [2023-12-28 06:52:21,702][106226] Updated weights for policy 0, policy_version 1615827 (0.0010) [2023-12-28 06:52:22,343][106225] Updated weights for policy 1, policy_version 1619489 (0.0008) [2023-12-28 06:52:22,403][106226] Updated weights for policy 0, policy_version 1615837 (0.0009) [2023-12-28 06:52:22,415][106225] Updated weights for policy 1, policy_version 1619499 (0.0008) [2023-12-28 06:52:22,466][106226] Updated weights for policy 0, policy_version 1615847 (0.0008) [2023-12-28 06:52:22,478][106225] Updated weights for policy 1, policy_version 1619509 (0.0007) [2023-12-28 06:52:22,518][106226] Updated weights for policy 0, policy_version 1615857 (0.0008) [2023-12-28 06:52:23,196][106225] Updated weights for policy 1, policy_version 1619519 (0.0008) [2023-12-28 06:52:23,210][106226] Updated weights for policy 0, policy_version 1615867 (0.0008) [2023-12-28 06:52:23,254][106225] Updated weights for policy 1, policy_version 1619529 (0.0007) [2023-12-28 06:52:23,272][106226] Updated weights for policy 0, policy_version 1615877 (0.0006) [2023-12-28 06:52:23,305][106225] Updated weights for policy 1, policy_version 1619539 (0.0007) [2023-12-28 06:52:23,333][106226] Updated weights for policy 0, policy_version 1615887 (0.0009) [2023-12-28 06:52:23,985][106225] Updated weights for policy 1, policy_version 1619549 (0.0008) [2023-12-28 06:52:24,040][106225] Updated weights for policy 1, policy_version 1619559 (0.0005) [2023-12-28 06:52:24,075][106226] Updated weights for policy 0, policy_version 1615897 (0.0008) [2023-12-28 06:52:24,090][106225] Updated weights for policy 1, policy_version 1619569 (0.0005) [2023-12-28 06:52:24,124][106226] Updated weights for policy 0, policy_version 1615907 (0.0008) [2023-12-28 06:52:24,176][106226] Updated weights for policy 0, policy_version 1615917 (0.0008) [2023-12-28 06:52:24,228][106226] Updated weights for policy 0, policy_version 1615927 (0.0008) [2023-12-28 06:52:24,796][106225] Updated weights for policy 1, policy_version 1619579 (0.0007) [2023-12-28 06:52:24,851][106225] Updated weights for policy 1, policy_version 1619589 (0.0008) [2023-12-28 06:52:24,894][106225] Updated weights for policy 1, policy_version 1619599 (0.0008) [2023-12-28 06:52:24,930][106226] Updated weights for policy 0, policy_version 1615937 (0.0008) [2023-12-28 06:52:24,998][106226] Updated weights for policy 0, policy_version 1615947 (0.0008) [2023-12-28 06:52:25,061][106226] Updated weights for policy 0, policy_version 1615957 (0.0008) [2023-12-28 06:52:25,620][106225] Updated weights for policy 1, policy_version 1619609 (0.0006) [2023-12-28 06:52:25,685][106225] Updated weights for policy 1, policy_version 1619619 (0.0007) [2023-12-28 06:52:25,747][106225] Updated weights for policy 1, policy_version 1619629 (0.0005) [2023-12-28 06:52:25,783][106226] Updated weights for policy 0, policy_version 1615967 (0.0008) [2023-12-28 06:52:25,804][106225] Updated weights for policy 1, policy_version 1619639 (0.0005) [2023-12-28 06:52:25,838][106226] Updated weights for policy 0, policy_version 1615977 (0.0009) [2023-12-28 06:52:25,895][106226] Updated weights for policy 0, policy_version 1615987 (0.0008) [2023-12-28 06:52:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 828448768. Throughput: 0: 9944.1, 1: 9842.7. Samples: 828416664. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:26,176][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.665')] [2023-12-28 06:52:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001619640_414679040.pth... [2023-12-28 06:52:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001615992_413769728.pth... [2023-12-28 06:52:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001618488_414384128.pth [2023-12-28 06:52:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001614808_413466624.pth [2023-12-28 06:52:26,341][106225] Updated weights for policy 1, policy_version 1619649 (0.0005) [2023-12-28 06:52:26,394][106225] Updated weights for policy 1, policy_version 1619659 (0.0005) [2023-12-28 06:52:26,445][106225] Updated weights for policy 1, policy_version 1619669 (0.0005) [2023-12-28 06:52:26,632][106226] Updated weights for policy 0, policy_version 1615997 (0.0008) [2023-12-28 06:52:26,679][106226] Updated weights for policy 0, policy_version 1616007 (0.0008) [2023-12-28 06:52:26,728][106226] Updated weights for policy 0, policy_version 1616017 (0.0007) [2023-12-28 06:52:27,106][106225] Updated weights for policy 1, policy_version 1619679 (0.0009) [2023-12-28 06:52:27,152][106225] Updated weights for policy 1, policy_version 1619689 (0.0009) [2023-12-28 06:52:27,197][106225] Updated weights for policy 1, policy_version 1619699 (0.0005) [2023-12-28 06:52:27,503][106226] Updated weights for policy 0, policy_version 1616027 (0.0007) [2023-12-28 06:52:27,556][106226] Updated weights for policy 0, policy_version 1616037 (0.0008) [2023-12-28 06:52:27,614][106226] Updated weights for policy 0, policy_version 1616047 (0.0009) [2023-12-28 06:52:27,744][106225] Updated weights for policy 1, policy_version 1619709 (0.0006) [2023-12-28 06:52:27,797][106225] Updated weights for policy 1, policy_version 1619719 (0.0010) [2023-12-28 06:52:27,853][106225] Updated weights for policy 1, policy_version 1619729 (0.0010) [2023-12-28 06:52:28,199][106226] Updated weights for policy 0, policy_version 1616057 (0.0010) [2023-12-28 06:52:28,254][106226] Updated weights for policy 0, policy_version 1616067 (0.0005) [2023-12-28 06:52:28,309][106226] Updated weights for policy 0, policy_version 1616077 (0.0005) [2023-12-28 06:52:28,376][106226] Updated weights for policy 0, policy_version 1616087 (0.0008) [2023-12-28 06:52:28,582][106225] Updated weights for policy 1, policy_version 1619739 (0.0009) [2023-12-28 06:52:28,628][106225] Updated weights for policy 1, policy_version 1619749 (0.0007) [2023-12-28 06:52:28,683][106225] Updated weights for policy 1, policy_version 1619759 (0.0007) [2023-12-28 06:52:29,027][106226] Updated weights for policy 0, policy_version 1616097 (0.0010) [2023-12-28 06:52:29,080][106226] Updated weights for policy 0, policy_version 1616107 (0.0010) [2023-12-28 06:52:29,135][106226] Updated weights for policy 0, policy_version 1616117 (0.0010) [2023-12-28 06:52:29,387][106225] Updated weights for policy 1, policy_version 1619769 (0.0008) [2023-12-28 06:52:29,448][106225] Updated weights for policy 1, policy_version 1619779 (0.0006) [2023-12-28 06:52:29,505][106225] Updated weights for policy 1, policy_version 1619789 (0.0010) [2023-12-28 06:52:29,565][106225] Updated weights for policy 1, policy_version 1619799 (0.0011) [2023-12-28 06:52:29,839][106226] Updated weights for policy 0, policy_version 1616127 (0.0008) [2023-12-28 06:52:29,892][106226] Updated weights for policy 0, policy_version 1616137 (0.0006) [2023-12-28 06:52:29,958][106226] Updated weights for policy 0, policy_version 1616147 (0.0007) [2023-12-28 06:52:30,314][106225] Updated weights for policy 1, policy_version 1619809 (0.0006) [2023-12-28 06:52:30,378][106225] Updated weights for policy 1, policy_version 1619819 (0.0008) [2023-12-28 06:52:30,441][106225] Updated weights for policy 1, policy_version 1619829 (0.0007) [2023-12-28 06:52:30,657][106226] Updated weights for policy 0, policy_version 1616157 (0.0007) [2023-12-28 06:52:30,707][106226] Updated weights for policy 0, policy_version 1616167 (0.0008) [2023-12-28 06:52:30,753][106226] Updated weights for policy 0, policy_version 1616177 (0.0008) [2023-12-28 06:52:31,133][106225] Updated weights for policy 1, policy_version 1619839 (0.0008) [2023-12-28 06:52:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 828547072. Throughput: 0: 9990.7, 1: 9919.8. Samples: 828539620. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:31,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.743')] [2023-12-28 06:52:31,201][106225] Updated weights for policy 1, policy_version 1619849 (0.0007) [2023-12-28 06:52:31,263][106225] Updated weights for policy 1, policy_version 1619859 (0.0007) [2023-12-28 06:52:31,484][106226] Updated weights for policy 0, policy_version 1616187 (0.0008) [2023-12-28 06:52:31,550][106226] Updated weights for policy 0, policy_version 1616197 (0.0007) [2023-12-28 06:52:31,603][106226] Updated weights for policy 0, policy_version 1616207 (0.0007) [2023-12-28 06:52:31,956][106225] Updated weights for policy 1, policy_version 1619869 (0.0009) [2023-12-28 06:52:32,010][106225] Updated weights for policy 1, policy_version 1619880 (0.0009) [2023-12-28 06:52:32,059][106225] Updated weights for policy 1, policy_version 1619890 (0.0008) [2023-12-28 06:52:32,319][106226] Updated weights for policy 0, policy_version 1616217 (0.0009) [2023-12-28 06:52:32,391][106226] Updated weights for policy 0, policy_version 1616227 (0.0009) [2023-12-28 06:52:32,446][106226] Updated weights for policy 0, policy_version 1616237 (0.0009) [2023-12-28 06:52:32,498][106226] Updated weights for policy 0, policy_version 1616247 (0.0008) [2023-12-28 06:52:32,806][106225] Updated weights for policy 1, policy_version 1619900 (0.0007) [2023-12-28 06:52:32,862][106225] Updated weights for policy 1, policy_version 1619910 (0.0005) [2023-12-28 06:52:32,924][106225] Updated weights for policy 1, policy_version 1619920 (0.0007) [2023-12-28 06:52:33,182][106226] Updated weights for policy 0, policy_version 1616257 (0.0008) [2023-12-28 06:52:33,239][106226] Updated weights for policy 0, policy_version 1616267 (0.0007) [2023-12-28 06:52:33,304][106226] Updated weights for policy 0, policy_version 1616277 (0.0007) [2023-12-28 06:52:33,543][106225] Updated weights for policy 1, policy_version 1619930 (0.0007) [2023-12-28 06:52:33,603][106225] Updated weights for policy 1, policy_version 1619940 (0.0010) [2023-12-28 06:52:33,649][106225] Updated weights for policy 1, policy_version 1619950 (0.0010) [2023-12-28 06:52:33,694][106225] Updated weights for policy 1, policy_version 1619960 (0.0010) [2023-12-28 06:52:33,922][106226] Updated weights for policy 0, policy_version 1616287 (0.0009) [2023-12-28 06:52:33,974][106226] Updated weights for policy 0, policy_version 1616297 (0.0009) [2023-12-28 06:52:34,030][106226] Updated weights for policy 0, policy_version 1616307 (0.0005) [2023-12-28 06:52:34,408][106225] Updated weights for policy 1, policy_version 1619970 (0.0006) [2023-12-28 06:52:34,476][106225] Updated weights for policy 1, policy_version 1619980 (0.0006) [2023-12-28 06:52:34,541][106225] Updated weights for policy 1, policy_version 1619990 (0.0008) [2023-12-28 06:52:34,671][106226] Updated weights for policy 0, policy_version 1616317 (0.0006) [2023-12-28 06:52:34,725][106226] Updated weights for policy 0, policy_version 1616327 (0.0011) [2023-12-28 06:52:34,782][106226] Updated weights for policy 0, policy_version 1616337 (0.0010) [2023-12-28 06:52:35,065][106225] Updated weights for policy 1, policy_version 1620000 (0.0009) [2023-12-28 06:52:35,111][106225] Updated weights for policy 1, policy_version 1620010 (0.0010) [2023-12-28 06:52:35,162][106225] Updated weights for policy 1, policy_version 1620020 (0.0005) [2023-12-28 06:52:35,401][106226] Updated weights for policy 0, policy_version 1616347 (0.0009) [2023-12-28 06:52:35,454][106226] Updated weights for policy 0, policy_version 1616357 (0.0010) [2023-12-28 06:52:35,517][106226] Updated weights for policy 0, policy_version 1616367 (0.0010) [2023-12-28 06:52:35,770][106225] Updated weights for policy 1, policy_version 1620030 (0.0008) [2023-12-28 06:52:35,824][106225] Updated weights for policy 1, policy_version 1620040 (0.0010) [2023-12-28 06:52:35,873][106225] Updated weights for policy 1, policy_version 1620050 (0.0008) [2023-12-28 06:52:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 828653568. Throughput: 0: 10039.6, 1: 9987.3. Samples: 828663516. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:36,175][105115] Avg episode reward: [(0, '-4.224'), (1, '-4.477')] [2023-12-28 06:52:36,234][106226] Updated weights for policy 0, policy_version 1616377 (0.0010) [2023-12-28 06:52:36,289][106226] Updated weights for policy 0, policy_version 1616387 (0.0008) [2023-12-28 06:52:36,351][106226] Updated weights for policy 0, policy_version 1616397 (0.0011) [2023-12-28 06:52:36,410][106226] Updated weights for policy 0, policy_version 1616407 (0.0011) [2023-12-28 06:52:36,569][106225] Updated weights for policy 1, policy_version 1620060 (0.0008) [2023-12-28 06:52:36,630][106225] Updated weights for policy 1, policy_version 1620070 (0.0010) [2023-12-28 06:52:36,680][106225] Updated weights for policy 1, policy_version 1620080 (0.0010) [2023-12-28 06:52:37,144][106226] Updated weights for policy 0, policy_version 1616417 (0.0011) [2023-12-28 06:52:37,201][106226] Updated weights for policy 0, policy_version 1616427 (0.0011) [2023-12-28 06:52:37,262][106226] Updated weights for policy 0, policy_version 1616437 (0.0011) [2023-12-28 06:52:37,414][106225] Updated weights for policy 1, policy_version 1620090 (0.0010) [2023-12-28 06:52:37,475][106225] Updated weights for policy 1, policy_version 1620100 (0.0011) [2023-12-28 06:52:37,531][106225] Updated weights for policy 1, policy_version 1620110 (0.0010) [2023-12-28 06:52:37,588][106225] Updated weights for policy 1, policy_version 1620120 (0.0010) [2023-12-28 06:52:37,949][106226] Updated weights for policy 0, policy_version 1616447 (0.0010) [2023-12-28 06:52:38,000][106226] Updated weights for policy 0, policy_version 1616457 (0.0010) [2023-12-28 06:52:38,050][106226] Updated weights for policy 0, policy_version 1616467 (0.0010) [2023-12-28 06:52:38,261][106225] Updated weights for policy 1, policy_version 1620130 (0.0010) [2023-12-28 06:52:38,314][106225] Updated weights for policy 1, policy_version 1620140 (0.0010) [2023-12-28 06:52:38,374][106225] Updated weights for policy 1, policy_version 1620150 (0.0010) [2023-12-28 06:52:38,819][106226] Updated weights for policy 0, policy_version 1616477 (0.0008) [2023-12-28 06:52:38,889][106226] Updated weights for policy 0, policy_version 1616487 (0.0007) [2023-12-28 06:52:38,943][106226] Updated weights for policy 0, policy_version 1616497 (0.0008) [2023-12-28 06:52:38,959][106225] Updated weights for policy 1, policy_version 1620160 (0.0009) [2023-12-28 06:52:39,015][106225] Updated weights for policy 1, policy_version 1620170 (0.0007) [2023-12-28 06:52:39,059][106225] Updated weights for policy 1, policy_version 1620180 (0.0008) [2023-12-28 06:52:39,695][106226] Updated weights for policy 0, policy_version 1616507 (0.0009) [2023-12-28 06:52:39,761][106226] Updated weights for policy 0, policy_version 1616517 (0.0008) [2023-12-28 06:52:39,835][106226] Updated weights for policy 0, policy_version 1616527 (0.0009) [2023-12-28 06:52:39,895][106225] Updated weights for policy 1, policy_version 1620190 (0.0007) [2023-12-28 06:52:39,966][106225] Updated weights for policy 1, policy_version 1620200 (0.0008) [2023-12-28 06:52:40,029][106225] Updated weights for policy 1, policy_version 1620210 (0.0009) [2023-12-28 06:52:40,577][106226] Updated weights for policy 0, policy_version 1616537 (0.0008) [2023-12-28 06:52:40,627][106226] Updated weights for policy 0, policy_version 1616547 (0.0005) [2023-12-28 06:52:40,690][106226] Updated weights for policy 0, policy_version 1616557 (0.0006) [2023-12-28 06:52:40,749][106225] Updated weights for policy 1, policy_version 1620220 (0.0009) [2023-12-28 06:52:40,758][106226] Updated weights for policy 0, policy_version 1616567 (0.0009) [2023-12-28 06:52:40,803][106225] Updated weights for policy 1, policy_version 1620230 (0.0010) [2023-12-28 06:52:40,862][106225] Updated weights for policy 1, policy_version 1620240 (0.0010) [2023-12-28 06:52:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 828751872. Throughput: 0: 10034.1, 1: 10010.7. Samples: 828722688. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:41,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.509')] [2023-12-28 06:52:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001620248_414834688.pth... [2023-12-28 06:52:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001616568_413917184.pth... [2023-12-28 06:52:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001615416_413622272.pth [2023-12-28 06:52:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001619064_414531584.pth [2023-12-28 06:52:41,471][106226] Updated weights for policy 0, policy_version 1616577 (0.0008) [2023-12-28 06:52:41,534][106226] Updated weights for policy 0, policy_version 1616587 (0.0008) [2023-12-28 06:52:41,596][106226] Updated weights for policy 0, policy_version 1616597 (0.0008) [2023-12-28 06:52:41,598][106225] Updated weights for policy 1, policy_version 1620250 (0.0007) [2023-12-28 06:52:41,667][106225] Updated weights for policy 1, policy_version 1620260 (0.0009) [2023-12-28 06:52:41,739][106225] Updated weights for policy 1, policy_version 1620270 (0.0009) [2023-12-28 06:52:41,803][106225] Updated weights for policy 1, policy_version 1620280 (0.0008) [2023-12-28 06:52:42,314][106226] Updated weights for policy 0, policy_version 1616607 (0.0008) [2023-12-28 06:52:42,384][106226] Updated weights for policy 0, policy_version 1616617 (0.0009) [2023-12-28 06:52:42,446][106226] Updated weights for policy 0, policy_version 1616627 (0.0008) [2023-12-28 06:52:42,600][106225] Updated weights for policy 1, policy_version 1620290 (0.0009) [2023-12-28 06:52:42,657][106225] Updated weights for policy 1, policy_version 1620300 (0.0009) [2023-12-28 06:52:42,716][106225] Updated weights for policy 1, policy_version 1620310 (0.0009) [2023-12-28 06:52:43,177][106226] Updated weights for policy 0, policy_version 1616637 (0.0009) [2023-12-28 06:52:43,238][106226] Updated weights for policy 0, policy_version 1616647 (0.0009) [2023-12-28 06:52:43,293][106226] Updated weights for policy 0, policy_version 1616657 (0.0009) [2023-12-28 06:52:43,410][106225] Updated weights for policy 1, policy_version 1620320 (0.0010) [2023-12-28 06:52:43,461][106225] Updated weights for policy 1, policy_version 1620331 (0.0009) [2023-12-28 06:52:43,506][106225] Updated weights for policy 1, policy_version 1620341 (0.0008) [2023-12-28 06:52:43,975][106226] Updated weights for policy 0, policy_version 1616667 (0.0009) [2023-12-28 06:52:44,039][106226] Updated weights for policy 0, policy_version 1616677 (0.0009) [2023-12-28 06:52:44,096][106226] Updated weights for policy 0, policy_version 1616687 (0.0009) [2023-12-28 06:52:44,273][106225] Updated weights for policy 1, policy_version 1620351 (0.0008) [2023-12-28 06:52:44,330][106225] Updated weights for policy 1, policy_version 1620361 (0.0006) [2023-12-28 06:52:44,389][106225] Updated weights for policy 1, policy_version 1620371 (0.0008) [2023-12-28 06:52:44,826][106226] Updated weights for policy 0, policy_version 1616697 (0.0009) [2023-12-28 06:52:44,891][106226] Updated weights for policy 0, policy_version 1616707 (0.0008) [2023-12-28 06:52:44,955][106226] Updated weights for policy 0, policy_version 1616717 (0.0008) [2023-12-28 06:52:45,015][106226] Updated weights for policy 0, policy_version 1616727 (0.0009) [2023-12-28 06:52:45,101][106225] Updated weights for policy 1, policy_version 1620381 (0.0009) [2023-12-28 06:52:45,162][106225] Updated weights for policy 1, policy_version 1620391 (0.0009) [2023-12-28 06:52:45,212][106225] Updated weights for policy 1, policy_version 1620401 (0.0008) [2023-12-28 06:52:45,762][106226] Updated weights for policy 0, policy_version 1616737 (0.0009) [2023-12-28 06:52:45,827][106226] Updated weights for policy 0, policy_version 1616747 (0.0009) [2023-12-28 06:52:45,889][106226] Updated weights for policy 0, policy_version 1616757 (0.0009) [2023-12-28 06:52:45,964][106225] Updated weights for policy 1, policy_version 1620411 (0.0008) [2023-12-28 06:52:46,020][106225] Updated weights for policy 1, policy_version 1620421 (0.0007) [2023-12-28 06:52:46,078][106225] Updated weights for policy 1, policy_version 1620431 (0.0005) [2023-12-28 06:52:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 828850176. Throughput: 0: 9916.0, 1: 9957.8. Samples: 828835700. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:46,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.827')] [2023-12-28 06:52:46,654][106226] Updated weights for policy 0, policy_version 1616767 (0.0008) [2023-12-28 06:52:46,698][106225] Updated weights for policy 1, policy_version 1620441 (0.0006) [2023-12-28 06:52:46,722][106226] Updated weights for policy 0, policy_version 1616777 (0.0007) [2023-12-28 06:52:46,757][106225] Updated weights for policy 1, policy_version 1620451 (0.0007) [2023-12-28 06:52:46,778][106226] Updated weights for policy 0, policy_version 1616787 (0.0007) [2023-12-28 06:52:46,815][106225] Updated weights for policy 1, policy_version 1620461 (0.0007) [2023-12-28 06:52:46,872][106225] Updated weights for policy 1, policy_version 1620471 (0.0008) [2023-12-28 06:52:47,450][106226] Updated weights for policy 0, policy_version 1616797 (0.0006) [2023-12-28 06:52:47,511][106226] Updated weights for policy 0, policy_version 1616807 (0.0007) [2023-12-28 06:52:47,512][106225] Updated weights for policy 1, policy_version 1620481 (0.0006) [2023-12-28 06:52:47,569][106226] Updated weights for policy 0, policy_version 1616817 (0.0006) [2023-12-28 06:52:47,570][106225] Updated weights for policy 1, policy_version 1620491 (0.0007) [2023-12-28 06:52:47,625][106225] Updated weights for policy 1, policy_version 1620501 (0.0009) [2023-12-28 06:52:48,169][106226] Updated weights for policy 0, policy_version 1616827 (0.0006) [2023-12-28 06:52:48,233][106226] Updated weights for policy 0, policy_version 1616837 (0.0009) [2023-12-28 06:52:48,296][106226] Updated weights for policy 0, policy_version 1616847 (0.0008) [2023-12-28 06:52:48,408][106225] Updated weights for policy 1, policy_version 1620511 (0.0009) [2023-12-28 06:52:48,472][106225] Updated weights for policy 1, policy_version 1620521 (0.0005) [2023-12-28 06:52:48,536][106225] Updated weights for policy 1, policy_version 1620531 (0.0005) [2023-12-28 06:52:49,047][106226] Updated weights for policy 0, policy_version 1616857 (0.0008) [2023-12-28 06:52:49,107][106226] Updated weights for policy 0, policy_version 1616867 (0.0009) [2023-12-28 06:52:49,159][106225] Updated weights for policy 1, policy_version 1620541 (0.0006) [2023-12-28 06:52:49,162][106226] Updated weights for policy 0, policy_version 1616877 (0.0008) [2023-12-28 06:52:49,216][106225] Updated weights for policy 1, policy_version 1620551 (0.0006) [2023-12-28 06:52:49,226][106226] Updated weights for policy 0, policy_version 1616887 (0.0007) [2023-12-28 06:52:49,283][106225] Updated weights for policy 1, policy_version 1620561 (0.0008) [2023-12-28 06:52:49,962][106226] Updated weights for policy 0, policy_version 1616897 (0.0007) [2023-12-28 06:52:50,023][106226] Updated weights for policy 0, policy_version 1616907 (0.0009) [2023-12-28 06:52:50,058][106225] Updated weights for policy 1, policy_version 1620571 (0.0006) [2023-12-28 06:52:50,076][106226] Updated weights for policy 0, policy_version 1616917 (0.0007) [2023-12-28 06:52:50,112][106225] Updated weights for policy 1, policy_version 1620581 (0.0007) [2023-12-28 06:52:50,164][106225] Updated weights for policy 1, policy_version 1620591 (0.0008) [2023-12-28 06:52:50,806][106226] Updated weights for policy 0, policy_version 1616927 (0.0007) [2023-12-28 06:52:50,867][106226] Updated weights for policy 0, policy_version 1616937 (0.0008) [2023-12-28 06:52:50,886][106225] Updated weights for policy 1, policy_version 1620601 (0.0009) [2023-12-28 06:52:50,928][106226] Updated weights for policy 0, policy_version 1616947 (0.0008) [2023-12-28 06:52:50,943][106225] Updated weights for policy 1, policy_version 1620611 (0.0006) [2023-12-28 06:52:51,001][106225] Updated weights for policy 1, policy_version 1620621 (0.0008) [2023-12-28 06:52:51,067][106225] Updated weights for policy 1, policy_version 1620631 (0.0008) [2023-12-28 06:52:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 828948480. Throughput: 0: 9840.3, 1: 9947.4. Samples: 828953324. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:51,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-4.863')] [2023-12-28 06:52:51,619][106226] Updated weights for policy 0, policy_version 1616957 (0.0008) [2023-12-28 06:52:51,688][106226] Updated weights for policy 0, policy_version 1616967 (0.0007) [2023-12-28 06:52:51,760][106226] Updated weights for policy 0, policy_version 1616977 (0.0009) [2023-12-28 06:52:51,844][106225] Updated weights for policy 1, policy_version 1620641 (0.0009) [2023-12-28 06:52:51,895][106225] Updated weights for policy 1, policy_version 1620651 (0.0008) [2023-12-28 06:52:51,959][106225] Updated weights for policy 1, policy_version 1620661 (0.0008) [2023-12-28 06:52:52,509][106226] Updated weights for policy 0, policy_version 1616987 (0.0009) [2023-12-28 06:52:52,572][106226] Updated weights for policy 0, policy_version 1616997 (0.0008) [2023-12-28 06:52:52,638][106226] Updated weights for policy 0, policy_version 1617007 (0.0008) [2023-12-28 06:52:52,738][106225] Updated weights for policy 1, policy_version 1620671 (0.0009) [2023-12-28 06:52:52,796][106225] Updated weights for policy 1, policy_version 1620681 (0.0010) [2023-12-28 06:52:52,854][106225] Updated weights for policy 1, policy_version 1620691 (0.0010) [2023-12-28 06:52:53,332][106226] Updated weights for policy 0, policy_version 1617017 (0.0007) [2023-12-28 06:52:53,397][106226] Updated weights for policy 0, policy_version 1617027 (0.0005) [2023-12-28 06:52:53,457][106226] Updated weights for policy 0, policy_version 1617037 (0.0005) [2023-12-28 06:52:53,487][106225] Updated weights for policy 1, policy_version 1620701 (0.0010) [2023-12-28 06:52:53,517][106226] Updated weights for policy 0, policy_version 1617047 (0.0007) [2023-12-28 06:52:53,545][106225] Updated weights for policy 1, policy_version 1620711 (0.0010) [2023-12-28 06:52:53,607][106225] Updated weights for policy 1, policy_version 1620721 (0.0010) [2023-12-28 06:52:54,168][106226] Updated weights for policy 0, policy_version 1617057 (0.0008) [2023-12-28 06:52:54,226][106226] Updated weights for policy 0, policy_version 1617067 (0.0008) [2023-12-28 06:52:54,260][106225] Updated weights for policy 1, policy_version 1620731 (0.0010) [2023-12-28 06:52:54,288][106226] Updated weights for policy 0, policy_version 1617077 (0.0008) [2023-12-28 06:52:54,303][106225] Updated weights for policy 1, policy_version 1620741 (0.0010) [2023-12-28 06:52:54,361][106225] Updated weights for policy 1, policy_version 1620751 (0.0010) [2023-12-28 06:52:55,047][106226] Updated weights for policy 0, policy_version 1617087 (0.0008) [2023-12-28 06:52:55,052][106225] Updated weights for policy 1, policy_version 1620761 (0.0010) [2023-12-28 06:52:55,107][106226] Updated weights for policy 0, policy_version 1617097 (0.0007) [2023-12-28 06:52:55,115][106225] Updated weights for policy 1, policy_version 1620771 (0.0010) [2023-12-28 06:52:55,164][106226] Updated weights for policy 0, policy_version 1617107 (0.0006) [2023-12-28 06:52:55,165][106225] Updated weights for policy 1, policy_version 1620781 (0.0010) [2023-12-28 06:52:55,212][106225] Updated weights for policy 1, policy_version 1620791 (0.0010) [2023-12-28 06:52:55,784][106226] Updated weights for policy 0, policy_version 1617117 (0.0006) [2023-12-28 06:52:55,834][106226] Updated weights for policy 0, policy_version 1617127 (0.0008) [2023-12-28 06:52:55,887][106226] Updated weights for policy 0, policy_version 1617137 (0.0008) [2023-12-28 06:52:55,942][106225] Updated weights for policy 1, policy_version 1620801 (0.0010) [2023-12-28 06:52:55,988][106225] Updated weights for policy 1, policy_version 1620811 (0.0010) [2023-12-28 06:52:56,034][106225] Updated weights for policy 1, policy_version 1620821 (0.0010) [2023-12-28 06:52:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 829046784. Throughput: 0: 9784.8, 1: 9912.3. Samples: 829011204. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:52:56,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.783')] [2023-12-28 06:52:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001617144_414064640.pth... [2023-12-28 06:52:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001620824_414982144.pth... [2023-12-28 06:52:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001619640_414679040.pth [2023-12-28 06:52:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001615992_413769728.pth [2023-12-28 06:52:56,637][106225] Updated weights for policy 1, policy_version 1620831 (0.0007) [2023-12-28 06:52:56,690][106225] Updated weights for policy 1, policy_version 1620841 (0.0005) [2023-12-28 06:52:56,693][106226] Updated weights for policy 0, policy_version 1617147 (0.0008) [2023-12-28 06:52:56,744][106225] Updated weights for policy 1, policy_version 1620851 (0.0006) [2023-12-28 06:52:56,749][106226] Updated weights for policy 0, policy_version 1617157 (0.0007) [2023-12-28 06:52:56,812][106226] Updated weights for policy 0, policy_version 1617167 (0.0007) [2023-12-28 06:52:57,315][106225] Updated weights for policy 1, policy_version 1620861 (0.0007) [2023-12-28 06:52:57,366][106225] Updated weights for policy 1, policy_version 1620871 (0.0008) [2023-12-28 06:52:57,418][106225] Updated weights for policy 1, policy_version 1620881 (0.0008) [2023-12-28 06:52:57,572][106226] Updated weights for policy 0, policy_version 1617177 (0.0009) [2023-12-28 06:52:57,624][106226] Updated weights for policy 0, policy_version 1617187 (0.0009) [2023-12-28 06:52:57,679][106226] Updated weights for policy 0, policy_version 1617197 (0.0009) [2023-12-28 06:52:57,747][106226] Updated weights for policy 0, policy_version 1617207 (0.0009) [2023-12-28 06:52:58,056][106225] Updated weights for policy 1, policy_version 1620891 (0.0007) [2023-12-28 06:52:58,115][106225] Updated weights for policy 1, policy_version 1620901 (0.0005) [2023-12-28 06:52:58,161][106225] Updated weights for policy 1, policy_version 1620911 (0.0005) [2023-12-28 06:52:58,520][106226] Updated weights for policy 0, policy_version 1617217 (0.0010) [2023-12-28 06:52:58,586][106226] Updated weights for policy 0, policy_version 1617227 (0.0012) [2023-12-28 06:52:58,655][106226] Updated weights for policy 0, policy_version 1617237 (0.0010) [2023-12-28 06:52:58,919][106225] Updated weights for policy 1, policy_version 1620921 (0.0009) [2023-12-28 06:52:58,981][106225] Updated weights for policy 1, policy_version 1620931 (0.0009) [2023-12-28 06:52:59,041][106225] Updated weights for policy 1, policy_version 1620941 (0.0009) [2023-12-28 06:52:59,101][106225] Updated weights for policy 1, policy_version 1620951 (0.0009) [2023-12-28 06:52:59,471][106226] Updated weights for policy 0, policy_version 1617247 (0.0010) [2023-12-28 06:52:59,528][106226] Updated weights for policy 0, policy_version 1617257 (0.0009) [2023-12-28 06:52:59,578][106226] Updated weights for policy 0, policy_version 1617267 (0.0008) [2023-12-28 06:52:59,870][106225] Updated weights for policy 1, policy_version 1620961 (0.0009) [2023-12-28 06:52:59,927][106225] Updated weights for policy 1, policy_version 1620971 (0.0009) [2023-12-28 06:52:59,993][106225] Updated weights for policy 1, policy_version 1620981 (0.0009) [2023-12-28 06:53:00,285][106226] Updated weights for policy 0, policy_version 1617277 (0.0008) [2023-12-28 06:53:00,338][106226] Updated weights for policy 0, policy_version 1617287 (0.0008) [2023-12-28 06:53:00,394][106226] Updated weights for policy 0, policy_version 1617297 (0.0008) [2023-12-28 06:53:00,707][106225] Updated weights for policy 1, policy_version 1620991 (0.0006) [2023-12-28 06:53:00,769][106225] Updated weights for policy 1, policy_version 1621001 (0.0010) [2023-12-28 06:53:00,834][106225] Updated weights for policy 1, policy_version 1621011 (0.0009) [2023-12-28 06:53:00,992][106226] Updated weights for policy 0, policy_version 1617307 (0.0006) [2023-12-28 06:53:01,065][106226] Updated weights for policy 0, policy_version 1617317 (0.0007) [2023-12-28 06:53:01,127][106226] Updated weights for policy 0, policy_version 1617327 (0.0007) [2023-12-28 06:53:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 829136896. Throughput: 0: 9715.8, 1: 9981.5. Samples: 829129028. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:01,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-4.861')] [2023-12-28 06:53:01,544][106225] Updated weights for policy 1, policy_version 1621021 (0.0008) [2023-12-28 06:53:01,603][106225] Updated weights for policy 1, policy_version 1621031 (0.0007) [2023-12-28 06:53:01,666][106225] Updated weights for policy 1, policy_version 1621041 (0.0009) [2023-12-28 06:53:01,860][106226] Updated weights for policy 0, policy_version 1617337 (0.0008) [2023-12-28 06:53:01,925][106226] Updated weights for policy 0, policy_version 1617347 (0.0005) [2023-12-28 06:53:01,990][106226] Updated weights for policy 0, policy_version 1617357 (0.0005) [2023-12-28 06:53:02,050][106226] Updated weights for policy 0, policy_version 1617367 (0.0007) [2023-12-28 06:53:02,414][106225] Updated weights for policy 1, policy_version 1621051 (0.0007) [2023-12-28 06:53:02,474][106225] Updated weights for policy 1, policy_version 1621061 (0.0010) [2023-12-28 06:53:02,531][106225] Updated weights for policy 1, policy_version 1621071 (0.0005) [2023-12-28 06:53:02,747][106226] Updated weights for policy 0, policy_version 1617377 (0.0006) [2023-12-28 06:53:02,810][106226] Updated weights for policy 0, policy_version 1617387 (0.0006) [2023-12-28 06:53:02,867][106226] Updated weights for policy 0, policy_version 1617397 (0.0009) [2023-12-28 06:53:03,086][106225] Updated weights for policy 1, policy_version 1621081 (0.0005) [2023-12-28 06:53:03,139][106225] Updated weights for policy 1, policy_version 1621091 (0.0005) [2023-12-28 06:53:03,205][106225] Updated weights for policy 1, policy_version 1621101 (0.0009) [2023-12-28 06:53:03,270][106225] Updated weights for policy 1, policy_version 1621111 (0.0011) [2023-12-28 06:53:03,487][106226] Updated weights for policy 0, policy_version 1617407 (0.0007) [2023-12-28 06:53:03,539][106226] Updated weights for policy 0, policy_version 1617417 (0.0009) [2023-12-28 06:53:03,588][106226] Updated weights for policy 0, policy_version 1617427 (0.0009) [2023-12-28 06:53:03,956][106225] Updated weights for policy 1, policy_version 1621121 (0.0009) [2023-12-28 06:53:04,005][106225] Updated weights for policy 1, policy_version 1621131 (0.0009) [2023-12-28 06:53:04,055][106225] Updated weights for policy 1, policy_version 1621141 (0.0008) [2023-12-28 06:53:04,277][106226] Updated weights for policy 0, policy_version 1617437 (0.0007) [2023-12-28 06:53:04,338][106226] Updated weights for policy 0, policy_version 1617447 (0.0007) [2023-12-28 06:53:04,402][106226] Updated weights for policy 0, policy_version 1617457 (0.0007) [2023-12-28 06:53:04,806][106225] Updated weights for policy 1, policy_version 1621151 (0.0007) [2023-12-28 06:53:04,867][106225] Updated weights for policy 1, policy_version 1621161 (0.0008) [2023-12-28 06:53:04,921][106225] Updated weights for policy 1, policy_version 1621171 (0.0010) [2023-12-28 06:53:04,986][106226] Updated weights for policy 0, policy_version 1617467 (0.0005) [2023-12-28 06:53:05,045][106226] Updated weights for policy 0, policy_version 1617477 (0.0007) [2023-12-28 06:53:05,102][106226] Updated weights for policy 0, policy_version 1617487 (0.0010) [2023-12-28 06:53:05,579][106225] Updated weights for policy 1, policy_version 1621181 (0.0010) [2023-12-28 06:53:05,622][106225] Updated weights for policy 1, policy_version 1621191 (0.0010) [2023-12-28 06:53:05,675][106225] Updated weights for policy 1, policy_version 1621201 (0.0010) [2023-12-28 06:53:05,727][106226] Updated weights for policy 0, policy_version 1617497 (0.0010) [2023-12-28 06:53:05,783][106226] Updated weights for policy 0, policy_version 1617507 (0.0010) [2023-12-28 06:53:05,829][106226] Updated weights for policy 0, policy_version 1617517 (0.0010) [2023-12-28 06:53:05,882][106226] Updated weights for policy 0, policy_version 1617527 (0.0010) [2023-12-28 06:53:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 829243392. Throughput: 0: 9824.5, 1: 10001.9. Samples: 829251796. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:06,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.666')] [2023-12-28 06:53:06,349][106225] Updated weights for policy 1, policy_version 1621211 (0.0010) [2023-12-28 06:53:06,408][106225] Updated weights for policy 1, policy_version 1621221 (0.0010) [2023-12-28 06:53:06,466][106225] Updated weights for policy 1, policy_version 1621231 (0.0010) [2023-12-28 06:53:06,598][106226] Updated weights for policy 0, policy_version 1617537 (0.0010) [2023-12-28 06:53:06,661][106226] Updated weights for policy 0, policy_version 1617547 (0.0011) [2023-12-28 06:53:06,718][106226] Updated weights for policy 0, policy_version 1617557 (0.0011) [2023-12-28 06:53:07,102][106225] Updated weights for policy 1, policy_version 1621241 (0.0011) [2023-12-28 06:53:07,149][106225] Updated weights for policy 1, policy_version 1621251 (0.0010) [2023-12-28 06:53:07,196][106225] Updated weights for policy 1, policy_version 1621261 (0.0010) [2023-12-28 06:53:07,248][106225] Updated weights for policy 1, policy_version 1621271 (0.0009) [2023-12-28 06:53:07,386][106226] Updated weights for policy 0, policy_version 1617567 (0.0010) [2023-12-28 06:53:07,444][106226] Updated weights for policy 0, policy_version 1617577 (0.0010) [2023-12-28 06:53:07,491][106226] Updated weights for policy 0, policy_version 1617587 (0.0010) [2023-12-28 06:53:07,883][106225] Updated weights for policy 1, policy_version 1621281 (0.0005) [2023-12-28 06:53:07,927][106225] Updated weights for policy 1, policy_version 1621291 (0.0007) [2023-12-28 06:53:07,978][106225] Updated weights for policy 1, policy_version 1621301 (0.0008) [2023-12-28 06:53:08,165][106226] Updated weights for policy 0, policy_version 1617597 (0.0010) [2023-12-28 06:53:08,214][106226] Updated weights for policy 0, policy_version 1617607 (0.0010) [2023-12-28 06:53:08,264][106226] Updated weights for policy 0, policy_version 1617617 (0.0010) [2023-12-28 06:53:08,716][106225] Updated weights for policy 1, policy_version 1621311 (0.0008) [2023-12-28 06:53:08,774][106225] Updated weights for policy 1, policy_version 1621321 (0.0008) [2023-12-28 06:53:08,828][106225] Updated weights for policy 1, policy_version 1621331 (0.0007) [2023-12-28 06:53:09,017][106226] Updated weights for policy 0, policy_version 1617627 (0.0010) [2023-12-28 06:53:09,067][106226] Updated weights for policy 0, policy_version 1617637 (0.0010) [2023-12-28 06:53:09,124][106226] Updated weights for policy 0, policy_version 1617647 (0.0011) [2023-12-28 06:53:09,579][106225] Updated weights for policy 1, policy_version 1621341 (0.0008) [2023-12-28 06:53:09,648][106225] Updated weights for policy 1, policy_version 1621351 (0.0010) [2023-12-28 06:53:09,711][106225] Updated weights for policy 1, policy_version 1621361 (0.0010) [2023-12-28 06:53:09,872][106226] Updated weights for policy 0, policy_version 1617657 (0.0011) [2023-12-28 06:53:09,942][106226] Updated weights for policy 0, policy_version 1617667 (0.0011) [2023-12-28 06:53:10,005][106226] Updated weights for policy 0, policy_version 1617677 (0.0011) [2023-12-28 06:53:10,054][106226] Updated weights for policy 0, policy_version 1617687 (0.0011) [2023-12-28 06:53:10,347][106225] Updated weights for policy 1, policy_version 1621371 (0.0006) [2023-12-28 06:53:10,419][106225] Updated weights for policy 1, policy_version 1621381 (0.0009) [2023-12-28 06:53:10,472][106225] Updated weights for policy 1, policy_version 1621391 (0.0008) [2023-12-28 06:53:10,735][106226] Updated weights for policy 0, policy_version 1617697 (0.0006) [2023-12-28 06:53:10,791][106226] Updated weights for policy 0, policy_version 1617707 (0.0005) [2023-12-28 06:53:10,840][106226] Updated weights for policy 0, policy_version 1617717 (0.0006) [2023-12-28 06:53:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 829341696. Throughput: 0: 9852.0, 1: 10086.4. Samples: 829313892. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:11,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-5.106')] [2023-12-28 06:53:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001621400_415129600.pth... [2023-12-28 06:53:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001617720_414212096.pth... [2023-12-28 06:53:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001616568_413917184.pth [2023-12-28 06:53:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001620248_414834688.pth [2023-12-28 06:53:11,304][106225] Updated weights for policy 1, policy_version 1621401 (0.0008) [2023-12-28 06:53:11,377][106225] Updated weights for policy 1, policy_version 1621411 (0.0008) [2023-12-28 06:53:11,440][106225] Updated weights for policy 1, policy_version 1621421 (0.0008) [2023-12-28 06:53:11,505][106225] Updated weights for policy 1, policy_version 1621431 (0.0007) [2023-12-28 06:53:11,581][106226] Updated weights for policy 0, policy_version 1617727 (0.0006) [2023-12-28 06:53:11,649][106226] Updated weights for policy 0, policy_version 1617737 (0.0008) [2023-12-28 06:53:11,721][106226] Updated weights for policy 0, policy_version 1617747 (0.0007) [2023-12-28 06:53:12,217][106225] Updated weights for policy 1, policy_version 1621441 (0.0006) [2023-12-28 06:53:12,285][106225] Updated weights for policy 1, policy_version 1621451 (0.0008) [2023-12-28 06:53:12,354][106225] Updated weights for policy 1, policy_version 1621461 (0.0008) [2023-12-28 06:53:12,468][106226] Updated weights for policy 0, policy_version 1617757 (0.0007) [2023-12-28 06:53:12,527][106226] Updated weights for policy 0, policy_version 1617767 (0.0006) [2023-12-28 06:53:12,593][106226] Updated weights for policy 0, policy_version 1617777 (0.0006) [2023-12-28 06:53:13,040][106225] Updated weights for policy 1, policy_version 1621471 (0.0008) [2023-12-28 06:53:13,108][106225] Updated weights for policy 1, policy_version 1621481 (0.0008) [2023-12-28 06:53:13,164][106225] Updated weights for policy 1, policy_version 1621491 (0.0008) [2023-12-28 06:53:13,290][106226] Updated weights for policy 0, policy_version 1617787 (0.0009) [2023-12-28 06:53:13,345][106226] Updated weights for policy 0, policy_version 1617797 (0.0009) [2023-12-28 06:53:13,390][106226] Updated weights for policy 0, policy_version 1617807 (0.0008) [2023-12-28 06:53:13,920][106225] Updated weights for policy 1, policy_version 1621501 (0.0008) [2023-12-28 06:53:13,965][106225] Updated weights for policy 1, policy_version 1621511 (0.0008) [2023-12-28 06:53:14,003][106226] Updated weights for policy 0, policy_version 1617817 (0.0009) [2023-12-28 06:53:14,016][106225] Updated weights for policy 1, policy_version 1621521 (0.0008) [2023-12-28 06:53:14,066][106226] Updated weights for policy 0, policy_version 1617827 (0.0008) [2023-12-28 06:53:14,129][106226] Updated weights for policy 0, policy_version 1617837 (0.0007) [2023-12-28 06:53:14,182][106226] Updated weights for policy 0, policy_version 1617847 (0.0005) [2023-12-28 06:53:14,707][106225] Updated weights for policy 1, policy_version 1621531 (0.0006) [2023-12-28 06:53:14,773][106225] Updated weights for policy 1, policy_version 1621541 (0.0008) [2023-12-28 06:53:14,835][106225] Updated weights for policy 1, policy_version 1621551 (0.0008) [2023-12-28 06:53:14,877][106226] Updated weights for policy 0, policy_version 1617857 (0.0006) [2023-12-28 06:53:14,930][106226] Updated weights for policy 0, policy_version 1617867 (0.0007) [2023-12-28 06:53:14,995][106226] Updated weights for policy 0, policy_version 1617877 (0.0008) [2023-12-28 06:53:15,495][106225] Updated weights for policy 1, policy_version 1621561 (0.0010) [2023-12-28 06:53:15,560][106225] Updated weights for policy 1, policy_version 1621571 (0.0006) [2023-12-28 06:53:15,627][106225] Updated weights for policy 1, policy_version 1621581 (0.0005) [2023-12-28 06:53:15,701][106225] Updated weights for policy 1, policy_version 1621591 (0.0007) [2023-12-28 06:53:15,710][106226] Updated weights for policy 0, policy_version 1617887 (0.0006) [2023-12-28 06:53:15,765][106226] Updated weights for policy 0, policy_version 1617897 (0.0005) [2023-12-28 06:53:15,833][106226] Updated weights for policy 0, policy_version 1617907 (0.0005) [2023-12-28 06:53:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 829440000. Throughput: 0: 9825.1, 1: 9962.8. Samples: 829430080. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:16,176][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.678')] [2023-12-28 06:53:16,405][106225] Updated weights for policy 1, policy_version 1621601 (0.0008) [2023-12-28 06:53:16,437][106226] Updated weights for policy 0, policy_version 1617917 (0.0007) [2023-12-28 06:53:16,463][106225] Updated weights for policy 1, policy_version 1621611 (0.0006) [2023-12-28 06:53:16,500][106226] Updated weights for policy 0, policy_version 1617927 (0.0008) [2023-12-28 06:53:16,529][106225] Updated weights for policy 1, policy_version 1621621 (0.0007) [2023-12-28 06:53:16,562][106226] Updated weights for policy 0, policy_version 1617937 (0.0008) [2023-12-28 06:53:17,249][106225] Updated weights for policy 1, policy_version 1621631 (0.0008) [2023-12-28 06:53:17,295][106226] Updated weights for policy 0, policy_version 1617947 (0.0008) [2023-12-28 06:53:17,305][106225] Updated weights for policy 1, policy_version 1621641 (0.0007) [2023-12-28 06:53:17,353][106226] Updated weights for policy 0, policy_version 1617957 (0.0007) [2023-12-28 06:53:17,359][106225] Updated weights for policy 1, policy_version 1621651 (0.0006) [2023-12-28 06:53:17,411][106226] Updated weights for policy 0, policy_version 1617967 (0.0007) [2023-12-28 06:53:18,017][106225] Updated weights for policy 1, policy_version 1621661 (0.0007) [2023-12-28 06:53:18,076][106225] Updated weights for policy 1, policy_version 1621671 (0.0008) [2023-12-28 06:53:18,100][106226] Updated weights for policy 0, policy_version 1617977 (0.0008) [2023-12-28 06:53:18,142][106225] Updated weights for policy 1, policy_version 1621681 (0.0009) [2023-12-28 06:53:18,164][106226] Updated weights for policy 0, policy_version 1617987 (0.0007) [2023-12-28 06:53:18,230][106226] Updated weights for policy 0, policy_version 1617997 (0.0006) [2023-12-28 06:53:18,303][106226] Updated weights for policy 0, policy_version 1618007 (0.0006) [2023-12-28 06:53:18,925][106225] Updated weights for policy 1, policy_version 1621691 (0.0007) [2023-12-28 06:53:18,977][106226] Updated weights for policy 0, policy_version 1618017 (0.0007) [2023-12-28 06:53:18,979][106225] Updated weights for policy 1, policy_version 1621701 (0.0006) [2023-12-28 06:53:19,038][106225] Updated weights for policy 1, policy_version 1621711 (0.0005) [2023-12-28 06:53:19,039][106226] Updated weights for policy 0, policy_version 1618027 (0.0009) [2023-12-28 06:53:19,098][106226] Updated weights for policy 0, policy_version 1618037 (0.0009) [2023-12-28 06:53:19,746][106225] Updated weights for policy 1, policy_version 1621721 (0.0006) [2023-12-28 06:53:19,808][106225] Updated weights for policy 1, policy_version 1621731 (0.0007) [2023-12-28 06:53:19,867][106226] Updated weights for policy 0, policy_version 1618047 (0.0008) [2023-12-28 06:53:19,885][106225] Updated weights for policy 1, policy_version 1621741 (0.0008) [2023-12-28 06:53:19,935][106226] Updated weights for policy 0, policy_version 1618057 (0.0008) [2023-12-28 06:53:19,952][106225] Updated weights for policy 1, policy_version 1621751 (0.0008) [2023-12-28 06:53:20,009][106226] Updated weights for policy 0, policy_version 1618067 (0.0008) [2023-12-28 06:53:20,640][106225] Updated weights for policy 1, policy_version 1621761 (0.0008) [2023-12-28 06:53:20,708][106225] Updated weights for policy 1, policy_version 1621771 (0.0008) [2023-12-28 06:53:20,732][106226] Updated weights for policy 0, policy_version 1618077 (0.0008) [2023-12-28 06:53:20,764][106225] Updated weights for policy 1, policy_version 1621781 (0.0008) [2023-12-28 06:53:20,797][106226] Updated weights for policy 0, policy_version 1618087 (0.0008) [2023-12-28 06:53:20,863][106226] Updated weights for policy 0, policy_version 1618097 (0.0008) [2023-12-28 06:53:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 829538304. Throughput: 0: 9741.2, 1: 9876.0. Samples: 829546292. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:21,175][105115] Avg episode reward: [(0, '-4.205'), (1, '-4.631')] [2023-12-28 06:53:21,530][106225] Updated weights for policy 1, policy_version 1621791 (0.0007) [2023-12-28 06:53:21,560][106226] Updated weights for policy 0, policy_version 1618107 (0.0007) [2023-12-28 06:53:21,591][106225] Updated weights for policy 1, policy_version 1621801 (0.0008) [2023-12-28 06:53:21,628][106226] Updated weights for policy 0, policy_version 1618117 (0.0006) [2023-12-28 06:53:21,658][106225] Updated weights for policy 1, policy_version 1621811 (0.0008) [2023-12-28 06:53:21,699][106226] Updated weights for policy 0, policy_version 1618127 (0.0008) [2023-12-28 06:53:22,326][106225] Updated weights for policy 1, policy_version 1621821 (0.0008) [2023-12-28 06:53:22,399][106225] Updated weights for policy 1, policy_version 1621831 (0.0008) [2023-12-28 06:53:22,454][106225] Updated weights for policy 1, policy_version 1621841 (0.0008) [2023-12-28 06:53:22,497][106226] Updated weights for policy 0, policy_version 1618137 (0.0008) [2023-12-28 06:53:22,566][106226] Updated weights for policy 0, policy_version 1618147 (0.0006) [2023-12-28 06:53:22,634][106226] Updated weights for policy 0, policy_version 1618157 (0.0006) [2023-12-28 06:53:22,703][106226] Updated weights for policy 0, policy_version 1618167 (0.0006) [2023-12-28 06:53:23,099][106225] Updated weights for policy 1, policy_version 1621851 (0.0006) [2023-12-28 06:53:23,149][106225] Updated weights for policy 1, policy_version 1621861 (0.0009) [2023-12-28 06:53:23,204][106225] Updated weights for policy 1, policy_version 1621871 (0.0007) [2023-12-28 06:53:23,324][106226] Updated weights for policy 0, policy_version 1618177 (0.0010) [2023-12-28 06:53:23,387][106226] Updated weights for policy 0, policy_version 1618187 (0.0011) [2023-12-28 06:53:23,454][106226] Updated weights for policy 0, policy_version 1618197 (0.0011) [2023-12-28 06:53:23,938][106225] Updated weights for policy 1, policy_version 1621881 (0.0009) [2023-12-28 06:53:23,988][106225] Updated weights for policy 1, policy_version 1621891 (0.0009) [2023-12-28 06:53:24,037][106225] Updated weights for policy 1, policy_version 1621901 (0.0007) [2023-12-28 06:53:24,091][106225] Updated weights for policy 1, policy_version 1621911 (0.0007) [2023-12-28 06:53:24,117][106226] Updated weights for policy 0, policy_version 1618207 (0.0007) [2023-12-28 06:53:24,188][106226] Updated weights for policy 0, policy_version 1618217 (0.0006) [2023-12-28 06:53:24,235][106226] Updated weights for policy 0, policy_version 1618227 (0.0006) [2023-12-28 06:53:24,789][106225] Updated weights for policy 1, policy_version 1621921 (0.0006) [2023-12-28 06:53:24,805][106226] Updated weights for policy 0, policy_version 1618237 (0.0005) [2023-12-28 06:53:24,851][106225] Updated weights for policy 1, policy_version 1621931 (0.0005) [2023-12-28 06:53:24,864][106226] Updated weights for policy 0, policy_version 1618247 (0.0005) [2023-12-28 06:53:24,903][106225] Updated weights for policy 1, policy_version 1621941 (0.0005) [2023-12-28 06:53:24,911][106226] Updated weights for policy 0, policy_version 1618257 (0.0005) [2023-12-28 06:53:25,489][106225] Updated weights for policy 1, policy_version 1621951 (0.0007) [2023-12-28 06:53:25,512][106226] Updated weights for policy 0, policy_version 1618267 (0.0007) [2023-12-28 06:53:25,541][106225] Updated weights for policy 1, policy_version 1621961 (0.0007) [2023-12-28 06:53:25,565][106226] Updated weights for policy 0, policy_version 1618277 (0.0010) [2023-12-28 06:53:25,594][106225] Updated weights for policy 1, policy_version 1621971 (0.0007) [2023-12-28 06:53:25,621][106226] Updated weights for policy 0, policy_version 1618287 (0.0010) [2023-12-28 06:53:26,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 829636608. Throughput: 0: 9757.7, 1: 9851.3. Samples: 829605092. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:26,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.932')] [2023-12-28 06:53:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001621976_415277056.pth... [2023-12-28 06:53:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001618296_414359552.pth... [2023-12-28 06:53:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001620824_414982144.pth [2023-12-28 06:53:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001617144_414064640.pth [2023-12-28 06:53:26,297][106225] Updated weights for policy 1, policy_version 1621981 (0.0009) [2023-12-28 06:53:26,352][106225] Updated weights for policy 1, policy_version 1621991 (0.0008) [2023-12-28 06:53:26,354][106226] Updated weights for policy 0, policy_version 1618297 (0.0010) [2023-12-28 06:53:26,410][106226] Updated weights for policy 0, policy_version 1618307 (0.0007) [2023-12-28 06:53:26,412][106225] Updated weights for policy 1, policy_version 1622001 (0.0008) [2023-12-28 06:53:26,461][106226] Updated weights for policy 0, policy_version 1618317 (0.0007) [2023-12-28 06:53:26,513][106226] Updated weights for policy 0, policy_version 1618327 (0.0008) [2023-12-28 06:53:27,053][106225] Updated weights for policy 1, policy_version 1622011 (0.0008) [2023-12-28 06:53:27,107][106225] Updated weights for policy 1, policy_version 1622021 (0.0008) [2023-12-28 06:53:27,161][106225] Updated weights for policy 1, policy_version 1622031 (0.0008) [2023-12-28 06:53:27,179][106226] Updated weights for policy 0, policy_version 1618337 (0.0006) [2023-12-28 06:53:27,231][106226] Updated weights for policy 0, policy_version 1618347 (0.0006) [2023-12-28 06:53:27,283][106226] Updated weights for policy 0, policy_version 1618357 (0.0008) [2023-12-28 06:53:27,861][106225] Updated weights for policy 1, policy_version 1622041 (0.0007) [2023-12-28 06:53:27,917][106225] Updated weights for policy 1, policy_version 1622051 (0.0008) [2023-12-28 06:53:27,921][106226] Updated weights for policy 0, policy_version 1618367 (0.0008) [2023-12-28 06:53:27,967][106226] Updated weights for policy 0, policy_version 1618377 (0.0008) [2023-12-28 06:53:27,973][106225] Updated weights for policy 1, policy_version 1622061 (0.0005) [2023-12-28 06:53:28,023][106226] Updated weights for policy 0, policy_version 1618387 (0.0008) [2023-12-28 06:53:28,034][106225] Updated weights for policy 1, policy_version 1622071 (0.0006) [2023-12-28 06:53:28,704][106226] Updated weights for policy 0, policy_version 1618397 (0.0007) [2023-12-28 06:53:28,765][106226] Updated weights for policy 0, policy_version 1618407 (0.0008) [2023-12-28 06:53:28,771][106225] Updated weights for policy 1, policy_version 1622081 (0.0006) [2023-12-28 06:53:28,824][106226] Updated weights for policy 0, policy_version 1618417 (0.0008) [2023-12-28 06:53:28,830][106225] Updated weights for policy 1, policy_version 1622091 (0.0006) [2023-12-28 06:53:28,897][106225] Updated weights for policy 1, policy_version 1622101 (0.0005) [2023-12-28 06:53:29,475][106225] Updated weights for policy 1, policy_version 1622111 (0.0008) [2023-12-28 06:53:29,536][106225] Updated weights for policy 1, policy_version 1622121 (0.0008) [2023-12-28 06:53:29,549][106226] Updated weights for policy 0, policy_version 1618427 (0.0009) [2023-12-28 06:53:29,594][106225] Updated weights for policy 1, policy_version 1622131 (0.0006) [2023-12-28 06:53:29,604][106226] Updated weights for policy 0, policy_version 1618437 (0.0007) [2023-12-28 06:53:29,658][106226] Updated weights for policy 0, policy_version 1618447 (0.0007) [2023-12-28 06:53:30,215][106225] Updated weights for policy 1, policy_version 1622141 (0.0006) [2023-12-28 06:53:30,275][106225] Updated weights for policy 1, policy_version 1622151 (0.0005) [2023-12-28 06:53:30,332][106225] Updated weights for policy 1, policy_version 1622161 (0.0006) [2023-12-28 06:53:30,477][106226] Updated weights for policy 0, policy_version 1618457 (0.0008) [2023-12-28 06:53:30,539][106226] Updated weights for policy 0, policy_version 1618467 (0.0008) [2023-12-28 06:53:30,583][106226] Updated weights for policy 0, policy_version 1618477 (0.0008) [2023-12-28 06:53:30,636][106226] Updated weights for policy 0, policy_version 1618487 (0.0008) [2023-12-28 06:53:30,987][106225] Updated weights for policy 1, policy_version 1622171 (0.0009) [2023-12-28 06:53:31,036][106225] Updated weights for policy 1, policy_version 1622181 (0.0008) [2023-12-28 06:53:31,098][106225] Updated weights for policy 1, policy_version 1622191 (0.0008) [2023-12-28 06:53:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 829743104. Throughput: 0: 9889.9, 1: 9976.0. Samples: 829729668. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:31,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.702')] [2023-12-28 06:53:31,368][106226] Updated weights for policy 0, policy_version 1618497 (0.0008) [2023-12-28 06:53:31,442][106226] Updated weights for policy 0, policy_version 1618507 (0.0009) [2023-12-28 06:53:31,505][106226] Updated weights for policy 0, policy_version 1618517 (0.0010) [2023-12-28 06:53:31,857][106225] Updated weights for policy 1, policy_version 1622201 (0.0009) [2023-12-28 06:53:31,914][106225] Updated weights for policy 1, policy_version 1622211 (0.0008) [2023-12-28 06:53:31,975][106225] Updated weights for policy 1, policy_version 1622221 (0.0008) [2023-12-28 06:53:32,032][106225] Updated weights for policy 1, policy_version 1622231 (0.0007) [2023-12-28 06:53:32,230][106226] Updated weights for policy 0, policy_version 1618527 (0.0010) [2023-12-28 06:53:32,293][106226] Updated weights for policy 0, policy_version 1618537 (0.0008) [2023-12-28 06:53:32,356][106226] Updated weights for policy 0, policy_version 1618547 (0.0006) [2023-12-28 06:53:32,815][106225] Updated weights for policy 1, policy_version 1622241 (0.0008) [2023-12-28 06:53:32,865][106225] Updated weights for policy 1, policy_version 1622251 (0.0008) [2023-12-28 06:53:32,913][106225] Updated weights for policy 1, policy_version 1622261 (0.0008) [2023-12-28 06:53:32,987][106226] Updated weights for policy 0, policy_version 1618557 (0.0008) [2023-12-28 06:53:33,053][106226] Updated weights for policy 0, policy_version 1618567 (0.0008) [2023-12-28 06:53:33,109][106226] Updated weights for policy 0, policy_version 1618577 (0.0009) [2023-12-28 06:53:33,655][106225] Updated weights for policy 1, policy_version 1622271 (0.0006) [2023-12-28 06:53:33,715][106225] Updated weights for policy 1, policy_version 1622281 (0.0006) [2023-12-28 06:53:33,771][106225] Updated weights for policy 1, policy_version 1622291 (0.0008) [2023-12-28 06:53:33,773][106226] Updated weights for policy 0, policy_version 1618587 (0.0007) [2023-12-28 06:53:33,833][106226] Updated weights for policy 0, policy_version 1618597 (0.0008) [2023-12-28 06:53:33,891][106226] Updated weights for policy 0, policy_version 1618607 (0.0009) [2023-12-28 06:53:34,486][106225] Updated weights for policy 1, policy_version 1622301 (0.0008) [2023-12-28 06:53:34,547][106225] Updated weights for policy 1, policy_version 1622311 (0.0007) [2023-12-28 06:53:34,604][106225] Updated weights for policy 1, policy_version 1622321 (0.0008) [2023-12-28 06:53:34,655][106226] Updated weights for policy 0, policy_version 1618617 (0.0009) [2023-12-28 06:53:34,722][106226] Updated weights for policy 0, policy_version 1618627 (0.0009) [2023-12-28 06:53:34,776][106226] Updated weights for policy 0, policy_version 1618637 (0.0011) [2023-12-28 06:53:34,833][106226] Updated weights for policy 0, policy_version 1618647 (0.0007) [2023-12-28 06:53:35,335][106225] Updated weights for policy 1, policy_version 1622331 (0.0009) [2023-12-28 06:53:35,381][106225] Updated weights for policy 1, policy_version 1622341 (0.0010) [2023-12-28 06:53:35,428][106225] Updated weights for policy 1, policy_version 1622351 (0.0010) [2023-12-28 06:53:35,477][106226] Updated weights for policy 0, policy_version 1618657 (0.0010) [2023-12-28 06:53:35,527][106226] Updated weights for policy 0, policy_version 1618667 (0.0010) [2023-12-28 06:53:35,582][106226] Updated weights for policy 0, policy_version 1618677 (0.0010) [2023-12-28 06:53:36,172][106225] Updated weights for policy 1, policy_version 1622361 (0.0010) [2023-12-28 06:53:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 829833216. Throughput: 0: 9899.5, 1: 9961.2. Samples: 829847052. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:36,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.576')] [2023-12-28 06:53:36,237][106225] Updated weights for policy 1, policy_version 1622371 (0.0011) [2023-12-28 06:53:36,299][106225] Updated weights for policy 1, policy_version 1622381 (0.0011) [2023-12-28 06:53:36,331][106226] Updated weights for policy 0, policy_version 1618687 (0.0011) [2023-12-28 06:53:36,361][106225] Updated weights for policy 1, policy_version 1622391 (0.0010) [2023-12-28 06:53:36,395][106226] Updated weights for policy 0, policy_version 1618697 (0.0011) [2023-12-28 06:53:36,459][106226] Updated weights for policy 0, policy_version 1618707 (0.0011) [2023-12-28 06:53:37,078][106225] Updated weights for policy 1, policy_version 1622401 (0.0010) [2023-12-28 06:53:37,139][106225] Updated weights for policy 1, policy_version 1622411 (0.0010) [2023-12-28 06:53:37,166][106226] Updated weights for policy 0, policy_version 1618717 (0.0009) [2023-12-28 06:53:37,203][106225] Updated weights for policy 1, policy_version 1622421 (0.0010) [2023-12-28 06:53:37,218][106226] Updated weights for policy 0, policy_version 1618727 (0.0007) [2023-12-28 06:53:37,275][106226] Updated weights for policy 0, policy_version 1618737 (0.0005) [2023-12-28 06:53:37,838][106226] Updated weights for policy 0, policy_version 1618747 (0.0006) [2023-12-28 06:53:37,889][106226] Updated weights for policy 0, policy_version 1618757 (0.0007) [2023-12-28 06:53:37,899][106225] Updated weights for policy 1, policy_version 1622431 (0.0010) [2023-12-28 06:53:37,937][106226] Updated weights for policy 0, policy_version 1618767 (0.0007) [2023-12-28 06:53:37,946][106225] Updated weights for policy 1, policy_version 1622441 (0.0010) [2023-12-28 06:53:37,997][106225] Updated weights for policy 1, policy_version 1622451 (0.0010) [2023-12-28 06:53:38,550][106226] Updated weights for policy 0, policy_version 1618777 (0.0006) [2023-12-28 06:53:38,613][106226] Updated weights for policy 0, policy_version 1618787 (0.0010) [2023-12-28 06:53:38,663][106226] Updated weights for policy 0, policy_version 1618797 (0.0010) [2023-12-28 06:53:38,710][106226] Updated weights for policy 0, policy_version 1618807 (0.0010) [2023-12-28 06:53:38,737][106225] Updated weights for policy 1, policy_version 1622461 (0.0010) [2023-12-28 06:53:38,794][106225] Updated weights for policy 1, policy_version 1622471 (0.0010) [2023-12-28 06:53:38,855][106225] Updated weights for policy 1, policy_version 1622481 (0.0010) [2023-12-28 06:53:39,503][106226] Updated weights for policy 0, policy_version 1618817 (0.0008) [2023-12-28 06:53:39,527][106225] Updated weights for policy 1, policy_version 1622491 (0.0006) [2023-12-28 06:53:39,562][106226] Updated weights for policy 0, policy_version 1618827 (0.0008) [2023-12-28 06:53:39,589][106225] Updated weights for policy 1, policy_version 1622501 (0.0008) [2023-12-28 06:53:39,625][106226] Updated weights for policy 0, policy_version 1618837 (0.0008) [2023-12-28 06:53:39,648][106225] Updated weights for policy 1, policy_version 1622511 (0.0008) [2023-12-28 06:53:40,366][106226] Updated weights for policy 0, policy_version 1618847 (0.0008) [2023-12-28 06:53:40,411][106225] Updated weights for policy 1, policy_version 1622521 (0.0008) [2023-12-28 06:53:40,435][106226] Updated weights for policy 0, policy_version 1618857 (0.0008) [2023-12-28 06:53:40,469][106225] Updated weights for policy 1, policy_version 1622531 (0.0010) [2023-12-28 06:53:40,495][106226] Updated weights for policy 0, policy_version 1618867 (0.0006) [2023-12-28 06:53:40,527][106225] Updated weights for policy 1, policy_version 1622541 (0.0010) [2023-12-28 06:53:40,592][106225] Updated weights for policy 1, policy_version 1622551 (0.0010) [2023-12-28 06:53:41,174][106226] Updated weights for policy 0, policy_version 1618877 (0.0007) [2023-12-28 06:53:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 829931520. Throughput: 0: 9953.5, 1: 9972.1. Samples: 829907860. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:41,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.629')] [2023-12-28 06:53:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001622552_415424512.pth... [2023-12-28 06:53:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001621400_415129600.pth [2023-12-28 06:53:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001622552_415424512.pth [2023-12-28 06:53:41,242][106226] Updated weights for policy 0, policy_version 1618887 (0.0006) [2023-12-28 06:53:41,310][106226] Updated weights for policy 0, policy_version 1618897 (0.0008) [2023-12-28 06:53:41,327][106225] Updated weights for policy 1, policy_version 1622561 (0.0010) [2023-12-28 06:53:41,352][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001618904_414515200.pth... [2023-12-28 06:53:41,363][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001617720_414212096.pth [2023-12-28 06:53:41,368][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001618904_414515200.pth [2023-12-28 06:53:41,397][106225] Updated weights for policy 1, policy_version 1622571 (0.0011) [2023-12-28 06:53:41,466][106225] Updated weights for policy 1, policy_version 1622581 (0.0010) [2023-12-28 06:53:42,049][106226] Updated weights for policy 0, policy_version 1618907 (0.0009) [2023-12-28 06:53:42,115][106226] Updated weights for policy 0, policy_version 1618917 (0.0011) [2023-12-28 06:53:42,170][106226] Updated weights for policy 0, policy_version 1618927 (0.0011) [2023-12-28 06:53:42,224][106225] Updated weights for policy 1, policy_version 1622591 (0.0010) [2023-12-28 06:53:42,284][106225] Updated weights for policy 1, policy_version 1622601 (0.0011) [2023-12-28 06:53:42,348][106225] Updated weights for policy 1, policy_version 1622611 (0.0011) [2023-12-28 06:53:42,860][106226] Updated weights for policy 0, policy_version 1618937 (0.0010) [2023-12-28 06:53:42,914][106226] Updated weights for policy 0, policy_version 1618947 (0.0005) [2023-12-28 06:53:42,968][106226] Updated weights for policy 0, policy_version 1618957 (0.0005) [2023-12-28 06:53:43,027][106226] Updated weights for policy 0, policy_version 1618967 (0.0005) [2023-12-28 06:53:43,084][106225] Updated weights for policy 1, policy_version 1622621 (0.0010) [2023-12-28 06:53:43,144][106225] Updated weights for policy 1, policy_version 1622631 (0.0010) [2023-12-28 06:53:43,191][106225] Updated weights for policy 1, policy_version 1622641 (0.0010) [2023-12-28 06:53:43,592][106226] Updated weights for policy 0, policy_version 1618977 (0.0006) [2023-12-28 06:53:43,645][106226] Updated weights for policy 0, policy_version 1618987 (0.0010) [2023-12-28 06:53:43,702][106226] Updated weights for policy 0, policy_version 1618997 (0.0010) [2023-12-28 06:53:43,828][106225] Updated weights for policy 1, policy_version 1622651 (0.0010) [2023-12-28 06:53:43,881][106225] Updated weights for policy 1, policy_version 1622661 (0.0010) [2023-12-28 06:53:43,928][106225] Updated weights for policy 1, policy_version 1622671 (0.0010) [2023-12-28 06:53:44,341][106226] Updated weights for policy 0, policy_version 1619007 (0.0008) [2023-12-28 06:53:44,393][106226] Updated weights for policy 0, policy_version 1619017 (0.0009) [2023-12-28 06:53:44,448][106226] Updated weights for policy 0, policy_version 1619027 (0.0005) [2023-12-28 06:53:44,635][106225] Updated weights for policy 1, policy_version 1622681 (0.0009) [2023-12-28 06:53:44,683][106225] Updated weights for policy 1, policy_version 1622691 (0.0008) [2023-12-28 06:53:44,730][106225] Updated weights for policy 1, policy_version 1622701 (0.0010) [2023-12-28 06:53:44,791][106225] Updated weights for policy 1, policy_version 1622711 (0.0009) [2023-12-28 06:53:45,080][106226] Updated weights for policy 0, policy_version 1619037 (0.0009) [2023-12-28 06:53:45,151][106226] Updated weights for policy 0, policy_version 1619047 (0.0008) [2023-12-28 06:53:45,217][106226] Updated weights for policy 0, policy_version 1619057 (0.0010) [2023-12-28 06:53:45,572][106225] Updated weights for policy 1, policy_version 1622721 (0.0010) [2023-12-28 06:53:45,635][106225] Updated weights for policy 1, policy_version 1622731 (0.0010) [2023-12-28 06:53:45,692][106225] Updated weights for policy 1, policy_version 1622741 (0.0010) [2023-12-28 06:53:45,885][106226] Updated weights for policy 0, policy_version 1619067 (0.0010) [2023-12-28 06:53:45,945][106226] Updated weights for policy 0, policy_version 1619077 (0.0011) [2023-12-28 06:53:46,008][106226] Updated weights for policy 0, policy_version 1619087 (0.0010) [2023-12-28 06:53:46,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 830038016. Throughput: 0: 10083.6, 1: 9870.8. Samples: 830026980. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:46,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.705')] [2023-12-28 06:53:46,391][106225] Updated weights for policy 1, policy_version 1622751 (0.0010) [2023-12-28 06:53:46,441][106225] Updated weights for policy 1, policy_version 1622761 (0.0010) [2023-12-28 06:53:46,490][106225] Updated weights for policy 1, policy_version 1622771 (0.0009) [2023-12-28 06:53:46,693][106226] Updated weights for policy 0, policy_version 1619097 (0.0010) [2023-12-28 06:53:46,746][106226] Updated weights for policy 0, policy_version 1619107 (0.0010) [2023-12-28 06:53:46,802][106226] Updated weights for policy 0, policy_version 1619117 (0.0010) [2023-12-28 06:53:46,851][106226] Updated weights for policy 0, policy_version 1619127 (0.0010) [2023-12-28 06:53:47,229][106225] Updated weights for policy 1, policy_version 1622781 (0.0008) [2023-12-28 06:53:47,289][106225] Updated weights for policy 1, policy_version 1622791 (0.0010) [2023-12-28 06:53:47,339][106225] Updated weights for policy 1, policy_version 1622801 (0.0010) [2023-12-28 06:53:47,584][106226] Updated weights for policy 0, policy_version 1619137 (0.0011) [2023-12-28 06:53:47,647][106226] Updated weights for policy 0, policy_version 1619147 (0.0011) [2023-12-28 06:53:47,714][106226] Updated weights for policy 0, policy_version 1619157 (0.0011) [2023-12-28 06:53:48,091][106225] Updated weights for policy 1, policy_version 1622811 (0.0010) [2023-12-28 06:53:48,151][106225] Updated weights for policy 1, policy_version 1622821 (0.0007) [2023-12-28 06:53:48,208][106225] Updated weights for policy 1, policy_version 1622831 (0.0007) [2023-12-28 06:53:48,382][106226] Updated weights for policy 0, policy_version 1619167 (0.0011) [2023-12-28 06:53:48,440][106226] Updated weights for policy 0, policy_version 1619177 (0.0011) [2023-12-28 06:53:48,505][106226] Updated weights for policy 0, policy_version 1619187 (0.0011) [2023-12-28 06:53:48,963][106225] Updated weights for policy 1, policy_version 1622841 (0.0007) [2023-12-28 06:53:49,022][106225] Updated weights for policy 1, policy_version 1622851 (0.0008) [2023-12-28 06:53:49,081][106225] Updated weights for policy 1, policy_version 1622861 (0.0008) [2023-12-28 06:53:49,135][106225] Updated weights for policy 1, policy_version 1622871 (0.0008) [2023-12-28 06:53:49,206][106226] Updated weights for policy 0, policy_version 1619197 (0.0009) [2023-12-28 06:53:49,278][106226] Updated weights for policy 0, policy_version 1619207 (0.0007) [2023-12-28 06:53:49,347][106226] Updated weights for policy 0, policy_version 1619217 (0.0008) [2023-12-28 06:53:49,979][106225] Updated weights for policy 1, policy_version 1622881 (0.0007) [2023-12-28 06:53:50,032][106226] Updated weights for policy 0, policy_version 1619227 (0.0010) [2023-12-28 06:53:50,041][106225] Updated weights for policy 1, policy_version 1622891 (0.0007) [2023-12-28 06:53:50,094][106226] Updated weights for policy 0, policy_version 1619237 (0.0007) [2023-12-28 06:53:50,103][106225] Updated weights for policy 1, policy_version 1622901 (0.0009) [2023-12-28 06:53:50,151][106226] Updated weights for policy 0, policy_version 1619247 (0.0008) [2023-12-28 06:53:50,717][106225] Updated weights for policy 1, policy_version 1622911 (0.0008) [2023-12-28 06:53:50,780][106225] Updated weights for policy 1, policy_version 1622921 (0.0008) [2023-12-28 06:53:50,847][106225] Updated weights for policy 1, policy_version 1622931 (0.0008) [2023-12-28 06:53:50,933][106226] Updated weights for policy 0, policy_version 1619257 (0.0007) [2023-12-28 06:53:50,993][106226] Updated weights for policy 0, policy_version 1619267 (0.0008) [2023-12-28 06:53:51,058][106226] Updated weights for policy 0, policy_version 1619277 (0.0009) [2023-12-28 06:53:51,114][106226] Updated weights for policy 0, policy_version 1619287 (0.0008) [2023-12-28 06:53:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 830136320. Throughput: 0: 9964.3, 1: 9805.3. Samples: 830141432. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:51,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.800')] [2023-12-28 06:53:51,552][106225] Updated weights for policy 1, policy_version 1622941 (0.0008) [2023-12-28 06:53:51,611][106225] Updated weights for policy 1, policy_version 1622951 (0.0008) [2023-12-28 06:53:51,677][106225] Updated weights for policy 1, policy_version 1622961 (0.0008) [2023-12-28 06:53:51,925][106226] Updated weights for policy 0, policy_version 1619297 (0.0010) [2023-12-28 06:53:51,993][106226] Updated weights for policy 0, policy_version 1619307 (0.0009) [2023-12-28 06:53:52,054][106226] Updated weights for policy 0, policy_version 1619317 (0.0008) [2023-12-28 06:53:52,445][106225] Updated weights for policy 1, policy_version 1622971 (0.0008) [2023-12-28 06:53:52,502][106225] Updated weights for policy 1, policy_version 1622982 (0.0010) [2023-12-28 06:53:52,555][106225] Updated weights for policy 1, policy_version 1622992 (0.0008) [2023-12-28 06:53:52,779][106226] Updated weights for policy 0, policy_version 1619327 (0.0009) [2023-12-28 06:53:52,842][106226] Updated weights for policy 0, policy_version 1619337 (0.0009) [2023-12-28 06:53:52,900][106226] Updated weights for policy 0, policy_version 1619347 (0.0008) [2023-12-28 06:53:53,214][106225] Updated weights for policy 1, policy_version 1623002 (0.0009) [2023-12-28 06:53:53,269][106225] Updated weights for policy 1, policy_version 1623012 (0.0005) [2023-12-28 06:53:53,325][106225] Updated weights for policy 1, policy_version 1623022 (0.0005) [2023-12-28 06:53:53,374][106225] Updated weights for policy 1, policy_version 1623032 (0.0005) [2023-12-28 06:53:53,568][106226] Updated weights for policy 0, policy_version 1619357 (0.0008) [2023-12-28 06:53:53,612][106226] Updated weights for policy 0, policy_version 1619367 (0.0008) [2023-12-28 06:53:53,669][106226] Updated weights for policy 0, policy_version 1619377 (0.0008) [2023-12-28 06:53:54,014][106225] Updated weights for policy 1, policy_version 1623042 (0.0006) [2023-12-28 06:53:54,061][106225] Updated weights for policy 1, policy_version 1623052 (0.0005) [2023-12-28 06:53:54,119][106225] Updated weights for policy 1, policy_version 1623062 (0.0008) [2023-12-28 06:53:54,256][106226] Updated weights for policy 0, policy_version 1619387 (0.0006) [2023-12-28 06:53:54,321][106226] Updated weights for policy 0, policy_version 1619397 (0.0006) [2023-12-28 06:53:54,384][106226] Updated weights for policy 0, policy_version 1619407 (0.0006) [2023-12-28 06:53:54,779][106225] Updated weights for policy 1, policy_version 1623072 (0.0006) [2023-12-28 06:53:54,833][106225] Updated weights for policy 1, policy_version 1623082 (0.0005) [2023-12-28 06:53:54,881][106225] Updated weights for policy 1, policy_version 1623092 (0.0005) [2023-12-28 06:53:54,957][106226] Updated weights for policy 0, policy_version 1619417 (0.0006) [2023-12-28 06:53:55,026][106226] Updated weights for policy 0, policy_version 1619427 (0.0010) [2023-12-28 06:53:55,088][106226] Updated weights for policy 0, policy_version 1619437 (0.0009) [2023-12-28 06:53:55,150][106226] Updated weights for policy 0, policy_version 1619447 (0.0009) [2023-12-28 06:53:55,481][106225] Updated weights for policy 1, policy_version 1623102 (0.0005) [2023-12-28 06:53:55,546][106225] Updated weights for policy 1, policy_version 1623112 (0.0005) [2023-12-28 06:53:55,607][106225] Updated weights for policy 1, policy_version 1623122 (0.0005) [2023-12-28 06:53:55,908][106226] Updated weights for policy 0, policy_version 1619457 (0.0011) [2023-12-28 06:53:55,978][106226] Updated weights for policy 0, policy_version 1619467 (0.0010) [2023-12-28 06:53:56,046][106226] Updated weights for policy 0, policy_version 1619477 (0.0009) [2023-12-28 06:53:56,108][106225] Updated weights for policy 1, policy_version 1623132 (0.0006) [2023-12-28 06:53:56,161][106225] Updated weights for policy 1, policy_version 1623142 (0.0005) [2023-12-28 06:53:56,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 830234624. Throughput: 0: 9952.0, 1: 9767.2. Samples: 830201252. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:53:56,175][105115] Avg episode reward: [(0, '-4.962'), (1, '-4.676')] [2023-12-28 06:53:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001619480_414662656.pth... [2023-12-28 06:53:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001618296_414359552.pth [2023-12-28 06:53:56,218][106225] Updated weights for policy 1, policy_version 1623152 (0.0005) [2023-12-28 06:53:56,262][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001623160_415580160.pth... [2023-12-28 06:53:56,265][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001621976_415277056.pth [2023-12-28 06:53:56,721][106226] Updated weights for policy 0, policy_version 1619487 (0.0005) [2023-12-28 06:53:56,763][106225] Updated weights for policy 1, policy_version 1623162 (0.0006) [2023-12-28 06:53:56,779][106226] Updated weights for policy 0, policy_version 1619497 (0.0006) [2023-12-28 06:53:56,824][106225] Updated weights for policy 1, policy_version 1623172 (0.0006) [2023-12-28 06:53:56,833][106226] Updated weights for policy 0, policy_version 1619507 (0.0009) [2023-12-28 06:53:56,880][106225] Updated weights for policy 1, policy_version 1623182 (0.0010) [2023-12-28 06:53:56,935][106225] Updated weights for policy 1, policy_version 1623192 (0.0010) [2023-12-28 06:53:57,495][106226] Updated weights for policy 0, policy_version 1619517 (0.0009) [2023-12-28 06:53:57,551][106226] Updated weights for policy 0, policy_version 1619527 (0.0007) [2023-12-28 06:53:57,578][106225] Updated weights for policy 1, policy_version 1623202 (0.0008) [2023-12-28 06:53:57,610][106226] Updated weights for policy 0, policy_version 1619537 (0.0007) [2023-12-28 06:53:57,634][106225] Updated weights for policy 1, policy_version 1623212 (0.0006) [2023-12-28 06:53:57,685][106225] Updated weights for policy 1, policy_version 1623222 (0.0005) [2023-12-28 06:53:58,284][106225] Updated weights for policy 1, policy_version 1623232 (0.0007) [2023-12-28 06:53:58,353][106225] Updated weights for policy 1, policy_version 1623242 (0.0008) [2023-12-28 06:53:58,422][106225] Updated weights for policy 1, policy_version 1623252 (0.0007) [2023-12-28 06:53:58,456][106226] Updated weights for policy 0, policy_version 1619547 (0.0008) [2023-12-28 06:53:58,519][106226] Updated weights for policy 0, policy_version 1619557 (0.0009) [2023-12-28 06:53:58,586][106226] Updated weights for policy 0, policy_version 1619567 (0.0009) [2023-12-28 06:53:59,178][106225] Updated weights for policy 1, policy_version 1623262 (0.0008) [2023-12-28 06:53:59,238][106225] Updated weights for policy 1, policy_version 1623272 (0.0009) [2023-12-28 06:53:59,304][106225] Updated weights for policy 1, policy_version 1623282 (0.0009) [2023-12-28 06:53:59,405][106226] Updated weights for policy 0, policy_version 1619577 (0.0009) [2023-12-28 06:53:59,464][106226] Updated weights for policy 0, policy_version 1619587 (0.0005) [2023-12-28 06:53:59,525][106226] Updated weights for policy 0, policy_version 1619597 (0.0006) [2023-12-28 06:53:59,591][106226] Updated weights for policy 0, policy_version 1619607 (0.0005) [2023-12-28 06:54:00,119][106225] Updated weights for policy 1, policy_version 1623292 (0.0009) [2023-12-28 06:54:00,173][106225] Updated weights for policy 1, policy_version 1623302 (0.0006) [2023-12-28 06:54:00,204][106226] Updated weights for policy 0, policy_version 1619617 (0.0009) [2023-12-28 06:54:00,236][106225] Updated weights for policy 1, policy_version 1623312 (0.0007) [2023-12-28 06:54:00,267][106226] Updated weights for policy 0, policy_version 1619627 (0.0007) [2023-12-28 06:54:00,333][106226] Updated weights for policy 0, policy_version 1619637 (0.0008) [2023-12-28 06:54:00,948][106225] Updated weights for policy 1, policy_version 1623322 (0.0009) [2023-12-28 06:54:01,000][106225] Updated weights for policy 1, policy_version 1623332 (0.0010) [2023-12-28 06:54:01,046][106226] Updated weights for policy 0, policy_version 1619647 (0.0009) [2023-12-28 06:54:01,059][106225] Updated weights for policy 1, policy_version 1623342 (0.0009) [2023-12-28 06:54:01,110][106226] Updated weights for policy 0, policy_version 1619657 (0.0007) [2023-12-28 06:54:01,120][106225] Updated weights for policy 1, policy_version 1623352 (0.0011) [2023-12-28 06:54:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 830332928. Throughput: 0: 9943.4, 1: 9932.9. Samples: 830324512. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-28 06:54:01,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.636')] [2023-12-28 06:54:01,180][106226] Updated weights for policy 0, policy_version 1619667 (0.0009) [2023-12-28 06:54:01,857][106226] Updated weights for policy 0, policy_version 1619677 (0.0007) [2023-12-28 06:54:01,875][106225] Updated weights for policy 1, policy_version 1623362 (0.0010) [2023-12-28 06:54:01,917][106226] Updated weights for policy 0, policy_version 1619687 (0.0006) [2023-12-28 06:54:01,925][106225] Updated weights for policy 1, policy_version 1623372 (0.0010) [2023-12-28 06:54:01,976][106226] Updated weights for policy 0, policy_version 1619697 (0.0009) [2023-12-28 06:54:01,985][106225] Updated weights for policy 1, policy_version 1623382 (0.0010) [2023-12-28 06:54:02,683][106225] Updated weights for policy 1, policy_version 1623392 (0.0010) [2023-12-28 06:54:02,722][106226] Updated weights for policy 0, policy_version 1619707 (0.0008) [2023-12-28 06:54:02,741][106225] Updated weights for policy 1, policy_version 1623402 (0.0010) [2023-12-28 06:54:02,804][106226] Updated weights for policy 0, policy_version 1619717 (0.0006) [2023-12-28 06:54:02,806][106225] Updated weights for policy 1, policy_version 1623412 (0.0011) [2023-12-28 06:54:02,862][106226] Updated weights for policy 0, policy_version 1619727 (0.0006) [2023-12-28 06:54:03,404][106225] Updated weights for policy 1, policy_version 1623422 (0.0007) [2023-12-28 06:54:03,411][106226] Updated weights for policy 0, policy_version 1619737 (0.0009) [2023-12-28 06:54:03,470][106225] Updated weights for policy 1, policy_version 1623432 (0.0005) [2023-12-28 06:54:03,472][106226] Updated weights for policy 0, policy_version 1619747 (0.0008) [2023-12-28 06:54:03,522][106225] Updated weights for policy 1, policy_version 1623442 (0.0008) [2023-12-28 06:54:03,523][106226] Updated weights for policy 0, policy_version 1619757 (0.0009) [2023-12-28 06:54:03,581][106226] Updated weights for policy 0, policy_version 1619767 (0.0007) [2023-12-28 06:54:04,130][106225] Updated weights for policy 1, policy_version 1623452 (0.0010) [2023-12-28 06:54:04,194][106225] Updated weights for policy 1, policy_version 1623462 (0.0008) [2023-12-28 06:54:04,247][106225] Updated weights for policy 1, policy_version 1623472 (0.0008) [2023-12-28 06:54:04,294][106226] Updated weights for policy 0, policy_version 1619777 (0.0006) [2023-12-28 06:54:04,353][106226] Updated weights for policy 0, policy_version 1619787 (0.0008) [2023-12-28 06:54:04,413][106226] Updated weights for policy 0, policy_version 1619797 (0.0008) [2023-12-28 06:54:04,911][106225] Updated weights for policy 1, policy_version 1623482 (0.0008) [2023-12-28 06:54:04,969][106225] Updated weights for policy 1, policy_version 1623492 (0.0005) [2023-12-28 06:54:05,025][106225] Updated weights for policy 1, policy_version 1623502 (0.0005) [2023-12-28 06:54:05,079][106225] Updated weights for policy 1, policy_version 1623512 (0.0005) [2023-12-28 06:54:05,174][106226] Updated weights for policy 0, policy_version 1619807 (0.0009) [2023-12-28 06:54:05,228][106226] Updated weights for policy 0, policy_version 1619817 (0.0007) [2023-12-28 06:54:05,284][106226] Updated weights for policy 0, policy_version 1619827 (0.0005) [2023-12-28 06:54:05,714][106225] Updated weights for policy 1, policy_version 1623522 (0.0010) [2023-12-28 06:54:05,764][106225] Updated weights for policy 1, policy_version 1623532 (0.0010) [2023-12-28 06:54:05,833][106225] Updated weights for policy 1, policy_version 1623542 (0.0010) [2023-12-28 06:54:05,944][106226] Updated weights for policy 0, policy_version 1619837 (0.0010) [2023-12-28 06:54:05,996][106226] Updated weights for policy 0, policy_version 1619847 (0.0008) [2023-12-28 06:54:06,048][106226] Updated weights for policy 0, policy_version 1619857 (0.0006) [2023-12-28 06:54:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 830439424. Throughput: 0: 9982.7, 1: 9995.4. Samples: 830445304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:06,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.548')] [2023-12-28 06:54:06,599][106225] Updated weights for policy 1, policy_version 1623552 (0.0010) [2023-12-28 06:54:06,656][106225] Updated weights for policy 1, policy_version 1623562 (0.0010) [2023-12-28 06:54:06,717][106225] Updated weights for policy 1, policy_version 1623572 (0.0010) [2023-12-28 06:54:06,746][106226] Updated weights for policy 0, policy_version 1619867 (0.0007) [2023-12-28 06:54:06,796][106226] Updated weights for policy 0, policy_version 1619877 (0.0010) [2023-12-28 06:54:06,846][106226] Updated weights for policy 0, policy_version 1619887 (0.0010) [2023-12-28 06:54:07,368][106225] Updated weights for policy 1, policy_version 1623582 (0.0009) [2023-12-28 06:54:07,418][106225] Updated weights for policy 1, policy_version 1623592 (0.0009) [2023-12-28 06:54:07,468][106225] Updated weights for policy 1, policy_version 1623602 (0.0009) [2023-12-28 06:54:07,485][106226] Updated weights for policy 0, policy_version 1619897 (0.0007) [2023-12-28 06:54:07,546][106226] Updated weights for policy 0, policy_version 1619907 (0.0005) [2023-12-28 06:54:07,601][106226] Updated weights for policy 0, policy_version 1619917 (0.0005) [2023-12-28 06:54:07,659][106226] Updated weights for policy 0, policy_version 1619927 (0.0006) [2023-12-28 06:54:08,257][106226] Updated weights for policy 0, policy_version 1619937 (0.0011) [2023-12-28 06:54:08,274][106225] Updated weights for policy 1, policy_version 1623612 (0.0008) [2023-12-28 06:54:08,310][106226] Updated weights for policy 0, policy_version 1619947 (0.0009) [2023-12-28 06:54:08,344][106225] Updated weights for policy 1, policy_version 1623622 (0.0007) [2023-12-28 06:54:08,375][106226] Updated weights for policy 0, policy_version 1619957 (0.0009) [2023-12-28 06:54:08,407][106225] Updated weights for policy 1, policy_version 1623632 (0.0008) [2023-12-28 06:54:09,017][106226] Updated weights for policy 0, policy_version 1619967 (0.0010) [2023-12-28 06:54:09,079][106226] Updated weights for policy 0, policy_version 1619977 (0.0009) [2023-12-28 06:54:09,135][106226] Updated weights for policy 0, policy_version 1619987 (0.0010) [2023-12-28 06:54:09,187][106225] Updated weights for policy 1, policy_version 1623642 (0.0008) [2023-12-28 06:54:09,248][106225] Updated weights for policy 1, policy_version 1623652 (0.0007) [2023-12-28 06:54:09,304][106225] Updated weights for policy 1, policy_version 1623662 (0.0007) [2023-12-28 06:54:09,375][106225] Updated weights for policy 1, policy_version 1623672 (0.0009) [2023-12-28 06:54:09,842][106226] Updated weights for policy 0, policy_version 1619997 (0.0009) [2023-12-28 06:54:09,912][106226] Updated weights for policy 0, policy_version 1620007 (0.0009) [2023-12-28 06:54:09,980][106226] Updated weights for policy 0, policy_version 1620017 (0.0010) [2023-12-28 06:54:10,061][106225] Updated weights for policy 1, policy_version 1623682 (0.0008) [2023-12-28 06:54:10,123][106225] Updated weights for policy 1, policy_version 1623692 (0.0008) [2023-12-28 06:54:10,182][106225] Updated weights for policy 1, policy_version 1623702 (0.0009) [2023-12-28 06:54:10,714][106226] Updated weights for policy 0, policy_version 1620027 (0.0010) [2023-12-28 06:54:10,773][106226] Updated weights for policy 0, policy_version 1620037 (0.0008) [2023-12-28 06:54:10,825][106226] Updated weights for policy 0, policy_version 1620047 (0.0008) [2023-12-28 06:54:10,924][106225] Updated weights for policy 1, policy_version 1623712 (0.0010) [2023-12-28 06:54:10,981][106225] Updated weights for policy 1, policy_version 1623722 (0.0010) [2023-12-28 06:54:11,042][106225] Updated weights for policy 1, policy_version 1623732 (0.0010) [2023-12-28 06:54:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 830537728. Throughput: 0: 10036.1, 1: 9976.4. Samples: 830505660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:11,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.684')] [2023-12-28 06:54:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001620056_414810112.pth... [2023-12-28 06:54:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001623736_415727616.pth... [2023-12-28 06:54:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001622552_415424512.pth [2023-12-28 06:54:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001618904_414515200.pth [2023-12-28 06:54:11,637][106226] Updated weights for policy 0, policy_version 1620057 (0.0008) [2023-12-28 06:54:11,705][106226] Updated weights for policy 0, policy_version 1620067 (0.0007) [2023-12-28 06:54:11,784][106226] Updated weights for policy 0, policy_version 1620077 (0.0009) [2023-12-28 06:54:11,800][106225] Updated weights for policy 1, policy_version 1623742 (0.0009) [2023-12-28 06:54:11,847][106226] Updated weights for policy 0, policy_version 1620087 (0.0008) [2023-12-28 06:54:11,861][106225] Updated weights for policy 1, policy_version 1623752 (0.0010) [2023-12-28 06:54:11,919][106225] Updated weights for policy 1, policy_version 1623762 (0.0010) [2023-12-28 06:54:12,483][106226] Updated weights for policy 0, policy_version 1620097 (0.0009) [2023-12-28 06:54:12,539][106226] Updated weights for policy 0, policy_version 1620107 (0.0010) [2023-12-28 06:54:12,594][106226] Updated weights for policy 0, policy_version 1620117 (0.0011) [2023-12-28 06:54:12,692][106225] Updated weights for policy 1, policy_version 1623772 (0.0010) [2023-12-28 06:54:12,740][106225] Updated weights for policy 1, policy_version 1623782 (0.0008) [2023-12-28 06:54:12,790][106225] Updated weights for policy 1, policy_version 1623792 (0.0008) [2023-12-28 06:54:13,337][106226] Updated weights for policy 0, policy_version 1620127 (0.0010) [2023-12-28 06:54:13,392][106226] Updated weights for policy 0, policy_version 1620137 (0.0011) [2023-12-28 06:54:13,453][106226] Updated weights for policy 0, policy_version 1620147 (0.0010) [2023-12-28 06:54:13,495][106225] Updated weights for policy 1, policy_version 1623802 (0.0007) [2023-12-28 06:54:13,554][106225] Updated weights for policy 1, policy_version 1623812 (0.0005) [2023-12-28 06:54:13,607][106225] Updated weights for policy 1, policy_version 1623822 (0.0005) [2023-12-28 06:54:13,652][106225] Updated weights for policy 1, policy_version 1623832 (0.0005) [2023-12-28 06:54:14,127][106226] Updated weights for policy 0, policy_version 1620157 (0.0008) [2023-12-28 06:54:14,192][106226] Updated weights for policy 0, policy_version 1620167 (0.0006) [2023-12-28 06:54:14,199][106225] Updated weights for policy 1, policy_version 1623842 (0.0007) [2023-12-28 06:54:14,252][106226] Updated weights for policy 0, policy_version 1620177 (0.0008) [2023-12-28 06:54:14,255][106225] Updated weights for policy 1, policy_version 1623852 (0.0010) [2023-12-28 06:54:14,319][106225] Updated weights for policy 1, policy_version 1623862 (0.0008) [2023-12-28 06:54:14,911][106226] Updated weights for policy 0, policy_version 1620187 (0.0010) [2023-12-28 06:54:14,972][106226] Updated weights for policy 0, policy_version 1620197 (0.0010) [2023-12-28 06:54:15,035][106226] Updated weights for policy 0, policy_version 1620207 (0.0011) [2023-12-28 06:54:15,039][106225] Updated weights for policy 1, policy_version 1623872 (0.0008) [2023-12-28 06:54:15,099][106225] Updated weights for policy 1, policy_version 1623882 (0.0008) [2023-12-28 06:54:15,162][106225] Updated weights for policy 1, policy_version 1623892 (0.0008) [2023-12-28 06:54:15,688][106226] Updated weights for policy 0, policy_version 1620217 (0.0011) [2023-12-28 06:54:15,746][106226] Updated weights for policy 0, policy_version 1620227 (0.0011) [2023-12-28 06:54:15,803][106226] Updated weights for policy 0, policy_version 1620237 (0.0011) [2023-12-28 06:54:15,851][106226] Updated weights for policy 0, policy_version 1620247 (0.0010) [2023-12-28 06:54:15,860][106225] Updated weights for policy 1, policy_version 1623902 (0.0009) [2023-12-28 06:54:15,917][106225] Updated weights for policy 1, policy_version 1623912 (0.0010) [2023-12-28 06:54:15,966][106225] Updated weights for policy 1, policy_version 1623922 (0.0010) [2023-12-28 06:54:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 830636032. Throughput: 0: 9936.1, 1: 9895.8. Samples: 830622104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:16,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.737')] [2023-12-28 06:54:16,573][106226] Updated weights for policy 0, policy_version 1620257 (0.0011) [2023-12-28 06:54:16,591][106225] Updated weights for policy 1, policy_version 1623932 (0.0008) [2023-12-28 06:54:16,639][106225] Updated weights for policy 1, policy_version 1623942 (0.0005) [2023-12-28 06:54:16,640][106226] Updated weights for policy 0, policy_version 1620267 (0.0010) [2023-12-28 06:54:16,697][106226] Updated weights for policy 0, policy_version 1620277 (0.0010) [2023-12-28 06:54:16,701][106225] Updated weights for policy 1, policy_version 1623952 (0.0009) [2023-12-28 06:54:17,358][106226] Updated weights for policy 0, policy_version 1620287 (0.0007) [2023-12-28 06:54:17,386][106225] Updated weights for policy 1, policy_version 1623962 (0.0010) [2023-12-28 06:54:17,418][106226] Updated weights for policy 0, policy_version 1620297 (0.0007) [2023-12-28 06:54:17,443][106225] Updated weights for policy 1, policy_version 1623972 (0.0010) [2023-12-28 06:54:17,480][106226] Updated weights for policy 0, policy_version 1620307 (0.0005) [2023-12-28 06:54:17,506][106225] Updated weights for policy 1, policy_version 1623982 (0.0010) [2023-12-28 06:54:17,562][106225] Updated weights for policy 1, policy_version 1623992 (0.0010) [2023-12-28 06:54:18,006][106226] Updated weights for policy 0, policy_version 1620317 (0.0008) [2023-12-28 06:54:18,061][106226] Updated weights for policy 0, policy_version 1620327 (0.0010) [2023-12-28 06:54:18,118][106226] Updated weights for policy 0, policy_version 1620337 (0.0007) [2023-12-28 06:54:18,308][106225] Updated weights for policy 1, policy_version 1624002 (0.0005) [2023-12-28 06:54:18,382][106225] Updated weights for policy 1, policy_version 1624012 (0.0008) [2023-12-28 06:54:18,448][106225] Updated weights for policy 1, policy_version 1624022 (0.0008) [2023-12-28 06:54:18,833][106226] Updated weights for policy 0, policy_version 1620347 (0.0008) [2023-12-28 06:54:18,894][106226] Updated weights for policy 0, policy_version 1620357 (0.0009) [2023-12-28 06:54:18,965][106226] Updated weights for policy 0, policy_version 1620367 (0.0009) [2023-12-28 06:54:19,172][106225] Updated weights for policy 1, policy_version 1624032 (0.0009) [2023-12-28 06:54:19,243][106225] Updated weights for policy 1, policy_version 1624042 (0.0008) [2023-12-28 06:54:19,311][106225] Updated weights for policy 1, policy_version 1624052 (0.0009) [2023-12-28 06:54:19,814][106226] Updated weights for policy 0, policy_version 1620377 (0.0007) [2023-12-28 06:54:19,888][106226] Updated weights for policy 0, policy_version 1620387 (0.0008) [2023-12-28 06:54:19,964][106226] Updated weights for policy 0, policy_version 1620397 (0.0008) [2023-12-28 06:54:20,029][106226] Updated weights for policy 0, policy_version 1620407 (0.0007) [2023-12-28 06:54:20,099][106225] Updated weights for policy 1, policy_version 1624062 (0.0009) [2023-12-28 06:54:20,158][106225] Updated weights for policy 1, policy_version 1624072 (0.0008) [2023-12-28 06:54:20,223][106225] Updated weights for policy 1, policy_version 1624082 (0.0010) [2023-12-28 06:54:20,715][106226] Updated weights for policy 0, policy_version 1620417 (0.0007) [2023-12-28 06:54:20,781][106226] Updated weights for policy 0, policy_version 1620427 (0.0006) [2023-12-28 06:54:20,849][106226] Updated weights for policy 0, policy_version 1620437 (0.0008) [2023-12-28 06:54:20,989][106225] Updated weights for policy 1, policy_version 1624092 (0.0009) [2023-12-28 06:54:21,058][106225] Updated weights for policy 1, policy_version 1624102 (0.0008) [2023-12-28 06:54:21,124][106225] Updated weights for policy 1, policy_version 1624112 (0.0009) [2023-12-28 06:54:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 830726144. Throughput: 0: 9971.4, 1: 9878.0. Samples: 830740280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:21,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.829')] [2023-12-28 06:54:21,578][106226] Updated weights for policy 0, policy_version 1620447 (0.0007) [2023-12-28 06:54:21,640][106226] Updated weights for policy 0, policy_version 1620457 (0.0010) [2023-12-28 06:54:21,704][106226] Updated weights for policy 0, policy_version 1620467 (0.0011) [2023-12-28 06:54:21,996][106225] Updated weights for policy 1, policy_version 1624122 (0.0009) [2023-12-28 06:54:22,058][106225] Updated weights for policy 1, policy_version 1624132 (0.0008) [2023-12-28 06:54:22,112][106225] Updated weights for policy 1, policy_version 1624142 (0.0008) [2023-12-28 06:54:22,168][106225] Updated weights for policy 1, policy_version 1624152 (0.0009) [2023-12-28 06:54:22,446][106226] Updated weights for policy 0, policy_version 1620477 (0.0011) [2023-12-28 06:54:22,518][106226] Updated weights for policy 0, policy_version 1620487 (0.0011) [2023-12-28 06:54:22,584][106226] Updated weights for policy 0, policy_version 1620497 (0.0011) [2023-12-28 06:54:22,896][106225] Updated weights for policy 1, policy_version 1624162 (0.0007) [2023-12-28 06:54:22,957][106225] Updated weights for policy 1, policy_version 1624172 (0.0009) [2023-12-28 06:54:23,015][106225] Updated weights for policy 1, policy_version 1624182 (0.0010) [2023-12-28 06:54:23,236][106226] Updated weights for policy 0, policy_version 1620507 (0.0011) [2023-12-28 06:54:23,283][106226] Updated weights for policy 0, policy_version 1620517 (0.0010) [2023-12-28 06:54:23,331][106226] Updated weights for policy 0, policy_version 1620527 (0.0009) [2023-12-28 06:54:23,699][106225] Updated weights for policy 1, policy_version 1624192 (0.0006) [2023-12-28 06:54:23,762][106225] Updated weights for policy 1, policy_version 1624202 (0.0005) [2023-12-28 06:54:23,817][106225] Updated weights for policy 1, policy_version 1624212 (0.0005) [2023-12-28 06:54:23,979][106226] Updated weights for policy 0, policy_version 1620537 (0.0006) [2023-12-28 06:54:24,044][106226] Updated weights for policy 0, policy_version 1620547 (0.0008) [2023-12-28 06:54:24,107][106226] Updated weights for policy 0, policy_version 1620557 (0.0010) [2023-12-28 06:54:24,167][106226] Updated weights for policy 0, policy_version 1620567 (0.0011) [2023-12-28 06:54:24,474][106225] Updated weights for policy 1, policy_version 1624222 (0.0010) [2023-12-28 06:54:24,521][106225] Updated weights for policy 1, policy_version 1624232 (0.0010) [2023-12-28 06:54:24,589][106225] Updated weights for policy 1, policy_version 1624242 (0.0010) [2023-12-28 06:54:24,799][106226] Updated weights for policy 0, policy_version 1620577 (0.0008) [2023-12-28 06:54:24,852][106226] Updated weights for policy 0, policy_version 1620587 (0.0008) [2023-12-28 06:54:24,904][106226] Updated weights for policy 0, policy_version 1620597 (0.0006) [2023-12-28 06:54:25,244][106225] Updated weights for policy 1, policy_version 1624252 (0.0009) [2023-12-28 06:54:25,316][106225] Updated weights for policy 1, policy_version 1624262 (0.0008) [2023-12-28 06:54:25,382][106225] Updated weights for policy 1, policy_version 1624272 (0.0005) [2023-12-28 06:54:25,541][106226] Updated weights for policy 0, policy_version 1620607 (0.0007) [2023-12-28 06:54:25,587][106226] Updated weights for policy 0, policy_version 1620617 (0.0008) [2023-12-28 06:54:25,644][106226] Updated weights for policy 0, policy_version 1620627 (0.0006) [2023-12-28 06:54:25,970][106225] Updated weights for policy 1, policy_version 1624282 (0.0005) [2023-12-28 06:54:26,026][106225] Updated weights for policy 1, policy_version 1624292 (0.0005) [2023-12-28 06:54:26,074][106225] Updated weights for policy 1, policy_version 1624302 (0.0005) [2023-12-28 06:54:26,124][106225] Updated weights for policy 1, policy_version 1624312 (0.0009) [2023-12-28 06:54:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 830832640. Throughput: 0: 9924.2, 1: 9846.5. Samples: 830797548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:26,176][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.314')] [2023-12-28 06:54:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001620632_414957568.pth... [2023-12-28 06:54:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001624312_415875072.pth... [2023-12-28 06:54:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001623160_415580160.pth [2023-12-28 06:54:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001619480_414662656.pth [2023-12-28 06:54:26,372][106226] Updated weights for policy 0, policy_version 1620637 (0.0007) [2023-12-28 06:54:26,430][106226] Updated weights for policy 0, policy_version 1620647 (0.0008) [2023-12-28 06:54:26,484][106226] Updated weights for policy 0, policy_version 1620657 (0.0009) [2023-12-28 06:54:26,682][106225] Updated weights for policy 1, policy_version 1624322 (0.0009) [2023-12-28 06:54:26,730][106225] Updated weights for policy 1, policy_version 1624332 (0.0010) [2023-12-28 06:54:26,793][106225] Updated weights for policy 1, policy_version 1624342 (0.0010) [2023-12-28 06:54:27,171][106226] Updated weights for policy 0, policy_version 1620667 (0.0008) [2023-12-28 06:54:27,224][106226] Updated weights for policy 0, policy_version 1620677 (0.0005) [2023-12-28 06:54:27,274][106226] Updated weights for policy 0, policy_version 1620687 (0.0005) [2023-12-28 06:54:27,432][106225] Updated weights for policy 1, policy_version 1624352 (0.0010) [2023-12-28 06:54:27,478][106225] Updated weights for policy 1, policy_version 1624362 (0.0010) [2023-12-28 06:54:27,537][106225] Updated weights for policy 1, policy_version 1624372 (0.0010) [2023-12-28 06:54:27,911][106226] Updated weights for policy 0, policy_version 1620697 (0.0006) [2023-12-28 06:54:27,957][106226] Updated weights for policy 0, policy_version 1620707 (0.0007) [2023-12-28 06:54:28,006][106226] Updated weights for policy 0, policy_version 1620717 (0.0007) [2023-12-28 06:54:28,052][106226] Updated weights for policy 0, policy_version 1620727 (0.0007) [2023-12-28 06:54:28,233][106225] Updated weights for policy 1, policy_version 1624382 (0.0010) [2023-12-28 06:54:28,282][106225] Updated weights for policy 1, policy_version 1624392 (0.0010) [2023-12-28 06:54:28,343][106225] Updated weights for policy 1, policy_version 1624402 (0.0008) [2023-12-28 06:54:28,787][106226] Updated weights for policy 0, policy_version 1620737 (0.0008) [2023-12-28 06:54:28,837][106226] Updated weights for policy 0, policy_version 1620747 (0.0009) [2023-12-28 06:54:28,894][106226] Updated weights for policy 0, policy_version 1620757 (0.0009) [2023-12-28 06:54:28,980][106225] Updated weights for policy 1, policy_version 1624412 (0.0006) [2023-12-28 06:54:29,031][106225] Updated weights for policy 1, policy_version 1624422 (0.0008) [2023-12-28 06:54:29,075][106225] Updated weights for policy 1, policy_version 1624432 (0.0008) [2023-12-28 06:54:29,630][106226] Updated weights for policy 0, policy_version 1620767 (0.0010) [2023-12-28 06:54:29,681][106226] Updated weights for policy 0, policy_version 1620777 (0.0009) [2023-12-28 06:54:29,739][106226] Updated weights for policy 0, policy_version 1620787 (0.0006) [2023-12-28 06:54:29,805][106225] Updated weights for policy 1, policy_version 1624442 (0.0007) [2023-12-28 06:54:29,872][106225] Updated weights for policy 1, policy_version 1624452 (0.0009) [2023-12-28 06:54:29,931][106225] Updated weights for policy 1, policy_version 1624462 (0.0007) [2023-12-28 06:54:29,996][106225] Updated weights for policy 1, policy_version 1624472 (0.0008) [2023-12-28 06:54:30,354][106226] Updated weights for policy 0, policy_version 1620797 (0.0008) [2023-12-28 06:54:30,405][106226] Updated weights for policy 0, policy_version 1620807 (0.0010) [2023-12-28 06:54:30,458][106226] Updated weights for policy 0, policy_version 1620817 (0.0010) [2023-12-28 06:54:30,759][106225] Updated weights for policy 1, policy_version 1624482 (0.0005) [2023-12-28 06:54:30,820][106225] Updated weights for policy 1, policy_version 1624492 (0.0005) [2023-12-28 06:54:30,876][106225] Updated weights for policy 1, policy_version 1624502 (0.0005) [2023-12-28 06:54:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 830930944. Throughput: 0: 9927.5, 1: 9979.0. Samples: 830922772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:31,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-5.010')] [2023-12-28 06:54:31,177][106226] Updated weights for policy 0, policy_version 1620827 (0.0010) [2023-12-28 06:54:31,236][106226] Updated weights for policy 0, policy_version 1620837 (0.0005) [2023-12-28 06:54:31,302][106226] Updated weights for policy 0, policy_version 1620847 (0.0007) [2023-12-28 06:54:31,531][106225] Updated weights for policy 1, policy_version 1624512 (0.0008) [2023-12-28 06:54:31,592][106225] Updated weights for policy 1, policy_version 1624522 (0.0007) [2023-12-28 06:54:31,662][106225] Updated weights for policy 1, policy_version 1624532 (0.0008) [2023-12-28 06:54:32,019][106226] Updated weights for policy 0, policy_version 1620857 (0.0010) [2023-12-28 06:54:32,083][106226] Updated weights for policy 0, policy_version 1620867 (0.0009) [2023-12-28 06:54:32,140][106226] Updated weights for policy 0, policy_version 1620877 (0.0009) [2023-12-28 06:54:32,199][106226] Updated weights for policy 0, policy_version 1620887 (0.0009) [2023-12-28 06:54:32,390][106225] Updated weights for policy 1, policy_version 1624542 (0.0009) [2023-12-28 06:54:32,449][106225] Updated weights for policy 1, policy_version 1624552 (0.0009) [2023-12-28 06:54:32,506][106225] Updated weights for policy 1, policy_version 1624562 (0.0008) [2023-12-28 06:54:32,905][106226] Updated weights for policy 0, policy_version 1620897 (0.0006) [2023-12-28 06:54:32,960][106226] Updated weights for policy 0, policy_version 1620907 (0.0007) [2023-12-28 06:54:33,016][106226] Updated weights for policy 0, policy_version 1620917 (0.0008) [2023-12-28 06:54:33,204][106225] Updated weights for policy 1, policy_version 1624572 (0.0009) [2023-12-28 06:54:33,256][106225] Updated weights for policy 1, policy_version 1624582 (0.0009) [2023-12-28 06:54:33,308][106225] Updated weights for policy 1, policy_version 1624592 (0.0009) [2023-12-28 06:54:33,628][106226] Updated weights for policy 0, policy_version 1620927 (0.0008) [2023-12-28 06:54:33,689][106226] Updated weights for policy 0, policy_version 1620937 (0.0007) [2023-12-28 06:54:33,746][106226] Updated weights for policy 0, policy_version 1620947 (0.0007) [2023-12-28 06:54:33,987][106225] Updated weights for policy 1, policy_version 1624602 (0.0008) [2023-12-28 06:54:34,040][106225] Updated weights for policy 1, policy_version 1624612 (0.0007) [2023-12-28 06:54:34,100][106225] Updated weights for policy 1, policy_version 1624622 (0.0009) [2023-12-28 06:54:34,166][106225] Updated weights for policy 1, policy_version 1624632 (0.0008) [2023-12-28 06:54:34,442][106226] Updated weights for policy 0, policy_version 1620957 (0.0007) [2023-12-28 06:54:34,505][106226] Updated weights for policy 0, policy_version 1620967 (0.0009) [2023-12-28 06:54:34,572][106226] Updated weights for policy 0, policy_version 1620977 (0.0009) [2023-12-28 06:54:34,941][106225] Updated weights for policy 1, policy_version 1624642 (0.0008) [2023-12-28 06:54:34,985][106225] Updated weights for policy 1, policy_version 1624652 (0.0008) [2023-12-28 06:54:35,036][106225] Updated weights for policy 1, policy_version 1624662 (0.0008) [2023-12-28 06:54:35,256][106226] Updated weights for policy 0, policy_version 1620987 (0.0008) [2023-12-28 06:54:35,303][106226] Updated weights for policy 0, policy_version 1620997 (0.0009) [2023-12-28 06:54:35,349][106226] Updated weights for policy 0, policy_version 1621007 (0.0009) [2023-12-28 06:54:35,665][106225] Updated weights for policy 1, policy_version 1624672 (0.0006) [2023-12-28 06:54:35,717][106225] Updated weights for policy 1, policy_version 1624683 (0.0010) [2023-12-28 06:54:35,771][106225] Updated weights for policy 1, policy_version 1624694 (0.0009) [2023-12-28 06:54:35,932][106226] Updated weights for policy 0, policy_version 1621017 (0.0009) [2023-12-28 06:54:35,989][106226] Updated weights for policy 0, policy_version 1621027 (0.0009) [2023-12-28 06:54:36,051][106226] Updated weights for policy 0, policy_version 1621037 (0.0005) [2023-12-28 06:54:36,104][106226] Updated weights for policy 0, policy_version 1621047 (0.0008) [2023-12-28 06:54:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 831037440. Throughput: 0: 10019.5, 1: 10035.1. Samples: 831043888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:36,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.494')] [2023-12-28 06:54:36,479][106225] Updated weights for policy 1, policy_version 1624704 (0.0008) [2023-12-28 06:54:36,536][106225] Updated weights for policy 1, policy_version 1624714 (0.0009) [2023-12-28 06:54:36,592][106225] Updated weights for policy 1, policy_version 1624724 (0.0006) [2023-12-28 06:54:36,848][106226] Updated weights for policy 0, policy_version 1621057 (0.0008) [2023-12-28 06:54:36,906][106226] Updated weights for policy 0, policy_version 1621067 (0.0008) [2023-12-28 06:54:36,967][106226] Updated weights for policy 0, policy_version 1621077 (0.0008) [2023-12-28 06:54:37,210][106225] Updated weights for policy 1, policy_version 1624734 (0.0005) [2023-12-28 06:54:37,265][106225] Updated weights for policy 1, policy_version 1624744 (0.0005) [2023-12-28 06:54:37,320][106225] Updated weights for policy 1, policy_version 1624754 (0.0005) [2023-12-28 06:54:37,646][106226] Updated weights for policy 0, policy_version 1621087 (0.0006) [2023-12-28 06:54:37,711][106226] Updated weights for policy 0, policy_version 1621097 (0.0006) [2023-12-28 06:54:37,780][106226] Updated weights for policy 0, policy_version 1621107 (0.0005) [2023-12-28 06:54:37,855][106225] Updated weights for policy 1, policy_version 1624764 (0.0006) [2023-12-28 06:54:37,915][106225] Updated weights for policy 1, policy_version 1624774 (0.0005) [2023-12-28 06:54:37,974][106225] Updated weights for policy 1, policy_version 1624784 (0.0008) [2023-12-28 06:54:38,502][106226] Updated weights for policy 0, policy_version 1621117 (0.0007) [2023-12-28 06:54:38,564][106226] Updated weights for policy 0, policy_version 1621127 (0.0008) [2023-12-28 06:54:38,633][106226] Updated weights for policy 0, policy_version 1621137 (0.0009) [2023-12-28 06:54:38,643][106225] Updated weights for policy 1, policy_version 1624794 (0.0007) [2023-12-28 06:54:38,706][106225] Updated weights for policy 1, policy_version 1624804 (0.0007) [2023-12-28 06:54:38,761][106225] Updated weights for policy 1, policy_version 1624814 (0.0009) [2023-12-28 06:54:38,821][106225] Updated weights for policy 1, policy_version 1624824 (0.0009) [2023-12-28 06:54:39,354][106226] Updated weights for policy 0, policy_version 1621147 (0.0008) [2023-12-28 06:54:39,417][106226] Updated weights for policy 0, policy_version 1621157 (0.0008) [2023-12-28 06:54:39,480][106226] Updated weights for policy 0, policy_version 1621167 (0.0009) [2023-12-28 06:54:39,611][106225] Updated weights for policy 1, policy_version 1624834 (0.0008) [2023-12-28 06:54:39,670][106225] Updated weights for policy 1, policy_version 1624844 (0.0008) [2023-12-28 06:54:39,736][106225] Updated weights for policy 1, policy_version 1624854 (0.0009) [2023-12-28 06:54:40,236][106226] Updated weights for policy 0, policy_version 1621177 (0.0010) [2023-12-28 06:54:40,298][106226] Updated weights for policy 0, policy_version 1621187 (0.0009) [2023-12-28 06:54:40,367][106226] Updated weights for policy 0, policy_version 1621197 (0.0009) [2023-12-28 06:54:40,424][106226] Updated weights for policy 0, policy_version 1621207 (0.0009) [2023-12-28 06:54:40,475][106225] Updated weights for policy 1, policy_version 1624864 (0.0008) [2023-12-28 06:54:40,524][106225] Updated weights for policy 1, policy_version 1624874 (0.0007) [2023-12-28 06:54:40,576][106225] Updated weights for policy 1, policy_version 1624884 (0.0007) [2023-12-28 06:54:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 831127552. Throughput: 0: 9990.0, 1: 10089.3. Samples: 831104824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:41,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.921')] [2023-12-28 06:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001624888_416022528.pth... [2023-12-28 06:54:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001623736_415727616.pth [2023-12-28 06:54:41,194][106226] Updated weights for policy 0, policy_version 1621217 (0.0009) [2023-12-28 06:54:41,253][106226] Updated weights for policy 0, policy_version 1621227 (0.0007) [2023-12-28 06:54:41,321][106226] Updated weights for policy 0, policy_version 1621237 (0.0006) [2023-12-28 06:54:41,341][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001621240_415113216.pth... [2023-12-28 06:54:41,345][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001620056_414810112.pth [2023-12-28 06:54:41,353][106225] Updated weights for policy 1, policy_version 1624894 (0.0009) [2023-12-28 06:54:41,424][106225] Updated weights for policy 1, policy_version 1624904 (0.0009) [2023-12-28 06:54:41,478][106225] Updated weights for policy 1, policy_version 1624914 (0.0010) [2023-12-28 06:54:41,939][106226] Updated weights for policy 0, policy_version 1621247 (0.0008) [2023-12-28 06:54:42,000][106226] Updated weights for policy 0, policy_version 1621257 (0.0009) [2023-12-28 06:54:42,062][106226] Updated weights for policy 0, policy_version 1621267 (0.0008) [2023-12-28 06:54:42,340][106225] Updated weights for policy 1, policy_version 1624924 (0.0009) [2023-12-28 06:54:42,419][106225] Updated weights for policy 1, policy_version 1624934 (0.0008) [2023-12-28 06:54:42,483][106225] Updated weights for policy 1, policy_version 1624944 (0.0008) [2023-12-28 06:54:42,784][106226] Updated weights for policy 0, policy_version 1621277 (0.0008) [2023-12-28 06:54:42,836][106226] Updated weights for policy 0, policy_version 1621287 (0.0009) [2023-12-28 06:54:42,891][106226] Updated weights for policy 0, policy_version 1621297 (0.0009) [2023-12-28 06:54:43,143][106225] Updated weights for policy 1, policy_version 1624954 (0.0008) [2023-12-28 06:54:43,194][106225] Updated weights for policy 1, policy_version 1624964 (0.0005) [2023-12-28 06:54:43,252][106225] Updated weights for policy 1, policy_version 1624974 (0.0005) [2023-12-28 06:54:43,318][106225] Updated weights for policy 1, policy_version 1624984 (0.0008) [2023-12-28 06:54:43,669][106226] Updated weights for policy 0, policy_version 1621307 (0.0009) [2023-12-28 06:54:43,718][106226] Updated weights for policy 0, policy_version 1621317 (0.0008) [2023-12-28 06:54:43,764][106226] Updated weights for policy 0, policy_version 1621327 (0.0007) [2023-12-28 06:54:43,979][106225] Updated weights for policy 1, policy_version 1624994 (0.0009) [2023-12-28 06:54:44,036][106225] Updated weights for policy 1, policy_version 1625004 (0.0008) [2023-12-28 06:54:44,084][106225] Updated weights for policy 1, policy_version 1625014 (0.0008) [2023-12-28 06:54:44,458][106226] Updated weights for policy 0, policy_version 1621337 (0.0008) [2023-12-28 06:54:44,515][106226] Updated weights for policy 0, policy_version 1621347 (0.0010) [2023-12-28 06:54:44,579][106226] Updated weights for policy 0, policy_version 1621357 (0.0011) [2023-12-28 06:54:44,642][106226] Updated weights for policy 0, policy_version 1621367 (0.0011) [2023-12-28 06:54:44,810][106225] Updated weights for policy 1, policy_version 1625024 (0.0008) [2023-12-28 06:54:44,876][106225] Updated weights for policy 1, policy_version 1625034 (0.0007) [2023-12-28 06:54:44,939][106225] Updated weights for policy 1, policy_version 1625044 (0.0007) [2023-12-28 06:54:45,382][106226] Updated weights for policy 0, policy_version 1621377 (0.0011) [2023-12-28 06:54:45,442][106226] Updated weights for policy 0, policy_version 1621387 (0.0011) [2023-12-28 06:54:45,502][106226] Updated weights for policy 0, policy_version 1621397 (0.0009) [2023-12-28 06:54:45,555][106225] Updated weights for policy 1, policy_version 1625054 (0.0008) [2023-12-28 06:54:45,606][106225] Updated weights for policy 1, policy_version 1625064 (0.0010) [2023-12-28 06:54:45,661][106225] Updated weights for policy 1, policy_version 1625074 (0.0006) [2023-12-28 06:54:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 831225856. Throughput: 0: 9963.2, 1: 9907.5. Samples: 831218692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:46,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.770')] [2023-12-28 06:54:46,269][106226] Updated weights for policy 0, policy_version 1621407 (0.0010) [2023-12-28 06:54:46,283][106225] Updated weights for policy 1, policy_version 1625084 (0.0008) [2023-12-28 06:54:46,327][106226] Updated weights for policy 0, policy_version 1621417 (0.0008) [2023-12-28 06:54:46,345][106225] Updated weights for policy 1, policy_version 1625094 (0.0007) [2023-12-28 06:54:46,389][106226] Updated weights for policy 0, policy_version 1621427 (0.0007) [2023-12-28 06:54:46,402][106225] Updated weights for policy 1, policy_version 1625104 (0.0006) [2023-12-28 06:54:47,082][106225] Updated weights for policy 1, policy_version 1625114 (0.0007) [2023-12-28 06:54:47,097][106226] Updated weights for policy 0, policy_version 1621437 (0.0009) [2023-12-28 06:54:47,149][106225] Updated weights for policy 1, policy_version 1625124 (0.0008) [2023-12-28 06:54:47,151][106226] Updated weights for policy 0, policy_version 1621447 (0.0006) [2023-12-28 06:54:47,204][106226] Updated weights for policy 0, policy_version 1621457 (0.0007) [2023-12-28 06:54:47,207][106225] Updated weights for policy 1, policy_version 1625134 (0.0006) [2023-12-28 06:54:47,252][106225] Updated weights for policy 1, policy_version 1625144 (0.0005) [2023-12-28 06:54:47,771][106225] Updated weights for policy 1, policy_version 1625154 (0.0006) [2023-12-28 06:54:47,818][106225] Updated weights for policy 1, policy_version 1625164 (0.0008) [2023-12-28 06:54:47,869][106225] Updated weights for policy 1, policy_version 1625174 (0.0005) [2023-12-28 06:54:48,022][106226] Updated weights for policy 0, policy_version 1621467 (0.0008) [2023-12-28 06:54:48,091][106226] Updated weights for policy 0, policy_version 1621477 (0.0008) [2023-12-28 06:54:48,152][106226] Updated weights for policy 0, policy_version 1621487 (0.0008) [2023-12-28 06:54:48,543][106225] Updated weights for policy 1, policy_version 1625184 (0.0008) [2023-12-28 06:54:48,602][106225] Updated weights for policy 1, policy_version 1625194 (0.0008) [2023-12-28 06:54:48,664][106225] Updated weights for policy 1, policy_version 1625204 (0.0008) [2023-12-28 06:54:48,865][106226] Updated weights for policy 0, policy_version 1621497 (0.0008) [2023-12-28 06:54:48,935][106226] Updated weights for policy 0, policy_version 1621507 (0.0009) [2023-12-28 06:54:48,990][106226] Updated weights for policy 0, policy_version 1621517 (0.0007) [2023-12-28 06:54:49,040][106226] Updated weights for policy 0, policy_version 1621527 (0.0009) [2023-12-28 06:54:49,361][106225] Updated weights for policy 1, policy_version 1625214 (0.0008) [2023-12-28 06:54:49,426][106225] Updated weights for policy 1, policy_version 1625224 (0.0008) [2023-12-28 06:54:49,484][106225] Updated weights for policy 1, policy_version 1625234 (0.0008) [2023-12-28 06:54:49,744][106226] Updated weights for policy 0, policy_version 1621537 (0.0009) [2023-12-28 06:54:49,806][106226] Updated weights for policy 0, policy_version 1621547 (0.0009) [2023-12-28 06:54:49,871][106226] Updated weights for policy 0, policy_version 1621557 (0.0008) [2023-12-28 06:54:50,304][106225] Updated weights for policy 1, policy_version 1625244 (0.0009) [2023-12-28 06:54:50,373][106225] Updated weights for policy 1, policy_version 1625254 (0.0008) [2023-12-28 06:54:50,435][106225] Updated weights for policy 1, policy_version 1625264 (0.0009) [2023-12-28 06:54:50,648][106226] Updated weights for policy 0, policy_version 1621567 (0.0008) [2023-12-28 06:54:50,709][106226] Updated weights for policy 0, policy_version 1621577 (0.0008) [2023-12-28 06:54:50,766][106226] Updated weights for policy 0, policy_version 1621587 (0.0009) [2023-12-28 06:54:51,098][106225] Updated weights for policy 1, policy_version 1625274 (0.0007) [2023-12-28 06:54:51,169][106225] Updated weights for policy 1, policy_version 1625284 (0.0008) [2023-12-28 06:54:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 831324160. Throughput: 0: 9872.3, 1: 9924.8. Samples: 831336176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:51,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.700')] [2023-12-28 06:54:51,226][106225] Updated weights for policy 1, policy_version 1625294 (0.0008) [2023-12-28 06:54:51,293][106225] Updated weights for policy 1, policy_version 1625304 (0.0008) [2023-12-28 06:54:51,563][106226] Updated weights for policy 0, policy_version 1621597 (0.0009) [2023-12-28 06:54:51,634][106226] Updated weights for policy 0, policy_version 1621607 (0.0008) [2023-12-28 06:54:51,702][106226] Updated weights for policy 0, policy_version 1621617 (0.0009) [2023-12-28 06:54:52,031][106225] Updated weights for policy 1, policy_version 1625314 (0.0006) [2023-12-28 06:54:52,080][106225] Updated weights for policy 1, policy_version 1625324 (0.0006) [2023-12-28 06:54:52,133][106225] Updated weights for policy 1, policy_version 1625334 (0.0006) [2023-12-28 06:54:52,518][106226] Updated weights for policy 0, policy_version 1621627 (0.0009) [2023-12-28 06:54:52,589][106226] Updated weights for policy 0, policy_version 1621637 (0.0009) [2023-12-28 06:54:52,658][106226] Updated weights for policy 0, policy_version 1621647 (0.0011) [2023-12-28 06:54:52,726][106225] Updated weights for policy 1, policy_version 1625344 (0.0006) [2023-12-28 06:54:52,777][106225] Updated weights for policy 1, policy_version 1625354 (0.0006) [2023-12-28 06:54:52,830][106225] Updated weights for policy 1, policy_version 1625364 (0.0005) [2023-12-28 06:54:53,321][106226] Updated weights for policy 0, policy_version 1621657 (0.0010) [2023-12-28 06:54:53,382][106226] Updated weights for policy 0, policy_version 1621667 (0.0006) [2023-12-28 06:54:53,445][106226] Updated weights for policy 0, policy_version 1621677 (0.0008) [2023-12-28 06:54:53,510][106225] Updated weights for policy 1, policy_version 1625374 (0.0007) [2023-12-28 06:54:53,512][106226] Updated weights for policy 0, policy_version 1621687 (0.0006) [2023-12-28 06:54:53,557][106225] Updated weights for policy 1, policy_version 1625384 (0.0008) [2023-12-28 06:54:53,622][106225] Updated weights for policy 1, policy_version 1625394 (0.0005) [2023-12-28 06:54:54,121][106226] Updated weights for policy 0, policy_version 1621697 (0.0006) [2023-12-28 06:54:54,190][106226] Updated weights for policy 0, policy_version 1621707 (0.0006) [2023-12-28 06:54:54,208][106225] Updated weights for policy 1, policy_version 1625404 (0.0006) [2023-12-28 06:54:54,244][106226] Updated weights for policy 0, policy_version 1621717 (0.0008) [2023-12-28 06:54:54,270][106225] Updated weights for policy 1, policy_version 1625414 (0.0008) [2023-12-28 06:54:54,330][106225] Updated weights for policy 1, policy_version 1625424 (0.0008) [2023-12-28 06:54:54,890][106226] Updated weights for policy 0, policy_version 1621727 (0.0009) [2023-12-28 06:54:54,941][106226] Updated weights for policy 0, policy_version 1621737 (0.0010) [2023-12-28 06:54:54,969][106225] Updated weights for policy 1, policy_version 1625434 (0.0008) [2023-12-28 06:54:55,006][106226] Updated weights for policy 0, policy_version 1621747 (0.0011) [2023-12-28 06:54:55,032][106225] Updated weights for policy 1, policy_version 1625444 (0.0009) [2023-12-28 06:54:55,093][106225] Updated weights for policy 1, policy_version 1625454 (0.0010) [2023-12-28 06:54:55,159][106225] Updated weights for policy 1, policy_version 1625464 (0.0010) [2023-12-28 06:54:55,694][106226] Updated weights for policy 0, policy_version 1621757 (0.0010) [2023-12-28 06:54:55,758][106226] Updated weights for policy 0, policy_version 1621767 (0.0011) [2023-12-28 06:54:55,816][106226] Updated weights for policy 0, policy_version 1621777 (0.0011) [2023-12-28 06:54:55,847][106225] Updated weights for policy 1, policy_version 1625474 (0.0010) [2023-12-28 06:54:55,894][106225] Updated weights for policy 1, policy_version 1625484 (0.0010) [2023-12-28 06:54:55,944][106225] Updated weights for policy 1, policy_version 1625494 (0.0010) [2023-12-28 06:54:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 831430656. Throughput: 0: 9810.1, 1: 9981.0. Samples: 831396264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:54:56,176][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.617')] [2023-12-28 06:54:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001625496_416178176.pth... [2023-12-28 06:54:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001621784_415252480.pth... [2023-12-28 06:54:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001624312_415875072.pth [2023-12-28 06:54:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001620632_414957568.pth [2023-12-28 06:54:56,496][106226] Updated weights for policy 0, policy_version 1621787 (0.0010) [2023-12-28 06:54:56,559][106226] Updated weights for policy 0, policy_version 1621797 (0.0010) [2023-12-28 06:54:56,625][106226] Updated weights for policy 0, policy_version 1621807 (0.0010) [2023-12-28 06:54:56,668][106225] Updated weights for policy 1, policy_version 1625504 (0.0006) [2023-12-28 06:54:56,722][106225] Updated weights for policy 1, policy_version 1625514 (0.0007) [2023-12-28 06:54:56,775][106225] Updated weights for policy 1, policy_version 1625524 (0.0008) [2023-12-28 06:54:57,285][106226] Updated weights for policy 0, policy_version 1621817 (0.0010) [2023-12-28 06:54:57,346][106226] Updated weights for policy 0, policy_version 1621827 (0.0008) [2023-12-28 06:54:57,401][106226] Updated weights for policy 0, policy_version 1621837 (0.0010) [2023-12-28 06:54:57,462][106226] Updated weights for policy 0, policy_version 1621847 (0.0010) [2023-12-28 06:54:57,512][106225] Updated weights for policy 1, policy_version 1625534 (0.0010) [2023-12-28 06:54:57,571][106225] Updated weights for policy 1, policy_version 1625544 (0.0010) [2023-12-28 06:54:57,623][106225] Updated weights for policy 1, policy_version 1625554 (0.0010) [2023-12-28 06:54:58,161][106226] Updated weights for policy 0, policy_version 1621857 (0.0010) [2023-12-28 06:54:58,216][106226] Updated weights for policy 0, policy_version 1621867 (0.0009) [2023-12-28 06:54:58,283][106226] Updated weights for policy 0, policy_version 1621877 (0.0010) [2023-12-28 06:54:58,329][106225] Updated weights for policy 1, policy_version 1625564 (0.0009) [2023-12-28 06:54:58,392][106225] Updated weights for policy 1, policy_version 1625574 (0.0008) [2023-12-28 06:54:58,463][106225] Updated weights for policy 1, policy_version 1625584 (0.0008) [2023-12-28 06:54:59,106][106226] Updated weights for policy 0, policy_version 1621887 (0.0010) [2023-12-28 06:54:59,162][106226] Updated weights for policy 0, policy_version 1621897 (0.0009) [2023-12-28 06:54:59,208][106226] Updated weights for policy 0, policy_version 1621907 (0.0010) [2023-12-28 06:54:59,304][106225] Updated weights for policy 1, policy_version 1625594 (0.0008) [2023-12-28 06:54:59,370][106225] Updated weights for policy 1, policy_version 1625604 (0.0008) [2023-12-28 06:54:59,429][106225] Updated weights for policy 1, policy_version 1625614 (0.0009) [2023-12-28 06:54:59,487][106225] Updated weights for policy 1, policy_version 1625624 (0.0008) [2023-12-28 06:54:59,916][106226] Updated weights for policy 0, policy_version 1621917 (0.0009) [2023-12-28 06:54:59,986][106226] Updated weights for policy 0, policy_version 1621927 (0.0013) [2023-12-28 06:55:00,045][106226] Updated weights for policy 0, policy_version 1621937 (0.0008) [2023-12-28 06:55:00,284][106225] Updated weights for policy 1, policy_version 1625634 (0.0007) [2023-12-28 06:55:00,345][106225] Updated weights for policy 1, policy_version 1625644 (0.0008) [2023-12-28 06:55:00,397][106225] Updated weights for policy 1, policy_version 1625654 (0.0008) [2023-12-28 06:55:00,801][106226] Updated weights for policy 0, policy_version 1621947 (0.0010) [2023-12-28 06:55:00,864][106226] Updated weights for policy 0, policy_version 1621957 (0.0009) [2023-12-28 06:55:00,925][106226] Updated weights for policy 0, policy_version 1621967 (0.0010) [2023-12-28 06:55:01,011][106225] Updated weights for policy 1, policy_version 1625664 (0.0008) [2023-12-28 06:55:01,077][106225] Updated weights for policy 1, policy_version 1625674 (0.0008) [2023-12-28 06:55:01,141][106225] Updated weights for policy 1, policy_version 1625684 (0.0011) [2023-12-28 06:55:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 831528960. Throughput: 0: 9835.7, 1: 9980.8. Samples: 831513848. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:01,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.975')] [2023-12-28 06:55:01,653][106226] Updated weights for policy 0, policy_version 1621977 (0.0007) [2023-12-28 06:55:01,726][106226] Updated weights for policy 0, policy_version 1621987 (0.0007) [2023-12-28 06:55:01,787][106226] Updated weights for policy 0, policy_version 1621997 (0.0010) [2023-12-28 06:55:01,844][106226] Updated weights for policy 0, policy_version 1622007 (0.0008) [2023-12-28 06:55:01,877][106225] Updated weights for policy 1, policy_version 1625694 (0.0009) [2023-12-28 06:55:01,935][106225] Updated weights for policy 1, policy_version 1625704 (0.0010) [2023-12-28 06:55:01,992][106225] Updated weights for policy 1, policy_version 1625714 (0.0010) [2023-12-28 06:55:02,607][106226] Updated weights for policy 0, policy_version 1622017 (0.0008) [2023-12-28 06:55:02,641][106225] Updated weights for policy 1, policy_version 1625724 (0.0008) [2023-12-28 06:55:02,668][106226] Updated weights for policy 0, policy_version 1622027 (0.0007) [2023-12-28 06:55:02,691][106225] Updated weights for policy 1, policy_version 1625734 (0.0006) [2023-12-28 06:55:02,731][106226] Updated weights for policy 0, policy_version 1622037 (0.0009) [2023-12-28 06:55:02,749][106225] Updated weights for policy 1, policy_version 1625744 (0.0005) [2023-12-28 06:55:03,428][106225] Updated weights for policy 1, policy_version 1625754 (0.0008) [2023-12-28 06:55:03,456][106226] Updated weights for policy 0, policy_version 1622047 (0.0008) [2023-12-28 06:55:03,481][106225] Updated weights for policy 1, policy_version 1625764 (0.0005) [2023-12-28 06:55:03,511][106226] Updated weights for policy 0, policy_version 1622057 (0.0009) [2023-12-28 06:55:03,535][106225] Updated weights for policy 1, policy_version 1625774 (0.0006) [2023-12-28 06:55:03,560][106226] Updated weights for policy 0, policy_version 1622067 (0.0009) [2023-12-28 06:55:03,589][106225] Updated weights for policy 1, policy_version 1625784 (0.0007) [2023-12-28 06:55:04,235][106226] Updated weights for policy 0, policy_version 1622077 (0.0006) [2023-12-28 06:55:04,288][106225] Updated weights for policy 1, policy_version 1625794 (0.0007) [2023-12-28 06:55:04,298][106226] Updated weights for policy 0, policy_version 1622087 (0.0008) [2023-12-28 06:55:04,355][106225] Updated weights for policy 1, policy_version 1625804 (0.0008) [2023-12-28 06:55:04,379][106226] Updated weights for policy 0, policy_version 1622097 (0.0006) [2023-12-28 06:55:04,420][106225] Updated weights for policy 1, policy_version 1625814 (0.0008) [2023-12-28 06:55:05,088][106225] Updated weights for policy 1, policy_version 1625824 (0.0008) [2023-12-28 06:55:05,097][106226] Updated weights for policy 0, policy_version 1622107 (0.0007) [2023-12-28 06:55:05,146][106225] Updated weights for policy 1, policy_version 1625834 (0.0005) [2023-12-28 06:55:05,151][106226] Updated weights for policy 0, policy_version 1622117 (0.0008) [2023-12-28 06:55:05,200][106225] Updated weights for policy 1, policy_version 1625844 (0.0005) [2023-12-28 06:55:05,202][106226] Updated weights for policy 0, policy_version 1622127 (0.0007) [2023-12-28 06:55:05,792][106225] Updated weights for policy 1, policy_version 1625854 (0.0005) [2023-12-28 06:55:05,844][106225] Updated weights for policy 1, policy_version 1625864 (0.0005) [2023-12-28 06:55:05,910][106225] Updated weights for policy 1, policy_version 1625874 (0.0008) [2023-12-28 06:55:05,998][106226] Updated weights for policy 0, policy_version 1622137 (0.0008) [2023-12-28 06:55:06,048][106226] Updated weights for policy 0, policy_version 1622147 (0.0007) [2023-12-28 06:55:06,109][106226] Updated weights for policy 0, policy_version 1622157 (0.0006) [2023-12-28 06:55:06,172][106226] Updated weights for policy 0, policy_version 1622167 (0.0006) [2023-12-28 06:55:06,174][105115] Fps is (10 sec: 18842.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 831619072. Throughput: 0: 9737.4, 1: 10070.7. Samples: 831631644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:06,175][105115] Avg episode reward: [(0, '-4.969'), (1, '-4.712')] [2023-12-28 06:55:06,610][106225] Updated weights for policy 1, policy_version 1625884 (0.0007) [2023-12-28 06:55:06,673][106225] Updated weights for policy 1, policy_version 1625894 (0.0007) [2023-12-28 06:55:06,726][106225] Updated weights for policy 1, policy_version 1625904 (0.0009) [2023-12-28 06:55:06,868][106226] Updated weights for policy 0, policy_version 1622177 (0.0008) [2023-12-28 06:55:06,923][106226] Updated weights for policy 0, policy_version 1622187 (0.0009) [2023-12-28 06:55:06,971][106226] Updated weights for policy 0, policy_version 1622197 (0.0008) [2023-12-28 06:55:07,401][106225] Updated weights for policy 1, policy_version 1625914 (0.0009) [2023-12-28 06:55:07,458][106225] Updated weights for policy 1, policy_version 1625924 (0.0008) [2023-12-28 06:55:07,519][106225] Updated weights for policy 1, policy_version 1625934 (0.0008) [2023-12-28 06:55:07,584][106225] Updated weights for policy 1, policy_version 1625944 (0.0009) [2023-12-28 06:55:07,699][106226] Updated weights for policy 0, policy_version 1622207 (0.0009) [2023-12-28 06:55:07,756][106226] Updated weights for policy 0, policy_version 1622217 (0.0008) [2023-12-28 06:55:07,808][106226] Updated weights for policy 0, policy_version 1622227 (0.0008) [2023-12-28 06:55:08,238][106225] Updated weights for policy 1, policy_version 1625954 (0.0007) [2023-12-28 06:55:08,289][106225] Updated weights for policy 1, policy_version 1625964 (0.0007) [2023-12-28 06:55:08,347][106225] Updated weights for policy 1, policy_version 1625974 (0.0007) [2023-12-28 06:55:08,561][106226] Updated weights for policy 0, policy_version 1622237 (0.0009) [2023-12-28 06:55:08,618][106226] Updated weights for policy 0, policy_version 1622247 (0.0006) [2023-12-28 06:55:08,670][106226] Updated weights for policy 0, policy_version 1622257 (0.0005) [2023-12-28 06:55:09,037][106225] Updated weights for policy 1, policy_version 1625984 (0.0008) [2023-12-28 06:55:09,089][106225] Updated weights for policy 1, policy_version 1625994 (0.0008) [2023-12-28 06:55:09,147][106225] Updated weights for policy 1, policy_version 1626004 (0.0009) [2023-12-28 06:55:09,334][106226] Updated weights for policy 0, policy_version 1622267 (0.0006) [2023-12-28 06:55:09,397][106226] Updated weights for policy 0, policy_version 1622277 (0.0009) [2023-12-28 06:55:09,461][106226] Updated weights for policy 0, policy_version 1622287 (0.0009) [2023-12-28 06:55:09,930][106225] Updated weights for policy 1, policy_version 1626014 (0.0008) [2023-12-28 06:55:09,996][106225] Updated weights for policy 1, policy_version 1626024 (0.0008) [2023-12-28 06:55:10,056][106225] Updated weights for policy 1, policy_version 1626034 (0.0008) [2023-12-28 06:55:10,161][106226] Updated weights for policy 0, policy_version 1622297 (0.0008) [2023-12-28 06:55:10,221][106226] Updated weights for policy 0, policy_version 1622307 (0.0009) [2023-12-28 06:55:10,281][106226] Updated weights for policy 0, policy_version 1622317 (0.0009) [2023-12-28 06:55:10,345][106226] Updated weights for policy 0, policy_version 1622327 (0.0007) [2023-12-28 06:55:10,772][106225] Updated weights for policy 1, policy_version 1626044 (0.0008) [2023-12-28 06:55:10,835][106225] Updated weights for policy 1, policy_version 1626054 (0.0008) [2023-12-28 06:55:10,893][106225] Updated weights for policy 1, policy_version 1626064 (0.0008) [2023-12-28 06:55:11,098][106226] Updated weights for policy 0, policy_version 1622337 (0.0010) [2023-12-28 06:55:11,165][106226] Updated weights for policy 0, policy_version 1622347 (0.0008) [2023-12-28 06:55:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 831717376. Throughput: 0: 9735.8, 1: 10134.1. Samples: 831691688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:11,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.699')] [2023-12-28 06:55:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001626072_416325632.pth... [2023-12-28 06:55:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001624888_416022528.pth [2023-12-28 06:55:11,227][106226] Updated weights for policy 0, policy_version 1622357 (0.0008) [2023-12-28 06:55:11,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001622360_415399936.pth... [2023-12-28 06:55:11,254][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001621240_415113216.pth [2023-12-28 06:55:11,670][106225] Updated weights for policy 1, policy_version 1626074 (0.0009) [2023-12-28 06:55:11,744][106225] Updated weights for policy 1, policy_version 1626084 (0.0010) [2023-12-28 06:55:11,801][106225] Updated weights for policy 1, policy_version 1626094 (0.0010) [2023-12-28 06:55:11,853][106225] Updated weights for policy 1, policy_version 1626104 (0.0010) [2023-12-28 06:55:12,000][106226] Updated weights for policy 0, policy_version 1622367 (0.0007) [2023-12-28 06:55:12,058][106226] Updated weights for policy 0, policy_version 1622377 (0.0008) [2023-12-28 06:55:12,114][106226] Updated weights for policy 0, policy_version 1622387 (0.0008) [2023-12-28 06:55:12,601][106225] Updated weights for policy 1, policy_version 1626114 (0.0009) [2023-12-28 06:55:12,666][106225] Updated weights for policy 1, policy_version 1626124 (0.0008) [2023-12-28 06:55:12,731][106225] Updated weights for policy 1, policy_version 1626134 (0.0008) [2023-12-28 06:55:12,873][106226] Updated weights for policy 0, policy_version 1622397 (0.0007) [2023-12-28 06:55:12,942][106226] Updated weights for policy 0, policy_version 1622407 (0.0009) [2023-12-28 06:55:13,002][106226] Updated weights for policy 0, policy_version 1622417 (0.0006) [2023-12-28 06:55:13,332][106225] Updated weights for policy 1, policy_version 1626144 (0.0006) [2023-12-28 06:55:13,383][106225] Updated weights for policy 1, policy_version 1626154 (0.0009) [2023-12-28 06:55:13,433][106225] Updated weights for policy 1, policy_version 1626164 (0.0010) [2023-12-28 06:55:13,646][106226] Updated weights for policy 0, policy_version 1622427 (0.0006) [2023-12-28 06:55:13,696][106226] Updated weights for policy 0, policy_version 1622437 (0.0008) [2023-12-28 06:55:13,748][106226] Updated weights for policy 0, policy_version 1622447 (0.0007) [2023-12-28 06:55:14,056][106225] Updated weights for policy 1, policy_version 1626174 (0.0009) [2023-12-28 06:55:14,117][106225] Updated weights for policy 1, policy_version 1626184 (0.0009) [2023-12-28 06:55:14,175][106225] Updated weights for policy 1, policy_version 1626194 (0.0008) [2023-12-28 06:55:14,548][106226] Updated weights for policy 0, policy_version 1622457 (0.0008) [2023-12-28 06:55:14,600][106226] Updated weights for policy 0, policy_version 1622467 (0.0009) [2023-12-28 06:55:14,654][106226] Updated weights for policy 0, policy_version 1622477 (0.0009) [2023-12-28 06:55:14,711][106226] Updated weights for policy 0, policy_version 1622487 (0.0008) [2023-12-28 06:55:14,805][106225] Updated weights for policy 1, policy_version 1626204 (0.0007) [2023-12-28 06:55:14,866][106225] Updated weights for policy 1, policy_version 1626214 (0.0008) [2023-12-28 06:55:14,931][106225] Updated weights for policy 1, policy_version 1626224 (0.0008) [2023-12-28 06:55:15,540][106225] Updated weights for policy 1, policy_version 1626234 (0.0006) [2023-12-28 06:55:15,545][106226] Updated weights for policy 0, policy_version 1622497 (0.0009) [2023-12-28 06:55:15,603][106225] Updated weights for policy 1, policy_version 1626244 (0.0006) [2023-12-28 06:55:15,607][106226] Updated weights for policy 0, policy_version 1622507 (0.0008) [2023-12-28 06:55:15,648][106225] Updated weights for policy 1, policy_version 1626254 (0.0008) [2023-12-28 06:55:15,673][106226] Updated weights for policy 0, policy_version 1622517 (0.0007) [2023-12-28 06:55:15,699][106225] Updated weights for policy 1, policy_version 1626264 (0.0005) [2023-12-28 06:55:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 831815680. Throughput: 0: 9621.0, 1: 10014.7. Samples: 831806380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:16,176][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.545')] [2023-12-28 06:55:16,316][106225] Updated weights for policy 1, policy_version 1626274 (0.0010) [2023-12-28 06:55:16,380][106225] Updated weights for policy 1, policy_version 1626284 (0.0008) [2023-12-28 06:55:16,430][106225] Updated weights for policy 1, policy_version 1626294 (0.0010) [2023-12-28 06:55:16,444][106226] Updated weights for policy 0, policy_version 1622527 (0.0006) [2023-12-28 06:55:16,504][106226] Updated weights for policy 0, policy_version 1622537 (0.0008) [2023-12-28 06:55:16,563][106226] Updated weights for policy 0, policy_version 1622547 (0.0007) [2023-12-28 06:55:17,127][106225] Updated weights for policy 1, policy_version 1626304 (0.0010) [2023-12-28 06:55:17,182][106225] Updated weights for policy 1, policy_version 1626314 (0.0009) [2023-12-28 06:55:17,195][106226] Updated weights for policy 0, policy_version 1622557 (0.0007) [2023-12-28 06:55:17,230][106225] Updated weights for policy 1, policy_version 1626324 (0.0007) [2023-12-28 06:55:17,245][106226] Updated weights for policy 0, policy_version 1622567 (0.0008) [2023-12-28 06:55:17,299][106226] Updated weights for policy 0, policy_version 1622577 (0.0006) [2023-12-28 06:55:17,896][106225] Updated weights for policy 1, policy_version 1626334 (0.0007) [2023-12-28 06:55:17,912][106226] Updated weights for policy 0, policy_version 1622587 (0.0007) [2023-12-28 06:55:17,956][106225] Updated weights for policy 1, policy_version 1626344 (0.0005) [2023-12-28 06:55:17,965][106226] Updated weights for policy 0, policy_version 1622597 (0.0010) [2023-12-28 06:55:18,012][106225] Updated weights for policy 1, policy_version 1626354 (0.0007) [2023-12-28 06:55:18,019][106226] Updated weights for policy 0, policy_version 1622607 (0.0010) [2023-12-28 06:55:18,598][106225] Updated weights for policy 1, policy_version 1626364 (0.0006) [2023-12-28 06:55:18,656][106225] Updated weights for policy 1, policy_version 1626374 (0.0009) [2023-12-28 06:55:18,684][106226] Updated weights for policy 0, policy_version 1622617 (0.0010) [2023-12-28 06:55:18,715][106225] Updated weights for policy 1, policy_version 1626384 (0.0008) [2023-12-28 06:55:18,733][106226] Updated weights for policy 0, policy_version 1622627 (0.0005) [2023-12-28 06:55:18,793][106226] Updated weights for policy 0, policy_version 1622637 (0.0009) [2023-12-28 06:55:18,862][106226] Updated weights for policy 0, policy_version 1622647 (0.0011) [2023-12-28 06:55:19,488][106225] Updated weights for policy 1, policy_version 1626394 (0.0009) [2023-12-28 06:55:19,556][106225] Updated weights for policy 1, policy_version 1626404 (0.0007) [2023-12-28 06:55:19,604][106226] Updated weights for policy 0, policy_version 1622657 (0.0007) [2023-12-28 06:55:19,623][106225] Updated weights for policy 1, policy_version 1626414 (0.0008) [2023-12-28 06:55:19,664][106226] Updated weights for policy 0, policy_version 1622667 (0.0009) [2023-12-28 06:55:19,671][106225] Updated weights for policy 1, policy_version 1626424 (0.0007) [2023-12-28 06:55:19,726][106226] Updated weights for policy 0, policy_version 1622677 (0.0008) [2023-12-28 06:55:20,317][106225] Updated weights for policy 1, policy_version 1626434 (0.0010) [2023-12-28 06:55:20,343][106226] Updated weights for policy 0, policy_version 1622687 (0.0006) [2023-12-28 06:55:20,383][106225] Updated weights for policy 1, policy_version 1626444 (0.0009) [2023-12-28 06:55:20,411][106226] Updated weights for policy 0, policy_version 1622697 (0.0007) [2023-12-28 06:55:20,442][106225] Updated weights for policy 1, policy_version 1626454 (0.0010) [2023-12-28 06:55:20,474][106226] Updated weights for policy 0, policy_version 1622707 (0.0006) [2023-12-28 06:55:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 831913984. Throughput: 0: 9586.2, 1: 10062.6. Samples: 831928084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:21,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.585')] [2023-12-28 06:55:21,203][106225] Updated weights for policy 1, policy_version 1626464 (0.0008) [2023-12-28 06:55:21,217][106226] Updated weights for policy 0, policy_version 1622717 (0.0007) [2023-12-28 06:55:21,276][106225] Updated weights for policy 1, policy_version 1626474 (0.0008) [2023-12-28 06:55:21,286][106226] Updated weights for policy 0, policy_version 1622727 (0.0010) [2023-12-28 06:55:21,341][106225] Updated weights for policy 1, policy_version 1626484 (0.0007) [2023-12-28 06:55:21,354][106226] Updated weights for policy 0, policy_version 1622737 (0.0008) [2023-12-28 06:55:22,071][106225] Updated weights for policy 1, policy_version 1626494 (0.0008) [2023-12-28 06:55:22,132][106225] Updated weights for policy 1, policy_version 1626504 (0.0008) [2023-12-28 06:55:22,152][106226] Updated weights for policy 0, policy_version 1622747 (0.0010) [2023-12-28 06:55:22,196][106225] Updated weights for policy 1, policy_version 1626514 (0.0007) [2023-12-28 06:55:22,215][106226] Updated weights for policy 0, policy_version 1622757 (0.0008) [2023-12-28 06:55:22,286][106226] Updated weights for policy 0, policy_version 1622767 (0.0008) [2023-12-28 06:55:22,851][106225] Updated weights for policy 1, policy_version 1626524 (0.0007) [2023-12-28 06:55:22,915][106225] Updated weights for policy 1, policy_version 1626534 (0.0009) [2023-12-28 06:55:22,971][106225] Updated weights for policy 1, policy_version 1626544 (0.0006) [2023-12-28 06:55:23,148][106226] Updated weights for policy 0, policy_version 1622777 (0.0010) [2023-12-28 06:55:23,211][106226] Updated weights for policy 0, policy_version 1622787 (0.0008) [2023-12-28 06:55:23,269][106226] Updated weights for policy 0, policy_version 1622797 (0.0009) [2023-12-28 06:55:23,333][106226] Updated weights for policy 0, policy_version 1622807 (0.0005) [2023-12-28 06:55:23,522][106225] Updated weights for policy 1, policy_version 1626554 (0.0005) [2023-12-28 06:55:23,571][106225] Updated weights for policy 1, policy_version 1626564 (0.0005) [2023-12-28 06:55:23,617][106225] Updated weights for policy 1, policy_version 1626574 (0.0005) [2023-12-28 06:55:23,666][106225] Updated weights for policy 1, policy_version 1626584 (0.0008) [2023-12-28 06:55:23,884][106226] Updated weights for policy 0, policy_version 1622817 (0.0005) [2023-12-28 06:55:23,933][106226] Updated weights for policy 0, policy_version 1622827 (0.0005) [2023-12-28 06:55:23,982][106226] Updated weights for policy 0, policy_version 1622837 (0.0005) [2023-12-28 06:55:24,420][106225] Updated weights for policy 1, policy_version 1626594 (0.0008) [2023-12-28 06:55:24,472][106225] Updated weights for policy 1, policy_version 1626604 (0.0008) [2023-12-28 06:55:24,523][106225] Updated weights for policy 1, policy_version 1626614 (0.0009) [2023-12-28 06:55:24,590][106226] Updated weights for policy 0, policy_version 1622847 (0.0007) [2023-12-28 06:55:24,651][106226] Updated weights for policy 0, policy_version 1622857 (0.0008) [2023-12-28 06:55:24,707][106226] Updated weights for policy 0, policy_version 1622867 (0.0009) [2023-12-28 06:55:25,265][106225] Updated weights for policy 1, policy_version 1626624 (0.0010) [2023-12-28 06:55:25,314][106225] Updated weights for policy 1, policy_version 1626634 (0.0010) [2023-12-28 06:55:25,357][106225] Updated weights for policy 1, policy_version 1626644 (0.0010) [2023-12-28 06:55:25,367][106226] Updated weights for policy 0, policy_version 1622877 (0.0007) [2023-12-28 06:55:25,421][106226] Updated weights for policy 0, policy_version 1622887 (0.0008) [2023-12-28 06:55:25,470][106226] Updated weights for policy 0, policy_version 1622897 (0.0007) [2023-12-28 06:55:26,003][106225] Updated weights for policy 1, policy_version 1626654 (0.0007) [2023-12-28 06:55:26,056][106225] Updated weights for policy 1, policy_version 1626664 (0.0005) [2023-12-28 06:55:26,117][106226] Updated weights for policy 0, policy_version 1622907 (0.0008) [2023-12-28 06:55:26,119][106225] Updated weights for policy 1, policy_version 1626674 (0.0008) [2023-12-28 06:55:26,173][106226] Updated weights for policy 0, policy_version 1622917 (0.0005) [2023-12-28 06:55:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 832020480. Throughput: 0: 9590.6, 1: 10023.7. Samples: 831987468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:26,175][105115] Avg episode reward: [(0, '-4.192'), (1, '-5.006')] [2023-12-28 06:55:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001626680_416481280.pth... [2023-12-28 06:55:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001625496_416178176.pth [2023-12-28 06:55:26,238][106226] Updated weights for policy 0, policy_version 1622927 (0.0005) [2023-12-28 06:55:26,291][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001622936_415547392.pth... [2023-12-28 06:55:26,295][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001621784_415252480.pth [2023-12-28 06:55:26,833][106225] Updated weights for policy 1, policy_version 1626684 (0.0008) [2023-12-28 06:55:26,868][106226] Updated weights for policy 0, policy_version 1622937 (0.0005) [2023-12-28 06:55:26,882][106225] Updated weights for policy 1, policy_version 1626694 (0.0007) [2023-12-28 06:55:26,930][106226] Updated weights for policy 0, policy_version 1622947 (0.0006) [2023-12-28 06:55:26,937][106225] Updated weights for policy 1, policy_version 1626704 (0.0006) [2023-12-28 06:55:26,986][106226] Updated weights for policy 0, policy_version 1622957 (0.0008) [2023-12-28 06:55:27,040][106226] Updated weights for policy 0, policy_version 1622967 (0.0008) [2023-12-28 06:55:27,613][106225] Updated weights for policy 1, policy_version 1626714 (0.0009) [2023-12-28 06:55:27,662][106225] Updated weights for policy 1, policy_version 1626724 (0.0008) [2023-12-28 06:55:27,721][106225] Updated weights for policy 1, policy_version 1626734 (0.0008) [2023-12-28 06:55:27,743][106226] Updated weights for policy 0, policy_version 1622977 (0.0006) [2023-12-28 06:55:27,768][106225] Updated weights for policy 1, policy_version 1626744 (0.0007) [2023-12-28 06:55:27,797][106226] Updated weights for policy 0, policy_version 1622987 (0.0007) [2023-12-28 06:55:27,859][106226] Updated weights for policy 0, policy_version 1622997 (0.0009) [2023-12-28 06:55:28,448][106225] Updated weights for policy 1, policy_version 1626754 (0.0008) [2023-12-28 06:55:28,504][106225] Updated weights for policy 1, policy_version 1626764 (0.0008) [2023-12-28 06:55:28,559][106225] Updated weights for policy 1, policy_version 1626774 (0.0008) [2023-12-28 06:55:28,621][106226] Updated weights for policy 0, policy_version 1623007 (0.0008) [2023-12-28 06:55:28,679][106226] Updated weights for policy 0, policy_version 1623017 (0.0009) [2023-12-28 06:55:28,738][106226] Updated weights for policy 0, policy_version 1623027 (0.0008) [2023-12-28 06:55:29,279][106225] Updated weights for policy 1, policy_version 1626784 (0.0008) [2023-12-28 06:55:29,349][106225] Updated weights for policy 1, policy_version 1626794 (0.0009) [2023-12-28 06:55:29,405][106225] Updated weights for policy 1, policy_version 1626804 (0.0008) [2023-12-28 06:55:29,493][106226] Updated weights for policy 0, policy_version 1623037 (0.0008) [2023-12-28 06:55:29,547][106226] Updated weights for policy 0, policy_version 1623047 (0.0009) [2023-12-28 06:55:29,596][106226] Updated weights for policy 0, policy_version 1623057 (0.0009) [2023-12-28 06:55:30,125][106225] Updated weights for policy 1, policy_version 1626814 (0.0008) [2023-12-28 06:55:30,180][106225] Updated weights for policy 1, policy_version 1626824 (0.0008) [2023-12-28 06:55:30,228][106225] Updated weights for policy 1, policy_version 1626834 (0.0008) [2023-12-28 06:55:30,403][106226] Updated weights for policy 0, policy_version 1623067 (0.0008) [2023-12-28 06:55:30,453][106226] Updated weights for policy 0, policy_version 1623077 (0.0009) [2023-12-28 06:55:30,498][106226] Updated weights for policy 0, policy_version 1623087 (0.0008) [2023-12-28 06:55:30,870][106225] Updated weights for policy 1, policy_version 1626844 (0.0007) [2023-12-28 06:55:30,921][106225] Updated weights for policy 1, policy_version 1626854 (0.0005) [2023-12-28 06:55:30,971][106225] Updated weights for policy 1, policy_version 1626864 (0.0005) [2023-12-28 06:55:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 832118784. Throughput: 0: 9640.8, 1: 10088.5. Samples: 832106512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:31,175][105115] Avg episode reward: [(0, '-4.624'), (1, '-4.933')] [2023-12-28 06:55:31,228][106226] Updated weights for policy 0, policy_version 1623097 (0.0008) [2023-12-28 06:55:31,289][106226] Updated weights for policy 0, policy_version 1623107 (0.0009) [2023-12-28 06:55:31,355][106226] Updated weights for policy 0, policy_version 1623117 (0.0007) [2023-12-28 06:55:31,421][106226] Updated weights for policy 0, policy_version 1623127 (0.0009) [2023-12-28 06:55:31,688][106225] Updated weights for policy 1, policy_version 1626874 (0.0008) [2023-12-28 06:55:31,753][106225] Updated weights for policy 1, policy_version 1626884 (0.0007) [2023-12-28 06:55:31,811][106225] Updated weights for policy 1, policy_version 1626894 (0.0007) [2023-12-28 06:55:31,860][106225] Updated weights for policy 1, policy_version 1626904 (0.0008) [2023-12-28 06:55:32,178][106226] Updated weights for policy 0, policy_version 1623137 (0.0008) [2023-12-28 06:55:32,226][106226] Updated weights for policy 0, policy_version 1623147 (0.0009) [2023-12-28 06:55:32,296][106226] Updated weights for policy 0, policy_version 1623157 (0.0007) [2023-12-28 06:55:32,573][106225] Updated weights for policy 1, policy_version 1626914 (0.0005) [2023-12-28 06:55:32,625][106225] Updated weights for policy 1, policy_version 1626924 (0.0005) [2023-12-28 06:55:32,680][106225] Updated weights for policy 1, policy_version 1626934 (0.0005) [2023-12-28 06:55:33,040][106226] Updated weights for policy 0, policy_version 1623167 (0.0008) [2023-12-28 06:55:33,090][106226] Updated weights for policy 0, policy_version 1623177 (0.0007) [2023-12-28 06:55:33,145][106226] Updated weights for policy 0, policy_version 1623187 (0.0007) [2023-12-28 06:55:33,295][106225] Updated weights for policy 1, policy_version 1626944 (0.0008) [2023-12-28 06:55:33,341][106225] Updated weights for policy 1, policy_version 1626954 (0.0008) [2023-12-28 06:55:33,390][106225] Updated weights for policy 1, policy_version 1626964 (0.0008) [2023-12-28 06:55:33,800][106226] Updated weights for policy 0, policy_version 1623197 (0.0007) [2023-12-28 06:55:33,862][106226] Updated weights for policy 0, policy_version 1623207 (0.0007) [2023-12-28 06:55:33,919][106226] Updated weights for policy 0, policy_version 1623217 (0.0008) [2023-12-28 06:55:34,158][106225] Updated weights for policy 1, policy_version 1626974 (0.0009) [2023-12-28 06:55:34,216][106225] Updated weights for policy 1, policy_version 1626984 (0.0007) [2023-12-28 06:55:34,272][106225] Updated weights for policy 1, policy_version 1626994 (0.0005) [2023-12-28 06:55:34,638][106226] Updated weights for policy 0, policy_version 1623227 (0.0009) [2023-12-28 06:55:34,698][106226] Updated weights for policy 0, policy_version 1623237 (0.0010) [2023-12-28 06:55:34,759][106226] Updated weights for policy 0, policy_version 1623247 (0.0008) [2023-12-28 06:55:34,927][106225] Updated weights for policy 1, policy_version 1627004 (0.0007) [2023-12-28 06:55:34,991][106225] Updated weights for policy 1, policy_version 1627014 (0.0006) [2023-12-28 06:55:35,056][106225] Updated weights for policy 1, policy_version 1627024 (0.0005) [2023-12-28 06:55:35,495][106226] Updated weights for policy 0, policy_version 1623257 (0.0006) [2023-12-28 06:55:35,558][106226] Updated weights for policy 0, policy_version 1623267 (0.0010) [2023-12-28 06:55:35,626][106226] Updated weights for policy 0, policy_version 1623277 (0.0006) [2023-12-28 06:55:35,670][106225] Updated weights for policy 1, policy_version 1627034 (0.0006) [2023-12-28 06:55:35,678][106226] Updated weights for policy 0, policy_version 1623287 (0.0008) [2023-12-28 06:55:35,719][106225] Updated weights for policy 1, policy_version 1627044 (0.0010) [2023-12-28 06:55:35,782][106225] Updated weights for policy 1, policy_version 1627055 (0.0009) [2023-12-28 06:55:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 832217088. Throughput: 0: 9705.1, 1: 10088.5. Samples: 832226884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:36,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-4.790')] [2023-12-28 06:55:36,286][106226] Updated weights for policy 0, policy_version 1623297 (0.0008) [2023-12-28 06:55:36,356][106226] Updated weights for policy 0, policy_version 1623307 (0.0009) [2023-12-28 06:55:36,427][106226] Updated weights for policy 0, policy_version 1623317 (0.0010) [2023-12-28 06:55:36,461][106225] Updated weights for policy 1, policy_version 1627065 (0.0008) [2023-12-28 06:55:36,527][106225] Updated weights for policy 1, policy_version 1627075 (0.0006) [2023-12-28 06:55:36,596][106225] Updated weights for policy 1, policy_version 1627085 (0.0008) [2023-12-28 06:55:36,653][106225] Updated weights for policy 1, policy_version 1627095 (0.0008) [2023-12-28 06:55:37,130][106226] Updated weights for policy 0, policy_version 1623327 (0.0007) [2023-12-28 06:55:37,192][106226] Updated weights for policy 0, policy_version 1623337 (0.0008) [2023-12-28 06:55:37,260][106226] Updated weights for policy 0, policy_version 1623347 (0.0008) [2023-12-28 06:55:37,376][106225] Updated weights for policy 1, policy_version 1627105 (0.0009) [2023-12-28 06:55:37,435][106225] Updated weights for policy 1, policy_version 1627115 (0.0008) [2023-12-28 06:55:37,495][106225] Updated weights for policy 1, policy_version 1627125 (0.0008) [2023-12-28 06:55:37,893][106226] Updated weights for policy 0, policy_version 1623357 (0.0008) [2023-12-28 06:55:37,941][106226] Updated weights for policy 0, policy_version 1623367 (0.0008) [2023-12-28 06:55:37,989][106226] Updated weights for policy 0, policy_version 1623377 (0.0008) [2023-12-28 06:55:38,235][106225] Updated weights for policy 1, policy_version 1627135 (0.0006) [2023-12-28 06:55:38,287][106225] Updated weights for policy 1, policy_version 1627145 (0.0005) [2023-12-28 06:55:38,343][106225] Updated weights for policy 1, policy_version 1627155 (0.0007) [2023-12-28 06:55:38,725][106226] Updated weights for policy 0, policy_version 1623387 (0.0009) [2023-12-28 06:55:38,783][106226] Updated weights for policy 0, policy_version 1623397 (0.0008) [2023-12-28 06:55:38,838][106226] Updated weights for policy 0, policy_version 1623407 (0.0009) [2023-12-28 06:55:39,084][106225] Updated weights for policy 1, policy_version 1627165 (0.0008) [2023-12-28 06:55:39,135][106225] Updated weights for policy 1, policy_version 1627175 (0.0009) [2023-12-28 06:55:39,185][106225] Updated weights for policy 1, policy_version 1627185 (0.0009) [2023-12-28 06:55:39,539][106226] Updated weights for policy 0, policy_version 1623417 (0.0009) [2023-12-28 06:55:39,595][106226] Updated weights for policy 0, policy_version 1623427 (0.0009) [2023-12-28 06:55:39,656][106226] Updated weights for policy 0, policy_version 1623437 (0.0009) [2023-12-28 06:55:39,719][106226] Updated weights for policy 0, policy_version 1623447 (0.0009) [2023-12-28 06:55:39,974][106225] Updated weights for policy 1, policy_version 1627195 (0.0011) [2023-12-28 06:55:40,038][106225] Updated weights for policy 1, policy_version 1627205 (0.0008) [2023-12-28 06:55:40,102][106225] Updated weights for policy 1, policy_version 1627215 (0.0008) [2023-12-28 06:55:40,504][106226] Updated weights for policy 0, policy_version 1623458 (0.0010) [2023-12-28 06:55:40,563][106226] Updated weights for policy 0, policy_version 1623468 (0.0009) [2023-12-28 06:55:40,618][106226] Updated weights for policy 0, policy_version 1623478 (0.0008) [2023-12-28 06:55:40,742][106225] Updated weights for policy 1, policy_version 1627225 (0.0009) [2023-12-28 06:55:40,794][106225] Updated weights for policy 1, policy_version 1627235 (0.0008) [2023-12-28 06:55:40,854][106225] Updated weights for policy 1, policy_version 1627245 (0.0008) [2023-12-28 06:55:40,914][106225] Updated weights for policy 1, policy_version 1627255 (0.0008) [2023-12-28 06:55:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 832315392. Throughput: 0: 9718.7, 1: 10047.0. Samples: 832285716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:41,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.700')] [2023-12-28 06:55:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001627256_416628736.pth... [2023-12-28 06:55:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001623480_415686656.pth... [2023-12-28 06:55:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001626072_416325632.pth [2023-12-28 06:55:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001622360_415399936.pth [2023-12-28 06:55:41,447][106226] Updated weights for policy 0, policy_version 1623488 (0.0009) [2023-12-28 06:55:41,509][106226] Updated weights for policy 0, policy_version 1623498 (0.0008) [2023-12-28 06:55:41,568][106226] Updated weights for policy 0, policy_version 1623508 (0.0008) [2023-12-28 06:55:41,679][106225] Updated weights for policy 1, policy_version 1627265 (0.0008) [2023-12-28 06:55:41,748][106225] Updated weights for policy 1, policy_version 1627275 (0.0007) [2023-12-28 06:55:41,814][106225] Updated weights for policy 1, policy_version 1627285 (0.0006) [2023-12-28 06:55:42,303][106226] Updated weights for policy 0, policy_version 1623518 (0.0008) [2023-12-28 06:55:42,373][106226] Updated weights for policy 0, policy_version 1623528 (0.0008) [2023-12-28 06:55:42,437][106226] Updated weights for policy 0, policy_version 1623538 (0.0007) [2023-12-28 06:55:42,490][106225] Updated weights for policy 1, policy_version 1627295 (0.0008) [2023-12-28 06:55:42,553][106225] Updated weights for policy 1, policy_version 1627305 (0.0008) [2023-12-28 06:55:42,619][106225] Updated weights for policy 1, policy_version 1627315 (0.0009) [2023-12-28 06:55:42,989][106226] Updated weights for policy 0, policy_version 1623548 (0.0006) [2023-12-28 06:55:43,042][106226] Updated weights for policy 0, policy_version 1623558 (0.0006) [2023-12-28 06:55:43,093][106226] Updated weights for policy 0, policy_version 1623568 (0.0008) [2023-12-28 06:55:43,335][106225] Updated weights for policy 1, policy_version 1627325 (0.0008) [2023-12-28 06:55:43,389][106225] Updated weights for policy 1, policy_version 1627335 (0.0010) [2023-12-28 06:55:43,448][106225] Updated weights for policy 1, policy_version 1627345 (0.0010) [2023-12-28 06:55:43,823][106226] Updated weights for policy 0, policy_version 1623578 (0.0008) [2023-12-28 06:55:43,873][106226] Updated weights for policy 0, policy_version 1623588 (0.0011) [2023-12-28 06:55:43,933][106226] Updated weights for policy 0, policy_version 1623598 (0.0010) [2023-12-28 06:55:43,998][106226] Updated weights for policy 0, policy_version 1623608 (0.0008) [2023-12-28 06:55:44,041][106225] Updated weights for policy 1, policy_version 1627355 (0.0009) [2023-12-28 06:55:44,087][106225] Updated weights for policy 1, policy_version 1627365 (0.0005) [2023-12-28 06:55:44,138][106225] Updated weights for policy 1, policy_version 1627375 (0.0005) [2023-12-28 06:55:44,704][106226] Updated weights for policy 0, policy_version 1623618 (0.0011) [2023-12-28 06:55:44,765][106226] Updated weights for policy 0, policy_version 1623628 (0.0010) [2023-12-28 06:55:44,802][106225] Updated weights for policy 1, policy_version 1627385 (0.0005) [2023-12-28 06:55:44,828][106226] Updated weights for policy 0, policy_version 1623638 (0.0008) [2023-12-28 06:55:44,858][106225] Updated weights for policy 1, policy_version 1627395 (0.0007) [2023-12-28 06:55:44,916][106225] Updated weights for policy 1, policy_version 1627405 (0.0008) [2023-12-28 06:55:44,976][106225] Updated weights for policy 1, policy_version 1627415 (0.0008) [2023-12-28 06:55:45,586][106226] Updated weights for policy 0, policy_version 1623648 (0.0010) [2023-12-28 06:55:45,626][106225] Updated weights for policy 1, policy_version 1627425 (0.0006) [2023-12-28 06:55:45,652][106226] Updated weights for policy 0, policy_version 1623658 (0.0011) [2023-12-28 06:55:45,678][106225] Updated weights for policy 1, policy_version 1627435 (0.0005) [2023-12-28 06:55:45,715][106226] Updated weights for policy 0, policy_version 1623668 (0.0011) [2023-12-28 06:55:45,734][106225] Updated weights for policy 1, policy_version 1627445 (0.0007) [2023-12-28 06:55:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 832413696. Throughput: 0: 9693.6, 1: 10073.5. Samples: 832403376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:46,176][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.730')] [2023-12-28 06:55:46,410][106225] Updated weights for policy 1, policy_version 1627455 (0.0006) [2023-12-28 06:55:46,410][106226] Updated weights for policy 0, policy_version 1623678 (0.0011) [2023-12-28 06:55:46,475][106225] Updated weights for policy 1, policy_version 1627465 (0.0005) [2023-12-28 06:55:46,478][106226] Updated weights for policy 0, policy_version 1623688 (0.0011) [2023-12-28 06:55:46,534][106225] Updated weights for policy 1, policy_version 1627475 (0.0005) [2023-12-28 06:55:46,539][106226] Updated weights for policy 0, policy_version 1623698 (0.0011) [2023-12-28 06:55:47,086][106225] Updated weights for policy 1, policy_version 1627485 (0.0008) [2023-12-28 06:55:47,139][106225] Updated weights for policy 1, policy_version 1627495 (0.0010) [2023-12-28 06:55:47,193][106225] Updated weights for policy 1, policy_version 1627505 (0.0010) [2023-12-28 06:55:47,211][106226] Updated weights for policy 0, policy_version 1623708 (0.0008) [2023-12-28 06:55:47,270][106226] Updated weights for policy 0, policy_version 1623718 (0.0007) [2023-12-28 06:55:47,331][106226] Updated weights for policy 0, policy_version 1623728 (0.0007) [2023-12-28 06:55:47,916][106225] Updated weights for policy 1, policy_version 1627515 (0.0010) [2023-12-28 06:55:47,949][106226] Updated weights for policy 0, policy_version 1623738 (0.0007) [2023-12-28 06:55:47,970][106225] Updated weights for policy 1, policy_version 1627525 (0.0010) [2023-12-28 06:55:48,001][106226] Updated weights for policy 0, policy_version 1623748 (0.0005) [2023-12-28 06:55:48,024][106225] Updated weights for policy 1, policy_version 1627535 (0.0010) [2023-12-28 06:55:48,054][106226] Updated weights for policy 0, policy_version 1623758 (0.0005) [2023-12-28 06:55:48,110][106226] Updated weights for policy 0, policy_version 1623768 (0.0005) [2023-12-28 06:55:48,709][106225] Updated weights for policy 1, policy_version 1627545 (0.0010) [2023-12-28 06:55:48,715][106226] Updated weights for policy 0, policy_version 1623778 (0.0007) [2023-12-28 06:55:48,766][106225] Updated weights for policy 1, policy_version 1627555 (0.0008) [2023-12-28 06:55:48,779][106226] Updated weights for policy 0, policy_version 1623788 (0.0006) [2023-12-28 06:55:48,822][106225] Updated weights for policy 1, policy_version 1627565 (0.0007) [2023-12-28 06:55:48,843][106226] Updated weights for policy 0, policy_version 1623798 (0.0006) [2023-12-28 06:55:48,891][106225] Updated weights for policy 1, policy_version 1627575 (0.0006) [2023-12-28 06:55:49,392][106226] Updated weights for policy 0, policy_version 1623808 (0.0007) [2023-12-28 06:55:49,457][106226] Updated weights for policy 0, policy_version 1623818 (0.0010) [2023-12-28 06:55:49,518][106226] Updated weights for policy 0, policy_version 1623828 (0.0011) [2023-12-28 06:55:49,570][106225] Updated weights for policy 1, policy_version 1627585 (0.0008) [2023-12-28 06:55:49,634][106225] Updated weights for policy 1, policy_version 1627595 (0.0010) [2023-12-28 06:55:49,692][106225] Updated weights for policy 1, policy_version 1627605 (0.0009) [2023-12-28 06:55:50,216][106226] Updated weights for policy 0, policy_version 1623838 (0.0009) [2023-12-28 06:55:50,266][106226] Updated weights for policy 0, policy_version 1623848 (0.0008) [2023-12-28 06:55:50,323][106226] Updated weights for policy 0, policy_version 1623858 (0.0008) [2023-12-28 06:55:50,415][106225] Updated weights for policy 1, policy_version 1627615 (0.0010) [2023-12-28 06:55:50,465][106225] Updated weights for policy 1, policy_version 1627625 (0.0010) [2023-12-28 06:55:50,531][106225] Updated weights for policy 1, policy_version 1627635 (0.0010) [2023-12-28 06:55:51,081][106226] Updated weights for policy 0, policy_version 1623868 (0.0008) [2023-12-28 06:55:51,141][106226] Updated weights for policy 0, policy_version 1623878 (0.0008) [2023-12-28 06:55:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 832512000. Throughput: 0: 9816.0, 1: 10072.3. Samples: 832526620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:51,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.792')] [2023-12-28 06:55:51,205][106226] Updated weights for policy 0, policy_version 1623888 (0.0007) [2023-12-28 06:55:51,275][106225] Updated weights for policy 1, policy_version 1627645 (0.0009) [2023-12-28 06:55:51,336][106225] Updated weights for policy 1, policy_version 1627655 (0.0008) [2023-12-28 06:55:51,411][106225] Updated weights for policy 1, policy_version 1627665 (0.0008) [2023-12-28 06:55:51,934][106226] Updated weights for policy 0, policy_version 1623898 (0.0008) [2023-12-28 06:55:51,996][106226] Updated weights for policy 0, policy_version 1623908 (0.0009) [2023-12-28 06:55:52,059][106226] Updated weights for policy 0, policy_version 1623918 (0.0009) [2023-12-28 06:55:52,111][106225] Updated weights for policy 1, policy_version 1627675 (0.0007) [2023-12-28 06:55:52,119][106226] Updated weights for policy 0, policy_version 1623928 (0.0007) [2023-12-28 06:55:52,176][106225] Updated weights for policy 1, policy_version 1627685 (0.0009) [2023-12-28 06:55:52,241][106225] Updated weights for policy 1, policy_version 1627695 (0.0008) [2023-12-28 06:55:52,835][106226] Updated weights for policy 0, policy_version 1623938 (0.0008) [2023-12-28 06:55:52,884][106226] Updated weights for policy 0, policy_version 1623948 (0.0010) [2023-12-28 06:55:52,940][106226] Updated weights for policy 0, policy_version 1623958 (0.0010) [2023-12-28 06:55:53,011][106225] Updated weights for policy 1, policy_version 1627705 (0.0009) [2023-12-28 06:55:53,076][106225] Updated weights for policy 1, policy_version 1627715 (0.0005) [2023-12-28 06:55:53,138][106225] Updated weights for policy 1, policy_version 1627725 (0.0005) [2023-12-28 06:55:53,205][106225] Updated weights for policy 1, policy_version 1627735 (0.0008) [2023-12-28 06:55:53,644][106226] Updated weights for policy 0, policy_version 1623968 (0.0006) [2023-12-28 06:55:53,703][106226] Updated weights for policy 0, policy_version 1623978 (0.0006) [2023-12-28 06:55:53,751][106226] Updated weights for policy 0, policy_version 1623988 (0.0005) [2023-12-28 06:55:53,922][106225] Updated weights for policy 1, policy_version 1627745 (0.0006) [2023-12-28 06:55:53,979][106225] Updated weights for policy 1, policy_version 1627755 (0.0009) [2023-12-28 06:55:54,032][106225] Updated weights for policy 1, policy_version 1627765 (0.0008) [2023-12-28 06:55:54,307][106226] Updated weights for policy 0, policy_version 1623998 (0.0005) [2023-12-28 06:55:54,374][106226] Updated weights for policy 0, policy_version 1624008 (0.0009) [2023-12-28 06:55:54,425][106226] Updated weights for policy 0, policy_version 1624018 (0.0010) [2023-12-28 06:55:54,737][106225] Updated weights for policy 1, policy_version 1627775 (0.0007) [2023-12-28 06:55:54,802][106225] Updated weights for policy 1, policy_version 1627785 (0.0008) [2023-12-28 06:55:54,859][106225] Updated weights for policy 1, policy_version 1627795 (0.0008) [2023-12-28 06:55:55,005][106226] Updated weights for policy 0, policy_version 1624028 (0.0008) [2023-12-28 06:55:55,054][106226] Updated weights for policy 0, policy_version 1624038 (0.0005) [2023-12-28 06:55:55,106][106226] Updated weights for policy 0, policy_version 1624048 (0.0005) [2023-12-28 06:55:55,559][106225] Updated weights for policy 1, policy_version 1627805 (0.0008) [2023-12-28 06:55:55,623][106225] Updated weights for policy 1, policy_version 1627815 (0.0005) [2023-12-28 06:55:55,682][106225] Updated weights for policy 1, policy_version 1627825 (0.0006) [2023-12-28 06:55:55,682][106226] Updated weights for policy 0, policy_version 1624058 (0.0009) [2023-12-28 06:55:55,743][106226] Updated weights for policy 0, policy_version 1624068 (0.0005) [2023-12-28 06:55:55,793][106226] Updated weights for policy 0, policy_version 1624078 (0.0005) [2023-12-28 06:55:55,849][106226] Updated weights for policy 0, policy_version 1624088 (0.0005) [2023-12-28 06:55:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 832618496. Throughput: 0: 9820.5, 1: 10014.4. Samples: 832584260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:55:56,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.706')] [2023-12-28 06:55:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001624088_415842304.pth... [2023-12-28 06:55:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001627832_416776192.pth... [2023-12-28 06:55:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001622936_415547392.pth [2023-12-28 06:55:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001626680_416481280.pth [2023-12-28 06:55:56,378][106226] Updated weights for policy 0, policy_version 1624098 (0.0005) [2023-12-28 06:55:56,434][106226] Updated weights for policy 0, policy_version 1624108 (0.0005) [2023-12-28 06:55:56,437][106225] Updated weights for policy 1, policy_version 1627835 (0.0007) [2023-12-28 06:55:56,487][106225] Updated weights for policy 1, policy_version 1627845 (0.0008) [2023-12-28 06:55:56,499][106226] Updated weights for policy 0, policy_version 1624118 (0.0005) [2023-12-28 06:55:56,537][106225] Updated weights for policy 1, policy_version 1627855 (0.0009) [2023-12-28 06:55:57,100][106226] Updated weights for policy 0, policy_version 1624128 (0.0010) [2023-12-28 06:55:57,148][106226] Updated weights for policy 0, policy_version 1624138 (0.0010) [2023-12-28 06:55:57,207][106226] Updated weights for policy 0, policy_version 1624148 (0.0010) [2023-12-28 06:55:57,291][106225] Updated weights for policy 1, policy_version 1627865 (0.0006) [2023-12-28 06:55:57,350][106225] Updated weights for policy 1, policy_version 1627875 (0.0009) [2023-12-28 06:55:57,399][106225] Updated weights for policy 1, policy_version 1627885 (0.0008) [2023-12-28 06:55:57,457][106225] Updated weights for policy 1, policy_version 1627895 (0.0009) [2023-12-28 06:55:57,782][106226] Updated weights for policy 0, policy_version 1624158 (0.0007) [2023-12-28 06:55:57,830][106226] Updated weights for policy 0, policy_version 1624168 (0.0007) [2023-12-28 06:55:57,888][106226] Updated weights for policy 0, policy_version 1624178 (0.0005) [2023-12-28 06:55:58,262][106225] Updated weights for policy 1, policy_version 1627905 (0.0008) [2023-12-28 06:55:58,323][106225] Updated weights for policy 1, policy_version 1627915 (0.0008) [2023-12-28 06:55:58,394][106225] Updated weights for policy 1, policy_version 1627925 (0.0008) [2023-12-28 06:55:58,597][106226] Updated weights for policy 0, policy_version 1624188 (0.0007) [2023-12-28 06:55:58,663][106226] Updated weights for policy 0, policy_version 1624198 (0.0008) [2023-12-28 06:55:58,727][106226] Updated weights for policy 0, policy_version 1624208 (0.0008) [2023-12-28 06:55:59,152][106225] Updated weights for policy 1, policy_version 1627935 (0.0006) [2023-12-28 06:55:59,215][106225] Updated weights for policy 1, policy_version 1627945 (0.0007) [2023-12-28 06:55:59,293][106225] Updated weights for policy 1, policy_version 1627955 (0.0008) [2023-12-28 06:55:59,555][106226] Updated weights for policy 0, policy_version 1624218 (0.0009) [2023-12-28 06:55:59,602][106226] Updated weights for policy 0, policy_version 1624228 (0.0008) [2023-12-28 06:55:59,659][106226] Updated weights for policy 0, policy_version 1624238 (0.0009) [2023-12-28 06:55:59,713][106226] Updated weights for policy 0, policy_version 1624248 (0.0009) [2023-12-28 06:55:59,917][106225] Updated weights for policy 1, policy_version 1627965 (0.0007) [2023-12-28 06:55:59,981][106225] Updated weights for policy 1, policy_version 1627975 (0.0006) [2023-12-28 06:56:00,047][106225] Updated weights for policy 1, policy_version 1627985 (0.0005) [2023-12-28 06:56:00,555][106226] Updated weights for policy 0, policy_version 1624258 (0.0009) [2023-12-28 06:56:00,612][106226] Updated weights for policy 0, policy_version 1624268 (0.0008) [2023-12-28 06:56:00,637][106225] Updated weights for policy 1, policy_version 1627995 (0.0006) [2023-12-28 06:56:00,661][106226] Updated weights for policy 0, policy_version 1624278 (0.0005) [2023-12-28 06:56:00,694][106225] Updated weights for policy 1, policy_version 1628005 (0.0008) [2023-12-28 06:56:00,747][106225] Updated weights for policy 1, policy_version 1628015 (0.0006) [2023-12-28 06:56:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 832716800. Throughput: 0: 10003.6, 1: 9970.8. Samples: 832705224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:56:01,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.884')] [2023-12-28 06:56:01,262][106226] Updated weights for policy 0, policy_version 1624288 (0.0007) [2023-12-28 06:56:01,323][106226] Updated weights for policy 0, policy_version 1624298 (0.0006) [2023-12-28 06:56:01,391][106226] Updated weights for policy 0, policy_version 1624308 (0.0008) [2023-12-28 06:56:01,524][106225] Updated weights for policy 1, policy_version 1628025 (0.0006) [2023-12-28 06:56:01,589][106225] Updated weights for policy 1, policy_version 1628035 (0.0008) [2023-12-28 06:56:01,659][106225] Updated weights for policy 1, policy_version 1628045 (0.0008) [2023-12-28 06:56:01,726][106225] Updated weights for policy 1, policy_version 1628055 (0.0008) [2023-12-28 06:56:02,082][106226] Updated weights for policy 0, policy_version 1624318 (0.0008) [2023-12-28 06:56:02,142][106226] Updated weights for policy 0, policy_version 1624328 (0.0008) [2023-12-28 06:56:02,202][106226] Updated weights for policy 0, policy_version 1624338 (0.0009) [2023-12-28 06:56:02,422][106225] Updated weights for policy 1, policy_version 1628065 (0.0009) [2023-12-28 06:56:02,487][106225] Updated weights for policy 1, policy_version 1628075 (0.0009) [2023-12-28 06:56:02,536][106225] Updated weights for policy 1, policy_version 1628085 (0.0008) [2023-12-28 06:56:02,908][106226] Updated weights for policy 0, policy_version 1624348 (0.0009) [2023-12-28 06:56:02,972][106226] Updated weights for policy 0, policy_version 1624358 (0.0006) [2023-12-28 06:56:03,031][106226] Updated weights for policy 0, policy_version 1624368 (0.0008) [2023-12-28 06:56:03,281][106225] Updated weights for policy 1, policy_version 1628095 (0.0009) [2023-12-28 06:56:03,329][106225] Updated weights for policy 1, policy_version 1628105 (0.0009) [2023-12-28 06:56:03,377][106225] Updated weights for policy 1, policy_version 1628115 (0.0009) [2023-12-28 06:56:03,689][106226] Updated weights for policy 0, policy_version 1624378 (0.0009) [2023-12-28 06:56:03,744][106226] Updated weights for policy 0, policy_version 1624388 (0.0010) [2023-12-28 06:56:03,792][106226] Updated weights for policy 0, policy_version 1624398 (0.0008) [2023-12-28 06:56:03,865][106226] Updated weights for policy 0, policy_version 1624408 (0.0007) [2023-12-28 06:56:04,107][106225] Updated weights for policy 1, policy_version 1628125 (0.0009) [2023-12-28 06:56:04,166][106225] Updated weights for policy 1, policy_version 1628135 (0.0010) [2023-12-28 06:56:04,231][106225] Updated weights for policy 1, policy_version 1628145 (0.0010) [2023-12-28 06:56:04,632][106226] Updated weights for policy 0, policy_version 1624418 (0.0008) [2023-12-28 06:56:04,693][106226] Updated weights for policy 0, policy_version 1624428 (0.0008) [2023-12-28 06:56:04,763][106226] Updated weights for policy 0, policy_version 1624438 (0.0008) [2023-12-28 06:56:04,980][106225] Updated weights for policy 1, policy_version 1628155 (0.0011) [2023-12-28 06:56:05,034][106225] Updated weights for policy 1, policy_version 1628165 (0.0010) [2023-12-28 06:56:05,088][106225] Updated weights for policy 1, policy_version 1628175 (0.0010) [2023-12-28 06:56:05,426][106226] Updated weights for policy 0, policy_version 1624448 (0.0010) [2023-12-28 06:56:05,483][106226] Updated weights for policy 0, policy_version 1624458 (0.0011) [2023-12-28 06:56:05,546][106226] Updated weights for policy 0, policy_version 1624468 (0.0011) [2023-12-28 06:56:05,760][106225] Updated weights for policy 1, policy_version 1628185 (0.0010) [2023-12-28 06:56:05,810][106225] Updated weights for policy 1, policy_version 1628195 (0.0007) [2023-12-28 06:56:05,862][106225] Updated weights for policy 1, policy_version 1628206 (0.0008) [2023-12-28 06:56:05,915][106225] Updated weights for policy 1, policy_version 1628216 (0.0007) [2023-12-28 06:56:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 832815104. Throughput: 0: 10008.1, 1: 9930.6. Samples: 832825324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 06:56:06,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.516')] [2023-12-28 06:56:06,240][106226] Updated weights for policy 0, policy_version 1624478 (0.0008) [2023-12-28 06:56:06,310][106226] Updated weights for policy 0, policy_version 1624488 (0.0009) [2023-12-28 06:56:06,376][106226] Updated weights for policy 0, policy_version 1624498 (0.0007) [2023-12-28 06:56:06,630][106225] Updated weights for policy 1, policy_version 1628226 (0.0007) [2023-12-28 06:56:06,693][106225] Updated weights for policy 1, policy_version 1628236 (0.0005) [2023-12-28 06:56:06,752][106225] Updated weights for policy 1, policy_version 1628246 (0.0005) [2023-12-28 06:56:07,047][106226] Updated weights for policy 0, policy_version 1624508 (0.0006) [2023-12-28 06:56:07,107][106226] Updated weights for policy 0, policy_version 1624518 (0.0006) [2023-12-28 06:56:07,178][106226] Updated weights for policy 0, policy_version 1624528 (0.0011) [2023-12-28 06:56:07,414][106225] Updated weights for policy 1, policy_version 1628256 (0.0007) [2023-12-28 06:56:07,468][106225] Updated weights for policy 1, policy_version 1628266 (0.0007) [2023-12-28 06:56:07,518][106225] Updated weights for policy 1, policy_version 1628276 (0.0009) [2023-12-28 06:56:07,823][106226] Updated weights for policy 0, policy_version 1624538 (0.0011) [2023-12-28 06:56:07,882][106226] Updated weights for policy 0, policy_version 1624548 (0.0010) [2023-12-28 06:56:07,931][106226] Updated weights for policy 0, policy_version 1624558 (0.0010) [2023-12-28 06:56:07,977][106226] Updated weights for policy 0, policy_version 1624568 (0.0010) [2023-12-28 06:56:08,291][106225] Updated weights for policy 1, policy_version 1628286 (0.0007) [2023-12-28 06:56:08,357][106225] Updated weights for policy 1, policy_version 1628296 (0.0008) [2023-12-28 06:56:08,424][106225] Updated weights for policy 1, policy_version 1628306 (0.0009) [2023-12-28 06:56:08,664][106226] Updated weights for policy 0, policy_version 1624578 (0.0008) [2023-12-28 06:56:08,727][106226] Updated weights for policy 0, policy_version 1624588 (0.0007) [2023-12-28 06:56:08,783][106226] Updated weights for policy 0, policy_version 1624598 (0.0007) [2023-12-28 06:56:09,231][106225] Updated weights for policy 1, policy_version 1628316 (0.0010) [2023-12-28 06:56:09,298][106225] Updated weights for policy 1, policy_version 1628326 (0.0008) [2023-12-28 06:56:09,363][106225] Updated weights for policy 1, policy_version 1628336 (0.0008) [2023-12-28 06:56:09,444][106226] Updated weights for policy 0, policy_version 1624608 (0.0008) [2023-12-28 06:56:09,503][106226] Updated weights for policy 0, policy_version 1624618 (0.0008) [2023-12-28 06:56:09,566][106226] Updated weights for policy 0, policy_version 1624628 (0.0008) [2023-12-28 06:56:10,024][106225] Updated weights for policy 1, policy_version 1628346 (0.0008) [2023-12-28 06:56:10,090][106225] Updated weights for policy 1, policy_version 1628356 (0.0009) [2023-12-28 06:56:10,148][106225] Updated weights for policy 1, policy_version 1628366 (0.0006) [2023-12-28 06:56:10,201][106225] Updated weights for policy 1, policy_version 1628376 (0.0005) [2023-12-28 06:56:10,304][106226] Updated weights for policy 0, policy_version 1624638 (0.0007) [2023-12-28 06:56:10,368][106226] Updated weights for policy 0, policy_version 1624648 (0.0008) [2023-12-28 06:56:10,437][106226] Updated weights for policy 0, policy_version 1624658 (0.0008) [2023-12-28 06:56:10,873][106225] Updated weights for policy 1, policy_version 1628386 (0.0005) [2023-12-28 06:56:10,924][106225] Updated weights for policy 1, policy_version 1628396 (0.0005) [2023-12-28 06:56:10,978][106225] Updated weights for policy 1, policy_version 1628406 (0.0006) [2023-12-28 06:56:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 832913408. Throughput: 0: 10052.5, 1: 9894.5. Samples: 832885080. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:11,175][105115] Avg episode reward: [(0, '-4.906'), (1, '-4.566')] [2023-12-28 06:56:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001628408_416923648.pth... [2023-12-28 06:56:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001624664_415989760.pth... [2023-12-28 06:56:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001627256_416628736.pth [2023-12-28 06:56:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001623480_415686656.pth [2023-12-28 06:56:11,225][106226] Updated weights for policy 0, policy_version 1624668 (0.0008) [2023-12-28 06:56:11,288][106226] Updated weights for policy 0, policy_version 1624678 (0.0008) [2023-12-28 06:56:11,356][106226] Updated weights for policy 0, policy_version 1624688 (0.0008) [2023-12-28 06:56:11,687][106225] Updated weights for policy 1, policy_version 1628416 (0.0008) [2023-12-28 06:56:11,753][106225] Updated weights for policy 1, policy_version 1628426 (0.0009) [2023-12-28 06:56:11,816][106225] Updated weights for policy 1, policy_version 1628436 (0.0008) [2023-12-28 06:56:12,042][106226] Updated weights for policy 0, policy_version 1624698 (0.0009) [2023-12-28 06:56:12,105][106226] Updated weights for policy 0, policy_version 1624708 (0.0009) [2023-12-28 06:56:12,167][106226] Updated weights for policy 0, policy_version 1624718 (0.0007) [2023-12-28 06:56:12,225][106226] Updated weights for policy 0, policy_version 1624728 (0.0009) [2023-12-28 06:56:12,606][106225] Updated weights for policy 1, policy_version 1628446 (0.0007) [2023-12-28 06:56:12,670][106225] Updated weights for policy 1, policy_version 1628456 (0.0006) [2023-12-28 06:56:12,733][106225] Updated weights for policy 1, policy_version 1628466 (0.0005) [2023-12-28 06:56:12,908][106226] Updated weights for policy 0, policy_version 1624738 (0.0008) [2023-12-28 06:56:12,967][106226] Updated weights for policy 0, policy_version 1624748 (0.0008) [2023-12-28 06:56:13,019][106226] Updated weights for policy 0, policy_version 1624758 (0.0009) [2023-12-28 06:56:13,325][106225] Updated weights for policy 1, policy_version 1628476 (0.0005) [2023-12-28 06:56:13,378][106225] Updated weights for policy 1, policy_version 1628486 (0.0005) [2023-12-28 06:56:13,433][106225] Updated weights for policy 1, policy_version 1628496 (0.0005) [2023-12-28 06:56:13,777][106226] Updated weights for policy 0, policy_version 1624768 (0.0009) [2023-12-28 06:56:13,825][106226] Updated weights for policy 0, policy_version 1624778 (0.0009) [2023-12-28 06:56:13,873][106226] Updated weights for policy 0, policy_version 1624788 (0.0008) [2023-12-28 06:56:14,023][106225] Updated weights for policy 1, policy_version 1628506 (0.0007) [2023-12-28 06:56:14,072][106225] Updated weights for policy 1, policy_version 1628516 (0.0005) [2023-12-28 06:56:14,120][106225] Updated weights for policy 1, policy_version 1628526 (0.0007) [2023-12-28 06:56:14,164][106225] Updated weights for policy 1, policy_version 1628536 (0.0008) [2023-12-28 06:56:14,651][106226] Updated weights for policy 0, policy_version 1624798 (0.0010) [2023-12-28 06:56:14,704][106226] Updated weights for policy 0, policy_version 1624808 (0.0006) [2023-12-28 06:56:14,761][106226] Updated weights for policy 0, policy_version 1624818 (0.0008) [2023-12-28 06:56:14,946][106225] Updated weights for policy 1, policy_version 1628546 (0.0009) [2023-12-28 06:56:15,009][106225] Updated weights for policy 1, policy_version 1628556 (0.0009) [2023-12-28 06:56:15,072][106225] Updated weights for policy 1, policy_version 1628566 (0.0008) [2023-12-28 06:56:15,427][106226] Updated weights for policy 0, policy_version 1624828 (0.0008) [2023-12-28 06:56:15,492][106226] Updated weights for policy 0, policy_version 1624838 (0.0006) [2023-12-28 06:56:15,556][106226] Updated weights for policy 0, policy_version 1624848 (0.0006) [2023-12-28 06:56:15,876][106225] Updated weights for policy 1, policy_version 1628576 (0.0009) [2023-12-28 06:56:15,932][106225] Updated weights for policy 1, policy_version 1628586 (0.0008) [2023-12-28 06:56:15,986][106225] Updated weights for policy 1, policy_version 1628596 (0.0009) [2023-12-28 06:56:16,146][106226] Updated weights for policy 0, policy_version 1624858 (0.0008) [2023-12-28 06:56:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 833011712. Throughput: 0: 9995.3, 1: 9896.3. Samples: 833001632. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:16,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.168')] [2023-12-28 06:56:16,204][106226] Updated weights for policy 0, policy_version 1624868 (0.0009) [2023-12-28 06:56:16,249][106226] Updated weights for policy 0, policy_version 1624878 (0.0008) [2023-12-28 06:56:16,302][106226] Updated weights for policy 0, policy_version 1624888 (0.0009) [2023-12-28 06:56:16,680][106225] Updated weights for policy 1, policy_version 1628606 (0.0007) [2023-12-28 06:56:16,737][106225] Updated weights for policy 1, policy_version 1628616 (0.0007) [2023-12-28 06:56:16,788][106225] Updated weights for policy 1, policy_version 1628626 (0.0007) [2023-12-28 06:56:17,065][106226] Updated weights for policy 0, policy_version 1624898 (0.0010) [2023-12-28 06:56:17,118][106226] Updated weights for policy 0, policy_version 1624908 (0.0010) [2023-12-28 06:56:17,178][106226] Updated weights for policy 0, policy_version 1624918 (0.0010) [2023-12-28 06:56:17,499][106225] Updated weights for policy 1, policy_version 1628636 (0.0008) [2023-12-28 06:56:17,563][106225] Updated weights for policy 1, policy_version 1628646 (0.0008) [2023-12-28 06:56:17,621][106225] Updated weights for policy 1, policy_version 1628656 (0.0008) [2023-12-28 06:56:17,913][106226] Updated weights for policy 0, policy_version 1624928 (0.0008) [2023-12-28 06:56:17,957][106226] Updated weights for policy 0, policy_version 1624938 (0.0008) [2023-12-28 06:56:18,009][106226] Updated weights for policy 0, policy_version 1624948 (0.0009) [2023-12-28 06:56:18,348][106225] Updated weights for policy 1, policy_version 1628666 (0.0008) [2023-12-28 06:56:18,406][106225] Updated weights for policy 1, policy_version 1628676 (0.0009) [2023-12-28 06:56:18,462][106225] Updated weights for policy 1, policy_version 1628686 (0.0009) [2023-12-28 06:56:18,516][106225] Updated weights for policy 1, policy_version 1628696 (0.0008) [2023-12-28 06:56:18,730][106226] Updated weights for policy 0, policy_version 1624958 (0.0009) [2023-12-28 06:56:18,787][106226] Updated weights for policy 0, policy_version 1624968 (0.0009) [2023-12-28 06:56:18,847][106226] Updated weights for policy 0, policy_version 1624978 (0.0008) [2023-12-28 06:56:19,263][106225] Updated weights for policy 1, policy_version 1628706 (0.0007) [2023-12-28 06:56:19,328][106225] Updated weights for policy 1, policy_version 1628716 (0.0007) [2023-12-28 06:56:19,400][106225] Updated weights for policy 1, policy_version 1628726 (0.0007) [2023-12-28 06:56:19,617][106226] Updated weights for policy 0, policy_version 1624988 (0.0008) [2023-12-28 06:56:19,683][106226] Updated weights for policy 0, policy_version 1624998 (0.0006) [2023-12-28 06:56:19,750][106226] Updated weights for policy 0, policy_version 1625008 (0.0006) [2023-12-28 06:56:20,127][106225] Updated weights for policy 1, policy_version 1628736 (0.0008) [2023-12-28 06:56:20,180][106225] Updated weights for policy 1, policy_version 1628746 (0.0009) [2023-12-28 06:56:20,234][106225] Updated weights for policy 1, policy_version 1628756 (0.0009) [2023-12-28 06:56:20,443][106226] Updated weights for policy 0, policy_version 1625018 (0.0007) [2023-12-28 06:56:20,499][106226] Updated weights for policy 0, policy_version 1625028 (0.0007) [2023-12-28 06:56:20,555][106226] Updated weights for policy 0, policy_version 1625038 (0.0005) [2023-12-28 06:56:20,618][106226] Updated weights for policy 0, policy_version 1625048 (0.0007) [2023-12-28 06:56:20,993][106225] Updated weights for policy 1, policy_version 1628766 (0.0008) [2023-12-28 06:56:21,058][106225] Updated weights for policy 1, policy_version 1628776 (0.0009) [2023-12-28 06:56:21,120][106225] Updated weights for policy 1, policy_version 1628786 (0.0008) [2023-12-28 06:56:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 833110016. Throughput: 0: 10014.3, 1: 9776.3. Samples: 833117464. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:21,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.644')] [2023-12-28 06:56:21,306][106226] Updated weights for policy 0, policy_version 1625058 (0.0008) [2023-12-28 06:56:21,374][106226] Updated weights for policy 0, policy_version 1625068 (0.0008) [2023-12-28 06:56:21,440][106226] Updated weights for policy 0, policy_version 1625078 (0.0008) [2023-12-28 06:56:21,889][106225] Updated weights for policy 1, policy_version 1628796 (0.0007) [2023-12-28 06:56:21,948][106225] Updated weights for policy 1, policy_version 1628806 (0.0005) [2023-12-28 06:56:22,018][106225] Updated weights for policy 1, policy_version 1628816 (0.0006) [2023-12-28 06:56:22,195][106226] Updated weights for policy 0, policy_version 1625088 (0.0009) [2023-12-28 06:56:22,254][106226] Updated weights for policy 0, policy_version 1625098 (0.0010) [2023-12-28 06:56:22,322][106226] Updated weights for policy 0, policy_version 1625108 (0.0008) [2023-12-28 06:56:22,672][106225] Updated weights for policy 1, policy_version 1628826 (0.0006) [2023-12-28 06:56:22,734][106225] Updated weights for policy 1, policy_version 1628836 (0.0009) [2023-12-28 06:56:22,799][106225] Updated weights for policy 1, policy_version 1628846 (0.0009) [2023-12-28 06:56:22,860][106225] Updated weights for policy 1, policy_version 1628856 (0.0008) [2023-12-28 06:56:23,117][106226] Updated weights for policy 0, policy_version 1625118 (0.0010) [2023-12-28 06:56:23,183][106226] Updated weights for policy 0, policy_version 1625128 (0.0011) [2023-12-28 06:56:23,238][106226] Updated weights for policy 0, policy_version 1625138 (0.0011) [2023-12-28 06:56:23,655][106225] Updated weights for policy 1, policy_version 1628866 (0.0005) [2023-12-28 06:56:23,712][106225] Updated weights for policy 1, policy_version 1628876 (0.0005) [2023-12-28 06:56:23,772][106225] Updated weights for policy 1, policy_version 1628886 (0.0005) [2023-12-28 06:56:23,885][106226] Updated weights for policy 0, policy_version 1625148 (0.0007) [2023-12-28 06:56:23,934][106226] Updated weights for policy 0, policy_version 1625158 (0.0007) [2023-12-28 06:56:23,996][106226] Updated weights for policy 0, policy_version 1625168 (0.0005) [2023-12-28 06:56:24,459][106225] Updated weights for policy 1, policy_version 1628896 (0.0006) [2023-12-28 06:56:24,525][106225] Updated weights for policy 1, policy_version 1628906 (0.0010) [2023-12-28 06:56:24,577][106226] Updated weights for policy 0, policy_version 1625178 (0.0006) [2023-12-28 06:56:24,589][106225] Updated weights for policy 1, policy_version 1628916 (0.0007) [2023-12-28 06:56:24,633][106226] Updated weights for policy 0, policy_version 1625188 (0.0009) [2023-12-28 06:56:24,683][106226] Updated weights for policy 0, policy_version 1625198 (0.0007) [2023-12-28 06:56:24,740][106226] Updated weights for policy 0, policy_version 1625208 (0.0005) [2023-12-28 06:56:25,293][106226] Updated weights for policy 0, policy_version 1625218 (0.0008) [2023-12-28 06:56:25,295][106225] Updated weights for policy 1, policy_version 1628926 (0.0005) [2023-12-28 06:56:25,351][106225] Updated weights for policy 1, policy_version 1628936 (0.0006) [2023-12-28 06:56:25,353][106226] Updated weights for policy 0, policy_version 1625228 (0.0007) [2023-12-28 06:56:25,402][106225] Updated weights for policy 1, policy_version 1628946 (0.0007) [2023-12-28 06:56:25,410][106226] Updated weights for policy 0, policy_version 1625238 (0.0005) [2023-12-28 06:56:26,105][106226] Updated weights for policy 0, policy_version 1625248 (0.0009) [2023-12-28 06:56:26,138][106225] Updated weights for policy 1, policy_version 1628956 (0.0007) [2023-12-28 06:56:26,152][106226] Updated weights for policy 0, policy_version 1625258 (0.0007) [2023-12-28 06:56:26,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 833200128. Throughput: 0: 9990.4, 1: 9757.3. Samples: 833174364. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:26,176][105115] Avg episode reward: [(0, '-4.482'), (1, '-4.851')] [2023-12-28 06:56:26,190][106225] Updated weights for policy 1, policy_version 1628966 (0.0007) [2023-12-28 06:56:26,201][106226] Updated weights for policy 0, policy_version 1625268 (0.0005) [2023-12-28 06:56:26,217][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001625272_416145408.pth... [2023-12-28 06:56:26,220][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001624088_415842304.pth [2023-12-28 06:56:26,237][106225] Updated weights for policy 1, policy_version 1628976 (0.0006) [2023-12-28 06:56:26,274][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001628984_417071104.pth... [2023-12-28 06:56:26,277][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001627832_416776192.pth [2023-12-28 06:56:26,801][106225] Updated weights for policy 1, policy_version 1628986 (0.0005) [2023-12-28 06:56:26,865][106225] Updated weights for policy 1, policy_version 1628996 (0.0005) [2023-12-28 06:56:26,930][106225] Updated weights for policy 1, policy_version 1629006 (0.0005) [2023-12-28 06:56:26,991][106225] Updated weights for policy 1, policy_version 1629016 (0.0005) [2023-12-28 06:56:27,061][106226] Updated weights for policy 0, policy_version 1625278 (0.0008) [2023-12-28 06:56:27,115][106226] Updated weights for policy 0, policy_version 1625288 (0.0008) [2023-12-28 06:56:27,164][106226] Updated weights for policy 0, policy_version 1625298 (0.0008) [2023-12-28 06:56:27,502][106225] Updated weights for policy 1, policy_version 1629026 (0.0005) [2023-12-28 06:56:27,551][106225] Updated weights for policy 1, policy_version 1629036 (0.0005) [2023-12-28 06:56:27,601][106225] Updated weights for policy 1, policy_version 1629046 (0.0005) [2023-12-28 06:56:27,997][106226] Updated weights for policy 0, policy_version 1625308 (0.0009) [2023-12-28 06:56:28,071][106226] Updated weights for policy 0, policy_version 1625318 (0.0010) [2023-12-28 06:56:28,132][106226] Updated weights for policy 0, policy_version 1625328 (0.0007) [2023-12-28 06:56:28,141][106225] Updated weights for policy 1, policy_version 1629056 (0.0008) [2023-12-28 06:56:28,197][106225] Updated weights for policy 1, policy_version 1629066 (0.0005) [2023-12-28 06:56:28,259][106225] Updated weights for policy 1, policy_version 1629076 (0.0005) [2023-12-28 06:56:28,885][106225] Updated weights for policy 1, policy_version 1629086 (0.0009) [2023-12-28 06:56:28,903][106226] Updated weights for policy 0, policy_version 1625338 (0.0008) [2023-12-28 06:56:28,944][106225] Updated weights for policy 1, policy_version 1629096 (0.0006) [2023-12-28 06:56:28,965][106226] Updated weights for policy 0, policy_version 1625348 (0.0008) [2023-12-28 06:56:29,008][106225] Updated weights for policy 1, policy_version 1629106 (0.0008) [2023-12-28 06:56:29,018][106226] Updated weights for policy 0, policy_version 1625358 (0.0005) [2023-12-28 06:56:29,068][106226] Updated weights for policy 0, policy_version 1625368 (0.0005) [2023-12-28 06:56:29,705][106226] Updated weights for policy 0, policy_version 1625378 (0.0008) [2023-12-28 06:56:29,763][106226] Updated weights for policy 0, policy_version 1625388 (0.0008) [2023-12-28 06:56:29,802][106225] Updated weights for policy 1, policy_version 1629116 (0.0006) [2023-12-28 06:56:29,822][106226] Updated weights for policy 0, policy_version 1625398 (0.0009) [2023-12-28 06:56:29,867][106225] Updated weights for policy 1, policy_version 1629126 (0.0008) [2023-12-28 06:56:29,929][106225] Updated weights for policy 1, policy_version 1629136 (0.0007) [2023-12-28 06:56:30,499][106225] Updated weights for policy 1, policy_version 1629146 (0.0006) [2023-12-28 06:56:30,557][106225] Updated weights for policy 1, policy_version 1629156 (0.0006) [2023-12-28 06:56:30,563][106226] Updated weights for policy 0, policy_version 1625408 (0.0006) [2023-12-28 06:56:30,614][106225] Updated weights for policy 1, policy_version 1629166 (0.0006) [2023-12-28 06:56:30,624][106226] Updated weights for policy 0, policy_version 1625418 (0.0009) [2023-12-28 06:56:30,667][106225] Updated weights for policy 1, policy_version 1629176 (0.0006) [2023-12-28 06:56:30,682][106226] Updated weights for policy 0, policy_version 1625428 (0.0008) [2023-12-28 06:56:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 833306624. Throughput: 0: 10021.6, 1: 9840.0. Samples: 833297144. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:31,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.843')] [2023-12-28 06:56:31,306][106225] Updated weights for policy 1, policy_version 1629186 (0.0009) [2023-12-28 06:56:31,370][106225] Updated weights for policy 1, policy_version 1629196 (0.0008) [2023-12-28 06:56:31,383][106226] Updated weights for policy 0, policy_version 1625438 (0.0008) [2023-12-28 06:56:31,431][106225] Updated weights for policy 1, policy_version 1629206 (0.0008) [2023-12-28 06:56:31,444][106226] Updated weights for policy 0, policy_version 1625448 (0.0007) [2023-12-28 06:56:31,499][106226] Updated weights for policy 0, policy_version 1625458 (0.0008) [2023-12-28 06:56:32,198][106226] Updated weights for policy 0, policy_version 1625468 (0.0009) [2023-12-28 06:56:32,217][106225] Updated weights for policy 1, policy_version 1629216 (0.0008) [2023-12-28 06:56:32,259][106226] Updated weights for policy 0, policy_version 1625478 (0.0008) [2023-12-28 06:56:32,274][106225] Updated weights for policy 1, policy_version 1629226 (0.0006) [2023-12-28 06:56:32,312][106226] Updated weights for policy 0, policy_version 1625488 (0.0006) [2023-12-28 06:56:32,326][106225] Updated weights for policy 1, policy_version 1629236 (0.0007) [2023-12-28 06:56:33,061][106226] Updated weights for policy 0, policy_version 1625498 (0.0007) [2023-12-28 06:56:33,095][106225] Updated weights for policy 1, policy_version 1629246 (0.0007) [2023-12-28 06:56:33,120][106226] Updated weights for policy 0, policy_version 1625508 (0.0009) [2023-12-28 06:56:33,147][106225] Updated weights for policy 1, policy_version 1629256 (0.0007) [2023-12-28 06:56:33,177][106226] Updated weights for policy 0, policy_version 1625518 (0.0007) [2023-12-28 06:56:33,209][106225] Updated weights for policy 1, policy_version 1629266 (0.0007) [2023-12-28 06:56:33,235][106226] Updated weights for policy 0, policy_version 1625528 (0.0007) [2023-12-28 06:56:33,932][106225] Updated weights for policy 1, policy_version 1629276 (0.0005) [2023-12-28 06:56:33,957][106226] Updated weights for policy 0, policy_version 1625538 (0.0008) [2023-12-28 06:56:33,984][106225] Updated weights for policy 1, policy_version 1629286 (0.0005) [2023-12-28 06:56:34,009][106226] Updated weights for policy 0, policy_version 1625548 (0.0008) [2023-12-28 06:56:34,034][106225] Updated weights for policy 1, policy_version 1629296 (0.0006) [2023-12-28 06:56:34,066][106226] Updated weights for policy 0, policy_version 1625558 (0.0009) [2023-12-28 06:56:34,691][106226] Updated weights for policy 0, policy_version 1625568 (0.0006) [2023-12-28 06:56:34,753][106226] Updated weights for policy 0, policy_version 1625578 (0.0006) [2023-12-28 06:56:34,754][106225] Updated weights for policy 1, policy_version 1629306 (0.0006) [2023-12-28 06:56:34,821][106225] Updated weights for policy 1, policy_version 1629316 (0.0010) [2023-12-28 06:56:34,826][106226] Updated weights for policy 0, policy_version 1625588 (0.0005) [2023-12-28 06:56:34,878][106225] Updated weights for policy 1, policy_version 1629326 (0.0010) [2023-12-28 06:56:34,927][106225] Updated weights for policy 1, policy_version 1629336 (0.0009) [2023-12-28 06:56:35,362][106226] Updated weights for policy 0, policy_version 1625598 (0.0008) [2023-12-28 06:56:35,421][106226] Updated weights for policy 0, policy_version 1625608 (0.0008) [2023-12-28 06:56:35,484][106226] Updated weights for policy 0, policy_version 1625618 (0.0007) [2023-12-28 06:56:35,617][106225] Updated weights for policy 1, policy_version 1629346 (0.0010) [2023-12-28 06:56:35,678][106225] Updated weights for policy 1, policy_version 1629356 (0.0010) [2023-12-28 06:56:35,739][106225] Updated weights for policy 1, policy_version 1629366 (0.0007) [2023-12-28 06:56:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 833404928. Throughput: 0: 10000.3, 1: 9794.8. Samples: 833417396. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:36,175][105115] Avg episode reward: [(0, '-4.661'), (1, '-4.781')] [2023-12-28 06:56:36,233][106226] Updated weights for policy 0, policy_version 1625628 (0.0008) [2023-12-28 06:56:36,305][106226] Updated weights for policy 0, policy_version 1625638 (0.0010) [2023-12-28 06:56:36,373][106226] Updated weights for policy 0, policy_version 1625648 (0.0011) [2023-12-28 06:56:36,430][106225] Updated weights for policy 1, policy_version 1629376 (0.0006) [2023-12-28 06:56:36,495][106225] Updated weights for policy 1, policy_version 1629386 (0.0008) [2023-12-28 06:56:36,556][106225] Updated weights for policy 1, policy_version 1629396 (0.0008) [2023-12-28 06:56:37,044][106226] Updated weights for policy 0, policy_version 1625658 (0.0010) [2023-12-28 06:56:37,104][106226] Updated weights for policy 0, policy_version 1625668 (0.0005) [2023-12-28 06:56:37,171][106226] Updated weights for policy 0, policy_version 1625678 (0.0008) [2023-12-28 06:56:37,235][106226] Updated weights for policy 0, policy_version 1625688 (0.0008) [2023-12-28 06:56:37,255][106225] Updated weights for policy 1, policy_version 1629406 (0.0008) [2023-12-28 06:56:37,311][106225] Updated weights for policy 1, policy_version 1629416 (0.0008) [2023-12-28 06:56:37,358][106225] Updated weights for policy 1, policy_version 1629426 (0.0008) [2023-12-28 06:56:37,902][106226] Updated weights for policy 0, policy_version 1625698 (0.0011) [2023-12-28 06:56:37,955][106226] Updated weights for policy 0, policy_version 1625708 (0.0010) [2023-12-28 06:56:38,004][106226] Updated weights for policy 0, policy_version 1625718 (0.0010) [2023-12-28 06:56:38,022][106225] Updated weights for policy 1, policy_version 1629436 (0.0006) [2023-12-28 06:56:38,081][106225] Updated weights for policy 1, policy_version 1629446 (0.0008) [2023-12-28 06:56:38,141][106225] Updated weights for policy 1, policy_version 1629456 (0.0008) [2023-12-28 06:56:38,715][106226] Updated weights for policy 0, policy_version 1625728 (0.0011) [2023-12-28 06:56:38,780][106226] Updated weights for policy 0, policy_version 1625738 (0.0011) [2023-12-28 06:56:38,834][106226] Updated weights for policy 0, policy_version 1625748 (0.0010) [2023-12-28 06:56:38,857][106225] Updated weights for policy 1, policy_version 1629466 (0.0007) [2023-12-28 06:56:38,923][106225] Updated weights for policy 1, policy_version 1629476 (0.0008) [2023-12-28 06:56:38,987][106225] Updated weights for policy 1, policy_version 1629486 (0.0008) [2023-12-28 06:56:39,049][106225] Updated weights for policy 1, policy_version 1629496 (0.0006) [2023-12-28 06:56:39,604][106226] Updated weights for policy 0, policy_version 1625758 (0.0009) [2023-12-28 06:56:39,665][106226] Updated weights for policy 0, policy_version 1625768 (0.0009) [2023-12-28 06:56:39,730][106226] Updated weights for policy 0, policy_version 1625778 (0.0008) [2023-12-28 06:56:39,761][106225] Updated weights for policy 1, policy_version 1629506 (0.0007) [2023-12-28 06:56:39,828][106225] Updated weights for policy 1, policy_version 1629516 (0.0008) [2023-12-28 06:56:39,894][106225] Updated weights for policy 1, policy_version 1629526 (0.0008) [2023-12-28 06:56:40,402][106226] Updated weights for policy 0, policy_version 1625788 (0.0007) [2023-12-28 06:56:40,457][106226] Updated weights for policy 0, policy_version 1625798 (0.0008) [2023-12-28 06:56:40,522][106226] Updated weights for policy 0, policy_version 1625808 (0.0008) [2023-12-28 06:56:40,584][106225] Updated weights for policy 1, policy_version 1629536 (0.0008) [2023-12-28 06:56:40,651][106225] Updated weights for policy 1, policy_version 1629546 (0.0009) [2023-12-28 06:56:40,711][106225] Updated weights for policy 1, policy_version 1629556 (0.0008) [2023-12-28 06:56:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 833503232. Throughput: 0: 9989.7, 1: 9830.5. Samples: 833476168. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:41,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.699')] [2023-12-28 06:56:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001629560_417218560.pth... [2023-12-28 06:56:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001628408_416923648.pth [2023-12-28 06:56:41,188][106226] Updated weights for policy 0, policy_version 1625818 (0.0007) [2023-12-28 06:56:41,253][106226] Updated weights for policy 0, policy_version 1625828 (0.0008) [2023-12-28 06:56:41,318][106226] Updated weights for policy 0, policy_version 1625838 (0.0009) [2023-12-28 06:56:41,386][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001625848_416292864.pth... [2023-12-28 06:56:41,388][106226] Updated weights for policy 0, policy_version 1625848 (0.0009) [2023-12-28 06:56:41,389][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001624664_415989760.pth [2023-12-28 06:56:41,512][106225] Updated weights for policy 1, policy_version 1629566 (0.0008) [2023-12-28 06:56:41,568][106225] Updated weights for policy 1, policy_version 1629576 (0.0008) [2023-12-28 06:56:41,630][106225] Updated weights for policy 1, policy_version 1629586 (0.0008) [2023-12-28 06:56:42,139][106226] Updated weights for policy 0, policy_version 1625858 (0.0008) [2023-12-28 06:56:42,203][106226] Updated weights for policy 0, policy_version 1625868 (0.0008) [2023-12-28 06:56:42,270][106226] Updated weights for policy 0, policy_version 1625878 (0.0009) [2023-12-28 06:56:42,411][106225] Updated weights for policy 1, policy_version 1629596 (0.0008) [2023-12-28 06:56:42,468][106225] Updated weights for policy 1, policy_version 1629606 (0.0008) [2023-12-28 06:56:42,522][106225] Updated weights for policy 1, policy_version 1629616 (0.0008) [2023-12-28 06:56:42,960][106226] Updated weights for policy 0, policy_version 1625888 (0.0009) [2023-12-28 06:56:43,026][106226] Updated weights for policy 0, policy_version 1625898 (0.0007) [2023-12-28 06:56:43,087][106226] Updated weights for policy 0, policy_version 1625908 (0.0010) [2023-12-28 06:56:43,253][106225] Updated weights for policy 1, policy_version 1629626 (0.0008) [2023-12-28 06:56:43,303][106225] Updated weights for policy 1, policy_version 1629636 (0.0007) [2023-12-28 06:56:43,350][106225] Updated weights for policy 1, policy_version 1629646 (0.0007) [2023-12-28 06:56:43,407][106225] Updated weights for policy 1, policy_version 1629656 (0.0007) [2023-12-28 06:56:43,815][106226] Updated weights for policy 0, policy_version 1625918 (0.0010) [2023-12-28 06:56:43,873][106226] Updated weights for policy 0, policy_version 1625928 (0.0010) [2023-12-28 06:56:43,939][106226] Updated weights for policy 0, policy_version 1625938 (0.0011) [2023-12-28 06:56:44,050][106225] Updated weights for policy 1, policy_version 1629666 (0.0005) [2023-12-28 06:56:44,098][106225] Updated weights for policy 1, policy_version 1629676 (0.0006) [2023-12-28 06:56:44,145][106225] Updated weights for policy 1, policy_version 1629686 (0.0007) [2023-12-28 06:56:44,523][106226] Updated weights for policy 0, policy_version 1625948 (0.0009) [2023-12-28 06:56:44,586][106226] Updated weights for policy 0, policy_version 1625958 (0.0006) [2023-12-28 06:56:44,652][106226] Updated weights for policy 0, policy_version 1625968 (0.0011) [2023-12-28 06:56:44,877][106225] Updated weights for policy 1, policy_version 1629696 (0.0009) [2023-12-28 06:56:44,931][106225] Updated weights for policy 1, policy_version 1629706 (0.0010) [2023-12-28 06:56:44,985][106225] Updated weights for policy 1, policy_version 1629716 (0.0009) [2023-12-28 06:56:45,292][106226] Updated weights for policy 0, policy_version 1625978 (0.0010) [2023-12-28 06:56:45,352][106226] Updated weights for policy 0, policy_version 1625988 (0.0010) [2023-12-28 06:56:45,422][106226] Updated weights for policy 0, policy_version 1625998 (0.0010) [2023-12-28 06:56:45,489][106226] Updated weights for policy 0, policy_version 1626008 (0.0005) [2023-12-28 06:56:45,701][106225] Updated weights for policy 1, policy_version 1629726 (0.0008) [2023-12-28 06:56:45,758][106225] Updated weights for policy 1, policy_version 1629736 (0.0007) [2023-12-28 06:56:45,800][106225] Updated weights for policy 1, policy_version 1629746 (0.0008) [2023-12-28 06:56:46,089][106226] Updated weights for policy 0, policy_version 1626018 (0.0005) [2023-12-28 06:56:46,147][106226] Updated weights for policy 0, policy_version 1626028 (0.0006) [2023-12-28 06:56:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 833601536. Throughput: 0: 9895.2, 1: 9861.5. Samples: 833594276. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:46,176][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.836')] [2023-12-28 06:56:46,208][106226] Updated weights for policy 0, policy_version 1626038 (0.0006) [2023-12-28 06:56:46,530][106225] Updated weights for policy 1, policy_version 1629756 (0.0008) [2023-12-28 06:56:46,583][106225] Updated weights for policy 1, policy_version 1629766 (0.0008) [2023-12-28 06:56:46,631][106225] Updated weights for policy 1, policy_version 1629776 (0.0007) [2023-12-28 06:56:46,713][106226] Updated weights for policy 0, policy_version 1626048 (0.0006) [2023-12-28 06:56:46,772][106226] Updated weights for policy 0, policy_version 1626058 (0.0009) [2023-12-28 06:56:46,837][106226] Updated weights for policy 0, policy_version 1626068 (0.0006) [2023-12-28 06:56:47,385][106226] Updated weights for policy 0, policy_version 1626078 (0.0005) [2023-12-28 06:56:47,446][106226] Updated weights for policy 0, policy_version 1626088 (0.0008) [2023-12-28 06:56:47,469][106225] Updated weights for policy 1, policy_version 1629786 (0.0009) [2023-12-28 06:56:47,508][106226] Updated weights for policy 0, policy_version 1626098 (0.0010) [2023-12-28 06:56:47,518][106225] Updated weights for policy 1, policy_version 1629796 (0.0006) [2023-12-28 06:56:47,569][106225] Updated weights for policy 1, policy_version 1629806 (0.0006) [2023-12-28 06:56:47,617][106225] Updated weights for policy 1, policy_version 1629816 (0.0007) [2023-12-28 06:56:48,140][106226] Updated weights for policy 0, policy_version 1626108 (0.0011) [2023-12-28 06:56:48,198][106226] Updated weights for policy 0, policy_version 1626118 (0.0009) [2023-12-28 06:56:48,249][106226] Updated weights for policy 0, policy_version 1626128 (0.0008) [2023-12-28 06:56:48,350][106225] Updated weights for policy 1, policy_version 1629826 (0.0010) [2023-12-28 06:56:48,418][106225] Updated weights for policy 1, policy_version 1629836 (0.0009) [2023-12-28 06:56:48,475][106225] Updated weights for policy 1, policy_version 1629846 (0.0010) [2023-12-28 06:56:48,995][106226] Updated weights for policy 0, policy_version 1626138 (0.0007) [2023-12-28 06:56:49,049][106226] Updated weights for policy 0, policy_version 1626148 (0.0006) [2023-12-28 06:56:49,100][106226] Updated weights for policy 0, policy_version 1626158 (0.0008) [2023-12-28 06:56:49,147][106226] Updated weights for policy 0, policy_version 1626168 (0.0005) [2023-12-28 06:56:49,212][106225] Updated weights for policy 1, policy_version 1629856 (0.0010) [2023-12-28 06:56:49,276][106225] Updated weights for policy 1, policy_version 1629866 (0.0009) [2023-12-28 06:56:49,344][106225] Updated weights for policy 1, policy_version 1629876 (0.0008) [2023-12-28 06:56:49,938][106226] Updated weights for policy 0, policy_version 1626178 (0.0010) [2023-12-28 06:56:50,001][106226] Updated weights for policy 0, policy_version 1626188 (0.0010) [2023-12-28 06:56:50,046][106225] Updated weights for policy 1, policy_version 1629886 (0.0008) [2023-12-28 06:56:50,063][106226] Updated weights for policy 0, policy_version 1626198 (0.0006) [2023-12-28 06:56:50,103][106225] Updated weights for policy 1, policy_version 1629896 (0.0008) [2023-12-28 06:56:50,163][106225] Updated weights for policy 1, policy_version 1629906 (0.0009) [2023-12-28 06:56:50,688][106226] Updated weights for policy 0, policy_version 1626208 (0.0010) [2023-12-28 06:56:50,752][106226] Updated weights for policy 0, policy_version 1626218 (0.0010) [2023-12-28 06:56:50,813][106226] Updated weights for policy 0, policy_version 1626228 (0.0011) [2023-12-28 06:56:50,951][106225] Updated weights for policy 1, policy_version 1629916 (0.0007) [2023-12-28 06:56:51,007][106225] Updated weights for policy 1, policy_version 1629926 (0.0008) [2023-12-28 06:56:51,072][106225] Updated weights for policy 1, policy_version 1629936 (0.0008) [2023-12-28 06:56:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 833708032. Throughput: 0: 9966.8, 1: 9788.5. Samples: 833714312. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:51,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.580')] [2023-12-28 06:56:51,499][106226] Updated weights for policy 0, policy_version 1626238 (0.0011) [2023-12-28 06:56:51,556][106226] Updated weights for policy 0, policy_version 1626248 (0.0011) [2023-12-28 06:56:51,623][106226] Updated weights for policy 0, policy_version 1626258 (0.0011) [2023-12-28 06:56:51,877][106225] Updated weights for policy 1, policy_version 1629946 (0.0010) [2023-12-28 06:56:51,939][106225] Updated weights for policy 1, policy_version 1629956 (0.0011) [2023-12-28 06:56:52,003][106225] Updated weights for policy 1, policy_version 1629966 (0.0010) [2023-12-28 06:56:52,067][106225] Updated weights for policy 1, policy_version 1629976 (0.0010) [2023-12-28 06:56:52,383][106226] Updated weights for policy 0, policy_version 1626268 (0.0006) [2023-12-28 06:56:52,449][106226] Updated weights for policy 0, policy_version 1626278 (0.0007) [2023-12-28 06:56:52,515][106226] Updated weights for policy 0, policy_version 1626288 (0.0007) [2023-12-28 06:56:52,855][106225] Updated weights for policy 1, policy_version 1629986 (0.0010) [2023-12-28 06:56:52,909][106225] Updated weights for policy 1, policy_version 1629996 (0.0010) [2023-12-28 06:56:52,967][106225] Updated weights for policy 1, policy_version 1630006 (0.0007) [2023-12-28 06:56:53,233][106226] Updated weights for policy 0, policy_version 1626298 (0.0006) [2023-12-28 06:56:53,283][106226] Updated weights for policy 0, policy_version 1626308 (0.0009) [2023-12-28 06:56:53,348][106226] Updated weights for policy 0, policy_version 1626318 (0.0009) [2023-12-28 06:56:53,410][106226] Updated weights for policy 0, policy_version 1626328 (0.0009) [2023-12-28 06:56:53,635][106225] Updated weights for policy 1, policy_version 1630016 (0.0010) [2023-12-28 06:56:53,693][106225] Updated weights for policy 1, policy_version 1630026 (0.0010) [2023-12-28 06:56:53,747][106225] Updated weights for policy 1, policy_version 1630036 (0.0010) [2023-12-28 06:56:54,180][106226] Updated weights for policy 0, policy_version 1626338 (0.0008) [2023-12-28 06:56:54,246][106226] Updated weights for policy 0, policy_version 1626348 (0.0008) [2023-12-28 06:56:54,304][106226] Updated weights for policy 0, policy_version 1626358 (0.0008) [2023-12-28 06:56:54,478][106225] Updated weights for policy 1, policy_version 1630046 (0.0011) [2023-12-28 06:56:54,542][106225] Updated weights for policy 1, policy_version 1630056 (0.0011) [2023-12-28 06:56:54,605][106225] Updated weights for policy 1, policy_version 1630066 (0.0010) [2023-12-28 06:56:55,030][106226] Updated weights for policy 0, policy_version 1626368 (0.0008) [2023-12-28 06:56:55,081][106226] Updated weights for policy 0, policy_version 1626378 (0.0008) [2023-12-28 06:56:55,127][106226] Updated weights for policy 0, policy_version 1626388 (0.0007) [2023-12-28 06:56:55,323][106225] Updated weights for policy 1, policy_version 1630076 (0.0010) [2023-12-28 06:56:55,376][106225] Updated weights for policy 1, policy_version 1630086 (0.0010) [2023-12-28 06:56:55,428][106225] Updated weights for policy 1, policy_version 1630096 (0.0010) [2023-12-28 06:56:55,884][106226] Updated weights for policy 0, policy_version 1626398 (0.0008) [2023-12-28 06:56:55,937][106226] Updated weights for policy 0, policy_version 1626408 (0.0007) [2023-12-28 06:56:55,989][106226] Updated weights for policy 0, policy_version 1626418 (0.0007) [2023-12-28 06:56:56,156][106225] Updated weights for policy 1, policy_version 1630106 (0.0010) [2023-12-28 06:56:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 833798144. Throughput: 0: 9913.4, 1: 9766.5. Samples: 833770676. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:56:56,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.739')] [2023-12-28 06:56:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001626424_416440320.pth... [2023-12-28 06:56:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001625272_416145408.pth [2023-12-28 06:56:56,226][106225] Updated weights for policy 1, policy_version 1630116 (0.0011) [2023-12-28 06:56:56,280][106225] Updated weights for policy 1, policy_version 1630126 (0.0010) [2023-12-28 06:56:56,330][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001630136_417366016.pth... [2023-12-28 06:56:56,331][106225] Updated weights for policy 1, policy_version 1630136 (0.0010) [2023-12-28 06:56:56,337][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001628984_417071104.pth [2023-12-28 06:56:56,715][106226] Updated weights for policy 0, policy_version 1626428 (0.0008) [2023-12-28 06:56:56,764][106226] Updated weights for policy 0, policy_version 1626438 (0.0007) [2023-12-28 06:56:56,815][106226] Updated weights for policy 0, policy_version 1626448 (0.0008) [2023-12-28 06:56:57,046][106225] Updated weights for policy 1, policy_version 1630146 (0.0011) [2023-12-28 06:56:57,096][106225] Updated weights for policy 1, policy_version 1630156 (0.0010) [2023-12-28 06:56:57,146][106225] Updated weights for policy 1, policy_version 1630166 (0.0010) [2023-12-28 06:56:57,570][106226] Updated weights for policy 0, policy_version 1626458 (0.0007) [2023-12-28 06:56:57,624][106226] Updated weights for policy 0, policy_version 1626468 (0.0008) [2023-12-28 06:56:57,670][106226] Updated weights for policy 0, policy_version 1626478 (0.0008) [2023-12-28 06:56:57,717][106226] Updated weights for policy 0, policy_version 1626488 (0.0008) [2023-12-28 06:56:57,883][106225] Updated weights for policy 1, policy_version 1630176 (0.0010) [2023-12-28 06:56:57,933][106225] Updated weights for policy 1, policy_version 1630186 (0.0010) [2023-12-28 06:56:57,992][106225] Updated weights for policy 1, policy_version 1630196 (0.0010) [2023-12-28 06:56:58,482][106226] Updated weights for policy 0, policy_version 1626498 (0.0008) [2023-12-28 06:56:58,543][106226] Updated weights for policy 0, policy_version 1626508 (0.0008) [2023-12-28 06:56:58,608][106226] Updated weights for policy 0, policy_version 1626518 (0.0008) [2023-12-28 06:56:58,769][106225] Updated weights for policy 1, policy_version 1630206 (0.0010) [2023-12-28 06:56:58,837][106225] Updated weights for policy 1, policy_version 1630216 (0.0009) [2023-12-28 06:56:58,908][106225] Updated weights for policy 1, policy_version 1630226 (0.0009) [2023-12-28 06:56:59,439][106226] Updated weights for policy 0, policy_version 1626528 (0.0010) [2023-12-28 06:56:59,497][106226] Updated weights for policy 0, policy_version 1626538 (0.0010) [2023-12-28 06:56:59,554][106226] Updated weights for policy 0, policy_version 1626548 (0.0010) [2023-12-28 06:56:59,697][106225] Updated weights for policy 1, policy_version 1630236 (0.0008) [2023-12-28 06:56:59,759][106225] Updated weights for policy 1, policy_version 1630246 (0.0005) [2023-12-28 06:56:59,813][106225] Updated weights for policy 1, policy_version 1630256 (0.0006) [2023-12-28 06:57:00,256][106226] Updated weights for policy 0, policy_version 1626558 (0.0007) [2023-12-28 06:57:00,327][106226] Updated weights for policy 0, policy_version 1626568 (0.0008) [2023-12-28 06:57:00,391][106226] Updated weights for policy 0, policy_version 1626578 (0.0008) [2023-12-28 06:57:00,471][106225] Updated weights for policy 1, policy_version 1630266 (0.0008) [2023-12-28 06:57:00,524][106225] Updated weights for policy 1, policy_version 1630276 (0.0007) [2023-12-28 06:57:00,576][106225] Updated weights for policy 1, policy_version 1630286 (0.0006) [2023-12-28 06:57:00,637][106225] Updated weights for policy 1, policy_version 1630296 (0.0006) [2023-12-28 06:57:00,948][106226] Updated weights for policy 0, policy_version 1626588 (0.0007) [2023-12-28 06:57:01,004][106226] Updated weights for policy 0, policy_version 1626598 (0.0008) [2023-12-28 06:57:01,062][106226] Updated weights for policy 0, policy_version 1626608 (0.0007) [2023-12-28 06:57:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 833896448. Throughput: 0: 9887.6, 1: 9698.8. Samples: 833883024. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:01,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.577')] [2023-12-28 06:57:01,291][106225] Updated weights for policy 1, policy_version 1630306 (0.0007) [2023-12-28 06:57:01,361][106225] Updated weights for policy 1, policy_version 1630316 (0.0009) [2023-12-28 06:57:01,425][106225] Updated weights for policy 1, policy_version 1630326 (0.0009) [2023-12-28 06:57:01,809][106226] Updated weights for policy 0, policy_version 1626618 (0.0009) [2023-12-28 06:57:01,870][106226] Updated weights for policy 0, policy_version 1626628 (0.0010) [2023-12-28 06:57:01,932][106226] Updated weights for policy 0, policy_version 1626638 (0.0006) [2023-12-28 06:57:01,994][106226] Updated weights for policy 0, policy_version 1626648 (0.0006) [2023-12-28 06:57:02,162][106225] Updated weights for policy 1, policy_version 1630336 (0.0008) [2023-12-28 06:57:02,220][106225] Updated weights for policy 1, policy_version 1630346 (0.0008) [2023-12-28 06:57:02,273][106225] Updated weights for policy 1, policy_version 1630356 (0.0008) [2023-12-28 06:57:02,624][106226] Updated weights for policy 0, policy_version 1626658 (0.0008) [2023-12-28 06:57:02,677][106226] Updated weights for policy 0, policy_version 1626668 (0.0008) [2023-12-28 06:57:02,728][106226] Updated weights for policy 0, policy_version 1626678 (0.0008) [2023-12-28 06:57:03,015][106225] Updated weights for policy 1, policy_version 1630366 (0.0008) [2023-12-28 06:57:03,063][106225] Updated weights for policy 1, policy_version 1630376 (0.0009) [2023-12-28 06:57:03,113][106225] Updated weights for policy 1, policy_version 1630386 (0.0009) [2023-12-28 06:57:03,450][106226] Updated weights for policy 0, policy_version 1626688 (0.0009) [2023-12-28 06:57:03,505][106226] Updated weights for policy 0, policy_version 1626698 (0.0008) [2023-12-28 06:57:03,553][106226] Updated weights for policy 0, policy_version 1626708 (0.0008) [2023-12-28 06:57:03,745][106225] Updated weights for policy 1, policy_version 1630396 (0.0008) [2023-12-28 06:57:03,795][106225] Updated weights for policy 1, policy_version 1630406 (0.0010) [2023-12-28 06:57:03,860][106225] Updated weights for policy 1, policy_version 1630416 (0.0010) [2023-12-28 06:57:04,233][106226] Updated weights for policy 0, policy_version 1626718 (0.0009) [2023-12-28 06:57:04,295][106226] Updated weights for policy 0, policy_version 1626728 (0.0010) [2023-12-28 06:57:04,359][106226] Updated weights for policy 0, policy_version 1626738 (0.0010) [2023-12-28 06:57:04,587][106225] Updated weights for policy 1, policy_version 1630426 (0.0010) [2023-12-28 06:57:04,638][106225] Updated weights for policy 1, policy_version 1630436 (0.0005) [2023-12-28 06:57:04,686][106225] Updated weights for policy 1, policy_version 1630446 (0.0005) [2023-12-28 06:57:04,741][106225] Updated weights for policy 1, policy_version 1630456 (0.0007) [2023-12-28 06:57:05,064][106226] Updated weights for policy 0, policy_version 1626748 (0.0009) [2023-12-28 06:57:05,122][106226] Updated weights for policy 0, policy_version 1626758 (0.0009) [2023-12-28 06:57:05,178][106226] Updated weights for policy 0, policy_version 1626768 (0.0010) [2023-12-28 06:57:05,375][106225] Updated weights for policy 1, policy_version 1630466 (0.0006) [2023-12-28 06:57:05,444][106225] Updated weights for policy 1, policy_version 1630476 (0.0008) [2023-12-28 06:57:05,506][106225] Updated weights for policy 1, policy_version 1630486 (0.0008) [2023-12-28 06:57:05,897][106226] Updated weights for policy 0, policy_version 1626778 (0.0010) [2023-12-28 06:57:05,954][106226] Updated weights for policy 0, policy_version 1626788 (0.0011) [2023-12-28 06:57:06,005][106226] Updated weights for policy 0, policy_version 1626798 (0.0010) [2023-12-28 06:57:06,058][106226] Updated weights for policy 0, policy_version 1626808 (0.0010) [2023-12-28 06:57:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 833994752. Throughput: 0: 9912.6, 1: 9802.6. Samples: 834004648. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:06,175][105115] Avg episode reward: [(0, '-4.295'), (1, '-4.799')] [2023-12-28 06:57:06,198][106225] Updated weights for policy 1, policy_version 1630496 (0.0010) [2023-12-28 06:57:06,260][106225] Updated weights for policy 1, policy_version 1630506 (0.0011) [2023-12-28 06:57:06,314][106225] Updated weights for policy 1, policy_version 1630516 (0.0011) [2023-12-28 06:57:06,802][106226] Updated weights for policy 0, policy_version 1626818 (0.0007) [2023-12-28 06:57:06,850][106226] Updated weights for policy 0, policy_version 1626828 (0.0006) [2023-12-28 06:57:06,901][106226] Updated weights for policy 0, policy_version 1626838 (0.0007) [2023-12-28 06:57:07,020][106225] Updated weights for policy 1, policy_version 1630526 (0.0010) [2023-12-28 06:57:07,068][106225] Updated weights for policy 1, policy_version 1630536 (0.0008) [2023-12-28 06:57:07,127][106225] Updated weights for policy 1, policy_version 1630546 (0.0009) [2023-12-28 06:57:07,530][106226] Updated weights for policy 0, policy_version 1626848 (0.0008) [2023-12-28 06:57:07,580][106226] Updated weights for policy 0, policy_version 1626858 (0.0006) [2023-12-28 06:57:07,632][106226] Updated weights for policy 0, policy_version 1626868 (0.0005) [2023-12-28 06:57:07,917][106225] Updated weights for policy 1, policy_version 1630556 (0.0010) [2023-12-28 06:57:07,973][106225] Updated weights for policy 1, policy_version 1630566 (0.0010) [2023-12-28 06:57:08,022][106225] Updated weights for policy 1, policy_version 1630576 (0.0010) [2023-12-28 06:57:08,255][106226] Updated weights for policy 0, policy_version 1626878 (0.0007) [2023-12-28 06:57:08,312][106226] Updated weights for policy 0, policy_version 1626888 (0.0006) [2023-12-28 06:57:08,393][106226] Updated weights for policy 0, policy_version 1626899 (0.0007) [2023-12-28 06:57:08,726][106225] Updated weights for policy 1, policy_version 1630586 (0.0010) [2023-12-28 06:57:08,792][106225] Updated weights for policy 1, policy_version 1630596 (0.0010) [2023-12-28 06:57:08,847][106225] Updated weights for policy 1, policy_version 1630606 (0.0010) [2023-12-28 06:57:08,893][106225] Updated weights for policy 1, policy_version 1630616 (0.0010) [2023-12-28 06:57:09,107][106226] Updated weights for policy 0, policy_version 1626909 (0.0009) [2023-12-28 06:57:09,156][106226] Updated weights for policy 0, policy_version 1626919 (0.0008) [2023-12-28 06:57:09,206][106226] Updated weights for policy 0, policy_version 1626929 (0.0008) [2023-12-28 06:57:09,639][106225] Updated weights for policy 1, policy_version 1630626 (0.0005) [2023-12-28 06:57:09,701][106225] Updated weights for policy 1, policy_version 1630636 (0.0007) [2023-12-28 06:57:09,762][106225] Updated weights for policy 1, policy_version 1630646 (0.0010) [2023-12-28 06:57:10,036][106226] Updated weights for policy 0, policy_version 1626939 (0.0008) [2023-12-28 06:57:10,107][106226] Updated weights for policy 0, policy_version 1626949 (0.0009) [2023-12-28 06:57:10,170][106226] Updated weights for policy 0, policy_version 1626959 (0.0009) [2023-12-28 06:57:10,487][106225] Updated weights for policy 1, policy_version 1630656 (0.0010) [2023-12-28 06:57:10,551][106225] Updated weights for policy 1, policy_version 1630666 (0.0010) [2023-12-28 06:57:10,601][106225] Updated weights for policy 1, policy_version 1630676 (0.0010) [2023-12-28 06:57:10,916][106226] Updated weights for policy 0, policy_version 1626969 (0.0008) [2023-12-28 06:57:10,976][106226] Updated weights for policy 0, policy_version 1626979 (0.0007) [2023-12-28 06:57:11,039][106226] Updated weights for policy 0, policy_version 1626989 (0.0010) [2023-12-28 06:57:11,105][106226] Updated weights for policy 0, policy_version 1626999 (0.0008) [2023-12-28 06:57:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 834093056. Throughput: 0: 9965.7, 1: 9811.9. Samples: 834064352. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:11,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.549')] [2023-12-28 06:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001627000_416587776.pth... [2023-12-28 06:57:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001630680_417505280.pth... [2023-12-28 06:57:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001629560_417218560.pth [2023-12-28 06:57:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001625848_416292864.pth [2023-12-28 06:57:11,275][106225] Updated weights for policy 1, policy_version 1630686 (0.0010) [2023-12-28 06:57:11,338][106225] Updated weights for policy 1, policy_version 1630696 (0.0010) [2023-12-28 06:57:11,412][106225] Updated weights for policy 1, policy_version 1630706 (0.0011) [2023-12-28 06:57:11,927][106226] Updated weights for policy 0, policy_version 1627009 (0.0009) [2023-12-28 06:57:11,992][106226] Updated weights for policy 0, policy_version 1627019 (0.0008) [2023-12-28 06:57:12,050][106226] Updated weights for policy 0, policy_version 1627029 (0.0007) [2023-12-28 06:57:12,219][106225] Updated weights for policy 1, policy_version 1630716 (0.0010) [2023-12-28 06:57:12,277][106225] Updated weights for policy 1, policy_version 1630726 (0.0009) [2023-12-28 06:57:12,342][106225] Updated weights for policy 1, policy_version 1630736 (0.0008) [2023-12-28 06:57:12,773][106226] Updated weights for policy 0, policy_version 1627039 (0.0009) [2023-12-28 06:57:12,835][106226] Updated weights for policy 0, policy_version 1627049 (0.0009) [2023-12-28 06:57:12,893][106226] Updated weights for policy 0, policy_version 1627059 (0.0009) [2023-12-28 06:57:12,991][106225] Updated weights for policy 1, policy_version 1630746 (0.0009) [2023-12-28 06:57:13,056][106225] Updated weights for policy 1, policy_version 1630756 (0.0008) [2023-12-28 06:57:13,111][106225] Updated weights for policy 1, policy_version 1630766 (0.0009) [2023-12-28 06:57:13,166][106225] Updated weights for policy 1, policy_version 1630776 (0.0009) [2023-12-28 06:57:13,504][106226] Updated weights for policy 0, policy_version 1627069 (0.0007) [2023-12-28 06:57:13,562][106226] Updated weights for policy 0, policy_version 1627079 (0.0008) [2023-12-28 06:57:13,620][106226] Updated weights for policy 0, policy_version 1627089 (0.0006) [2023-12-28 06:57:13,805][106225] Updated weights for policy 1, policy_version 1630786 (0.0005) [2023-12-28 06:57:13,855][106225] Updated weights for policy 1, policy_version 1630796 (0.0005) [2023-12-28 06:57:13,921][106225] Updated weights for policy 1, policy_version 1630806 (0.0005) [2023-12-28 06:57:14,355][106226] Updated weights for policy 0, policy_version 1627099 (0.0010) [2023-12-28 06:57:14,413][106226] Updated weights for policy 0, policy_version 1627109 (0.0008) [2023-12-28 06:57:14,459][106225] Updated weights for policy 1, policy_version 1630816 (0.0007) [2023-12-28 06:57:14,468][106226] Updated weights for policy 0, policy_version 1627119 (0.0009) [2023-12-28 06:57:14,519][106225] Updated weights for policy 1, policy_version 1630826 (0.0006) [2023-12-28 06:57:14,575][106225] Updated weights for policy 1, policy_version 1630836 (0.0005) [2023-12-28 06:57:15,234][106226] Updated weights for policy 0, policy_version 1627129 (0.0007) [2023-12-28 06:57:15,264][106225] Updated weights for policy 1, policy_version 1630846 (0.0007) [2023-12-28 06:57:15,292][106226] Updated weights for policy 0, policy_version 1627139 (0.0007) [2023-12-28 06:57:15,327][106225] Updated weights for policy 1, policy_version 1630856 (0.0008) [2023-12-28 06:57:15,349][106226] Updated weights for policy 0, policy_version 1627149 (0.0008) [2023-12-28 06:57:15,386][106225] Updated weights for policy 1, policy_version 1630866 (0.0010) [2023-12-28 06:57:15,407][106226] Updated weights for policy 0, policy_version 1627159 (0.0005) [2023-12-28 06:57:16,005][106225] Updated weights for policy 1, policy_version 1630876 (0.0010) [2023-12-28 06:57:16,054][106225] Updated weights for policy 1, policy_version 1630886 (0.0010) [2023-12-28 06:57:16,110][106225] Updated weights for policy 1, policy_version 1630896 (0.0010) [2023-12-28 06:57:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 834191360. Throughput: 0: 9889.3, 1: 9746.3. Samples: 834180744. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:16,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.674')] [2023-12-28 06:57:16,176][106226] Updated weights for policy 0, policy_version 1627169 (0.0008) [2023-12-28 06:57:16,232][106226] Updated weights for policy 0, policy_version 1627179 (0.0007) [2023-12-28 06:57:16,281][106226] Updated weights for policy 0, policy_version 1627189 (0.0008) [2023-12-28 06:57:16,832][106225] Updated weights for policy 1, policy_version 1630906 (0.0010) [2023-12-28 06:57:16,888][106225] Updated weights for policy 1, policy_version 1630916 (0.0010) [2023-12-28 06:57:16,941][106225] Updated weights for policy 1, policy_version 1630926 (0.0010) [2023-12-28 06:57:16,991][106225] Updated weights for policy 1, policy_version 1630936 (0.0010) [2023-12-28 06:57:17,013][106226] Updated weights for policy 0, policy_version 1627199 (0.0007) [2023-12-28 06:57:17,066][106226] Updated weights for policy 0, policy_version 1627209 (0.0007) [2023-12-28 06:57:17,113][106226] Updated weights for policy 0, policy_version 1627219 (0.0008) [2023-12-28 06:57:17,677][106225] Updated weights for policy 1, policy_version 1630946 (0.0008) [2023-12-28 06:57:17,728][106225] Updated weights for policy 1, policy_version 1630956 (0.0005) [2023-12-28 06:57:17,785][106225] Updated weights for policy 1, policy_version 1630966 (0.0007) [2023-12-28 06:57:17,869][106226] Updated weights for policy 0, policy_version 1627229 (0.0008) [2023-12-28 06:57:17,918][106226] Updated weights for policy 0, policy_version 1627239 (0.0008) [2023-12-28 06:57:17,976][106226] Updated weights for policy 0, policy_version 1627249 (0.0010) [2023-12-28 06:57:18,403][106225] Updated weights for policy 1, policy_version 1630976 (0.0010) [2023-12-28 06:57:18,453][106225] Updated weights for policy 1, policy_version 1630986 (0.0010) [2023-12-28 06:57:18,518][106225] Updated weights for policy 1, policy_version 1630996 (0.0010) [2023-12-28 06:57:18,771][106226] Updated weights for policy 0, policy_version 1627259 (0.0008) [2023-12-28 06:57:18,835][106226] Updated weights for policy 0, policy_version 1627269 (0.0008) [2023-12-28 06:57:18,893][106226] Updated weights for policy 0, policy_version 1627279 (0.0008) [2023-12-28 06:57:19,265][106225] Updated weights for policy 1, policy_version 1631006 (0.0009) [2023-12-28 06:57:19,324][106225] Updated weights for policy 1, policy_version 1631016 (0.0008) [2023-12-28 06:57:19,393][106225] Updated weights for policy 1, policy_version 1631026 (0.0008) [2023-12-28 06:57:19,628][106226] Updated weights for policy 0, policy_version 1627289 (0.0008) [2023-12-28 06:57:19,688][106226] Updated weights for policy 0, policy_version 1627299 (0.0008) [2023-12-28 06:57:19,744][106226] Updated weights for policy 0, policy_version 1627309 (0.0008) [2023-12-28 06:57:19,805][106226] Updated weights for policy 0, policy_version 1627319 (0.0008) [2023-12-28 06:57:20,165][106225] Updated weights for policy 1, policy_version 1631036 (0.0006) [2023-12-28 06:57:20,228][106225] Updated weights for policy 1, policy_version 1631046 (0.0008) [2023-12-28 06:57:20,289][106225] Updated weights for policy 1, policy_version 1631056 (0.0008) [2023-12-28 06:57:20,641][106226] Updated weights for policy 0, policy_version 1627329 (0.0008) [2023-12-28 06:57:20,703][106226] Updated weights for policy 0, policy_version 1627339 (0.0008) [2023-12-28 06:57:20,759][106226] Updated weights for policy 0, policy_version 1627349 (0.0008) [2023-12-28 06:57:21,007][106225] Updated weights for policy 1, policy_version 1631066 (0.0008) [2023-12-28 06:57:21,074][106225] Updated weights for policy 1, policy_version 1631076 (0.0008) [2023-12-28 06:57:21,136][106225] Updated weights for policy 1, policy_version 1631086 (0.0009) [2023-12-28 06:57:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 834281472. Throughput: 0: 9766.6, 1: 9745.8. Samples: 834295452. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:21,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.855')] [2023-12-28 06:57:21,195][106225] Updated weights for policy 1, policy_version 1631096 (0.0007) [2023-12-28 06:57:21,582][106226] Updated weights for policy 0, policy_version 1627359 (0.0009) [2023-12-28 06:57:21,650][106226] Updated weights for policy 0, policy_version 1627369 (0.0008) [2023-12-28 06:57:21,715][106226] Updated weights for policy 0, policy_version 1627379 (0.0007) [2023-12-28 06:57:21,965][106225] Updated weights for policy 1, policy_version 1631106 (0.0009) [2023-12-28 06:57:22,026][106225] Updated weights for policy 1, policy_version 1631116 (0.0009) [2023-12-28 06:57:22,091][106225] Updated weights for policy 1, policy_version 1631126 (0.0009) [2023-12-28 06:57:22,433][106226] Updated weights for policy 0, policy_version 1627389 (0.0009) [2023-12-28 06:57:22,492][106226] Updated weights for policy 0, policy_version 1627399 (0.0006) [2023-12-28 06:57:22,554][106226] Updated weights for policy 0, policy_version 1627409 (0.0006) [2023-12-28 06:57:22,800][106225] Updated weights for policy 1, policy_version 1631136 (0.0008) [2023-12-28 06:57:22,863][106225] Updated weights for policy 1, policy_version 1631146 (0.0008) [2023-12-28 06:57:22,929][106225] Updated weights for policy 1, policy_version 1631156 (0.0008) [2023-12-28 06:57:23,197][106226] Updated weights for policy 0, policy_version 1627419 (0.0006) [2023-12-28 06:57:23,261][106226] Updated weights for policy 0, policy_version 1627429 (0.0006) [2023-12-28 06:57:23,322][106226] Updated weights for policy 0, policy_version 1627439 (0.0008) [2023-12-28 06:57:23,588][106225] Updated weights for policy 1, policy_version 1631166 (0.0008) [2023-12-28 06:57:23,643][106225] Updated weights for policy 1, policy_version 1631176 (0.0008) [2023-12-28 06:57:23,703][106225] Updated weights for policy 1, policy_version 1631186 (0.0008) [2023-12-28 06:57:24,019][106226] Updated weights for policy 0, policy_version 1627449 (0.0008) [2023-12-28 06:57:24,079][106226] Updated weights for policy 0, policy_version 1627459 (0.0009) [2023-12-28 06:57:24,139][106226] Updated weights for policy 0, policy_version 1627469 (0.0009) [2023-12-28 06:57:24,195][106226] Updated weights for policy 0, policy_version 1627479 (0.0008) [2023-12-28 06:57:24,427][106225] Updated weights for policy 1, policy_version 1631196 (0.0008) [2023-12-28 06:57:24,476][106225] Updated weights for policy 1, policy_version 1631206 (0.0008) [2023-12-28 06:57:24,525][106225] Updated weights for policy 1, policy_version 1631216 (0.0008) [2023-12-28 06:57:24,910][106226] Updated weights for policy 0, policy_version 1627489 (0.0008) [2023-12-28 06:57:24,978][106226] Updated weights for policy 0, policy_version 1627499 (0.0008) [2023-12-28 06:57:25,041][106226] Updated weights for policy 0, policy_version 1627509 (0.0007) [2023-12-28 06:57:25,249][106225] Updated weights for policy 1, policy_version 1631226 (0.0008) [2023-12-28 06:57:25,298][106225] Updated weights for policy 1, policy_version 1631236 (0.0008) [2023-12-28 06:57:25,354][106225] Updated weights for policy 1, policy_version 1631246 (0.0008) [2023-12-28 06:57:25,416][106225] Updated weights for policy 1, policy_version 1631256 (0.0008) [2023-12-28 06:57:25,771][106226] Updated weights for policy 0, policy_version 1627519 (0.0009) [2023-12-28 06:57:25,825][106226] Updated weights for policy 0, policy_version 1627529 (0.0009) [2023-12-28 06:57:25,881][106226] Updated weights for policy 0, policy_version 1627539 (0.0008) [2023-12-28 06:57:26,161][106225] Updated weights for policy 1, policy_version 1631266 (0.0008) [2023-12-28 06:57:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 834379776. Throughput: 0: 9759.6, 1: 9728.0. Samples: 834353108. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:26,175][105115] Avg episode reward: [(0, '-4.616'), (1, '-4.484')] [2023-12-28 06:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001627544_416727040.pth... [2023-12-28 06:57:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001626424_416440320.pth [2023-12-28 06:57:26,213][106225] Updated weights for policy 1, policy_version 1631276 (0.0008) [2023-12-28 06:57:26,268][106225] Updated weights for policy 1, policy_version 1631286 (0.0008) [2023-12-28 06:57:26,278][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001631288_417660928.pth... [2023-12-28 06:57:26,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001630136_417366016.pth [2023-12-28 06:57:26,568][106226] Updated weights for policy 0, policy_version 1627549 (0.0008) [2023-12-28 06:57:26,622][106226] Updated weights for policy 0, policy_version 1627559 (0.0009) [2023-12-28 06:57:26,678][106226] Updated weights for policy 0, policy_version 1627569 (0.0008) [2023-12-28 06:57:26,997][106225] Updated weights for policy 1, policy_version 1631296 (0.0009) [2023-12-28 06:57:27,040][106225] Updated weights for policy 1, policy_version 1631306 (0.0007) [2023-12-28 06:57:27,091][106225] Updated weights for policy 1, policy_version 1631316 (0.0007) [2023-12-28 06:57:27,319][106226] Updated weights for policy 0, policy_version 1627579 (0.0007) [2023-12-28 06:57:27,377][106226] Updated weights for policy 0, policy_version 1627589 (0.0008) [2023-12-28 06:57:27,438][106226] Updated weights for policy 0, policy_version 1627599 (0.0006) [2023-12-28 06:57:27,782][106225] Updated weights for policy 1, policy_version 1631326 (0.0007) [2023-12-28 06:57:27,844][106225] Updated weights for policy 1, policy_version 1631336 (0.0008) [2023-12-28 06:57:27,902][106225] Updated weights for policy 1, policy_version 1631346 (0.0008) [2023-12-28 06:57:28,040][106226] Updated weights for policy 0, policy_version 1627609 (0.0005) [2023-12-28 06:57:28,097][106226] Updated weights for policy 0, policy_version 1627619 (0.0008) [2023-12-28 06:57:28,167][106226] Updated weights for policy 0, policy_version 1627629 (0.0005) [2023-12-28 06:57:28,235][106226] Updated weights for policy 0, policy_version 1627639 (0.0006) [2023-12-28 06:57:28,529][106225] Updated weights for policy 1, policy_version 1631356 (0.0009) [2023-12-28 06:57:28,595][106225] Updated weights for policy 1, policy_version 1631366 (0.0009) [2023-12-28 06:57:28,655][106225] Updated weights for policy 1, policy_version 1631376 (0.0008) [2023-12-28 06:57:28,893][106226] Updated weights for policy 0, policy_version 1627649 (0.0006) [2023-12-28 06:57:28,953][106226] Updated weights for policy 0, policy_version 1627659 (0.0006) [2023-12-28 06:57:29,010][106226] Updated weights for policy 0, policy_version 1627669 (0.0008) [2023-12-28 06:57:29,345][106225] Updated weights for policy 1, policy_version 1631386 (0.0008) [2023-12-28 06:57:29,414][106225] Updated weights for policy 1, policy_version 1631396 (0.0007) [2023-12-28 06:57:29,473][106225] Updated weights for policy 1, policy_version 1631406 (0.0008) [2023-12-28 06:57:29,534][106225] Updated weights for policy 1, policy_version 1631416 (0.0007) [2023-12-28 06:57:29,654][106226] Updated weights for policy 0, policy_version 1627679 (0.0009) [2023-12-28 06:57:29,705][106226] Updated weights for policy 0, policy_version 1627689 (0.0010) [2023-12-28 06:57:29,762][106226] Updated weights for policy 0, policy_version 1627699 (0.0010) [2023-12-28 06:57:30,174][106225] Updated weights for policy 1, policy_version 1631426 (0.0008) [2023-12-28 06:57:30,235][106225] Updated weights for policy 1, policy_version 1631436 (0.0010) [2023-12-28 06:57:30,289][106225] Updated weights for policy 1, policy_version 1631446 (0.0008) [2023-12-28 06:57:30,419][106226] Updated weights for policy 0, policy_version 1627709 (0.0010) [2023-12-28 06:57:30,464][106226] Updated weights for policy 0, policy_version 1627719 (0.0008) [2023-12-28 06:57:30,516][106226] Updated weights for policy 0, policy_version 1627729 (0.0008) [2023-12-28 06:57:31,000][106225] Updated weights for policy 1, policy_version 1631457 (0.0008) [2023-12-28 06:57:31,064][106225] Updated weights for policy 1, policy_version 1631467 (0.0008) [2023-12-28 06:57:31,122][106225] Updated weights for policy 1, policy_version 1631477 (0.0008) [2023-12-28 06:57:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 834486272. Throughput: 0: 9780.9, 1: 9769.3. Samples: 834474032. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:31,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.963')] [2023-12-28 06:57:31,232][106226] Updated weights for policy 0, policy_version 1627739 (0.0010) [2023-12-28 06:57:31,301][106226] Updated weights for policy 0, policy_version 1627749 (0.0009) [2023-12-28 06:57:31,368][106226] Updated weights for policy 0, policy_version 1627759 (0.0009) [2023-12-28 06:57:31,909][106225] Updated weights for policy 1, policy_version 1631487 (0.0009) [2023-12-28 06:57:31,964][106225] Updated weights for policy 1, policy_version 1631497 (0.0008) [2023-12-28 06:57:32,014][106226] Updated weights for policy 0, policy_version 1627769 (0.0008) [2023-12-28 06:57:32,017][106225] Updated weights for policy 1, policy_version 1631507 (0.0008) [2023-12-28 06:57:32,074][106226] Updated weights for policy 0, policy_version 1627779 (0.0008) [2023-12-28 06:57:32,136][106226] Updated weights for policy 0, policy_version 1627789 (0.0007) [2023-12-28 06:57:32,201][106226] Updated weights for policy 0, policy_version 1627799 (0.0007) [2023-12-28 06:57:32,722][106225] Updated weights for policy 1, policy_version 1631517 (0.0007) [2023-12-28 06:57:32,788][106225] Updated weights for policy 1, policy_version 1631527 (0.0005) [2023-12-28 06:57:32,814][106226] Updated weights for policy 0, policy_version 1627809 (0.0007) [2023-12-28 06:57:32,851][106225] Updated weights for policy 1, policy_version 1631537 (0.0006) [2023-12-28 06:57:32,877][106226] Updated weights for policy 0, policy_version 1627819 (0.0008) [2023-12-28 06:57:32,938][106226] Updated weights for policy 0, policy_version 1627829 (0.0006) [2023-12-28 06:57:33,533][106225] Updated weights for policy 1, policy_version 1631547 (0.0005) [2023-12-28 06:57:33,540][106226] Updated weights for policy 0, policy_version 1627839 (0.0007) [2023-12-28 06:57:33,582][106225] Updated weights for policy 1, policy_version 1631557 (0.0005) [2023-12-28 06:57:33,585][106226] Updated weights for policy 0, policy_version 1627849 (0.0008) [2023-12-28 06:57:33,639][106225] Updated weights for policy 1, policy_version 1631567 (0.0006) [2023-12-28 06:57:33,640][106226] Updated weights for policy 0, policy_version 1627859 (0.0008) [2023-12-28 06:57:34,312][106225] Updated weights for policy 1, policy_version 1631577 (0.0008) [2023-12-28 06:57:34,355][106226] Updated weights for policy 0, policy_version 1627869 (0.0008) [2023-12-28 06:57:34,371][106225] Updated weights for policy 1, policy_version 1631587 (0.0010) [2023-12-28 06:57:34,418][106226] Updated weights for policy 0, policy_version 1627879 (0.0007) [2023-12-28 06:57:34,432][106225] Updated weights for policy 1, policy_version 1631597 (0.0007) [2023-12-28 06:57:34,480][106226] Updated weights for policy 0, policy_version 1627889 (0.0006) [2023-12-28 06:57:34,487][106225] Updated weights for policy 1, policy_version 1631607 (0.0008) [2023-12-28 06:57:35,190][106226] Updated weights for policy 0, policy_version 1627899 (0.0008) [2023-12-28 06:57:35,235][106225] Updated weights for policy 1, policy_version 1631617 (0.0008) [2023-12-28 06:57:35,244][106226] Updated weights for policy 0, policy_version 1627909 (0.0005) [2023-12-28 06:57:35,298][106226] Updated weights for policy 0, policy_version 1627919 (0.0005) [2023-12-28 06:57:35,299][106225] Updated weights for policy 1, policy_version 1631627 (0.0008) [2023-12-28 06:57:35,359][106225] Updated weights for policy 1, policy_version 1631637 (0.0008) [2023-12-28 06:57:35,873][106226] Updated weights for policy 0, policy_version 1627929 (0.0006) [2023-12-28 06:57:35,922][106226] Updated weights for policy 0, policy_version 1627939 (0.0007) [2023-12-28 06:57:35,969][106226] Updated weights for policy 0, policy_version 1627949 (0.0005) [2023-12-28 06:57:36,015][106226] Updated weights for policy 0, policy_version 1627959 (0.0006) [2023-12-28 06:57:36,170][106225] Updated weights for policy 1, policy_version 1631647 (0.0008) [2023-12-28 06:57:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 834584576. Throughput: 0: 9766.4, 1: 9795.2. Samples: 834594584. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:36,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.518')] [2023-12-28 06:57:36,230][106225] Updated weights for policy 1, policy_version 1631657 (0.0009) [2023-12-28 06:57:36,296][106225] Updated weights for policy 1, policy_version 1631667 (0.0007) [2023-12-28 06:57:36,766][106226] Updated weights for policy 0, policy_version 1627969 (0.0008) [2023-12-28 06:57:36,816][106226] Updated weights for policy 0, policy_version 1627979 (0.0006) [2023-12-28 06:57:36,877][106226] Updated weights for policy 0, policy_version 1627989 (0.0008) [2023-12-28 06:57:37,039][106225] Updated weights for policy 1, policy_version 1631677 (0.0008) [2023-12-28 06:57:37,091][106225] Updated weights for policy 1, policy_version 1631687 (0.0008) [2023-12-28 06:57:37,151][106225] Updated weights for policy 1, policy_version 1631697 (0.0008) [2023-12-28 06:57:37,593][106226] Updated weights for policy 0, policy_version 1627999 (0.0007) [2023-12-28 06:57:37,655][106226] Updated weights for policy 0, policy_version 1628009 (0.0005) [2023-12-28 06:57:37,722][106226] Updated weights for policy 0, policy_version 1628019 (0.0006) [2023-12-28 06:57:37,919][106225] Updated weights for policy 1, policy_version 1631707 (0.0008) [2023-12-28 06:57:37,984][106225] Updated weights for policy 1, policy_version 1631717 (0.0010) [2023-12-28 06:57:38,046][106225] Updated weights for policy 1, policy_version 1631727 (0.0009) [2023-12-28 06:57:38,286][106226] Updated weights for policy 0, policy_version 1628029 (0.0009) [2023-12-28 06:57:38,345][106226] Updated weights for policy 0, policy_version 1628039 (0.0009) [2023-12-28 06:57:38,410][106226] Updated weights for policy 0, policy_version 1628049 (0.0010) [2023-12-28 06:57:38,782][106225] Updated weights for policy 1, policy_version 1631737 (0.0010) [2023-12-28 06:57:38,844][106225] Updated weights for policy 1, policy_version 1631747 (0.0008) [2023-12-28 06:57:38,903][106225] Updated weights for policy 1, policy_version 1631757 (0.0008) [2023-12-28 06:57:38,954][106225] Updated weights for policy 1, policy_version 1631767 (0.0008) [2023-12-28 06:57:39,139][106226] Updated weights for policy 0, policy_version 1628059 (0.0007) [2023-12-28 06:57:39,200][106226] Updated weights for policy 0, policy_version 1628069 (0.0006) [2023-12-28 06:57:39,269][106226] Updated weights for policy 0, policy_version 1628079 (0.0008) [2023-12-28 06:57:39,698][106225] Updated weights for policy 1, policy_version 1631777 (0.0008) [2023-12-28 06:57:39,756][106225] Updated weights for policy 1, policy_version 1631787 (0.0008) [2023-12-28 06:57:39,814][106225] Updated weights for policy 1, policy_version 1631797 (0.0008) [2023-12-28 06:57:40,025][106226] Updated weights for policy 0, policy_version 1628089 (0.0009) [2023-12-28 06:57:40,085][106226] Updated weights for policy 0, policy_version 1628099 (0.0009) [2023-12-28 06:57:40,146][106226] Updated weights for policy 0, policy_version 1628109 (0.0008) [2023-12-28 06:57:40,207][106226] Updated weights for policy 0, policy_version 1628119 (0.0009) [2023-12-28 06:57:40,538][106225] Updated weights for policy 1, policy_version 1631807 (0.0007) [2023-12-28 06:57:40,598][106225] Updated weights for policy 1, policy_version 1631817 (0.0009) [2023-12-28 06:57:40,657][106225] Updated weights for policy 1, policy_version 1631827 (0.0008) [2023-12-28 06:57:40,963][106226] Updated weights for policy 0, policy_version 1628129 (0.0006) [2023-12-28 06:57:41,026][106226] Updated weights for policy 0, policy_version 1628139 (0.0006) [2023-12-28 06:57:41,097][106226] Updated weights for policy 0, policy_version 1628149 (0.0008) [2023-12-28 06:57:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 834682880. Throughput: 0: 9818.6, 1: 9781.9. Samples: 834652696. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:41,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-4.466')] [2023-12-28 06:57:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001628152_416882688.pth... [2023-12-28 06:57:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001631832_417800192.pth... [2023-12-28 06:57:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001627000_416587776.pth [2023-12-28 06:57:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001630680_417505280.pth [2023-12-28 06:57:41,523][106225] Updated weights for policy 1, policy_version 1631837 (0.0007) [2023-12-28 06:57:41,576][106225] Updated weights for policy 1, policy_version 1631847 (0.0005) [2023-12-28 06:57:41,639][106225] Updated weights for policy 1, policy_version 1631857 (0.0006) [2023-12-28 06:57:41,830][106226] Updated weights for policy 0, policy_version 1628159 (0.0008) [2023-12-28 06:57:41,896][106226] Updated weights for policy 0, policy_version 1628169 (0.0008) [2023-12-28 06:57:41,964][106226] Updated weights for policy 0, policy_version 1628179 (0.0009) [2023-12-28 06:57:42,379][106225] Updated weights for policy 1, policy_version 1631867 (0.0009) [2023-12-28 06:57:42,446][106225] Updated weights for policy 1, policy_version 1631877 (0.0008) [2023-12-28 06:57:42,509][106225] Updated weights for policy 1, policy_version 1631887 (0.0009) [2023-12-28 06:57:42,720][106226] Updated weights for policy 0, policy_version 1628189 (0.0009) [2023-12-28 06:57:42,779][106226] Updated weights for policy 0, policy_version 1628199 (0.0009) [2023-12-28 06:57:42,841][106226] Updated weights for policy 0, policy_version 1628209 (0.0009) [2023-12-28 06:57:43,176][106225] Updated weights for policy 1, policy_version 1631897 (0.0008) [2023-12-28 06:57:43,231][106225] Updated weights for policy 1, policy_version 1631907 (0.0005) [2023-12-28 06:57:43,292][106225] Updated weights for policy 1, policy_version 1631917 (0.0006) [2023-12-28 06:57:43,352][106225] Updated weights for policy 1, policy_version 1631927 (0.0008) [2023-12-28 06:57:43,463][106226] Updated weights for policy 0, policy_version 1628219 (0.0008) [2023-12-28 06:57:43,513][106226] Updated weights for policy 0, policy_version 1628229 (0.0005) [2023-12-28 06:57:43,561][106226] Updated weights for policy 0, policy_version 1628239 (0.0005) [2023-12-28 06:57:44,100][106225] Updated weights for policy 1, policy_version 1631937 (0.0008) [2023-12-28 06:57:44,155][106226] Updated weights for policy 0, policy_version 1628249 (0.0005) [2023-12-28 06:57:44,156][106225] Updated weights for policy 1, policy_version 1631947 (0.0006) [2023-12-28 06:57:44,213][106226] Updated weights for policy 0, policy_version 1628259 (0.0007) [2023-12-28 06:57:44,215][106225] Updated weights for policy 1, policy_version 1631957 (0.0007) [2023-12-28 06:57:44,271][106226] Updated weights for policy 0, policy_version 1628269 (0.0009) [2023-12-28 06:57:44,317][106226] Updated weights for policy 0, policy_version 1628279 (0.0009) [2023-12-28 06:57:44,856][106225] Updated weights for policy 1, policy_version 1631967 (0.0005) [2023-12-28 06:57:44,918][106225] Updated weights for policy 1, policy_version 1631977 (0.0006) [2023-12-28 06:57:44,974][106225] Updated weights for policy 1, policy_version 1631987 (0.0005) [2023-12-28 06:57:45,107][106226] Updated weights for policy 0, policy_version 1628289 (0.0008) [2023-12-28 06:57:45,170][106226] Updated weights for policy 0, policy_version 1628299 (0.0009) [2023-12-28 06:57:45,237][106226] Updated weights for policy 0, policy_version 1628309 (0.0009) [2023-12-28 06:57:45,621][106225] Updated weights for policy 1, policy_version 1631997 (0.0008) [2023-12-28 06:57:45,682][106225] Updated weights for policy 1, policy_version 1632007 (0.0008) [2023-12-28 06:57:45,743][106225] Updated weights for policy 1, policy_version 1632017 (0.0008) [2023-12-28 06:57:45,964][106226] Updated weights for policy 0, policy_version 1628319 (0.0008) [2023-12-28 06:57:46,017][106226] Updated weights for policy 0, policy_version 1628329 (0.0009) [2023-12-28 06:57:46,069][106226] Updated weights for policy 0, policy_version 1628339 (0.0008) [2023-12-28 06:57:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 834781184. Throughput: 0: 9861.3, 1: 9808.8. Samples: 834768184. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:46,176][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.793')] [2023-12-28 06:57:46,465][106225] Updated weights for policy 1, policy_version 1632027 (0.0009) [2023-12-28 06:57:46,516][106225] Updated weights for policy 1, policy_version 1632037 (0.0005) [2023-12-28 06:57:46,564][106225] Updated weights for policy 1, policy_version 1632047 (0.0005) [2023-12-28 06:57:46,838][106226] Updated weights for policy 0, policy_version 1628349 (0.0008) [2023-12-28 06:57:46,888][106226] Updated weights for policy 0, policy_version 1628359 (0.0008) [2023-12-28 06:57:46,941][106226] Updated weights for policy 0, policy_version 1628369 (0.0008) [2023-12-28 06:57:47,185][106225] Updated weights for policy 1, policy_version 1632057 (0.0008) [2023-12-28 06:57:47,250][106225] Updated weights for policy 1, policy_version 1632067 (0.0006) [2023-12-28 06:57:47,309][106225] Updated weights for policy 1, policy_version 1632077 (0.0006) [2023-12-28 06:57:47,370][106225] Updated weights for policy 1, policy_version 1632087 (0.0006) [2023-12-28 06:57:47,659][106226] Updated weights for policy 0, policy_version 1628379 (0.0008) [2023-12-28 06:57:47,712][106226] Updated weights for policy 0, policy_version 1628389 (0.0009) [2023-12-28 06:57:47,769][106226] Updated weights for policy 0, policy_version 1628399 (0.0008) [2023-12-28 06:57:47,959][106225] Updated weights for policy 1, policy_version 1632097 (0.0010) [2023-12-28 06:57:48,009][106225] Updated weights for policy 1, policy_version 1632107 (0.0010) [2023-12-28 06:57:48,069][106225] Updated weights for policy 1, policy_version 1632117 (0.0010) [2023-12-28 06:57:48,518][106226] Updated weights for policy 0, policy_version 1628409 (0.0008) [2023-12-28 06:57:48,573][106226] Updated weights for policy 0, policy_version 1628419 (0.0007) [2023-12-28 06:57:48,630][106226] Updated weights for policy 0, policy_version 1628429 (0.0008) [2023-12-28 06:57:48,695][106226] Updated weights for policy 0, policy_version 1628439 (0.0008) [2023-12-28 06:57:48,792][106225] Updated weights for policy 1, policy_version 1632127 (0.0010) [2023-12-28 06:57:48,849][106225] Updated weights for policy 1, policy_version 1632137 (0.0008) [2023-12-28 06:57:48,917][106225] Updated weights for policy 1, policy_version 1632147 (0.0007) [2023-12-28 06:57:49,516][106226] Updated weights for policy 0, policy_version 1628449 (0.0008) [2023-12-28 06:57:49,569][106226] Updated weights for policy 0, policy_version 1628459 (0.0008) [2023-12-28 06:57:49,593][106225] Updated weights for policy 1, policy_version 1632157 (0.0008) [2023-12-28 06:57:49,622][106226] Updated weights for policy 0, policy_version 1628469 (0.0008) [2023-12-28 06:57:49,657][106225] Updated weights for policy 1, policy_version 1632167 (0.0007) [2023-12-28 06:57:49,715][106225] Updated weights for policy 1, policy_version 1632177 (0.0009) [2023-12-28 06:57:50,297][106226] Updated weights for policy 0, policy_version 1628479 (0.0008) [2023-12-28 06:57:50,360][106226] Updated weights for policy 0, policy_version 1628489 (0.0009) [2023-12-28 06:57:50,425][106226] Updated weights for policy 0, policy_version 1628499 (0.0008) [2023-12-28 06:57:50,479][106225] Updated weights for policy 1, policy_version 1632187 (0.0008) [2023-12-28 06:57:50,539][106225] Updated weights for policy 1, policy_version 1632197 (0.0007) [2023-12-28 06:57:50,599][106225] Updated weights for policy 1, policy_version 1632207 (0.0010) [2023-12-28 06:57:51,053][106226] Updated weights for policy 0, policy_version 1628509 (0.0009) [2023-12-28 06:57:51,120][106226] Updated weights for policy 0, policy_version 1628519 (0.0009) [2023-12-28 06:57:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19744.1). Total num frames: 834871296. Throughput: 0: 9797.5, 1: 9783.7. Samples: 834885804. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:51,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.781')] [2023-12-28 06:57:51,178][106226] Updated weights for policy 0, policy_version 1628529 (0.0008) [2023-12-28 06:57:51,442][106225] Updated weights for policy 1, policy_version 1632217 (0.0008) [2023-12-28 06:57:51,510][106225] Updated weights for policy 1, policy_version 1632227 (0.0006) [2023-12-28 06:57:51,571][106225] Updated weights for policy 1, policy_version 1632237 (0.0005) [2023-12-28 06:57:51,635][106225] Updated weights for policy 1, policy_version 1632247 (0.0007) [2023-12-28 06:57:51,894][106226] Updated weights for policy 0, policy_version 1628539 (0.0007) [2023-12-28 06:57:51,970][106226] Updated weights for policy 0, policy_version 1628549 (0.0008) [2023-12-28 06:57:52,037][106226] Updated weights for policy 0, policy_version 1628559 (0.0008) [2023-12-28 06:57:52,331][106225] Updated weights for policy 1, policy_version 1632257 (0.0008) [2023-12-28 06:57:52,400][106225] Updated weights for policy 1, policy_version 1632267 (0.0008) [2023-12-28 06:57:52,453][106225] Updated weights for policy 1, policy_version 1632277 (0.0008) [2023-12-28 06:57:52,708][106226] Updated weights for policy 0, policy_version 1628569 (0.0009) [2023-12-28 06:57:52,772][106226] Updated weights for policy 0, policy_version 1628579 (0.0008) [2023-12-28 06:57:52,837][106226] Updated weights for policy 0, policy_version 1628589 (0.0008) [2023-12-28 06:57:52,893][106226] Updated weights for policy 0, policy_version 1628599 (0.0005) [2023-12-28 06:57:53,193][106225] Updated weights for policy 1, policy_version 1632287 (0.0008) [2023-12-28 06:57:53,243][106225] Updated weights for policy 1, policy_version 1632297 (0.0009) [2023-12-28 06:57:53,295][106225] Updated weights for policy 1, policy_version 1632307 (0.0005) [2023-12-28 06:57:53,543][106226] Updated weights for policy 0, policy_version 1628609 (0.0009) [2023-12-28 06:57:53,602][106226] Updated weights for policy 0, policy_version 1628619 (0.0009) [2023-12-28 06:57:53,663][106226] Updated weights for policy 0, policy_version 1628629 (0.0009) [2023-12-28 06:57:53,917][106225] Updated weights for policy 1, policy_version 1632317 (0.0005) [2023-12-28 06:57:53,968][106225] Updated weights for policy 1, policy_version 1632327 (0.0007) [2023-12-28 06:57:54,021][106225] Updated weights for policy 1, policy_version 1632337 (0.0006) [2023-12-28 06:57:54,377][106226] Updated weights for policy 0, policy_version 1628639 (0.0007) [2023-12-28 06:57:54,438][106226] Updated weights for policy 0, policy_version 1628649 (0.0011) [2023-12-28 06:57:54,499][106226] Updated weights for policy 0, policy_version 1628659 (0.0010) [2023-12-28 06:57:54,701][106225] Updated weights for policy 1, policy_version 1632347 (0.0010) [2023-12-28 06:57:54,758][106225] Updated weights for policy 1, policy_version 1632357 (0.0010) [2023-12-28 06:57:54,807][106225] Updated weights for policy 1, policy_version 1632367 (0.0010) [2023-12-28 06:57:55,207][106226] Updated weights for policy 0, policy_version 1628669 (0.0008) [2023-12-28 06:57:55,258][106226] Updated weights for policy 0, policy_version 1628679 (0.0009) [2023-12-28 06:57:55,325][106226] Updated weights for policy 0, policy_version 1628689 (0.0010) [2023-12-28 06:57:55,440][106225] Updated weights for policy 1, policy_version 1632377 (0.0008) [2023-12-28 06:57:55,486][106225] Updated weights for policy 1, policy_version 1632387 (0.0007) [2023-12-28 06:57:55,537][106225] Updated weights for policy 1, policy_version 1632397 (0.0005) [2023-12-28 06:57:55,586][106225] Updated weights for policy 1, policy_version 1632407 (0.0005) [2023-12-28 06:57:56,081][106226] Updated weights for policy 0, policy_version 1628699 (0.0010) [2023-12-28 06:57:56,142][106226] Updated weights for policy 0, policy_version 1628709 (0.0009) [2023-12-28 06:57:56,150][106225] Updated weights for policy 1, policy_version 1632417 (0.0007) [2023-12-28 06:57:56,174][105115] Fps is (10 sec: 18842.2, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 834969600. Throughput: 0: 9758.1, 1: 9795.4. Samples: 834944256. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:57:56,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-4.796')] [2023-12-28 06:57:56,196][106226] Updated weights for policy 0, policy_version 1628719 (0.0008) [2023-12-28 06:57:56,213][106225] Updated weights for policy 1, policy_version 1632427 (0.0008) [2023-12-28 06:57:56,248][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001628728_417030144.pth... [2023-12-28 06:57:56,252][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001627544_416727040.pth [2023-12-28 06:57:56,275][106225] Updated weights for policy 1, policy_version 1632437 (0.0006) [2023-12-28 06:57:56,292][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001632440_417955840.pth... [2023-12-28 06:57:56,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001631288_417660928.pth [2023-12-28 06:57:56,883][106226] Updated weights for policy 0, policy_version 1628729 (0.0006) [2023-12-28 06:57:56,926][106226] Updated weights for policy 0, policy_version 1628739 (0.0006) [2023-12-28 06:57:56,973][106226] Updated weights for policy 0, policy_version 1628749 (0.0006) [2023-12-28 06:57:56,981][106225] Updated weights for policy 1, policy_version 1632447 (0.0009) [2023-12-28 06:57:57,025][106226] Updated weights for policy 0, policy_version 1628759 (0.0006) [2023-12-28 06:57:57,032][106225] Updated weights for policy 1, policy_version 1632457 (0.0007) [2023-12-28 06:57:57,081][106225] Updated weights for policy 1, policy_version 1632467 (0.0009) [2023-12-28 06:57:57,676][106226] Updated weights for policy 0, policy_version 1628769 (0.0007) [2023-12-28 06:57:57,738][106226] Updated weights for policy 0, policy_version 1628779 (0.0008) [2023-12-28 06:57:57,775][106225] Updated weights for policy 1, policy_version 1632477 (0.0008) [2023-12-28 06:57:57,796][106226] Updated weights for policy 0, policy_version 1628789 (0.0008) [2023-12-28 06:57:57,832][106225] Updated weights for policy 1, policy_version 1632487 (0.0009) [2023-12-28 06:57:57,889][106225] Updated weights for policy 1, policy_version 1632497 (0.0010) [2023-12-28 06:57:58,546][106226] Updated weights for policy 0, policy_version 1628799 (0.0007) [2023-12-28 06:57:58,610][106226] Updated weights for policy 0, policy_version 1628809 (0.0006) [2023-12-28 06:57:58,679][106226] Updated weights for policy 0, policy_version 1628819 (0.0007) [2023-12-28 06:57:58,682][106225] Updated weights for policy 1, policy_version 1632507 (0.0010) [2023-12-28 06:57:58,752][106225] Updated weights for policy 1, policy_version 1632517 (0.0008) [2023-12-28 06:57:58,811][106225] Updated weights for policy 1, policy_version 1632527 (0.0007) [2023-12-28 06:57:59,424][106226] Updated weights for policy 0, policy_version 1628829 (0.0008) [2023-12-28 06:57:59,494][106226] Updated weights for policy 0, policy_version 1628839 (0.0007) [2023-12-28 06:57:59,528][106225] Updated weights for policy 1, policy_version 1632537 (0.0008) [2023-12-28 06:57:59,546][106226] Updated weights for policy 0, policy_version 1628849 (0.0007) [2023-12-28 06:57:59,594][106225] Updated weights for policy 1, policy_version 1632547 (0.0006) [2023-12-28 06:57:59,665][106225] Updated weights for policy 1, policy_version 1632557 (0.0009) [2023-12-28 06:57:59,738][106225] Updated weights for policy 1, policy_version 1632567 (0.0009) [2023-12-28 06:58:00,311][106226] Updated weights for policy 0, policy_version 1628859 (0.0006) [2023-12-28 06:58:00,377][106226] Updated weights for policy 0, policy_version 1628869 (0.0008) [2023-12-28 06:58:00,442][106226] Updated weights for policy 0, policy_version 1628879 (0.0008) [2023-12-28 06:58:00,476][106225] Updated weights for policy 1, policy_version 1632577 (0.0010) [2023-12-28 06:58:00,530][106225] Updated weights for policy 1, policy_version 1632587 (0.0010) [2023-12-28 06:58:00,586][106225] Updated weights for policy 1, policy_version 1632597 (0.0010) [2023-12-28 06:58:01,057][106226] Updated weights for policy 0, policy_version 1628889 (0.0007) [2023-12-28 06:58:01,111][106226] Updated weights for policy 0, policy_version 1628899 (0.0008) [2023-12-28 06:58:01,169][106226] Updated weights for policy 0, policy_version 1628909 (0.0009) [2023-12-28 06:58:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 835067904. Throughput: 0: 9818.2, 1: 9788.6. Samples: 835063052. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:58:01,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.652')] [2023-12-28 06:58:01,223][106226] Updated weights for policy 0, policy_version 1628919 (0.0008) [2023-12-28 06:58:01,279][106225] Updated weights for policy 1, policy_version 1632607 (0.0008) [2023-12-28 06:58:01,336][106225] Updated weights for policy 1, policy_version 1632617 (0.0006) [2023-12-28 06:58:01,408][106225] Updated weights for policy 1, policy_version 1632627 (0.0007) [2023-12-28 06:58:02,019][106226] Updated weights for policy 0, policy_version 1628929 (0.0009) [2023-12-28 06:58:02,073][106226] Updated weights for policy 0, policy_version 1628939 (0.0008) [2023-12-28 06:58:02,096][106225] Updated weights for policy 1, policy_version 1632637 (0.0007) [2023-12-28 06:58:02,130][106226] Updated weights for policy 0, policy_version 1628949 (0.0008) [2023-12-28 06:58:02,152][106225] Updated weights for policy 1, policy_version 1632647 (0.0006) [2023-12-28 06:58:02,206][106225] Updated weights for policy 1, policy_version 1632657 (0.0008) [2023-12-28 06:58:02,802][106225] Updated weights for policy 1, policy_version 1632667 (0.0008) [2023-12-28 06:58:02,850][106225] Updated weights for policy 1, policy_version 1632677 (0.0005) [2023-12-28 06:58:02,910][106225] Updated weights for policy 1, policy_version 1632687 (0.0006) [2023-12-28 06:58:02,945][106226] Updated weights for policy 0, policy_version 1628959 (0.0007) [2023-12-28 06:58:03,005][106226] Updated weights for policy 0, policy_version 1628969 (0.0009) [2023-12-28 06:58:03,068][106226] Updated weights for policy 0, policy_version 1628979 (0.0009) [2023-12-28 06:58:03,447][106225] Updated weights for policy 1, policy_version 1632697 (0.0006) [2023-12-28 06:58:03,503][106225] Updated weights for policy 1, policy_version 1632707 (0.0005) [2023-12-28 06:58:03,555][106225] Updated weights for policy 1, policy_version 1632717 (0.0007) [2023-12-28 06:58:03,604][106225] Updated weights for policy 1, policy_version 1632727 (0.0007) [2023-12-28 06:58:03,790][106226] Updated weights for policy 0, policy_version 1628989 (0.0010) [2023-12-28 06:58:03,860][106226] Updated weights for policy 0, policy_version 1628999 (0.0008) [2023-12-28 06:58:03,922][106226] Updated weights for policy 0, policy_version 1629009 (0.0006) [2023-12-28 06:58:04,318][106225] Updated weights for policy 1, policy_version 1632737 (0.0006) [2023-12-28 06:58:04,377][106225] Updated weights for policy 1, policy_version 1632747 (0.0006) [2023-12-28 06:58:04,436][106225] Updated weights for policy 1, policy_version 1632757 (0.0005) [2023-12-28 06:58:04,612][106226] Updated weights for policy 0, policy_version 1629019 (0.0008) [2023-12-28 06:58:04,659][106226] Updated weights for policy 0, policy_version 1629029 (0.0009) [2023-12-28 06:58:04,710][106226] Updated weights for policy 0, policy_version 1629039 (0.0005) [2023-12-28 06:58:05,137][106225] Updated weights for policy 1, policy_version 1632767 (0.0005) [2023-12-28 06:58:05,199][106225] Updated weights for policy 1, policy_version 1632777 (0.0007) [2023-12-28 06:58:05,251][106225] Updated weights for policy 1, policy_version 1632787 (0.0005) [2023-12-28 06:58:05,262][106226] Updated weights for policy 0, policy_version 1629049 (0.0005) [2023-12-28 06:58:05,317][106226] Updated weights for policy 0, policy_version 1629059 (0.0008) [2023-12-28 06:58:05,365][106226] Updated weights for policy 0, policy_version 1629069 (0.0008) [2023-12-28 06:58:05,410][106226] Updated weights for policy 0, policy_version 1629079 (0.0008) [2023-12-28 06:58:05,861][106225] Updated weights for policy 1, policy_version 1632797 (0.0007) [2023-12-28 06:58:05,922][106225] Updated weights for policy 1, policy_version 1632807 (0.0006) [2023-12-28 06:58:05,984][106225] Updated weights for policy 1, policy_version 1632817 (0.0008) [2023-12-28 06:58:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 835174400. Throughput: 0: 9902.9, 1: 9859.3. Samples: 835184752. Policy #0 lag: (min: 18.0, avg: 29.6, max: 50.0) [2023-12-28 06:58:06,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.500')] [2023-12-28 06:58:06,189][106226] Updated weights for policy 0, policy_version 1629089 (0.0010) [2023-12-28 06:58:06,246][106226] Updated weights for policy 0, policy_version 1629099 (0.0011) [2023-12-28 06:58:06,304][106226] Updated weights for policy 0, policy_version 1629109 (0.0011) [2023-12-28 06:58:06,731][106225] Updated weights for policy 1, policy_version 1632827 (0.0007) [2023-12-28 06:58:06,790][106225] Updated weights for policy 1, policy_version 1632837 (0.0008) [2023-12-28 06:58:06,852][106225] Updated weights for policy 1, policy_version 1632847 (0.0009) [2023-12-28 06:58:06,970][106226] Updated weights for policy 0, policy_version 1629119 (0.0007) [2023-12-28 06:58:07,040][106226] Updated weights for policy 0, policy_version 1629129 (0.0005) [2023-12-28 06:58:07,097][106226] Updated weights for policy 0, policy_version 1629139 (0.0005) [2023-12-28 06:58:07,643][106226] Updated weights for policy 0, policy_version 1629149 (0.0005) [2023-12-28 06:58:07,672][106225] Updated weights for policy 1, policy_version 1632857 (0.0008) [2023-12-28 06:58:07,698][106226] Updated weights for policy 0, policy_version 1629159 (0.0005) [2023-12-28 06:58:07,729][106225] Updated weights for policy 1, policy_version 1632867 (0.0008) [2023-12-28 06:58:07,753][106226] Updated weights for policy 0, policy_version 1629169 (0.0005) [2023-12-28 06:58:07,780][106225] Updated weights for policy 1, policy_version 1632877 (0.0007) [2023-12-28 06:58:07,830][106225] Updated weights for policy 1, policy_version 1632887 (0.0008) [2023-12-28 06:58:08,284][106226] Updated weights for policy 0, policy_version 1629179 (0.0007) [2023-12-28 06:58:08,348][106226] Updated weights for policy 0, policy_version 1629189 (0.0011) [2023-12-28 06:58:08,415][106226] Updated weights for policy 0, policy_version 1629199 (0.0011) [2023-12-28 06:58:08,458][106225] Updated weights for policy 1, policy_version 1632897 (0.0008) [2023-12-28 06:58:08,505][106225] Updated weights for policy 1, policy_version 1632907 (0.0008) [2023-12-28 06:58:08,556][106225] Updated weights for policy 1, policy_version 1632917 (0.0008) [2023-12-28 06:58:09,045][106226] Updated weights for policy 0, policy_version 1629209 (0.0011) [2023-12-28 06:58:09,092][106226] Updated weights for policy 0, policy_version 1629219 (0.0010) [2023-12-28 06:58:09,139][106226] Updated weights for policy 0, policy_version 1629229 (0.0010) [2023-12-28 06:58:09,198][106226] Updated weights for policy 0, policy_version 1629239 (0.0010) [2023-12-28 06:58:09,345][106225] Updated weights for policy 1, policy_version 1632927 (0.0007) [2023-12-28 06:58:09,414][106225] Updated weights for policy 1, policy_version 1632937 (0.0009) [2023-12-28 06:58:09,483][106225] Updated weights for policy 1, policy_version 1632947 (0.0008) [2023-12-28 06:58:10,064][106226] Updated weights for policy 0, policy_version 1629249 (0.0009) [2023-12-28 06:58:10,127][106226] Updated weights for policy 0, policy_version 1629259 (0.0011) [2023-12-28 06:58:10,171][106225] Updated weights for policy 1, policy_version 1632957 (0.0007) [2023-12-28 06:58:10,192][106226] Updated weights for policy 0, policy_version 1629269 (0.0008) [2023-12-28 06:58:10,230][106225] Updated weights for policy 1, policy_version 1632967 (0.0007) [2023-12-28 06:58:10,285][106225] Updated weights for policy 1, policy_version 1632977 (0.0008) [2023-12-28 06:58:10,911][106226] Updated weights for policy 0, policy_version 1629279 (0.0008) [2023-12-28 06:58:10,959][106225] Updated weights for policy 1, policy_version 1632987 (0.0009) [2023-12-28 06:58:10,965][106226] Updated weights for policy 0, policy_version 1629289 (0.0009) [2023-12-28 06:58:11,011][106225] Updated weights for policy 1, policy_version 1632997 (0.0006) [2023-12-28 06:58:11,025][106226] Updated weights for policy 0, policy_version 1629299 (0.0006) [2023-12-28 06:58:11,073][106225] Updated weights for policy 1, policy_version 1633007 (0.0008) [2023-12-28 06:58:11,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 835280896. Throughput: 0: 10008.4, 1: 9840.5. Samples: 835246308. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:11,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.972')] [2023-12-28 06:58:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001633016_418103296.pth... [2023-12-28 06:58:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001629304_417177600.pth... [2023-12-28 06:58:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001628152_416882688.pth [2023-12-28 06:58:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001631832_417800192.pth [2023-12-28 06:58:11,849][106226] Updated weights for policy 0, policy_version 1629309 (0.0008) [2023-12-28 06:58:11,861][106225] Updated weights for policy 1, policy_version 1633017 (0.0009) [2023-12-28 06:58:11,910][106226] Updated weights for policy 0, policy_version 1629319 (0.0009) [2023-12-28 06:58:11,923][106225] Updated weights for policy 1, policy_version 1633027 (0.0009) [2023-12-28 06:58:11,960][106226] Updated weights for policy 0, policy_version 1629329 (0.0008) [2023-12-28 06:58:11,986][106225] Updated weights for policy 1, policy_version 1633037 (0.0009) [2023-12-28 06:58:12,047][106225] Updated weights for policy 1, policy_version 1633047 (0.0008) [2023-12-28 06:58:12,678][106226] Updated weights for policy 0, policy_version 1629339 (0.0008) [2023-12-28 06:58:12,741][106226] Updated weights for policy 0, policy_version 1629349 (0.0009) [2023-12-28 06:58:12,802][106226] Updated weights for policy 0, policy_version 1629359 (0.0008) [2023-12-28 06:58:12,823][106225] Updated weights for policy 1, policy_version 1633057 (0.0007) [2023-12-28 06:58:12,884][106225] Updated weights for policy 1, policy_version 1633067 (0.0007) [2023-12-28 06:58:12,943][106225] Updated weights for policy 1, policy_version 1633077 (0.0009) [2023-12-28 06:58:13,529][106226] Updated weights for policy 0, policy_version 1629369 (0.0006) [2023-12-28 06:58:13,589][106226] Updated weights for policy 0, policy_version 1629379 (0.0009) [2023-12-28 06:58:13,648][106226] Updated weights for policy 0, policy_version 1629389 (0.0007) [2023-12-28 06:58:13,652][106225] Updated weights for policy 1, policy_version 1633087 (0.0009) [2023-12-28 06:58:13,697][106226] Updated weights for policy 0, policy_version 1629399 (0.0007) [2023-12-28 06:58:13,710][106225] Updated weights for policy 1, policy_version 1633097 (0.0007) [2023-12-28 06:58:13,761][106225] Updated weights for policy 1, policy_version 1633107 (0.0008) [2023-12-28 06:58:14,318][106226] Updated weights for policy 0, policy_version 1629409 (0.0005) [2023-12-28 06:58:14,369][106226] Updated weights for policy 0, policy_version 1629419 (0.0005) [2023-12-28 06:58:14,421][106226] Updated weights for policy 0, policy_version 1629429 (0.0005) [2023-12-28 06:58:14,556][106225] Updated weights for policy 1, policy_version 1633117 (0.0009) [2023-12-28 06:58:14,607][106225] Updated weights for policy 1, policy_version 1633127 (0.0007) [2023-12-28 06:58:14,654][106225] Updated weights for policy 1, policy_version 1633137 (0.0008) [2023-12-28 06:58:15,043][106226] Updated weights for policy 0, policy_version 1629439 (0.0008) [2023-12-28 06:58:15,104][106226] Updated weights for policy 0, policy_version 1629449 (0.0009) [2023-12-28 06:58:15,168][106226] Updated weights for policy 0, policy_version 1629459 (0.0009) [2023-12-28 06:58:15,402][106225] Updated weights for policy 1, policy_version 1633147 (0.0008) [2023-12-28 06:58:15,457][106225] Updated weights for policy 1, policy_version 1633157 (0.0008) [2023-12-28 06:58:15,512][106225] Updated weights for policy 1, policy_version 1633167 (0.0008) [2023-12-28 06:58:15,895][106226] Updated weights for policy 0, policy_version 1629469 (0.0007) [2023-12-28 06:58:15,957][106226] Updated weights for policy 0, policy_version 1629479 (0.0007) [2023-12-28 06:58:16,017][106226] Updated weights for policy 0, policy_version 1629489 (0.0007) [2023-12-28 06:58:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 835371008. Throughput: 0: 9935.9, 1: 9760.8. Samples: 835360384. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:16,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.730')] [2023-12-28 06:58:16,202][106225] Updated weights for policy 1, policy_version 1633177 (0.0009) [2023-12-28 06:58:16,263][106225] Updated weights for policy 1, policy_version 1633187 (0.0008) [2023-12-28 06:58:16,317][106225] Updated weights for policy 1, policy_version 1633197 (0.0009) [2023-12-28 06:58:16,372][106225] Updated weights for policy 1, policy_version 1633207 (0.0010) [2023-12-28 06:58:16,619][106226] Updated weights for policy 0, policy_version 1629499 (0.0006) [2023-12-28 06:58:16,678][106226] Updated weights for policy 0, policy_version 1629509 (0.0008) [2023-12-28 06:58:16,731][106226] Updated weights for policy 0, policy_version 1629519 (0.0009) [2023-12-28 06:58:17,099][106225] Updated weights for policy 1, policy_version 1633217 (0.0009) [2023-12-28 06:58:17,147][106225] Updated weights for policy 1, policy_version 1633227 (0.0008) [2023-12-28 06:58:17,196][106225] Updated weights for policy 1, policy_version 1633237 (0.0008) [2023-12-28 06:58:17,453][106226] Updated weights for policy 0, policy_version 1629529 (0.0007) [2023-12-28 06:58:17,511][106226] Updated weights for policy 0, policy_version 1629539 (0.0009) [2023-12-28 06:58:17,568][106226] Updated weights for policy 0, policy_version 1629549 (0.0009) [2023-12-28 06:58:17,623][106226] Updated weights for policy 0, policy_version 1629559 (0.0008) [2023-12-28 06:58:17,869][106225] Updated weights for policy 1, policy_version 1633247 (0.0008) [2023-12-28 06:58:17,925][106225] Updated weights for policy 1, policy_version 1633257 (0.0008) [2023-12-28 06:58:17,969][106225] Updated weights for policy 1, policy_version 1633267 (0.0006) [2023-12-28 06:58:18,416][106226] Updated weights for policy 0, policy_version 1629569 (0.0009) [2023-12-28 06:58:18,483][106226] Updated weights for policy 0, policy_version 1629579 (0.0006) [2023-12-28 06:58:18,548][106226] Updated weights for policy 0, policy_version 1629589 (0.0008) [2023-12-28 06:58:18,656][106225] Updated weights for policy 1, policy_version 1633277 (0.0007) [2023-12-28 06:58:18,718][106225] Updated weights for policy 1, policy_version 1633287 (0.0008) [2023-12-28 06:58:18,783][106225] Updated weights for policy 1, policy_version 1633297 (0.0009) [2023-12-28 06:58:19,162][106226] Updated weights for policy 0, policy_version 1629599 (0.0007) [2023-12-28 06:58:19,225][106226] Updated weights for policy 0, policy_version 1629609 (0.0009) [2023-12-28 06:58:19,292][106226] Updated weights for policy 0, policy_version 1629619 (0.0007) [2023-12-28 06:58:19,586][106225] Updated weights for policy 1, policy_version 1633307 (0.0009) [2023-12-28 06:58:19,646][106225] Updated weights for policy 1, policy_version 1633317 (0.0008) [2023-12-28 06:58:19,707][106225] Updated weights for policy 1, policy_version 1633327 (0.0009) [2023-12-28 06:58:20,022][106226] Updated weights for policy 0, policy_version 1629629 (0.0009) [2023-12-28 06:58:20,088][106226] Updated weights for policy 0, policy_version 1629639 (0.0010) [2023-12-28 06:58:20,158][106226] Updated weights for policy 0, policy_version 1629649 (0.0009) [2023-12-28 06:58:20,464][106225] Updated weights for policy 1, policy_version 1633337 (0.0009) [2023-12-28 06:58:20,514][106225] Updated weights for policy 1, policy_version 1633347 (0.0009) [2023-12-28 06:58:20,580][106225] Updated weights for policy 1, policy_version 1633357 (0.0007) [2023-12-28 06:58:20,643][106225] Updated weights for policy 1, policy_version 1633367 (0.0008) [2023-12-28 06:58:20,860][106226] Updated weights for policy 0, policy_version 1629659 (0.0008) [2023-12-28 06:58:20,912][106226] Updated weights for policy 0, policy_version 1629669 (0.0008) [2023-12-28 06:58:20,962][106226] Updated weights for policy 0, policy_version 1629679 (0.0009) [2023-12-28 06:58:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 835469312. Throughput: 0: 9841.6, 1: 9769.3. Samples: 835477072. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:21,175][105115] Avg episode reward: [(0, '-4.185'), (1, '-4.782')] [2023-12-28 06:58:21,456][106225] Updated weights for policy 1, policy_version 1633377 (0.0007) [2023-12-28 06:58:21,522][106225] Updated weights for policy 1, policy_version 1633387 (0.0008) [2023-12-28 06:58:21,585][106225] Updated weights for policy 1, policy_version 1633397 (0.0008) [2023-12-28 06:58:21,736][106226] Updated weights for policy 0, policy_version 1629689 (0.0008) [2023-12-28 06:58:21,793][106226] Updated weights for policy 0, policy_version 1629699 (0.0009) [2023-12-28 06:58:21,856][106226] Updated weights for policy 0, policy_version 1629709 (0.0009) [2023-12-28 06:58:21,919][106226] Updated weights for policy 0, policy_version 1629719 (0.0009) [2023-12-28 06:58:22,261][106225] Updated weights for policy 1, policy_version 1633407 (0.0007) [2023-12-28 06:58:22,329][106225] Updated weights for policy 1, policy_version 1633417 (0.0006) [2023-12-28 06:58:22,399][106225] Updated weights for policy 1, policy_version 1633427 (0.0009) [2023-12-28 06:58:22,636][106226] Updated weights for policy 0, policy_version 1629729 (0.0006) [2023-12-28 06:58:22,703][106226] Updated weights for policy 0, policy_version 1629739 (0.0006) [2023-12-28 06:58:22,772][106226] Updated weights for policy 0, policy_version 1629749 (0.0006) [2023-12-28 06:58:23,070][106225] Updated weights for policy 1, policy_version 1633437 (0.0008) [2023-12-28 06:58:23,135][106225] Updated weights for policy 1, policy_version 1633447 (0.0007) [2023-12-28 06:58:23,185][106225] Updated weights for policy 1, policy_version 1633457 (0.0008) [2023-12-28 06:58:23,366][106226] Updated weights for policy 0, policy_version 1629759 (0.0009) [2023-12-28 06:58:23,420][106226] Updated weights for policy 0, policy_version 1629769 (0.0010) [2023-12-28 06:58:23,472][106226] Updated weights for policy 0, policy_version 1629779 (0.0008) [2023-12-28 06:58:23,914][106225] Updated weights for policy 1, policy_version 1633467 (0.0009) [2023-12-28 06:58:23,972][106225] Updated weights for policy 1, policy_version 1633477 (0.0008) [2023-12-28 06:58:24,039][106225] Updated weights for policy 1, policy_version 1633487 (0.0010) [2023-12-28 06:58:24,060][106226] Updated weights for policy 0, policy_version 1629789 (0.0005) [2023-12-28 06:58:24,111][106226] Updated weights for policy 0, policy_version 1629799 (0.0005) [2023-12-28 06:58:24,175][106226] Updated weights for policy 0, policy_version 1629809 (0.0005) [2023-12-28 06:58:24,730][106226] Updated weights for policy 0, policy_version 1629819 (0.0006) [2023-12-28 06:58:24,753][106225] Updated weights for policy 1, policy_version 1633497 (0.0009) [2023-12-28 06:58:24,779][106226] Updated weights for policy 0, policy_version 1629829 (0.0010) [2023-12-28 06:58:24,801][106225] Updated weights for policy 1, policy_version 1633507 (0.0005) [2023-12-28 06:58:24,832][106226] Updated weights for policy 0, policy_version 1629839 (0.0010) [2023-12-28 06:58:24,858][106225] Updated weights for policy 1, policy_version 1633517 (0.0005) [2023-12-28 06:58:24,918][106225] Updated weights for policy 1, policy_version 1633527 (0.0007) [2023-12-28 06:58:25,496][106226] Updated weights for policy 0, policy_version 1629849 (0.0009) [2023-12-28 06:58:25,545][106226] Updated weights for policy 0, policy_version 1629859 (0.0005) [2023-12-28 06:58:25,596][106226] Updated weights for policy 0, policy_version 1629869 (0.0006) [2023-12-28 06:58:25,654][106226] Updated weights for policy 0, policy_version 1629879 (0.0008) [2023-12-28 06:58:25,657][106225] Updated weights for policy 1, policy_version 1633537 (0.0009) [2023-12-28 06:58:25,721][106225] Updated weights for policy 1, policy_version 1633547 (0.0009) [2023-12-28 06:58:25,787][106225] Updated weights for policy 1, policy_version 1633557 (0.0009) [2023-12-28 06:58:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 835567616. Throughput: 0: 9859.3, 1: 9801.2. Samples: 835537420. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:26,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-4.713')] [2023-12-28 06:58:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001633560_418242560.pth... [2023-12-28 06:58:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001629880_417325056.pth... [2023-12-28 06:58:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001632440_417955840.pth [2023-12-28 06:58:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001628728_417030144.pth [2023-12-28 06:58:26,360][106226] Updated weights for policy 0, policy_version 1629889 (0.0007) [2023-12-28 06:58:26,409][106226] Updated weights for policy 0, policy_version 1629899 (0.0008) [2023-12-28 06:58:26,422][106225] Updated weights for policy 1, policy_version 1633567 (0.0006) [2023-12-28 06:58:26,466][106226] Updated weights for policy 0, policy_version 1629909 (0.0008) [2023-12-28 06:58:26,483][106225] Updated weights for policy 1, policy_version 1633577 (0.0005) [2023-12-28 06:58:26,544][106225] Updated weights for policy 1, policy_version 1633587 (0.0005) [2023-12-28 06:58:27,163][106226] Updated weights for policy 0, policy_version 1629919 (0.0006) [2023-12-28 06:58:27,209][106225] Updated weights for policy 1, policy_version 1633597 (0.0006) [2023-12-28 06:58:27,213][106226] Updated weights for policy 0, policy_version 1629929 (0.0005) [2023-12-28 06:58:27,267][106226] Updated weights for policy 0, policy_version 1629939 (0.0006) [2023-12-28 06:58:27,270][106225] Updated weights for policy 1, policy_version 1633607 (0.0006) [2023-12-28 06:58:27,321][106225] Updated weights for policy 1, policy_version 1633617 (0.0009) [2023-12-28 06:58:27,871][106226] Updated weights for policy 0, policy_version 1629949 (0.0008) [2023-12-28 06:58:27,932][106226] Updated weights for policy 0, policy_version 1629959 (0.0007) [2023-12-28 06:58:27,985][106226] Updated weights for policy 0, policy_version 1629969 (0.0008) [2023-12-28 06:58:28,010][106225] Updated weights for policy 1, policy_version 1633627 (0.0009) [2023-12-28 06:58:28,068][106225] Updated weights for policy 1, policy_version 1633637 (0.0008) [2023-12-28 06:58:28,118][106225] Updated weights for policy 1, policy_version 1633647 (0.0009) [2023-12-28 06:58:28,730][106226] Updated weights for policy 0, policy_version 1629979 (0.0007) [2023-12-28 06:58:28,748][106225] Updated weights for policy 1, policy_version 1633657 (0.0008) [2023-12-28 06:58:28,785][106226] Updated weights for policy 0, policy_version 1629989 (0.0007) [2023-12-28 06:58:28,806][106225] Updated weights for policy 1, policy_version 1633667 (0.0007) [2023-12-28 06:58:28,848][106226] Updated weights for policy 0, policy_version 1629999 (0.0008) [2023-12-28 06:58:28,862][106225] Updated weights for policy 1, policy_version 1633677 (0.0008) [2023-12-28 06:58:28,927][106225] Updated weights for policy 1, policy_version 1633687 (0.0005) [2023-12-28 06:58:29,585][106226] Updated weights for policy 0, policy_version 1630009 (0.0008) [2023-12-28 06:58:29,637][106225] Updated weights for policy 1, policy_version 1633697 (0.0007) [2023-12-28 06:58:29,643][106226] Updated weights for policy 0, policy_version 1630019 (0.0005) [2023-12-28 06:58:29,699][106225] Updated weights for policy 1, policy_version 1633707 (0.0008) [2023-12-28 06:58:29,706][106226] Updated weights for policy 0, policy_version 1630029 (0.0006) [2023-12-28 06:58:29,754][106225] Updated weights for policy 1, policy_version 1633717 (0.0008) [2023-12-28 06:58:29,763][106226] Updated weights for policy 0, policy_version 1630039 (0.0005) [2023-12-28 06:58:30,417][106226] Updated weights for policy 0, policy_version 1630049 (0.0008) [2023-12-28 06:58:30,448][106225] Updated weights for policy 1, policy_version 1633727 (0.0006) [2023-12-28 06:58:30,478][106226] Updated weights for policy 0, policy_version 1630059 (0.0009) [2023-12-28 06:58:30,506][106225] Updated weights for policy 1, policy_version 1633737 (0.0007) [2023-12-28 06:58:30,540][106226] Updated weights for policy 0, policy_version 1630069 (0.0008) [2023-12-28 06:58:30,554][106225] Updated weights for policy 1, policy_version 1633747 (0.0006) [2023-12-28 06:58:31,150][106226] Updated weights for policy 0, policy_version 1630079 (0.0007) [2023-12-28 06:58:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 835665920. Throughput: 0: 9940.9, 1: 9841.4. Samples: 835658380. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:31,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.635')] [2023-12-28 06:58:31,216][106226] Updated weights for policy 0, policy_version 1630089 (0.0008) [2023-12-28 06:58:31,240][106225] Updated weights for policy 1, policy_version 1633757 (0.0007) [2023-12-28 06:58:31,280][106226] Updated weights for policy 0, policy_version 1630099 (0.0007) [2023-12-28 06:58:31,310][106225] Updated weights for policy 1, policy_version 1633767 (0.0007) [2023-12-28 06:58:31,381][106225] Updated weights for policy 1, policy_version 1633778 (0.0008) [2023-12-28 06:58:31,947][106226] Updated weights for policy 0, policy_version 1630109 (0.0006) [2023-12-28 06:58:31,999][106226] Updated weights for policy 0, policy_version 1630119 (0.0007) [2023-12-28 06:58:32,059][106226] Updated weights for policy 0, policy_version 1630129 (0.0011) [2023-12-28 06:58:32,081][106225] Updated weights for policy 1, policy_version 1633788 (0.0007) [2023-12-28 06:58:32,143][106225] Updated weights for policy 1, policy_version 1633798 (0.0007) [2023-12-28 06:58:32,205][106225] Updated weights for policy 1, policy_version 1633808 (0.0007) [2023-12-28 06:58:32,797][106226] Updated weights for policy 0, policy_version 1630139 (0.0008) [2023-12-28 06:58:32,854][106226] Updated weights for policy 0, policy_version 1630149 (0.0010) [2023-12-28 06:58:32,900][106226] Updated weights for policy 0, policy_version 1630159 (0.0010) [2023-12-28 06:58:32,948][106225] Updated weights for policy 1, policy_version 1633818 (0.0007) [2023-12-28 06:58:33,005][106225] Updated weights for policy 1, policy_version 1633828 (0.0007) [2023-12-28 06:58:33,047][106225] Updated weights for policy 1, policy_version 1633838 (0.0007) [2023-12-28 06:58:33,093][106225] Updated weights for policy 1, policy_version 1633848 (0.0008) [2023-12-28 06:58:33,573][106226] Updated weights for policy 0, policy_version 1630169 (0.0010) [2023-12-28 06:58:33,643][106226] Updated weights for policy 0, policy_version 1630179 (0.0006) [2023-12-28 06:58:33,702][106226] Updated weights for policy 0, policy_version 1630189 (0.0010) [2023-12-28 06:58:33,758][106226] Updated weights for policy 0, policy_version 1630199 (0.0010) [2023-12-28 06:58:33,800][106225] Updated weights for policy 1, policy_version 1633858 (0.0007) [2023-12-28 06:58:33,847][106225] Updated weights for policy 1, policy_version 1633868 (0.0007) [2023-12-28 06:58:33,898][106225] Updated weights for policy 1, policy_version 1633878 (0.0005) [2023-12-28 06:58:34,350][106226] Updated weights for policy 0, policy_version 1630209 (0.0008) [2023-12-28 06:58:34,419][106226] Updated weights for policy 0, policy_version 1630219 (0.0007) [2023-12-28 06:58:34,480][106226] Updated weights for policy 0, policy_version 1630229 (0.0007) [2023-12-28 06:58:34,509][106225] Updated weights for policy 1, policy_version 1633888 (0.0008) [2023-12-28 06:58:34,570][106225] Updated weights for policy 1, policy_version 1633898 (0.0008) [2023-12-28 06:58:34,631][106225] Updated weights for policy 1, policy_version 1633908 (0.0008) [2023-12-28 06:58:35,197][106226] Updated weights for policy 0, policy_version 1630239 (0.0008) [2023-12-28 06:58:35,248][106226] Updated weights for policy 0, policy_version 1630249 (0.0008) [2023-12-28 06:58:35,299][106226] Updated weights for policy 0, policy_version 1630259 (0.0008) [2023-12-28 06:58:35,363][106225] Updated weights for policy 1, policy_version 1633918 (0.0008) [2023-12-28 06:58:35,418][106225] Updated weights for policy 1, policy_version 1633928 (0.0005) [2023-12-28 06:58:35,473][106225] Updated weights for policy 1, policy_version 1633938 (0.0005) [2023-12-28 06:58:35,975][106226] Updated weights for policy 0, policy_version 1630269 (0.0007) [2023-12-28 06:58:36,037][106226] Updated weights for policy 0, policy_version 1630279 (0.0006) [2023-12-28 06:58:36,073][106225] Updated weights for policy 1, policy_version 1633948 (0.0007) [2023-12-28 06:58:36,094][106226] Updated weights for policy 0, policy_version 1630289 (0.0008) [2023-12-28 06:58:36,140][106225] Updated weights for policy 1, policy_version 1633959 (0.0009) [2023-12-28 06:58:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 835772416. Throughput: 0: 10043.2, 1: 9878.4. Samples: 835782276. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:36,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.591')] [2023-12-28 06:58:36,194][106225] Updated weights for policy 1, policy_version 1633969 (0.0008) [2023-12-28 06:58:36,826][106226] Updated weights for policy 0, policy_version 1630299 (0.0009) [2023-12-28 06:58:36,888][106226] Updated weights for policy 0, policy_version 1630309 (0.0009) [2023-12-28 06:58:36,946][106225] Updated weights for policy 1, policy_version 1633979 (0.0008) [2023-12-28 06:58:36,949][106226] Updated weights for policy 0, policy_version 1630319 (0.0008) [2023-12-28 06:58:37,006][106225] Updated weights for policy 1, policy_version 1633989 (0.0009) [2023-12-28 06:58:37,060][106225] Updated weights for policy 1, policy_version 1633999 (0.0008) [2023-12-28 06:58:37,672][106226] Updated weights for policy 0, policy_version 1630329 (0.0008) [2023-12-28 06:58:37,724][106226] Updated weights for policy 0, policy_version 1630339 (0.0008) [2023-12-28 06:58:37,774][106226] Updated weights for policy 0, policy_version 1630349 (0.0009) [2023-12-28 06:58:37,775][106225] Updated weights for policy 1, policy_version 1634009 (0.0007) [2023-12-28 06:58:37,824][106226] Updated weights for policy 0, policy_version 1630359 (0.0010) [2023-12-28 06:58:37,835][106225] Updated weights for policy 1, policy_version 1634019 (0.0010) [2023-12-28 06:58:37,892][106225] Updated weights for policy 1, policy_version 1634029 (0.0009) [2023-12-28 06:58:37,947][106225] Updated weights for policy 1, policy_version 1634039 (0.0005) [2023-12-28 06:58:38,399][106226] Updated weights for policy 0, policy_version 1630369 (0.0007) [2023-12-28 06:58:38,458][106226] Updated weights for policy 0, policy_version 1630379 (0.0007) [2023-12-28 06:58:38,521][106226] Updated weights for policy 0, policy_version 1630389 (0.0010) [2023-12-28 06:58:38,655][106225] Updated weights for policy 1, policy_version 1634049 (0.0010) [2023-12-28 06:58:38,719][106225] Updated weights for policy 1, policy_version 1634059 (0.0010) [2023-12-28 06:58:38,786][106225] Updated weights for policy 1, policy_version 1634069 (0.0010) [2023-12-28 06:58:39,161][106226] Updated weights for policy 0, policy_version 1630399 (0.0006) [2023-12-28 06:58:39,219][106226] Updated weights for policy 0, policy_version 1630409 (0.0006) [2023-12-28 06:58:39,290][106226] Updated weights for policy 0, policy_version 1630419 (0.0010) [2023-12-28 06:58:39,553][106225] Updated weights for policy 1, policy_version 1634079 (0.0010) [2023-12-28 06:58:39,624][106225] Updated weights for policy 1, policy_version 1634089 (0.0010) [2023-12-28 06:58:39,683][106225] Updated weights for policy 1, policy_version 1634099 (0.0010) [2023-12-28 06:58:39,973][106226] Updated weights for policy 0, policy_version 1630429 (0.0009) [2023-12-28 06:58:40,034][106226] Updated weights for policy 0, policy_version 1630439 (0.0009) [2023-12-28 06:58:40,099][106226] Updated weights for policy 0, policy_version 1630449 (0.0009) [2023-12-28 06:58:40,414][106225] Updated weights for policy 1, policy_version 1634109 (0.0009) [2023-12-28 06:58:40,479][106225] Updated weights for policy 1, policy_version 1634119 (0.0009) [2023-12-28 06:58:40,542][106225] Updated weights for policy 1, policy_version 1634129 (0.0008) [2023-12-28 06:58:40,795][106226] Updated weights for policy 0, policy_version 1630459 (0.0008) [2023-12-28 06:58:40,846][106226] Updated weights for policy 0, policy_version 1630469 (0.0006) [2023-12-28 06:58:40,910][106226] Updated weights for policy 0, policy_version 1630479 (0.0005) [2023-12-28 06:58:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 835870720. Throughput: 0: 10074.9, 1: 9871.6. Samples: 835841852. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:41,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.970')] [2023-12-28 06:58:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001630488_417480704.pth... [2023-12-28 06:58:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001634136_418390016.pth... [2023-12-28 06:58:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001633016_418103296.pth [2023-12-28 06:58:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001629304_417177600.pth [2023-12-28 06:58:41,300][106225] Updated weights for policy 1, policy_version 1634139 (0.0009) [2023-12-28 06:58:41,361][106225] Updated weights for policy 1, policy_version 1634149 (0.0010) [2023-12-28 06:58:41,430][106225] Updated weights for policy 1, policy_version 1634159 (0.0010) [2023-12-28 06:58:41,604][106226] Updated weights for policy 0, policy_version 1630489 (0.0005) [2023-12-28 06:58:41,677][106226] Updated weights for policy 0, policy_version 1630499 (0.0008) [2023-12-28 06:58:41,747][106226] Updated weights for policy 0, policy_version 1630509 (0.0008) [2023-12-28 06:58:41,810][106226] Updated weights for policy 0, policy_version 1630519 (0.0007) [2023-12-28 06:58:42,184][106225] Updated weights for policy 1, policy_version 1634169 (0.0008) [2023-12-28 06:58:42,248][106225] Updated weights for policy 1, policy_version 1634179 (0.0006) [2023-12-28 06:58:42,314][106225] Updated weights for policy 1, policy_version 1634189 (0.0006) [2023-12-28 06:58:42,380][106225] Updated weights for policy 1, policy_version 1634199 (0.0008) [2023-12-28 06:58:42,510][106226] Updated weights for policy 0, policy_version 1630529 (0.0008) [2023-12-28 06:58:42,575][106226] Updated weights for policy 0, policy_version 1630539 (0.0008) [2023-12-28 06:58:42,636][106226] Updated weights for policy 0, policy_version 1630549 (0.0011) [2023-12-28 06:58:43,035][106225] Updated weights for policy 1, policy_version 1634209 (0.0008) [2023-12-28 06:58:43,087][106225] Updated weights for policy 1, policy_version 1634219 (0.0008) [2023-12-28 06:58:43,133][106225] Updated weights for policy 1, policy_version 1634229 (0.0008) [2023-12-28 06:58:43,331][106226] Updated weights for policy 0, policy_version 1630559 (0.0011) [2023-12-28 06:58:43,382][106226] Updated weights for policy 0, policy_version 1630569 (0.0010) [2023-12-28 06:58:43,446][106226] Updated weights for policy 0, policy_version 1630579 (0.0011) [2023-12-28 06:58:43,891][106225] Updated weights for policy 1, policy_version 1634239 (0.0009) [2023-12-28 06:58:43,954][106225] Updated weights for policy 1, policy_version 1634249 (0.0008) [2023-12-28 06:58:44,011][106225] Updated weights for policy 1, policy_version 1634259 (0.0009) [2023-12-28 06:58:44,095][106226] Updated weights for policy 0, policy_version 1630589 (0.0009) [2023-12-28 06:58:44,149][106226] Updated weights for policy 0, policy_version 1630599 (0.0009) [2023-12-28 06:58:44,202][106226] Updated weights for policy 0, policy_version 1630609 (0.0008) [2023-12-28 06:58:44,806][106225] Updated weights for policy 1, policy_version 1634269 (0.0008) [2023-12-28 06:58:44,813][106226] Updated weights for policy 0, policy_version 1630619 (0.0007) [2023-12-28 06:58:44,866][106225] Updated weights for policy 1, policy_version 1634279 (0.0007) [2023-12-28 06:58:44,876][106226] Updated weights for policy 0, policy_version 1630629 (0.0010) [2023-12-28 06:58:44,932][106225] Updated weights for policy 1, policy_version 1634289 (0.0006) [2023-12-28 06:58:44,941][106226] Updated weights for policy 0, policy_version 1630639 (0.0011) [2023-12-28 06:58:45,622][106226] Updated weights for policy 0, policy_version 1630649 (0.0011) [2023-12-28 06:58:45,677][106226] Updated weights for policy 0, policy_version 1630659 (0.0008) [2023-12-28 06:58:45,686][106225] Updated weights for policy 1, policy_version 1634299 (0.0007) [2023-12-28 06:58:45,735][106226] Updated weights for policy 0, policy_version 1630669 (0.0005) [2023-12-28 06:58:45,748][106225] Updated weights for policy 1, policy_version 1634309 (0.0009) [2023-12-28 06:58:45,792][106226] Updated weights for policy 0, policy_version 1630679 (0.0005) [2023-12-28 06:58:45,813][106225] Updated weights for policy 1, policy_version 1634319 (0.0008) [2023-12-28 06:58:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 835969024. Throughput: 0: 10124.0, 1: 9777.5. Samples: 835958620. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:46,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.842')] [2023-12-28 06:58:46,463][106226] Updated weights for policy 0, policy_version 1630689 (0.0008) [2023-12-28 06:58:46,480][106225] Updated weights for policy 1, policy_version 1634329 (0.0007) [2023-12-28 06:58:46,524][106226] Updated weights for policy 0, policy_version 1630699 (0.0007) [2023-12-28 06:58:46,530][106225] Updated weights for policy 1, policy_version 1634339 (0.0010) [2023-12-28 06:58:46,579][106226] Updated weights for policy 0, policy_version 1630709 (0.0008) [2023-12-28 06:58:46,587][106225] Updated weights for policy 1, policy_version 1634349 (0.0010) [2023-12-28 06:58:46,646][106225] Updated weights for policy 1, policy_version 1634359 (0.0010) [2023-12-28 06:58:47,315][106226] Updated weights for policy 0, policy_version 1630719 (0.0008) [2023-12-28 06:58:47,361][106225] Updated weights for policy 1, policy_version 1634369 (0.0010) [2023-12-28 06:58:47,362][106226] Updated weights for policy 0, policy_version 1630729 (0.0006) [2023-12-28 06:58:47,406][106226] Updated weights for policy 0, policy_version 1630739 (0.0006) [2023-12-28 06:58:47,415][106225] Updated weights for policy 1, policy_version 1634379 (0.0010) [2023-12-28 06:58:47,462][106225] Updated weights for policy 1, policy_version 1634389 (0.0010) [2023-12-28 06:58:48,173][106226] Updated weights for policy 0, policy_version 1630749 (0.0007) [2023-12-28 06:58:48,209][106225] Updated weights for policy 1, policy_version 1634399 (0.0010) [2023-12-28 06:58:48,230][106226] Updated weights for policy 0, policy_version 1630759 (0.0006) [2023-12-28 06:58:48,266][106225] Updated weights for policy 1, policy_version 1634409 (0.0010) [2023-12-28 06:58:48,291][106226] Updated weights for policy 0, policy_version 1630769 (0.0005) [2023-12-28 06:58:48,327][106225] Updated weights for policy 1, policy_version 1634419 (0.0011) [2023-12-28 06:58:49,016][106226] Updated weights for policy 0, policy_version 1630779 (0.0009) [2023-12-28 06:58:49,061][106225] Updated weights for policy 1, policy_version 1634429 (0.0011) [2023-12-28 06:58:49,064][106226] Updated weights for policy 0, policy_version 1630789 (0.0007) [2023-12-28 06:58:49,115][106226] Updated weights for policy 0, policy_version 1630799 (0.0006) [2023-12-28 06:58:49,123][106225] Updated weights for policy 1, policy_version 1634439 (0.0010) [2023-12-28 06:58:49,179][106225] Updated weights for policy 1, policy_version 1634449 (0.0010) [2023-12-28 06:58:49,751][106226] Updated weights for policy 0, policy_version 1630809 (0.0006) [2023-12-28 06:58:49,821][106226] Updated weights for policy 0, policy_version 1630819 (0.0008) [2023-12-28 06:58:49,825][106225] Updated weights for policy 1, policy_version 1634459 (0.0009) [2023-12-28 06:58:49,888][106226] Updated weights for policy 0, policy_version 1630829 (0.0010) [2023-12-28 06:58:49,895][106225] Updated weights for policy 1, policy_version 1634469 (0.0011) [2023-12-28 06:58:49,949][106226] Updated weights for policy 0, policy_version 1630839 (0.0010) [2023-12-28 06:58:49,959][106225] Updated weights for policy 1, policy_version 1634479 (0.0008) [2023-12-28 06:58:50,605][106225] Updated weights for policy 1, policy_version 1634489 (0.0008) [2023-12-28 06:58:50,664][106225] Updated weights for policy 1, policy_version 1634499 (0.0009) [2023-12-28 06:58:50,712][106226] Updated weights for policy 0, policy_version 1630849 (0.0007) [2023-12-28 06:58:50,727][106225] Updated weights for policy 1, policy_version 1634509 (0.0007) [2023-12-28 06:58:50,775][106226] Updated weights for policy 0, policy_version 1630859 (0.0008) [2023-12-28 06:58:50,787][106225] Updated weights for policy 1, policy_version 1634519 (0.0006) [2023-12-28 06:58:50,839][106226] Updated weights for policy 0, policy_version 1630869 (0.0008) [2023-12-28 06:58:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 836067328. Throughput: 0: 10099.3, 1: 9686.9. Samples: 836075132. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:51,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.558')] [2023-12-28 06:58:51,477][106225] Updated weights for policy 1, policy_version 1634529 (0.0008) [2023-12-28 06:58:51,532][106225] Updated weights for policy 1, policy_version 1634539 (0.0008) [2023-12-28 06:58:51,591][106226] Updated weights for policy 0, policy_version 1630879 (0.0008) [2023-12-28 06:58:51,591][106225] Updated weights for policy 1, policy_version 1634549 (0.0008) [2023-12-28 06:58:51,663][106226] Updated weights for policy 0, policy_version 1630889 (0.0008) [2023-12-28 06:58:51,730][106226] Updated weights for policy 0, policy_version 1630899 (0.0008) [2023-12-28 06:58:52,375][106225] Updated weights for policy 1, policy_version 1634559 (0.0009) [2023-12-28 06:58:52,432][106225] Updated weights for policy 1, policy_version 1634569 (0.0008) [2023-12-28 06:58:52,467][106226] Updated weights for policy 0, policy_version 1630909 (0.0007) [2023-12-28 06:58:52,491][106225] Updated weights for policy 1, policy_version 1634579 (0.0009) [2023-12-28 06:58:52,534][106226] Updated weights for policy 0, policy_version 1630919 (0.0006) [2023-12-28 06:58:52,603][106226] Updated weights for policy 0, policy_version 1630929 (0.0006) [2023-12-28 06:58:53,249][106225] Updated weights for policy 1, policy_version 1634589 (0.0009) [2023-12-28 06:58:53,289][106226] Updated weights for policy 0, policy_version 1630939 (0.0007) [2023-12-28 06:58:53,298][106225] Updated weights for policy 1, policy_version 1634599 (0.0010) [2023-12-28 06:58:53,348][106225] Updated weights for policy 1, policy_version 1634609 (0.0010) [2023-12-28 06:58:53,348][106226] Updated weights for policy 0, policy_version 1630949 (0.0008) [2023-12-28 06:58:53,407][106226] Updated weights for policy 0, policy_version 1630959 (0.0010) [2023-12-28 06:58:53,967][106225] Updated weights for policy 1, policy_version 1634619 (0.0009) [2023-12-28 06:58:54,026][106225] Updated weights for policy 1, policy_version 1634629 (0.0008) [2023-12-28 06:58:54,082][106225] Updated weights for policy 1, policy_version 1634639 (0.0010) [2023-12-28 06:58:54,203][106226] Updated weights for policy 0, policy_version 1630969 (0.0008) [2023-12-28 06:58:54,266][106226] Updated weights for policy 0, policy_version 1630979 (0.0006) [2023-12-28 06:58:54,336][106226] Updated weights for policy 0, policy_version 1630989 (0.0006) [2023-12-28 06:58:54,393][106226] Updated weights for policy 0, policy_version 1630999 (0.0008) [2023-12-28 06:58:54,793][106225] Updated weights for policy 1, policy_version 1634649 (0.0010) [2023-12-28 06:58:54,853][106225] Updated weights for policy 1, policy_version 1634659 (0.0010) [2023-12-28 06:58:54,913][106225] Updated weights for policy 1, policy_version 1634669 (0.0010) [2023-12-28 06:58:54,969][106225] Updated weights for policy 1, policy_version 1634679 (0.0010) [2023-12-28 06:58:55,004][106226] Updated weights for policy 0, policy_version 1631009 (0.0010) [2023-12-28 06:58:55,062][106226] Updated weights for policy 0, policy_version 1631019 (0.0010) [2023-12-28 06:58:55,121][106226] Updated weights for policy 0, policy_version 1631029 (0.0009) [2023-12-28 06:58:55,661][106225] Updated weights for policy 1, policy_version 1634689 (0.0010) [2023-12-28 06:58:55,728][106225] Updated weights for policy 1, policy_version 1634699 (0.0011) [2023-12-28 06:58:55,800][106225] Updated weights for policy 1, policy_version 1634709 (0.0011) [2023-12-28 06:58:55,811][106226] Updated weights for policy 0, policy_version 1631039 (0.0010) [2023-12-28 06:58:55,865][106226] Updated weights for policy 0, policy_version 1631049 (0.0011) [2023-12-28 06:58:55,928][106226] Updated weights for policy 0, policy_version 1631059 (0.0007) [2023-12-28 06:58:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 836165632. Throughput: 0: 9972.9, 1: 9716.4. Samples: 836132324. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:58:56,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.840')] [2023-12-28 06:58:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001631064_417628160.pth... [2023-12-28 06:58:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001634712_418537472.pth... [2023-12-28 06:58:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001629880_417325056.pth [2023-12-28 06:58:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001633560_418242560.pth [2023-12-28 06:58:56,441][106225] Updated weights for policy 1, policy_version 1634719 (0.0008) [2023-12-28 06:58:56,496][106225] Updated weights for policy 1, policy_version 1634729 (0.0010) [2023-12-28 06:58:56,552][106225] Updated weights for policy 1, policy_version 1634739 (0.0010) [2023-12-28 06:58:56,558][106226] Updated weights for policy 0, policy_version 1631069 (0.0009) [2023-12-28 06:58:56,610][106226] Updated weights for policy 0, policy_version 1631079 (0.0010) [2023-12-28 06:58:56,655][106226] Updated weights for policy 0, policy_version 1631089 (0.0008) [2023-12-28 06:58:57,210][106225] Updated weights for policy 1, policy_version 1634749 (0.0008) [2023-12-28 06:58:57,240][106226] Updated weights for policy 0, policy_version 1631099 (0.0006) [2023-12-28 06:58:57,278][106225] Updated weights for policy 1, policy_version 1634759 (0.0008) [2023-12-28 06:58:57,297][106226] Updated weights for policy 0, policy_version 1631109 (0.0006) [2023-12-28 06:58:57,332][106225] Updated weights for policy 1, policy_version 1634769 (0.0009) [2023-12-28 06:58:57,352][106226] Updated weights for policy 0, policy_version 1631119 (0.0007) [2023-12-28 06:58:58,003][106226] Updated weights for policy 0, policy_version 1631129 (0.0006) [2023-12-28 06:58:58,010][106225] Updated weights for policy 1, policy_version 1634779 (0.0009) [2023-12-28 06:58:58,063][106225] Updated weights for policy 1, policy_version 1634789 (0.0008) [2023-12-28 06:58:58,065][106226] Updated weights for policy 0, policy_version 1631139 (0.0006) [2023-12-28 06:58:58,118][106226] Updated weights for policy 0, policy_version 1631149 (0.0006) [2023-12-28 06:58:58,120][106225] Updated weights for policy 1, policy_version 1634799 (0.0009) [2023-12-28 06:58:58,169][106226] Updated weights for policy 0, policy_version 1631159 (0.0005) [2023-12-28 06:58:58,898][106225] Updated weights for policy 1, policy_version 1634809 (0.0005) [2023-12-28 06:58:58,948][106225] Updated weights for policy 1, policy_version 1634819 (0.0008) [2023-12-28 06:58:59,017][106225] Updated weights for policy 1, policy_version 1634829 (0.0008) [2023-12-28 06:58:59,037][106226] Updated weights for policy 0, policy_version 1631169 (0.0008) [2023-12-28 06:58:59,067][106225] Updated weights for policy 1, policy_version 1634839 (0.0008) [2023-12-28 06:58:59,093][106226] Updated weights for policy 0, policy_version 1631179 (0.0008) [2023-12-28 06:58:59,155][106226] Updated weights for policy 0, policy_version 1631189 (0.0009) [2023-12-28 06:58:59,843][106225] Updated weights for policy 1, policy_version 1634849 (0.0008) [2023-12-28 06:58:59,909][106225] Updated weights for policy 1, policy_version 1634859 (0.0006) [2023-12-28 06:58:59,943][106226] Updated weights for policy 0, policy_version 1631199 (0.0009) [2023-12-28 06:58:59,975][106225] Updated weights for policy 1, policy_version 1634869 (0.0007) [2023-12-28 06:59:00,003][106226] Updated weights for policy 0, policy_version 1631209 (0.0007) [2023-12-28 06:59:00,057][106226] Updated weights for policy 0, policy_version 1631219 (0.0007) [2023-12-28 06:59:00,612][106225] Updated weights for policy 1, policy_version 1634879 (0.0008) [2023-12-28 06:59:00,622][106226] Updated weights for policy 0, policy_version 1631229 (0.0008) [2023-12-28 06:59:00,659][106225] Updated weights for policy 1, policy_version 1634889 (0.0009) [2023-12-28 06:59:00,674][106226] Updated weights for policy 0, policy_version 1631239 (0.0010) [2023-12-28 06:59:00,714][106225] Updated weights for policy 1, policy_version 1634899 (0.0008) [2023-12-28 06:59:00,721][106226] Updated weights for policy 0, policy_version 1631249 (0.0010) [2023-12-28 06:59:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 836263936. Throughput: 0: 10031.6, 1: 9788.2. Samples: 836252276. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:01,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.626')] [2023-12-28 06:59:01,424][106226] Updated weights for policy 0, policy_version 1631259 (0.0009) [2023-12-28 06:59:01,429][106225] Updated weights for policy 1, policy_version 1634909 (0.0009) [2023-12-28 06:59:01,483][106226] Updated weights for policy 0, policy_version 1631269 (0.0005) [2023-12-28 06:59:01,488][106225] Updated weights for policy 1, policy_version 1634919 (0.0008) [2023-12-28 06:59:01,535][106226] Updated weights for policy 0, policy_version 1631279 (0.0005) [2023-12-28 06:59:01,553][106225] Updated weights for policy 1, policy_version 1634929 (0.0008) [2023-12-28 06:59:02,262][106225] Updated weights for policy 1, policy_version 1634939 (0.0010) [2023-12-28 06:59:02,267][106226] Updated weights for policy 0, policy_version 1631289 (0.0006) [2023-12-28 06:59:02,315][106226] Updated weights for policy 0, policy_version 1631299 (0.0008) [2023-12-28 06:59:02,321][106225] Updated weights for policy 1, policy_version 1634949 (0.0007) [2023-12-28 06:59:02,378][106226] Updated weights for policy 0, policy_version 1631309 (0.0009) [2023-12-28 06:59:02,381][106225] Updated weights for policy 1, policy_version 1634959 (0.0006) [2023-12-28 06:59:02,434][106226] Updated weights for policy 0, policy_version 1631319 (0.0006) [2023-12-28 06:59:03,107][106225] Updated weights for policy 1, policy_version 1634969 (0.0006) [2023-12-28 06:59:03,157][106225] Updated weights for policy 1, policy_version 1634979 (0.0008) [2023-12-28 06:59:03,191][106226] Updated weights for policy 0, policy_version 1631329 (0.0007) [2023-12-28 06:59:03,207][106225] Updated weights for policy 1, policy_version 1634989 (0.0006) [2023-12-28 06:59:03,245][106226] Updated weights for policy 0, policy_version 1631339 (0.0007) [2023-12-28 06:59:03,260][106225] Updated weights for policy 1, policy_version 1634999 (0.0006) [2023-12-28 06:59:03,295][106226] Updated weights for policy 0, policy_version 1631349 (0.0009) [2023-12-28 06:59:03,962][106225] Updated weights for policy 1, policy_version 1635009 (0.0008) [2023-12-28 06:59:04,027][106225] Updated weights for policy 1, policy_version 1635019 (0.0009) [2023-12-28 06:59:04,050][106226] Updated weights for policy 0, policy_version 1631359 (0.0007) [2023-12-28 06:59:04,085][106225] Updated weights for policy 1, policy_version 1635029 (0.0006) [2023-12-28 06:59:04,104][106226] Updated weights for policy 0, policy_version 1631369 (0.0009) [2023-12-28 06:59:04,158][106226] Updated weights for policy 0, policy_version 1631379 (0.0010) [2023-12-28 06:59:04,741][106225] Updated weights for policy 1, policy_version 1635039 (0.0008) [2023-12-28 06:59:04,786][106225] Updated weights for policy 1, policy_version 1635049 (0.0008) [2023-12-28 06:59:04,835][106225] Updated weights for policy 1, policy_version 1635059 (0.0008) [2023-12-28 06:59:04,937][106226] Updated weights for policy 0, policy_version 1631389 (0.0007) [2023-12-28 06:59:04,985][106226] Updated weights for policy 0, policy_version 1631399 (0.0005) [2023-12-28 06:59:05,040][106226] Updated weights for policy 0, policy_version 1631409 (0.0006) [2023-12-28 06:59:05,601][106225] Updated weights for policy 1, policy_version 1635069 (0.0008) [2023-12-28 06:59:05,647][106225] Updated weights for policy 1, policy_version 1635079 (0.0008) [2023-12-28 06:59:05,661][106226] Updated weights for policy 0, policy_version 1631419 (0.0006) [2023-12-28 06:59:05,694][106225] Updated weights for policy 1, policy_version 1635089 (0.0006) [2023-12-28 06:59:05,716][106226] Updated weights for policy 0, policy_version 1631429 (0.0007) [2023-12-28 06:59:05,773][106226] Updated weights for policy 0, policy_version 1631439 (0.0008) [2023-12-28 06:59:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 836362240. Throughput: 0: 10051.7, 1: 9811.3. Samples: 836370904. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:06,175][105115] Avg episode reward: [(0, '-4.677'), (1, '-4.753')] [2023-12-28 06:59:06,446][106225] Updated weights for policy 1, policy_version 1635099 (0.0009) [2023-12-28 06:59:06,508][106225] Updated weights for policy 1, policy_version 1635109 (0.0010) [2023-12-28 06:59:06,524][106226] Updated weights for policy 0, policy_version 1631449 (0.0009) [2023-12-28 06:59:06,566][106225] Updated weights for policy 1, policy_version 1635119 (0.0010) [2023-12-28 06:59:06,588][106226] Updated weights for policy 0, policy_version 1631459 (0.0009) [2023-12-28 06:59:06,653][106226] Updated weights for policy 0, policy_version 1631469 (0.0009) [2023-12-28 06:59:06,716][106226] Updated weights for policy 0, policy_version 1631479 (0.0008) [2023-12-28 06:59:07,299][106225] Updated weights for policy 1, policy_version 1635129 (0.0010) [2023-12-28 06:59:07,354][106226] Updated weights for policy 0, policy_version 1631489 (0.0006) [2023-12-28 06:59:07,366][106225] Updated weights for policy 1, policy_version 1635139 (0.0010) [2023-12-28 06:59:07,419][106226] Updated weights for policy 0, policy_version 1631499 (0.0007) [2023-12-28 06:59:07,430][106225] Updated weights for policy 1, policy_version 1635149 (0.0011) [2023-12-28 06:59:07,473][106226] Updated weights for policy 0, policy_version 1631509 (0.0007) [2023-12-28 06:59:07,497][106225] Updated weights for policy 1, policy_version 1635159 (0.0010) [2023-12-28 06:59:08,099][106226] Updated weights for policy 0, policy_version 1631519 (0.0007) [2023-12-28 06:59:08,160][106226] Updated weights for policy 0, policy_version 1631529 (0.0006) [2023-12-28 06:59:08,182][106225] Updated weights for policy 1, policy_version 1635169 (0.0007) [2023-12-28 06:59:08,218][106226] Updated weights for policy 0, policy_version 1631539 (0.0006) [2023-12-28 06:59:08,240][106225] Updated weights for policy 1, policy_version 1635179 (0.0009) [2023-12-28 06:59:08,298][106225] Updated weights for policy 1, policy_version 1635189 (0.0010) [2023-12-28 06:59:08,853][106226] Updated weights for policy 0, policy_version 1631549 (0.0007) [2023-12-28 06:59:08,910][106226] Updated weights for policy 0, policy_version 1631559 (0.0010) [2023-12-28 06:59:08,971][106226] Updated weights for policy 0, policy_version 1631569 (0.0009) [2023-12-28 06:59:09,066][106225] Updated weights for policy 1, policy_version 1635199 (0.0008) [2023-12-28 06:59:09,125][106225] Updated weights for policy 1, policy_version 1635209 (0.0008) [2023-12-28 06:59:09,200][106225] Updated weights for policy 1, policy_version 1635219 (0.0008) [2023-12-28 06:59:09,753][106226] Updated weights for policy 0, policy_version 1631579 (0.0008) [2023-12-28 06:59:09,817][106226] Updated weights for policy 0, policy_version 1631589 (0.0006) [2023-12-28 06:59:09,889][106226] Updated weights for policy 0, policy_version 1631599 (0.0008) [2023-12-28 06:59:09,999][106225] Updated weights for policy 1, policy_version 1635229 (0.0008) [2023-12-28 06:59:10,059][106225] Updated weights for policy 1, policy_version 1635239 (0.0009) [2023-12-28 06:59:10,119][106225] Updated weights for policy 1, policy_version 1635249 (0.0007) [2023-12-28 06:59:10,610][106226] Updated weights for policy 0, policy_version 1631609 (0.0006) [2023-12-28 06:59:10,670][106226] Updated weights for policy 0, policy_version 1631619 (0.0008) [2023-12-28 06:59:10,734][106226] Updated weights for policy 0, policy_version 1631629 (0.0009) [2023-12-28 06:59:10,777][106225] Updated weights for policy 1, policy_version 1635259 (0.0007) [2023-12-28 06:59:10,787][106226] Updated weights for policy 0, policy_version 1631639 (0.0007) [2023-12-28 06:59:10,827][106225] Updated weights for policy 1, policy_version 1635269 (0.0010) [2023-12-28 06:59:10,874][106225] Updated weights for policy 1, policy_version 1635279 (0.0010) [2023-12-28 06:59:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 836460544. Throughput: 0: 10033.0, 1: 9801.9. Samples: 836429988. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:11,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.694')] [2023-12-28 06:59:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001635288_418684928.pth... [2023-12-28 06:59:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001631640_417775616.pth... [2023-12-28 06:59:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001630488_417480704.pth [2023-12-28 06:59:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001634136_418390016.pth [2023-12-28 06:59:11,614][106225] Updated weights for policy 1, policy_version 1635289 (0.0010) [2023-12-28 06:59:11,632][106226] Updated weights for policy 0, policy_version 1631649 (0.0008) [2023-12-28 06:59:11,687][106225] Updated weights for policy 1, policy_version 1635299 (0.0010) [2023-12-28 06:59:11,703][106226] Updated weights for policy 0, policy_version 1631659 (0.0009) [2023-12-28 06:59:11,763][106225] Updated weights for policy 1, policy_version 1635309 (0.0009) [2023-12-28 06:59:11,775][106226] Updated weights for policy 0, policy_version 1631669 (0.0008) [2023-12-28 06:59:11,829][106225] Updated weights for policy 1, policy_version 1635319 (0.0011) [2023-12-28 06:59:12,509][106226] Updated weights for policy 0, policy_version 1631679 (0.0007) [2023-12-28 06:59:12,537][106225] Updated weights for policy 1, policy_version 1635329 (0.0011) [2023-12-28 06:59:12,562][106226] Updated weights for policy 0, policy_version 1631689 (0.0006) [2023-12-28 06:59:12,595][106225] Updated weights for policy 1, policy_version 1635339 (0.0010) [2023-12-28 06:59:12,624][106226] Updated weights for policy 0, policy_version 1631699 (0.0006) [2023-12-28 06:59:12,650][106225] Updated weights for policy 1, policy_version 1635349 (0.0011) [2023-12-28 06:59:13,317][106226] Updated weights for policy 0, policy_version 1631709 (0.0008) [2023-12-28 06:59:13,332][106225] Updated weights for policy 1, policy_version 1635359 (0.0007) [2023-12-28 06:59:13,373][106226] Updated weights for policy 0, policy_version 1631719 (0.0010) [2023-12-28 06:59:13,376][106225] Updated weights for policy 1, policy_version 1635369 (0.0005) [2023-12-28 06:59:13,431][106225] Updated weights for policy 1, policy_version 1635379 (0.0006) [2023-12-28 06:59:13,436][106226] Updated weights for policy 0, policy_version 1631729 (0.0011) [2023-12-28 06:59:14,082][106225] Updated weights for policy 1, policy_version 1635389 (0.0010) [2023-12-28 06:59:14,131][106226] Updated weights for policy 0, policy_version 1631739 (0.0009) [2023-12-28 06:59:14,139][106225] Updated weights for policy 1, policy_version 1635399 (0.0008) [2023-12-28 06:59:14,194][106226] Updated weights for policy 0, policy_version 1631749 (0.0007) [2023-12-28 06:59:14,199][106225] Updated weights for policy 1, policy_version 1635409 (0.0010) [2023-12-28 06:59:14,257][106226] Updated weights for policy 0, policy_version 1631759 (0.0007) [2023-12-28 06:59:14,881][106226] Updated weights for policy 0, policy_version 1631769 (0.0008) [2023-12-28 06:59:14,931][106225] Updated weights for policy 1, policy_version 1635419 (0.0009) [2023-12-28 06:59:14,946][106226] Updated weights for policy 0, policy_version 1631779 (0.0009) [2023-12-28 06:59:14,996][106225] Updated weights for policy 1, policy_version 1635429 (0.0006) [2023-12-28 06:59:15,003][106226] Updated weights for policy 0, policy_version 1631789 (0.0008) [2023-12-28 06:59:15,062][106225] Updated weights for policy 1, policy_version 1635439 (0.0008) [2023-12-28 06:59:15,068][106226] Updated weights for policy 0, policy_version 1631799 (0.0009) [2023-12-28 06:59:15,741][106225] Updated weights for policy 1, policy_version 1635449 (0.0008) [2023-12-28 06:59:15,793][106226] Updated weights for policy 0, policy_version 1631809 (0.0005) [2023-12-28 06:59:15,799][106225] Updated weights for policy 1, policy_version 1635459 (0.0006) [2023-12-28 06:59:15,846][106226] Updated weights for policy 0, policy_version 1631819 (0.0005) [2023-12-28 06:59:15,856][106225] Updated weights for policy 1, policy_version 1635469 (0.0007) [2023-12-28 06:59:15,903][106225] Updated weights for policy 1, policy_version 1635479 (0.0010) [2023-12-28 06:59:15,904][106226] Updated weights for policy 0, policy_version 1631829 (0.0006) [2023-12-28 06:59:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 836558848. Throughput: 0: 9952.9, 1: 9790.3. Samples: 836546824. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:16,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-4.778')] [2023-12-28 06:59:16,461][106226] Updated weights for policy 0, policy_version 1631839 (0.0007) [2023-12-28 06:59:16,510][106226] Updated weights for policy 0, policy_version 1631849 (0.0005) [2023-12-28 06:59:16,564][106226] Updated weights for policy 0, policy_version 1631859 (0.0008) [2023-12-28 06:59:16,598][106225] Updated weights for policy 1, policy_version 1635489 (0.0010) [2023-12-28 06:59:16,659][106225] Updated weights for policy 1, policy_version 1635499 (0.0010) [2023-12-28 06:59:16,721][106225] Updated weights for policy 1, policy_version 1635509 (0.0010) [2023-12-28 06:59:17,252][106226] Updated weights for policy 0, policy_version 1631869 (0.0008) [2023-12-28 06:59:17,314][106226] Updated weights for policy 0, policy_version 1631879 (0.0009) [2023-12-28 06:59:17,367][106226] Updated weights for policy 0, policy_version 1631889 (0.0009) [2023-12-28 06:59:17,409][106225] Updated weights for policy 1, policy_version 1635519 (0.0009) [2023-12-28 06:59:17,474][106225] Updated weights for policy 1, policy_version 1635529 (0.0006) [2023-12-28 06:59:17,541][106225] Updated weights for policy 1, policy_version 1635539 (0.0006) [2023-12-28 06:59:18,005][106226] Updated weights for policy 0, policy_version 1631899 (0.0007) [2023-12-28 06:59:18,062][106226] Updated weights for policy 0, policy_version 1631909 (0.0007) [2023-12-28 06:59:18,127][106226] Updated weights for policy 0, policy_version 1631919 (0.0006) [2023-12-28 06:59:18,172][106225] Updated weights for policy 1, policy_version 1635549 (0.0007) [2023-12-28 06:59:18,224][106225] Updated weights for policy 1, policy_version 1635559 (0.0008) [2023-12-28 06:59:18,282][106225] Updated weights for policy 1, policy_version 1635569 (0.0010) [2023-12-28 06:59:18,783][106226] Updated weights for policy 0, policy_version 1631929 (0.0006) [2023-12-28 06:59:18,844][106226] Updated weights for policy 0, policy_version 1631939 (0.0011) [2023-12-28 06:59:18,905][106226] Updated weights for policy 0, policy_version 1631949 (0.0010) [2023-12-28 06:59:18,968][106226] Updated weights for policy 0, policy_version 1631959 (0.0007) [2023-12-28 06:59:19,052][106225] Updated weights for policy 1, policy_version 1635579 (0.0009) [2023-12-28 06:59:19,113][106225] Updated weights for policy 1, policy_version 1635589 (0.0008) [2023-12-28 06:59:19,172][106225] Updated weights for policy 1, policy_version 1635599 (0.0008) [2023-12-28 06:59:19,644][106226] Updated weights for policy 0, policy_version 1631969 (0.0008) [2023-12-28 06:59:19,710][106226] Updated weights for policy 0, policy_version 1631979 (0.0008) [2023-12-28 06:59:19,781][106226] Updated weights for policy 0, policy_version 1631989 (0.0009) [2023-12-28 06:59:19,877][106225] Updated weights for policy 1, policy_version 1635610 (0.0007) [2023-12-28 06:59:19,944][106225] Updated weights for policy 1, policy_version 1635620 (0.0007) [2023-12-28 06:59:20,013][106225] Updated weights for policy 1, policy_version 1635630 (0.0008) [2023-12-28 06:59:20,080][106225] Updated weights for policy 1, policy_version 1635640 (0.0008) [2023-12-28 06:59:20,549][106226] Updated weights for policy 0, policy_version 1631999 (0.0009) [2023-12-28 06:59:20,609][106226] Updated weights for policy 0, policy_version 1632009 (0.0008) [2023-12-28 06:59:20,663][106226] Updated weights for policy 0, policy_version 1632019 (0.0009) [2023-12-28 06:59:20,733][106225] Updated weights for policy 1, policy_version 1635650 (0.0009) [2023-12-28 06:59:20,787][106225] Updated weights for policy 1, policy_version 1635660 (0.0009) [2023-12-28 06:59:20,839][106225] Updated weights for policy 1, policy_version 1635670 (0.0008) [2023-12-28 06:59:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 836657152. Throughput: 0: 9904.4, 1: 9734.9. Samples: 836666048. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:21,175][105115] Avg episode reward: [(0, '-4.645'), (1, '-5.052')] [2023-12-28 06:59:21,483][106226] Updated weights for policy 0, policy_version 1632029 (0.0008) [2023-12-28 06:59:21,547][106226] Updated weights for policy 0, policy_version 1632039 (0.0008) [2023-12-28 06:59:21,612][106226] Updated weights for policy 0, policy_version 1632049 (0.0009) [2023-12-28 06:59:21,640][106225] Updated weights for policy 1, policy_version 1635680 (0.0008) [2023-12-28 06:59:21,710][106225] Updated weights for policy 1, policy_version 1635690 (0.0008) [2023-12-28 06:59:21,775][106225] Updated weights for policy 1, policy_version 1635700 (0.0010) [2023-12-28 06:59:22,298][106226] Updated weights for policy 0, policy_version 1632059 (0.0007) [2023-12-28 06:59:22,370][106226] Updated weights for policy 0, policy_version 1632069 (0.0008) [2023-12-28 06:59:22,437][106226] Updated weights for policy 0, policy_version 1632079 (0.0007) [2023-12-28 06:59:22,537][106225] Updated weights for policy 1, policy_version 1635710 (0.0007) [2023-12-28 06:59:22,599][106225] Updated weights for policy 1, policy_version 1635720 (0.0008) [2023-12-28 06:59:22,661][106225] Updated weights for policy 1, policy_version 1635730 (0.0007) [2023-12-28 06:59:23,071][106226] Updated weights for policy 0, policy_version 1632089 (0.0009) [2023-12-28 06:59:23,132][106226] Updated weights for policy 0, policy_version 1632099 (0.0008) [2023-12-28 06:59:23,188][106226] Updated weights for policy 0, policy_version 1632109 (0.0006) [2023-12-28 06:59:23,253][106226] Updated weights for policy 0, policy_version 1632119 (0.0005) [2023-12-28 06:59:23,409][106225] Updated weights for policy 1, policy_version 1635740 (0.0007) [2023-12-28 06:59:23,457][106225] Updated weights for policy 1, policy_version 1635750 (0.0005) [2023-12-28 06:59:23,510][106225] Updated weights for policy 1, policy_version 1635760 (0.0006) [2023-12-28 06:59:23,888][106226] Updated weights for policy 0, policy_version 1632129 (0.0009) [2023-12-28 06:59:23,941][106226] Updated weights for policy 0, policy_version 1632139 (0.0008) [2023-12-28 06:59:23,998][106226] Updated weights for policy 0, policy_version 1632149 (0.0009) [2023-12-28 06:59:24,155][106225] Updated weights for policy 1, policy_version 1635770 (0.0009) [2023-12-28 06:59:24,204][106225] Updated weights for policy 1, policy_version 1635780 (0.0010) [2023-12-28 06:59:24,258][106225] Updated weights for policy 1, policy_version 1635790 (0.0008) [2023-12-28 06:59:24,312][106225] Updated weights for policy 1, policy_version 1635800 (0.0010) [2023-12-28 06:59:24,751][106226] Updated weights for policy 0, policy_version 1632159 (0.0008) [2023-12-28 06:59:24,800][106226] Updated weights for policy 0, policy_version 1632169 (0.0008) [2023-12-28 06:59:24,849][106226] Updated weights for policy 0, policy_version 1632179 (0.0009) [2023-12-28 06:59:24,936][106225] Updated weights for policy 1, policy_version 1635810 (0.0005) [2023-12-28 06:59:24,999][106225] Updated weights for policy 1, policy_version 1635820 (0.0005) [2023-12-28 06:59:25,060][106225] Updated weights for policy 1, policy_version 1635830 (0.0010) [2023-12-28 06:59:25,600][106225] Updated weights for policy 1, policy_version 1635840 (0.0006) [2023-12-28 06:59:25,615][106226] Updated weights for policy 0, policy_version 1632189 (0.0009) [2023-12-28 06:59:25,657][106225] Updated weights for policy 1, policy_version 1635850 (0.0005) [2023-12-28 06:59:25,665][106226] Updated weights for policy 0, policy_version 1632199 (0.0007) [2023-12-28 06:59:25,710][106226] Updated weights for policy 0, policy_version 1632209 (0.0005) [2023-12-28 06:59:25,722][106225] Updated weights for policy 1, policy_version 1635860 (0.0005) [2023-12-28 06:59:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 836755456. Throughput: 0: 9874.4, 1: 9710.4. Samples: 836723168. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:26,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.926')] [2023-12-28 06:59:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001632216_417923072.pth... [2023-12-28 06:59:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001635864_418832384.pth... [2023-12-28 06:59:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001634712_418537472.pth [2023-12-28 06:59:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001631064_417628160.pth [2023-12-28 06:59:26,299][106225] Updated weights for policy 1, policy_version 1635870 (0.0005) [2023-12-28 06:59:26,341][106226] Updated weights for policy 0, policy_version 1632219 (0.0007) [2023-12-28 06:59:26,351][106225] Updated weights for policy 1, policy_version 1635880 (0.0005) [2023-12-28 06:59:26,401][106225] Updated weights for policy 1, policy_version 1635890 (0.0009) [2023-12-28 06:59:26,403][106226] Updated weights for policy 0, policy_version 1632229 (0.0010) [2023-12-28 06:59:26,463][106226] Updated weights for policy 0, policy_version 1632239 (0.0011) [2023-12-28 06:59:27,056][106225] Updated weights for policy 1, policy_version 1635900 (0.0009) [2023-12-28 06:59:27,113][106225] Updated weights for policy 1, policy_version 1635910 (0.0010) [2023-12-28 06:59:27,175][106225] Updated weights for policy 1, policy_version 1635920 (0.0010) [2023-12-28 06:59:27,184][106226] Updated weights for policy 0, policy_version 1632249 (0.0010) [2023-12-28 06:59:27,230][106226] Updated weights for policy 0, policy_version 1632259 (0.0010) [2023-12-28 06:59:27,288][106226] Updated weights for policy 0, policy_version 1632269 (0.0010) [2023-12-28 06:59:27,342][106226] Updated weights for policy 0, policy_version 1632279 (0.0010) [2023-12-28 06:59:27,882][106225] Updated weights for policy 1, policy_version 1635930 (0.0010) [2023-12-28 06:59:27,942][106225] Updated weights for policy 1, policy_version 1635940 (0.0011) [2023-12-28 06:59:27,993][106225] Updated weights for policy 1, policy_version 1635950 (0.0010) [2023-12-28 06:59:28,040][106225] Updated weights for policy 1, policy_version 1635960 (0.0010) [2023-12-28 06:59:28,041][106226] Updated weights for policy 0, policy_version 1632289 (0.0010) [2023-12-28 06:59:28,101][106226] Updated weights for policy 0, policy_version 1632299 (0.0010) [2023-12-28 06:59:28,165][106226] Updated weights for policy 0, policy_version 1632309 (0.0011) [2023-12-28 06:59:28,780][106225] Updated weights for policy 1, policy_version 1635970 (0.0008) [2023-12-28 06:59:28,811][106226] Updated weights for policy 0, policy_version 1632319 (0.0011) [2023-12-28 06:59:28,831][106225] Updated weights for policy 1, policy_version 1635980 (0.0008) [2023-12-28 06:59:28,861][106226] Updated weights for policy 0, policy_version 1632329 (0.0010) [2023-12-28 06:59:28,886][106225] Updated weights for policy 1, policy_version 1635990 (0.0005) [2023-12-28 06:59:28,913][106226] Updated weights for policy 0, policy_version 1632339 (0.0010) [2023-12-28 06:59:29,615][106226] Updated weights for policy 0, policy_version 1632349 (0.0010) [2023-12-28 06:59:29,664][106225] Updated weights for policy 1, policy_version 1636000 (0.0006) [2023-12-28 06:59:29,677][106226] Updated weights for policy 0, policy_version 1632359 (0.0011) [2023-12-28 06:59:29,728][106225] Updated weights for policy 1, policy_version 1636010 (0.0007) [2023-12-28 06:59:29,742][106226] Updated weights for policy 0, policy_version 1632369 (0.0011) [2023-12-28 06:59:29,783][106225] Updated weights for policy 1, policy_version 1636020 (0.0006) [2023-12-28 06:59:30,445][106225] Updated weights for policy 1, policy_version 1636030 (0.0009) [2023-12-28 06:59:30,496][106226] Updated weights for policy 0, policy_version 1632379 (0.0010) [2023-12-28 06:59:30,498][106225] Updated weights for policy 1, policy_version 1636040 (0.0010) [2023-12-28 06:59:30,548][106225] Updated weights for policy 1, policy_version 1636050 (0.0010) [2023-12-28 06:59:30,549][106226] Updated weights for policy 0, policy_version 1632389 (0.0010) [2023-12-28 06:59:30,608][106226] Updated weights for policy 0, policy_version 1632399 (0.0010) [2023-12-28 06:59:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 836853760. Throughput: 0: 9855.6, 1: 9869.4. Samples: 836846248. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:31,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.631')] [2023-12-28 06:59:31,205][106225] Updated weights for policy 1, policy_version 1636060 (0.0009) [2023-12-28 06:59:31,266][106225] Updated weights for policy 1, policy_version 1636070 (0.0009) [2023-12-28 06:59:31,322][106225] Updated weights for policy 1, policy_version 1636080 (0.0008) [2023-12-28 06:59:31,340][106226] Updated weights for policy 0, policy_version 1632409 (0.0010) [2023-12-28 06:59:31,415][106226] Updated weights for policy 0, policy_version 1632419 (0.0009) [2023-12-28 06:59:31,476][106226] Updated weights for policy 0, policy_version 1632429 (0.0010) [2023-12-28 06:59:31,529][106226] Updated weights for policy 0, policy_version 1632439 (0.0010) [2023-12-28 06:59:32,061][106225] Updated weights for policy 1, policy_version 1636090 (0.0009) [2023-12-28 06:59:32,121][106225] Updated weights for policy 1, policy_version 1636100 (0.0010) [2023-12-28 06:59:32,175][106225] Updated weights for policy 1, policy_version 1636110 (0.0010) [2023-12-28 06:59:32,221][106225] Updated weights for policy 1, policy_version 1636120 (0.0008) [2023-12-28 06:59:32,253][106226] Updated weights for policy 0, policy_version 1632449 (0.0008) [2023-12-28 06:59:32,315][106226] Updated weights for policy 0, policy_version 1632459 (0.0009) [2023-12-28 06:59:32,377][106226] Updated weights for policy 0, policy_version 1632469 (0.0008) [2023-12-28 06:59:32,885][106225] Updated weights for policy 1, policy_version 1636130 (0.0009) [2023-12-28 06:59:32,944][106225] Updated weights for policy 1, policy_version 1636140 (0.0008) [2023-12-28 06:59:33,001][106225] Updated weights for policy 1, policy_version 1636150 (0.0008) [2023-12-28 06:59:33,071][106226] Updated weights for policy 0, policy_version 1632479 (0.0008) [2023-12-28 06:59:33,132][106226] Updated weights for policy 0, policy_version 1632489 (0.0008) [2023-12-28 06:59:33,195][106226] Updated weights for policy 0, policy_version 1632499 (0.0005) [2023-12-28 06:59:33,686][106225] Updated weights for policy 1, policy_version 1636160 (0.0010) [2023-12-28 06:59:33,733][106225] Updated weights for policy 1, policy_version 1636170 (0.0010) [2023-12-28 06:59:33,773][106226] Updated weights for policy 0, policy_version 1632509 (0.0006) [2023-12-28 06:59:33,786][106225] Updated weights for policy 1, policy_version 1636180 (0.0010) [2023-12-28 06:59:33,844][106226] Updated weights for policy 0, policy_version 1632519 (0.0007) [2023-12-28 06:59:33,897][106226] Updated weights for policy 0, policy_version 1632529 (0.0009) [2023-12-28 06:59:34,469][106225] Updated weights for policy 1, policy_version 1636190 (0.0010) [2023-12-28 06:59:34,531][106225] Updated weights for policy 1, policy_version 1636200 (0.0010) [2023-12-28 06:59:34,593][106225] Updated weights for policy 1, policy_version 1636210 (0.0010) [2023-12-28 06:59:34,632][106226] Updated weights for policy 0, policy_version 1632539 (0.0008) [2023-12-28 06:59:34,692][106226] Updated weights for policy 0, policy_version 1632549 (0.0008) [2023-12-28 06:59:34,754][106226] Updated weights for policy 0, policy_version 1632559 (0.0008) [2023-12-28 06:59:35,298][106225] Updated weights for policy 1, policy_version 1636220 (0.0008) [2023-12-28 06:59:35,356][106225] Updated weights for policy 1, policy_version 1636230 (0.0005) [2023-12-28 06:59:35,419][106225] Updated weights for policy 1, policy_version 1636240 (0.0005) [2023-12-28 06:59:35,523][106226] Updated weights for policy 0, policy_version 1632569 (0.0008) [2023-12-28 06:59:35,577][106226] Updated weights for policy 0, policy_version 1632579 (0.0009) [2023-12-28 06:59:35,641][106226] Updated weights for policy 0, policy_version 1632589 (0.0008) [2023-12-28 06:59:35,700][106226] Updated weights for policy 0, policy_version 1632599 (0.0007) [2023-12-28 06:59:36,023][106225] Updated weights for policy 1, policy_version 1636250 (0.0005) [2023-12-28 06:59:36,072][106225] Updated weights for policy 1, policy_version 1636260 (0.0005) [2023-12-28 06:59:36,138][106225] Updated weights for policy 1, policy_version 1636270 (0.0007) [2023-12-28 06:59:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 836952064. Throughput: 0: 9868.2, 1: 9921.6. Samples: 836965672. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:36,179][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.923')] [2023-12-28 06:59:36,200][106225] Updated weights for policy 1, policy_version 1636280 (0.0007) [2023-12-28 06:59:36,480][106226] Updated weights for policy 0, policy_version 1632609 (0.0009) [2023-12-28 06:59:36,548][106226] Updated weights for policy 0, policy_version 1632619 (0.0011) [2023-12-28 06:59:36,614][106226] Updated weights for policy 0, policy_version 1632629 (0.0009) [2023-12-28 06:59:36,825][106225] Updated weights for policy 1, policy_version 1636290 (0.0008) [2023-12-28 06:59:36,889][106225] Updated weights for policy 1, policy_version 1636300 (0.0008) [2023-12-28 06:59:36,948][106225] Updated weights for policy 1, policy_version 1636310 (0.0008) [2023-12-28 06:59:37,384][106226] Updated weights for policy 0, policy_version 1632639 (0.0008) [2023-12-28 06:59:37,441][106226] Updated weights for policy 0, policy_version 1632649 (0.0007) [2023-12-28 06:59:37,491][106226] Updated weights for policy 0, policy_version 1632659 (0.0008) [2023-12-28 06:59:37,607][106225] Updated weights for policy 1, policy_version 1636320 (0.0006) [2023-12-28 06:59:37,652][106225] Updated weights for policy 1, policy_version 1636330 (0.0005) [2023-12-28 06:59:37,697][106225] Updated weights for policy 1, policy_version 1636340 (0.0010) [2023-12-28 06:59:38,282][106226] Updated weights for policy 0, policy_version 1632669 (0.0008) [2023-12-28 06:59:38,346][106226] Updated weights for policy 0, policy_version 1632679 (0.0008) [2023-12-28 06:59:38,390][106225] Updated weights for policy 1, policy_version 1636350 (0.0009) [2023-12-28 06:59:38,408][106226] Updated weights for policy 0, policy_version 1632689 (0.0008) [2023-12-28 06:59:38,451][106225] Updated weights for policy 1, policy_version 1636360 (0.0005) [2023-12-28 06:59:38,510][106225] Updated weights for policy 1, policy_version 1636370 (0.0007) [2023-12-28 06:59:39,015][106226] Updated weights for policy 0, policy_version 1632699 (0.0008) [2023-12-28 06:59:39,070][106226] Updated weights for policy 0, policy_version 1632709 (0.0008) [2023-12-28 06:59:39,131][106226] Updated weights for policy 0, policy_version 1632719 (0.0009) [2023-12-28 06:59:39,234][106225] Updated weights for policy 1, policy_version 1636380 (0.0008) [2023-12-28 06:59:39,305][106225] Updated weights for policy 1, policy_version 1636390 (0.0007) [2023-12-28 06:59:39,378][106225] Updated weights for policy 1, policy_version 1636400 (0.0008) [2023-12-28 06:59:39,921][106226] Updated weights for policy 0, policy_version 1632729 (0.0009) [2023-12-28 06:59:39,982][106226] Updated weights for policy 0, policy_version 1632739 (0.0006) [2023-12-28 06:59:40,039][106226] Updated weights for policy 0, policy_version 1632749 (0.0006) [2023-12-28 06:59:40,089][106226] Updated weights for policy 0, policy_version 1632759 (0.0008) [2023-12-28 06:59:40,148][106225] Updated weights for policy 1, policy_version 1636410 (0.0008) [2023-12-28 06:59:40,201][106225] Updated weights for policy 1, policy_version 1636420 (0.0008) [2023-12-28 06:59:40,264][106225] Updated weights for policy 1, policy_version 1636430 (0.0008) [2023-12-28 06:59:40,323][106225] Updated weights for policy 1, policy_version 1636440 (0.0008) [2023-12-28 06:59:40,825][106226] Updated weights for policy 0, policy_version 1632769 (0.0008) [2023-12-28 06:59:40,878][106226] Updated weights for policy 0, policy_version 1632779 (0.0008) [2023-12-28 06:59:40,932][106226] Updated weights for policy 0, policy_version 1632789 (0.0006) [2023-12-28 06:59:41,024][106225] Updated weights for policy 1, policy_version 1636450 (0.0009) [2023-12-28 06:59:41,089][106225] Updated weights for policy 1, policy_version 1636460 (0.0008) [2023-12-28 06:59:41,156][106225] Updated weights for policy 1, policy_version 1636470 (0.0009) [2023-12-28 06:59:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 837058560. Throughput: 0: 9876.3, 1: 9959.8. Samples: 837024952. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:41,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.699')] [2023-12-28 06:59:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001636472_418988032.pth... [2023-12-28 06:59:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001632792_418070528.pth... [2023-12-28 06:59:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001631640_417775616.pth [2023-12-28 06:59:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001635288_418684928.pth [2023-12-28 06:59:41,688][106226] Updated weights for policy 0, policy_version 1632799 (0.0008) [2023-12-28 06:59:41,758][106226] Updated weights for policy 0, policy_version 1632809 (0.0007) [2023-12-28 06:59:41,826][106226] Updated weights for policy 0, policy_version 1632819 (0.0008) [2023-12-28 06:59:41,951][106225] Updated weights for policy 1, policy_version 1636480 (0.0008) [2023-12-28 06:59:42,011][106225] Updated weights for policy 1, policy_version 1636490 (0.0008) [2023-12-28 06:59:42,062][106225] Updated weights for policy 1, policy_version 1636500 (0.0008) [2023-12-28 06:59:42,570][106226] Updated weights for policy 0, policy_version 1632829 (0.0008) [2023-12-28 06:59:42,637][106226] Updated weights for policy 0, policy_version 1632839 (0.0009) [2023-12-28 06:59:42,699][106226] Updated weights for policy 0, policy_version 1632849 (0.0008) [2023-12-28 06:59:42,828][106225] Updated weights for policy 1, policy_version 1636510 (0.0008) [2023-12-28 06:59:42,888][106225] Updated weights for policy 1, policy_version 1636520 (0.0009) [2023-12-28 06:59:42,939][106225] Updated weights for policy 1, policy_version 1636530 (0.0008) [2023-12-28 06:59:43,393][106226] Updated weights for policy 0, policy_version 1632859 (0.0008) [2023-12-28 06:59:43,456][106226] Updated weights for policy 0, policy_version 1632869 (0.0009) [2023-12-28 06:59:43,511][106226] Updated weights for policy 0, policy_version 1632879 (0.0008) [2023-12-28 06:59:43,688][106225] Updated weights for policy 1, policy_version 1636540 (0.0008) [2023-12-28 06:59:43,750][106225] Updated weights for policy 1, policy_version 1636550 (0.0009) [2023-12-28 06:59:43,806][106225] Updated weights for policy 1, policy_version 1636560 (0.0008) [2023-12-28 06:59:44,125][106226] Updated weights for policy 0, policy_version 1632889 (0.0008) [2023-12-28 06:59:44,186][106226] Updated weights for policy 0, policy_version 1632899 (0.0006) [2023-12-28 06:59:44,239][106226] Updated weights for policy 0, policy_version 1632909 (0.0009) [2023-12-28 06:59:44,296][106226] Updated weights for policy 0, policy_version 1632919 (0.0006) [2023-12-28 06:59:44,418][106225] Updated weights for policy 1, policy_version 1636570 (0.0008) [2023-12-28 06:59:44,472][106225] Updated weights for policy 1, policy_version 1636580 (0.0005) [2023-12-28 06:59:44,535][106225] Updated weights for policy 1, policy_version 1636590 (0.0005) [2023-12-28 06:59:44,595][106225] Updated weights for policy 1, policy_version 1636600 (0.0006) [2023-12-28 06:59:44,974][106226] Updated weights for policy 0, policy_version 1632929 (0.0008) [2023-12-28 06:59:45,032][106226] Updated weights for policy 0, policy_version 1632939 (0.0008) [2023-12-28 06:59:45,091][106226] Updated weights for policy 0, policy_version 1632949 (0.0009) [2023-12-28 06:59:45,228][106225] Updated weights for policy 1, policy_version 1636610 (0.0009) [2023-12-28 06:59:45,281][106225] Updated weights for policy 1, policy_version 1636620 (0.0008) [2023-12-28 06:59:45,334][106225] Updated weights for policy 1, policy_version 1636630 (0.0009) [2023-12-28 06:59:45,814][106226] Updated weights for policy 0, policy_version 1632959 (0.0009) [2023-12-28 06:59:45,862][106226] Updated weights for policy 0, policy_version 1632969 (0.0008) [2023-12-28 06:59:45,935][106226] Updated weights for policy 0, policy_version 1632979 (0.0005) [2023-12-28 06:59:45,997][106225] Updated weights for policy 1, policy_version 1636640 (0.0007) [2023-12-28 06:59:46,049][106225] Updated weights for policy 1, policy_version 1636650 (0.0008) [2023-12-28 06:59:46,098][106225] Updated weights for policy 1, policy_version 1636660 (0.0006) [2023-12-28 06:59:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 837156864. Throughput: 0: 9823.4, 1: 9920.1. Samples: 837140736. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:46,176][105115] Avg episode reward: [(0, '-4.541'), (1, '-4.953')] [2023-12-28 06:59:46,671][106226] Updated weights for policy 0, policy_version 1632989 (0.0008) [2023-12-28 06:59:46,711][106225] Updated weights for policy 1, policy_version 1636670 (0.0005) [2023-12-28 06:59:46,731][106226] Updated weights for policy 0, policy_version 1632999 (0.0008) [2023-12-28 06:59:46,767][106225] Updated weights for policy 1, policy_version 1636680 (0.0005) [2023-12-28 06:59:46,791][106226] Updated weights for policy 0, policy_version 1633009 (0.0008) [2023-12-28 06:59:46,825][106225] Updated weights for policy 1, policy_version 1636690 (0.0005) [2023-12-28 06:59:47,432][106225] Updated weights for policy 1, policy_version 1636700 (0.0005) [2023-12-28 06:59:47,489][106225] Updated weights for policy 1, policy_version 1636710 (0.0005) [2023-12-28 06:59:47,531][106226] Updated weights for policy 0, policy_version 1633019 (0.0008) [2023-12-28 06:59:47,542][106225] Updated weights for policy 1, policy_version 1636720 (0.0006) [2023-12-28 06:59:47,586][106226] Updated weights for policy 0, policy_version 1633029 (0.0007) [2023-12-28 06:59:47,640][106226] Updated weights for policy 0, policy_version 1633039 (0.0009) [2023-12-28 06:59:48,162][106225] Updated weights for policy 1, policy_version 1636730 (0.0007) [2023-12-28 06:59:48,224][106225] Updated weights for policy 1, policy_version 1636740 (0.0010) [2023-12-28 06:59:48,283][106225] Updated weights for policy 1, policy_version 1636750 (0.0010) [2023-12-28 06:59:48,351][106225] Updated weights for policy 1, policy_version 1636760 (0.0008) [2023-12-28 06:59:48,373][106226] Updated weights for policy 0, policy_version 1633049 (0.0006) [2023-12-28 06:59:48,439][106226] Updated weights for policy 0, policy_version 1633059 (0.0005) [2023-12-28 06:59:48,504][106226] Updated weights for policy 0, policy_version 1633069 (0.0009) [2023-12-28 06:59:48,563][106226] Updated weights for policy 0, policy_version 1633079 (0.0011) [2023-12-28 06:59:49,121][106225] Updated weights for policy 1, policy_version 1636770 (0.0005) [2023-12-28 06:59:49,147][106226] Updated weights for policy 0, policy_version 1633089 (0.0010) [2023-12-28 06:59:49,184][106225] Updated weights for policy 1, policy_version 1636780 (0.0005) [2023-12-28 06:59:49,205][106226] Updated weights for policy 0, policy_version 1633099 (0.0011) [2023-12-28 06:59:49,247][106225] Updated weights for policy 1, policy_version 1636790 (0.0007) [2023-12-28 06:59:49,269][106226] Updated weights for policy 0, policy_version 1633109 (0.0010) [2023-12-28 06:59:49,982][106225] Updated weights for policy 1, policy_version 1636800 (0.0007) [2023-12-28 06:59:50,026][106226] Updated weights for policy 0, policy_version 1633119 (0.0011) [2023-12-28 06:59:50,036][106225] Updated weights for policy 1, policy_version 1636810 (0.0008) [2023-12-28 06:59:50,077][106226] Updated weights for policy 0, policy_version 1633129 (0.0011) [2023-12-28 06:59:50,095][106225] Updated weights for policy 1, policy_version 1636820 (0.0005) [2023-12-28 06:59:50,138][106226] Updated weights for policy 0, policy_version 1633139 (0.0010) [2023-12-28 06:59:50,791][106225] Updated weights for policy 1, policy_version 1636830 (0.0009) [2023-12-28 06:59:50,849][106225] Updated weights for policy 1, policy_version 1636840 (0.0007) [2023-12-28 06:59:50,874][106226] Updated weights for policy 0, policy_version 1633149 (0.0008) [2023-12-28 06:59:50,909][106225] Updated weights for policy 1, policy_version 1636850 (0.0007) [2023-12-28 06:59:50,932][106226] Updated weights for policy 0, policy_version 1633159 (0.0009) [2023-12-28 06:59:50,990][106226] Updated weights for policy 0, policy_version 1633169 (0.0008) [2023-12-28 06:59:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 837255168. Throughput: 0: 9778.8, 1: 9970.5. Samples: 837259628. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:51,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.575')] [2023-12-28 06:59:51,706][106225] Updated weights for policy 1, policy_version 1636860 (0.0009) [2023-12-28 06:59:51,752][106226] Updated weights for policy 0, policy_version 1633179 (0.0007) [2023-12-28 06:59:51,777][106225] Updated weights for policy 1, policy_version 1636870 (0.0008) [2023-12-28 06:59:51,814][106226] Updated weights for policy 0, policy_version 1633189 (0.0008) [2023-12-28 06:59:51,844][106225] Updated weights for policy 1, policy_version 1636880 (0.0008) [2023-12-28 06:59:51,873][106226] Updated weights for policy 0, policy_version 1633199 (0.0006) [2023-12-28 06:59:52,453][106225] Updated weights for policy 1, policy_version 1636890 (0.0008) [2023-12-28 06:59:52,516][106225] Updated weights for policy 1, policy_version 1636900 (0.0008) [2023-12-28 06:59:52,571][106225] Updated weights for policy 1, policy_version 1636910 (0.0008) [2023-12-28 06:59:52,625][106226] Updated weights for policy 0, policy_version 1633209 (0.0009) [2023-12-28 06:59:52,628][106225] Updated weights for policy 1, policy_version 1636920 (0.0009) [2023-12-28 06:59:52,678][106226] Updated weights for policy 0, policy_version 1633219 (0.0007) [2023-12-28 06:59:52,737][106226] Updated weights for policy 0, policy_version 1633229 (0.0008) [2023-12-28 06:59:52,802][106226] Updated weights for policy 0, policy_version 1633239 (0.0011) [2023-12-28 06:59:53,279][106225] Updated weights for policy 1, policy_version 1636930 (0.0010) [2023-12-28 06:59:53,324][106225] Updated weights for policy 1, policy_version 1636940 (0.0006) [2023-12-28 06:59:53,377][106225] Updated weights for policy 1, policy_version 1636950 (0.0005) [2023-12-28 06:59:53,444][106226] Updated weights for policy 0, policy_version 1633249 (0.0006) [2023-12-28 06:59:53,491][106226] Updated weights for policy 0, policy_version 1633259 (0.0005) [2023-12-28 06:59:53,544][106226] Updated weights for policy 0, policy_version 1633269 (0.0006) [2023-12-28 06:59:54,065][106225] Updated weights for policy 1, policy_version 1636960 (0.0009) [2023-12-28 06:59:54,116][106225] Updated weights for policy 1, policy_version 1636970 (0.0010) [2023-12-28 06:59:54,183][106225] Updated weights for policy 1, policy_version 1636980 (0.0008) [2023-12-28 06:59:54,229][106226] Updated weights for policy 0, policy_version 1633279 (0.0007) [2023-12-28 06:59:54,283][106226] Updated weights for policy 0, policy_version 1633289 (0.0008) [2023-12-28 06:59:54,332][106226] Updated weights for policy 0, policy_version 1633299 (0.0007) [2023-12-28 06:59:54,812][106225] Updated weights for policy 1, policy_version 1636990 (0.0008) [2023-12-28 06:59:54,867][106225] Updated weights for policy 1, policy_version 1637000 (0.0009) [2023-12-28 06:59:54,917][106225] Updated weights for policy 1, policy_version 1637010 (0.0008) [2023-12-28 06:59:54,971][106226] Updated weights for policy 0, policy_version 1633309 (0.0007) [2023-12-28 06:59:55,038][106226] Updated weights for policy 0, policy_version 1633319 (0.0009) [2023-12-28 06:59:55,099][106226] Updated weights for policy 0, policy_version 1633329 (0.0010) [2023-12-28 06:59:55,552][106225] Updated weights for policy 1, policy_version 1637020 (0.0006) [2023-12-28 06:59:55,601][106225] Updated weights for policy 1, policy_version 1637030 (0.0005) [2023-12-28 06:59:55,657][106225] Updated weights for policy 1, policy_version 1637040 (0.0005) [2023-12-28 06:59:55,686][106226] Updated weights for policy 0, policy_version 1633339 (0.0010) [2023-12-28 06:59:55,739][106226] Updated weights for policy 0, policy_version 1633349 (0.0010) [2023-12-28 06:59:55,789][106226] Updated weights for policy 0, policy_version 1633359 (0.0010) [2023-12-28 06:59:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 837353472. Throughput: 0: 9756.6, 1: 10001.2. Samples: 837319088. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 06:59:56,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-4.710')] [2023-12-28 06:59:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001637048_419135488.pth... [2023-12-28 06:59:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001633368_418217984.pth... [2023-12-28 06:59:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001635864_418832384.pth [2023-12-28 06:59:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001632216_417923072.pth [2023-12-28 06:59:56,239][106225] Updated weights for policy 1, policy_version 1637050 (0.0006) [2023-12-28 06:59:56,299][106225] Updated weights for policy 1, policy_version 1637060 (0.0007) [2023-12-28 06:59:56,354][106225] Updated weights for policy 1, policy_version 1637070 (0.0008) [2023-12-28 06:59:56,411][106225] Updated weights for policy 1, policy_version 1637080 (0.0007) [2023-12-28 06:59:56,496][106226] Updated weights for policy 0, policy_version 1633369 (0.0008) [2023-12-28 06:59:56,545][106226] Updated weights for policy 0, policy_version 1633379 (0.0010) [2023-12-28 06:59:56,604][106226] Updated weights for policy 0, policy_version 1633389 (0.0010) [2023-12-28 06:59:56,651][106226] Updated weights for policy 0, policy_version 1633399 (0.0010) [2023-12-28 06:59:56,958][106225] Updated weights for policy 1, policy_version 1637090 (0.0010) [2023-12-28 06:59:57,004][106225] Updated weights for policy 1, policy_version 1637100 (0.0006) [2023-12-28 06:59:57,063][106225] Updated weights for policy 1, policy_version 1637110 (0.0005) [2023-12-28 06:59:57,364][106226] Updated weights for policy 0, policy_version 1633409 (0.0011) [2023-12-28 06:59:57,431][106226] Updated weights for policy 0, policy_version 1633419 (0.0010) [2023-12-28 06:59:57,497][106226] Updated weights for policy 0, policy_version 1633429 (0.0011) [2023-12-28 06:59:57,690][106225] Updated weights for policy 1, policy_version 1637120 (0.0008) [2023-12-28 06:59:57,736][106225] Updated weights for policy 1, policy_version 1637130 (0.0010) [2023-12-28 06:59:57,794][106225] Updated weights for policy 1, policy_version 1637140 (0.0009) [2023-12-28 06:59:58,180][106226] Updated weights for policy 0, policy_version 1633439 (0.0010) [2023-12-28 06:59:58,241][106226] Updated weights for policy 0, policy_version 1633449 (0.0009) [2023-12-28 06:59:58,301][106226] Updated weights for policy 0, policy_version 1633459 (0.0008) [2023-12-28 06:59:58,543][106225] Updated weights for policy 1, policy_version 1637150 (0.0008) [2023-12-28 06:59:58,611][106225] Updated weights for policy 1, policy_version 1637160 (0.0009) [2023-12-28 06:59:58,673][106225] Updated weights for policy 1, policy_version 1637170 (0.0009) [2023-12-28 06:59:59,124][106226] Updated weights for policy 0, policy_version 1633469 (0.0008) [2023-12-28 06:59:59,190][106226] Updated weights for policy 0, policy_version 1633479 (0.0011) [2023-12-28 06:59:59,265][106226] Updated weights for policy 0, policy_version 1633489 (0.0012) [2023-12-28 06:59:59,539][106225] Updated weights for policy 1, policy_version 1637180 (0.0007) [2023-12-28 06:59:59,594][106225] Updated weights for policy 1, policy_version 1637190 (0.0006) [2023-12-28 06:59:59,656][106225] Updated weights for policy 1, policy_version 1637200 (0.0007) [2023-12-28 06:59:59,975][106226] Updated weights for policy 0, policy_version 1633499 (0.0010) [2023-12-28 07:00:00,038][106226] Updated weights for policy 0, policy_version 1633509 (0.0008) [2023-12-28 07:00:00,096][106226] Updated weights for policy 0, policy_version 1633519 (0.0008) [2023-12-28 07:00:00,380][106225] Updated weights for policy 1, policy_version 1637210 (0.0008) [2023-12-28 07:00:00,434][106225] Updated weights for policy 1, policy_version 1637220 (0.0007) [2023-12-28 07:00:00,493][106225] Updated weights for policy 1, policy_version 1637230 (0.0006) [2023-12-28 07:00:00,549][106225] Updated weights for policy 1, policy_version 1637240 (0.0005) [2023-12-28 07:00:00,805][106226] Updated weights for policy 0, policy_version 1633529 (0.0010) [2023-12-28 07:00:00,859][106226] Updated weights for policy 0, policy_version 1633539 (0.0010) [2023-12-28 07:00:00,911][106226] Updated weights for policy 0, policy_version 1633549 (0.0008) [2023-12-28 07:00:00,956][106226] Updated weights for policy 0, policy_version 1633559 (0.0007) [2023-12-28 07:00:01,163][106225] Updated weights for policy 1, policy_version 1637250 (0.0011) [2023-12-28 07:00:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 837451776. Throughput: 0: 9797.4, 1: 10080.9. Samples: 837441348. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 07:00:01,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.690')] [2023-12-28 07:00:01,216][106225] Updated weights for policy 1, policy_version 1637260 (0.0010) [2023-12-28 07:00:01,282][106225] Updated weights for policy 1, policy_version 1637270 (0.0010) [2023-12-28 07:00:01,779][106226] Updated weights for policy 0, policy_version 1633569 (0.0007) [2023-12-28 07:00:01,836][106226] Updated weights for policy 0, policy_version 1633579 (0.0006) [2023-12-28 07:00:01,901][106226] Updated weights for policy 0, policy_version 1633589 (0.0006) [2023-12-28 07:00:02,058][106225] Updated weights for policy 1, policy_version 1637280 (0.0010) [2023-12-28 07:00:02,122][106225] Updated weights for policy 1, policy_version 1637290 (0.0010) [2023-12-28 07:00:02,180][106225] Updated weights for policy 1, policy_version 1637300 (0.0011) [2023-12-28 07:00:02,491][106226] Updated weights for policy 0, policy_version 1633599 (0.0007) [2023-12-28 07:00:02,553][106226] Updated weights for policy 0, policy_version 1633609 (0.0007) [2023-12-28 07:00:02,613][106226] Updated weights for policy 0, policy_version 1633619 (0.0008) [2023-12-28 07:00:02,942][106225] Updated weights for policy 1, policy_version 1637310 (0.0010) [2023-12-28 07:00:02,989][106225] Updated weights for policy 1, policy_version 1637320 (0.0006) [2023-12-28 07:00:03,045][106225] Updated weights for policy 1, policy_version 1637330 (0.0005) [2023-12-28 07:00:03,305][106226] Updated weights for policy 0, policy_version 1633629 (0.0008) [2023-12-28 07:00:03,359][106226] Updated weights for policy 0, policy_version 1633639 (0.0007) [2023-12-28 07:00:03,416][106226] Updated weights for policy 0, policy_version 1633649 (0.0008) [2023-12-28 07:00:03,635][106225] Updated weights for policy 1, policy_version 1637340 (0.0007) [2023-12-28 07:00:03,686][106225] Updated weights for policy 1, policy_version 1637350 (0.0005) [2023-12-28 07:00:03,736][106225] Updated weights for policy 1, policy_version 1637360 (0.0005) [2023-12-28 07:00:04,123][106226] Updated weights for policy 0, policy_version 1633659 (0.0007) [2023-12-28 07:00:04,179][106226] Updated weights for policy 0, policy_version 1633669 (0.0007) [2023-12-28 07:00:04,239][106226] Updated weights for policy 0, policy_version 1633679 (0.0007) [2023-12-28 07:00:04,448][106225] Updated weights for policy 1, policy_version 1637370 (0.0007) [2023-12-28 07:00:04,512][106225] Updated weights for policy 1, policy_version 1637380 (0.0009) [2023-12-28 07:00:04,576][106225] Updated weights for policy 1, policy_version 1637390 (0.0008) [2023-12-28 07:00:04,621][106225] Updated weights for policy 1, policy_version 1637400 (0.0008) [2023-12-28 07:00:04,995][106226] Updated weights for policy 0, policy_version 1633689 (0.0010) [2023-12-28 07:00:05,065][106226] Updated weights for policy 0, policy_version 1633699 (0.0008) [2023-12-28 07:00:05,129][106226] Updated weights for policy 0, policy_version 1633709 (0.0009) [2023-12-28 07:00:05,187][106226] Updated weights for policy 0, policy_version 1633719 (0.0008) [2023-12-28 07:00:05,268][106225] Updated weights for policy 1, policy_version 1637410 (0.0006) [2023-12-28 07:00:05,332][106225] Updated weights for policy 1, policy_version 1637420 (0.0008) [2023-12-28 07:00:05,391][106225] Updated weights for policy 1, policy_version 1637430 (0.0008) [2023-12-28 07:00:05,894][106226] Updated weights for policy 0, policy_version 1633729 (0.0008) [2023-12-28 07:00:05,952][106226] Updated weights for policy 0, policy_version 1633739 (0.0009) [2023-12-28 07:00:06,009][106226] Updated weights for policy 0, policy_version 1633749 (0.0007) [2023-12-28 07:00:06,079][106225] Updated weights for policy 1, policy_version 1637440 (0.0009) [2023-12-28 07:00:06,161][106225] Updated weights for policy 1, policy_version 1637450 (0.0011) [2023-12-28 07:00:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 837550080. Throughput: 0: 9757.2, 1: 10116.6. Samples: 837560364. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-28 07:00:06,175][105115] Avg episode reward: [(0, '-4.832'), (1, '-4.715')] [2023-12-28 07:00:06,227][106225] Updated weights for policy 1, policy_version 1637460 (0.0010) [2023-12-28 07:00:06,770][106226] Updated weights for policy 0, policy_version 1633759 (0.0008) [2023-12-28 07:00:06,817][106226] Updated weights for policy 0, policy_version 1633769 (0.0008) [2023-12-28 07:00:06,873][106226] Updated weights for policy 0, policy_version 1633779 (0.0005) [2023-12-28 07:00:06,955][106225] Updated weights for policy 1, policy_version 1637470 (0.0008) [2023-12-28 07:00:07,028][106225] Updated weights for policy 1, policy_version 1637480 (0.0007) [2023-12-28 07:00:07,087][106225] Updated weights for policy 1, policy_version 1637490 (0.0010) [2023-12-28 07:00:07,570][106226] Updated weights for policy 0, policy_version 1633789 (0.0006) [2023-12-28 07:00:07,636][106226] Updated weights for policy 0, policy_version 1633799 (0.0008) [2023-12-28 07:00:07,697][106226] Updated weights for policy 0, policy_version 1633809 (0.0008) [2023-12-28 07:00:07,801][106225] Updated weights for policy 1, policy_version 1637500 (0.0010) [2023-12-28 07:00:07,859][106225] Updated weights for policy 1, policy_version 1637510 (0.0010) [2023-12-28 07:00:07,916][106225] Updated weights for policy 1, policy_version 1637520 (0.0010) [2023-12-28 07:00:08,326][106226] Updated weights for policy 0, policy_version 1633819 (0.0007) [2023-12-28 07:00:08,400][106226] Updated weights for policy 0, policy_version 1633829 (0.0008) [2023-12-28 07:00:08,462][106226] Updated weights for policy 0, policy_version 1633839 (0.0008) [2023-12-28 07:00:08,622][106225] Updated weights for policy 1, policy_version 1637530 (0.0010) [2023-12-28 07:00:08,686][106225] Updated weights for policy 1, policy_version 1637540 (0.0010) [2023-12-28 07:00:08,748][106225] Updated weights for policy 1, policy_version 1637550 (0.0008) [2023-12-28 07:00:08,810][106225] Updated weights for policy 1, policy_version 1637560 (0.0007) [2023-12-28 07:00:09,141][106226] Updated weights for policy 0, policy_version 1633849 (0.0008) [2023-12-28 07:00:09,195][106226] Updated weights for policy 0, policy_version 1633859 (0.0009) [2023-12-28 07:00:09,259][106226] Updated weights for policy 0, policy_version 1633869 (0.0010) [2023-12-28 07:00:09,323][106226] Updated weights for policy 0, policy_version 1633879 (0.0007) [2023-12-28 07:00:09,505][106225] Updated weights for policy 1, policy_version 1637570 (0.0005) [2023-12-28 07:00:09,575][106225] Updated weights for policy 1, policy_version 1637580 (0.0006) [2023-12-28 07:00:09,642][106225] Updated weights for policy 1, policy_version 1637590 (0.0008) [2023-12-28 07:00:10,065][106226] Updated weights for policy 0, policy_version 1633889 (0.0008) [2023-12-28 07:00:10,126][106226] Updated weights for policy 0, policy_version 1633899 (0.0008) [2023-12-28 07:00:10,196][106226] Updated weights for policy 0, policy_version 1633909 (0.0010) [2023-12-28 07:00:10,323][106225] Updated weights for policy 1, policy_version 1637600 (0.0008) [2023-12-28 07:00:10,390][106225] Updated weights for policy 1, policy_version 1637610 (0.0009) [2023-12-28 07:00:10,466][106225] Updated weights for policy 1, policy_version 1637620 (0.0008) [2023-12-28 07:00:10,860][106226] Updated weights for policy 0, policy_version 1633919 (0.0008) [2023-12-28 07:00:10,917][106226] Updated weights for policy 0, policy_version 1633929 (0.0009) [2023-12-28 07:00:10,982][106226] Updated weights for policy 0, policy_version 1633939 (0.0009) [2023-12-28 07:00:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 837648384. Throughput: 0: 9778.6, 1: 10124.3. Samples: 837618800. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:11,175][105115] Avg episode reward: [(0, '-4.224'), (1, '-4.565')] [2023-12-28 07:00:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001633944_418365440.pth... [2023-12-28 07:00:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001637624_419282944.pth... [2023-12-28 07:00:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001632792_418070528.pth [2023-12-28 07:00:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001636472_418988032.pth [2023-12-28 07:00:11,239][106225] Updated weights for policy 1, policy_version 1637630 (0.0008) [2023-12-28 07:00:11,307][106225] Updated weights for policy 1, policy_version 1637640 (0.0007) [2023-12-28 07:00:11,373][106225] Updated weights for policy 1, policy_version 1637650 (0.0008) [2023-12-28 07:00:11,838][106226] Updated weights for policy 0, policy_version 1633949 (0.0007) [2023-12-28 07:00:11,907][106226] Updated weights for policy 0, policy_version 1633959 (0.0007) [2023-12-28 07:00:11,960][106226] Updated weights for policy 0, policy_version 1633969 (0.0006) [2023-12-28 07:00:12,064][106225] Updated weights for policy 1, policy_version 1637660 (0.0008) [2023-12-28 07:00:12,119][106225] Updated weights for policy 1, policy_version 1637670 (0.0008) [2023-12-28 07:00:12,178][106225] Updated weights for policy 1, policy_version 1637680 (0.0009) [2023-12-28 07:00:12,701][106226] Updated weights for policy 0, policy_version 1633979 (0.0009) [2023-12-28 07:00:12,757][106226] Updated weights for policy 0, policy_version 1633989 (0.0009) [2023-12-28 07:00:12,823][106226] Updated weights for policy 0, policy_version 1633999 (0.0010) [2023-12-28 07:00:12,894][106225] Updated weights for policy 1, policy_version 1637690 (0.0008) [2023-12-28 07:00:12,955][106225] Updated weights for policy 1, policy_version 1637700 (0.0008) [2023-12-28 07:00:13,019][106225] Updated weights for policy 1, policy_version 1637710 (0.0009) [2023-12-28 07:00:13,081][106225] Updated weights for policy 1, policy_version 1637720 (0.0009) [2023-12-28 07:00:13,594][106226] Updated weights for policy 0, policy_version 1634009 (0.0008) [2023-12-28 07:00:13,653][106226] Updated weights for policy 0, policy_version 1634019 (0.0008) [2023-12-28 07:00:13,707][106226] Updated weights for policy 0, policy_version 1634029 (0.0008) [2023-12-28 07:00:13,758][106226] Updated weights for policy 0, policy_version 1634039 (0.0006) [2023-12-28 07:00:13,767][106225] Updated weights for policy 1, policy_version 1637730 (0.0010) [2023-12-28 07:00:13,830][106225] Updated weights for policy 1, policy_version 1637740 (0.0010) [2023-12-28 07:00:13,892][106225] Updated weights for policy 1, policy_version 1637750 (0.0006) [2023-12-28 07:00:14,529][106226] Updated weights for policy 0, policy_version 1634049 (0.0006) [2023-12-28 07:00:14,548][106225] Updated weights for policy 1, policy_version 1637760 (0.0009) [2023-12-28 07:00:14,585][106226] Updated weights for policy 0, policy_version 1634059 (0.0009) [2023-12-28 07:00:14,603][106225] Updated weights for policy 1, policy_version 1637770 (0.0010) [2023-12-28 07:00:14,643][106226] Updated weights for policy 0, policy_version 1634069 (0.0010) [2023-12-28 07:00:14,655][106225] Updated weights for policy 1, policy_version 1637780 (0.0010) [2023-12-28 07:00:15,321][106226] Updated weights for policy 0, policy_version 1634079 (0.0010) [2023-12-28 07:00:15,374][106226] Updated weights for policy 0, policy_version 1634089 (0.0009) [2023-12-28 07:00:15,422][106225] Updated weights for policy 1, policy_version 1637790 (0.0009) [2023-12-28 07:00:15,433][106226] Updated weights for policy 0, policy_version 1634099 (0.0007) [2023-12-28 07:00:15,481][106225] Updated weights for policy 1, policy_version 1637800 (0.0007) [2023-12-28 07:00:15,534][106225] Updated weights for policy 1, policy_version 1637810 (0.0009) [2023-12-28 07:00:16,117][106226] Updated weights for policy 0, policy_version 1634109 (0.0008) [2023-12-28 07:00:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 837738496. Throughput: 0: 9691.0, 1: 10008.6. Samples: 837732732. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:16,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.717')] [2023-12-28 07:00:16,181][106226] Updated weights for policy 0, policy_version 1634119 (0.0011) [2023-12-28 07:00:16,240][106226] Updated weights for policy 0, policy_version 1634129 (0.0010) [2023-12-28 07:00:16,286][106225] Updated weights for policy 1, policy_version 1637820 (0.0008) [2023-12-28 07:00:16,361][106225] Updated weights for policy 1, policy_version 1637830 (0.0007) [2023-12-28 07:00:16,420][106225] Updated weights for policy 1, policy_version 1637840 (0.0008) [2023-12-28 07:00:16,876][106226] Updated weights for policy 0, policy_version 1634139 (0.0007) [2023-12-28 07:00:16,937][106226] Updated weights for policy 0, policy_version 1634149 (0.0011) [2023-12-28 07:00:17,006][106226] Updated weights for policy 0, policy_version 1634159 (0.0011) [2023-12-28 07:00:17,066][106225] Updated weights for policy 1, policy_version 1637850 (0.0008) [2023-12-28 07:00:17,126][106225] Updated weights for policy 1, policy_version 1637860 (0.0005) [2023-12-28 07:00:17,176][106225] Updated weights for policy 1, policy_version 1637870 (0.0007) [2023-12-28 07:00:17,219][106225] Updated weights for policy 1, policy_version 1637880 (0.0008) [2023-12-28 07:00:17,721][106226] Updated weights for policy 0, policy_version 1634169 (0.0011) [2023-12-28 07:00:17,772][106226] Updated weights for policy 0, policy_version 1634179 (0.0010) [2023-12-28 07:00:17,832][106226] Updated weights for policy 0, policy_version 1634189 (0.0009) [2023-12-28 07:00:17,879][106226] Updated weights for policy 0, policy_version 1634199 (0.0010) [2023-12-28 07:00:17,966][106225] Updated weights for policy 1, policy_version 1637890 (0.0006) [2023-12-28 07:00:18,033][106225] Updated weights for policy 1, policy_version 1637900 (0.0006) [2023-12-28 07:00:18,093][106225] Updated weights for policy 1, policy_version 1637910 (0.0008) [2023-12-28 07:00:18,638][106226] Updated weights for policy 0, policy_version 1634209 (0.0011) [2023-12-28 07:00:18,703][106226] Updated weights for policy 0, policy_version 1634219 (0.0011) [2023-12-28 07:00:18,768][106226] Updated weights for policy 0, policy_version 1634229 (0.0011) [2023-12-28 07:00:18,825][106225] Updated weights for policy 1, policy_version 1637920 (0.0008) [2023-12-28 07:00:18,887][106225] Updated weights for policy 1, policy_version 1637930 (0.0008) [2023-12-28 07:00:18,945][106225] Updated weights for policy 1, policy_version 1637940 (0.0007) [2023-12-28 07:00:19,539][106226] Updated weights for policy 0, policy_version 1634239 (0.0011) [2023-12-28 07:00:19,603][106226] Updated weights for policy 0, policy_version 1634249 (0.0009) [2023-12-28 07:00:19,668][106226] Updated weights for policy 0, policy_version 1634259 (0.0010) [2023-12-28 07:00:19,735][106225] Updated weights for policy 1, policy_version 1637950 (0.0008) [2023-12-28 07:00:19,800][106225] Updated weights for policy 1, policy_version 1637960 (0.0007) [2023-12-28 07:00:19,870][106225] Updated weights for policy 1, policy_version 1637970 (0.0009) [2023-12-28 07:00:20,424][106226] Updated weights for policy 0, policy_version 1634269 (0.0011) [2023-12-28 07:00:20,488][106226] Updated weights for policy 0, policy_version 1634279 (0.0011) [2023-12-28 07:00:20,554][106226] Updated weights for policy 0, policy_version 1634289 (0.0011) [2023-12-28 07:00:20,678][106225] Updated weights for policy 1, policy_version 1637980 (0.0009) [2023-12-28 07:00:20,744][106225] Updated weights for policy 1, policy_version 1637990 (0.0009) [2023-12-28 07:00:20,801][106225] Updated weights for policy 1, policy_version 1638000 (0.0008) [2023-12-28 07:00:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 837836800. Throughput: 0: 9656.2, 1: 9904.5. Samples: 837845904. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:21,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.789')] [2023-12-28 07:00:21,388][106226] Updated weights for policy 0, policy_version 1634299 (0.0010) [2023-12-28 07:00:21,456][106226] Updated weights for policy 0, policy_version 1634309 (0.0009) [2023-12-28 07:00:21,520][106226] Updated weights for policy 0, policy_version 1634319 (0.0009) [2023-12-28 07:00:21,592][106225] Updated weights for policy 1, policy_version 1638010 (0.0009) [2023-12-28 07:00:21,665][106225] Updated weights for policy 1, policy_version 1638020 (0.0009) [2023-12-28 07:00:21,733][106225] Updated weights for policy 1, policy_version 1638030 (0.0008) [2023-12-28 07:00:21,801][106225] Updated weights for policy 1, policy_version 1638040 (0.0008) [2023-12-28 07:00:22,422][106226] Updated weights for policy 0, policy_version 1634329 (0.0009) [2023-12-28 07:00:22,482][106226] Updated weights for policy 0, policy_version 1634339 (0.0009) [2023-12-28 07:00:22,522][106225] Updated weights for policy 1, policy_version 1638050 (0.0010) [2023-12-28 07:00:22,545][106226] Updated weights for policy 0, policy_version 1634349 (0.0007) [2023-12-28 07:00:22,583][106225] Updated weights for policy 1, policy_version 1638060 (0.0009) [2023-12-28 07:00:22,603][106226] Updated weights for policy 0, policy_version 1634359 (0.0007) [2023-12-28 07:00:22,646][106225] Updated weights for policy 1, policy_version 1638070 (0.0008) [2023-12-28 07:00:23,393][106226] Updated weights for policy 0, policy_version 1634369 (0.0008) [2023-12-28 07:00:23,415][106225] Updated weights for policy 1, policy_version 1638080 (0.0006) [2023-12-28 07:00:23,455][106226] Updated weights for policy 0, policy_version 1634379 (0.0008) [2023-12-28 07:00:23,468][106225] Updated weights for policy 1, policy_version 1638090 (0.0005) [2023-12-28 07:00:23,504][106226] Updated weights for policy 0, policy_version 1634389 (0.0008) [2023-12-28 07:00:23,519][106225] Updated weights for policy 1, policy_version 1638100 (0.0005) [2023-12-28 07:00:24,066][106225] Updated weights for policy 1, policy_version 1638110 (0.0006) [2023-12-28 07:00:24,115][106225] Updated weights for policy 1, policy_version 1638120 (0.0007) [2023-12-28 07:00:24,169][106225] Updated weights for policy 1, policy_version 1638130 (0.0008) [2023-12-28 07:00:24,232][106226] Updated weights for policy 0, policy_version 1634399 (0.0009) [2023-12-28 07:00:24,291][106226] Updated weights for policy 0, policy_version 1634409 (0.0008) [2023-12-28 07:00:24,355][106226] Updated weights for policy 0, policy_version 1634419 (0.0009) [2023-12-28 07:00:24,950][106225] Updated weights for policy 1, policy_version 1638140 (0.0007) [2023-12-28 07:00:24,974][106226] Updated weights for policy 0, policy_version 1634429 (0.0009) [2023-12-28 07:00:25,003][106225] Updated weights for policy 1, policy_version 1638150 (0.0006) [2023-12-28 07:00:25,036][106226] Updated weights for policy 0, policy_version 1634439 (0.0006) [2023-12-28 07:00:25,061][106225] Updated weights for policy 1, policy_version 1638160 (0.0006) [2023-12-28 07:00:25,094][106226] Updated weights for policy 0, policy_version 1634449 (0.0007) [2023-12-28 07:00:25,689][106225] Updated weights for policy 1, policy_version 1638170 (0.0006) [2023-12-28 07:00:25,745][106225] Updated weights for policy 1, policy_version 1638180 (0.0008) [2023-12-28 07:00:25,808][106225] Updated weights for policy 1, policy_version 1638190 (0.0006) [2023-12-28 07:00:25,829][106226] Updated weights for policy 0, policy_version 1634459 (0.0009) [2023-12-28 07:00:25,868][106225] Updated weights for policy 1, policy_version 1638200 (0.0005) [2023-12-28 07:00:25,896][106226] Updated weights for policy 0, policy_version 1634469 (0.0011) [2023-12-28 07:00:25,963][106226] Updated weights for policy 0, policy_version 1634479 (0.0006) [2023-12-28 07:00:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 837935104. Throughput: 0: 9615.9, 1: 9846.9. Samples: 837900780. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:26,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.930')] [2023-12-28 07:00:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001638200_419430400.pth... [2023-12-28 07:00:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001634488_418504704.pth... [2023-12-28 07:00:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001633368_418217984.pth [2023-12-28 07:00:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001637048_419135488.pth [2023-12-28 07:00:26,446][106225] Updated weights for policy 1, policy_version 1638210 (0.0008) [2023-12-28 07:00:26,496][106225] Updated weights for policy 1, policy_version 1638220 (0.0008) [2023-12-28 07:00:26,552][106225] Updated weights for policy 1, policy_version 1638230 (0.0008) [2023-12-28 07:00:26,593][106226] Updated weights for policy 0, policy_version 1634489 (0.0005) [2023-12-28 07:00:26,652][106226] Updated weights for policy 0, policy_version 1634499 (0.0005) [2023-12-28 07:00:26,708][106226] Updated weights for policy 0, policy_version 1634509 (0.0005) [2023-12-28 07:00:26,766][106226] Updated weights for policy 0, policy_version 1634519 (0.0005) [2023-12-28 07:00:27,207][106225] Updated weights for policy 1, policy_version 1638240 (0.0006) [2023-12-28 07:00:27,256][106225] Updated weights for policy 1, policy_version 1638250 (0.0005) [2023-12-28 07:00:27,310][106225] Updated weights for policy 1, policy_version 1638260 (0.0006) [2023-12-28 07:00:27,317][106226] Updated weights for policy 0, policy_version 1634529 (0.0006) [2023-12-28 07:00:27,377][106226] Updated weights for policy 0, policy_version 1634539 (0.0006) [2023-12-28 07:00:27,435][106226] Updated weights for policy 0, policy_version 1634549 (0.0006) [2023-12-28 07:00:27,909][106225] Updated weights for policy 1, policy_version 1638270 (0.0009) [2023-12-28 07:00:27,969][106225] Updated weights for policy 1, policy_version 1638280 (0.0007) [2023-12-28 07:00:28,024][106225] Updated weights for policy 1, policy_version 1638290 (0.0011) [2023-12-28 07:00:28,062][106226] Updated weights for policy 0, policy_version 1634559 (0.0005) [2023-12-28 07:00:28,117][106226] Updated weights for policy 0, policy_version 1634569 (0.0005) [2023-12-28 07:00:28,174][106226] Updated weights for policy 0, policy_version 1634579 (0.0006) [2023-12-28 07:00:28,686][106225] Updated weights for policy 1, policy_version 1638300 (0.0009) [2023-12-28 07:00:28,739][106225] Updated weights for policy 1, policy_version 1638310 (0.0010) [2023-12-28 07:00:28,750][106226] Updated weights for policy 0, policy_version 1634589 (0.0008) [2023-12-28 07:00:28,799][106225] Updated weights for policy 1, policy_version 1638320 (0.0010) [2023-12-28 07:00:28,810][106226] Updated weights for policy 0, policy_version 1634599 (0.0007) [2023-12-28 07:00:28,873][106226] Updated weights for policy 0, policy_version 1634609 (0.0005) [2023-12-28 07:00:29,506][106225] Updated weights for policy 1, policy_version 1638330 (0.0009) [2023-12-28 07:00:29,563][106226] Updated weights for policy 0, policy_version 1634619 (0.0008) [2023-12-28 07:00:29,564][106225] Updated weights for policy 1, policy_version 1638340 (0.0006) [2023-12-28 07:00:29,614][106225] Updated weights for policy 1, policy_version 1638350 (0.0005) [2023-12-28 07:00:29,624][106226] Updated weights for policy 0, policy_version 1634629 (0.0010) [2023-12-28 07:00:29,666][106225] Updated weights for policy 1, policy_version 1638360 (0.0005) [2023-12-28 07:00:29,689][106226] Updated weights for policy 0, policy_version 1634639 (0.0011) [2023-12-28 07:00:30,322][106226] Updated weights for policy 0, policy_version 1634649 (0.0011) [2023-12-28 07:00:30,376][106225] Updated weights for policy 1, policy_version 1638370 (0.0008) [2023-12-28 07:00:30,385][106226] Updated weights for policy 0, policy_version 1634659 (0.0009) [2023-12-28 07:00:30,418][106225] Updated weights for policy 1, policy_version 1638380 (0.0007) [2023-12-28 07:00:30,451][106226] Updated weights for policy 0, policy_version 1634669 (0.0007) [2023-12-28 07:00:30,470][106225] Updated weights for policy 1, policy_version 1638390 (0.0005) [2023-12-28 07:00:30,508][106226] Updated weights for policy 0, policy_version 1634679 (0.0008) [2023-12-28 07:00:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 838033408. Throughput: 0: 9734.7, 1: 9973.1. Samples: 838027584. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:31,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.776')] [2023-12-28 07:00:31,230][106225] Updated weights for policy 1, policy_version 1638400 (0.0007) [2023-12-28 07:00:31,233][106226] Updated weights for policy 0, policy_version 1634689 (0.0006) [2023-12-28 07:00:31,291][106225] Updated weights for policy 1, policy_version 1638410 (0.0008) [2023-12-28 07:00:31,302][106226] Updated weights for policy 0, policy_version 1634699 (0.0006) [2023-12-28 07:00:31,353][106225] Updated weights for policy 1, policy_version 1638420 (0.0007) [2023-12-28 07:00:31,375][106226] Updated weights for policy 0, policy_version 1634709 (0.0008) [2023-12-28 07:00:32,080][106226] Updated weights for policy 0, policy_version 1634719 (0.0008) [2023-12-28 07:00:32,105][106225] Updated weights for policy 1, policy_version 1638430 (0.0008) [2023-12-28 07:00:32,140][106226] Updated weights for policy 0, policy_version 1634729 (0.0009) [2023-12-28 07:00:32,169][106225] Updated weights for policy 1, policy_version 1638440 (0.0010) [2023-12-28 07:00:32,207][106226] Updated weights for policy 0, policy_version 1634739 (0.0006) [2023-12-28 07:00:32,234][106225] Updated weights for policy 1, policy_version 1638450 (0.0008) [2023-12-28 07:00:32,884][106226] Updated weights for policy 0, policy_version 1634749 (0.0006) [2023-12-28 07:00:32,945][106226] Updated weights for policy 0, policy_version 1634759 (0.0006) [2023-12-28 07:00:33,002][106225] Updated weights for policy 1, policy_version 1638460 (0.0009) [2023-12-28 07:00:33,004][106226] Updated weights for policy 0, policy_version 1634769 (0.0010) [2023-12-28 07:00:33,061][106225] Updated weights for policy 1, policy_version 1638470 (0.0006) [2023-12-28 07:00:33,111][106225] Updated weights for policy 1, policy_version 1638480 (0.0007) [2023-12-28 07:00:33,607][106226] Updated weights for policy 0, policy_version 1634779 (0.0009) [2023-12-28 07:00:33,651][106226] Updated weights for policy 0, policy_version 1634789 (0.0008) [2023-12-28 07:00:33,699][106226] Updated weights for policy 0, policy_version 1634799 (0.0009) [2023-12-28 07:00:33,779][106225] Updated weights for policy 1, policy_version 1638490 (0.0009) [2023-12-28 07:00:33,838][106225] Updated weights for policy 1, policy_version 1638500 (0.0009) [2023-12-28 07:00:33,898][106225] Updated weights for policy 1, policy_version 1638510 (0.0008) [2023-12-28 07:00:33,955][106225] Updated weights for policy 1, policy_version 1638520 (0.0007) [2023-12-28 07:00:34,422][106226] Updated weights for policy 0, policy_version 1634809 (0.0009) [2023-12-28 07:00:34,484][106226] Updated weights for policy 0, policy_version 1634819 (0.0008) [2023-12-28 07:00:34,551][106226] Updated weights for policy 0, policy_version 1634829 (0.0009) [2023-12-28 07:00:34,606][106225] Updated weights for policy 1, policy_version 1638530 (0.0006) [2023-12-28 07:00:34,608][106226] Updated weights for policy 0, policy_version 1634839 (0.0007) [2023-12-28 07:00:34,668][106225] Updated weights for policy 1, policy_version 1638540 (0.0008) [2023-12-28 07:00:34,731][106225] Updated weights for policy 1, policy_version 1638550 (0.0008) [2023-12-28 07:00:35,245][106226] Updated weights for policy 0, policy_version 1634849 (0.0006) [2023-12-28 07:00:35,291][106226] Updated weights for policy 0, policy_version 1634859 (0.0005) [2023-12-28 07:00:35,351][106226] Updated weights for policy 0, policy_version 1634869 (0.0005) [2023-12-28 07:00:35,370][106225] Updated weights for policy 1, policy_version 1638560 (0.0006) [2023-12-28 07:00:35,434][106225] Updated weights for policy 1, policy_version 1638570 (0.0008) [2023-12-28 07:00:35,490][106225] Updated weights for policy 1, policy_version 1638580 (0.0005) [2023-12-28 07:00:35,907][106226] Updated weights for policy 0, policy_version 1634879 (0.0009) [2023-12-28 07:00:35,958][106226] Updated weights for policy 0, policy_version 1634889 (0.0010) [2023-12-28 07:00:35,994][106225] Updated weights for policy 1, policy_version 1638590 (0.0006) [2023-12-28 07:00:36,015][106226] Updated weights for policy 0, policy_version 1634899 (0.0010) [2023-12-28 07:00:36,052][106225] Updated weights for policy 1, policy_version 1638600 (0.0007) [2023-12-28 07:00:36,112][106225] Updated weights for policy 1, policy_version 1638610 (0.0008) [2023-12-28 07:00:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 838148096. Throughput: 0: 9837.7, 1: 9952.8. Samples: 838150200. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:36,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.873')] [2023-12-28 07:00:36,784][106225] Updated weights for policy 1, policy_version 1638620 (0.0008) [2023-12-28 07:00:36,788][106226] Updated weights for policy 0, policy_version 1634909 (0.0009) [2023-12-28 07:00:36,832][106225] Updated weights for policy 1, policy_version 1638630 (0.0008) [2023-12-28 07:00:36,843][106226] Updated weights for policy 0, policy_version 1634919 (0.0005) [2023-12-28 07:00:36,886][106225] Updated weights for policy 1, policy_version 1638640 (0.0007) [2023-12-28 07:00:36,892][106226] Updated weights for policy 0, policy_version 1634929 (0.0007) [2023-12-28 07:00:37,593][106225] Updated weights for policy 1, policy_version 1638650 (0.0008) [2023-12-28 07:00:37,660][106226] Updated weights for policy 0, policy_version 1634939 (0.0007) [2023-12-28 07:00:37,661][106225] Updated weights for policy 1, policy_version 1638660 (0.0007) [2023-12-28 07:00:37,722][106225] Updated weights for policy 1, policy_version 1638670 (0.0007) [2023-12-28 07:00:37,723][106226] Updated weights for policy 0, policy_version 1634949 (0.0011) [2023-12-28 07:00:37,781][106225] Updated weights for policy 1, policy_version 1638680 (0.0008) [2023-12-28 07:00:37,806][106226] Updated weights for policy 0, policy_version 1634959 (0.0010) [2023-12-28 07:00:38,407][106226] Updated weights for policy 0, policy_version 1634969 (0.0008) [2023-12-28 07:00:38,468][106226] Updated weights for policy 0, policy_version 1634979 (0.0011) [2023-12-28 07:00:38,530][106226] Updated weights for policy 0, policy_version 1634989 (0.0011) [2023-12-28 07:00:38,556][106225] Updated weights for policy 1, policy_version 1638690 (0.0008) [2023-12-28 07:00:38,584][106226] Updated weights for policy 0, policy_version 1634999 (0.0010) [2023-12-28 07:00:38,614][106225] Updated weights for policy 1, policy_version 1638700 (0.0005) [2023-12-28 07:00:38,672][106225] Updated weights for policy 1, policy_version 1638710 (0.0006) [2023-12-28 07:00:39,318][106226] Updated weights for policy 0, policy_version 1635009 (0.0008) [2023-12-28 07:00:39,370][106225] Updated weights for policy 1, policy_version 1638720 (0.0008) [2023-12-28 07:00:39,391][106226] Updated weights for policy 0, policy_version 1635019 (0.0011) [2023-12-28 07:00:39,446][106225] Updated weights for policy 1, policy_version 1638730 (0.0008) [2023-12-28 07:00:39,462][106226] Updated weights for policy 0, policy_version 1635029 (0.0008) [2023-12-28 07:00:39,502][106225] Updated weights for policy 1, policy_version 1638740 (0.0009) [2023-12-28 07:00:40,184][106226] Updated weights for policy 0, policy_version 1635039 (0.0010) [2023-12-28 07:00:40,242][106226] Updated weights for policy 0, policy_version 1635049 (0.0011) [2023-12-28 07:00:40,263][106225] Updated weights for policy 1, policy_version 1638750 (0.0007) [2023-12-28 07:00:40,303][106226] Updated weights for policy 0, policy_version 1635059 (0.0011) [2023-12-28 07:00:40,325][106225] Updated weights for policy 1, policy_version 1638760 (0.0006) [2023-12-28 07:00:40,386][106225] Updated weights for policy 1, policy_version 1638770 (0.0008) [2023-12-28 07:00:40,930][106226] Updated weights for policy 0, policy_version 1635069 (0.0008) [2023-12-28 07:00:40,975][106225] Updated weights for policy 1, policy_version 1638780 (0.0007) [2023-12-28 07:00:40,995][106226] Updated weights for policy 0, policy_version 1635079 (0.0006) [2023-12-28 07:00:41,038][106225] Updated weights for policy 1, policy_version 1638790 (0.0007) [2023-12-28 07:00:41,068][106226] Updated weights for policy 0, policy_version 1635090 (0.0007) [2023-12-28 07:00:41,106][106225] Updated weights for policy 1, policy_version 1638800 (0.0006) [2023-12-28 07:00:41,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 838246400. Throughput: 0: 9832.1, 1: 9958.3. Samples: 838209656. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:41,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.798')] [2023-12-28 07:00:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001635096_418660352.pth... [2023-12-28 07:00:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001638808_419586048.pth... [2023-12-28 07:00:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001633944_418365440.pth [2023-12-28 07:00:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001637624_419282944.pth [2023-12-28 07:00:41,834][106226] Updated weights for policy 0, policy_version 1635100 (0.0008) [2023-12-28 07:00:41,852][106225] Updated weights for policy 1, policy_version 1638810 (0.0008) [2023-12-28 07:00:41,918][106225] Updated weights for policy 1, policy_version 1638820 (0.0008) [2023-12-28 07:00:41,920][106226] Updated weights for policy 0, policy_version 1635110 (0.0011) [2023-12-28 07:00:41,978][106225] Updated weights for policy 1, policy_version 1638830 (0.0008) [2023-12-28 07:00:41,982][106226] Updated weights for policy 0, policy_version 1635120 (0.0011) [2023-12-28 07:00:42,038][106225] Updated weights for policy 1, policy_version 1638840 (0.0008) [2023-12-28 07:00:42,680][106226] Updated weights for policy 0, policy_version 1635130 (0.0010) [2023-12-28 07:00:42,736][106226] Updated weights for policy 0, policy_version 1635140 (0.0005) [2023-12-28 07:00:42,775][106225] Updated weights for policy 1, policy_version 1638850 (0.0008) [2023-12-28 07:00:42,792][106226] Updated weights for policy 0, policy_version 1635150 (0.0007) [2023-12-28 07:00:42,832][106225] Updated weights for policy 1, policy_version 1638860 (0.0005) [2023-12-28 07:00:42,856][106226] Updated weights for policy 0, policy_version 1635160 (0.0009) [2023-12-28 07:00:42,881][106225] Updated weights for policy 1, policy_version 1638870 (0.0007) [2023-12-28 07:00:43,446][106226] Updated weights for policy 0, policy_version 1635170 (0.0009) [2023-12-28 07:00:43,513][106226] Updated weights for policy 0, policy_version 1635180 (0.0008) [2023-12-28 07:00:43,560][106226] Updated weights for policy 0, policy_version 1635190 (0.0007) [2023-12-28 07:00:43,635][106225] Updated weights for policy 1, policy_version 1638880 (0.0008) [2023-12-28 07:00:43,692][106225] Updated weights for policy 1, policy_version 1638890 (0.0008) [2023-12-28 07:00:43,745][106225] Updated weights for policy 1, policy_version 1638900 (0.0007) [2023-12-28 07:00:44,276][106226] Updated weights for policy 0, policy_version 1635200 (0.0008) [2023-12-28 07:00:44,342][106226] Updated weights for policy 0, policy_version 1635210 (0.0008) [2023-12-28 07:00:44,400][106226] Updated weights for policy 0, policy_version 1635220 (0.0008) [2023-12-28 07:00:44,464][106225] Updated weights for policy 1, policy_version 1638910 (0.0009) [2023-12-28 07:00:44,516][106225] Updated weights for policy 1, policy_version 1638920 (0.0010) [2023-12-28 07:00:44,562][106225] Updated weights for policy 1, policy_version 1638930 (0.0010) [2023-12-28 07:00:45,111][106226] Updated weights for policy 0, policy_version 1635230 (0.0007) [2023-12-28 07:00:45,170][106226] Updated weights for policy 0, policy_version 1635240 (0.0009) [2023-12-28 07:00:45,228][106226] Updated weights for policy 0, policy_version 1635250 (0.0008) [2023-12-28 07:00:45,299][106225] Updated weights for policy 1, policy_version 1638940 (0.0010) [2023-12-28 07:00:45,354][106225] Updated weights for policy 1, policy_version 1638950 (0.0011) [2023-12-28 07:00:45,418][106225] Updated weights for policy 1, policy_version 1638960 (0.0011) [2023-12-28 07:00:45,860][106226] Updated weights for policy 0, policy_version 1635260 (0.0009) [2023-12-28 07:00:45,914][106226] Updated weights for policy 0, policy_version 1635270 (0.0008) [2023-12-28 07:00:45,963][106226] Updated weights for policy 0, policy_version 1635280 (0.0009) [2023-12-28 07:00:46,014][106225] Updated weights for policy 1, policy_version 1638970 (0.0010) [2023-12-28 07:00:46,068][106225] Updated weights for policy 1, policy_version 1638980 (0.0010) [2023-12-28 07:00:46,128][106225] Updated weights for policy 1, policy_version 1638990 (0.0010) [2023-12-28 07:00:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 838336512. Throughput: 0: 9812.2, 1: 9842.8. Samples: 838325820. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:46,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-5.098')] [2023-12-28 07:00:46,184][106225] Updated weights for policy 1, policy_version 1639000 (0.0010) [2023-12-28 07:00:46,668][106226] Updated weights for policy 0, policy_version 1635290 (0.0008) [2023-12-28 07:00:46,730][106226] Updated weights for policy 0, policy_version 1635300 (0.0007) [2023-12-28 07:00:46,790][106226] Updated weights for policy 0, policy_version 1635310 (0.0008) [2023-12-28 07:00:46,835][106225] Updated weights for policy 1, policy_version 1639010 (0.0006) [2023-12-28 07:00:46,851][106226] Updated weights for policy 0, policy_version 1635320 (0.0011) [2023-12-28 07:00:46,883][106225] Updated weights for policy 1, policy_version 1639020 (0.0006) [2023-12-28 07:00:46,932][106225] Updated weights for policy 1, policy_version 1639030 (0.0005) [2023-12-28 07:00:47,494][106226] Updated weights for policy 0, policy_version 1635330 (0.0005) [2023-12-28 07:00:47,542][106226] Updated weights for policy 0, policy_version 1635340 (0.0005) [2023-12-28 07:00:47,593][106226] Updated weights for policy 0, policy_version 1635350 (0.0006) [2023-12-28 07:00:47,627][106225] Updated weights for policy 1, policy_version 1639040 (0.0009) [2023-12-28 07:00:47,680][106225] Updated weights for policy 1, policy_version 1639050 (0.0010) [2023-12-28 07:00:47,738][106225] Updated weights for policy 1, policy_version 1639060 (0.0010) [2023-12-28 07:00:48,259][106226] Updated weights for policy 0, policy_version 1635360 (0.0007) [2023-12-28 07:00:48,329][106226] Updated weights for policy 0, policy_version 1635370 (0.0008) [2023-12-28 07:00:48,356][106225] Updated weights for policy 1, policy_version 1639070 (0.0010) [2023-12-28 07:00:48,396][106226] Updated weights for policy 0, policy_version 1635380 (0.0007) [2023-12-28 07:00:48,422][106225] Updated weights for policy 1, policy_version 1639080 (0.0007) [2023-12-28 07:00:48,474][106225] Updated weights for policy 1, policy_version 1639090 (0.0010) [2023-12-28 07:00:48,985][106226] Updated weights for policy 0, policy_version 1635390 (0.0005) [2023-12-28 07:00:49,043][106226] Updated weights for policy 0, policy_version 1635400 (0.0005) [2023-12-28 07:00:49,102][106226] Updated weights for policy 0, policy_version 1635410 (0.0006) [2023-12-28 07:00:49,247][106225] Updated weights for policy 1, policy_version 1639100 (0.0010) [2023-12-28 07:00:49,307][106225] Updated weights for policy 1, policy_version 1639110 (0.0010) [2023-12-28 07:00:49,370][106225] Updated weights for policy 1, policy_version 1639120 (0.0007) [2023-12-28 07:00:49,797][106226] Updated weights for policy 0, policy_version 1635420 (0.0009) [2023-12-28 07:00:49,865][106226] Updated weights for policy 0, policy_version 1635430 (0.0010) [2023-12-28 07:00:49,925][106226] Updated weights for policy 0, policy_version 1635440 (0.0007) [2023-12-28 07:00:50,059][106225] Updated weights for policy 1, policy_version 1639130 (0.0010) [2023-12-28 07:00:50,122][106225] Updated weights for policy 1, policy_version 1639140 (0.0006) [2023-12-28 07:00:50,182][106225] Updated weights for policy 1, policy_version 1639150 (0.0008) [2023-12-28 07:00:50,239][106225] Updated weights for policy 1, policy_version 1639160 (0.0007) [2023-12-28 07:00:50,688][106226] Updated weights for policy 0, policy_version 1635450 (0.0007) [2023-12-28 07:00:50,746][106226] Updated weights for policy 0, policy_version 1635460 (0.0005) [2023-12-28 07:00:50,804][106226] Updated weights for policy 0, policy_version 1635470 (0.0008) [2023-12-28 07:00:50,863][106226] Updated weights for policy 0, policy_version 1635480 (0.0010) [2023-12-28 07:00:50,925][106225] Updated weights for policy 1, policy_version 1639170 (0.0006) [2023-12-28 07:00:50,984][106225] Updated weights for policy 1, policy_version 1639180 (0.0008) [2023-12-28 07:00:51,046][106225] Updated weights for policy 1, policy_version 1639190 (0.0010) [2023-12-28 07:00:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 838443008. Throughput: 0: 9873.3, 1: 9855.6. Samples: 838448168. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:51,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.948')] [2023-12-28 07:00:51,643][106226] Updated weights for policy 0, policy_version 1635490 (0.0008) [2023-12-28 07:00:51,712][106226] Updated weights for policy 0, policy_version 1635500 (0.0008) [2023-12-28 07:00:51,769][106225] Updated weights for policy 1, policy_version 1639200 (0.0008) [2023-12-28 07:00:51,783][106226] Updated weights for policy 0, policy_version 1635510 (0.0008) [2023-12-28 07:00:51,828][106225] Updated weights for policy 1, policy_version 1639210 (0.0006) [2023-12-28 07:00:51,883][106225] Updated weights for policy 1, policy_version 1639220 (0.0007) [2023-12-28 07:00:52,559][106226] Updated weights for policy 0, policy_version 1635520 (0.0006) [2023-12-28 07:00:52,616][106226] Updated weights for policy 0, policy_version 1635530 (0.0006) [2023-12-28 07:00:52,649][106225] Updated weights for policy 1, policy_version 1639230 (0.0007) [2023-12-28 07:00:52,681][106226] Updated weights for policy 0, policy_version 1635540 (0.0008) [2023-12-28 07:00:52,718][106225] Updated weights for policy 1, policy_version 1639240 (0.0005) [2023-12-28 07:00:52,783][106225] Updated weights for policy 1, policy_version 1639250 (0.0007) [2023-12-28 07:00:53,285][106226] Updated weights for policy 0, policy_version 1635550 (0.0008) [2023-12-28 07:00:53,335][106226] Updated weights for policy 0, policy_version 1635560 (0.0008) [2023-12-28 07:00:53,396][106226] Updated weights for policy 0, policy_version 1635570 (0.0009) [2023-12-28 07:00:53,428][106225] Updated weights for policy 1, policy_version 1639260 (0.0006) [2023-12-28 07:00:53,485][106225] Updated weights for policy 1, policy_version 1639270 (0.0007) [2023-12-28 07:00:53,547][106225] Updated weights for policy 1, policy_version 1639280 (0.0008) [2023-12-28 07:00:54,145][106226] Updated weights for policy 0, policy_version 1635580 (0.0008) [2023-12-28 07:00:54,180][106225] Updated weights for policy 1, policy_version 1639290 (0.0008) [2023-12-28 07:00:54,204][106226] Updated weights for policy 0, policy_version 1635590 (0.0006) [2023-12-28 07:00:54,242][106225] Updated weights for policy 1, policy_version 1639300 (0.0006) [2023-12-28 07:00:54,265][106226] Updated weights for policy 0, policy_version 1635600 (0.0005) [2023-12-28 07:00:54,304][106225] Updated weights for policy 1, policy_version 1639310 (0.0006) [2023-12-28 07:00:54,364][106225] Updated weights for policy 1, policy_version 1639320 (0.0005) [2023-12-28 07:00:54,944][106225] Updated weights for policy 1, policy_version 1639330 (0.0008) [2023-12-28 07:00:54,974][106226] Updated weights for policy 0, policy_version 1635610 (0.0008) [2023-12-28 07:00:55,009][106225] Updated weights for policy 1, policy_version 1639340 (0.0008) [2023-12-28 07:00:55,035][106226] Updated weights for policy 0, policy_version 1635620 (0.0008) [2023-12-28 07:00:55,061][106225] Updated weights for policy 1, policy_version 1639350 (0.0006) [2023-12-28 07:00:55,090][106226] Updated weights for policy 0, policy_version 1635630 (0.0007) [2023-12-28 07:00:55,148][106226] Updated weights for policy 0, policy_version 1635640 (0.0008) [2023-12-28 07:00:55,670][106225] Updated weights for policy 1, policy_version 1639360 (0.0006) [2023-12-28 07:00:55,730][106225] Updated weights for policy 1, policy_version 1639370 (0.0005) [2023-12-28 07:00:55,790][106225] Updated weights for policy 1, policy_version 1639380 (0.0006) [2023-12-28 07:00:55,970][106226] Updated weights for policy 0, policy_version 1635650 (0.0009) [2023-12-28 07:00:56,029][106226] Updated weights for policy 0, policy_version 1635660 (0.0008) [2023-12-28 07:00:56,084][106226] Updated weights for policy 0, policy_version 1635670 (0.0008) [2023-12-28 07:00:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 838541312. Throughput: 0: 9844.1, 1: 9876.6. Samples: 838506228. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:00:56,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.697')] [2023-12-28 07:00:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001639384_419733504.pth... [2023-12-28 07:00:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001635672_418807808.pth... [2023-12-28 07:00:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001638200_419430400.pth [2023-12-28 07:00:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001634488_418504704.pth [2023-12-28 07:00:56,331][106225] Updated weights for policy 1, policy_version 1639390 (0.0006) [2023-12-28 07:00:56,379][106225] Updated weights for policy 1, policy_version 1639400 (0.0008) [2023-12-28 07:00:56,429][106225] Updated weights for policy 1, policy_version 1639410 (0.0008) [2023-12-28 07:00:56,827][106226] Updated weights for policy 0, policy_version 1635680 (0.0009) [2023-12-28 07:00:56,896][106226] Updated weights for policy 0, policy_version 1635690 (0.0008) [2023-12-28 07:00:56,954][106226] Updated weights for policy 0, policy_version 1635700 (0.0009) [2023-12-28 07:00:57,146][106225] Updated weights for policy 1, policy_version 1639420 (0.0010) [2023-12-28 07:00:57,211][106225] Updated weights for policy 1, policy_version 1639430 (0.0010) [2023-12-28 07:00:57,257][106225] Updated weights for policy 1, policy_version 1639440 (0.0010) [2023-12-28 07:00:57,680][106226] Updated weights for policy 0, policy_version 1635710 (0.0007) [2023-12-28 07:00:57,744][106226] Updated weights for policy 0, policy_version 1635720 (0.0007) [2023-12-28 07:00:57,794][106226] Updated weights for policy 0, policy_version 1635730 (0.0005) [2023-12-28 07:00:57,918][106225] Updated weights for policy 1, policy_version 1639450 (0.0006) [2023-12-28 07:00:57,973][106225] Updated weights for policy 1, policy_version 1639460 (0.0008) [2023-12-28 07:00:58,024][106225] Updated weights for policy 1, policy_version 1639470 (0.0007) [2023-12-28 07:00:58,087][106225] Updated weights for policy 1, policy_version 1639480 (0.0010) [2023-12-28 07:00:58,449][106226] Updated weights for policy 0, policy_version 1635740 (0.0007) [2023-12-28 07:00:58,516][106226] Updated weights for policy 0, policy_version 1635750 (0.0008) [2023-12-28 07:00:58,582][106226] Updated weights for policy 0, policy_version 1635760 (0.0009) [2023-12-28 07:00:58,869][106225] Updated weights for policy 1, policy_version 1639490 (0.0008) [2023-12-28 07:00:58,937][106225] Updated weights for policy 1, policy_version 1639500 (0.0009) [2023-12-28 07:00:59,004][106225] Updated weights for policy 1, policy_version 1639510 (0.0008) [2023-12-28 07:00:59,379][106226] Updated weights for policy 0, policy_version 1635770 (0.0008) [2023-12-28 07:00:59,448][106226] Updated weights for policy 0, policy_version 1635780 (0.0006) [2023-12-28 07:00:59,511][106226] Updated weights for policy 0, policy_version 1635790 (0.0005) [2023-12-28 07:00:59,567][106226] Updated weights for policy 0, policy_version 1635800 (0.0006) [2023-12-28 07:00:59,688][106225] Updated weights for policy 1, policy_version 1639520 (0.0007) [2023-12-28 07:00:59,746][106225] Updated weights for policy 1, policy_version 1639530 (0.0007) [2023-12-28 07:00:59,811][106225] Updated weights for policy 1, policy_version 1639540 (0.0008) [2023-12-28 07:01:00,318][106226] Updated weights for policy 0, policy_version 1635810 (0.0008) [2023-12-28 07:01:00,375][106226] Updated weights for policy 0, policy_version 1635820 (0.0009) [2023-12-28 07:01:00,435][106226] Updated weights for policy 0, policy_version 1635830 (0.0010) [2023-12-28 07:01:00,482][106225] Updated weights for policy 1, policy_version 1639550 (0.0008) [2023-12-28 07:01:00,532][106225] Updated weights for policy 1, policy_version 1639560 (0.0005) [2023-12-28 07:01:00,583][106225] Updated weights for policy 1, policy_version 1639570 (0.0005) [2023-12-28 07:01:01,118][106225] Updated weights for policy 1, policy_version 1639580 (0.0006) [2023-12-28 07:01:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 838631424. Throughput: 0: 9838.8, 1: 9991.9. Samples: 838625116. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:01,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.893')] [2023-12-28 07:01:01,179][106226] Updated weights for policy 0, policy_version 1635840 (0.0009) [2023-12-28 07:01:01,182][106225] Updated weights for policy 1, policy_version 1639590 (0.0006) [2023-12-28 07:01:01,240][106226] Updated weights for policy 0, policy_version 1635850 (0.0009) [2023-12-28 07:01:01,245][106225] Updated weights for policy 1, policy_version 1639600 (0.0006) [2023-12-28 07:01:01,303][106226] Updated weights for policy 0, policy_version 1635860 (0.0006) [2023-12-28 07:01:01,978][106225] Updated weights for policy 1, policy_version 1639610 (0.0009) [2023-12-28 07:01:02,029][106225] Updated weights for policy 1, policy_version 1639620 (0.0010) [2023-12-28 07:01:02,049][106226] Updated weights for policy 0, policy_version 1635870 (0.0009) [2023-12-28 07:01:02,093][106225] Updated weights for policy 1, policy_version 1639630 (0.0010) [2023-12-28 07:01:02,117][106226] Updated weights for policy 0, policy_version 1635880 (0.0007) [2023-12-28 07:01:02,147][106225] Updated weights for policy 1, policy_version 1639640 (0.0010) [2023-12-28 07:01:02,180][106226] Updated weights for policy 0, policy_version 1635890 (0.0011) [2023-12-28 07:01:02,881][106226] Updated weights for policy 0, policy_version 1635900 (0.0010) [2023-12-28 07:01:02,892][106225] Updated weights for policy 1, policy_version 1639650 (0.0007) [2023-12-28 07:01:02,932][106226] Updated weights for policy 0, policy_version 1635910 (0.0010) [2023-12-28 07:01:02,942][106225] Updated weights for policy 1, policy_version 1639660 (0.0006) [2023-12-28 07:01:02,986][106226] Updated weights for policy 0, policy_version 1635920 (0.0010) [2023-12-28 07:01:02,995][106225] Updated weights for policy 1, policy_version 1639670 (0.0005) [2023-12-28 07:01:03,716][106226] Updated weights for policy 0, policy_version 1635930 (0.0010) [2023-12-28 07:01:03,725][106225] Updated weights for policy 1, policy_version 1639680 (0.0008) [2023-12-28 07:01:03,769][106226] Updated weights for policy 0, policy_version 1635940 (0.0010) [2023-12-28 07:01:03,775][106225] Updated weights for policy 1, policy_version 1639690 (0.0006) [2023-12-28 07:01:03,828][106225] Updated weights for policy 1, policy_version 1639700 (0.0006) [2023-12-28 07:01:03,830][106226] Updated weights for policy 0, policy_version 1635950 (0.0011) [2023-12-28 07:01:03,898][106226] Updated weights for policy 0, policy_version 1635960 (0.0011) [2023-12-28 07:01:04,604][106226] Updated weights for policy 0, policy_version 1635970 (0.0011) [2023-12-28 07:01:04,610][106225] Updated weights for policy 1, policy_version 1639710 (0.0006) [2023-12-28 07:01:04,665][106226] Updated weights for policy 0, policy_version 1635980 (0.0011) [2023-12-28 07:01:04,668][106225] Updated weights for policy 1, policy_version 1639720 (0.0006) [2023-12-28 07:01:04,726][106226] Updated weights for policy 0, policy_version 1635990 (0.0011) [2023-12-28 07:01:04,732][106225] Updated weights for policy 1, policy_version 1639730 (0.0007) [2023-12-28 07:01:05,359][106225] Updated weights for policy 1, policy_version 1639740 (0.0007) [2023-12-28 07:01:05,377][106226] Updated weights for policy 0, policy_version 1636000 (0.0011) [2023-12-28 07:01:05,421][106225] Updated weights for policy 1, policy_version 1639750 (0.0005) [2023-12-28 07:01:05,440][106226] Updated weights for policy 0, policy_version 1636010 (0.0011) [2023-12-28 07:01:05,475][106225] Updated weights for policy 1, policy_version 1639760 (0.0005) [2023-12-28 07:01:05,501][106226] Updated weights for policy 0, policy_version 1636020 (0.0011) [2023-12-28 07:01:06,152][106225] Updated weights for policy 1, policy_version 1639770 (0.0006) [2023-12-28 07:01:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 838729728. Throughput: 0: 9877.8, 1: 10086.9. Samples: 838744312. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:06,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.711')] [2023-12-28 07:01:06,196][106226] Updated weights for policy 0, policy_version 1636030 (0.0010) [2023-12-28 07:01:06,215][106225] Updated weights for policy 1, policy_version 1639780 (0.0007) [2023-12-28 07:01:06,259][106226] Updated weights for policy 0, policy_version 1636040 (0.0007) [2023-12-28 07:01:06,280][106225] Updated weights for policy 1, policy_version 1639790 (0.0008) [2023-12-28 07:01:06,319][106226] Updated weights for policy 0, policy_version 1636050 (0.0007) [2023-12-28 07:01:06,344][106225] Updated weights for policy 1, policy_version 1639800 (0.0007) [2023-12-28 07:01:06,920][106226] Updated weights for policy 0, policy_version 1636060 (0.0011) [2023-12-28 07:01:06,973][106226] Updated weights for policy 0, policy_version 1636070 (0.0011) [2023-12-28 07:01:07,030][106226] Updated weights for policy 0, policy_version 1636080 (0.0011) [2023-12-28 07:01:07,093][106225] Updated weights for policy 1, policy_version 1639810 (0.0009) [2023-12-28 07:01:07,161][106225] Updated weights for policy 1, policy_version 1639820 (0.0008) [2023-12-28 07:01:07,226][106225] Updated weights for policy 1, policy_version 1639830 (0.0008) [2023-12-28 07:01:07,723][106226] Updated weights for policy 0, policy_version 1636090 (0.0011) [2023-12-28 07:01:07,788][106226] Updated weights for policy 0, policy_version 1636100 (0.0011) [2023-12-28 07:01:07,853][106226] Updated weights for policy 0, policy_version 1636110 (0.0011) [2023-12-28 07:01:07,914][106226] Updated weights for policy 0, policy_version 1636120 (0.0011) [2023-12-28 07:01:07,988][106225] Updated weights for policy 1, policy_version 1639840 (0.0008) [2023-12-28 07:01:08,049][106225] Updated weights for policy 1, policy_version 1639850 (0.0008) [2023-12-28 07:01:08,110][106225] Updated weights for policy 1, policy_version 1639860 (0.0008) [2023-12-28 07:01:08,629][106226] Updated weights for policy 0, policy_version 1636130 (0.0011) [2023-12-28 07:01:08,690][106226] Updated weights for policy 0, policy_version 1636140 (0.0011) [2023-12-28 07:01:08,755][106226] Updated weights for policy 0, policy_version 1636150 (0.0011) [2023-12-28 07:01:08,844][106225] Updated weights for policy 1, policy_version 1639870 (0.0008) [2023-12-28 07:01:08,898][106225] Updated weights for policy 1, policy_version 1639880 (0.0008) [2023-12-28 07:01:08,953][106225] Updated weights for policy 1, policy_version 1639890 (0.0008) [2023-12-28 07:01:09,512][106226] Updated weights for policy 0, policy_version 1636160 (0.0011) [2023-12-28 07:01:09,579][106226] Updated weights for policy 0, policy_version 1636170 (0.0011) [2023-12-28 07:01:09,642][106226] Updated weights for policy 0, policy_version 1636180 (0.0007) [2023-12-28 07:01:09,766][106225] Updated weights for policy 1, policy_version 1639900 (0.0008) [2023-12-28 07:01:09,827][106225] Updated weights for policy 1, policy_version 1639910 (0.0008) [2023-12-28 07:01:09,892][106225] Updated weights for policy 1, policy_version 1639920 (0.0008) [2023-12-28 07:01:10,342][106226] Updated weights for policy 0, policy_version 1636190 (0.0006) [2023-12-28 07:01:10,405][106226] Updated weights for policy 0, policy_version 1636200 (0.0009) [2023-12-28 07:01:10,469][106226] Updated weights for policy 0, policy_version 1636210 (0.0009) [2023-12-28 07:01:10,702][106225] Updated weights for policy 1, policy_version 1639930 (0.0008) [2023-12-28 07:01:10,750][106225] Updated weights for policy 1, policy_version 1639940 (0.0008) [2023-12-28 07:01:10,797][106225] Updated weights for policy 1, policy_version 1639950 (0.0009) [2023-12-28 07:01:10,846][106225] Updated weights for policy 1, policy_version 1639960 (0.0009) [2023-12-28 07:01:11,124][106226] Updated weights for policy 0, policy_version 1636220 (0.0007) [2023-12-28 07:01:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 838828032. Throughput: 0: 9953.6, 1: 10071.1. Samples: 838801892. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:11,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.606')] [2023-12-28 07:01:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001639960_419880960.pth... [2023-12-28 07:01:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001638808_419586048.pth [2023-12-28 07:01:11,195][106226] Updated weights for policy 0, policy_version 1636230 (0.0008) [2023-12-28 07:01:11,257][106226] Updated weights for policy 0, policy_version 1636240 (0.0008) [2023-12-28 07:01:11,307][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001636248_418955264.pth... [2023-12-28 07:01:11,312][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001635096_418660352.pth [2023-12-28 07:01:11,700][106225] Updated weights for policy 1, policy_version 1639970 (0.0008) [2023-12-28 07:01:11,769][106225] Updated weights for policy 1, policy_version 1639980 (0.0009) [2023-12-28 07:01:11,837][106225] Updated weights for policy 1, policy_version 1639990 (0.0007) [2023-12-28 07:01:12,007][106226] Updated weights for policy 0, policy_version 1636250 (0.0009) [2023-12-28 07:01:12,061][106226] Updated weights for policy 0, policy_version 1636260 (0.0009) [2023-12-28 07:01:12,114][106226] Updated weights for policy 0, policy_version 1636270 (0.0009) [2023-12-28 07:01:12,177][106226] Updated weights for policy 0, policy_version 1636280 (0.0009) [2023-12-28 07:01:12,586][106225] Updated weights for policy 1, policy_version 1640000 (0.0009) [2023-12-28 07:01:12,648][106225] Updated weights for policy 1, policy_version 1640010 (0.0009) [2023-12-28 07:01:12,709][106225] Updated weights for policy 1, policy_version 1640020 (0.0009) [2023-12-28 07:01:12,940][106226] Updated weights for policy 0, policy_version 1636290 (0.0006) [2023-12-28 07:01:12,999][106226] Updated weights for policy 0, policy_version 1636300 (0.0008) [2023-12-28 07:01:13,060][106226] Updated weights for policy 0, policy_version 1636310 (0.0008) [2023-12-28 07:01:13,445][106225] Updated weights for policy 1, policy_version 1640030 (0.0007) [2023-12-28 07:01:13,514][106225] Updated weights for policy 1, policy_version 1640040 (0.0005) [2023-12-28 07:01:13,580][106225] Updated weights for policy 1, policy_version 1640050 (0.0005) [2023-12-28 07:01:13,715][106226] Updated weights for policy 0, policy_version 1636320 (0.0009) [2023-12-28 07:01:13,771][106226] Updated weights for policy 0, policy_version 1636330 (0.0009) [2023-12-28 07:01:13,824][106226] Updated weights for policy 0, policy_version 1636340 (0.0008) [2023-12-28 07:01:14,150][106225] Updated weights for policy 1, policy_version 1640060 (0.0007) [2023-12-28 07:01:14,198][106225] Updated weights for policy 1, policy_version 1640070 (0.0009) [2023-12-28 07:01:14,259][106225] Updated weights for policy 1, policy_version 1640080 (0.0006) [2023-12-28 07:01:14,621][106226] Updated weights for policy 0, policy_version 1636350 (0.0009) [2023-12-28 07:01:14,686][106226] Updated weights for policy 0, policy_version 1636360 (0.0008) [2023-12-28 07:01:14,747][106226] Updated weights for policy 0, policy_version 1636370 (0.0008) [2023-12-28 07:01:14,906][106225] Updated weights for policy 1, policy_version 1640090 (0.0006) [2023-12-28 07:01:14,976][106225] Updated weights for policy 1, policy_version 1640100 (0.0008) [2023-12-28 07:01:15,040][106225] Updated weights for policy 1, policy_version 1640110 (0.0009) [2023-12-28 07:01:15,104][106225] Updated weights for policy 1, policy_version 1640120 (0.0009) [2023-12-28 07:01:15,501][106226] Updated weights for policy 0, policy_version 1636380 (0.0007) [2023-12-28 07:01:15,550][106226] Updated weights for policy 0, policy_version 1636390 (0.0005) [2023-12-28 07:01:15,598][106226] Updated weights for policy 0, policy_version 1636400 (0.0005) [2023-12-28 07:01:15,876][106225] Updated weights for policy 1, policy_version 1640130 (0.0009) [2023-12-28 07:01:15,924][106225] Updated weights for policy 1, policy_version 1640140 (0.0007) [2023-12-28 07:01:15,968][106225] Updated weights for policy 1, policy_version 1640150 (0.0008) [2023-12-28 07:01:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 838926336. Throughput: 0: 9807.3, 1: 9935.5. Samples: 838916016. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:16,176][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.659')] [2023-12-28 07:01:16,205][106226] Updated weights for policy 0, policy_version 1636410 (0.0008) [2023-12-28 07:01:16,260][106226] Updated weights for policy 0, policy_version 1636420 (0.0008) [2023-12-28 07:01:16,319][106226] Updated weights for policy 0, policy_version 1636430 (0.0008) [2023-12-28 07:01:16,377][106226] Updated weights for policy 0, policy_version 1636440 (0.0009) [2023-12-28 07:01:16,641][106225] Updated weights for policy 1, policy_version 1640160 (0.0007) [2023-12-28 07:01:16,685][106225] Updated weights for policy 1, policy_version 1640170 (0.0008) [2023-12-28 07:01:16,734][106225] Updated weights for policy 1, policy_version 1640180 (0.0008) [2023-12-28 07:01:17,140][106226] Updated weights for policy 0, policy_version 1636450 (0.0009) [2023-12-28 07:01:17,194][106226] Updated weights for policy 0, policy_version 1636460 (0.0008) [2023-12-28 07:01:17,257][106226] Updated weights for policy 0, policy_version 1636470 (0.0009) [2023-12-28 07:01:17,422][106225] Updated weights for policy 1, policy_version 1640190 (0.0008) [2023-12-28 07:01:17,466][106225] Updated weights for policy 1, policy_version 1640200 (0.0008) [2023-12-28 07:01:17,531][106225] Updated weights for policy 1, policy_version 1640210 (0.0008) [2023-12-28 07:01:17,929][106226] Updated weights for policy 0, policy_version 1636480 (0.0008) [2023-12-28 07:01:17,978][106226] Updated weights for policy 0, policy_version 1636490 (0.0008) [2023-12-28 07:01:18,027][106226] Updated weights for policy 0, policy_version 1636500 (0.0008) [2023-12-28 07:01:18,206][106225] Updated weights for policy 1, policy_version 1640220 (0.0008) [2023-12-28 07:01:18,263][106225] Updated weights for policy 1, policy_version 1640230 (0.0009) [2023-12-28 07:01:18,319][106225] Updated weights for policy 1, policy_version 1640240 (0.0009) [2023-12-28 07:01:18,804][106226] Updated weights for policy 0, policy_version 1636510 (0.0009) [2023-12-28 07:01:18,856][106226] Updated weights for policy 0, policy_version 1636520 (0.0008) [2023-12-28 07:01:18,915][106226] Updated weights for policy 0, policy_version 1636530 (0.0008) [2023-12-28 07:01:19,077][106225] Updated weights for policy 1, policy_version 1640250 (0.0010) [2023-12-28 07:01:19,147][106225] Updated weights for policy 1, policy_version 1640260 (0.0009) [2023-12-28 07:01:19,206][106225] Updated weights for policy 1, policy_version 1640270 (0.0008) [2023-12-28 07:01:19,275][106225] Updated weights for policy 1, policy_version 1640280 (0.0008) [2023-12-28 07:01:19,677][106226] Updated weights for policy 0, policy_version 1636540 (0.0009) [2023-12-28 07:01:19,739][106226] Updated weights for policy 0, policy_version 1636550 (0.0009) [2023-12-28 07:01:19,797][106226] Updated weights for policy 0, policy_version 1636560 (0.0009) [2023-12-28 07:01:19,975][106225] Updated weights for policy 1, policy_version 1640290 (0.0008) [2023-12-28 07:01:20,040][106225] Updated weights for policy 1, policy_version 1640300 (0.0008) [2023-12-28 07:01:20,092][106225] Updated weights for policy 1, policy_version 1640310 (0.0008) [2023-12-28 07:01:20,540][106226] Updated weights for policy 0, policy_version 1636570 (0.0010) [2023-12-28 07:01:20,608][106226] Updated weights for policy 0, policy_version 1636580 (0.0006) [2023-12-28 07:01:20,663][106226] Updated weights for policy 0, policy_version 1636590 (0.0008) [2023-12-28 07:01:20,719][106226] Updated weights for policy 0, policy_version 1636600 (0.0008) [2023-12-28 07:01:20,856][106225] Updated weights for policy 1, policy_version 1640320 (0.0009) [2023-12-28 07:01:20,916][106225] Updated weights for policy 1, policy_version 1640330 (0.0009) [2023-12-28 07:01:20,980][106225] Updated weights for policy 1, policy_version 1640340 (0.0008) [2023-12-28 07:01:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 839024640. Throughput: 0: 9720.7, 1: 9885.9. Samples: 839032500. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:21,175][105115] Avg episode reward: [(0, '-4.581'), (1, '-4.705')] [2023-12-28 07:01:21,478][106226] Updated weights for policy 0, policy_version 1636610 (0.0009) [2023-12-28 07:01:21,545][106226] Updated weights for policy 0, policy_version 1636620 (0.0009) [2023-12-28 07:01:21,606][106226] Updated weights for policy 0, policy_version 1636630 (0.0009) [2023-12-28 07:01:21,730][106225] Updated weights for policy 1, policy_version 1640350 (0.0008) [2023-12-28 07:01:21,793][106225] Updated weights for policy 1, policy_version 1640360 (0.0009) [2023-12-28 07:01:21,855][106225] Updated weights for policy 1, policy_version 1640370 (0.0009) [2023-12-28 07:01:22,272][106226] Updated weights for policy 0, policy_version 1636640 (0.0009) [2023-12-28 07:01:22,332][106226] Updated weights for policy 0, policy_version 1636650 (0.0009) [2023-12-28 07:01:22,399][106226] Updated weights for policy 0, policy_version 1636660 (0.0008) [2023-12-28 07:01:22,687][106225] Updated weights for policy 1, policy_version 1640380 (0.0009) [2023-12-28 07:01:22,743][106225] Updated weights for policy 1, policy_version 1640390 (0.0008) [2023-12-28 07:01:22,803][106225] Updated weights for policy 1, policy_version 1640400 (0.0008) [2023-12-28 07:01:23,154][106226] Updated weights for policy 0, policy_version 1636670 (0.0010) [2023-12-28 07:01:23,213][106226] Updated weights for policy 0, policy_version 1636680 (0.0011) [2023-12-28 07:01:23,264][106226] Updated weights for policy 0, policy_version 1636690 (0.0006) [2023-12-28 07:01:23,573][106225] Updated weights for policy 1, policy_version 1640410 (0.0008) [2023-12-28 07:01:23,632][106225] Updated weights for policy 1, policy_version 1640420 (0.0005) [2023-12-28 07:01:23,691][106225] Updated weights for policy 1, policy_version 1640430 (0.0005) [2023-12-28 07:01:23,744][106225] Updated weights for policy 1, policy_version 1640440 (0.0005) [2023-12-28 07:01:23,946][106226] Updated weights for policy 0, policy_version 1636700 (0.0010) [2023-12-28 07:01:23,996][106226] Updated weights for policy 0, policy_version 1636710 (0.0010) [2023-12-28 07:01:24,042][106226] Updated weights for policy 0, policy_version 1636720 (0.0010) [2023-12-28 07:01:24,287][106225] Updated weights for policy 1, policy_version 1640450 (0.0010) [2023-12-28 07:01:24,343][106225] Updated weights for policy 1, policy_version 1640460 (0.0010) [2023-12-28 07:01:24,396][106225] Updated weights for policy 1, policy_version 1640470 (0.0010) [2023-12-28 07:01:24,718][106226] Updated weights for policy 0, policy_version 1636730 (0.0010) [2023-12-28 07:01:24,775][106226] Updated weights for policy 0, policy_version 1636740 (0.0010) [2023-12-28 07:01:24,821][106226] Updated weights for policy 0, policy_version 1636750 (0.0010) [2023-12-28 07:01:24,870][106226] Updated weights for policy 0, policy_version 1636760 (0.0010) [2023-12-28 07:01:25,129][106225] Updated weights for policy 1, policy_version 1640480 (0.0010) [2023-12-28 07:01:25,187][106225] Updated weights for policy 1, policy_version 1640490 (0.0010) [2023-12-28 07:01:25,236][106225] Updated weights for policy 1, policy_version 1640500 (0.0010) [2023-12-28 07:01:25,530][106226] Updated weights for policy 0, policy_version 1636770 (0.0010) [2023-12-28 07:01:25,589][106226] Updated weights for policy 0, policy_version 1636780 (0.0010) [2023-12-28 07:01:25,638][106226] Updated weights for policy 0, policy_version 1636790 (0.0010) [2023-12-28 07:01:25,855][106225] Updated weights for policy 1, policy_version 1640510 (0.0008) [2023-12-28 07:01:25,901][106225] Updated weights for policy 1, policy_version 1640520 (0.0010) [2023-12-28 07:01:25,947][106225] Updated weights for policy 1, policy_version 1640530 (0.0010) [2023-12-28 07:01:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 839122944. Throughput: 0: 9715.8, 1: 9828.5. Samples: 839089152. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:26,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.799')] [2023-12-28 07:01:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001640536_420028416.pth... [2023-12-28 07:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001636792_419094528.pth... [2023-12-28 07:01:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001639384_419733504.pth [2023-12-28 07:01:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001635672_418807808.pth [2023-12-28 07:01:26,299][106226] Updated weights for policy 0, policy_version 1636800 (0.0006) [2023-12-28 07:01:26,350][106226] Updated weights for policy 0, policy_version 1636810 (0.0005) [2023-12-28 07:01:26,405][106226] Updated weights for policy 0, policy_version 1636820 (0.0005) [2023-12-28 07:01:26,677][106225] Updated weights for policy 1, policy_version 1640540 (0.0010) [2023-12-28 07:01:26,728][106225] Updated weights for policy 1, policy_version 1640550 (0.0006) [2023-12-28 07:01:26,782][106225] Updated weights for policy 1, policy_version 1640560 (0.0009) [2023-12-28 07:01:26,930][106226] Updated weights for policy 0, policy_version 1636830 (0.0008) [2023-12-28 07:01:26,992][106226] Updated weights for policy 0, policy_version 1636840 (0.0010) [2023-12-28 07:01:27,041][106226] Updated weights for policy 0, policy_version 1636850 (0.0010) [2023-12-28 07:01:27,498][106225] Updated weights for policy 1, policy_version 1640570 (0.0010) [2023-12-28 07:01:27,564][106225] Updated weights for policy 1, policy_version 1640580 (0.0008) [2023-12-28 07:01:27,617][106226] Updated weights for policy 0, policy_version 1636860 (0.0007) [2023-12-28 07:01:27,627][106225] Updated weights for policy 1, policy_version 1640590 (0.0008) [2023-12-28 07:01:27,675][106226] Updated weights for policy 0, policy_version 1636870 (0.0007) [2023-12-28 07:01:27,692][106225] Updated weights for policy 1, policy_version 1640600 (0.0008) [2023-12-28 07:01:27,732][106226] Updated weights for policy 0, policy_version 1636880 (0.0007) [2023-12-28 07:01:28,231][106225] Updated weights for policy 1, policy_version 1640610 (0.0005) [2023-12-28 07:01:28,281][106225] Updated weights for policy 1, policy_version 1640620 (0.0008) [2023-12-28 07:01:28,336][106225] Updated weights for policy 1, policy_version 1640630 (0.0007) [2023-12-28 07:01:28,509][106226] Updated weights for policy 0, policy_version 1636890 (0.0009) [2023-12-28 07:01:28,578][106226] Updated weights for policy 0, policy_version 1636900 (0.0007) [2023-12-28 07:01:28,642][106226] Updated weights for policy 0, policy_version 1636910 (0.0007) [2023-12-28 07:01:28,704][106226] Updated weights for policy 0, policy_version 1636920 (0.0008) [2023-12-28 07:01:29,050][106225] Updated weights for policy 1, policy_version 1640640 (0.0010) [2023-12-28 07:01:29,109][106225] Updated weights for policy 1, policy_version 1640650 (0.0010) [2023-12-28 07:01:29,170][106225] Updated weights for policy 1, policy_version 1640660 (0.0010) [2023-12-28 07:01:29,441][106226] Updated weights for policy 0, policy_version 1636930 (0.0010) [2023-12-28 07:01:29,504][106226] Updated weights for policy 0, policy_version 1636940 (0.0010) [2023-12-28 07:01:29,567][106226] Updated weights for policy 0, policy_version 1636950 (0.0010) [2023-12-28 07:01:29,911][106225] Updated weights for policy 1, policy_version 1640670 (0.0008) [2023-12-28 07:01:29,983][106225] Updated weights for policy 1, policy_version 1640680 (0.0009) [2023-12-28 07:01:30,050][106225] Updated weights for policy 1, policy_version 1640690 (0.0008) [2023-12-28 07:01:30,259][106226] Updated weights for policy 0, policy_version 1636960 (0.0010) [2023-12-28 07:01:30,309][106226] Updated weights for policy 0, policy_version 1636970 (0.0010) [2023-12-28 07:01:30,369][106226] Updated weights for policy 0, policy_version 1636980 (0.0011) [2023-12-28 07:01:30,723][106225] Updated weights for policy 1, policy_version 1640700 (0.0008) [2023-12-28 07:01:30,785][106225] Updated weights for policy 1, policy_version 1640710 (0.0008) [2023-12-28 07:01:30,850][106225] Updated weights for policy 1, policy_version 1640720 (0.0007) [2023-12-28 07:01:31,116][106226] Updated weights for policy 0, policy_version 1636990 (0.0011) [2023-12-28 07:01:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 839221248. Throughput: 0: 9803.6, 1: 9922.9. Samples: 839213516. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:31,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.779')] [2023-12-28 07:01:31,183][106226] Updated weights for policy 0, policy_version 1637000 (0.0009) [2023-12-28 07:01:31,249][106226] Updated weights for policy 0, policy_version 1637010 (0.0011) [2023-12-28 07:01:31,584][106225] Updated weights for policy 1, policy_version 1640730 (0.0008) [2023-12-28 07:01:31,644][106225] Updated weights for policy 1, policy_version 1640740 (0.0008) [2023-12-28 07:01:31,705][106225] Updated weights for policy 1, policy_version 1640750 (0.0008) [2023-12-28 07:01:31,770][106225] Updated weights for policy 1, policy_version 1640760 (0.0009) [2023-12-28 07:01:31,942][106226] Updated weights for policy 0, policy_version 1637020 (0.0010) [2023-12-28 07:01:32,000][106226] Updated weights for policy 0, policy_version 1637030 (0.0009) [2023-12-28 07:01:32,057][106226] Updated weights for policy 0, policy_version 1637040 (0.0006) [2023-12-28 07:01:32,489][106225] Updated weights for policy 1, policy_version 1640770 (0.0006) [2023-12-28 07:01:32,553][106225] Updated weights for policy 1, policy_version 1640780 (0.0008) [2023-12-28 07:01:32,616][106225] Updated weights for policy 1, policy_version 1640790 (0.0008) [2023-12-28 07:01:32,772][106226] Updated weights for policy 0, policy_version 1637050 (0.0008) [2023-12-28 07:01:32,823][106226] Updated weights for policy 0, policy_version 1637060 (0.0005) [2023-12-28 07:01:32,882][106226] Updated weights for policy 0, policy_version 1637070 (0.0005) [2023-12-28 07:01:32,939][106226] Updated weights for policy 0, policy_version 1637080 (0.0005) [2023-12-28 07:01:33,348][106225] Updated weights for policy 1, policy_version 1640800 (0.0009) [2023-12-28 07:01:33,398][106225] Updated weights for policy 1, policy_version 1640810 (0.0008) [2023-12-28 07:01:33,443][106225] Updated weights for policy 1, policy_version 1640820 (0.0008) [2023-12-28 07:01:33,567][106226] Updated weights for policy 0, policy_version 1637090 (0.0009) [2023-12-28 07:01:33,616][106226] Updated weights for policy 0, policy_version 1637100 (0.0009) [2023-12-28 07:01:33,667][106226] Updated weights for policy 0, policy_version 1637110 (0.0008) [2023-12-28 07:01:34,236][106225] Updated weights for policy 1, policy_version 1640830 (0.0007) [2023-12-28 07:01:34,299][106225] Updated weights for policy 1, policy_version 1640840 (0.0008) [2023-12-28 07:01:34,353][106226] Updated weights for policy 0, policy_version 1637120 (0.0009) [2023-12-28 07:01:34,359][106225] Updated weights for policy 1, policy_version 1640850 (0.0007) [2023-12-28 07:01:34,412][106226] Updated weights for policy 0, policy_version 1637130 (0.0009) [2023-12-28 07:01:34,472][106226] Updated weights for policy 0, policy_version 1637140 (0.0007) [2023-12-28 07:01:35,064][106225] Updated weights for policy 1, policy_version 1640860 (0.0007) [2023-12-28 07:01:35,120][106225] Updated weights for policy 1, policy_version 1640870 (0.0008) [2023-12-28 07:01:35,140][106226] Updated weights for policy 0, policy_version 1637150 (0.0007) [2023-12-28 07:01:35,168][106225] Updated weights for policy 1, policy_version 1640880 (0.0008) [2023-12-28 07:01:35,197][106226] Updated weights for policy 0, policy_version 1637160 (0.0007) [2023-12-28 07:01:35,243][106226] Updated weights for policy 0, policy_version 1637170 (0.0007) [2023-12-28 07:01:35,925][106225] Updated weights for policy 1, policy_version 1640890 (0.0006) [2023-12-28 07:01:35,931][106226] Updated weights for policy 0, policy_version 1637180 (0.0008) [2023-12-28 07:01:35,973][106225] Updated weights for policy 1, policy_version 1640900 (0.0005) [2023-12-28 07:01:35,989][106226] Updated weights for policy 0, policy_version 1637190 (0.0008) [2023-12-28 07:01:36,019][106225] Updated weights for policy 1, policy_version 1640910 (0.0005) [2023-12-28 07:01:36,043][106226] Updated weights for policy 0, policy_version 1637200 (0.0007) [2023-12-28 07:01:36,075][106225] Updated weights for policy 1, policy_version 1640920 (0.0005) [2023-12-28 07:01:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 839327744. Throughput: 0: 9784.2, 1: 9828.1. Samples: 839330720. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:36,175][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.839')] [2023-12-28 07:01:36,676][106226] Updated weights for policy 0, policy_version 1637210 (0.0005) [2023-12-28 07:01:36,735][106226] Updated weights for policy 0, policy_version 1637220 (0.0006) [2023-12-28 07:01:36,792][106226] Updated weights for policy 0, policy_version 1637230 (0.0009) [2023-12-28 07:01:36,842][106226] Updated weights for policy 0, policy_version 1637240 (0.0006) [2023-12-28 07:01:36,855][106225] Updated weights for policy 1, policy_version 1640930 (0.0008) [2023-12-28 07:01:36,909][106225] Updated weights for policy 1, policy_version 1640940 (0.0009) [2023-12-28 07:01:36,962][106225] Updated weights for policy 1, policy_version 1640950 (0.0008) [2023-12-28 07:01:37,496][106226] Updated weights for policy 0, policy_version 1637250 (0.0009) [2023-12-28 07:01:37,556][106226] Updated weights for policy 0, policy_version 1637260 (0.0009) [2023-12-28 07:01:37,609][106226] Updated weights for policy 0, policy_version 1637270 (0.0009) [2023-12-28 07:01:37,725][106225] Updated weights for policy 1, policy_version 1640960 (0.0008) [2023-12-28 07:01:37,791][106225] Updated weights for policy 1, policy_version 1640970 (0.0008) [2023-12-28 07:01:37,854][106225] Updated weights for policy 1, policy_version 1640980 (0.0009) [2023-12-28 07:01:38,417][106226] Updated weights for policy 0, policy_version 1637280 (0.0008) [2023-12-28 07:01:38,475][106226] Updated weights for policy 0, policy_version 1637290 (0.0009) [2023-12-28 07:01:38,530][106225] Updated weights for policy 1, policy_version 1640990 (0.0008) [2023-12-28 07:01:38,536][106226] Updated weights for policy 0, policy_version 1637300 (0.0008) [2023-12-28 07:01:38,593][106225] Updated weights for policy 1, policy_version 1641000 (0.0009) [2023-12-28 07:01:38,656][106225] Updated weights for policy 1, policy_version 1641010 (0.0008) [2023-12-28 07:01:39,293][106225] Updated weights for policy 1, policy_version 1641020 (0.0008) [2023-12-28 07:01:39,295][106226] Updated weights for policy 0, policy_version 1637310 (0.0009) [2023-12-28 07:01:39,361][106225] Updated weights for policy 1, policy_version 1641030 (0.0008) [2023-12-28 07:01:39,379][106226] Updated weights for policy 0, policy_version 1637320 (0.0009) [2023-12-28 07:01:39,431][106225] Updated weights for policy 1, policy_version 1641040 (0.0008) [2023-12-28 07:01:39,454][106226] Updated weights for policy 0, policy_version 1637330 (0.0009) [2023-12-28 07:01:40,195][106226] Updated weights for policy 0, policy_version 1637340 (0.0008) [2023-12-28 07:01:40,204][106225] Updated weights for policy 1, policy_version 1641050 (0.0008) [2023-12-28 07:01:40,263][106226] Updated weights for policy 0, policy_version 1637350 (0.0009) [2023-12-28 07:01:40,273][106225] Updated weights for policy 1, policy_version 1641060 (0.0006) [2023-12-28 07:01:40,325][106226] Updated weights for policy 0, policy_version 1637360 (0.0009) [2023-12-28 07:01:40,341][106225] Updated weights for policy 1, policy_version 1641070 (0.0007) [2023-12-28 07:01:40,404][106225] Updated weights for policy 1, policy_version 1641080 (0.0009) [2023-12-28 07:01:41,026][106226] Updated weights for policy 0, policy_version 1637370 (0.0010) [2023-12-28 07:01:41,099][106225] Updated weights for policy 1, policy_version 1641090 (0.0008) [2023-12-28 07:01:41,113][106226] Updated weights for policy 0, policy_version 1637380 (0.0007) [2023-12-28 07:01:41,173][106225] Updated weights for policy 1, policy_version 1641100 (0.0008) [2023-12-28 07:01:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 839409664. Throughput: 0: 9798.2, 1: 9813.5. Samples: 839388756. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:41,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.859')] [2023-12-28 07:01:41,180][106226] Updated weights for policy 0, policy_version 1637390 (0.0007) [2023-12-28 07:01:41,240][106225] Updated weights for policy 1, policy_version 1641110 (0.0007) [2023-12-28 07:01:41,245][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001637400_419250176.pth... [2023-12-28 07:01:41,246][106226] Updated weights for policy 0, policy_version 1637400 (0.0009) [2023-12-28 07:01:41,250][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001636248_418955264.pth [2023-12-28 07:01:41,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001641112_420175872.pth... [2023-12-28 07:01:41,258][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001639960_419880960.pth [2023-12-28 07:01:41,983][106225] Updated weights for policy 1, policy_version 1641120 (0.0006) [2023-12-28 07:01:41,993][106226] Updated weights for policy 0, policy_version 1637410 (0.0007) [2023-12-28 07:01:42,039][106225] Updated weights for policy 1, policy_version 1641130 (0.0006) [2023-12-28 07:01:42,053][106226] Updated weights for policy 0, policy_version 1637420 (0.0007) [2023-12-28 07:01:42,091][106225] Updated weights for policy 1, policy_version 1641140 (0.0008) [2023-12-28 07:01:42,116][106226] Updated weights for policy 0, policy_version 1637430 (0.0007) [2023-12-28 07:01:42,852][106226] Updated weights for policy 0, policy_version 1637440 (0.0009) [2023-12-28 07:01:42,852][106225] Updated weights for policy 1, policy_version 1641150 (0.0007) [2023-12-28 07:01:42,910][106225] Updated weights for policy 1, policy_version 1641160 (0.0006) [2023-12-28 07:01:42,921][106226] Updated weights for policy 0, policy_version 1637450 (0.0009) [2023-12-28 07:01:42,959][106225] Updated weights for policy 1, policy_version 1641170 (0.0007) [2023-12-28 07:01:42,984][106226] Updated weights for policy 0, policy_version 1637460 (0.0007) [2023-12-28 07:01:43,645][106225] Updated weights for policy 1, policy_version 1641180 (0.0008) [2023-12-28 07:01:43,702][106225] Updated weights for policy 1, policy_version 1641190 (0.0010) [2023-12-28 07:01:43,704][106226] Updated weights for policy 0, policy_version 1637470 (0.0007) [2023-12-28 07:01:43,763][106226] Updated weights for policy 0, policy_version 1637480 (0.0009) [2023-12-28 07:01:43,771][106225] Updated weights for policy 1, policy_version 1641200 (0.0010) [2023-12-28 07:01:43,812][106226] Updated weights for policy 0, policy_version 1637490 (0.0006) [2023-12-28 07:01:44,472][106225] Updated weights for policy 1, policy_version 1641210 (0.0010) [2023-12-28 07:01:44,536][106225] Updated weights for policy 1, policy_version 1641220 (0.0010) [2023-12-28 07:01:44,541][106226] Updated weights for policy 0, policy_version 1637500 (0.0008) [2023-12-28 07:01:44,590][106225] Updated weights for policy 1, policy_version 1641230 (0.0010) [2023-12-28 07:01:44,596][106226] Updated weights for policy 0, policy_version 1637510 (0.0006) [2023-12-28 07:01:44,649][106225] Updated weights for policy 1, policy_version 1641240 (0.0009) [2023-12-28 07:01:44,652][106226] Updated weights for policy 0, policy_version 1637520 (0.0006) [2023-12-28 07:01:45,380][106225] Updated weights for policy 1, policy_version 1641250 (0.0007) [2023-12-28 07:01:45,425][106226] Updated weights for policy 0, policy_version 1637530 (0.0007) [2023-12-28 07:01:45,437][106225] Updated weights for policy 1, policy_version 1641260 (0.0007) [2023-12-28 07:01:45,484][106226] Updated weights for policy 0, policy_version 1637540 (0.0007) [2023-12-28 07:01:45,493][106225] Updated weights for policy 1, policy_version 1641270 (0.0010) [2023-12-28 07:01:45,536][106226] Updated weights for policy 0, policy_version 1637550 (0.0007) [2023-12-28 07:01:45,596][106226] Updated weights for policy 0, policy_version 1637560 (0.0008) [2023-12-28 07:01:46,174][105115] Fps is (10 sec: 18022.5, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 839507968. Throughput: 0: 9797.6, 1: 9699.8. Samples: 839502496. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:46,175][105115] Avg episode reward: [(0, '-4.759'), (1, '-4.646')] [2023-12-28 07:01:46,196][106225] Updated weights for policy 1, policy_version 1641280 (0.0010) [2023-12-28 07:01:46,252][106225] Updated weights for policy 1, policy_version 1641290 (0.0010) [2023-12-28 07:01:46,302][106225] Updated weights for policy 1, policy_version 1641300 (0.0010) [2023-12-28 07:01:46,331][106226] Updated weights for policy 0, policy_version 1637570 (0.0005) [2023-12-28 07:01:46,393][106226] Updated weights for policy 0, policy_version 1637580 (0.0005) [2023-12-28 07:01:46,451][106226] Updated weights for policy 0, policy_version 1637590 (0.0005) [2023-12-28 07:01:46,942][106226] Updated weights for policy 0, policy_version 1637600 (0.0005) [2023-12-28 07:01:46,995][106226] Updated weights for policy 0, policy_version 1637610 (0.0007) [2023-12-28 07:01:47,008][106225] Updated weights for policy 1, policy_version 1641310 (0.0010) [2023-12-28 07:01:47,048][106226] Updated weights for policy 0, policy_version 1637620 (0.0005) [2023-12-28 07:01:47,065][106225] Updated weights for policy 1, policy_version 1641320 (0.0010) [2023-12-28 07:01:47,118][106225] Updated weights for policy 1, policy_version 1641330 (0.0010) [2023-12-28 07:01:47,759][106226] Updated weights for policy 0, policy_version 1637630 (0.0007) [2023-12-28 07:01:47,824][106226] Updated weights for policy 0, policy_version 1637640 (0.0007) [2023-12-28 07:01:47,839][106225] Updated weights for policy 1, policy_version 1641340 (0.0010) [2023-12-28 07:01:47,883][106226] Updated weights for policy 0, policy_version 1637650 (0.0009) [2023-12-28 07:01:47,889][106225] Updated weights for policy 1, policy_version 1641350 (0.0010) [2023-12-28 07:01:47,948][106225] Updated weights for policy 1, policy_version 1641360 (0.0010) [2023-12-28 07:01:48,598][106226] Updated weights for policy 0, policy_version 1637660 (0.0007) [2023-12-28 07:01:48,661][106225] Updated weights for policy 1, policy_version 1641370 (0.0010) [2023-12-28 07:01:48,662][106226] Updated weights for policy 0, policy_version 1637670 (0.0007) [2023-12-28 07:01:48,721][106225] Updated weights for policy 1, policy_version 1641380 (0.0010) [2023-12-28 07:01:48,727][106226] Updated weights for policy 0, policy_version 1637680 (0.0005) [2023-12-28 07:01:48,779][106225] Updated weights for policy 1, policy_version 1641390 (0.0010) [2023-12-28 07:01:48,840][106225] Updated weights for policy 1, policy_version 1641400 (0.0010) [2023-12-28 07:01:49,394][106226] Updated weights for policy 0, policy_version 1637690 (0.0006) [2023-12-28 07:01:49,456][106226] Updated weights for policy 0, policy_version 1637700 (0.0008) [2023-12-28 07:01:49,523][106226] Updated weights for policy 0, policy_version 1637710 (0.0008) [2023-12-28 07:01:49,579][106226] Updated weights for policy 0, policy_version 1637720 (0.0007) [2023-12-28 07:01:49,607][106225] Updated weights for policy 1, policy_version 1641410 (0.0010) [2023-12-28 07:01:49,666][106225] Updated weights for policy 1, policy_version 1641420 (0.0010) [2023-12-28 07:01:49,726][106225] Updated weights for policy 1, policy_version 1641430 (0.0010) [2023-12-28 07:01:50,223][106226] Updated weights for policy 0, policy_version 1637730 (0.0008) [2023-12-28 07:01:50,285][106226] Updated weights for policy 0, policy_version 1637740 (0.0010) [2023-12-28 07:01:50,345][106226] Updated weights for policy 0, policy_version 1637750 (0.0009) [2023-12-28 07:01:50,449][106225] Updated weights for policy 1, policy_version 1641440 (0.0009) [2023-12-28 07:01:50,506][106225] Updated weights for policy 1, policy_version 1641450 (0.0008) [2023-12-28 07:01:50,558][106225] Updated weights for policy 1, policy_version 1641460 (0.0008) [2023-12-28 07:01:51,090][106226] Updated weights for policy 0, policy_version 1637760 (0.0007) [2023-12-28 07:01:51,163][106226] Updated weights for policy 0, policy_version 1637770 (0.0008) [2023-12-28 07:01:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 839606272. Throughput: 0: 9841.2, 1: 9634.0. Samples: 839620700. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:51,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-4.991')] [2023-12-28 07:01:51,236][106226] Updated weights for policy 0, policy_version 1637780 (0.0007) [2023-12-28 07:01:51,335][106225] Updated weights for policy 1, policy_version 1641470 (0.0009) [2023-12-28 07:01:51,404][106225] Updated weights for policy 1, policy_version 1641480 (0.0008) [2023-12-28 07:01:51,463][106225] Updated weights for policy 1, policy_version 1641490 (0.0009) [2023-12-28 07:01:51,976][106226] Updated weights for policy 0, policy_version 1637790 (0.0008) [2023-12-28 07:01:52,042][106226] Updated weights for policy 0, policy_version 1637800 (0.0009) [2023-12-28 07:01:52,100][106226] Updated weights for policy 0, policy_version 1637810 (0.0008) [2023-12-28 07:01:52,223][106225] Updated weights for policy 1, policy_version 1641500 (0.0009) [2023-12-28 07:01:52,286][106225] Updated weights for policy 1, policy_version 1641510 (0.0007) [2023-12-28 07:01:52,354][106225] Updated weights for policy 1, policy_version 1641520 (0.0008) [2023-12-28 07:01:52,837][106226] Updated weights for policy 0, policy_version 1637820 (0.0009) [2023-12-28 07:01:52,886][106226] Updated weights for policy 0, policy_version 1637830 (0.0008) [2023-12-28 07:01:52,952][106226] Updated weights for policy 0, policy_version 1637840 (0.0009) [2023-12-28 07:01:53,061][106225] Updated weights for policy 1, policy_version 1641530 (0.0009) [2023-12-28 07:01:53,113][106225] Updated weights for policy 1, policy_version 1641540 (0.0009) [2023-12-28 07:01:53,170][106225] Updated weights for policy 1, policy_version 1641550 (0.0008) [2023-12-28 07:01:53,225][106225] Updated weights for policy 1, policy_version 1641560 (0.0008) [2023-12-28 07:01:53,657][106226] Updated weights for policy 0, policy_version 1637850 (0.0008) [2023-12-28 07:01:53,715][106226] Updated weights for policy 0, policy_version 1637860 (0.0005) [2023-12-28 07:01:53,779][106226] Updated weights for policy 0, policy_version 1637870 (0.0010) [2023-12-28 07:01:53,845][106226] Updated weights for policy 0, policy_version 1637880 (0.0009) [2023-12-28 07:01:53,928][106225] Updated weights for policy 1, policy_version 1641570 (0.0005) [2023-12-28 07:01:53,985][106225] Updated weights for policy 1, policy_version 1641580 (0.0005) [2023-12-28 07:01:54,041][106225] Updated weights for policy 1, policy_version 1641590 (0.0005) [2023-12-28 07:01:54,563][106226] Updated weights for policy 0, policy_version 1637890 (0.0005) [2023-12-28 07:01:54,629][106226] Updated weights for policy 0, policy_version 1637900 (0.0006) [2023-12-28 07:01:54,683][106225] Updated weights for policy 1, policy_version 1641600 (0.0006) [2023-12-28 07:01:54,690][106226] Updated weights for policy 0, policy_version 1637910 (0.0007) [2023-12-28 07:01:54,748][106225] Updated weights for policy 1, policy_version 1641610 (0.0008) [2023-12-28 07:01:54,799][106225] Updated weights for policy 1, policy_version 1641620 (0.0009) [2023-12-28 07:01:55,357][106226] Updated weights for policy 0, policy_version 1637920 (0.0009) [2023-12-28 07:01:55,368][106225] Updated weights for policy 1, policy_version 1641630 (0.0006) [2023-12-28 07:01:55,419][106225] Updated weights for policy 1, policy_version 1641640 (0.0006) [2023-12-28 07:01:55,424][106226] Updated weights for policy 0, policy_version 1637930 (0.0008) [2023-12-28 07:01:55,473][106225] Updated weights for policy 1, policy_version 1641650 (0.0006) [2023-12-28 07:01:55,486][106226] Updated weights for policy 0, policy_version 1637940 (0.0008) [2023-12-28 07:01:56,060][106225] Updated weights for policy 1, policy_version 1641660 (0.0006) [2023-12-28 07:01:56,121][106225] Updated weights for policy 1, policy_version 1641670 (0.0008) [2023-12-28 07:01:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 839704576. Throughput: 0: 9803.2, 1: 9654.6. Samples: 839677492. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:01:56,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.835')] [2023-12-28 07:01:56,180][106225] Updated weights for policy 1, policy_version 1641680 (0.0008) [2023-12-28 07:01:56,209][106226] Updated weights for policy 0, policy_version 1637950 (0.0008) [2023-12-28 07:01:56,221][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001641688_420323328.pth... [2023-12-28 07:01:56,224][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001640536_420028416.pth [2023-12-28 07:01:56,265][106226] Updated weights for policy 0, policy_version 1637960 (0.0009) [2023-12-28 07:01:56,314][106226] Updated weights for policy 0, policy_version 1637970 (0.0009) [2023-12-28 07:01:56,339][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001637976_419397632.pth... [2023-12-28 07:01:56,342][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001636792_419094528.pth [2023-12-28 07:01:56,742][106225] Updated weights for policy 1, policy_version 1641690 (0.0006) [2023-12-28 07:01:56,789][106225] Updated weights for policy 1, policy_version 1641700 (0.0008) [2023-12-28 07:01:56,834][106225] Updated weights for policy 1, policy_version 1641710 (0.0008) [2023-12-28 07:01:56,882][106225] Updated weights for policy 1, policy_version 1641720 (0.0009) [2023-12-28 07:01:57,111][106226] Updated weights for policy 0, policy_version 1637980 (0.0009) [2023-12-28 07:01:57,166][106226] Updated weights for policy 0, policy_version 1637990 (0.0010) [2023-12-28 07:01:57,226][106226] Updated weights for policy 0, policy_version 1638000 (0.0010) [2023-12-28 07:01:57,573][106225] Updated weights for policy 1, policy_version 1641730 (0.0008) [2023-12-28 07:01:57,624][106225] Updated weights for policy 1, policy_version 1641740 (0.0008) [2023-12-28 07:01:57,679][106225] Updated weights for policy 1, policy_version 1641750 (0.0008) [2023-12-28 07:01:57,905][106226] Updated weights for policy 0, policy_version 1638010 (0.0010) [2023-12-28 07:01:57,965][106226] Updated weights for policy 0, policy_version 1638020 (0.0007) [2023-12-28 07:01:58,024][106226] Updated weights for policy 0, policy_version 1638030 (0.0005) [2023-12-28 07:01:58,082][106226] Updated weights for policy 0, policy_version 1638040 (0.0005) [2023-12-28 07:01:58,466][106225] Updated weights for policy 1, policy_version 1641760 (0.0008) [2023-12-28 07:01:58,529][106225] Updated weights for policy 1, policy_version 1641770 (0.0008) [2023-12-28 07:01:58,592][106225] Updated weights for policy 1, policy_version 1641780 (0.0008) [2023-12-28 07:01:58,767][106226] Updated weights for policy 0, policy_version 1638050 (0.0009) [2023-12-28 07:01:58,840][106226] Updated weights for policy 0, policy_version 1638060 (0.0008) [2023-12-28 07:01:58,913][106226] Updated weights for policy 0, policy_version 1638070 (0.0008) [2023-12-28 07:01:59,459][106225] Updated weights for policy 1, policy_version 1641790 (0.0007) [2023-12-28 07:01:59,519][106225] Updated weights for policy 1, policy_version 1641800 (0.0007) [2023-12-28 07:01:59,576][106225] Updated weights for policy 1, policy_version 1641810 (0.0010) [2023-12-28 07:01:59,756][106226] Updated weights for policy 0, policy_version 1638080 (0.0008) [2023-12-28 07:01:59,812][106226] Updated weights for policy 0, policy_version 1638090 (0.0007) [2023-12-28 07:01:59,882][106226] Updated weights for policy 0, policy_version 1638100 (0.0009) [2023-12-28 07:02:00,303][106225] Updated weights for policy 1, policy_version 1641820 (0.0010) [2023-12-28 07:02:00,361][106225] Updated weights for policy 1, policy_version 1641830 (0.0006) [2023-12-28 07:02:00,417][106225] Updated weights for policy 1, policy_version 1641840 (0.0007) [2023-12-28 07:02:00,521][106226] Updated weights for policy 0, policy_version 1638110 (0.0009) [2023-12-28 07:02:00,576][106226] Updated weights for policy 0, policy_version 1638120 (0.0008) [2023-12-28 07:02:00,628][106226] Updated weights for policy 0, policy_version 1638130 (0.0009) [2023-12-28 07:02:01,138][106225] Updated weights for policy 1, policy_version 1641850 (0.0008) [2023-12-28 07:02:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 839802880. Throughput: 0: 9797.8, 1: 9756.7. Samples: 839795968. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:02:01,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.778')] [2023-12-28 07:02:01,211][106225] Updated weights for policy 1, policy_version 1641860 (0.0007) [2023-12-28 07:02:01,279][106225] Updated weights for policy 1, policy_version 1641870 (0.0009) [2023-12-28 07:02:01,345][106225] Updated weights for policy 1, policy_version 1641880 (0.0008) [2023-12-28 07:02:01,346][106226] Updated weights for policy 0, policy_version 1638140 (0.0008) [2023-12-28 07:02:01,416][106226] Updated weights for policy 0, policy_version 1638150 (0.0009) [2023-12-28 07:02:01,473][106226] Updated weights for policy 0, policy_version 1638160 (0.0009) [2023-12-28 07:02:02,061][106225] Updated weights for policy 1, policy_version 1641890 (0.0010) [2023-12-28 07:02:02,112][106225] Updated weights for policy 1, policy_version 1641900 (0.0010) [2023-12-28 07:02:02,123][106226] Updated weights for policy 0, policy_version 1638170 (0.0009) [2023-12-28 07:02:02,169][106226] Updated weights for policy 0, policy_version 1638180 (0.0007) [2023-12-28 07:02:02,173][106225] Updated weights for policy 1, policy_version 1641910 (0.0007) [2023-12-28 07:02:02,226][106226] Updated weights for policy 0, policy_version 1638190 (0.0008) [2023-12-28 07:02:02,292][106226] Updated weights for policy 0, policy_version 1638200 (0.0008) [2023-12-28 07:02:02,808][106225] Updated weights for policy 1, policy_version 1641920 (0.0006) [2023-12-28 07:02:02,871][106225] Updated weights for policy 1, policy_version 1641930 (0.0006) [2023-12-28 07:02:02,931][106225] Updated weights for policy 1, policy_version 1641940 (0.0005) [2023-12-28 07:02:03,034][106226] Updated weights for policy 0, policy_version 1638210 (0.0010) [2023-12-28 07:02:03,090][106226] Updated weights for policy 0, policy_version 1638220 (0.0010) [2023-12-28 07:02:03,139][106226] Updated weights for policy 0, policy_version 1638230 (0.0008) [2023-12-28 07:02:03,453][106225] Updated weights for policy 1, policy_version 1641950 (0.0005) [2023-12-28 07:02:03,506][106225] Updated weights for policy 1, policy_version 1641960 (0.0006) [2023-12-28 07:02:03,566][106225] Updated weights for policy 1, policy_version 1641970 (0.0005) [2023-12-28 07:02:03,748][106226] Updated weights for policy 0, policy_version 1638240 (0.0008) [2023-12-28 07:02:03,811][106226] Updated weights for policy 0, policy_version 1638250 (0.0008) [2023-12-28 07:02:03,874][106226] Updated weights for policy 0, policy_version 1638260 (0.0007) [2023-12-28 07:02:04,162][106225] Updated weights for policy 1, policy_version 1641980 (0.0006) [2023-12-28 07:02:04,211][106225] Updated weights for policy 1, policy_version 1641990 (0.0008) [2023-12-28 07:02:04,272][106225] Updated weights for policy 1, policy_version 1642000 (0.0008) [2023-12-28 07:02:04,497][106226] Updated weights for policy 0, policy_version 1638270 (0.0007) [2023-12-28 07:02:04,560][106226] Updated weights for policy 0, policy_version 1638280 (0.0011) [2023-12-28 07:02:04,620][106226] Updated weights for policy 0, policy_version 1638290 (0.0010) [2023-12-28 07:02:05,007][106225] Updated weights for policy 1, policy_version 1642010 (0.0008) [2023-12-28 07:02:05,064][106225] Updated weights for policy 1, policy_version 1642020 (0.0005) [2023-12-28 07:02:05,119][106225] Updated weights for policy 1, policy_version 1642030 (0.0005) [2023-12-28 07:02:05,180][106225] Updated weights for policy 1, policy_version 1642040 (0.0005) [2023-12-28 07:02:05,315][106226] Updated weights for policy 0, policy_version 1638300 (0.0011) [2023-12-28 07:02:05,381][106226] Updated weights for policy 0, policy_version 1638310 (0.0011) [2023-12-28 07:02:05,431][106226] Updated weights for policy 0, policy_version 1638320 (0.0010) [2023-12-28 07:02:05,870][106225] Updated weights for policy 1, policy_version 1642050 (0.0009) [2023-12-28 07:02:05,924][106225] Updated weights for policy 1, policy_version 1642060 (0.0009) [2023-12-28 07:02:05,976][106225] Updated weights for policy 1, policy_version 1642070 (0.0007) [2023-12-28 07:02:06,042][106226] Updated weights for policy 0, policy_version 1638330 (0.0009) [2023-12-28 07:02:06,132][106226] Updated weights for policy 0, policy_version 1638340 (0.0008) [2023-12-28 07:02:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 839909376. Throughput: 0: 9895.8, 1: 9842.5. Samples: 839920724. Policy #0 lag: (min: 13.0, avg: 18.3, max: 45.0) [2023-12-28 07:02:06,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.783')] [2023-12-28 07:02:06,192][106226] Updated weights for policy 0, policy_version 1638350 (0.0008) [2023-12-28 07:02:06,744][106225] Updated weights for policy 1, policy_version 1642080 (0.0008) [2023-12-28 07:02:06,795][106225] Updated weights for policy 1, policy_version 1642090 (0.0008) [2023-12-28 07:02:06,850][106225] Updated weights for policy 1, policy_version 1642100 (0.0008) [2023-12-28 07:02:06,886][106226] Updated weights for policy 0, policy_version 1638361 (0.0008) [2023-12-28 07:02:06,945][106226] Updated weights for policy 0, policy_version 1638371 (0.0006) [2023-12-28 07:02:07,000][106226] Updated weights for policy 0, policy_version 1638381 (0.0010) [2023-12-28 07:02:07,047][106226] Updated weights for policy 0, policy_version 1638391 (0.0010) [2023-12-28 07:02:07,635][106225] Updated weights for policy 1, policy_version 1642110 (0.0009) [2023-12-28 07:02:07,679][106225] Updated weights for policy 1, policy_version 1642120 (0.0010) [2023-12-28 07:02:07,725][106226] Updated weights for policy 0, policy_version 1638401 (0.0006) [2023-12-28 07:02:07,730][106225] Updated weights for policy 1, policy_version 1642130 (0.0010) [2023-12-28 07:02:07,776][106226] Updated weights for policy 0, policy_version 1638411 (0.0005) [2023-12-28 07:02:07,835][106226] Updated weights for policy 0, policy_version 1638421 (0.0008) [2023-12-28 07:02:08,477][106225] Updated weights for policy 1, policy_version 1642140 (0.0009) [2023-12-28 07:02:08,488][106226] Updated weights for policy 0, policy_version 1638431 (0.0009) [2023-12-28 07:02:08,533][106225] Updated weights for policy 1, policy_version 1642150 (0.0008) [2023-12-28 07:02:08,546][106226] Updated weights for policy 0, policy_version 1638441 (0.0010) [2023-12-28 07:02:08,592][106225] Updated weights for policy 1, policy_version 1642160 (0.0008) [2023-12-28 07:02:08,603][106226] Updated weights for policy 0, policy_version 1638451 (0.0011) [2023-12-28 07:02:09,200][106226] Updated weights for policy 0, policy_version 1638461 (0.0009) [2023-12-28 07:02:09,266][106226] Updated weights for policy 0, policy_version 1638471 (0.0008) [2023-12-28 07:02:09,281][106225] Updated weights for policy 1, policy_version 1642170 (0.0008) [2023-12-28 07:02:09,326][106226] Updated weights for policy 0, policy_version 1638481 (0.0006) [2023-12-28 07:02:09,343][106225] Updated weights for policy 1, policy_version 1642180 (0.0007) [2023-12-28 07:02:09,424][106225] Updated weights for policy 1, policy_version 1642190 (0.0009) [2023-12-28 07:02:09,482][106225] Updated weights for policy 1, policy_version 1642200 (0.0007) [2023-12-28 07:02:10,129][106226] Updated weights for policy 0, policy_version 1638491 (0.0008) [2023-12-28 07:02:10,141][106225] Updated weights for policy 1, policy_version 1642210 (0.0008) [2023-12-28 07:02:10,189][106226] Updated weights for policy 0, policy_version 1638501 (0.0008) [2023-12-28 07:02:10,202][106225] Updated weights for policy 1, policy_version 1642220 (0.0008) [2023-12-28 07:02:10,248][106226] Updated weights for policy 0, policy_version 1638511 (0.0008) [2023-12-28 07:02:10,262][106225] Updated weights for policy 1, policy_version 1642230 (0.0007) [2023-12-28 07:02:10,897][106226] Updated weights for policy 0, policy_version 1638521 (0.0007) [2023-12-28 07:02:10,955][106226] Updated weights for policy 0, policy_version 1638531 (0.0005) [2023-12-28 07:02:10,990][106225] Updated weights for policy 1, policy_version 1642240 (0.0010) [2023-12-28 07:02:11,025][106226] Updated weights for policy 0, policy_version 1638541 (0.0006) [2023-12-28 07:02:11,059][106225] Updated weights for policy 1, policy_version 1642250 (0.0011) [2023-12-28 07:02:11,093][106226] Updated weights for policy 0, policy_version 1638551 (0.0008) [2023-12-28 07:02:11,116][106225] Updated weights for policy 1, policy_version 1642260 (0.0006) [2023-12-28 07:02:11,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 840015872. Throughput: 0: 9948.7, 1: 9837.0. Samples: 839979508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:11,175][105115] Avg episode reward: [(0, '-4.659'), (1, '-4.639')] [2023-12-28 07:02:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001642264_420470784.pth... [2023-12-28 07:02:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001638552_419545088.pth... [2023-12-28 07:02:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001641112_420175872.pth [2023-12-28 07:02:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001637400_419250176.pth [2023-12-28 07:02:11,862][106226] Updated weights for policy 0, policy_version 1638561 (0.0008) [2023-12-28 07:02:11,911][106226] Updated weights for policy 0, policy_version 1638571 (0.0008) [2023-12-28 07:02:11,950][106225] Updated weights for policy 1, policy_version 1642270 (0.0008) [2023-12-28 07:02:11,960][106226] Updated weights for policy 0, policy_version 1638581 (0.0008) [2023-12-28 07:02:12,008][106225] Updated weights for policy 1, policy_version 1642280 (0.0007) [2023-12-28 07:02:12,059][106225] Updated weights for policy 1, policy_version 1642290 (0.0008) [2023-12-28 07:02:12,705][106226] Updated weights for policy 0, policy_version 1638591 (0.0008) [2023-12-28 07:02:12,761][106226] Updated weights for policy 0, policy_version 1638601 (0.0009) [2023-12-28 07:02:12,814][106226] Updated weights for policy 0, policy_version 1638611 (0.0008) [2023-12-28 07:02:12,840][106225] Updated weights for policy 1, policy_version 1642300 (0.0008) [2023-12-28 07:02:12,900][106225] Updated weights for policy 1, policy_version 1642310 (0.0008) [2023-12-28 07:02:12,950][106225] Updated weights for policy 1, policy_version 1642320 (0.0008) [2023-12-28 07:02:13,505][106226] Updated weights for policy 0, policy_version 1638621 (0.0008) [2023-12-28 07:02:13,566][106226] Updated weights for policy 0, policy_version 1638631 (0.0008) [2023-12-28 07:02:13,617][106226] Updated weights for policy 0, policy_version 1638641 (0.0008) [2023-12-28 07:02:13,695][106225] Updated weights for policy 1, policy_version 1642330 (0.0009) [2023-12-28 07:02:13,742][106225] Updated weights for policy 1, policy_version 1642340 (0.0008) [2023-12-28 07:02:13,789][106225] Updated weights for policy 1, policy_version 1642350 (0.0007) [2023-12-28 07:02:13,840][106225] Updated weights for policy 1, policy_version 1642360 (0.0005) [2023-12-28 07:02:14,376][106226] Updated weights for policy 0, policy_version 1638651 (0.0009) [2023-12-28 07:02:14,444][106226] Updated weights for policy 0, policy_version 1638661 (0.0008) [2023-12-28 07:02:14,501][106226] Updated weights for policy 0, policy_version 1638671 (0.0007) [2023-12-28 07:02:14,509][106225] Updated weights for policy 1, policy_version 1642370 (0.0009) [2023-12-28 07:02:14,568][106225] Updated weights for policy 1, policy_version 1642380 (0.0008) [2023-12-28 07:02:14,623][106225] Updated weights for policy 1, policy_version 1642390 (0.0008) [2023-12-28 07:02:15,270][106226] Updated weights for policy 0, policy_version 1638681 (0.0006) [2023-12-28 07:02:15,283][106225] Updated weights for policy 1, policy_version 1642400 (0.0008) [2023-12-28 07:02:15,329][106226] Updated weights for policy 0, policy_version 1638691 (0.0009) [2023-12-28 07:02:15,338][106225] Updated weights for policy 1, policy_version 1642410 (0.0008) [2023-12-28 07:02:15,388][106226] Updated weights for policy 0, policy_version 1638701 (0.0006) [2023-12-28 07:02:15,401][106225] Updated weights for policy 1, policy_version 1642420 (0.0006) [2023-12-28 07:02:15,451][106226] Updated weights for policy 0, policy_version 1638711 (0.0008) [2023-12-28 07:02:16,096][106225] Updated weights for policy 1, policy_version 1642430 (0.0008) [2023-12-28 07:02:16,150][106225] Updated weights for policy 1, policy_version 1642440 (0.0007) [2023-12-28 07:02:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 840097792. Throughput: 0: 9817.3, 1: 9747.7. Samples: 840093944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:16,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.642')] [2023-12-28 07:02:16,184][106226] Updated weights for policy 0, policy_version 1638721 (0.0008) [2023-12-28 07:02:16,210][106225] Updated weights for policy 1, policy_version 1642450 (0.0008) [2023-12-28 07:02:16,239][106226] Updated weights for policy 0, policy_version 1638731 (0.0008) [2023-12-28 07:02:16,295][106226] Updated weights for policy 0, policy_version 1638741 (0.0008) [2023-12-28 07:02:16,860][106225] Updated weights for policy 1, policy_version 1642460 (0.0007) [2023-12-28 07:02:16,920][106225] Updated weights for policy 1, policy_version 1642470 (0.0007) [2023-12-28 07:02:16,982][106225] Updated weights for policy 1, policy_version 1642480 (0.0008) [2023-12-28 07:02:17,061][106226] Updated weights for policy 0, policy_version 1638751 (0.0008) [2023-12-28 07:02:17,112][106226] Updated weights for policy 0, policy_version 1638761 (0.0008) [2023-12-28 07:02:17,173][106226] Updated weights for policy 0, policy_version 1638771 (0.0008) [2023-12-28 07:02:17,619][106225] Updated weights for policy 1, policy_version 1642490 (0.0008) [2023-12-28 07:02:17,666][106225] Updated weights for policy 1, policy_version 1642500 (0.0008) [2023-12-28 07:02:17,712][106225] Updated weights for policy 1, policy_version 1642510 (0.0008) [2023-12-28 07:02:17,760][106225] Updated weights for policy 1, policy_version 1642520 (0.0008) [2023-12-28 07:02:17,924][106226] Updated weights for policy 0, policy_version 1638781 (0.0009) [2023-12-28 07:02:17,977][106226] Updated weights for policy 0, policy_version 1638791 (0.0008) [2023-12-28 07:02:18,026][106226] Updated weights for policy 0, policy_version 1638801 (0.0009) [2023-12-28 07:02:18,563][106225] Updated weights for policy 1, policy_version 1642530 (0.0008) [2023-12-28 07:02:18,624][106225] Updated weights for policy 1, policy_version 1642540 (0.0009) [2023-12-28 07:02:18,678][106225] Updated weights for policy 1, policy_version 1642550 (0.0008) [2023-12-28 07:02:18,780][106226] Updated weights for policy 0, policy_version 1638811 (0.0009) [2023-12-28 07:02:18,834][106226] Updated weights for policy 0, policy_version 1638821 (0.0011) [2023-12-28 07:02:18,892][106226] Updated weights for policy 0, policy_version 1638831 (0.0009) [2023-12-28 07:02:19,481][106225] Updated weights for policy 1, policy_version 1642560 (0.0007) [2023-12-28 07:02:19,546][106225] Updated weights for policy 1, policy_version 1642570 (0.0008) [2023-12-28 07:02:19,589][106226] Updated weights for policy 0, policy_version 1638841 (0.0006) [2023-12-28 07:02:19,603][106225] Updated weights for policy 1, policy_version 1642580 (0.0007) [2023-12-28 07:02:19,640][106226] Updated weights for policy 0, policy_version 1638851 (0.0011) [2023-12-28 07:02:19,706][106226] Updated weights for policy 0, policy_version 1638861 (0.0011) [2023-12-28 07:02:19,757][106226] Updated weights for policy 0, policy_version 1638871 (0.0010) [2023-12-28 07:02:20,329][106225] Updated weights for policy 1, policy_version 1642590 (0.0008) [2023-12-28 07:02:20,392][106225] Updated weights for policy 1, policy_version 1642600 (0.0010) [2023-12-28 07:02:20,454][106225] Updated weights for policy 1, policy_version 1642610 (0.0006) [2023-12-28 07:02:20,546][106226] Updated weights for policy 0, policy_version 1638881 (0.0011) [2023-12-28 07:02:20,620][106226] Updated weights for policy 0, policy_version 1638891 (0.0009) [2023-12-28 07:02:20,675][106226] Updated weights for policy 0, policy_version 1638901 (0.0009) [2023-12-28 07:02:21,035][106225] Updated weights for policy 1, policy_version 1642620 (0.0008) [2023-12-28 07:02:21,101][106225] Updated weights for policy 1, policy_version 1642630 (0.0011) [2023-12-28 07:02:21,164][106225] Updated weights for policy 1, policy_version 1642640 (0.0010) [2023-12-28 07:02:21,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 840196096. Throughput: 0: 9709.3, 1: 9808.4. Samples: 840209020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:21,175][105115] Avg episode reward: [(0, '-4.630'), (1, '-4.584')] [2023-12-28 07:02:21,491][106226] Updated weights for policy 0, policy_version 1638911 (0.0008) [2023-12-28 07:02:21,550][106226] Updated weights for policy 0, policy_version 1638921 (0.0007) [2023-12-28 07:02:21,619][106226] Updated weights for policy 0, policy_version 1638931 (0.0008) [2023-12-28 07:02:21,926][106225] Updated weights for policy 1, policy_version 1642650 (0.0010) [2023-12-28 07:02:21,995][106225] Updated weights for policy 1, policy_version 1642660 (0.0008) [2023-12-28 07:02:22,057][106225] Updated weights for policy 1, policy_version 1642670 (0.0006) [2023-12-28 07:02:22,128][106225] Updated weights for policy 1, policy_version 1642680 (0.0006) [2023-12-28 07:02:22,362][106226] Updated weights for policy 0, policy_version 1638941 (0.0009) [2023-12-28 07:02:22,423][106226] Updated weights for policy 0, policy_version 1638951 (0.0007) [2023-12-28 07:02:22,482][106226] Updated weights for policy 0, policy_version 1638961 (0.0006) [2023-12-28 07:02:22,781][106225] Updated weights for policy 1, policy_version 1642690 (0.0008) [2023-12-28 07:02:22,839][106225] Updated weights for policy 1, policy_version 1642700 (0.0008) [2023-12-28 07:02:22,888][106225] Updated weights for policy 1, policy_version 1642710 (0.0009) [2023-12-28 07:02:23,126][106226] Updated weights for policy 0, policy_version 1638971 (0.0008) [2023-12-28 07:02:23,200][106226] Updated weights for policy 0, policy_version 1638981 (0.0009) [2023-12-28 07:02:23,262][106226] Updated weights for policy 0, policy_version 1638991 (0.0008) [2023-12-28 07:02:23,677][106225] Updated weights for policy 1, policy_version 1642720 (0.0008) [2023-12-28 07:02:23,746][106225] Updated weights for policy 1, policy_version 1642730 (0.0006) [2023-12-28 07:02:23,817][106225] Updated weights for policy 1, policy_version 1642740 (0.0008) [2023-12-28 07:02:23,879][106226] Updated weights for policy 0, policy_version 1639001 (0.0009) [2023-12-28 07:02:23,942][106226] Updated weights for policy 0, policy_version 1639011 (0.0007) [2023-12-28 07:02:24,011][106226] Updated weights for policy 0, policy_version 1639021 (0.0005) [2023-12-28 07:02:24,070][106226] Updated weights for policy 0, policy_version 1639031 (0.0008) [2023-12-28 07:02:24,393][106225] Updated weights for policy 1, policy_version 1642750 (0.0007) [2023-12-28 07:02:24,449][106225] Updated weights for policy 1, policy_version 1642760 (0.0005) [2023-12-28 07:02:24,497][106225] Updated weights for policy 1, policy_version 1642770 (0.0005) [2023-12-28 07:02:24,786][106226] Updated weights for policy 0, policy_version 1639041 (0.0009) [2023-12-28 07:02:24,833][106226] Updated weights for policy 0, policy_version 1639051 (0.0007) [2023-12-28 07:02:24,883][106226] Updated weights for policy 0, policy_version 1639061 (0.0010) [2023-12-28 07:02:25,045][106225] Updated weights for policy 1, policy_version 1642780 (0.0006) [2023-12-28 07:02:25,099][106225] Updated weights for policy 1, policy_version 1642790 (0.0005) [2023-12-28 07:02:25,147][106225] Updated weights for policy 1, policy_version 1642800 (0.0005) [2023-12-28 07:02:25,679][106226] Updated weights for policy 0, policy_version 1639071 (0.0008) [2023-12-28 07:02:25,731][106226] Updated weights for policy 0, policy_version 1639081 (0.0008) [2023-12-28 07:02:25,790][106226] Updated weights for policy 0, policy_version 1639091 (0.0008) [2023-12-28 07:02:25,818][106225] Updated weights for policy 1, policy_version 1642810 (0.0005) [2023-12-28 07:02:25,868][106225] Updated weights for policy 1, policy_version 1642820 (0.0008) [2023-12-28 07:02:25,929][106225] Updated weights for policy 1, policy_version 1642830 (0.0009) [2023-12-28 07:02:25,984][106225] Updated weights for policy 1, policy_version 1642840 (0.0008) [2023-12-28 07:02:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 840302592. Throughput: 0: 9730.4, 1: 9812.9. Samples: 840268204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:26,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-5.074')] [2023-12-28 07:02:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001642840_420618240.pth... [2023-12-28 07:02:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001639096_419684352.pth... [2023-12-28 07:02:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001641688_420323328.pth [2023-12-28 07:02:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001637976_419397632.pth [2023-12-28 07:02:26,520][106226] Updated weights for policy 0, policy_version 1639101 (0.0008) [2023-12-28 07:02:26,570][106226] Updated weights for policy 0, policy_version 1639111 (0.0009) [2023-12-28 07:02:26,625][106226] Updated weights for policy 0, policy_version 1639121 (0.0009) [2023-12-28 07:02:26,643][106225] Updated weights for policy 1, policy_version 1642850 (0.0007) [2023-12-28 07:02:26,694][106225] Updated weights for policy 1, policy_version 1642860 (0.0009) [2023-12-28 07:02:26,743][106225] Updated weights for policy 1, policy_version 1642871 (0.0008) [2023-12-28 07:02:27,317][106226] Updated weights for policy 0, policy_version 1639131 (0.0005) [2023-12-28 07:02:27,376][106226] Updated weights for policy 0, policy_version 1639141 (0.0007) [2023-12-28 07:02:27,425][106226] Updated weights for policy 0, policy_version 1639151 (0.0006) [2023-12-28 07:02:27,497][106225] Updated weights for policy 1, policy_version 1642881 (0.0007) [2023-12-28 07:02:27,545][106225] Updated weights for policy 1, policy_version 1642891 (0.0008) [2023-12-28 07:02:27,605][106225] Updated weights for policy 1, policy_version 1642901 (0.0008) [2023-12-28 07:02:28,115][106226] Updated weights for policy 0, policy_version 1639161 (0.0008) [2023-12-28 07:02:28,163][106226] Updated weights for policy 0, policy_version 1639171 (0.0008) [2023-12-28 07:02:28,211][106226] Updated weights for policy 0, policy_version 1639181 (0.0008) [2023-12-28 07:02:28,262][106226] Updated weights for policy 0, policy_version 1639191 (0.0008) [2023-12-28 07:02:28,338][106225] Updated weights for policy 1, policy_version 1642911 (0.0008) [2023-12-28 07:02:28,394][106225] Updated weights for policy 1, policy_version 1642921 (0.0007) [2023-12-28 07:02:28,446][106225] Updated weights for policy 1, policy_version 1642931 (0.0006) [2023-12-28 07:02:28,968][106226] Updated weights for policy 0, policy_version 1639201 (0.0008) [2023-12-28 07:02:29,026][106226] Updated weights for policy 0, policy_version 1639211 (0.0009) [2023-12-28 07:02:29,082][106226] Updated weights for policy 0, policy_version 1639221 (0.0008) [2023-12-28 07:02:29,150][106225] Updated weights for policy 1, policy_version 1642941 (0.0008) [2023-12-28 07:02:29,208][106225] Updated weights for policy 1, policy_version 1642951 (0.0008) [2023-12-28 07:02:29,272][106225] Updated weights for policy 1, policy_version 1642961 (0.0009) [2023-12-28 07:02:29,775][106226] Updated weights for policy 0, policy_version 1639231 (0.0009) [2023-12-28 07:02:29,843][106226] Updated weights for policy 0, policy_version 1639241 (0.0008) [2023-12-28 07:02:29,908][106226] Updated weights for policy 0, policy_version 1639251 (0.0011) [2023-12-28 07:02:30,126][106225] Updated weights for policy 1, policy_version 1642971 (0.0008) [2023-12-28 07:02:30,187][106225] Updated weights for policy 1, policy_version 1642981 (0.0006) [2023-12-28 07:02:30,254][106225] Updated weights for policy 1, policy_version 1642991 (0.0009) [2023-12-28 07:02:30,646][106226] Updated weights for policy 0, policy_version 1639261 (0.0008) [2023-12-28 07:02:30,706][106226] Updated weights for policy 0, policy_version 1639271 (0.0005) [2023-12-28 07:02:30,768][106226] Updated weights for policy 0, policy_version 1639281 (0.0007) [2023-12-28 07:02:30,982][106225] Updated weights for policy 1, policy_version 1643001 (0.0008) [2023-12-28 07:02:31,040][106225] Updated weights for policy 1, policy_version 1643011 (0.0006) [2023-12-28 07:02:31,102][106225] Updated weights for policy 1, policy_version 1643021 (0.0007) [2023-12-28 07:02:31,168][106225] Updated weights for policy 1, policy_version 1643031 (0.0009) [2023-12-28 07:02:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 840400896. Throughput: 0: 9787.4, 1: 9886.7. Samples: 840387836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:31,175][105115] Avg episode reward: [(0, '-4.664'), (1, '-4.714')] [2023-12-28 07:02:31,419][106226] Updated weights for policy 0, policy_version 1639291 (0.0008) [2023-12-28 07:02:31,475][106226] Updated weights for policy 0, policy_version 1639301 (0.0008) [2023-12-28 07:02:31,533][106226] Updated weights for policy 0, policy_version 1639311 (0.0008) [2023-12-28 07:02:31,925][106225] Updated weights for policy 1, policy_version 1643041 (0.0008) [2023-12-28 07:02:31,980][106225] Updated weights for policy 1, policy_version 1643051 (0.0008) [2023-12-28 07:02:32,038][106225] Updated weights for policy 1, policy_version 1643061 (0.0008) [2023-12-28 07:02:32,305][106226] Updated weights for policy 0, policy_version 1639321 (0.0007) [2023-12-28 07:02:32,366][106226] Updated weights for policy 0, policy_version 1639331 (0.0010) [2023-12-28 07:02:32,430][106226] Updated weights for policy 0, policy_version 1639341 (0.0008) [2023-12-28 07:02:32,483][106226] Updated weights for policy 0, policy_version 1639351 (0.0009) [2023-12-28 07:02:32,775][106225] Updated weights for policy 1, policy_version 1643071 (0.0006) [2023-12-28 07:02:32,833][106225] Updated weights for policy 1, policy_version 1643081 (0.0005) [2023-12-28 07:02:32,896][106225] Updated weights for policy 1, policy_version 1643091 (0.0005) [2023-12-28 07:02:33,231][106226] Updated weights for policy 0, policy_version 1639361 (0.0008) [2023-12-28 07:02:33,293][106226] Updated weights for policy 0, policy_version 1639371 (0.0011) [2023-12-28 07:02:33,338][106226] Updated weights for policy 0, policy_version 1639381 (0.0010) [2023-12-28 07:02:33,521][106225] Updated weights for policy 1, policy_version 1643101 (0.0007) [2023-12-28 07:02:33,583][106225] Updated weights for policy 1, policy_version 1643111 (0.0006) [2023-12-28 07:02:33,648][106225] Updated weights for policy 1, policy_version 1643121 (0.0005) [2023-12-28 07:02:33,982][106226] Updated weights for policy 0, policy_version 1639391 (0.0007) [2023-12-28 07:02:34,041][106226] Updated weights for policy 0, policy_version 1639401 (0.0005) [2023-12-28 07:02:34,096][106226] Updated weights for policy 0, policy_version 1639411 (0.0006) [2023-12-28 07:02:34,321][106225] Updated weights for policy 1, policy_version 1643131 (0.0007) [2023-12-28 07:02:34,386][106225] Updated weights for policy 1, policy_version 1643141 (0.0010) [2023-12-28 07:02:34,450][106225] Updated weights for policy 1, policy_version 1643151 (0.0010) [2023-12-28 07:02:34,657][106226] Updated weights for policy 0, policy_version 1639421 (0.0006) [2023-12-28 07:02:34,718][106226] Updated weights for policy 0, policy_version 1639431 (0.0008) [2023-12-28 07:02:34,775][106226] Updated weights for policy 0, policy_version 1639441 (0.0008) [2023-12-28 07:02:35,204][106225] Updated weights for policy 1, policy_version 1643161 (0.0011) [2023-12-28 07:02:35,262][106225] Updated weights for policy 1, policy_version 1643171 (0.0007) [2023-12-28 07:02:35,320][106225] Updated weights for policy 1, policy_version 1643181 (0.0009) [2023-12-28 07:02:35,351][106226] Updated weights for policy 0, policy_version 1639451 (0.0005) [2023-12-28 07:02:35,378][106225] Updated weights for policy 1, policy_version 1643191 (0.0009) [2023-12-28 07:02:35,401][106226] Updated weights for policy 0, policy_version 1639461 (0.0005) [2023-12-28 07:02:35,449][106226] Updated weights for policy 0, policy_version 1639471 (0.0005) [2023-12-28 07:02:36,136][106225] Updated weights for policy 1, policy_version 1643201 (0.0008) [2023-12-28 07:02:36,155][106226] Updated weights for policy 0, policy_version 1639481 (0.0010) [2023-12-28 07:02:36,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 840491008. Throughput: 0: 9815.3, 1: 9871.4. Samples: 840506600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:36,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-5.019')] [2023-12-28 07:02:36,192][106225] Updated weights for policy 1, policy_version 1643211 (0.0007) [2023-12-28 07:02:36,216][106226] Updated weights for policy 0, policy_version 1639491 (0.0011) [2023-12-28 07:02:36,254][106225] Updated weights for policy 1, policy_version 1643221 (0.0006) [2023-12-28 07:02:36,271][106226] Updated weights for policy 0, policy_version 1639501 (0.0010) [2023-12-28 07:02:36,326][106226] Updated weights for policy 0, policy_version 1639511 (0.0011) [2023-12-28 07:02:36,946][106225] Updated weights for policy 1, policy_version 1643231 (0.0009) [2023-12-28 07:02:37,004][106225] Updated weights for policy 1, policy_version 1643241 (0.0010) [2023-12-28 07:02:37,049][106225] Updated weights for policy 1, policy_version 1643251 (0.0010) [2023-12-28 07:02:37,071][106226] Updated weights for policy 0, policy_version 1639521 (0.0011) [2023-12-28 07:02:37,121][106226] Updated weights for policy 0, policy_version 1639531 (0.0010) [2023-12-28 07:02:37,179][106226] Updated weights for policy 0, policy_version 1639541 (0.0010) [2023-12-28 07:02:37,770][106225] Updated weights for policy 1, policy_version 1643261 (0.0011) [2023-12-28 07:02:37,834][106225] Updated weights for policy 1, policy_version 1643271 (0.0010) [2023-12-28 07:02:37,880][106225] Updated weights for policy 1, policy_version 1643281 (0.0006) [2023-12-28 07:02:37,884][106226] Updated weights for policy 0, policy_version 1639551 (0.0007) [2023-12-28 07:02:37,945][106226] Updated weights for policy 0, policy_version 1639561 (0.0005) [2023-12-28 07:02:38,009][106226] Updated weights for policy 0, policy_version 1639571 (0.0008) [2023-12-28 07:02:38,571][106225] Updated weights for policy 1, policy_version 1643291 (0.0005) [2023-12-28 07:02:38,627][106225] Updated weights for policy 1, policy_version 1643301 (0.0006) [2023-12-28 07:02:38,648][106226] Updated weights for policy 0, policy_version 1639581 (0.0007) [2023-12-28 07:02:38,676][106225] Updated weights for policy 1, policy_version 1643311 (0.0006) [2023-12-28 07:02:38,702][106226] Updated weights for policy 0, policy_version 1639591 (0.0009) [2023-12-28 07:02:38,757][106226] Updated weights for policy 0, policy_version 1639601 (0.0008) [2023-12-28 07:02:39,310][106225] Updated weights for policy 1, policy_version 1643321 (0.0006) [2023-12-28 07:02:39,387][106225] Updated weights for policy 1, policy_version 1643331 (0.0008) [2023-12-28 07:02:39,450][106225] Updated weights for policy 1, policy_version 1643341 (0.0007) [2023-12-28 07:02:39,513][106225] Updated weights for policy 1, policy_version 1643351 (0.0007) [2023-12-28 07:02:39,518][106226] Updated weights for policy 0, policy_version 1639611 (0.0008) [2023-12-28 07:02:39,570][106226] Updated weights for policy 0, policy_version 1639621 (0.0009) [2023-12-28 07:02:39,631][106226] Updated weights for policy 0, policy_version 1639631 (0.0009) [2023-12-28 07:02:40,212][106225] Updated weights for policy 1, policy_version 1643361 (0.0005) [2023-12-28 07:02:40,283][106225] Updated weights for policy 1, policy_version 1643371 (0.0007) [2023-12-28 07:02:40,343][106225] Updated weights for policy 1, policy_version 1643381 (0.0009) [2023-12-28 07:02:40,440][106226] Updated weights for policy 0, policy_version 1639641 (0.0009) [2023-12-28 07:02:40,510][106226] Updated weights for policy 0, policy_version 1639651 (0.0008) [2023-12-28 07:02:40,570][106226] Updated weights for policy 0, policy_version 1639661 (0.0008) [2023-12-28 07:02:40,630][106226] Updated weights for policy 0, policy_version 1639671 (0.0009) [2023-12-28 07:02:41,036][106225] Updated weights for policy 1, policy_version 1643391 (0.0009) [2023-12-28 07:02:41,097][106225] Updated weights for policy 1, policy_version 1643401 (0.0010) [2023-12-28 07:02:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 840589312. Throughput: 0: 9841.0, 1: 9906.5. Samples: 840566128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:41,175][105115] Avg episode reward: [(0, '-4.755'), (1, '-4.601')] [2023-12-28 07:02:41,177][106225] Updated weights for policy 1, policy_version 1643411 (0.0011) [2023-12-28 07:02:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001639672_419831808.pth... [2023-12-28 07:02:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001638552_419545088.pth [2023-12-28 07:02:41,205][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001643416_420765696.pth... [2023-12-28 07:02:41,209][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001642264_420470784.pth [2023-12-28 07:02:41,351][106226] Updated weights for policy 0, policy_version 1639681 (0.0008) [2023-12-28 07:02:41,414][106226] Updated weights for policy 0, policy_version 1639691 (0.0009) [2023-12-28 07:02:41,479][106226] Updated weights for policy 0, policy_version 1639701 (0.0008) [2023-12-28 07:02:41,910][106225] Updated weights for policy 1, policy_version 1643421 (0.0009) [2023-12-28 07:02:41,966][106225] Updated weights for policy 1, policy_version 1643431 (0.0007) [2023-12-28 07:02:42,024][106225] Updated weights for policy 1, policy_version 1643441 (0.0009) [2023-12-28 07:02:42,240][106226] Updated weights for policy 0, policy_version 1639711 (0.0007) [2023-12-28 07:02:42,302][106226] Updated weights for policy 0, policy_version 1639721 (0.0008) [2023-12-28 07:02:42,362][106226] Updated weights for policy 0, policy_version 1639731 (0.0009) [2023-12-28 07:02:42,749][106225] Updated weights for policy 1, policy_version 1643451 (0.0008) [2023-12-28 07:02:42,817][106225] Updated weights for policy 1, policy_version 1643461 (0.0007) [2023-12-28 07:02:42,881][106225] Updated weights for policy 1, policy_version 1643471 (0.0008) [2023-12-28 07:02:43,149][106226] Updated weights for policy 0, policy_version 1639741 (0.0008) [2023-12-28 07:02:43,213][106226] Updated weights for policy 0, policy_version 1639751 (0.0009) [2023-12-28 07:02:43,282][106226] Updated weights for policy 0, policy_version 1639761 (0.0010) [2023-12-28 07:02:43,447][106225] Updated weights for policy 1, policy_version 1643481 (0.0006) [2023-12-28 07:02:43,493][106225] Updated weights for policy 1, policy_version 1643491 (0.0005) [2023-12-28 07:02:43,540][106225] Updated weights for policy 1, policy_version 1643501 (0.0005) [2023-12-28 07:02:43,586][106225] Updated weights for policy 1, policy_version 1643511 (0.0005) [2023-12-28 07:02:43,981][106226] Updated weights for policy 0, policy_version 1639771 (0.0009) [2023-12-28 07:02:44,035][106226] Updated weights for policy 0, policy_version 1639781 (0.0011) [2023-12-28 07:02:44,086][106226] Updated weights for policy 0, policy_version 1639791 (0.0011) [2023-12-28 07:02:44,189][106225] Updated weights for policy 1, policy_version 1643521 (0.0007) [2023-12-28 07:02:44,248][106225] Updated weights for policy 1, policy_version 1643531 (0.0007) [2023-12-28 07:02:44,300][106225] Updated weights for policy 1, policy_version 1643541 (0.0008) [2023-12-28 07:02:44,813][106226] Updated weights for policy 0, policy_version 1639801 (0.0011) [2023-12-28 07:02:44,868][106226] Updated weights for policy 0, policy_version 1639811 (0.0010) [2023-12-28 07:02:44,932][106226] Updated weights for policy 0, policy_version 1639821 (0.0008) [2023-12-28 07:02:44,998][106226] Updated weights for policy 0, policy_version 1639831 (0.0010) [2023-12-28 07:02:45,084][106225] Updated weights for policy 1, policy_version 1643551 (0.0008) [2023-12-28 07:02:45,147][106225] Updated weights for policy 1, policy_version 1643561 (0.0005) [2023-12-28 07:02:45,209][106225] Updated weights for policy 1, policy_version 1643571 (0.0006) [2023-12-28 07:02:45,713][106226] Updated weights for policy 0, policy_version 1639841 (0.0008) [2023-12-28 07:02:45,771][106226] Updated weights for policy 0, policy_version 1639851 (0.0008) [2023-12-28 07:02:45,821][106225] Updated weights for policy 1, policy_version 1643581 (0.0008) [2023-12-28 07:02:45,827][106226] Updated weights for policy 0, policy_version 1639861 (0.0006) [2023-12-28 07:02:45,871][106225] Updated weights for policy 1, policy_version 1643591 (0.0010) [2023-12-28 07:02:45,928][106225] Updated weights for policy 1, policy_version 1643601 (0.0010) [2023-12-28 07:02:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 840695808. Throughput: 0: 9827.0, 1: 9874.7. Samples: 840682548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:46,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.665')] [2023-12-28 07:02:46,561][106226] Updated weights for policy 0, policy_version 1639871 (0.0006) [2023-12-28 07:02:46,630][106226] Updated weights for policy 0, policy_version 1639881 (0.0008) [2023-12-28 07:02:46,646][106225] Updated weights for policy 1, policy_version 1643611 (0.0009) [2023-12-28 07:02:46,690][106225] Updated weights for policy 1, policy_version 1643621 (0.0007) [2023-12-28 07:02:46,691][106226] Updated weights for policy 0, policy_version 1639891 (0.0007) [2023-12-28 07:02:46,737][106225] Updated weights for policy 1, policy_version 1643631 (0.0006) [2023-12-28 07:02:47,299][106225] Updated weights for policy 1, policy_version 1643641 (0.0005) [2023-12-28 07:02:47,361][106225] Updated weights for policy 1, policy_version 1643651 (0.0005) [2023-12-28 07:02:47,426][106225] Updated weights for policy 1, policy_version 1643661 (0.0005) [2023-12-28 07:02:47,488][106225] Updated weights for policy 1, policy_version 1643671 (0.0006) [2023-12-28 07:02:47,517][106226] Updated weights for policy 0, policy_version 1639901 (0.0008) [2023-12-28 07:02:47,562][106226] Updated weights for policy 0, policy_version 1639911 (0.0008) [2023-12-28 07:02:47,607][106226] Updated weights for policy 0, policy_version 1639921 (0.0008) [2023-12-28 07:02:48,166][106225] Updated weights for policy 1, policy_version 1643681 (0.0009) [2023-12-28 07:02:48,232][106225] Updated weights for policy 1, policy_version 1643691 (0.0008) [2023-12-28 07:02:48,258][106226] Updated weights for policy 0, policy_version 1639931 (0.0007) [2023-12-28 07:02:48,281][106225] Updated weights for policy 1, policy_version 1643701 (0.0007) [2023-12-28 07:02:48,313][106226] Updated weights for policy 0, policy_version 1639941 (0.0007) [2023-12-28 07:02:48,371][106226] Updated weights for policy 0, policy_version 1639951 (0.0009) [2023-12-28 07:02:48,980][106225] Updated weights for policy 1, policy_version 1643711 (0.0008) [2023-12-28 07:02:49,039][106225] Updated weights for policy 1, policy_version 1643721 (0.0009) [2023-12-28 07:02:49,090][106225] Updated weights for policy 1, policy_version 1643731 (0.0008) [2023-12-28 07:02:49,122][106226] Updated weights for policy 0, policy_version 1639961 (0.0008) [2023-12-28 07:02:49,185][106226] Updated weights for policy 0, policy_version 1639971 (0.0008) [2023-12-28 07:02:49,253][106226] Updated weights for policy 0, policy_version 1639981 (0.0008) [2023-12-28 07:02:49,314][106226] Updated weights for policy 0, policy_version 1639991 (0.0006) [2023-12-28 07:02:49,774][106225] Updated weights for policy 1, policy_version 1643741 (0.0008) [2023-12-28 07:02:49,833][106225] Updated weights for policy 1, policy_version 1643751 (0.0008) [2023-12-28 07:02:49,896][106225] Updated weights for policy 1, policy_version 1643761 (0.0009) [2023-12-28 07:02:50,068][106226] Updated weights for policy 0, policy_version 1640001 (0.0008) [2023-12-28 07:02:50,131][106226] Updated weights for policy 0, policy_version 1640011 (0.0007) [2023-12-28 07:02:50,186][106226] Updated weights for policy 0, policy_version 1640021 (0.0005) [2023-12-28 07:02:50,616][106225] Updated weights for policy 1, policy_version 1643771 (0.0008) [2023-12-28 07:02:50,680][106225] Updated weights for policy 1, policy_version 1643781 (0.0008) [2023-12-28 07:02:50,748][106225] Updated weights for policy 1, policy_version 1643791 (0.0009) [2023-12-28 07:02:50,868][106226] Updated weights for policy 0, policy_version 1640031 (0.0008) [2023-12-28 07:02:50,923][106226] Updated weights for policy 0, policy_version 1640041 (0.0009) [2023-12-28 07:02:50,974][106226] Updated weights for policy 0, policy_version 1640051 (0.0010) [2023-12-28 07:02:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 840794112. Throughput: 0: 9695.0, 1: 9856.7. Samples: 840800552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:51,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-4.966')] [2023-12-28 07:02:51,476][106225] Updated weights for policy 1, policy_version 1643801 (0.0009) [2023-12-28 07:02:51,539][106225] Updated weights for policy 1, policy_version 1643811 (0.0008) [2023-12-28 07:02:51,566][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000003 [2023-12-28 07:02:51,774][106226] Updated weights for policy 0, policy_version 1640061 (0.0011) [2023-12-28 07:02:51,835][106226] Updated weights for policy 0, policy_version 1640071 (0.0009) [2023-12-28 07:02:51,896][106226] Updated weights for policy 0, policy_version 1640081 (0.0008) [2023-12-28 07:02:52,273][106225] Updated weights for policy 1, policy_version 1643821 (0.0007) [2023-12-28 07:02:52,319][106225] Updated weights for policy 1, policy_version 1643831 (0.0008) [2023-12-28 07:02:52,385][106225] Updated weights for policy 1, policy_version 1643841 (0.0007) [2023-12-28 07:02:52,619][106226] Updated weights for policy 0, policy_version 1640091 (0.0009) [2023-12-28 07:02:52,673][106226] Updated weights for policy 0, policy_version 1640101 (0.0005) [2023-12-28 07:02:52,735][106226] Updated weights for policy 0, policy_version 1640111 (0.0007) [2023-12-28 07:02:53,009][106225] Updated weights for policy 1, policy_version 1643851 (0.0007) [2023-12-28 07:02:53,080][106225] Updated weights for policy 1, policy_version 1643861 (0.0008) [2023-12-28 07:02:53,133][106225] Updated weights for policy 1, policy_version 1643871 (0.0010) [2023-12-28 07:02:53,366][106226] Updated weights for policy 0, policy_version 1640121 (0.0008) [2023-12-28 07:02:53,430][106226] Updated weights for policy 0, policy_version 1640131 (0.0007) [2023-12-28 07:02:53,504][106226] Updated weights for policy 0, policy_version 1640141 (0.0010) [2023-12-28 07:02:53,568][106226] Updated weights for policy 0, policy_version 1640151 (0.0009) [2023-12-28 07:02:53,864][106225] Updated weights for policy 1, policy_version 1643881 (0.0009) [2023-12-28 07:02:53,919][106225] Updated weights for policy 1, policy_version 1643891 (0.0008) [2023-12-28 07:02:53,973][106225] Updated weights for policy 1, policy_version 1643901 (0.0010) [2023-12-28 07:02:54,018][106225] Updated weights for policy 1, policy_version 1643911 (0.0010) [2023-12-28 07:02:54,293][106226] Updated weights for policy 0, policy_version 1640161 (0.0008) [2023-12-28 07:02:54,352][106226] Updated weights for policy 0, policy_version 1640171 (0.0008) [2023-12-28 07:02:54,399][106226] Updated weights for policy 0, policy_version 1640181 (0.0008) [2023-12-28 07:02:54,731][106225] Updated weights for policy 1, policy_version 1643921 (0.0010) [2023-12-28 07:02:54,791][106225] Updated weights for policy 1, policy_version 1643931 (0.0010) [2023-12-28 07:02:54,840][106225] Updated weights for policy 1, policy_version 1643941 (0.0010) [2023-12-28 07:02:55,082][106226] Updated weights for policy 0, policy_version 1640191 (0.0007) [2023-12-28 07:02:55,139][106226] Updated weights for policy 0, policy_version 1640201 (0.0008) [2023-12-28 07:02:55,186][106226] Updated weights for policy 0, policy_version 1640211 (0.0008) [2023-12-28 07:02:55,497][106225] Updated weights for policy 1, policy_version 1643951 (0.0010) [2023-12-28 07:02:55,554][106225] Updated weights for policy 1, policy_version 1643961 (0.0010) [2023-12-28 07:02:55,614][106225] Updated weights for policy 1, policy_version 1643971 (0.0010) [2023-12-28 07:02:55,915][106226] Updated weights for policy 0, policy_version 1640221 (0.0007) [2023-12-28 07:02:55,962][106226] Updated weights for policy 0, policy_version 1640232 (0.0007) [2023-12-28 07:02:56,013][106226] Updated weights for policy 0, policy_version 1640242 (0.0005) [2023-12-28 07:02:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 840892416. Throughput: 0: 9638.0, 1: 9925.1. Samples: 840859852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:02:56,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.645')] [2023-12-28 07:02:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001643976_420913152.pth... [2023-12-28 07:02:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001640248_419979264.pth... [2023-12-28 07:02:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001639096_419684352.pth [2023-12-28 07:02:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001642840_420618240.pth [2023-12-28 07:02:56,338][106225] Updated weights for policy 1, policy_version 1643981 (0.0010) [2023-12-28 07:02:56,396][106225] Updated weights for policy 1, policy_version 1643991 (0.0008) [2023-12-28 07:02:56,458][106225] Updated weights for policy 1, policy_version 1644001 (0.0005) [2023-12-28 07:02:56,656][106226] Updated weights for policy 0, policy_version 1640252 (0.0007) [2023-12-28 07:02:56,705][106226] Updated weights for policy 0, policy_version 1640262 (0.0008) [2023-12-28 07:02:56,757][106226] Updated weights for policy 0, policy_version 1640272 (0.0009) [2023-12-28 07:02:57,035][106225] Updated weights for policy 1, policy_version 1644011 (0.0007) [2023-12-28 07:02:57,095][106225] Updated weights for policy 1, policy_version 1644021 (0.0010) [2023-12-28 07:02:57,145][106225] Updated weights for policy 1, policy_version 1644031 (0.0010) [2023-12-28 07:02:57,441][106226] Updated weights for policy 0, policy_version 1640282 (0.0008) [2023-12-28 07:02:57,490][106226] Updated weights for policy 0, policy_version 1640292 (0.0010) [2023-12-28 07:02:57,536][106226] Updated weights for policy 0, policy_version 1640302 (0.0010) [2023-12-28 07:02:57,581][106226] Updated weights for policy 0, policy_version 1640312 (0.0006) [2023-12-28 07:02:57,841][106225] Updated weights for policy 1, policy_version 1644041 (0.0010) [2023-12-28 07:02:57,903][106225] Updated weights for policy 1, policy_version 1644051 (0.0010) [2023-12-28 07:02:57,952][106225] Updated weights for policy 1, policy_version 1644061 (0.0010) [2023-12-28 07:02:57,998][106225] Updated weights for policy 1, policy_version 1644071 (0.0010) [2023-12-28 07:02:58,275][106226] Updated weights for policy 0, policy_version 1640322 (0.0010) [2023-12-28 07:02:58,331][106226] Updated weights for policy 0, policy_version 1640332 (0.0010) [2023-12-28 07:02:58,400][106226] Updated weights for policy 0, policy_version 1640342 (0.0010) [2023-12-28 07:02:58,785][106225] Updated weights for policy 1, policy_version 1644081 (0.0009) [2023-12-28 07:02:58,850][106225] Updated weights for policy 1, policy_version 1644091 (0.0009) [2023-12-28 07:02:58,918][106225] Updated weights for policy 1, policy_version 1644101 (0.0008) [2023-12-28 07:02:59,245][106226] Updated weights for policy 0, policy_version 1640352 (0.0010) [2023-12-28 07:02:59,314][106226] Updated weights for policy 0, policy_version 1640362 (0.0012) [2023-12-28 07:02:59,386][106226] Updated weights for policy 0, policy_version 1640372 (0.0010) [2023-12-28 07:02:59,636][106225] Updated weights for policy 1, policy_version 1644111 (0.0006) [2023-12-28 07:02:59,700][106225] Updated weights for policy 1, policy_version 1644121 (0.0009) [2023-12-28 07:02:59,767][106225] Updated weights for policy 1, policy_version 1644131 (0.0010) [2023-12-28 07:03:00,088][106226] Updated weights for policy 0, policy_version 1640382 (0.0006) [2023-12-28 07:03:00,151][106226] Updated weights for policy 0, policy_version 1640392 (0.0006) [2023-12-28 07:03:00,212][106226] Updated weights for policy 0, policy_version 1640402 (0.0008) [2023-12-28 07:03:00,447][106225] Updated weights for policy 1, policy_version 1644141 (0.0010) [2023-12-28 07:03:00,509][106225] Updated weights for policy 1, policy_version 1644151 (0.0010) [2023-12-28 07:03:00,572][106225] Updated weights for policy 1, policy_version 1644161 (0.0010) [2023-12-28 07:03:00,868][106226] Updated weights for policy 0, policy_version 1640412 (0.0007) [2023-12-28 07:03:00,928][106226] Updated weights for policy 0, policy_version 1640422 (0.0008) [2023-12-28 07:03:00,973][106226] Updated weights for policy 0, policy_version 1640432 (0.0009) [2023-12-28 07:03:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 840990720. Throughput: 0: 9697.8, 1: 9973.2. Samples: 840979140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:01,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.621')] [2023-12-28 07:03:01,379][106225] Updated weights for policy 1, policy_version 1644171 (0.0010) [2023-12-28 07:03:01,454][106225] Updated weights for policy 1, policy_version 1644181 (0.0007) [2023-12-28 07:03:01,507][106225] Updated weights for policy 1, policy_version 1644191 (0.0005) [2023-12-28 07:03:01,711][106226] Updated weights for policy 0, policy_version 1640442 (0.0008) [2023-12-28 07:03:01,774][106226] Updated weights for policy 0, policy_version 1640452 (0.0008) [2023-12-28 07:03:01,829][106226] Updated weights for policy 0, policy_version 1640462 (0.0008) [2023-12-28 07:03:01,880][106226] Updated weights for policy 0, policy_version 1640472 (0.0008) [2023-12-28 07:03:02,216][106225] Updated weights for policy 1, policy_version 1644201 (0.0007) [2023-12-28 07:03:02,286][106225] Updated weights for policy 1, policy_version 1644211 (0.0010) [2023-12-28 07:03:02,350][106225] Updated weights for policy 1, policy_version 1644221 (0.0010) [2023-12-28 07:03:02,415][106225] Updated weights for policy 1, policy_version 1644231 (0.0008) [2023-12-28 07:03:02,643][106226] Updated weights for policy 0, policy_version 1640482 (0.0008) [2023-12-28 07:03:02,707][106226] Updated weights for policy 0, policy_version 1640492 (0.0007) [2023-12-28 07:03:02,772][106226] Updated weights for policy 0, policy_version 1640502 (0.0008) [2023-12-28 07:03:03,128][106225] Updated weights for policy 1, policy_version 1644241 (0.0010) [2023-12-28 07:03:03,182][106225] Updated weights for policy 1, policy_version 1644251 (0.0010) [2023-12-28 07:03:03,235][106225] Updated weights for policy 1, policy_version 1644261 (0.0010) [2023-12-28 07:03:03,494][106226] Updated weights for policy 0, policy_version 1640512 (0.0008) [2023-12-28 07:03:03,545][106226] Updated weights for policy 0, policy_version 1640522 (0.0008) [2023-12-28 07:03:03,601][106226] Updated weights for policy 0, policy_version 1640532 (0.0008) [2023-12-28 07:03:03,813][106225] Updated weights for policy 1, policy_version 1644271 (0.0010) [2023-12-28 07:03:03,872][106225] Updated weights for policy 1, policy_version 1644281 (0.0010) [2023-12-28 07:03:03,930][106225] Updated weights for policy 1, policy_version 1644291 (0.0009) [2023-12-28 07:03:04,339][106226] Updated weights for policy 0, policy_version 1640542 (0.0009) [2023-12-28 07:03:04,406][106226] Updated weights for policy 0, policy_version 1640552 (0.0009) [2023-12-28 07:03:04,467][106226] Updated weights for policy 0, policy_version 1640562 (0.0009) [2023-12-28 07:03:04,630][106225] Updated weights for policy 1, policy_version 1644301 (0.0009) [2023-12-28 07:03:04,685][106225] Updated weights for policy 1, policy_version 1644311 (0.0005) [2023-12-28 07:03:04,735][106225] Updated weights for policy 1, policy_version 1644321 (0.0005) [2023-12-28 07:03:05,213][106226] Updated weights for policy 0, policy_version 1640572 (0.0008) [2023-12-28 07:03:05,276][106226] Updated weights for policy 0, policy_version 1640582 (0.0007) [2023-12-28 07:03:05,338][106226] Updated weights for policy 0, policy_version 1640592 (0.0008) [2023-12-28 07:03:05,434][106225] Updated weights for policy 1, policy_version 1644331 (0.0009) [2023-12-28 07:03:05,496][106225] Updated weights for policy 1, policy_version 1644341 (0.0010) [2023-12-28 07:03:05,543][106225] Updated weights for policy 1, policy_version 1644351 (0.0010) [2023-12-28 07:03:06,075][106226] Updated weights for policy 0, policy_version 1640602 (0.0008) [2023-12-28 07:03:06,135][106226] Updated weights for policy 0, policy_version 1640612 (0.0008) [2023-12-28 07:03:06,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 841080832. Throughput: 0: 9736.4, 1: 9975.1. Samples: 841096036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:06,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.939')] [2023-12-28 07:03:06,193][106226] Updated weights for policy 0, policy_version 1640622 (0.0008) [2023-12-28 07:03:06,246][106226] Updated weights for policy 0, policy_version 1640632 (0.0007) [2023-12-28 07:03:06,272][106225] Updated weights for policy 1, policy_version 1644361 (0.0010) [2023-12-28 07:03:06,327][106225] Updated weights for policy 1, policy_version 1644371 (0.0011) [2023-12-28 07:03:06,392][106225] Updated weights for policy 1, policy_version 1644381 (0.0011) [2023-12-28 07:03:06,446][106225] Updated weights for policy 1, policy_version 1644391 (0.0011) [2023-12-28 07:03:06,939][106226] Updated weights for policy 0, policy_version 1640642 (0.0006) [2023-12-28 07:03:07,010][106226] Updated weights for policy 0, policy_version 1640652 (0.0006) [2023-12-28 07:03:07,078][106226] Updated weights for policy 0, policy_version 1640662 (0.0006) [2023-12-28 07:03:07,135][106225] Updated weights for policy 1, policy_version 1644401 (0.0009) [2023-12-28 07:03:07,183][106225] Updated weights for policy 1, policy_version 1644411 (0.0005) [2023-12-28 07:03:07,237][106225] Updated weights for policy 1, policy_version 1644421 (0.0006) [2023-12-28 07:03:07,644][106226] Updated weights for policy 0, policy_version 1640672 (0.0008) [2023-12-28 07:03:07,705][106226] Updated weights for policy 0, policy_version 1640682 (0.0008) [2023-12-28 07:03:07,768][106226] Updated weights for policy 0, policy_version 1640692 (0.0009) [2023-12-28 07:03:07,826][106225] Updated weights for policy 1, policy_version 1644431 (0.0008) [2023-12-28 07:03:07,871][106225] Updated weights for policy 1, policy_version 1644441 (0.0008) [2023-12-28 07:03:07,918][106225] Updated weights for policy 1, policy_version 1644451 (0.0008) [2023-12-28 07:03:08,515][106226] Updated weights for policy 0, policy_version 1640702 (0.0008) [2023-12-28 07:03:08,585][106226] Updated weights for policy 0, policy_version 1640712 (0.0008) [2023-12-28 07:03:08,633][106225] Updated weights for policy 1, policy_version 1644461 (0.0007) [2023-12-28 07:03:08,650][106226] Updated weights for policy 0, policy_version 1640722 (0.0009) [2023-12-28 07:03:08,698][106225] Updated weights for policy 1, policy_version 1644471 (0.0007) [2023-12-28 07:03:08,756][106225] Updated weights for policy 1, policy_version 1644481 (0.0009) [2023-12-28 07:03:09,363][106226] Updated weights for policy 0, policy_version 1640732 (0.0008) [2023-12-28 07:03:09,437][106226] Updated weights for policy 0, policy_version 1640742 (0.0009) [2023-12-28 07:03:09,496][106226] Updated weights for policy 0, policy_version 1640752 (0.0011) [2023-12-28 07:03:09,554][106225] Updated weights for policy 1, policy_version 1644491 (0.0008) [2023-12-28 07:03:09,617][106225] Updated weights for policy 1, policy_version 1644501 (0.0008) [2023-12-28 07:03:09,675][106225] Updated weights for policy 1, policy_version 1644511 (0.0007) [2023-12-28 07:03:10,252][106226] Updated weights for policy 0, policy_version 1640762 (0.0011) [2023-12-28 07:03:10,307][106226] Updated weights for policy 0, policy_version 1640772 (0.0011) [2023-12-28 07:03:10,365][106226] Updated weights for policy 0, policy_version 1640782 (0.0011) [2023-12-28 07:03:10,382][106225] Updated weights for policy 1, policy_version 1644521 (0.0007) [2023-12-28 07:03:10,427][106226] Updated weights for policy 0, policy_version 1640792 (0.0011) [2023-12-28 07:03:10,434][106225] Updated weights for policy 1, policy_version 1644531 (0.0010) [2023-12-28 07:03:10,485][106225] Updated weights for policy 1, policy_version 1644541 (0.0010) [2023-12-28 07:03:10,542][106225] Updated weights for policy 1, policy_version 1644551 (0.0010) [2023-12-28 07:03:11,097][106226] Updated weights for policy 0, policy_version 1640802 (0.0010) [2023-12-28 07:03:11,158][106226] Updated weights for policy 0, policy_version 1640812 (0.0010) [2023-12-28 07:03:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 841179136. Throughput: 0: 9725.5, 1: 10021.2. Samples: 841156808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:11,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.644')] [2023-12-28 07:03:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001644552_421060608.pth... [2023-12-28 07:03:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001643416_420765696.pth [2023-12-28 07:03:11,230][106226] Updated weights for policy 0, policy_version 1640822 (0.0011) [2023-12-28 07:03:11,243][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001640824_420126720.pth... [2023-12-28 07:03:11,247][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001639672_419831808.pth [2023-12-28 07:03:11,294][106225] Updated weights for policy 1, policy_version 1644561 (0.0010) [2023-12-28 07:03:11,366][106225] Updated weights for policy 1, policy_version 1644571 (0.0012) [2023-12-28 07:03:11,430][106225] Updated weights for policy 1, policy_version 1644581 (0.0009) [2023-12-28 07:03:12,011][106226] Updated weights for policy 0, policy_version 1640832 (0.0008) [2023-12-28 07:03:12,073][106226] Updated weights for policy 0, policy_version 1640842 (0.0007) [2023-12-28 07:03:12,129][106226] Updated weights for policy 0, policy_version 1640852 (0.0008) [2023-12-28 07:03:12,184][106225] Updated weights for policy 1, policy_version 1644591 (0.0010) [2023-12-28 07:03:12,238][106225] Updated weights for policy 1, policy_version 1644601 (0.0010) [2023-12-28 07:03:12,308][106225] Updated weights for policy 1, policy_version 1644611 (0.0011) [2023-12-28 07:03:12,915][106226] Updated weights for policy 0, policy_version 1640862 (0.0009) [2023-12-28 07:03:12,969][106226] Updated weights for policy 0, policy_version 1640872 (0.0010) [2023-12-28 07:03:13,019][106226] Updated weights for policy 0, policy_version 1640882 (0.0010) [2023-12-28 07:03:13,030][106225] Updated weights for policy 1, policy_version 1644621 (0.0010) [2023-12-28 07:03:13,087][106225] Updated weights for policy 1, policy_version 1644631 (0.0010) [2023-12-28 07:03:13,147][106225] Updated weights for policy 1, policy_version 1644641 (0.0010) [2023-12-28 07:03:13,627][106226] Updated weights for policy 0, policy_version 1640892 (0.0009) [2023-12-28 07:03:13,698][106226] Updated weights for policy 0, policy_version 1640902 (0.0005) [2023-12-28 07:03:13,763][106226] Updated weights for policy 0, policy_version 1640912 (0.0007) [2023-12-28 07:03:13,798][106225] Updated weights for policy 1, policy_version 1644651 (0.0009) [2023-12-28 07:03:13,856][106225] Updated weights for policy 1, policy_version 1644661 (0.0005) [2023-12-28 07:03:13,909][106225] Updated weights for policy 1, policy_version 1644671 (0.0007) [2023-12-28 07:03:14,417][106226] Updated weights for policy 0, policy_version 1640922 (0.0011) [2023-12-28 07:03:14,463][106226] Updated weights for policy 0, policy_version 1640932 (0.0008) [2023-12-28 07:03:14,510][106226] Updated weights for policy 0, policy_version 1640942 (0.0006) [2023-12-28 07:03:14,564][106226] Updated weights for policy 0, policy_version 1640952 (0.0006) [2023-12-28 07:03:14,624][106225] Updated weights for policy 1, policy_version 1644681 (0.0007) [2023-12-28 07:03:14,680][106225] Updated weights for policy 1, policy_version 1644691 (0.0009) [2023-12-28 07:03:14,731][106225] Updated weights for policy 1, policy_version 1644701 (0.0008) [2023-12-28 07:03:14,791][106225] Updated weights for policy 1, policy_version 1644711 (0.0008) [2023-12-28 07:03:15,310][106226] Updated weights for policy 0, policy_version 1640962 (0.0011) [2023-12-28 07:03:15,372][106226] Updated weights for policy 0, policy_version 1640972 (0.0009) [2023-12-28 07:03:15,437][106226] Updated weights for policy 0, policy_version 1640982 (0.0011) [2023-12-28 07:03:15,554][106225] Updated weights for policy 1, policy_version 1644721 (0.0008) [2023-12-28 07:03:15,613][106225] Updated weights for policy 1, policy_version 1644731 (0.0009) [2023-12-28 07:03:15,677][106225] Updated weights for policy 1, policy_version 1644741 (0.0009) [2023-12-28 07:03:16,003][106226] Updated weights for policy 0, policy_version 1640992 (0.0006) [2023-12-28 07:03:16,063][106226] Updated weights for policy 0, policy_version 1641002 (0.0005) [2023-12-28 07:03:16,117][106226] Updated weights for policy 0, policy_version 1641012 (0.0008) [2023-12-28 07:03:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 841285632. Throughput: 0: 9737.5, 1: 9925.4. Samples: 841272660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:16,175][105115] Avg episode reward: [(0, '-4.730'), (1, '-4.668')] [2023-12-28 07:03:16,508][106225] Updated weights for policy 1, policy_version 1644751 (0.0008) [2023-12-28 07:03:16,556][106225] Updated weights for policy 1, policy_version 1644761 (0.0008) [2023-12-28 07:03:16,610][106225] Updated weights for policy 1, policy_version 1644771 (0.0008) [2023-12-28 07:03:16,742][106226] Updated weights for policy 0, policy_version 1641022 (0.0010) [2023-12-28 07:03:16,796][106226] Updated weights for policy 0, policy_version 1641032 (0.0011) [2023-12-28 07:03:16,852][106226] Updated weights for policy 0, policy_version 1641042 (0.0006) [2023-12-28 07:03:17,402][106225] Updated weights for policy 1, policy_version 1644781 (0.0008) [2023-12-28 07:03:17,455][106225] Updated weights for policy 1, policy_version 1644791 (0.0008) [2023-12-28 07:03:17,464][106226] Updated weights for policy 0, policy_version 1641052 (0.0005) [2023-12-28 07:03:17,508][106225] Updated weights for policy 1, policy_version 1644801 (0.0008) [2023-12-28 07:03:17,521][106226] Updated weights for policy 0, policy_version 1641062 (0.0005) [2023-12-28 07:03:17,580][106226] Updated weights for policy 0, policy_version 1641072 (0.0010) [2023-12-28 07:03:18,242][106226] Updated weights for policy 0, policy_version 1641082 (0.0009) [2023-12-28 07:03:18,278][106225] Updated weights for policy 1, policy_version 1644811 (0.0008) [2023-12-28 07:03:18,299][106226] Updated weights for policy 0, policy_version 1641092 (0.0009) [2023-12-28 07:03:18,327][106225] Updated weights for policy 1, policy_version 1644821 (0.0007) [2023-12-28 07:03:18,381][106226] Updated weights for policy 0, policy_version 1641102 (0.0006) [2023-12-28 07:03:18,397][106225] Updated weights for policy 1, policy_version 1644831 (0.0009) [2023-12-28 07:03:18,440][106226] Updated weights for policy 0, policy_version 1641112 (0.0006) [2023-12-28 07:03:19,018][106226] Updated weights for policy 0, policy_version 1641122 (0.0005) [2023-12-28 07:03:19,075][106226] Updated weights for policy 0, policy_version 1641132 (0.0008) [2023-12-28 07:03:19,135][106226] Updated weights for policy 0, policy_version 1641142 (0.0009) [2023-12-28 07:03:19,192][106225] Updated weights for policy 1, policy_version 1644841 (0.0008) [2023-12-28 07:03:19,256][106225] Updated weights for policy 1, policy_version 1644851 (0.0007) [2023-12-28 07:03:19,320][106225] Updated weights for policy 1, policy_version 1644861 (0.0007) [2023-12-28 07:03:19,385][106225] Updated weights for policy 1, policy_version 1644871 (0.0012) [2023-12-28 07:03:19,849][106226] Updated weights for policy 0, policy_version 1641152 (0.0009) [2023-12-28 07:03:19,913][106226] Updated weights for policy 0, policy_version 1641162 (0.0008) [2023-12-28 07:03:19,979][106226] Updated weights for policy 0, policy_version 1641172 (0.0009) [2023-12-28 07:03:20,122][106225] Updated weights for policy 1, policy_version 1644881 (0.0006) [2023-12-28 07:03:20,195][106225] Updated weights for policy 1, policy_version 1644891 (0.0007) [2023-12-28 07:03:20,263][106225] Updated weights for policy 1, policy_version 1644901 (0.0006) [2023-12-28 07:03:20,618][106226] Updated weights for policy 0, policy_version 1641182 (0.0010) [2023-12-28 07:03:20,673][106226] Updated weights for policy 0, policy_version 1641192 (0.0011) [2023-12-28 07:03:20,736][106226] Updated weights for policy 0, policy_version 1641202 (0.0011) [2023-12-28 07:03:20,922][106225] Updated weights for policy 1, policy_version 1644911 (0.0007) [2023-12-28 07:03:20,981][106225] Updated weights for policy 1, policy_version 1644921 (0.0005) [2023-12-28 07:03:21,042][106225] Updated weights for policy 1, policy_version 1644931 (0.0010) [2023-12-28 07:03:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 841383936. Throughput: 0: 9768.4, 1: 9867.1. Samples: 841390200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:21,175][105115] Avg episode reward: [(0, '-4.698'), (1, '-4.658')] [2023-12-28 07:03:21,492][106226] Updated weights for policy 0, policy_version 1641212 (0.0010) [2023-12-28 07:03:21,563][106226] Updated weights for policy 0, policy_version 1641222 (0.0008) [2023-12-28 07:03:21,636][106226] Updated weights for policy 0, policy_version 1641232 (0.0008) [2023-12-28 07:03:21,810][106225] Updated weights for policy 1, policy_version 1644941 (0.0008) [2023-12-28 07:03:21,875][106225] Updated weights for policy 1, policy_version 1644951 (0.0006) [2023-12-28 07:03:21,938][106225] Updated weights for policy 1, policy_version 1644961 (0.0008) [2023-12-28 07:03:22,394][106226] Updated weights for policy 0, policy_version 1641242 (0.0008) [2023-12-28 07:03:22,456][106226] Updated weights for policy 0, policy_version 1641252 (0.0008) [2023-12-28 07:03:22,519][106226] Updated weights for policy 0, policy_version 1641262 (0.0008) [2023-12-28 07:03:22,584][106226] Updated weights for policy 0, policy_version 1641272 (0.0007) [2023-12-28 07:03:22,660][106225] Updated weights for policy 1, policy_version 1644971 (0.0008) [2023-12-28 07:03:22,721][106225] Updated weights for policy 1, policy_version 1644981 (0.0010) [2023-12-28 07:03:22,782][106225] Updated weights for policy 1, policy_version 1644991 (0.0008) [2023-12-28 07:03:23,313][106226] Updated weights for policy 0, policy_version 1641282 (0.0008) [2023-12-28 07:03:23,358][106226] Updated weights for policy 0, policy_version 1641292 (0.0008) [2023-12-28 07:03:23,406][106226] Updated weights for policy 0, policy_version 1641302 (0.0008) [2023-12-28 07:03:23,475][106225] Updated weights for policy 1, policy_version 1645001 (0.0009) [2023-12-28 07:03:23,530][106225] Updated weights for policy 1, policy_version 1645011 (0.0008) [2023-12-28 07:03:23,582][106225] Updated weights for policy 1, policy_version 1645021 (0.0008) [2023-12-28 07:03:23,631][106225] Updated weights for policy 1, policy_version 1645031 (0.0008) [2023-12-28 07:03:24,112][106226] Updated weights for policy 0, policy_version 1641312 (0.0006) [2023-12-28 07:03:24,177][106226] Updated weights for policy 0, policy_version 1641322 (0.0006) [2023-12-28 07:03:24,246][106226] Updated weights for policy 0, policy_version 1641332 (0.0007) [2023-12-28 07:03:24,425][106225] Updated weights for policy 1, policy_version 1645041 (0.0007) [2023-12-28 07:03:24,485][106225] Updated weights for policy 1, policy_version 1645051 (0.0005) [2023-12-28 07:03:24,551][106225] Updated weights for policy 1, policy_version 1645061 (0.0005) [2023-12-28 07:03:24,911][106226] Updated weights for policy 0, policy_version 1641342 (0.0008) [2023-12-28 07:03:24,968][106226] Updated weights for policy 0, policy_version 1641352 (0.0007) [2023-12-28 07:03:25,027][106226] Updated weights for policy 0, policy_version 1641362 (0.0008) [2023-12-28 07:03:25,142][106225] Updated weights for policy 1, policy_version 1645071 (0.0007) [2023-12-28 07:03:25,196][106225] Updated weights for policy 1, policy_version 1645081 (0.0009) [2023-12-28 07:03:25,261][106225] Updated weights for policy 1, policy_version 1645091 (0.0008) [2023-12-28 07:03:25,689][106226] Updated weights for policy 0, policy_version 1641372 (0.0007) [2023-12-28 07:03:25,746][106226] Updated weights for policy 0, policy_version 1641382 (0.0007) [2023-12-28 07:03:25,804][106226] Updated weights for policy 0, policy_version 1641392 (0.0008) [2023-12-28 07:03:25,922][106225] Updated weights for policy 1, policy_version 1645101 (0.0009) [2023-12-28 07:03:25,974][106225] Updated weights for policy 1, policy_version 1645111 (0.0008) [2023-12-28 07:03:26,024][106225] Updated weights for policy 1, policy_version 1645121 (0.0009) [2023-12-28 07:03:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 841482240. Throughput: 0: 9749.9, 1: 9832.4. Samples: 841447336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:26,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.820')] [2023-12-28 07:03:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001641400_420274176.pth... [2023-12-28 07:03:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001645128_421208064.pth... [2023-12-28 07:03:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001640248_419979264.pth [2023-12-28 07:03:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001643976_420913152.pth [2023-12-28 07:03:26,472][106226] Updated weights for policy 0, policy_version 1641402 (0.0008) [2023-12-28 07:03:26,531][106226] Updated weights for policy 0, policy_version 1641412 (0.0006) [2023-12-28 07:03:26,586][106226] Updated weights for policy 0, policy_version 1641422 (0.0008) [2023-12-28 07:03:26,641][106226] Updated weights for policy 0, policy_version 1641432 (0.0008) [2023-12-28 07:03:26,735][106225] Updated weights for policy 1, policy_version 1645131 (0.0008) [2023-12-28 07:03:26,791][106225] Updated weights for policy 1, policy_version 1645141 (0.0006) [2023-12-28 07:03:26,836][106225] Updated weights for policy 1, policy_version 1645151 (0.0005) [2023-12-28 07:03:27,363][106226] Updated weights for policy 0, policy_version 1641442 (0.0010) [2023-12-28 07:03:27,402][106225] Updated weights for policy 1, policy_version 1645161 (0.0005) [2023-12-28 07:03:27,426][106226] Updated weights for policy 0, policy_version 1641452 (0.0007) [2023-12-28 07:03:27,463][106225] Updated weights for policy 1, policy_version 1645171 (0.0005) [2023-12-28 07:03:27,483][106226] Updated weights for policy 0, policy_version 1641462 (0.0008) [2023-12-28 07:03:27,511][106225] Updated weights for policy 1, policy_version 1645181 (0.0005) [2023-12-28 07:03:27,557][106225] Updated weights for policy 1, policy_version 1645191 (0.0005) [2023-12-28 07:03:28,089][106225] Updated weights for policy 1, policy_version 1645201 (0.0009) [2023-12-28 07:03:28,152][106225] Updated weights for policy 1, policy_version 1645211 (0.0010) [2023-12-28 07:03:28,211][106225] Updated weights for policy 1, policy_version 1645221 (0.0010) [2023-12-28 07:03:28,241][106226] Updated weights for policy 0, policy_version 1641472 (0.0006) [2023-12-28 07:03:28,285][106226] Updated weights for policy 0, policy_version 1641482 (0.0008) [2023-12-28 07:03:28,341][106226] Updated weights for policy 0, policy_version 1641492 (0.0008) [2023-12-28 07:03:28,859][106225] Updated weights for policy 1, policy_version 1645231 (0.0010) [2023-12-28 07:03:28,919][106225] Updated weights for policy 1, policy_version 1645241 (0.0010) [2023-12-28 07:03:28,973][106226] Updated weights for policy 0, policy_version 1641502 (0.0007) [2023-12-28 07:03:28,973][106225] Updated weights for policy 1, policy_version 1645251 (0.0010) [2023-12-28 07:03:29,024][106226] Updated weights for policy 0, policy_version 1641512 (0.0005) [2023-12-28 07:03:29,069][106226] Updated weights for policy 0, policy_version 1641522 (0.0005) [2023-12-28 07:03:29,639][106225] Updated weights for policy 1, policy_version 1645261 (0.0010) [2023-12-28 07:03:29,699][106225] Updated weights for policy 1, policy_version 1645271 (0.0008) [2023-12-28 07:03:29,740][106226] Updated weights for policy 0, policy_version 1641532 (0.0005) [2023-12-28 07:03:29,760][106225] Updated weights for policy 1, policy_version 1645281 (0.0007) [2023-12-28 07:03:29,799][106226] Updated weights for policy 0, policy_version 1641542 (0.0007) [2023-12-28 07:03:29,865][106226] Updated weights for policy 0, policy_version 1641552 (0.0007) [2023-12-28 07:03:30,476][106225] Updated weights for policy 1, policy_version 1645291 (0.0008) [2023-12-28 07:03:30,533][106225] Updated weights for policy 1, policy_version 1645301 (0.0010) [2023-12-28 07:03:30,596][106225] Updated weights for policy 1, policy_version 1645311 (0.0010) [2023-12-28 07:03:30,622][106226] Updated weights for policy 0, policy_version 1641562 (0.0007) [2023-12-28 07:03:30,680][106226] Updated weights for policy 0, policy_version 1641572 (0.0007) [2023-12-28 07:03:30,738][106226] Updated weights for policy 0, policy_version 1641582 (0.0008) [2023-12-28 07:03:30,802][106226] Updated weights for policy 0, policy_version 1641592 (0.0008) [2023-12-28 07:03:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 841580544. Throughput: 0: 9846.5, 1: 9915.6. Samples: 841571840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:31,175][105115] Avg episode reward: [(0, '-4.647'), (1, '-4.697')] [2023-12-28 07:03:31,335][106225] Updated weights for policy 1, policy_version 1645321 (0.0010) [2023-12-28 07:03:31,414][106225] Updated weights for policy 1, policy_version 1645331 (0.0009) [2023-12-28 07:03:31,471][106225] Updated weights for policy 1, policy_version 1645341 (0.0009) [2023-12-28 07:03:31,519][106225] Updated weights for policy 1, policy_version 1645351 (0.0009) [2023-12-28 07:03:31,671][106226] Updated weights for policy 0, policy_version 1641602 (0.0010) [2023-12-28 07:03:31,733][106226] Updated weights for policy 0, policy_version 1641612 (0.0008) [2023-12-28 07:03:31,800][106226] Updated weights for policy 0, policy_version 1641622 (0.0008) [2023-12-28 07:03:32,285][106225] Updated weights for policy 1, policy_version 1645361 (0.0008) [2023-12-28 07:03:32,348][106225] Updated weights for policy 1, policy_version 1645371 (0.0009) [2023-12-28 07:03:32,413][106225] Updated weights for policy 1, policy_version 1645381 (0.0008) [2023-12-28 07:03:32,524][106226] Updated weights for policy 0, policy_version 1641632 (0.0008) [2023-12-28 07:03:32,589][106226] Updated weights for policy 0, policy_version 1641642 (0.0009) [2023-12-28 07:03:32,656][106226] Updated weights for policy 0, policy_version 1641652 (0.0007) [2023-12-28 07:03:33,089][106225] Updated weights for policy 1, policy_version 1645391 (0.0008) [2023-12-28 07:03:33,140][106225] Updated weights for policy 1, policy_version 1645401 (0.0008) [2023-12-28 07:03:33,192][106225] Updated weights for policy 1, policy_version 1645411 (0.0009) [2023-12-28 07:03:33,325][106226] Updated weights for policy 0, policy_version 1641662 (0.0007) [2023-12-28 07:03:33,367][106226] Updated weights for policy 0, policy_version 1641672 (0.0006) [2023-12-28 07:03:33,419][106226] Updated weights for policy 0, policy_version 1641682 (0.0005) [2023-12-28 07:03:33,894][106225] Updated weights for policy 1, policy_version 1645421 (0.0007) [2023-12-28 07:03:33,960][106225] Updated weights for policy 1, policy_version 1645431 (0.0006) [2023-12-28 07:03:33,961][106226] Updated weights for policy 0, policy_version 1641692 (0.0005) [2023-12-28 07:03:34,019][106226] Updated weights for policy 0, policy_version 1641702 (0.0005) [2023-12-28 07:03:34,028][106225] Updated weights for policy 1, policy_version 1645441 (0.0007) [2023-12-28 07:03:34,077][106226] Updated weights for policy 0, policy_version 1641712 (0.0005) [2023-12-28 07:03:34,678][106225] Updated weights for policy 1, policy_version 1645451 (0.0007) [2023-12-28 07:03:34,728][106226] Updated weights for policy 0, policy_version 1641722 (0.0005) [2023-12-28 07:03:34,733][106225] Updated weights for policy 1, policy_version 1645461 (0.0007) [2023-12-28 07:03:34,782][106226] Updated weights for policy 0, policy_version 1641732 (0.0007) [2023-12-28 07:03:34,785][106225] Updated weights for policy 1, policy_version 1645471 (0.0006) [2023-12-28 07:03:34,839][106226] Updated weights for policy 0, policy_version 1641742 (0.0006) [2023-12-28 07:03:34,905][106226] Updated weights for policy 0, policy_version 1641752 (0.0005) [2023-12-28 07:03:35,435][106225] Updated weights for policy 1, policy_version 1645481 (0.0006) [2023-12-28 07:03:35,486][106225] Updated weights for policy 1, policy_version 1645491 (0.0007) [2023-12-28 07:03:35,544][106225] Updated weights for policy 1, policy_version 1645501 (0.0007) [2023-12-28 07:03:35,567][106226] Updated weights for policy 0, policy_version 1641762 (0.0007) [2023-12-28 07:03:35,603][106225] Updated weights for policy 1, policy_version 1645511 (0.0007) [2023-12-28 07:03:35,621][106226] Updated weights for policy 0, policy_version 1641772 (0.0005) [2023-12-28 07:03:35,677][106226] Updated weights for policy 0, policy_version 1641782 (0.0005) [2023-12-28 07:03:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 841678848. Throughput: 0: 9916.8, 1: 9857.9. Samples: 841690412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:36,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.680')] [2023-12-28 07:03:36,346][106225] Updated weights for policy 1, policy_version 1645521 (0.0008) [2023-12-28 07:03:36,360][106226] Updated weights for policy 0, policy_version 1641792 (0.0010) [2023-12-28 07:03:36,407][106225] Updated weights for policy 1, policy_version 1645531 (0.0006) [2023-12-28 07:03:36,422][106226] Updated weights for policy 0, policy_version 1641802 (0.0007) [2023-12-28 07:03:36,472][106225] Updated weights for policy 1, policy_version 1645541 (0.0008) [2023-12-28 07:03:36,488][106226] Updated weights for policy 0, policy_version 1641812 (0.0006) [2023-12-28 07:03:37,181][106225] Updated weights for policy 1, policy_version 1645551 (0.0008) [2023-12-28 07:03:37,204][106226] Updated weights for policy 0, policy_version 1641822 (0.0008) [2023-12-28 07:03:37,241][106225] Updated weights for policy 1, policy_version 1645561 (0.0009) [2023-12-28 07:03:37,263][106226] Updated weights for policy 0, policy_version 1641832 (0.0007) [2023-12-28 07:03:37,297][106225] Updated weights for policy 1, policy_version 1645571 (0.0006) [2023-12-28 07:03:37,326][106226] Updated weights for policy 0, policy_version 1641842 (0.0008) [2023-12-28 07:03:37,938][106225] Updated weights for policy 1, policy_version 1645581 (0.0008) [2023-12-28 07:03:37,988][106225] Updated weights for policy 1, policy_version 1645591 (0.0010) [2023-12-28 07:03:38,044][106226] Updated weights for policy 0, policy_version 1641852 (0.0007) [2023-12-28 07:03:38,045][106225] Updated weights for policy 1, policy_version 1645601 (0.0010) [2023-12-28 07:03:38,096][106226] Updated weights for policy 0, policy_version 1641862 (0.0007) [2023-12-28 07:03:38,150][106226] Updated weights for policy 0, policy_version 1641872 (0.0006) [2023-12-28 07:03:38,718][106225] Updated weights for policy 1, policy_version 1645611 (0.0010) [2023-12-28 07:03:38,778][106225] Updated weights for policy 1, policy_version 1645621 (0.0010) [2023-12-28 07:03:38,838][106225] Updated weights for policy 1, policy_version 1645631 (0.0010) [2023-12-28 07:03:38,865][106226] Updated weights for policy 0, policy_version 1641882 (0.0005) [2023-12-28 07:03:38,935][106226] Updated weights for policy 0, policy_version 1641892 (0.0008) [2023-12-28 07:03:38,994][106226] Updated weights for policy 0, policy_version 1641902 (0.0008) [2023-12-28 07:03:39,063][106226] Updated weights for policy 0, policy_version 1641912 (0.0008) [2023-12-28 07:03:39,618][106225] Updated weights for policy 1, policy_version 1645641 (0.0010) [2023-12-28 07:03:39,677][106225] Updated weights for policy 1, policy_version 1645651 (0.0010) [2023-12-28 07:03:39,732][106225] Updated weights for policy 1, policy_version 1645661 (0.0010) [2023-12-28 07:03:39,737][106226] Updated weights for policy 0, policy_version 1641922 (0.0011) [2023-12-28 07:03:39,791][106226] Updated weights for policy 0, policy_version 1641932 (0.0010) [2023-12-28 07:03:39,794][106225] Updated weights for policy 1, policy_version 1645671 (0.0011) [2023-12-28 07:03:39,848][106226] Updated weights for policy 0, policy_version 1641942 (0.0007) [2023-12-28 07:03:40,537][106225] Updated weights for policy 1, policy_version 1645681 (0.0010) [2023-12-28 07:03:40,551][106226] Updated weights for policy 0, policy_version 1641952 (0.0006) [2023-12-28 07:03:40,588][106225] Updated weights for policy 1, policy_version 1645691 (0.0010) [2023-12-28 07:03:40,601][106226] Updated weights for policy 0, policy_version 1641962 (0.0005) [2023-12-28 07:03:40,646][106225] Updated weights for policy 1, policy_version 1645701 (0.0010) [2023-12-28 07:03:40,657][106226] Updated weights for policy 0, policy_version 1641972 (0.0006) [2023-12-28 07:03:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 841777152. Throughput: 0: 9911.5, 1: 9856.3. Samples: 841749400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:41,175][105115] Avg episode reward: [(0, '-4.211'), (1, '-4.829')] [2023-12-28 07:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001645704_421355520.pth... [2023-12-28 07:03:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001641976_420421632.pth... [2023-12-28 07:03:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001640824_420126720.pth [2023-12-28 07:03:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001644552_421060608.pth [2023-12-28 07:03:41,379][106226] Updated weights for policy 0, policy_version 1641982 (0.0007) [2023-12-28 07:03:41,439][106226] Updated weights for policy 0, policy_version 1641992 (0.0008) [2023-12-28 07:03:41,450][106225] Updated weights for policy 1, policy_version 1645711 (0.0009) [2023-12-28 07:03:41,498][106226] Updated weights for policy 0, policy_version 1642002 (0.0008) [2023-12-28 07:03:41,511][106225] Updated weights for policy 1, policy_version 1645721 (0.0009) [2023-12-28 07:03:41,573][106225] Updated weights for policy 1, policy_version 1645731 (0.0009) [2023-12-28 07:03:42,254][106226] Updated weights for policy 0, policy_version 1642012 (0.0008) [2023-12-28 07:03:42,323][106226] Updated weights for policy 0, policy_version 1642022 (0.0007) [2023-12-28 07:03:42,392][106226] Updated weights for policy 0, policy_version 1642032 (0.0009) [2023-12-28 07:03:42,406][106225] Updated weights for policy 1, policy_version 1645741 (0.0010) [2023-12-28 07:03:42,470][106225] Updated weights for policy 1, policy_version 1645751 (0.0007) [2023-12-28 07:03:42,535][106225] Updated weights for policy 1, policy_version 1645761 (0.0008) [2023-12-28 07:03:43,081][106226] Updated weights for policy 0, policy_version 1642042 (0.0008) [2023-12-28 07:03:43,136][106226] Updated weights for policy 0, policy_version 1642052 (0.0008) [2023-12-28 07:03:43,184][106226] Updated weights for policy 0, policy_version 1642062 (0.0007) [2023-12-28 07:03:43,234][106225] Updated weights for policy 1, policy_version 1645771 (0.0008) [2023-12-28 07:03:43,242][106226] Updated weights for policy 0, policy_version 1642072 (0.0007) [2023-12-28 07:03:43,290][106225] Updated weights for policy 1, policy_version 1645781 (0.0005) [2023-12-28 07:03:43,343][106225] Updated weights for policy 1, policy_version 1645791 (0.0005) [2023-12-28 07:03:43,967][106225] Updated weights for policy 1, policy_version 1645801 (0.0006) [2023-12-28 07:03:44,017][106226] Updated weights for policy 0, policy_version 1642082 (0.0009) [2023-12-28 07:03:44,024][106225] Updated weights for policy 1, policy_version 1645811 (0.0009) [2023-12-28 07:03:44,067][106226] Updated weights for policy 0, policy_version 1642092 (0.0008) [2023-12-28 07:03:44,073][106225] Updated weights for policy 1, policy_version 1645821 (0.0005) [2023-12-28 07:03:44,113][106226] Updated weights for policy 0, policy_version 1642102 (0.0008) [2023-12-28 07:03:44,116][106225] Updated weights for policy 1, policy_version 1645831 (0.0005) [2023-12-28 07:03:44,797][106225] Updated weights for policy 1, policy_version 1645841 (0.0007) [2023-12-28 07:03:44,861][106225] Updated weights for policy 1, policy_version 1645851 (0.0009) [2023-12-28 07:03:44,864][106226] Updated weights for policy 0, policy_version 1642112 (0.0007) [2023-12-28 07:03:44,922][106225] Updated weights for policy 1, policy_version 1645861 (0.0008) [2023-12-28 07:03:44,926][106226] Updated weights for policy 0, policy_version 1642122 (0.0006) [2023-12-28 07:03:44,992][106226] Updated weights for policy 0, policy_version 1642132 (0.0008) [2023-12-28 07:03:45,649][106225] Updated weights for policy 1, policy_version 1645871 (0.0009) [2023-12-28 07:03:45,654][106226] Updated weights for policy 0, policy_version 1642142 (0.0009) [2023-12-28 07:03:45,703][106225] Updated weights for policy 1, policy_version 1645881 (0.0009) [2023-12-28 07:03:45,716][106226] Updated weights for policy 0, policy_version 1642152 (0.0009) [2023-12-28 07:03:45,759][106225] Updated weights for policy 1, policy_version 1645891 (0.0005) [2023-12-28 07:03:45,762][106226] Updated weights for policy 0, policy_version 1642162 (0.0010) [2023-12-28 07:03:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 841875456. Throughput: 0: 9873.8, 1: 9790.6. Samples: 841864040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:46,176][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.764')] [2023-12-28 07:03:46,397][106225] Updated weights for policy 1, policy_version 1645901 (0.0008) [2023-12-28 07:03:46,458][106225] Updated weights for policy 1, policy_version 1645911 (0.0010) [2023-12-28 07:03:46,465][106226] Updated weights for policy 0, policy_version 1642172 (0.0007) [2023-12-28 07:03:46,519][106225] Updated weights for policy 1, policy_version 1645921 (0.0010) [2023-12-28 07:03:46,527][106226] Updated weights for policy 0, policy_version 1642182 (0.0005) [2023-12-28 07:03:46,589][106226] Updated weights for policy 0, policy_version 1642192 (0.0005) [2023-12-28 07:03:47,158][106226] Updated weights for policy 0, policy_version 1642202 (0.0007) [2023-12-28 07:03:47,215][106226] Updated weights for policy 0, policy_version 1642212 (0.0009) [2023-12-28 07:03:47,218][106225] Updated weights for policy 1, policy_version 1645931 (0.0011) [2023-12-28 07:03:47,270][106226] Updated weights for policy 0, policy_version 1642222 (0.0005) [2023-12-28 07:03:47,272][106225] Updated weights for policy 1, policy_version 1645941 (0.0011) [2023-12-28 07:03:47,326][106225] Updated weights for policy 1, policy_version 1645951 (0.0010) [2023-12-28 07:03:47,328][106226] Updated weights for policy 0, policy_version 1642232 (0.0006) [2023-12-28 07:03:48,047][106226] Updated weights for policy 0, policy_version 1642242 (0.0008) [2023-12-28 07:03:48,056][106225] Updated weights for policy 1, policy_version 1645961 (0.0010) [2023-12-28 07:03:48,103][106226] Updated weights for policy 0, policy_version 1642252 (0.0010) [2023-12-28 07:03:48,109][106225] Updated weights for policy 1, policy_version 1645971 (0.0010) [2023-12-28 07:03:48,153][106226] Updated weights for policy 0, policy_version 1642262 (0.0005) [2023-12-28 07:03:48,156][106225] Updated weights for policy 1, policy_version 1645981 (0.0010) [2023-12-28 07:03:48,202][106225] Updated weights for policy 1, policy_version 1645991 (0.0010) [2023-12-28 07:03:48,904][106226] Updated weights for policy 0, policy_version 1642272 (0.0009) [2023-12-28 07:03:48,948][106225] Updated weights for policy 1, policy_version 1646001 (0.0010) [2023-12-28 07:03:48,958][106226] Updated weights for policy 0, policy_version 1642282 (0.0008) [2023-12-28 07:03:49,007][106225] Updated weights for policy 1, policy_version 1646011 (0.0010) [2023-12-28 07:03:49,021][106226] Updated weights for policy 0, policy_version 1642292 (0.0005) [2023-12-28 07:03:49,067][106225] Updated weights for policy 1, policy_version 1646021 (0.0010) [2023-12-28 07:03:49,661][106226] Updated weights for policy 0, policy_version 1642302 (0.0007) [2023-12-28 07:03:49,711][106226] Updated weights for policy 0, policy_version 1642312 (0.0007) [2023-12-28 07:03:49,767][106226] Updated weights for policy 0, policy_version 1642322 (0.0007) [2023-12-28 07:03:49,789][106225] Updated weights for policy 1, policy_version 1646031 (0.0011) [2023-12-28 07:03:49,857][106225] Updated weights for policy 1, policy_version 1646041 (0.0010) [2023-12-28 07:03:49,913][106225] Updated weights for policy 1, policy_version 1646051 (0.0009) [2023-12-28 07:03:50,514][106226] Updated weights for policy 0, policy_version 1642332 (0.0008) [2023-12-28 07:03:50,574][106226] Updated weights for policy 0, policy_version 1642342 (0.0010) [2023-12-28 07:03:50,624][106225] Updated weights for policy 1, policy_version 1646061 (0.0009) [2023-12-28 07:03:50,646][106226] Updated weights for policy 0, policy_version 1642352 (0.0006) [2023-12-28 07:03:50,675][106225] Updated weights for policy 1, policy_version 1646071 (0.0007) [2023-12-28 07:03:50,738][106225] Updated weights for policy 1, policy_version 1646081 (0.0006) [2023-12-28 07:03:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 841973760. Throughput: 0: 9940.3, 1: 9773.2. Samples: 841983140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:51,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.856')] [2023-12-28 07:03:51,421][106225] Updated weights for policy 1, policy_version 1646091 (0.0007) [2023-12-28 07:03:51,432][106226] Updated weights for policy 0, policy_version 1642362 (0.0006) [2023-12-28 07:03:51,475][106225] Updated weights for policy 1, policy_version 1646101 (0.0006) [2023-12-28 07:03:51,502][106226] Updated weights for policy 0, policy_version 1642372 (0.0009) [2023-12-28 07:03:51,541][106225] Updated weights for policy 1, policy_version 1646111 (0.0007) [2023-12-28 07:03:51,560][106226] Updated weights for policy 0, policy_version 1642382 (0.0010) [2023-12-28 07:03:51,628][106226] Updated weights for policy 0, policy_version 1642392 (0.0009) [2023-12-28 07:03:52,212][106225] Updated weights for policy 1, policy_version 1646121 (0.0008) [2023-12-28 07:03:52,274][106225] Updated weights for policy 1, policy_version 1646131 (0.0009) [2023-12-28 07:03:52,329][106225] Updated weights for policy 1, policy_version 1646141 (0.0008) [2023-12-28 07:03:52,394][106226] Updated weights for policy 0, policy_version 1642402 (0.0007) [2023-12-28 07:03:52,398][106225] Updated weights for policy 1, policy_version 1646151 (0.0008) [2023-12-28 07:03:52,443][106226] Updated weights for policy 0, policy_version 1642412 (0.0006) [2023-12-28 07:03:52,511][106226] Updated weights for policy 0, policy_version 1642422 (0.0007) [2023-12-28 07:03:53,003][106225] Updated weights for policy 1, policy_version 1646161 (0.0008) [2023-12-28 07:03:53,058][106225] Updated weights for policy 1, policy_version 1646171 (0.0008) [2023-12-28 07:03:53,112][106225] Updated weights for policy 1, policy_version 1646181 (0.0009) [2023-12-28 07:03:53,220][106226] Updated weights for policy 0, policy_version 1642432 (0.0005) [2023-12-28 07:03:53,288][106226] Updated weights for policy 0, policy_version 1642442 (0.0008) [2023-12-28 07:03:53,340][106226] Updated weights for policy 0, policy_version 1642452 (0.0008) [2023-12-28 07:03:53,906][106225] Updated weights for policy 1, policy_version 1646191 (0.0009) [2023-12-28 07:03:53,951][106226] Updated weights for policy 0, policy_version 1642462 (0.0006) [2023-12-28 07:03:53,961][106225] Updated weights for policy 1, policy_version 1646201 (0.0010) [2023-12-28 07:03:54,010][106226] Updated weights for policy 0, policy_version 1642472 (0.0006) [2023-12-28 07:03:54,020][106225] Updated weights for policy 1, policy_version 1646211 (0.0010) [2023-12-28 07:03:54,082][106226] Updated weights for policy 0, policy_version 1642482 (0.0009) [2023-12-28 07:03:54,745][106225] Updated weights for policy 1, policy_version 1646221 (0.0008) [2023-12-28 07:03:54,813][106225] Updated weights for policy 1, policy_version 1646231 (0.0006) [2023-12-28 07:03:54,836][106226] Updated weights for policy 0, policy_version 1642492 (0.0008) [2023-12-28 07:03:54,867][106225] Updated weights for policy 1, policy_version 1646241 (0.0010) [2023-12-28 07:03:54,896][106226] Updated weights for policy 0, policy_version 1642502 (0.0007) [2023-12-28 07:03:54,951][106226] Updated weights for policy 0, policy_version 1642512 (0.0008) [2023-12-28 07:03:55,566][106225] Updated weights for policy 1, policy_version 1646251 (0.0010) [2023-12-28 07:03:55,624][106225] Updated weights for policy 1, policy_version 1646261 (0.0009) [2023-12-28 07:03:55,640][106226] Updated weights for policy 0, policy_version 1642522 (0.0008) [2023-12-28 07:03:55,681][106225] Updated weights for policy 1, policy_version 1646271 (0.0009) [2023-12-28 07:03:55,690][106226] Updated weights for policy 0, policy_version 1642532 (0.0005) [2023-12-28 07:03:55,742][106226] Updated weights for policy 0, policy_version 1642542 (0.0007) [2023-12-28 07:03:55,798][106226] Updated weights for policy 0, policy_version 1642552 (0.0009) [2023-12-28 07:03:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 842072064. Throughput: 0: 9919.8, 1: 9756.6. Samples: 842042248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:03:56,176][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.777')] [2023-12-28 07:03:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001646280_421502976.pth... [2023-12-28 07:03:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001642552_420569088.pth... [2023-12-28 07:03:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001645128_421208064.pth [2023-12-28 07:03:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001641400_420274176.pth [2023-12-28 07:03:56,418][106225] Updated weights for policy 1, policy_version 1646281 (0.0008) [2023-12-28 07:03:56,478][106225] Updated weights for policy 1, policy_version 1646291 (0.0006) [2023-12-28 07:03:56,486][106226] Updated weights for policy 0, policy_version 1642562 (0.0008) [2023-12-28 07:03:56,535][106226] Updated weights for policy 0, policy_version 1642572 (0.0008) [2023-12-28 07:03:56,540][106225] Updated weights for policy 1, policy_version 1646301 (0.0005) [2023-12-28 07:03:56,592][106226] Updated weights for policy 0, policy_version 1642582 (0.0008) [2023-12-28 07:03:56,596][106225] Updated weights for policy 1, policy_version 1646311 (0.0005) [2023-12-28 07:03:57,201][106225] Updated weights for policy 1, policy_version 1646321 (0.0005) [2023-12-28 07:03:57,254][106225] Updated weights for policy 1, policy_version 1646331 (0.0005) [2023-12-28 07:03:57,304][106225] Updated weights for policy 1, policy_version 1646341 (0.0009) [2023-12-28 07:03:57,385][106226] Updated weights for policy 0, policy_version 1642592 (0.0008) [2023-12-28 07:03:57,439][106226] Updated weights for policy 0, policy_version 1642602 (0.0007) [2023-12-28 07:03:57,488][106226] Updated weights for policy 0, policy_version 1642612 (0.0005) [2023-12-28 07:03:57,931][106225] Updated weights for policy 1, policy_version 1646351 (0.0008) [2023-12-28 07:03:57,990][106225] Updated weights for policy 1, policy_version 1646361 (0.0008) [2023-12-28 07:03:58,044][106225] Updated weights for policy 1, policy_version 1646371 (0.0006) [2023-12-28 07:03:58,237][106226] Updated weights for policy 0, policy_version 1642622 (0.0008) [2023-12-28 07:03:58,290][106226] Updated weights for policy 0, policy_version 1642632 (0.0008) [2023-12-28 07:03:58,350][106226] Updated weights for policy 0, policy_version 1642642 (0.0009) [2023-12-28 07:03:58,804][106225] Updated weights for policy 1, policy_version 1646381 (0.0007) [2023-12-28 07:03:58,870][106225] Updated weights for policy 1, policy_version 1646391 (0.0009) [2023-12-28 07:03:58,940][106225] Updated weights for policy 1, policy_version 1646401 (0.0009) [2023-12-28 07:03:59,100][106226] Updated weights for policy 0, policy_version 1642652 (0.0007) [2023-12-28 07:03:59,161][106226] Updated weights for policy 0, policy_version 1642662 (0.0007) [2023-12-28 07:03:59,241][106226] Updated weights for policy 0, policy_version 1642672 (0.0009) [2023-12-28 07:03:59,762][106225] Updated weights for policy 1, policy_version 1646411 (0.0007) [2023-12-28 07:03:59,821][106225] Updated weights for policy 1, policy_version 1646421 (0.0006) [2023-12-28 07:03:59,881][106225] Updated weights for policy 1, policy_version 1646431 (0.0008) [2023-12-28 07:04:00,001][106226] Updated weights for policy 0, policy_version 1642682 (0.0007) [2023-12-28 07:04:00,055][106226] Updated weights for policy 0, policy_version 1642692 (0.0008) [2023-12-28 07:04:00,122][106226] Updated weights for policy 0, policy_version 1642702 (0.0005) [2023-12-28 07:04:00,188][106226] Updated weights for policy 0, policy_version 1642712 (0.0006) [2023-12-28 07:04:00,621][106225] Updated weights for policy 1, policy_version 1646441 (0.0008) [2023-12-28 07:04:00,665][106225] Updated weights for policy 1, policy_version 1646451 (0.0005) [2023-12-28 07:04:00,713][106225] Updated weights for policy 1, policy_version 1646461 (0.0005) [2023-12-28 07:04:00,776][106225] Updated weights for policy 1, policy_version 1646471 (0.0006) [2023-12-28 07:04:00,786][106226] Updated weights for policy 0, policy_version 1642722 (0.0005) [2023-12-28 07:04:00,832][106226] Updated weights for policy 0, policy_version 1642732 (0.0007) [2023-12-28 07:04:00,883][106226] Updated weights for policy 0, policy_version 1642742 (0.0009) [2023-12-28 07:04:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 842170368. Throughput: 0: 9870.3, 1: 9790.1. Samples: 842157380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:04:01,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.787')] [2023-12-28 07:04:01,494][106225] Updated weights for policy 1, policy_version 1646481 (0.0008) [2023-12-28 07:04:01,557][106225] Updated weights for policy 1, policy_version 1646491 (0.0007) [2023-12-28 07:04:01,574][106226] Updated weights for policy 0, policy_version 1642752 (0.0009) [2023-12-28 07:04:01,625][106225] Updated weights for policy 1, policy_version 1646501 (0.0008) [2023-12-28 07:04:01,642][106226] Updated weights for policy 0, policy_version 1642762 (0.0008) [2023-12-28 07:04:01,700][106226] Updated weights for policy 0, policy_version 1642772 (0.0008) [2023-12-28 07:04:02,288][106225] Updated weights for policy 1, policy_version 1646511 (0.0008) [2023-12-28 07:04:02,346][106225] Updated weights for policy 1, policy_version 1646521 (0.0008) [2023-12-28 07:04:02,407][106225] Updated weights for policy 1, policy_version 1646531 (0.0006) [2023-12-28 07:04:02,468][106226] Updated weights for policy 0, policy_version 1642782 (0.0009) [2023-12-28 07:04:02,527][106226] Updated weights for policy 0, policy_version 1642792 (0.0008) [2023-12-28 07:04:02,593][106226] Updated weights for policy 0, policy_version 1642802 (0.0006) [2023-12-28 07:04:03,078][106225] Updated weights for policy 1, policy_version 1646541 (0.0006) [2023-12-28 07:04:03,131][106225] Updated weights for policy 1, policy_version 1646551 (0.0009) [2023-12-28 07:04:03,187][106225] Updated weights for policy 1, policy_version 1646561 (0.0009) [2023-12-28 07:04:03,287][106226] Updated weights for policy 0, policy_version 1642812 (0.0007) [2023-12-28 07:04:03,355][106226] Updated weights for policy 0, policy_version 1642822 (0.0006) [2023-12-28 07:04:03,416][106226] Updated weights for policy 0, policy_version 1642832 (0.0005) [2023-12-28 07:04:03,922][106226] Updated weights for policy 0, policy_version 1642842 (0.0006) [2023-12-28 07:04:03,982][106226] Updated weights for policy 0, policy_version 1642852 (0.0008) [2023-12-28 07:04:04,039][106225] Updated weights for policy 1, policy_version 1646571 (0.0007) [2023-12-28 07:04:04,041][106226] Updated weights for policy 0, policy_version 1642862 (0.0009) [2023-12-28 07:04:04,095][106225] Updated weights for policy 1, policy_version 1646581 (0.0007) [2023-12-28 07:04:04,097][106226] Updated weights for policy 0, policy_version 1642872 (0.0006) [2023-12-28 07:04:04,159][106225] Updated weights for policy 1, policy_version 1646591 (0.0008) [2023-12-28 07:04:04,781][106226] Updated weights for policy 0, policy_version 1642882 (0.0007) [2023-12-28 07:04:04,840][106226] Updated weights for policy 0, policy_version 1642892 (0.0009) [2023-12-28 07:04:04,885][106225] Updated weights for policy 1, policy_version 1646601 (0.0007) [2023-12-28 07:04:04,892][106226] Updated weights for policy 0, policy_version 1642902 (0.0008) [2023-12-28 07:04:04,943][106225] Updated weights for policy 1, policy_version 1646611 (0.0007) [2023-12-28 07:04:05,002][106225] Updated weights for policy 1, policy_version 1646621 (0.0007) [2023-12-28 07:04:05,056][106225] Updated weights for policy 1, policy_version 1646631 (0.0009) [2023-12-28 07:04:05,520][106226] Updated weights for policy 0, policy_version 1642912 (0.0007) [2023-12-28 07:04:05,567][106226] Updated weights for policy 0, policy_version 1642922 (0.0005) [2023-12-28 07:04:05,626][106226] Updated weights for policy 0, policy_version 1642932 (0.0007) [2023-12-28 07:04:05,790][106225] Updated weights for policy 1, policy_version 1646641 (0.0008) [2023-12-28 07:04:05,861][106225] Updated weights for policy 1, policy_version 1646651 (0.0009) [2023-12-28 07:04:05,930][106225] Updated weights for policy 1, policy_version 1646661 (0.0010) [2023-12-28 07:04:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 842268672. Throughput: 0: 9883.4, 1: 9866.7. Samples: 842278952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:04:06,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.641')] [2023-12-28 07:04:06,177][106226] Updated weights for policy 0, policy_version 1642942 (0.0008) [2023-12-28 07:04:06,236][106226] Updated weights for policy 0, policy_version 1642952 (0.0008) [2023-12-28 07:04:06,285][106226] Updated weights for policy 0, policy_version 1642962 (0.0008) [2023-12-28 07:04:06,647][106225] Updated weights for policy 1, policy_version 1646671 (0.0007) [2023-12-28 07:04:06,709][106225] Updated weights for policy 1, policy_version 1646681 (0.0005) [2023-12-28 07:04:06,765][106225] Updated weights for policy 1, policy_version 1646691 (0.0006) [2023-12-28 07:04:07,114][106226] Updated weights for policy 0, policy_version 1642972 (0.0009) [2023-12-28 07:04:07,173][106226] Updated weights for policy 0, policy_version 1642982 (0.0008) [2023-12-28 07:04:07,238][106226] Updated weights for policy 0, policy_version 1642992 (0.0007) [2023-12-28 07:04:07,348][106225] Updated weights for policy 1, policy_version 1646701 (0.0008) [2023-12-28 07:04:07,417][106225] Updated weights for policy 1, policy_version 1646711 (0.0009) [2023-12-28 07:04:07,477][106225] Updated weights for policy 1, policy_version 1646721 (0.0008) [2023-12-28 07:04:07,913][106226] Updated weights for policy 0, policy_version 1643002 (0.0006) [2023-12-28 07:04:07,964][106226] Updated weights for policy 0, policy_version 1643012 (0.0008) [2023-12-28 07:04:08,023][106226] Updated weights for policy 0, policy_version 1643022 (0.0009) [2023-12-28 07:04:08,089][106226] Updated weights for policy 0, policy_version 1643032 (0.0008) [2023-12-28 07:04:08,210][106225] Updated weights for policy 1, policy_version 1646731 (0.0009) [2023-12-28 07:04:08,260][106225] Updated weights for policy 1, policy_version 1646741 (0.0009) [2023-12-28 07:04:08,309][106225] Updated weights for policy 1, policy_version 1646751 (0.0008) [2023-12-28 07:04:08,820][106226] Updated weights for policy 0, policy_version 1643042 (0.0006) [2023-12-28 07:04:08,887][106226] Updated weights for policy 0, policy_version 1643052 (0.0006) [2023-12-28 07:04:08,952][106226] Updated weights for policy 0, policy_version 1643062 (0.0006) [2023-12-28 07:04:08,976][106225] Updated weights for policy 1, policy_version 1646761 (0.0008) [2023-12-28 07:04:09,033][106225] Updated weights for policy 1, policy_version 1646771 (0.0008) [2023-12-28 07:04:09,086][106225] Updated weights for policy 1, policy_version 1646781 (0.0007) [2023-12-28 07:04:09,148][106225] Updated weights for policy 1, policy_version 1646791 (0.0008) [2023-12-28 07:04:09,632][106226] Updated weights for policy 0, policy_version 1643072 (0.0007) [2023-12-28 07:04:09,700][106226] Updated weights for policy 0, policy_version 1643082 (0.0007) [2023-12-28 07:04:09,771][106226] Updated weights for policy 0, policy_version 1643092 (0.0006) [2023-12-28 07:04:09,933][106225] Updated weights for policy 1, policy_version 1646801 (0.0008) [2023-12-28 07:04:09,998][106225] Updated weights for policy 1, policy_version 1646811 (0.0009) [2023-12-28 07:04:10,058][106225] Updated weights for policy 1, policy_version 1646821 (0.0009) [2023-12-28 07:04:10,479][106226] Updated weights for policy 0, policy_version 1643102 (0.0007) [2023-12-28 07:04:10,543][106226] Updated weights for policy 0, policy_version 1643112 (0.0009) [2023-12-28 07:04:10,604][106226] Updated weights for policy 0, policy_version 1643122 (0.0009) [2023-12-28 07:04:10,717][106225] Updated weights for policy 1, policy_version 1646831 (0.0009) [2023-12-28 07:04:10,774][106225] Updated weights for policy 1, policy_version 1646841 (0.0008) [2023-12-28 07:04:10,830][106225] Updated weights for policy 1, policy_version 1646851 (0.0008) [2023-12-28 07:04:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 842366976. Throughput: 0: 9890.9, 1: 9891.7. Samples: 842337552. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:11,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-4.624')] [2023-12-28 07:04:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001646856_421650432.pth... [2023-12-28 07:04:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001643128_420716544.pth... [2023-12-28 07:04:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001645704_421355520.pth [2023-12-28 07:04:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001641976_420421632.pth [2023-12-28 07:04:11,333][106226] Updated weights for policy 0, policy_version 1643132 (0.0008) [2023-12-28 07:04:11,412][106226] Updated weights for policy 0, policy_version 1643142 (0.0007) [2023-12-28 07:04:11,478][106226] Updated weights for policy 0, policy_version 1643152 (0.0008) [2023-12-28 07:04:11,660][106225] Updated weights for policy 1, policy_version 1646861 (0.0009) [2023-12-28 07:04:11,729][106225] Updated weights for policy 1, policy_version 1646871 (0.0007) [2023-12-28 07:04:11,795][106225] Updated weights for policy 1, policy_version 1646881 (0.0008) [2023-12-28 07:04:12,228][106226] Updated weights for policy 0, policy_version 1643162 (0.0008) [2023-12-28 07:04:12,296][106226] Updated weights for policy 0, policy_version 1643172 (0.0009) [2023-12-28 07:04:12,365][106226] Updated weights for policy 0, policy_version 1643182 (0.0008) [2023-12-28 07:04:12,425][106226] Updated weights for policy 0, policy_version 1643192 (0.0006) [2023-12-28 07:04:12,548][106225] Updated weights for policy 1, policy_version 1646891 (0.0010) [2023-12-28 07:04:12,612][106225] Updated weights for policy 1, policy_version 1646901 (0.0010) [2023-12-28 07:04:12,676][106225] Updated weights for policy 1, policy_version 1646911 (0.0010) [2023-12-28 07:04:13,081][106226] Updated weights for policy 0, policy_version 1643202 (0.0008) [2023-12-28 07:04:13,132][106226] Updated weights for policy 0, policy_version 1643212 (0.0008) [2023-12-28 07:04:13,181][106226] Updated weights for policy 0, policy_version 1643222 (0.0007) [2023-12-28 07:04:13,338][106225] Updated weights for policy 1, policy_version 1646921 (0.0010) [2023-12-28 07:04:13,387][106225] Updated weights for policy 1, policy_version 1646931 (0.0010) [2023-12-28 07:04:13,432][106225] Updated weights for policy 1, policy_version 1646941 (0.0008) [2023-12-28 07:04:13,488][106225] Updated weights for policy 1, policy_version 1646951 (0.0010) [2023-12-28 07:04:13,861][106226] Updated weights for policy 0, policy_version 1643232 (0.0008) [2023-12-28 07:04:13,908][106226] Updated weights for policy 0, policy_version 1643242 (0.0008) [2023-12-28 07:04:13,956][106226] Updated weights for policy 0, policy_version 1643252 (0.0007) [2023-12-28 07:04:14,201][106225] Updated weights for policy 1, policy_version 1646961 (0.0008) [2023-12-28 07:04:14,258][106225] Updated weights for policy 1, policy_version 1646971 (0.0010) [2023-12-28 07:04:14,318][106225] Updated weights for policy 1, policy_version 1646981 (0.0010) [2023-12-28 07:04:14,609][106226] Updated weights for policy 0, policy_version 1643262 (0.0005) [2023-12-28 07:04:14,658][106226] Updated weights for policy 0, policy_version 1643272 (0.0005) [2023-12-28 07:04:14,714][106226] Updated weights for policy 0, policy_version 1643282 (0.0005) [2023-12-28 07:04:15,033][106225] Updated weights for policy 1, policy_version 1646991 (0.0011) [2023-12-28 07:04:15,096][106225] Updated weights for policy 1, policy_version 1647001 (0.0010) [2023-12-28 07:04:15,147][106225] Updated weights for policy 1, policy_version 1647011 (0.0010) [2023-12-28 07:04:15,359][106226] Updated weights for policy 0, policy_version 1643292 (0.0006) [2023-12-28 07:04:15,406][106226] Updated weights for policy 0, policy_version 1643302 (0.0008) [2023-12-28 07:04:15,455][106226] Updated weights for policy 0, policy_version 1643312 (0.0007) [2023-12-28 07:04:15,791][106225] Updated weights for policy 1, policy_version 1647021 (0.0009) [2023-12-28 07:04:15,848][106225] Updated weights for policy 1, policy_version 1647031 (0.0010) [2023-12-28 07:04:15,896][106225] Updated weights for policy 1, policy_version 1647041 (0.0010) [2023-12-28 07:04:16,127][106226] Updated weights for policy 0, policy_version 1643322 (0.0009) [2023-12-28 07:04:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 842465280. Throughput: 0: 9880.8, 1: 9752.7. Samples: 842455348. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:16,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.701')] [2023-12-28 07:04:16,186][106226] Updated weights for policy 0, policy_version 1643332 (0.0006) [2023-12-28 07:04:16,235][106226] Updated weights for policy 0, policy_version 1643342 (0.0009) [2023-12-28 07:04:16,299][106226] Updated weights for policy 0, policy_version 1643352 (0.0009) [2023-12-28 07:04:16,576][106225] Updated weights for policy 1, policy_version 1647051 (0.0009) [2023-12-28 07:04:16,631][106225] Updated weights for policy 1, policy_version 1647061 (0.0006) [2023-12-28 07:04:16,683][106225] Updated weights for policy 1, policy_version 1647071 (0.0007) [2023-12-28 07:04:16,957][106226] Updated weights for policy 0, policy_version 1643362 (0.0011) [2023-12-28 07:04:17,018][106226] Updated weights for policy 0, policy_version 1643372 (0.0011) [2023-12-28 07:04:17,071][106226] Updated weights for policy 0, policy_version 1643382 (0.0010) [2023-12-28 07:04:17,229][106225] Updated weights for policy 1, policy_version 1647081 (0.0005) [2023-12-28 07:04:17,282][106225] Updated weights for policy 1, policy_version 1647091 (0.0005) [2023-12-28 07:04:17,335][106225] Updated weights for policy 1, policy_version 1647101 (0.0006) [2023-12-28 07:04:17,381][106225] Updated weights for policy 1, policy_version 1647111 (0.0005) [2023-12-28 07:04:17,756][106226] Updated weights for policy 0, policy_version 1643392 (0.0011) [2023-12-28 07:04:17,810][106226] Updated weights for policy 0, policy_version 1643402 (0.0010) [2023-12-28 07:04:17,862][106226] Updated weights for policy 0, policy_version 1643412 (0.0010) [2023-12-28 07:04:17,945][106225] Updated weights for policy 1, policy_version 1647121 (0.0006) [2023-12-28 07:04:18,004][106225] Updated weights for policy 1, policy_version 1647131 (0.0007) [2023-12-28 07:04:18,062][106225] Updated weights for policy 1, policy_version 1647141 (0.0006) [2023-12-28 07:04:18,590][106226] Updated weights for policy 0, policy_version 1643422 (0.0011) [2023-12-28 07:04:18,644][106226] Updated weights for policy 0, policy_version 1643432 (0.0009) [2023-12-28 07:04:18,700][106226] Updated weights for policy 0, policy_version 1643442 (0.0008) [2023-12-28 07:04:18,735][106225] Updated weights for policy 1, policy_version 1647151 (0.0006) [2023-12-28 07:04:18,797][106225] Updated weights for policy 1, policy_version 1647161 (0.0008) [2023-12-28 07:04:18,860][106225] Updated weights for policy 1, policy_version 1647171 (0.0009) [2023-12-28 07:04:19,467][106226] Updated weights for policy 0, policy_version 1643452 (0.0009) [2023-12-28 07:04:19,531][106226] Updated weights for policy 0, policy_version 1643462 (0.0009) [2023-12-28 07:04:19,594][106226] Updated weights for policy 0, policy_version 1643472 (0.0010) [2023-12-28 07:04:19,619][106225] Updated weights for policy 1, policy_version 1647181 (0.0007) [2023-12-28 07:04:19,677][106225] Updated weights for policy 1, policy_version 1647191 (0.0007) [2023-12-28 07:04:19,743][106225] Updated weights for policy 1, policy_version 1647201 (0.0008) [2023-12-28 07:04:20,262][106226] Updated weights for policy 0, policy_version 1643482 (0.0010) [2023-12-28 07:04:20,323][106226] Updated weights for policy 0, policy_version 1643492 (0.0006) [2023-12-28 07:04:20,389][106226] Updated weights for policy 0, policy_version 1643502 (0.0007) [2023-12-28 07:04:20,461][106226] Updated weights for policy 0, policy_version 1643512 (0.0006) [2023-12-28 07:04:20,471][106225] Updated weights for policy 1, policy_version 1647211 (0.0008) [2023-12-28 07:04:20,535][106225] Updated weights for policy 1, policy_version 1647221 (0.0007) [2023-12-28 07:04:20,599][106225] Updated weights for policy 1, policy_version 1647231 (0.0008) [2023-12-28 07:04:21,171][106226] Updated weights for policy 0, policy_version 1643522 (0.0009) [2023-12-28 07:04:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 842563584. Throughput: 0: 9873.4, 1: 9829.5. Samples: 842577044. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:21,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.620')] [2023-12-28 07:04:21,229][106226] Updated weights for policy 0, policy_version 1643532 (0.0009) [2023-12-28 07:04:21,266][106225] Updated weights for policy 1, policy_version 1647241 (0.0007) [2023-12-28 07:04:21,293][106226] Updated weights for policy 0, policy_version 1643542 (0.0008) [2023-12-28 07:04:21,326][106225] Updated weights for policy 1, policy_version 1647251 (0.0008) [2023-12-28 07:04:21,397][106225] Updated weights for policy 1, policy_version 1647261 (0.0010) [2023-12-28 07:04:21,458][106225] Updated weights for policy 1, policy_version 1647271 (0.0008) [2023-12-28 07:04:22,061][106226] Updated weights for policy 0, policy_version 1643552 (0.0008) [2023-12-28 07:04:22,123][106226] Updated weights for policy 0, policy_version 1643562 (0.0008) [2023-12-28 07:04:22,153][106225] Updated weights for policy 1, policy_version 1647281 (0.0008) [2023-12-28 07:04:22,185][106226] Updated weights for policy 0, policy_version 1643572 (0.0007) [2023-12-28 07:04:22,219][106225] Updated weights for policy 1, policy_version 1647291 (0.0008) [2023-12-28 07:04:22,285][106225] Updated weights for policy 1, policy_version 1647301 (0.0009) [2023-12-28 07:04:22,998][106226] Updated weights for policy 0, policy_version 1643582 (0.0008) [2023-12-28 07:04:23,041][106225] Updated weights for policy 1, policy_version 1647311 (0.0007) [2023-12-28 07:04:23,060][106226] Updated weights for policy 0, policy_version 1643592 (0.0008) [2023-12-28 07:04:23,098][106225] Updated weights for policy 1, policy_version 1647321 (0.0008) [2023-12-28 07:04:23,112][106226] Updated weights for policy 0, policy_version 1643602 (0.0007) [2023-12-28 07:04:23,155][106225] Updated weights for policy 1, policy_version 1647331 (0.0006) [2023-12-28 07:04:23,846][106226] Updated weights for policy 0, policy_version 1643612 (0.0007) [2023-12-28 07:04:23,878][106225] Updated weights for policy 1, policy_version 1647341 (0.0009) [2023-12-28 07:04:23,892][106226] Updated weights for policy 0, policy_version 1643622 (0.0007) [2023-12-28 07:04:23,924][106225] Updated weights for policy 1, policy_version 1647351 (0.0010) [2023-12-28 07:04:23,933][106226] Updated weights for policy 0, policy_version 1643632 (0.0008) [2023-12-28 07:04:23,972][106225] Updated weights for policy 1, policy_version 1647361 (0.0009) [2023-12-28 07:04:24,606][106225] Updated weights for policy 1, policy_version 1647371 (0.0007) [2023-12-28 07:04:24,667][106225] Updated weights for policy 1, policy_version 1647381 (0.0010) [2023-12-28 07:04:24,725][106225] Updated weights for policy 1, policy_version 1647391 (0.0010) [2023-12-28 07:04:24,783][106226] Updated weights for policy 0, policy_version 1643642 (0.0008) [2023-12-28 07:04:24,847][106226] Updated weights for policy 0, policy_version 1643652 (0.0007) [2023-12-28 07:04:24,899][106226] Updated weights for policy 0, policy_version 1643662 (0.0009) [2023-12-28 07:04:24,951][106226] Updated weights for policy 0, policy_version 1643672 (0.0009) [2023-12-28 07:04:25,336][106225] Updated weights for policy 1, policy_version 1647401 (0.0011) [2023-12-28 07:04:25,392][106225] Updated weights for policy 1, policy_version 1647411 (0.0008) [2023-12-28 07:04:25,454][106225] Updated weights for policy 1, policy_version 1647421 (0.0007) [2023-12-28 07:04:25,517][106225] Updated weights for policy 1, policy_version 1647431 (0.0010) [2023-12-28 07:04:25,740][106226] Updated weights for policy 0, policy_version 1643682 (0.0008) [2023-12-28 07:04:25,787][106226] Updated weights for policy 0, policy_version 1643692 (0.0007) [2023-12-28 07:04:25,845][106226] Updated weights for policy 0, policy_version 1643702 (0.0008) [2023-12-28 07:04:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 842661888. Throughput: 0: 9849.3, 1: 9809.0. Samples: 842634024. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:26,176][105115] Avg episode reward: [(0, '-4.318'), (1, '-4.819')] [2023-12-28 07:04:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001643704_420864000.pth... [2023-12-28 07:04:26,189][106225] Updated weights for policy 1, policy_version 1647441 (0.0010) [2023-12-28 07:04:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001642552_420569088.pth [2023-12-28 07:04:26,246][106225] Updated weights for policy 1, policy_version 1647451 (0.0010) [2023-12-28 07:04:26,303][106225] Updated weights for policy 1, policy_version 1647461 (0.0010) [2023-12-28 07:04:26,320][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001647464_421806080.pth... [2023-12-28 07:04:26,324][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001646280_421502976.pth [2023-12-28 07:04:26,533][106226] Updated weights for policy 0, policy_version 1643712 (0.0008) [2023-12-28 07:04:26,582][106226] Updated weights for policy 0, policy_version 1643722 (0.0007) [2023-12-28 07:04:26,624][106226] Updated weights for policy 0, policy_version 1643732 (0.0007) [2023-12-28 07:04:27,014][106225] Updated weights for policy 1, policy_version 1647471 (0.0010) [2023-12-28 07:04:27,066][106225] Updated weights for policy 1, policy_version 1647481 (0.0010) [2023-12-28 07:04:27,122][106225] Updated weights for policy 1, policy_version 1647491 (0.0010) [2023-12-28 07:04:27,362][106226] Updated weights for policy 0, policy_version 1643742 (0.0006) [2023-12-28 07:04:27,412][106226] Updated weights for policy 0, policy_version 1643752 (0.0005) [2023-12-28 07:04:27,477][106226] Updated weights for policy 0, policy_version 1643762 (0.0005) [2023-12-28 07:04:27,846][106225] Updated weights for policy 1, policy_version 1647501 (0.0010) [2023-12-28 07:04:27,892][106225] Updated weights for policy 1, policy_version 1647511 (0.0010) [2023-12-28 07:04:27,938][106225] Updated weights for policy 1, policy_version 1647521 (0.0010) [2023-12-28 07:04:28,012][106226] Updated weights for policy 0, policy_version 1643772 (0.0006) [2023-12-28 07:04:28,070][106226] Updated weights for policy 0, policy_version 1643782 (0.0008) [2023-12-28 07:04:28,126][106226] Updated weights for policy 0, policy_version 1643792 (0.0007) [2023-12-28 07:04:28,682][106225] Updated weights for policy 1, policy_version 1647531 (0.0010) [2023-12-28 07:04:28,749][106225] Updated weights for policy 1, policy_version 1647541 (0.0011) [2023-12-28 07:04:28,804][106226] Updated weights for policy 0, policy_version 1643802 (0.0007) [2023-12-28 07:04:28,807][106225] Updated weights for policy 1, policy_version 1647551 (0.0010) [2023-12-28 07:04:28,863][106226] Updated weights for policy 0, policy_version 1643812 (0.0006) [2023-12-28 07:04:28,922][106226] Updated weights for policy 0, policy_version 1643822 (0.0007) [2023-12-28 07:04:28,980][106226] Updated weights for policy 0, policy_version 1643832 (0.0007) [2023-12-28 07:04:29,511][106225] Updated weights for policy 1, policy_version 1647561 (0.0010) [2023-12-28 07:04:29,573][106225] Updated weights for policy 1, policy_version 1647571 (0.0009) [2023-12-28 07:04:29,629][106225] Updated weights for policy 1, policy_version 1647581 (0.0008) [2023-12-28 07:04:29,674][106225] Updated weights for policy 1, policy_version 1647591 (0.0007) [2023-12-28 07:04:29,683][106226] Updated weights for policy 0, policy_version 1643842 (0.0008) [2023-12-28 07:04:29,745][106226] Updated weights for policy 0, policy_version 1643852 (0.0007) [2023-12-28 07:04:29,807][106226] Updated weights for policy 0, policy_version 1643862 (0.0005) [2023-12-28 07:04:30,446][106225] Updated weights for policy 1, policy_version 1647601 (0.0008) [2023-12-28 07:04:30,500][106225] Updated weights for policy 1, policy_version 1647611 (0.0008) [2023-12-28 07:04:30,508][106226] Updated weights for policy 0, policy_version 1643872 (0.0006) [2023-12-28 07:04:30,559][106226] Updated weights for policy 0, policy_version 1643882 (0.0005) [2023-12-28 07:04:30,562][106225] Updated weights for policy 1, policy_version 1647621 (0.0008) [2023-12-28 07:04:30,610][106226] Updated weights for policy 0, policy_version 1643892 (0.0005) [2023-12-28 07:04:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 842760192. Throughput: 0: 9888.1, 1: 9890.3. Samples: 842754068. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:31,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.811')] [2023-12-28 07:04:31,194][106225] Updated weights for policy 1, policy_version 1647631 (0.0007) [2023-12-28 07:04:31,254][106225] Updated weights for policy 1, policy_version 1647641 (0.0006) [2023-12-28 07:04:31,263][106226] Updated weights for policy 0, policy_version 1643902 (0.0006) [2023-12-28 07:04:31,315][106225] Updated weights for policy 1, policy_version 1647651 (0.0007) [2023-12-28 07:04:31,325][106226] Updated weights for policy 0, policy_version 1643912 (0.0006) [2023-12-28 07:04:31,395][106226] Updated weights for policy 0, policy_version 1643922 (0.0008) [2023-12-28 07:04:31,996][106225] Updated weights for policy 1, policy_version 1647661 (0.0006) [2023-12-28 07:04:32,054][106225] Updated weights for policy 1, policy_version 1647671 (0.0007) [2023-12-28 07:04:32,100][106226] Updated weights for policy 0, policy_version 1643932 (0.0007) [2023-12-28 07:04:32,107][106225] Updated weights for policy 1, policy_version 1647681 (0.0007) [2023-12-28 07:04:32,163][106226] Updated weights for policy 0, policy_version 1643942 (0.0008) [2023-12-28 07:04:32,227][106226] Updated weights for policy 0, policy_version 1643952 (0.0009) [2023-12-28 07:04:32,872][106225] Updated weights for policy 1, policy_version 1647691 (0.0006) [2023-12-28 07:04:32,907][106226] Updated weights for policy 0, policy_version 1643962 (0.0009) [2023-12-28 07:04:32,924][106225] Updated weights for policy 1, policy_version 1647701 (0.0005) [2023-12-28 07:04:32,959][106226] Updated weights for policy 0, policy_version 1643972 (0.0007) [2023-12-28 07:04:32,977][106225] Updated weights for policy 1, policy_version 1647711 (0.0006) [2023-12-28 07:04:33,017][106226] Updated weights for policy 0, policy_version 1643982 (0.0007) [2023-12-28 07:04:33,068][106226] Updated weights for policy 0, policy_version 1643992 (0.0008) [2023-12-28 07:04:33,593][106225] Updated weights for policy 1, policy_version 1647721 (0.0008) [2023-12-28 07:04:33,650][106225] Updated weights for policy 1, policy_version 1647731 (0.0005) [2023-12-28 07:04:33,705][106225] Updated weights for policy 1, policy_version 1647741 (0.0005) [2023-12-28 07:04:33,759][106225] Updated weights for policy 1, policy_version 1647751 (0.0005) [2023-12-28 07:04:33,855][106226] Updated weights for policy 0, policy_version 1644002 (0.0009) [2023-12-28 07:04:33,920][106226] Updated weights for policy 0, policy_version 1644012 (0.0008) [2023-12-28 07:04:33,980][106226] Updated weights for policy 0, policy_version 1644022 (0.0009) [2023-12-28 07:04:34,449][106225] Updated weights for policy 1, policy_version 1647761 (0.0008) [2023-12-28 07:04:34,512][106225] Updated weights for policy 1, policy_version 1647771 (0.0008) [2023-12-28 07:04:34,580][106225] Updated weights for policy 1, policy_version 1647781 (0.0008) [2023-12-28 07:04:34,702][106226] Updated weights for policy 0, policy_version 1644032 (0.0007) [2023-12-28 07:04:34,757][106226] Updated weights for policy 0, policy_version 1644042 (0.0008) [2023-12-28 07:04:34,810][106226] Updated weights for policy 0, policy_version 1644052 (0.0009) [2023-12-28 07:04:35,337][106225] Updated weights for policy 1, policy_version 1647791 (0.0008) [2023-12-28 07:04:35,394][106225] Updated weights for policy 1, policy_version 1647801 (0.0008) [2023-12-28 07:04:35,452][106225] Updated weights for policy 1, policy_version 1647811 (0.0009) [2023-12-28 07:04:35,490][106226] Updated weights for policy 0, policy_version 1644062 (0.0008) [2023-12-28 07:04:35,543][106226] Updated weights for policy 0, policy_version 1644072 (0.0010) [2023-12-28 07:04:35,593][106226] Updated weights for policy 0, policy_version 1644082 (0.0010) [2023-12-28 07:04:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 842858496. Throughput: 0: 9862.0, 1: 9909.5. Samples: 842872856. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:36,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.613')] [2023-12-28 07:04:36,194][106225] Updated weights for policy 1, policy_version 1647821 (0.0008) [2023-12-28 07:04:36,263][106225] Updated weights for policy 1, policy_version 1647831 (0.0008) [2023-12-28 07:04:36,304][106226] Updated weights for policy 0, policy_version 1644092 (0.0010) [2023-12-28 07:04:36,329][106225] Updated weights for policy 1, policy_version 1647841 (0.0006) [2023-12-28 07:04:36,369][106226] Updated weights for policy 0, policy_version 1644102 (0.0011) [2023-12-28 07:04:36,431][106226] Updated weights for policy 0, policy_version 1644112 (0.0011) [2023-12-28 07:04:36,943][106225] Updated weights for policy 1, policy_version 1647851 (0.0006) [2023-12-28 07:04:37,004][106225] Updated weights for policy 1, policy_version 1647861 (0.0007) [2023-12-28 07:04:37,062][106225] Updated weights for policy 1, policy_version 1647871 (0.0007) [2023-12-28 07:04:37,147][106226] Updated weights for policy 0, policy_version 1644122 (0.0010) [2023-12-28 07:04:37,213][106226] Updated weights for policy 0, policy_version 1644132 (0.0005) [2023-12-28 07:04:37,273][106226] Updated weights for policy 0, policy_version 1644142 (0.0006) [2023-12-28 07:04:37,332][106226] Updated weights for policy 0, policy_version 1644152 (0.0005) [2023-12-28 07:04:37,797][106225] Updated weights for policy 1, policy_version 1647881 (0.0007) [2023-12-28 07:04:37,858][106225] Updated weights for policy 1, policy_version 1647891 (0.0008) [2023-12-28 07:04:37,919][106225] Updated weights for policy 1, policy_version 1647901 (0.0008) [2023-12-28 07:04:37,974][106226] Updated weights for policy 0, policy_version 1644162 (0.0011) [2023-12-28 07:04:37,984][106225] Updated weights for policy 1, policy_version 1647911 (0.0006) [2023-12-28 07:04:38,026][106226] Updated weights for policy 0, policy_version 1644172 (0.0008) [2023-12-28 07:04:38,079][106226] Updated weights for policy 0, policy_version 1644182 (0.0005) [2023-12-28 07:04:38,643][106225] Updated weights for policy 1, policy_version 1647921 (0.0007) [2023-12-28 07:04:38,698][106225] Updated weights for policy 1, policy_version 1647931 (0.0008) [2023-12-28 07:04:38,754][106225] Updated weights for policy 1, policy_version 1647941 (0.0008) [2023-12-28 07:04:38,799][106226] Updated weights for policy 0, policy_version 1644192 (0.0011) [2023-12-28 07:04:38,859][106226] Updated weights for policy 0, policy_version 1644202 (0.0011) [2023-12-28 07:04:38,923][106226] Updated weights for policy 0, policy_version 1644212 (0.0010) [2023-12-28 07:04:39,485][106225] Updated weights for policy 1, policy_version 1647951 (0.0008) [2023-12-28 07:04:39,555][106225] Updated weights for policy 1, policy_version 1647961 (0.0007) [2023-12-28 07:04:39,617][106225] Updated weights for policy 1, policy_version 1647971 (0.0006) [2023-12-28 07:04:39,668][106226] Updated weights for policy 0, policy_version 1644222 (0.0010) [2023-12-28 07:04:39,728][106226] Updated weights for policy 0, policy_version 1644232 (0.0008) [2023-12-28 07:04:39,791][106226] Updated weights for policy 0, policy_version 1644242 (0.0008) [2023-12-28 07:04:40,324][106225] Updated weights for policy 1, policy_version 1647981 (0.0007) [2023-12-28 07:04:40,388][106225] Updated weights for policy 1, policy_version 1647991 (0.0008) [2023-12-28 07:04:40,447][106225] Updated weights for policy 1, policy_version 1648001 (0.0008) [2023-12-28 07:04:40,575][106226] Updated weights for policy 0, policy_version 1644252 (0.0007) [2023-12-28 07:04:40,633][106226] Updated weights for policy 0, policy_version 1644262 (0.0005) [2023-12-28 07:04:40,694][106226] Updated weights for policy 0, policy_version 1644272 (0.0008) [2023-12-28 07:04:41,123][106225] Updated weights for policy 1, policy_version 1648011 (0.0009) [2023-12-28 07:04:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 842956800. Throughput: 0: 9868.0, 1: 9908.4. Samples: 842932184. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:41,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.392')] [2023-12-28 07:04:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001644280_421011456.pth... [2023-12-28 07:04:41,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001643128_420716544.pth [2023-12-28 07:04:41,195][106225] Updated weights for policy 1, policy_version 1648021 (0.0009) [2023-12-28 07:04:41,252][106225] Updated weights for policy 1, policy_version 1648031 (0.0009) [2023-12-28 07:04:41,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001648040_421953536.pth... [2023-12-28 07:04:41,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001646856_421650432.pth [2023-12-28 07:04:41,447][106226] Updated weights for policy 0, policy_version 1644282 (0.0008) [2023-12-28 07:04:41,515][106226] Updated weights for policy 0, policy_version 1644292 (0.0009) [2023-12-28 07:04:41,573][106226] Updated weights for policy 0, policy_version 1644302 (0.0010) [2023-12-28 07:04:41,641][106226] Updated weights for policy 0, policy_version 1644312 (0.0009) [2023-12-28 07:04:42,076][106225] Updated weights for policy 1, policy_version 1648041 (0.0009) [2023-12-28 07:04:42,138][106225] Updated weights for policy 1, policy_version 1648051 (0.0009) [2023-12-28 07:04:42,193][106225] Updated weights for policy 1, policy_version 1648061 (0.0007) [2023-12-28 07:04:42,245][106225] Updated weights for policy 1, policy_version 1648071 (0.0006) [2023-12-28 07:04:42,371][106226] Updated weights for policy 0, policy_version 1644322 (0.0009) [2023-12-28 07:04:42,432][106226] Updated weights for policy 0, policy_version 1644332 (0.0009) [2023-12-28 07:04:42,499][106226] Updated weights for policy 0, policy_version 1644342 (0.0009) [2023-12-28 07:04:42,957][106225] Updated weights for policy 1, policy_version 1648081 (0.0006) [2023-12-28 07:04:43,014][106225] Updated weights for policy 1, policy_version 1648091 (0.0005) [2023-12-28 07:04:43,075][106225] Updated weights for policy 1, policy_version 1648101 (0.0005) [2023-12-28 07:04:43,116][106226] Updated weights for policy 0, policy_version 1644352 (0.0008) [2023-12-28 07:04:43,162][106226] Updated weights for policy 0, policy_version 1644362 (0.0006) [2023-12-28 07:04:43,210][106226] Updated weights for policy 0, policy_version 1644372 (0.0005) [2023-12-28 07:04:43,656][106225] Updated weights for policy 1, policy_version 1648111 (0.0005) [2023-12-28 07:04:43,713][106225] Updated weights for policy 1, policy_version 1648121 (0.0005) [2023-12-28 07:04:43,769][106225] Updated weights for policy 1, policy_version 1648131 (0.0005) [2023-12-28 07:04:43,889][106226] Updated weights for policy 0, policy_version 1644382 (0.0008) [2023-12-28 07:04:43,944][106226] Updated weights for policy 0, policy_version 1644392 (0.0008) [2023-12-28 07:04:43,997][106226] Updated weights for policy 0, policy_version 1644402 (0.0008) [2023-12-28 07:04:44,332][106225] Updated weights for policy 1, policy_version 1648141 (0.0006) [2023-12-28 07:04:44,393][106225] Updated weights for policy 1, policy_version 1648151 (0.0009) [2023-12-28 07:04:44,447][106225] Updated weights for policy 1, policy_version 1648161 (0.0007) [2023-12-28 07:04:44,735][106226] Updated weights for policy 0, policy_version 1644412 (0.0006) [2023-12-28 07:04:44,806][106226] Updated weights for policy 0, policy_version 1644422 (0.0009) [2023-12-28 07:04:44,869][106226] Updated weights for policy 0, policy_version 1644432 (0.0009) [2023-12-28 07:04:45,179][106225] Updated weights for policy 1, policy_version 1648171 (0.0006) [2023-12-28 07:04:45,246][106225] Updated weights for policy 1, policy_version 1648181 (0.0006) [2023-12-28 07:04:45,309][106225] Updated weights for policy 1, policy_version 1648191 (0.0005) [2023-12-28 07:04:45,664][106226] Updated weights for policy 0, policy_version 1644442 (0.0009) [2023-12-28 07:04:45,728][106226] Updated weights for policy 0, policy_version 1644452 (0.0009) [2023-12-28 07:04:45,786][106226] Updated weights for policy 0, policy_version 1644462 (0.0009) [2023-12-28 07:04:45,847][106226] Updated weights for policy 0, policy_version 1644472 (0.0008) [2023-12-28 07:04:45,889][106225] Updated weights for policy 1, policy_version 1648201 (0.0006) [2023-12-28 07:04:45,938][106225] Updated weights for policy 1, policy_version 1648211 (0.0008) [2023-12-28 07:04:45,988][106225] Updated weights for policy 1, policy_version 1648221 (0.0008) [2023-12-28 07:04:46,037][106225] Updated weights for policy 1, policy_version 1648231 (0.0008) [2023-12-28 07:04:46,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 843063296. Throughput: 0: 9880.2, 1: 9953.0. Samples: 843049880. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:46,176][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.807')] [2023-12-28 07:04:46,484][106226] Updated weights for policy 0, policy_version 1644482 (0.0009) [2023-12-28 07:04:46,541][106226] Updated weights for policy 0, policy_version 1644492 (0.0009) [2023-12-28 07:04:46,603][106226] Updated weights for policy 0, policy_version 1644502 (0.0008) [2023-12-28 07:04:46,808][106225] Updated weights for policy 1, policy_version 1648241 (0.0008) [2023-12-28 07:04:46,870][106225] Updated weights for policy 1, policy_version 1648251 (0.0008) [2023-12-28 07:04:46,930][106225] Updated weights for policy 1, policy_version 1648261 (0.0008) [2023-12-28 07:04:47,355][106226] Updated weights for policy 0, policy_version 1644512 (0.0008) [2023-12-28 07:04:47,416][106226] Updated weights for policy 0, policy_version 1644522 (0.0009) [2023-12-28 07:04:47,474][106226] Updated weights for policy 0, policy_version 1644532 (0.0008) [2023-12-28 07:04:47,601][106225] Updated weights for policy 1, policy_version 1648271 (0.0007) [2023-12-28 07:04:47,663][106225] Updated weights for policy 1, policy_version 1648281 (0.0009) [2023-12-28 07:04:47,720][106225] Updated weights for policy 1, policy_version 1648291 (0.0008) [2023-12-28 07:04:48,110][106226] Updated weights for policy 0, policy_version 1644542 (0.0008) [2023-12-28 07:04:48,168][106226] Updated weights for policy 0, policy_version 1644552 (0.0009) [2023-12-28 07:04:48,223][106226] Updated weights for policy 0, policy_version 1644562 (0.0009) [2023-12-28 07:04:48,310][106225] Updated weights for policy 1, policy_version 1648301 (0.0006) [2023-12-28 07:04:48,373][106225] Updated weights for policy 1, policy_version 1648311 (0.0008) [2023-12-28 07:04:48,431][106225] Updated weights for policy 1, policy_version 1648321 (0.0007) [2023-12-28 07:04:48,929][106226] Updated weights for policy 0, policy_version 1644572 (0.0007) [2023-12-28 07:04:48,980][106226] Updated weights for policy 0, policy_version 1644582 (0.0008) [2023-12-28 07:04:49,036][106226] Updated weights for policy 0, policy_version 1644592 (0.0007) [2023-12-28 07:04:49,125][106225] Updated weights for policy 1, policy_version 1648331 (0.0008) [2023-12-28 07:04:49,178][106225] Updated weights for policy 1, policy_version 1648341 (0.0009) [2023-12-28 07:04:49,244][106225] Updated weights for policy 1, policy_version 1648351 (0.0008) [2023-12-28 07:04:49,768][106226] Updated weights for policy 0, policy_version 1644602 (0.0009) [2023-12-28 07:04:49,832][106226] Updated weights for policy 0, policy_version 1644612 (0.0009) [2023-12-28 07:04:49,895][106226] Updated weights for policy 0, policy_version 1644622 (0.0010) [2023-12-28 07:04:49,970][106226] Updated weights for policy 0, policy_version 1644632 (0.0009) [2023-12-28 07:04:50,039][106225] Updated weights for policy 1, policy_version 1648361 (0.0009) [2023-12-28 07:04:50,098][106225] Updated weights for policy 1, policy_version 1648371 (0.0008) [2023-12-28 07:04:50,162][106225] Updated weights for policy 1, policy_version 1648381 (0.0009) [2023-12-28 07:04:50,226][106225] Updated weights for policy 1, policy_version 1648391 (0.0009) [2023-12-28 07:04:50,752][106226] Updated weights for policy 0, policy_version 1644642 (0.0008) [2023-12-28 07:04:50,815][106226] Updated weights for policy 0, policy_version 1644652 (0.0008) [2023-12-28 07:04:50,875][106226] Updated weights for policy 0, policy_version 1644662 (0.0008) [2023-12-28 07:04:50,973][106225] Updated weights for policy 1, policy_version 1648401 (0.0008) [2023-12-28 07:04:51,037][106225] Updated weights for policy 1, policy_version 1648411 (0.0008) [2023-12-28 07:04:51,108][106225] Updated weights for policy 1, policy_version 1648421 (0.0009) [2023-12-28 07:04:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 843161600. Throughput: 0: 9744.1, 1: 9985.2. Samples: 843166772. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:51,175][105115] Avg episode reward: [(0, '-4.756'), (1, '-4.508')] [2023-12-28 07:04:51,557][106226] Updated weights for policy 0, policy_version 1644672 (0.0008) [2023-12-28 07:04:51,623][106226] Updated weights for policy 0, policy_version 1644682 (0.0008) [2023-12-28 07:04:51,683][106226] Updated weights for policy 0, policy_version 1644692 (0.0007) [2023-12-28 07:04:51,868][106225] Updated weights for policy 1, policy_version 1648431 (0.0006) [2023-12-28 07:04:51,924][106225] Updated weights for policy 1, policy_version 1648441 (0.0009) [2023-12-28 07:04:51,987][106225] Updated weights for policy 1, policy_version 1648451 (0.0010) [2023-12-28 07:04:52,400][106226] Updated weights for policy 0, policy_version 1644702 (0.0008) [2023-12-28 07:04:52,460][106226] Updated weights for policy 0, policy_version 1644712 (0.0008) [2023-12-28 07:04:52,525][106226] Updated weights for policy 0, policy_version 1644722 (0.0008) [2023-12-28 07:04:52,698][106225] Updated weights for policy 1, policy_version 1648461 (0.0007) [2023-12-28 07:04:52,755][106225] Updated weights for policy 1, policy_version 1648471 (0.0008) [2023-12-28 07:04:52,822][106225] Updated weights for policy 1, policy_version 1648481 (0.0010) [2023-12-28 07:04:53,269][106226] Updated weights for policy 0, policy_version 1644732 (0.0009) [2023-12-28 07:04:53,335][106226] Updated weights for policy 0, policy_version 1644742 (0.0006) [2023-12-28 07:04:53,397][106226] Updated weights for policy 0, policy_version 1644752 (0.0006) [2023-12-28 07:04:53,438][106225] Updated weights for policy 1, policy_version 1648491 (0.0008) [2023-12-28 07:04:53,498][106225] Updated weights for policy 1, policy_version 1648501 (0.0008) [2023-12-28 07:04:53,551][106225] Updated weights for policy 1, policy_version 1648511 (0.0010) [2023-12-28 07:04:53,982][106226] Updated weights for policy 0, policy_version 1644762 (0.0006) [2023-12-28 07:04:54,044][106226] Updated weights for policy 0, policy_version 1644772 (0.0010) [2023-12-28 07:04:54,104][106226] Updated weights for policy 0, policy_version 1644782 (0.0010) [2023-12-28 07:04:54,164][106226] Updated weights for policy 0, policy_version 1644792 (0.0011) [2023-12-28 07:04:54,305][106225] Updated weights for policy 1, policy_version 1648521 (0.0009) [2023-12-28 07:04:54,365][106225] Updated weights for policy 1, policy_version 1648531 (0.0007) [2023-12-28 07:04:54,422][106225] Updated weights for policy 1, policy_version 1648541 (0.0007) [2023-12-28 07:04:54,479][106225] Updated weights for policy 1, policy_version 1648551 (0.0008) [2023-12-28 07:04:54,855][106226] Updated weights for policy 0, policy_version 1644802 (0.0011) [2023-12-28 07:04:54,923][106226] Updated weights for policy 0, policy_version 1644812 (0.0010) [2023-12-28 07:04:54,988][106226] Updated weights for policy 0, policy_version 1644822 (0.0006) [2023-12-28 07:04:55,305][106225] Updated weights for policy 1, policy_version 1648561 (0.0007) [2023-12-28 07:04:55,370][106225] Updated weights for policy 1, policy_version 1648571 (0.0008) [2023-12-28 07:04:55,431][106225] Updated weights for policy 1, policy_version 1648581 (0.0008) [2023-12-28 07:04:55,623][106226] Updated weights for policy 0, policy_version 1644832 (0.0010) [2023-12-28 07:04:55,676][106226] Updated weights for policy 0, policy_version 1644842 (0.0011) [2023-12-28 07:04:55,728][106226] Updated weights for policy 0, policy_version 1644852 (0.0006) [2023-12-28 07:04:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 843251712. Throughput: 0: 9774.0, 1: 9973.3. Samples: 843226180. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:04:56,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.891')] [2023-12-28 07:04:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001644856_421158912.pth... [2023-12-28 07:04:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001643704_420864000.pth [2023-12-28 07:04:56,195][106225] Updated weights for policy 1, policy_version 1648591 (0.0008) [2023-12-28 07:04:56,242][106225] Updated weights for policy 1, policy_version 1648601 (0.0008) [2023-12-28 07:04:56,299][106225] Updated weights for policy 1, policy_version 1648611 (0.0007) [2023-12-28 07:04:56,324][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001648616_422100992.pth... [2023-12-28 07:04:56,328][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001647464_421806080.pth [2023-12-28 07:04:56,388][106226] Updated weights for policy 0, policy_version 1644862 (0.0005) [2023-12-28 07:04:56,440][106226] Updated weights for policy 0, policy_version 1644872 (0.0005) [2023-12-28 07:04:56,488][106226] Updated weights for policy 0, policy_version 1644882 (0.0005) [2023-12-28 07:04:57,021][106226] Updated weights for policy 0, policy_version 1644892 (0.0007) [2023-12-28 07:04:57,022][106225] Updated weights for policy 1, policy_version 1648621 (0.0007) [2023-12-28 07:04:57,074][106226] Updated weights for policy 0, policy_version 1644902 (0.0010) [2023-12-28 07:04:57,076][106225] Updated weights for policy 1, policy_version 1648631 (0.0006) [2023-12-28 07:04:57,123][106226] Updated weights for policy 0, policy_version 1644912 (0.0010) [2023-12-28 07:04:57,129][106225] Updated weights for policy 1, policy_version 1648641 (0.0005) [2023-12-28 07:04:57,720][106226] Updated weights for policy 0, policy_version 1644922 (0.0010) [2023-12-28 07:04:57,769][106226] Updated weights for policy 0, policy_version 1644932 (0.0010) [2023-12-28 07:04:57,815][106226] Updated weights for policy 0, policy_version 1644942 (0.0010) [2023-12-28 07:04:57,870][106226] Updated weights for policy 0, policy_version 1644952 (0.0010) [2023-12-28 07:04:57,872][106225] Updated weights for policy 1, policy_version 1648651 (0.0005) [2023-12-28 07:04:57,924][106225] Updated weights for policy 1, policy_version 1648661 (0.0008) [2023-12-28 07:04:57,984][106225] Updated weights for policy 1, policy_version 1648671 (0.0007) [2023-12-28 07:04:58,592][106226] Updated weights for policy 0, policy_version 1644962 (0.0011) [2023-12-28 07:04:58,657][106226] Updated weights for policy 0, policy_version 1644972 (0.0009) [2023-12-28 07:04:58,730][106226] Updated weights for policy 0, policy_version 1644982 (0.0008) [2023-12-28 07:04:58,753][106225] Updated weights for policy 1, policy_version 1648681 (0.0008) [2023-12-28 07:04:58,825][106225] Updated weights for policy 1, policy_version 1648691 (0.0008) [2023-12-28 07:04:58,895][106225] Updated weights for policy 1, policy_version 1648701 (0.0007) [2023-12-28 07:04:58,957][106225] Updated weights for policy 1, policy_version 1648711 (0.0009) [2023-12-28 07:04:59,473][106226] Updated weights for policy 0, policy_version 1644992 (0.0006) [2023-12-28 07:04:59,538][106226] Updated weights for policy 0, policy_version 1645002 (0.0005) [2023-12-28 07:04:59,603][106226] Updated weights for policy 0, policy_version 1645012 (0.0005) [2023-12-28 07:04:59,767][106225] Updated weights for policy 1, policy_version 1648721 (0.0011) [2023-12-28 07:04:59,829][106225] Updated weights for policy 1, policy_version 1648731 (0.0010) [2023-12-28 07:04:59,895][106225] Updated weights for policy 1, policy_version 1648741 (0.0011) [2023-12-28 07:05:00,235][106226] Updated weights for policy 0, policy_version 1645022 (0.0008) [2023-12-28 07:05:00,285][106226] Updated weights for policy 0, policy_version 1645032 (0.0009) [2023-12-28 07:05:00,334][106226] Updated weights for policy 0, policy_version 1645042 (0.0006) [2023-12-28 07:05:00,626][106225] Updated weights for policy 1, policy_version 1648751 (0.0008) [2023-12-28 07:05:00,686][106225] Updated weights for policy 1, policy_version 1648761 (0.0005) [2023-12-28 07:05:00,732][106225] Updated weights for policy 1, policy_version 1648771 (0.0005) [2023-12-28 07:05:01,033][106226] Updated weights for policy 0, policy_version 1645052 (0.0007) [2023-12-28 07:05:01,101][106226] Updated weights for policy 0, policy_version 1645062 (0.0008) [2023-12-28 07:05:01,166][106226] Updated weights for policy 0, policy_version 1645072 (0.0007) [2023-12-28 07:05:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 843350016. Throughput: 0: 9855.5, 1: 9906.3. Samples: 843344628. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:01,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.896')] [2023-12-28 07:05:01,334][106225] Updated weights for policy 1, policy_version 1648781 (0.0006) [2023-12-28 07:05:01,412][106225] Updated weights for policy 1, policy_version 1648791 (0.0007) [2023-12-28 07:05:01,463][106225] Updated weights for policy 1, policy_version 1648801 (0.0009) [2023-12-28 07:05:01,872][106226] Updated weights for policy 0, policy_version 1645082 (0.0009) [2023-12-28 07:05:01,925][106226] Updated weights for policy 0, policy_version 1645092 (0.0010) [2023-12-28 07:05:01,979][106226] Updated weights for policy 0, policy_version 1645102 (0.0010) [2023-12-28 07:05:02,046][106226] Updated weights for policy 0, policy_version 1645112 (0.0011) [2023-12-28 07:05:02,221][106225] Updated weights for policy 1, policy_version 1648811 (0.0007) [2023-12-28 07:05:02,281][106225] Updated weights for policy 1, policy_version 1648821 (0.0007) [2023-12-28 07:05:02,331][106225] Updated weights for policy 1, policy_version 1648831 (0.0007) [2023-12-28 07:05:02,777][106226] Updated weights for policy 0, policy_version 1645122 (0.0007) [2023-12-28 07:05:02,831][106226] Updated weights for policy 0, policy_version 1645132 (0.0010) [2023-12-28 07:05:02,885][106226] Updated weights for policy 0, policy_version 1645142 (0.0010) [2023-12-28 07:05:02,982][106225] Updated weights for policy 1, policy_version 1648841 (0.0007) [2023-12-28 07:05:03,039][106225] Updated weights for policy 1, policy_version 1648851 (0.0005) [2023-12-28 07:05:03,097][106225] Updated weights for policy 1, policy_version 1648861 (0.0005) [2023-12-28 07:05:03,156][106225] Updated weights for policy 1, policy_version 1648871 (0.0005) [2023-12-28 07:05:03,545][106226] Updated weights for policy 0, policy_version 1645152 (0.0009) [2023-12-28 07:05:03,599][106226] Updated weights for policy 0, policy_version 1645162 (0.0007) [2023-12-28 07:05:03,653][106226] Updated weights for policy 0, policy_version 1645172 (0.0008) [2023-12-28 07:05:03,789][106225] Updated weights for policy 1, policy_version 1648881 (0.0006) [2023-12-28 07:05:03,850][106225] Updated weights for policy 1, policy_version 1648891 (0.0006) [2023-12-28 07:05:03,910][106225] Updated weights for policy 1, policy_version 1648901 (0.0008) [2023-12-28 07:05:04,382][106226] Updated weights for policy 0, policy_version 1645182 (0.0007) [2023-12-28 07:05:04,447][106226] Updated weights for policy 0, policy_version 1645192 (0.0006) [2023-12-28 07:05:04,506][106226] Updated weights for policy 0, policy_version 1645202 (0.0006) [2023-12-28 07:05:04,626][106225] Updated weights for policy 1, policy_version 1648911 (0.0011) [2023-12-28 07:05:04,687][106225] Updated weights for policy 1, policy_version 1648921 (0.0010) [2023-12-28 07:05:04,754][106225] Updated weights for policy 1, policy_version 1648931 (0.0010) [2023-12-28 07:05:05,086][106226] Updated weights for policy 0, policy_version 1645212 (0.0007) [2023-12-28 07:05:05,147][106226] Updated weights for policy 0, policy_version 1645222 (0.0008) [2023-12-28 07:05:05,209][106226] Updated weights for policy 0, policy_version 1645232 (0.0007) [2023-12-28 07:05:05,446][106225] Updated weights for policy 1, policy_version 1648941 (0.0010) [2023-12-28 07:05:05,511][106225] Updated weights for policy 1, policy_version 1648951 (0.0008) [2023-12-28 07:05:05,569][106225] Updated weights for policy 1, policy_version 1648961 (0.0008) [2023-12-28 07:05:05,906][106226] Updated weights for policy 0, policy_version 1645242 (0.0008) [2023-12-28 07:05:05,960][106226] Updated weights for policy 0, policy_version 1645252 (0.0008) [2023-12-28 07:05:06,007][106226] Updated weights for policy 0, policy_version 1645262 (0.0008) [2023-12-28 07:05:06,070][106226] Updated weights for policy 0, policy_version 1645272 (0.0010) [2023-12-28 07:05:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 843456512. Throughput: 0: 9867.0, 1: 9851.6. Samples: 843464384. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:06,175][105115] Avg episode reward: [(0, '-4.667'), (1, '-4.769')] [2023-12-28 07:05:06,265][106225] Updated weights for policy 1, policy_version 1648971 (0.0009) [2023-12-28 07:05:06,332][106225] Updated weights for policy 1, policy_version 1648981 (0.0010) [2023-12-28 07:05:06,396][106225] Updated weights for policy 1, policy_version 1648991 (0.0010) [2023-12-28 07:05:06,831][106226] Updated weights for policy 0, policy_version 1645282 (0.0008) [2023-12-28 07:05:06,879][106226] Updated weights for policy 0, policy_version 1645292 (0.0008) [2023-12-28 07:05:06,930][106226] Updated weights for policy 0, policy_version 1645302 (0.0008) [2023-12-28 07:05:07,107][106225] Updated weights for policy 1, policy_version 1649001 (0.0010) [2023-12-28 07:05:07,167][106225] Updated weights for policy 1, policy_version 1649011 (0.0010) [2023-12-28 07:05:07,225][106225] Updated weights for policy 1, policy_version 1649021 (0.0010) [2023-12-28 07:05:07,286][106225] Updated weights for policy 1, policy_version 1649031 (0.0010) [2023-12-28 07:05:07,695][106226] Updated weights for policy 0, policy_version 1645312 (0.0009) [2023-12-28 07:05:07,749][106226] Updated weights for policy 0, policy_version 1645322 (0.0009) [2023-12-28 07:05:07,799][106226] Updated weights for policy 0, policy_version 1645332 (0.0009) [2023-12-28 07:05:07,914][106225] Updated weights for policy 1, policy_version 1649041 (0.0009) [2023-12-28 07:05:07,977][106225] Updated weights for policy 1, policy_version 1649051 (0.0008) [2023-12-28 07:05:08,041][106225] Updated weights for policy 1, policy_version 1649061 (0.0008) [2023-12-28 07:05:08,598][106226] Updated weights for policy 0, policy_version 1645342 (0.0009) [2023-12-28 07:05:08,651][106226] Updated weights for policy 0, policy_version 1645352 (0.0008) [2023-12-28 07:05:08,719][106226] Updated weights for policy 0, policy_version 1645363 (0.0009) [2023-12-28 07:05:08,770][106225] Updated weights for policy 1, policy_version 1649071 (0.0009) [2023-12-28 07:05:08,819][106225] Updated weights for policy 1, policy_version 1649081 (0.0008) [2023-12-28 07:05:08,868][106225] Updated weights for policy 1, policy_version 1649091 (0.0008) [2023-12-28 07:05:09,478][106226] Updated weights for policy 0, policy_version 1645373 (0.0006) [2023-12-28 07:05:09,531][106226] Updated weights for policy 0, policy_version 1645383 (0.0008) [2023-12-28 07:05:09,593][106226] Updated weights for policy 0, policy_version 1645393 (0.0007) [2023-12-28 07:05:09,675][106225] Updated weights for policy 1, policy_version 1649101 (0.0008) [2023-12-28 07:05:09,742][106225] Updated weights for policy 1, policy_version 1649111 (0.0009) [2023-12-28 07:05:09,811][106225] Updated weights for policy 1, policy_version 1649121 (0.0009) [2023-12-28 07:05:10,228][106226] Updated weights for policy 0, policy_version 1645403 (0.0008) [2023-12-28 07:05:10,287][106226] Updated weights for policy 0, policy_version 1645413 (0.0008) [2023-12-28 07:05:10,351][106226] Updated weights for policy 0, policy_version 1645423 (0.0009) [2023-12-28 07:05:10,579][106225] Updated weights for policy 1, policy_version 1649131 (0.0008) [2023-12-28 07:05:10,643][106225] Updated weights for policy 1, policy_version 1649141 (0.0008) [2023-12-28 07:05:10,708][106225] Updated weights for policy 1, policy_version 1649151 (0.0009) [2023-12-28 07:05:11,168][106226] Updated weights for policy 0, policy_version 1645433 (0.0008) [2023-12-28 07:05:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 843546624. Throughput: 0: 9872.3, 1: 9867.8. Samples: 843522328. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:11,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.552')] [2023-12-28 07:05:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001649160_422240256.pth... [2023-12-28 07:05:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001648040_421953536.pth [2023-12-28 07:05:11,229][106226] Updated weights for policy 0, policy_version 1645443 (0.0008) [2023-12-28 07:05:11,303][106226] Updated weights for policy 0, policy_version 1645453 (0.0007) [2023-12-28 07:05:11,378][106226] Updated weights for policy 0, policy_version 1645463 (0.0008) [2023-12-28 07:05:11,386][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001645464_421314560.pth... [2023-12-28 07:05:11,391][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001644280_421011456.pth [2023-12-28 07:05:11,442][106225] Updated weights for policy 1, policy_version 1649161 (0.0007) [2023-12-28 07:05:11,497][106225] Updated weights for policy 1, policy_version 1649171 (0.0009) [2023-12-28 07:05:11,561][106225] Updated weights for policy 1, policy_version 1649181 (0.0008) [2023-12-28 07:05:11,630][106225] Updated weights for policy 1, policy_version 1649191 (0.0007) [2023-12-28 07:05:12,119][106226] Updated weights for policy 0, policy_version 1645473 (0.0009) [2023-12-28 07:05:12,183][106226] Updated weights for policy 0, policy_version 1645483 (0.0009) [2023-12-28 07:05:12,245][106226] Updated weights for policy 0, policy_version 1645493 (0.0008) [2023-12-28 07:05:12,435][106225] Updated weights for policy 1, policy_version 1649201 (0.0007) [2023-12-28 07:05:12,501][106225] Updated weights for policy 1, policy_version 1649211 (0.0006) [2023-12-28 07:05:12,564][106225] Updated weights for policy 1, policy_version 1649221 (0.0006) [2023-12-28 07:05:12,906][106226] Updated weights for policy 0, policy_version 1645503 (0.0008) [2023-12-28 07:05:12,965][106226] Updated weights for policy 0, policy_version 1645513 (0.0009) [2023-12-28 07:05:13,027][106226] Updated weights for policy 0, policy_version 1645523 (0.0008) [2023-12-28 07:05:13,215][106225] Updated weights for policy 1, policy_version 1649231 (0.0008) [2023-12-28 07:05:13,264][106225] Updated weights for policy 1, policy_version 1649241 (0.0008) [2023-12-28 07:05:13,313][106225] Updated weights for policy 1, policy_version 1649251 (0.0008) [2023-12-28 07:05:13,752][106226] Updated weights for policy 0, policy_version 1645533 (0.0009) [2023-12-28 07:05:13,817][106226] Updated weights for policy 0, policy_version 1645543 (0.0009) [2023-12-28 07:05:13,884][106226] Updated weights for policy 0, policy_version 1645553 (0.0008) [2023-12-28 07:05:13,987][106225] Updated weights for policy 1, policy_version 1649261 (0.0008) [2023-12-28 07:05:14,042][106225] Updated weights for policy 1, policy_version 1649271 (0.0009) [2023-12-28 07:05:14,097][106225] Updated weights for policy 1, policy_version 1649281 (0.0009) [2023-12-28 07:05:14,490][106226] Updated weights for policy 0, policy_version 1645563 (0.0008) [2023-12-28 07:05:14,554][106226] Updated weights for policy 0, policy_version 1645573 (0.0005) [2023-12-28 07:05:14,615][106226] Updated weights for policy 0, policy_version 1645583 (0.0006) [2023-12-28 07:05:14,940][106225] Updated weights for policy 1, policy_version 1649291 (0.0008) [2023-12-28 07:05:15,007][106225] Updated weights for policy 1, policy_version 1649301 (0.0009) [2023-12-28 07:05:15,067][106225] Updated weights for policy 1, policy_version 1649311 (0.0009) [2023-12-28 07:05:15,274][106226] Updated weights for policy 0, policy_version 1645593 (0.0008) [2023-12-28 07:05:15,334][106226] Updated weights for policy 0, policy_version 1645603 (0.0009) [2023-12-28 07:05:15,390][106226] Updated weights for policy 0, policy_version 1645613 (0.0005) [2023-12-28 07:05:15,454][106226] Updated weights for policy 0, policy_version 1645623 (0.0007) [2023-12-28 07:05:15,811][106225] Updated weights for policy 1, policy_version 1649321 (0.0009) [2023-12-28 07:05:15,860][106225] Updated weights for policy 1, policy_version 1649331 (0.0009) [2023-12-28 07:05:15,916][106225] Updated weights for policy 1, policy_version 1649341 (0.0006) [2023-12-28 07:05:15,967][106225] Updated weights for policy 1, policy_version 1649351 (0.0008) [2023-12-28 07:05:16,039][106226] Updated weights for policy 0, policy_version 1645633 (0.0007) [2023-12-28 07:05:16,096][106226] Updated weights for policy 0, policy_version 1645643 (0.0008) [2023-12-28 07:05:16,162][106226] Updated weights for policy 0, policy_version 1645653 (0.0006) [2023-12-28 07:05:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 843644928. Throughput: 0: 9872.9, 1: 9767.2. Samples: 843637872. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:16,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-4.561')] [2023-12-28 07:05:16,660][106225] Updated weights for policy 1, policy_version 1649361 (0.0010) [2023-12-28 07:05:16,717][106225] Updated weights for policy 1, policy_version 1649371 (0.0008) [2023-12-28 07:05:16,775][106225] Updated weights for policy 1, policy_version 1649381 (0.0006) [2023-12-28 07:05:16,787][106226] Updated weights for policy 0, policy_version 1645663 (0.0007) [2023-12-28 07:05:16,848][106226] Updated weights for policy 0, policy_version 1645673 (0.0009) [2023-12-28 07:05:16,902][106226] Updated weights for policy 0, policy_version 1645683 (0.0008) [2023-12-28 07:05:17,448][106225] Updated weights for policy 1, policy_version 1649391 (0.0009) [2023-12-28 07:05:17,494][106225] Updated weights for policy 1, policy_version 1649401 (0.0010) [2023-12-28 07:05:17,541][106225] Updated weights for policy 1, policy_version 1649411 (0.0010) [2023-12-28 07:05:17,596][106226] Updated weights for policy 0, policy_version 1645693 (0.0008) [2023-12-28 07:05:17,646][106226] Updated weights for policy 0, policy_version 1645703 (0.0007) [2023-12-28 07:05:17,694][106226] Updated weights for policy 0, policy_version 1645713 (0.0007) [2023-12-28 07:05:18,240][106225] Updated weights for policy 1, policy_version 1649421 (0.0010) [2023-12-28 07:05:18,287][106225] Updated weights for policy 1, policy_version 1649431 (0.0010) [2023-12-28 07:05:18,342][106225] Updated weights for policy 1, policy_version 1649441 (0.0009) [2023-12-28 07:05:18,379][106226] Updated weights for policy 0, policy_version 1645723 (0.0007) [2023-12-28 07:05:18,446][106226] Updated weights for policy 0, policy_version 1645733 (0.0011) [2023-12-28 07:05:18,510][106226] Updated weights for policy 0, policy_version 1645743 (0.0011) [2023-12-28 07:05:19,102][106225] Updated weights for policy 1, policy_version 1649451 (0.0008) [2023-12-28 07:05:19,115][106226] Updated weights for policy 0, policy_version 1645753 (0.0010) [2023-12-28 07:05:19,161][106225] Updated weights for policy 1, policy_version 1649461 (0.0008) [2023-12-28 07:05:19,168][106226] Updated weights for policy 0, policy_version 1645763 (0.0006) [2023-12-28 07:05:19,222][106225] Updated weights for policy 1, policy_version 1649471 (0.0006) [2023-12-28 07:05:19,224][106226] Updated weights for policy 0, policy_version 1645773 (0.0010) [2023-12-28 07:05:19,290][106226] Updated weights for policy 0, policy_version 1645783 (0.0012) [2023-12-28 07:05:19,952][106225] Updated weights for policy 1, policy_version 1649481 (0.0007) [2023-12-28 07:05:20,017][106225] Updated weights for policy 1, policy_version 1649491 (0.0010) [2023-12-28 07:05:20,017][106226] Updated weights for policy 0, policy_version 1645793 (0.0008) [2023-12-28 07:05:20,077][106226] Updated weights for policy 0, policy_version 1645803 (0.0008) [2023-12-28 07:05:20,078][106225] Updated weights for policy 1, policy_version 1649501 (0.0008) [2023-12-28 07:05:20,134][106226] Updated weights for policy 0, policy_version 1645813 (0.0008) [2023-12-28 07:05:20,136][106225] Updated weights for policy 1, policy_version 1649511 (0.0008) [2023-12-28 07:05:20,832][106225] Updated weights for policy 1, policy_version 1649521 (0.0008) [2023-12-28 07:05:20,888][106225] Updated weights for policy 1, policy_version 1649531 (0.0006) [2023-12-28 07:05:20,898][106226] Updated weights for policy 0, policy_version 1645823 (0.0008) [2023-12-28 07:05:20,942][106225] Updated weights for policy 1, policy_version 1649541 (0.0006) [2023-12-28 07:05:20,955][106226] Updated weights for policy 0, policy_version 1645833 (0.0007) [2023-12-28 07:05:21,025][106226] Updated weights for policy 0, policy_version 1645843 (0.0010) [2023-12-28 07:05:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 843751424. Throughput: 0: 9910.4, 1: 9733.2. Samples: 843756820. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:21,175][105115] Avg episode reward: [(0, '-4.105'), (1, '-4.703')] [2023-12-28 07:05:21,690][106225] Updated weights for policy 1, policy_version 1649551 (0.0007) [2023-12-28 07:05:21,761][106225] Updated weights for policy 1, policy_version 1649561 (0.0009) [2023-12-28 07:05:21,824][106226] Updated weights for policy 0, policy_version 1645853 (0.0008) [2023-12-28 07:05:21,831][106225] Updated weights for policy 1, policy_version 1649571 (0.0006) [2023-12-28 07:05:21,890][106226] Updated weights for policy 0, policy_version 1645863 (0.0006) [2023-12-28 07:05:21,952][106226] Updated weights for policy 0, policy_version 1645873 (0.0006) [2023-12-28 07:05:22,513][106225] Updated weights for policy 1, policy_version 1649581 (0.0007) [2023-12-28 07:05:22,574][106225] Updated weights for policy 1, policy_version 1649591 (0.0009) [2023-12-28 07:05:22,634][106225] Updated weights for policy 1, policy_version 1649601 (0.0008) [2023-12-28 07:05:22,715][106226] Updated weights for policy 0, policy_version 1645883 (0.0007) [2023-12-28 07:05:22,781][106226] Updated weights for policy 0, policy_version 1645893 (0.0011) [2023-12-28 07:05:22,844][106226] Updated weights for policy 0, policy_version 1645903 (0.0008) [2023-12-28 07:05:23,318][106225] Updated weights for policy 1, policy_version 1649611 (0.0007) [2023-12-28 07:05:23,379][106225] Updated weights for policy 1, policy_version 1649621 (0.0008) [2023-12-28 07:05:23,436][106225] Updated weights for policy 1, policy_version 1649631 (0.0007) [2023-12-28 07:05:23,548][106226] Updated weights for policy 0, policy_version 1645913 (0.0011) [2023-12-28 07:05:23,610][106226] Updated weights for policy 0, policy_version 1645923 (0.0010) [2023-12-28 07:05:23,673][106226] Updated weights for policy 0, policy_version 1645933 (0.0010) [2023-12-28 07:05:23,730][106226] Updated weights for policy 0, policy_version 1645943 (0.0010) [2023-12-28 07:05:24,126][106225] Updated weights for policy 1, policy_version 1649641 (0.0007) [2023-12-28 07:05:24,177][106225] Updated weights for policy 1, policy_version 1649651 (0.0008) [2023-12-28 07:05:24,228][106225] Updated weights for policy 1, policy_version 1649661 (0.0008) [2023-12-28 07:05:24,284][106225] Updated weights for policy 1, policy_version 1649671 (0.0008) [2023-12-28 07:05:24,391][106226] Updated weights for policy 0, policy_version 1645953 (0.0006) [2023-12-28 07:05:24,439][106226] Updated weights for policy 0, policy_version 1645963 (0.0005) [2023-12-28 07:05:24,485][106226] Updated weights for policy 0, policy_version 1645973 (0.0005) [2023-12-28 07:05:25,109][106225] Updated weights for policy 1, policy_version 1649681 (0.0008) [2023-12-28 07:05:25,130][106226] Updated weights for policy 0, policy_version 1645983 (0.0009) [2023-12-28 07:05:25,168][106225] Updated weights for policy 1, policy_version 1649691 (0.0008) [2023-12-28 07:05:25,185][106226] Updated weights for policy 0, policy_version 1645993 (0.0008) [2023-12-28 07:05:25,235][106225] Updated weights for policy 1, policy_version 1649701 (0.0008) [2023-12-28 07:05:25,236][106226] Updated weights for policy 0, policy_version 1646003 (0.0006) [2023-12-28 07:05:25,826][106226] Updated weights for policy 0, policy_version 1646013 (0.0005) [2023-12-28 07:05:25,879][106226] Updated weights for policy 0, policy_version 1646023 (0.0009) [2023-12-28 07:05:25,932][106226] Updated weights for policy 0, policy_version 1646033 (0.0010) [2023-12-28 07:05:26,003][106225] Updated weights for policy 1, policy_version 1649711 (0.0006) [2023-12-28 07:05:26,049][106225] Updated weights for policy 1, policy_version 1649721 (0.0005) [2023-12-28 07:05:26,098][106225] Updated weights for policy 1, policy_version 1649731 (0.0006) [2023-12-28 07:05:26,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 843849728. Throughput: 0: 9889.4, 1: 9706.3. Samples: 843813992. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:26,176][105115] Avg episode reward: [(0, '-4.705'), (1, '-4.658')] [2023-12-28 07:05:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001649736_422387712.pth... [2023-12-28 07:05:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001646040_421462016.pth... [2023-12-28 07:05:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001648616_422100992.pth [2023-12-28 07:05:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001644856_421158912.pth [2023-12-28 07:05:26,647][106226] Updated weights for policy 0, policy_version 1646043 (0.0010) [2023-12-28 07:05:26,714][106226] Updated weights for policy 0, policy_version 1646053 (0.0011) [2023-12-28 07:05:26,756][106225] Updated weights for policy 1, policy_version 1649741 (0.0007) [2023-12-28 07:05:26,771][106226] Updated weights for policy 0, policy_version 1646063 (0.0010) [2023-12-28 07:05:26,805][106225] Updated weights for policy 1, policy_version 1649751 (0.0010) [2023-12-28 07:05:26,852][106225] Updated weights for policy 1, policy_version 1649761 (0.0010) [2023-12-28 07:05:27,466][106226] Updated weights for policy 0, policy_version 1646073 (0.0010) [2023-12-28 07:05:27,512][106226] Updated weights for policy 0, policy_version 1646083 (0.0010) [2023-12-28 07:05:27,539][106225] Updated weights for policy 1, policy_version 1649771 (0.0008) [2023-12-28 07:05:27,564][106226] Updated weights for policy 0, policy_version 1646093 (0.0006) [2023-12-28 07:05:27,595][106225] Updated weights for policy 1, policy_version 1649781 (0.0005) [2023-12-28 07:05:27,612][106226] Updated weights for policy 0, policy_version 1646103 (0.0009) [2023-12-28 07:05:27,651][106225] Updated weights for policy 1, policy_version 1649791 (0.0007) [2023-12-28 07:05:28,195][106226] Updated weights for policy 0, policy_version 1646113 (0.0010) [2023-12-28 07:05:28,259][106225] Updated weights for policy 1, policy_version 1649801 (0.0010) [2023-12-28 07:05:28,261][106226] Updated weights for policy 0, policy_version 1646123 (0.0010) [2023-12-28 07:05:28,314][106226] Updated weights for policy 0, policy_version 1646133 (0.0010) [2023-12-28 07:05:28,319][106225] Updated weights for policy 1, policy_version 1649811 (0.0009) [2023-12-28 07:05:28,392][106225] Updated weights for policy 1, policy_version 1649821 (0.0010) [2023-12-28 07:05:28,453][106225] Updated weights for policy 1, policy_version 1649831 (0.0010) [2023-12-28 07:05:29,027][106226] Updated weights for policy 0, policy_version 1646143 (0.0007) [2023-12-28 07:05:29,062][106225] Updated weights for policy 1, policy_version 1649841 (0.0006) [2023-12-28 07:05:29,079][106226] Updated weights for policy 0, policy_version 1646153 (0.0008) [2023-12-28 07:05:29,118][106225] Updated weights for policy 1, policy_version 1649851 (0.0007) [2023-12-28 07:05:29,128][106226] Updated weights for policy 0, policy_version 1646163 (0.0007) [2023-12-28 07:05:29,169][106225] Updated weights for policy 1, policy_version 1649861 (0.0005) [2023-12-28 07:05:29,815][106226] Updated weights for policy 0, policy_version 1646173 (0.0007) [2023-12-28 07:05:29,836][106225] Updated weights for policy 1, policy_version 1649871 (0.0008) [2023-12-28 07:05:29,881][106226] Updated weights for policy 0, policy_version 1646183 (0.0008) [2023-12-28 07:05:29,895][106225] Updated weights for policy 1, policy_version 1649881 (0.0010) [2023-12-28 07:05:29,939][106226] Updated weights for policy 0, policy_version 1646193 (0.0007) [2023-12-28 07:05:29,956][106225] Updated weights for policy 1, policy_version 1649891 (0.0011) [2023-12-28 07:05:30,646][106225] Updated weights for policy 1, policy_version 1649901 (0.0007) [2023-12-28 07:05:30,708][106225] Updated weights for policy 1, policy_version 1649911 (0.0007) [2023-12-28 07:05:30,714][106226] Updated weights for policy 0, policy_version 1646203 (0.0008) [2023-12-28 07:05:30,762][106225] Updated weights for policy 1, policy_version 1649921 (0.0007) [2023-12-28 07:05:30,768][106226] Updated weights for policy 0, policy_version 1646213 (0.0008) [2023-12-28 07:05:30,819][106226] Updated weights for policy 0, policy_version 1646223 (0.0008) [2023-12-28 07:05:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 843948032. Throughput: 0: 10012.0, 1: 9719.2. Samples: 843937784. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:31,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.647')] [2023-12-28 07:05:31,416][106225] Updated weights for policy 1, policy_version 1649931 (0.0008) [2023-12-28 07:05:31,475][106225] Updated weights for policy 1, policy_version 1649941 (0.0009) [2023-12-28 07:05:31,531][106225] Updated weights for policy 1, policy_version 1649951 (0.0008) [2023-12-28 07:05:31,547][106226] Updated weights for policy 0, policy_version 1646233 (0.0008) [2023-12-28 07:05:31,599][106226] Updated weights for policy 0, policy_version 1646243 (0.0008) [2023-12-28 07:05:31,666][106226] Updated weights for policy 0, policy_version 1646253 (0.0008) [2023-12-28 07:05:31,718][106226] Updated weights for policy 0, policy_version 1646263 (0.0009) [2023-12-28 07:05:32,207][106225] Updated weights for policy 1, policy_version 1649961 (0.0009) [2023-12-28 07:05:32,267][106225] Updated weights for policy 1, policy_version 1649971 (0.0008) [2023-12-28 07:05:32,327][106225] Updated weights for policy 1, policy_version 1649981 (0.0009) [2023-12-28 07:05:32,390][106225] Updated weights for policy 1, policy_version 1649991 (0.0009) [2023-12-28 07:05:32,541][106226] Updated weights for policy 0, policy_version 1646273 (0.0009) [2023-12-28 07:05:32,606][106226] Updated weights for policy 0, policy_version 1646283 (0.0007) [2023-12-28 07:05:32,674][106226] Updated weights for policy 0, policy_version 1646293 (0.0010) [2023-12-28 07:05:32,982][106225] Updated weights for policy 1, policy_version 1650001 (0.0006) [2023-12-28 07:05:33,048][106225] Updated weights for policy 1, policy_version 1650011 (0.0006) [2023-12-28 07:05:33,119][106225] Updated weights for policy 1, policy_version 1650021 (0.0005) [2023-12-28 07:05:33,356][106226] Updated weights for policy 0, policy_version 1646303 (0.0007) [2023-12-28 07:05:33,417][106226] Updated weights for policy 0, policy_version 1646313 (0.0005) [2023-12-28 07:05:33,472][106226] Updated weights for policy 0, policy_version 1646323 (0.0005) [2023-12-28 07:05:33,695][106225] Updated weights for policy 1, policy_version 1650031 (0.0007) [2023-12-28 07:05:33,740][106225] Updated weights for policy 1, policy_version 1650041 (0.0008) [2023-12-28 07:05:33,788][106225] Updated weights for policy 1, policy_version 1650051 (0.0009) [2023-12-28 07:05:34,044][106226] Updated weights for policy 0, policy_version 1646333 (0.0006) [2023-12-28 07:05:34,089][106226] Updated weights for policy 0, policy_version 1646343 (0.0005) [2023-12-28 07:05:34,152][106226] Updated weights for policy 0, policy_version 1646353 (0.0007) [2023-12-28 07:05:34,531][106225] Updated weights for policy 1, policy_version 1650061 (0.0009) [2023-12-28 07:05:34,591][106225] Updated weights for policy 1, policy_version 1650071 (0.0008) [2023-12-28 07:05:34,652][106225] Updated weights for policy 1, policy_version 1650081 (0.0008) [2023-12-28 07:05:34,869][106226] Updated weights for policy 0, policy_version 1646363 (0.0008) [2023-12-28 07:05:34,929][106226] Updated weights for policy 0, policy_version 1646373 (0.0008) [2023-12-28 07:05:34,983][106226] Updated weights for policy 0, policy_version 1646383 (0.0008) [2023-12-28 07:05:35,370][106225] Updated weights for policy 1, policy_version 1650091 (0.0008) [2023-12-28 07:05:35,430][106225] Updated weights for policy 1, policy_version 1650101 (0.0009) [2023-12-28 07:05:35,493][106225] Updated weights for policy 1, policy_version 1650111 (0.0009) [2023-12-28 07:05:35,652][106226] Updated weights for policy 0, policy_version 1646393 (0.0008) [2023-12-28 07:05:35,702][106226] Updated weights for policy 0, policy_version 1646403 (0.0005) [2023-12-28 07:05:35,753][106226] Updated weights for policy 0, policy_version 1646413 (0.0008) [2023-12-28 07:05:35,813][106226] Updated weights for policy 0, policy_version 1646423 (0.0009) [2023-12-28 07:05:36,107][106225] Updated weights for policy 1, policy_version 1650121 (0.0010) [2023-12-28 07:05:36,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 844046336. Throughput: 0: 10032.3, 1: 9760.4. Samples: 844057440. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:36,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.829')] [2023-12-28 07:05:36,177][106225] Updated weights for policy 1, policy_version 1650131 (0.0006) [2023-12-28 07:05:36,236][106225] Updated weights for policy 1, policy_version 1650141 (0.0006) [2023-12-28 07:05:36,297][106225] Updated weights for policy 1, policy_version 1650151 (0.0006) [2023-12-28 07:05:36,654][106226] Updated weights for policy 0, policy_version 1646433 (0.0009) [2023-12-28 07:05:36,707][106226] Updated weights for policy 0, policy_version 1646443 (0.0008) [2023-12-28 07:05:36,767][106226] Updated weights for policy 0, policy_version 1646453 (0.0009) [2023-12-28 07:05:36,954][106225] Updated weights for policy 1, policy_version 1650161 (0.0007) [2023-12-28 07:05:37,019][106225] Updated weights for policy 1, policy_version 1650171 (0.0007) [2023-12-28 07:05:37,083][106225] Updated weights for policy 1, policy_version 1650181 (0.0008) [2023-12-28 07:05:37,491][106226] Updated weights for policy 0, policy_version 1646463 (0.0008) [2023-12-28 07:05:37,549][106226] Updated weights for policy 0, policy_version 1646473 (0.0008) [2023-12-28 07:05:37,605][106226] Updated weights for policy 0, policy_version 1646483 (0.0009) [2023-12-28 07:05:37,766][106225] Updated weights for policy 1, policy_version 1650191 (0.0008) [2023-12-28 07:05:37,826][106225] Updated weights for policy 1, policy_version 1650201 (0.0009) [2023-12-28 07:05:37,878][106225] Updated weights for policy 1, policy_version 1650211 (0.0008) [2023-12-28 07:05:38,285][106226] Updated weights for policy 0, policy_version 1646493 (0.0008) [2023-12-28 07:05:38,347][106226] Updated weights for policy 0, policy_version 1646503 (0.0009) [2023-12-28 07:05:38,414][106226] Updated weights for policy 0, policy_version 1646513 (0.0008) [2023-12-28 07:05:38,617][106225] Updated weights for policy 1, policy_version 1650221 (0.0008) [2023-12-28 07:05:38,677][106225] Updated weights for policy 1, policy_version 1650231 (0.0008) [2023-12-28 07:05:38,728][106225] Updated weights for policy 1, policy_version 1650241 (0.0008) [2023-12-28 07:05:39,154][106226] Updated weights for policy 0, policy_version 1646523 (0.0009) [2023-12-28 07:05:39,219][106226] Updated weights for policy 0, policy_version 1646533 (0.0008) [2023-12-28 07:05:39,287][106226] Updated weights for policy 0, policy_version 1646543 (0.0008) [2023-12-28 07:05:39,465][106225] Updated weights for policy 1, policy_version 1650251 (0.0006) [2023-12-28 07:05:39,529][106225] Updated weights for policy 1, policy_version 1650261 (0.0010) [2023-12-28 07:05:39,590][106225] Updated weights for policy 1, policy_version 1650271 (0.0011) [2023-12-28 07:05:40,050][106226] Updated weights for policy 0, policy_version 1646553 (0.0008) [2023-12-28 07:05:40,114][106226] Updated weights for policy 0, policy_version 1646563 (0.0008) [2023-12-28 07:05:40,178][106226] Updated weights for policy 0, policy_version 1646573 (0.0007) [2023-12-28 07:05:40,229][106226] Updated weights for policy 0, policy_version 1646583 (0.0008) [2023-12-28 07:05:40,294][106225] Updated weights for policy 1, policy_version 1650281 (0.0010) [2023-12-28 07:05:40,356][106225] Updated weights for policy 1, policy_version 1650291 (0.0009) [2023-12-28 07:05:40,420][106225] Updated weights for policy 1, policy_version 1650301 (0.0006) [2023-12-28 07:05:40,479][106225] Updated weights for policy 1, policy_version 1650311 (0.0006) [2023-12-28 07:05:41,019][106226] Updated weights for policy 0, policy_version 1646593 (0.0008) [2023-12-28 07:05:41,086][106226] Updated weights for policy 0, policy_version 1646603 (0.0008) [2023-12-28 07:05:41,158][106226] Updated weights for policy 0, policy_version 1646613 (0.0009) [2023-12-28 07:05:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 844136448. Throughput: 0: 10002.3, 1: 9785.8. Samples: 844116644. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:41,175][105115] Avg episode reward: [(0, '-4.227'), (1, '-4.824')] [2023-12-28 07:05:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001646616_421609472.pth... [2023-12-28 07:05:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001645464_421314560.pth [2023-12-28 07:05:41,195][106225] Updated weights for policy 1, policy_version 1650321 (0.0008) [2023-12-28 07:05:41,260][106225] Updated weights for policy 1, policy_version 1650331 (0.0010) [2023-12-28 07:05:41,326][106225] Updated weights for policy 1, policy_version 1650341 (0.0011) [2023-12-28 07:05:41,349][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001650344_422543360.pth... [2023-12-28 07:05:41,353][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001649160_422240256.pth [2023-12-28 07:05:41,883][106226] Updated weights for policy 0, policy_version 1646623 (0.0010) [2023-12-28 07:05:41,945][106226] Updated weights for policy 0, policy_version 1646633 (0.0011) [2023-12-28 07:05:42,010][106226] Updated weights for policy 0, policy_version 1646643 (0.0010) [2023-12-28 07:05:42,102][106225] Updated weights for policy 1, policy_version 1650351 (0.0008) [2023-12-28 07:05:42,163][106225] Updated weights for policy 1, policy_version 1650361 (0.0008) [2023-12-28 07:05:42,223][106225] Updated weights for policy 1, policy_version 1650371 (0.0008) [2023-12-28 07:05:42,722][106226] Updated weights for policy 0, policy_version 1646653 (0.0007) [2023-12-28 07:05:42,794][106226] Updated weights for policy 0, policy_version 1646663 (0.0010) [2023-12-28 07:05:42,858][106225] Updated weights for policy 1, policy_version 1650381 (0.0008) [2023-12-28 07:05:42,861][106226] Updated weights for policy 0, policy_version 1646673 (0.0011) [2023-12-28 07:05:42,910][106225] Updated weights for policy 1, policy_version 1650391 (0.0007) [2023-12-28 07:05:42,970][106225] Updated weights for policy 1, policy_version 1650401 (0.0006) [2023-12-28 07:05:43,505][106226] Updated weights for policy 0, policy_version 1646683 (0.0011) [2023-12-28 07:05:43,558][106226] Updated weights for policy 0, policy_version 1646693 (0.0011) [2023-12-28 07:05:43,621][106226] Updated weights for policy 0, policy_version 1646703 (0.0011) [2023-12-28 07:05:43,689][106225] Updated weights for policy 1, policy_version 1650411 (0.0008) [2023-12-28 07:05:43,738][106225] Updated weights for policy 1, policy_version 1650421 (0.0010) [2023-12-28 07:05:43,794][106225] Updated weights for policy 1, policy_version 1650431 (0.0010) [2023-12-28 07:05:44,253][106226] Updated weights for policy 0, policy_version 1646713 (0.0010) [2023-12-28 07:05:44,322][106226] Updated weights for policy 0, policy_version 1646723 (0.0011) [2023-12-28 07:05:44,379][106226] Updated weights for policy 0, policy_version 1646733 (0.0010) [2023-12-28 07:05:44,432][106226] Updated weights for policy 0, policy_version 1646743 (0.0010) [2023-12-28 07:05:44,522][106225] Updated weights for policy 1, policy_version 1650441 (0.0010) [2023-12-28 07:05:44,589][106225] Updated weights for policy 1, policy_version 1650451 (0.0008) [2023-12-28 07:05:44,651][106225] Updated weights for policy 1, policy_version 1650461 (0.0008) [2023-12-28 07:05:44,713][106225] Updated weights for policy 1, policy_version 1650471 (0.0008) [2023-12-28 07:05:45,066][106226] Updated weights for policy 0, policy_version 1646753 (0.0006) [2023-12-28 07:05:45,118][106226] Updated weights for policy 0, policy_version 1646763 (0.0007) [2023-12-28 07:05:45,177][106226] Updated weights for policy 0, policy_version 1646773 (0.0006) [2023-12-28 07:05:45,367][106225] Updated weights for policy 1, policy_version 1650481 (0.0006) [2023-12-28 07:05:45,425][106225] Updated weights for policy 1, policy_version 1650491 (0.0005) [2023-12-28 07:05:45,491][106225] Updated weights for policy 1, policy_version 1650501 (0.0007) [2023-12-28 07:05:45,830][106226] Updated weights for policy 0, policy_version 1646783 (0.0005) [2023-12-28 07:05:45,887][106226] Updated weights for policy 0, policy_version 1646793 (0.0007) [2023-12-28 07:05:45,942][106226] Updated weights for policy 0, policy_version 1646803 (0.0008) [2023-12-28 07:05:46,171][106225] Updated weights for policy 1, policy_version 1650511 (0.0006) [2023-12-28 07:05:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 844242944. Throughput: 0: 9885.0, 1: 9865.6. Samples: 844233412. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:46,176][105115] Avg episode reward: [(0, '-4.295'), (1, '-4.853')] [2023-12-28 07:05:46,234][106225] Updated weights for policy 1, policy_version 1650521 (0.0005) [2023-12-28 07:05:46,289][106225] Updated weights for policy 1, policy_version 1650531 (0.0005) [2023-12-28 07:05:46,573][106226] Updated weights for policy 0, policy_version 1646813 (0.0007) [2023-12-28 07:05:46,625][106226] Updated weights for policy 0, policy_version 1646823 (0.0005) [2023-12-28 07:05:46,682][106226] Updated weights for policy 0, policy_version 1646833 (0.0008) [2023-12-28 07:05:46,938][106225] Updated weights for policy 1, policy_version 1650541 (0.0008) [2023-12-28 07:05:46,984][106225] Updated weights for policy 1, policy_version 1650551 (0.0010) [2023-12-28 07:05:47,031][106225] Updated weights for policy 1, policy_version 1650561 (0.0010) [2023-12-28 07:05:47,376][106226] Updated weights for policy 0, policy_version 1646843 (0.0007) [2023-12-28 07:05:47,422][106226] Updated weights for policy 0, policy_version 1646853 (0.0009) [2023-12-28 07:05:47,478][106226] Updated weights for policy 0, policy_version 1646863 (0.0008) [2023-12-28 07:05:47,702][106225] Updated weights for policy 1, policy_version 1650571 (0.0010) [2023-12-28 07:05:47,755][106225] Updated weights for policy 1, policy_version 1650581 (0.0006) [2023-12-28 07:05:47,805][106225] Updated weights for policy 1, policy_version 1650591 (0.0006) [2023-12-28 07:05:48,286][106226] Updated weights for policy 0, policy_version 1646873 (0.0010) [2023-12-28 07:05:48,356][106226] Updated weights for policy 0, policy_version 1646883 (0.0009) [2023-12-28 07:05:48,415][106226] Updated weights for policy 0, policy_version 1646893 (0.0008) [2023-12-28 07:05:48,473][106225] Updated weights for policy 1, policy_version 1650601 (0.0008) [2023-12-28 07:05:48,479][106226] Updated weights for policy 0, policy_version 1646903 (0.0008) [2023-12-28 07:05:48,528][106225] Updated weights for policy 1, policy_version 1650611 (0.0008) [2023-12-28 07:05:48,581][106225] Updated weights for policy 1, policy_version 1650621 (0.0008) [2023-12-28 07:05:48,638][106225] Updated weights for policy 1, policy_version 1650631 (0.0009) [2023-12-28 07:05:49,173][106226] Updated weights for policy 0, policy_version 1646913 (0.0008) [2023-12-28 07:05:49,239][106226] Updated weights for policy 0, policy_version 1646923 (0.0009) [2023-12-28 07:05:49,303][106226] Updated weights for policy 0, policy_version 1646933 (0.0008) [2023-12-28 07:05:49,429][106225] Updated weights for policy 1, policy_version 1650641 (0.0008) [2023-12-28 07:05:49,490][106225] Updated weights for policy 1, policy_version 1650651 (0.0007) [2023-12-28 07:05:49,552][106225] Updated weights for policy 1, policy_version 1650661 (0.0008) [2023-12-28 07:05:50,072][106226] Updated weights for policy 0, policy_version 1646943 (0.0008) [2023-12-28 07:05:50,134][106226] Updated weights for policy 0, policy_version 1646953 (0.0008) [2023-12-28 07:05:50,190][106225] Updated weights for policy 1, policy_version 1650671 (0.0007) [2023-12-28 07:05:50,197][106226] Updated weights for policy 0, policy_version 1646963 (0.0006) [2023-12-28 07:05:50,244][106225] Updated weights for policy 1, policy_version 1650681 (0.0007) [2023-12-28 07:05:50,304][106225] Updated weights for policy 1, policy_version 1650691 (0.0005) [2023-12-28 07:05:50,846][106226] Updated weights for policy 0, policy_version 1646973 (0.0008) [2023-12-28 07:05:50,903][106226] Updated weights for policy 0, policy_version 1646983 (0.0009) [2023-12-28 07:05:50,944][106225] Updated weights for policy 1, policy_version 1650701 (0.0007) [2023-12-28 07:05:50,953][106226] Updated weights for policy 0, policy_version 1646993 (0.0008) [2023-12-28 07:05:50,996][106225] Updated weights for policy 1, policy_version 1650711 (0.0006) [2023-12-28 07:05:51,058][106225] Updated weights for policy 1, policy_version 1650721 (0.0008) [2023-12-28 07:05:51,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 844349440. Throughput: 0: 9856.3, 1: 9899.8. Samples: 844353412. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:51,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.641')] [2023-12-28 07:05:51,757][106226] Updated weights for policy 0, policy_version 1647003 (0.0007) [2023-12-28 07:05:51,805][106225] Updated weights for policy 1, policy_version 1650731 (0.0008) [2023-12-28 07:05:51,820][106226] Updated weights for policy 0, policy_version 1647013 (0.0007) [2023-12-28 07:05:51,870][106225] Updated weights for policy 1, policy_version 1650741 (0.0009) [2023-12-28 07:05:51,881][106226] Updated weights for policy 0, policy_version 1647023 (0.0009) [2023-12-28 07:05:51,932][106225] Updated weights for policy 1, policy_version 1650751 (0.0009) [2023-12-28 07:05:52,541][106225] Updated weights for policy 1, policy_version 1650761 (0.0007) [2023-12-28 07:05:52,602][106225] Updated weights for policy 1, policy_version 1650771 (0.0007) [2023-12-28 07:05:52,632][106226] Updated weights for policy 0, policy_version 1647033 (0.0009) [2023-12-28 07:05:52,664][106225] Updated weights for policy 1, policy_version 1650781 (0.0010) [2023-12-28 07:05:52,696][106226] Updated weights for policy 0, policy_version 1647043 (0.0009) [2023-12-28 07:05:52,722][106225] Updated weights for policy 1, policy_version 1650791 (0.0010) [2023-12-28 07:05:52,748][106226] Updated weights for policy 0, policy_version 1647053 (0.0007) [2023-12-28 07:05:52,844][106226] Updated weights for policy 0, policy_version 1647063 (0.0008) [2023-12-28 07:05:53,363][106225] Updated weights for policy 1, policy_version 1650801 (0.0010) [2023-12-28 07:05:53,410][106225] Updated weights for policy 1, policy_version 1650811 (0.0010) [2023-12-28 07:05:53,468][106225] Updated weights for policy 1, policy_version 1650821 (0.0010) [2023-12-28 07:05:53,518][106226] Updated weights for policy 0, policy_version 1647073 (0.0007) [2023-12-28 07:05:53,568][106226] Updated weights for policy 0, policy_version 1647083 (0.0007) [2023-12-28 07:05:53,619][106226] Updated weights for policy 0, policy_version 1647093 (0.0008) [2023-12-28 07:05:54,147][106225] Updated weights for policy 1, policy_version 1650831 (0.0010) [2023-12-28 07:05:54,214][106225] Updated weights for policy 1, policy_version 1650841 (0.0011) [2023-12-28 07:05:54,271][106225] Updated weights for policy 1, policy_version 1650851 (0.0010) [2023-12-28 07:05:54,370][106226] Updated weights for policy 0, policy_version 1647103 (0.0006) [2023-12-28 07:05:54,424][106226] Updated weights for policy 0, policy_version 1647113 (0.0005) [2023-12-28 07:05:54,476][106226] Updated weights for policy 0, policy_version 1647123 (0.0005) [2023-12-28 07:05:54,868][106225] Updated weights for policy 1, policy_version 1650861 (0.0008) [2023-12-28 07:05:54,924][106225] Updated weights for policy 1, policy_version 1650871 (0.0005) [2023-12-28 07:05:54,982][106225] Updated weights for policy 1, policy_version 1650881 (0.0006) [2023-12-28 07:05:55,013][106226] Updated weights for policy 0, policy_version 1647133 (0.0006) [2023-12-28 07:05:55,070][106226] Updated weights for policy 0, policy_version 1647143 (0.0008) [2023-12-28 07:05:55,121][106226] Updated weights for policy 0, policy_version 1647153 (0.0009) [2023-12-28 07:05:55,596][106225] Updated weights for policy 1, policy_version 1650891 (0.0007) [2023-12-28 07:05:55,651][106225] Updated weights for policy 1, policy_version 1650901 (0.0006) [2023-12-28 07:05:55,709][106225] Updated weights for policy 1, policy_version 1650911 (0.0005) [2023-12-28 07:05:55,765][106226] Updated weights for policy 0, policy_version 1647163 (0.0009) [2023-12-28 07:05:55,826][106226] Updated weights for policy 0, policy_version 1647173 (0.0010) [2023-12-28 07:05:55,879][106226] Updated weights for policy 0, policy_version 1647183 (0.0010) [2023-12-28 07:05:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 844447744. Throughput: 0: 9857.0, 1: 9909.4. Samples: 844411820. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:05:56,176][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.758')] [2023-12-28 07:05:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001650920_422690816.pth... [2023-12-28 07:05:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001647192_421756928.pth... [2023-12-28 07:05:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001649736_422387712.pth [2023-12-28 07:05:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001646040_421462016.pth [2023-12-28 07:05:56,355][106225] Updated weights for policy 1, policy_version 1650921 (0.0007) [2023-12-28 07:05:56,404][106225] Updated weights for policy 1, policy_version 1650931 (0.0010) [2023-12-28 07:05:56,453][106225] Updated weights for policy 1, policy_version 1650941 (0.0008) [2023-12-28 07:05:56,504][106225] Updated weights for policy 1, policy_version 1650951 (0.0010) [2023-12-28 07:05:56,547][106226] Updated weights for policy 0, policy_version 1647193 (0.0011) [2023-12-28 07:05:56,603][106226] Updated weights for policy 0, policy_version 1647203 (0.0010) [2023-12-28 07:05:56,652][106226] Updated weights for policy 0, policy_version 1647213 (0.0010) [2023-12-28 07:05:56,701][106226] Updated weights for policy 0, policy_version 1647223 (0.0010) [2023-12-28 07:05:57,187][106225] Updated weights for policy 1, policy_version 1650961 (0.0006) [2023-12-28 07:05:57,233][106225] Updated weights for policy 1, policy_version 1650971 (0.0005) [2023-12-28 07:05:57,284][106225] Updated weights for policy 1, policy_version 1650981 (0.0008) [2023-12-28 07:05:57,302][106226] Updated weights for policy 0, policy_version 1647233 (0.0010) [2023-12-28 07:05:57,355][106226] Updated weights for policy 0, policy_version 1647243 (0.0009) [2023-12-28 07:05:57,408][106226] Updated weights for policy 0, policy_version 1647253 (0.0010) [2023-12-28 07:05:57,946][106225] Updated weights for policy 1, policy_version 1650991 (0.0010) [2023-12-28 07:05:57,989][106225] Updated weights for policy 1, policy_version 1651001 (0.0010) [2023-12-28 07:05:58,010][106226] Updated weights for policy 0, policy_version 1647263 (0.0010) [2023-12-28 07:05:58,045][106225] Updated weights for policy 1, policy_version 1651011 (0.0008) [2023-12-28 07:05:58,070][106226] Updated weights for policy 0, policy_version 1647273 (0.0010) [2023-12-28 07:05:58,131][106226] Updated weights for policy 0, policy_version 1647283 (0.0011) [2023-12-28 07:05:58,756][106225] Updated weights for policy 1, policy_version 1651021 (0.0006) [2023-12-28 07:05:58,827][106225] Updated weights for policy 1, policy_version 1651032 (0.0008) [2023-12-28 07:05:58,900][106225] Updated weights for policy 1, policy_version 1651042 (0.0008) [2023-12-28 07:05:58,980][106226] Updated weights for policy 0, policy_version 1647293 (0.0009) [2023-12-28 07:05:59,033][106226] Updated weights for policy 0, policy_version 1647303 (0.0008) [2023-12-28 07:05:59,097][106226] Updated weights for policy 0, policy_version 1647313 (0.0007) [2023-12-28 07:05:59,672][106225] Updated weights for policy 1, policy_version 1651052 (0.0007) [2023-12-28 07:05:59,721][106225] Updated weights for policy 1, policy_version 1651062 (0.0007) [2023-12-28 07:05:59,776][106225] Updated weights for policy 1, policy_version 1651072 (0.0008) [2023-12-28 07:05:59,908][106226] Updated weights for policy 0, policy_version 1647323 (0.0007) [2023-12-28 07:05:59,969][106226] Updated weights for policy 0, policy_version 1647333 (0.0008) [2023-12-28 07:06:00,020][106226] Updated weights for policy 0, policy_version 1647343 (0.0008) [2023-12-28 07:06:00,432][106225] Updated weights for policy 1, policy_version 1651082 (0.0008) [2023-12-28 07:06:00,492][106225] Updated weights for policy 1, policy_version 1651092 (0.0010) [2023-12-28 07:06:00,541][106225] Updated weights for policy 1, policy_version 1651102 (0.0010) [2023-12-28 07:06:00,594][106225] Updated weights for policy 1, policy_version 1651112 (0.0010) [2023-12-28 07:06:00,772][106226] Updated weights for policy 0, policy_version 1647353 (0.0007) [2023-12-28 07:06:00,830][106226] Updated weights for policy 0, policy_version 1647363 (0.0005) [2023-12-28 07:06:00,893][106226] Updated weights for policy 0, policy_version 1647373 (0.0005) [2023-12-28 07:06:00,960][106226] Updated weights for policy 0, policy_version 1647383 (0.0005) [2023-12-28 07:06:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 844546048. Throughput: 0: 9906.9, 1: 10061.1. Samples: 844536432. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:06:01,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.727')] [2023-12-28 07:06:01,315][106225] Updated weights for policy 1, policy_version 1651122 (0.0010) [2023-12-28 07:06:01,377][106225] Updated weights for policy 1, policy_version 1651132 (0.0008) [2023-12-28 07:06:01,445][106225] Updated weights for policy 1, policy_version 1651142 (0.0010) [2023-12-28 07:06:01,648][106226] Updated weights for policy 0, policy_version 1647393 (0.0007) [2023-12-28 07:06:01,714][106226] Updated weights for policy 0, policy_version 1647403 (0.0007) [2023-12-28 07:06:01,773][106226] Updated weights for policy 0, policy_version 1647413 (0.0009) [2023-12-28 07:06:02,078][106225] Updated weights for policy 1, policy_version 1651152 (0.0006) [2023-12-28 07:06:02,126][106225] Updated weights for policy 1, policy_version 1651162 (0.0005) [2023-12-28 07:06:02,174][106225] Updated weights for policy 1, policy_version 1651172 (0.0005) [2023-12-28 07:06:02,550][106226] Updated weights for policy 0, policy_version 1647423 (0.0008) [2023-12-28 07:06:02,611][106226] Updated weights for policy 0, policy_version 1647433 (0.0006) [2023-12-28 07:06:02,668][106226] Updated weights for policy 0, policy_version 1647443 (0.0005) [2023-12-28 07:06:02,857][106225] Updated weights for policy 1, policy_version 1651182 (0.0007) [2023-12-28 07:06:02,913][106225] Updated weights for policy 1, policy_version 1651192 (0.0005) [2023-12-28 07:06:02,966][106225] Updated weights for policy 1, policy_version 1651202 (0.0007) [2023-12-28 07:06:03,390][106226] Updated weights for policy 0, policy_version 1647453 (0.0007) [2023-12-28 07:06:03,448][106226] Updated weights for policy 0, policy_version 1647463 (0.0010) [2023-12-28 07:06:03,485][106225] Updated weights for policy 1, policy_version 1651212 (0.0008) [2023-12-28 07:06:03,510][106226] Updated weights for policy 0, policy_version 1647473 (0.0009) [2023-12-28 07:06:03,537][106225] Updated weights for policy 1, policy_version 1651222 (0.0005) [2023-12-28 07:06:03,602][106225] Updated weights for policy 1, policy_version 1651232 (0.0006) [2023-12-28 07:06:04,250][106226] Updated weights for policy 0, policy_version 1647483 (0.0007) [2023-12-28 07:06:04,315][106225] Updated weights for policy 1, policy_version 1651242 (0.0009) [2023-12-28 07:06:04,315][106226] Updated weights for policy 0, policy_version 1647493 (0.0007) [2023-12-28 07:06:04,377][106226] Updated weights for policy 0, policy_version 1647503 (0.0006) [2023-12-28 07:06:04,378][106225] Updated weights for policy 1, policy_version 1651252 (0.0011) [2023-12-28 07:06:04,437][106225] Updated weights for policy 1, policy_version 1651262 (0.0010) [2023-12-28 07:06:04,487][106225] Updated weights for policy 1, policy_version 1651272 (0.0010) [2023-12-28 07:06:05,072][106226] Updated weights for policy 0, policy_version 1647513 (0.0006) [2023-12-28 07:06:05,130][106226] Updated weights for policy 0, policy_version 1647523 (0.0008) [2023-12-28 07:06:05,182][106226] Updated weights for policy 0, policy_version 1647533 (0.0007) [2023-12-28 07:06:05,222][106225] Updated weights for policy 1, policy_version 1651282 (0.0010) [2023-12-28 07:06:05,233][106226] Updated weights for policy 0, policy_version 1647543 (0.0005) [2023-12-28 07:06:05,269][106225] Updated weights for policy 1, policy_version 1651292 (0.0010) [2023-12-28 07:06:05,315][106225] Updated weights for policy 1, policy_version 1651302 (0.0010) [2023-12-28 07:06:05,986][106226] Updated weights for policy 0, policy_version 1647553 (0.0007) [2023-12-28 07:06:05,992][106225] Updated weights for policy 1, policy_version 1651312 (0.0006) [2023-12-28 07:06:06,044][106226] Updated weights for policy 0, policy_version 1647563 (0.0007) [2023-12-28 07:06:06,047][106225] Updated weights for policy 1, policy_version 1651322 (0.0009) [2023-12-28 07:06:06,102][106225] Updated weights for policy 1, policy_version 1651332 (0.0010) [2023-12-28 07:06:06,109][106226] Updated weights for policy 0, policy_version 1647573 (0.0006) [2023-12-28 07:06:06,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 844652544. Throughput: 0: 9830.2, 1: 10144.8. Samples: 844655696. Policy #0 lag: (min: 31.0, avg: 39.8, max: 63.0) [2023-12-28 07:06:06,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.786')] [2023-12-28 07:06:06,843][106226] Updated weights for policy 0, policy_version 1647583 (0.0008) [2023-12-28 07:06:06,865][106225] Updated weights for policy 1, policy_version 1651342 (0.0011) [2023-12-28 07:06:06,898][106226] Updated weights for policy 0, policy_version 1647593 (0.0006) [2023-12-28 07:06:06,924][106225] Updated weights for policy 1, policy_version 1651352 (0.0011) [2023-12-28 07:06:06,957][106226] Updated weights for policy 0, policy_version 1647603 (0.0006) [2023-12-28 07:06:06,978][106225] Updated weights for policy 1, policy_version 1651362 (0.0010) [2023-12-28 07:06:07,697][106226] Updated weights for policy 0, policy_version 1647613 (0.0008) [2023-12-28 07:06:07,712][106225] Updated weights for policy 1, policy_version 1651372 (0.0011) [2023-12-28 07:06:07,752][106226] Updated weights for policy 0, policy_version 1647623 (0.0008) [2023-12-28 07:06:07,769][106225] Updated weights for policy 1, policy_version 1651382 (0.0010) [2023-12-28 07:06:07,805][106226] Updated weights for policy 0, policy_version 1647633 (0.0006) [2023-12-28 07:06:07,829][106225] Updated weights for policy 1, policy_version 1651392 (0.0010) [2023-12-28 07:06:08,542][106226] Updated weights for policy 0, policy_version 1647643 (0.0006) [2023-12-28 07:06:08,542][106225] Updated weights for policy 1, policy_version 1651402 (0.0010) [2023-12-28 07:06:08,596][106226] Updated weights for policy 0, policy_version 1647653 (0.0006) [2023-12-28 07:06:08,603][106225] Updated weights for policy 1, policy_version 1651412 (0.0011) [2023-12-28 07:06:08,651][106226] Updated weights for policy 0, policy_version 1647663 (0.0008) [2023-12-28 07:06:08,662][106225] Updated weights for policy 1, policy_version 1651422 (0.0011) [2023-12-28 07:06:08,722][106225] Updated weights for policy 1, policy_version 1651432 (0.0011) [2023-12-28 07:06:09,421][106225] Updated weights for policy 1, policy_version 1651443 (0.0008) [2023-12-28 07:06:09,450][106226] Updated weights for policy 0, policy_version 1647673 (0.0006) [2023-12-28 07:06:09,482][106225] Updated weights for policy 1, policy_version 1651453 (0.0006) [2023-12-28 07:06:09,517][106226] Updated weights for policy 0, policy_version 1647683 (0.0008) [2023-12-28 07:06:09,541][106225] Updated weights for policy 1, policy_version 1651463 (0.0010) [2023-12-28 07:06:09,576][106226] Updated weights for policy 0, policy_version 1647693 (0.0008) [2023-12-28 07:06:09,628][106226] Updated weights for policy 0, policy_version 1647703 (0.0008) [2023-12-28 07:06:10,313][106226] Updated weights for policy 0, policy_version 1647713 (0.0007) [2023-12-28 07:06:10,337][106225] Updated weights for policy 1, policy_version 1651473 (0.0008) [2023-12-28 07:06:10,378][106226] Updated weights for policy 0, policy_version 1647723 (0.0008) [2023-12-28 07:06:10,406][106225] Updated weights for policy 1, policy_version 1651483 (0.0009) [2023-12-28 07:06:10,451][106226] Updated weights for policy 0, policy_version 1647733 (0.0009) [2023-12-28 07:06:10,473][106225] Updated weights for policy 1, policy_version 1651493 (0.0006) [2023-12-28 07:06:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 844734464. Throughput: 0: 9818.5, 1: 10152.1. Samples: 844712668. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:11,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.611')] [2023-12-28 07:06:11,191][106226] Updated weights for policy 0, policy_version 1647743 (0.0008) [2023-12-28 07:06:11,225][106225] Updated weights for policy 1, policy_version 1651503 (0.0007) [2023-12-28 07:06:11,255][106226] Updated weights for policy 0, policy_version 1647753 (0.0009) [2023-12-28 07:06:11,286][106225] Updated weights for policy 1, policy_version 1651513 (0.0006) [2023-12-28 07:06:11,315][106226] Updated weights for policy 0, policy_version 1647763 (0.0009) [2023-12-28 07:06:11,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001647768_421904384.pth... [2023-12-28 07:06:11,350][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001646616_421609472.pth [2023-12-28 07:06:11,352][106225] Updated weights for policy 1, policy_version 1651523 (0.0006) [2023-12-28 07:06:11,389][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001651528_422846464.pth... [2023-12-28 07:06:11,392][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001650344_422543360.pth [2023-12-28 07:06:12,116][106225] Updated weights for policy 1, policy_version 1651533 (0.0011) [2023-12-28 07:06:12,132][106226] Updated weights for policy 0, policy_version 1647773 (0.0007) [2023-12-28 07:06:12,175][106225] Updated weights for policy 1, policy_version 1651543 (0.0007) [2023-12-28 07:06:12,187][106226] Updated weights for policy 0, policy_version 1647783 (0.0007) [2023-12-28 07:06:12,227][106225] Updated weights for policy 1, policy_version 1651553 (0.0007) [2023-12-28 07:06:12,252][106226] Updated weights for policy 0, policy_version 1647793 (0.0008) [2023-12-28 07:06:12,958][106226] Updated weights for policy 0, policy_version 1647804 (0.0008) [2023-12-28 07:06:12,976][106225] Updated weights for policy 1, policy_version 1651563 (0.0008) [2023-12-28 07:06:13,007][106226] Updated weights for policy 0, policy_version 1647814 (0.0008) [2023-12-28 07:06:13,030][106225] Updated weights for policy 1, policy_version 1651573 (0.0010) [2023-12-28 07:06:13,059][106226] Updated weights for policy 0, policy_version 1647824 (0.0005) [2023-12-28 07:06:13,094][106225] Updated weights for policy 1, policy_version 1651583 (0.0008) [2023-12-28 07:06:13,646][106225] Updated weights for policy 1, policy_version 1651593 (0.0006) [2023-12-28 07:06:13,703][106225] Updated weights for policy 1, policy_version 1651603 (0.0010) [2023-12-28 07:06:13,763][106225] Updated weights for policy 1, policy_version 1651613 (0.0010) [2023-12-28 07:06:13,819][106225] Updated weights for policy 1, policy_version 1651623 (0.0006) [2023-12-28 07:06:13,838][106226] Updated weights for policy 0, policy_version 1647834 (0.0009) [2023-12-28 07:06:13,894][106226] Updated weights for policy 0, policy_version 1647844 (0.0009) [2023-12-28 07:06:13,953][106226] Updated weights for policy 0, policy_version 1647854 (0.0008) [2023-12-28 07:06:14,010][106226] Updated weights for policy 0, policy_version 1647864 (0.0008) [2023-12-28 07:06:14,449][106225] Updated weights for policy 1, policy_version 1651633 (0.0005) [2023-12-28 07:06:14,504][106225] Updated weights for policy 1, policy_version 1651643 (0.0005) [2023-12-28 07:06:14,565][106225] Updated weights for policy 1, policy_version 1651653 (0.0005) [2023-12-28 07:06:14,707][106226] Updated weights for policy 0, policy_version 1647874 (0.0008) [2023-12-28 07:06:14,767][106226] Updated weights for policy 0, policy_version 1647884 (0.0008) [2023-12-28 07:06:14,835][106226] Updated weights for policy 0, policy_version 1647895 (0.0009) [2023-12-28 07:06:15,221][106225] Updated weights for policy 1, policy_version 1651663 (0.0009) [2023-12-28 07:06:15,280][106225] Updated weights for policy 1, policy_version 1651673 (0.0010) [2023-12-28 07:06:15,338][106225] Updated weights for policy 1, policy_version 1651683 (0.0011) [2023-12-28 07:06:15,641][106226] Updated weights for policy 0, policy_version 1647905 (0.0008) [2023-12-28 07:06:15,698][106226] Updated weights for policy 0, policy_version 1647915 (0.0008) [2023-12-28 07:06:15,758][106226] Updated weights for policy 0, policy_version 1647925 (0.0008) [2023-12-28 07:06:16,052][106225] Updated weights for policy 1, policy_version 1651693 (0.0010) [2023-12-28 07:06:16,110][106225] Updated weights for policy 1, policy_version 1651703 (0.0010) [2023-12-28 07:06:16,156][106225] Updated weights for policy 1, policy_version 1651713 (0.0010) [2023-12-28 07:06:16,174][105115] Fps is (10 sec: 18022.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 844832768. Throughput: 0: 9670.8, 1: 10095.4. Samples: 844827264. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:16,175][105115] Avg episode reward: [(0, '-4.184'), (1, '-4.822')] [2023-12-28 07:06:16,396][106226] Updated weights for policy 0, policy_version 1647935 (0.0006) [2023-12-28 07:06:16,456][106226] Updated weights for policy 0, policy_version 1647945 (0.0007) [2023-12-28 07:06:16,508][106226] Updated weights for policy 0, policy_version 1647955 (0.0008) [2023-12-28 07:06:16,875][106225] Updated weights for policy 1, policy_version 1651723 (0.0010) [2023-12-28 07:06:16,933][106225] Updated weights for policy 1, policy_version 1651733 (0.0010) [2023-12-28 07:06:16,992][106225] Updated weights for policy 1, policy_version 1651743 (0.0010) [2023-12-28 07:06:17,240][106226] Updated weights for policy 0, policy_version 1647965 (0.0008) [2023-12-28 07:06:17,300][106226] Updated weights for policy 0, policy_version 1647975 (0.0008) [2023-12-28 07:06:17,357][106226] Updated weights for policy 0, policy_version 1647985 (0.0007) [2023-12-28 07:06:17,702][106225] Updated weights for policy 1, policy_version 1651753 (0.0010) [2023-12-28 07:06:17,763][106225] Updated weights for policy 1, policy_version 1651763 (0.0010) [2023-12-28 07:06:17,822][106225] Updated weights for policy 1, policy_version 1651773 (0.0010) [2023-12-28 07:06:17,871][106225] Updated weights for policy 1, policy_version 1651783 (0.0010) [2023-12-28 07:06:18,007][106226] Updated weights for policy 0, policy_version 1647995 (0.0008) [2023-12-28 07:06:18,067][106226] Updated weights for policy 0, policy_version 1648005 (0.0009) [2023-12-28 07:06:18,131][106226] Updated weights for policy 0, policy_version 1648015 (0.0011) [2023-12-28 07:06:18,496][106225] Updated weights for policy 1, policy_version 1651793 (0.0010) [2023-12-28 07:06:18,553][106225] Updated weights for policy 1, policy_version 1651803 (0.0010) [2023-12-28 07:06:18,614][106225] Updated weights for policy 1, policy_version 1651813 (0.0010) [2023-12-28 07:06:18,797][106226] Updated weights for policy 0, policy_version 1648025 (0.0010) [2023-12-28 07:06:18,863][106226] Updated weights for policy 0, policy_version 1648035 (0.0006) [2023-12-28 07:06:18,934][106226] Updated weights for policy 0, policy_version 1648045 (0.0008) [2023-12-28 07:06:18,995][106226] Updated weights for policy 0, policy_version 1648055 (0.0009) [2023-12-28 07:06:19,236][106225] Updated weights for policy 1, policy_version 1651823 (0.0008) [2023-12-28 07:06:19,293][106225] Updated weights for policy 1, policy_version 1651833 (0.0006) [2023-12-28 07:06:19,361][106225] Updated weights for policy 1, policy_version 1651843 (0.0007) [2023-12-28 07:06:19,647][106226] Updated weights for policy 0, policy_version 1648065 (0.0009) [2023-12-28 07:06:19,708][106226] Updated weights for policy 0, policy_version 1648075 (0.0009) [2023-12-28 07:06:19,764][106226] Updated weights for policy 0, policy_version 1648085 (0.0009) [2023-12-28 07:06:20,086][106225] Updated weights for policy 1, policy_version 1651853 (0.0011) [2023-12-28 07:06:20,148][106225] Updated weights for policy 1, policy_version 1651863 (0.0009) [2023-12-28 07:06:20,211][106225] Updated weights for policy 1, policy_version 1651873 (0.0009) [2023-12-28 07:06:20,541][106226] Updated weights for policy 0, policy_version 1648095 (0.0008) [2023-12-28 07:06:20,604][106226] Updated weights for policy 0, policy_version 1648105 (0.0009) [2023-12-28 07:06:20,664][106226] Updated weights for policy 0, policy_version 1648115 (0.0005) [2023-12-28 07:06:20,975][106225] Updated weights for policy 1, policy_version 1651883 (0.0009) [2023-12-28 07:06:21,040][106225] Updated weights for policy 1, policy_version 1651893 (0.0008) [2023-12-28 07:06:21,101][106225] Updated weights for policy 1, policy_version 1651903 (0.0009) [2023-12-28 07:06:21,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 844939264. Throughput: 0: 9705.2, 1: 10063.2. Samples: 844947020. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:21,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.480')] [2023-12-28 07:06:21,298][106226] Updated weights for policy 0, policy_version 1648125 (0.0007) [2023-12-28 07:06:21,369][106226] Updated weights for policy 0, policy_version 1648135 (0.0009) [2023-12-28 07:06:21,427][106226] Updated weights for policy 0, policy_version 1648145 (0.0007) [2023-12-28 07:06:21,913][106225] Updated weights for policy 1, policy_version 1651913 (0.0009) [2023-12-28 07:06:21,972][106225] Updated weights for policy 1, policy_version 1651923 (0.0008) [2023-12-28 07:06:22,034][106225] Updated weights for policy 1, policy_version 1651933 (0.0008) [2023-12-28 07:06:22,098][106225] Updated weights for policy 1, policy_version 1651943 (0.0009) [2023-12-28 07:06:22,110][106226] Updated weights for policy 0, policy_version 1648155 (0.0006) [2023-12-28 07:06:22,176][106226] Updated weights for policy 0, policy_version 1648165 (0.0008) [2023-12-28 07:06:22,240][106226] Updated weights for policy 0, policy_version 1648175 (0.0008) [2023-12-28 07:06:22,817][106225] Updated weights for policy 1, policy_version 1651953 (0.0006) [2023-12-28 07:06:22,874][106225] Updated weights for policy 1, policy_version 1651963 (0.0006) [2023-12-28 07:06:22,929][106225] Updated weights for policy 1, policy_version 1651973 (0.0007) [2023-12-28 07:06:23,046][106226] Updated weights for policy 0, policy_version 1648185 (0.0009) [2023-12-28 07:06:23,115][106226] Updated weights for policy 0, policy_version 1648195 (0.0008) [2023-12-28 07:06:23,182][106226] Updated weights for policy 0, policy_version 1648205 (0.0006) [2023-12-28 07:06:23,247][106226] Updated weights for policy 0, policy_version 1648215 (0.0008) [2023-12-28 07:06:23,534][106225] Updated weights for policy 1, policy_version 1651983 (0.0009) [2023-12-28 07:06:23,590][106225] Updated weights for policy 1, policy_version 1651993 (0.0008) [2023-12-28 07:06:23,641][106225] Updated weights for policy 1, policy_version 1652003 (0.0005) [2023-12-28 07:06:23,888][106226] Updated weights for policy 0, policy_version 1648225 (0.0006) [2023-12-28 07:06:23,952][106226] Updated weights for policy 0, policy_version 1648235 (0.0007) [2023-12-28 07:06:24,009][106226] Updated weights for policy 0, policy_version 1648245 (0.0008) [2023-12-28 07:06:24,331][106225] Updated weights for policy 1, policy_version 1652013 (0.0008) [2023-12-28 07:06:24,395][106225] Updated weights for policy 1, policy_version 1652023 (0.0010) [2023-12-28 07:06:24,462][106225] Updated weights for policy 1, policy_version 1652033 (0.0010) [2023-12-28 07:06:24,625][106226] Updated weights for policy 0, policy_version 1648255 (0.0010) [2023-12-28 07:06:24,688][106226] Updated weights for policy 0, policy_version 1648265 (0.0011) [2023-12-28 07:06:24,742][106226] Updated weights for policy 0, policy_version 1648275 (0.0011) [2023-12-28 07:06:25,124][106225] Updated weights for policy 1, policy_version 1652043 (0.0011) [2023-12-28 07:06:25,184][106225] Updated weights for policy 1, policy_version 1652053 (0.0010) [2023-12-28 07:06:25,245][106225] Updated weights for policy 1, policy_version 1652063 (0.0010) [2023-12-28 07:06:25,315][106226] Updated weights for policy 0, policy_version 1648285 (0.0009) [2023-12-28 07:06:25,378][106226] Updated weights for policy 0, policy_version 1648295 (0.0011) [2023-12-28 07:06:25,438][106226] Updated weights for policy 0, policy_version 1648305 (0.0010) [2023-12-28 07:06:25,939][106225] Updated weights for policy 1, policy_version 1652073 (0.0010) [2023-12-28 07:06:26,007][106225] Updated weights for policy 1, policy_version 1652083 (0.0010) [2023-12-28 07:06:26,071][106225] Updated weights for policy 1, policy_version 1652093 (0.0011) [2023-12-28 07:06:26,114][106226] Updated weights for policy 0, policy_version 1648315 (0.0010) [2023-12-28 07:06:26,133][106225] Updated weights for policy 1, policy_version 1652103 (0.0010) [2023-12-28 07:06:26,164][106226] Updated weights for policy 0, policy_version 1648325 (0.0010) [2023-12-28 07:06:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 845037568. Throughput: 0: 9708.3, 1: 10045.7. Samples: 845005572. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:26,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-5.084')] [2023-12-28 07:06:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001652104_422993920.pth... [2023-12-28 07:06:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001650920_422690816.pth [2023-12-28 07:06:26,218][106226] Updated weights for policy 0, policy_version 1648335 (0.0010) [2023-12-28 07:06:26,268][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001648344_422051840.pth... [2023-12-28 07:06:26,272][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001647192_421756928.pth [2023-12-28 07:06:26,740][106225] Updated weights for policy 1, policy_version 1652113 (0.0006) [2023-12-28 07:06:26,786][106225] Updated weights for policy 1, policy_version 1652123 (0.0005) [2023-12-28 07:06:26,831][106225] Updated weights for policy 1, policy_version 1652133 (0.0005) [2023-12-28 07:06:26,871][106226] Updated weights for policy 0, policy_version 1648345 (0.0010) [2023-12-28 07:06:26,927][106226] Updated weights for policy 0, policy_version 1648355 (0.0009) [2023-12-28 07:06:26,986][106226] Updated weights for policy 0, policy_version 1648365 (0.0006) [2023-12-28 07:06:27,048][106226] Updated weights for policy 0, policy_version 1648375 (0.0005) [2023-12-28 07:06:27,490][106225] Updated weights for policy 1, policy_version 1652143 (0.0005) [2023-12-28 07:06:27,535][106225] Updated weights for policy 1, policy_version 1652153 (0.0005) [2023-12-28 07:06:27,584][106225] Updated weights for policy 1, policy_version 1652163 (0.0010) [2023-12-28 07:06:27,654][106226] Updated weights for policy 0, policy_version 1648385 (0.0007) [2023-12-28 07:06:27,709][106226] Updated weights for policy 0, policy_version 1648395 (0.0005) [2023-12-28 07:06:27,764][106226] Updated weights for policy 0, policy_version 1648405 (0.0005) [2023-12-28 07:06:28,265][106225] Updated weights for policy 1, policy_version 1652173 (0.0008) [2023-12-28 07:06:28,341][106225] Updated weights for policy 1, policy_version 1652183 (0.0007) [2023-12-28 07:06:28,374][106226] Updated weights for policy 0, policy_version 1648415 (0.0010) [2023-12-28 07:06:28,401][106225] Updated weights for policy 1, policy_version 1652193 (0.0009) [2023-12-28 07:06:28,437][106226] Updated weights for policy 0, policy_version 1648425 (0.0005) [2023-12-28 07:06:28,503][106226] Updated weights for policy 0, policy_version 1648435 (0.0007) [2023-12-28 07:06:29,091][106225] Updated weights for policy 1, policy_version 1652203 (0.0010) [2023-12-28 07:06:29,155][106225] Updated weights for policy 1, policy_version 1652213 (0.0010) [2023-12-28 07:06:29,219][106225] Updated weights for policy 1, policy_version 1652223 (0.0010) [2023-12-28 07:06:29,261][106226] Updated weights for policy 0, policy_version 1648445 (0.0008) [2023-12-28 07:06:29,319][106226] Updated weights for policy 0, policy_version 1648455 (0.0008) [2023-12-28 07:06:29,383][106226] Updated weights for policy 0, policy_version 1648465 (0.0009) [2023-12-28 07:06:29,850][106225] Updated weights for policy 1, policy_version 1652233 (0.0009) [2023-12-28 07:06:29,903][106225] Updated weights for policy 1, policy_version 1652243 (0.0009) [2023-12-28 07:06:29,973][106225] Updated weights for policy 1, policy_version 1652253 (0.0008) [2023-12-28 07:06:30,028][106225] Updated weights for policy 1, policy_version 1652263 (0.0006) [2023-12-28 07:06:30,232][106226] Updated weights for policy 0, policy_version 1648475 (0.0010) [2023-12-28 07:06:30,292][106226] Updated weights for policy 0, policy_version 1648485 (0.0010) [2023-12-28 07:06:30,350][106226] Updated weights for policy 0, policy_version 1648495 (0.0008) [2023-12-28 07:06:30,709][106225] Updated weights for policy 1, policy_version 1652273 (0.0005) [2023-12-28 07:06:30,777][106225] Updated weights for policy 1, policy_version 1652283 (0.0005) [2023-12-28 07:06:30,824][106225] Updated weights for policy 1, policy_version 1652293 (0.0005) [2023-12-28 07:06:30,942][106226] Updated weights for policy 0, policy_version 1648505 (0.0009) [2023-12-28 07:06:30,987][106226] Updated weights for policy 0, policy_version 1648515 (0.0005) [2023-12-28 07:06:31,049][106226] Updated weights for policy 0, policy_version 1648525 (0.0006) [2023-12-28 07:06:31,122][106226] Updated weights for policy 0, policy_version 1648535 (0.0006) [2023-12-28 07:06:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 845144064. Throughput: 0: 9793.1, 1: 10121.4. Samples: 845129564. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:31,175][105115] Avg episode reward: [(0, '-4.397'), (1, '-4.579')] [2023-12-28 07:06:31,473][106225] Updated weights for policy 1, policy_version 1652303 (0.0008) [2023-12-28 07:06:31,528][106225] Updated weights for policy 1, policy_version 1652313 (0.0008) [2023-12-28 07:06:31,582][106225] Updated weights for policy 1, policy_version 1652323 (0.0008) [2023-12-28 07:06:31,789][106226] Updated weights for policy 0, policy_version 1648545 (0.0007) [2023-12-28 07:06:31,858][106226] Updated weights for policy 0, policy_version 1648555 (0.0005) [2023-12-28 07:06:31,921][106226] Updated weights for policy 0, policy_version 1648565 (0.0005) [2023-12-28 07:06:32,362][106225] Updated weights for policy 1, policy_version 1652333 (0.0009) [2023-12-28 07:06:32,425][106225] Updated weights for policy 1, policy_version 1652343 (0.0008) [2023-12-28 07:06:32,478][106225] Updated weights for policy 1, policy_version 1652353 (0.0007) [2023-12-28 07:06:32,493][106226] Updated weights for policy 0, policy_version 1648575 (0.0007) [2023-12-28 07:06:32,553][106226] Updated weights for policy 0, policy_version 1648585 (0.0008) [2023-12-28 07:06:32,616][106226] Updated weights for policy 0, policy_version 1648595 (0.0010) [2023-12-28 07:06:33,097][106225] Updated weights for policy 1, policy_version 1652363 (0.0008) [2023-12-28 07:06:33,151][106225] Updated weights for policy 1, policy_version 1652373 (0.0005) [2023-12-28 07:06:33,197][106225] Updated weights for policy 1, policy_version 1652383 (0.0005) [2023-12-28 07:06:33,352][106226] Updated weights for policy 0, policy_version 1648605 (0.0007) [2023-12-28 07:06:33,401][106226] Updated weights for policy 0, policy_version 1648615 (0.0008) [2023-12-28 07:06:33,451][106226] Updated weights for policy 0, policy_version 1648625 (0.0009) [2023-12-28 07:06:33,774][106225] Updated weights for policy 1, policy_version 1652393 (0.0005) [2023-12-28 07:06:33,822][106225] Updated weights for policy 1, policy_version 1652403 (0.0007) [2023-12-28 07:06:33,867][106225] Updated weights for policy 1, policy_version 1652413 (0.0007) [2023-12-28 07:06:33,920][106225] Updated weights for policy 1, policy_version 1652423 (0.0007) [2023-12-28 07:06:34,212][106226] Updated weights for policy 0, policy_version 1648635 (0.0008) [2023-12-28 07:06:34,274][106226] Updated weights for policy 0, policy_version 1648645 (0.0008) [2023-12-28 07:06:34,335][106226] Updated weights for policy 0, policy_version 1648655 (0.0008) [2023-12-28 07:06:34,660][106225] Updated weights for policy 1, policy_version 1652433 (0.0008) [2023-12-28 07:06:34,707][106225] Updated weights for policy 1, policy_version 1652443 (0.0008) [2023-12-28 07:06:34,763][106225] Updated weights for policy 1, policy_version 1652453 (0.0008) [2023-12-28 07:06:35,068][106226] Updated weights for policy 0, policy_version 1648665 (0.0008) [2023-12-28 07:06:35,113][106226] Updated weights for policy 0, policy_version 1648675 (0.0008) [2023-12-28 07:06:35,161][106226] Updated weights for policy 0, policy_version 1648685 (0.0008) [2023-12-28 07:06:35,210][106226] Updated weights for policy 0, policy_version 1648695 (0.0008) [2023-12-28 07:06:35,451][106225] Updated weights for policy 1, policy_version 1652463 (0.0009) [2023-12-28 07:06:35,504][106225] Updated weights for policy 1, policy_version 1652473 (0.0008) [2023-12-28 07:06:35,567][106225] Updated weights for policy 1, policy_version 1652483 (0.0007) [2023-12-28 07:06:35,926][106226] Updated weights for policy 0, policy_version 1648705 (0.0006) [2023-12-28 07:06:35,985][106226] Updated weights for policy 0, policy_version 1648715 (0.0006) [2023-12-28 07:06:36,037][106226] Updated weights for policy 0, policy_version 1648725 (0.0008) [2023-12-28 07:06:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 845242368. Throughput: 0: 9826.2, 1: 10130.9. Samples: 845251480. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:36,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-4.382')] [2023-12-28 07:06:36,298][106225] Updated weights for policy 1, policy_version 1652493 (0.0008) [2023-12-28 07:06:36,358][106225] Updated weights for policy 1, policy_version 1652503 (0.0007) [2023-12-28 07:06:36,427][106225] Updated weights for policy 1, policy_version 1652513 (0.0008) [2023-12-28 07:06:36,805][106226] Updated weights for policy 0, policy_version 1648735 (0.0009) [2023-12-28 07:06:36,872][106226] Updated weights for policy 0, policy_version 1648745 (0.0008) [2023-12-28 07:06:36,931][106226] Updated weights for policy 0, policy_version 1648755 (0.0008) [2023-12-28 07:06:37,106][106225] Updated weights for policy 1, policy_version 1652523 (0.0010) [2023-12-28 07:06:37,171][106225] Updated weights for policy 1, policy_version 1652533 (0.0009) [2023-12-28 07:06:37,236][106225] Updated weights for policy 1, policy_version 1652543 (0.0007) [2023-12-28 07:06:37,659][106226] Updated weights for policy 0, policy_version 1648765 (0.0008) [2023-12-28 07:06:37,716][106226] Updated weights for policy 0, policy_version 1648775 (0.0008) [2023-12-28 07:06:37,773][106226] Updated weights for policy 0, policy_version 1648785 (0.0008) [2023-12-28 07:06:37,924][106225] Updated weights for policy 1, policy_version 1652553 (0.0008) [2023-12-28 07:06:37,985][106225] Updated weights for policy 1, policy_version 1652563 (0.0008) [2023-12-28 07:06:38,061][106225] Updated weights for policy 1, policy_version 1652573 (0.0006) [2023-12-28 07:06:38,120][106225] Updated weights for policy 1, policy_version 1652583 (0.0006) [2023-12-28 07:06:38,486][106226] Updated weights for policy 0, policy_version 1648795 (0.0010) [2023-12-28 07:06:38,544][106226] Updated weights for policy 0, policy_version 1648805 (0.0009) [2023-12-28 07:06:38,603][106226] Updated weights for policy 0, policy_version 1648815 (0.0008) [2023-12-28 07:06:38,777][106225] Updated weights for policy 1, policy_version 1652593 (0.0008) [2023-12-28 07:06:38,833][106225] Updated weights for policy 1, policy_version 1652603 (0.0008) [2023-12-28 07:06:38,896][106225] Updated weights for policy 1, policy_version 1652613 (0.0009) [2023-12-28 07:06:39,292][106226] Updated weights for policy 0, policy_version 1648825 (0.0009) [2023-12-28 07:06:39,361][106226] Updated weights for policy 0, policy_version 1648835 (0.0009) [2023-12-28 07:06:39,435][106226] Updated weights for policy 0, policy_version 1648845 (0.0009) [2023-12-28 07:06:39,502][106226] Updated weights for policy 0, policy_version 1648855 (0.0009) [2023-12-28 07:06:39,722][106225] Updated weights for policy 1, policy_version 1652623 (0.0009) [2023-12-28 07:06:39,786][106225] Updated weights for policy 1, policy_version 1652633 (0.0009) [2023-12-28 07:06:39,846][106225] Updated weights for policy 1, policy_version 1652643 (0.0009) [2023-12-28 07:06:40,216][106226] Updated weights for policy 0, policy_version 1648865 (0.0008) [2023-12-28 07:06:40,280][106226] Updated weights for policy 0, policy_version 1648875 (0.0009) [2023-12-28 07:06:40,338][106226] Updated weights for policy 0, policy_version 1648885 (0.0008) [2023-12-28 07:06:40,606][106225] Updated weights for policy 1, policy_version 1652653 (0.0006) [2023-12-28 07:06:40,673][106225] Updated weights for policy 1, policy_version 1652663 (0.0007) [2023-12-28 07:06:40,735][106225] Updated weights for policy 1, policy_version 1652673 (0.0006) [2023-12-28 07:06:41,065][106226] Updated weights for policy 0, policy_version 1648895 (0.0008) [2023-12-28 07:06:41,130][106226] Updated weights for policy 0, policy_version 1648905 (0.0006) [2023-12-28 07:06:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 845332480. Throughput: 0: 9849.7, 1: 10114.3. Samples: 845310196. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:41,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.913')] [2023-12-28 07:06:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001652680_423141376.pth... [2023-12-28 07:06:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001651528_422846464.pth [2023-12-28 07:06:41,200][106226] Updated weights for policy 0, policy_version 1648915 (0.0006) [2023-12-28 07:06:41,229][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001648920_422199296.pth... [2023-12-28 07:06:41,234][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001647768_421904384.pth [2023-12-28 07:06:41,469][106225] Updated weights for policy 1, policy_version 1652683 (0.0007) [2023-12-28 07:06:41,530][106225] Updated weights for policy 1, policy_version 1652693 (0.0009) [2023-12-28 07:06:41,595][106225] Updated weights for policy 1, policy_version 1652703 (0.0009) [2023-12-28 07:06:41,966][106226] Updated weights for policy 0, policy_version 1648925 (0.0007) [2023-12-28 07:06:42,024][106226] Updated weights for policy 0, policy_version 1648935 (0.0009) [2023-12-28 07:06:42,089][106226] Updated weights for policy 0, policy_version 1648945 (0.0007) [2023-12-28 07:06:42,343][106225] Updated weights for policy 1, policy_version 1652713 (0.0009) [2023-12-28 07:06:42,403][106225] Updated weights for policy 1, policy_version 1652723 (0.0010) [2023-12-28 07:06:42,469][106225] Updated weights for policy 1, policy_version 1652733 (0.0009) [2023-12-28 07:06:42,530][106225] Updated weights for policy 1, policy_version 1652743 (0.0008) [2023-12-28 07:06:42,754][106226] Updated weights for policy 0, policy_version 1648955 (0.0007) [2023-12-28 07:06:42,823][106226] Updated weights for policy 0, policy_version 1648965 (0.0011) [2023-12-28 07:06:42,881][106226] Updated weights for policy 0, policy_version 1648975 (0.0009) [2023-12-28 07:06:43,126][106225] Updated weights for policy 1, policy_version 1652753 (0.0007) [2023-12-28 07:06:43,182][106225] Updated weights for policy 1, policy_version 1652763 (0.0009) [2023-12-28 07:06:43,228][106225] Updated weights for policy 1, policy_version 1652773 (0.0010) [2023-12-28 07:06:43,570][106226] Updated weights for policy 0, policy_version 1648985 (0.0007) [2023-12-28 07:06:43,625][106226] Updated weights for policy 0, policy_version 1648995 (0.0009) [2023-12-28 07:06:43,674][106226] Updated weights for policy 0, policy_version 1649005 (0.0008) [2023-12-28 07:06:43,727][106226] Updated weights for policy 0, policy_version 1649015 (0.0008) [2023-12-28 07:06:43,907][106225] Updated weights for policy 1, policy_version 1652783 (0.0007) [2023-12-28 07:06:43,963][106225] Updated weights for policy 1, policy_version 1652793 (0.0008) [2023-12-28 07:06:44,026][106225] Updated weights for policy 1, policy_version 1652803 (0.0007) [2023-12-28 07:06:44,388][106226] Updated weights for policy 0, policy_version 1649025 (0.0009) [2023-12-28 07:06:44,448][106226] Updated weights for policy 0, policy_version 1649035 (0.0008) [2023-12-28 07:06:44,499][106226] Updated weights for policy 0, policy_version 1649045 (0.0009) [2023-12-28 07:06:44,619][106225] Updated weights for policy 1, policy_version 1652813 (0.0007) [2023-12-28 07:06:44,679][106225] Updated weights for policy 1, policy_version 1652823 (0.0007) [2023-12-28 07:06:44,738][106225] Updated weights for policy 1, policy_version 1652833 (0.0008) [2023-12-28 07:06:45,248][106226] Updated weights for policy 0, policy_version 1649055 (0.0009) [2023-12-28 07:06:45,310][106226] Updated weights for policy 0, policy_version 1649065 (0.0009) [2023-12-28 07:06:45,361][106226] Updated weights for policy 0, policy_version 1649075 (0.0009) [2023-12-28 07:06:45,456][106225] Updated weights for policy 1, policy_version 1652843 (0.0007) [2023-12-28 07:06:45,513][106225] Updated weights for policy 1, policy_version 1652853 (0.0007) [2023-12-28 07:06:45,569][106225] Updated weights for policy 1, policy_version 1652863 (0.0007) [2023-12-28 07:06:46,138][106226] Updated weights for policy 0, policy_version 1649085 (0.0008) [2023-12-28 07:06:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 845430784. Throughput: 0: 9769.8, 1: 10013.5. Samples: 845426680. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:46,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.926')] [2023-12-28 07:06:46,198][106226] Updated weights for policy 0, policy_version 1649095 (0.0005) [2023-12-28 07:06:46,217][106225] Updated weights for policy 1, policy_version 1652873 (0.0005) [2023-12-28 07:06:46,254][106226] Updated weights for policy 0, policy_version 1649105 (0.0005) [2023-12-28 07:06:46,266][106225] Updated weights for policy 1, policy_version 1652883 (0.0008) [2023-12-28 07:06:46,317][106225] Updated weights for policy 1, policy_version 1652893 (0.0008) [2023-12-28 07:06:46,374][106225] Updated weights for policy 1, policy_version 1652903 (0.0008) [2023-12-28 07:06:46,902][106226] Updated weights for policy 0, policy_version 1649115 (0.0007) [2023-12-28 07:06:46,962][106226] Updated weights for policy 0, policy_version 1649125 (0.0010) [2023-12-28 07:06:47,016][106226] Updated weights for policy 0, policy_version 1649135 (0.0010) [2023-12-28 07:06:47,052][106225] Updated weights for policy 1, policy_version 1652913 (0.0006) [2023-12-28 07:06:47,108][106225] Updated weights for policy 1, policy_version 1652923 (0.0006) [2023-12-28 07:06:47,158][106225] Updated weights for policy 1, policy_version 1652933 (0.0007) [2023-12-28 07:06:47,601][106226] Updated weights for policy 0, policy_version 1649145 (0.0007) [2023-12-28 07:06:47,651][106226] Updated weights for policy 0, policy_version 1649155 (0.0010) [2023-12-28 07:06:47,695][106226] Updated weights for policy 0, policy_version 1649165 (0.0010) [2023-12-28 07:06:47,751][106226] Updated weights for policy 0, policy_version 1649175 (0.0005) [2023-12-28 07:06:47,936][106225] Updated weights for policy 1, policy_version 1652943 (0.0008) [2023-12-28 07:06:47,988][106225] Updated weights for policy 1, policy_version 1652953 (0.0007) [2023-12-28 07:06:48,043][106225] Updated weights for policy 1, policy_version 1652963 (0.0010) [2023-12-28 07:06:48,299][106226] Updated weights for policy 0, policy_version 1649185 (0.0006) [2023-12-28 07:06:48,359][106226] Updated weights for policy 0, policy_version 1649195 (0.0007) [2023-12-28 07:06:48,420][106226] Updated weights for policy 0, policy_version 1649205 (0.0011) [2023-12-28 07:06:48,814][106225] Updated weights for policy 1, policy_version 1652973 (0.0009) [2023-12-28 07:06:48,872][106225] Updated weights for policy 1, policy_version 1652983 (0.0008) [2023-12-28 07:06:48,927][106225] Updated weights for policy 1, policy_version 1652993 (0.0008) [2023-12-28 07:06:49,150][106226] Updated weights for policy 0, policy_version 1649215 (0.0011) [2023-12-28 07:06:49,206][106226] Updated weights for policy 0, policy_version 1649225 (0.0010) [2023-12-28 07:06:49,277][106226] Updated weights for policy 0, policy_version 1649235 (0.0010) [2023-12-28 07:06:49,686][106225] Updated weights for policy 1, policy_version 1653003 (0.0008) [2023-12-28 07:06:49,743][106225] Updated weights for policy 1, policy_version 1653013 (0.0008) [2023-12-28 07:06:49,797][106225] Updated weights for policy 1, policy_version 1653023 (0.0008) [2023-12-28 07:06:50,030][106226] Updated weights for policy 0, policy_version 1649245 (0.0011) [2023-12-28 07:06:50,092][106226] Updated weights for policy 0, policy_version 1649255 (0.0011) [2023-12-28 07:06:50,153][106226] Updated weights for policy 0, policy_version 1649265 (0.0011) [2023-12-28 07:06:50,583][106225] Updated weights for policy 1, policy_version 1653033 (0.0008) [2023-12-28 07:06:50,649][106225] Updated weights for policy 1, policy_version 1653043 (0.0008) [2023-12-28 07:06:50,710][106225] Updated weights for policy 1, policy_version 1653053 (0.0007) [2023-12-28 07:06:50,772][106225] Updated weights for policy 1, policy_version 1653063 (0.0008) [2023-12-28 07:06:50,830][106226] Updated weights for policy 0, policy_version 1649275 (0.0010) [2023-12-28 07:06:50,898][106226] Updated weights for policy 0, policy_version 1649285 (0.0008) [2023-12-28 07:06:50,958][106226] Updated weights for policy 0, policy_version 1649295 (0.0008) [2023-12-28 07:06:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 845537280. Throughput: 0: 9852.8, 1: 9912.1. Samples: 845545116. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:51,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.949')] [2023-12-28 07:06:51,512][106225] Updated weights for policy 1, policy_version 1653073 (0.0008) [2023-12-28 07:06:51,577][106225] Updated weights for policy 1, policy_version 1653083 (0.0008) [2023-12-28 07:06:51,641][106225] Updated weights for policy 1, policy_version 1653093 (0.0009) [2023-12-28 07:06:51,735][106226] Updated weights for policy 0, policy_version 1649305 (0.0007) [2023-12-28 07:06:51,799][106226] Updated weights for policy 0, policy_version 1649315 (0.0008) [2023-12-28 07:06:51,869][106226] Updated weights for policy 0, policy_version 1649325 (0.0009) [2023-12-28 07:06:51,931][106226] Updated weights for policy 0, policy_version 1649335 (0.0010) [2023-12-28 07:06:52,271][106225] Updated weights for policy 1, policy_version 1653103 (0.0007) [2023-12-28 07:06:52,337][106225] Updated weights for policy 1, policy_version 1653113 (0.0008) [2023-12-28 07:06:52,405][106225] Updated weights for policy 1, policy_version 1653123 (0.0008) [2023-12-28 07:06:52,650][106226] Updated weights for policy 0, policy_version 1649345 (0.0009) [2023-12-28 07:06:52,716][106226] Updated weights for policy 0, policy_version 1649355 (0.0009) [2023-12-28 07:06:52,781][106226] Updated weights for policy 0, policy_version 1649365 (0.0008) [2023-12-28 07:06:53,067][106225] Updated weights for policy 1, policy_version 1653133 (0.0007) [2023-12-28 07:06:53,126][106225] Updated weights for policy 1, policy_version 1653143 (0.0007) [2023-12-28 07:06:53,194][106225] Updated weights for policy 1, policy_version 1653153 (0.0007) [2023-12-28 07:06:53,548][106226] Updated weights for policy 0, policy_version 1649375 (0.0010) [2023-12-28 07:06:53,623][106226] Updated weights for policy 0, policy_version 1649385 (0.0010) [2023-12-28 07:06:53,684][106226] Updated weights for policy 0, policy_version 1649395 (0.0008) [2023-12-28 07:06:53,771][106225] Updated weights for policy 1, policy_version 1653163 (0.0006) [2023-12-28 07:06:53,829][106225] Updated weights for policy 1, policy_version 1653173 (0.0008) [2023-12-28 07:06:53,882][106225] Updated weights for policy 1, policy_version 1653183 (0.0006) [2023-12-28 07:06:54,438][106226] Updated weights for policy 0, policy_version 1649405 (0.0008) [2023-12-28 07:06:54,493][106226] Updated weights for policy 0, policy_version 1649415 (0.0008) [2023-12-28 07:06:54,544][106226] Updated weights for policy 0, policy_version 1649425 (0.0008) [2023-12-28 07:06:54,567][106225] Updated weights for policy 1, policy_version 1653193 (0.0006) [2023-12-28 07:06:54,623][106225] Updated weights for policy 1, policy_version 1653203 (0.0007) [2023-12-28 07:06:54,680][106225] Updated weights for policy 1, policy_version 1653213 (0.0007) [2023-12-28 07:06:54,730][106225] Updated weights for policy 1, policy_version 1653223 (0.0005) [2023-12-28 07:06:55,261][106226] Updated weights for policy 0, policy_version 1649435 (0.0008) [2023-12-28 07:06:55,318][106226] Updated weights for policy 0, policy_version 1649445 (0.0008) [2023-12-28 07:06:55,375][106226] Updated weights for policy 0, policy_version 1649455 (0.0007) [2023-12-28 07:06:55,427][106225] Updated weights for policy 1, policy_version 1653233 (0.0007) [2023-12-28 07:06:55,482][106225] Updated weights for policy 1, policy_version 1653243 (0.0008) [2023-12-28 07:06:55,540][106225] Updated weights for policy 1, policy_version 1653253 (0.0008) [2023-12-28 07:06:56,095][106226] Updated weights for policy 0, policy_version 1649465 (0.0006) [2023-12-28 07:06:56,156][106226] Updated weights for policy 0, policy_version 1649475 (0.0009) [2023-12-28 07:06:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 845627392. Throughput: 0: 9839.3, 1: 9957.5. Samples: 845603524. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:06:56,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.460')] [2023-12-28 07:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001653256_423288832.pth... [2023-12-28 07:06:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001652104_422993920.pth [2023-12-28 07:06:56,210][106226] Updated weights for policy 0, policy_version 1649485 (0.0008) [2023-12-28 07:06:56,265][106225] Updated weights for policy 1, policy_version 1653263 (0.0007) [2023-12-28 07:06:56,270][106226] Updated weights for policy 0, policy_version 1649495 (0.0008) [2023-12-28 07:06:56,275][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001649496_422346752.pth... [2023-12-28 07:06:56,279][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001648344_422051840.pth [2023-12-28 07:06:56,312][106225] Updated weights for policy 1, policy_version 1653273 (0.0008) [2023-12-28 07:06:56,368][106225] Updated weights for policy 1, policy_version 1653283 (0.0009) [2023-12-28 07:06:57,004][106226] Updated weights for policy 0, policy_version 1649505 (0.0006) [2023-12-28 07:06:57,052][106226] Updated weights for policy 0, policy_version 1649515 (0.0005) [2023-12-28 07:06:57,112][106226] Updated weights for policy 0, policy_version 1649525 (0.0005) [2023-12-28 07:06:57,138][106225] Updated weights for policy 1, policy_version 1653293 (0.0006) [2023-12-28 07:06:57,186][106225] Updated weights for policy 1, policy_version 1653303 (0.0005) [2023-12-28 07:06:57,239][106225] Updated weights for policy 1, policy_version 1653313 (0.0006) [2023-12-28 07:06:57,719][106226] Updated weights for policy 0, policy_version 1649535 (0.0008) [2023-12-28 07:06:57,766][106226] Updated weights for policy 0, policy_version 1649545 (0.0008) [2023-12-28 07:06:57,821][106226] Updated weights for policy 0, policy_version 1649555 (0.0008) [2023-12-28 07:06:57,926][106225] Updated weights for policy 1, policy_version 1653323 (0.0009) [2023-12-28 07:06:57,996][106225] Updated weights for policy 1, policy_version 1653333 (0.0008) [2023-12-28 07:06:58,052][106225] Updated weights for policy 1, policy_version 1653343 (0.0005) [2023-12-28 07:06:58,588][106226] Updated weights for policy 0, policy_version 1649565 (0.0009) [2023-12-28 07:06:58,652][106226] Updated weights for policy 0, policy_version 1649575 (0.0008) [2023-12-28 07:06:58,722][106226] Updated weights for policy 0, policy_version 1649585 (0.0008) [2023-12-28 07:06:58,750][106225] Updated weights for policy 1, policy_version 1653353 (0.0006) [2023-12-28 07:06:58,822][106225] Updated weights for policy 1, policy_version 1653363 (0.0009) [2023-12-28 07:06:58,876][106225] Updated weights for policy 1, policy_version 1653373 (0.0009) [2023-12-28 07:06:58,937][106225] Updated weights for policy 1, policy_version 1653383 (0.0009) [2023-12-28 07:06:59,460][106226] Updated weights for policy 0, policy_version 1649595 (0.0009) [2023-12-28 07:06:59,518][106226] Updated weights for policy 0, policy_version 1649605 (0.0008) [2023-12-28 07:06:59,577][106226] Updated weights for policy 0, policy_version 1649615 (0.0009) [2023-12-28 07:06:59,704][106225] Updated weights for policy 1, policy_version 1653393 (0.0008) [2023-12-28 07:06:59,774][106225] Updated weights for policy 1, policy_version 1653403 (0.0009) [2023-12-28 07:06:59,842][106225] Updated weights for policy 1, policy_version 1653413 (0.0008) [2023-12-28 07:07:00,233][106226] Updated weights for policy 0, policy_version 1649625 (0.0009) [2023-12-28 07:07:00,287][106226] Updated weights for policy 0, policy_version 1649635 (0.0007) [2023-12-28 07:07:00,350][106226] Updated weights for policy 0, policy_version 1649645 (0.0008) [2023-12-28 07:07:00,407][106226] Updated weights for policy 0, policy_version 1649655 (0.0006) [2023-12-28 07:07:00,531][106225] Updated weights for policy 1, policy_version 1653423 (0.0008) [2023-12-28 07:07:00,588][106225] Updated weights for policy 1, policy_version 1653433 (0.0006) [2023-12-28 07:07:00,642][106225] Updated weights for policy 1, policy_version 1653443 (0.0006) [2023-12-28 07:07:01,129][106226] Updated weights for policy 0, policy_version 1649665 (0.0007) [2023-12-28 07:07:01,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 845725696. Throughput: 0: 9886.8, 1: 9943.2. Samples: 845719616. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:01,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.998')] [2023-12-28 07:07:01,184][106226] Updated weights for policy 0, policy_version 1649675 (0.0008) [2023-12-28 07:07:01,235][106226] Updated weights for policy 0, policy_version 1649685 (0.0008) [2023-12-28 07:07:01,354][106225] Updated weights for policy 1, policy_version 1653453 (0.0007) [2023-12-28 07:07:01,412][106225] Updated weights for policy 1, policy_version 1653463 (0.0007) [2023-12-28 07:07:01,459][106225] Updated weights for policy 1, policy_version 1653473 (0.0005) [2023-12-28 07:07:01,956][106226] Updated weights for policy 0, policy_version 1649695 (0.0006) [2023-12-28 07:07:02,023][106226] Updated weights for policy 0, policy_version 1649705 (0.0008) [2023-12-28 07:07:02,088][106226] Updated weights for policy 0, policy_version 1649715 (0.0008) [2023-12-28 07:07:02,243][106225] Updated weights for policy 1, policy_version 1653483 (0.0008) [2023-12-28 07:07:02,302][106225] Updated weights for policy 1, policy_version 1653493 (0.0008) [2023-12-28 07:07:02,357][106225] Updated weights for policy 1, policy_version 1653503 (0.0008) [2023-12-28 07:07:02,795][106226] Updated weights for policy 0, policy_version 1649725 (0.0008) [2023-12-28 07:07:02,853][106226] Updated weights for policy 0, policy_version 1649735 (0.0009) [2023-12-28 07:07:02,903][106226] Updated weights for policy 0, policy_version 1649745 (0.0008) [2023-12-28 07:07:02,946][106225] Updated weights for policy 1, policy_version 1653513 (0.0006) [2023-12-28 07:07:03,003][106225] Updated weights for policy 1, policy_version 1653523 (0.0009) [2023-12-28 07:07:03,054][106225] Updated weights for policy 1, policy_version 1653533 (0.0008) [2023-12-28 07:07:03,097][106225] Updated weights for policy 1, policy_version 1653543 (0.0008) [2023-12-28 07:07:03,659][106226] Updated weights for policy 0, policy_version 1649755 (0.0007) [2023-12-28 07:07:03,722][106226] Updated weights for policy 0, policy_version 1649765 (0.0005) [2023-12-28 07:07:03,780][106226] Updated weights for policy 0, policy_version 1649775 (0.0007) [2023-12-28 07:07:03,785][106225] Updated weights for policy 1, policy_version 1653553 (0.0006) [2023-12-28 07:07:03,835][106225] Updated weights for policy 1, policy_version 1653563 (0.0007) [2023-12-28 07:07:03,894][106225] Updated weights for policy 1, policy_version 1653573 (0.0010) [2023-12-28 07:07:04,419][106226] Updated weights for policy 0, policy_version 1649785 (0.0007) [2023-12-28 07:07:04,487][106226] Updated weights for policy 0, policy_version 1649795 (0.0005) [2023-12-28 07:07:04,555][106226] Updated weights for policy 0, policy_version 1649805 (0.0007) [2023-12-28 07:07:04,604][106226] Updated weights for policy 0, policy_version 1649815 (0.0008) [2023-12-28 07:07:04,672][106225] Updated weights for policy 1, policy_version 1653583 (0.0008) [2023-12-28 07:07:04,723][106225] Updated weights for policy 1, policy_version 1653593 (0.0009) [2023-12-28 07:07:04,786][106225] Updated weights for policy 1, policy_version 1653603 (0.0006) [2023-12-28 07:07:05,155][106226] Updated weights for policy 0, policy_version 1649825 (0.0006) [2023-12-28 07:07:05,215][106226] Updated weights for policy 0, policy_version 1649835 (0.0005) [2023-12-28 07:07:05,267][106226] Updated weights for policy 0, policy_version 1649845 (0.0005) [2023-12-28 07:07:05,394][106225] Updated weights for policy 1, policy_version 1653613 (0.0007) [2023-12-28 07:07:05,441][106225] Updated weights for policy 1, policy_version 1653623 (0.0005) [2023-12-28 07:07:05,493][106225] Updated weights for policy 1, policy_version 1653633 (0.0005) [2023-12-28 07:07:05,931][106226] Updated weights for policy 0, policy_version 1649855 (0.0007) [2023-12-28 07:07:05,993][106226] Updated weights for policy 0, policy_version 1649865 (0.0008) [2023-12-28 07:07:06,036][106225] Updated weights for policy 1, policy_version 1653643 (0.0005) [2023-12-28 07:07:06,065][106226] Updated weights for policy 0, policy_version 1649875 (0.0009) [2023-12-28 07:07:06,095][106225] Updated weights for policy 1, policy_version 1653653 (0.0006) [2023-12-28 07:07:06,161][106225] Updated weights for policy 1, policy_version 1653663 (0.0008) [2023-12-28 07:07:06,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 845832192. Throughput: 0: 9900.4, 1: 9979.2. Samples: 845841600. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:06,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.808')] [2023-12-28 07:07:06,835][106226] Updated weights for policy 0, policy_version 1649885 (0.0007) [2023-12-28 07:07:06,886][106226] Updated weights for policy 0, policy_version 1649895 (0.0005) [2023-12-28 07:07:06,935][106226] Updated weights for policy 0, policy_version 1649905 (0.0005) [2023-12-28 07:07:06,951][106225] Updated weights for policy 1, policy_version 1653673 (0.0008) [2023-12-28 07:07:07,011][106225] Updated weights for policy 1, policy_version 1653683 (0.0005) [2023-12-28 07:07:07,072][106225] Updated weights for policy 1, policy_version 1653693 (0.0006) [2023-12-28 07:07:07,140][106225] Updated weights for policy 1, policy_version 1653703 (0.0006) [2023-12-28 07:07:07,586][106226] Updated weights for policy 0, policy_version 1649915 (0.0007) [2023-12-28 07:07:07,654][106226] Updated weights for policy 0, policy_version 1649925 (0.0011) [2023-12-28 07:07:07,706][106225] Updated weights for policy 1, policy_version 1653713 (0.0006) [2023-12-28 07:07:07,723][106226] Updated weights for policy 0, policy_version 1649935 (0.0011) [2023-12-28 07:07:07,764][106225] Updated weights for policy 1, policy_version 1653723 (0.0006) [2023-12-28 07:07:07,822][106225] Updated weights for policy 1, policy_version 1653733 (0.0008) [2023-12-28 07:07:08,442][106226] Updated weights for policy 0, policy_version 1649945 (0.0009) [2023-12-28 07:07:08,498][106226] Updated weights for policy 0, policy_version 1649955 (0.0009) [2023-12-28 07:07:08,536][106225] Updated weights for policy 1, policy_version 1653743 (0.0010) [2023-12-28 07:07:08,553][106226] Updated weights for policy 0, policy_version 1649965 (0.0006) [2023-12-28 07:07:08,601][106225] Updated weights for policy 1, policy_version 1653753 (0.0010) [2023-12-28 07:07:08,611][106226] Updated weights for policy 0, policy_version 1649975 (0.0005) [2023-12-28 07:07:08,665][106225] Updated weights for policy 1, policy_version 1653763 (0.0010) [2023-12-28 07:07:09,274][106226] Updated weights for policy 0, policy_version 1649985 (0.0010) [2023-12-28 07:07:09,336][106226] Updated weights for policy 0, policy_version 1649995 (0.0008) [2023-12-28 07:07:09,409][106226] Updated weights for policy 0, policy_version 1650005 (0.0009) [2023-12-28 07:07:09,422][106225] Updated weights for policy 1, policy_version 1653773 (0.0011) [2023-12-28 07:07:09,489][106225] Updated weights for policy 1, policy_version 1653783 (0.0008) [2023-12-28 07:07:09,548][106225] Updated weights for policy 1, policy_version 1653793 (0.0008) [2023-12-28 07:07:10,149][106226] Updated weights for policy 0, policy_version 1650015 (0.0008) [2023-12-28 07:07:10,217][106226] Updated weights for policy 0, policy_version 1650025 (0.0007) [2023-12-28 07:07:10,285][106226] Updated weights for policy 0, policy_version 1650035 (0.0007) [2023-12-28 07:07:10,349][106225] Updated weights for policy 1, policy_version 1653803 (0.0008) [2023-12-28 07:07:10,412][106225] Updated weights for policy 1, policy_version 1653813 (0.0008) [2023-12-28 07:07:10,471][106225] Updated weights for policy 1, policy_version 1653823 (0.0008) [2023-12-28 07:07:11,018][106226] Updated weights for policy 0, policy_version 1650045 (0.0008) [2023-12-28 07:07:11,091][106226] Updated weights for policy 0, policy_version 1650055 (0.0009) [2023-12-28 07:07:11,160][106226] Updated weights for policy 0, policy_version 1650065 (0.0008) [2023-12-28 07:07:11,169][106225] Updated weights for policy 1, policy_version 1653833 (0.0008) [2023-12-28 07:07:11,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 845922304. Throughput: 0: 9922.0, 1: 10000.0. Samples: 845902060. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:11,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.845')] [2023-12-28 07:07:11,205][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001650072_422494208.pth... [2023-12-28 07:07:11,211][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001648920_422199296.pth [2023-12-28 07:07:11,228][106225] Updated weights for policy 1, policy_version 1653843 (0.0007) [2023-12-28 07:07:11,295][106225] Updated weights for policy 1, policy_version 1653853 (0.0008) [2023-12-28 07:07:11,360][106225] Updated weights for policy 1, policy_version 1653863 (0.0008) [2023-12-28 07:07:11,368][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001653864_423444480.pth... [2023-12-28 07:07:11,371][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001652680_423141376.pth [2023-12-28 07:07:11,963][106226] Updated weights for policy 0, policy_version 1650075 (0.0008) [2023-12-28 07:07:12,026][106226] Updated weights for policy 0, policy_version 1650085 (0.0008) [2023-12-28 07:07:12,081][106226] Updated weights for policy 0, policy_version 1650095 (0.0008) [2023-12-28 07:07:12,114][106225] Updated weights for policy 1, policy_version 1653873 (0.0010) [2023-12-28 07:07:12,177][106225] Updated weights for policy 1, policy_version 1653883 (0.0009) [2023-12-28 07:07:12,234][106225] Updated weights for policy 1, policy_version 1653893 (0.0008) [2023-12-28 07:07:12,836][106226] Updated weights for policy 0, policy_version 1650105 (0.0007) [2023-12-28 07:07:12,898][106226] Updated weights for policy 0, policy_version 1650115 (0.0006) [2023-12-28 07:07:12,953][106226] Updated weights for policy 0, policy_version 1650125 (0.0008) [2023-12-28 07:07:12,995][106225] Updated weights for policy 1, policy_version 1653903 (0.0009) [2023-12-28 07:07:13,008][106226] Updated weights for policy 0, policy_version 1650135 (0.0006) [2023-12-28 07:07:13,059][106225] Updated weights for policy 1, policy_version 1653913 (0.0008) [2023-12-28 07:07:13,117][106225] Updated weights for policy 1, policy_version 1653923 (0.0009) [2023-12-28 07:07:13,719][106226] Updated weights for policy 0, policy_version 1650145 (0.0008) [2023-12-28 07:07:13,741][106225] Updated weights for policy 1, policy_version 1653933 (0.0009) [2023-12-28 07:07:13,777][106226] Updated weights for policy 0, policy_version 1650155 (0.0006) [2023-12-28 07:07:13,794][106225] Updated weights for policy 1, policy_version 1653943 (0.0010) [2023-12-28 07:07:13,831][106226] Updated weights for policy 0, policy_version 1650165 (0.0005) [2023-12-28 07:07:13,851][106225] Updated weights for policy 1, policy_version 1653953 (0.0010) [2023-12-28 07:07:14,479][106225] Updated weights for policy 1, policy_version 1653963 (0.0010) [2023-12-28 07:07:14,526][106226] Updated weights for policy 0, policy_version 1650175 (0.0006) [2023-12-28 07:07:14,533][106225] Updated weights for policy 1, policy_version 1653973 (0.0008) [2023-12-28 07:07:14,586][106226] Updated weights for policy 0, policy_version 1650185 (0.0006) [2023-12-28 07:07:14,590][106225] Updated weights for policy 1, policy_version 1653983 (0.0007) [2023-12-28 07:07:14,648][106226] Updated weights for policy 0, policy_version 1650195 (0.0005) [2023-12-28 07:07:15,274][106226] Updated weights for policy 0, policy_version 1650205 (0.0007) [2023-12-28 07:07:15,334][106226] Updated weights for policy 0, policy_version 1650215 (0.0008) [2023-12-28 07:07:15,341][106225] Updated weights for policy 1, policy_version 1653993 (0.0008) [2023-12-28 07:07:15,389][106226] Updated weights for policy 0, policy_version 1650225 (0.0009) [2023-12-28 07:07:15,395][106225] Updated weights for policy 1, policy_version 1654003 (0.0007) [2023-12-28 07:07:15,437][106225] Updated weights for policy 1, policy_version 1654013 (0.0007) [2023-12-28 07:07:15,484][106225] Updated weights for policy 1, policy_version 1654023 (0.0007) [2023-12-28 07:07:16,050][106226] Updated weights for policy 0, policy_version 1650235 (0.0010) [2023-12-28 07:07:16,060][106225] Updated weights for policy 1, policy_version 1654033 (0.0005) [2023-12-28 07:07:16,095][106226] Updated weights for policy 0, policy_version 1650245 (0.0010) [2023-12-28 07:07:16,120][106225] Updated weights for policy 1, policy_version 1654043 (0.0005) [2023-12-28 07:07:16,152][106226] Updated weights for policy 0, policy_version 1650255 (0.0010) [2023-12-28 07:07:16,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 846020608. Throughput: 0: 9803.6, 1: 9899.7. Samples: 846016208. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:16,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.781')] [2023-12-28 07:07:16,184][106225] Updated weights for policy 1, policy_version 1654053 (0.0005) [2023-12-28 07:07:16,744][106226] Updated weights for policy 0, policy_version 1650265 (0.0007) [2023-12-28 07:07:16,809][106226] Updated weights for policy 0, policy_version 1650275 (0.0010) [2023-12-28 07:07:16,813][106225] Updated weights for policy 1, policy_version 1654063 (0.0007) [2023-12-28 07:07:16,862][106225] Updated weights for policy 1, policy_version 1654073 (0.0005) [2023-12-28 07:07:16,869][106226] Updated weights for policy 0, policy_version 1650285 (0.0008) [2023-12-28 07:07:16,906][106225] Updated weights for policy 1, policy_version 1654083 (0.0005) [2023-12-28 07:07:16,930][106226] Updated weights for policy 0, policy_version 1650295 (0.0008) [2023-12-28 07:07:17,424][106225] Updated weights for policy 1, policy_version 1654093 (0.0006) [2023-12-28 07:07:17,482][106225] Updated weights for policy 1, policy_version 1654103 (0.0008) [2023-12-28 07:07:17,545][106225] Updated weights for policy 1, policy_version 1654113 (0.0005) [2023-12-28 07:07:17,638][106226] Updated weights for policy 0, policy_version 1650305 (0.0010) [2023-12-28 07:07:17,688][106226] Updated weights for policy 0, policy_version 1650315 (0.0010) [2023-12-28 07:07:17,742][106226] Updated weights for policy 0, policy_version 1650325 (0.0011) [2023-12-28 07:07:18,105][106225] Updated weights for policy 1, policy_version 1654123 (0.0007) [2023-12-28 07:07:18,167][106225] Updated weights for policy 1, policy_version 1654133 (0.0010) [2023-12-28 07:07:18,229][106225] Updated weights for policy 1, policy_version 1654143 (0.0010) [2023-12-28 07:07:18,466][106226] Updated weights for policy 0, policy_version 1650335 (0.0011) [2023-12-28 07:07:18,532][106226] Updated weights for policy 0, policy_version 1650345 (0.0011) [2023-12-28 07:07:18,595][106226] Updated weights for policy 0, policy_version 1650355 (0.0011) [2023-12-28 07:07:18,926][106225] Updated weights for policy 1, policy_version 1654153 (0.0010) [2023-12-28 07:07:18,987][106225] Updated weights for policy 1, policy_version 1654163 (0.0009) [2023-12-28 07:07:19,041][106225] Updated weights for policy 1, policy_version 1654173 (0.0010) [2023-12-28 07:07:19,091][106225] Updated weights for policy 1, policy_version 1654183 (0.0010) [2023-12-28 07:07:19,255][106226] Updated weights for policy 0, policy_version 1650365 (0.0010) [2023-12-28 07:07:19,310][106226] Updated weights for policy 0, policy_version 1650375 (0.0008) [2023-12-28 07:07:19,371][106226] Updated weights for policy 0, policy_version 1650385 (0.0008) [2023-12-28 07:07:19,841][106225] Updated weights for policy 1, policy_version 1654193 (0.0008) [2023-12-28 07:07:19,909][106225] Updated weights for policy 1, policy_version 1654203 (0.0007) [2023-12-28 07:07:19,979][106225] Updated weights for policy 1, policy_version 1654213 (0.0011) [2023-12-28 07:07:20,121][106226] Updated weights for policy 0, policy_version 1650395 (0.0007) [2023-12-28 07:07:20,183][106226] Updated weights for policy 0, policy_version 1650405 (0.0009) [2023-12-28 07:07:20,249][106226] Updated weights for policy 0, policy_version 1650415 (0.0009) [2023-12-28 07:07:20,641][106225] Updated weights for policy 1, policy_version 1654223 (0.0009) [2023-12-28 07:07:20,697][106225] Updated weights for policy 1, policy_version 1654233 (0.0008) [2023-12-28 07:07:20,744][106225] Updated weights for policy 1, policy_version 1654243 (0.0008) [2023-12-28 07:07:20,996][106226] Updated weights for policy 0, policy_version 1650425 (0.0010) [2023-12-28 07:07:21,068][106226] Updated weights for policy 0, policy_version 1650435 (0.0008) [2023-12-28 07:07:21,130][106226] Updated weights for policy 0, policy_version 1650445 (0.0010) [2023-12-28 07:07:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 846127104. Throughput: 0: 9810.3, 1: 9954.5. Samples: 846140896. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:21,175][105115] Avg episode reward: [(0, '-4.708'), (1, '-4.875')] [2023-12-28 07:07:21,197][106226] Updated weights for policy 0, policy_version 1650455 (0.0010) [2023-12-28 07:07:21,532][106225] Updated weights for policy 1, policy_version 1654253 (0.0007) [2023-12-28 07:07:21,598][106225] Updated weights for policy 1, policy_version 1654263 (0.0007) [2023-12-28 07:07:21,664][106225] Updated weights for policy 1, policy_version 1654273 (0.0008) [2023-12-28 07:07:21,936][106226] Updated weights for policy 0, policy_version 1650465 (0.0011) [2023-12-28 07:07:21,987][106226] Updated weights for policy 0, policy_version 1650475 (0.0011) [2023-12-28 07:07:22,052][106226] Updated weights for policy 0, policy_version 1650485 (0.0011) [2023-12-28 07:07:22,343][106225] Updated weights for policy 1, policy_version 1654283 (0.0008) [2023-12-28 07:07:22,413][106225] Updated weights for policy 1, policy_version 1654293 (0.0008) [2023-12-28 07:07:22,473][106225] Updated weights for policy 1, policy_version 1654303 (0.0007) [2023-12-28 07:07:22,803][106226] Updated weights for policy 0, policy_version 1650495 (0.0011) [2023-12-28 07:07:22,865][106226] Updated weights for policy 0, policy_version 1650505 (0.0011) [2023-12-28 07:07:22,928][106226] Updated weights for policy 0, policy_version 1650515 (0.0011) [2023-12-28 07:07:23,183][106225] Updated weights for policy 1, policy_version 1654313 (0.0007) [2023-12-28 07:07:23,238][106225] Updated weights for policy 1, policy_version 1654323 (0.0008) [2023-12-28 07:07:23,291][106225] Updated weights for policy 1, policy_version 1654333 (0.0007) [2023-12-28 07:07:23,348][106225] Updated weights for policy 1, policy_version 1654343 (0.0008) [2023-12-28 07:07:23,648][106226] Updated weights for policy 0, policy_version 1650525 (0.0008) [2023-12-28 07:07:23,704][106226] Updated weights for policy 0, policy_version 1650535 (0.0006) [2023-12-28 07:07:23,757][106226] Updated weights for policy 0, policy_version 1650545 (0.0005) [2023-12-28 07:07:24,084][106225] Updated weights for policy 1, policy_version 1654353 (0.0009) [2023-12-28 07:07:24,133][106225] Updated weights for policy 1, policy_version 1654363 (0.0008) [2023-12-28 07:07:24,190][106225] Updated weights for policy 1, policy_version 1654373 (0.0008) [2023-12-28 07:07:24,305][106226] Updated weights for policy 0, policy_version 1650555 (0.0007) [2023-12-28 07:07:24,368][106226] Updated weights for policy 0, policy_version 1650565 (0.0010) [2023-12-28 07:07:24,437][106226] Updated weights for policy 0, policy_version 1650575 (0.0010) [2023-12-28 07:07:24,939][106225] Updated weights for policy 1, policy_version 1654383 (0.0008) [2023-12-28 07:07:24,990][106225] Updated weights for policy 1, policy_version 1654393 (0.0008) [2023-12-28 07:07:25,043][106225] Updated weights for policy 1, policy_version 1654403 (0.0008) [2023-12-28 07:07:25,120][106226] Updated weights for policy 0, policy_version 1650585 (0.0010) [2023-12-28 07:07:25,177][106226] Updated weights for policy 0, policy_version 1650595 (0.0009) [2023-12-28 07:07:25,247][106226] Updated weights for policy 0, policy_version 1650605 (0.0009) [2023-12-28 07:07:25,298][106226] Updated weights for policy 0, policy_version 1650615 (0.0010) [2023-12-28 07:07:25,788][106225] Updated weights for policy 1, policy_version 1654413 (0.0008) [2023-12-28 07:07:25,833][106225] Updated weights for policy 1, policy_version 1654423 (0.0007) [2023-12-28 07:07:25,880][106225] Updated weights for policy 1, policy_version 1654433 (0.0008) [2023-12-28 07:07:26,012][106226] Updated weights for policy 0, policy_version 1650625 (0.0010) [2023-12-28 07:07:26,079][106226] Updated weights for policy 0, policy_version 1650635 (0.0010) [2023-12-28 07:07:26,147][106226] Updated weights for policy 0, policy_version 1650645 (0.0009) [2023-12-28 07:07:26,175][105115] Fps is (10 sec: 21299.0, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 846233600. Throughput: 0: 9820.3, 1: 9946.4. Samples: 846199696. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:26,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-5.002')] [2023-12-28 07:07:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001654440_423591936.pth... [2023-12-28 07:07:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001650648_422641664.pth... [2023-12-28 07:07:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001653256_423288832.pth [2023-12-28 07:07:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001649496_422346752.pth [2023-12-28 07:07:26,653][106225] Updated weights for policy 1, policy_version 1654443 (0.0007) [2023-12-28 07:07:26,708][106225] Updated weights for policy 1, policy_version 1654453 (0.0009) [2023-12-28 07:07:26,757][106225] Updated weights for policy 1, policy_version 1654463 (0.0008) [2023-12-28 07:07:26,766][106226] Updated weights for policy 0, policy_version 1650655 (0.0010) [2023-12-28 07:07:26,822][106226] Updated weights for policy 0, policy_version 1650665 (0.0005) [2023-12-28 07:07:26,882][106226] Updated weights for policy 0, policy_version 1650675 (0.0006) [2023-12-28 07:07:27,524][106225] Updated weights for policy 1, policy_version 1654473 (0.0008) [2023-12-28 07:07:27,538][106226] Updated weights for policy 0, policy_version 1650685 (0.0008) [2023-12-28 07:07:27,586][106225] Updated weights for policy 1, policy_version 1654483 (0.0006) [2023-12-28 07:07:27,603][106226] Updated weights for policy 0, policy_version 1650695 (0.0007) [2023-12-28 07:07:27,640][106225] Updated weights for policy 1, policy_version 1654493 (0.0006) [2023-12-28 07:07:27,665][106226] Updated weights for policy 0, policy_version 1650705 (0.0008) [2023-12-28 07:07:27,687][106225] Updated weights for policy 1, policy_version 1654503 (0.0005) [2023-12-28 07:07:28,225][106226] Updated weights for policy 0, policy_version 1650715 (0.0008) [2023-12-28 07:07:28,279][106226] Updated weights for policy 0, policy_version 1650725 (0.0005) [2023-12-28 07:07:28,347][106226] Updated weights for policy 0, policy_version 1650735 (0.0007) [2023-12-28 07:07:28,526][106225] Updated weights for policy 1, policy_version 1654513 (0.0008) [2023-12-28 07:07:28,582][106225] Updated weights for policy 1, policy_version 1654523 (0.0009) [2023-12-28 07:07:28,639][106225] Updated weights for policy 1, policy_version 1654533 (0.0009) [2023-12-28 07:07:29,002][106226] Updated weights for policy 0, policy_version 1650745 (0.0008) [2023-12-28 07:07:29,060][106226] Updated weights for policy 0, policy_version 1650755 (0.0009) [2023-12-28 07:07:29,118][106226] Updated weights for policy 0, policy_version 1650765 (0.0006) [2023-12-28 07:07:29,172][106226] Updated weights for policy 0, policy_version 1650775 (0.0005) [2023-12-28 07:07:29,407][106225] Updated weights for policy 1, policy_version 1654543 (0.0008) [2023-12-28 07:07:29,467][106225] Updated weights for policy 1, policy_version 1654553 (0.0009) [2023-12-28 07:07:29,530][106225] Updated weights for policy 1, policy_version 1654563 (0.0008) [2023-12-28 07:07:29,803][106226] Updated weights for policy 0, policy_version 1650785 (0.0008) [2023-12-28 07:07:29,871][106226] Updated weights for policy 0, policy_version 1650795 (0.0009) [2023-12-28 07:07:29,935][106226] Updated weights for policy 0, policy_version 1650805 (0.0009) [2023-12-28 07:07:30,306][106225] Updated weights for policy 1, policy_version 1654573 (0.0008) [2023-12-28 07:07:30,365][106225] Updated weights for policy 1, policy_version 1654583 (0.0008) [2023-12-28 07:07:30,417][106225] Updated weights for policy 1, policy_version 1654593 (0.0008) [2023-12-28 07:07:30,678][106226] Updated weights for policy 0, policy_version 1650815 (0.0006) [2023-12-28 07:07:30,722][106226] Updated weights for policy 0, policy_version 1650825 (0.0005) [2023-12-28 07:07:30,780][106226] Updated weights for policy 0, policy_version 1650835 (0.0005) [2023-12-28 07:07:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 846323712. Throughput: 0: 9911.9, 1: 9881.3. Samples: 846317376. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:31,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.701')] [2023-12-28 07:07:31,217][106225] Updated weights for policy 1, policy_version 1654603 (0.0008) [2023-12-28 07:07:31,274][106225] Updated weights for policy 1, policy_version 1654613 (0.0008) [2023-12-28 07:07:31,336][106225] Updated weights for policy 1, policy_version 1654623 (0.0008) [2023-12-28 07:07:31,346][106226] Updated weights for policy 0, policy_version 1650845 (0.0006) [2023-12-28 07:07:31,411][106226] Updated weights for policy 0, policy_version 1650855 (0.0007) [2023-12-28 07:07:31,472][106226] Updated weights for policy 0, policy_version 1650865 (0.0005) [2023-12-28 07:07:32,083][106225] Updated weights for policy 1, policy_version 1654633 (0.0008) [2023-12-28 07:07:32,110][106226] Updated weights for policy 0, policy_version 1650875 (0.0005) [2023-12-28 07:07:32,139][106225] Updated weights for policy 1, policy_version 1654643 (0.0008) [2023-12-28 07:07:32,177][106226] Updated weights for policy 0, policy_version 1650885 (0.0008) [2023-12-28 07:07:32,199][106225] Updated weights for policy 1, policy_version 1654653 (0.0006) [2023-12-28 07:07:32,235][106226] Updated weights for policy 0, policy_version 1650895 (0.0008) [2023-12-28 07:07:32,263][106225] Updated weights for policy 1, policy_version 1654663 (0.0007) [2023-12-28 07:07:32,884][106226] Updated weights for policy 0, policy_version 1650905 (0.0009) [2023-12-28 07:07:32,938][106226] Updated weights for policy 0, policy_version 1650915 (0.0011) [2023-12-28 07:07:32,998][106226] Updated weights for policy 0, policy_version 1650925 (0.0010) [2023-12-28 07:07:33,045][106225] Updated weights for policy 1, policy_version 1654673 (0.0007) [2023-12-28 07:07:33,054][106226] Updated weights for policy 0, policy_version 1650935 (0.0010) [2023-12-28 07:07:33,089][106225] Updated weights for policy 1, policy_version 1654683 (0.0007) [2023-12-28 07:07:33,140][106225] Updated weights for policy 1, policy_version 1654693 (0.0009) [2023-12-28 07:07:33,695][106226] Updated weights for policy 0, policy_version 1650945 (0.0009) [2023-12-28 07:07:33,748][106226] Updated weights for policy 0, policy_version 1650955 (0.0006) [2023-12-28 07:07:33,806][106226] Updated weights for policy 0, policy_version 1650965 (0.0005) [2023-12-28 07:07:33,838][106225] Updated weights for policy 1, policy_version 1654703 (0.0008) [2023-12-28 07:07:33,891][106225] Updated weights for policy 1, policy_version 1654713 (0.0008) [2023-12-28 07:07:33,955][106225] Updated weights for policy 1, policy_version 1654723 (0.0008) [2023-12-28 07:07:34,461][106226] Updated weights for policy 0, policy_version 1650975 (0.0008) [2023-12-28 07:07:34,525][106226] Updated weights for policy 0, policy_version 1650985 (0.0009) [2023-12-28 07:07:34,590][106226] Updated weights for policy 0, policy_version 1650995 (0.0008) [2023-12-28 07:07:34,680][106225] Updated weights for policy 1, policy_version 1654733 (0.0009) [2023-12-28 07:07:34,728][106225] Updated weights for policy 1, policy_version 1654743 (0.0008) [2023-12-28 07:07:34,780][106225] Updated weights for policy 1, policy_version 1654753 (0.0008) [2023-12-28 07:07:35,231][106226] Updated weights for policy 0, policy_version 1651005 (0.0007) [2023-12-28 07:07:35,279][106226] Updated weights for policy 0, policy_version 1651015 (0.0005) [2023-12-28 07:07:35,334][106226] Updated weights for policy 0, policy_version 1651025 (0.0005) [2023-12-28 07:07:35,596][106225] Updated weights for policy 1, policy_version 1654763 (0.0009) [2023-12-28 07:07:35,646][106225] Updated weights for policy 1, policy_version 1654773 (0.0008) [2023-12-28 07:07:35,700][106225] Updated weights for policy 1, policy_version 1654783 (0.0008) [2023-12-28 07:07:35,965][106226] Updated weights for policy 0, policy_version 1651035 (0.0006) [2023-12-28 07:07:36,015][106226] Updated weights for policy 0, policy_version 1651045 (0.0008) [2023-12-28 07:07:36,070][106226] Updated weights for policy 0, policy_version 1651055 (0.0009) [2023-12-28 07:07:36,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 846430208. Throughput: 0: 9975.8, 1: 9842.6. Samples: 846436944. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:36,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.814')] [2023-12-28 07:07:36,413][106225] Updated weights for policy 1, policy_version 1654793 (0.0009) [2023-12-28 07:07:36,475][106225] Updated weights for policy 1, policy_version 1654803 (0.0009) [2023-12-28 07:07:36,534][106225] Updated weights for policy 1, policy_version 1654813 (0.0009) [2023-12-28 07:07:36,603][106225] Updated weights for policy 1, policy_version 1654823 (0.0008) [2023-12-28 07:07:36,875][106226] Updated weights for policy 0, policy_version 1651065 (0.0008) [2023-12-28 07:07:36,944][106226] Updated weights for policy 0, policy_version 1651075 (0.0009) [2023-12-28 07:07:37,017][106226] Updated weights for policy 0, policy_version 1651085 (0.0008) [2023-12-28 07:07:37,080][106226] Updated weights for policy 0, policy_version 1651095 (0.0008) [2023-12-28 07:07:37,291][106225] Updated weights for policy 1, policy_version 1654833 (0.0010) [2023-12-28 07:07:37,358][106225] Updated weights for policy 1, policy_version 1654843 (0.0011) [2023-12-28 07:07:37,420][106225] Updated weights for policy 1, policy_version 1654853 (0.0010) [2023-12-28 07:07:37,751][106226] Updated weights for policy 0, policy_version 1651105 (0.0007) [2023-12-28 07:07:37,807][106226] Updated weights for policy 0, policy_version 1651115 (0.0008) [2023-12-28 07:07:37,863][106226] Updated weights for policy 0, policy_version 1651125 (0.0008) [2023-12-28 07:07:38,129][106225] Updated weights for policy 1, policy_version 1654863 (0.0009) [2023-12-28 07:07:38,190][106225] Updated weights for policy 1, policy_version 1654873 (0.0006) [2023-12-28 07:07:38,250][106225] Updated weights for policy 1, policy_version 1654883 (0.0007) [2023-12-28 07:07:38,537][106226] Updated weights for policy 0, policy_version 1651135 (0.0006) [2023-12-28 07:07:38,593][106226] Updated weights for policy 0, policy_version 1651145 (0.0006) [2023-12-28 07:07:38,656][106226] Updated weights for policy 0, policy_version 1651155 (0.0006) [2023-12-28 07:07:38,991][106225] Updated weights for policy 1, policy_version 1654893 (0.0009) [2023-12-28 07:07:39,056][106225] Updated weights for policy 1, policy_version 1654903 (0.0009) [2023-12-28 07:07:39,116][106225] Updated weights for policy 1, policy_version 1654913 (0.0008) [2023-12-28 07:07:39,252][106226] Updated weights for policy 0, policy_version 1651165 (0.0007) [2023-12-28 07:07:39,311][106226] Updated weights for policy 0, policy_version 1651175 (0.0006) [2023-12-28 07:07:39,377][106226] Updated weights for policy 0, policy_version 1651185 (0.0008) [2023-12-28 07:07:39,881][106225] Updated weights for policy 1, policy_version 1654923 (0.0006) [2023-12-28 07:07:39,948][106225] Updated weights for policy 1, policy_version 1654933 (0.0007) [2023-12-28 07:07:40,000][106225] Updated weights for policy 1, policy_version 1654943 (0.0008) [2023-12-28 07:07:40,063][106226] Updated weights for policy 0, policy_version 1651195 (0.0009) [2023-12-28 07:07:40,126][106226] Updated weights for policy 0, policy_version 1651205 (0.0007) [2023-12-28 07:07:40,193][106226] Updated weights for policy 0, policy_version 1651215 (0.0006) [2023-12-28 07:07:40,726][106225] Updated weights for policy 1, policy_version 1654953 (0.0008) [2023-12-28 07:07:40,789][106225] Updated weights for policy 1, policy_version 1654963 (0.0006) [2023-12-28 07:07:40,839][106226] Updated weights for policy 0, policy_version 1651225 (0.0010) [2023-12-28 07:07:40,841][106225] Updated weights for policy 1, policy_version 1654973 (0.0007) [2023-12-28 07:07:40,894][106226] Updated weights for policy 0, policy_version 1651235 (0.0006) [2023-12-28 07:07:40,906][106225] Updated weights for policy 1, policy_version 1654983 (0.0010) [2023-12-28 07:07:40,947][106226] Updated weights for policy 0, policy_version 1651245 (0.0008) [2023-12-28 07:07:41,010][106226] Updated weights for policy 0, policy_version 1651255 (0.0008) [2023-12-28 07:07:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 846528512. Throughput: 0: 10039.9, 1: 9806.8. Samples: 846496624. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:41,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.847')] [2023-12-28 07:07:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001651256_422797312.pth... [2023-12-28 07:07:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001654984_423731200.pth... [2023-12-28 07:07:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001650072_422494208.pth [2023-12-28 07:07:41,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001653864_423444480.pth [2023-12-28 07:07:41,683][106225] Updated weights for policy 1, policy_version 1654993 (0.0011) [2023-12-28 07:07:41,752][106225] Updated weights for policy 1, policy_version 1655003 (0.0009) [2023-12-28 07:07:41,818][106225] Updated weights for policy 1, policy_version 1655013 (0.0011) [2023-12-28 07:07:41,865][106226] Updated weights for policy 0, policy_version 1651265 (0.0008) [2023-12-28 07:07:41,929][106226] Updated weights for policy 0, policy_version 1651275 (0.0008) [2023-12-28 07:07:41,991][106226] Updated weights for policy 0, policy_version 1651285 (0.0008) [2023-12-28 07:07:42,520][106225] Updated weights for policy 1, policy_version 1655023 (0.0011) [2023-12-28 07:07:42,571][106225] Updated weights for policy 1, policy_version 1655033 (0.0010) [2023-12-28 07:07:42,627][106225] Updated weights for policy 1, policy_version 1655043 (0.0010) [2023-12-28 07:07:42,747][106226] Updated weights for policy 0, policy_version 1651295 (0.0008) [2023-12-28 07:07:42,805][106226] Updated weights for policy 0, policy_version 1651305 (0.0008) [2023-12-28 07:07:42,866][106226] Updated weights for policy 0, policy_version 1651315 (0.0007) [2023-12-28 07:07:43,307][106225] Updated weights for policy 1, policy_version 1655053 (0.0005) [2023-12-28 07:07:43,367][106225] Updated weights for policy 1, policy_version 1655063 (0.0009) [2023-12-28 07:07:43,423][106225] Updated weights for policy 1, policy_version 1655073 (0.0005) [2023-12-28 07:07:43,667][106226] Updated weights for policy 0, policy_version 1651325 (0.0008) [2023-12-28 07:07:43,712][106226] Updated weights for policy 0, policy_version 1651335 (0.0008) [2023-12-28 07:07:43,758][106226] Updated weights for policy 0, policy_version 1651345 (0.0005) [2023-12-28 07:07:44,033][106225] Updated weights for policy 1, policy_version 1655083 (0.0006) [2023-12-28 07:07:44,100][106225] Updated weights for policy 1, policy_version 1655093 (0.0005) [2023-12-28 07:07:44,151][106225] Updated weights for policy 1, policy_version 1655103 (0.0007) [2023-12-28 07:07:44,488][106226] Updated weights for policy 0, policy_version 1651355 (0.0007) [2023-12-28 07:07:44,534][106226] Updated weights for policy 0, policy_version 1651365 (0.0009) [2023-12-28 07:07:44,584][106226] Updated weights for policy 0, policy_version 1651375 (0.0008) [2023-12-28 07:07:44,780][106225] Updated weights for policy 1, policy_version 1655113 (0.0008) [2023-12-28 07:07:44,845][106225] Updated weights for policy 1, policy_version 1655123 (0.0008) [2023-12-28 07:07:44,911][106225] Updated weights for policy 1, policy_version 1655133 (0.0008) [2023-12-28 07:07:44,975][106225] Updated weights for policy 1, policy_version 1655143 (0.0008) [2023-12-28 07:07:45,382][106226] Updated weights for policy 0, policy_version 1651385 (0.0008) [2023-12-28 07:07:45,439][106226] Updated weights for policy 0, policy_version 1651395 (0.0007) [2023-12-28 07:07:45,498][106226] Updated weights for policy 0, policy_version 1651405 (0.0008) [2023-12-28 07:07:45,556][106226] Updated weights for policy 0, policy_version 1651415 (0.0008) [2023-12-28 07:07:45,606][106225] Updated weights for policy 1, policy_version 1655153 (0.0006) [2023-12-28 07:07:45,669][106225] Updated weights for policy 1, policy_version 1655163 (0.0009) [2023-12-28 07:07:45,730][106225] Updated weights for policy 1, policy_version 1655173 (0.0005) [2023-12-28 07:07:46,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 846618624. Throughput: 0: 9989.8, 1: 9816.7. Samples: 846610908. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:46,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-4.497')] [2023-12-28 07:07:46,272][106226] Updated weights for policy 0, policy_version 1651425 (0.0007) [2023-12-28 07:07:46,330][106226] Updated weights for policy 0, policy_version 1651435 (0.0008) [2023-12-28 07:07:46,355][106225] Updated weights for policy 1, policy_version 1655183 (0.0009) [2023-12-28 07:07:46,378][106226] Updated weights for policy 0, policy_version 1651445 (0.0005) [2023-12-28 07:07:46,407][106225] Updated weights for policy 1, policy_version 1655193 (0.0010) [2023-12-28 07:07:46,471][106225] Updated weights for policy 1, policy_version 1655203 (0.0011) [2023-12-28 07:07:46,930][106226] Updated weights for policy 0, policy_version 1651455 (0.0005) [2023-12-28 07:07:46,976][106226] Updated weights for policy 0, policy_version 1651465 (0.0005) [2023-12-28 07:07:47,030][106226] Updated weights for policy 0, policy_version 1651475 (0.0005) [2023-12-28 07:07:47,201][106225] Updated weights for policy 1, policy_version 1655213 (0.0010) [2023-12-28 07:07:47,259][106225] Updated weights for policy 1, policy_version 1655223 (0.0009) [2023-12-28 07:07:47,323][106225] Updated weights for policy 1, policy_version 1655233 (0.0008) [2023-12-28 07:07:47,663][106226] Updated weights for policy 0, policy_version 1651485 (0.0008) [2023-12-28 07:07:47,716][106226] Updated weights for policy 0, policy_version 1651495 (0.0010) [2023-12-28 07:07:47,767][106226] Updated weights for policy 0, policy_version 1651505 (0.0011) [2023-12-28 07:07:48,016][106225] Updated weights for policy 1, policy_version 1655243 (0.0008) [2023-12-28 07:07:48,066][106225] Updated weights for policy 1, policy_version 1655253 (0.0010) [2023-12-28 07:07:48,113][106225] Updated weights for policy 1, policy_version 1655263 (0.0010) [2023-12-28 07:07:48,452][106226] Updated weights for policy 0, policy_version 1651515 (0.0011) [2023-12-28 07:07:48,520][106226] Updated weights for policy 0, policy_version 1651525 (0.0009) [2023-12-28 07:07:48,573][106226] Updated weights for policy 0, policy_version 1651535 (0.0008) [2023-12-28 07:07:48,762][106225] Updated weights for policy 1, policy_version 1655273 (0.0010) [2023-12-28 07:07:48,829][106225] Updated weights for policy 1, policy_version 1655283 (0.0010) [2023-12-28 07:07:48,887][106225] Updated weights for policy 1, policy_version 1655293 (0.0010) [2023-12-28 07:07:48,948][106225] Updated weights for policy 1, policy_version 1655303 (0.0011) [2023-12-28 07:07:49,347][106226] Updated weights for policy 0, policy_version 1651545 (0.0009) [2023-12-28 07:07:49,420][106226] Updated weights for policy 0, policy_version 1651555 (0.0007) [2023-12-28 07:07:49,482][106226] Updated weights for policy 0, policy_version 1651565 (0.0006) [2023-12-28 07:07:49,546][106226] Updated weights for policy 0, policy_version 1651575 (0.0006) [2023-12-28 07:07:49,667][106225] Updated weights for policy 1, policy_version 1655313 (0.0009) [2023-12-28 07:07:49,731][106225] Updated weights for policy 1, policy_version 1655323 (0.0010) [2023-12-28 07:07:49,802][106225] Updated weights for policy 1, policy_version 1655333 (0.0011) [2023-12-28 07:07:50,243][106226] Updated weights for policy 0, policy_version 1651585 (0.0006) [2023-12-28 07:07:50,303][106226] Updated weights for policy 0, policy_version 1651595 (0.0005) [2023-12-28 07:07:50,367][106226] Updated weights for policy 0, policy_version 1651605 (0.0011) [2023-12-28 07:07:50,501][106225] Updated weights for policy 1, policy_version 1655343 (0.0010) [2023-12-28 07:07:50,555][106225] Updated weights for policy 1, policy_version 1655353 (0.0005) [2023-12-28 07:07:50,624][106225] Updated weights for policy 1, policy_version 1655363 (0.0009) [2023-12-28 07:07:51,048][106226] Updated weights for policy 0, policy_version 1651615 (0.0011) [2023-12-28 07:07:51,117][106226] Updated weights for policy 0, policy_version 1651625 (0.0010) [2023-12-28 07:07:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 846716928. Throughput: 0: 9989.1, 1: 9791.9. Samples: 846731748. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:51,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.617')] [2023-12-28 07:07:51,188][106226] Updated weights for policy 0, policy_version 1651635 (0.0011) [2023-12-28 07:07:51,330][106225] Updated weights for policy 1, policy_version 1655373 (0.0007) [2023-12-28 07:07:51,400][106225] Updated weights for policy 1, policy_version 1655383 (0.0008) [2023-12-28 07:07:51,466][106225] Updated weights for policy 1, policy_version 1655393 (0.0008) [2023-12-28 07:07:51,953][106226] Updated weights for policy 0, policy_version 1651645 (0.0007) [2023-12-28 07:07:52,025][106226] Updated weights for policy 0, policy_version 1651655 (0.0007) [2023-12-28 07:07:52,094][106226] Updated weights for policy 0, policy_version 1651665 (0.0007) [2023-12-28 07:07:52,109][106225] Updated weights for policy 1, policy_version 1655403 (0.0008) [2023-12-28 07:07:52,168][106225] Updated weights for policy 1, policy_version 1655413 (0.0007) [2023-12-28 07:07:52,226][106225] Updated weights for policy 1, policy_version 1655423 (0.0007) [2023-12-28 07:07:52,762][106226] Updated weights for policy 0, policy_version 1651675 (0.0009) [2023-12-28 07:07:52,824][106226] Updated weights for policy 0, policy_version 1651685 (0.0005) [2023-12-28 07:07:52,884][106226] Updated weights for policy 0, policy_version 1651695 (0.0006) [2023-12-28 07:07:52,929][106225] Updated weights for policy 1, policy_version 1655433 (0.0007) [2023-12-28 07:07:52,987][106225] Updated weights for policy 1, policy_version 1655443 (0.0008) [2023-12-28 07:07:53,050][106225] Updated weights for policy 1, policy_version 1655453 (0.0009) [2023-12-28 07:07:53,102][106225] Updated weights for policy 1, policy_version 1655463 (0.0009) [2023-12-28 07:07:53,557][106226] Updated weights for policy 0, policy_version 1651705 (0.0009) [2023-12-28 07:07:53,624][106226] Updated weights for policy 0, policy_version 1651715 (0.0006) [2023-12-28 07:07:53,683][106226] Updated weights for policy 0, policy_version 1651725 (0.0010) [2023-12-28 07:07:53,743][106226] Updated weights for policy 0, policy_version 1651735 (0.0010) [2023-12-28 07:07:53,792][106225] Updated weights for policy 1, policy_version 1655473 (0.0007) [2023-12-28 07:07:53,848][106225] Updated weights for policy 1, policy_version 1655483 (0.0007) [2023-12-28 07:07:53,902][106225] Updated weights for policy 1, policy_version 1655493 (0.0007) [2023-12-28 07:07:54,426][106226] Updated weights for policy 0, policy_version 1651745 (0.0010) [2023-12-28 07:07:54,474][106226] Updated weights for policy 0, policy_version 1651755 (0.0010) [2023-12-28 07:07:54,533][106226] Updated weights for policy 0, policy_version 1651765 (0.0010) [2023-12-28 07:07:54,641][106225] Updated weights for policy 1, policy_version 1655503 (0.0008) [2023-12-28 07:07:54,704][106225] Updated weights for policy 1, policy_version 1655513 (0.0009) [2023-12-28 07:07:54,757][106225] Updated weights for policy 1, policy_version 1655523 (0.0010) [2023-12-28 07:07:55,117][106226] Updated weights for policy 0, policy_version 1651775 (0.0007) [2023-12-28 07:07:55,172][106226] Updated weights for policy 0, policy_version 1651785 (0.0006) [2023-12-28 07:07:55,219][106226] Updated weights for policy 0, policy_version 1651795 (0.0009) [2023-12-28 07:07:55,543][106225] Updated weights for policy 1, policy_version 1655533 (0.0008) [2023-12-28 07:07:55,598][106225] Updated weights for policy 1, policy_version 1655543 (0.0006) [2023-12-28 07:07:55,647][106225] Updated weights for policy 1, policy_version 1655553 (0.0005) [2023-12-28 07:07:55,933][106226] Updated weights for policy 0, policy_version 1651805 (0.0008) [2023-12-28 07:07:55,989][106226] Updated weights for policy 0, policy_version 1651815 (0.0006) [2023-12-28 07:07:56,051][106226] Updated weights for policy 0, policy_version 1651825 (0.0011) [2023-12-28 07:07:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 846823424. Throughput: 0: 9974.1, 1: 9783.4. Samples: 846791148. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:07:56,175][105115] Avg episode reward: [(0, '-4.180'), (1, '-4.967')] [2023-12-28 07:07:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001655560_423878656.pth... [2023-12-28 07:07:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001651832_422944768.pth... [2023-12-28 07:07:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001650648_422641664.pth [2023-12-28 07:07:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001654440_423591936.pth [2023-12-28 07:07:56,278][106225] Updated weights for policy 1, policy_version 1655563 (0.0008) [2023-12-28 07:07:56,343][106225] Updated weights for policy 1, policy_version 1655573 (0.0008) [2023-12-28 07:07:56,402][106225] Updated weights for policy 1, policy_version 1655583 (0.0008) [2023-12-28 07:07:56,774][106226] Updated weights for policy 0, policy_version 1651835 (0.0011) [2023-12-28 07:07:56,832][106226] Updated weights for policy 0, policy_version 1651845 (0.0011) [2023-12-28 07:07:56,886][106226] Updated weights for policy 0, policy_version 1651855 (0.0010) [2023-12-28 07:07:57,159][106225] Updated weights for policy 1, policy_version 1655593 (0.0008) [2023-12-28 07:07:57,210][106225] Updated weights for policy 1, policy_version 1655603 (0.0006) [2023-12-28 07:07:57,265][106225] Updated weights for policy 1, policy_version 1655613 (0.0008) [2023-12-28 07:07:57,322][106225] Updated weights for policy 1, policy_version 1655623 (0.0009) [2023-12-28 07:07:57,494][106226] Updated weights for policy 0, policy_version 1651865 (0.0010) [2023-12-28 07:07:57,555][106226] Updated weights for policy 0, policy_version 1651875 (0.0011) [2023-12-28 07:07:57,604][106226] Updated weights for policy 0, policy_version 1651885 (0.0010) [2023-12-28 07:07:57,653][106226] Updated weights for policy 0, policy_version 1651895 (0.0010) [2023-12-28 07:07:57,960][106225] Updated weights for policy 1, policy_version 1655633 (0.0006) [2023-12-28 07:07:58,018][106225] Updated weights for policy 1, policy_version 1655643 (0.0005) [2023-12-28 07:07:58,076][106225] Updated weights for policy 1, policy_version 1655653 (0.0007) [2023-12-28 07:07:58,346][106226] Updated weights for policy 0, policy_version 1651905 (0.0010) [2023-12-28 07:07:58,411][106226] Updated weights for policy 0, policy_version 1651915 (0.0011) [2023-12-28 07:07:58,479][106226] Updated weights for policy 0, policy_version 1651925 (0.0012) [2023-12-28 07:07:58,763][106225] Updated weights for policy 1, policy_version 1655663 (0.0008) [2023-12-28 07:07:58,831][106225] Updated weights for policy 1, policy_version 1655673 (0.0008) [2023-12-28 07:07:58,897][106225] Updated weights for policy 1, policy_version 1655683 (0.0015) [2023-12-28 07:07:59,336][106226] Updated weights for policy 0, policy_version 1651935 (0.0009) [2023-12-28 07:07:59,401][106226] Updated weights for policy 0, policy_version 1651945 (0.0009) [2023-12-28 07:07:59,464][106226] Updated weights for policy 0, policy_version 1651955 (0.0009) [2023-12-28 07:07:59,689][106225] Updated weights for policy 1, policy_version 1655693 (0.0007) [2023-12-28 07:07:59,750][106225] Updated weights for policy 1, policy_version 1655703 (0.0007) [2023-12-28 07:07:59,810][106225] Updated weights for policy 1, policy_version 1655713 (0.0007) [2023-12-28 07:08:00,195][106226] Updated weights for policy 0, policy_version 1651965 (0.0006) [2023-12-28 07:08:00,255][106226] Updated weights for policy 0, policy_version 1651975 (0.0008) [2023-12-28 07:08:00,316][106226] Updated weights for policy 0, policy_version 1651985 (0.0008) [2023-12-28 07:08:00,531][106225] Updated weights for policy 1, policy_version 1655723 (0.0008) [2023-12-28 07:08:00,587][106225] Updated weights for policy 1, policy_version 1655733 (0.0008) [2023-12-28 07:08:00,647][106225] Updated weights for policy 1, policy_version 1655743 (0.0006) [2023-12-28 07:08:01,023][106226] Updated weights for policy 0, policy_version 1651995 (0.0009) [2023-12-28 07:08:01,089][106226] Updated weights for policy 0, policy_version 1652005 (0.0009) [2023-12-28 07:08:01,169][106226] Updated weights for policy 0, policy_version 1652015 (0.0008) [2023-12-28 07:08:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 846913536. Throughput: 0: 10029.4, 1: 9793.9. Samples: 846908256. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:08:01,175][105115] Avg episode reward: [(0, '-4.134'), (1, '-4.941')] [2023-12-28 07:08:01,370][106225] Updated weights for policy 1, policy_version 1655753 (0.0006) [2023-12-28 07:08:01,423][106225] Updated weights for policy 1, policy_version 1655763 (0.0009) [2023-12-28 07:08:01,475][106225] Updated weights for policy 1, policy_version 1655773 (0.0009) [2023-12-28 07:08:01,535][106225] Updated weights for policy 1, policy_version 1655783 (0.0008) [2023-12-28 07:08:01,867][106226] Updated weights for policy 0, policy_version 1652025 (0.0008) [2023-12-28 07:08:01,932][106226] Updated weights for policy 0, policy_version 1652035 (0.0006) [2023-12-28 07:08:01,992][106226] Updated weights for policy 0, policy_version 1652045 (0.0008) [2023-12-28 07:08:02,059][106226] Updated weights for policy 0, policy_version 1652055 (0.0009) [2023-12-28 07:08:02,311][106225] Updated weights for policy 1, policy_version 1655793 (0.0009) [2023-12-28 07:08:02,375][106225] Updated weights for policy 1, policy_version 1655803 (0.0009) [2023-12-28 07:08:02,435][106225] Updated weights for policy 1, policy_version 1655813 (0.0009) [2023-12-28 07:08:02,775][106226] Updated weights for policy 0, policy_version 1652065 (0.0006) [2023-12-28 07:08:02,830][106226] Updated weights for policy 0, policy_version 1652075 (0.0005) [2023-12-28 07:08:02,887][106226] Updated weights for policy 0, policy_version 1652085 (0.0006) [2023-12-28 07:08:03,155][106225] Updated weights for policy 1, policy_version 1655823 (0.0008) [2023-12-28 07:08:03,212][106225] Updated weights for policy 1, policy_version 1655833 (0.0008) [2023-12-28 07:08:03,268][106225] Updated weights for policy 1, policy_version 1655843 (0.0009) [2023-12-28 07:08:03,526][106226] Updated weights for policy 0, policy_version 1652095 (0.0006) [2023-12-28 07:08:03,584][106226] Updated weights for policy 0, policy_version 1652105 (0.0005) [2023-12-28 07:08:03,639][106226] Updated weights for policy 0, policy_version 1652115 (0.0006) [2023-12-28 07:08:04,073][106225] Updated weights for policy 1, policy_version 1655853 (0.0009) [2023-12-28 07:08:04,137][106225] Updated weights for policy 1, policy_version 1655863 (0.0011) [2023-12-28 07:08:04,202][106225] Updated weights for policy 1, policy_version 1655873 (0.0011) [2023-12-28 07:08:04,237][106226] Updated weights for policy 0, policy_version 1652125 (0.0007) [2023-12-28 07:08:04,285][106226] Updated weights for policy 0, policy_version 1652135 (0.0008) [2023-12-28 07:08:04,336][106226] Updated weights for policy 0, policy_version 1652145 (0.0008) [2023-12-28 07:08:04,893][106225] Updated weights for policy 1, policy_version 1655883 (0.0010) [2023-12-28 07:08:04,943][106225] Updated weights for policy 1, policy_version 1655893 (0.0010) [2023-12-28 07:08:04,994][106225] Updated weights for policy 1, policy_version 1655903 (0.0010) [2023-12-28 07:08:05,104][106226] Updated weights for policy 0, policy_version 1652155 (0.0008) [2023-12-28 07:08:05,162][106226] Updated weights for policy 0, policy_version 1652165 (0.0008) [2023-12-28 07:08:05,215][106226] Updated weights for policy 0, policy_version 1652175 (0.0009) [2023-12-28 07:08:05,697][106225] Updated weights for policy 1, policy_version 1655913 (0.0011) [2023-12-28 07:08:05,757][106225] Updated weights for policy 1, policy_version 1655923 (0.0010) [2023-12-28 07:08:05,810][106225] Updated weights for policy 1, policy_version 1655933 (0.0010) [2023-12-28 07:08:05,859][106225] Updated weights for policy 1, policy_version 1655943 (0.0010) [2023-12-28 07:08:05,957][106226] Updated weights for policy 0, policy_version 1652185 (0.0009) [2023-12-28 07:08:06,019][106226] Updated weights for policy 0, policy_version 1652195 (0.0006) [2023-12-28 07:08:06,078][106226] Updated weights for policy 0, policy_version 1652205 (0.0006) [2023-12-28 07:08:06,167][106226] Updated weights for policy 0, policy_version 1652215 (0.0009) [2023-12-28 07:08:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 847020032. Throughput: 0: 10005.0, 1: 9636.1. Samples: 847024744. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:08:06,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.843')] [2023-12-28 07:08:06,649][106225] Updated weights for policy 1, policy_version 1655953 (0.0008) [2023-12-28 07:08:06,708][106225] Updated weights for policy 1, policy_version 1655963 (0.0009) [2023-12-28 07:08:06,741][106226] Updated weights for policy 0, policy_version 1652225 (0.0011) [2023-12-28 07:08:06,759][106225] Updated weights for policy 1, policy_version 1655973 (0.0006) [2023-12-28 07:08:06,798][106226] Updated weights for policy 0, policy_version 1652235 (0.0011) [2023-12-28 07:08:06,851][106226] Updated weights for policy 0, policy_version 1652245 (0.0010) [2023-12-28 07:08:07,541][106225] Updated weights for policy 1, policy_version 1655983 (0.0008) [2023-12-28 07:08:07,552][106226] Updated weights for policy 0, policy_version 1652255 (0.0008) [2023-12-28 07:08:07,596][106225] Updated weights for policy 1, policy_version 1655993 (0.0007) [2023-12-28 07:08:07,617][106226] Updated weights for policy 0, policy_version 1652265 (0.0011) [2023-12-28 07:08:07,658][106225] Updated weights for policy 1, policy_version 1656003 (0.0007) [2023-12-28 07:08:07,675][106226] Updated weights for policy 0, policy_version 1652275 (0.0010) [2023-12-28 07:08:08,252][106225] Updated weights for policy 1, policy_version 1656013 (0.0007) [2023-12-28 07:08:08,306][106225] Updated weights for policy 1, policy_version 1656023 (0.0005) [2023-12-28 07:08:08,378][106225] Updated weights for policy 1, policy_version 1656033 (0.0008) [2023-12-28 07:08:08,390][106226] Updated weights for policy 0, policy_version 1652285 (0.0010) [2023-12-28 07:08:08,445][106226] Updated weights for policy 0, policy_version 1652295 (0.0011) [2023-12-28 07:08:08,495][106226] Updated weights for policy 0, policy_version 1652305 (0.0010) [2023-12-28 07:08:09,055][106225] Updated weights for policy 1, policy_version 1656043 (0.0007) [2023-12-28 07:08:09,105][106225] Updated weights for policy 1, policy_version 1656053 (0.0005) [2023-12-28 07:08:09,170][106225] Updated weights for policy 1, policy_version 1656063 (0.0006) [2023-12-28 07:08:09,183][106226] Updated weights for policy 0, policy_version 1652315 (0.0007) [2023-12-28 07:08:09,252][106226] Updated weights for policy 0, policy_version 1652325 (0.0011) [2023-12-28 07:08:09,318][106226] Updated weights for policy 0, policy_version 1652335 (0.0007) [2023-12-28 07:08:09,982][106225] Updated weights for policy 1, policy_version 1656073 (0.0008) [2023-12-28 07:08:10,038][106225] Updated weights for policy 1, policy_version 1656083 (0.0009) [2023-12-28 07:08:10,062][106226] Updated weights for policy 0, policy_version 1652345 (0.0007) [2023-12-28 07:08:10,096][106225] Updated weights for policy 1, policy_version 1656093 (0.0007) [2023-12-28 07:08:10,122][106226] Updated weights for policy 0, policy_version 1652355 (0.0007) [2023-12-28 07:08:10,151][106225] Updated weights for policy 1, policy_version 1656103 (0.0007) [2023-12-28 07:08:10,179][106226] Updated weights for policy 0, policy_version 1652365 (0.0007) [2023-12-28 07:08:10,238][106226] Updated weights for policy 0, policy_version 1652375 (0.0007) [2023-12-28 07:08:10,841][106225] Updated weights for policy 1, policy_version 1656113 (0.0008) [2023-12-28 07:08:10,899][106225] Updated weights for policy 1, policy_version 1656123 (0.0008) [2023-12-28 07:08:10,900][106226] Updated weights for policy 0, policy_version 1652385 (0.0008) [2023-12-28 07:08:10,958][106226] Updated weights for policy 0, policy_version 1652395 (0.0006) [2023-12-28 07:08:10,959][106225] Updated weights for policy 1, policy_version 1656133 (0.0010) [2023-12-28 07:08:11,019][106226] Updated weights for policy 0, policy_version 1652405 (0.0009) [2023-12-28 07:08:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 847118336. Throughput: 0: 10026.8, 1: 9630.8. Samples: 847084288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:11,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.604')] [2023-12-28 07:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001652408_423092224.pth... [2023-12-28 07:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001656136_424026112.pth... [2023-12-28 07:08:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001651256_422797312.pth [2023-12-28 07:08:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001654984_423731200.pth [2023-12-28 07:08:11,754][106225] Updated weights for policy 1, policy_version 1656143 (0.0008) [2023-12-28 07:08:11,809][106226] Updated weights for policy 0, policy_version 1652415 (0.0008) [2023-12-28 07:08:11,826][106225] Updated weights for policy 1, policy_version 1656153 (0.0007) [2023-12-28 07:08:11,874][106226] Updated weights for policy 0, policy_version 1652425 (0.0008) [2023-12-28 07:08:11,885][106225] Updated weights for policy 1, policy_version 1656163 (0.0008) [2023-12-28 07:08:11,936][106226] Updated weights for policy 0, policy_version 1652435 (0.0008) [2023-12-28 07:08:12,596][106225] Updated weights for policy 1, policy_version 1656173 (0.0007) [2023-12-28 07:08:12,662][106225] Updated weights for policy 1, policy_version 1656183 (0.0008) [2023-12-28 07:08:12,720][106225] Updated weights for policy 1, policy_version 1656193 (0.0011) [2023-12-28 07:08:12,753][106226] Updated weights for policy 0, policy_version 1652445 (0.0009) [2023-12-28 07:08:12,813][106226] Updated weights for policy 0, policy_version 1652455 (0.0007) [2023-12-28 07:08:12,874][106226] Updated weights for policy 0, policy_version 1652465 (0.0008) [2023-12-28 07:08:13,394][106225] Updated weights for policy 1, policy_version 1656203 (0.0009) [2023-12-28 07:08:13,445][106225] Updated weights for policy 1, policy_version 1656213 (0.0005) [2023-12-28 07:08:13,498][106225] Updated weights for policy 1, policy_version 1656223 (0.0005) [2023-12-28 07:08:13,523][106226] Updated weights for policy 0, policy_version 1652475 (0.0007) [2023-12-28 07:08:13,577][106226] Updated weights for policy 0, policy_version 1652485 (0.0005) [2023-12-28 07:08:13,639][106226] Updated weights for policy 0, policy_version 1652495 (0.0005) [2023-12-28 07:08:14,155][106225] Updated weights for policy 1, policy_version 1656233 (0.0006) [2023-12-28 07:08:14,213][106225] Updated weights for policy 1, policy_version 1656243 (0.0010) [2023-12-28 07:08:14,269][106225] Updated weights for policy 1, policy_version 1656253 (0.0010) [2023-12-28 07:08:14,312][106226] Updated weights for policy 0, policy_version 1652505 (0.0008) [2023-12-28 07:08:14,325][106225] Updated weights for policy 1, policy_version 1656263 (0.0010) [2023-12-28 07:08:14,363][106226] Updated weights for policy 0, policy_version 1652515 (0.0006) [2023-12-28 07:08:14,423][106226] Updated weights for policy 0, policy_version 1652525 (0.0009) [2023-12-28 07:08:14,476][106226] Updated weights for policy 0, policy_version 1652535 (0.0007) [2023-12-28 07:08:14,967][106225] Updated weights for policy 1, policy_version 1656273 (0.0009) [2023-12-28 07:08:15,026][106225] Updated weights for policy 1, policy_version 1656283 (0.0009) [2023-12-28 07:08:15,097][106225] Updated weights for policy 1, policy_version 1656293 (0.0009) [2023-12-28 07:08:15,218][106226] Updated weights for policy 0, policy_version 1652545 (0.0008) [2023-12-28 07:08:15,277][106226] Updated weights for policy 0, policy_version 1652555 (0.0008) [2023-12-28 07:08:15,334][106226] Updated weights for policy 0, policy_version 1652565 (0.0009) [2023-12-28 07:08:15,797][106225] Updated weights for policy 1, policy_version 1656303 (0.0007) [2023-12-28 07:08:15,854][106225] Updated weights for policy 1, policy_version 1656313 (0.0008) [2023-12-28 07:08:15,912][106225] Updated weights for policy 1, policy_version 1656323 (0.0008) [2023-12-28 07:08:16,077][106226] Updated weights for policy 0, policy_version 1652575 (0.0009) [2023-12-28 07:08:16,133][106226] Updated weights for policy 0, policy_version 1652585 (0.0008) [2023-12-28 07:08:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 847208448. Throughput: 0: 9915.7, 1: 9702.1. Samples: 847200180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:16,176][105115] Avg episode reward: [(0, '-4.220'), (1, '-4.826')] [2023-12-28 07:08:16,185][106226] Updated weights for policy 0, policy_version 1652595 (0.0008) [2023-12-28 07:08:16,594][106225] Updated weights for policy 1, policy_version 1656333 (0.0008) [2023-12-28 07:08:16,660][106225] Updated weights for policy 1, policy_version 1656343 (0.0009) [2023-12-28 07:08:16,710][106225] Updated weights for policy 1, policy_version 1656353 (0.0008) [2023-12-28 07:08:16,906][106226] Updated weights for policy 0, policy_version 1652605 (0.0008) [2023-12-28 07:08:16,966][106226] Updated weights for policy 0, policy_version 1652615 (0.0009) [2023-12-28 07:08:17,021][106226] Updated weights for policy 0, policy_version 1652625 (0.0009) [2023-12-28 07:08:17,345][106225] Updated weights for policy 1, policy_version 1656363 (0.0008) [2023-12-28 07:08:17,410][106225] Updated weights for policy 1, policy_version 1656373 (0.0009) [2023-12-28 07:08:17,463][106225] Updated weights for policy 1, policy_version 1656383 (0.0006) [2023-12-28 07:08:17,762][106226] Updated weights for policy 0, policy_version 1652635 (0.0008) [2023-12-28 07:08:17,815][106226] Updated weights for policy 0, policy_version 1652645 (0.0008) [2023-12-28 07:08:17,871][106226] Updated weights for policy 0, policy_version 1652655 (0.0007) [2023-12-28 07:08:18,162][106225] Updated weights for policy 1, policy_version 1656393 (0.0006) [2023-12-28 07:08:18,222][106225] Updated weights for policy 1, policy_version 1656403 (0.0010) [2023-12-28 07:08:18,268][106225] Updated weights for policy 1, policy_version 1656413 (0.0010) [2023-12-28 07:08:18,325][106225] Updated weights for policy 1, policy_version 1656423 (0.0010) [2023-12-28 07:08:18,625][106226] Updated weights for policy 0, policy_version 1652665 (0.0008) [2023-12-28 07:08:18,688][106226] Updated weights for policy 0, policy_version 1652675 (0.0008) [2023-12-28 07:08:18,747][106226] Updated weights for policy 0, policy_version 1652685 (0.0009) [2023-12-28 07:08:18,813][106226] Updated weights for policy 0, policy_version 1652695 (0.0008) [2023-12-28 07:08:19,007][106225] Updated weights for policy 1, policy_version 1656433 (0.0009) [2023-12-28 07:08:19,060][106225] Updated weights for policy 1, policy_version 1656443 (0.0008) [2023-12-28 07:08:19,120][106225] Updated weights for policy 1, policy_version 1656453 (0.0009) [2023-12-28 07:08:19,574][106226] Updated weights for policy 0, policy_version 1652705 (0.0006) [2023-12-28 07:08:19,647][106226] Updated weights for policy 0, policy_version 1652715 (0.0008) [2023-12-28 07:08:19,707][106226] Updated weights for policy 0, policy_version 1652725 (0.0009) [2023-12-28 07:08:19,858][106225] Updated weights for policy 1, policy_version 1656463 (0.0009) [2023-12-28 07:08:19,914][106225] Updated weights for policy 1, policy_version 1656473 (0.0009) [2023-12-28 07:08:19,984][106225] Updated weights for policy 1, policy_version 1656483 (0.0007) [2023-12-28 07:08:20,398][106226] Updated weights for policy 0, policy_version 1652735 (0.0007) [2023-12-28 07:08:20,451][106226] Updated weights for policy 0, policy_version 1652745 (0.0007) [2023-12-28 07:08:20,502][106226] Updated weights for policy 0, policy_version 1652755 (0.0009) [2023-12-28 07:08:20,709][106225] Updated weights for policy 1, policy_version 1656493 (0.0007) [2023-12-28 07:08:20,770][106225] Updated weights for policy 1, policy_version 1656503 (0.0009) [2023-12-28 07:08:20,831][106225] Updated weights for policy 1, policy_version 1656513 (0.0009) [2023-12-28 07:08:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 847306752. Throughput: 0: 9760.1, 1: 9783.9. Samples: 847316428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:21,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.822')] [2023-12-28 07:08:21,275][106226] Updated weights for policy 0, policy_version 1652765 (0.0009) [2023-12-28 07:08:21,334][106226] Updated weights for policy 0, policy_version 1652775 (0.0008) [2023-12-28 07:08:21,398][106226] Updated weights for policy 0, policy_version 1652785 (0.0008) [2023-12-28 07:08:21,631][106225] Updated weights for policy 1, policy_version 1656523 (0.0008) [2023-12-28 07:08:21,693][106225] Updated weights for policy 1, policy_version 1656533 (0.0006) [2023-12-28 07:08:21,761][106225] Updated weights for policy 1, policy_version 1656543 (0.0007) [2023-12-28 07:08:22,148][106226] Updated weights for policy 0, policy_version 1652795 (0.0008) [2023-12-28 07:08:22,199][106226] Updated weights for policy 0, policy_version 1652805 (0.0008) [2023-12-28 07:08:22,253][106226] Updated weights for policy 0, policy_version 1652815 (0.0009) [2023-12-28 07:08:22,433][106225] Updated weights for policy 1, policy_version 1656553 (0.0008) [2023-12-28 07:08:22,496][106225] Updated weights for policy 1, policy_version 1656563 (0.0008) [2023-12-28 07:08:22,551][106225] Updated weights for policy 1, policy_version 1656573 (0.0008) [2023-12-28 07:08:22,603][106225] Updated weights for policy 1, policy_version 1656583 (0.0008) [2023-12-28 07:08:22,922][106226] Updated weights for policy 0, policy_version 1652825 (0.0006) [2023-12-28 07:08:22,980][106226] Updated weights for policy 0, policy_version 1652835 (0.0007) [2023-12-28 07:08:23,043][106226] Updated weights for policy 0, policy_version 1652845 (0.0009) [2023-12-28 07:08:23,109][106226] Updated weights for policy 0, policy_version 1652855 (0.0009) [2023-12-28 07:08:23,381][106225] Updated weights for policy 1, policy_version 1656593 (0.0008) [2023-12-28 07:08:23,436][106225] Updated weights for policy 1, policy_version 1656603 (0.0009) [2023-12-28 07:08:23,482][106225] Updated weights for policy 1, policy_version 1656613 (0.0008) [2023-12-28 07:08:23,793][106226] Updated weights for policy 0, policy_version 1652865 (0.0006) [2023-12-28 07:08:23,852][106226] Updated weights for policy 0, policy_version 1652875 (0.0005) [2023-12-28 07:08:23,918][106226] Updated weights for policy 0, policy_version 1652885 (0.0005) [2023-12-28 07:08:24,122][106225] Updated weights for policy 1, policy_version 1656623 (0.0007) [2023-12-28 07:08:24,184][106225] Updated weights for policy 1, policy_version 1656633 (0.0007) [2023-12-28 07:08:24,241][106225] Updated weights for policy 1, policy_version 1656643 (0.0010) [2023-12-28 07:08:24,538][106226] Updated weights for policy 0, policy_version 1652895 (0.0005) [2023-12-28 07:08:24,596][106226] Updated weights for policy 0, policy_version 1652905 (0.0005) [2023-12-28 07:08:24,647][106226] Updated weights for policy 0, policy_version 1652915 (0.0005) [2023-12-28 07:08:24,863][106225] Updated weights for policy 1, policy_version 1656653 (0.0010) [2023-12-28 07:08:24,928][106225] Updated weights for policy 1, policy_version 1656663 (0.0006) [2023-12-28 07:08:24,990][106225] Updated weights for policy 1, policy_version 1656673 (0.0005) [2023-12-28 07:08:25,202][106226] Updated weights for policy 0, policy_version 1652925 (0.0007) [2023-12-28 07:08:25,258][106226] Updated weights for policy 0, policy_version 1652935 (0.0008) [2023-12-28 07:08:25,315][106226] Updated weights for policy 0, policy_version 1652945 (0.0005) [2023-12-28 07:08:25,631][106225] Updated weights for policy 1, policy_version 1656683 (0.0007) [2023-12-28 07:08:25,685][106225] Updated weights for policy 1, policy_version 1656693 (0.0005) [2023-12-28 07:08:25,730][106225] Updated weights for policy 1, policy_version 1656703 (0.0005) [2023-12-28 07:08:25,930][106226] Updated weights for policy 0, policy_version 1652955 (0.0006) [2023-12-28 07:08:25,981][106226] Updated weights for policy 0, policy_version 1652965 (0.0005) [2023-12-28 07:08:26,029][106226] Updated weights for policy 0, policy_version 1652975 (0.0005) [2023-12-28 07:08:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 847413248. Throughput: 0: 9767.5, 1: 9770.6. Samples: 847375836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:26,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.837')] [2023-12-28 07:08:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001656712_424173568.pth... [2023-12-28 07:08:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001652984_423239680.pth... [2023-12-28 07:08:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001655560_423878656.pth [2023-12-28 07:08:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001651832_422944768.pth [2023-12-28 07:08:26,436][106225] Updated weights for policy 1, policy_version 1656713 (0.0010) [2023-12-28 07:08:26,500][106225] Updated weights for policy 1, policy_version 1656723 (0.0009) [2023-12-28 07:08:26,553][106225] Updated weights for policy 1, policy_version 1656733 (0.0010) [2023-12-28 07:08:26,603][106225] Updated weights for policy 1, policy_version 1656743 (0.0010) [2023-12-28 07:08:26,764][106226] Updated weights for policy 0, policy_version 1652985 (0.0007) [2023-12-28 07:08:26,829][106226] Updated weights for policy 0, policy_version 1652995 (0.0008) [2023-12-28 07:08:26,893][106226] Updated weights for policy 0, policy_version 1653005 (0.0008) [2023-12-28 07:08:26,947][106226] Updated weights for policy 0, policy_version 1653015 (0.0008) [2023-12-28 07:08:27,342][106225] Updated weights for policy 1, policy_version 1656753 (0.0008) [2023-12-28 07:08:27,387][106225] Updated weights for policy 1, policy_version 1656763 (0.0006) [2023-12-28 07:08:27,435][106225] Updated weights for policy 1, policy_version 1656773 (0.0008) [2023-12-28 07:08:27,636][106226] Updated weights for policy 0, policy_version 1653025 (0.0009) [2023-12-28 07:08:27,684][106226] Updated weights for policy 0, policy_version 1653035 (0.0008) [2023-12-28 07:08:27,772][106226] Updated weights for policy 0, policy_version 1653045 (0.0008) [2023-12-28 07:08:28,176][106225] Updated weights for policy 1, policy_version 1656783 (0.0008) [2023-12-28 07:08:28,239][106225] Updated weights for policy 1, policy_version 1656793 (0.0010) [2023-12-28 07:08:28,297][106225] Updated weights for policy 1, policy_version 1656803 (0.0010) [2023-12-28 07:08:28,400][106226] Updated weights for policy 0, policy_version 1653055 (0.0007) [2023-12-28 07:08:28,459][106226] Updated weights for policy 0, policy_version 1653065 (0.0005) [2023-12-28 07:08:28,521][106226] Updated weights for policy 0, policy_version 1653075 (0.0007) [2023-12-28 07:08:28,992][106225] Updated weights for policy 1, policy_version 1656813 (0.0010) [2023-12-28 07:08:29,047][106225] Updated weights for policy 1, policy_version 1656823 (0.0010) [2023-12-28 07:08:29,096][106225] Updated weights for policy 1, policy_version 1656833 (0.0010) [2023-12-28 07:08:29,205][106226] Updated weights for policy 0, policy_version 1653085 (0.0008) [2023-12-28 07:08:29,270][106226] Updated weights for policy 0, policy_version 1653095 (0.0009) [2023-12-28 07:08:29,331][106226] Updated weights for policy 0, policy_version 1653105 (0.0008) [2023-12-28 07:08:29,825][106225] Updated weights for policy 1, policy_version 1656843 (0.0010) [2023-12-28 07:08:29,898][106225] Updated weights for policy 1, policy_version 1656853 (0.0008) [2023-12-28 07:08:29,964][106225] Updated weights for policy 1, policy_version 1656863 (0.0009) [2023-12-28 07:08:30,078][106226] Updated weights for policy 0, policy_version 1653115 (0.0008) [2023-12-28 07:08:30,146][106226] Updated weights for policy 0, policy_version 1653125 (0.0008) [2023-12-28 07:08:30,209][106226] Updated weights for policy 0, policy_version 1653135 (0.0008) [2023-12-28 07:08:30,654][106225] Updated weights for policy 1, policy_version 1656873 (0.0010) [2023-12-28 07:08:30,714][106225] Updated weights for policy 1, policy_version 1656883 (0.0008) [2023-12-28 07:08:30,758][106225] Updated weights for policy 1, policy_version 1656893 (0.0005) [2023-12-28 07:08:30,809][106225] Updated weights for policy 1, policy_version 1656903 (0.0005) [2023-12-28 07:08:30,897][106226] Updated weights for policy 0, policy_version 1653146 (0.0008) [2023-12-28 07:08:30,943][106226] Updated weights for policy 0, policy_version 1653156 (0.0010) [2023-12-28 07:08:31,002][106226] Updated weights for policy 0, policy_version 1653166 (0.0011) [2023-12-28 07:08:31,074][106226] Updated weights for policy 0, policy_version 1653176 (0.0010) [2023-12-28 07:08:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 847511552. Throughput: 0: 9897.9, 1: 9819.4. Samples: 847498192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:31,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.541')] [2023-12-28 07:08:31,467][106225] Updated weights for policy 1, policy_version 1656913 (0.0008) [2023-12-28 07:08:31,520][106225] Updated weights for policy 1, policy_version 1656923 (0.0007) [2023-12-28 07:08:31,574][106225] Updated weights for policy 1, policy_version 1656933 (0.0009) [2023-12-28 07:08:31,820][106226] Updated weights for policy 0, policy_version 1653186 (0.0008) [2023-12-28 07:08:31,883][106226] Updated weights for policy 0, policy_version 1653196 (0.0008) [2023-12-28 07:08:31,944][106226] Updated weights for policy 0, policy_version 1653206 (0.0008) [2023-12-28 07:08:32,318][106225] Updated weights for policy 1, policy_version 1656943 (0.0008) [2023-12-28 07:08:32,377][106225] Updated weights for policy 1, policy_version 1656953 (0.0008) [2023-12-28 07:08:32,434][106225] Updated weights for policy 1, policy_version 1656963 (0.0008) [2023-12-28 07:08:32,679][106226] Updated weights for policy 0, policy_version 1653216 (0.0010) [2023-12-28 07:08:32,739][106226] Updated weights for policy 0, policy_version 1653226 (0.0011) [2023-12-28 07:08:32,799][106226] Updated weights for policy 0, policy_version 1653236 (0.0010) [2023-12-28 07:08:33,155][106225] Updated weights for policy 1, policy_version 1656973 (0.0007) [2023-12-28 07:08:33,219][106225] Updated weights for policy 1, policy_version 1656983 (0.0007) [2023-12-28 07:08:33,272][106225] Updated weights for policy 1, policy_version 1656993 (0.0008) [2023-12-28 07:08:33,508][106226] Updated weights for policy 0, policy_version 1653246 (0.0010) [2023-12-28 07:08:33,560][106226] Updated weights for policy 0, policy_version 1653256 (0.0010) [2023-12-28 07:08:33,603][106226] Updated weights for policy 0, policy_version 1653266 (0.0010) [2023-12-28 07:08:33,898][106225] Updated weights for policy 1, policy_version 1657003 (0.0008) [2023-12-28 07:08:33,957][106225] Updated weights for policy 1, policy_version 1657013 (0.0009) [2023-12-28 07:08:34,016][106225] Updated weights for policy 1, policy_version 1657023 (0.0007) [2023-12-28 07:08:34,366][106226] Updated weights for policy 0, policy_version 1653276 (0.0010) [2023-12-28 07:08:34,422][106226] Updated weights for policy 0, policy_version 1653286 (0.0008) [2023-12-28 07:08:34,488][106226] Updated weights for policy 0, policy_version 1653296 (0.0008) [2023-12-28 07:08:34,641][106225] Updated weights for policy 1, policy_version 1657033 (0.0006) [2023-12-28 07:08:34,690][106225] Updated weights for policy 1, policy_version 1657043 (0.0006) [2023-12-28 07:08:34,737][106225] Updated weights for policy 1, policy_version 1657053 (0.0005) [2023-12-28 07:08:34,788][106225] Updated weights for policy 1, policy_version 1657063 (0.0009) [2023-12-28 07:08:35,259][106226] Updated weights for policy 0, policy_version 1653306 (0.0008) [2023-12-28 07:08:35,320][106226] Updated weights for policy 0, policy_version 1653316 (0.0005) [2023-12-28 07:08:35,388][106226] Updated weights for policy 0, policy_version 1653326 (0.0005) [2023-12-28 07:08:35,423][106225] Updated weights for policy 1, policy_version 1657073 (0.0006) [2023-12-28 07:08:35,444][106226] Updated weights for policy 0, policy_version 1653336 (0.0007) [2023-12-28 07:08:35,475][106225] Updated weights for policy 1, policy_version 1657083 (0.0005) [2023-12-28 07:08:35,528][106225] Updated weights for policy 1, policy_version 1657093 (0.0006) [2023-12-28 07:08:36,143][106225] Updated weights for policy 1, policy_version 1657103 (0.0008) [2023-12-28 07:08:36,143][106226] Updated weights for policy 0, policy_version 1653346 (0.0008) [2023-12-28 07:08:36,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 847601664. Throughput: 0: 9808.0, 1: 9863.6. Samples: 847616968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:36,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-4.864')] [2023-12-28 07:08:36,205][106225] Updated weights for policy 1, policy_version 1657113 (0.0005) [2023-12-28 07:08:36,206][106226] Updated weights for policy 0, policy_version 1653356 (0.0009) [2023-12-28 07:08:36,264][106226] Updated weights for policy 0, policy_version 1653366 (0.0009) [2023-12-28 07:08:36,274][106225] Updated weights for policy 1, policy_version 1657123 (0.0006) [2023-12-28 07:08:36,956][106225] Updated weights for policy 1, policy_version 1657133 (0.0008) [2023-12-28 07:08:37,019][106225] Updated weights for policy 1, policy_version 1657143 (0.0011) [2023-12-28 07:08:37,025][106226] Updated weights for policy 0, policy_version 1653376 (0.0007) [2023-12-28 07:08:37,081][106225] Updated weights for policy 1, policy_version 1657153 (0.0011) [2023-12-28 07:08:37,082][106226] Updated weights for policy 0, policy_version 1653386 (0.0007) [2023-12-28 07:08:37,138][106226] Updated weights for policy 0, policy_version 1653396 (0.0008) [2023-12-28 07:08:37,796][106225] Updated weights for policy 1, policy_version 1657163 (0.0011) [2023-12-28 07:08:37,847][106225] Updated weights for policy 1, policy_version 1657173 (0.0010) [2023-12-28 07:08:37,849][106226] Updated weights for policy 0, policy_version 1653406 (0.0007) [2023-12-28 07:08:37,897][106226] Updated weights for policy 0, policy_version 1653416 (0.0006) [2023-12-28 07:08:37,905][106225] Updated weights for policy 1, policy_version 1657183 (0.0010) [2023-12-28 07:08:37,949][106226] Updated weights for policy 0, policy_version 1653426 (0.0006) [2023-12-28 07:08:38,608][106225] Updated weights for policy 1, policy_version 1657193 (0.0011) [2023-12-28 07:08:38,608][106226] Updated weights for policy 0, policy_version 1653436 (0.0006) [2023-12-28 07:08:38,667][106225] Updated weights for policy 1, policy_version 1657203 (0.0007) [2023-12-28 07:08:38,673][106226] Updated weights for policy 0, policy_version 1653446 (0.0007) [2023-12-28 07:08:38,730][106225] Updated weights for policy 1, policy_version 1657213 (0.0010) [2023-12-28 07:08:38,732][106226] Updated weights for policy 0, policy_version 1653456 (0.0006) [2023-12-28 07:08:38,785][106225] Updated weights for policy 1, policy_version 1657223 (0.0007) [2023-12-28 07:08:39,510][106226] Updated weights for policy 0, policy_version 1653466 (0.0007) [2023-12-28 07:08:39,524][106225] Updated weights for policy 1, policy_version 1657233 (0.0010) [2023-12-28 07:08:39,570][106226] Updated weights for policy 0, policy_version 1653476 (0.0006) [2023-12-28 07:08:39,587][106225] Updated weights for policy 1, policy_version 1657243 (0.0010) [2023-12-28 07:08:39,625][106226] Updated weights for policy 0, policy_version 1653486 (0.0007) [2023-12-28 07:08:39,652][106225] Updated weights for policy 1, policy_version 1657253 (0.0011) [2023-12-28 07:08:39,697][106226] Updated weights for policy 0, policy_version 1653496 (0.0008) [2023-12-28 07:08:40,395][106225] Updated weights for policy 1, policy_version 1657263 (0.0011) [2023-12-28 07:08:40,409][106226] Updated weights for policy 0, policy_version 1653506 (0.0007) [2023-12-28 07:08:40,454][106225] Updated weights for policy 1, policy_version 1657273 (0.0011) [2023-12-28 07:08:40,466][106226] Updated weights for policy 0, policy_version 1653516 (0.0006) [2023-12-28 07:08:40,520][106225] Updated weights for policy 1, policy_version 1657283 (0.0008) [2023-12-28 07:08:40,522][106226] Updated weights for policy 0, policy_version 1653526 (0.0006) [2023-12-28 07:08:41,097][106225] Updated weights for policy 1, policy_version 1657293 (0.0008) [2023-12-28 07:08:41,120][106226] Updated weights for policy 0, policy_version 1653536 (0.0007) [2023-12-28 07:08:41,165][106225] Updated weights for policy 1, policy_version 1657303 (0.0010) [2023-12-28 07:08:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 847699968. Throughput: 0: 9803.3, 1: 9865.0. Samples: 847676220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:41,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-4.650')] [2023-12-28 07:08:41,192][106226] Updated weights for policy 0, policy_version 1653546 (0.0008) [2023-12-28 07:08:41,227][106225] Updated weights for policy 1, policy_version 1657313 (0.0011) [2023-12-28 07:08:41,253][106226] Updated weights for policy 0, policy_version 1653556 (0.0006) [2023-12-28 07:08:41,269][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001657320_424329216.pth... [2023-12-28 07:08:41,274][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001656136_424026112.pth [2023-12-28 07:08:41,280][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001653560_423387136.pth... [2023-12-28 07:08:41,284][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001652408_423092224.pth [2023-12-28 07:08:42,002][106226] Updated weights for policy 0, policy_version 1653566 (0.0007) [2023-12-28 07:08:42,044][106225] Updated weights for policy 1, policy_version 1657323 (0.0010) [2023-12-28 07:08:42,062][106226] Updated weights for policy 0, policy_version 1653576 (0.0008) [2023-12-28 07:08:42,103][106225] Updated weights for policy 1, policy_version 1657333 (0.0008) [2023-12-28 07:08:42,113][106226] Updated weights for policy 0, policy_version 1653586 (0.0006) [2023-12-28 07:08:42,166][106225] Updated weights for policy 1, policy_version 1657343 (0.0007) [2023-12-28 07:08:42,806][106226] Updated weights for policy 0, policy_version 1653596 (0.0006) [2023-12-28 07:08:42,866][106226] Updated weights for policy 0, policy_version 1653606 (0.0008) [2023-12-28 07:08:42,910][106225] Updated weights for policy 1, policy_version 1657353 (0.0008) [2023-12-28 07:08:42,936][106226] Updated weights for policy 0, policy_version 1653616 (0.0008) [2023-12-28 07:08:42,976][106225] Updated weights for policy 1, policy_version 1657363 (0.0008) [2023-12-28 07:08:43,028][106225] Updated weights for policy 1, policy_version 1657373 (0.0006) [2023-12-28 07:08:43,073][106225] Updated weights for policy 1, policy_version 1657383 (0.0006) [2023-12-28 07:08:43,608][106225] Updated weights for policy 1, policy_version 1657393 (0.0005) [2023-12-28 07:08:43,654][106225] Updated weights for policy 1, policy_version 1657403 (0.0005) [2023-12-28 07:08:43,707][106225] Updated weights for policy 1, policy_version 1657413 (0.0005) [2023-12-28 07:08:43,716][106226] Updated weights for policy 0, policy_version 1653626 (0.0007) [2023-12-28 07:08:43,773][106226] Updated weights for policy 0, policy_version 1653636 (0.0011) [2023-12-28 07:08:43,826][106226] Updated weights for policy 0, policy_version 1653646 (0.0009) [2023-12-28 07:08:43,887][106226] Updated weights for policy 0, policy_version 1653656 (0.0005) [2023-12-28 07:08:44,410][106225] Updated weights for policy 1, policy_version 1657423 (0.0007) [2023-12-28 07:08:44,471][106225] Updated weights for policy 1, policy_version 1657433 (0.0007) [2023-12-28 07:08:44,527][106225] Updated weights for policy 1, policy_version 1657443 (0.0010) [2023-12-28 07:08:44,533][106226] Updated weights for policy 0, policy_version 1653666 (0.0011) [2023-12-28 07:08:44,596][106226] Updated weights for policy 0, policy_version 1653676 (0.0010) [2023-12-28 07:08:44,642][106226] Updated weights for policy 0, policy_version 1653686 (0.0010) [2023-12-28 07:08:45,192][106225] Updated weights for policy 1, policy_version 1657453 (0.0010) [2023-12-28 07:08:45,257][106225] Updated weights for policy 1, policy_version 1657463 (0.0009) [2023-12-28 07:08:45,320][106225] Updated weights for policy 1, policy_version 1657473 (0.0007) [2023-12-28 07:08:45,402][106226] Updated weights for policy 0, policy_version 1653696 (0.0010) [2023-12-28 07:08:45,459][106226] Updated weights for policy 0, policy_version 1653706 (0.0011) [2023-12-28 07:08:45,526][106226] Updated weights for policy 0, policy_version 1653716 (0.0011) [2023-12-28 07:08:45,976][106225] Updated weights for policy 1, policy_version 1657483 (0.0008) [2023-12-28 07:08:46,032][106225] Updated weights for policy 1, policy_version 1657493 (0.0010) [2023-12-28 07:08:46,085][106225] Updated weights for policy 1, policy_version 1657503 (0.0010) [2023-12-28 07:08:46,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 847806464. Throughput: 0: 9783.2, 1: 9917.9. Samples: 847794808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:46,176][105115] Avg episode reward: [(0, '-4.709'), (1, '-4.790')] [2023-12-28 07:08:46,243][106226] Updated weights for policy 0, policy_version 1653726 (0.0010) [2023-12-28 07:08:46,293][106226] Updated weights for policy 0, policy_version 1653736 (0.0010) [2023-12-28 07:08:46,343][106226] Updated weights for policy 0, policy_version 1653746 (0.0010) [2023-12-28 07:08:46,682][106225] Updated weights for policy 1, policy_version 1657513 (0.0006) [2023-12-28 07:08:46,731][106225] Updated weights for policy 1, policy_version 1657523 (0.0005) [2023-12-28 07:08:46,786][106225] Updated weights for policy 1, policy_version 1657533 (0.0006) [2023-12-28 07:08:46,841][106225] Updated weights for policy 1, policy_version 1657543 (0.0008) [2023-12-28 07:08:47,079][106226] Updated weights for policy 0, policy_version 1653756 (0.0010) [2023-12-28 07:08:47,137][106226] Updated weights for policy 0, policy_version 1653766 (0.0011) [2023-12-28 07:08:47,190][106226] Updated weights for policy 0, policy_version 1653776 (0.0010) [2023-12-28 07:08:47,402][106225] Updated weights for policy 1, policy_version 1657553 (0.0010) [2023-12-28 07:08:47,450][106225] Updated weights for policy 1, policy_version 1657563 (0.0007) [2023-12-28 07:08:47,496][106225] Updated weights for policy 1, policy_version 1657573 (0.0005) [2023-12-28 07:08:47,880][106226] Updated weights for policy 0, policy_version 1653786 (0.0010) [2023-12-28 07:08:47,933][106226] Updated weights for policy 0, policy_version 1653796 (0.0006) [2023-12-28 07:08:48,000][106226] Updated weights for policy 0, policy_version 1653806 (0.0005) [2023-12-28 07:08:48,065][106226] Updated weights for policy 0, policy_version 1653816 (0.0009) [2023-12-28 07:08:48,174][106225] Updated weights for policy 1, policy_version 1657583 (0.0006) [2023-12-28 07:08:48,239][106225] Updated weights for policy 1, policy_version 1657593 (0.0010) [2023-12-28 07:08:48,296][106225] Updated weights for policy 1, policy_version 1657603 (0.0006) [2023-12-28 07:08:48,703][106226] Updated weights for policy 0, policy_version 1653826 (0.0006) [2023-12-28 07:08:48,760][106226] Updated weights for policy 0, policy_version 1653836 (0.0006) [2023-12-28 07:08:48,822][106226] Updated weights for policy 0, policy_version 1653846 (0.0008) [2023-12-28 07:08:48,935][106225] Updated weights for policy 1, policy_version 1657613 (0.0007) [2023-12-28 07:08:48,983][106225] Updated weights for policy 1, policy_version 1657623 (0.0007) [2023-12-28 07:08:49,038][106225] Updated weights for policy 1, policy_version 1657633 (0.0005) [2023-12-28 07:08:49,473][106226] Updated weights for policy 0, policy_version 1653856 (0.0009) [2023-12-28 07:08:49,522][106226] Updated weights for policy 0, policy_version 1653866 (0.0010) [2023-12-28 07:08:49,570][106226] Updated weights for policy 0, policy_version 1653876 (0.0008) [2023-12-28 07:08:49,653][106225] Updated weights for policy 1, policy_version 1657643 (0.0005) [2023-12-28 07:08:49,702][106225] Updated weights for policy 1, policy_version 1657653 (0.0005) [2023-12-28 07:08:49,763][106225] Updated weights for policy 1, policy_version 1657663 (0.0005) [2023-12-28 07:08:50,337][106226] Updated weights for policy 0, policy_version 1653886 (0.0010) [2023-12-28 07:08:50,366][106225] Updated weights for policy 1, policy_version 1657673 (0.0006) [2023-12-28 07:08:50,391][106226] Updated weights for policy 0, policy_version 1653896 (0.0010) [2023-12-28 07:08:50,424][106225] Updated weights for policy 1, policy_version 1657683 (0.0006) [2023-12-28 07:08:50,451][106226] Updated weights for policy 0, policy_version 1653906 (0.0011) [2023-12-28 07:08:50,484][106225] Updated weights for policy 1, policy_version 1657693 (0.0006) [2023-12-28 07:08:50,543][106225] Updated weights for policy 1, policy_version 1657703 (0.0007) [2023-12-28 07:08:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 847904768. Throughput: 0: 9774.6, 1: 10096.2. Samples: 847918928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:51,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.801')] [2023-12-28 07:08:51,205][106226] Updated weights for policy 0, policy_version 1653916 (0.0009) [2023-12-28 07:08:51,267][106226] Updated weights for policy 0, policy_version 1653926 (0.0008) [2023-12-28 07:08:51,294][106225] Updated weights for policy 1, policy_version 1657713 (0.0007) [2023-12-28 07:08:51,331][106226] Updated weights for policy 0, policy_version 1653936 (0.0007) [2023-12-28 07:08:51,361][106225] Updated weights for policy 1, policy_version 1657723 (0.0008) [2023-12-28 07:08:51,421][106225] Updated weights for policy 1, policy_version 1657733 (0.0008) [2023-12-28 07:08:52,051][106226] Updated weights for policy 0, policy_version 1653946 (0.0007) [2023-12-28 07:08:52,106][106226] Updated weights for policy 0, policy_version 1653956 (0.0008) [2023-12-28 07:08:52,144][106225] Updated weights for policy 1, policy_version 1657743 (0.0008) [2023-12-28 07:08:52,162][106226] Updated weights for policy 0, policy_version 1653966 (0.0007) [2023-12-28 07:08:52,196][106225] Updated weights for policy 1, policy_version 1657753 (0.0005) [2023-12-28 07:08:52,225][106226] Updated weights for policy 0, policy_version 1653976 (0.0008) [2023-12-28 07:08:52,247][106225] Updated weights for policy 1, policy_version 1657763 (0.0006) [2023-12-28 07:08:52,831][106225] Updated weights for policy 1, policy_version 1657773 (0.0007) [2023-12-28 07:08:52,884][106225] Updated weights for policy 1, policy_version 1657783 (0.0009) [2023-12-28 07:08:52,952][106225] Updated weights for policy 1, policy_version 1657793 (0.0009) [2023-12-28 07:08:53,053][106226] Updated weights for policy 0, policy_version 1653986 (0.0008) [2023-12-28 07:08:53,115][106226] Updated weights for policy 0, policy_version 1653996 (0.0006) [2023-12-28 07:08:53,185][106226] Updated weights for policy 0, policy_version 1654006 (0.0007) [2023-12-28 07:08:53,631][106225] Updated weights for policy 1, policy_version 1657803 (0.0009) [2023-12-28 07:08:53,689][106225] Updated weights for policy 1, policy_version 1657813 (0.0008) [2023-12-28 07:08:53,750][106225] Updated weights for policy 1, policy_version 1657823 (0.0006) [2023-12-28 07:08:53,896][106226] Updated weights for policy 0, policy_version 1654016 (0.0008) [2023-12-28 07:08:53,962][106226] Updated weights for policy 0, policy_version 1654026 (0.0009) [2023-12-28 07:08:54,032][106226] Updated weights for policy 0, policy_version 1654036 (0.0009) [2023-12-28 07:08:54,289][106225] Updated weights for policy 1, policy_version 1657833 (0.0005) [2023-12-28 07:08:54,347][106225] Updated weights for policy 1, policy_version 1657843 (0.0005) [2023-12-28 07:08:54,404][106225] Updated weights for policy 1, policy_version 1657853 (0.0010) [2023-12-28 07:08:54,451][106225] Updated weights for policy 1, policy_version 1657863 (0.0010) [2023-12-28 07:08:54,827][106226] Updated weights for policy 0, policy_version 1654046 (0.0008) [2023-12-28 07:08:54,887][106226] Updated weights for policy 0, policy_version 1654056 (0.0008) [2023-12-28 07:08:54,949][106226] Updated weights for policy 0, policy_version 1654066 (0.0007) [2023-12-28 07:08:55,141][106225] Updated weights for policy 1, policy_version 1657873 (0.0007) [2023-12-28 07:08:55,206][106225] Updated weights for policy 1, policy_version 1657883 (0.0008) [2023-12-28 07:08:55,264][106225] Updated weights for policy 1, policy_version 1657893 (0.0008) [2023-12-28 07:08:55,584][106226] Updated weights for policy 0, policy_version 1654076 (0.0007) [2023-12-28 07:08:55,644][106226] Updated weights for policy 0, policy_version 1654086 (0.0006) [2023-12-28 07:08:55,705][106226] Updated weights for policy 0, policy_version 1654096 (0.0006) [2023-12-28 07:08:55,964][106225] Updated weights for policy 1, policy_version 1657903 (0.0009) [2023-12-28 07:08:56,028][106225] Updated weights for policy 1, policy_version 1657913 (0.0010) [2023-12-28 07:08:56,087][106225] Updated weights for policy 1, policy_version 1657923 (0.0010) [2023-12-28 07:08:56,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 848011264. Throughput: 0: 9702.1, 1: 10122.5. Samples: 847976396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:08:56,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.866')] [2023-12-28 07:08:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001657928_424484864.pth... [2023-12-28 07:08:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001654104_423526400.pth... [2023-12-28 07:08:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001656712_424173568.pth [2023-12-28 07:08:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001652984_423239680.pth [2023-12-28 07:08:56,300][106226] Updated weights for policy 0, policy_version 1654106 (0.0006) [2023-12-28 07:08:56,359][106226] Updated weights for policy 0, policy_version 1654116 (0.0006) [2023-12-28 07:08:56,416][106226] Updated weights for policy 0, policy_version 1654126 (0.0006) [2023-12-28 07:08:56,472][106226] Updated weights for policy 0, policy_version 1654136 (0.0010) [2023-12-28 07:08:56,671][106225] Updated weights for policy 1, policy_version 1657933 (0.0008) [2023-12-28 07:08:56,725][106225] Updated weights for policy 1, policy_version 1657943 (0.0005) [2023-12-28 07:08:56,780][106225] Updated weights for policy 1, policy_version 1657953 (0.0007) [2023-12-28 07:08:57,120][106226] Updated weights for policy 0, policy_version 1654146 (0.0008) [2023-12-28 07:08:57,182][106226] Updated weights for policy 0, policy_version 1654156 (0.0007) [2023-12-28 07:08:57,243][106226] Updated weights for policy 0, policy_version 1654166 (0.0008) [2023-12-28 07:08:57,449][106225] Updated weights for policy 1, policy_version 1657963 (0.0007) [2023-12-28 07:08:57,502][106225] Updated weights for policy 1, policy_version 1657973 (0.0010) [2023-12-28 07:08:57,564][106225] Updated weights for policy 1, policy_version 1657983 (0.0010) [2023-12-28 07:08:57,998][106226] Updated weights for policy 0, policy_version 1654176 (0.0008) [2023-12-28 07:08:58,055][106226] Updated weights for policy 0, policy_version 1654186 (0.0008) [2023-12-28 07:08:58,110][106226] Updated weights for policy 0, policy_version 1654196 (0.0008) [2023-12-28 07:08:58,165][106225] Updated weights for policy 1, policy_version 1657993 (0.0008) [2023-12-28 07:08:58,232][106225] Updated weights for policy 1, policy_version 1658003 (0.0010) [2023-12-28 07:08:58,297][106225] Updated weights for policy 1, policy_version 1658013 (0.0008) [2023-12-28 07:08:58,398][106225] Updated weights for policy 1, policy_version 1658023 (0.0009) [2023-12-28 07:08:58,883][106226] Updated weights for policy 0, policy_version 1654206 (0.0009) [2023-12-28 07:08:58,956][106226] Updated weights for policy 0, policy_version 1654216 (0.0009) [2023-12-28 07:08:59,023][106226] Updated weights for policy 0, policy_version 1654226 (0.0011) [2023-12-28 07:08:59,159][106225] Updated weights for policy 1, policy_version 1658033 (0.0008) [2023-12-28 07:08:59,223][106225] Updated weights for policy 1, policy_version 1658043 (0.0008) [2023-12-28 07:08:59,290][106225] Updated weights for policy 1, policy_version 1658053 (0.0008) [2023-12-28 07:08:59,805][106226] Updated weights for policy 0, policy_version 1654236 (0.0009) [2023-12-28 07:08:59,869][106226] Updated weights for policy 0, policy_version 1654246 (0.0009) [2023-12-28 07:08:59,930][106226] Updated weights for policy 0, policy_version 1654256 (0.0008) [2023-12-28 07:09:00,038][106225] Updated weights for policy 1, policy_version 1658063 (0.0009) [2023-12-28 07:09:00,098][106225] Updated weights for policy 1, policy_version 1658073 (0.0008) [2023-12-28 07:09:00,156][106225] Updated weights for policy 1, policy_version 1658083 (0.0008) [2023-12-28 07:09:00,697][106226] Updated weights for policy 0, policy_version 1654266 (0.0009) [2023-12-28 07:09:00,754][106226] Updated weights for policy 0, policy_version 1654276 (0.0007) [2023-12-28 07:09:00,816][106226] Updated weights for policy 0, policy_version 1654286 (0.0009) [2023-12-28 07:09:00,834][106225] Updated weights for policy 1, policy_version 1658093 (0.0008) [2023-12-28 07:09:00,875][106226] Updated weights for policy 0, policy_version 1654296 (0.0007) [2023-12-28 07:09:00,894][106225] Updated weights for policy 1, policy_version 1658103 (0.0008) [2023-12-28 07:09:00,948][106225] Updated weights for policy 1, policy_version 1658113 (0.0008) [2023-12-28 07:09:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 848109568. Throughput: 0: 9716.7, 1: 10182.9. Samples: 848095660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:01,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.595')] [2023-12-28 07:09:01,654][106226] Updated weights for policy 0, policy_version 1654306 (0.0009) [2023-12-28 07:09:01,655][106225] Updated weights for policy 1, policy_version 1658123 (0.0007) [2023-12-28 07:09:01,710][106225] Updated weights for policy 1, policy_version 1658133 (0.0006) [2023-12-28 07:09:01,717][106226] Updated weights for policy 0, policy_version 1654316 (0.0009) [2023-12-28 07:09:01,775][106225] Updated weights for policy 1, policy_version 1658143 (0.0008) [2023-12-28 07:09:01,781][106226] Updated weights for policy 0, policy_version 1654326 (0.0011) [2023-12-28 07:09:02,496][106225] Updated weights for policy 1, policy_version 1658153 (0.0007) [2023-12-28 07:09:02,528][106226] Updated weights for policy 0, policy_version 1654336 (0.0011) [2023-12-28 07:09:02,549][106225] Updated weights for policy 1, policy_version 1658163 (0.0007) [2023-12-28 07:09:02,585][106226] Updated weights for policy 0, policy_version 1654346 (0.0006) [2023-12-28 07:09:02,600][106225] Updated weights for policy 1, policy_version 1658173 (0.0008) [2023-12-28 07:09:02,646][106226] Updated weights for policy 0, policy_version 1654356 (0.0006) [2023-12-28 07:09:02,651][106225] Updated weights for policy 1, policy_version 1658183 (0.0008) [2023-12-28 07:09:03,243][106226] Updated weights for policy 0, policy_version 1654366 (0.0006) [2023-12-28 07:09:03,305][106226] Updated weights for policy 0, policy_version 1654376 (0.0005) [2023-12-28 07:09:03,361][106225] Updated weights for policy 1, policy_version 1658193 (0.0010) [2023-12-28 07:09:03,362][106226] Updated weights for policy 0, policy_version 1654386 (0.0007) [2023-12-28 07:09:03,417][106225] Updated weights for policy 1, policy_version 1658203 (0.0009) [2023-12-28 07:09:03,470][106225] Updated weights for policy 1, policy_version 1658213 (0.0006) [2023-12-28 07:09:04,046][106226] Updated weights for policy 0, policy_version 1654396 (0.0007) [2023-12-28 07:09:04,070][106225] Updated weights for policy 1, policy_version 1658223 (0.0006) [2023-12-28 07:09:04,105][106226] Updated weights for policy 0, policy_version 1654406 (0.0007) [2023-12-28 07:09:04,136][106225] Updated weights for policy 1, policy_version 1658233 (0.0007) [2023-12-28 07:09:04,171][106226] Updated weights for policy 0, policy_version 1654416 (0.0008) [2023-12-28 07:09:04,203][106225] Updated weights for policy 1, policy_version 1658243 (0.0006) [2023-12-28 07:09:04,852][106226] Updated weights for policy 0, policy_version 1654426 (0.0008) [2023-12-28 07:09:04,875][106225] Updated weights for policy 1, policy_version 1658253 (0.0006) [2023-12-28 07:09:04,910][106226] Updated weights for policy 0, policy_version 1654436 (0.0010) [2023-12-28 07:09:04,923][106225] Updated weights for policy 1, policy_version 1658263 (0.0008) [2023-12-28 07:09:04,969][106226] Updated weights for policy 0, policy_version 1654446 (0.0010) [2023-12-28 07:09:04,971][106225] Updated weights for policy 1, policy_version 1658273 (0.0006) [2023-12-28 07:09:05,028][106226] Updated weights for policy 0, policy_version 1654456 (0.0010) [2023-12-28 07:09:05,662][106226] Updated weights for policy 0, policy_version 1654466 (0.0010) [2023-12-28 07:09:05,711][106226] Updated weights for policy 0, policy_version 1654476 (0.0010) [2023-12-28 07:09:05,729][106225] Updated weights for policy 1, policy_version 1658283 (0.0005) [2023-12-28 07:09:05,765][106226] Updated weights for policy 0, policy_version 1654486 (0.0010) [2023-12-28 07:09:05,771][106225] Updated weights for policy 1, policy_version 1658293 (0.0005) [2023-12-28 07:09:05,830][106225] Updated weights for policy 1, policy_version 1658303 (0.0006) [2023-12-28 07:09:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 848207872. Throughput: 0: 9779.7, 1: 10198.8. Samples: 848215460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:06,176][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.528')] [2023-12-28 07:09:06,473][106225] Updated weights for policy 1, policy_version 1658313 (0.0007) [2023-12-28 07:09:06,505][106226] Updated weights for policy 0, policy_version 1654496 (0.0011) [2023-12-28 07:09:06,529][106225] Updated weights for policy 1, policy_version 1658323 (0.0006) [2023-12-28 07:09:06,567][106226] Updated weights for policy 0, policy_version 1654506 (0.0011) [2023-12-28 07:09:06,592][106225] Updated weights for policy 1, policy_version 1658333 (0.0006) [2023-12-28 07:09:06,625][106226] Updated weights for policy 0, policy_version 1654516 (0.0010) [2023-12-28 07:09:06,658][106225] Updated weights for policy 1, policy_version 1658343 (0.0006) [2023-12-28 07:09:07,272][106225] Updated weights for policy 1, policy_version 1658353 (0.0006) [2023-12-28 07:09:07,335][106225] Updated weights for policy 1, policy_version 1658363 (0.0010) [2023-12-28 07:09:07,342][106226] Updated weights for policy 0, policy_version 1654526 (0.0011) [2023-12-28 07:09:07,387][106225] Updated weights for policy 1, policy_version 1658373 (0.0010) [2023-12-28 07:09:07,400][106226] Updated weights for policy 0, policy_version 1654536 (0.0011) [2023-12-28 07:09:07,455][106226] Updated weights for policy 0, policy_version 1654546 (0.0010) [2023-12-28 07:09:08,093][106225] Updated weights for policy 1, policy_version 1658383 (0.0010) [2023-12-28 07:09:08,135][106226] Updated weights for policy 0, policy_version 1654556 (0.0007) [2023-12-28 07:09:08,151][106225] Updated weights for policy 1, policy_version 1658393 (0.0008) [2023-12-28 07:09:08,194][106226] Updated weights for policy 0, policy_version 1654566 (0.0008) [2023-12-28 07:09:08,210][106225] Updated weights for policy 1, policy_version 1658403 (0.0007) [2023-12-28 07:09:08,243][106226] Updated weights for policy 0, policy_version 1654576 (0.0008) [2023-12-28 07:09:08,899][106225] Updated weights for policy 1, policy_version 1658413 (0.0008) [2023-12-28 07:09:08,961][106226] Updated weights for policy 0, policy_version 1654586 (0.0008) [2023-12-28 07:09:08,964][106225] Updated weights for policy 1, policy_version 1658423 (0.0011) [2023-12-28 07:09:09,021][106225] Updated weights for policy 1, policy_version 1658433 (0.0010) [2023-12-28 07:09:09,022][106226] Updated weights for policy 0, policy_version 1654596 (0.0009) [2023-12-28 07:09:09,082][106226] Updated weights for policy 0, policy_version 1654606 (0.0008) [2023-12-28 07:09:09,125][106226] Updated weights for policy 0, policy_version 1654616 (0.0007) [2023-12-28 07:09:09,792][106225] Updated weights for policy 1, policy_version 1658443 (0.0009) [2023-12-28 07:09:09,859][106225] Updated weights for policy 1, policy_version 1658453 (0.0008) [2023-12-28 07:09:09,900][106226] Updated weights for policy 0, policy_version 1654626 (0.0009) [2023-12-28 07:09:09,927][106225] Updated weights for policy 1, policy_version 1658463 (0.0007) [2023-12-28 07:09:09,963][106226] Updated weights for policy 0, policy_version 1654636 (0.0009) [2023-12-28 07:09:10,029][106226] Updated weights for policy 0, policy_version 1654646 (0.0009) [2023-12-28 07:09:10,653][106225] Updated weights for policy 1, policy_version 1658473 (0.0007) [2023-12-28 07:09:10,709][106225] Updated weights for policy 1, policy_version 1658483 (0.0007) [2023-12-28 07:09:10,755][106225] Updated weights for policy 1, policy_version 1658493 (0.0009) [2023-12-28 07:09:10,786][106226] Updated weights for policy 0, policy_version 1654656 (0.0008) [2023-12-28 07:09:10,809][106225] Updated weights for policy 1, policy_version 1658503 (0.0008) [2023-12-28 07:09:10,843][106226] Updated weights for policy 0, policy_version 1654666 (0.0005) [2023-12-28 07:09:10,898][106226] Updated weights for policy 0, policy_version 1654676 (0.0008) [2023-12-28 07:09:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 848306176. Throughput: 0: 9758.3, 1: 10247.9. Samples: 848276112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:11,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.734')] [2023-12-28 07:09:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001658504_424632320.pth... [2023-12-28 07:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001654680_423673856.pth... [2023-12-28 07:09:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001657320_424329216.pth [2023-12-28 07:09:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001653560_423387136.pth [2023-12-28 07:09:11,575][106225] Updated weights for policy 1, policy_version 1658513 (0.0006) [2023-12-28 07:09:11,645][106225] Updated weights for policy 1, policy_version 1658523 (0.0009) [2023-12-28 07:09:11,660][106226] Updated weights for policy 0, policy_version 1654686 (0.0009) [2023-12-28 07:09:11,712][106225] Updated weights for policy 1, policy_version 1658533 (0.0008) [2023-12-28 07:09:11,718][106226] Updated weights for policy 0, policy_version 1654696 (0.0009) [2023-12-28 07:09:11,787][106226] Updated weights for policy 0, policy_version 1654706 (0.0011) [2023-12-28 07:09:12,457][106225] Updated weights for policy 1, policy_version 1658543 (0.0006) [2023-12-28 07:09:12,487][106226] Updated weights for policy 0, policy_version 1654716 (0.0010) [2023-12-28 07:09:12,522][106225] Updated weights for policy 1, policy_version 1658553 (0.0006) [2023-12-28 07:09:12,552][106226] Updated weights for policy 0, policy_version 1654726 (0.0009) [2023-12-28 07:09:12,587][106225] Updated weights for policy 1, policy_version 1658563 (0.0007) [2023-12-28 07:09:12,620][106226] Updated weights for policy 0, policy_version 1654736 (0.0011) [2023-12-28 07:09:13,273][106225] Updated weights for policy 1, policy_version 1658573 (0.0009) [2023-12-28 07:09:13,309][106226] Updated weights for policy 0, policy_version 1654746 (0.0010) [2023-12-28 07:09:13,337][106225] Updated weights for policy 1, policy_version 1658583 (0.0007) [2023-12-28 07:09:13,362][106226] Updated weights for policy 0, policy_version 1654756 (0.0010) [2023-12-28 07:09:13,394][106225] Updated weights for policy 1, policy_version 1658593 (0.0009) [2023-12-28 07:09:13,411][106226] Updated weights for policy 0, policy_version 1654766 (0.0010) [2023-12-28 07:09:13,464][106226] Updated weights for policy 0, policy_version 1654776 (0.0010) [2023-12-28 07:09:14,013][106225] Updated weights for policy 1, policy_version 1658603 (0.0009) [2023-12-28 07:09:14,067][106225] Updated weights for policy 1, policy_version 1658613 (0.0009) [2023-12-28 07:09:14,118][106225] Updated weights for policy 1, policy_version 1658623 (0.0010) [2023-12-28 07:09:14,177][106226] Updated weights for policy 0, policy_version 1654786 (0.0005) [2023-12-28 07:09:14,238][106226] Updated weights for policy 0, policy_version 1654796 (0.0007) [2023-12-28 07:09:14,300][106226] Updated weights for policy 0, policy_version 1654806 (0.0008) [2023-12-28 07:09:14,754][106225] Updated weights for policy 1, policy_version 1658633 (0.0011) [2023-12-28 07:09:14,824][106225] Updated weights for policy 1, policy_version 1658643 (0.0009) [2023-12-28 07:09:14,893][106225] Updated weights for policy 1, policy_version 1658653 (0.0011) [2023-12-28 07:09:14,921][106226] Updated weights for policy 0, policy_version 1654816 (0.0011) [2023-12-28 07:09:14,956][106225] Updated weights for policy 1, policy_version 1658663 (0.0011) [2023-12-28 07:09:14,980][106226] Updated weights for policy 0, policy_version 1654826 (0.0009) [2023-12-28 07:09:15,045][106226] Updated weights for policy 0, policy_version 1654836 (0.0011) [2023-12-28 07:09:15,663][106225] Updated weights for policy 1, policy_version 1658673 (0.0006) [2023-12-28 07:09:15,714][106226] Updated weights for policy 0, policy_version 1654846 (0.0007) [2023-12-28 07:09:15,726][106225] Updated weights for policy 1, policy_version 1658683 (0.0010) [2023-12-28 07:09:15,777][106226] Updated weights for policy 0, policy_version 1654856 (0.0006) [2023-12-28 07:09:15,779][106225] Updated weights for policy 1, policy_version 1658693 (0.0010) [2023-12-28 07:09:15,832][106226] Updated weights for policy 0, policy_version 1654866 (0.0006) [2023-12-28 07:09:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 848404480. Throughput: 0: 9668.5, 1: 10209.0. Samples: 848392676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:16,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.583')] [2023-12-28 07:09:16,426][106226] Updated weights for policy 0, policy_version 1654876 (0.0005) [2023-12-28 07:09:16,435][106225] Updated weights for policy 1, policy_version 1658703 (0.0008) [2023-12-28 07:09:16,483][106226] Updated weights for policy 0, policy_version 1654886 (0.0005) [2023-12-28 07:09:16,492][106225] Updated weights for policy 1, policy_version 1658713 (0.0008) [2023-12-28 07:09:16,544][106226] Updated weights for policy 0, policy_version 1654896 (0.0005) [2023-12-28 07:09:16,558][106225] Updated weights for policy 1, policy_version 1658723 (0.0010) [2023-12-28 07:09:17,074][106226] Updated weights for policy 0, policy_version 1654906 (0.0005) [2023-12-28 07:09:17,129][106226] Updated weights for policy 0, policy_version 1654916 (0.0005) [2023-12-28 07:09:17,182][106226] Updated weights for policy 0, policy_version 1654926 (0.0005) [2023-12-28 07:09:17,194][106225] Updated weights for policy 1, policy_version 1658733 (0.0009) [2023-12-28 07:09:17,225][106226] Updated weights for policy 0, policy_version 1654936 (0.0005) [2023-12-28 07:09:17,250][106225] Updated weights for policy 1, policy_version 1658743 (0.0009) [2023-12-28 07:09:17,307][106225] Updated weights for policy 1, policy_version 1658753 (0.0008) [2023-12-28 07:09:17,769][106226] Updated weights for policy 0, policy_version 1654946 (0.0005) [2023-12-28 07:09:17,822][106226] Updated weights for policy 0, policy_version 1654956 (0.0005) [2023-12-28 07:09:17,869][106226] Updated weights for policy 0, policy_version 1654966 (0.0007) [2023-12-28 07:09:18,102][106225] Updated weights for policy 1, policy_version 1658764 (0.0009) [2023-12-28 07:09:18,157][106225] Updated weights for policy 1, policy_version 1658774 (0.0008) [2023-12-28 07:09:18,206][106225] Updated weights for policy 1, policy_version 1658784 (0.0008) [2023-12-28 07:09:18,581][106226] Updated weights for policy 0, policy_version 1654976 (0.0008) [2023-12-28 07:09:18,642][106226] Updated weights for policy 0, policy_version 1654986 (0.0008) [2023-12-28 07:09:18,704][106226] Updated weights for policy 0, policy_version 1654996 (0.0008) [2023-12-28 07:09:18,965][106225] Updated weights for policy 1, policy_version 1658794 (0.0008) [2023-12-28 07:09:19,029][106225] Updated weights for policy 1, policy_version 1658804 (0.0007) [2023-12-28 07:09:19,092][106225] Updated weights for policy 1, policy_version 1658814 (0.0007) [2023-12-28 07:09:19,154][106225] Updated weights for policy 1, policy_version 1658824 (0.0008) [2023-12-28 07:09:19,381][106226] Updated weights for policy 0, policy_version 1655006 (0.0008) [2023-12-28 07:09:19,446][106226] Updated weights for policy 0, policy_version 1655016 (0.0008) [2023-12-28 07:09:19,516][106226] Updated weights for policy 0, policy_version 1655026 (0.0009) [2023-12-28 07:09:19,898][106225] Updated weights for policy 1, policy_version 1658834 (0.0008) [2023-12-28 07:09:19,972][106225] Updated weights for policy 1, policy_version 1658844 (0.0008) [2023-12-28 07:09:20,034][106225] Updated weights for policy 1, policy_version 1658854 (0.0009) [2023-12-28 07:09:20,242][106226] Updated weights for policy 0, policy_version 1655036 (0.0009) [2023-12-28 07:09:20,296][106226] Updated weights for policy 0, policy_version 1655046 (0.0009) [2023-12-28 07:09:20,351][106226] Updated weights for policy 0, policy_version 1655056 (0.0009) [2023-12-28 07:09:20,784][106225] Updated weights for policy 1, policy_version 1658864 (0.0009) [2023-12-28 07:09:20,847][106225] Updated weights for policy 1, policy_version 1658874 (0.0009) [2023-12-28 07:09:20,906][106225] Updated weights for policy 1, policy_version 1658884 (0.0008) [2023-12-28 07:09:21,078][106226] Updated weights for policy 0, policy_version 1655066 (0.0007) [2023-12-28 07:09:21,140][106226] Updated weights for policy 0, policy_version 1655076 (0.0009) [2023-12-28 07:09:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 848502784. Throughput: 0: 9835.8, 1: 10105.3. Samples: 848514320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:21,175][105115] Avg episode reward: [(0, '-4.157'), (1, '-4.554')] [2023-12-28 07:09:21,204][106226] Updated weights for policy 0, policy_version 1655086 (0.0006) [2023-12-28 07:09:21,268][106226] Updated weights for policy 0, policy_version 1655096 (0.0007) [2023-12-28 07:09:21,715][106225] Updated weights for policy 1, policy_version 1658894 (0.0009) [2023-12-28 07:09:21,783][106225] Updated weights for policy 1, policy_version 1658904 (0.0008) [2023-12-28 07:09:21,843][106225] Updated weights for policy 1, policy_version 1658914 (0.0008) [2023-12-28 07:09:22,022][106226] Updated weights for policy 0, policy_version 1655106 (0.0008) [2023-12-28 07:09:22,078][106226] Updated weights for policy 0, policy_version 1655116 (0.0007) [2023-12-28 07:09:22,146][106226] Updated weights for policy 0, policy_version 1655126 (0.0009) [2023-12-28 07:09:22,611][106225] Updated weights for policy 1, policy_version 1658924 (0.0009) [2023-12-28 07:09:22,671][106225] Updated weights for policy 1, policy_version 1658934 (0.0008) [2023-12-28 07:09:22,724][106225] Updated weights for policy 1, policy_version 1658944 (0.0009) [2023-12-28 07:09:22,906][106226] Updated weights for policy 0, policy_version 1655136 (0.0006) [2023-12-28 07:09:22,960][106226] Updated weights for policy 0, policy_version 1655146 (0.0005) [2023-12-28 07:09:23,015][106226] Updated weights for policy 0, policy_version 1655156 (0.0006) [2023-12-28 07:09:23,420][106225] Updated weights for policy 1, policy_version 1658954 (0.0006) [2023-12-28 07:09:23,472][106225] Updated weights for policy 1, policy_version 1658964 (0.0009) [2023-12-28 07:09:23,531][106225] Updated weights for policy 1, policy_version 1658974 (0.0008) [2023-12-28 07:09:23,589][106225] Updated weights for policy 1, policy_version 1658984 (0.0008) [2023-12-28 07:09:23,690][106226] Updated weights for policy 0, policy_version 1655166 (0.0008) [2023-12-28 07:09:23,744][106226] Updated weights for policy 0, policy_version 1655176 (0.0008) [2023-12-28 07:09:23,799][106226] Updated weights for policy 0, policy_version 1655186 (0.0008) [2023-12-28 07:09:24,267][106225] Updated weights for policy 1, policy_version 1658994 (0.0006) [2023-12-28 07:09:24,322][106225] Updated weights for policy 1, policy_version 1659004 (0.0005) [2023-12-28 07:09:24,387][106225] Updated weights for policy 1, policy_version 1659014 (0.0006) [2023-12-28 07:09:24,588][106226] Updated weights for policy 0, policy_version 1655196 (0.0009) [2023-12-28 07:09:24,654][106226] Updated weights for policy 0, policy_version 1655206 (0.0009) [2023-12-28 07:09:24,706][106226] Updated weights for policy 0, policy_version 1655216 (0.0009) [2023-12-28 07:09:25,054][106225] Updated weights for policy 1, policy_version 1659024 (0.0007) [2023-12-28 07:09:25,106][106225] Updated weights for policy 1, policy_version 1659034 (0.0008) [2023-12-28 07:09:25,165][106225] Updated weights for policy 1, policy_version 1659044 (0.0009) [2023-12-28 07:09:25,399][106226] Updated weights for policy 0, policy_version 1655226 (0.0008) [2023-12-28 07:09:25,450][106226] Updated weights for policy 0, policy_version 1655236 (0.0008) [2023-12-28 07:09:25,498][106226] Updated weights for policy 0, policy_version 1655246 (0.0008) [2023-12-28 07:09:25,547][106226] Updated weights for policy 0, policy_version 1655256 (0.0008) [2023-12-28 07:09:25,887][106225] Updated weights for policy 1, policy_version 1659054 (0.0008) [2023-12-28 07:09:25,941][106225] Updated weights for policy 1, policy_version 1659064 (0.0008) [2023-12-28 07:09:25,988][106225] Updated weights for policy 1, policy_version 1659074 (0.0009) [2023-12-28 07:09:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 848601088. Throughput: 0: 9816.1, 1: 10043.9. Samples: 848569920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:26,175][105115] Avg episode reward: [(0, '-4.923'), (1, '-4.884')] [2023-12-28 07:09:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001659080_424779776.pth... [2023-12-28 07:09:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001655256_423821312.pth... [2023-12-28 07:09:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001654104_423526400.pth [2023-12-28 07:09:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001657928_424484864.pth [2023-12-28 07:09:26,297][106226] Updated weights for policy 0, policy_version 1655266 (0.0008) [2023-12-28 07:09:26,351][106226] Updated weights for policy 0, policy_version 1655276 (0.0008) [2023-12-28 07:09:26,425][106226] Updated weights for policy 0, policy_version 1655286 (0.0007) [2023-12-28 07:09:26,738][106225] Updated weights for policy 1, policy_version 1659084 (0.0008) [2023-12-28 07:09:26,787][106225] Updated weights for policy 1, policy_version 1659094 (0.0007) [2023-12-28 07:09:26,848][106225] Updated weights for policy 1, policy_version 1659104 (0.0008) [2023-12-28 07:09:27,112][106226] Updated weights for policy 0, policy_version 1655296 (0.0009) [2023-12-28 07:09:27,178][106226] Updated weights for policy 0, policy_version 1655306 (0.0008) [2023-12-28 07:09:27,240][106226] Updated weights for policy 0, policy_version 1655316 (0.0008) [2023-12-28 07:09:27,597][106225] Updated weights for policy 1, policy_version 1659114 (0.0008) [2023-12-28 07:09:27,661][106225] Updated weights for policy 1, policy_version 1659124 (0.0006) [2023-12-28 07:09:27,718][106225] Updated weights for policy 1, policy_version 1659134 (0.0005) [2023-12-28 07:09:27,771][106225] Updated weights for policy 1, policy_version 1659144 (0.0005) [2023-12-28 07:09:27,904][106226] Updated weights for policy 0, policy_version 1655326 (0.0008) [2023-12-28 07:09:27,955][106226] Updated weights for policy 0, policy_version 1655336 (0.0009) [2023-12-28 07:09:28,024][106226] Updated weights for policy 0, policy_version 1655346 (0.0006) [2023-12-28 07:09:28,358][106225] Updated weights for policy 1, policy_version 1659154 (0.0010) [2023-12-28 07:09:28,419][106225] Updated weights for policy 1, policy_version 1659164 (0.0010) [2023-12-28 07:09:28,479][106225] Updated weights for policy 1, policy_version 1659174 (0.0010) [2023-12-28 07:09:28,704][106226] Updated weights for policy 0, policy_version 1655356 (0.0007) [2023-12-28 07:09:28,764][106226] Updated weights for policy 0, policy_version 1655366 (0.0007) [2023-12-28 07:09:28,830][106226] Updated weights for policy 0, policy_version 1655376 (0.0008) [2023-12-28 07:09:29,125][106225] Updated weights for policy 1, policy_version 1659184 (0.0010) [2023-12-28 07:09:29,176][106225] Updated weights for policy 1, policy_version 1659194 (0.0010) [2023-12-28 07:09:29,233][106225] Updated weights for policy 1, policy_version 1659204 (0.0009) [2023-12-28 07:09:29,567][106226] Updated weights for policy 0, policy_version 1655386 (0.0009) [2023-12-28 07:09:29,625][106226] Updated weights for policy 0, policy_version 1655396 (0.0006) [2023-12-28 07:09:29,685][106226] Updated weights for policy 0, policy_version 1655406 (0.0010) [2023-12-28 07:09:29,734][106226] Updated weights for policy 0, policy_version 1655416 (0.0006) [2023-12-28 07:09:30,081][106225] Updated weights for policy 1, policy_version 1659214 (0.0007) [2023-12-28 07:09:30,148][106225] Updated weights for policy 1, policy_version 1659224 (0.0008) [2023-12-28 07:09:30,215][106225] Updated weights for policy 1, policy_version 1659234 (0.0008) [2023-12-28 07:09:30,397][106226] Updated weights for policy 0, policy_version 1655426 (0.0010) [2023-12-28 07:09:30,459][106226] Updated weights for policy 0, policy_version 1655436 (0.0007) [2023-12-28 07:09:30,519][106226] Updated weights for policy 0, policy_version 1655446 (0.0008) [2023-12-28 07:09:30,875][106225] Updated weights for policy 1, policy_version 1659244 (0.0009) [2023-12-28 07:09:30,931][106225] Updated weights for policy 1, policy_version 1659254 (0.0010) [2023-12-28 07:09:30,987][106225] Updated weights for policy 1, policy_version 1659264 (0.0010) [2023-12-28 07:09:31,142][106226] Updated weights for policy 0, policy_version 1655456 (0.0008) [2023-12-28 07:09:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 848699392. Throughput: 0: 9836.6, 1: 10048.7. Samples: 848689648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:31,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-5.062')] [2023-12-28 07:09:31,210][106226] Updated weights for policy 0, policy_version 1655466 (0.0008) [2023-12-28 07:09:31,266][106226] Updated weights for policy 0, policy_version 1655476 (0.0008) [2023-12-28 07:09:31,694][106225] Updated weights for policy 1, policy_version 1659274 (0.0009) [2023-12-28 07:09:31,751][106225] Updated weights for policy 1, policy_version 1659284 (0.0008) [2023-12-28 07:09:31,800][106225] Updated weights for policy 1, policy_version 1659294 (0.0006) [2023-12-28 07:09:31,847][106225] Updated weights for policy 1, policy_version 1659304 (0.0005) [2023-12-28 07:09:31,940][106226] Updated weights for policy 0, policy_version 1655486 (0.0009) [2023-12-28 07:09:32,002][106226] Updated weights for policy 0, policy_version 1655496 (0.0006) [2023-12-28 07:09:32,063][106226] Updated weights for policy 0, policy_version 1655506 (0.0009) [2023-12-28 07:09:32,520][106225] Updated weights for policy 1, policy_version 1659314 (0.0010) [2023-12-28 07:09:32,584][106225] Updated weights for policy 1, policy_version 1659324 (0.0010) [2023-12-28 07:09:32,653][106225] Updated weights for policy 1, policy_version 1659334 (0.0010) [2023-12-28 07:09:32,770][106226] Updated weights for policy 0, policy_version 1655516 (0.0007) [2023-12-28 07:09:32,831][106226] Updated weights for policy 0, policy_version 1655526 (0.0011) [2023-12-28 07:09:32,887][106226] Updated weights for policy 0, policy_version 1655536 (0.0010) [2023-12-28 07:09:33,304][106225] Updated weights for policy 1, policy_version 1659344 (0.0006) [2023-12-28 07:09:33,364][106225] Updated weights for policy 1, policy_version 1659354 (0.0005) [2023-12-28 07:09:33,415][106225] Updated weights for policy 1, policy_version 1659364 (0.0005) [2023-12-28 07:09:33,496][106226] Updated weights for policy 0, policy_version 1655546 (0.0010) [2023-12-28 07:09:33,556][106226] Updated weights for policy 0, policy_version 1655556 (0.0009) [2023-12-28 07:09:33,614][106226] Updated weights for policy 0, policy_version 1655566 (0.0009) [2023-12-28 07:09:33,664][106226] Updated weights for policy 0, policy_version 1655576 (0.0008) [2023-12-28 07:09:34,036][106225] Updated weights for policy 1, policy_version 1659374 (0.0008) [2023-12-28 07:09:34,097][106225] Updated weights for policy 1, policy_version 1659384 (0.0010) [2023-12-28 07:09:34,172][106225] Updated weights for policy 1, policy_version 1659395 (0.0010) [2023-12-28 07:09:34,313][106226] Updated weights for policy 0, policy_version 1655586 (0.0006) [2023-12-28 07:09:34,377][106226] Updated weights for policy 0, policy_version 1655596 (0.0006) [2023-12-28 07:09:34,441][106226] Updated weights for policy 0, policy_version 1655606 (0.0009) [2023-12-28 07:09:34,966][106225] Updated weights for policy 1, policy_version 1659405 (0.0009) [2023-12-28 07:09:35,034][106225] Updated weights for policy 1, policy_version 1659415 (0.0011) [2023-12-28 07:09:35,085][106226] Updated weights for policy 0, policy_version 1655616 (0.0007) [2023-12-28 07:09:35,095][106225] Updated weights for policy 1, policy_version 1659425 (0.0010) [2023-12-28 07:09:35,146][106226] Updated weights for policy 0, policy_version 1655626 (0.0007) [2023-12-28 07:09:35,203][106226] Updated weights for policy 0, policy_version 1655636 (0.0009) [2023-12-28 07:09:35,779][106225] Updated weights for policy 1, policy_version 1659435 (0.0007) [2023-12-28 07:09:35,826][106225] Updated weights for policy 1, policy_version 1659445 (0.0010) [2023-12-28 07:09:35,882][106225] Updated weights for policy 1, policy_version 1659455 (0.0010) [2023-12-28 07:09:35,892][106226] Updated weights for policy 0, policy_version 1655646 (0.0008) [2023-12-28 07:09:35,943][106226] Updated weights for policy 0, policy_version 1655656 (0.0005) [2023-12-28 07:09:35,998][106226] Updated weights for policy 0, policy_version 1655666 (0.0005) [2023-12-28 07:09:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 848805888. Throughput: 0: 9907.9, 1: 9933.0. Samples: 848811772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:36,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.823')] [2023-12-28 07:09:36,610][106225] Updated weights for policy 1, policy_version 1659465 (0.0010) [2023-12-28 07:09:36,670][106225] Updated weights for policy 1, policy_version 1659475 (0.0007) [2023-12-28 07:09:36,676][106226] Updated weights for policy 0, policy_version 1655676 (0.0008) [2023-12-28 07:09:36,731][106225] Updated weights for policy 1, policy_version 1659485 (0.0005) [2023-12-28 07:09:36,740][106226] Updated weights for policy 0, policy_version 1655686 (0.0011) [2023-12-28 07:09:36,792][106225] Updated weights for policy 1, policy_version 1659495 (0.0005) [2023-12-28 07:09:36,804][106226] Updated weights for policy 0, policy_version 1655696 (0.0011) [2023-12-28 07:09:37,383][106225] Updated weights for policy 1, policy_version 1659505 (0.0008) [2023-12-28 07:09:37,440][106225] Updated weights for policy 1, policy_version 1659515 (0.0007) [2023-12-28 07:09:37,496][106225] Updated weights for policy 1, policy_version 1659525 (0.0008) [2023-12-28 07:09:37,508][106226] Updated weights for policy 0, policy_version 1655706 (0.0011) [2023-12-28 07:09:37,559][106226] Updated weights for policy 0, policy_version 1655716 (0.0011) [2023-12-28 07:09:37,609][106226] Updated weights for policy 0, policy_version 1655726 (0.0010) [2023-12-28 07:09:37,678][106226] Updated weights for policy 0, policy_version 1655736 (0.0010) [2023-12-28 07:09:38,206][106225] Updated weights for policy 1, policy_version 1659535 (0.0008) [2023-12-28 07:09:38,260][106225] Updated weights for policy 1, policy_version 1659545 (0.0008) [2023-12-28 07:09:38,309][106225] Updated weights for policy 1, policy_version 1659555 (0.0007) [2023-12-28 07:09:38,396][106226] Updated weights for policy 0, policy_version 1655746 (0.0011) [2023-12-28 07:09:38,458][106226] Updated weights for policy 0, policy_version 1655756 (0.0011) [2023-12-28 07:09:38,512][106226] Updated weights for policy 0, policy_version 1655766 (0.0011) [2023-12-28 07:09:39,092][106225] Updated weights for policy 1, policy_version 1659565 (0.0006) [2023-12-28 07:09:39,158][106225] Updated weights for policy 1, policy_version 1659575 (0.0006) [2023-12-28 07:09:39,204][106226] Updated weights for policy 0, policy_version 1655776 (0.0010) [2023-12-28 07:09:39,221][106225] Updated weights for policy 1, policy_version 1659585 (0.0008) [2023-12-28 07:09:39,278][106226] Updated weights for policy 0, policy_version 1655786 (0.0009) [2023-12-28 07:09:39,344][106226] Updated weights for policy 0, policy_version 1655796 (0.0010) [2023-12-28 07:09:40,005][106225] Updated weights for policy 1, policy_version 1659595 (0.0008) [2023-12-28 07:09:40,073][106225] Updated weights for policy 1, policy_version 1659605 (0.0007) [2023-12-28 07:09:40,144][106225] Updated weights for policy 1, policy_version 1659615 (0.0008) [2023-12-28 07:09:40,163][106226] Updated weights for policy 0, policy_version 1655806 (0.0014) [2023-12-28 07:09:40,228][106226] Updated weights for policy 0, policy_version 1655816 (0.0008) [2023-12-28 07:09:40,296][106226] Updated weights for policy 0, policy_version 1655826 (0.0007) [2023-12-28 07:09:40,857][106225] Updated weights for policy 1, policy_version 1659625 (0.0008) [2023-12-28 07:09:40,913][106225] Updated weights for policy 1, policy_version 1659635 (0.0009) [2023-12-28 07:09:40,965][106226] Updated weights for policy 0, policy_version 1655836 (0.0006) [2023-12-28 07:09:40,967][106225] Updated weights for policy 1, policy_version 1659645 (0.0007) [2023-12-28 07:09:41,027][106225] Updated weights for policy 1, policy_version 1659655 (0.0006) [2023-12-28 07:09:41,045][106226] Updated weights for policy 0, policy_version 1655846 (0.0007) [2023-12-28 07:09:41,110][106226] Updated weights for policy 0, policy_version 1655856 (0.0008) [2023-12-28 07:09:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 848904192. Throughput: 0: 9961.1, 1: 9921.9. Samples: 848871136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:41,175][105115] Avg episode reward: [(0, '-4.144'), (1, '-4.593')] [2023-12-28 07:09:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001659656_424927232.pth... [2023-12-28 07:09:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001655864_423976960.pth... [2023-12-28 07:09:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001654680_423673856.pth [2023-12-28 07:09:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001658504_424632320.pth [2023-12-28 07:09:41,828][106225] Updated weights for policy 1, policy_version 1659665 (0.0008) [2023-12-28 07:09:41,882][106226] Updated weights for policy 0, policy_version 1655866 (0.0007) [2023-12-28 07:09:41,885][106225] Updated weights for policy 1, policy_version 1659675 (0.0009) [2023-12-28 07:09:41,941][106226] Updated weights for policy 0, policy_version 1655876 (0.0006) [2023-12-28 07:09:41,943][106225] Updated weights for policy 1, policy_version 1659685 (0.0007) [2023-12-28 07:09:42,005][106226] Updated weights for policy 0, policy_version 1655886 (0.0008) [2023-12-28 07:09:42,073][106226] Updated weights for policy 0, policy_version 1655896 (0.0008) [2023-12-28 07:09:42,694][106225] Updated weights for policy 1, policy_version 1659695 (0.0007) [2023-12-28 07:09:42,759][106225] Updated weights for policy 1, policy_version 1659705 (0.0008) [2023-12-28 07:09:42,772][106226] Updated weights for policy 0, policy_version 1655906 (0.0007) [2023-12-28 07:09:42,814][106225] Updated weights for policy 1, policy_version 1659715 (0.0007) [2023-12-28 07:09:42,823][106226] Updated weights for policy 0, policy_version 1655916 (0.0006) [2023-12-28 07:09:42,878][106226] Updated weights for policy 0, policy_version 1655926 (0.0008) [2023-12-28 07:09:43,521][106225] Updated weights for policy 1, policy_version 1659725 (0.0007) [2023-12-28 07:09:43,577][106225] Updated weights for policy 1, policy_version 1659735 (0.0008) [2023-12-28 07:09:43,612][106226] Updated weights for policy 0, policy_version 1655936 (0.0008) [2023-12-28 07:09:43,633][106225] Updated weights for policy 1, policy_version 1659745 (0.0005) [2023-12-28 07:09:43,670][106226] Updated weights for policy 0, policy_version 1655946 (0.0008) [2023-12-28 07:09:43,733][106226] Updated weights for policy 0, policy_version 1655956 (0.0005) [2023-12-28 07:09:44,286][106225] Updated weights for policy 1, policy_version 1659755 (0.0006) [2023-12-28 07:09:44,342][106225] Updated weights for policy 1, policy_version 1659765 (0.0008) [2023-12-28 07:09:44,378][106226] Updated weights for policy 0, policy_version 1655966 (0.0006) [2023-12-28 07:09:44,406][106225] Updated weights for policy 1, policy_version 1659775 (0.0007) [2023-12-28 07:09:44,430][106226] Updated weights for policy 0, policy_version 1655976 (0.0005) [2023-12-28 07:09:44,477][106226] Updated weights for policy 0, policy_version 1655986 (0.0006) [2023-12-28 07:09:45,150][106225] Updated weights for policy 1, policy_version 1659785 (0.0007) [2023-12-28 07:09:45,157][106226] Updated weights for policy 0, policy_version 1655996 (0.0006) [2023-12-28 07:09:45,211][106225] Updated weights for policy 1, policy_version 1659795 (0.0008) [2023-12-28 07:09:45,221][106226] Updated weights for policy 0, policy_version 1656006 (0.0006) [2023-12-28 07:09:45,276][106225] Updated weights for policy 1, policy_version 1659805 (0.0008) [2023-12-28 07:09:45,288][106226] Updated weights for policy 0, policy_version 1656016 (0.0006) [2023-12-28 07:09:45,336][106225] Updated weights for policy 1, policy_version 1659815 (0.0008) [2023-12-28 07:09:45,945][106226] Updated weights for policy 0, policy_version 1656026 (0.0006) [2023-12-28 07:09:46,003][106226] Updated weights for policy 0, policy_version 1656036 (0.0009) [2023-12-28 07:09:46,060][106225] Updated weights for policy 1, policy_version 1659825 (0.0008) [2023-12-28 07:09:46,062][106226] Updated weights for policy 0, policy_version 1656046 (0.0009) [2023-12-28 07:09:46,112][106225] Updated weights for policy 1, policy_version 1659835 (0.0006) [2023-12-28 07:09:46,120][106226] Updated weights for policy 0, policy_version 1656056 (0.0007) [2023-12-28 07:09:46,167][106225] Updated weights for policy 1, policy_version 1659845 (0.0008) [2023-12-28 07:09:46,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 848994304. Throughput: 0: 9962.8, 1: 9802.0. Samples: 848985072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:46,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.760')] [2023-12-28 07:09:46,847][106226] Updated weights for policy 0, policy_version 1656066 (0.0008) [2023-12-28 07:09:46,892][106225] Updated weights for policy 1, policy_version 1659855 (0.0007) [2023-12-28 07:09:46,906][106226] Updated weights for policy 0, policy_version 1656076 (0.0006) [2023-12-28 07:09:46,954][106225] Updated weights for policy 1, policy_version 1659865 (0.0007) [2023-12-28 07:09:46,960][106226] Updated weights for policy 0, policy_version 1656086 (0.0006) [2023-12-28 07:09:47,000][106225] Updated weights for policy 1, policy_version 1659875 (0.0007) [2023-12-28 07:09:47,666][106226] Updated weights for policy 0, policy_version 1656096 (0.0005) [2023-12-28 07:09:47,724][106226] Updated weights for policy 0, policy_version 1656106 (0.0006) [2023-12-28 07:09:47,752][106225] Updated weights for policy 1, policy_version 1659885 (0.0008) [2023-12-28 07:09:47,785][106226] Updated weights for policy 0, policy_version 1656116 (0.0006) [2023-12-28 07:09:47,807][106225] Updated weights for policy 1, policy_version 1659895 (0.0007) [2023-12-28 07:09:47,877][106225] Updated weights for policy 1, policy_version 1659905 (0.0008) [2023-12-28 07:09:48,401][106226] Updated weights for policy 0, policy_version 1656126 (0.0009) [2023-12-28 07:09:48,467][106226] Updated weights for policy 0, policy_version 1656136 (0.0008) [2023-12-28 07:09:48,528][106226] Updated weights for policy 0, policy_version 1656146 (0.0008) [2023-12-28 07:09:48,588][106225] Updated weights for policy 1, policy_version 1659915 (0.0008) [2023-12-28 07:09:48,642][106225] Updated weights for policy 1, policy_version 1659925 (0.0009) [2023-12-28 07:09:48,699][106225] Updated weights for policy 1, policy_version 1659935 (0.0009) [2023-12-28 07:09:49,261][106226] Updated weights for policy 0, policy_version 1656156 (0.0010) [2023-12-28 07:09:49,324][106226] Updated weights for policy 0, policy_version 1656166 (0.0010) [2023-12-28 07:09:49,395][106226] Updated weights for policy 0, policy_version 1656176 (0.0011) [2023-12-28 07:09:49,420][106225] Updated weights for policy 1, policy_version 1659945 (0.0008) [2023-12-28 07:09:49,480][106225] Updated weights for policy 1, policy_version 1659955 (0.0005) [2023-12-28 07:09:49,540][106225] Updated weights for policy 1, policy_version 1659965 (0.0005) [2023-12-28 07:09:49,595][106225] Updated weights for policy 1, policy_version 1659975 (0.0005) [2023-12-28 07:09:50,089][106226] Updated weights for policy 0, policy_version 1656186 (0.0011) [2023-12-28 07:09:50,154][106226] Updated weights for policy 0, policy_version 1656196 (0.0011) [2023-12-28 07:09:50,220][106226] Updated weights for policy 0, policy_version 1656206 (0.0011) [2023-12-28 07:09:50,264][106225] Updated weights for policy 1, policy_version 1659985 (0.0005) [2023-12-28 07:09:50,281][106226] Updated weights for policy 0, policy_version 1656216 (0.0011) [2023-12-28 07:09:50,327][106225] Updated weights for policy 1, policy_version 1659995 (0.0007) [2023-12-28 07:09:50,388][106225] Updated weights for policy 1, policy_version 1660005 (0.0007) [2023-12-28 07:09:50,968][106226] Updated weights for policy 0, policy_version 1656226 (0.0009) [2023-12-28 07:09:51,045][106226] Updated weights for policy 0, policy_version 1656236 (0.0009) [2023-12-28 07:09:51,068][106225] Updated weights for policy 1, policy_version 1660015 (0.0007) [2023-12-28 07:09:51,101][106226] Updated weights for policy 0, policy_version 1656246 (0.0008) [2023-12-28 07:09:51,130][106225] Updated weights for policy 1, policy_version 1660025 (0.0008) [2023-12-28 07:09:51,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 849092608. Throughput: 0: 9945.6, 1: 9773.5. Samples: 849102820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:51,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.934')] [2023-12-28 07:09:51,198][106225] Updated weights for policy 1, policy_version 1660035 (0.0008) [2023-12-28 07:09:51,924][106225] Updated weights for policy 1, policy_version 1660045 (0.0008) [2023-12-28 07:09:51,925][106226] Updated weights for policy 0, policy_version 1656256 (0.0006) [2023-12-28 07:09:51,983][106226] Updated weights for policy 0, policy_version 1656266 (0.0007) [2023-12-28 07:09:51,984][106225] Updated weights for policy 1, policy_version 1660055 (0.0007) [2023-12-28 07:09:52,036][106225] Updated weights for policy 1, policy_version 1660065 (0.0006) [2023-12-28 07:09:52,045][106226] Updated weights for policy 0, policy_version 1656276 (0.0008) [2023-12-28 07:09:52,759][106226] Updated weights for policy 0, policy_version 1656286 (0.0009) [2023-12-28 07:09:52,784][106225] Updated weights for policy 1, policy_version 1660075 (0.0007) [2023-12-28 07:09:52,818][106226] Updated weights for policy 0, policy_version 1656296 (0.0008) [2023-12-28 07:09:52,840][106225] Updated weights for policy 1, policy_version 1660085 (0.0007) [2023-12-28 07:09:52,873][106226] Updated weights for policy 0, policy_version 1656306 (0.0009) [2023-12-28 07:09:52,896][106225] Updated weights for policy 1, policy_version 1660095 (0.0006) [2023-12-28 07:09:53,554][106226] Updated weights for policy 0, policy_version 1656316 (0.0008) [2023-12-28 07:09:53,606][106226] Updated weights for policy 0, policy_version 1656326 (0.0007) [2023-12-28 07:09:53,655][106225] Updated weights for policy 1, policy_version 1660105 (0.0009) [2023-12-28 07:09:53,670][106226] Updated weights for policy 0, policy_version 1656336 (0.0006) [2023-12-28 07:09:53,716][106225] Updated weights for policy 1, policy_version 1660115 (0.0009) [2023-12-28 07:09:53,766][106225] Updated weights for policy 1, policy_version 1660125 (0.0008) [2023-12-28 07:09:53,819][106225] Updated weights for policy 1, policy_version 1660135 (0.0008) [2023-12-28 07:09:54,261][106226] Updated weights for policy 0, policy_version 1656346 (0.0006) [2023-12-28 07:09:54,330][106226] Updated weights for policy 0, policy_version 1656356 (0.0009) [2023-12-28 07:09:54,388][106226] Updated weights for policy 0, policy_version 1656366 (0.0008) [2023-12-28 07:09:54,457][106226] Updated weights for policy 0, policy_version 1656376 (0.0008) [2023-12-28 07:09:54,496][106225] Updated weights for policy 1, policy_version 1660145 (0.0007) [2023-12-28 07:09:54,555][106225] Updated weights for policy 1, policy_version 1660155 (0.0008) [2023-12-28 07:09:54,603][106225] Updated weights for policy 1, policy_version 1660165 (0.0009) [2023-12-28 07:09:55,139][106226] Updated weights for policy 0, policy_version 1656386 (0.0008) [2023-12-28 07:09:55,200][106226] Updated weights for policy 0, policy_version 1656396 (0.0009) [2023-12-28 07:09:55,267][106226] Updated weights for policy 0, policy_version 1656406 (0.0010) [2023-12-28 07:09:55,302][106225] Updated weights for policy 1, policy_version 1660175 (0.0007) [2023-12-28 07:09:55,357][106225] Updated weights for policy 1, policy_version 1660185 (0.0009) [2023-12-28 07:09:55,411][106225] Updated weights for policy 1, policy_version 1660195 (0.0009) [2023-12-28 07:09:55,901][106226] Updated weights for policy 0, policy_version 1656416 (0.0007) [2023-12-28 07:09:55,964][106226] Updated weights for policy 0, policy_version 1656426 (0.0006) [2023-12-28 07:09:56,015][106226] Updated weights for policy 0, policy_version 1656436 (0.0006) [2023-12-28 07:09:56,142][106225] Updated weights for policy 1, policy_version 1660205 (0.0007) [2023-12-28 07:09:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 849190912. Throughput: 0: 9940.6, 1: 9709.3. Samples: 849160360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:09:56,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.027')] [2023-12-28 07:09:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001656440_424124416.pth... [2023-12-28 07:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001655256_423821312.pth [2023-12-28 07:09:56,194][106225] Updated weights for policy 1, policy_version 1660215 (0.0006) [2023-12-28 07:09:56,251][106225] Updated weights for policy 1, policy_version 1660225 (0.0006) [2023-12-28 07:09:56,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001660232_425074688.pth... [2023-12-28 07:09:56,294][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001659080_424779776.pth [2023-12-28 07:09:56,736][106226] Updated weights for policy 0, policy_version 1656446 (0.0008) [2023-12-28 07:09:56,802][106226] Updated weights for policy 0, policy_version 1656456 (0.0008) [2023-12-28 07:09:56,848][106225] Updated weights for policy 1, policy_version 1660235 (0.0007) [2023-12-28 07:09:56,867][106226] Updated weights for policy 0, policy_version 1656466 (0.0010) [2023-12-28 07:09:56,900][106225] Updated weights for policy 1, policy_version 1660245 (0.0005) [2023-12-28 07:09:56,954][106225] Updated weights for policy 1, policy_version 1660255 (0.0005) [2023-12-28 07:09:57,592][106226] Updated weights for policy 0, policy_version 1656476 (0.0009) [2023-12-28 07:09:57,617][106225] Updated weights for policy 1, policy_version 1660265 (0.0006) [2023-12-28 07:09:57,645][106226] Updated weights for policy 0, policy_version 1656486 (0.0006) [2023-12-28 07:09:57,677][106225] Updated weights for policy 1, policy_version 1660275 (0.0010) [2023-12-28 07:09:57,699][106226] Updated weights for policy 0, policy_version 1656496 (0.0009) [2023-12-28 07:09:57,735][106225] Updated weights for policy 1, policy_version 1660285 (0.0010) [2023-12-28 07:09:57,792][106225] Updated weights for policy 1, policy_version 1660295 (0.0010) [2023-12-28 07:09:58,444][106226] Updated weights for policy 0, policy_version 1656506 (0.0010) [2023-12-28 07:09:58,494][106225] Updated weights for policy 1, policy_version 1660305 (0.0010) [2023-12-28 07:09:58,505][106226] Updated weights for policy 0, policy_version 1656516 (0.0008) [2023-12-28 07:09:58,556][106225] Updated weights for policy 1, policy_version 1660315 (0.0008) [2023-12-28 07:09:58,568][106226] Updated weights for policy 0, policy_version 1656526 (0.0008) [2023-12-28 07:09:58,620][106225] Updated weights for policy 1, policy_version 1660325 (0.0007) [2023-12-28 07:09:58,630][106226] Updated weights for policy 0, policy_version 1656536 (0.0008) [2023-12-28 07:09:59,374][106225] Updated weights for policy 1, policy_version 1660335 (0.0008) [2023-12-28 07:09:59,438][106225] Updated weights for policy 1, policy_version 1660345 (0.0008) [2023-12-28 07:09:59,503][106225] Updated weights for policy 1, policy_version 1660355 (0.0006) [2023-12-28 07:09:59,562][106226] Updated weights for policy 0, policy_version 1656546 (0.0009) [2023-12-28 07:09:59,610][106226] Updated weights for policy 0, policy_version 1656556 (0.0009) [2023-12-28 07:09:59,660][106226] Updated weights for policy 0, policy_version 1656566 (0.0008) [2023-12-28 07:10:00,142][106225] Updated weights for policy 1, policy_version 1660365 (0.0008) [2023-12-28 07:10:00,189][106225] Updated weights for policy 1, policy_version 1660375 (0.0010) [2023-12-28 07:10:00,239][106225] Updated weights for policy 1, policy_version 1660385 (0.0010) [2023-12-28 07:10:00,448][106226] Updated weights for policy 0, policy_version 1656576 (0.0006) [2023-12-28 07:10:00,506][106226] Updated weights for policy 0, policy_version 1656586 (0.0006) [2023-12-28 07:10:00,561][106226] Updated weights for policy 0, policy_version 1656596 (0.0005) [2023-12-28 07:10:00,925][106225] Updated weights for policy 1, policy_version 1660395 (0.0008) [2023-12-28 07:10:00,980][106225] Updated weights for policy 1, policy_version 1660405 (0.0005) [2023-12-28 07:10:01,045][106225] Updated weights for policy 1, policy_version 1660415 (0.0008) [2023-12-28 07:10:01,154][106226] Updated weights for policy 0, policy_version 1656606 (0.0009) [2023-12-28 07:10:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 849289216. Throughput: 0: 9924.1, 1: 9747.8. Samples: 849277912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:10:01,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.564')] [2023-12-28 07:10:01,212][106226] Updated weights for policy 0, policy_version 1656616 (0.0010) [2023-12-28 07:10:01,270][106226] Updated weights for policy 0, policy_version 1656626 (0.0009) [2023-12-28 07:10:01,780][106225] Updated weights for policy 1, policy_version 1660425 (0.0010) [2023-12-28 07:10:01,843][106225] Updated weights for policy 1, policy_version 1660435 (0.0006) [2023-12-28 07:10:01,903][106225] Updated weights for policy 1, policy_version 1660445 (0.0005) [2023-12-28 07:10:01,958][106225] Updated weights for policy 1, policy_version 1660455 (0.0006) [2023-12-28 07:10:02,025][106226] Updated weights for policy 0, policy_version 1656636 (0.0007) [2023-12-28 07:10:02,089][106226] Updated weights for policy 0, policy_version 1656646 (0.0006) [2023-12-28 07:10:02,149][106226] Updated weights for policy 0, policy_version 1656656 (0.0009) [2023-12-28 07:10:02,647][106225] Updated weights for policy 1, policy_version 1660465 (0.0008) [2023-12-28 07:10:02,696][106225] Updated weights for policy 1, policy_version 1660475 (0.0008) [2023-12-28 07:10:02,746][106225] Updated weights for policy 1, policy_version 1660485 (0.0008) [2023-12-28 07:10:02,780][106226] Updated weights for policy 0, policy_version 1656666 (0.0008) [2023-12-28 07:10:02,839][106226] Updated weights for policy 0, policy_version 1656676 (0.0008) [2023-12-28 07:10:02,896][106226] Updated weights for policy 0, policy_version 1656686 (0.0005) [2023-12-28 07:10:02,958][106226] Updated weights for policy 0, policy_version 1656696 (0.0005) [2023-12-28 07:10:03,499][106225] Updated weights for policy 1, policy_version 1660495 (0.0008) [2023-12-28 07:10:03,560][106225] Updated weights for policy 1, policy_version 1660505 (0.0007) [2023-12-28 07:10:03,584][106226] Updated weights for policy 0, policy_version 1656706 (0.0008) [2023-12-28 07:10:03,616][106225] Updated weights for policy 1, policy_version 1660515 (0.0006) [2023-12-28 07:10:03,642][106226] Updated weights for policy 0, policy_version 1656716 (0.0007) [2023-12-28 07:10:03,698][106226] Updated weights for policy 0, policy_version 1656726 (0.0008) [2023-12-28 07:10:04,225][106225] Updated weights for policy 1, policy_version 1660525 (0.0006) [2023-12-28 07:10:04,291][106225] Updated weights for policy 1, policy_version 1660535 (0.0006) [2023-12-28 07:10:04,355][106225] Updated weights for policy 1, policy_version 1660545 (0.0006) [2023-12-28 07:10:04,468][106226] Updated weights for policy 0, policy_version 1656736 (0.0008) [2023-12-28 07:10:04,516][106226] Updated weights for policy 0, policy_version 1656746 (0.0007) [2023-12-28 07:10:04,575][106226] Updated weights for policy 0, policy_version 1656756 (0.0009) [2023-12-28 07:10:04,996][106225] Updated weights for policy 1, policy_version 1660555 (0.0008) [2023-12-28 07:10:05,059][106225] Updated weights for policy 1, policy_version 1660565 (0.0010) [2023-12-28 07:10:05,126][106225] Updated weights for policy 1, policy_version 1660575 (0.0010) [2023-12-28 07:10:05,242][106226] Updated weights for policy 0, policy_version 1656766 (0.0008) [2023-12-28 07:10:05,304][106226] Updated weights for policy 0, policy_version 1656776 (0.0007) [2023-12-28 07:10:05,358][106226] Updated weights for policy 0, policy_version 1656786 (0.0008) [2023-12-28 07:10:05,819][106225] Updated weights for policy 1, policy_version 1660585 (0.0011) [2023-12-28 07:10:05,886][106225] Updated weights for policy 1, policy_version 1660595 (0.0010) [2023-12-28 07:10:05,956][106225] Updated weights for policy 1, policy_version 1660605 (0.0010) [2023-12-28 07:10:06,020][106225] Updated weights for policy 1, policy_version 1660615 (0.0010) [2023-12-28 07:10:06,068][106226] Updated weights for policy 0, policy_version 1656796 (0.0008) [2023-12-28 07:10:06,140][106226] Updated weights for policy 0, policy_version 1656806 (0.0009) [2023-12-28 07:10:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 849387520. Throughput: 0: 9850.9, 1: 9821.2. Samples: 849399568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:10:06,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-5.154')] [2023-12-28 07:10:06,208][106226] Updated weights for policy 0, policy_version 1656816 (0.0008) [2023-12-28 07:10:06,749][106225] Updated weights for policy 1, policy_version 1660625 (0.0009) [2023-12-28 07:10:06,813][106225] Updated weights for policy 1, policy_version 1660635 (0.0010) [2023-12-28 07:10:06,850][106226] Updated weights for policy 0, policy_version 1656826 (0.0009) [2023-12-28 07:10:06,861][106225] Updated weights for policy 1, policy_version 1660645 (0.0010) [2023-12-28 07:10:06,911][106226] Updated weights for policy 0, policy_version 1656836 (0.0007) [2023-12-28 07:10:06,970][106226] Updated weights for policy 0, policy_version 1656846 (0.0006) [2023-12-28 07:10:07,028][106226] Updated weights for policy 0, policy_version 1656856 (0.0011) [2023-12-28 07:10:07,570][106225] Updated weights for policy 1, policy_version 1660655 (0.0007) [2023-12-28 07:10:07,596][106226] Updated weights for policy 0, policy_version 1656866 (0.0011) [2023-12-28 07:10:07,617][106225] Updated weights for policy 1, policy_version 1660665 (0.0010) [2023-12-28 07:10:07,654][106226] Updated weights for policy 0, policy_version 1656876 (0.0011) [2023-12-28 07:10:07,675][106225] Updated weights for policy 1, policy_version 1660675 (0.0010) [2023-12-28 07:10:07,715][106226] Updated weights for policy 0, policy_version 1656886 (0.0010) [2023-12-28 07:10:08,395][106225] Updated weights for policy 1, policy_version 1660685 (0.0009) [2023-12-28 07:10:08,402][106226] Updated weights for policy 0, policy_version 1656896 (0.0007) [2023-12-28 07:10:08,458][106226] Updated weights for policy 0, policy_version 1656906 (0.0008) [2023-12-28 07:10:08,461][106225] Updated weights for policy 1, policy_version 1660695 (0.0007) [2023-12-28 07:10:08,520][106226] Updated weights for policy 0, policy_version 1656916 (0.0009) [2023-12-28 07:10:08,528][106225] Updated weights for policy 1, policy_version 1660705 (0.0008) [2023-12-28 07:10:09,121][106225] Updated weights for policy 1, policy_version 1660715 (0.0005) [2023-12-28 07:10:09,166][106226] Updated weights for policy 0, policy_version 1656926 (0.0011) [2023-12-28 07:10:09,182][106225] Updated weights for policy 1, policy_version 1660725 (0.0005) [2023-12-28 07:10:09,229][106226] Updated weights for policy 0, policy_version 1656936 (0.0010) [2023-12-28 07:10:09,252][106225] Updated weights for policy 1, policy_version 1660735 (0.0007) [2023-12-28 07:10:09,292][106226] Updated weights for policy 0, policy_version 1656946 (0.0008) [2023-12-28 07:10:09,918][106225] Updated weights for policy 1, policy_version 1660745 (0.0007) [2023-12-28 07:10:09,983][106225] Updated weights for policy 1, policy_version 1660755 (0.0009) [2023-12-28 07:10:10,039][106226] Updated weights for policy 0, policy_version 1656956 (0.0007) [2023-12-28 07:10:10,047][106225] Updated weights for policy 1, policy_version 1660765 (0.0007) [2023-12-28 07:10:10,111][106226] Updated weights for policy 0, policy_version 1656966 (0.0009) [2023-12-28 07:10:10,114][106225] Updated weights for policy 1, policy_version 1660775 (0.0006) [2023-12-28 07:10:10,183][106226] Updated weights for policy 0, policy_version 1656976 (0.0008) [2023-12-28 07:10:10,770][106225] Updated weights for policy 1, policy_version 1660785 (0.0006) [2023-12-28 07:10:10,820][106225] Updated weights for policy 1, policy_version 1660795 (0.0009) [2023-12-28 07:10:10,869][106225] Updated weights for policy 1, policy_version 1660805 (0.0010) [2023-12-28 07:10:10,917][106226] Updated weights for policy 0, policy_version 1656986 (0.0008) [2023-12-28 07:10:10,971][106226] Updated weights for policy 0, policy_version 1656996 (0.0005) [2023-12-28 07:10:11,037][106226] Updated weights for policy 0, policy_version 1657006 (0.0006) [2023-12-28 07:10:11,105][106226] Updated weights for policy 0, policy_version 1657016 (0.0006) [2023-12-28 07:10:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 849494016. Throughput: 0: 9934.3, 1: 9851.5. Samples: 849460284. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:11,175][105115] Avg episode reward: [(0, '-4.212'), (1, '-4.709')] [2023-12-28 07:10:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001660808_425222144.pth... [2023-12-28 07:10:11,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001657016_424271872.pth... [2023-12-28 07:10:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001655864_423976960.pth [2023-12-28 07:10:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001659656_424927232.pth [2023-12-28 07:10:11,775][106225] Updated weights for policy 1, policy_version 1660815 (0.0008) [2023-12-28 07:10:11,787][106226] Updated weights for policy 0, policy_version 1657026 (0.0008) [2023-12-28 07:10:11,829][106225] Updated weights for policy 1, policy_version 1660825 (0.0006) [2023-12-28 07:10:11,842][106226] Updated weights for policy 0, policy_version 1657036 (0.0008) [2023-12-28 07:10:11,892][106225] Updated weights for policy 1, policy_version 1660835 (0.0007) [2023-12-28 07:10:11,902][106226] Updated weights for policy 0, policy_version 1657046 (0.0008) [2023-12-28 07:10:12,628][106226] Updated weights for policy 0, policy_version 1657056 (0.0007) [2023-12-28 07:10:12,653][106225] Updated weights for policy 1, policy_version 1660845 (0.0007) [2023-12-28 07:10:12,691][106226] Updated weights for policy 0, policy_version 1657066 (0.0007) [2023-12-28 07:10:12,712][106225] Updated weights for policy 1, policy_version 1660855 (0.0006) [2023-12-28 07:10:12,751][106226] Updated weights for policy 0, policy_version 1657076 (0.0007) [2023-12-28 07:10:12,773][106225] Updated weights for policy 1, policy_version 1660865 (0.0007) [2023-12-28 07:10:13,369][106226] Updated weights for policy 0, policy_version 1657086 (0.0005) [2023-12-28 07:10:13,432][106226] Updated weights for policy 0, policy_version 1657096 (0.0005) [2023-12-28 07:10:13,494][106226] Updated weights for policy 0, policy_version 1657106 (0.0005) [2023-12-28 07:10:13,541][106225] Updated weights for policy 1, policy_version 1660875 (0.0008) [2023-12-28 07:10:13,600][106225] Updated weights for policy 1, policy_version 1660885 (0.0006) [2023-12-28 07:10:13,653][106225] Updated weights for policy 1, policy_version 1660895 (0.0005) [2023-12-28 07:10:14,081][106226] Updated weights for policy 0, policy_version 1657116 (0.0005) [2023-12-28 07:10:14,132][106226] Updated weights for policy 0, policy_version 1657126 (0.0007) [2023-12-28 07:10:14,197][106226] Updated weights for policy 0, policy_version 1657136 (0.0009) [2023-12-28 07:10:14,293][106225] Updated weights for policy 1, policy_version 1660905 (0.0007) [2023-12-28 07:10:14,346][106225] Updated weights for policy 1, policy_version 1660915 (0.0008) [2023-12-28 07:10:14,396][106225] Updated weights for policy 1, policy_version 1660925 (0.0009) [2023-12-28 07:10:14,456][106225] Updated weights for policy 1, policy_version 1660935 (0.0009) [2023-12-28 07:10:14,927][106226] Updated weights for policy 0, policy_version 1657146 (0.0008) [2023-12-28 07:10:14,987][106226] Updated weights for policy 0, policy_version 1657156 (0.0008) [2023-12-28 07:10:15,044][106226] Updated weights for policy 0, policy_version 1657166 (0.0008) [2023-12-28 07:10:15,101][106226] Updated weights for policy 0, policy_version 1657176 (0.0008) [2023-12-28 07:10:15,158][106225] Updated weights for policy 1, policy_version 1660945 (0.0007) [2023-12-28 07:10:15,222][106225] Updated weights for policy 1, policy_version 1660955 (0.0005) [2023-12-28 07:10:15,275][106225] Updated weights for policy 1, policy_version 1660965 (0.0007) [2023-12-28 07:10:15,845][106225] Updated weights for policy 1, policy_version 1660975 (0.0005) [2023-12-28 07:10:15,910][106225] Updated weights for policy 1, policy_version 1660985 (0.0007) [2023-12-28 07:10:15,911][106226] Updated weights for policy 0, policy_version 1657186 (0.0009) [2023-12-28 07:10:15,970][106225] Updated weights for policy 1, policy_version 1660995 (0.0007) [2023-12-28 07:10:15,974][106226] Updated weights for policy 0, policy_version 1657196 (0.0007) [2023-12-28 07:10:16,032][106226] Updated weights for policy 0, policy_version 1657206 (0.0009) [2023-12-28 07:10:16,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 849592320. Throughput: 0: 9930.2, 1: 9788.4. Samples: 849576984. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:16,175][105115] Avg episode reward: [(0, '-4.176'), (1, '-4.798')] [2023-12-28 07:10:16,559][106225] Updated weights for policy 1, policy_version 1661005 (0.0008) [2023-12-28 07:10:16,613][106225] Updated weights for policy 1, policy_version 1661015 (0.0007) [2023-12-28 07:10:16,668][106225] Updated weights for policy 1, policy_version 1661025 (0.0008) [2023-12-28 07:10:16,754][106226] Updated weights for policy 0, policy_version 1657216 (0.0009) [2023-12-28 07:10:16,821][106226] Updated weights for policy 0, policy_version 1657226 (0.0009) [2023-12-28 07:10:16,873][106226] Updated weights for policy 0, policy_version 1657236 (0.0009) [2023-12-28 07:10:17,353][106225] Updated weights for policy 1, policy_version 1661035 (0.0007) [2023-12-28 07:10:17,408][106225] Updated weights for policy 1, policy_version 1661045 (0.0008) [2023-12-28 07:10:17,451][106225] Updated weights for policy 1, policy_version 1661055 (0.0006) [2023-12-28 07:10:17,607][106226] Updated weights for policy 0, policy_version 1657246 (0.0007) [2023-12-28 07:10:17,663][106226] Updated weights for policy 0, policy_version 1657256 (0.0009) [2023-12-28 07:10:17,722][106226] Updated weights for policy 0, policy_version 1657266 (0.0008) [2023-12-28 07:10:18,044][106225] Updated weights for policy 1, policy_version 1661065 (0.0005) [2023-12-28 07:10:18,097][106225] Updated weights for policy 1, policy_version 1661075 (0.0009) [2023-12-28 07:10:18,153][106225] Updated weights for policy 1, policy_version 1661085 (0.0009) [2023-12-28 07:10:18,207][106225] Updated weights for policy 1, policy_version 1661095 (0.0008) [2023-12-28 07:10:18,525][106226] Updated weights for policy 0, policy_version 1657276 (0.0008) [2023-12-28 07:10:18,587][106226] Updated weights for policy 0, policy_version 1657286 (0.0006) [2023-12-28 07:10:18,646][106226] Updated weights for policy 0, policy_version 1657296 (0.0008) [2023-12-28 07:10:19,008][106225] Updated weights for policy 1, policy_version 1661105 (0.0007) [2023-12-28 07:10:19,059][106225] Updated weights for policy 1, policy_version 1661115 (0.0009) [2023-12-28 07:10:19,113][106225] Updated weights for policy 1, policy_version 1661125 (0.0009) [2023-12-28 07:10:19,276][106226] Updated weights for policy 0, policy_version 1657306 (0.0008) [2023-12-28 07:10:19,325][106226] Updated weights for policy 0, policy_version 1657316 (0.0008) [2023-12-28 07:10:19,388][106226] Updated weights for policy 0, policy_version 1657326 (0.0008) [2023-12-28 07:10:19,459][106226] Updated weights for policy 0, policy_version 1657336 (0.0009) [2023-12-28 07:10:19,921][106225] Updated weights for policy 1, policy_version 1661135 (0.0007) [2023-12-28 07:10:19,986][106225] Updated weights for policy 1, policy_version 1661145 (0.0010) [2023-12-28 07:10:20,047][106225] Updated weights for policy 1, policy_version 1661155 (0.0007) [2023-12-28 07:10:20,208][106226] Updated weights for policy 0, policy_version 1657346 (0.0010) [2023-12-28 07:10:20,262][106226] Updated weights for policy 0, policy_version 1657356 (0.0011) [2023-12-28 07:10:20,320][106226] Updated weights for policy 0, policy_version 1657366 (0.0010) [2023-12-28 07:10:20,595][106225] Updated weights for policy 1, policy_version 1661165 (0.0007) [2023-12-28 07:10:20,662][106225] Updated weights for policy 1, policy_version 1661175 (0.0009) [2023-12-28 07:10:20,732][106225] Updated weights for policy 1, policy_version 1661185 (0.0010) [2023-12-28 07:10:21,145][106226] Updated weights for policy 0, policy_version 1657376 (0.0007) [2023-12-28 07:10:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 849682432. Throughput: 0: 9791.8, 1: 9854.2. Samples: 849695844. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:21,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.861')] [2023-12-28 07:10:21,201][106226] Updated weights for policy 0, policy_version 1657386 (0.0008) [2023-12-28 07:10:21,263][106226] Updated weights for policy 0, policy_version 1657396 (0.0008) [2023-12-28 07:10:21,452][106225] Updated weights for policy 1, policy_version 1661195 (0.0011) [2023-12-28 07:10:21,517][106225] Updated weights for policy 1, policy_version 1661205 (0.0011) [2023-12-28 07:10:21,580][106225] Updated weights for policy 1, policy_version 1661215 (0.0010) [2023-12-28 07:10:22,049][106226] Updated weights for policy 0, policy_version 1657406 (0.0008) [2023-12-28 07:10:22,109][106226] Updated weights for policy 0, policy_version 1657416 (0.0008) [2023-12-28 07:10:22,166][106226] Updated weights for policy 0, policy_version 1657426 (0.0008) [2023-12-28 07:10:22,309][106225] Updated weights for policy 1, policy_version 1661225 (0.0011) [2023-12-28 07:10:22,379][106225] Updated weights for policy 1, policy_version 1661235 (0.0009) [2023-12-28 07:10:22,442][106225] Updated weights for policy 1, policy_version 1661245 (0.0008) [2023-12-28 07:10:22,500][106225] Updated weights for policy 1, policy_version 1661255 (0.0008) [2023-12-28 07:10:22,938][106226] Updated weights for policy 0, policy_version 1657436 (0.0009) [2023-12-28 07:10:22,993][106226] Updated weights for policy 0, policy_version 1657446 (0.0009) [2023-12-28 07:10:23,042][106226] Updated weights for policy 0, policy_version 1657456 (0.0008) [2023-12-28 07:10:23,243][106225] Updated weights for policy 1, policy_version 1661265 (0.0006) [2023-12-28 07:10:23,301][106225] Updated weights for policy 1, policy_version 1661275 (0.0005) [2023-12-28 07:10:23,367][106225] Updated weights for policy 1, policy_version 1661285 (0.0006) [2023-12-28 07:10:23,685][106226] Updated weights for policy 0, policy_version 1657466 (0.0009) [2023-12-28 07:10:23,736][106226] Updated weights for policy 0, policy_version 1657476 (0.0009) [2023-12-28 07:10:23,797][106226] Updated weights for policy 0, policy_version 1657486 (0.0008) [2023-12-28 07:10:23,848][106226] Updated weights for policy 0, policy_version 1657496 (0.0008) [2023-12-28 07:10:23,880][106225] Updated weights for policy 1, policy_version 1661295 (0.0005) [2023-12-28 07:10:23,926][106225] Updated weights for policy 1, policy_version 1661305 (0.0005) [2023-12-28 07:10:23,974][106225] Updated weights for policy 1, policy_version 1661315 (0.0005) [2023-12-28 07:10:24,622][106225] Updated weights for policy 1, policy_version 1661325 (0.0007) [2023-12-28 07:10:24,631][106226] Updated weights for policy 0, policy_version 1657506 (0.0009) [2023-12-28 07:10:24,668][106225] Updated weights for policy 1, policy_version 1661335 (0.0005) [2023-12-28 07:10:24,679][106226] Updated weights for policy 0, policy_version 1657516 (0.0007) [2023-12-28 07:10:24,718][106225] Updated weights for policy 1, policy_version 1661345 (0.0005) [2023-12-28 07:10:24,743][106226] Updated weights for policy 0, policy_version 1657526 (0.0008) [2023-12-28 07:10:25,275][106225] Updated weights for policy 1, policy_version 1661355 (0.0006) [2023-12-28 07:10:25,321][106225] Updated weights for policy 1, policy_version 1661365 (0.0005) [2023-12-28 07:10:25,376][106225] Updated weights for policy 1, policy_version 1661375 (0.0005) [2023-12-28 07:10:25,579][106226] Updated weights for policy 0, policy_version 1657536 (0.0008) [2023-12-28 07:10:25,631][106226] Updated weights for policy 0, policy_version 1657546 (0.0008) [2023-12-28 07:10:25,690][106226] Updated weights for policy 0, policy_version 1657556 (0.0008) [2023-12-28 07:10:26,012][106225] Updated weights for policy 1, policy_version 1661385 (0.0007) [2023-12-28 07:10:26,069][106225] Updated weights for policy 1, policy_version 1661395 (0.0006) [2023-12-28 07:10:26,125][106225] Updated weights for policy 1, policy_version 1661405 (0.0005) [2023-12-28 07:10:26,170][106225] Updated weights for policy 1, policy_version 1661415 (0.0005) [2023-12-28 07:10:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 849788928. Throughput: 0: 9760.8, 1: 9849.7. Samples: 849753608. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:26,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.897')] [2023-12-28 07:10:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001661416_425377792.pth... [2023-12-28 07:10:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001657560_424411136.pth... [2023-12-28 07:10:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001660232_425074688.pth [2023-12-28 07:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001656440_424124416.pth [2023-12-28 07:10:26,491][106226] Updated weights for policy 0, policy_version 1657566 (0.0008) [2023-12-28 07:10:26,539][106226] Updated weights for policy 0, policy_version 1657576 (0.0008) [2023-12-28 07:10:26,589][106226] Updated weights for policy 0, policy_version 1657586 (0.0007) [2023-12-28 07:10:26,708][106225] Updated weights for policy 1, policy_version 1661425 (0.0005) [2023-12-28 07:10:26,763][106225] Updated weights for policy 1, policy_version 1661435 (0.0006) [2023-12-28 07:10:26,821][106225] Updated weights for policy 1, policy_version 1661445 (0.0008) [2023-12-28 07:10:27,381][106226] Updated weights for policy 0, policy_version 1657596 (0.0009) [2023-12-28 07:10:27,408][106225] Updated weights for policy 1, policy_version 1661455 (0.0006) [2023-12-28 07:10:27,430][106226] Updated weights for policy 0, policy_version 1657606 (0.0008) [2023-12-28 07:10:27,459][106225] Updated weights for policy 1, policy_version 1661465 (0.0006) [2023-12-28 07:10:27,478][106226] Updated weights for policy 0, policy_version 1657616 (0.0006) [2023-12-28 07:10:27,514][106225] Updated weights for policy 1, policy_version 1661475 (0.0006) [2023-12-28 07:10:28,172][106225] Updated weights for policy 1, policy_version 1661485 (0.0007) [2023-12-28 07:10:28,219][106225] Updated weights for policy 1, policy_version 1661495 (0.0007) [2023-12-28 07:10:28,246][106226] Updated weights for policy 0, policy_version 1657626 (0.0006) [2023-12-28 07:10:28,274][106225] Updated weights for policy 1, policy_version 1661505 (0.0006) [2023-12-28 07:10:28,300][106226] Updated weights for policy 0, policy_version 1657636 (0.0007) [2023-12-28 07:10:28,369][106226] Updated weights for policy 0, policy_version 1657646 (0.0007) [2023-12-28 07:10:28,433][106226] Updated weights for policy 0, policy_version 1657656 (0.0006) [2023-12-28 07:10:29,022][106225] Updated weights for policy 1, policy_version 1661515 (0.0007) [2023-12-28 07:10:29,079][106225] Updated weights for policy 1, policy_version 1661525 (0.0008) [2023-12-28 07:10:29,110][106226] Updated weights for policy 0, policy_version 1657666 (0.0007) [2023-12-28 07:10:29,127][106225] Updated weights for policy 1, policy_version 1661535 (0.0007) [2023-12-28 07:10:29,170][106226] Updated weights for policy 0, policy_version 1657676 (0.0006) [2023-12-28 07:10:29,235][106226] Updated weights for policy 0, policy_version 1657686 (0.0008) [2023-12-28 07:10:29,874][106225] Updated weights for policy 1, policy_version 1661545 (0.0007) [2023-12-28 07:10:29,935][106225] Updated weights for policy 1, policy_version 1661555 (0.0008) [2023-12-28 07:10:29,955][106226] Updated weights for policy 0, policy_version 1657696 (0.0007) [2023-12-28 07:10:30,001][106225] Updated weights for policy 1, policy_version 1661565 (0.0009) [2023-12-28 07:10:30,019][106226] Updated weights for policy 0, policy_version 1657706 (0.0005) [2023-12-28 07:10:30,059][106225] Updated weights for policy 1, policy_version 1661575 (0.0008) [2023-12-28 07:10:30,074][106226] Updated weights for policy 0, policy_version 1657716 (0.0005) [2023-12-28 07:10:30,709][106226] Updated weights for policy 0, policy_version 1657726 (0.0007) [2023-12-28 07:10:30,769][106226] Updated weights for policy 0, policy_version 1657736 (0.0005) [2023-12-28 07:10:30,810][106225] Updated weights for policy 1, policy_version 1661585 (0.0006) [2023-12-28 07:10:30,824][106226] Updated weights for policy 0, policy_version 1657746 (0.0005) [2023-12-28 07:10:30,856][106225] Updated weights for policy 1, policy_version 1661595 (0.0005) [2023-12-28 07:10:30,900][106225] Updated weights for policy 1, policy_version 1661605 (0.0005) [2023-12-28 07:10:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 849887232. Throughput: 0: 9707.8, 1: 10071.3. Samples: 849875132. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:31,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.819')] [2023-12-28 07:10:31,441][106226] Updated weights for policy 0, policy_version 1657756 (0.0006) [2023-12-28 07:10:31,500][106226] Updated weights for policy 0, policy_version 1657766 (0.0009) [2023-12-28 07:10:31,563][106226] Updated weights for policy 0, policy_version 1657776 (0.0009) [2023-12-28 07:10:31,570][106225] Updated weights for policy 1, policy_version 1661615 (0.0006) [2023-12-28 07:10:31,630][106225] Updated weights for policy 1, policy_version 1661625 (0.0007) [2023-12-28 07:10:31,692][106225] Updated weights for policy 1, policy_version 1661635 (0.0008) [2023-12-28 07:10:32,332][106226] Updated weights for policy 0, policy_version 1657786 (0.0008) [2023-12-28 07:10:32,396][106226] Updated weights for policy 0, policy_version 1657796 (0.0009) [2023-12-28 07:10:32,447][106226] Updated weights for policy 0, policy_version 1657806 (0.0008) [2023-12-28 07:10:32,464][106225] Updated weights for policy 1, policy_version 1661645 (0.0007) [2023-12-28 07:10:32,500][106226] Updated weights for policy 0, policy_version 1657816 (0.0006) [2023-12-28 07:10:32,521][106225] Updated weights for policy 1, policy_version 1661655 (0.0005) [2023-12-28 07:10:32,581][106225] Updated weights for policy 1, policy_version 1661665 (0.0006) [2023-12-28 07:10:33,212][106226] Updated weights for policy 0, policy_version 1657826 (0.0009) [2023-12-28 07:10:33,259][106226] Updated weights for policy 0, policy_version 1657836 (0.0007) [2023-12-28 07:10:33,286][106225] Updated weights for policy 1, policy_version 1661675 (0.0008) [2023-12-28 07:10:33,309][106226] Updated weights for policy 0, policy_version 1657846 (0.0007) [2023-12-28 07:10:33,356][106225] Updated weights for policy 1, policy_version 1661685 (0.0009) [2023-12-28 07:10:33,421][106225] Updated weights for policy 1, policy_version 1661695 (0.0010) [2023-12-28 07:10:33,939][106226] Updated weights for policy 0, policy_version 1657856 (0.0005) [2023-12-28 07:10:33,993][106226] Updated weights for policy 0, policy_version 1657866 (0.0005) [2023-12-28 07:10:34,054][106226] Updated weights for policy 0, policy_version 1657876 (0.0006) [2023-12-28 07:10:34,098][106225] Updated weights for policy 1, policy_version 1661705 (0.0009) [2023-12-28 07:10:34,159][106225] Updated weights for policy 1, policy_version 1661715 (0.0010) [2023-12-28 07:10:34,225][106225] Updated weights for policy 1, policy_version 1661725 (0.0007) [2023-12-28 07:10:34,285][106225] Updated weights for policy 1, policy_version 1661735 (0.0005) [2023-12-28 07:10:34,656][106226] Updated weights for policy 0, policy_version 1657886 (0.0009) [2023-12-28 07:10:34,712][106226] Updated weights for policy 0, policy_version 1657896 (0.0009) [2023-12-28 07:10:34,763][106226] Updated weights for policy 0, policy_version 1657906 (0.0010) [2023-12-28 07:10:34,949][106225] Updated weights for policy 1, policy_version 1661745 (0.0006) [2023-12-28 07:10:35,006][106225] Updated weights for policy 1, policy_version 1661755 (0.0005) [2023-12-28 07:10:35,063][106225] Updated weights for policy 1, policy_version 1661765 (0.0005) [2023-12-28 07:10:35,383][106226] Updated weights for policy 0, policy_version 1657916 (0.0009) [2023-12-28 07:10:35,447][106226] Updated weights for policy 0, policy_version 1657926 (0.0009) [2023-12-28 07:10:35,507][106226] Updated weights for policy 0, policy_version 1657936 (0.0010) [2023-12-28 07:10:35,652][106225] Updated weights for policy 1, policy_version 1661775 (0.0005) [2023-12-28 07:10:35,701][106225] Updated weights for policy 1, policy_version 1661785 (0.0007) [2023-12-28 07:10:35,746][106225] Updated weights for policy 1, policy_version 1661795 (0.0010) [2023-12-28 07:10:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 849985536. Throughput: 0: 9799.8, 1: 10103.2. Samples: 849998456. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:36,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.607')] [2023-12-28 07:10:36,220][106226] Updated weights for policy 0, policy_version 1657946 (0.0010) [2023-12-28 07:10:36,288][106226] Updated weights for policy 0, policy_version 1657956 (0.0009) [2023-12-28 07:10:36,353][106225] Updated weights for policy 1, policy_version 1661805 (0.0008) [2023-12-28 07:10:36,353][106226] Updated weights for policy 0, policy_version 1657966 (0.0009) [2023-12-28 07:10:36,415][106226] Updated weights for policy 0, policy_version 1657976 (0.0008) [2023-12-28 07:10:36,424][106225] Updated weights for policy 1, policy_version 1661815 (0.0009) [2023-12-28 07:10:36,491][106225] Updated weights for policy 1, policy_version 1661825 (0.0011) [2023-12-28 07:10:37,056][106226] Updated weights for policy 0, policy_version 1657986 (0.0008) [2023-12-28 07:10:37,119][106226] Updated weights for policy 0, policy_version 1657996 (0.0008) [2023-12-28 07:10:37,181][106226] Updated weights for policy 0, policy_version 1658006 (0.0008) [2023-12-28 07:10:37,182][106225] Updated weights for policy 1, policy_version 1661835 (0.0011) [2023-12-28 07:10:37,243][106225] Updated weights for policy 1, policy_version 1661845 (0.0010) [2023-12-28 07:10:37,306][106225] Updated weights for policy 1, policy_version 1661855 (0.0011) [2023-12-28 07:10:37,771][106226] Updated weights for policy 0, policy_version 1658016 (0.0010) [2023-12-28 07:10:37,828][106226] Updated weights for policy 0, policy_version 1658026 (0.0010) [2023-12-28 07:10:37,881][106226] Updated weights for policy 0, policy_version 1658036 (0.0010) [2023-12-28 07:10:37,999][106225] Updated weights for policy 1, policy_version 1661865 (0.0011) [2023-12-28 07:10:38,056][106225] Updated weights for policy 1, policy_version 1661875 (0.0010) [2023-12-28 07:10:38,103][106225] Updated weights for policy 1, policy_version 1661885 (0.0010) [2023-12-28 07:10:38,150][106225] Updated weights for policy 1, policy_version 1661895 (0.0010) [2023-12-28 07:10:38,534][106226] Updated weights for policy 0, policy_version 1658046 (0.0009) [2023-12-28 07:10:38,601][106226] Updated weights for policy 0, policy_version 1658056 (0.0006) [2023-12-28 07:10:38,658][106226] Updated weights for policy 0, policy_version 1658066 (0.0005) [2023-12-28 07:10:38,920][106225] Updated weights for policy 1, policy_version 1661905 (0.0010) [2023-12-28 07:10:38,976][106225] Updated weights for policy 1, policy_version 1661915 (0.0010) [2023-12-28 07:10:39,028][106225] Updated weights for policy 1, policy_version 1661925 (0.0009) [2023-12-28 07:10:39,268][106226] Updated weights for policy 0, policy_version 1658076 (0.0007) [2023-12-28 07:10:39,327][106226] Updated weights for policy 0, policy_version 1658086 (0.0009) [2023-12-28 07:10:39,400][106226] Updated weights for policy 0, policy_version 1658096 (0.0009) [2023-12-28 07:10:39,778][106225] Updated weights for policy 1, policy_version 1661935 (0.0006) [2023-12-28 07:10:39,846][106225] Updated weights for policy 1, policy_version 1661945 (0.0008) [2023-12-28 07:10:39,914][106225] Updated weights for policy 1, policy_version 1661955 (0.0010) [2023-12-28 07:10:40,179][106226] Updated weights for policy 0, policy_version 1658106 (0.0010) [2023-12-28 07:10:40,249][106226] Updated weights for policy 0, policy_version 1658116 (0.0011) [2023-12-28 07:10:40,311][106226] Updated weights for policy 0, policy_version 1658126 (0.0011) [2023-12-28 07:10:40,376][106226] Updated weights for policy 0, policy_version 1658136 (0.0011) [2023-12-28 07:10:40,648][106225] Updated weights for policy 1, policy_version 1661965 (0.0008) [2023-12-28 07:10:40,707][106225] Updated weights for policy 1, policy_version 1661975 (0.0006) [2023-12-28 07:10:40,770][106225] Updated weights for policy 1, policy_version 1661985 (0.0005) [2023-12-28 07:10:41,095][106226] Updated weights for policy 0, policy_version 1658146 (0.0009) [2023-12-28 07:10:41,157][106226] Updated weights for policy 0, policy_version 1658156 (0.0009) [2023-12-28 07:10:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 850083840. Throughput: 0: 9850.9, 1: 10148.9. Samples: 850060348. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:41,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.728')] [2023-12-28 07:10:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001661992_425525248.pth... [2023-12-28 07:10:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001660808_425222144.pth [2023-12-28 07:10:41,222][106226] Updated weights for policy 0, policy_version 1658166 (0.0006) [2023-12-28 07:10:41,234][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001658168_424566784.pth... [2023-12-28 07:10:41,238][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001657016_424271872.pth [2023-12-28 07:10:41,487][106225] Updated weights for policy 1, policy_version 1661995 (0.0007) [2023-12-28 07:10:41,549][106225] Updated weights for policy 1, policy_version 1662005 (0.0009) [2023-12-28 07:10:41,615][106225] Updated weights for policy 1, policy_version 1662015 (0.0008) [2023-12-28 07:10:41,977][106226] Updated weights for policy 0, policy_version 1658176 (0.0009) [2023-12-28 07:10:42,040][106226] Updated weights for policy 0, policy_version 1658186 (0.0009) [2023-12-28 07:10:42,096][106226] Updated weights for policy 0, policy_version 1658196 (0.0008) [2023-12-28 07:10:42,358][106225] Updated weights for policy 1, policy_version 1662025 (0.0008) [2023-12-28 07:10:42,419][106225] Updated weights for policy 1, policy_version 1662035 (0.0008) [2023-12-28 07:10:42,470][106225] Updated weights for policy 1, policy_version 1662045 (0.0008) [2023-12-28 07:10:42,522][106225] Updated weights for policy 1, policy_version 1662055 (0.0007) [2023-12-28 07:10:42,841][106226] Updated weights for policy 0, policy_version 1658206 (0.0008) [2023-12-28 07:10:42,895][106226] Updated weights for policy 0, policy_version 1658216 (0.0008) [2023-12-28 07:10:42,956][106226] Updated weights for policy 0, policy_version 1658226 (0.0008) [2023-12-28 07:10:43,281][106225] Updated weights for policy 1, policy_version 1662065 (0.0010) [2023-12-28 07:10:43,340][106225] Updated weights for policy 1, policy_version 1662075 (0.0010) [2023-12-28 07:10:43,400][106225] Updated weights for policy 1, policy_version 1662085 (0.0010) [2023-12-28 07:10:43,683][106226] Updated weights for policy 0, policy_version 1658236 (0.0007) [2023-12-28 07:10:43,749][106226] Updated weights for policy 0, policy_version 1658246 (0.0005) [2023-12-28 07:10:43,812][106226] Updated weights for policy 0, policy_version 1658256 (0.0005) [2023-12-28 07:10:44,145][106225] Updated weights for policy 1, policy_version 1662095 (0.0009) [2023-12-28 07:10:44,200][106225] Updated weights for policy 1, policy_version 1662105 (0.0009) [2023-12-28 07:10:44,257][106225] Updated weights for policy 1, policy_version 1662115 (0.0008) [2023-12-28 07:10:44,325][106226] Updated weights for policy 0, policy_version 1658266 (0.0005) [2023-12-28 07:10:44,384][106226] Updated weights for policy 0, policy_version 1658276 (0.0005) [2023-12-28 07:10:44,442][106226] Updated weights for policy 0, policy_version 1658286 (0.0007) [2023-12-28 07:10:44,505][106226] Updated weights for policy 0, policy_version 1658296 (0.0008) [2023-12-28 07:10:44,958][106225] Updated weights for policy 1, policy_version 1662125 (0.0008) [2023-12-28 07:10:45,026][106225] Updated weights for policy 1, policy_version 1662135 (0.0008) [2023-12-28 07:10:45,089][106225] Updated weights for policy 1, policy_version 1662145 (0.0008) [2023-12-28 07:10:45,246][106226] Updated weights for policy 0, policy_version 1658306 (0.0006) [2023-12-28 07:10:45,315][106226] Updated weights for policy 0, policy_version 1658316 (0.0007) [2023-12-28 07:10:45,379][106226] Updated weights for policy 0, policy_version 1658326 (0.0009) [2023-12-28 07:10:45,749][106225] Updated weights for policy 1, policy_version 1662155 (0.0008) [2023-12-28 07:10:45,813][106225] Updated weights for policy 1, policy_version 1662165 (0.0006) [2023-12-28 07:10:45,864][106225] Updated weights for policy 1, policy_version 1662175 (0.0006) [2023-12-28 07:10:46,091][106226] Updated weights for policy 0, policy_version 1658336 (0.0008) [2023-12-28 07:10:46,152][106226] Updated weights for policy 0, policy_version 1658346 (0.0007) [2023-12-28 07:10:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 850182144. Throughput: 0: 9882.8, 1: 10063.6. Samples: 850175504. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:46,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.586')] [2023-12-28 07:10:46,217][106226] Updated weights for policy 0, policy_version 1658356 (0.0008) [2023-12-28 07:10:46,561][106225] Updated weights for policy 1, policy_version 1662185 (0.0005) [2023-12-28 07:10:46,626][106225] Updated weights for policy 1, policy_version 1662195 (0.0005) [2023-12-28 07:10:46,688][106225] Updated weights for policy 1, policy_version 1662205 (0.0005) [2023-12-28 07:10:46,743][106225] Updated weights for policy 1, policy_version 1662215 (0.0005) [2023-12-28 07:10:46,903][106226] Updated weights for policy 0, policy_version 1658366 (0.0008) [2023-12-28 07:10:46,954][106226] Updated weights for policy 0, policy_version 1658376 (0.0009) [2023-12-28 07:10:47,003][106226] Updated weights for policy 0, policy_version 1658386 (0.0008) [2023-12-28 07:10:47,337][106225] Updated weights for policy 1, policy_version 1662225 (0.0009) [2023-12-28 07:10:47,387][106225] Updated weights for policy 1, policy_version 1662235 (0.0008) [2023-12-28 07:10:47,440][106225] Updated weights for policy 1, policy_version 1662245 (0.0007) [2023-12-28 07:10:47,685][106226] Updated weights for policy 0, policy_version 1658396 (0.0006) [2023-12-28 07:10:47,739][106226] Updated weights for policy 0, policy_version 1658406 (0.0006) [2023-12-28 07:10:47,794][106226] Updated weights for policy 0, policy_version 1658416 (0.0005) [2023-12-28 07:10:48,194][106225] Updated weights for policy 1, policy_version 1662255 (0.0006) [2023-12-28 07:10:48,251][106225] Updated weights for policy 1, policy_version 1662265 (0.0005) [2023-12-28 07:10:48,308][106225] Updated weights for policy 1, policy_version 1662275 (0.0005) [2023-12-28 07:10:48,420][106226] Updated weights for policy 0, policy_version 1658426 (0.0009) [2023-12-28 07:10:48,468][106226] Updated weights for policy 0, policy_version 1658436 (0.0007) [2023-12-28 07:10:48,523][106226] Updated weights for policy 0, policy_version 1658446 (0.0008) [2023-12-28 07:10:48,571][106226] Updated weights for policy 0, policy_version 1658456 (0.0008) [2023-12-28 07:10:48,998][106225] Updated weights for policy 1, policy_version 1662285 (0.0009) [2023-12-28 07:10:49,065][106225] Updated weights for policy 1, policy_version 1662295 (0.0010) [2023-12-28 07:10:49,131][106225] Updated weights for policy 1, policy_version 1662305 (0.0006) [2023-12-28 07:10:49,265][106226] Updated weights for policy 0, policy_version 1658466 (0.0009) [2023-12-28 07:10:49,318][106226] Updated weights for policy 0, policy_version 1658476 (0.0009) [2023-12-28 07:10:49,383][106226] Updated weights for policy 0, policy_version 1658486 (0.0008) [2023-12-28 07:10:49,725][106225] Updated weights for policy 1, policy_version 1662315 (0.0007) [2023-12-28 07:10:49,796][106225] Updated weights for policy 1, policy_version 1662325 (0.0011) [2023-12-28 07:10:49,875][106225] Updated weights for policy 1, policy_version 1662335 (0.0009) [2023-12-28 07:10:50,091][106226] Updated weights for policy 0, policy_version 1658496 (0.0007) [2023-12-28 07:10:50,156][106226] Updated weights for policy 0, policy_version 1658506 (0.0008) [2023-12-28 07:10:50,213][106226] Updated weights for policy 0, policy_version 1658516 (0.0006) [2023-12-28 07:10:50,527][106225] Updated weights for policy 1, policy_version 1662345 (0.0011) [2023-12-28 07:10:50,592][106225] Updated weights for policy 1, policy_version 1662355 (0.0010) [2023-12-28 07:10:50,656][106225] Updated weights for policy 1, policy_version 1662365 (0.0010) [2023-12-28 07:10:50,709][106225] Updated weights for policy 1, policy_version 1662375 (0.0010) [2023-12-28 07:10:50,834][106226] Updated weights for policy 0, policy_version 1658526 (0.0009) [2023-12-28 07:10:50,888][106226] Updated weights for policy 0, policy_version 1658536 (0.0010) [2023-12-28 07:10:50,936][106226] Updated weights for policy 0, policy_version 1658546 (0.0005) [2023-12-28 07:10:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 850288640. Throughput: 0: 9882.8, 1: 10066.4. Samples: 850297284. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:51,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.393')] [2023-12-28 07:10:51,446][106225] Updated weights for policy 1, policy_version 1662385 (0.0008) [2023-12-28 07:10:51,504][106225] Updated weights for policy 1, policy_version 1662395 (0.0008) [2023-12-28 07:10:51,570][106225] Updated weights for policy 1, policy_version 1662405 (0.0006) [2023-12-28 07:10:51,678][106226] Updated weights for policy 0, policy_version 1658556 (0.0007) [2023-12-28 07:10:51,761][106226] Updated weights for policy 0, policy_version 1658566 (0.0009) [2023-12-28 07:10:51,824][106226] Updated weights for policy 0, policy_version 1658576 (0.0009) [2023-12-28 07:10:52,242][106225] Updated weights for policy 1, policy_version 1662415 (0.0006) [2023-12-28 07:10:52,308][106225] Updated weights for policy 1, policy_version 1662425 (0.0008) [2023-12-28 07:10:52,386][106225] Updated weights for policy 1, policy_version 1662435 (0.0009) [2023-12-28 07:10:52,592][106226] Updated weights for policy 0, policy_version 1658586 (0.0009) [2023-12-28 07:10:52,643][106226] Updated weights for policy 0, policy_version 1658596 (0.0008) [2023-12-28 07:10:52,703][106226] Updated weights for policy 0, policy_version 1658606 (0.0009) [2023-12-28 07:10:52,767][106226] Updated weights for policy 0, policy_version 1658616 (0.0009) [2023-12-28 07:10:53,050][106225] Updated weights for policy 1, policy_version 1662445 (0.0009) [2023-12-28 07:10:53,101][106225] Updated weights for policy 1, policy_version 1662455 (0.0008) [2023-12-28 07:10:53,153][106225] Updated weights for policy 1, policy_version 1662465 (0.0009) [2023-12-28 07:10:53,479][106226] Updated weights for policy 0, policy_version 1658626 (0.0006) [2023-12-28 07:10:53,531][106226] Updated weights for policy 0, policy_version 1658636 (0.0009) [2023-12-28 07:10:53,587][106226] Updated weights for policy 0, policy_version 1658646 (0.0009) [2023-12-28 07:10:53,902][106225] Updated weights for policy 1, policy_version 1662475 (0.0008) [2023-12-28 07:10:53,950][106225] Updated weights for policy 1, policy_version 1662485 (0.0008) [2023-12-28 07:10:53,998][106225] Updated weights for policy 1, policy_version 1662495 (0.0009) [2023-12-28 07:10:54,300][106226] Updated weights for policy 0, policy_version 1658656 (0.0009) [2023-12-28 07:10:54,356][106226] Updated weights for policy 0, policy_version 1658666 (0.0008) [2023-12-28 07:10:54,418][106226] Updated weights for policy 0, policy_version 1658676 (0.0008) [2023-12-28 07:10:54,689][106225] Updated weights for policy 1, policy_version 1662505 (0.0008) [2023-12-28 07:10:54,745][106225] Updated weights for policy 1, policy_version 1662515 (0.0006) [2023-12-28 07:10:54,802][106225] Updated weights for policy 1, policy_version 1662525 (0.0008) [2023-12-28 07:10:54,862][106225] Updated weights for policy 1, policy_version 1662535 (0.0006) [2023-12-28 07:10:55,189][106226] Updated weights for policy 0, policy_version 1658686 (0.0009) [2023-12-28 07:10:55,245][106226] Updated weights for policy 0, policy_version 1658696 (0.0008) [2023-12-28 07:10:55,300][106226] Updated weights for policy 0, policy_version 1658706 (0.0009) [2023-12-28 07:10:55,477][106225] Updated weights for policy 1, policy_version 1662545 (0.0008) [2023-12-28 07:10:55,529][106225] Updated weights for policy 1, policy_version 1662555 (0.0008) [2023-12-28 07:10:55,588][106225] Updated weights for policy 1, policy_version 1662565 (0.0008) [2023-12-28 07:10:56,025][106226] Updated weights for policy 0, policy_version 1658716 (0.0009) [2023-12-28 07:10:56,084][106226] Updated weights for policy 0, policy_version 1658726 (0.0008) [2023-12-28 07:10:56,146][106226] Updated weights for policy 0, policy_version 1658736 (0.0008) [2023-12-28 07:10:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 850378752. Throughput: 0: 9796.4, 1: 10075.7. Samples: 850354524. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:10:56,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.882')] [2023-12-28 07:10:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001662568_425672704.pth... [2023-12-28 07:10:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001661416_425377792.pth [2023-12-28 07:10:56,197][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001658744_424714240.pth... [2023-12-28 07:10:56,200][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001657560_424411136.pth [2023-12-28 07:10:56,318][106225] Updated weights for policy 1, policy_version 1662575 (0.0009) [2023-12-28 07:10:56,372][106225] Updated weights for policy 1, policy_version 1662585 (0.0009) [2023-12-28 07:10:56,433][106225] Updated weights for policy 1, policy_version 1662595 (0.0009) [2023-12-28 07:10:56,823][106226] Updated weights for policy 0, policy_version 1658746 (0.0009) [2023-12-28 07:10:56,872][106226] Updated weights for policy 0, policy_version 1658756 (0.0009) [2023-12-28 07:10:56,937][106226] Updated weights for policy 0, policy_version 1658766 (0.0009) [2023-12-28 07:10:56,986][106226] Updated weights for policy 0, policy_version 1658776 (0.0009) [2023-12-28 07:10:57,042][106225] Updated weights for policy 1, policy_version 1662605 (0.0007) [2023-12-28 07:10:57,101][106225] Updated weights for policy 1, policy_version 1662615 (0.0005) [2023-12-28 07:10:57,160][106225] Updated weights for policy 1, policy_version 1662625 (0.0005) [2023-12-28 07:10:57,774][106226] Updated weights for policy 0, policy_version 1658786 (0.0008) [2023-12-28 07:10:57,775][106225] Updated weights for policy 1, policy_version 1662635 (0.0007) [2023-12-28 07:10:57,819][106225] Updated weights for policy 1, policy_version 1662645 (0.0006) [2023-12-28 07:10:57,829][106226] Updated weights for policy 0, policy_version 1658796 (0.0006) [2023-12-28 07:10:57,880][106225] Updated weights for policy 1, policy_version 1662655 (0.0007) [2023-12-28 07:10:57,898][106226] Updated weights for policy 0, policy_version 1658806 (0.0008) [2023-12-28 07:10:58,678][106226] Updated weights for policy 0, policy_version 1658816 (0.0008) [2023-12-28 07:10:58,681][106225] Updated weights for policy 1, policy_version 1662665 (0.0008) [2023-12-28 07:10:58,741][106226] Updated weights for policy 0, policy_version 1658826 (0.0010) [2023-12-28 07:10:58,744][106225] Updated weights for policy 1, policy_version 1662675 (0.0007) [2023-12-28 07:10:58,805][106226] Updated weights for policy 0, policy_version 1658836 (0.0011) [2023-12-28 07:10:58,813][106225] Updated weights for policy 1, policy_version 1662685 (0.0008) [2023-12-28 07:10:58,879][106225] Updated weights for policy 1, policy_version 1662695 (0.0008) [2023-12-28 07:10:59,523][106226] Updated weights for policy 0, policy_version 1658846 (0.0007) [2023-12-28 07:10:59,574][106226] Updated weights for policy 0, policy_version 1658856 (0.0005) [2023-12-28 07:10:59,625][106226] Updated weights for policy 0, policy_version 1658866 (0.0006) [2023-12-28 07:10:59,668][106225] Updated weights for policy 1, policy_version 1662705 (0.0008) [2023-12-28 07:10:59,725][106225] Updated weights for policy 1, policy_version 1662716 (0.0009) [2023-12-28 07:10:59,779][106225] Updated weights for policy 1, policy_version 1662726 (0.0008) [2023-12-28 07:11:00,235][106226] Updated weights for policy 0, policy_version 1658876 (0.0006) [2023-12-28 07:11:00,297][106226] Updated weights for policy 0, policy_version 1658886 (0.0006) [2023-12-28 07:11:00,352][106226] Updated weights for policy 0, policy_version 1658896 (0.0005) [2023-12-28 07:11:00,594][106225] Updated weights for policy 1, policy_version 1662736 (0.0007) [2023-12-28 07:11:00,656][106225] Updated weights for policy 1, policy_version 1662746 (0.0008) [2023-12-28 07:11:00,723][106225] Updated weights for policy 1, policy_version 1662756 (0.0009) [2023-12-28 07:11:00,929][106226] Updated weights for policy 0, policy_version 1658906 (0.0008) [2023-12-28 07:11:00,990][106226] Updated weights for policy 0, policy_version 1658916 (0.0008) [2023-12-28 07:11:01,054][106226] Updated weights for policy 0, policy_version 1658926 (0.0009) [2023-12-28 07:11:01,118][106226] Updated weights for policy 0, policy_version 1658936 (0.0007) [2023-12-28 07:11:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 850485248. Throughput: 0: 9764.9, 1: 10122.2. Samples: 850471904. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:01,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.733')] [2023-12-28 07:11:01,411][106225] Updated weights for policy 1, policy_version 1662766 (0.0009) [2023-12-28 07:11:01,471][106225] Updated weights for policy 1, policy_version 1662776 (0.0007) [2023-12-28 07:11:01,540][106225] Updated weights for policy 1, policy_version 1662786 (0.0008) [2023-12-28 07:11:01,796][106226] Updated weights for policy 0, policy_version 1658946 (0.0008) [2023-12-28 07:11:01,844][106226] Updated weights for policy 0, policy_version 1658956 (0.0009) [2023-12-28 07:11:01,894][106226] Updated weights for policy 0, policy_version 1658966 (0.0009) [2023-12-28 07:11:02,195][106225] Updated weights for policy 1, policy_version 1662796 (0.0008) [2023-12-28 07:11:02,251][106225] Updated weights for policy 1, policy_version 1662806 (0.0008) [2023-12-28 07:11:02,314][106225] Updated weights for policy 1, policy_version 1662816 (0.0008) [2023-12-28 07:11:02,641][106226] Updated weights for policy 0, policy_version 1658976 (0.0008) [2023-12-28 07:11:02,700][106226] Updated weights for policy 0, policy_version 1658986 (0.0006) [2023-12-28 07:11:02,755][106226] Updated weights for policy 0, policy_version 1658996 (0.0005) [2023-12-28 07:11:03,092][106225] Updated weights for policy 1, policy_version 1662826 (0.0008) [2023-12-28 07:11:03,151][106225] Updated weights for policy 1, policy_version 1662836 (0.0005) [2023-12-28 07:11:03,212][106225] Updated weights for policy 1, policy_version 1662846 (0.0007) [2023-12-28 07:11:03,270][106225] Updated weights for policy 1, policy_version 1662856 (0.0008) [2023-12-28 07:11:03,402][106226] Updated weights for policy 0, policy_version 1659006 (0.0007) [2023-12-28 07:11:03,454][106226] Updated weights for policy 0, policy_version 1659016 (0.0009) [2023-12-28 07:11:03,506][106226] Updated weights for policy 0, policy_version 1659026 (0.0009) [2023-12-28 07:11:03,957][106225] Updated weights for policy 1, policy_version 1662866 (0.0008) [2023-12-28 07:11:04,014][106225] Updated weights for policy 1, policy_version 1662876 (0.0008) [2023-12-28 07:11:04,074][106225] Updated weights for policy 1, policy_version 1662886 (0.0008) [2023-12-28 07:11:04,246][106226] Updated weights for policy 0, policy_version 1659036 (0.0008) [2023-12-28 07:11:04,313][106226] Updated weights for policy 0, policy_version 1659046 (0.0009) [2023-12-28 07:11:04,378][106226] Updated weights for policy 0, policy_version 1659056 (0.0008) [2023-12-28 07:11:04,823][106225] Updated weights for policy 1, policy_version 1662896 (0.0008) [2023-12-28 07:11:04,872][106225] Updated weights for policy 1, policy_version 1662906 (0.0007) [2023-12-28 07:11:04,927][106225] Updated weights for policy 1, policy_version 1662916 (0.0005) [2023-12-28 07:11:05,103][106226] Updated weights for policy 0, policy_version 1659066 (0.0008) [2023-12-28 07:11:05,166][106226] Updated weights for policy 0, policy_version 1659076 (0.0011) [2023-12-28 07:11:05,226][106226] Updated weights for policy 0, policy_version 1659086 (0.0011) [2023-12-28 07:11:05,288][106226] Updated weights for policy 0, policy_version 1659096 (0.0010) [2023-12-28 07:11:05,563][106225] Updated weights for policy 1, policy_version 1662926 (0.0007) [2023-12-28 07:11:05,623][106225] Updated weights for policy 1, policy_version 1662936 (0.0008) [2023-12-28 07:11:05,682][106225] Updated weights for policy 1, policy_version 1662946 (0.0008) [2023-12-28 07:11:05,974][106226] Updated weights for policy 0, policy_version 1659106 (0.0009) [2023-12-28 07:11:06,030][106226] Updated weights for policy 0, policy_version 1659116 (0.0008) [2023-12-28 07:11:06,089][106226] Updated weights for policy 0, policy_version 1659126 (0.0008) [2023-12-28 07:11:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 850583552. Throughput: 0: 9857.9, 1: 10014.0. Samples: 850590080. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:06,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.840')] [2023-12-28 07:11:06,404][106225] Updated weights for policy 1, policy_version 1662956 (0.0006) [2023-12-28 07:11:06,474][106225] Updated weights for policy 1, policy_version 1662966 (0.0006) [2023-12-28 07:11:06,533][106225] Updated weights for policy 1, policy_version 1662976 (0.0008) [2023-12-28 07:11:06,822][106226] Updated weights for policy 0, policy_version 1659136 (0.0010) [2023-12-28 07:11:06,883][106226] Updated weights for policy 0, policy_version 1659146 (0.0011) [2023-12-28 07:11:06,945][106226] Updated weights for policy 0, policy_version 1659156 (0.0011) [2023-12-28 07:11:07,220][106225] Updated weights for policy 1, policy_version 1662986 (0.0008) [2023-12-28 07:11:07,280][106225] Updated weights for policy 1, policy_version 1662996 (0.0009) [2023-12-28 07:11:07,334][106225] Updated weights for policy 1, policy_version 1663006 (0.0008) [2023-12-28 07:11:07,401][106225] Updated weights for policy 1, policy_version 1663016 (0.0008) [2023-12-28 07:11:07,612][106226] Updated weights for policy 0, policy_version 1659166 (0.0008) [2023-12-28 07:11:07,664][106226] Updated weights for policy 0, policy_version 1659176 (0.0005) [2023-12-28 07:11:07,719][106226] Updated weights for policy 0, policy_version 1659186 (0.0008) [2023-12-28 07:11:08,154][106225] Updated weights for policy 1, policy_version 1663026 (0.0008) [2023-12-28 07:11:08,208][106225] Updated weights for policy 1, policy_version 1663036 (0.0008) [2023-12-28 07:11:08,257][106225] Updated weights for policy 1, policy_version 1663046 (0.0008) [2023-12-28 07:11:08,404][106226] Updated weights for policy 0, policy_version 1659196 (0.0007) [2023-12-28 07:11:08,468][106226] Updated weights for policy 0, policy_version 1659206 (0.0009) [2023-12-28 07:11:08,522][106226] Updated weights for policy 0, policy_version 1659216 (0.0006) [2023-12-28 07:11:09,083][106225] Updated weights for policy 1, policy_version 1663056 (0.0008) [2023-12-28 07:11:09,143][106225] Updated weights for policy 1, policy_version 1663066 (0.0006) [2023-12-28 07:11:09,197][106225] Updated weights for policy 1, policy_version 1663076 (0.0005) [2023-12-28 07:11:09,210][106226] Updated weights for policy 0, policy_version 1659226 (0.0007) [2023-12-28 07:11:09,277][106226] Updated weights for policy 0, policy_version 1659236 (0.0009) [2023-12-28 07:11:09,334][106226] Updated weights for policy 0, policy_version 1659247 (0.0009) [2023-12-28 07:11:09,933][106225] Updated weights for policy 1, policy_version 1663086 (0.0008) [2023-12-28 07:11:09,997][106225] Updated weights for policy 1, policy_version 1663096 (0.0008) [2023-12-28 07:11:10,062][106225] Updated weights for policy 1, policy_version 1663106 (0.0009) [2023-12-28 07:11:10,117][106226] Updated weights for policy 0, policy_version 1659257 (0.0008) [2023-12-28 07:11:10,188][106226] Updated weights for policy 0, policy_version 1659267 (0.0007) [2023-12-28 07:11:10,250][106226] Updated weights for policy 0, policy_version 1659277 (0.0008) [2023-12-28 07:11:10,303][106226] Updated weights for policy 0, policy_version 1659287 (0.0009) [2023-12-28 07:11:10,811][106225] Updated weights for policy 1, policy_version 1663116 (0.0008) [2023-12-28 07:11:10,867][106225] Updated weights for policy 1, policy_version 1663126 (0.0008) [2023-12-28 07:11:10,932][106225] Updated weights for policy 1, policy_version 1663136 (0.0008) [2023-12-28 07:11:11,003][106226] Updated weights for policy 0, policy_version 1659297 (0.0006) [2023-12-28 07:11:11,088][106226] Updated weights for policy 0, policy_version 1659307 (0.0008) [2023-12-28 07:11:11,152][106226] Updated weights for policy 0, policy_version 1659317 (0.0008) [2023-12-28 07:11:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 850673664. Throughput: 0: 9901.1, 1: 9987.3. Samples: 850648584. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:11,175][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.639')] [2023-12-28 07:11:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001659320_424861696.pth... [2023-12-28 07:11:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001663144_425820160.pth... [2023-12-28 07:11:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001658168_424566784.pth [2023-12-28 07:11:11,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001661992_425525248.pth [2023-12-28 07:11:11,742][106225] Updated weights for policy 1, policy_version 1663146 (0.0009) [2023-12-28 07:11:11,796][106225] Updated weights for policy 1, policy_version 1663156 (0.0008) [2023-12-28 07:11:11,855][106225] Updated weights for policy 1, policy_version 1663166 (0.0008) [2023-12-28 07:11:11,919][106225] Updated weights for policy 1, policy_version 1663176 (0.0008) [2023-12-28 07:11:11,967][106226] Updated weights for policy 0, policy_version 1659327 (0.0009) [2023-12-28 07:11:12,037][106226] Updated weights for policy 0, policy_version 1659337 (0.0009) [2023-12-28 07:11:12,102][106226] Updated weights for policy 0, policy_version 1659347 (0.0008) [2023-12-28 07:11:12,655][106225] Updated weights for policy 1, policy_version 1663186 (0.0009) [2023-12-28 07:11:12,716][106225] Updated weights for policy 1, policy_version 1663196 (0.0009) [2023-12-28 07:11:12,770][106225] Updated weights for policy 1, policy_version 1663206 (0.0008) [2023-12-28 07:11:12,779][106226] Updated weights for policy 0, policy_version 1659357 (0.0009) [2023-12-28 07:11:12,840][106226] Updated weights for policy 0, policy_version 1659367 (0.0008) [2023-12-28 07:11:12,900][106226] Updated weights for policy 0, policy_version 1659377 (0.0009) [2023-12-28 07:11:13,493][106225] Updated weights for policy 1, policy_version 1663216 (0.0006) [2023-12-28 07:11:13,561][106225] Updated weights for policy 1, policy_version 1663226 (0.0008) [2023-12-28 07:11:13,598][106226] Updated weights for policy 0, policy_version 1659387 (0.0009) [2023-12-28 07:11:13,618][106225] Updated weights for policy 1, policy_version 1663236 (0.0010) [2023-12-28 07:11:13,649][106226] Updated weights for policy 0, policy_version 1659397 (0.0010) [2023-12-28 07:11:13,695][106226] Updated weights for policy 0, policy_version 1659407 (0.0007) [2023-12-28 07:11:14,276][106225] Updated weights for policy 1, policy_version 1663246 (0.0010) [2023-12-28 07:11:14,295][106226] Updated weights for policy 0, policy_version 1659417 (0.0006) [2023-12-28 07:11:14,332][106225] Updated weights for policy 1, policy_version 1663256 (0.0010) [2023-12-28 07:11:14,348][106226] Updated weights for policy 0, policy_version 1659427 (0.0010) [2023-12-28 07:11:14,383][106225] Updated weights for policy 1, policy_version 1663266 (0.0010) [2023-12-28 07:11:14,396][106226] Updated weights for policy 0, policy_version 1659437 (0.0008) [2023-12-28 07:11:14,453][106226] Updated weights for policy 0, policy_version 1659447 (0.0005) [2023-12-28 07:11:15,084][106226] Updated weights for policy 0, policy_version 1659457 (0.0008) [2023-12-28 07:11:15,139][106225] Updated weights for policy 1, policy_version 1663276 (0.0010) [2023-12-28 07:11:15,146][106226] Updated weights for policy 0, policy_version 1659467 (0.0006) [2023-12-28 07:11:15,202][106225] Updated weights for policy 1, policy_version 1663286 (0.0010) [2023-12-28 07:11:15,216][106226] Updated weights for policy 0, policy_version 1659477 (0.0007) [2023-12-28 07:11:15,266][106225] Updated weights for policy 1, policy_version 1663296 (0.0011) [2023-12-28 07:11:15,887][106226] Updated weights for policy 0, policy_version 1659487 (0.0007) [2023-12-28 07:11:15,953][106226] Updated weights for policy 0, policy_version 1659497 (0.0008) [2023-12-28 07:11:15,993][106225] Updated weights for policy 1, policy_version 1663306 (0.0010) [2023-12-28 07:11:16,010][106226] Updated weights for policy 0, policy_version 1659507 (0.0007) [2023-12-28 07:11:16,050][106225] Updated weights for policy 1, policy_version 1663316 (0.0010) [2023-12-28 07:11:16,108][106225] Updated weights for policy 1, policy_version 1663326 (0.0010) [2023-12-28 07:11:16,167][106225] Updated weights for policy 1, policy_version 1663336 (0.0010) [2023-12-28 07:11:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 850780160. Throughput: 0: 9962.0, 1: 9785.3. Samples: 850763764. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:16,176][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.905')] [2023-12-28 07:11:16,585][106226] Updated weights for policy 0, policy_version 1659517 (0.0006) [2023-12-28 07:11:16,648][106226] Updated weights for policy 0, policy_version 1659527 (0.0006) [2023-12-28 07:11:16,708][106226] Updated weights for policy 0, policy_version 1659537 (0.0008) [2023-12-28 07:11:16,818][106225] Updated weights for policy 1, policy_version 1663346 (0.0010) [2023-12-28 07:11:16,871][106225] Updated weights for policy 1, policy_version 1663356 (0.0010) [2023-12-28 07:11:16,934][106225] Updated weights for policy 1, policy_version 1663366 (0.0010) [2023-12-28 07:11:17,266][106226] Updated weights for policy 0, policy_version 1659548 (0.0007) [2023-12-28 07:11:17,330][106226] Updated weights for policy 0, policy_version 1659558 (0.0005) [2023-12-28 07:11:17,386][106226] Updated weights for policy 0, policy_version 1659568 (0.0005) [2023-12-28 07:11:17,480][106225] Updated weights for policy 1, policy_version 1663376 (0.0005) [2023-12-28 07:11:17,537][106225] Updated weights for policy 1, policy_version 1663386 (0.0007) [2023-12-28 07:11:17,597][106225] Updated weights for policy 1, policy_version 1663396 (0.0010) [2023-12-28 07:11:17,937][106226] Updated weights for policy 0, policy_version 1659578 (0.0005) [2023-12-28 07:11:17,986][106226] Updated weights for policy 0, policy_version 1659588 (0.0005) [2023-12-28 07:11:18,037][106226] Updated weights for policy 0, policy_version 1659598 (0.0006) [2023-12-28 07:11:18,090][106226] Updated weights for policy 0, policy_version 1659608 (0.0005) [2023-12-28 07:11:18,298][106225] Updated weights for policy 1, policy_version 1663406 (0.0010) [2023-12-28 07:11:18,363][106225] Updated weights for policy 1, policy_version 1663416 (0.0011) [2023-12-28 07:11:18,425][106225] Updated weights for policy 1, policy_version 1663426 (0.0011) [2023-12-28 07:11:18,827][106226] Updated weights for policy 0, policy_version 1659618 (0.0011) [2023-12-28 07:11:18,889][106226] Updated weights for policy 0, policy_version 1659628 (0.0011) [2023-12-28 07:11:18,940][106226] Updated weights for policy 0, policy_version 1659638 (0.0011) [2023-12-28 07:11:19,143][106225] Updated weights for policy 1, policy_version 1663436 (0.0009) [2023-12-28 07:11:19,207][106225] Updated weights for policy 1, policy_version 1663446 (0.0007) [2023-12-28 07:11:19,282][106225] Updated weights for policy 1, policy_version 1663456 (0.0008) [2023-12-28 07:11:19,654][106226] Updated weights for policy 0, policy_version 1659648 (0.0011) [2023-12-28 07:11:19,723][106226] Updated weights for policy 0, policy_version 1659658 (0.0011) [2023-12-28 07:11:19,788][106226] Updated weights for policy 0, policy_version 1659668 (0.0011) [2023-12-28 07:11:19,922][106225] Updated weights for policy 1, policy_version 1663466 (0.0010) [2023-12-28 07:11:19,990][106225] Updated weights for policy 1, policy_version 1663476 (0.0008) [2023-12-28 07:11:20,052][106225] Updated weights for policy 1, policy_version 1663486 (0.0008) [2023-12-28 07:11:20,114][106225] Updated weights for policy 1, policy_version 1663496 (0.0008) [2023-12-28 07:11:20,511][106226] Updated weights for policy 0, policy_version 1659678 (0.0009) [2023-12-28 07:11:20,578][106226] Updated weights for policy 0, policy_version 1659688 (0.0009) [2023-12-28 07:11:20,640][106226] Updated weights for policy 0, policy_version 1659698 (0.0007) [2023-12-28 07:11:20,868][106225] Updated weights for policy 1, policy_version 1663506 (0.0007) [2023-12-28 07:11:20,931][106225] Updated weights for policy 1, policy_version 1663516 (0.0008) [2023-12-28 07:11:20,993][106225] Updated weights for policy 1, policy_version 1663526 (0.0008) [2023-12-28 07:11:21,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 850878464. Throughput: 0: 9947.0, 1: 9775.7. Samples: 850885980. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:21,175][105115] Avg episode reward: [(0, '-4.688'), (1, '-4.695')] [2023-12-28 07:11:21,412][106226] Updated weights for policy 0, policy_version 1659708 (0.0009) [2023-12-28 07:11:21,471][106226] Updated weights for policy 0, policy_version 1659718 (0.0009) [2023-12-28 07:11:21,535][106226] Updated weights for policy 0, policy_version 1659728 (0.0009) [2023-12-28 07:11:21,718][106225] Updated weights for policy 1, policy_version 1663536 (0.0007) [2023-12-28 07:11:21,788][106225] Updated weights for policy 1, policy_version 1663546 (0.0008) [2023-12-28 07:11:21,851][106225] Updated weights for policy 1, policy_version 1663556 (0.0008) [2023-12-28 07:11:22,266][106226] Updated weights for policy 0, policy_version 1659738 (0.0009) [2023-12-28 07:11:22,328][106226] Updated weights for policy 0, policy_version 1659748 (0.0011) [2023-12-28 07:11:22,392][106226] Updated weights for policy 0, policy_version 1659758 (0.0011) [2023-12-28 07:11:22,454][106226] Updated weights for policy 0, policy_version 1659768 (0.0011) [2023-12-28 07:11:22,614][106225] Updated weights for policy 1, policy_version 1663566 (0.0008) [2023-12-28 07:11:22,676][106225] Updated weights for policy 1, policy_version 1663576 (0.0007) [2023-12-28 07:11:22,733][106225] Updated weights for policy 1, policy_version 1663586 (0.0008) [2023-12-28 07:11:23,145][106226] Updated weights for policy 0, policy_version 1659778 (0.0008) [2023-12-28 07:11:23,195][106226] Updated weights for policy 0, policy_version 1659788 (0.0008) [2023-12-28 07:11:23,255][106226] Updated weights for policy 0, policy_version 1659798 (0.0008) [2023-12-28 07:11:23,430][106225] Updated weights for policy 1, policy_version 1663596 (0.0007) [2023-12-28 07:11:23,495][106225] Updated weights for policy 1, policy_version 1663606 (0.0009) [2023-12-28 07:11:23,555][106225] Updated weights for policy 1, policy_version 1663616 (0.0010) [2023-12-28 07:11:24,025][106226] Updated weights for policy 0, policy_version 1659808 (0.0011) [2023-12-28 07:11:24,083][106226] Updated weights for policy 0, policy_version 1659818 (0.0010) [2023-12-28 07:11:24,143][106226] Updated weights for policy 0, policy_version 1659828 (0.0011) [2023-12-28 07:11:24,196][106225] Updated weights for policy 1, policy_version 1663626 (0.0009) [2023-12-28 07:11:24,258][106225] Updated weights for policy 1, policy_version 1663636 (0.0005) [2023-12-28 07:11:24,317][106225] Updated weights for policy 1, policy_version 1663646 (0.0006) [2023-12-28 07:11:24,367][106225] Updated weights for policy 1, policy_version 1663656 (0.0007) [2023-12-28 07:11:24,853][106226] Updated weights for policy 0, policy_version 1659838 (0.0008) [2023-12-28 07:11:24,898][106225] Updated weights for policy 1, policy_version 1663666 (0.0005) [2023-12-28 07:11:24,919][106226] Updated weights for policy 0, policy_version 1659848 (0.0005) [2023-12-28 07:11:24,949][106225] Updated weights for policy 1, policy_version 1663676 (0.0005) [2023-12-28 07:11:24,985][106226] Updated weights for policy 0, policy_version 1659858 (0.0006) [2023-12-28 07:11:24,998][106225] Updated weights for policy 1, policy_version 1663686 (0.0005) [2023-12-28 07:11:25,564][106226] Updated weights for policy 0, policy_version 1659868 (0.0008) [2023-12-28 07:11:25,593][106225] Updated weights for policy 1, policy_version 1663696 (0.0006) [2023-12-28 07:11:25,628][106226] Updated weights for policy 0, policy_version 1659878 (0.0011) [2023-12-28 07:11:25,649][106225] Updated weights for policy 1, policy_version 1663706 (0.0007) [2023-12-28 07:11:25,687][106226] Updated weights for policy 0, policy_version 1659888 (0.0010) [2023-12-28 07:11:25,700][106225] Updated weights for policy 1, policy_version 1663716 (0.0005) [2023-12-28 07:11:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 850976768. Throughput: 0: 9861.7, 1: 9742.2. Samples: 850942528. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:26,176][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.677')] [2023-12-28 07:11:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001663720_425967616.pth... [2023-12-28 07:11:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001659896_425009152.pth... [2023-12-28 07:11:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001662568_425672704.pth [2023-12-28 07:11:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001658744_424714240.pth [2023-12-28 07:11:26,247][106225] Updated weights for policy 1, policy_version 1663726 (0.0005) [2023-12-28 07:11:26,247][106226] Updated weights for policy 0, policy_version 1659898 (0.0010) [2023-12-28 07:11:26,296][106225] Updated weights for policy 1, policy_version 1663736 (0.0006) [2023-12-28 07:11:26,309][106226] Updated weights for policy 0, policy_version 1659908 (0.0005) [2023-12-28 07:11:26,361][106225] Updated weights for policy 1, policy_version 1663746 (0.0008) [2023-12-28 07:11:26,372][106226] Updated weights for policy 0, policy_version 1659918 (0.0005) [2023-12-28 07:11:26,431][106226] Updated weights for policy 0, policy_version 1659928 (0.0005) [2023-12-28 07:11:26,935][106225] Updated weights for policy 1, policy_version 1663756 (0.0008) [2023-12-28 07:11:26,955][106226] Updated weights for policy 0, policy_version 1659938 (0.0005) [2023-12-28 07:11:26,985][106225] Updated weights for policy 1, policy_version 1663766 (0.0005) [2023-12-28 07:11:27,011][106226] Updated weights for policy 0, policy_version 1659948 (0.0006) [2023-12-28 07:11:27,034][106225] Updated weights for policy 1, policy_version 1663776 (0.0005) [2023-12-28 07:11:27,061][106226] Updated weights for policy 0, policy_version 1659958 (0.0010) [2023-12-28 07:11:27,631][106225] Updated weights for policy 1, policy_version 1663786 (0.0006) [2023-12-28 07:11:27,688][106225] Updated weights for policy 1, policy_version 1663796 (0.0006) [2023-12-28 07:11:27,719][106226] Updated weights for policy 0, policy_version 1659968 (0.0010) [2023-12-28 07:11:27,746][106225] Updated weights for policy 1, policy_version 1663806 (0.0005) [2023-12-28 07:11:27,763][106226] Updated weights for policy 0, policy_version 1659978 (0.0005) [2023-12-28 07:11:27,806][106225] Updated weights for policy 1, policy_version 1663816 (0.0005) [2023-12-28 07:11:27,808][106226] Updated weights for policy 0, policy_version 1659988 (0.0005) [2023-12-28 07:11:28,382][106225] Updated weights for policy 1, policy_version 1663826 (0.0009) [2023-12-28 07:11:28,442][106225] Updated weights for policy 1, policy_version 1663836 (0.0009) [2023-12-28 07:11:28,476][106226] Updated weights for policy 0, policy_version 1659998 (0.0007) [2023-12-28 07:11:28,502][106225] Updated weights for policy 1, policy_version 1663846 (0.0009) [2023-12-28 07:11:28,528][106226] Updated weights for policy 0, policy_version 1660008 (0.0006) [2023-12-28 07:11:28,591][106226] Updated weights for policy 0, policy_version 1660018 (0.0010) [2023-12-28 07:11:29,258][106225] Updated weights for policy 1, policy_version 1663856 (0.0008) [2023-12-28 07:11:29,303][106226] Updated weights for policy 0, policy_version 1660028 (0.0010) [2023-12-28 07:11:29,314][106225] Updated weights for policy 1, policy_version 1663866 (0.0007) [2023-12-28 07:11:29,369][106226] Updated weights for policy 0, policy_version 1660038 (0.0010) [2023-12-28 07:11:29,375][106225] Updated weights for policy 1, policy_version 1663876 (0.0008) [2023-12-28 07:11:29,437][106226] Updated weights for policy 0, policy_version 1660048 (0.0009) [2023-12-28 07:11:30,105][106225] Updated weights for policy 1, policy_version 1663886 (0.0009) [2023-12-28 07:11:30,152][106225] Updated weights for policy 1, policy_version 1663896 (0.0007) [2023-12-28 07:11:30,190][106226] Updated weights for policy 0, policy_version 1660058 (0.0011) [2023-12-28 07:11:30,204][106225] Updated weights for policy 1, policy_version 1663906 (0.0005) [2023-12-28 07:11:30,244][106226] Updated weights for policy 0, policy_version 1660068 (0.0011) [2023-12-28 07:11:30,303][106226] Updated weights for policy 0, policy_version 1660078 (0.0010) [2023-12-28 07:11:30,360][106226] Updated weights for policy 0, policy_version 1660088 (0.0010) [2023-12-28 07:11:30,843][106225] Updated weights for policy 1, policy_version 1663916 (0.0007) [2023-12-28 07:11:30,892][106225] Updated weights for policy 1, policy_version 1663926 (0.0008) [2023-12-28 07:11:30,947][106225] Updated weights for policy 1, policy_version 1663936 (0.0008) [2023-12-28 07:11:30,971][106226] Updated weights for policy 0, policy_version 1660098 (0.0005) [2023-12-28 07:11:31,049][106226] Updated weights for policy 0, policy_version 1660108 (0.0006) [2023-12-28 07:11:31,113][106226] Updated weights for policy 0, policy_version 1660118 (0.0010) [2023-12-28 07:11:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 851091456. Throughput: 0: 9984.0, 1: 9979.8. Samples: 851073876. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:31,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.816')] [2023-12-28 07:11:31,633][106225] Updated weights for policy 1, policy_version 1663946 (0.0006) [2023-12-28 07:11:31,702][106225] Updated weights for policy 1, policy_version 1663956 (0.0006) [2023-12-28 07:11:31,768][106225] Updated weights for policy 1, policy_version 1663966 (0.0008) [2023-12-28 07:11:31,826][106225] Updated weights for policy 1, policy_version 1663976 (0.0008) [2023-12-28 07:11:31,830][106226] Updated weights for policy 0, policy_version 1660128 (0.0010) [2023-12-28 07:11:31,893][106226] Updated weights for policy 0, policy_version 1660138 (0.0011) [2023-12-28 07:11:31,952][106226] Updated weights for policy 0, policy_version 1660148 (0.0011) [2023-12-28 07:11:32,505][106225] Updated weights for policy 1, policy_version 1663986 (0.0008) [2023-12-28 07:11:32,604][106225] Updated weights for policy 1, policy_version 1663996 (0.0008) [2023-12-28 07:11:32,622][106226] Updated weights for policy 0, policy_version 1660158 (0.0008) [2023-12-28 07:11:32,658][106225] Updated weights for policy 1, policy_version 1664006 (0.0008) [2023-12-28 07:11:32,688][106226] Updated weights for policy 0, policy_version 1660168 (0.0009) [2023-12-28 07:11:32,748][106226] Updated weights for policy 0, policy_version 1660178 (0.0010) [2023-12-28 07:11:33,289][106225] Updated weights for policy 1, policy_version 1664016 (0.0008) [2023-12-28 07:11:33,348][106225] Updated weights for policy 1, policy_version 1664026 (0.0007) [2023-12-28 07:11:33,403][106225] Updated weights for policy 1, policy_version 1664036 (0.0005) [2023-12-28 07:11:33,454][106226] Updated weights for policy 0, policy_version 1660188 (0.0010) [2023-12-28 07:11:33,521][106226] Updated weights for policy 0, policy_version 1660198 (0.0011) [2023-12-28 07:11:33,580][106226] Updated weights for policy 0, policy_version 1660208 (0.0010) [2023-12-28 07:11:33,978][106225] Updated weights for policy 1, policy_version 1664046 (0.0008) [2023-12-28 07:11:34,027][106225] Updated weights for policy 1, policy_version 1664056 (0.0007) [2023-12-28 07:11:34,087][106225] Updated weights for policy 1, policy_version 1664066 (0.0005) [2023-12-28 07:11:34,217][106226] Updated weights for policy 0, policy_version 1660218 (0.0010) [2023-12-28 07:11:34,279][106226] Updated weights for policy 0, policy_version 1660228 (0.0009) [2023-12-28 07:11:34,346][106226] Updated weights for policy 0, policy_version 1660238 (0.0008) [2023-12-28 07:11:34,408][106226] Updated weights for policy 0, policy_version 1660248 (0.0009) [2023-12-28 07:11:34,768][106225] Updated weights for policy 1, policy_version 1664076 (0.0008) [2023-12-28 07:11:34,831][106225] Updated weights for policy 1, policy_version 1664086 (0.0007) [2023-12-28 07:11:34,896][106225] Updated weights for policy 1, policy_version 1664096 (0.0005) [2023-12-28 07:11:35,129][106226] Updated weights for policy 0, policy_version 1660258 (0.0009) [2023-12-28 07:11:35,185][106226] Updated weights for policy 0, policy_version 1660268 (0.0007) [2023-12-28 07:11:35,234][106226] Updated weights for policy 0, policy_version 1660278 (0.0009) [2023-12-28 07:11:35,424][106225] Updated weights for policy 1, policy_version 1664106 (0.0006) [2023-12-28 07:11:35,493][106225] Updated weights for policy 1, policy_version 1664116 (0.0009) [2023-12-28 07:11:35,557][106225] Updated weights for policy 1, policy_version 1664126 (0.0008) [2023-12-28 07:11:35,618][106225] Updated weights for policy 1, policy_version 1664136 (0.0007) [2023-12-28 07:11:35,880][106226] Updated weights for policy 0, policy_version 1660288 (0.0006) [2023-12-28 07:11:35,933][106226] Updated weights for policy 0, policy_version 1660298 (0.0010) [2023-12-28 07:11:35,976][106226] Updated weights for policy 0, policy_version 1660308 (0.0010) [2023-12-28 07:11:36,174][105115] Fps is (10 sec: 21299.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 851189760. Throughput: 0: 9985.8, 1: 10043.6. Samples: 851198604. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:36,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.495')] [2023-12-28 07:11:36,315][106225] Updated weights for policy 1, policy_version 1664146 (0.0008) [2023-12-28 07:11:36,381][106225] Updated weights for policy 1, policy_version 1664156 (0.0009) [2023-12-28 07:11:36,442][106225] Updated weights for policy 1, policy_version 1664166 (0.0008) [2023-12-28 07:11:36,712][106226] Updated weights for policy 0, policy_version 1660318 (0.0011) [2023-12-28 07:11:36,760][106226] Updated weights for policy 0, policy_version 1660328 (0.0010) [2023-12-28 07:11:36,811][106226] Updated weights for policy 0, policy_version 1660338 (0.0010) [2023-12-28 07:11:37,142][106225] Updated weights for policy 1, policy_version 1664176 (0.0008) [2023-12-28 07:11:37,206][106225] Updated weights for policy 1, policy_version 1664186 (0.0005) [2023-12-28 07:11:37,270][106225] Updated weights for policy 1, policy_version 1664196 (0.0005) [2023-12-28 07:11:37,489][106226] Updated weights for policy 0, policy_version 1660348 (0.0011) [2023-12-28 07:11:37,550][106226] Updated weights for policy 0, policy_version 1660358 (0.0011) [2023-12-28 07:11:37,597][106226] Updated weights for policy 0, policy_version 1660368 (0.0011) [2023-12-28 07:11:37,788][106225] Updated weights for policy 1, policy_version 1664206 (0.0005) [2023-12-28 07:11:37,849][106225] Updated weights for policy 1, policy_version 1664216 (0.0010) [2023-12-28 07:11:37,914][106225] Updated weights for policy 1, policy_version 1664226 (0.0010) [2023-12-28 07:11:38,262][106226] Updated weights for policy 0, policy_version 1660378 (0.0009) [2023-12-28 07:11:38,313][106226] Updated weights for policy 0, policy_version 1660388 (0.0007) [2023-12-28 07:11:38,377][106226] Updated weights for policy 0, policy_version 1660398 (0.0008) [2023-12-28 07:11:38,436][106226] Updated weights for policy 0, policy_version 1660408 (0.0009) [2023-12-28 07:11:38,565][106225] Updated weights for policy 1, policy_version 1664236 (0.0008) [2023-12-28 07:11:38,627][106225] Updated weights for policy 1, policy_version 1664246 (0.0006) [2023-12-28 07:11:38,688][106225] Updated weights for policy 1, policy_version 1664256 (0.0007) [2023-12-28 07:11:39,173][106226] Updated weights for policy 0, policy_version 1660418 (0.0008) [2023-12-28 07:11:39,222][106226] Updated weights for policy 0, policy_version 1660428 (0.0008) [2023-12-28 07:11:39,292][106226] Updated weights for policy 0, policy_version 1660438 (0.0007) [2023-12-28 07:11:39,387][106225] Updated weights for policy 1, policy_version 1664266 (0.0009) [2023-12-28 07:11:39,458][106225] Updated weights for policy 1, policy_version 1664276 (0.0008) [2023-12-28 07:11:39,521][106225] Updated weights for policy 1, policy_version 1664286 (0.0008) [2023-12-28 07:11:39,594][106225] Updated weights for policy 1, policy_version 1664296 (0.0008) [2023-12-28 07:11:40,082][106226] Updated weights for policy 0, policy_version 1660448 (0.0006) [2023-12-28 07:11:40,149][106226] Updated weights for policy 0, policy_version 1660458 (0.0007) [2023-12-28 07:11:40,218][106226] Updated weights for policy 0, policy_version 1660468 (0.0008) [2023-12-28 07:11:40,418][106225] Updated weights for policy 1, policy_version 1664306 (0.0011) [2023-12-28 07:11:40,484][106225] Updated weights for policy 1, policy_version 1664316 (0.0010) [2023-12-28 07:11:40,549][106225] Updated weights for policy 1, policy_version 1664326 (0.0010) [2023-12-28 07:11:40,969][106226] Updated weights for policy 0, policy_version 1660478 (0.0008) [2023-12-28 07:11:41,033][106226] Updated weights for policy 0, policy_version 1660488 (0.0009) [2023-12-28 07:11:41,098][106226] Updated weights for policy 0, policy_version 1660498 (0.0007) [2023-12-28 07:11:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 851288064. Throughput: 0: 10020.5, 1: 10101.5. Samples: 851260016. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:41,175][105115] Avg episode reward: [(0, '-4.574'), (1, '-4.752')] [2023-12-28 07:11:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001664328_426123264.pth... [2023-12-28 07:11:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001660504_425164800.pth... [2023-12-28 07:11:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001663144_425820160.pth [2023-12-28 07:11:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001659320_424861696.pth [2023-12-28 07:11:41,259][106225] Updated weights for policy 1, policy_version 1664336 (0.0010) [2023-12-28 07:11:41,323][106225] Updated weights for policy 1, policy_version 1664346 (0.0009) [2023-12-28 07:11:41,396][106225] Updated weights for policy 1, policy_version 1664356 (0.0008) [2023-12-28 07:11:41,932][106226] Updated weights for policy 0, policy_version 1660508 (0.0008) [2023-12-28 07:11:41,995][106226] Updated weights for policy 0, policy_version 1660518 (0.0008) [2023-12-28 07:11:42,060][106226] Updated weights for policy 0, policy_version 1660528 (0.0008) [2023-12-28 07:11:42,174][106225] Updated weights for policy 1, policy_version 1664366 (0.0010) [2023-12-28 07:11:42,228][106225] Updated weights for policy 1, policy_version 1664376 (0.0010) [2023-12-28 07:11:42,290][106225] Updated weights for policy 1, policy_version 1664386 (0.0010) [2023-12-28 07:11:42,865][106226] Updated weights for policy 0, policy_version 1660538 (0.0008) [2023-12-28 07:11:42,924][106226] Updated weights for policy 0, policy_version 1660548 (0.0008) [2023-12-28 07:11:42,979][106226] Updated weights for policy 0, policy_version 1660558 (0.0008) [2023-12-28 07:11:43,046][106226] Updated weights for policy 0, policy_version 1660568 (0.0008) [2023-12-28 07:11:43,074][106225] Updated weights for policy 1, policy_version 1664396 (0.0009) [2023-12-28 07:11:43,135][106225] Updated weights for policy 1, policy_version 1664406 (0.0010) [2023-12-28 07:11:43,193][106225] Updated weights for policy 1, policy_version 1664416 (0.0010) [2023-12-28 07:11:43,775][106226] Updated weights for policy 0, policy_version 1660578 (0.0009) [2023-12-28 07:11:43,822][106226] Updated weights for policy 0, policy_version 1660588 (0.0008) [2023-12-28 07:11:43,853][106225] Updated weights for policy 1, policy_version 1664426 (0.0008) [2023-12-28 07:11:43,880][106226] Updated weights for policy 0, policy_version 1660598 (0.0008) [2023-12-28 07:11:43,912][106225] Updated weights for policy 1, policy_version 1664436 (0.0005) [2023-12-28 07:11:43,971][106225] Updated weights for policy 1, policy_version 1664446 (0.0008) [2023-12-28 07:11:44,022][106225] Updated weights for policy 1, policy_version 1664456 (0.0008) [2023-12-28 07:11:44,612][106225] Updated weights for policy 1, policy_version 1664466 (0.0005) [2023-12-28 07:11:44,621][106226] Updated weights for policy 0, policy_version 1660608 (0.0008) [2023-12-28 07:11:44,668][106225] Updated weights for policy 1, policy_version 1664476 (0.0005) [2023-12-28 07:11:44,688][106226] Updated weights for policy 0, policy_version 1660618 (0.0010) [2023-12-28 07:11:44,722][106225] Updated weights for policy 1, policy_version 1664486 (0.0006) [2023-12-28 07:11:44,745][106226] Updated weights for policy 0, policy_version 1660628 (0.0010) [2023-12-28 07:11:45,329][106225] Updated weights for policy 1, policy_version 1664496 (0.0006) [2023-12-28 07:11:45,383][106225] Updated weights for policy 1, policy_version 1664506 (0.0009) [2023-12-28 07:11:45,440][106225] Updated weights for policy 1, policy_version 1664516 (0.0010) [2023-12-28 07:11:45,502][106226] Updated weights for policy 0, policy_version 1660638 (0.0010) [2023-12-28 07:11:45,558][106226] Updated weights for policy 0, policy_version 1660649 (0.0007) [2023-12-28 07:11:45,624][106226] Updated weights for policy 0, policy_version 1660659 (0.0008) [2023-12-28 07:11:46,092][106225] Updated weights for policy 1, policy_version 1664526 (0.0009) [2023-12-28 07:11:46,138][106225] Updated weights for policy 1, policy_version 1664536 (0.0008) [2023-12-28 07:11:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 851378176. Throughput: 0: 9960.8, 1: 10045.4. Samples: 851372184. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:46,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.812')] [2023-12-28 07:11:46,192][106225] Updated weights for policy 1, policy_version 1664546 (0.0006) [2023-12-28 07:11:46,355][106226] Updated weights for policy 0, policy_version 1660669 (0.0007) [2023-12-28 07:11:46,410][106226] Updated weights for policy 0, policy_version 1660679 (0.0008) [2023-12-28 07:11:46,461][106226] Updated weights for policy 0, policy_version 1660689 (0.0009) [2023-12-28 07:11:46,884][106225] Updated weights for policy 1, policy_version 1664556 (0.0007) [2023-12-28 07:11:46,940][106225] Updated weights for policy 1, policy_version 1664566 (0.0005) [2023-12-28 07:11:47,003][106225] Updated weights for policy 1, policy_version 1664576 (0.0006) [2023-12-28 07:11:47,227][106226] Updated weights for policy 0, policy_version 1660699 (0.0009) [2023-12-28 07:11:47,279][106226] Updated weights for policy 0, policy_version 1660709 (0.0009) [2023-12-28 07:11:47,339][106226] Updated weights for policy 0, policy_version 1660719 (0.0008) [2023-12-28 07:11:47,692][106225] Updated weights for policy 1, policy_version 1664586 (0.0008) [2023-12-28 07:11:47,748][106225] Updated weights for policy 1, policy_version 1664596 (0.0006) [2023-12-28 07:11:47,805][106225] Updated weights for policy 1, policy_version 1664606 (0.0005) [2023-12-28 07:11:47,851][106225] Updated weights for policy 1, policy_version 1664616 (0.0005) [2023-12-28 07:11:48,087][106226] Updated weights for policy 0, policy_version 1660729 (0.0008) [2023-12-28 07:11:48,156][106226] Updated weights for policy 0, policy_version 1660739 (0.0005) [2023-12-28 07:11:48,222][106226] Updated weights for policy 0, policy_version 1660749 (0.0006) [2023-12-28 07:11:48,281][106226] Updated weights for policy 0, policy_version 1660759 (0.0007) [2023-12-28 07:11:48,422][106225] Updated weights for policy 1, policy_version 1664626 (0.0007) [2023-12-28 07:11:48,477][106225] Updated weights for policy 1, policy_version 1664636 (0.0007) [2023-12-28 07:11:48,549][106225] Updated weights for policy 1, policy_version 1664646 (0.0010) [2023-12-28 07:11:48,871][106226] Updated weights for policy 0, policy_version 1660769 (0.0006) [2023-12-28 07:11:48,932][106226] Updated weights for policy 0, policy_version 1660779 (0.0006) [2023-12-28 07:11:48,993][106226] Updated weights for policy 0, policy_version 1660789 (0.0008) [2023-12-28 07:11:49,307][106225] Updated weights for policy 1, policy_version 1664656 (0.0009) [2023-12-28 07:11:49,373][106225] Updated weights for policy 1, policy_version 1664666 (0.0008) [2023-12-28 07:11:49,440][106225] Updated weights for policy 1, policy_version 1664676 (0.0007) [2023-12-28 07:11:49,743][106226] Updated weights for policy 0, policy_version 1660799 (0.0008) [2023-12-28 07:11:49,805][106226] Updated weights for policy 0, policy_version 1660809 (0.0009) [2023-12-28 07:11:49,869][106226] Updated weights for policy 0, policy_version 1660819 (0.0008) [2023-12-28 07:11:50,139][106225] Updated weights for policy 1, policy_version 1664686 (0.0007) [2023-12-28 07:11:50,192][106225] Updated weights for policy 1, policy_version 1664696 (0.0005) [2023-12-28 07:11:50,251][106225] Updated weights for policy 1, policy_version 1664706 (0.0006) [2023-12-28 07:11:50,540][106226] Updated weights for policy 0, policy_version 1660829 (0.0007) [2023-12-28 07:11:50,603][106226] Updated weights for policy 0, policy_version 1660839 (0.0009) [2023-12-28 07:11:50,664][106226] Updated weights for policy 0, policy_version 1660849 (0.0008) [2023-12-28 07:11:50,874][106225] Updated weights for policy 1, policy_version 1664716 (0.0005) [2023-12-28 07:11:50,939][106225] Updated weights for policy 1, policy_version 1664726 (0.0006) [2023-12-28 07:11:51,000][106225] Updated weights for policy 1, policy_version 1664736 (0.0008) [2023-12-28 07:11:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 851484672. Throughput: 0: 9918.6, 1: 10130.9. Samples: 851492308. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:51,175][105115] Avg episode reward: [(0, '-4.377'), (1, '-4.881')] [2023-12-28 07:11:51,406][106226] Updated weights for policy 0, policy_version 1660859 (0.0008) [2023-12-28 07:11:51,471][106226] Updated weights for policy 0, policy_version 1660869 (0.0009) [2023-12-28 07:11:51,544][106226] Updated weights for policy 0, policy_version 1660879 (0.0006) [2023-12-28 07:11:51,696][106225] Updated weights for policy 1, policy_version 1664746 (0.0006) [2023-12-28 07:11:51,768][106225] Updated weights for policy 1, policy_version 1664757 (0.0008) [2023-12-28 07:11:51,830][106225] Updated weights for policy 1, policy_version 1664767 (0.0008) [2023-12-28 07:11:52,229][106226] Updated weights for policy 0, policy_version 1660889 (0.0009) [2023-12-28 07:11:52,292][106226] Updated weights for policy 0, policy_version 1660899 (0.0008) [2023-12-28 07:11:52,355][106226] Updated weights for policy 0, policy_version 1660909 (0.0009) [2023-12-28 07:11:52,419][106226] Updated weights for policy 0, policy_version 1660919 (0.0009) [2023-12-28 07:11:52,539][106225] Updated weights for policy 1, policy_version 1664777 (0.0008) [2023-12-28 07:11:52,591][106225] Updated weights for policy 1, policy_version 1664787 (0.0005) [2023-12-28 07:11:52,646][106225] Updated weights for policy 1, policy_version 1664797 (0.0005) [2023-12-28 07:11:52,707][106225] Updated weights for policy 1, policy_version 1664807 (0.0006) [2023-12-28 07:11:53,198][106226] Updated weights for policy 0, policy_version 1660929 (0.0009) [2023-12-28 07:11:53,260][106226] Updated weights for policy 0, policy_version 1660939 (0.0008) [2023-12-28 07:11:53,301][106225] Updated weights for policy 1, policy_version 1664817 (0.0008) [2023-12-28 07:11:53,317][106226] Updated weights for policy 0, policy_version 1660949 (0.0007) [2023-12-28 07:11:53,358][106225] Updated weights for policy 1, policy_version 1664827 (0.0008) [2023-12-28 07:11:53,416][106225] Updated weights for policy 1, policy_version 1664837 (0.0005) [2023-12-28 07:11:54,054][106226] Updated weights for policy 0, policy_version 1660959 (0.0009) [2023-12-28 07:11:54,103][106226] Updated weights for policy 0, policy_version 1660969 (0.0006) [2023-12-28 07:11:54,108][106225] Updated weights for policy 1, policy_version 1664847 (0.0008) [2023-12-28 07:11:54,152][106226] Updated weights for policy 0, policy_version 1660979 (0.0007) [2023-12-28 07:11:54,165][106225] Updated weights for policy 1, policy_version 1664857 (0.0007) [2023-12-28 07:11:54,220][106225] Updated weights for policy 1, policy_version 1664867 (0.0008) [2023-12-28 07:11:54,786][106225] Updated weights for policy 1, policy_version 1664877 (0.0006) [2023-12-28 07:11:54,837][106225] Updated weights for policy 1, policy_version 1664887 (0.0005) [2023-12-28 07:11:54,886][106225] Updated weights for policy 1, policy_version 1664897 (0.0007) [2023-12-28 07:11:54,933][106226] Updated weights for policy 0, policy_version 1660989 (0.0008) [2023-12-28 07:11:54,991][106226] Updated weights for policy 0, policy_version 1660999 (0.0011) [2023-12-28 07:11:55,060][106226] Updated weights for policy 0, policy_version 1661009 (0.0011) [2023-12-28 07:11:55,600][106225] Updated weights for policy 1, policy_version 1664907 (0.0008) [2023-12-28 07:11:55,650][106225] Updated weights for policy 1, policy_version 1664917 (0.0007) [2023-12-28 07:11:55,701][106225] Updated weights for policy 1, policy_version 1664927 (0.0009) [2023-12-28 07:11:55,756][106226] Updated weights for policy 0, policy_version 1661019 (0.0011) [2023-12-28 07:11:55,815][106226] Updated weights for policy 0, policy_version 1661029 (0.0010) [2023-12-28 07:11:55,878][106226] Updated weights for policy 0, policy_version 1661039 (0.0011) [2023-12-28 07:11:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 851582976. Throughput: 0: 9868.9, 1: 10186.3. Samples: 851551068. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:11:56,175][105115] Avg episode reward: [(0, '-4.578'), (1, '-4.949')] [2023-12-28 07:11:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001661048_425304064.pth... [2023-12-28 07:11:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001664936_426278912.pth... [2023-12-28 07:11:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001659896_425009152.pth [2023-12-28 07:11:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001663720_425967616.pth [2023-12-28 07:11:56,299][106225] Updated weights for policy 1, policy_version 1664937 (0.0008) [2023-12-28 07:11:56,345][106225] Updated weights for policy 1, policy_version 1664947 (0.0007) [2023-12-28 07:11:56,396][106225] Updated weights for policy 1, policy_version 1664957 (0.0007) [2023-12-28 07:11:56,439][106225] Updated weights for policy 1, policy_version 1664967 (0.0007) [2023-12-28 07:11:56,581][106226] Updated weights for policy 0, policy_version 1661049 (0.0010) [2023-12-28 07:11:56,637][106226] Updated weights for policy 0, policy_version 1661059 (0.0005) [2023-12-28 07:11:56,687][106226] Updated weights for policy 0, policy_version 1661069 (0.0010) [2023-12-28 07:11:56,740][106226] Updated weights for policy 0, policy_version 1661079 (0.0010) [2023-12-28 07:11:56,994][106225] Updated weights for policy 1, policy_version 1664977 (0.0006) [2023-12-28 07:11:57,049][106225] Updated weights for policy 1, policy_version 1664987 (0.0005) [2023-12-28 07:11:57,104][106225] Updated weights for policy 1, policy_version 1664997 (0.0005) [2023-12-28 07:11:57,501][106226] Updated weights for policy 0, policy_version 1661089 (0.0009) [2023-12-28 07:11:57,552][106226] Updated weights for policy 0, policy_version 1661099 (0.0009) [2023-12-28 07:11:57,610][106226] Updated weights for policy 0, policy_version 1661109 (0.0009) [2023-12-28 07:11:57,672][106225] Updated weights for policy 1, policy_version 1665007 (0.0006) [2023-12-28 07:11:57,726][106225] Updated weights for policy 1, policy_version 1665017 (0.0005) [2023-12-28 07:11:57,784][106225] Updated weights for policy 1, policy_version 1665027 (0.0005) [2023-12-28 07:11:58,322][106225] Updated weights for policy 1, policy_version 1665037 (0.0006) [2023-12-28 07:11:58,372][106226] Updated weights for policy 0, policy_version 1661119 (0.0008) [2023-12-28 07:11:58,386][106225] Updated weights for policy 1, policy_version 1665047 (0.0008) [2023-12-28 07:11:58,467][106225] Updated weights for policy 1, policy_version 1665057 (0.0007) [2023-12-28 07:11:58,484][106226] Updated weights for policy 0, policy_version 1661129 (0.0009) [2023-12-28 07:11:58,557][106226] Updated weights for policy 0, policy_version 1661139 (0.0010) [2023-12-28 07:11:59,231][106226] Updated weights for policy 0, policy_version 1661149 (0.0008) [2023-12-28 07:11:59,290][106225] Updated weights for policy 1, policy_version 1665067 (0.0007) [2023-12-28 07:11:59,300][106226] Updated weights for policy 0, policy_version 1661159 (0.0008) [2023-12-28 07:11:59,354][106225] Updated weights for policy 1, policy_version 1665077 (0.0008) [2023-12-28 07:11:59,365][106226] Updated weights for policy 0, policy_version 1661169 (0.0007) [2023-12-28 07:11:59,429][106225] Updated weights for policy 1, policy_version 1665089 (0.0009) [2023-12-28 07:12:00,126][106226] Updated weights for policy 0, policy_version 1661179 (0.0012) [2023-12-28 07:12:00,185][106226] Updated weights for policy 0, policy_version 1661189 (0.0008) [2023-12-28 07:12:00,211][106225] Updated weights for policy 1, policy_version 1665099 (0.0008) [2023-12-28 07:12:00,244][106226] Updated weights for policy 0, policy_version 1661199 (0.0007) [2023-12-28 07:12:00,266][106225] Updated weights for policy 1, policy_version 1665109 (0.0006) [2023-12-28 07:12:00,327][106225] Updated weights for policy 1, policy_version 1665119 (0.0009) [2023-12-28 07:12:00,948][106226] Updated weights for policy 0, policy_version 1661209 (0.0008) [2023-12-28 07:12:00,990][106225] Updated weights for policy 1, policy_version 1665129 (0.0008) [2023-12-28 07:12:01,012][106226] Updated weights for policy 0, policy_version 1661219 (0.0006) [2023-12-28 07:12:01,054][106225] Updated weights for policy 1, policy_version 1665139 (0.0007) [2023-12-28 07:12:01,072][106226] Updated weights for policy 0, policy_version 1661229 (0.0008) [2023-12-28 07:12:01,116][106225] Updated weights for policy 1, policy_version 1665150 (0.0008) [2023-12-28 07:12:01,132][106226] Updated weights for policy 0, policy_version 1661239 (0.0007) [2023-12-28 07:12:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 851681280. Throughput: 0: 9812.0, 1: 10349.4. Samples: 851671024. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:12:01,175][105115] Avg episode reward: [(0, '-4.124'), (1, '-4.633')] [2023-12-28 07:12:01,184][106225] Updated weights for policy 1, policy_version 1665160 (0.0009) [2023-12-28 07:12:01,888][106226] Updated weights for policy 0, policy_version 1661249 (0.0007) [2023-12-28 07:12:01,945][106226] Updated weights for policy 0, policy_version 1661259 (0.0005) [2023-12-28 07:12:01,949][106225] Updated weights for policy 1, policy_version 1665170 (0.0008) [2023-12-28 07:12:02,003][106226] Updated weights for policy 0, policy_version 1661269 (0.0006) [2023-12-28 07:12:02,013][106225] Updated weights for policy 1, policy_version 1665180 (0.0008) [2023-12-28 07:12:02,071][106225] Updated weights for policy 1, policy_version 1665190 (0.0008) [2023-12-28 07:12:02,653][106226] Updated weights for policy 0, policy_version 1661279 (0.0006) [2023-12-28 07:12:02,720][106226] Updated weights for policy 0, policy_version 1661289 (0.0005) [2023-12-28 07:12:02,784][106226] Updated weights for policy 0, policy_version 1661299 (0.0007) [2023-12-28 07:12:02,834][106225] Updated weights for policy 1, policy_version 1665200 (0.0007) [2023-12-28 07:12:02,881][106225] Updated weights for policy 1, policy_version 1665210 (0.0008) [2023-12-28 07:12:02,935][106225] Updated weights for policy 1, policy_version 1665220 (0.0007) [2023-12-28 07:12:03,372][106226] Updated weights for policy 0, policy_version 1661309 (0.0008) [2023-12-28 07:12:03,421][106226] Updated weights for policy 0, policy_version 1661319 (0.0010) [2023-12-28 07:12:03,475][106226] Updated weights for policy 0, policy_version 1661329 (0.0010) [2023-12-28 07:12:03,546][106225] Updated weights for policy 1, policy_version 1665230 (0.0006) [2023-12-28 07:12:03,604][106225] Updated weights for policy 1, policy_version 1665240 (0.0005) [2023-12-28 07:12:03,655][106225] Updated weights for policy 1, policy_version 1665250 (0.0005) [2023-12-28 07:12:04,168][106226] Updated weights for policy 0, policy_version 1661339 (0.0009) [2023-12-28 07:12:04,231][106226] Updated weights for policy 0, policy_version 1661349 (0.0006) [2023-12-28 07:12:04,283][106226] Updated weights for policy 0, policy_version 1661359 (0.0005) [2023-12-28 07:12:04,324][106225] Updated weights for policy 1, policy_version 1665260 (0.0009) [2023-12-28 07:12:04,372][106225] Updated weights for policy 1, policy_version 1665270 (0.0007) [2023-12-28 07:12:04,423][106225] Updated weights for policy 1, policy_version 1665280 (0.0007) [2023-12-28 07:12:04,961][106226] Updated weights for policy 0, policy_version 1661369 (0.0007) [2023-12-28 07:12:05,030][106226] Updated weights for policy 0, policy_version 1661379 (0.0011) [2023-12-28 07:12:05,088][106226] Updated weights for policy 0, policy_version 1661389 (0.0010) [2023-12-28 07:12:05,141][106226] Updated weights for policy 0, policy_version 1661399 (0.0010) [2023-12-28 07:12:05,160][106225] Updated weights for policy 1, policy_version 1665290 (0.0008) [2023-12-28 07:12:05,206][106225] Updated weights for policy 1, policy_version 1665300 (0.0010) [2023-12-28 07:12:05,263][106225] Updated weights for policy 1, policy_version 1665310 (0.0009) [2023-12-28 07:12:05,321][106225] Updated weights for policy 1, policy_version 1665320 (0.0005) [2023-12-28 07:12:05,837][106226] Updated weights for policy 0, policy_version 1661409 (0.0011) [2023-12-28 07:12:05,891][106226] Updated weights for policy 0, policy_version 1661419 (0.0010) [2023-12-28 07:12:05,898][106225] Updated weights for policy 1, policy_version 1665330 (0.0006) [2023-12-28 07:12:05,942][106225] Updated weights for policy 1, policy_version 1665340 (0.0006) [2023-12-28 07:12:05,944][106226] Updated weights for policy 0, policy_version 1661429 (0.0010) [2023-12-28 07:12:05,985][106225] Updated weights for policy 1, policy_version 1665350 (0.0007) [2023-12-28 07:12:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 851787776. Throughput: 0: 9770.2, 1: 10359.0. Samples: 851791796. Policy #0 lag: (min: 4.0, avg: 7.2, max: 36.0) [2023-12-28 07:12:06,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.478')] [2023-12-28 07:12:06,671][106226] Updated weights for policy 0, policy_version 1661439 (0.0011) [2023-12-28 07:12:06,732][106226] Updated weights for policy 0, policy_version 1661449 (0.0011) [2023-12-28 07:12:06,738][106225] Updated weights for policy 1, policy_version 1665360 (0.0006) [2023-12-28 07:12:06,789][106226] Updated weights for policy 0, policy_version 1661459 (0.0011) [2023-12-28 07:12:06,793][106225] Updated weights for policy 1, policy_version 1665370 (0.0009) [2023-12-28 07:12:06,849][106225] Updated weights for policy 1, policy_version 1665380 (0.0009) [2023-12-28 07:12:07,476][106226] Updated weights for policy 0, policy_version 1661469 (0.0011) [2023-12-28 07:12:07,507][106225] Updated weights for policy 1, policy_version 1665390 (0.0007) [2023-12-28 07:12:07,528][106226] Updated weights for policy 0, policy_version 1661479 (0.0010) [2023-12-28 07:12:07,577][106225] Updated weights for policy 1, policy_version 1665400 (0.0005) [2023-12-28 07:12:07,582][106226] Updated weights for policy 0, policy_version 1661489 (0.0011) [2023-12-28 07:12:07,645][106225] Updated weights for policy 1, policy_version 1665410 (0.0005) [2023-12-28 07:12:08,201][106226] Updated weights for policy 0, policy_version 1661499 (0.0010) [2023-12-28 07:12:08,267][106226] Updated weights for policy 0, policy_version 1661509 (0.0008) [2023-12-28 07:12:08,336][106226] Updated weights for policy 0, policy_version 1661519 (0.0008) [2023-12-28 07:12:08,364][106225] Updated weights for policy 1, policy_version 1665420 (0.0005) [2023-12-28 07:12:08,426][106225] Updated weights for policy 1, policy_version 1665430 (0.0007) [2023-12-28 07:12:08,488][106225] Updated weights for policy 1, policy_version 1665440 (0.0008) [2023-12-28 07:12:09,054][106226] Updated weights for policy 0, policy_version 1661529 (0.0008) [2023-12-28 07:12:09,107][106226] Updated weights for policy 0, policy_version 1661539 (0.0006) [2023-12-28 07:12:09,163][106226] Updated weights for policy 0, policy_version 1661549 (0.0006) [2023-12-28 07:12:09,211][106225] Updated weights for policy 1, policy_version 1665450 (0.0007) [2023-12-28 07:12:09,214][106226] Updated weights for policy 0, policy_version 1661559 (0.0006) [2023-12-28 07:12:09,278][106225] Updated weights for policy 1, policy_version 1665460 (0.0009) [2023-12-28 07:12:09,350][106225] Updated weights for policy 1, policy_version 1665470 (0.0010) [2023-12-28 07:12:09,419][106225] Updated weights for policy 1, policy_version 1665480 (0.0009) [2023-12-28 07:12:09,948][106226] Updated weights for policy 0, policy_version 1661569 (0.0008) [2023-12-28 07:12:10,008][106226] Updated weights for policy 0, policy_version 1661579 (0.0009) [2023-12-28 07:12:10,070][106226] Updated weights for policy 0, policy_version 1661589 (0.0008) [2023-12-28 07:12:10,144][106225] Updated weights for policy 1, policy_version 1665490 (0.0008) [2023-12-28 07:12:10,203][106225] Updated weights for policy 1, policy_version 1665500 (0.0008) [2023-12-28 07:12:10,266][106225] Updated weights for policy 1, policy_version 1665510 (0.0009) [2023-12-28 07:12:10,806][106226] Updated weights for policy 0, policy_version 1661599 (0.0008) [2023-12-28 07:12:10,876][106226] Updated weights for policy 0, policy_version 1661609 (0.0008) [2023-12-28 07:12:10,947][106226] Updated weights for policy 0, policy_version 1661619 (0.0009) [2023-12-28 07:12:11,007][106225] Updated weights for policy 1, policy_version 1665520 (0.0008) [2023-12-28 07:12:11,077][106225] Updated weights for policy 1, policy_version 1665530 (0.0009) [2023-12-28 07:12:11,139][106225] Updated weights for policy 1, policy_version 1665540 (0.0008) [2023-12-28 07:12:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 851886080. Throughput: 0: 9827.1, 1: 10375.7. Samples: 851851648. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:11,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.770')] [2023-12-28 07:12:11,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001665544_426434560.pth... [2023-12-28 07:12:11,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001661624_425451520.pth... [2023-12-28 07:12:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001664328_426123264.pth [2023-12-28 07:12:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001660504_425164800.pth [2023-12-28 07:12:11,664][106226] Updated weights for policy 0, policy_version 1661629 (0.0008) [2023-12-28 07:12:11,738][106226] Updated weights for policy 0, policy_version 1661639 (0.0008) [2023-12-28 07:12:11,805][106226] Updated weights for policy 0, policy_version 1661649 (0.0008) [2023-12-28 07:12:11,960][106225] Updated weights for policy 1, policy_version 1665550 (0.0008) [2023-12-28 07:12:12,023][106225] Updated weights for policy 1, policy_version 1665560 (0.0009) [2023-12-28 07:12:12,094][106225] Updated weights for policy 1, policy_version 1665570 (0.0009) [2023-12-28 07:12:12,594][106226] Updated weights for policy 0, policy_version 1661659 (0.0008) [2023-12-28 07:12:12,659][106226] Updated weights for policy 0, policy_version 1661669 (0.0008) [2023-12-28 07:12:12,717][106226] Updated weights for policy 0, policy_version 1661679 (0.0008) [2023-12-28 07:12:12,865][106225] Updated weights for policy 1, policy_version 1665580 (0.0009) [2023-12-28 07:12:12,925][106225] Updated weights for policy 1, policy_version 1665590 (0.0010) [2023-12-28 07:12:12,987][106225] Updated weights for policy 1, policy_version 1665600 (0.0009) [2023-12-28 07:12:13,440][106226] Updated weights for policy 0, policy_version 1661689 (0.0008) [2023-12-28 07:12:13,495][106226] Updated weights for policy 0, policy_version 1661699 (0.0009) [2023-12-28 07:12:13,564][106226] Updated weights for policy 0, policy_version 1661709 (0.0008) [2023-12-28 07:12:13,615][106226] Updated weights for policy 0, policy_version 1661719 (0.0008) [2023-12-28 07:12:13,746][106225] Updated weights for policy 1, policy_version 1665610 (0.0007) [2023-12-28 07:12:13,795][106225] Updated weights for policy 1, policy_version 1665620 (0.0008) [2023-12-28 07:12:13,851][106225] Updated weights for policy 1, policy_version 1665630 (0.0008) [2023-12-28 07:12:13,908][106225] Updated weights for policy 1, policy_version 1665640 (0.0008) [2023-12-28 07:12:14,316][106226] Updated weights for policy 0, policy_version 1661729 (0.0009) [2023-12-28 07:12:14,369][106226] Updated weights for policy 0, policy_version 1661739 (0.0008) [2023-12-28 07:12:14,429][106226] Updated weights for policy 0, policy_version 1661749 (0.0009) [2023-12-28 07:12:14,703][106225] Updated weights for policy 1, policy_version 1665650 (0.0008) [2023-12-28 07:12:14,756][106225] Updated weights for policy 1, policy_version 1665660 (0.0008) [2023-12-28 07:12:14,823][106225] Updated weights for policy 1, policy_version 1665670 (0.0008) [2023-12-28 07:12:15,137][106226] Updated weights for policy 0, policy_version 1661759 (0.0009) [2023-12-28 07:12:15,186][106226] Updated weights for policy 0, policy_version 1661769 (0.0008) [2023-12-28 07:12:15,236][106226] Updated weights for policy 0, policy_version 1661779 (0.0008) [2023-12-28 07:12:15,571][106225] Updated weights for policy 1, policy_version 1665680 (0.0008) [2023-12-28 07:12:15,620][106225] Updated weights for policy 1, policy_version 1665690 (0.0008) [2023-12-28 07:12:15,673][106225] Updated weights for policy 1, policy_version 1665700 (0.0008) [2023-12-28 07:12:15,975][106226] Updated weights for policy 0, policy_version 1661789 (0.0007) [2023-12-28 07:12:16,029][106226] Updated weights for policy 0, policy_version 1661799 (0.0005) [2023-12-28 07:12:16,087][106226] Updated weights for policy 0, policy_version 1661809 (0.0005) [2023-12-28 07:12:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 851976192. Throughput: 0: 9679.4, 1: 10088.4. Samples: 851963424. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:16,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.618')] [2023-12-28 07:12:16,309][106225] Updated weights for policy 1, policy_version 1665710 (0.0008) [2023-12-28 07:12:16,372][106225] Updated weights for policy 1, policy_version 1665720 (0.0005) [2023-12-28 07:12:16,431][106225] Updated weights for policy 1, policy_version 1665730 (0.0006) [2023-12-28 07:12:16,645][106226] Updated weights for policy 0, policy_version 1661819 (0.0005) [2023-12-28 07:12:16,698][106226] Updated weights for policy 0, policy_version 1661829 (0.0008) [2023-12-28 07:12:16,754][106226] Updated weights for policy 0, policy_version 1661839 (0.0009) [2023-12-28 07:12:17,116][106225] Updated weights for policy 1, policy_version 1665740 (0.0008) [2023-12-28 07:12:17,180][106225] Updated weights for policy 1, policy_version 1665750 (0.0008) [2023-12-28 07:12:17,239][106225] Updated weights for policy 1, policy_version 1665760 (0.0008) [2023-12-28 07:12:17,427][106226] Updated weights for policy 0, policy_version 1661849 (0.0009) [2023-12-28 07:12:17,474][106226] Updated weights for policy 0, policy_version 1661859 (0.0008) [2023-12-28 07:12:17,517][106226] Updated weights for policy 0, policy_version 1661869 (0.0008) [2023-12-28 07:12:17,564][106226] Updated weights for policy 0, policy_version 1661879 (0.0007) [2023-12-28 07:12:17,900][106225] Updated weights for policy 1, policy_version 1665770 (0.0007) [2023-12-28 07:12:17,964][106225] Updated weights for policy 1, policy_version 1665780 (0.0007) [2023-12-28 07:12:18,023][106225] Updated weights for policy 1, policy_version 1665790 (0.0008) [2023-12-28 07:12:18,081][106225] Updated weights for policy 1, policy_version 1665800 (0.0009) [2023-12-28 07:12:18,289][106226] Updated weights for policy 0, policy_version 1661889 (0.0006) [2023-12-28 07:12:18,339][106226] Updated weights for policy 0, policy_version 1661899 (0.0006) [2023-12-28 07:12:18,398][106226] Updated weights for policy 0, policy_version 1661909 (0.0008) [2023-12-28 07:12:18,780][106225] Updated weights for policy 1, policy_version 1665810 (0.0009) [2023-12-28 07:12:18,833][106225] Updated weights for policy 1, policy_version 1665820 (0.0008) [2023-12-28 07:12:18,889][106225] Updated weights for policy 1, policy_version 1665830 (0.0009) [2023-12-28 07:12:19,124][106226] Updated weights for policy 0, policy_version 1661919 (0.0008) [2023-12-28 07:12:19,175][106226] Updated weights for policy 0, policy_version 1661929 (0.0008) [2023-12-28 07:12:19,233][106226] Updated weights for policy 0, policy_version 1661939 (0.0009) [2023-12-28 07:12:19,641][106225] Updated weights for policy 1, policy_version 1665840 (0.0006) [2023-12-28 07:12:19,706][106225] Updated weights for policy 1, policy_version 1665850 (0.0008) [2023-12-28 07:12:19,768][106225] Updated weights for policy 1, policy_version 1665860 (0.0008) [2023-12-28 07:12:20,009][106226] Updated weights for policy 0, policy_version 1661949 (0.0008) [2023-12-28 07:12:20,073][106226] Updated weights for policy 0, policy_version 1661959 (0.0009) [2023-12-28 07:12:20,135][106226] Updated weights for policy 0, policy_version 1661969 (0.0006) [2023-12-28 07:12:20,536][106225] Updated weights for policy 1, policy_version 1665870 (0.0006) [2023-12-28 07:12:20,601][106225] Updated weights for policy 1, policy_version 1665880 (0.0007) [2023-12-28 07:12:20,660][106225] Updated weights for policy 1, policy_version 1665890 (0.0007) [2023-12-28 07:12:20,845][106226] Updated weights for policy 0, policy_version 1661979 (0.0007) [2023-12-28 07:12:20,916][106226] Updated weights for policy 0, policy_version 1661989 (0.0006) [2023-12-28 07:12:20,983][106226] Updated weights for policy 0, policy_version 1661999 (0.0008) [2023-12-28 07:12:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 852074496. Throughput: 0: 9649.1, 1: 9983.2. Samples: 852082060. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:21,176][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.911')] [2023-12-28 07:12:21,337][106225] Updated weights for policy 1, policy_version 1665900 (0.0007) [2023-12-28 07:12:21,412][106225] Updated weights for policy 1, policy_version 1665910 (0.0007) [2023-12-28 07:12:21,470][106225] Updated weights for policy 1, policy_version 1665920 (0.0009) [2023-12-28 07:12:21,740][106226] Updated weights for policy 0, policy_version 1662009 (0.0010) [2023-12-28 07:12:21,802][106226] Updated weights for policy 0, policy_version 1662019 (0.0009) [2023-12-28 07:12:21,849][106226] Updated weights for policy 0, policy_version 1662029 (0.0007) [2023-12-28 07:12:21,906][106226] Updated weights for policy 0, policy_version 1662039 (0.0006) [2023-12-28 07:12:22,160][106225] Updated weights for policy 1, policy_version 1665930 (0.0010) [2023-12-28 07:12:22,207][106225] Updated weights for policy 1, policy_version 1665940 (0.0010) [2023-12-28 07:12:22,262][106225] Updated weights for policy 1, policy_version 1665950 (0.0006) [2023-12-28 07:12:22,328][106225] Updated weights for policy 1, policy_version 1665960 (0.0007) [2023-12-28 07:12:22,723][106226] Updated weights for policy 0, policy_version 1662049 (0.0008) [2023-12-28 07:12:22,782][106226] Updated weights for policy 0, policy_version 1662059 (0.0009) [2023-12-28 07:12:22,845][106226] Updated weights for policy 0, policy_version 1662069 (0.0009) [2023-12-28 07:12:23,041][106225] Updated weights for policy 1, policy_version 1665970 (0.0007) [2023-12-28 07:12:23,106][106225] Updated weights for policy 1, policy_version 1665980 (0.0011) [2023-12-28 07:12:23,156][106225] Updated weights for policy 1, policy_version 1665990 (0.0010) [2023-12-28 07:12:23,580][106226] Updated weights for policy 0, policy_version 1662079 (0.0008) [2023-12-28 07:12:23,632][106226] Updated weights for policy 0, policy_version 1662089 (0.0008) [2023-12-28 07:12:23,681][106226] Updated weights for policy 0, policy_version 1662099 (0.0008) [2023-12-28 07:12:23,840][106225] Updated weights for policy 1, policy_version 1666000 (0.0009) [2023-12-28 07:12:23,887][106225] Updated weights for policy 1, policy_version 1666010 (0.0010) [2023-12-28 07:12:23,930][106225] Updated weights for policy 1, policy_version 1666020 (0.0010) [2023-12-28 07:12:24,435][106226] Updated weights for policy 0, policy_version 1662109 (0.0007) [2023-12-28 07:12:24,493][106226] Updated weights for policy 0, policy_version 1662119 (0.0008) [2023-12-28 07:12:24,558][106226] Updated weights for policy 0, policy_version 1662129 (0.0008) [2023-12-28 07:12:24,692][106225] Updated weights for policy 1, policy_version 1666030 (0.0010) [2023-12-28 07:12:24,752][106225] Updated weights for policy 1, policy_version 1666040 (0.0010) [2023-12-28 07:12:24,802][106225] Updated weights for policy 1, policy_version 1666050 (0.0010) [2023-12-28 07:12:25,275][106226] Updated weights for policy 0, policy_version 1662139 (0.0008) [2023-12-28 07:12:25,325][106226] Updated weights for policy 0, policy_version 1662149 (0.0008) [2023-12-28 07:12:25,375][106226] Updated weights for policy 0, policy_version 1662159 (0.0008) [2023-12-28 07:12:25,524][106225] Updated weights for policy 1, policy_version 1666060 (0.0010) [2023-12-28 07:12:25,577][106225] Updated weights for policy 1, policy_version 1666070 (0.0010) [2023-12-28 07:12:25,626][106225] Updated weights for policy 1, policy_version 1666080 (0.0010) [2023-12-28 07:12:26,142][106226] Updated weights for policy 0, policy_version 1662169 (0.0007) [2023-12-28 07:12:26,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 852164608. Throughput: 0: 9601.3, 1: 9939.7. Samples: 852139364. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:26,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.993')] [2023-12-28 07:12:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001666088_426573824.pth... [2023-12-28 07:12:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001664936_426278912.pth [2023-12-28 07:12:26,204][106226] Updated weights for policy 0, policy_version 1662179 (0.0007) [2023-12-28 07:12:26,266][106226] Updated weights for policy 0, policy_version 1662189 (0.0006) [2023-12-28 07:12:26,299][106225] Updated weights for policy 1, policy_version 1666090 (0.0009) [2023-12-28 07:12:26,324][106226] Updated weights for policy 0, policy_version 1662199 (0.0008) [2023-12-28 07:12:26,325][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001662200_425598976.pth... [2023-12-28 07:12:26,328][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001661048_425304064.pth [2023-12-28 07:12:26,358][106225] Updated weights for policy 1, policy_version 1666100 (0.0005) [2023-12-28 07:12:26,425][106225] Updated weights for policy 1, policy_version 1666110 (0.0005) [2023-12-28 07:12:26,485][106225] Updated weights for policy 1, policy_version 1666120 (0.0005) [2023-12-28 07:12:26,990][106226] Updated weights for policy 0, policy_version 1662209 (0.0006) [2023-12-28 07:12:27,054][106226] Updated weights for policy 0, policy_version 1662219 (0.0007) [2023-12-28 07:12:27,100][106225] Updated weights for policy 1, policy_version 1666130 (0.0005) [2023-12-28 07:12:27,119][106226] Updated weights for policy 0, policy_version 1662229 (0.0007) [2023-12-28 07:12:27,148][106225] Updated weights for policy 1, policy_version 1666140 (0.0005) [2023-12-28 07:12:27,194][106225] Updated weights for policy 1, policy_version 1666150 (0.0005) [2023-12-28 07:12:27,664][106226] Updated weights for policy 0, policy_version 1662239 (0.0009) [2023-12-28 07:12:27,714][106226] Updated weights for policy 0, policy_version 1662249 (0.0009) [2023-12-28 07:12:27,753][106225] Updated weights for policy 1, policy_version 1666160 (0.0009) [2023-12-28 07:12:27,766][106226] Updated weights for policy 0, policy_version 1662259 (0.0005) [2023-12-28 07:12:27,805][106225] Updated weights for policy 1, policy_version 1666170 (0.0010) [2023-12-28 07:12:27,861][106225] Updated weights for policy 1, policy_version 1666180 (0.0010) [2023-12-28 07:12:28,317][106226] Updated weights for policy 0, policy_version 1662269 (0.0006) [2023-12-28 07:12:28,382][106226] Updated weights for policy 0, policy_version 1662279 (0.0007) [2023-12-28 07:12:28,442][106226] Updated weights for policy 0, policy_version 1662289 (0.0008) [2023-12-28 07:12:28,560][106225] Updated weights for policy 1, policy_version 1666190 (0.0009) [2023-12-28 07:12:28,619][106225] Updated weights for policy 1, policy_version 1666200 (0.0007) [2023-12-28 07:12:28,674][106225] Updated weights for policy 1, policy_version 1666210 (0.0008) [2023-12-28 07:12:29,170][106226] Updated weights for policy 0, policy_version 1662299 (0.0008) [2023-12-28 07:12:29,228][106226] Updated weights for policy 0, policy_version 1662309 (0.0008) [2023-12-28 07:12:29,283][106226] Updated weights for policy 0, policy_version 1662319 (0.0008) [2023-12-28 07:12:29,403][106225] Updated weights for policy 1, policy_version 1666220 (0.0009) [2023-12-28 07:12:29,459][106225] Updated weights for policy 1, policy_version 1666230 (0.0009) [2023-12-28 07:12:29,520][106225] Updated weights for policy 1, policy_version 1666240 (0.0011) [2023-12-28 07:12:30,027][106226] Updated weights for policy 0, policy_version 1662329 (0.0008) [2023-12-28 07:12:30,092][106226] Updated weights for policy 0, policy_version 1662339 (0.0009) [2023-12-28 07:12:30,153][106226] Updated weights for policy 0, policy_version 1662349 (0.0009) [2023-12-28 07:12:30,166][106225] Updated weights for policy 1, policy_version 1666250 (0.0010) [2023-12-28 07:12:30,205][106226] Updated weights for policy 0, policy_version 1662359 (0.0007) [2023-12-28 07:12:30,225][106225] Updated weights for policy 1, policy_version 1666260 (0.0006) [2023-12-28 07:12:30,280][106225] Updated weights for policy 1, policy_version 1666270 (0.0005) [2023-12-28 07:12:30,341][106225] Updated weights for policy 1, policy_version 1666280 (0.0007) [2023-12-28 07:12:30,967][106225] Updated weights for policy 1, policy_version 1666290 (0.0006) [2023-12-28 07:12:30,973][106226] Updated weights for policy 0, policy_version 1662369 (0.0007) [2023-12-28 07:12:31,027][106225] Updated weights for policy 1, policy_version 1666300 (0.0007) [2023-12-28 07:12:31,036][106226] Updated weights for policy 0, policy_version 1662379 (0.0008) [2023-12-28 07:12:31,090][106225] Updated weights for policy 1, policy_version 1666310 (0.0007) [2023-12-28 07:12:31,096][106226] Updated weights for policy 0, policy_version 1662389 (0.0008) [2023-12-28 07:12:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 852279296. Throughput: 0: 9731.7, 1: 10025.1. Samples: 852261240. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:31,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.597')] [2023-12-28 07:12:31,701][106225] Updated weights for policy 1, policy_version 1666320 (0.0005) [2023-12-28 07:12:31,763][106225] Updated weights for policy 1, policy_version 1666330 (0.0008) [2023-12-28 07:12:31,827][106225] Updated weights for policy 1, policy_version 1666340 (0.0006) [2023-12-28 07:12:31,904][106226] Updated weights for policy 0, policy_version 1662399 (0.0006) [2023-12-28 07:12:31,967][106226] Updated weights for policy 0, policy_version 1662409 (0.0005) [2023-12-28 07:12:32,030][106226] Updated weights for policy 0, policy_version 1662419 (0.0005) [2023-12-28 07:12:32,518][106225] Updated weights for policy 1, policy_version 1666350 (0.0009) [2023-12-28 07:12:32,588][106225] Updated weights for policy 1, policy_version 1666360 (0.0007) [2023-12-28 07:12:32,634][106226] Updated weights for policy 0, policy_version 1662429 (0.0006) [2023-12-28 07:12:32,647][106225] Updated weights for policy 1, policy_version 1666370 (0.0006) [2023-12-28 07:12:32,693][106226] Updated weights for policy 0, policy_version 1662439 (0.0005) [2023-12-28 07:12:32,762][106226] Updated weights for policy 0, policy_version 1662449 (0.0006) [2023-12-28 07:12:33,234][106225] Updated weights for policy 1, policy_version 1666380 (0.0006) [2023-12-28 07:12:33,286][106225] Updated weights for policy 1, policy_version 1666390 (0.0006) [2023-12-28 07:12:33,350][106225] Updated weights for policy 1, policy_version 1666400 (0.0008) [2023-12-28 07:12:33,360][106226] Updated weights for policy 0, policy_version 1662459 (0.0007) [2023-12-28 07:12:33,414][106226] Updated weights for policy 0, policy_version 1662469 (0.0005) [2023-12-28 07:12:33,461][106226] Updated weights for policy 0, policy_version 1662479 (0.0005) [2023-12-28 07:12:34,007][106225] Updated weights for policy 1, policy_version 1666410 (0.0007) [2023-12-28 07:12:34,057][106225] Updated weights for policy 1, policy_version 1666420 (0.0005) [2023-12-28 07:12:34,096][106226] Updated weights for policy 0, policy_version 1662489 (0.0005) [2023-12-28 07:12:34,102][106225] Updated weights for policy 1, policy_version 1666430 (0.0005) [2023-12-28 07:12:34,151][106226] Updated weights for policy 0, policy_version 1662499 (0.0008) [2023-12-28 07:12:34,154][106225] Updated weights for policy 1, policy_version 1666440 (0.0006) [2023-12-28 07:12:34,217][106226] Updated weights for policy 0, policy_version 1662509 (0.0007) [2023-12-28 07:12:34,279][106226] Updated weights for policy 0, policy_version 1662519 (0.0008) [2023-12-28 07:12:34,827][106225] Updated weights for policy 1, policy_version 1666451 (0.0009) [2023-12-28 07:12:34,873][106225] Updated weights for policy 1, policy_version 1666461 (0.0006) [2023-12-28 07:12:34,922][106225] Updated weights for policy 1, policy_version 1666471 (0.0005) [2023-12-28 07:12:35,025][106226] Updated weights for policy 0, policy_version 1662529 (0.0008) [2023-12-28 07:12:35,068][106226] Updated weights for policy 0, policy_version 1662539 (0.0008) [2023-12-28 07:12:35,118][106226] Updated weights for policy 0, policy_version 1662549 (0.0008) [2023-12-28 07:12:35,567][106225] Updated weights for policy 1, policy_version 1666481 (0.0008) [2023-12-28 07:12:35,623][106225] Updated weights for policy 1, policy_version 1666491 (0.0007) [2023-12-28 07:12:35,680][106225] Updated weights for policy 1, policy_version 1666501 (0.0005) [2023-12-28 07:12:35,893][106226] Updated weights for policy 0, policy_version 1662559 (0.0008) [2023-12-28 07:12:35,941][106226] Updated weights for policy 0, policy_version 1662569 (0.0008) [2023-12-28 07:12:35,992][106226] Updated weights for policy 0, policy_version 1662579 (0.0008) [2023-12-28 07:12:36,174][105115] Fps is (10 sec: 21299.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 852377600. Throughput: 0: 9733.4, 1: 10070.2. Samples: 852383468. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:36,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.931')] [2023-12-28 07:12:36,374][106225] Updated weights for policy 1, policy_version 1666511 (0.0008) [2023-12-28 07:12:36,443][106225] Updated weights for policy 1, policy_version 1666521 (0.0006) [2023-12-28 07:12:36,501][106225] Updated weights for policy 1, policy_version 1666531 (0.0007) [2023-12-28 07:12:36,821][106226] Updated weights for policy 0, policy_version 1662589 (0.0009) [2023-12-28 07:12:36,871][106226] Updated weights for policy 0, policy_version 1662599 (0.0009) [2023-12-28 07:12:36,940][106226] Updated weights for policy 0, policy_version 1662609 (0.0008) [2023-12-28 07:12:37,068][106225] Updated weights for policy 1, policy_version 1666541 (0.0007) [2023-12-28 07:12:37,114][106225] Updated weights for policy 1, policy_version 1666551 (0.0005) [2023-12-28 07:12:37,172][106225] Updated weights for policy 1, policy_version 1666561 (0.0009) [2023-12-28 07:12:37,718][106226] Updated weights for policy 0, policy_version 1662619 (0.0008) [2023-12-28 07:12:37,782][106226] Updated weights for policy 0, policy_version 1662629 (0.0008) [2023-12-28 07:12:37,834][106225] Updated weights for policy 1, policy_version 1666571 (0.0008) [2023-12-28 07:12:37,841][106226] Updated weights for policy 0, policy_version 1662639 (0.0009) [2023-12-28 07:12:37,888][106225] Updated weights for policy 1, policy_version 1666581 (0.0005) [2023-12-28 07:12:37,942][106225] Updated weights for policy 1, policy_version 1666591 (0.0009) [2023-12-28 07:12:38,550][106226] Updated weights for policy 0, policy_version 1662649 (0.0008) [2023-12-28 07:12:38,609][106226] Updated weights for policy 0, policy_version 1662659 (0.0009) [2023-12-28 07:12:38,652][106225] Updated weights for policy 1, policy_version 1666601 (0.0006) [2023-12-28 07:12:38,657][106226] Updated weights for policy 0, policy_version 1662669 (0.0009) [2023-12-28 07:12:38,709][106226] Updated weights for policy 0, policy_version 1662679 (0.0006) [2023-12-28 07:12:38,712][106225] Updated weights for policy 1, policy_version 1666611 (0.0006) [2023-12-28 07:12:38,776][106225] Updated weights for policy 1, policy_version 1666621 (0.0009) [2023-12-28 07:12:38,825][106225] Updated weights for policy 1, policy_version 1666631 (0.0008) [2023-12-28 07:12:39,453][106226] Updated weights for policy 0, policy_version 1662689 (0.0007) [2023-12-28 07:12:39,518][106226] Updated weights for policy 0, policy_version 1662699 (0.0007) [2023-12-28 07:12:39,584][106226] Updated weights for policy 0, policy_version 1662709 (0.0008) [2023-12-28 07:12:39,612][106225] Updated weights for policy 1, policy_version 1666641 (0.0005) [2023-12-28 07:12:39,669][106225] Updated weights for policy 1, policy_version 1666651 (0.0006) [2023-12-28 07:12:39,717][106225] Updated weights for policy 1, policy_version 1666661 (0.0009) [2023-12-28 07:12:40,287][106226] Updated weights for policy 0, policy_version 1662719 (0.0009) [2023-12-28 07:12:40,352][106226] Updated weights for policy 0, policy_version 1662729 (0.0007) [2023-12-28 07:12:40,409][106226] Updated weights for policy 0, policy_version 1662739 (0.0010) [2023-12-28 07:12:40,438][106225] Updated weights for policy 1, policy_version 1666671 (0.0007) [2023-12-28 07:12:40,492][106225] Updated weights for policy 1, policy_version 1666681 (0.0007) [2023-12-28 07:12:40,546][106225] Updated weights for policy 1, policy_version 1666691 (0.0009) [2023-12-28 07:12:41,114][106226] Updated weights for policy 0, policy_version 1662749 (0.0009) [2023-12-28 07:12:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 852467712. Throughput: 0: 9737.5, 1: 10084.6. Samples: 852443064. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:41,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.647')] [2023-12-28 07:12:41,183][106226] Updated weights for policy 0, policy_version 1662759 (0.0008) [2023-12-28 07:12:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001666696_426729472.pth... [2023-12-28 07:12:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001665544_426434560.pth [2023-12-28 07:12:41,250][106226] Updated weights for policy 0, policy_version 1662769 (0.0009) [2023-12-28 07:12:41,285][106225] Updated weights for policy 1, policy_version 1666701 (0.0010) [2023-12-28 07:12:41,299][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001662776_425746432.pth... [2023-12-28 07:12:41,304][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001661624_425451520.pth [2023-12-28 07:12:41,352][106225] Updated weights for policy 1, policy_version 1666711 (0.0007) [2023-12-28 07:12:41,424][106225] Updated weights for policy 1, policy_version 1666721 (0.0011) [2023-12-28 07:12:42,048][106226] Updated weights for policy 0, policy_version 1662779 (0.0006) [2023-12-28 07:12:42,106][106226] Updated weights for policy 0, policy_version 1662789 (0.0008) [2023-12-28 07:12:42,157][106226] Updated weights for policy 0, policy_version 1662799 (0.0006) [2023-12-28 07:12:42,188][106225] Updated weights for policy 1, policy_version 1666731 (0.0009) [2023-12-28 07:12:42,246][106225] Updated weights for policy 1, policy_version 1666741 (0.0010) [2023-12-28 07:12:42,310][106225] Updated weights for policy 1, policy_version 1666751 (0.0011) [2023-12-28 07:12:42,921][106226] Updated weights for policy 0, policy_version 1662809 (0.0010) [2023-12-28 07:12:42,987][106226] Updated weights for policy 0, policy_version 1662819 (0.0011) [2023-12-28 07:12:43,021][106225] Updated weights for policy 1, policy_version 1666761 (0.0010) [2023-12-28 07:12:43,048][106226] Updated weights for policy 0, policy_version 1662829 (0.0011) [2023-12-28 07:12:43,069][106225] Updated weights for policy 1, policy_version 1666771 (0.0006) [2023-12-28 07:12:43,109][106226] Updated weights for policy 0, policy_version 1662839 (0.0011) [2023-12-28 07:12:43,127][106225] Updated weights for policy 1, policy_version 1666781 (0.0008) [2023-12-28 07:12:43,183][106225] Updated weights for policy 1, policy_version 1666791 (0.0008) [2023-12-28 07:12:43,825][106226] Updated weights for policy 0, policy_version 1662849 (0.0011) [2023-12-28 07:12:43,882][106226] Updated weights for policy 0, policy_version 1662859 (0.0011) [2023-12-28 07:12:43,944][106226] Updated weights for policy 0, policy_version 1662869 (0.0011) [2023-12-28 07:12:44,010][106225] Updated weights for policy 1, policy_version 1666801 (0.0007) [2023-12-28 07:12:44,071][106225] Updated weights for policy 1, policy_version 1666811 (0.0008) [2023-12-28 07:12:44,131][106225] Updated weights for policy 1, policy_version 1666821 (0.0008) [2023-12-28 07:12:44,645][106226] Updated weights for policy 0, policy_version 1662879 (0.0008) [2023-12-28 07:12:44,696][106226] Updated weights for policy 0, policy_version 1662889 (0.0005) [2023-12-28 07:12:44,762][106226] Updated weights for policy 0, policy_version 1662899 (0.0007) [2023-12-28 07:12:44,867][106225] Updated weights for policy 1, policy_version 1666831 (0.0006) [2023-12-28 07:12:44,917][106225] Updated weights for policy 1, policy_version 1666841 (0.0007) [2023-12-28 07:12:44,977][106225] Updated weights for policy 1, policy_version 1666851 (0.0008) [2023-12-28 07:12:45,510][106226] Updated weights for policy 0, policy_version 1662909 (0.0008) [2023-12-28 07:12:45,575][106226] Updated weights for policy 0, policy_version 1662919 (0.0008) [2023-12-28 07:12:45,626][106226] Updated weights for policy 0, policy_version 1662929 (0.0008) [2023-12-28 07:12:45,705][106225] Updated weights for policy 1, policy_version 1666861 (0.0008) [2023-12-28 07:12:45,761][106225] Updated weights for policy 1, policy_version 1666871 (0.0008) [2023-12-28 07:12:45,820][106225] Updated weights for policy 1, policy_version 1666881 (0.0008) [2023-12-28 07:12:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 852566016. Throughput: 0: 9762.0, 1: 9908.9. Samples: 852556220. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:46,176][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.492')] [2023-12-28 07:12:46,349][106226] Updated weights for policy 0, policy_version 1662939 (0.0009) [2023-12-28 07:12:46,413][106226] Updated weights for policy 0, policy_version 1662949 (0.0009) [2023-12-28 07:12:46,469][106226] Updated weights for policy 0, policy_version 1662959 (0.0009) [2023-12-28 07:12:46,541][106225] Updated weights for policy 1, policy_version 1666891 (0.0009) [2023-12-28 07:12:46,601][106225] Updated weights for policy 1, policy_version 1666901 (0.0008) [2023-12-28 07:12:46,662][106225] Updated weights for policy 1, policy_version 1666911 (0.0009) [2023-12-28 07:12:47,114][106226] Updated weights for policy 0, policy_version 1662969 (0.0008) [2023-12-28 07:12:47,171][106226] Updated weights for policy 0, policy_version 1662979 (0.0008) [2023-12-28 07:12:47,228][106226] Updated weights for policy 0, policy_version 1662989 (0.0008) [2023-12-28 07:12:47,284][106226] Updated weights for policy 0, policy_version 1662999 (0.0008) [2023-12-28 07:12:47,440][106225] Updated weights for policy 1, policy_version 1666921 (0.0008) [2023-12-28 07:12:47,490][106225] Updated weights for policy 1, policy_version 1666931 (0.0008) [2023-12-28 07:12:47,534][106225] Updated weights for policy 1, policy_version 1666941 (0.0005) [2023-12-28 07:12:47,580][106225] Updated weights for policy 1, policy_version 1666951 (0.0005) [2023-12-28 07:12:47,845][106226] Updated weights for policy 0, policy_version 1663009 (0.0006) [2023-12-28 07:12:47,907][106226] Updated weights for policy 0, policy_version 1663019 (0.0009) [2023-12-28 07:12:47,969][106226] Updated weights for policy 0, policy_version 1663029 (0.0007) [2023-12-28 07:12:48,302][106225] Updated weights for policy 1, policy_version 1666961 (0.0008) [2023-12-28 07:12:48,367][106225] Updated weights for policy 1, policy_version 1666971 (0.0007) [2023-12-28 07:12:48,426][106225] Updated weights for policy 1, policy_version 1666981 (0.0006) [2023-12-28 07:12:48,638][106226] Updated weights for policy 0, policy_version 1663039 (0.0010) [2023-12-28 07:12:48,705][106226] Updated weights for policy 0, policy_version 1663049 (0.0008) [2023-12-28 07:12:48,769][106226] Updated weights for policy 0, policy_version 1663059 (0.0011) [2023-12-28 07:12:49,122][106225] Updated weights for policy 1, policy_version 1666991 (0.0010) [2023-12-28 07:12:49,182][106225] Updated weights for policy 1, policy_version 1667001 (0.0010) [2023-12-28 07:12:49,250][106225] Updated weights for policy 1, policy_version 1667011 (0.0009) [2023-12-28 07:12:49,480][106226] Updated weights for policy 0, policy_version 1663069 (0.0010) [2023-12-28 07:12:49,537][106226] Updated weights for policy 0, policy_version 1663079 (0.0010) [2023-12-28 07:12:49,602][106226] Updated weights for policy 0, policy_version 1663089 (0.0008) [2023-12-28 07:12:49,981][106225] Updated weights for policy 1, policy_version 1667021 (0.0008) [2023-12-28 07:12:50,043][106225] Updated weights for policy 1, policy_version 1667031 (0.0006) [2023-12-28 07:12:50,100][106225] Updated weights for policy 1, policy_version 1667041 (0.0007) [2023-12-28 07:12:50,342][106226] Updated weights for policy 0, policy_version 1663099 (0.0011) [2023-12-28 07:12:50,408][106226] Updated weights for policy 0, policy_version 1663109 (0.0011) [2023-12-28 07:12:50,465][106226] Updated weights for policy 0, policy_version 1663119 (0.0011) [2023-12-28 07:12:50,781][106225] Updated weights for policy 1, policy_version 1667051 (0.0008) [2023-12-28 07:12:50,839][106225] Updated weights for policy 1, policy_version 1667061 (0.0008) [2023-12-28 07:12:50,901][106225] Updated weights for policy 1, policy_version 1667071 (0.0008) [2023-12-28 07:12:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 852664320. Throughput: 0: 9752.8, 1: 9860.2. Samples: 852674380. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:51,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.946')] [2023-12-28 07:12:51,204][106226] Updated weights for policy 0, policy_version 1663129 (0.0010) [2023-12-28 07:12:51,275][106226] Updated weights for policy 0, policy_version 1663139 (0.0008) [2023-12-28 07:12:51,348][106226] Updated weights for policy 0, policy_version 1663149 (0.0008) [2023-12-28 07:12:51,422][106226] Updated weights for policy 0, policy_version 1663159 (0.0009) [2023-12-28 07:12:51,591][106225] Updated weights for policy 1, policy_version 1667081 (0.0007) [2023-12-28 07:12:51,657][106225] Updated weights for policy 1, policy_version 1667091 (0.0007) [2023-12-28 07:12:51,712][106225] Updated weights for policy 1, policy_version 1667101 (0.0009) [2023-12-28 07:12:51,779][106225] Updated weights for policy 1, policy_version 1667111 (0.0008) [2023-12-28 07:12:52,133][106226] Updated weights for policy 0, policy_version 1663169 (0.0009) [2023-12-28 07:12:52,189][106226] Updated weights for policy 0, policy_version 1663179 (0.0009) [2023-12-28 07:12:52,252][106226] Updated weights for policy 0, policy_version 1663189 (0.0008) [2023-12-28 07:12:52,503][106225] Updated weights for policy 1, policy_version 1667121 (0.0009) [2023-12-28 07:12:52,562][106225] Updated weights for policy 1, policy_version 1667131 (0.0009) [2023-12-28 07:12:52,616][106225] Updated weights for policy 1, policy_version 1667141 (0.0009) [2023-12-28 07:12:52,936][106226] Updated weights for policy 0, policy_version 1663199 (0.0008) [2023-12-28 07:12:52,994][106226] Updated weights for policy 0, policy_version 1663209 (0.0008) [2023-12-28 07:12:53,054][106226] Updated weights for policy 0, policy_version 1663219 (0.0008) [2023-12-28 07:12:53,370][106225] Updated weights for policy 1, policy_version 1667151 (0.0008) [2023-12-28 07:12:53,413][106225] Updated weights for policy 1, policy_version 1667161 (0.0008) [2023-12-28 07:12:53,459][106225] Updated weights for policy 1, policy_version 1667171 (0.0007) [2023-12-28 07:12:53,786][106226] Updated weights for policy 0, policy_version 1663229 (0.0010) [2023-12-28 07:12:53,832][106226] Updated weights for policy 0, policy_version 1663239 (0.0010) [2023-12-28 07:12:53,878][106226] Updated weights for policy 0, policy_version 1663249 (0.0010) [2023-12-28 07:12:54,229][106225] Updated weights for policy 1, policy_version 1667181 (0.0008) [2023-12-28 07:12:54,290][106225] Updated weights for policy 1, policy_version 1667191 (0.0008) [2023-12-28 07:12:54,346][106225] Updated weights for policy 1, policy_version 1667201 (0.0007) [2023-12-28 07:12:54,622][106226] Updated weights for policy 0, policy_version 1663259 (0.0010) [2023-12-28 07:12:54,678][106226] Updated weights for policy 0, policy_version 1663269 (0.0010) [2023-12-28 07:12:54,734][106226] Updated weights for policy 0, policy_version 1663279 (0.0011) [2023-12-28 07:12:55,082][106225] Updated weights for policy 1, policy_version 1667211 (0.0007) [2023-12-28 07:12:55,149][106225] Updated weights for policy 1, policy_version 1667221 (0.0008) [2023-12-28 07:12:55,205][106225] Updated weights for policy 1, policy_version 1667231 (0.0008) [2023-12-28 07:12:55,459][106226] Updated weights for policy 0, policy_version 1663289 (0.0010) [2023-12-28 07:12:55,523][106226] Updated weights for policy 0, policy_version 1663299 (0.0007) [2023-12-28 07:12:55,587][106226] Updated weights for policy 0, policy_version 1663309 (0.0005) [2023-12-28 07:12:55,642][106226] Updated weights for policy 0, policy_version 1663319 (0.0005) [2023-12-28 07:12:55,945][106225] Updated weights for policy 1, policy_version 1667241 (0.0007) [2023-12-28 07:12:55,995][106225] Updated weights for policy 1, policy_version 1667251 (0.0008) [2023-12-28 07:12:56,050][106225] Updated weights for policy 1, policy_version 1667261 (0.0008) [2023-12-28 07:12:56,114][106225] Updated weights for policy 1, policy_version 1667271 (0.0008) [2023-12-28 07:12:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 852762624. Throughput: 0: 9709.3, 1: 9832.2. Samples: 852731020. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:12:56,175][105115] Avg episode reward: [(0, '-4.623'), (1, '-4.926')] [2023-12-28 07:12:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001663320_425885696.pth... [2023-12-28 07:12:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001667272_426876928.pth... [2023-12-28 07:12:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001662200_425598976.pth [2023-12-28 07:12:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001666088_426573824.pth [2023-12-28 07:12:56,288][106226] Updated weights for policy 0, policy_version 1663329 (0.0010) [2023-12-28 07:12:56,342][106226] Updated weights for policy 0, policy_version 1663339 (0.0008) [2023-12-28 07:12:56,395][106226] Updated weights for policy 0, policy_version 1663349 (0.0005) [2023-12-28 07:12:56,774][106225] Updated weights for policy 1, policy_version 1667281 (0.0010) [2023-12-28 07:12:56,826][106225] Updated weights for policy 1, policy_version 1667291 (0.0010) [2023-12-28 07:12:56,881][106225] Updated weights for policy 1, policy_version 1667301 (0.0010) [2023-12-28 07:12:57,093][106226] Updated weights for policy 0, policy_version 1663359 (0.0010) [2023-12-28 07:12:57,139][106226] Updated weights for policy 0, policy_version 1663369 (0.0010) [2023-12-28 07:12:57,191][106226] Updated weights for policy 0, policy_version 1663379 (0.0010) [2023-12-28 07:12:57,500][106225] Updated weights for policy 1, policy_version 1667311 (0.0007) [2023-12-28 07:12:57,560][106225] Updated weights for policy 1, policy_version 1667321 (0.0005) [2023-12-28 07:12:57,622][106225] Updated weights for policy 1, policy_version 1667331 (0.0005) [2023-12-28 07:12:57,882][106226] Updated weights for policy 0, policy_version 1663389 (0.0008) [2023-12-28 07:12:57,932][106226] Updated weights for policy 0, policy_version 1663399 (0.0005) [2023-12-28 07:12:57,988][106226] Updated weights for policy 0, policy_version 1663409 (0.0007) [2023-12-28 07:12:58,122][106225] Updated weights for policy 1, policy_version 1667341 (0.0008) [2023-12-28 07:12:58,174][106225] Updated weights for policy 1, policy_version 1667351 (0.0010) [2023-12-28 07:12:58,238][106225] Updated weights for policy 1, policy_version 1667361 (0.0009) [2023-12-28 07:12:58,812][106226] Updated weights for policy 0, policy_version 1663419 (0.0007) [2023-12-28 07:12:58,880][106226] Updated weights for policy 0, policy_version 1663429 (0.0008) [2023-12-28 07:12:58,951][106226] Updated weights for policy 0, policy_version 1663439 (0.0010) [2023-12-28 07:12:59,025][106225] Updated weights for policy 1, policy_version 1667371 (0.0010) [2023-12-28 07:12:59,088][106225] Updated weights for policy 1, policy_version 1667381 (0.0011) [2023-12-28 07:12:59,146][106225] Updated weights for policy 1, policy_version 1667391 (0.0010) [2023-12-28 07:12:59,730][106226] Updated weights for policy 0, policy_version 1663449 (0.0008) [2023-12-28 07:12:59,792][106226] Updated weights for policy 0, policy_version 1663459 (0.0009) [2023-12-28 07:12:59,860][106226] Updated weights for policy 0, policy_version 1663469 (0.0010) [2023-12-28 07:12:59,882][106225] Updated weights for policy 1, policy_version 1667401 (0.0010) [2023-12-28 07:12:59,919][106226] Updated weights for policy 0, policy_version 1663479 (0.0008) [2023-12-28 07:12:59,949][106225] Updated weights for policy 1, policy_version 1667411 (0.0008) [2023-12-28 07:13:00,012][106225] Updated weights for policy 1, policy_version 1667421 (0.0010) [2023-12-28 07:13:00,075][106225] Updated weights for policy 1, policy_version 1667431 (0.0009) [2023-12-28 07:13:00,566][106226] Updated weights for policy 0, policy_version 1663489 (0.0009) [2023-12-28 07:13:00,630][106226] Updated weights for policy 0, policy_version 1663499 (0.0009) [2023-12-28 07:13:00,684][106225] Updated weights for policy 1, policy_version 1667441 (0.0006) [2023-12-28 07:13:00,688][106226] Updated weights for policy 0, policy_version 1663509 (0.0009) [2023-12-28 07:13:00,737][106225] Updated weights for policy 1, policy_version 1667451 (0.0005) [2023-12-28 07:13:00,792][106225] Updated weights for policy 1, policy_version 1667461 (0.0005) [2023-12-28 07:13:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 852860928. Throughput: 0: 9731.4, 1: 9959.8. Samples: 852849528. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:01,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.822')] [2023-12-28 07:13:01,455][106226] Updated weights for policy 0, policy_version 1663519 (0.0006) [2023-12-28 07:13:01,517][106226] Updated weights for policy 0, policy_version 1663529 (0.0006) [2023-12-28 07:13:01,522][106225] Updated weights for policy 1, policy_version 1667471 (0.0007) [2023-12-28 07:13:01,576][106226] Updated weights for policy 0, policy_version 1663539 (0.0006) [2023-12-28 07:13:01,578][106225] Updated weights for policy 1, policy_version 1667481 (0.0007) [2023-12-28 07:13:01,641][106225] Updated weights for policy 1, policy_version 1667491 (0.0007) [2023-12-28 07:13:02,182][106226] Updated weights for policy 0, policy_version 1663549 (0.0008) [2023-12-28 07:13:02,231][106226] Updated weights for policy 0, policy_version 1663559 (0.0008) [2023-12-28 07:13:02,296][106226] Updated weights for policy 0, policy_version 1663569 (0.0009) [2023-12-28 07:13:02,380][106225] Updated weights for policy 1, policy_version 1667501 (0.0007) [2023-12-28 07:13:02,435][106225] Updated weights for policy 1, policy_version 1667511 (0.0009) [2023-12-28 07:13:02,488][106225] Updated weights for policy 1, policy_version 1667521 (0.0008) [2023-12-28 07:13:02,990][106226] Updated weights for policy 0, policy_version 1663579 (0.0009) [2023-12-28 07:13:03,046][106226] Updated weights for policy 0, policy_version 1663589 (0.0009) [2023-12-28 07:13:03,108][106226] Updated weights for policy 0, policy_version 1663599 (0.0008) [2023-12-28 07:13:03,247][106225] Updated weights for policy 1, policy_version 1667531 (0.0007) [2023-12-28 07:13:03,296][106225] Updated weights for policy 1, policy_version 1667541 (0.0008) [2023-12-28 07:13:03,354][106225] Updated weights for policy 1, policy_version 1667551 (0.0009) [2023-12-28 07:13:03,730][106226] Updated weights for policy 0, policy_version 1663609 (0.0008) [2023-12-28 07:13:03,785][106226] Updated weights for policy 0, policy_version 1663619 (0.0005) [2023-12-28 07:13:03,837][106226] Updated weights for policy 0, policy_version 1663629 (0.0006) [2023-12-28 07:13:03,897][106226] Updated weights for policy 0, policy_version 1663639 (0.0008) [2023-12-28 07:13:04,015][106225] Updated weights for policy 1, policy_version 1667561 (0.0008) [2023-12-28 07:13:04,074][106225] Updated weights for policy 1, policy_version 1667571 (0.0008) [2023-12-28 07:13:04,134][106225] Updated weights for policy 1, policy_version 1667581 (0.0008) [2023-12-28 07:13:04,196][106225] Updated weights for policy 1, policy_version 1667591 (0.0009) [2023-12-28 07:13:04,590][106226] Updated weights for policy 0, policy_version 1663649 (0.0009) [2023-12-28 07:13:04,647][106226] Updated weights for policy 0, policy_version 1663659 (0.0011) [2023-12-28 07:13:04,704][106226] Updated weights for policy 0, policy_version 1663669 (0.0010) [2023-12-28 07:13:04,930][106225] Updated weights for policy 1, policy_version 1667601 (0.0007) [2023-12-28 07:13:04,976][106225] Updated weights for policy 1, policy_version 1667611 (0.0008) [2023-12-28 07:13:05,023][106225] Updated weights for policy 1, policy_version 1667621 (0.0008) [2023-12-28 07:13:05,368][106226] Updated weights for policy 0, policy_version 1663679 (0.0007) [2023-12-28 07:13:05,417][106226] Updated weights for policy 0, policy_version 1663689 (0.0005) [2023-12-28 07:13:05,474][106226] Updated weights for policy 0, policy_version 1663699 (0.0005) [2023-12-28 07:13:05,725][106225] Updated weights for policy 1, policy_version 1667631 (0.0010) [2023-12-28 07:13:05,775][106225] Updated weights for policy 1, policy_version 1667641 (0.0010) [2023-12-28 07:13:05,826][106225] Updated weights for policy 1, policy_version 1667651 (0.0010) [2023-12-28 07:13:05,998][106226] Updated weights for policy 0, policy_version 1663709 (0.0005) [2023-12-28 07:13:06,046][106226] Updated weights for policy 0, policy_version 1663719 (0.0006) [2023-12-28 07:13:06,100][106226] Updated weights for policy 0, policy_version 1663729 (0.0008) [2023-12-28 07:13:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 852967424. Throughput: 0: 9815.5, 1: 9983.8. Samples: 852973028. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:06,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.932')] [2023-12-28 07:13:06,615][106225] Updated weights for policy 1, policy_version 1667661 (0.0008) [2023-12-28 07:13:06,680][106225] Updated weights for policy 1, policy_version 1667671 (0.0007) [2023-12-28 07:13:06,746][106225] Updated weights for policy 1, policy_version 1667681 (0.0008) [2023-12-28 07:13:06,830][106226] Updated weights for policy 0, policy_version 1663739 (0.0011) [2023-12-28 07:13:06,895][106226] Updated weights for policy 0, policy_version 1663749 (0.0011) [2023-12-28 07:13:06,960][106226] Updated weights for policy 0, policy_version 1663759 (0.0011) [2023-12-28 07:13:07,403][106225] Updated weights for policy 1, policy_version 1667691 (0.0007) [2023-12-28 07:13:07,464][106225] Updated weights for policy 1, policy_version 1667701 (0.0007) [2023-12-28 07:13:07,521][106225] Updated weights for policy 1, policy_version 1667711 (0.0008) [2023-12-28 07:13:07,671][106226] Updated weights for policy 0, policy_version 1663769 (0.0011) [2023-12-28 07:13:07,720][106226] Updated weights for policy 0, policy_version 1663779 (0.0010) [2023-12-28 07:13:07,774][106226] Updated weights for policy 0, policy_version 1663789 (0.0011) [2023-12-28 07:13:07,827][106226] Updated weights for policy 0, policy_version 1663799 (0.0010) [2023-12-28 07:13:08,175][106225] Updated weights for policy 1, policy_version 1667721 (0.0006) [2023-12-28 07:13:08,244][106225] Updated weights for policy 1, policy_version 1667731 (0.0005) [2023-12-28 07:13:08,301][106225] Updated weights for policy 1, policy_version 1667741 (0.0005) [2023-12-28 07:13:08,363][106225] Updated weights for policy 1, policy_version 1667751 (0.0007) [2023-12-28 07:13:08,559][106226] Updated weights for policy 0, policy_version 1663809 (0.0010) [2023-12-28 07:13:08,623][106226] Updated weights for policy 0, policy_version 1663819 (0.0011) [2023-12-28 07:13:08,687][106226] Updated weights for policy 0, policy_version 1663829 (0.0011) [2023-12-28 07:13:09,033][106225] Updated weights for policy 1, policy_version 1667761 (0.0010) [2023-12-28 07:13:09,095][106225] Updated weights for policy 1, policy_version 1667771 (0.0010) [2023-12-28 07:13:09,156][106225] Updated weights for policy 1, policy_version 1667781 (0.0010) [2023-12-28 07:13:09,397][106226] Updated weights for policy 0, policy_version 1663839 (0.0009) [2023-12-28 07:13:09,464][106226] Updated weights for policy 0, policy_version 1663849 (0.0008) [2023-12-28 07:13:09,525][106226] Updated weights for policy 0, policy_version 1663859 (0.0008) [2023-12-28 07:13:09,880][106225] Updated weights for policy 1, policy_version 1667791 (0.0009) [2023-12-28 07:13:09,941][106225] Updated weights for policy 1, policy_version 1667801 (0.0009) [2023-12-28 07:13:10,007][106225] Updated weights for policy 1, policy_version 1667811 (0.0008) [2023-12-28 07:13:10,360][106226] Updated weights for policy 0, policy_version 1663869 (0.0010) [2023-12-28 07:13:10,423][106226] Updated weights for policy 0, policy_version 1663879 (0.0009) [2023-12-28 07:13:10,482][106226] Updated weights for policy 0, policy_version 1663889 (0.0008) [2023-12-28 07:13:10,684][106225] Updated weights for policy 1, policy_version 1667821 (0.0007) [2023-12-28 07:13:10,732][106225] Updated weights for policy 1, policy_version 1667831 (0.0006) [2023-12-28 07:13:10,788][106225] Updated weights for policy 1, policy_version 1667841 (0.0006) [2023-12-28 07:13:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 853057536. Throughput: 0: 9845.6, 1: 9987.7. Samples: 853031860. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:11,175][105115] Avg episode reward: [(0, '-4.129'), (1, '-4.685')] [2023-12-28 07:13:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001667848_427024384.pth... [2023-12-28 07:13:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001666696_426729472.pth [2023-12-28 07:13:11,193][106226] Updated weights for policy 0, policy_version 1663899 (0.0008) [2023-12-28 07:13:11,259][106226] Updated weights for policy 0, policy_version 1663909 (0.0008) [2023-12-28 07:13:11,325][106226] Updated weights for policy 0, policy_version 1663919 (0.0009) [2023-12-28 07:13:11,383][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001663928_426041344.pth... [2023-12-28 07:13:11,388][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001662776_425746432.pth [2023-12-28 07:13:11,520][106225] Updated weights for policy 1, policy_version 1667851 (0.0008) [2023-12-28 07:13:11,582][106225] Updated weights for policy 1, policy_version 1667861 (0.0009) [2023-12-28 07:13:11,647][106225] Updated weights for policy 1, policy_version 1667871 (0.0009) [2023-12-28 07:13:12,147][106226] Updated weights for policy 0, policy_version 1663929 (0.0010) [2023-12-28 07:13:12,215][106226] Updated weights for policy 0, policy_version 1663939 (0.0009) [2023-12-28 07:13:12,277][106226] Updated weights for policy 0, policy_version 1663949 (0.0008) [2023-12-28 07:13:12,344][106226] Updated weights for policy 0, policy_version 1663959 (0.0008) [2023-12-28 07:13:12,432][106225] Updated weights for policy 1, policy_version 1667881 (0.0007) [2023-12-28 07:13:12,494][106225] Updated weights for policy 1, policy_version 1667891 (0.0008) [2023-12-28 07:13:12,558][106225] Updated weights for policy 1, policy_version 1667901 (0.0009) [2023-12-28 07:13:12,621][106225] Updated weights for policy 1, policy_version 1667911 (0.0008) [2023-12-28 07:13:13,064][106226] Updated weights for policy 0, policy_version 1663969 (0.0008) [2023-12-28 07:13:13,123][106226] Updated weights for policy 0, policy_version 1663979 (0.0009) [2023-12-28 07:13:13,181][106226] Updated weights for policy 0, policy_version 1663989 (0.0009) [2023-12-28 07:13:13,355][106225] Updated weights for policy 1, policy_version 1667921 (0.0008) [2023-12-28 07:13:13,410][106225] Updated weights for policy 1, policy_version 1667931 (0.0009) [2023-12-28 07:13:13,467][106225] Updated weights for policy 1, policy_version 1667941 (0.0007) [2023-12-28 07:13:13,825][106226] Updated weights for policy 0, policy_version 1663999 (0.0006) [2023-12-28 07:13:13,883][106226] Updated weights for policy 0, policy_version 1664009 (0.0005) [2023-12-28 07:13:13,934][106226] Updated weights for policy 0, policy_version 1664019 (0.0009) [2023-12-28 07:13:14,080][106225] Updated weights for policy 1, policy_version 1667951 (0.0007) [2023-12-28 07:13:14,145][106225] Updated weights for policy 1, policy_version 1667961 (0.0008) [2023-12-28 07:13:14,199][106225] Updated weights for policy 1, policy_version 1667971 (0.0007) [2023-12-28 07:13:14,683][106226] Updated weights for policy 0, policy_version 1664029 (0.0009) [2023-12-28 07:13:14,747][106226] Updated weights for policy 0, policy_version 1664039 (0.0008) [2023-12-28 07:13:14,828][106226] Updated weights for policy 0, policy_version 1664049 (0.0009) [2023-12-28 07:13:14,957][106225] Updated weights for policy 1, policy_version 1667981 (0.0008) [2023-12-28 07:13:15,018][106225] Updated weights for policy 1, policy_version 1667991 (0.0009) [2023-12-28 07:13:15,086][106225] Updated weights for policy 1, policy_version 1668001 (0.0009) [2023-12-28 07:13:15,514][106226] Updated weights for policy 0, policy_version 1664059 (0.0009) [2023-12-28 07:13:15,572][106226] Updated weights for policy 0, policy_version 1664069 (0.0008) [2023-12-28 07:13:15,626][106226] Updated weights for policy 0, policy_version 1664079 (0.0008) [2023-12-28 07:13:15,865][106225] Updated weights for policy 1, policy_version 1668011 (0.0009) [2023-12-28 07:13:15,912][106225] Updated weights for policy 1, policy_version 1668021 (0.0010) [2023-12-28 07:13:15,961][106225] Updated weights for policy 1, policy_version 1668031 (0.0010) [2023-12-28 07:13:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 853155840. Throughput: 0: 9733.3, 1: 9915.0. Samples: 853145416. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:16,176][105115] Avg episode reward: [(0, '-4.358'), (1, '-5.039')] [2023-12-28 07:13:16,254][106226] Updated weights for policy 0, policy_version 1664089 (0.0008) [2023-12-28 07:13:16,318][106226] Updated weights for policy 0, policy_version 1664099 (0.0009) [2023-12-28 07:13:16,383][106226] Updated weights for policy 0, policy_version 1664109 (0.0009) [2023-12-28 07:13:16,450][106226] Updated weights for policy 0, policy_version 1664119 (0.0008) [2023-12-28 07:13:16,614][106225] Updated weights for policy 1, policy_version 1668041 (0.0009) [2023-12-28 07:13:16,670][106225] Updated weights for policy 1, policy_version 1668051 (0.0010) [2023-12-28 07:13:16,733][106225] Updated weights for policy 1, policy_version 1668061 (0.0010) [2023-12-28 07:13:16,786][106225] Updated weights for policy 1, policy_version 1668071 (0.0006) [2023-12-28 07:13:17,183][106226] Updated weights for policy 0, policy_version 1664129 (0.0006) [2023-12-28 07:13:17,231][106226] Updated weights for policy 0, policy_version 1664139 (0.0005) [2023-12-28 07:13:17,290][106226] Updated weights for policy 0, policy_version 1664149 (0.0005) [2023-12-28 07:13:17,452][106225] Updated weights for policy 1, policy_version 1668081 (0.0007) [2023-12-28 07:13:17,503][106225] Updated weights for policy 1, policy_version 1668091 (0.0009) [2023-12-28 07:13:17,553][106225] Updated weights for policy 1, policy_version 1668101 (0.0009) [2023-12-28 07:13:17,860][106226] Updated weights for policy 0, policy_version 1664159 (0.0006) [2023-12-28 07:13:17,912][106226] Updated weights for policy 0, policy_version 1664169 (0.0008) [2023-12-28 07:13:17,972][106226] Updated weights for policy 0, policy_version 1664179 (0.0009) [2023-12-28 07:13:18,243][106225] Updated weights for policy 1, policy_version 1668111 (0.0007) [2023-12-28 07:13:18,298][106225] Updated weights for policy 1, policy_version 1668121 (0.0005) [2023-12-28 07:13:18,362][106225] Updated weights for policy 1, policy_version 1668131 (0.0007) [2023-12-28 07:13:18,644][106226] Updated weights for policy 0, policy_version 1664189 (0.0008) [2023-12-28 07:13:18,711][106226] Updated weights for policy 0, policy_version 1664199 (0.0009) [2023-12-28 07:13:18,782][106226] Updated weights for policy 0, policy_version 1664209 (0.0009) [2023-12-28 07:13:18,972][106225] Updated weights for policy 1, policy_version 1668141 (0.0008) [2023-12-28 07:13:19,029][106225] Updated weights for policy 1, policy_version 1668151 (0.0008) [2023-12-28 07:13:19,091][106225] Updated weights for policy 1, policy_version 1668161 (0.0008) [2023-12-28 07:13:19,531][106226] Updated weights for policy 0, policy_version 1664219 (0.0009) [2023-12-28 07:13:19,588][106226] Updated weights for policy 0, policy_version 1664229 (0.0006) [2023-12-28 07:13:19,641][106226] Updated weights for policy 0, policy_version 1664239 (0.0005) [2023-12-28 07:13:19,943][106225] Updated weights for policy 1, policy_version 1668171 (0.0009) [2023-12-28 07:13:20,009][106225] Updated weights for policy 1, policy_version 1668181 (0.0011) [2023-12-28 07:13:20,076][106225] Updated weights for policy 1, policy_version 1668191 (0.0011) [2023-12-28 07:13:20,437][106226] Updated weights for policy 0, policy_version 1664249 (0.0008) [2023-12-28 07:13:20,496][106226] Updated weights for policy 0, policy_version 1664259 (0.0011) [2023-12-28 07:13:20,551][106226] Updated weights for policy 0, policy_version 1664269 (0.0008) [2023-12-28 07:13:20,629][106226] Updated weights for policy 0, policy_version 1664279 (0.0007) [2023-12-28 07:13:20,712][106225] Updated weights for policy 1, policy_version 1668201 (0.0010) [2023-12-28 07:13:20,784][106225] Updated weights for policy 1, policy_version 1668211 (0.0006) [2023-12-28 07:13:20,844][106225] Updated weights for policy 1, policy_version 1668221 (0.0007) [2023-12-28 07:13:20,909][106225] Updated weights for policy 1, policy_version 1668231 (0.0007) [2023-12-28 07:13:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 853254144. Throughput: 0: 9759.4, 1: 9820.2. Samples: 853264552. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:21,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-4.741')] [2023-12-28 07:13:21,372][106226] Updated weights for policy 0, policy_version 1664289 (0.0009) [2023-12-28 07:13:21,443][106226] Updated weights for policy 0, policy_version 1664299 (0.0011) [2023-12-28 07:13:21,509][106226] Updated weights for policy 0, policy_version 1664309 (0.0011) [2023-12-28 07:13:21,576][106225] Updated weights for policy 1, policy_version 1668241 (0.0008) [2023-12-28 07:13:21,633][106225] Updated weights for policy 1, policy_version 1668251 (0.0008) [2023-12-28 07:13:21,707][106225] Updated weights for policy 1, policy_version 1668261 (0.0008) [2023-12-28 07:13:22,246][106226] Updated weights for policy 0, policy_version 1664319 (0.0009) [2023-12-28 07:13:22,316][106226] Updated weights for policy 0, policy_version 1664329 (0.0009) [2023-12-28 07:13:22,383][106226] Updated weights for policy 0, policy_version 1664339 (0.0008) [2023-12-28 07:13:22,447][106225] Updated weights for policy 1, policy_version 1668271 (0.0008) [2023-12-28 07:13:22,508][106225] Updated weights for policy 1, policy_version 1668281 (0.0009) [2023-12-28 07:13:22,573][106225] Updated weights for policy 1, policy_version 1668291 (0.0009) [2023-12-28 07:13:23,180][106226] Updated weights for policy 0, policy_version 1664349 (0.0007) [2023-12-28 07:13:23,210][106225] Updated weights for policy 1, policy_version 1668301 (0.0008) [2023-12-28 07:13:23,229][106226] Updated weights for policy 0, policy_version 1664359 (0.0007) [2023-12-28 07:13:23,270][106225] Updated weights for policy 1, policy_version 1668311 (0.0010) [2023-12-28 07:13:23,288][106226] Updated weights for policy 0, policy_version 1664369 (0.0009) [2023-12-28 07:13:23,329][106225] Updated weights for policy 1, policy_version 1668321 (0.0007) [2023-12-28 07:13:23,986][106225] Updated weights for policy 1, policy_version 1668331 (0.0008) [2023-12-28 07:13:24,041][106225] Updated weights for policy 1, policy_version 1668341 (0.0005) [2023-12-28 07:13:24,056][106226] Updated weights for policy 0, policy_version 1664379 (0.0007) [2023-12-28 07:13:24,094][106225] Updated weights for policy 1, policy_version 1668351 (0.0006) [2023-12-28 07:13:24,111][106226] Updated weights for policy 0, policy_version 1664389 (0.0007) [2023-12-28 07:13:24,170][106226] Updated weights for policy 0, policy_version 1664399 (0.0009) [2023-12-28 07:13:24,727][106225] Updated weights for policy 1, policy_version 1668361 (0.0007) [2023-12-28 07:13:24,797][106225] Updated weights for policy 1, policy_version 1668371 (0.0006) [2023-12-28 07:13:24,855][106225] Updated weights for policy 1, policy_version 1668381 (0.0008) [2023-12-28 07:13:24,875][106226] Updated weights for policy 0, policy_version 1664409 (0.0008) [2023-12-28 07:13:24,911][106225] Updated weights for policy 1, policy_version 1668391 (0.0007) [2023-12-28 07:13:24,936][106226] Updated weights for policy 0, policy_version 1664419 (0.0007) [2023-12-28 07:13:24,987][106226] Updated weights for policy 0, policy_version 1664429 (0.0008) [2023-12-28 07:13:25,046][106226] Updated weights for policy 0, policy_version 1664439 (0.0008) [2023-12-28 07:13:25,560][106225] Updated weights for policy 1, policy_version 1668401 (0.0005) [2023-12-28 07:13:25,615][106225] Updated weights for policy 1, policy_version 1668411 (0.0005) [2023-12-28 07:13:25,678][106225] Updated weights for policy 1, policy_version 1668421 (0.0005) [2023-12-28 07:13:25,738][106226] Updated weights for policy 0, policy_version 1664449 (0.0010) [2023-12-28 07:13:25,788][106226] Updated weights for policy 0, policy_version 1664459 (0.0010) [2023-12-28 07:13:25,834][106226] Updated weights for policy 0, policy_version 1664469 (0.0010) [2023-12-28 07:13:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 853352448. Throughput: 0: 9736.3, 1: 9777.7. Samples: 853321192. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:26,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.783')] [2023-12-28 07:13:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001664472_426180608.pth... [2023-12-28 07:13:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001668424_427171840.pth... [2023-12-28 07:13:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001663320_425885696.pth [2023-12-28 07:13:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001667272_426876928.pth [2023-12-28 07:13:26,259][106225] Updated weights for policy 1, policy_version 1668431 (0.0005) [2023-12-28 07:13:26,321][106225] Updated weights for policy 1, policy_version 1668441 (0.0005) [2023-12-28 07:13:26,383][106225] Updated weights for policy 1, policy_version 1668451 (0.0005) [2023-12-28 07:13:26,569][106226] Updated weights for policy 0, policy_version 1664479 (0.0011) [2023-12-28 07:13:26,614][106226] Updated weights for policy 0, policy_version 1664489 (0.0006) [2023-12-28 07:13:26,666][106226] Updated weights for policy 0, policy_version 1664499 (0.0010) [2023-12-28 07:13:27,050][106225] Updated weights for policy 1, policy_version 1668461 (0.0006) [2023-12-28 07:13:27,095][106225] Updated weights for policy 1, policy_version 1668471 (0.0007) [2023-12-28 07:13:27,141][106225] Updated weights for policy 1, policy_version 1668481 (0.0007) [2023-12-28 07:13:27,337][106226] Updated weights for policy 0, policy_version 1664509 (0.0010) [2023-12-28 07:13:27,389][106226] Updated weights for policy 0, policy_version 1664519 (0.0010) [2023-12-28 07:13:27,435][106226] Updated weights for policy 0, policy_version 1664529 (0.0010) [2023-12-28 07:13:27,866][106225] Updated weights for policy 1, policy_version 1668491 (0.0008) [2023-12-28 07:13:27,922][106225] Updated weights for policy 1, policy_version 1668501 (0.0010) [2023-12-28 07:13:27,985][106225] Updated weights for policy 1, policy_version 1668511 (0.0010) [2023-12-28 07:13:28,161][106226] Updated weights for policy 0, policy_version 1664539 (0.0010) [2023-12-28 07:13:28,220][106226] Updated weights for policy 0, policy_version 1664549 (0.0010) [2023-12-28 07:13:28,282][106226] Updated weights for policy 0, policy_version 1664559 (0.0010) [2023-12-28 07:13:28,689][106225] Updated weights for policy 1, policy_version 1668521 (0.0010) [2023-12-28 07:13:28,735][106225] Updated weights for policy 1, policy_version 1668531 (0.0010) [2023-12-28 07:13:28,782][106225] Updated weights for policy 1, policy_version 1668541 (0.0010) [2023-12-28 07:13:28,836][106225] Updated weights for policy 1, policy_version 1668551 (0.0010) [2023-12-28 07:13:28,985][106226] Updated weights for policy 0, policy_version 1664569 (0.0010) [2023-12-28 07:13:29,045][106226] Updated weights for policy 0, policy_version 1664579 (0.0008) [2023-12-28 07:13:29,097][106226] Updated weights for policy 0, policy_version 1664589 (0.0010) [2023-12-28 07:13:29,152][106226] Updated weights for policy 0, policy_version 1664599 (0.0010) [2023-12-28 07:13:29,604][106225] Updated weights for policy 1, policy_version 1668561 (0.0010) [2023-12-28 07:13:29,661][106225] Updated weights for policy 1, policy_version 1668571 (0.0010) [2023-12-28 07:13:29,713][106225] Updated weights for policy 1, policy_version 1668581 (0.0007) [2023-12-28 07:13:29,911][106226] Updated weights for policy 0, policy_version 1664609 (0.0010) [2023-12-28 07:13:29,995][106226] Updated weights for policy 0, policy_version 1664619 (0.0011) [2023-12-28 07:13:30,060][106226] Updated weights for policy 0, policy_version 1664629 (0.0010) [2023-12-28 07:13:30,419][106225] Updated weights for policy 1, policy_version 1668591 (0.0009) [2023-12-28 07:13:30,479][106225] Updated weights for policy 1, policy_version 1668601 (0.0006) [2023-12-28 07:13:30,531][106225] Updated weights for policy 1, policy_version 1668611 (0.0005) [2023-12-28 07:13:30,764][106226] Updated weights for policy 0, policy_version 1664639 (0.0007) [2023-12-28 07:13:30,813][106226] Updated weights for policy 0, policy_version 1664649 (0.0005) [2023-12-28 07:13:30,864][106226] Updated weights for policy 0, policy_version 1664659 (0.0010) [2023-12-28 07:13:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 853450752. Throughput: 0: 9776.1, 1: 9912.7. Samples: 853442212. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:31,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.882')] [2023-12-28 07:13:31,193][106225] Updated weights for policy 1, policy_version 1668621 (0.0006) [2023-12-28 07:13:31,260][106225] Updated weights for policy 1, policy_version 1668631 (0.0008) [2023-12-28 07:13:31,328][106225] Updated weights for policy 1, policy_version 1668641 (0.0009) [2023-12-28 07:13:31,551][106226] Updated weights for policy 0, policy_version 1664669 (0.0008) [2023-12-28 07:13:31,613][106226] Updated weights for policy 0, policy_version 1664679 (0.0006) [2023-12-28 07:13:31,677][106226] Updated weights for policy 0, policy_version 1664689 (0.0008) [2023-12-28 07:13:31,977][106225] Updated weights for policy 1, policy_version 1668651 (0.0007) [2023-12-28 07:13:32,038][106225] Updated weights for policy 1, policy_version 1668661 (0.0010) [2023-12-28 07:13:32,091][106225] Updated weights for policy 1, policy_version 1668671 (0.0007) [2023-12-28 07:13:32,374][106226] Updated weights for policy 0, policy_version 1664699 (0.0008) [2023-12-28 07:13:32,431][106226] Updated weights for policy 0, policy_version 1664709 (0.0006) [2023-12-28 07:13:32,494][106226] Updated weights for policy 0, policy_version 1664719 (0.0005) [2023-12-28 07:13:32,814][106225] Updated weights for policy 1, policy_version 1668681 (0.0008) [2023-12-28 07:13:32,873][106225] Updated weights for policy 1, policy_version 1668691 (0.0006) [2023-12-28 07:13:32,921][106225] Updated weights for policy 1, policy_version 1668701 (0.0005) [2023-12-28 07:13:32,972][106225] Updated weights for policy 1, policy_version 1668711 (0.0006) [2023-12-28 07:13:33,164][106226] Updated weights for policy 0, policy_version 1664729 (0.0006) [2023-12-28 07:13:33,215][106226] Updated weights for policy 0, policy_version 1664739 (0.0005) [2023-12-28 07:13:33,270][106226] Updated weights for policy 0, policy_version 1664749 (0.0005) [2023-12-28 07:13:33,318][106226] Updated weights for policy 0, policy_version 1664759 (0.0006) [2023-12-28 07:13:33,617][106225] Updated weights for policy 1, policy_version 1668721 (0.0006) [2023-12-28 07:13:33,667][106225] Updated weights for policy 1, policy_version 1668731 (0.0006) [2023-12-28 07:13:33,713][106225] Updated weights for policy 1, policy_version 1668741 (0.0005) [2023-12-28 07:13:33,965][106226] Updated weights for policy 0, policy_version 1664769 (0.0010) [2023-12-28 07:13:34,017][106226] Updated weights for policy 0, policy_version 1664779 (0.0010) [2023-12-28 07:13:34,063][106226] Updated weights for policy 0, policy_version 1664789 (0.0010) [2023-12-28 07:13:34,292][106225] Updated weights for policy 1, policy_version 1668751 (0.0007) [2023-12-28 07:13:34,356][106225] Updated weights for policy 1, policy_version 1668761 (0.0008) [2023-12-28 07:13:34,411][106225] Updated weights for policy 1, policy_version 1668771 (0.0007) [2023-12-28 07:13:34,784][106226] Updated weights for policy 0, policy_version 1664799 (0.0010) [2023-12-28 07:13:34,840][106226] Updated weights for policy 0, policy_version 1664809 (0.0008) [2023-12-28 07:13:34,889][106226] Updated weights for policy 0, policy_version 1664819 (0.0008) [2023-12-28 07:13:35,109][106225] Updated weights for policy 1, policy_version 1668781 (0.0007) [2023-12-28 07:13:35,162][106225] Updated weights for policy 1, policy_version 1668791 (0.0005) [2023-12-28 07:13:35,214][106225] Updated weights for policy 1, policy_version 1668801 (0.0006) [2023-12-28 07:13:35,488][106226] Updated weights for policy 0, policy_version 1664829 (0.0009) [2023-12-28 07:13:35,535][106226] Updated weights for policy 0, policy_version 1664839 (0.0010) [2023-12-28 07:13:35,589][106226] Updated weights for policy 0, policy_version 1664849 (0.0008) [2023-12-28 07:13:35,793][106225] Updated weights for policy 1, policy_version 1668811 (0.0005) [2023-12-28 07:13:35,852][106225] Updated weights for policy 1, policy_version 1668821 (0.0005) [2023-12-28 07:13:35,903][106225] Updated weights for policy 1, policy_version 1668831 (0.0005) [2023-12-28 07:13:36,163][106226] Updated weights for policy 0, policy_version 1664859 (0.0009) [2023-12-28 07:13:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 853557248. Throughput: 0: 9844.5, 1: 10037.5. Samples: 853569072. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:36,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.856')] [2023-12-28 07:13:36,230][106226] Updated weights for policy 0, policy_version 1664869 (0.0011) [2023-12-28 07:13:36,295][106226] Updated weights for policy 0, policy_version 1664879 (0.0011) [2023-12-28 07:13:36,602][106225] Updated weights for policy 1, policy_version 1668841 (0.0005) [2023-12-28 07:13:36,672][106225] Updated weights for policy 1, policy_version 1668851 (0.0008) [2023-12-28 07:13:36,739][106225] Updated weights for policy 1, policy_version 1668861 (0.0008) [2023-12-28 07:13:36,796][106225] Updated weights for policy 1, policy_version 1668871 (0.0010) [2023-12-28 07:13:36,940][106226] Updated weights for policy 0, policy_version 1664889 (0.0011) [2023-12-28 07:13:36,994][106226] Updated weights for policy 0, policy_version 1664899 (0.0011) [2023-12-28 07:13:37,048][106226] Updated weights for policy 0, policy_version 1664909 (0.0010) [2023-12-28 07:13:37,095][106226] Updated weights for policy 0, policy_version 1664919 (0.0010) [2023-12-28 07:13:37,383][106225] Updated weights for policy 1, policy_version 1668881 (0.0006) [2023-12-28 07:13:37,436][106225] Updated weights for policy 1, policy_version 1668891 (0.0005) [2023-12-28 07:13:37,487][106225] Updated weights for policy 1, policy_version 1668901 (0.0005) [2023-12-28 07:13:37,834][106226] Updated weights for policy 0, policy_version 1664929 (0.0011) [2023-12-28 07:13:37,900][106226] Updated weights for policy 0, policy_version 1664939 (0.0011) [2023-12-28 07:13:37,960][106226] Updated weights for policy 0, policy_version 1664949 (0.0011) [2023-12-28 07:13:38,157][106225] Updated weights for policy 1, policy_version 1668911 (0.0008) [2023-12-28 07:13:38,208][106225] Updated weights for policy 1, policy_version 1668921 (0.0010) [2023-12-28 07:13:38,265][106225] Updated weights for policy 1, policy_version 1668931 (0.0010) [2023-12-28 07:13:38,697][106226] Updated weights for policy 0, policy_version 1664959 (0.0009) [2023-12-28 07:13:38,757][106226] Updated weights for policy 0, policy_version 1664969 (0.0007) [2023-12-28 07:13:38,814][106226] Updated weights for policy 0, policy_version 1664979 (0.0008) [2023-12-28 07:13:38,995][106225] Updated weights for policy 1, policy_version 1668941 (0.0010) [2023-12-28 07:13:39,046][106225] Updated weights for policy 1, policy_version 1668951 (0.0010) [2023-12-28 07:13:39,107][106225] Updated weights for policy 1, policy_version 1668961 (0.0010) [2023-12-28 07:13:39,527][106226] Updated weights for policy 0, policy_version 1664989 (0.0008) [2023-12-28 07:13:39,581][106226] Updated weights for policy 0, policy_version 1664999 (0.0010) [2023-12-28 07:13:39,632][106226] Updated weights for policy 0, policy_version 1665009 (0.0006) [2023-12-28 07:13:39,850][106225] Updated weights for policy 1, policy_version 1668971 (0.0010) [2023-12-28 07:13:39,914][106225] Updated weights for policy 1, policy_version 1668981 (0.0008) [2023-12-28 07:13:39,971][106225] Updated weights for policy 1, policy_version 1668991 (0.0007) [2023-12-28 07:13:40,314][106226] Updated weights for policy 0, policy_version 1665019 (0.0007) [2023-12-28 07:13:40,374][106226] Updated weights for policy 0, policy_version 1665029 (0.0010) [2023-12-28 07:13:40,440][106226] Updated weights for policy 0, policy_version 1665039 (0.0006) [2023-12-28 07:13:40,745][106225] Updated weights for policy 1, policy_version 1669001 (0.0008) [2023-12-28 07:13:40,805][106225] Updated weights for policy 1, policy_version 1669011 (0.0008) [2023-12-28 07:13:40,860][106225] Updated weights for policy 1, policy_version 1669021 (0.0008) [2023-12-28 07:13:40,919][106225] Updated weights for policy 1, policy_version 1669031 (0.0008) [2023-12-28 07:13:41,076][106226] Updated weights for policy 0, policy_version 1665049 (0.0005) [2023-12-28 07:13:41,159][106226] Updated weights for policy 0, policy_version 1665059 (0.0009) [2023-12-28 07:13:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 853655552. Throughput: 0: 9861.3, 1: 10098.2. Samples: 853629200. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:41,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-4.615')] [2023-12-28 07:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001669032_427327488.pth... [2023-12-28 07:13:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001667848_427024384.pth [2023-12-28 07:13:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001669032_427327488.pth [2023-12-28 07:13:41,222][106226] Updated weights for policy 0, policy_version 1665069 (0.0009) [2023-12-28 07:13:41,287][106226] Updated weights for policy 0, policy_version 1665079 (0.0010) [2023-12-28 07:13:41,293][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001665080_426336256.pth... [2023-12-28 07:13:41,296][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001663928_426041344.pth [2023-12-28 07:13:41,296][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001665080_426336256.pth [2023-12-28 07:13:41,625][106225] Updated weights for policy 1, policy_version 1669041 (0.0008) [2023-12-28 07:13:41,689][106225] Updated weights for policy 1, policy_version 1669051 (0.0009) [2023-12-28 07:13:41,758][106225] Updated weights for policy 1, policy_version 1669061 (0.0009) [2023-12-28 07:13:42,039][106226] Updated weights for policy 0, policy_version 1665089 (0.0006) [2023-12-28 07:13:42,101][106226] Updated weights for policy 0, policy_version 1665099 (0.0008) [2023-12-28 07:13:42,165][106226] Updated weights for policy 0, policy_version 1665109 (0.0009) [2023-12-28 07:13:42,413][106225] Updated weights for policy 1, policy_version 1669071 (0.0007) [2023-12-28 07:13:42,468][106225] Updated weights for policy 1, policy_version 1669081 (0.0005) [2023-12-28 07:13:42,528][106225] Updated weights for policy 1, policy_version 1669091 (0.0007) [2023-12-28 07:13:42,922][106226] Updated weights for policy 0, policy_version 1665119 (0.0009) [2023-12-28 07:13:42,985][106226] Updated weights for policy 0, policy_version 1665129 (0.0009) [2023-12-28 07:13:43,049][106226] Updated weights for policy 0, policy_version 1665139 (0.0005) [2023-12-28 07:13:43,174][106225] Updated weights for policy 1, policy_version 1669101 (0.0008) [2023-12-28 07:13:43,235][106225] Updated weights for policy 1, policy_version 1669111 (0.0008) [2023-12-28 07:13:43,303][106225] Updated weights for policy 1, policy_version 1669121 (0.0008) [2023-12-28 07:13:43,725][106226] Updated weights for policy 0, policy_version 1665149 (0.0008) [2023-12-28 07:13:43,784][106226] Updated weights for policy 0, policy_version 1665159 (0.0008) [2023-12-28 07:13:43,838][106226] Updated weights for policy 0, policy_version 1665169 (0.0009) [2023-12-28 07:13:44,028][106225] Updated weights for policy 1, policy_version 1669131 (0.0008) [2023-12-28 07:13:44,080][106225] Updated weights for policy 1, policy_version 1669141 (0.0008) [2023-12-28 07:13:44,129][106225] Updated weights for policy 1, policy_version 1669151 (0.0009) [2023-12-28 07:13:44,584][106226] Updated weights for policy 0, policy_version 1665179 (0.0009) [2023-12-28 07:13:44,640][106226] Updated weights for policy 0, policy_version 1665189 (0.0009) [2023-12-28 07:13:44,705][106226] Updated weights for policy 0, policy_version 1665199 (0.0009) [2023-12-28 07:13:44,835][106225] Updated weights for policy 1, policy_version 1669161 (0.0008) [2023-12-28 07:13:44,886][106225] Updated weights for policy 1, policy_version 1669171 (0.0009) [2023-12-28 07:13:44,941][106225] Updated weights for policy 1, policy_version 1669181 (0.0008) [2023-12-28 07:13:45,004][106225] Updated weights for policy 1, policy_version 1669191 (0.0008) [2023-12-28 07:13:45,466][106226] Updated weights for policy 0, policy_version 1665209 (0.0007) [2023-12-28 07:13:45,525][106226] Updated weights for policy 0, policy_version 1665219 (0.0009) [2023-12-28 07:13:45,572][106226] Updated weights for policy 0, policy_version 1665229 (0.0009) [2023-12-28 07:13:45,622][106226] Updated weights for policy 0, policy_version 1665239 (0.0006) [2023-12-28 07:13:45,695][106225] Updated weights for policy 1, policy_version 1669201 (0.0008) [2023-12-28 07:13:45,764][106225] Updated weights for policy 1, policy_version 1669211 (0.0008) [2023-12-28 07:13:45,818][106225] Updated weights for policy 1, policy_version 1669221 (0.0009) [2023-12-28 07:13:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 853753856. Throughput: 0: 9858.8, 1: 10048.2. Samples: 853745344. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:46,175][105115] Avg episode reward: [(0, '-4.233'), (1, '-4.645')] [2023-12-28 07:13:46,319][106226] Updated weights for policy 0, policy_version 1665249 (0.0008) [2023-12-28 07:13:46,375][106226] Updated weights for policy 0, policy_version 1665259 (0.0009) [2023-12-28 07:13:46,427][106226] Updated weights for policy 0, policy_version 1665269 (0.0008) [2023-12-28 07:13:46,527][106225] Updated weights for policy 1, policy_version 1669231 (0.0010) [2023-12-28 07:13:46,577][106225] Updated weights for policy 1, policy_version 1669241 (0.0008) [2023-12-28 07:13:46,636][106225] Updated weights for policy 1, policy_version 1669251 (0.0010) [2023-12-28 07:13:47,218][106225] Updated weights for policy 1, policy_version 1669261 (0.0008) [2023-12-28 07:13:47,263][106226] Updated weights for policy 0, policy_version 1665279 (0.0008) [2023-12-28 07:13:47,277][106225] Updated weights for policy 1, policy_version 1669271 (0.0005) [2023-12-28 07:13:47,312][106226] Updated weights for policy 0, policy_version 1665289 (0.0008) [2023-12-28 07:13:47,333][106225] Updated weights for policy 1, policy_version 1669281 (0.0006) [2023-12-28 07:13:47,364][106226] Updated weights for policy 0, policy_version 1665299 (0.0008) [2023-12-28 07:13:47,858][106225] Updated weights for policy 1, policy_version 1669291 (0.0007) [2023-12-28 07:13:47,908][106225] Updated weights for policy 1, policy_version 1669301 (0.0010) [2023-12-28 07:13:47,968][106225] Updated weights for policy 1, policy_version 1669311 (0.0010) [2023-12-28 07:13:48,182][106226] Updated weights for policy 0, policy_version 1665309 (0.0008) [2023-12-28 07:13:48,248][106226] Updated weights for policy 0, policy_version 1665319 (0.0008) [2023-12-28 07:13:48,310][106226] Updated weights for policy 0, policy_version 1665329 (0.0008) [2023-12-28 07:13:48,707][106225] Updated weights for policy 1, policy_version 1669321 (0.0010) [2023-12-28 07:13:48,766][106225] Updated weights for policy 1, policy_version 1669331 (0.0010) [2023-12-28 07:13:48,828][106225] Updated weights for policy 1, policy_version 1669341 (0.0006) [2023-12-28 07:13:48,895][106225] Updated weights for policy 1, policy_version 1669351 (0.0005) [2023-12-28 07:13:49,033][106226] Updated weights for policy 0, policy_version 1665339 (0.0007) [2023-12-28 07:13:49,084][106226] Updated weights for policy 0, policy_version 1665349 (0.0009) [2023-12-28 07:13:49,139][106226] Updated weights for policy 0, policy_version 1665359 (0.0005) [2023-12-28 07:13:49,579][106225] Updated weights for policy 1, policy_version 1669361 (0.0008) [2023-12-28 07:13:49,638][106225] Updated weights for policy 1, policy_version 1669371 (0.0008) [2023-12-28 07:13:49,698][106225] Updated weights for policy 1, policy_version 1669381 (0.0009) [2023-12-28 07:13:49,862][106226] Updated weights for policy 0, policy_version 1665369 (0.0008) [2023-12-28 07:13:49,925][106226] Updated weights for policy 0, policy_version 1665379 (0.0008) [2023-12-28 07:13:49,991][106226] Updated weights for policy 0, policy_version 1665389 (0.0008) [2023-12-28 07:13:50,051][106226] Updated weights for policy 0, policy_version 1665399 (0.0009) [2023-12-28 07:13:50,507][106225] Updated weights for policy 1, policy_version 1669391 (0.0008) [2023-12-28 07:13:50,565][106225] Updated weights for policy 1, policy_version 1669401 (0.0008) [2023-12-28 07:13:50,628][106225] Updated weights for policy 1, policy_version 1669411 (0.0007) [2023-12-28 07:13:50,757][106226] Updated weights for policy 0, policy_version 1665409 (0.0008) [2023-12-28 07:13:50,819][106226] Updated weights for policy 0, policy_version 1665419 (0.0006) [2023-12-28 07:13:50,884][106226] Updated weights for policy 0, policy_version 1665429 (0.0005) [2023-12-28 07:13:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 853852160. Throughput: 0: 9711.5, 1: 10068.0. Samples: 853863108. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:51,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.697')] [2023-12-28 07:13:51,394][106225] Updated weights for policy 1, policy_version 1669421 (0.0007) [2023-12-28 07:13:51,457][106225] Updated weights for policy 1, policy_version 1669431 (0.0008) [2023-12-28 07:13:51,523][106225] Updated weights for policy 1, policy_version 1669441 (0.0008) [2023-12-28 07:13:51,548][106226] Updated weights for policy 0, policy_version 1665439 (0.0007) [2023-12-28 07:13:51,613][106226] Updated weights for policy 0, policy_version 1665449 (0.0007) [2023-12-28 07:13:51,684][106226] Updated weights for policy 0, policy_version 1665459 (0.0008) [2023-12-28 07:13:52,264][106225] Updated weights for policy 1, policy_version 1669451 (0.0008) [2023-12-28 07:13:52,330][106225] Updated weights for policy 1, policy_version 1669461 (0.0008) [2023-12-28 07:13:52,397][106225] Updated weights for policy 1, policy_version 1669471 (0.0008) [2023-12-28 07:13:52,446][106226] Updated weights for policy 0, policy_version 1665469 (0.0010) [2023-12-28 07:13:52,511][106226] Updated weights for policy 0, policy_version 1665479 (0.0011) [2023-12-28 07:13:52,572][106226] Updated weights for policy 0, policy_version 1665489 (0.0011) [2023-12-28 07:13:53,151][106225] Updated weights for policy 1, policy_version 1669481 (0.0008) [2023-12-28 07:13:53,223][106226] Updated weights for policy 0, policy_version 1665499 (0.0010) [2023-12-28 07:13:53,223][106225] Updated weights for policy 1, policy_version 1669491 (0.0006) [2023-12-28 07:13:53,272][106225] Updated weights for policy 1, policy_version 1669501 (0.0006) [2023-12-28 07:13:53,274][106226] Updated weights for policy 0, policy_version 1665509 (0.0010) [2023-12-28 07:13:53,326][106225] Updated weights for policy 1, policy_version 1669511 (0.0005) [2023-12-28 07:13:53,328][106226] Updated weights for policy 0, policy_version 1665519 (0.0011) [2023-12-28 07:13:53,915][106225] Updated weights for policy 1, policy_version 1669521 (0.0005) [2023-12-28 07:13:53,966][106225] Updated weights for policy 1, policy_version 1669531 (0.0006) [2023-12-28 07:13:54,015][106225] Updated weights for policy 1, policy_version 1669541 (0.0008) [2023-12-28 07:13:54,064][106226] Updated weights for policy 0, policy_version 1665529 (0.0010) [2023-12-28 07:13:54,119][106226] Updated weights for policy 0, policy_version 1665539 (0.0006) [2023-12-28 07:13:54,173][106226] Updated weights for policy 0, policy_version 1665549 (0.0005) [2023-12-28 07:13:54,228][106226] Updated weights for policy 0, policy_version 1665559 (0.0006) [2023-12-28 07:13:54,793][106225] Updated weights for policy 1, policy_version 1669551 (0.0008) [2023-12-28 07:13:54,800][106226] Updated weights for policy 0, policy_version 1665569 (0.0007) [2023-12-28 07:13:54,851][106226] Updated weights for policy 0, policy_version 1665579 (0.0007) [2023-12-28 07:13:54,856][106225] Updated weights for policy 1, policy_version 1669561 (0.0008) [2023-12-28 07:13:54,902][106226] Updated weights for policy 0, policy_version 1665589 (0.0006) [2023-12-28 07:13:54,904][106225] Updated weights for policy 1, policy_version 1669571 (0.0006) [2023-12-28 07:13:55,573][106225] Updated weights for policy 1, policy_version 1669581 (0.0008) [2023-12-28 07:13:55,624][106226] Updated weights for policy 0, policy_version 1665599 (0.0007) [2023-12-28 07:13:55,631][106225] Updated weights for policy 1, policy_version 1669591 (0.0007) [2023-12-28 07:13:55,669][106226] Updated weights for policy 0, policy_version 1665609 (0.0007) [2023-12-28 07:13:55,690][106225] Updated weights for policy 1, policy_version 1669601 (0.0008) [2023-12-28 07:13:55,720][106226] Updated weights for policy 0, policy_version 1665619 (0.0007) [2023-12-28 07:13:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 853950464. Throughput: 0: 9712.5, 1: 10028.8. Samples: 853920220. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:13:56,176][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.679')] [2023-12-28 07:13:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001669608_427474944.pth... [2023-12-28 07:13:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001665624_426475520.pth... [2023-12-28 07:13:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001664472_426180608.pth [2023-12-28 07:13:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001668424_427171840.pth [2023-12-28 07:13:56,397][106225] Updated weights for policy 1, policy_version 1669611 (0.0007) [2023-12-28 07:13:56,453][106225] Updated weights for policy 1, policy_version 1669621 (0.0005) [2023-12-28 07:13:56,453][106226] Updated weights for policy 0, policy_version 1665629 (0.0007) [2023-12-28 07:13:56,515][106225] Updated weights for policy 1, policy_version 1669631 (0.0006) [2023-12-28 07:13:56,518][106226] Updated weights for policy 0, policy_version 1665639 (0.0009) [2023-12-28 07:13:56,572][106226] Updated weights for policy 0, policy_version 1665649 (0.0008) [2023-12-28 07:13:57,160][106225] Updated weights for policy 1, policy_version 1669641 (0.0009) [2023-12-28 07:13:57,212][106225] Updated weights for policy 1, policy_version 1669651 (0.0008) [2023-12-28 07:13:57,267][106225] Updated weights for policy 1, policy_version 1669661 (0.0008) [2023-12-28 07:13:57,273][106226] Updated weights for policy 0, policy_version 1665659 (0.0008) [2023-12-28 07:13:57,323][106225] Updated weights for policy 1, policy_version 1669671 (0.0007) [2023-12-28 07:13:57,325][106226] Updated weights for policy 0, policy_version 1665669 (0.0007) [2023-12-28 07:13:57,374][106226] Updated weights for policy 0, policy_version 1665679 (0.0005) [2023-12-28 07:13:57,984][106226] Updated weights for policy 0, policy_version 1665689 (0.0006) [2023-12-28 07:13:57,990][106225] Updated weights for policy 1, policy_version 1669681 (0.0006) [2023-12-28 07:13:58,037][106226] Updated weights for policy 0, policy_version 1665699 (0.0011) [2023-12-28 07:13:58,039][106225] Updated weights for policy 1, policy_version 1669691 (0.0006) [2023-12-28 07:13:58,083][106226] Updated weights for policy 0, policy_version 1665709 (0.0010) [2023-12-28 07:13:58,085][106225] Updated weights for policy 1, policy_version 1669701 (0.0005) [2023-12-28 07:13:58,129][106226] Updated weights for policy 0, policy_version 1665719 (0.0010) [2023-12-28 07:13:58,816][106225] Updated weights for policy 1, policy_version 1669711 (0.0008) [2023-12-28 07:13:58,883][106225] Updated weights for policy 1, policy_version 1669721 (0.0008) [2023-12-28 07:13:58,954][106225] Updated weights for policy 1, policy_version 1669731 (0.0009) [2023-12-28 07:13:58,973][106226] Updated weights for policy 0, policy_version 1665729 (0.0007) [2023-12-28 07:13:59,032][106226] Updated weights for policy 0, policy_version 1665739 (0.0006) [2023-12-28 07:13:59,097][106226] Updated weights for policy 0, policy_version 1665749 (0.0009) [2023-12-28 07:13:59,764][106225] Updated weights for policy 1, policy_version 1669741 (0.0009) [2023-12-28 07:13:59,818][106225] Updated weights for policy 1, policy_version 1669751 (0.0009) [2023-12-28 07:13:59,833][106226] Updated weights for policy 0, policy_version 1665759 (0.0008) [2023-12-28 07:13:59,886][106225] Updated weights for policy 1, policy_version 1669761 (0.0008) [2023-12-28 07:13:59,898][106226] Updated weights for policy 0, policy_version 1665769 (0.0006) [2023-12-28 07:13:59,967][106226] Updated weights for policy 0, policy_version 1665779 (0.0007) [2023-12-28 07:14:00,621][106225] Updated weights for policy 1, policy_version 1669771 (0.0009) [2023-12-28 07:14:00,651][106226] Updated weights for policy 0, policy_version 1665789 (0.0007) [2023-12-28 07:14:00,672][106225] Updated weights for policy 1, policy_version 1669781 (0.0009) [2023-12-28 07:14:00,700][106226] Updated weights for policy 0, policy_version 1665799 (0.0007) [2023-12-28 07:14:00,720][106225] Updated weights for policy 1, policy_version 1669791 (0.0008) [2023-12-28 07:14:00,749][106226] Updated weights for policy 0, policy_version 1665809 (0.0005) [2023-12-28 07:14:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 854048768. Throughput: 0: 9797.5, 1: 10051.6. Samples: 854038624. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:14:01,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.660')] [2023-12-28 07:14:01,437][106226] Updated weights for policy 0, policy_version 1665819 (0.0006) [2023-12-28 07:14:01,489][106225] Updated weights for policy 1, policy_version 1669801 (0.0006) [2023-12-28 07:14:01,499][106226] Updated weights for policy 0, policy_version 1665829 (0.0008) [2023-12-28 07:14:01,537][106225] Updated weights for policy 1, policy_version 1669811 (0.0009) [2023-12-28 07:14:01,551][106226] Updated weights for policy 0, policy_version 1665839 (0.0007) [2023-12-28 07:14:01,592][106225] Updated weights for policy 1, policy_version 1669821 (0.0006) [2023-12-28 07:14:01,661][106225] Updated weights for policy 1, policy_version 1669831 (0.0008) [2023-12-28 07:14:02,209][106226] Updated weights for policy 0, policy_version 1665849 (0.0008) [2023-12-28 07:14:02,258][106226] Updated weights for policy 0, policy_version 1665859 (0.0010) [2023-12-28 07:14:02,306][106226] Updated weights for policy 0, policy_version 1665869 (0.0008) [2023-12-28 07:14:02,367][106226] Updated weights for policy 0, policy_version 1665879 (0.0007) [2023-12-28 07:14:02,402][106225] Updated weights for policy 1, policy_version 1669841 (0.0007) [2023-12-28 07:14:02,454][106225] Updated weights for policy 1, policy_version 1669851 (0.0008) [2023-12-28 07:14:02,510][106225] Updated weights for policy 1, policy_version 1669861 (0.0008) [2023-12-28 07:14:02,968][106226] Updated weights for policy 0, policy_version 1665889 (0.0008) [2023-12-28 07:14:03,016][106226] Updated weights for policy 0, policy_version 1665899 (0.0007) [2023-12-28 07:14:03,069][106226] Updated weights for policy 0, policy_version 1665909 (0.0008) [2023-12-28 07:14:03,303][106225] Updated weights for policy 1, policy_version 1669871 (0.0007) [2023-12-28 07:14:03,366][106225] Updated weights for policy 1, policy_version 1669881 (0.0005) [2023-12-28 07:14:03,430][106225] Updated weights for policy 1, policy_version 1669891 (0.0006) [2023-12-28 07:14:03,651][106226] Updated weights for policy 0, policy_version 1665919 (0.0006) [2023-12-28 07:14:03,706][106226] Updated weights for policy 0, policy_version 1665929 (0.0005) [2023-12-28 07:14:03,760][106226] Updated weights for policy 0, policy_version 1665939 (0.0005) [2023-12-28 07:14:04,112][106225] Updated weights for policy 1, policy_version 1669901 (0.0008) [2023-12-28 07:14:04,165][106225] Updated weights for policy 1, policy_version 1669911 (0.0007) [2023-12-28 07:14:04,212][106225] Updated weights for policy 1, policy_version 1669921 (0.0008) [2023-12-28 07:14:04,442][106226] Updated weights for policy 0, policy_version 1665949 (0.0007) [2023-12-28 07:14:04,493][106226] Updated weights for policy 0, policy_version 1665959 (0.0009) [2023-12-28 07:14:04,543][106226] Updated weights for policy 0, policy_version 1665969 (0.0007) [2023-12-28 07:14:04,892][106225] Updated weights for policy 1, policy_version 1669931 (0.0008) [2023-12-28 07:14:04,942][106225] Updated weights for policy 1, policy_version 1669941 (0.0005) [2023-12-28 07:14:05,004][106225] Updated weights for policy 1, policy_version 1669951 (0.0005) [2023-12-28 07:14:05,246][106226] Updated weights for policy 0, policy_version 1665979 (0.0007) [2023-12-28 07:14:05,301][106226] Updated weights for policy 0, policy_version 1665989 (0.0005) [2023-12-28 07:14:05,372][106226] Updated weights for policy 0, policy_version 1665999 (0.0007) [2023-12-28 07:14:05,567][106225] Updated weights for policy 1, policy_version 1669961 (0.0006) [2023-12-28 07:14:05,660][106225] Updated weights for policy 1, policy_version 1669971 (0.0008) [2023-12-28 07:14:05,719][106225] Updated weights for policy 1, policy_version 1669981 (0.0009) [2023-12-28 07:14:05,766][106225] Updated weights for policy 1, policy_version 1669991 (0.0009) [2023-12-28 07:14:06,111][106226] Updated weights for policy 0, policy_version 1666009 (0.0009) [2023-12-28 07:14:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 854147072. Throughput: 0: 9866.0, 1: 10030.4. Samples: 854159888. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:14:06,175][105115] Avg episode reward: [(0, '-4.737'), (1, '-4.670')] [2023-12-28 07:14:06,178][106226] Updated weights for policy 0, policy_version 1666019 (0.0009) [2023-12-28 07:14:06,247][106226] Updated weights for policy 0, policy_version 1666029 (0.0008) [2023-12-28 07:14:06,311][106226] Updated weights for policy 0, policy_version 1666039 (0.0007) [2023-12-28 07:14:06,351][106225] Updated weights for policy 1, policy_version 1670001 (0.0011) [2023-12-28 07:14:06,418][106225] Updated weights for policy 1, policy_version 1670011 (0.0010) [2023-12-28 07:14:06,475][106225] Updated weights for policy 1, policy_version 1670021 (0.0009) [2023-12-28 07:14:06,955][106226] Updated weights for policy 0, policy_version 1666049 (0.0009) [2023-12-28 07:14:07,023][106226] Updated weights for policy 0, policy_version 1666059 (0.0009) [2023-12-28 07:14:07,083][106226] Updated weights for policy 0, policy_version 1666069 (0.0009) [2023-12-28 07:14:07,243][106225] Updated weights for policy 1, policy_version 1670031 (0.0010) [2023-12-28 07:14:07,294][106225] Updated weights for policy 1, policy_version 1670041 (0.0008) [2023-12-28 07:14:07,343][106225] Updated weights for policy 1, policy_version 1670051 (0.0009) [2023-12-28 07:14:07,740][106226] Updated weights for policy 0, policy_version 1666079 (0.0009) [2023-12-28 07:14:07,799][106226] Updated weights for policy 0, policy_version 1666089 (0.0008) [2023-12-28 07:14:07,857][106226] Updated weights for policy 0, policy_version 1666099 (0.0005) [2023-12-28 07:14:08,170][106225] Updated weights for policy 1, policy_version 1670061 (0.0010) [2023-12-28 07:14:08,227][106225] Updated weights for policy 1, policy_version 1670071 (0.0008) [2023-12-28 07:14:08,279][106225] Updated weights for policy 1, policy_version 1670081 (0.0009) [2023-12-28 07:14:08,407][106226] Updated weights for policy 0, policy_version 1666109 (0.0007) [2023-12-28 07:14:08,469][106226] Updated weights for policy 0, policy_version 1666119 (0.0010) [2023-12-28 07:14:08,527][106226] Updated weights for policy 0, policy_version 1666129 (0.0006) [2023-12-28 07:14:09,081][106225] Updated weights for policy 1, policy_version 1670091 (0.0007) [2023-12-28 07:14:09,129][106226] Updated weights for policy 0, policy_version 1666139 (0.0006) [2023-12-28 07:14:09,148][106225] Updated weights for policy 1, policy_version 1670101 (0.0006) [2023-12-28 07:14:09,183][106226] Updated weights for policy 0, policy_version 1666149 (0.0006) [2023-12-28 07:14:09,209][106225] Updated weights for policy 1, policy_version 1670111 (0.0008) [2023-12-28 07:14:09,250][106226] Updated weights for policy 0, policy_version 1666159 (0.0007) [2023-12-28 07:14:09,920][106225] Updated weights for policy 1, policy_version 1670121 (0.0008) [2023-12-28 07:14:09,986][106225] Updated weights for policy 1, policy_version 1670131 (0.0009) [2023-12-28 07:14:09,992][106226] Updated weights for policy 0, policy_version 1666169 (0.0008) [2023-12-28 07:14:10,051][106225] Updated weights for policy 1, policy_version 1670141 (0.0008) [2023-12-28 07:14:10,060][106226] Updated weights for policy 0, policy_version 1666179 (0.0009) [2023-12-28 07:14:10,119][106225] Updated weights for policy 1, policy_version 1670151 (0.0009) [2023-12-28 07:14:10,121][106226] Updated weights for policy 0, policy_version 1666189 (0.0007) [2023-12-28 07:14:10,185][106226] Updated weights for policy 0, policy_version 1666199 (0.0006) [2023-12-28 07:14:10,804][106225] Updated weights for policy 1, policy_version 1670161 (0.0006) [2023-12-28 07:14:10,862][106225] Updated weights for policy 1, policy_version 1670171 (0.0010) [2023-12-28 07:14:10,884][106226] Updated weights for policy 0, policy_version 1666209 (0.0009) [2023-12-28 07:14:10,917][106225] Updated weights for policy 1, policy_version 1670181 (0.0006) [2023-12-28 07:14:10,937][106226] Updated weights for policy 0, policy_version 1666219 (0.0011) [2023-12-28 07:14:10,990][106226] Updated weights for policy 0, policy_version 1666229 (0.0011) [2023-12-28 07:14:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 854253568. Throughput: 0: 9985.0, 1: 9991.5. Samples: 854220136. Policy #0 lag: (min: 15.0, avg: 16.8, max: 47.0) [2023-12-28 07:14:11,175][105115] Avg episode reward: [(0, '-4.232'), (1, '-4.514')] [2023-12-28 07:14:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001666232_426631168.pth... [2023-12-28 07:14:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001670184_427622400.pth... [2023-12-28 07:14:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001665080_426336256.pth [2023-12-28 07:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001669032_427327488.pth [2023-12-28 07:14:11,683][106225] Updated weights for policy 1, policy_version 1670191 (0.0007) [2023-12-28 07:14:11,752][106226] Updated weights for policy 0, policy_version 1666239 (0.0009) [2023-12-28 07:14:11,754][106225] Updated weights for policy 1, policy_version 1670201 (0.0008) [2023-12-28 07:14:11,803][106225] Updated weights for policy 1, policy_version 1670211 (0.0009) [2023-12-28 07:14:11,811][106226] Updated weights for policy 0, policy_version 1666249 (0.0007) [2023-12-28 07:14:11,871][106226] Updated weights for policy 0, policy_version 1666259 (0.0009) [2023-12-28 07:14:12,530][106225] Updated weights for policy 1, policy_version 1670221 (0.0006) [2023-12-28 07:14:12,595][106225] Updated weights for policy 1, policy_version 1670231 (0.0006) [2023-12-28 07:14:12,621][106226] Updated weights for policy 0, policy_version 1666269 (0.0006) [2023-12-28 07:14:12,654][106225] Updated weights for policy 1, policy_version 1670241 (0.0008) [2023-12-28 07:14:12,685][106226] Updated weights for policy 0, policy_version 1666279 (0.0008) [2023-12-28 07:14:12,749][106226] Updated weights for policy 0, policy_version 1666289 (0.0009) [2023-12-28 07:14:13,285][106225] Updated weights for policy 1, policy_version 1670251 (0.0007) [2023-12-28 07:14:13,352][106225] Updated weights for policy 1, policy_version 1670261 (0.0010) [2023-12-28 07:14:13,402][106225] Updated weights for policy 1, policy_version 1670271 (0.0010) [2023-12-28 07:14:13,443][106226] Updated weights for policy 0, policy_version 1666299 (0.0008) [2023-12-28 07:14:13,498][106226] Updated weights for policy 0, policy_version 1666309 (0.0007) [2023-12-28 07:14:13,546][106226] Updated weights for policy 0, policy_version 1666319 (0.0008) [2023-12-28 07:14:14,111][106225] Updated weights for policy 1, policy_version 1670281 (0.0010) [2023-12-28 07:14:14,175][106225] Updated weights for policy 1, policy_version 1670291 (0.0006) [2023-12-28 07:14:14,234][106225] Updated weights for policy 1, policy_version 1670301 (0.0009) [2023-12-28 07:14:14,254][106226] Updated weights for policy 0, policy_version 1666329 (0.0008) [2023-12-28 07:14:14,295][106225] Updated weights for policy 1, policy_version 1670311 (0.0010) [2023-12-28 07:14:14,309][106226] Updated weights for policy 0, policy_version 1666339 (0.0006) [2023-12-28 07:14:14,363][106226] Updated weights for policy 0, policy_version 1666349 (0.0005) [2023-12-28 07:14:14,428][106226] Updated weights for policy 0, policy_version 1666359 (0.0007) [2023-12-28 07:14:14,987][106225] Updated weights for policy 1, policy_version 1670321 (0.0010) [2023-12-28 07:14:15,051][106225] Updated weights for policy 1, policy_version 1670331 (0.0011) [2023-12-28 07:14:15,113][106225] Updated weights for policy 1, policy_version 1670341 (0.0010) [2023-12-28 07:14:15,220][106226] Updated weights for policy 0, policy_version 1666369 (0.0008) [2023-12-28 07:14:15,283][106226] Updated weights for policy 0, policy_version 1666379 (0.0008) [2023-12-28 07:14:15,338][106226] Updated weights for policy 0, policy_version 1666389 (0.0008) [2023-12-28 07:14:15,702][106225] Updated weights for policy 1, policy_version 1670351 (0.0007) [2023-12-28 07:14:15,755][106225] Updated weights for policy 1, policy_version 1670361 (0.0005) [2023-12-28 07:14:15,813][106225] Updated weights for policy 1, policy_version 1670371 (0.0005) [2023-12-28 07:14:16,019][106226] Updated weights for policy 0, policy_version 1666399 (0.0010) [2023-12-28 07:14:16,092][106226] Updated weights for policy 0, policy_version 1666409 (0.0010) [2023-12-28 07:14:16,152][106226] Updated weights for policy 0, policy_version 1666419 (0.0005) [2023-12-28 07:14:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 854343680. Throughput: 0: 9953.9, 1: 9900.5. Samples: 854335664. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:16,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.761')] [2023-12-28 07:14:16,375][106225] Updated weights for policy 1, policy_version 1670381 (0.0006) [2023-12-28 07:14:16,430][106225] Updated weights for policy 1, policy_version 1670391 (0.0010) [2023-12-28 07:14:16,484][106225] Updated weights for policy 1, policy_version 1670401 (0.0010) [2023-12-28 07:14:16,811][106226] Updated weights for policy 0, policy_version 1666429 (0.0007) [2023-12-28 07:14:16,881][106226] Updated weights for policy 0, policy_version 1666439 (0.0010) [2023-12-28 07:14:16,927][106226] Updated weights for policy 0, policy_version 1666449 (0.0010) [2023-12-28 07:14:17,113][106225] Updated weights for policy 1, policy_version 1670411 (0.0009) [2023-12-28 07:14:17,169][106225] Updated weights for policy 1, policy_version 1670421 (0.0007) [2023-12-28 07:14:17,219][106225] Updated weights for policy 1, policy_version 1670431 (0.0005) [2023-12-28 07:14:17,533][106226] Updated weights for policy 0, policy_version 1666459 (0.0010) [2023-12-28 07:14:17,603][106226] Updated weights for policy 0, policy_version 1666469 (0.0011) [2023-12-28 07:14:17,670][106226] Updated weights for policy 0, policy_version 1666479 (0.0011) [2023-12-28 07:14:17,775][106225] Updated weights for policy 1, policy_version 1670441 (0.0006) [2023-12-28 07:14:17,828][106225] Updated weights for policy 1, policy_version 1670451 (0.0010) [2023-12-28 07:14:17,877][106225] Updated weights for policy 1, policy_version 1670461 (0.0010) [2023-12-28 07:14:17,932][106225] Updated weights for policy 1, policy_version 1670471 (0.0010) [2023-12-28 07:14:18,310][106226] Updated weights for policy 0, policy_version 1666489 (0.0011) [2023-12-28 07:14:18,388][106226] Updated weights for policy 0, policy_version 1666501 (0.0008) [2023-12-28 07:14:18,451][106226] Updated weights for policy 0, policy_version 1666511 (0.0008) [2023-12-28 07:14:18,589][106225] Updated weights for policy 1, policy_version 1670481 (0.0010) [2023-12-28 07:14:18,640][106225] Updated weights for policy 1, policy_version 1670491 (0.0010) [2023-12-28 07:14:18,692][106225] Updated weights for policy 1, policy_version 1670501 (0.0010) [2023-12-28 07:14:19,161][106226] Updated weights for policy 0, policy_version 1666521 (0.0008) [2023-12-28 07:14:19,217][106226] Updated weights for policy 0, policy_version 1666531 (0.0009) [2023-12-28 07:14:19,281][106226] Updated weights for policy 0, policy_version 1666541 (0.0007) [2023-12-28 07:14:19,342][106226] Updated weights for policy 0, policy_version 1666551 (0.0008) [2023-12-28 07:14:19,440][106225] Updated weights for policy 1, policy_version 1670511 (0.0007) [2023-12-28 07:14:19,501][106225] Updated weights for policy 1, policy_version 1670521 (0.0006) [2023-12-28 07:14:19,566][106225] Updated weights for policy 1, policy_version 1670531 (0.0010) [2023-12-28 07:14:20,128][106226] Updated weights for policy 0, policy_version 1666561 (0.0009) [2023-12-28 07:14:20,197][106226] Updated weights for policy 0, policy_version 1666571 (0.0009) [2023-12-28 07:14:20,259][106226] Updated weights for policy 0, policy_version 1666581 (0.0007) [2023-12-28 07:14:20,263][106225] Updated weights for policy 1, policy_version 1670541 (0.0010) [2023-12-28 07:14:20,329][106225] Updated weights for policy 1, policy_version 1670551 (0.0011) [2023-12-28 07:14:20,401][106225] Updated weights for policy 1, policy_version 1670561 (0.0011) [2023-12-28 07:14:20,933][106226] Updated weights for policy 0, policy_version 1666591 (0.0006) [2023-12-28 07:14:20,996][106226] Updated weights for policy 0, policy_version 1666601 (0.0009) [2023-12-28 07:14:21,079][106226] Updated weights for policy 0, policy_version 1666611 (0.0008) [2023-12-28 07:14:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 854450176. Throughput: 0: 9890.4, 1: 9890.6. Samples: 854459216. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:21,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.749')] [2023-12-28 07:14:21,204][106225] Updated weights for policy 1, policy_version 1670571 (0.0010) [2023-12-28 07:14:21,271][106225] Updated weights for policy 1, policy_version 1670581 (0.0007) [2023-12-28 07:14:21,338][106225] Updated weights for policy 1, policy_version 1670591 (0.0008) [2023-12-28 07:14:21,869][106226] Updated weights for policy 0, policy_version 1666621 (0.0009) [2023-12-28 07:14:21,919][106226] Updated weights for policy 0, policy_version 1666631 (0.0009) [2023-12-28 07:14:21,975][106226] Updated weights for policy 0, policy_version 1666641 (0.0008) [2023-12-28 07:14:22,019][106225] Updated weights for policy 1, policy_version 1670601 (0.0008) [2023-12-28 07:14:22,083][106225] Updated weights for policy 1, policy_version 1670611 (0.0009) [2023-12-28 07:14:22,143][106225] Updated weights for policy 1, policy_version 1670621 (0.0010) [2023-12-28 07:14:22,194][106225] Updated weights for policy 1, policy_version 1670631 (0.0008) [2023-12-28 07:14:22,769][106226] Updated weights for policy 0, policy_version 1666651 (0.0008) [2023-12-28 07:14:22,844][106226] Updated weights for policy 0, policy_version 1666661 (0.0009) [2023-12-28 07:14:22,911][106226] Updated weights for policy 0, policy_version 1666671 (0.0008) [2023-12-28 07:14:22,932][106225] Updated weights for policy 1, policy_version 1670641 (0.0010) [2023-12-28 07:14:22,997][106225] Updated weights for policy 1, policy_version 1670651 (0.0010) [2023-12-28 07:14:23,068][106225] Updated weights for policy 1, policy_version 1670661 (0.0010) [2023-12-28 07:14:23,629][106226] Updated weights for policy 0, policy_version 1666681 (0.0006) [2023-12-28 07:14:23,692][106226] Updated weights for policy 0, policy_version 1666691 (0.0008) [2023-12-28 07:14:23,747][106226] Updated weights for policy 0, policy_version 1666701 (0.0006) [2023-12-28 07:14:23,758][106225] Updated weights for policy 1, policy_version 1670671 (0.0010) [2023-12-28 07:14:23,815][106226] Updated weights for policy 0, policy_version 1666711 (0.0007) [2023-12-28 07:14:23,816][106225] Updated weights for policy 1, policy_version 1670681 (0.0005) [2023-12-28 07:14:23,873][106225] Updated weights for policy 1, policy_version 1670691 (0.0006) [2023-12-28 07:14:24,487][106225] Updated weights for policy 1, policy_version 1670701 (0.0006) [2023-12-28 07:14:24,524][106226] Updated weights for policy 0, policy_version 1666721 (0.0008) [2023-12-28 07:14:24,543][106225] Updated weights for policy 1, policy_version 1670711 (0.0006) [2023-12-28 07:14:24,587][106226] Updated weights for policy 0, policy_version 1666731 (0.0008) [2023-12-28 07:14:24,597][106225] Updated weights for policy 1, policy_version 1670721 (0.0005) [2023-12-28 07:14:24,644][106226] Updated weights for policy 0, policy_version 1666741 (0.0008) [2023-12-28 07:14:25,263][106225] Updated weights for policy 1, policy_version 1670731 (0.0005) [2023-12-28 07:14:25,320][106225] Updated weights for policy 1, policy_version 1670741 (0.0007) [2023-12-28 07:14:25,369][106225] Updated weights for policy 1, policy_version 1670751 (0.0007) [2023-12-28 07:14:25,382][106226] Updated weights for policy 0, policy_version 1666751 (0.0008) [2023-12-28 07:14:25,435][106226] Updated weights for policy 0, policy_version 1666761 (0.0009) [2023-12-28 07:14:25,491][106226] Updated weights for policy 0, policy_version 1666771 (0.0008) [2023-12-28 07:14:26,005][106225] Updated weights for policy 1, policy_version 1670761 (0.0008) [2023-12-28 07:14:26,063][106225] Updated weights for policy 1, policy_version 1670771 (0.0008) [2023-12-28 07:14:26,126][106225] Updated weights for policy 1, policy_version 1670781 (0.0008) [2023-12-28 07:14:26,135][106226] Updated weights for policy 0, policy_version 1666781 (0.0010) [2023-12-28 07:14:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 854540288. Throughput: 0: 9849.0, 1: 9846.9. Samples: 854515516. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:26,175][105115] Avg episode reward: [(0, '-4.508'), (1, '-5.045')] [2023-12-28 07:14:26,177][106225] Updated weights for policy 1, policy_version 1670791 (0.0006) [2023-12-28 07:14:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001670792_427778048.pth... [2023-12-28 07:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001669608_427474944.pth [2023-12-28 07:14:26,197][106226] Updated weights for policy 0, policy_version 1666791 (0.0011) [2023-12-28 07:14:26,253][106226] Updated weights for policy 0, policy_version 1666801 (0.0010) [2023-12-28 07:14:26,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001666808_426778624.pth... [2023-12-28 07:14:26,288][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001665624_426475520.pth [2023-12-28 07:14:26,812][106226] Updated weights for policy 0, policy_version 1666811 (0.0009) [2023-12-28 07:14:26,857][106226] Updated weights for policy 0, policy_version 1666821 (0.0008) [2023-12-28 07:14:26,906][106226] Updated weights for policy 0, policy_version 1666831 (0.0006) [2023-12-28 07:14:26,911][106225] Updated weights for policy 1, policy_version 1670801 (0.0010) [2023-12-28 07:14:26,967][106225] Updated weights for policy 1, policy_version 1670811 (0.0010) [2023-12-28 07:14:27,016][106225] Updated weights for policy 1, policy_version 1670821 (0.0010) [2023-12-28 07:14:27,604][106226] Updated weights for policy 0, policy_version 1666841 (0.0005) [2023-12-28 07:14:27,659][106226] Updated weights for policy 0, policy_version 1666851 (0.0007) [2023-12-28 07:14:27,684][106225] Updated weights for policy 1, policy_version 1670831 (0.0010) [2023-12-28 07:14:27,706][106226] Updated weights for policy 0, policy_version 1666861 (0.0006) [2023-12-28 07:14:27,740][106225] Updated weights for policy 1, policy_version 1670842 (0.0006) [2023-12-28 07:14:27,766][106226] Updated weights for policy 0, policy_version 1666871 (0.0009) [2023-12-28 07:14:27,789][106225] Updated weights for policy 1, policy_version 1670852 (0.0007) [2023-12-28 07:14:28,417][106225] Updated weights for policy 1, policy_version 1670862 (0.0007) [2023-12-28 07:14:28,421][106226] Updated weights for policy 0, policy_version 1666881 (0.0006) [2023-12-28 07:14:28,478][106225] Updated weights for policy 1, policy_version 1670872 (0.0007) [2023-12-28 07:14:28,486][106226] Updated weights for policy 0, policy_version 1666891 (0.0006) [2023-12-28 07:14:28,538][106225] Updated weights for policy 1, policy_version 1670882 (0.0006) [2023-12-28 07:14:28,545][106226] Updated weights for policy 0, policy_version 1666901 (0.0007) [2023-12-28 07:14:29,144][106225] Updated weights for policy 1, policy_version 1670892 (0.0005) [2023-12-28 07:14:29,197][106225] Updated weights for policy 1, policy_version 1670902 (0.0005) [2023-12-28 07:14:29,199][106226] Updated weights for policy 0, policy_version 1666911 (0.0010) [2023-12-28 07:14:29,263][106225] Updated weights for policy 1, policy_version 1670912 (0.0007) [2023-12-28 07:14:29,264][106226] Updated weights for policy 0, policy_version 1666921 (0.0009) [2023-12-28 07:14:29,327][106226] Updated weights for policy 0, policy_version 1666931 (0.0007) [2023-12-28 07:14:29,946][106225] Updated weights for policy 1, policy_version 1670922 (0.0008) [2023-12-28 07:14:30,002][106225] Updated weights for policy 1, policy_version 1670932 (0.0010) [2023-12-28 07:14:30,036][106226] Updated weights for policy 0, policy_version 1666941 (0.0008) [2023-12-28 07:14:30,060][106225] Updated weights for policy 1, policy_version 1670942 (0.0010) [2023-12-28 07:14:30,098][106226] Updated weights for policy 0, policy_version 1666951 (0.0010) [2023-12-28 07:14:30,120][106225] Updated weights for policy 1, policy_version 1670952 (0.0008) [2023-12-28 07:14:30,151][106226] Updated weights for policy 0, policy_version 1666961 (0.0009) [2023-12-28 07:14:30,799][106225] Updated weights for policy 1, policy_version 1670962 (0.0009) [2023-12-28 07:14:30,827][106226] Updated weights for policy 0, policy_version 1666971 (0.0009) [2023-12-28 07:14:30,859][106225] Updated weights for policy 1, policy_version 1670972 (0.0010) [2023-12-28 07:14:30,882][106226] Updated weights for policy 0, policy_version 1666981 (0.0009) [2023-12-28 07:14:30,907][106225] Updated weights for policy 1, policy_version 1670982 (0.0010) [2023-12-28 07:14:30,936][106226] Updated weights for policy 0, policy_version 1666991 (0.0010) [2023-12-28 07:14:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 854654976. Throughput: 0: 9923.1, 1: 9950.4. Samples: 854639652. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:31,175][105115] Avg episode reward: [(0, '-4.723'), (1, '-4.316')] [2023-12-28 07:14:31,638][106225] Updated weights for policy 1, policy_version 1670992 (0.0009) [2023-12-28 07:14:31,664][106226] Updated weights for policy 0, policy_version 1667001 (0.0010) [2023-12-28 07:14:31,696][106225] Updated weights for policy 1, policy_version 1671002 (0.0007) [2023-12-28 07:14:31,726][106226] Updated weights for policy 0, policy_version 1667011 (0.0009) [2023-12-28 07:14:31,767][106225] Updated weights for policy 1, policy_version 1671012 (0.0007) [2023-12-28 07:14:31,793][106226] Updated weights for policy 0, policy_version 1667021 (0.0007) [2023-12-28 07:14:31,843][106226] Updated weights for policy 0, policy_version 1667031 (0.0008) [2023-12-28 07:14:32,506][106225] Updated weights for policy 1, policy_version 1671022 (0.0008) [2023-12-28 07:14:32,531][106226] Updated weights for policy 0, policy_version 1667041 (0.0006) [2023-12-28 07:14:32,568][106225] Updated weights for policy 1, policy_version 1671032 (0.0009) [2023-12-28 07:14:32,583][106226] Updated weights for policy 0, policy_version 1667051 (0.0007) [2023-12-28 07:14:32,628][106225] Updated weights for policy 1, policy_version 1671042 (0.0009) [2023-12-28 07:14:32,643][106226] Updated weights for policy 0, policy_version 1667061 (0.0006) [2023-12-28 07:14:33,279][106225] Updated weights for policy 1, policy_version 1671052 (0.0007) [2023-12-28 07:14:33,311][106226] Updated weights for policy 0, policy_version 1667071 (0.0006) [2023-12-28 07:14:33,332][106225] Updated weights for policy 1, policy_version 1671062 (0.0005) [2023-12-28 07:14:33,373][106226] Updated weights for policy 0, policy_version 1667081 (0.0008) [2023-12-28 07:14:33,384][106225] Updated weights for policy 1, policy_version 1671072 (0.0008) [2023-12-28 07:14:33,430][106226] Updated weights for policy 0, policy_version 1667091 (0.0007) [2023-12-28 07:14:34,025][106226] Updated weights for policy 0, policy_version 1667101 (0.0007) [2023-12-28 07:14:34,086][106226] Updated weights for policy 0, policy_version 1667111 (0.0006) [2023-12-28 07:14:34,108][106225] Updated weights for policy 1, policy_version 1671082 (0.0006) [2023-12-28 07:14:34,147][106226] Updated weights for policy 0, policy_version 1667121 (0.0006) [2023-12-28 07:14:34,174][106225] Updated weights for policy 1, policy_version 1671092 (0.0007) [2023-12-28 07:14:34,232][106225] Updated weights for policy 1, policy_version 1671102 (0.0007) [2023-12-28 07:14:34,290][106225] Updated weights for policy 1, policy_version 1671112 (0.0008) [2023-12-28 07:14:34,861][106226] Updated weights for policy 0, policy_version 1667131 (0.0010) [2023-12-28 07:14:34,918][106226] Updated weights for policy 0, policy_version 1667141 (0.0011) [2023-12-28 07:14:34,965][106225] Updated weights for policy 1, policy_version 1671122 (0.0005) [2023-12-28 07:14:34,981][106226] Updated weights for policy 0, policy_version 1667151 (0.0011) [2023-12-28 07:14:35,008][106225] Updated weights for policy 1, policy_version 1671132 (0.0007) [2023-12-28 07:14:35,056][106225] Updated weights for policy 1, policy_version 1671142 (0.0006) [2023-12-28 07:14:35,678][106226] Updated weights for policy 0, policy_version 1667161 (0.0010) [2023-12-28 07:14:35,732][106226] Updated weights for policy 0, policy_version 1667171 (0.0005) [2023-12-28 07:14:35,795][106226] Updated weights for policy 0, policy_version 1667181 (0.0005) [2023-12-28 07:14:35,809][106225] Updated weights for policy 1, policy_version 1671152 (0.0010) [2023-12-28 07:14:35,862][106226] Updated weights for policy 0, policy_version 1667191 (0.0009) [2023-12-28 07:14:35,871][106225] Updated weights for policy 1, policy_version 1671162 (0.0006) [2023-12-28 07:14:35,932][106225] Updated weights for policy 1, policy_version 1671172 (0.0008) [2023-12-28 07:14:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 854753280. Throughput: 0: 10015.0, 1: 9916.5. Samples: 854760028. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:36,176][105115] Avg episode reward: [(0, '-4.820'), (1, '-4.598')] [2023-12-28 07:14:36,523][106226] Updated weights for policy 0, policy_version 1667201 (0.0011) [2023-12-28 07:14:36,581][106226] Updated weights for policy 0, policy_version 1667211 (0.0011) [2023-12-28 07:14:36,643][106226] Updated weights for policy 0, policy_version 1667221 (0.0011) [2023-12-28 07:14:36,645][106225] Updated weights for policy 1, policy_version 1671182 (0.0007) [2023-12-28 07:14:36,704][106225] Updated weights for policy 1, policy_version 1671192 (0.0007) [2023-12-28 07:14:36,762][106225] Updated weights for policy 1, policy_version 1671202 (0.0007) [2023-12-28 07:14:37,326][106226] Updated weights for policy 0, policy_version 1667231 (0.0011) [2023-12-28 07:14:37,382][106226] Updated weights for policy 0, policy_version 1667241 (0.0010) [2023-12-28 07:14:37,446][106226] Updated weights for policy 0, policy_version 1667251 (0.0011) [2023-12-28 07:14:37,513][106225] Updated weights for policy 1, policy_version 1671212 (0.0008) [2023-12-28 07:14:37,567][106225] Updated weights for policy 1, policy_version 1671222 (0.0007) [2023-12-28 07:14:37,624][106225] Updated weights for policy 1, policy_version 1671232 (0.0007) [2023-12-28 07:14:38,157][106226] Updated weights for policy 0, policy_version 1667261 (0.0011) [2023-12-28 07:14:38,217][106226] Updated weights for policy 0, policy_version 1667271 (0.0010) [2023-12-28 07:14:38,270][106226] Updated weights for policy 0, policy_version 1667281 (0.0010) [2023-12-28 07:14:38,354][106225] Updated weights for policy 1, policy_version 1671242 (0.0007) [2023-12-28 07:14:38,421][106225] Updated weights for policy 1, policy_version 1671252 (0.0006) [2023-12-28 07:14:38,477][106225] Updated weights for policy 1, policy_version 1671262 (0.0007) [2023-12-28 07:14:38,539][106225] Updated weights for policy 1, policy_version 1671272 (0.0010) [2023-12-28 07:14:39,027][106226] Updated weights for policy 0, policy_version 1667291 (0.0010) [2023-12-28 07:14:39,079][106226] Updated weights for policy 0, policy_version 1667301 (0.0010) [2023-12-28 07:14:39,130][106226] Updated weights for policy 0, policy_version 1667311 (0.0011) [2023-12-28 07:14:39,267][106225] Updated weights for policy 1, policy_version 1671282 (0.0006) [2023-12-28 07:14:39,337][106225] Updated weights for policy 1, policy_version 1671292 (0.0007) [2023-12-28 07:14:39,410][106225] Updated weights for policy 1, policy_version 1671302 (0.0006) [2023-12-28 07:14:39,830][106226] Updated weights for policy 0, policy_version 1667321 (0.0010) [2023-12-28 07:14:39,896][106226] Updated weights for policy 0, policy_version 1667331 (0.0011) [2023-12-28 07:14:39,966][106226] Updated weights for policy 0, policy_version 1667341 (0.0011) [2023-12-28 07:14:40,031][106226] Updated weights for policy 0, policy_version 1667351 (0.0010) [2023-12-28 07:14:40,207][106225] Updated weights for policy 1, policy_version 1671312 (0.0008) [2023-12-28 07:14:40,271][106225] Updated weights for policy 1, policy_version 1671322 (0.0008) [2023-12-28 07:14:40,323][106225] Updated weights for policy 1, policy_version 1671332 (0.0008) [2023-12-28 07:14:40,652][106226] Updated weights for policy 0, policy_version 1667361 (0.0006) [2023-12-28 07:14:40,711][106226] Updated weights for policy 0, policy_version 1667371 (0.0008) [2023-12-28 07:14:40,771][106226] Updated weights for policy 0, policy_version 1667381 (0.0011) [2023-12-28 07:14:41,092][106225] Updated weights for policy 1, policy_version 1671342 (0.0008) [2023-12-28 07:14:41,158][106225] Updated weights for policy 1, policy_version 1671352 (0.0008) [2023-12-28 07:14:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 854843392. Throughput: 0: 10021.9, 1: 9912.6. Samples: 854817268. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:41,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.752')] [2023-12-28 07:14:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001667384_426926080.pth... [2023-12-28 07:14:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001666232_426631168.pth [2023-12-28 07:14:41,222][106225] Updated weights for policy 1, policy_version 1671362 (0.0008) [2023-12-28 07:14:41,256][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001671368_427925504.pth... [2023-12-28 07:14:41,262][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001670184_427622400.pth [2023-12-28 07:14:41,509][106226] Updated weights for policy 0, policy_version 1667391 (0.0009) [2023-12-28 07:14:41,570][106226] Updated weights for policy 0, policy_version 1667401 (0.0008) [2023-12-28 07:14:41,637][106226] Updated weights for policy 0, policy_version 1667411 (0.0009) [2023-12-28 07:14:42,014][106225] Updated weights for policy 1, policy_version 1671372 (0.0008) [2023-12-28 07:14:42,074][106225] Updated weights for policy 1, policy_version 1671382 (0.0008) [2023-12-28 07:14:42,123][106225] Updated weights for policy 1, policy_version 1671392 (0.0008) [2023-12-28 07:14:42,371][106226] Updated weights for policy 0, policy_version 1667421 (0.0008) [2023-12-28 07:14:42,441][106226] Updated weights for policy 0, policy_version 1667431 (0.0006) [2023-12-28 07:14:42,500][106226] Updated weights for policy 0, policy_version 1667441 (0.0008) [2023-12-28 07:14:42,895][106225] Updated weights for policy 1, policy_version 1671402 (0.0008) [2023-12-28 07:14:42,956][106225] Updated weights for policy 1, policy_version 1671412 (0.0007) [2023-12-28 07:14:43,018][106225] Updated weights for policy 1, policy_version 1671422 (0.0010) [2023-12-28 07:14:43,077][106225] Updated weights for policy 1, policy_version 1671432 (0.0009) [2023-12-28 07:14:43,128][106226] Updated weights for policy 0, policy_version 1667451 (0.0007) [2023-12-28 07:14:43,181][106226] Updated weights for policy 0, policy_version 1667461 (0.0010) [2023-12-28 07:14:43,231][106226] Updated weights for policy 0, policy_version 1667471 (0.0010) [2023-12-28 07:14:43,828][106225] Updated weights for policy 1, policy_version 1671442 (0.0008) [2023-12-28 07:14:43,886][106225] Updated weights for policy 1, policy_version 1671452 (0.0008) [2023-12-28 07:14:43,940][106226] Updated weights for policy 0, policy_version 1667481 (0.0010) [2023-12-28 07:14:43,943][106225] Updated weights for policy 1, policy_version 1671462 (0.0008) [2023-12-28 07:14:43,997][106226] Updated weights for policy 0, policy_version 1667491 (0.0006) [2023-12-28 07:14:44,055][106226] Updated weights for policy 0, policy_version 1667501 (0.0005) [2023-12-28 07:14:44,109][106226] Updated weights for policy 0, policy_version 1667511 (0.0005) [2023-12-28 07:14:44,703][106225] Updated weights for policy 1, policy_version 1671472 (0.0008) [2023-12-28 07:14:44,725][106226] Updated weights for policy 0, policy_version 1667521 (0.0007) [2023-12-28 07:14:44,762][106225] Updated weights for policy 1, policy_version 1671482 (0.0008) [2023-12-28 07:14:44,782][106226] Updated weights for policy 0, policy_version 1667531 (0.0011) [2023-12-28 07:14:44,827][106225] Updated weights for policy 1, policy_version 1671492 (0.0008) [2023-12-28 07:14:44,851][106226] Updated weights for policy 0, policy_version 1667541 (0.0006) [2023-12-28 07:14:45,531][106226] Updated weights for policy 0, policy_version 1667551 (0.0008) [2023-12-28 07:14:45,588][106226] Updated weights for policy 0, policy_version 1667561 (0.0007) [2023-12-28 07:14:45,623][106225] Updated weights for policy 1, policy_version 1671502 (0.0008) [2023-12-28 07:14:45,657][106226] Updated weights for policy 0, policy_version 1667571 (0.0005) [2023-12-28 07:14:45,686][106225] Updated weights for policy 1, policy_version 1671512 (0.0006) [2023-12-28 07:14:45,739][106225] Updated weights for policy 1, policy_version 1671522 (0.0006) [2023-12-28 07:14:46,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 854941696. Throughput: 0: 10026.7, 1: 9818.1. Samples: 854931640. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:46,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.759')] [2023-12-28 07:14:46,356][106226] Updated weights for policy 0, policy_version 1667581 (0.0006) [2023-12-28 07:14:46,417][106226] Updated weights for policy 0, policy_version 1667591 (0.0007) [2023-12-28 07:14:46,440][106225] Updated weights for policy 1, policy_version 1671532 (0.0008) [2023-12-28 07:14:46,482][106226] Updated weights for policy 0, policy_version 1667601 (0.0009) [2023-12-28 07:14:46,499][106225] Updated weights for policy 1, policy_version 1671542 (0.0010) [2023-12-28 07:14:46,561][106225] Updated weights for policy 1, policy_version 1671552 (0.0007) [2023-12-28 07:14:47,170][106226] Updated weights for policy 0, policy_version 1667611 (0.0007) [2023-12-28 07:14:47,228][106226] Updated weights for policy 0, policy_version 1667621 (0.0009) [2023-12-28 07:14:47,277][106225] Updated weights for policy 1, policy_version 1671562 (0.0009) [2023-12-28 07:14:47,290][106226] Updated weights for policy 0, policy_version 1667631 (0.0010) [2023-12-28 07:14:47,328][106225] Updated weights for policy 1, policy_version 1671572 (0.0009) [2023-12-28 07:14:47,388][106225] Updated weights for policy 1, policy_version 1671582 (0.0005) [2023-12-28 07:14:47,460][106225] Updated weights for policy 1, policy_version 1671592 (0.0005) [2023-12-28 07:14:47,872][106226] Updated weights for policy 0, policy_version 1667641 (0.0010) [2023-12-28 07:14:47,930][106226] Updated weights for policy 0, policy_version 1667651 (0.0008) [2023-12-28 07:14:47,989][106226] Updated weights for policy 0, policy_version 1667661 (0.0006) [2023-12-28 07:14:47,999][106225] Updated weights for policy 1, policy_version 1671602 (0.0005) [2023-12-28 07:14:48,046][106226] Updated weights for policy 0, policy_version 1667671 (0.0011) [2023-12-28 07:14:48,054][106225] Updated weights for policy 1, policy_version 1671612 (0.0006) [2023-12-28 07:14:48,120][106225] Updated weights for policy 1, policy_version 1671622 (0.0005) [2023-12-28 07:14:48,710][106226] Updated weights for policy 0, policy_version 1667681 (0.0009) [2023-12-28 07:14:48,768][106225] Updated weights for policy 1, policy_version 1671632 (0.0009) [2023-12-28 07:14:48,770][106226] Updated weights for policy 0, policy_version 1667691 (0.0009) [2023-12-28 07:14:48,829][106226] Updated weights for policy 0, policy_version 1667701 (0.0011) [2023-12-28 07:14:48,830][106225] Updated weights for policy 1, policy_version 1671642 (0.0010) [2023-12-28 07:14:48,889][106225] Updated weights for policy 1, policy_version 1671652 (0.0011) [2023-12-28 07:14:49,573][106226] Updated weights for policy 0, policy_version 1667711 (0.0011) [2023-12-28 07:14:49,638][106226] Updated weights for policy 0, policy_version 1667721 (0.0007) [2023-12-28 07:14:49,664][106225] Updated weights for policy 1, policy_version 1671662 (0.0008) [2023-12-28 07:14:49,700][106226] Updated weights for policy 0, policy_version 1667731 (0.0009) [2023-12-28 07:14:49,730][106225] Updated weights for policy 1, policy_version 1671672 (0.0007) [2023-12-28 07:14:49,782][106225] Updated weights for policy 1, policy_version 1671682 (0.0009) [2023-12-28 07:14:50,327][106226] Updated weights for policy 0, policy_version 1667741 (0.0006) [2023-12-28 07:14:50,388][106226] Updated weights for policy 0, policy_version 1667751 (0.0006) [2023-12-28 07:14:50,448][106226] Updated weights for policy 0, policy_version 1667761 (0.0005) [2023-12-28 07:14:50,557][106225] Updated weights for policy 1, policy_version 1671692 (0.0010) [2023-12-28 07:14:50,632][106225] Updated weights for policy 1, policy_version 1671702 (0.0009) [2023-12-28 07:14:50,699][106225] Updated weights for policy 1, policy_version 1671712 (0.0010) [2023-12-28 07:14:50,991][106226] Updated weights for policy 0, policy_version 1667771 (0.0006) [2023-12-28 07:14:51,060][106226] Updated weights for policy 0, policy_version 1667781 (0.0008) [2023-12-28 07:14:51,122][106226] Updated weights for policy 0, policy_version 1667791 (0.0007) [2023-12-28 07:14:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 855040000. Throughput: 0: 10035.0, 1: 9811.3. Samples: 855052972. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:51,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.821')] [2023-12-28 07:14:51,480][106225] Updated weights for policy 1, policy_version 1671722 (0.0009) [2023-12-28 07:14:51,531][106225] Updated weights for policy 1, policy_version 1671732 (0.0007) [2023-12-28 07:14:51,592][106225] Updated weights for policy 1, policy_version 1671742 (0.0007) [2023-12-28 07:14:51,665][106225] Updated weights for policy 1, policy_version 1671752 (0.0008) [2023-12-28 07:14:51,806][106226] Updated weights for policy 0, policy_version 1667801 (0.0006) [2023-12-28 07:14:51,875][106226] Updated weights for policy 0, policy_version 1667811 (0.0007) [2023-12-28 07:14:51,936][106226] Updated weights for policy 0, policy_version 1667821 (0.0009) [2023-12-28 07:14:51,996][106226] Updated weights for policy 0, policy_version 1667831 (0.0008) [2023-12-28 07:14:52,452][106225] Updated weights for policy 1, policy_version 1671762 (0.0008) [2023-12-28 07:14:52,509][106225] Updated weights for policy 1, policy_version 1671772 (0.0009) [2023-12-28 07:14:52,573][106225] Updated weights for policy 1, policy_version 1671782 (0.0009) [2023-12-28 07:14:52,707][106226] Updated weights for policy 0, policy_version 1667841 (0.0007) [2023-12-28 07:14:52,777][106226] Updated weights for policy 0, policy_version 1667851 (0.0009) [2023-12-28 07:14:52,844][106226] Updated weights for policy 0, policy_version 1667861 (0.0009) [2023-12-28 07:14:53,236][106225] Updated weights for policy 1, policy_version 1671792 (0.0009) [2023-12-28 07:14:53,281][106225] Updated weights for policy 1, policy_version 1671802 (0.0008) [2023-12-28 07:14:53,330][106225] Updated weights for policy 1, policy_version 1671812 (0.0008) [2023-12-28 07:14:53,576][106226] Updated weights for policy 0, policy_version 1667871 (0.0008) [2023-12-28 07:14:53,626][106226] Updated weights for policy 0, policy_version 1667881 (0.0007) [2023-12-28 07:14:53,676][106226] Updated weights for policy 0, policy_version 1667891 (0.0008) [2023-12-28 07:14:53,980][106225] Updated weights for policy 1, policy_version 1671822 (0.0009) [2023-12-28 07:14:54,032][106225] Updated weights for policy 1, policy_version 1671832 (0.0008) [2023-12-28 07:14:54,083][106225] Updated weights for policy 1, policy_version 1671842 (0.0008) [2023-12-28 07:14:54,458][106226] Updated weights for policy 0, policy_version 1667901 (0.0010) [2023-12-28 07:14:54,510][106226] Updated weights for policy 0, policy_version 1667911 (0.0008) [2023-12-28 07:14:54,555][106226] Updated weights for policy 0, policy_version 1667921 (0.0008) [2023-12-28 07:14:54,808][106225] Updated weights for policy 1, policy_version 1671852 (0.0008) [2023-12-28 07:14:54,857][106225] Updated weights for policy 1, policy_version 1671862 (0.0008) [2023-12-28 07:14:54,917][106225] Updated weights for policy 1, policy_version 1671872 (0.0008) [2023-12-28 07:14:55,306][106226] Updated weights for policy 0, policy_version 1667931 (0.0007) [2023-12-28 07:14:55,362][106226] Updated weights for policy 0, policy_version 1667941 (0.0005) [2023-12-28 07:14:55,415][106226] Updated weights for policy 0, policy_version 1667951 (0.0005) [2023-12-28 07:14:55,618][106225] Updated weights for policy 1, policy_version 1671882 (0.0007) [2023-12-28 07:14:55,682][106225] Updated weights for policy 1, policy_version 1671892 (0.0005) [2023-12-28 07:14:55,748][106225] Updated weights for policy 1, policy_version 1671902 (0.0008) [2023-12-28 07:14:55,799][106225] Updated weights for policy 1, policy_version 1671912 (0.0008) [2023-12-28 07:14:56,056][106226] Updated weights for policy 0, policy_version 1667961 (0.0005) [2023-12-28 07:14:56,111][106226] Updated weights for policy 0, policy_version 1667971 (0.0006) [2023-12-28 07:14:56,158][106226] Updated weights for policy 0, policy_version 1667981 (0.0007) [2023-12-28 07:14:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 855138304. Throughput: 0: 9942.4, 1: 9841.4. Samples: 855110408. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:14:56,175][105115] Avg episode reward: [(0, '-4.627'), (1, '-4.877')] [2023-12-28 07:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001671912_428064768.pth... [2023-12-28 07:14:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001670792_427778048.pth [2023-12-28 07:14:56,214][106226] Updated weights for policy 0, policy_version 1667991 (0.0005) [2023-12-28 07:14:56,218][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001667992_427081728.pth... [2023-12-28 07:14:56,221][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001666808_426778624.pth [2023-12-28 07:14:56,507][106225] Updated weights for policy 1, policy_version 1671922 (0.0005) [2023-12-28 07:14:56,559][106225] Updated weights for policy 1, policy_version 1671932 (0.0005) [2023-12-28 07:14:56,611][106225] Updated weights for policy 1, policy_version 1671942 (0.0005) [2023-12-28 07:14:56,827][106226] Updated weights for policy 0, policy_version 1668001 (0.0005) [2023-12-28 07:14:56,879][106226] Updated weights for policy 0, policy_version 1668011 (0.0005) [2023-12-28 07:14:56,935][106226] Updated weights for policy 0, policy_version 1668021 (0.0008) [2023-12-28 07:14:57,153][106225] Updated weights for policy 1, policy_version 1671952 (0.0008) [2023-12-28 07:14:57,214][106225] Updated weights for policy 1, policy_version 1671962 (0.0008) [2023-12-28 07:14:57,272][106225] Updated weights for policy 1, policy_version 1671972 (0.0008) [2023-12-28 07:14:57,617][106226] Updated weights for policy 0, policy_version 1668032 (0.0008) [2023-12-28 07:14:57,677][106226] Updated weights for policy 0, policy_version 1668042 (0.0006) [2023-12-28 07:14:57,735][106226] Updated weights for policy 0, policy_version 1668052 (0.0007) [2023-12-28 07:14:58,003][106225] Updated weights for policy 1, policy_version 1671982 (0.0008) [2023-12-28 07:14:58,057][106225] Updated weights for policy 1, policy_version 1671992 (0.0008) [2023-12-28 07:14:58,114][106225] Updated weights for policy 1, policy_version 1672002 (0.0008) [2023-12-28 07:14:58,331][106226] Updated weights for policy 0, policy_version 1668062 (0.0007) [2023-12-28 07:14:58,399][106226] Updated weights for policy 0, policy_version 1668072 (0.0009) [2023-12-28 07:14:58,462][106226] Updated weights for policy 0, policy_version 1668082 (0.0008) [2023-12-28 07:14:58,949][106225] Updated weights for policy 1, policy_version 1672012 (0.0008) [2023-12-28 07:14:59,013][106225] Updated weights for policy 1, policy_version 1672022 (0.0008) [2023-12-28 07:14:59,080][106225] Updated weights for policy 1, policy_version 1672032 (0.0009) [2023-12-28 07:14:59,347][106226] Updated weights for policy 0, policy_version 1668092 (0.0008) [2023-12-28 07:14:59,416][106226] Updated weights for policy 0, policy_version 1668102 (0.0008) [2023-12-28 07:14:59,480][106226] Updated weights for policy 0, policy_version 1668112 (0.0008) [2023-12-28 07:14:59,778][106225] Updated weights for policy 1, policy_version 1672042 (0.0005) [2023-12-28 07:14:59,839][106225] Updated weights for policy 1, policy_version 1672052 (0.0010) [2023-12-28 07:14:59,899][106225] Updated weights for policy 1, policy_version 1672062 (0.0008) [2023-12-28 07:14:59,964][106225] Updated weights for policy 1, policy_version 1672072 (0.0007) [2023-12-28 07:15:00,286][106226] Updated weights for policy 0, policy_version 1668122 (0.0008) [2023-12-28 07:15:00,335][106226] Updated weights for policy 0, policy_version 1668132 (0.0007) [2023-12-28 07:15:00,391][106226] Updated weights for policy 0, policy_version 1668142 (0.0007) [2023-12-28 07:15:00,459][106226] Updated weights for policy 0, policy_version 1668152 (0.0007) [2023-12-28 07:15:00,674][106225] Updated weights for policy 1, policy_version 1672082 (0.0010) [2023-12-28 07:15:00,724][106225] Updated weights for policy 1, policy_version 1672092 (0.0010) [2023-12-28 07:15:00,766][106225] Updated weights for policy 1, policy_version 1672102 (0.0010) [2023-12-28 07:15:01,150][106226] Updated weights for policy 0, policy_version 1668162 (0.0007) [2023-12-28 07:15:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 855236608. Throughput: 0: 9998.7, 1: 9877.4. Samples: 855230088. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:01,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.879')] [2023-12-28 07:15:01,211][106226] Updated weights for policy 0, policy_version 1668172 (0.0005) [2023-12-28 07:15:01,270][106226] Updated weights for policy 0, policy_version 1668182 (0.0007) [2023-12-28 07:15:01,572][106225] Updated weights for policy 1, policy_version 1672112 (0.0009) [2023-12-28 07:15:01,635][106225] Updated weights for policy 1, policy_version 1672122 (0.0007) [2023-12-28 07:15:01,698][106225] Updated weights for policy 1, policy_version 1672132 (0.0007) [2023-12-28 07:15:02,011][106226] Updated weights for policy 0, policy_version 1668192 (0.0009) [2023-12-28 07:15:02,068][106226] Updated weights for policy 0, policy_version 1668202 (0.0008) [2023-12-28 07:15:02,119][106226] Updated weights for policy 0, policy_version 1668212 (0.0008) [2023-12-28 07:15:02,341][106225] Updated weights for policy 1, policy_version 1672142 (0.0008) [2023-12-28 07:15:02,400][106225] Updated weights for policy 1, policy_version 1672152 (0.0008) [2023-12-28 07:15:02,467][106225] Updated weights for policy 1, policy_version 1672162 (0.0010) [2023-12-28 07:15:02,907][106226] Updated weights for policy 0, policy_version 1668222 (0.0008) [2023-12-28 07:15:02,964][106226] Updated weights for policy 0, policy_version 1668232 (0.0007) [2023-12-28 07:15:03,020][106226] Updated weights for policy 0, policy_version 1668242 (0.0008) [2023-12-28 07:15:03,177][106225] Updated weights for policy 1, policy_version 1672172 (0.0009) [2023-12-28 07:15:03,226][106225] Updated weights for policy 1, policy_version 1672182 (0.0005) [2023-12-28 07:15:03,288][106225] Updated weights for policy 1, policy_version 1672192 (0.0007) [2023-12-28 07:15:03,740][106226] Updated weights for policy 0, policy_version 1668252 (0.0009) [2023-12-28 07:15:03,796][106226] Updated weights for policy 0, policy_version 1668262 (0.0010) [2023-12-28 07:15:03,857][106226] Updated weights for policy 0, policy_version 1668272 (0.0011) [2023-12-28 07:15:03,963][106225] Updated weights for policy 1, policy_version 1672202 (0.0008) [2023-12-28 07:15:04,028][106225] Updated weights for policy 1, policy_version 1672212 (0.0008) [2023-12-28 07:15:04,086][106225] Updated weights for policy 1, policy_version 1672222 (0.0008) [2023-12-28 07:15:04,147][106225] Updated weights for policy 1, policy_version 1672232 (0.0007) [2023-12-28 07:15:04,525][106226] Updated weights for policy 0, policy_version 1668282 (0.0010) [2023-12-28 07:15:04,582][106226] Updated weights for policy 0, policy_version 1668292 (0.0010) [2023-12-28 07:15:04,637][106226] Updated weights for policy 0, policy_version 1668302 (0.0007) [2023-12-28 07:15:04,692][106226] Updated weights for policy 0, policy_version 1668312 (0.0005) [2023-12-28 07:15:04,943][106225] Updated weights for policy 1, policy_version 1672242 (0.0009) [2023-12-28 07:15:05,010][106225] Updated weights for policy 1, policy_version 1672252 (0.0009) [2023-12-28 07:15:05,075][106225] Updated weights for policy 1, policy_version 1672262 (0.0008) [2023-12-28 07:15:05,298][106226] Updated weights for policy 0, policy_version 1668322 (0.0010) [2023-12-28 07:15:05,360][106226] Updated weights for policy 0, policy_version 1668332 (0.0010) [2023-12-28 07:15:05,421][106226] Updated weights for policy 0, policy_version 1668342 (0.0009) [2023-12-28 07:15:05,808][106225] Updated weights for policy 1, policy_version 1672272 (0.0008) [2023-12-28 07:15:05,874][106225] Updated weights for policy 1, policy_version 1672282 (0.0008) [2023-12-28 07:15:05,938][106225] Updated weights for policy 1, policy_version 1672292 (0.0008) [2023-12-28 07:15:06,130][106226] Updated weights for policy 0, policy_version 1668352 (0.0011) [2023-12-28 07:15:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 855334912. Throughput: 0: 9973.7, 1: 9745.3. Samples: 855346568. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:06,175][105115] Avg episode reward: [(0, '-4.696'), (1, '-4.879')] [2023-12-28 07:15:06,196][106226] Updated weights for policy 0, policy_version 1668362 (0.0008) [2023-12-28 07:15:06,259][106226] Updated weights for policy 0, policy_version 1668372 (0.0009) [2023-12-28 07:15:06,681][106225] Updated weights for policy 1, policy_version 1672302 (0.0007) [2023-12-28 07:15:06,744][106225] Updated weights for policy 1, policy_version 1672312 (0.0008) [2023-12-28 07:15:06,802][106225] Updated weights for policy 1, policy_version 1672322 (0.0008) [2023-12-28 07:15:06,951][106226] Updated weights for policy 0, policy_version 1668382 (0.0011) [2023-12-28 07:15:07,004][106226] Updated weights for policy 0, policy_version 1668392 (0.0011) [2023-12-28 07:15:07,062][106226] Updated weights for policy 0, policy_version 1668402 (0.0011) [2023-12-28 07:15:07,542][106225] Updated weights for policy 1, policy_version 1672332 (0.0008) [2023-12-28 07:15:07,593][106225] Updated weights for policy 1, policy_version 1672342 (0.0008) [2023-12-28 07:15:07,645][106225] Updated weights for policy 1, policy_version 1672352 (0.0007) [2023-12-28 07:15:07,736][106226] Updated weights for policy 0, policy_version 1668412 (0.0008) [2023-12-28 07:15:07,793][106226] Updated weights for policy 0, policy_version 1668422 (0.0005) [2023-12-28 07:15:07,848][106226] Updated weights for policy 0, policy_version 1668432 (0.0005) [2023-12-28 07:15:08,399][106226] Updated weights for policy 0, policy_version 1668442 (0.0006) [2023-12-28 07:15:08,457][106226] Updated weights for policy 0, policy_version 1668452 (0.0011) [2023-12-28 07:15:08,490][106225] Updated weights for policy 1, policy_version 1672362 (0.0008) [2023-12-28 07:15:08,514][106226] Updated weights for policy 0, policy_version 1668462 (0.0007) [2023-12-28 07:15:08,548][106225] Updated weights for policy 1, policy_version 1672372 (0.0007) [2023-12-28 07:15:08,577][106226] Updated weights for policy 0, policy_version 1668472 (0.0009) [2023-12-28 07:15:08,602][106225] Updated weights for policy 1, policy_version 1672382 (0.0007) [2023-12-28 07:15:08,654][106225] Updated weights for policy 1, policy_version 1672392 (0.0008) [2023-12-28 07:15:09,282][106226] Updated weights for policy 0, policy_version 1668482 (0.0007) [2023-12-28 07:15:09,342][106226] Updated weights for policy 0, policy_version 1668492 (0.0007) [2023-12-28 07:15:09,412][106226] Updated weights for policy 0, policy_version 1668502 (0.0008) [2023-12-28 07:15:09,456][106225] Updated weights for policy 1, policy_version 1672402 (0.0009) [2023-12-28 07:15:09,508][106225] Updated weights for policy 1, policy_version 1672412 (0.0008) [2023-12-28 07:15:09,567][106225] Updated weights for policy 1, policy_version 1672422 (0.0008) [2023-12-28 07:15:10,122][106226] Updated weights for policy 0, policy_version 1668512 (0.0007) [2023-12-28 07:15:10,183][106226] Updated weights for policy 0, policy_version 1668522 (0.0009) [2023-12-28 07:15:10,239][106226] Updated weights for policy 0, policy_version 1668532 (0.0009) [2023-12-28 07:15:10,312][106225] Updated weights for policy 1, policy_version 1672432 (0.0008) [2023-12-28 07:15:10,377][106225] Updated weights for policy 1, policy_version 1672442 (0.0008) [2023-12-28 07:15:10,441][106225] Updated weights for policy 1, policy_version 1672452 (0.0009) [2023-12-28 07:15:10,880][106226] Updated weights for policy 0, policy_version 1668542 (0.0008) [2023-12-28 07:15:10,940][106226] Updated weights for policy 0, policy_version 1668552 (0.0008) [2023-12-28 07:15:10,998][106226] Updated weights for policy 0, policy_version 1668562 (0.0009) [2023-12-28 07:15:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 855433216. Throughput: 0: 10056.8, 1: 9697.6. Samples: 855404464. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:11,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.798')] [2023-12-28 07:15:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001672456_428204032.pth... [2023-12-28 07:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001668568_427229184.pth... [2023-12-28 07:15:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001671368_427925504.pth [2023-12-28 07:15:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001667384_426926080.pth [2023-12-28 07:15:11,246][106225] Updated weights for policy 1, policy_version 1672462 (0.0008) [2023-12-28 07:15:11,305][106225] Updated weights for policy 1, policy_version 1672472 (0.0009) [2023-12-28 07:15:11,369][106225] Updated weights for policy 1, policy_version 1672482 (0.0009) [2023-12-28 07:15:11,815][106226] Updated weights for policy 0, policy_version 1668572 (0.0009) [2023-12-28 07:15:11,875][106226] Updated weights for policy 0, policy_version 1668582 (0.0008) [2023-12-28 07:15:11,938][106226] Updated weights for policy 0, policy_version 1668592 (0.0010) [2023-12-28 07:15:12,164][106225] Updated weights for policy 1, policy_version 1672492 (0.0008) [2023-12-28 07:15:12,226][106225] Updated weights for policy 1, policy_version 1672502 (0.0008) [2023-12-28 07:15:12,291][106225] Updated weights for policy 1, policy_version 1672512 (0.0007) [2023-12-28 07:15:12,640][106226] Updated weights for policy 0, policy_version 1668602 (0.0009) [2023-12-28 07:15:12,706][106226] Updated weights for policy 0, policy_version 1668612 (0.0006) [2023-12-28 07:15:12,766][106226] Updated weights for policy 0, policy_version 1668622 (0.0008) [2023-12-28 07:15:12,823][106226] Updated weights for policy 0, policy_version 1668632 (0.0008) [2023-12-28 07:15:13,095][106225] Updated weights for policy 1, policy_version 1672522 (0.0008) [2023-12-28 07:15:13,153][106225] Updated weights for policy 1, policy_version 1672532 (0.0008) [2023-12-28 07:15:13,212][106225] Updated weights for policy 1, policy_version 1672542 (0.0008) [2023-12-28 07:15:13,279][106225] Updated weights for policy 1, policy_version 1672552 (0.0007) [2023-12-28 07:15:13,436][106226] Updated weights for policy 0, policy_version 1668642 (0.0008) [2023-12-28 07:15:13,489][106226] Updated weights for policy 0, policy_version 1668652 (0.0009) [2023-12-28 07:15:13,544][106226] Updated weights for policy 0, policy_version 1668662 (0.0008) [2023-12-28 07:15:14,049][106225] Updated weights for policy 1, policy_version 1672562 (0.0009) [2023-12-28 07:15:14,098][106225] Updated weights for policy 1, policy_version 1672572 (0.0009) [2023-12-28 07:15:14,148][106225] Updated weights for policy 1, policy_version 1672582 (0.0008) [2023-12-28 07:15:14,191][106226] Updated weights for policy 0, policy_version 1668672 (0.0009) [2023-12-28 07:15:14,251][106226] Updated weights for policy 0, policy_version 1668682 (0.0008) [2023-12-28 07:15:14,306][106226] Updated weights for policy 0, policy_version 1668692 (0.0009) [2023-12-28 07:15:14,926][106225] Updated weights for policy 1, policy_version 1672592 (0.0009) [2023-12-28 07:15:14,989][106225] Updated weights for policy 1, policy_version 1672602 (0.0008) [2023-12-28 07:15:15,007][106226] Updated weights for policy 0, policy_version 1668702 (0.0007) [2023-12-28 07:15:15,049][106225] Updated weights for policy 1, policy_version 1672612 (0.0008) [2023-12-28 07:15:15,068][106226] Updated weights for policy 0, policy_version 1668712 (0.0006) [2023-12-28 07:15:15,127][106226] Updated weights for policy 0, policy_version 1668722 (0.0008) [2023-12-28 07:15:15,769][106226] Updated weights for policy 0, policy_version 1668732 (0.0008) [2023-12-28 07:15:15,833][106226] Updated weights for policy 0, policy_version 1668742 (0.0006) [2023-12-28 07:15:15,858][106225] Updated weights for policy 1, policy_version 1672622 (0.0006) [2023-12-28 07:15:15,886][106226] Updated weights for policy 0, policy_version 1668752 (0.0009) [2023-12-28 07:15:15,916][106225] Updated weights for policy 1, policy_version 1672632 (0.0007) [2023-12-28 07:15:15,967][106225] Updated weights for policy 1, policy_version 1672642 (0.0007) [2023-12-28 07:15:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 855531520. Throughput: 0: 10006.9, 1: 9518.3. Samples: 855518284. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:16,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.695')] [2023-12-28 07:15:16,513][106226] Updated weights for policy 0, policy_version 1668762 (0.0007) [2023-12-28 07:15:16,572][106226] Updated weights for policy 0, policy_version 1668772 (0.0007) [2023-12-28 07:15:16,624][106226] Updated weights for policy 0, policy_version 1668782 (0.0008) [2023-12-28 07:15:16,688][106226] Updated weights for policy 0, policy_version 1668792 (0.0010) [2023-12-28 07:15:16,695][106225] Updated weights for policy 1, policy_version 1672652 (0.0007) [2023-12-28 07:15:16,755][106225] Updated weights for policy 1, policy_version 1672662 (0.0011) [2023-12-28 07:15:16,816][106225] Updated weights for policy 1, policy_version 1672672 (0.0011) [2023-12-28 07:15:17,404][106226] Updated weights for policy 0, policy_version 1668802 (0.0009) [2023-12-28 07:15:17,455][106226] Updated weights for policy 0, policy_version 1668812 (0.0008) [2023-12-28 07:15:17,510][106225] Updated weights for policy 1, policy_version 1672682 (0.0010) [2023-12-28 07:15:17,516][106226] Updated weights for policy 0, policy_version 1668822 (0.0007) [2023-12-28 07:15:17,557][106225] Updated weights for policy 1, policy_version 1672692 (0.0010) [2023-12-28 07:15:17,613][106225] Updated weights for policy 1, policy_version 1672702 (0.0011) [2023-12-28 07:15:17,669][106225] Updated weights for policy 1, policy_version 1672712 (0.0010) [2023-12-28 07:15:18,338][106226] Updated weights for policy 0, policy_version 1668832 (0.0008) [2023-12-28 07:15:18,350][106225] Updated weights for policy 1, policy_version 1672722 (0.0008) [2023-12-28 07:15:18,406][106226] Updated weights for policy 0, policy_version 1668842 (0.0007) [2023-12-28 07:15:18,419][106225] Updated weights for policy 1, policy_version 1672732 (0.0008) [2023-12-28 07:15:18,470][106226] Updated weights for policy 0, policy_version 1668852 (0.0008) [2023-12-28 07:15:18,489][106225] Updated weights for policy 1, policy_version 1672742 (0.0007) [2023-12-28 07:15:19,162][106226] Updated weights for policy 0, policy_version 1668862 (0.0007) [2023-12-28 07:15:19,202][106225] Updated weights for policy 1, policy_version 1672752 (0.0009) [2023-12-28 07:15:19,229][106226] Updated weights for policy 0, policy_version 1668872 (0.0010) [2023-12-28 07:15:19,266][106225] Updated weights for policy 1, policy_version 1672762 (0.0010) [2023-12-28 07:15:19,294][106226] Updated weights for policy 0, policy_version 1668882 (0.0007) [2023-12-28 07:15:19,334][106225] Updated weights for policy 1, policy_version 1672772 (0.0011) [2023-12-28 07:15:20,054][106226] Updated weights for policy 0, policy_version 1668892 (0.0007) [2023-12-28 07:15:20,114][106226] Updated weights for policy 0, policy_version 1668902 (0.0009) [2023-12-28 07:15:20,125][106225] Updated weights for policy 1, policy_version 1672782 (0.0008) [2023-12-28 07:15:20,180][106226] Updated weights for policy 0, policy_version 1668912 (0.0008) [2023-12-28 07:15:20,188][106225] Updated weights for policy 1, policy_version 1672792 (0.0007) [2023-12-28 07:15:20,256][106225] Updated weights for policy 1, policy_version 1672802 (0.0006) [2023-12-28 07:15:20,983][106226] Updated weights for policy 0, policy_version 1668922 (0.0008) [2023-12-28 07:15:21,009][106225] Updated weights for policy 1, policy_version 1672812 (0.0007) [2023-12-28 07:15:21,050][106226] Updated weights for policy 0, policy_version 1668932 (0.0007) [2023-12-28 07:15:21,109][106225] Updated weights for policy 1, policy_version 1672825 (0.0013) [2023-12-28 07:15:21,124][106226] Updated weights for policy 0, policy_version 1668942 (0.0008) [2023-12-28 07:15:21,181][105115] Fps is (10 sec: 18011.4, 60 sec: 19385.8, 300 sec: 19743.7). Total num frames: 855613440. Throughput: 0: 9929.7, 1: 9441.6. Samples: 855631852. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:21,182][106225] Updated weights for policy 1, policy_version 1672835 (0.0008) [2023-12-28 07:15:21,181][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.499')] [2023-12-28 07:15:21,200][106226] Updated weights for policy 0, policy_version 1668952 (0.0009) [2023-12-28 07:15:22,002][106225] Updated weights for policy 1, policy_version 1672845 (0.0009) [2023-12-28 07:15:22,064][106225] Updated weights for policy 1, policy_version 1672855 (0.0009) [2023-12-28 07:15:22,128][106225] Updated weights for policy 1, policy_version 1672865 (0.0007) [2023-12-28 07:15:22,143][106226] Updated weights for policy 0, policy_version 1668962 (0.0008) [2023-12-28 07:15:22,204][106226] Updated weights for policy 0, policy_version 1668972 (0.0008) [2023-12-28 07:15:22,274][106226] Updated weights for policy 0, policy_version 1668982 (0.0009) [2023-12-28 07:15:22,853][106225] Updated weights for policy 1, policy_version 1672875 (0.0007) [2023-12-28 07:15:22,910][106225] Updated weights for policy 1, policy_version 1672885 (0.0007) [2023-12-28 07:15:22,963][106225] Updated weights for policy 1, policy_version 1672895 (0.0009) [2023-12-28 07:15:22,995][106226] Updated weights for policy 0, policy_version 1668992 (0.0008) [2023-12-28 07:15:23,049][106226] Updated weights for policy 0, policy_version 1669002 (0.0009) [2023-12-28 07:15:23,102][106226] Updated weights for policy 0, policy_version 1669012 (0.0009) [2023-12-28 07:15:23,646][106225] Updated weights for policy 1, policy_version 1672905 (0.0008) [2023-12-28 07:15:23,706][106225] Updated weights for policy 1, policy_version 1672915 (0.0009) [2023-12-28 07:15:23,757][106226] Updated weights for policy 0, policy_version 1669022 (0.0007) [2023-12-28 07:15:23,771][106225] Updated weights for policy 1, policy_version 1672925 (0.0008) [2023-12-28 07:15:23,820][106226] Updated weights for policy 0, policy_version 1669032 (0.0006) [2023-12-28 07:15:23,832][106225] Updated weights for policy 1, policy_version 1672935 (0.0007) [2023-12-28 07:15:23,874][106226] Updated weights for policy 0, policy_version 1669042 (0.0008) [2023-12-28 07:15:24,521][106225] Updated weights for policy 1, policy_version 1672945 (0.0006) [2023-12-28 07:15:24,578][106225] Updated weights for policy 1, policy_version 1672955 (0.0005) [2023-12-28 07:15:24,629][106226] Updated weights for policy 0, policy_version 1669052 (0.0008) [2023-12-28 07:15:24,639][106225] Updated weights for policy 1, policy_version 1672965 (0.0005) [2023-12-28 07:15:24,681][106226] Updated weights for policy 0, policy_version 1669062 (0.0009) [2023-12-28 07:15:24,730][106226] Updated weights for policy 0, policy_version 1669072 (0.0008) [2023-12-28 07:15:25,230][106225] Updated weights for policy 1, policy_version 1672975 (0.0008) [2023-12-28 07:15:25,284][106225] Updated weights for policy 1, policy_version 1672985 (0.0009) [2023-12-28 07:15:25,342][106225] Updated weights for policy 1, policy_version 1672995 (0.0008) [2023-12-28 07:15:25,458][106226] Updated weights for policy 0, policy_version 1669082 (0.0010) [2023-12-28 07:15:25,522][106226] Updated weights for policy 0, policy_version 1669092 (0.0007) [2023-12-28 07:15:25,577][106226] Updated weights for policy 0, policy_version 1669102 (0.0005) [2023-12-28 07:15:25,631][106226] Updated weights for policy 0, policy_version 1669112 (0.0005) [2023-12-28 07:15:26,149][106225] Updated weights for policy 1, policy_version 1673005 (0.0009) [2023-12-28 07:15:26,150][106226] Updated weights for policy 0, policy_version 1669122 (0.0008) [2023-12-28 07:15:26,175][105115] Fps is (10 sec: 18022.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 855711744. Throughput: 0: 9890.0, 1: 9414.5. Samples: 855685976. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:26,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.916')] [2023-12-28 07:15:26,199][106225] Updated weights for policy 1, policy_version 1673015 (0.0010) [2023-12-28 07:15:26,205][106226] Updated weights for policy 0, policy_version 1669132 (0.0007) [2023-12-28 07:15:26,253][106225] Updated weights for policy 1, policy_version 1673025 (0.0010) [2023-12-28 07:15:26,262][106226] Updated weights for policy 0, policy_version 1669142 (0.0005) [2023-12-28 07:15:26,272][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001669144_427376640.pth... [2023-12-28 07:15:26,276][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001667992_427081728.pth [2023-12-28 07:15:26,289][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001673032_428351488.pth... [2023-12-28 07:15:26,293][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001671912_428064768.pth [2023-12-28 07:15:26,888][106226] Updated weights for policy 0, policy_version 1669152 (0.0005) [2023-12-28 07:15:26,951][106225] Updated weights for policy 1, policy_version 1673035 (0.0009) [2023-12-28 07:15:26,954][106226] Updated weights for policy 0, policy_version 1669162 (0.0005) [2023-12-28 07:15:27,005][106225] Updated weights for policy 1, policy_version 1673045 (0.0005) [2023-12-28 07:15:27,008][106226] Updated weights for policy 0, policy_version 1669172 (0.0008) [2023-12-28 07:15:27,059][106225] Updated weights for policy 1, policy_version 1673055 (0.0008) [2023-12-28 07:15:27,593][106226] Updated weights for policy 0, policy_version 1669182 (0.0006) [2023-12-28 07:15:27,651][106226] Updated weights for policy 0, policy_version 1669192 (0.0005) [2023-12-28 07:15:27,695][106225] Updated weights for policy 1, policy_version 1673065 (0.0010) [2023-12-28 07:15:27,707][106226] Updated weights for policy 0, policy_version 1669202 (0.0008) [2023-12-28 07:15:27,749][106225] Updated weights for policy 1, policy_version 1673075 (0.0006) [2023-12-28 07:15:27,808][106225] Updated weights for policy 1, policy_version 1673085 (0.0007) [2023-12-28 07:15:27,871][106225] Updated weights for policy 1, policy_version 1673095 (0.0005) [2023-12-28 07:15:28,279][106226] Updated weights for policy 0, policy_version 1669212 (0.0010) [2023-12-28 07:15:28,341][106226] Updated weights for policy 0, policy_version 1669222 (0.0010) [2023-12-28 07:15:28,405][106226] Updated weights for policy 0, policy_version 1669232 (0.0006) [2023-12-28 07:15:28,635][106225] Updated weights for policy 1, policy_version 1673105 (0.0007) [2023-12-28 07:15:28,685][106225] Updated weights for policy 1, policy_version 1673115 (0.0008) [2023-12-28 07:15:28,751][106225] Updated weights for policy 1, policy_version 1673125 (0.0006) [2023-12-28 07:15:29,049][106226] Updated weights for policy 0, policy_version 1669242 (0.0007) [2023-12-28 07:15:29,108][106226] Updated weights for policy 0, policy_version 1669252 (0.0010) [2023-12-28 07:15:29,166][106226] Updated weights for policy 0, policy_version 1669262 (0.0010) [2023-12-28 07:15:29,226][106226] Updated weights for policy 0, policy_version 1669272 (0.0011) [2023-12-28 07:15:29,527][106225] Updated weights for policy 1, policy_version 1673135 (0.0009) [2023-12-28 07:15:29,585][106225] Updated weights for policy 1, policy_version 1673145 (0.0009) [2023-12-28 07:15:29,650][106225] Updated weights for policy 1, policy_version 1673155 (0.0007) [2023-12-28 07:15:29,951][106226] Updated weights for policy 0, policy_version 1669282 (0.0007) [2023-12-28 07:15:30,020][106226] Updated weights for policy 0, policy_version 1669292 (0.0007) [2023-12-28 07:15:30,089][106226] Updated weights for policy 0, policy_version 1669302 (0.0006) [2023-12-28 07:15:30,398][106225] Updated weights for policy 1, policy_version 1673165 (0.0008) [2023-12-28 07:15:30,465][106225] Updated weights for policy 1, policy_version 1673175 (0.0008) [2023-12-28 07:15:30,525][106225] Updated weights for policy 1, policy_version 1673185 (0.0006) [2023-12-28 07:15:30,834][106226] Updated weights for policy 0, policy_version 1669312 (0.0008) [2023-12-28 07:15:30,894][106226] Updated weights for policy 0, policy_version 1669322 (0.0006) [2023-12-28 07:15:30,948][106226] Updated weights for policy 0, policy_version 1669332 (0.0006) [2023-12-28 07:15:31,174][105115] Fps is (10 sec: 20492.7, 60 sec: 19387.8, 300 sec: 19771.9). Total num frames: 855818240. Throughput: 0: 9993.8, 1: 9516.9. Samples: 855809620. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:31,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.356')] [2023-12-28 07:15:31,179][106225] Updated weights for policy 1, policy_version 1673195 (0.0007) [2023-12-28 07:15:31,245][106225] Updated weights for policy 1, policy_version 1673205 (0.0010) [2023-12-28 07:15:31,304][106225] Updated weights for policy 1, policy_version 1673215 (0.0010) [2023-12-28 07:15:31,701][106226] Updated weights for policy 0, policy_version 1669342 (0.0007) [2023-12-28 07:15:31,769][106226] Updated weights for policy 0, policy_version 1669352 (0.0009) [2023-12-28 07:15:31,833][106226] Updated weights for policy 0, policy_version 1669362 (0.0008) [2023-12-28 07:15:32,054][106225] Updated weights for policy 1, policy_version 1673225 (0.0011) [2023-12-28 07:15:32,109][106225] Updated weights for policy 1, policy_version 1673235 (0.0008) [2023-12-28 07:15:32,164][106225] Updated weights for policy 1, policy_version 1673245 (0.0008) [2023-12-28 07:15:32,220][106225] Updated weights for policy 1, policy_version 1673255 (0.0008) [2023-12-28 07:15:32,590][106226] Updated weights for policy 0, policy_version 1669372 (0.0009) [2023-12-28 07:15:32,651][106226] Updated weights for policy 0, policy_version 1669382 (0.0008) [2023-12-28 07:15:32,711][106226] Updated weights for policy 0, policy_version 1669392 (0.0007) [2023-12-28 07:15:32,894][106225] Updated weights for policy 1, policy_version 1673265 (0.0006) [2023-12-28 07:15:32,945][106225] Updated weights for policy 1, policy_version 1673275 (0.0010) [2023-12-28 07:15:32,995][106225] Updated weights for policy 1, policy_version 1673285 (0.0010) [2023-12-28 07:15:33,486][106226] Updated weights for policy 0, policy_version 1669402 (0.0008) [2023-12-28 07:15:33,528][106226] Updated weights for policy 0, policy_version 1669412 (0.0007) [2023-12-28 07:15:33,574][106226] Updated weights for policy 0, policy_version 1669422 (0.0008) [2023-12-28 07:15:33,619][106226] Updated weights for policy 0, policy_version 1669432 (0.0007) [2023-12-28 07:15:33,657][106225] Updated weights for policy 1, policy_version 1673295 (0.0010) [2023-12-28 07:15:33,712][106225] Updated weights for policy 1, policy_version 1673305 (0.0010) [2023-12-28 07:15:33,765][106225] Updated weights for policy 1, policy_version 1673315 (0.0010) [2023-12-28 07:15:34,362][106225] Updated weights for policy 1, policy_version 1673325 (0.0009) [2023-12-28 07:15:34,420][106225] Updated weights for policy 1, policy_version 1673335 (0.0009) [2023-12-28 07:15:34,468][106226] Updated weights for policy 0, policy_version 1669442 (0.0007) [2023-12-28 07:15:34,481][106225] Updated weights for policy 1, policy_version 1673345 (0.0010) [2023-12-28 07:15:34,530][106226] Updated weights for policy 0, policy_version 1669452 (0.0006) [2023-12-28 07:15:34,592][106226] Updated weights for policy 0, policy_version 1669462 (0.0008) [2023-12-28 07:15:35,164][106225] Updated weights for policy 1, policy_version 1673355 (0.0009) [2023-12-28 07:15:35,215][106225] Updated weights for policy 1, policy_version 1673365 (0.0005) [2023-12-28 07:15:35,271][106225] Updated weights for policy 1, policy_version 1673375 (0.0006) [2023-12-28 07:15:35,296][106226] Updated weights for policy 0, policy_version 1669472 (0.0007) [2023-12-28 07:15:35,352][106226] Updated weights for policy 0, policy_version 1669482 (0.0009) [2023-12-28 07:15:35,402][106226] Updated weights for policy 0, policy_version 1669492 (0.0009) [2023-12-28 07:15:35,882][106225] Updated weights for policy 1, policy_version 1673385 (0.0006) [2023-12-28 07:15:35,945][106225] Updated weights for policy 1, policy_version 1673395 (0.0006) [2023-12-28 07:15:35,995][106225] Updated weights for policy 1, policy_version 1673405 (0.0005) [2023-12-28 07:15:36,057][106225] Updated weights for policy 1, policy_version 1673415 (0.0005) [2023-12-28 07:15:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19387.8, 300 sec: 19771.9). Total num frames: 855916544. Throughput: 0: 9806.2, 1: 9606.3. Samples: 855926532. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:36,175][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.627')] [2023-12-28 07:15:36,218][106226] Updated weights for policy 0, policy_version 1669502 (0.0008) [2023-12-28 07:15:36,276][106226] Updated weights for policy 0, policy_version 1669513 (0.0010) [2023-12-28 07:15:36,325][106226] Updated weights for policy 0, policy_version 1669523 (0.0009) [2023-12-28 07:15:36,627][106225] Updated weights for policy 1, policy_version 1673425 (0.0006) [2023-12-28 07:15:36,677][106225] Updated weights for policy 1, policy_version 1673435 (0.0005) [2023-12-28 07:15:36,728][106225] Updated weights for policy 1, policy_version 1673445 (0.0005) [2023-12-28 07:15:37,117][106226] Updated weights for policy 0, policy_version 1669533 (0.0007) [2023-12-28 07:15:37,169][106226] Updated weights for policy 0, policy_version 1669543 (0.0006) [2023-12-28 07:15:37,222][106226] Updated weights for policy 0, policy_version 1669553 (0.0005) [2023-12-28 07:15:37,364][106225] Updated weights for policy 1, policy_version 1673455 (0.0008) [2023-12-28 07:15:37,427][106225] Updated weights for policy 1, policy_version 1673465 (0.0008) [2023-12-28 07:15:37,475][106225] Updated weights for policy 1, policy_version 1673475 (0.0009) [2023-12-28 07:15:37,898][106226] Updated weights for policy 0, policy_version 1669563 (0.0006) [2023-12-28 07:15:37,959][106226] Updated weights for policy 0, policy_version 1669573 (0.0007) [2023-12-28 07:15:38,021][106226] Updated weights for policy 0, policy_version 1669583 (0.0008) [2023-12-28 07:15:38,194][106225] Updated weights for policy 1, policy_version 1673485 (0.0008) [2023-12-28 07:15:38,245][106225] Updated weights for policy 1, policy_version 1673495 (0.0008) [2023-12-28 07:15:38,303][106225] Updated weights for policy 1, policy_version 1673505 (0.0008) [2023-12-28 07:15:38,739][106226] Updated weights for policy 0, policy_version 1669593 (0.0009) [2023-12-28 07:15:38,807][106226] Updated weights for policy 0, policy_version 1669603 (0.0009) [2023-12-28 07:15:38,873][106226] Updated weights for policy 0, policy_version 1669613 (0.0009) [2023-12-28 07:15:38,938][106226] Updated weights for policy 0, policy_version 1669623 (0.0010) [2023-12-28 07:15:38,990][106225] Updated weights for policy 1, policy_version 1673516 (0.0010) [2023-12-28 07:15:39,043][106225] Updated weights for policy 1, policy_version 1673526 (0.0008) [2023-12-28 07:15:39,093][106225] Updated weights for policy 1, policy_version 1673536 (0.0007) [2023-12-28 07:15:39,756][106226] Updated weights for policy 0, policy_version 1669633 (0.0008) [2023-12-28 07:15:39,816][106226] Updated weights for policy 0, policy_version 1669643 (0.0008) [2023-12-28 07:15:39,865][106225] Updated weights for policy 1, policy_version 1673546 (0.0008) [2023-12-28 07:15:39,890][106226] Updated weights for policy 0, policy_version 1669653 (0.0010) [2023-12-28 07:15:39,935][106225] Updated weights for policy 1, policy_version 1673556 (0.0008) [2023-12-28 07:15:39,999][106225] Updated weights for policy 1, policy_version 1673566 (0.0008) [2023-12-28 07:15:40,052][106225] Updated weights for policy 1, policy_version 1673576 (0.0008) [2023-12-28 07:15:40,638][106226] Updated weights for policy 0, policy_version 1669663 (0.0008) [2023-12-28 07:15:40,700][106226] Updated weights for policy 0, policy_version 1669673 (0.0008) [2023-12-28 07:15:40,758][106225] Updated weights for policy 1, policy_version 1673586 (0.0006) [2023-12-28 07:15:40,760][106226] Updated weights for policy 0, policy_version 1669683 (0.0007) [2023-12-28 07:15:40,808][106225] Updated weights for policy 1, policy_version 1673596 (0.0007) [2023-12-28 07:15:40,861][106225] Updated weights for policy 1, policy_version 1673606 (0.0006) [2023-12-28 07:15:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 856014848. Throughput: 0: 9807.4, 1: 9654.6. Samples: 855986200. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:41,175][105115] Avg episode reward: [(0, '-4.905'), (1, '-4.699')] [2023-12-28 07:15:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001673608_428498944.pth... [2023-12-28 07:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001669688_427515904.pth... [2023-12-28 07:15:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001672456_428204032.pth [2023-12-28 07:15:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001668568_427229184.pth [2023-12-28 07:15:41,570][106226] Updated weights for policy 0, policy_version 1669693 (0.0008) [2023-12-28 07:15:41,621][106225] Updated weights for policy 1, policy_version 1673616 (0.0007) [2023-12-28 07:15:41,636][106226] Updated weights for policy 0, policy_version 1669703 (0.0008) [2023-12-28 07:15:41,690][106225] Updated weights for policy 1, policy_version 1673626 (0.0008) [2023-12-28 07:15:41,705][106226] Updated weights for policy 0, policy_version 1669713 (0.0006) [2023-12-28 07:15:41,758][106225] Updated weights for policy 1, policy_version 1673636 (0.0007) [2023-12-28 07:15:42,416][106226] Updated weights for policy 0, policy_version 1669723 (0.0008) [2023-12-28 07:15:42,477][106226] Updated weights for policy 0, policy_version 1669733 (0.0006) [2023-12-28 07:15:42,487][106225] Updated weights for policy 1, policy_version 1673646 (0.0009) [2023-12-28 07:15:42,538][106226] Updated weights for policy 0, policy_version 1669743 (0.0006) [2023-12-28 07:15:42,550][106225] Updated weights for policy 1, policy_version 1673656 (0.0008) [2023-12-28 07:15:42,608][106225] Updated weights for policy 1, policy_version 1673666 (0.0008) [2023-12-28 07:15:43,259][106225] Updated weights for policy 1, policy_version 1673676 (0.0008) [2023-12-28 07:15:43,263][106226] Updated weights for policy 0, policy_version 1669753 (0.0006) [2023-12-28 07:15:43,311][106226] Updated weights for policy 0, policy_version 1669763 (0.0007) [2023-12-28 07:15:43,318][106225] Updated weights for policy 1, policy_version 1673686 (0.0006) [2023-12-28 07:15:43,358][106226] Updated weights for policy 0, policy_version 1669773 (0.0007) [2023-12-28 07:15:43,383][106225] Updated weights for policy 1, policy_version 1673696 (0.0007) [2023-12-28 07:15:43,412][106226] Updated weights for policy 0, policy_version 1669783 (0.0007) [2023-12-28 07:15:43,945][106225] Updated weights for policy 1, policy_version 1673706 (0.0006) [2023-12-28 07:15:43,990][106225] Updated weights for policy 1, policy_version 1673716 (0.0005) [2023-12-28 07:15:44,046][106225] Updated weights for policy 1, policy_version 1673726 (0.0006) [2023-12-28 07:15:44,100][106225] Updated weights for policy 1, policy_version 1673736 (0.0008) [2023-12-28 07:15:44,107][106226] Updated weights for policy 0, policy_version 1669793 (0.0010) [2023-12-28 07:15:44,167][106226] Updated weights for policy 0, policy_version 1669803 (0.0011) [2023-12-28 07:15:44,227][106226] Updated weights for policy 0, policy_version 1669813 (0.0010) [2023-12-28 07:15:44,734][106225] Updated weights for policy 1, policy_version 1673746 (0.0008) [2023-12-28 07:15:44,816][106225] Updated weights for policy 1, policy_version 1673756 (0.0008) [2023-12-28 07:15:44,881][106225] Updated weights for policy 1, policy_version 1673766 (0.0008) [2023-12-28 07:15:44,932][106226] Updated weights for policy 0, policy_version 1669823 (0.0009) [2023-12-28 07:15:44,992][106226] Updated weights for policy 0, policy_version 1669833 (0.0008) [2023-12-28 07:15:45,046][106226] Updated weights for policy 0, policy_version 1669843 (0.0011) [2023-12-28 07:15:45,618][106225] Updated weights for policy 1, policy_version 1673776 (0.0008) [2023-12-28 07:15:45,675][106225] Updated weights for policy 1, policy_version 1673786 (0.0008) [2023-12-28 07:15:45,728][106225] Updated weights for policy 1, policy_version 1673796 (0.0009) [2023-12-28 07:15:45,795][106226] Updated weights for policy 0, policy_version 1669853 (0.0008) [2023-12-28 07:15:45,850][106226] Updated weights for policy 0, policy_version 1669863 (0.0009) [2023-12-28 07:15:45,906][106226] Updated weights for policy 0, policy_version 1669873 (0.0009) [2023-12-28 07:15:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 856113152. Throughput: 0: 9725.8, 1: 9659.4. Samples: 856102420. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:46,175][105115] Avg episode reward: [(0, '-4.670'), (1, '-4.622')] [2023-12-28 07:15:46,508][106225] Updated weights for policy 1, policy_version 1673806 (0.0008) [2023-12-28 07:15:46,566][106225] Updated weights for policy 1, policy_version 1673816 (0.0008) [2023-12-28 07:15:46,618][106225] Updated weights for policy 1, policy_version 1673826 (0.0008) [2023-12-28 07:15:46,626][106226] Updated weights for policy 0, policy_version 1669883 (0.0010) [2023-12-28 07:15:46,689][106226] Updated weights for policy 0, policy_version 1669893 (0.0010) [2023-12-28 07:15:46,747][106226] Updated weights for policy 0, policy_version 1669903 (0.0008) [2023-12-28 07:15:47,357][106225] Updated weights for policy 1, policy_version 1673836 (0.0008) [2023-12-28 07:15:47,386][106226] Updated weights for policy 0, policy_version 1669913 (0.0007) [2023-12-28 07:15:47,407][106225] Updated weights for policy 1, policy_version 1673846 (0.0007) [2023-12-28 07:15:47,433][106226] Updated weights for policy 0, policy_version 1669923 (0.0006) [2023-12-28 07:15:47,454][106225] Updated weights for policy 1, policy_version 1673856 (0.0005) [2023-12-28 07:15:47,484][106226] Updated weights for policy 0, policy_version 1669933 (0.0006) [2023-12-28 07:15:47,539][106226] Updated weights for policy 0, policy_version 1669943 (0.0008) [2023-12-28 07:15:48,189][106226] Updated weights for policy 0, policy_version 1669953 (0.0011) [2023-12-28 07:15:48,236][106226] Updated weights for policy 0, policy_version 1669963 (0.0010) [2023-12-28 07:15:48,257][106225] Updated weights for policy 1, policy_version 1673866 (0.0006) [2023-12-28 07:15:48,287][106226] Updated weights for policy 0, policy_version 1669973 (0.0010) [2023-12-28 07:15:48,318][106225] Updated weights for policy 1, policy_version 1673876 (0.0006) [2023-12-28 07:15:48,380][106225] Updated weights for policy 1, policy_version 1673886 (0.0008) [2023-12-28 07:15:48,433][106225] Updated weights for policy 1, policy_version 1673896 (0.0008) [2023-12-28 07:15:49,014][106226] Updated weights for policy 0, policy_version 1669983 (0.0010) [2023-12-28 07:15:49,064][106226] Updated weights for policy 0, policy_version 1669993 (0.0010) [2023-12-28 07:15:49,114][106226] Updated weights for policy 0, policy_version 1670003 (0.0010) [2023-12-28 07:15:49,157][106225] Updated weights for policy 1, policy_version 1673906 (0.0006) [2023-12-28 07:15:49,214][106225] Updated weights for policy 1, policy_version 1673916 (0.0006) [2023-12-28 07:15:49,277][106225] Updated weights for policy 1, policy_version 1673926 (0.0013) [2023-12-28 07:15:49,873][106226] Updated weights for policy 0, policy_version 1670013 (0.0011) [2023-12-28 07:15:49,941][106226] Updated weights for policy 0, policy_version 1670023 (0.0011) [2023-12-28 07:15:49,995][106225] Updated weights for policy 1, policy_version 1673936 (0.0009) [2023-12-28 07:15:50,003][106226] Updated weights for policy 0, policy_version 1670033 (0.0011) [2023-12-28 07:15:50,047][106225] Updated weights for policy 1, policy_version 1673946 (0.0009) [2023-12-28 07:15:50,106][106225] Updated weights for policy 1, policy_version 1673956 (0.0009) [2023-12-28 07:15:50,687][106226] Updated weights for policy 0, policy_version 1670043 (0.0009) [2023-12-28 07:15:50,738][106226] Updated weights for policy 0, policy_version 1670053 (0.0010) [2023-12-28 07:15:50,793][106226] Updated weights for policy 0, policy_version 1670063 (0.0011) [2023-12-28 07:15:50,808][106225] Updated weights for policy 1, policy_version 1673966 (0.0010) [2023-12-28 07:15:50,867][106225] Updated weights for policy 1, policy_version 1673976 (0.0009) [2023-12-28 07:15:50,923][106225] Updated weights for policy 1, policy_version 1673986 (0.0007) [2023-12-28 07:15:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 856211456. Throughput: 0: 9745.4, 1: 9629.4. Samples: 856218436. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:51,176][105115] Avg episode reward: [(0, '-4.625'), (1, '-4.571')] [2023-12-28 07:15:51,518][106226] Updated weights for policy 0, policy_version 1670073 (0.0010) [2023-12-28 07:15:51,581][106226] Updated weights for policy 0, policy_version 1670083 (0.0009) [2023-12-28 07:15:51,670][106226] Updated weights for policy 0, policy_version 1670093 (0.0011) [2023-12-28 07:15:51,742][106226] Updated weights for policy 0, policy_version 1670103 (0.0011) [2023-12-28 07:15:51,742][106225] Updated weights for policy 1, policy_version 1673996 (0.0008) [2023-12-28 07:15:51,801][106225] Updated weights for policy 1, policy_version 1674006 (0.0008) [2023-12-28 07:15:51,863][106225] Updated weights for policy 1, policy_version 1674016 (0.0006) [2023-12-28 07:15:52,389][106226] Updated weights for policy 0, policy_version 1670113 (0.0009) [2023-12-28 07:15:52,459][106226] Updated weights for policy 0, policy_version 1670123 (0.0008) [2023-12-28 07:15:52,520][106226] Updated weights for policy 0, policy_version 1670133 (0.0008) [2023-12-28 07:15:52,566][106225] Updated weights for policy 1, policy_version 1674026 (0.0007) [2023-12-28 07:15:52,631][106225] Updated weights for policy 1, policy_version 1674036 (0.0009) [2023-12-28 07:15:52,691][106225] Updated weights for policy 1, policy_version 1674046 (0.0008) [2023-12-28 07:15:52,752][106225] Updated weights for policy 1, policy_version 1674056 (0.0008) [2023-12-28 07:15:53,268][106226] Updated weights for policy 0, policy_version 1670143 (0.0009) [2023-12-28 07:15:53,324][106226] Updated weights for policy 0, policy_version 1670153 (0.0009) [2023-12-28 07:15:53,380][106226] Updated weights for policy 0, policy_version 1670163 (0.0006) [2023-12-28 07:15:53,509][106225] Updated weights for policy 1, policy_version 1674066 (0.0008) [2023-12-28 07:15:53,558][106225] Updated weights for policy 1, policy_version 1674076 (0.0008) [2023-12-28 07:15:53,610][106225] Updated weights for policy 1, policy_version 1674086 (0.0008) [2023-12-28 07:15:53,974][106226] Updated weights for policy 0, policy_version 1670173 (0.0005) [2023-12-28 07:15:54,032][106226] Updated weights for policy 0, policy_version 1670183 (0.0005) [2023-12-28 07:15:54,083][106226] Updated weights for policy 0, policy_version 1670193 (0.0008) [2023-12-28 07:15:54,410][106225] Updated weights for policy 1, policy_version 1674096 (0.0008) [2023-12-28 07:15:54,461][106225] Updated weights for policy 1, policy_version 1674106 (0.0009) [2023-12-28 07:15:54,516][106225] Updated weights for policy 1, policy_version 1674116 (0.0008) [2023-12-28 07:15:54,745][106226] Updated weights for policy 0, policy_version 1670203 (0.0005) [2023-12-28 07:15:54,799][106226] Updated weights for policy 0, policy_version 1670213 (0.0005) [2023-12-28 07:15:54,852][106226] Updated weights for policy 0, policy_version 1670223 (0.0005) [2023-12-28 07:15:55,334][106225] Updated weights for policy 1, policy_version 1674126 (0.0007) [2023-12-28 07:15:55,394][106225] Updated weights for policy 1, policy_version 1674136 (0.0008) [2023-12-28 07:15:55,396][106226] Updated weights for policy 0, policy_version 1670233 (0.0005) [2023-12-28 07:15:55,440][106225] Updated weights for policy 1, policy_version 1674146 (0.0008) [2023-12-28 07:15:55,452][106226] Updated weights for policy 0, policy_version 1670243 (0.0005) [2023-12-28 07:15:55,506][106226] Updated weights for policy 0, policy_version 1670253 (0.0007) [2023-12-28 07:15:55,558][106226] Updated weights for policy 0, policy_version 1670263 (0.0009) [2023-12-28 07:15:56,151][106226] Updated weights for policy 0, policy_version 1670273 (0.0006) [2023-12-28 07:15:56,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 856301568. Throughput: 0: 9731.0, 1: 9638.6. Samples: 856276100. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:15:56,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.051')] [2023-12-28 07:15:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001674152_428638208.pth... [2023-12-28 07:15:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001673032_428351488.pth [2023-12-28 07:15:56,209][106226] Updated weights for policy 0, policy_version 1670283 (0.0008) [2023-12-28 07:15:56,246][106225] Updated weights for policy 1, policy_version 1674156 (0.0007) [2023-12-28 07:15:56,271][106226] Updated weights for policy 0, policy_version 1670293 (0.0007) [2023-12-28 07:15:56,290][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001670296_427671552.pth... [2023-12-28 07:15:56,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001669144_427376640.pth [2023-12-28 07:15:56,302][106225] Updated weights for policy 1, policy_version 1674166 (0.0006) [2023-12-28 07:15:56,364][106225] Updated weights for policy 1, policy_version 1674176 (0.0008) [2023-12-28 07:15:56,968][106226] Updated weights for policy 0, policy_version 1670303 (0.0010) [2023-12-28 07:15:57,036][106226] Updated weights for policy 0, policy_version 1670313 (0.0010) [2023-12-28 07:15:57,070][106225] Updated weights for policy 1, policy_version 1674186 (0.0006) [2023-12-28 07:15:57,104][106226] Updated weights for policy 0, policy_version 1670323 (0.0008) [2023-12-28 07:15:57,123][106225] Updated weights for policy 1, policy_version 1674196 (0.0006) [2023-12-28 07:15:57,175][106225] Updated weights for policy 1, policy_version 1674206 (0.0005) [2023-12-28 07:15:57,233][106225] Updated weights for policy 1, policy_version 1674216 (0.0005) [2023-12-28 07:15:57,780][106225] Updated weights for policy 1, policy_version 1674226 (0.0005) [2023-12-28 07:15:57,828][106225] Updated weights for policy 1, policy_version 1674236 (0.0010) [2023-12-28 07:15:57,845][106226] Updated weights for policy 0, policy_version 1670333 (0.0008) [2023-12-28 07:15:57,869][106225] Updated weights for policy 1, policy_version 1674246 (0.0005) [2023-12-28 07:15:57,906][106226] Updated weights for policy 0, policy_version 1670343 (0.0008) [2023-12-28 07:15:57,964][106226] Updated weights for policy 0, policy_version 1670353 (0.0007) [2023-12-28 07:15:58,602][106225] Updated weights for policy 1, policy_version 1674256 (0.0009) [2023-12-28 07:15:58,666][106225] Updated weights for policy 1, policy_version 1674266 (0.0009) [2023-12-28 07:15:58,705][106226] Updated weights for policy 0, policy_version 1670363 (0.0008) [2023-12-28 07:15:58,740][106225] Updated weights for policy 1, policy_version 1674276 (0.0008) [2023-12-28 07:15:58,770][106226] Updated weights for policy 0, policy_version 1670373 (0.0009) [2023-12-28 07:15:58,838][106226] Updated weights for policy 0, policy_version 1670383 (0.0009) [2023-12-28 07:15:59,506][106225] Updated weights for policy 1, policy_version 1674286 (0.0006) [2023-12-28 07:15:59,552][106225] Updated weights for policy 1, policy_version 1674296 (0.0005) [2023-12-28 07:15:59,596][106226] Updated weights for policy 0, policy_version 1670393 (0.0007) [2023-12-28 07:15:59,605][106225] Updated weights for policy 1, policy_version 1674306 (0.0005) [2023-12-28 07:15:59,649][106226] Updated weights for policy 0, policy_version 1670403 (0.0008) [2023-12-28 07:15:59,701][106226] Updated weights for policy 0, policy_version 1670413 (0.0008) [2023-12-28 07:15:59,759][106226] Updated weights for policy 0, policy_version 1670423 (0.0007) [2023-12-28 07:16:00,300][106225] Updated weights for policy 1, policy_version 1674316 (0.0008) [2023-12-28 07:16:00,363][106225] Updated weights for policy 1, policy_version 1674326 (0.0010) [2023-12-28 07:16:00,424][106225] Updated weights for policy 1, policy_version 1674336 (0.0010) [2023-12-28 07:16:00,528][106226] Updated weights for policy 0, policy_version 1670433 (0.0008) [2023-12-28 07:16:00,579][106226] Updated weights for policy 0, policy_version 1670443 (0.0007) [2023-12-28 07:16:00,643][106226] Updated weights for policy 0, policy_version 1670453 (0.0007) [2023-12-28 07:16:01,153][106225] Updated weights for policy 1, policy_version 1674346 (0.0010) [2023-12-28 07:16:01,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19387.8, 300 sec: 19716.3). Total num frames: 856399872. Throughput: 0: 9735.1, 1: 9716.3. Samples: 856393596. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:16:01,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.726')] [2023-12-28 07:16:01,215][106225] Updated weights for policy 1, policy_version 1674356 (0.0010) [2023-12-28 07:16:01,283][106225] Updated weights for policy 1, policy_version 1674366 (0.0010) [2023-12-28 07:16:01,304][106226] Updated weights for policy 0, policy_version 1670463 (0.0008) [2023-12-28 07:16:01,346][106225] Updated weights for policy 1, policy_version 1674376 (0.0011) [2023-12-28 07:16:01,369][106226] Updated weights for policy 0, policy_version 1670473 (0.0006) [2023-12-28 07:16:01,433][106226] Updated weights for policy 0, policy_version 1670483 (0.0007) [2023-12-28 07:16:02,038][106226] Updated weights for policy 0, policy_version 1670493 (0.0007) [2023-12-28 07:16:02,048][106225] Updated weights for policy 1, policy_version 1674386 (0.0006) [2023-12-28 07:16:02,102][106226] Updated weights for policy 0, policy_version 1670503 (0.0007) [2023-12-28 07:16:02,104][106225] Updated weights for policy 1, policy_version 1674396 (0.0009) [2023-12-28 07:16:02,149][106226] Updated weights for policy 0, policy_version 1670513 (0.0006) [2023-12-28 07:16:02,161][106225] Updated weights for policy 1, policy_version 1674406 (0.0010) [2023-12-28 07:16:02,864][106225] Updated weights for policy 1, policy_version 1674416 (0.0010) [2023-12-28 07:16:02,887][106226] Updated weights for policy 0, policy_version 1670523 (0.0008) [2023-12-28 07:16:02,918][106225] Updated weights for policy 1, policy_version 1674426 (0.0010) [2023-12-28 07:16:02,939][106226] Updated weights for policy 0, policy_version 1670533 (0.0005) [2023-12-28 07:16:02,974][106225] Updated weights for policy 1, policy_version 1674436 (0.0010) [2023-12-28 07:16:02,986][106226] Updated weights for policy 0, policy_version 1670543 (0.0008) [2023-12-28 07:16:03,693][106225] Updated weights for policy 1, policy_version 1674446 (0.0011) [2023-12-28 07:16:03,715][106226] Updated weights for policy 0, policy_version 1670553 (0.0007) [2023-12-28 07:16:03,746][106225] Updated weights for policy 1, policy_version 1674456 (0.0010) [2023-12-28 07:16:03,765][106226] Updated weights for policy 0, policy_version 1670563 (0.0009) [2023-12-28 07:16:03,796][106225] Updated weights for policy 1, policy_version 1674466 (0.0010) [2023-12-28 07:16:03,818][106226] Updated weights for policy 0, policy_version 1670573 (0.0006) [2023-12-28 07:16:03,896][106226] Updated weights for policy 0, policy_version 1670583 (0.0008) [2023-12-28 07:16:04,473][106225] Updated weights for policy 1, policy_version 1674476 (0.0010) [2023-12-28 07:16:04,532][106225] Updated weights for policy 1, policy_version 1674486 (0.0007) [2023-12-28 07:16:04,596][106225] Updated weights for policy 1, policy_version 1674496 (0.0008) [2023-12-28 07:16:04,680][106226] Updated weights for policy 0, policy_version 1670593 (0.0010) [2023-12-28 07:16:04,741][106226] Updated weights for policy 0, policy_version 1670603 (0.0011) [2023-12-28 07:16:04,793][106226] Updated weights for policy 0, policy_version 1670613 (0.0011) [2023-12-28 07:16:05,157][106225] Updated weights for policy 1, policy_version 1674506 (0.0006) [2023-12-28 07:16:05,217][106225] Updated weights for policy 1, policy_version 1674516 (0.0006) [2023-12-28 07:16:05,271][106225] Updated weights for policy 1, policy_version 1674526 (0.0010) [2023-12-28 07:16:05,333][106225] Updated weights for policy 1, policy_version 1674536 (0.0010) [2023-12-28 07:16:05,510][106226] Updated weights for policy 0, policy_version 1670623 (0.0007) [2023-12-28 07:16:05,569][106226] Updated weights for policy 0, policy_version 1670633 (0.0005) [2023-12-28 07:16:05,622][106226] Updated weights for policy 0, policy_version 1670643 (0.0008) [2023-12-28 07:16:05,984][106225] Updated weights for policy 1, policy_version 1674546 (0.0011) [2023-12-28 07:16:06,044][106225] Updated weights for policy 1, policy_version 1674556 (0.0010) [2023-12-28 07:16:06,110][106225] Updated weights for policy 1, policy_version 1674566 (0.0010) [2023-12-28 07:16:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 856506368. Throughput: 0: 9789.7, 1: 9817.8. Samples: 856514068. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:16:06,176][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.862')] [2023-12-28 07:16:06,290][106226] Updated weights for policy 0, policy_version 1670653 (0.0005) [2023-12-28 07:16:06,349][106226] Updated weights for policy 0, policy_version 1670663 (0.0007) [2023-12-28 07:16:06,410][106226] Updated weights for policy 0, policy_version 1670673 (0.0008) [2023-12-28 07:16:06,829][106225] Updated weights for policy 1, policy_version 1674576 (0.0010) [2023-12-28 07:16:06,890][106225] Updated weights for policy 1, policy_version 1674586 (0.0010) [2023-12-28 07:16:06,948][106225] Updated weights for policy 1, policy_version 1674596 (0.0010) [2023-12-28 07:16:07,148][106226] Updated weights for policy 0, policy_version 1670683 (0.0009) [2023-12-28 07:16:07,205][106226] Updated weights for policy 0, policy_version 1670693 (0.0009) [2023-12-28 07:16:07,263][106226] Updated weights for policy 0, policy_version 1670703 (0.0008) [2023-12-28 07:16:07,577][106225] Updated weights for policy 1, policy_version 1674606 (0.0007) [2023-12-28 07:16:07,631][106225] Updated weights for policy 1, policy_version 1674616 (0.0005) [2023-12-28 07:16:07,697][106225] Updated weights for policy 1, policy_version 1674626 (0.0009) [2023-12-28 07:16:07,921][106226] Updated weights for policy 0, policy_version 1670713 (0.0008) [2023-12-28 07:16:07,984][106226] Updated weights for policy 0, policy_version 1670723 (0.0009) [2023-12-28 07:16:08,040][106226] Updated weights for policy 0, policy_version 1670733 (0.0007) [2023-12-28 07:16:08,088][106226] Updated weights for policy 0, policy_version 1670743 (0.0008) [2023-12-28 07:16:08,340][106225] Updated weights for policy 1, policy_version 1674636 (0.0010) [2023-12-28 07:16:08,400][106225] Updated weights for policy 1, policy_version 1674646 (0.0009) [2023-12-28 07:16:08,453][106225] Updated weights for policy 1, policy_version 1674656 (0.0008) [2023-12-28 07:16:08,870][106226] Updated weights for policy 0, policy_version 1670753 (0.0007) [2023-12-28 07:16:08,933][106226] Updated weights for policy 0, policy_version 1670763 (0.0006) [2023-12-28 07:16:08,989][106226] Updated weights for policy 0, policy_version 1670773 (0.0009) [2023-12-28 07:16:09,240][106225] Updated weights for policy 1, policy_version 1674666 (0.0008) [2023-12-28 07:16:09,313][106225] Updated weights for policy 1, policy_version 1674676 (0.0008) [2023-12-28 07:16:09,382][106225] Updated weights for policy 1, policy_version 1674686 (0.0008) [2023-12-28 07:16:09,451][106225] Updated weights for policy 1, policy_version 1674696 (0.0009) [2023-12-28 07:16:09,612][106226] Updated weights for policy 0, policy_version 1670783 (0.0007) [2023-12-28 07:16:09,676][106226] Updated weights for policy 0, policy_version 1670793 (0.0005) [2023-12-28 07:16:09,732][106226] Updated weights for policy 0, policy_version 1670803 (0.0008) [2023-12-28 07:16:10,252][106225] Updated weights for policy 1, policy_version 1674706 (0.0008) [2023-12-28 07:16:10,316][106225] Updated weights for policy 1, policy_version 1674716 (0.0008) [2023-12-28 07:16:10,372][106225] Updated weights for policy 1, policy_version 1674726 (0.0009) [2023-12-28 07:16:10,490][106226] Updated weights for policy 0, policy_version 1670813 (0.0008) [2023-12-28 07:16:10,547][106226] Updated weights for policy 0, policy_version 1670823 (0.0009) [2023-12-28 07:16:10,608][106226] Updated weights for policy 0, policy_version 1670833 (0.0009) [2023-12-28 07:16:11,031][106225] Updated weights for policy 1, policy_version 1674736 (0.0008) [2023-12-28 07:16:11,097][106225] Updated weights for policy 1, policy_version 1674746 (0.0009) [2023-12-28 07:16:11,164][106225] Updated weights for policy 1, policy_version 1674756 (0.0009) [2023-12-28 07:16:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 856596480. Throughput: 0: 9831.4, 1: 9892.7. Samples: 856573560. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 07:16:11,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.692')] [2023-12-28 07:16:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001670840_427810816.pth... [2023-12-28 07:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001669688_427515904.pth [2023-12-28 07:16:11,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001674760_428793856.pth... [2023-12-28 07:16:11,194][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001673608_428498944.pth [2023-12-28 07:16:11,461][106226] Updated weights for policy 0, policy_version 1670843 (0.0009) [2023-12-28 07:16:11,525][106226] Updated weights for policy 0, policy_version 1670853 (0.0008) [2023-12-28 07:16:11,589][106226] Updated weights for policy 0, policy_version 1670863 (0.0009) [2023-12-28 07:16:11,921][106225] Updated weights for policy 1, policy_version 1674766 (0.0008) [2023-12-28 07:16:11,983][106225] Updated weights for policy 1, policy_version 1674776 (0.0007) [2023-12-28 07:16:12,049][106225] Updated weights for policy 1, policy_version 1674786 (0.0009) [2023-12-28 07:16:12,276][106226] Updated weights for policy 0, policy_version 1670873 (0.0008) [2023-12-28 07:16:12,353][106226] Updated weights for policy 0, policy_version 1670883 (0.0011) [2023-12-28 07:16:12,408][106226] Updated weights for policy 0, policy_version 1670893 (0.0011) [2023-12-28 07:16:12,469][106226] Updated weights for policy 0, policy_version 1670903 (0.0011) [2023-12-28 07:16:12,784][106225] Updated weights for policy 1, policy_version 1674796 (0.0008) [2023-12-28 07:16:12,841][106225] Updated weights for policy 1, policy_version 1674806 (0.0009) [2023-12-28 07:16:12,892][106225] Updated weights for policy 1, policy_version 1674816 (0.0008) [2023-12-28 07:16:13,173][106226] Updated weights for policy 0, policy_version 1670913 (0.0007) [2023-12-28 07:16:13,238][106226] Updated weights for policy 0, policy_version 1670923 (0.0005) [2023-12-28 07:16:13,298][106226] Updated weights for policy 0, policy_version 1670933 (0.0006) [2023-12-28 07:16:13,687][106225] Updated weights for policy 1, policy_version 1674826 (0.0009) [2023-12-28 07:16:13,740][106225] Updated weights for policy 1, policy_version 1674836 (0.0005) [2023-12-28 07:16:13,792][106225] Updated weights for policy 1, policy_version 1674846 (0.0005) [2023-12-28 07:16:13,854][106225] Updated weights for policy 1, policy_version 1674856 (0.0005) [2023-12-28 07:16:13,872][106226] Updated weights for policy 0, policy_version 1670943 (0.0008) [2023-12-28 07:16:13,935][106226] Updated weights for policy 0, policy_version 1670953 (0.0011) [2023-12-28 07:16:13,994][106226] Updated weights for policy 0, policy_version 1670963 (0.0011) [2023-12-28 07:16:14,457][106225] Updated weights for policy 1, policy_version 1674866 (0.0010) [2023-12-28 07:16:14,513][106225] Updated weights for policy 1, policy_version 1674876 (0.0010) [2023-12-28 07:16:14,574][106225] Updated weights for policy 1, policy_version 1674886 (0.0010) [2023-12-28 07:16:14,641][106226] Updated weights for policy 0, policy_version 1670973 (0.0009) [2023-12-28 07:16:14,691][106226] Updated weights for policy 0, policy_version 1670983 (0.0008) [2023-12-28 07:16:14,745][106226] Updated weights for policy 0, policy_version 1670993 (0.0008) [2023-12-28 07:16:15,322][106225] Updated weights for policy 1, policy_version 1674896 (0.0010) [2023-12-28 07:16:15,380][106225] Updated weights for policy 1, policy_version 1674906 (0.0010) [2023-12-28 07:16:15,432][106226] Updated weights for policy 0, policy_version 1671003 (0.0008) [2023-12-28 07:16:15,441][106225] Updated weights for policy 1, policy_version 1674916 (0.0009) [2023-12-28 07:16:15,495][106226] Updated weights for policy 0, policy_version 1671013 (0.0006) [2023-12-28 07:16:15,567][106226] Updated weights for policy 0, policy_version 1671023 (0.0006) [2023-12-28 07:16:16,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 856694784. Throughput: 0: 9711.5, 1: 9840.4. Samples: 856689460. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:16,175][105115] Avg episode reward: [(0, '-4.232'), (1, '-4.791')] [2023-12-28 07:16:16,177][106225] Updated weights for policy 1, policy_version 1674926 (0.0010) [2023-12-28 07:16:16,232][106225] Updated weights for policy 1, policy_version 1674936 (0.0010) [2023-12-28 07:16:16,254][106226] Updated weights for policy 0, policy_version 1671033 (0.0007) [2023-12-28 07:16:16,290][106225] Updated weights for policy 1, policy_version 1674946 (0.0010) [2023-12-28 07:16:16,313][106226] Updated weights for policy 0, policy_version 1671043 (0.0008) [2023-12-28 07:16:16,369][106226] Updated weights for policy 0, policy_version 1671053 (0.0008) [2023-12-28 07:16:16,429][106226] Updated weights for policy 0, policy_version 1671063 (0.0010) [2023-12-28 07:16:17,031][106225] Updated weights for policy 1, policy_version 1674956 (0.0009) [2023-12-28 07:16:17,081][106225] Updated weights for policy 1, policy_version 1674966 (0.0007) [2023-12-28 07:16:17,129][106225] Updated weights for policy 1, policy_version 1674976 (0.0008) [2023-12-28 07:16:17,181][106226] Updated weights for policy 0, policy_version 1671073 (0.0010) [2023-12-28 07:16:17,234][106226] Updated weights for policy 0, policy_version 1671083 (0.0010) [2023-12-28 07:16:17,284][106226] Updated weights for policy 0, policy_version 1671093 (0.0010) [2023-12-28 07:16:17,798][106225] Updated weights for policy 1, policy_version 1674986 (0.0009) [2023-12-28 07:16:17,861][106225] Updated weights for policy 1, policy_version 1674996 (0.0005) [2023-12-28 07:16:17,871][106226] Updated weights for policy 0, policy_version 1671103 (0.0006) [2023-12-28 07:16:17,919][106225] Updated weights for policy 1, policy_version 1675006 (0.0005) [2023-12-28 07:16:17,934][106226] Updated weights for policy 0, policy_version 1671113 (0.0006) [2023-12-28 07:16:17,991][106225] Updated weights for policy 1, policy_version 1675016 (0.0005) [2023-12-28 07:16:18,003][106226] Updated weights for policy 0, policy_version 1671123 (0.0010) [2023-12-28 07:16:18,509][106225] Updated weights for policy 1, policy_version 1675026 (0.0008) [2023-12-28 07:16:18,574][106225] Updated weights for policy 1, policy_version 1675036 (0.0007) [2023-12-28 07:16:18,639][106225] Updated weights for policy 1, policy_version 1675046 (0.0006) [2023-12-28 07:16:18,676][106226] Updated weights for policy 0, policy_version 1671133 (0.0007) [2023-12-28 07:16:18,748][106226] Updated weights for policy 0, policy_version 1671143 (0.0011) [2023-12-28 07:16:18,817][106226] Updated weights for policy 0, policy_version 1671153 (0.0011) [2023-12-28 07:16:19,284][106225] Updated weights for policy 1, policy_version 1675056 (0.0007) [2023-12-28 07:16:19,355][106225] Updated weights for policy 1, policy_version 1675066 (0.0010) [2023-12-28 07:16:19,417][106225] Updated weights for policy 1, policy_version 1675076 (0.0009) [2023-12-28 07:16:19,596][106226] Updated weights for policy 0, policy_version 1671163 (0.0010) [2023-12-28 07:16:19,656][106226] Updated weights for policy 0, policy_version 1671173 (0.0008) [2023-12-28 07:16:19,718][106226] Updated weights for policy 0, policy_version 1671183 (0.0008) [2023-12-28 07:16:20,196][106225] Updated weights for policy 1, policy_version 1675086 (0.0008) [2023-12-28 07:16:20,261][106225] Updated weights for policy 1, policy_version 1675096 (0.0007) [2023-12-28 07:16:20,318][106225] Updated weights for policy 1, policy_version 1675106 (0.0006) [2023-12-28 07:16:20,371][106226] Updated weights for policy 0, policy_version 1671193 (0.0007) [2023-12-28 07:16:20,440][106226] Updated weights for policy 0, policy_version 1671203 (0.0008) [2023-12-28 07:16:20,504][106226] Updated weights for policy 0, policy_version 1671213 (0.0008) [2023-12-28 07:16:20,563][106226] Updated weights for policy 0, policy_version 1671223 (0.0007) [2023-12-28 07:16:21,001][106225] Updated weights for policy 1, policy_version 1675116 (0.0008) [2023-12-28 07:16:21,068][106225] Updated weights for policy 1, policy_version 1675126 (0.0011) [2023-12-28 07:16:21,135][106225] Updated weights for policy 1, policy_version 1675136 (0.0010) [2023-12-28 07:16:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19662.8, 300 sec: 19716.4). Total num frames: 856793088. Throughput: 0: 9826.3, 1: 9797.3. Samples: 856809596. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:21,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-5.009')] [2023-12-28 07:16:21,303][106226] Updated weights for policy 0, policy_version 1671233 (0.0009) [2023-12-28 07:16:21,372][106226] Updated weights for policy 0, policy_version 1671243 (0.0008) [2023-12-28 07:16:21,443][106226] Updated weights for policy 0, policy_version 1671253 (0.0008) [2023-12-28 07:16:21,954][106225] Updated weights for policy 1, policy_version 1675146 (0.0010) [2023-12-28 07:16:22,007][106225] Updated weights for policy 1, policy_version 1675156 (0.0008) [2023-12-28 07:16:22,070][106225] Updated weights for policy 1, policy_version 1675166 (0.0007) [2023-12-28 07:16:22,123][106225] Updated weights for policy 1, policy_version 1675176 (0.0005) [2023-12-28 07:16:22,185][106226] Updated weights for policy 0, policy_version 1671263 (0.0008) [2023-12-28 07:16:22,249][106226] Updated weights for policy 0, policy_version 1671273 (0.0008) [2023-12-28 07:16:22,310][106226] Updated weights for policy 0, policy_version 1671283 (0.0010) [2023-12-28 07:16:22,870][106225] Updated weights for policy 1, policy_version 1675186 (0.0010) [2023-12-28 07:16:22,927][106225] Updated weights for policy 1, policy_version 1675196 (0.0010) [2023-12-28 07:16:22,987][106225] Updated weights for policy 1, policy_version 1675206 (0.0010) [2023-12-28 07:16:23,063][106226] Updated weights for policy 0, policy_version 1671293 (0.0010) [2023-12-28 07:16:23,126][106226] Updated weights for policy 0, policy_version 1671303 (0.0010) [2023-12-28 07:16:23,182][106226] Updated weights for policy 0, policy_version 1671313 (0.0010) [2023-12-28 07:16:23,646][106225] Updated weights for policy 1, policy_version 1675216 (0.0009) [2023-12-28 07:16:23,699][106225] Updated weights for policy 1, policy_version 1675226 (0.0010) [2023-12-28 07:16:23,753][106225] Updated weights for policy 1, policy_version 1675236 (0.0008) [2023-12-28 07:16:23,822][106226] Updated weights for policy 0, policy_version 1671323 (0.0010) [2023-12-28 07:16:23,869][106226] Updated weights for policy 0, policy_version 1671333 (0.0010) [2023-12-28 07:16:23,916][106226] Updated weights for policy 0, policy_version 1671343 (0.0010) [2023-12-28 07:16:24,402][106225] Updated weights for policy 1, policy_version 1675246 (0.0006) [2023-12-28 07:16:24,459][106225] Updated weights for policy 1, policy_version 1675256 (0.0005) [2023-12-28 07:16:24,521][106225] Updated weights for policy 1, policy_version 1675266 (0.0006) [2023-12-28 07:16:24,647][106226] Updated weights for policy 0, policy_version 1671353 (0.0011) [2023-12-28 07:16:24,707][106226] Updated weights for policy 0, policy_version 1671363 (0.0008) [2023-12-28 07:16:24,759][106226] Updated weights for policy 0, policy_version 1671373 (0.0008) [2023-12-28 07:16:24,816][106226] Updated weights for policy 0, policy_version 1671383 (0.0009) [2023-12-28 07:16:25,109][106225] Updated weights for policy 1, policy_version 1675276 (0.0006) [2023-12-28 07:16:25,161][106225] Updated weights for policy 1, policy_version 1675286 (0.0005) [2023-12-28 07:16:25,219][106225] Updated weights for policy 1, policy_version 1675296 (0.0005) [2023-12-28 07:16:25,665][106226] Updated weights for policy 0, policy_version 1671393 (0.0009) [2023-12-28 07:16:25,726][106226] Updated weights for policy 0, policy_version 1671403 (0.0009) [2023-12-28 07:16:25,736][106225] Updated weights for policy 1, policy_version 1675306 (0.0006) [2023-12-28 07:16:25,785][106226] Updated weights for policy 0, policy_version 1671413 (0.0007) [2023-12-28 07:16:25,800][106225] Updated weights for policy 1, policy_version 1675316 (0.0005) [2023-12-28 07:16:25,859][106225] Updated weights for policy 1, policy_version 1675326 (0.0005) [2023-12-28 07:16:25,920][106225] Updated weights for policy 1, policy_version 1675336 (0.0006) [2023-12-28 07:16:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 856899584. Throughput: 0: 9835.7, 1: 9720.8. Samples: 856866240. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:26,175][105115] Avg episode reward: [(0, '-4.632'), (1, '-4.835')] [2023-12-28 07:16:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001671416_427958272.pth... [2023-12-28 07:16:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001675336_428941312.pth... [2023-12-28 07:16:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001674152_428638208.pth [2023-12-28 07:16:26,196][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001670296_427671552.pth [2023-12-28 07:16:26,434][106225] Updated weights for policy 1, policy_version 1675346 (0.0005) [2023-12-28 07:16:26,495][106225] Updated weights for policy 1, policy_version 1675356 (0.0007) [2023-12-28 07:16:26,552][106225] Updated weights for policy 1, policy_version 1675366 (0.0010) [2023-12-28 07:16:26,568][106226] Updated weights for policy 0, policy_version 1671423 (0.0008) [2023-12-28 07:16:26,627][106226] Updated weights for policy 0, policy_version 1671433 (0.0008) [2023-12-28 07:16:26,685][106226] Updated weights for policy 0, policy_version 1671443 (0.0008) [2023-12-28 07:16:27,205][106225] Updated weights for policy 1, policy_version 1675376 (0.0006) [2023-12-28 07:16:27,257][106225] Updated weights for policy 1, policy_version 1675386 (0.0005) [2023-12-28 07:16:27,276][106226] Updated weights for policy 0, policy_version 1671453 (0.0009) [2023-12-28 07:16:27,307][106225] Updated weights for policy 1, policy_version 1675396 (0.0005) [2023-12-28 07:16:27,337][106226] Updated weights for policy 0, policy_version 1671463 (0.0011) [2023-12-28 07:16:27,394][106226] Updated weights for policy 0, policy_version 1671473 (0.0008) [2023-12-28 07:16:27,810][106225] Updated weights for policy 1, policy_version 1675406 (0.0007) [2023-12-28 07:16:27,856][106225] Updated weights for policy 1, policy_version 1675416 (0.0007) [2023-12-28 07:16:27,905][106225] Updated weights for policy 1, policy_version 1675426 (0.0008) [2023-12-28 07:16:27,958][106226] Updated weights for policy 0, policy_version 1671483 (0.0007) [2023-12-28 07:16:28,004][106226] Updated weights for policy 0, policy_version 1671493 (0.0010) [2023-12-28 07:16:28,056][106226] Updated weights for policy 0, policy_version 1671503 (0.0010) [2023-12-28 07:16:28,555][106225] Updated weights for policy 1, policy_version 1675436 (0.0008) [2023-12-28 07:16:28,600][106225] Updated weights for policy 1, policy_version 1675446 (0.0007) [2023-12-28 07:16:28,648][106225] Updated weights for policy 1, policy_version 1675456 (0.0005) [2023-12-28 07:16:28,822][106226] Updated weights for policy 0, policy_version 1671513 (0.0010) [2023-12-28 07:16:28,879][106226] Updated weights for policy 0, policy_version 1671523 (0.0006) [2023-12-28 07:16:28,934][106226] Updated weights for policy 0, policy_version 1671533 (0.0005) [2023-12-28 07:16:28,992][106226] Updated weights for policy 0, policy_version 1671543 (0.0008) [2023-12-28 07:16:29,303][106225] Updated weights for policy 1, policy_version 1675466 (0.0006) [2023-12-28 07:16:29,371][106225] Updated weights for policy 1, policy_version 1675476 (0.0009) [2023-12-28 07:16:29,431][106225] Updated weights for policy 1, policy_version 1675486 (0.0008) [2023-12-28 07:16:29,497][106225] Updated weights for policy 1, policy_version 1675496 (0.0006) [2023-12-28 07:16:29,641][106226] Updated weights for policy 0, policy_version 1671553 (0.0006) [2023-12-28 07:16:29,705][106226] Updated weights for policy 0, policy_version 1671563 (0.0005) [2023-12-28 07:16:29,764][106226] Updated weights for policy 0, policy_version 1671573 (0.0007) [2023-12-28 07:16:30,135][106225] Updated weights for policy 1, policy_version 1675506 (0.0007) [2023-12-28 07:16:30,188][106225] Updated weights for policy 1, policy_version 1675516 (0.0009) [2023-12-28 07:16:30,248][106225] Updated weights for policy 1, policy_version 1675526 (0.0008) [2023-12-28 07:16:30,369][106226] Updated weights for policy 0, policy_version 1671583 (0.0006) [2023-12-28 07:16:30,427][106226] Updated weights for policy 0, policy_version 1671593 (0.0005) [2023-12-28 07:16:30,476][106226] Updated weights for policy 0, policy_version 1671603 (0.0005) [2023-12-28 07:16:31,017][106226] Updated weights for policy 0, policy_version 1671613 (0.0006) [2023-12-28 07:16:31,032][106225] Updated weights for policy 1, policy_version 1675536 (0.0009) [2023-12-28 07:16:31,087][106226] Updated weights for policy 0, policy_version 1671623 (0.0008) [2023-12-28 07:16:31,097][106225] Updated weights for policy 1, policy_version 1675546 (0.0007) [2023-12-28 07:16:31,148][106226] Updated weights for policy 0, policy_version 1671633 (0.0009) [2023-12-28 07:16:31,162][106225] Updated weights for policy 1, policy_version 1675556 (0.0008) [2023-12-28 07:16:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 856997888. Throughput: 0: 9916.5, 1: 9924.8. Samples: 856995280. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:31,175][105115] Avg episode reward: [(0, '-4.658'), (1, '-4.609')] [2023-12-28 07:16:31,839][106226] Updated weights for policy 0, policy_version 1671643 (0.0009) [2023-12-28 07:16:31,907][106226] Updated weights for policy 0, policy_version 1671653 (0.0006) [2023-12-28 07:16:31,927][106225] Updated weights for policy 1, policy_version 1675566 (0.0008) [2023-12-28 07:16:31,971][106226] Updated weights for policy 0, policy_version 1671663 (0.0009) [2023-12-28 07:16:31,988][106225] Updated weights for policy 1, policy_version 1675576 (0.0005) [2023-12-28 07:16:32,053][106225] Updated weights for policy 1, policy_version 1675586 (0.0006) [2023-12-28 07:16:32,629][106226] Updated weights for policy 0, policy_version 1671673 (0.0010) [2023-12-28 07:16:32,688][106226] Updated weights for policy 0, policy_version 1671683 (0.0010) [2023-12-28 07:16:32,752][106226] Updated weights for policy 0, policy_version 1671693 (0.0010) [2023-12-28 07:16:32,752][106225] Updated weights for policy 1, policy_version 1675596 (0.0008) [2023-12-28 07:16:32,815][106225] Updated weights for policy 1, policy_version 1675606 (0.0008) [2023-12-28 07:16:32,815][106226] Updated weights for policy 0, policy_version 1671703 (0.0010) [2023-12-28 07:16:32,874][106225] Updated weights for policy 1, policy_version 1675616 (0.0007) [2023-12-28 07:16:33,374][106226] Updated weights for policy 0, policy_version 1671713 (0.0010) [2023-12-28 07:16:33,437][106226] Updated weights for policy 0, policy_version 1671723 (0.0010) [2023-12-28 07:16:33,444][106225] Updated weights for policy 1, policy_version 1675626 (0.0006) [2023-12-28 07:16:33,486][106226] Updated weights for policy 0, policy_version 1671733 (0.0010) [2023-12-28 07:16:33,492][106225] Updated weights for policy 1, policy_version 1675636 (0.0010) [2023-12-28 07:16:33,541][106225] Updated weights for policy 1, policy_version 1675646 (0.0005) [2023-12-28 07:16:33,598][106225] Updated weights for policy 1, policy_version 1675656 (0.0005) [2023-12-28 07:16:34,140][106225] Updated weights for policy 1, policy_version 1675666 (0.0006) [2023-12-28 07:16:34,156][106226] Updated weights for policy 0, policy_version 1671743 (0.0008) [2023-12-28 07:16:34,201][106225] Updated weights for policy 1, policy_version 1675676 (0.0008) [2023-12-28 07:16:34,220][106226] Updated weights for policy 0, policy_version 1671753 (0.0007) [2023-12-28 07:16:34,258][106225] Updated weights for policy 1, policy_version 1675686 (0.0009) [2023-12-28 07:16:34,284][106226] Updated weights for policy 0, policy_version 1671763 (0.0008) [2023-12-28 07:16:34,943][106225] Updated weights for policy 1, policy_version 1675696 (0.0008) [2023-12-28 07:16:34,956][106226] Updated weights for policy 0, policy_version 1671773 (0.0008) [2023-12-28 07:16:34,997][106225] Updated weights for policy 1, policy_version 1675706 (0.0007) [2023-12-28 07:16:35,015][106226] Updated weights for policy 0, policy_version 1671783 (0.0006) [2023-12-28 07:16:35,052][106225] Updated weights for policy 1, policy_version 1675716 (0.0007) [2023-12-28 07:16:35,065][106226] Updated weights for policy 0, policy_version 1671793 (0.0006) [2023-12-28 07:16:35,708][106226] Updated weights for policy 0, policy_version 1671803 (0.0007) [2023-12-28 07:16:35,775][106226] Updated weights for policy 0, policy_version 1671813 (0.0005) [2023-12-28 07:16:35,820][106225] Updated weights for policy 1, policy_version 1675726 (0.0007) [2023-12-28 07:16:35,836][106226] Updated weights for policy 0, policy_version 1671823 (0.0009) [2023-12-28 07:16:35,885][106225] Updated weights for policy 1, policy_version 1675736 (0.0007) [2023-12-28 07:16:35,943][106225] Updated weights for policy 1, policy_version 1675746 (0.0010) [2023-12-28 07:16:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 857112576. Throughput: 0: 10006.5, 1: 10030.4. Samples: 857120096. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:36,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.886')] [2023-12-28 07:16:36,522][106226] Updated weights for policy 0, policy_version 1671833 (0.0011) [2023-12-28 07:16:36,577][106225] Updated weights for policy 1, policy_version 1675756 (0.0009) [2023-12-28 07:16:36,584][106226] Updated weights for policy 0, policy_version 1671843 (0.0011) [2023-12-28 07:16:36,633][106225] Updated weights for policy 1, policy_version 1675766 (0.0006) [2023-12-28 07:16:36,642][106226] Updated weights for policy 0, policy_version 1671853 (0.0011) [2023-12-28 07:16:36,694][106225] Updated weights for policy 1, policy_version 1675776 (0.0005) [2023-12-28 07:16:36,700][106226] Updated weights for policy 0, policy_version 1671863 (0.0011) [2023-12-28 07:16:37,287][106225] Updated weights for policy 1, policy_version 1675786 (0.0007) [2023-12-28 07:16:37,358][106225] Updated weights for policy 1, policy_version 1675796 (0.0007) [2023-12-28 07:16:37,421][106225] Updated weights for policy 1, policy_version 1675806 (0.0007) [2023-12-28 07:16:37,434][106226] Updated weights for policy 0, policy_version 1671873 (0.0011) [2023-12-28 07:16:37,478][106225] Updated weights for policy 1, policy_version 1675816 (0.0007) [2023-12-28 07:16:37,501][106226] Updated weights for policy 0, policy_version 1671883 (0.0011) [2023-12-28 07:16:37,565][106226] Updated weights for policy 0, policy_version 1671893 (0.0011) [2023-12-28 07:16:38,087][106225] Updated weights for policy 1, policy_version 1675826 (0.0008) [2023-12-28 07:16:38,139][106225] Updated weights for policy 1, policy_version 1675836 (0.0008) [2023-12-28 07:16:38,179][106226] Updated weights for policy 0, policy_version 1671903 (0.0007) [2023-12-28 07:16:38,192][106225] Updated weights for policy 1, policy_version 1675846 (0.0007) [2023-12-28 07:16:38,230][106226] Updated weights for policy 0, policy_version 1671913 (0.0005) [2023-12-28 07:16:38,280][106226] Updated weights for policy 0, policy_version 1671923 (0.0006) [2023-12-28 07:16:38,883][106225] Updated weights for policy 1, policy_version 1675856 (0.0008) [2023-12-28 07:16:38,900][106226] Updated weights for policy 0, policy_version 1671933 (0.0008) [2023-12-28 07:16:38,937][106225] Updated weights for policy 1, policy_version 1675866 (0.0005) [2023-12-28 07:16:38,958][106226] Updated weights for policy 0, policy_version 1671943 (0.0009) [2023-12-28 07:16:38,997][106225] Updated weights for policy 1, policy_version 1675876 (0.0005) [2023-12-28 07:16:39,012][106226] Updated weights for policy 0, policy_version 1671953 (0.0008) [2023-12-28 07:16:39,671][106225] Updated weights for policy 1, policy_version 1675886 (0.0006) [2023-12-28 07:16:39,737][106225] Updated weights for policy 1, policy_version 1675896 (0.0007) [2023-12-28 07:16:39,750][106226] Updated weights for policy 0, policy_version 1671963 (0.0008) [2023-12-28 07:16:39,798][106225] Updated weights for policy 1, policy_version 1675906 (0.0012) [2023-12-28 07:16:39,812][106226] Updated weights for policy 0, policy_version 1671973 (0.0011) [2023-12-28 07:16:39,876][106226] Updated weights for policy 0, policy_version 1671983 (0.0011) [2023-12-28 07:16:40,539][106225] Updated weights for policy 1, policy_version 1675916 (0.0009) [2023-12-28 07:16:40,602][106225] Updated weights for policy 1, policy_version 1675926 (0.0008) [2023-12-28 07:16:40,618][106226] Updated weights for policy 0, policy_version 1671993 (0.0008) [2023-12-28 07:16:40,663][106225] Updated weights for policy 1, policy_version 1675936 (0.0007) [2023-12-28 07:16:40,683][106226] Updated weights for policy 0, policy_version 1672003 (0.0011) [2023-12-28 07:16:40,747][106226] Updated weights for policy 0, policy_version 1672013 (0.0011) [2023-12-28 07:16:40,804][106226] Updated weights for policy 0, policy_version 1672023 (0.0011) [2023-12-28 07:16:41,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 857210880. Throughput: 0: 10007.0, 1: 10130.7. Samples: 857182296. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:41,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.772')] [2023-12-28 07:16:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001675944_429096960.pth... [2023-12-28 07:16:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001672024_428113920.pth... [2023-12-28 07:16:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001674760_428793856.pth [2023-12-28 07:16:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001670840_427810816.pth [2023-12-28 07:16:41,406][106225] Updated weights for policy 1, policy_version 1675946 (0.0008) [2023-12-28 07:16:41,476][106225] Updated weights for policy 1, policy_version 1675956 (0.0010) [2023-12-28 07:16:41,538][106225] Updated weights for policy 1, policy_version 1675966 (0.0011) [2023-12-28 07:16:41,575][106226] Updated weights for policy 0, policy_version 1672033 (0.0006) [2023-12-28 07:16:41,600][106225] Updated weights for policy 1, policy_version 1675976 (0.0011) [2023-12-28 07:16:41,642][106226] Updated weights for policy 0, policy_version 1672043 (0.0008) [2023-12-28 07:16:41,710][106226] Updated weights for policy 0, policy_version 1672053 (0.0009) [2023-12-28 07:16:42,380][106225] Updated weights for policy 1, policy_version 1675986 (0.0011) [2023-12-28 07:16:42,406][106226] Updated weights for policy 0, policy_version 1672063 (0.0009) [2023-12-28 07:16:42,438][106225] Updated weights for policy 1, policy_version 1675996 (0.0010) [2023-12-28 07:16:42,468][106226] Updated weights for policy 0, policy_version 1672073 (0.0008) [2023-12-28 07:16:42,501][106225] Updated weights for policy 1, policy_version 1676006 (0.0011) [2023-12-28 07:16:42,530][106226] Updated weights for policy 0, policy_version 1672083 (0.0008) [2023-12-28 07:16:43,149][106225] Updated weights for policy 1, policy_version 1676016 (0.0006) [2023-12-28 07:16:43,210][106225] Updated weights for policy 1, policy_version 1676026 (0.0005) [2023-12-28 07:16:43,249][106226] Updated weights for policy 0, policy_version 1672093 (0.0008) [2023-12-28 07:16:43,274][106225] Updated weights for policy 1, policy_version 1676036 (0.0005) [2023-12-28 07:16:43,307][106226] Updated weights for policy 0, policy_version 1672103 (0.0007) [2023-12-28 07:16:43,362][106226] Updated weights for policy 0, policy_version 1672113 (0.0007) [2023-12-28 07:16:43,871][106225] Updated weights for policy 1, policy_version 1676046 (0.0008) [2023-12-28 07:16:43,930][106225] Updated weights for policy 1, policy_version 1676056 (0.0010) [2023-12-28 07:16:43,932][106226] Updated weights for policy 0, policy_version 1672123 (0.0007) [2023-12-28 07:16:43,989][106226] Updated weights for policy 0, policy_version 1672133 (0.0005) [2023-12-28 07:16:43,991][106225] Updated weights for policy 1, policy_version 1676066 (0.0010) [2023-12-28 07:16:44,037][106226] Updated weights for policy 0, policy_version 1672143 (0.0008) [2023-12-28 07:16:44,700][106225] Updated weights for policy 1, policy_version 1676076 (0.0007) [2023-12-28 07:16:44,749][106225] Updated weights for policy 1, policy_version 1676086 (0.0008) [2023-12-28 07:16:44,775][106226] Updated weights for policy 0, policy_version 1672153 (0.0008) [2023-12-28 07:16:44,810][106225] Updated weights for policy 1, policy_version 1676096 (0.0007) [2023-12-28 07:16:44,846][106226] Updated weights for policy 0, policy_version 1672163 (0.0007) [2023-12-28 07:16:44,909][106226] Updated weights for policy 0, policy_version 1672173 (0.0009) [2023-12-28 07:16:44,973][106226] Updated weights for policy 0, policy_version 1672183 (0.0009) [2023-12-28 07:16:45,447][106225] Updated weights for policy 1, policy_version 1676106 (0.0007) [2023-12-28 07:16:45,509][106225] Updated weights for policy 1, policy_version 1676116 (0.0011) [2023-12-28 07:16:45,570][106225] Updated weights for policy 1, policy_version 1676126 (0.0010) [2023-12-28 07:16:45,644][106225] Updated weights for policy 1, policy_version 1676136 (0.0010) [2023-12-28 07:16:45,677][106226] Updated weights for policy 0, policy_version 1672193 (0.0007) [2023-12-28 07:16:45,725][106226] Updated weights for policy 0, policy_version 1672203 (0.0007) [2023-12-28 07:16:45,774][106226] Updated weights for policy 0, policy_version 1672213 (0.0008) [2023-12-28 07:16:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 857309184. Throughput: 0: 9971.1, 1: 10149.2. Samples: 857299012. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:46,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-4.496')] [2023-12-28 07:16:46,330][106225] Updated weights for policy 1, policy_version 1676146 (0.0008) [2023-12-28 07:16:46,392][106225] Updated weights for policy 1, policy_version 1676156 (0.0006) [2023-12-28 07:16:46,426][106226] Updated weights for policy 0, policy_version 1672223 (0.0007) [2023-12-28 07:16:46,444][106225] Updated weights for policy 1, policy_version 1676166 (0.0009) [2023-12-28 07:16:46,491][106226] Updated weights for policy 0, policy_version 1672233 (0.0006) [2023-12-28 07:16:46,551][106226] Updated weights for policy 0, policy_version 1672243 (0.0007) [2023-12-28 07:16:47,138][106225] Updated weights for policy 1, policy_version 1676176 (0.0008) [2023-12-28 07:16:47,187][106225] Updated weights for policy 1, policy_version 1676186 (0.0009) [2023-12-28 07:16:47,233][106226] Updated weights for policy 0, policy_version 1672253 (0.0009) [2023-12-28 07:16:47,239][106225] Updated weights for policy 1, policy_version 1676196 (0.0006) [2023-12-28 07:16:47,290][106226] Updated weights for policy 0, policy_version 1672263 (0.0006) [2023-12-28 07:16:47,340][106226] Updated weights for policy 0, policy_version 1672273 (0.0008) [2023-12-28 07:16:47,882][106225] Updated weights for policy 1, policy_version 1676206 (0.0008) [2023-12-28 07:16:47,926][106225] Updated weights for policy 1, policy_version 1676216 (0.0006) [2023-12-28 07:16:47,978][106225] Updated weights for policy 1, policy_version 1676226 (0.0008) [2023-12-28 07:16:48,110][106226] Updated weights for policy 0, policy_version 1672283 (0.0007) [2023-12-28 07:16:48,164][106226] Updated weights for policy 0, policy_version 1672293 (0.0008) [2023-12-28 07:16:48,224][106226] Updated weights for policy 0, policy_version 1672303 (0.0008) [2023-12-28 07:16:48,702][106225] Updated weights for policy 1, policy_version 1676236 (0.0010) [2023-12-28 07:16:48,757][106225] Updated weights for policy 1, policy_version 1676246 (0.0010) [2023-12-28 07:16:48,828][106225] Updated weights for policy 1, policy_version 1676256 (0.0010) [2023-12-28 07:16:48,941][106226] Updated weights for policy 0, policy_version 1672313 (0.0008) [2023-12-28 07:16:49,004][106226] Updated weights for policy 0, policy_version 1672323 (0.0008) [2023-12-28 07:16:49,067][106226] Updated weights for policy 0, policy_version 1672333 (0.0009) [2023-12-28 07:16:49,135][106226] Updated weights for policy 0, policy_version 1672343 (0.0007) [2023-12-28 07:16:49,536][106225] Updated weights for policy 1, policy_version 1676266 (0.0010) [2023-12-28 07:16:49,591][106225] Updated weights for policy 1, policy_version 1676276 (0.0007) [2023-12-28 07:16:49,644][106225] Updated weights for policy 1, policy_version 1676286 (0.0008) [2023-12-28 07:16:49,704][106225] Updated weights for policy 1, policy_version 1676296 (0.0007) [2023-12-28 07:16:49,907][106226] Updated weights for policy 0, policy_version 1672353 (0.0008) [2023-12-28 07:16:49,974][106226] Updated weights for policy 0, policy_version 1672363 (0.0008) [2023-12-28 07:16:50,036][106226] Updated weights for policy 0, policy_version 1672373 (0.0008) [2023-12-28 07:16:50,484][106225] Updated weights for policy 1, policy_version 1676306 (0.0008) [2023-12-28 07:16:50,552][106225] Updated weights for policy 1, policy_version 1676316 (0.0006) [2023-12-28 07:16:50,627][106225] Updated weights for policy 1, policy_version 1676326 (0.0007) [2023-12-28 07:16:50,798][106226] Updated weights for policy 0, policy_version 1672383 (0.0008) [2023-12-28 07:16:50,847][106226] Updated weights for policy 0, policy_version 1672393 (0.0007) [2023-12-28 07:16:50,898][106226] Updated weights for policy 0, policy_version 1672403 (0.0009) [2023-12-28 07:16:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 857407488. Throughput: 0: 9932.4, 1: 10124.5. Samples: 857416632. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:51,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.871')] [2023-12-28 07:16:51,381][106225] Updated weights for policy 1, policy_version 1676336 (0.0008) [2023-12-28 07:16:51,438][106225] Updated weights for policy 1, policy_version 1676346 (0.0008) [2023-12-28 07:16:51,500][106225] Updated weights for policy 1, policy_version 1676356 (0.0009) [2023-12-28 07:16:51,672][106226] Updated weights for policy 0, policy_version 1672413 (0.0009) [2023-12-28 07:16:51,742][106226] Updated weights for policy 0, policy_version 1672423 (0.0009) [2023-12-28 07:16:51,798][106226] Updated weights for policy 0, policy_version 1672433 (0.0005) [2023-12-28 07:16:52,245][106225] Updated weights for policy 1, policy_version 1676366 (0.0006) [2023-12-28 07:16:52,313][106225] Updated weights for policy 1, policy_version 1676376 (0.0006) [2023-12-28 07:16:52,381][106225] Updated weights for policy 1, policy_version 1676386 (0.0006) [2023-12-28 07:16:52,566][106226] Updated weights for policy 0, policy_version 1672443 (0.0005) [2023-12-28 07:16:52,633][106226] Updated weights for policy 0, policy_version 1672453 (0.0007) [2023-12-28 07:16:52,699][106226] Updated weights for policy 0, policy_version 1672463 (0.0006) [2023-12-28 07:16:53,056][106225] Updated weights for policy 1, policy_version 1676396 (0.0007) [2023-12-28 07:16:53,114][106225] Updated weights for policy 1, policy_version 1676406 (0.0008) [2023-12-28 07:16:53,163][106225] Updated weights for policy 1, policy_version 1676416 (0.0007) [2023-12-28 07:16:53,348][106226] Updated weights for policy 0, policy_version 1672473 (0.0008) [2023-12-28 07:16:53,400][106226] Updated weights for policy 0, policy_version 1672483 (0.0005) [2023-12-28 07:16:53,461][106226] Updated weights for policy 0, policy_version 1672493 (0.0007) [2023-12-28 07:16:53,520][106226] Updated weights for policy 0, policy_version 1672503 (0.0011) [2023-12-28 07:16:53,909][106225] Updated weights for policy 1, policy_version 1676426 (0.0009) [2023-12-28 07:16:53,966][106225] Updated weights for policy 1, policy_version 1676436 (0.0010) [2023-12-28 07:16:54,017][106225] Updated weights for policy 1, policy_version 1676446 (0.0010) [2023-12-28 07:16:54,068][106225] Updated weights for policy 1, policy_version 1676456 (0.0008) [2023-12-28 07:16:54,141][106226] Updated weights for policy 0, policy_version 1672513 (0.0011) [2023-12-28 07:16:54,195][106226] Updated weights for policy 0, policy_version 1672523 (0.0010) [2023-12-28 07:16:54,248][106226] Updated weights for policy 0, policy_version 1672533 (0.0010) [2023-12-28 07:16:54,800][106225] Updated weights for policy 1, policy_version 1676466 (0.0010) [2023-12-28 07:16:54,835][106226] Updated weights for policy 0, policy_version 1672543 (0.0007) [2023-12-28 07:16:54,858][106225] Updated weights for policy 1, policy_version 1676476 (0.0010) [2023-12-28 07:16:54,887][106226] Updated weights for policy 0, policy_version 1672553 (0.0005) [2023-12-28 07:16:54,925][106225] Updated weights for policy 1, policy_version 1676486 (0.0010) [2023-12-28 07:16:54,942][106226] Updated weights for policy 0, policy_version 1672563 (0.0005) [2023-12-28 07:16:55,482][106226] Updated weights for policy 0, policy_version 1672573 (0.0005) [2023-12-28 07:16:55,534][106226] Updated weights for policy 0, policy_version 1672583 (0.0006) [2023-12-28 07:16:55,593][106226] Updated weights for policy 0, policy_version 1672593 (0.0010) [2023-12-28 07:16:55,636][106225] Updated weights for policy 1, policy_version 1676496 (0.0009) [2023-12-28 07:16:55,693][106225] Updated weights for policy 1, policy_version 1676506 (0.0005) [2023-12-28 07:16:55,749][106225] Updated weights for policy 1, policy_version 1676516 (0.0005) [2023-12-28 07:16:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 857505792. Throughput: 0: 9951.5, 1: 10081.3. Samples: 857475040. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:16:56,176][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.866')] [2023-12-28 07:16:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001672600_428261376.pth... [2023-12-28 07:16:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001676520_429244416.pth... [2023-12-28 07:16:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001671416_427958272.pth [2023-12-28 07:16:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001675336_428941312.pth [2023-12-28 07:16:56,233][106226] Updated weights for policy 0, policy_version 1672603 (0.0010) [2023-12-28 07:16:56,292][106226] Updated weights for policy 0, policy_version 1672613 (0.0006) [2023-12-28 07:16:56,355][106226] Updated weights for policy 0, policy_version 1672623 (0.0008) [2023-12-28 07:16:56,445][106225] Updated weights for policy 1, policy_version 1676526 (0.0008) [2023-12-28 07:16:56,496][106225] Updated weights for policy 1, policy_version 1676536 (0.0008) [2023-12-28 07:16:56,544][106225] Updated weights for policy 1, policy_version 1676546 (0.0009) [2023-12-28 07:16:57,048][106226] Updated weights for policy 0, policy_version 1672633 (0.0008) [2023-12-28 07:16:57,101][106226] Updated weights for policy 0, policy_version 1672643 (0.0008) [2023-12-28 07:16:57,146][106226] Updated weights for policy 0, policy_version 1672653 (0.0008) [2023-12-28 07:16:57,197][106226] Updated weights for policy 0, policy_version 1672663 (0.0008) [2023-12-28 07:16:57,271][106225] Updated weights for policy 1, policy_version 1676556 (0.0008) [2023-12-28 07:16:57,331][106225] Updated weights for policy 1, policy_version 1676566 (0.0008) [2023-12-28 07:16:57,390][106225] Updated weights for policy 1, policy_version 1676576 (0.0008) [2023-12-28 07:16:57,916][106226] Updated weights for policy 0, policy_version 1672673 (0.0008) [2023-12-28 07:16:57,970][106226] Updated weights for policy 0, policy_version 1672683 (0.0008) [2023-12-28 07:16:58,026][106226] Updated weights for policy 0, policy_version 1672693 (0.0007) [2023-12-28 07:16:58,127][106225] Updated weights for policy 1, policy_version 1676586 (0.0008) [2023-12-28 07:16:58,181][106225] Updated weights for policy 1, policy_version 1676596 (0.0009) [2023-12-28 07:16:58,245][106225] Updated weights for policy 1, policy_version 1676606 (0.0008) [2023-12-28 07:16:58,302][106225] Updated weights for policy 1, policy_version 1676616 (0.0009) [2023-12-28 07:16:58,748][106226] Updated weights for policy 0, policy_version 1672703 (0.0007) [2023-12-28 07:16:58,818][106226] Updated weights for policy 0, policy_version 1672713 (0.0009) [2023-12-28 07:16:58,894][106226] Updated weights for policy 0, policy_version 1672723 (0.0009) [2023-12-28 07:16:59,114][106225] Updated weights for policy 1, policy_version 1676626 (0.0008) [2023-12-28 07:16:59,174][106225] Updated weights for policy 1, policy_version 1676636 (0.0008) [2023-12-28 07:16:59,246][106225] Updated weights for policy 1, policy_version 1676646 (0.0012) [2023-12-28 07:16:59,673][106226] Updated weights for policy 0, policy_version 1672733 (0.0009) [2023-12-28 07:16:59,733][106226] Updated weights for policy 0, policy_version 1672743 (0.0008) [2023-12-28 07:16:59,798][106226] Updated weights for policy 0, policy_version 1672753 (0.0008) [2023-12-28 07:17:00,048][106225] Updated weights for policy 1, policy_version 1676656 (0.0010) [2023-12-28 07:17:00,105][106225] Updated weights for policy 1, policy_version 1676666 (0.0010) [2023-12-28 07:17:00,158][106225] Updated weights for policy 1, policy_version 1676676 (0.0010) [2023-12-28 07:17:00,489][106226] Updated weights for policy 0, policy_version 1672763 (0.0008) [2023-12-28 07:17:00,537][106226] Updated weights for policy 0, policy_version 1672773 (0.0007) [2023-12-28 07:17:00,596][106226] Updated weights for policy 0, policy_version 1672783 (0.0007) [2023-12-28 07:17:00,887][106225] Updated weights for policy 1, policy_version 1676686 (0.0010) [2023-12-28 07:17:00,936][106225] Updated weights for policy 1, policy_version 1676696 (0.0010) [2023-12-28 07:17:00,986][106225] Updated weights for policy 1, policy_version 1676706 (0.0010) [2023-12-28 07:17:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 857604096. Throughput: 0: 10010.5, 1: 10068.8. Samples: 857593028. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:01,175][105115] Avg episode reward: [(0, '-4.593'), (1, '-4.635')] [2023-12-28 07:17:01,290][106226] Updated weights for policy 0, policy_version 1672793 (0.0008) [2023-12-28 07:17:01,357][106226] Updated weights for policy 0, policy_version 1672803 (0.0006) [2023-12-28 07:17:01,424][106226] Updated weights for policy 0, policy_version 1672813 (0.0006) [2023-12-28 07:17:01,487][106226] Updated weights for policy 0, policy_version 1672823 (0.0009) [2023-12-28 07:17:01,690][106225] Updated weights for policy 1, policy_version 1676716 (0.0009) [2023-12-28 07:17:01,758][106225] Updated weights for policy 1, policy_version 1676726 (0.0008) [2023-12-28 07:17:01,818][106225] Updated weights for policy 1, policy_version 1676736 (0.0006) [2023-12-28 07:17:02,232][106226] Updated weights for policy 0, policy_version 1672833 (0.0009) [2023-12-28 07:17:02,297][106226] Updated weights for policy 0, policy_version 1672843 (0.0009) [2023-12-28 07:17:02,346][106226] Updated weights for policy 0, policy_version 1672853 (0.0009) [2023-12-28 07:17:02,478][106225] Updated weights for policy 1, policy_version 1676746 (0.0007) [2023-12-28 07:17:02,538][106225] Updated weights for policy 1, policy_version 1676756 (0.0009) [2023-12-28 07:17:02,597][106225] Updated weights for policy 1, policy_version 1676766 (0.0009) [2023-12-28 07:17:02,656][106225] Updated weights for policy 1, policy_version 1676776 (0.0008) [2023-12-28 07:17:03,117][106226] Updated weights for policy 0, policy_version 1672863 (0.0009) [2023-12-28 07:17:03,172][106226] Updated weights for policy 0, policy_version 1672873 (0.0009) [2023-12-28 07:17:03,235][106226] Updated weights for policy 0, policy_version 1672883 (0.0008) [2023-12-28 07:17:03,375][106225] Updated weights for policy 1, policy_version 1676786 (0.0009) [2023-12-28 07:17:03,424][106225] Updated weights for policy 1, policy_version 1676796 (0.0010) [2023-12-28 07:17:03,467][106225] Updated weights for policy 1, policy_version 1676806 (0.0010) [2023-12-28 07:17:03,971][106226] Updated weights for policy 0, policy_version 1672893 (0.0009) [2023-12-28 07:17:04,024][106226] Updated weights for policy 0, policy_version 1672903 (0.0010) [2023-12-28 07:17:04,086][106226] Updated weights for policy 0, policy_version 1672913 (0.0011) [2023-12-28 07:17:04,135][106225] Updated weights for policy 1, policy_version 1676816 (0.0007) [2023-12-28 07:17:04,193][106225] Updated weights for policy 1, policy_version 1676826 (0.0007) [2023-12-28 07:17:04,255][106225] Updated weights for policy 1, policy_version 1676836 (0.0007) [2023-12-28 07:17:04,789][106226] Updated weights for policy 0, policy_version 1672923 (0.0011) [2023-12-28 07:17:04,799][106225] Updated weights for policy 1, policy_version 1676846 (0.0005) [2023-12-28 07:17:04,843][106226] Updated weights for policy 0, policy_version 1672933 (0.0011) [2023-12-28 07:17:04,857][106225] Updated weights for policy 1, policy_version 1676856 (0.0005) [2023-12-28 07:17:04,902][106226] Updated weights for policy 0, policy_version 1672943 (0.0009) [2023-12-28 07:17:04,907][106225] Updated weights for policy 1, policy_version 1676866 (0.0005) [2023-12-28 07:17:05,518][106225] Updated weights for policy 1, policy_version 1676876 (0.0005) [2023-12-28 07:17:05,565][106225] Updated weights for policy 1, policy_version 1676886 (0.0005) [2023-12-28 07:17:05,616][106225] Updated weights for policy 1, policy_version 1676896 (0.0006) [2023-12-28 07:17:05,635][106226] Updated weights for policy 0, policy_version 1672953 (0.0008) [2023-12-28 07:17:05,696][106226] Updated weights for policy 0, policy_version 1672963 (0.0008) [2023-12-28 07:17:05,764][106226] Updated weights for policy 0, policy_version 1672973 (0.0011) [2023-12-28 07:17:05,825][106226] Updated weights for policy 0, policy_version 1672983 (0.0011) [2023-12-28 07:17:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 857702400. Throughput: 0: 9956.2, 1: 10106.5. Samples: 857712416. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:06,175][105115] Avg episode reward: [(0, '-4.187'), (1, '-4.985')] [2023-12-28 07:17:06,362][106225] Updated weights for policy 1, policy_version 1676906 (0.0007) [2023-12-28 07:17:06,428][106225] Updated weights for policy 1, policy_version 1676916 (0.0008) [2023-12-28 07:17:06,493][106225] Updated weights for policy 1, policy_version 1676926 (0.0008) [2023-12-28 07:17:06,521][106226] Updated weights for policy 0, policy_version 1672993 (0.0011) [2023-12-28 07:17:06,550][106225] Updated weights for policy 1, policy_version 1676936 (0.0007) [2023-12-28 07:17:06,586][106226] Updated weights for policy 0, policy_version 1673003 (0.0008) [2023-12-28 07:17:06,652][106226] Updated weights for policy 0, policy_version 1673013 (0.0006) [2023-12-28 07:17:07,266][106226] Updated weights for policy 0, policy_version 1673023 (0.0009) [2023-12-28 07:17:07,283][106225] Updated weights for policy 1, policy_version 1676946 (0.0005) [2023-12-28 07:17:07,315][106226] Updated weights for policy 0, policy_version 1673033 (0.0010) [2023-12-28 07:17:07,340][106225] Updated weights for policy 1, policy_version 1676956 (0.0005) [2023-12-28 07:17:07,369][106226] Updated weights for policy 0, policy_version 1673043 (0.0011) [2023-12-28 07:17:07,395][106225] Updated weights for policy 1, policy_version 1676966 (0.0005) [2023-12-28 07:17:08,024][106226] Updated weights for policy 0, policy_version 1673053 (0.0010) [2023-12-28 07:17:08,035][106225] Updated weights for policy 1, policy_version 1676976 (0.0008) [2023-12-28 07:17:08,080][106226] Updated weights for policy 0, policy_version 1673063 (0.0007) [2023-12-28 07:17:08,090][106225] Updated weights for policy 1, policy_version 1676986 (0.0006) [2023-12-28 07:17:08,135][106225] Updated weights for policy 1, policy_version 1676996 (0.0007) [2023-12-28 07:17:08,140][106226] Updated weights for policy 0, policy_version 1673073 (0.0007) [2023-12-28 07:17:08,790][106225] Updated weights for policy 1, policy_version 1677006 (0.0006) [2023-12-28 07:17:08,855][106225] Updated weights for policy 1, policy_version 1677016 (0.0009) [2023-12-28 07:17:08,905][106226] Updated weights for policy 0, policy_version 1673083 (0.0007) [2023-12-28 07:17:08,917][106225] Updated weights for policy 1, policy_version 1677026 (0.0008) [2023-12-28 07:17:08,964][106226] Updated weights for policy 0, policy_version 1673093 (0.0006) [2023-12-28 07:17:09,014][106226] Updated weights for policy 0, policy_version 1673103 (0.0005) [2023-12-28 07:17:09,685][106225] Updated weights for policy 1, policy_version 1677036 (0.0009) [2023-12-28 07:17:09,687][106226] Updated weights for policy 0, policy_version 1673113 (0.0005) [2023-12-28 07:17:09,745][106225] Updated weights for policy 1, policy_version 1677046 (0.0008) [2023-12-28 07:17:09,751][106226] Updated weights for policy 0, policy_version 1673123 (0.0009) [2023-12-28 07:17:09,807][106225] Updated weights for policy 1, policy_version 1677056 (0.0006) [2023-12-28 07:17:09,812][106226] Updated weights for policy 0, policy_version 1673133 (0.0010) [2023-12-28 07:17:09,881][106226] Updated weights for policy 0, policy_version 1673143 (0.0009) [2023-12-28 07:17:10,544][106226] Updated weights for policy 0, policy_version 1673153 (0.0011) [2023-12-28 07:17:10,610][106226] Updated weights for policy 0, policy_version 1673163 (0.0010) [2023-12-28 07:17:10,612][106225] Updated weights for policy 1, policy_version 1677066 (0.0008) [2023-12-28 07:17:10,672][106225] Updated weights for policy 1, policy_version 1677076 (0.0006) [2023-12-28 07:17:10,673][106226] Updated weights for policy 0, policy_version 1673173 (0.0011) [2023-12-28 07:17:10,726][106225] Updated weights for policy 1, policy_version 1677086 (0.0007) [2023-12-28 07:17:10,776][106225] Updated weights for policy 1, policy_version 1677096 (0.0006) [2023-12-28 07:17:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 857800704. Throughput: 0: 10001.7, 1: 10158.6. Samples: 857773452. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:11,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.596')] [2023-12-28 07:17:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001677096_429391872.pth... [2023-12-28 07:17:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001673176_428408832.pth... [2023-12-28 07:17:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001672024_428113920.pth [2023-12-28 07:17:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001675944_429096960.pth [2023-12-28 07:17:11,425][106226] Updated weights for policy 0, policy_version 1673183 (0.0010) [2023-12-28 07:17:11,492][106226] Updated weights for policy 0, policy_version 1673193 (0.0008) [2023-12-28 07:17:11,500][106225] Updated weights for policy 1, policy_version 1677106 (0.0006) [2023-12-28 07:17:11,560][106225] Updated weights for policy 1, policy_version 1677116 (0.0006) [2023-12-28 07:17:11,560][106226] Updated weights for policy 0, policy_version 1673203 (0.0008) [2023-12-28 07:17:11,627][106225] Updated weights for policy 1, policy_version 1677126 (0.0007) [2023-12-28 07:17:12,274][106226] Updated weights for policy 0, policy_version 1673213 (0.0008) [2023-12-28 07:17:12,324][106225] Updated weights for policy 1, policy_version 1677136 (0.0010) [2023-12-28 07:17:12,337][106226] Updated weights for policy 0, policy_version 1673223 (0.0006) [2023-12-28 07:17:12,383][106225] Updated weights for policy 1, policy_version 1677146 (0.0010) [2023-12-28 07:17:12,408][106226] Updated weights for policy 0, policy_version 1673233 (0.0007) [2023-12-28 07:17:12,437][106225] Updated weights for policy 1, policy_version 1677156 (0.0009) [2023-12-28 07:17:13,157][106226] Updated weights for policy 0, policy_version 1673243 (0.0009) [2023-12-28 07:17:13,184][106225] Updated weights for policy 1, policy_version 1677166 (0.0008) [2023-12-28 07:17:13,217][106226] Updated weights for policy 0, policy_version 1673253 (0.0005) [2023-12-28 07:17:13,231][106225] Updated weights for policy 1, policy_version 1677176 (0.0007) [2023-12-28 07:17:13,276][106226] Updated weights for policy 0, policy_version 1673263 (0.0005) [2023-12-28 07:17:13,296][106225] Updated weights for policy 1, policy_version 1677186 (0.0005) [2023-12-28 07:17:13,834][106226] Updated weights for policy 0, policy_version 1673273 (0.0006) [2023-12-28 07:17:13,858][106225] Updated weights for policy 1, policy_version 1677196 (0.0005) [2023-12-28 07:17:13,898][106226] Updated weights for policy 0, policy_version 1673283 (0.0007) [2023-12-28 07:17:13,920][106225] Updated weights for policy 1, policy_version 1677206 (0.0005) [2023-12-28 07:17:13,963][106226] Updated weights for policy 0, policy_version 1673293 (0.0005) [2023-12-28 07:17:13,972][106225] Updated weights for policy 1, policy_version 1677216 (0.0006) [2023-12-28 07:17:14,023][106226] Updated weights for policy 0, policy_version 1673303 (0.0006) [2023-12-28 07:17:14,606][106225] Updated weights for policy 1, policy_version 1677226 (0.0008) [2023-12-28 07:17:14,663][106225] Updated weights for policy 1, policy_version 1677236 (0.0008) [2023-12-28 07:17:14,713][106226] Updated weights for policy 0, policy_version 1673313 (0.0007) [2023-12-28 07:17:14,722][106225] Updated weights for policy 1, policy_version 1677246 (0.0008) [2023-12-28 07:17:14,775][106226] Updated weights for policy 0, policy_version 1673323 (0.0006) [2023-12-28 07:17:14,787][106225] Updated weights for policy 1, policy_version 1677256 (0.0008) [2023-12-28 07:17:14,843][106226] Updated weights for policy 0, policy_version 1673333 (0.0008) [2023-12-28 07:17:15,499][106225] Updated weights for policy 1, policy_version 1677266 (0.0005) [2023-12-28 07:17:15,550][106225] Updated weights for policy 1, policy_version 1677276 (0.0007) [2023-12-28 07:17:15,605][106225] Updated weights for policy 1, policy_version 1677286 (0.0008) [2023-12-28 07:17:15,620][106226] Updated weights for policy 0, policy_version 1673343 (0.0007) [2023-12-28 07:17:15,680][106226] Updated weights for policy 0, policy_version 1673353 (0.0008) [2023-12-28 07:17:15,731][106226] Updated weights for policy 0, policy_version 1673363 (0.0006) [2023-12-28 07:17:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 857899008. Throughput: 0: 9969.8, 1: 9927.4. Samples: 857890656. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:16,176][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.803')] [2023-12-28 07:17:16,231][106225] Updated weights for policy 1, policy_version 1677296 (0.0005) [2023-12-28 07:17:16,296][106225] Updated weights for policy 1, policy_version 1677306 (0.0008) [2023-12-28 07:17:16,359][106225] Updated weights for policy 1, policy_version 1677316 (0.0008) [2023-12-28 07:17:16,408][106226] Updated weights for policy 0, policy_version 1673373 (0.0008) [2023-12-28 07:17:16,461][106226] Updated weights for policy 0, policy_version 1673383 (0.0007) [2023-12-28 07:17:16,514][106226] Updated weights for policy 0, policy_version 1673393 (0.0009) [2023-12-28 07:17:17,041][106225] Updated weights for policy 1, policy_version 1677326 (0.0010) [2023-12-28 07:17:17,100][106225] Updated weights for policy 1, policy_version 1677336 (0.0007) [2023-12-28 07:17:17,164][106225] Updated weights for policy 1, policy_version 1677346 (0.0006) [2023-12-28 07:17:17,307][106226] Updated weights for policy 0, policy_version 1673403 (0.0008) [2023-12-28 07:17:17,352][106226] Updated weights for policy 0, policy_version 1673413 (0.0008) [2023-12-28 07:17:17,405][106226] Updated weights for policy 0, policy_version 1673423 (0.0008) [2023-12-28 07:17:17,835][106225] Updated weights for policy 1, policy_version 1677356 (0.0009) [2023-12-28 07:17:17,891][106225] Updated weights for policy 1, policy_version 1677366 (0.0010) [2023-12-28 07:17:17,952][106225] Updated weights for policy 1, policy_version 1677376 (0.0010) [2023-12-28 07:17:18,154][106226] Updated weights for policy 0, policy_version 1673433 (0.0007) [2023-12-28 07:17:18,205][106226] Updated weights for policy 0, policy_version 1673443 (0.0008) [2023-12-28 07:17:18,262][106226] Updated weights for policy 0, policy_version 1673453 (0.0007) [2023-12-28 07:17:18,314][106226] Updated weights for policy 0, policy_version 1673463 (0.0005) [2023-12-28 07:17:18,630][106225] Updated weights for policy 1, policy_version 1677386 (0.0007) [2023-12-28 07:17:18,695][106225] Updated weights for policy 1, policy_version 1677396 (0.0006) [2023-12-28 07:17:18,761][106225] Updated weights for policy 1, policy_version 1677406 (0.0010) [2023-12-28 07:17:18,825][106225] Updated weights for policy 1, policy_version 1677416 (0.0010) [2023-12-28 07:17:19,061][106226] Updated weights for policy 0, policy_version 1673473 (0.0009) [2023-12-28 07:17:19,122][106226] Updated weights for policy 0, policy_version 1673483 (0.0008) [2023-12-28 07:17:19,176][106226] Updated weights for policy 0, policy_version 1673493 (0.0008) [2023-12-28 07:17:19,431][106225] Updated weights for policy 1, policy_version 1677426 (0.0007) [2023-12-28 07:17:19,494][106225] Updated weights for policy 1, policy_version 1677436 (0.0010) [2023-12-28 07:17:19,568][106225] Updated weights for policy 1, policy_version 1677446 (0.0009) [2023-12-28 07:17:20,105][106226] Updated weights for policy 0, policy_version 1673503 (0.0008) [2023-12-28 07:17:20,176][106226] Updated weights for policy 0, policy_version 1673513 (0.0008) [2023-12-28 07:17:20,240][106226] Updated weights for policy 0, policy_version 1673523 (0.0008) [2023-12-28 07:17:20,305][106225] Updated weights for policy 1, policy_version 1677456 (0.0008) [2023-12-28 07:17:20,360][106225] Updated weights for policy 1, policy_version 1677466 (0.0007) [2023-12-28 07:17:20,410][106225] Updated weights for policy 1, policy_version 1677476 (0.0007) [2023-12-28 07:17:20,870][106226] Updated weights for policy 0, policy_version 1673533 (0.0007) [2023-12-28 07:17:20,936][106226] Updated weights for policy 0, policy_version 1673543 (0.0006) [2023-12-28 07:17:20,995][106226] Updated weights for policy 0, policy_version 1673553 (0.0008) [2023-12-28 07:17:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 857997312. Throughput: 0: 9803.6, 1: 9911.1. Samples: 858007260. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:21,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.755')] [2023-12-28 07:17:21,306][106225] Updated weights for policy 1, policy_version 1677486 (0.0009) [2023-12-28 07:17:21,374][106225] Updated weights for policy 1, policy_version 1677496 (0.0010) [2023-12-28 07:17:21,441][106225] Updated weights for policy 1, policy_version 1677506 (0.0011) [2023-12-28 07:17:21,753][106226] Updated weights for policy 0, policy_version 1673563 (0.0008) [2023-12-28 07:17:21,824][106226] Updated weights for policy 0, policy_version 1673573 (0.0009) [2023-12-28 07:17:21,882][106226] Updated weights for policy 0, policy_version 1673583 (0.0010) [2023-12-28 07:17:22,181][106225] Updated weights for policy 1, policy_version 1677516 (0.0010) [2023-12-28 07:17:22,229][106225] Updated weights for policy 1, policy_version 1677526 (0.0008) [2023-12-28 07:17:22,284][106225] Updated weights for policy 1, policy_version 1677536 (0.0008) [2023-12-28 07:17:22,654][106226] Updated weights for policy 0, policy_version 1673593 (0.0009) [2023-12-28 07:17:22,722][106226] Updated weights for policy 0, policy_version 1673603 (0.0011) [2023-12-28 07:17:22,784][106226] Updated weights for policy 0, policy_version 1673613 (0.0011) [2023-12-28 07:17:22,845][106226] Updated weights for policy 0, policy_version 1673623 (0.0011) [2023-12-28 07:17:23,049][106225] Updated weights for policy 1, policy_version 1677546 (0.0007) [2023-12-28 07:17:23,104][106225] Updated weights for policy 1, policy_version 1677556 (0.0005) [2023-12-28 07:17:23,163][106225] Updated weights for policy 1, policy_version 1677566 (0.0005) [2023-12-28 07:17:23,225][106225] Updated weights for policy 1, policy_version 1677576 (0.0005) [2023-12-28 07:17:23,448][106226] Updated weights for policy 0, policy_version 1673633 (0.0006) [2023-12-28 07:17:23,507][106226] Updated weights for policy 0, policy_version 1673643 (0.0010) [2023-12-28 07:17:23,574][106226] Updated weights for policy 0, policy_version 1673653 (0.0011) [2023-12-28 07:17:23,890][106225] Updated weights for policy 1, policy_version 1677586 (0.0007) [2023-12-28 07:17:23,942][106225] Updated weights for policy 1, policy_version 1677596 (0.0007) [2023-12-28 07:17:23,995][106225] Updated weights for policy 1, policy_version 1677606 (0.0007) [2023-12-28 07:17:24,194][106226] Updated weights for policy 0, policy_version 1673663 (0.0008) [2023-12-28 07:17:24,256][106226] Updated weights for policy 0, policy_version 1673673 (0.0005) [2023-12-28 07:17:24,318][106226] Updated weights for policy 0, policy_version 1673683 (0.0005) [2023-12-28 07:17:24,821][106225] Updated weights for policy 1, policy_version 1677616 (0.0009) [2023-12-28 07:17:24,850][106226] Updated weights for policy 0, policy_version 1673693 (0.0005) [2023-12-28 07:17:24,881][106225] Updated weights for policy 1, policy_version 1677626 (0.0008) [2023-12-28 07:17:24,898][106226] Updated weights for policy 0, policy_version 1673703 (0.0005) [2023-12-28 07:17:24,942][106225] Updated weights for policy 1, policy_version 1677636 (0.0007) [2023-12-28 07:17:24,948][106226] Updated weights for policy 0, policy_version 1673713 (0.0005) [2023-12-28 07:17:25,525][106226] Updated weights for policy 0, policy_version 1673723 (0.0005) [2023-12-28 07:17:25,588][106226] Updated weights for policy 0, policy_version 1673733 (0.0005) [2023-12-28 07:17:25,638][106226] Updated weights for policy 0, policy_version 1673743 (0.0005) [2023-12-28 07:17:25,734][106225] Updated weights for policy 1, policy_version 1677646 (0.0007) [2023-12-28 07:17:25,789][106225] Updated weights for policy 1, policy_version 1677656 (0.0008) [2023-12-28 07:17:25,846][106225] Updated weights for policy 1, policy_version 1677666 (0.0008) [2023-12-28 07:17:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 858095616. Throughput: 0: 9787.7, 1: 9838.2. Samples: 858065464. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:26,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-5.076')] [2023-12-28 07:17:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001673752_428556288.pth... [2023-12-28 07:17:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001677672_429539328.pth... [2023-12-28 07:17:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001672600_428261376.pth [2023-12-28 07:17:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001676520_429244416.pth [2023-12-28 07:17:26,247][106226] Updated weights for policy 0, policy_version 1673753 (0.0008) [2023-12-28 07:17:26,310][106226] Updated weights for policy 0, policy_version 1673763 (0.0005) [2023-12-28 07:17:26,366][106226] Updated weights for policy 0, policy_version 1673773 (0.0005) [2023-12-28 07:17:26,427][106226] Updated weights for policy 0, policy_version 1673783 (0.0005) [2023-12-28 07:17:26,562][106225] Updated weights for policy 1, policy_version 1677676 (0.0009) [2023-12-28 07:17:26,615][106225] Updated weights for policy 1, policy_version 1677686 (0.0010) [2023-12-28 07:17:26,677][106225] Updated weights for policy 1, policy_version 1677696 (0.0010) [2023-12-28 07:17:26,959][106226] Updated weights for policy 0, policy_version 1673793 (0.0008) [2023-12-28 07:17:27,016][106226] Updated weights for policy 0, policy_version 1673803 (0.0006) [2023-12-28 07:17:27,083][106226] Updated weights for policy 0, policy_version 1673813 (0.0008) [2023-12-28 07:17:27,395][106225] Updated weights for policy 1, policy_version 1677706 (0.0009) [2023-12-28 07:17:27,448][106225] Updated weights for policy 1, policy_version 1677716 (0.0008) [2023-12-28 07:17:27,496][106225] Updated weights for policy 1, policy_version 1677726 (0.0008) [2023-12-28 07:17:27,549][106225] Updated weights for policy 1, policy_version 1677736 (0.0007) [2023-12-28 07:17:27,755][106226] Updated weights for policy 0, policy_version 1673823 (0.0008) [2023-12-28 07:17:27,812][106226] Updated weights for policy 0, policy_version 1673833 (0.0005) [2023-12-28 07:17:27,877][106226] Updated weights for policy 0, policy_version 1673843 (0.0006) [2023-12-28 07:17:28,258][106225] Updated weights for policy 1, policy_version 1677746 (0.0005) [2023-12-28 07:17:28,309][106225] Updated weights for policy 1, policy_version 1677756 (0.0005) [2023-12-28 07:17:28,369][106225] Updated weights for policy 1, policy_version 1677766 (0.0008) [2023-12-28 07:17:28,589][106226] Updated weights for policy 0, policy_version 1673853 (0.0011) [2023-12-28 07:17:28,633][106226] Updated weights for policy 0, policy_version 1673863 (0.0010) [2023-12-28 07:17:28,691][106226] Updated weights for policy 0, policy_version 1673873 (0.0010) [2023-12-28 07:17:28,915][106225] Updated weights for policy 1, policy_version 1677776 (0.0009) [2023-12-28 07:17:28,971][106225] Updated weights for policy 1, policy_version 1677786 (0.0010) [2023-12-28 07:17:29,031][106225] Updated weights for policy 1, policy_version 1677796 (0.0010) [2023-12-28 07:17:29,435][106226] Updated weights for policy 0, policy_version 1673883 (0.0010) [2023-12-28 07:17:29,489][106226] Updated weights for policy 0, policy_version 1673893 (0.0010) [2023-12-28 07:17:29,542][106226] Updated weights for policy 0, policy_version 1673903 (0.0010) [2023-12-28 07:17:29,677][106225] Updated weights for policy 1, policy_version 1677806 (0.0008) [2023-12-28 07:17:29,738][106225] Updated weights for policy 1, policy_version 1677816 (0.0010) [2023-12-28 07:17:29,803][106225] Updated weights for policy 1, policy_version 1677826 (0.0009) [2023-12-28 07:17:30,242][106226] Updated weights for policy 0, policy_version 1673913 (0.0010) [2023-12-28 07:17:30,309][106226] Updated weights for policy 0, policy_version 1673923 (0.0011) [2023-12-28 07:17:30,363][106226] Updated weights for policy 0, policy_version 1673933 (0.0010) [2023-12-28 07:17:30,416][106226] Updated weights for policy 0, policy_version 1673943 (0.0010) [2023-12-28 07:17:30,484][106225] Updated weights for policy 1, policy_version 1677836 (0.0009) [2023-12-28 07:17:30,540][106225] Updated weights for policy 1, policy_version 1677846 (0.0010) [2023-12-28 07:17:30,607][106225] Updated weights for policy 1, policy_version 1677856 (0.0010) [2023-12-28 07:17:31,139][106226] Updated weights for policy 0, policy_version 1673953 (0.0010) [2023-12-28 07:17:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 858193920. Throughput: 0: 9945.6, 1: 9840.3. Samples: 858189380. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:31,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.956')] [2023-12-28 07:17:31,205][106226] Updated weights for policy 0, policy_version 1673963 (0.0008) [2023-12-28 07:17:31,222][106225] Updated weights for policy 1, policy_version 1677866 (0.0009) [2023-12-28 07:17:31,267][106226] Updated weights for policy 0, policy_version 1673973 (0.0011) [2023-12-28 07:17:31,284][106225] Updated weights for policy 1, policy_version 1677876 (0.0006) [2023-12-28 07:17:31,346][106225] Updated weights for policy 1, policy_version 1677886 (0.0008) [2023-12-28 07:17:31,410][106225] Updated weights for policy 1, policy_version 1677896 (0.0007) [2023-12-28 07:17:31,938][106226] Updated weights for policy 0, policy_version 1673983 (0.0009) [2023-12-28 07:17:31,986][106226] Updated weights for policy 0, policy_version 1673993 (0.0006) [2023-12-28 07:17:32,036][106226] Updated weights for policy 0, policy_version 1674003 (0.0005) [2023-12-28 07:17:32,155][106225] Updated weights for policy 1, policy_version 1677906 (0.0007) [2023-12-28 07:17:32,202][106225] Updated weights for policy 1, policy_version 1677916 (0.0008) [2023-12-28 07:17:32,261][106225] Updated weights for policy 1, policy_version 1677926 (0.0008) [2023-12-28 07:17:32,702][106226] Updated weights for policy 0, policy_version 1674013 (0.0008) [2023-12-28 07:17:32,764][106226] Updated weights for policy 0, policy_version 1674023 (0.0006) [2023-12-28 07:17:32,821][106226] Updated weights for policy 0, policy_version 1674033 (0.0006) [2023-12-28 07:17:32,940][106225] Updated weights for policy 1, policy_version 1677936 (0.0009) [2023-12-28 07:17:33,002][106225] Updated weights for policy 1, policy_version 1677946 (0.0010) [2023-12-28 07:17:33,061][106225] Updated weights for policy 1, policy_version 1677956 (0.0008) [2023-12-28 07:17:33,458][106226] Updated weights for policy 0, policy_version 1674043 (0.0009) [2023-12-28 07:17:33,509][106226] Updated weights for policy 0, policy_version 1674053 (0.0005) [2023-12-28 07:17:33,555][106226] Updated weights for policy 0, policy_version 1674063 (0.0007) [2023-12-28 07:17:33,814][106225] Updated weights for policy 1, policy_version 1677966 (0.0007) [2023-12-28 07:17:33,872][106225] Updated weights for policy 1, policy_version 1677976 (0.0008) [2023-12-28 07:17:33,925][106225] Updated weights for policy 1, policy_version 1677986 (0.0009) [2023-12-28 07:17:34,153][106226] Updated weights for policy 0, policy_version 1674073 (0.0008) [2023-12-28 07:17:34,222][106226] Updated weights for policy 0, policy_version 1674083 (0.0009) [2023-12-28 07:17:34,284][106226] Updated weights for policy 0, policy_version 1674093 (0.0008) [2023-12-28 07:17:34,347][106226] Updated weights for policy 0, policy_version 1674103 (0.0009) [2023-12-28 07:17:34,671][106225] Updated weights for policy 1, policy_version 1677996 (0.0009) [2023-12-28 07:17:34,733][106225] Updated weights for policy 1, policy_version 1678006 (0.0008) [2023-12-28 07:17:34,793][106225] Updated weights for policy 1, policy_version 1678016 (0.0008) [2023-12-28 07:17:35,045][106226] Updated weights for policy 0, policy_version 1674113 (0.0006) [2023-12-28 07:17:35,091][106226] Updated weights for policy 0, policy_version 1674123 (0.0005) [2023-12-28 07:17:35,153][106226] Updated weights for policy 0, policy_version 1674133 (0.0005) [2023-12-28 07:17:35,550][106225] Updated weights for policy 1, policy_version 1678026 (0.0009) [2023-12-28 07:17:35,606][106225] Updated weights for policy 1, policy_version 1678036 (0.0010) [2023-12-28 07:17:35,659][106225] Updated weights for policy 1, policy_version 1678046 (0.0010) [2023-12-28 07:17:35,710][106225] Updated weights for policy 1, policy_version 1678056 (0.0010) [2023-12-28 07:17:35,786][106226] Updated weights for policy 0, policy_version 1674143 (0.0007) [2023-12-28 07:17:35,851][106226] Updated weights for policy 0, policy_version 1674153 (0.0008) [2023-12-28 07:17:35,911][106226] Updated weights for policy 0, policy_version 1674163 (0.0008) [2023-12-28 07:17:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 858300416. Throughput: 0: 10035.6, 1: 9810.7. Samples: 858309712. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:36,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-4.808')] [2023-12-28 07:17:36,454][106225] Updated weights for policy 1, policy_version 1678066 (0.0011) [2023-12-28 07:17:36,497][106226] Updated weights for policy 0, policy_version 1674173 (0.0008) [2023-12-28 07:17:36,513][106225] Updated weights for policy 1, policy_version 1678076 (0.0011) [2023-12-28 07:17:36,567][106226] Updated weights for policy 0, policy_version 1674183 (0.0007) [2023-12-28 07:17:36,574][106225] Updated weights for policy 1, policy_version 1678086 (0.0010) [2023-12-28 07:17:36,637][106226] Updated weights for policy 0, policy_version 1674193 (0.0006) [2023-12-28 07:17:37,207][106226] Updated weights for policy 0, policy_version 1674203 (0.0006) [2023-12-28 07:17:37,247][106225] Updated weights for policy 1, policy_version 1678096 (0.0007) [2023-12-28 07:17:37,267][106226] Updated weights for policy 0, policy_version 1674213 (0.0006) [2023-12-28 07:17:37,308][106225] Updated weights for policy 1, policy_version 1678106 (0.0010) [2023-12-28 07:17:37,322][106226] Updated weights for policy 0, policy_version 1674223 (0.0006) [2023-12-28 07:17:37,372][106225] Updated weights for policy 1, policy_version 1678116 (0.0008) [2023-12-28 07:17:37,974][106226] Updated weights for policy 0, policy_version 1674233 (0.0006) [2023-12-28 07:17:37,978][106225] Updated weights for policy 1, policy_version 1678126 (0.0006) [2023-12-28 07:17:38,021][106226] Updated weights for policy 0, policy_version 1674243 (0.0007) [2023-12-28 07:17:38,033][106225] Updated weights for policy 1, policy_version 1678136 (0.0006) [2023-12-28 07:17:38,073][106226] Updated weights for policy 0, policy_version 1674253 (0.0007) [2023-12-28 07:17:38,096][106225] Updated weights for policy 1, policy_version 1678146 (0.0006) [2023-12-28 07:17:38,123][106226] Updated weights for policy 0, policy_version 1674263 (0.0006) [2023-12-28 07:17:38,718][106225] Updated weights for policy 1, policy_version 1678156 (0.0006) [2023-12-28 07:17:38,776][106225] Updated weights for policy 1, policy_version 1678166 (0.0009) [2023-12-28 07:17:38,781][106226] Updated weights for policy 0, policy_version 1674273 (0.0007) [2023-12-28 07:17:38,837][106226] Updated weights for policy 0, policy_version 1674283 (0.0007) [2023-12-28 07:17:38,839][106225] Updated weights for policy 1, policy_version 1678176 (0.0007) [2023-12-28 07:17:38,898][106226] Updated weights for policy 0, policy_version 1674293 (0.0007) [2023-12-28 07:17:39,532][106225] Updated weights for policy 1, policy_version 1678186 (0.0011) [2023-12-28 07:17:39,581][106225] Updated weights for policy 1, policy_version 1678196 (0.0010) [2023-12-28 07:17:39,636][106225] Updated weights for policy 1, policy_version 1678206 (0.0010) [2023-12-28 07:17:39,694][106225] Updated weights for policy 1, policy_version 1678216 (0.0010) [2023-12-28 07:17:39,705][106226] Updated weights for policy 0, policy_version 1674303 (0.0007) [2023-12-28 07:17:39,767][106226] Updated weights for policy 0, policy_version 1674313 (0.0008) [2023-12-28 07:17:39,833][106226] Updated weights for policy 0, policy_version 1674323 (0.0008) [2023-12-28 07:17:40,400][106225] Updated weights for policy 1, policy_version 1678226 (0.0010) [2023-12-28 07:17:40,460][106225] Updated weights for policy 1, policy_version 1678236 (0.0010) [2023-12-28 07:17:40,522][106225] Updated weights for policy 1, policy_version 1678246 (0.0009) [2023-12-28 07:17:40,624][106226] Updated weights for policy 0, policy_version 1674333 (0.0008) [2023-12-28 07:17:40,675][106226] Updated weights for policy 0, policy_version 1674343 (0.0008) [2023-12-28 07:17:40,725][106226] Updated weights for policy 0, policy_version 1674353 (0.0009) [2023-12-28 07:17:41,161][106225] Updated weights for policy 1, policy_version 1678256 (0.0010) [2023-12-28 07:17:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 858398720. Throughput: 0: 10080.8, 1: 9880.9. Samples: 858373312. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:41,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.807')] [2023-12-28 07:17:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001674360_428711936.pth... [2023-12-28 07:17:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001673176_428408832.pth [2023-12-28 07:17:41,227][106225] Updated weights for policy 1, policy_version 1678266 (0.0009) [2023-12-28 07:17:41,292][106225] Updated weights for policy 1, policy_version 1678276 (0.0008) [2023-12-28 07:17:41,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001678280_429694976.pth... [2023-12-28 07:17:41,319][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001677096_429391872.pth [2023-12-28 07:17:41,529][106226] Updated weights for policy 0, policy_version 1674363 (0.0008) [2023-12-28 07:17:41,599][106226] Updated weights for policy 0, policy_version 1674373 (0.0006) [2023-12-28 07:17:41,669][106226] Updated weights for policy 0, policy_version 1674383 (0.0008) [2023-12-28 07:17:42,018][106225] Updated weights for policy 1, policy_version 1678286 (0.0008) [2023-12-28 07:17:42,086][106225] Updated weights for policy 1, policy_version 1678296 (0.0006) [2023-12-28 07:17:42,159][106225] Updated weights for policy 1, policy_version 1678306 (0.0009) [2023-12-28 07:17:42,240][106226] Updated weights for policy 0, policy_version 1674393 (0.0006) [2023-12-28 07:17:42,306][106226] Updated weights for policy 0, policy_version 1674403 (0.0009) [2023-12-28 07:17:42,382][106226] Updated weights for policy 0, policy_version 1674413 (0.0009) [2023-12-28 07:17:42,438][106226] Updated weights for policy 0, policy_version 1674423 (0.0008) [2023-12-28 07:17:42,809][106225] Updated weights for policy 1, policy_version 1678316 (0.0010) [2023-12-28 07:17:42,856][106225] Updated weights for policy 1, policy_version 1678326 (0.0008) [2023-12-28 07:17:42,912][106225] Updated weights for policy 1, policy_version 1678336 (0.0008) [2023-12-28 07:17:43,095][106226] Updated weights for policy 0, policy_version 1674433 (0.0008) [2023-12-28 07:17:43,147][106226] Updated weights for policy 0, policy_version 1674443 (0.0008) [2023-12-28 07:17:43,191][106226] Updated weights for policy 0, policy_version 1674453 (0.0008) [2023-12-28 07:17:43,693][106225] Updated weights for policy 1, policy_version 1678346 (0.0009) [2023-12-28 07:17:43,740][106225] Updated weights for policy 1, policy_version 1678356 (0.0008) [2023-12-28 07:17:43,784][106225] Updated weights for policy 1, policy_version 1678366 (0.0008) [2023-12-28 07:17:43,831][106225] Updated weights for policy 1, policy_version 1678376 (0.0009) [2023-12-28 07:17:43,904][106226] Updated weights for policy 0, policy_version 1674463 (0.0008) [2023-12-28 07:17:43,960][106226] Updated weights for policy 0, policy_version 1674473 (0.0009) [2023-12-28 07:17:44,008][106226] Updated weights for policy 0, policy_version 1674483 (0.0008) [2023-12-28 07:17:44,528][106225] Updated weights for policy 1, policy_version 1678386 (0.0005) [2023-12-28 07:17:44,573][106225] Updated weights for policy 1, policy_version 1678396 (0.0005) [2023-12-28 07:17:44,617][106225] Updated weights for policy 1, policy_version 1678406 (0.0005) [2023-12-28 07:17:44,694][106226] Updated weights for policy 0, policy_version 1674493 (0.0009) [2023-12-28 07:17:44,741][106226] Updated weights for policy 0, policy_version 1674503 (0.0009) [2023-12-28 07:17:44,828][106226] Updated weights for policy 0, policy_version 1674513 (0.0009) [2023-12-28 07:17:45,271][106225] Updated weights for policy 1, policy_version 1678416 (0.0008) [2023-12-28 07:17:45,332][106225] Updated weights for policy 1, policy_version 1678426 (0.0009) [2023-12-28 07:17:45,391][106225] Updated weights for policy 1, policy_version 1678436 (0.0009) [2023-12-28 07:17:45,573][106226] Updated weights for policy 0, policy_version 1674523 (0.0009) [2023-12-28 07:17:45,617][106226] Updated weights for policy 0, policy_version 1674533 (0.0008) [2023-12-28 07:17:45,662][106226] Updated weights for policy 0, policy_version 1674543 (0.0008) [2023-12-28 07:17:46,017][106225] Updated weights for policy 1, policy_version 1678446 (0.0009) [2023-12-28 07:17:46,073][106225] Updated weights for policy 1, policy_version 1678456 (0.0008) [2023-12-28 07:17:46,131][106225] Updated weights for policy 1, policy_version 1678466 (0.0009) [2023-12-28 07:17:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 858505216. Throughput: 0: 9997.5, 1: 9959.8. Samples: 858491104. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:46,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.952')] [2023-12-28 07:17:46,367][106226] Updated weights for policy 0, policy_version 1674553 (0.0008) [2023-12-28 07:17:46,430][106226] Updated weights for policy 0, policy_version 1674563 (0.0008) [2023-12-28 07:17:46,494][106226] Updated weights for policy 0, policy_version 1674573 (0.0008) [2023-12-28 07:17:46,561][106226] Updated weights for policy 0, policy_version 1674583 (0.0007) [2023-12-28 07:17:46,905][106225] Updated weights for policy 1, policy_version 1678476 (0.0009) [2023-12-28 07:17:46,952][106225] Updated weights for policy 1, policy_version 1678486 (0.0009) [2023-12-28 07:17:47,008][106225] Updated weights for policy 1, policy_version 1678496 (0.0009) [2023-12-28 07:17:47,283][106226] Updated weights for policy 0, policy_version 1674593 (0.0006) [2023-12-28 07:17:47,352][106226] Updated weights for policy 0, policy_version 1674603 (0.0006) [2023-12-28 07:17:47,415][106226] Updated weights for policy 0, policy_version 1674613 (0.0008) [2023-12-28 07:17:47,753][106225] Updated weights for policy 1, policy_version 1678506 (0.0006) [2023-12-28 07:17:47,804][106225] Updated weights for policy 1, policy_version 1678516 (0.0008) [2023-12-28 07:17:47,853][106225] Updated weights for policy 1, policy_version 1678526 (0.0006) [2023-12-28 07:17:47,898][106225] Updated weights for policy 1, policy_version 1678536 (0.0005) [2023-12-28 07:17:48,057][106226] Updated weights for policy 0, policy_version 1674623 (0.0006) [2023-12-28 07:17:48,107][106226] Updated weights for policy 0, policy_version 1674633 (0.0009) [2023-12-28 07:17:48,153][106226] Updated weights for policy 0, policy_version 1674643 (0.0010) [2023-12-28 07:17:48,577][106225] Updated weights for policy 1, policy_version 1678546 (0.0008) [2023-12-28 07:17:48,638][106225] Updated weights for policy 1, policy_version 1678556 (0.0008) [2023-12-28 07:17:48,689][106225] Updated weights for policy 1, policy_version 1678566 (0.0008) [2023-12-28 07:17:48,904][106226] Updated weights for policy 0, policy_version 1674653 (0.0011) [2023-12-28 07:17:48,955][106226] Updated weights for policy 0, policy_version 1674663 (0.0010) [2023-12-28 07:17:49,008][106226] Updated weights for policy 0, policy_version 1674673 (0.0010) [2023-12-28 07:17:49,430][106225] Updated weights for policy 1, policy_version 1678576 (0.0007) [2023-12-28 07:17:49,499][106225] Updated weights for policy 1, policy_version 1678586 (0.0005) [2023-12-28 07:17:49,570][106225] Updated weights for policy 1, policy_version 1678596 (0.0006) [2023-12-28 07:17:49,715][106226] Updated weights for policy 0, policy_version 1674683 (0.0010) [2023-12-28 07:17:49,769][106226] Updated weights for policy 0, policy_version 1674693 (0.0008) [2023-12-28 07:17:49,835][106226] Updated weights for policy 0, policy_version 1674703 (0.0008) [2023-12-28 07:17:50,272][106225] Updated weights for policy 1, policy_version 1678606 (0.0006) [2023-12-28 07:17:50,334][106225] Updated weights for policy 1, policy_version 1678616 (0.0008) [2023-12-28 07:17:50,395][106225] Updated weights for policy 1, policy_version 1678626 (0.0008) [2023-12-28 07:17:50,574][106226] Updated weights for policy 0, policy_version 1674713 (0.0009) [2023-12-28 07:17:50,641][106226] Updated weights for policy 0, policy_version 1674723 (0.0009) [2023-12-28 07:17:50,700][106226] Updated weights for policy 0, policy_version 1674733 (0.0009) [2023-12-28 07:17:50,770][106226] Updated weights for policy 0, policy_version 1674743 (0.0008) [2023-12-28 07:17:51,112][106225] Updated weights for policy 1, policy_version 1678636 (0.0008) [2023-12-28 07:17:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 858595328. Throughput: 0: 10020.9, 1: 9892.6. Samples: 858608524. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:51,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.764')] [2023-12-28 07:17:51,184][106225] Updated weights for policy 1, policy_version 1678646 (0.0006) [2023-12-28 07:17:51,249][106225] Updated weights for policy 1, policy_version 1678656 (0.0009) [2023-12-28 07:17:51,495][106226] Updated weights for policy 0, policy_version 1674753 (0.0008) [2023-12-28 07:17:51,551][106226] Updated weights for policy 0, policy_version 1674763 (0.0009) [2023-12-28 07:17:51,606][106226] Updated weights for policy 0, policy_version 1674773 (0.0008) [2023-12-28 07:17:52,017][106225] Updated weights for policy 1, policy_version 1678666 (0.0008) [2023-12-28 07:17:52,078][106225] Updated weights for policy 1, policy_version 1678676 (0.0010) [2023-12-28 07:17:52,138][106225] Updated weights for policy 1, policy_version 1678686 (0.0008) [2023-12-28 07:17:52,193][106225] Updated weights for policy 1, policy_version 1678696 (0.0007) [2023-12-28 07:17:52,355][106226] Updated weights for policy 0, policy_version 1674783 (0.0008) [2023-12-28 07:17:52,432][106226] Updated weights for policy 0, policy_version 1674793 (0.0009) [2023-12-28 07:17:52,492][106226] Updated weights for policy 0, policy_version 1674803 (0.0009) [2023-12-28 07:17:52,914][106225] Updated weights for policy 1, policy_version 1678706 (0.0005) [2023-12-28 07:17:52,962][106225] Updated weights for policy 1, policy_version 1678716 (0.0009) [2023-12-28 07:17:53,008][106225] Updated weights for policy 1, policy_version 1678726 (0.0005) [2023-12-28 07:17:53,255][106226] Updated weights for policy 0, policy_version 1674813 (0.0010) [2023-12-28 07:17:53,318][106226] Updated weights for policy 0, policy_version 1674823 (0.0009) [2023-12-28 07:17:53,385][106226] Updated weights for policy 0, policy_version 1674833 (0.0007) [2023-12-28 07:17:53,570][106225] Updated weights for policy 1, policy_version 1678736 (0.0005) [2023-12-28 07:17:53,629][106225] Updated weights for policy 1, policy_version 1678746 (0.0005) [2023-12-28 07:17:53,683][106225] Updated weights for policy 1, policy_version 1678756 (0.0005) [2023-12-28 07:17:54,052][106226] Updated weights for policy 0, policy_version 1674843 (0.0008) [2023-12-28 07:17:54,109][106226] Updated weights for policy 0, policy_version 1674853 (0.0008) [2023-12-28 07:17:54,175][106226] Updated weights for policy 0, policy_version 1674863 (0.0008) [2023-12-28 07:17:54,306][106225] Updated weights for policy 1, policy_version 1678766 (0.0009) [2023-12-28 07:17:54,364][106225] Updated weights for policy 1, policy_version 1678776 (0.0008) [2023-12-28 07:17:54,424][106225] Updated weights for policy 1, policy_version 1678786 (0.0008) [2023-12-28 07:17:54,891][106226] Updated weights for policy 0, policy_version 1674873 (0.0008) [2023-12-28 07:17:54,956][106226] Updated weights for policy 0, policy_version 1674883 (0.0010) [2023-12-28 07:17:55,019][106226] Updated weights for policy 0, policy_version 1674893 (0.0008) [2023-12-28 07:17:55,072][106225] Updated weights for policy 1, policy_version 1678796 (0.0006) [2023-12-28 07:17:55,082][106226] Updated weights for policy 0, policy_version 1674903 (0.0010) [2023-12-28 07:17:55,123][106225] Updated weights for policy 1, policy_version 1678806 (0.0005) [2023-12-28 07:17:55,173][106225] Updated weights for policy 1, policy_version 1678816 (0.0007) [2023-12-28 07:17:55,750][106226] Updated weights for policy 0, policy_version 1674913 (0.0010) [2023-12-28 07:17:55,797][106226] Updated weights for policy 0, policy_version 1674923 (0.0010) [2023-12-28 07:17:55,847][106226] Updated weights for policy 0, policy_version 1674933 (0.0010) [2023-12-28 07:17:55,893][106225] Updated weights for policy 1, policy_version 1678826 (0.0008) [2023-12-28 07:17:55,943][106225] Updated weights for policy 1, policy_version 1678836 (0.0008) [2023-12-28 07:17:55,990][106225] Updated weights for policy 1, policy_version 1678846 (0.0008) [2023-12-28 07:17:56,040][106225] Updated weights for policy 1, policy_version 1678856 (0.0007) [2023-12-28 07:17:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 858701824. Throughput: 0: 9977.2, 1: 9903.7. Samples: 858668092. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:17:56,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.027')] [2023-12-28 07:17:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001674936_428859392.pth... [2023-12-28 07:17:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001678856_429842432.pth... [2023-12-28 07:17:56,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001673752_428556288.pth [2023-12-28 07:17:56,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001677672_429539328.pth [2023-12-28 07:17:56,563][106226] Updated weights for policy 0, policy_version 1674943 (0.0007) [2023-12-28 07:17:56,620][106226] Updated weights for policy 0, policy_version 1674953 (0.0005) [2023-12-28 07:17:56,688][106226] Updated weights for policy 0, policy_version 1674963 (0.0006) [2023-12-28 07:17:56,725][106225] Updated weights for policy 1, policy_version 1678866 (0.0005) [2023-12-28 07:17:56,775][106225] Updated weights for policy 1, policy_version 1678876 (0.0005) [2023-12-28 07:17:56,827][106225] Updated weights for policy 1, policy_version 1678886 (0.0005) [2023-12-28 07:17:57,271][106226] Updated weights for policy 0, policy_version 1674973 (0.0008) [2023-12-28 07:17:57,324][106226] Updated weights for policy 0, policy_version 1674983 (0.0008) [2023-12-28 07:17:57,348][106225] Updated weights for policy 1, policy_version 1678896 (0.0005) [2023-12-28 07:17:57,377][106226] Updated weights for policy 0, policy_version 1674993 (0.0008) [2023-12-28 07:17:57,393][106225] Updated weights for policy 1, policy_version 1678906 (0.0005) [2023-12-28 07:17:57,456][106225] Updated weights for policy 1, policy_version 1678916 (0.0006) [2023-12-28 07:17:58,039][106225] Updated weights for policy 1, policy_version 1678926 (0.0008) [2023-12-28 07:17:58,087][106225] Updated weights for policy 1, policy_version 1678936 (0.0008) [2023-12-28 07:17:58,135][106225] Updated weights for policy 1, policy_version 1678946 (0.0009) [2023-12-28 07:17:58,142][106226] Updated weights for policy 0, policy_version 1675003 (0.0007) [2023-12-28 07:17:58,198][106226] Updated weights for policy 0, policy_version 1675013 (0.0009) [2023-12-28 07:17:58,262][106226] Updated weights for policy 0, policy_version 1675023 (0.0008) [2023-12-28 07:17:58,984][106225] Updated weights for policy 1, policy_version 1678956 (0.0008) [2023-12-28 07:17:59,046][106225] Updated weights for policy 1, policy_version 1678966 (0.0008) [2023-12-28 07:17:59,106][106226] Updated weights for policy 0, policy_version 1675033 (0.0009) [2023-12-28 07:17:59,108][106225] Updated weights for policy 1, policy_version 1678976 (0.0007) [2023-12-28 07:17:59,166][106226] Updated weights for policy 0, policy_version 1675043 (0.0010) [2023-12-28 07:17:59,256][106226] Updated weights for policy 0, policy_version 1675053 (0.0011) [2023-12-28 07:17:59,319][106226] Updated weights for policy 0, policy_version 1675063 (0.0009) [2023-12-28 07:17:59,889][106225] Updated weights for policy 1, policy_version 1678986 (0.0008) [2023-12-28 07:17:59,951][106225] Updated weights for policy 1, policy_version 1678996 (0.0008) [2023-12-28 07:17:59,969][106226] Updated weights for policy 0, policy_version 1675073 (0.0007) [2023-12-28 07:18:00,008][106225] Updated weights for policy 1, policy_version 1679006 (0.0008) [2023-12-28 07:18:00,031][106226] Updated weights for policy 0, policy_version 1675083 (0.0006) [2023-12-28 07:18:00,067][106225] Updated weights for policy 1, policy_version 1679016 (0.0008) [2023-12-28 07:18:00,087][106226] Updated weights for policy 0, policy_version 1675093 (0.0006) [2023-12-28 07:18:00,779][106226] Updated weights for policy 0, policy_version 1675103 (0.0009) [2023-12-28 07:18:00,816][106225] Updated weights for policy 1, policy_version 1679026 (0.0010) [2023-12-28 07:18:00,828][106226] Updated weights for policy 0, policy_version 1675113 (0.0010) [2023-12-28 07:18:00,876][106225] Updated weights for policy 1, policy_version 1679036 (0.0010) [2023-12-28 07:18:00,889][106226] Updated weights for policy 0, policy_version 1675123 (0.0006) [2023-12-28 07:18:00,932][106225] Updated weights for policy 1, policy_version 1679046 (0.0010) [2023-12-28 07:18:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 858800128. Throughput: 0: 9977.4, 1: 9969.2. Samples: 858788248. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:18:01,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.542')] [2023-12-28 07:18:01,546][106226] Updated weights for policy 0, policy_version 1675133 (0.0005) [2023-12-28 07:18:01,602][106226] Updated weights for policy 0, policy_version 1675143 (0.0008) [2023-12-28 07:18:01,673][106226] Updated weights for policy 0, policy_version 1675153 (0.0008) [2023-12-28 07:18:01,718][106225] Updated weights for policy 1, policy_version 1679056 (0.0008) [2023-12-28 07:18:01,793][106225] Updated weights for policy 1, policy_version 1679066 (0.0009) [2023-12-28 07:18:01,852][106225] Updated weights for policy 1, policy_version 1679076 (0.0008) [2023-12-28 07:18:02,298][106226] Updated weights for policy 0, policy_version 1675163 (0.0007) [2023-12-28 07:18:02,364][106226] Updated weights for policy 0, policy_version 1675173 (0.0008) [2023-12-28 07:18:02,428][106226] Updated weights for policy 0, policy_version 1675183 (0.0006) [2023-12-28 07:18:02,525][106225] Updated weights for policy 1, policy_version 1679086 (0.0009) [2023-12-28 07:18:02,584][106225] Updated weights for policy 1, policy_version 1679096 (0.0009) [2023-12-28 07:18:02,639][106225] Updated weights for policy 1, policy_version 1679106 (0.0008) [2023-12-28 07:18:03,064][106226] Updated weights for policy 0, policy_version 1675193 (0.0009) [2023-12-28 07:18:03,121][106226] Updated weights for policy 0, policy_version 1675203 (0.0009) [2023-12-28 07:18:03,184][106226] Updated weights for policy 0, policy_version 1675213 (0.0005) [2023-12-28 07:18:03,229][106226] Updated weights for policy 0, policy_version 1675223 (0.0005) [2023-12-28 07:18:03,350][106225] Updated weights for policy 1, policy_version 1679116 (0.0008) [2023-12-28 07:18:03,396][106225] Updated weights for policy 1, policy_version 1679126 (0.0005) [2023-12-28 07:18:03,446][106225] Updated weights for policy 1, policy_version 1679136 (0.0005) [2023-12-28 07:18:03,973][106226] Updated weights for policy 0, policy_version 1675233 (0.0008) [2023-12-28 07:18:04,035][106226] Updated weights for policy 0, policy_version 1675243 (0.0008) [2023-12-28 07:18:04,071][106225] Updated weights for policy 1, policy_version 1679146 (0.0006) [2023-12-28 07:18:04,093][106226] Updated weights for policy 0, policy_version 1675253 (0.0007) [2023-12-28 07:18:04,129][106225] Updated weights for policy 1, policy_version 1679156 (0.0006) [2023-12-28 07:18:04,189][106225] Updated weights for policy 1, policy_version 1679166 (0.0009) [2023-12-28 07:18:04,261][106225] Updated weights for policy 1, policy_version 1679176 (0.0008) [2023-12-28 07:18:04,839][106226] Updated weights for policy 0, policy_version 1675263 (0.0008) [2023-12-28 07:18:04,893][106226] Updated weights for policy 0, policy_version 1675273 (0.0008) [2023-12-28 07:18:04,918][106225] Updated weights for policy 1, policy_version 1679186 (0.0009) [2023-12-28 07:18:04,959][106226] Updated weights for policy 0, policy_version 1675283 (0.0008) [2023-12-28 07:18:04,969][106225] Updated weights for policy 1, policy_version 1679196 (0.0008) [2023-12-28 07:18:05,036][106225] Updated weights for policy 1, policy_version 1679206 (0.0010) [2023-12-28 07:18:05,717][106226] Updated weights for policy 0, policy_version 1675293 (0.0006) [2023-12-28 07:18:05,740][106225] Updated weights for policy 1, policy_version 1679216 (0.0006) [2023-12-28 07:18:05,774][106226] Updated weights for policy 0, policy_version 1675303 (0.0005) [2023-12-28 07:18:05,803][106225] Updated weights for policy 1, policy_version 1679226 (0.0010) [2023-12-28 07:18:05,831][106226] Updated weights for policy 0, policy_version 1675313 (0.0006) [2023-12-28 07:18:05,860][106225] Updated weights for policy 1, policy_version 1679236 (0.0010) [2023-12-28 07:18:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 858898432. Throughput: 0: 10056.1, 1: 9952.4. Samples: 858907640. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:18:06,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.752')] [2023-12-28 07:18:06,424][106226] Updated weights for policy 0, policy_version 1675323 (0.0006) [2023-12-28 07:18:06,485][106226] Updated weights for policy 0, policy_version 1675333 (0.0006) [2023-12-28 07:18:06,522][106225] Updated weights for policy 1, policy_version 1679246 (0.0008) [2023-12-28 07:18:06,544][106226] Updated weights for policy 0, policy_version 1675343 (0.0007) [2023-12-28 07:18:06,580][106225] Updated weights for policy 1, policy_version 1679256 (0.0011) [2023-12-28 07:18:06,635][106225] Updated weights for policy 1, policy_version 1679266 (0.0010) [2023-12-28 07:18:07,161][106226] Updated weights for policy 0, policy_version 1675353 (0.0007) [2023-12-28 07:18:07,223][106226] Updated weights for policy 0, policy_version 1675363 (0.0005) [2023-12-28 07:18:07,241][106225] Updated weights for policy 1, policy_version 1679276 (0.0009) [2023-12-28 07:18:07,289][106226] Updated weights for policy 0, policy_version 1675373 (0.0006) [2023-12-28 07:18:07,301][106225] Updated weights for policy 1, policy_version 1679286 (0.0005) [2023-12-28 07:18:07,342][106226] Updated weights for policy 0, policy_version 1675383 (0.0005) [2023-12-28 07:18:07,362][106225] Updated weights for policy 1, policy_version 1679296 (0.0005) [2023-12-28 07:18:07,882][106225] Updated weights for policy 1, policy_version 1679306 (0.0006) [2023-12-28 07:18:07,937][106225] Updated weights for policy 1, policy_version 1679316 (0.0008) [2023-12-28 07:18:07,987][106225] Updated weights for policy 1, policy_version 1679326 (0.0010) [2023-12-28 07:18:08,038][106225] Updated weights for policy 1, policy_version 1679336 (0.0006) [2023-12-28 07:18:08,068][106226] Updated weights for policy 0, policy_version 1675393 (0.0009) [2023-12-28 07:18:08,130][106226] Updated weights for policy 0, policy_version 1675403 (0.0008) [2023-12-28 07:18:08,185][106226] Updated weights for policy 0, policy_version 1675413 (0.0009) [2023-12-28 07:18:08,714][106225] Updated weights for policy 1, policy_version 1679346 (0.0006) [2023-12-28 07:18:08,783][106225] Updated weights for policy 1, policy_version 1679356 (0.0005) [2023-12-28 07:18:08,850][106225] Updated weights for policy 1, policy_version 1679366 (0.0006) [2023-12-28 07:18:08,934][106226] Updated weights for policy 0, policy_version 1675423 (0.0006) [2023-12-28 07:18:08,997][106226] Updated weights for policy 0, policy_version 1675433 (0.0008) [2023-12-28 07:18:09,065][106226] Updated weights for policy 0, policy_version 1675443 (0.0008) [2023-12-28 07:18:09,513][106225] Updated weights for policy 1, policy_version 1679376 (0.0008) [2023-12-28 07:18:09,565][106225] Updated weights for policy 1, policy_version 1679386 (0.0008) [2023-12-28 07:18:09,616][106225] Updated weights for policy 1, policy_version 1679396 (0.0008) [2023-12-28 07:18:09,731][106226] Updated weights for policy 0, policy_version 1675453 (0.0008) [2023-12-28 07:18:09,798][106226] Updated weights for policy 0, policy_version 1675463 (0.0008) [2023-12-28 07:18:09,868][106226] Updated weights for policy 0, policy_version 1675473 (0.0008) [2023-12-28 07:18:10,375][106225] Updated weights for policy 1, policy_version 1679406 (0.0010) [2023-12-28 07:18:10,439][106225] Updated weights for policy 1, policy_version 1679416 (0.0010) [2023-12-28 07:18:10,500][106225] Updated weights for policy 1, policy_version 1679426 (0.0010) [2023-12-28 07:18:10,616][106226] Updated weights for policy 0, policy_version 1675483 (0.0008) [2023-12-28 07:18:10,681][106226] Updated weights for policy 0, policy_version 1675493 (0.0008) [2023-12-28 07:18:10,738][106226] Updated weights for policy 0, policy_version 1675503 (0.0008) [2023-12-28 07:18:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 858996736. Throughput: 0: 10068.5, 1: 10053.4. Samples: 858970952. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-28 07:18:11,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.514')] [2023-12-28 07:18:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001675512_429006848.pth... [2023-12-28 07:18:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001674360_428711936.pth [2023-12-28 07:18:11,207][106225] Updated weights for policy 1, policy_version 1679436 (0.0011) [2023-12-28 07:18:11,274][106225] Updated weights for policy 1, policy_version 1679446 (0.0011) [2023-12-28 07:18:11,334][106225] Updated weights for policy 1, policy_version 1679456 (0.0010) [2023-12-28 07:18:11,391][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001679464_429998080.pth... [2023-12-28 07:18:11,396][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001678280_429694976.pth [2023-12-28 07:18:11,415][106226] Updated weights for policy 0, policy_version 1675513 (0.0007) [2023-12-28 07:18:11,478][106226] Updated weights for policy 0, policy_version 1675523 (0.0006) [2023-12-28 07:18:11,543][106226] Updated weights for policy 0, policy_version 1675533 (0.0007) [2023-12-28 07:18:11,605][106226] Updated weights for policy 0, policy_version 1675543 (0.0008) [2023-12-28 07:18:12,161][106225] Updated weights for policy 1, policy_version 1679466 (0.0013) [2023-12-28 07:18:12,229][106225] Updated weights for policy 1, policy_version 1679476 (0.0008) [2023-12-28 07:18:12,300][106225] Updated weights for policy 1, policy_version 1679486 (0.0009) [2023-12-28 07:18:12,332][106226] Updated weights for policy 0, policy_version 1675553 (0.0007) [2023-12-28 07:18:12,364][106225] Updated weights for policy 1, policy_version 1679496 (0.0008) [2023-12-28 07:18:12,404][106226] Updated weights for policy 0, policy_version 1675563 (0.0009) [2023-12-28 07:18:12,472][106226] Updated weights for policy 0, policy_version 1675573 (0.0009) [2023-12-28 07:18:13,057][106225] Updated weights for policy 1, policy_version 1679506 (0.0009) [2023-12-28 07:18:13,121][106225] Updated weights for policy 1, policy_version 1679516 (0.0010) [2023-12-28 07:18:13,183][106225] Updated weights for policy 1, policy_version 1679526 (0.0008) [2023-12-28 07:18:13,198][106226] Updated weights for policy 0, policy_version 1675583 (0.0007) [2023-12-28 07:18:13,251][106226] Updated weights for policy 0, policy_version 1675593 (0.0008) [2023-12-28 07:18:13,301][106226] Updated weights for policy 0, policy_version 1675603 (0.0008) [2023-12-28 07:18:13,814][106225] Updated weights for policy 1, policy_version 1679536 (0.0008) [2023-12-28 07:18:13,856][106225] Updated weights for policy 1, policy_version 1679546 (0.0006) [2023-12-28 07:18:13,907][106225] Updated weights for policy 1, policy_version 1679556 (0.0005) [2023-12-28 07:18:14,086][106226] Updated weights for policy 0, policy_version 1675613 (0.0009) [2023-12-28 07:18:14,154][106226] Updated weights for policy 0, policy_version 1675623 (0.0010) [2023-12-28 07:18:14,222][106226] Updated weights for policy 0, policy_version 1675633 (0.0009) [2023-12-28 07:18:14,574][106225] Updated weights for policy 1, policy_version 1679566 (0.0006) [2023-12-28 07:18:14,630][106225] Updated weights for policy 1, policy_version 1679576 (0.0007) [2023-12-28 07:18:14,676][106225] Updated weights for policy 1, policy_version 1679586 (0.0005) [2023-12-28 07:18:14,985][106226] Updated weights for policy 0, policy_version 1675643 (0.0008) [2023-12-28 07:18:15,042][106226] Updated weights for policy 0, policy_version 1675653 (0.0009) [2023-12-28 07:18:15,097][106226] Updated weights for policy 0, policy_version 1675663 (0.0009) [2023-12-28 07:18:15,356][106225] Updated weights for policy 1, policy_version 1679596 (0.0005) [2023-12-28 07:18:15,410][106225] Updated weights for policy 1, policy_version 1679606 (0.0005) [2023-12-28 07:18:15,472][106225] Updated weights for policy 1, policy_version 1679616 (0.0005) [2023-12-28 07:18:15,955][106226] Updated weights for policy 0, policy_version 1675673 (0.0009) [2023-12-28 07:18:15,979][106225] Updated weights for policy 1, policy_version 1679626 (0.0006) [2023-12-28 07:18:16,005][106226] Updated weights for policy 0, policy_version 1675683 (0.0007) [2023-12-28 07:18:16,039][106225] Updated weights for policy 1, policy_version 1679636 (0.0008) [2023-12-28 07:18:16,062][106226] Updated weights for policy 0, policy_version 1675693 (0.0008) [2023-12-28 07:18:16,084][106225] Updated weights for policy 1, policy_version 1679646 (0.0007) [2023-12-28 07:18:16,124][106226] Updated weights for policy 0, policy_version 1675703 (0.0006) [2023-12-28 07:18:16,130][106225] Updated weights for policy 1, policy_version 1679656 (0.0008) [2023-12-28 07:18:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 859103232. Throughput: 0: 9866.9, 1: 10044.5. Samples: 859085392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:16,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.756')] [2023-12-28 07:18:16,800][106225] Updated weights for policy 1, policy_version 1679666 (0.0009) [2023-12-28 07:18:16,859][106225] Updated weights for policy 1, policy_version 1679676 (0.0009) [2023-12-28 07:18:16,897][106226] Updated weights for policy 0, policy_version 1675713 (0.0008) [2023-12-28 07:18:16,914][106225] Updated weights for policy 1, policy_version 1679686 (0.0007) [2023-12-28 07:18:16,963][106226] Updated weights for policy 0, policy_version 1675723 (0.0008) [2023-12-28 07:18:17,023][106226] Updated weights for policy 0, policy_version 1675733 (0.0008) [2023-12-28 07:18:17,626][106225] Updated weights for policy 1, policy_version 1679696 (0.0008) [2023-12-28 07:18:17,678][106225] Updated weights for policy 1, policy_version 1679706 (0.0008) [2023-12-28 07:18:17,732][106226] Updated weights for policy 0, policy_version 1675743 (0.0009) [2023-12-28 07:18:17,735][106225] Updated weights for policy 1, policy_version 1679716 (0.0008) [2023-12-28 07:18:17,799][106226] Updated weights for policy 0, policy_version 1675753 (0.0010) [2023-12-28 07:18:17,864][106226] Updated weights for policy 0, policy_version 1675763 (0.0009) [2023-12-28 07:18:18,360][106225] Updated weights for policy 1, policy_version 1679726 (0.0008) [2023-12-28 07:18:18,416][106225] Updated weights for policy 1, policy_version 1679736 (0.0010) [2023-12-28 07:18:18,468][106225] Updated weights for policy 1, policy_version 1679746 (0.0010) [2023-12-28 07:18:18,635][106226] Updated weights for policy 0, policy_version 1675773 (0.0009) [2023-12-28 07:18:18,700][106226] Updated weights for policy 0, policy_version 1675783 (0.0009) [2023-12-28 07:18:18,757][106226] Updated weights for policy 0, policy_version 1675793 (0.0008) [2023-12-28 07:18:19,225][106225] Updated weights for policy 1, policy_version 1679756 (0.0010) [2023-12-28 07:18:19,291][106225] Updated weights for policy 1, policy_version 1679766 (0.0008) [2023-12-28 07:18:19,343][106225] Updated weights for policy 1, policy_version 1679776 (0.0010) [2023-12-28 07:18:19,514][106226] Updated weights for policy 0, policy_version 1675803 (0.0009) [2023-12-28 07:18:19,571][106226] Updated weights for policy 0, policy_version 1675813 (0.0006) [2023-12-28 07:18:19,626][106226] Updated weights for policy 0, policy_version 1675823 (0.0006) [2023-12-28 07:18:20,110][106225] Updated weights for policy 1, policy_version 1679786 (0.0009) [2023-12-28 07:18:20,174][106225] Updated weights for policy 1, policy_version 1679796 (0.0009) [2023-12-28 07:18:20,239][106225] Updated weights for policy 1, policy_version 1679806 (0.0011) [2023-12-28 07:18:20,287][106226] Updated weights for policy 0, policy_version 1675833 (0.0006) [2023-12-28 07:18:20,302][106225] Updated weights for policy 1, policy_version 1679816 (0.0011) [2023-12-28 07:18:20,351][106226] Updated weights for policy 0, policy_version 1675843 (0.0006) [2023-12-28 07:18:20,416][106226] Updated weights for policy 0, policy_version 1675853 (0.0006) [2023-12-28 07:18:20,482][106226] Updated weights for policy 0, policy_version 1675863 (0.0005) [2023-12-28 07:18:21,058][106225] Updated weights for policy 1, policy_version 1679826 (0.0008) [2023-12-28 07:18:21,124][106225] Updated weights for policy 1, policy_version 1679836 (0.0009) [2023-12-28 07:18:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 859185152. Throughput: 0: 9726.3, 1: 10110.2. Samples: 859202356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:21,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-4.658')] [2023-12-28 07:18:21,187][106225] Updated weights for policy 1, policy_version 1679846 (0.0009) [2023-12-28 07:18:21,237][106226] Updated weights for policy 0, policy_version 1675873 (0.0007) [2023-12-28 07:18:21,308][106226] Updated weights for policy 0, policy_version 1675883 (0.0009) [2023-12-28 07:18:21,383][106226] Updated weights for policy 0, policy_version 1675893 (0.0009) [2023-12-28 07:18:21,967][106225] Updated weights for policy 1, policy_version 1679856 (0.0008) [2023-12-28 07:18:22,033][106225] Updated weights for policy 1, policy_version 1679866 (0.0006) [2023-12-28 07:18:22,096][106225] Updated weights for policy 1, policy_version 1679876 (0.0006) [2023-12-28 07:18:22,117][106226] Updated weights for policy 0, policy_version 1675903 (0.0010) [2023-12-28 07:18:22,184][106226] Updated weights for policy 0, policy_version 1675913 (0.0005) [2023-12-28 07:18:22,252][106226] Updated weights for policy 0, policy_version 1675923 (0.0010) [2023-12-28 07:18:22,770][106225] Updated weights for policy 1, policy_version 1679886 (0.0006) [2023-12-28 07:18:22,826][106225] Updated weights for policy 1, policy_version 1679896 (0.0009) [2023-12-28 07:18:22,882][106225] Updated weights for policy 1, policy_version 1679906 (0.0008) [2023-12-28 07:18:22,990][106226] Updated weights for policy 0, policy_version 1675933 (0.0009) [2023-12-28 07:18:23,049][106226] Updated weights for policy 0, policy_version 1675943 (0.0008) [2023-12-28 07:18:23,102][106226] Updated weights for policy 0, policy_version 1675953 (0.0009) [2023-12-28 07:18:23,587][106225] Updated weights for policy 1, policy_version 1679916 (0.0008) [2023-12-28 07:18:23,638][106225] Updated weights for policy 1, policy_version 1679926 (0.0009) [2023-12-28 07:18:23,689][106225] Updated weights for policy 1, policy_version 1679937 (0.0009) [2023-12-28 07:18:23,794][106226] Updated weights for policy 0, policy_version 1675963 (0.0007) [2023-12-28 07:18:23,852][106226] Updated weights for policy 0, policy_version 1675973 (0.0009) [2023-12-28 07:18:23,913][106226] Updated weights for policy 0, policy_version 1675983 (0.0008) [2023-12-28 07:18:24,395][106225] Updated weights for policy 1, policy_version 1679947 (0.0008) [2023-12-28 07:18:24,450][106225] Updated weights for policy 1, policy_version 1679957 (0.0008) [2023-12-28 07:18:24,499][106225] Updated weights for policy 1, policy_version 1679967 (0.0009) [2023-12-28 07:18:24,610][106226] Updated weights for policy 0, policy_version 1675993 (0.0008) [2023-12-28 07:18:24,658][106226] Updated weights for policy 0, policy_version 1676003 (0.0008) [2023-12-28 07:18:24,710][106226] Updated weights for policy 0, policy_version 1676013 (0.0008) [2023-12-28 07:18:24,766][106226] Updated weights for policy 0, policy_version 1676023 (0.0009) [2023-12-28 07:18:25,250][106225] Updated weights for policy 1, policy_version 1679977 (0.0007) [2023-12-28 07:18:25,307][106225] Updated weights for policy 1, policy_version 1679987 (0.0008) [2023-12-28 07:18:25,357][106225] Updated weights for policy 1, policy_version 1679997 (0.0008) [2023-12-28 07:18:25,409][106225] Updated weights for policy 1, policy_version 1680007 (0.0008) [2023-12-28 07:18:25,470][106226] Updated weights for policy 0, policy_version 1676033 (0.0008) [2023-12-28 07:18:25,522][106226] Updated weights for policy 0, policy_version 1676043 (0.0006) [2023-12-28 07:18:25,579][106226] Updated weights for policy 0, policy_version 1676053 (0.0008) [2023-12-28 07:18:26,172][106225] Updated weights for policy 1, policy_version 1680017 (0.0009) [2023-12-28 07:18:26,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 859283456. Throughput: 0: 9641.6, 1: 10035.0. Samples: 859258760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:26,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.468')] [2023-12-28 07:18:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001676056_429146112.pth... [2023-12-28 07:18:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001674936_428859392.pth [2023-12-28 07:18:26,237][106225] Updated weights for policy 1, policy_version 1680027 (0.0009) [2023-12-28 07:18:26,254][106226] Updated weights for policy 0, policy_version 1676063 (0.0006) [2023-12-28 07:18:26,305][106225] Updated weights for policy 1, policy_version 1680037 (0.0007) [2023-12-28 07:18:26,308][106226] Updated weights for policy 0, policy_version 1676073 (0.0006) [2023-12-28 07:18:26,322][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001680040_430145536.pth... [2023-12-28 07:18:26,326][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001678856_429842432.pth [2023-12-28 07:18:26,367][106226] Updated weights for policy 0, policy_version 1676083 (0.0007) [2023-12-28 07:18:27,021][106225] Updated weights for policy 1, policy_version 1680047 (0.0008) [2023-12-28 07:18:27,072][106226] Updated weights for policy 0, policy_version 1676093 (0.0008) [2023-12-28 07:18:27,082][106225] Updated weights for policy 1, policy_version 1680057 (0.0007) [2023-12-28 07:18:27,122][106226] Updated weights for policy 0, policy_version 1676103 (0.0008) [2023-12-28 07:18:27,143][106225] Updated weights for policy 1, policy_version 1680067 (0.0007) [2023-12-28 07:18:27,173][106226] Updated weights for policy 0, policy_version 1676113 (0.0006) [2023-12-28 07:18:27,832][106225] Updated weights for policy 1, policy_version 1680077 (0.0008) [2023-12-28 07:18:27,850][106226] Updated weights for policy 0, policy_version 1676123 (0.0008) [2023-12-28 07:18:27,883][106225] Updated weights for policy 1, policy_version 1680087 (0.0006) [2023-12-28 07:18:27,896][106226] Updated weights for policy 0, policy_version 1676133 (0.0005) [2023-12-28 07:18:27,940][106225] Updated weights for policy 1, policy_version 1680097 (0.0007) [2023-12-28 07:18:27,943][106226] Updated weights for policy 0, policy_version 1676143 (0.0006) [2023-12-28 07:18:28,525][106226] Updated weights for policy 0, policy_version 1676153 (0.0008) [2023-12-28 07:18:28,584][106226] Updated weights for policy 0, policy_version 1676163 (0.0005) [2023-12-28 07:18:28,635][106226] Updated weights for policy 0, policy_version 1676173 (0.0005) [2023-12-28 07:18:28,684][106226] Updated weights for policy 0, policy_version 1676183 (0.0006) [2023-12-28 07:18:28,775][106225] Updated weights for policy 1, policy_version 1680107 (0.0009) [2023-12-28 07:18:28,834][106225] Updated weights for policy 1, policy_version 1680117 (0.0008) [2023-12-28 07:18:28,899][106225] Updated weights for policy 1, policy_version 1680127 (0.0008) [2023-12-28 07:18:29,353][106226] Updated weights for policy 0, policy_version 1676193 (0.0008) [2023-12-28 07:18:29,421][106226] Updated weights for policy 0, policy_version 1676203 (0.0009) [2023-12-28 07:18:29,483][106226] Updated weights for policy 0, policy_version 1676213 (0.0008) [2023-12-28 07:18:29,647][106225] Updated weights for policy 1, policy_version 1680137 (0.0008) [2023-12-28 07:18:29,710][106225] Updated weights for policy 1, policy_version 1680147 (0.0010) [2023-12-28 07:18:29,774][106225] Updated weights for policy 1, policy_version 1680157 (0.0008) [2023-12-28 07:18:29,843][106225] Updated weights for policy 1, policy_version 1680167 (0.0008) [2023-12-28 07:18:30,153][106226] Updated weights for policy 0, policy_version 1676223 (0.0006) [2023-12-28 07:18:30,212][106226] Updated weights for policy 0, policy_version 1676233 (0.0005) [2023-12-28 07:18:30,285][106226] Updated weights for policy 0, policy_version 1676243 (0.0005) [2023-12-28 07:18:30,559][106225] Updated weights for policy 1, policy_version 1680177 (0.0010) [2023-12-28 07:18:30,625][106225] Updated weights for policy 1, policy_version 1680187 (0.0010) [2023-12-28 07:18:30,681][106225] Updated weights for policy 1, policy_version 1680197 (0.0010) [2023-12-28 07:18:30,863][106226] Updated weights for policy 0, policy_version 1676253 (0.0006) [2023-12-28 07:18:30,912][106226] Updated weights for policy 0, policy_version 1676263 (0.0005) [2023-12-28 07:18:30,964][106226] Updated weights for policy 0, policy_version 1676273 (0.0005) [2023-12-28 07:18:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 859389952. Throughput: 0: 9737.4, 1: 9969.0. Samples: 859377892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:31,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-5.090')] [2023-12-28 07:18:31,429][106225] Updated weights for policy 1, policy_version 1680207 (0.0009) [2023-12-28 07:18:31,498][106225] Updated weights for policy 1, policy_version 1680217 (0.0009) [2023-12-28 07:18:31,559][106225] Updated weights for policy 1, policy_version 1680227 (0.0008) [2023-12-28 07:18:31,580][106226] Updated weights for policy 0, policy_version 1676283 (0.0007) [2023-12-28 07:18:31,659][106226] Updated weights for policy 0, policy_version 1676293 (0.0009) [2023-12-28 07:18:31,705][106226] Updated weights for policy 0, policy_version 1676303 (0.0008) [2023-12-28 07:18:32,292][106225] Updated weights for policy 1, policy_version 1680237 (0.0008) [2023-12-28 07:18:32,354][106226] Updated weights for policy 0, policy_version 1676313 (0.0009) [2023-12-28 07:18:32,354][106225] Updated weights for policy 1, policy_version 1680247 (0.0011) [2023-12-28 07:18:32,409][106225] Updated weights for policy 1, policy_version 1680257 (0.0008) [2023-12-28 07:18:32,411][106226] Updated weights for policy 0, policy_version 1676323 (0.0007) [2023-12-28 07:18:32,467][106226] Updated weights for policy 0, policy_version 1676333 (0.0007) [2023-12-28 07:18:32,527][106226] Updated weights for policy 0, policy_version 1676343 (0.0008) [2023-12-28 07:18:33,141][106225] Updated weights for policy 1, policy_version 1680267 (0.0007) [2023-12-28 07:18:33,197][106225] Updated weights for policy 1, policy_version 1680277 (0.0005) [2023-12-28 07:18:33,202][106226] Updated weights for policy 0, policy_version 1676353 (0.0005) [2023-12-28 07:18:33,243][106225] Updated weights for policy 1, policy_version 1680287 (0.0008) [2023-12-28 07:18:33,261][106226] Updated weights for policy 0, policy_version 1676363 (0.0005) [2023-12-28 07:18:33,318][106226] Updated weights for policy 0, policy_version 1676373 (0.0005) [2023-12-28 07:18:33,908][106226] Updated weights for policy 0, policy_version 1676383 (0.0007) [2023-12-28 07:18:33,942][106225] Updated weights for policy 1, policy_version 1680297 (0.0008) [2023-12-28 07:18:33,971][106226] Updated weights for policy 0, policy_version 1676393 (0.0007) [2023-12-28 07:18:33,997][106225] Updated weights for policy 1, policy_version 1680307 (0.0006) [2023-12-28 07:18:34,026][106226] Updated weights for policy 0, policy_version 1676403 (0.0006) [2023-12-28 07:18:34,052][106225] Updated weights for policy 1, policy_version 1680317 (0.0006) [2023-12-28 07:18:34,100][106225] Updated weights for policy 1, policy_version 1680327 (0.0008) [2023-12-28 07:18:34,706][106226] Updated weights for policy 0, policy_version 1676413 (0.0008) [2023-12-28 07:18:34,765][106226] Updated weights for policy 0, policy_version 1676423 (0.0008) [2023-12-28 07:18:34,823][106226] Updated weights for policy 0, policy_version 1676433 (0.0006) [2023-12-28 07:18:34,864][106225] Updated weights for policy 1, policy_version 1680337 (0.0009) [2023-12-28 07:18:34,912][106225] Updated weights for policy 1, policy_version 1680347 (0.0008) [2023-12-28 07:18:34,976][106225] Updated weights for policy 1, policy_version 1680357 (0.0005) [2023-12-28 07:18:35,480][106226] Updated weights for policy 0, policy_version 1676443 (0.0006) [2023-12-28 07:18:35,521][106225] Updated weights for policy 1, policy_version 1680367 (0.0005) [2023-12-28 07:18:35,552][106226] Updated weights for policy 0, policy_version 1676453 (0.0007) [2023-12-28 07:18:35,574][106225] Updated weights for policy 1, policy_version 1680377 (0.0005) [2023-12-28 07:18:35,614][106226] Updated weights for policy 0, policy_version 1676463 (0.0008) [2023-12-28 07:18:35,624][106225] Updated weights for policy 1, policy_version 1680387 (0.0005) [2023-12-28 07:18:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 859488256. Throughput: 0: 9847.6, 1: 9965.3. Samples: 859500104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:36,175][105115] Avg episode reward: [(0, '-4.197'), (1, '-4.685')] [2023-12-28 07:18:36,249][106225] Updated weights for policy 1, policy_version 1680397 (0.0007) [2023-12-28 07:18:36,307][106225] Updated weights for policy 1, policy_version 1680407 (0.0008) [2023-12-28 07:18:36,329][106226] Updated weights for policy 0, policy_version 1676473 (0.0011) [2023-12-28 07:18:36,365][106225] Updated weights for policy 1, policy_version 1680417 (0.0007) [2023-12-28 07:18:36,393][106226] Updated weights for policy 0, policy_version 1676483 (0.0011) [2023-12-28 07:18:36,458][106226] Updated weights for policy 0, policy_version 1676493 (0.0011) [2023-12-28 07:18:36,530][106226] Updated weights for policy 0, policy_version 1676503 (0.0011) [2023-12-28 07:18:37,037][106225] Updated weights for policy 1, policy_version 1680427 (0.0006) [2023-12-28 07:18:37,099][106225] Updated weights for policy 1, policy_version 1680437 (0.0007) [2023-12-28 07:18:37,161][106225] Updated weights for policy 1, policy_version 1680447 (0.0005) [2023-12-28 07:18:37,221][106226] Updated weights for policy 0, policy_version 1676513 (0.0006) [2023-12-28 07:18:37,270][106226] Updated weights for policy 0, policy_version 1676523 (0.0005) [2023-12-28 07:18:37,323][106226] Updated weights for policy 0, policy_version 1676533 (0.0005) [2023-12-28 07:18:37,805][106225] Updated weights for policy 1, policy_version 1680457 (0.0006) [2023-12-28 07:18:37,848][106225] Updated weights for policy 1, policy_version 1680467 (0.0007) [2023-12-28 07:18:37,895][106225] Updated weights for policy 1, policy_version 1680477 (0.0008) [2023-12-28 07:18:37,945][106225] Updated weights for policy 1, policy_version 1680487 (0.0007) [2023-12-28 07:18:37,981][106226] Updated weights for policy 0, policy_version 1676543 (0.0009) [2023-12-28 07:18:38,029][106226] Updated weights for policy 0, policy_version 1676553 (0.0009) [2023-12-28 07:18:38,082][106226] Updated weights for policy 0, policy_version 1676563 (0.0009) [2023-12-28 07:18:38,720][106225] Updated weights for policy 1, policy_version 1680497 (0.0008) [2023-12-28 07:18:38,778][106225] Updated weights for policy 1, policy_version 1680507 (0.0009) [2023-12-28 07:18:38,827][106225] Updated weights for policy 1, policy_version 1680517 (0.0009) [2023-12-28 07:18:38,875][106226] Updated weights for policy 0, policy_version 1676573 (0.0009) [2023-12-28 07:18:38,925][106226] Updated weights for policy 0, policy_version 1676583 (0.0008) [2023-12-28 07:18:38,976][106226] Updated weights for policy 0, policy_version 1676593 (0.0009) [2023-12-28 07:18:39,578][106225] Updated weights for policy 1, policy_version 1680527 (0.0006) [2023-12-28 07:18:39,639][106225] Updated weights for policy 1, policy_version 1680537 (0.0006) [2023-12-28 07:18:39,701][106225] Updated weights for policy 1, policy_version 1680547 (0.0006) [2023-12-28 07:18:39,776][106226] Updated weights for policy 0, policy_version 1676603 (0.0009) [2023-12-28 07:18:39,834][106226] Updated weights for policy 0, policy_version 1676613 (0.0009) [2023-12-28 07:18:39,903][106226] Updated weights for policy 0, policy_version 1676623 (0.0009) [2023-12-28 07:18:40,380][106225] Updated weights for policy 1, policy_version 1680557 (0.0009) [2023-12-28 07:18:40,445][106225] Updated weights for policy 1, policy_version 1680567 (0.0011) [2023-12-28 07:18:40,502][106225] Updated weights for policy 1, policy_version 1680577 (0.0010) [2023-12-28 07:18:40,652][106226] Updated weights for policy 0, policy_version 1676633 (0.0008) [2023-12-28 07:18:40,718][106226] Updated weights for policy 0, policy_version 1676643 (0.0006) [2023-12-28 07:18:40,780][106226] Updated weights for policy 0, policy_version 1676653 (0.0005) [2023-12-28 07:18:40,833][106226] Updated weights for policy 0, policy_version 1676663 (0.0005) [2023-12-28 07:18:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 859586560. Throughput: 0: 9852.5, 1: 9963.6. Samples: 859559820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:41,175][105115] Avg episode reward: [(0, '-4.637'), (1, '-4.807')] [2023-12-28 07:18:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001676664_429301760.pth... [2023-12-28 07:18:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001680584_430284800.pth... [2023-12-28 07:18:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001675512_429006848.pth [2023-12-28 07:18:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001679464_429998080.pth [2023-12-28 07:18:41,275][106225] Updated weights for policy 1, policy_version 1680587 (0.0009) [2023-12-28 07:18:41,330][106225] Updated weights for policy 1, policy_version 1680597 (0.0010) [2023-12-28 07:18:41,396][106225] Updated weights for policy 1, policy_version 1680607 (0.0009) [2023-12-28 07:18:41,472][106226] Updated weights for policy 0, policy_version 1676673 (0.0009) [2023-12-28 07:18:41,525][106226] Updated weights for policy 0, policy_version 1676683 (0.0008) [2023-12-28 07:18:41,581][106226] Updated weights for policy 0, policy_version 1676693 (0.0009) [2023-12-28 07:18:42,110][106225] Updated weights for policy 1, policy_version 1680617 (0.0008) [2023-12-28 07:18:42,167][106225] Updated weights for policy 1, policy_version 1680627 (0.0006) [2023-12-28 07:18:42,233][106225] Updated weights for policy 1, policy_version 1680637 (0.0006) [2023-12-28 07:18:42,299][106225] Updated weights for policy 1, policy_version 1680647 (0.0007) [2023-12-28 07:18:42,420][106226] Updated weights for policy 0, policy_version 1676703 (0.0008) [2023-12-28 07:18:42,490][106226] Updated weights for policy 0, policy_version 1676713 (0.0006) [2023-12-28 07:18:42,550][106226] Updated weights for policy 0, policy_version 1676723 (0.0006) [2023-12-28 07:18:42,923][106225] Updated weights for policy 1, policy_version 1680657 (0.0009) [2023-12-28 07:18:42,993][106225] Updated weights for policy 1, policy_version 1680667 (0.0009) [2023-12-28 07:18:43,045][106225] Updated weights for policy 1, policy_version 1680677 (0.0009) [2023-12-28 07:18:43,174][106226] Updated weights for policy 0, policy_version 1676733 (0.0007) [2023-12-28 07:18:43,239][106226] Updated weights for policy 0, policy_version 1676743 (0.0007) [2023-12-28 07:18:43,308][106226] Updated weights for policy 0, policy_version 1676753 (0.0005) [2023-12-28 07:18:43,660][106225] Updated weights for policy 1, policy_version 1680687 (0.0010) [2023-12-28 07:18:43,720][106225] Updated weights for policy 1, policy_version 1680697 (0.0010) [2023-12-28 07:18:43,780][106225] Updated weights for policy 1, policy_version 1680707 (0.0010) [2023-12-28 07:18:43,894][106226] Updated weights for policy 0, policy_version 1676763 (0.0009) [2023-12-28 07:18:43,948][106226] Updated weights for policy 0, policy_version 1676773 (0.0005) [2023-12-28 07:18:43,996][106226] Updated weights for policy 0, policy_version 1676783 (0.0006) [2023-12-28 07:18:44,491][106225] Updated weights for policy 1, policy_version 1680717 (0.0010) [2023-12-28 07:18:44,544][106225] Updated weights for policy 1, policy_version 1680727 (0.0010) [2023-12-28 07:18:44,597][106225] Updated weights for policy 1, policy_version 1680737 (0.0010) [2023-12-28 07:18:44,688][106226] Updated weights for policy 0, policy_version 1676793 (0.0008) [2023-12-28 07:18:44,748][106226] Updated weights for policy 0, policy_version 1676803 (0.0008) [2023-12-28 07:18:44,813][106226] Updated weights for policy 0, policy_version 1676813 (0.0007) [2023-12-28 07:18:44,881][106226] Updated weights for policy 0, policy_version 1676824 (0.0009) [2023-12-28 07:18:45,343][106225] Updated weights for policy 1, policy_version 1680747 (0.0010) [2023-12-28 07:18:45,405][106225] Updated weights for policy 1, policy_version 1680757 (0.0010) [2023-12-28 07:18:45,458][106225] Updated weights for policy 1, policy_version 1680767 (0.0005) [2023-12-28 07:18:45,581][106226] Updated weights for policy 0, policy_version 1676834 (0.0008) [2023-12-28 07:18:45,630][106226] Updated weights for policy 0, policy_version 1676844 (0.0008) [2023-12-28 07:18:45,679][106226] Updated weights for policy 0, policy_version 1676854 (0.0007) [2023-12-28 07:18:46,117][106225] Updated weights for policy 1, policy_version 1680777 (0.0008) [2023-12-28 07:18:46,173][106225] Updated weights for policy 1, policy_version 1680787 (0.0005) [2023-12-28 07:18:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 859684864. Throughput: 0: 9862.1, 1: 9903.7. Samples: 859677708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:46,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-5.091')] [2023-12-28 07:18:46,233][106225] Updated weights for policy 1, policy_version 1680797 (0.0006) [2023-12-28 07:18:46,292][106225] Updated weights for policy 1, policy_version 1680807 (0.0010) [2023-12-28 07:18:46,327][106226] Updated weights for policy 0, policy_version 1676864 (0.0008) [2023-12-28 07:18:46,373][106226] Updated weights for policy 0, policy_version 1676874 (0.0008) [2023-12-28 07:18:46,419][106226] Updated weights for policy 0, policy_version 1676884 (0.0008) [2023-12-28 07:18:46,881][106225] Updated weights for policy 1, policy_version 1680817 (0.0010) [2023-12-28 07:18:46,928][106225] Updated weights for policy 1, policy_version 1680827 (0.0010) [2023-12-28 07:18:46,976][106225] Updated weights for policy 1, policy_version 1680837 (0.0008) [2023-12-28 07:18:47,226][106226] Updated weights for policy 0, policy_version 1676894 (0.0008) [2023-12-28 07:18:47,281][106226] Updated weights for policy 0, policy_version 1676904 (0.0009) [2023-12-28 07:18:47,337][106226] Updated weights for policy 0, policy_version 1676914 (0.0009) [2023-12-28 07:18:47,612][106225] Updated weights for policy 1, policy_version 1680847 (0.0007) [2023-12-28 07:18:47,671][106225] Updated weights for policy 1, policy_version 1680857 (0.0006) [2023-12-28 07:18:47,731][106225] Updated weights for policy 1, policy_version 1680867 (0.0006) [2023-12-28 07:18:48,028][106226] Updated weights for policy 0, policy_version 1676924 (0.0008) [2023-12-28 07:18:48,084][106226] Updated weights for policy 0, policy_version 1676934 (0.0009) [2023-12-28 07:18:48,136][106226] Updated weights for policy 0, policy_version 1676944 (0.0008) [2023-12-28 07:18:48,352][106225] Updated weights for policy 1, policy_version 1680877 (0.0007) [2023-12-28 07:18:48,419][106225] Updated weights for policy 1, policy_version 1680887 (0.0010) [2023-12-28 07:18:48,476][106225] Updated weights for policy 1, policy_version 1680897 (0.0010) [2023-12-28 07:18:48,845][106226] Updated weights for policy 0, policy_version 1676954 (0.0008) [2023-12-28 07:18:48,907][106226] Updated weights for policy 0, policy_version 1676964 (0.0008) [2023-12-28 07:18:48,963][106226] Updated weights for policy 0, policy_version 1676974 (0.0008) [2023-12-28 07:18:49,023][106226] Updated weights for policy 0, policy_version 1676984 (0.0008) [2023-12-28 07:18:49,187][106225] Updated weights for policy 1, policy_version 1680907 (0.0010) [2023-12-28 07:18:49,253][106225] Updated weights for policy 1, policy_version 1680917 (0.0009) [2023-12-28 07:18:49,320][106225] Updated weights for policy 1, policy_version 1680927 (0.0011) [2023-12-28 07:18:49,677][106226] Updated weights for policy 0, policy_version 1676994 (0.0006) [2023-12-28 07:18:49,730][106226] Updated weights for policy 0, policy_version 1677004 (0.0008) [2023-12-28 07:18:49,788][106226] Updated weights for policy 0, policy_version 1677014 (0.0010) [2023-12-28 07:18:49,986][106225] Updated weights for policy 1, policy_version 1680937 (0.0009) [2023-12-28 07:18:50,046][106225] Updated weights for policy 1, policy_version 1680947 (0.0011) [2023-12-28 07:18:50,108][106225] Updated weights for policy 1, policy_version 1680957 (0.0011) [2023-12-28 07:18:50,172][106225] Updated weights for policy 1, policy_version 1680967 (0.0008) [2023-12-28 07:18:50,627][106226] Updated weights for policy 0, policy_version 1677024 (0.0008) [2023-12-28 07:18:50,686][106226] Updated weights for policy 0, policy_version 1677034 (0.0010) [2023-12-28 07:18:50,742][106226] Updated weights for policy 0, policy_version 1677044 (0.0009) [2023-12-28 07:18:50,763][106225] Updated weights for policy 1, policy_version 1680977 (0.0007) [2023-12-28 07:18:50,829][106225] Updated weights for policy 1, policy_version 1680987 (0.0009) [2023-12-28 07:18:50,893][106225] Updated weights for policy 1, policy_version 1680997 (0.0009) [2023-12-28 07:18:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 859791360. Throughput: 0: 9802.6, 1: 10000.3. Samples: 859798776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:51,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.904')] [2023-12-28 07:18:51,529][106226] Updated weights for policy 0, policy_version 1677054 (0.0010) [2023-12-28 07:18:51,590][106226] Updated weights for policy 0, policy_version 1677064 (0.0008) [2023-12-28 07:18:51,592][106225] Updated weights for policy 1, policy_version 1681007 (0.0009) [2023-12-28 07:18:51,657][106226] Updated weights for policy 0, policy_version 1677074 (0.0008) [2023-12-28 07:18:51,659][106225] Updated weights for policy 1, policy_version 1681017 (0.0009) [2023-12-28 07:18:51,727][106225] Updated weights for policy 1, policy_version 1681027 (0.0011) [2023-12-28 07:18:52,458][106225] Updated weights for policy 1, policy_version 1681037 (0.0009) [2023-12-28 07:18:52,470][106226] Updated weights for policy 0, policy_version 1677084 (0.0007) [2023-12-28 07:18:52,521][106225] Updated weights for policy 1, policy_version 1681047 (0.0010) [2023-12-28 07:18:52,535][106226] Updated weights for policy 0, policy_version 1677094 (0.0007) [2023-12-28 07:18:52,579][106225] Updated weights for policy 1, policy_version 1681057 (0.0010) [2023-12-28 07:18:52,594][106226] Updated weights for policy 0, policy_version 1677104 (0.0007) [2023-12-28 07:18:53,292][106225] Updated weights for policy 1, policy_version 1681067 (0.0009) [2023-12-28 07:18:53,319][106226] Updated weights for policy 0, policy_version 1677114 (0.0007) [2023-12-28 07:18:53,354][106225] Updated weights for policy 1, policy_version 1681077 (0.0009) [2023-12-28 07:18:53,368][106226] Updated weights for policy 0, policy_version 1677124 (0.0007) [2023-12-28 07:18:53,412][106225] Updated weights for policy 1, policy_version 1681087 (0.0008) [2023-12-28 07:18:53,420][106226] Updated weights for policy 0, policy_version 1677134 (0.0009) [2023-12-28 07:18:53,470][106226] Updated weights for policy 0, policy_version 1677144 (0.0008) [2023-12-28 07:18:53,965][106225] Updated weights for policy 1, policy_version 1681097 (0.0005) [2023-12-28 07:18:54,020][106225] Updated weights for policy 1, policy_version 1681107 (0.0008) [2023-12-28 07:18:54,081][106225] Updated weights for policy 1, policy_version 1681117 (0.0008) [2023-12-28 07:18:54,146][106225] Updated weights for policy 1, policy_version 1681127 (0.0008) [2023-12-28 07:18:54,275][106226] Updated weights for policy 0, policy_version 1677154 (0.0005) [2023-12-28 07:18:54,339][106226] Updated weights for policy 0, policy_version 1677164 (0.0006) [2023-12-28 07:18:54,400][106226] Updated weights for policy 0, policy_version 1677174 (0.0008) [2023-12-28 07:18:54,770][106225] Updated weights for policy 1, policy_version 1681137 (0.0005) [2023-12-28 07:18:54,826][106225] Updated weights for policy 1, policy_version 1681147 (0.0005) [2023-12-28 07:18:54,889][106225] Updated weights for policy 1, policy_version 1681157 (0.0006) [2023-12-28 07:18:55,106][106226] Updated weights for policy 0, policy_version 1677184 (0.0008) [2023-12-28 07:18:55,158][106226] Updated weights for policy 0, policy_version 1677194 (0.0008) [2023-12-28 07:18:55,215][106226] Updated weights for policy 0, policy_version 1677204 (0.0008) [2023-12-28 07:18:55,596][106225] Updated weights for policy 1, policy_version 1681167 (0.0008) [2023-12-28 07:18:55,650][106225] Updated weights for policy 1, policy_version 1681177 (0.0008) [2023-12-28 07:18:55,698][106225] Updated weights for policy 1, policy_version 1681187 (0.0006) [2023-12-28 07:18:55,950][106226] Updated weights for policy 0, policy_version 1677214 (0.0009) [2023-12-28 07:18:56,004][106226] Updated weights for policy 0, policy_version 1677224 (0.0008) [2023-12-28 07:18:56,050][106226] Updated weights for policy 0, policy_version 1677234 (0.0007) [2023-12-28 07:18:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 859889664. Throughput: 0: 9724.2, 1: 9918.2. Samples: 859854860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:18:56,175][105115] Avg episode reward: [(0, '-4.643'), (1, '-4.980')] [2023-12-28 07:18:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001681192_430440448.pth... [2023-12-28 07:18:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001677240_429449216.pth... [2023-12-28 07:18:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001680040_430145536.pth [2023-12-28 07:18:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001676056_429146112.pth [2023-12-28 07:18:56,287][106225] Updated weights for policy 1, policy_version 1681197 (0.0008) [2023-12-28 07:18:56,339][106225] Updated weights for policy 1, policy_version 1681207 (0.0010) [2023-12-28 07:18:56,393][106225] Updated weights for policy 1, policy_version 1681217 (0.0009) [2023-12-28 07:18:56,814][106226] Updated weights for policy 0, policy_version 1677244 (0.0010) [2023-12-28 07:18:56,861][106226] Updated weights for policy 0, policy_version 1677254 (0.0007) [2023-12-28 07:18:56,917][106226] Updated weights for policy 0, policy_version 1677264 (0.0008) [2023-12-28 07:18:56,979][106225] Updated weights for policy 1, policy_version 1681227 (0.0009) [2023-12-28 07:18:57,034][106225] Updated weights for policy 1, policy_version 1681237 (0.0010) [2023-12-28 07:18:57,090][106225] Updated weights for policy 1, policy_version 1681247 (0.0010) [2023-12-28 07:18:57,658][106225] Updated weights for policy 1, policy_version 1681257 (0.0010) [2023-12-28 07:18:57,667][106226] Updated weights for policy 0, policy_version 1677274 (0.0006) [2023-12-28 07:18:57,715][106225] Updated weights for policy 1, policy_version 1681267 (0.0010) [2023-12-28 07:18:57,724][106226] Updated weights for policy 0, policy_version 1677284 (0.0006) [2023-12-28 07:18:57,767][106225] Updated weights for policy 1, policy_version 1681277 (0.0010) [2023-12-28 07:18:57,780][106226] Updated weights for policy 0, policy_version 1677294 (0.0005) [2023-12-28 07:18:57,813][106225] Updated weights for policy 1, policy_version 1681287 (0.0010) [2023-12-28 07:18:57,830][106226] Updated weights for policy 0, policy_version 1677304 (0.0006) [2023-12-28 07:18:58,526][106225] Updated weights for policy 1, policy_version 1681297 (0.0010) [2023-12-28 07:18:58,595][106225] Updated weights for policy 1, policy_version 1681307 (0.0011) [2023-12-28 07:18:58,605][106226] Updated weights for policy 0, policy_version 1677314 (0.0007) [2023-12-28 07:18:58,658][106225] Updated weights for policy 1, policy_version 1681317 (0.0008) [2023-12-28 07:18:58,670][106226] Updated weights for policy 0, policy_version 1677324 (0.0007) [2023-12-28 07:18:58,735][106226] Updated weights for policy 0, policy_version 1677334 (0.0007) [2023-12-28 07:18:59,435][106225] Updated weights for policy 1, policy_version 1681327 (0.0007) [2023-12-28 07:18:59,492][106225] Updated weights for policy 1, policy_version 1681337 (0.0009) [2023-12-28 07:18:59,550][106225] Updated weights for policy 1, policy_version 1681347 (0.0008) [2023-12-28 07:18:59,601][106226] Updated weights for policy 0, policy_version 1677344 (0.0008) [2023-12-28 07:18:59,665][106226] Updated weights for policy 0, policy_version 1677354 (0.0008) [2023-12-28 07:18:59,725][106226] Updated weights for policy 0, policy_version 1677364 (0.0007) [2023-12-28 07:19:00,287][106225] Updated weights for policy 1, policy_version 1681357 (0.0008) [2023-12-28 07:19:00,353][106225] Updated weights for policy 1, policy_version 1681367 (0.0009) [2023-12-28 07:19:00,415][106225] Updated weights for policy 1, policy_version 1681377 (0.0008) [2023-12-28 07:19:00,428][106226] Updated weights for policy 0, policy_version 1677374 (0.0007) [2023-12-28 07:19:00,486][106226] Updated weights for policy 0, policy_version 1677384 (0.0007) [2023-12-28 07:19:00,545][106226] Updated weights for policy 0, policy_version 1677394 (0.0006) [2023-12-28 07:19:01,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 859979776. Throughput: 0: 9713.9, 1: 10012.8. Samples: 859973092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:01,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.793')] [2023-12-28 07:19:01,188][106226] Updated weights for policy 0, policy_version 1677404 (0.0007) [2023-12-28 07:19:01,190][106225] Updated weights for policy 1, policy_version 1681387 (0.0008) [2023-12-28 07:19:01,253][106225] Updated weights for policy 1, policy_version 1681397 (0.0006) [2023-12-28 07:19:01,255][106226] Updated weights for policy 0, policy_version 1677414 (0.0006) [2023-12-28 07:19:01,318][106226] Updated weights for policy 0, policy_version 1677424 (0.0008) [2023-12-28 07:19:01,318][106225] Updated weights for policy 1, policy_version 1681407 (0.0008) [2023-12-28 07:19:02,061][106226] Updated weights for policy 0, policy_version 1677434 (0.0008) [2023-12-28 07:19:02,087][106225] Updated weights for policy 1, policy_version 1681417 (0.0007) [2023-12-28 07:19:02,116][106226] Updated weights for policy 0, policy_version 1677444 (0.0007) [2023-12-28 07:19:02,155][106225] Updated weights for policy 1, policy_version 1681427 (0.0005) [2023-12-28 07:19:02,177][106226] Updated weights for policy 0, policy_version 1677454 (0.0006) [2023-12-28 07:19:02,226][106225] Updated weights for policy 1, policy_version 1681437 (0.0009) [2023-12-28 07:19:02,243][106226] Updated weights for policy 0, policy_version 1677464 (0.0006) [2023-12-28 07:19:02,290][106225] Updated weights for policy 1, policy_version 1681447 (0.0007) [2023-12-28 07:19:02,938][106226] Updated weights for policy 0, policy_version 1677474 (0.0008) [2023-12-28 07:19:02,994][106226] Updated weights for policy 0, policy_version 1677484 (0.0007) [2023-12-28 07:19:03,007][106225] Updated weights for policy 1, policy_version 1681457 (0.0006) [2023-12-28 07:19:03,051][106226] Updated weights for policy 0, policy_version 1677494 (0.0008) [2023-12-28 07:19:03,072][106225] Updated weights for policy 1, policy_version 1681467 (0.0006) [2023-12-28 07:19:03,116][106225] Updated weights for policy 1, policy_version 1681477 (0.0005) [2023-12-28 07:19:03,626][106225] Updated weights for policy 1, policy_version 1681487 (0.0005) [2023-12-28 07:19:03,678][106225] Updated weights for policy 1, policy_version 1681497 (0.0007) [2023-12-28 07:19:03,730][106225] Updated weights for policy 1, policy_version 1681507 (0.0008) [2023-12-28 07:19:03,828][106226] Updated weights for policy 0, policy_version 1677504 (0.0008) [2023-12-28 07:19:03,891][106226] Updated weights for policy 0, policy_version 1677514 (0.0008) [2023-12-28 07:19:03,954][106226] Updated weights for policy 0, policy_version 1677524 (0.0008) [2023-12-28 07:19:04,452][106225] Updated weights for policy 1, policy_version 1681517 (0.0008) [2023-12-28 07:19:04,510][106225] Updated weights for policy 1, policy_version 1681527 (0.0008) [2023-12-28 07:19:04,558][106225] Updated weights for policy 1, policy_version 1681537 (0.0008) [2023-12-28 07:19:04,670][106226] Updated weights for policy 0, policy_version 1677534 (0.0009) [2023-12-28 07:19:04,717][106226] Updated weights for policy 0, policy_version 1677544 (0.0008) [2023-12-28 07:19:04,766][106226] Updated weights for policy 0, policy_version 1677554 (0.0008) [2023-12-28 07:19:05,258][106225] Updated weights for policy 1, policy_version 1681547 (0.0008) [2023-12-28 07:19:05,310][106225] Updated weights for policy 1, policy_version 1681557 (0.0005) [2023-12-28 07:19:05,364][106225] Updated weights for policy 1, policy_version 1681567 (0.0007) [2023-12-28 07:19:05,513][106226] Updated weights for policy 0, policy_version 1677564 (0.0008) [2023-12-28 07:19:05,575][106226] Updated weights for policy 0, policy_version 1677574 (0.0008) [2023-12-28 07:19:05,637][106226] Updated weights for policy 0, policy_version 1677584 (0.0008) [2023-12-28 07:19:06,012][106225] Updated weights for policy 1, policy_version 1681577 (0.0007) [2023-12-28 07:19:06,070][106225] Updated weights for policy 1, policy_version 1681587 (0.0005) [2023-12-28 07:19:06,143][106225] Updated weights for policy 1, policy_version 1681597 (0.0007) [2023-12-28 07:19:06,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 860078080. Throughput: 0: 9765.9, 1: 9989.7. Samples: 860091356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:06,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.932')] [2023-12-28 07:19:06,203][106225] Updated weights for policy 1, policy_version 1681607 (0.0009) [2023-12-28 07:19:06,422][106226] Updated weights for policy 0, policy_version 1677594 (0.0009) [2023-12-28 07:19:06,481][106226] Updated weights for policy 0, policy_version 1677604 (0.0009) [2023-12-28 07:19:06,542][106226] Updated weights for policy 0, policy_version 1677614 (0.0009) [2023-12-28 07:19:06,598][106226] Updated weights for policy 0, policy_version 1677624 (0.0009) [2023-12-28 07:19:06,865][106225] Updated weights for policy 1, policy_version 1681617 (0.0008) [2023-12-28 07:19:06,924][106225] Updated weights for policy 1, policy_version 1681627 (0.0009) [2023-12-28 07:19:06,988][106225] Updated weights for policy 1, policy_version 1681637 (0.0008) [2023-12-28 07:19:07,330][106226] Updated weights for policy 0, policy_version 1677634 (0.0007) [2023-12-28 07:19:07,375][106226] Updated weights for policy 0, policy_version 1677644 (0.0005) [2023-12-28 07:19:07,435][106226] Updated weights for policy 0, policy_version 1677654 (0.0005) [2023-12-28 07:19:07,669][106225] Updated weights for policy 1, policy_version 1681647 (0.0007) [2023-12-28 07:19:07,726][106225] Updated weights for policy 1, policy_version 1681657 (0.0005) [2023-12-28 07:19:07,776][106225] Updated weights for policy 1, policy_version 1681667 (0.0008) [2023-12-28 07:19:08,097][106226] Updated weights for policy 0, policy_version 1677664 (0.0008) [2023-12-28 07:19:08,156][106226] Updated weights for policy 0, policy_version 1677674 (0.0008) [2023-12-28 07:19:08,211][106226] Updated weights for policy 0, policy_version 1677684 (0.0009) [2023-12-28 07:19:08,468][106225] Updated weights for policy 1, policy_version 1681677 (0.0007) [2023-12-28 07:19:08,528][106225] Updated weights for policy 1, policy_version 1681687 (0.0009) [2023-12-28 07:19:08,581][106225] Updated weights for policy 1, policy_version 1681697 (0.0008) [2023-12-28 07:19:08,963][106226] Updated weights for policy 0, policy_version 1677694 (0.0009) [2023-12-28 07:19:09,015][106226] Updated weights for policy 0, policy_version 1677704 (0.0009) [2023-12-28 07:19:09,069][106226] Updated weights for policy 0, policy_version 1677714 (0.0008) [2023-12-28 07:19:09,263][106225] Updated weights for policy 1, policy_version 1681707 (0.0008) [2023-12-28 07:19:09,323][106225] Updated weights for policy 1, policy_version 1681717 (0.0009) [2023-12-28 07:19:09,391][106225] Updated weights for policy 1, policy_version 1681727 (0.0008) [2023-12-28 07:19:09,873][106226] Updated weights for policy 0, policy_version 1677724 (0.0007) [2023-12-28 07:19:09,944][106226] Updated weights for policy 0, policy_version 1677734 (0.0007) [2023-12-28 07:19:10,015][106226] Updated weights for policy 0, policy_version 1677744 (0.0008) [2023-12-28 07:19:10,147][106225] Updated weights for policy 1, policy_version 1681737 (0.0007) [2023-12-28 07:19:10,205][106225] Updated weights for policy 1, policy_version 1681747 (0.0011) [2023-12-28 07:19:10,266][106225] Updated weights for policy 1, policy_version 1681757 (0.0010) [2023-12-28 07:19:10,335][106225] Updated weights for policy 1, policy_version 1681767 (0.0011) [2023-12-28 07:19:10,691][106226] Updated weights for policy 0, policy_version 1677754 (0.0007) [2023-12-28 07:19:10,748][106226] Updated weights for policy 0, policy_version 1677764 (0.0011) [2023-12-28 07:19:10,813][106226] Updated weights for policy 0, policy_version 1677774 (0.0010) [2023-12-28 07:19:10,873][106226] Updated weights for policy 0, policy_version 1677784 (0.0008) [2023-12-28 07:19:11,030][106225] Updated weights for policy 1, policy_version 1681777 (0.0010) [2023-12-28 07:19:11,101][106225] Updated weights for policy 1, policy_version 1681787 (0.0008) [2023-12-28 07:19:11,171][106225] Updated weights for policy 1, policy_version 1681797 (0.0008) [2023-12-28 07:19:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 860176384. Throughput: 0: 9775.9, 1: 10042.4. Samples: 860150584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:11,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.935')] [2023-12-28 07:19:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001677784_429588480.pth... [2023-12-28 07:19:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001676664_429301760.pth [2023-12-28 07:19:11,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001681800_430596096.pth... [2023-12-28 07:19:11,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001680584_430284800.pth [2023-12-28 07:19:11,634][106226] Updated weights for policy 0, policy_version 1677794 (0.0009) [2023-12-28 07:19:11,701][106226] Updated weights for policy 0, policy_version 1677804 (0.0009) [2023-12-28 07:19:11,772][106226] Updated weights for policy 0, policy_version 1677814 (0.0009) [2023-12-28 07:19:11,909][106225] Updated weights for policy 1, policy_version 1681807 (0.0008) [2023-12-28 07:19:11,969][106225] Updated weights for policy 1, policy_version 1681817 (0.0008) [2023-12-28 07:19:12,033][106225] Updated weights for policy 1, policy_version 1681827 (0.0009) [2023-12-28 07:19:12,486][106226] Updated weights for policy 0, policy_version 1677824 (0.0008) [2023-12-28 07:19:12,546][106226] Updated weights for policy 0, policy_version 1677834 (0.0009) [2023-12-28 07:19:12,599][106226] Updated weights for policy 0, policy_version 1677844 (0.0008) [2023-12-28 07:19:12,758][106225] Updated weights for policy 1, policy_version 1681837 (0.0008) [2023-12-28 07:19:12,815][106225] Updated weights for policy 1, policy_version 1681847 (0.0009) [2023-12-28 07:19:12,863][106225] Updated weights for policy 1, policy_version 1681857 (0.0008) [2023-12-28 07:19:13,336][106226] Updated weights for policy 0, policy_version 1677854 (0.0008) [2023-12-28 07:19:13,398][106226] Updated weights for policy 0, policy_version 1677864 (0.0009) [2023-12-28 07:19:13,462][106226] Updated weights for policy 0, policy_version 1677874 (0.0009) [2023-12-28 07:19:13,529][106225] Updated weights for policy 1, policy_version 1681867 (0.0008) [2023-12-28 07:19:13,586][106225] Updated weights for policy 1, policy_version 1681877 (0.0008) [2023-12-28 07:19:13,641][106225] Updated weights for policy 1, policy_version 1681887 (0.0009) [2023-12-28 07:19:14,126][106226] Updated weights for policy 0, policy_version 1677884 (0.0009) [2023-12-28 07:19:14,183][106226] Updated weights for policy 0, policy_version 1677894 (0.0010) [2023-12-28 07:19:14,236][106226] Updated weights for policy 0, policy_version 1677904 (0.0010) [2023-12-28 07:19:14,375][106225] Updated weights for policy 1, policy_version 1681897 (0.0008) [2023-12-28 07:19:14,431][106225] Updated weights for policy 1, policy_version 1681907 (0.0007) [2023-12-28 07:19:14,489][106225] Updated weights for policy 1, policy_version 1681917 (0.0008) [2023-12-28 07:19:14,564][106225] Updated weights for policy 1, policy_version 1681927 (0.0009) [2023-12-28 07:19:14,870][106226] Updated weights for policy 0, policy_version 1677914 (0.0010) [2023-12-28 07:19:14,930][106226] Updated weights for policy 0, policy_version 1677924 (0.0008) [2023-12-28 07:19:14,981][106226] Updated weights for policy 0, policy_version 1677934 (0.0007) [2023-12-28 07:19:15,046][106226] Updated weights for policy 0, policy_version 1677944 (0.0009) [2023-12-28 07:19:15,370][106225] Updated weights for policy 1, policy_version 1681937 (0.0009) [2023-12-28 07:19:15,427][106225] Updated weights for policy 1, policy_version 1681947 (0.0009) [2023-12-28 07:19:15,478][106225] Updated weights for policy 1, policy_version 1681957 (0.0007) [2023-12-28 07:19:15,663][106226] Updated weights for policy 0, policy_version 1677954 (0.0008) [2023-12-28 07:19:15,713][106226] Updated weights for policy 0, policy_version 1677964 (0.0008) [2023-12-28 07:19:15,772][106226] Updated weights for policy 0, policy_version 1677974 (0.0007) [2023-12-28 07:19:16,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 860274688. Throughput: 0: 9674.7, 1: 10052.1. Samples: 860265596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:16,175][105115] Avg episode reward: [(0, '-4.597'), (1, '-5.132')] [2023-12-28 07:19:16,216][106225] Updated weights for policy 1, policy_version 1681967 (0.0009) [2023-12-28 07:19:16,273][106225] Updated weights for policy 1, policy_version 1681977 (0.0010) [2023-12-28 07:19:16,336][106225] Updated weights for policy 1, policy_version 1681987 (0.0008) [2023-12-28 07:19:16,477][106226] Updated weights for policy 0, policy_version 1677984 (0.0008) [2023-12-28 07:19:16,538][106226] Updated weights for policy 0, policy_version 1677994 (0.0008) [2023-12-28 07:19:16,606][106226] Updated weights for policy 0, policy_version 1678004 (0.0009) [2023-12-28 07:19:16,988][106225] Updated weights for policy 1, policy_version 1681997 (0.0007) [2023-12-28 07:19:17,045][106225] Updated weights for policy 1, policy_version 1682007 (0.0006) [2023-12-28 07:19:17,111][106225] Updated weights for policy 1, policy_version 1682017 (0.0005) [2023-12-28 07:19:17,374][106226] Updated weights for policy 0, policy_version 1678014 (0.0008) [2023-12-28 07:19:17,440][106226] Updated weights for policy 0, policy_version 1678024 (0.0009) [2023-12-28 07:19:17,506][106226] Updated weights for policy 0, policy_version 1678034 (0.0009) [2023-12-28 07:19:17,744][106225] Updated weights for policy 1, policy_version 1682027 (0.0006) [2023-12-28 07:19:17,805][106225] Updated weights for policy 1, policy_version 1682037 (0.0009) [2023-12-28 07:19:17,865][106225] Updated weights for policy 1, policy_version 1682047 (0.0008) [2023-12-28 07:19:18,226][106226] Updated weights for policy 0, policy_version 1678044 (0.0007) [2023-12-28 07:19:18,284][106226] Updated weights for policy 0, policy_version 1678054 (0.0005) [2023-12-28 07:19:18,369][106226] Updated weights for policy 0, policy_version 1678064 (0.0007) [2023-12-28 07:19:18,573][106225] Updated weights for policy 1, policy_version 1682057 (0.0009) [2023-12-28 07:19:18,630][106225] Updated weights for policy 1, policy_version 1682067 (0.0008) [2023-12-28 07:19:18,683][106225] Updated weights for policy 1, policy_version 1682077 (0.0007) [2023-12-28 07:19:18,744][106225] Updated weights for policy 1, policy_version 1682087 (0.0008) [2023-12-28 07:19:18,952][106226] Updated weights for policy 0, policy_version 1678074 (0.0010) [2023-12-28 07:19:18,998][106226] Updated weights for policy 0, policy_version 1678084 (0.0005) [2023-12-28 07:19:19,043][106226] Updated weights for policy 0, policy_version 1678094 (0.0005) [2023-12-28 07:19:19,094][106226] Updated weights for policy 0, policy_version 1678104 (0.0010) [2023-12-28 07:19:19,482][106225] Updated weights for policy 1, policy_version 1682097 (0.0008) [2023-12-28 07:19:19,545][106225] Updated weights for policy 1, policy_version 1682107 (0.0009) [2023-12-28 07:19:19,608][106225] Updated weights for policy 1, policy_version 1682117 (0.0008) [2023-12-28 07:19:19,848][106226] Updated weights for policy 0, policy_version 1678114 (0.0007) [2023-12-28 07:19:19,917][106226] Updated weights for policy 0, policy_version 1678124 (0.0010) [2023-12-28 07:19:19,987][106226] Updated weights for policy 0, policy_version 1678134 (0.0008) [2023-12-28 07:19:20,280][106225] Updated weights for policy 1, policy_version 1682127 (0.0008) [2023-12-28 07:19:20,338][106225] Updated weights for policy 1, policy_version 1682137 (0.0008) [2023-12-28 07:19:20,390][106225] Updated weights for policy 1, policy_version 1682147 (0.0008) [2023-12-28 07:19:20,691][106226] Updated weights for policy 0, policy_version 1678144 (0.0009) [2023-12-28 07:19:20,755][106226] Updated weights for policy 0, policy_version 1678154 (0.0009) [2023-12-28 07:19:20,820][106226] Updated weights for policy 0, policy_version 1678164 (0.0007) [2023-12-28 07:19:21,149][106225] Updated weights for policy 1, policy_version 1682157 (0.0008) [2023-12-28 07:19:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 860372992. Throughput: 0: 9589.1, 1: 10054.4. Samples: 860384064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:21,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.812')] [2023-12-28 07:19:21,211][106225] Updated weights for policy 1, policy_version 1682167 (0.0008) [2023-12-28 07:19:21,278][106225] Updated weights for policy 1, policy_version 1682177 (0.0008) [2023-12-28 07:19:21,591][106226] Updated weights for policy 0, policy_version 1678174 (0.0006) [2023-12-28 07:19:21,662][106226] Updated weights for policy 0, policy_version 1678184 (0.0010) [2023-12-28 07:19:21,738][106226] Updated weights for policy 0, policy_version 1678194 (0.0010) [2023-12-28 07:19:22,055][106225] Updated weights for policy 1, policy_version 1682187 (0.0009) [2023-12-28 07:19:22,120][106225] Updated weights for policy 1, policy_version 1682197 (0.0009) [2023-12-28 07:19:22,178][106225] Updated weights for policy 1, policy_version 1682207 (0.0008) [2023-12-28 07:19:22,546][106226] Updated weights for policy 0, policy_version 1678204 (0.0008) [2023-12-28 07:19:22,613][106226] Updated weights for policy 0, policy_version 1678214 (0.0007) [2023-12-28 07:19:22,680][106226] Updated weights for policy 0, policy_version 1678224 (0.0008) [2023-12-28 07:19:22,895][106225] Updated weights for policy 1, policy_version 1682217 (0.0008) [2023-12-28 07:19:22,945][106225] Updated weights for policy 1, policy_version 1682227 (0.0009) [2023-12-28 07:19:23,007][106225] Updated weights for policy 1, policy_version 1682237 (0.0010) [2023-12-28 07:19:23,066][106225] Updated weights for policy 1, policy_version 1682247 (0.0010) [2023-12-28 07:19:23,437][106226] Updated weights for policy 0, policy_version 1678234 (0.0008) [2023-12-28 07:19:23,487][106226] Updated weights for policy 0, policy_version 1678244 (0.0008) [2023-12-28 07:19:23,534][106226] Updated weights for policy 0, policy_version 1678254 (0.0008) [2023-12-28 07:19:23,585][106226] Updated weights for policy 0, policy_version 1678264 (0.0008) [2023-12-28 07:19:23,726][106225] Updated weights for policy 1, policy_version 1682257 (0.0010) [2023-12-28 07:19:23,776][106225] Updated weights for policy 1, policy_version 1682267 (0.0010) [2023-12-28 07:19:23,833][106225] Updated weights for policy 1, policy_version 1682277 (0.0010) [2023-12-28 07:19:24,392][106226] Updated weights for policy 0, policy_version 1678274 (0.0006) [2023-12-28 07:19:24,447][106226] Updated weights for policy 0, policy_version 1678284 (0.0007) [2023-12-28 07:19:24,452][106225] Updated weights for policy 1, policy_version 1682287 (0.0010) [2023-12-28 07:19:24,502][106226] Updated weights for policy 0, policy_version 1678294 (0.0006) [2023-12-28 07:19:24,513][106225] Updated weights for policy 1, policy_version 1682297 (0.0010) [2023-12-28 07:19:24,565][106225] Updated weights for policy 1, policy_version 1682307 (0.0008) [2023-12-28 07:19:25,204][106225] Updated weights for policy 1, policy_version 1682317 (0.0007) [2023-12-28 07:19:25,255][106226] Updated weights for policy 0, policy_version 1678304 (0.0008) [2023-12-28 07:19:25,256][106225] Updated weights for policy 1, policy_version 1682327 (0.0005) [2023-12-28 07:19:25,304][106226] Updated weights for policy 0, policy_version 1678314 (0.0007) [2023-12-28 07:19:25,309][106225] Updated weights for policy 1, policy_version 1682337 (0.0006) [2023-12-28 07:19:25,357][106226] Updated weights for policy 0, policy_version 1678324 (0.0010) [2023-12-28 07:19:25,945][106225] Updated weights for policy 1, policy_version 1682347 (0.0007) [2023-12-28 07:19:26,008][106225] Updated weights for policy 1, policy_version 1682357 (0.0010) [2023-12-28 07:19:26,068][106225] Updated weights for policy 1, policy_version 1682367 (0.0010) [2023-12-28 07:19:26,101][106226] Updated weights for policy 0, policy_version 1678334 (0.0008) [2023-12-28 07:19:26,157][106226] Updated weights for policy 0, policy_version 1678344 (0.0007) [2023-12-28 07:19:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 860471296. Throughput: 0: 9541.5, 1: 10004.8. Samples: 860439404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:26,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-4.730')] [2023-12-28 07:19:26,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001682376_430743552.pth... [2023-12-28 07:19:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001681192_430440448.pth [2023-12-28 07:19:26,214][106226] Updated weights for policy 0, policy_version 1678354 (0.0007) [2023-12-28 07:19:26,246][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001678360_429735936.pth... [2023-12-28 07:19:26,249][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001677240_429449216.pth [2023-12-28 07:19:26,779][106225] Updated weights for policy 1, policy_version 1682377 (0.0010) [2023-12-28 07:19:26,841][106225] Updated weights for policy 1, policy_version 1682387 (0.0010) [2023-12-28 07:19:26,897][106225] Updated weights for policy 1, policy_version 1682397 (0.0007) [2023-12-28 07:19:26,944][106226] Updated weights for policy 0, policy_version 1678364 (0.0009) [2023-12-28 07:19:26,953][106225] Updated weights for policy 1, policy_version 1682407 (0.0007) [2023-12-28 07:19:26,998][106226] Updated weights for policy 0, policy_version 1678374 (0.0008) [2023-12-28 07:19:27,054][106226] Updated weights for policy 0, policy_version 1678384 (0.0006) [2023-12-28 07:19:27,600][106225] Updated weights for policy 1, policy_version 1682417 (0.0006) [2023-12-28 07:19:27,660][106225] Updated weights for policy 1, policy_version 1682427 (0.0008) [2023-12-28 07:19:27,715][106226] Updated weights for policy 0, policy_version 1678394 (0.0008) [2023-12-28 07:19:27,727][106225] Updated weights for policy 1, policy_version 1682437 (0.0009) [2023-12-28 07:19:27,771][106226] Updated weights for policy 0, policy_version 1678404 (0.0005) [2023-12-28 07:19:27,827][106226] Updated weights for policy 0, policy_version 1678414 (0.0005) [2023-12-28 07:19:27,878][106226] Updated weights for policy 0, policy_version 1678424 (0.0005) [2023-12-28 07:19:28,369][106225] Updated weights for policy 1, policy_version 1682447 (0.0008) [2023-12-28 07:19:28,401][106226] Updated weights for policy 0, policy_version 1678434 (0.0006) [2023-12-28 07:19:28,430][106225] Updated weights for policy 1, policy_version 1682457 (0.0007) [2023-12-28 07:19:28,459][106226] Updated weights for policy 0, policy_version 1678444 (0.0006) [2023-12-28 07:19:28,487][106225] Updated weights for policy 1, policy_version 1682467 (0.0007) [2023-12-28 07:19:28,518][106226] Updated weights for policy 0, policy_version 1678454 (0.0005) [2023-12-28 07:19:29,116][106226] Updated weights for policy 0, policy_version 1678464 (0.0005) [2023-12-28 07:19:29,167][106226] Updated weights for policy 0, policy_version 1678474 (0.0007) [2023-12-28 07:19:29,227][106226] Updated weights for policy 0, policy_version 1678484 (0.0009) [2023-12-28 07:19:29,256][106225] Updated weights for policy 1, policy_version 1682477 (0.0009) [2023-12-28 07:19:29,306][106225] Updated weights for policy 1, policy_version 1682487 (0.0008) [2023-12-28 07:19:29,371][106225] Updated weights for policy 1, policy_version 1682497 (0.0008) [2023-12-28 07:19:29,882][106226] Updated weights for policy 0, policy_version 1678494 (0.0008) [2023-12-28 07:19:29,951][106226] Updated weights for policy 0, policy_version 1678504 (0.0006) [2023-12-28 07:19:30,019][106226] Updated weights for policy 0, policy_version 1678514 (0.0005) [2023-12-28 07:19:30,141][106225] Updated weights for policy 1, policy_version 1682507 (0.0008) [2023-12-28 07:19:30,196][106225] Updated weights for policy 1, policy_version 1682517 (0.0006) [2023-12-28 07:19:30,263][106225] Updated weights for policy 1, policy_version 1682527 (0.0006) [2023-12-28 07:19:30,682][106226] Updated weights for policy 0, policy_version 1678524 (0.0007) [2023-12-28 07:19:30,733][106226] Updated weights for policy 0, policy_version 1678534 (0.0007) [2023-12-28 07:19:30,779][106226] Updated weights for policy 0, policy_version 1678544 (0.0005) [2023-12-28 07:19:30,851][106225] Updated weights for policy 1, policy_version 1682537 (0.0006) [2023-12-28 07:19:30,904][106225] Updated weights for policy 1, policy_version 1682547 (0.0005) [2023-12-28 07:19:30,955][106225] Updated weights for policy 1, policy_version 1682557 (0.0005) [2023-12-28 07:19:31,016][106225] Updated weights for policy 1, policy_version 1682567 (0.0006) [2023-12-28 07:19:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 860577792. Throughput: 0: 9608.6, 1: 10055.2. Samples: 860562580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:31,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.652')] [2023-12-28 07:19:31,387][106226] Updated weights for policy 0, policy_version 1678554 (0.0006) [2023-12-28 07:19:31,457][106226] Updated weights for policy 0, policy_version 1678564 (0.0007) [2023-12-28 07:19:31,513][106226] Updated weights for policy 0, policy_version 1678574 (0.0007) [2023-12-28 07:19:31,568][106226] Updated weights for policy 0, policy_version 1678584 (0.0008) [2023-12-28 07:19:31,722][106225] Updated weights for policy 1, policy_version 1682577 (0.0005) [2023-12-28 07:19:31,785][106225] Updated weights for policy 1, policy_version 1682587 (0.0009) [2023-12-28 07:19:31,838][106225] Updated weights for policy 1, policy_version 1682597 (0.0009) [2023-12-28 07:19:32,313][106226] Updated weights for policy 0, policy_version 1678594 (0.0010) [2023-12-28 07:19:32,364][106226] Updated weights for policy 0, policy_version 1678604 (0.0009) [2023-12-28 07:19:32,427][106226] Updated weights for policy 0, policy_version 1678614 (0.0009) [2023-12-28 07:19:32,542][106225] Updated weights for policy 1, policy_version 1682607 (0.0009) [2023-12-28 07:19:32,601][106225] Updated weights for policy 1, policy_version 1682617 (0.0009) [2023-12-28 07:19:32,649][106225] Updated weights for policy 1, policy_version 1682627 (0.0007) [2023-12-28 07:19:33,142][106226] Updated weights for policy 0, policy_version 1678624 (0.0008) [2023-12-28 07:19:33,194][106226] Updated weights for policy 0, policy_version 1678634 (0.0007) [2023-12-28 07:19:33,245][106226] Updated weights for policy 0, policy_version 1678644 (0.0008) [2023-12-28 07:19:33,363][106225] Updated weights for policy 1, policy_version 1682637 (0.0009) [2023-12-28 07:19:33,413][106225] Updated weights for policy 1, policy_version 1682647 (0.0010) [2023-12-28 07:19:33,458][106225] Updated weights for policy 1, policy_version 1682657 (0.0009) [2023-12-28 07:19:33,879][106226] Updated weights for policy 0, policy_version 1678654 (0.0006) [2023-12-28 07:19:33,937][106226] Updated weights for policy 0, policy_version 1678664 (0.0005) [2023-12-28 07:19:33,992][106226] Updated weights for policy 0, policy_version 1678674 (0.0005) [2023-12-28 07:19:34,065][106225] Updated weights for policy 1, policy_version 1682667 (0.0007) [2023-12-28 07:19:34,126][106225] Updated weights for policy 1, policy_version 1682677 (0.0010) [2023-12-28 07:19:34,197][106225] Updated weights for policy 1, policy_version 1682687 (0.0010) [2023-12-28 07:19:34,619][106226] Updated weights for policy 0, policy_version 1678684 (0.0005) [2023-12-28 07:19:34,676][106226] Updated weights for policy 0, policy_version 1678694 (0.0007) [2023-12-28 07:19:34,747][106226] Updated weights for policy 0, policy_version 1678704 (0.0006) [2023-12-28 07:19:34,852][106225] Updated weights for policy 1, policy_version 1682697 (0.0008) [2023-12-28 07:19:34,912][106225] Updated weights for policy 1, policy_version 1682707 (0.0010) [2023-12-28 07:19:34,971][106225] Updated weights for policy 1, policy_version 1682717 (0.0010) [2023-12-28 07:19:35,026][106225] Updated weights for policy 1, policy_version 1682727 (0.0009) [2023-12-28 07:19:35,415][106226] Updated weights for policy 0, policy_version 1678714 (0.0006) [2023-12-28 07:19:35,479][106226] Updated weights for policy 0, policy_version 1678724 (0.0008) [2023-12-28 07:19:35,532][106226] Updated weights for policy 0, policy_version 1678734 (0.0008) [2023-12-28 07:19:35,590][106226] Updated weights for policy 0, policy_version 1678744 (0.0008) [2023-12-28 07:19:35,678][106225] Updated weights for policy 1, policy_version 1682737 (0.0005) [2023-12-28 07:19:35,732][106225] Updated weights for policy 1, policy_version 1682747 (0.0009) [2023-12-28 07:19:35,781][106225] Updated weights for policy 1, policy_version 1682757 (0.0010) [2023-12-28 07:19:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 860676096. Throughput: 0: 9701.1, 1: 10019.0. Samples: 860686176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:36,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.866')] [2023-12-28 07:19:36,283][106226] Updated weights for policy 0, policy_version 1678754 (0.0006) [2023-12-28 07:19:36,346][106226] Updated weights for policy 0, policy_version 1678764 (0.0006) [2023-12-28 07:19:36,410][106226] Updated weights for policy 0, policy_version 1678774 (0.0006) [2023-12-28 07:19:36,456][106225] Updated weights for policy 1, policy_version 1682767 (0.0010) [2023-12-28 07:19:36,525][106225] Updated weights for policy 1, policy_version 1682777 (0.0011) [2023-12-28 07:19:36,591][106225] Updated weights for policy 1, policy_version 1682787 (0.0007) [2023-12-28 07:19:36,949][106226] Updated weights for policy 0, policy_version 1678784 (0.0010) [2023-12-28 07:19:37,003][106226] Updated weights for policy 0, policy_version 1678794 (0.0006) [2023-12-28 07:19:37,069][106226] Updated weights for policy 0, policy_version 1678804 (0.0006) [2023-12-28 07:19:37,241][106225] Updated weights for policy 1, policy_version 1682797 (0.0006) [2023-12-28 07:19:37,304][106225] Updated weights for policy 1, policy_version 1682807 (0.0005) [2023-12-28 07:19:37,360][106225] Updated weights for policy 1, policy_version 1682817 (0.0005) [2023-12-28 07:19:37,650][106226] Updated weights for policy 0, policy_version 1678814 (0.0009) [2023-12-28 07:19:37,716][106226] Updated weights for policy 0, policy_version 1678824 (0.0011) [2023-12-28 07:19:37,770][106226] Updated weights for policy 0, policy_version 1678834 (0.0010) [2023-12-28 07:19:37,966][106225] Updated weights for policy 1, policy_version 1682827 (0.0006) [2023-12-28 07:19:38,017][106225] Updated weights for policy 1, policy_version 1682837 (0.0008) [2023-12-28 07:19:38,065][106225] Updated weights for policy 1, policy_version 1682847 (0.0008) [2023-12-28 07:19:38,511][106226] Updated weights for policy 0, policy_version 1678844 (0.0011) [2023-12-28 07:19:38,575][106226] Updated weights for policy 0, policy_version 1678854 (0.0011) [2023-12-28 07:19:38,635][106226] Updated weights for policy 0, policy_version 1678864 (0.0011) [2023-12-28 07:19:38,822][106225] Updated weights for policy 1, policy_version 1682857 (0.0007) [2023-12-28 07:19:38,890][106225] Updated weights for policy 1, policy_version 1682867 (0.0005) [2023-12-28 07:19:38,953][106225] Updated weights for policy 1, policy_version 1682877 (0.0006) [2023-12-28 07:19:39,010][106225] Updated weights for policy 1, policy_version 1682887 (0.0006) [2023-12-28 07:19:39,346][106226] Updated weights for policy 0, policy_version 1678874 (0.0010) [2023-12-28 07:19:39,415][106226] Updated weights for policy 0, policy_version 1678884 (0.0009) [2023-12-28 07:19:39,496][106226] Updated weights for policy 0, policy_version 1678894 (0.0010) [2023-12-28 07:19:39,553][106226] Updated weights for policy 0, policy_version 1678904 (0.0010) [2023-12-28 07:19:39,754][106225] Updated weights for policy 1, policy_version 1682897 (0.0009) [2023-12-28 07:19:39,807][106225] Updated weights for policy 1, policy_version 1682907 (0.0006) [2023-12-28 07:19:39,881][106225] Updated weights for policy 1, policy_version 1682917 (0.0008) [2023-12-28 07:19:40,246][106226] Updated weights for policy 0, policy_version 1678914 (0.0009) [2023-12-28 07:19:40,304][106226] Updated weights for policy 0, policy_version 1678924 (0.0009) [2023-12-28 07:19:40,371][106226] Updated weights for policy 0, policy_version 1678934 (0.0007) [2023-12-28 07:19:40,574][106225] Updated weights for policy 1, policy_version 1682927 (0.0009) [2023-12-28 07:19:40,632][106225] Updated weights for policy 1, policy_version 1682937 (0.0008) [2023-12-28 07:19:40,686][106225] Updated weights for policy 1, policy_version 1682947 (0.0006) [2023-12-28 07:19:41,064][106226] Updated weights for policy 0, policy_version 1678944 (0.0009) [2023-12-28 07:19:41,124][106226] Updated weights for policy 0, policy_version 1678954 (0.0008) [2023-12-28 07:19:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 860774400. Throughput: 0: 9815.0, 1: 10048.3. Samples: 860748708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:41,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.787')] [2023-12-28 07:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001682952_430891008.pth... [2023-12-28 07:19:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001681800_430596096.pth [2023-12-28 07:19:41,194][106226] Updated weights for policy 0, policy_version 1678964 (0.0009) [2023-12-28 07:19:41,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001678968_429891584.pth... [2023-12-28 07:19:41,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001677784_429588480.pth [2023-12-28 07:19:41,399][106225] Updated weights for policy 1, policy_version 1682957 (0.0007) [2023-12-28 07:19:41,462][106225] Updated weights for policy 1, policy_version 1682967 (0.0008) [2023-12-28 07:19:41,521][106225] Updated weights for policy 1, policy_version 1682977 (0.0008) [2023-12-28 07:19:42,007][106226] Updated weights for policy 0, policy_version 1678974 (0.0009) [2023-12-28 07:19:42,078][106226] Updated weights for policy 0, policy_version 1678984 (0.0008) [2023-12-28 07:19:42,148][106226] Updated weights for policy 0, policy_version 1678994 (0.0010) [2023-12-28 07:19:42,236][106225] Updated weights for policy 1, policy_version 1682987 (0.0008) [2023-12-28 07:19:42,305][106225] Updated weights for policy 1, policy_version 1682997 (0.0009) [2023-12-28 07:19:42,374][106225] Updated weights for policy 1, policy_version 1683007 (0.0008) [2023-12-28 07:19:42,924][106226] Updated weights for policy 0, policy_version 1679004 (0.0009) [2023-12-28 07:19:42,987][106226] Updated weights for policy 0, policy_version 1679014 (0.0009) [2023-12-28 07:19:43,041][106226] Updated weights for policy 0, policy_version 1679024 (0.0008) [2023-12-28 07:19:43,043][106225] Updated weights for policy 1, policy_version 1683017 (0.0008) [2023-12-28 07:19:43,099][106225] Updated weights for policy 1, policy_version 1683027 (0.0008) [2023-12-28 07:19:43,155][106225] Updated weights for policy 1, policy_version 1683037 (0.0009) [2023-12-28 07:19:43,211][106225] Updated weights for policy 1, policy_version 1683047 (0.0009) [2023-12-28 07:19:43,773][106225] Updated weights for policy 1, policy_version 1683057 (0.0007) [2023-12-28 07:19:43,823][106225] Updated weights for policy 1, policy_version 1683067 (0.0005) [2023-12-28 07:19:43,866][106226] Updated weights for policy 0, policy_version 1679034 (0.0009) [2023-12-28 07:19:43,881][106225] Updated weights for policy 1, policy_version 1683077 (0.0010) [2023-12-28 07:19:43,914][106226] Updated weights for policy 0, policy_version 1679044 (0.0008) [2023-12-28 07:19:43,963][106226] Updated weights for policy 0, policy_version 1679054 (0.0008) [2023-12-28 07:19:44,014][106226] Updated weights for policy 0, policy_version 1679064 (0.0009) [2023-12-28 07:19:44,500][106225] Updated weights for policy 1, policy_version 1683087 (0.0007) [2023-12-28 07:19:44,548][106225] Updated weights for policy 1, policy_version 1683097 (0.0005) [2023-12-28 07:19:44,609][106225] Updated weights for policy 1, policy_version 1683107 (0.0008) [2023-12-28 07:19:44,832][106226] Updated weights for policy 0, policy_version 1679074 (0.0007) [2023-12-28 07:19:44,896][106226] Updated weights for policy 0, policy_version 1679084 (0.0006) [2023-12-28 07:19:44,961][106226] Updated weights for policy 0, policy_version 1679094 (0.0008) [2023-12-28 07:19:45,246][106225] Updated weights for policy 1, policy_version 1683117 (0.0008) [2023-12-28 07:19:45,309][106225] Updated weights for policy 1, policy_version 1683127 (0.0010) [2023-12-28 07:19:45,373][106225] Updated weights for policy 1, policy_version 1683137 (0.0010) [2023-12-28 07:19:45,723][106226] Updated weights for policy 0, policy_version 1679104 (0.0008) [2023-12-28 07:19:45,783][106226] Updated weights for policy 0, policy_version 1679114 (0.0010) [2023-12-28 07:19:45,836][106226] Updated weights for policy 0, policy_version 1679124 (0.0007) [2023-12-28 07:19:46,027][106225] Updated weights for policy 1, policy_version 1683147 (0.0010) [2023-12-28 07:19:46,089][106225] Updated weights for policy 1, policy_version 1683157 (0.0010) [2023-12-28 07:19:46,149][106225] Updated weights for policy 1, policy_version 1683167 (0.0010) [2023-12-28 07:19:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 860872704. Throughput: 0: 9796.1, 1: 10008.8. Samples: 860864312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:46,175][105115] Avg episode reward: [(0, '-4.514'), (1, '-4.613')] [2023-12-28 07:19:46,642][106226] Updated weights for policy 0, policy_version 1679134 (0.0008) [2023-12-28 07:19:46,713][106226] Updated weights for policy 0, policy_version 1679144 (0.0008) [2023-12-28 07:19:46,730][106225] Updated weights for policy 1, policy_version 1683177 (0.0010) [2023-12-28 07:19:46,779][106226] Updated weights for policy 0, policy_version 1679154 (0.0006) [2023-12-28 07:19:46,788][106225] Updated weights for policy 1, policy_version 1683187 (0.0010) [2023-12-28 07:19:46,845][106225] Updated weights for policy 1, policy_version 1683197 (0.0006) [2023-12-28 07:19:46,906][106225] Updated weights for policy 1, policy_version 1683207 (0.0005) [2023-12-28 07:19:47,449][106225] Updated weights for policy 1, policy_version 1683217 (0.0005) [2023-12-28 07:19:47,506][106225] Updated weights for policy 1, policy_version 1683227 (0.0005) [2023-12-28 07:19:47,552][106225] Updated weights for policy 1, policy_version 1683237 (0.0005) [2023-12-28 07:19:47,580][106226] Updated weights for policy 0, policy_version 1679164 (0.0008) [2023-12-28 07:19:47,637][106226] Updated weights for policy 0, policy_version 1679174 (0.0008) [2023-12-28 07:19:47,697][106226] Updated weights for policy 0, policy_version 1679184 (0.0009) [2023-12-28 07:19:48,205][106225] Updated weights for policy 1, policy_version 1683247 (0.0009) [2023-12-28 07:19:48,262][106225] Updated weights for policy 1, policy_version 1683257 (0.0010) [2023-12-28 07:19:48,325][106225] Updated weights for policy 1, policy_version 1683267 (0.0010) [2023-12-28 07:19:48,481][106226] Updated weights for policy 0, policy_version 1679194 (0.0008) [2023-12-28 07:19:48,533][106226] Updated weights for policy 0, policy_version 1679204 (0.0010) [2023-12-28 07:19:48,581][106226] Updated weights for policy 0, policy_version 1679214 (0.0008) [2023-12-28 07:19:48,629][106226] Updated weights for policy 0, policy_version 1679224 (0.0007) [2023-12-28 07:19:48,982][106225] Updated weights for policy 1, policy_version 1683277 (0.0008) [2023-12-28 07:19:49,032][106225] Updated weights for policy 1, policy_version 1683287 (0.0008) [2023-12-28 07:19:49,079][106225] Updated weights for policy 1, policy_version 1683297 (0.0008) [2023-12-28 07:19:49,389][106226] Updated weights for policy 0, policy_version 1679234 (0.0010) [2023-12-28 07:19:49,457][106226] Updated weights for policy 0, policy_version 1679244 (0.0011) [2023-12-28 07:19:49,507][106226] Updated weights for policy 0, policy_version 1679254 (0.0010) [2023-12-28 07:19:49,852][106225] Updated weights for policy 1, policy_version 1683307 (0.0007) [2023-12-28 07:19:49,906][106225] Updated weights for policy 1, policy_version 1683317 (0.0008) [2023-12-28 07:19:49,965][106225] Updated weights for policy 1, policy_version 1683327 (0.0008) [2023-12-28 07:19:50,269][106226] Updated weights for policy 0, policy_version 1679264 (0.0010) [2023-12-28 07:19:50,328][106226] Updated weights for policy 0, policy_version 1679274 (0.0007) [2023-12-28 07:19:50,389][106226] Updated weights for policy 0, policy_version 1679284 (0.0006) [2023-12-28 07:19:50,667][106225] Updated weights for policy 1, policy_version 1683337 (0.0007) [2023-12-28 07:19:50,736][106225] Updated weights for policy 1, policy_version 1683347 (0.0009) [2023-12-28 07:19:50,807][106225] Updated weights for policy 1, policy_version 1683357 (0.0010) [2023-12-28 07:19:50,877][106225] Updated weights for policy 1, policy_version 1683367 (0.0010) [2023-12-28 07:19:51,034][106226] Updated weights for policy 0, policy_version 1679294 (0.0007) [2023-12-28 07:19:51,104][106226] Updated weights for policy 0, policy_version 1679304 (0.0007) [2023-12-28 07:19:51,172][106226] Updated weights for policy 0, policy_version 1679314 (0.0008) [2023-12-28 07:19:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 860971008. Throughput: 0: 9736.7, 1: 10074.8. Samples: 860982872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:51,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.731')] [2023-12-28 07:19:51,650][106225] Updated weights for policy 1, policy_version 1683377 (0.0008) [2023-12-28 07:19:51,705][106225] Updated weights for policy 1, policy_version 1683387 (0.0007) [2023-12-28 07:19:51,771][106225] Updated weights for policy 1, policy_version 1683397 (0.0007) [2023-12-28 07:19:51,838][106226] Updated weights for policy 0, policy_version 1679324 (0.0007) [2023-12-28 07:19:51,899][106226] Updated weights for policy 0, policy_version 1679334 (0.0007) [2023-12-28 07:19:51,950][106226] Updated weights for policy 0, policy_version 1679344 (0.0007) [2023-12-28 07:19:52,553][106225] Updated weights for policy 1, policy_version 1683407 (0.0008) [2023-12-28 07:19:52,601][106226] Updated weights for policy 0, policy_version 1679354 (0.0008) [2023-12-28 07:19:52,618][106225] Updated weights for policy 1, policy_version 1683417 (0.0008) [2023-12-28 07:19:52,660][106226] Updated weights for policy 0, policy_version 1679364 (0.0006) [2023-12-28 07:19:52,677][106225] Updated weights for policy 1, policy_version 1683427 (0.0008) [2023-12-28 07:19:52,724][106226] Updated weights for policy 0, policy_version 1679374 (0.0007) [2023-12-28 07:19:52,774][106226] Updated weights for policy 0, policy_version 1679384 (0.0008) [2023-12-28 07:19:53,398][106225] Updated weights for policy 1, policy_version 1683437 (0.0008) [2023-12-28 07:19:53,455][106225] Updated weights for policy 1, policy_version 1683447 (0.0008) [2023-12-28 07:19:53,505][106225] Updated weights for policy 1, policy_version 1683457 (0.0007) [2023-12-28 07:19:53,515][106226] Updated weights for policy 0, policy_version 1679394 (0.0007) [2023-12-28 07:19:53,580][106226] Updated weights for policy 0, policy_version 1679404 (0.0009) [2023-12-28 07:19:53,632][106226] Updated weights for policy 0, policy_version 1679414 (0.0009) [2023-12-28 07:19:54,097][106225] Updated weights for policy 1, policy_version 1683467 (0.0006) [2023-12-28 07:19:54,159][106225] Updated weights for policy 1, policy_version 1683477 (0.0009) [2023-12-28 07:19:54,225][106225] Updated weights for policy 1, policy_version 1683487 (0.0009) [2023-12-28 07:19:54,442][106226] Updated weights for policy 0, policy_version 1679424 (0.0007) [2023-12-28 07:19:54,500][106226] Updated weights for policy 0, policy_version 1679434 (0.0009) [2023-12-28 07:19:54,562][106226] Updated weights for policy 0, policy_version 1679444 (0.0008) [2023-12-28 07:19:54,845][106225] Updated weights for policy 1, policy_version 1683497 (0.0007) [2023-12-28 07:19:54,904][106225] Updated weights for policy 1, policy_version 1683507 (0.0005) [2023-12-28 07:19:54,961][106225] Updated weights for policy 1, policy_version 1683517 (0.0006) [2023-12-28 07:19:55,021][106225] Updated weights for policy 1, policy_version 1683527 (0.0010) [2023-12-28 07:19:55,256][106226] Updated weights for policy 0, policy_version 1679454 (0.0006) [2023-12-28 07:19:55,314][106226] Updated weights for policy 0, policy_version 1679464 (0.0005) [2023-12-28 07:19:55,371][106226] Updated weights for policy 0, policy_version 1679474 (0.0005) [2023-12-28 07:19:55,688][106225] Updated weights for policy 1, policy_version 1683537 (0.0010) [2023-12-28 07:19:55,735][106225] Updated weights for policy 1, policy_version 1683547 (0.0010) [2023-12-28 07:19:55,784][106225] Updated weights for policy 1, policy_version 1683557 (0.0010) [2023-12-28 07:19:56,012][106226] Updated weights for policy 0, policy_version 1679484 (0.0010) [2023-12-28 07:19:56,072][106226] Updated weights for policy 0, policy_version 1679494 (0.0011) [2023-12-28 07:19:56,131][106226] Updated weights for policy 0, policy_version 1679504 (0.0007) [2023-12-28 07:19:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 861069312. Throughput: 0: 9738.1, 1: 10020.4. Samples: 861039720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:19:56,176][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.055')] [2023-12-28 07:19:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001683560_431046656.pth... [2023-12-28 07:19:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001679512_430030848.pth... [2023-12-28 07:19:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001682376_430743552.pth [2023-12-28 07:19:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001678360_429735936.pth [2023-12-28 07:19:56,502][106225] Updated weights for policy 1, policy_version 1683567 (0.0010) [2023-12-28 07:19:56,558][106225] Updated weights for policy 1, policy_version 1683577 (0.0010) [2023-12-28 07:19:56,608][106225] Updated weights for policy 1, policy_version 1683587 (0.0010) [2023-12-28 07:19:56,804][106226] Updated weights for policy 0, policy_version 1679514 (0.0007) [2023-12-28 07:19:56,855][106226] Updated weights for policy 0, policy_version 1679524 (0.0010) [2023-12-28 07:19:56,911][106226] Updated weights for policy 0, policy_version 1679534 (0.0009) [2023-12-28 07:19:56,967][106226] Updated weights for policy 0, policy_version 1679544 (0.0008) [2023-12-28 07:19:57,197][106225] Updated weights for policy 1, policy_version 1683597 (0.0009) [2023-12-28 07:19:57,252][106225] Updated weights for policy 1, policy_version 1683607 (0.0010) [2023-12-28 07:19:57,317][106225] Updated weights for policy 1, policy_version 1683617 (0.0010) [2023-12-28 07:19:57,593][106226] Updated weights for policy 0, policy_version 1679554 (0.0005) [2023-12-28 07:19:57,638][106226] Updated weights for policy 0, policy_version 1679564 (0.0005) [2023-12-28 07:19:57,698][106226] Updated weights for policy 0, policy_version 1679574 (0.0005) [2023-12-28 07:19:57,926][106225] Updated weights for policy 1, policy_version 1683627 (0.0009) [2023-12-28 07:19:57,970][106225] Updated weights for policy 1, policy_version 1683637 (0.0007) [2023-12-28 07:19:58,021][106225] Updated weights for policy 1, policy_version 1683647 (0.0006) [2023-12-28 07:19:58,390][106226] Updated weights for policy 0, policy_version 1679584 (0.0011) [2023-12-28 07:19:58,458][106226] Updated weights for policy 0, policy_version 1679594 (0.0011) [2023-12-28 07:19:58,525][106226] Updated weights for policy 0, policy_version 1679604 (0.0009) [2023-12-28 07:19:58,655][106225] Updated weights for policy 1, policy_version 1683657 (0.0006) [2023-12-28 07:19:58,722][106225] Updated weights for policy 1, policy_version 1683667 (0.0008) [2023-12-28 07:19:58,795][106225] Updated weights for policy 1, policy_version 1683677 (0.0008) [2023-12-28 07:19:58,864][106225] Updated weights for policy 1, policy_version 1683687 (0.0008) [2023-12-28 07:19:59,335][106226] Updated weights for policy 0, policy_version 1679614 (0.0011) [2023-12-28 07:19:59,415][106226] Updated weights for policy 0, policy_version 1679624 (0.0008) [2023-12-28 07:19:59,464][106226] Updated weights for policy 0, policy_version 1679634 (0.0010) [2023-12-28 07:19:59,613][106225] Updated weights for policy 1, policy_version 1683697 (0.0006) [2023-12-28 07:19:59,678][106225] Updated weights for policy 1, policy_version 1683707 (0.0006) [2023-12-28 07:19:59,740][106225] Updated weights for policy 1, policy_version 1683717 (0.0008) [2023-12-28 07:20:00,209][106226] Updated weights for policy 0, policy_version 1679644 (0.0007) [2023-12-28 07:20:00,264][106226] Updated weights for policy 0, policy_version 1679654 (0.0007) [2023-12-28 07:20:00,311][106226] Updated weights for policy 0, policy_version 1679664 (0.0006) [2023-12-28 07:20:00,386][106225] Updated weights for policy 1, policy_version 1683727 (0.0008) [2023-12-28 07:20:00,453][106225] Updated weights for policy 1, policy_version 1683737 (0.0008) [2023-12-28 07:20:00,511][106225] Updated weights for policy 1, policy_version 1683747 (0.0008) [2023-12-28 07:20:00,980][106226] Updated weights for policy 0, policy_version 1679674 (0.0006) [2023-12-28 07:20:01,042][106226] Updated weights for policy 0, policy_version 1679684 (0.0008) [2023-12-28 07:20:01,107][106226] Updated weights for policy 0, policy_version 1679694 (0.0007) [2023-12-28 07:20:01,173][106226] Updated weights for policy 0, policy_version 1679704 (0.0007) [2023-12-28 07:20:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 861175808. Throughput: 0: 9780.7, 1: 10163.8. Samples: 861163100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:20:01,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.571')] [2023-12-28 07:20:01,242][106225] Updated weights for policy 1, policy_version 1683757 (0.0009) [2023-12-28 07:20:01,295][106225] Updated weights for policy 1, policy_version 1683767 (0.0007) [2023-12-28 07:20:01,369][106225] Updated weights for policy 1, policy_version 1683777 (0.0009) [2023-12-28 07:20:01,780][106226] Updated weights for policy 0, policy_version 1679714 (0.0009) [2023-12-28 07:20:01,842][106226] Updated weights for policy 0, policy_version 1679724 (0.0009) [2023-12-28 07:20:01,895][106226] Updated weights for policy 0, policy_version 1679734 (0.0010) [2023-12-28 07:20:02,122][106225] Updated weights for policy 1, policy_version 1683787 (0.0007) [2023-12-28 07:20:02,174][106225] Updated weights for policy 1, policy_version 1683797 (0.0005) [2023-12-28 07:20:02,236][106225] Updated weights for policy 1, policy_version 1683807 (0.0006) [2023-12-28 07:20:02,595][106226] Updated weights for policy 0, policy_version 1679744 (0.0011) [2023-12-28 07:20:02,652][106226] Updated weights for policy 0, policy_version 1679754 (0.0010) [2023-12-28 07:20:02,698][106226] Updated weights for policy 0, policy_version 1679764 (0.0010) [2023-12-28 07:20:02,947][106225] Updated weights for policy 1, policy_version 1683817 (0.0008) [2023-12-28 07:20:02,997][106225] Updated weights for policy 1, policy_version 1683827 (0.0007) [2023-12-28 07:20:03,052][106225] Updated weights for policy 1, policy_version 1683837 (0.0005) [2023-12-28 07:20:03,105][106225] Updated weights for policy 1, policy_version 1683847 (0.0007) [2023-12-28 07:20:03,411][106226] Updated weights for policy 0, policy_version 1679774 (0.0011) [2023-12-28 07:20:03,467][106226] Updated weights for policy 0, policy_version 1679784 (0.0010) [2023-12-28 07:20:03,523][106226] Updated weights for policy 0, policy_version 1679794 (0.0010) [2023-12-28 07:20:03,689][106225] Updated weights for policy 1, policy_version 1683857 (0.0005) [2023-12-28 07:20:03,744][106225] Updated weights for policy 1, policy_version 1683867 (0.0005) [2023-12-28 07:20:03,813][106225] Updated weights for policy 1, policy_version 1683877 (0.0005) [2023-12-28 07:20:04,168][106226] Updated weights for policy 0, policy_version 1679804 (0.0008) [2023-12-28 07:20:04,232][106226] Updated weights for policy 0, policy_version 1679814 (0.0007) [2023-12-28 07:20:04,297][106226] Updated weights for policy 0, policy_version 1679824 (0.0009) [2023-12-28 07:20:04,489][106225] Updated weights for policy 1, policy_version 1683887 (0.0008) [2023-12-28 07:20:04,552][106225] Updated weights for policy 1, policy_version 1683897 (0.0007) [2023-12-28 07:20:04,611][106225] Updated weights for policy 1, policy_version 1683907 (0.0008) [2023-12-28 07:20:04,911][106226] Updated weights for policy 0, policy_version 1679834 (0.0008) [2023-12-28 07:20:04,971][106226] Updated weights for policy 0, policy_version 1679844 (0.0005) [2023-12-28 07:20:05,026][106226] Updated weights for policy 0, policy_version 1679854 (0.0006) [2023-12-28 07:20:05,083][106226] Updated weights for policy 0, policy_version 1679864 (0.0008) [2023-12-28 07:20:05,346][106225] Updated weights for policy 1, policy_version 1683917 (0.0008) [2023-12-28 07:20:05,398][106225] Updated weights for policy 1, policy_version 1683927 (0.0008) [2023-12-28 07:20:05,449][106225] Updated weights for policy 1, policy_version 1683937 (0.0008) [2023-12-28 07:20:05,710][106226] Updated weights for policy 0, policy_version 1679874 (0.0005) [2023-12-28 07:20:05,771][106226] Updated weights for policy 0, policy_version 1679884 (0.0007) [2023-12-28 07:20:05,826][106226] Updated weights for policy 0, policy_version 1679894 (0.0009) [2023-12-28 07:20:06,153][106225] Updated weights for policy 1, policy_version 1683947 (0.0009) [2023-12-28 07:20:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 861274112. Throughput: 0: 9854.3, 1: 10171.0. Samples: 861285204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:20:06,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.755')] [2023-12-28 07:20:06,217][106225] Updated weights for policy 1, policy_version 1683957 (0.0008) [2023-12-28 07:20:06,280][106225] Updated weights for policy 1, policy_version 1683967 (0.0008) [2023-12-28 07:20:06,488][106226] Updated weights for policy 0, policy_version 1679904 (0.0006) [2023-12-28 07:20:06,547][106226] Updated weights for policy 0, policy_version 1679914 (0.0007) [2023-12-28 07:20:06,607][106226] Updated weights for policy 0, policy_version 1679924 (0.0007) [2023-12-28 07:20:07,097][106225] Updated weights for policy 1, policy_version 1683977 (0.0008) [2023-12-28 07:20:07,160][106225] Updated weights for policy 1, policy_version 1683987 (0.0008) [2023-12-28 07:20:07,168][106226] Updated weights for policy 0, policy_version 1679934 (0.0008) [2023-12-28 07:20:07,215][106226] Updated weights for policy 0, policy_version 1679944 (0.0010) [2023-12-28 07:20:07,221][106225] Updated weights for policy 1, policy_version 1683997 (0.0006) [2023-12-28 07:20:07,266][106226] Updated weights for policy 0, policy_version 1679954 (0.0010) [2023-12-28 07:20:07,278][106225] Updated weights for policy 1, policy_version 1684007 (0.0006) [2023-12-28 07:20:07,941][106225] Updated weights for policy 1, policy_version 1684017 (0.0009) [2023-12-28 07:20:07,941][106226] Updated weights for policy 0, policy_version 1679964 (0.0009) [2023-12-28 07:20:07,982][106225] Updated weights for policy 1, policy_version 1684027 (0.0007) [2023-12-28 07:20:08,000][106226] Updated weights for policy 0, policy_version 1679974 (0.0006) [2023-12-28 07:20:08,037][106225] Updated weights for policy 1, policy_version 1684037 (0.0006) [2023-12-28 07:20:08,052][106226] Updated weights for policy 0, policy_version 1679984 (0.0009) [2023-12-28 07:20:08,714][106226] Updated weights for policy 0, policy_version 1679994 (0.0008) [2023-12-28 07:20:08,732][106225] Updated weights for policy 1, policy_version 1684047 (0.0007) [2023-12-28 07:20:08,781][106226] Updated weights for policy 0, policy_version 1680004 (0.0008) [2023-12-28 07:20:08,784][106225] Updated weights for policy 1, policy_version 1684057 (0.0007) [2023-12-28 07:20:08,830][106225] Updated weights for policy 1, policy_version 1684067 (0.0006) [2023-12-28 07:20:08,849][106226] Updated weights for policy 0, policy_version 1680014 (0.0007) [2023-12-28 07:20:08,914][106226] Updated weights for policy 0, policy_version 1680024 (0.0009) [2023-12-28 07:20:09,523][106225] Updated weights for policy 1, policy_version 1684077 (0.0007) [2023-12-28 07:20:09,586][106225] Updated weights for policy 1, policy_version 1684087 (0.0008) [2023-12-28 07:20:09,646][106225] Updated weights for policy 1, policy_version 1684097 (0.0008) [2023-12-28 07:20:09,664][106226] Updated weights for policy 0, policy_version 1680034 (0.0012) [2023-12-28 07:20:09,722][106226] Updated weights for policy 0, policy_version 1680044 (0.0011) [2023-12-28 07:20:09,783][106226] Updated weights for policy 0, policy_version 1680054 (0.0011) [2023-12-28 07:20:10,369][106225] Updated weights for policy 1, policy_version 1684107 (0.0007) [2023-12-28 07:20:10,424][106225] Updated weights for policy 1, policy_version 1684117 (0.0008) [2023-12-28 07:20:10,475][106225] Updated weights for policy 1, policy_version 1684127 (0.0007) [2023-12-28 07:20:10,491][106226] Updated weights for policy 0, policy_version 1680064 (0.0008) [2023-12-28 07:20:10,553][106226] Updated weights for policy 0, policy_version 1680074 (0.0008) [2023-12-28 07:20:10,602][106226] Updated weights for policy 0, policy_version 1680084 (0.0009) [2023-12-28 07:20:11,107][106225] Updated weights for policy 1, policy_version 1684137 (0.0008) [2023-12-28 07:20:11,173][106225] Updated weights for policy 1, policy_version 1684147 (0.0008) [2023-12-28 07:20:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 861372416. Throughput: 0: 9949.1, 1: 10181.9. Samples: 861345300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:20:11,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.789')] [2023-12-28 07:20:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001680088_430178304.pth... [2023-12-28 07:20:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001678968_429891584.pth [2023-12-28 07:20:11,232][106225] Updated weights for policy 1, policy_version 1684157 (0.0008) [2023-12-28 07:20:11,317][106225] Updated weights for policy 1, policy_version 1684167 (0.0009) [2023-12-28 07:20:11,321][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001684168_431202304.pth... [2023-12-28 07:20:11,326][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001682952_430891008.pth [2023-12-28 07:20:11,402][106226] Updated weights for policy 0, policy_version 1680094 (0.0008) [2023-12-28 07:20:11,463][106226] Updated weights for policy 0, policy_version 1680104 (0.0005) [2023-12-28 07:20:11,523][106226] Updated weights for policy 0, policy_version 1680114 (0.0006) [2023-12-28 07:20:12,197][106225] Updated weights for policy 1, policy_version 1684177 (0.0009) [2023-12-28 07:20:12,220][106226] Updated weights for policy 0, policy_version 1680124 (0.0006) [2023-12-28 07:20:12,262][106225] Updated weights for policy 1, policy_version 1684187 (0.0007) [2023-12-28 07:20:12,293][106226] Updated weights for policy 0, policy_version 1680134 (0.0008) [2023-12-28 07:20:12,330][106225] Updated weights for policy 1, policy_version 1684197 (0.0008) [2023-12-28 07:20:12,361][106226] Updated weights for policy 0, policy_version 1680144 (0.0007) [2023-12-28 07:20:13,051][106226] Updated weights for policy 0, policy_version 1680154 (0.0008) [2023-12-28 07:20:13,056][106225] Updated weights for policy 1, policy_version 1684207 (0.0006) [2023-12-28 07:20:13,100][106226] Updated weights for policy 0, policy_version 1680164 (0.0005) [2023-12-28 07:20:13,122][106225] Updated weights for policy 1, policy_version 1684217 (0.0005) [2023-12-28 07:20:13,153][106226] Updated weights for policy 0, policy_version 1680174 (0.0005) [2023-12-28 07:20:13,181][106225] Updated weights for policy 1, policy_version 1684227 (0.0006) [2023-12-28 07:20:13,199][106226] Updated weights for policy 0, policy_version 1680184 (0.0005) [2023-12-28 07:20:13,765][106226] Updated weights for policy 0, policy_version 1680194 (0.0009) [2023-12-28 07:20:13,819][106226] Updated weights for policy 0, policy_version 1680204 (0.0008) [2023-12-28 07:20:13,869][106225] Updated weights for policy 1, policy_version 1684237 (0.0006) [2023-12-28 07:20:13,878][106226] Updated weights for policy 0, policy_version 1680214 (0.0008) [2023-12-28 07:20:13,923][106225] Updated weights for policy 1, policy_version 1684247 (0.0008) [2023-12-28 07:20:13,977][106225] Updated weights for policy 1, policy_version 1684257 (0.0008) [2023-12-28 07:20:14,474][106226] Updated weights for policy 0, policy_version 1680224 (0.0009) [2023-12-28 07:20:14,535][106226] Updated weights for policy 0, policy_version 1680234 (0.0009) [2023-12-28 07:20:14,592][106226] Updated weights for policy 0, policy_version 1680244 (0.0008) [2023-12-28 07:20:14,747][106225] Updated weights for policy 1, policy_version 1684267 (0.0007) [2023-12-28 07:20:14,817][106225] Updated weights for policy 1, policy_version 1684277 (0.0008) [2023-12-28 07:20:14,879][106225] Updated weights for policy 1, policy_version 1684287 (0.0008) [2023-12-28 07:20:15,301][106226] Updated weights for policy 0, policy_version 1680254 (0.0007) [2023-12-28 07:20:15,354][106226] Updated weights for policy 0, policy_version 1680264 (0.0005) [2023-12-28 07:20:15,409][106226] Updated weights for policy 0, policy_version 1680274 (0.0009) [2023-12-28 07:20:15,553][106225] Updated weights for policy 1, policy_version 1684297 (0.0007) [2023-12-28 07:20:15,604][106225] Updated weights for policy 1, policy_version 1684307 (0.0007) [2023-12-28 07:20:15,654][106225] Updated weights for policy 1, policy_version 1684317 (0.0010) [2023-12-28 07:20:15,710][106225] Updated weights for policy 1, policy_version 1684327 (0.0010) [2023-12-28 07:20:16,048][106226] Updated weights for policy 0, policy_version 1680284 (0.0009) [2023-12-28 07:20:16,106][106226] Updated weights for policy 0, policy_version 1680294 (0.0009) [2023-12-28 07:20:16,164][106226] Updated weights for policy 0, policy_version 1680304 (0.0008) [2023-12-28 07:20:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.6). Total num frames: 861470720. Throughput: 0: 9916.2, 1: 10101.8. Samples: 861463396. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:16,175][105115] Avg episode reward: [(0, '-4.271'), (1, '-4.909')] [2023-12-28 07:20:16,355][106225] Updated weights for policy 1, policy_version 1684337 (0.0007) [2023-12-28 07:20:16,409][106225] Updated weights for policy 1, policy_version 1684347 (0.0005) [2023-12-28 07:20:16,455][106225] Updated weights for policy 1, policy_version 1684357 (0.0008) [2023-12-28 07:20:16,898][106226] Updated weights for policy 0, policy_version 1680314 (0.0008) [2023-12-28 07:20:16,956][106226] Updated weights for policy 0, policy_version 1680324 (0.0008) [2023-12-28 07:20:17,016][106226] Updated weights for policy 0, policy_version 1680334 (0.0008) [2023-12-28 07:20:17,072][106226] Updated weights for policy 0, policy_version 1680344 (0.0007) [2023-12-28 07:20:17,078][106225] Updated weights for policy 1, policy_version 1684367 (0.0008) [2023-12-28 07:20:17,129][106225] Updated weights for policy 1, policy_version 1684377 (0.0008) [2023-12-28 07:20:17,191][106225] Updated weights for policy 1, policy_version 1684387 (0.0008) [2023-12-28 07:20:17,799][106226] Updated weights for policy 0, policy_version 1680354 (0.0006) [2023-12-28 07:20:17,852][106226] Updated weights for policy 0, policy_version 1680364 (0.0006) [2023-12-28 07:20:17,911][106226] Updated weights for policy 0, policy_version 1680374 (0.0008) [2023-12-28 07:20:17,916][106225] Updated weights for policy 1, policy_version 1684397 (0.0008) [2023-12-28 07:20:17,969][106225] Updated weights for policy 1, policy_version 1684407 (0.0009) [2023-12-28 07:20:18,031][106225] Updated weights for policy 1, policy_version 1684417 (0.0009) [2023-12-28 07:20:18,625][106226] Updated weights for policy 0, policy_version 1680384 (0.0008) [2023-12-28 07:20:18,682][106226] Updated weights for policy 0, policy_version 1680394 (0.0008) [2023-12-28 07:20:18,741][106226] Updated weights for policy 0, policy_version 1680404 (0.0009) [2023-12-28 07:20:18,771][106225] Updated weights for policy 1, policy_version 1684427 (0.0007) [2023-12-28 07:20:18,835][106225] Updated weights for policy 1, policy_version 1684437 (0.0005) [2023-12-28 07:20:18,900][106225] Updated weights for policy 1, policy_version 1684447 (0.0005) [2023-12-28 07:20:19,493][106225] Updated weights for policy 1, policy_version 1684457 (0.0006) [2023-12-28 07:20:19,529][106226] Updated weights for policy 0, policy_version 1680414 (0.0007) [2023-12-28 07:20:19,555][106225] Updated weights for policy 1, policy_version 1684467 (0.0007) [2023-12-28 07:20:19,588][106226] Updated weights for policy 0, policy_version 1680424 (0.0007) [2023-12-28 07:20:19,615][106225] Updated weights for policy 1, policy_version 1684477 (0.0006) [2023-12-28 07:20:19,649][106226] Updated weights for policy 0, policy_version 1680434 (0.0007) [2023-12-28 07:20:19,675][106225] Updated weights for policy 1, policy_version 1684487 (0.0008) [2023-12-28 07:20:20,399][106225] Updated weights for policy 1, policy_version 1684497 (0.0009) [2023-12-28 07:20:20,426][106226] Updated weights for policy 0, policy_version 1680444 (0.0009) [2023-12-28 07:20:20,462][106225] Updated weights for policy 1, policy_version 1684507 (0.0007) [2023-12-28 07:20:20,491][106226] Updated weights for policy 0, policy_version 1680454 (0.0008) [2023-12-28 07:20:20,530][106225] Updated weights for policy 1, policy_version 1684517 (0.0008) [2023-12-28 07:20:20,552][106226] Updated weights for policy 0, policy_version 1680464 (0.0008) [2023-12-28 07:20:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 861569024. Throughput: 0: 9817.1, 1: 10076.7. Samples: 861581396. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:21,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.715')] [2023-12-28 07:20:21,307][106225] Updated weights for policy 1, policy_version 1684527 (0.0010) [2023-12-28 07:20:21,385][106225] Updated weights for policy 1, policy_version 1684538 (0.0014) [2023-12-28 07:20:21,420][106226] Updated weights for policy 0, policy_version 1680474 (0.0008) [2023-12-28 07:20:21,453][106225] Updated weights for policy 1, policy_version 1684548 (0.0011) [2023-12-28 07:20:21,483][106226] Updated weights for policy 0, policy_version 1680484 (0.0008) [2023-12-28 07:20:21,554][106226] Updated weights for policy 0, policy_version 1680494 (0.0008) [2023-12-28 07:20:21,613][106226] Updated weights for policy 0, policy_version 1680504 (0.0008) [2023-12-28 07:20:22,251][106225] Updated weights for policy 1, policy_version 1684558 (0.0009) [2023-12-28 07:20:22,325][106225] Updated weights for policy 1, policy_version 1684568 (0.0007) [2023-12-28 07:20:22,326][106226] Updated weights for policy 0, policy_version 1680514 (0.0008) [2023-12-28 07:20:22,389][106225] Updated weights for policy 1, policy_version 1684578 (0.0008) [2023-12-28 07:20:22,397][106226] Updated weights for policy 0, policy_version 1680524 (0.0008) [2023-12-28 07:20:22,466][106226] Updated weights for policy 0, policy_version 1680534 (0.0006) [2023-12-28 07:20:23,094][106225] Updated weights for policy 1, policy_version 1684588 (0.0009) [2023-12-28 07:20:23,151][106225] Updated weights for policy 1, policy_version 1684598 (0.0007) [2023-12-28 07:20:23,209][106225] Updated weights for policy 1, policy_version 1684608 (0.0007) [2023-12-28 07:20:23,227][106226] Updated weights for policy 0, policy_version 1680544 (0.0007) [2023-12-28 07:20:23,281][106226] Updated weights for policy 0, policy_version 1680554 (0.0006) [2023-12-28 07:20:23,336][106226] Updated weights for policy 0, policy_version 1680564 (0.0009) [2023-12-28 07:20:23,820][106225] Updated weights for policy 1, policy_version 1684618 (0.0010) [2023-12-28 07:20:23,869][106225] Updated weights for policy 1, policy_version 1684628 (0.0008) [2023-12-28 07:20:23,921][106225] Updated weights for policy 1, policy_version 1684638 (0.0008) [2023-12-28 07:20:23,969][106226] Updated weights for policy 0, policy_version 1680574 (0.0008) [2023-12-28 07:20:23,973][106225] Updated weights for policy 1, policy_version 1684648 (0.0006) [2023-12-28 07:20:24,029][106226] Updated weights for policy 0, policy_version 1680584 (0.0009) [2023-12-28 07:20:24,093][106226] Updated weights for policy 0, policy_version 1680594 (0.0007) [2023-12-28 07:20:24,666][106225] Updated weights for policy 1, policy_version 1684658 (0.0008) [2023-12-28 07:20:24,719][106225] Updated weights for policy 1, policy_version 1684668 (0.0009) [2023-12-28 07:20:24,768][106225] Updated weights for policy 1, policy_version 1684678 (0.0007) [2023-12-28 07:20:24,801][106226] Updated weights for policy 0, policy_version 1680604 (0.0007) [2023-12-28 07:20:24,866][106226] Updated weights for policy 0, policy_version 1680614 (0.0005) [2023-12-28 07:20:24,935][106226] Updated weights for policy 0, policy_version 1680624 (0.0005) [2023-12-28 07:20:25,487][106226] Updated weights for policy 0, policy_version 1680634 (0.0006) [2023-12-28 07:20:25,498][106225] Updated weights for policy 1, policy_version 1684688 (0.0007) [2023-12-28 07:20:25,536][106226] Updated weights for policy 0, policy_version 1680644 (0.0005) [2023-12-28 07:20:25,547][106225] Updated weights for policy 1, policy_version 1684698 (0.0005) [2023-12-28 07:20:25,583][106226] Updated weights for policy 0, policy_version 1680654 (0.0007) [2023-12-28 07:20:25,593][106225] Updated weights for policy 1, policy_version 1684708 (0.0005) [2023-12-28 07:20:25,640][106226] Updated weights for policy 0, policy_version 1680664 (0.0006) [2023-12-28 07:20:26,163][106225] Updated weights for policy 1, policy_version 1684718 (0.0008) [2023-12-28 07:20:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 861667328. Throughput: 0: 9738.7, 1: 10043.2. Samples: 861638896. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:26,176][106226] Updated weights for policy 0, policy_version 1680674 (0.0005) [2023-12-28 07:20:26,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-4.658')] [2023-12-28 07:20:26,214][106225] Updated weights for policy 1, policy_version 1684728 (0.0010) [2023-12-28 07:20:26,227][106226] Updated weights for policy 0, policy_version 1680684 (0.0005) [2023-12-28 07:20:26,266][106225] Updated weights for policy 1, policy_version 1684738 (0.0008) [2023-12-28 07:20:26,283][106226] Updated weights for policy 0, policy_version 1680694 (0.0006) [2023-12-28 07:20:26,292][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001680696_430333952.pth... [2023-12-28 07:20:26,295][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001679512_430030848.pth [2023-12-28 07:20:26,297][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001684744_431349760.pth... [2023-12-28 07:20:26,300][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001683560_431046656.pth [2023-12-28 07:20:26,908][106226] Updated weights for policy 0, policy_version 1680704 (0.0010) [2023-12-28 07:20:26,958][106225] Updated weights for policy 1, policy_version 1684748 (0.0006) [2023-12-28 07:20:26,977][106226] Updated weights for policy 0, policy_version 1680714 (0.0010) [2023-12-28 07:20:27,007][106225] Updated weights for policy 1, policy_version 1684758 (0.0006) [2023-12-28 07:20:27,043][106226] Updated weights for policy 0, policy_version 1680724 (0.0011) [2023-12-28 07:20:27,057][106225] Updated weights for policy 1, policy_version 1684768 (0.0005) [2023-12-28 07:20:27,724][106226] Updated weights for policy 0, policy_version 1680734 (0.0011) [2023-12-28 07:20:27,726][106225] Updated weights for policy 1, policy_version 1684778 (0.0006) [2023-12-28 07:20:27,781][106225] Updated weights for policy 1, policy_version 1684788 (0.0005) [2023-12-28 07:20:27,781][106226] Updated weights for policy 0, policy_version 1680744 (0.0011) [2023-12-28 07:20:27,831][106226] Updated weights for policy 0, policy_version 1680754 (0.0010) [2023-12-28 07:20:27,832][106225] Updated weights for policy 1, policy_version 1684798 (0.0005) [2023-12-28 07:20:27,883][106225] Updated weights for policy 1, policy_version 1684808 (0.0006) [2023-12-28 07:20:28,493][106226] Updated weights for policy 0, policy_version 1680764 (0.0009) [2023-12-28 07:20:28,548][106226] Updated weights for policy 0, policy_version 1680774 (0.0005) [2023-12-28 07:20:28,606][106226] Updated weights for policy 0, policy_version 1680784 (0.0005) [2023-12-28 07:20:28,613][106225] Updated weights for policy 1, policy_version 1684818 (0.0009) [2023-12-28 07:20:28,669][106225] Updated weights for policy 1, policy_version 1684828 (0.0007) [2023-12-28 07:20:28,720][106225] Updated weights for policy 1, policy_version 1684838 (0.0009) [2023-12-28 07:20:29,149][106226] Updated weights for policy 0, policy_version 1680794 (0.0008) [2023-12-28 07:20:29,201][106226] Updated weights for policy 0, policy_version 1680804 (0.0006) [2023-12-28 07:20:29,273][106226] Updated weights for policy 0, policy_version 1680814 (0.0008) [2023-12-28 07:20:29,339][106226] Updated weights for policy 0, policy_version 1680824 (0.0011) [2023-12-28 07:20:29,508][106225] Updated weights for policy 1, policy_version 1684848 (0.0008) [2023-12-28 07:20:29,562][106225] Updated weights for policy 1, policy_version 1684858 (0.0008) [2023-12-28 07:20:29,614][106225] Updated weights for policy 1, policy_version 1684868 (0.0006) [2023-12-28 07:20:30,040][106226] Updated weights for policy 0, policy_version 1680834 (0.0011) [2023-12-28 07:20:30,094][106226] Updated weights for policy 0, policy_version 1680844 (0.0010) [2023-12-28 07:20:30,154][106226] Updated weights for policy 0, policy_version 1680854 (0.0010) [2023-12-28 07:20:30,339][106225] Updated weights for policy 1, policy_version 1684878 (0.0007) [2023-12-28 07:20:30,391][106225] Updated weights for policy 1, policy_version 1684888 (0.0008) [2023-12-28 07:20:30,446][106225] Updated weights for policy 1, policy_version 1684898 (0.0007) [2023-12-28 07:20:30,788][106226] Updated weights for policy 0, policy_version 1680864 (0.0006) [2023-12-28 07:20:30,834][106226] Updated weights for policy 0, policy_version 1680874 (0.0005) [2023-12-28 07:20:30,879][106226] Updated weights for policy 0, policy_version 1680884 (0.0005) [2023-12-28 07:20:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 861773824. Throughput: 0: 9972.8, 1: 10034.9. Samples: 861764660. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:31,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.813')] [2023-12-28 07:20:31,236][106225] Updated weights for policy 1, policy_version 1684908 (0.0009) [2023-12-28 07:20:31,294][106225] Updated weights for policy 1, policy_version 1684918 (0.0009) [2023-12-28 07:20:31,351][106225] Updated weights for policy 1, policy_version 1684928 (0.0008) [2023-12-28 07:20:31,566][106226] Updated weights for policy 0, policy_version 1680894 (0.0008) [2023-12-28 07:20:31,629][106226] Updated weights for policy 0, policy_version 1680904 (0.0007) [2023-12-28 07:20:31,695][106226] Updated weights for policy 0, policy_version 1680914 (0.0006) [2023-12-28 07:20:32,166][106225] Updated weights for policy 1, policy_version 1684938 (0.0008) [2023-12-28 07:20:32,225][106225] Updated weights for policy 1, policy_version 1684948 (0.0008) [2023-12-28 07:20:32,284][106225] Updated weights for policy 1, policy_version 1684958 (0.0008) [2023-12-28 07:20:32,339][106225] Updated weights for policy 1, policy_version 1684968 (0.0008) [2023-12-28 07:20:32,340][106226] Updated weights for policy 0, policy_version 1680924 (0.0007) [2023-12-28 07:20:32,407][106226] Updated weights for policy 0, policy_version 1680934 (0.0009) [2023-12-28 07:20:32,466][106226] Updated weights for policy 0, policy_version 1680944 (0.0009) [2023-12-28 07:20:33,128][106225] Updated weights for policy 1, policy_version 1684978 (0.0008) [2023-12-28 07:20:33,164][106226] Updated weights for policy 0, policy_version 1680954 (0.0008) [2023-12-28 07:20:33,185][106225] Updated weights for policy 1, policy_version 1684988 (0.0007) [2023-12-28 07:20:33,223][106226] Updated weights for policy 0, policy_version 1680964 (0.0007) [2023-12-28 07:20:33,236][106225] Updated weights for policy 1, policy_version 1684998 (0.0006) [2023-12-28 07:20:33,284][106226] Updated weights for policy 0, policy_version 1680974 (0.0007) [2023-12-28 07:20:33,349][106226] Updated weights for policy 0, policy_version 1680984 (0.0009) [2023-12-28 07:20:33,850][106225] Updated weights for policy 1, policy_version 1685008 (0.0008) [2023-12-28 07:20:33,903][106225] Updated weights for policy 1, policy_version 1685018 (0.0007) [2023-12-28 07:20:33,967][106225] Updated weights for policy 1, policy_version 1685028 (0.0008) [2023-12-28 07:20:34,034][106226] Updated weights for policy 0, policy_version 1680994 (0.0011) [2023-12-28 07:20:34,083][106226] Updated weights for policy 0, policy_version 1681004 (0.0010) [2023-12-28 07:20:34,135][106226] Updated weights for policy 0, policy_version 1681014 (0.0008) [2023-12-28 07:20:34,696][106225] Updated weights for policy 1, policy_version 1685038 (0.0009) [2023-12-28 07:20:34,763][106225] Updated weights for policy 1, policy_version 1685048 (0.0010) [2023-12-28 07:20:34,830][106225] Updated weights for policy 1, policy_version 1685058 (0.0008) [2023-12-28 07:20:34,851][106226] Updated weights for policy 0, policy_version 1681024 (0.0006) [2023-12-28 07:20:34,903][106226] Updated weights for policy 0, policy_version 1681034 (0.0005) [2023-12-28 07:20:34,962][106226] Updated weights for policy 0, policy_version 1681044 (0.0006) [2023-12-28 07:20:35,580][106225] Updated weights for policy 1, policy_version 1685068 (0.0009) [2023-12-28 07:20:35,629][106226] Updated weights for policy 0, policy_version 1681054 (0.0008) [2023-12-28 07:20:35,652][106225] Updated weights for policy 1, policy_version 1685078 (0.0009) [2023-12-28 07:20:35,685][106226] Updated weights for policy 0, policy_version 1681064 (0.0008) [2023-12-28 07:20:35,714][106225] Updated weights for policy 1, policy_version 1685088 (0.0007) [2023-12-28 07:20:35,739][106226] Updated weights for policy 0, policy_version 1681074 (0.0009) [2023-12-28 07:20:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 861872128. Throughput: 0: 10098.8, 1: 9886.7. Samples: 861882220. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:36,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.407')] [2023-12-28 07:20:36,408][106225] Updated weights for policy 1, policy_version 1685098 (0.0008) [2023-12-28 07:20:36,469][106225] Updated weights for policy 1, policy_version 1685108 (0.0009) [2023-12-28 07:20:36,504][106226] Updated weights for policy 0, policy_version 1681084 (0.0007) [2023-12-28 07:20:36,531][106225] Updated weights for policy 1, policy_version 1685118 (0.0007) [2023-12-28 07:20:36,561][106226] Updated weights for policy 0, policy_version 1681094 (0.0006) [2023-12-28 07:20:36,594][106225] Updated weights for policy 1, policy_version 1685128 (0.0008) [2023-12-28 07:20:36,625][106226] Updated weights for policy 0, policy_version 1681104 (0.0007) [2023-12-28 07:20:37,198][106225] Updated weights for policy 1, policy_version 1685138 (0.0009) [2023-12-28 07:20:37,261][106225] Updated weights for policy 1, policy_version 1685148 (0.0009) [2023-12-28 07:20:37,307][106225] Updated weights for policy 1, policy_version 1685158 (0.0008) [2023-12-28 07:20:37,422][106226] Updated weights for policy 0, policy_version 1681114 (0.0009) [2023-12-28 07:20:37,484][106226] Updated weights for policy 0, policy_version 1681124 (0.0008) [2023-12-28 07:20:37,544][106226] Updated weights for policy 0, policy_version 1681134 (0.0009) [2023-12-28 07:20:37,607][106226] Updated weights for policy 0, policy_version 1681144 (0.0009) [2023-12-28 07:20:38,042][106225] Updated weights for policy 1, policy_version 1685168 (0.0008) [2023-12-28 07:20:38,097][106225] Updated weights for policy 1, policy_version 1685178 (0.0008) [2023-12-28 07:20:38,155][106225] Updated weights for policy 1, policy_version 1685188 (0.0006) [2023-12-28 07:20:38,359][106226] Updated weights for policy 0, policy_version 1681154 (0.0008) [2023-12-28 07:20:38,421][106226] Updated weights for policy 0, policy_version 1681164 (0.0008) [2023-12-28 07:20:38,479][106226] Updated weights for policy 0, policy_version 1681174 (0.0008) [2023-12-28 07:20:38,838][106225] Updated weights for policy 1, policy_version 1685198 (0.0008) [2023-12-28 07:20:38,898][106225] Updated weights for policy 1, policy_version 1685208 (0.0008) [2023-12-28 07:20:38,961][106225] Updated weights for policy 1, policy_version 1685218 (0.0008) [2023-12-28 07:20:39,154][106226] Updated weights for policy 0, policy_version 1681184 (0.0008) [2023-12-28 07:20:39,210][106226] Updated weights for policy 0, policy_version 1681194 (0.0009) [2023-12-28 07:20:39,276][106226] Updated weights for policy 0, policy_version 1681204 (0.0008) [2023-12-28 07:20:39,766][106225] Updated weights for policy 1, policy_version 1685228 (0.0009) [2023-12-28 07:20:39,830][106225] Updated weights for policy 1, policy_version 1685238 (0.0009) [2023-12-28 07:20:39,892][106225] Updated weights for policy 1, policy_version 1685248 (0.0008) [2023-12-28 07:20:39,960][106226] Updated weights for policy 0, policy_version 1681214 (0.0009) [2023-12-28 07:20:40,027][106226] Updated weights for policy 0, policy_version 1681224 (0.0007) [2023-12-28 07:20:40,091][106226] Updated weights for policy 0, policy_version 1681234 (0.0008) [2023-12-28 07:20:40,569][106225] Updated weights for policy 1, policy_version 1685258 (0.0008) [2023-12-28 07:20:40,629][106225] Updated weights for policy 1, policy_version 1685268 (0.0009) [2023-12-28 07:20:40,680][106225] Updated weights for policy 1, policy_version 1685278 (0.0008) [2023-12-28 07:20:40,728][106225] Updated weights for policy 1, policy_version 1685288 (0.0008) [2023-12-28 07:20:40,855][106226] Updated weights for policy 0, policy_version 1681244 (0.0009) [2023-12-28 07:20:40,911][106226] Updated weights for policy 0, policy_version 1681254 (0.0009) [2023-12-28 07:20:40,973][106226] Updated weights for policy 0, policy_version 1681264 (0.0010) [2023-12-28 07:20:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 861970432. Throughput: 0: 10088.0, 1: 9940.2. Samples: 861940984. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:41,175][105115] Avg episode reward: [(0, '-4.123'), (1, '-4.759')] [2023-12-28 07:20:41,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001681272_430481408.pth... [2023-12-28 07:20:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001685288_431489024.pth... [2023-12-28 07:20:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001680088_430178304.pth [2023-12-28 07:20:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001684168_431202304.pth [2023-12-28 07:20:41,439][106225] Updated weights for policy 1, policy_version 1685298 (0.0007) [2023-12-28 07:20:41,503][106225] Updated weights for policy 1, policy_version 1685308 (0.0008) [2023-12-28 07:20:41,566][106225] Updated weights for policy 1, policy_version 1685318 (0.0008) [2023-12-28 07:20:41,802][106226] Updated weights for policy 0, policy_version 1681274 (0.0008) [2023-12-28 07:20:41,871][106226] Updated weights for policy 0, policy_version 1681284 (0.0008) [2023-12-28 07:20:41,929][106226] Updated weights for policy 0, policy_version 1681294 (0.0006) [2023-12-28 07:20:41,989][106226] Updated weights for policy 0, policy_version 1681304 (0.0008) [2023-12-28 07:20:42,301][106225] Updated weights for policy 1, policy_version 1685328 (0.0009) [2023-12-28 07:20:42,372][106225] Updated weights for policy 1, policy_version 1685338 (0.0009) [2023-12-28 07:20:42,439][106225] Updated weights for policy 1, policy_version 1685348 (0.0007) [2023-12-28 07:20:42,700][106226] Updated weights for policy 0, policy_version 1681314 (0.0006) [2023-12-28 07:20:42,769][106226] Updated weights for policy 0, policy_version 1681324 (0.0006) [2023-12-28 07:20:42,837][106226] Updated weights for policy 0, policy_version 1681334 (0.0006) [2023-12-28 07:20:43,178][106225] Updated weights for policy 1, policy_version 1685358 (0.0006) [2023-12-28 07:20:43,247][106225] Updated weights for policy 1, policy_version 1685368 (0.0005) [2023-12-28 07:20:43,316][106225] Updated weights for policy 1, policy_version 1685378 (0.0005) [2023-12-28 07:20:43,424][106226] Updated weights for policy 0, policy_version 1681344 (0.0007) [2023-12-28 07:20:43,473][106226] Updated weights for policy 0, policy_version 1681354 (0.0005) [2023-12-28 07:20:43,527][106226] Updated weights for policy 0, policy_version 1681364 (0.0005) [2023-12-28 07:20:43,904][106225] Updated weights for policy 1, policy_version 1685388 (0.0007) [2023-12-28 07:20:43,956][106225] Updated weights for policy 1, policy_version 1685398 (0.0010) [2023-12-28 07:20:44,003][106225] Updated weights for policy 1, policy_version 1685408 (0.0010) [2023-12-28 07:20:44,123][106226] Updated weights for policy 0, policy_version 1681374 (0.0005) [2023-12-28 07:20:44,176][106226] Updated weights for policy 0, policy_version 1681384 (0.0005) [2023-12-28 07:20:44,223][106226] Updated weights for policy 0, policy_version 1681394 (0.0005) [2023-12-28 07:20:44,680][106225] Updated weights for policy 1, policy_version 1685418 (0.0010) [2023-12-28 07:20:44,733][106225] Updated weights for policy 1, policy_version 1685428 (0.0010) [2023-12-28 07:20:44,795][106225] Updated weights for policy 1, policy_version 1685438 (0.0009) [2023-12-28 07:20:44,856][106225] Updated weights for policy 1, policy_version 1685448 (0.0010) [2023-12-28 07:20:44,935][106226] Updated weights for policy 0, policy_version 1681404 (0.0008) [2023-12-28 07:20:44,991][106226] Updated weights for policy 0, policy_version 1681414 (0.0010) [2023-12-28 07:20:45,052][106226] Updated weights for policy 0, policy_version 1681424 (0.0007) [2023-12-28 07:20:45,589][106225] Updated weights for policy 1, policy_version 1685458 (0.0010) [2023-12-28 07:20:45,645][106225] Updated weights for policy 1, policy_version 1685468 (0.0010) [2023-12-28 07:20:45,683][106226] Updated weights for policy 0, policy_version 1681434 (0.0009) [2023-12-28 07:20:45,708][106225] Updated weights for policy 1, policy_version 1685478 (0.0010) [2023-12-28 07:20:45,737][106226] Updated weights for policy 0, policy_version 1681444 (0.0010) [2023-12-28 07:20:45,793][106226] Updated weights for policy 0, policy_version 1681454 (0.0010) [2023-12-28 07:20:45,853][106226] Updated weights for policy 0, policy_version 1681464 (0.0010) [2023-12-28 07:20:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 862068736. Throughput: 0: 10075.5, 1: 9819.9. Samples: 862058392. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:46,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.889')] [2023-12-28 07:20:46,372][106225] Updated weights for policy 1, policy_version 1685488 (0.0008) [2023-12-28 07:20:46,419][106225] Updated weights for policy 1, policy_version 1685498 (0.0008) [2023-12-28 07:20:46,475][106225] Updated weights for policy 1, policy_version 1685508 (0.0007) [2023-12-28 07:20:46,480][106226] Updated weights for policy 0, policy_version 1681474 (0.0007) [2023-12-28 07:20:46,549][106226] Updated weights for policy 0, policy_version 1681484 (0.0005) [2023-12-28 07:20:46,609][106226] Updated weights for policy 0, policy_version 1681494 (0.0006) [2023-12-28 07:20:47,133][106226] Updated weights for policy 0, policy_version 1681504 (0.0006) [2023-12-28 07:20:47,200][106226] Updated weights for policy 0, policy_version 1681514 (0.0005) [2023-12-28 07:20:47,277][106226] Updated weights for policy 0, policy_version 1681524 (0.0007) [2023-12-28 07:20:47,299][106225] Updated weights for policy 1, policy_version 1685518 (0.0008) [2023-12-28 07:20:47,359][106225] Updated weights for policy 1, policy_version 1685528 (0.0007) [2023-12-28 07:20:47,423][106225] Updated weights for policy 1, policy_version 1685538 (0.0006) [2023-12-28 07:20:47,859][106226] Updated weights for policy 0, policy_version 1681534 (0.0007) [2023-12-28 07:20:47,913][106226] Updated weights for policy 0, policy_version 1681544 (0.0005) [2023-12-28 07:20:47,965][106226] Updated weights for policy 0, policy_version 1681554 (0.0009) [2023-12-28 07:20:48,046][106225] Updated weights for policy 1, policy_version 1685548 (0.0006) [2023-12-28 07:20:48,111][106225] Updated weights for policy 1, policy_version 1685558 (0.0009) [2023-12-28 07:20:48,167][106225] Updated weights for policy 1, policy_version 1685568 (0.0009) [2023-12-28 07:20:48,703][106226] Updated weights for policy 0, policy_version 1681564 (0.0009) [2023-12-28 07:20:48,779][106226] Updated weights for policy 0, policy_version 1681574 (0.0010) [2023-12-28 07:20:48,827][106225] Updated weights for policy 1, policy_version 1685578 (0.0009) [2023-12-28 07:20:48,838][106226] Updated weights for policy 0, policy_version 1681584 (0.0008) [2023-12-28 07:20:48,876][106225] Updated weights for policy 1, policy_version 1685588 (0.0006) [2023-12-28 07:20:48,930][106225] Updated weights for policy 1, policy_version 1685598 (0.0008) [2023-12-28 07:20:48,980][106225] Updated weights for policy 1, policy_version 1685608 (0.0006) [2023-12-28 07:20:49,617][106226] Updated weights for policy 0, policy_version 1681594 (0.0007) [2023-12-28 07:20:49,684][106226] Updated weights for policy 0, policy_version 1681604 (0.0005) [2023-12-28 07:20:49,733][106225] Updated weights for policy 1, policy_version 1685618 (0.0006) [2023-12-28 07:20:49,746][106226] Updated weights for policy 0, policy_version 1681614 (0.0005) [2023-12-28 07:20:49,793][106225] Updated weights for policy 1, policy_version 1685628 (0.0006) [2023-12-28 07:20:49,807][106226] Updated weights for policy 0, policy_version 1681624 (0.0008) [2023-12-28 07:20:49,860][106225] Updated weights for policy 1, policy_version 1685638 (0.0008) [2023-12-28 07:20:50,440][106226] Updated weights for policy 0, policy_version 1681634 (0.0008) [2023-12-28 07:20:50,501][106226] Updated weights for policy 0, policy_version 1681644 (0.0007) [2023-12-28 07:20:50,565][106226] Updated weights for policy 0, policy_version 1681654 (0.0008) [2023-12-28 07:20:50,662][106225] Updated weights for policy 1, policy_version 1685648 (0.0010) [2023-12-28 07:20:50,724][106225] Updated weights for policy 1, policy_version 1685658 (0.0010) [2023-12-28 07:20:50,785][106225] Updated weights for policy 1, policy_version 1685668 (0.0008) [2023-12-28 07:20:51,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 862167040. Throughput: 0: 10054.2, 1: 9789.6. Samples: 862178176. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:51,176][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.495')] [2023-12-28 07:20:51,368][106226] Updated weights for policy 0, policy_version 1681664 (0.0009) [2023-12-28 07:20:51,425][106226] Updated weights for policy 0, policy_version 1681674 (0.0008) [2023-12-28 07:20:51,485][106226] Updated weights for policy 0, policy_version 1681684 (0.0009) [2023-12-28 07:20:51,491][106225] Updated weights for policy 1, policy_version 1685678 (0.0006) [2023-12-28 07:20:51,547][106225] Updated weights for policy 1, policy_version 1685688 (0.0008) [2023-12-28 07:20:51,602][106225] Updated weights for policy 1, policy_version 1685698 (0.0007) [2023-12-28 07:20:52,251][106225] Updated weights for policy 1, policy_version 1685708 (0.0008) [2023-12-28 07:20:52,312][106225] Updated weights for policy 1, policy_version 1685718 (0.0009) [2023-12-28 07:20:52,318][106226] Updated weights for policy 0, policy_version 1681694 (0.0008) [2023-12-28 07:20:52,382][106225] Updated weights for policy 1, policy_version 1685728 (0.0008) [2023-12-28 07:20:52,393][106226] Updated weights for policy 0, policy_version 1681704 (0.0007) [2023-12-28 07:20:52,448][106226] Updated weights for policy 0, policy_version 1681714 (0.0008) [2023-12-28 07:20:53,127][106225] Updated weights for policy 1, policy_version 1685738 (0.0009) [2023-12-28 07:20:53,182][106225] Updated weights for policy 1, policy_version 1685748 (0.0010) [2023-12-28 07:20:53,204][106226] Updated weights for policy 0, policy_version 1681724 (0.0007) [2023-12-28 07:20:53,237][106225] Updated weights for policy 1, policy_version 1685758 (0.0010) [2023-12-28 07:20:53,268][106226] Updated weights for policy 0, policy_version 1681734 (0.0008) [2023-12-28 07:20:53,303][106225] Updated weights for policy 1, policy_version 1685768 (0.0005) [2023-12-28 07:20:53,333][106226] Updated weights for policy 0, policy_version 1681744 (0.0011) [2023-12-28 07:20:53,998][106226] Updated weights for policy 0, policy_version 1681754 (0.0011) [2023-12-28 07:20:54,013][106225] Updated weights for policy 1, policy_version 1685778 (0.0010) [2023-12-28 07:20:54,056][106226] Updated weights for policy 0, policy_version 1681764 (0.0010) [2023-12-28 07:20:54,069][106225] Updated weights for policy 1, policy_version 1685788 (0.0010) [2023-12-28 07:20:54,116][106226] Updated weights for policy 0, policy_version 1681774 (0.0010) [2023-12-28 07:20:54,125][106225] Updated weights for policy 1, policy_version 1685798 (0.0010) [2023-12-28 07:20:54,174][106226] Updated weights for policy 0, policy_version 1681784 (0.0007) [2023-12-28 07:20:54,791][106225] Updated weights for policy 1, policy_version 1685808 (0.0007) [2023-12-28 07:20:54,793][106226] Updated weights for policy 0, policy_version 1681794 (0.0007) [2023-12-28 07:20:54,851][106225] Updated weights for policy 1, policy_version 1685818 (0.0005) [2023-12-28 07:20:54,851][106226] Updated weights for policy 0, policy_version 1681804 (0.0006) [2023-12-28 07:20:54,903][106225] Updated weights for policy 1, policy_version 1685828 (0.0005) [2023-12-28 07:20:54,916][106226] Updated weights for policy 0, policy_version 1681814 (0.0005) [2023-12-28 07:20:55,496][106226] Updated weights for policy 0, policy_version 1681824 (0.0008) [2023-12-28 07:20:55,508][106225] Updated weights for policy 1, policy_version 1685838 (0.0008) [2023-12-28 07:20:55,552][106225] Updated weights for policy 1, policy_version 1685848 (0.0010) [2023-12-28 07:20:55,554][106226] Updated weights for policy 0, policy_version 1681834 (0.0008) [2023-12-28 07:20:55,609][106225] Updated weights for policy 1, policy_version 1685858 (0.0010) [2023-12-28 07:20:55,611][106226] Updated weights for policy 0, policy_version 1681844 (0.0010) [2023-12-28 07:20:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 862265344. Throughput: 0: 9975.7, 1: 9796.7. Samples: 862235060. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:20:56,176][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.713')] [2023-12-28 07:20:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001681848_430628864.pth... [2023-12-28 07:20:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001680696_430333952.pth [2023-12-28 07:20:56,212][106225] Updated weights for policy 1, policy_version 1685868 (0.0010) [2023-12-28 07:20:56,268][106225] Updated weights for policy 1, policy_version 1685878 (0.0006) [2023-12-28 07:20:56,271][106226] Updated weights for policy 0, policy_version 1681854 (0.0010) [2023-12-28 07:20:56,324][106225] Updated weights for policy 1, policy_version 1685888 (0.0005) [2023-12-28 07:20:56,333][106226] Updated weights for policy 0, policy_version 1681864 (0.0011) [2023-12-28 07:20:56,366][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001685896_431644672.pth... [2023-12-28 07:20:56,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001684744_431349760.pth [2023-12-28 07:20:56,396][106226] Updated weights for policy 0, policy_version 1681874 (0.0010) [2023-12-28 07:20:56,924][106225] Updated weights for policy 1, policy_version 1685898 (0.0006) [2023-12-28 07:20:56,977][106225] Updated weights for policy 1, policy_version 1685908 (0.0010) [2023-12-28 07:20:57,023][106225] Updated weights for policy 1, policy_version 1685918 (0.0010) [2023-12-28 07:20:57,073][106225] Updated weights for policy 1, policy_version 1685928 (0.0010) [2023-12-28 07:20:57,100][106226] Updated weights for policy 0, policy_version 1681884 (0.0010) [2023-12-28 07:20:57,163][106226] Updated weights for policy 0, policy_version 1681894 (0.0007) [2023-12-28 07:20:57,223][106226] Updated weights for policy 0, policy_version 1681904 (0.0008) [2023-12-28 07:20:57,800][106225] Updated weights for policy 1, policy_version 1685938 (0.0006) [2023-12-28 07:20:57,856][106225] Updated weights for policy 1, policy_version 1685948 (0.0005) [2023-12-28 07:20:57,911][106225] Updated weights for policy 1, policy_version 1685958 (0.0005) [2023-12-28 07:20:57,927][106226] Updated weights for policy 0, policy_version 1681914 (0.0007) [2023-12-28 07:20:57,986][106226] Updated weights for policy 0, policy_version 1681924 (0.0009) [2023-12-28 07:20:58,044][106226] Updated weights for policy 0, policy_version 1681934 (0.0008) [2023-12-28 07:20:58,091][106226] Updated weights for policy 0, policy_version 1681944 (0.0008) [2023-12-28 07:20:58,580][106225] Updated weights for policy 1, policy_version 1685968 (0.0008) [2023-12-28 07:20:58,647][106225] Updated weights for policy 1, policy_version 1685978 (0.0008) [2023-12-28 07:20:58,718][106225] Updated weights for policy 1, policy_version 1685988 (0.0008) [2023-12-28 07:20:58,992][106226] Updated weights for policy 0, policy_version 1681954 (0.0006) [2023-12-28 07:20:59,047][106226] Updated weights for policy 0, policy_version 1681964 (0.0009) [2023-12-28 07:20:59,115][106226] Updated weights for policy 0, policy_version 1681974 (0.0007) [2023-12-28 07:20:59,530][106225] Updated weights for policy 1, policy_version 1685998 (0.0006) [2023-12-28 07:20:59,585][106225] Updated weights for policy 1, policy_version 1686008 (0.0006) [2023-12-28 07:20:59,644][106225] Updated weights for policy 1, policy_version 1686018 (0.0007) [2023-12-28 07:20:59,779][106226] Updated weights for policy 0, policy_version 1681984 (0.0009) [2023-12-28 07:20:59,839][106226] Updated weights for policy 0, policy_version 1681994 (0.0008) [2023-12-28 07:20:59,912][106226] Updated weights for policy 0, policy_version 1682004 (0.0009) [2023-12-28 07:21:00,273][106225] Updated weights for policy 1, policy_version 1686028 (0.0006) [2023-12-28 07:21:00,325][106225] Updated weights for policy 1, policy_version 1686038 (0.0008) [2023-12-28 07:21:00,381][106225] Updated weights for policy 1, policy_version 1686048 (0.0008) [2023-12-28 07:21:00,593][106226] Updated weights for policy 0, policy_version 1682014 (0.0007) [2023-12-28 07:21:00,642][106226] Updated weights for policy 0, policy_version 1682024 (0.0008) [2023-12-28 07:21:00,707][106226] Updated weights for policy 0, policy_version 1682034 (0.0008) [2023-12-28 07:21:00,973][106225] Updated weights for policy 1, policy_version 1686058 (0.0007) [2023-12-28 07:21:01,034][106225] Updated weights for policy 1, policy_version 1686068 (0.0006) [2023-12-28 07:21:01,094][106225] Updated weights for policy 1, policy_version 1686078 (0.0007) [2023-12-28 07:21:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 862363648. Throughput: 0: 9954.2, 1: 9879.7. Samples: 862355924. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:01,175][105115] Avg episode reward: [(0, '-4.311'), (1, '-4.749')] [2023-12-28 07:21:01,178][106225] Updated weights for policy 1, policy_version 1686088 (0.0007) [2023-12-28 07:21:01,407][106226] Updated weights for policy 0, policy_version 1682044 (0.0010) [2023-12-28 07:21:01,464][106226] Updated weights for policy 0, policy_version 1682054 (0.0009) [2023-12-28 07:21:01,519][106226] Updated weights for policy 0, policy_version 1682064 (0.0008) [2023-12-28 07:21:01,806][106225] Updated weights for policy 1, policy_version 1686098 (0.0005) [2023-12-28 07:21:01,875][106225] Updated weights for policy 1, policy_version 1686108 (0.0006) [2023-12-28 07:21:01,937][106225] Updated weights for policy 1, policy_version 1686118 (0.0008) [2023-12-28 07:21:02,176][106226] Updated weights for policy 0, policy_version 1682074 (0.0008) [2023-12-28 07:21:02,233][106226] Updated weights for policy 0, policy_version 1682084 (0.0008) [2023-12-28 07:21:02,295][106226] Updated weights for policy 0, policy_version 1682094 (0.0008) [2023-12-28 07:21:02,357][106226] Updated weights for policy 0, policy_version 1682104 (0.0006) [2023-12-28 07:21:02,689][106225] Updated weights for policy 1, policy_version 1686128 (0.0010) [2023-12-28 07:21:02,752][106225] Updated weights for policy 1, policy_version 1686138 (0.0010) [2023-12-28 07:21:02,820][106225] Updated weights for policy 1, policy_version 1686148 (0.0006) [2023-12-28 07:21:03,002][106226] Updated weights for policy 0, policy_version 1682114 (0.0007) [2023-12-28 07:21:03,056][106226] Updated weights for policy 0, policy_version 1682124 (0.0007) [2023-12-28 07:21:03,107][106226] Updated weights for policy 0, policy_version 1682134 (0.0005) [2023-12-28 07:21:03,377][106225] Updated weights for policy 1, policy_version 1686158 (0.0007) [2023-12-28 07:21:03,442][106225] Updated weights for policy 1, policy_version 1686168 (0.0010) [2023-12-28 07:21:03,502][106225] Updated weights for policy 1, policy_version 1686178 (0.0010) [2023-12-28 07:21:03,730][106226] Updated weights for policy 0, policy_version 1682144 (0.0005) [2023-12-28 07:21:03,791][106226] Updated weights for policy 0, policy_version 1682154 (0.0008) [2023-12-28 07:21:03,859][106226] Updated weights for policy 0, policy_version 1682164 (0.0012) [2023-12-28 07:21:04,267][106225] Updated weights for policy 1, policy_version 1686188 (0.0010) [2023-12-28 07:21:04,334][106225] Updated weights for policy 1, policy_version 1686198 (0.0006) [2023-12-28 07:21:04,392][106225] Updated weights for policy 1, policy_version 1686208 (0.0007) [2023-12-28 07:21:04,506][106226] Updated weights for policy 0, policy_version 1682174 (0.0009) [2023-12-28 07:21:04,567][106226] Updated weights for policy 0, policy_version 1682184 (0.0009) [2023-12-28 07:21:04,627][106226] Updated weights for policy 0, policy_version 1682194 (0.0008) [2023-12-28 07:21:04,988][106225] Updated weights for policy 1, policy_version 1686218 (0.0007) [2023-12-28 07:21:05,049][106225] Updated weights for policy 1, policy_version 1686228 (0.0005) [2023-12-28 07:21:05,115][106225] Updated weights for policy 1, policy_version 1686238 (0.0006) [2023-12-28 07:21:05,165][106225] Updated weights for policy 1, policy_version 1686248 (0.0005) [2023-12-28 07:21:05,316][106226] Updated weights for policy 0, policy_version 1682204 (0.0007) [2023-12-28 07:21:05,362][106226] Updated weights for policy 0, policy_version 1682214 (0.0011) [2023-12-28 07:21:05,416][106226] Updated weights for policy 0, policy_version 1682224 (0.0009) [2023-12-28 07:21:05,824][106225] Updated weights for policy 1, policy_version 1686258 (0.0009) [2023-12-28 07:21:05,893][106225] Updated weights for policy 1, policy_version 1686268 (0.0009) [2023-12-28 07:21:05,949][106225] Updated weights for policy 1, policy_version 1686278 (0.0008) [2023-12-28 07:21:06,039][106226] Updated weights for policy 0, policy_version 1682234 (0.0009) [2023-12-28 07:21:06,094][106226] Updated weights for policy 0, policy_version 1682244 (0.0009) [2023-12-28 07:21:06,159][106226] Updated weights for policy 0, policy_version 1682254 (0.0009) [2023-12-28 07:21:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 862470144. Throughput: 0: 10080.6, 1: 9933.3. Samples: 862482024. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:06,175][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.899')] [2023-12-28 07:21:06,223][106226] Updated weights for policy 0, policy_version 1682264 (0.0008) [2023-12-28 07:21:06,703][106225] Updated weights for policy 1, policy_version 1686288 (0.0008) [2023-12-28 07:21:06,759][106225] Updated weights for policy 1, policy_version 1686298 (0.0008) [2023-12-28 07:21:06,818][106225] Updated weights for policy 1, policy_version 1686308 (0.0009) [2023-12-28 07:21:06,890][106226] Updated weights for policy 0, policy_version 1682274 (0.0005) [2023-12-28 07:21:06,952][106226] Updated weights for policy 0, policy_version 1682284 (0.0005) [2023-12-28 07:21:07,021][106226] Updated weights for policy 0, policy_version 1682294 (0.0006) [2023-12-28 07:21:07,549][106225] Updated weights for policy 1, policy_version 1686318 (0.0008) [2023-12-28 07:21:07,604][106225] Updated weights for policy 1, policy_version 1686329 (0.0008) [2023-12-28 07:21:07,614][106226] Updated weights for policy 0, policy_version 1682304 (0.0007) [2023-12-28 07:21:07,664][106225] Updated weights for policy 1, policy_version 1686339 (0.0008) [2023-12-28 07:21:07,668][106226] Updated weights for policy 0, policy_version 1682314 (0.0007) [2023-12-28 07:21:07,738][106226] Updated weights for policy 0, policy_version 1682324 (0.0006) [2023-12-28 07:21:08,338][106225] Updated weights for policy 1, policy_version 1686349 (0.0007) [2023-12-28 07:21:08,344][106226] Updated weights for policy 0, policy_version 1682334 (0.0007) [2023-12-28 07:21:08,396][106225] Updated weights for policy 1, policy_version 1686359 (0.0006) [2023-12-28 07:21:08,412][106226] Updated weights for policy 0, policy_version 1682344 (0.0008) [2023-12-28 07:21:08,457][106225] Updated weights for policy 1, policy_version 1686369 (0.0008) [2023-12-28 07:21:08,472][106226] Updated weights for policy 0, policy_version 1682354 (0.0007) [2023-12-28 07:21:09,108][106225] Updated weights for policy 1, policy_version 1686379 (0.0008) [2023-12-28 07:21:09,151][106226] Updated weights for policy 0, policy_version 1682364 (0.0006) [2023-12-28 07:21:09,165][106225] Updated weights for policy 1, policy_version 1686389 (0.0005) [2023-12-28 07:21:09,214][106226] Updated weights for policy 0, policy_version 1682374 (0.0006) [2023-12-28 07:21:09,222][106225] Updated weights for policy 1, policy_version 1686399 (0.0006) [2023-12-28 07:21:09,280][106226] Updated weights for policy 0, policy_version 1682384 (0.0007) [2023-12-28 07:21:09,913][106225] Updated weights for policy 1, policy_version 1686409 (0.0008) [2023-12-28 07:21:09,979][106225] Updated weights for policy 1, policy_version 1686419 (0.0005) [2023-12-28 07:21:09,988][106226] Updated weights for policy 0, policy_version 1682394 (0.0010) [2023-12-28 07:21:10,040][106225] Updated weights for policy 1, policy_version 1686429 (0.0007) [2023-12-28 07:21:10,050][106226] Updated weights for policy 0, policy_version 1682404 (0.0008) [2023-12-28 07:21:10,094][106225] Updated weights for policy 1, policy_version 1686439 (0.0007) [2023-12-28 07:21:10,106][106226] Updated weights for policy 0, policy_version 1682414 (0.0008) [2023-12-28 07:21:10,168][106226] Updated weights for policy 0, policy_version 1682424 (0.0008) [2023-12-28 07:21:10,775][106225] Updated weights for policy 1, policy_version 1686449 (0.0006) [2023-12-28 07:21:10,833][106225] Updated weights for policy 1, policy_version 1686459 (0.0008) [2023-12-28 07:21:10,840][106226] Updated weights for policy 0, policy_version 1682434 (0.0008) [2023-12-28 07:21:10,892][106225] Updated weights for policy 1, policy_version 1686469 (0.0005) [2023-12-28 07:21:10,902][106226] Updated weights for policy 0, policy_version 1682444 (0.0009) [2023-12-28 07:21:10,959][106226] Updated weights for policy 0, policy_version 1682454 (0.0011) [2023-12-28 07:21:11,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 862576640. Throughput: 0: 10155.6, 1: 9922.0. Samples: 862542392. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:11,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.921')] [2023-12-28 07:21:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001686472_431792128.pth... [2023-12-28 07:21:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001682456_430784512.pth... [2023-12-28 07:21:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001681272_430481408.pth [2023-12-28 07:21:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001685288_431489024.pth [2023-12-28 07:21:11,591][106225] Updated weights for policy 1, policy_version 1686479 (0.0006) [2023-12-28 07:21:11,661][106225] Updated weights for policy 1, policy_version 1686489 (0.0007) [2023-12-28 07:21:11,703][106226] Updated weights for policy 0, policy_version 1682464 (0.0010) [2023-12-28 07:21:11,730][106225] Updated weights for policy 1, policy_version 1686499 (0.0007) [2023-12-28 07:21:11,770][106226] Updated weights for policy 0, policy_version 1682474 (0.0009) [2023-12-28 07:21:11,837][106226] Updated weights for policy 0, policy_version 1682484 (0.0008) [2023-12-28 07:21:12,502][106225] Updated weights for policy 1, policy_version 1686509 (0.0007) [2023-12-28 07:21:12,526][106226] Updated weights for policy 0, policy_version 1682494 (0.0009) [2023-12-28 07:21:12,559][106225] Updated weights for policy 1, policy_version 1686519 (0.0007) [2023-12-28 07:21:12,587][106226] Updated weights for policy 0, policy_version 1682504 (0.0006) [2023-12-28 07:21:12,620][106225] Updated weights for policy 1, policy_version 1686529 (0.0008) [2023-12-28 07:21:12,668][106226] Updated weights for policy 0, policy_version 1682514 (0.0007) [2023-12-28 07:21:13,326][106225] Updated weights for policy 1, policy_version 1686539 (0.0007) [2023-12-28 07:21:13,383][106225] Updated weights for policy 1, policy_version 1686549 (0.0006) [2023-12-28 07:21:13,421][106226] Updated weights for policy 0, policy_version 1682524 (0.0008) [2023-12-28 07:21:13,447][106225] Updated weights for policy 1, policy_version 1686559 (0.0008) [2023-12-28 07:21:13,470][106226] Updated weights for policy 0, policy_version 1682534 (0.0007) [2023-12-28 07:21:13,522][106226] Updated weights for policy 0, policy_version 1682544 (0.0008) [2023-12-28 07:21:14,098][106225] Updated weights for policy 1, policy_version 1686569 (0.0007) [2023-12-28 07:21:14,157][106225] Updated weights for policy 1, policy_version 1686579 (0.0008) [2023-12-28 07:21:14,213][106225] Updated weights for policy 1, policy_version 1686589 (0.0008) [2023-12-28 07:21:14,281][106225] Updated weights for policy 1, policy_version 1686599 (0.0005) [2023-12-28 07:21:14,283][106226] Updated weights for policy 0, policy_version 1682554 (0.0008) [2023-12-28 07:21:14,342][106226] Updated weights for policy 0, policy_version 1682564 (0.0008) [2023-12-28 07:21:14,405][106226] Updated weights for policy 0, policy_version 1682574 (0.0009) [2023-12-28 07:21:14,462][106226] Updated weights for policy 0, policy_version 1682584 (0.0010) [2023-12-28 07:21:15,005][106225] Updated weights for policy 1, policy_version 1686609 (0.0008) [2023-12-28 07:21:15,067][106225] Updated weights for policy 1, policy_version 1686619 (0.0008) [2023-12-28 07:21:15,131][106225] Updated weights for policy 1, policy_version 1686629 (0.0006) [2023-12-28 07:21:15,144][106226] Updated weights for policy 0, policy_version 1682594 (0.0011) [2023-12-28 07:21:15,206][106226] Updated weights for policy 0, policy_version 1682604 (0.0011) [2023-12-28 07:21:15,270][106226] Updated weights for policy 0, policy_version 1682614 (0.0007) [2023-12-28 07:21:15,850][106225] Updated weights for policy 1, policy_version 1686639 (0.0007) [2023-12-28 07:21:15,903][106225] Updated weights for policy 1, policy_version 1686649 (0.0007) [2023-12-28 07:21:15,931][106226] Updated weights for policy 0, policy_version 1682624 (0.0010) [2023-12-28 07:21:15,949][106225] Updated weights for policy 1, policy_version 1686659 (0.0007) [2023-12-28 07:21:15,981][106226] Updated weights for policy 0, policy_version 1682634 (0.0010) [2023-12-28 07:21:16,031][106226] Updated weights for policy 0, policy_version 1682644 (0.0010) [2023-12-28 07:21:16,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 862674944. Throughput: 0: 9999.7, 1: 9885.5. Samples: 862659496. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:16,176][105115] Avg episode reward: [(0, '-4.631'), (1, '-4.920')] [2023-12-28 07:21:16,671][106225] Updated weights for policy 1, policy_version 1686669 (0.0006) [2023-12-28 07:21:16,724][106225] Updated weights for policy 1, policy_version 1686679 (0.0008) [2023-12-28 07:21:16,755][106226] Updated weights for policy 0, policy_version 1682654 (0.0009) [2023-12-28 07:21:16,780][106225] Updated weights for policy 1, policy_version 1686689 (0.0006) [2023-12-28 07:21:16,804][106226] Updated weights for policy 0, policy_version 1682664 (0.0007) [2023-12-28 07:21:16,857][106226] Updated weights for policy 0, policy_version 1682674 (0.0007) [2023-12-28 07:21:17,436][106225] Updated weights for policy 1, policy_version 1686699 (0.0006) [2023-12-28 07:21:17,499][106225] Updated weights for policy 1, policy_version 1686709 (0.0007) [2023-12-28 07:21:17,501][106226] Updated weights for policy 0, policy_version 1682684 (0.0007) [2023-12-28 07:21:17,555][106225] Updated weights for policy 1, policy_version 1686719 (0.0008) [2023-12-28 07:21:17,560][106226] Updated weights for policy 0, policy_version 1682694 (0.0007) [2023-12-28 07:21:17,615][106226] Updated weights for policy 0, policy_version 1682704 (0.0010) [2023-12-28 07:21:18,191][106226] Updated weights for policy 0, policy_version 1682714 (0.0008) [2023-12-28 07:21:18,250][106226] Updated weights for policy 0, policy_version 1682724 (0.0005) [2023-12-28 07:21:18,285][106225] Updated weights for policy 1, policy_version 1686729 (0.0007) [2023-12-28 07:21:18,306][106226] Updated weights for policy 0, policy_version 1682734 (0.0005) [2023-12-28 07:21:18,350][106225] Updated weights for policy 1, policy_version 1686739 (0.0008) [2023-12-28 07:21:18,374][106226] Updated weights for policy 0, policy_version 1682744 (0.0008) [2023-12-28 07:21:18,410][106225] Updated weights for policy 1, policy_version 1686749 (0.0009) [2023-12-28 07:21:18,470][106225] Updated weights for policy 1, policy_version 1686759 (0.0008) [2023-12-28 07:21:19,091][106226] Updated weights for policy 0, policy_version 1682754 (0.0008) [2023-12-28 07:21:19,148][106226] Updated weights for policy 0, policy_version 1682764 (0.0008) [2023-12-28 07:21:19,181][106225] Updated weights for policy 1, policy_version 1686769 (0.0010) [2023-12-28 07:21:19,206][106226] Updated weights for policy 0, policy_version 1682774 (0.0006) [2023-12-28 07:21:19,233][106225] Updated weights for policy 1, policy_version 1686779 (0.0010) [2023-12-28 07:21:19,294][106225] Updated weights for policy 1, policy_version 1686789 (0.0010) [2023-12-28 07:21:19,968][106226] Updated weights for policy 0, policy_version 1682784 (0.0009) [2023-12-28 07:21:20,032][106226] Updated weights for policy 0, policy_version 1682794 (0.0009) [2023-12-28 07:21:20,086][106226] Updated weights for policy 0, policy_version 1682804 (0.0006) [2023-12-28 07:21:20,088][106225] Updated weights for policy 1, policy_version 1686799 (0.0011) [2023-12-28 07:21:20,149][106225] Updated weights for policy 1, policy_version 1686809 (0.0011) [2023-12-28 07:21:20,207][106225] Updated weights for policy 1, policy_version 1686819 (0.0011) [2023-12-28 07:21:20,880][106225] Updated weights for policy 1, policy_version 1686829 (0.0008) [2023-12-28 07:21:20,914][106226] Updated weights for policy 0, policy_version 1682814 (0.0007) [2023-12-28 07:21:20,941][106225] Updated weights for policy 1, policy_version 1686839 (0.0007) [2023-12-28 07:21:20,977][106226] Updated weights for policy 0, policy_version 1682824 (0.0009) [2023-12-28 07:21:21,006][106225] Updated weights for policy 1, policy_version 1686849 (0.0008) [2023-12-28 07:21:21,041][106226] Updated weights for policy 0, policy_version 1682834 (0.0007) [2023-12-28 07:21:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 862773248. Throughput: 0: 9955.3, 1: 9924.3. Samples: 862776804. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:21,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.613')] [2023-12-28 07:21:21,770][106225] Updated weights for policy 1, policy_version 1686859 (0.0008) [2023-12-28 07:21:21,816][106226] Updated weights for policy 0, policy_version 1682844 (0.0008) [2023-12-28 07:21:21,826][106225] Updated weights for policy 1, policy_version 1686869 (0.0008) [2023-12-28 07:21:21,876][106226] Updated weights for policy 0, policy_version 1682854 (0.0007) [2023-12-28 07:21:21,879][106225] Updated weights for policy 1, policy_version 1686879 (0.0007) [2023-12-28 07:21:21,939][106226] Updated weights for policy 0, policy_version 1682864 (0.0006) [2023-12-28 07:21:22,599][106225] Updated weights for policy 1, policy_version 1686889 (0.0008) [2023-12-28 07:21:22,662][106225] Updated weights for policy 1, policy_version 1686899 (0.0006) [2023-12-28 07:21:22,699][106226] Updated weights for policy 0, policy_version 1682874 (0.0007) [2023-12-28 07:21:22,721][106225] Updated weights for policy 1, policy_version 1686909 (0.0006) [2023-12-28 07:21:22,763][106226] Updated weights for policy 0, policy_version 1682884 (0.0006) [2023-12-28 07:21:22,781][106225] Updated weights for policy 1, policy_version 1686919 (0.0008) [2023-12-28 07:21:22,826][106226] Updated weights for policy 0, policy_version 1682894 (0.0008) [2023-12-28 07:21:22,890][106226] Updated weights for policy 0, policy_version 1682904 (0.0009) [2023-12-28 07:21:23,523][106225] Updated weights for policy 1, policy_version 1686929 (0.0008) [2023-12-28 07:21:23,576][106225] Updated weights for policy 1, policy_version 1686939 (0.0009) [2023-12-28 07:21:23,618][106226] Updated weights for policy 0, policy_version 1682914 (0.0005) [2023-12-28 07:21:23,640][106225] Updated weights for policy 1, policy_version 1686949 (0.0006) [2023-12-28 07:21:23,690][106226] Updated weights for policy 0, policy_version 1682924 (0.0005) [2023-12-28 07:21:23,758][106226] Updated weights for policy 0, policy_version 1682934 (0.0006) [2023-12-28 07:21:24,258][106225] Updated weights for policy 1, policy_version 1686959 (0.0008) [2023-12-28 07:21:24,310][106225] Updated weights for policy 1, policy_version 1686969 (0.0005) [2023-12-28 07:21:24,358][106225] Updated weights for policy 1, policy_version 1686979 (0.0005) [2023-12-28 07:21:24,456][106226] Updated weights for policy 0, policy_version 1682944 (0.0009) [2023-12-28 07:21:24,516][106226] Updated weights for policy 0, policy_version 1682954 (0.0011) [2023-12-28 07:21:24,575][106226] Updated weights for policy 0, policy_version 1682964 (0.0010) [2023-12-28 07:21:25,109][106225] Updated weights for policy 1, policy_version 1686989 (0.0006) [2023-12-28 07:21:25,168][106225] Updated weights for policy 1, policy_version 1686999 (0.0006) [2023-12-28 07:21:25,170][106226] Updated weights for policy 0, policy_version 1682974 (0.0005) [2023-12-28 07:21:25,228][106226] Updated weights for policy 0, policy_version 1682984 (0.0009) [2023-12-28 07:21:25,233][106225] Updated weights for policy 1, policy_version 1687009 (0.0005) [2023-12-28 07:21:25,281][106226] Updated weights for policy 0, policy_version 1682994 (0.0006) [2023-12-28 07:21:25,891][106226] Updated weights for policy 0, policy_version 1683004 (0.0009) [2023-12-28 07:21:25,904][106225] Updated weights for policy 1, policy_version 1687019 (0.0007) [2023-12-28 07:21:25,947][106226] Updated weights for policy 0, policy_version 1683014 (0.0010) [2023-12-28 07:21:25,956][106225] Updated weights for policy 1, policy_version 1687029 (0.0007) [2023-12-28 07:21:25,999][106226] Updated weights for policy 0, policy_version 1683024 (0.0005) [2023-12-28 07:21:26,010][106225] Updated weights for policy 1, policy_version 1687039 (0.0008) [2023-12-28 07:21:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 862871552. Throughput: 0: 9940.1, 1: 9874.9. Samples: 862832660. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:26,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.909')] [2023-12-28 07:21:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001683032_430931968.pth... [2023-12-28 07:21:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001687048_431939584.pth... [2023-12-28 07:21:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001681848_430628864.pth [2023-12-28 07:21:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001685896_431644672.pth [2023-12-28 07:21:26,664][106226] Updated weights for policy 0, policy_version 1683034 (0.0007) [2023-12-28 07:21:26,719][106226] Updated weights for policy 0, policy_version 1683044 (0.0010) [2023-12-28 07:21:26,727][106225] Updated weights for policy 1, policy_version 1687049 (0.0008) [2023-12-28 07:21:26,781][106225] Updated weights for policy 1, policy_version 1687059 (0.0006) [2023-12-28 07:21:26,785][106226] Updated weights for policy 0, policy_version 1683054 (0.0010) [2023-12-28 07:21:26,837][106226] Updated weights for policy 0, policy_version 1683064 (0.0010) [2023-12-28 07:21:26,839][106225] Updated weights for policy 1, policy_version 1687069 (0.0006) [2023-12-28 07:21:26,902][106225] Updated weights for policy 1, policy_version 1687079 (0.0008) [2023-12-28 07:21:27,412][106226] Updated weights for policy 0, policy_version 1683074 (0.0005) [2023-12-28 07:21:27,467][106226] Updated weights for policy 0, policy_version 1683084 (0.0005) [2023-12-28 07:21:27,528][106226] Updated weights for policy 0, policy_version 1683094 (0.0005) [2023-12-28 07:21:27,544][106225] Updated weights for policy 1, policy_version 1687089 (0.0008) [2023-12-28 07:21:27,593][106225] Updated weights for policy 1, policy_version 1687099 (0.0005) [2023-12-28 07:21:27,645][106225] Updated weights for policy 1, policy_version 1687109 (0.0008) [2023-12-28 07:21:28,163][106226] Updated weights for policy 0, policy_version 1683104 (0.0009) [2023-12-28 07:21:28,222][106226] Updated weights for policy 0, policy_version 1683114 (0.0010) [2023-12-28 07:21:28,277][106226] Updated weights for policy 0, policy_version 1683124 (0.0010) [2023-12-28 07:21:28,370][106225] Updated weights for policy 1, policy_version 1687119 (0.0008) [2023-12-28 07:21:28,428][106225] Updated weights for policy 1, policy_version 1687129 (0.0008) [2023-12-28 07:21:28,490][106225] Updated weights for policy 1, policy_version 1687139 (0.0008) [2023-12-28 07:21:29,001][106226] Updated weights for policy 0, policy_version 1683134 (0.0007) [2023-12-28 07:21:29,065][106226] Updated weights for policy 0, policy_version 1683144 (0.0005) [2023-12-28 07:21:29,133][106226] Updated weights for policy 0, policy_version 1683154 (0.0006) [2023-12-28 07:21:29,233][106225] Updated weights for policy 1, policy_version 1687149 (0.0008) [2023-12-28 07:21:29,302][106225] Updated weights for policy 1, policy_version 1687159 (0.0009) [2023-12-28 07:21:29,370][106225] Updated weights for policy 1, policy_version 1687169 (0.0011) [2023-12-28 07:21:29,842][106226] Updated weights for policy 0, policy_version 1683164 (0.0006) [2023-12-28 07:21:29,905][106226] Updated weights for policy 0, policy_version 1683174 (0.0008) [2023-12-28 07:21:29,974][106226] Updated weights for policy 0, policy_version 1683184 (0.0010) [2023-12-28 07:21:30,091][106225] Updated weights for policy 1, policy_version 1687179 (0.0007) [2023-12-28 07:21:30,153][106225] Updated weights for policy 1, policy_version 1687189 (0.0009) [2023-12-28 07:21:30,213][106225] Updated weights for policy 1, policy_version 1687199 (0.0009) [2023-12-28 07:21:30,729][106226] Updated weights for policy 0, policy_version 1683194 (0.0008) [2023-12-28 07:21:30,774][106226] Updated weights for policy 0, policy_version 1683204 (0.0005) [2023-12-28 07:21:30,820][106226] Updated weights for policy 0, policy_version 1683214 (0.0006) [2023-12-28 07:21:30,866][106226] Updated weights for policy 0, policy_version 1683224 (0.0007) [2023-12-28 07:21:30,928][106225] Updated weights for policy 1, policy_version 1687209 (0.0009) [2023-12-28 07:21:30,988][106225] Updated weights for policy 1, policy_version 1687219 (0.0008) [2023-12-28 07:21:31,058][106225] Updated weights for policy 1, policy_version 1687229 (0.0010) [2023-12-28 07:21:31,119][106225] Updated weights for policy 1, policy_version 1687239 (0.0010) [2023-12-28 07:21:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 862969856. Throughput: 0: 10020.4, 1: 9901.8. Samples: 862954888. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:31,175][105115] Avg episode reward: [(0, '-4.710'), (1, '-4.643')] [2023-12-28 07:21:31,553][106226] Updated weights for policy 0, policy_version 1683234 (0.0006) [2023-12-28 07:21:31,613][106226] Updated weights for policy 0, policy_version 1683244 (0.0008) [2023-12-28 07:21:31,674][106226] Updated weights for policy 0, policy_version 1683254 (0.0006) [2023-12-28 07:21:31,856][106225] Updated weights for policy 1, policy_version 1687249 (0.0006) [2023-12-28 07:21:31,903][106225] Updated weights for policy 1, policy_version 1687259 (0.0005) [2023-12-28 07:21:31,955][106225] Updated weights for policy 1, policy_version 1687269 (0.0005) [2023-12-28 07:21:32,454][106226] Updated weights for policy 0, policy_version 1683264 (0.0005) [2023-12-28 07:21:32,519][106226] Updated weights for policy 0, policy_version 1683274 (0.0006) [2023-12-28 07:21:32,576][106226] Updated weights for policy 0, policy_version 1683284 (0.0006) [2023-12-28 07:21:32,582][106225] Updated weights for policy 1, policy_version 1687279 (0.0009) [2023-12-28 07:21:32,633][106225] Updated weights for policy 1, policy_version 1687289 (0.0010) [2023-12-28 07:21:32,690][106225] Updated weights for policy 1, policy_version 1687299 (0.0010) [2023-12-28 07:21:33,117][106226] Updated weights for policy 0, policy_version 1683294 (0.0005) [2023-12-28 07:21:33,173][106226] Updated weights for policy 0, policy_version 1683304 (0.0005) [2023-12-28 07:21:33,231][106226] Updated weights for policy 0, policy_version 1683314 (0.0005) [2023-12-28 07:21:33,440][106225] Updated weights for policy 1, policy_version 1687309 (0.0009) [2023-12-28 07:21:33,490][106225] Updated weights for policy 1, policy_version 1687319 (0.0008) [2023-12-28 07:21:33,552][106225] Updated weights for policy 1, policy_version 1687329 (0.0007) [2023-12-28 07:21:33,766][106226] Updated weights for policy 0, policy_version 1683324 (0.0006) [2023-12-28 07:21:33,821][106226] Updated weights for policy 0, policy_version 1683334 (0.0005) [2023-12-28 07:21:33,882][106226] Updated weights for policy 0, policy_version 1683344 (0.0008) [2023-12-28 07:21:34,372][106225] Updated weights for policy 1, policy_version 1687339 (0.0008) [2023-12-28 07:21:34,431][106225] Updated weights for policy 1, policy_version 1687349 (0.0009) [2023-12-28 07:21:34,480][106225] Updated weights for policy 1, policy_version 1687359 (0.0008) [2023-12-28 07:21:34,505][106226] Updated weights for policy 0, policy_version 1683354 (0.0007) [2023-12-28 07:21:34,562][106226] Updated weights for policy 0, policy_version 1683364 (0.0007) [2023-12-28 07:21:34,621][106226] Updated weights for policy 0, policy_version 1683374 (0.0005) [2023-12-28 07:21:34,681][106226] Updated weights for policy 0, policy_version 1683384 (0.0005) [2023-12-28 07:21:35,259][106225] Updated weights for policy 1, policy_version 1687369 (0.0007) [2023-12-28 07:21:35,299][106226] Updated weights for policy 0, policy_version 1683394 (0.0010) [2023-12-28 07:21:35,301][106225] Updated weights for policy 1, policy_version 1687379 (0.0006) [2023-12-28 07:21:35,347][106225] Updated weights for policy 1, policy_version 1687389 (0.0006) [2023-12-28 07:21:35,352][106226] Updated weights for policy 0, policy_version 1683404 (0.0011) [2023-12-28 07:21:35,398][106225] Updated weights for policy 1, policy_version 1687399 (0.0007) [2023-12-28 07:21:35,401][106226] Updated weights for policy 0, policy_version 1683414 (0.0008) [2023-12-28 07:21:35,937][106226] Updated weights for policy 0, policy_version 1683424 (0.0008) [2023-12-28 07:21:35,998][106226] Updated weights for policy 0, policy_version 1683434 (0.0008) [2023-12-28 07:21:36,060][106226] Updated weights for policy 0, policy_version 1683444 (0.0009) [2023-12-28 07:21:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 863068160. Throughput: 0: 10088.8, 1: 9881.6. Samples: 863076844. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:36,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.690')] [2023-12-28 07:21:36,201][106225] Updated weights for policy 1, policy_version 1687409 (0.0008) [2023-12-28 07:21:36,261][106225] Updated weights for policy 1, policy_version 1687419 (0.0009) [2023-12-28 07:21:36,321][106225] Updated weights for policy 1, policy_version 1687429 (0.0009) [2023-12-28 07:21:36,822][106226] Updated weights for policy 0, policy_version 1683454 (0.0009) [2023-12-28 07:21:36,873][106226] Updated weights for policy 0, policy_version 1683464 (0.0008) [2023-12-28 07:21:36,931][106226] Updated weights for policy 0, policy_version 1683474 (0.0009) [2023-12-28 07:21:36,994][106225] Updated weights for policy 1, policy_version 1687439 (0.0006) [2023-12-28 07:21:37,058][106225] Updated weights for policy 1, policy_version 1687449 (0.0008) [2023-12-28 07:21:37,110][106225] Updated weights for policy 1, policy_version 1687459 (0.0008) [2023-12-28 07:21:37,713][106226] Updated weights for policy 0, policy_version 1683484 (0.0009) [2023-12-28 07:21:37,736][106225] Updated weights for policy 1, policy_version 1687469 (0.0007) [2023-12-28 07:21:37,766][106226] Updated weights for policy 0, policy_version 1683494 (0.0007) [2023-12-28 07:21:37,795][106225] Updated weights for policy 1, policy_version 1687479 (0.0006) [2023-12-28 07:21:37,819][106226] Updated weights for policy 0, policy_version 1683504 (0.0008) [2023-12-28 07:21:37,852][106225] Updated weights for policy 1, policy_version 1687489 (0.0007) [2023-12-28 07:21:38,582][106226] Updated weights for policy 0, policy_version 1683514 (0.0007) [2023-12-28 07:21:38,596][106225] Updated weights for policy 1, policy_version 1687499 (0.0007) [2023-12-28 07:21:38,647][106226] Updated weights for policy 0, policy_version 1683524 (0.0009) [2023-12-28 07:21:38,661][106225] Updated weights for policy 1, policy_version 1687509 (0.0007) [2023-12-28 07:21:38,705][106226] Updated weights for policy 0, policy_version 1683534 (0.0010) [2023-12-28 07:21:38,719][106225] Updated weights for policy 1, policy_version 1687519 (0.0005) [2023-12-28 07:21:38,765][106226] Updated weights for policy 0, policy_version 1683544 (0.0009) [2023-12-28 07:21:39,503][106226] Updated weights for policy 0, policy_version 1683554 (0.0011) [2023-12-28 07:21:39,561][106226] Updated weights for policy 0, policy_version 1683564 (0.0011) [2023-12-28 07:21:39,567][106225] Updated weights for policy 1, policy_version 1687529 (0.0009) [2023-12-28 07:21:39,619][106226] Updated weights for policy 0, policy_version 1683574 (0.0011) [2023-12-28 07:21:39,628][106225] Updated weights for policy 1, policy_version 1687539 (0.0008) [2023-12-28 07:21:39,675][106225] Updated weights for policy 1, policy_version 1687549 (0.0008) [2023-12-28 07:21:39,730][106225] Updated weights for policy 1, policy_version 1687559 (0.0008) [2023-12-28 07:21:40,408][106226] Updated weights for policy 0, policy_version 1683584 (0.0011) [2023-12-28 07:21:40,467][106226] Updated weights for policy 0, policy_version 1683594 (0.0010) [2023-12-28 07:21:40,500][106225] Updated weights for policy 1, policy_version 1687569 (0.0007) [2023-12-28 07:21:40,527][106226] Updated weights for policy 0, policy_version 1683604 (0.0010) [2023-12-28 07:21:40,556][106225] Updated weights for policy 1, policy_version 1687579 (0.0007) [2023-12-28 07:21:40,606][106225] Updated weights for policy 1, policy_version 1687589 (0.0008) [2023-12-28 07:21:41,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 863158272. Throughput: 0: 10097.4, 1: 9894.3. Samples: 863134684. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:41,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.811')] [2023-12-28 07:21:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001687592_432078848.pth... [2023-12-28 07:21:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001683608_431079424.pth... [2023-12-28 07:21:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001682456_430784512.pth [2023-12-28 07:21:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001686472_431792128.pth [2023-12-28 07:21:41,269][106226] Updated weights for policy 0, policy_version 1683614 (0.0009) [2023-12-28 07:21:41,313][106225] Updated weights for policy 1, policy_version 1687599 (0.0007) [2023-12-28 07:21:41,328][106226] Updated weights for policy 0, policy_version 1683624 (0.0006) [2023-12-28 07:21:41,382][106225] Updated weights for policy 1, policy_version 1687609 (0.0008) [2023-12-28 07:21:41,400][106226] Updated weights for policy 0, policy_version 1683634 (0.0008) [2023-12-28 07:21:41,446][106225] Updated weights for policy 1, policy_version 1687619 (0.0009) [2023-12-28 07:21:42,120][106226] Updated weights for policy 0, policy_version 1683644 (0.0008) [2023-12-28 07:21:42,171][106226] Updated weights for policy 0, policy_version 1683654 (0.0010) [2023-12-28 07:21:42,208][106225] Updated weights for policy 1, policy_version 1687629 (0.0007) [2023-12-28 07:21:42,232][106226] Updated weights for policy 0, policy_version 1683664 (0.0010) [2023-12-28 07:21:42,269][106225] Updated weights for policy 1, policy_version 1687639 (0.0007) [2023-12-28 07:21:42,330][106225] Updated weights for policy 1, policy_version 1687649 (0.0010) [2023-12-28 07:21:42,920][106226] Updated weights for policy 0, policy_version 1683674 (0.0011) [2023-12-28 07:21:42,980][106226] Updated weights for policy 0, policy_version 1683684 (0.0010) [2023-12-28 07:21:42,985][106225] Updated weights for policy 1, policy_version 1687659 (0.0009) [2023-12-28 07:21:43,040][106225] Updated weights for policy 1, policy_version 1687669 (0.0006) [2023-12-28 07:21:43,047][106226] Updated weights for policy 0, policy_version 1683694 (0.0010) [2023-12-28 07:21:43,090][106225] Updated weights for policy 1, policy_version 1687679 (0.0005) [2023-12-28 07:21:43,107][106226] Updated weights for policy 0, policy_version 1683704 (0.0010) [2023-12-28 07:21:43,626][106225] Updated weights for policy 1, policy_version 1687689 (0.0006) [2023-12-28 07:21:43,687][106225] Updated weights for policy 1, policy_version 1687699 (0.0008) [2023-12-28 07:21:43,749][106225] Updated weights for policy 1, policy_version 1687709 (0.0008) [2023-12-28 07:21:43,808][106226] Updated weights for policy 0, policy_version 1683714 (0.0007) [2023-12-28 07:21:43,818][106225] Updated weights for policy 1, policy_version 1687719 (0.0005) [2023-12-28 07:21:43,855][106226] Updated weights for policy 0, policy_version 1683724 (0.0006) [2023-12-28 07:21:43,910][106226] Updated weights for policy 0, policy_version 1683734 (0.0006) [2023-12-28 07:21:44,367][106225] Updated weights for policy 1, policy_version 1687729 (0.0005) [2023-12-28 07:21:44,429][106225] Updated weights for policy 1, policy_version 1687739 (0.0006) [2023-12-28 07:21:44,479][106225] Updated weights for policy 1, policy_version 1687749 (0.0008) [2023-12-28 07:21:44,588][106226] Updated weights for policy 0, policy_version 1683744 (0.0010) [2023-12-28 07:21:44,651][106226] Updated weights for policy 0, policy_version 1683754 (0.0005) [2023-12-28 07:21:44,702][106226] Updated weights for policy 0, policy_version 1683764 (0.0005) [2023-12-28 07:21:45,191][106225] Updated weights for policy 1, policy_version 1687759 (0.0008) [2023-12-28 07:21:45,254][106225] Updated weights for policy 1, policy_version 1687769 (0.0008) [2023-12-28 07:21:45,321][106225] Updated weights for policy 1, policy_version 1687779 (0.0007) [2023-12-28 07:21:45,422][106226] Updated weights for policy 0, policy_version 1683774 (0.0008) [2023-12-28 07:21:45,490][106226] Updated weights for policy 0, policy_version 1683784 (0.0010) [2023-12-28 07:21:45,549][106226] Updated weights for policy 0, policy_version 1683794 (0.0010) [2023-12-28 07:21:45,932][106225] Updated weights for policy 1, policy_version 1687789 (0.0007) [2023-12-28 07:21:45,982][106225] Updated weights for policy 1, policy_version 1687799 (0.0009) [2023-12-28 07:21:46,039][106225] Updated weights for policy 1, policy_version 1687809 (0.0008) [2023-12-28 07:21:46,112][106226] Updated weights for policy 0, policy_version 1683804 (0.0009) [2023-12-28 07:21:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 863264768. Throughput: 0: 10059.4, 1: 9862.8. Samples: 863252420. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:46,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.092')] [2023-12-28 07:21:46,176][106226] Updated weights for policy 0, policy_version 1683814 (0.0008) [2023-12-28 07:21:46,247][106226] Updated weights for policy 0, policy_version 1683824 (0.0007) [2023-12-28 07:21:46,766][106225] Updated weights for policy 1, policy_version 1687819 (0.0008) [2023-12-28 07:21:46,826][106225] Updated weights for policy 1, policy_version 1687829 (0.0008) [2023-12-28 07:21:46,841][106226] Updated weights for policy 0, policy_version 1683834 (0.0006) [2023-12-28 07:21:46,888][106225] Updated weights for policy 1, policy_version 1687839 (0.0008) [2023-12-28 07:21:46,895][106226] Updated weights for policy 0, policy_version 1683844 (0.0011) [2023-12-28 07:21:46,956][106226] Updated weights for policy 0, policy_version 1683854 (0.0011) [2023-12-28 07:21:47,005][106226] Updated weights for policy 0, policy_version 1683864 (0.0010) [2023-12-28 07:21:47,613][106226] Updated weights for policy 0, policy_version 1683874 (0.0005) [2023-12-28 07:21:47,658][106225] Updated weights for policy 1, policy_version 1687849 (0.0006) [2023-12-28 07:21:47,671][106226] Updated weights for policy 0, policy_version 1683884 (0.0005) [2023-12-28 07:21:47,711][106225] Updated weights for policy 1, policy_version 1687859 (0.0007) [2023-12-28 07:21:47,738][106226] Updated weights for policy 0, policy_version 1683894 (0.0009) [2023-12-28 07:21:47,771][106225] Updated weights for policy 1, policy_version 1687869 (0.0010) [2023-12-28 07:21:47,830][106225] Updated weights for policy 1, policy_version 1687879 (0.0008) [2023-12-28 07:21:48,393][106226] Updated weights for policy 0, policy_version 1683904 (0.0011) [2023-12-28 07:21:48,455][106226] Updated weights for policy 0, policy_version 1683914 (0.0011) [2023-12-28 07:21:48,521][106226] Updated weights for policy 0, policy_version 1683924 (0.0010) [2023-12-28 07:21:48,561][106225] Updated weights for policy 1, policy_version 1687889 (0.0007) [2023-12-28 07:21:48,648][106225] Updated weights for policy 1, policy_version 1687899 (0.0008) [2023-12-28 07:21:48,714][106225] Updated weights for policy 1, policy_version 1687909 (0.0008) [2023-12-28 07:21:49,252][106226] Updated weights for policy 0, policy_version 1683934 (0.0009) [2023-12-28 07:21:49,317][106226] Updated weights for policy 0, policy_version 1683944 (0.0008) [2023-12-28 07:21:49,387][106226] Updated weights for policy 0, policy_version 1683954 (0.0008) [2023-12-28 07:21:49,442][106225] Updated weights for policy 1, policy_version 1687919 (0.0007) [2023-12-28 07:21:49,500][106225] Updated weights for policy 1, policy_version 1687929 (0.0009) [2023-12-28 07:21:49,564][106225] Updated weights for policy 1, policy_version 1687939 (0.0008) [2023-12-28 07:21:50,116][106226] Updated weights for policy 0, policy_version 1683964 (0.0007) [2023-12-28 07:21:50,178][106226] Updated weights for policy 0, policy_version 1683974 (0.0009) [2023-12-28 07:21:50,233][106226] Updated weights for policy 0, policy_version 1683984 (0.0008) [2023-12-28 07:21:50,267][106225] Updated weights for policy 1, policy_version 1687949 (0.0008) [2023-12-28 07:21:50,322][106225] Updated weights for policy 1, policy_version 1687959 (0.0007) [2023-12-28 07:21:50,377][106225] Updated weights for policy 1, policy_version 1687969 (0.0008) [2023-12-28 07:21:51,009][106226] Updated weights for policy 0, policy_version 1683994 (0.0008) [2023-12-28 07:21:51,020][106225] Updated weights for policy 1, policy_version 1687979 (0.0006) [2023-12-28 07:21:51,074][106226] Updated weights for policy 0, policy_version 1684004 (0.0007) [2023-12-28 07:21:51,096][106225] Updated weights for policy 1, policy_version 1687989 (0.0007) [2023-12-28 07:21:51,140][106226] Updated weights for policy 0, policy_version 1684014 (0.0007) [2023-12-28 07:21:51,167][106225] Updated weights for policy 1, policy_version 1687999 (0.0009) [2023-12-28 07:21:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 863354880. Throughput: 0: 10015.7, 1: 9752.8. Samples: 863371608. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:51,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.956')] [2023-12-28 07:21:51,201][106226] Updated weights for policy 0, policy_version 1684024 (0.0008) [2023-12-28 07:21:51,851][106225] Updated weights for policy 1, policy_version 1688009 (0.0006) [2023-12-28 07:21:51,899][106225] Updated weights for policy 1, policy_version 1688019 (0.0007) [2023-12-28 07:21:51,949][106225] Updated weights for policy 1, policy_version 1688029 (0.0006) [2023-12-28 07:21:51,993][106226] Updated weights for policy 0, policy_version 1684034 (0.0008) [2023-12-28 07:21:52,004][106225] Updated weights for policy 1, policy_version 1688039 (0.0006) [2023-12-28 07:21:52,057][106226] Updated weights for policy 0, policy_version 1684044 (0.0007) [2023-12-28 07:21:52,129][106226] Updated weights for policy 0, policy_version 1684054 (0.0005) [2023-12-28 07:21:52,743][106226] Updated weights for policy 0, policy_version 1684064 (0.0007) [2023-12-28 07:21:52,762][106225] Updated weights for policy 1, policy_version 1688049 (0.0007) [2023-12-28 07:21:52,804][106226] Updated weights for policy 0, policy_version 1684074 (0.0006) [2023-12-28 07:21:52,822][106225] Updated weights for policy 1, policy_version 1688059 (0.0009) [2023-12-28 07:21:52,865][106226] Updated weights for policy 0, policy_version 1684084 (0.0005) [2023-12-28 07:21:52,876][106225] Updated weights for policy 1, policy_version 1688069 (0.0009) [2023-12-28 07:21:53,563][106225] Updated weights for policy 1, policy_version 1688079 (0.0008) [2023-12-28 07:21:53,585][106226] Updated weights for policy 0, policy_version 1684094 (0.0007) [2023-12-28 07:21:53,611][106225] Updated weights for policy 1, policy_version 1688089 (0.0006) [2023-12-28 07:21:53,645][106226] Updated weights for policy 0, policy_version 1684104 (0.0009) [2023-12-28 07:21:53,664][106225] Updated weights for policy 1, policy_version 1688099 (0.0006) [2023-12-28 07:21:53,698][106226] Updated weights for policy 0, policy_version 1684114 (0.0006) [2023-12-28 07:21:54,283][106225] Updated weights for policy 1, policy_version 1688109 (0.0006) [2023-12-28 07:21:54,333][106225] Updated weights for policy 1, policy_version 1688119 (0.0009) [2023-12-28 07:21:54,378][106225] Updated weights for policy 1, policy_version 1688129 (0.0009) [2023-12-28 07:21:54,418][106226] Updated weights for policy 0, policy_version 1684124 (0.0009) [2023-12-28 07:21:54,478][106226] Updated weights for policy 0, policy_version 1684134 (0.0008) [2023-12-28 07:21:54,535][106226] Updated weights for policy 0, policy_version 1684144 (0.0008) [2023-12-28 07:21:55,103][106225] Updated weights for policy 1, policy_version 1688139 (0.0008) [2023-12-28 07:21:55,164][106225] Updated weights for policy 1, policy_version 1688149 (0.0010) [2023-12-28 07:21:55,196][106226] Updated weights for policy 0, policy_version 1684154 (0.0008) [2023-12-28 07:21:55,225][106225] Updated weights for policy 1, policy_version 1688159 (0.0010) [2023-12-28 07:21:55,251][106226] Updated weights for policy 0, policy_version 1684164 (0.0006) [2023-12-28 07:21:55,309][106226] Updated weights for policy 0, policy_version 1684174 (0.0007) [2023-12-28 07:21:55,369][106226] Updated weights for policy 0, policy_version 1684184 (0.0008) [2023-12-28 07:21:55,953][106225] Updated weights for policy 1, policy_version 1688169 (0.0010) [2023-12-28 07:21:56,017][106225] Updated weights for policy 1, policy_version 1688179 (0.0011) [2023-12-28 07:21:56,019][106226] Updated weights for policy 0, policy_version 1684194 (0.0006) [2023-12-28 07:21:56,078][106225] Updated weights for policy 1, policy_version 1688189 (0.0010) [2023-12-28 07:21:56,084][106226] Updated weights for policy 0, policy_version 1684204 (0.0006) [2023-12-28 07:21:56,133][106225] Updated weights for policy 1, policy_version 1688199 (0.0011) [2023-12-28 07:21:56,150][106226] Updated weights for policy 0, policy_version 1684214 (0.0007) [2023-12-28 07:21:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 863469568. Throughput: 0: 9950.5, 1: 9786.6. Samples: 863430560. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:21:56,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.469')] [2023-12-28 07:21:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001688200_432234496.pth... [2023-12-28 07:21:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001684216_431235072.pth... [2023-12-28 07:21:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001683032_430931968.pth [2023-12-28 07:21:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001687048_431939584.pth [2023-12-28 07:21:56,850][106226] Updated weights for policy 0, policy_version 1684224 (0.0008) [2023-12-28 07:21:56,851][106225] Updated weights for policy 1, policy_version 1688209 (0.0010) [2023-12-28 07:21:56,897][106225] Updated weights for policy 1, policy_version 1688219 (0.0010) [2023-12-28 07:21:56,911][106226] Updated weights for policy 0, policy_version 1684234 (0.0006) [2023-12-28 07:21:56,948][106225] Updated weights for policy 1, policy_version 1688229 (0.0010) [2023-12-28 07:21:56,968][106226] Updated weights for policy 0, policy_version 1684244 (0.0006) [2023-12-28 07:21:57,555][106226] Updated weights for policy 0, policy_version 1684254 (0.0005) [2023-12-28 07:21:57,602][106225] Updated weights for policy 1, policy_version 1688239 (0.0010) [2023-12-28 07:21:57,605][106226] Updated weights for policy 0, policy_version 1684264 (0.0006) [2023-12-28 07:21:57,662][106226] Updated weights for policy 0, policy_version 1684274 (0.0005) [2023-12-28 07:21:57,665][106225] Updated weights for policy 1, policy_version 1688249 (0.0010) [2023-12-28 07:21:57,716][106225] Updated weights for policy 1, policy_version 1688259 (0.0006) [2023-12-28 07:21:58,352][106226] Updated weights for policy 0, policy_version 1684284 (0.0009) [2023-12-28 07:21:58,420][106226] Updated weights for policy 0, policy_version 1684294 (0.0007) [2023-12-28 07:21:58,456][106225] Updated weights for policy 1, policy_version 1688269 (0.0009) [2023-12-28 07:21:58,482][106226] Updated weights for policy 0, policy_version 1684304 (0.0011) [2023-12-28 07:21:58,519][106225] Updated weights for policy 1, policy_version 1688279 (0.0009) [2023-12-28 07:21:58,586][106225] Updated weights for policy 1, policy_version 1688289 (0.0010) [2023-12-28 07:21:59,295][106226] Updated weights for policy 0, policy_version 1684314 (0.0010) [2023-12-28 07:21:59,368][106226] Updated weights for policy 0, policy_version 1684324 (0.0011) [2023-12-28 07:21:59,420][106225] Updated weights for policy 1, policy_version 1688299 (0.0010) [2023-12-28 07:21:59,423][106226] Updated weights for policy 0, policy_version 1684334 (0.0009) [2023-12-28 07:21:59,470][106225] Updated weights for policy 1, policy_version 1688309 (0.0010) [2023-12-28 07:21:59,473][106226] Updated weights for policy 0, policy_version 1684344 (0.0010) [2023-12-28 07:21:59,530][106225] Updated weights for policy 1, policy_version 1688319 (0.0010) [2023-12-28 07:22:00,200][106225] Updated weights for policy 1, policy_version 1688329 (0.0010) [2023-12-28 07:22:00,264][106226] Updated weights for policy 0, policy_version 1684354 (0.0008) [2023-12-28 07:22:00,267][106225] Updated weights for policy 1, policy_version 1688339 (0.0006) [2023-12-28 07:22:00,328][106226] Updated weights for policy 0, policy_version 1684364 (0.0007) [2023-12-28 07:22:00,329][106225] Updated weights for policy 1, policy_version 1688349 (0.0009) [2023-12-28 07:22:00,384][106226] Updated weights for policy 0, policy_version 1684374 (0.0007) [2023-12-28 07:22:00,393][106225] Updated weights for policy 1, policy_version 1688359 (0.0010) [2023-12-28 07:22:01,051][106226] Updated weights for policy 0, policy_version 1684384 (0.0010) [2023-12-28 07:22:01,076][106225] Updated weights for policy 1, policy_version 1688369 (0.0007) [2023-12-28 07:22:01,114][106226] Updated weights for policy 0, policy_version 1684394 (0.0011) [2023-12-28 07:22:01,136][106225] Updated weights for policy 1, policy_version 1688379 (0.0006) [2023-12-28 07:22:01,175][106226] Updated weights for policy 0, policy_version 1684404 (0.0011) [2023-12-28 07:22:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 863551488. Throughput: 0: 9991.9, 1: 9772.0. Samples: 863548872. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:22:01,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.796')] [2023-12-28 07:22:01,196][106225] Updated weights for policy 1, policy_version 1688389 (0.0007) [2023-12-28 07:22:01,888][106225] Updated weights for policy 1, policy_version 1688399 (0.0007) [2023-12-28 07:22:01,890][106226] Updated weights for policy 0, policy_version 1684414 (0.0008) [2023-12-28 07:22:01,944][106225] Updated weights for policy 1, policy_version 1688409 (0.0005) [2023-12-28 07:22:01,946][106226] Updated weights for policy 0, policy_version 1684424 (0.0007) [2023-12-28 07:22:01,996][106225] Updated weights for policy 1, policy_version 1688419 (0.0006) [2023-12-28 07:22:02,007][106226] Updated weights for policy 0, policy_version 1684434 (0.0008) [2023-12-28 07:22:02,670][106225] Updated weights for policy 1, policy_version 1688429 (0.0006) [2023-12-28 07:22:02,727][106225] Updated weights for policy 1, policy_version 1688439 (0.0008) [2023-12-28 07:22:02,755][106226] Updated weights for policy 0, policy_version 1684444 (0.0008) [2023-12-28 07:22:02,784][106225] Updated weights for policy 1, policy_version 1688449 (0.0005) [2023-12-28 07:22:02,815][106226] Updated weights for policy 0, policy_version 1684454 (0.0008) [2023-12-28 07:22:02,881][106226] Updated weights for policy 0, policy_version 1684464 (0.0008) [2023-12-28 07:22:03,533][106225] Updated weights for policy 1, policy_version 1688459 (0.0008) [2023-12-28 07:22:03,578][106226] Updated weights for policy 0, policy_version 1684474 (0.0010) [2023-12-28 07:22:03,581][106225] Updated weights for policy 1, policy_version 1688469 (0.0007) [2023-12-28 07:22:03,624][106226] Updated weights for policy 0, policy_version 1684484 (0.0010) [2023-12-28 07:22:03,637][106225] Updated weights for policy 1, policy_version 1688479 (0.0005) [2023-12-28 07:22:03,673][106226] Updated weights for policy 0, policy_version 1684494 (0.0010) [2023-12-28 07:22:03,737][106226] Updated weights for policy 0, policy_version 1684504 (0.0010) [2023-12-28 07:22:04,372][106225] Updated weights for policy 1, policy_version 1688489 (0.0006) [2023-12-28 07:22:04,373][106226] Updated weights for policy 0, policy_version 1684514 (0.0011) [2023-12-28 07:22:04,434][106226] Updated weights for policy 0, policy_version 1684524 (0.0010) [2023-12-28 07:22:04,436][106225] Updated weights for policy 1, policy_version 1688499 (0.0010) [2023-12-28 07:22:04,489][106225] Updated weights for policy 1, policy_version 1688509 (0.0010) [2023-12-28 07:22:04,490][106226] Updated weights for policy 0, policy_version 1684534 (0.0010) [2023-12-28 07:22:04,539][106225] Updated weights for policy 1, policy_version 1688519 (0.0007) [2023-12-28 07:22:05,061][106226] Updated weights for policy 0, policy_version 1684544 (0.0006) [2023-12-28 07:22:05,114][106226] Updated weights for policy 0, policy_version 1684554 (0.0005) [2023-12-28 07:22:05,165][106226] Updated weights for policy 0, policy_version 1684564 (0.0009) [2023-12-28 07:22:05,234][106225] Updated weights for policy 1, policy_version 1688529 (0.0007) [2023-12-28 07:22:05,292][106225] Updated weights for policy 1, policy_version 1688539 (0.0008) [2023-12-28 07:22:05,340][106225] Updated weights for policy 1, policy_version 1688549 (0.0008) [2023-12-28 07:22:05,858][106226] Updated weights for policy 0, policy_version 1684574 (0.0011) [2023-12-28 07:22:05,919][106226] Updated weights for policy 0, policy_version 1684584 (0.0010) [2023-12-28 07:22:05,974][106225] Updated weights for policy 1, policy_version 1688559 (0.0006) [2023-12-28 07:22:05,983][106226] Updated weights for policy 0, policy_version 1684594 (0.0011) [2023-12-28 07:22:06,027][106225] Updated weights for policy 1, policy_version 1688569 (0.0009) [2023-12-28 07:22:06,081][106225] Updated weights for policy 1, policy_version 1688579 (0.0005) [2023-12-28 07:22:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 863666176. Throughput: 0: 10015.3, 1: 9800.3. Samples: 863668504. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:22:06,175][105115] Avg episode reward: [(0, '-4.831'), (1, '-4.874')] [2023-12-28 07:22:06,665][106226] Updated weights for policy 0, policy_version 1684604 (0.0011) [2023-12-28 07:22:06,723][106226] Updated weights for policy 0, policy_version 1684614 (0.0011) [2023-12-28 07:22:06,738][106225] Updated weights for policy 1, policy_version 1688589 (0.0009) [2023-12-28 07:22:06,786][106226] Updated weights for policy 0, policy_version 1684624 (0.0011) [2023-12-28 07:22:06,792][106225] Updated weights for policy 1, policy_version 1688599 (0.0010) [2023-12-28 07:22:06,847][106225] Updated weights for policy 1, policy_version 1688609 (0.0010) [2023-12-28 07:22:07,480][106226] Updated weights for policy 0, policy_version 1684634 (0.0010) [2023-12-28 07:22:07,525][106226] Updated weights for policy 0, policy_version 1684644 (0.0005) [2023-12-28 07:22:07,528][106225] Updated weights for policy 1, policy_version 1688619 (0.0010) [2023-12-28 07:22:07,578][106226] Updated weights for policy 0, policy_version 1684654 (0.0005) [2023-12-28 07:22:07,588][106225] Updated weights for policy 1, policy_version 1688629 (0.0010) [2023-12-28 07:22:07,626][106226] Updated weights for policy 0, policy_version 1684664 (0.0005) [2023-12-28 07:22:07,641][106225] Updated weights for policy 1, policy_version 1688639 (0.0010) [2023-12-28 07:22:08,180][106226] Updated weights for policy 0, policy_version 1684674 (0.0010) [2023-12-28 07:22:08,240][106226] Updated weights for policy 0, policy_version 1684684 (0.0010) [2023-12-28 07:22:08,307][106226] Updated weights for policy 0, policy_version 1684694 (0.0011) [2023-12-28 07:22:08,333][106225] Updated weights for policy 1, policy_version 1688649 (0.0006) [2023-12-28 07:22:08,397][106225] Updated weights for policy 1, policy_version 1688659 (0.0007) [2023-12-28 07:22:08,454][106225] Updated weights for policy 1, policy_version 1688669 (0.0010) [2023-12-28 07:22:08,509][106225] Updated weights for policy 1, policy_version 1688679 (0.0010) [2023-12-28 07:22:08,917][106226] Updated weights for policy 0, policy_version 1684704 (0.0008) [2023-12-28 07:22:08,972][106226] Updated weights for policy 0, policy_version 1684714 (0.0010) [2023-12-28 07:22:09,030][106226] Updated weights for policy 0, policy_version 1684724 (0.0008) [2023-12-28 07:22:09,149][106225] Updated weights for policy 1, policy_version 1688689 (0.0010) [2023-12-28 07:22:09,215][106225] Updated weights for policy 1, policy_version 1688699 (0.0010) [2023-12-28 07:22:09,280][106225] Updated weights for policy 1, policy_version 1688709 (0.0009) [2023-12-28 07:22:09,733][106226] Updated weights for policy 0, policy_version 1684734 (0.0010) [2023-12-28 07:22:09,803][106226] Updated weights for policy 0, policy_version 1684744 (0.0011) [2023-12-28 07:22:09,870][106226] Updated weights for policy 0, policy_version 1684754 (0.0011) [2023-12-28 07:22:10,042][106225] Updated weights for policy 1, policy_version 1688719 (0.0008) [2023-12-28 07:22:10,100][106225] Updated weights for policy 1, policy_version 1688729 (0.0008) [2023-12-28 07:22:10,170][106225] Updated weights for policy 1, policy_version 1688739 (0.0009) [2023-12-28 07:22:10,628][106226] Updated weights for policy 0, policy_version 1684764 (0.0011) [2023-12-28 07:22:10,688][106226] Updated weights for policy 0, policy_version 1684774 (0.0011) [2023-12-28 07:22:10,746][106226] Updated weights for policy 0, policy_version 1684784 (0.0007) [2023-12-28 07:22:10,841][106225] Updated weights for policy 1, policy_version 1688749 (0.0011) [2023-12-28 07:22:10,901][106225] Updated weights for policy 1, policy_version 1688759 (0.0008) [2023-12-28 07:22:10,964][106225] Updated weights for policy 1, policy_version 1688769 (0.0010) [2023-12-28 07:22:11,175][105115] Fps is (10 sec: 21298.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 863764480. Throughput: 0: 10122.9, 1: 9858.6. Samples: 863731832. Policy #0 lag: (min: 5.0, avg: 7.4, max: 37.0) [2023-12-28 07:22:11,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-5.045')] [2023-12-28 07:22:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001688776_432381952.pth... [2023-12-28 07:22:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001684792_431382528.pth... [2023-12-28 07:22:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001687592_432078848.pth [2023-12-28 07:22:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001683608_431079424.pth [2023-12-28 07:22:11,470][106226] Updated weights for policy 0, policy_version 1684794 (0.0006) [2023-12-28 07:22:11,521][106226] Updated weights for policy 0, policy_version 1684804 (0.0009) [2023-12-28 07:22:11,580][106226] Updated weights for policy 0, policy_version 1684814 (0.0007) [2023-12-28 07:22:11,660][106226] Updated weights for policy 0, policy_version 1684824 (0.0008) [2023-12-28 07:22:11,828][106225] Updated weights for policy 1, policy_version 1688779 (0.0010) [2023-12-28 07:22:11,875][106225] Updated weights for policy 1, policy_version 1688789 (0.0008) [2023-12-28 07:22:11,925][106225] Updated weights for policy 1, policy_version 1688799 (0.0008) [2023-12-28 07:22:12,419][106226] Updated weights for policy 0, policy_version 1684834 (0.0008) [2023-12-28 07:22:12,485][106226] Updated weights for policy 0, policy_version 1684844 (0.0008) [2023-12-28 07:22:12,539][106226] Updated weights for policy 0, policy_version 1684854 (0.0007) [2023-12-28 07:22:12,674][106225] Updated weights for policy 1, policy_version 1688809 (0.0011) [2023-12-28 07:22:12,734][106225] Updated weights for policy 1, policy_version 1688819 (0.0009) [2023-12-28 07:22:12,790][106225] Updated weights for policy 1, policy_version 1688829 (0.0009) [2023-12-28 07:22:12,847][106225] Updated weights for policy 1, policy_version 1688839 (0.0008) [2023-12-28 07:22:13,221][106226] Updated weights for policy 0, policy_version 1684864 (0.0008) [2023-12-28 07:22:13,278][106226] Updated weights for policy 0, policy_version 1684874 (0.0008) [2023-12-28 07:22:13,340][106226] Updated weights for policy 0, policy_version 1684884 (0.0009) [2023-12-28 07:22:13,509][106225] Updated weights for policy 1, policy_version 1688849 (0.0010) [2023-12-28 07:22:13,562][106225] Updated weights for policy 1, policy_version 1688859 (0.0010) [2023-12-28 07:22:13,625][106225] Updated weights for policy 1, policy_version 1688869 (0.0010) [2023-12-28 07:22:13,951][106226] Updated weights for policy 0, policy_version 1684894 (0.0010) [2023-12-28 07:22:13,998][106226] Updated weights for policy 0, policy_version 1684904 (0.0010) [2023-12-28 07:22:14,043][106226] Updated weights for policy 0, policy_version 1684914 (0.0007) [2023-12-28 07:22:14,286][106225] Updated weights for policy 1, policy_version 1688879 (0.0010) [2023-12-28 07:22:14,340][106225] Updated weights for policy 1, policy_version 1688889 (0.0010) [2023-12-28 07:22:14,399][106225] Updated weights for policy 1, policy_version 1688899 (0.0010) [2023-12-28 07:22:14,759][106226] Updated weights for policy 0, policy_version 1684924 (0.0007) [2023-12-28 07:22:14,825][106226] Updated weights for policy 0, policy_version 1684934 (0.0011) [2023-12-28 07:22:14,885][106226] Updated weights for policy 0, policy_version 1684944 (0.0006) [2023-12-28 07:22:15,104][106225] Updated weights for policy 1, policy_version 1688909 (0.0010) [2023-12-28 07:22:15,169][106225] Updated weights for policy 1, policy_version 1688919 (0.0011) [2023-12-28 07:22:15,237][106225] Updated weights for policy 1, policy_version 1688929 (0.0007) [2023-12-28 07:22:15,495][106226] Updated weights for policy 0, policy_version 1684954 (0.0006) [2023-12-28 07:22:15,543][106226] Updated weights for policy 0, policy_version 1684964 (0.0011) [2023-12-28 07:22:15,595][106226] Updated weights for policy 0, policy_version 1684974 (0.0007) [2023-12-28 07:22:15,642][106226] Updated weights for policy 0, policy_version 1684984 (0.0010) [2023-12-28 07:22:15,914][106225] Updated weights for policy 1, policy_version 1688939 (0.0007) [2023-12-28 07:22:15,969][106225] Updated weights for policy 1, policy_version 1688949 (0.0008) [2023-12-28 07:22:16,026][106225] Updated weights for policy 1, policy_version 1688959 (0.0008) [2023-12-28 07:22:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 863862784. Throughput: 0: 10040.9, 1: 9841.8. Samples: 863849612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:16,176][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.869')] [2023-12-28 07:22:16,285][106226] Updated weights for policy 0, policy_version 1684994 (0.0005) [2023-12-28 07:22:16,341][106226] Updated weights for policy 0, policy_version 1685004 (0.0005) [2023-12-28 07:22:16,394][106226] Updated weights for policy 0, policy_version 1685014 (0.0006) [2023-12-28 07:22:16,766][106225] Updated weights for policy 1, policy_version 1688969 (0.0010) [2023-12-28 07:22:16,816][106225] Updated weights for policy 1, policy_version 1688979 (0.0008) [2023-12-28 07:22:16,862][106225] Updated weights for policy 1, policy_version 1688989 (0.0008) [2023-12-28 07:22:16,907][106225] Updated weights for policy 1, policy_version 1688999 (0.0008) [2023-12-28 07:22:17,016][106226] Updated weights for policy 0, policy_version 1685024 (0.0007) [2023-12-28 07:22:17,067][106226] Updated weights for policy 0, policy_version 1685034 (0.0009) [2023-12-28 07:22:17,120][106226] Updated weights for policy 0, policy_version 1685044 (0.0006) [2023-12-28 07:22:17,522][106225] Updated weights for policy 1, policy_version 1689009 (0.0006) [2023-12-28 07:22:17,579][106225] Updated weights for policy 1, policy_version 1689019 (0.0009) [2023-12-28 07:22:17,637][106225] Updated weights for policy 1, policy_version 1689029 (0.0008) [2023-12-28 07:22:17,859][106226] Updated weights for policy 0, policy_version 1685054 (0.0006) [2023-12-28 07:22:17,910][106226] Updated weights for policy 0, policy_version 1685064 (0.0005) [2023-12-28 07:22:17,970][106226] Updated weights for policy 0, policy_version 1685074 (0.0005) [2023-12-28 07:22:18,365][106225] Updated weights for policy 1, policy_version 1689039 (0.0008) [2023-12-28 07:22:18,426][106225] Updated weights for policy 1, policy_version 1689049 (0.0007) [2023-12-28 07:22:18,482][106225] Updated weights for policy 1, policy_version 1689059 (0.0008) [2023-12-28 07:22:18,555][106226] Updated weights for policy 0, policy_version 1685084 (0.0005) [2023-12-28 07:22:18,622][106226] Updated weights for policy 0, policy_version 1685094 (0.0007) [2023-12-28 07:22:18,681][106226] Updated weights for policy 0, policy_version 1685104 (0.0009) [2023-12-28 07:22:19,210][106225] Updated weights for policy 1, policy_version 1689069 (0.0009) [2023-12-28 07:22:19,282][106225] Updated weights for policy 1, policy_version 1689079 (0.0008) [2023-12-28 07:22:19,338][106225] Updated weights for policy 1, policy_version 1689089 (0.0008) [2023-12-28 07:22:19,434][106226] Updated weights for policy 0, policy_version 1685114 (0.0009) [2023-12-28 07:22:19,492][106226] Updated weights for policy 0, policy_version 1685124 (0.0010) [2023-12-28 07:22:19,549][106226] Updated weights for policy 0, policy_version 1685134 (0.0007) [2023-12-28 07:22:19,595][106226] Updated weights for policy 0, policy_version 1685144 (0.0006) [2023-12-28 07:22:20,093][106225] Updated weights for policy 1, policy_version 1689099 (0.0009) [2023-12-28 07:22:20,155][106225] Updated weights for policy 1, policy_version 1689109 (0.0009) [2023-12-28 07:22:20,221][106225] Updated weights for policy 1, policy_version 1689119 (0.0006) [2023-12-28 07:22:20,371][106226] Updated weights for policy 0, policy_version 1685154 (0.0011) [2023-12-28 07:22:20,426][106226] Updated weights for policy 0, policy_version 1685164 (0.0010) [2023-12-28 07:22:20,483][106226] Updated weights for policy 0, policy_version 1685174 (0.0011) [2023-12-28 07:22:20,886][106225] Updated weights for policy 1, policy_version 1689129 (0.0007) [2023-12-28 07:22:20,935][106225] Updated weights for policy 1, policy_version 1689139 (0.0008) [2023-12-28 07:22:20,984][106225] Updated weights for policy 1, policy_version 1689149 (0.0008) [2023-12-28 07:22:21,046][106225] Updated weights for policy 1, policy_version 1689159 (0.0008) [2023-12-28 07:22:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 863961088. Throughput: 0: 9960.7, 1: 9898.7. Samples: 863970516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:21,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.548')] [2023-12-28 07:22:21,186][106226] Updated weights for policy 0, policy_version 1685184 (0.0008) [2023-12-28 07:22:21,253][106226] Updated weights for policy 0, policy_version 1685194 (0.0011) [2023-12-28 07:22:21,318][106226] Updated weights for policy 0, policy_version 1685204 (0.0011) [2023-12-28 07:22:21,839][106225] Updated weights for policy 1, policy_version 1689169 (0.0007) [2023-12-28 07:22:21,911][106225] Updated weights for policy 1, policy_version 1689179 (0.0006) [2023-12-28 07:22:21,975][106225] Updated weights for policy 1, policy_version 1689189 (0.0007) [2023-12-28 07:22:22,054][106226] Updated weights for policy 0, policy_version 1685214 (0.0011) [2023-12-28 07:22:22,106][106226] Updated weights for policy 0, policy_version 1685224 (0.0011) [2023-12-28 07:22:22,156][106226] Updated weights for policy 0, policy_version 1685234 (0.0010) [2023-12-28 07:22:22,615][106225] Updated weights for policy 1, policy_version 1689199 (0.0006) [2023-12-28 07:22:22,682][106225] Updated weights for policy 1, policy_version 1689209 (0.0006) [2023-12-28 07:22:22,730][106225] Updated weights for policy 1, policy_version 1689219 (0.0005) [2023-12-28 07:22:22,962][106226] Updated weights for policy 0, policy_version 1685244 (0.0007) [2023-12-28 07:22:23,033][106226] Updated weights for policy 0, policy_version 1685254 (0.0009) [2023-12-28 07:22:23,101][106226] Updated weights for policy 0, policy_version 1685264 (0.0010) [2023-12-28 07:22:23,255][106225] Updated weights for policy 1, policy_version 1689229 (0.0006) [2023-12-28 07:22:23,307][106225] Updated weights for policy 1, policy_version 1689239 (0.0009) [2023-12-28 07:22:23,360][106225] Updated weights for policy 1, policy_version 1689249 (0.0005) [2023-12-28 07:22:23,871][106226] Updated weights for policy 0, policy_version 1685274 (0.0009) [2023-12-28 07:22:23,934][106226] Updated weights for policy 0, policy_version 1685284 (0.0008) [2023-12-28 07:22:23,997][106226] Updated weights for policy 0, policy_version 1685294 (0.0009) [2023-12-28 07:22:24,011][106225] Updated weights for policy 1, policy_version 1689259 (0.0006) [2023-12-28 07:22:24,058][106226] Updated weights for policy 0, policy_version 1685304 (0.0007) [2023-12-28 07:22:24,068][106225] Updated weights for policy 1, policy_version 1689269 (0.0005) [2023-12-28 07:22:24,135][106225] Updated weights for policy 1, policy_version 1689279 (0.0006) [2023-12-28 07:22:24,668][106225] Updated weights for policy 1, policy_version 1689289 (0.0005) [2023-12-28 07:22:24,718][106225] Updated weights for policy 1, policy_version 1689299 (0.0005) [2023-12-28 07:22:24,765][106226] Updated weights for policy 0, policy_version 1685314 (0.0006) [2023-12-28 07:22:24,778][106225] Updated weights for policy 1, policy_version 1689309 (0.0007) [2023-12-28 07:22:24,830][106226] Updated weights for policy 0, policy_version 1685324 (0.0005) [2023-12-28 07:22:24,834][106225] Updated weights for policy 1, policy_version 1689319 (0.0008) [2023-12-28 07:22:24,890][106226] Updated weights for policy 0, policy_version 1685334 (0.0005) [2023-12-28 07:22:25,467][106226] Updated weights for policy 0, policy_version 1685344 (0.0006) [2023-12-28 07:22:25,484][106225] Updated weights for policy 1, policy_version 1689329 (0.0009) [2023-12-28 07:22:25,518][106226] Updated weights for policy 0, policy_version 1685354 (0.0010) [2023-12-28 07:22:25,541][106225] Updated weights for policy 1, policy_version 1689339 (0.0010) [2023-12-28 07:22:25,578][106226] Updated weights for policy 0, policy_version 1685364 (0.0006) [2023-12-28 07:22:25,595][106225] Updated weights for policy 1, policy_version 1689349 (0.0010) [2023-12-28 07:22:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 864059392. Throughput: 0: 9938.0, 1: 9929.3. Samples: 864028712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:26,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.810')] [2023-12-28 07:22:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001685368_431529984.pth... [2023-12-28 07:22:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001689352_432529408.pth... [2023-12-28 07:22:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001684216_431235072.pth [2023-12-28 07:22:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001688200_432234496.pth [2023-12-28 07:22:26,270][106226] Updated weights for policy 0, policy_version 1685374 (0.0007) [2023-12-28 07:22:26,287][106225] Updated weights for policy 1, policy_version 1689359 (0.0010) [2023-12-28 07:22:26,323][106226] Updated weights for policy 0, policy_version 1685384 (0.0006) [2023-12-28 07:22:26,341][106225] Updated weights for policy 1, policy_version 1689369 (0.0010) [2023-12-28 07:22:26,387][106226] Updated weights for policy 0, policy_version 1685394 (0.0006) [2023-12-28 07:22:26,397][106225] Updated weights for policy 1, policy_version 1689379 (0.0010) [2023-12-28 07:22:27,100][106226] Updated weights for policy 0, policy_version 1685404 (0.0006) [2023-12-28 07:22:27,116][106225] Updated weights for policy 1, policy_version 1689389 (0.0010) [2023-12-28 07:22:27,159][106226] Updated weights for policy 0, policy_version 1685414 (0.0006) [2023-12-28 07:22:27,172][106225] Updated weights for policy 1, policy_version 1689399 (0.0010) [2023-12-28 07:22:27,213][106226] Updated weights for policy 0, policy_version 1685424 (0.0005) [2023-12-28 07:22:27,226][106225] Updated weights for policy 1, policy_version 1689409 (0.0010) [2023-12-28 07:22:27,766][106226] Updated weights for policy 0, policy_version 1685434 (0.0005) [2023-12-28 07:22:27,824][106226] Updated weights for policy 0, policy_version 1685444 (0.0005) [2023-12-28 07:22:27,876][106225] Updated weights for policy 1, policy_version 1689419 (0.0010) [2023-12-28 07:22:27,876][106226] Updated weights for policy 0, policy_version 1685454 (0.0005) [2023-12-28 07:22:27,922][106225] Updated weights for policy 1, policy_version 1689429 (0.0009) [2023-12-28 07:22:27,932][106226] Updated weights for policy 0, policy_version 1685464 (0.0005) [2023-12-28 07:22:27,988][106225] Updated weights for policy 1, policy_version 1689439 (0.0010) [2023-12-28 07:22:28,620][106226] Updated weights for policy 0, policy_version 1685474 (0.0008) [2023-12-28 07:22:28,671][106226] Updated weights for policy 0, policy_version 1685484 (0.0008) [2023-12-28 07:22:28,722][106226] Updated weights for policy 0, policy_version 1685494 (0.0008) [2023-12-28 07:22:28,738][106225] Updated weights for policy 1, policy_version 1689449 (0.0010) [2023-12-28 07:22:28,795][106225] Updated weights for policy 1, policy_version 1689459 (0.0010) [2023-12-28 07:22:28,853][106225] Updated weights for policy 1, policy_version 1689469 (0.0010) [2023-12-28 07:22:28,913][106225] Updated weights for policy 1, policy_version 1689479 (0.0010) [2023-12-28 07:22:29,512][106226] Updated weights for policy 0, policy_version 1685504 (0.0007) [2023-12-28 07:22:29,563][106226] Updated weights for policy 0, policy_version 1685514 (0.0005) [2023-12-28 07:22:29,620][106226] Updated weights for policy 0, policy_version 1685524 (0.0005) [2023-12-28 07:22:29,653][106225] Updated weights for policy 1, policy_version 1689489 (0.0008) [2023-12-28 07:22:29,712][106225] Updated weights for policy 1, policy_version 1689499 (0.0010) [2023-12-28 07:22:29,771][106225] Updated weights for policy 1, policy_version 1689509 (0.0009) [2023-12-28 07:22:30,250][106226] Updated weights for policy 0, policy_version 1685534 (0.0007) [2023-12-28 07:22:30,303][106226] Updated weights for policy 0, policy_version 1685544 (0.0009) [2023-12-28 07:22:30,358][106226] Updated weights for policy 0, policy_version 1685554 (0.0008) [2023-12-28 07:22:30,543][106225] Updated weights for policy 1, policy_version 1689519 (0.0008) [2023-12-28 07:22:30,601][106225] Updated weights for policy 1, policy_version 1689529 (0.0008) [2023-12-28 07:22:30,662][106225] Updated weights for policy 1, policy_version 1689539 (0.0009) [2023-12-28 07:22:31,093][106226] Updated weights for policy 0, policy_version 1685564 (0.0008) [2023-12-28 07:22:31,158][106226] Updated weights for policy 0, policy_version 1685574 (0.0007) [2023-12-28 07:22:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 864157696. Throughput: 0: 10041.9, 1: 9956.1. Samples: 864152328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:31,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.850')] [2023-12-28 07:22:31,218][106226] Updated weights for policy 0, policy_version 1685584 (0.0006) [2023-12-28 07:22:31,381][106225] Updated weights for policy 1, policy_version 1689550 (0.0008) [2023-12-28 07:22:31,442][106225] Updated weights for policy 1, policy_version 1689560 (0.0007) [2023-12-28 07:22:31,503][106225] Updated weights for policy 1, policy_version 1689570 (0.0005) [2023-12-28 07:22:31,962][106226] Updated weights for policy 0, policy_version 1685594 (0.0008) [2023-12-28 07:22:32,017][106226] Updated weights for policy 0, policy_version 1685604 (0.0008) [2023-12-28 07:22:32,072][106226] Updated weights for policy 0, policy_version 1685614 (0.0008) [2023-12-28 07:22:32,129][106226] Updated weights for policy 0, policy_version 1685624 (0.0009) [2023-12-28 07:22:32,205][106225] Updated weights for policy 1, policy_version 1689580 (0.0007) [2023-12-28 07:22:32,270][106225] Updated weights for policy 1, policy_version 1689590 (0.0009) [2023-12-28 07:22:32,329][106225] Updated weights for policy 1, policy_version 1689600 (0.0009) [2023-12-28 07:22:32,828][106226] Updated weights for policy 0, policy_version 1685634 (0.0008) [2023-12-28 07:22:32,878][106226] Updated weights for policy 0, policy_version 1685644 (0.0009) [2023-12-28 07:22:32,927][106226] Updated weights for policy 0, policy_version 1685654 (0.0008) [2023-12-28 07:22:33,056][106225] Updated weights for policy 1, policy_version 1689610 (0.0008) [2023-12-28 07:22:33,113][106225] Updated weights for policy 1, policy_version 1689620 (0.0009) [2023-12-28 07:22:33,165][106225] Updated weights for policy 1, policy_version 1689630 (0.0008) [2023-12-28 07:22:33,221][106225] Updated weights for policy 1, policy_version 1689640 (0.0009) [2023-12-28 07:22:33,517][106226] Updated weights for policy 0, policy_version 1685664 (0.0009) [2023-12-28 07:22:33,573][106226] Updated weights for policy 0, policy_version 1685674 (0.0008) [2023-12-28 07:22:33,635][106226] Updated weights for policy 0, policy_version 1685684 (0.0007) [2023-12-28 07:22:34,028][106225] Updated weights for policy 1, policy_version 1689650 (0.0005) [2023-12-28 07:22:34,090][106225] Updated weights for policy 1, policy_version 1689660 (0.0007) [2023-12-28 07:22:34,159][106225] Updated weights for policy 1, policy_version 1689670 (0.0007) [2023-12-28 07:22:34,302][106226] Updated weights for policy 0, policy_version 1685694 (0.0007) [2023-12-28 07:22:34,367][106226] Updated weights for policy 0, policy_version 1685704 (0.0007) [2023-12-28 07:22:34,430][106226] Updated weights for policy 0, policy_version 1685714 (0.0006) [2023-12-28 07:22:34,893][106225] Updated weights for policy 1, policy_version 1689680 (0.0010) [2023-12-28 07:22:34,959][106225] Updated weights for policy 1, policy_version 1689690 (0.0008) [2023-12-28 07:22:35,017][106225] Updated weights for policy 1, policy_version 1689700 (0.0007) [2023-12-28 07:22:35,024][106226] Updated weights for policy 0, policy_version 1685724 (0.0006) [2023-12-28 07:22:35,089][106226] Updated weights for policy 0, policy_version 1685734 (0.0007) [2023-12-28 07:22:35,152][106226] Updated weights for policy 0, policy_version 1685744 (0.0008) [2023-12-28 07:22:35,734][106226] Updated weights for policy 0, policy_version 1685754 (0.0007) [2023-12-28 07:22:35,738][106225] Updated weights for policy 1, policy_version 1689710 (0.0006) [2023-12-28 07:22:35,783][106225] Updated weights for policy 1, policy_version 1689720 (0.0009) [2023-12-28 07:22:35,785][106226] Updated weights for policy 0, policy_version 1685764 (0.0005) [2023-12-28 07:22:35,835][106226] Updated weights for policy 0, policy_version 1685774 (0.0007) [2023-12-28 07:22:35,837][106225] Updated weights for policy 1, policy_version 1689730 (0.0010) [2023-12-28 07:22:35,886][106226] Updated weights for policy 0, policy_version 1685784 (0.0006) [2023-12-28 07:22:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 864264192. Throughput: 0: 10068.0, 1: 9918.6. Samples: 864271008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:36,176][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.725')] [2023-12-28 07:22:36,578][106225] Updated weights for policy 1, policy_version 1689740 (0.0010) [2023-12-28 07:22:36,636][106225] Updated weights for policy 1, policy_version 1689750 (0.0011) [2023-12-28 07:22:36,667][106226] Updated weights for policy 0, policy_version 1685794 (0.0009) [2023-12-28 07:22:36,691][106225] Updated weights for policy 1, policy_version 1689760 (0.0010) [2023-12-28 07:22:36,721][106226] Updated weights for policy 0, policy_version 1685804 (0.0006) [2023-12-28 07:22:36,779][106226] Updated weights for policy 0, policy_version 1685814 (0.0008) [2023-12-28 07:22:37,435][106225] Updated weights for policy 1, policy_version 1689770 (0.0010) [2023-12-28 07:22:37,496][106225] Updated weights for policy 1, policy_version 1689780 (0.0010) [2023-12-28 07:22:37,544][106226] Updated weights for policy 0, policy_version 1685824 (0.0009) [2023-12-28 07:22:37,554][106225] Updated weights for policy 1, policy_version 1689790 (0.0011) [2023-12-28 07:22:37,599][106226] Updated weights for policy 0, policy_version 1685834 (0.0006) [2023-12-28 07:22:37,615][106225] Updated weights for policy 1, policy_version 1689800 (0.0010) [2023-12-28 07:22:37,652][106226] Updated weights for policy 0, policy_version 1685844 (0.0009) [2023-12-28 07:22:38,329][106225] Updated weights for policy 1, policy_version 1689810 (0.0010) [2023-12-28 07:22:38,386][106225] Updated weights for policy 1, policy_version 1689820 (0.0011) [2023-12-28 07:22:38,412][106226] Updated weights for policy 0, policy_version 1685854 (0.0008) [2023-12-28 07:22:38,444][106225] Updated weights for policy 1, policy_version 1689830 (0.0010) [2023-12-28 07:22:38,469][106226] Updated weights for policy 0, policy_version 1685864 (0.0007) [2023-12-28 07:22:38,539][106226] Updated weights for policy 0, policy_version 1685874 (0.0008) [2023-12-28 07:22:39,169][106225] Updated weights for policy 1, policy_version 1689840 (0.0007) [2023-12-28 07:22:39,195][106226] Updated weights for policy 0, policy_version 1685884 (0.0007) [2023-12-28 07:22:39,219][106225] Updated weights for policy 1, policy_version 1689850 (0.0008) [2023-12-28 07:22:39,266][106226] Updated weights for policy 0, policy_version 1685894 (0.0008) [2023-12-28 07:22:39,284][106225] Updated weights for policy 1, policy_version 1689860 (0.0010) [2023-12-28 07:22:39,327][106226] Updated weights for policy 0, policy_version 1685904 (0.0009) [2023-12-28 07:22:40,055][106225] Updated weights for policy 1, policy_version 1689870 (0.0010) [2023-12-28 07:22:40,069][106226] Updated weights for policy 0, policy_version 1685914 (0.0008) [2023-12-28 07:22:40,113][106225] Updated weights for policy 1, policy_version 1689880 (0.0011) [2023-12-28 07:22:40,132][106226] Updated weights for policy 0, policy_version 1685924 (0.0006) [2023-12-28 07:22:40,172][106225] Updated weights for policy 1, policy_version 1689890 (0.0010) [2023-12-28 07:22:40,193][106226] Updated weights for policy 0, policy_version 1685934 (0.0005) [2023-12-28 07:22:40,259][106226] Updated weights for policy 0, policy_version 1685944 (0.0008) [2023-12-28 07:22:40,915][106225] Updated weights for policy 1, policy_version 1689900 (0.0010) [2023-12-28 07:22:40,975][106225] Updated weights for policy 1, policy_version 1689910 (0.0010) [2023-12-28 07:22:40,985][106226] Updated weights for policy 0, policy_version 1685954 (0.0005) [2023-12-28 07:22:41,051][106225] Updated weights for policy 1, policy_version 1689920 (0.0010) [2023-12-28 07:22:41,053][106226] Updated weights for policy 0, policy_version 1685964 (0.0008) [2023-12-28 07:22:41,116][106226] Updated weights for policy 0, policy_version 1685974 (0.0007) [2023-12-28 07:22:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 864362496. Throughput: 0: 10057.8, 1: 9875.8. Samples: 864327572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:41,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.522')] [2023-12-28 07:22:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001685976_431685632.pth... [2023-12-28 07:22:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001689928_432676864.pth... [2023-12-28 07:22:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001684792_431382528.pth [2023-12-28 07:22:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001688776_432381952.pth [2023-12-28 07:22:41,901][106225] Updated weights for policy 1, policy_version 1689930 (0.0011) [2023-12-28 07:22:41,903][106226] Updated weights for policy 0, policy_version 1685984 (0.0008) [2023-12-28 07:22:41,964][106225] Updated weights for policy 1, policy_version 1689940 (0.0011) [2023-12-28 07:22:41,965][106226] Updated weights for policy 0, policy_version 1685994 (0.0007) [2023-12-28 07:22:42,025][106226] Updated weights for policy 0, policy_version 1686004 (0.0006) [2023-12-28 07:22:42,026][106225] Updated weights for policy 1, policy_version 1689950 (0.0010) [2023-12-28 07:22:42,088][106225] Updated weights for policy 1, policy_version 1689960 (0.0010) [2023-12-28 07:22:42,759][106226] Updated weights for policy 0, policy_version 1686014 (0.0008) [2023-12-28 07:22:42,772][106225] Updated weights for policy 1, policy_version 1689970 (0.0007) [2023-12-28 07:22:42,820][106226] Updated weights for policy 0, policy_version 1686024 (0.0007) [2023-12-28 07:22:42,837][106225] Updated weights for policy 1, policy_version 1689980 (0.0006) [2023-12-28 07:22:42,891][106226] Updated weights for policy 0, policy_version 1686034 (0.0006) [2023-12-28 07:22:42,896][106225] Updated weights for policy 1, policy_version 1689990 (0.0007) [2023-12-28 07:22:43,474][106226] Updated weights for policy 0, policy_version 1686044 (0.0009) [2023-12-28 07:22:43,484][106225] Updated weights for policy 1, policy_version 1690000 (0.0008) [2023-12-28 07:22:43,522][106226] Updated weights for policy 0, policy_version 1686054 (0.0006) [2023-12-28 07:22:43,532][106225] Updated weights for policy 1, policy_version 1690010 (0.0006) [2023-12-28 07:22:43,577][106226] Updated weights for policy 0, policy_version 1686064 (0.0005) [2023-12-28 07:22:43,593][106225] Updated weights for policy 1, policy_version 1690020 (0.0006) [2023-12-28 07:22:44,182][106226] Updated weights for policy 0, policy_version 1686074 (0.0006) [2023-12-28 07:22:44,254][106226] Updated weights for policy 0, policy_version 1686084 (0.0009) [2023-12-28 07:22:44,323][106226] Updated weights for policy 0, policy_version 1686094 (0.0006) [2023-12-28 07:22:44,336][106225] Updated weights for policy 1, policy_version 1690030 (0.0007) [2023-12-28 07:22:44,390][106226] Updated weights for policy 0, policy_version 1686104 (0.0006) [2023-12-28 07:22:44,394][106225] Updated weights for policy 1, policy_version 1690040 (0.0008) [2023-12-28 07:22:44,453][106225] Updated weights for policy 1, policy_version 1690050 (0.0010) [2023-12-28 07:22:44,999][106226] Updated weights for policy 0, policy_version 1686114 (0.0008) [2023-12-28 07:22:45,058][106226] Updated weights for policy 0, policy_version 1686124 (0.0008) [2023-12-28 07:22:45,123][106226] Updated weights for policy 0, policy_version 1686134 (0.0009) [2023-12-28 07:22:45,163][106225] Updated weights for policy 1, policy_version 1690060 (0.0008) [2023-12-28 07:22:45,219][106225] Updated weights for policy 1, policy_version 1690070 (0.0006) [2023-12-28 07:22:45,281][106225] Updated weights for policy 1, policy_version 1690080 (0.0008) [2023-12-28 07:22:45,861][106226] Updated weights for policy 0, policy_version 1686144 (0.0008) [2023-12-28 07:22:45,917][106226] Updated weights for policy 0, policy_version 1686154 (0.0008) [2023-12-28 07:22:45,959][106225] Updated weights for policy 1, policy_version 1690090 (0.0010) [2023-12-28 07:22:45,968][106226] Updated weights for policy 0, policy_version 1686164 (0.0009) [2023-12-28 07:22:46,006][106225] Updated weights for policy 1, policy_version 1690100 (0.0010) [2023-12-28 07:22:46,052][106225] Updated weights for policy 1, policy_version 1690110 (0.0005) [2023-12-28 07:22:46,100][106225] Updated weights for policy 1, policy_version 1690120 (0.0009) [2023-12-28 07:22:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 864460800. Throughput: 0: 10052.4, 1: 9847.2. Samples: 864444360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:46,176][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.466')] [2023-12-28 07:22:46,678][106226] Updated weights for policy 0, policy_version 1686174 (0.0007) [2023-12-28 07:22:46,728][106226] Updated weights for policy 0, policy_version 1686184 (0.0007) [2023-12-28 07:22:46,778][106226] Updated weights for policy 0, policy_version 1686194 (0.0007) [2023-12-28 07:22:46,836][106225] Updated weights for policy 1, policy_version 1690130 (0.0010) [2023-12-28 07:22:46,895][106225] Updated weights for policy 1, policy_version 1690140 (0.0007) [2023-12-28 07:22:46,950][106225] Updated weights for policy 1, policy_version 1690150 (0.0010) [2023-12-28 07:22:47,524][106226] Updated weights for policy 0, policy_version 1686204 (0.0006) [2023-12-28 07:22:47,553][106225] Updated weights for policy 1, policy_version 1690160 (0.0010) [2023-12-28 07:22:47,578][106226] Updated weights for policy 0, policy_version 1686214 (0.0007) [2023-12-28 07:22:47,618][106225] Updated weights for policy 1, policy_version 1690170 (0.0008) [2023-12-28 07:22:47,627][106226] Updated weights for policy 0, policy_version 1686224 (0.0008) [2023-12-28 07:22:47,674][106225] Updated weights for policy 1, policy_version 1690180 (0.0008) [2023-12-28 07:22:48,313][106226] Updated weights for policy 0, policy_version 1686234 (0.0007) [2023-12-28 07:22:48,384][106226] Updated weights for policy 0, policy_version 1686244 (0.0010) [2023-12-28 07:22:48,406][106225] Updated weights for policy 1, policy_version 1690190 (0.0007) [2023-12-28 07:22:48,446][106226] Updated weights for policy 0, policy_version 1686254 (0.0011) [2023-12-28 07:22:48,456][106225] Updated weights for policy 1, policy_version 1690200 (0.0006) [2023-12-28 07:22:48,509][106225] Updated weights for policy 1, policy_version 1690210 (0.0007) [2023-12-28 07:22:48,510][106226] Updated weights for policy 0, policy_version 1686264 (0.0011) [2023-12-28 07:22:49,181][106226] Updated weights for policy 0, policy_version 1686274 (0.0007) [2023-12-28 07:22:49,253][106225] Updated weights for policy 1, policy_version 1690220 (0.0008) [2023-12-28 07:22:49,267][106226] Updated weights for policy 0, policy_version 1686284 (0.0007) [2023-12-28 07:22:49,315][106225] Updated weights for policy 1, policy_version 1690230 (0.0008) [2023-12-28 07:22:49,329][106226] Updated weights for policy 0, policy_version 1686294 (0.0007) [2023-12-28 07:22:49,381][106225] Updated weights for policy 1, policy_version 1690240 (0.0008) [2023-12-28 07:22:50,001][106226] Updated weights for policy 0, policy_version 1686304 (0.0008) [2023-12-28 07:22:50,059][106226] Updated weights for policy 0, policy_version 1686314 (0.0009) [2023-12-28 07:22:50,119][106226] Updated weights for policy 0, policy_version 1686324 (0.0009) [2023-12-28 07:22:50,141][106225] Updated weights for policy 1, policy_version 1690250 (0.0008) [2023-12-28 07:22:50,199][106225] Updated weights for policy 1, policy_version 1690260 (0.0008) [2023-12-28 07:22:50,254][106225] Updated weights for policy 1, policy_version 1690270 (0.0008) [2023-12-28 07:22:50,306][106225] Updated weights for policy 1, policy_version 1690280 (0.0008) [2023-12-28 07:22:50,882][106226] Updated weights for policy 0, policy_version 1686334 (0.0009) [2023-12-28 07:22:50,945][106226] Updated weights for policy 0, policy_version 1686344 (0.0010) [2023-12-28 07:22:51,010][106226] Updated weights for policy 0, policy_version 1686354 (0.0010) [2023-12-28 07:22:51,033][106225] Updated weights for policy 1, policy_version 1690290 (0.0007) [2023-12-28 07:22:51,097][106225] Updated weights for policy 1, policy_version 1690300 (0.0007) [2023-12-28 07:22:51,156][106225] Updated weights for policy 1, policy_version 1690310 (0.0008) [2023-12-28 07:22:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 864559104. Throughput: 0: 10008.5, 1: 9834.4. Samples: 864561436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:51,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-4.751')] [2023-12-28 07:22:51,804][106226] Updated weights for policy 0, policy_version 1686364 (0.0010) [2023-12-28 07:22:51,864][106225] Updated weights for policy 1, policy_version 1690320 (0.0008) [2023-12-28 07:22:51,866][106226] Updated weights for policy 0, policy_version 1686374 (0.0007) [2023-12-28 07:22:51,925][106225] Updated weights for policy 1, policy_version 1690330 (0.0006) [2023-12-28 07:22:51,929][106226] Updated weights for policy 0, policy_version 1686384 (0.0008) [2023-12-28 07:22:51,988][106225] Updated weights for policy 1, policy_version 1690340 (0.0007) [2023-12-28 07:22:52,646][106226] Updated weights for policy 0, policy_version 1686394 (0.0011) [2023-12-28 07:22:52,703][106226] Updated weights for policy 0, policy_version 1686404 (0.0011) [2023-12-28 07:22:52,713][106225] Updated weights for policy 1, policy_version 1690350 (0.0007) [2023-12-28 07:22:52,764][106226] Updated weights for policy 0, policy_version 1686414 (0.0011) [2023-12-28 07:22:52,771][106225] Updated weights for policy 1, policy_version 1690360 (0.0008) [2023-12-28 07:22:52,821][106226] Updated weights for policy 0, policy_version 1686424 (0.0010) [2023-12-28 07:22:52,830][106225] Updated weights for policy 1, policy_version 1690370 (0.0008) [2023-12-28 07:22:53,464][106226] Updated weights for policy 0, policy_version 1686434 (0.0007) [2023-12-28 07:22:53,514][106226] Updated weights for policy 0, policy_version 1686444 (0.0010) [2023-12-28 07:22:53,516][106225] Updated weights for policy 1, policy_version 1690380 (0.0008) [2023-12-28 07:22:53,568][106226] Updated weights for policy 0, policy_version 1686454 (0.0011) [2023-12-28 07:22:53,573][106225] Updated weights for policy 1, policy_version 1690390 (0.0010) [2023-12-28 07:22:53,628][106225] Updated weights for policy 1, policy_version 1690400 (0.0007) [2023-12-28 07:22:54,183][106226] Updated weights for policy 0, policy_version 1686464 (0.0010) [2023-12-28 07:22:54,244][106226] Updated weights for policy 0, policy_version 1686474 (0.0011) [2023-12-28 07:22:54,297][106226] Updated weights for policy 0, policy_version 1686484 (0.0010) [2023-12-28 07:22:54,323][106225] Updated weights for policy 1, policy_version 1690410 (0.0008) [2023-12-28 07:22:54,383][106225] Updated weights for policy 1, policy_version 1690420 (0.0010) [2023-12-28 07:22:54,439][106225] Updated weights for policy 1, policy_version 1690430 (0.0010) [2023-12-28 07:22:54,495][106225] Updated weights for policy 1, policy_version 1690440 (0.0010) [2023-12-28 07:22:54,959][106226] Updated weights for policy 0, policy_version 1686494 (0.0011) [2023-12-28 07:22:55,017][106226] Updated weights for policy 0, policy_version 1686504 (0.0010) [2023-12-28 07:22:55,070][106226] Updated weights for policy 0, policy_version 1686514 (0.0006) [2023-12-28 07:22:55,097][106225] Updated weights for policy 1, policy_version 1690450 (0.0011) [2023-12-28 07:22:55,155][106225] Updated weights for policy 1, policy_version 1690460 (0.0010) [2023-12-28 07:22:55,218][106225] Updated weights for policy 1, policy_version 1690470 (0.0010) [2023-12-28 07:22:55,693][106226] Updated weights for policy 0, policy_version 1686524 (0.0009) [2023-12-28 07:22:55,754][106226] Updated weights for policy 0, policy_version 1686534 (0.0008) [2023-12-28 07:22:55,778][106225] Updated weights for policy 1, policy_version 1690480 (0.0008) [2023-12-28 07:22:55,813][106226] Updated weights for policy 0, policy_version 1686544 (0.0005) [2023-12-28 07:22:55,835][106225] Updated weights for policy 1, policy_version 1690490 (0.0010) [2023-12-28 07:22:55,884][106225] Updated weights for policy 1, policy_version 1690500 (0.0010) [2023-12-28 07:22:56,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 864657408. Throughput: 0: 9962.0, 1: 9808.2. Samples: 864621488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:22:56,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-5.032')] [2023-12-28 07:22:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001686552_431833088.pth... [2023-12-28 07:22:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001690504_432824320.pth... [2023-12-28 07:22:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001685368_431529984.pth [2023-12-28 07:22:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001689352_432529408.pth [2023-12-28 07:22:56,440][106226] Updated weights for policy 0, policy_version 1686554 (0.0006) [2023-12-28 07:22:56,487][106226] Updated weights for policy 0, policy_version 1686564 (0.0007) [2023-12-28 07:22:56,531][106226] Updated weights for policy 0, policy_version 1686574 (0.0007) [2023-12-28 07:22:56,581][106225] Updated weights for policy 1, policy_version 1690510 (0.0010) [2023-12-28 07:22:56,586][106226] Updated weights for policy 0, policy_version 1686584 (0.0007) [2023-12-28 07:22:56,633][106225] Updated weights for policy 1, policy_version 1690520 (0.0010) [2023-12-28 07:22:56,682][106225] Updated weights for policy 1, policy_version 1690530 (0.0010) [2023-12-28 07:22:57,245][106226] Updated weights for policy 0, policy_version 1686594 (0.0005) [2023-12-28 07:22:57,307][106226] Updated weights for policy 0, policy_version 1686604 (0.0006) [2023-12-28 07:22:57,367][106226] Updated weights for policy 0, policy_version 1686614 (0.0006) [2023-12-28 07:22:57,414][106225] Updated weights for policy 1, policy_version 1690540 (0.0010) [2023-12-28 07:22:57,472][106225] Updated weights for policy 1, policy_version 1690550 (0.0008) [2023-12-28 07:22:57,532][106225] Updated weights for policy 1, policy_version 1690560 (0.0009) [2023-12-28 07:22:57,955][106226] Updated weights for policy 0, policy_version 1686624 (0.0007) [2023-12-28 07:22:58,018][106226] Updated weights for policy 0, policy_version 1686634 (0.0006) [2023-12-28 07:22:58,066][106226] Updated weights for policy 0, policy_version 1686644 (0.0005) [2023-12-28 07:22:58,308][106225] Updated weights for policy 1, policy_version 1690570 (0.0008) [2023-12-28 07:22:58,385][106225] Updated weights for policy 1, policy_version 1690580 (0.0008) [2023-12-28 07:22:58,448][106225] Updated weights for policy 1, policy_version 1690590 (0.0008) [2023-12-28 07:22:58,518][106225] Updated weights for policy 1, policy_version 1690600 (0.0008) [2023-12-28 07:22:58,827][106226] Updated weights for policy 0, policy_version 1686654 (0.0009) [2023-12-28 07:22:58,900][106226] Updated weights for policy 0, policy_version 1686664 (0.0008) [2023-12-28 07:22:58,970][106226] Updated weights for policy 0, policy_version 1686674 (0.0008) [2023-12-28 07:22:59,329][106225] Updated weights for policy 1, policy_version 1690610 (0.0008) [2023-12-28 07:22:59,395][106225] Updated weights for policy 1, policy_version 1690620 (0.0008) [2023-12-28 07:22:59,457][106225] Updated weights for policy 1, policy_version 1690630 (0.0009) [2023-12-28 07:22:59,710][106226] Updated weights for policy 0, policy_version 1686684 (0.0010) [2023-12-28 07:22:59,769][106226] Updated weights for policy 0, policy_version 1686694 (0.0010) [2023-12-28 07:22:59,817][106226] Updated weights for policy 0, policy_version 1686704 (0.0010) [2023-12-28 07:23:00,206][106225] Updated weights for policy 1, policy_version 1690640 (0.0007) [2023-12-28 07:23:00,273][106225] Updated weights for policy 1, policy_version 1690650 (0.0009) [2023-12-28 07:23:00,340][106225] Updated weights for policy 1, policy_version 1690660 (0.0010) [2023-12-28 07:23:00,508][106226] Updated weights for policy 0, policy_version 1686714 (0.0007) [2023-12-28 07:23:00,559][106226] Updated weights for policy 0, policy_version 1686724 (0.0005) [2023-12-28 07:23:00,611][106226] Updated weights for policy 0, policy_version 1686734 (0.0010) [2023-12-28 07:23:00,660][106226] Updated weights for policy 0, policy_version 1686744 (0.0010) [2023-12-28 07:23:00,985][106225] Updated weights for policy 1, policy_version 1690670 (0.0008) [2023-12-28 07:23:01,046][106225] Updated weights for policy 1, policy_version 1690680 (0.0007) [2023-12-28 07:23:01,111][106225] Updated weights for policy 1, policy_version 1690690 (0.0009) [2023-12-28 07:23:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 864755712. Throughput: 0: 10019.3, 1: 9813.1. Samples: 864742068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:01,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.576')] [2023-12-28 07:23:01,363][106226] Updated weights for policy 0, policy_version 1686754 (0.0008) [2023-12-28 07:23:01,427][106226] Updated weights for policy 0, policy_version 1686764 (0.0009) [2023-12-28 07:23:01,480][106226] Updated weights for policy 0, policy_version 1686774 (0.0009) [2023-12-28 07:23:01,817][106225] Updated weights for policy 1, policy_version 1690700 (0.0007) [2023-12-28 07:23:01,875][106225] Updated weights for policy 1, policy_version 1690710 (0.0005) [2023-12-28 07:23:01,937][106225] Updated weights for policy 1, policy_version 1690720 (0.0005) [2023-12-28 07:23:02,280][106226] Updated weights for policy 0, policy_version 1686784 (0.0009) [2023-12-28 07:23:02,340][106226] Updated weights for policy 0, policy_version 1686794 (0.0007) [2023-12-28 07:23:02,412][106226] Updated weights for policy 0, policy_version 1686804 (0.0007) [2023-12-28 07:23:02,557][106225] Updated weights for policy 1, policy_version 1690730 (0.0005) [2023-12-28 07:23:02,615][106225] Updated weights for policy 1, policy_version 1690740 (0.0008) [2023-12-28 07:23:02,671][106225] Updated weights for policy 1, policy_version 1690750 (0.0007) [2023-12-28 07:23:02,733][106225] Updated weights for policy 1, policy_version 1690760 (0.0010) [2023-12-28 07:23:03,102][106226] Updated weights for policy 0, policy_version 1686814 (0.0009) [2023-12-28 07:23:03,163][106226] Updated weights for policy 0, policy_version 1686824 (0.0010) [2023-12-28 07:23:03,213][106226] Updated weights for policy 0, policy_version 1686834 (0.0010) [2023-12-28 07:23:03,391][106225] Updated weights for policy 1, policy_version 1690770 (0.0008) [2023-12-28 07:23:03,447][106225] Updated weights for policy 1, policy_version 1690780 (0.0007) [2023-12-28 07:23:03,500][106225] Updated weights for policy 1, policy_version 1690790 (0.0007) [2023-12-28 07:23:03,921][106226] Updated weights for policy 0, policy_version 1686844 (0.0010) [2023-12-28 07:23:03,978][106226] Updated weights for policy 0, policy_version 1686854 (0.0011) [2023-12-28 07:23:04,041][106226] Updated weights for policy 0, policy_version 1686864 (0.0011) [2023-12-28 07:23:04,210][106225] Updated weights for policy 1, policy_version 1690800 (0.0010) [2023-12-28 07:23:04,275][106225] Updated weights for policy 1, policy_version 1690810 (0.0011) [2023-12-28 07:23:04,337][106225] Updated weights for policy 1, policy_version 1690820 (0.0010) [2023-12-28 07:23:04,760][106226] Updated weights for policy 0, policy_version 1686874 (0.0011) [2023-12-28 07:23:04,816][106226] Updated weights for policy 0, policy_version 1686884 (0.0010) [2023-12-28 07:23:04,864][106226] Updated weights for policy 0, policy_version 1686894 (0.0005) [2023-12-28 07:23:04,914][106226] Updated weights for policy 0, policy_version 1686904 (0.0005) [2023-12-28 07:23:05,027][106225] Updated weights for policy 1, policy_version 1690830 (0.0010) [2023-12-28 07:23:05,076][106225] Updated weights for policy 1, policy_version 1690840 (0.0010) [2023-12-28 07:23:05,123][106225] Updated weights for policy 1, policy_version 1690850 (0.0010) [2023-12-28 07:23:05,594][106226] Updated weights for policy 0, policy_version 1686914 (0.0010) [2023-12-28 07:23:05,652][106226] Updated weights for policy 0, policy_version 1686924 (0.0010) [2023-12-28 07:23:05,714][106226] Updated weights for policy 0, policy_version 1686934 (0.0010) [2023-12-28 07:23:05,800][106225] Updated weights for policy 1, policy_version 1690860 (0.0009) [2023-12-28 07:23:05,862][106225] Updated weights for policy 1, policy_version 1690870 (0.0006) [2023-12-28 07:23:05,923][106225] Updated weights for policy 1, policy_version 1690880 (0.0005) [2023-12-28 07:23:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 864854016. Throughput: 0: 9957.1, 1: 9840.4. Samples: 864861404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:06,176][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.718')] [2023-12-28 07:23:06,432][106226] Updated weights for policy 0, policy_version 1686944 (0.0008) [2023-12-28 07:23:06,492][106226] Updated weights for policy 0, policy_version 1686954 (0.0009) [2023-12-28 07:23:06,555][106226] Updated weights for policy 0, policy_version 1686964 (0.0008) [2023-12-28 07:23:06,570][106225] Updated weights for policy 1, policy_version 1690890 (0.0005) [2023-12-28 07:23:06,619][106225] Updated weights for policy 1, policy_version 1690900 (0.0008) [2023-12-28 07:23:06,671][106225] Updated weights for policy 1, policy_version 1690910 (0.0008) [2023-12-28 07:23:06,740][106225] Updated weights for policy 1, policy_version 1690920 (0.0006) [2023-12-28 07:23:07,214][106226] Updated weights for policy 0, policy_version 1686974 (0.0006) [2023-12-28 07:23:07,277][106226] Updated weights for policy 0, policy_version 1686984 (0.0007) [2023-12-28 07:23:07,339][106226] Updated weights for policy 0, policy_version 1686994 (0.0009) [2023-12-28 07:23:07,487][106225] Updated weights for policy 1, policy_version 1690930 (0.0005) [2023-12-28 07:23:07,551][106225] Updated weights for policy 1, policy_version 1690940 (0.0005) [2023-12-28 07:23:07,616][106225] Updated weights for policy 1, policy_version 1690950 (0.0008) [2023-12-28 07:23:07,914][106226] Updated weights for policy 0, policy_version 1687004 (0.0007) [2023-12-28 07:23:07,967][106226] Updated weights for policy 0, policy_version 1687014 (0.0005) [2023-12-28 07:23:08,029][106226] Updated weights for policy 0, policy_version 1687024 (0.0005) [2023-12-28 07:23:08,137][106225] Updated weights for policy 1, policy_version 1690960 (0.0007) [2023-12-28 07:23:08,187][106225] Updated weights for policy 1, policy_version 1690970 (0.0009) [2023-12-28 07:23:08,249][106225] Updated weights for policy 1, policy_version 1690980 (0.0008) [2023-12-28 07:23:08,641][106226] Updated weights for policy 0, policy_version 1687034 (0.0006) [2023-12-28 07:23:08,701][106226] Updated weights for policy 0, policy_version 1687044 (0.0009) [2023-12-28 07:23:08,766][106226] Updated weights for policy 0, policy_version 1687054 (0.0007) [2023-12-28 07:23:08,830][106226] Updated weights for policy 0, policy_version 1687064 (0.0006) [2023-12-28 07:23:09,035][106225] Updated weights for policy 1, policy_version 1690990 (0.0007) [2023-12-28 07:23:09,082][106225] Updated weights for policy 1, policy_version 1691000 (0.0008) [2023-12-28 07:23:09,139][106225] Updated weights for policy 1, policy_version 1691010 (0.0008) [2023-12-28 07:23:09,484][106226] Updated weights for policy 0, policy_version 1687074 (0.0007) [2023-12-28 07:23:09,542][106226] Updated weights for policy 0, policy_version 1687084 (0.0009) [2023-12-28 07:23:09,590][106226] Updated weights for policy 0, policy_version 1687094 (0.0007) [2023-12-28 07:23:09,838][106225] Updated weights for policy 1, policy_version 1691020 (0.0008) [2023-12-28 07:23:09,905][106225] Updated weights for policy 1, policy_version 1691030 (0.0007) [2023-12-28 07:23:09,968][106225] Updated weights for policy 1, policy_version 1691040 (0.0008) [2023-12-28 07:23:10,371][106226] Updated weights for policy 0, policy_version 1687104 (0.0010) [2023-12-28 07:23:10,440][106226] Updated weights for policy 0, policy_version 1687114 (0.0011) [2023-12-28 07:23:10,504][106226] Updated weights for policy 0, policy_version 1687124 (0.0011) [2023-12-28 07:23:10,636][106225] Updated weights for policy 1, policy_version 1691050 (0.0009) [2023-12-28 07:23:10,697][106225] Updated weights for policy 1, policy_version 1691060 (0.0009) [2023-12-28 07:23:10,748][106225] Updated weights for policy 1, policy_version 1691070 (0.0009) [2023-12-28 07:23:10,796][106225] Updated weights for policy 1, policy_version 1691080 (0.0008) [2023-12-28 07:23:11,143][106226] Updated weights for policy 0, policy_version 1687134 (0.0010) [2023-12-28 07:23:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 864952320. Throughput: 0: 10084.5, 1: 9836.3. Samples: 864925144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:11,175][105115] Avg episode reward: [(0, '-4.448'), (1, '-4.994')] [2023-12-28 07:23:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001691080_432971776.pth... [2023-12-28 07:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001689928_432676864.pth [2023-12-28 07:23:11,212][106226] Updated weights for policy 0, policy_version 1687144 (0.0008) [2023-12-28 07:23:11,285][106226] Updated weights for policy 0, policy_version 1687154 (0.0007) [2023-12-28 07:23:11,315][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001687160_431988736.pth... [2023-12-28 07:23:11,320][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001685976_431685632.pth [2023-12-28 07:23:11,578][106225] Updated weights for policy 1, policy_version 1691090 (0.0008) [2023-12-28 07:23:11,650][106225] Updated weights for policy 1, policy_version 1691100 (0.0008) [2023-12-28 07:23:11,713][106225] Updated weights for policy 1, policy_version 1691110 (0.0008) [2023-12-28 07:23:11,968][106226] Updated weights for policy 0, policy_version 1687164 (0.0011) [2023-12-28 07:23:12,023][106226] Updated weights for policy 0, policy_version 1687174 (0.0011) [2023-12-28 07:23:12,085][106226] Updated weights for policy 0, policy_version 1687184 (0.0011) [2023-12-28 07:23:12,448][106225] Updated weights for policy 1, policy_version 1691120 (0.0007) [2023-12-28 07:23:12,507][106225] Updated weights for policy 1, policy_version 1691130 (0.0009) [2023-12-28 07:23:12,562][106225] Updated weights for policy 1, policy_version 1691140 (0.0008) [2023-12-28 07:23:12,814][106226] Updated weights for policy 0, policy_version 1687194 (0.0011) [2023-12-28 07:23:12,878][106226] Updated weights for policy 0, policy_version 1687204 (0.0011) [2023-12-28 07:23:12,935][106226] Updated weights for policy 0, policy_version 1687214 (0.0011) [2023-12-28 07:23:12,989][106226] Updated weights for policy 0, policy_version 1687224 (0.0010) [2023-12-28 07:23:13,304][106225] Updated weights for policy 1, policy_version 1691150 (0.0008) [2023-12-28 07:23:13,364][106225] Updated weights for policy 1, policy_version 1691160 (0.0008) [2023-12-28 07:23:13,418][106225] Updated weights for policy 1, policy_version 1691170 (0.0007) [2023-12-28 07:23:13,696][106226] Updated weights for policy 0, policy_version 1687234 (0.0009) [2023-12-28 07:23:13,753][106226] Updated weights for policy 0, policy_version 1687244 (0.0007) [2023-12-28 07:23:13,807][106226] Updated weights for policy 0, policy_version 1687254 (0.0005) [2023-12-28 07:23:14,130][106225] Updated weights for policy 1, policy_version 1691180 (0.0007) [2023-12-28 07:23:14,182][106225] Updated weights for policy 1, policy_version 1691190 (0.0008) [2023-12-28 07:23:14,235][106225] Updated weights for policy 1, policy_version 1691200 (0.0008) [2023-12-28 07:23:14,451][106226] Updated weights for policy 0, policy_version 1687264 (0.0006) [2023-12-28 07:23:14,502][106226] Updated weights for policy 0, policy_version 1687274 (0.0006) [2023-12-28 07:23:14,560][106226] Updated weights for policy 0, policy_version 1687284 (0.0005) [2023-12-28 07:23:15,021][106225] Updated weights for policy 1, policy_version 1691210 (0.0009) [2023-12-28 07:23:15,086][106225] Updated weights for policy 1, policy_version 1691220 (0.0011) [2023-12-28 07:23:15,158][106225] Updated weights for policy 1, policy_version 1691230 (0.0011) [2023-12-28 07:23:15,204][106226] Updated weights for policy 0, policy_version 1687294 (0.0008) [2023-12-28 07:23:15,217][106225] Updated weights for policy 1, policy_version 1691240 (0.0011) [2023-12-28 07:23:15,271][106226] Updated weights for policy 0, policy_version 1687304 (0.0009) [2023-12-28 07:23:15,326][106226] Updated weights for policy 0, policy_version 1687314 (0.0008) [2023-12-28 07:23:15,911][106225] Updated weights for policy 1, policy_version 1691250 (0.0005) [2023-12-28 07:23:15,962][106225] Updated weights for policy 1, policy_version 1691260 (0.0005) [2023-12-28 07:23:16,013][106226] Updated weights for policy 0, policy_version 1687324 (0.0007) [2023-12-28 07:23:16,023][106225] Updated weights for policy 1, policy_version 1691270 (0.0008) [2023-12-28 07:23:16,075][106226] Updated weights for policy 0, policy_version 1687334 (0.0005) [2023-12-28 07:23:16,130][106226] Updated weights for policy 0, policy_version 1687344 (0.0006) [2023-12-28 07:23:16,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 865058816. Throughput: 0: 10027.6, 1: 9737.1. Samples: 865041736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:16,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.739')] [2023-12-28 07:23:16,689][106225] Updated weights for policy 1, policy_version 1691280 (0.0008) [2023-12-28 07:23:16,742][106225] Updated weights for policy 1, policy_version 1691290 (0.0010) [2023-12-28 07:23:16,802][106225] Updated weights for policy 1, policy_version 1691300 (0.0010) [2023-12-28 07:23:16,821][106226] Updated weights for policy 0, policy_version 1687354 (0.0007) [2023-12-28 07:23:16,877][106226] Updated weights for policy 0, policy_version 1687364 (0.0010) [2023-12-28 07:23:16,924][106226] Updated weights for policy 0, policy_version 1687374 (0.0010) [2023-12-28 07:23:16,980][106226] Updated weights for policy 0, policy_version 1687384 (0.0010) [2023-12-28 07:23:17,534][106225] Updated weights for policy 1, policy_version 1691310 (0.0010) [2023-12-28 07:23:17,591][106225] Updated weights for policy 1, policy_version 1691320 (0.0010) [2023-12-28 07:23:17,600][106226] Updated weights for policy 0, policy_version 1687394 (0.0006) [2023-12-28 07:23:17,641][106225] Updated weights for policy 1, policy_version 1691330 (0.0010) [2023-12-28 07:23:17,656][106226] Updated weights for policy 0, policy_version 1687404 (0.0005) [2023-12-28 07:23:17,720][106226] Updated weights for policy 0, policy_version 1687414 (0.0006) [2023-12-28 07:23:18,278][106225] Updated weights for policy 1, policy_version 1691340 (0.0008) [2023-12-28 07:23:18,341][106225] Updated weights for policy 1, policy_version 1691350 (0.0007) [2023-12-28 07:23:18,371][106226] Updated weights for policy 0, policy_version 1687424 (0.0008) [2023-12-28 07:23:18,403][106225] Updated weights for policy 1, policy_version 1691360 (0.0008) [2023-12-28 07:23:18,430][106226] Updated weights for policy 0, policy_version 1687434 (0.0008) [2023-12-28 07:23:18,479][106226] Updated weights for policy 0, policy_version 1687444 (0.0008) [2023-12-28 07:23:19,039][106225] Updated weights for policy 1, policy_version 1691370 (0.0008) [2023-12-28 07:23:19,098][106225] Updated weights for policy 1, policy_version 1691380 (0.0005) [2023-12-28 07:23:19,158][106225] Updated weights for policy 1, policy_version 1691390 (0.0006) [2023-12-28 07:23:19,185][106226] Updated weights for policy 0, policy_version 1687454 (0.0009) [2023-12-28 07:23:19,220][106225] Updated weights for policy 1, policy_version 1691400 (0.0008) [2023-12-28 07:23:19,258][106226] Updated weights for policy 0, policy_version 1687464 (0.0008) [2023-12-28 07:23:19,317][106226] Updated weights for policy 0, policy_version 1687474 (0.0006) [2023-12-28 07:23:19,855][106225] Updated weights for policy 1, policy_version 1691410 (0.0008) [2023-12-28 07:23:19,904][106225] Updated weights for policy 1, policy_version 1691420 (0.0008) [2023-12-28 07:23:19,972][106225] Updated weights for policy 1, policy_version 1691430 (0.0009) [2023-12-28 07:23:20,074][106226] Updated weights for policy 0, policy_version 1687484 (0.0009) [2023-12-28 07:23:20,130][106226] Updated weights for policy 0, policy_version 1687494 (0.0008) [2023-12-28 07:23:20,192][106226] Updated weights for policy 0, policy_version 1687504 (0.0009) [2023-12-28 07:23:20,731][106225] Updated weights for policy 1, policy_version 1691440 (0.0008) [2023-12-28 07:23:20,786][106225] Updated weights for policy 1, policy_version 1691450 (0.0008) [2023-12-28 07:23:20,844][106225] Updated weights for policy 1, policy_version 1691460 (0.0009) [2023-12-28 07:23:20,918][106226] Updated weights for policy 0, policy_version 1687514 (0.0009) [2023-12-28 07:23:20,981][106226] Updated weights for policy 0, policy_version 1687524 (0.0009) [2023-12-28 07:23:21,051][106226] Updated weights for policy 0, policy_version 1687534 (0.0009) [2023-12-28 07:23:21,109][106226] Updated weights for policy 0, policy_version 1687544 (0.0009) [2023-12-28 07:23:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 865157120. Throughput: 0: 9968.3, 1: 9815.9. Samples: 865161296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:21,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.658')] [2023-12-28 07:23:21,690][106225] Updated weights for policy 1, policy_version 1691470 (0.0008) [2023-12-28 07:23:21,761][106225] Updated weights for policy 1, policy_version 1691480 (0.0009) [2023-12-28 07:23:21,824][106225] Updated weights for policy 1, policy_version 1691490 (0.0008) [2023-12-28 07:23:21,943][106226] Updated weights for policy 0, policy_version 1687554 (0.0008) [2023-12-28 07:23:22,008][106226] Updated weights for policy 0, policy_version 1687564 (0.0008) [2023-12-28 07:23:22,055][106226] Updated weights for policy 0, policy_version 1687574 (0.0009) [2023-12-28 07:23:22,580][106225] Updated weights for policy 1, policy_version 1691500 (0.0008) [2023-12-28 07:23:22,641][106225] Updated weights for policy 1, policy_version 1691510 (0.0009) [2023-12-28 07:23:22,701][106225] Updated weights for policy 1, policy_version 1691520 (0.0009) [2023-12-28 07:23:22,806][106226] Updated weights for policy 0, policy_version 1687584 (0.0009) [2023-12-28 07:23:22,877][106226] Updated weights for policy 0, policy_version 1687594 (0.0008) [2023-12-28 07:23:22,943][106226] Updated weights for policy 0, policy_version 1687604 (0.0009) [2023-12-28 07:23:23,390][106225] Updated weights for policy 1, policy_version 1691530 (0.0008) [2023-12-28 07:23:23,455][106225] Updated weights for policy 1, policy_version 1691540 (0.0009) [2023-12-28 07:23:23,509][106225] Updated weights for policy 1, policy_version 1691550 (0.0010) [2023-12-28 07:23:23,563][106225] Updated weights for policy 1, policy_version 1691560 (0.0010) [2023-12-28 07:23:23,709][106226] Updated weights for policy 0, policy_version 1687614 (0.0008) [2023-12-28 07:23:23,770][106226] Updated weights for policy 0, policy_version 1687624 (0.0008) [2023-12-28 07:23:23,820][106226] Updated weights for policy 0, policy_version 1687634 (0.0007) [2023-12-28 07:23:24,287][106225] Updated weights for policy 1, policy_version 1691570 (0.0010) [2023-12-28 07:23:24,340][106225] Updated weights for policy 1, policy_version 1691580 (0.0010) [2023-12-28 07:23:24,399][106225] Updated weights for policy 1, policy_version 1691590 (0.0009) [2023-12-28 07:23:24,551][106226] Updated weights for policy 0, policy_version 1687644 (0.0009) [2023-12-28 07:23:24,610][106226] Updated weights for policy 0, policy_version 1687654 (0.0008) [2023-12-28 07:23:24,660][106226] Updated weights for policy 0, policy_version 1687664 (0.0008) [2023-12-28 07:23:25,091][106225] Updated weights for policy 1, policy_version 1691600 (0.0009) [2023-12-28 07:23:25,144][106225] Updated weights for policy 1, policy_version 1691610 (0.0010) [2023-12-28 07:23:25,190][106225] Updated weights for policy 1, policy_version 1691620 (0.0010) [2023-12-28 07:23:25,290][106226] Updated weights for policy 0, policy_version 1687674 (0.0008) [2023-12-28 07:23:25,351][106226] Updated weights for policy 0, policy_version 1687684 (0.0008) [2023-12-28 07:23:25,404][106226] Updated weights for policy 0, policy_version 1687694 (0.0007) [2023-12-28 07:23:25,454][106226] Updated weights for policy 0, policy_version 1687704 (0.0009) [2023-12-28 07:23:25,900][106225] Updated weights for policy 1, policy_version 1691630 (0.0010) [2023-12-28 07:23:25,959][106225] Updated weights for policy 1, policy_version 1691640 (0.0010) [2023-12-28 07:23:26,007][106225] Updated weights for policy 1, policy_version 1691650 (0.0008) [2023-12-28 07:23:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 865247232. Throughput: 0: 9947.2, 1: 9808.0. Samples: 865216552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:26,175][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.824')] [2023-12-28 07:23:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001691656_433119232.pth... [2023-12-28 07:23:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001690504_432824320.pth [2023-12-28 07:23:26,199][106226] Updated weights for policy 0, policy_version 1687714 (0.0008) [2023-12-28 07:23:26,248][106226] Updated weights for policy 0, policy_version 1687724 (0.0007) [2023-12-28 07:23:26,307][106226] Updated weights for policy 0, policy_version 1687734 (0.0006) [2023-12-28 07:23:26,316][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001687736_432136192.pth... [2023-12-28 07:23:26,319][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001686552_431833088.pth [2023-12-28 07:23:26,694][106225] Updated weights for policy 1, policy_version 1691660 (0.0007) [2023-12-28 07:23:26,755][106225] Updated weights for policy 1, policy_version 1691670 (0.0010) [2023-12-28 07:23:26,811][106225] Updated weights for policy 1, policy_version 1691680 (0.0010) [2023-12-28 07:23:26,924][106226] Updated weights for policy 0, policy_version 1687744 (0.0006) [2023-12-28 07:23:26,983][106226] Updated weights for policy 0, policy_version 1687754 (0.0009) [2023-12-28 07:23:27,040][106226] Updated weights for policy 0, policy_version 1687764 (0.0011) [2023-12-28 07:23:27,523][106225] Updated weights for policy 1, policy_version 1691690 (0.0010) [2023-12-28 07:23:27,585][106225] Updated weights for policy 1, policy_version 1691700 (0.0010) [2023-12-28 07:23:27,630][106225] Updated weights for policy 1, policy_version 1691710 (0.0010) [2023-12-28 07:23:27,686][106225] Updated weights for policy 1, policy_version 1691720 (0.0010) [2023-12-28 07:23:27,689][106226] Updated weights for policy 0, policy_version 1687774 (0.0010) [2023-12-28 07:23:27,745][106226] Updated weights for policy 0, policy_version 1687784 (0.0010) [2023-12-28 07:23:27,798][106226] Updated weights for policy 0, policy_version 1687794 (0.0010) [2023-12-28 07:23:28,435][106225] Updated weights for policy 1, policy_version 1691730 (0.0010) [2023-12-28 07:23:28,451][106226] Updated weights for policy 0, policy_version 1687804 (0.0011) [2023-12-28 07:23:28,500][106225] Updated weights for policy 1, policy_version 1691740 (0.0010) [2023-12-28 07:23:28,514][106226] Updated weights for policy 0, policy_version 1687814 (0.0011) [2023-12-28 07:23:28,564][106225] Updated weights for policy 1, policy_version 1691750 (0.0010) [2023-12-28 07:23:28,575][106226] Updated weights for policy 0, policy_version 1687824 (0.0011) [2023-12-28 07:23:29,247][106225] Updated weights for policy 1, policy_version 1691760 (0.0010) [2023-12-28 07:23:29,268][106226] Updated weights for policy 0, policy_version 1687834 (0.0010) [2023-12-28 07:23:29,311][106225] Updated weights for policy 1, policy_version 1691770 (0.0010) [2023-12-28 07:23:29,335][106226] Updated weights for policy 0, policy_version 1687844 (0.0010) [2023-12-28 07:23:29,382][106225] Updated weights for policy 1, policy_version 1691780 (0.0008) [2023-12-28 07:23:29,399][106226] Updated weights for policy 0, policy_version 1687854 (0.0010) [2023-12-28 07:23:29,463][106226] Updated weights for policy 0, policy_version 1687864 (0.0009) [2023-12-28 07:23:29,973][106225] Updated weights for policy 1, policy_version 1691790 (0.0008) [2023-12-28 07:23:30,041][106225] Updated weights for policy 1, policy_version 1691800 (0.0008) [2023-12-28 07:23:30,108][106225] Updated weights for policy 1, policy_version 1691810 (0.0008) [2023-12-28 07:23:30,219][106226] Updated weights for policy 0, policy_version 1687874 (0.0009) [2023-12-28 07:23:30,272][106226] Updated weights for policy 0, policy_version 1687884 (0.0008) [2023-12-28 07:23:30,327][106226] Updated weights for policy 0, policy_version 1687894 (0.0008) [2023-12-28 07:23:30,782][106225] Updated weights for policy 1, policy_version 1691820 (0.0007) [2023-12-28 07:23:30,834][106225] Updated weights for policy 1, policy_version 1691830 (0.0007) [2023-12-28 07:23:30,888][106225] Updated weights for policy 1, policy_version 1691840 (0.0006) [2023-12-28 07:23:31,028][106226] Updated weights for policy 0, policy_version 1687904 (0.0006) [2023-12-28 07:23:31,094][106226] Updated weights for policy 0, policy_version 1687914 (0.0010) [2023-12-28 07:23:31,166][106226] Updated weights for policy 0, policy_version 1687924 (0.0009) [2023-12-28 07:23:31,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 865345536. Throughput: 0: 9977.4, 1: 9865.7. Samples: 865337296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:31,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.679')] [2023-12-28 07:23:31,530][106225] Updated weights for policy 1, policy_version 1691850 (0.0006) [2023-12-28 07:23:31,581][106225] Updated weights for policy 1, policy_version 1691860 (0.0008) [2023-12-28 07:23:31,643][106225] Updated weights for policy 1, policy_version 1691870 (0.0008) [2023-12-28 07:23:31,702][106225] Updated weights for policy 1, policy_version 1691880 (0.0009) [2023-12-28 07:23:31,895][106226] Updated weights for policy 0, policy_version 1687934 (0.0009) [2023-12-28 07:23:31,960][106226] Updated weights for policy 0, policy_version 1687944 (0.0011) [2023-12-28 07:23:32,024][106226] Updated weights for policy 0, policy_version 1687954 (0.0010) [2023-12-28 07:23:32,489][106225] Updated weights for policy 1, policy_version 1691890 (0.0006) [2023-12-28 07:23:32,538][106225] Updated weights for policy 1, policy_version 1691900 (0.0006) [2023-12-28 07:23:32,599][106225] Updated weights for policy 1, policy_version 1691910 (0.0008) [2023-12-28 07:23:32,731][106226] Updated weights for policy 0, policy_version 1687964 (0.0007) [2023-12-28 07:23:32,792][106226] Updated weights for policy 0, policy_version 1687974 (0.0007) [2023-12-28 07:23:32,841][106226] Updated weights for policy 0, policy_version 1687984 (0.0009) [2023-12-28 07:23:33,293][106225] Updated weights for policy 1, policy_version 1691920 (0.0006) [2023-12-28 07:23:33,343][106225] Updated weights for policy 1, policy_version 1691930 (0.0010) [2023-12-28 07:23:33,392][106225] Updated weights for policy 1, policy_version 1691940 (0.0009) [2023-12-28 07:23:33,512][106226] Updated weights for policy 0, policy_version 1687994 (0.0008) [2023-12-28 07:23:33,570][106226] Updated weights for policy 0, policy_version 1688004 (0.0009) [2023-12-28 07:23:33,636][106226] Updated weights for policy 0, policy_version 1688014 (0.0006) [2023-12-28 07:23:33,698][106226] Updated weights for policy 0, policy_version 1688024 (0.0006) [2023-12-28 07:23:34,007][106225] Updated weights for policy 1, policy_version 1691951 (0.0007) [2023-12-28 07:23:34,066][106225] Updated weights for policy 1, policy_version 1691961 (0.0008) [2023-12-28 07:23:34,132][106225] Updated weights for policy 1, policy_version 1691971 (0.0010) [2023-12-28 07:23:34,358][106226] Updated weights for policy 0, policy_version 1688034 (0.0009) [2023-12-28 07:23:34,427][106226] Updated weights for policy 0, policy_version 1688044 (0.0009) [2023-12-28 07:23:34,485][106226] Updated weights for policy 0, policy_version 1688054 (0.0011) [2023-12-28 07:23:34,845][106225] Updated weights for policy 1, policy_version 1691981 (0.0011) [2023-12-28 07:23:34,898][106225] Updated weights for policy 1, policy_version 1691991 (0.0010) [2023-12-28 07:23:34,958][106225] Updated weights for policy 1, policy_version 1692001 (0.0010) [2023-12-28 07:23:35,184][106226] Updated weights for policy 0, policy_version 1688064 (0.0011) [2023-12-28 07:23:35,240][106226] Updated weights for policy 0, policy_version 1688074 (0.0010) [2023-12-28 07:23:35,300][106226] Updated weights for policy 0, policy_version 1688084 (0.0011) [2023-12-28 07:23:35,641][106225] Updated weights for policy 1, policy_version 1692011 (0.0007) [2023-12-28 07:23:35,692][106225] Updated weights for policy 1, policy_version 1692021 (0.0005) [2023-12-28 07:23:35,739][106225] Updated weights for policy 1, policy_version 1692031 (0.0005) [2023-12-28 07:23:35,905][106226] Updated weights for policy 0, policy_version 1688094 (0.0011) [2023-12-28 07:23:35,970][106226] Updated weights for policy 0, policy_version 1688104 (0.0006) [2023-12-28 07:23:36,026][106226] Updated weights for policy 0, policy_version 1688114 (0.0005) [2023-12-28 07:23:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 865452032. Throughput: 0: 10023.9, 1: 9919.6. Samples: 865458896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:36,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.689')] [2023-12-28 07:23:36,355][106225] Updated weights for policy 1, policy_version 1692041 (0.0005) [2023-12-28 07:23:36,422][106225] Updated weights for policy 1, policy_version 1692051 (0.0006) [2023-12-28 07:23:36,482][106225] Updated weights for policy 1, policy_version 1692061 (0.0006) [2023-12-28 07:23:36,548][106225] Updated weights for policy 1, policy_version 1692071 (0.0007) [2023-12-28 07:23:36,718][106226] Updated weights for policy 0, policy_version 1688124 (0.0007) [2023-12-28 07:23:36,777][106226] Updated weights for policy 0, policy_version 1688134 (0.0008) [2023-12-28 07:23:36,828][106226] Updated weights for policy 0, policy_version 1688144 (0.0010) [2023-12-28 07:23:37,115][106225] Updated weights for policy 1, policy_version 1692081 (0.0009) [2023-12-28 07:23:37,174][106225] Updated weights for policy 1, policy_version 1692091 (0.0010) [2023-12-28 07:23:37,233][106225] Updated weights for policy 1, policy_version 1692101 (0.0009) [2023-12-28 07:23:37,535][106226] Updated weights for policy 0, policy_version 1688154 (0.0010) [2023-12-28 07:23:37,590][106226] Updated weights for policy 0, policy_version 1688164 (0.0011) [2023-12-28 07:23:37,656][106226] Updated weights for policy 0, policy_version 1688174 (0.0011) [2023-12-28 07:23:37,715][106226] Updated weights for policy 0, policy_version 1688184 (0.0009) [2023-12-28 07:23:37,856][106225] Updated weights for policy 1, policy_version 1692111 (0.0006) [2023-12-28 07:23:37,925][106225] Updated weights for policy 1, policy_version 1692121 (0.0005) [2023-12-28 07:23:37,996][106225] Updated weights for policy 1, policy_version 1692131 (0.0010) [2023-12-28 07:23:38,387][106226] Updated weights for policy 0, policy_version 1688194 (0.0007) [2023-12-28 07:23:38,438][106226] Updated weights for policy 0, policy_version 1688204 (0.0009) [2023-12-28 07:23:38,485][106226] Updated weights for policy 0, policy_version 1688214 (0.0010) [2023-12-28 07:23:38,577][106225] Updated weights for policy 1, policy_version 1692141 (0.0009) [2023-12-28 07:23:38,644][106225] Updated weights for policy 1, policy_version 1692151 (0.0008) [2023-12-28 07:23:38,704][106225] Updated weights for policy 1, policy_version 1692161 (0.0007) [2023-12-28 07:23:39,261][106226] Updated weights for policy 0, policy_version 1688224 (0.0009) [2023-12-28 07:23:39,329][106226] Updated weights for policy 0, policy_version 1688234 (0.0006) [2023-12-28 07:23:39,404][106226] Updated weights for policy 0, policy_version 1688244 (0.0010) [2023-12-28 07:23:39,429][106225] Updated weights for policy 1, policy_version 1692171 (0.0008) [2023-12-28 07:23:39,497][106225] Updated weights for policy 1, policy_version 1692181 (0.0008) [2023-12-28 07:23:39,562][106225] Updated weights for policy 1, policy_version 1692191 (0.0006) [2023-12-28 07:23:40,141][106226] Updated weights for policy 0, policy_version 1688254 (0.0008) [2023-12-28 07:23:40,193][106225] Updated weights for policy 1, policy_version 1692201 (0.0006) [2023-12-28 07:23:40,209][106226] Updated weights for policy 0, policy_version 1688264 (0.0007) [2023-12-28 07:23:40,256][106225] Updated weights for policy 1, policy_version 1692211 (0.0006) [2023-12-28 07:23:40,266][106226] Updated weights for policy 0, policy_version 1688274 (0.0006) [2023-12-28 07:23:40,324][106225] Updated weights for policy 1, policy_version 1692221 (0.0007) [2023-12-28 07:23:40,393][106225] Updated weights for policy 1, policy_version 1692231 (0.0010) [2023-12-28 07:23:40,940][106226] Updated weights for policy 0, policy_version 1688284 (0.0007) [2023-12-28 07:23:41,003][106226] Updated weights for policy 0, policy_version 1688294 (0.0005) [2023-12-28 07:23:41,072][106226] Updated weights for policy 0, policy_version 1688304 (0.0009) [2023-12-28 07:23:41,105][106225] Updated weights for policy 1, policy_version 1692241 (0.0010) [2023-12-28 07:23:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 865550336. Throughput: 0: 10006.8, 1: 10001.7. Samples: 865521872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:41,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-4.606')] [2023-12-28 07:23:41,177][106225] Updated weights for policy 1, policy_version 1692251 (0.0009) [2023-12-28 07:23:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001688312_432283648.pth... [2023-12-28 07:23:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001687160_431988736.pth [2023-12-28 07:23:41,242][106225] Updated weights for policy 1, policy_version 1692261 (0.0010) [2023-12-28 07:23:41,262][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001692264_433274880.pth... [2023-12-28 07:23:41,269][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001691080_432971776.pth [2023-12-28 07:23:41,783][106226] Updated weights for policy 0, policy_version 1688314 (0.0010) [2023-12-28 07:23:41,842][106226] Updated weights for policy 0, policy_version 1688324 (0.0009) [2023-12-28 07:23:41,905][106226] Updated weights for policy 0, policy_version 1688334 (0.0006) [2023-12-28 07:23:41,974][106225] Updated weights for policy 1, policy_version 1692271 (0.0007) [2023-12-28 07:23:41,977][106226] Updated weights for policy 0, policy_version 1688344 (0.0009) [2023-12-28 07:23:42,048][106225] Updated weights for policy 1, policy_version 1692281 (0.0006) [2023-12-28 07:23:42,113][106225] Updated weights for policy 1, policy_version 1692291 (0.0006) [2023-12-28 07:23:42,636][106226] Updated weights for policy 0, policy_version 1688354 (0.0011) [2023-12-28 07:23:42,696][106226] Updated weights for policy 0, policy_version 1688364 (0.0011) [2023-12-28 07:23:42,763][106226] Updated weights for policy 0, policy_version 1688374 (0.0010) [2023-12-28 07:23:42,851][106225] Updated weights for policy 1, policy_version 1692301 (0.0009) [2023-12-28 07:23:42,909][106225] Updated weights for policy 1, policy_version 1692311 (0.0008) [2023-12-28 07:23:42,969][106225] Updated weights for policy 1, policy_version 1692321 (0.0006) [2023-12-28 07:23:43,415][106226] Updated weights for policy 0, policy_version 1688384 (0.0009) [2023-12-28 07:23:43,464][106226] Updated weights for policy 0, policy_version 1688394 (0.0009) [2023-12-28 07:23:43,517][106226] Updated weights for policy 0, policy_version 1688404 (0.0008) [2023-12-28 07:23:43,640][106225] Updated weights for policy 1, policy_version 1692331 (0.0007) [2023-12-28 07:23:43,690][106225] Updated weights for policy 1, policy_version 1692341 (0.0006) [2023-12-28 07:23:43,739][106225] Updated weights for policy 1, policy_version 1692351 (0.0005) [2023-12-28 07:23:44,266][106226] Updated weights for policy 0, policy_version 1688414 (0.0007) [2023-12-28 07:23:44,312][106226] Updated weights for policy 0, policy_version 1688424 (0.0005) [2023-12-28 07:23:44,361][106225] Updated weights for policy 1, policy_version 1692361 (0.0005) [2023-12-28 07:23:44,365][106226] Updated weights for policy 0, policy_version 1688434 (0.0005) [2023-12-28 07:23:44,420][106225] Updated weights for policy 1, policy_version 1692371 (0.0006) [2023-12-28 07:23:44,488][106225] Updated weights for policy 1, policy_version 1692381 (0.0006) [2023-12-28 07:23:44,536][106225] Updated weights for policy 1, policy_version 1692391 (0.0008) [2023-12-28 07:23:45,034][106226] Updated weights for policy 0, policy_version 1688444 (0.0007) [2023-12-28 07:23:45,095][106226] Updated weights for policy 0, policy_version 1688454 (0.0008) [2023-12-28 07:23:45,162][106226] Updated weights for policy 0, policy_version 1688464 (0.0008) [2023-12-28 07:23:45,246][106225] Updated weights for policy 1, policy_version 1692401 (0.0006) [2023-12-28 07:23:45,302][106225] Updated weights for policy 1, policy_version 1692411 (0.0009) [2023-12-28 07:23:45,361][106225] Updated weights for policy 1, policy_version 1692421 (0.0010) [2023-12-28 07:23:45,915][106226] Updated weights for policy 0, policy_version 1688474 (0.0007) [2023-12-28 07:23:45,966][106226] Updated weights for policy 0, policy_version 1688484 (0.0007) [2023-12-28 07:23:46,017][106226] Updated weights for policy 0, policy_version 1688494 (0.0006) [2023-12-28 07:23:46,060][106225] Updated weights for policy 1, policy_version 1692431 (0.0011) [2023-12-28 07:23:46,080][106226] Updated weights for policy 0, policy_version 1688504 (0.0005) [2023-12-28 07:23:46,117][106225] Updated weights for policy 1, policy_version 1692441 (0.0010) [2023-12-28 07:23:46,172][106225] Updated weights for policy 1, policy_version 1692451 (0.0010) [2023-12-28 07:23:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 865648640. Throughput: 0: 9945.8, 1: 9999.0. Samples: 865639580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:46,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-5.034')] [2023-12-28 07:23:46,781][106226] Updated weights for policy 0, policy_version 1688514 (0.0005) [2023-12-28 07:23:46,833][106225] Updated weights for policy 1, policy_version 1692461 (0.0010) [2023-12-28 07:23:46,839][106226] Updated weights for policy 0, policy_version 1688524 (0.0009) [2023-12-28 07:23:46,893][106225] Updated weights for policy 1, policy_version 1692471 (0.0010) [2023-12-28 07:23:46,898][106226] Updated weights for policy 0, policy_version 1688534 (0.0008) [2023-12-28 07:23:46,957][106225] Updated weights for policy 1, policy_version 1692481 (0.0010) [2023-12-28 07:23:47,533][106226] Updated weights for policy 0, policy_version 1688544 (0.0006) [2023-12-28 07:23:47,580][106226] Updated weights for policy 0, policy_version 1688554 (0.0005) [2023-12-28 07:23:47,587][106225] Updated weights for policy 1, policy_version 1692491 (0.0009) [2023-12-28 07:23:47,631][106226] Updated weights for policy 0, policy_version 1688564 (0.0005) [2023-12-28 07:23:47,638][106225] Updated weights for policy 1, policy_version 1692501 (0.0005) [2023-12-28 07:23:47,702][106225] Updated weights for policy 1, policy_version 1692511 (0.0006) [2023-12-28 07:23:48,210][106226] Updated weights for policy 0, policy_version 1688574 (0.0007) [2023-12-28 07:23:48,274][106226] Updated weights for policy 0, policy_version 1688584 (0.0008) [2023-12-28 07:23:48,337][106226] Updated weights for policy 0, policy_version 1688594 (0.0008) [2023-12-28 07:23:48,383][106225] Updated weights for policy 1, policy_version 1692521 (0.0006) [2023-12-28 07:23:48,440][106225] Updated weights for policy 1, policy_version 1692531 (0.0010) [2023-12-28 07:23:48,504][106225] Updated weights for policy 1, policy_version 1692541 (0.0011) [2023-12-28 07:23:48,567][106225] Updated weights for policy 1, policy_version 1692551 (0.0010) [2023-12-28 07:23:49,046][106226] Updated weights for policy 0, policy_version 1688604 (0.0010) [2023-12-28 07:23:49,096][106226] Updated weights for policy 0, policy_version 1688614 (0.0010) [2023-12-28 07:23:49,170][106226] Updated weights for policy 0, policy_version 1688624 (0.0011) [2023-12-28 07:23:49,291][106225] Updated weights for policy 1, policy_version 1692561 (0.0009) [2023-12-28 07:23:49,355][106225] Updated weights for policy 1, policy_version 1692571 (0.0009) [2023-12-28 07:23:49,418][106225] Updated weights for policy 1, policy_version 1692581 (0.0007) [2023-12-28 07:23:49,918][106226] Updated weights for policy 0, policy_version 1688634 (0.0010) [2023-12-28 07:23:49,973][106226] Updated weights for policy 0, policy_version 1688644 (0.0008) [2023-12-28 07:23:50,023][106226] Updated weights for policy 0, policy_version 1688654 (0.0008) [2023-12-28 07:23:50,073][106226] Updated weights for policy 0, policy_version 1688664 (0.0009) [2023-12-28 07:23:50,133][106225] Updated weights for policy 1, policy_version 1692591 (0.0008) [2023-12-28 07:23:50,190][106225] Updated weights for policy 1, policy_version 1692601 (0.0010) [2023-12-28 07:23:50,250][106225] Updated weights for policy 1, policy_version 1692611 (0.0010) [2023-12-28 07:23:50,842][106226] Updated weights for policy 0, policy_version 1688674 (0.0009) [2023-12-28 07:23:50,881][106225] Updated weights for policy 1, policy_version 1692621 (0.0008) [2023-12-28 07:23:50,893][106226] Updated weights for policy 0, policy_version 1688684 (0.0009) [2023-12-28 07:23:50,946][106226] Updated weights for policy 0, policy_version 1688694 (0.0009) [2023-12-28 07:23:50,948][106225] Updated weights for policy 1, policy_version 1692631 (0.0007) [2023-12-28 07:23:51,018][106225] Updated weights for policy 1, policy_version 1692641 (0.0007) [2023-12-28 07:23:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 865755136. Throughput: 0: 9949.2, 1: 9991.9. Samples: 865758752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:51,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.900')] [2023-12-28 07:23:51,802][106225] Updated weights for policy 1, policy_version 1692651 (0.0009) [2023-12-28 07:23:51,832][106226] Updated weights for policy 0, policy_version 1688704 (0.0008) [2023-12-28 07:23:51,865][106225] Updated weights for policy 1, policy_version 1692661 (0.0006) [2023-12-28 07:23:51,903][106226] Updated weights for policy 0, policy_version 1688714 (0.0009) [2023-12-28 07:23:51,925][106225] Updated weights for policy 1, policy_version 1692671 (0.0007) [2023-12-28 07:23:51,971][106226] Updated weights for policy 0, policy_version 1688724 (0.0010) [2023-12-28 07:23:52,635][106226] Updated weights for policy 0, policy_version 1688734 (0.0006) [2023-12-28 07:23:52,654][106225] Updated weights for policy 1, policy_version 1692681 (0.0007) [2023-12-28 07:23:52,699][106226] Updated weights for policy 0, policy_version 1688744 (0.0008) [2023-12-28 07:23:52,712][106225] Updated weights for policy 1, policy_version 1692691 (0.0006) [2023-12-28 07:23:52,764][106226] Updated weights for policy 0, policy_version 1688754 (0.0009) [2023-12-28 07:23:52,768][106225] Updated weights for policy 1, policy_version 1692701 (0.0006) [2023-12-28 07:23:52,828][106225] Updated weights for policy 1, policy_version 1692711 (0.0007) [2023-12-28 07:23:53,381][106226] Updated weights for policy 0, policy_version 1688764 (0.0008) [2023-12-28 07:23:53,436][106226] Updated weights for policy 0, policy_version 1688774 (0.0008) [2023-12-28 07:23:53,483][106226] Updated weights for policy 0, policy_version 1688784 (0.0008) [2023-12-28 07:23:53,544][106225] Updated weights for policy 1, policy_version 1692721 (0.0006) [2023-12-28 07:23:53,588][106225] Updated weights for policy 1, policy_version 1692731 (0.0008) [2023-12-28 07:23:53,646][106225] Updated weights for policy 1, policy_version 1692741 (0.0008) [2023-12-28 07:23:54,199][106226] Updated weights for policy 0, policy_version 1688794 (0.0008) [2023-12-28 07:23:54,253][106226] Updated weights for policy 0, policy_version 1688804 (0.0007) [2023-12-28 07:23:54,312][106226] Updated weights for policy 0, policy_version 1688814 (0.0006) [2023-12-28 07:23:54,363][106226] Updated weights for policy 0, policy_version 1688824 (0.0005) [2023-12-28 07:23:54,385][106225] Updated weights for policy 1, policy_version 1692751 (0.0006) [2023-12-28 07:23:54,432][106225] Updated weights for policy 1, policy_version 1692761 (0.0005) [2023-12-28 07:23:54,487][106225] Updated weights for policy 1, policy_version 1692771 (0.0006) [2023-12-28 07:23:55,042][106225] Updated weights for policy 1, policy_version 1692781 (0.0006) [2023-12-28 07:23:55,062][106226] Updated weights for policy 0, policy_version 1688834 (0.0009) [2023-12-28 07:23:55,098][106225] Updated weights for policy 1, policy_version 1692791 (0.0006) [2023-12-28 07:23:55,122][106226] Updated weights for policy 0, policy_version 1688844 (0.0005) [2023-12-28 07:23:55,154][106225] Updated weights for policy 1, policy_version 1692801 (0.0007) [2023-12-28 07:23:55,180][106226] Updated weights for policy 0, policy_version 1688854 (0.0009) [2023-12-28 07:23:55,789][106226] Updated weights for policy 0, policy_version 1688864 (0.0007) [2023-12-28 07:23:55,842][106225] Updated weights for policy 1, policy_version 1692811 (0.0006) [2023-12-28 07:23:55,851][106226] Updated weights for policy 0, policy_version 1688874 (0.0008) [2023-12-28 07:23:55,903][106225] Updated weights for policy 1, policy_version 1692821 (0.0006) [2023-12-28 07:23:55,914][106226] Updated weights for policy 0, policy_version 1688884 (0.0010) [2023-12-28 07:23:55,960][106225] Updated weights for policy 1, policy_version 1692831 (0.0008) [2023-12-28 07:23:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 865853440. Throughput: 0: 9892.3, 1: 9927.8. Samples: 865817052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:23:56,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.714')] [2023-12-28 07:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001688888_432431104.pth... [2023-12-28 07:23:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001692840_433422336.pth... [2023-12-28 07:23:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001687736_432136192.pth [2023-12-28 07:23:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001691656_433119232.pth [2023-12-28 07:23:56,577][106226] Updated weights for policy 0, policy_version 1688894 (0.0011) [2023-12-28 07:23:56,630][106226] Updated weights for policy 0, policy_version 1688904 (0.0010) [2023-12-28 07:23:56,651][106225] Updated weights for policy 1, policy_version 1692841 (0.0008) [2023-12-28 07:23:56,683][106226] Updated weights for policy 0, policy_version 1688914 (0.0010) [2023-12-28 07:23:56,712][106225] Updated weights for policy 1, policy_version 1692851 (0.0006) [2023-12-28 07:23:56,764][106225] Updated weights for policy 1, policy_version 1692861 (0.0005) [2023-12-28 07:23:56,817][106225] Updated weights for policy 1, policy_version 1692871 (0.0005) [2023-12-28 07:23:57,404][106226] Updated weights for policy 0, policy_version 1688924 (0.0008) [2023-12-28 07:23:57,407][106225] Updated weights for policy 1, policy_version 1692881 (0.0006) [2023-12-28 07:23:57,455][106225] Updated weights for policy 1, policy_version 1692891 (0.0009) [2023-12-28 07:23:57,472][106226] Updated weights for policy 0, policy_version 1688934 (0.0008) [2023-12-28 07:23:57,500][106225] Updated weights for policy 1, policy_version 1692901 (0.0006) [2023-12-28 07:23:57,529][106226] Updated weights for policy 0, policy_version 1688944 (0.0007) [2023-12-28 07:23:58,200][106225] Updated weights for policy 1, policy_version 1692911 (0.0006) [2023-12-28 07:23:58,266][106226] Updated weights for policy 0, policy_version 1688954 (0.0008) [2023-12-28 07:23:58,268][106225] Updated weights for policy 1, policy_version 1692921 (0.0008) [2023-12-28 07:23:58,344][106226] Updated weights for policy 0, policy_version 1688964 (0.0007) [2023-12-28 07:23:58,350][106225] Updated weights for policy 1, policy_version 1692931 (0.0008) [2023-12-28 07:23:58,415][106226] Updated weights for policy 0, policy_version 1688974 (0.0008) [2023-12-28 07:23:58,485][106226] Updated weights for policy 0, policy_version 1688984 (0.0008) [2023-12-28 07:23:59,227][106225] Updated weights for policy 1, policy_version 1692941 (0.0008) [2023-12-28 07:23:59,279][106226] Updated weights for policy 0, policy_version 1688995 (0.0009) [2023-12-28 07:23:59,296][106225] Updated weights for policy 1, policy_version 1692951 (0.0009) [2023-12-28 07:23:59,350][106226] Updated weights for policy 0, policy_version 1689005 (0.0008) [2023-12-28 07:23:59,378][106225] Updated weights for policy 1, policy_version 1692961 (0.0008) [2023-12-28 07:23:59,421][106226] Updated weights for policy 0, policy_version 1689015 (0.0010) [2023-12-28 07:24:00,167][106226] Updated weights for policy 0, policy_version 1689025 (0.0006) [2023-12-28 07:24:00,173][106225] Updated weights for policy 1, policy_version 1692971 (0.0008) [2023-12-28 07:24:00,226][106225] Updated weights for policy 1, policy_version 1692981 (0.0008) [2023-12-28 07:24:00,228][106226] Updated weights for policy 0, policy_version 1689035 (0.0008) [2023-12-28 07:24:00,276][106225] Updated weights for policy 1, policy_version 1692991 (0.0005) [2023-12-28 07:24:00,289][106226] Updated weights for policy 0, policy_version 1689045 (0.0006) [2023-12-28 07:24:00,878][106226] Updated weights for policy 0, policy_version 1689055 (0.0010) [2023-12-28 07:24:00,937][106226] Updated weights for policy 0, policy_version 1689065 (0.0011) [2023-12-28 07:24:00,995][106226] Updated weights for policy 0, policy_version 1689075 (0.0010) [2023-12-28 07:24:01,017][106225] Updated weights for policy 1, policy_version 1693001 (0.0007) [2023-12-28 07:24:01,081][106225] Updated weights for policy 1, policy_version 1693011 (0.0010) [2023-12-28 07:24:01,144][106225] Updated weights for policy 1, policy_version 1693021 (0.0009) [2023-12-28 07:24:01,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 865943552. Throughput: 0: 9853.8, 1: 9991.4. Samples: 865934768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:24:01,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.866')] [2023-12-28 07:24:01,207][106225] Updated weights for policy 1, policy_version 1693031 (0.0009) [2023-12-28 07:24:01,715][106226] Updated weights for policy 0, policy_version 1689085 (0.0011) [2023-12-28 07:24:01,789][106226] Updated weights for policy 0, policy_version 1689095 (0.0008) [2023-12-28 07:24:01,849][106226] Updated weights for policy 0, policy_version 1689105 (0.0007) [2023-12-28 07:24:01,925][106225] Updated weights for policy 1, policy_version 1693041 (0.0008) [2023-12-28 07:24:01,985][106225] Updated weights for policy 1, policy_version 1693051 (0.0009) [2023-12-28 07:24:02,047][106225] Updated weights for policy 1, policy_version 1693061 (0.0009) [2023-12-28 07:24:02,474][106226] Updated weights for policy 0, policy_version 1689115 (0.0007) [2023-12-28 07:24:02,529][106226] Updated weights for policy 0, policy_version 1689125 (0.0007) [2023-12-28 07:24:02,584][106226] Updated weights for policy 0, policy_version 1689135 (0.0006) [2023-12-28 07:24:02,843][106225] Updated weights for policy 1, policy_version 1693071 (0.0008) [2023-12-28 07:24:02,899][106225] Updated weights for policy 1, policy_version 1693081 (0.0008) [2023-12-28 07:24:02,955][106225] Updated weights for policy 1, policy_version 1693091 (0.0006) [2023-12-28 07:24:03,312][106226] Updated weights for policy 0, policy_version 1689145 (0.0008) [2023-12-28 07:24:03,367][106226] Updated weights for policy 0, policy_version 1689155 (0.0009) [2023-12-28 07:24:03,415][106226] Updated weights for policy 0, policy_version 1689165 (0.0009) [2023-12-28 07:24:03,459][106226] Updated weights for policy 0, policy_version 1689175 (0.0008) [2023-12-28 07:24:03,632][106225] Updated weights for policy 1, policy_version 1693101 (0.0006) [2023-12-28 07:24:03,688][106225] Updated weights for policy 1, policy_version 1693111 (0.0005) [2023-12-28 07:24:03,747][106225] Updated weights for policy 1, policy_version 1693121 (0.0005) [2023-12-28 07:24:04,181][106226] Updated weights for policy 0, policy_version 1689185 (0.0010) [2023-12-28 07:24:04,245][106226] Updated weights for policy 0, policy_version 1689195 (0.0008) [2023-12-28 07:24:04,313][106226] Updated weights for policy 0, policy_version 1689205 (0.0010) [2023-12-28 07:24:04,413][106225] Updated weights for policy 1, policy_version 1693131 (0.0006) [2023-12-28 07:24:04,474][106225] Updated weights for policy 1, policy_version 1693141 (0.0005) [2023-12-28 07:24:04,531][106225] Updated weights for policy 1, policy_version 1693151 (0.0008) [2023-12-28 07:24:05,053][106226] Updated weights for policy 0, policy_version 1689215 (0.0011) [2023-12-28 07:24:05,105][106226] Updated weights for policy 0, policy_version 1689225 (0.0011) [2023-12-28 07:24:05,159][106226] Updated weights for policy 0, policy_version 1689235 (0.0010) [2023-12-28 07:24:05,265][106225] Updated weights for policy 1, policy_version 1693161 (0.0007) [2023-12-28 07:24:05,316][106225] Updated weights for policy 1, policy_version 1693171 (0.0008) [2023-12-28 07:24:05,366][106225] Updated weights for policy 1, policy_version 1693181 (0.0008) [2023-12-28 07:24:05,425][106225] Updated weights for policy 1, policy_version 1693191 (0.0008) [2023-12-28 07:24:05,814][106226] Updated weights for policy 0, policy_version 1689245 (0.0008) [2023-12-28 07:24:05,862][106226] Updated weights for policy 0, policy_version 1689255 (0.0005) [2023-12-28 07:24:05,908][106226] Updated weights for policy 0, policy_version 1689265 (0.0009) [2023-12-28 07:24:06,102][106225] Updated weights for policy 1, policy_version 1693201 (0.0007) [2023-12-28 07:24:06,167][106225] Updated weights for policy 1, policy_version 1693211 (0.0007) [2023-12-28 07:24:06,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 866041856. Throughput: 0: 9877.7, 1: 9932.1. Samples: 866052744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:24:06,176][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.736')] [2023-12-28 07:24:06,218][106225] Updated weights for policy 1, policy_version 1693221 (0.0008) [2023-12-28 07:24:06,636][106226] Updated weights for policy 0, policy_version 1689275 (0.0011) [2023-12-28 07:24:06,691][106226] Updated weights for policy 0, policy_version 1689285 (0.0010) [2023-12-28 07:24:06,748][106226] Updated weights for policy 0, policy_version 1689295 (0.0011) [2023-12-28 07:24:06,981][106225] Updated weights for policy 1, policy_version 1693231 (0.0008) [2023-12-28 07:24:07,039][106225] Updated weights for policy 1, policy_version 1693241 (0.0008) [2023-12-28 07:24:07,091][106225] Updated weights for policy 1, policy_version 1693251 (0.0007) [2023-12-28 07:24:07,445][106226] Updated weights for policy 0, policy_version 1689305 (0.0008) [2023-12-28 07:24:07,503][106226] Updated weights for policy 0, policy_version 1689315 (0.0007) [2023-12-28 07:24:07,554][106226] Updated weights for policy 0, policy_version 1689325 (0.0010) [2023-12-28 07:24:07,603][106226] Updated weights for policy 0, policy_version 1689335 (0.0010) [2023-12-28 07:24:07,831][106225] Updated weights for policy 1, policy_version 1693261 (0.0006) [2023-12-28 07:24:07,891][106225] Updated weights for policy 1, policy_version 1693271 (0.0008) [2023-12-28 07:24:07,951][106225] Updated weights for policy 1, policy_version 1693281 (0.0007) [2023-12-28 07:24:08,305][106226] Updated weights for policy 0, policy_version 1689345 (0.0010) [2023-12-28 07:24:08,379][106226] Updated weights for policy 0, policy_version 1689355 (0.0011) [2023-12-28 07:24:08,444][106226] Updated weights for policy 0, policy_version 1689365 (0.0011) [2023-12-28 07:24:08,707][106225] Updated weights for policy 1, policy_version 1693291 (0.0007) [2023-12-28 07:24:08,762][106225] Updated weights for policy 1, policy_version 1693301 (0.0008) [2023-12-28 07:24:08,816][106225] Updated weights for policy 1, policy_version 1693311 (0.0008) [2023-12-28 07:24:09,089][106226] Updated weights for policy 0, policy_version 1689375 (0.0010) [2023-12-28 07:24:09,138][106226] Updated weights for policy 0, policy_version 1689385 (0.0010) [2023-12-28 07:24:09,194][106226] Updated weights for policy 0, policy_version 1689395 (0.0006) [2023-12-28 07:24:09,597][106225] Updated weights for policy 1, policy_version 1693321 (0.0007) [2023-12-28 07:24:09,657][106225] Updated weights for policy 1, policy_version 1693331 (0.0006) [2023-12-28 07:24:09,723][106225] Updated weights for policy 1, policy_version 1693341 (0.0006) [2023-12-28 07:24:09,780][106225] Updated weights for policy 1, policy_version 1693351 (0.0007) [2023-12-28 07:24:10,000][106226] Updated weights for policy 0, policy_version 1689405 (0.0010) [2023-12-28 07:24:10,067][106226] Updated weights for policy 0, policy_version 1689415 (0.0008) [2023-12-28 07:24:10,137][106226] Updated weights for policy 0, policy_version 1689425 (0.0008) [2023-12-28 07:24:10,409][106225] Updated weights for policy 1, policy_version 1693361 (0.0008) [2023-12-28 07:24:10,460][106225] Updated weights for policy 1, policy_version 1693371 (0.0008) [2023-12-28 07:24:10,510][106225] Updated weights for policy 1, policy_version 1693381 (0.0008) [2023-12-28 07:24:10,722][106226] Updated weights for policy 0, policy_version 1689435 (0.0007) [2023-12-28 07:24:10,770][106226] Updated weights for policy 0, policy_version 1689445 (0.0008) [2023-12-28 07:24:10,826][106226] Updated weights for policy 0, policy_version 1689455 (0.0009) [2023-12-28 07:24:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 866140160. Throughput: 0: 9940.5, 1: 9953.1. Samples: 866111764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:24:11,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.777')] [2023-12-28 07:24:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001693384_433561600.pth... [2023-12-28 07:24:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001689464_432578560.pth... [2023-12-28 07:24:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001692264_433274880.pth [2023-12-28 07:24:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001688312_432283648.pth [2023-12-28 07:24:11,239][106225] Updated weights for policy 1, policy_version 1693391 (0.0007) [2023-12-28 07:24:11,299][106225] Updated weights for policy 1, policy_version 1693401 (0.0007) [2023-12-28 07:24:11,368][106225] Updated weights for policy 1, policy_version 1693411 (0.0008) [2023-12-28 07:24:11,670][106226] Updated weights for policy 0, policy_version 1689465 (0.0008) [2023-12-28 07:24:11,730][106226] Updated weights for policy 0, policy_version 1689475 (0.0009) [2023-12-28 07:24:11,800][106226] Updated weights for policy 0, policy_version 1689485 (0.0008) [2023-12-28 07:24:11,858][106226] Updated weights for policy 0, policy_version 1689495 (0.0009) [2023-12-28 07:24:12,128][106225] Updated weights for policy 1, policy_version 1693421 (0.0007) [2023-12-28 07:24:12,190][106225] Updated weights for policy 1, policy_version 1693431 (0.0008) [2023-12-28 07:24:12,246][106225] Updated weights for policy 1, policy_version 1693441 (0.0008) [2023-12-28 07:24:12,560][106226] Updated weights for policy 0, policy_version 1689505 (0.0009) [2023-12-28 07:24:12,610][106226] Updated weights for policy 0, policy_version 1689515 (0.0008) [2023-12-28 07:24:12,672][106226] Updated weights for policy 0, policy_version 1689525 (0.0008) [2023-12-28 07:24:12,975][106225] Updated weights for policy 1, policy_version 1693451 (0.0009) [2023-12-28 07:24:13,034][106225] Updated weights for policy 1, policy_version 1693461 (0.0010) [2023-12-28 07:24:13,092][106225] Updated weights for policy 1, policy_version 1693471 (0.0007) [2023-12-28 07:24:13,312][106226] Updated weights for policy 0, policy_version 1689535 (0.0008) [2023-12-28 07:24:13,368][106226] Updated weights for policy 0, policy_version 1689545 (0.0007) [2023-12-28 07:24:13,427][106226] Updated weights for policy 0, policy_version 1689555 (0.0008) [2023-12-28 07:24:13,777][106225] Updated weights for policy 1, policy_version 1693481 (0.0010) [2023-12-28 07:24:13,833][106225] Updated weights for policy 1, policy_version 1693491 (0.0010) [2023-12-28 07:24:13,883][106225] Updated weights for policy 1, policy_version 1693501 (0.0010) [2023-12-28 07:24:13,933][106225] Updated weights for policy 1, policy_version 1693511 (0.0010) [2023-12-28 07:24:14,038][106226] Updated weights for policy 0, policy_version 1689565 (0.0007) [2023-12-28 07:24:14,087][106226] Updated weights for policy 0, policy_version 1689575 (0.0007) [2023-12-28 07:24:14,138][106226] Updated weights for policy 0, policy_version 1689585 (0.0008) [2023-12-28 07:24:14,578][106225] Updated weights for policy 1, policy_version 1693521 (0.0008) [2023-12-28 07:24:14,628][106225] Updated weights for policy 1, policy_version 1693531 (0.0010) [2023-12-28 07:24:14,683][106225] Updated weights for policy 1, policy_version 1693541 (0.0010) [2023-12-28 07:24:14,751][106226] Updated weights for policy 0, policy_version 1689595 (0.0008) [2023-12-28 07:24:14,821][106226] Updated weights for policy 0, policy_version 1689605 (0.0008) [2023-12-28 07:24:14,881][106226] Updated weights for policy 0, policy_version 1689615 (0.0008) [2023-12-28 07:24:15,456][106225] Updated weights for policy 1, policy_version 1693551 (0.0007) [2023-12-28 07:24:15,506][106226] Updated weights for policy 0, policy_version 1689625 (0.0008) [2023-12-28 07:24:15,524][106225] Updated weights for policy 1, policy_version 1693561 (0.0007) [2023-12-28 07:24:15,559][106226] Updated weights for policy 0, policy_version 1689635 (0.0006) [2023-12-28 07:24:15,583][106225] Updated weights for policy 1, policy_version 1693571 (0.0007) [2023-12-28 07:24:15,621][106226] Updated weights for policy 0, policy_version 1689645 (0.0005) [2023-12-28 07:24:15,685][106226] Updated weights for policy 0, policy_version 1689655 (0.0006) [2023-12-28 07:24:16,127][106225] Updated weights for policy 1, policy_version 1693581 (0.0010) [2023-12-28 07:24:16,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 866238464. Throughput: 0: 9919.4, 1: 9925.6. Samples: 866230320. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:16,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.037')] [2023-12-28 07:24:16,181][106225] Updated weights for policy 1, policy_version 1693591 (0.0010) [2023-12-28 07:24:16,228][106225] Updated weights for policy 1, policy_version 1693601 (0.0010) [2023-12-28 07:24:16,344][106226] Updated weights for policy 0, policy_version 1689665 (0.0008) [2023-12-28 07:24:16,403][106226] Updated weights for policy 0, policy_version 1689675 (0.0007) [2023-12-28 07:24:16,460][106226] Updated weights for policy 0, policy_version 1689685 (0.0007) [2023-12-28 07:24:16,839][106225] Updated weights for policy 1, policy_version 1693611 (0.0009) [2023-12-28 07:24:16,889][106225] Updated weights for policy 1, policy_version 1693621 (0.0010) [2023-12-28 07:24:16,940][106225] Updated weights for policy 1, policy_version 1693631 (0.0010) [2023-12-28 07:24:17,139][106226] Updated weights for policy 0, policy_version 1689695 (0.0007) [2023-12-28 07:24:17,200][106226] Updated weights for policy 0, policy_version 1689705 (0.0007) [2023-12-28 07:24:17,260][106226] Updated weights for policy 0, policy_version 1689715 (0.0008) [2023-12-28 07:24:17,590][106225] Updated weights for policy 1, policy_version 1693641 (0.0011) [2023-12-28 07:24:17,660][106225] Updated weights for policy 1, policy_version 1693651 (0.0010) [2023-12-28 07:24:17,731][106225] Updated weights for policy 1, policy_version 1693661 (0.0010) [2023-12-28 07:24:17,790][106225] Updated weights for policy 1, policy_version 1693671 (0.0011) [2023-12-28 07:24:17,935][106226] Updated weights for policy 0, policy_version 1689725 (0.0009) [2023-12-28 07:24:17,985][106226] Updated weights for policy 0, policy_version 1689735 (0.0008) [2023-12-28 07:24:18,043][106226] Updated weights for policy 0, policy_version 1689745 (0.0008) [2023-12-28 07:24:18,464][106225] Updated weights for policy 1, policy_version 1693681 (0.0010) [2023-12-28 07:24:18,529][106225] Updated weights for policy 1, policy_version 1693691 (0.0011) [2023-12-28 07:24:18,589][106225] Updated weights for policy 1, policy_version 1693701 (0.0010) [2023-12-28 07:24:18,728][106226] Updated weights for policy 0, policy_version 1689755 (0.0008) [2023-12-28 07:24:18,793][106226] Updated weights for policy 0, policy_version 1689765 (0.0008) [2023-12-28 07:24:18,860][106226] Updated weights for policy 0, policy_version 1689775 (0.0008) [2023-12-28 07:24:19,229][106225] Updated weights for policy 1, policy_version 1693711 (0.0009) [2023-12-28 07:24:19,300][106225] Updated weights for policy 1, policy_version 1693721 (0.0010) [2023-12-28 07:24:19,371][106225] Updated weights for policy 1, policy_version 1693731 (0.0010) [2023-12-28 07:24:19,608][106226] Updated weights for policy 0, policy_version 1689785 (0.0008) [2023-12-28 07:24:19,673][106226] Updated weights for policy 0, policy_version 1689795 (0.0007) [2023-12-28 07:24:19,741][106226] Updated weights for policy 0, policy_version 1689805 (0.0007) [2023-12-28 07:24:19,805][106226] Updated weights for policy 0, policy_version 1689815 (0.0007) [2023-12-28 07:24:20,088][106225] Updated weights for policy 1, policy_version 1693741 (0.0009) [2023-12-28 07:24:20,156][106225] Updated weights for policy 1, policy_version 1693751 (0.0006) [2023-12-28 07:24:20,218][106225] Updated weights for policy 1, policy_version 1693761 (0.0007) [2023-12-28 07:24:20,520][106226] Updated weights for policy 0, policy_version 1689825 (0.0007) [2023-12-28 07:24:20,586][106226] Updated weights for policy 0, policy_version 1689835 (0.0007) [2023-12-28 07:24:20,649][106226] Updated weights for policy 0, policy_version 1689845 (0.0008) [2023-12-28 07:24:20,965][106225] Updated weights for policy 1, policy_version 1693771 (0.0007) [2023-12-28 07:24:21,026][106225] Updated weights for policy 1, policy_version 1693781 (0.0007) [2023-12-28 07:24:21,088][106225] Updated weights for policy 1, policy_version 1693791 (0.0008) [2023-12-28 07:24:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 866344960. Throughput: 0: 9910.4, 1: 9936.6. Samples: 866352012. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:21,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.612')] [2023-12-28 07:24:21,389][106226] Updated weights for policy 0, policy_version 1689855 (0.0008) [2023-12-28 07:24:21,457][106226] Updated weights for policy 0, policy_version 1689865 (0.0008) [2023-12-28 07:24:21,523][106226] Updated weights for policy 0, policy_version 1689875 (0.0006) [2023-12-28 07:24:21,846][106225] Updated weights for policy 1, policy_version 1693801 (0.0009) [2023-12-28 07:24:21,912][106225] Updated weights for policy 1, policy_version 1693811 (0.0008) [2023-12-28 07:24:21,980][106225] Updated weights for policy 1, policy_version 1693821 (0.0009) [2023-12-28 07:24:22,036][106225] Updated weights for policy 1, policy_version 1693831 (0.0008) [2023-12-28 07:24:22,264][106226] Updated weights for policy 0, policy_version 1689885 (0.0007) [2023-12-28 07:24:22,324][106226] Updated weights for policy 0, policy_version 1689895 (0.0009) [2023-12-28 07:24:22,393][106226] Updated weights for policy 0, policy_version 1689905 (0.0009) [2023-12-28 07:24:22,723][106225] Updated weights for policy 1, policy_version 1693841 (0.0007) [2023-12-28 07:24:22,782][106225] Updated weights for policy 1, policy_version 1693851 (0.0008) [2023-12-28 07:24:22,846][106225] Updated weights for policy 1, policy_version 1693861 (0.0009) [2023-12-28 07:24:23,112][106226] Updated weights for policy 0, policy_version 1689915 (0.0007) [2023-12-28 07:24:23,171][106226] Updated weights for policy 0, policy_version 1689925 (0.0008) [2023-12-28 07:24:23,233][106226] Updated weights for policy 0, policy_version 1689935 (0.0009) [2023-12-28 07:24:23,509][106225] Updated weights for policy 1, policy_version 1693871 (0.0010) [2023-12-28 07:24:23,572][106225] Updated weights for policy 1, policy_version 1693881 (0.0010) [2023-12-28 07:24:23,618][106225] Updated weights for policy 1, policy_version 1693891 (0.0010) [2023-12-28 07:24:23,883][106226] Updated weights for policy 0, policy_version 1689945 (0.0008) [2023-12-28 07:24:23,949][106226] Updated weights for policy 0, policy_version 1689955 (0.0005) [2023-12-28 07:24:24,012][106226] Updated weights for policy 0, policy_version 1689965 (0.0005) [2023-12-28 07:24:24,073][106226] Updated weights for policy 0, policy_version 1689975 (0.0005) [2023-12-28 07:24:24,269][106225] Updated weights for policy 1, policy_version 1693901 (0.0009) [2023-12-28 07:24:24,334][106225] Updated weights for policy 1, policy_version 1693911 (0.0009) [2023-12-28 07:24:24,395][106225] Updated weights for policy 1, policy_version 1693921 (0.0008) [2023-12-28 07:24:24,634][106226] Updated weights for policy 0, policy_version 1689985 (0.0006) [2023-12-28 07:24:24,702][106226] Updated weights for policy 0, policy_version 1689995 (0.0005) [2023-12-28 07:24:24,768][106226] Updated weights for policy 0, policy_version 1690005 (0.0008) [2023-12-28 07:24:25,012][106225] Updated weights for policy 1, policy_version 1693931 (0.0007) [2023-12-28 07:24:25,061][106225] Updated weights for policy 1, policy_version 1693941 (0.0007) [2023-12-28 07:24:25,116][106225] Updated weights for policy 1, policy_version 1693951 (0.0006) [2023-12-28 07:24:25,273][106226] Updated weights for policy 0, policy_version 1690015 (0.0006) [2023-12-28 07:24:25,338][106226] Updated weights for policy 0, policy_version 1690025 (0.0006) [2023-12-28 07:24:25,394][106226] Updated weights for policy 0, policy_version 1690035 (0.0005) [2023-12-28 07:24:25,863][106225] Updated weights for policy 1, policy_version 1693961 (0.0006) [2023-12-28 07:24:25,913][106225] Updated weights for policy 1, policy_version 1693971 (0.0008) [2023-12-28 07:24:25,927][106226] Updated weights for policy 0, policy_version 1690045 (0.0006) [2023-12-28 07:24:25,968][106225] Updated weights for policy 1, policy_version 1693981 (0.0008) [2023-12-28 07:24:25,974][106226] Updated weights for policy 0, policy_version 1690055 (0.0007) [2023-12-28 07:24:26,016][106225] Updated weights for policy 1, policy_version 1693991 (0.0005) [2023-12-28 07:24:26,022][106226] Updated weights for policy 0, policy_version 1690065 (0.0006) [2023-12-28 07:24:26,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 866451456. Throughput: 0: 9903.8, 1: 9844.7. Samples: 866410556. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:26,175][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.901')] [2023-12-28 07:24:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001693992_433717248.pth... [2023-12-28 07:24:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001690072_432734208.pth... [2023-12-28 07:24:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001692840_433422336.pth [2023-12-28 07:24:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001688888_432431104.pth [2023-12-28 07:24:26,746][106226] Updated weights for policy 0, policy_version 1690075 (0.0009) [2023-12-28 07:24:26,759][106225] Updated weights for policy 1, policy_version 1694001 (0.0006) [2023-12-28 07:24:26,795][106226] Updated weights for policy 0, policy_version 1690085 (0.0010) [2023-12-28 07:24:26,809][106225] Updated weights for policy 1, policy_version 1694011 (0.0005) [2023-12-28 07:24:26,842][106226] Updated weights for policy 0, policy_version 1690095 (0.0010) [2023-12-28 07:24:26,855][106225] Updated weights for policy 1, policy_version 1694021 (0.0005) [2023-12-28 07:24:27,522][106226] Updated weights for policy 0, policy_version 1690105 (0.0010) [2023-12-28 07:24:27,525][106225] Updated weights for policy 1, policy_version 1694031 (0.0005) [2023-12-28 07:24:27,571][106226] Updated weights for policy 0, policy_version 1690115 (0.0010) [2023-12-28 07:24:27,578][106225] Updated weights for policy 1, policy_version 1694041 (0.0005) [2023-12-28 07:24:27,625][106226] Updated weights for policy 0, policy_version 1690125 (0.0010) [2023-12-28 07:24:27,627][106225] Updated weights for policy 1, policy_version 1694051 (0.0006) [2023-12-28 07:24:27,690][106226] Updated weights for policy 0, policy_version 1690135 (0.0010) [2023-12-28 07:24:28,344][106226] Updated weights for policy 0, policy_version 1690145 (0.0008) [2023-12-28 07:24:28,364][106225] Updated weights for policy 1, policy_version 1694061 (0.0008) [2023-12-28 07:24:28,410][106226] Updated weights for policy 0, policy_version 1690155 (0.0009) [2023-12-28 07:24:28,423][106225] Updated weights for policy 1, policy_version 1694071 (0.0006) [2023-12-28 07:24:28,477][106226] Updated weights for policy 0, policy_version 1690165 (0.0007) [2023-12-28 07:24:28,491][106225] Updated weights for policy 1, policy_version 1694081 (0.0005) [2023-12-28 07:24:29,031][106226] Updated weights for policy 0, policy_version 1690175 (0.0010) [2023-12-28 07:24:29,055][106225] Updated weights for policy 1, policy_version 1694091 (0.0006) [2023-12-28 07:24:29,090][106226] Updated weights for policy 0, policy_version 1690185 (0.0010) [2023-12-28 07:24:29,107][106225] Updated weights for policy 1, policy_version 1694101 (0.0006) [2023-12-28 07:24:29,153][106226] Updated weights for policy 0, policy_version 1690195 (0.0010) [2023-12-28 07:24:29,157][106225] Updated weights for policy 1, policy_version 1694111 (0.0005) [2023-12-28 07:24:29,891][106226] Updated weights for policy 0, policy_version 1690205 (0.0010) [2023-12-28 07:24:29,909][106225] Updated weights for policy 1, policy_version 1694121 (0.0006) [2023-12-28 07:24:29,967][106226] Updated weights for policy 0, policy_version 1690215 (0.0010) [2023-12-28 07:24:29,973][106225] Updated weights for policy 1, policy_version 1694131 (0.0008) [2023-12-28 07:24:30,021][106226] Updated weights for policy 0, policy_version 1690225 (0.0010) [2023-12-28 07:24:30,031][106225] Updated weights for policy 1, policy_version 1694141 (0.0008) [2023-12-28 07:24:30,093][106225] Updated weights for policy 1, policy_version 1694151 (0.0007) [2023-12-28 07:24:30,766][106226] Updated weights for policy 0, policy_version 1690235 (0.0010) [2023-12-28 07:24:30,815][106226] Updated weights for policy 0, policy_version 1690245 (0.0010) [2023-12-28 07:24:30,840][106225] Updated weights for policy 1, policy_version 1694161 (0.0006) [2023-12-28 07:24:30,861][106226] Updated weights for policy 0, policy_version 1690255 (0.0010) [2023-12-28 07:24:30,893][106225] Updated weights for policy 1, policy_version 1694171 (0.0006) [2023-12-28 07:24:30,949][106225] Updated weights for policy 1, policy_version 1694181 (0.0008) [2023-12-28 07:24:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 866549760. Throughput: 0: 10036.7, 1: 9898.0. Samples: 866536644. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:31,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.802')] [2023-12-28 07:24:31,601][106226] Updated weights for policy 0, policy_version 1690265 (0.0010) [2023-12-28 07:24:31,635][106225] Updated weights for policy 1, policy_version 1694191 (0.0007) [2023-12-28 07:24:31,670][106226] Updated weights for policy 0, policy_version 1690275 (0.0010) [2023-12-28 07:24:31,696][106225] Updated weights for policy 1, policy_version 1694201 (0.0007) [2023-12-28 07:24:31,738][106226] Updated weights for policy 0, policy_version 1690285 (0.0009) [2023-12-28 07:24:31,761][106225] Updated weights for policy 1, policy_version 1694211 (0.0008) [2023-12-28 07:24:31,798][106226] Updated weights for policy 0, policy_version 1690295 (0.0008) [2023-12-28 07:24:32,390][106225] Updated weights for policy 1, policy_version 1694221 (0.0007) [2023-12-28 07:24:32,448][106225] Updated weights for policy 1, policy_version 1694231 (0.0009) [2023-12-28 07:24:32,511][106225] Updated weights for policy 1, policy_version 1694241 (0.0008) [2023-12-28 07:24:32,588][106226] Updated weights for policy 0, policy_version 1690305 (0.0009) [2023-12-28 07:24:32,648][106226] Updated weights for policy 0, policy_version 1690315 (0.0009) [2023-12-28 07:24:32,703][106226] Updated weights for policy 0, policy_version 1690325 (0.0009) [2023-12-28 07:24:33,250][106225] Updated weights for policy 1, policy_version 1694251 (0.0009) [2023-12-28 07:24:33,276][106226] Updated weights for policy 0, policy_version 1690335 (0.0007) [2023-12-28 07:24:33,302][106225] Updated weights for policy 1, policy_version 1694261 (0.0006) [2023-12-28 07:24:33,334][106226] Updated weights for policy 0, policy_version 1690345 (0.0008) [2023-12-28 07:24:33,351][106225] Updated weights for policy 1, policy_version 1694271 (0.0006) [2023-12-28 07:24:33,392][106226] Updated weights for policy 0, policy_version 1690355 (0.0008) [2023-12-28 07:24:33,990][106226] Updated weights for policy 0, policy_version 1690365 (0.0009) [2023-12-28 07:24:34,046][106226] Updated weights for policy 0, policy_version 1690375 (0.0009) [2023-12-28 07:24:34,101][106226] Updated weights for policy 0, policy_version 1690385 (0.0009) [2023-12-28 07:24:34,148][106225] Updated weights for policy 1, policy_version 1694281 (0.0007) [2023-12-28 07:24:34,210][106225] Updated weights for policy 1, policy_version 1694291 (0.0009) [2023-12-28 07:24:34,265][106225] Updated weights for policy 1, policy_version 1694301 (0.0009) [2023-12-28 07:24:34,321][106225] Updated weights for policy 1, policy_version 1694311 (0.0008) [2023-12-28 07:24:34,797][106226] Updated weights for policy 0, policy_version 1690395 (0.0008) [2023-12-28 07:24:34,847][106226] Updated weights for policy 0, policy_version 1690405 (0.0009) [2023-12-28 07:24:34,895][106226] Updated weights for policy 0, policy_version 1690415 (0.0008) [2023-12-28 07:24:35,122][106225] Updated weights for policy 1, policy_version 1694321 (0.0007) [2023-12-28 07:24:35,179][106225] Updated weights for policy 1, policy_version 1694331 (0.0008) [2023-12-28 07:24:35,240][106225] Updated weights for policy 1, policy_version 1694341 (0.0009) [2023-12-28 07:24:35,534][106226] Updated weights for policy 0, policy_version 1690425 (0.0010) [2023-12-28 07:24:35,599][106226] Updated weights for policy 0, policy_version 1690435 (0.0010) [2023-12-28 07:24:35,665][106226] Updated weights for policy 0, policy_version 1690445 (0.0010) [2023-12-28 07:24:35,727][106226] Updated weights for policy 0, policy_version 1690455 (0.0011) [2023-12-28 07:24:36,001][106225] Updated weights for policy 1, policy_version 1694351 (0.0007) [2023-12-28 07:24:36,050][106225] Updated weights for policy 1, policy_version 1694361 (0.0007) [2023-12-28 07:24:36,124][106225] Updated weights for policy 1, policy_version 1694371 (0.0007) [2023-12-28 07:24:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 866648064. Throughput: 0: 10094.1, 1: 9825.8. Samples: 866655144. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:36,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.996')] [2023-12-28 07:24:36,394][106226] Updated weights for policy 0, policy_version 1690465 (0.0011) [2023-12-28 07:24:36,457][106226] Updated weights for policy 0, policy_version 1690475 (0.0007) [2023-12-28 07:24:36,523][106226] Updated weights for policy 0, policy_version 1690485 (0.0009) [2023-12-28 07:24:36,860][106225] Updated weights for policy 1, policy_version 1694381 (0.0008) [2023-12-28 07:24:36,916][106225] Updated weights for policy 1, policy_version 1694391 (0.0008) [2023-12-28 07:24:36,972][106225] Updated weights for policy 1, policy_version 1694401 (0.0008) [2023-12-28 07:24:37,259][106226] Updated weights for policy 0, policy_version 1690495 (0.0010) [2023-12-28 07:24:37,322][106226] Updated weights for policy 0, policy_version 1690505 (0.0009) [2023-12-28 07:24:37,388][106226] Updated weights for policy 0, policy_version 1690515 (0.0009) [2023-12-28 07:24:37,660][106225] Updated weights for policy 1, policy_version 1694411 (0.0007) [2023-12-28 07:24:37,721][106225] Updated weights for policy 1, policy_version 1694421 (0.0009) [2023-12-28 07:24:37,781][106225] Updated weights for policy 1, policy_version 1694431 (0.0009) [2023-12-28 07:24:38,123][106226] Updated weights for policy 0, policy_version 1690525 (0.0009) [2023-12-28 07:24:38,183][106226] Updated weights for policy 0, policy_version 1690535 (0.0011) [2023-12-28 07:24:38,244][106226] Updated weights for policy 0, policy_version 1690545 (0.0005) [2023-12-28 07:24:38,497][106225] Updated weights for policy 1, policy_version 1694441 (0.0008) [2023-12-28 07:24:38,560][106225] Updated weights for policy 1, policy_version 1694451 (0.0006) [2023-12-28 07:24:38,624][106225] Updated weights for policy 1, policy_version 1694461 (0.0007) [2023-12-28 07:24:38,684][106225] Updated weights for policy 1, policy_version 1694471 (0.0008) [2023-12-28 07:24:38,896][106226] Updated weights for policy 0, policy_version 1690555 (0.0007) [2023-12-28 07:24:38,957][106226] Updated weights for policy 0, policy_version 1690565 (0.0011) [2023-12-28 07:24:39,007][106226] Updated weights for policy 0, policy_version 1690575 (0.0011) [2023-12-28 07:24:39,399][106225] Updated weights for policy 1, policy_version 1694481 (0.0010) [2023-12-28 07:24:39,458][106225] Updated weights for policy 1, policy_version 1694491 (0.0008) [2023-12-28 07:24:39,520][106225] Updated weights for policy 1, policy_version 1694501 (0.0011) [2023-12-28 07:24:39,780][106226] Updated weights for policy 0, policy_version 1690585 (0.0010) [2023-12-28 07:24:39,857][106226] Updated weights for policy 0, policy_version 1690595 (0.0009) [2023-12-28 07:24:39,926][106226] Updated weights for policy 0, policy_version 1690605 (0.0008) [2023-12-28 07:24:39,992][106226] Updated weights for policy 0, policy_version 1690615 (0.0007) [2023-12-28 07:24:40,333][106225] Updated weights for policy 1, policy_version 1694511 (0.0007) [2023-12-28 07:24:40,401][106225] Updated weights for policy 1, policy_version 1694521 (0.0007) [2023-12-28 07:24:40,465][106225] Updated weights for policy 1, policy_version 1694531 (0.0007) [2023-12-28 07:24:40,811][106226] Updated weights for policy 0, policy_version 1690625 (0.0009) [2023-12-28 07:24:40,863][106226] Updated weights for policy 0, policy_version 1690635 (0.0010) [2023-12-28 07:24:40,913][106226] Updated weights for policy 0, policy_version 1690645 (0.0011) [2023-12-28 07:24:41,069][106225] Updated weights for policy 1, policy_version 1694541 (0.0010) [2023-12-28 07:24:41,129][106225] Updated weights for policy 1, policy_version 1694551 (0.0007) [2023-12-28 07:24:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 866738176. Throughput: 0: 10070.6, 1: 9836.9. Samples: 866712888. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:41,175][105115] Avg episode reward: [(0, '-4.297'), (1, '-4.792')] [2023-12-28 07:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001690648_432881664.pth... [2023-12-28 07:24:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001689464_432578560.pth [2023-12-28 07:24:41,199][106225] Updated weights for policy 1, policy_version 1694561 (0.0007) [2023-12-28 07:24:41,232][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001694568_433864704.pth... [2023-12-28 07:24:41,235][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001693384_433561600.pth [2023-12-28 07:24:41,695][106226] Updated weights for policy 0, policy_version 1690655 (0.0009) [2023-12-28 07:24:41,767][106226] Updated weights for policy 0, policy_version 1690665 (0.0008) [2023-12-28 07:24:41,837][106226] Updated weights for policy 0, policy_version 1690675 (0.0008) [2023-12-28 07:24:41,923][106225] Updated weights for policy 1, policy_version 1694571 (0.0007) [2023-12-28 07:24:41,977][106225] Updated weights for policy 1, policy_version 1694581 (0.0008) [2023-12-28 07:24:42,031][106225] Updated weights for policy 1, policy_version 1694591 (0.0009) [2023-12-28 07:24:42,618][106226] Updated weights for policy 0, policy_version 1690685 (0.0009) [2023-12-28 07:24:42,678][106226] Updated weights for policy 0, policy_version 1690695 (0.0008) [2023-12-28 07:24:42,731][106226] Updated weights for policy 0, policy_version 1690705 (0.0009) [2023-12-28 07:24:42,781][106225] Updated weights for policy 1, policy_version 1694601 (0.0008) [2023-12-28 07:24:42,837][106225] Updated weights for policy 1, policy_version 1694611 (0.0009) [2023-12-28 07:24:42,900][106225] Updated weights for policy 1, policy_version 1694621 (0.0008) [2023-12-28 07:24:42,953][106225] Updated weights for policy 1, policy_version 1694631 (0.0009) [2023-12-28 07:24:43,449][106226] Updated weights for policy 0, policy_version 1690715 (0.0008) [2023-12-28 07:24:43,516][106226] Updated weights for policy 0, policy_version 1690725 (0.0005) [2023-12-28 07:24:43,586][106226] Updated weights for policy 0, policy_version 1690735 (0.0005) [2023-12-28 07:24:43,736][106225] Updated weights for policy 1, policy_version 1694641 (0.0007) [2023-12-28 07:24:43,783][106225] Updated weights for policy 1, policy_version 1694651 (0.0007) [2023-12-28 07:24:43,834][106225] Updated weights for policy 1, policy_version 1694661 (0.0005) [2023-12-28 07:24:44,139][106226] Updated weights for policy 0, policy_version 1690745 (0.0005) [2023-12-28 07:24:44,205][106226] Updated weights for policy 0, policy_version 1690755 (0.0006) [2023-12-28 07:24:44,272][106226] Updated weights for policy 0, policy_version 1690765 (0.0005) [2023-12-28 07:24:44,341][106226] Updated weights for policy 0, policy_version 1690775 (0.0005) [2023-12-28 07:24:44,547][106225] Updated weights for policy 1, policy_version 1694671 (0.0008) [2023-12-28 07:24:44,598][106225] Updated weights for policy 1, policy_version 1694681 (0.0008) [2023-12-28 07:24:44,657][106225] Updated weights for policy 1, policy_version 1694691 (0.0008) [2023-12-28 07:24:44,957][106226] Updated weights for policy 0, policy_version 1690785 (0.0010) [2023-12-28 07:24:45,024][106226] Updated weights for policy 0, policy_version 1690795 (0.0011) [2023-12-28 07:24:45,092][106226] Updated weights for policy 0, policy_version 1690805 (0.0011) [2023-12-28 07:24:45,419][106225] Updated weights for policy 1, policy_version 1694701 (0.0009) [2023-12-28 07:24:45,472][106225] Updated weights for policy 1, policy_version 1694711 (0.0010) [2023-12-28 07:24:45,525][106225] Updated weights for policy 1, policy_version 1694721 (0.0010) [2023-12-28 07:24:45,781][106226] Updated weights for policy 0, policy_version 1690815 (0.0011) [2023-12-28 07:24:45,834][106226] Updated weights for policy 0, policy_version 1690825 (0.0010) [2023-12-28 07:24:45,886][106226] Updated weights for policy 0, policy_version 1690835 (0.0005) [2023-12-28 07:24:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 866836480. Throughput: 0: 10056.3, 1: 9777.8. Samples: 866827304. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:46,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.837')] [2023-12-28 07:24:46,250][106225] Updated weights for policy 1, policy_version 1694731 (0.0010) [2023-12-28 07:24:46,306][106225] Updated weights for policy 1, policy_version 1694741 (0.0010) [2023-12-28 07:24:46,362][106225] Updated weights for policy 1, policy_version 1694751 (0.0010) [2023-12-28 07:24:46,516][106226] Updated weights for policy 0, policy_version 1690845 (0.0008) [2023-12-28 07:24:46,578][106226] Updated weights for policy 0, policy_version 1690855 (0.0010) [2023-12-28 07:24:46,638][106226] Updated weights for policy 0, policy_version 1690865 (0.0010) [2023-12-28 07:24:46,966][106225] Updated weights for policy 1, policy_version 1694761 (0.0010) [2023-12-28 07:24:47,022][106225] Updated weights for policy 1, policy_version 1694771 (0.0005) [2023-12-28 07:24:47,074][106225] Updated weights for policy 1, policy_version 1694781 (0.0006) [2023-12-28 07:24:47,124][106225] Updated weights for policy 1, policy_version 1694791 (0.0008) [2023-12-28 07:24:47,283][106226] Updated weights for policy 0, policy_version 1690875 (0.0009) [2023-12-28 07:24:47,336][106226] Updated weights for policy 0, policy_version 1690885 (0.0005) [2023-12-28 07:24:47,385][106226] Updated weights for policy 0, policy_version 1690895 (0.0010) [2023-12-28 07:24:47,883][106225] Updated weights for policy 1, policy_version 1694801 (0.0009) [2023-12-28 07:24:47,935][106226] Updated weights for policy 0, policy_version 1690905 (0.0010) [2023-12-28 07:24:47,943][106225] Updated weights for policy 1, policy_version 1694811 (0.0009) [2023-12-28 07:24:48,002][106226] Updated weights for policy 0, policy_version 1690915 (0.0010) [2023-12-28 07:24:48,005][106225] Updated weights for policy 1, policy_version 1694821 (0.0007) [2023-12-28 07:24:48,067][106226] Updated weights for policy 0, policy_version 1690926 (0.0010) [2023-12-28 07:24:48,124][106226] Updated weights for policy 0, policy_version 1690936 (0.0010) [2023-12-28 07:24:48,713][106225] Updated weights for policy 1, policy_version 1694831 (0.0008) [2023-12-28 07:24:48,780][106225] Updated weights for policy 1, policy_version 1694841 (0.0008) [2023-12-28 07:24:48,846][106225] Updated weights for policy 1, policy_version 1694851 (0.0008) [2023-12-28 07:24:48,846][106226] Updated weights for policy 0, policy_version 1690946 (0.0011) [2023-12-28 07:24:48,905][106226] Updated weights for policy 0, policy_version 1690956 (0.0011) [2023-12-28 07:24:48,966][106226] Updated weights for policy 0, policy_version 1690966 (0.0010) [2023-12-28 07:24:49,570][106225] Updated weights for policy 1, policy_version 1694861 (0.0008) [2023-12-28 07:24:49,628][106225] Updated weights for policy 1, policy_version 1694871 (0.0007) [2023-12-28 07:24:49,675][106226] Updated weights for policy 0, policy_version 1690976 (0.0011) [2023-12-28 07:24:49,681][106225] Updated weights for policy 1, policy_version 1694881 (0.0008) [2023-12-28 07:24:49,736][106226] Updated weights for policy 0, policy_version 1690986 (0.0010) [2023-12-28 07:24:49,801][106226] Updated weights for policy 0, policy_version 1690996 (0.0010) [2023-12-28 07:24:50,432][106225] Updated weights for policy 1, policy_version 1694891 (0.0006) [2023-12-28 07:24:50,496][106225] Updated weights for policy 1, policy_version 1694901 (0.0008) [2023-12-28 07:24:50,553][106225] Updated weights for policy 1, policy_version 1694911 (0.0008) [2023-12-28 07:24:50,584][106226] Updated weights for policy 0, policy_version 1691006 (0.0009) [2023-12-28 07:24:50,644][106140] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000008 [2023-12-28 07:24:50,646][106226] Updated weights for policy 0, policy_version 1691016 (0.0008) [2023-12-28 07:24:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 866934784. Throughput: 0: 10055.9, 1: 9792.1. Samples: 866945904. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:51,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.871')] [2023-12-28 07:24:51,327][106225] Updated weights for policy 1, policy_version 1694921 (0.0006) [2023-12-28 07:24:51,404][106225] Updated weights for policy 1, policy_version 1694931 (0.0008) [2023-12-28 07:24:51,465][106225] Updated weights for policy 1, policy_version 1694941 (0.0007) [2023-12-28 07:24:51,483][106226] Updated weights for policy 0, policy_version 1691026 (0.0011) [2023-12-28 07:24:51,525][106225] Updated weights for policy 1, policy_version 1694951 (0.0006) [2023-12-28 07:24:51,548][106226] Updated weights for policy 0, policy_version 1691036 (0.0011) [2023-12-28 07:24:51,614][106226] Updated weights for policy 0, policy_version 1691046 (0.0011) [2023-12-28 07:24:52,298][106226] Updated weights for policy 0, policy_version 1691056 (0.0011) [2023-12-28 07:24:52,311][106225] Updated weights for policy 1, policy_version 1694961 (0.0007) [2023-12-28 07:24:52,353][106226] Updated weights for policy 0, policy_version 1691066 (0.0011) [2023-12-28 07:24:52,377][106225] Updated weights for policy 1, policy_version 1694971 (0.0008) [2023-12-28 07:24:52,422][106226] Updated weights for policy 0, policy_version 1691076 (0.0007) [2023-12-28 07:24:52,436][106225] Updated weights for policy 1, policy_version 1694981 (0.0008) [2023-12-28 07:24:53,113][106226] Updated weights for policy 0, policy_version 1691086 (0.0007) [2023-12-28 07:24:53,146][106225] Updated weights for policy 1, policy_version 1694991 (0.0007) [2023-12-28 07:24:53,179][106226] Updated weights for policy 0, policy_version 1691096 (0.0008) [2023-12-28 07:24:53,203][106225] Updated weights for policy 1, policy_version 1695001 (0.0007) [2023-12-28 07:24:53,229][106226] Updated weights for policy 0, policy_version 1691106 (0.0006) [2023-12-28 07:24:53,255][106225] Updated weights for policy 1, policy_version 1695011 (0.0008) [2023-12-28 07:24:53,845][106225] Updated weights for policy 1, policy_version 1695021 (0.0005) [2023-12-28 07:24:53,895][106225] Updated weights for policy 1, policy_version 1695031 (0.0005) [2023-12-28 07:24:53,954][106225] Updated weights for policy 1, policy_version 1695041 (0.0005) [2023-12-28 07:24:54,005][106226] Updated weights for policy 0, policy_version 1691116 (0.0007) [2023-12-28 07:24:54,051][106226] Updated weights for policy 0, policy_version 1691126 (0.0007) [2023-12-28 07:24:54,101][106226] Updated weights for policy 0, policy_version 1691136 (0.0008) [2023-12-28 07:24:54,502][106225] Updated weights for policy 1, policy_version 1695051 (0.0006) [2023-12-28 07:24:54,562][106225] Updated weights for policy 1, policy_version 1695061 (0.0007) [2023-12-28 07:24:54,611][106225] Updated weights for policy 1, policy_version 1695071 (0.0009) [2023-12-28 07:24:54,921][106226] Updated weights for policy 0, policy_version 1691146 (0.0009) [2023-12-28 07:24:54,974][106226] Updated weights for policy 0, policy_version 1691156 (0.0008) [2023-12-28 07:24:55,030][106226] Updated weights for policy 0, policy_version 1691166 (0.0008) [2023-12-28 07:24:55,080][106226] Updated weights for policy 0, policy_version 1691176 (0.0008) [2023-12-28 07:24:55,275][106225] Updated weights for policy 1, policy_version 1695081 (0.0010) [2023-12-28 07:24:55,324][106225] Updated weights for policy 1, policy_version 1695091 (0.0010) [2023-12-28 07:24:55,375][106225] Updated weights for policy 1, policy_version 1695101 (0.0006) [2023-12-28 07:24:55,420][106225] Updated weights for policy 1, policy_version 1695111 (0.0005) [2023-12-28 07:24:55,848][106226] Updated weights for policy 0, policy_version 1691186 (0.0008) [2023-12-28 07:24:55,908][106226] Updated weights for policy 0, policy_version 1691196 (0.0008) [2023-12-28 07:24:55,958][106226] Updated weights for policy 0, policy_version 1691206 (0.0010) [2023-12-28 07:24:56,109][106225] Updated weights for policy 1, policy_version 1695121 (0.0009) [2023-12-28 07:24:56,155][106225] Updated weights for policy 1, policy_version 1695131 (0.0010) [2023-12-28 07:24:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 867033088. Throughput: 0: 10015.2, 1: 9795.6. Samples: 867003248. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:24:56,175][105115] Avg episode reward: [(0, '-4.386'), (1, '-4.735')] [2023-12-28 07:24:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001691208_433029120.pth... [2023-12-28 07:24:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001690072_432734208.pth [2023-12-28 07:24:56,212][106225] Updated weights for policy 1, policy_version 1695141 (0.0010) [2023-12-28 07:24:56,228][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001695144_434012160.pth... [2023-12-28 07:24:56,232][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001693992_433717248.pth [2023-12-28 07:24:56,649][106226] Updated weights for policy 0, policy_version 1691216 (0.0009) [2023-12-28 07:24:56,705][106226] Updated weights for policy 0, policy_version 1691226 (0.0008) [2023-12-28 07:24:56,763][106226] Updated weights for policy 0, policy_version 1691236 (0.0005) [2023-12-28 07:24:56,952][106225] Updated weights for policy 1, policy_version 1695151 (0.0009) [2023-12-28 07:24:57,005][106225] Updated weights for policy 1, policy_version 1695161 (0.0006) [2023-12-28 07:24:57,058][106225] Updated weights for policy 1, policy_version 1695171 (0.0008) [2023-12-28 07:24:57,357][106226] Updated weights for policy 0, policy_version 1691246 (0.0006) [2023-12-28 07:24:57,409][106226] Updated weights for policy 0, policy_version 1691256 (0.0005) [2023-12-28 07:24:57,462][106226] Updated weights for policy 0, policy_version 1691266 (0.0009) [2023-12-28 07:24:57,610][106225] Updated weights for policy 1, policy_version 1695181 (0.0008) [2023-12-28 07:24:57,654][106225] Updated weights for policy 1, policy_version 1695191 (0.0009) [2023-12-28 07:24:57,706][106225] Updated weights for policy 1, policy_version 1695201 (0.0007) [2023-12-28 07:24:58,037][106226] Updated weights for policy 0, policy_version 1691276 (0.0010) [2023-12-28 07:24:58,093][106226] Updated weights for policy 0, policy_version 1691286 (0.0010) [2023-12-28 07:24:58,150][106226] Updated weights for policy 0, policy_version 1691296 (0.0010) [2023-12-28 07:24:58,414][106225] Updated weights for policy 1, policy_version 1695211 (0.0007) [2023-12-28 07:24:58,479][106225] Updated weights for policy 1, policy_version 1695221 (0.0010) [2023-12-28 07:24:58,540][106225] Updated weights for policy 1, policy_version 1695231 (0.0011) [2023-12-28 07:24:58,986][106226] Updated weights for policy 0, policy_version 1691306 (0.0010) [2023-12-28 07:24:59,040][106226] Updated weights for policy 0, policy_version 1691316 (0.0009) [2023-12-28 07:24:59,097][106226] Updated weights for policy 0, policy_version 1691326 (0.0007) [2023-12-28 07:24:59,161][106226] Updated weights for policy 0, policy_version 1691336 (0.0006) [2023-12-28 07:24:59,383][106225] Updated weights for policy 1, policy_version 1695241 (0.0010) [2023-12-28 07:24:59,445][106225] Updated weights for policy 1, policy_version 1695251 (0.0008) [2023-12-28 07:24:59,500][106225] Updated weights for policy 1, policy_version 1695261 (0.0007) [2023-12-28 07:24:59,556][106225] Updated weights for policy 1, policy_version 1695271 (0.0008) [2023-12-28 07:24:59,946][106226] Updated weights for policy 0, policy_version 1691346 (0.0011) [2023-12-28 07:25:00,005][106226] Updated weights for policy 0, policy_version 1691356 (0.0011) [2023-12-28 07:25:00,064][106226] Updated weights for policy 0, policy_version 1691366 (0.0010) [2023-12-28 07:25:00,304][106225] Updated weights for policy 1, policy_version 1695281 (0.0008) [2023-12-28 07:25:00,351][106225] Updated weights for policy 1, policy_version 1695291 (0.0007) [2023-12-28 07:25:00,398][106225] Updated weights for policy 1, policy_version 1695301 (0.0007) [2023-12-28 07:25:00,785][106226] Updated weights for policy 0, policy_version 1691376 (0.0011) [2023-12-28 07:25:00,848][106226] Updated weights for policy 0, policy_version 1691386 (0.0011) [2023-12-28 07:25:00,907][106226] Updated weights for policy 0, policy_version 1691396 (0.0010) [2023-12-28 07:25:01,161][106225] Updated weights for policy 1, policy_version 1695311 (0.0008) [2023-12-28 07:25:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 867131392. Throughput: 0: 9983.0, 1: 9855.0. Samples: 867123032. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:01,175][105115] Avg episode reward: [(0, '-4.197'), (1, '-4.693')] [2023-12-28 07:25:01,228][106225] Updated weights for policy 1, policy_version 1695321 (0.0009) [2023-12-28 07:25:01,296][106225] Updated weights for policy 1, policy_version 1695331 (0.0009) [2023-12-28 07:25:01,653][106226] Updated weights for policy 0, policy_version 1691406 (0.0009) [2023-12-28 07:25:01,718][106226] Updated weights for policy 0, policy_version 1691416 (0.0009) [2023-12-28 07:25:01,773][106226] Updated weights for policy 0, policy_version 1691426 (0.0006) [2023-12-28 07:25:02,073][106225] Updated weights for policy 1, policy_version 1695341 (0.0009) [2023-12-28 07:25:02,126][106225] Updated weights for policy 1, policy_version 1695351 (0.0007) [2023-12-28 07:25:02,184][106225] Updated weights for policy 1, policy_version 1695361 (0.0008) [2023-12-28 07:25:02,380][106226] Updated weights for policy 0, policy_version 1691436 (0.0006) [2023-12-28 07:25:02,446][106226] Updated weights for policy 0, policy_version 1691446 (0.0010) [2023-12-28 07:25:02,518][106226] Updated weights for policy 0, policy_version 1691456 (0.0011) [2023-12-28 07:25:02,842][106225] Updated weights for policy 1, policy_version 1695371 (0.0007) [2023-12-28 07:25:02,894][106225] Updated weights for policy 1, policy_version 1695381 (0.0005) [2023-12-28 07:25:02,937][106225] Updated weights for policy 1, policy_version 1695391 (0.0005) [2023-12-28 07:25:03,271][106226] Updated weights for policy 0, policy_version 1691466 (0.0009) [2023-12-28 07:25:03,334][106226] Updated weights for policy 0, policy_version 1691476 (0.0009) [2023-12-28 07:25:03,395][106226] Updated weights for policy 0, policy_version 1691486 (0.0008) [2023-12-28 07:25:03,445][106226] Updated weights for policy 0, policy_version 1691496 (0.0009) [2023-12-28 07:25:03,459][106225] Updated weights for policy 1, policy_version 1695401 (0.0006) [2023-12-28 07:25:03,514][106225] Updated weights for policy 1, policy_version 1695411 (0.0005) [2023-12-28 07:25:03,568][106225] Updated weights for policy 1, policy_version 1695421 (0.0005) [2023-12-28 07:25:03,613][106225] Updated weights for policy 1, policy_version 1695431 (0.0005) [2023-12-28 07:25:04,247][106226] Updated weights for policy 0, policy_version 1691506 (0.0009) [2023-12-28 07:25:04,314][106225] Updated weights for policy 1, policy_version 1695441 (0.0008) [2023-12-28 07:25:04,316][106226] Updated weights for policy 0, policy_version 1691516 (0.0006) [2023-12-28 07:25:04,376][106225] Updated weights for policy 1, policy_version 1695451 (0.0008) [2023-12-28 07:25:04,377][106226] Updated weights for policy 0, policy_version 1691526 (0.0006) [2023-12-28 07:25:04,428][106225] Updated weights for policy 1, policy_version 1695461 (0.0008) [2023-12-28 07:25:04,973][106226] Updated weights for policy 0, policy_version 1691536 (0.0007) [2023-12-28 07:25:05,021][106226] Updated weights for policy 0, policy_version 1691546 (0.0009) [2023-12-28 07:25:05,041][106225] Updated weights for policy 1, policy_version 1695471 (0.0006) [2023-12-28 07:25:05,075][106226] Updated weights for policy 0, policy_version 1691556 (0.0009) [2023-12-28 07:25:05,094][106225] Updated weights for policy 1, policy_version 1695481 (0.0007) [2023-12-28 07:25:05,156][106225] Updated weights for policy 1, policy_version 1695491 (0.0006) [2023-12-28 07:25:05,781][106225] Updated weights for policy 1, policy_version 1695501 (0.0005) [2023-12-28 07:25:05,838][106225] Updated weights for policy 1, policy_version 1695511 (0.0005) [2023-12-28 07:25:05,875][106226] Updated weights for policy 0, policy_version 1691566 (0.0009) [2023-12-28 07:25:05,890][106225] Updated weights for policy 1, policy_version 1695521 (0.0006) [2023-12-28 07:25:05,934][106226] Updated weights for policy 0, policy_version 1691576 (0.0008) [2023-12-28 07:25:05,996][106226] Updated weights for policy 0, policy_version 1691586 (0.0008) [2023-12-28 07:25:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 867237888. Throughput: 0: 9926.7, 1: 9872.4. Samples: 867242972. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:06,175][105115] Avg episode reward: [(0, '-4.278'), (1, '-4.917')] [2023-12-28 07:25:06,572][106225] Updated weights for policy 1, policy_version 1695531 (0.0007) [2023-12-28 07:25:06,633][106225] Updated weights for policy 1, policy_version 1695541 (0.0008) [2023-12-28 07:25:06,687][106225] Updated weights for policy 1, policy_version 1695551 (0.0008) [2023-12-28 07:25:06,763][106226] Updated weights for policy 0, policy_version 1691596 (0.0007) [2023-12-28 07:25:06,819][106226] Updated weights for policy 0, policy_version 1691606 (0.0007) [2023-12-28 07:25:06,866][106226] Updated weights for policy 0, policy_version 1691616 (0.0009) [2023-12-28 07:25:07,340][106225] Updated weights for policy 1, policy_version 1695561 (0.0008) [2023-12-28 07:25:07,406][106225] Updated weights for policy 1, policy_version 1695571 (0.0006) [2023-12-28 07:25:07,468][106225] Updated weights for policy 1, policy_version 1695581 (0.0006) [2023-12-28 07:25:07,516][106225] Updated weights for policy 1, policy_version 1695591 (0.0007) [2023-12-28 07:25:07,645][106226] Updated weights for policy 0, policy_version 1691626 (0.0008) [2023-12-28 07:25:07,698][106226] Updated weights for policy 0, policy_version 1691636 (0.0005) [2023-12-28 07:25:07,759][106226] Updated weights for policy 0, policy_version 1691646 (0.0005) [2023-12-28 07:25:07,813][106226] Updated weights for policy 0, policy_version 1691656 (0.0008) [2023-12-28 07:25:08,111][106225] Updated weights for policy 1, policy_version 1695601 (0.0005) [2023-12-28 07:25:08,161][106225] Updated weights for policy 1, policy_version 1695611 (0.0006) [2023-12-28 07:25:08,220][106225] Updated weights for policy 1, policy_version 1695621 (0.0009) [2023-12-28 07:25:08,474][106226] Updated weights for policy 0, policy_version 1691666 (0.0007) [2023-12-28 07:25:08,531][106226] Updated weights for policy 0, policy_version 1691676 (0.0009) [2023-12-28 07:25:08,595][106226] Updated weights for policy 0, policy_version 1691686 (0.0010) [2023-12-28 07:25:09,001][106225] Updated weights for policy 1, policy_version 1695631 (0.0006) [2023-12-28 07:25:09,056][106225] Updated weights for policy 1, policy_version 1695641 (0.0007) [2023-12-28 07:25:09,108][106225] Updated weights for policy 1, policy_version 1695651 (0.0009) [2023-12-28 07:25:09,198][106226] Updated weights for policy 0, policy_version 1691696 (0.0008) [2023-12-28 07:25:09,268][106226] Updated weights for policy 0, policy_version 1691706 (0.0008) [2023-12-28 07:25:09,337][106226] Updated weights for policy 0, policy_version 1691716 (0.0009) [2023-12-28 07:25:09,801][106225] Updated weights for policy 1, policy_version 1695661 (0.0009) [2023-12-28 07:25:09,871][106225] Updated weights for policy 1, policy_version 1695671 (0.0009) [2023-12-28 07:25:09,938][106225] Updated weights for policy 1, policy_version 1695681 (0.0008) [2023-12-28 07:25:10,088][106226] Updated weights for policy 0, policy_version 1691726 (0.0009) [2023-12-28 07:25:10,153][106226] Updated weights for policy 0, policy_version 1691736 (0.0009) [2023-12-28 07:25:10,215][106226] Updated weights for policy 0, policy_version 1691746 (0.0009) [2023-12-28 07:25:10,677][106225] Updated weights for policy 1, policy_version 1695691 (0.0008) [2023-12-28 07:25:10,725][106225] Updated weights for policy 1, policy_version 1695701 (0.0010) [2023-12-28 07:25:10,775][106225] Updated weights for policy 1, policy_version 1695711 (0.0010) [2023-12-28 07:25:10,926][106226] Updated weights for policy 0, policy_version 1691756 (0.0009) [2023-12-28 07:25:10,988][106226] Updated weights for policy 0, policy_version 1691766 (0.0007) [2023-12-28 07:25:11,057][106226] Updated weights for policy 0, policy_version 1691776 (0.0006) [2023-12-28 07:25:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 867336192. Throughput: 0: 9939.0, 1: 9909.3. Samples: 867303732. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:11,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.824')] [2023-12-28 07:25:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001695720_434159616.pth... [2023-12-28 07:25:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001691784_433176576.pth... [2023-12-28 07:25:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001694568_433864704.pth [2023-12-28 07:25:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001690648_432881664.pth [2023-12-28 07:25:11,543][106225] Updated weights for policy 1, policy_version 1695721 (0.0007) [2023-12-28 07:25:11,600][106225] Updated weights for policy 1, policy_version 1695731 (0.0009) [2023-12-28 07:25:11,680][106225] Updated weights for policy 1, policy_version 1695741 (0.0008) [2023-12-28 07:25:11,755][106225] Updated weights for policy 1, policy_version 1695751 (0.0009) [2023-12-28 07:25:11,852][106226] Updated weights for policy 0, policy_version 1691786 (0.0008) [2023-12-28 07:25:11,913][106226] Updated weights for policy 0, policy_version 1691796 (0.0008) [2023-12-28 07:25:11,979][106226] Updated weights for policy 0, policy_version 1691806 (0.0009) [2023-12-28 07:25:12,041][106226] Updated weights for policy 0, policy_version 1691816 (0.0009) [2023-12-28 07:25:12,431][106225] Updated weights for policy 1, policy_version 1695761 (0.0005) [2023-12-28 07:25:12,489][106225] Updated weights for policy 1, policy_version 1695771 (0.0005) [2023-12-28 07:25:12,547][106225] Updated weights for policy 1, policy_version 1695781 (0.0007) [2023-12-28 07:25:12,808][106226] Updated weights for policy 0, policy_version 1691826 (0.0008) [2023-12-28 07:25:12,874][106226] Updated weights for policy 0, policy_version 1691836 (0.0008) [2023-12-28 07:25:12,932][106226] Updated weights for policy 0, policy_version 1691846 (0.0009) [2023-12-28 07:25:13,226][106225] Updated weights for policy 1, policy_version 1695791 (0.0009) [2023-12-28 07:25:13,282][106225] Updated weights for policy 1, policy_version 1695801 (0.0009) [2023-12-28 07:25:13,341][106225] Updated weights for policy 1, policy_version 1695811 (0.0007) [2023-12-28 07:25:13,584][106226] Updated weights for policy 0, policy_version 1691856 (0.0010) [2023-12-28 07:25:13,637][106226] Updated weights for policy 0, policy_version 1691866 (0.0010) [2023-12-28 07:25:13,693][106226] Updated weights for policy 0, policy_version 1691876 (0.0010) [2023-12-28 07:25:13,996][106225] Updated weights for policy 1, policy_version 1695821 (0.0008) [2023-12-28 07:25:14,047][106225] Updated weights for policy 1, policy_version 1695831 (0.0010) [2023-12-28 07:25:14,093][106225] Updated weights for policy 1, policy_version 1695841 (0.0010) [2023-12-28 07:25:14,328][106226] Updated weights for policy 0, policy_version 1691886 (0.0007) [2023-12-28 07:25:14,395][106226] Updated weights for policy 0, policy_version 1691896 (0.0006) [2023-12-28 07:25:14,452][106226] Updated weights for policy 0, policy_version 1691906 (0.0010) [2023-12-28 07:25:14,777][106225] Updated weights for policy 1, policy_version 1695851 (0.0010) [2023-12-28 07:25:14,846][106225] Updated weights for policy 1, policy_version 1695861 (0.0010) [2023-12-28 07:25:14,901][106225] Updated weights for policy 1, policy_version 1695871 (0.0010) [2023-12-28 07:25:15,059][106226] Updated weights for policy 0, policy_version 1691916 (0.0006) [2023-12-28 07:25:15,127][106226] Updated weights for policy 0, policy_version 1691926 (0.0007) [2023-12-28 07:25:15,191][106226] Updated weights for policy 0, policy_version 1691936 (0.0005) [2023-12-28 07:25:15,577][106225] Updated weights for policy 1, policy_version 1695881 (0.0009) [2023-12-28 07:25:15,623][106225] Updated weights for policy 1, policy_version 1695891 (0.0005) [2023-12-28 07:25:15,681][106225] Updated weights for policy 1, policy_version 1695901 (0.0007) [2023-12-28 07:25:15,732][106225] Updated weights for policy 1, policy_version 1695911 (0.0010) [2023-12-28 07:25:15,767][106226] Updated weights for policy 0, policy_version 1691946 (0.0007) [2023-12-28 07:25:15,835][106226] Updated weights for policy 0, policy_version 1691956 (0.0005) [2023-12-28 07:25:15,902][106226] Updated weights for policy 0, policy_version 1691966 (0.0005) [2023-12-28 07:25:15,962][106226] Updated weights for policy 0, policy_version 1691976 (0.0006) [2023-12-28 07:25:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 867434496. Throughput: 0: 9797.4, 1: 9860.9. Samples: 867421268. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:16,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.544')] [2023-12-28 07:25:16,391][106225] Updated weights for policy 1, policy_version 1695921 (0.0010) [2023-12-28 07:25:16,451][106225] Updated weights for policy 1, policy_version 1695931 (0.0010) [2023-12-28 07:25:16,462][106226] Updated weights for policy 0, policy_version 1691986 (0.0010) [2023-12-28 07:25:16,508][106225] Updated weights for policy 1, policy_version 1695941 (0.0010) [2023-12-28 07:25:16,515][106226] Updated weights for policy 0, policy_version 1691996 (0.0010) [2023-12-28 07:25:16,568][106226] Updated weights for policy 0, policy_version 1692006 (0.0010) [2023-12-28 07:25:17,206][106225] Updated weights for policy 1, policy_version 1695951 (0.0010) [2023-12-28 07:25:17,259][106225] Updated weights for policy 1, policy_version 1695961 (0.0010) [2023-12-28 07:25:17,294][106226] Updated weights for policy 0, policy_version 1692016 (0.0007) [2023-12-28 07:25:17,318][106225] Updated weights for policy 1, policy_version 1695971 (0.0010) [2023-12-28 07:25:17,349][106226] Updated weights for policy 0, policy_version 1692026 (0.0009) [2023-12-28 07:25:17,409][106226] Updated weights for policy 0, policy_version 1692036 (0.0008) [2023-12-28 07:25:18,000][106225] Updated weights for policy 1, policy_version 1695981 (0.0008) [2023-12-28 07:25:18,048][106225] Updated weights for policy 1, policy_version 1695991 (0.0007) [2023-12-28 07:25:18,077][106226] Updated weights for policy 0, policy_version 1692046 (0.0007) [2023-12-28 07:25:18,102][106225] Updated weights for policy 1, policy_version 1696001 (0.0010) [2023-12-28 07:25:18,135][106226] Updated weights for policy 0, policy_version 1692056 (0.0006) [2023-12-28 07:25:18,193][106226] Updated weights for policy 0, policy_version 1692066 (0.0006) [2023-12-28 07:25:18,870][106226] Updated weights for policy 0, policy_version 1692076 (0.0008) [2023-12-28 07:25:18,871][106225] Updated weights for policy 1, policy_version 1696011 (0.0010) [2023-12-28 07:25:18,927][106225] Updated weights for policy 1, policy_version 1696021 (0.0008) [2023-12-28 07:25:18,938][106226] Updated weights for policy 0, policy_version 1692086 (0.0008) [2023-12-28 07:25:18,975][106225] Updated weights for policy 1, policy_version 1696031 (0.0008) [2023-12-28 07:25:18,993][106226] Updated weights for policy 0, policy_version 1692096 (0.0006) [2023-12-28 07:25:19,689][106226] Updated weights for policy 0, policy_version 1692106 (0.0005) [2023-12-28 07:25:19,755][106226] Updated weights for policy 0, policy_version 1692116 (0.0006) [2023-12-28 07:25:19,800][106225] Updated weights for policy 1, policy_version 1696041 (0.0009) [2023-12-28 07:25:19,819][106226] Updated weights for policy 0, policy_version 1692126 (0.0006) [2023-12-28 07:25:19,867][106225] Updated weights for policy 1, policy_version 1696051 (0.0008) [2023-12-28 07:25:19,890][106226] Updated weights for policy 0, policy_version 1692136 (0.0007) [2023-12-28 07:25:19,935][106225] Updated weights for policy 1, policy_version 1696061 (0.0008) [2023-12-28 07:25:20,002][106225] Updated weights for policy 1, policy_version 1696071 (0.0009) [2023-12-28 07:25:20,610][106226] Updated weights for policy 0, policy_version 1692146 (0.0008) [2023-12-28 07:25:20,703][106226] Updated weights for policy 0, policy_version 1692156 (0.0006) [2023-12-28 07:25:20,762][106226] Updated weights for policy 0, policy_version 1692166 (0.0006) [2023-12-28 07:25:20,833][106225] Updated weights for policy 1, policy_version 1696081 (0.0006) [2023-12-28 07:25:20,900][106225] Updated weights for policy 1, policy_version 1696091 (0.0008) [2023-12-28 07:25:20,963][106225] Updated weights for policy 1, policy_version 1696101 (0.0009) [2023-12-28 07:25:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 867532800. Throughput: 0: 9818.8, 1: 9870.2. Samples: 867541148. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:21,175][105115] Avg episode reward: [(0, '-4.182'), (1, '-4.706')] [2023-12-28 07:25:21,481][106226] Updated weights for policy 0, policy_version 1692176 (0.0008) [2023-12-28 07:25:21,535][106226] Updated weights for policy 0, policy_version 1692186 (0.0009) [2023-12-28 07:25:21,590][106226] Updated weights for policy 0, policy_version 1692196 (0.0010) [2023-12-28 07:25:21,757][106225] Updated weights for policy 1, policy_version 1696111 (0.0008) [2023-12-28 07:25:21,817][106225] Updated weights for policy 1, policy_version 1696121 (0.0007) [2023-12-28 07:25:21,874][106225] Updated weights for policy 1, policy_version 1696131 (0.0008) [2023-12-28 07:25:22,358][106226] Updated weights for policy 0, policy_version 1692206 (0.0012) [2023-12-28 07:25:22,420][106226] Updated weights for policy 0, policy_version 1692216 (0.0009) [2023-12-28 07:25:22,483][106226] Updated weights for policy 0, policy_version 1692226 (0.0008) [2023-12-28 07:25:22,620][106225] Updated weights for policy 1, policy_version 1696141 (0.0008) [2023-12-28 07:25:22,683][106225] Updated weights for policy 1, policy_version 1696151 (0.0008) [2023-12-28 07:25:22,741][106225] Updated weights for policy 1, policy_version 1696161 (0.0008) [2023-12-28 07:25:23,209][106226] Updated weights for policy 0, policy_version 1692236 (0.0007) [2023-12-28 07:25:23,263][106226] Updated weights for policy 0, policy_version 1692246 (0.0005) [2023-12-28 07:25:23,333][106226] Updated weights for policy 0, policy_version 1692256 (0.0005) [2023-12-28 07:25:23,449][106225] Updated weights for policy 1, policy_version 1696171 (0.0009) [2023-12-28 07:25:23,498][106225] Updated weights for policy 1, policy_version 1696181 (0.0009) [2023-12-28 07:25:23,549][106225] Updated weights for policy 1, policy_version 1696191 (0.0008) [2023-12-28 07:25:23,900][106226] Updated weights for policy 0, policy_version 1692266 (0.0005) [2023-12-28 07:25:23,957][106226] Updated weights for policy 0, policy_version 1692276 (0.0006) [2023-12-28 07:25:24,017][106226] Updated weights for policy 0, policy_version 1692286 (0.0006) [2023-12-28 07:25:24,077][106226] Updated weights for policy 0, policy_version 1692296 (0.0005) [2023-12-28 07:25:24,340][106225] Updated weights for policy 1, policy_version 1696201 (0.0008) [2023-12-28 07:25:24,387][106225] Updated weights for policy 1, policy_version 1696211 (0.0008) [2023-12-28 07:25:24,435][106225] Updated weights for policy 1, policy_version 1696221 (0.0008) [2023-12-28 07:25:24,480][106225] Updated weights for policy 1, policy_version 1696231 (0.0009) [2023-12-28 07:25:24,703][106226] Updated weights for policy 0, policy_version 1692306 (0.0007) [2023-12-28 07:25:24,762][106226] Updated weights for policy 0, policy_version 1692316 (0.0006) [2023-12-28 07:25:24,830][106226] Updated weights for policy 0, policy_version 1692326 (0.0005) [2023-12-28 07:25:25,201][106225] Updated weights for policy 1, policy_version 1696241 (0.0006) [2023-12-28 07:25:25,260][106225] Updated weights for policy 1, policy_version 1696251 (0.0006) [2023-12-28 07:25:25,327][106225] Updated weights for policy 1, policy_version 1696261 (0.0006) [2023-12-28 07:25:25,423][106226] Updated weights for policy 0, policy_version 1692336 (0.0007) [2023-12-28 07:25:25,473][106226] Updated weights for policy 0, policy_version 1692346 (0.0008) [2023-12-28 07:25:25,522][106226] Updated weights for policy 0, policy_version 1692356 (0.0008) [2023-12-28 07:25:25,969][106225] Updated weights for policy 1, policy_version 1696271 (0.0006) [2023-12-28 07:25:26,022][106225] Updated weights for policy 1, policy_version 1696281 (0.0005) [2023-12-28 07:25:26,071][106225] Updated weights for policy 1, policy_version 1696291 (0.0005) [2023-12-28 07:25:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 867631104. Throughput: 0: 9831.0, 1: 9844.4. Samples: 867598284. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:26,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-4.668')] [2023-12-28 07:25:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001692360_433324032.pth... [2023-12-28 07:25:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001696296_434307072.pth... [2023-12-28 07:25:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001695144_434012160.pth [2023-12-28 07:25:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001691208_433029120.pth [2023-12-28 07:25:26,297][106226] Updated weights for policy 0, policy_version 1692366 (0.0008) [2023-12-28 07:25:26,354][106226] Updated weights for policy 0, policy_version 1692376 (0.0008) [2023-12-28 07:25:26,406][106226] Updated weights for policy 0, policy_version 1692386 (0.0008) [2023-12-28 07:25:26,717][106225] Updated weights for policy 1, policy_version 1696301 (0.0007) [2023-12-28 07:25:26,763][106225] Updated weights for policy 1, policy_version 1696311 (0.0008) [2023-12-28 07:25:26,815][106225] Updated weights for policy 1, policy_version 1696321 (0.0009) [2023-12-28 07:25:27,084][106226] Updated weights for policy 0, policy_version 1692396 (0.0008) [2023-12-28 07:25:27,139][106226] Updated weights for policy 0, policy_version 1692406 (0.0009) [2023-12-28 07:25:27,187][106226] Updated weights for policy 0, policy_version 1692416 (0.0008) [2023-12-28 07:25:27,526][106225] Updated weights for policy 1, policy_version 1696331 (0.0007) [2023-12-28 07:25:27,591][106225] Updated weights for policy 1, policy_version 1696341 (0.0005) [2023-12-28 07:25:27,654][106225] Updated weights for policy 1, policy_version 1696351 (0.0005) [2023-12-28 07:25:27,924][106226] Updated weights for policy 0, policy_version 1692426 (0.0008) [2023-12-28 07:25:27,975][106226] Updated weights for policy 0, policy_version 1692436 (0.0005) [2023-12-28 07:25:28,024][106226] Updated weights for policy 0, policy_version 1692446 (0.0006) [2023-12-28 07:25:28,075][106226] Updated weights for policy 0, policy_version 1692456 (0.0005) [2023-12-28 07:25:28,228][106225] Updated weights for policy 1, policy_version 1696361 (0.0006) [2023-12-28 07:25:28,277][106225] Updated weights for policy 1, policy_version 1696371 (0.0005) [2023-12-28 07:25:28,333][106225] Updated weights for policy 1, policy_version 1696381 (0.0008) [2023-12-28 07:25:28,397][106225] Updated weights for policy 1, policy_version 1696391 (0.0007) [2023-12-28 07:25:28,666][106226] Updated weights for policy 0, policy_version 1692466 (0.0008) [2023-12-28 07:25:28,729][106226] Updated weights for policy 0, policy_version 1692476 (0.0008) [2023-12-28 07:25:28,779][106226] Updated weights for policy 0, policy_version 1692486 (0.0007) [2023-12-28 07:25:29,112][106225] Updated weights for policy 1, policy_version 1696401 (0.0010) [2023-12-28 07:25:29,165][106225] Updated weights for policy 1, policy_version 1696411 (0.0010) [2023-12-28 07:25:29,220][106225] Updated weights for policy 1, policy_version 1696421 (0.0010) [2023-12-28 07:25:29,466][106226] Updated weights for policy 0, policy_version 1692496 (0.0008) [2023-12-28 07:25:29,528][106226] Updated weights for policy 0, policy_version 1692506 (0.0008) [2023-12-28 07:25:29,587][106226] Updated weights for policy 0, policy_version 1692516 (0.0008) [2023-12-28 07:25:29,973][106225] Updated weights for policy 1, policy_version 1696431 (0.0009) [2023-12-28 07:25:30,035][106225] Updated weights for policy 1, policy_version 1696441 (0.0009) [2023-12-28 07:25:30,100][106225] Updated weights for policy 1, policy_version 1696451 (0.0008) [2023-12-28 07:25:30,345][106226] Updated weights for policy 0, policy_version 1692526 (0.0008) [2023-12-28 07:25:30,406][106226] Updated weights for policy 0, policy_version 1692536 (0.0006) [2023-12-28 07:25:30,465][106226] Updated weights for policy 0, policy_version 1692546 (0.0009) [2023-12-28 07:25:30,828][106225] Updated weights for policy 1, policy_version 1696461 (0.0008) [2023-12-28 07:25:30,881][106225] Updated weights for policy 1, policy_version 1696471 (0.0008) [2023-12-28 07:25:30,937][106225] Updated weights for policy 1, policy_version 1696481 (0.0009) [2023-12-28 07:25:31,039][106226] Updated weights for policy 0, policy_version 1692556 (0.0008) [2023-12-28 07:25:31,111][106226] Updated weights for policy 0, policy_version 1692566 (0.0008) [2023-12-28 07:25:31,174][106226] Updated weights for policy 0, policy_version 1692576 (0.0010) [2023-12-28 07:25:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 867729408. Throughput: 0: 9914.7, 1: 9934.7. Samples: 867720524. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:31,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-5.162')] [2023-12-28 07:25:31,845][106225] Updated weights for policy 1, policy_version 1696491 (0.0008) [2023-12-28 07:25:31,865][106226] Updated weights for policy 0, policy_version 1692586 (0.0008) [2023-12-28 07:25:31,905][106225] Updated weights for policy 1, policy_version 1696501 (0.0008) [2023-12-28 07:25:31,932][106226] Updated weights for policy 0, policy_version 1692596 (0.0007) [2023-12-28 07:25:31,970][106225] Updated weights for policy 1, policy_version 1696511 (0.0009) [2023-12-28 07:25:31,994][106226] Updated weights for policy 0, policy_version 1692606 (0.0008) [2023-12-28 07:25:32,056][106226] Updated weights for policy 0, policy_version 1692616 (0.0008) [2023-12-28 07:25:32,711][106225] Updated weights for policy 1, policy_version 1696521 (0.0010) [2023-12-28 07:25:32,764][106225] Updated weights for policy 1, policy_version 1696531 (0.0009) [2023-12-28 07:25:32,781][106226] Updated weights for policy 0, policy_version 1692626 (0.0008) [2023-12-28 07:25:32,826][106225] Updated weights for policy 1, policy_version 1696541 (0.0006) [2023-12-28 07:25:32,839][106226] Updated weights for policy 0, policy_version 1692636 (0.0007) [2023-12-28 07:25:32,885][106225] Updated weights for policy 1, policy_version 1696551 (0.0007) [2023-12-28 07:25:32,891][106226] Updated weights for policy 0, policy_version 1692646 (0.0006) [2023-12-28 07:25:33,563][106225] Updated weights for policy 1, policy_version 1696561 (0.0006) [2023-12-28 07:25:33,602][106226] Updated weights for policy 0, policy_version 1692656 (0.0008) [2023-12-28 07:25:33,611][106225] Updated weights for policy 1, policy_version 1696571 (0.0008) [2023-12-28 07:25:33,659][106226] Updated weights for policy 0, policy_version 1692666 (0.0005) [2023-12-28 07:25:33,663][106225] Updated weights for policy 1, policy_version 1696581 (0.0008) [2023-12-28 07:25:33,712][106226] Updated weights for policy 0, policy_version 1692676 (0.0005) [2023-12-28 07:25:34,308][106226] Updated weights for policy 0, policy_version 1692686 (0.0007) [2023-12-28 07:25:34,356][106226] Updated weights for policy 0, policy_version 1692696 (0.0008) [2023-12-28 07:25:34,413][106226] Updated weights for policy 0, policy_version 1692706 (0.0008) [2023-12-28 07:25:34,416][106225] Updated weights for policy 1, policy_version 1696591 (0.0008) [2023-12-28 07:25:34,479][106225] Updated weights for policy 1, policy_version 1696601 (0.0008) [2023-12-28 07:25:34,541][106225] Updated weights for policy 1, policy_version 1696611 (0.0007) [2023-12-28 07:25:35,150][106225] Updated weights for policy 1, policy_version 1696621 (0.0006) [2023-12-28 07:25:35,160][106226] Updated weights for policy 0, policy_version 1692716 (0.0008) [2023-12-28 07:25:35,215][106225] Updated weights for policy 1, policy_version 1696631 (0.0007) [2023-12-28 07:25:35,222][106226] Updated weights for policy 0, policy_version 1692726 (0.0006) [2023-12-28 07:25:35,282][106225] Updated weights for policy 1, policy_version 1696641 (0.0006) [2023-12-28 07:25:35,287][106226] Updated weights for policy 0, policy_version 1692736 (0.0006) [2023-12-28 07:25:35,842][106226] Updated weights for policy 0, policy_version 1692746 (0.0008) [2023-12-28 07:25:35,901][106226] Updated weights for policy 0, policy_version 1692756 (0.0005) [2023-12-28 07:25:35,959][106226] Updated weights for policy 0, policy_version 1692766 (0.0008) [2023-12-28 07:25:36,017][106226] Updated weights for policy 0, policy_version 1692776 (0.0007) [2023-12-28 07:25:36,019][106225] Updated weights for policy 1, policy_version 1696651 (0.0010) [2023-12-28 07:25:36,083][106225] Updated weights for policy 1, policy_version 1696661 (0.0011) [2023-12-28 07:25:36,151][106225] Updated weights for policy 1, policy_version 1696671 (0.0008) [2023-12-28 07:25:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 867827712. Throughput: 0: 9936.1, 1: 9918.0. Samples: 867839336. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:36,175][105115] Avg episode reward: [(0, '-4.113'), (1, '-4.388')] [2023-12-28 07:25:36,712][106226] Updated weights for policy 0, policy_version 1692786 (0.0005) [2023-12-28 07:25:36,774][106226] Updated weights for policy 0, policy_version 1692796 (0.0005) [2023-12-28 07:25:36,841][106226] Updated weights for policy 0, policy_version 1692806 (0.0006) [2023-12-28 07:25:36,875][106225] Updated weights for policy 1, policy_version 1696681 (0.0010) [2023-12-28 07:25:36,937][106225] Updated weights for policy 1, policy_version 1696691 (0.0009) [2023-12-28 07:25:36,997][106225] Updated weights for policy 1, policy_version 1696701 (0.0008) [2023-12-28 07:25:37,057][106225] Updated weights for policy 1, policy_version 1696711 (0.0010) [2023-12-28 07:25:37,505][106226] Updated weights for policy 0, policy_version 1692816 (0.0008) [2023-12-28 07:25:37,563][106226] Updated weights for policy 0, policy_version 1692826 (0.0007) [2023-12-28 07:25:37,623][106226] Updated weights for policy 0, policy_version 1692836 (0.0010) [2023-12-28 07:25:37,762][106225] Updated weights for policy 1, policy_version 1696721 (0.0008) [2023-12-28 07:25:37,820][106225] Updated weights for policy 1, policy_version 1696731 (0.0006) [2023-12-28 07:25:37,881][106225] Updated weights for policy 1, policy_version 1696741 (0.0007) [2023-12-28 07:25:38,324][106226] Updated weights for policy 0, policy_version 1692846 (0.0010) [2023-12-28 07:25:38,390][106226] Updated weights for policy 0, policy_version 1692856 (0.0011) [2023-12-28 07:25:38,452][106226] Updated weights for policy 0, policy_version 1692866 (0.0011) [2023-12-28 07:25:38,577][106225] Updated weights for policy 1, policy_version 1696751 (0.0008) [2023-12-28 07:25:38,646][106225] Updated weights for policy 1, policy_version 1696761 (0.0008) [2023-12-28 07:25:38,703][106225] Updated weights for policy 1, policy_version 1696771 (0.0008) [2023-12-28 07:25:39,166][106226] Updated weights for policy 0, policy_version 1692876 (0.0008) [2023-12-28 07:25:39,232][106226] Updated weights for policy 0, policy_version 1692886 (0.0010) [2023-12-28 07:25:39,299][106226] Updated weights for policy 0, policy_version 1692896 (0.0011) [2023-12-28 07:25:39,480][106225] Updated weights for policy 1, policy_version 1696781 (0.0008) [2023-12-28 07:25:39,540][106225] Updated weights for policy 1, policy_version 1696791 (0.0009) [2023-12-28 07:25:39,603][106225] Updated weights for policy 1, policy_version 1696801 (0.0008) [2023-12-28 07:25:40,002][106226] Updated weights for policy 0, policy_version 1692906 (0.0010) [2023-12-28 07:25:40,064][106226] Updated weights for policy 0, policy_version 1692916 (0.0007) [2023-12-28 07:25:40,126][106226] Updated weights for policy 0, policy_version 1692926 (0.0007) [2023-12-28 07:25:40,192][106226] Updated weights for policy 0, policy_version 1692936 (0.0008) [2023-12-28 07:25:40,374][106225] Updated weights for policy 1, policy_version 1696811 (0.0010) [2023-12-28 07:25:40,433][106225] Updated weights for policy 1, policy_version 1696821 (0.0009) [2023-12-28 07:25:40,501][106225] Updated weights for policy 1, policy_version 1696831 (0.0009) [2023-12-28 07:25:40,889][106226] Updated weights for policy 0, policy_version 1692946 (0.0009) [2023-12-28 07:25:40,949][106226] Updated weights for policy 0, policy_version 1692956 (0.0008) [2023-12-28 07:25:41,005][106226] Updated weights for policy 0, policy_version 1692966 (0.0008) [2023-12-28 07:25:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 867926016. Throughput: 0: 9965.7, 1: 9918.0. Samples: 867898016. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:41,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.963')] [2023-12-28 07:25:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001692968_433479680.pth... [2023-12-28 07:25:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001691784_433176576.pth [2023-12-28 07:25:41,192][106225] Updated weights for policy 1, policy_version 1696841 (0.0007) [2023-12-28 07:25:41,263][106225] Updated weights for policy 1, policy_version 1696851 (0.0008) [2023-12-28 07:25:41,319][106225] Updated weights for policy 1, policy_version 1696861 (0.0007) [2023-12-28 07:25:41,389][106225] Updated weights for policy 1, policy_version 1696871 (0.0007) [2023-12-28 07:25:41,395][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001696872_434454528.pth... [2023-12-28 07:25:41,398][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001695720_434159616.pth [2023-12-28 07:25:41,829][106226] Updated weights for policy 0, policy_version 1692976 (0.0008) [2023-12-28 07:25:41,889][106226] Updated weights for policy 0, policy_version 1692986 (0.0008) [2023-12-28 07:25:41,951][106226] Updated weights for policy 0, policy_version 1692996 (0.0008) [2023-12-28 07:25:42,141][106225] Updated weights for policy 1, policy_version 1696881 (0.0008) [2023-12-28 07:25:42,207][106225] Updated weights for policy 1, policy_version 1696891 (0.0008) [2023-12-28 07:25:42,270][106225] Updated weights for policy 1, policy_version 1696901 (0.0008) [2023-12-28 07:25:42,721][106226] Updated weights for policy 0, policy_version 1693006 (0.0008) [2023-12-28 07:25:42,781][106226] Updated weights for policy 0, policy_version 1693016 (0.0009) [2023-12-28 07:25:42,844][106226] Updated weights for policy 0, policy_version 1693026 (0.0010) [2023-12-28 07:25:42,939][106225] Updated weights for policy 1, policy_version 1696911 (0.0007) [2023-12-28 07:25:42,997][106225] Updated weights for policy 1, policy_version 1696921 (0.0006) [2023-12-28 07:25:43,055][106225] Updated weights for policy 1, policy_version 1696931 (0.0005) [2023-12-28 07:25:43,599][106226] Updated weights for policy 0, policy_version 1693036 (0.0007) [2023-12-28 07:25:43,603][106225] Updated weights for policy 1, policy_version 1696941 (0.0005) [2023-12-28 07:25:43,651][106226] Updated weights for policy 0, policy_version 1693046 (0.0009) [2023-12-28 07:25:43,662][106225] Updated weights for policy 1, policy_version 1696951 (0.0005) [2023-12-28 07:25:43,712][106226] Updated weights for policy 0, policy_version 1693056 (0.0009) [2023-12-28 07:25:43,723][106225] Updated weights for policy 1, policy_version 1696961 (0.0005) [2023-12-28 07:25:44,377][106225] Updated weights for policy 1, policy_version 1696971 (0.0007) [2023-12-28 07:25:44,433][106225] Updated weights for policy 1, policy_version 1696981 (0.0010) [2023-12-28 07:25:44,454][106226] Updated weights for policy 0, policy_version 1693066 (0.0008) [2023-12-28 07:25:44,499][106225] Updated weights for policy 1, policy_version 1696991 (0.0007) [2023-12-28 07:25:44,514][106226] Updated weights for policy 0, policy_version 1693076 (0.0009) [2023-12-28 07:25:44,563][106226] Updated weights for policy 0, policy_version 1693086 (0.0009) [2023-12-28 07:25:44,621][106226] Updated weights for policy 0, policy_version 1693096 (0.0008) [2023-12-28 07:25:45,148][106225] Updated weights for policy 1, policy_version 1697001 (0.0006) [2023-12-28 07:25:45,213][106225] Updated weights for policy 1, policy_version 1697011 (0.0011) [2023-12-28 07:25:45,278][106225] Updated weights for policy 1, policy_version 1697021 (0.0011) [2023-12-28 07:25:45,343][106225] Updated weights for policy 1, policy_version 1697031 (0.0010) [2023-12-28 07:25:45,414][106226] Updated weights for policy 0, policy_version 1693106 (0.0008) [2023-12-28 07:25:45,478][106226] Updated weights for policy 0, policy_version 1693116 (0.0008) [2023-12-28 07:25:45,543][106226] Updated weights for policy 0, policy_version 1693126 (0.0008) [2023-12-28 07:25:46,019][106225] Updated weights for policy 1, policy_version 1697041 (0.0006) [2023-12-28 07:25:46,083][106225] Updated weights for policy 1, policy_version 1697051 (0.0005) [2023-12-28 07:25:46,138][106226] Updated weights for policy 0, policy_version 1693136 (0.0006) [2023-12-28 07:25:46,140][106225] Updated weights for policy 1, policy_version 1697061 (0.0006) [2023-12-28 07:25:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 868024320. Throughput: 0: 9895.1, 1: 9887.1. Samples: 868013232. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:46,175][105115] Avg episode reward: [(0, '-4.641'), (1, '-4.813')] [2023-12-28 07:25:46,198][106226] Updated weights for policy 0, policy_version 1693146 (0.0005) [2023-12-28 07:25:46,260][106226] Updated weights for policy 0, policy_version 1693156 (0.0005) [2023-12-28 07:25:46,648][106225] Updated weights for policy 1, policy_version 1697071 (0.0005) [2023-12-28 07:25:46,706][106225] Updated weights for policy 1, policy_version 1697081 (0.0005) [2023-12-28 07:25:46,764][106225] Updated weights for policy 1, policy_version 1697091 (0.0009) [2023-12-28 07:25:46,852][106226] Updated weights for policy 0, policy_version 1693166 (0.0006) [2023-12-28 07:25:46,898][106226] Updated weights for policy 0, policy_version 1693176 (0.0008) [2023-12-28 07:25:46,953][106226] Updated weights for policy 0, policy_version 1693186 (0.0006) [2023-12-28 07:25:47,443][106225] Updated weights for policy 1, policy_version 1697101 (0.0010) [2023-12-28 07:25:47,501][106225] Updated weights for policy 1, policy_version 1697111 (0.0010) [2023-12-28 07:25:47,565][106225] Updated weights for policy 1, policy_version 1697121 (0.0010) [2023-12-28 07:25:47,617][106226] Updated weights for policy 0, policy_version 1693196 (0.0006) [2023-12-28 07:25:47,688][106226] Updated weights for policy 0, policy_version 1693206 (0.0005) [2023-12-28 07:25:47,756][106226] Updated weights for policy 0, policy_version 1693216 (0.0009) [2023-12-28 07:25:48,218][106225] Updated weights for policy 1, policy_version 1697131 (0.0005) [2023-12-28 07:25:48,275][106225] Updated weights for policy 1, policy_version 1697141 (0.0008) [2023-12-28 07:25:48,330][106225] Updated weights for policy 1, policy_version 1697151 (0.0008) [2023-12-28 07:25:48,363][106226] Updated weights for policy 0, policy_version 1693226 (0.0011) [2023-12-28 07:25:48,422][106226] Updated weights for policy 0, policy_version 1693236 (0.0011) [2023-12-28 07:25:48,487][106226] Updated weights for policy 0, policy_version 1693246 (0.0011) [2023-12-28 07:25:48,549][106226] Updated weights for policy 0, policy_version 1693256 (0.0011) [2023-12-28 07:25:49,034][106225] Updated weights for policy 1, policy_version 1697161 (0.0006) [2023-12-28 07:25:49,090][106225] Updated weights for policy 1, policy_version 1697171 (0.0005) [2023-12-28 07:25:49,150][106225] Updated weights for policy 1, policy_version 1697181 (0.0007) [2023-12-28 07:25:49,210][106225] Updated weights for policy 1, policy_version 1697191 (0.0006) [2023-12-28 07:25:49,270][106226] Updated weights for policy 0, policy_version 1693266 (0.0011) [2023-12-28 07:25:49,325][106226] Updated weights for policy 0, policy_version 1693276 (0.0011) [2023-12-28 07:25:49,397][106226] Updated weights for policy 0, policy_version 1693288 (0.0008) [2023-12-28 07:25:49,975][106225] Updated weights for policy 1, policy_version 1697201 (0.0009) [2023-12-28 07:25:50,041][106225] Updated weights for policy 1, policy_version 1697211 (0.0009) [2023-12-28 07:25:50,094][106225] Updated weights for policy 1, policy_version 1697221 (0.0008) [2023-12-28 07:25:50,187][106226] Updated weights for policy 0, policy_version 1693298 (0.0008) [2023-12-28 07:25:50,250][106226] Updated weights for policy 0, policy_version 1693308 (0.0008) [2023-12-28 07:25:50,315][106226] Updated weights for policy 0, policy_version 1693318 (0.0011) [2023-12-28 07:25:50,812][106225] Updated weights for policy 1, policy_version 1697231 (0.0008) [2023-12-28 07:25:50,885][106225] Updated weights for policy 1, policy_version 1697241 (0.0007) [2023-12-28 07:25:50,940][106225] Updated weights for policy 1, policy_version 1697251 (0.0008) [2023-12-28 07:25:51,009][106226] Updated weights for policy 0, policy_version 1693328 (0.0011) [2023-12-28 07:25:51,075][106226] Updated weights for policy 0, policy_version 1693338 (0.0009) [2023-12-28 07:25:51,144][106226] Updated weights for policy 0, policy_version 1693348 (0.0010) [2023-12-28 07:25:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 868130816. Throughput: 0: 9982.4, 1: 9859.9. Samples: 868135876. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:51,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.829')] [2023-12-28 07:25:51,671][106225] Updated weights for policy 1, policy_version 1697261 (0.0009) [2023-12-28 07:25:51,737][106225] Updated weights for policy 1, policy_version 1697271 (0.0009) [2023-12-28 07:25:51,803][106225] Updated weights for policy 1, policy_version 1697281 (0.0008) [2023-12-28 07:25:51,992][106226] Updated weights for policy 0, policy_version 1693358 (0.0008) [2023-12-28 07:25:52,051][106226] Updated weights for policy 0, policy_version 1693368 (0.0009) [2023-12-28 07:25:52,123][106226] Updated weights for policy 0, policy_version 1693378 (0.0008) [2023-12-28 07:25:52,550][106225] Updated weights for policy 1, policy_version 1697291 (0.0008) [2023-12-28 07:25:52,609][106225] Updated weights for policy 1, policy_version 1697301 (0.0008) [2023-12-28 07:25:52,675][106225] Updated weights for policy 1, policy_version 1697311 (0.0009) [2023-12-28 07:25:52,812][106226] Updated weights for policy 0, policy_version 1693388 (0.0006) [2023-12-28 07:25:52,874][106226] Updated weights for policy 0, policy_version 1693398 (0.0009) [2023-12-28 07:25:52,924][106226] Updated weights for policy 0, policy_version 1693408 (0.0010) [2023-12-28 07:25:53,308][106225] Updated weights for policy 1, policy_version 1697321 (0.0006) [2023-12-28 07:25:53,369][106225] Updated weights for policy 1, policy_version 1697331 (0.0008) [2023-12-28 07:25:53,427][106225] Updated weights for policy 1, policy_version 1697341 (0.0009) [2023-12-28 07:25:53,496][106225] Updated weights for policy 1, policy_version 1697351 (0.0008) [2023-12-28 07:25:53,607][106226] Updated weights for policy 0, policy_version 1693418 (0.0009) [2023-12-28 07:25:53,658][106226] Updated weights for policy 0, policy_version 1693428 (0.0007) [2023-12-28 07:25:53,720][106226] Updated weights for policy 0, policy_version 1693438 (0.0009) [2023-12-28 07:25:53,786][106226] Updated weights for policy 0, policy_version 1693448 (0.0005) [2023-12-28 07:25:54,231][106225] Updated weights for policy 1, policy_version 1697361 (0.0006) [2023-12-28 07:25:54,279][106225] Updated weights for policy 1, policy_version 1697371 (0.0005) [2023-12-28 07:25:54,343][106225] Updated weights for policy 1, policy_version 1697381 (0.0006) [2023-12-28 07:25:54,367][106226] Updated weights for policy 0, policy_version 1693458 (0.0008) [2023-12-28 07:25:54,413][106226] Updated weights for policy 0, policy_version 1693468 (0.0010) [2023-12-28 07:25:54,466][106226] Updated weights for policy 0, policy_version 1693478 (0.0011) [2023-12-28 07:25:54,982][106225] Updated weights for policy 1, policy_version 1697391 (0.0009) [2023-12-28 07:25:55,045][106225] Updated weights for policy 1, policy_version 1697401 (0.0008) [2023-12-28 07:25:55,105][106225] Updated weights for policy 1, policy_version 1697411 (0.0009) [2023-12-28 07:25:55,166][106226] Updated weights for policy 0, policy_version 1693488 (0.0006) [2023-12-28 07:25:55,215][106226] Updated weights for policy 0, policy_version 1693498 (0.0006) [2023-12-28 07:25:55,264][106226] Updated weights for policy 0, policy_version 1693508 (0.0008) [2023-12-28 07:25:55,833][106225] Updated weights for policy 1, policy_version 1697421 (0.0011) [2023-12-28 07:25:55,886][106225] Updated weights for policy 1, policy_version 1697431 (0.0010) [2023-12-28 07:25:55,900][106226] Updated weights for policy 0, policy_version 1693518 (0.0006) [2023-12-28 07:25:55,933][106225] Updated weights for policy 1, policy_version 1697441 (0.0010) [2023-12-28 07:25:55,963][106226] Updated weights for policy 0, policy_version 1693528 (0.0005) [2023-12-28 07:25:56,022][106226] Updated weights for policy 0, policy_version 1693538 (0.0005) [2023-12-28 07:25:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 868229120. Throughput: 0: 9973.3, 1: 9805.7. Samples: 868193788. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:25:56,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.695')] [2023-12-28 07:25:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001697448_434601984.pth... [2023-12-28 07:25:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001693544_433627136.pth... [2023-12-28 07:25:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001696296_434307072.pth [2023-12-28 07:25:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001692360_433324032.pth [2023-12-28 07:25:56,615][106225] Updated weights for policy 1, policy_version 1697451 (0.0010) [2023-12-28 07:25:56,618][106226] Updated weights for policy 0, policy_version 1693548 (0.0007) [2023-12-28 07:25:56,661][106225] Updated weights for policy 1, policy_version 1697461 (0.0010) [2023-12-28 07:25:56,677][106226] Updated weights for policy 0, policy_version 1693558 (0.0010) [2023-12-28 07:25:56,708][106225] Updated weights for policy 1, policy_version 1697471 (0.0010) [2023-12-28 07:25:56,732][106226] Updated weights for policy 0, policy_version 1693568 (0.0010) [2023-12-28 07:25:57,334][106225] Updated weights for policy 1, policy_version 1697481 (0.0009) [2023-12-28 07:25:57,382][106225] Updated weights for policy 1, policy_version 1697491 (0.0009) [2023-12-28 07:25:57,398][106226] Updated weights for policy 0, policy_version 1693578 (0.0009) [2023-12-28 07:25:57,442][106225] Updated weights for policy 1, policy_version 1697501 (0.0010) [2023-12-28 07:25:57,451][106226] Updated weights for policy 0, policy_version 1693588 (0.0005) [2023-12-28 07:25:57,491][106225] Updated weights for policy 1, policy_version 1697511 (0.0010) [2023-12-28 07:25:57,500][106226] Updated weights for policy 0, policy_version 1693598 (0.0005) [2023-12-28 07:25:57,551][106226] Updated weights for policy 0, policy_version 1693608 (0.0005) [2023-12-28 07:25:58,073][106225] Updated weights for policy 1, policy_version 1697521 (0.0008) [2023-12-28 07:25:58,136][106225] Updated weights for policy 1, policy_version 1697531 (0.0008) [2023-12-28 07:25:58,193][106225] Updated weights for policy 1, policy_version 1697541 (0.0006) [2023-12-28 07:25:58,201][106226] Updated weights for policy 0, policy_version 1693618 (0.0010) [2023-12-28 07:25:58,260][106226] Updated weights for policy 0, policy_version 1693628 (0.0008) [2023-12-28 07:25:58,329][106226] Updated weights for policy 0, policy_version 1693638 (0.0008) [2023-12-28 07:25:58,982][106225] Updated weights for policy 1, policy_version 1697551 (0.0008) [2023-12-28 07:25:59,048][106225] Updated weights for policy 1, policy_version 1697561 (0.0008) [2023-12-28 07:25:59,107][106225] Updated weights for policy 1, policy_version 1697571 (0.0008) [2023-12-28 07:25:59,143][106226] Updated weights for policy 0, policy_version 1693648 (0.0010) [2023-12-28 07:25:59,207][106226] Updated weights for policy 0, policy_version 1693658 (0.0010) [2023-12-28 07:25:59,286][106226] Updated weights for policy 0, policy_version 1693668 (0.0010) [2023-12-28 07:25:59,865][106225] Updated weights for policy 1, policy_version 1697581 (0.0008) [2023-12-28 07:25:59,921][106225] Updated weights for policy 1, policy_version 1697591 (0.0006) [2023-12-28 07:25:59,927][106226] Updated weights for policy 0, policy_version 1693678 (0.0007) [2023-12-28 07:25:59,986][106225] Updated weights for policy 1, policy_version 1697601 (0.0007) [2023-12-28 07:25:59,991][106226] Updated weights for policy 0, policy_version 1693688 (0.0009) [2023-12-28 07:26:00,047][106226] Updated weights for policy 0, policy_version 1693698 (0.0006) [2023-12-28 07:26:00,710][106226] Updated weights for policy 0, policy_version 1693708 (0.0005) [2023-12-28 07:26:00,769][106226] Updated weights for policy 0, policy_version 1693718 (0.0005) [2023-12-28 07:26:00,771][106225] Updated weights for policy 1, policy_version 1697611 (0.0008) [2023-12-28 07:26:00,819][106226] Updated weights for policy 0, policy_version 1693728 (0.0005) [2023-12-28 07:26:00,823][106225] Updated weights for policy 1, policy_version 1697621 (0.0008) [2023-12-28 07:26:00,875][106225] Updated weights for policy 1, policy_version 1697631 (0.0008) [2023-12-28 07:26:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 868327424. Throughput: 0: 10037.1, 1: 9837.7. Samples: 868315632. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:26:01,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.461')] [2023-12-28 07:26:01,406][106226] Updated weights for policy 0, policy_version 1693738 (0.0006) [2023-12-28 07:26:01,473][106226] Updated weights for policy 0, policy_version 1693748 (0.0009) [2023-12-28 07:26:01,540][106226] Updated weights for policy 0, policy_version 1693758 (0.0008) [2023-12-28 07:26:01,599][106226] Updated weights for policy 0, policy_version 1693768 (0.0008) [2023-12-28 07:26:01,675][106225] Updated weights for policy 1, policy_version 1697641 (0.0008) [2023-12-28 07:26:01,746][106225] Updated weights for policy 1, policy_version 1697651 (0.0009) [2023-12-28 07:26:01,809][106225] Updated weights for policy 1, policy_version 1697661 (0.0008) [2023-12-28 07:26:01,872][106225] Updated weights for policy 1, policy_version 1697671 (0.0008) [2023-12-28 07:26:02,375][106226] Updated weights for policy 0, policy_version 1693778 (0.0009) [2023-12-28 07:26:02,435][106226] Updated weights for policy 0, policy_version 1693788 (0.0009) [2023-12-28 07:26:02,496][106226] Updated weights for policy 0, policy_version 1693798 (0.0008) [2023-12-28 07:26:02,611][106225] Updated weights for policy 1, policy_version 1697681 (0.0009) [2023-12-28 07:26:02,667][106225] Updated weights for policy 1, policy_version 1697691 (0.0007) [2023-12-28 07:26:02,727][106225] Updated weights for policy 1, policy_version 1697701 (0.0005) [2023-12-28 07:26:03,214][106226] Updated weights for policy 0, policy_version 1693808 (0.0009) [2023-12-28 07:26:03,272][106226] Updated weights for policy 0, policy_version 1693818 (0.0009) [2023-12-28 07:26:03,332][106226] Updated weights for policy 0, policy_version 1693828 (0.0008) [2023-12-28 07:26:03,407][106225] Updated weights for policy 1, policy_version 1697711 (0.0007) [2023-12-28 07:26:03,470][106225] Updated weights for policy 1, policy_version 1697721 (0.0008) [2023-12-28 07:26:03,533][106225] Updated weights for policy 1, policy_version 1697731 (0.0008) [2023-12-28 07:26:04,083][106226] Updated weights for policy 0, policy_version 1693838 (0.0009) [2023-12-28 07:26:04,146][106226] Updated weights for policy 0, policy_version 1693848 (0.0008) [2023-12-28 07:26:04,206][106225] Updated weights for policy 1, policy_version 1697741 (0.0008) [2023-12-28 07:26:04,214][106226] Updated weights for policy 0, policy_version 1693858 (0.0009) [2023-12-28 07:26:04,268][106225] Updated weights for policy 1, policy_version 1697751 (0.0009) [2023-12-28 07:26:04,331][106225] Updated weights for policy 1, policy_version 1697761 (0.0009) [2023-12-28 07:26:04,935][106226] Updated weights for policy 0, policy_version 1693868 (0.0007) [2023-12-28 07:26:04,982][106226] Updated weights for policy 0, policy_version 1693878 (0.0008) [2023-12-28 07:26:05,030][106226] Updated weights for policy 0, policy_version 1693888 (0.0006) [2023-12-28 07:26:05,046][106225] Updated weights for policy 1, policy_version 1697771 (0.0008) [2023-12-28 07:26:05,114][106225] Updated weights for policy 1, policy_version 1697781 (0.0008) [2023-12-28 07:26:05,177][106225] Updated weights for policy 1, policy_version 1697791 (0.0010) [2023-12-28 07:26:05,699][106226] Updated weights for policy 0, policy_version 1693898 (0.0006) [2023-12-28 07:26:05,759][106226] Updated weights for policy 0, policy_version 1693908 (0.0009) [2023-12-28 07:26:05,768][106225] Updated weights for policy 1, policy_version 1697801 (0.0010) [2023-12-28 07:26:05,822][106226] Updated weights for policy 0, policy_version 1693918 (0.0005) [2023-12-28 07:26:05,825][106225] Updated weights for policy 1, policy_version 1697811 (0.0010) [2023-12-28 07:26:05,885][106225] Updated weights for policy 1, policy_version 1697821 (0.0010) [2023-12-28 07:26:05,887][106226] Updated weights for policy 0, policy_version 1693928 (0.0005) [2023-12-28 07:26:05,940][106225] Updated weights for policy 1, policy_version 1697831 (0.0008) [2023-12-28 07:26:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 868425728. Throughput: 0: 9976.2, 1: 9845.1. Samples: 868433108. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:26:06,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.064')] [2023-12-28 07:26:06,640][106226] Updated weights for policy 0, policy_version 1693938 (0.0007) [2023-12-28 07:26:06,659][106225] Updated weights for policy 1, policy_version 1697841 (0.0007) [2023-12-28 07:26:06,699][106226] Updated weights for policy 0, policy_version 1693948 (0.0006) [2023-12-28 07:26:06,724][106225] Updated weights for policy 1, policy_version 1697851 (0.0008) [2023-12-28 07:26:06,765][106226] Updated weights for policy 0, policy_version 1693958 (0.0007) [2023-12-28 07:26:06,775][106225] Updated weights for policy 1, policy_version 1697861 (0.0006) [2023-12-28 07:26:07,423][106225] Updated weights for policy 1, policy_version 1697871 (0.0009) [2023-12-28 07:26:07,433][106226] Updated weights for policy 0, policy_version 1693968 (0.0006) [2023-12-28 07:26:07,478][106225] Updated weights for policy 1, policy_version 1697881 (0.0010) [2023-12-28 07:26:07,484][106226] Updated weights for policy 0, policy_version 1693978 (0.0005) [2023-12-28 07:26:07,531][106226] Updated weights for policy 0, policy_version 1693988 (0.0006) [2023-12-28 07:26:07,535][106225] Updated weights for policy 1, policy_version 1697891 (0.0010) [2023-12-28 07:26:08,128][106225] Updated weights for policy 1, policy_version 1697901 (0.0010) [2023-12-28 07:26:08,133][106226] Updated weights for policy 0, policy_version 1693998 (0.0006) [2023-12-28 07:26:08,182][106225] Updated weights for policy 1, policy_version 1697911 (0.0010) [2023-12-28 07:26:08,189][106226] Updated weights for policy 0, policy_version 1694008 (0.0006) [2023-12-28 07:26:08,237][106226] Updated weights for policy 0, policy_version 1694018 (0.0006) [2023-12-28 07:26:08,248][106225] Updated weights for policy 1, policy_version 1697921 (0.0009) [2023-12-28 07:26:08,897][106226] Updated weights for policy 0, policy_version 1694028 (0.0008) [2023-12-28 07:26:08,958][106226] Updated weights for policy 0, policy_version 1694038 (0.0010) [2023-12-28 07:26:08,960][106225] Updated weights for policy 1, policy_version 1697931 (0.0010) [2023-12-28 07:26:09,016][106226] Updated weights for policy 0, policy_version 1694048 (0.0011) [2023-12-28 07:26:09,019][106225] Updated weights for policy 1, policy_version 1697941 (0.0010) [2023-12-28 07:26:09,071][106225] Updated weights for policy 1, policy_version 1697951 (0.0010) [2023-12-28 07:26:09,756][106226] Updated weights for policy 0, policy_version 1694058 (0.0010) [2023-12-28 07:26:09,811][106225] Updated weights for policy 1, policy_version 1697961 (0.0010) [2023-12-28 07:26:09,819][106226] Updated weights for policy 0, policy_version 1694068 (0.0011) [2023-12-28 07:26:09,878][106225] Updated weights for policy 1, policy_version 1697971 (0.0012) [2023-12-28 07:26:09,885][106226] Updated weights for policy 0, policy_version 1694078 (0.0009) [2023-12-28 07:26:09,943][106225] Updated weights for policy 1, policy_version 1697981 (0.0011) [2023-12-28 07:26:09,953][106226] Updated weights for policy 0, policy_version 1694088 (0.0008) [2023-12-28 07:26:09,997][106225] Updated weights for policy 1, policy_version 1697991 (0.0007) [2023-12-28 07:26:10,611][106225] Updated weights for policy 1, policy_version 1698001 (0.0007) [2023-12-28 07:26:10,655][106225] Updated weights for policy 1, policy_version 1698011 (0.0008) [2023-12-28 07:26:10,712][106225] Updated weights for policy 1, policy_version 1698021 (0.0007) [2023-12-28 07:26:10,738][106226] Updated weights for policy 0, policy_version 1694098 (0.0007) [2023-12-28 07:26:10,789][106226] Updated weights for policy 0, policy_version 1694108 (0.0009) [2023-12-28 07:26:10,851][106226] Updated weights for policy 0, policy_version 1694118 (0.0010) [2023-12-28 07:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 868524032. Throughput: 0: 10005.6, 1: 9919.1. Samples: 868494896. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-28 07:26:11,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.892')] [2023-12-28 07:26:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001698024_434749440.pth... [2023-12-28 07:26:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001694120_433774592.pth... [2023-12-28 07:26:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001692968_433479680.pth [2023-12-28 07:26:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001696872_434454528.pth [2023-12-28 07:26:11,362][106225] Updated weights for policy 1, policy_version 1698031 (0.0006) [2023-12-28 07:26:11,433][106225] Updated weights for policy 1, policy_version 1698041 (0.0007) [2023-12-28 07:26:11,484][106225] Updated weights for policy 1, policy_version 1698051 (0.0006) [2023-12-28 07:26:11,747][106226] Updated weights for policy 0, policy_version 1694128 (0.0009) [2023-12-28 07:26:11,812][106226] Updated weights for policy 0, policy_version 1694138 (0.0008) [2023-12-28 07:26:11,879][106226] Updated weights for policy 0, policy_version 1694148 (0.0008) [2023-12-28 07:26:12,138][106225] Updated weights for policy 1, policy_version 1698061 (0.0007) [2023-12-28 07:26:12,186][106225] Updated weights for policy 1, policy_version 1698071 (0.0008) [2023-12-28 07:26:12,248][106225] Updated weights for policy 1, policy_version 1698081 (0.0007) [2023-12-28 07:26:12,614][106226] Updated weights for policy 0, policy_version 1694158 (0.0009) [2023-12-28 07:26:12,675][106226] Updated weights for policy 0, policy_version 1694168 (0.0009) [2023-12-28 07:26:12,730][106226] Updated weights for policy 0, policy_version 1694178 (0.0008) [2023-12-28 07:26:13,002][106225] Updated weights for policy 1, policy_version 1698091 (0.0009) [2023-12-28 07:26:13,049][106225] Updated weights for policy 1, policy_version 1698101 (0.0005) [2023-12-28 07:26:13,102][106225] Updated weights for policy 1, policy_version 1698111 (0.0005) [2023-12-28 07:26:13,515][106226] Updated weights for policy 0, policy_version 1694188 (0.0009) [2023-12-28 07:26:13,565][106226] Updated weights for policy 0, policy_version 1694198 (0.0009) [2023-12-28 07:26:13,628][106226] Updated weights for policy 0, policy_version 1694208 (0.0007) [2023-12-28 07:26:13,685][106225] Updated weights for policy 1, policy_version 1698121 (0.0006) [2023-12-28 07:26:13,747][106225] Updated weights for policy 1, policy_version 1698131 (0.0007) [2023-12-28 07:26:13,805][106225] Updated weights for policy 1, policy_version 1698141 (0.0005) [2023-12-28 07:26:13,863][106225] Updated weights for policy 1, policy_version 1698151 (0.0005) [2023-12-28 07:26:14,286][106226] Updated weights for policy 0, policy_version 1694218 (0.0006) [2023-12-28 07:26:14,335][106226] Updated weights for policy 0, policy_version 1694228 (0.0010) [2023-12-28 07:26:14,388][106226] Updated weights for policy 0, policy_version 1694238 (0.0010) [2023-12-28 07:26:14,443][106226] Updated weights for policy 0, policy_version 1694248 (0.0010) [2023-12-28 07:26:14,520][106225] Updated weights for policy 1, policy_version 1698161 (0.0008) [2023-12-28 07:26:14,577][106225] Updated weights for policy 1, policy_version 1698171 (0.0006) [2023-12-28 07:26:14,637][106225] Updated weights for policy 1, policy_version 1698181 (0.0005) [2023-12-28 07:26:15,147][106226] Updated weights for policy 0, policy_version 1694258 (0.0011) [2023-12-28 07:26:15,212][106226] Updated weights for policy 0, policy_version 1694268 (0.0009) [2023-12-28 07:26:15,277][106226] Updated weights for policy 0, policy_version 1694278 (0.0011) [2023-12-28 07:26:15,333][106225] Updated weights for policy 1, policy_version 1698191 (0.0009) [2023-12-28 07:26:15,396][106225] Updated weights for policy 1, policy_version 1698201 (0.0010) [2023-12-28 07:26:15,464][106225] Updated weights for policy 1, policy_version 1698211 (0.0011) [2023-12-28 07:26:15,890][106226] Updated weights for policy 0, policy_version 1694288 (0.0009) [2023-12-28 07:26:15,943][106226] Updated weights for policy 0, policy_version 1694298 (0.0010) [2023-12-28 07:26:15,993][106226] Updated weights for policy 0, policy_version 1694308 (0.0010) [2023-12-28 07:26:16,065][106225] Updated weights for policy 1, policy_version 1698221 (0.0010) [2023-12-28 07:26:16,122][106225] Updated weights for policy 1, policy_version 1698231 (0.0008) [2023-12-28 07:26:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 868622336. Throughput: 0: 9879.5, 1: 9934.2. Samples: 868612144. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:16,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.710')] [2023-12-28 07:26:16,179][106225] Updated weights for policy 1, policy_version 1698241 (0.0010) [2023-12-28 07:26:16,680][106226] Updated weights for policy 0, policy_version 1694318 (0.0009) [2023-12-28 07:26:16,736][106226] Updated weights for policy 0, policy_version 1694328 (0.0009) [2023-12-28 07:26:16,784][106226] Updated weights for policy 0, policy_version 1694338 (0.0008) [2023-12-28 07:26:16,882][106225] Updated weights for policy 1, policy_version 1698251 (0.0008) [2023-12-28 07:26:16,941][106225] Updated weights for policy 1, policy_version 1698261 (0.0008) [2023-12-28 07:26:16,993][106225] Updated weights for policy 1, policy_version 1698271 (0.0008) [2023-12-28 07:26:17,543][106226] Updated weights for policy 0, policy_version 1694348 (0.0009) [2023-12-28 07:26:17,605][106226] Updated weights for policy 0, policy_version 1694358 (0.0009) [2023-12-28 07:26:17,652][106226] Updated weights for policy 0, policy_version 1694368 (0.0008) [2023-12-28 07:26:17,680][106225] Updated weights for policy 1, policy_version 1698281 (0.0009) [2023-12-28 07:26:17,743][106225] Updated weights for policy 1, policy_version 1698291 (0.0008) [2023-12-28 07:26:17,791][106225] Updated weights for policy 1, policy_version 1698301 (0.0008) [2023-12-28 07:26:17,840][106225] Updated weights for policy 1, policy_version 1698311 (0.0008) [2023-12-28 07:26:18,234][106226] Updated weights for policy 0, policy_version 1694378 (0.0008) [2023-12-28 07:26:18,291][106226] Updated weights for policy 0, policy_version 1694388 (0.0006) [2023-12-28 07:26:18,375][106226] Updated weights for policy 0, policy_version 1694398 (0.0008) [2023-12-28 07:26:18,436][106226] Updated weights for policy 0, policy_version 1694408 (0.0011) [2023-12-28 07:26:18,581][106225] Updated weights for policy 1, policy_version 1698321 (0.0008) [2023-12-28 07:26:18,644][106225] Updated weights for policy 1, policy_version 1698331 (0.0008) [2023-12-28 07:26:18,703][106225] Updated weights for policy 1, policy_version 1698341 (0.0008) [2023-12-28 07:26:19,093][106226] Updated weights for policy 0, policy_version 1694418 (0.0009) [2023-12-28 07:26:19,144][106226] Updated weights for policy 0, policy_version 1694428 (0.0011) [2023-12-28 07:26:19,198][106226] Updated weights for policy 0, policy_version 1694438 (0.0008) [2023-12-28 07:26:19,448][106225] Updated weights for policy 1, policy_version 1698351 (0.0007) [2023-12-28 07:26:19,510][106225] Updated weights for policy 1, policy_version 1698361 (0.0008) [2023-12-28 07:26:19,568][106225] Updated weights for policy 1, policy_version 1698371 (0.0009) [2023-12-28 07:26:20,006][106226] Updated weights for policy 0, policy_version 1694448 (0.0011) [2023-12-28 07:26:20,062][106226] Updated weights for policy 0, policy_version 1694458 (0.0011) [2023-12-28 07:26:20,136][106226] Updated weights for policy 0, policy_version 1694468 (0.0009) [2023-12-28 07:26:20,364][106225] Updated weights for policy 1, policy_version 1698381 (0.0007) [2023-12-28 07:26:20,428][106225] Updated weights for policy 1, policy_version 1698391 (0.0008) [2023-12-28 07:26:20,492][106225] Updated weights for policy 1, policy_version 1698401 (0.0008) [2023-12-28 07:26:20,926][106226] Updated weights for policy 0, policy_version 1694478 (0.0010) [2023-12-28 07:26:20,991][106226] Updated weights for policy 0, policy_version 1694488 (0.0009) [2023-12-28 07:26:21,066][106226] Updated weights for policy 0, policy_version 1694498 (0.0008) [2023-12-28 07:26:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 868720640. Throughput: 0: 9824.9, 1: 9955.6. Samples: 868729460. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:21,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-4.969')] [2023-12-28 07:26:21,221][106225] Updated weights for policy 1, policy_version 1698411 (0.0007) [2023-12-28 07:26:21,288][106225] Updated weights for policy 1, policy_version 1698421 (0.0009) [2023-12-28 07:26:21,360][106225] Updated weights for policy 1, policy_version 1698431 (0.0008) [2023-12-28 07:26:21,822][106226] Updated weights for policy 0, policy_version 1694508 (0.0007) [2023-12-28 07:26:21,883][106226] Updated weights for policy 0, policy_version 1694518 (0.0007) [2023-12-28 07:26:21,948][106226] Updated weights for policy 0, policy_version 1694528 (0.0007) [2023-12-28 07:26:22,067][106225] Updated weights for policy 1, policy_version 1698441 (0.0007) [2023-12-28 07:26:22,122][106225] Updated weights for policy 1, policy_version 1698451 (0.0007) [2023-12-28 07:26:22,178][106225] Updated weights for policy 1, policy_version 1698461 (0.0010) [2023-12-28 07:26:22,238][106225] Updated weights for policy 1, policy_version 1698471 (0.0010) [2023-12-28 07:26:22,624][106226] Updated weights for policy 0, policy_version 1694538 (0.0007) [2023-12-28 07:26:22,686][106226] Updated weights for policy 0, policy_version 1694548 (0.0006) [2023-12-28 07:26:22,741][106226] Updated weights for policy 0, policy_version 1694558 (0.0007) [2023-12-28 07:26:22,799][106226] Updated weights for policy 0, policy_version 1694568 (0.0008) [2023-12-28 07:26:23,004][106225] Updated weights for policy 1, policy_version 1698481 (0.0010) [2023-12-28 07:26:23,062][106225] Updated weights for policy 1, policy_version 1698491 (0.0010) [2023-12-28 07:26:23,122][106225] Updated weights for policy 1, policy_version 1698501 (0.0010) [2023-12-28 07:26:23,486][106226] Updated weights for policy 0, policy_version 1694578 (0.0009) [2023-12-28 07:26:23,544][106226] Updated weights for policy 0, policy_version 1694588 (0.0008) [2023-12-28 07:26:23,603][106226] Updated weights for policy 0, policy_version 1694598 (0.0009) [2023-12-28 07:26:23,820][106225] Updated weights for policy 1, policy_version 1698511 (0.0009) [2023-12-28 07:26:23,870][106225] Updated weights for policy 1, policy_version 1698521 (0.0007) [2023-12-28 07:26:23,930][106225] Updated weights for policy 1, policy_version 1698531 (0.0008) [2023-12-28 07:26:24,296][106226] Updated weights for policy 0, policy_version 1694608 (0.0010) [2023-12-28 07:26:24,356][106226] Updated weights for policy 0, policy_version 1694618 (0.0011) [2023-12-28 07:26:24,414][106226] Updated weights for policy 0, policy_version 1694628 (0.0011) [2023-12-28 07:26:24,642][106225] Updated weights for policy 1, policy_version 1698541 (0.0007) [2023-12-28 07:26:24,709][106225] Updated weights for policy 1, policy_version 1698551 (0.0006) [2023-12-28 07:26:24,755][106225] Updated weights for policy 1, policy_version 1698561 (0.0005) [2023-12-28 07:26:25,081][106226] Updated weights for policy 0, policy_version 1694638 (0.0009) [2023-12-28 07:26:25,131][106226] Updated weights for policy 0, policy_version 1694648 (0.0010) [2023-12-28 07:26:25,184][106226] Updated weights for policy 0, policy_version 1694658 (0.0010) [2023-12-28 07:26:25,349][106225] Updated weights for policy 1, policy_version 1698571 (0.0006) [2023-12-28 07:26:25,400][106225] Updated weights for policy 1, policy_version 1698581 (0.0005) [2023-12-28 07:26:25,451][106225] Updated weights for policy 1, policy_version 1698591 (0.0005) [2023-12-28 07:26:25,904][106226] Updated weights for policy 0, policy_version 1694668 (0.0009) [2023-12-28 07:26:25,953][106226] Updated weights for policy 0, policy_version 1694678 (0.0010) [2023-12-28 07:26:26,003][106226] Updated weights for policy 0, policy_version 1694688 (0.0010) [2023-12-28 07:26:26,052][106225] Updated weights for policy 1, policy_version 1698601 (0.0006) [2023-12-28 07:26:26,115][106225] Updated weights for policy 1, policy_version 1698611 (0.0010) [2023-12-28 07:26:26,162][106225] Updated weights for policy 1, policy_version 1698621 (0.0010) [2023-12-28 07:26:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 868818944. Throughput: 0: 9809.7, 1: 9944.7. Samples: 868786964. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:26,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.109')] [2023-12-28 07:26:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001694696_433922048.pth... [2023-12-28 07:26:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001693544_433627136.pth [2023-12-28 07:26:26,215][106225] Updated weights for policy 1, policy_version 1698631 (0.0010) [2023-12-28 07:26:26,219][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001698632_434905088.pth... [2023-12-28 07:26:26,222][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001697448_434601984.pth [2023-12-28 07:26:26,692][106226] Updated weights for policy 0, policy_version 1694698 (0.0010) [2023-12-28 07:26:26,744][106226] Updated weights for policy 0, policy_version 1694708 (0.0010) [2023-12-28 07:26:26,796][106226] Updated weights for policy 0, policy_version 1694718 (0.0010) [2023-12-28 07:26:26,851][106226] Updated weights for policy 0, policy_version 1694728 (0.0010) [2023-12-28 07:26:26,901][106225] Updated weights for policy 1, policy_version 1698641 (0.0010) [2023-12-28 07:26:26,952][106225] Updated weights for policy 1, policy_version 1698651 (0.0010) [2023-12-28 07:26:27,005][106225] Updated weights for policy 1, policy_version 1698661 (0.0010) [2023-12-28 07:26:27,540][106226] Updated weights for policy 0, policy_version 1694738 (0.0008) [2023-12-28 07:26:27,592][106226] Updated weights for policy 0, policy_version 1694748 (0.0010) [2023-12-28 07:26:27,645][106226] Updated weights for policy 0, policy_version 1694758 (0.0010) [2023-12-28 07:26:27,672][106225] Updated weights for policy 1, policy_version 1698671 (0.0010) [2023-12-28 07:26:27,718][106225] Updated weights for policy 1, policy_version 1698681 (0.0010) [2023-12-28 07:26:27,767][106225] Updated weights for policy 1, policy_version 1698691 (0.0010) [2023-12-28 07:26:28,368][106226] Updated weights for policy 0, policy_version 1694768 (0.0011) [2023-12-28 07:26:28,428][106226] Updated weights for policy 0, policy_version 1694778 (0.0011) [2023-12-28 07:26:28,491][106226] Updated weights for policy 0, policy_version 1694788 (0.0010) [2023-12-28 07:26:28,504][106225] Updated weights for policy 1, policy_version 1698701 (0.0010) [2023-12-28 07:26:28,566][106225] Updated weights for policy 1, policy_version 1698711 (0.0010) [2023-12-28 07:26:28,626][106225] Updated weights for policy 1, policy_version 1698721 (0.0010) [2023-12-28 07:26:29,163][106226] Updated weights for policy 0, policy_version 1694798 (0.0010) [2023-12-28 07:26:29,221][106226] Updated weights for policy 0, policy_version 1694808 (0.0010) [2023-12-28 07:26:29,285][106226] Updated weights for policy 0, policy_version 1694818 (0.0009) [2023-12-28 07:26:29,350][106225] Updated weights for policy 1, policy_version 1698731 (0.0010) [2023-12-28 07:26:29,415][106225] Updated weights for policy 1, policy_version 1698741 (0.0007) [2023-12-28 07:26:29,475][106225] Updated weights for policy 1, policy_version 1698751 (0.0007) [2023-12-28 07:26:30,026][106226] Updated weights for policy 0, policy_version 1694828 (0.0008) [2023-12-28 07:26:30,095][106226] Updated weights for policy 0, policy_version 1694838 (0.0006) [2023-12-28 07:26:30,145][106226] Updated weights for policy 0, policy_version 1694848 (0.0006) [2023-12-28 07:26:30,167][106225] Updated weights for policy 1, policy_version 1698761 (0.0008) [2023-12-28 07:26:30,222][106225] Updated weights for policy 1, policy_version 1698771 (0.0010) [2023-12-28 07:26:30,286][106225] Updated weights for policy 1, policy_version 1698781 (0.0010) [2023-12-28 07:26:30,353][106225] Updated weights for policy 1, policy_version 1698791 (0.0010) [2023-12-28 07:26:30,789][106226] Updated weights for policy 0, policy_version 1694858 (0.0006) [2023-12-28 07:26:30,837][106226] Updated weights for policy 0, policy_version 1694868 (0.0008) [2023-12-28 07:26:30,892][106226] Updated weights for policy 0, policy_version 1694878 (0.0009) [2023-12-28 07:26:30,941][106226] Updated weights for policy 0, policy_version 1694888 (0.0009) [2023-12-28 07:26:31,008][106225] Updated weights for policy 1, policy_version 1698801 (0.0006) [2023-12-28 07:26:31,069][106225] Updated weights for policy 1, policy_version 1698811 (0.0006) [2023-12-28 07:26:31,142][106225] Updated weights for policy 1, policy_version 1698821 (0.0007) [2023-12-28 07:26:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 868925440. Throughput: 0: 9919.1, 1: 9997.1. Samples: 868909460. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:31,175][105115] Avg episode reward: [(0, '-4.536'), (1, '-4.605')] [2023-12-28 07:26:31,693][106226] Updated weights for policy 0, policy_version 1694898 (0.0006) [2023-12-28 07:26:31,765][106226] Updated weights for policy 0, policy_version 1694908 (0.0008) [2023-12-28 07:26:31,830][106225] Updated weights for policy 1, policy_version 1698831 (0.0006) [2023-12-28 07:26:31,831][106226] Updated weights for policy 0, policy_version 1694918 (0.0008) [2023-12-28 07:26:31,892][106225] Updated weights for policy 1, policy_version 1698841 (0.0005) [2023-12-28 07:26:31,949][106225] Updated weights for policy 1, policy_version 1698851 (0.0005) [2023-12-28 07:26:32,605][106225] Updated weights for policy 1, policy_version 1698861 (0.0007) [2023-12-28 07:26:32,606][106226] Updated weights for policy 0, policy_version 1694928 (0.0006) [2023-12-28 07:26:32,659][106225] Updated weights for policy 1, policy_version 1698871 (0.0008) [2023-12-28 07:26:32,663][106226] Updated weights for policy 0, policy_version 1694938 (0.0005) [2023-12-28 07:26:32,710][106225] Updated weights for policy 1, policy_version 1698881 (0.0006) [2023-12-28 07:26:32,725][106226] Updated weights for policy 0, policy_version 1694948 (0.0006) [2023-12-28 07:26:33,274][106226] Updated weights for policy 0, policy_version 1694958 (0.0007) [2023-12-28 07:26:33,330][106226] Updated weights for policy 0, policy_version 1694968 (0.0008) [2023-12-28 07:26:33,387][106226] Updated weights for policy 0, policy_version 1694978 (0.0007) [2023-12-28 07:26:33,455][106225] Updated weights for policy 1, policy_version 1698891 (0.0008) [2023-12-28 07:26:33,504][106225] Updated weights for policy 1, policy_version 1698901 (0.0005) [2023-12-28 07:26:33,560][106225] Updated weights for policy 1, policy_version 1698911 (0.0005) [2023-12-28 07:26:33,997][106226] Updated weights for policy 0, policy_version 1694988 (0.0010) [2023-12-28 07:26:34,046][106226] Updated weights for policy 0, policy_version 1694998 (0.0010) [2023-12-28 07:26:34,101][106226] Updated weights for policy 0, policy_version 1695008 (0.0007) [2023-12-28 07:26:34,212][106225] Updated weights for policy 1, policy_version 1698921 (0.0009) [2023-12-28 07:26:34,275][106225] Updated weights for policy 1, policy_version 1698931 (0.0009) [2023-12-28 07:26:34,339][106225] Updated weights for policy 1, policy_version 1698941 (0.0010) [2023-12-28 07:26:34,404][106225] Updated weights for policy 1, policy_version 1698951 (0.0008) [2023-12-28 07:26:34,780][106226] Updated weights for policy 0, policy_version 1695018 (0.0008) [2023-12-28 07:26:34,838][106226] Updated weights for policy 0, policy_version 1695028 (0.0007) [2023-12-28 07:26:34,893][106226] Updated weights for policy 0, policy_version 1695038 (0.0008) [2023-12-28 07:26:34,949][106226] Updated weights for policy 0, policy_version 1695048 (0.0008) [2023-12-28 07:26:35,113][106225] Updated weights for policy 1, policy_version 1698961 (0.0010) [2023-12-28 07:26:35,157][106225] Updated weights for policy 1, policy_version 1698971 (0.0010) [2023-12-28 07:26:35,214][106225] Updated weights for policy 1, policy_version 1698981 (0.0010) [2023-12-28 07:26:35,586][106226] Updated weights for policy 0, policy_version 1695058 (0.0005) [2023-12-28 07:26:35,640][106226] Updated weights for policy 0, policy_version 1695068 (0.0006) [2023-12-28 07:26:35,704][106226] Updated weights for policy 0, policy_version 1695078 (0.0011) [2023-12-28 07:26:35,847][106225] Updated weights for policy 1, policy_version 1698991 (0.0007) [2023-12-28 07:26:35,906][106225] Updated weights for policy 1, policy_version 1699001 (0.0005) [2023-12-28 07:26:35,970][106225] Updated weights for policy 1, policy_version 1699011 (0.0005) [2023-12-28 07:26:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 869023744. Throughput: 0: 9937.4, 1: 9988.3. Samples: 869032532. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:36,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.763')] [2023-12-28 07:26:36,432][106226] Updated weights for policy 0, policy_version 1695088 (0.0009) [2023-12-28 07:26:36,500][106226] Updated weights for policy 0, policy_version 1695098 (0.0009) [2023-12-28 07:26:36,564][106226] Updated weights for policy 0, policy_version 1695108 (0.0009) [2023-12-28 07:26:36,597][106225] Updated weights for policy 1, policy_version 1699021 (0.0006) [2023-12-28 07:26:36,657][106225] Updated weights for policy 1, policy_version 1699031 (0.0009) [2023-12-28 07:26:36,715][106225] Updated weights for policy 1, policy_version 1699041 (0.0008) [2023-12-28 07:26:37,293][106225] Updated weights for policy 1, policy_version 1699051 (0.0008) [2023-12-28 07:26:37,344][106225] Updated weights for policy 1, policy_version 1699061 (0.0006) [2023-12-28 07:26:37,365][106226] Updated weights for policy 0, policy_version 1695118 (0.0006) [2023-12-28 07:26:37,407][106225] Updated weights for policy 1, policy_version 1699071 (0.0006) [2023-12-28 07:26:37,420][106226] Updated weights for policy 0, policy_version 1695128 (0.0008) [2023-12-28 07:26:37,467][106226] Updated weights for policy 0, policy_version 1695138 (0.0009) [2023-12-28 07:26:38,006][106225] Updated weights for policy 1, policy_version 1699081 (0.0008) [2023-12-28 07:26:38,062][106225] Updated weights for policy 1, policy_version 1699091 (0.0005) [2023-12-28 07:26:38,118][106225] Updated weights for policy 1, policy_version 1699101 (0.0005) [2023-12-28 07:26:38,147][106226] Updated weights for policy 0, policy_version 1695148 (0.0008) [2023-12-28 07:26:38,174][106225] Updated weights for policy 1, policy_version 1699111 (0.0006) [2023-12-28 07:26:38,194][106226] Updated weights for policy 0, policy_version 1695158 (0.0010) [2023-12-28 07:26:38,240][106226] Updated weights for policy 0, policy_version 1695168 (0.0010) [2023-12-28 07:26:38,747][106225] Updated weights for policy 1, policy_version 1699121 (0.0005) [2023-12-28 07:26:38,796][106225] Updated weights for policy 1, policy_version 1699131 (0.0005) [2023-12-28 07:26:38,847][106225] Updated weights for policy 1, policy_version 1699141 (0.0006) [2023-12-28 07:26:38,999][106226] Updated weights for policy 0, policy_version 1695178 (0.0010) [2023-12-28 07:26:39,057][106226] Updated weights for policy 0, policy_version 1695188 (0.0009) [2023-12-28 07:26:39,118][106226] Updated weights for policy 0, policy_version 1695198 (0.0005) [2023-12-28 07:26:39,181][106226] Updated weights for policy 0, policy_version 1695208 (0.0005) [2023-12-28 07:26:39,538][106225] Updated weights for policy 1, policy_version 1699151 (0.0009) [2023-12-28 07:26:39,596][106225] Updated weights for policy 1, policy_version 1699161 (0.0010) [2023-12-28 07:26:39,653][106225] Updated weights for policy 1, policy_version 1699171 (0.0010) [2023-12-28 07:26:39,874][106226] Updated weights for policy 0, policy_version 1695218 (0.0011) [2023-12-28 07:26:39,948][106226] Updated weights for policy 0, policy_version 1695228 (0.0011) [2023-12-28 07:26:40,019][106226] Updated weights for policy 0, policy_version 1695238 (0.0011) [2023-12-28 07:26:40,373][106225] Updated weights for policy 1, policy_version 1699181 (0.0009) [2023-12-28 07:26:40,437][106225] Updated weights for policy 1, policy_version 1699191 (0.0008) [2023-12-28 07:26:40,505][106225] Updated weights for policy 1, policy_version 1699201 (0.0007) [2023-12-28 07:26:40,745][106226] Updated weights for policy 0, policy_version 1695248 (0.0011) [2023-12-28 07:26:40,802][106226] Updated weights for policy 0, policy_version 1695258 (0.0010) [2023-12-28 07:26:40,853][106226] Updated weights for policy 0, policy_version 1695268 (0.0010) [2023-12-28 07:26:41,146][106225] Updated weights for policy 1, policy_version 1699211 (0.0008) [2023-12-28 07:26:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 869122048. Throughput: 0: 9908.4, 1: 10109.4. Samples: 869094592. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:41,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-4.725')] [2023-12-28 07:26:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001695272_434069504.pth... [2023-12-28 07:26:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001694120_433774592.pth [2023-12-28 07:26:41,214][106225] Updated weights for policy 1, policy_version 1699221 (0.0008) [2023-12-28 07:26:41,276][106225] Updated weights for policy 1, policy_version 1699231 (0.0008) [2023-12-28 07:26:41,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001699240_435060736.pth... [2023-12-28 07:26:41,337][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001698024_434749440.pth [2023-12-28 07:26:41,624][106226] Updated weights for policy 0, policy_version 1695278 (0.0010) [2023-12-28 07:26:41,698][106226] Updated weights for policy 0, policy_version 1695288 (0.0009) [2023-12-28 07:26:41,764][106226] Updated weights for policy 0, policy_version 1695298 (0.0009) [2023-12-28 07:26:42,044][106225] Updated weights for policy 1, policy_version 1699241 (0.0008) [2023-12-28 07:26:42,093][106225] Updated weights for policy 1, policy_version 1699251 (0.0008) [2023-12-28 07:26:42,156][106225] Updated weights for policy 1, policy_version 1699261 (0.0009) [2023-12-28 07:26:42,222][106225] Updated weights for policy 1, policy_version 1699271 (0.0009) [2023-12-28 07:26:42,508][106226] Updated weights for policy 0, policy_version 1695308 (0.0008) [2023-12-28 07:26:42,569][106226] Updated weights for policy 0, policy_version 1695318 (0.0006) [2023-12-28 07:26:42,631][106226] Updated weights for policy 0, policy_version 1695328 (0.0008) [2023-12-28 07:26:42,910][106225] Updated weights for policy 1, policy_version 1699281 (0.0005) [2023-12-28 07:26:42,966][106225] Updated weights for policy 1, policy_version 1699291 (0.0008) [2023-12-28 07:26:43,019][106225] Updated weights for policy 1, policy_version 1699301 (0.0007) [2023-12-28 07:26:43,327][106226] Updated weights for policy 0, policy_version 1695338 (0.0011) [2023-12-28 07:26:43,395][106226] Updated weights for policy 0, policy_version 1695348 (0.0010) [2023-12-28 07:26:43,456][106226] Updated weights for policy 0, policy_version 1695358 (0.0010) [2023-12-28 07:26:43,518][106226] Updated weights for policy 0, policy_version 1695368 (0.0010) [2023-12-28 07:26:43,633][106225] Updated weights for policy 1, policy_version 1699311 (0.0008) [2023-12-28 07:26:43,690][106225] Updated weights for policy 1, policy_version 1699321 (0.0008) [2023-12-28 07:26:43,750][106225] Updated weights for policy 1, policy_version 1699331 (0.0008) [2023-12-28 07:26:44,167][106226] Updated weights for policy 0, policy_version 1695378 (0.0010) [2023-12-28 07:26:44,213][106226] Updated weights for policy 0, policy_version 1695388 (0.0010) [2023-12-28 07:26:44,273][106226] Updated weights for policy 0, policy_version 1695398 (0.0010) [2023-12-28 07:26:44,403][106225] Updated weights for policy 1, policy_version 1699341 (0.0006) [2023-12-28 07:26:44,459][106225] Updated weights for policy 1, policy_version 1699351 (0.0009) [2023-12-28 07:26:44,509][106225] Updated weights for policy 1, policy_version 1699361 (0.0008) [2023-12-28 07:26:44,937][106226] Updated weights for policy 0, policy_version 1695408 (0.0008) [2023-12-28 07:26:45,005][106226] Updated weights for policy 0, policy_version 1695418 (0.0011) [2023-12-28 07:26:45,073][106226] Updated weights for policy 0, policy_version 1695428 (0.0010) [2023-12-28 07:26:45,261][106225] Updated weights for policy 1, policy_version 1699371 (0.0008) [2023-12-28 07:26:45,327][106225] Updated weights for policy 1, policy_version 1699381 (0.0008) [2023-12-28 07:26:45,392][106225] Updated weights for policy 1, policy_version 1699391 (0.0008) [2023-12-28 07:26:45,732][106226] Updated weights for policy 0, policy_version 1695438 (0.0010) [2023-12-28 07:26:45,794][106226] Updated weights for policy 0, policy_version 1695448 (0.0010) [2023-12-28 07:26:45,855][106226] Updated weights for policy 0, policy_version 1695458 (0.0009) [2023-12-28 07:26:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 869220352. Throughput: 0: 9837.8, 1: 10104.6. Samples: 869213036. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:46,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-4.888')] [2023-12-28 07:26:46,183][106225] Updated weights for policy 1, policy_version 1699401 (0.0008) [2023-12-28 07:26:46,238][106225] Updated weights for policy 1, policy_version 1699411 (0.0008) [2023-12-28 07:26:46,298][106225] Updated weights for policy 1, policy_version 1699421 (0.0008) [2023-12-28 07:26:46,353][106225] Updated weights for policy 1, policy_version 1699431 (0.0009) [2023-12-28 07:26:46,410][106226] Updated weights for policy 0, policy_version 1695468 (0.0005) [2023-12-28 07:26:46,462][106226] Updated weights for policy 0, policy_version 1695478 (0.0009) [2023-12-28 07:26:46,511][106226] Updated weights for policy 0, policy_version 1695488 (0.0010) [2023-12-28 07:26:47,092][106226] Updated weights for policy 0, policy_version 1695498 (0.0010) [2023-12-28 07:26:47,152][106226] Updated weights for policy 0, policy_version 1695508 (0.0010) [2023-12-28 07:26:47,158][106225] Updated weights for policy 1, policy_version 1699441 (0.0008) [2023-12-28 07:26:47,215][106226] Updated weights for policy 0, policy_version 1695518 (0.0008) [2023-12-28 07:26:47,216][106225] Updated weights for policy 1, policy_version 1699451 (0.0008) [2023-12-28 07:26:47,263][106226] Updated weights for policy 0, policy_version 1695528 (0.0005) [2023-12-28 07:26:47,269][106225] Updated weights for policy 1, policy_version 1699461 (0.0009) [2023-12-28 07:26:47,874][106226] Updated weights for policy 0, policy_version 1695538 (0.0010) [2023-12-28 07:26:47,936][106226] Updated weights for policy 0, policy_version 1695548 (0.0010) [2023-12-28 07:26:47,999][106226] Updated weights for policy 0, policy_version 1695558 (0.0010) [2023-12-28 07:26:48,016][106225] Updated weights for policy 1, policy_version 1699471 (0.0006) [2023-12-28 07:26:48,066][106225] Updated weights for policy 1, policy_version 1699481 (0.0008) [2023-12-28 07:26:48,119][106225] Updated weights for policy 1, policy_version 1699491 (0.0007) [2023-12-28 07:26:48,633][106226] Updated weights for policy 0, policy_version 1695568 (0.0007) [2023-12-28 07:26:48,694][106226] Updated weights for policy 0, policy_version 1695578 (0.0011) [2023-12-28 07:26:48,752][106226] Updated weights for policy 0, policy_version 1695588 (0.0009) [2023-12-28 07:26:48,955][106225] Updated weights for policy 1, policy_version 1699501 (0.0009) [2023-12-28 07:26:49,006][106225] Updated weights for policy 1, policy_version 1699511 (0.0008) [2023-12-28 07:26:49,071][106225] Updated weights for policy 1, policy_version 1699521 (0.0008) [2023-12-28 07:26:49,331][106226] Updated weights for policy 0, policy_version 1695598 (0.0009) [2023-12-28 07:26:49,397][106226] Updated weights for policy 0, policy_version 1695608 (0.0009) [2023-12-28 07:26:49,443][106226] Updated weights for policy 0, policy_version 1695618 (0.0010) [2023-12-28 07:26:49,901][106225] Updated weights for policy 1, policy_version 1699531 (0.0009) [2023-12-28 07:26:49,977][106225] Updated weights for policy 1, policy_version 1699541 (0.0007) [2023-12-28 07:26:50,042][106225] Updated weights for policy 1, policy_version 1699551 (0.0008) [2023-12-28 07:26:50,209][106226] Updated weights for policy 0, policy_version 1695628 (0.0010) [2023-12-28 07:26:50,271][106226] Updated weights for policy 0, policy_version 1695638 (0.0011) [2023-12-28 07:26:50,332][106226] Updated weights for policy 0, policy_version 1695648 (0.0010) [2023-12-28 07:26:50,747][106225] Updated weights for policy 1, policy_version 1699561 (0.0007) [2023-12-28 07:26:50,814][106225] Updated weights for policy 1, policy_version 1699571 (0.0007) [2023-12-28 07:26:50,880][106225] Updated weights for policy 1, policy_version 1699581 (0.0008) [2023-12-28 07:26:50,937][106225] Updated weights for policy 1, policy_version 1699591 (0.0008) [2023-12-28 07:26:51,032][106226] Updated weights for policy 0, policy_version 1695658 (0.0008) [2023-12-28 07:26:51,101][106226] Updated weights for policy 0, policy_version 1695668 (0.0007) [2023-12-28 07:26:51,162][106226] Updated weights for policy 0, policy_version 1695678 (0.0007) [2023-12-28 07:26:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 869318656. Throughput: 0: 9944.7, 1: 10020.5. Samples: 869331544. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:51,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.797')] [2023-12-28 07:26:51,212][106226] Updated weights for policy 0, policy_version 1695688 (0.0005) [2023-12-28 07:26:51,714][106225] Updated weights for policy 1, policy_version 1699601 (0.0006) [2023-12-28 07:26:51,780][106225] Updated weights for policy 1, policy_version 1699611 (0.0007) [2023-12-28 07:26:51,842][106225] Updated weights for policy 1, policy_version 1699621 (0.0008) [2023-12-28 07:26:51,924][106226] Updated weights for policy 0, policy_version 1695698 (0.0011) [2023-12-28 07:26:51,988][106226] Updated weights for policy 0, policy_version 1695708 (0.0011) [2023-12-28 07:26:52,047][106226] Updated weights for policy 0, policy_version 1695718 (0.0010) [2023-12-28 07:26:52,490][106225] Updated weights for policy 1, policy_version 1699631 (0.0008) [2023-12-28 07:26:52,542][106225] Updated weights for policy 1, policy_version 1699641 (0.0008) [2023-12-28 07:26:52,590][106225] Updated weights for policy 1, policy_version 1699651 (0.0008) [2023-12-28 07:26:52,793][106226] Updated weights for policy 0, policy_version 1695728 (0.0008) [2023-12-28 07:26:52,845][106226] Updated weights for policy 0, policy_version 1695738 (0.0008) [2023-12-28 07:26:52,903][106226] Updated weights for policy 0, policy_version 1695748 (0.0010) [2023-12-28 07:26:53,326][106225] Updated weights for policy 1, policy_version 1699661 (0.0008) [2023-12-28 07:26:53,370][106225] Updated weights for policy 1, policy_version 1699671 (0.0008) [2023-12-28 07:26:53,428][106225] Updated weights for policy 1, policy_version 1699681 (0.0007) [2023-12-28 07:26:53,633][106226] Updated weights for policy 0, policy_version 1695758 (0.0008) [2023-12-28 07:26:53,695][106226] Updated weights for policy 0, policy_version 1695768 (0.0008) [2023-12-28 07:26:53,752][106226] Updated weights for policy 0, policy_version 1695778 (0.0008) [2023-12-28 07:26:54,133][106225] Updated weights for policy 1, policy_version 1699691 (0.0008) [2023-12-28 07:26:54,190][106225] Updated weights for policy 1, policy_version 1699701 (0.0008) [2023-12-28 07:26:54,249][106225] Updated weights for policy 1, policy_version 1699711 (0.0008) [2023-12-28 07:26:54,460][106226] Updated weights for policy 0, policy_version 1695788 (0.0008) [2023-12-28 07:26:54,514][106226] Updated weights for policy 0, policy_version 1695798 (0.0010) [2023-12-28 07:26:54,580][106226] Updated weights for policy 0, policy_version 1695808 (0.0011) [2023-12-28 07:26:55,018][106225] Updated weights for policy 1, policy_version 1699721 (0.0008) [2023-12-28 07:26:55,074][106225] Updated weights for policy 1, policy_version 1699731 (0.0007) [2023-12-28 07:26:55,136][106225] Updated weights for policy 1, policy_version 1699741 (0.0006) [2023-12-28 07:26:55,184][106225] Updated weights for policy 1, policy_version 1699751 (0.0008) [2023-12-28 07:26:55,196][106226] Updated weights for policy 0, policy_version 1695818 (0.0008) [2023-12-28 07:26:55,242][106226] Updated weights for policy 0, policy_version 1695828 (0.0010) [2023-12-28 07:26:55,289][106226] Updated weights for policy 0, policy_version 1695838 (0.0010) [2023-12-28 07:26:55,348][106226] Updated weights for policy 0, policy_version 1695848 (0.0010) [2023-12-28 07:26:55,834][106225] Updated weights for policy 1, policy_version 1699761 (0.0010) [2023-12-28 07:26:55,893][106225] Updated weights for policy 1, policy_version 1699771 (0.0010) [2023-12-28 07:26:55,948][106225] Updated weights for policy 1, policy_version 1699781 (0.0010) [2023-12-28 07:26:56,049][106226] Updated weights for policy 0, policy_version 1695858 (0.0006) [2023-12-28 07:26:56,095][106226] Updated weights for policy 0, policy_version 1695868 (0.0010) [2023-12-28 07:26:56,142][106226] Updated weights for policy 0, policy_version 1695878 (0.0010) [2023-12-28 07:26:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 869425152. Throughput: 0: 9887.3, 1: 9969.4. Samples: 869388448. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:26:56,176][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.664')] [2023-12-28 07:26:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001699784_435200000.pth... [2023-12-28 07:26:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001695880_434225152.pth... [2023-12-28 07:26:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001698632_434905088.pth [2023-12-28 07:26:56,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001694696_433922048.pth [2023-12-28 07:26:56,652][106225] Updated weights for policy 1, policy_version 1699791 (0.0010) [2023-12-28 07:26:56,697][106225] Updated weights for policy 1, policy_version 1699801 (0.0010) [2023-12-28 07:26:56,744][106225] Updated weights for policy 1, policy_version 1699811 (0.0009) [2023-12-28 07:26:56,856][106226] Updated weights for policy 0, policy_version 1695888 (0.0010) [2023-12-28 07:26:56,905][106226] Updated weights for policy 0, policy_version 1695898 (0.0010) [2023-12-28 07:26:56,951][106226] Updated weights for policy 0, policy_version 1695908 (0.0010) [2023-12-28 07:26:57,468][106225] Updated weights for policy 1, policy_version 1699821 (0.0010) [2023-12-28 07:26:57,514][106225] Updated weights for policy 1, policy_version 1699831 (0.0010) [2023-12-28 07:26:57,562][106226] Updated weights for policy 0, policy_version 1695918 (0.0010) [2023-12-28 07:26:57,570][106225] Updated weights for policy 1, policy_version 1699841 (0.0010) [2023-12-28 07:26:57,605][106226] Updated weights for policy 0, policy_version 1695928 (0.0010) [2023-12-28 07:26:57,654][106226] Updated weights for policy 0, policy_version 1695938 (0.0010) [2023-12-28 07:26:58,285][106225] Updated weights for policy 1, policy_version 1699851 (0.0009) [2023-12-28 07:26:58,346][106225] Updated weights for policy 1, policy_version 1699861 (0.0008) [2023-12-28 07:26:58,388][106226] Updated weights for policy 0, policy_version 1695948 (0.0009) [2023-12-28 07:26:58,409][106225] Updated weights for policy 1, policy_version 1699871 (0.0008) [2023-12-28 07:26:58,454][106226] Updated weights for policy 0, policy_version 1695958 (0.0008) [2023-12-28 07:26:58,522][106226] Updated weights for policy 0, policy_version 1695968 (0.0006) [2023-12-28 07:26:59,160][106225] Updated weights for policy 1, policy_version 1699881 (0.0009) [2023-12-28 07:26:59,225][106225] Updated weights for policy 1, policy_version 1699891 (0.0008) [2023-12-28 07:26:59,282][106226] Updated weights for policy 0, policy_version 1695978 (0.0010) [2023-12-28 07:26:59,294][106225] Updated weights for policy 1, policy_version 1699901 (0.0010) [2023-12-28 07:26:59,348][106226] Updated weights for policy 0, policy_version 1695988 (0.0010) [2023-12-28 07:26:59,354][106225] Updated weights for policy 1, policy_version 1699911 (0.0007) [2023-12-28 07:26:59,416][106226] Updated weights for policy 0, policy_version 1695998 (0.0011) [2023-12-28 07:26:59,476][106226] Updated weights for policy 0, policy_version 1696008 (0.0011) [2023-12-28 07:27:00,094][106225] Updated weights for policy 1, policy_version 1699921 (0.0007) [2023-12-28 07:27:00,163][106225] Updated weights for policy 1, policy_version 1699931 (0.0006) [2023-12-28 07:27:00,191][106226] Updated weights for policy 0, policy_version 1696018 (0.0008) [2023-12-28 07:27:00,227][106225] Updated weights for policy 1, policy_version 1699941 (0.0007) [2023-12-28 07:27:00,247][106226] Updated weights for policy 0, policy_version 1696028 (0.0007) [2023-12-28 07:27:00,305][106226] Updated weights for policy 0, policy_version 1696038 (0.0007) [2023-12-28 07:27:00,822][106225] Updated weights for policy 1, policy_version 1699951 (0.0006) [2023-12-28 07:27:00,874][106225] Updated weights for policy 1, policy_version 1699961 (0.0006) [2023-12-28 07:27:00,926][106225] Updated weights for policy 1, policy_version 1699971 (0.0008) [2023-12-28 07:27:00,977][106226] Updated weights for policy 0, policy_version 1696048 (0.0007) [2023-12-28 07:27:01,027][106226] Updated weights for policy 0, policy_version 1696058 (0.0007) [2023-12-28 07:27:01,089][106226] Updated weights for policy 0, policy_version 1696068 (0.0006) [2023-12-28 07:27:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 869523456. Throughput: 0: 10002.3, 1: 9892.6. Samples: 869507408. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:01,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.726')] [2023-12-28 07:27:01,604][106225] Updated weights for policy 1, policy_version 1699981 (0.0007) [2023-12-28 07:27:01,673][106225] Updated weights for policy 1, policy_version 1699991 (0.0007) [2023-12-28 07:27:01,736][106225] Updated weights for policy 1, policy_version 1700001 (0.0008) [2023-12-28 07:27:01,876][106226] Updated weights for policy 0, policy_version 1696078 (0.0006) [2023-12-28 07:27:01,946][106226] Updated weights for policy 0, policy_version 1696088 (0.0006) [2023-12-28 07:27:02,010][106226] Updated weights for policy 0, policy_version 1696098 (0.0008) [2023-12-28 07:27:02,544][106225] Updated weights for policy 1, policy_version 1700011 (0.0008) [2023-12-28 07:27:02,560][106226] Updated weights for policy 0, policy_version 1696108 (0.0005) [2023-12-28 07:27:02,604][106225] Updated weights for policy 1, policy_version 1700021 (0.0007) [2023-12-28 07:27:02,621][106226] Updated weights for policy 0, policy_version 1696118 (0.0005) [2023-12-28 07:27:02,662][106225] Updated weights for policy 1, policy_version 1700031 (0.0008) [2023-12-28 07:27:02,687][106226] Updated weights for policy 0, policy_version 1696128 (0.0005) [2023-12-28 07:27:03,303][106226] Updated weights for policy 0, policy_version 1696138 (0.0007) [2023-12-28 07:27:03,328][106225] Updated weights for policy 1, policy_version 1700041 (0.0008) [2023-12-28 07:27:03,363][106226] Updated weights for policy 0, policy_version 1696148 (0.0011) [2023-12-28 07:27:03,403][106225] Updated weights for policy 1, policy_version 1700051 (0.0005) [2023-12-28 07:27:03,424][106226] Updated weights for policy 0, policy_version 1696158 (0.0010) [2023-12-28 07:27:03,464][106225] Updated weights for policy 1, policy_version 1700061 (0.0005) [2023-12-28 07:27:03,481][106226] Updated weights for policy 0, policy_version 1696168 (0.0011) [2023-12-28 07:27:03,515][106225] Updated weights for policy 1, policy_version 1700071 (0.0007) [2023-12-28 07:27:04,108][106226] Updated weights for policy 0, policy_version 1696178 (0.0006) [2023-12-28 07:27:04,164][106226] Updated weights for policy 0, policy_version 1696188 (0.0006) [2023-12-28 07:27:04,221][106226] Updated weights for policy 0, policy_version 1696198 (0.0007) [2023-12-28 07:27:04,275][106225] Updated weights for policy 1, policy_version 1700081 (0.0008) [2023-12-28 07:27:04,335][106225] Updated weights for policy 1, policy_version 1700091 (0.0008) [2023-12-28 07:27:04,394][106225] Updated weights for policy 1, policy_version 1700101 (0.0008) [2023-12-28 07:27:04,822][106226] Updated weights for policy 0, policy_version 1696208 (0.0011) [2023-12-28 07:27:04,872][106226] Updated weights for policy 0, policy_version 1696218 (0.0010) [2023-12-28 07:27:04,928][106226] Updated weights for policy 0, policy_version 1696228 (0.0010) [2023-12-28 07:27:05,024][106225] Updated weights for policy 1, policy_version 1700111 (0.0010) [2023-12-28 07:27:05,081][106225] Updated weights for policy 1, policy_version 1700121 (0.0010) [2023-12-28 07:27:05,147][106225] Updated weights for policy 1, policy_version 1700131 (0.0010) [2023-12-28 07:27:05,491][106226] Updated weights for policy 0, policy_version 1696238 (0.0005) [2023-12-28 07:27:05,555][106226] Updated weights for policy 0, policy_version 1696248 (0.0006) [2023-12-28 07:27:05,613][106226] Updated weights for policy 0, policy_version 1696258 (0.0005) [2023-12-28 07:27:05,821][106225] Updated weights for policy 1, policy_version 1700141 (0.0008) [2023-12-28 07:27:05,878][106225] Updated weights for policy 1, policy_version 1700151 (0.0007) [2023-12-28 07:27:05,938][106225] Updated weights for policy 1, policy_version 1700161 (0.0009) [2023-12-28 07:27:06,142][106226] Updated weights for policy 0, policy_version 1696268 (0.0008) [2023-12-28 07:27:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 869621760. Throughput: 0: 10150.1, 1: 9917.4. Samples: 869632492. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:06,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.999')] [2023-12-28 07:27:06,203][106226] Updated weights for policy 0, policy_version 1696278 (0.0006) [2023-12-28 07:27:06,263][106226] Updated weights for policy 0, policy_version 1696288 (0.0006) [2023-12-28 07:27:06,620][106225] Updated weights for policy 1, policy_version 1700171 (0.0007) [2023-12-28 07:27:06,684][106225] Updated weights for policy 1, policy_version 1700181 (0.0008) [2023-12-28 07:27:06,749][106225] Updated weights for policy 1, policy_version 1700191 (0.0009) [2023-12-28 07:27:06,997][106226] Updated weights for policy 0, policy_version 1696298 (0.0007) [2023-12-28 07:27:07,053][106226] Updated weights for policy 0, policy_version 1696308 (0.0008) [2023-12-28 07:27:07,103][106226] Updated weights for policy 0, policy_version 1696318 (0.0009) [2023-12-28 07:27:07,161][106226] Updated weights for policy 0, policy_version 1696328 (0.0009) [2023-12-28 07:27:07,430][106225] Updated weights for policy 1, policy_version 1700201 (0.0008) [2023-12-28 07:27:07,487][106225] Updated weights for policy 1, policy_version 1700211 (0.0006) [2023-12-28 07:27:07,542][106225] Updated weights for policy 1, policy_version 1700221 (0.0005) [2023-12-28 07:27:07,600][106225] Updated weights for policy 1, policy_version 1700231 (0.0006) [2023-12-28 07:27:07,860][106226] Updated weights for policy 0, policy_version 1696338 (0.0005) [2023-12-28 07:27:07,905][106226] Updated weights for policy 0, policy_version 1696348 (0.0005) [2023-12-28 07:27:07,962][106226] Updated weights for policy 0, policy_version 1696358 (0.0006) [2023-12-28 07:27:08,242][106225] Updated weights for policy 1, policy_version 1700241 (0.0009) [2023-12-28 07:27:08,299][106225] Updated weights for policy 1, policy_version 1700251 (0.0006) [2023-12-28 07:27:08,367][106225] Updated weights for policy 1, policy_version 1700261 (0.0007) [2023-12-28 07:27:08,640][106226] Updated weights for policy 0, policy_version 1696368 (0.0011) [2023-12-28 07:27:08,706][106226] Updated weights for policy 0, policy_version 1696378 (0.0008) [2023-12-28 07:27:08,774][106226] Updated weights for policy 0, policy_version 1696388 (0.0007) [2023-12-28 07:27:09,059][106225] Updated weights for policy 1, policy_version 1700271 (0.0007) [2023-12-28 07:27:09,120][106225] Updated weights for policy 1, policy_version 1700281 (0.0007) [2023-12-28 07:27:09,174][106225] Updated weights for policy 1, policy_version 1700291 (0.0007) [2023-12-28 07:27:09,403][106226] Updated weights for policy 0, policy_version 1696398 (0.0010) [2023-12-28 07:27:09,459][106226] Updated weights for policy 0, policy_version 1696408 (0.0009) [2023-12-28 07:27:09,517][106226] Updated weights for policy 0, policy_version 1696418 (0.0010) [2023-12-28 07:27:09,872][106225] Updated weights for policy 1, policy_version 1700301 (0.0010) [2023-12-28 07:27:09,934][106225] Updated weights for policy 1, policy_version 1700311 (0.0011) [2023-12-28 07:27:09,996][106225] Updated weights for policy 1, policy_version 1700321 (0.0007) [2023-12-28 07:27:10,293][106226] Updated weights for policy 0, policy_version 1696428 (0.0011) [2023-12-28 07:27:10,348][106226] Updated weights for policy 0, policy_version 1696438 (0.0011) [2023-12-28 07:27:10,405][106226] Updated weights for policy 0, policy_version 1696448 (0.0009) [2023-12-28 07:27:10,667][106225] Updated weights for policy 1, policy_version 1700331 (0.0007) [2023-12-28 07:27:10,721][106225] Updated weights for policy 1, policy_version 1700341 (0.0005) [2023-12-28 07:27:10,768][106225] Updated weights for policy 1, policy_version 1700351 (0.0008) [2023-12-28 07:27:11,138][106226] Updated weights for policy 0, policy_version 1696458 (0.0010) [2023-12-28 07:27:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 869720064. Throughput: 0: 10178.9, 1: 9963.1. Samples: 869693356. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:11,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.851')] [2023-12-28 07:27:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001700360_435347456.pth... [2023-12-28 07:27:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001699240_435060736.pth [2023-12-28 07:27:11,206][106226] Updated weights for policy 0, policy_version 1696468 (0.0008) [2023-12-28 07:27:11,272][106226] Updated weights for policy 0, policy_version 1696478 (0.0009) [2023-12-28 07:27:11,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001696488_434380800.pth... [2023-12-28 07:27:11,330][106226] Updated weights for policy 0, policy_version 1696488 (0.0008) [2023-12-28 07:27:11,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001695272_434069504.pth [2023-12-28 07:27:11,555][106225] Updated weights for policy 1, policy_version 1700361 (0.0010) [2023-12-28 07:27:11,621][106225] Updated weights for policy 1, policy_version 1700371 (0.0008) [2023-12-28 07:27:11,689][106225] Updated weights for policy 1, policy_version 1700381 (0.0009) [2023-12-28 07:27:11,759][106225] Updated weights for policy 1, policy_version 1700391 (0.0008) [2023-12-28 07:27:12,135][106226] Updated weights for policy 0, policy_version 1696498 (0.0009) [2023-12-28 07:27:12,194][106226] Updated weights for policy 0, policy_version 1696508 (0.0009) [2023-12-28 07:27:12,255][106226] Updated weights for policy 0, policy_version 1696518 (0.0007) [2023-12-28 07:27:12,484][106225] Updated weights for policy 1, policy_version 1700401 (0.0008) [2023-12-28 07:27:12,549][106225] Updated weights for policy 1, policy_version 1700411 (0.0008) [2023-12-28 07:27:12,617][106225] Updated weights for policy 1, policy_version 1700421 (0.0009) [2023-12-28 07:27:13,032][106226] Updated weights for policy 0, policy_version 1696528 (0.0009) [2023-12-28 07:27:13,087][106226] Updated weights for policy 0, policy_version 1696538 (0.0009) [2023-12-28 07:27:13,146][106226] Updated weights for policy 0, policy_version 1696548 (0.0007) [2023-12-28 07:27:13,199][106225] Updated weights for policy 1, policy_version 1700431 (0.0006) [2023-12-28 07:27:13,265][106225] Updated weights for policy 1, policy_version 1700441 (0.0006) [2023-12-28 07:27:13,324][106225] Updated weights for policy 1, policy_version 1700451 (0.0005) [2023-12-28 07:27:13,901][106225] Updated weights for policy 1, policy_version 1700461 (0.0007) [2023-12-28 07:27:13,914][106226] Updated weights for policy 0, policy_version 1696558 (0.0008) [2023-12-28 07:27:13,949][106225] Updated weights for policy 1, policy_version 1700471 (0.0006) [2023-12-28 07:27:13,968][106226] Updated weights for policy 0, policy_version 1696568 (0.0008) [2023-12-28 07:27:13,998][106225] Updated weights for policy 1, policy_version 1700481 (0.0008) [2023-12-28 07:27:14,026][106226] Updated weights for policy 0, policy_version 1696578 (0.0008) [2023-12-28 07:27:14,671][106225] Updated weights for policy 1, policy_version 1700491 (0.0008) [2023-12-28 07:27:14,728][106225] Updated weights for policy 1, policy_version 1700501 (0.0008) [2023-12-28 07:27:14,789][106226] Updated weights for policy 0, policy_version 1696588 (0.0008) [2023-12-28 07:27:14,792][106225] Updated weights for policy 1, policy_version 1700511 (0.0007) [2023-12-28 07:27:14,858][106226] Updated weights for policy 0, policy_version 1696598 (0.0005) [2023-12-28 07:27:14,924][106226] Updated weights for policy 0, policy_version 1696608 (0.0008) [2023-12-28 07:27:15,442][106225] Updated weights for policy 1, policy_version 1700521 (0.0008) [2023-12-28 07:27:15,501][106225] Updated weights for policy 1, policy_version 1700531 (0.0007) [2023-12-28 07:27:15,508][106226] Updated weights for policy 0, policy_version 1696618 (0.0007) [2023-12-28 07:27:15,559][106226] Updated weights for policy 0, policy_version 1696628 (0.0005) [2023-12-28 07:27:15,562][106225] Updated weights for policy 1, policy_version 1700541 (0.0010) [2023-12-28 07:27:15,609][106226] Updated weights for policy 0, policy_version 1696638 (0.0005) [2023-12-28 07:27:15,620][106225] Updated weights for policy 1, policy_version 1700551 (0.0010) [2023-12-28 07:27:15,657][106226] Updated weights for policy 0, policy_version 1696648 (0.0005) [2023-12-28 07:27:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 869818368. Throughput: 0: 10064.1, 1: 9919.8. Samples: 869808736. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:16,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.964')] [2023-12-28 07:27:16,308][106225] Updated weights for policy 1, policy_version 1700561 (0.0006) [2023-12-28 07:27:16,335][106226] Updated weights for policy 0, policy_version 1696658 (0.0008) [2023-12-28 07:27:16,359][106225] Updated weights for policy 1, policy_version 1700571 (0.0005) [2023-12-28 07:27:16,398][106226] Updated weights for policy 0, policy_version 1696668 (0.0008) [2023-12-28 07:27:16,419][106225] Updated weights for policy 1, policy_version 1700581 (0.0009) [2023-12-28 07:27:16,459][106226] Updated weights for policy 0, policy_version 1696678 (0.0007) [2023-12-28 07:27:16,991][106225] Updated weights for policy 1, policy_version 1700591 (0.0007) [2023-12-28 07:27:17,048][106225] Updated weights for policy 1, policy_version 1700601 (0.0008) [2023-12-28 07:27:17,102][106225] Updated weights for policy 1, policy_version 1700611 (0.0010) [2023-12-28 07:27:17,238][106226] Updated weights for policy 0, policy_version 1696688 (0.0008) [2023-12-28 07:27:17,292][106226] Updated weights for policy 0, policy_version 1696698 (0.0008) [2023-12-28 07:27:17,342][106226] Updated weights for policy 0, policy_version 1696709 (0.0010) [2023-12-28 07:27:17,763][106225] Updated weights for policy 1, policy_version 1700621 (0.0009) [2023-12-28 07:27:17,817][106225] Updated weights for policy 1, policy_version 1700631 (0.0007) [2023-12-28 07:27:17,863][106225] Updated weights for policy 1, policy_version 1700641 (0.0005) [2023-12-28 07:27:18,075][106226] Updated weights for policy 0, policy_version 1696719 (0.0008) [2023-12-28 07:27:18,124][106226] Updated weights for policy 0, policy_version 1696729 (0.0008) [2023-12-28 07:27:18,173][106226] Updated weights for policy 0, policy_version 1696739 (0.0009) [2023-12-28 07:27:18,538][106225] Updated weights for policy 1, policy_version 1700651 (0.0006) [2023-12-28 07:27:18,597][106225] Updated weights for policy 1, policy_version 1700661 (0.0008) [2023-12-28 07:27:18,660][106225] Updated weights for policy 1, policy_version 1700671 (0.0009) [2023-12-28 07:27:18,920][106226] Updated weights for policy 0, policy_version 1696749 (0.0008) [2023-12-28 07:27:18,974][106226] Updated weights for policy 0, policy_version 1696759 (0.0008) [2023-12-28 07:27:19,028][106226] Updated weights for policy 0, policy_version 1696769 (0.0008) [2023-12-28 07:27:19,424][106225] Updated weights for policy 1, policy_version 1700681 (0.0008) [2023-12-28 07:27:19,489][106225] Updated weights for policy 1, policy_version 1700691 (0.0010) [2023-12-28 07:27:19,553][106225] Updated weights for policy 1, policy_version 1700701 (0.0009) [2023-12-28 07:27:19,617][106225] Updated weights for policy 1, policy_version 1700711 (0.0007) [2023-12-28 07:27:19,811][106226] Updated weights for policy 0, policy_version 1696779 (0.0008) [2023-12-28 07:27:19,876][106226] Updated weights for policy 0, policy_version 1696789 (0.0008) [2023-12-28 07:27:19,944][106226] Updated weights for policy 0, policy_version 1696799 (0.0007) [2023-12-28 07:27:20,315][106225] Updated weights for policy 1, policy_version 1700721 (0.0009) [2023-12-28 07:27:20,373][106225] Updated weights for policy 1, policy_version 1700731 (0.0008) [2023-12-28 07:27:20,436][106225] Updated weights for policy 1, policy_version 1700741 (0.0008) [2023-12-28 07:27:20,561][106226] Updated weights for policy 0, policy_version 1696809 (0.0006) [2023-12-28 07:27:20,626][106226] Updated weights for policy 0, policy_version 1696819 (0.0008) [2023-12-28 07:27:20,683][106226] Updated weights for policy 0, policy_version 1696829 (0.0009) [2023-12-28 07:27:20,747][106226] Updated weights for policy 0, policy_version 1696839 (0.0009) [2023-12-28 07:27:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 869916672. Throughput: 0: 9988.9, 1: 9916.7. Samples: 869928284. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:21,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-5.046')] [2023-12-28 07:27:21,235][106225] Updated weights for policy 1, policy_version 1700751 (0.0008) [2023-12-28 07:27:21,304][106225] Updated weights for policy 1, policy_version 1700761 (0.0009) [2023-12-28 07:27:21,379][106225] Updated weights for policy 1, policy_version 1700772 (0.0008) [2023-12-28 07:27:21,516][106226] Updated weights for policy 0, policy_version 1696849 (0.0010) [2023-12-28 07:27:21,584][106226] Updated weights for policy 0, policy_version 1696859 (0.0011) [2023-12-28 07:27:21,649][106226] Updated weights for policy 0, policy_version 1696869 (0.0009) [2023-12-28 07:27:22,117][106225] Updated weights for policy 1, policy_version 1700782 (0.0009) [2023-12-28 07:27:22,182][106225] Updated weights for policy 1, policy_version 1700792 (0.0009) [2023-12-28 07:27:22,249][106225] Updated weights for policy 1, policy_version 1700802 (0.0007) [2023-12-28 07:27:22,386][106226] Updated weights for policy 0, policy_version 1696879 (0.0008) [2023-12-28 07:27:22,450][106226] Updated weights for policy 0, policy_version 1696889 (0.0009) [2023-12-28 07:27:22,515][106226] Updated weights for policy 0, policy_version 1696899 (0.0009) [2023-12-28 07:27:22,974][106225] Updated weights for policy 1, policy_version 1700812 (0.0008) [2023-12-28 07:27:23,032][106225] Updated weights for policy 1, policy_version 1700822 (0.0006) [2023-12-28 07:27:23,094][106225] Updated weights for policy 1, policy_version 1700832 (0.0008) [2023-12-28 07:27:23,242][106226] Updated weights for policy 0, policy_version 1696909 (0.0010) [2023-12-28 07:27:23,291][106226] Updated weights for policy 0, policy_version 1696919 (0.0007) [2023-12-28 07:27:23,342][106226] Updated weights for policy 0, policy_version 1696929 (0.0008) [2023-12-28 07:27:23,660][106225] Updated weights for policy 1, policy_version 1700842 (0.0007) [2023-12-28 07:27:23,711][106225] Updated weights for policy 1, policy_version 1700852 (0.0005) [2023-12-28 07:27:23,764][106225] Updated weights for policy 1, policy_version 1700862 (0.0005) [2023-12-28 07:27:23,831][106225] Updated weights for policy 1, policy_version 1700872 (0.0008) [2023-12-28 07:27:24,088][106226] Updated weights for policy 0, policy_version 1696939 (0.0009) [2023-12-28 07:27:24,161][106226] Updated weights for policy 0, policy_version 1696949 (0.0005) [2023-12-28 07:27:24,220][106226] Updated weights for policy 0, policy_version 1696959 (0.0005) [2023-12-28 07:27:24,599][106225] Updated weights for policy 1, policy_version 1700882 (0.0008) [2023-12-28 07:27:24,659][106225] Updated weights for policy 1, policy_version 1700892 (0.0007) [2023-12-28 07:27:24,711][106226] Updated weights for policy 0, policy_version 1696969 (0.0006) [2023-12-28 07:27:24,718][106225] Updated weights for policy 1, policy_version 1700902 (0.0010) [2023-12-28 07:27:24,764][106226] Updated weights for policy 0, policy_version 1696979 (0.0007) [2023-12-28 07:27:24,817][106226] Updated weights for policy 0, policy_version 1696989 (0.0008) [2023-12-28 07:27:24,878][106226] Updated weights for policy 0, policy_version 1696999 (0.0008) [2023-12-28 07:27:25,380][106225] Updated weights for policy 1, policy_version 1700912 (0.0006) [2023-12-28 07:27:25,431][106225] Updated weights for policy 1, policy_version 1700922 (0.0005) [2023-12-28 07:27:25,477][106225] Updated weights for policy 1, policy_version 1700932 (0.0005) [2023-12-28 07:27:25,572][106226] Updated weights for policy 0, policy_version 1697009 (0.0006) [2023-12-28 07:27:25,634][106226] Updated weights for policy 0, policy_version 1697019 (0.0008) [2023-12-28 07:27:25,702][106226] Updated weights for policy 0, policy_version 1697029 (0.0008) [2023-12-28 07:27:26,161][106225] Updated weights for policy 1, policy_version 1700942 (0.0010) [2023-12-28 07:27:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 870014976. Throughput: 0: 9992.0, 1: 9831.1. Samples: 869986628. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:26,175][105115] Avg episode reward: [(0, '-4.636'), (1, '-5.160')] [2023-12-28 07:27:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001697032_434520064.pth... [2023-12-28 07:27:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001695880_434225152.pth [2023-12-28 07:27:26,208][106225] Updated weights for policy 1, policy_version 1700952 (0.0010) [2023-12-28 07:27:26,255][106225] Updated weights for policy 1, policy_version 1700962 (0.0010) [2023-12-28 07:27:26,284][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001700968_435503104.pth... [2023-12-28 07:27:26,288][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001699784_435200000.pth [2023-12-28 07:27:26,371][106226] Updated weights for policy 0, policy_version 1697039 (0.0010) [2023-12-28 07:27:26,439][106226] Updated weights for policy 0, policy_version 1697049 (0.0010) [2023-12-28 07:27:26,502][106226] Updated weights for policy 0, policy_version 1697059 (0.0009) [2023-12-28 07:27:26,876][106225] Updated weights for policy 1, policy_version 1700972 (0.0007) [2023-12-28 07:27:26,936][106225] Updated weights for policy 1, policy_version 1700982 (0.0005) [2023-12-28 07:27:27,003][106225] Updated weights for policy 1, policy_version 1700992 (0.0005) [2023-12-28 07:27:27,213][106226] Updated weights for policy 0, policy_version 1697069 (0.0010) [2023-12-28 07:27:27,259][106226] Updated weights for policy 0, policy_version 1697079 (0.0010) [2023-12-28 07:27:27,316][106226] Updated weights for policy 0, policy_version 1697089 (0.0010) [2023-12-28 07:27:27,533][106225] Updated weights for policy 1, policy_version 1701002 (0.0005) [2023-12-28 07:27:27,587][106225] Updated weights for policy 1, policy_version 1701012 (0.0005) [2023-12-28 07:27:27,643][106225] Updated weights for policy 1, policy_version 1701022 (0.0005) [2023-12-28 07:27:27,706][106225] Updated weights for policy 1, policy_version 1701032 (0.0009) [2023-12-28 07:27:27,922][106226] Updated weights for policy 0, policy_version 1697099 (0.0008) [2023-12-28 07:27:27,969][106226] Updated weights for policy 0, policy_version 1697109 (0.0008) [2023-12-28 07:27:28,018][106226] Updated weights for policy 0, policy_version 1697119 (0.0008) [2023-12-28 07:27:28,247][106225] Updated weights for policy 1, policy_version 1701042 (0.0010) [2023-12-28 07:27:28,312][106225] Updated weights for policy 1, policy_version 1701052 (0.0010) [2023-12-28 07:27:28,377][106225] Updated weights for policy 1, policy_version 1701062 (0.0009) [2023-12-28 07:27:28,734][106226] Updated weights for policy 0, policy_version 1697129 (0.0008) [2023-12-28 07:27:28,803][106226] Updated weights for policy 0, policy_version 1697139 (0.0006) [2023-12-28 07:27:28,862][106226] Updated weights for policy 0, policy_version 1697149 (0.0005) [2023-12-28 07:27:28,920][106226] Updated weights for policy 0, policy_version 1697159 (0.0006) [2023-12-28 07:27:28,935][106225] Updated weights for policy 1, policy_version 1701072 (0.0006) [2023-12-28 07:27:28,993][106225] Updated weights for policy 1, policy_version 1701082 (0.0010) [2023-12-28 07:27:29,049][106225] Updated weights for policy 1, policy_version 1701092 (0.0010) [2023-12-28 07:27:29,533][106226] Updated weights for policy 0, policy_version 1697169 (0.0008) [2023-12-28 07:27:29,590][106226] Updated weights for policy 0, policy_version 1697179 (0.0008) [2023-12-28 07:27:29,646][106226] Updated weights for policy 0, policy_version 1697189 (0.0007) [2023-12-28 07:27:29,770][106225] Updated weights for policy 1, policy_version 1701102 (0.0009) [2023-12-28 07:27:29,835][106225] Updated weights for policy 1, policy_version 1701112 (0.0008) [2023-12-28 07:27:29,895][106225] Updated weights for policy 1, policy_version 1701122 (0.0012) [2023-12-28 07:27:30,298][106226] Updated weights for policy 0, policy_version 1697199 (0.0008) [2023-12-28 07:27:30,355][106226] Updated weights for policy 0, policy_version 1697209 (0.0007) [2023-12-28 07:27:30,401][106226] Updated weights for policy 0, policy_version 1697219 (0.0008) [2023-12-28 07:27:30,623][106225] Updated weights for policy 1, policy_version 1701132 (0.0010) [2023-12-28 07:27:30,675][106225] Updated weights for policy 1, policy_version 1701142 (0.0010) [2023-12-28 07:27:30,730][106225] Updated weights for policy 1, policy_version 1701152 (0.0010) [2023-12-28 07:27:31,121][106226] Updated weights for policy 0, policy_version 1697229 (0.0008) [2023-12-28 07:27:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 870121472. Throughput: 0: 10095.6, 1: 9926.8. Samples: 870114040. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:31,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-4.826')] [2023-12-28 07:27:31,186][106226] Updated weights for policy 0, policy_version 1697239 (0.0008) [2023-12-28 07:27:31,256][106226] Updated weights for policy 0, policy_version 1697249 (0.0007) [2023-12-28 07:27:31,496][106225] Updated weights for policy 1, policy_version 1701162 (0.0009) [2023-12-28 07:27:31,567][106225] Updated weights for policy 1, policy_version 1701172 (0.0005) [2023-12-28 07:27:31,635][106225] Updated weights for policy 1, policy_version 1701182 (0.0007) [2023-12-28 07:27:31,690][106225] Updated weights for policy 1, policy_version 1701192 (0.0006) [2023-12-28 07:27:31,973][106226] Updated weights for policy 0, policy_version 1697259 (0.0006) [2023-12-28 07:27:32,036][106226] Updated weights for policy 0, policy_version 1697269 (0.0006) [2023-12-28 07:27:32,096][106226] Updated weights for policy 0, policy_version 1697279 (0.0009) [2023-12-28 07:27:32,357][106225] Updated weights for policy 1, policy_version 1701202 (0.0008) [2023-12-28 07:27:32,418][106225] Updated weights for policy 1, policy_version 1701212 (0.0009) [2023-12-28 07:27:32,474][106225] Updated weights for policy 1, policy_version 1701222 (0.0008) [2023-12-28 07:27:32,793][106226] Updated weights for policy 0, policy_version 1697289 (0.0008) [2023-12-28 07:27:32,856][106226] Updated weights for policy 0, policy_version 1697299 (0.0005) [2023-12-28 07:27:32,916][106226] Updated weights for policy 0, policy_version 1697309 (0.0005) [2023-12-28 07:27:32,982][106226] Updated weights for policy 0, policy_version 1697319 (0.0006) [2023-12-28 07:27:33,253][106225] Updated weights for policy 1, policy_version 1701232 (0.0008) [2023-12-28 07:27:33,300][106225] Updated weights for policy 1, policy_version 1701242 (0.0008) [2023-12-28 07:27:33,345][106225] Updated weights for policy 1, policy_version 1701252 (0.0008) [2023-12-28 07:27:33,608][106226] Updated weights for policy 0, policy_version 1697329 (0.0009) [2023-12-28 07:27:33,659][106226] Updated weights for policy 0, policy_version 1697339 (0.0007) [2023-12-28 07:27:33,703][106226] Updated weights for policy 0, policy_version 1697349 (0.0007) [2023-12-28 07:27:34,045][106225] Updated weights for policy 1, policy_version 1701262 (0.0008) [2023-12-28 07:27:34,092][106225] Updated weights for policy 1, policy_version 1701272 (0.0008) [2023-12-28 07:27:34,146][106225] Updated weights for policy 1, policy_version 1701282 (0.0008) [2023-12-28 07:27:34,560][106226] Updated weights for policy 0, policy_version 1697359 (0.0009) [2023-12-28 07:27:34,621][106226] Updated weights for policy 0, policy_version 1697369 (0.0009) [2023-12-28 07:27:34,678][106226] Updated weights for policy 0, policy_version 1697379 (0.0009) [2023-12-28 07:27:34,967][106225] Updated weights for policy 1, policy_version 1701292 (0.0008) [2023-12-28 07:27:35,022][106225] Updated weights for policy 1, policy_version 1701302 (0.0008) [2023-12-28 07:27:35,083][106225] Updated weights for policy 1, policy_version 1701312 (0.0006) [2023-12-28 07:27:35,372][106226] Updated weights for policy 0, policy_version 1697389 (0.0009) [2023-12-28 07:27:35,418][106226] Updated weights for policy 0, policy_version 1697399 (0.0007) [2023-12-28 07:27:35,485][106226] Updated weights for policy 0, policy_version 1697409 (0.0008) [2023-12-28 07:27:35,734][106225] Updated weights for policy 1, policy_version 1701322 (0.0006) [2023-12-28 07:27:35,793][106225] Updated weights for policy 1, policy_version 1701332 (0.0007) [2023-12-28 07:27:35,848][106225] Updated weights for policy 1, policy_version 1701342 (0.0010) [2023-12-28 07:27:35,901][106225] Updated weights for policy 1, policy_version 1701352 (0.0010) [2023-12-28 07:27:36,125][106226] Updated weights for policy 0, policy_version 1697419 (0.0008) [2023-12-28 07:27:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 870219776. Throughput: 0: 9990.8, 1: 10004.7. Samples: 870231344. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:36,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.327')] [2023-12-28 07:27:36,192][106226] Updated weights for policy 0, policy_version 1697429 (0.0007) [2023-12-28 07:27:36,258][106226] Updated weights for policy 0, policy_version 1697439 (0.0009) [2023-12-28 07:27:36,600][106225] Updated weights for policy 1, policy_version 1701362 (0.0010) [2023-12-28 07:27:36,651][106225] Updated weights for policy 1, policy_version 1701372 (0.0010) [2023-12-28 07:27:36,706][106225] Updated weights for policy 1, policy_version 1701382 (0.0011) [2023-12-28 07:27:36,969][106226] Updated weights for policy 0, policy_version 1697449 (0.0011) [2023-12-28 07:27:37,026][106226] Updated weights for policy 0, policy_version 1697459 (0.0011) [2023-12-28 07:27:37,086][106226] Updated weights for policy 0, policy_version 1697469 (0.0011) [2023-12-28 07:27:37,143][106226] Updated weights for policy 0, policy_version 1697479 (0.0010) [2023-12-28 07:27:37,395][106225] Updated weights for policy 1, policy_version 1701392 (0.0010) [2023-12-28 07:27:37,461][106225] Updated weights for policy 1, policy_version 1701402 (0.0008) [2023-12-28 07:27:37,531][106225] Updated weights for policy 1, policy_version 1701412 (0.0005) [2023-12-28 07:27:37,791][106226] Updated weights for policy 0, policy_version 1697489 (0.0006) [2023-12-28 07:27:37,843][106226] Updated weights for policy 0, policy_version 1697499 (0.0005) [2023-12-28 07:27:37,896][106226] Updated weights for policy 0, policy_version 1697509 (0.0008) [2023-12-28 07:27:38,083][106225] Updated weights for policy 1, policy_version 1701422 (0.0005) [2023-12-28 07:27:38,141][106225] Updated weights for policy 1, policy_version 1701432 (0.0005) [2023-12-28 07:27:38,203][106225] Updated weights for policy 1, policy_version 1701442 (0.0006) [2023-12-28 07:27:38,665][106226] Updated weights for policy 0, policy_version 1697519 (0.0008) [2023-12-28 07:27:38,727][106226] Updated weights for policy 0, policy_version 1697529 (0.0008) [2023-12-28 07:27:38,787][106226] Updated weights for policy 0, policy_version 1697539 (0.0008) [2023-12-28 07:27:38,833][106225] Updated weights for policy 1, policy_version 1701452 (0.0008) [2023-12-28 07:27:38,893][106225] Updated weights for policy 1, policy_version 1701462 (0.0010) [2023-12-28 07:27:38,945][106225] Updated weights for policy 1, policy_version 1701472 (0.0006) [2023-12-28 07:27:39,479][106226] Updated weights for policy 0, policy_version 1697549 (0.0007) [2023-12-28 07:27:39,549][106226] Updated weights for policy 0, policy_version 1697559 (0.0006) [2023-12-28 07:27:39,618][106226] Updated weights for policy 0, policy_version 1697569 (0.0006) [2023-12-28 07:27:39,656][106225] Updated weights for policy 1, policy_version 1701482 (0.0009) [2023-12-28 07:27:39,723][106225] Updated weights for policy 1, policy_version 1701492 (0.0008) [2023-12-28 07:27:39,787][106225] Updated weights for policy 1, policy_version 1701502 (0.0006) [2023-12-28 07:27:39,865][106225] Updated weights for policy 1, policy_version 1701512 (0.0008) [2023-12-28 07:27:40,282][106226] Updated weights for policy 0, policy_version 1697579 (0.0007) [2023-12-28 07:27:40,341][106226] Updated weights for policy 0, policy_version 1697589 (0.0009) [2023-12-28 07:27:40,414][106226] Updated weights for policy 0, policy_version 1697599 (0.0010) [2023-12-28 07:27:40,500][106225] Updated weights for policy 1, policy_version 1701522 (0.0006) [2023-12-28 07:27:40,558][106225] Updated weights for policy 1, policy_version 1701532 (0.0005) [2023-12-28 07:27:40,616][106225] Updated weights for policy 1, policy_version 1701542 (0.0007) [2023-12-28 07:27:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 870318080. Throughput: 0: 10013.0, 1: 10083.9. Samples: 870292804. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:41,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-5.107')] [2023-12-28 07:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001697608_434667520.pth... [2023-12-28 07:27:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001696488_434380800.pth [2023-12-28 07:27:41,194][106225] Updated weights for policy 1, policy_version 1701552 (0.0006) [2023-12-28 07:27:41,228][106226] Updated weights for policy 0, policy_version 1697609 (0.0008) [2023-12-28 07:27:41,260][106225] Updated weights for policy 1, policy_version 1701562 (0.0008) [2023-12-28 07:27:41,299][106226] Updated weights for policy 0, policy_version 1697619 (0.0007) [2023-12-28 07:27:41,324][106225] Updated weights for policy 1, policy_version 1701572 (0.0009) [2023-12-28 07:27:41,353][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001701576_435658752.pth... [2023-12-28 07:27:41,357][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001700360_435347456.pth [2023-12-28 07:27:41,366][106226] Updated weights for policy 0, policy_version 1697629 (0.0008) [2023-12-28 07:27:41,429][106226] Updated weights for policy 0, policy_version 1697639 (0.0011) [2023-12-28 07:27:42,031][106225] Updated weights for policy 1, policy_version 1701582 (0.0008) [2023-12-28 07:27:42,098][106225] Updated weights for policy 1, policy_version 1701592 (0.0008) [2023-12-28 07:27:42,165][106225] Updated weights for policy 1, policy_version 1701602 (0.0008) [2023-12-28 07:27:42,196][106226] Updated weights for policy 0, policy_version 1697649 (0.0008) [2023-12-28 07:27:42,264][106226] Updated weights for policy 0, policy_version 1697659 (0.0009) [2023-12-28 07:27:42,331][106226] Updated weights for policy 0, policy_version 1697669 (0.0008) [2023-12-28 07:27:42,833][106225] Updated weights for policy 1, policy_version 1701612 (0.0007) [2023-12-28 07:27:42,879][106225] Updated weights for policy 1, policy_version 1701622 (0.0005) [2023-12-28 07:27:42,935][106225] Updated weights for policy 1, policy_version 1701632 (0.0005) [2023-12-28 07:27:43,054][106226] Updated weights for policy 0, policy_version 1697679 (0.0010) [2023-12-28 07:27:43,113][106226] Updated weights for policy 0, policy_version 1697689 (0.0009) [2023-12-28 07:27:43,172][106226] Updated weights for policy 0, policy_version 1697699 (0.0008) [2023-12-28 07:27:43,538][106225] Updated weights for policy 1, policy_version 1701642 (0.0007) [2023-12-28 07:27:43,604][106225] Updated weights for policy 1, policy_version 1701652 (0.0009) [2023-12-28 07:27:43,661][106225] Updated weights for policy 1, policy_version 1701662 (0.0007) [2023-12-28 07:27:43,723][106225] Updated weights for policy 1, policy_version 1701672 (0.0008) [2023-12-28 07:27:43,865][106226] Updated weights for policy 0, policy_version 1697709 (0.0009) [2023-12-28 07:27:43,913][106226] Updated weights for policy 0, policy_version 1697719 (0.0007) [2023-12-28 07:27:43,957][106226] Updated weights for policy 0, policy_version 1697729 (0.0005) [2023-12-28 07:27:44,500][106226] Updated weights for policy 0, policy_version 1697739 (0.0006) [2023-12-28 07:27:44,540][106225] Updated weights for policy 1, policy_version 1701682 (0.0006) [2023-12-28 07:27:44,554][106226] Updated weights for policy 0, policy_version 1697749 (0.0010) [2023-12-28 07:27:44,592][106225] Updated weights for policy 1, policy_version 1701692 (0.0005) [2023-12-28 07:27:44,611][106226] Updated weights for policy 0, policy_version 1697759 (0.0010) [2023-12-28 07:27:44,645][106225] Updated weights for policy 1, policy_version 1701702 (0.0005) [2023-12-28 07:27:45,309][106226] Updated weights for policy 0, policy_version 1697769 (0.0010) [2023-12-28 07:27:45,316][106225] Updated weights for policy 1, policy_version 1701712 (0.0009) [2023-12-28 07:27:45,367][106226] Updated weights for policy 0, policy_version 1697779 (0.0008) [2023-12-28 07:27:45,371][106225] Updated weights for policy 1, policy_version 1701722 (0.0008) [2023-12-28 07:27:45,425][106226] Updated weights for policy 0, policy_version 1697789 (0.0011) [2023-12-28 07:27:45,426][106225] Updated weights for policy 1, policy_version 1701732 (0.0008) [2023-12-28 07:27:45,473][106226] Updated weights for policy 0, policy_version 1697799 (0.0007) [2023-12-28 07:27:46,147][106226] Updated weights for policy 0, policy_version 1697809 (0.0008) [2023-12-28 07:27:46,162][106225] Updated weights for policy 1, policy_version 1701742 (0.0007) [2023-12-28 07:27:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 870416384. Throughput: 0: 9962.7, 1: 10122.4. Samples: 870411236. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:46,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.784')] [2023-12-28 07:27:46,193][106226] Updated weights for policy 0, policy_version 1697819 (0.0007) [2023-12-28 07:27:46,215][106225] Updated weights for policy 1, policy_version 1701752 (0.0007) [2023-12-28 07:27:46,246][106226] Updated weights for policy 0, policy_version 1697829 (0.0006) [2023-12-28 07:27:46,268][106225] Updated weights for policy 1, policy_version 1701763 (0.0008) [2023-12-28 07:27:46,927][106226] Updated weights for policy 0, policy_version 1697839 (0.0006) [2023-12-28 07:27:46,994][106226] Updated weights for policy 0, policy_version 1697849 (0.0009) [2023-12-28 07:27:47,002][106225] Updated weights for policy 1, policy_version 1701773 (0.0008) [2023-12-28 07:27:47,051][106226] Updated weights for policy 0, policy_version 1697859 (0.0006) [2023-12-28 07:27:47,057][106225] Updated weights for policy 1, policy_version 1701783 (0.0006) [2023-12-28 07:27:47,117][106225] Updated weights for policy 1, policy_version 1701793 (0.0007) [2023-12-28 07:27:47,739][106226] Updated weights for policy 0, policy_version 1697869 (0.0006) [2023-12-28 07:27:47,784][106226] Updated weights for policy 0, policy_version 1697879 (0.0005) [2023-12-28 07:27:47,834][106225] Updated weights for policy 1, policy_version 1701803 (0.0009) [2023-12-28 07:27:47,835][106226] Updated weights for policy 0, policy_version 1697889 (0.0005) [2023-12-28 07:27:47,886][106225] Updated weights for policy 1, policy_version 1701813 (0.0007) [2023-12-28 07:27:47,931][106225] Updated weights for policy 1, policy_version 1701823 (0.0008) [2023-12-28 07:27:48,527][106226] Updated weights for policy 0, policy_version 1697899 (0.0006) [2023-12-28 07:27:48,587][106226] Updated weights for policy 0, policy_version 1697909 (0.0009) [2023-12-28 07:27:48,653][106226] Updated weights for policy 0, policy_version 1697919 (0.0008) [2023-12-28 07:27:48,725][106225] Updated weights for policy 1, policy_version 1701833 (0.0007) [2023-12-28 07:27:48,797][106225] Updated weights for policy 1, policy_version 1701843 (0.0007) [2023-12-28 07:27:48,855][106225] Updated weights for policy 1, policy_version 1701853 (0.0008) [2023-12-28 07:27:48,913][106225] Updated weights for policy 1, policy_version 1701863 (0.0009) [2023-12-28 07:27:49,382][106226] Updated weights for policy 0, policy_version 1697929 (0.0009) [2023-12-28 07:27:49,445][106226] Updated weights for policy 0, policy_version 1697939 (0.0008) [2023-12-28 07:27:49,507][106226] Updated weights for policy 0, policy_version 1697949 (0.0008) [2023-12-28 07:27:49,569][106226] Updated weights for policy 0, policy_version 1697959 (0.0008) [2023-12-28 07:27:49,619][106225] Updated weights for policy 1, policy_version 1701873 (0.0007) [2023-12-28 07:27:49,672][106225] Updated weights for policy 1, policy_version 1701883 (0.0008) [2023-12-28 07:27:49,732][106225] Updated weights for policy 1, policy_version 1701893 (0.0008) [2023-12-28 07:27:50,317][106226] Updated weights for policy 0, policy_version 1697969 (0.0009) [2023-12-28 07:27:50,375][106226] Updated weights for policy 0, policy_version 1697979 (0.0009) [2023-12-28 07:27:50,436][106226] Updated weights for policy 0, policy_version 1697989 (0.0008) [2023-12-28 07:27:50,458][106225] Updated weights for policy 1, policy_version 1701903 (0.0007) [2023-12-28 07:27:50,522][106225] Updated weights for policy 1, policy_version 1701913 (0.0010) [2023-12-28 07:27:50,589][106225] Updated weights for policy 1, policy_version 1701923 (0.0009) [2023-12-28 07:27:51,163][106226] Updated weights for policy 0, policy_version 1697999 (0.0008) [2023-12-28 07:27:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 870514688. Throughput: 0: 9825.3, 1: 10077.8. Samples: 870528132. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:51,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.772')] [2023-12-28 07:27:51,217][106226] Updated weights for policy 0, policy_version 1698009 (0.0009) [2023-12-28 07:27:51,274][106226] Updated weights for policy 0, policy_version 1698019 (0.0009) [2023-12-28 07:27:51,363][106225] Updated weights for policy 1, policy_version 1701933 (0.0009) [2023-12-28 07:27:51,434][106225] Updated weights for policy 1, policy_version 1701943 (0.0008) [2023-12-28 07:27:51,498][106225] Updated weights for policy 1, policy_version 1701953 (0.0006) [2023-12-28 07:27:52,056][106226] Updated weights for policy 0, policy_version 1698029 (0.0008) [2023-12-28 07:27:52,118][106226] Updated weights for policy 0, policy_version 1698039 (0.0007) [2023-12-28 07:27:52,178][106226] Updated weights for policy 0, policy_version 1698049 (0.0005) [2023-12-28 07:27:52,191][106225] Updated weights for policy 1, policy_version 1701963 (0.0006) [2023-12-28 07:27:52,257][106225] Updated weights for policy 1, policy_version 1701973 (0.0007) [2023-12-28 07:27:52,315][106225] Updated weights for policy 1, policy_version 1701983 (0.0009) [2023-12-28 07:27:52,923][106226] Updated weights for policy 0, policy_version 1698059 (0.0008) [2023-12-28 07:27:52,986][106226] Updated weights for policy 0, policy_version 1698069 (0.0010) [2023-12-28 07:27:53,003][106225] Updated weights for policy 1, policy_version 1701993 (0.0008) [2023-12-28 07:27:53,043][106226] Updated weights for policy 0, policy_version 1698079 (0.0010) [2023-12-28 07:27:53,049][106225] Updated weights for policy 1, policy_version 1702003 (0.0005) [2023-12-28 07:27:53,099][106225] Updated weights for policy 1, policy_version 1702013 (0.0006) [2023-12-28 07:27:53,142][106225] Updated weights for policy 1, policy_version 1702023 (0.0007) [2023-12-28 07:27:53,799][106225] Updated weights for policy 1, policy_version 1702033 (0.0006) [2023-12-28 07:27:53,800][106226] Updated weights for policy 0, policy_version 1698089 (0.0010) [2023-12-28 07:27:53,850][106225] Updated weights for policy 1, policy_version 1702043 (0.0006) [2023-12-28 07:27:53,856][106226] Updated weights for policy 0, policy_version 1698099 (0.0007) [2023-12-28 07:27:53,904][106226] Updated weights for policy 0, policy_version 1698109 (0.0006) [2023-12-28 07:27:53,904][106225] Updated weights for policy 1, policy_version 1702053 (0.0007) [2023-12-28 07:27:53,957][106226] Updated weights for policy 0, policy_version 1698119 (0.0008) [2023-12-28 07:27:54,586][106225] Updated weights for policy 1, policy_version 1702063 (0.0006) [2023-12-28 07:27:54,657][106225] Updated weights for policy 1, policy_version 1702073 (0.0009) [2023-12-28 07:27:54,701][106226] Updated weights for policy 0, policy_version 1698129 (0.0008) [2023-12-28 07:27:54,719][106225] Updated weights for policy 1, policy_version 1702083 (0.0006) [2023-12-28 07:27:54,779][106226] Updated weights for policy 0, policy_version 1698139 (0.0009) [2023-12-28 07:27:54,833][106226] Updated weights for policy 0, policy_version 1698149 (0.0006) [2023-12-28 07:27:55,418][106225] Updated weights for policy 1, policy_version 1702093 (0.0007) [2023-12-28 07:27:55,471][106225] Updated weights for policy 1, policy_version 1702103 (0.0008) [2023-12-28 07:27:55,477][106226] Updated weights for policy 0, policy_version 1698159 (0.0008) [2023-12-28 07:27:55,515][106225] Updated weights for policy 1, policy_version 1702113 (0.0006) [2023-12-28 07:27:55,538][106226] Updated weights for policy 0, policy_version 1698169 (0.0007) [2023-12-28 07:27:55,594][106226] Updated weights for policy 0, policy_version 1698179 (0.0007) [2023-12-28 07:27:56,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 870612992. Throughput: 0: 9759.9, 1: 10060.0. Samples: 870585256. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:27:56,176][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.968')] [2023-12-28 07:27:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001702120_435798016.pth... [2023-12-28 07:27:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001698184_434814976.pth... [2023-12-28 07:27:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001697032_434520064.pth [2023-12-28 07:27:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001700968_435503104.pth [2023-12-28 07:27:56,258][106226] Updated weights for policy 0, policy_version 1698189 (0.0008) [2023-12-28 07:27:56,273][106225] Updated weights for policy 1, policy_version 1702123 (0.0008) [2023-12-28 07:27:56,311][106226] Updated weights for policy 0, policy_version 1698199 (0.0006) [2023-12-28 07:27:56,328][106225] Updated weights for policy 1, policy_version 1702133 (0.0006) [2023-12-28 07:27:56,361][106226] Updated weights for policy 0, policy_version 1698209 (0.0006) [2023-12-28 07:27:56,375][106225] Updated weights for policy 1, policy_version 1702143 (0.0006) [2023-12-28 07:27:57,036][106226] Updated weights for policy 0, policy_version 1698219 (0.0007) [2023-12-28 07:27:57,087][106226] Updated weights for policy 0, policy_version 1698230 (0.0008) [2023-12-28 07:27:57,123][106225] Updated weights for policy 1, policy_version 1702153 (0.0006) [2023-12-28 07:27:57,139][106226] Updated weights for policy 0, policy_version 1698240 (0.0009) [2023-12-28 07:27:57,172][106225] Updated weights for policy 1, policy_version 1702163 (0.0005) [2023-12-28 07:27:57,232][106225] Updated weights for policy 1, policy_version 1702173 (0.0008) [2023-12-28 07:27:57,295][106225] Updated weights for policy 1, policy_version 1702183 (0.0008) [2023-12-28 07:27:57,799][106226] Updated weights for policy 0, policy_version 1698250 (0.0009) [2023-12-28 07:27:57,855][106226] Updated weights for policy 0, policy_version 1698260 (0.0009) [2023-12-28 07:27:57,915][106226] Updated weights for policy 0, policy_version 1698270 (0.0010) [2023-12-28 07:27:57,978][106226] Updated weights for policy 0, policy_version 1698280 (0.0011) [2023-12-28 07:27:57,979][106225] Updated weights for policy 1, policy_version 1702193 (0.0005) [2023-12-28 07:27:58,044][106225] Updated weights for policy 1, policy_version 1702203 (0.0007) [2023-12-28 07:27:58,101][106225] Updated weights for policy 1, policy_version 1702213 (0.0006) [2023-12-28 07:27:58,706][106226] Updated weights for policy 0, policy_version 1698290 (0.0011) [2023-12-28 07:27:58,758][106225] Updated weights for policy 1, policy_version 1702223 (0.0007) [2023-12-28 07:27:58,768][106226] Updated weights for policy 0, policy_version 1698300 (0.0011) [2023-12-28 07:27:58,820][106225] Updated weights for policy 1, policy_version 1702233 (0.0010) [2023-12-28 07:27:58,838][106226] Updated weights for policy 0, policy_version 1698310 (0.0007) [2023-12-28 07:27:58,896][106225] Updated weights for policy 1, policy_version 1702243 (0.0007) [2023-12-28 07:27:59,669][106226] Updated weights for policy 0, policy_version 1698320 (0.0010) [2023-12-28 07:27:59,704][106225] Updated weights for policy 1, policy_version 1702253 (0.0007) [2023-12-28 07:27:59,732][106226] Updated weights for policy 0, policy_version 1698330 (0.0011) [2023-12-28 07:27:59,774][106225] Updated weights for policy 1, policy_version 1702263 (0.0006) [2023-12-28 07:27:59,787][106226] Updated weights for policy 0, policy_version 1698340 (0.0010) [2023-12-28 07:27:59,833][106225] Updated weights for policy 1, policy_version 1702273 (0.0007) [2023-12-28 07:28:00,544][106226] Updated weights for policy 0, policy_version 1698350 (0.0011) [2023-12-28 07:28:00,561][106225] Updated weights for policy 1, policy_version 1702283 (0.0009) [2023-12-28 07:28:00,600][106226] Updated weights for policy 0, policy_version 1698360 (0.0010) [2023-12-28 07:28:00,613][106225] Updated weights for policy 1, policy_version 1702293 (0.0005) [2023-12-28 07:28:00,653][106226] Updated weights for policy 0, policy_version 1698370 (0.0010) [2023-12-28 07:28:00,666][106225] Updated weights for policy 1, policy_version 1702303 (0.0005) [2023-12-28 07:28:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 870711296. Throughput: 0: 9843.0, 1: 10013.8. Samples: 870702292. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:28:01,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.927')] [2023-12-28 07:28:01,365][106226] Updated weights for policy 0, policy_version 1698380 (0.0010) [2023-12-28 07:28:01,392][106225] Updated weights for policy 1, policy_version 1702313 (0.0007) [2023-12-28 07:28:01,418][106226] Updated weights for policy 0, policy_version 1698390 (0.0010) [2023-12-28 07:28:01,449][106225] Updated weights for policy 1, policy_version 1702323 (0.0009) [2023-12-28 07:28:01,469][106226] Updated weights for policy 0, policy_version 1698400 (0.0010) [2023-12-28 07:28:01,504][106225] Updated weights for policy 1, policy_version 1702333 (0.0008) [2023-12-28 07:28:01,558][106225] Updated weights for policy 1, policy_version 1702343 (0.0008) [2023-12-28 07:28:02,241][106226] Updated weights for policy 0, policy_version 1698410 (0.0011) [2023-12-28 07:28:02,302][106226] Updated weights for policy 0, policy_version 1698420 (0.0011) [2023-12-28 07:28:02,316][106225] Updated weights for policy 1, policy_version 1702353 (0.0007) [2023-12-28 07:28:02,356][106226] Updated weights for policy 0, policy_version 1698430 (0.0010) [2023-12-28 07:28:02,382][106225] Updated weights for policy 1, policy_version 1702363 (0.0006) [2023-12-28 07:28:02,422][106226] Updated weights for policy 0, policy_version 1698440 (0.0010) [2023-12-28 07:28:02,440][106225] Updated weights for policy 1, policy_version 1702373 (0.0007) [2023-12-28 07:28:03,143][106226] Updated weights for policy 0, policy_version 1698450 (0.0005) [2023-12-28 07:28:03,181][106225] Updated weights for policy 1, policy_version 1702383 (0.0008) [2023-12-28 07:28:03,195][106226] Updated weights for policy 0, policy_version 1698460 (0.0007) [2023-12-28 07:28:03,243][106226] Updated weights for policy 0, policy_version 1698470 (0.0007) [2023-12-28 07:28:03,246][106225] Updated weights for policy 1, policy_version 1702393 (0.0006) [2023-12-28 07:28:03,311][106225] Updated weights for policy 1, policy_version 1702403 (0.0008) [2023-12-28 07:28:03,922][106226] Updated weights for policy 0, policy_version 1698480 (0.0005) [2023-12-28 07:28:03,990][106226] Updated weights for policy 0, policy_version 1698490 (0.0010) [2023-12-28 07:28:04,044][106225] Updated weights for policy 1, policy_version 1702413 (0.0006) [2023-12-28 07:28:04,054][106226] Updated weights for policy 0, policy_version 1698500 (0.0011) [2023-12-28 07:28:04,107][106225] Updated weights for policy 1, policy_version 1702423 (0.0007) [2023-12-28 07:28:04,169][106225] Updated weights for policy 1, policy_version 1702433 (0.0007) [2023-12-28 07:28:04,772][106226] Updated weights for policy 0, policy_version 1698510 (0.0011) [2023-12-28 07:28:04,818][106226] Updated weights for policy 0, policy_version 1698520 (0.0006) [2023-12-28 07:28:04,865][106226] Updated weights for policy 0, policy_version 1698530 (0.0009) [2023-12-28 07:28:04,870][106225] Updated weights for policy 1, policy_version 1702443 (0.0007) [2023-12-28 07:28:04,933][106225] Updated weights for policy 1, policy_version 1702453 (0.0007) [2023-12-28 07:28:04,991][106225] Updated weights for policy 1, policy_version 1702463 (0.0008) [2023-12-28 07:28:05,596][106226] Updated weights for policy 0, policy_version 1698540 (0.0010) [2023-12-28 07:28:05,658][106226] Updated weights for policy 0, policy_version 1698550 (0.0011) [2023-12-28 07:28:05,715][106225] Updated weights for policy 1, policy_version 1702473 (0.0008) [2023-12-28 07:28:05,725][106226] Updated weights for policy 0, policy_version 1698560 (0.0011) [2023-12-28 07:28:05,772][106225] Updated weights for policy 1, policy_version 1702483 (0.0006) [2023-12-28 07:28:05,825][106225] Updated weights for policy 1, policy_version 1702493 (0.0007) [2023-12-28 07:28:05,878][106225] Updated weights for policy 1, policy_version 1702503 (0.0005) [2023-12-28 07:28:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 870809600. Throughput: 0: 9832.6, 1: 9926.9. Samples: 870817464. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:28:06,175][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.757')] [2023-12-28 07:28:06,427][106226] Updated weights for policy 0, policy_version 1698570 (0.0010) [2023-12-28 07:28:06,485][106226] Updated weights for policy 0, policy_version 1698580 (0.0011) [2023-12-28 07:28:06,540][106226] Updated weights for policy 0, policy_version 1698590 (0.0011) [2023-12-28 07:28:06,605][106226] Updated weights for policy 0, policy_version 1698600 (0.0011) [2023-12-28 07:28:06,656][106225] Updated weights for policy 1, policy_version 1702513 (0.0007) [2023-12-28 07:28:06,719][106225] Updated weights for policy 1, policy_version 1702523 (0.0007) [2023-12-28 07:28:06,784][106225] Updated weights for policy 1, policy_version 1702533 (0.0008) [2023-12-28 07:28:07,304][106226] Updated weights for policy 0, policy_version 1698610 (0.0006) [2023-12-28 07:28:07,354][106226] Updated weights for policy 0, policy_version 1698620 (0.0008) [2023-12-28 07:28:07,415][106226] Updated weights for policy 0, policy_version 1698630 (0.0011) [2023-12-28 07:28:07,598][106225] Updated weights for policy 1, policy_version 1702543 (0.0008) [2023-12-28 07:28:07,657][106225] Updated weights for policy 1, policy_version 1702553 (0.0008) [2023-12-28 07:28:07,718][106225] Updated weights for policy 1, policy_version 1702563 (0.0008) [2023-12-28 07:28:08,102][106226] Updated weights for policy 0, policy_version 1698640 (0.0011) [2023-12-28 07:28:08,162][106226] Updated weights for policy 0, policy_version 1698650 (0.0010) [2023-12-28 07:28:08,223][106226] Updated weights for policy 0, policy_version 1698660 (0.0011) [2023-12-28 07:28:08,338][106225] Updated weights for policy 1, policy_version 1702573 (0.0009) [2023-12-28 07:28:08,405][106225] Updated weights for policy 1, policy_version 1702583 (0.0007) [2023-12-28 07:28:08,466][106225] Updated weights for policy 1, policy_version 1702593 (0.0008) [2023-12-28 07:28:08,939][106226] Updated weights for policy 0, policy_version 1698670 (0.0011) [2023-12-28 07:28:08,998][106226] Updated weights for policy 0, policy_version 1698680 (0.0011) [2023-12-28 07:28:09,048][106226] Updated weights for policy 0, policy_version 1698690 (0.0010) [2023-12-28 07:28:09,255][106225] Updated weights for policy 1, policy_version 1702603 (0.0008) [2023-12-28 07:28:09,315][106225] Updated weights for policy 1, policy_version 1702613 (0.0007) [2023-12-28 07:28:09,376][106225] Updated weights for policy 1, policy_version 1702623 (0.0007) [2023-12-28 07:28:09,798][106226] Updated weights for policy 0, policy_version 1698700 (0.0009) [2023-12-28 07:28:09,867][106226] Updated weights for policy 0, policy_version 1698710 (0.0009) [2023-12-28 07:28:09,933][106226] Updated weights for policy 0, policy_version 1698720 (0.0010) [2023-12-28 07:28:10,061][106225] Updated weights for policy 1, policy_version 1702633 (0.0007) [2023-12-28 07:28:10,133][106225] Updated weights for policy 1, policy_version 1702643 (0.0009) [2023-12-28 07:28:10,195][106225] Updated weights for policy 1, policy_version 1702653 (0.0007) [2023-12-28 07:28:10,263][106225] Updated weights for policy 1, policy_version 1702663 (0.0006) [2023-12-28 07:28:10,586][106226] Updated weights for policy 0, policy_version 1698730 (0.0009) [2023-12-28 07:28:10,635][106226] Updated weights for policy 0, policy_version 1698740 (0.0008) [2023-12-28 07:28:10,703][106226] Updated weights for policy 0, policy_version 1698750 (0.0006) [2023-12-28 07:28:10,766][106226] Updated weights for policy 0, policy_version 1698760 (0.0007) [2023-12-28 07:28:10,913][106225] Updated weights for policy 1, policy_version 1702673 (0.0009) [2023-12-28 07:28:10,979][106225] Updated weights for policy 1, policy_version 1702683 (0.0010) [2023-12-28 07:28:11,058][106225] Updated weights for policy 1, policy_version 1702693 (0.0008) [2023-12-28 07:28:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 870907904. Throughput: 0: 9867.0, 1: 9889.2. Samples: 870875660. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-28 07:28:11,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.981')] [2023-12-28 07:28:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001702696_435945472.pth... [2023-12-28 07:28:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001698760_434962432.pth... [2023-12-28 07:28:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001701576_435658752.pth [2023-12-28 07:28:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001697608_434667520.pth [2023-12-28 07:28:11,442][106226] Updated weights for policy 0, policy_version 1698770 (0.0008) [2023-12-28 07:28:11,504][106226] Updated weights for policy 0, policy_version 1698780 (0.0008) [2023-12-28 07:28:11,571][106226] Updated weights for policy 0, policy_version 1698790 (0.0008) [2023-12-28 07:28:11,859][106225] Updated weights for policy 1, policy_version 1702703 (0.0008) [2023-12-28 07:28:11,921][106225] Updated weights for policy 1, policy_version 1702713 (0.0010) [2023-12-28 07:28:11,987][106225] Updated weights for policy 1, policy_version 1702723 (0.0011) [2023-12-28 07:28:12,408][106226] Updated weights for policy 0, policy_version 1698800 (0.0008) [2023-12-28 07:28:12,468][106226] Updated weights for policy 0, policy_version 1698810 (0.0008) [2023-12-28 07:28:12,530][106226] Updated weights for policy 0, policy_version 1698820 (0.0008) [2023-12-28 07:28:12,669][106225] Updated weights for policy 1, policy_version 1702733 (0.0009) [2023-12-28 07:28:12,721][106225] Updated weights for policy 1, policy_version 1702743 (0.0008) [2023-12-28 07:28:12,792][106225] Updated weights for policy 1, policy_version 1702753 (0.0009) [2023-12-28 07:28:13,269][106226] Updated weights for policy 0, policy_version 1698830 (0.0009) [2023-12-28 07:28:13,332][106226] Updated weights for policy 0, policy_version 1698840 (0.0009) [2023-12-28 07:28:13,388][106226] Updated weights for policy 0, policy_version 1698850 (0.0008) [2023-12-28 07:28:13,422][106225] Updated weights for policy 1, policy_version 1702763 (0.0007) [2023-12-28 07:28:13,472][106225] Updated weights for policy 1, policy_version 1702773 (0.0008) [2023-12-28 07:28:13,521][106225] Updated weights for policy 1, policy_version 1702783 (0.0008) [2023-12-28 07:28:14,102][106226] Updated weights for policy 0, policy_version 1698860 (0.0007) [2023-12-28 07:28:14,154][106226] Updated weights for policy 0, policy_version 1698870 (0.0009) [2023-12-28 07:28:14,209][106226] Updated weights for policy 0, policy_version 1698880 (0.0008) [2023-12-28 07:28:14,266][106225] Updated weights for policy 1, policy_version 1702793 (0.0009) [2023-12-28 07:28:14,317][106225] Updated weights for policy 1, policy_version 1702803 (0.0008) [2023-12-28 07:28:14,369][106225] Updated weights for policy 1, policy_version 1702813 (0.0008) [2023-12-28 07:28:14,414][106225] Updated weights for policy 1, policy_version 1702823 (0.0008) [2023-12-28 07:28:14,953][106226] Updated weights for policy 0, policy_version 1698890 (0.0009) [2023-12-28 07:28:15,018][106226] Updated weights for policy 0, policy_version 1698900 (0.0008) [2023-12-28 07:28:15,054][106225] Updated weights for policy 1, policy_version 1702833 (0.0008) [2023-12-28 07:28:15,079][106226] Updated weights for policy 0, policy_version 1698910 (0.0008) [2023-12-28 07:28:15,113][106225] Updated weights for policy 1, policy_version 1702843 (0.0007) [2023-12-28 07:28:15,142][106226] Updated weights for policy 0, policy_version 1698920 (0.0007) [2023-12-28 07:28:15,176][106225] Updated weights for policy 1, policy_version 1702853 (0.0006) [2023-12-28 07:28:15,750][106225] Updated weights for policy 1, policy_version 1702863 (0.0006) [2023-12-28 07:28:15,785][106226] Updated weights for policy 0, policy_version 1698930 (0.0005) [2023-12-28 07:28:15,801][106225] Updated weights for policy 1, policy_version 1702873 (0.0007) [2023-12-28 07:28:15,848][106226] Updated weights for policy 0, policy_version 1698940 (0.0006) [2023-12-28 07:28:15,854][106225] Updated weights for policy 1, policy_version 1702883 (0.0009) [2023-12-28 07:28:15,896][106226] Updated weights for policy 0, policy_version 1698950 (0.0005) [2023-12-28 07:28:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 871006208. Throughput: 0: 9733.2, 1: 9750.8. Samples: 870990820. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:16,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.941')] [2023-12-28 07:28:16,423][106226] Updated weights for policy 0, policy_version 1698960 (0.0008) [2023-12-28 07:28:16,490][106226] Updated weights for policy 0, policy_version 1698970 (0.0011) [2023-12-28 07:28:16,541][106226] Updated weights for policy 0, policy_version 1698980 (0.0010) [2023-12-28 07:28:16,604][106225] Updated weights for policy 1, policy_version 1702893 (0.0008) [2023-12-28 07:28:16,658][106225] Updated weights for policy 1, policy_version 1702903 (0.0008) [2023-12-28 07:28:16,707][106225] Updated weights for policy 1, policy_version 1702913 (0.0007) [2023-12-28 07:28:17,150][106226] Updated weights for policy 0, policy_version 1698990 (0.0007) [2023-12-28 07:28:17,200][106226] Updated weights for policy 0, policy_version 1699000 (0.0006) [2023-12-28 07:28:17,257][106226] Updated weights for policy 0, policy_version 1699010 (0.0009) [2023-12-28 07:28:17,461][106225] Updated weights for policy 1, policy_version 1702923 (0.0007) [2023-12-28 07:28:17,510][106225] Updated weights for policy 1, policy_version 1702933 (0.0006) [2023-12-28 07:28:17,558][106225] Updated weights for policy 1, policy_version 1702943 (0.0010) [2023-12-28 07:28:17,900][106226] Updated weights for policy 0, policy_version 1699020 (0.0009) [2023-12-28 07:28:17,958][106226] Updated weights for policy 0, policy_version 1699030 (0.0009) [2023-12-28 07:28:18,012][106226] Updated weights for policy 0, policy_version 1699040 (0.0010) [2023-12-28 07:28:18,175][106225] Updated weights for policy 1, policy_version 1702953 (0.0009) [2023-12-28 07:28:18,231][106225] Updated weights for policy 1, policy_version 1702963 (0.0005) [2023-12-28 07:28:18,286][106225] Updated weights for policy 1, policy_version 1702973 (0.0005) [2023-12-28 07:28:18,343][106225] Updated weights for policy 1, policy_version 1702983 (0.0006) [2023-12-28 07:28:18,698][106226] Updated weights for policy 0, policy_version 1699050 (0.0010) [2023-12-28 07:28:18,756][106226] Updated weights for policy 0, policy_version 1699060 (0.0011) [2023-12-28 07:28:18,810][106226] Updated weights for policy 0, policy_version 1699070 (0.0010) [2023-12-28 07:28:18,868][106226] Updated weights for policy 0, policy_version 1699080 (0.0006) [2023-12-28 07:28:18,931][106225] Updated weights for policy 1, policy_version 1702993 (0.0008) [2023-12-28 07:28:18,985][106225] Updated weights for policy 1, policy_version 1703003 (0.0008) [2023-12-28 07:28:19,032][106225] Updated weights for policy 1, policy_version 1703013 (0.0008) [2023-12-28 07:28:19,548][106226] Updated weights for policy 0, policy_version 1699090 (0.0010) [2023-12-28 07:28:19,613][106226] Updated weights for policy 0, policy_version 1699100 (0.0011) [2023-12-28 07:28:19,676][106226] Updated weights for policy 0, policy_version 1699110 (0.0011) [2023-12-28 07:28:19,772][106225] Updated weights for policy 1, policy_version 1703023 (0.0009) [2023-12-28 07:28:19,854][106225] Updated weights for policy 1, policy_version 1703033 (0.0008) [2023-12-28 07:28:19,916][106225] Updated weights for policy 1, policy_version 1703043 (0.0007) [2023-12-28 07:28:20,411][106226] Updated weights for policy 0, policy_version 1699120 (0.0009) [2023-12-28 07:28:20,467][106226] Updated weights for policy 0, policy_version 1699130 (0.0009) [2023-12-28 07:28:20,528][106226] Updated weights for policy 0, policy_version 1699140 (0.0008) [2023-12-28 07:28:20,611][106225] Updated weights for policy 1, policy_version 1703053 (0.0008) [2023-12-28 07:28:20,678][106225] Updated weights for policy 1, policy_version 1703063 (0.0008) [2023-12-28 07:28:20,743][106225] Updated weights for policy 1, policy_version 1703073 (0.0009) [2023-12-28 07:28:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 871104512. Throughput: 0: 9786.6, 1: 9835.2. Samples: 871114324. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:21,175][105115] Avg episode reward: [(0, '-4.450'), (1, '-4.916')] [2023-12-28 07:28:21,355][106226] Updated weights for policy 0, policy_version 1699150 (0.0009) [2023-12-28 07:28:21,430][106226] Updated weights for policy 0, policy_version 1699160 (0.0009) [2023-12-28 07:28:21,493][106226] Updated weights for policy 0, policy_version 1699170 (0.0009) [2023-12-28 07:28:21,513][106225] Updated weights for policy 1, policy_version 1703083 (0.0008) [2023-12-28 07:28:21,566][106225] Updated weights for policy 1, policy_version 1703093 (0.0007) [2023-12-28 07:28:21,619][106225] Updated weights for policy 1, policy_version 1703103 (0.0008) [2023-12-28 07:28:22,301][106225] Updated weights for policy 1, policy_version 1703113 (0.0009) [2023-12-28 07:28:22,312][106226] Updated weights for policy 0, policy_version 1699180 (0.0008) [2023-12-28 07:28:22,364][106225] Updated weights for policy 1, policy_version 1703123 (0.0008) [2023-12-28 07:28:22,376][106226] Updated weights for policy 0, policy_version 1699190 (0.0007) [2023-12-28 07:28:22,433][106225] Updated weights for policy 1, policy_version 1703133 (0.0006) [2023-12-28 07:28:22,440][106226] Updated weights for policy 0, policy_version 1699200 (0.0010) [2023-12-28 07:28:22,495][106225] Updated weights for policy 1, policy_version 1703143 (0.0005) [2023-12-28 07:28:23,122][106225] Updated weights for policy 1, policy_version 1703153 (0.0007) [2023-12-28 07:28:23,166][106225] Updated weights for policy 1, policy_version 1703163 (0.0007) [2023-12-28 07:28:23,212][106225] Updated weights for policy 1, policy_version 1703173 (0.0008) [2023-12-28 07:28:23,238][106226] Updated weights for policy 0, policy_version 1699210 (0.0009) [2023-12-28 07:28:23,290][106226] Updated weights for policy 0, policy_version 1699220 (0.0011) [2023-12-28 07:28:23,354][106226] Updated weights for policy 0, policy_version 1699230 (0.0006) [2023-12-28 07:28:23,424][106226] Updated weights for policy 0, policy_version 1699240 (0.0005) [2023-12-28 07:28:23,858][106225] Updated weights for policy 1, policy_version 1703183 (0.0009) [2023-12-28 07:28:23,925][106225] Updated weights for policy 1, policy_version 1703193 (0.0010) [2023-12-28 07:28:23,981][106225] Updated weights for policy 1, policy_version 1703203 (0.0010) [2023-12-28 07:28:24,014][106226] Updated weights for policy 0, policy_version 1699250 (0.0005) [2023-12-28 07:28:24,075][106226] Updated weights for policy 0, policy_version 1699260 (0.0005) [2023-12-28 07:28:24,137][106226] Updated weights for policy 0, policy_version 1699270 (0.0006) [2023-12-28 07:28:24,700][106225] Updated weights for policy 1, policy_version 1703213 (0.0010) [2023-12-28 07:28:24,727][106226] Updated weights for policy 0, policy_version 1699280 (0.0009) [2023-12-28 07:28:24,750][106225] Updated weights for policy 1, policy_version 1703223 (0.0010) [2023-12-28 07:28:24,777][106226] Updated weights for policy 0, policy_version 1699290 (0.0010) [2023-12-28 07:28:24,802][106225] Updated weights for policy 1, policy_version 1703233 (0.0008) [2023-12-28 07:28:24,833][106226] Updated weights for policy 0, policy_version 1699300 (0.0010) [2023-12-28 07:28:25,482][106225] Updated weights for policy 1, policy_version 1703243 (0.0007) [2023-12-28 07:28:25,536][106225] Updated weights for policy 1, policy_version 1703253 (0.0010) [2023-12-28 07:28:25,556][106226] Updated weights for policy 0, policy_version 1699310 (0.0010) [2023-12-28 07:28:25,593][106225] Updated weights for policy 1, policy_version 1703263 (0.0010) [2023-12-28 07:28:25,609][106226] Updated weights for policy 0, policy_version 1699320 (0.0005) [2023-12-28 07:28:25,663][106226] Updated weights for policy 0, policy_version 1699330 (0.0005) [2023-12-28 07:28:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 871202816. Throughput: 0: 9767.7, 1: 9801.7. Samples: 871173428. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:26,176][105115] Avg episode reward: [(0, '-4.185'), (1, '-4.644')] [2023-12-28 07:28:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001703272_436092928.pth... [2023-12-28 07:28:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001699336_435109888.pth... [2023-12-28 07:28:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001702120_435798016.pth [2023-12-28 07:28:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001698184_434814976.pth [2023-12-28 07:28:26,301][106225] Updated weights for policy 1, policy_version 1703273 (0.0010) [2023-12-28 07:28:26,331][106226] Updated weights for policy 0, policy_version 1699340 (0.0007) [2023-12-28 07:28:26,362][106225] Updated weights for policy 1, policy_version 1703283 (0.0010) [2023-12-28 07:28:26,388][106226] Updated weights for policy 0, policy_version 1699350 (0.0010) [2023-12-28 07:28:26,415][106225] Updated weights for policy 1, policy_version 1703293 (0.0010) [2023-12-28 07:28:26,448][106226] Updated weights for policy 0, policy_version 1699360 (0.0010) [2023-12-28 07:28:26,469][106225] Updated weights for policy 1, policy_version 1703303 (0.0008) [2023-12-28 07:28:27,161][106226] Updated weights for policy 0, policy_version 1699370 (0.0011) [2023-12-28 07:28:27,193][106225] Updated weights for policy 1, policy_version 1703313 (0.0009) [2023-12-28 07:28:27,221][106226] Updated weights for policy 0, policy_version 1699380 (0.0010) [2023-12-28 07:28:27,252][106225] Updated weights for policy 1, policy_version 1703323 (0.0010) [2023-12-28 07:28:27,270][106226] Updated weights for policy 0, policy_version 1699390 (0.0010) [2023-12-28 07:28:27,312][106225] Updated weights for policy 1, policy_version 1703333 (0.0010) [2023-12-28 07:28:27,332][106226] Updated weights for policy 0, policy_version 1699400 (0.0010) [2023-12-28 07:28:27,947][106226] Updated weights for policy 0, policy_version 1699410 (0.0005) [2023-12-28 07:28:28,001][106226] Updated weights for policy 0, policy_version 1699420 (0.0005) [2023-12-28 07:28:28,020][106225] Updated weights for policy 1, policy_version 1703343 (0.0009) [2023-12-28 07:28:28,049][106226] Updated weights for policy 0, policy_version 1699430 (0.0005) [2023-12-28 07:28:28,083][106225] Updated weights for policy 1, policy_version 1703353 (0.0008) [2023-12-28 07:28:28,143][106225] Updated weights for policy 1, policy_version 1703363 (0.0008) [2023-12-28 07:28:28,779][106226] Updated weights for policy 0, policy_version 1699440 (0.0008) [2023-12-28 07:28:28,828][106225] Updated weights for policy 1, policy_version 1703373 (0.0007) [2023-12-28 07:28:28,834][106226] Updated weights for policy 0, policy_version 1699450 (0.0009) [2023-12-28 07:28:28,882][106225] Updated weights for policy 1, policy_version 1703383 (0.0006) [2023-12-28 07:28:28,901][106226] Updated weights for policy 0, policy_version 1699460 (0.0007) [2023-12-28 07:28:28,941][106225] Updated weights for policy 1, policy_version 1703393 (0.0006) [2023-12-28 07:28:29,635][106225] Updated weights for policy 1, policy_version 1703403 (0.0005) [2023-12-28 07:28:29,645][106226] Updated weights for policy 0, policy_version 1699470 (0.0008) [2023-12-28 07:28:29,692][106225] Updated weights for policy 1, policy_version 1703413 (0.0007) [2023-12-28 07:28:29,706][106226] Updated weights for policy 0, policy_version 1699480 (0.0008) [2023-12-28 07:28:29,753][106225] Updated weights for policy 1, policy_version 1703423 (0.0006) [2023-12-28 07:28:29,763][106226] Updated weights for policy 0, policy_version 1699490 (0.0008) [2023-12-28 07:28:30,396][106225] Updated weights for policy 1, policy_version 1703433 (0.0008) [2023-12-28 07:28:30,442][106225] Updated weights for policy 1, policy_version 1703443 (0.0005) [2023-12-28 07:28:30,485][106225] Updated weights for policy 1, policy_version 1703453 (0.0005) [2023-12-28 07:28:30,518][106226] Updated weights for policy 0, policy_version 1699500 (0.0008) [2023-12-28 07:28:30,529][106225] Updated weights for policy 1, policy_version 1703463 (0.0005) [2023-12-28 07:28:30,569][106226] Updated weights for policy 0, policy_version 1699510 (0.0009) [2023-12-28 07:28:30,619][106226] Updated weights for policy 0, policy_version 1699520 (0.0008) [2023-12-28 07:28:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 871301120. Throughput: 0: 9805.0, 1: 9789.6. Samples: 871292996. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:31,175][105115] Avg episode reward: [(0, '-4.690'), (1, '-4.905')] [2023-12-28 07:28:31,211][106225] Updated weights for policy 1, policy_version 1703473 (0.0007) [2023-12-28 07:28:31,280][106225] Updated weights for policy 1, policy_version 1703483 (0.0007) [2023-12-28 07:28:31,350][106225] Updated weights for policy 1, policy_version 1703493 (0.0006) [2023-12-28 07:28:31,429][106226] Updated weights for policy 0, policy_version 1699530 (0.0008) [2023-12-28 07:28:31,482][106226] Updated weights for policy 0, policy_version 1699540 (0.0009) [2023-12-28 07:28:31,533][106226] Updated weights for policy 0, policy_version 1699550 (0.0007) [2023-12-28 07:28:31,591][106226] Updated weights for policy 0, policy_version 1699560 (0.0007) [2023-12-28 07:28:31,977][106225] Updated weights for policy 1, policy_version 1703503 (0.0006) [2023-12-28 07:28:32,046][106225] Updated weights for policy 1, policy_version 1703513 (0.0007) [2023-12-28 07:28:32,107][106225] Updated weights for policy 1, policy_version 1703523 (0.0009) [2023-12-28 07:28:32,355][106226] Updated weights for policy 0, policy_version 1699570 (0.0008) [2023-12-28 07:28:32,414][106226] Updated weights for policy 0, policy_version 1699580 (0.0008) [2023-12-28 07:28:32,475][106226] Updated weights for policy 0, policy_version 1699590 (0.0009) [2023-12-28 07:28:32,823][106225] Updated weights for policy 1, policy_version 1703533 (0.0009) [2023-12-28 07:28:32,886][106225] Updated weights for policy 1, policy_version 1703543 (0.0005) [2023-12-28 07:28:32,953][106225] Updated weights for policy 1, policy_version 1703553 (0.0005) [2023-12-28 07:28:33,291][106226] Updated weights for policy 0, policy_version 1699600 (0.0009) [2023-12-28 07:28:33,342][106226] Updated weights for policy 0, policy_version 1699610 (0.0009) [2023-12-28 07:28:33,391][106226] Updated weights for policy 0, policy_version 1699620 (0.0008) [2023-12-28 07:28:33,452][106225] Updated weights for policy 1, policy_version 1703563 (0.0005) [2023-12-28 07:28:33,508][106225] Updated weights for policy 1, policy_version 1703573 (0.0007) [2023-12-28 07:28:33,568][106225] Updated weights for policy 1, policy_version 1703583 (0.0009) [2023-12-28 07:28:34,113][106225] Updated weights for policy 1, policy_version 1703593 (0.0005) [2023-12-28 07:28:34,185][106225] Updated weights for policy 1, policy_version 1703603 (0.0007) [2023-12-28 07:28:34,248][106225] Updated weights for policy 1, policy_version 1703613 (0.0006) [2023-12-28 07:28:34,255][106226] Updated weights for policy 0, policy_version 1699630 (0.0009) [2023-12-28 07:28:34,309][106225] Updated weights for policy 1, policy_version 1703623 (0.0010) [2023-12-28 07:28:34,315][106226] Updated weights for policy 0, policy_version 1699640 (0.0007) [2023-12-28 07:28:34,384][106226] Updated weights for policy 0, policy_version 1699650 (0.0008) [2023-12-28 07:28:34,962][106225] Updated weights for policy 1, policy_version 1703633 (0.0006) [2023-12-28 07:28:35,025][106225] Updated weights for policy 1, policy_version 1703643 (0.0005) [2023-12-28 07:28:35,080][106225] Updated weights for policy 1, policy_version 1703653 (0.0008) [2023-12-28 07:28:35,097][106226] Updated weights for policy 0, policy_version 1699660 (0.0007) [2023-12-28 07:28:35,169][106226] Updated weights for policy 0, policy_version 1699670 (0.0008) [2023-12-28 07:28:35,226][106226] Updated weights for policy 0, policy_version 1699680 (0.0010) [2023-12-28 07:28:35,729][106225] Updated weights for policy 1, policy_version 1703663 (0.0007) [2023-12-28 07:28:35,778][106225] Updated weights for policy 1, policy_version 1703673 (0.0006) [2023-12-28 07:28:35,831][106225] Updated weights for policy 1, policy_version 1703683 (0.0007) [2023-12-28 07:28:35,943][106226] Updated weights for policy 0, policy_version 1699690 (0.0008) [2023-12-28 07:28:36,007][106226] Updated weights for policy 0, policy_version 1699700 (0.0008) [2023-12-28 07:28:36,078][106226] Updated weights for policy 0, policy_version 1699710 (0.0010) [2023-12-28 07:28:36,147][106226] Updated weights for policy 0, policy_version 1699720 (0.0009) [2023-12-28 07:28:36,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 871407616. Throughput: 0: 9700.6, 1: 9972.3. Samples: 871413412. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:36,175][105115] Avg episode reward: [(0, '-4.764'), (1, '-5.042')] [2023-12-28 07:28:36,499][106225] Updated weights for policy 1, policy_version 1703693 (0.0009) [2023-12-28 07:28:36,555][106225] Updated weights for policy 1, policy_version 1703703 (0.0010) [2023-12-28 07:28:36,619][106225] Updated weights for policy 1, policy_version 1703713 (0.0010) [2023-12-28 07:28:36,802][106226] Updated weights for policy 0, policy_version 1699730 (0.0010) [2023-12-28 07:28:36,857][106226] Updated weights for policy 0, policy_version 1699740 (0.0005) [2023-12-28 07:28:36,923][106226] Updated weights for policy 0, policy_version 1699750 (0.0006) [2023-12-28 07:28:37,328][106225] Updated weights for policy 1, policy_version 1703723 (0.0007) [2023-12-28 07:28:37,386][106225] Updated weights for policy 1, policy_version 1703733 (0.0008) [2023-12-28 07:28:37,448][106225] Updated weights for policy 1, policy_version 1703743 (0.0007) [2023-12-28 07:28:37,638][106226] Updated weights for policy 0, policy_version 1699760 (0.0010) [2023-12-28 07:28:37,707][106226] Updated weights for policy 0, policy_version 1699770 (0.0011) [2023-12-28 07:28:37,772][106226] Updated weights for policy 0, policy_version 1699780 (0.0010) [2023-12-28 07:28:38,160][106225] Updated weights for policy 1, policy_version 1703753 (0.0009) [2023-12-28 07:28:38,221][106225] Updated weights for policy 1, policy_version 1703763 (0.0007) [2023-12-28 07:28:38,277][106225] Updated weights for policy 1, policy_version 1703773 (0.0007) [2023-12-28 07:28:38,334][106225] Updated weights for policy 1, policy_version 1703783 (0.0008) [2023-12-28 07:28:38,437][106226] Updated weights for policy 0, policy_version 1699790 (0.0009) [2023-12-28 07:28:38,492][106226] Updated weights for policy 0, policy_version 1699800 (0.0008) [2023-12-28 07:28:38,541][106226] Updated weights for policy 0, policy_version 1699810 (0.0007) [2023-12-28 07:28:39,107][106225] Updated weights for policy 1, policy_version 1703793 (0.0009) [2023-12-28 07:28:39,181][106225] Updated weights for policy 1, policy_version 1703803 (0.0008) [2023-12-28 07:28:39,246][106225] Updated weights for policy 1, policy_version 1703813 (0.0009) [2023-12-28 07:28:39,264][106226] Updated weights for policy 0, policy_version 1699820 (0.0006) [2023-12-28 07:28:39,324][106226] Updated weights for policy 0, policy_version 1699830 (0.0009) [2023-12-28 07:28:39,401][106226] Updated weights for policy 0, policy_version 1699840 (0.0009) [2023-12-28 07:28:39,983][106225] Updated weights for policy 1, policy_version 1703823 (0.0010) [2023-12-28 07:28:40,039][106225] Updated weights for policy 1, policy_version 1703833 (0.0009) [2023-12-28 07:28:40,105][106225] Updated weights for policy 1, policy_version 1703843 (0.0010) [2023-12-28 07:28:40,146][106226] Updated weights for policy 0, policy_version 1699850 (0.0008) [2023-12-28 07:28:40,210][106226] Updated weights for policy 0, policy_version 1699860 (0.0009) [2023-12-28 07:28:40,267][106226] Updated weights for policy 0, policy_version 1699870 (0.0008) [2023-12-28 07:28:40,323][106226] Updated weights for policy 0, policy_version 1699880 (0.0009) [2023-12-28 07:28:40,780][106225] Updated weights for policy 1, policy_version 1703853 (0.0008) [2023-12-28 07:28:40,848][106225] Updated weights for policy 1, policy_version 1703863 (0.0009) [2023-12-28 07:28:40,916][106225] Updated weights for policy 1, policy_version 1703873 (0.0010) [2023-12-28 07:28:41,078][106226] Updated weights for policy 0, policy_version 1699890 (0.0008) [2023-12-28 07:28:41,147][106226] Updated weights for policy 0, policy_version 1699900 (0.0007) [2023-12-28 07:28:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 871497728. Throughput: 0: 9753.6, 1: 9964.2. Samples: 871472556. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:41,175][105115] Avg episode reward: [(0, '-4.715'), (1, '-5.117')] [2023-12-28 07:28:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001703880_436248576.pth... [2023-12-28 07:28:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001702696_435945472.pth [2023-12-28 07:28:41,211][106226] Updated weights for policy 0, policy_version 1699910 (0.0009) [2023-12-28 07:28:41,221][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001699912_435257344.pth... [2023-12-28 07:28:41,224][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001698760_434962432.pth [2023-12-28 07:28:41,734][106225] Updated weights for policy 1, policy_version 1703883 (0.0009) [2023-12-28 07:28:41,803][106225] Updated weights for policy 1, policy_version 1703893 (0.0009) [2023-12-28 07:28:41,869][106225] Updated weights for policy 1, policy_version 1703903 (0.0008) [2023-12-28 07:28:41,968][106226] Updated weights for policy 0, policy_version 1699920 (0.0008) [2023-12-28 07:28:42,031][106226] Updated weights for policy 0, policy_version 1699930 (0.0009) [2023-12-28 07:28:42,096][106226] Updated weights for policy 0, policy_version 1699940 (0.0008) [2023-12-28 07:28:42,574][106225] Updated weights for policy 1, policy_version 1703913 (0.0009) [2023-12-28 07:28:42,634][106225] Updated weights for policy 1, policy_version 1703923 (0.0007) [2023-12-28 07:28:42,684][106225] Updated weights for policy 1, policy_version 1703933 (0.0007) [2023-12-28 07:28:42,747][106225] Updated weights for policy 1, policy_version 1703943 (0.0006) [2023-12-28 07:28:42,748][106226] Updated weights for policy 0, policy_version 1699950 (0.0008) [2023-12-28 07:28:42,805][106226] Updated weights for policy 0, policy_version 1699960 (0.0009) [2023-12-28 07:28:42,863][106226] Updated weights for policy 0, policy_version 1699970 (0.0010) [2023-12-28 07:28:43,333][106225] Updated weights for policy 1, policy_version 1703953 (0.0006) [2023-12-28 07:28:43,384][106225] Updated weights for policy 1, policy_version 1703963 (0.0005) [2023-12-28 07:28:43,437][106225] Updated weights for policy 1, policy_version 1703973 (0.0005) [2023-12-28 07:28:43,530][106226] Updated weights for policy 0, policy_version 1699980 (0.0009) [2023-12-28 07:28:43,579][106226] Updated weights for policy 0, policy_version 1699990 (0.0010) [2023-12-28 07:28:43,636][106226] Updated weights for policy 0, policy_version 1700000 (0.0010) [2023-12-28 07:28:43,976][106225] Updated weights for policy 1, policy_version 1703983 (0.0009) [2023-12-28 07:28:44,023][106225] Updated weights for policy 1, policy_version 1703993 (0.0005) [2023-12-28 07:28:44,070][106225] Updated weights for policy 1, policy_version 1704003 (0.0005) [2023-12-28 07:28:44,245][106226] Updated weights for policy 0, policy_version 1700010 (0.0009) [2023-12-28 07:28:44,313][106226] Updated weights for policy 0, policy_version 1700020 (0.0005) [2023-12-28 07:28:44,373][106226] Updated weights for policy 0, policy_version 1700030 (0.0008) [2023-12-28 07:28:44,432][106226] Updated weights for policy 0, policy_version 1700040 (0.0010) [2023-12-28 07:28:44,707][106225] Updated weights for policy 1, policy_version 1704013 (0.0008) [2023-12-28 07:28:44,771][106225] Updated weights for policy 1, policy_version 1704023 (0.0010) [2023-12-28 07:28:44,840][106225] Updated weights for policy 1, policy_version 1704033 (0.0011) [2023-12-28 07:28:45,066][106226] Updated weights for policy 0, policy_version 1700050 (0.0008) [2023-12-28 07:28:45,129][106226] Updated weights for policy 0, policy_version 1700060 (0.0008) [2023-12-28 07:28:45,195][106226] Updated weights for policy 0, policy_version 1700070 (0.0008) [2023-12-28 07:28:45,573][106225] Updated weights for policy 1, policy_version 1704043 (0.0009) [2023-12-28 07:28:45,633][106225] Updated weights for policy 1, policy_version 1704053 (0.0005) [2023-12-28 07:28:45,695][106225] Updated weights for policy 1, policy_version 1704063 (0.0005) [2023-12-28 07:28:45,788][106226] Updated weights for policy 0, policy_version 1700080 (0.0006) [2023-12-28 07:28:45,839][106226] Updated weights for policy 0, policy_version 1700090 (0.0007) [2023-12-28 07:28:45,898][106226] Updated weights for policy 0, policy_version 1700100 (0.0006) [2023-12-28 07:28:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 871604224. Throughput: 0: 9774.9, 1: 10021.2. Samples: 871593120. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:46,176][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.651')] [2023-12-28 07:28:46,378][106225] Updated weights for policy 1, policy_version 1704073 (0.0006) [2023-12-28 07:28:46,444][106225] Updated weights for policy 1, policy_version 1704083 (0.0008) [2023-12-28 07:28:46,495][106225] Updated weights for policy 1, policy_version 1704093 (0.0007) [2023-12-28 07:28:46,509][106226] Updated weights for policy 0, policy_version 1700110 (0.0008) [2023-12-28 07:28:46,545][106225] Updated weights for policy 1, policy_version 1704103 (0.0007) [2023-12-28 07:28:46,567][106226] Updated weights for policy 0, policy_version 1700120 (0.0008) [2023-12-28 07:28:46,632][106226] Updated weights for policy 0, policy_version 1700130 (0.0010) [2023-12-28 07:28:47,242][106225] Updated weights for policy 1, policy_version 1704113 (0.0007) [2023-12-28 07:28:47,292][106225] Updated weights for policy 1, policy_version 1704123 (0.0007) [2023-12-28 07:28:47,298][106226] Updated weights for policy 0, policy_version 1700140 (0.0011) [2023-12-28 07:28:47,338][106225] Updated weights for policy 1, policy_version 1704133 (0.0005) [2023-12-28 07:28:47,344][106226] Updated weights for policy 0, policy_version 1700150 (0.0010) [2023-12-28 07:28:47,394][106226] Updated weights for policy 0, policy_version 1700160 (0.0010) [2023-12-28 07:28:48,011][106225] Updated weights for policy 1, policy_version 1704143 (0.0005) [2023-12-28 07:28:48,058][106225] Updated weights for policy 1, policy_version 1704153 (0.0005) [2023-12-28 07:28:48,106][106225] Updated weights for policy 1, policy_version 1704163 (0.0007) [2023-12-28 07:28:48,122][106226] Updated weights for policy 0, policy_version 1700170 (0.0011) [2023-12-28 07:28:48,169][106226] Updated weights for policy 0, policy_version 1700180 (0.0011) [2023-12-28 07:28:48,219][106226] Updated weights for policy 0, policy_version 1700190 (0.0010) [2023-12-28 07:28:48,276][106226] Updated weights for policy 0, policy_version 1700200 (0.0010) [2023-12-28 07:28:48,809][106225] Updated weights for policy 1, policy_version 1704173 (0.0007) [2023-12-28 07:28:48,873][106225] Updated weights for policy 1, policy_version 1704183 (0.0007) [2023-12-28 07:28:48,937][106225] Updated weights for policy 1, policy_version 1704193 (0.0010) [2023-12-28 07:28:49,045][106226] Updated weights for policy 0, policy_version 1700210 (0.0011) [2023-12-28 07:28:49,105][106226] Updated weights for policy 0, policy_version 1700220 (0.0011) [2023-12-28 07:28:49,165][106226] Updated weights for policy 0, policy_version 1700230 (0.0011) [2023-12-28 07:28:49,634][106225] Updated weights for policy 1, policy_version 1704203 (0.0009) [2023-12-28 07:28:49,686][106225] Updated weights for policy 1, policy_version 1704213 (0.0005) [2023-12-28 07:28:49,748][106225] Updated weights for policy 1, policy_version 1704223 (0.0005) [2023-12-28 07:28:49,894][106226] Updated weights for policy 0, policy_version 1700240 (0.0009) [2023-12-28 07:28:49,965][106226] Updated weights for policy 0, policy_version 1700250 (0.0009) [2023-12-28 07:28:50,026][106226] Updated weights for policy 0, policy_version 1700260 (0.0010) [2023-12-28 07:28:50,409][106225] Updated weights for policy 1, policy_version 1704233 (0.0005) [2023-12-28 07:28:50,466][106225] Updated weights for policy 1, policy_version 1704243 (0.0005) [2023-12-28 07:28:50,522][106225] Updated weights for policy 1, policy_version 1704253 (0.0006) [2023-12-28 07:28:50,590][106225] Updated weights for policy 1, policy_version 1704263 (0.0008) [2023-12-28 07:28:50,755][106226] Updated weights for policy 0, policy_version 1700270 (0.0006) [2023-12-28 07:28:50,818][106226] Updated weights for policy 0, policy_version 1700280 (0.0006) [2023-12-28 07:28:50,881][106226] Updated weights for policy 0, policy_version 1700290 (0.0006) [2023-12-28 07:28:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 871702528. Throughput: 0: 9818.5, 1: 10089.2. Samples: 871713316. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:51,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.591')] [2023-12-28 07:28:51,366][106225] Updated weights for policy 1, policy_version 1704273 (0.0008) [2023-12-28 07:28:51,423][106225] Updated weights for policy 1, policy_version 1704283 (0.0009) [2023-12-28 07:28:51,468][106226] Updated weights for policy 0, policy_version 1700300 (0.0007) [2023-12-28 07:28:51,486][106225] Updated weights for policy 1, policy_version 1704293 (0.0007) [2023-12-28 07:28:51,520][106226] Updated weights for policy 0, policy_version 1700310 (0.0006) [2023-12-28 07:28:51,576][106226] Updated weights for policy 0, policy_version 1700320 (0.0005) [2023-12-28 07:28:52,211][106225] Updated weights for policy 1, policy_version 1704303 (0.0007) [2023-12-28 07:28:52,269][106225] Updated weights for policy 1, policy_version 1704313 (0.0006) [2023-12-28 07:28:52,278][106226] Updated weights for policy 0, policy_version 1700330 (0.0008) [2023-12-28 07:28:52,324][106225] Updated weights for policy 1, policy_version 1704323 (0.0005) [2023-12-28 07:28:52,337][106226] Updated weights for policy 0, policy_version 1700340 (0.0008) [2023-12-28 07:28:52,407][106226] Updated weights for policy 0, policy_version 1700350 (0.0009) [2023-12-28 07:28:52,471][106226] Updated weights for policy 0, policy_version 1700360 (0.0009) [2023-12-28 07:28:53,097][106225] Updated weights for policy 1, policy_version 1704333 (0.0008) [2023-12-28 07:28:53,155][106225] Updated weights for policy 1, policy_version 1704343 (0.0008) [2023-12-28 07:28:53,203][106226] Updated weights for policy 0, policy_version 1700370 (0.0007) [2023-12-28 07:28:53,217][106225] Updated weights for policy 1, policy_version 1704353 (0.0006) [2023-12-28 07:28:53,263][106226] Updated weights for policy 0, policy_version 1700380 (0.0006) [2023-12-28 07:28:53,335][106226] Updated weights for policy 0, policy_version 1700390 (0.0009) [2023-12-28 07:28:53,818][106225] Updated weights for policy 1, policy_version 1704363 (0.0007) [2023-12-28 07:28:53,878][106225] Updated weights for policy 1, policy_version 1704373 (0.0008) [2023-12-28 07:28:53,941][106225] Updated weights for policy 1, policy_version 1704383 (0.0005) [2023-12-28 07:28:54,021][106226] Updated weights for policy 0, policy_version 1700400 (0.0006) [2023-12-28 07:28:54,076][106226] Updated weights for policy 0, policy_version 1700410 (0.0005) [2023-12-28 07:28:54,140][106226] Updated weights for policy 0, policy_version 1700420 (0.0005) [2023-12-28 07:28:54,519][106225] Updated weights for policy 1, policy_version 1704393 (0.0005) [2023-12-28 07:28:54,575][106225] Updated weights for policy 1, policy_version 1704403 (0.0010) [2023-12-28 07:28:54,626][106225] Updated weights for policy 1, policy_version 1704413 (0.0010) [2023-12-28 07:28:54,680][106225] Updated weights for policy 1, policy_version 1704423 (0.0010) [2023-12-28 07:28:54,779][106226] Updated weights for policy 0, policy_version 1700430 (0.0005) [2023-12-28 07:28:54,853][106226] Updated weights for policy 0, policy_version 1700440 (0.0006) [2023-12-28 07:28:54,919][106226] Updated weights for policy 0, policy_version 1700450 (0.0005) [2023-12-28 07:28:55,336][106225] Updated weights for policy 1, policy_version 1704433 (0.0010) [2023-12-28 07:28:55,382][106225] Updated weights for policy 1, policy_version 1704443 (0.0010) [2023-12-28 07:28:55,435][106225] Updated weights for policy 1, policy_version 1704453 (0.0010) [2023-12-28 07:28:55,539][106226] Updated weights for policy 0, policy_version 1700460 (0.0007) [2023-12-28 07:28:55,585][106226] Updated weights for policy 0, policy_version 1700470 (0.0010) [2023-12-28 07:28:55,641][106226] Updated weights for policy 0, policy_version 1700480 (0.0010) [2023-12-28 07:28:56,159][106225] Updated weights for policy 1, policy_version 1704463 (0.0007) [2023-12-28 07:28:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 871800832. Throughput: 0: 9815.4, 1: 10112.7. Samples: 871772424. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:28:56,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.938')] [2023-12-28 07:28:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001700488_435404800.pth... [2023-12-28 07:28:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001699336_435109888.pth [2023-12-28 07:28:56,215][106225] Updated weights for policy 1, policy_version 1704473 (0.0008) [2023-12-28 07:28:56,272][106225] Updated weights for policy 1, policy_version 1704483 (0.0007) [2023-12-28 07:28:56,294][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001704488_436404224.pth... [2023-12-28 07:28:56,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001703272_436092928.pth [2023-12-28 07:28:56,368][106226] Updated weights for policy 0, policy_version 1700490 (0.0010) [2023-12-28 07:28:56,424][106226] Updated weights for policy 0, policy_version 1700500 (0.0011) [2023-12-28 07:28:56,488][106226] Updated weights for policy 0, policy_version 1700510 (0.0011) [2023-12-28 07:28:56,544][106226] Updated weights for policy 0, policy_version 1700520 (0.0010) [2023-12-28 07:28:56,881][106225] Updated weights for policy 1, policy_version 1704493 (0.0005) [2023-12-28 07:28:56,931][106225] Updated weights for policy 1, policy_version 1704503 (0.0005) [2023-12-28 07:28:56,981][106225] Updated weights for policy 1, policy_version 1704513 (0.0005) [2023-12-28 07:28:57,247][106226] Updated weights for policy 0, policy_version 1700530 (0.0010) [2023-12-28 07:28:57,302][106226] Updated weights for policy 0, policy_version 1700540 (0.0009) [2023-12-28 07:28:57,356][106226] Updated weights for policy 0, policy_version 1700550 (0.0007) [2023-12-28 07:28:57,511][106225] Updated weights for policy 1, policy_version 1704523 (0.0006) [2023-12-28 07:28:57,564][106225] Updated weights for policy 1, policy_version 1704533 (0.0010) [2023-12-28 07:28:57,626][106225] Updated weights for policy 1, policy_version 1704543 (0.0010) [2023-12-28 07:28:58,062][106226] Updated weights for policy 0, policy_version 1700560 (0.0010) [2023-12-28 07:28:58,108][106226] Updated weights for policy 0, policy_version 1700570 (0.0010) [2023-12-28 07:28:58,163][106226] Updated weights for policy 0, policy_version 1700580 (0.0010) [2023-12-28 07:28:58,214][106225] Updated weights for policy 1, policy_version 1704553 (0.0010) [2023-12-28 07:28:58,281][106225] Updated weights for policy 1, policy_version 1704563 (0.0007) [2023-12-28 07:28:58,356][106225] Updated weights for policy 1, policy_version 1704573 (0.0010) [2023-12-28 07:28:58,416][106225] Updated weights for policy 1, policy_version 1704583 (0.0009) [2023-12-28 07:28:59,001][106226] Updated weights for policy 0, policy_version 1700590 (0.0008) [2023-12-28 07:28:59,062][106226] Updated weights for policy 0, policy_version 1700600 (0.0008) [2023-12-28 07:28:59,128][106226] Updated weights for policy 0, policy_version 1700610 (0.0008) [2023-12-28 07:28:59,166][106225] Updated weights for policy 1, policy_version 1704593 (0.0010) [2023-12-28 07:28:59,236][106225] Updated weights for policy 1, policy_version 1704604 (0.0009) [2023-12-28 07:28:59,303][106225] Updated weights for policy 1, policy_version 1704614 (0.0009) [2023-12-28 07:28:59,870][106226] Updated weights for policy 0, policy_version 1700620 (0.0008) [2023-12-28 07:28:59,964][106226] Updated weights for policy 0, policy_version 1700630 (0.0008) [2023-12-28 07:28:59,982][106225] Updated weights for policy 1, policy_version 1704624 (0.0008) [2023-12-28 07:29:00,025][106226] Updated weights for policy 0, policy_version 1700640 (0.0007) [2023-12-28 07:29:00,041][106225] Updated weights for policy 1, policy_version 1704634 (0.0008) [2023-12-28 07:29:00,096][106225] Updated weights for policy 1, policy_version 1704644 (0.0008) [2023-12-28 07:29:00,716][106226] Updated weights for policy 0, policy_version 1700650 (0.0007) [2023-12-28 07:29:00,771][106225] Updated weights for policy 1, policy_version 1704654 (0.0009) [2023-12-28 07:29:00,786][106226] Updated weights for policy 0, policy_version 1700660 (0.0007) [2023-12-28 07:29:00,829][106225] Updated weights for policy 1, policy_version 1704664 (0.0008) [2023-12-28 07:29:00,840][106226] Updated weights for policy 0, policy_version 1700670 (0.0010) [2023-12-28 07:29:00,889][106225] Updated weights for policy 1, policy_version 1704674 (0.0010) [2023-12-28 07:29:00,895][106226] Updated weights for policy 0, policy_version 1700680 (0.0011) [2023-12-28 07:29:01,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 871907328. Throughput: 0: 9845.9, 1: 10239.9. Samples: 871894680. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:01,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-5.162')] [2023-12-28 07:29:01,578][106225] Updated weights for policy 1, policy_version 1704684 (0.0005) [2023-12-28 07:29:01,625][106226] Updated weights for policy 0, policy_version 1700690 (0.0008) [2023-12-28 07:29:01,639][106225] Updated weights for policy 1, policy_version 1704694 (0.0008) [2023-12-28 07:29:01,683][106226] Updated weights for policy 0, policy_version 1700700 (0.0007) [2023-12-28 07:29:01,696][106225] Updated weights for policy 1, policy_version 1704704 (0.0010) [2023-12-28 07:29:01,750][106226] Updated weights for policy 0, policy_version 1700710 (0.0007) [2023-12-28 07:29:02,415][106225] Updated weights for policy 1, policy_version 1704714 (0.0010) [2023-12-28 07:29:02,454][106226] Updated weights for policy 0, policy_version 1700720 (0.0006) [2023-12-28 07:29:02,471][106225] Updated weights for policy 1, policy_version 1704724 (0.0010) [2023-12-28 07:29:02,516][106226] Updated weights for policy 0, policy_version 1700730 (0.0006) [2023-12-28 07:29:02,522][106225] Updated weights for policy 1, policy_version 1704734 (0.0010) [2023-12-28 07:29:02,567][106226] Updated weights for policy 0, policy_version 1700740 (0.0006) [2023-12-28 07:29:02,576][106225] Updated weights for policy 1, policy_version 1704744 (0.0010) [2023-12-28 07:29:03,312][106226] Updated weights for policy 0, policy_version 1700750 (0.0007) [2023-12-28 07:29:03,333][106225] Updated weights for policy 1, policy_version 1704754 (0.0010) [2023-12-28 07:29:03,369][106226] Updated weights for policy 0, policy_version 1700760 (0.0006) [2023-12-28 07:29:03,379][106225] Updated weights for policy 1, policy_version 1704764 (0.0010) [2023-12-28 07:29:03,423][106226] Updated weights for policy 0, policy_version 1700770 (0.0005) [2023-12-28 07:29:03,425][106225] Updated weights for policy 1, policy_version 1704774 (0.0010) [2023-12-28 07:29:04,156][106226] Updated weights for policy 0, policy_version 1700780 (0.0006) [2023-12-28 07:29:04,162][106225] Updated weights for policy 1, policy_version 1704784 (0.0010) [2023-12-28 07:29:04,218][106226] Updated weights for policy 0, policy_version 1700790 (0.0005) [2023-12-28 07:29:04,228][106225] Updated weights for policy 1, policy_version 1704794 (0.0010) [2023-12-28 07:29:04,285][106226] Updated weights for policy 0, policy_version 1700800 (0.0007) [2023-12-28 07:29:04,287][106225] Updated weights for policy 1, policy_version 1704804 (0.0010) [2023-12-28 07:29:04,902][106225] Updated weights for policy 1, policy_version 1704814 (0.0007) [2023-12-28 07:29:04,928][106226] Updated weights for policy 0, policy_version 1700810 (0.0008) [2023-12-28 07:29:04,959][106225] Updated weights for policy 1, policy_version 1704824 (0.0006) [2023-12-28 07:29:04,992][106226] Updated weights for policy 0, policy_version 1700820 (0.0009) [2023-12-28 07:29:05,023][106225] Updated weights for policy 1, policy_version 1704834 (0.0010) [2023-12-28 07:29:05,050][106226] Updated weights for policy 0, policy_version 1700830 (0.0006) [2023-12-28 07:29:05,106][106226] Updated weights for policy 0, policy_version 1700840 (0.0005) [2023-12-28 07:29:05,641][106226] Updated weights for policy 0, policy_version 1700850 (0.0008) [2023-12-28 07:29:05,692][106226] Updated weights for policy 0, policy_version 1700860 (0.0006) [2023-12-28 07:29:05,711][106225] Updated weights for policy 1, policy_version 1704844 (0.0010) [2023-12-28 07:29:05,738][106226] Updated weights for policy 0, policy_version 1700870 (0.0005) [2023-12-28 07:29:05,768][106225] Updated weights for policy 1, policy_version 1704854 (0.0010) [2023-12-28 07:29:05,829][106225] Updated weights for policy 1, policy_version 1704864 (0.0010) [2023-12-28 07:29:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 872005632. Throughput: 0: 9814.8, 1: 10204.1. Samples: 872015172. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:06,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.012')] [2023-12-28 07:29:06,433][106226] Updated weights for policy 0, policy_version 1700880 (0.0007) [2023-12-28 07:29:06,503][106226] Updated weights for policy 0, policy_version 1700890 (0.0008) [2023-12-28 07:29:06,543][106225] Updated weights for policy 1, policy_version 1704874 (0.0009) [2023-12-28 07:29:06,571][106226] Updated weights for policy 0, policy_version 1700900 (0.0009) [2023-12-28 07:29:06,602][106225] Updated weights for policy 1, policy_version 1704884 (0.0008) [2023-12-28 07:29:06,668][106225] Updated weights for policy 1, policy_version 1704894 (0.0010) [2023-12-28 07:29:06,733][106225] Updated weights for policy 1, policy_version 1704904 (0.0011) [2023-12-28 07:29:07,293][106226] Updated weights for policy 0, policy_version 1700910 (0.0008) [2023-12-28 07:29:07,343][106226] Updated weights for policy 0, policy_version 1700920 (0.0007) [2023-12-28 07:29:07,406][106226] Updated weights for policy 0, policy_version 1700930 (0.0009) [2023-12-28 07:29:07,421][106225] Updated weights for policy 1, policy_version 1704914 (0.0006) [2023-12-28 07:29:07,489][106225] Updated weights for policy 1, policy_version 1704924 (0.0008) [2023-12-28 07:29:07,550][106225] Updated weights for policy 1, policy_version 1704934 (0.0008) [2023-12-28 07:29:08,175][106226] Updated weights for policy 0, policy_version 1700940 (0.0008) [2023-12-28 07:29:08,227][106226] Updated weights for policy 0, policy_version 1700950 (0.0008) [2023-12-28 07:29:08,258][106225] Updated weights for policy 1, policy_version 1704944 (0.0008) [2023-12-28 07:29:08,283][106226] Updated weights for policy 0, policy_version 1700960 (0.0006) [2023-12-28 07:29:08,315][106225] Updated weights for policy 1, policy_version 1704954 (0.0010) [2023-12-28 07:29:08,382][106225] Updated weights for policy 1, policy_version 1704964 (0.0010) [2023-12-28 07:29:09,017][106226] Updated weights for policy 0, policy_version 1700970 (0.0007) [2023-12-28 07:29:09,029][106225] Updated weights for policy 1, policy_version 1704974 (0.0009) [2023-12-28 07:29:09,077][106226] Updated weights for policy 0, policy_version 1700980 (0.0005) [2023-12-28 07:29:09,086][106225] Updated weights for policy 1, policy_version 1704984 (0.0008) [2023-12-28 07:29:09,129][106226] Updated weights for policy 0, policy_version 1700990 (0.0005) [2023-12-28 07:29:09,131][106225] Updated weights for policy 1, policy_version 1704994 (0.0008) [2023-12-28 07:29:09,180][106226] Updated weights for policy 0, policy_version 1701000 (0.0005) [2023-12-28 07:29:09,846][106226] Updated weights for policy 0, policy_version 1701010 (0.0009) [2023-12-28 07:29:09,908][106226] Updated weights for policy 0, policy_version 1701020 (0.0007) [2023-12-28 07:29:09,968][106225] Updated weights for policy 1, policy_version 1705004 (0.0008) [2023-12-28 07:29:09,978][106226] Updated weights for policy 0, policy_version 1701030 (0.0008) [2023-12-28 07:29:10,027][106225] Updated weights for policy 1, policy_version 1705014 (0.0006) [2023-12-28 07:29:10,092][106225] Updated weights for policy 1, policy_version 1705024 (0.0007) [2023-12-28 07:29:10,734][106226] Updated weights for policy 0, policy_version 1701040 (0.0009) [2023-12-28 07:29:10,798][106226] Updated weights for policy 0, policy_version 1701050 (0.0011) [2023-12-28 07:29:10,822][106225] Updated weights for policy 1, policy_version 1705034 (0.0008) [2023-12-28 07:29:10,866][106226] Updated weights for policy 0, policy_version 1701060 (0.0011) [2023-12-28 07:29:10,887][106225] Updated weights for policy 1, policy_version 1705044 (0.0006) [2023-12-28 07:29:10,941][106225] Updated weights for policy 1, policy_version 1705054 (0.0005) [2023-12-28 07:29:10,995][106225] Updated weights for policy 1, policy_version 1705064 (0.0005) [2023-12-28 07:29:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 872103936. Throughput: 0: 9812.1, 1: 10177.4. Samples: 872072952. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:11,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.551')] [2023-12-28 07:29:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001705064_436551680.pth... [2023-12-28 07:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001701064_435552256.pth... [2023-12-28 07:29:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001699912_435257344.pth [2023-12-28 07:29:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001703880_436248576.pth [2023-12-28 07:29:11,638][106226] Updated weights for policy 0, policy_version 1701070 (0.0009) [2023-12-28 07:29:11,692][106225] Updated weights for policy 1, policy_version 1705074 (0.0009) [2023-12-28 07:29:11,698][106226] Updated weights for policy 0, policy_version 1701080 (0.0007) [2023-12-28 07:29:11,760][106225] Updated weights for policy 1, policy_version 1705084 (0.0008) [2023-12-28 07:29:11,775][106226] Updated weights for policy 0, policy_version 1701090 (0.0008) [2023-12-28 07:29:11,821][106225] Updated weights for policy 1, policy_version 1705094 (0.0008) [2023-12-28 07:29:12,506][106226] Updated weights for policy 0, policy_version 1701100 (0.0007) [2023-12-28 07:29:12,571][106225] Updated weights for policy 1, policy_version 1705104 (0.0007) [2023-12-28 07:29:12,573][106226] Updated weights for policy 0, policy_version 1701110 (0.0007) [2023-12-28 07:29:12,636][106226] Updated weights for policy 0, policy_version 1701120 (0.0006) [2023-12-28 07:29:12,637][106225] Updated weights for policy 1, policy_version 1705114 (0.0008) [2023-12-28 07:29:12,702][106225] Updated weights for policy 1, policy_version 1705124 (0.0009) [2023-12-28 07:29:13,313][106226] Updated weights for policy 0, policy_version 1701130 (0.0008) [2023-12-28 07:29:13,342][106225] Updated weights for policy 1, policy_version 1705134 (0.0006) [2023-12-28 07:29:13,378][106226] Updated weights for policy 0, policy_version 1701140 (0.0007) [2023-12-28 07:29:13,402][106225] Updated weights for policy 1, policy_version 1705144 (0.0005) [2023-12-28 07:29:13,448][106226] Updated weights for policy 0, policy_version 1701150 (0.0006) [2023-12-28 07:29:13,455][106225] Updated weights for policy 1, policy_version 1705154 (0.0005) [2023-12-28 07:29:13,515][106226] Updated weights for policy 0, policy_version 1701160 (0.0006) [2023-12-28 07:29:14,072][106225] Updated weights for policy 1, policy_version 1705164 (0.0005) [2023-12-28 07:29:14,108][106226] Updated weights for policy 0, policy_version 1701170 (0.0008) [2023-12-28 07:29:14,130][106225] Updated weights for policy 1, policy_version 1705174 (0.0007) [2023-12-28 07:29:14,170][106226] Updated weights for policy 0, policy_version 1701180 (0.0006) [2023-12-28 07:29:14,188][106225] Updated weights for policy 1, policy_version 1705184 (0.0010) [2023-12-28 07:29:14,233][106226] Updated weights for policy 0, policy_version 1701190 (0.0006) [2023-12-28 07:29:14,848][106225] Updated weights for policy 1, policy_version 1705194 (0.0010) [2023-12-28 07:29:14,904][106226] Updated weights for policy 0, policy_version 1701200 (0.0010) [2023-12-28 07:29:14,911][106225] Updated weights for policy 1, policy_version 1705204 (0.0008) [2023-12-28 07:29:14,973][106226] Updated weights for policy 0, policy_version 1701210 (0.0009) [2023-12-28 07:29:14,977][106225] Updated weights for policy 1, policy_version 1705214 (0.0008) [2023-12-28 07:29:15,039][106225] Updated weights for policy 1, policy_version 1705224 (0.0006) [2023-12-28 07:29:15,040][106226] Updated weights for policy 0, policy_version 1701220 (0.0010) [2023-12-28 07:29:15,708][106225] Updated weights for policy 1, policy_version 1705234 (0.0007) [2023-12-28 07:29:15,729][106226] Updated weights for policy 0, policy_version 1701230 (0.0010) [2023-12-28 07:29:15,761][106225] Updated weights for policy 1, policy_version 1705244 (0.0006) [2023-12-28 07:29:15,782][106226] Updated weights for policy 0, policy_version 1701240 (0.0010) [2023-12-28 07:29:15,823][106225] Updated weights for policy 1, policy_version 1705254 (0.0005) [2023-12-28 07:29:15,829][106226] Updated weights for policy 0, policy_version 1701250 (0.0011) [2023-12-28 07:29:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 872202240. Throughput: 0: 9772.4, 1: 10157.7. Samples: 872189852. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:16,175][105115] Avg episode reward: [(0, '-4.172'), (1, '-4.838')] [2023-12-28 07:29:16,555][106226] Updated weights for policy 0, policy_version 1701260 (0.0010) [2023-12-28 07:29:16,565][106225] Updated weights for policy 1, policy_version 1705264 (0.0006) [2023-12-28 07:29:16,601][106226] Updated weights for policy 0, policy_version 1701270 (0.0010) [2023-12-28 07:29:16,627][106225] Updated weights for policy 1, policy_version 1705274 (0.0005) [2023-12-28 07:29:16,652][106226] Updated weights for policy 0, policy_version 1701280 (0.0008) [2023-12-28 07:29:16,685][106225] Updated weights for policy 1, policy_version 1705284 (0.0007) [2023-12-28 07:29:17,371][106225] Updated weights for policy 1, policy_version 1705294 (0.0008) [2023-12-28 07:29:17,399][106226] Updated weights for policy 0, policy_version 1701290 (0.0006) [2023-12-28 07:29:17,429][106225] Updated weights for policy 1, policy_version 1705304 (0.0007) [2023-12-28 07:29:17,443][106226] Updated weights for policy 0, policy_version 1701300 (0.0006) [2023-12-28 07:29:17,488][106225] Updated weights for policy 1, policy_version 1705314 (0.0008) [2023-12-28 07:29:17,491][106226] Updated weights for policy 0, policy_version 1701310 (0.0007) [2023-12-28 07:29:17,536][106226] Updated weights for policy 0, policy_version 1701320 (0.0006) [2023-12-28 07:29:18,154][106225] Updated weights for policy 1, policy_version 1705324 (0.0005) [2023-12-28 07:29:18,217][106225] Updated weights for policy 1, policy_version 1705334 (0.0005) [2023-12-28 07:29:18,268][106225] Updated weights for policy 1, policy_version 1705344 (0.0006) [2023-12-28 07:29:18,327][106226] Updated weights for policy 0, policy_version 1701330 (0.0008) [2023-12-28 07:29:18,388][106226] Updated weights for policy 0, policy_version 1701340 (0.0008) [2023-12-28 07:29:18,451][106226] Updated weights for policy 0, policy_version 1701350 (0.0009) [2023-12-28 07:29:18,946][106225] Updated weights for policy 1, policy_version 1705354 (0.0007) [2023-12-28 07:29:19,000][106225] Updated weights for policy 1, policy_version 1705364 (0.0007) [2023-12-28 07:29:19,056][106225] Updated weights for policy 1, policy_version 1705374 (0.0008) [2023-12-28 07:29:19,137][106226] Updated weights for policy 0, policy_version 1701360 (0.0006) [2023-12-28 07:29:19,190][106226] Updated weights for policy 0, policy_version 1701370 (0.0005) [2023-12-28 07:29:19,255][106226] Updated weights for policy 0, policy_version 1701380 (0.0007) [2023-12-28 07:29:19,726][106225] Updated weights for policy 1, policy_version 1705385 (0.0007) [2023-12-28 07:29:19,783][106225] Updated weights for policy 1, policy_version 1705395 (0.0006) [2023-12-28 07:29:19,865][106225] Updated weights for policy 1, policy_version 1705405 (0.0008) [2023-12-28 07:29:19,931][106225] Updated weights for policy 1, policy_version 1705415 (0.0010) [2023-12-28 07:29:19,999][106226] Updated weights for policy 0, policy_version 1701390 (0.0008) [2023-12-28 07:29:20,061][106226] Updated weights for policy 0, policy_version 1701400 (0.0008) [2023-12-28 07:29:20,129][106226] Updated weights for policy 0, policy_version 1701410 (0.0008) [2023-12-28 07:29:20,626][106225] Updated weights for policy 1, policy_version 1705425 (0.0008) [2023-12-28 07:29:20,689][106225] Updated weights for policy 1, policy_version 1705435 (0.0011) [2023-12-28 07:29:20,748][106225] Updated weights for policy 1, policy_version 1705445 (0.0010) [2023-12-28 07:29:20,861][106226] Updated weights for policy 0, policy_version 1701420 (0.0008) [2023-12-28 07:29:20,926][106226] Updated weights for policy 0, policy_version 1701430 (0.0008) [2023-12-28 07:29:20,992][106226] Updated weights for policy 0, policy_version 1701440 (0.0008) [2023-12-28 07:29:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 872300544. Throughput: 0: 9826.9, 1: 10020.3. Samples: 872306536. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:21,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.748')] [2023-12-28 07:29:21,542][106225] Updated weights for policy 1, policy_version 1705455 (0.0009) [2023-12-28 07:29:21,602][106225] Updated weights for policy 1, policy_version 1705465 (0.0007) [2023-12-28 07:29:21,675][106225] Updated weights for policy 1, policy_version 1705475 (0.0008) [2023-12-28 07:29:21,796][106226] Updated weights for policy 0, policy_version 1701450 (0.0008) [2023-12-28 07:29:21,861][106226] Updated weights for policy 0, policy_version 1701460 (0.0008) [2023-12-28 07:29:21,931][106226] Updated weights for policy 0, policy_version 1701470 (0.0009) [2023-12-28 07:29:21,989][106226] Updated weights for policy 0, policy_version 1701480 (0.0008) [2023-12-28 07:29:22,500][106225] Updated weights for policy 1, policy_version 1705485 (0.0009) [2023-12-28 07:29:22,558][106225] Updated weights for policy 1, policy_version 1705495 (0.0008) [2023-12-28 07:29:22,639][106225] Updated weights for policy 1, policy_version 1705505 (0.0008) [2023-12-28 07:29:22,727][106226] Updated weights for policy 0, policy_version 1701490 (0.0009) [2023-12-28 07:29:22,783][106226] Updated weights for policy 0, policy_version 1701500 (0.0008) [2023-12-28 07:29:22,842][106226] Updated weights for policy 0, policy_version 1701510 (0.0009) [2023-12-28 07:29:23,361][106225] Updated weights for policy 1, policy_version 1705515 (0.0008) [2023-12-28 07:29:23,421][106225] Updated weights for policy 1, policy_version 1705525 (0.0009) [2023-12-28 07:29:23,469][106225] Updated weights for policy 1, policy_version 1705535 (0.0008) [2023-12-28 07:29:23,563][106226] Updated weights for policy 0, policy_version 1701520 (0.0009) [2023-12-28 07:29:23,609][106226] Updated weights for policy 0, policy_version 1701530 (0.0008) [2023-12-28 07:29:23,658][106226] Updated weights for policy 0, policy_version 1701540 (0.0006) [2023-12-28 07:29:24,216][106225] Updated weights for policy 1, policy_version 1705545 (0.0008) [2023-12-28 07:29:24,275][106225] Updated weights for policy 1, policy_version 1705555 (0.0008) [2023-12-28 07:29:24,331][106225] Updated weights for policy 1, policy_version 1705565 (0.0009) [2023-12-28 07:29:24,383][106226] Updated weights for policy 0, policy_version 1701550 (0.0007) [2023-12-28 07:29:24,388][106225] Updated weights for policy 1, policy_version 1705575 (0.0008) [2023-12-28 07:29:24,436][106226] Updated weights for policy 0, policy_version 1701560 (0.0008) [2023-12-28 07:29:24,486][106226] Updated weights for policy 0, policy_version 1701570 (0.0007) [2023-12-28 07:29:25,124][106225] Updated weights for policy 1, policy_version 1705585 (0.0008) [2023-12-28 07:29:25,185][106225] Updated weights for policy 1, policy_version 1705595 (0.0009) [2023-12-28 07:29:25,188][106226] Updated weights for policy 0, policy_version 1701580 (0.0007) [2023-12-28 07:29:25,240][106225] Updated weights for policy 1, policy_version 1705605 (0.0006) [2023-12-28 07:29:25,242][106226] Updated weights for policy 0, policy_version 1701590 (0.0007) [2023-12-28 07:29:25,291][106226] Updated weights for policy 0, policy_version 1701600 (0.0008) [2023-12-28 07:29:25,851][106225] Updated weights for policy 1, policy_version 1705615 (0.0008) [2023-12-28 07:29:25,901][106225] Updated weights for policy 1, policy_version 1705625 (0.0009) [2023-12-28 07:29:25,953][106225] Updated weights for policy 1, policy_version 1705635 (0.0008) [2023-12-28 07:29:26,046][106226] Updated weights for policy 0, policy_version 1701610 (0.0009) [2023-12-28 07:29:26,116][106226] Updated weights for policy 0, policy_version 1701620 (0.0006) [2023-12-28 07:29:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 872390656. Throughput: 0: 9799.3, 1: 9974.0. Samples: 872362360. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:26,176][105115] Avg episode reward: [(0, '-4.380'), (1, '-4.788')] [2023-12-28 07:29:26,179][106226] Updated weights for policy 0, policy_version 1701630 (0.0008) [2023-12-28 07:29:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001705640_436699136.pth... [2023-12-28 07:29:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001704488_436404224.pth [2023-12-28 07:29:26,242][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001701640_435699712.pth... [2023-12-28 07:29:26,244][106226] Updated weights for policy 0, policy_version 1701640 (0.0006) [2023-12-28 07:29:26,246][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001700488_435404800.pth [2023-12-28 07:29:26,728][106225] Updated weights for policy 1, policy_version 1705645 (0.0008) [2023-12-28 07:29:26,783][106225] Updated weights for policy 1, policy_version 1705655 (0.0008) [2023-12-28 07:29:26,830][106225] Updated weights for policy 1, policy_version 1705665 (0.0008) [2023-12-28 07:29:26,882][106226] Updated weights for policy 0, policy_version 1701650 (0.0007) [2023-12-28 07:29:26,938][106226] Updated weights for policy 0, policy_version 1701660 (0.0008) [2023-12-28 07:29:26,988][106226] Updated weights for policy 0, policy_version 1701670 (0.0008) [2023-12-28 07:29:27,533][106225] Updated weights for policy 1, policy_version 1705675 (0.0007) [2023-12-28 07:29:27,577][106225] Updated weights for policy 1, policy_version 1705685 (0.0008) [2023-12-28 07:29:27,628][106225] Updated weights for policy 1, policy_version 1705695 (0.0006) [2023-12-28 07:29:27,704][106226] Updated weights for policy 0, policy_version 1701680 (0.0008) [2023-12-28 07:29:27,769][106226] Updated weights for policy 0, policy_version 1701690 (0.0008) [2023-12-28 07:29:27,819][106226] Updated weights for policy 0, policy_version 1701700 (0.0008) [2023-12-28 07:29:28,257][106225] Updated weights for policy 1, policy_version 1705705 (0.0005) [2023-12-28 07:29:28,308][106225] Updated weights for policy 1, policy_version 1705715 (0.0008) [2023-12-28 07:29:28,372][106225] Updated weights for policy 1, policy_version 1705725 (0.0008) [2023-12-28 07:29:28,430][106225] Updated weights for policy 1, policy_version 1705735 (0.0009) [2023-12-28 07:29:28,590][106226] Updated weights for policy 0, policy_version 1701710 (0.0009) [2023-12-28 07:29:28,648][106226] Updated weights for policy 0, policy_version 1701720 (0.0009) [2023-12-28 07:29:28,702][106226] Updated weights for policy 0, policy_version 1701730 (0.0008) [2023-12-28 07:29:29,125][106225] Updated weights for policy 1, policy_version 1705745 (0.0008) [2023-12-28 07:29:29,185][106225] Updated weights for policy 1, policy_version 1705755 (0.0006) [2023-12-28 07:29:29,243][106225] Updated weights for policy 1, policy_version 1705765 (0.0008) [2023-12-28 07:29:29,436][106226] Updated weights for policy 0, policy_version 1701740 (0.0008) [2023-12-28 07:29:29,498][106226] Updated weights for policy 0, policy_version 1701750 (0.0008) [2023-12-28 07:29:29,556][106226] Updated weights for policy 0, policy_version 1701760 (0.0008) [2023-12-28 07:29:29,932][106225] Updated weights for policy 1, policy_version 1705775 (0.0009) [2023-12-28 07:29:29,996][106225] Updated weights for policy 1, policy_version 1705785 (0.0006) [2023-12-28 07:29:30,060][106225] Updated weights for policy 1, policy_version 1705795 (0.0006) [2023-12-28 07:29:30,279][106226] Updated weights for policy 0, policy_version 1701770 (0.0008) [2023-12-28 07:29:30,342][106226] Updated weights for policy 0, policy_version 1701780 (0.0005) [2023-12-28 07:29:30,405][106226] Updated weights for policy 0, policy_version 1701790 (0.0008) [2023-12-28 07:29:30,470][106226] Updated weights for policy 0, policy_version 1701800 (0.0009) [2023-12-28 07:29:30,714][106225] Updated weights for policy 1, policy_version 1705805 (0.0008) [2023-12-28 07:29:30,760][106225] Updated weights for policy 1, policy_version 1705815 (0.0010) [2023-12-28 07:29:30,811][106225] Updated weights for policy 1, policy_version 1705825 (0.0008) [2023-12-28 07:29:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 872488960. Throughput: 0: 9756.4, 1: 9967.4. Samples: 872480688. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:31,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.632')] [2023-12-28 07:29:31,207][106226] Updated weights for policy 0, policy_version 1701810 (0.0008) [2023-12-28 07:29:31,268][106226] Updated weights for policy 0, policy_version 1701820 (0.0007) [2023-12-28 07:29:31,325][106226] Updated weights for policy 0, policy_version 1701830 (0.0005) [2023-12-28 07:29:31,508][106225] Updated weights for policy 1, policy_version 1705835 (0.0007) [2023-12-28 07:29:31,562][106225] Updated weights for policy 1, policy_version 1705845 (0.0008) [2023-12-28 07:29:31,623][106225] Updated weights for policy 1, policy_version 1705857 (0.0011) [2023-12-28 07:29:32,018][106226] Updated weights for policy 0, policy_version 1701840 (0.0008) [2023-12-28 07:29:32,073][106226] Updated weights for policy 0, policy_version 1701850 (0.0009) [2023-12-28 07:29:32,135][106226] Updated weights for policy 0, policy_version 1701860 (0.0008) [2023-12-28 07:29:32,433][106225] Updated weights for policy 1, policy_version 1705867 (0.0009) [2023-12-28 07:29:32,495][106225] Updated weights for policy 1, policy_version 1705877 (0.0009) [2023-12-28 07:29:32,541][106225] Updated weights for policy 1, policy_version 1705887 (0.0008) [2023-12-28 07:29:32,872][106226] Updated weights for policy 0, policy_version 1701870 (0.0007) [2023-12-28 07:29:32,927][106226] Updated weights for policy 0, policy_version 1701880 (0.0006) [2023-12-28 07:29:32,990][106226] Updated weights for policy 0, policy_version 1701890 (0.0005) [2023-12-28 07:29:33,231][106225] Updated weights for policy 1, policy_version 1705897 (0.0008) [2023-12-28 07:29:33,290][106225] Updated weights for policy 1, policy_version 1705907 (0.0005) [2023-12-28 07:29:33,342][106225] Updated weights for policy 1, policy_version 1705917 (0.0007) [2023-12-28 07:29:33,387][106225] Updated weights for policy 1, policy_version 1705927 (0.0007) [2023-12-28 07:29:33,617][106226] Updated weights for policy 0, policy_version 1701900 (0.0006) [2023-12-28 07:29:33,682][106226] Updated weights for policy 0, policy_version 1701910 (0.0005) [2023-12-28 07:29:33,734][106226] Updated weights for policy 0, policy_version 1701920 (0.0005) [2023-12-28 07:29:33,923][106225] Updated weights for policy 1, policy_version 1705937 (0.0006) [2023-12-28 07:29:33,975][106225] Updated weights for policy 1, policy_version 1705947 (0.0008) [2023-12-28 07:29:34,037][106225] Updated weights for policy 1, policy_version 1705957 (0.0008) [2023-12-28 07:29:34,356][106226] Updated weights for policy 0, policy_version 1701930 (0.0006) [2023-12-28 07:29:34,421][106226] Updated weights for policy 0, policy_version 1701940 (0.0007) [2023-12-28 07:29:34,487][106226] Updated weights for policy 0, policy_version 1701950 (0.0008) [2023-12-28 07:29:34,540][106226] Updated weights for policy 0, policy_version 1701960 (0.0009) [2023-12-28 07:29:34,797][106225] Updated weights for policy 1, policy_version 1705967 (0.0009) [2023-12-28 07:29:34,859][106225] Updated weights for policy 1, policy_version 1705977 (0.0007) [2023-12-28 07:29:34,923][106225] Updated weights for policy 1, policy_version 1705987 (0.0008) [2023-12-28 07:29:35,218][106226] Updated weights for policy 0, policy_version 1701970 (0.0009) [2023-12-28 07:29:35,270][106226] Updated weights for policy 0, policy_version 1701980 (0.0008) [2023-12-28 07:29:35,320][106226] Updated weights for policy 0, policy_version 1701990 (0.0008) [2023-12-28 07:29:35,659][106225] Updated weights for policy 1, policy_version 1705997 (0.0007) [2023-12-28 07:29:35,711][106225] Updated weights for policy 1, policy_version 1706007 (0.0005) [2023-12-28 07:29:35,770][106225] Updated weights for policy 1, policy_version 1706017 (0.0008) [2023-12-28 07:29:36,075][106226] Updated weights for policy 0, policy_version 1702000 (0.0008) [2023-12-28 07:29:36,132][106226] Updated weights for policy 0, policy_version 1702010 (0.0008) [2023-12-28 07:29:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 872587264. Throughput: 0: 9753.2, 1: 9978.0. Samples: 872601216. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:36,175][105115] Avg episode reward: [(0, '-4.448'), (1, '-4.729')] [2023-12-28 07:29:36,184][106226] Updated weights for policy 0, policy_version 1702020 (0.0006) [2023-12-28 07:29:36,496][106225] Updated weights for policy 1, policy_version 1706027 (0.0009) [2023-12-28 07:29:36,562][106225] Updated weights for policy 1, policy_version 1706037 (0.0008) [2023-12-28 07:29:36,620][106225] Updated weights for policy 1, policy_version 1706047 (0.0009) [2023-12-28 07:29:36,820][106226] Updated weights for policy 0, policy_version 1702030 (0.0008) [2023-12-28 07:29:36,881][106226] Updated weights for policy 0, policy_version 1702040 (0.0008) [2023-12-28 07:29:36,940][106226] Updated weights for policy 0, policy_version 1702050 (0.0008) [2023-12-28 07:29:37,350][106225] Updated weights for policy 1, policy_version 1706057 (0.0011) [2023-12-28 07:29:37,412][106225] Updated weights for policy 1, policy_version 1706067 (0.0011) [2023-12-28 07:29:37,470][106225] Updated weights for policy 1, policy_version 1706077 (0.0011) [2023-12-28 07:29:37,531][106225] Updated weights for policy 1, policy_version 1706087 (0.0010) [2023-12-28 07:29:37,694][106226] Updated weights for policy 0, policy_version 1702060 (0.0009) [2023-12-28 07:29:37,759][106226] Updated weights for policy 0, policy_version 1702070 (0.0007) [2023-12-28 07:29:37,822][106226] Updated weights for policy 0, policy_version 1702080 (0.0006) [2023-12-28 07:29:38,172][106225] Updated weights for policy 1, policy_version 1706097 (0.0007) [2023-12-28 07:29:38,224][106225] Updated weights for policy 1, policy_version 1706107 (0.0008) [2023-12-28 07:29:38,275][106225] Updated weights for policy 1, policy_version 1706117 (0.0008) [2023-12-28 07:29:38,572][106226] Updated weights for policy 0, policy_version 1702090 (0.0007) [2023-12-28 07:29:38,629][106226] Updated weights for policy 0, policy_version 1702100 (0.0009) [2023-12-28 07:29:38,680][106226] Updated weights for policy 0, policy_version 1702110 (0.0008) [2023-12-28 07:29:38,732][106226] Updated weights for policy 0, policy_version 1702120 (0.0009) [2023-12-28 07:29:38,975][106225] Updated weights for policy 1, policy_version 1706127 (0.0010) [2023-12-28 07:29:39,032][106225] Updated weights for policy 1, policy_version 1706137 (0.0010) [2023-12-28 07:29:39,090][106225] Updated weights for policy 1, policy_version 1706147 (0.0010) [2023-12-28 07:29:39,445][106226] Updated weights for policy 0, policy_version 1702130 (0.0008) [2023-12-28 07:29:39,501][106226] Updated weights for policy 0, policy_version 1702140 (0.0009) [2023-12-28 07:29:39,566][106226] Updated weights for policy 0, policy_version 1702150 (0.0009) [2023-12-28 07:29:39,850][106225] Updated weights for policy 1, policy_version 1706157 (0.0010) [2023-12-28 07:29:39,910][106225] Updated weights for policy 1, policy_version 1706167 (0.0009) [2023-12-28 07:29:39,980][106225] Updated weights for policy 1, policy_version 1706177 (0.0008) [2023-12-28 07:29:40,360][106226] Updated weights for policy 0, policy_version 1702160 (0.0006) [2023-12-28 07:29:40,421][106226] Updated weights for policy 0, policy_version 1702170 (0.0008) [2023-12-28 07:29:40,483][106226] Updated weights for policy 0, policy_version 1702180 (0.0008) [2023-12-28 07:29:40,669][106225] Updated weights for policy 1, policy_version 1706187 (0.0007) [2023-12-28 07:29:40,722][106225] Updated weights for policy 1, policy_version 1706197 (0.0007) [2023-12-28 07:29:40,781][106225] Updated weights for policy 1, policy_version 1706207 (0.0006) [2023-12-28 07:29:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 872685568. Throughput: 0: 9742.7, 1: 9969.2. Samples: 872659464. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:41,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-5.307')] [2023-12-28 07:29:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001706216_436846592.pth... [2023-12-28 07:29:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001705064_436551680.pth [2023-12-28 07:29:41,208][106226] Updated weights for policy 0, policy_version 1702190 (0.0008) [2023-12-28 07:29:41,267][106226] Updated weights for policy 0, policy_version 1702200 (0.0008) [2023-12-28 07:29:41,329][106226] Updated weights for policy 0, policy_version 1702210 (0.0008) [2023-12-28 07:29:41,370][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001702216_435847168.pth... [2023-12-28 07:29:41,376][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001701064_435552256.pth [2023-12-28 07:29:41,513][106225] Updated weights for policy 1, policy_version 1706217 (0.0006) [2023-12-28 07:29:41,578][106225] Updated weights for policy 1, policy_version 1706227 (0.0009) [2023-12-28 07:29:41,647][106225] Updated weights for policy 1, policy_version 1706237 (0.0008) [2023-12-28 07:29:41,704][106225] Updated weights for policy 1, policy_version 1706247 (0.0008) [2023-12-28 07:29:42,149][106226] Updated weights for policy 0, policy_version 1702220 (0.0008) [2023-12-28 07:29:42,204][106226] Updated weights for policy 0, policy_version 1702230 (0.0009) [2023-12-28 07:29:42,263][106226] Updated weights for policy 0, policy_version 1702240 (0.0010) [2023-12-28 07:29:42,333][106225] Updated weights for policy 1, policy_version 1706257 (0.0007) [2023-12-28 07:29:42,400][106225] Updated weights for policy 1, policy_version 1706267 (0.0007) [2023-12-28 07:29:42,463][106225] Updated weights for policy 1, policy_version 1706277 (0.0007) [2023-12-28 07:29:43,058][106226] Updated weights for policy 0, policy_version 1702250 (0.0008) [2023-12-28 07:29:43,122][106226] Updated weights for policy 0, policy_version 1702260 (0.0007) [2023-12-28 07:29:43,126][106225] Updated weights for policy 1, policy_version 1706287 (0.0007) [2023-12-28 07:29:43,184][106226] Updated weights for policy 0, policy_version 1702270 (0.0006) [2023-12-28 07:29:43,191][106225] Updated weights for policy 1, policy_version 1706297 (0.0008) [2023-12-28 07:29:43,248][106226] Updated weights for policy 0, policy_version 1702280 (0.0006) [2023-12-28 07:29:43,252][106225] Updated weights for policy 1, policy_version 1706307 (0.0007) [2023-12-28 07:29:43,895][106225] Updated weights for policy 1, policy_version 1706317 (0.0008) [2023-12-28 07:29:43,918][106226] Updated weights for policy 0, policy_version 1702290 (0.0007) [2023-12-28 07:29:43,950][106225] Updated weights for policy 1, policy_version 1706327 (0.0006) [2023-12-28 07:29:43,972][106226] Updated weights for policy 0, policy_version 1702300 (0.0007) [2023-12-28 07:29:43,998][106225] Updated weights for policy 1, policy_version 1706337 (0.0005) [2023-12-28 07:29:44,022][106226] Updated weights for policy 0, policy_version 1702310 (0.0008) [2023-12-28 07:29:44,597][106225] Updated weights for policy 1, policy_version 1706347 (0.0006) [2023-12-28 07:29:44,652][106225] Updated weights for policy 1, policy_version 1706357 (0.0005) [2023-12-28 07:29:44,712][106225] Updated weights for policy 1, policy_version 1706367 (0.0007) [2023-12-28 07:29:44,733][106226] Updated weights for policy 0, policy_version 1702320 (0.0010) [2023-12-28 07:29:44,787][106226] Updated weights for policy 0, policy_version 1702330 (0.0009) [2023-12-28 07:29:44,839][106226] Updated weights for policy 0, policy_version 1702340 (0.0009) [2023-12-28 07:29:45,425][106225] Updated weights for policy 1, policy_version 1706377 (0.0008) [2023-12-28 07:29:45,487][106226] Updated weights for policy 0, policy_version 1702350 (0.0006) [2023-12-28 07:29:45,492][106225] Updated weights for policy 1, policy_version 1706387 (0.0009) [2023-12-28 07:29:45,535][106226] Updated weights for policy 0, policy_version 1702360 (0.0008) [2023-12-28 07:29:45,555][106225] Updated weights for policy 1, policy_version 1706397 (0.0005) [2023-12-28 07:29:45,587][106226] Updated weights for policy 0, policy_version 1702370 (0.0008) [2023-12-28 07:29:45,616][106225] Updated weights for policy 1, policy_version 1706407 (0.0009) [2023-12-28 07:29:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 872783872. Throughput: 0: 9693.9, 1: 9899.0. Samples: 872776360. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:46,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.623')] [2023-12-28 07:29:46,239][106225] Updated weights for policy 1, policy_version 1706417 (0.0006) [2023-12-28 07:29:46,281][106226] Updated weights for policy 0, policy_version 1702380 (0.0011) [2023-12-28 07:29:46,296][106225] Updated weights for policy 1, policy_version 1706427 (0.0005) [2023-12-28 07:29:46,332][106226] Updated weights for policy 0, policy_version 1702390 (0.0010) [2023-12-28 07:29:46,356][106225] Updated weights for policy 1, policy_version 1706437 (0.0006) [2023-12-28 07:29:46,393][106226] Updated weights for policy 0, policy_version 1702400 (0.0011) [2023-12-28 07:29:46,873][106225] Updated weights for policy 1, policy_version 1706447 (0.0005) [2023-12-28 07:29:46,934][106225] Updated weights for policy 1, policy_version 1706457 (0.0005) [2023-12-28 07:29:46,992][106225] Updated weights for policy 1, policy_version 1706467 (0.0005) [2023-12-28 07:29:47,125][106226] Updated weights for policy 0, policy_version 1702410 (0.0010) [2023-12-28 07:29:47,184][106226] Updated weights for policy 0, policy_version 1702420 (0.0010) [2023-12-28 07:29:47,240][106226] Updated weights for policy 0, policy_version 1702430 (0.0010) [2023-12-28 07:29:47,309][106226] Updated weights for policy 0, policy_version 1702440 (0.0011) [2023-12-28 07:29:47,540][106225] Updated weights for policy 1, policy_version 1706477 (0.0005) [2023-12-28 07:29:47,600][106225] Updated weights for policy 1, policy_version 1706487 (0.0006) [2023-12-28 07:29:47,658][106225] Updated weights for policy 1, policy_version 1706497 (0.0007) [2023-12-28 07:29:47,994][106226] Updated weights for policy 0, policy_version 1702450 (0.0005) [2023-12-28 07:29:48,043][106226] Updated weights for policy 0, policy_version 1702460 (0.0010) [2023-12-28 07:29:48,101][106226] Updated weights for policy 0, policy_version 1702470 (0.0010) [2023-12-28 07:29:48,274][106225] Updated weights for policy 1, policy_version 1706507 (0.0006) [2023-12-28 07:29:48,335][106225] Updated weights for policy 1, policy_version 1706517 (0.0006) [2023-12-28 07:29:48,396][106225] Updated weights for policy 1, policy_version 1706527 (0.0007) [2023-12-28 07:29:48,794][106226] Updated weights for policy 0, policy_version 1702480 (0.0011) [2023-12-28 07:29:48,845][106226] Updated weights for policy 0, policy_version 1702490 (0.0011) [2023-12-28 07:29:48,902][106226] Updated weights for policy 0, policy_version 1702500 (0.0011) [2023-12-28 07:29:48,951][106225] Updated weights for policy 1, policy_version 1706537 (0.0008) [2023-12-28 07:29:49,010][106225] Updated weights for policy 1, policy_version 1706547 (0.0008) [2023-12-28 07:29:49,072][106225] Updated weights for policy 1, policy_version 1706557 (0.0006) [2023-12-28 07:29:49,135][106225] Updated weights for policy 1, policy_version 1706567 (0.0005) [2023-12-28 07:29:49,626][106226] Updated weights for policy 0, policy_version 1702510 (0.0008) [2023-12-28 07:29:49,674][106226] Updated weights for policy 0, policy_version 1702520 (0.0009) [2023-12-28 07:29:49,731][106226] Updated weights for policy 0, policy_version 1702530 (0.0009) [2023-12-28 07:29:49,881][106225] Updated weights for policy 1, policy_version 1706577 (0.0008) [2023-12-28 07:29:49,949][106225] Updated weights for policy 1, policy_version 1706587 (0.0008) [2023-12-28 07:29:50,004][106225] Updated weights for policy 1, policy_version 1706597 (0.0006) [2023-12-28 07:29:50,506][106226] Updated weights for policy 0, policy_version 1702540 (0.0007) [2023-12-28 07:29:50,570][106226] Updated weights for policy 0, policy_version 1702550 (0.0008) [2023-12-28 07:29:50,642][106226] Updated weights for policy 0, policy_version 1702560 (0.0008) [2023-12-28 07:29:50,733][106225] Updated weights for policy 1, policy_version 1706607 (0.0009) [2023-12-28 07:29:50,793][106225] Updated weights for policy 1, policy_version 1706617 (0.0010) [2023-12-28 07:29:50,844][106225] Updated weights for policy 1, policy_version 1706627 (0.0010) [2023-12-28 07:29:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 872890368. Throughput: 0: 9650.9, 1: 10004.2. Samples: 872899656. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:51,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.605')] [2023-12-28 07:29:51,325][106226] Updated weights for policy 0, policy_version 1702570 (0.0008) [2023-12-28 07:29:51,393][106226] Updated weights for policy 0, policy_version 1702580 (0.0008) [2023-12-28 07:29:51,451][106226] Updated weights for policy 0, policy_version 1702590 (0.0006) [2023-12-28 07:29:51,511][106226] Updated weights for policy 0, policy_version 1702600 (0.0007) [2023-12-28 07:29:51,581][106225] Updated weights for policy 1, policy_version 1706637 (0.0010) [2023-12-28 07:29:51,640][106225] Updated weights for policy 1, policy_version 1706647 (0.0009) [2023-12-28 07:29:51,705][106225] Updated weights for policy 1, policy_version 1706657 (0.0008) [2023-12-28 07:29:52,223][106226] Updated weights for policy 0, policy_version 1702610 (0.0006) [2023-12-28 07:29:52,287][106226] Updated weights for policy 0, policy_version 1702620 (0.0007) [2023-12-28 07:29:52,353][106226] Updated weights for policy 0, policy_version 1702630 (0.0007) [2023-12-28 07:29:52,488][106225] Updated weights for policy 1, policy_version 1706667 (0.0008) [2023-12-28 07:29:52,547][106225] Updated weights for policy 1, policy_version 1706677 (0.0008) [2023-12-28 07:29:52,603][106225] Updated weights for policy 1, policy_version 1706687 (0.0008) [2023-12-28 07:29:53,033][106226] Updated weights for policy 0, policy_version 1702640 (0.0008) [2023-12-28 07:29:53,101][106226] Updated weights for policy 0, policy_version 1702650 (0.0008) [2023-12-28 07:29:53,165][106226] Updated weights for policy 0, policy_version 1702660 (0.0008) [2023-12-28 07:29:53,314][106225] Updated weights for policy 1, policy_version 1706697 (0.0008) [2023-12-28 07:29:53,371][106225] Updated weights for policy 1, policy_version 1706707 (0.0005) [2023-12-28 07:29:53,428][106225] Updated weights for policy 1, policy_version 1706717 (0.0005) [2023-12-28 07:29:53,484][106225] Updated weights for policy 1, policy_version 1706727 (0.0005) [2023-12-28 07:29:53,792][106226] Updated weights for policy 0, policy_version 1702670 (0.0008) [2023-12-28 07:29:53,857][106226] Updated weights for policy 0, policy_version 1702680 (0.0007) [2023-12-28 07:29:53,919][106226] Updated weights for policy 0, policy_version 1702690 (0.0007) [2023-12-28 07:29:54,012][106225] Updated weights for policy 1, policy_version 1706737 (0.0005) [2023-12-28 07:29:54,061][106225] Updated weights for policy 1, policy_version 1706747 (0.0005) [2023-12-28 07:29:54,110][106225] Updated weights for policy 1, policy_version 1706757 (0.0005) [2023-12-28 07:29:54,502][106226] Updated weights for policy 0, policy_version 1702700 (0.0005) [2023-12-28 07:29:54,559][106226] Updated weights for policy 0, policy_version 1702710 (0.0007) [2023-12-28 07:29:54,623][106226] Updated weights for policy 0, policy_version 1702720 (0.0006) [2023-12-28 07:29:54,776][106225] Updated weights for policy 1, policy_version 1706767 (0.0009) [2023-12-28 07:29:54,835][106225] Updated weights for policy 1, policy_version 1706777 (0.0010) [2023-12-28 07:29:54,881][106225] Updated weights for policy 1, policy_version 1706787 (0.0010) [2023-12-28 07:29:55,264][106226] Updated weights for policy 0, policy_version 1702730 (0.0006) [2023-12-28 07:29:55,311][106226] Updated weights for policy 0, policy_version 1702740 (0.0008) [2023-12-28 07:29:55,364][106226] Updated weights for policy 0, policy_version 1702750 (0.0007) [2023-12-28 07:29:55,413][106226] Updated weights for policy 0, policy_version 1702760 (0.0008) [2023-12-28 07:29:55,599][106225] Updated weights for policy 1, policy_version 1706797 (0.0010) [2023-12-28 07:29:55,655][106225] Updated weights for policy 1, policy_version 1706807 (0.0010) [2023-12-28 07:29:55,704][106225] Updated weights for policy 1, policy_version 1706817 (0.0010) [2023-12-28 07:29:56,069][106226] Updated weights for policy 0, policy_version 1702770 (0.0005) [2023-12-28 07:29:56,128][106226] Updated weights for policy 0, policy_version 1702780 (0.0006) [2023-12-28 07:29:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 872988672. Throughput: 0: 9707.4, 1: 10004.2. Samples: 872959972. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:29:56,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.912')] [2023-12-28 07:29:56,179][106226] Updated weights for policy 0, policy_version 1702790 (0.0008) [2023-12-28 07:29:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001706824_437002240.pth... [2023-12-28 07:29:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001705640_436699136.pth [2023-12-28 07:29:56,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001702792_435994624.pth... [2023-12-28 07:29:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001701640_435699712.pth [2023-12-28 07:29:56,425][106225] Updated weights for policy 1, policy_version 1706827 (0.0010) [2023-12-28 07:29:56,485][106225] Updated weights for policy 1, policy_version 1706837 (0.0011) [2023-12-28 07:29:56,546][106225] Updated weights for policy 1, policy_version 1706847 (0.0010) [2023-12-28 07:29:56,874][106226] Updated weights for policy 0, policy_version 1702800 (0.0006) [2023-12-28 07:29:56,938][106226] Updated weights for policy 0, policy_version 1702810 (0.0008) [2023-12-28 07:29:56,987][106226] Updated weights for policy 0, policy_version 1702820 (0.0007) [2023-12-28 07:29:57,205][106225] Updated weights for policy 1, policy_version 1706857 (0.0010) [2023-12-28 07:29:57,262][106225] Updated weights for policy 1, policy_version 1706867 (0.0010) [2023-12-28 07:29:57,321][106225] Updated weights for policy 1, policy_version 1706877 (0.0010) [2023-12-28 07:29:57,379][106225] Updated weights for policy 1, policy_version 1706887 (0.0007) [2023-12-28 07:29:57,592][106226] Updated weights for policy 0, policy_version 1702830 (0.0006) [2023-12-28 07:29:57,638][106226] Updated weights for policy 0, policy_version 1702840 (0.0005) [2023-12-28 07:29:57,682][106226] Updated weights for policy 0, policy_version 1702850 (0.0006) [2023-12-28 07:29:58,064][106225] Updated weights for policy 1, policy_version 1706897 (0.0006) [2023-12-28 07:29:58,117][106225] Updated weights for policy 1, policy_version 1706907 (0.0005) [2023-12-28 07:29:58,171][106225] Updated weights for policy 1, policy_version 1706917 (0.0006) [2023-12-28 07:29:58,388][106226] Updated weights for policy 0, policy_version 1702860 (0.0008) [2023-12-28 07:29:58,458][106226] Updated weights for policy 0, policy_version 1702870 (0.0007) [2023-12-28 07:29:58,521][106226] Updated weights for policy 0, policy_version 1702880 (0.0008) [2023-12-28 07:29:58,903][106225] Updated weights for policy 1, policy_version 1706927 (0.0008) [2023-12-28 07:29:58,967][106225] Updated weights for policy 1, policy_version 1706937 (0.0011) [2023-12-28 07:29:59,031][106225] Updated weights for policy 1, policy_version 1706947 (0.0006) [2023-12-28 07:29:59,294][106226] Updated weights for policy 0, policy_version 1702890 (0.0009) [2023-12-28 07:29:59,362][106226] Updated weights for policy 0, policy_version 1702900 (0.0008) [2023-12-28 07:29:59,417][106226] Updated weights for policy 0, policy_version 1702910 (0.0007) [2023-12-28 07:29:59,464][106226] Updated weights for policy 0, policy_version 1702920 (0.0007) [2023-12-28 07:29:59,678][106225] Updated weights for policy 1, policy_version 1706957 (0.0006) [2023-12-28 07:29:59,738][106225] Updated weights for policy 1, policy_version 1706967 (0.0006) [2023-12-28 07:29:59,788][106225] Updated weights for policy 1, policy_version 1706977 (0.0005) [2023-12-28 07:30:00,261][106226] Updated weights for policy 0, policy_version 1702930 (0.0009) [2023-12-28 07:30:00,324][106226] Updated weights for policy 0, policy_version 1702940 (0.0009) [2023-12-28 07:30:00,391][106226] Updated weights for policy 0, policy_version 1702950 (0.0009) [2023-12-28 07:30:00,458][106225] Updated weights for policy 1, policy_version 1706987 (0.0007) [2023-12-28 07:30:00,513][106225] Updated weights for policy 1, policy_version 1706997 (0.0008) [2023-12-28 07:30:00,561][106225] Updated weights for policy 1, policy_version 1707007 (0.0008) [2023-12-28 07:30:01,116][106226] Updated weights for policy 0, policy_version 1702960 (0.0008) [2023-12-28 07:30:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 873086976. Throughput: 0: 9768.0, 1: 10058.9. Samples: 873082060. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:30:01,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.852')] [2023-12-28 07:30:01,180][106226] Updated weights for policy 0, policy_version 1702970 (0.0008) [2023-12-28 07:30:01,237][106226] Updated weights for policy 0, policy_version 1702980 (0.0009) [2023-12-28 07:30:01,289][106225] Updated weights for policy 1, policy_version 1707017 (0.0008) [2023-12-28 07:30:01,353][106225] Updated weights for policy 1, policy_version 1707027 (0.0007) [2023-12-28 07:30:01,422][106225] Updated weights for policy 1, policy_version 1707037 (0.0009) [2023-12-28 07:30:01,484][106225] Updated weights for policy 1, policy_version 1707047 (0.0008) [2023-12-28 07:30:01,976][106226] Updated weights for policy 0, policy_version 1702990 (0.0010) [2023-12-28 07:30:02,039][106226] Updated weights for policy 0, policy_version 1703000 (0.0011) [2023-12-28 07:30:02,104][106226] Updated weights for policy 0, policy_version 1703010 (0.0009) [2023-12-28 07:30:02,164][106225] Updated weights for policy 1, policy_version 1707057 (0.0006) [2023-12-28 07:30:02,220][106225] Updated weights for policy 1, policy_version 1707067 (0.0008) [2023-12-28 07:30:02,284][106225] Updated weights for policy 1, policy_version 1707077 (0.0007) [2023-12-28 07:30:02,804][106226] Updated weights for policy 0, policy_version 1703020 (0.0011) [2023-12-28 07:30:02,857][106226] Updated weights for policy 0, policy_version 1703030 (0.0010) [2023-12-28 07:30:02,904][106226] Updated weights for policy 0, policy_version 1703040 (0.0010) [2023-12-28 07:30:02,947][106225] Updated weights for policy 1, policy_version 1707087 (0.0006) [2023-12-28 07:30:02,997][106225] Updated weights for policy 1, policy_version 1707097 (0.0008) [2023-12-28 07:30:03,060][106225] Updated weights for policy 1, policy_version 1707107 (0.0007) [2023-12-28 07:30:03,633][106226] Updated weights for policy 0, policy_version 1703050 (0.0010) [2023-12-28 07:30:03,693][106226] Updated weights for policy 0, policy_version 1703060 (0.0011) [2023-12-28 07:30:03,742][106226] Updated weights for policy 0, policy_version 1703070 (0.0010) [2023-12-28 07:30:03,793][106225] Updated weights for policy 1, policy_version 1707117 (0.0007) [2023-12-28 07:30:03,802][106226] Updated weights for policy 0, policy_version 1703080 (0.0011) [2023-12-28 07:30:03,859][106225] Updated weights for policy 1, policy_version 1707127 (0.0007) [2023-12-28 07:30:03,921][106225] Updated weights for policy 1, policy_version 1707137 (0.0008) [2023-12-28 07:30:04,571][106226] Updated weights for policy 0, policy_version 1703090 (0.0011) [2023-12-28 07:30:04,607][106225] Updated weights for policy 1, policy_version 1707147 (0.0008) [2023-12-28 07:30:04,631][106226] Updated weights for policy 0, policy_version 1703100 (0.0011) [2023-12-28 07:30:04,669][106225] Updated weights for policy 1, policy_version 1707157 (0.0010) [2023-12-28 07:30:04,692][106226] Updated weights for policy 0, policy_version 1703110 (0.0011) [2023-12-28 07:30:04,723][106225] Updated weights for policy 1, policy_version 1707167 (0.0007) [2023-12-28 07:30:05,398][106226] Updated weights for policy 0, policy_version 1703120 (0.0011) [2023-12-28 07:30:05,453][106225] Updated weights for policy 1, policy_version 1707177 (0.0007) [2023-12-28 07:30:05,458][106226] Updated weights for policy 0, policy_version 1703130 (0.0010) [2023-12-28 07:30:05,502][106225] Updated weights for policy 1, policy_version 1707187 (0.0006) [2023-12-28 07:30:05,518][106226] Updated weights for policy 0, policy_version 1703140 (0.0010) [2023-12-28 07:30:05,558][106225] Updated weights for policy 1, policy_version 1707197 (0.0005) [2023-12-28 07:30:05,616][106225] Updated weights for policy 1, policy_version 1707207 (0.0005) [2023-12-28 07:30:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 873185280. Throughput: 0: 9784.7, 1: 10058.9. Samples: 873199500. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:30:06,175][105115] Avg episode reward: [(0, '-4.308'), (1, '-4.901')] [2023-12-28 07:30:06,200][106226] Updated weights for policy 0, policy_version 1703150 (0.0011) [2023-12-28 07:30:06,265][106226] Updated weights for policy 0, policy_version 1703160 (0.0011) [2023-12-28 07:30:06,327][106226] Updated weights for policy 0, policy_version 1703170 (0.0011) [2023-12-28 07:30:06,361][106225] Updated weights for policy 1, policy_version 1707217 (0.0006) [2023-12-28 07:30:06,426][106225] Updated weights for policy 1, policy_version 1707227 (0.0009) [2023-12-28 07:30:06,493][106225] Updated weights for policy 1, policy_version 1707237 (0.0008) [2023-12-28 07:30:07,004][106226] Updated weights for policy 0, policy_version 1703180 (0.0008) [2023-12-28 07:30:07,063][106226] Updated weights for policy 0, policy_version 1703190 (0.0005) [2023-12-28 07:30:07,125][106226] Updated weights for policy 0, policy_version 1703200 (0.0005) [2023-12-28 07:30:07,205][106225] Updated weights for policy 1, policy_version 1707247 (0.0008) [2023-12-28 07:30:07,259][106225] Updated weights for policy 1, policy_version 1707257 (0.0008) [2023-12-28 07:30:07,323][106225] Updated weights for policy 1, policy_version 1707267 (0.0008) [2023-12-28 07:30:07,729][106226] Updated weights for policy 0, policy_version 1703210 (0.0009) [2023-12-28 07:30:07,791][106226] Updated weights for policy 0, policy_version 1703220 (0.0011) [2023-12-28 07:30:07,850][106226] Updated weights for policy 0, policy_version 1703230 (0.0011) [2023-12-28 07:30:07,904][106226] Updated weights for policy 0, policy_version 1703240 (0.0008) [2023-12-28 07:30:07,927][106225] Updated weights for policy 1, policy_version 1707277 (0.0006) [2023-12-28 07:30:07,992][106225] Updated weights for policy 1, policy_version 1707287 (0.0006) [2023-12-28 07:30:08,063][106225] Updated weights for policy 1, policy_version 1707297 (0.0008) [2023-12-28 07:30:08,676][106226] Updated weights for policy 0, policy_version 1703250 (0.0009) [2023-12-28 07:30:08,686][106225] Updated weights for policy 1, policy_version 1707307 (0.0007) [2023-12-28 07:30:08,728][106226] Updated weights for policy 0, policy_version 1703260 (0.0007) [2023-12-28 07:30:08,738][106225] Updated weights for policy 1, policy_version 1707317 (0.0006) [2023-12-28 07:30:08,782][106226] Updated weights for policy 0, policy_version 1703270 (0.0008) [2023-12-28 07:30:08,785][106225] Updated weights for policy 1, policy_version 1707327 (0.0006) [2023-12-28 07:30:09,509][106226] Updated weights for policy 0, policy_version 1703280 (0.0008) [2023-12-28 07:30:09,556][106225] Updated weights for policy 1, policy_version 1707337 (0.0009) [2023-12-28 07:30:09,566][106226] Updated weights for policy 0, policy_version 1703290 (0.0006) [2023-12-28 07:30:09,621][106225] Updated weights for policy 1, policy_version 1707347 (0.0008) [2023-12-28 07:30:09,623][106226] Updated weights for policy 0, policy_version 1703300 (0.0006) [2023-12-28 07:30:09,682][106225] Updated weights for policy 1, policy_version 1707357 (0.0007) [2023-12-28 07:30:09,749][106225] Updated weights for policy 1, policy_version 1707367 (0.0008) [2023-12-28 07:30:10,258][106226] Updated weights for policy 0, policy_version 1703310 (0.0008) [2023-12-28 07:30:10,322][106226] Updated weights for policy 0, policy_version 1703320 (0.0009) [2023-12-28 07:30:10,384][106226] Updated weights for policy 0, policy_version 1703330 (0.0009) [2023-12-28 07:30:10,512][106225] Updated weights for policy 1, policy_version 1707377 (0.0008) [2023-12-28 07:30:10,575][106225] Updated weights for policy 1, policy_version 1707387 (0.0009) [2023-12-28 07:30:10,635][106225] Updated weights for policy 1, policy_version 1707397 (0.0008) [2023-12-28 07:30:11,108][106226] Updated weights for policy 0, policy_version 1703340 (0.0010) [2023-12-28 07:30:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 873283584. Throughput: 0: 9804.1, 1: 10122.4. Samples: 873259048. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:30:11,175][105115] Avg episode reward: [(0, '-4.421'), (1, '-4.582')] [2023-12-28 07:30:11,178][106226] Updated weights for policy 0, policy_version 1703350 (0.0010) [2023-12-28 07:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001707400_437149696.pth... [2023-12-28 07:30:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001706216_436846592.pth [2023-12-28 07:30:11,244][106226] Updated weights for policy 0, policy_version 1703360 (0.0011) [2023-12-28 07:30:11,297][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001703368_436142080.pth... [2023-12-28 07:30:11,301][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001702216_435847168.pth [2023-12-28 07:30:11,397][106225] Updated weights for policy 1, policy_version 1707407 (0.0008) [2023-12-28 07:30:11,456][106225] Updated weights for policy 1, policy_version 1707417 (0.0007) [2023-12-28 07:30:11,519][106225] Updated weights for policy 1, policy_version 1707427 (0.0006) [2023-12-28 07:30:12,000][106226] Updated weights for policy 0, policy_version 1703370 (0.0009) [2023-12-28 07:30:12,060][106226] Updated weights for policy 0, policy_version 1703380 (0.0008) [2023-12-28 07:30:12,127][106226] Updated weights for policy 0, policy_version 1703390 (0.0007) [2023-12-28 07:30:12,182][106226] Updated weights for policy 0, policy_version 1703400 (0.0008) [2023-12-28 07:30:12,239][106225] Updated weights for policy 1, policy_version 1707437 (0.0008) [2023-12-28 07:30:12,310][106225] Updated weights for policy 1, policy_version 1707447 (0.0010) [2023-12-28 07:30:12,379][106225] Updated weights for policy 1, policy_version 1707457 (0.0010) [2023-12-28 07:30:12,975][106226] Updated weights for policy 0, policy_version 1703410 (0.0009) [2023-12-28 07:30:13,041][106226] Updated weights for policy 0, policy_version 1703420 (0.0009) [2023-12-28 07:30:13,107][106226] Updated weights for policy 0, policy_version 1703430 (0.0008) [2023-12-28 07:30:13,169][106225] Updated weights for policy 1, policy_version 1707467 (0.0008) [2023-12-28 07:30:13,239][106225] Updated weights for policy 1, policy_version 1707477 (0.0005) [2023-12-28 07:30:13,301][106225] Updated weights for policy 1, policy_version 1707487 (0.0008) [2023-12-28 07:30:13,816][106226] Updated weights for policy 0, policy_version 1703440 (0.0007) [2023-12-28 07:30:13,882][106226] Updated weights for policy 0, policy_version 1703450 (0.0006) [2023-12-28 07:30:13,953][106226] Updated weights for policy 0, policy_version 1703460 (0.0005) [2023-12-28 07:30:13,985][106225] Updated weights for policy 1, policy_version 1707497 (0.0008) [2023-12-28 07:30:14,040][106225] Updated weights for policy 1, policy_version 1707507 (0.0009) [2023-12-28 07:30:14,095][106225] Updated weights for policy 1, policy_version 1707518 (0.0008) [2023-12-28 07:30:14,152][106225] Updated weights for policy 1, policy_version 1707528 (0.0007) [2023-12-28 07:30:14,519][106226] Updated weights for policy 0, policy_version 1703470 (0.0007) [2023-12-28 07:30:14,579][106226] Updated weights for policy 0, policy_version 1703480 (0.0009) [2023-12-28 07:30:14,638][106226] Updated weights for policy 0, policy_version 1703490 (0.0006) [2023-12-28 07:30:14,912][106225] Updated weights for policy 1, policy_version 1707538 (0.0009) [2023-12-28 07:30:14,971][106225] Updated weights for policy 1, policy_version 1707548 (0.0008) [2023-12-28 07:30:15,029][106225] Updated weights for policy 1, policy_version 1707558 (0.0008) [2023-12-28 07:30:15,337][106226] Updated weights for policy 0, policy_version 1703500 (0.0008) [2023-12-28 07:30:15,393][106226] Updated weights for policy 0, policy_version 1703510 (0.0009) [2023-12-28 07:30:15,448][106226] Updated weights for policy 0, policy_version 1703520 (0.0008) [2023-12-28 07:30:15,784][106225] Updated weights for policy 1, policy_version 1707568 (0.0008) [2023-12-28 07:30:15,841][106225] Updated weights for policy 1, policy_version 1707578 (0.0009) [2023-12-28 07:30:15,904][106225] Updated weights for policy 1, policy_version 1707588 (0.0008) [2023-12-28 07:30:16,172][106226] Updated weights for policy 0, policy_version 1703530 (0.0009) [2023-12-28 07:30:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 873381888. Throughput: 0: 9830.5, 1: 10016.3. Samples: 873373800. Policy #0 lag: (min: 4.0, avg: 14.8, max: 36.0) [2023-12-28 07:30:16,176][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.679')] [2023-12-28 07:30:16,225][106226] Updated weights for policy 0, policy_version 1703540 (0.0008) [2023-12-28 07:30:16,275][106226] Updated weights for policy 0, policy_version 1703550 (0.0009) [2023-12-28 07:30:16,330][106226] Updated weights for policy 0, policy_version 1703560 (0.0008) [2023-12-28 07:30:16,612][106225] Updated weights for policy 1, policy_version 1707598 (0.0008) [2023-12-28 07:30:16,670][106225] Updated weights for policy 1, policy_version 1707608 (0.0008) [2023-12-28 07:30:16,729][106225] Updated weights for policy 1, policy_version 1707618 (0.0008) [2023-12-28 07:30:17,112][106226] Updated weights for policy 0, policy_version 1703570 (0.0009) [2023-12-28 07:30:17,168][106226] Updated weights for policy 0, policy_version 1703580 (0.0008) [2023-12-28 07:30:17,231][106226] Updated weights for policy 0, policy_version 1703590 (0.0008) [2023-12-28 07:30:17,426][106225] Updated weights for policy 1, policy_version 1707628 (0.0007) [2023-12-28 07:30:17,486][106225] Updated weights for policy 1, policy_version 1707638 (0.0005) [2023-12-28 07:30:17,537][106225] Updated weights for policy 1, policy_version 1707648 (0.0007) [2023-12-28 07:30:17,996][106226] Updated weights for policy 0, policy_version 1703600 (0.0009) [2023-12-28 07:30:18,056][106226] Updated weights for policy 0, policy_version 1703610 (0.0009) [2023-12-28 07:30:18,110][106226] Updated weights for policy 0, policy_version 1703620 (0.0008) [2023-12-28 07:30:18,157][106225] Updated weights for policy 1, policy_version 1707658 (0.0006) [2023-12-28 07:30:18,214][106225] Updated weights for policy 1, policy_version 1707668 (0.0007) [2023-12-28 07:30:18,260][106225] Updated weights for policy 1, policy_version 1707678 (0.0007) [2023-12-28 07:30:18,314][106225] Updated weights for policy 1, policy_version 1707688 (0.0005) [2023-12-28 07:30:18,820][106226] Updated weights for policy 0, policy_version 1703630 (0.0008) [2023-12-28 07:30:18,884][106226] Updated weights for policy 0, policy_version 1703640 (0.0009) [2023-12-28 07:30:18,946][106226] Updated weights for policy 0, policy_version 1703650 (0.0008) [2023-12-28 07:30:19,073][106225] Updated weights for policy 1, policy_version 1707698 (0.0005) [2023-12-28 07:30:19,136][106225] Updated weights for policy 1, policy_version 1707708 (0.0006) [2023-12-28 07:30:19,202][106225] Updated weights for policy 1, policy_version 1707718 (0.0009) [2023-12-28 07:30:19,670][106226] Updated weights for policy 0, policy_version 1703660 (0.0007) [2023-12-28 07:30:19,722][106226] Updated weights for policy 0, policy_version 1703670 (0.0008) [2023-12-28 07:30:19,772][106226] Updated weights for policy 0, policy_version 1703680 (0.0008) [2023-12-28 07:30:19,947][106225] Updated weights for policy 1, policy_version 1707728 (0.0008) [2023-12-28 07:30:20,003][106225] Updated weights for policy 1, policy_version 1707738 (0.0008) [2023-12-28 07:30:20,067][106225] Updated weights for policy 1, policy_version 1707748 (0.0008) [2023-12-28 07:30:20,555][106226] Updated weights for policy 0, policy_version 1703690 (0.0010) [2023-12-28 07:30:20,623][106226] Updated weights for policy 0, policy_version 1703700 (0.0009) [2023-12-28 07:30:20,686][106226] Updated weights for policy 0, policy_version 1703710 (0.0008) [2023-12-28 07:30:20,742][106226] Updated weights for policy 0, policy_version 1703720 (0.0009) [2023-12-28 07:30:20,854][106225] Updated weights for policy 1, policy_version 1707758 (0.0009) [2023-12-28 07:30:20,916][106225] Updated weights for policy 1, policy_version 1707768 (0.0008) [2023-12-28 07:30:20,970][106225] Updated weights for policy 1, policy_version 1707778 (0.0007) [2023-12-28 07:30:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 873480192. Throughput: 0: 9725.9, 1: 9950.1. Samples: 873486636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:21,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.643')] [2023-12-28 07:30:21,547][106226] Updated weights for policy 0, policy_version 1703730 (0.0008) [2023-12-28 07:30:21,614][106226] Updated weights for policy 0, policy_version 1703740 (0.0010) [2023-12-28 07:30:21,687][106226] Updated weights for policy 0, policy_version 1703750 (0.0009) [2023-12-28 07:30:21,748][106225] Updated weights for policy 1, policy_version 1707788 (0.0007) [2023-12-28 07:30:21,813][106225] Updated weights for policy 1, policy_version 1707798 (0.0008) [2023-12-28 07:30:21,878][106225] Updated weights for policy 1, policy_version 1707808 (0.0006) [2023-12-28 07:30:22,555][106226] Updated weights for policy 0, policy_version 1703760 (0.0009) [2023-12-28 07:30:22,577][106225] Updated weights for policy 1, policy_version 1707818 (0.0006) [2023-12-28 07:30:22,628][106226] Updated weights for policy 0, policy_version 1703770 (0.0011) [2023-12-28 07:30:22,633][106225] Updated weights for policy 1, policy_version 1707828 (0.0008) [2023-12-28 07:30:22,689][106225] Updated weights for policy 1, policy_version 1707838 (0.0007) [2023-12-28 07:30:22,700][106226] Updated weights for policy 0, policy_version 1703780 (0.0011) [2023-12-28 07:30:22,753][106225] Updated weights for policy 1, policy_version 1707848 (0.0007) [2023-12-28 07:30:23,404][106226] Updated weights for policy 0, policy_version 1703790 (0.0008) [2023-12-28 07:30:23,465][106226] Updated weights for policy 0, policy_version 1703800 (0.0006) [2023-12-28 07:30:23,480][106225] Updated weights for policy 1, policy_version 1707858 (0.0008) [2023-12-28 07:30:23,527][106226] Updated weights for policy 0, policy_version 1703810 (0.0006) [2023-12-28 07:30:23,545][106225] Updated weights for policy 1, policy_version 1707868 (0.0007) [2023-12-28 07:30:23,602][106225] Updated weights for policy 1, policy_version 1707878 (0.0009) [2023-12-28 07:30:24,201][106226] Updated weights for policy 0, policy_version 1703820 (0.0008) [2023-12-28 07:30:24,266][106226] Updated weights for policy 0, policy_version 1703830 (0.0009) [2023-12-28 07:30:24,319][106226] Updated weights for policy 0, policy_version 1703840 (0.0009) [2023-12-28 07:30:24,353][106225] Updated weights for policy 1, policy_version 1707888 (0.0007) [2023-12-28 07:30:24,415][106225] Updated weights for policy 1, policy_version 1707898 (0.0008) [2023-12-28 07:30:24,480][106225] Updated weights for policy 1, policy_version 1707908 (0.0008) [2023-12-28 07:30:24,994][106226] Updated weights for policy 0, policy_version 1703850 (0.0009) [2023-12-28 07:30:25,048][106226] Updated weights for policy 0, policy_version 1703860 (0.0005) [2023-12-28 07:30:25,098][106226] Updated weights for policy 0, policy_version 1703870 (0.0007) [2023-12-28 07:30:25,158][106226] Updated weights for policy 0, policy_version 1703880 (0.0010) [2023-12-28 07:30:25,160][106225] Updated weights for policy 1, policy_version 1707918 (0.0008) [2023-12-28 07:30:25,227][106225] Updated weights for policy 1, policy_version 1707928 (0.0008) [2023-12-28 07:30:25,294][106225] Updated weights for policy 1, policy_version 1707938 (0.0008) [2023-12-28 07:30:25,840][106226] Updated weights for policy 0, policy_version 1703890 (0.0006) [2023-12-28 07:30:25,851][106225] Updated weights for policy 1, policy_version 1707948 (0.0006) [2023-12-28 07:30:25,898][106226] Updated weights for policy 0, policy_version 1703900 (0.0008) [2023-12-28 07:30:25,907][106225] Updated weights for policy 1, policy_version 1707958 (0.0010) [2023-12-28 07:30:25,955][106225] Updated weights for policy 1, policy_version 1707968 (0.0007) [2023-12-28 07:30:25,956][106226] Updated weights for policy 0, policy_version 1703910 (0.0010) [2023-12-28 07:30:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 873578496. Throughput: 0: 9674.6, 1: 9926.4. Samples: 873541508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:26,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.852')] [2023-12-28 07:30:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001703912_436281344.pth... [2023-12-28 07:30:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001707976_437297152.pth... [2023-12-28 07:30:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001702792_435994624.pth [2023-12-28 07:30:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001706824_437002240.pth [2023-12-28 07:30:26,548][106225] Updated weights for policy 1, policy_version 1707978 (0.0005) [2023-12-28 07:30:26,613][106225] Updated weights for policy 1, policy_version 1707988 (0.0005) [2023-12-28 07:30:26,639][106226] Updated weights for policy 0, policy_version 1703920 (0.0007) [2023-12-28 07:30:26,674][106225] Updated weights for policy 1, policy_version 1707998 (0.0008) [2023-12-28 07:30:26,692][106226] Updated weights for policy 0, policy_version 1703930 (0.0006) [2023-12-28 07:30:26,726][106225] Updated weights for policy 1, policy_version 1708008 (0.0010) [2023-12-28 07:30:26,743][106226] Updated weights for policy 0, policy_version 1703940 (0.0008) [2023-12-28 07:30:27,310][106226] Updated weights for policy 0, policy_version 1703950 (0.0008) [2023-12-28 07:30:27,364][106226] Updated weights for policy 0, policy_version 1703960 (0.0007) [2023-12-28 07:30:27,398][106225] Updated weights for policy 1, policy_version 1708018 (0.0010) [2023-12-28 07:30:27,414][106226] Updated weights for policy 0, policy_version 1703970 (0.0010) [2023-12-28 07:30:27,451][106225] Updated weights for policy 1, policy_version 1708028 (0.0010) [2023-12-28 07:30:27,504][106225] Updated weights for policy 1, policy_version 1708038 (0.0010) [2023-12-28 07:30:28,036][106226] Updated weights for policy 0, policy_version 1703980 (0.0007) [2023-12-28 07:30:28,094][106226] Updated weights for policy 0, policy_version 1703990 (0.0005) [2023-12-28 07:30:28,156][106226] Updated weights for policy 0, policy_version 1704000 (0.0006) [2023-12-28 07:30:28,219][106225] Updated weights for policy 1, policy_version 1708048 (0.0007) [2023-12-28 07:30:28,269][106225] Updated weights for policy 1, policy_version 1708058 (0.0005) [2023-12-28 07:30:28,324][106225] Updated weights for policy 1, policy_version 1708068 (0.0007) [2023-12-28 07:30:28,724][106226] Updated weights for policy 0, policy_version 1704010 (0.0007) [2023-12-28 07:30:28,788][106226] Updated weights for policy 0, policy_version 1704020 (0.0011) [2023-12-28 07:30:28,852][106226] Updated weights for policy 0, policy_version 1704030 (0.0011) [2023-12-28 07:30:28,915][106226] Updated weights for policy 0, policy_version 1704040 (0.0011) [2023-12-28 07:30:29,058][106225] Updated weights for policy 1, policy_version 1708078 (0.0009) [2023-12-28 07:30:29,112][106225] Updated weights for policy 1, policy_version 1708088 (0.0009) [2023-12-28 07:30:29,170][106225] Updated weights for policy 1, policy_version 1708098 (0.0009) [2023-12-28 07:30:29,530][106226] Updated weights for policy 0, policy_version 1704050 (0.0009) [2023-12-28 07:30:29,588][106226] Updated weights for policy 0, policy_version 1704060 (0.0006) [2023-12-28 07:30:29,646][106226] Updated weights for policy 0, policy_version 1704070 (0.0007) [2023-12-28 07:30:29,961][106225] Updated weights for policy 1, policy_version 1708108 (0.0008) [2023-12-28 07:30:30,022][106225] Updated weights for policy 1, policy_version 1708118 (0.0008) [2023-12-28 07:30:30,083][106225] Updated weights for policy 1, policy_version 1708128 (0.0007) [2023-12-28 07:30:30,363][106226] Updated weights for policy 0, policy_version 1704080 (0.0008) [2023-12-28 07:30:30,419][106226] Updated weights for policy 0, policy_version 1704090 (0.0009) [2023-12-28 07:30:30,475][106226] Updated weights for policy 0, policy_version 1704100 (0.0009) [2023-12-28 07:30:30,755][106225] Updated weights for policy 1, policy_version 1708138 (0.0007) [2023-12-28 07:30:30,806][106225] Updated weights for policy 1, policy_version 1708148 (0.0005) [2023-12-28 07:30:30,860][106225] Updated weights for policy 1, policy_version 1708158 (0.0007) [2023-12-28 07:30:30,920][106225] Updated weights for policy 1, policy_version 1708168 (0.0009) [2023-12-28 07:30:31,146][106226] Updated weights for policy 0, policy_version 1704110 (0.0008) [2023-12-28 07:30:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 873676800. Throughput: 0: 9854.2, 1: 9929.7. Samples: 873666636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:31,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.923')] [2023-12-28 07:30:31,230][106226] Updated weights for policy 0, policy_version 1704120 (0.0009) [2023-12-28 07:30:31,291][106226] Updated weights for policy 0, policy_version 1704130 (0.0009) [2023-12-28 07:30:31,595][106225] Updated weights for policy 1, policy_version 1708178 (0.0009) [2023-12-28 07:30:31,659][106225] Updated weights for policy 1, policy_version 1708188 (0.0008) [2023-12-28 07:30:31,722][106225] Updated weights for policy 1, policy_version 1708198 (0.0006) [2023-12-28 07:30:32,064][106226] Updated weights for policy 0, policy_version 1704140 (0.0009) [2023-12-28 07:30:32,124][106226] Updated weights for policy 0, policy_version 1704150 (0.0011) [2023-12-28 07:30:32,180][106226] Updated weights for policy 0, policy_version 1704160 (0.0009) [2023-12-28 07:30:32,377][106225] Updated weights for policy 1, policy_version 1708208 (0.0008) [2023-12-28 07:30:32,438][106225] Updated weights for policy 1, policy_version 1708218 (0.0008) [2023-12-28 07:30:32,495][106225] Updated weights for policy 1, policy_version 1708228 (0.0008) [2023-12-28 07:30:32,885][106226] Updated weights for policy 0, policy_version 1704170 (0.0007) [2023-12-28 07:30:32,942][106226] Updated weights for policy 0, policy_version 1704180 (0.0011) [2023-12-28 07:30:33,002][106226] Updated weights for policy 0, policy_version 1704190 (0.0010) [2023-12-28 07:30:33,064][106226] Updated weights for policy 0, policy_version 1704200 (0.0010) [2023-12-28 07:30:33,271][106225] Updated weights for policy 1, policy_version 1708238 (0.0008) [2023-12-28 07:30:33,322][106225] Updated weights for policy 1, policy_version 1708248 (0.0009) [2023-12-28 07:30:33,372][106225] Updated weights for policy 1, policy_version 1708258 (0.0008) [2023-12-28 07:30:33,684][106226] Updated weights for policy 0, policy_version 1704210 (0.0007) [2023-12-28 07:30:33,729][106226] Updated weights for policy 0, policy_version 1704220 (0.0005) [2023-12-28 07:30:33,777][106226] Updated weights for policy 0, policy_version 1704230 (0.0006) [2023-12-28 07:30:34,025][106225] Updated weights for policy 1, policy_version 1708268 (0.0007) [2023-12-28 07:30:34,075][106225] Updated weights for policy 1, policy_version 1708278 (0.0007) [2023-12-28 07:30:34,138][106225] Updated weights for policy 1, policy_version 1708288 (0.0006) [2023-12-28 07:30:34,456][106226] Updated weights for policy 0, policy_version 1704240 (0.0005) [2023-12-28 07:30:34,513][106226] Updated weights for policy 0, policy_version 1704250 (0.0005) [2023-12-28 07:30:34,579][106226] Updated weights for policy 0, policy_version 1704260 (0.0008) [2023-12-28 07:30:34,976][106225] Updated weights for policy 1, policy_version 1708298 (0.0008) [2023-12-28 07:30:35,032][106225] Updated weights for policy 1, policy_version 1708308 (0.0008) [2023-12-28 07:30:35,087][106225] Updated weights for policy 1, policy_version 1708318 (0.0008) [2023-12-28 07:30:35,106][106226] Updated weights for policy 0, policy_version 1704270 (0.0009) [2023-12-28 07:30:35,140][106225] Updated weights for policy 1, policy_version 1708328 (0.0006) [2023-12-28 07:30:35,160][106226] Updated weights for policy 0, policy_version 1704280 (0.0010) [2023-12-28 07:30:35,229][106226] Updated weights for policy 0, policy_version 1704290 (0.0005) [2023-12-28 07:30:35,833][106226] Updated weights for policy 0, policy_version 1704300 (0.0008) [2023-12-28 07:30:35,886][106226] Updated weights for policy 0, policy_version 1704310 (0.0006) [2023-12-28 07:30:35,951][106226] Updated weights for policy 0, policy_version 1704320 (0.0008) [2023-12-28 07:30:35,953][106225] Updated weights for policy 1, policy_version 1708338 (0.0008) [2023-12-28 07:30:36,013][106225] Updated weights for policy 1, policy_version 1708348 (0.0007) [2023-12-28 07:30:36,081][106225] Updated weights for policy 1, policy_version 1708358 (0.0008) [2023-12-28 07:30:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 873783296. Throughput: 0: 9937.4, 1: 9779.7. Samples: 873786928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:36,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-5.095')] [2023-12-28 07:30:36,637][106226] Updated weights for policy 0, policy_version 1704330 (0.0011) [2023-12-28 07:30:36,688][106226] Updated weights for policy 0, policy_version 1704340 (0.0009) [2023-12-28 07:30:36,737][106226] Updated weights for policy 0, policy_version 1704350 (0.0008) [2023-12-28 07:30:36,793][106226] Updated weights for policy 0, policy_version 1704360 (0.0008) [2023-12-28 07:30:36,843][106225] Updated weights for policy 1, policy_version 1708368 (0.0008) [2023-12-28 07:30:36,907][106225] Updated weights for policy 1, policy_version 1708378 (0.0009) [2023-12-28 07:30:36,968][106225] Updated weights for policy 1, policy_version 1708388 (0.0009) [2023-12-28 07:30:37,551][106226] Updated weights for policy 0, policy_version 1704370 (0.0009) [2023-12-28 07:30:37,601][106226] Updated weights for policy 0, policy_version 1704380 (0.0009) [2023-12-28 07:30:37,660][106226] Updated weights for policy 0, policy_version 1704390 (0.0008) [2023-12-28 07:30:37,678][106225] Updated weights for policy 1, policy_version 1708398 (0.0008) [2023-12-28 07:30:37,728][106225] Updated weights for policy 1, policy_version 1708408 (0.0009) [2023-12-28 07:30:37,780][106225] Updated weights for policy 1, policy_version 1708418 (0.0008) [2023-12-28 07:30:38,426][106226] Updated weights for policy 0, policy_version 1704400 (0.0010) [2023-12-28 07:30:38,492][106226] Updated weights for policy 0, policy_version 1704410 (0.0006) [2023-12-28 07:30:38,562][106226] Updated weights for policy 0, policy_version 1704420 (0.0006) [2023-12-28 07:30:38,579][106225] Updated weights for policy 1, policy_version 1708428 (0.0008) [2023-12-28 07:30:38,626][106225] Updated weights for policy 1, policy_version 1708438 (0.0006) [2023-12-28 07:30:38,685][106225] Updated weights for policy 1, policy_version 1708448 (0.0005) [2023-12-28 07:30:39,178][106226] Updated weights for policy 0, policy_version 1704430 (0.0007) [2023-12-28 07:30:39,244][106226] Updated weights for policy 0, policy_version 1704440 (0.0009) [2023-12-28 07:30:39,307][106226] Updated weights for policy 0, policy_version 1704450 (0.0007) [2023-12-28 07:30:39,426][106225] Updated weights for policy 1, policy_version 1708458 (0.0007) [2023-12-28 07:30:39,484][106225] Updated weights for policy 1, policy_version 1708468 (0.0011) [2023-12-28 07:30:39,553][106225] Updated weights for policy 1, policy_version 1708478 (0.0011) [2023-12-28 07:30:39,625][106225] Updated weights for policy 1, policy_version 1708488 (0.0011) [2023-12-28 07:30:39,943][106226] Updated weights for policy 0, policy_version 1704460 (0.0007) [2023-12-28 07:30:40,010][106226] Updated weights for policy 0, policy_version 1704470 (0.0008) [2023-12-28 07:30:40,071][106226] Updated weights for policy 0, policy_version 1704480 (0.0009) [2023-12-28 07:30:40,310][106225] Updated weights for policy 1, policy_version 1708498 (0.0007) [2023-12-28 07:30:40,377][106225] Updated weights for policy 1, policy_version 1708508 (0.0005) [2023-12-28 07:30:40,440][106225] Updated weights for policy 1, policy_version 1708518 (0.0006) [2023-12-28 07:30:40,771][106226] Updated weights for policy 0, policy_version 1704490 (0.0009) [2023-12-28 07:30:40,831][106226] Updated weights for policy 0, policy_version 1704500 (0.0008) [2023-12-28 07:30:40,892][106226] Updated weights for policy 0, policy_version 1704510 (0.0006) [2023-12-28 07:30:40,951][106226] Updated weights for policy 0, policy_version 1704520 (0.0007) [2023-12-28 07:30:41,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 873873408. Throughput: 0: 9910.1, 1: 9745.8. Samples: 873844488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:41,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.853')] [2023-12-28 07:30:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001704520_436436992.pth... [2023-12-28 07:30:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001703368_436142080.pth [2023-12-28 07:30:41,187][106225] Updated weights for policy 1, policy_version 1708528 (0.0007) [2023-12-28 07:30:41,249][106225] Updated weights for policy 1, policy_version 1708538 (0.0009) [2023-12-28 07:30:41,304][106225] Updated weights for policy 1, policy_version 1708548 (0.0008) [2023-12-28 07:30:41,323][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001708552_437444608.pth... [2023-12-28 07:30:41,326][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001707400_437149696.pth [2023-12-28 07:30:41,761][106226] Updated weights for policy 0, policy_version 1704530 (0.0009) [2023-12-28 07:30:41,827][106226] Updated weights for policy 0, policy_version 1704540 (0.0009) [2023-12-28 07:30:41,888][106226] Updated weights for policy 0, policy_version 1704550 (0.0010) [2023-12-28 07:30:41,991][106225] Updated weights for policy 1, policy_version 1708558 (0.0007) [2023-12-28 07:30:42,044][106225] Updated weights for policy 1, policy_version 1708568 (0.0008) [2023-12-28 07:30:42,098][106225] Updated weights for policy 1, policy_version 1708578 (0.0008) [2023-12-28 07:30:42,670][106226] Updated weights for policy 0, policy_version 1704560 (0.0011) [2023-12-28 07:30:42,733][106226] Updated weights for policy 0, policy_version 1704570 (0.0011) [2023-12-28 07:30:42,797][106226] Updated weights for policy 0, policy_version 1704580 (0.0009) [2023-12-28 07:30:42,853][106225] Updated weights for policy 1, policy_version 1708588 (0.0008) [2023-12-28 07:30:42,902][106225] Updated weights for policy 1, policy_version 1708598 (0.0005) [2023-12-28 07:30:42,956][106225] Updated weights for policy 1, policy_version 1708608 (0.0007) [2023-12-28 07:30:43,466][106226] Updated weights for policy 0, policy_version 1704590 (0.0008) [2023-12-28 07:30:43,522][106226] Updated weights for policy 0, policy_version 1704600 (0.0007) [2023-12-28 07:30:43,582][106226] Updated weights for policy 0, policy_version 1704610 (0.0008) [2023-12-28 07:30:43,634][106225] Updated weights for policy 1, policy_version 1708618 (0.0008) [2023-12-28 07:30:43,690][106225] Updated weights for policy 1, policy_version 1708628 (0.0008) [2023-12-28 07:30:43,750][106225] Updated weights for policy 1, policy_version 1708638 (0.0008) [2023-12-28 07:30:43,804][106225] Updated weights for policy 1, policy_version 1708648 (0.0008) [2023-12-28 07:30:44,230][106226] Updated weights for policy 0, policy_version 1704620 (0.0008) [2023-12-28 07:30:44,288][106226] Updated weights for policy 0, policy_version 1704630 (0.0008) [2023-12-28 07:30:44,353][106226] Updated weights for policy 0, policy_version 1704640 (0.0007) [2023-12-28 07:30:44,524][106225] Updated weights for policy 1, policy_version 1708658 (0.0005) [2023-12-28 07:30:44,579][106225] Updated weights for policy 1, policy_version 1708668 (0.0006) [2023-12-28 07:30:44,629][106225] Updated weights for policy 1, policy_version 1708678 (0.0010) [2023-12-28 07:30:45,084][106226] Updated weights for policy 0, policy_version 1704650 (0.0009) [2023-12-28 07:30:45,147][106226] Updated weights for policy 0, policy_version 1704660 (0.0011) [2023-12-28 07:30:45,207][106226] Updated weights for policy 0, policy_version 1704670 (0.0011) [2023-12-28 07:30:45,261][106226] Updated weights for policy 0, policy_version 1704680 (0.0010) [2023-12-28 07:30:45,287][106225] Updated weights for policy 1, policy_version 1708688 (0.0006) [2023-12-28 07:30:45,352][106225] Updated weights for policy 1, policy_version 1708698 (0.0006) [2023-12-28 07:30:45,412][106225] Updated weights for policy 1, policy_version 1708708 (0.0010) [2023-12-28 07:30:45,827][106226] Updated weights for policy 0, policy_version 1704690 (0.0005) [2023-12-28 07:30:45,885][106226] Updated weights for policy 0, policy_version 1704700 (0.0005) [2023-12-28 07:30:45,939][106226] Updated weights for policy 0, policy_version 1704710 (0.0005) [2023-12-28 07:30:46,080][106225] Updated weights for policy 1, policy_version 1708718 (0.0010) [2023-12-28 07:30:46,140][106225] Updated weights for policy 1, policy_version 1708728 (0.0010) [2023-12-28 07:30:46,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 873971712. Throughput: 0: 9856.8, 1: 9684.4. Samples: 873961416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:46,176][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.792')] [2023-12-28 07:30:46,193][106225] Updated weights for policy 1, policy_version 1708738 (0.0010) [2023-12-28 07:30:46,525][106226] Updated weights for policy 0, policy_version 1704720 (0.0006) [2023-12-28 07:30:46,581][106226] Updated weights for policy 0, policy_version 1704730 (0.0008) [2023-12-28 07:30:46,637][106226] Updated weights for policy 0, policy_version 1704740 (0.0007) [2023-12-28 07:30:46,766][106225] Updated weights for policy 1, policy_version 1708748 (0.0009) [2023-12-28 07:30:46,828][106225] Updated weights for policy 1, policy_version 1708758 (0.0010) [2023-12-28 07:30:46,881][106225] Updated weights for policy 1, policy_version 1708768 (0.0010) [2023-12-28 07:30:47,217][106226] Updated weights for policy 0, policy_version 1704750 (0.0007) [2023-12-28 07:30:47,278][106226] Updated weights for policy 0, policy_version 1704760 (0.0005) [2023-12-28 07:30:47,330][106226] Updated weights for policy 0, policy_version 1704770 (0.0005) [2023-12-28 07:30:47,595][106225] Updated weights for policy 1, policy_version 1708778 (0.0010) [2023-12-28 07:30:47,655][106225] Updated weights for policy 1, policy_version 1708788 (0.0010) [2023-12-28 07:30:47,705][106225] Updated weights for policy 1, policy_version 1708798 (0.0010) [2023-12-28 07:30:47,756][106225] Updated weights for policy 1, policy_version 1708808 (0.0010) [2023-12-28 07:30:47,904][106226] Updated weights for policy 0, policy_version 1704780 (0.0006) [2023-12-28 07:30:47,973][106226] Updated weights for policy 0, policy_version 1704790 (0.0006) [2023-12-28 07:30:48,042][106226] Updated weights for policy 0, policy_version 1704800 (0.0007) [2023-12-28 07:30:48,512][106225] Updated weights for policy 1, policy_version 1708818 (0.0005) [2023-12-28 07:30:48,565][106225] Updated weights for policy 1, policy_version 1708828 (0.0006) [2023-12-28 07:30:48,620][106225] Updated weights for policy 1, policy_version 1708838 (0.0005) [2023-12-28 07:30:48,726][106226] Updated weights for policy 0, policy_version 1704810 (0.0007) [2023-12-28 07:30:48,794][106226] Updated weights for policy 0, policy_version 1704820 (0.0010) [2023-12-28 07:30:48,862][106226] Updated weights for policy 0, policy_version 1704830 (0.0011) [2023-12-28 07:30:48,923][106226] Updated weights for policy 0, policy_version 1704840 (0.0010) [2023-12-28 07:30:49,310][106225] Updated weights for policy 1, policy_version 1708848 (0.0009) [2023-12-28 07:30:49,378][106225] Updated weights for policy 1, policy_version 1708858 (0.0008) [2023-12-28 07:30:49,440][106225] Updated weights for policy 1, policy_version 1708868 (0.0008) [2023-12-28 07:30:49,619][106226] Updated weights for policy 0, policy_version 1704850 (0.0009) [2023-12-28 07:30:49,693][106226] Updated weights for policy 0, policy_version 1704860 (0.0008) [2023-12-28 07:30:49,746][106226] Updated weights for policy 0, policy_version 1704870 (0.0006) [2023-12-28 07:30:50,122][106225] Updated weights for policy 1, policy_version 1708878 (0.0008) [2023-12-28 07:30:50,180][106225] Updated weights for policy 1, policy_version 1708888 (0.0008) [2023-12-28 07:30:50,232][106225] Updated weights for policy 1, policy_version 1708898 (0.0008) [2023-12-28 07:30:50,475][106226] Updated weights for policy 0, policy_version 1704880 (0.0010) [2023-12-28 07:30:50,539][106226] Updated weights for policy 0, policy_version 1704890 (0.0011) [2023-12-28 07:30:50,605][106226] Updated weights for policy 0, policy_version 1704900 (0.0010) [2023-12-28 07:30:51,009][106225] Updated weights for policy 1, policy_version 1708908 (0.0007) [2023-12-28 07:30:51,077][106225] Updated weights for policy 1, policy_version 1708918 (0.0007) [2023-12-28 07:30:51,142][106225] Updated weights for policy 1, policy_version 1708928 (0.0007) [2023-12-28 07:30:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 874070016. Throughput: 0: 9976.4, 1: 9709.4. Samples: 874085360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:51,175][105115] Avg episode reward: [(0, '-4.147'), (1, '-4.951')] [2023-12-28 07:30:51,329][106226] Updated weights for policy 0, policy_version 1704910 (0.0011) [2023-12-28 07:30:51,391][106226] Updated weights for policy 0, policy_version 1704920 (0.0011) [2023-12-28 07:30:51,442][106226] Updated weights for policy 0, policy_version 1704930 (0.0008) [2023-12-28 07:30:51,839][106225] Updated weights for policy 1, policy_version 1708938 (0.0007) [2023-12-28 07:30:51,895][106225] Updated weights for policy 1, policy_version 1708948 (0.0008) [2023-12-28 07:30:51,945][106225] Updated weights for policy 1, policy_version 1708958 (0.0009) [2023-12-28 07:30:52,007][106225] Updated weights for policy 1, policy_version 1708968 (0.0008) [2023-12-28 07:30:52,222][106226] Updated weights for policy 0, policy_version 1704940 (0.0008) [2023-12-28 07:30:52,281][106226] Updated weights for policy 0, policy_version 1704950 (0.0008) [2023-12-28 07:30:52,357][106226] Updated weights for policy 0, policy_version 1704960 (0.0009) [2023-12-28 07:30:52,696][106225] Updated weights for policy 1, policy_version 1708978 (0.0009) [2023-12-28 07:30:52,745][106225] Updated weights for policy 1, policy_version 1708988 (0.0009) [2023-12-28 07:30:52,789][106225] Updated weights for policy 1, policy_version 1708998 (0.0008) [2023-12-28 07:30:53,010][106226] Updated weights for policy 0, policy_version 1704970 (0.0011) [2023-12-28 07:30:53,060][106226] Updated weights for policy 0, policy_version 1704980 (0.0010) [2023-12-28 07:30:53,114][106226] Updated weights for policy 0, policy_version 1704990 (0.0009) [2023-12-28 07:30:53,166][106226] Updated weights for policy 0, policy_version 1705000 (0.0006) [2023-12-28 07:30:53,560][106225] Updated weights for policy 1, policy_version 1709008 (0.0008) [2023-12-28 07:30:53,620][106225] Updated weights for policy 1, policy_version 1709018 (0.0007) [2023-12-28 07:30:53,684][106225] Updated weights for policy 1, policy_version 1709028 (0.0008) [2023-12-28 07:30:53,794][106226] Updated weights for policy 0, policy_version 1705010 (0.0005) [2023-12-28 07:30:53,852][106226] Updated weights for policy 0, policy_version 1705020 (0.0007) [2023-12-28 07:30:53,912][106226] Updated weights for policy 0, policy_version 1705030 (0.0005) [2023-12-28 07:30:54,426][106225] Updated weights for policy 1, policy_version 1709038 (0.0007) [2023-12-28 07:30:54,476][106225] Updated weights for policy 1, policy_version 1709048 (0.0008) [2023-12-28 07:30:54,531][106225] Updated weights for policy 1, policy_version 1709058 (0.0007) [2023-12-28 07:30:54,572][106226] Updated weights for policy 0, policy_version 1705040 (0.0010) [2023-12-28 07:30:54,625][106226] Updated weights for policy 0, policy_version 1705050 (0.0010) [2023-12-28 07:30:54,674][106226] Updated weights for policy 0, policy_version 1705060 (0.0010) [2023-12-28 07:30:55,139][106225] Updated weights for policy 1, policy_version 1709068 (0.0009) [2023-12-28 07:30:55,192][106225] Updated weights for policy 1, policy_version 1709078 (0.0007) [2023-12-28 07:30:55,238][106225] Updated weights for policy 1, policy_version 1709088 (0.0008) [2023-12-28 07:30:55,360][106226] Updated weights for policy 0, policy_version 1705070 (0.0007) [2023-12-28 07:30:55,419][106226] Updated weights for policy 0, policy_version 1705080 (0.0006) [2023-12-28 07:30:55,488][106226] Updated weights for policy 0, policy_version 1705090 (0.0005) [2023-12-28 07:30:55,872][106225] Updated weights for policy 1, policy_version 1709098 (0.0007) [2023-12-28 07:30:55,937][106225] Updated weights for policy 1, policy_version 1709108 (0.0006) [2023-12-28 07:30:55,987][106225] Updated weights for policy 1, policy_version 1709118 (0.0008) [2023-12-28 07:30:56,033][106225] Updated weights for policy 1, policy_version 1709128 (0.0005) [2023-12-28 07:30:56,066][106226] Updated weights for policy 0, policy_version 1705100 (0.0007) [2023-12-28 07:30:56,119][106226] Updated weights for policy 0, policy_version 1705110 (0.0006) [2023-12-28 07:30:56,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 874176512. Throughput: 0: 9997.7, 1: 9675.5. Samples: 874144340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:30:56,175][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.867')] [2023-12-28 07:30:56,178][106226] Updated weights for policy 0, policy_version 1705120 (0.0006) [2023-12-28 07:30:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001709128_437592064.pth... [2023-12-28 07:30:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001707976_437297152.pth [2023-12-28 07:30:56,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001705128_436592640.pth... [2023-12-28 07:30:56,228][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001703912_436281344.pth [2023-12-28 07:30:56,726][106225] Updated weights for policy 1, policy_version 1709139 (0.0009) [2023-12-28 07:30:56,765][106226] Updated weights for policy 0, policy_version 1705130 (0.0005) [2023-12-28 07:30:56,777][106225] Updated weights for policy 1, policy_version 1709149 (0.0008) [2023-12-28 07:30:56,819][106226] Updated weights for policy 0, policy_version 1705140 (0.0005) [2023-12-28 07:30:56,826][106225] Updated weights for policy 1, policy_version 1709159 (0.0008) [2023-12-28 07:30:56,875][106226] Updated weights for policy 0, policy_version 1705150 (0.0005) [2023-12-28 07:30:56,935][106226] Updated weights for policy 0, policy_version 1705160 (0.0005) [2023-12-28 07:30:57,452][106226] Updated weights for policy 0, policy_version 1705170 (0.0010) [2023-12-28 07:30:57,515][106226] Updated weights for policy 0, policy_version 1705180 (0.0010) [2023-12-28 07:30:57,545][106225] Updated weights for policy 1, policy_version 1709169 (0.0007) [2023-12-28 07:30:57,568][106226] Updated weights for policy 0, policy_version 1705190 (0.0010) [2023-12-28 07:30:57,593][106225] Updated weights for policy 1, policy_version 1709179 (0.0007) [2023-12-28 07:30:57,645][106225] Updated weights for policy 1, policy_version 1709189 (0.0008) [2023-12-28 07:30:58,271][106226] Updated weights for policy 0, policy_version 1705200 (0.0008) [2023-12-28 07:30:58,283][106225] Updated weights for policy 1, policy_version 1709199 (0.0006) [2023-12-28 07:30:58,351][106225] Updated weights for policy 1, policy_version 1709209 (0.0008) [2023-12-28 07:30:58,360][106226] Updated weights for policy 0, policy_version 1705213 (0.0008) [2023-12-28 07:30:58,418][106225] Updated weights for policy 1, policy_version 1709219 (0.0008) [2023-12-28 07:30:58,423][106226] Updated weights for policy 0, policy_version 1705223 (0.0007) [2023-12-28 07:30:59,229][106226] Updated weights for policy 0, policy_version 1705233 (0.0009) [2023-12-28 07:30:59,260][106225] Updated weights for policy 1, policy_version 1709229 (0.0008) [2023-12-28 07:30:59,300][106226] Updated weights for policy 0, policy_version 1705243 (0.0008) [2023-12-28 07:30:59,326][106225] Updated weights for policy 1, policy_version 1709239 (0.0006) [2023-12-28 07:30:59,363][106226] Updated weights for policy 0, policy_version 1705253 (0.0010) [2023-12-28 07:30:59,398][106225] Updated weights for policy 1, policy_version 1709249 (0.0007) [2023-12-28 07:31:00,040][106225] Updated weights for policy 1, policy_version 1709259 (0.0007) [2023-12-28 07:31:00,076][106226] Updated weights for policy 0, policy_version 1705263 (0.0013) [2023-12-28 07:31:00,094][106225] Updated weights for policy 1, policy_version 1709269 (0.0008) [2023-12-28 07:31:00,131][106226] Updated weights for policy 0, policy_version 1705273 (0.0007) [2023-12-28 07:31:00,145][106225] Updated weights for policy 1, policy_version 1709279 (0.0006) [2023-12-28 07:31:00,184][106226] Updated weights for policy 0, policy_version 1705283 (0.0006) [2023-12-28 07:31:00,819][106226] Updated weights for policy 0, policy_version 1705293 (0.0006) [2023-12-28 07:31:00,869][106226] Updated weights for policy 0, policy_version 1705303 (0.0005) [2023-12-28 07:31:00,920][106226] Updated weights for policy 0, policy_version 1705313 (0.0005) [2023-12-28 07:31:00,933][106225] Updated weights for policy 1, policy_version 1709289 (0.0007) [2023-12-28 07:31:00,990][106225] Updated weights for policy 1, policy_version 1709299 (0.0009) [2023-12-28 07:31:01,059][106225] Updated weights for policy 1, policy_version 1709309 (0.0008) [2023-12-28 07:31:01,120][106225] Updated weights for policy 1, policy_version 1709319 (0.0007) [2023-12-28 07:31:01,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 874283008. Throughput: 0: 10060.9, 1: 9783.0. Samples: 874266776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:01,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-5.135')] [2023-12-28 07:31:01,578][106226] Updated weights for policy 0, policy_version 1705323 (0.0006) [2023-12-28 07:31:01,650][106226] Updated weights for policy 0, policy_version 1705333 (0.0007) [2023-12-28 07:31:01,711][106226] Updated weights for policy 0, policy_version 1705343 (0.0006) [2023-12-28 07:31:01,883][106225] Updated weights for policy 1, policy_version 1709329 (0.0007) [2023-12-28 07:31:01,943][106225] Updated weights for policy 1, policy_version 1709339 (0.0009) [2023-12-28 07:31:02,000][106225] Updated weights for policy 1, policy_version 1709349 (0.0008) [2023-12-28 07:31:02,325][106226] Updated weights for policy 0, policy_version 1705353 (0.0008) [2023-12-28 07:31:02,394][106226] Updated weights for policy 0, policy_version 1705363 (0.0009) [2023-12-28 07:31:02,456][106226] Updated weights for policy 0, policy_version 1705373 (0.0008) [2023-12-28 07:31:02,515][106226] Updated weights for policy 0, policy_version 1705383 (0.0008) [2023-12-28 07:31:02,694][106225] Updated weights for policy 1, policy_version 1709359 (0.0008) [2023-12-28 07:31:02,753][106225] Updated weights for policy 1, policy_version 1709369 (0.0008) [2023-12-28 07:31:02,815][106225] Updated weights for policy 1, policy_version 1709379 (0.0009) [2023-12-28 07:31:03,227][106226] Updated weights for policy 0, policy_version 1705393 (0.0006) [2023-12-28 07:31:03,273][106226] Updated weights for policy 0, policy_version 1705403 (0.0005) [2023-12-28 07:31:03,329][106226] Updated weights for policy 0, policy_version 1705413 (0.0006) [2023-12-28 07:31:03,438][106225] Updated weights for policy 1, policy_version 1709389 (0.0007) [2023-12-28 07:31:03,491][106225] Updated weights for policy 1, policy_version 1709399 (0.0005) [2023-12-28 07:31:03,542][106225] Updated weights for policy 1, policy_version 1709409 (0.0006) [2023-12-28 07:31:04,112][106226] Updated weights for policy 0, policy_version 1705423 (0.0009) [2023-12-28 07:31:04,151][106225] Updated weights for policy 1, policy_version 1709419 (0.0008) [2023-12-28 07:31:04,177][106226] Updated weights for policy 0, policy_version 1705433 (0.0011) [2023-12-28 07:31:04,209][106225] Updated weights for policy 1, policy_version 1709429 (0.0006) [2023-12-28 07:31:04,243][106226] Updated weights for policy 0, policy_version 1705443 (0.0008) [2023-12-28 07:31:04,275][106225] Updated weights for policy 1, policy_version 1709439 (0.0010) [2023-12-28 07:31:04,928][106226] Updated weights for policy 0, policy_version 1705453 (0.0008) [2023-12-28 07:31:04,980][106225] Updated weights for policy 1, policy_version 1709449 (0.0010) [2023-12-28 07:31:04,988][106226] Updated weights for policy 0, policy_version 1705463 (0.0010) [2023-12-28 07:31:05,042][106225] Updated weights for policy 1, policy_version 1709459 (0.0006) [2023-12-28 07:31:05,052][106226] Updated weights for policy 0, policy_version 1705473 (0.0007) [2023-12-28 07:31:05,105][106225] Updated weights for policy 1, policy_version 1709469 (0.0005) [2023-12-28 07:31:05,156][106225] Updated weights for policy 1, policy_version 1709479 (0.0005) [2023-12-28 07:31:05,677][106226] Updated weights for policy 0, policy_version 1705483 (0.0008) [2023-12-28 07:31:05,702][106225] Updated weights for policy 1, policy_version 1709489 (0.0008) [2023-12-28 07:31:05,730][106226] Updated weights for policy 0, policy_version 1705493 (0.0010) [2023-12-28 07:31:05,754][106225] Updated weights for policy 1, policy_version 1709499 (0.0009) [2023-12-28 07:31:05,777][106226] Updated weights for policy 0, policy_version 1705503 (0.0010) [2023-12-28 07:31:05,800][106225] Updated weights for policy 1, policy_version 1709509 (0.0010) [2023-12-28 07:31:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 874381312. Throughput: 0: 10177.2, 1: 9868.2. Samples: 874388676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:06,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.676')] [2023-12-28 07:31:06,499][106226] Updated weights for policy 0, policy_version 1705513 (0.0010) [2023-12-28 07:31:06,555][106226] Updated weights for policy 0, policy_version 1705523 (0.0007) [2023-12-28 07:31:06,576][106225] Updated weights for policy 1, policy_version 1709519 (0.0010) [2023-12-28 07:31:06,609][106226] Updated weights for policy 0, policy_version 1705533 (0.0008) [2023-12-28 07:31:06,639][106225] Updated weights for policy 1, policy_version 1709529 (0.0010) [2023-12-28 07:31:06,676][106226] Updated weights for policy 0, policy_version 1705543 (0.0011) [2023-12-28 07:31:06,702][106225] Updated weights for policy 1, policy_version 1709539 (0.0010) [2023-12-28 07:31:07,364][106225] Updated weights for policy 1, policy_version 1709549 (0.0010) [2023-12-28 07:31:07,402][106226] Updated weights for policy 0, policy_version 1705553 (0.0006) [2023-12-28 07:31:07,422][106225] Updated weights for policy 1, policy_version 1709559 (0.0010) [2023-12-28 07:31:07,453][106226] Updated weights for policy 0, policy_version 1705563 (0.0008) [2023-12-28 07:31:07,473][106225] Updated weights for policy 1, policy_version 1709569 (0.0010) [2023-12-28 07:31:07,504][106226] Updated weights for policy 0, policy_version 1705573 (0.0008) [2023-12-28 07:31:08,137][106226] Updated weights for policy 0, policy_version 1705583 (0.0007) [2023-12-28 07:31:08,199][106225] Updated weights for policy 1, policy_version 1709579 (0.0010) [2023-12-28 07:31:08,202][106226] Updated weights for policy 0, policy_version 1705593 (0.0005) [2023-12-28 07:31:08,260][106225] Updated weights for policy 1, policy_version 1709589 (0.0009) [2023-12-28 07:31:08,266][106226] Updated weights for policy 0, policy_version 1705603 (0.0010) [2023-12-28 07:31:08,347][106225] Updated weights for policy 1, policy_version 1709599 (0.0006) [2023-12-28 07:31:08,957][106225] Updated weights for policy 1, policy_version 1709609 (0.0007) [2023-12-28 07:31:09,019][106225] Updated weights for policy 1, policy_version 1709619 (0.0011) [2023-12-28 07:31:09,023][106226] Updated weights for policy 0, policy_version 1705613 (0.0010) [2023-12-28 07:31:09,077][106225] Updated weights for policy 1, policy_version 1709629 (0.0011) [2023-12-28 07:31:09,086][106226] Updated weights for policy 0, policy_version 1705623 (0.0011) [2023-12-28 07:31:09,128][106225] Updated weights for policy 1, policy_version 1709639 (0.0010) [2023-12-28 07:31:09,153][106226] Updated weights for policy 0, policy_version 1705633 (0.0011) [2023-12-28 07:31:09,874][106226] Updated weights for policy 0, policy_version 1705643 (0.0010) [2023-12-28 07:31:09,914][106225] Updated weights for policy 1, policy_version 1709649 (0.0009) [2023-12-28 07:31:09,936][106226] Updated weights for policy 0, policy_version 1705653 (0.0007) [2023-12-28 07:31:09,978][106225] Updated weights for policy 1, policy_version 1709659 (0.0009) [2023-12-28 07:31:09,995][106226] Updated weights for policy 0, policy_version 1705663 (0.0006) [2023-12-28 07:31:10,042][106225] Updated weights for policy 1, policy_version 1709669 (0.0009) [2023-12-28 07:31:10,659][106226] Updated weights for policy 0, policy_version 1705673 (0.0007) [2023-12-28 07:31:10,715][106226] Updated weights for policy 0, policy_version 1705683 (0.0006) [2023-12-28 07:31:10,777][106226] Updated weights for policy 0, policy_version 1705693 (0.0005) [2023-12-28 07:31:10,844][106226] Updated weights for policy 0, policy_version 1705703 (0.0005) [2023-12-28 07:31:10,866][106225] Updated weights for policy 1, policy_version 1709679 (0.0008) [2023-12-28 07:31:10,929][106225] Updated weights for policy 1, policy_version 1709689 (0.0008) [2023-12-28 07:31:10,985][106225] Updated weights for policy 1, policy_version 1709699 (0.0009) [2023-12-28 07:31:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 874479616. Throughput: 0: 10244.5, 1: 9905.5. Samples: 874448260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:11,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.664')] [2023-12-28 07:31:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001709704_437739520.pth... [2023-12-28 07:31:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001705704_436740096.pth... [2023-12-28 07:31:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001708552_437444608.pth [2023-12-28 07:31:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001704520_436436992.pth [2023-12-28 07:31:11,524][106226] Updated weights for policy 0, policy_version 1705713 (0.0009) [2023-12-28 07:31:11,581][106226] Updated weights for policy 0, policy_version 1705723 (0.0009) [2023-12-28 07:31:11,640][106226] Updated weights for policy 0, policy_version 1705733 (0.0009) [2023-12-28 07:31:11,799][106225] Updated weights for policy 1, policy_version 1709709 (0.0008) [2023-12-28 07:31:11,859][106225] Updated weights for policy 1, policy_version 1709719 (0.0008) [2023-12-28 07:31:11,925][106225] Updated weights for policy 1, policy_version 1709729 (0.0009) [2023-12-28 07:31:12,319][106226] Updated weights for policy 0, policy_version 1705743 (0.0008) [2023-12-28 07:31:12,391][106226] Updated weights for policy 0, policy_version 1705753 (0.0007) [2023-12-28 07:31:12,452][106226] Updated weights for policy 0, policy_version 1705763 (0.0008) [2023-12-28 07:31:12,722][106225] Updated weights for policy 1, policy_version 1709739 (0.0008) [2023-12-28 07:31:12,788][106225] Updated weights for policy 1, policy_version 1709749 (0.0005) [2023-12-28 07:31:12,845][106225] Updated weights for policy 1, policy_version 1709759 (0.0010) [2023-12-28 07:31:13,209][106226] Updated weights for policy 0, policy_version 1705773 (0.0009) [2023-12-28 07:31:13,265][106226] Updated weights for policy 0, policy_version 1705783 (0.0010) [2023-12-28 07:31:13,315][106226] Updated weights for policy 0, policy_version 1705793 (0.0010) [2023-12-28 07:31:13,448][106225] Updated weights for policy 1, policy_version 1709769 (0.0010) [2023-12-28 07:31:13,500][106225] Updated weights for policy 1, policy_version 1709779 (0.0008) [2023-12-28 07:31:13,547][106225] Updated weights for policy 1, policy_version 1709789 (0.0007) [2023-12-28 07:31:13,600][106225] Updated weights for policy 1, policy_version 1709799 (0.0008) [2023-12-28 07:31:13,946][106226] Updated weights for policy 0, policy_version 1705803 (0.0010) [2023-12-28 07:31:14,007][106226] Updated weights for policy 0, policy_version 1705813 (0.0008) [2023-12-28 07:31:14,075][106226] Updated weights for policy 0, policy_version 1705823 (0.0008) [2023-12-28 07:31:14,276][106225] Updated weights for policy 1, policy_version 1709809 (0.0010) [2023-12-28 07:31:14,333][106225] Updated weights for policy 1, policy_version 1709819 (0.0010) [2023-12-28 07:31:14,391][106225] Updated weights for policy 1, policy_version 1709829 (0.0010) [2023-12-28 07:31:14,691][106226] Updated weights for policy 0, policy_version 1705833 (0.0010) [2023-12-28 07:31:14,770][106226] Updated weights for policy 0, policy_version 1705843 (0.0021) [2023-12-28 07:31:14,824][106226] Updated weights for policy 0, policy_version 1705853 (0.0007) [2023-12-28 07:31:14,892][106226] Updated weights for policy 0, policy_version 1705863 (0.0006) [2023-12-28 07:31:15,057][106225] Updated weights for policy 1, policy_version 1709839 (0.0010) [2023-12-28 07:31:15,122][106225] Updated weights for policy 1, policy_version 1709849 (0.0011) [2023-12-28 07:31:15,187][106225] Updated weights for policy 1, policy_version 1709859 (0.0007) [2023-12-28 07:31:15,550][106226] Updated weights for policy 0, policy_version 1705873 (0.0010) [2023-12-28 07:31:15,606][106226] Updated weights for policy 0, policy_version 1705883 (0.0010) [2023-12-28 07:31:15,658][106226] Updated weights for policy 0, policy_version 1705893 (0.0010) [2023-12-28 07:31:15,904][106225] Updated weights for policy 1, policy_version 1709869 (0.0008) [2023-12-28 07:31:15,957][106225] Updated weights for policy 1, policy_version 1709879 (0.0005) [2023-12-28 07:31:16,008][106225] Updated weights for policy 1, policy_version 1709889 (0.0007) [2023-12-28 07:31:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 874577920. Throughput: 0: 10169.1, 1: 9816.9. Samples: 874566004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:16,175][105115] Avg episode reward: [(0, '-4.121'), (1, '-4.574')] [2023-12-28 07:31:16,250][106226] Updated weights for policy 0, policy_version 1705903 (0.0007) [2023-12-28 07:31:16,299][106226] Updated weights for policy 0, policy_version 1705913 (0.0005) [2023-12-28 07:31:16,361][106226] Updated weights for policy 0, policy_version 1705923 (0.0010) [2023-12-28 07:31:16,577][106225] Updated weights for policy 1, policy_version 1709899 (0.0005) [2023-12-28 07:31:16,623][106225] Updated weights for policy 1, policy_version 1709909 (0.0005) [2023-12-28 07:31:16,668][106225] Updated weights for policy 1, policy_version 1709919 (0.0005) [2023-12-28 07:31:16,957][106226] Updated weights for policy 0, policy_version 1705933 (0.0008) [2023-12-28 07:31:17,025][106226] Updated weights for policy 0, policy_version 1705943 (0.0005) [2023-12-28 07:31:17,094][106226] Updated weights for policy 0, policy_version 1705953 (0.0005) [2023-12-28 07:31:17,322][106225] Updated weights for policy 1, policy_version 1709929 (0.0007) [2023-12-28 07:31:17,390][106225] Updated weights for policy 1, policy_version 1709939 (0.0007) [2023-12-28 07:31:17,458][106225] Updated weights for policy 1, policy_version 1709949 (0.0009) [2023-12-28 07:31:17,524][106225] Updated weights for policy 1, policy_version 1709959 (0.0008) [2023-12-28 07:31:17,612][106226] Updated weights for policy 0, policy_version 1705963 (0.0005) [2023-12-28 07:31:17,663][106226] Updated weights for policy 0, policy_version 1705973 (0.0005) [2023-12-28 07:31:17,713][106226] Updated weights for policy 0, policy_version 1705983 (0.0006) [2023-12-28 07:31:18,195][106225] Updated weights for policy 1, policy_version 1709969 (0.0007) [2023-12-28 07:31:18,254][106225] Updated weights for policy 1, policy_version 1709979 (0.0009) [2023-12-28 07:31:18,312][106226] Updated weights for policy 0, policy_version 1705993 (0.0005) [2023-12-28 07:31:18,319][106225] Updated weights for policy 1, policy_version 1709989 (0.0008) [2023-12-28 07:31:18,376][106226] Updated weights for policy 0, policy_version 1706003 (0.0008) [2023-12-28 07:31:18,439][106226] Updated weights for policy 0, policy_version 1706013 (0.0007) [2023-12-28 07:31:18,493][106226] Updated weights for policy 0, policy_version 1706023 (0.0007) [2023-12-28 07:31:19,075][106226] Updated weights for policy 0, policy_version 1706033 (0.0009) [2023-12-28 07:31:19,105][106225] Updated weights for policy 1, policy_version 1709999 (0.0007) [2023-12-28 07:31:19,133][106226] Updated weights for policy 0, policy_version 1706043 (0.0007) [2023-12-28 07:31:19,155][106225] Updated weights for policy 1, policy_version 1710009 (0.0006) [2023-12-28 07:31:19,188][106226] Updated weights for policy 0, policy_version 1706053 (0.0007) [2023-12-28 07:31:19,205][106225] Updated weights for policy 1, policy_version 1710019 (0.0005) [2023-12-28 07:31:19,871][106226] Updated weights for policy 0, policy_version 1706063 (0.0008) [2023-12-28 07:31:19,934][106226] Updated weights for policy 0, policy_version 1706073 (0.0008) [2023-12-28 07:31:19,980][106225] Updated weights for policy 1, policy_version 1710029 (0.0008) [2023-12-28 07:31:19,995][106226] Updated weights for policy 0, policy_version 1706083 (0.0007) [2023-12-28 07:31:20,043][106225] Updated weights for policy 1, policy_version 1710039 (0.0007) [2023-12-28 07:31:20,103][106225] Updated weights for policy 1, policy_version 1710049 (0.0008) [2023-12-28 07:31:20,657][106226] Updated weights for policy 0, policy_version 1706093 (0.0008) [2023-12-28 07:31:20,720][106226] Updated weights for policy 0, policy_version 1706103 (0.0009) [2023-12-28 07:31:20,780][106226] Updated weights for policy 0, policy_version 1706113 (0.0009) [2023-12-28 07:31:20,823][106225] Updated weights for policy 1, policy_version 1710059 (0.0009) [2023-12-28 07:31:20,881][106225] Updated weights for policy 1, policy_version 1710069 (0.0009) [2023-12-28 07:31:20,952][106225] Updated weights for policy 1, policy_version 1710079 (0.0010) [2023-12-28 07:31:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 874684416. Throughput: 0: 10254.6, 1: 9853.5. Samples: 874691792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:21,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.549')] [2023-12-28 07:31:21,477][106226] Updated weights for policy 0, policy_version 1706123 (0.0006) [2023-12-28 07:31:21,540][106226] Updated weights for policy 0, policy_version 1706133 (0.0006) [2023-12-28 07:31:21,609][106226] Updated weights for policy 0, policy_version 1706143 (0.0008) [2023-12-28 07:31:21,745][106225] Updated weights for policy 1, policy_version 1710089 (0.0010) [2023-12-28 07:31:21,808][106225] Updated weights for policy 1, policy_version 1710099 (0.0009) [2023-12-28 07:31:21,873][106225] Updated weights for policy 1, policy_version 1710109 (0.0008) [2023-12-28 07:31:21,937][106225] Updated weights for policy 1, policy_version 1710119 (0.0008) [2023-12-28 07:31:22,335][106226] Updated weights for policy 0, policy_version 1706153 (0.0008) [2023-12-28 07:31:22,403][106226] Updated weights for policy 0, policy_version 1706163 (0.0009) [2023-12-28 07:31:22,469][106226] Updated weights for policy 0, policy_version 1706173 (0.0009) [2023-12-28 07:31:22,529][106226] Updated weights for policy 0, policy_version 1706183 (0.0009) [2023-12-28 07:31:22,697][106225] Updated weights for policy 1, policy_version 1710129 (0.0011) [2023-12-28 07:31:22,759][106225] Updated weights for policy 1, policy_version 1710139 (0.0010) [2023-12-28 07:31:22,820][106225] Updated weights for policy 1, policy_version 1710149 (0.0011) [2023-12-28 07:31:23,149][106226] Updated weights for policy 0, policy_version 1706193 (0.0009) [2023-12-28 07:31:23,197][106226] Updated weights for policy 0, policy_version 1706203 (0.0007) [2023-12-28 07:31:23,257][106226] Updated weights for policy 0, policy_version 1706213 (0.0006) [2023-12-28 07:31:23,484][106225] Updated weights for policy 1, policy_version 1710159 (0.0010) [2023-12-28 07:31:23,540][106225] Updated weights for policy 1, policy_version 1710169 (0.0010) [2023-12-28 07:31:23,601][106225] Updated weights for policy 1, policy_version 1710179 (0.0006) [2023-12-28 07:31:24,027][106226] Updated weights for policy 0, policy_version 1706223 (0.0006) [2023-12-28 07:31:24,075][106226] Updated weights for policy 0, policy_version 1706233 (0.0007) [2023-12-28 07:31:24,128][106226] Updated weights for policy 0, policy_version 1706243 (0.0006) [2023-12-28 07:31:24,245][106225] Updated weights for policy 1, policy_version 1710189 (0.0008) [2023-12-28 07:31:24,307][106225] Updated weights for policy 1, policy_version 1710199 (0.0010) [2023-12-28 07:31:24,357][106225] Updated weights for policy 1, policy_version 1710209 (0.0010) [2023-12-28 07:31:24,767][106226] Updated weights for policy 0, policy_version 1706253 (0.0006) [2023-12-28 07:31:24,818][106226] Updated weights for policy 0, policy_version 1706263 (0.0009) [2023-12-28 07:31:24,866][106226] Updated weights for policy 0, policy_version 1706273 (0.0007) [2023-12-28 07:31:24,999][106225] Updated weights for policy 1, policy_version 1710219 (0.0009) [2023-12-28 07:31:25,059][106225] Updated weights for policy 1, policy_version 1710229 (0.0005) [2023-12-28 07:31:25,119][106225] Updated weights for policy 1, policy_version 1710239 (0.0005) [2023-12-28 07:31:25,602][106226] Updated weights for policy 0, policy_version 1706283 (0.0007) [2023-12-28 07:31:25,606][106225] Updated weights for policy 1, policy_version 1710249 (0.0005) [2023-12-28 07:31:25,652][106226] Updated weights for policy 0, policy_version 1706293 (0.0008) [2023-12-28 07:31:25,664][106225] Updated weights for policy 1, policy_version 1710259 (0.0008) [2023-12-28 07:31:25,703][106226] Updated weights for policy 0, policy_version 1706303 (0.0008) [2023-12-28 07:31:25,713][106225] Updated weights for policy 1, policy_version 1710269 (0.0010) [2023-12-28 07:31:25,771][106225] Updated weights for policy 1, policy_version 1710279 (0.0009) [2023-12-28 07:31:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 874782720. Throughput: 0: 10247.4, 1: 9861.3. Samples: 874749380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:26,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.816')] [2023-12-28 07:31:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001710280_437886976.pth... [2023-12-28 07:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001706312_436895744.pth... [2023-12-28 07:31:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001709128_437592064.pth [2023-12-28 07:31:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001705128_436592640.pth [2023-12-28 07:31:26,414][106225] Updated weights for policy 1, policy_version 1710289 (0.0010) [2023-12-28 07:31:26,458][106226] Updated weights for policy 0, policy_version 1706313 (0.0006) [2023-12-28 07:31:26,468][106225] Updated weights for policy 1, policy_version 1710299 (0.0010) [2023-12-28 07:31:26,515][106225] Updated weights for policy 1, policy_version 1710309 (0.0010) [2023-12-28 07:31:26,519][106226] Updated weights for policy 0, policy_version 1706323 (0.0005) [2023-12-28 07:31:26,575][106226] Updated weights for policy 0, policy_version 1706333 (0.0008) [2023-12-28 07:31:26,636][106226] Updated weights for policy 0, policy_version 1706343 (0.0008) [2023-12-28 07:31:27,122][106225] Updated weights for policy 1, policy_version 1710319 (0.0007) [2023-12-28 07:31:27,172][106225] Updated weights for policy 1, policy_version 1710329 (0.0005) [2023-12-28 07:31:27,226][106225] Updated weights for policy 1, policy_version 1710339 (0.0005) [2023-12-28 07:31:27,390][106226] Updated weights for policy 0, policy_version 1706353 (0.0009) [2023-12-28 07:31:27,440][106226] Updated weights for policy 0, policy_version 1706363 (0.0007) [2023-12-28 07:31:27,499][106226] Updated weights for policy 0, policy_version 1706373 (0.0007) [2023-12-28 07:31:27,818][106225] Updated weights for policy 1, policy_version 1710349 (0.0008) [2023-12-28 07:31:27,880][106225] Updated weights for policy 1, policy_version 1710359 (0.0010) [2023-12-28 07:31:27,938][106225] Updated weights for policy 1, policy_version 1710369 (0.0010) [2023-12-28 07:31:28,236][106226] Updated weights for policy 0, policy_version 1706383 (0.0008) [2023-12-28 07:31:28,288][106226] Updated weights for policy 0, policy_version 1706393 (0.0008) [2023-12-28 07:31:28,348][106226] Updated weights for policy 0, policy_version 1706403 (0.0009) [2023-12-28 07:31:28,612][106225] Updated weights for policy 1, policy_version 1710379 (0.0009) [2023-12-28 07:31:28,667][106225] Updated weights for policy 1, policy_version 1710389 (0.0005) [2023-12-28 07:31:28,726][106225] Updated weights for policy 1, policy_version 1710399 (0.0006) [2023-12-28 07:31:29,100][106226] Updated weights for policy 0, policy_version 1706413 (0.0008) [2023-12-28 07:31:29,145][106226] Updated weights for policy 0, policy_version 1706423 (0.0008) [2023-12-28 07:31:29,191][106226] Updated weights for policy 0, policy_version 1706433 (0.0007) [2023-12-28 07:31:29,416][106225] Updated weights for policy 1, policy_version 1710409 (0.0010) [2023-12-28 07:31:29,481][106225] Updated weights for policy 1, policy_version 1710419 (0.0010) [2023-12-28 07:31:29,548][106225] Updated weights for policy 1, policy_version 1710429 (0.0010) [2023-12-28 07:31:29,615][106225] Updated weights for policy 1, policy_version 1710439 (0.0006) [2023-12-28 07:31:29,891][106226] Updated weights for policy 0, policy_version 1706443 (0.0009) [2023-12-28 07:31:29,954][106226] Updated weights for policy 0, policy_version 1706453 (0.0008) [2023-12-28 07:31:30,022][106226] Updated weights for policy 0, policy_version 1706463 (0.0007) [2023-12-28 07:31:30,271][106225] Updated weights for policy 1, policy_version 1710449 (0.0005) [2023-12-28 07:31:30,325][106225] Updated weights for policy 1, policy_version 1710459 (0.0005) [2023-12-28 07:31:30,379][106225] Updated weights for policy 1, policy_version 1710469 (0.0005) [2023-12-28 07:31:30,808][106226] Updated weights for policy 0, policy_version 1706473 (0.0008) [2023-12-28 07:31:30,862][106226] Updated weights for policy 0, policy_version 1706483 (0.0006) [2023-12-28 07:31:30,917][106226] Updated weights for policy 0, policy_version 1706493 (0.0005) [2023-12-28 07:31:30,977][106226] Updated weights for policy 0, policy_version 1706503 (0.0005) [2023-12-28 07:31:30,993][106225] Updated weights for policy 1, policy_version 1710479 (0.0009) [2023-12-28 07:31:31,055][106225] Updated weights for policy 1, policy_version 1710489 (0.0009) [2023-12-28 07:31:31,123][106225] Updated weights for policy 1, policy_version 1710499 (0.0008) [2023-12-28 07:31:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20207.0, 300 sec: 19883.0). Total num frames: 874889216. Throughput: 0: 10221.2, 1: 10020.7. Samples: 874872296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:31,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.473')] [2023-12-28 07:31:31,710][106226] Updated weights for policy 0, policy_version 1706513 (0.0007) [2023-12-28 07:31:31,774][106226] Updated weights for policy 0, policy_version 1706523 (0.0008) [2023-12-28 07:31:31,831][106226] Updated weights for policy 0, policy_version 1706533 (0.0008) [2023-12-28 07:31:31,876][106225] Updated weights for policy 1, policy_version 1710509 (0.0009) [2023-12-28 07:31:31,937][106225] Updated weights for policy 1, policy_version 1710519 (0.0010) [2023-12-28 07:31:32,001][106225] Updated weights for policy 1, policy_version 1710529 (0.0007) [2023-12-28 07:31:32,538][106226] Updated weights for policy 0, policy_version 1706543 (0.0008) [2023-12-28 07:31:32,604][106226] Updated weights for policy 0, policy_version 1706553 (0.0008) [2023-12-28 07:31:32,662][106226] Updated weights for policy 0, policy_version 1706563 (0.0010) [2023-12-28 07:31:32,695][106225] Updated weights for policy 1, policy_version 1710539 (0.0008) [2023-12-28 07:31:32,759][106225] Updated weights for policy 1, policy_version 1710549 (0.0010) [2023-12-28 07:31:32,818][106225] Updated weights for policy 1, policy_version 1710559 (0.0010) [2023-12-28 07:31:33,396][106226] Updated weights for policy 0, policy_version 1706573 (0.0008) [2023-12-28 07:31:33,452][106226] Updated weights for policy 0, policy_version 1706583 (0.0007) [2023-12-28 07:31:33,493][106225] Updated weights for policy 1, policy_version 1710569 (0.0010) [2023-12-28 07:31:33,510][106226] Updated weights for policy 0, policy_version 1706593 (0.0007) [2023-12-28 07:31:33,549][106225] Updated weights for policy 1, policy_version 1710579 (0.0010) [2023-12-28 07:31:33,614][106225] Updated weights for policy 1, policy_version 1710589 (0.0010) [2023-12-28 07:31:33,675][106225] Updated weights for policy 1, policy_version 1710599 (0.0010) [2023-12-28 07:31:34,265][106226] Updated weights for policy 0, policy_version 1706603 (0.0006) [2023-12-28 07:31:34,320][106225] Updated weights for policy 1, policy_version 1710609 (0.0008) [2023-12-28 07:31:34,321][106226] Updated weights for policy 0, policy_version 1706613 (0.0008) [2023-12-28 07:31:34,378][106225] Updated weights for policy 1, policy_version 1710619 (0.0006) [2023-12-28 07:31:34,384][106226] Updated weights for policy 0, policy_version 1706623 (0.0008) [2023-12-28 07:31:34,435][106225] Updated weights for policy 1, policy_version 1710629 (0.0006) [2023-12-28 07:31:35,055][106226] Updated weights for policy 0, policy_version 1706633 (0.0007) [2023-12-28 07:31:35,122][106226] Updated weights for policy 0, policy_version 1706643 (0.0006) [2023-12-28 07:31:35,184][106225] Updated weights for policy 1, policy_version 1710639 (0.0007) [2023-12-28 07:31:35,185][106226] Updated weights for policy 0, policy_version 1706653 (0.0007) [2023-12-28 07:31:35,237][106225] Updated weights for policy 1, policy_version 1710649 (0.0005) [2023-12-28 07:31:35,245][106226] Updated weights for policy 0, policy_version 1706663 (0.0010) [2023-12-28 07:31:35,292][106225] Updated weights for policy 1, policy_version 1710659 (0.0008) [2023-12-28 07:31:35,914][106226] Updated weights for policy 0, policy_version 1706673 (0.0006) [2023-12-28 07:31:35,979][106226] Updated weights for policy 0, policy_version 1706683 (0.0005) [2023-12-28 07:31:36,006][106225] Updated weights for policy 1, policy_version 1710669 (0.0009) [2023-12-28 07:31:36,042][106226] Updated weights for policy 0, policy_version 1706693 (0.0008) [2023-12-28 07:31:36,053][106225] Updated weights for policy 1, policy_version 1710679 (0.0010) [2023-12-28 07:31:36,110][106225] Updated weights for policy 1, policy_version 1710689 (0.0010) [2023-12-28 07:31:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 874987520. Throughput: 0: 10126.4, 1: 9999.9. Samples: 874991044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:36,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-4.699')] [2023-12-28 07:31:36,642][106226] Updated weights for policy 0, policy_version 1706703 (0.0008) [2023-12-28 07:31:36,701][106226] Updated weights for policy 0, policy_version 1706713 (0.0008) [2023-12-28 07:31:36,753][106226] Updated weights for policy 0, policy_version 1706723 (0.0008) [2023-12-28 07:31:36,854][106225] Updated weights for policy 1, policy_version 1710699 (0.0009) [2023-12-28 07:31:36,914][106225] Updated weights for policy 1, policy_version 1710709 (0.0010) [2023-12-28 07:31:36,964][106225] Updated weights for policy 1, policy_version 1710719 (0.0010) [2023-12-28 07:31:37,464][106226] Updated weights for policy 0, policy_version 1706733 (0.0008) [2023-12-28 07:31:37,527][106226] Updated weights for policy 0, policy_version 1706743 (0.0009) [2023-12-28 07:31:37,576][106226] Updated weights for policy 0, policy_version 1706753 (0.0008) [2023-12-28 07:31:37,675][106225] Updated weights for policy 1, policy_version 1710729 (0.0010) [2023-12-28 07:31:37,728][106225] Updated weights for policy 1, policy_version 1710739 (0.0008) [2023-12-28 07:31:37,779][106225] Updated weights for policy 1, policy_version 1710749 (0.0009) [2023-12-28 07:31:37,831][106225] Updated weights for policy 1, policy_version 1710759 (0.0010) [2023-12-28 07:31:38,207][106226] Updated weights for policy 0, policy_version 1706763 (0.0008) [2023-12-28 07:31:38,275][106226] Updated weights for policy 0, policy_version 1706773 (0.0007) [2023-12-28 07:31:38,341][106226] Updated weights for policy 0, policy_version 1706783 (0.0010) [2023-12-28 07:31:38,608][106225] Updated weights for policy 1, policy_version 1710769 (0.0009) [2023-12-28 07:31:38,668][106225] Updated weights for policy 1, policy_version 1710779 (0.0009) [2023-12-28 07:31:38,730][106225] Updated weights for policy 1, policy_version 1710789 (0.0009) [2023-12-28 07:31:39,092][106226] Updated weights for policy 0, policy_version 1706793 (0.0009) [2023-12-28 07:31:39,155][106226] Updated weights for policy 0, policy_version 1706803 (0.0008) [2023-12-28 07:31:39,216][106226] Updated weights for policy 0, policy_version 1706813 (0.0008) [2023-12-28 07:31:39,284][106226] Updated weights for policy 0, policy_version 1706823 (0.0007) [2023-12-28 07:31:39,539][106225] Updated weights for policy 1, policy_version 1710799 (0.0009) [2023-12-28 07:31:39,601][106225] Updated weights for policy 1, policy_version 1710809 (0.0009) [2023-12-28 07:31:39,664][106225] Updated weights for policy 1, policy_version 1710819 (0.0009) [2023-12-28 07:31:40,069][106226] Updated weights for policy 0, policy_version 1706833 (0.0008) [2023-12-28 07:31:40,139][106226] Updated weights for policy 0, policy_version 1706843 (0.0007) [2023-12-28 07:31:40,202][106226] Updated weights for policy 0, policy_version 1706853 (0.0008) [2023-12-28 07:31:40,454][106225] Updated weights for policy 1, policy_version 1710829 (0.0009) [2023-12-28 07:31:40,507][106225] Updated weights for policy 1, policy_version 1710839 (0.0010) [2023-12-28 07:31:40,564][106225] Updated weights for policy 1, policy_version 1710849 (0.0010) [2023-12-28 07:31:40,838][106226] Updated weights for policy 0, policy_version 1706863 (0.0009) [2023-12-28 07:31:40,891][106226] Updated weights for policy 0, policy_version 1706873 (0.0010) [2023-12-28 07:31:40,948][106226] Updated weights for policy 0, policy_version 1706883 (0.0009) [2023-12-28 07:31:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 875077632. Throughput: 0: 10120.8, 1: 9998.9. Samples: 875049728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:41,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.834')] [2023-12-28 07:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001710856_438034432.pth... [2023-12-28 07:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001706888_437043200.pth... [2023-12-28 07:31:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001705704_436740096.pth [2023-12-28 07:31:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001709704_437739520.pth [2023-12-28 07:31:41,241][106225] Updated weights for policy 1, policy_version 1710859 (0.0010) [2023-12-28 07:31:41,303][106225] Updated weights for policy 1, policy_version 1710869 (0.0008) [2023-12-28 07:31:41,367][106225] Updated weights for policy 1, policy_version 1710879 (0.0008) [2023-12-28 07:31:41,742][106226] Updated weights for policy 0, policy_version 1706893 (0.0008) [2023-12-28 07:31:41,801][106226] Updated weights for policy 0, policy_version 1706903 (0.0008) [2023-12-28 07:31:41,861][106226] Updated weights for policy 0, policy_version 1706913 (0.0008) [2023-12-28 07:31:42,177][106225] Updated weights for policy 1, policy_version 1710889 (0.0008) [2023-12-28 07:31:42,222][106225] Updated weights for policy 1, policy_version 1710899 (0.0008) [2023-12-28 07:31:42,285][106225] Updated weights for policy 1, policy_version 1710909 (0.0008) [2023-12-28 07:31:42,345][106225] Updated weights for policy 1, policy_version 1710919 (0.0007) [2023-12-28 07:31:42,616][106226] Updated weights for policy 0, policy_version 1706923 (0.0008) [2023-12-28 07:31:42,679][106226] Updated weights for policy 0, policy_version 1706933 (0.0007) [2023-12-28 07:31:42,745][106226] Updated weights for policy 0, policy_version 1706943 (0.0006) [2023-12-28 07:31:43,113][106225] Updated weights for policy 1, policy_version 1710929 (0.0007) [2023-12-28 07:31:43,173][106225] Updated weights for policy 1, policy_version 1710939 (0.0008) [2023-12-28 07:31:43,225][106225] Updated weights for policy 1, policy_version 1710949 (0.0008) [2023-12-28 07:31:43,427][106226] Updated weights for policy 0, policy_version 1706953 (0.0008) [2023-12-28 07:31:43,489][106226] Updated weights for policy 0, policy_version 1706963 (0.0008) [2023-12-28 07:31:43,546][106226] Updated weights for policy 0, policy_version 1706973 (0.0009) [2023-12-28 07:31:43,607][106226] Updated weights for policy 0, policy_version 1706983 (0.0009) [2023-12-28 07:31:43,941][106225] Updated weights for policy 1, policy_version 1710959 (0.0008) [2023-12-28 07:31:43,996][106225] Updated weights for policy 1, policy_version 1710969 (0.0007) [2023-12-28 07:31:44,049][106225] Updated weights for policy 1, policy_version 1710979 (0.0007) [2023-12-28 07:31:44,262][106226] Updated weights for policy 0, policy_version 1706993 (0.0010) [2023-12-28 07:31:44,315][106226] Updated weights for policy 0, policy_version 1707003 (0.0010) [2023-12-28 07:31:44,365][106226] Updated weights for policy 0, policy_version 1707013 (0.0010) [2023-12-28 07:31:44,803][106225] Updated weights for policy 1, policy_version 1710989 (0.0007) [2023-12-28 07:31:44,862][106225] Updated weights for policy 1, policy_version 1710999 (0.0007) [2023-12-28 07:31:44,931][106225] Updated weights for policy 1, policy_version 1711009 (0.0006) [2023-12-28 07:31:45,048][106226] Updated weights for policy 0, policy_version 1707023 (0.0008) [2023-12-28 07:31:45,118][106226] Updated weights for policy 0, policy_version 1707033 (0.0006) [2023-12-28 07:31:45,184][106226] Updated weights for policy 0, policy_version 1707043 (0.0006) [2023-12-28 07:31:45,664][106225] Updated weights for policy 1, policy_version 1711019 (0.0007) [2023-12-28 07:31:45,725][106225] Updated weights for policy 1, policy_version 1711029 (0.0008) [2023-12-28 07:31:45,772][106225] Updated weights for policy 1, policy_version 1711039 (0.0008) [2023-12-28 07:31:45,868][106226] Updated weights for policy 0, policy_version 1707053 (0.0009) [2023-12-28 07:31:45,928][106226] Updated weights for policy 0, policy_version 1707063 (0.0006) [2023-12-28 07:31:45,988][106226] Updated weights for policy 0, policy_version 1707073 (0.0005) [2023-12-28 07:31:46,175][105115] Fps is (10 sec: 18841.5, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 875175936. Throughput: 0: 10029.4, 1: 9891.1. Samples: 875163200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:46,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.966')] [2023-12-28 07:31:46,558][106225] Updated weights for policy 1, policy_version 1711049 (0.0008) [2023-12-28 07:31:46,570][106226] Updated weights for policy 0, policy_version 1707083 (0.0005) [2023-12-28 07:31:46,613][106225] Updated weights for policy 1, policy_version 1711059 (0.0009) [2023-12-28 07:31:46,622][106226] Updated weights for policy 0, policy_version 1707093 (0.0005) [2023-12-28 07:31:46,674][106225] Updated weights for policy 1, policy_version 1711069 (0.0006) [2023-12-28 07:31:46,681][106226] Updated weights for policy 0, policy_version 1707103 (0.0007) [2023-12-28 07:31:46,734][106225] Updated weights for policy 1, policy_version 1711079 (0.0008) [2023-12-28 07:31:47,404][106226] Updated weights for policy 0, policy_version 1707113 (0.0006) [2023-12-28 07:31:47,418][106225] Updated weights for policy 1, policy_version 1711089 (0.0007) [2023-12-28 07:31:47,462][106225] Updated weights for policy 1, policy_version 1711099 (0.0006) [2023-12-28 07:31:47,463][106226] Updated weights for policy 0, policy_version 1707123 (0.0007) [2023-12-28 07:31:47,509][106225] Updated weights for policy 1, policy_version 1711109 (0.0006) [2023-12-28 07:31:47,521][106226] Updated weights for policy 0, policy_version 1707133 (0.0008) [2023-12-28 07:31:47,587][106226] Updated weights for policy 0, policy_version 1707143 (0.0009) [2023-12-28 07:31:48,248][106225] Updated weights for policy 1, policy_version 1711119 (0.0008) [2023-12-28 07:31:48,282][106226] Updated weights for policy 0, policy_version 1707153 (0.0006) [2023-12-28 07:31:48,311][106225] Updated weights for policy 1, policy_version 1711129 (0.0008) [2023-12-28 07:31:48,358][106226] Updated weights for policy 0, policy_version 1707166 (0.0007) [2023-12-28 07:31:48,380][106225] Updated weights for policy 1, policy_version 1711139 (0.0008) [2023-12-28 07:31:48,417][106226] Updated weights for policy 0, policy_version 1707176 (0.0007) [2023-12-28 07:31:48,976][106226] Updated weights for policy 0, policy_version 1707186 (0.0005) [2023-12-28 07:31:49,025][106226] Updated weights for policy 0, policy_version 1707196 (0.0005) [2023-12-28 07:31:49,078][106226] Updated weights for policy 0, policy_version 1707206 (0.0005) [2023-12-28 07:31:49,208][106225] Updated weights for policy 1, policy_version 1711149 (0.0010) [2023-12-28 07:31:49,272][106225] Updated weights for policy 1, policy_version 1711159 (0.0008) [2023-12-28 07:31:49,333][106225] Updated weights for policy 1, policy_version 1711169 (0.0009) [2023-12-28 07:31:49,753][106226] Updated weights for policy 0, policy_version 1707216 (0.0008) [2023-12-28 07:31:49,812][106226] Updated weights for policy 0, policy_version 1707226 (0.0008) [2023-12-28 07:31:49,880][106226] Updated weights for policy 0, policy_version 1707236 (0.0009) [2023-12-28 07:31:50,022][106225] Updated weights for policy 1, policy_version 1711179 (0.0010) [2023-12-28 07:31:50,085][106225] Updated weights for policy 1, policy_version 1711189 (0.0010) [2023-12-28 07:31:50,149][106225] Updated weights for policy 1, policy_version 1711199 (0.0009) [2023-12-28 07:31:50,564][106226] Updated weights for policy 0, policy_version 1707246 (0.0008) [2023-12-28 07:31:50,632][106226] Updated weights for policy 0, policy_version 1707256 (0.0007) [2023-12-28 07:31:50,699][106226] Updated weights for policy 0, policy_version 1707266 (0.0007) [2023-12-28 07:31:50,913][106225] Updated weights for policy 1, policy_version 1711209 (0.0008) [2023-12-28 07:31:50,969][106225] Updated weights for policy 1, policy_version 1711219 (0.0009) [2023-12-28 07:31:51,034][106225] Updated weights for policy 1, policy_version 1711229 (0.0009) [2023-12-28 07:31:51,097][106225] Updated weights for policy 1, policy_version 1711239 (0.0009) [2023-12-28 07:31:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.5, 300 sec: 19827.4). Total num frames: 875274240. Throughput: 0: 10054.2, 1: 9763.0. Samples: 875280452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:51,175][105115] Avg episode reward: [(0, '-4.192'), (1, '-4.743')] [2023-12-28 07:31:51,408][106226] Updated weights for policy 0, policy_version 1707276 (0.0008) [2023-12-28 07:31:51,465][106226] Updated weights for policy 0, policy_version 1707286 (0.0008) [2023-12-28 07:31:51,520][106226] Updated weights for policy 0, policy_version 1707296 (0.0007) [2023-12-28 07:31:51,844][106225] Updated weights for policy 1, policy_version 1711249 (0.0008) [2023-12-28 07:31:51,899][106225] Updated weights for policy 1, policy_version 1711259 (0.0010) [2023-12-28 07:31:51,966][106225] Updated weights for policy 1, policy_version 1711269 (0.0008) [2023-12-28 07:31:52,220][106226] Updated weights for policy 0, policy_version 1707306 (0.0009) [2023-12-28 07:31:52,290][106226] Updated weights for policy 0, policy_version 1707316 (0.0009) [2023-12-28 07:31:52,366][106226] Updated weights for policy 0, policy_version 1707326 (0.0009) [2023-12-28 07:31:52,426][106226] Updated weights for policy 0, policy_version 1707336 (0.0009) [2023-12-28 07:31:52,739][106225] Updated weights for policy 1, policy_version 1711279 (0.0009) [2023-12-28 07:31:52,793][106225] Updated weights for policy 1, policy_version 1711289 (0.0008) [2023-12-28 07:31:52,853][106225] Updated weights for policy 1, policy_version 1711299 (0.0010) [2023-12-28 07:31:53,149][106226] Updated weights for policy 0, policy_version 1707346 (0.0007) [2023-12-28 07:31:53,212][106226] Updated weights for policy 0, policy_version 1707356 (0.0007) [2023-12-28 07:31:53,272][106226] Updated weights for policy 0, policy_version 1707366 (0.0007) [2023-12-28 07:31:53,573][106225] Updated weights for policy 1, policy_version 1711309 (0.0011) [2023-12-28 07:31:53,626][106225] Updated weights for policy 1, policy_version 1711319 (0.0010) [2023-12-28 07:31:53,685][106225] Updated weights for policy 1, policy_version 1711329 (0.0010) [2023-12-28 07:31:53,884][106226] Updated weights for policy 0, policy_version 1707376 (0.0010) [2023-12-28 07:31:53,948][106226] Updated weights for policy 0, policy_version 1707386 (0.0011) [2023-12-28 07:31:54,014][106226] Updated weights for policy 0, policy_version 1707396 (0.0009) [2023-12-28 07:31:54,434][106225] Updated weights for policy 1, policy_version 1711339 (0.0009) [2023-12-28 07:31:54,493][106225] Updated weights for policy 1, policy_version 1711349 (0.0007) [2023-12-28 07:31:54,554][106225] Updated weights for policy 1, policy_version 1711359 (0.0008) [2023-12-28 07:31:54,728][106226] Updated weights for policy 0, policy_version 1707406 (0.0009) [2023-12-28 07:31:54,785][106226] Updated weights for policy 0, policy_version 1707416 (0.0010) [2023-12-28 07:31:54,834][106226] Updated weights for policy 0, policy_version 1707426 (0.0010) [2023-12-28 07:31:55,282][106225] Updated weights for policy 1, policy_version 1711369 (0.0008) [2023-12-28 07:31:55,343][106225] Updated weights for policy 1, policy_version 1711379 (0.0008) [2023-12-28 07:31:55,404][106225] Updated weights for policy 1, policy_version 1711389 (0.0009) [2023-12-28 07:31:55,459][106225] Updated weights for policy 1, policy_version 1711399 (0.0008) [2023-12-28 07:31:55,513][106226] Updated weights for policy 0, policy_version 1707436 (0.0008) [2023-12-28 07:31:55,580][106226] Updated weights for policy 0, policy_version 1707446 (0.0005) [2023-12-28 07:31:55,646][106226] Updated weights for policy 0, policy_version 1707456 (0.0007) [2023-12-28 07:31:56,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 875364352. Throughput: 0: 10041.9, 1: 9740.6. Samples: 875338472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:31:56,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.782')] [2023-12-28 07:31:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001707464_437190656.pth... [2023-12-28 07:31:56,182][106225] Updated weights for policy 1, policy_version 1711409 (0.0008) [2023-12-28 07:31:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001706312_436895744.pth [2023-12-28 07:31:56,245][106225] Updated weights for policy 1, policy_version 1711419 (0.0007) [2023-12-28 07:31:56,284][106226] Updated weights for policy 0, policy_version 1707466 (0.0008) [2023-12-28 07:31:56,306][106225] Updated weights for policy 1, policy_version 1711429 (0.0008) [2023-12-28 07:31:56,326][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001711432_438181888.pth... [2023-12-28 07:31:56,331][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001710280_437886976.pth [2023-12-28 07:31:56,334][106226] Updated weights for policy 0, policy_version 1707476 (0.0007) [2023-12-28 07:31:56,405][106226] Updated weights for policy 0, policy_version 1707486 (0.0005) [2023-12-28 07:31:56,463][106226] Updated weights for policy 0, policy_version 1707496 (0.0005) [2023-12-28 07:31:56,990][106226] Updated weights for policy 0, policy_version 1707506 (0.0007) [2023-12-28 07:31:57,001][106225] Updated weights for policy 1, policy_version 1711439 (0.0009) [2023-12-28 07:31:57,048][106226] Updated weights for policy 0, policy_version 1707516 (0.0009) [2023-12-28 07:31:57,050][106225] Updated weights for policy 1, policy_version 1711449 (0.0010) [2023-12-28 07:31:57,100][106225] Updated weights for policy 1, policy_version 1711459 (0.0010) [2023-12-28 07:31:57,103][106226] Updated weights for policy 0, policy_version 1707526 (0.0005) [2023-12-28 07:31:57,662][106226] Updated weights for policy 0, policy_version 1707536 (0.0007) [2023-12-28 07:31:57,728][106226] Updated weights for policy 0, policy_version 1707546 (0.0007) [2023-12-28 07:31:57,785][106226] Updated weights for policy 0, policy_version 1707556 (0.0005) [2023-12-28 07:31:57,823][106225] Updated weights for policy 1, policy_version 1711469 (0.0008) [2023-12-28 07:31:57,879][106225] Updated weights for policy 1, policy_version 1711479 (0.0005) [2023-12-28 07:31:57,936][106225] Updated weights for policy 1, policy_version 1711489 (0.0005) [2023-12-28 07:31:58,348][106226] Updated weights for policy 0, policy_version 1707566 (0.0008) [2023-12-28 07:31:58,417][106226] Updated weights for policy 0, policy_version 1707576 (0.0009) [2023-12-28 07:31:58,483][106226] Updated weights for policy 0, policy_version 1707586 (0.0010) [2023-12-28 07:31:58,613][106225] Updated weights for policy 1, policy_version 1711499 (0.0007) [2023-12-28 07:31:58,675][106225] Updated weights for policy 1, policy_version 1711509 (0.0010) [2023-12-28 07:31:58,745][106225] Updated weights for policy 1, policy_version 1711519 (0.0010) [2023-12-28 07:31:59,381][106226] Updated weights for policy 0, policy_version 1707596 (0.0009) [2023-12-28 07:31:59,447][106226] Updated weights for policy 0, policy_version 1707606 (0.0009) [2023-12-28 07:31:59,512][106226] Updated weights for policy 0, policy_version 1707616 (0.0008) [2023-12-28 07:31:59,537][106225] Updated weights for policy 1, policy_version 1711530 (0.0010) [2023-12-28 07:31:59,597][106225] Updated weights for policy 1, policy_version 1711540 (0.0009) [2023-12-28 07:31:59,659][106225] Updated weights for policy 1, policy_version 1711550 (0.0006) [2023-12-28 07:31:59,714][106225] Updated weights for policy 1, policy_version 1711560 (0.0005) [2023-12-28 07:32:00,167][106226] Updated weights for policy 0, policy_version 1707626 (0.0006) [2023-12-28 07:32:00,223][106226] Updated weights for policy 0, policy_version 1707636 (0.0009) [2023-12-28 07:32:00,281][106226] Updated weights for policy 0, policy_version 1707646 (0.0006) [2023-12-28 07:32:00,339][106226] Updated weights for policy 0, policy_version 1707656 (0.0005) [2023-12-28 07:32:00,369][106225] Updated weights for policy 1, policy_version 1711570 (0.0007) [2023-12-28 07:32:00,433][106225] Updated weights for policy 1, policy_version 1711580 (0.0008) [2023-12-28 07:32:00,493][106225] Updated weights for policy 1, policy_version 1711590 (0.0009) [2023-12-28 07:32:00,894][106226] Updated weights for policy 0, policy_version 1707666 (0.0010) [2023-12-28 07:32:00,947][106226] Updated weights for policy 0, policy_version 1707676 (0.0010) [2023-12-28 07:32:00,996][106226] Updated weights for policy 0, policy_version 1707686 (0.0010) [2023-12-28 07:32:01,121][106225] Updated weights for policy 1, policy_version 1711600 (0.0007) [2023-12-28 07:32:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 875470848. Throughput: 0: 10094.5, 1: 9757.2. Samples: 875459332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:32:01,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.468')] [2023-12-28 07:32:01,186][106225] Updated weights for policy 1, policy_version 1711610 (0.0009) [2023-12-28 07:32:01,237][106225] Updated weights for policy 1, policy_version 1711620 (0.0009) [2023-12-28 07:32:01,675][106226] Updated weights for policy 0, policy_version 1707696 (0.0011) [2023-12-28 07:32:01,730][106226] Updated weights for policy 0, policy_version 1707706 (0.0011) [2023-12-28 07:32:01,796][106226] Updated weights for policy 0, policy_version 1707716 (0.0010) [2023-12-28 07:32:01,993][106225] Updated weights for policy 1, policy_version 1711630 (0.0007) [2023-12-28 07:32:02,057][106225] Updated weights for policy 1, policy_version 1711640 (0.0008) [2023-12-28 07:32:02,117][106225] Updated weights for policy 1, policy_version 1711650 (0.0008) [2023-12-28 07:32:02,518][106226] Updated weights for policy 0, policy_version 1707726 (0.0011) [2023-12-28 07:32:02,578][106226] Updated weights for policy 0, policy_version 1707736 (0.0010) [2023-12-28 07:32:02,635][106226] Updated weights for policy 0, policy_version 1707746 (0.0010) [2023-12-28 07:32:02,752][106225] Updated weights for policy 1, policy_version 1711660 (0.0007) [2023-12-28 07:32:02,818][106225] Updated weights for policy 1, policy_version 1711670 (0.0007) [2023-12-28 07:32:02,884][106225] Updated weights for policy 1, policy_version 1711680 (0.0008) [2023-12-28 07:32:03,267][106226] Updated weights for policy 0, policy_version 1707756 (0.0008) [2023-12-28 07:32:03,321][106226] Updated weights for policy 0, policy_version 1707766 (0.0005) [2023-12-28 07:32:03,374][106226] Updated weights for policy 0, policy_version 1707776 (0.0005) [2023-12-28 07:32:03,556][106225] Updated weights for policy 1, policy_version 1711690 (0.0008) [2023-12-28 07:32:03,608][106225] Updated weights for policy 1, policy_version 1711700 (0.0005) [2023-12-28 07:32:03,671][106225] Updated weights for policy 1, policy_version 1711710 (0.0005) [2023-12-28 07:32:03,731][106225] Updated weights for policy 1, policy_version 1711720 (0.0007) [2023-12-28 07:32:04,019][106226] Updated weights for policy 0, policy_version 1707786 (0.0006) [2023-12-28 07:32:04,089][106226] Updated weights for policy 0, policy_version 1707796 (0.0008) [2023-12-28 07:32:04,156][106226] Updated weights for policy 0, policy_version 1707806 (0.0009) [2023-12-28 07:32:04,216][106226] Updated weights for policy 0, policy_version 1707816 (0.0009) [2023-12-28 07:32:04,334][106225] Updated weights for policy 1, policy_version 1711730 (0.0009) [2023-12-28 07:32:04,399][106225] Updated weights for policy 1, policy_version 1711740 (0.0009) [2023-12-28 07:32:04,451][106225] Updated weights for policy 1, policy_version 1711750 (0.0009) [2023-12-28 07:32:04,980][106226] Updated weights for policy 0, policy_version 1707826 (0.0005) [2023-12-28 07:32:05,054][106226] Updated weights for policy 0, policy_version 1707836 (0.0006) [2023-12-28 07:32:05,100][106225] Updated weights for policy 1, policy_version 1711760 (0.0006) [2023-12-28 07:32:05,114][106226] Updated weights for policy 0, policy_version 1707846 (0.0011) [2023-12-28 07:32:05,158][106225] Updated weights for policy 1, policy_version 1711770 (0.0005) [2023-12-28 07:32:05,224][106225] Updated weights for policy 1, policy_version 1711780 (0.0005) [2023-12-28 07:32:05,674][106226] Updated weights for policy 0, policy_version 1707856 (0.0010) [2023-12-28 07:32:05,731][106226] Updated weights for policy 0, policy_version 1707866 (0.0011) [2023-12-28 07:32:05,785][106226] Updated weights for policy 0, policy_version 1707876 (0.0010) [2023-12-28 07:32:05,819][106225] Updated weights for policy 1, policy_version 1711790 (0.0008) [2023-12-28 07:32:05,866][106225] Updated weights for policy 1, policy_version 1711800 (0.0010) [2023-12-28 07:32:05,919][106225] Updated weights for policy 1, policy_version 1711810 (0.0010) [2023-12-28 07:32:06,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 875577344. Throughput: 0: 10015.0, 1: 9833.1. Samples: 875584956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:32:06,175][105115] Avg episode reward: [(0, '-4.591'), (1, '-4.782')] [2023-12-28 07:32:06,440][106226] Updated weights for policy 0, policy_version 1707886 (0.0009) [2023-12-28 07:32:06,505][106226] Updated weights for policy 0, policy_version 1707896 (0.0011) [2023-12-28 07:32:06,571][106226] Updated weights for policy 0, policy_version 1707906 (0.0011) [2023-12-28 07:32:06,675][106225] Updated weights for policy 1, policy_version 1711820 (0.0008) [2023-12-28 07:32:06,732][106225] Updated weights for policy 1, policy_version 1711830 (0.0010) [2023-12-28 07:32:06,792][106225] Updated weights for policy 1, policy_version 1711840 (0.0010) [2023-12-28 07:32:07,222][106226] Updated weights for policy 0, policy_version 1707916 (0.0011) [2023-12-28 07:32:07,276][106226] Updated weights for policy 0, policy_version 1707926 (0.0011) [2023-12-28 07:32:07,333][106226] Updated weights for policy 0, policy_version 1707936 (0.0011) [2023-12-28 07:32:07,491][106225] Updated weights for policy 1, policy_version 1711850 (0.0009) [2023-12-28 07:32:07,550][106225] Updated weights for policy 1, policy_version 1711860 (0.0009) [2023-12-28 07:32:07,612][106225] Updated weights for policy 1, policy_version 1711870 (0.0010) [2023-12-28 07:32:07,672][106225] Updated weights for policy 1, policy_version 1711880 (0.0010) [2023-12-28 07:32:07,982][106226] Updated weights for policy 0, policy_version 1707946 (0.0010) [2023-12-28 07:32:08,044][106226] Updated weights for policy 0, policy_version 1707956 (0.0006) [2023-12-28 07:32:08,105][106226] Updated weights for policy 0, policy_version 1707966 (0.0008) [2023-12-28 07:32:08,162][106226] Updated weights for policy 0, policy_version 1707976 (0.0005) [2023-12-28 07:32:08,314][106225] Updated weights for policy 1, policy_version 1711890 (0.0006) [2023-12-28 07:32:08,381][106225] Updated weights for policy 1, policy_version 1711900 (0.0008) [2023-12-28 07:32:08,437][106225] Updated weights for policy 1, policy_version 1711910 (0.0010) [2023-12-28 07:32:08,733][106226] Updated weights for policy 0, policy_version 1707986 (0.0008) [2023-12-28 07:32:08,798][106226] Updated weights for policy 0, policy_version 1707996 (0.0011) [2023-12-28 07:32:08,864][106226] Updated weights for policy 0, policy_version 1708006 (0.0005) [2023-12-28 07:32:09,178][106225] Updated weights for policy 1, policy_version 1711920 (0.0007) [2023-12-28 07:32:09,241][106225] Updated weights for policy 1, policy_version 1711930 (0.0008) [2023-12-28 07:32:09,323][106225] Updated weights for policy 1, policy_version 1711940 (0.0009) [2023-12-28 07:32:09,584][106226] Updated weights for policy 0, policy_version 1708016 (0.0010) [2023-12-28 07:32:09,643][106226] Updated weights for policy 0, policy_version 1708026 (0.0011) [2023-12-28 07:32:09,705][106226] Updated weights for policy 0, policy_version 1708036 (0.0011) [2023-12-28 07:32:10,130][106225] Updated weights for policy 1, policy_version 1711950 (0.0008) [2023-12-28 07:32:10,196][106225] Updated weights for policy 1, policy_version 1711960 (0.0008) [2023-12-28 07:32:10,263][106225] Updated weights for policy 1, policy_version 1711970 (0.0006) [2023-12-28 07:32:10,464][106226] Updated weights for policy 0, policy_version 1708046 (0.0011) [2023-12-28 07:32:10,528][106226] Updated weights for policy 0, policy_version 1708056 (0.0011) [2023-12-28 07:32:10,597][106226] Updated weights for policy 0, policy_version 1708066 (0.0008) [2023-12-28 07:32:10,990][106225] Updated weights for policy 1, policy_version 1711980 (0.0008) [2023-12-28 07:32:11,051][106225] Updated weights for policy 1, policy_version 1711990 (0.0008) [2023-12-28 07:32:11,119][106225] Updated weights for policy 1, policy_version 1712000 (0.0008) [2023-12-28 07:32:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 875675648. Throughput: 0: 10073.7, 1: 9859.6. Samples: 875646376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:32:11,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.695')] [2023-12-28 07:32:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001712008_438329344.pth... [2023-12-28 07:32:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001708072_437346304.pth... [2023-12-28 07:32:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001706888_437043200.pth [2023-12-28 07:32:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001710856_438034432.pth [2023-12-28 07:32:11,330][106226] Updated weights for policy 0, policy_version 1708076 (0.0011) [2023-12-28 07:32:11,415][106226] Updated weights for policy 0, policy_version 1708086 (0.0010) [2023-12-28 07:32:11,476][106226] Updated weights for policy 0, policy_version 1708096 (0.0011) [2023-12-28 07:32:11,957][106225] Updated weights for policy 1, policy_version 1712010 (0.0008) [2023-12-28 07:32:12,023][106225] Updated weights for policy 1, policy_version 1712020 (0.0009) [2023-12-28 07:32:12,081][106225] Updated weights for policy 1, policy_version 1712030 (0.0009) [2023-12-28 07:32:12,101][106226] Updated weights for policy 0, policy_version 1708106 (0.0007) [2023-12-28 07:32:12,136][106225] Updated weights for policy 1, policy_version 1712040 (0.0008) [2023-12-28 07:32:12,161][106226] Updated weights for policy 0, policy_version 1708116 (0.0006) [2023-12-28 07:32:12,225][106226] Updated weights for policy 0, policy_version 1708126 (0.0006) [2023-12-28 07:32:12,288][106226] Updated weights for policy 0, policy_version 1708136 (0.0007) [2023-12-28 07:32:12,884][106225] Updated weights for policy 1, policy_version 1712050 (0.0010) [2023-12-28 07:32:12,937][106225] Updated weights for policy 1, policy_version 1712060 (0.0010) [2023-12-28 07:32:12,990][106225] Updated weights for policy 1, policy_version 1712070 (0.0010) [2023-12-28 07:32:13,024][106226] Updated weights for policy 0, policy_version 1708146 (0.0007) [2023-12-28 07:32:13,079][106226] Updated weights for policy 0, policy_version 1708156 (0.0009) [2023-12-28 07:32:13,142][106226] Updated weights for policy 0, policy_version 1708166 (0.0008) [2023-12-28 07:32:13,617][106225] Updated weights for policy 1, policy_version 1712080 (0.0005) [2023-12-28 07:32:13,679][106225] Updated weights for policy 1, policy_version 1712090 (0.0006) [2023-12-28 07:32:13,731][106225] Updated weights for policy 1, policy_version 1712100 (0.0007) [2023-12-28 07:32:13,893][106226] Updated weights for policy 0, policy_version 1708176 (0.0009) [2023-12-28 07:32:13,948][106226] Updated weights for policy 0, policy_version 1708186 (0.0007) [2023-12-28 07:32:14,011][106226] Updated weights for policy 0, policy_version 1708196 (0.0005) [2023-12-28 07:32:14,392][106225] Updated weights for policy 1, policy_version 1712110 (0.0008) [2023-12-28 07:32:14,453][106225] Updated weights for policy 1, policy_version 1712120 (0.0010) [2023-12-28 07:32:14,514][106225] Updated weights for policy 1, policy_version 1712130 (0.0008) [2023-12-28 07:32:14,591][106226] Updated weights for policy 0, policy_version 1708206 (0.0008) [2023-12-28 07:32:14,647][106226] Updated weights for policy 0, policy_version 1708216 (0.0008) [2023-12-28 07:32:14,708][106226] Updated weights for policy 0, policy_version 1708226 (0.0009) [2023-12-28 07:32:15,239][106225] Updated weights for policy 1, policy_version 1712140 (0.0007) [2023-12-28 07:32:15,293][106225] Updated weights for policy 1, policy_version 1712150 (0.0008) [2023-12-28 07:32:15,358][106225] Updated weights for policy 1, policy_version 1712160 (0.0008) [2023-12-28 07:32:15,477][106226] Updated weights for policy 0, policy_version 1708236 (0.0010) [2023-12-28 07:32:15,540][106226] Updated weights for policy 0, policy_version 1708246 (0.0010) [2023-12-28 07:32:15,599][106226] Updated weights for policy 0, policy_version 1708256 (0.0010) [2023-12-28 07:32:16,095][106225] Updated weights for policy 1, policy_version 1712170 (0.0008) [2023-12-28 07:32:16,146][106225] Updated weights for policy 1, policy_version 1712180 (0.0008) [2023-12-28 07:32:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 875765760. Throughput: 0: 10085.1, 1: 9650.7. Samples: 875760404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:32:16,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-5.159')] [2023-12-28 07:32:16,202][106225] Updated weights for policy 1, policy_version 1712190 (0.0008) [2023-12-28 07:32:16,261][106225] Updated weights for policy 1, policy_version 1712200 (0.0008) [2023-12-28 07:32:16,303][106226] Updated weights for policy 0, policy_version 1708266 (0.0010) [2023-12-28 07:32:16,366][106226] Updated weights for policy 0, policy_version 1708276 (0.0011) [2023-12-28 07:32:16,430][106226] Updated weights for policy 0, policy_version 1708286 (0.0011) [2023-12-28 07:32:16,493][106226] Updated weights for policy 0, policy_version 1708296 (0.0011) [2023-12-28 07:32:16,957][106225] Updated weights for policy 1, policy_version 1712210 (0.0006) [2023-12-28 07:32:17,004][106225] Updated weights for policy 1, policy_version 1712220 (0.0005) [2023-12-28 07:32:17,058][106225] Updated weights for policy 1, policy_version 1712230 (0.0009) [2023-12-28 07:32:17,156][106226] Updated weights for policy 0, policy_version 1708306 (0.0008) [2023-12-28 07:32:17,216][106226] Updated weights for policy 0, policy_version 1708316 (0.0008) [2023-12-28 07:32:17,279][106226] Updated weights for policy 0, policy_version 1708326 (0.0009) [2023-12-28 07:32:17,722][106225] Updated weights for policy 1, policy_version 1712240 (0.0010) [2023-12-28 07:32:17,792][106225] Updated weights for policy 1, policy_version 1712250 (0.0010) [2023-12-28 07:32:17,859][106225] Updated weights for policy 1, policy_version 1712260 (0.0010) [2023-12-28 07:32:17,966][106226] Updated weights for policy 0, policy_version 1708336 (0.0008) [2023-12-28 07:32:18,020][106226] Updated weights for policy 0, policy_version 1708346 (0.0008) [2023-12-28 07:32:18,072][106226] Updated weights for policy 0, policy_version 1708356 (0.0008) [2023-12-28 07:32:18,551][106225] Updated weights for policy 1, policy_version 1712270 (0.0009) [2023-12-28 07:32:18,614][106225] Updated weights for policy 1, policy_version 1712280 (0.0007) [2023-12-28 07:32:18,670][106225] Updated weights for policy 1, policy_version 1712290 (0.0009) [2023-12-28 07:32:18,766][106226] Updated weights for policy 0, policy_version 1708366 (0.0008) [2023-12-28 07:32:18,828][106226] Updated weights for policy 0, policy_version 1708376 (0.0008) [2023-12-28 07:32:18,887][106226] Updated weights for policy 0, policy_version 1708386 (0.0008) [2023-12-28 07:32:19,348][106225] Updated weights for policy 1, policy_version 1712300 (0.0008) [2023-12-28 07:32:19,418][106225] Updated weights for policy 1, policy_version 1712310 (0.0007) [2023-12-28 07:32:19,486][106225] Updated weights for policy 1, policy_version 1712320 (0.0006) [2023-12-28 07:32:19,572][106226] Updated weights for policy 0, policy_version 1708396 (0.0008) [2023-12-28 07:32:19,642][106226] Updated weights for policy 0, policy_version 1708406 (0.0006) [2023-12-28 07:32:19,709][106226] Updated weights for policy 0, policy_version 1708416 (0.0007) [2023-12-28 07:32:20,210][106225] Updated weights for policy 1, policy_version 1712330 (0.0008) [2023-12-28 07:32:20,266][106225] Updated weights for policy 1, policy_version 1712340 (0.0009) [2023-12-28 07:32:20,327][106225] Updated weights for policy 1, policy_version 1712350 (0.0009) [2023-12-28 07:32:20,373][106226] Updated weights for policy 0, policy_version 1708426 (0.0007) [2023-12-28 07:32:20,384][106225] Updated weights for policy 1, policy_version 1712360 (0.0008) [2023-12-28 07:32:20,433][106226] Updated weights for policy 0, policy_version 1708436 (0.0008) [2023-12-28 07:32:20,491][106226] Updated weights for policy 0, policy_version 1708446 (0.0005) [2023-12-28 07:32:20,542][106226] Updated weights for policy 0, policy_version 1708456 (0.0005) [2023-12-28 07:32:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 875864064. Throughput: 0: 10108.2, 1: 9627.7. Samples: 875879160. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:21,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-5.064')] [2023-12-28 07:32:21,193][106225] Updated weights for policy 1, policy_version 1712370 (0.0009) [2023-12-28 07:32:21,265][106225] Updated weights for policy 1, policy_version 1712380 (0.0010) [2023-12-28 07:32:21,267][106226] Updated weights for policy 0, policy_version 1708466 (0.0008) [2023-12-28 07:32:21,326][106226] Updated weights for policy 0, policy_version 1708476 (0.0006) [2023-12-28 07:32:21,332][106225] Updated weights for policy 1, policy_version 1712390 (0.0011) [2023-12-28 07:32:21,403][106226] Updated weights for policy 0, policy_version 1708486 (0.0008) [2023-12-28 07:32:22,112][106226] Updated weights for policy 0, policy_version 1708496 (0.0007) [2023-12-28 07:32:22,136][106225] Updated weights for policy 1, policy_version 1712400 (0.0010) [2023-12-28 07:32:22,168][106226] Updated weights for policy 0, policy_version 1708506 (0.0008) [2023-12-28 07:32:22,199][106225] Updated weights for policy 1, policy_version 1712410 (0.0006) [2023-12-28 07:32:22,225][106226] Updated weights for policy 0, policy_version 1708516 (0.0009) [2023-12-28 07:32:22,262][106225] Updated weights for policy 1, policy_version 1712420 (0.0009) [2023-12-28 07:32:22,907][106225] Updated weights for policy 1, policy_version 1712430 (0.0010) [2023-12-28 07:32:22,945][106226] Updated weights for policy 0, policy_version 1708526 (0.0007) [2023-12-28 07:32:22,959][106225] Updated weights for policy 1, policy_version 1712440 (0.0009) [2023-12-28 07:32:22,995][106226] Updated weights for policy 0, policy_version 1708536 (0.0007) [2023-12-28 07:32:23,019][106225] Updated weights for policy 1, policy_version 1712450 (0.0009) [2023-12-28 07:32:23,052][106226] Updated weights for policy 0, policy_version 1708546 (0.0005) [2023-12-28 07:32:23,604][106225] Updated weights for policy 1, policy_version 1712460 (0.0009) [2023-12-28 07:32:23,660][106225] Updated weights for policy 1, policy_version 1712470 (0.0005) [2023-12-28 07:32:23,715][106225] Updated weights for policy 1, policy_version 1712480 (0.0010) [2023-12-28 07:32:23,794][106226] Updated weights for policy 0, policy_version 1708556 (0.0009) [2023-12-28 07:32:23,843][106226] Updated weights for policy 0, policy_version 1708566 (0.0009) [2023-12-28 07:32:23,895][106226] Updated weights for policy 0, policy_version 1708576 (0.0005) [2023-12-28 07:32:24,429][106225] Updated weights for policy 1, policy_version 1712490 (0.0010) [2023-12-28 07:32:24,487][106225] Updated weights for policy 1, policy_version 1712500 (0.0010) [2023-12-28 07:32:24,542][106225] Updated weights for policy 1, policy_version 1712510 (0.0011) [2023-12-28 07:32:24,578][106226] Updated weights for policy 0, policy_version 1708586 (0.0005) [2023-12-28 07:32:24,603][106225] Updated weights for policy 1, policy_version 1712520 (0.0011) [2023-12-28 07:32:24,634][106226] Updated weights for policy 0, policy_version 1708596 (0.0007) [2023-12-28 07:32:24,690][106226] Updated weights for policy 0, policy_version 1708606 (0.0008) [2023-12-28 07:32:24,746][106226] Updated weights for policy 0, policy_version 1708616 (0.0008) [2023-12-28 07:32:25,332][106225] Updated weights for policy 1, policy_version 1712530 (0.0010) [2023-12-28 07:32:25,381][106225] Updated weights for policy 1, policy_version 1712540 (0.0010) [2023-12-28 07:32:25,430][106225] Updated weights for policy 1, policy_version 1712550 (0.0010) [2023-12-28 07:32:25,478][106226] Updated weights for policy 0, policy_version 1708626 (0.0007) [2023-12-28 07:32:25,528][106226] Updated weights for policy 0, policy_version 1708636 (0.0008) [2023-12-28 07:32:25,578][106226] Updated weights for policy 0, policy_version 1708646 (0.0008) [2023-12-28 07:32:26,122][106225] Updated weights for policy 1, policy_version 1712560 (0.0006) [2023-12-28 07:32:26,174][106225] Updated weights for policy 1, policy_version 1712570 (0.0005) [2023-12-28 07:32:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 875962368. Throughput: 0: 10082.1, 1: 9656.3. Samples: 875937952. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:26,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.877')] [2023-12-28 07:32:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001708648_437493760.pth... [2023-12-28 07:32:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001707464_437190656.pth [2023-12-28 07:32:26,221][106225] Updated weights for policy 1, policy_version 1712580 (0.0005) [2023-12-28 07:32:26,240][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001712584_438476800.pth... [2023-12-28 07:32:26,241][106226] Updated weights for policy 0, policy_version 1708656 (0.0006) [2023-12-28 07:32:26,244][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001711432_438181888.pth [2023-12-28 07:32:26,300][106226] Updated weights for policy 0, policy_version 1708666 (0.0005) [2023-12-28 07:32:26,359][106226] Updated weights for policy 0, policy_version 1708676 (0.0009) [2023-12-28 07:32:26,790][106225] Updated weights for policy 1, policy_version 1712590 (0.0005) [2023-12-28 07:32:26,836][106225] Updated weights for policy 1, policy_version 1712600 (0.0005) [2023-12-28 07:32:26,895][106225] Updated weights for policy 1, policy_version 1712610 (0.0005) [2023-12-28 07:32:27,019][106226] Updated weights for policy 0, policy_version 1708686 (0.0006) [2023-12-28 07:32:27,069][106226] Updated weights for policy 0, policy_version 1708696 (0.0007) [2023-12-28 07:32:27,115][106226] Updated weights for policy 0, policy_version 1708706 (0.0008) [2023-12-28 07:32:27,510][106225] Updated weights for policy 1, policy_version 1712620 (0.0007) [2023-12-28 07:32:27,567][106225] Updated weights for policy 1, policy_version 1712630 (0.0010) [2023-12-28 07:32:27,626][106225] Updated weights for policy 1, policy_version 1712640 (0.0008) [2023-12-28 07:32:27,741][106226] Updated weights for policy 0, policy_version 1708716 (0.0007) [2023-12-28 07:32:27,791][106226] Updated weights for policy 0, policy_version 1708726 (0.0008) [2023-12-28 07:32:27,851][106226] Updated weights for policy 0, policy_version 1708736 (0.0008) [2023-12-28 07:32:28,321][106225] Updated weights for policy 1, policy_version 1712650 (0.0010) [2023-12-28 07:32:28,389][106225] Updated weights for policy 1, policy_version 1712660 (0.0011) [2023-12-28 07:32:28,456][106225] Updated weights for policy 1, policy_version 1712670 (0.0010) [2023-12-28 07:32:28,515][106225] Updated weights for policy 1, policy_version 1712680 (0.0010) [2023-12-28 07:32:28,583][106226] Updated weights for policy 0, policy_version 1708746 (0.0008) [2023-12-28 07:32:28,641][106226] Updated weights for policy 0, policy_version 1708756 (0.0008) [2023-12-28 07:32:28,693][106226] Updated weights for policy 0, policy_version 1708766 (0.0008) [2023-12-28 07:32:28,740][106226] Updated weights for policy 0, policy_version 1708776 (0.0008) [2023-12-28 07:32:29,218][106225] Updated weights for policy 1, policy_version 1712690 (0.0011) [2023-12-28 07:32:29,282][106225] Updated weights for policy 1, policy_version 1712700 (0.0009) [2023-12-28 07:32:29,347][106225] Updated weights for policy 1, policy_version 1712710 (0.0009) [2023-12-28 07:32:29,490][106226] Updated weights for policy 0, policy_version 1708786 (0.0009) [2023-12-28 07:32:29,549][106226] Updated weights for policy 0, policy_version 1708796 (0.0008) [2023-12-28 07:32:29,618][106226] Updated weights for policy 0, policy_version 1708806 (0.0009) [2023-12-28 07:32:29,987][106225] Updated weights for policy 1, policy_version 1712720 (0.0010) [2023-12-28 07:32:30,051][106225] Updated weights for policy 1, policy_version 1712730 (0.0010) [2023-12-28 07:32:30,114][106225] Updated weights for policy 1, policy_version 1712740 (0.0010) [2023-12-28 07:32:30,313][106226] Updated weights for policy 0, policy_version 1708816 (0.0006) [2023-12-28 07:32:30,377][106226] Updated weights for policy 0, policy_version 1708826 (0.0009) [2023-12-28 07:32:30,436][106226] Updated weights for policy 0, policy_version 1708836 (0.0010) [2023-12-28 07:32:30,815][106225] Updated weights for policy 1, policy_version 1712750 (0.0007) [2023-12-28 07:32:30,862][106225] Updated weights for policy 1, policy_version 1712760 (0.0009) [2023-12-28 07:32:30,907][106225] Updated weights for policy 1, policy_version 1712770 (0.0010) [2023-12-28 07:32:31,060][106226] Updated weights for policy 0, policy_version 1708846 (0.0010) [2023-12-28 07:32:31,111][106226] Updated weights for policy 0, policy_version 1708856 (0.0007) [2023-12-28 07:32:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 876068864. Throughput: 0: 10123.1, 1: 9786.6. Samples: 876059136. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:31,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-5.195')] [2023-12-28 07:32:31,180][106226] Updated weights for policy 0, policy_version 1708866 (0.0008) [2023-12-28 07:32:31,677][106225] Updated weights for policy 1, policy_version 1712780 (0.0009) [2023-12-28 07:32:31,736][106225] Updated weights for policy 1, policy_version 1712790 (0.0008) [2023-12-28 07:32:31,801][106225] Updated weights for policy 1, policy_version 1712800 (0.0006) [2023-12-28 07:32:31,902][106226] Updated weights for policy 0, policy_version 1708876 (0.0006) [2023-12-28 07:32:31,967][106226] Updated weights for policy 0, policy_version 1708886 (0.0005) [2023-12-28 07:32:32,028][106226] Updated weights for policy 0, policy_version 1708896 (0.0006) [2023-12-28 07:32:32,489][106225] Updated weights for policy 1, policy_version 1712810 (0.0007) [2023-12-28 07:32:32,545][106225] Updated weights for policy 1, policy_version 1712820 (0.0006) [2023-12-28 07:32:32,598][106225] Updated weights for policy 1, policy_version 1712830 (0.0008) [2023-12-28 07:32:32,617][106226] Updated weights for policy 0, policy_version 1708906 (0.0007) [2023-12-28 07:32:32,658][106225] Updated weights for policy 1, policy_version 1712840 (0.0006) [2023-12-28 07:32:32,673][106226] Updated weights for policy 0, policy_version 1708916 (0.0006) [2023-12-28 07:32:32,730][106226] Updated weights for policy 0, policy_version 1708926 (0.0008) [2023-12-28 07:32:32,796][106226] Updated weights for policy 0, policy_version 1708936 (0.0009) [2023-12-28 07:32:33,226][106225] Updated weights for policy 1, policy_version 1712850 (0.0005) [2023-12-28 07:32:33,275][106225] Updated weights for policy 1, policy_version 1712860 (0.0009) [2023-12-28 07:32:33,321][106225] Updated weights for policy 1, policy_version 1712870 (0.0009) [2023-12-28 07:32:33,411][106226] Updated weights for policy 0, policy_version 1708946 (0.0010) [2023-12-28 07:32:33,473][106226] Updated weights for policy 0, policy_version 1708956 (0.0010) [2023-12-28 07:32:33,522][106226] Updated weights for policy 0, policy_version 1708966 (0.0010) [2023-12-28 07:32:34,006][106225] Updated weights for policy 1, policy_version 1712880 (0.0008) [2023-12-28 07:32:34,058][106225] Updated weights for policy 1, policy_version 1712890 (0.0006) [2023-12-28 07:32:34,095][106226] Updated weights for policy 0, policy_version 1708976 (0.0006) [2023-12-28 07:32:34,108][106225] Updated weights for policy 1, policy_version 1712900 (0.0007) [2023-12-28 07:32:34,167][106226] Updated weights for policy 0, policy_version 1708986 (0.0006) [2023-12-28 07:32:34,224][106226] Updated weights for policy 0, policy_version 1708996 (0.0011) [2023-12-28 07:32:34,875][106226] Updated weights for policy 0, policy_version 1709006 (0.0009) [2023-12-28 07:32:34,920][106226] Updated weights for policy 0, policy_version 1709016 (0.0006) [2023-12-28 07:32:34,952][106225] Updated weights for policy 1, policy_version 1712910 (0.0006) [2023-12-28 07:32:34,972][106226] Updated weights for policy 0, policy_version 1709026 (0.0006) [2023-12-28 07:32:35,002][106225] Updated weights for policy 1, policy_version 1712920 (0.0007) [2023-12-28 07:32:35,056][106225] Updated weights for policy 1, policy_version 1712930 (0.0008) [2023-12-28 07:32:35,592][106226] Updated weights for policy 0, policy_version 1709036 (0.0006) [2023-12-28 07:32:35,645][106226] Updated weights for policy 0, policy_version 1709046 (0.0005) [2023-12-28 07:32:35,705][106226] Updated weights for policy 0, policy_version 1709056 (0.0005) [2023-12-28 07:32:35,758][106225] Updated weights for policy 1, policy_version 1712940 (0.0011) [2023-12-28 07:32:35,815][106225] Updated weights for policy 1, policy_version 1712950 (0.0010) [2023-12-28 07:32:35,873][106225] Updated weights for policy 1, policy_version 1712960 (0.0010) [2023-12-28 07:32:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 876175360. Throughput: 0: 10203.3, 1: 9891.0. Samples: 876184696. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:36,175][105115] Avg episode reward: [(0, '-4.601'), (1, '-4.632')] [2023-12-28 07:32:36,347][106226] Updated weights for policy 0, policy_version 1709066 (0.0006) [2023-12-28 07:32:36,418][106226] Updated weights for policy 0, policy_version 1709076 (0.0009) [2023-12-28 07:32:36,487][106226] Updated weights for policy 0, policy_version 1709086 (0.0009) [2023-12-28 07:32:36,552][106226] Updated weights for policy 0, policy_version 1709096 (0.0011) [2023-12-28 07:32:36,576][106225] Updated weights for policy 1, policy_version 1712970 (0.0010) [2023-12-28 07:32:36,638][106225] Updated weights for policy 1, policy_version 1712980 (0.0008) [2023-12-28 07:32:36,700][106225] Updated weights for policy 1, policy_version 1712990 (0.0008) [2023-12-28 07:32:36,761][106225] Updated weights for policy 1, policy_version 1713000 (0.0008) [2023-12-28 07:32:37,134][106226] Updated weights for policy 0, policy_version 1709106 (0.0011) [2023-12-28 07:32:37,186][106226] Updated weights for policy 0, policy_version 1709116 (0.0010) [2023-12-28 07:32:37,242][106226] Updated weights for policy 0, policy_version 1709126 (0.0010) [2023-12-28 07:32:37,491][106225] Updated weights for policy 1, policy_version 1713010 (0.0006) [2023-12-28 07:32:37,546][106225] Updated weights for policy 1, policy_version 1713020 (0.0006) [2023-12-28 07:32:37,590][106225] Updated weights for policy 1, policy_version 1713030 (0.0005) [2023-12-28 07:32:37,956][106226] Updated weights for policy 0, policy_version 1709136 (0.0006) [2023-12-28 07:32:38,016][106226] Updated weights for policy 0, policy_version 1709146 (0.0006) [2023-12-28 07:32:38,074][106226] Updated weights for policy 0, policy_version 1709156 (0.0007) [2023-12-28 07:32:38,180][106225] Updated weights for policy 1, policy_version 1713040 (0.0009) [2023-12-28 07:32:38,234][106225] Updated weights for policy 1, policy_version 1713050 (0.0009) [2023-12-28 07:32:38,291][106225] Updated weights for policy 1, policy_version 1713060 (0.0005) [2023-12-28 07:32:38,763][106226] Updated weights for policy 0, policy_version 1709166 (0.0010) [2023-12-28 07:32:38,823][106226] Updated weights for policy 0, policy_version 1709176 (0.0011) [2023-12-28 07:32:38,885][106226] Updated weights for policy 0, policy_version 1709186 (0.0009) [2023-12-28 07:32:38,944][106225] Updated weights for policy 1, policy_version 1713070 (0.0008) [2023-12-28 07:32:38,986][106225] Updated weights for policy 1, policy_version 1713080 (0.0007) [2023-12-28 07:32:39,040][106225] Updated weights for policy 1, policy_version 1713090 (0.0005) [2023-12-28 07:32:39,674][106226] Updated weights for policy 0, policy_version 1709196 (0.0009) [2023-12-28 07:32:39,742][106226] Updated weights for policy 0, policy_version 1709206 (0.0008) [2023-12-28 07:32:39,806][106226] Updated weights for policy 0, policy_version 1709216 (0.0008) [2023-12-28 07:32:39,847][106225] Updated weights for policy 1, policy_version 1713100 (0.0007) [2023-12-28 07:32:39,918][106225] Updated weights for policy 1, policy_version 1713110 (0.0011) [2023-12-28 07:32:39,983][106225] Updated weights for policy 1, policy_version 1713120 (0.0010) [2023-12-28 07:32:40,534][106226] Updated weights for policy 0, policy_version 1709226 (0.0006) [2023-12-28 07:32:40,594][106226] Updated weights for policy 0, policy_version 1709236 (0.0006) [2023-12-28 07:32:40,649][106226] Updated weights for policy 0, policy_version 1709246 (0.0005) [2023-12-28 07:32:40,704][106226] Updated weights for policy 0, policy_version 1709256 (0.0005) [2023-12-28 07:32:40,716][106225] Updated weights for policy 1, policy_version 1713130 (0.0008) [2023-12-28 07:32:40,783][106225] Updated weights for policy 1, policy_version 1713140 (0.0008) [2023-12-28 07:32:40,847][106225] Updated weights for policy 1, policy_version 1713150 (0.0008) [2023-12-28 07:32:40,911][106225] Updated weights for policy 1, policy_version 1713160 (0.0007) [2023-12-28 07:32:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 876273664. Throughput: 0: 10216.5, 1: 9942.3. Samples: 876245620. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:41,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-4.867')] [2023-12-28 07:32:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001709256_437649408.pth... [2023-12-28 07:32:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001713160_438624256.pth... [2023-12-28 07:32:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001708072_437346304.pth [2023-12-28 07:32:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001712008_438329344.pth [2023-12-28 07:32:41,377][106226] Updated weights for policy 0, policy_version 1709266 (0.0007) [2023-12-28 07:32:41,447][106226] Updated weights for policy 0, policy_version 1709276 (0.0008) [2023-12-28 07:32:41,511][106226] Updated weights for policy 0, policy_version 1709286 (0.0009) [2023-12-28 07:32:41,687][106225] Updated weights for policy 1, policy_version 1713170 (0.0009) [2023-12-28 07:32:41,763][106225] Updated weights for policy 1, policy_version 1713180 (0.0009) [2023-12-28 07:32:41,830][106225] Updated weights for policy 1, policy_version 1713190 (0.0007) [2023-12-28 07:32:42,268][106226] Updated weights for policy 0, policy_version 1709296 (0.0008) [2023-12-28 07:32:42,332][106226] Updated weights for policy 0, policy_version 1709306 (0.0008) [2023-12-28 07:32:42,397][106226] Updated weights for policy 0, policy_version 1709316 (0.0007) [2023-12-28 07:32:42,613][106225] Updated weights for policy 1, policy_version 1713200 (0.0007) [2023-12-28 07:32:42,679][106225] Updated weights for policy 1, policy_version 1713210 (0.0009) [2023-12-28 07:32:42,738][106225] Updated weights for policy 1, policy_version 1713220 (0.0008) [2023-12-28 07:32:43,045][106226] Updated weights for policy 0, policy_version 1709326 (0.0008) [2023-12-28 07:32:43,111][106226] Updated weights for policy 0, policy_version 1709336 (0.0009) [2023-12-28 07:32:43,158][106226] Updated weights for policy 0, policy_version 1709346 (0.0008) [2023-12-28 07:32:43,449][106225] Updated weights for policy 1, policy_version 1713230 (0.0009) [2023-12-28 07:32:43,507][106225] Updated weights for policy 1, policy_version 1713240 (0.0008) [2023-12-28 07:32:43,555][106225] Updated weights for policy 1, policy_version 1713250 (0.0006) [2023-12-28 07:32:43,904][106226] Updated weights for policy 0, policy_version 1709356 (0.0008) [2023-12-28 07:32:43,960][106226] Updated weights for policy 0, policy_version 1709366 (0.0008) [2023-12-28 07:32:44,011][106226] Updated weights for policy 0, policy_version 1709376 (0.0009) [2023-12-28 07:32:44,236][106225] Updated weights for policy 1, policy_version 1713260 (0.0007) [2023-12-28 07:32:44,290][106225] Updated weights for policy 1, policy_version 1713270 (0.0008) [2023-12-28 07:32:44,339][106225] Updated weights for policy 1, policy_version 1713280 (0.0008) [2023-12-28 07:32:44,692][106226] Updated weights for policy 0, policy_version 1709386 (0.0009) [2023-12-28 07:32:44,752][106226] Updated weights for policy 0, policy_version 1709396 (0.0008) [2023-12-28 07:32:44,824][106226] Updated weights for policy 0, policy_version 1709406 (0.0007) [2023-12-28 07:32:44,885][106226] Updated weights for policy 0, policy_version 1709416 (0.0008) [2023-12-28 07:32:45,121][106225] Updated weights for policy 1, policy_version 1713290 (0.0008) [2023-12-28 07:32:45,186][106225] Updated weights for policy 1, policy_version 1713300 (0.0008) [2023-12-28 07:32:45,246][106225] Updated weights for policy 1, policy_version 1713310 (0.0009) [2023-12-28 07:32:45,307][106225] Updated weights for policy 1, policy_version 1713320 (0.0008) [2023-12-28 07:32:45,607][106226] Updated weights for policy 0, policy_version 1709426 (0.0005) [2023-12-28 07:32:45,657][106226] Updated weights for policy 0, policy_version 1709436 (0.0005) [2023-12-28 07:32:45,705][106226] Updated weights for policy 0, policy_version 1709446 (0.0005) [2023-12-28 07:32:46,107][106225] Updated weights for policy 1, policy_version 1713330 (0.0009) [2023-12-28 07:32:46,157][106225] Updated weights for policy 1, policy_version 1713340 (0.0008) [2023-12-28 07:32:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 876363776. Throughput: 0: 10092.2, 1: 9897.8. Samples: 876358888. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:46,175][105115] Avg episode reward: [(0, '-4.700'), (1, '-4.858')] [2023-12-28 07:32:46,207][106225] Updated weights for policy 1, policy_version 1713350 (0.0009) [2023-12-28 07:32:46,246][106226] Updated weights for policy 0, policy_version 1709456 (0.0005) [2023-12-28 07:32:46,304][106226] Updated weights for policy 0, policy_version 1709466 (0.0005) [2023-12-28 07:32:46,355][106226] Updated weights for policy 0, policy_version 1709476 (0.0005) [2023-12-28 07:32:46,979][106226] Updated weights for policy 0, policy_version 1709486 (0.0007) [2023-12-28 07:32:46,997][106225] Updated weights for policy 1, policy_version 1713360 (0.0006) [2023-12-28 07:32:47,040][106226] Updated weights for policy 0, policy_version 1709496 (0.0007) [2023-12-28 07:32:47,051][106225] Updated weights for policy 1, policy_version 1713370 (0.0005) [2023-12-28 07:32:47,104][106226] Updated weights for policy 0, policy_version 1709506 (0.0009) [2023-12-28 07:32:47,107][106225] Updated weights for policy 1, policy_version 1713380 (0.0005) [2023-12-28 07:32:47,742][106225] Updated weights for policy 1, policy_version 1713390 (0.0007) [2023-12-28 07:32:47,801][106225] Updated weights for policy 1, policy_version 1713400 (0.0008) [2023-12-28 07:32:47,829][106226] Updated weights for policy 0, policy_version 1709516 (0.0009) [2023-12-28 07:32:47,850][106225] Updated weights for policy 1, policy_version 1713410 (0.0008) [2023-12-28 07:32:47,894][106226] Updated weights for policy 0, policy_version 1709526 (0.0005) [2023-12-28 07:32:47,958][106226] Updated weights for policy 0, policy_version 1709536 (0.0006) [2023-12-28 07:32:48,605][106225] Updated weights for policy 1, policy_version 1713420 (0.0008) [2023-12-28 07:32:48,643][106226] Updated weights for policy 0, policy_version 1709546 (0.0007) [2023-12-28 07:32:48,658][106225] Updated weights for policy 1, policy_version 1713430 (0.0007) [2023-12-28 07:32:48,694][106226] Updated weights for policy 0, policy_version 1709556 (0.0007) [2023-12-28 07:32:48,712][106225] Updated weights for policy 1, policy_version 1713440 (0.0008) [2023-12-28 07:32:48,750][106226] Updated weights for policy 0, policy_version 1709566 (0.0007) [2023-12-28 07:32:48,806][106226] Updated weights for policy 0, policy_version 1709576 (0.0008) [2023-12-28 07:32:49,415][106225] Updated weights for policy 1, policy_version 1713450 (0.0006) [2023-12-28 07:32:49,470][106225] Updated weights for policy 1, policy_version 1713460 (0.0005) [2023-12-28 07:32:49,520][106225] Updated weights for policy 1, policy_version 1713470 (0.0005) [2023-12-28 07:32:49,571][106226] Updated weights for policy 0, policy_version 1709586 (0.0008) [2023-12-28 07:32:49,572][106225] Updated weights for policy 1, policy_version 1713480 (0.0005) [2023-12-28 07:32:49,641][106226] Updated weights for policy 0, policy_version 1709596 (0.0010) [2023-12-28 07:32:49,699][106226] Updated weights for policy 0, policy_version 1709606 (0.0010) [2023-12-28 07:32:50,170][106225] Updated weights for policy 1, policy_version 1713490 (0.0007) [2023-12-28 07:32:50,241][106225] Updated weights for policy 1, policy_version 1713500 (0.0009) [2023-12-28 07:32:50,306][106225] Updated weights for policy 1, policy_version 1713510 (0.0009) [2023-12-28 07:32:50,393][106226] Updated weights for policy 0, policy_version 1709616 (0.0009) [2023-12-28 07:32:50,446][106226] Updated weights for policy 0, policy_version 1709626 (0.0009) [2023-12-28 07:32:50,500][106226] Updated weights for policy 0, policy_version 1709636 (0.0006) [2023-12-28 07:32:51,030][106225] Updated weights for policy 1, policy_version 1713520 (0.0008) [2023-12-28 07:32:51,093][106225] Updated weights for policy 1, policy_version 1713530 (0.0008) [2023-12-28 07:32:51,160][106225] Updated weights for policy 1, policy_version 1713540 (0.0009) [2023-12-28 07:32:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 876462080. Throughput: 0: 10047.1, 1: 9797.9. Samples: 876477980. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:51,175][105115] Avg episode reward: [(0, '-4.617'), (1, '-4.841')] [2023-12-28 07:32:51,239][106226] Updated weights for policy 0, policy_version 1709646 (0.0009) [2023-12-28 07:32:51,301][106226] Updated weights for policy 0, policy_version 1709656 (0.0008) [2023-12-28 07:32:51,366][106226] Updated weights for policy 0, policy_version 1709666 (0.0009) [2023-12-28 07:32:51,938][106225] Updated weights for policy 1, policy_version 1713550 (0.0010) [2023-12-28 07:32:52,006][106225] Updated weights for policy 1, policy_version 1713560 (0.0010) [2023-12-28 07:32:52,069][106226] Updated weights for policy 0, policy_version 1709676 (0.0007) [2023-12-28 07:32:52,069][106225] Updated weights for policy 1, policy_version 1713570 (0.0011) [2023-12-28 07:32:52,128][106226] Updated weights for policy 0, policy_version 1709686 (0.0008) [2023-12-28 07:32:52,190][106226] Updated weights for policy 0, policy_version 1709696 (0.0009) [2023-12-28 07:32:52,803][106225] Updated weights for policy 1, policy_version 1713580 (0.0011) [2023-12-28 07:32:52,858][106225] Updated weights for policy 1, policy_version 1713590 (0.0010) [2023-12-28 07:32:52,904][106226] Updated weights for policy 0, policy_version 1709706 (0.0008) [2023-12-28 07:32:52,918][106225] Updated weights for policy 1, policy_version 1713600 (0.0010) [2023-12-28 07:32:52,953][106226] Updated weights for policy 0, policy_version 1709716 (0.0008) [2023-12-28 07:32:53,004][106226] Updated weights for policy 0, policy_version 1709726 (0.0005) [2023-12-28 07:32:53,068][106226] Updated weights for policy 0, policy_version 1709736 (0.0005) [2023-12-28 07:32:53,596][106225] Updated weights for policy 1, policy_version 1713610 (0.0010) [2023-12-28 07:32:53,655][106225] Updated weights for policy 1, policy_version 1713620 (0.0010) [2023-12-28 07:32:53,669][106226] Updated weights for policy 0, policy_version 1709746 (0.0006) [2023-12-28 07:32:53,713][106225] Updated weights for policy 1, policy_version 1713630 (0.0010) [2023-12-28 07:32:53,728][106226] Updated weights for policy 0, policy_version 1709756 (0.0005) [2023-12-28 07:32:53,777][106225] Updated weights for policy 1, policy_version 1713640 (0.0010) [2023-12-28 07:32:53,786][106226] Updated weights for policy 0, policy_version 1709766 (0.0006) [2023-12-28 07:32:54,428][106225] Updated weights for policy 1, policy_version 1713650 (0.0005) [2023-12-28 07:32:54,455][106226] Updated weights for policy 0, policy_version 1709776 (0.0010) [2023-12-28 07:32:54,491][106225] Updated weights for policy 1, policy_version 1713660 (0.0006) [2023-12-28 07:32:54,514][106226] Updated weights for policy 0, policy_version 1709786 (0.0010) [2023-12-28 07:32:54,561][106225] Updated weights for policy 1, policy_version 1713670 (0.0009) [2023-12-28 07:32:54,578][106226] Updated weights for policy 0, policy_version 1709796 (0.0008) [2023-12-28 07:32:55,195][106226] Updated weights for policy 0, policy_version 1709806 (0.0006) [2023-12-28 07:32:55,236][106225] Updated weights for policy 1, policy_version 1713680 (0.0010) [2023-12-28 07:32:55,256][106226] Updated weights for policy 0, policy_version 1709816 (0.0006) [2023-12-28 07:32:55,296][106225] Updated weights for policy 1, policy_version 1713690 (0.0010) [2023-12-28 07:32:55,314][106226] Updated weights for policy 0, policy_version 1709826 (0.0005) [2023-12-28 07:32:55,349][106225] Updated weights for policy 1, policy_version 1713700 (0.0010) [2023-12-28 07:32:55,919][106225] Updated weights for policy 1, policy_version 1713710 (0.0007) [2023-12-28 07:32:55,977][106225] Updated weights for policy 1, policy_version 1713720 (0.0007) [2023-12-28 07:32:56,024][106225] Updated weights for policy 1, policy_version 1713730 (0.0007) [2023-12-28 07:32:56,024][106226] Updated weights for policy 0, policy_version 1709836 (0.0006) [2023-12-28 07:32:56,079][106226] Updated weights for policy 0, policy_version 1709846 (0.0009) [2023-12-28 07:32:56,132][106226] Updated weights for policy 0, policy_version 1709856 (0.0008) [2023-12-28 07:32:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 876568576. Throughput: 0: 10018.3, 1: 9781.3. Samples: 876537360. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:32:56,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.824')] [2023-12-28 07:32:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001709864_437805056.pth... [2023-12-28 07:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001713736_438771712.pth... [2023-12-28 07:32:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001708648_437493760.pth [2023-12-28 07:32:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001712584_438476800.pth [2023-12-28 07:32:56,588][106225] Updated weights for policy 1, policy_version 1713740 (0.0007) [2023-12-28 07:32:56,649][106225] Updated weights for policy 1, policy_version 1713750 (0.0008) [2023-12-28 07:32:56,702][106225] Updated weights for policy 1, policy_version 1713760 (0.0008) [2023-12-28 07:32:56,925][106226] Updated weights for policy 0, policy_version 1709866 (0.0009) [2023-12-28 07:32:56,987][106226] Updated weights for policy 0, policy_version 1709876 (0.0009) [2023-12-28 07:32:57,040][106226] Updated weights for policy 0, policy_version 1709886 (0.0008) [2023-12-28 07:32:57,089][106226] Updated weights for policy 0, policy_version 1709896 (0.0007) [2023-12-28 07:32:57,333][106225] Updated weights for policy 1, policy_version 1713771 (0.0008) [2023-12-28 07:32:57,380][106225] Updated weights for policy 1, policy_version 1713781 (0.0008) [2023-12-28 07:32:57,428][106225] Updated weights for policy 1, policy_version 1713791 (0.0008) [2023-12-28 07:32:57,862][106226] Updated weights for policy 0, policy_version 1709906 (0.0008) [2023-12-28 07:32:57,917][106226] Updated weights for policy 0, policy_version 1709916 (0.0009) [2023-12-28 07:32:57,971][106226] Updated weights for policy 0, policy_version 1709926 (0.0009) [2023-12-28 07:32:58,092][106225] Updated weights for policy 1, policy_version 1713801 (0.0007) [2023-12-28 07:32:58,148][106225] Updated weights for policy 1, policy_version 1713811 (0.0006) [2023-12-28 07:32:58,198][106225] Updated weights for policy 1, policy_version 1713821 (0.0008) [2023-12-28 07:32:58,271][106225] Updated weights for policy 1, policy_version 1713831 (0.0009) [2023-12-28 07:32:58,762][106226] Updated weights for policy 0, policy_version 1709936 (0.0008) [2023-12-28 07:32:58,827][106226] Updated weights for policy 0, policy_version 1709946 (0.0008) [2023-12-28 07:32:58,899][106226] Updated weights for policy 0, policy_version 1709956 (0.0009) [2023-12-28 07:32:59,104][106225] Updated weights for policy 1, policy_version 1713841 (0.0008) [2023-12-28 07:32:59,161][106225] Updated weights for policy 1, policy_version 1713851 (0.0009) [2023-12-28 07:32:59,226][106225] Updated weights for policy 1, policy_version 1713861 (0.0008) [2023-12-28 07:32:59,675][106226] Updated weights for policy 0, policy_version 1709966 (0.0010) [2023-12-28 07:32:59,733][106226] Updated weights for policy 0, policy_version 1709976 (0.0010) [2023-12-28 07:32:59,782][106226] Updated weights for policy 0, policy_version 1709986 (0.0010) [2023-12-28 07:32:59,975][106225] Updated weights for policy 1, policy_version 1713871 (0.0010) [2023-12-28 07:33:00,029][106225] Updated weights for policy 1, policy_version 1713881 (0.0009) [2023-12-28 07:33:00,089][106225] Updated weights for policy 1, policy_version 1713891 (0.0010) [2023-12-28 07:33:00,540][106226] Updated weights for policy 0, policy_version 1709996 (0.0010) [2023-12-28 07:33:00,589][106226] Updated weights for policy 0, policy_version 1710006 (0.0010) [2023-12-28 07:33:00,638][106226] Updated weights for policy 0, policy_version 1710016 (0.0010) [2023-12-28 07:33:00,784][106225] Updated weights for policy 1, policy_version 1713901 (0.0010) [2023-12-28 07:33:00,847][106225] Updated weights for policy 1, policy_version 1713911 (0.0010) [2023-12-28 07:33:00,904][106225] Updated weights for policy 1, policy_version 1713921 (0.0010) [2023-12-28 07:33:01,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 876666880. Throughput: 0: 9989.7, 1: 9917.7. Samples: 876656240. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:01,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.999')] [2023-12-28 07:33:01,385][106226] Updated weights for policy 0, policy_version 1710026 (0.0010) [2023-12-28 07:33:01,450][106226] Updated weights for policy 0, policy_version 1710036 (0.0011) [2023-12-28 07:33:01,506][106226] Updated weights for policy 0, policy_version 1710046 (0.0010) [2023-12-28 07:33:01,562][106226] Updated weights for policy 0, policy_version 1710056 (0.0010) [2023-12-28 07:33:01,627][106225] Updated weights for policy 1, policy_version 1713931 (0.0007) [2023-12-28 07:33:01,687][106225] Updated weights for policy 1, policy_version 1713941 (0.0010) [2023-12-28 07:33:01,753][106225] Updated weights for policy 1, policy_version 1713951 (0.0009) [2023-12-28 07:33:02,271][106226] Updated weights for policy 0, policy_version 1710066 (0.0007) [2023-12-28 07:33:02,326][106226] Updated weights for policy 0, policy_version 1710076 (0.0009) [2023-12-28 07:33:02,390][106226] Updated weights for policy 0, policy_version 1710086 (0.0006) [2023-12-28 07:33:02,501][106225] Updated weights for policy 1, policy_version 1713961 (0.0010) [2023-12-28 07:33:02,563][106225] Updated weights for policy 1, policy_version 1713971 (0.0009) [2023-12-28 07:33:02,623][106225] Updated weights for policy 1, policy_version 1713981 (0.0010) [2023-12-28 07:33:02,684][106225] Updated weights for policy 1, policy_version 1713991 (0.0010) [2023-12-28 07:33:03,118][106226] Updated weights for policy 0, policy_version 1710096 (0.0008) [2023-12-28 07:33:03,173][106226] Updated weights for policy 0, policy_version 1710106 (0.0008) [2023-12-28 07:33:03,228][106226] Updated weights for policy 0, policy_version 1710116 (0.0008) [2023-12-28 07:33:03,380][106225] Updated weights for policy 1, policy_version 1714001 (0.0008) [2023-12-28 07:33:03,431][106225] Updated weights for policy 1, policy_version 1714011 (0.0007) [2023-12-28 07:33:03,484][106225] Updated weights for policy 1, policy_version 1714021 (0.0005) [2023-12-28 07:33:03,801][106226] Updated weights for policy 0, policy_version 1710126 (0.0007) [2023-12-28 07:33:03,852][106226] Updated weights for policy 0, policy_version 1710136 (0.0006) [2023-12-28 07:33:03,919][106226] Updated weights for policy 0, policy_version 1710146 (0.0006) [2023-12-28 07:33:04,150][106225] Updated weights for policy 1, policy_version 1714031 (0.0009) [2023-12-28 07:33:04,207][106225] Updated weights for policy 1, policy_version 1714041 (0.0009) [2023-12-28 07:33:04,271][106225] Updated weights for policy 1, policy_version 1714051 (0.0008) [2023-12-28 07:33:04,560][106226] Updated weights for policy 0, policy_version 1710156 (0.0008) [2023-12-28 07:33:04,608][106226] Updated weights for policy 0, policy_version 1710166 (0.0008) [2023-12-28 07:33:04,653][106226] Updated weights for policy 0, policy_version 1710176 (0.0008) [2023-12-28 07:33:05,004][106225] Updated weights for policy 1, policy_version 1714061 (0.0008) [2023-12-28 07:33:05,061][106225] Updated weights for policy 1, policy_version 1714071 (0.0008) [2023-12-28 07:33:05,113][106225] Updated weights for policy 1, policy_version 1714081 (0.0009) [2023-12-28 07:33:05,378][106226] Updated weights for policy 0, policy_version 1710186 (0.0008) [2023-12-28 07:33:05,426][106226] Updated weights for policy 0, policy_version 1710196 (0.0008) [2023-12-28 07:33:05,473][106226] Updated weights for policy 0, policy_version 1710206 (0.0008) [2023-12-28 07:33:05,520][106226] Updated weights for policy 0, policy_version 1710216 (0.0008) [2023-12-28 07:33:05,857][106225] Updated weights for policy 1, policy_version 1714091 (0.0008) [2023-12-28 07:33:05,905][106225] Updated weights for policy 1, policy_version 1714101 (0.0008) [2023-12-28 07:33:05,952][106225] Updated weights for policy 1, policy_version 1714111 (0.0008) [2023-12-28 07:33:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 876765184. Throughput: 0: 9997.3, 1: 9907.1. Samples: 876774856. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:06,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.920')] [2023-12-28 07:33:06,267][106226] Updated weights for policy 0, policy_version 1710226 (0.0008) [2023-12-28 07:33:06,341][106226] Updated weights for policy 0, policy_version 1710236 (0.0009) [2023-12-28 07:33:06,410][106226] Updated weights for policy 0, policy_version 1710246 (0.0010) [2023-12-28 07:33:06,711][106225] Updated weights for policy 1, policy_version 1714121 (0.0008) [2023-12-28 07:33:06,775][106225] Updated weights for policy 1, policy_version 1714131 (0.0008) [2023-12-28 07:33:06,837][106225] Updated weights for policy 1, policy_version 1714141 (0.0008) [2023-12-28 07:33:06,902][106225] Updated weights for policy 1, policy_version 1714151 (0.0008) [2023-12-28 07:33:07,144][106226] Updated weights for policy 0, policy_version 1710256 (0.0009) [2023-12-28 07:33:07,201][106226] Updated weights for policy 0, policy_version 1710266 (0.0011) [2023-12-28 07:33:07,255][106226] Updated weights for policy 0, policy_version 1710276 (0.0010) [2023-12-28 07:33:07,615][106225] Updated weights for policy 1, policy_version 1714161 (0.0008) [2023-12-28 07:33:07,673][106225] Updated weights for policy 1, policy_version 1714171 (0.0008) [2023-12-28 07:33:07,738][106225] Updated weights for policy 1, policy_version 1714181 (0.0008) [2023-12-28 07:33:07,965][106226] Updated weights for policy 0, policy_version 1710286 (0.0009) [2023-12-28 07:33:08,022][106226] Updated weights for policy 0, policy_version 1710296 (0.0009) [2023-12-28 07:33:08,071][106226] Updated weights for policy 0, policy_version 1710306 (0.0008) [2023-12-28 07:33:08,482][106225] Updated weights for policy 1, policy_version 1714191 (0.0007) [2023-12-28 07:33:08,549][106225] Updated weights for policy 1, policy_version 1714201 (0.0008) [2023-12-28 07:33:08,635][106225] Updated weights for policy 1, policy_version 1714211 (0.0008) [2023-12-28 07:33:08,797][106226] Updated weights for policy 0, policy_version 1710316 (0.0008) [2023-12-28 07:33:08,846][106226] Updated weights for policy 0, policy_version 1710326 (0.0009) [2023-12-28 07:33:08,906][106226] Updated weights for policy 0, policy_version 1710336 (0.0007) [2023-12-28 07:33:09,372][106225] Updated weights for policy 1, policy_version 1714221 (0.0008) [2023-12-28 07:33:09,447][106225] Updated weights for policy 1, policy_version 1714231 (0.0009) [2023-12-28 07:33:09,509][106225] Updated weights for policy 1, policy_version 1714241 (0.0008) [2023-12-28 07:33:09,600][106226] Updated weights for policy 0, policy_version 1710346 (0.0006) [2023-12-28 07:33:09,671][106226] Updated weights for policy 0, policy_version 1710356 (0.0009) [2023-12-28 07:33:09,739][106226] Updated weights for policy 0, policy_version 1710366 (0.0007) [2023-12-28 07:33:09,797][106226] Updated weights for policy 0, policy_version 1710376 (0.0008) [2023-12-28 07:33:10,282][106225] Updated weights for policy 1, policy_version 1714251 (0.0008) [2023-12-28 07:33:10,346][106225] Updated weights for policy 1, policy_version 1714261 (0.0008) [2023-12-28 07:33:10,412][106225] Updated weights for policy 1, policy_version 1714271 (0.0008) [2023-12-28 07:33:10,505][106226] Updated weights for policy 0, policy_version 1710386 (0.0008) [2023-12-28 07:33:10,569][106226] Updated weights for policy 0, policy_version 1710396 (0.0008) [2023-12-28 07:33:10,627][106226] Updated weights for policy 0, policy_version 1710406 (0.0008) [2023-12-28 07:33:11,152][106225] Updated weights for policy 1, policy_version 1714281 (0.0008) [2023-12-28 07:33:11,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 876855296. Throughput: 0: 10001.2, 1: 9864.3. Samples: 876831904. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:11,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.345')] [2023-12-28 07:33:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001710408_437944320.pth... [2023-12-28 07:33:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001709256_437649408.pth [2023-12-28 07:33:11,215][106225] Updated weights for policy 1, policy_version 1714291 (0.0008) [2023-12-28 07:33:11,287][106225] Updated weights for policy 1, policy_version 1714301 (0.0008) [2023-12-28 07:33:11,341][106226] Updated weights for policy 0, policy_version 1710416 (0.0008) [2023-12-28 07:33:11,354][106225] Updated weights for policy 1, policy_version 1714311 (0.0007) [2023-12-28 07:33:11,359][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001714312_438919168.pth... [2023-12-28 07:33:11,364][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001713160_438624256.pth [2023-12-28 07:33:11,408][106226] Updated weights for policy 0, policy_version 1710426 (0.0009) [2023-12-28 07:33:11,472][106226] Updated weights for policy 0, policy_version 1710436 (0.0009) [2023-12-28 07:33:12,147][106225] Updated weights for policy 1, policy_version 1714321 (0.0006) [2023-12-28 07:33:12,213][106225] Updated weights for policy 1, policy_version 1714331 (0.0007) [2023-12-28 07:33:12,286][106225] Updated weights for policy 1, policy_version 1714341 (0.0008) [2023-12-28 07:33:12,299][106226] Updated weights for policy 0, policy_version 1710446 (0.0009) [2023-12-28 07:33:12,379][106226] Updated weights for policy 0, policy_version 1710456 (0.0009) [2023-12-28 07:33:12,441][106226] Updated weights for policy 0, policy_version 1710466 (0.0009) [2023-12-28 07:33:12,984][106225] Updated weights for policy 1, policy_version 1714351 (0.0007) [2023-12-28 07:33:13,031][106225] Updated weights for policy 1, policy_version 1714361 (0.0007) [2023-12-28 07:33:13,081][106225] Updated weights for policy 1, policy_version 1714371 (0.0008) [2023-12-28 07:33:13,206][106226] Updated weights for policy 0, policy_version 1710476 (0.0010) [2023-12-28 07:33:13,257][106226] Updated weights for policy 0, policy_version 1710486 (0.0011) [2023-12-28 07:33:13,308][106226] Updated weights for policy 0, policy_version 1710496 (0.0011) [2023-12-28 07:33:13,848][106225] Updated weights for policy 1, policy_version 1714381 (0.0008) [2023-12-28 07:33:13,908][106225] Updated weights for policy 1, policy_version 1714391 (0.0008) [2023-12-28 07:33:13,966][106225] Updated weights for policy 1, policy_version 1714401 (0.0008) [2023-12-28 07:33:14,046][106226] Updated weights for policy 0, policy_version 1710506 (0.0010) [2023-12-28 07:33:14,095][106226] Updated weights for policy 0, policy_version 1710516 (0.0008) [2023-12-28 07:33:14,144][106226] Updated weights for policy 0, policy_version 1710526 (0.0008) [2023-12-28 07:33:14,189][106226] Updated weights for policy 0, policy_version 1710536 (0.0009) [2023-12-28 07:33:14,703][106225] Updated weights for policy 1, policy_version 1714411 (0.0008) [2023-12-28 07:33:14,751][106225] Updated weights for policy 1, policy_version 1714421 (0.0008) [2023-12-28 07:33:14,809][106225] Updated weights for policy 1, policy_version 1714431 (0.0008) [2023-12-28 07:33:14,907][106226] Updated weights for policy 0, policy_version 1710546 (0.0008) [2023-12-28 07:33:14,968][106226] Updated weights for policy 0, policy_version 1710556 (0.0008) [2023-12-28 07:33:15,029][106226] Updated weights for policy 0, policy_version 1710566 (0.0006) [2023-12-28 07:33:15,513][106225] Updated weights for policy 1, policy_version 1714441 (0.0008) [2023-12-28 07:33:15,572][106225] Updated weights for policy 1, policy_version 1714451 (0.0008) [2023-12-28 07:33:15,628][106225] Updated weights for policy 1, policy_version 1714461 (0.0007) [2023-12-28 07:33:15,642][106226] Updated weights for policy 0, policy_version 1710576 (0.0007) [2023-12-28 07:33:15,692][106225] Updated weights for policy 1, policy_version 1714471 (0.0006) [2023-12-28 07:33:15,710][106226] Updated weights for policy 0, policy_version 1710586 (0.0007) [2023-12-28 07:33:15,769][106226] Updated weights for policy 0, policy_version 1710596 (0.0008) [2023-12-28 07:33:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 876953600. Throughput: 0: 9928.6, 1: 9728.3. Samples: 876943700. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:16,175][105115] Avg episode reward: [(0, '-4.988'), (1, '-4.548')] [2023-12-28 07:33:16,365][106225] Updated weights for policy 1, policy_version 1714481 (0.0008) [2023-12-28 07:33:16,432][106225] Updated weights for policy 1, policy_version 1714491 (0.0006) [2023-12-28 07:33:16,440][106226] Updated weights for policy 0, policy_version 1710606 (0.0010) [2023-12-28 07:33:16,489][106225] Updated weights for policy 1, policy_version 1714501 (0.0006) [2023-12-28 07:33:16,497][106226] Updated weights for policy 0, policy_version 1710616 (0.0010) [2023-12-28 07:33:16,554][106226] Updated weights for policy 0, policy_version 1710626 (0.0008) [2023-12-28 07:33:17,125][106226] Updated weights for policy 0, policy_version 1710636 (0.0006) [2023-12-28 07:33:17,162][106225] Updated weights for policy 1, policy_version 1714511 (0.0007) [2023-12-28 07:33:17,178][106226] Updated weights for policy 0, policy_version 1710646 (0.0006) [2023-12-28 07:33:17,214][106225] Updated weights for policy 1, policy_version 1714521 (0.0007) [2023-12-28 07:33:17,239][106226] Updated weights for policy 0, policy_version 1710656 (0.0006) [2023-12-28 07:33:17,269][106225] Updated weights for policy 1, policy_version 1714531 (0.0007) [2023-12-28 07:33:17,878][106225] Updated weights for policy 1, policy_version 1714541 (0.0008) [2023-12-28 07:33:17,883][106226] Updated weights for policy 0, policy_version 1710666 (0.0005) [2023-12-28 07:33:17,938][106225] Updated weights for policy 1, policy_version 1714551 (0.0010) [2023-12-28 07:33:17,941][106226] Updated weights for policy 0, policy_version 1710676 (0.0006) [2023-12-28 07:33:17,999][106226] Updated weights for policy 0, policy_version 1710686 (0.0010) [2023-12-28 07:33:18,002][106225] Updated weights for policy 1, policy_version 1714561 (0.0006) [2023-12-28 07:33:18,065][106226] Updated weights for policy 0, policy_version 1710696 (0.0006) [2023-12-28 07:33:18,593][106225] Updated weights for policy 1, policy_version 1714571 (0.0007) [2023-12-28 07:33:18,652][106225] Updated weights for policy 1, policy_version 1714581 (0.0006) [2023-12-28 07:33:18,682][106226] Updated weights for policy 0, policy_version 1710706 (0.0011) [2023-12-28 07:33:18,706][106225] Updated weights for policy 1, policy_version 1714591 (0.0005) [2023-12-28 07:33:18,747][106226] Updated weights for policy 0, policy_version 1710716 (0.0010) [2023-12-28 07:33:18,808][106226] Updated weights for policy 0, policy_version 1710726 (0.0011) [2023-12-28 07:33:19,260][106225] Updated weights for policy 1, policy_version 1714601 (0.0008) [2023-12-28 07:33:19,322][106225] Updated weights for policy 1, policy_version 1714611 (0.0006) [2023-12-28 07:33:19,391][106225] Updated weights for policy 1, policy_version 1714621 (0.0010) [2023-12-28 07:33:19,450][106225] Updated weights for policy 1, policy_version 1714631 (0.0008) [2023-12-28 07:33:19,489][106226] Updated weights for policy 0, policy_version 1710736 (0.0011) [2023-12-28 07:33:19,554][106226] Updated weights for policy 0, policy_version 1710746 (0.0011) [2023-12-28 07:33:19,612][106226] Updated weights for policy 0, policy_version 1710756 (0.0011) [2023-12-28 07:33:20,177][106225] Updated weights for policy 1, policy_version 1714641 (0.0007) [2023-12-28 07:33:20,245][106225] Updated weights for policy 1, policy_version 1714651 (0.0009) [2023-12-28 07:33:20,309][106225] Updated weights for policy 1, policy_version 1714661 (0.0010) [2023-12-28 07:33:20,367][106226] Updated weights for policy 0, policy_version 1710766 (0.0011) [2023-12-28 07:33:20,428][106226] Updated weights for policy 0, policy_version 1710776 (0.0011) [2023-12-28 07:33:20,489][106226] Updated weights for policy 0, policy_version 1710786 (0.0011) [2023-12-28 07:33:21,053][106225] Updated weights for policy 1, policy_version 1714671 (0.0009) [2023-12-28 07:33:21,117][106225] Updated weights for policy 1, policy_version 1714681 (0.0008) [2023-12-28 07:33:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 877051904. Throughput: 0: 9850.5, 1: 9779.4. Samples: 877068040. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:21,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.934')] [2023-12-28 07:33:21,183][106225] Updated weights for policy 1, policy_version 1714691 (0.0008) [2023-12-28 07:33:21,250][106226] Updated weights for policy 0, policy_version 1710796 (0.0010) [2023-12-28 07:33:21,320][106226] Updated weights for policy 0, policy_version 1710806 (0.0012) [2023-12-28 07:33:21,389][106226] Updated weights for policy 0, policy_version 1710816 (0.0011) [2023-12-28 07:33:21,941][106225] Updated weights for policy 1, policy_version 1714701 (0.0007) [2023-12-28 07:33:21,991][106225] Updated weights for policy 1, policy_version 1714711 (0.0006) [2023-12-28 07:33:22,045][106225] Updated weights for policy 1, policy_version 1714721 (0.0006) [2023-12-28 07:33:22,135][106226] Updated weights for policy 0, policy_version 1710826 (0.0011) [2023-12-28 07:33:22,187][106226] Updated weights for policy 0, policy_version 1710836 (0.0011) [2023-12-28 07:33:22,243][106226] Updated weights for policy 0, policy_version 1710846 (0.0007) [2023-12-28 07:33:22,313][106226] Updated weights for policy 0, policy_version 1710856 (0.0007) [2023-12-28 07:33:22,784][106225] Updated weights for policy 1, policy_version 1714731 (0.0007) [2023-12-28 07:33:22,839][106225] Updated weights for policy 1, policy_version 1714741 (0.0008) [2023-12-28 07:33:22,895][106225] Updated weights for policy 1, policy_version 1714751 (0.0008) [2023-12-28 07:33:23,056][106226] Updated weights for policy 0, policy_version 1710866 (0.0011) [2023-12-28 07:33:23,124][106226] Updated weights for policy 0, policy_version 1710876 (0.0011) [2023-12-28 07:33:23,194][106226] Updated weights for policy 0, policy_version 1710886 (0.0006) [2023-12-28 07:33:23,583][106225] Updated weights for policy 1, policy_version 1714761 (0.0009) [2023-12-28 07:33:23,650][106225] Updated weights for policy 1, policy_version 1714771 (0.0006) [2023-12-28 07:33:23,715][106225] Updated weights for policy 1, policy_version 1714781 (0.0008) [2023-12-28 07:33:23,781][106225] Updated weights for policy 1, policy_version 1714791 (0.0008) [2023-12-28 07:33:23,834][106226] Updated weights for policy 0, policy_version 1710896 (0.0009) [2023-12-28 07:33:23,887][106226] Updated weights for policy 0, policy_version 1710906 (0.0008) [2023-12-28 07:33:23,945][106226] Updated weights for policy 0, policy_version 1710916 (0.0010) [2023-12-28 07:33:24,401][106225] Updated weights for policy 1, policy_version 1714801 (0.0010) [2023-12-28 07:33:24,452][106225] Updated weights for policy 1, policy_version 1714811 (0.0008) [2023-12-28 07:33:24,508][106225] Updated weights for policy 1, policy_version 1714821 (0.0005) [2023-12-28 07:33:24,592][106226] Updated weights for policy 0, policy_version 1710926 (0.0007) [2023-12-28 07:33:24,650][106226] Updated weights for policy 0, policy_version 1710936 (0.0005) [2023-12-28 07:33:24,707][106226] Updated weights for policy 0, policy_version 1710946 (0.0005) [2023-12-28 07:33:25,132][106225] Updated weights for policy 1, policy_version 1714831 (0.0007) [2023-12-28 07:33:25,195][106225] Updated weights for policy 1, policy_version 1714841 (0.0009) [2023-12-28 07:33:25,259][106225] Updated weights for policy 1, policy_version 1714851 (0.0009) [2023-12-28 07:33:25,377][106226] Updated weights for policy 0, policy_version 1710956 (0.0005) [2023-12-28 07:33:25,437][106226] Updated weights for policy 0, policy_version 1710966 (0.0005) [2023-12-28 07:33:25,500][106226] Updated weights for policy 0, policy_version 1710976 (0.0005) [2023-12-28 07:33:25,948][106225] Updated weights for policy 1, policy_version 1714861 (0.0009) [2023-12-28 07:33:26,005][106225] Updated weights for policy 1, policy_version 1714871 (0.0010) [2023-12-28 07:33:26,058][106225] Updated weights for policy 1, policy_version 1714881 (0.0010) [2023-12-28 07:33:26,124][106226] Updated weights for policy 0, policy_version 1710986 (0.0006) [2023-12-28 07:33:26,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 877158400. Throughput: 0: 9815.0, 1: 9732.5. Samples: 877125256. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:26,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.766')] [2023-12-28 07:33:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001714888_439066624.pth... [2023-12-28 07:33:26,185][106226] Updated weights for policy 0, policy_version 1710996 (0.0005) [2023-12-28 07:33:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001713736_438771712.pth [2023-12-28 07:33:26,253][106226] Updated weights for policy 0, policy_version 1711006 (0.0005) [2023-12-28 07:33:26,308][106226] Updated weights for policy 0, policy_version 1711016 (0.0005) [2023-12-28 07:33:26,308][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001711016_438099968.pth... [2023-12-28 07:33:26,312][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001709864_437805056.pth [2023-12-28 07:33:26,783][106225] Updated weights for policy 1, policy_version 1714891 (0.0010) [2023-12-28 07:33:26,843][106225] Updated weights for policy 1, policy_version 1714901 (0.0008) [2023-12-28 07:33:26,860][106226] Updated weights for policy 0, policy_version 1711026 (0.0009) [2023-12-28 07:33:26,892][106225] Updated weights for policy 1, policy_version 1714911 (0.0005) [2023-12-28 07:33:26,923][106226] Updated weights for policy 0, policy_version 1711036 (0.0005) [2023-12-28 07:33:26,978][106226] Updated weights for policy 0, policy_version 1711046 (0.0006) [2023-12-28 07:33:27,424][106225] Updated weights for policy 1, policy_version 1714921 (0.0005) [2023-12-28 07:33:27,484][106225] Updated weights for policy 1, policy_version 1714931 (0.0007) [2023-12-28 07:33:27,537][106225] Updated weights for policy 1, policy_version 1714941 (0.0010) [2023-12-28 07:33:27,597][106225] Updated weights for policy 1, policy_version 1714951 (0.0010) [2023-12-28 07:33:27,709][106226] Updated weights for policy 0, policy_version 1711056 (0.0006) [2023-12-28 07:33:27,755][106226] Updated weights for policy 0, policy_version 1711066 (0.0005) [2023-12-28 07:33:27,809][106226] Updated weights for policy 0, policy_version 1711076 (0.0008) [2023-12-28 07:33:28,288][106225] Updated weights for policy 1, policy_version 1714961 (0.0007) [2023-12-28 07:33:28,342][106225] Updated weights for policy 1, policy_version 1714971 (0.0008) [2023-12-28 07:33:28,406][106225] Updated weights for policy 1, policy_version 1714981 (0.0010) [2023-12-28 07:33:28,470][106226] Updated weights for policy 0, policy_version 1711086 (0.0006) [2023-12-28 07:33:28,524][106226] Updated weights for policy 0, policy_version 1711096 (0.0006) [2023-12-28 07:33:28,583][106226] Updated weights for policy 0, policy_version 1711106 (0.0006) [2023-12-28 07:33:29,007][106225] Updated weights for policy 1, policy_version 1714991 (0.0007) [2023-12-28 07:33:29,058][106225] Updated weights for policy 1, policy_version 1715001 (0.0005) [2023-12-28 07:33:29,116][106225] Updated weights for policy 1, policy_version 1715011 (0.0005) [2023-12-28 07:33:29,151][106226] Updated weights for policy 0, policy_version 1711116 (0.0007) [2023-12-28 07:33:29,200][106226] Updated weights for policy 0, policy_version 1711126 (0.0010) [2023-12-28 07:33:29,266][106226] Updated weights for policy 0, policy_version 1711136 (0.0008) [2023-12-28 07:33:29,678][106225] Updated weights for policy 1, policy_version 1715021 (0.0007) [2023-12-28 07:33:29,739][106225] Updated weights for policy 1, policy_version 1715031 (0.0007) [2023-12-28 07:33:29,791][106225] Updated weights for policy 1, policy_version 1715041 (0.0005) [2023-12-28 07:33:30,038][106226] Updated weights for policy 0, policy_version 1711146 (0.0010) [2023-12-28 07:33:30,101][106226] Updated weights for policy 0, policy_version 1711156 (0.0008) [2023-12-28 07:33:30,158][106226] Updated weights for policy 0, policy_version 1711166 (0.0007) [2023-12-28 07:33:30,222][106226] Updated weights for policy 0, policy_version 1711176 (0.0008) [2023-12-28 07:33:30,495][106225] Updated weights for policy 1, policy_version 1715051 (0.0007) [2023-12-28 07:33:30,560][106225] Updated weights for policy 1, policy_version 1715061 (0.0005) [2023-12-28 07:33:30,614][106225] Updated weights for policy 1, policy_version 1715071 (0.0005) [2023-12-28 07:33:30,992][106226] Updated weights for policy 0, policy_version 1711186 (0.0009) [2023-12-28 07:33:31,053][106226] Updated weights for policy 0, policy_version 1711196 (0.0008) [2023-12-28 07:33:31,115][106226] Updated weights for policy 0, policy_version 1711206 (0.0007) [2023-12-28 07:33:31,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 877264896. Throughput: 0: 9947.6, 1: 9924.1. Samples: 877253112. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:31,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.748')] [2023-12-28 07:33:31,207][106225] Updated weights for policy 1, policy_version 1715081 (0.0009) [2023-12-28 07:33:31,265][106225] Updated weights for policy 1, policy_version 1715091 (0.0008) [2023-12-28 07:33:31,330][106225] Updated weights for policy 1, policy_version 1715101 (0.0007) [2023-12-28 07:33:31,397][106225] Updated weights for policy 1, policy_version 1715111 (0.0008) [2023-12-28 07:33:31,881][106226] Updated weights for policy 0, policy_version 1711216 (0.0006) [2023-12-28 07:33:31,933][106226] Updated weights for policy 0, policy_version 1711226 (0.0005) [2023-12-28 07:33:31,994][106226] Updated weights for policy 0, policy_version 1711236 (0.0006) [2023-12-28 07:33:32,047][106225] Updated weights for policy 1, policy_version 1715121 (0.0007) [2023-12-28 07:33:32,112][106225] Updated weights for policy 1, policy_version 1715131 (0.0007) [2023-12-28 07:33:32,173][106225] Updated weights for policy 1, policy_version 1715141 (0.0007) [2023-12-28 07:33:32,627][106226] Updated weights for policy 0, policy_version 1711246 (0.0010) [2023-12-28 07:33:32,691][106226] Updated weights for policy 0, policy_version 1711256 (0.0011) [2023-12-28 07:33:32,755][106226] Updated weights for policy 0, policy_version 1711266 (0.0011) [2023-12-28 07:33:32,850][106225] Updated weights for policy 1, policy_version 1715151 (0.0007) [2023-12-28 07:33:32,912][106225] Updated weights for policy 1, policy_version 1715161 (0.0008) [2023-12-28 07:33:32,962][106225] Updated weights for policy 1, policy_version 1715171 (0.0007) [2023-12-28 07:33:33,349][106226] Updated weights for policy 0, policy_version 1711276 (0.0009) [2023-12-28 07:33:33,416][106226] Updated weights for policy 0, policy_version 1711286 (0.0006) [2023-12-28 07:33:33,475][106226] Updated weights for policy 0, policy_version 1711296 (0.0006) [2023-12-28 07:33:33,534][106225] Updated weights for policy 1, policy_version 1715181 (0.0008) [2023-12-28 07:33:33,596][106225] Updated weights for policy 1, policy_version 1715191 (0.0005) [2023-12-28 07:33:33,643][106225] Updated weights for policy 1, policy_version 1715201 (0.0005) [2023-12-28 07:33:34,078][106226] Updated weights for policy 0, policy_version 1711306 (0.0008) [2023-12-28 07:33:34,135][106226] Updated weights for policy 0, policy_version 1711316 (0.0010) [2023-12-28 07:33:34,180][106225] Updated weights for policy 1, policy_version 1715211 (0.0007) [2023-12-28 07:33:34,202][106226] Updated weights for policy 0, policy_version 1711326 (0.0008) [2023-12-28 07:33:34,242][106225] Updated weights for policy 1, policy_version 1715221 (0.0009) [2023-12-28 07:33:34,270][106226] Updated weights for policy 0, policy_version 1711336 (0.0008) [2023-12-28 07:33:34,304][106225] Updated weights for policy 1, policy_version 1715231 (0.0011) [2023-12-28 07:33:34,930][106225] Updated weights for policy 1, policy_version 1715241 (0.0010) [2023-12-28 07:33:34,977][106225] Updated weights for policy 1, policy_version 1715251 (0.0008) [2023-12-28 07:33:34,978][106226] Updated weights for policy 0, policy_version 1711346 (0.0006) [2023-12-28 07:33:35,030][106225] Updated weights for policy 1, policy_version 1715261 (0.0007) [2023-12-28 07:33:35,039][106226] Updated weights for policy 0, policy_version 1711356 (0.0006) [2023-12-28 07:33:35,097][106226] Updated weights for policy 0, policy_version 1711366 (0.0005) [2023-12-28 07:33:35,098][106225] Updated weights for policy 1, policy_version 1715271 (0.0005) [2023-12-28 07:33:35,671][106226] Updated weights for policy 0, policy_version 1711376 (0.0008) [2023-12-28 07:33:35,733][106226] Updated weights for policy 0, policy_version 1711386 (0.0008) [2023-12-28 07:33:35,735][106225] Updated weights for policy 1, policy_version 1715281 (0.0005) [2023-12-28 07:33:35,789][106225] Updated weights for policy 1, policy_version 1715291 (0.0005) [2023-12-28 07:33:35,795][106226] Updated weights for policy 0, policy_version 1711396 (0.0006) [2023-12-28 07:33:35,835][106225] Updated weights for policy 1, policy_version 1715301 (0.0005) [2023-12-28 07:33:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 877371392. Throughput: 0: 9978.0, 1: 10076.4. Samples: 877380432. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:36,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.687')] [2023-12-28 07:33:36,448][106226] Updated weights for policy 0, policy_version 1711406 (0.0007) [2023-12-28 07:33:36,464][106225] Updated weights for policy 1, policy_version 1715311 (0.0006) [2023-12-28 07:33:36,514][106226] Updated weights for policy 0, policy_version 1711416 (0.0010) [2023-12-28 07:33:36,532][106225] Updated weights for policy 1, policy_version 1715321 (0.0008) [2023-12-28 07:33:36,579][106226] Updated weights for policy 0, policy_version 1711426 (0.0011) [2023-12-28 07:33:36,590][106225] Updated weights for policy 1, policy_version 1715331 (0.0010) [2023-12-28 07:33:37,234][106225] Updated weights for policy 1, policy_version 1715341 (0.0010) [2023-12-28 07:33:37,291][106225] Updated weights for policy 1, policy_version 1715351 (0.0010) [2023-12-28 07:33:37,302][106226] Updated weights for policy 0, policy_version 1711436 (0.0011) [2023-12-28 07:33:37,341][106225] Updated weights for policy 1, policy_version 1715361 (0.0010) [2023-12-28 07:33:37,359][106226] Updated weights for policy 0, policy_version 1711446 (0.0011) [2023-12-28 07:33:37,424][106226] Updated weights for policy 0, policy_version 1711456 (0.0011) [2023-12-28 07:33:38,027][106225] Updated weights for policy 1, policy_version 1715371 (0.0010) [2023-12-28 07:33:38,090][106225] Updated weights for policy 1, policy_version 1715381 (0.0007) [2023-12-28 07:33:38,141][106226] Updated weights for policy 0, policy_version 1711466 (0.0010) [2023-12-28 07:33:38,143][106225] Updated weights for policy 1, policy_version 1715391 (0.0008) [2023-12-28 07:33:38,196][106226] Updated weights for policy 0, policy_version 1711476 (0.0005) [2023-12-28 07:33:38,244][106226] Updated weights for policy 0, policy_version 1711486 (0.0008) [2023-12-28 07:33:38,301][106226] Updated weights for policy 0, policy_version 1711496 (0.0010) [2023-12-28 07:33:38,880][106225] Updated weights for policy 1, policy_version 1715401 (0.0008) [2023-12-28 07:33:38,942][106225] Updated weights for policy 1, policy_version 1715411 (0.0007) [2023-12-28 07:33:39,001][106225] Updated weights for policy 1, policy_version 1715421 (0.0008) [2023-12-28 07:33:39,050][106226] Updated weights for policy 0, policy_version 1711506 (0.0011) [2023-12-28 07:33:39,062][106225] Updated weights for policy 1, policy_version 1715431 (0.0009) [2023-12-28 07:33:39,109][106226] Updated weights for policy 0, policy_version 1711516 (0.0010) [2023-12-28 07:33:39,174][106226] Updated weights for policy 0, policy_version 1711526 (0.0011) [2023-12-28 07:33:39,827][106225] Updated weights for policy 1, policy_version 1715441 (0.0011) [2023-12-28 07:33:39,895][106225] Updated weights for policy 1, policy_version 1715451 (0.0009) [2023-12-28 07:33:39,965][106225] Updated weights for policy 1, policy_version 1715461 (0.0011) [2023-12-28 07:33:39,984][106226] Updated weights for policy 0, policy_version 1711536 (0.0009) [2023-12-28 07:33:40,046][106226] Updated weights for policy 0, policy_version 1711546 (0.0009) [2023-12-28 07:33:40,110][106226] Updated weights for policy 0, policy_version 1711556 (0.0009) [2023-12-28 07:33:40,636][106225] Updated weights for policy 1, policy_version 1715471 (0.0006) [2023-12-28 07:33:40,690][106225] Updated weights for policy 1, policy_version 1715481 (0.0006) [2023-12-28 07:33:40,755][106225] Updated weights for policy 1, policy_version 1715491 (0.0009) [2023-12-28 07:33:40,820][106226] Updated weights for policy 0, policy_version 1711566 (0.0007) [2023-12-28 07:33:40,879][106226] Updated weights for policy 0, policy_version 1711576 (0.0005) [2023-12-28 07:33:40,934][106226] Updated weights for policy 0, policy_version 1711586 (0.0005) [2023-12-28 07:33:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 877469696. Throughput: 0: 9936.5, 1: 10126.0. Samples: 877440176. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:41,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.543')] [2023-12-28 07:33:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001715496_439222272.pth... [2023-12-28 07:33:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001711592_438247424.pth... [2023-12-28 07:33:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001714312_438919168.pth [2023-12-28 07:33:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001710408_437944320.pth [2023-12-28 07:33:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001715496_439222272.pth [2023-12-28 07:33:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001711592_438247424.pth [2023-12-28 07:33:41,563][106225] Updated weights for policy 1, policy_version 1715501 (0.0010) [2023-12-28 07:33:41,628][106225] Updated weights for policy 1, policy_version 1715511 (0.0010) [2023-12-28 07:33:41,634][106226] Updated weights for policy 0, policy_version 1711596 (0.0006) [2023-12-28 07:33:41,693][106225] Updated weights for policy 1, policy_version 1715521 (0.0009) [2023-12-28 07:33:41,704][106226] Updated weights for policy 0, policy_version 1711606 (0.0007) [2023-12-28 07:33:41,773][106226] Updated weights for policy 0, policy_version 1711616 (0.0009) [2023-12-28 07:33:42,460][106225] Updated weights for policy 1, policy_version 1715531 (0.0009) [2023-12-28 07:33:42,519][106225] Updated weights for policy 1, policy_version 1715541 (0.0008) [2023-12-28 07:33:42,556][106226] Updated weights for policy 0, policy_version 1711626 (0.0009) [2023-12-28 07:33:42,583][106225] Updated weights for policy 1, policy_version 1715551 (0.0011) [2023-12-28 07:33:42,614][106226] Updated weights for policy 0, policy_version 1711636 (0.0008) [2023-12-28 07:33:42,672][106226] Updated weights for policy 0, policy_version 1711646 (0.0009) [2023-12-28 07:33:42,734][106226] Updated weights for policy 0, policy_version 1711656 (0.0008) [2023-12-28 07:33:43,245][106225] Updated weights for policy 1, policy_version 1715561 (0.0010) [2023-12-28 07:33:43,311][106225] Updated weights for policy 1, policy_version 1715571 (0.0010) [2023-12-28 07:33:43,382][106225] Updated weights for policy 1, policy_version 1715581 (0.0010) [2023-12-28 07:33:43,443][106225] Updated weights for policy 1, policy_version 1715591 (0.0010) [2023-12-28 07:33:43,470][106226] Updated weights for policy 0, policy_version 1711666 (0.0011) [2023-12-28 07:33:43,523][106226] Updated weights for policy 0, policy_version 1711676 (0.0009) [2023-12-28 07:33:43,569][106226] Updated weights for policy 0, policy_version 1711686 (0.0005) [2023-12-28 07:33:44,086][106225] Updated weights for policy 1, policy_version 1715601 (0.0007) [2023-12-28 07:33:44,144][106225] Updated weights for policy 1, policy_version 1715611 (0.0010) [2023-12-28 07:33:44,208][106225] Updated weights for policy 1, policy_version 1715621 (0.0009) [2023-12-28 07:33:44,244][106226] Updated weights for policy 0, policy_version 1711696 (0.0008) [2023-12-28 07:33:44,300][106226] Updated weights for policy 0, policy_version 1711706 (0.0008) [2023-12-28 07:33:44,363][106226] Updated weights for policy 0, policy_version 1711716 (0.0006) [2023-12-28 07:33:44,905][106225] Updated weights for policy 1, policy_version 1715631 (0.0011) [2023-12-28 07:33:44,970][106225] Updated weights for policy 1, policy_version 1715641 (0.0011) [2023-12-28 07:33:45,036][106225] Updated weights for policy 1, policy_version 1715651 (0.0011) [2023-12-28 07:33:45,075][106226] Updated weights for policy 0, policy_version 1711726 (0.0009) [2023-12-28 07:33:45,141][106226] Updated weights for policy 0, policy_version 1711736 (0.0011) [2023-12-28 07:33:45,206][106226] Updated weights for policy 0, policy_version 1711746 (0.0011) [2023-12-28 07:33:45,764][106225] Updated weights for policy 1, policy_version 1715661 (0.0010) [2023-12-28 07:33:45,813][106225] Updated weights for policy 1, policy_version 1715671 (0.0010) [2023-12-28 07:33:45,869][106225] Updated weights for policy 1, policy_version 1715681 (0.0010) [2023-12-28 07:33:45,911][106226] Updated weights for policy 0, policy_version 1711756 (0.0009) [2023-12-28 07:33:45,966][106226] Updated weights for policy 0, policy_version 1711766 (0.0005) [2023-12-28 07:33:46,010][106226] Updated weights for policy 0, policy_version 1711776 (0.0005) [2023-12-28 07:33:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 877568000. Throughput: 0: 9940.6, 1: 10018.5. Samples: 877554400. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:46,176][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.824')] [2023-12-28 07:33:46,582][106225] Updated weights for policy 1, policy_version 1715691 (0.0009) [2023-12-28 07:33:46,638][106225] Updated weights for policy 1, policy_version 1715701 (0.0006) [2023-12-28 07:33:46,683][106226] Updated weights for policy 0, policy_version 1711786 (0.0006) [2023-12-28 07:33:46,691][106225] Updated weights for policy 1, policy_version 1715711 (0.0005) [2023-12-28 07:33:46,740][106226] Updated weights for policy 0, policy_version 1711796 (0.0009) [2023-12-28 07:33:46,801][106226] Updated weights for policy 0, policy_version 1711806 (0.0010) [2023-12-28 07:33:46,871][106226] Updated weights for policy 0, policy_version 1711816 (0.0011) [2023-12-28 07:33:47,233][106225] Updated weights for policy 1, policy_version 1715721 (0.0008) [2023-12-28 07:33:47,287][106225] Updated weights for policy 1, policy_version 1715731 (0.0005) [2023-12-28 07:33:47,342][106225] Updated weights for policy 1, policy_version 1715741 (0.0005) [2023-12-28 07:33:47,387][106225] Updated weights for policy 1, policy_version 1715751 (0.0006) [2023-12-28 07:33:47,563][106226] Updated weights for policy 0, policy_version 1711826 (0.0010) [2023-12-28 07:33:47,613][106226] Updated weights for policy 0, policy_version 1711836 (0.0010) [2023-12-28 07:33:47,675][106226] Updated weights for policy 0, policy_version 1711846 (0.0011) [2023-12-28 07:33:48,084][106225] Updated weights for policy 1, policy_version 1715761 (0.0008) [2023-12-28 07:33:48,137][106225] Updated weights for policy 1, policy_version 1715771 (0.0008) [2023-12-28 07:33:48,199][106225] Updated weights for policy 1, policy_version 1715781 (0.0007) [2023-12-28 07:33:48,323][106226] Updated weights for policy 0, policy_version 1711856 (0.0009) [2023-12-28 07:33:48,382][106226] Updated weights for policy 0, policy_version 1711866 (0.0007) [2023-12-28 07:33:48,439][106226] Updated weights for policy 0, policy_version 1711876 (0.0009) [2023-12-28 07:33:48,955][106225] Updated weights for policy 1, policy_version 1715791 (0.0007) [2023-12-28 07:33:49,003][106225] Updated weights for policy 1, policy_version 1715801 (0.0008) [2023-12-28 07:33:49,054][106225] Updated weights for policy 1, policy_version 1715811 (0.0008) [2023-12-28 07:33:49,206][106226] Updated weights for policy 0, policy_version 1711886 (0.0010) [2023-12-28 07:33:49,272][106226] Updated weights for policy 0, policy_version 1711896 (0.0009) [2023-12-28 07:33:49,327][106226] Updated weights for policy 0, policy_version 1711906 (0.0007) [2023-12-28 07:33:49,756][106225] Updated weights for policy 1, policy_version 1715821 (0.0008) [2023-12-28 07:33:49,813][106225] Updated weights for policy 1, policy_version 1715831 (0.0009) [2023-12-28 07:33:49,885][106225] Updated weights for policy 1, policy_version 1715841 (0.0009) [2023-12-28 07:33:50,127][106226] Updated weights for policy 0, policy_version 1711916 (0.0012) [2023-12-28 07:33:50,188][106226] Updated weights for policy 0, policy_version 1711926 (0.0009) [2023-12-28 07:33:50,249][106226] Updated weights for policy 0, policy_version 1711936 (0.0008) [2023-12-28 07:33:50,576][106225] Updated weights for policy 1, policy_version 1715851 (0.0008) [2023-12-28 07:33:50,640][106225] Updated weights for policy 1, policy_version 1715861 (0.0008) [2023-12-28 07:33:50,702][106225] Updated weights for policy 1, policy_version 1715871 (0.0008) [2023-12-28 07:33:51,007][106226] Updated weights for policy 0, policy_version 1711946 (0.0009) [2023-12-28 07:33:51,071][106226] Updated weights for policy 0, policy_version 1711956 (0.0009) [2023-12-28 07:33:51,136][106226] Updated weights for policy 0, policy_version 1711966 (0.0008) [2023-12-28 07:33:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 877658112. Throughput: 0: 9880.7, 1: 10065.2. Samples: 877672424. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:51,176][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.781')] [2023-12-28 07:33:51,189][106226] Updated weights for policy 0, policy_version 1711976 (0.0008) [2023-12-28 07:33:51,456][106225] Updated weights for policy 1, policy_version 1715881 (0.0008) [2023-12-28 07:33:51,513][106225] Updated weights for policy 1, policy_version 1715891 (0.0010) [2023-12-28 07:33:51,574][106225] Updated weights for policy 1, policy_version 1715901 (0.0011) [2023-12-28 07:33:51,640][106225] Updated weights for policy 1, policy_version 1715911 (0.0010) [2023-12-28 07:33:52,022][106226] Updated weights for policy 0, policy_version 1711986 (0.0008) [2023-12-28 07:33:52,086][106226] Updated weights for policy 0, policy_version 1711996 (0.0007) [2023-12-28 07:33:52,150][106226] Updated weights for policy 0, policy_version 1712006 (0.0005) [2023-12-28 07:33:52,387][106225] Updated weights for policy 1, policy_version 1715921 (0.0009) [2023-12-28 07:33:52,451][106225] Updated weights for policy 1, policy_version 1715931 (0.0007) [2023-12-28 07:33:52,512][106225] Updated weights for policy 1, policy_version 1715941 (0.0010) [2023-12-28 07:33:52,713][106226] Updated weights for policy 0, policy_version 1712016 (0.0010) [2023-12-28 07:33:52,772][106226] Updated weights for policy 0, policy_version 1712026 (0.0010) [2023-12-28 07:33:52,833][106226] Updated weights for policy 0, policy_version 1712036 (0.0011) [2023-12-28 07:33:53,212][106225] Updated weights for policy 1, policy_version 1715951 (0.0008) [2023-12-28 07:33:53,274][106225] Updated weights for policy 1, policy_version 1715961 (0.0005) [2023-12-28 07:33:53,340][106225] Updated weights for policy 1, policy_version 1715971 (0.0005) [2023-12-28 07:33:53,442][106226] Updated weights for policy 0, policy_version 1712046 (0.0007) [2023-12-28 07:33:53,490][106226] Updated weights for policy 0, policy_version 1712056 (0.0008) [2023-12-28 07:33:53,536][106226] Updated weights for policy 0, policy_version 1712066 (0.0010) [2023-12-28 07:33:53,986][106225] Updated weights for policy 1, policy_version 1715981 (0.0008) [2023-12-28 07:33:54,035][106225] Updated weights for policy 1, policy_version 1715991 (0.0010) [2023-12-28 07:33:54,095][106225] Updated weights for policy 1, policy_version 1716001 (0.0010) [2023-12-28 07:33:54,180][106226] Updated weights for policy 0, policy_version 1712076 (0.0010) [2023-12-28 07:33:54,247][106226] Updated weights for policy 0, policy_version 1712086 (0.0010) [2023-12-28 07:33:54,311][106226] Updated weights for policy 0, policy_version 1712096 (0.0010) [2023-12-28 07:33:54,764][106225] Updated weights for policy 1, policy_version 1716011 (0.0010) [2023-12-28 07:33:54,821][106225] Updated weights for policy 1, policy_version 1716021 (0.0010) [2023-12-28 07:33:54,884][106225] Updated weights for policy 1, policy_version 1716031 (0.0010) [2023-12-28 07:33:54,943][106226] Updated weights for policy 0, policy_version 1712106 (0.0009) [2023-12-28 07:33:55,003][106226] Updated weights for policy 0, policy_version 1712116 (0.0006) [2023-12-28 07:33:55,068][106226] Updated weights for policy 0, policy_version 1712126 (0.0008) [2023-12-28 07:33:55,123][106226] Updated weights for policy 0, policy_version 1712136 (0.0008) [2023-12-28 07:33:55,611][106225] Updated weights for policy 1, policy_version 1716041 (0.0010) [2023-12-28 07:33:55,669][106225] Updated weights for policy 1, policy_version 1716051 (0.0006) [2023-12-28 07:33:55,723][106225] Updated weights for policy 1, policy_version 1716061 (0.0010) [2023-12-28 07:33:55,780][106225] Updated weights for policy 1, policy_version 1716071 (0.0010) [2023-12-28 07:33:55,865][106226] Updated weights for policy 0, policy_version 1712146 (0.0010) [2023-12-28 07:33:55,920][106226] Updated weights for policy 0, policy_version 1712156 (0.0007) [2023-12-28 07:33:55,984][106226] Updated weights for policy 0, policy_version 1712166 (0.0006) [2023-12-28 07:33:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 877764608. Throughput: 0: 9938.6, 1: 10086.8. Samples: 877733048. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:33:56,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.686')] [2023-12-28 07:33:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001716072_439369728.pth... [2023-12-28 07:33:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001712168_438394880.pth... [2023-12-28 07:33:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001711016_438099968.pth [2023-12-28 07:33:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001714888_439066624.pth [2023-12-28 07:33:56,489][106225] Updated weights for policy 1, policy_version 1716081 (0.0010) [2023-12-28 07:33:56,547][106225] Updated weights for policy 1, policy_version 1716091 (0.0010) [2023-12-28 07:33:56,583][106226] Updated weights for policy 0, policy_version 1712176 (0.0008) [2023-12-28 07:33:56,597][106225] Updated weights for policy 1, policy_version 1716101 (0.0010) [2023-12-28 07:33:56,638][106226] Updated weights for policy 0, policy_version 1712186 (0.0005) [2023-12-28 07:33:56,700][106226] Updated weights for policy 0, policy_version 1712196 (0.0005) [2023-12-28 07:33:57,292][106226] Updated weights for policy 0, policy_version 1712206 (0.0006) [2023-12-28 07:33:57,309][106225] Updated weights for policy 1, policy_version 1716111 (0.0010) [2023-12-28 07:33:57,346][106226] Updated weights for policy 0, policy_version 1712216 (0.0010) [2023-12-28 07:33:57,370][106225] Updated weights for policy 1, policy_version 1716121 (0.0010) [2023-12-28 07:33:57,401][106226] Updated weights for policy 0, policy_version 1712226 (0.0010) [2023-12-28 07:33:57,429][106225] Updated weights for policy 1, policy_version 1716131 (0.0010) [2023-12-28 07:33:58,060][106226] Updated weights for policy 0, policy_version 1712236 (0.0008) [2023-12-28 07:33:58,124][106226] Updated weights for policy 0, policy_version 1712246 (0.0006) [2023-12-28 07:33:58,126][106225] Updated weights for policy 1, policy_version 1716141 (0.0010) [2023-12-28 07:33:58,175][106226] Updated weights for policy 0, policy_version 1712256 (0.0005) [2023-12-28 07:33:58,184][106225] Updated weights for policy 1, policy_version 1716151 (0.0010) [2023-12-28 07:33:58,245][106225] Updated weights for policy 1, policy_version 1716161 (0.0009) [2023-12-28 07:33:59,008][106226] Updated weights for policy 0, policy_version 1712266 (0.0007) [2023-12-28 07:33:59,040][106225] Updated weights for policy 1, policy_version 1716171 (0.0009) [2023-12-28 07:33:59,069][106226] Updated weights for policy 0, policy_version 1712276 (0.0010) [2023-12-28 07:33:59,105][106225] Updated weights for policy 1, policy_version 1716181 (0.0010) [2023-12-28 07:33:59,139][106226] Updated weights for policy 0, policy_version 1712286 (0.0011) [2023-12-28 07:33:59,167][106225] Updated weights for policy 1, policy_version 1716191 (0.0009) [2023-12-28 07:33:59,205][106226] Updated weights for policy 0, policy_version 1712296 (0.0009) [2023-12-28 07:33:59,870][106226] Updated weights for policy 0, policy_version 1712306 (0.0009) [2023-12-28 07:33:59,940][106226] Updated weights for policy 0, policy_version 1712316 (0.0008) [2023-12-28 07:33:59,954][106225] Updated weights for policy 1, policy_version 1716201 (0.0008) [2023-12-28 07:34:00,005][106226] Updated weights for policy 0, policy_version 1712326 (0.0007) [2023-12-28 07:34:00,010][106225] Updated weights for policy 1, policy_version 1716211 (0.0008) [2023-12-28 07:34:00,063][106225] Updated weights for policy 1, policy_version 1716221 (0.0006) [2023-12-28 07:34:00,118][106225] Updated weights for policy 1, policy_version 1716231 (0.0009) [2023-12-28 07:34:00,679][106226] Updated weights for policy 0, policy_version 1712336 (0.0006) [2023-12-28 07:34:00,730][106226] Updated weights for policy 0, policy_version 1712346 (0.0005) [2023-12-28 07:34:00,775][106225] Updated weights for policy 1, policy_version 1716241 (0.0007) [2023-12-28 07:34:00,796][106226] Updated weights for policy 0, policy_version 1712356 (0.0005) [2023-12-28 07:34:00,830][106225] Updated weights for policy 1, policy_version 1716251 (0.0007) [2023-12-28 07:34:00,883][106225] Updated weights for policy 1, policy_version 1716261 (0.0007) [2023-12-28 07:34:01,175][105115] Fps is (10 sec: 20479.2, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 877862912. Throughput: 0: 10026.8, 1: 10134.0. Samples: 877850940. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:34:01,176][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.906')] [2023-12-28 07:34:01,391][106226] Updated weights for policy 0, policy_version 1712366 (0.0007) [2023-12-28 07:34:01,448][106226] Updated weights for policy 0, policy_version 1712376 (0.0010) [2023-12-28 07:34:01,512][106226] Updated weights for policy 0, policy_version 1712386 (0.0006) [2023-12-28 07:34:01,641][106225] Updated weights for policy 1, policy_version 1716271 (0.0009) [2023-12-28 07:34:01,700][106225] Updated weights for policy 1, policy_version 1716281 (0.0006) [2023-12-28 07:34:01,775][106225] Updated weights for policy 1, policy_version 1716291 (0.0008) [2023-12-28 07:34:02,243][106226] Updated weights for policy 0, policy_version 1712396 (0.0009) [2023-12-28 07:34:02,305][106226] Updated weights for policy 0, policy_version 1712406 (0.0009) [2023-12-28 07:34:02,365][106226] Updated weights for policy 0, policy_version 1712416 (0.0008) [2023-12-28 07:34:02,437][106225] Updated weights for policy 1, policy_version 1716301 (0.0008) [2023-12-28 07:34:02,495][106225] Updated weights for policy 1, policy_version 1716311 (0.0009) [2023-12-28 07:34:02,558][106225] Updated weights for policy 1, policy_version 1716321 (0.0008) [2023-12-28 07:34:03,124][106225] Updated weights for policy 1, policy_version 1716331 (0.0009) [2023-12-28 07:34:03,163][106226] Updated weights for policy 0, policy_version 1712426 (0.0007) [2023-12-28 07:34:03,180][106225] Updated weights for policy 1, policy_version 1716341 (0.0010) [2023-12-28 07:34:03,212][106226] Updated weights for policy 0, policy_version 1712436 (0.0005) [2023-12-28 07:34:03,230][106225] Updated weights for policy 1, policy_version 1716351 (0.0010) [2023-12-28 07:34:03,265][106226] Updated weights for policy 0, policy_version 1712446 (0.0008) [2023-12-28 07:34:03,317][106226] Updated weights for policy 0, policy_version 1712456 (0.0008) [2023-12-28 07:34:03,807][106225] Updated weights for policy 1, policy_version 1716361 (0.0009) [2023-12-28 07:34:03,868][106225] Updated weights for policy 1, policy_version 1716371 (0.0007) [2023-12-28 07:34:03,930][106225] Updated weights for policy 1, policy_version 1716381 (0.0006) [2023-12-28 07:34:03,977][106225] Updated weights for policy 1, policy_version 1716391 (0.0005) [2023-12-28 07:34:04,104][106226] Updated weights for policy 0, policy_version 1712466 (0.0008) [2023-12-28 07:34:04,163][106226] Updated weights for policy 0, policy_version 1712476 (0.0008) [2023-12-28 07:34:04,218][106226] Updated weights for policy 0, policy_version 1712486 (0.0008) [2023-12-28 07:34:04,590][106225] Updated weights for policy 1, policy_version 1716401 (0.0009) [2023-12-28 07:34:04,648][106225] Updated weights for policy 1, policy_version 1716411 (0.0008) [2023-12-28 07:34:04,698][106225] Updated weights for policy 1, policy_version 1716421 (0.0008) [2023-12-28 07:34:04,971][106226] Updated weights for policy 0, policy_version 1712496 (0.0008) [2023-12-28 07:34:05,021][106226] Updated weights for policy 0, policy_version 1712506 (0.0008) [2023-12-28 07:34:05,075][106226] Updated weights for policy 0, policy_version 1712516 (0.0008) [2023-12-28 07:34:05,433][106225] Updated weights for policy 1, policy_version 1716431 (0.0009) [2023-12-28 07:34:05,479][106225] Updated weights for policy 1, policy_version 1716441 (0.0010) [2023-12-28 07:34:05,526][106225] Updated weights for policy 1, policy_version 1716451 (0.0010) [2023-12-28 07:34:05,829][106226] Updated weights for policy 0, policy_version 1712526 (0.0007) [2023-12-28 07:34:05,875][106226] Updated weights for policy 0, policy_version 1712536 (0.0008) [2023-12-28 07:34:05,925][106226] Updated weights for policy 0, policy_version 1712546 (0.0007) [2023-12-28 07:34:06,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 877961216. Throughput: 0: 9929.3, 1: 10142.0. Samples: 877971248. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:34:06,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.669')] [2023-12-28 07:34:06,256][106225] Updated weights for policy 1, policy_version 1716461 (0.0010) [2023-12-28 07:34:06,314][106225] Updated weights for policy 1, policy_version 1716471 (0.0011) [2023-12-28 07:34:06,376][106225] Updated weights for policy 1, policy_version 1716481 (0.0011) [2023-12-28 07:34:06,729][106226] Updated weights for policy 0, policy_version 1712556 (0.0007) [2023-12-28 07:34:06,790][106226] Updated weights for policy 0, policy_version 1712566 (0.0005) [2023-12-28 07:34:06,840][106226] Updated weights for policy 0, policy_version 1712576 (0.0005) [2023-12-28 07:34:07,092][106225] Updated weights for policy 1, policy_version 1716491 (0.0011) [2023-12-28 07:34:07,139][106225] Updated weights for policy 1, policy_version 1716501 (0.0010) [2023-12-28 07:34:07,189][106225] Updated weights for policy 1, policy_version 1716511 (0.0010) [2023-12-28 07:34:07,516][106226] Updated weights for policy 0, policy_version 1712586 (0.0006) [2023-12-28 07:34:07,566][106226] Updated weights for policy 0, policy_version 1712596 (0.0009) [2023-12-28 07:34:07,625][106226] Updated weights for policy 0, policy_version 1712606 (0.0009) [2023-12-28 07:34:07,678][106226] Updated weights for policy 0, policy_version 1712616 (0.0008) [2023-12-28 07:34:07,787][106225] Updated weights for policy 1, policy_version 1716521 (0.0010) [2023-12-28 07:34:07,852][106225] Updated weights for policy 1, policy_version 1716531 (0.0007) [2023-12-28 07:34:07,907][106225] Updated weights for policy 1, policy_version 1716541 (0.0005) [2023-12-28 07:34:07,965][106225] Updated weights for policy 1, policy_version 1716551 (0.0006) [2023-12-28 07:34:08,480][106226] Updated weights for policy 0, policy_version 1712626 (0.0008) [2023-12-28 07:34:08,540][106226] Updated weights for policy 0, policy_version 1712636 (0.0007) [2023-12-28 07:34:08,600][106226] Updated weights for policy 0, policy_version 1712646 (0.0006) [2023-12-28 07:34:08,613][106225] Updated weights for policy 1, policy_version 1716561 (0.0010) [2023-12-28 07:34:08,673][106225] Updated weights for policy 1, policy_version 1716571 (0.0010) [2023-12-28 07:34:08,732][106225] Updated weights for policy 1, policy_version 1716581 (0.0010) [2023-12-28 07:34:09,360][106226] Updated weights for policy 0, policy_version 1712656 (0.0008) [2023-12-28 07:34:09,433][106226] Updated weights for policy 0, policy_version 1712666 (0.0008) [2023-12-28 07:34:09,489][106226] Updated weights for policy 0, policy_version 1712676 (0.0006) [2023-12-28 07:34:09,499][106225] Updated weights for policy 1, policy_version 1716591 (0.0010) [2023-12-28 07:34:09,556][106225] Updated weights for policy 1, policy_version 1716601 (0.0010) [2023-12-28 07:34:09,621][106225] Updated weights for policy 1, policy_version 1716611 (0.0010) [2023-12-28 07:34:10,301][106226] Updated weights for policy 0, policy_version 1712686 (0.0007) [2023-12-28 07:34:10,365][106226] Updated weights for policy 0, policy_version 1712696 (0.0008) [2023-12-28 07:34:10,394][106225] Updated weights for policy 1, policy_version 1716621 (0.0010) [2023-12-28 07:34:10,423][106226] Updated weights for policy 0, policy_version 1712706 (0.0008) [2023-12-28 07:34:10,450][106225] Updated weights for policy 1, policy_version 1716631 (0.0008) [2023-12-28 07:34:10,508][106225] Updated weights for policy 1, policy_version 1716641 (0.0008) [2023-12-28 07:34:11,175][105115] Fps is (10 sec: 18842.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 878051328. Throughput: 0: 9919.3, 1: 10189.5. Samples: 878030152. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:34:11,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.748')] [2023-12-28 07:34:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001712712_438534144.pth... [2023-12-28 07:34:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001711592_438247424.pth [2023-12-28 07:34:11,187][106225] Updated weights for policy 1, policy_version 1716651 (0.0009) [2023-12-28 07:34:11,221][106226] Updated weights for policy 0, policy_version 1712716 (0.0006) [2023-12-28 07:34:11,250][106225] Updated weights for policy 1, policy_version 1716661 (0.0009) [2023-12-28 07:34:11,290][106226] Updated weights for policy 0, policy_version 1712726 (0.0008) [2023-12-28 07:34:11,317][106225] Updated weights for policy 1, policy_version 1716671 (0.0008) [2023-12-28 07:34:11,350][106226] Updated weights for policy 0, policy_version 1712736 (0.0008) [2023-12-28 07:34:11,376][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001716680_439525376.pth... [2023-12-28 07:34:11,381][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001715496_439222272.pth [2023-12-28 07:34:12,036][106226] Updated weights for policy 0, policy_version 1712746 (0.0009) [2023-12-28 07:34:12,061][106225] Updated weights for policy 1, policy_version 1716681 (0.0008) [2023-12-28 07:34:12,091][106226] Updated weights for policy 0, policy_version 1712756 (0.0006) [2023-12-28 07:34:12,123][106225] Updated weights for policy 1, policy_version 1716691 (0.0007) [2023-12-28 07:34:12,149][106226] Updated weights for policy 0, policy_version 1712766 (0.0008) [2023-12-28 07:34:12,182][106225] Updated weights for policy 1, policy_version 1716701 (0.0008) [2023-12-28 07:34:12,206][106226] Updated weights for policy 0, policy_version 1712776 (0.0006) [2023-12-28 07:34:12,241][106225] Updated weights for policy 1, policy_version 1716711 (0.0008) [2023-12-28 07:34:12,906][106226] Updated weights for policy 0, policy_version 1712786 (0.0009) [2023-12-28 07:34:12,956][106226] Updated weights for policy 0, policy_version 1712796 (0.0007) [2023-12-28 07:34:12,976][106225] Updated weights for policy 1, policy_version 1716721 (0.0006) [2023-12-28 07:34:13,002][106226] Updated weights for policy 0, policy_version 1712806 (0.0006) [2023-12-28 07:34:13,038][106225] Updated weights for policy 1, policy_version 1716731 (0.0008) [2023-12-28 07:34:13,097][106225] Updated weights for policy 1, policy_version 1716741 (0.0008) [2023-12-28 07:34:13,722][106226] Updated weights for policy 0, policy_version 1712816 (0.0006) [2023-12-28 07:34:13,788][106226] Updated weights for policy 0, policy_version 1712826 (0.0006) [2023-12-28 07:34:13,802][106225] Updated weights for policy 1, policy_version 1716751 (0.0009) [2023-12-28 07:34:13,855][106226] Updated weights for policy 0, policy_version 1712836 (0.0006) [2023-12-28 07:34:13,862][106225] Updated weights for policy 1, policy_version 1716761 (0.0008) [2023-12-28 07:34:13,931][106225] Updated weights for policy 1, policy_version 1716771 (0.0008) [2023-12-28 07:34:14,465][106226] Updated weights for policy 0, policy_version 1712846 (0.0007) [2023-12-28 07:34:14,513][106226] Updated weights for policy 0, policy_version 1712856 (0.0006) [2023-12-28 07:34:14,543][106225] Updated weights for policy 1, policy_version 1716781 (0.0007) [2023-12-28 07:34:14,560][106226] Updated weights for policy 0, policy_version 1712866 (0.0006) [2023-12-28 07:34:14,596][106225] Updated weights for policy 1, policy_version 1716791 (0.0009) [2023-12-28 07:34:14,648][106225] Updated weights for policy 1, policy_version 1716801 (0.0008) [2023-12-28 07:34:15,218][106226] Updated weights for policy 0, policy_version 1712876 (0.0008) [2023-12-28 07:34:15,277][106226] Updated weights for policy 0, policy_version 1712886 (0.0008) [2023-12-28 07:34:15,337][106226] Updated weights for policy 0, policy_version 1712896 (0.0009) [2023-12-28 07:34:15,397][106225] Updated weights for policy 1, policy_version 1716811 (0.0008) [2023-12-28 07:34:15,459][106225] Updated weights for policy 1, policy_version 1716821 (0.0009) [2023-12-28 07:34:15,518][106225] Updated weights for policy 1, policy_version 1716831 (0.0008) [2023-12-28 07:34:15,940][106226] Updated weights for policy 0, policy_version 1712906 (0.0009) [2023-12-28 07:34:16,005][106226] Updated weights for policy 0, policy_version 1712916 (0.0007) [2023-12-28 07:34:16,071][106226] Updated weights for policy 0, policy_version 1712926 (0.0006) [2023-12-28 07:34:16,131][106226] Updated weights for policy 0, policy_version 1712936 (0.0008) [2023-12-28 07:34:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 878157824. Throughput: 0: 9802.5, 1: 10033.4. Samples: 878145728. Policy #0 lag: (min: 23.0, avg: 26.6, max: 55.0) [2023-12-28 07:34:16,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.026')] [2023-12-28 07:34:16,309][106225] Updated weights for policy 1, policy_version 1716841 (0.0009) [2023-12-28 07:34:16,365][106225] Updated weights for policy 1, policy_version 1716851 (0.0009) [2023-12-28 07:34:16,436][106225] Updated weights for policy 1, policy_version 1716861 (0.0008) [2023-12-28 07:34:16,500][106225] Updated weights for policy 1, policy_version 1716871 (0.0008) [2023-12-28 07:34:16,789][106226] Updated weights for policy 0, policy_version 1712946 (0.0008) [2023-12-28 07:34:16,852][106226] Updated weights for policy 0, policy_version 1712956 (0.0009) [2023-12-28 07:34:16,906][106226] Updated weights for policy 0, policy_version 1712966 (0.0009) [2023-12-28 07:34:17,179][106225] Updated weights for policy 1, policy_version 1716881 (0.0010) [2023-12-28 07:34:17,252][106225] Updated weights for policy 1, policy_version 1716891 (0.0009) [2023-12-28 07:34:17,311][106225] Updated weights for policy 1, policy_version 1716901 (0.0010) [2023-12-28 07:34:17,568][106226] Updated weights for policy 0, policy_version 1712976 (0.0006) [2023-12-28 07:34:17,630][106226] Updated weights for policy 0, policy_version 1712986 (0.0005) [2023-12-28 07:34:17,682][106226] Updated weights for policy 0, policy_version 1712996 (0.0005) [2023-12-28 07:34:17,991][106225] Updated weights for policy 1, policy_version 1716911 (0.0008) [2023-12-28 07:34:18,051][106225] Updated weights for policy 1, policy_version 1716921 (0.0007) [2023-12-28 07:34:18,112][106225] Updated weights for policy 1, policy_version 1716931 (0.0007) [2023-12-28 07:34:18,341][106226] Updated weights for policy 0, policy_version 1713006 (0.0007) [2023-12-28 07:34:18,401][106226] Updated weights for policy 0, policy_version 1713016 (0.0007) [2023-12-28 07:34:18,466][106226] Updated weights for policy 0, policy_version 1713026 (0.0008) [2023-12-28 07:34:18,814][106225] Updated weights for policy 1, policy_version 1716941 (0.0010) [2023-12-28 07:34:18,872][106225] Updated weights for policy 1, policy_version 1716951 (0.0011) [2023-12-28 07:34:18,923][106225] Updated weights for policy 1, policy_version 1716961 (0.0010) [2023-12-28 07:34:19,182][106226] Updated weights for policy 0, policy_version 1713036 (0.0009) [2023-12-28 07:34:19,246][106226] Updated weights for policy 0, policy_version 1713046 (0.0008) [2023-12-28 07:34:19,313][106226] Updated weights for policy 0, policy_version 1713056 (0.0006) [2023-12-28 07:34:19,607][106225] Updated weights for policy 1, policy_version 1716971 (0.0007) [2023-12-28 07:34:19,660][106225] Updated weights for policy 1, policy_version 1716981 (0.0008) [2023-12-28 07:34:19,711][106225] Updated weights for policy 1, policy_version 1716991 (0.0008) [2023-12-28 07:34:19,947][106226] Updated weights for policy 0, policy_version 1713066 (0.0008) [2023-12-28 07:34:20,004][106226] Updated weights for policy 0, policy_version 1713076 (0.0008) [2023-12-28 07:34:20,067][106226] Updated weights for policy 0, policy_version 1713086 (0.0007) [2023-12-28 07:34:20,135][106226] Updated weights for policy 0, policy_version 1713096 (0.0008) [2023-12-28 07:34:20,520][106225] Updated weights for policy 1, policy_version 1717001 (0.0008) [2023-12-28 07:34:20,588][106225] Updated weights for policy 1, policy_version 1717011 (0.0010) [2023-12-28 07:34:20,657][106225] Updated weights for policy 1, policy_version 1717021 (0.0009) [2023-12-28 07:34:20,722][106225] Updated weights for policy 1, policy_version 1717031 (0.0009) [2023-12-28 07:34:20,886][106226] Updated weights for policy 0, policy_version 1713106 (0.0009) [2023-12-28 07:34:20,955][106226] Updated weights for policy 0, policy_version 1713116 (0.0010) [2023-12-28 07:34:21,014][106226] Updated weights for policy 0, policy_version 1713126 (0.0008) [2023-12-28 07:34:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 878256128. Throughput: 0: 9766.2, 1: 9848.4. Samples: 878263084. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:21,175][105115] Avg episode reward: [(0, '-4.678'), (1, '-5.014')] [2023-12-28 07:34:21,496][106225] Updated weights for policy 1, policy_version 1717041 (0.0009) [2023-12-28 07:34:21,559][106225] Updated weights for policy 1, policy_version 1717051 (0.0010) [2023-12-28 07:34:21,622][106225] Updated weights for policy 1, policy_version 1717061 (0.0008) [2023-12-28 07:34:21,750][106226] Updated weights for policy 0, policy_version 1713136 (0.0009) [2023-12-28 07:34:21,800][106226] Updated weights for policy 0, policy_version 1713146 (0.0009) [2023-12-28 07:34:21,846][106226] Updated weights for policy 0, policy_version 1713156 (0.0008) [2023-12-28 07:34:22,376][106225] Updated weights for policy 1, policy_version 1717071 (0.0009) [2023-12-28 07:34:22,439][106225] Updated weights for policy 1, policy_version 1717081 (0.0008) [2023-12-28 07:34:22,497][106225] Updated weights for policy 1, policy_version 1717091 (0.0009) [2023-12-28 07:34:22,680][106226] Updated weights for policy 0, policy_version 1713166 (0.0009) [2023-12-28 07:34:22,738][106226] Updated weights for policy 0, policy_version 1713176 (0.0009) [2023-12-28 07:34:22,794][106226] Updated weights for policy 0, policy_version 1713186 (0.0009) [2023-12-28 07:34:23,192][106225] Updated weights for policy 1, policy_version 1717101 (0.0007) [2023-12-28 07:34:23,251][106225] Updated weights for policy 1, policy_version 1717111 (0.0009) [2023-12-28 07:34:23,304][106225] Updated weights for policy 1, policy_version 1717121 (0.0009) [2023-12-28 07:34:23,515][106226] Updated weights for policy 0, policy_version 1713196 (0.0009) [2023-12-28 07:34:23,566][106226] Updated weights for policy 0, policy_version 1713206 (0.0009) [2023-12-28 07:34:23,619][106226] Updated weights for policy 0, policy_version 1713216 (0.0008) [2023-12-28 07:34:23,904][106225] Updated weights for policy 1, policy_version 1717131 (0.0008) [2023-12-28 07:34:23,964][106225] Updated weights for policy 1, policy_version 1717141 (0.0008) [2023-12-28 07:34:24,011][106225] Updated weights for policy 1, policy_version 1717151 (0.0008) [2023-12-28 07:34:24,413][106226] Updated weights for policy 0, policy_version 1713226 (0.0009) [2023-12-28 07:34:24,473][106226] Updated weights for policy 0, policy_version 1713236 (0.0009) [2023-12-28 07:34:24,523][106226] Updated weights for policy 0, policy_version 1713246 (0.0009) [2023-12-28 07:34:24,577][106226] Updated weights for policy 0, policy_version 1713256 (0.0010) [2023-12-28 07:34:24,672][106225] Updated weights for policy 1, policy_version 1717161 (0.0008) [2023-12-28 07:34:24,737][106225] Updated weights for policy 1, policy_version 1717171 (0.0006) [2023-12-28 07:34:24,808][106225] Updated weights for policy 1, policy_version 1717181 (0.0005) [2023-12-28 07:34:24,867][106225] Updated weights for policy 1, policy_version 1717191 (0.0007) [2023-12-28 07:34:25,253][106226] Updated weights for policy 0, policy_version 1713266 (0.0010) [2023-12-28 07:34:25,318][106226] Updated weights for policy 0, policy_version 1713276 (0.0011) [2023-12-28 07:34:25,380][106226] Updated weights for policy 0, policy_version 1713286 (0.0011) [2023-12-28 07:34:25,540][106225] Updated weights for policy 1, policy_version 1717201 (0.0008) [2023-12-28 07:34:25,603][106225] Updated weights for policy 1, policy_version 1717211 (0.0008) [2023-12-28 07:34:25,662][106225] Updated weights for policy 1, policy_version 1717221 (0.0008) [2023-12-28 07:34:26,148][106226] Updated weights for policy 0, policy_version 1713296 (0.0009) [2023-12-28 07:34:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 878346240. Throughput: 0: 9749.5, 1: 9806.4. Samples: 878320192. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:26,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-5.005')] [2023-12-28 07:34:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001717224_439664640.pth... [2023-12-28 07:34:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001716072_439369728.pth [2023-12-28 07:34:26,206][106226] Updated weights for policy 0, policy_version 1713306 (0.0008) [2023-12-28 07:34:26,252][106226] Updated weights for policy 0, policy_version 1713316 (0.0008) [2023-12-28 07:34:26,270][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001713320_438689792.pth... [2023-12-28 07:34:26,273][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001712168_438394880.pth [2023-12-28 07:34:26,355][106225] Updated weights for policy 1, policy_version 1717231 (0.0009) [2023-12-28 07:34:26,407][106225] Updated weights for policy 1, policy_version 1717242 (0.0010) [2023-12-28 07:34:26,454][106225] Updated weights for policy 1, policy_version 1717252 (0.0010) [2023-12-28 07:34:26,942][106226] Updated weights for policy 0, policy_version 1713326 (0.0007) [2023-12-28 07:34:26,996][106226] Updated weights for policy 0, policy_version 1713336 (0.0008) [2023-12-28 07:34:27,054][106226] Updated weights for policy 0, policy_version 1713346 (0.0007) [2023-12-28 07:34:27,167][106225] Updated weights for policy 1, policy_version 1717262 (0.0010) [2023-12-28 07:34:27,214][106225] Updated weights for policy 1, policy_version 1717272 (0.0010) [2023-12-28 07:34:27,267][106225] Updated weights for policy 1, policy_version 1717282 (0.0010) [2023-12-28 07:34:27,706][106226] Updated weights for policy 0, policy_version 1713356 (0.0007) [2023-12-28 07:34:27,756][106226] Updated weights for policy 0, policy_version 1713366 (0.0008) [2023-12-28 07:34:27,804][106226] Updated weights for policy 0, policy_version 1713376 (0.0007) [2023-12-28 07:34:27,994][106225] Updated weights for policy 1, policy_version 1717292 (0.0010) [2023-12-28 07:34:28,048][106225] Updated weights for policy 1, policy_version 1717302 (0.0010) [2023-12-28 07:34:28,094][106225] Updated weights for policy 1, policy_version 1717312 (0.0010) [2023-12-28 07:34:28,518][106226] Updated weights for policy 0, policy_version 1713386 (0.0008) [2023-12-28 07:34:28,587][106226] Updated weights for policy 0, policy_version 1713396 (0.0008) [2023-12-28 07:34:28,647][106226] Updated weights for policy 0, policy_version 1713406 (0.0008) [2023-12-28 07:34:28,703][106226] Updated weights for policy 0, policy_version 1713416 (0.0008) [2023-12-28 07:34:28,839][106225] Updated weights for policy 1, policy_version 1717322 (0.0010) [2023-12-28 07:34:28,890][106225] Updated weights for policy 1, policy_version 1717332 (0.0010) [2023-12-28 07:34:28,936][106225] Updated weights for policy 1, policy_version 1717342 (0.0010) [2023-12-28 07:34:28,986][106225] Updated weights for policy 1, policy_version 1717352 (0.0010) [2023-12-28 07:34:29,284][106226] Updated weights for policy 0, policy_version 1713426 (0.0008) [2023-12-28 07:34:29,350][106226] Updated weights for policy 0, policy_version 1713436 (0.0008) [2023-12-28 07:34:29,421][106226] Updated weights for policy 0, policy_version 1713446 (0.0008) [2023-12-28 07:34:29,706][106225] Updated weights for policy 1, policy_version 1717362 (0.0008) [2023-12-28 07:34:29,772][106225] Updated weights for policy 1, policy_version 1717372 (0.0007) [2023-12-28 07:34:29,838][106225] Updated weights for policy 1, policy_version 1717382 (0.0007) [2023-12-28 07:34:30,082][106226] Updated weights for policy 0, policy_version 1713456 (0.0009) [2023-12-28 07:34:30,140][106226] Updated weights for policy 0, policy_version 1713466 (0.0007) [2023-12-28 07:34:30,200][106226] Updated weights for policy 0, policy_version 1713476 (0.0006) [2023-12-28 07:34:30,527][106225] Updated weights for policy 1, policy_version 1717392 (0.0009) [2023-12-28 07:34:30,573][106225] Updated weights for policy 1, policy_version 1717402 (0.0008) [2023-12-28 07:34:30,618][106225] Updated weights for policy 1, policy_version 1717412 (0.0009) [2023-12-28 07:34:30,794][106226] Updated weights for policy 0, policy_version 1713486 (0.0007) [2023-12-28 07:34:30,844][106226] Updated weights for policy 0, policy_version 1713496 (0.0009) [2023-12-28 07:34:30,903][106226] Updated weights for policy 0, policy_version 1713506 (0.0006) [2023-12-28 07:34:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 878452736. Throughput: 0: 9832.6, 1: 9863.7. Samples: 878440728. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:31,175][105115] Avg episode reward: [(0, '-4.392'), (1, '-5.167')] [2023-12-28 07:34:31,377][106225] Updated weights for policy 1, policy_version 1717422 (0.0008) [2023-12-28 07:34:31,441][106225] Updated weights for policy 1, policy_version 1717432 (0.0008) [2023-12-28 07:34:31,495][106225] Updated weights for policy 1, policy_version 1717442 (0.0008) [2023-12-28 07:34:31,622][106226] Updated weights for policy 0, policy_version 1713516 (0.0006) [2023-12-28 07:34:31,686][106226] Updated weights for policy 0, policy_version 1713526 (0.0008) [2023-12-28 07:34:31,749][106226] Updated weights for policy 0, policy_version 1713536 (0.0009) [2023-12-28 07:34:32,267][106225] Updated weights for policy 1, policy_version 1717452 (0.0008) [2023-12-28 07:34:32,329][106225] Updated weights for policy 1, policy_version 1717462 (0.0006) [2023-12-28 07:34:32,396][106225] Updated weights for policy 1, policy_version 1717472 (0.0010) [2023-12-28 07:34:32,478][106226] Updated weights for policy 0, policy_version 1713546 (0.0007) [2023-12-28 07:34:32,536][106226] Updated weights for policy 0, policy_version 1713556 (0.0007) [2023-12-28 07:34:32,596][106226] Updated weights for policy 0, policy_version 1713566 (0.0006) [2023-12-28 07:34:32,653][106226] Updated weights for policy 0, policy_version 1713576 (0.0008) [2023-12-28 07:34:33,039][106225] Updated weights for policy 1, policy_version 1717482 (0.0010) [2023-12-28 07:34:33,089][106225] Updated weights for policy 1, policy_version 1717492 (0.0010) [2023-12-28 07:34:33,135][106225] Updated weights for policy 1, policy_version 1717502 (0.0010) [2023-12-28 07:34:33,187][106225] Updated weights for policy 1, policy_version 1717512 (0.0010) [2023-12-28 07:34:33,242][106226] Updated weights for policy 0, policy_version 1713586 (0.0006) [2023-12-28 07:34:33,294][106226] Updated weights for policy 0, policy_version 1713596 (0.0005) [2023-12-28 07:34:33,349][106226] Updated weights for policy 0, policy_version 1713606 (0.0005) [2023-12-28 07:34:33,835][106225] Updated weights for policy 1, policy_version 1717522 (0.0006) [2023-12-28 07:34:33,855][106226] Updated weights for policy 0, policy_version 1713616 (0.0007) [2023-12-28 07:34:33,884][106225] Updated weights for policy 1, policy_version 1717532 (0.0010) [2023-12-28 07:34:33,909][106226] Updated weights for policy 0, policy_version 1713626 (0.0006) [2023-12-28 07:34:33,934][106225] Updated weights for policy 1, policy_version 1717542 (0.0010) [2023-12-28 07:34:33,974][106226] Updated weights for policy 0, policy_version 1713636 (0.0007) [2023-12-28 07:34:34,663][106225] Updated weights for policy 1, policy_version 1717552 (0.0010) [2023-12-28 07:34:34,699][106226] Updated weights for policy 0, policy_version 1713646 (0.0006) [2023-12-28 07:34:34,723][106225] Updated weights for policy 1, policy_version 1717562 (0.0010) [2023-12-28 07:34:34,756][106226] Updated weights for policy 0, policy_version 1713656 (0.0006) [2023-12-28 07:34:34,780][106225] Updated weights for policy 1, policy_version 1717572 (0.0010) [2023-12-28 07:34:34,814][106226] Updated weights for policy 0, policy_version 1713666 (0.0006) [2023-12-28 07:34:35,485][106225] Updated weights for policy 1, policy_version 1717582 (0.0010) [2023-12-28 07:34:35,538][106225] Updated weights for policy 1, policy_version 1717592 (0.0010) [2023-12-28 07:34:35,540][106226] Updated weights for policy 0, policy_version 1713676 (0.0007) [2023-12-28 07:34:35,585][106225] Updated weights for policy 1, policy_version 1717602 (0.0010) [2023-12-28 07:34:35,594][106226] Updated weights for policy 0, policy_version 1713686 (0.0006) [2023-12-28 07:34:35,643][106226] Updated weights for policy 0, policy_version 1713696 (0.0007) [2023-12-28 07:34:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 878551040. Throughput: 0: 9928.6, 1: 9828.4. Samples: 878561488. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:36,175][105115] Avg episode reward: [(0, '-4.614'), (1, '-4.844')] [2023-12-28 07:34:36,352][106225] Updated weights for policy 1, policy_version 1717612 (0.0010) [2023-12-28 07:34:36,403][106225] Updated weights for policy 1, policy_version 1717622 (0.0010) [2023-12-28 07:34:36,410][106226] Updated weights for policy 0, policy_version 1713706 (0.0007) [2023-12-28 07:34:36,458][106225] Updated weights for policy 1, policy_version 1717632 (0.0010) [2023-12-28 07:34:36,476][106226] Updated weights for policy 0, policy_version 1713716 (0.0006) [2023-12-28 07:34:36,533][106226] Updated weights for policy 0, policy_version 1713726 (0.0007) [2023-12-28 07:34:36,593][106226] Updated weights for policy 0, policy_version 1713736 (0.0008) [2023-12-28 07:34:37,202][106225] Updated weights for policy 1, policy_version 1717642 (0.0011) [2023-12-28 07:34:37,266][106225] Updated weights for policy 1, policy_version 1717652 (0.0010) [2023-12-28 07:34:37,325][106226] Updated weights for policy 0, policy_version 1713746 (0.0007) [2023-12-28 07:34:37,327][106225] Updated weights for policy 1, policy_version 1717662 (0.0010) [2023-12-28 07:34:37,374][106225] Updated weights for policy 1, policy_version 1717672 (0.0010) [2023-12-28 07:34:37,376][106226] Updated weights for policy 0, policy_version 1713756 (0.0005) [2023-12-28 07:34:37,427][106226] Updated weights for policy 0, policy_version 1713766 (0.0008) [2023-12-28 07:34:38,090][106225] Updated weights for policy 1, policy_version 1717682 (0.0010) [2023-12-28 07:34:38,140][106225] Updated weights for policy 1, policy_version 1717692 (0.0010) [2023-12-28 07:34:38,183][106225] Updated weights for policy 1, policy_version 1717702 (0.0010) [2023-12-28 07:34:38,185][106226] Updated weights for policy 0, policy_version 1713776 (0.0006) [2023-12-28 07:34:38,242][106226] Updated weights for policy 0, policy_version 1713786 (0.0007) [2023-12-28 07:34:38,293][106226] Updated weights for policy 0, policy_version 1713796 (0.0008) [2023-12-28 07:34:38,957][106225] Updated weights for policy 1, policy_version 1717712 (0.0010) [2023-12-28 07:34:38,997][106226] Updated weights for policy 0, policy_version 1713806 (0.0009) [2023-12-28 07:34:39,015][106225] Updated weights for policy 1, policy_version 1717722 (0.0010) [2023-12-28 07:34:39,047][106226] Updated weights for policy 0, policy_version 1713816 (0.0005) [2023-12-28 07:34:39,065][106225] Updated weights for policy 1, policy_version 1717732 (0.0010) [2023-12-28 07:34:39,092][106226] Updated weights for policy 0, policy_version 1713826 (0.0008) [2023-12-28 07:34:39,848][106225] Updated weights for policy 1, policy_version 1717742 (0.0009) [2023-12-28 07:34:39,865][106226] Updated weights for policy 0, policy_version 1713836 (0.0007) [2023-12-28 07:34:39,904][106225] Updated weights for policy 1, policy_version 1717753 (0.0010) [2023-12-28 07:34:39,924][106226] Updated weights for policy 0, policy_version 1713846 (0.0009) [2023-12-28 07:34:39,967][106225] Updated weights for policy 1, policy_version 1717763 (0.0007) [2023-12-28 07:34:39,984][106226] Updated weights for policy 0, policy_version 1713856 (0.0010) [2023-12-28 07:34:40,739][106225] Updated weights for policy 1, policy_version 1717773 (0.0006) [2023-12-28 07:34:40,761][106226] Updated weights for policy 0, policy_version 1713866 (0.0010) [2023-12-28 07:34:40,797][106225] Updated weights for policy 1, policy_version 1717783 (0.0007) [2023-12-28 07:34:40,818][106226] Updated weights for policy 0, policy_version 1713876 (0.0007) [2023-12-28 07:34:40,852][106225] Updated weights for policy 1, policy_version 1717793 (0.0006) [2023-12-28 07:34:40,875][106226] Updated weights for policy 0, policy_version 1713886 (0.0007) [2023-12-28 07:34:40,933][106226] Updated weights for policy 0, policy_version 1713896 (0.0007) [2023-12-28 07:34:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 878649344. Throughput: 0: 9857.4, 1: 9820.9. Samples: 878618572. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:41,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.602')] [2023-12-28 07:34:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001713896_438837248.pth... [2023-12-28 07:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001717800_439812096.pth... [2023-12-28 07:34:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001712712_438534144.pth [2023-12-28 07:34:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001716680_439525376.pth [2023-12-28 07:34:41,662][106225] Updated weights for policy 1, policy_version 1717803 (0.0006) [2023-12-28 07:34:41,721][106225] Updated weights for policy 1, policy_version 1717813 (0.0010) [2023-12-28 07:34:41,723][106226] Updated weights for policy 0, policy_version 1713906 (0.0007) [2023-12-28 07:34:41,791][106225] Updated weights for policy 1, policy_version 1717823 (0.0010) [2023-12-28 07:34:41,793][106226] Updated weights for policy 0, policy_version 1713916 (0.0007) [2023-12-28 07:34:41,856][106226] Updated weights for policy 0, policy_version 1713926 (0.0006) [2023-12-28 07:34:42,513][106225] Updated weights for policy 1, policy_version 1717833 (0.0010) [2023-12-28 07:34:42,575][106225] Updated weights for policy 1, policy_version 1717843 (0.0009) [2023-12-28 07:34:42,628][106226] Updated weights for policy 0, policy_version 1713936 (0.0010) [2023-12-28 07:34:42,640][106225] Updated weights for policy 1, policy_version 1717853 (0.0008) [2023-12-28 07:34:42,687][106226] Updated weights for policy 0, policy_version 1713946 (0.0006) [2023-12-28 07:34:42,701][106225] Updated weights for policy 1, policy_version 1717863 (0.0007) [2023-12-28 07:34:42,750][106226] Updated weights for policy 0, policy_version 1713956 (0.0008) [2023-12-28 07:34:43,341][106225] Updated weights for policy 1, policy_version 1717873 (0.0005) [2023-12-28 07:34:43,393][106225] Updated weights for policy 1, policy_version 1717883 (0.0005) [2023-12-28 07:34:43,445][106225] Updated weights for policy 1, policy_version 1717893 (0.0006) [2023-12-28 07:34:43,493][106226] Updated weights for policy 0, policy_version 1713966 (0.0007) [2023-12-28 07:34:43,545][106226] Updated weights for policy 0, policy_version 1713976 (0.0005) [2023-12-28 07:34:43,601][106226] Updated weights for policy 0, policy_version 1713986 (0.0007) [2023-12-28 07:34:44,085][106225] Updated weights for policy 1, policy_version 1717903 (0.0009) [2023-12-28 07:34:44,143][106225] Updated weights for policy 1, policy_version 1717913 (0.0008) [2023-12-28 07:34:44,198][106225] Updated weights for policy 1, policy_version 1717923 (0.0008) [2023-12-28 07:34:44,303][106226] Updated weights for policy 0, policy_version 1713996 (0.0009) [2023-12-28 07:34:44,355][106226] Updated weights for policy 0, policy_version 1714006 (0.0007) [2023-12-28 07:34:44,425][106226] Updated weights for policy 0, policy_version 1714016 (0.0005) [2023-12-28 07:34:44,998][106226] Updated weights for policy 0, policy_version 1714026 (0.0005) [2023-12-28 07:34:45,016][106225] Updated weights for policy 1, policy_version 1717933 (0.0008) [2023-12-28 07:34:45,062][106226] Updated weights for policy 0, policy_version 1714036 (0.0009) [2023-12-28 07:34:45,077][106225] Updated weights for policy 1, policy_version 1717943 (0.0007) [2023-12-28 07:34:45,130][106226] Updated weights for policy 0, policy_version 1714046 (0.0006) [2023-12-28 07:34:45,145][106225] Updated weights for policy 1, policy_version 1717953 (0.0008) [2023-12-28 07:34:45,201][106226] Updated weights for policy 0, policy_version 1714056 (0.0008) [2023-12-28 07:34:45,804][106226] Updated weights for policy 0, policy_version 1714066 (0.0005) [2023-12-28 07:34:45,856][106226] Updated weights for policy 0, policy_version 1714076 (0.0005) [2023-12-28 07:34:45,904][106226] Updated weights for policy 0, policy_version 1714086 (0.0005) [2023-12-28 07:34:45,935][106225] Updated weights for policy 1, policy_version 1717963 (0.0008) [2023-12-28 07:34:45,987][106225] Updated weights for policy 1, policy_version 1717973 (0.0007) [2023-12-28 07:34:46,042][106225] Updated weights for policy 1, policy_version 1717983 (0.0008) [2023-12-28 07:34:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 878747648. Throughput: 0: 9786.0, 1: 9811.6. Samples: 878732820. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:46,175][105115] Avg episode reward: [(0, '-4.986'), (1, '-4.988')] [2023-12-28 07:34:46,571][106226] Updated weights for policy 0, policy_version 1714096 (0.0008) [2023-12-28 07:34:46,627][106226] Updated weights for policy 0, policy_version 1714106 (0.0009) [2023-12-28 07:34:46,688][106226] Updated weights for policy 0, policy_version 1714116 (0.0009) [2023-12-28 07:34:46,737][106225] Updated weights for policy 1, policy_version 1717993 (0.0008) [2023-12-28 07:34:46,786][106225] Updated weights for policy 1, policy_version 1718003 (0.0008) [2023-12-28 07:34:46,844][106225] Updated weights for policy 1, policy_version 1718013 (0.0008) [2023-12-28 07:34:46,894][106225] Updated weights for policy 1, policy_version 1718023 (0.0008) [2023-12-28 07:34:47,402][106226] Updated weights for policy 0, policy_version 1714126 (0.0009) [2023-12-28 07:34:47,469][106226] Updated weights for policy 0, policy_version 1714136 (0.0009) [2023-12-28 07:34:47,532][106226] Updated weights for policy 0, policy_version 1714146 (0.0008) [2023-12-28 07:34:47,636][106225] Updated weights for policy 1, policy_version 1718033 (0.0008) [2023-12-28 07:34:47,702][106225] Updated weights for policy 1, policy_version 1718043 (0.0008) [2023-12-28 07:34:47,767][106225] Updated weights for policy 1, policy_version 1718053 (0.0008) [2023-12-28 07:34:48,174][106226] Updated weights for policy 0, policy_version 1714156 (0.0009) [2023-12-28 07:34:48,238][106226] Updated weights for policy 0, policy_version 1714166 (0.0009) [2023-12-28 07:34:48,297][106226] Updated weights for policy 0, policy_version 1714176 (0.0008) [2023-12-28 07:34:48,533][106225] Updated weights for policy 1, policy_version 1718063 (0.0008) [2023-12-28 07:34:48,599][106225] Updated weights for policy 1, policy_version 1718073 (0.0010) [2023-12-28 07:34:48,660][106225] Updated weights for policy 1, policy_version 1718083 (0.0009) [2023-12-28 07:34:49,044][106226] Updated weights for policy 0, policy_version 1714186 (0.0008) [2023-12-28 07:34:49,099][106226] Updated weights for policy 0, policy_version 1714196 (0.0006) [2023-12-28 07:34:49,164][106226] Updated weights for policy 0, policy_version 1714206 (0.0006) [2023-12-28 07:34:49,227][106226] Updated weights for policy 0, policy_version 1714216 (0.0007) [2023-12-28 07:34:49,369][106225] Updated weights for policy 1, policy_version 1718093 (0.0008) [2023-12-28 07:34:49,430][106225] Updated weights for policy 1, policy_version 1718103 (0.0006) [2023-12-28 07:34:49,495][106225] Updated weights for policy 1, policy_version 1718113 (0.0005) [2023-12-28 07:34:50,050][106226] Updated weights for policy 0, policy_version 1714226 (0.0008) [2023-12-28 07:34:50,095][106225] Updated weights for policy 1, policy_version 1718123 (0.0006) [2023-12-28 07:34:50,110][106226] Updated weights for policy 0, policy_version 1714236 (0.0009) [2023-12-28 07:34:50,156][106225] Updated weights for policy 1, policy_version 1718133 (0.0007) [2023-12-28 07:34:50,170][106226] Updated weights for policy 0, policy_version 1714246 (0.0008) [2023-12-28 07:34:50,222][106225] Updated weights for policy 1, policy_version 1718143 (0.0006) [2023-12-28 07:34:50,884][106225] Updated weights for policy 1, policy_version 1718153 (0.0006) [2023-12-28 07:34:50,934][106226] Updated weights for policy 0, policy_version 1714256 (0.0009) [2023-12-28 07:34:50,936][106225] Updated weights for policy 1, policy_version 1718163 (0.0006) [2023-12-28 07:34:50,985][106225] Updated weights for policy 1, policy_version 1718173 (0.0008) [2023-12-28 07:34:51,001][106226] Updated weights for policy 0, policy_version 1714266 (0.0007) [2023-12-28 07:34:51,045][106225] Updated weights for policy 1, policy_version 1718184 (0.0009) [2023-12-28 07:34:51,065][106226] Updated weights for policy 0, policy_version 1714276 (0.0007) [2023-12-28 07:34:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 878845952. Throughput: 0: 9803.8, 1: 9698.6. Samples: 878848856. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:51,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-4.971')] [2023-12-28 07:34:51,800][106226] Updated weights for policy 0, policy_version 1714286 (0.0009) [2023-12-28 07:34:51,866][106226] Updated weights for policy 0, policy_version 1714296 (0.0008) [2023-12-28 07:34:51,900][106225] Updated weights for policy 1, policy_version 1718194 (0.0008) [2023-12-28 07:34:51,930][106226] Updated weights for policy 0, policy_version 1714306 (0.0006) [2023-12-28 07:34:51,960][106225] Updated weights for policy 1, policy_version 1718204 (0.0008) [2023-12-28 07:34:52,027][106225] Updated weights for policy 1, policy_version 1718214 (0.0008) [2023-12-28 07:34:52,587][106226] Updated weights for policy 0, policy_version 1714316 (0.0007) [2023-12-28 07:34:52,646][106226] Updated weights for policy 0, policy_version 1714326 (0.0009) [2023-12-28 07:34:52,696][106226] Updated weights for policy 0, policy_version 1714336 (0.0009) [2023-12-28 07:34:52,770][106225] Updated weights for policy 1, policy_version 1718224 (0.0007) [2023-12-28 07:34:52,828][106225] Updated weights for policy 1, policy_version 1718234 (0.0008) [2023-12-28 07:34:52,883][106225] Updated weights for policy 1, policy_version 1718244 (0.0008) [2023-12-28 07:34:53,441][106226] Updated weights for policy 0, policy_version 1714346 (0.0009) [2023-12-28 07:34:53,493][106226] Updated weights for policy 0, policy_version 1714356 (0.0008) [2023-12-28 07:34:53,541][106226] Updated weights for policy 0, policy_version 1714366 (0.0008) [2023-12-28 07:34:53,584][106226] Updated weights for policy 0, policy_version 1714376 (0.0007) [2023-12-28 07:34:53,585][106225] Updated weights for policy 1, policy_version 1718254 (0.0008) [2023-12-28 07:34:53,642][106225] Updated weights for policy 1, policy_version 1718264 (0.0008) [2023-12-28 07:34:53,696][106225] Updated weights for policy 1, policy_version 1718274 (0.0008) [2023-12-28 07:34:54,295][106226] Updated weights for policy 0, policy_version 1714386 (0.0010) [2023-12-28 07:34:54,351][106226] Updated weights for policy 0, policy_version 1714396 (0.0010) [2023-12-28 07:34:54,410][106226] Updated weights for policy 0, policy_version 1714406 (0.0010) [2023-12-28 07:34:54,416][106225] Updated weights for policy 1, policy_version 1718284 (0.0007) [2023-12-28 07:34:54,469][106225] Updated weights for policy 1, policy_version 1718294 (0.0007) [2023-12-28 07:34:54,528][106225] Updated weights for policy 1, policy_version 1718304 (0.0008) [2023-12-28 07:34:55,053][106226] Updated weights for policy 0, policy_version 1714416 (0.0010) [2023-12-28 07:34:55,103][106226] Updated weights for policy 0, policy_version 1714426 (0.0010) [2023-12-28 07:34:55,167][106226] Updated weights for policy 0, policy_version 1714436 (0.0009) [2023-12-28 07:34:55,286][106225] Updated weights for policy 1, policy_version 1718314 (0.0008) [2023-12-28 07:34:55,332][106225] Updated weights for policy 1, policy_version 1718324 (0.0008) [2023-12-28 07:34:55,385][106225] Updated weights for policy 1, policy_version 1718334 (0.0007) [2023-12-28 07:34:55,444][106225] Updated weights for policy 1, policy_version 1718344 (0.0007) [2023-12-28 07:34:55,841][106226] Updated weights for policy 0, policy_version 1714446 (0.0006) [2023-12-28 07:34:55,910][106226] Updated weights for policy 0, policy_version 1714456 (0.0008) [2023-12-28 07:34:55,980][106226] Updated weights for policy 0, policy_version 1714466 (0.0010) [2023-12-28 07:34:56,112][106225] Updated weights for policy 1, policy_version 1718354 (0.0008) [2023-12-28 07:34:56,170][106225] Updated weights for policy 1, policy_version 1718364 (0.0007) [2023-12-28 07:34:56,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 878936064. Throughput: 0: 9832.5, 1: 9627.0. Samples: 878905832. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:34:56,176][105115] Avg episode reward: [(0, '-4.757'), (1, '-5.130')] [2023-12-28 07:34:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001714472_438984704.pth... [2023-12-28 07:34:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001713320_438689792.pth [2023-12-28 07:34:56,230][106225] Updated weights for policy 1, policy_version 1718374 (0.0008) [2023-12-28 07:34:56,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001718376_439959552.pth... [2023-12-28 07:34:56,245][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001717224_439664640.pth [2023-12-28 07:34:56,565][106226] Updated weights for policy 0, policy_version 1714476 (0.0007) [2023-12-28 07:34:56,628][106226] Updated weights for policy 0, policy_version 1714486 (0.0005) [2023-12-28 07:34:56,686][106226] Updated weights for policy 0, policy_version 1714496 (0.0009) [2023-12-28 07:34:56,984][106225] Updated weights for policy 1, policy_version 1718384 (0.0007) [2023-12-28 07:34:57,032][106225] Updated weights for policy 1, policy_version 1718394 (0.0007) [2023-12-28 07:34:57,082][106225] Updated weights for policy 1, policy_version 1718404 (0.0007) [2023-12-28 07:34:57,348][106226] Updated weights for policy 0, policy_version 1714506 (0.0009) [2023-12-28 07:34:57,410][106226] Updated weights for policy 0, policy_version 1714516 (0.0005) [2023-12-28 07:34:57,476][106226] Updated weights for policy 0, policy_version 1714526 (0.0007) [2023-12-28 07:34:57,544][106226] Updated weights for policy 0, policy_version 1714536 (0.0010) [2023-12-28 07:34:57,716][106225] Updated weights for policy 1, policy_version 1718414 (0.0006) [2023-12-28 07:34:57,763][106225] Updated weights for policy 1, policy_version 1718424 (0.0005) [2023-12-28 07:34:57,809][106225] Updated weights for policy 1, policy_version 1718434 (0.0005) [2023-12-28 07:34:58,221][106226] Updated weights for policy 0, policy_version 1714546 (0.0010) [2023-12-28 07:34:58,283][106226] Updated weights for policy 0, policy_version 1714556 (0.0008) [2023-12-28 07:34:58,361][106226] Updated weights for policy 0, policy_version 1714566 (0.0029) [2023-12-28 07:34:58,427][106225] Updated weights for policy 1, policy_version 1718444 (0.0007) [2023-12-28 07:34:58,497][106225] Updated weights for policy 1, policy_version 1718454 (0.0008) [2023-12-28 07:34:58,567][106225] Updated weights for policy 1, policy_version 1718464 (0.0008) [2023-12-28 07:34:59,233][106226] Updated weights for policy 0, policy_version 1714576 (0.0008) [2023-12-28 07:34:59,293][106225] Updated weights for policy 1, policy_version 1718474 (0.0008) [2023-12-28 07:34:59,303][106226] Updated weights for policy 0, policy_version 1714586 (0.0007) [2023-12-28 07:34:59,354][106225] Updated weights for policy 1, policy_version 1718484 (0.0008) [2023-12-28 07:34:59,364][106226] Updated weights for policy 0, policy_version 1714596 (0.0008) [2023-12-28 07:34:59,422][106225] Updated weights for policy 1, policy_version 1718494 (0.0008) [2023-12-28 07:34:59,492][106225] Updated weights for policy 1, policy_version 1718504 (0.0007) [2023-12-28 07:34:59,999][106226] Updated weights for policy 0, policy_version 1714606 (0.0008) [2023-12-28 07:35:00,058][106226] Updated weights for policy 0, policy_version 1714616 (0.0008) [2023-12-28 07:35:00,122][106226] Updated weights for policy 0, policy_version 1714626 (0.0009) [2023-12-28 07:35:00,240][106225] Updated weights for policy 1, policy_version 1718514 (0.0009) [2023-12-28 07:35:00,294][106225] Updated weights for policy 1, policy_version 1718524 (0.0008) [2023-12-28 07:35:00,347][106225] Updated weights for policy 1, policy_version 1718534 (0.0008) [2023-12-28 07:35:00,751][106226] Updated weights for policy 0, policy_version 1714636 (0.0008) [2023-12-28 07:35:00,808][106226] Updated weights for policy 0, policy_version 1714646 (0.0008) [2023-12-28 07:35:00,861][106226] Updated weights for policy 0, policy_version 1714656 (0.0008) [2023-12-28 07:35:01,129][106225] Updated weights for policy 1, policy_version 1718544 (0.0008) [2023-12-28 07:35:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.4, 300 sec: 19827.4). Total num frames: 879034368. Throughput: 0: 9872.3, 1: 9674.8. Samples: 879025352. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:01,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.930')] [2023-12-28 07:35:01,193][106225] Updated weights for policy 1, policy_version 1718554 (0.0009) [2023-12-28 07:35:01,259][106225] Updated weights for policy 1, policy_version 1718564 (0.0008) [2023-12-28 07:35:01,583][106226] Updated weights for policy 0, policy_version 1714666 (0.0009) [2023-12-28 07:35:01,636][106226] Updated weights for policy 0, policy_version 1714676 (0.0009) [2023-12-28 07:35:01,702][106226] Updated weights for policy 0, policy_version 1714686 (0.0008) [2023-12-28 07:35:01,771][106226] Updated weights for policy 0, policy_version 1714696 (0.0008) [2023-12-28 07:35:02,063][106225] Updated weights for policy 1, policy_version 1718574 (0.0008) [2023-12-28 07:35:02,125][106225] Updated weights for policy 1, policy_version 1718584 (0.0008) [2023-12-28 07:35:02,184][106225] Updated weights for policy 1, policy_version 1718594 (0.0008) [2023-12-28 07:35:02,493][106226] Updated weights for policy 0, policy_version 1714706 (0.0008) [2023-12-28 07:35:02,550][106226] Updated weights for policy 0, policy_version 1714716 (0.0008) [2023-12-28 07:35:02,609][106226] Updated weights for policy 0, policy_version 1714726 (0.0008) [2023-12-28 07:35:02,889][106225] Updated weights for policy 1, policy_version 1718604 (0.0006) [2023-12-28 07:35:02,952][106225] Updated weights for policy 1, policy_version 1718614 (0.0010) [2023-12-28 07:35:03,014][106225] Updated weights for policy 1, policy_version 1718624 (0.0010) [2023-12-28 07:35:03,378][106226] Updated weights for policy 0, policy_version 1714736 (0.0010) [2023-12-28 07:35:03,440][106226] Updated weights for policy 0, policy_version 1714746 (0.0009) [2023-12-28 07:35:03,490][106226] Updated weights for policy 0, policy_version 1714756 (0.0009) [2023-12-28 07:35:03,594][106225] Updated weights for policy 1, policy_version 1718634 (0.0009) [2023-12-28 07:35:03,658][106225] Updated weights for policy 1, policy_version 1718644 (0.0010) [2023-12-28 07:35:03,701][106225] Updated weights for policy 1, policy_version 1718654 (0.0009) [2023-12-28 07:35:03,748][106225] Updated weights for policy 1, policy_version 1718664 (0.0005) [2023-12-28 07:35:04,261][106226] Updated weights for policy 0, policy_version 1714766 (0.0009) [2023-12-28 07:35:04,321][106226] Updated weights for policy 0, policy_version 1714776 (0.0008) [2023-12-28 07:35:04,343][106225] Updated weights for policy 1, policy_version 1718674 (0.0011) [2023-12-28 07:35:04,380][106226] Updated weights for policy 0, policy_version 1714786 (0.0006) [2023-12-28 07:35:04,401][106225] Updated weights for policy 1, policy_version 1718684 (0.0011) [2023-12-28 07:35:04,451][106225] Updated weights for policy 1, policy_version 1718694 (0.0010) [2023-12-28 07:35:05,077][106225] Updated weights for policy 1, policy_version 1718704 (0.0005) [2023-12-28 07:35:05,087][106226] Updated weights for policy 0, policy_version 1714796 (0.0007) [2023-12-28 07:35:05,134][106225] Updated weights for policy 1, policy_version 1718714 (0.0005) [2023-12-28 07:35:05,134][106226] Updated weights for policy 0, policy_version 1714806 (0.0009) [2023-12-28 07:35:05,185][106226] Updated weights for policy 0, policy_version 1714816 (0.0007) [2023-12-28 07:35:05,195][106225] Updated weights for policy 1, policy_version 1718724 (0.0009) [2023-12-28 07:35:05,779][106225] Updated weights for policy 1, policy_version 1718734 (0.0008) [2023-12-28 07:35:05,836][106225] Updated weights for policy 1, policy_version 1718744 (0.0010) [2023-12-28 07:35:05,889][106225] Updated weights for policy 1, policy_version 1718754 (0.0011) [2023-12-28 07:35:05,992][106226] Updated weights for policy 0, policy_version 1714826 (0.0007) [2023-12-28 07:35:06,046][106226] Updated weights for policy 0, policy_version 1714836 (0.0008) [2023-12-28 07:35:06,099][106226] Updated weights for policy 0, policy_version 1714846 (0.0008) [2023-12-28 07:35:06,164][106226] Updated weights for policy 0, policy_version 1714856 (0.0008) [2023-12-28 07:35:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.7, 300 sec: 19855.2). Total num frames: 879140864. Throughput: 0: 9806.8, 1: 9779.0. Samples: 879144448. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:06,176][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.795')] [2023-12-28 07:35:06,599][106225] Updated weights for policy 1, policy_version 1718764 (0.0009) [2023-12-28 07:35:06,662][106225] Updated weights for policy 1, policy_version 1718774 (0.0010) [2023-12-28 07:35:06,730][106225] Updated weights for policy 1, policy_version 1718784 (0.0005) [2023-12-28 07:35:06,958][106226] Updated weights for policy 0, policy_version 1714866 (0.0009) [2023-12-28 07:35:07,020][106226] Updated weights for policy 0, policy_version 1714876 (0.0008) [2023-12-28 07:35:07,082][106226] Updated weights for policy 0, policy_version 1714886 (0.0008) [2023-12-28 07:35:07,322][106225] Updated weights for policy 1, policy_version 1718794 (0.0005) [2023-12-28 07:35:07,388][106225] Updated weights for policy 1, policy_version 1718804 (0.0006) [2023-12-28 07:35:07,437][106225] Updated weights for policy 1, policy_version 1718814 (0.0005) [2023-12-28 07:35:07,488][106225] Updated weights for policy 1, policy_version 1718824 (0.0005) [2023-12-28 07:35:07,900][106226] Updated weights for policy 0, policy_version 1714896 (0.0006) [2023-12-28 07:35:07,950][106226] Updated weights for policy 0, policy_version 1714906 (0.0005) [2023-12-28 07:35:08,008][106226] Updated weights for policy 0, policy_version 1714916 (0.0006) [2023-12-28 07:35:08,064][106225] Updated weights for policy 1, policy_version 1718834 (0.0005) [2023-12-28 07:35:08,126][106225] Updated weights for policy 1, policy_version 1718844 (0.0006) [2023-12-28 07:35:08,190][106225] Updated weights for policy 1, policy_version 1718854 (0.0009) [2023-12-28 07:35:08,637][106226] Updated weights for policy 0, policy_version 1714926 (0.0009) [2023-12-28 07:35:08,699][106226] Updated weights for policy 0, policy_version 1714936 (0.0006) [2023-12-28 07:35:08,768][106226] Updated weights for policy 0, policy_version 1714946 (0.0005) [2023-12-28 07:35:08,891][106225] Updated weights for policy 1, policy_version 1718864 (0.0010) [2023-12-28 07:35:08,947][106225] Updated weights for policy 1, policy_version 1718874 (0.0008) [2023-12-28 07:35:09,007][106225] Updated weights for policy 1, policy_version 1718884 (0.0008) [2023-12-28 07:35:09,387][106226] Updated weights for policy 0, policy_version 1714956 (0.0007) [2023-12-28 07:35:09,452][106226] Updated weights for policy 0, policy_version 1714966 (0.0007) [2023-12-28 07:35:09,510][106226] Updated weights for policy 0, policy_version 1714976 (0.0006) [2023-12-28 07:35:09,860][106225] Updated weights for policy 1, policy_version 1718894 (0.0008) [2023-12-28 07:35:09,936][106225] Updated weights for policy 1, policy_version 1718904 (0.0009) [2023-12-28 07:35:09,998][106225] Updated weights for policy 1, policy_version 1718914 (0.0008) [2023-12-28 07:35:10,146][106226] Updated weights for policy 0, policy_version 1714986 (0.0007) [2023-12-28 07:35:10,212][106226] Updated weights for policy 0, policy_version 1714996 (0.0008) [2023-12-28 07:35:10,278][106226] Updated weights for policy 0, policy_version 1715006 (0.0007) [2023-12-28 07:35:10,345][106226] Updated weights for policy 0, policy_version 1715016 (0.0008) [2023-12-28 07:35:10,769][106225] Updated weights for policy 1, policy_version 1718924 (0.0009) [2023-12-28 07:35:10,821][106225] Updated weights for policy 1, policy_version 1718934 (0.0008) [2023-12-28 07:35:10,881][106225] Updated weights for policy 1, policy_version 1718944 (0.0008) [2023-12-28 07:35:11,008][106226] Updated weights for policy 0, policy_version 1715026 (0.0011) [2023-12-28 07:35:11,082][106226] Updated weights for policy 0, policy_version 1715036 (0.0010) [2023-12-28 07:35:11,149][106226] Updated weights for policy 0, policy_version 1715046 (0.0008) [2023-12-28 07:35:11,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 879239168. Throughput: 0: 9829.4, 1: 9840.6. Samples: 879205344. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:11,176][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.555')] [2023-12-28 07:35:11,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001718952_440107008.pth... [2023-12-28 07:35:11,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001715048_439132160.pth... [2023-12-28 07:35:11,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001713896_438837248.pth [2023-12-28 07:35:11,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001717800_439812096.pth [2023-12-28 07:35:11,658][106225] Updated weights for policy 1, policy_version 1718954 (0.0008) [2023-12-28 07:35:11,721][106225] Updated weights for policy 1, policy_version 1718964 (0.0008) [2023-12-28 07:35:11,786][106225] Updated weights for policy 1, policy_version 1718974 (0.0008) [2023-12-28 07:35:11,843][106225] Updated weights for policy 1, policy_version 1718984 (0.0009) [2023-12-28 07:35:11,893][106226] Updated weights for policy 0, policy_version 1715056 (0.0008) [2023-12-28 07:35:11,953][106226] Updated weights for policy 0, policy_version 1715066 (0.0009) [2023-12-28 07:35:12,012][106226] Updated weights for policy 0, policy_version 1715076 (0.0008) [2023-12-28 07:35:12,595][106225] Updated weights for policy 1, policy_version 1718994 (0.0008) [2023-12-28 07:35:12,667][106225] Updated weights for policy 1, policy_version 1719005 (0.0009) [2023-12-28 07:35:12,732][106225] Updated weights for policy 1, policy_version 1719015 (0.0009) [2023-12-28 07:35:12,790][106226] Updated weights for policy 0, policy_version 1715086 (0.0009) [2023-12-28 07:35:12,849][106226] Updated weights for policy 0, policy_version 1715096 (0.0010) [2023-12-28 07:35:12,910][106226] Updated weights for policy 0, policy_version 1715106 (0.0011) [2023-12-28 07:35:13,490][106225] Updated weights for policy 1, policy_version 1719025 (0.0010) [2023-12-28 07:35:13,543][106225] Updated weights for policy 1, policy_version 1719035 (0.0009) [2023-12-28 07:35:13,588][106226] Updated weights for policy 0, policy_version 1715116 (0.0009) [2023-12-28 07:35:13,593][106225] Updated weights for policy 1, policy_version 1719045 (0.0008) [2023-12-28 07:35:13,643][106226] Updated weights for policy 0, policy_version 1715126 (0.0006) [2023-12-28 07:35:13,692][106226] Updated weights for policy 0, policy_version 1715136 (0.0005) [2023-12-28 07:35:14,291][106226] Updated weights for policy 0, policy_version 1715146 (0.0005) [2023-12-28 07:35:14,351][106225] Updated weights for policy 1, policy_version 1719055 (0.0007) [2023-12-28 07:35:14,353][106226] Updated weights for policy 0, policy_version 1715156 (0.0006) [2023-12-28 07:35:14,405][106225] Updated weights for policy 1, policy_version 1719065 (0.0009) [2023-12-28 07:35:14,411][106226] Updated weights for policy 0, policy_version 1715166 (0.0006) [2023-12-28 07:35:14,456][106225] Updated weights for policy 1, policy_version 1719075 (0.0010) [2023-12-28 07:35:14,462][106226] Updated weights for policy 0, policy_version 1715176 (0.0005) [2023-12-28 07:35:15,146][106226] Updated weights for policy 0, policy_version 1715186 (0.0008) [2023-12-28 07:35:15,207][106226] Updated weights for policy 0, policy_version 1715196 (0.0008) [2023-12-28 07:35:15,228][106225] Updated weights for policy 1, policy_version 1719085 (0.0010) [2023-12-28 07:35:15,269][106226] Updated weights for policy 0, policy_version 1715206 (0.0006) [2023-12-28 07:35:15,294][106225] Updated weights for policy 1, policy_version 1719095 (0.0011) [2023-12-28 07:35:15,352][106225] Updated weights for policy 1, policy_version 1719105 (0.0011) [2023-12-28 07:35:15,880][106226] Updated weights for policy 0, policy_version 1715216 (0.0005) [2023-12-28 07:35:15,946][106226] Updated weights for policy 0, policy_version 1715226 (0.0007) [2023-12-28 07:35:16,007][106226] Updated weights for policy 0, policy_version 1715236 (0.0007) [2023-12-28 07:35:16,046][106225] Updated weights for policy 1, policy_version 1719115 (0.0010) [2023-12-28 07:35:16,110][106225] Updated weights for policy 1, policy_version 1719125 (0.0010) [2023-12-28 07:35:16,165][106225] Updated weights for policy 1, policy_version 1719135 (0.0010) [2023-12-28 07:35:16,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 879329280. Throughput: 0: 9813.2, 1: 9718.1. Samples: 879319640. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:16,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.935')] [2023-12-28 07:35:16,653][106226] Updated weights for policy 0, policy_version 1715246 (0.0007) [2023-12-28 07:35:16,701][106226] Updated weights for policy 0, policy_version 1715256 (0.0007) [2023-12-28 07:35:16,756][106226] Updated weights for policy 0, policy_version 1715266 (0.0005) [2023-12-28 07:35:16,854][106225] Updated weights for policy 1, policy_version 1719145 (0.0010) [2023-12-28 07:35:16,923][106225] Updated weights for policy 1, policy_version 1719155 (0.0009) [2023-12-28 07:35:16,978][106225] Updated weights for policy 1, policy_version 1719165 (0.0005) [2023-12-28 07:35:17,032][106225] Updated weights for policy 1, policy_version 1719175 (0.0006) [2023-12-28 07:35:17,461][106226] Updated weights for policy 0, policy_version 1715276 (0.0006) [2023-12-28 07:35:17,523][106226] Updated weights for policy 0, policy_version 1715286 (0.0007) [2023-12-28 07:35:17,582][106226] Updated weights for policy 0, policy_version 1715296 (0.0007) [2023-12-28 07:35:17,600][106225] Updated weights for policy 1, policy_version 1719185 (0.0006) [2023-12-28 07:35:17,666][106225] Updated weights for policy 1, policy_version 1719195 (0.0006) [2023-12-28 07:35:17,738][106225] Updated weights for policy 1, policy_version 1719205 (0.0005) [2023-12-28 07:35:18,308][106225] Updated weights for policy 1, policy_version 1719215 (0.0005) [2023-12-28 07:35:18,357][106226] Updated weights for policy 0, policy_version 1715306 (0.0007) [2023-12-28 07:35:18,393][106225] Updated weights for policy 1, policy_version 1719225 (0.0008) [2023-12-28 07:35:18,424][106226] Updated weights for policy 0, policy_version 1715316 (0.0008) [2023-12-28 07:35:18,450][106225] Updated weights for policy 1, policy_version 1719235 (0.0006) [2023-12-28 07:35:18,487][106226] Updated weights for policy 0, policy_version 1715326 (0.0007) [2023-12-28 07:35:18,547][106226] Updated weights for policy 0, policy_version 1715336 (0.0009) [2023-12-28 07:35:19,042][106225] Updated weights for policy 1, policy_version 1719245 (0.0007) [2023-12-28 07:35:19,110][106225] Updated weights for policy 1, policy_version 1719255 (0.0008) [2023-12-28 07:35:19,172][106225] Updated weights for policy 1, policy_version 1719265 (0.0009) [2023-12-28 07:35:19,295][106226] Updated weights for policy 0, policy_version 1715346 (0.0007) [2023-12-28 07:35:19,365][106226] Updated weights for policy 0, policy_version 1715356 (0.0008) [2023-12-28 07:35:19,419][106226] Updated weights for policy 0, policy_version 1715366 (0.0007) [2023-12-28 07:35:20,008][106225] Updated weights for policy 1, policy_version 1719275 (0.0008) [2023-12-28 07:35:20,067][106225] Updated weights for policy 1, policy_version 1719285 (0.0009) [2023-12-28 07:35:20,133][106225] Updated weights for policy 1, policy_version 1719295 (0.0008) [2023-12-28 07:35:20,224][106226] Updated weights for policy 0, policy_version 1715376 (0.0006) [2023-12-28 07:35:20,284][106226] Updated weights for policy 0, policy_version 1715386 (0.0005) [2023-12-28 07:35:20,345][106226] Updated weights for policy 0, policy_version 1715396 (0.0005) [2023-12-28 07:35:20,935][106225] Updated weights for policy 1, policy_version 1719305 (0.0008) [2023-12-28 07:35:20,978][106226] Updated weights for policy 0, policy_version 1715406 (0.0006) [2023-12-28 07:35:20,999][106225] Updated weights for policy 1, policy_version 1719315 (0.0006) [2023-12-28 07:35:21,060][106226] Updated weights for policy 0, policy_version 1715416 (0.0008) [2023-12-28 07:35:21,063][106225] Updated weights for policy 1, policy_version 1719325 (0.0008) [2023-12-28 07:35:21,130][106225] Updated weights for policy 1, policy_version 1719335 (0.0006) [2023-12-28 07:35:21,130][106226] Updated weights for policy 0, policy_version 1715426 (0.0008) [2023-12-28 07:35:21,174][105115] Fps is (10 sec: 19661.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 879435776. Throughput: 0: 9754.7, 1: 9748.8. Samples: 879439144. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:21,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.808')] [2023-12-28 07:35:21,848][106226] Updated weights for policy 0, policy_version 1715436 (0.0006) [2023-12-28 07:35:21,849][106225] Updated weights for policy 1, policy_version 1719345 (0.0008) [2023-12-28 07:35:21,910][106226] Updated weights for policy 0, policy_version 1715446 (0.0009) [2023-12-28 07:35:21,910][106225] Updated weights for policy 1, policy_version 1719355 (0.0008) [2023-12-28 07:35:21,970][106226] Updated weights for policy 0, policy_version 1715456 (0.0006) [2023-12-28 07:35:21,973][106225] Updated weights for policy 1, policy_version 1719365 (0.0007) [2023-12-28 07:35:22,660][106225] Updated weights for policy 1, policy_version 1719375 (0.0007) [2023-12-28 07:35:22,660][106226] Updated weights for policy 0, policy_version 1715466 (0.0006) [2023-12-28 07:35:22,723][106225] Updated weights for policy 1, policy_version 1719385 (0.0006) [2023-12-28 07:35:22,731][106226] Updated weights for policy 0, policy_version 1715476 (0.0009) [2023-12-28 07:35:22,788][106225] Updated weights for policy 1, policy_version 1719395 (0.0007) [2023-12-28 07:35:22,794][106226] Updated weights for policy 0, policy_version 1715486 (0.0009) [2023-12-28 07:35:22,865][106226] Updated weights for policy 0, policy_version 1715496 (0.0009) [2023-12-28 07:35:23,471][106225] Updated weights for policy 1, policy_version 1719405 (0.0008) [2023-12-28 07:35:23,530][106225] Updated weights for policy 1, policy_version 1719415 (0.0009) [2023-12-28 07:35:23,534][106226] Updated weights for policy 0, policy_version 1715506 (0.0007) [2023-12-28 07:35:23,588][106225] Updated weights for policy 1, policy_version 1719425 (0.0007) [2023-12-28 07:35:23,601][106226] Updated weights for policy 0, policy_version 1715516 (0.0007) [2023-12-28 07:35:23,656][106226] Updated weights for policy 0, policy_version 1715526 (0.0007) [2023-12-28 07:35:24,246][106225] Updated weights for policy 1, policy_version 1719435 (0.0006) [2023-12-28 07:35:24,303][106225] Updated weights for policy 1, policy_version 1719445 (0.0005) [2023-12-28 07:35:24,362][106225] Updated weights for policy 1, policy_version 1719455 (0.0005) [2023-12-28 07:35:24,421][106226] Updated weights for policy 0, policy_version 1715536 (0.0007) [2023-12-28 07:35:24,491][106226] Updated weights for policy 0, policy_version 1715546 (0.0009) [2023-12-28 07:35:24,550][106226] Updated weights for policy 0, policy_version 1715556 (0.0009) [2023-12-28 07:35:25,029][106225] Updated weights for policy 1, policy_version 1719465 (0.0007) [2023-12-28 07:35:25,088][106225] Updated weights for policy 1, policy_version 1719475 (0.0009) [2023-12-28 07:35:25,146][106225] Updated weights for policy 1, policy_version 1719485 (0.0008) [2023-12-28 07:35:25,190][106225] Updated weights for policy 1, policy_version 1719495 (0.0008) [2023-12-28 07:35:25,246][106226] Updated weights for policy 0, policy_version 1715566 (0.0009) [2023-12-28 07:35:25,301][106226] Updated weights for policy 0, policy_version 1715576 (0.0008) [2023-12-28 07:35:25,356][106226] Updated weights for policy 0, policy_version 1715586 (0.0008) [2023-12-28 07:35:25,933][106225] Updated weights for policy 1, policy_version 1719505 (0.0009) [2023-12-28 07:35:25,992][106225] Updated weights for policy 1, policy_version 1719515 (0.0008) [2023-12-28 07:35:26,057][106225] Updated weights for policy 1, policy_version 1719525 (0.0009) [2023-12-28 07:35:26,096][106226] Updated weights for policy 0, policy_version 1715596 (0.0008) [2023-12-28 07:35:26,161][106226] Updated weights for policy 0, policy_version 1715606 (0.0009) [2023-12-28 07:35:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 879525888. Throughput: 0: 9754.8, 1: 9751.6. Samples: 879496364. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:26,175][105115] Avg episode reward: [(0, '-4.448'), (1, '-4.776')] [2023-12-28 07:35:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001719528_440254464.pth... [2023-12-28 07:35:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001718376_439959552.pth [2023-12-28 07:35:26,226][106226] Updated weights for policy 0, policy_version 1715616 (0.0010) [2023-12-28 07:35:26,276][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001715624_439279616.pth... [2023-12-28 07:35:26,280][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001714472_438984704.pth [2023-12-28 07:35:26,740][106225] Updated weights for policy 1, policy_version 1719535 (0.0008) [2023-12-28 07:35:26,791][106225] Updated weights for policy 1, policy_version 1719545 (0.0005) [2023-12-28 07:35:26,836][106225] Updated weights for policy 1, policy_version 1719555 (0.0005) [2023-12-28 07:35:26,957][106226] Updated weights for policy 0, policy_version 1715626 (0.0009) [2023-12-28 07:35:27,014][106226] Updated weights for policy 0, policy_version 1715636 (0.0009) [2023-12-28 07:35:27,082][106226] Updated weights for policy 0, policy_version 1715646 (0.0010) [2023-12-28 07:35:27,132][106226] Updated weights for policy 0, policy_version 1715656 (0.0010) [2023-12-28 07:35:27,436][106225] Updated weights for policy 1, policy_version 1719565 (0.0009) [2023-12-28 07:35:27,486][106225] Updated weights for policy 1, policy_version 1719575 (0.0009) [2023-12-28 07:35:27,548][106225] Updated weights for policy 1, policy_version 1719585 (0.0009) [2023-12-28 07:35:27,728][106226] Updated weights for policy 0, policy_version 1715666 (0.0005) [2023-12-28 07:35:27,789][106226] Updated weights for policy 0, policy_version 1715676 (0.0005) [2023-12-28 07:35:27,847][106226] Updated weights for policy 0, policy_version 1715686 (0.0009) [2023-12-28 07:35:28,211][106225] Updated weights for policy 1, policy_version 1719595 (0.0007) [2023-12-28 07:35:28,257][106225] Updated weights for policy 1, policy_version 1719605 (0.0005) [2023-12-28 07:35:28,302][106225] Updated weights for policy 1, policy_version 1719615 (0.0005) [2023-12-28 07:35:28,468][106226] Updated weights for policy 0, policy_version 1715696 (0.0010) [2023-12-28 07:35:28,520][106226] Updated weights for policy 0, policy_version 1715706 (0.0010) [2023-12-28 07:35:28,581][106226] Updated weights for policy 0, policy_version 1715716 (0.0010) [2023-12-28 07:35:28,976][106225] Updated weights for policy 1, policy_version 1719625 (0.0007) [2023-12-28 07:35:29,039][106225] Updated weights for policy 1, policy_version 1719635 (0.0006) [2023-12-28 07:35:29,093][106225] Updated weights for policy 1, policy_version 1719645 (0.0006) [2023-12-28 07:35:29,150][106225] Updated weights for policy 1, policy_version 1719655 (0.0006) [2023-12-28 07:35:29,316][106226] Updated weights for policy 0, policy_version 1715726 (0.0011) [2023-12-28 07:35:29,389][106226] Updated weights for policy 0, policy_version 1715736 (0.0011) [2023-12-28 07:35:29,454][106226] Updated weights for policy 0, policy_version 1715746 (0.0011) [2023-12-28 07:35:29,776][106225] Updated weights for policy 1, policy_version 1719665 (0.0006) [2023-12-28 07:35:29,830][106225] Updated weights for policy 1, policy_version 1719675 (0.0008) [2023-12-28 07:35:29,901][106225] Updated weights for policy 1, policy_version 1719685 (0.0009) [2023-12-28 07:35:30,175][106226] Updated weights for policy 0, policy_version 1715756 (0.0011) [2023-12-28 07:35:30,241][106226] Updated weights for policy 0, policy_version 1715766 (0.0011) [2023-12-28 07:35:30,297][106226] Updated weights for policy 0, policy_version 1715776 (0.0011) [2023-12-28 07:35:30,530][106225] Updated weights for policy 1, policy_version 1719695 (0.0008) [2023-12-28 07:35:30,584][106225] Updated weights for policy 1, policy_version 1719705 (0.0006) [2023-12-28 07:35:30,635][106225] Updated weights for policy 1, policy_version 1719715 (0.0006) [2023-12-28 07:35:30,994][106226] Updated weights for policy 0, policy_version 1715786 (0.0010) [2023-12-28 07:35:31,055][106226] Updated weights for policy 0, policy_version 1715796 (0.0010) [2023-12-28 07:35:31,110][106226] Updated weights for policy 0, policy_version 1715806 (0.0010) [2023-12-28 07:35:31,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 879624192. Throughput: 0: 9804.3, 1: 9882.8. Samples: 879618744. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:31,175][105115] Avg episode reward: [(0, '-4.498'), (1, '-4.827')] [2023-12-28 07:35:31,179][106226] Updated weights for policy 0, policy_version 1715816 (0.0010) [2023-12-28 07:35:31,284][106225] Updated weights for policy 1, policy_version 1719725 (0.0007) [2023-12-28 07:35:31,351][106225] Updated weights for policy 1, policy_version 1719735 (0.0008) [2023-12-28 07:35:31,418][106225] Updated weights for policy 1, policy_version 1719745 (0.0007) [2023-12-28 07:35:31,946][106226] Updated weights for policy 0, policy_version 1715826 (0.0009) [2023-12-28 07:35:31,996][106226] Updated weights for policy 0, policy_version 1715836 (0.0008) [2023-12-28 07:35:32,051][106226] Updated weights for policy 0, policy_version 1715846 (0.0008) [2023-12-28 07:35:32,065][106225] Updated weights for policy 1, policy_version 1719755 (0.0006) [2023-12-28 07:35:32,125][106225] Updated weights for policy 1, policy_version 1719765 (0.0008) [2023-12-28 07:35:32,191][106225] Updated weights for policy 1, policy_version 1719775 (0.0008) [2023-12-28 07:35:32,759][106226] Updated weights for policy 0, policy_version 1715856 (0.0008) [2023-12-28 07:35:32,820][106226] Updated weights for policy 0, policy_version 1715866 (0.0009) [2023-12-28 07:35:32,881][106226] Updated weights for policy 0, policy_version 1715876 (0.0008) [2023-12-28 07:35:32,890][106225] Updated weights for policy 1, policy_version 1719785 (0.0009) [2023-12-28 07:35:32,936][106225] Updated weights for policy 1, policy_version 1719795 (0.0005) [2023-12-28 07:35:32,980][106225] Updated weights for policy 1, policy_version 1719805 (0.0005) [2023-12-28 07:35:33,026][106225] Updated weights for policy 1, policy_version 1719815 (0.0008) [2023-12-28 07:35:33,590][106226] Updated weights for policy 0, policy_version 1715886 (0.0007) [2023-12-28 07:35:33,648][106226] Updated weights for policy 0, policy_version 1715896 (0.0005) [2023-12-28 07:35:33,707][106226] Updated weights for policy 0, policy_version 1715906 (0.0006) [2023-12-28 07:35:33,763][106225] Updated weights for policy 1, policy_version 1719825 (0.0009) [2023-12-28 07:35:33,817][106225] Updated weights for policy 1, policy_version 1719835 (0.0008) [2023-12-28 07:35:33,870][106225] Updated weights for policy 1, policy_version 1719845 (0.0008) [2023-12-28 07:35:34,335][106226] Updated weights for policy 0, policy_version 1715916 (0.0009) [2023-12-28 07:35:34,392][106226] Updated weights for policy 0, policy_version 1715926 (0.0008) [2023-12-28 07:35:34,459][106226] Updated weights for policy 0, policy_version 1715936 (0.0009) [2023-12-28 07:35:34,647][106225] Updated weights for policy 1, policy_version 1719855 (0.0009) [2023-12-28 07:35:34,709][106225] Updated weights for policy 1, policy_version 1719865 (0.0008) [2023-12-28 07:35:34,772][106225] Updated weights for policy 1, policy_version 1719875 (0.0009) [2023-12-28 07:35:35,192][106226] Updated weights for policy 0, policy_version 1715946 (0.0008) [2023-12-28 07:35:35,242][106226] Updated weights for policy 0, policy_version 1715956 (0.0006) [2023-12-28 07:35:35,303][106226] Updated weights for policy 0, policy_version 1715966 (0.0008) [2023-12-28 07:35:35,369][106226] Updated weights for policy 0, policy_version 1715976 (0.0009) [2023-12-28 07:35:35,471][106225] Updated weights for policy 1, policy_version 1719885 (0.0007) [2023-12-28 07:35:35,533][106225] Updated weights for policy 1, policy_version 1719895 (0.0007) [2023-12-28 07:35:35,592][106225] Updated weights for policy 1, policy_version 1719905 (0.0008) [2023-12-28 07:35:35,992][106226] Updated weights for policy 0, policy_version 1715986 (0.0008) [2023-12-28 07:35:36,054][106226] Updated weights for policy 0, policy_version 1715996 (0.0009) [2023-12-28 07:35:36,114][106226] Updated weights for policy 0, policy_version 1716006 (0.0008) [2023-12-28 07:35:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 879730688. Throughput: 0: 9827.2, 1: 9931.4. Samples: 879737992. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:36,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.620')] [2023-12-28 07:35:36,328][106225] Updated weights for policy 1, policy_version 1719915 (0.0009) [2023-12-28 07:35:36,386][106225] Updated weights for policy 1, policy_version 1719925 (0.0008) [2023-12-28 07:35:36,446][106225] Updated weights for policy 1, policy_version 1719935 (0.0008) [2023-12-28 07:35:36,869][106226] Updated weights for policy 0, policy_version 1716016 (0.0008) [2023-12-28 07:35:36,933][106226] Updated weights for policy 0, policy_version 1716026 (0.0005) [2023-12-28 07:35:36,996][106226] Updated weights for policy 0, policy_version 1716036 (0.0007) [2023-12-28 07:35:37,185][106225] Updated weights for policy 1, policy_version 1719945 (0.0009) [2023-12-28 07:35:37,248][106225] Updated weights for policy 1, policy_version 1719955 (0.0006) [2023-12-28 07:35:37,302][106225] Updated weights for policy 1, policy_version 1719965 (0.0005) [2023-12-28 07:35:37,349][106225] Updated weights for policy 1, policy_version 1719975 (0.0005) [2023-12-28 07:35:37,682][106226] Updated weights for policy 0, policy_version 1716046 (0.0010) [2023-12-28 07:35:37,736][106226] Updated weights for policy 0, policy_version 1716056 (0.0008) [2023-12-28 07:35:37,787][106226] Updated weights for policy 0, policy_version 1716066 (0.0009) [2023-12-28 07:35:37,939][106225] Updated weights for policy 1, policy_version 1719985 (0.0007) [2023-12-28 07:35:37,992][106225] Updated weights for policy 1, policy_version 1719995 (0.0007) [2023-12-28 07:35:38,049][106225] Updated weights for policy 1, policy_version 1720005 (0.0008) [2023-12-28 07:35:38,581][106226] Updated weights for policy 0, policy_version 1716076 (0.0010) [2023-12-28 07:35:38,641][106226] Updated weights for policy 0, policy_version 1716086 (0.0011) [2023-12-28 07:35:38,692][106226] Updated weights for policy 0, policy_version 1716096 (0.0011) [2023-12-28 07:35:38,798][106225] Updated weights for policy 1, policy_version 1720015 (0.0007) [2023-12-28 07:35:38,857][106225] Updated weights for policy 1, policy_version 1720025 (0.0008) [2023-12-28 07:35:38,917][106225] Updated weights for policy 1, policy_version 1720035 (0.0008) [2023-12-28 07:35:39,385][106226] Updated weights for policy 0, policy_version 1716106 (0.0010) [2023-12-28 07:35:39,454][106226] Updated weights for policy 0, policy_version 1716116 (0.0008) [2023-12-28 07:35:39,511][106226] Updated weights for policy 0, policy_version 1716126 (0.0008) [2023-12-28 07:35:39,560][106226] Updated weights for policy 0, policy_version 1716136 (0.0008) [2023-12-28 07:35:39,573][106225] Updated weights for policy 1, policy_version 1720045 (0.0007) [2023-12-28 07:35:39,631][106225] Updated weights for policy 1, policy_version 1720055 (0.0008) [2023-12-28 07:35:39,686][106225] Updated weights for policy 1, policy_version 1720065 (0.0008) [2023-12-28 07:35:40,360][106226] Updated weights for policy 0, policy_version 1716146 (0.0009) [2023-12-28 07:35:40,423][106226] Updated weights for policy 0, policy_version 1716156 (0.0009) [2023-12-28 07:35:40,468][106225] Updated weights for policy 1, policy_version 1720075 (0.0008) [2023-12-28 07:35:40,486][106226] Updated weights for policy 0, policy_version 1716166 (0.0008) [2023-12-28 07:35:40,533][106225] Updated weights for policy 1, policy_version 1720085 (0.0008) [2023-12-28 07:35:40,599][106225] Updated weights for policy 1, policy_version 1720095 (0.0009) [2023-12-28 07:35:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.2, 300 sec: 19827.4). Total num frames: 879820800. Throughput: 0: 9807.3, 1: 9979.5. Samples: 879796240. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:41,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.860')] [2023-12-28 07:35:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001720104_440401920.pth... [2023-12-28 07:35:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001718952_440107008.pth [2023-12-28 07:35:41,209][106226] Updated weights for policy 0, policy_version 1716176 (0.0009) [2023-12-28 07:35:41,269][106226] Updated weights for policy 0, policy_version 1716186 (0.0008) [2023-12-28 07:35:41,333][106226] Updated weights for policy 0, policy_version 1716196 (0.0008) [2023-12-28 07:35:41,342][106225] Updated weights for policy 1, policy_version 1720105 (0.0009) [2023-12-28 07:35:41,360][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001716200_439427072.pth... [2023-12-28 07:35:41,365][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001715048_439132160.pth [2023-12-28 07:35:41,430][106225] Updated weights for policy 1, policy_version 1720115 (0.0008) [2023-12-28 07:35:41,499][106225] Updated weights for policy 1, policy_version 1720125 (0.0009) [2023-12-28 07:35:41,568][106225] Updated weights for policy 1, policy_version 1720135 (0.0009) [2023-12-28 07:35:42,062][106226] Updated weights for policy 0, policy_version 1716206 (0.0007) [2023-12-28 07:35:42,122][106226] Updated weights for policy 0, policy_version 1716216 (0.0008) [2023-12-28 07:35:42,185][106226] Updated weights for policy 0, policy_version 1716226 (0.0009) [2023-12-28 07:35:42,334][106225] Updated weights for policy 1, policy_version 1720145 (0.0008) [2023-12-28 07:35:42,403][106225] Updated weights for policy 1, policy_version 1720155 (0.0008) [2023-12-28 07:35:42,469][106225] Updated weights for policy 1, policy_version 1720165 (0.0008) [2023-12-28 07:35:42,876][106226] Updated weights for policy 0, policy_version 1716236 (0.0008) [2023-12-28 07:35:42,929][106226] Updated weights for policy 0, policy_version 1716246 (0.0009) [2023-12-28 07:35:42,990][106226] Updated weights for policy 0, policy_version 1716256 (0.0009) [2023-12-28 07:35:43,193][106225] Updated weights for policy 1, policy_version 1720175 (0.0006) [2023-12-28 07:35:43,247][106225] Updated weights for policy 1, policy_version 1720185 (0.0005) [2023-12-28 07:35:43,325][106225] Updated weights for policy 1, policy_version 1720195 (0.0005) [2023-12-28 07:35:43,706][106226] Updated weights for policy 0, policy_version 1716266 (0.0008) [2023-12-28 07:35:43,770][106226] Updated weights for policy 0, policy_version 1716276 (0.0009) [2023-12-28 07:35:43,833][106226] Updated weights for policy 0, policy_version 1716286 (0.0008) [2023-12-28 07:35:43,843][106225] Updated weights for policy 1, policy_version 1720205 (0.0005) [2023-12-28 07:35:43,889][106226] Updated weights for policy 0, policy_version 1716296 (0.0008) [2023-12-28 07:35:43,892][106225] Updated weights for policy 1, policy_version 1720215 (0.0006) [2023-12-28 07:35:43,949][106225] Updated weights for policy 1, policy_version 1720225 (0.0007) [2023-12-28 07:35:44,646][106225] Updated weights for policy 1, policy_version 1720235 (0.0007) [2023-12-28 07:35:44,648][106226] Updated weights for policy 0, policy_version 1716306 (0.0008) [2023-12-28 07:35:44,702][106225] Updated weights for policy 1, policy_version 1720245 (0.0006) [2023-12-28 07:35:44,710][106226] Updated weights for policy 0, policy_version 1716316 (0.0006) [2023-12-28 07:35:44,768][106225] Updated weights for policy 1, policy_version 1720255 (0.0007) [2023-12-28 07:35:44,776][106226] Updated weights for policy 0, policy_version 1716326 (0.0008) [2023-12-28 07:35:45,506][106225] Updated weights for policy 1, policy_version 1720265 (0.0008) [2023-12-28 07:35:45,511][106226] Updated weights for policy 0, policy_version 1716336 (0.0008) [2023-12-28 07:35:45,573][106225] Updated weights for policy 1, policy_version 1720275 (0.0007) [2023-12-28 07:35:45,578][106226] Updated weights for policy 0, policy_version 1716346 (0.0006) [2023-12-28 07:35:45,636][106225] Updated weights for policy 1, policy_version 1720285 (0.0005) [2023-12-28 07:35:45,638][106226] Updated weights for policy 0, policy_version 1716356 (0.0007) [2023-12-28 07:35:45,688][106225] Updated weights for policy 1, policy_version 1720295 (0.0005) [2023-12-28 07:35:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 879919104. Throughput: 0: 9727.3, 1: 9959.6. Samples: 879911260. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:46,175][105115] Avg episode reward: [(0, '-4.634'), (1, '-4.846')] [2023-12-28 07:35:46,325][106225] Updated weights for policy 1, policy_version 1720305 (0.0008) [2023-12-28 07:35:46,371][106226] Updated weights for policy 0, policy_version 1716366 (0.0008) [2023-12-28 07:35:46,388][106225] Updated weights for policy 1, policy_version 1720315 (0.0007) [2023-12-28 07:35:46,430][106226] Updated weights for policy 0, policy_version 1716376 (0.0006) [2023-12-28 07:35:46,444][106225] Updated weights for policy 1, policy_version 1720325 (0.0007) [2023-12-28 07:35:46,488][106226] Updated weights for policy 0, policy_version 1716386 (0.0007) [2023-12-28 07:35:47,198][106226] Updated weights for policy 0, policy_version 1716396 (0.0008) [2023-12-28 07:35:47,208][106225] Updated weights for policy 1, policy_version 1720335 (0.0008) [2023-12-28 07:35:47,249][106226] Updated weights for policy 0, policy_version 1716406 (0.0005) [2023-12-28 07:35:47,268][106225] Updated weights for policy 1, policy_version 1720345 (0.0008) [2023-12-28 07:35:47,302][106226] Updated weights for policy 0, policy_version 1716416 (0.0007) [2023-12-28 07:35:47,328][106225] Updated weights for policy 1, policy_version 1720355 (0.0009) [2023-12-28 07:35:48,007][106226] Updated weights for policy 0, policy_version 1716426 (0.0008) [2023-12-28 07:35:48,057][106225] Updated weights for policy 1, policy_version 1720365 (0.0008) [2023-12-28 07:35:48,063][106226] Updated weights for policy 0, policy_version 1716436 (0.0006) [2023-12-28 07:35:48,104][106225] Updated weights for policy 1, policy_version 1720375 (0.0005) [2023-12-28 07:35:48,117][106226] Updated weights for policy 0, policy_version 1716446 (0.0007) [2023-12-28 07:35:48,155][106225] Updated weights for policy 1, policy_version 1720385 (0.0007) [2023-12-28 07:35:48,178][106226] Updated weights for policy 0, policy_version 1716456 (0.0009) [2023-12-28 07:35:48,848][106226] Updated weights for policy 0, policy_version 1716466 (0.0007) [2023-12-28 07:35:48,905][106226] Updated weights for policy 0, policy_version 1716476 (0.0009) [2023-12-28 07:35:48,944][106225] Updated weights for policy 1, policy_version 1720395 (0.0008) [2023-12-28 07:35:48,972][106226] Updated weights for policy 0, policy_version 1716486 (0.0007) [2023-12-28 07:35:49,004][106225] Updated weights for policy 1, policy_version 1720405 (0.0008) [2023-12-28 07:35:49,067][106225] Updated weights for policy 1, policy_version 1720415 (0.0010) [2023-12-28 07:35:49,717][106226] Updated weights for policy 0, policy_version 1716496 (0.0008) [2023-12-28 07:35:49,766][106226] Updated weights for policy 0, policy_version 1716506 (0.0009) [2023-12-28 07:35:49,813][106225] Updated weights for policy 1, policy_version 1720425 (0.0008) [2023-12-28 07:35:49,824][106226] Updated weights for policy 0, policy_version 1716516 (0.0009) [2023-12-28 07:35:49,879][106225] Updated weights for policy 1, policy_version 1720435 (0.0007) [2023-12-28 07:35:49,944][106225] Updated weights for policy 1, policy_version 1720445 (0.0008) [2023-12-28 07:35:50,007][106225] Updated weights for policy 1, policy_version 1720455 (0.0006) [2023-12-28 07:35:50,595][106226] Updated weights for policy 0, policy_version 1716526 (0.0008) [2023-12-28 07:35:50,658][106226] Updated weights for policy 0, policy_version 1716536 (0.0009) [2023-12-28 07:35:50,720][106226] Updated weights for policy 0, policy_version 1716546 (0.0009) [2023-12-28 07:35:50,795][106225] Updated weights for policy 1, policy_version 1720465 (0.0008) [2023-12-28 07:35:50,851][106225] Updated weights for policy 1, policy_version 1720475 (0.0009) [2023-12-28 07:35:50,908][106225] Updated weights for policy 1, policy_version 1720485 (0.0008) [2023-12-28 07:35:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 880017408. Throughput: 0: 9729.0, 1: 9844.3. Samples: 880025244. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:51,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.801')] [2023-12-28 07:35:51,547][106226] Updated weights for policy 0, policy_version 1716556 (0.0009) [2023-12-28 07:35:51,611][106226] Updated weights for policy 0, policy_version 1716566 (0.0009) [2023-12-28 07:35:51,675][106226] Updated weights for policy 0, policy_version 1716576 (0.0008) [2023-12-28 07:35:51,696][106225] Updated weights for policy 1, policy_version 1720495 (0.0008) [2023-12-28 07:35:51,770][106225] Updated weights for policy 1, policy_version 1720505 (0.0011) [2023-12-28 07:35:51,831][106225] Updated weights for policy 1, policy_version 1720515 (0.0011) [2023-12-28 07:35:52,454][106225] Updated weights for policy 1, policy_version 1720525 (0.0010) [2023-12-28 07:35:52,481][106226] Updated weights for policy 0, policy_version 1716586 (0.0007) [2023-12-28 07:35:52,519][106225] Updated weights for policy 1, policy_version 1720535 (0.0010) [2023-12-28 07:35:52,541][106226] Updated weights for policy 0, policy_version 1716596 (0.0006) [2023-12-28 07:35:52,590][106225] Updated weights for policy 1, policy_version 1720545 (0.0011) [2023-12-28 07:35:52,605][106226] Updated weights for policy 0, policy_version 1716606 (0.0008) [2023-12-28 07:35:52,672][106226] Updated weights for policy 0, policy_version 1716616 (0.0006) [2023-12-28 07:35:53,252][106225] Updated weights for policy 1, policy_version 1720555 (0.0009) [2023-12-28 07:35:53,302][106225] Updated weights for policy 1, policy_version 1720565 (0.0010) [2023-12-28 07:35:53,359][106225] Updated weights for policy 1, policy_version 1720575 (0.0010) [2023-12-28 07:35:53,366][106226] Updated weights for policy 0, policy_version 1716626 (0.0006) [2023-12-28 07:35:53,431][106226] Updated weights for policy 0, policy_version 1716636 (0.0005) [2023-12-28 07:35:53,496][106226] Updated weights for policy 0, policy_version 1716646 (0.0006) [2023-12-28 07:35:54,015][106225] Updated weights for policy 1, policy_version 1720585 (0.0010) [2023-12-28 07:35:54,058][106226] Updated weights for policy 0, policy_version 1716656 (0.0009) [2023-12-28 07:35:54,064][106225] Updated weights for policy 1, policy_version 1720595 (0.0007) [2023-12-28 07:35:54,128][106226] Updated weights for policy 0, policy_version 1716666 (0.0011) [2023-12-28 07:35:54,128][106225] Updated weights for policy 1, policy_version 1720605 (0.0007) [2023-12-28 07:35:54,176][106225] Updated weights for policy 1, policy_version 1720615 (0.0007) [2023-12-28 07:35:54,194][106226] Updated weights for policy 0, policy_version 1716676 (0.0010) [2023-12-28 07:35:54,815][106225] Updated weights for policy 1, policy_version 1720625 (0.0006) [2023-12-28 07:35:54,863][106225] Updated weights for policy 1, policy_version 1720635 (0.0005) [2023-12-28 07:35:54,882][106226] Updated weights for policy 0, policy_version 1716686 (0.0010) [2023-12-28 07:35:54,919][106225] Updated weights for policy 1, policy_version 1720645 (0.0009) [2023-12-28 07:35:54,938][106226] Updated weights for policy 0, policy_version 1716696 (0.0010) [2023-12-28 07:35:54,988][106226] Updated weights for policy 0, policy_version 1716706 (0.0010) [2023-12-28 07:35:55,562][106225] Updated weights for policy 1, policy_version 1720655 (0.0007) [2023-12-28 07:35:55,610][106225] Updated weights for policy 1, policy_version 1720665 (0.0006) [2023-12-28 07:35:55,655][106225] Updated weights for policy 1, policy_version 1720675 (0.0005) [2023-12-28 07:35:55,716][106226] Updated weights for policy 0, policy_version 1716716 (0.0011) [2023-12-28 07:35:55,773][106226] Updated weights for policy 0, policy_version 1716726 (0.0010) [2023-12-28 07:35:55,825][106226] Updated weights for policy 0, policy_version 1716736 (0.0010) [2023-12-28 07:35:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 880115712. Throughput: 0: 9738.1, 1: 9791.6. Samples: 880084176. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:35:56,175][105115] Avg episode reward: [(0, '-4.281'), (1, '-4.998')] [2023-12-28 07:35:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001720680_440549376.pth... [2023-12-28 07:35:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001716744_439566336.pth... [2023-12-28 07:35:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001719528_440254464.pth [2023-12-28 07:35:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001715624_439279616.pth [2023-12-28 07:35:56,295][106225] Updated weights for policy 1, policy_version 1720685 (0.0005) [2023-12-28 07:35:56,361][106225] Updated weights for policy 1, policy_version 1720695 (0.0005) [2023-12-28 07:35:56,426][106225] Updated weights for policy 1, policy_version 1720705 (0.0005) [2023-12-28 07:35:56,552][106226] Updated weights for policy 0, policy_version 1716746 (0.0010) [2023-12-28 07:35:56,612][106226] Updated weights for policy 0, policy_version 1716756 (0.0010) [2023-12-28 07:35:56,680][106226] Updated weights for policy 0, policy_version 1716766 (0.0010) [2023-12-28 07:35:56,744][106226] Updated weights for policy 0, policy_version 1716776 (0.0011) [2023-12-28 07:35:56,983][106225] Updated weights for policy 1, policy_version 1720715 (0.0007) [2023-12-28 07:35:57,038][106225] Updated weights for policy 1, policy_version 1720725 (0.0010) [2023-12-28 07:35:57,096][106225] Updated weights for policy 1, policy_version 1720735 (0.0010) [2023-12-28 07:35:57,375][106226] Updated weights for policy 0, policy_version 1716786 (0.0006) [2023-12-28 07:35:57,424][106226] Updated weights for policy 0, policy_version 1716796 (0.0008) [2023-12-28 07:35:57,477][106226] Updated weights for policy 0, policy_version 1716806 (0.0010) [2023-12-28 07:35:57,700][106225] Updated weights for policy 1, policy_version 1720745 (0.0009) [2023-12-28 07:35:57,764][106225] Updated weights for policy 1, policy_version 1720755 (0.0008) [2023-12-28 07:35:57,816][106225] Updated weights for policy 1, policy_version 1720765 (0.0008) [2023-12-28 07:35:57,873][106225] Updated weights for policy 1, policy_version 1720775 (0.0008) [2023-12-28 07:35:58,160][106226] Updated weights for policy 0, policy_version 1716816 (0.0009) [2023-12-28 07:35:58,211][106226] Updated weights for policy 0, policy_version 1716826 (0.0008) [2023-12-28 07:35:58,276][106226] Updated weights for policy 0, policy_version 1716836 (0.0011) [2023-12-28 07:35:58,618][106225] Updated weights for policy 1, policy_version 1720785 (0.0008) [2023-12-28 07:35:58,686][106225] Updated weights for policy 1, policy_version 1720795 (0.0011) [2023-12-28 07:35:58,750][106225] Updated weights for policy 1, policy_version 1720805 (0.0010) [2023-12-28 07:35:59,096][106226] Updated weights for policy 0, policy_version 1716846 (0.0009) [2023-12-28 07:35:59,164][106226] Updated weights for policy 0, policy_version 1716856 (0.0006) [2023-12-28 07:35:59,236][106226] Updated weights for policy 0, policy_version 1716866 (0.0008) [2023-12-28 07:35:59,512][106225] Updated weights for policy 1, policy_version 1720815 (0.0008) [2023-12-28 07:35:59,565][106225] Updated weights for policy 1, policy_version 1720825 (0.0009) [2023-12-28 07:35:59,618][106225] Updated weights for policy 1, policy_version 1720835 (0.0007) [2023-12-28 07:35:59,965][106226] Updated weights for policy 0, policy_version 1716876 (0.0008) [2023-12-28 07:36:00,024][106226] Updated weights for policy 0, policy_version 1716886 (0.0008) [2023-12-28 07:36:00,075][106226] Updated weights for policy 0, policy_version 1716896 (0.0008) [2023-12-28 07:36:00,308][106225] Updated weights for policy 1, policy_version 1720845 (0.0008) [2023-12-28 07:36:00,361][106225] Updated weights for policy 1, policy_version 1720855 (0.0010) [2023-12-28 07:36:00,411][106225] Updated weights for policy 1, policy_version 1720865 (0.0010) [2023-12-28 07:36:00,831][106226] Updated weights for policy 0, policy_version 1716906 (0.0007) [2023-12-28 07:36:00,883][106226] Updated weights for policy 0, policy_version 1716916 (0.0005) [2023-12-28 07:36:00,947][106226] Updated weights for policy 0, policy_version 1716926 (0.0006) [2023-12-28 07:36:01,011][106226] Updated weights for policy 0, policy_version 1716936 (0.0008) [2023-12-28 07:36:01,146][106225] Updated weights for policy 1, policy_version 1720875 (0.0009) [2023-12-28 07:36:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 880214016. Throughput: 0: 9682.1, 1: 9968.3. Samples: 880203908. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:36:01,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.974')] [2023-12-28 07:36:01,212][106225] Updated weights for policy 1, policy_version 1720885 (0.0009) [2023-12-28 07:36:01,277][106225] Updated weights for policy 1, policy_version 1720895 (0.0008) [2023-12-28 07:36:01,680][106226] Updated weights for policy 0, policy_version 1716946 (0.0009) [2023-12-28 07:36:01,748][106226] Updated weights for policy 0, policy_version 1716956 (0.0008) [2023-12-28 07:36:01,807][106226] Updated weights for policy 0, policy_version 1716966 (0.0008) [2023-12-28 07:36:02,020][106225] Updated weights for policy 1, policy_version 1720905 (0.0010) [2023-12-28 07:36:02,079][106225] Updated weights for policy 1, policy_version 1720915 (0.0010) [2023-12-28 07:36:02,143][106225] Updated weights for policy 1, policy_version 1720925 (0.0010) [2023-12-28 07:36:02,203][106225] Updated weights for policy 1, policy_version 1720935 (0.0010) [2023-12-28 07:36:02,442][106226] Updated weights for policy 0, policy_version 1716976 (0.0010) [2023-12-28 07:36:02,496][106226] Updated weights for policy 0, policy_version 1716986 (0.0010) [2023-12-28 07:36:02,552][106226] Updated weights for policy 0, policy_version 1716996 (0.0010) [2023-12-28 07:36:02,893][106225] Updated weights for policy 1, policy_version 1720945 (0.0010) [2023-12-28 07:36:02,943][106225] Updated weights for policy 1, policy_version 1720955 (0.0010) [2023-12-28 07:36:03,002][106225] Updated weights for policy 1, policy_version 1720965 (0.0010) [2023-12-28 07:36:03,259][106226] Updated weights for policy 0, policy_version 1717006 (0.0009) [2023-12-28 07:36:03,303][106226] Updated weights for policy 0, policy_version 1717016 (0.0005) [2023-12-28 07:36:03,350][106226] Updated weights for policy 0, policy_version 1717026 (0.0005) [2023-12-28 07:36:03,679][106225] Updated weights for policy 1, policy_version 1720975 (0.0008) [2023-12-28 07:36:03,729][106225] Updated weights for policy 1, policy_version 1720985 (0.0010) [2023-12-28 07:36:03,775][106225] Updated weights for policy 1, policy_version 1720995 (0.0010) [2023-12-28 07:36:03,977][106226] Updated weights for policy 0, policy_version 1717036 (0.0006) [2023-12-28 07:36:04,042][106226] Updated weights for policy 0, policy_version 1717046 (0.0008) [2023-12-28 07:36:04,105][106226] Updated weights for policy 0, policy_version 1717056 (0.0008) [2023-12-28 07:36:04,509][106225] Updated weights for policy 1, policy_version 1721005 (0.0010) [2023-12-28 07:36:04,569][106225] Updated weights for policy 1, policy_version 1721015 (0.0010) [2023-12-28 07:36:04,640][106225] Updated weights for policy 1, policy_version 1721025 (0.0006) [2023-12-28 07:36:04,839][106226] Updated weights for policy 0, policy_version 1717066 (0.0009) [2023-12-28 07:36:04,885][106226] Updated weights for policy 0, policy_version 1717076 (0.0005) [2023-12-28 07:36:04,932][106226] Updated weights for policy 0, policy_version 1717086 (0.0005) [2023-12-28 07:36:04,985][106226] Updated weights for policy 0, policy_version 1717096 (0.0005) [2023-12-28 07:36:05,219][106225] Updated weights for policy 1, policy_version 1721035 (0.0007) [2023-12-28 07:36:05,272][106225] Updated weights for policy 1, policy_version 1721045 (0.0007) [2023-12-28 07:36:05,320][106225] Updated weights for policy 1, policy_version 1721055 (0.0005) [2023-12-28 07:36:05,684][106226] Updated weights for policy 0, policy_version 1717106 (0.0011) [2023-12-28 07:36:05,746][106226] Updated weights for policy 0, policy_version 1717116 (0.0010) [2023-12-28 07:36:05,807][106226] Updated weights for policy 0, policy_version 1717126 (0.0011) [2023-12-28 07:36:06,001][106225] Updated weights for policy 1, policy_version 1721065 (0.0006) [2023-12-28 07:36:06,056][106225] Updated weights for policy 1, policy_version 1721075 (0.0010) [2023-12-28 07:36:06,120][106225] Updated weights for policy 1, policy_version 1721085 (0.0010) [2023-12-28 07:36:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 880312320. Throughput: 0: 9711.0, 1: 9990.2. Samples: 880325700. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:36:06,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.891')] [2023-12-28 07:36:06,184][106225] Updated weights for policy 1, policy_version 1721095 (0.0012) [2023-12-28 07:36:06,520][106226] Updated weights for policy 0, policy_version 1717136 (0.0011) [2023-12-28 07:36:06,588][106226] Updated weights for policy 0, policy_version 1717146 (0.0011) [2023-12-28 07:36:06,642][106226] Updated weights for policy 0, policy_version 1717156 (0.0010) [2023-12-28 07:36:06,906][106225] Updated weights for policy 1, policy_version 1721105 (0.0010) [2023-12-28 07:36:06,953][106225] Updated weights for policy 1, policy_version 1721115 (0.0010) [2023-12-28 07:36:07,016][106225] Updated weights for policy 1, policy_version 1721125 (0.0010) [2023-12-28 07:36:07,347][106226] Updated weights for policy 0, policy_version 1717166 (0.0011) [2023-12-28 07:36:07,415][106226] Updated weights for policy 0, policy_version 1717176 (0.0011) [2023-12-28 07:36:07,482][106226] Updated weights for policy 0, policy_version 1717186 (0.0011) [2023-12-28 07:36:07,643][106225] Updated weights for policy 1, policy_version 1721135 (0.0007) [2023-12-28 07:36:07,700][106225] Updated weights for policy 1, policy_version 1721145 (0.0005) [2023-12-28 07:36:07,761][106225] Updated weights for policy 1, policy_version 1721155 (0.0005) [2023-12-28 07:36:08,173][106226] Updated weights for policy 0, policy_version 1717196 (0.0010) [2023-12-28 07:36:08,224][106226] Updated weights for policy 0, policy_version 1717206 (0.0011) [2023-12-28 07:36:08,272][106226] Updated weights for policy 0, policy_version 1717216 (0.0006) [2023-12-28 07:36:08,406][106225] Updated weights for policy 1, policy_version 1721165 (0.0007) [2023-12-28 07:36:08,470][106225] Updated weights for policy 1, policy_version 1721175 (0.0008) [2023-12-28 07:36:08,528][106225] Updated weights for policy 1, policy_version 1721185 (0.0008) [2023-12-28 07:36:09,026][106226] Updated weights for policy 0, policy_version 1717226 (0.0009) [2023-12-28 07:36:09,090][106226] Updated weights for policy 0, policy_version 1717236 (0.0010) [2023-12-28 07:36:09,147][106226] Updated weights for policy 0, policy_version 1717246 (0.0011) [2023-12-28 07:36:09,206][106226] Updated weights for policy 0, policy_version 1717256 (0.0011) [2023-12-28 07:36:09,227][106225] Updated weights for policy 1, policy_version 1721195 (0.0010) [2023-12-28 07:36:09,286][106225] Updated weights for policy 1, policy_version 1721205 (0.0007) [2023-12-28 07:36:09,355][106225] Updated weights for policy 1, policy_version 1721215 (0.0010) [2023-12-28 07:36:09,996][106226] Updated weights for policy 0, policy_version 1717266 (0.0006) [2023-12-28 07:36:10,068][106226] Updated weights for policy 0, policy_version 1717276 (0.0006) [2023-12-28 07:36:10,126][106225] Updated weights for policy 1, policy_version 1721225 (0.0013) [2023-12-28 07:36:10,139][106226] Updated weights for policy 0, policy_version 1717286 (0.0007) [2023-12-28 07:36:10,187][106225] Updated weights for policy 1, policy_version 1721235 (0.0010) [2023-12-28 07:36:10,251][106225] Updated weights for policy 1, policy_version 1721245 (0.0010) [2023-12-28 07:36:10,315][106225] Updated weights for policy 1, policy_version 1721255 (0.0007) [2023-12-28 07:36:10,823][106226] Updated weights for policy 0, policy_version 1717296 (0.0009) [2023-12-28 07:36:10,877][106226] Updated weights for policy 0, policy_version 1717306 (0.0007) [2023-12-28 07:36:10,893][106225] Updated weights for policy 1, policy_version 1721265 (0.0007) [2023-12-28 07:36:10,936][106226] Updated weights for policy 0, policy_version 1717316 (0.0006) [2023-12-28 07:36:10,957][106225] Updated weights for policy 1, policy_version 1721275 (0.0009) [2023-12-28 07:36:11,019][106225] Updated weights for policy 1, policy_version 1721285 (0.0009) [2023-12-28 07:36:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 880418816. Throughput: 0: 9724.2, 1: 10030.7. Samples: 880385332. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:36:11,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.046')] [2023-12-28 07:36:11,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001717320_439713792.pth... [2023-12-28 07:36:11,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001721288_440705024.pth... [2023-12-28 07:36:11,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001720104_440401920.pth [2023-12-28 07:36:11,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001716200_439427072.pth [2023-12-28 07:36:11,732][106226] Updated weights for policy 0, policy_version 1717326 (0.0007) [2023-12-28 07:36:11,746][106225] Updated weights for policy 1, policy_version 1721295 (0.0008) [2023-12-28 07:36:11,799][106226] Updated weights for policy 0, policy_version 1717336 (0.0007) [2023-12-28 07:36:11,811][106225] Updated weights for policy 1, policy_version 1721305 (0.0008) [2023-12-28 07:36:11,861][106226] Updated weights for policy 0, policy_version 1717346 (0.0007) [2023-12-28 07:36:11,873][106225] Updated weights for policy 1, policy_version 1721315 (0.0009) [2023-12-28 07:36:12,604][106226] Updated weights for policy 0, policy_version 1717356 (0.0008) [2023-12-28 07:36:12,623][106225] Updated weights for policy 1, policy_version 1721325 (0.0008) [2023-12-28 07:36:12,679][106226] Updated weights for policy 0, policy_version 1717366 (0.0008) [2023-12-28 07:36:12,682][106225] Updated weights for policy 1, policy_version 1721335 (0.0007) [2023-12-28 07:36:12,734][106225] Updated weights for policy 1, policy_version 1721345 (0.0006) [2023-12-28 07:36:12,739][106226] Updated weights for policy 0, policy_version 1717376 (0.0006) [2023-12-28 07:36:13,310][106226] Updated weights for policy 0, policy_version 1717386 (0.0007) [2023-12-28 07:36:13,371][106225] Updated weights for policy 1, policy_version 1721355 (0.0006) [2023-12-28 07:36:13,373][106226] Updated weights for policy 0, policy_version 1717396 (0.0009) [2023-12-28 07:36:13,429][106226] Updated weights for policy 0, policy_version 1717406 (0.0008) [2023-12-28 07:36:13,432][106225] Updated weights for policy 1, policy_version 1721365 (0.0008) [2023-12-28 07:36:13,480][106226] Updated weights for policy 0, policy_version 1717416 (0.0007) [2023-12-28 07:36:13,486][106225] Updated weights for policy 1, policy_version 1721375 (0.0006) [2023-12-28 07:36:14,145][106226] Updated weights for policy 0, policy_version 1717426 (0.0009) [2023-12-28 07:36:14,153][106225] Updated weights for policy 1, policy_version 1721385 (0.0008) [2023-12-28 07:36:14,196][106226] Updated weights for policy 0, policy_version 1717436 (0.0006) [2023-12-28 07:36:14,220][106225] Updated weights for policy 1, policy_version 1721395 (0.0008) [2023-12-28 07:36:14,251][106226] Updated weights for policy 0, policy_version 1717446 (0.0010) [2023-12-28 07:36:14,277][106225] Updated weights for policy 1, policy_version 1721405 (0.0007) [2023-12-28 07:36:14,336][106225] Updated weights for policy 1, policy_version 1721415 (0.0009) [2023-12-28 07:36:15,010][106226] Updated weights for policy 0, policy_version 1717456 (0.0010) [2023-12-28 07:36:15,075][106226] Updated weights for policy 0, policy_version 1717466 (0.0007) [2023-12-28 07:36:15,105][106225] Updated weights for policy 1, policy_version 1721425 (0.0006) [2023-12-28 07:36:15,135][106226] Updated weights for policy 0, policy_version 1717476 (0.0010) [2023-12-28 07:36:15,164][106225] Updated weights for policy 1, policy_version 1721435 (0.0006) [2023-12-28 07:36:15,217][106225] Updated weights for policy 1, policy_version 1721445 (0.0008) [2023-12-28 07:36:15,825][106226] Updated weights for policy 0, policy_version 1717486 (0.0008) [2023-12-28 07:36:15,876][106226] Updated weights for policy 0, policy_version 1717496 (0.0007) [2023-12-28 07:36:15,904][106225] Updated weights for policy 1, policy_version 1721455 (0.0006) [2023-12-28 07:36:15,935][106226] Updated weights for policy 0, policy_version 1717506 (0.0006) [2023-12-28 07:36:15,950][106225] Updated weights for policy 1, policy_version 1721465 (0.0005) [2023-12-28 07:36:16,009][106225] Updated weights for policy 1, policy_version 1721475 (0.0006) [2023-12-28 07:36:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 880517120. Throughput: 0: 9693.3, 1: 9948.5. Samples: 880502620. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 07:36:16,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-5.005')] [2023-12-28 07:36:16,518][106226] Updated weights for policy 0, policy_version 1717516 (0.0006) [2023-12-28 07:36:16,574][106226] Updated weights for policy 0, policy_version 1717526 (0.0007) [2023-12-28 07:36:16,627][106226] Updated weights for policy 0, policy_version 1717536 (0.0008) [2023-12-28 07:36:16,725][106225] Updated weights for policy 1, policy_version 1721485 (0.0007) [2023-12-28 07:36:16,779][106225] Updated weights for policy 1, policy_version 1721495 (0.0007) [2023-12-28 07:36:16,835][106225] Updated weights for policy 1, policy_version 1721505 (0.0010) [2023-12-28 07:36:17,347][106226] Updated weights for policy 0, policy_version 1717546 (0.0008) [2023-12-28 07:36:17,398][106226] Updated weights for policy 0, policy_version 1717556 (0.0007) [2023-12-28 07:36:17,444][106226] Updated weights for policy 0, policy_version 1717566 (0.0008) [2023-12-28 07:36:17,498][106226] Updated weights for policy 0, policy_version 1717576 (0.0008) [2023-12-28 07:36:17,563][106225] Updated weights for policy 1, policy_version 1721515 (0.0010) [2023-12-28 07:36:17,620][106225] Updated weights for policy 1, policy_version 1721525 (0.0010) [2023-12-28 07:36:17,677][106225] Updated weights for policy 1, policy_version 1721535 (0.0010) [2023-12-28 07:36:18,143][106226] Updated weights for policy 0, policy_version 1717586 (0.0008) [2023-12-28 07:36:18,200][106226] Updated weights for policy 0, policy_version 1717596 (0.0008) [2023-12-28 07:36:18,246][106226] Updated weights for policy 0, policy_version 1717606 (0.0008) [2023-12-28 07:36:18,409][106225] Updated weights for policy 1, policy_version 1721545 (0.0010) [2023-12-28 07:36:18,471][106225] Updated weights for policy 1, policy_version 1721555 (0.0010) [2023-12-28 07:36:18,528][106225] Updated weights for policy 1, policy_version 1721565 (0.0010) [2023-12-28 07:36:18,594][106225] Updated weights for policy 1, policy_version 1721575 (0.0010) [2023-12-28 07:36:19,016][106226] Updated weights for policy 0, policy_version 1717616 (0.0008) [2023-12-28 07:36:19,077][106226] Updated weights for policy 0, policy_version 1717626 (0.0008) [2023-12-28 07:36:19,129][106226] Updated weights for policy 0, policy_version 1717636 (0.0007) [2023-12-28 07:36:19,317][106225] Updated weights for policy 1, policy_version 1721585 (0.0010) [2023-12-28 07:36:19,382][106225] Updated weights for policy 1, policy_version 1721595 (0.0009) [2023-12-28 07:36:19,447][106225] Updated weights for policy 1, policy_version 1721605 (0.0010) [2023-12-28 07:36:19,850][106226] Updated weights for policy 0, policy_version 1717646 (0.0008) [2023-12-28 07:36:19,918][106226] Updated weights for policy 0, policy_version 1717656 (0.0007) [2023-12-28 07:36:19,986][106226] Updated weights for policy 0, policy_version 1717666 (0.0007) [2023-12-28 07:36:20,244][106225] Updated weights for policy 1, policy_version 1721615 (0.0007) [2023-12-28 07:36:20,316][106225] Updated weights for policy 1, policy_version 1721625 (0.0006) [2023-12-28 07:36:20,383][106225] Updated weights for policy 1, policy_version 1721635 (0.0009) [2023-12-28 07:36:20,773][106226] Updated weights for policy 0, policy_version 1717676 (0.0008) [2023-12-28 07:36:20,828][106226] Updated weights for policy 0, policy_version 1717686 (0.0009) [2023-12-28 07:36:20,883][106226] Updated weights for policy 0, policy_version 1717696 (0.0008) [2023-12-28 07:36:20,955][106225] Updated weights for policy 1, policy_version 1721645 (0.0011) [2023-12-28 07:36:21,020][106225] Updated weights for policy 1, policy_version 1721655 (0.0010) [2023-12-28 07:36:21,089][106225] Updated weights for policy 1, policy_version 1721665 (0.0009) [2023-12-28 07:36:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 880615424. Throughput: 0: 9678.1, 1: 9913.4. Samples: 880619612. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:21,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.718')] [2023-12-28 07:36:21,728][106226] Updated weights for policy 0, policy_version 1717706 (0.0008) [2023-12-28 07:36:21,801][106226] Updated weights for policy 0, policy_version 1717716 (0.0006) [2023-12-28 07:36:21,840][106225] Updated weights for policy 1, policy_version 1721675 (0.0008) [2023-12-28 07:36:21,872][106226] Updated weights for policy 0, policy_version 1717726 (0.0008) [2023-12-28 07:36:21,908][106225] Updated weights for policy 1, policy_version 1721685 (0.0011) [2023-12-28 07:36:21,938][106226] Updated weights for policy 0, policy_version 1717736 (0.0008) [2023-12-28 07:36:21,974][106225] Updated weights for policy 1, policy_version 1721695 (0.0007) [2023-12-28 07:36:22,718][106226] Updated weights for policy 0, policy_version 1717746 (0.0005) [2023-12-28 07:36:22,742][106225] Updated weights for policy 1, policy_version 1721705 (0.0008) [2023-12-28 07:36:22,781][106226] Updated weights for policy 0, policy_version 1717756 (0.0008) [2023-12-28 07:36:22,807][106225] Updated weights for policy 1, policy_version 1721715 (0.0006) [2023-12-28 07:36:22,841][106226] Updated weights for policy 0, policy_version 1717766 (0.0008) [2023-12-28 07:36:22,869][106225] Updated weights for policy 1, policy_version 1721725 (0.0006) [2023-12-28 07:36:22,925][106225] Updated weights for policy 1, policy_version 1721735 (0.0006) [2023-12-28 07:36:23,555][106226] Updated weights for policy 0, policy_version 1717776 (0.0010) [2023-12-28 07:36:23,608][106225] Updated weights for policy 1, policy_version 1721745 (0.0006) [2023-12-28 07:36:23,608][106226] Updated weights for policy 0, policy_version 1717786 (0.0010) [2023-12-28 07:36:23,671][106225] Updated weights for policy 1, policy_version 1721755 (0.0008) [2023-12-28 07:36:23,674][106226] Updated weights for policy 0, policy_version 1717796 (0.0010) [2023-12-28 07:36:23,725][106225] Updated weights for policy 1, policy_version 1721765 (0.0007) [2023-12-28 07:36:24,339][106226] Updated weights for policy 0, policy_version 1717806 (0.0008) [2023-12-28 07:36:24,407][106226] Updated weights for policy 0, policy_version 1717816 (0.0006) [2023-12-28 07:36:24,461][106225] Updated weights for policy 1, policy_version 1721775 (0.0008) [2023-12-28 07:36:24,470][106226] Updated weights for policy 0, policy_version 1717826 (0.0008) [2023-12-28 07:36:24,507][106225] Updated weights for policy 1, policy_version 1721785 (0.0007) [2023-12-28 07:36:24,565][106225] Updated weights for policy 1, policy_version 1721795 (0.0008) [2023-12-28 07:36:25,056][106226] Updated weights for policy 0, policy_version 1717836 (0.0010) [2023-12-28 07:36:25,106][106226] Updated weights for policy 0, policy_version 1717846 (0.0010) [2023-12-28 07:36:25,166][106226] Updated weights for policy 0, policy_version 1717856 (0.0011) [2023-12-28 07:36:25,325][106225] Updated weights for policy 1, policy_version 1721805 (0.0007) [2023-12-28 07:36:25,370][106225] Updated weights for policy 1, policy_version 1721815 (0.0005) [2023-12-28 07:36:25,413][106225] Updated weights for policy 1, policy_version 1721825 (0.0005) [2023-12-28 07:36:25,887][106226] Updated weights for policy 0, policy_version 1717866 (0.0011) [2023-12-28 07:36:25,946][106226] Updated weights for policy 0, policy_version 1717876 (0.0010) [2023-12-28 07:36:26,003][106226] Updated weights for policy 0, policy_version 1717886 (0.0010) [2023-12-28 07:36:26,012][106225] Updated weights for policy 1, policy_version 1721835 (0.0005) [2023-12-28 07:36:26,056][106226] Updated weights for policy 0, policy_version 1717896 (0.0010) [2023-12-28 07:36:26,063][106225] Updated weights for policy 1, policy_version 1721845 (0.0005) [2023-12-28 07:36:26,122][106225] Updated weights for policy 1, policy_version 1721855 (0.0008) [2023-12-28 07:36:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 880713728. Throughput: 0: 9663.3, 1: 9881.2. Samples: 880675740. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:26,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.944')] [2023-12-28 07:36:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001721864_440852480.pth... [2023-12-28 07:36:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001717896_439861248.pth... [2023-12-28 07:36:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001720680_440549376.pth [2023-12-28 07:36:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001716744_439566336.pth [2023-12-28 07:36:26,657][106225] Updated weights for policy 1, policy_version 1721865 (0.0007) [2023-12-28 07:36:26,714][106225] Updated weights for policy 1, policy_version 1721875 (0.0009) [2023-12-28 07:36:26,778][106225] Updated weights for policy 1, policy_version 1721885 (0.0005) [2023-12-28 07:36:26,815][106226] Updated weights for policy 0, policy_version 1717906 (0.0010) [2023-12-28 07:36:26,837][106225] Updated weights for policy 1, policy_version 1721895 (0.0005) [2023-12-28 07:36:26,875][106226] Updated weights for policy 0, policy_version 1717916 (0.0010) [2023-12-28 07:36:26,933][106226] Updated weights for policy 0, policy_version 1717926 (0.0011) [2023-12-28 07:36:27,398][106225] Updated weights for policy 1, policy_version 1721905 (0.0005) [2023-12-28 07:36:27,454][106225] Updated weights for policy 1, policy_version 1721915 (0.0005) [2023-12-28 07:36:27,497][106225] Updated weights for policy 1, policy_version 1721925 (0.0005) [2023-12-28 07:36:27,653][106226] Updated weights for policy 0, policy_version 1717936 (0.0010) [2023-12-28 07:36:27,716][106226] Updated weights for policy 0, policy_version 1717946 (0.0010) [2023-12-28 07:36:27,763][106226] Updated weights for policy 0, policy_version 1717956 (0.0009) [2023-12-28 07:36:28,050][106225] Updated weights for policy 1, policy_version 1721935 (0.0009) [2023-12-28 07:36:28,100][106225] Updated weights for policy 1, policy_version 1721945 (0.0010) [2023-12-28 07:36:28,156][106225] Updated weights for policy 1, policy_version 1721955 (0.0010) [2023-12-28 07:36:28,476][106226] Updated weights for policy 0, policy_version 1717966 (0.0009) [2023-12-28 07:36:28,526][106226] Updated weights for policy 0, policy_version 1717976 (0.0010) [2023-12-28 07:36:28,579][106226] Updated weights for policy 0, policy_version 1717986 (0.0010) [2023-12-28 07:36:28,845][106225] Updated weights for policy 1, policy_version 1721965 (0.0010) [2023-12-28 07:36:28,894][106225] Updated weights for policy 1, policy_version 1721975 (0.0007) [2023-12-28 07:36:28,957][106225] Updated weights for policy 1, policy_version 1721985 (0.0010) [2023-12-28 07:36:29,253][106226] Updated weights for policy 0, policy_version 1717996 (0.0010) [2023-12-28 07:36:29,320][106226] Updated weights for policy 0, policy_version 1718006 (0.0006) [2023-12-28 07:36:29,389][106226] Updated weights for policy 0, policy_version 1718016 (0.0007) [2023-12-28 07:36:29,662][106225] Updated weights for policy 1, policy_version 1721995 (0.0010) [2023-12-28 07:36:29,721][106225] Updated weights for policy 1, policy_version 1722005 (0.0007) [2023-12-28 07:36:29,789][106225] Updated weights for policy 1, policy_version 1722015 (0.0005) [2023-12-28 07:36:30,109][106226] Updated weights for policy 0, policy_version 1718026 (0.0008) [2023-12-28 07:36:30,166][106226] Updated weights for policy 0, policy_version 1718036 (0.0009) [2023-12-28 07:36:30,233][106226] Updated weights for policy 0, policy_version 1718046 (0.0006) [2023-12-28 07:36:30,290][106226] Updated weights for policy 0, policy_version 1718056 (0.0007) [2023-12-28 07:36:30,427][106225] Updated weights for policy 1, policy_version 1722025 (0.0007) [2023-12-28 07:36:30,492][106225] Updated weights for policy 1, policy_version 1722035 (0.0006) [2023-12-28 07:36:30,552][106225] Updated weights for policy 1, policy_version 1722045 (0.0008) [2023-12-28 07:36:30,614][106225] Updated weights for policy 1, policy_version 1722055 (0.0007) [2023-12-28 07:36:30,923][106226] Updated weights for policy 0, policy_version 1718066 (0.0010) [2023-12-28 07:36:30,982][106226] Updated weights for policy 0, policy_version 1718076 (0.0010) [2023-12-28 07:36:31,040][106226] Updated weights for policy 0, policy_version 1718086 (0.0009) [2023-12-28 07:36:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 880812032. Throughput: 0: 9748.4, 1: 10012.9. Samples: 880800520. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:31,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.875')] [2023-12-28 07:36:31,367][106225] Updated weights for policy 1, policy_version 1722065 (0.0007) [2023-12-28 07:36:31,421][106225] Updated weights for policy 1, policy_version 1722075 (0.0007) [2023-12-28 07:36:31,465][106225] Updated weights for policy 1, policy_version 1722085 (0.0005) [2023-12-28 07:36:31,742][106226] Updated weights for policy 0, policy_version 1718096 (0.0009) [2023-12-28 07:36:31,794][106226] Updated weights for policy 0, policy_version 1718106 (0.0008) [2023-12-28 07:36:31,845][106226] Updated weights for policy 0, policy_version 1718116 (0.0008) [2023-12-28 07:36:32,132][106225] Updated weights for policy 1, policy_version 1722095 (0.0005) [2023-12-28 07:36:32,183][106225] Updated weights for policy 1, policy_version 1722105 (0.0007) [2023-12-28 07:36:32,242][106225] Updated weights for policy 1, policy_version 1722115 (0.0008) [2023-12-28 07:36:32,604][106226] Updated weights for policy 0, policy_version 1718126 (0.0008) [2023-12-28 07:36:32,666][106226] Updated weights for policy 0, policy_version 1718136 (0.0007) [2023-12-28 07:36:32,715][106226] Updated weights for policy 0, policy_version 1718146 (0.0006) [2023-12-28 07:36:32,926][106225] Updated weights for policy 1, policy_version 1722125 (0.0009) [2023-12-28 07:36:32,983][106225] Updated weights for policy 1, policy_version 1722135 (0.0008) [2023-12-28 07:36:33,041][106225] Updated weights for policy 1, policy_version 1722145 (0.0008) [2023-12-28 07:36:33,452][106226] Updated weights for policy 0, policy_version 1718156 (0.0008) [2023-12-28 07:36:33,503][106226] Updated weights for policy 0, policy_version 1718166 (0.0009) [2023-12-28 07:36:33,555][106226] Updated weights for policy 0, policy_version 1718176 (0.0009) [2023-12-28 07:36:33,649][106225] Updated weights for policy 1, policy_version 1722155 (0.0008) [2023-12-28 07:36:33,704][106225] Updated weights for policy 1, policy_version 1722165 (0.0008) [2023-12-28 07:36:33,757][106225] Updated weights for policy 1, policy_version 1722175 (0.0008) [2023-12-28 07:36:34,352][106226] Updated weights for policy 0, policy_version 1718186 (0.0009) [2023-12-28 07:36:34,410][106226] Updated weights for policy 0, policy_version 1718196 (0.0008) [2023-12-28 07:36:34,470][106226] Updated weights for policy 0, policy_version 1718206 (0.0008) [2023-12-28 07:36:34,474][106225] Updated weights for policy 1, policy_version 1722185 (0.0008) [2023-12-28 07:36:34,530][106226] Updated weights for policy 0, policy_version 1718216 (0.0008) [2023-12-28 07:36:34,532][106225] Updated weights for policy 1, policy_version 1722195 (0.0008) [2023-12-28 07:36:34,591][106225] Updated weights for policy 1, policy_version 1722205 (0.0008) [2023-12-28 07:36:34,642][106225] Updated weights for policy 1, policy_version 1722215 (0.0008) [2023-12-28 07:36:35,171][106226] Updated weights for policy 0, policy_version 1718226 (0.0009) [2023-12-28 07:36:35,221][106226] Updated weights for policy 0, policy_version 1718236 (0.0009) [2023-12-28 07:36:35,275][106226] Updated weights for policy 0, policy_version 1718246 (0.0008) [2023-12-28 07:36:35,310][106225] Updated weights for policy 1, policy_version 1722225 (0.0008) [2023-12-28 07:36:35,370][106225] Updated weights for policy 1, policy_version 1722235 (0.0008) [2023-12-28 07:36:35,432][106225] Updated weights for policy 1, policy_version 1722245 (0.0005) [2023-12-28 07:36:36,013][106226] Updated weights for policy 0, policy_version 1718256 (0.0009) [2023-12-28 07:36:36,074][106226] Updated weights for policy 0, policy_version 1718266 (0.0009) [2023-12-28 07:36:36,139][106225] Updated weights for policy 1, policy_version 1722255 (0.0008) [2023-12-28 07:36:36,156][106226] Updated weights for policy 0, policy_version 1718276 (0.0008) [2023-12-28 07:36:36,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 880902144. Throughput: 0: 9770.5, 1: 10116.1. Samples: 880920140. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:36,175][105115] Avg episode reward: [(0, '-4.048'), (1, '-4.679')] [2023-12-28 07:36:36,199][106225] Updated weights for policy 1, policy_version 1722265 (0.0007) [2023-12-28 07:36:36,249][106225] Updated weights for policy 1, policy_version 1722275 (0.0009) [2023-12-28 07:36:36,797][106226] Updated weights for policy 0, policy_version 1718286 (0.0009) [2023-12-28 07:36:36,850][106226] Updated weights for policy 0, policy_version 1718296 (0.0009) [2023-12-28 07:36:36,913][106226] Updated weights for policy 0, policy_version 1718306 (0.0009) [2023-12-28 07:36:36,979][106225] Updated weights for policy 1, policy_version 1722285 (0.0007) [2023-12-28 07:36:37,050][106225] Updated weights for policy 1, policy_version 1722295 (0.0007) [2023-12-28 07:36:37,110][106225] Updated weights for policy 1, policy_version 1722305 (0.0010) [2023-12-28 07:36:37,678][106226] Updated weights for policy 0, policy_version 1718316 (0.0009) [2023-12-28 07:36:37,734][106225] Updated weights for policy 1, policy_version 1722315 (0.0010) [2023-12-28 07:36:37,740][106226] Updated weights for policy 0, policy_version 1718326 (0.0007) [2023-12-28 07:36:37,792][106225] Updated weights for policy 1, policy_version 1722325 (0.0010) [2023-12-28 07:36:37,798][106226] Updated weights for policy 0, policy_version 1718336 (0.0005) [2023-12-28 07:36:37,854][106225] Updated weights for policy 1, policy_version 1722335 (0.0010) [2023-12-28 07:36:38,535][106226] Updated weights for policy 0, policy_version 1718346 (0.0006) [2023-12-28 07:36:38,595][106226] Updated weights for policy 0, policy_version 1718356 (0.0008) [2023-12-28 07:36:38,600][106225] Updated weights for policy 1, policy_version 1722345 (0.0010) [2023-12-28 07:36:38,652][106226] Updated weights for policy 0, policy_version 1718366 (0.0006) [2023-12-28 07:36:38,658][106225] Updated weights for policy 1, policy_version 1722355 (0.0010) [2023-12-28 07:36:38,708][106226] Updated weights for policy 0, policy_version 1718376 (0.0006) [2023-12-28 07:36:38,717][106225] Updated weights for policy 1, policy_version 1722365 (0.0010) [2023-12-28 07:36:38,774][106225] Updated weights for policy 1, policy_version 1722375 (0.0010) [2023-12-28 07:36:39,484][106226] Updated weights for policy 0, policy_version 1718386 (0.0008) [2023-12-28 07:36:39,543][106226] Updated weights for policy 0, policy_version 1718396 (0.0007) [2023-12-28 07:36:39,552][106225] Updated weights for policy 1, policy_version 1722385 (0.0010) [2023-12-28 07:36:39,605][106226] Updated weights for policy 0, policy_version 1718406 (0.0006) [2023-12-28 07:36:39,611][106225] Updated weights for policy 1, policy_version 1722395 (0.0010) [2023-12-28 07:36:39,673][106225] Updated weights for policy 1, policy_version 1722405 (0.0011) [2023-12-28 07:36:40,377][106226] Updated weights for policy 0, policy_version 1718416 (0.0007) [2023-12-28 07:36:40,418][106225] Updated weights for policy 1, policy_version 1722415 (0.0011) [2023-12-28 07:36:40,440][106226] Updated weights for policy 0, policy_version 1718426 (0.0008) [2023-12-28 07:36:40,476][106225] Updated weights for policy 1, policy_version 1722425 (0.0010) [2023-12-28 07:36:40,495][106226] Updated weights for policy 0, policy_version 1718436 (0.0006) [2023-12-28 07:36:40,538][106225] Updated weights for policy 1, policy_version 1722435 (0.0010) [2023-12-28 07:36:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 881000448. Throughput: 0: 9748.5, 1: 10118.8. Samples: 880978208. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:41,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.856')] [2023-12-28 07:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001722440_440999936.pth... [2023-12-28 07:36:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001718440_440000512.pth... [2023-12-28 07:36:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001721288_440705024.pth [2023-12-28 07:36:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001717320_439713792.pth [2023-12-28 07:36:41,265][106226] Updated weights for policy 0, policy_version 1718446 (0.0009) [2023-12-28 07:36:41,309][106225] Updated weights for policy 1, policy_version 1722445 (0.0010) [2023-12-28 07:36:41,330][106226] Updated weights for policy 0, policy_version 1718456 (0.0010) [2023-12-28 07:36:41,378][106225] Updated weights for policy 1, policy_version 1722455 (0.0010) [2023-12-28 07:36:41,404][106226] Updated weights for policy 0, policy_version 1718466 (0.0011) [2023-12-28 07:36:41,441][106225] Updated weights for policy 1, policy_version 1722465 (0.0011) [2023-12-28 07:36:42,155][106226] Updated weights for policy 0, policy_version 1718476 (0.0008) [2023-12-28 07:36:42,173][106225] Updated weights for policy 1, policy_version 1722475 (0.0009) [2023-12-28 07:36:42,214][106226] Updated weights for policy 0, policy_version 1718486 (0.0008) [2023-12-28 07:36:42,231][106225] Updated weights for policy 1, policy_version 1722485 (0.0010) [2023-12-28 07:36:42,278][106226] Updated weights for policy 0, policy_version 1718496 (0.0010) [2023-12-28 07:36:42,297][106225] Updated weights for policy 1, policy_version 1722495 (0.0010) [2023-12-28 07:36:42,975][106226] Updated weights for policy 0, policy_version 1718506 (0.0010) [2023-12-28 07:36:43,017][106225] Updated weights for policy 1, policy_version 1722505 (0.0007) [2023-12-28 07:36:43,033][106226] Updated weights for policy 0, policy_version 1718516 (0.0007) [2023-12-28 07:36:43,069][106225] Updated weights for policy 1, policy_version 1722515 (0.0008) [2023-12-28 07:36:43,092][106226] Updated weights for policy 0, policy_version 1718526 (0.0005) [2023-12-28 07:36:43,126][106225] Updated weights for policy 1, policy_version 1722525 (0.0009) [2023-12-28 07:36:43,156][106226] Updated weights for policy 0, policy_version 1718536 (0.0006) [2023-12-28 07:36:43,179][106225] Updated weights for policy 1, policy_version 1722535 (0.0007) [2023-12-28 07:36:43,781][106226] Updated weights for policy 0, policy_version 1718546 (0.0005) [2023-12-28 07:36:43,828][106226] Updated weights for policy 0, policy_version 1718556 (0.0005) [2023-12-28 07:36:43,880][106226] Updated weights for policy 0, policy_version 1718566 (0.0005) [2023-12-28 07:36:43,911][106225] Updated weights for policy 1, policy_version 1722545 (0.0008) [2023-12-28 07:36:43,966][106225] Updated weights for policy 1, policy_version 1722555 (0.0009) [2023-12-28 07:36:44,019][106225] Updated weights for policy 1, policy_version 1722565 (0.0008) [2023-12-28 07:36:44,583][106226] Updated weights for policy 0, policy_version 1718576 (0.0009) [2023-12-28 07:36:44,628][106225] Updated weights for policy 1, policy_version 1722575 (0.0007) [2023-12-28 07:36:44,638][106226] Updated weights for policy 0, policy_version 1718586 (0.0006) [2023-12-28 07:36:44,677][106225] Updated weights for policy 1, policy_version 1722585 (0.0007) [2023-12-28 07:36:44,683][106226] Updated weights for policy 0, policy_version 1718596 (0.0009) [2023-12-28 07:36:44,731][106225] Updated weights for policy 1, policy_version 1722595 (0.0006) [2023-12-28 07:36:45,381][106226] Updated weights for policy 0, policy_version 1718606 (0.0007) [2023-12-28 07:36:45,444][106226] Updated weights for policy 0, policy_version 1718616 (0.0009) [2023-12-28 07:36:45,459][106225] Updated weights for policy 1, policy_version 1722605 (0.0009) [2023-12-28 07:36:45,508][106226] Updated weights for policy 0, policy_version 1718626 (0.0006) [2023-12-28 07:36:45,518][106225] Updated weights for policy 1, policy_version 1722615 (0.0010) [2023-12-28 07:36:45,573][106225] Updated weights for policy 1, policy_version 1722625 (0.0011) [2023-12-28 07:36:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 881098752. Throughput: 0: 9752.4, 1: 10009.2. Samples: 881093180. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:46,175][105115] Avg episode reward: [(0, '-4.644'), (1, '-4.668')] [2023-12-28 07:36:46,215][106225] Updated weights for policy 1, policy_version 1722635 (0.0010) [2023-12-28 07:36:46,238][106226] Updated weights for policy 0, policy_version 1718636 (0.0006) [2023-12-28 07:36:46,268][106225] Updated weights for policy 1, policy_version 1722645 (0.0007) [2023-12-28 07:36:46,305][106226] Updated weights for policy 0, policy_version 1718646 (0.0008) [2023-12-28 07:36:46,317][106225] Updated weights for policy 1, policy_version 1722655 (0.0007) [2023-12-28 07:36:46,367][106226] Updated weights for policy 0, policy_version 1718656 (0.0008) [2023-12-28 07:36:47,057][106226] Updated weights for policy 0, policy_version 1718666 (0.0009) [2023-12-28 07:36:47,066][106225] Updated weights for policy 1, policy_version 1722665 (0.0007) [2023-12-28 07:36:47,112][106225] Updated weights for policy 1, policy_version 1722675 (0.0005) [2023-12-28 07:36:47,117][106226] Updated weights for policy 0, policy_version 1718676 (0.0009) [2023-12-28 07:36:47,160][106225] Updated weights for policy 1, policy_version 1722685 (0.0006) [2023-12-28 07:36:47,174][106226] Updated weights for policy 0, policy_version 1718686 (0.0007) [2023-12-28 07:36:47,209][106225] Updated weights for policy 1, policy_version 1722695 (0.0005) [2023-12-28 07:36:47,237][106226] Updated weights for policy 0, policy_version 1718696 (0.0008) [2023-12-28 07:36:47,912][106225] Updated weights for policy 1, policy_version 1722705 (0.0008) [2023-12-28 07:36:47,972][106225] Updated weights for policy 1, policy_version 1722715 (0.0008) [2023-12-28 07:36:47,974][106226] Updated weights for policy 0, policy_version 1718706 (0.0006) [2023-12-28 07:36:48,026][106225] Updated weights for policy 1, policy_version 1722725 (0.0006) [2023-12-28 07:36:48,030][106226] Updated weights for policy 0, policy_version 1718716 (0.0007) [2023-12-28 07:36:48,096][106226] Updated weights for policy 0, policy_version 1718726 (0.0008) [2023-12-28 07:36:48,807][106225] Updated weights for policy 1, policy_version 1722735 (0.0009) [2023-12-28 07:36:48,858][106226] Updated weights for policy 0, policy_version 1718736 (0.0008) [2023-12-28 07:36:48,869][106225] Updated weights for policy 1, policy_version 1722745 (0.0007) [2023-12-28 07:36:48,919][106226] Updated weights for policy 0, policy_version 1718746 (0.0008) [2023-12-28 07:36:48,932][106225] Updated weights for policy 1, policy_version 1722755 (0.0007) [2023-12-28 07:36:48,983][106226] Updated weights for policy 0, policy_version 1718756 (0.0008) [2023-12-28 07:36:49,665][106225] Updated weights for policy 1, policy_version 1722765 (0.0007) [2023-12-28 07:36:49,719][106225] Updated weights for policy 1, policy_version 1722775 (0.0008) [2023-12-28 07:36:49,745][106226] Updated weights for policy 0, policy_version 1718766 (0.0007) [2023-12-28 07:36:49,781][106225] Updated weights for policy 1, policy_version 1722785 (0.0007) [2023-12-28 07:36:49,811][106226] Updated weights for policy 0, policy_version 1718776 (0.0009) [2023-12-28 07:36:49,874][106226] Updated weights for policy 0, policy_version 1718786 (0.0009) [2023-12-28 07:36:50,592][106225] Updated weights for policy 1, policy_version 1722795 (0.0008) [2023-12-28 07:36:50,623][106226] Updated weights for policy 0, policy_version 1718796 (0.0009) [2023-12-28 07:36:50,661][106225] Updated weights for policy 1, policy_version 1722805 (0.0007) [2023-12-28 07:36:50,676][106226] Updated weights for policy 0, policy_version 1718806 (0.0007) [2023-12-28 07:36:50,728][106226] Updated weights for policy 0, policy_version 1718816 (0.0007) [2023-12-28 07:36:50,732][106225] Updated weights for policy 1, policy_version 1722815 (0.0008) [2023-12-28 07:36:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 881197056. Throughput: 0: 9669.2, 1: 9929.0. Samples: 881207616. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:51,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.744')] [2023-12-28 07:36:51,387][106226] Updated weights for policy 0, policy_version 1718826 (0.0009) [2023-12-28 07:36:51,451][106226] Updated weights for policy 0, policy_version 1718836 (0.0008) [2023-12-28 07:36:51,515][106226] Updated weights for policy 0, policy_version 1718846 (0.0008) [2023-12-28 07:36:51,536][106225] Updated weights for policy 1, policy_version 1722825 (0.0009) [2023-12-28 07:36:51,570][106226] Updated weights for policy 0, policy_version 1718856 (0.0007) [2023-12-28 07:36:51,595][106225] Updated weights for policy 1, policy_version 1722835 (0.0007) [2023-12-28 07:36:51,671][106225] Updated weights for policy 1, policy_version 1722845 (0.0009) [2023-12-28 07:36:51,737][106225] Updated weights for policy 1, policy_version 1722855 (0.0010) [2023-12-28 07:36:52,252][106226] Updated weights for policy 0, policy_version 1718866 (0.0008) [2023-12-28 07:36:52,316][106226] Updated weights for policy 0, policy_version 1718876 (0.0006) [2023-12-28 07:36:52,382][106226] Updated weights for policy 0, policy_version 1718886 (0.0007) [2023-12-28 07:36:52,423][106225] Updated weights for policy 1, policy_version 1722865 (0.0009) [2023-12-28 07:36:52,482][106225] Updated weights for policy 1, policy_version 1722875 (0.0009) [2023-12-28 07:36:52,543][106225] Updated weights for policy 1, policy_version 1722885 (0.0009) [2023-12-28 07:36:53,086][106226] Updated weights for policy 0, policy_version 1718896 (0.0008) [2023-12-28 07:36:53,145][106226] Updated weights for policy 0, policy_version 1718906 (0.0006) [2023-12-28 07:36:53,209][106226] Updated weights for policy 0, policy_version 1718916 (0.0006) [2023-12-28 07:36:53,303][106225] Updated weights for policy 1, policy_version 1722895 (0.0007) [2023-12-28 07:36:53,355][106225] Updated weights for policy 1, policy_version 1722905 (0.0008) [2023-12-28 07:36:53,407][106225] Updated weights for policy 1, policy_version 1722915 (0.0008) [2023-12-28 07:36:53,881][106226] Updated weights for policy 0, policy_version 1718926 (0.0009) [2023-12-28 07:36:53,932][106226] Updated weights for policy 0, policy_version 1718936 (0.0011) [2023-12-28 07:36:53,980][106226] Updated weights for policy 0, policy_version 1718946 (0.0010) [2023-12-28 07:36:54,151][106225] Updated weights for policy 1, policy_version 1722925 (0.0008) [2023-12-28 07:36:54,212][106225] Updated weights for policy 1, policy_version 1722935 (0.0005) [2023-12-28 07:36:54,269][106225] Updated weights for policy 1, policy_version 1722945 (0.0005) [2023-12-28 07:36:54,737][106226] Updated weights for policy 0, policy_version 1718956 (0.0011) [2023-12-28 07:36:54,796][106226] Updated weights for policy 0, policy_version 1718966 (0.0007) [2023-12-28 07:36:54,863][106226] Updated weights for policy 0, policy_version 1718976 (0.0007) [2023-12-28 07:36:54,888][106225] Updated weights for policy 1, policy_version 1722955 (0.0006) [2023-12-28 07:36:54,945][106225] Updated weights for policy 1, policy_version 1722965 (0.0007) [2023-12-28 07:36:55,009][106225] Updated weights for policy 1, policy_version 1722975 (0.0007) [2023-12-28 07:36:55,461][106226] Updated weights for policy 0, policy_version 1718986 (0.0007) [2023-12-28 07:36:55,519][106226] Updated weights for policy 0, policy_version 1718996 (0.0008) [2023-12-28 07:36:55,574][106226] Updated weights for policy 0, policy_version 1719006 (0.0008) [2023-12-28 07:36:55,640][106226] Updated weights for policy 0, policy_version 1719016 (0.0005) [2023-12-28 07:36:55,762][106225] Updated weights for policy 1, policy_version 1722985 (0.0008) [2023-12-28 07:36:55,815][106225] Updated weights for policy 1, policy_version 1722995 (0.0008) [2023-12-28 07:36:55,867][106225] Updated weights for policy 1, policy_version 1723005 (0.0009) [2023-12-28 07:36:55,918][106225] Updated weights for policy 1, policy_version 1723015 (0.0008) [2023-12-28 07:36:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 881295360. Throughput: 0: 9686.4, 1: 9863.1. Samples: 881265060. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:36:56,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.641')] [2023-12-28 07:36:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001723016_441147392.pth... [2023-12-28 07:36:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001719016_440147968.pth... [2023-12-28 07:36:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001721864_440852480.pth [2023-12-28 07:36:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001717896_439861248.pth [2023-12-28 07:36:56,269][106226] Updated weights for policy 0, policy_version 1719026 (0.0008) [2023-12-28 07:36:56,327][106226] Updated weights for policy 0, policy_version 1719036 (0.0007) [2023-12-28 07:36:56,382][106226] Updated weights for policy 0, policy_version 1719046 (0.0010) [2023-12-28 07:36:56,701][106225] Updated weights for policy 1, policy_version 1723025 (0.0008) [2023-12-28 07:36:56,764][106225] Updated weights for policy 1, policy_version 1723035 (0.0008) [2023-12-28 07:36:56,822][106225] Updated weights for policy 1, policy_version 1723045 (0.0008) [2023-12-28 07:36:57,094][106226] Updated weights for policy 0, policy_version 1719056 (0.0010) [2023-12-28 07:36:57,152][106226] Updated weights for policy 0, policy_version 1719066 (0.0008) [2023-12-28 07:36:57,209][106226] Updated weights for policy 0, policy_version 1719076 (0.0008) [2023-12-28 07:36:57,522][106225] Updated weights for policy 1, policy_version 1723055 (0.0006) [2023-12-28 07:36:57,583][106225] Updated weights for policy 1, policy_version 1723065 (0.0005) [2023-12-28 07:36:57,634][106225] Updated weights for policy 1, policy_version 1723075 (0.0005) [2023-12-28 07:36:57,754][106226] Updated weights for policy 0, policy_version 1719086 (0.0009) [2023-12-28 07:36:57,813][106226] Updated weights for policy 0, policy_version 1719096 (0.0010) [2023-12-28 07:36:57,876][106226] Updated weights for policy 0, policy_version 1719106 (0.0010) [2023-12-28 07:36:58,247][106225] Updated weights for policy 1, policy_version 1723085 (0.0009) [2023-12-28 07:36:58,315][106225] Updated weights for policy 1, policy_version 1723095 (0.0011) [2023-12-28 07:36:58,382][106225] Updated weights for policy 1, policy_version 1723105 (0.0008) [2023-12-28 07:36:58,634][106226] Updated weights for policy 0, policy_version 1719116 (0.0010) [2023-12-28 07:36:58,697][106226] Updated weights for policy 0, policy_version 1719126 (0.0010) [2023-12-28 07:36:58,762][106226] Updated weights for policy 0, policy_version 1719136 (0.0010) [2023-12-28 07:36:59,206][106225] Updated weights for policy 1, policy_version 1723115 (0.0008) [2023-12-28 07:36:59,277][106225] Updated weights for policy 1, policy_version 1723125 (0.0008) [2023-12-28 07:36:59,344][106225] Updated weights for policy 1, policy_version 1723135 (0.0007) [2023-12-28 07:36:59,627][106226] Updated weights for policy 0, policy_version 1719146 (0.0008) [2023-12-28 07:36:59,692][106226] Updated weights for policy 0, policy_version 1719156 (0.0010) [2023-12-28 07:36:59,750][106226] Updated weights for policy 0, policy_version 1719166 (0.0009) [2023-12-28 07:36:59,809][106226] Updated weights for policy 0, policy_version 1719176 (0.0008) [2023-12-28 07:37:00,000][106225] Updated weights for policy 1, policy_version 1723145 (0.0007) [2023-12-28 07:37:00,064][106225] Updated weights for policy 1, policy_version 1723155 (0.0008) [2023-12-28 07:37:00,122][106225] Updated weights for policy 1, policy_version 1723165 (0.0006) [2023-12-28 07:37:00,182][106225] Updated weights for policy 1, policy_version 1723175 (0.0006) [2023-12-28 07:37:00,589][106226] Updated weights for policy 0, policy_version 1719186 (0.0008) [2023-12-28 07:37:00,646][106226] Updated weights for policy 0, policy_version 1719196 (0.0008) [2023-12-28 07:37:00,713][106226] Updated weights for policy 0, policy_version 1719206 (0.0008) [2023-12-28 07:37:00,798][106225] Updated weights for policy 1, policy_version 1723185 (0.0010) [2023-12-28 07:37:00,861][106225] Updated weights for policy 1, policy_version 1723195 (0.0010) [2023-12-28 07:37:00,920][106225] Updated weights for policy 1, policy_version 1723205 (0.0010) [2023-12-28 07:37:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 881393664. Throughput: 0: 9717.4, 1: 9852.0. Samples: 881383244. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:01,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.065')] [2023-12-28 07:37:01,485][106226] Updated weights for policy 0, policy_version 1719216 (0.0007) [2023-12-28 07:37:01,547][106226] Updated weights for policy 0, policy_version 1719226 (0.0009) [2023-12-28 07:37:01,602][106226] Updated weights for policy 0, policy_version 1719236 (0.0008) [2023-12-28 07:37:01,639][106225] Updated weights for policy 1, policy_version 1723215 (0.0009) [2023-12-28 07:37:01,707][106225] Updated weights for policy 1, policy_version 1723225 (0.0008) [2023-12-28 07:37:01,768][106225] Updated weights for policy 1, policy_version 1723235 (0.0010) [2023-12-28 07:37:02,355][106225] Updated weights for policy 1, policy_version 1723245 (0.0009) [2023-12-28 07:37:02,404][106226] Updated weights for policy 0, policy_version 1719246 (0.0008) [2023-12-28 07:37:02,417][106225] Updated weights for policy 1, policy_version 1723255 (0.0008) [2023-12-28 07:37:02,457][106226] Updated weights for policy 0, policy_version 1719256 (0.0007) [2023-12-28 07:37:02,476][106225] Updated weights for policy 1, policy_version 1723265 (0.0008) [2023-12-28 07:37:02,510][106226] Updated weights for policy 0, policy_version 1719266 (0.0006) [2023-12-28 07:37:03,161][106225] Updated weights for policy 1, policy_version 1723275 (0.0007) [2023-12-28 07:37:03,206][106226] Updated weights for policy 0, policy_version 1719276 (0.0008) [2023-12-28 07:37:03,224][106225] Updated weights for policy 1, policy_version 1723285 (0.0005) [2023-12-28 07:37:03,264][106226] Updated weights for policy 0, policy_version 1719286 (0.0007) [2023-12-28 07:37:03,281][106225] Updated weights for policy 1, policy_version 1723295 (0.0008) [2023-12-28 07:37:03,324][106226] Updated weights for policy 0, policy_version 1719296 (0.0005) [2023-12-28 07:37:03,883][106225] Updated weights for policy 1, policy_version 1723305 (0.0010) [2023-12-28 07:37:03,943][106225] Updated weights for policy 1, policy_version 1723315 (0.0006) [2023-12-28 07:37:04,010][106225] Updated weights for policy 1, policy_version 1723325 (0.0009) [2023-12-28 07:37:04,057][106226] Updated weights for policy 0, policy_version 1719306 (0.0008) [2023-12-28 07:37:04,077][106225] Updated weights for policy 1, policy_version 1723335 (0.0008) [2023-12-28 07:37:04,128][106226] Updated weights for policy 0, policy_version 1719316 (0.0009) [2023-12-28 07:37:04,197][106226] Updated weights for policy 0, policy_version 1719326 (0.0009) [2023-12-28 07:37:04,255][106226] Updated weights for policy 0, policy_version 1719336 (0.0008) [2023-12-28 07:37:04,770][106225] Updated weights for policy 1, policy_version 1723345 (0.0006) [2023-12-28 07:37:04,823][106225] Updated weights for policy 1, policy_version 1723355 (0.0007) [2023-12-28 07:37:04,888][106225] Updated weights for policy 1, policy_version 1723365 (0.0007) [2023-12-28 07:37:04,938][106226] Updated weights for policy 0, policy_version 1719346 (0.0010) [2023-12-28 07:37:04,998][106226] Updated weights for policy 0, policy_version 1719356 (0.0007) [2023-12-28 07:37:05,056][106226] Updated weights for policy 0, policy_version 1719366 (0.0005) [2023-12-28 07:37:05,615][106226] Updated weights for policy 0, policy_version 1719376 (0.0008) [2023-12-28 07:37:05,641][106225] Updated weights for policy 1, policy_version 1723375 (0.0006) [2023-12-28 07:37:05,674][106226] Updated weights for policy 0, policy_version 1719386 (0.0006) [2023-12-28 07:37:05,695][106225] Updated weights for policy 1, policy_version 1723385 (0.0007) [2023-12-28 07:37:05,725][106226] Updated weights for policy 0, policy_version 1719396 (0.0006) [2023-12-28 07:37:05,756][106225] Updated weights for policy 1, policy_version 1723395 (0.0007) [2023-12-28 07:37:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 881491968. Throughput: 0: 9696.5, 1: 9922.7. Samples: 881502480. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:06,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-5.318')] [2023-12-28 07:37:06,474][106225] Updated weights for policy 1, policy_version 1723405 (0.0008) [2023-12-28 07:37:06,476][106226] Updated weights for policy 0, policy_version 1719406 (0.0007) [2023-12-28 07:37:06,541][106225] Updated weights for policy 1, policy_version 1723415 (0.0006) [2023-12-28 07:37:06,545][106226] Updated weights for policy 0, policy_version 1719416 (0.0009) [2023-12-28 07:37:06,601][106225] Updated weights for policy 1, policy_version 1723425 (0.0006) [2023-12-28 07:37:06,603][106226] Updated weights for policy 0, policy_version 1719426 (0.0008) [2023-12-28 07:37:07,168][106225] Updated weights for policy 1, policy_version 1723435 (0.0008) [2023-12-28 07:37:07,224][106225] Updated weights for policy 1, policy_version 1723445 (0.0008) [2023-12-28 07:37:07,282][106225] Updated weights for policy 1, policy_version 1723455 (0.0008) [2023-12-28 07:37:07,387][106226] Updated weights for policy 0, policy_version 1719436 (0.0009) [2023-12-28 07:37:07,443][106226] Updated weights for policy 0, policy_version 1719446 (0.0008) [2023-12-28 07:37:07,496][106226] Updated weights for policy 0, policy_version 1719456 (0.0009) [2023-12-28 07:37:07,983][106225] Updated weights for policy 1, policy_version 1723465 (0.0009) [2023-12-28 07:37:08,045][106225] Updated weights for policy 1, policy_version 1723475 (0.0008) [2023-12-28 07:37:08,106][106225] Updated weights for policy 1, policy_version 1723485 (0.0010) [2023-12-28 07:37:08,163][106225] Updated weights for policy 1, policy_version 1723495 (0.0010) [2023-12-28 07:37:08,268][106226] Updated weights for policy 0, policy_version 1719466 (0.0008) [2023-12-28 07:37:08,326][106226] Updated weights for policy 0, policy_version 1719476 (0.0008) [2023-12-28 07:37:08,390][106226] Updated weights for policy 0, policy_version 1719486 (0.0008) [2023-12-28 07:37:08,452][106226] Updated weights for policy 0, policy_version 1719496 (0.0008) [2023-12-28 07:37:08,849][106225] Updated weights for policy 1, policy_version 1723505 (0.0010) [2023-12-28 07:37:08,915][106225] Updated weights for policy 1, policy_version 1723515 (0.0009) [2023-12-28 07:37:08,967][106225] Updated weights for policy 1, policy_version 1723525 (0.0009) [2023-12-28 07:37:09,161][106226] Updated weights for policy 0, policy_version 1719506 (0.0007) [2023-12-28 07:37:09,226][106226] Updated weights for policy 0, policy_version 1719516 (0.0006) [2023-12-28 07:37:09,302][106226] Updated weights for policy 0, policy_version 1719526 (0.0008) [2023-12-28 07:37:09,706][106225] Updated weights for policy 1, policy_version 1723535 (0.0008) [2023-12-28 07:37:09,767][106225] Updated weights for policy 1, policy_version 1723545 (0.0009) [2023-12-28 07:37:09,832][106225] Updated weights for policy 1, policy_version 1723555 (0.0009) [2023-12-28 07:37:10,079][106226] Updated weights for policy 0, policy_version 1719536 (0.0006) [2023-12-28 07:37:10,141][106226] Updated weights for policy 0, policy_version 1719546 (0.0006) [2023-12-28 07:37:10,211][106226] Updated weights for policy 0, policy_version 1719556 (0.0006) [2023-12-28 07:37:10,689][106225] Updated weights for policy 1, policy_version 1723565 (0.0007) [2023-12-28 07:37:10,747][106225] Updated weights for policy 1, policy_version 1723575 (0.0008) [2023-12-28 07:37:10,795][106225] Updated weights for policy 1, policy_version 1723585 (0.0009) [2023-12-28 07:37:10,866][106226] Updated weights for policy 0, policy_version 1719566 (0.0009) [2023-12-28 07:37:10,916][106226] Updated weights for policy 0, policy_version 1719576 (0.0009) [2023-12-28 07:37:10,971][106226] Updated weights for policy 0, policy_version 1719586 (0.0009) [2023-12-28 07:37:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 881590272. Throughput: 0: 9697.2, 1: 9979.9. Samples: 881561212. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:11,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.809')] [2023-12-28 07:37:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001723592_441294848.pth... [2023-12-28 07:37:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001719592_440295424.pth... [2023-12-28 07:37:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001718440_440000512.pth [2023-12-28 07:37:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001722440_440999936.pth [2023-12-28 07:37:11,571][106225] Updated weights for policy 1, policy_version 1723595 (0.0008) [2023-12-28 07:37:11,634][106225] Updated weights for policy 1, policy_version 1723605 (0.0008) [2023-12-28 07:37:11,704][106225] Updated weights for policy 1, policy_version 1723615 (0.0008) [2023-12-28 07:37:11,788][106226] Updated weights for policy 0, policy_version 1719596 (0.0008) [2023-12-28 07:37:11,857][106226] Updated weights for policy 0, policy_version 1719606 (0.0009) [2023-12-28 07:37:11,912][106226] Updated weights for policy 0, policy_version 1719616 (0.0008) [2023-12-28 07:37:12,498][106225] Updated weights for policy 1, policy_version 1723625 (0.0008) [2023-12-28 07:37:12,550][106225] Updated weights for policy 1, policy_version 1723635 (0.0008) [2023-12-28 07:37:12,603][106225] Updated weights for policy 1, policy_version 1723645 (0.0008) [2023-12-28 07:37:12,612][106226] Updated weights for policy 0, policy_version 1719626 (0.0009) [2023-12-28 07:37:12,653][106225] Updated weights for policy 1, policy_version 1723655 (0.0007) [2023-12-28 07:37:12,673][106226] Updated weights for policy 0, policy_version 1719636 (0.0007) [2023-12-28 07:37:12,739][106226] Updated weights for policy 0, policy_version 1719646 (0.0005) [2023-12-28 07:37:12,801][106226] Updated weights for policy 0, policy_version 1719656 (0.0006) [2023-12-28 07:37:13,342][106225] Updated weights for policy 1, policy_version 1723665 (0.0010) [2023-12-28 07:37:13,404][106225] Updated weights for policy 1, policy_version 1723675 (0.0010) [2023-12-28 07:37:13,456][106226] Updated weights for policy 0, policy_version 1719666 (0.0006) [2023-12-28 07:37:13,458][106225] Updated weights for policy 1, policy_version 1723685 (0.0010) [2023-12-28 07:37:13,507][106226] Updated weights for policy 0, policy_version 1719676 (0.0005) [2023-12-28 07:37:13,562][106226] Updated weights for policy 0, policy_version 1719686 (0.0006) [2023-12-28 07:37:14,170][106225] Updated weights for policy 1, policy_version 1723695 (0.0010) [2023-12-28 07:37:14,172][106226] Updated weights for policy 0, policy_version 1719696 (0.0008) [2023-12-28 07:37:14,218][106226] Updated weights for policy 0, policy_version 1719706 (0.0008) [2023-12-28 07:37:14,231][106225] Updated weights for policy 1, policy_version 1723705 (0.0010) [2023-12-28 07:37:14,272][106226] Updated weights for policy 0, policy_version 1719716 (0.0006) [2023-12-28 07:37:14,291][106225] Updated weights for policy 1, policy_version 1723715 (0.0010) [2023-12-28 07:37:14,903][106226] Updated weights for policy 0, policy_version 1719726 (0.0007) [2023-12-28 07:37:14,954][106226] Updated weights for policy 0, policy_version 1719736 (0.0008) [2023-12-28 07:37:15,015][106226] Updated weights for policy 0, policy_version 1719746 (0.0008) [2023-12-28 07:37:15,027][106225] Updated weights for policy 1, policy_version 1723725 (0.0010) [2023-12-28 07:37:15,082][106225] Updated weights for policy 1, policy_version 1723735 (0.0011) [2023-12-28 07:37:15,140][106225] Updated weights for policy 1, policy_version 1723745 (0.0010) [2023-12-28 07:37:15,756][106226] Updated weights for policy 0, policy_version 1719756 (0.0009) [2023-12-28 07:37:15,819][106226] Updated weights for policy 0, policy_version 1719766 (0.0010) [2023-12-28 07:37:15,860][106225] Updated weights for policy 1, policy_version 1723755 (0.0011) [2023-12-28 07:37:15,880][106226] Updated weights for policy 0, policy_version 1719776 (0.0007) [2023-12-28 07:37:15,921][106225] Updated weights for policy 1, policy_version 1723765 (0.0010) [2023-12-28 07:37:15,977][106225] Updated weights for policy 1, policy_version 1723775 (0.0010) [2023-12-28 07:37:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 881688576. Throughput: 0: 9678.2, 1: 9765.4. Samples: 881675484. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:16,175][105115] Avg episode reward: [(0, '-4.676'), (1, '-4.636')] [2023-12-28 07:37:16,538][106226] Updated weights for policy 0, policy_version 1719786 (0.0006) [2023-12-28 07:37:16,606][106226] Updated weights for policy 0, policy_version 1719796 (0.0009) [2023-12-28 07:37:16,615][106225] Updated weights for policy 1, policy_version 1723785 (0.0010) [2023-12-28 07:37:16,667][106226] Updated weights for policy 0, policy_version 1719806 (0.0008) [2023-12-28 07:37:16,675][106225] Updated weights for policy 1, policy_version 1723795 (0.0005) [2023-12-28 07:37:16,728][106226] Updated weights for policy 0, policy_version 1719816 (0.0008) [2023-12-28 07:37:16,731][106225] Updated weights for policy 1, policy_version 1723805 (0.0005) [2023-12-28 07:37:16,784][106225] Updated weights for policy 1, policy_version 1723815 (0.0005) [2023-12-28 07:37:17,319][106225] Updated weights for policy 1, policy_version 1723825 (0.0005) [2023-12-28 07:37:17,378][106225] Updated weights for policy 1, policy_version 1723835 (0.0005) [2023-12-28 07:37:17,439][106225] Updated weights for policy 1, policy_version 1723845 (0.0008) [2023-12-28 07:37:17,521][106226] Updated weights for policy 0, policy_version 1719826 (0.0008) [2023-12-28 07:37:17,585][106226] Updated weights for policy 0, policy_version 1719836 (0.0008) [2023-12-28 07:37:17,644][106226] Updated weights for policy 0, policy_version 1719846 (0.0008) [2023-12-28 07:37:18,070][106225] Updated weights for policy 1, policy_version 1723855 (0.0007) [2023-12-28 07:37:18,125][106225] Updated weights for policy 1, policy_version 1723865 (0.0005) [2023-12-28 07:37:18,178][106225] Updated weights for policy 1, policy_version 1723875 (0.0005) [2023-12-28 07:37:18,433][106226] Updated weights for policy 0, policy_version 1719856 (0.0008) [2023-12-28 07:37:18,496][106226] Updated weights for policy 0, policy_version 1719866 (0.0008) [2023-12-28 07:37:18,560][106226] Updated weights for policy 0, policy_version 1719876 (0.0008) [2023-12-28 07:37:18,775][106225] Updated weights for policy 1, policy_version 1723885 (0.0008) [2023-12-28 07:37:18,838][106225] Updated weights for policy 1, policy_version 1723895 (0.0011) [2023-12-28 07:37:18,907][106225] Updated weights for policy 1, policy_version 1723905 (0.0011) [2023-12-28 07:37:19,286][106226] Updated weights for policy 0, policy_version 1719886 (0.0008) [2023-12-28 07:37:19,366][106226] Updated weights for policy 0, policy_version 1719897 (0.0011) [2023-12-28 07:37:19,437][106226] Updated weights for policy 0, policy_version 1719907 (0.0011) [2023-12-28 07:37:19,641][106225] Updated weights for policy 1, policy_version 1723915 (0.0008) [2023-12-28 07:37:19,703][106225] Updated weights for policy 1, policy_version 1723925 (0.0008) [2023-12-28 07:37:19,770][106225] Updated weights for policy 1, policy_version 1723935 (0.0009) [2023-12-28 07:37:20,169][106226] Updated weights for policy 0, policy_version 1719917 (0.0009) [2023-12-28 07:37:20,228][106226] Updated weights for policy 0, policy_version 1719927 (0.0008) [2023-12-28 07:37:20,290][106226] Updated weights for policy 0, policy_version 1719937 (0.0009) [2023-12-28 07:37:20,538][106225] Updated weights for policy 1, policy_version 1723945 (0.0008) [2023-12-28 07:37:20,609][106225] Updated weights for policy 1, policy_version 1723955 (0.0008) [2023-12-28 07:37:20,672][106225] Updated weights for policy 1, policy_version 1723965 (0.0007) [2023-12-28 07:37:20,740][106225] Updated weights for policy 1, policy_version 1723975 (0.0006) [2023-12-28 07:37:20,978][106226] Updated weights for policy 0, policy_version 1719947 (0.0009) [2023-12-28 07:37:21,047][106226] Updated weights for policy 0, policy_version 1719957 (0.0008) [2023-12-28 07:37:21,106][106226] Updated weights for policy 0, policy_version 1719967 (0.0010) [2023-12-28 07:37:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 881786880. Throughput: 0: 9632.7, 1: 9775.1. Samples: 881793484. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:21,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.754')] [2023-12-28 07:37:21,417][106225] Updated weights for policy 1, policy_version 1723985 (0.0008) [2023-12-28 07:37:21,485][106225] Updated weights for policy 1, policy_version 1723995 (0.0007) [2023-12-28 07:37:21,550][106225] Updated weights for policy 1, policy_version 1724005 (0.0006) [2023-12-28 07:37:21,865][106226] Updated weights for policy 0, policy_version 1719977 (0.0007) [2023-12-28 07:37:21,935][106226] Updated weights for policy 0, policy_version 1719987 (0.0006) [2023-12-28 07:37:22,004][106226] Updated weights for policy 0, policy_version 1719997 (0.0006) [2023-12-28 07:37:22,072][106226] Updated weights for policy 0, policy_version 1720007 (0.0007) [2023-12-28 07:37:22,248][106225] Updated weights for policy 1, policy_version 1724015 (0.0010) [2023-12-28 07:37:22,313][106225] Updated weights for policy 1, policy_version 1724025 (0.0008) [2023-12-28 07:37:22,377][106225] Updated weights for policy 1, policy_version 1724035 (0.0008) [2023-12-28 07:37:22,671][106226] Updated weights for policy 0, policy_version 1720017 (0.0008) [2023-12-28 07:37:22,731][106226] Updated weights for policy 0, policy_version 1720027 (0.0009) [2023-12-28 07:37:22,796][106226] Updated weights for policy 0, policy_version 1720037 (0.0009) [2023-12-28 07:37:23,076][106225] Updated weights for policy 1, policy_version 1724045 (0.0008) [2023-12-28 07:37:23,141][106225] Updated weights for policy 1, policy_version 1724055 (0.0005) [2023-12-28 07:37:23,200][106225] Updated weights for policy 1, policy_version 1724065 (0.0006) [2023-12-28 07:37:23,483][106226] Updated weights for policy 0, policy_version 1720047 (0.0008) [2023-12-28 07:37:23,535][106226] Updated weights for policy 0, policy_version 1720057 (0.0009) [2023-12-28 07:37:23,586][106226] Updated weights for policy 0, policy_version 1720067 (0.0008) [2023-12-28 07:37:23,821][106225] Updated weights for policy 1, policy_version 1724075 (0.0007) [2023-12-28 07:37:23,884][106225] Updated weights for policy 1, policy_version 1724085 (0.0009) [2023-12-28 07:37:23,944][106225] Updated weights for policy 1, policy_version 1724095 (0.0007) [2023-12-28 07:37:24,263][106226] Updated weights for policy 0, policy_version 1720077 (0.0009) [2023-12-28 07:37:24,320][106226] Updated weights for policy 0, policy_version 1720087 (0.0008) [2023-12-28 07:37:24,378][106226] Updated weights for policy 0, policy_version 1720097 (0.0009) [2023-12-28 07:37:24,614][106225] Updated weights for policy 1, policy_version 1724105 (0.0006) [2023-12-28 07:37:24,670][106225] Updated weights for policy 1, policy_version 1724115 (0.0009) [2023-12-28 07:37:24,714][106225] Updated weights for policy 1, policy_version 1724125 (0.0008) [2023-12-28 07:37:24,760][106225] Updated weights for policy 1, policy_version 1724135 (0.0007) [2023-12-28 07:37:25,128][106226] Updated weights for policy 0, policy_version 1720107 (0.0008) [2023-12-28 07:37:25,185][106226] Updated weights for policy 0, policy_version 1720117 (0.0007) [2023-12-28 07:37:25,242][106226] Updated weights for policy 0, policy_version 1720127 (0.0007) [2023-12-28 07:37:25,509][106225] Updated weights for policy 1, policy_version 1724145 (0.0006) [2023-12-28 07:37:25,569][106225] Updated weights for policy 1, policy_version 1724155 (0.0005) [2023-12-28 07:37:25,618][106225] Updated weights for policy 1, policy_version 1724165 (0.0005) [2023-12-28 07:37:25,985][106226] Updated weights for policy 0, policy_version 1720137 (0.0008) [2023-12-28 07:37:26,048][106226] Updated weights for policy 0, policy_version 1720147 (0.0009) [2023-12-28 07:37:26,102][106226] Updated weights for policy 0, policy_version 1720157 (0.0008) [2023-12-28 07:37:26,146][106225] Updated weights for policy 1, policy_version 1724175 (0.0005) [2023-12-28 07:37:26,163][106226] Updated weights for policy 0, policy_version 1720167 (0.0008) [2023-12-28 07:37:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 881885184. Throughput: 0: 9675.0, 1: 9778.8. Samples: 881853632. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:26,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-4.773')] [2023-12-28 07:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001720168_440442880.pth... [2023-12-28 07:37:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001719016_440147968.pth [2023-12-28 07:37:26,209][106225] Updated weights for policy 1, policy_version 1724185 (0.0005) [2023-12-28 07:37:26,271][106225] Updated weights for policy 1, policy_version 1724195 (0.0009) [2023-12-28 07:37:26,298][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001724200_441450496.pth... [2023-12-28 07:37:26,302][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001723016_441147392.pth [2023-12-28 07:37:26,832][106226] Updated weights for policy 0, policy_version 1720177 (0.0005) [2023-12-28 07:37:26,883][106226] Updated weights for policy 0, policy_version 1720187 (0.0005) [2023-12-28 07:37:26,911][106225] Updated weights for policy 1, policy_version 1724205 (0.0010) [2023-12-28 07:37:26,940][106226] Updated weights for policy 0, policy_version 1720197 (0.0005) [2023-12-28 07:37:26,965][106225] Updated weights for policy 1, policy_version 1724215 (0.0010) [2023-12-28 07:37:27,034][106225] Updated weights for policy 1, policy_version 1724225 (0.0010) [2023-12-28 07:37:27,601][106226] Updated weights for policy 0, policy_version 1720207 (0.0009) [2023-12-28 07:37:27,646][106226] Updated weights for policy 0, policy_version 1720217 (0.0010) [2023-12-28 07:37:27,694][106226] Updated weights for policy 0, policy_version 1720227 (0.0010) [2023-12-28 07:37:27,786][106225] Updated weights for policy 1, policy_version 1724235 (0.0008) [2023-12-28 07:37:27,839][106225] Updated weights for policy 1, policy_version 1724245 (0.0010) [2023-12-28 07:37:27,891][106225] Updated weights for policy 1, policy_version 1724255 (0.0010) [2023-12-28 07:37:28,361][106226] Updated weights for policy 0, policy_version 1720237 (0.0009) [2023-12-28 07:37:28,412][106226] Updated weights for policy 0, policy_version 1720247 (0.0007) [2023-12-28 07:37:28,471][106226] Updated weights for policy 0, policy_version 1720257 (0.0007) [2023-12-28 07:37:28,550][106225] Updated weights for policy 1, policy_version 1724265 (0.0010) [2023-12-28 07:37:28,605][106225] Updated weights for policy 1, policy_version 1724275 (0.0007) [2023-12-28 07:37:28,660][106225] Updated weights for policy 1, policy_version 1724285 (0.0008) [2023-12-28 07:37:28,721][106225] Updated weights for policy 1, policy_version 1724295 (0.0005) [2023-12-28 07:37:29,206][106226] Updated weights for policy 0, policy_version 1720267 (0.0008) [2023-12-28 07:37:29,278][106226] Updated weights for policy 0, policy_version 1720277 (0.0008) [2023-12-28 07:37:29,339][106226] Updated weights for policy 0, policy_version 1720287 (0.0010) [2023-12-28 07:37:29,361][106225] Updated weights for policy 1, policy_version 1724305 (0.0008) [2023-12-28 07:37:29,419][106225] Updated weights for policy 1, policy_version 1724315 (0.0007) [2023-12-28 07:37:29,473][106225] Updated weights for policy 1, policy_version 1724325 (0.0008) [2023-12-28 07:37:30,049][106226] Updated weights for policy 0, policy_version 1720297 (0.0008) [2023-12-28 07:37:30,104][106226] Updated weights for policy 0, policy_version 1720307 (0.0005) [2023-12-28 07:37:30,167][106226] Updated weights for policy 0, policy_version 1720317 (0.0005) [2023-12-28 07:37:30,222][106226] Updated weights for policy 0, policy_version 1720327 (0.0005) [2023-12-28 07:37:30,223][106225] Updated weights for policy 1, policy_version 1724335 (0.0009) [2023-12-28 07:37:30,282][106225] Updated weights for policy 1, policy_version 1724345 (0.0010) [2023-12-28 07:37:30,340][106225] Updated weights for policy 1, policy_version 1724355 (0.0010) [2023-12-28 07:37:30,806][106226] Updated weights for policy 0, policy_version 1720337 (0.0008) [2023-12-28 07:37:30,865][106226] Updated weights for policy 0, policy_version 1720347 (0.0008) [2023-12-28 07:37:30,925][106226] Updated weights for policy 0, policy_version 1720357 (0.0008) [2023-12-28 07:37:31,153][106225] Updated weights for policy 1, policy_version 1724365 (0.0009) [2023-12-28 07:37:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 881983488. Throughput: 0: 9717.6, 1: 9882.6. Samples: 881975188. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:31,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-4.798')] [2023-12-28 07:37:31,207][106225] Updated weights for policy 1, policy_version 1724375 (0.0008) [2023-12-28 07:37:31,261][106225] Updated weights for policy 1, policy_version 1724385 (0.0008) [2023-12-28 07:37:31,605][106226] Updated weights for policy 0, policy_version 1720367 (0.0008) [2023-12-28 07:37:31,673][106226] Updated weights for policy 0, policy_version 1720377 (0.0008) [2023-12-28 07:37:31,743][106226] Updated weights for policy 0, policy_version 1720387 (0.0009) [2023-12-28 07:37:32,017][106225] Updated weights for policy 1, policy_version 1724395 (0.0009) [2023-12-28 07:37:32,077][106225] Updated weights for policy 1, policy_version 1724405 (0.0007) [2023-12-28 07:37:32,140][106225] Updated weights for policy 1, policy_version 1724415 (0.0011) [2023-12-28 07:37:32,382][106226] Updated weights for policy 0, policy_version 1720397 (0.0007) [2023-12-28 07:37:32,438][106226] Updated weights for policy 0, policy_version 1720407 (0.0007) [2023-12-28 07:37:32,487][106226] Updated weights for policy 0, policy_version 1720417 (0.0007) [2023-12-28 07:37:32,865][106225] Updated weights for policy 1, policy_version 1724425 (0.0010) [2023-12-28 07:37:32,922][106225] Updated weights for policy 1, policy_version 1724435 (0.0005) [2023-12-28 07:37:32,976][106225] Updated weights for policy 1, policy_version 1724445 (0.0006) [2023-12-28 07:37:33,025][106225] Updated weights for policy 1, policy_version 1724455 (0.0007) [2023-12-28 07:37:33,160][106226] Updated weights for policy 0, policy_version 1720427 (0.0007) [2023-12-28 07:37:33,215][106226] Updated weights for policy 0, policy_version 1720437 (0.0008) [2023-12-28 07:37:33,274][106226] Updated weights for policy 0, policy_version 1720447 (0.0009) [2023-12-28 07:37:33,714][106225] Updated weights for policy 1, policy_version 1724465 (0.0005) [2023-12-28 07:37:33,763][106225] Updated weights for policy 1, policy_version 1724475 (0.0008) [2023-12-28 07:37:33,815][106225] Updated weights for policy 1, policy_version 1724485 (0.0008) [2023-12-28 07:37:33,826][106226] Updated weights for policy 0, policy_version 1720457 (0.0007) [2023-12-28 07:37:33,880][106226] Updated weights for policy 0, policy_version 1720467 (0.0006) [2023-12-28 07:37:33,927][106226] Updated weights for policy 0, policy_version 1720477 (0.0008) [2023-12-28 07:37:33,982][106226] Updated weights for policy 0, policy_version 1720487 (0.0008) [2023-12-28 07:37:34,595][106225] Updated weights for policy 1, policy_version 1724495 (0.0008) [2023-12-28 07:37:34,649][106225] Updated weights for policy 1, policy_version 1724505 (0.0006) [2023-12-28 07:37:34,658][106226] Updated weights for policy 0, policy_version 1720497 (0.0008) [2023-12-28 07:37:34,709][106225] Updated weights for policy 1, policy_version 1724515 (0.0007) [2023-12-28 07:37:34,719][106226] Updated weights for policy 0, policy_version 1720507 (0.0008) [2023-12-28 07:37:34,773][106226] Updated weights for policy 0, policy_version 1720517 (0.0007) [2023-12-28 07:37:35,450][106225] Updated weights for policy 1, policy_version 1724525 (0.0008) [2023-12-28 07:37:35,461][106226] Updated weights for policy 0, policy_version 1720527 (0.0006) [2023-12-28 07:37:35,506][106225] Updated weights for policy 1, policy_version 1724535 (0.0008) [2023-12-28 07:37:35,507][106226] Updated weights for policy 0, policy_version 1720537 (0.0005) [2023-12-28 07:37:35,558][106225] Updated weights for policy 1, policy_version 1724545 (0.0007) [2023-12-28 07:37:35,568][106226] Updated weights for policy 0, policy_version 1720547 (0.0005) [2023-12-28 07:37:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 882081792. Throughput: 0: 9882.3, 1: 9849.4. Samples: 882095544. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:36,178][105115] Avg episode reward: [(0, '-4.616'), (1, '-5.216')] [2023-12-28 07:37:36,222][106226] Updated weights for policy 0, policy_version 1720557 (0.0006) [2023-12-28 07:37:36,280][106226] Updated weights for policy 0, policy_version 1720567 (0.0008) [2023-12-28 07:37:36,343][106226] Updated weights for policy 0, policy_version 1720577 (0.0007) [2023-12-28 07:37:36,346][106225] Updated weights for policy 1, policy_version 1724555 (0.0007) [2023-12-28 07:37:36,405][106225] Updated weights for policy 1, policy_version 1724565 (0.0008) [2023-12-28 07:37:36,472][106225] Updated weights for policy 1, policy_version 1724575 (0.0008) [2023-12-28 07:37:37,016][106226] Updated weights for policy 0, policy_version 1720587 (0.0006) [2023-12-28 07:37:37,072][106226] Updated weights for policy 0, policy_version 1720597 (0.0009) [2023-12-28 07:37:37,128][106226] Updated weights for policy 0, policy_version 1720607 (0.0009) [2023-12-28 07:37:37,215][106225] Updated weights for policy 1, policy_version 1724585 (0.0009) [2023-12-28 07:37:37,271][106225] Updated weights for policy 1, policy_version 1724595 (0.0009) [2023-12-28 07:37:37,323][106225] Updated weights for policy 1, policy_version 1724605 (0.0008) [2023-12-28 07:37:37,385][106225] Updated weights for policy 1, policy_version 1724615 (0.0009) [2023-12-28 07:37:37,815][106226] Updated weights for policy 0, policy_version 1720617 (0.0009) [2023-12-28 07:37:37,883][106226] Updated weights for policy 0, policy_version 1720627 (0.0009) [2023-12-28 07:37:37,942][106226] Updated weights for policy 0, policy_version 1720637 (0.0010) [2023-12-28 07:37:38,005][106226] Updated weights for policy 0, policy_version 1720647 (0.0008) [2023-12-28 07:37:38,132][106225] Updated weights for policy 1, policy_version 1724625 (0.0007) [2023-12-28 07:37:38,179][106225] Updated weights for policy 1, policy_version 1724635 (0.0008) [2023-12-28 07:37:38,237][106225] Updated weights for policy 1, policy_version 1724645 (0.0007) [2023-12-28 07:37:38,654][106226] Updated weights for policy 0, policy_version 1720657 (0.0010) [2023-12-28 07:37:38,717][106226] Updated weights for policy 0, policy_version 1720667 (0.0011) [2023-12-28 07:37:38,780][106226] Updated weights for policy 0, policy_version 1720677 (0.0011) [2023-12-28 07:37:38,995][106225] Updated weights for policy 1, policy_version 1724655 (0.0008) [2023-12-28 07:37:39,048][106225] Updated weights for policy 1, policy_version 1724665 (0.0008) [2023-12-28 07:37:39,116][106225] Updated weights for policy 1, policy_version 1724675 (0.0008) [2023-12-28 07:37:39,508][106226] Updated weights for policy 0, policy_version 1720687 (0.0007) [2023-12-28 07:37:39,575][106226] Updated weights for policy 0, policy_version 1720697 (0.0006) [2023-12-28 07:37:39,638][106226] Updated weights for policy 0, policy_version 1720707 (0.0006) [2023-12-28 07:37:39,891][106225] Updated weights for policy 1, policy_version 1724685 (0.0007) [2023-12-28 07:37:39,959][106225] Updated weights for policy 1, policy_version 1724695 (0.0008) [2023-12-28 07:37:40,017][106225] Updated weights for policy 1, policy_version 1724705 (0.0009) [2023-12-28 07:37:40,252][106226] Updated weights for policy 0, policy_version 1720717 (0.0008) [2023-12-28 07:37:40,308][106226] Updated weights for policy 0, policy_version 1720727 (0.0009) [2023-12-28 07:37:40,370][106226] Updated weights for policy 0, policy_version 1720737 (0.0008) [2023-12-28 07:37:40,747][106225] Updated weights for policy 1, policy_version 1724715 (0.0008) [2023-12-28 07:37:40,796][106225] Updated weights for policy 1, policy_version 1724725 (0.0008) [2023-12-28 07:37:40,848][106225] Updated weights for policy 1, policy_version 1724735 (0.0008) [2023-12-28 07:37:41,052][106226] Updated weights for policy 0, policy_version 1720747 (0.0008) [2023-12-28 07:37:41,116][106226] Updated weights for policy 0, policy_version 1720757 (0.0009) [2023-12-28 07:37:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 882180096. Throughput: 0: 9884.8, 1: 9856.2. Samples: 882153404. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:41,176][105115] Avg episode reward: [(0, '-4.457'), (1, '-5.004')] [2023-12-28 07:37:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001724744_441589760.pth... [2023-12-28 07:37:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001723592_441294848.pth [2023-12-28 07:37:41,190][106226] Updated weights for policy 0, policy_version 1720767 (0.0008) [2023-12-28 07:37:41,240][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001720776_440598528.pth... [2023-12-28 07:37:41,244][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001719592_440295424.pth [2023-12-28 07:37:41,633][106225] Updated weights for policy 1, policy_version 1724745 (0.0008) [2023-12-28 07:37:41,702][106225] Updated weights for policy 1, policy_version 1724755 (0.0010) [2023-12-28 07:37:41,771][106225] Updated weights for policy 1, policy_version 1724765 (0.0009) [2023-12-28 07:37:41,839][106225] Updated weights for policy 1, policy_version 1724775 (0.0009) [2023-12-28 07:37:41,929][106226] Updated weights for policy 0, policy_version 1720777 (0.0008) [2023-12-28 07:37:41,992][106226] Updated weights for policy 0, policy_version 1720787 (0.0006) [2023-12-28 07:37:42,055][106226] Updated weights for policy 0, policy_version 1720797 (0.0007) [2023-12-28 07:37:42,121][106226] Updated weights for policy 0, policy_version 1720807 (0.0008) [2023-12-28 07:37:42,641][106225] Updated weights for policy 1, policy_version 1724785 (0.0005) [2023-12-28 07:37:42,709][106225] Updated weights for policy 1, policy_version 1724795 (0.0005) [2023-12-28 07:37:42,764][106225] Updated weights for policy 1, policy_version 1724805 (0.0006) [2023-12-28 07:37:42,807][106226] Updated weights for policy 0, policy_version 1720817 (0.0008) [2023-12-28 07:37:42,864][106226] Updated weights for policy 0, policy_version 1720827 (0.0007) [2023-12-28 07:37:42,915][106226] Updated weights for policy 0, policy_version 1720837 (0.0009) [2023-12-28 07:37:43,295][106225] Updated weights for policy 1, policy_version 1724815 (0.0009) [2023-12-28 07:37:43,346][106225] Updated weights for policy 1, policy_version 1724825 (0.0008) [2023-12-28 07:37:43,401][106225] Updated weights for policy 1, policy_version 1724835 (0.0008) [2023-12-28 07:37:43,698][106226] Updated weights for policy 0, policy_version 1720847 (0.0008) [2023-12-28 07:37:43,750][106226] Updated weights for policy 0, policy_version 1720857 (0.0008) [2023-12-28 07:37:43,799][106226] Updated weights for policy 0, policy_version 1720867 (0.0008) [2023-12-28 07:37:44,072][106225] Updated weights for policy 1, policy_version 1724845 (0.0009) [2023-12-28 07:37:44,126][106225] Updated weights for policy 1, policy_version 1724855 (0.0006) [2023-12-28 07:37:44,190][106225] Updated weights for policy 1, policy_version 1724865 (0.0009) [2023-12-28 07:37:44,517][106226] Updated weights for policy 0, policy_version 1720877 (0.0007) [2023-12-28 07:37:44,573][106226] Updated weights for policy 0, policy_version 1720887 (0.0007) [2023-12-28 07:37:44,632][106226] Updated weights for policy 0, policy_version 1720897 (0.0005) [2023-12-28 07:37:44,926][106225] Updated weights for policy 1, policy_version 1724875 (0.0008) [2023-12-28 07:37:44,987][106225] Updated weights for policy 1, policy_version 1724885 (0.0009) [2023-12-28 07:37:45,050][106225] Updated weights for policy 1, policy_version 1724895 (0.0008) [2023-12-28 07:37:45,332][106226] Updated weights for policy 0, policy_version 1720907 (0.0006) [2023-12-28 07:37:45,402][106226] Updated weights for policy 0, policy_version 1720917 (0.0007) [2023-12-28 07:37:45,457][106226] Updated weights for policy 0, policy_version 1720927 (0.0008) [2023-12-28 07:37:45,742][106225] Updated weights for policy 1, policy_version 1724905 (0.0008) [2023-12-28 07:37:45,798][106225] Updated weights for policy 1, policy_version 1724915 (0.0005) [2023-12-28 07:37:45,852][106225] Updated weights for policy 1, policy_version 1724925 (0.0005) [2023-12-28 07:37:45,910][106225] Updated weights for policy 1, policy_version 1724935 (0.0005) [2023-12-28 07:37:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 882278400. Throughput: 0: 9861.3, 1: 9833.1. Samples: 882269496. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:46,176][105115] Avg episode reward: [(0, '-4.188'), (1, '-4.950')] [2023-12-28 07:37:46,200][106226] Updated weights for policy 0, policy_version 1720937 (0.0009) [2023-12-28 07:37:46,259][106226] Updated weights for policy 0, policy_version 1720947 (0.0010) [2023-12-28 07:37:46,329][106226] Updated weights for policy 0, policy_version 1720957 (0.0010) [2023-12-28 07:37:46,389][106226] Updated weights for policy 0, policy_version 1720967 (0.0011) [2023-12-28 07:37:46,499][106225] Updated weights for policy 1, policy_version 1724945 (0.0007) [2023-12-28 07:37:46,550][106225] Updated weights for policy 1, policy_version 1724955 (0.0007) [2023-12-28 07:37:46,597][106225] Updated weights for policy 1, policy_version 1724965 (0.0008) [2023-12-28 07:37:47,075][106226] Updated weights for policy 0, policy_version 1720977 (0.0011) [2023-12-28 07:37:47,135][106226] Updated weights for policy 0, policy_version 1720987 (0.0011) [2023-12-28 07:37:47,192][106226] Updated weights for policy 0, policy_version 1720997 (0.0011) [2023-12-28 07:37:47,373][106225] Updated weights for policy 1, policy_version 1724975 (0.0008) [2023-12-28 07:37:47,424][106225] Updated weights for policy 1, policy_version 1724985 (0.0007) [2023-12-28 07:37:47,481][106225] Updated weights for policy 1, policy_version 1724995 (0.0008) [2023-12-28 07:37:47,904][106226] Updated weights for policy 0, policy_version 1721007 (0.0011) [2023-12-28 07:37:47,956][106226] Updated weights for policy 0, policy_version 1721017 (0.0008) [2023-12-28 07:37:48,011][106226] Updated weights for policy 0, policy_version 1721027 (0.0010) [2023-12-28 07:37:48,179][106225] Updated weights for policy 1, policy_version 1725005 (0.0007) [2023-12-28 07:37:48,235][106225] Updated weights for policy 1, policy_version 1725015 (0.0005) [2023-12-28 07:37:48,281][106225] Updated weights for policy 1, policy_version 1725025 (0.0005) [2023-12-28 07:37:48,820][106226] Updated weights for policy 0, policy_version 1721037 (0.0009) [2023-12-28 07:37:48,883][106226] Updated weights for policy 0, policy_version 1721047 (0.0009) [2023-12-28 07:37:48,946][106226] Updated weights for policy 0, policy_version 1721057 (0.0008) [2023-12-28 07:37:48,948][106225] Updated weights for policy 1, policy_version 1725035 (0.0006) [2023-12-28 07:37:49,003][106225] Updated weights for policy 1, policy_version 1725045 (0.0007) [2023-12-28 07:37:49,061][106225] Updated weights for policy 1, policy_version 1725055 (0.0008) [2023-12-28 07:37:49,733][106226] Updated weights for policy 0, policy_version 1721067 (0.0008) [2023-12-28 07:37:49,778][106225] Updated weights for policy 1, policy_version 1725065 (0.0009) [2023-12-28 07:37:49,792][106226] Updated weights for policy 0, policy_version 1721077 (0.0008) [2023-12-28 07:37:49,848][106225] Updated weights for policy 1, policy_version 1725075 (0.0008) [2023-12-28 07:37:49,859][106226] Updated weights for policy 0, policy_version 1721087 (0.0007) [2023-12-28 07:37:49,908][106225] Updated weights for policy 1, policy_version 1725085 (0.0009) [2023-12-28 07:37:49,978][106225] Updated weights for policy 1, policy_version 1725095 (0.0009) [2023-12-28 07:37:50,588][106226] Updated weights for policy 0, policy_version 1721097 (0.0006) [2023-12-28 07:37:50,651][106226] Updated weights for policy 0, policy_version 1721107 (0.0008) [2023-12-28 07:37:50,713][106226] Updated weights for policy 0, policy_version 1721117 (0.0008) [2023-12-28 07:37:50,719][106225] Updated weights for policy 1, policy_version 1725105 (0.0007) [2023-12-28 07:37:50,772][106226] Updated weights for policy 0, policy_version 1721127 (0.0007) [2023-12-28 07:37:50,781][106225] Updated weights for policy 1, policy_version 1725115 (0.0006) [2023-12-28 07:37:50,831][106225] Updated weights for policy 1, policy_version 1725125 (0.0009) [2023-12-28 07:37:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 882376704. Throughput: 0: 9841.1, 1: 9792.5. Samples: 882385988. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:51,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.987')] [2023-12-28 07:37:51,420][106226] Updated weights for policy 0, policy_version 1721137 (0.0009) [2023-12-28 07:37:51,477][106226] Updated weights for policy 0, policy_version 1721147 (0.0009) [2023-12-28 07:37:51,541][106226] Updated weights for policy 0, policy_version 1721157 (0.0009) [2023-12-28 07:37:51,588][106225] Updated weights for policy 1, policy_version 1725135 (0.0008) [2023-12-28 07:37:51,660][106225] Updated weights for policy 1, policy_version 1725145 (0.0008) [2023-12-28 07:37:51,736][106225] Updated weights for policy 1, policy_version 1725155 (0.0009) [2023-12-28 07:37:52,317][106226] Updated weights for policy 0, policy_version 1721167 (0.0008) [2023-12-28 07:37:52,383][106226] Updated weights for policy 0, policy_version 1721177 (0.0009) [2023-12-28 07:37:52,442][106226] Updated weights for policy 0, policy_version 1721187 (0.0009) [2023-12-28 07:37:52,476][106225] Updated weights for policy 1, policy_version 1725165 (0.0008) [2023-12-28 07:37:52,534][106225] Updated weights for policy 1, policy_version 1725175 (0.0007) [2023-12-28 07:37:52,592][106225] Updated weights for policy 1, policy_version 1725185 (0.0007) [2023-12-28 07:37:53,204][106226] Updated weights for policy 0, policy_version 1721197 (0.0010) [2023-12-28 07:37:53,216][106225] Updated weights for policy 1, policy_version 1725195 (0.0008) [2023-12-28 07:37:53,264][106225] Updated weights for policy 1, policy_version 1725205 (0.0007) [2023-12-28 07:37:53,266][106226] Updated weights for policy 0, policy_version 1721207 (0.0010) [2023-12-28 07:37:53,310][106225] Updated weights for policy 1, policy_version 1725215 (0.0007) [2023-12-28 07:37:53,325][106226] Updated weights for policy 0, policy_version 1721217 (0.0010) [2023-12-28 07:37:53,910][106226] Updated weights for policy 0, policy_version 1721227 (0.0009) [2023-12-28 07:37:53,970][106226] Updated weights for policy 0, policy_version 1721237 (0.0011) [2023-12-28 07:37:53,998][106225] Updated weights for policy 1, policy_version 1725225 (0.0007) [2023-12-28 07:37:54,023][106226] Updated weights for policy 0, policy_version 1721247 (0.0010) [2023-12-28 07:37:54,056][106225] Updated weights for policy 1, policy_version 1725235 (0.0005) [2023-12-28 07:37:54,112][106225] Updated weights for policy 1, policy_version 1725245 (0.0007) [2023-12-28 07:37:54,173][106225] Updated weights for policy 1, policy_version 1725255 (0.0006) [2023-12-28 07:37:54,672][106226] Updated weights for policy 0, policy_version 1721257 (0.0010) [2023-12-28 07:37:54,730][106226] Updated weights for policy 0, policy_version 1721267 (0.0007) [2023-12-28 07:37:54,742][106225] Updated weights for policy 1, policy_version 1725265 (0.0006) [2023-12-28 07:37:54,784][106226] Updated weights for policy 0, policy_version 1721277 (0.0005) [2023-12-28 07:37:54,803][106225] Updated weights for policy 1, policy_version 1725275 (0.0009) [2023-12-28 07:37:54,834][106226] Updated weights for policy 0, policy_version 1721287 (0.0005) [2023-12-28 07:37:54,863][106225] Updated weights for policy 1, policy_version 1725285 (0.0010) [2023-12-28 07:37:55,433][106226] Updated weights for policy 0, policy_version 1721297 (0.0005) [2023-12-28 07:37:55,496][106226] Updated weights for policy 0, policy_version 1721307 (0.0010) [2023-12-28 07:37:55,499][106225] Updated weights for policy 1, policy_version 1725295 (0.0010) [2023-12-28 07:37:55,549][106225] Updated weights for policy 1, policy_version 1725305 (0.0010) [2023-12-28 07:37:55,552][106226] Updated weights for policy 0, policy_version 1721317 (0.0010) [2023-12-28 07:37:55,599][106225] Updated weights for policy 1, policy_version 1725315 (0.0010) [2023-12-28 07:37:56,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 882475008. Throughput: 0: 9868.1, 1: 9742.7. Samples: 882443696. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:37:56,175][105115] Avg episode reward: [(0, '-4.151'), (1, '-4.603')] [2023-12-28 07:37:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001725320_441737216.pth... [2023-12-28 07:37:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001724200_441450496.pth [2023-12-28 07:37:56,213][106226] Updated weights for policy 0, policy_version 1721327 (0.0011) [2023-12-28 07:37:56,270][106226] Updated weights for policy 0, policy_version 1721337 (0.0011) [2023-12-28 07:37:56,335][106225] Updated weights for policy 1, policy_version 1725325 (0.0010) [2023-12-28 07:37:56,337][106226] Updated weights for policy 0, policy_version 1721347 (0.0011) [2023-12-28 07:37:56,362][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001721352_440745984.pth... [2023-12-28 07:37:56,365][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001720168_440442880.pth [2023-12-28 07:37:56,385][106225] Updated weights for policy 1, policy_version 1725335 (0.0010) [2023-12-28 07:37:56,442][106225] Updated weights for policy 1, policy_version 1725345 (0.0010) [2023-12-28 07:37:57,040][106226] Updated weights for policy 0, policy_version 1721357 (0.0011) [2023-12-28 07:37:57,101][106226] Updated weights for policy 0, policy_version 1721367 (0.0010) [2023-12-28 07:37:57,160][106226] Updated weights for policy 0, policy_version 1721377 (0.0010) [2023-12-28 07:37:57,178][106225] Updated weights for policy 1, policy_version 1725355 (0.0010) [2023-12-28 07:37:57,235][106225] Updated weights for policy 1, policy_version 1725365 (0.0010) [2023-12-28 07:37:57,299][106225] Updated weights for policy 1, policy_version 1725375 (0.0010) [2023-12-28 07:37:57,836][106226] Updated weights for policy 0, policy_version 1721387 (0.0007) [2023-12-28 07:37:57,883][106226] Updated weights for policy 0, policy_version 1721397 (0.0010) [2023-12-28 07:37:57,929][106226] Updated weights for policy 0, policy_version 1721407 (0.0010) [2023-12-28 07:37:58,031][106225] Updated weights for policy 1, policy_version 1725385 (0.0010) [2023-12-28 07:37:58,088][106225] Updated weights for policy 1, policy_version 1725395 (0.0010) [2023-12-28 07:37:58,141][106225] Updated weights for policy 1, policy_version 1725405 (0.0010) [2023-12-28 07:37:58,190][106225] Updated weights for policy 1, policy_version 1725415 (0.0010) [2023-12-28 07:37:58,685][106226] Updated weights for policy 0, policy_version 1721417 (0.0010) [2023-12-28 07:37:58,768][106226] Updated weights for policy 0, policy_version 1721427 (0.0008) [2023-12-28 07:37:58,835][106226] Updated weights for policy 0, policy_version 1721437 (0.0007) [2023-12-28 07:37:58,913][106226] Updated weights for policy 0, policy_version 1721447 (0.0008) [2023-12-28 07:37:59,074][106225] Updated weights for policy 1, policy_version 1725425 (0.0008) [2023-12-28 07:37:59,137][106225] Updated weights for policy 1, policy_version 1725435 (0.0008) [2023-12-28 07:37:59,202][106225] Updated weights for policy 1, policy_version 1725445 (0.0009) [2023-12-28 07:37:59,638][106226] Updated weights for policy 0, policy_version 1721457 (0.0007) [2023-12-28 07:37:59,700][106226] Updated weights for policy 0, policy_version 1721467 (0.0008) [2023-12-28 07:37:59,750][106226] Updated weights for policy 0, policy_version 1721477 (0.0010) [2023-12-28 07:37:59,985][106225] Updated weights for policy 1, policy_version 1725455 (0.0008) [2023-12-28 07:38:00,040][106225] Updated weights for policy 1, policy_version 1725465 (0.0008) [2023-12-28 07:38:00,097][106225] Updated weights for policy 1, policy_version 1725475 (0.0008) [2023-12-28 07:38:00,542][106226] Updated weights for policy 0, policy_version 1721487 (0.0007) [2023-12-28 07:38:00,609][106226] Updated weights for policy 0, policy_version 1721497 (0.0007) [2023-12-28 07:38:00,657][106226] Updated weights for policy 0, policy_version 1721507 (0.0008) [2023-12-28 07:38:00,731][106225] Updated weights for policy 1, policy_version 1725485 (0.0009) [2023-12-28 07:38:00,787][106225] Updated weights for policy 1, policy_version 1725495 (0.0009) [2023-12-28 07:38:00,840][106225] Updated weights for policy 1, policy_version 1725505 (0.0009) [2023-12-28 07:38:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 882573312. Throughput: 0: 9885.9, 1: 9834.6. Samples: 882562908. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:38:01,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.838')] [2023-12-28 07:38:01,317][106226] Updated weights for policy 0, policy_version 1721517 (0.0008) [2023-12-28 07:38:01,383][106226] Updated weights for policy 0, policy_version 1721527 (0.0009) [2023-12-28 07:38:01,435][106226] Updated weights for policy 0, policy_version 1721537 (0.0009) [2023-12-28 07:38:01,579][106225] Updated weights for policy 1, policy_version 1725515 (0.0009) [2023-12-28 07:38:01,644][106225] Updated weights for policy 1, policy_version 1725525 (0.0008) [2023-12-28 07:38:01,700][106225] Updated weights for policy 1, policy_version 1725535 (0.0008) [2023-12-28 07:38:02,217][106226] Updated weights for policy 0, policy_version 1721547 (0.0009) [2023-12-28 07:38:02,283][106226] Updated weights for policy 0, policy_version 1721557 (0.0009) [2023-12-28 07:38:02,343][106226] Updated weights for policy 0, policy_version 1721567 (0.0009) [2023-12-28 07:38:02,402][106225] Updated weights for policy 1, policy_version 1725545 (0.0008) [2023-12-28 07:38:02,465][106225] Updated weights for policy 1, policy_version 1725555 (0.0007) [2023-12-28 07:38:02,529][106225] Updated weights for policy 1, policy_version 1725565 (0.0007) [2023-12-28 07:38:02,589][106225] Updated weights for policy 1, policy_version 1725575 (0.0008) [2023-12-28 07:38:03,134][106226] Updated weights for policy 0, policy_version 1721577 (0.0008) [2023-12-28 07:38:03,184][106225] Updated weights for policy 1, policy_version 1725585 (0.0009) [2023-12-28 07:38:03,194][106226] Updated weights for policy 0, policy_version 1721587 (0.0006) [2023-12-28 07:38:03,248][106225] Updated weights for policy 1, policy_version 1725595 (0.0007) [2023-12-28 07:38:03,253][106226] Updated weights for policy 0, policy_version 1721597 (0.0006) [2023-12-28 07:38:03,308][106225] Updated weights for policy 1, policy_version 1725605 (0.0008) [2023-12-28 07:38:03,312][106226] Updated weights for policy 0, policy_version 1721607 (0.0005) [2023-12-28 07:38:03,853][106226] Updated weights for policy 0, policy_version 1721617 (0.0007) [2023-12-28 07:38:03,915][106226] Updated weights for policy 0, policy_version 1721627 (0.0008) [2023-12-28 07:38:03,978][106226] Updated weights for policy 0, policy_version 1721637 (0.0007) [2023-12-28 07:38:04,083][106225] Updated weights for policy 1, policy_version 1725615 (0.0009) [2023-12-28 07:38:04,144][106225] Updated weights for policy 1, policy_version 1725625 (0.0008) [2023-12-28 07:38:04,203][106225] Updated weights for policy 1, policy_version 1725635 (0.0005) [2023-12-28 07:38:04,638][106226] Updated weights for policy 0, policy_version 1721647 (0.0007) [2023-12-28 07:38:04,694][106226] Updated weights for policy 0, policy_version 1721657 (0.0008) [2023-12-28 07:38:04,749][106226] Updated weights for policy 0, policy_version 1721667 (0.0008) [2023-12-28 07:38:04,835][106225] Updated weights for policy 1, policy_version 1725645 (0.0007) [2023-12-28 07:38:04,895][106225] Updated weights for policy 1, policy_version 1725655 (0.0009) [2023-12-28 07:38:04,942][106225] Updated weights for policy 1, policy_version 1725665 (0.0010) [2023-12-28 07:38:05,482][106226] Updated weights for policy 0, policy_version 1721677 (0.0010) [2023-12-28 07:38:05,548][106226] Updated weights for policy 0, policy_version 1721687 (0.0009) [2023-12-28 07:38:05,577][106225] Updated weights for policy 1, policy_version 1725675 (0.0009) [2023-12-28 07:38:05,606][106226] Updated weights for policy 0, policy_version 1721697 (0.0009) [2023-12-28 07:38:05,628][106225] Updated weights for policy 1, policy_version 1725685 (0.0005) [2023-12-28 07:38:05,679][106225] Updated weights for policy 1, policy_version 1725695 (0.0005) [2023-12-28 07:38:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 882671616. Throughput: 0: 9929.4, 1: 9829.4. Samples: 882682632. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:38:06,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-5.068')] [2023-12-28 07:38:06,211][106225] Updated weights for policy 1, policy_version 1725705 (0.0006) [2023-12-28 07:38:06,273][106225] Updated weights for policy 1, policy_version 1725715 (0.0009) [2023-12-28 07:38:06,333][106225] Updated weights for policy 1, policy_version 1725725 (0.0008) [2023-12-28 07:38:06,339][106226] Updated weights for policy 0, policy_version 1721707 (0.0008) [2023-12-28 07:38:06,396][106225] Updated weights for policy 1, policy_version 1725735 (0.0005) [2023-12-28 07:38:06,398][106226] Updated weights for policy 0, policy_version 1721717 (0.0007) [2023-12-28 07:38:06,465][106226] Updated weights for policy 0, policy_version 1721727 (0.0009) [2023-12-28 07:38:07,119][106225] Updated weights for policy 1, policy_version 1725745 (0.0009) [2023-12-28 07:38:07,162][106226] Updated weights for policy 0, policy_version 1721737 (0.0008) [2023-12-28 07:38:07,176][106225] Updated weights for policy 1, policy_version 1725755 (0.0007) [2023-12-28 07:38:07,217][106226] Updated weights for policy 0, policy_version 1721747 (0.0009) [2023-12-28 07:38:07,226][106225] Updated weights for policy 1, policy_version 1725765 (0.0009) [2023-12-28 07:38:07,271][106226] Updated weights for policy 0, policy_version 1721757 (0.0007) [2023-12-28 07:38:07,337][106226] Updated weights for policy 0, policy_version 1721767 (0.0008) [2023-12-28 07:38:07,922][106225] Updated weights for policy 1, policy_version 1725775 (0.0007) [2023-12-28 07:38:07,980][106225] Updated weights for policy 1, policy_version 1725785 (0.0005) [2023-12-28 07:38:08,047][106225] Updated weights for policy 1, policy_version 1725795 (0.0008) [2023-12-28 07:38:08,067][106226] Updated weights for policy 0, policy_version 1721777 (0.0007) [2023-12-28 07:38:08,126][106226] Updated weights for policy 0, policy_version 1721787 (0.0007) [2023-12-28 07:38:08,182][106226] Updated weights for policy 0, policy_version 1721797 (0.0010) [2023-12-28 07:38:08,722][106225] Updated weights for policy 1, policy_version 1725805 (0.0009) [2023-12-28 07:38:08,786][106225] Updated weights for policy 1, policy_version 1725815 (0.0005) [2023-12-28 07:38:08,843][106225] Updated weights for policy 1, policy_version 1725825 (0.0006) [2023-12-28 07:38:08,877][106226] Updated weights for policy 0, policy_version 1721807 (0.0011) [2023-12-28 07:38:08,930][106226] Updated weights for policy 0, policy_version 1721817 (0.0011) [2023-12-28 07:38:08,986][106226] Updated weights for policy 0, policy_version 1721827 (0.0010) [2023-12-28 07:38:09,568][106225] Updated weights for policy 1, policy_version 1725835 (0.0007) [2023-12-28 07:38:09,633][106225] Updated weights for policy 1, policy_version 1725845 (0.0009) [2023-12-28 07:38:09,689][106225] Updated weights for policy 1, policy_version 1725855 (0.0009) [2023-12-28 07:38:09,703][106226] Updated weights for policy 0, policy_version 1721837 (0.0008) [2023-12-28 07:38:09,767][106226] Updated weights for policy 0, policy_version 1721847 (0.0007) [2023-12-28 07:38:09,840][106226] Updated weights for policy 0, policy_version 1721857 (0.0009) [2023-12-28 07:38:10,478][106226] Updated weights for policy 0, policy_version 1721867 (0.0009) [2023-12-28 07:38:10,501][106225] Updated weights for policy 1, policy_version 1725865 (0.0007) [2023-12-28 07:38:10,535][106226] Updated weights for policy 0, policy_version 1721877 (0.0007) [2023-12-28 07:38:10,557][106225] Updated weights for policy 1, policy_version 1725875 (0.0007) [2023-12-28 07:38:10,602][106226] Updated weights for policy 0, policy_version 1721887 (0.0006) [2023-12-28 07:38:10,615][106225] Updated weights for policy 1, policy_version 1725885 (0.0007) [2023-12-28 07:38:10,671][106225] Updated weights for policy 1, policy_version 1725896 (0.0009) [2023-12-28 07:38:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 882769920. Throughput: 0: 9909.3, 1: 9852.3. Samples: 882742904. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:38:11,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.786')] [2023-12-28 07:38:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001725896_441884672.pth... [2023-12-28 07:38:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001721896_440885248.pth... [2023-12-28 07:38:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001720776_440598528.pth [2023-12-28 07:38:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001724744_441589760.pth [2023-12-28 07:38:11,218][106226] Updated weights for policy 0, policy_version 1721897 (0.0006) [2023-12-28 07:38:11,285][106226] Updated weights for policy 0, policy_version 1721907 (0.0007) [2023-12-28 07:38:11,354][106226] Updated weights for policy 0, policy_version 1721917 (0.0007) [2023-12-28 07:38:11,400][106225] Updated weights for policy 1, policy_version 1725906 (0.0008) [2023-12-28 07:38:11,439][106226] Updated weights for policy 0, policy_version 1721927 (0.0007) [2023-12-28 07:38:11,464][106225] Updated weights for policy 1, policy_version 1725916 (0.0006) [2023-12-28 07:38:11,520][106225] Updated weights for policy 1, policy_version 1725926 (0.0009) [2023-12-28 07:38:12,151][106226] Updated weights for policy 0, policy_version 1721937 (0.0008) [2023-12-28 07:38:12,220][106226] Updated weights for policy 0, policy_version 1721947 (0.0007) [2023-12-28 07:38:12,226][106225] Updated weights for policy 1, policy_version 1725936 (0.0007) [2023-12-28 07:38:12,286][106225] Updated weights for policy 1, policy_version 1725946 (0.0008) [2023-12-28 07:38:12,286][106226] Updated weights for policy 0, policy_version 1721957 (0.0008) [2023-12-28 07:38:12,351][106225] Updated weights for policy 1, policy_version 1725956 (0.0008) [2023-12-28 07:38:13,001][106226] Updated weights for policy 0, policy_version 1721967 (0.0009) [2023-12-28 07:38:13,055][106226] Updated weights for policy 0, policy_version 1721977 (0.0011) [2023-12-28 07:38:13,097][106225] Updated weights for policy 1, policy_version 1725966 (0.0006) [2023-12-28 07:38:13,112][106226] Updated weights for policy 0, policy_version 1721987 (0.0011) [2023-12-28 07:38:13,148][106225] Updated weights for policy 1, policy_version 1725976 (0.0007) [2023-12-28 07:38:13,205][106225] Updated weights for policy 1, policy_version 1725986 (0.0008) [2023-12-28 07:38:13,741][106226] Updated weights for policy 0, policy_version 1721997 (0.0008) [2023-12-28 07:38:13,797][106226] Updated weights for policy 0, policy_version 1722007 (0.0005) [2023-12-28 07:38:13,854][106226] Updated weights for policy 0, policy_version 1722017 (0.0008) [2023-12-28 07:38:14,002][106225] Updated weights for policy 1, policy_version 1725996 (0.0009) [2023-12-28 07:38:14,069][106225] Updated weights for policy 1, policy_version 1726006 (0.0007) [2023-12-28 07:38:14,125][106225] Updated weights for policy 1, policy_version 1726016 (0.0008) [2023-12-28 07:38:14,496][106226] Updated weights for policy 0, policy_version 1722027 (0.0011) [2023-12-28 07:38:14,545][106226] Updated weights for policy 0, policy_version 1722037 (0.0010) [2023-12-28 07:38:14,595][106226] Updated weights for policy 0, policy_version 1722047 (0.0010) [2023-12-28 07:38:14,890][106225] Updated weights for policy 1, policy_version 1726026 (0.0007) [2023-12-28 07:38:14,957][106225] Updated weights for policy 1, policy_version 1726036 (0.0007) [2023-12-28 07:38:15,022][106225] Updated weights for policy 1, policy_version 1726046 (0.0007) [2023-12-28 07:38:15,088][106225] Updated weights for policy 1, policy_version 1726056 (0.0008) [2023-12-28 07:38:15,339][106226] Updated weights for policy 0, policy_version 1722057 (0.0010) [2023-12-28 07:38:15,395][106226] Updated weights for policy 0, policy_version 1722067 (0.0009) [2023-12-28 07:38:15,453][106226] Updated weights for policy 0, policy_version 1722077 (0.0008) [2023-12-28 07:38:15,511][106226] Updated weights for policy 0, policy_version 1722087 (0.0009) [2023-12-28 07:38:15,782][106225] Updated weights for policy 1, policy_version 1726066 (0.0009) [2023-12-28 07:38:15,842][106225] Updated weights for policy 1, policy_version 1726076 (0.0005) [2023-12-28 07:38:15,910][106225] Updated weights for policy 1, policy_version 1726086 (0.0005) [2023-12-28 07:38:16,167][106226] Updated weights for policy 0, policy_version 1722097 (0.0008) [2023-12-28 07:38:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 882868224. Throughput: 0: 9938.9, 1: 9712.5. Samples: 882859500. Policy #0 lag: (min: 3.0, avg: 17.4, max: 35.0) [2023-12-28 07:38:16,175][105115] Avg episode reward: [(0, '-4.271'), (1, '-4.546')] [2023-12-28 07:38:16,226][106226] Updated weights for policy 0, policy_version 1722107 (0.0010) [2023-12-28 07:38:16,284][106226] Updated weights for policy 0, policy_version 1722117 (0.0009) [2023-12-28 07:38:16,536][106225] Updated weights for policy 1, policy_version 1726096 (0.0006) [2023-12-28 07:38:16,592][106225] Updated weights for policy 1, policy_version 1726106 (0.0005) [2023-12-28 07:38:16,645][106225] Updated weights for policy 1, policy_version 1726116 (0.0005) [2023-12-28 07:38:16,947][106226] Updated weights for policy 0, policy_version 1722127 (0.0010) [2023-12-28 07:38:17,001][106226] Updated weights for policy 0, policy_version 1722137 (0.0007) [2023-12-28 07:38:17,058][106226] Updated weights for policy 0, policy_version 1722147 (0.0010) [2023-12-28 07:38:17,262][106225] Updated weights for policy 1, policy_version 1726126 (0.0008) [2023-12-28 07:38:17,312][106225] Updated weights for policy 1, policy_version 1726136 (0.0010) [2023-12-28 07:38:17,358][106225] Updated weights for policy 1, policy_version 1726146 (0.0006) [2023-12-28 07:38:17,748][106226] Updated weights for policy 0, policy_version 1722157 (0.0010) [2023-12-28 07:38:17,809][106226] Updated weights for policy 0, policy_version 1722167 (0.0011) [2023-12-28 07:38:17,860][106226] Updated weights for policy 0, policy_version 1722177 (0.0010) [2023-12-28 07:38:18,011][106225] Updated weights for policy 1, policy_version 1726156 (0.0007) [2023-12-28 07:38:18,100][106225] Updated weights for policy 1, policy_version 1726166 (0.0011) [2023-12-28 07:38:18,158][106225] Updated weights for policy 1, policy_version 1726176 (0.0008) [2023-12-28 07:38:18,544][106226] Updated weights for policy 0, policy_version 1722187 (0.0010) [2023-12-28 07:38:18,604][106226] Updated weights for policy 0, policy_version 1722197 (0.0010) [2023-12-28 07:38:18,676][106226] Updated weights for policy 0, policy_version 1722207 (0.0011) [2023-12-28 07:38:18,792][106225] Updated weights for policy 1, policy_version 1726186 (0.0009) [2023-12-28 07:38:18,852][106225] Updated weights for policy 1, policy_version 1726196 (0.0007) [2023-12-28 07:38:18,901][106225] Updated weights for policy 1, policy_version 1726206 (0.0008) [2023-12-28 07:38:18,955][106225] Updated weights for policy 1, policy_version 1726216 (0.0007) [2023-12-28 07:38:19,427][106226] Updated weights for policy 0, policy_version 1722217 (0.0011) [2023-12-28 07:38:19,477][106226] Updated weights for policy 0, policy_version 1722227 (0.0011) [2023-12-28 07:38:19,543][106226] Updated weights for policy 0, policy_version 1722237 (0.0011) [2023-12-28 07:38:19,604][106226] Updated weights for policy 0, policy_version 1722247 (0.0010) [2023-12-28 07:38:19,708][106225] Updated weights for policy 1, policy_version 1726226 (0.0010) [2023-12-28 07:38:19,755][106225] Updated weights for policy 1, policy_version 1726236 (0.0010) [2023-12-28 07:38:19,806][106225] Updated weights for policy 1, policy_version 1726246 (0.0010) [2023-12-28 07:38:20,318][106226] Updated weights for policy 0, policy_version 1722257 (0.0007) [2023-12-28 07:38:20,384][106226] Updated weights for policy 0, policy_version 1722267 (0.0008) [2023-12-28 07:38:20,453][106226] Updated weights for policy 0, policy_version 1722277 (0.0009) [2023-12-28 07:38:20,655][106225] Updated weights for policy 1, policy_version 1726256 (0.0009) [2023-12-28 07:38:20,715][106225] Updated weights for policy 1, policy_version 1726266 (0.0008) [2023-12-28 07:38:20,775][106225] Updated weights for policy 1, policy_version 1726276 (0.0008) [2023-12-28 07:38:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 882966528. Throughput: 0: 9820.3, 1: 9799.2. Samples: 882978420. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:21,175][105115] Avg episode reward: [(0, '-4.694'), (1, '-4.960')] [2023-12-28 07:38:21,201][106226] Updated weights for policy 0, policy_version 1722287 (0.0009) [2023-12-28 07:38:21,266][106226] Updated weights for policy 0, policy_version 1722297 (0.0009) [2023-12-28 07:38:21,322][106226] Updated weights for policy 0, policy_version 1722307 (0.0009) [2023-12-28 07:38:21,550][106225] Updated weights for policy 1, policy_version 1726286 (0.0008) [2023-12-28 07:38:21,608][106225] Updated weights for policy 1, policy_version 1726296 (0.0006) [2023-12-28 07:38:21,677][106225] Updated weights for policy 1, policy_version 1726306 (0.0008) [2023-12-28 07:38:22,132][106226] Updated weights for policy 0, policy_version 1722317 (0.0008) [2023-12-28 07:38:22,189][106226] Updated weights for policy 0, policy_version 1722327 (0.0008) [2023-12-28 07:38:22,242][106226] Updated weights for policy 0, policy_version 1722337 (0.0008) [2023-12-28 07:38:22,452][106225] Updated weights for policy 1, policy_version 1726316 (0.0010) [2023-12-28 07:38:22,524][106225] Updated weights for policy 1, policy_version 1726326 (0.0010) [2023-12-28 07:38:22,594][106225] Updated weights for policy 1, policy_version 1726336 (0.0008) [2023-12-28 07:38:22,897][106226] Updated weights for policy 0, policy_version 1722347 (0.0008) [2023-12-28 07:38:22,963][106226] Updated weights for policy 0, policy_version 1722357 (0.0006) [2023-12-28 07:38:23,029][106226] Updated weights for policy 0, policy_version 1722367 (0.0007) [2023-12-28 07:38:23,307][106225] Updated weights for policy 1, policy_version 1726346 (0.0008) [2023-12-28 07:38:23,377][106225] Updated weights for policy 1, policy_version 1726356 (0.0010) [2023-12-28 07:38:23,434][106225] Updated weights for policy 1, policy_version 1726366 (0.0010) [2023-12-28 07:38:23,497][106225] Updated weights for policy 1, policy_version 1726376 (0.0010) [2023-12-28 07:38:23,641][106226] Updated weights for policy 0, policy_version 1722377 (0.0009) [2023-12-28 07:38:23,697][106226] Updated weights for policy 0, policy_version 1722387 (0.0006) [2023-12-28 07:38:23,751][106226] Updated weights for policy 0, policy_version 1722397 (0.0005) [2023-12-28 07:38:23,807][106226] Updated weights for policy 0, policy_version 1722407 (0.0005) [2023-12-28 07:38:24,250][106225] Updated weights for policy 1, policy_version 1726386 (0.0008) [2023-12-28 07:38:24,309][106225] Updated weights for policy 1, policy_version 1726396 (0.0008) [2023-12-28 07:38:24,366][106225] Updated weights for policy 1, policy_version 1726406 (0.0008) [2023-12-28 07:38:24,380][106226] Updated weights for policy 0, policy_version 1722417 (0.0006) [2023-12-28 07:38:24,434][106226] Updated weights for policy 0, policy_version 1722427 (0.0009) [2023-12-28 07:38:24,494][106226] Updated weights for policy 0, policy_version 1722437 (0.0008) [2023-12-28 07:38:25,027][106225] Updated weights for policy 1, policy_version 1726416 (0.0009) [2023-12-28 07:38:25,087][106225] Updated weights for policy 1, policy_version 1726426 (0.0007) [2023-12-28 07:38:25,140][106225] Updated weights for policy 1, policy_version 1726436 (0.0005) [2023-12-28 07:38:25,205][106226] Updated weights for policy 0, policy_version 1722447 (0.0009) [2023-12-28 07:38:25,263][106226] Updated weights for policy 0, policy_version 1722457 (0.0008) [2023-12-28 07:38:25,315][106226] Updated weights for policy 0, policy_version 1722467 (0.0007) [2023-12-28 07:38:25,735][106225] Updated weights for policy 1, policy_version 1726446 (0.0006) [2023-12-28 07:38:25,788][106225] Updated weights for policy 1, policy_version 1726456 (0.0005) [2023-12-28 07:38:25,842][106225] Updated weights for policy 1, policy_version 1726466 (0.0008) [2023-12-28 07:38:26,103][106226] Updated weights for policy 0, policy_version 1722477 (0.0008) [2023-12-28 07:38:26,160][106226] Updated weights for policy 0, policy_version 1722487 (0.0008) [2023-12-28 07:38:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 883064832. Throughput: 0: 9833.2, 1: 9796.0. Samples: 883036712. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:26,175][105115] Avg episode reward: [(0, '-4.666'), (1, '-4.576')] [2023-12-28 07:38:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001726472_442032128.pth... [2023-12-28 07:38:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001725320_441737216.pth [2023-12-28 07:38:26,219][106226] Updated weights for policy 0, policy_version 1722497 (0.0009) [2023-12-28 07:38:26,254][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001722504_441040896.pth... [2023-12-28 07:38:26,257][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001721352_440745984.pth [2023-12-28 07:38:26,492][106225] Updated weights for policy 1, policy_version 1726476 (0.0008) [2023-12-28 07:38:26,543][106225] Updated weights for policy 1, policy_version 1726486 (0.0008) [2023-12-28 07:38:26,604][106225] Updated weights for policy 1, policy_version 1726496 (0.0009) [2023-12-28 07:38:26,953][106226] Updated weights for policy 0, policy_version 1722507 (0.0008) [2023-12-28 07:38:27,004][106226] Updated weights for policy 0, policy_version 1722517 (0.0008) [2023-12-28 07:38:27,060][106226] Updated weights for policy 0, policy_version 1722527 (0.0008) [2023-12-28 07:38:27,323][106225] Updated weights for policy 1, policy_version 1726506 (0.0008) [2023-12-28 07:38:27,372][106225] Updated weights for policy 1, policy_version 1726516 (0.0009) [2023-12-28 07:38:27,430][106225] Updated weights for policy 1, policy_version 1726526 (0.0005) [2023-12-28 07:38:27,493][106225] Updated weights for policy 1, policy_version 1726536 (0.0007) [2023-12-28 07:38:27,716][106226] Updated weights for policy 0, policy_version 1722537 (0.0007) [2023-12-28 07:38:27,768][106226] Updated weights for policy 0, policy_version 1722547 (0.0011) [2023-12-28 07:38:27,819][106226] Updated weights for policy 0, policy_version 1722557 (0.0011) [2023-12-28 07:38:27,876][106226] Updated weights for policy 0, policy_version 1722567 (0.0011) [2023-12-28 07:38:28,189][106225] Updated weights for policy 1, policy_version 1726546 (0.0008) [2023-12-28 07:38:28,241][106225] Updated weights for policy 1, policy_version 1726556 (0.0008) [2023-12-28 07:38:28,284][106225] Updated weights for policy 1, policy_version 1726566 (0.0008) [2023-12-28 07:38:28,641][106226] Updated weights for policy 0, policy_version 1722577 (0.0011) [2023-12-28 07:38:28,696][106226] Updated weights for policy 0, policy_version 1722587 (0.0011) [2023-12-28 07:38:28,745][106226] Updated weights for policy 0, policy_version 1722597 (0.0010) [2023-12-28 07:38:29,062][106225] Updated weights for policy 1, policy_version 1726576 (0.0008) [2023-12-28 07:38:29,117][106225] Updated weights for policy 1, policy_version 1726586 (0.0008) [2023-12-28 07:38:29,180][106225] Updated weights for policy 1, policy_version 1726596 (0.0008) [2023-12-28 07:38:29,522][106226] Updated weights for policy 0, policy_version 1722607 (0.0009) [2023-12-28 07:38:29,578][106226] Updated weights for policy 0, policy_version 1722617 (0.0005) [2023-12-28 07:38:29,629][106226] Updated weights for policy 0, policy_version 1722627 (0.0005) [2023-12-28 07:38:29,936][106225] Updated weights for policy 1, policy_version 1726606 (0.0008) [2023-12-28 07:38:29,998][106225] Updated weights for policy 1, policy_version 1726616 (0.0008) [2023-12-28 07:38:30,059][106225] Updated weights for policy 1, policy_version 1726626 (0.0007) [2023-12-28 07:38:30,343][106226] Updated weights for policy 0, policy_version 1722637 (0.0007) [2023-12-28 07:38:30,396][106226] Updated weights for policy 0, policy_version 1722647 (0.0007) [2023-12-28 07:38:30,446][106226] Updated weights for policy 0, policy_version 1722657 (0.0007) [2023-12-28 07:38:30,793][106225] Updated weights for policy 1, policy_version 1726636 (0.0008) [2023-12-28 07:38:30,848][106225] Updated weights for policy 1, policy_version 1726646 (0.0007) [2023-12-28 07:38:30,904][106225] Updated weights for policy 1, policy_version 1726656 (0.0007) [2023-12-28 07:38:31,157][106226] Updated weights for policy 0, policy_version 1722667 (0.0008) [2023-12-28 07:38:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 883163136. Throughput: 0: 9827.2, 1: 9834.9. Samples: 883154284. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:31,175][105115] Avg episode reward: [(0, '-4.738'), (1, '-4.847')] [2023-12-28 07:38:31,208][106226] Updated weights for policy 0, policy_version 1722677 (0.0010) [2023-12-28 07:38:31,261][106226] Updated weights for policy 0, policy_version 1722687 (0.0011) [2023-12-28 07:38:31,663][106225] Updated weights for policy 1, policy_version 1726666 (0.0005) [2023-12-28 07:38:31,725][106225] Updated weights for policy 1, policy_version 1726676 (0.0008) [2023-12-28 07:38:31,790][106225] Updated weights for policy 1, policy_version 1726686 (0.0007) [2023-12-28 07:38:31,846][106225] Updated weights for policy 1, policy_version 1726696 (0.0009) [2023-12-28 07:38:32,015][106226] Updated weights for policy 0, policy_version 1722697 (0.0009) [2023-12-28 07:38:32,081][106226] Updated weights for policy 0, policy_version 1722707 (0.0008) [2023-12-28 07:38:32,142][106226] Updated weights for policy 0, policy_version 1722717 (0.0008) [2023-12-28 07:38:32,202][106226] Updated weights for policy 0, policy_version 1722727 (0.0007) [2023-12-28 07:38:32,562][106225] Updated weights for policy 1, policy_version 1726706 (0.0008) [2023-12-28 07:38:32,618][106225] Updated weights for policy 1, policy_version 1726716 (0.0007) [2023-12-28 07:38:32,674][106225] Updated weights for policy 1, policy_version 1726726 (0.0008) [2023-12-28 07:38:32,873][106226] Updated weights for policy 0, policy_version 1722737 (0.0008) [2023-12-28 07:38:32,929][106226] Updated weights for policy 0, policy_version 1722747 (0.0007) [2023-12-28 07:38:32,985][106226] Updated weights for policy 0, policy_version 1722757 (0.0009) [2023-12-28 07:38:33,280][106225] Updated weights for policy 1, policy_version 1726736 (0.0010) [2023-12-28 07:38:33,337][106225] Updated weights for policy 1, policy_version 1726746 (0.0010) [2023-12-28 07:38:33,383][106225] Updated weights for policy 1, policy_version 1726756 (0.0010) [2023-12-28 07:38:33,599][106226] Updated weights for policy 0, policy_version 1722767 (0.0006) [2023-12-28 07:38:33,647][106226] Updated weights for policy 0, policy_version 1722777 (0.0005) [2023-12-28 07:38:33,706][106226] Updated weights for policy 0, policy_version 1722787 (0.0005) [2023-12-28 07:38:34,112][106225] Updated weights for policy 1, policy_version 1726766 (0.0010) [2023-12-28 07:38:34,173][106225] Updated weights for policy 1, policy_version 1726776 (0.0009) [2023-12-28 07:38:34,244][106225] Updated weights for policy 1, policy_version 1726786 (0.0009) [2023-12-28 07:38:34,308][106226] Updated weights for policy 0, policy_version 1722797 (0.0007) [2023-12-28 07:38:34,375][106226] Updated weights for policy 0, policy_version 1722807 (0.0006) [2023-12-28 07:38:34,446][106226] Updated weights for policy 0, policy_version 1722817 (0.0006) [2023-12-28 07:38:34,977][106225] Updated weights for policy 1, policy_version 1726796 (0.0007) [2023-12-28 07:38:35,045][106225] Updated weights for policy 1, policy_version 1726806 (0.0006) [2023-12-28 07:38:35,090][106226] Updated weights for policy 0, policy_version 1722827 (0.0007) [2023-12-28 07:38:35,098][106225] Updated weights for policy 1, policy_version 1726816 (0.0006) [2023-12-28 07:38:35,135][106226] Updated weights for policy 0, policy_version 1722837 (0.0008) [2023-12-28 07:38:35,183][106226] Updated weights for policy 0, policy_version 1722847 (0.0007) [2023-12-28 07:38:35,754][106225] Updated weights for policy 1, policy_version 1726826 (0.0006) [2023-12-28 07:38:35,810][106225] Updated weights for policy 1, policy_version 1726836 (0.0008) [2023-12-28 07:38:35,867][106225] Updated weights for policy 1, policy_version 1726846 (0.0007) [2023-12-28 07:38:35,926][106225] Updated weights for policy 1, policy_version 1726856 (0.0008) [2023-12-28 07:38:35,932][106226] Updated weights for policy 0, policy_version 1722857 (0.0010) [2023-12-28 07:38:35,981][106226] Updated weights for policy 0, policy_version 1722867 (0.0010) [2023-12-28 07:38:36,028][106226] Updated weights for policy 0, policy_version 1722877 (0.0010) [2023-12-28 07:38:36,080][106226] Updated weights for policy 0, policy_version 1722887 (0.0010) [2023-12-28 07:38:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 883269632. Throughput: 0: 9920.6, 1: 9814.5. Samples: 883274068. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:36,175][105115] Avg episode reward: [(0, '-4.602'), (1, '-4.803')] [2023-12-28 07:38:36,689][106225] Updated weights for policy 1, policy_version 1726866 (0.0008) [2023-12-28 07:38:36,749][106225] Updated weights for policy 1, policy_version 1726876 (0.0008) [2023-12-28 07:38:36,810][106225] Updated weights for policy 1, policy_version 1726886 (0.0008) [2023-12-28 07:38:36,846][106226] Updated weights for policy 0, policy_version 1722897 (0.0011) [2023-12-28 07:38:36,897][106226] Updated weights for policy 0, policy_version 1722907 (0.0011) [2023-12-28 07:38:36,956][106226] Updated weights for policy 0, policy_version 1722917 (0.0010) [2023-12-28 07:38:37,425][106225] Updated weights for policy 1, policy_version 1726896 (0.0005) [2023-12-28 07:38:37,477][106225] Updated weights for policy 1, policy_version 1726906 (0.0007) [2023-12-28 07:38:37,527][106225] Updated weights for policy 1, policy_version 1726916 (0.0007) [2023-12-28 07:38:37,745][106226] Updated weights for policy 0, policy_version 1722927 (0.0009) [2023-12-28 07:38:37,796][106226] Updated weights for policy 0, policy_version 1722937 (0.0009) [2023-12-28 07:38:37,849][106226] Updated weights for policy 0, policy_version 1722947 (0.0008) [2023-12-28 07:38:38,127][106225] Updated weights for policy 1, policy_version 1726926 (0.0005) [2023-12-28 07:38:38,191][106225] Updated weights for policy 1, policy_version 1726936 (0.0007) [2023-12-28 07:38:38,261][106225] Updated weights for policy 1, policy_version 1726946 (0.0008) [2023-12-28 07:38:38,588][106226] Updated weights for policy 0, policy_version 1722957 (0.0008) [2023-12-28 07:38:38,647][106226] Updated weights for policy 0, policy_version 1722967 (0.0007) [2023-12-28 07:38:38,708][106226] Updated weights for policy 0, policy_version 1722977 (0.0008) [2023-12-28 07:38:38,873][106225] Updated weights for policy 1, policy_version 1726956 (0.0007) [2023-12-28 07:38:38,938][106225] Updated weights for policy 1, policy_version 1726966 (0.0006) [2023-12-28 07:38:38,996][106225] Updated weights for policy 1, policy_version 1726976 (0.0006) [2023-12-28 07:38:39,415][106226] Updated weights for policy 0, policy_version 1722987 (0.0008) [2023-12-28 07:38:39,487][106226] Updated weights for policy 0, policy_version 1722997 (0.0008) [2023-12-28 07:38:39,563][106226] Updated weights for policy 0, policy_version 1723007 (0.0010) [2023-12-28 07:38:39,670][106225] Updated weights for policy 1, policy_version 1726986 (0.0007) [2023-12-28 07:38:39,730][106225] Updated weights for policy 1, policy_version 1726996 (0.0008) [2023-12-28 07:38:39,776][106225] Updated weights for policy 1, policy_version 1727006 (0.0008) [2023-12-28 07:38:39,826][106225] Updated weights for policy 1, policy_version 1727016 (0.0009) [2023-12-28 07:38:40,331][106226] Updated weights for policy 0, policy_version 1723017 (0.0007) [2023-12-28 07:38:40,397][106226] Updated weights for policy 0, policy_version 1723027 (0.0007) [2023-12-28 07:38:40,466][106226] Updated weights for policy 0, policy_version 1723037 (0.0007) [2023-12-28 07:38:40,531][106225] Updated weights for policy 1, policy_version 1727026 (0.0011) [2023-12-28 07:38:40,533][106226] Updated weights for policy 0, policy_version 1723047 (0.0007) [2023-12-28 07:38:40,589][106225] Updated weights for policy 1, policy_version 1727036 (0.0010) [2023-12-28 07:38:40,651][106225] Updated weights for policy 1, policy_version 1727046 (0.0010) [2023-12-28 07:38:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19633.0). Total num frames: 883359744. Throughput: 0: 9911.0, 1: 9879.2. Samples: 883334256. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:41,175][105115] Avg episode reward: [(0, '-4.701'), (1, '-4.924')] [2023-12-28 07:38:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001727048_442179584.pth... [2023-12-28 07:38:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001725896_441884672.pth [2023-12-28 07:38:41,234][106226] Updated weights for policy 0, policy_version 1723057 (0.0009) [2023-12-28 07:38:41,299][106226] Updated weights for policy 0, policy_version 1723067 (0.0009) [2023-12-28 07:38:41,365][106226] Updated weights for policy 0, policy_version 1723077 (0.0008) [2023-12-28 07:38:41,384][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001723080_441188352.pth... [2023-12-28 07:38:41,388][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001721896_440885248.pth [2023-12-28 07:38:41,412][106225] Updated weights for policy 1, policy_version 1727056 (0.0007) [2023-12-28 07:38:41,467][106225] Updated weights for policy 1, policy_version 1727066 (0.0007) [2023-12-28 07:38:41,525][106225] Updated weights for policy 1, policy_version 1727076 (0.0005) [2023-12-28 07:38:42,142][106226] Updated weights for policy 0, policy_version 1723087 (0.0006) [2023-12-28 07:38:42,187][106225] Updated weights for policy 1, policy_version 1727086 (0.0008) [2023-12-28 07:38:42,202][106226] Updated weights for policy 0, policy_version 1723097 (0.0006) [2023-12-28 07:38:42,239][106225] Updated weights for policy 1, policy_version 1727096 (0.0009) [2023-12-28 07:38:42,266][106226] Updated weights for policy 0, policy_version 1723107 (0.0008) [2023-12-28 07:38:42,302][106225] Updated weights for policy 1, policy_version 1727106 (0.0008) [2023-12-28 07:38:42,905][106226] Updated weights for policy 0, policy_version 1723117 (0.0007) [2023-12-28 07:38:42,968][106226] Updated weights for policy 0, policy_version 1723127 (0.0006) [2023-12-28 07:38:43,016][106226] Updated weights for policy 0, policy_version 1723137 (0.0008) [2023-12-28 07:38:43,112][106225] Updated weights for policy 1, policy_version 1727116 (0.0009) [2023-12-28 07:38:43,175][106225] Updated weights for policy 1, policy_version 1727126 (0.0010) [2023-12-28 07:38:43,234][106225] Updated weights for policy 1, policy_version 1727136 (0.0010) [2023-12-28 07:38:43,614][106226] Updated weights for policy 0, policy_version 1723147 (0.0008) [2023-12-28 07:38:43,674][106226] Updated weights for policy 0, policy_version 1723157 (0.0006) [2023-12-28 07:38:43,727][106226] Updated weights for policy 0, policy_version 1723167 (0.0006) [2023-12-28 07:38:43,857][106225] Updated weights for policy 1, policy_version 1727146 (0.0009) [2023-12-28 07:38:43,910][106225] Updated weights for policy 1, policy_version 1727156 (0.0005) [2023-12-28 07:38:43,960][106225] Updated weights for policy 1, policy_version 1727166 (0.0005) [2023-12-28 07:38:44,006][106225] Updated weights for policy 1, policy_version 1727176 (0.0005) [2023-12-28 07:38:44,273][106226] Updated weights for policy 0, policy_version 1723177 (0.0006) [2023-12-28 07:38:44,334][106226] Updated weights for policy 0, policy_version 1723187 (0.0007) [2023-12-28 07:38:44,396][106226] Updated weights for policy 0, policy_version 1723197 (0.0005) [2023-12-28 07:38:44,450][106226] Updated weights for policy 0, policy_version 1723207 (0.0008) [2023-12-28 07:38:44,667][106225] Updated weights for policy 1, policy_version 1727186 (0.0010) [2023-12-28 07:38:44,718][106225] Updated weights for policy 1, policy_version 1727196 (0.0010) [2023-12-28 07:38:44,773][106225] Updated weights for policy 1, policy_version 1727206 (0.0010) [2023-12-28 07:38:45,126][106226] Updated weights for policy 0, policy_version 1723217 (0.0010) [2023-12-28 07:38:45,194][106226] Updated weights for policy 0, policy_version 1723227 (0.0008) [2023-12-28 07:38:45,259][106226] Updated weights for policy 0, policy_version 1723237 (0.0008) [2023-12-28 07:38:45,520][106225] Updated weights for policy 1, policy_version 1727216 (0.0009) [2023-12-28 07:38:45,576][106225] Updated weights for policy 1, policy_version 1727226 (0.0008) [2023-12-28 07:38:45,631][106225] Updated weights for policy 1, policy_version 1727236 (0.0008) [2023-12-28 07:38:45,887][106226] Updated weights for policy 0, policy_version 1723247 (0.0006) [2023-12-28 07:38:45,935][106226] Updated weights for policy 0, policy_version 1723257 (0.0005) [2023-12-28 07:38:45,990][106226] Updated weights for policy 0, policy_version 1723267 (0.0005) [2023-12-28 07:38:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.5, 300 sec: 19688.6). Total num frames: 883466240. Throughput: 0: 9911.6, 1: 9887.0. Samples: 883453840. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:46,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.504')] [2023-12-28 07:38:46,284][106225] Updated weights for policy 1, policy_version 1727246 (0.0005) [2023-12-28 07:38:46,346][106225] Updated weights for policy 1, policy_version 1727256 (0.0005) [2023-12-28 07:38:46,411][106225] Updated weights for policy 1, policy_version 1727266 (0.0005) [2023-12-28 07:38:46,701][106226] Updated weights for policy 0, policy_version 1723277 (0.0007) [2023-12-28 07:38:46,747][106226] Updated weights for policy 0, policy_version 1723287 (0.0008) [2023-12-28 07:38:46,801][106226] Updated weights for policy 0, policy_version 1723297 (0.0008) [2023-12-28 07:38:46,962][106225] Updated weights for policy 1, policy_version 1727276 (0.0008) [2023-12-28 07:38:47,018][106225] Updated weights for policy 1, policy_version 1727286 (0.0009) [2023-12-28 07:38:47,077][106225] Updated weights for policy 1, policy_version 1727296 (0.0008) [2023-12-28 07:38:47,555][106226] Updated weights for policy 0, policy_version 1723307 (0.0009) [2023-12-28 07:38:47,614][106226] Updated weights for policy 0, policy_version 1723317 (0.0009) [2023-12-28 07:38:47,668][106226] Updated weights for policy 0, policy_version 1723327 (0.0008) [2023-12-28 07:38:47,732][106225] Updated weights for policy 1, policy_version 1727306 (0.0007) [2023-12-28 07:38:47,785][106225] Updated weights for policy 1, policy_version 1727316 (0.0005) [2023-12-28 07:38:47,831][106225] Updated weights for policy 1, policy_version 1727326 (0.0005) [2023-12-28 07:38:47,881][106225] Updated weights for policy 1, policy_version 1727336 (0.0008) [2023-12-28 07:38:48,389][106226] Updated weights for policy 0, policy_version 1723337 (0.0007) [2023-12-28 07:38:48,461][106226] Updated weights for policy 0, policy_version 1723347 (0.0008) [2023-12-28 07:38:48,524][106226] Updated weights for policy 0, policy_version 1723357 (0.0007) [2023-12-28 07:38:48,592][106226] Updated weights for policy 0, policy_version 1723367 (0.0008) [2023-12-28 07:38:48,655][106225] Updated weights for policy 1, policy_version 1727346 (0.0010) [2023-12-28 07:38:48,719][106225] Updated weights for policy 1, policy_version 1727356 (0.0011) [2023-12-28 07:38:48,784][106225] Updated weights for policy 1, policy_version 1727366 (0.0011) [2023-12-28 07:38:49,283][106226] Updated weights for policy 0, policy_version 1723377 (0.0007) [2023-12-28 07:38:49,351][106226] Updated weights for policy 0, policy_version 1723387 (0.0009) [2023-12-28 07:38:49,414][106226] Updated weights for policy 0, policy_version 1723397 (0.0006) [2023-12-28 07:38:49,507][106225] Updated weights for policy 1, policy_version 1727376 (0.0006) [2023-12-28 07:38:49,560][106225] Updated weights for policy 1, policy_version 1727386 (0.0005) [2023-12-28 07:38:49,620][106225] Updated weights for policy 1, policy_version 1727396 (0.0008) [2023-12-28 07:38:50,188][106226] Updated weights for policy 0, policy_version 1723407 (0.0008) [2023-12-28 07:38:50,246][106226] Updated weights for policy 0, policy_version 1723417 (0.0009) [2023-12-28 07:38:50,250][106225] Updated weights for policy 1, policy_version 1727406 (0.0009) [2023-12-28 07:38:50,302][106226] Updated weights for policy 0, policy_version 1723427 (0.0008) [2023-12-28 07:38:50,315][106225] Updated weights for policy 1, policy_version 1727416 (0.0010) [2023-12-28 07:38:50,376][106225] Updated weights for policy 1, policy_version 1727426 (0.0010) [2023-12-28 07:38:51,075][106225] Updated weights for policy 1, policy_version 1727436 (0.0008) [2023-12-28 07:38:51,089][106226] Updated weights for policy 0, policy_version 1723437 (0.0006) [2023-12-28 07:38:51,141][106225] Updated weights for policy 1, policy_version 1727446 (0.0008) [2023-12-28 07:38:51,160][106226] Updated weights for policy 0, policy_version 1723447 (0.0007) [2023-12-28 07:38:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 883556352. Throughput: 0: 9894.3, 1: 9889.9. Samples: 883572920. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:51,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-4.648')] [2023-12-28 07:38:51,213][106225] Updated weights for policy 1, policy_version 1727456 (0.0010) [2023-12-28 07:38:51,216][106226] Updated weights for policy 0, policy_version 1723457 (0.0007) [2023-12-28 07:38:51,968][106226] Updated weights for policy 0, policy_version 1723467 (0.0009) [2023-12-28 07:38:51,973][106225] Updated weights for policy 1, policy_version 1727466 (0.0008) [2023-12-28 07:38:52,028][106226] Updated weights for policy 0, policy_version 1723477 (0.0006) [2023-12-28 07:38:52,030][106225] Updated weights for policy 1, policy_version 1727476 (0.0006) [2023-12-28 07:38:52,089][106225] Updated weights for policy 1, policy_version 1727486 (0.0007) [2023-12-28 07:38:52,090][106226] Updated weights for policy 0, policy_version 1723487 (0.0006) [2023-12-28 07:38:52,150][106225] Updated weights for policy 1, policy_version 1727496 (0.0007) [2023-12-28 07:38:52,816][106225] Updated weights for policy 1, policy_version 1727506 (0.0007) [2023-12-28 07:38:52,872][106226] Updated weights for policy 0, policy_version 1723497 (0.0006) [2023-12-28 07:38:52,888][106225] Updated weights for policy 1, policy_version 1727516 (0.0005) [2023-12-28 07:38:52,931][106226] Updated weights for policy 0, policy_version 1723507 (0.0008) [2023-12-28 07:38:52,957][106225] Updated weights for policy 1, policy_version 1727526 (0.0005) [2023-12-28 07:38:52,978][106226] Updated weights for policy 0, policy_version 1723517 (0.0008) [2023-12-28 07:38:53,028][106226] Updated weights for policy 0, policy_version 1723527 (0.0009) [2023-12-28 07:38:53,456][106225] Updated weights for policy 1, policy_version 1727536 (0.0005) [2023-12-28 07:38:53,515][106225] Updated weights for policy 1, policy_version 1727546 (0.0005) [2023-12-28 07:38:53,577][106225] Updated weights for policy 1, policy_version 1727556 (0.0005) [2023-12-28 07:38:53,850][106226] Updated weights for policy 0, policy_version 1723537 (0.0009) [2023-12-28 07:38:53,900][106226] Updated weights for policy 0, policy_version 1723547 (0.0008) [2023-12-28 07:38:53,960][106226] Updated weights for policy 0, policy_version 1723557 (0.0009) [2023-12-28 07:38:54,164][106225] Updated weights for policy 1, policy_version 1727566 (0.0006) [2023-12-28 07:38:54,216][106225] Updated weights for policy 1, policy_version 1727576 (0.0005) [2023-12-28 07:38:54,269][106225] Updated weights for policy 1, policy_version 1727586 (0.0005) [2023-12-28 07:38:54,717][106226] Updated weights for policy 0, policy_version 1723567 (0.0006) [2023-12-28 07:38:54,785][106226] Updated weights for policy 0, policy_version 1723577 (0.0005) [2023-12-28 07:38:54,846][106226] Updated weights for policy 0, policy_version 1723587 (0.0008) [2023-12-28 07:38:54,854][106225] Updated weights for policy 1, policy_version 1727596 (0.0005) [2023-12-28 07:38:54,911][106225] Updated weights for policy 1, policy_version 1727606 (0.0005) [2023-12-28 07:38:54,971][106225] Updated weights for policy 1, policy_version 1727616 (0.0006) [2023-12-28 07:38:55,423][106226] Updated weights for policy 0, policy_version 1723597 (0.0008) [2023-12-28 07:38:55,468][106226] Updated weights for policy 0, policy_version 1723607 (0.0008) [2023-12-28 07:38:55,513][106226] Updated weights for policy 0, policy_version 1723617 (0.0008) [2023-12-28 07:38:55,652][106225] Updated weights for policy 1, policy_version 1727626 (0.0008) [2023-12-28 07:38:55,709][106225] Updated weights for policy 1, policy_version 1727636 (0.0008) [2023-12-28 07:38:55,758][106225] Updated weights for policy 1, policy_version 1727646 (0.0007) [2023-12-28 07:38:55,801][106225] Updated weights for policy 1, policy_version 1727656 (0.0007) [2023-12-28 07:38:56,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 883662848. Throughput: 0: 9827.0, 1: 9898.0. Samples: 883630528. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:38:56,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.898')] [2023-12-28 07:38:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001727656_442335232.pth... [2023-12-28 07:38:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001723624_441327616.pth... [2023-12-28 07:38:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001726472_442032128.pth [2023-12-28 07:38:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001722504_441040896.pth [2023-12-28 07:38:56,230][106226] Updated weights for policy 0, policy_version 1723627 (0.0009) [2023-12-28 07:38:56,290][106226] Updated weights for policy 0, policy_version 1723637 (0.0011) [2023-12-28 07:38:56,337][106226] Updated weights for policy 0, policy_version 1723647 (0.0010) [2023-12-28 07:38:56,569][106225] Updated weights for policy 1, policy_version 1727666 (0.0008) [2023-12-28 07:38:56,621][106225] Updated weights for policy 1, policy_version 1727676 (0.0007) [2023-12-28 07:38:56,680][106225] Updated weights for policy 1, policy_version 1727686 (0.0007) [2023-12-28 07:38:56,992][106226] Updated weights for policy 0, policy_version 1723657 (0.0010) [2023-12-28 07:38:57,049][106226] Updated weights for policy 0, policy_version 1723667 (0.0010) [2023-12-28 07:38:57,095][106226] Updated weights for policy 0, policy_version 1723677 (0.0010) [2023-12-28 07:38:57,144][106226] Updated weights for policy 0, policy_version 1723687 (0.0010) [2023-12-28 07:38:57,250][106225] Updated weights for policy 1, policy_version 1727696 (0.0007) [2023-12-28 07:38:57,304][106225] Updated weights for policy 1, policy_version 1727706 (0.0008) [2023-12-28 07:38:57,369][106225] Updated weights for policy 1, policy_version 1727716 (0.0007) [2023-12-28 07:38:57,818][106226] Updated weights for policy 0, policy_version 1723697 (0.0008) [2023-12-28 07:38:57,883][106226] Updated weights for policy 0, policy_version 1723707 (0.0008) [2023-12-28 07:38:57,939][106226] Updated weights for policy 0, policy_version 1723717 (0.0007) [2023-12-28 07:38:58,071][106225] Updated weights for policy 1, policy_version 1727726 (0.0008) [2023-12-28 07:38:58,124][106225] Updated weights for policy 1, policy_version 1727736 (0.0009) [2023-12-28 07:38:58,186][106225] Updated weights for policy 1, policy_version 1727746 (0.0008) [2023-12-28 07:38:58,695][106226] Updated weights for policy 0, policy_version 1723727 (0.0009) [2023-12-28 07:38:58,762][106226] Updated weights for policy 0, policy_version 1723737 (0.0010) [2023-12-28 07:38:58,827][106226] Updated weights for policy 0, policy_version 1723747 (0.0009) [2023-12-28 07:38:58,975][106225] Updated weights for policy 1, policy_version 1727756 (0.0007) [2023-12-28 07:38:59,037][106225] Updated weights for policy 1, policy_version 1727766 (0.0008) [2023-12-28 07:38:59,097][106225] Updated weights for policy 1, policy_version 1727776 (0.0008) [2023-12-28 07:38:59,605][106226] Updated weights for policy 0, policy_version 1723757 (0.0006) [2023-12-28 07:38:59,662][106226] Updated weights for policy 0, policy_version 1723767 (0.0006) [2023-12-28 07:38:59,719][106226] Updated weights for policy 0, policy_version 1723777 (0.0006) [2023-12-28 07:38:59,848][106225] Updated weights for policy 1, policy_version 1727786 (0.0008) [2023-12-28 07:38:59,911][106225] Updated weights for policy 1, policy_version 1727796 (0.0010) [2023-12-28 07:38:59,975][106225] Updated weights for policy 1, policy_version 1727806 (0.0009) [2023-12-28 07:39:00,038][106225] Updated weights for policy 1, policy_version 1727816 (0.0008) [2023-12-28 07:39:00,420][106226] Updated weights for policy 0, policy_version 1723787 (0.0010) [2023-12-28 07:39:00,484][106226] Updated weights for policy 0, policy_version 1723797 (0.0007) [2023-12-28 07:39:00,551][106226] Updated weights for policy 0, policy_version 1723807 (0.0006) [2023-12-28 07:39:00,809][106225] Updated weights for policy 1, policy_version 1727826 (0.0009) [2023-12-28 07:39:00,869][106225] Updated weights for policy 1, policy_version 1727836 (0.0008) [2023-12-28 07:39:00,928][106225] Updated weights for policy 1, policy_version 1727846 (0.0008) [2023-12-28 07:39:01,131][106226] Updated weights for policy 0, policy_version 1723817 (0.0006) [2023-12-28 07:39:01,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 883761152. Throughput: 0: 9819.7, 1: 10012.3. Samples: 883751944. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:01,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.859')] [2023-12-28 07:39:01,199][106226] Updated weights for policy 0, policy_version 1723827 (0.0009) [2023-12-28 07:39:01,266][106226] Updated weights for policy 0, policy_version 1723837 (0.0009) [2023-12-28 07:39:01,325][106226] Updated weights for policy 0, policy_version 1723847 (0.0008) [2023-12-28 07:39:01,687][106225] Updated weights for policy 1, policy_version 1727856 (0.0007) [2023-12-28 07:39:01,751][106225] Updated weights for policy 1, policy_version 1727866 (0.0008) [2023-12-28 07:39:01,805][106225] Updated weights for policy 1, policy_version 1727876 (0.0008) [2023-12-28 07:39:02,007][106226] Updated weights for policy 0, policy_version 1723857 (0.0010) [2023-12-28 07:39:02,073][106226] Updated weights for policy 0, policy_version 1723867 (0.0011) [2023-12-28 07:39:02,133][106226] Updated weights for policy 0, policy_version 1723877 (0.0011) [2023-12-28 07:39:02,590][106225] Updated weights for policy 1, policy_version 1727886 (0.0008) [2023-12-28 07:39:02,640][106225] Updated weights for policy 1, policy_version 1727896 (0.0008) [2023-12-28 07:39:02,683][106225] Updated weights for policy 1, policy_version 1727906 (0.0007) [2023-12-28 07:39:02,816][106226] Updated weights for policy 0, policy_version 1723887 (0.0010) [2023-12-28 07:39:02,866][106226] Updated weights for policy 0, policy_version 1723897 (0.0010) [2023-12-28 07:39:02,922][106226] Updated weights for policy 0, policy_version 1723907 (0.0010) [2023-12-28 07:39:03,312][106225] Updated weights for policy 1, policy_version 1727916 (0.0006) [2023-12-28 07:39:03,357][106225] Updated weights for policy 1, policy_version 1727926 (0.0005) [2023-12-28 07:39:03,402][106225] Updated weights for policy 1, policy_version 1727936 (0.0005) [2023-12-28 07:39:03,592][106226] Updated weights for policy 0, policy_version 1723917 (0.0008) [2023-12-28 07:39:03,639][106226] Updated weights for policy 0, policy_version 1723927 (0.0010) [2023-12-28 07:39:03,691][106226] Updated weights for policy 0, policy_version 1723937 (0.0010) [2023-12-28 07:39:04,019][106225] Updated weights for policy 1, policy_version 1727946 (0.0006) [2023-12-28 07:39:04,072][106225] Updated weights for policy 1, policy_version 1727956 (0.0007) [2023-12-28 07:39:04,132][106225] Updated weights for policy 1, policy_version 1727966 (0.0008) [2023-12-28 07:39:04,193][106225] Updated weights for policy 1, policy_version 1727976 (0.0006) [2023-12-28 07:39:04,412][106226] Updated weights for policy 0, policy_version 1723947 (0.0010) [2023-12-28 07:39:04,476][106226] Updated weights for policy 0, policy_version 1723957 (0.0011) [2023-12-28 07:39:04,538][106226] Updated weights for policy 0, policy_version 1723967 (0.0010) [2023-12-28 07:39:04,806][106225] Updated weights for policy 1, policy_version 1727986 (0.0005) [2023-12-28 07:39:04,854][106225] Updated weights for policy 1, policy_version 1727996 (0.0005) [2023-12-28 07:39:04,918][106225] Updated weights for policy 1, policy_version 1728006 (0.0009) [2023-12-28 07:39:05,113][106226] Updated weights for policy 0, policy_version 1723977 (0.0007) [2023-12-28 07:39:05,169][106226] Updated weights for policy 0, policy_version 1723987 (0.0009) [2023-12-28 07:39:05,223][106226] Updated weights for policy 0, policy_version 1723997 (0.0009) [2023-12-28 07:39:05,286][106226] Updated weights for policy 0, policy_version 1724007 (0.0009) [2023-12-28 07:39:05,498][106225] Updated weights for policy 1, policy_version 1728016 (0.0009) [2023-12-28 07:39:05,553][106225] Updated weights for policy 1, policy_version 1728026 (0.0009) [2023-12-28 07:39:05,609][106225] Updated weights for policy 1, policy_version 1728036 (0.0009) [2023-12-28 07:39:06,077][106226] Updated weights for policy 0, policy_version 1724017 (0.0008) [2023-12-28 07:39:06,137][106226] Updated weights for policy 0, policy_version 1724027 (0.0008) [2023-12-28 07:39:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 883859456. Throughput: 0: 9859.2, 1: 10044.8. Samples: 883874100. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:06,175][105115] Avg episode reward: [(0, '-4.172'), (1, '-4.836')] [2023-12-28 07:39:06,202][106226] Updated weights for policy 0, policy_version 1724037 (0.0008) [2023-12-28 07:39:06,318][106225] Updated weights for policy 1, policy_version 1728046 (0.0008) [2023-12-28 07:39:06,387][106225] Updated weights for policy 1, policy_version 1728056 (0.0008) [2023-12-28 07:39:06,455][106225] Updated weights for policy 1, policy_version 1728066 (0.0008) [2023-12-28 07:39:06,932][106226] Updated weights for policy 0, policy_version 1724047 (0.0006) [2023-12-28 07:39:06,988][106226] Updated weights for policy 0, policy_version 1724057 (0.0010) [2023-12-28 07:39:07,043][106226] Updated weights for policy 0, policy_version 1724067 (0.0011) [2023-12-28 07:39:07,066][106225] Updated weights for policy 1, policy_version 1728076 (0.0007) [2023-12-28 07:39:07,133][106225] Updated weights for policy 1, policy_version 1728086 (0.0008) [2023-12-28 07:39:07,187][106225] Updated weights for policy 1, policy_version 1728096 (0.0009) [2023-12-28 07:39:07,596][106226] Updated weights for policy 0, policy_version 1724077 (0.0010) [2023-12-28 07:39:07,642][106226] Updated weights for policy 0, policy_version 1724087 (0.0007) [2023-12-28 07:39:07,691][106226] Updated weights for policy 0, policy_version 1724097 (0.0005) [2023-12-28 07:39:07,845][106225] Updated weights for policy 1, policy_version 1728106 (0.0007) [2023-12-28 07:39:07,900][106225] Updated weights for policy 1, policy_version 1728116 (0.0005) [2023-12-28 07:39:07,956][106225] Updated weights for policy 1, policy_version 1728126 (0.0007) [2023-12-28 07:39:08,015][106225] Updated weights for policy 1, policy_version 1728136 (0.0005) [2023-12-28 07:39:08,241][106226] Updated weights for policy 0, policy_version 1724107 (0.0005) [2023-12-28 07:39:08,287][106226] Updated weights for policy 0, policy_version 1724117 (0.0005) [2023-12-28 07:39:08,342][106226] Updated weights for policy 0, policy_version 1724127 (0.0006) [2023-12-28 07:39:08,612][106225] Updated weights for policy 1, policy_version 1728146 (0.0009) [2023-12-28 07:39:08,674][106225] Updated weights for policy 1, policy_version 1728156 (0.0006) [2023-12-28 07:39:08,741][106225] Updated weights for policy 1, policy_version 1728166 (0.0009) [2023-12-28 07:39:09,002][106226] Updated weights for policy 0, policy_version 1724137 (0.0008) [2023-12-28 07:39:09,063][106226] Updated weights for policy 0, policy_version 1724147 (0.0007) [2023-12-28 07:39:09,112][106226] Updated weights for policy 0, policy_version 1724157 (0.0007) [2023-12-28 07:39:09,166][106226] Updated weights for policy 0, policy_version 1724167 (0.0005) [2023-12-28 07:39:09,386][106225] Updated weights for policy 1, policy_version 1728176 (0.0008) [2023-12-28 07:39:09,457][106225] Updated weights for policy 1, policy_version 1728186 (0.0006) [2023-12-28 07:39:09,516][106225] Updated weights for policy 1, policy_version 1728196 (0.0006) [2023-12-28 07:39:09,884][106226] Updated weights for policy 0, policy_version 1724177 (0.0010) [2023-12-28 07:39:09,953][106226] Updated weights for policy 0, policy_version 1724187 (0.0009) [2023-12-28 07:39:10,016][106226] Updated weights for policy 0, policy_version 1724197 (0.0008) [2023-12-28 07:39:10,236][106225] Updated weights for policy 1, policy_version 1728206 (0.0008) [2023-12-28 07:39:10,293][106225] Updated weights for policy 1, policy_version 1728216 (0.0007) [2023-12-28 07:39:10,353][106225] Updated weights for policy 1, policy_version 1728226 (0.0007) [2023-12-28 07:39:10,790][106226] Updated weights for policy 0, policy_version 1724207 (0.0007) [2023-12-28 07:39:10,844][106226] Updated weights for policy 0, policy_version 1724217 (0.0009) [2023-12-28 07:39:10,894][106226] Updated weights for policy 0, policy_version 1724227 (0.0009) [2023-12-28 07:39:10,984][106225] Updated weights for policy 1, policy_version 1728236 (0.0007) [2023-12-28 07:39:11,050][106225] Updated weights for policy 1, policy_version 1728246 (0.0009) [2023-12-28 07:39:11,115][106225] Updated weights for policy 1, policy_version 1728256 (0.0008) [2023-12-28 07:39:11,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 883974144. Throughput: 0: 9921.6, 1: 10133.5. Samples: 883939192. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:11,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.492')] [2023-12-28 07:39:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001728264_442490880.pth... [2023-12-28 07:39:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001724232_441483264.pth... [2023-12-28 07:39:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001727048_442179584.pth [2023-12-28 07:39:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001723080_441188352.pth [2023-12-28 07:39:11,662][106226] Updated weights for policy 0, policy_version 1724237 (0.0009) [2023-12-28 07:39:11,725][106226] Updated weights for policy 0, policy_version 1724247 (0.0009) [2023-12-28 07:39:11,794][106226] Updated weights for policy 0, policy_version 1724257 (0.0009) [2023-12-28 07:39:11,926][106225] Updated weights for policy 1, policy_version 1728266 (0.0007) [2023-12-28 07:39:11,992][106225] Updated weights for policy 1, policy_version 1728276 (0.0006) [2023-12-28 07:39:12,053][106225] Updated weights for policy 1, policy_version 1728286 (0.0007) [2023-12-28 07:39:12,119][106225] Updated weights for policy 1, policy_version 1728296 (0.0006) [2023-12-28 07:39:12,527][106226] Updated weights for policy 0, policy_version 1724267 (0.0009) [2023-12-28 07:39:12,598][106226] Updated weights for policy 0, policy_version 1724277 (0.0008) [2023-12-28 07:39:12,665][106226] Updated weights for policy 0, policy_version 1724287 (0.0007) [2023-12-28 07:39:12,692][106225] Updated weights for policy 1, policy_version 1728306 (0.0009) [2023-12-28 07:39:12,745][106225] Updated weights for policy 1, policy_version 1728316 (0.0008) [2023-12-28 07:39:12,808][106225] Updated weights for policy 1, policy_version 1728326 (0.0008) [2023-12-28 07:39:13,404][106226] Updated weights for policy 0, policy_version 1724297 (0.0006) [2023-12-28 07:39:13,459][106226] Updated weights for policy 0, policy_version 1724307 (0.0009) [2023-12-28 07:39:13,521][106226] Updated weights for policy 0, policy_version 1724317 (0.0008) [2023-12-28 07:39:13,526][106225] Updated weights for policy 1, policy_version 1728336 (0.0007) [2023-12-28 07:39:13,570][106226] Updated weights for policy 0, policy_version 1724327 (0.0008) [2023-12-28 07:39:13,582][106225] Updated weights for policy 1, policy_version 1728346 (0.0005) [2023-12-28 07:39:13,630][106225] Updated weights for policy 1, policy_version 1728356 (0.0005) [2023-12-28 07:39:14,223][106225] Updated weights for policy 1, policy_version 1728366 (0.0006) [2023-12-28 07:39:14,264][106226] Updated weights for policy 0, policy_version 1724337 (0.0006) [2023-12-28 07:39:14,281][106225] Updated weights for policy 1, policy_version 1728376 (0.0005) [2023-12-28 07:39:14,324][106226] Updated weights for policy 0, policy_version 1724347 (0.0008) [2023-12-28 07:39:14,335][106225] Updated weights for policy 1, policy_version 1728386 (0.0005) [2023-12-28 07:39:14,386][106226] Updated weights for policy 0, policy_version 1724357 (0.0009) [2023-12-28 07:39:14,930][106225] Updated weights for policy 1, policy_version 1728396 (0.0006) [2023-12-28 07:39:14,984][106225] Updated weights for policy 1, policy_version 1728406 (0.0007) [2023-12-28 07:39:15,039][106225] Updated weights for policy 1, policy_version 1728416 (0.0008) [2023-12-28 07:39:15,114][106226] Updated weights for policy 0, policy_version 1724367 (0.0007) [2023-12-28 07:39:15,179][106226] Updated weights for policy 0, policy_version 1724377 (0.0011) [2023-12-28 07:39:15,245][106226] Updated weights for policy 0, policy_version 1724387 (0.0011) [2023-12-28 07:39:15,689][106225] Updated weights for policy 1, policy_version 1728426 (0.0007) [2023-12-28 07:39:15,746][106225] Updated weights for policy 1, policy_version 1728436 (0.0005) [2023-12-28 07:39:15,804][106225] Updated weights for policy 1, policy_version 1728446 (0.0008) [2023-12-28 07:39:15,858][106225] Updated weights for policy 1, policy_version 1728456 (0.0007) [2023-12-28 07:39:15,985][106226] Updated weights for policy 0, policy_version 1724397 (0.0011) [2023-12-28 07:39:16,049][106226] Updated weights for policy 0, policy_version 1724407 (0.0011) [2023-12-28 07:39:16,109][106226] Updated weights for policy 0, policy_version 1724417 (0.0011) [2023-12-28 07:39:16,174][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 884072448. Throughput: 0: 9886.4, 1: 10194.8. Samples: 884057936. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:16,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.724')] [2023-12-28 07:39:16,559][106225] Updated weights for policy 1, policy_version 1728466 (0.0008) [2023-12-28 07:39:16,618][106225] Updated weights for policy 1, policy_version 1728476 (0.0008) [2023-12-28 07:39:16,678][106225] Updated weights for policy 1, policy_version 1728486 (0.0010) [2023-12-28 07:39:16,758][106226] Updated weights for policy 0, policy_version 1724427 (0.0011) [2023-12-28 07:39:16,830][106226] Updated weights for policy 0, policy_version 1724437 (0.0007) [2023-12-28 07:39:16,898][106226] Updated weights for policy 0, policy_version 1724447 (0.0006) [2023-12-28 07:39:17,335][106225] Updated weights for policy 1, policy_version 1728496 (0.0009) [2023-12-28 07:39:17,390][106225] Updated weights for policy 1, policy_version 1728506 (0.0005) [2023-12-28 07:39:17,446][106225] Updated weights for policy 1, policy_version 1728516 (0.0005) [2023-12-28 07:39:17,578][106226] Updated weights for policy 0, policy_version 1724457 (0.0008) [2023-12-28 07:39:17,635][106226] Updated weights for policy 0, policy_version 1724467 (0.0010) [2023-12-28 07:39:17,704][106226] Updated weights for policy 0, policy_version 1724477 (0.0010) [2023-12-28 07:39:17,759][106226] Updated weights for policy 0, policy_version 1724487 (0.0007) [2023-12-28 07:39:17,969][106225] Updated weights for policy 1, policy_version 1728526 (0.0005) [2023-12-28 07:39:18,016][106225] Updated weights for policy 1, policy_version 1728536 (0.0005) [2023-12-28 07:39:18,060][106225] Updated weights for policy 1, policy_version 1728546 (0.0005) [2023-12-28 07:39:18,549][106226] Updated weights for policy 0, policy_version 1724497 (0.0008) [2023-12-28 07:39:18,607][106226] Updated weights for policy 0, policy_version 1724507 (0.0008) [2023-12-28 07:39:18,658][106226] Updated weights for policy 0, policy_version 1724517 (0.0007) [2023-12-28 07:39:18,687][106225] Updated weights for policy 1, policy_version 1728556 (0.0007) [2023-12-28 07:39:18,749][106225] Updated weights for policy 1, policy_version 1728566 (0.0010) [2023-12-28 07:39:18,807][106225] Updated weights for policy 1, policy_version 1728576 (0.0010) [2023-12-28 07:39:19,371][106226] Updated weights for policy 0, policy_version 1724527 (0.0008) [2023-12-28 07:39:19,439][106226] Updated weights for policy 0, policy_version 1724537 (0.0006) [2023-12-28 07:39:19,507][106226] Updated weights for policy 0, policy_version 1724547 (0.0007) [2023-12-28 07:39:19,559][106225] Updated weights for policy 1, policy_version 1728586 (0.0010) [2023-12-28 07:39:19,619][106225] Updated weights for policy 1, policy_version 1728596 (0.0008) [2023-12-28 07:39:19,683][106225] Updated weights for policy 1, policy_version 1728606 (0.0009) [2023-12-28 07:39:19,745][106225] Updated weights for policy 1, policy_version 1728616 (0.0008) [2023-12-28 07:39:20,234][106226] Updated weights for policy 0, policy_version 1724557 (0.0008) [2023-12-28 07:39:20,305][106226] Updated weights for policy 0, policy_version 1724567 (0.0010) [2023-12-28 07:39:20,372][106226] Updated weights for policy 0, policy_version 1724577 (0.0008) [2023-12-28 07:39:20,449][106225] Updated weights for policy 1, policy_version 1728626 (0.0007) [2023-12-28 07:39:20,496][106225] Updated weights for policy 1, policy_version 1728636 (0.0008) [2023-12-28 07:39:20,542][106225] Updated weights for policy 1, policy_version 1728646 (0.0008) [2023-12-28 07:39:21,121][106226] Updated weights for policy 0, policy_version 1724587 (0.0008) [2023-12-28 07:39:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 884162560. Throughput: 0: 9795.2, 1: 10266.2. Samples: 884176832. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:21,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.626')] [2023-12-28 07:39:21,193][106226] Updated weights for policy 0, policy_version 1724597 (0.0009) [2023-12-28 07:39:21,253][106226] Updated weights for policy 0, policy_version 1724607 (0.0008) [2023-12-28 07:39:21,324][106225] Updated weights for policy 1, policy_version 1728656 (0.0007) [2023-12-28 07:39:21,423][106225] Updated weights for policy 1, policy_version 1728666 (0.0009) [2023-12-28 07:39:21,483][106225] Updated weights for policy 1, policy_version 1728676 (0.0009) [2023-12-28 07:39:22,074][106226] Updated weights for policy 0, policy_version 1724617 (0.0009) [2023-12-28 07:39:22,134][106226] Updated weights for policy 0, policy_version 1724627 (0.0009) [2023-12-28 07:39:22,173][106225] Updated weights for policy 1, policy_version 1728686 (0.0007) [2023-12-28 07:39:22,190][106226] Updated weights for policy 0, policy_version 1724637 (0.0009) [2023-12-28 07:39:22,229][106225] Updated weights for policy 1, policy_version 1728696 (0.0006) [2023-12-28 07:39:22,245][106226] Updated weights for policy 0, policy_version 1724647 (0.0006) [2023-12-28 07:39:22,294][106225] Updated weights for policy 1, policy_version 1728706 (0.0007) [2023-12-28 07:39:23,048][106225] Updated weights for policy 1, policy_version 1728716 (0.0009) [2023-12-28 07:39:23,057][106226] Updated weights for policy 0, policy_version 1724657 (0.0008) [2023-12-28 07:39:23,109][106226] Updated weights for policy 0, policy_version 1724667 (0.0007) [2023-12-28 07:39:23,110][106225] Updated weights for policy 1, policy_version 1728726 (0.0009) [2023-12-28 07:39:23,163][106225] Updated weights for policy 1, policy_version 1728736 (0.0006) [2023-12-28 07:39:23,167][106226] Updated weights for policy 0, policy_version 1724677 (0.0009) [2023-12-28 07:39:23,740][106225] Updated weights for policy 1, policy_version 1728746 (0.0005) [2023-12-28 07:39:23,799][106225] Updated weights for policy 1, policy_version 1728756 (0.0006) [2023-12-28 07:39:23,810][106226] Updated weights for policy 0, policy_version 1724687 (0.0010) [2023-12-28 07:39:23,851][106225] Updated weights for policy 1, policy_version 1728766 (0.0007) [2023-12-28 07:39:23,866][106226] Updated weights for policy 0, policy_version 1724697 (0.0010) [2023-12-28 07:39:23,916][106226] Updated weights for policy 0, policy_version 1724707 (0.0009) [2023-12-28 07:39:23,917][106225] Updated weights for policy 1, policy_version 1728776 (0.0007) [2023-12-28 07:39:24,513][106225] Updated weights for policy 1, policy_version 1728786 (0.0005) [2023-12-28 07:39:24,545][106226] Updated weights for policy 0, policy_version 1724717 (0.0009) [2023-12-28 07:39:24,573][106225] Updated weights for policy 1, policy_version 1728796 (0.0005) [2023-12-28 07:39:24,601][106226] Updated weights for policy 0, policy_version 1724727 (0.0009) [2023-12-28 07:39:24,634][106225] Updated weights for policy 1, policy_version 1728806 (0.0005) [2023-12-28 07:39:24,654][106226] Updated weights for policy 0, policy_version 1724737 (0.0006) [2023-12-28 07:39:25,141][106225] Updated weights for policy 1, policy_version 1728816 (0.0007) [2023-12-28 07:39:25,196][106225] Updated weights for policy 1, policy_version 1728826 (0.0010) [2023-12-28 07:39:25,255][106225] Updated weights for policy 1, policy_version 1728836 (0.0009) [2023-12-28 07:39:25,271][106226] Updated weights for policy 0, policy_version 1724747 (0.0005) [2023-12-28 07:39:25,329][106226] Updated weights for policy 0, policy_version 1724757 (0.0005) [2023-12-28 07:39:25,384][106226] Updated weights for policy 0, policy_version 1724767 (0.0008) [2023-12-28 07:39:25,952][106225] Updated weights for policy 1, policy_version 1728846 (0.0008) [2023-12-28 07:39:26,001][106225] Updated weights for policy 1, policy_version 1728856 (0.0008) [2023-12-28 07:39:26,053][106225] Updated weights for policy 1, policy_version 1728866 (0.0009) [2023-12-28 07:39:26,088][106226] Updated weights for policy 0, policy_version 1724777 (0.0009) [2023-12-28 07:39:26,141][106226] Updated weights for policy 0, policy_version 1724787 (0.0005) [2023-12-28 07:39:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 884269056. Throughput: 0: 9780.0, 1: 10218.1. Samples: 884234172. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:26,175][105115] Avg episode reward: [(0, '-4.423'), (1, '-4.975')] [2023-12-28 07:39:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001728872_442646528.pth... [2023-12-28 07:39:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001727656_442335232.pth [2023-12-28 07:39:26,199][106226] Updated weights for policy 0, policy_version 1724797 (0.0005) [2023-12-28 07:39:26,261][106226] Updated weights for policy 0, policy_version 1724807 (0.0006) [2023-12-28 07:39:26,265][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001724808_441630720.pth... [2023-12-28 07:39:26,268][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001723624_441327616.pth [2023-12-28 07:39:26,845][106225] Updated weights for policy 1, policy_version 1728876 (0.0008) [2023-12-28 07:39:26,862][106226] Updated weights for policy 0, policy_version 1724817 (0.0006) [2023-12-28 07:39:26,897][106225] Updated weights for policy 1, policy_version 1728886 (0.0006) [2023-12-28 07:39:26,913][106226] Updated weights for policy 0, policy_version 1724827 (0.0007) [2023-12-28 07:39:26,947][106225] Updated weights for policy 1, policy_version 1728896 (0.0006) [2023-12-28 07:39:26,971][106226] Updated weights for policy 0, policy_version 1724837 (0.0007) [2023-12-28 07:39:27,634][106225] Updated weights for policy 1, policy_version 1728906 (0.0007) [2023-12-28 07:39:27,657][106226] Updated weights for policy 0, policy_version 1724847 (0.0007) [2023-12-28 07:39:27,692][106225] Updated weights for policy 1, policy_version 1728916 (0.0010) [2023-12-28 07:39:27,717][106226] Updated weights for policy 0, policy_version 1724857 (0.0006) [2023-12-28 07:39:27,738][106225] Updated weights for policy 1, policy_version 1728926 (0.0010) [2023-12-28 07:39:27,774][106226] Updated weights for policy 0, policy_version 1724867 (0.0005) [2023-12-28 07:39:27,788][106225] Updated weights for policy 1, policy_version 1728936 (0.0010) [2023-12-28 07:39:28,458][106225] Updated weights for policy 1, policy_version 1728946 (0.0010) [2023-12-28 07:39:28,505][106225] Updated weights for policy 1, policy_version 1728956 (0.0010) [2023-12-28 07:39:28,550][106226] Updated weights for policy 0, policy_version 1724877 (0.0007) [2023-12-28 07:39:28,555][106225] Updated weights for policy 1, policy_version 1728966 (0.0010) [2023-12-28 07:39:28,602][106226] Updated weights for policy 0, policy_version 1724887 (0.0007) [2023-12-28 07:39:28,661][106226] Updated weights for policy 0, policy_version 1724897 (0.0008) [2023-12-28 07:39:29,143][106225] Updated weights for policy 1, policy_version 1728976 (0.0010) [2023-12-28 07:39:29,191][106225] Updated weights for policy 1, policy_version 1728986 (0.0009) [2023-12-28 07:39:29,256][106225] Updated weights for policy 1, policy_version 1728996 (0.0009) [2023-12-28 07:39:29,421][106226] Updated weights for policy 0, policy_version 1724907 (0.0009) [2023-12-28 07:39:29,469][106226] Updated weights for policy 0, policy_version 1724917 (0.0009) [2023-12-28 07:39:29,527][106226] Updated weights for policy 0, policy_version 1724927 (0.0008) [2023-12-28 07:39:30,015][106225] Updated weights for policy 1, policy_version 1729006 (0.0008) [2023-12-28 07:39:30,080][106225] Updated weights for policy 1, policy_version 1729016 (0.0005) [2023-12-28 07:39:30,137][106225] Updated weights for policy 1, policy_version 1729026 (0.0008) [2023-12-28 07:39:30,211][106226] Updated weights for policy 0, policy_version 1724937 (0.0008) [2023-12-28 07:39:30,276][106226] Updated weights for policy 0, policy_version 1724947 (0.0008) [2023-12-28 07:39:30,330][106226] Updated weights for policy 0, policy_version 1724957 (0.0008) [2023-12-28 07:39:30,392][106226] Updated weights for policy 0, policy_version 1724967 (0.0008) [2023-12-28 07:39:30,815][106225] Updated weights for policy 1, policy_version 1729036 (0.0009) [2023-12-28 07:39:30,877][106225] Updated weights for policy 1, policy_version 1729046 (0.0008) [2023-12-28 07:39:30,939][106225] Updated weights for policy 1, policy_version 1729056 (0.0009) [2023-12-28 07:39:31,130][106226] Updated weights for policy 0, policy_version 1724977 (0.0009) [2023-12-28 07:39:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19716.3). Total num frames: 884367360. Throughput: 0: 9800.8, 1: 10309.8. Samples: 884358820. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:31,175][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.696')] [2023-12-28 07:39:31,201][106226] Updated weights for policy 0, policy_version 1724987 (0.0008) [2023-12-28 07:39:31,271][106226] Updated weights for policy 0, policy_version 1724997 (0.0008) [2023-12-28 07:39:31,748][106225] Updated weights for policy 1, policy_version 1729066 (0.0010) [2023-12-28 07:39:31,809][106225] Updated weights for policy 1, policy_version 1729076 (0.0010) [2023-12-28 07:39:31,870][106225] Updated weights for policy 1, policy_version 1729086 (0.0010) [2023-12-28 07:39:31,931][106225] Updated weights for policy 1, policy_version 1729096 (0.0010) [2023-12-28 07:39:31,966][106226] Updated weights for policy 0, policy_version 1725007 (0.0008) [2023-12-28 07:39:32,036][106226] Updated weights for policy 0, policy_version 1725017 (0.0008) [2023-12-28 07:39:32,091][106226] Updated weights for policy 0, policy_version 1725027 (0.0008) [2023-12-28 07:39:32,686][106225] Updated weights for policy 1, policy_version 1729106 (0.0010) [2023-12-28 07:39:32,741][106225] Updated weights for policy 1, policy_version 1729116 (0.0010) [2023-12-28 07:39:32,784][106226] Updated weights for policy 0, policy_version 1725037 (0.0006) [2023-12-28 07:39:32,801][106225] Updated weights for policy 1, policy_version 1729126 (0.0010) [2023-12-28 07:39:32,837][106226] Updated weights for policy 0, policy_version 1725047 (0.0009) [2023-12-28 07:39:32,883][106226] Updated weights for policy 0, policy_version 1725057 (0.0008) [2023-12-28 07:39:33,509][106225] Updated weights for policy 1, policy_version 1729136 (0.0010) [2023-12-28 07:39:33,565][106225] Updated weights for policy 1, policy_version 1729146 (0.0010) [2023-12-28 07:39:33,591][106226] Updated weights for policy 0, policy_version 1725067 (0.0007) [2023-12-28 07:39:33,618][106225] Updated weights for policy 1, policy_version 1729156 (0.0010) [2023-12-28 07:39:33,649][106226] Updated weights for policy 0, policy_version 1725077 (0.0005) [2023-12-28 07:39:33,713][106226] Updated weights for policy 0, policy_version 1725087 (0.0005) [2023-12-28 07:39:34,219][106225] Updated weights for policy 1, policy_version 1729166 (0.0008) [2023-12-28 07:39:34,280][106225] Updated weights for policy 1, policy_version 1729176 (0.0006) [2023-12-28 07:39:34,342][106225] Updated weights for policy 1, policy_version 1729186 (0.0006) [2023-12-28 07:39:34,406][106226] Updated weights for policy 0, policy_version 1725097 (0.0006) [2023-12-28 07:39:34,468][106226] Updated weights for policy 0, policy_version 1725107 (0.0008) [2023-12-28 07:39:34,530][106226] Updated weights for policy 0, policy_version 1725117 (0.0008) [2023-12-28 07:39:34,592][106226] Updated weights for policy 0, policy_version 1725127 (0.0008) [2023-12-28 07:39:34,987][106225] Updated weights for policy 1, policy_version 1729196 (0.0008) [2023-12-28 07:39:35,042][106225] Updated weights for policy 1, policy_version 1729206 (0.0005) [2023-12-28 07:39:35,094][106225] Updated weights for policy 1, policy_version 1729216 (0.0005) [2023-12-28 07:39:35,229][106226] Updated weights for policy 0, policy_version 1725137 (0.0006) [2023-12-28 07:39:35,287][106226] Updated weights for policy 0, policy_version 1725147 (0.0007) [2023-12-28 07:39:35,348][106226] Updated weights for policy 0, policy_version 1725157 (0.0008) [2023-12-28 07:39:35,709][106225] Updated weights for policy 1, policy_version 1729226 (0.0005) [2023-12-28 07:39:35,772][106225] Updated weights for policy 1, policy_version 1729236 (0.0008) [2023-12-28 07:39:35,821][106225] Updated weights for policy 1, policy_version 1729246 (0.0007) [2023-12-28 07:39:35,879][106225] Updated weights for policy 1, policy_version 1729256 (0.0005) [2023-12-28 07:39:35,946][106226] Updated weights for policy 0, policy_version 1725167 (0.0007) [2023-12-28 07:39:36,004][106226] Updated weights for policy 0, policy_version 1725177 (0.0006) [2023-12-28 07:39:36,059][106226] Updated weights for policy 0, policy_version 1725187 (0.0005) [2023-12-28 07:39:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 884473856. Throughput: 0: 9868.6, 1: 10277.9. Samples: 884479508. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:36,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.691')] [2023-12-28 07:39:36,633][106225] Updated weights for policy 1, policy_version 1729266 (0.0009) [2023-12-28 07:39:36,684][106225] Updated weights for policy 1, policy_version 1729276 (0.0008) [2023-12-28 07:39:36,732][106226] Updated weights for policy 0, policy_version 1725197 (0.0005) [2023-12-28 07:39:36,742][106225] Updated weights for policy 1, policy_version 1729286 (0.0008) [2023-12-28 07:39:36,789][106226] Updated weights for policy 0, policy_version 1725207 (0.0007) [2023-12-28 07:39:36,845][106226] Updated weights for policy 0, policy_version 1725217 (0.0008) [2023-12-28 07:39:37,472][106226] Updated weights for policy 0, policy_version 1725227 (0.0008) [2023-12-28 07:39:37,531][106226] Updated weights for policy 0, policy_version 1725237 (0.0008) [2023-12-28 07:39:37,561][106225] Updated weights for policy 1, policy_version 1729296 (0.0007) [2023-12-28 07:39:37,590][106226] Updated weights for policy 0, policy_version 1725247 (0.0009) [2023-12-28 07:39:37,622][106225] Updated weights for policy 1, policy_version 1729306 (0.0006) [2023-12-28 07:39:37,679][106225] Updated weights for policy 1, policy_version 1729316 (0.0007) [2023-12-28 07:39:38,323][106226] Updated weights for policy 0, policy_version 1725257 (0.0006) [2023-12-28 07:39:38,327][106225] Updated weights for policy 1, policy_version 1729326 (0.0007) [2023-12-28 07:39:38,384][106226] Updated weights for policy 0, policy_version 1725267 (0.0008) [2023-12-28 07:39:38,396][106225] Updated weights for policy 1, policy_version 1729336 (0.0007) [2023-12-28 07:39:38,450][106226] Updated weights for policy 0, policy_version 1725277 (0.0006) [2023-12-28 07:39:38,459][106225] Updated weights for policy 1, policy_version 1729346 (0.0008) [2023-12-28 07:39:38,515][106226] Updated weights for policy 0, policy_version 1725287 (0.0006) [2023-12-28 07:39:39,078][106225] Updated weights for policy 1, policy_version 1729356 (0.0008) [2023-12-28 07:39:39,103][106226] Updated weights for policy 0, policy_version 1725297 (0.0005) [2023-12-28 07:39:39,134][106225] Updated weights for policy 1, policy_version 1729366 (0.0010) [2023-12-28 07:39:39,156][106226] Updated weights for policy 0, policy_version 1725307 (0.0005) [2023-12-28 07:39:39,187][106225] Updated weights for policy 1, policy_version 1729376 (0.0010) [2023-12-28 07:39:39,213][106226] Updated weights for policy 0, policy_version 1725317 (0.0007) [2023-12-28 07:39:39,934][106225] Updated weights for policy 1, policy_version 1729386 (0.0009) [2023-12-28 07:39:39,959][106226] Updated weights for policy 0, policy_version 1725327 (0.0008) [2023-12-28 07:39:39,999][106225] Updated weights for policy 1, policy_version 1729396 (0.0008) [2023-12-28 07:39:40,028][106226] Updated weights for policy 0, policy_version 1725337 (0.0007) [2023-12-28 07:39:40,063][106225] Updated weights for policy 1, policy_version 1729406 (0.0007) [2023-12-28 07:39:40,078][106226] Updated weights for policy 0, policy_version 1725347 (0.0007) [2023-12-28 07:39:40,127][106225] Updated weights for policy 1, policy_version 1729416 (0.0008) [2023-12-28 07:39:40,829][106226] Updated weights for policy 0, policy_version 1725357 (0.0006) [2023-12-28 07:39:40,863][106225] Updated weights for policy 1, policy_version 1729426 (0.0010) [2023-12-28 07:39:40,887][106226] Updated weights for policy 0, policy_version 1725367 (0.0005) [2023-12-28 07:39:40,925][106225] Updated weights for policy 1, policy_version 1729436 (0.0010) [2023-12-28 07:39:40,944][106226] Updated weights for policy 0, policy_version 1725377 (0.0006) [2023-12-28 07:39:40,972][106225] Updated weights for policy 1, policy_version 1729446 (0.0010) [2023-12-28 07:39:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19744.1). Total num frames: 884572160. Throughput: 0: 9975.4, 1: 10214.3. Samples: 884539064. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:41,175][105115] Avg episode reward: [(0, '-4.707'), (1, '-4.513')] [2023-12-28 07:39:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001729448_442793984.pth... [2023-12-28 07:39:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001725384_441778176.pth... [2023-12-28 07:39:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001724232_441483264.pth [2023-12-28 07:39:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001728264_442490880.pth [2023-12-28 07:39:41,680][106226] Updated weights for policy 0, policy_version 1725387 (0.0008) [2023-12-28 07:39:41,749][106225] Updated weights for policy 1, policy_version 1729456 (0.0007) [2023-12-28 07:39:41,753][106226] Updated weights for policy 0, policy_version 1725397 (0.0009) [2023-12-28 07:39:41,810][106226] Updated weights for policy 0, policy_version 1725407 (0.0008) [2023-12-28 07:39:41,813][106225] Updated weights for policy 1, policy_version 1729466 (0.0006) [2023-12-28 07:39:41,868][106225] Updated weights for policy 1, policy_version 1729476 (0.0005) [2023-12-28 07:39:42,487][106226] Updated weights for policy 0, policy_version 1725417 (0.0008) [2023-12-28 07:39:42,539][106226] Updated weights for policy 0, policy_version 1725427 (0.0008) [2023-12-28 07:39:42,603][106226] Updated weights for policy 0, policy_version 1725437 (0.0008) [2023-12-28 07:39:42,632][106225] Updated weights for policy 1, policy_version 1729486 (0.0006) [2023-12-28 07:39:42,672][106226] Updated weights for policy 0, policy_version 1725447 (0.0006) [2023-12-28 07:39:42,700][106225] Updated weights for policy 1, policy_version 1729496 (0.0008) [2023-12-28 07:39:42,762][106225] Updated weights for policy 1, policy_version 1729506 (0.0010) [2023-12-28 07:39:43,420][106226] Updated weights for policy 0, policy_version 1725457 (0.0009) [2023-12-28 07:39:43,447][106225] Updated weights for policy 1, policy_version 1729516 (0.0008) [2023-12-28 07:39:43,476][106226] Updated weights for policy 0, policy_version 1725467 (0.0007) [2023-12-28 07:39:43,506][106225] Updated weights for policy 1, policy_version 1729526 (0.0006) [2023-12-28 07:39:43,528][106226] Updated weights for policy 0, policy_version 1725477 (0.0006) [2023-12-28 07:39:43,559][106225] Updated weights for policy 1, policy_version 1729536 (0.0006) [2023-12-28 07:39:44,142][106226] Updated weights for policy 0, policy_version 1725487 (0.0007) [2023-12-28 07:39:44,209][106226] Updated weights for policy 0, policy_version 1725497 (0.0008) [2023-12-28 07:39:44,274][106226] Updated weights for policy 0, policy_version 1725507 (0.0008) [2023-12-28 07:39:44,288][106225] Updated weights for policy 1, policy_version 1729546 (0.0007) [2023-12-28 07:39:44,341][106225] Updated weights for policy 1, policy_version 1729556 (0.0008) [2023-12-28 07:39:44,407][106225] Updated weights for policy 1, policy_version 1729566 (0.0009) [2023-12-28 07:39:44,464][106225] Updated weights for policy 1, policy_version 1729576 (0.0006) [2023-12-28 07:39:44,974][106226] Updated weights for policy 0, policy_version 1725517 (0.0008) [2023-12-28 07:39:45,032][106226] Updated weights for policy 0, policy_version 1725527 (0.0007) [2023-12-28 07:39:45,034][106225] Updated weights for policy 1, policy_version 1729586 (0.0006) [2023-12-28 07:39:45,083][106225] Updated weights for policy 1, policy_version 1729596 (0.0006) [2023-12-28 07:39:45,089][106226] Updated weights for policy 0, policy_version 1725537 (0.0006) [2023-12-28 07:39:45,141][106225] Updated weights for policy 1, policy_version 1729606 (0.0009) [2023-12-28 07:39:45,792][106226] Updated weights for policy 0, policy_version 1725547 (0.0008) [2023-12-28 07:39:45,843][106226] Updated weights for policy 0, policy_version 1725557 (0.0010) [2023-12-28 07:39:45,863][106225] Updated weights for policy 1, policy_version 1729616 (0.0006) [2023-12-28 07:39:45,893][106226] Updated weights for policy 0, policy_version 1725567 (0.0010) [2023-12-28 07:39:45,914][106225] Updated weights for policy 1, policy_version 1729626 (0.0005) [2023-12-28 07:39:45,961][106225] Updated weights for policy 1, policy_version 1729636 (0.0006) [2023-12-28 07:39:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 884670464. Throughput: 0: 9915.4, 1: 10155.9. Samples: 884655152. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:46,175][105115] Avg episode reward: [(0, '-4.775'), (1, '-4.690')] [2023-12-28 07:39:46,577][106226] Updated weights for policy 0, policy_version 1725577 (0.0010) [2023-12-28 07:39:46,624][106226] Updated weights for policy 0, policy_version 1725587 (0.0010) [2023-12-28 07:39:46,677][106225] Updated weights for policy 1, policy_version 1729646 (0.0006) [2023-12-28 07:39:46,682][106226] Updated weights for policy 0, policy_version 1725597 (0.0011) [2023-12-28 07:39:46,739][106225] Updated weights for policy 1, policy_version 1729656 (0.0006) [2023-12-28 07:39:46,743][106226] Updated weights for policy 0, policy_version 1725607 (0.0011) [2023-12-28 07:39:46,803][106225] Updated weights for policy 1, policy_version 1729666 (0.0006) [2023-12-28 07:39:47,459][106225] Updated weights for policy 1, policy_version 1729676 (0.0007) [2023-12-28 07:39:47,466][106226] Updated weights for policy 0, policy_version 1725617 (0.0009) [2023-12-28 07:39:47,513][106225] Updated weights for policy 1, policy_version 1729686 (0.0006) [2023-12-28 07:39:47,530][106226] Updated weights for policy 0, policy_version 1725627 (0.0011) [2023-12-28 07:39:47,572][106225] Updated weights for policy 1, policy_version 1729696 (0.0007) [2023-12-28 07:39:47,591][106226] Updated weights for policy 0, policy_version 1725637 (0.0007) [2023-12-28 07:39:48,129][106226] Updated weights for policy 0, policy_version 1725647 (0.0008) [2023-12-28 07:39:48,184][106226] Updated weights for policy 0, policy_version 1725657 (0.0011) [2023-12-28 07:39:48,240][106226] Updated weights for policy 0, policy_version 1725667 (0.0010) [2023-12-28 07:39:48,368][106225] Updated weights for policy 1, policy_version 1729706 (0.0008) [2023-12-28 07:39:48,427][106225] Updated weights for policy 1, policy_version 1729716 (0.0006) [2023-12-28 07:39:48,480][106225] Updated weights for policy 1, policy_version 1729726 (0.0006) [2023-12-28 07:39:48,538][106225] Updated weights for policy 1, policy_version 1729736 (0.0007) [2023-12-28 07:39:48,875][106226] Updated weights for policy 0, policy_version 1725677 (0.0008) [2023-12-28 07:39:48,926][106226] Updated weights for policy 0, policy_version 1725687 (0.0010) [2023-12-28 07:39:48,973][106226] Updated weights for policy 0, policy_version 1725697 (0.0010) [2023-12-28 07:39:49,164][106225] Updated weights for policy 1, policy_version 1729746 (0.0008) [2023-12-28 07:39:49,212][106225] Updated weights for policy 1, policy_version 1729756 (0.0008) [2023-12-28 07:39:49,276][106225] Updated weights for policy 1, policy_version 1729766 (0.0009) [2023-12-28 07:39:49,738][106226] Updated weights for policy 0, policy_version 1725707 (0.0008) [2023-12-28 07:39:49,795][106226] Updated weights for policy 0, policy_version 1725717 (0.0006) [2023-12-28 07:39:49,865][106226] Updated weights for policy 0, policy_version 1725727 (0.0008) [2023-12-28 07:39:50,057][106225] Updated weights for policy 1, policy_version 1729776 (0.0009) [2023-12-28 07:39:50,118][106225] Updated weights for policy 1, policy_version 1729786 (0.0008) [2023-12-28 07:39:50,183][106225] Updated weights for policy 1, policy_version 1729796 (0.0008) [2023-12-28 07:39:50,624][106226] Updated weights for policy 0, policy_version 1725737 (0.0009) [2023-12-28 07:39:50,682][106226] Updated weights for policy 0, policy_version 1725747 (0.0008) [2023-12-28 07:39:50,736][106226] Updated weights for policy 0, policy_version 1725757 (0.0008) [2023-12-28 07:39:50,798][106226] Updated weights for policy 0, policy_version 1725767 (0.0008) [2023-12-28 07:39:50,817][106225] Updated weights for policy 1, policy_version 1729806 (0.0006) [2023-12-28 07:39:50,884][106225] Updated weights for policy 1, policy_version 1729816 (0.0008) [2023-12-28 07:39:50,932][106225] Updated weights for policy 1, policy_version 1729826 (0.0008) [2023-12-28 07:39:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20206.9, 300 sec: 19771.9). Total num frames: 884768768. Throughput: 0: 9890.9, 1: 10128.6. Samples: 884774980. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:51,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.660')] [2023-12-28 07:39:51,620][106226] Updated weights for policy 0, policy_version 1725777 (0.0008) [2023-12-28 07:39:51,681][106225] Updated weights for policy 1, policy_version 1729836 (0.0009) [2023-12-28 07:39:51,688][106226] Updated weights for policy 0, policy_version 1725787 (0.0008) [2023-12-28 07:39:51,757][106226] Updated weights for policy 0, policy_version 1725797 (0.0009) [2023-12-28 07:39:51,763][106225] Updated weights for policy 1, policy_version 1729846 (0.0009) [2023-12-28 07:39:51,828][106225] Updated weights for policy 1, policy_version 1729856 (0.0008) [2023-12-28 07:39:52,511][106226] Updated weights for policy 0, policy_version 1725807 (0.0009) [2023-12-28 07:39:52,574][106226] Updated weights for policy 0, policy_version 1725817 (0.0008) [2023-12-28 07:39:52,580][106225] Updated weights for policy 1, policy_version 1729866 (0.0007) [2023-12-28 07:39:52,634][106226] Updated weights for policy 0, policy_version 1725827 (0.0006) [2023-12-28 07:39:52,640][106225] Updated weights for policy 1, policy_version 1729876 (0.0006) [2023-12-28 07:39:52,697][106225] Updated weights for policy 1, policy_version 1729886 (0.0008) [2023-12-28 07:39:52,763][106225] Updated weights for policy 1, policy_version 1729896 (0.0008) [2023-12-28 07:39:53,395][106226] Updated weights for policy 0, policy_version 1725837 (0.0007) [2023-12-28 07:39:53,441][106226] Updated weights for policy 0, policy_version 1725847 (0.0005) [2023-12-28 07:39:53,457][106225] Updated weights for policy 1, policy_version 1729906 (0.0005) [2023-12-28 07:39:53,495][106226] Updated weights for policy 0, policy_version 1725857 (0.0005) [2023-12-28 07:39:53,509][106225] Updated weights for policy 1, policy_version 1729916 (0.0007) [2023-12-28 07:39:53,562][106225] Updated weights for policy 1, policy_version 1729926 (0.0007) [2023-12-28 07:39:54,181][106226] Updated weights for policy 0, policy_version 1725867 (0.0008) [2023-12-28 07:39:54,225][106225] Updated weights for policy 1, policy_version 1729936 (0.0006) [2023-12-28 07:39:54,243][106226] Updated weights for policy 0, policy_version 1725877 (0.0011) [2023-12-28 07:39:54,288][106225] Updated weights for policy 1, policy_version 1729946 (0.0006) [2023-12-28 07:39:54,291][106226] Updated weights for policy 0, policy_version 1725887 (0.0010) [2023-12-28 07:39:54,344][106225] Updated weights for policy 1, policy_version 1729956 (0.0006) [2023-12-28 07:39:54,851][106226] Updated weights for policy 0, policy_version 1725897 (0.0010) [2023-12-28 07:39:54,910][106226] Updated weights for policy 0, policy_version 1725907 (0.0005) [2023-12-28 07:39:54,968][106226] Updated weights for policy 0, policy_version 1725917 (0.0006) [2023-12-28 07:39:55,038][106226] Updated weights for policy 0, policy_version 1725927 (0.0010) [2023-12-28 07:39:55,128][106225] Updated weights for policy 1, policy_version 1729966 (0.0008) [2023-12-28 07:39:55,181][106225] Updated weights for policy 1, policy_version 1729976 (0.0007) [2023-12-28 07:39:55,231][106225] Updated weights for policy 1, policy_version 1729986 (0.0009) [2023-12-28 07:39:55,661][106226] Updated weights for policy 0, policy_version 1725937 (0.0009) [2023-12-28 07:39:55,721][106226] Updated weights for policy 0, policy_version 1725947 (0.0008) [2023-12-28 07:39:55,789][106226] Updated weights for policy 0, policy_version 1725957 (0.0005) [2023-12-28 07:39:55,868][106225] Updated weights for policy 1, policy_version 1729996 (0.0008) [2023-12-28 07:39:55,932][106225] Updated weights for policy 1, policy_version 1730006 (0.0005) [2023-12-28 07:39:55,985][106225] Updated weights for policy 1, policy_version 1730016 (0.0005) [2023-12-28 07:39:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 884867072. Throughput: 0: 9786.8, 1: 10041.1. Samples: 884831444. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:39:56,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.534')] [2023-12-28 07:39:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001730024_442941440.pth... [2023-12-28 07:39:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001725960_441925632.pth... [2023-12-28 07:39:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001724808_441630720.pth [2023-12-28 07:39:56,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001728872_442646528.pth [2023-12-28 07:39:56,499][106226] Updated weights for policy 0, policy_version 1725967 (0.0008) [2023-12-28 07:39:56,554][106226] Updated weights for policy 0, policy_version 1725977 (0.0009) [2023-12-28 07:39:56,590][106225] Updated weights for policy 1, policy_version 1730026 (0.0006) [2023-12-28 07:39:56,600][106226] Updated weights for policy 0, policy_version 1725987 (0.0008) [2023-12-28 07:39:56,637][106225] Updated weights for policy 1, policy_version 1730036 (0.0005) [2023-12-28 07:39:56,680][106225] Updated weights for policy 1, policy_version 1730046 (0.0005) [2023-12-28 07:39:56,734][106225] Updated weights for policy 1, policy_version 1730056 (0.0005) [2023-12-28 07:39:57,297][106226] Updated weights for policy 0, policy_version 1725997 (0.0008) [2023-12-28 07:39:57,354][106226] Updated weights for policy 0, policy_version 1726007 (0.0008) [2023-12-28 07:39:57,397][106225] Updated weights for policy 1, policy_version 1730066 (0.0008) [2023-12-28 07:39:57,404][106226] Updated weights for policy 0, policy_version 1726017 (0.0006) [2023-12-28 07:39:57,443][106225] Updated weights for policy 1, policy_version 1730076 (0.0005) [2023-12-28 07:39:57,502][106225] Updated weights for policy 1, policy_version 1730086 (0.0005) [2023-12-28 07:39:58,011][106226] Updated weights for policy 0, policy_version 1726027 (0.0009) [2023-12-28 07:39:58,063][106226] Updated weights for policy 0, policy_version 1726037 (0.0010) [2023-12-28 07:39:58,115][106226] Updated weights for policy 0, policy_version 1726047 (0.0010) [2023-12-28 07:39:58,204][106225] Updated weights for policy 1, policy_version 1730096 (0.0007) [2023-12-28 07:39:58,269][106225] Updated weights for policy 1, policy_version 1730106 (0.0006) [2023-12-28 07:39:58,333][106225] Updated weights for policy 1, policy_version 1730116 (0.0008) [2023-12-28 07:39:58,931][106226] Updated weights for policy 0, policy_version 1726057 (0.0010) [2023-12-28 07:39:59,002][106226] Updated weights for policy 0, policy_version 1726067 (0.0008) [2023-12-28 07:39:59,060][106226] Updated weights for policy 0, policy_version 1726077 (0.0008) [2023-12-28 07:39:59,111][106225] Updated weights for policy 1, policy_version 1730126 (0.0007) [2023-12-28 07:39:59,122][106226] Updated weights for policy 0, policy_version 1726087 (0.0008) [2023-12-28 07:39:59,174][106225] Updated weights for policy 1, policy_version 1730136 (0.0008) [2023-12-28 07:39:59,242][106225] Updated weights for policy 1, policy_version 1730146 (0.0008) [2023-12-28 07:39:59,893][106225] Updated weights for policy 1, policy_version 1730156 (0.0009) [2023-12-28 07:39:59,957][106225] Updated weights for policy 1, policy_version 1730166 (0.0008) [2023-12-28 07:39:59,988][106226] Updated weights for policy 0, policy_version 1726097 (0.0010) [2023-12-28 07:40:00,013][106225] Updated weights for policy 1, policy_version 1730176 (0.0009) [2023-12-28 07:40:00,052][106226] Updated weights for policy 0, policy_version 1726107 (0.0010) [2023-12-28 07:40:00,107][106226] Updated weights for policy 0, policy_version 1726117 (0.0009) [2023-12-28 07:40:00,731][106225] Updated weights for policy 1, policy_version 1730186 (0.0006) [2023-12-28 07:40:00,778][106226] Updated weights for policy 0, policy_version 1726127 (0.0007) [2023-12-28 07:40:00,780][106225] Updated weights for policy 1, policy_version 1730196 (0.0010) [2023-12-28 07:40:00,830][106225] Updated weights for policy 1, policy_version 1730206 (0.0010) [2023-12-28 07:40:00,832][106226] Updated weights for policy 0, policy_version 1726137 (0.0005) [2023-12-28 07:40:00,879][106225] Updated weights for policy 1, policy_version 1730216 (0.0010) [2023-12-28 07:40:00,890][106226] Updated weights for policy 0, policy_version 1726147 (0.0008) [2023-12-28 07:40:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19744.1). Total num frames: 884965376. Throughput: 0: 9846.8, 1: 10009.0. Samples: 884951452. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:40:01,175][105115] Avg episode reward: [(0, '-4.132'), (1, '-4.448')] [2023-12-28 07:40:01,619][106226] Updated weights for policy 0, policy_version 1726157 (0.0009) [2023-12-28 07:40:01,635][106225] Updated weights for policy 1, policy_version 1730226 (0.0008) [2023-12-28 07:40:01,685][106226] Updated weights for policy 0, policy_version 1726167 (0.0010) [2023-12-28 07:40:01,703][106225] Updated weights for policy 1, policy_version 1730236 (0.0006) [2023-12-28 07:40:01,750][106226] Updated weights for policy 0, policy_version 1726177 (0.0010) [2023-12-28 07:40:01,769][106225] Updated weights for policy 1, policy_version 1730246 (0.0008) [2023-12-28 07:40:02,417][106225] Updated weights for policy 1, policy_version 1730256 (0.0008) [2023-12-28 07:40:02,487][106225] Updated weights for policy 1, policy_version 1730266 (0.0008) [2023-12-28 07:40:02,503][106226] Updated weights for policy 0, policy_version 1726187 (0.0010) [2023-12-28 07:40:02,546][106225] Updated weights for policy 1, policy_version 1730276 (0.0008) [2023-12-28 07:40:02,561][106226] Updated weights for policy 0, policy_version 1726197 (0.0006) [2023-12-28 07:40:02,622][106226] Updated weights for policy 0, policy_version 1726207 (0.0008) [2023-12-28 07:40:03,134][106225] Updated weights for policy 1, policy_version 1730286 (0.0006) [2023-12-28 07:40:03,201][106225] Updated weights for policy 1, policy_version 1730296 (0.0005) [2023-12-28 07:40:03,268][106225] Updated weights for policy 1, policy_version 1730306 (0.0005) [2023-12-28 07:40:03,415][106226] Updated weights for policy 0, policy_version 1726217 (0.0009) [2023-12-28 07:40:03,469][106226] Updated weights for policy 0, policy_version 1726227 (0.0010) [2023-12-28 07:40:03,523][106226] Updated weights for policy 0, policy_version 1726237 (0.0008) [2023-12-28 07:40:03,577][106226] Updated weights for policy 0, policy_version 1726247 (0.0010) [2023-12-28 07:40:03,816][106225] Updated weights for policy 1, policy_version 1730316 (0.0007) [2023-12-28 07:40:03,874][106225] Updated weights for policy 1, policy_version 1730326 (0.0008) [2023-12-28 07:40:03,926][106225] Updated weights for policy 1, policy_version 1730336 (0.0009) [2023-12-28 07:40:04,253][106226] Updated weights for policy 0, policy_version 1726257 (0.0009) [2023-12-28 07:40:04,318][106226] Updated weights for policy 0, policy_version 1726267 (0.0011) [2023-12-28 07:40:04,380][106226] Updated weights for policy 0, policy_version 1726277 (0.0011) [2023-12-28 07:40:04,698][106225] Updated weights for policy 1, policy_version 1730346 (0.0009) [2023-12-28 07:40:04,758][106225] Updated weights for policy 1, policy_version 1730356 (0.0009) [2023-12-28 07:40:04,815][106225] Updated weights for policy 1, policy_version 1730366 (0.0005) [2023-12-28 07:40:04,879][106225] Updated weights for policy 1, policy_version 1730376 (0.0005) [2023-12-28 07:40:05,047][106226] Updated weights for policy 0, policy_version 1726287 (0.0009) [2023-12-28 07:40:05,114][106226] Updated weights for policy 0, policy_version 1726297 (0.0005) [2023-12-28 07:40:05,181][106226] Updated weights for policy 0, policy_version 1726307 (0.0005) [2023-12-28 07:40:05,506][106225] Updated weights for policy 1, policy_version 1730386 (0.0008) [2023-12-28 07:40:05,556][106225] Updated weights for policy 1, policy_version 1730397 (0.0008) [2023-12-28 07:40:05,606][106225] Updated weights for policy 1, policy_version 1730407 (0.0009) [2023-12-28 07:40:05,734][106226] Updated weights for policy 0, policy_version 1726317 (0.0005) [2023-12-28 07:40:05,779][106226] Updated weights for policy 0, policy_version 1726327 (0.0005) [2023-12-28 07:40:05,838][106226] Updated weights for policy 0, policy_version 1726337 (0.0009) [2023-12-28 07:40:06,175][105115] Fps is (10 sec: 19660.3, 60 sec: 20070.3, 300 sec: 19744.1). Total num frames: 885063680. Throughput: 0: 9908.0, 1: 9993.2. Samples: 885072392. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:40:06,176][105115] Avg episode reward: [(0, '-4.501'), (1, '-5.085')] [2023-12-28 07:40:06,414][106225] Updated weights for policy 1, policy_version 1730417 (0.0008) [2023-12-28 07:40:06,481][106225] Updated weights for policy 1, policy_version 1730427 (0.0008) [2023-12-28 07:40:06,539][106225] Updated weights for policy 1, policy_version 1730437 (0.0007) [2023-12-28 07:40:06,548][106226] Updated weights for policy 0, policy_version 1726347 (0.0011) [2023-12-28 07:40:06,614][106226] Updated weights for policy 0, policy_version 1726357 (0.0011) [2023-12-28 07:40:06,680][106226] Updated weights for policy 0, policy_version 1726367 (0.0011) [2023-12-28 07:40:07,272][106225] Updated weights for policy 1, policy_version 1730447 (0.0007) [2023-12-28 07:40:07,328][106225] Updated weights for policy 1, policy_version 1730457 (0.0008) [2023-12-28 07:40:07,390][106226] Updated weights for policy 0, policy_version 1726377 (0.0011) [2023-12-28 07:40:07,392][106225] Updated weights for policy 1, policy_version 1730467 (0.0007) [2023-12-28 07:40:07,448][106226] Updated weights for policy 0, policy_version 1726387 (0.0011) [2023-12-28 07:40:07,498][106226] Updated weights for policy 0, policy_version 1726397 (0.0010) [2023-12-28 07:40:07,551][106226] Updated weights for policy 0, policy_version 1726407 (0.0010) [2023-12-28 07:40:08,100][106225] Updated weights for policy 1, policy_version 1730477 (0.0008) [2023-12-28 07:40:08,160][106225] Updated weights for policy 1, policy_version 1730487 (0.0006) [2023-12-28 07:40:08,202][106226] Updated weights for policy 0, policy_version 1726417 (0.0011) [2023-12-28 07:40:08,211][106225] Updated weights for policy 1, policy_version 1730497 (0.0005) [2023-12-28 07:40:08,263][106226] Updated weights for policy 0, policy_version 1726427 (0.0010) [2023-12-28 07:40:08,326][106226] Updated weights for policy 0, policy_version 1726437 (0.0010) [2023-12-28 07:40:08,808][106225] Updated weights for policy 1, policy_version 1730507 (0.0006) [2023-12-28 07:40:08,873][106225] Updated weights for policy 1, policy_version 1730517 (0.0005) [2023-12-28 07:40:08,933][106225] Updated weights for policy 1, policy_version 1730527 (0.0005) [2023-12-28 07:40:09,055][106226] Updated weights for policy 0, policy_version 1726447 (0.0009) [2023-12-28 07:40:09,113][106226] Updated weights for policy 0, policy_version 1726457 (0.0011) [2023-12-28 07:40:09,173][106226] Updated weights for policy 0, policy_version 1726467 (0.0011) [2023-12-28 07:40:09,547][106225] Updated weights for policy 1, policy_version 1730537 (0.0005) [2023-12-28 07:40:09,609][106225] Updated weights for policy 1, policy_version 1730547 (0.0006) [2023-12-28 07:40:09,667][106225] Updated weights for policy 1, policy_version 1730557 (0.0006) [2023-12-28 07:40:09,732][106225] Updated weights for policy 1, policy_version 1730567 (0.0006) [2023-12-28 07:40:09,916][106226] Updated weights for policy 0, policy_version 1726477 (0.0010) [2023-12-28 07:40:09,988][106226] Updated weights for policy 0, policy_version 1726487 (0.0008) [2023-12-28 07:40:10,058][106226] Updated weights for policy 0, policy_version 1726497 (0.0008) [2023-12-28 07:40:10,399][106225] Updated weights for policy 1, policy_version 1730577 (0.0010) [2023-12-28 07:40:10,453][106225] Updated weights for policy 1, policy_version 1730587 (0.0011) [2023-12-28 07:40:10,512][106225] Updated weights for policy 1, policy_version 1730597 (0.0010) [2023-12-28 07:40:10,720][106226] Updated weights for policy 0, policy_version 1726507 (0.0009) [2023-12-28 07:40:10,773][106226] Updated weights for policy 0, policy_version 1726517 (0.0007) [2023-12-28 07:40:10,832][106226] Updated weights for policy 0, policy_version 1726527 (0.0005) [2023-12-28 07:40:11,155][106225] Updated weights for policy 1, policy_version 1730607 (0.0009) [2023-12-28 07:40:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 885161984. Throughput: 0: 9946.6, 1: 9999.3. Samples: 885131736. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:40:11,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.810')] [2023-12-28 07:40:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001726536_442073088.pth... [2023-12-28 07:40:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001725384_441778176.pth [2023-12-28 07:40:11,223][106225] Updated weights for policy 1, policy_version 1730617 (0.0009) [2023-12-28 07:40:11,281][106225] Updated weights for policy 1, policy_version 1730627 (0.0008) [2023-12-28 07:40:11,304][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001730632_443097088.pth... [2023-12-28 07:40:11,308][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001729448_442793984.pth [2023-12-28 07:40:11,490][106226] Updated weights for policy 0, policy_version 1726537 (0.0006) [2023-12-28 07:40:11,551][106226] Updated weights for policy 0, policy_version 1726547 (0.0010) [2023-12-28 07:40:11,618][106226] Updated weights for policy 0, policy_version 1726557 (0.0010) [2023-12-28 07:40:11,690][106226] Updated weights for policy 0, policy_version 1726567 (0.0009) [2023-12-28 07:40:12,042][106225] Updated weights for policy 1, policy_version 1730637 (0.0008) [2023-12-28 07:40:12,098][106225] Updated weights for policy 1, policy_version 1730647 (0.0009) [2023-12-28 07:40:12,159][106225] Updated weights for policy 1, policy_version 1730657 (0.0008) [2023-12-28 07:40:12,472][106226] Updated weights for policy 0, policy_version 1726577 (0.0008) [2023-12-28 07:40:12,528][106226] Updated weights for policy 0, policy_version 1726587 (0.0008) [2023-12-28 07:40:12,585][106226] Updated weights for policy 0, policy_version 1726597 (0.0008) [2023-12-28 07:40:12,874][106225] Updated weights for policy 1, policy_version 1730667 (0.0008) [2023-12-28 07:40:12,936][106225] Updated weights for policy 1, policy_version 1730677 (0.0006) [2023-12-28 07:40:12,998][106225] Updated weights for policy 1, policy_version 1730687 (0.0005) [2023-12-28 07:40:13,404][106226] Updated weights for policy 0, policy_version 1726607 (0.0008) [2023-12-28 07:40:13,453][106226] Updated weights for policy 0, policy_version 1726617 (0.0007) [2023-12-28 07:40:13,506][106226] Updated weights for policy 0, policy_version 1726627 (0.0007) [2023-12-28 07:40:13,568][106225] Updated weights for policy 1, policy_version 1730697 (0.0006) [2023-12-28 07:40:13,630][106225] Updated weights for policy 1, policy_version 1730707 (0.0010) [2023-12-28 07:40:13,696][106225] Updated weights for policy 1, policy_version 1730717 (0.0010) [2023-12-28 07:40:13,760][106225] Updated weights for policy 1, policy_version 1730727 (0.0011) [2023-12-28 07:40:14,245][106226] Updated weights for policy 0, policy_version 1726637 (0.0008) [2023-12-28 07:40:14,292][106226] Updated weights for policy 0, policy_version 1726647 (0.0008) [2023-12-28 07:40:14,352][106226] Updated weights for policy 0, policy_version 1726657 (0.0008) [2023-12-28 07:40:14,475][106225] Updated weights for policy 1, policy_version 1730737 (0.0010) [2023-12-28 07:40:14,534][106225] Updated weights for policy 1, policy_version 1730747 (0.0010) [2023-12-28 07:40:14,588][106225] Updated weights for policy 1, policy_version 1730757 (0.0010) [2023-12-28 07:40:15,130][106226] Updated weights for policy 0, policy_version 1726667 (0.0009) [2023-12-28 07:40:15,188][106226] Updated weights for policy 0, policy_version 1726677 (0.0010) [2023-12-28 07:40:15,250][106226] Updated weights for policy 0, policy_version 1726687 (0.0011) [2023-12-28 07:40:15,268][106225] Updated weights for policy 1, policy_version 1730767 (0.0007) [2023-12-28 07:40:15,317][106225] Updated weights for policy 1, policy_version 1730777 (0.0008) [2023-12-28 07:40:15,375][106225] Updated weights for policy 1, policy_version 1730787 (0.0006) [2023-12-28 07:40:15,919][106226] Updated weights for policy 0, policy_version 1726697 (0.0010) [2023-12-28 07:40:15,983][106226] Updated weights for policy 0, policy_version 1726707 (0.0008) [2023-12-28 07:40:16,008][106225] Updated weights for policy 1, policy_version 1730797 (0.0007) [2023-12-28 07:40:16,048][106226] Updated weights for policy 0, policy_version 1726717 (0.0008) [2023-12-28 07:40:16,065][106225] Updated weights for policy 1, policy_version 1730807 (0.0005) [2023-12-28 07:40:16,116][106226] Updated weights for policy 0, policy_version 1726727 (0.0008) [2023-12-28 07:40:16,122][106225] Updated weights for policy 1, policy_version 1730817 (0.0006) [2023-12-28 07:40:16,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 885268480. Throughput: 0: 9847.4, 1: 9927.5. Samples: 885248696. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-28 07:40:16,176][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.819')] [2023-12-28 07:40:16,723][106226] Updated weights for policy 0, policy_version 1726737 (0.0008) [2023-12-28 07:40:16,789][106226] Updated weights for policy 0, policy_version 1726747 (0.0008) [2023-12-28 07:40:16,843][106226] Updated weights for policy 0, policy_version 1726757 (0.0010) [2023-12-28 07:40:16,883][106225] Updated weights for policy 1, policy_version 1730827 (0.0008) [2023-12-28 07:40:16,944][106225] Updated weights for policy 1, policy_version 1730837 (0.0008) [2023-12-28 07:40:17,001][106225] Updated weights for policy 1, policy_version 1730847 (0.0006) [2023-12-28 07:40:17,519][106226] Updated weights for policy 0, policy_version 1726767 (0.0010) [2023-12-28 07:40:17,579][106226] Updated weights for policy 0, policy_version 1726777 (0.0010) [2023-12-28 07:40:17,639][106226] Updated weights for policy 0, policy_version 1726787 (0.0011) [2023-12-28 07:40:17,671][106225] Updated weights for policy 1, policy_version 1730857 (0.0007) [2023-12-28 07:40:17,727][106225] Updated weights for policy 1, policy_version 1730867 (0.0007) [2023-12-28 07:40:17,775][106225] Updated weights for policy 1, policy_version 1730877 (0.0005) [2023-12-28 07:40:17,820][106225] Updated weights for policy 1, policy_version 1730887 (0.0005) [2023-12-28 07:40:18,321][106226] Updated weights for policy 0, policy_version 1726797 (0.0010) [2023-12-28 07:40:18,393][106226] Updated weights for policy 0, policy_version 1726807 (0.0011) [2023-12-28 07:40:18,397][106225] Updated weights for policy 1, policy_version 1730897 (0.0010) [2023-12-28 07:40:18,452][106225] Updated weights for policy 1, policy_version 1730907 (0.0010) [2023-12-28 07:40:18,457][106226] Updated weights for policy 0, policy_version 1726817 (0.0011) [2023-12-28 07:40:18,507][106225] Updated weights for policy 1, policy_version 1730917 (0.0010) [2023-12-28 07:40:19,161][106226] Updated weights for policy 0, policy_version 1726827 (0.0011) [2023-12-28 07:40:19,210][106225] Updated weights for policy 1, policy_version 1730927 (0.0007) [2023-12-28 07:40:19,211][106226] Updated weights for policy 0, policy_version 1726837 (0.0010) [2023-12-28 07:40:19,276][106225] Updated weights for policy 1, policy_version 1730937 (0.0007) [2023-12-28 07:40:19,278][106226] Updated weights for policy 0, policy_version 1726847 (0.0011) [2023-12-28 07:40:19,342][106225] Updated weights for policy 1, policy_version 1730947 (0.0006) [2023-12-28 07:40:20,065][106226] Updated weights for policy 0, policy_version 1726857 (0.0008) [2023-12-28 07:40:20,087][106225] Updated weights for policy 1, policy_version 1730957 (0.0007) [2023-12-28 07:40:20,131][106226] Updated weights for policy 0, policy_version 1726867 (0.0008) [2023-12-28 07:40:20,148][106225] Updated weights for policy 1, policy_version 1730967 (0.0008) [2023-12-28 07:40:20,191][106226] Updated weights for policy 0, policy_version 1726877 (0.0008) [2023-12-28 07:40:20,215][106225] Updated weights for policy 1, policy_version 1730977 (0.0006) [2023-12-28 07:40:20,246][106226] Updated weights for policy 0, policy_version 1726887 (0.0008) [2023-12-28 07:40:20,977][106226] Updated weights for policy 0, policy_version 1726897 (0.0011) [2023-12-28 07:40:21,010][106225] Updated weights for policy 1, policy_version 1730987 (0.0008) [2023-12-28 07:40:21,042][106226] Updated weights for policy 0, policy_version 1726907 (0.0011) [2023-12-28 07:40:21,081][106225] Updated weights for policy 1, policy_version 1730997 (0.0007) [2023-12-28 07:40:21,111][106226] Updated weights for policy 0, policy_version 1726917 (0.0009) [2023-12-28 07:40:21,148][106225] Updated weights for policy 1, policy_version 1731007 (0.0007) [2023-12-28 07:40:21,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 885358592. Throughput: 0: 9813.6, 1: 9941.6. Samples: 885368492. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:21,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-4.858')] [2023-12-28 07:40:21,897][106226] Updated weights for policy 0, policy_version 1726927 (0.0007) [2023-12-28 07:40:21,965][106226] Updated weights for policy 0, policy_version 1726937 (0.0009) [2023-12-28 07:40:21,966][106225] Updated weights for policy 1, policy_version 1731017 (0.0007) [2023-12-28 07:40:22,025][106225] Updated weights for policy 1, policy_version 1731027 (0.0008) [2023-12-28 07:40:22,029][106226] Updated weights for policy 0, policy_version 1726947 (0.0007) [2023-12-28 07:40:22,091][106225] Updated weights for policy 1, policy_version 1731037 (0.0008) [2023-12-28 07:40:22,147][106225] Updated weights for policy 1, policy_version 1731047 (0.0008) [2023-12-28 07:40:22,702][106226] Updated weights for policy 0, policy_version 1726957 (0.0008) [2023-12-28 07:40:22,767][106226] Updated weights for policy 0, policy_version 1726967 (0.0008) [2023-12-28 07:40:22,827][106226] Updated weights for policy 0, policy_version 1726977 (0.0007) [2023-12-28 07:40:22,916][106225] Updated weights for policy 1, policy_version 1731057 (0.0009) [2023-12-28 07:40:22,980][106225] Updated weights for policy 1, policy_version 1731067 (0.0010) [2023-12-28 07:40:23,050][106225] Updated weights for policy 1, policy_version 1731077 (0.0006) [2023-12-28 07:40:23,603][106225] Updated weights for policy 1, policy_version 1731087 (0.0006) [2023-12-28 07:40:23,604][106226] Updated weights for policy 0, policy_version 1726987 (0.0009) [2023-12-28 07:40:23,660][106225] Updated weights for policy 1, policy_version 1731097 (0.0007) [2023-12-28 07:40:23,665][106226] Updated weights for policy 0, policy_version 1726997 (0.0010) [2023-12-28 07:40:23,712][106225] Updated weights for policy 1, policy_version 1731107 (0.0007) [2023-12-28 07:40:23,723][106226] Updated weights for policy 0, policy_version 1727007 (0.0009) [2023-12-28 07:40:24,395][106226] Updated weights for policy 0, policy_version 1727017 (0.0007) [2023-12-28 07:40:24,455][106226] Updated weights for policy 0, policy_version 1727027 (0.0006) [2023-12-28 07:40:24,458][106225] Updated weights for policy 1, policy_version 1731117 (0.0007) [2023-12-28 07:40:24,509][106226] Updated weights for policy 0, policy_version 1727037 (0.0005) [2023-12-28 07:40:24,518][106225] Updated weights for policy 1, policy_version 1731127 (0.0007) [2023-12-28 07:40:24,568][106225] Updated weights for policy 1, policy_version 1731137 (0.0006) [2023-12-28 07:40:24,570][106226] Updated weights for policy 0, policy_version 1727047 (0.0010) [2023-12-28 07:40:25,272][106226] Updated weights for policy 0, policy_version 1727057 (0.0010) [2023-12-28 07:40:25,304][106225] Updated weights for policy 1, policy_version 1731147 (0.0007) [2023-12-28 07:40:25,327][106226] Updated weights for policy 0, policy_version 1727067 (0.0010) [2023-12-28 07:40:25,363][106225] Updated weights for policy 1, policy_version 1731157 (0.0006) [2023-12-28 07:40:25,387][106226] Updated weights for policy 0, policy_version 1727077 (0.0010) [2023-12-28 07:40:25,417][106225] Updated weights for policy 1, policy_version 1731167 (0.0006) [2023-12-28 07:40:26,046][106225] Updated weights for policy 1, policy_version 1731177 (0.0007) [2023-12-28 07:40:26,081][106226] Updated weights for policy 0, policy_version 1727087 (0.0011) [2023-12-28 07:40:26,111][106225] Updated weights for policy 1, policy_version 1731187 (0.0005) [2023-12-28 07:40:26,142][106226] Updated weights for policy 0, policy_version 1727097 (0.0010) [2023-12-28 07:40:26,174][106225] Updated weights for policy 1, policy_version 1731197 (0.0005) [2023-12-28 07:40:26,175][105115] Fps is (10 sec: 18022.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 885448704. Throughput: 0: 9743.0, 1: 9958.5. Samples: 885425628. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:26,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.970')] [2023-12-28 07:40:26,203][106226] Updated weights for policy 0, policy_version 1727107 (0.0010) [2023-12-28 07:40:26,231][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001727112_442220544.pth... [2023-12-28 07:40:26,233][106225] Updated weights for policy 1, policy_version 1731207 (0.0005) [2023-12-28 07:40:26,236][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001725960_441925632.pth [2023-12-28 07:40:26,238][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001731208_443244544.pth... [2023-12-28 07:40:26,244][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001730024_442941440.pth [2023-12-28 07:40:26,762][106225] Updated weights for policy 1, policy_version 1731217 (0.0007) [2023-12-28 07:40:26,822][106225] Updated weights for policy 1, policy_version 1731227 (0.0006) [2023-12-28 07:40:26,880][106225] Updated weights for policy 1, policy_version 1731237 (0.0007) [2023-12-28 07:40:26,889][106226] Updated weights for policy 0, policy_version 1727117 (0.0011) [2023-12-28 07:40:26,948][106226] Updated weights for policy 0, policy_version 1727127 (0.0010) [2023-12-28 07:40:27,011][106226] Updated weights for policy 0, policy_version 1727137 (0.0011) [2023-12-28 07:40:27,566][106225] Updated weights for policy 1, policy_version 1731247 (0.0005) [2023-12-28 07:40:27,614][106225] Updated weights for policy 1, policy_version 1731257 (0.0005) [2023-12-28 07:40:27,631][106226] Updated weights for policy 0, policy_version 1727147 (0.0010) [2023-12-28 07:40:27,666][106225] Updated weights for policy 1, policy_version 1731267 (0.0005) [2023-12-28 07:40:27,677][106226] Updated weights for policy 0, policy_version 1727157 (0.0010) [2023-12-28 07:40:27,723][106226] Updated weights for policy 0, policy_version 1727167 (0.0010) [2023-12-28 07:40:28,330][106225] Updated weights for policy 1, policy_version 1731277 (0.0008) [2023-12-28 07:40:28,392][106225] Updated weights for policy 1, policy_version 1731287 (0.0010) [2023-12-28 07:40:28,454][106225] Updated weights for policy 1, policy_version 1731297 (0.0009) [2023-12-28 07:40:28,503][106226] Updated weights for policy 0, policy_version 1727177 (0.0010) [2023-12-28 07:40:28,568][106226] Updated weights for policy 0, policy_version 1727187 (0.0006) [2023-12-28 07:40:28,629][106226] Updated weights for policy 0, policy_version 1727197 (0.0005) [2023-12-28 07:40:28,698][106226] Updated weights for policy 0, policy_version 1727207 (0.0009) [2023-12-28 07:40:29,164][106225] Updated weights for policy 1, policy_version 1731307 (0.0010) [2023-12-28 07:40:29,221][106225] Updated weights for policy 1, policy_version 1731317 (0.0010) [2023-12-28 07:40:29,289][106225] Updated weights for policy 1, policy_version 1731327 (0.0010) [2023-12-28 07:40:29,294][106226] Updated weights for policy 0, policy_version 1727217 (0.0006) [2023-12-28 07:40:29,362][106226] Updated weights for policy 0, policy_version 1727227 (0.0007) [2023-12-28 07:40:29,425][106226] Updated weights for policy 0, policy_version 1727237 (0.0010) [2023-12-28 07:40:29,858][106225] Updated weights for policy 1, policy_version 1731337 (0.0009) [2023-12-28 07:40:29,922][106225] Updated weights for policy 1, policy_version 1731347 (0.0009) [2023-12-28 07:40:29,985][106225] Updated weights for policy 1, policy_version 1731357 (0.0008) [2023-12-28 07:40:30,036][106225] Updated weights for policy 1, policy_version 1731367 (0.0007) [2023-12-28 07:40:30,236][106226] Updated weights for policy 0, policy_version 1727247 (0.0008) [2023-12-28 07:40:30,305][106226] Updated weights for policy 0, policy_version 1727257 (0.0006) [2023-12-28 07:40:30,369][106226] Updated weights for policy 0, policy_version 1727267 (0.0007) [2023-12-28 07:40:30,781][106225] Updated weights for policy 1, policy_version 1731377 (0.0008) [2023-12-28 07:40:30,846][106225] Updated weights for policy 1, policy_version 1731387 (0.0008) [2023-12-28 07:40:30,909][106225] Updated weights for policy 1, policy_version 1731397 (0.0010) [2023-12-28 07:40:30,945][106226] Updated weights for policy 0, policy_version 1727277 (0.0006) [2023-12-28 07:40:31,008][106226] Updated weights for policy 0, policy_version 1727287 (0.0005) [2023-12-28 07:40:31,074][106226] Updated weights for policy 0, policy_version 1727297 (0.0006) [2023-12-28 07:40:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 885563392. Throughput: 0: 9775.1, 1: 10049.4. Samples: 885547252. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:31,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.813')] [2023-12-28 07:40:31,683][106225] Updated weights for policy 1, policy_version 1731407 (0.0011) [2023-12-28 07:40:31,724][106226] Updated weights for policy 0, policy_version 1727307 (0.0007) [2023-12-28 07:40:31,747][106225] Updated weights for policy 1, policy_version 1731417 (0.0010) [2023-12-28 07:40:31,784][106226] Updated weights for policy 0, policy_version 1727317 (0.0007) [2023-12-28 07:40:31,805][106225] Updated weights for policy 1, policy_version 1731427 (0.0010) [2023-12-28 07:40:31,843][106226] Updated weights for policy 0, policy_version 1727327 (0.0008) [2023-12-28 07:40:32,467][106225] Updated weights for policy 1, policy_version 1731437 (0.0009) [2023-12-28 07:40:32,512][106225] Updated weights for policy 1, policy_version 1731447 (0.0009) [2023-12-28 07:40:32,571][106225] Updated weights for policy 1, policy_version 1731457 (0.0008) [2023-12-28 07:40:32,617][106226] Updated weights for policy 0, policy_version 1727337 (0.0008) [2023-12-28 07:40:32,673][106226] Updated weights for policy 0, policy_version 1727347 (0.0008) [2023-12-28 07:40:32,730][106226] Updated weights for policy 0, policy_version 1727357 (0.0008) [2023-12-28 07:40:32,787][106226] Updated weights for policy 0, policy_version 1727367 (0.0008) [2023-12-28 07:40:33,334][106225] Updated weights for policy 1, policy_version 1731467 (0.0010) [2023-12-28 07:40:33,387][106225] Updated weights for policy 1, policy_version 1731477 (0.0010) [2023-12-28 07:40:33,406][106226] Updated weights for policy 0, policy_version 1727377 (0.0007) [2023-12-28 07:40:33,441][106225] Updated weights for policy 1, policy_version 1731487 (0.0010) [2023-12-28 07:40:33,452][106226] Updated weights for policy 0, policy_version 1727387 (0.0006) [2023-12-28 07:40:33,497][106226] Updated weights for policy 0, policy_version 1727397 (0.0007) [2023-12-28 07:40:34,083][106225] Updated weights for policy 1, policy_version 1731497 (0.0010) [2023-12-28 07:40:34,087][106226] Updated weights for policy 0, policy_version 1727407 (0.0008) [2023-12-28 07:40:34,145][106226] Updated weights for policy 0, policy_version 1727417 (0.0006) [2023-12-28 07:40:34,148][106225] Updated weights for policy 1, policy_version 1731507 (0.0010) [2023-12-28 07:40:34,207][106225] Updated weights for policy 1, policy_version 1731517 (0.0009) [2023-12-28 07:40:34,213][106226] Updated weights for policy 0, policy_version 1727427 (0.0009) [2023-12-28 07:40:34,261][106225] Updated weights for policy 1, policy_version 1731527 (0.0009) [2023-12-28 07:40:34,965][106226] Updated weights for policy 0, policy_version 1727437 (0.0008) [2023-12-28 07:40:35,000][106225] Updated weights for policy 1, policy_version 1731537 (0.0008) [2023-12-28 07:40:35,034][106226] Updated weights for policy 0, policy_version 1727447 (0.0006) [2023-12-28 07:40:35,060][106225] Updated weights for policy 1, policy_version 1731547 (0.0008) [2023-12-28 07:40:35,095][106226] Updated weights for policy 0, policy_version 1727457 (0.0008) [2023-12-28 07:40:35,113][106225] Updated weights for policy 1, policy_version 1731557 (0.0008) [2023-12-28 07:40:35,811][106226] Updated weights for policy 0, policy_version 1727467 (0.0007) [2023-12-28 07:40:35,821][106225] Updated weights for policy 1, policy_version 1731567 (0.0010) [2023-12-28 07:40:35,869][106226] Updated weights for policy 0, policy_version 1727477 (0.0007) [2023-12-28 07:40:35,883][106225] Updated weights for policy 1, policy_version 1731577 (0.0006) [2023-12-28 07:40:35,921][106226] Updated weights for policy 0, policy_version 1727487 (0.0008) [2023-12-28 07:40:35,947][106225] Updated weights for policy 1, policy_version 1731587 (0.0007) [2023-12-28 07:40:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 885661696. Throughput: 0: 9815.8, 1: 10010.6. Samples: 885667168. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:36,175][105115] Avg episode reward: [(0, '-4.190'), (1, '-4.422')] [2023-12-28 07:40:36,607][106225] Updated weights for policy 1, policy_version 1731597 (0.0008) [2023-12-28 07:40:36,673][106225] Updated weights for policy 1, policy_version 1731607 (0.0006) [2023-12-28 07:40:36,728][106226] Updated weights for policy 0, policy_version 1727497 (0.0009) [2023-12-28 07:40:36,737][106225] Updated weights for policy 1, policy_version 1731617 (0.0009) [2023-12-28 07:40:36,783][106226] Updated weights for policy 0, policy_version 1727507 (0.0010) [2023-12-28 07:40:36,833][106226] Updated weights for policy 0, policy_version 1727517 (0.0008) [2023-12-28 07:40:36,889][106226] Updated weights for policy 0, policy_version 1727527 (0.0008) [2023-12-28 07:40:37,319][106225] Updated weights for policy 1, policy_version 1731627 (0.0010) [2023-12-28 07:40:37,375][106225] Updated weights for policy 1, policy_version 1731637 (0.0010) [2023-12-28 07:40:37,427][106225] Updated weights for policy 1, policy_version 1731647 (0.0010) [2023-12-28 07:40:37,688][106226] Updated weights for policy 0, policy_version 1727537 (0.0008) [2023-12-28 07:40:37,738][106226] Updated weights for policy 0, policy_version 1727547 (0.0008) [2023-12-28 07:40:37,789][106226] Updated weights for policy 0, policy_version 1727557 (0.0008) [2023-12-28 07:40:38,150][106225] Updated weights for policy 1, policy_version 1731657 (0.0010) [2023-12-28 07:40:38,208][106225] Updated weights for policy 1, policy_version 1731667 (0.0010) [2023-12-28 07:40:38,263][106225] Updated weights for policy 1, policy_version 1731677 (0.0009) [2023-12-28 07:40:38,324][106225] Updated weights for policy 1, policy_version 1731687 (0.0009) [2023-12-28 07:40:38,532][106226] Updated weights for policy 0, policy_version 1727567 (0.0007) [2023-12-28 07:40:38,594][106226] Updated weights for policy 0, policy_version 1727577 (0.0008) [2023-12-28 07:40:38,660][106226] Updated weights for policy 0, policy_version 1727587 (0.0008) [2023-12-28 07:40:39,028][106225] Updated weights for policy 1, policy_version 1731697 (0.0008) [2023-12-28 07:40:39,083][106225] Updated weights for policy 1, policy_version 1731707 (0.0008) [2023-12-28 07:40:39,144][106225] Updated weights for policy 1, policy_version 1731717 (0.0007) [2023-12-28 07:40:39,402][106226] Updated weights for policy 0, policy_version 1727597 (0.0009) [2023-12-28 07:40:39,471][106226] Updated weights for policy 0, policy_version 1727607 (0.0009) [2023-12-28 07:40:39,533][106226] Updated weights for policy 0, policy_version 1727617 (0.0008) [2023-12-28 07:40:39,888][106225] Updated weights for policy 1, policy_version 1731727 (0.0007) [2023-12-28 07:40:39,956][106225] Updated weights for policy 1, policy_version 1731737 (0.0009) [2023-12-28 07:40:40,013][106225] Updated weights for policy 1, policy_version 1731747 (0.0011) [2023-12-28 07:40:40,298][106226] Updated weights for policy 0, policy_version 1727627 (0.0009) [2023-12-28 07:40:40,351][106226] Updated weights for policy 0, policy_version 1727637 (0.0009) [2023-12-28 07:40:40,408][106226] Updated weights for policy 0, policy_version 1727647 (0.0010) [2023-12-28 07:40:40,650][106225] Updated weights for policy 1, policy_version 1731757 (0.0011) [2023-12-28 07:40:40,710][106225] Updated weights for policy 1, policy_version 1731767 (0.0010) [2023-12-28 07:40:40,761][106225] Updated weights for policy 1, policy_version 1731777 (0.0011) [2023-12-28 07:40:41,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 885751808. Throughput: 0: 9790.5, 1: 10076.4. Samples: 885725456. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:41,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.827')] [2023-12-28 07:40:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001731784_443392000.pth... [2023-12-28 07:40:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001730632_443097088.pth [2023-12-28 07:40:41,193][106226] Updated weights for policy 0, policy_version 1727657 (0.0009) [2023-12-28 07:40:41,257][106226] Updated weights for policy 0, policy_version 1727667 (0.0007) [2023-12-28 07:40:41,318][106226] Updated weights for policy 0, policy_version 1727677 (0.0009) [2023-12-28 07:40:41,385][106226] Updated weights for policy 0, policy_version 1727687 (0.0012) [2023-12-28 07:40:41,389][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001727688_442368000.pth... [2023-12-28 07:40:41,394][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001726536_442073088.pth [2023-12-28 07:40:41,502][106225] Updated weights for policy 1, policy_version 1731787 (0.0009) [2023-12-28 07:40:41,571][106225] Updated weights for policy 1, policy_version 1731797 (0.0007) [2023-12-28 07:40:41,639][106225] Updated weights for policy 1, policy_version 1731807 (0.0007) [2023-12-28 07:40:42,119][106226] Updated weights for policy 0, policy_version 1727697 (0.0008) [2023-12-28 07:40:42,182][106226] Updated weights for policy 0, policy_version 1727707 (0.0008) [2023-12-28 07:40:42,245][106226] Updated weights for policy 0, policy_version 1727717 (0.0007) [2023-12-28 07:40:42,316][106225] Updated weights for policy 1, policy_version 1731817 (0.0009) [2023-12-28 07:40:42,381][106225] Updated weights for policy 1, policy_version 1731827 (0.0007) [2023-12-28 07:40:42,440][106225] Updated weights for policy 1, policy_version 1731837 (0.0006) [2023-12-28 07:40:42,492][106225] Updated weights for policy 1, policy_version 1731847 (0.0005) [2023-12-28 07:40:43,046][106226] Updated weights for policy 0, policy_version 1727727 (0.0008) [2023-12-28 07:40:43,111][106226] Updated weights for policy 0, policy_version 1727737 (0.0008) [2023-12-28 07:40:43,122][106225] Updated weights for policy 1, policy_version 1731857 (0.0009) [2023-12-28 07:40:43,175][106226] Updated weights for policy 0, policy_version 1727747 (0.0005) [2023-12-28 07:40:43,181][106225] Updated weights for policy 1, policy_version 1731867 (0.0007) [2023-12-28 07:40:43,241][106225] Updated weights for policy 1, policy_version 1731877 (0.0005) [2023-12-28 07:40:43,742][106226] Updated weights for policy 0, policy_version 1727757 (0.0007) [2023-12-28 07:40:43,795][106226] Updated weights for policy 0, policy_version 1727767 (0.0009) [2023-12-28 07:40:43,866][106226] Updated weights for policy 0, policy_version 1727777 (0.0007) [2023-12-28 07:40:43,887][106225] Updated weights for policy 1, policy_version 1731887 (0.0007) [2023-12-28 07:40:43,953][106225] Updated weights for policy 1, policy_version 1731897 (0.0008) [2023-12-28 07:40:44,020][106225] Updated weights for policy 1, policy_version 1731907 (0.0007) [2023-12-28 07:40:44,634][106226] Updated weights for policy 0, policy_version 1727787 (0.0008) [2023-12-28 07:40:44,693][106225] Updated weights for policy 1, policy_version 1731917 (0.0007) [2023-12-28 07:40:44,694][106226] Updated weights for policy 0, policy_version 1727797 (0.0009) [2023-12-28 07:40:44,753][106226] Updated weights for policy 0, policy_version 1727807 (0.0009) [2023-12-28 07:40:44,756][106225] Updated weights for policy 1, policy_version 1731927 (0.0006) [2023-12-28 07:40:44,825][106225] Updated weights for policy 1, policy_version 1731937 (0.0007) [2023-12-28 07:40:45,472][106226] Updated weights for policy 0, policy_version 1727817 (0.0007) [2023-12-28 07:40:45,518][106226] Updated weights for policy 0, policy_version 1727827 (0.0007) [2023-12-28 07:40:45,550][106225] Updated weights for policy 1, policy_version 1731947 (0.0008) [2023-12-28 07:40:45,569][106226] Updated weights for policy 0, policy_version 1727837 (0.0007) [2023-12-28 07:40:45,604][106225] Updated weights for policy 1, policy_version 1731957 (0.0010) [2023-12-28 07:40:45,622][106226] Updated weights for policy 0, policy_version 1727847 (0.0007) [2023-12-28 07:40:45,654][106225] Updated weights for policy 1, policy_version 1731967 (0.0010) [2023-12-28 07:40:46,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 885850112. Throughput: 0: 9714.0, 1: 10067.4. Samples: 885841620. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:46,176][105115] Avg episode reward: [(0, '-4.464'), (1, '-4.944')] [2023-12-28 07:40:46,281][106225] Updated weights for policy 1, policy_version 1731977 (0.0010) [2023-12-28 07:40:46,348][106225] Updated weights for policy 1, policy_version 1731987 (0.0006) [2023-12-28 07:40:46,357][106226] Updated weights for policy 0, policy_version 1727857 (0.0005) [2023-12-28 07:40:46,414][106226] Updated weights for policy 0, policy_version 1727867 (0.0005) [2023-12-28 07:40:46,414][106225] Updated weights for policy 1, policy_version 1731997 (0.0006) [2023-12-28 07:40:46,470][106226] Updated weights for policy 0, policy_version 1727877 (0.0005) [2023-12-28 07:40:46,485][106225] Updated weights for policy 1, policy_version 1732007 (0.0006) [2023-12-28 07:40:47,063][106226] Updated weights for policy 0, policy_version 1727887 (0.0006) [2023-12-28 07:40:47,088][106225] Updated weights for policy 1, policy_version 1732017 (0.0008) [2023-12-28 07:40:47,125][106226] Updated weights for policy 0, policy_version 1727897 (0.0006) [2023-12-28 07:40:47,151][106225] Updated weights for policy 1, policy_version 1732027 (0.0006) [2023-12-28 07:40:47,187][106226] Updated weights for policy 0, policy_version 1727907 (0.0006) [2023-12-28 07:40:47,208][106225] Updated weights for policy 1, policy_version 1732037 (0.0005) [2023-12-28 07:40:47,752][106225] Updated weights for policy 1, policy_version 1732047 (0.0005) [2023-12-28 07:40:47,770][106226] Updated weights for policy 0, policy_version 1727917 (0.0006) [2023-12-28 07:40:47,804][106225] Updated weights for policy 1, policy_version 1732057 (0.0007) [2023-12-28 07:40:47,827][106226] Updated weights for policy 0, policy_version 1727927 (0.0005) [2023-12-28 07:40:47,850][106225] Updated weights for policy 1, policy_version 1732067 (0.0008) [2023-12-28 07:40:47,884][106226] Updated weights for policy 0, policy_version 1727937 (0.0005) [2023-12-28 07:40:48,478][106226] Updated weights for policy 0, policy_version 1727947 (0.0008) [2023-12-28 07:40:48,533][106226] Updated weights for policy 0, policy_version 1727957 (0.0007) [2023-12-28 07:40:48,597][106226] Updated weights for policy 0, policy_version 1727967 (0.0006) [2023-12-28 07:40:48,615][106225] Updated weights for policy 1, policy_version 1732077 (0.0008) [2023-12-28 07:40:48,677][106225] Updated weights for policy 1, policy_version 1732087 (0.0006) [2023-12-28 07:40:48,739][106225] Updated weights for policy 1, policy_version 1732097 (0.0007) [2023-12-28 07:40:49,340][106225] Updated weights for policy 1, policy_version 1732107 (0.0009) [2023-12-28 07:40:49,367][106226] Updated weights for policy 0, policy_version 1727977 (0.0007) [2023-12-28 07:40:49,409][106225] Updated weights for policy 1, policy_version 1732117 (0.0008) [2023-12-28 07:40:49,425][106226] Updated weights for policy 0, policy_version 1727987 (0.0005) [2023-12-28 07:40:49,475][106225] Updated weights for policy 1, policy_version 1732127 (0.0007) [2023-12-28 07:40:49,484][106226] Updated weights for policy 0, policy_version 1727997 (0.0007) [2023-12-28 07:40:49,539][106226] Updated weights for policy 0, policy_version 1728007 (0.0007) [2023-12-28 07:40:50,165][106225] Updated weights for policy 1, policy_version 1732137 (0.0006) [2023-12-28 07:40:50,224][106225] Updated weights for policy 1, policy_version 1732147 (0.0008) [2023-12-28 07:40:50,286][106225] Updated weights for policy 1, policy_version 1732157 (0.0008) [2023-12-28 07:40:50,336][106226] Updated weights for policy 0, policy_version 1728017 (0.0006) [2023-12-28 07:40:50,348][106225] Updated weights for policy 1, policy_version 1732167 (0.0008) [2023-12-28 07:40:50,401][106226] Updated weights for policy 0, policy_version 1728027 (0.0008) [2023-12-28 07:40:50,483][106226] Updated weights for policy 0, policy_version 1728037 (0.0008) [2023-12-28 07:40:51,061][106225] Updated weights for policy 1, policy_version 1732177 (0.0008) [2023-12-28 07:40:51,124][106225] Updated weights for policy 1, policy_version 1732187 (0.0007) [2023-12-28 07:40:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 885948416. Throughput: 0: 9730.8, 1: 10075.5. Samples: 885963672. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:51,175][105115] Avg episode reward: [(0, '-4.210'), (1, '-4.809')] [2023-12-28 07:40:51,192][106225] Updated weights for policy 1, policy_version 1732197 (0.0007) [2023-12-28 07:40:51,214][106226] Updated weights for policy 0, policy_version 1728047 (0.0009) [2023-12-28 07:40:51,285][106226] Updated weights for policy 0, policy_version 1728057 (0.0009) [2023-12-28 07:40:51,350][106226] Updated weights for policy 0, policy_version 1728067 (0.0009) [2023-12-28 07:40:51,931][106225] Updated weights for policy 1, policy_version 1732207 (0.0007) [2023-12-28 07:40:51,992][106225] Updated weights for policy 1, policy_version 1732217 (0.0007) [2023-12-28 07:40:52,052][106225] Updated weights for policy 1, policy_version 1732227 (0.0007) [2023-12-28 07:40:52,131][106226] Updated weights for policy 0, policy_version 1728077 (0.0009) [2023-12-28 07:40:52,191][106226] Updated weights for policy 0, policy_version 1728087 (0.0011) [2023-12-28 07:40:52,257][106226] Updated weights for policy 0, policy_version 1728097 (0.0007) [2023-12-28 07:40:52,763][106225] Updated weights for policy 1, policy_version 1732237 (0.0007) [2023-12-28 07:40:52,823][106225] Updated weights for policy 1, policy_version 1732247 (0.0008) [2023-12-28 07:40:52,884][106225] Updated weights for policy 1, policy_version 1732257 (0.0009) [2023-12-28 07:40:52,942][106226] Updated weights for policy 0, policy_version 1728107 (0.0006) [2023-12-28 07:40:53,000][106226] Updated weights for policy 0, policy_version 1728117 (0.0007) [2023-12-28 07:40:53,053][106226] Updated weights for policy 0, policy_version 1728127 (0.0009) [2023-12-28 07:40:53,568][106225] Updated weights for policy 1, policy_version 1732267 (0.0008) [2023-12-28 07:40:53,624][106225] Updated weights for policy 1, policy_version 1732277 (0.0006) [2023-12-28 07:40:53,679][106225] Updated weights for policy 1, policy_version 1732287 (0.0006) [2023-12-28 07:40:53,792][106226] Updated weights for policy 0, policy_version 1728137 (0.0008) [2023-12-28 07:40:53,842][106226] Updated weights for policy 0, policy_version 1728147 (0.0009) [2023-12-28 07:40:53,902][106226] Updated weights for policy 0, policy_version 1728157 (0.0005) [2023-12-28 07:40:53,950][106226] Updated weights for policy 0, policy_version 1728167 (0.0006) [2023-12-28 07:40:54,278][106225] Updated weights for policy 1, policy_version 1732297 (0.0005) [2023-12-28 07:40:54,332][106225] Updated weights for policy 1, policy_version 1732307 (0.0005) [2023-12-28 07:40:54,385][106225] Updated weights for policy 1, policy_version 1732317 (0.0005) [2023-12-28 07:40:54,443][106225] Updated weights for policy 1, policy_version 1732327 (0.0005) [2023-12-28 07:40:54,720][106226] Updated weights for policy 0, policy_version 1728177 (0.0009) [2023-12-28 07:40:54,776][106226] Updated weights for policy 0, policy_version 1728187 (0.0009) [2023-12-28 07:40:54,831][106226] Updated weights for policy 0, policy_version 1728197 (0.0009) [2023-12-28 07:40:55,032][106225] Updated weights for policy 1, policy_version 1732337 (0.0007) [2023-12-28 07:40:55,100][106225] Updated weights for policy 1, policy_version 1732347 (0.0007) [2023-12-28 07:40:55,163][106225] Updated weights for policy 1, policy_version 1732357 (0.0007) [2023-12-28 07:40:55,505][106226] Updated weights for policy 0, policy_version 1728207 (0.0007) [2023-12-28 07:40:55,571][106226] Updated weights for policy 0, policy_version 1728217 (0.0007) [2023-12-28 07:40:55,630][106226] Updated weights for policy 0, policy_version 1728227 (0.0005) [2023-12-28 07:40:55,853][106225] Updated weights for policy 1, policy_version 1732367 (0.0010) [2023-12-28 07:40:55,897][106225] Updated weights for policy 1, policy_version 1732377 (0.0010) [2023-12-28 07:40:55,951][106225] Updated weights for policy 1, policy_version 1732387 (0.0006) [2023-12-28 07:40:56,129][106226] Updated weights for policy 0, policy_version 1728237 (0.0007) [2023-12-28 07:40:56,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 886054912. Throughput: 0: 9704.3, 1: 10065.8. Samples: 886021388. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:40:56,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.598')] [2023-12-28 07:40:56,179][106226] Updated weights for policy 0, policy_version 1728247 (0.0008) [2023-12-28 07:40:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001732392_443547648.pth... [2023-12-28 07:40:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001731208_443244544.pth [2023-12-28 07:40:56,227][106226] Updated weights for policy 0, policy_version 1728257 (0.0008) [2023-12-28 07:40:56,255][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001728264_442515456.pth... [2023-12-28 07:40:56,258][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001727112_442220544.pth [2023-12-28 07:40:56,667][106225] Updated weights for policy 1, policy_version 1732397 (0.0008) [2023-12-28 07:40:56,728][106225] Updated weights for policy 1, policy_version 1732407 (0.0006) [2023-12-28 07:40:56,783][106225] Updated weights for policy 1, policy_version 1732417 (0.0008) [2023-12-28 07:40:56,976][106226] Updated weights for policy 0, policy_version 1728267 (0.0008) [2023-12-28 07:40:57,040][106226] Updated weights for policy 0, policy_version 1728277 (0.0006) [2023-12-28 07:40:57,095][106226] Updated weights for policy 0, policy_version 1728288 (0.0009) [2023-12-28 07:40:57,406][106225] Updated weights for policy 1, policy_version 1732427 (0.0008) [2023-12-28 07:40:57,470][106225] Updated weights for policy 1, policy_version 1732437 (0.0008) [2023-12-28 07:40:57,519][106225] Updated weights for policy 1, policy_version 1732447 (0.0007) [2023-12-28 07:40:57,825][106226] Updated weights for policy 0, policy_version 1728298 (0.0009) [2023-12-28 07:40:57,878][106226] Updated weights for policy 0, policy_version 1728308 (0.0010) [2023-12-28 07:40:57,927][106226] Updated weights for policy 0, policy_version 1728318 (0.0010) [2023-12-28 07:40:57,975][106226] Updated weights for policy 0, policy_version 1728328 (0.0010) [2023-12-28 07:40:58,229][106225] Updated weights for policy 1, policy_version 1732457 (0.0007) [2023-12-28 07:40:58,289][106225] Updated weights for policy 1, policy_version 1732467 (0.0007) [2023-12-28 07:40:58,358][106225] Updated weights for policy 1, policy_version 1732477 (0.0007) [2023-12-28 07:40:58,421][106225] Updated weights for policy 1, policy_version 1732487 (0.0008) [2023-12-28 07:40:58,756][106226] Updated weights for policy 0, policy_version 1728338 (0.0008) [2023-12-28 07:40:58,824][106226] Updated weights for policy 0, policy_version 1728348 (0.0007) [2023-12-28 07:40:58,896][106226] Updated weights for policy 0, policy_version 1728358 (0.0008) [2023-12-28 07:40:59,195][106225] Updated weights for policy 1, policy_version 1732497 (0.0008) [2023-12-28 07:40:59,266][106225] Updated weights for policy 1, policy_version 1732507 (0.0008) [2023-12-28 07:40:59,338][106225] Updated weights for policy 1, policy_version 1732517 (0.0007) [2023-12-28 07:40:59,730][106226] Updated weights for policy 0, policy_version 1728368 (0.0008) [2023-12-28 07:40:59,791][106226] Updated weights for policy 0, policy_version 1728378 (0.0009) [2023-12-28 07:40:59,854][106226] Updated weights for policy 0, policy_version 1728388 (0.0008) [2023-12-28 07:41:00,089][106225] Updated weights for policy 1, policy_version 1732527 (0.0007) [2023-12-28 07:41:00,143][106225] Updated weights for policy 1, policy_version 1732537 (0.0009) [2023-12-28 07:41:00,199][106225] Updated weights for policy 1, policy_version 1732547 (0.0008) [2023-12-28 07:41:00,563][106226] Updated weights for policy 0, policy_version 1728398 (0.0010) [2023-12-28 07:41:00,620][106226] Updated weights for policy 0, policy_version 1728408 (0.0010) [2023-12-28 07:41:00,673][106226] Updated weights for policy 0, policy_version 1728418 (0.0010) [2023-12-28 07:41:00,874][106225] Updated weights for policy 1, policy_version 1732557 (0.0006) [2023-12-28 07:41:00,922][106225] Updated weights for policy 1, policy_version 1732567 (0.0009) [2023-12-28 07:41:00,971][106225] Updated weights for policy 1, policy_version 1732577 (0.0010) [2023-12-28 07:41:01,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 886153216. Throughput: 0: 9740.4, 1: 10080.6. Samples: 886140636. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:01,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.833')] [2023-12-28 07:41:01,377][106226] Updated weights for policy 0, policy_version 1728428 (0.0011) [2023-12-28 07:41:01,445][106226] Updated weights for policy 0, policy_version 1728438 (0.0008) [2023-12-28 07:41:01,506][106226] Updated weights for policy 0, policy_version 1728448 (0.0010) [2023-12-28 07:41:01,638][106225] Updated weights for policy 1, policy_version 1732587 (0.0005) [2023-12-28 07:41:01,710][106225] Updated weights for policy 1, policy_version 1732597 (0.0008) [2023-12-28 07:41:01,774][106225] Updated weights for policy 1, policy_version 1732607 (0.0009) [2023-12-28 07:41:02,227][106226] Updated weights for policy 0, policy_version 1728458 (0.0009) [2023-12-28 07:41:02,294][106226] Updated weights for policy 0, policy_version 1728468 (0.0011) [2023-12-28 07:41:02,357][106226] Updated weights for policy 0, policy_version 1728478 (0.0011) [2023-12-28 07:41:02,420][106226] Updated weights for policy 0, policy_version 1728488 (0.0011) [2023-12-28 07:41:02,497][106225] Updated weights for policy 1, policy_version 1732617 (0.0008) [2023-12-28 07:41:02,551][106225] Updated weights for policy 1, policy_version 1732627 (0.0008) [2023-12-28 07:41:02,601][106225] Updated weights for policy 1, policy_version 1732637 (0.0007) [2023-12-28 07:41:02,647][106225] Updated weights for policy 1, policy_version 1732647 (0.0008) [2023-12-28 07:41:03,117][106226] Updated weights for policy 0, policy_version 1728498 (0.0005) [2023-12-28 07:41:03,165][106226] Updated weights for policy 0, policy_version 1728508 (0.0006) [2023-12-28 07:41:03,214][106226] Updated weights for policy 0, policy_version 1728518 (0.0006) [2023-12-28 07:41:03,412][106225] Updated weights for policy 1, policy_version 1732657 (0.0005) [2023-12-28 07:41:03,460][106225] Updated weights for policy 1, policy_version 1732667 (0.0008) [2023-12-28 07:41:03,506][106225] Updated weights for policy 1, policy_version 1732677 (0.0010) [2023-12-28 07:41:03,870][106226] Updated weights for policy 0, policy_version 1728528 (0.0009) [2023-12-28 07:41:03,930][106226] Updated weights for policy 0, policy_version 1728538 (0.0011) [2023-12-28 07:41:03,988][106226] Updated weights for policy 0, policy_version 1728548 (0.0007) [2023-12-28 07:41:04,239][106225] Updated weights for policy 1, policy_version 1732687 (0.0011) [2023-12-28 07:41:04,308][106225] Updated weights for policy 1, policy_version 1732697 (0.0011) [2023-12-28 07:41:04,373][106225] Updated weights for policy 1, policy_version 1732707 (0.0008) [2023-12-28 07:41:04,726][106226] Updated weights for policy 0, policy_version 1728558 (0.0007) [2023-12-28 07:41:04,782][106226] Updated weights for policy 0, policy_version 1728568 (0.0011) [2023-12-28 07:41:04,830][106226] Updated weights for policy 0, policy_version 1728578 (0.0010) [2023-12-28 07:41:05,035][106225] Updated weights for policy 1, policy_version 1732717 (0.0008) [2023-12-28 07:41:05,096][106225] Updated weights for policy 1, policy_version 1732727 (0.0007) [2023-12-28 07:41:05,155][106225] Updated weights for policy 1, policy_version 1732737 (0.0008) [2023-12-28 07:41:05,473][106226] Updated weights for policy 0, policy_version 1728588 (0.0007) [2023-12-28 07:41:05,534][106226] Updated weights for policy 0, policy_version 1728598 (0.0006) [2023-12-28 07:41:05,592][106226] Updated weights for policy 0, policy_version 1728608 (0.0006) [2023-12-28 07:41:05,862][106225] Updated weights for policy 1, policy_version 1732747 (0.0009) [2023-12-28 07:41:05,912][106225] Updated weights for policy 1, policy_version 1732757 (0.0006) [2023-12-28 07:41:05,974][106225] Updated weights for policy 1, policy_version 1732767 (0.0006) [2023-12-28 07:41:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 886251520. Throughput: 0: 9758.3, 1: 10049.1. Samples: 886259824. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:06,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.900')] [2023-12-28 07:41:06,293][106226] Updated weights for policy 0, policy_version 1728618 (0.0006) [2023-12-28 07:41:06,354][106226] Updated weights for policy 0, policy_version 1728628 (0.0008) [2023-12-28 07:41:06,419][106226] Updated weights for policy 0, policy_version 1728638 (0.0007) [2023-12-28 07:41:06,486][106226] Updated weights for policy 0, policy_version 1728648 (0.0008) [2023-12-28 07:41:06,678][106225] Updated weights for policy 1, policy_version 1732777 (0.0007) [2023-12-28 07:41:06,739][106225] Updated weights for policy 1, policy_version 1732787 (0.0010) [2023-12-28 07:41:06,802][106225] Updated weights for policy 1, policy_version 1732797 (0.0010) [2023-12-28 07:41:06,873][106225] Updated weights for policy 1, policy_version 1732807 (0.0006) [2023-12-28 07:41:07,260][106226] Updated weights for policy 0, policy_version 1728658 (0.0010) [2023-12-28 07:41:07,318][106226] Updated weights for policy 0, policy_version 1728668 (0.0008) [2023-12-28 07:41:07,384][106226] Updated weights for policy 0, policy_version 1728678 (0.0008) [2023-12-28 07:41:07,438][106225] Updated weights for policy 1, policy_version 1732817 (0.0009) [2023-12-28 07:41:07,492][106225] Updated weights for policy 1, policy_version 1732827 (0.0008) [2023-12-28 07:41:07,542][106225] Updated weights for policy 1, policy_version 1732837 (0.0006) [2023-12-28 07:41:08,135][106225] Updated weights for policy 1, policy_version 1732847 (0.0009) [2023-12-28 07:41:08,176][106226] Updated weights for policy 0, policy_version 1728688 (0.0007) [2023-12-28 07:41:08,192][106225] Updated weights for policy 1, policy_version 1732857 (0.0010) [2023-12-28 07:41:08,224][106226] Updated weights for policy 0, policy_version 1728698 (0.0005) [2023-12-28 07:41:08,242][106225] Updated weights for policy 1, policy_version 1732867 (0.0010) [2023-12-28 07:41:08,271][106226] Updated weights for policy 0, policy_version 1728708 (0.0005) [2023-12-28 07:41:08,919][106225] Updated weights for policy 1, policy_version 1732877 (0.0011) [2023-12-28 07:41:08,985][106225] Updated weights for policy 1, policy_version 1732887 (0.0005) [2023-12-28 07:41:09,037][106225] Updated weights for policy 1, policy_version 1732897 (0.0009) [2023-12-28 07:41:09,054][106226] Updated weights for policy 0, policy_version 1728718 (0.0007) [2023-12-28 07:41:09,121][106226] Updated weights for policy 0, policy_version 1728728 (0.0007) [2023-12-28 07:41:09,181][106226] Updated weights for policy 0, policy_version 1728738 (0.0008) [2023-12-28 07:41:09,783][106225] Updated weights for policy 1, policy_version 1732907 (0.0009) [2023-12-28 07:41:09,847][106225] Updated weights for policy 1, policy_version 1732917 (0.0009) [2023-12-28 07:41:09,916][106225] Updated weights for policy 1, policy_version 1732927 (0.0009) [2023-12-28 07:41:09,933][106226] Updated weights for policy 0, policy_version 1728748 (0.0008) [2023-12-28 07:41:09,991][106226] Updated weights for policy 0, policy_version 1728758 (0.0009) [2023-12-28 07:41:10,059][106226] Updated weights for policy 0, policy_version 1728768 (0.0008) [2023-12-28 07:41:10,645][106225] Updated weights for policy 1, policy_version 1732937 (0.0007) [2023-12-28 07:41:10,702][106225] Updated weights for policy 1, policy_version 1732947 (0.0010) [2023-12-28 07:41:10,761][106225] Updated weights for policy 1, policy_version 1732957 (0.0010) [2023-12-28 07:41:10,800][106226] Updated weights for policy 0, policy_version 1728778 (0.0007) [2023-12-28 07:41:10,825][106225] Updated weights for policy 1, policy_version 1732967 (0.0010) [2023-12-28 07:41:10,857][106226] Updated weights for policy 0, policy_version 1728788 (0.0005) [2023-12-28 07:41:10,921][106226] Updated weights for policy 0, policy_version 1728798 (0.0006) [2023-12-28 07:41:10,984][106226] Updated weights for policy 0, policy_version 1728808 (0.0005) [2023-12-28 07:41:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 886349824. Throughput: 0: 9738.0, 1: 10125.3. Samples: 886319480. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:11,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.821')] [2023-12-28 07:41:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001732968_443695104.pth... [2023-12-28 07:41:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001728808_442654720.pth... [2023-12-28 07:41:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001731784_443392000.pth [2023-12-28 07:41:11,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001727688_442368000.pth [2023-12-28 07:41:11,536][106225] Updated weights for policy 1, policy_version 1732977 (0.0008) [2023-12-28 07:41:11,585][106225] Updated weights for policy 1, policy_version 1732987 (0.0008) [2023-12-28 07:41:11,661][106225] Updated weights for policy 1, policy_version 1732997 (0.0008) [2023-12-28 07:41:11,697][106226] Updated weights for policy 0, policy_version 1728818 (0.0008) [2023-12-28 07:41:11,765][106226] Updated weights for policy 0, policy_version 1728828 (0.0008) [2023-12-28 07:41:11,827][106226] Updated weights for policy 0, policy_version 1728838 (0.0007) [2023-12-28 07:41:12,473][106225] Updated weights for policy 1, policy_version 1733007 (0.0008) [2023-12-28 07:41:12,537][106225] Updated weights for policy 1, policy_version 1733017 (0.0008) [2023-12-28 07:41:12,568][106226] Updated weights for policy 0, policy_version 1728848 (0.0008) [2023-12-28 07:41:12,597][106225] Updated weights for policy 1, policy_version 1733027 (0.0008) [2023-12-28 07:41:12,615][106226] Updated weights for policy 0, policy_version 1728858 (0.0007) [2023-12-28 07:41:12,678][106226] Updated weights for policy 0, policy_version 1728868 (0.0008) [2023-12-28 07:41:13,246][106225] Updated weights for policy 1, policy_version 1733037 (0.0009) [2023-12-28 07:41:13,298][106225] Updated weights for policy 1, policy_version 1733047 (0.0009) [2023-12-28 07:41:13,323][106226] Updated weights for policy 0, policy_version 1728878 (0.0010) [2023-12-28 07:41:13,341][106225] Updated weights for policy 1, policy_version 1733057 (0.0008) [2023-12-28 07:41:13,389][106226] Updated weights for policy 0, policy_version 1728888 (0.0010) [2023-12-28 07:41:13,448][106226] Updated weights for policy 0, policy_version 1728898 (0.0010) [2023-12-28 07:41:13,985][106225] Updated weights for policy 1, policy_version 1733067 (0.0006) [2023-12-28 07:41:14,033][106225] Updated weights for policy 1, policy_version 1733077 (0.0005) [2023-12-28 07:41:14,084][106225] Updated weights for policy 1, policy_version 1733087 (0.0006) [2023-12-28 07:41:14,106][106226] Updated weights for policy 0, policy_version 1728908 (0.0010) [2023-12-28 07:41:14,170][106226] Updated weights for policy 0, policy_version 1728918 (0.0007) [2023-12-28 07:41:14,242][106226] Updated weights for policy 0, policy_version 1728928 (0.0007) [2023-12-28 07:41:14,830][106225] Updated weights for policy 1, policy_version 1733097 (0.0009) [2023-12-28 07:41:14,885][106225] Updated weights for policy 1, policy_version 1733107 (0.0010) [2023-12-28 07:41:14,935][106226] Updated weights for policy 0, policy_version 1728938 (0.0011) [2023-12-28 07:41:14,950][106225] Updated weights for policy 1, policy_version 1733117 (0.0011) [2023-12-28 07:41:14,997][106226] Updated weights for policy 0, policy_version 1728948 (0.0011) [2023-12-28 07:41:15,012][106225] Updated weights for policy 1, policy_version 1733127 (0.0011) [2023-12-28 07:41:15,060][106226] Updated weights for policy 0, policy_version 1728958 (0.0010) [2023-12-28 07:41:15,120][106226] Updated weights for policy 0, policy_version 1728968 (0.0011) [2023-12-28 07:41:15,746][106225] Updated weights for policy 1, policy_version 1733137 (0.0010) [2023-12-28 07:41:15,802][106225] Updated weights for policy 1, policy_version 1733147 (0.0010) [2023-12-28 07:41:15,840][106226] Updated weights for policy 0, policy_version 1728978 (0.0006) [2023-12-28 07:41:15,856][106225] Updated weights for policy 1, policy_version 1733157 (0.0010) [2023-12-28 07:41:15,900][106226] Updated weights for policy 0, policy_version 1728988 (0.0005) [2023-12-28 07:41:15,961][106226] Updated weights for policy 0, policy_version 1728998 (0.0009) [2023-12-28 07:41:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 886448128. Throughput: 0: 9715.0, 1: 10020.7. Samples: 886435360. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:16,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-5.041')] [2023-12-28 07:41:16,498][106225] Updated weights for policy 1, policy_version 1733167 (0.0009) [2023-12-28 07:41:16,545][106225] Updated weights for policy 1, policy_version 1733177 (0.0010) [2023-12-28 07:41:16,595][106225] Updated weights for policy 1, policy_version 1733187 (0.0010) [2023-12-28 07:41:16,628][106226] Updated weights for policy 0, policy_version 1729008 (0.0010) [2023-12-28 07:41:16,683][106226] Updated weights for policy 0, policy_version 1729018 (0.0010) [2023-12-28 07:41:16,737][106226] Updated weights for policy 0, policy_version 1729028 (0.0007) [2023-12-28 07:41:17,291][106226] Updated weights for policy 0, policy_version 1729038 (0.0007) [2023-12-28 07:41:17,315][106225] Updated weights for policy 1, policy_version 1733197 (0.0008) [2023-12-28 07:41:17,343][106226] Updated weights for policy 0, policy_version 1729048 (0.0008) [2023-12-28 07:41:17,360][106225] Updated weights for policy 1, policy_version 1733207 (0.0006) [2023-12-28 07:41:17,389][106226] Updated weights for policy 0, policy_version 1729058 (0.0010) [2023-12-28 07:41:17,411][106225] Updated weights for policy 1, policy_version 1733217 (0.0005) [2023-12-28 07:41:18,014][106225] Updated weights for policy 1, policy_version 1733227 (0.0006) [2023-12-28 07:41:18,069][106226] Updated weights for policy 0, policy_version 1729068 (0.0010) [2023-12-28 07:41:18,079][106225] Updated weights for policy 1, policy_version 1733237 (0.0006) [2023-12-28 07:41:18,122][106226] Updated weights for policy 0, policy_version 1729078 (0.0010) [2023-12-28 07:41:18,129][106225] Updated weights for policy 1, policy_version 1733247 (0.0005) [2023-12-28 07:41:18,175][106226] Updated weights for policy 0, policy_version 1729088 (0.0010) [2023-12-28 07:41:18,771][106225] Updated weights for policy 1, policy_version 1733257 (0.0005) [2023-12-28 07:41:18,833][106225] Updated weights for policy 1, policy_version 1733267 (0.0009) [2023-12-28 07:41:18,848][106226] Updated weights for policy 0, policy_version 1729098 (0.0010) [2023-12-28 07:41:18,894][106225] Updated weights for policy 1, policy_version 1733277 (0.0006) [2023-12-28 07:41:18,910][106226] Updated weights for policy 0, policy_version 1729108 (0.0009) [2023-12-28 07:41:18,954][106225] Updated weights for policy 1, policy_version 1733287 (0.0007) [2023-12-28 07:41:18,978][106226] Updated weights for policy 0, policy_version 1729118 (0.0011) [2023-12-28 07:41:19,041][106226] Updated weights for policy 0, policy_version 1729128 (0.0011) [2023-12-28 07:41:19,632][106225] Updated weights for policy 1, policy_version 1733297 (0.0009) [2023-12-28 07:41:19,679][106226] Updated weights for policy 0, policy_version 1729138 (0.0010) [2023-12-28 07:41:19,685][106225] Updated weights for policy 1, policy_version 1733307 (0.0008) [2023-12-28 07:41:19,741][106226] Updated weights for policy 0, policy_version 1729148 (0.0011) [2023-12-28 07:41:19,746][106225] Updated weights for policy 1, policy_version 1733317 (0.0006) [2023-12-28 07:41:19,810][106226] Updated weights for policy 0, policy_version 1729158 (0.0011) [2023-12-28 07:41:20,489][106225] Updated weights for policy 1, policy_version 1733327 (0.0007) [2023-12-28 07:41:20,518][106226] Updated weights for policy 0, policy_version 1729168 (0.0010) [2023-12-28 07:41:20,548][106225] Updated weights for policy 1, policy_version 1733337 (0.0006) [2023-12-28 07:41:20,574][106226] Updated weights for policy 0, policy_version 1729178 (0.0010) [2023-12-28 07:41:20,618][106225] Updated weights for policy 1, policy_version 1733347 (0.0009) [2023-12-28 07:41:20,634][106226] Updated weights for policy 0, policy_version 1729188 (0.0010) [2023-12-28 07:41:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 886546432. Throughput: 0: 9715.7, 1: 10070.8. Samples: 886557564. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:21,175][105115] Avg episode reward: [(0, '-4.682'), (1, '-5.053')] [2023-12-28 07:41:21,324][106225] Updated weights for policy 1, policy_version 1733357 (0.0009) [2023-12-28 07:41:21,398][106225] Updated weights for policy 1, policy_version 1733367 (0.0007) [2023-12-28 07:41:21,421][106226] Updated weights for policy 0, policy_version 1729198 (0.0009) [2023-12-28 07:41:21,449][106225] Updated weights for policy 1, policy_version 1733377 (0.0006) [2023-12-28 07:41:21,486][106226] Updated weights for policy 0, policy_version 1729208 (0.0008) [2023-12-28 07:41:21,543][106226] Updated weights for policy 0, policy_version 1729218 (0.0009) [2023-12-28 07:41:22,102][106225] Updated weights for policy 1, policy_version 1733387 (0.0007) [2023-12-28 07:41:22,161][106225] Updated weights for policy 1, policy_version 1733397 (0.0008) [2023-12-28 07:41:22,226][106225] Updated weights for policy 1, policy_version 1733407 (0.0009) [2023-12-28 07:41:22,380][106226] Updated weights for policy 0, policy_version 1729228 (0.0008) [2023-12-28 07:41:22,437][106226] Updated weights for policy 0, policy_version 1729238 (0.0008) [2023-12-28 07:41:22,507][106226] Updated weights for policy 0, policy_version 1729248 (0.0010) [2023-12-28 07:41:22,928][106225] Updated weights for policy 1, policy_version 1733417 (0.0009) [2023-12-28 07:41:22,982][106225] Updated weights for policy 1, policy_version 1733427 (0.0010) [2023-12-28 07:41:23,043][106225] Updated weights for policy 1, policy_version 1733437 (0.0010) [2023-12-28 07:41:23,102][106225] Updated weights for policy 1, policy_version 1733447 (0.0011) [2023-12-28 07:41:23,258][106226] Updated weights for policy 0, policy_version 1729258 (0.0009) [2023-12-28 07:41:23,328][106226] Updated weights for policy 0, policy_version 1729268 (0.0008) [2023-12-28 07:41:23,380][106226] Updated weights for policy 0, policy_version 1729278 (0.0009) [2023-12-28 07:41:23,437][106226] Updated weights for policy 0, policy_version 1729288 (0.0008) [2023-12-28 07:41:23,801][106225] Updated weights for policy 1, policy_version 1733457 (0.0010) [2023-12-28 07:41:23,868][106225] Updated weights for policy 1, policy_version 1733467 (0.0010) [2023-12-28 07:41:23,925][106225] Updated weights for policy 1, policy_version 1733477 (0.0010) [2023-12-28 07:41:24,172][106226] Updated weights for policy 0, policy_version 1729298 (0.0011) [2023-12-28 07:41:24,239][106226] Updated weights for policy 0, policy_version 1729308 (0.0006) [2023-12-28 07:41:24,307][106226] Updated weights for policy 0, policy_version 1729318 (0.0008) [2023-12-28 07:41:24,562][106225] Updated weights for policy 1, policy_version 1733487 (0.0010) [2023-12-28 07:41:24,619][106225] Updated weights for policy 1, policy_version 1733497 (0.0010) [2023-12-28 07:41:24,666][106225] Updated weights for policy 1, policy_version 1733507 (0.0008) [2023-12-28 07:41:24,916][106226] Updated weights for policy 0, policy_version 1729328 (0.0008) [2023-12-28 07:41:24,972][106226] Updated weights for policy 0, policy_version 1729338 (0.0010) [2023-12-28 07:41:25,033][106226] Updated weights for policy 0, policy_version 1729348 (0.0011) [2023-12-28 07:41:25,380][106225] Updated weights for policy 1, policy_version 1733517 (0.0007) [2023-12-28 07:41:25,438][106225] Updated weights for policy 1, policy_version 1733527 (0.0005) [2023-12-28 07:41:25,496][106225] Updated weights for policy 1, policy_version 1733537 (0.0008) [2023-12-28 07:41:25,721][106226] Updated weights for policy 0, policy_version 1729358 (0.0007) [2023-12-28 07:41:25,780][106226] Updated weights for policy 0, policy_version 1729368 (0.0005) [2023-12-28 07:41:25,843][106226] Updated weights for policy 0, policy_version 1729378 (0.0005) [2023-12-28 07:41:26,153][106225] Updated weights for policy 1, policy_version 1733547 (0.0010) [2023-12-28 07:41:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 886644736. Throughput: 0: 9701.1, 1: 10057.5. Samples: 886614592. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:26,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.492')] [2023-12-28 07:41:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001729384_442802176.pth... [2023-12-28 07:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001728264_442515456.pth [2023-12-28 07:41:26,213][106225] Updated weights for policy 1, policy_version 1733557 (0.0007) [2023-12-28 07:41:26,263][106225] Updated weights for policy 1, policy_version 1733567 (0.0007) [2023-12-28 07:41:26,310][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001733576_443850752.pth... [2023-12-28 07:41:26,315][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001732392_443547648.pth [2023-12-28 07:41:26,430][106226] Updated weights for policy 0, policy_version 1729388 (0.0006) [2023-12-28 07:41:26,492][106226] Updated weights for policy 0, policy_version 1729398 (0.0005) [2023-12-28 07:41:26,547][106226] Updated weights for policy 0, policy_version 1729408 (0.0005) [2023-12-28 07:41:26,972][106225] Updated weights for policy 1, policy_version 1733577 (0.0006) [2023-12-28 07:41:27,022][106225] Updated weights for policy 1, policy_version 1733587 (0.0008) [2023-12-28 07:41:27,067][106225] Updated weights for policy 1, policy_version 1733597 (0.0007) [2023-12-28 07:41:27,112][106225] Updated weights for policy 1, policy_version 1733607 (0.0007) [2023-12-28 07:41:27,152][106226] Updated weights for policy 0, policy_version 1729418 (0.0008) [2023-12-28 07:41:27,206][106226] Updated weights for policy 0, policy_version 1729428 (0.0011) [2023-12-28 07:41:27,252][106226] Updated weights for policy 0, policy_version 1729438 (0.0010) [2023-12-28 07:41:27,312][106226] Updated weights for policy 0, policy_version 1729448 (0.0009) [2023-12-28 07:41:27,903][106225] Updated weights for policy 1, policy_version 1733617 (0.0006) [2023-12-28 07:41:27,924][106226] Updated weights for policy 0, policy_version 1729458 (0.0010) [2023-12-28 07:41:27,956][106225] Updated weights for policy 1, policy_version 1733627 (0.0005) [2023-12-28 07:41:27,988][106226] Updated weights for policy 0, policy_version 1729468 (0.0011) [2023-12-28 07:41:28,016][106225] Updated weights for policy 1, policy_version 1733637 (0.0007) [2023-12-28 07:41:28,041][106226] Updated weights for policy 0, policy_version 1729478 (0.0010) [2023-12-28 07:41:28,635][106225] Updated weights for policy 1, policy_version 1733647 (0.0008) [2023-12-28 07:41:28,695][106225] Updated weights for policy 1, policy_version 1733657 (0.0008) [2023-12-28 07:41:28,706][106226] Updated weights for policy 0, policy_version 1729488 (0.0006) [2023-12-28 07:41:28,760][106225] Updated weights for policy 1, policy_version 1733667 (0.0009) [2023-12-28 07:41:28,763][106226] Updated weights for policy 0, policy_version 1729498 (0.0005) [2023-12-28 07:41:28,818][106226] Updated weights for policy 0, policy_version 1729508 (0.0006) [2023-12-28 07:41:29,442][106226] Updated weights for policy 0, policy_version 1729518 (0.0010) [2023-12-28 07:41:29,505][106226] Updated weights for policy 0, policy_version 1729528 (0.0009) [2023-12-28 07:41:29,535][106225] Updated weights for policy 1, policy_version 1733677 (0.0008) [2023-12-28 07:41:29,564][106226] Updated weights for policy 0, policy_version 1729538 (0.0010) [2023-12-28 07:41:29,592][106225] Updated weights for policy 1, policy_version 1733687 (0.0006) [2023-12-28 07:41:29,648][106225] Updated weights for policy 1, policy_version 1733697 (0.0007) [2023-12-28 07:41:30,292][106226] Updated weights for policy 0, policy_version 1729548 (0.0010) [2023-12-28 07:41:30,358][106226] Updated weights for policy 0, policy_version 1729558 (0.0006) [2023-12-28 07:41:30,399][106225] Updated weights for policy 1, policy_version 1733707 (0.0008) [2023-12-28 07:41:30,418][106226] Updated weights for policy 0, policy_version 1729568 (0.0006) [2023-12-28 07:41:30,446][106225] Updated weights for policy 1, policy_version 1733717 (0.0007) [2023-12-28 07:41:30,494][106225] Updated weights for policy 1, policy_version 1733727 (0.0009) [2023-12-28 07:41:30,994][106226] Updated weights for policy 0, policy_version 1729578 (0.0006) [2023-12-28 07:41:31,063][106226] Updated weights for policy 0, policy_version 1729588 (0.0008) [2023-12-28 07:41:31,130][106226] Updated weights for policy 0, policy_version 1729598 (0.0008) [2023-12-28 07:41:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 886743040. Throughput: 0: 9883.3, 1: 10030.0. Samples: 886737712. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:31,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-5.149')] [2023-12-28 07:41:31,204][106226] Updated weights for policy 0, policy_version 1729608 (0.0008) [2023-12-28 07:41:31,254][106225] Updated weights for policy 1, policy_version 1733737 (0.0008) [2023-12-28 07:41:31,318][106225] Updated weights for policy 1, policy_version 1733747 (0.0008) [2023-12-28 07:41:31,381][106225] Updated weights for policy 1, policy_version 1733757 (0.0007) [2023-12-28 07:41:31,455][106225] Updated weights for policy 1, policy_version 1733767 (0.0008) [2023-12-28 07:41:31,880][106226] Updated weights for policy 0, policy_version 1729618 (0.0007) [2023-12-28 07:41:31,935][106226] Updated weights for policy 0, policy_version 1729628 (0.0009) [2023-12-28 07:41:31,992][106226] Updated weights for policy 0, policy_version 1729638 (0.0009) [2023-12-28 07:41:32,242][106225] Updated weights for policy 1, policy_version 1733777 (0.0009) [2023-12-28 07:41:32,305][106225] Updated weights for policy 1, policy_version 1733787 (0.0007) [2023-12-28 07:41:32,375][106225] Updated weights for policy 1, policy_version 1733797 (0.0007) [2023-12-28 07:41:32,702][106226] Updated weights for policy 0, policy_version 1729648 (0.0007) [2023-12-28 07:41:32,761][106226] Updated weights for policy 0, policy_version 1729658 (0.0008) [2023-12-28 07:41:32,820][106226] Updated weights for policy 0, policy_version 1729668 (0.0007) [2023-12-28 07:41:33,098][106225] Updated weights for policy 1, policy_version 1733807 (0.0008) [2023-12-28 07:41:33,158][106225] Updated weights for policy 1, policy_version 1733817 (0.0008) [2023-12-28 07:41:33,215][106225] Updated weights for policy 1, policy_version 1733827 (0.0008) [2023-12-28 07:41:33,456][106226] Updated weights for policy 0, policy_version 1729678 (0.0008) [2023-12-28 07:41:33,512][106226] Updated weights for policy 0, policy_version 1729688 (0.0008) [2023-12-28 07:41:33,577][106226] Updated weights for policy 0, policy_version 1729698 (0.0009) [2023-12-28 07:41:33,945][106225] Updated weights for policy 1, policy_version 1733837 (0.0008) [2023-12-28 07:41:34,002][106225] Updated weights for policy 1, policy_version 1733847 (0.0008) [2023-12-28 07:41:34,052][106225] Updated weights for policy 1, policy_version 1733857 (0.0008) [2023-12-28 07:41:34,223][106226] Updated weights for policy 0, policy_version 1729708 (0.0008) [2023-12-28 07:41:34,287][106226] Updated weights for policy 0, policy_version 1729718 (0.0009) [2023-12-28 07:41:34,344][106226] Updated weights for policy 0, policy_version 1729728 (0.0007) [2023-12-28 07:41:34,832][106225] Updated weights for policy 1, policy_version 1733867 (0.0007) [2023-12-28 07:41:34,891][106225] Updated weights for policy 1, policy_version 1733877 (0.0008) [2023-12-28 07:41:34,951][106225] Updated weights for policy 1, policy_version 1733887 (0.0009) [2023-12-28 07:41:35,044][106226] Updated weights for policy 0, policy_version 1729738 (0.0007) [2023-12-28 07:41:35,106][106226] Updated weights for policy 0, policy_version 1729748 (0.0009) [2023-12-28 07:41:35,155][106226] Updated weights for policy 0, policy_version 1729758 (0.0008) [2023-12-28 07:41:35,210][106226] Updated weights for policy 0, policy_version 1729768 (0.0008) [2023-12-28 07:41:35,665][106225] Updated weights for policy 1, policy_version 1733897 (0.0008) [2023-12-28 07:41:35,724][106225] Updated weights for policy 1, policy_version 1733907 (0.0009) [2023-12-28 07:41:35,785][106225] Updated weights for policy 1, policy_version 1733917 (0.0009) [2023-12-28 07:41:35,842][106225] Updated weights for policy 1, policy_version 1733927 (0.0008) [2023-12-28 07:41:35,950][106226] Updated weights for policy 0, policy_version 1729778 (0.0009) [2023-12-28 07:41:36,005][106226] Updated weights for policy 0, policy_version 1729788 (0.0008) [2023-12-28 07:41:36,051][106226] Updated weights for policy 0, policy_version 1729798 (0.0008) [2023-12-28 07:41:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 886849536. Throughput: 0: 9887.4, 1: 9905.5. Samples: 886854352. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:36,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.868')] [2023-12-28 07:41:36,546][106225] Updated weights for policy 1, policy_version 1733937 (0.0008) [2023-12-28 07:41:36,602][106225] Updated weights for policy 1, policy_version 1733947 (0.0006) [2023-12-28 07:41:36,657][106225] Updated weights for policy 1, policy_version 1733957 (0.0005) [2023-12-28 07:41:36,844][106226] Updated weights for policy 0, policy_version 1729808 (0.0007) [2023-12-28 07:41:36,906][106226] Updated weights for policy 0, policy_version 1729818 (0.0008) [2023-12-28 07:41:36,973][106226] Updated weights for policy 0, policy_version 1729828 (0.0008) [2023-12-28 07:41:37,345][106225] Updated weights for policy 1, policy_version 1733967 (0.0009) [2023-12-28 07:41:37,400][106225] Updated weights for policy 1, policy_version 1733977 (0.0010) [2023-12-28 07:41:37,458][106225] Updated weights for policy 1, policy_version 1733987 (0.0010) [2023-12-28 07:41:37,610][106226] Updated weights for policy 0, policy_version 1729838 (0.0010) [2023-12-28 07:41:37,664][106226] Updated weights for policy 0, policy_version 1729848 (0.0011) [2023-12-28 07:41:37,715][106226] Updated weights for policy 0, policy_version 1729858 (0.0010) [2023-12-28 07:41:38,182][106225] Updated weights for policy 1, policy_version 1733997 (0.0009) [2023-12-28 07:41:38,239][106225] Updated weights for policy 1, policy_version 1734007 (0.0008) [2023-12-28 07:41:38,292][106225] Updated weights for policy 1, policy_version 1734017 (0.0008) [2023-12-28 07:41:38,436][106226] Updated weights for policy 0, policy_version 1729868 (0.0010) [2023-12-28 07:41:38,497][106226] Updated weights for policy 0, policy_version 1729878 (0.0011) [2023-12-28 07:41:38,558][106226] Updated weights for policy 0, policy_version 1729888 (0.0007) [2023-12-28 07:41:39,042][106225] Updated weights for policy 1, policy_version 1734027 (0.0008) [2023-12-28 07:41:39,096][106225] Updated weights for policy 1, policy_version 1734037 (0.0008) [2023-12-28 07:41:39,156][106225] Updated weights for policy 1, policy_version 1734047 (0.0007) [2023-12-28 07:41:39,239][106226] Updated weights for policy 0, policy_version 1729898 (0.0010) [2023-12-28 07:41:39,296][106226] Updated weights for policy 0, policy_version 1729908 (0.0006) [2023-12-28 07:41:39,370][106226] Updated weights for policy 0, policy_version 1729918 (0.0009) [2023-12-28 07:41:39,444][106226] Updated weights for policy 0, policy_version 1729928 (0.0009) [2023-12-28 07:41:40,024][106225] Updated weights for policy 1, policy_version 1734057 (0.0009) [2023-12-28 07:41:40,081][106225] Updated weights for policy 1, policy_version 1734067 (0.0007) [2023-12-28 07:41:40,125][106226] Updated weights for policy 0, policy_version 1729938 (0.0011) [2023-12-28 07:41:40,143][106225] Updated weights for policy 1, policy_version 1734077 (0.0007) [2023-12-28 07:41:40,191][106226] Updated weights for policy 0, policy_version 1729948 (0.0011) [2023-12-28 07:41:40,205][106225] Updated weights for policy 1, policy_version 1734087 (0.0006) [2023-12-28 07:41:40,258][106226] Updated weights for policy 0, policy_version 1729958 (0.0008) [2023-12-28 07:41:40,897][106225] Updated weights for policy 1, policy_version 1734097 (0.0010) [2023-12-28 07:41:40,906][106226] Updated weights for policy 0, policy_version 1729968 (0.0006) [2023-12-28 07:41:40,958][106226] Updated weights for policy 0, policy_version 1729978 (0.0009) [2023-12-28 07:41:40,958][106225] Updated weights for policy 1, policy_version 1734107 (0.0010) [2023-12-28 07:41:41,019][106225] Updated weights for policy 1, policy_version 1734117 (0.0010) [2023-12-28 07:41:41,020][106226] Updated weights for policy 0, policy_version 1729988 (0.0011) [2023-12-28 07:41:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 886947840. Throughput: 0: 9911.8, 1: 9901.9. Samples: 886913008. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:41,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.899')] [2023-12-28 07:41:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001729992_442957824.pth... [2023-12-28 07:41:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001734120_443990016.pth... [2023-12-28 07:41:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001728808_442654720.pth [2023-12-28 07:41:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001732968_443695104.pth [2023-12-28 07:41:41,775][106226] Updated weights for policy 0, policy_version 1729998 (0.0010) [2023-12-28 07:41:41,828][106225] Updated weights for policy 1, policy_version 1734127 (0.0011) [2023-12-28 07:41:41,830][106226] Updated weights for policy 0, policy_version 1730008 (0.0008) [2023-12-28 07:41:41,886][106225] Updated weights for policy 1, policy_version 1734137 (0.0010) [2023-12-28 07:41:41,893][106226] Updated weights for policy 0, policy_version 1730018 (0.0008) [2023-12-28 07:41:41,945][106225] Updated weights for policy 1, policy_version 1734147 (0.0010) [2023-12-28 07:41:42,578][106226] Updated weights for policy 0, policy_version 1730028 (0.0007) [2023-12-28 07:41:42,639][106226] Updated weights for policy 0, policy_version 1730038 (0.0010) [2023-12-28 07:41:42,680][106225] Updated weights for policy 1, policy_version 1734157 (0.0010) [2023-12-28 07:41:42,700][106226] Updated weights for policy 0, policy_version 1730048 (0.0006) [2023-12-28 07:41:42,747][106225] Updated weights for policy 1, policy_version 1734167 (0.0010) [2023-12-28 07:41:42,805][106225] Updated weights for policy 1, policy_version 1734177 (0.0009) [2023-12-28 07:41:43,307][106226] Updated weights for policy 0, policy_version 1730058 (0.0006) [2023-12-28 07:41:43,362][106226] Updated weights for policy 0, policy_version 1730068 (0.0010) [2023-12-28 07:41:43,411][106226] Updated weights for policy 0, policy_version 1730078 (0.0010) [2023-12-28 07:41:43,444][106225] Updated weights for policy 1, policy_version 1734187 (0.0009) [2023-12-28 07:41:43,465][106226] Updated weights for policy 0, policy_version 1730088 (0.0011) [2023-12-28 07:41:43,503][106225] Updated weights for policy 1, policy_version 1734197 (0.0010) [2023-12-28 07:41:43,559][106225] Updated weights for policy 1, policy_version 1734207 (0.0010) [2023-12-28 07:41:44,165][106226] Updated weights for policy 0, policy_version 1730098 (0.0008) [2023-12-28 07:41:44,197][106225] Updated weights for policy 1, policy_version 1734217 (0.0010) [2023-12-28 07:41:44,228][106226] Updated weights for policy 0, policy_version 1730108 (0.0007) [2023-12-28 07:41:44,252][106225] Updated weights for policy 1, policy_version 1734227 (0.0007) [2023-12-28 07:41:44,288][106226] Updated weights for policy 0, policy_version 1730118 (0.0008) [2023-12-28 07:41:44,307][106225] Updated weights for policy 1, policy_version 1734237 (0.0006) [2023-12-28 07:41:44,356][106225] Updated weights for policy 1, policy_version 1734247 (0.0007) [2023-12-28 07:41:45,068][106226] Updated weights for policy 0, policy_version 1730128 (0.0007) [2023-12-28 07:41:45,090][106225] Updated weights for policy 1, policy_version 1734257 (0.0010) [2023-12-28 07:41:45,128][106226] Updated weights for policy 0, policy_version 1730138 (0.0006) [2023-12-28 07:41:45,146][106225] Updated weights for policy 1, policy_version 1734267 (0.0011) [2023-12-28 07:41:45,188][106226] Updated weights for policy 0, policy_version 1730148 (0.0006) [2023-12-28 07:41:45,200][106225] Updated weights for policy 1, policy_version 1734277 (0.0010) [2023-12-28 07:41:45,917][106226] Updated weights for policy 0, policy_version 1730158 (0.0007) [2023-12-28 07:41:45,931][106225] Updated weights for policy 1, policy_version 1734287 (0.0010) [2023-12-28 07:41:45,975][106226] Updated weights for policy 0, policy_version 1730168 (0.0007) [2023-12-28 07:41:45,991][106225] Updated weights for policy 1, policy_version 1734297 (0.0010) [2023-12-28 07:41:46,031][106226] Updated weights for policy 0, policy_version 1730178 (0.0009) [2023-12-28 07:41:46,042][106225] Updated weights for policy 1, policy_version 1734307 (0.0010) [2023-12-28 07:41:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 887046144. Throughput: 0: 9950.3, 1: 9828.3. Samples: 887030672. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:46,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.912')] [2023-12-28 07:41:46,620][106226] Updated weights for policy 0, policy_version 1730188 (0.0010) [2023-12-28 07:41:46,688][106226] Updated weights for policy 0, policy_version 1730198 (0.0009) [2023-12-28 07:41:46,745][106225] Updated weights for policy 1, policy_version 1734317 (0.0009) [2023-12-28 07:41:46,747][106226] Updated weights for policy 0, policy_version 1730208 (0.0008) [2023-12-28 07:41:46,800][106225] Updated weights for policy 1, policy_version 1734327 (0.0006) [2023-12-28 07:41:46,863][106225] Updated weights for policy 1, policy_version 1734337 (0.0009) [2023-12-28 07:41:47,439][106225] Updated weights for policy 1, policy_version 1734347 (0.0009) [2023-12-28 07:41:47,489][106225] Updated weights for policy 1, policy_version 1734357 (0.0005) [2023-12-28 07:41:47,522][106226] Updated weights for policy 0, policy_version 1730218 (0.0006) [2023-12-28 07:41:47,537][106225] Updated weights for policy 1, policy_version 1734367 (0.0005) [2023-12-28 07:41:47,578][106226] Updated weights for policy 0, policy_version 1730228 (0.0008) [2023-12-28 07:41:47,624][106226] Updated weights for policy 0, policy_version 1730238 (0.0005) [2023-12-28 07:41:47,679][106226] Updated weights for policy 0, policy_version 1730248 (0.0007) [2023-12-28 07:41:48,110][106225] Updated weights for policy 1, policy_version 1734377 (0.0007) [2023-12-28 07:41:48,168][106225] Updated weights for policy 1, policy_version 1734387 (0.0005) [2023-12-28 07:41:48,220][106225] Updated weights for policy 1, policy_version 1734397 (0.0005) [2023-12-28 07:41:48,282][106226] Updated weights for policy 0, policy_version 1730258 (0.0009) [2023-12-28 07:41:48,284][106225] Updated weights for policy 1, policy_version 1734407 (0.0010) [2023-12-28 07:41:48,345][106226] Updated weights for policy 0, policy_version 1730268 (0.0009) [2023-12-28 07:41:48,401][106226] Updated weights for policy 0, policy_version 1730278 (0.0010) [2023-12-28 07:41:48,970][106225] Updated weights for policy 1, policy_version 1734417 (0.0009) [2023-12-28 07:41:49,029][106225] Updated weights for policy 1, policy_version 1734427 (0.0008) [2023-12-28 07:41:49,087][106225] Updated weights for policy 1, policy_version 1734437 (0.0008) [2023-12-28 07:41:49,129][106226] Updated weights for policy 0, policy_version 1730288 (0.0009) [2023-12-28 07:41:49,183][106226] Updated weights for policy 0, policy_version 1730298 (0.0009) [2023-12-28 07:41:49,244][106226] Updated weights for policy 0, policy_version 1730308 (0.0008) [2023-12-28 07:41:49,843][106225] Updated weights for policy 1, policy_version 1734447 (0.0008) [2023-12-28 07:41:49,911][106225] Updated weights for policy 1, policy_version 1734457 (0.0008) [2023-12-28 07:41:49,976][106225] Updated weights for policy 1, policy_version 1734467 (0.0009) [2023-12-28 07:41:49,977][106226] Updated weights for policy 0, policy_version 1730318 (0.0008) [2023-12-28 07:41:50,043][106226] Updated weights for policy 0, policy_version 1730328 (0.0007) [2023-12-28 07:41:50,104][106226] Updated weights for policy 0, policy_version 1730338 (0.0007) [2023-12-28 07:41:50,597][106225] Updated weights for policy 1, policy_version 1734477 (0.0008) [2023-12-28 07:41:50,653][106225] Updated weights for policy 1, policy_version 1734487 (0.0006) [2023-12-28 07:41:50,724][106225] Updated weights for policy 1, policy_version 1734497 (0.0006) [2023-12-28 07:41:50,770][106226] Updated weights for policy 0, policy_version 1730348 (0.0008) [2023-12-28 07:41:50,823][106226] Updated weights for policy 0, policy_version 1730358 (0.0006) [2023-12-28 07:41:50,883][106226] Updated weights for policy 0, policy_version 1730368 (0.0006) [2023-12-28 07:41:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 887144448. Throughput: 0: 9949.5, 1: 9883.3. Samples: 887152300. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:51,175][105115] Avg episode reward: [(0, '-4.225'), (1, '-4.780')] [2023-12-28 07:41:51,448][106225] Updated weights for policy 1, policy_version 1734507 (0.0007) [2023-12-28 07:41:51,499][106225] Updated weights for policy 1, policy_version 1734517 (0.0009) [2023-12-28 07:41:51,553][106225] Updated weights for policy 1, policy_version 1734527 (0.0009) [2023-12-28 07:41:51,568][106226] Updated weights for policy 0, policy_version 1730378 (0.0009) [2023-12-28 07:41:51,642][106226] Updated weights for policy 0, policy_version 1730388 (0.0007) [2023-12-28 07:41:51,706][106226] Updated weights for policy 0, policy_version 1730398 (0.0006) [2023-12-28 07:41:51,772][106226] Updated weights for policy 0, policy_version 1730408 (0.0010) [2023-12-28 07:41:52,305][106225] Updated weights for policy 1, policy_version 1734537 (0.0008) [2023-12-28 07:41:52,375][106225] Updated weights for policy 1, policy_version 1734547 (0.0009) [2023-12-28 07:41:52,441][106225] Updated weights for policy 1, policy_version 1734557 (0.0009) [2023-12-28 07:41:52,487][106226] Updated weights for policy 0, policy_version 1730418 (0.0006) [2023-12-28 07:41:52,502][106225] Updated weights for policy 1, policy_version 1734567 (0.0007) [2023-12-28 07:41:52,538][106226] Updated weights for policy 0, policy_version 1730428 (0.0008) [2023-12-28 07:41:52,592][106226] Updated weights for policy 0, policy_version 1730438 (0.0009) [2023-12-28 07:41:53,124][106225] Updated weights for policy 1, policy_version 1734577 (0.0005) [2023-12-28 07:41:53,188][106225] Updated weights for policy 1, policy_version 1734587 (0.0006) [2023-12-28 07:41:53,242][106225] Updated weights for policy 1, policy_version 1734597 (0.0007) [2023-12-28 07:41:53,422][106226] Updated weights for policy 0, policy_version 1730448 (0.0007) [2023-12-28 07:41:53,472][106226] Updated weights for policy 0, policy_version 1730458 (0.0008) [2023-12-28 07:41:53,521][106226] Updated weights for policy 0, policy_version 1730468 (0.0008) [2023-12-28 07:41:53,762][106225] Updated weights for policy 1, policy_version 1734607 (0.0005) [2023-12-28 07:41:53,832][106225] Updated weights for policy 1, policy_version 1734617 (0.0005) [2023-12-28 07:41:53,887][106225] Updated weights for policy 1, policy_version 1734627 (0.0005) [2023-12-28 07:41:54,302][106226] Updated weights for policy 0, policy_version 1730479 (0.0010) [2023-12-28 07:41:54,360][106226] Updated weights for policy 0, policy_version 1730489 (0.0008) [2023-12-28 07:41:54,377][106225] Updated weights for policy 1, policy_version 1734637 (0.0005) [2023-12-28 07:41:54,420][106226] Updated weights for policy 0, policy_version 1730499 (0.0007) [2023-12-28 07:41:54,435][106225] Updated weights for policy 1, policy_version 1734647 (0.0006) [2023-12-28 07:41:54,495][106225] Updated weights for policy 1, policy_version 1734657 (0.0005) [2023-12-28 07:41:55,137][106225] Updated weights for policy 1, policy_version 1734667 (0.0008) [2023-12-28 07:41:55,170][106226] Updated weights for policy 0, policy_version 1730509 (0.0005) [2023-12-28 07:41:55,192][106225] Updated weights for policy 1, policy_version 1734677 (0.0008) [2023-12-28 07:41:55,219][106226] Updated weights for policy 0, policy_version 1730519 (0.0008) [2023-12-28 07:41:55,237][106225] Updated weights for policy 1, policy_version 1734687 (0.0005) [2023-12-28 07:41:55,268][106226] Updated weights for policy 0, policy_version 1730529 (0.0009) [2023-12-28 07:41:55,822][106225] Updated weights for policy 1, policy_version 1734697 (0.0005) [2023-12-28 07:41:55,887][106225] Updated weights for policy 1, policy_version 1734707 (0.0006) [2023-12-28 07:41:55,945][106225] Updated weights for policy 1, policy_version 1734717 (0.0005) [2023-12-28 07:41:56,010][106225] Updated weights for policy 1, policy_version 1734727 (0.0008) [2023-12-28 07:41:56,033][106226] Updated weights for policy 0, policy_version 1730539 (0.0008) [2023-12-28 07:41:56,097][106226] Updated weights for policy 0, policy_version 1730549 (0.0008) [2023-12-28 07:41:56,144][106226] Updated weights for policy 0, policy_version 1730559 (0.0008) [2023-12-28 07:41:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 887242752. Throughput: 0: 9949.7, 1: 9856.5. Samples: 887210760. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:41:56,175][105115] Avg episode reward: [(0, '-4.218'), (1, '-4.887')] [2023-12-28 07:41:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001734728_444145664.pth... [2023-12-28 07:41:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001733576_443850752.pth [2023-12-28 07:41:56,197][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001730568_443105280.pth... [2023-12-28 07:41:56,202][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001729384_442802176.pth [2023-12-28 07:41:56,665][106225] Updated weights for policy 1, policy_version 1734737 (0.0009) [2023-12-28 07:41:56,722][106225] Updated weights for policy 1, policy_version 1734747 (0.0008) [2023-12-28 07:41:56,768][106225] Updated weights for policy 1, policy_version 1734757 (0.0008) [2023-12-28 07:41:56,888][106226] Updated weights for policy 0, policy_version 1730569 (0.0008) [2023-12-28 07:41:56,943][106226] Updated weights for policy 0, policy_version 1730579 (0.0008) [2023-12-28 07:41:56,993][106226] Updated weights for policy 0, policy_version 1730589 (0.0009) [2023-12-28 07:41:57,043][106226] Updated weights for policy 0, policy_version 1730599 (0.0009) [2023-12-28 07:41:57,396][106225] Updated weights for policy 1, policy_version 1734767 (0.0008) [2023-12-28 07:41:57,443][106225] Updated weights for policy 1, policy_version 1734777 (0.0008) [2023-12-28 07:41:57,487][106225] Updated weights for policy 1, policy_version 1734787 (0.0008) [2023-12-28 07:41:57,737][106226] Updated weights for policy 0, policy_version 1730609 (0.0007) [2023-12-28 07:41:57,801][106226] Updated weights for policy 0, policy_version 1730619 (0.0009) [2023-12-28 07:41:57,857][106226] Updated weights for policy 0, policy_version 1730629 (0.0009) [2023-12-28 07:41:58,138][106225] Updated weights for policy 1, policy_version 1734797 (0.0007) [2023-12-28 07:41:58,193][106225] Updated weights for policy 1, policy_version 1734807 (0.0005) [2023-12-28 07:41:58,254][106225] Updated weights for policy 1, policy_version 1734817 (0.0007) [2023-12-28 07:41:58,582][106226] Updated weights for policy 0, policy_version 1730639 (0.0009) [2023-12-28 07:41:58,642][106226] Updated weights for policy 0, policy_version 1730649 (0.0008) [2023-12-28 07:41:58,705][106226] Updated weights for policy 0, policy_version 1730659 (0.0007) [2023-12-28 07:41:59,059][106225] Updated weights for policy 1, policy_version 1734827 (0.0008) [2023-12-28 07:41:59,122][106225] Updated weights for policy 1, policy_version 1734837 (0.0010) [2023-12-28 07:41:59,186][106225] Updated weights for policy 1, policy_version 1734847 (0.0010) [2023-12-28 07:41:59,551][106226] Updated weights for policy 0, policy_version 1730669 (0.0008) [2023-12-28 07:41:59,612][106226] Updated weights for policy 0, policy_version 1730679 (0.0007) [2023-12-28 07:41:59,672][106226] Updated weights for policy 0, policy_version 1730689 (0.0006) [2023-12-28 07:42:00,031][106225] Updated weights for policy 1, policy_version 1734857 (0.0009) [2023-12-28 07:42:00,089][106225] Updated weights for policy 1, policy_version 1734867 (0.0005) [2023-12-28 07:42:00,154][106225] Updated weights for policy 1, policy_version 1734877 (0.0007) [2023-12-28 07:42:00,219][106225] Updated weights for policy 1, policy_version 1734887 (0.0009) [2023-12-28 07:42:00,297][106226] Updated weights for policy 0, policy_version 1730699 (0.0008) [2023-12-28 07:42:00,340][106226] Updated weights for policy 0, policy_version 1730709 (0.0005) [2023-12-28 07:42:00,396][106226] Updated weights for policy 0, policy_version 1730719 (0.0007) [2023-12-28 07:42:00,883][106225] Updated weights for policy 1, policy_version 1734897 (0.0010) [2023-12-28 07:42:00,942][106225] Updated weights for policy 1, policy_version 1734907 (0.0010) [2023-12-28 07:42:01,001][106225] Updated weights for policy 1, policy_version 1734917 (0.0010) [2023-12-28 07:42:01,060][106226] Updated weights for policy 0, policy_version 1730729 (0.0008) [2023-12-28 07:42:01,108][106226] Updated weights for policy 0, policy_version 1730739 (0.0008) [2023-12-28 07:42:01,172][106226] Updated weights for policy 0, policy_version 1730749 (0.0011) [2023-12-28 07:42:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 887341056. Throughput: 0: 9924.5, 1: 9970.7. Samples: 887330644. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:42:01,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-5.045')] [2023-12-28 07:42:01,238][106226] Updated weights for policy 0, policy_version 1730759 (0.0009) [2023-12-28 07:42:01,793][106225] Updated weights for policy 1, policy_version 1734927 (0.0009) [2023-12-28 07:42:01,862][106225] Updated weights for policy 1, policy_version 1734937 (0.0005) [2023-12-28 07:42:01,926][106225] Updated weights for policy 1, policy_version 1734947 (0.0007) [2023-12-28 07:42:01,934][106226] Updated weights for policy 0, policy_version 1730769 (0.0007) [2023-12-28 07:42:01,997][106226] Updated weights for policy 0, policy_version 1730779 (0.0008) [2023-12-28 07:42:02,052][106226] Updated weights for policy 0, policy_version 1730789 (0.0005) [2023-12-28 07:42:02,563][106225] Updated weights for policy 1, policy_version 1734957 (0.0008) [2023-12-28 07:42:02,612][106225] Updated weights for policy 1, policy_version 1734967 (0.0008) [2023-12-28 07:42:02,657][106225] Updated weights for policy 1, policy_version 1734977 (0.0008) [2023-12-28 07:42:02,732][106226] Updated weights for policy 0, policy_version 1730799 (0.0007) [2023-12-28 07:42:02,784][106226] Updated weights for policy 0, policy_version 1730809 (0.0006) [2023-12-28 07:42:02,849][106226] Updated weights for policy 0, policy_version 1730819 (0.0008) [2023-12-28 07:42:03,279][106225] Updated weights for policy 1, policy_version 1734987 (0.0007) [2023-12-28 07:42:03,331][106225] Updated weights for policy 1, policy_version 1734997 (0.0010) [2023-12-28 07:42:03,383][106225] Updated weights for policy 1, policy_version 1735007 (0.0010) [2023-12-28 07:42:03,489][106226] Updated weights for policy 0, policy_version 1730829 (0.0007) [2023-12-28 07:42:03,539][106226] Updated weights for policy 0, policy_version 1730839 (0.0010) [2023-12-28 07:42:03,587][106226] Updated weights for policy 0, policy_version 1730849 (0.0009) [2023-12-28 07:42:04,062][106225] Updated weights for policy 1, policy_version 1735017 (0.0010) [2023-12-28 07:42:04,120][106225] Updated weights for policy 1, policy_version 1735027 (0.0010) [2023-12-28 07:42:04,184][106225] Updated weights for policy 1, policy_version 1735037 (0.0011) [2023-12-28 07:42:04,250][106225] Updated weights for policy 1, policy_version 1735047 (0.0010) [2023-12-28 07:42:04,267][106226] Updated weights for policy 0, policy_version 1730859 (0.0009) [2023-12-28 07:42:04,332][106226] Updated weights for policy 0, policy_version 1730869 (0.0008) [2023-12-28 07:42:04,398][106226] Updated weights for policy 0, policy_version 1730879 (0.0008) [2023-12-28 07:42:04,960][106225] Updated weights for policy 1, policy_version 1735057 (0.0006) [2023-12-28 07:42:05,007][106225] Updated weights for policy 1, policy_version 1735067 (0.0005) [2023-12-28 07:42:05,055][106225] Updated weights for policy 1, policy_version 1735077 (0.0005) [2023-12-28 07:42:05,068][106226] Updated weights for policy 0, policy_version 1730889 (0.0008) [2023-12-28 07:42:05,131][106226] Updated weights for policy 0, policy_version 1730899 (0.0009) [2023-12-28 07:42:05,186][106226] Updated weights for policy 0, policy_version 1730909 (0.0009) [2023-12-28 07:42:05,242][106226] Updated weights for policy 0, policy_version 1730919 (0.0010) [2023-12-28 07:42:05,602][106225] Updated weights for policy 1, policy_version 1735087 (0.0005) [2023-12-28 07:42:05,657][106225] Updated weights for policy 1, policy_version 1735097 (0.0005) [2023-12-28 07:42:05,721][106225] Updated weights for policy 1, policy_version 1735107 (0.0006) [2023-12-28 07:42:06,092][106226] Updated weights for policy 0, policy_version 1730929 (0.0009) [2023-12-28 07:42:06,156][106226] Updated weights for policy 0, policy_version 1730939 (0.0007) [2023-12-28 07:42:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 887439360. Throughput: 0: 9895.9, 1: 10007.0. Samples: 887453192. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:42:06,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.871')] [2023-12-28 07:42:06,221][106226] Updated weights for policy 0, policy_version 1730949 (0.0007) [2023-12-28 07:42:06,315][106225] Updated weights for policy 1, policy_version 1735117 (0.0007) [2023-12-28 07:42:06,375][106225] Updated weights for policy 1, policy_version 1735127 (0.0008) [2023-12-28 07:42:06,434][106225] Updated weights for policy 1, policy_version 1735137 (0.0008) [2023-12-28 07:42:06,898][106226] Updated weights for policy 0, policy_version 1730959 (0.0009) [2023-12-28 07:42:06,948][106226] Updated weights for policy 0, policy_version 1730969 (0.0008) [2023-12-28 07:42:07,003][106226] Updated weights for policy 0, policy_version 1730979 (0.0008) [2023-12-28 07:42:07,164][106225] Updated weights for policy 1, policy_version 1735147 (0.0008) [2023-12-28 07:42:07,217][106225] Updated weights for policy 1, policy_version 1735157 (0.0008) [2023-12-28 07:42:07,282][106225] Updated weights for policy 1, policy_version 1735167 (0.0009) [2023-12-28 07:42:07,710][106226] Updated weights for policy 0, policy_version 1730989 (0.0008) [2023-12-28 07:42:07,758][106226] Updated weights for policy 0, policy_version 1730999 (0.0008) [2023-12-28 07:42:07,806][106226] Updated weights for policy 0, policy_version 1731009 (0.0008) [2023-12-28 07:42:08,063][106225] Updated weights for policy 1, policy_version 1735177 (0.0009) [2023-12-28 07:42:08,115][106225] Updated weights for policy 1, policy_version 1735187 (0.0008) [2023-12-28 07:42:08,176][106225] Updated weights for policy 1, policy_version 1735197 (0.0007) [2023-12-28 07:42:08,234][106225] Updated weights for policy 1, policy_version 1735207 (0.0007) [2023-12-28 07:42:08,479][106226] Updated weights for policy 0, policy_version 1731019 (0.0009) [2023-12-28 07:42:08,549][106226] Updated weights for policy 0, policy_version 1731029 (0.0011) [2023-12-28 07:42:08,613][106226] Updated weights for policy 0, policy_version 1731039 (0.0007) [2023-12-28 07:42:08,967][106225] Updated weights for policy 1, policy_version 1735217 (0.0006) [2023-12-28 07:42:09,022][106225] Updated weights for policy 1, policy_version 1735227 (0.0005) [2023-12-28 07:42:09,073][106225] Updated weights for policy 1, policy_version 1735237 (0.0008) [2023-12-28 07:42:09,267][106226] Updated weights for policy 0, policy_version 1731049 (0.0006) [2023-12-28 07:42:09,329][106226] Updated weights for policy 0, policy_version 1731059 (0.0010) [2023-12-28 07:42:09,399][106226] Updated weights for policy 0, policy_version 1731069 (0.0009) [2023-12-28 07:42:09,467][106226] Updated weights for policy 0, policy_version 1731079 (0.0009) [2023-12-28 07:42:09,869][106225] Updated weights for policy 1, policy_version 1735247 (0.0008) [2023-12-28 07:42:09,932][106225] Updated weights for policy 1, policy_version 1735257 (0.0008) [2023-12-28 07:42:09,993][106225] Updated weights for policy 1, policy_version 1735267 (0.0007) [2023-12-28 07:42:10,250][106226] Updated weights for policy 0, policy_version 1731089 (0.0007) [2023-12-28 07:42:10,303][106226] Updated weights for policy 0, policy_version 1731099 (0.0006) [2023-12-28 07:42:10,367][106226] Updated weights for policy 0, policy_version 1731109 (0.0007) [2023-12-28 07:42:10,716][106225] Updated weights for policy 1, policy_version 1735277 (0.0007) [2023-12-28 07:42:10,771][106225] Updated weights for policy 1, policy_version 1735287 (0.0008) [2023-12-28 07:42:10,829][106225] Updated weights for policy 1, policy_version 1735297 (0.0008) [2023-12-28 07:42:11,129][106226] Updated weights for policy 0, policy_version 1731119 (0.0009) [2023-12-28 07:42:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 887537664. Throughput: 0: 9966.1, 1: 9979.3. Samples: 887512136. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:42:11,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.778')] [2023-12-28 07:42:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001735304_444293120.pth... [2023-12-28 07:42:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001734120_443990016.pth [2023-12-28 07:42:11,189][106226] Updated weights for policy 0, policy_version 1731129 (0.0009) [2023-12-28 07:42:11,253][106226] Updated weights for policy 0, policy_version 1731139 (0.0009) [2023-12-28 07:42:11,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001731144_443252736.pth... [2023-12-28 07:42:11,288][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001729992_442957824.pth [2023-12-28 07:42:11,623][106225] Updated weights for policy 1, policy_version 1735307 (0.0009) [2023-12-28 07:42:11,692][106225] Updated weights for policy 1, policy_version 1735317 (0.0008) [2023-12-28 07:42:11,760][106225] Updated weights for policy 1, policy_version 1735327 (0.0011) [2023-12-28 07:42:12,072][106226] Updated weights for policy 0, policy_version 1731149 (0.0008) [2023-12-28 07:42:12,140][106226] Updated weights for policy 0, policy_version 1731159 (0.0006) [2023-12-28 07:42:12,203][106226] Updated weights for policy 0, policy_version 1731169 (0.0006) [2023-12-28 07:42:12,487][106225] Updated weights for policy 1, policy_version 1735337 (0.0007) [2023-12-28 07:42:12,542][106225] Updated weights for policy 1, policy_version 1735347 (0.0006) [2023-12-28 07:42:12,600][106225] Updated weights for policy 1, policy_version 1735357 (0.0008) [2023-12-28 07:42:12,662][106225] Updated weights for policy 1, policy_version 1735367 (0.0008) [2023-12-28 07:42:12,951][106226] Updated weights for policy 0, policy_version 1731179 (0.0009) [2023-12-28 07:42:13,001][106226] Updated weights for policy 0, policy_version 1731189 (0.0010) [2023-12-28 07:42:13,060][106226] Updated weights for policy 0, policy_version 1731199 (0.0010) [2023-12-28 07:42:13,330][106225] Updated weights for policy 1, policy_version 1735377 (0.0008) [2023-12-28 07:42:13,386][106225] Updated weights for policy 1, policy_version 1735387 (0.0008) [2023-12-28 07:42:13,437][106225] Updated weights for policy 1, policy_version 1735397 (0.0008) [2023-12-28 07:42:13,769][106226] Updated weights for policy 0, policy_version 1731209 (0.0011) [2023-12-28 07:42:13,815][106226] Updated weights for policy 0, policy_version 1731219 (0.0010) [2023-12-28 07:42:13,861][106226] Updated weights for policy 0, policy_version 1731229 (0.0010) [2023-12-28 07:42:13,917][106226] Updated weights for policy 0, policy_version 1731239 (0.0010) [2023-12-28 07:42:14,189][106225] Updated weights for policy 1, policy_version 1735407 (0.0008) [2023-12-28 07:42:14,246][106225] Updated weights for policy 1, policy_version 1735417 (0.0008) [2023-12-28 07:42:14,300][106225] Updated weights for policy 1, policy_version 1735427 (0.0007) [2023-12-28 07:42:14,640][106226] Updated weights for policy 0, policy_version 1731249 (0.0010) [2023-12-28 07:42:14,703][106226] Updated weights for policy 0, policy_version 1731259 (0.0011) [2023-12-28 07:42:14,767][106226] Updated weights for policy 0, policy_version 1731269 (0.0006) [2023-12-28 07:42:15,027][106225] Updated weights for policy 1, policy_version 1735437 (0.0008) [2023-12-28 07:42:15,093][106225] Updated weights for policy 1, policy_version 1735447 (0.0008) [2023-12-28 07:42:15,155][106225] Updated weights for policy 1, policy_version 1735457 (0.0008) [2023-12-28 07:42:15,516][106226] Updated weights for policy 0, policy_version 1731279 (0.0010) [2023-12-28 07:42:15,573][106226] Updated weights for policy 0, policy_version 1731289 (0.0010) [2023-12-28 07:42:15,626][106226] Updated weights for policy 0, policy_version 1731299 (0.0010) [2023-12-28 07:42:15,849][106225] Updated weights for policy 1, policy_version 1735467 (0.0008) [2023-12-28 07:42:15,903][106225] Updated weights for policy 1, policy_version 1735477 (0.0008) [2023-12-28 07:42:15,965][106225] Updated weights for policy 1, policy_version 1735487 (0.0006) [2023-12-28 07:42:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 887635968. Throughput: 0: 9784.3, 1: 9921.5. Samples: 887624476. Policy #0 lag: (min: 30.0, avg: 36.7, max: 62.0) [2023-12-28 07:42:16,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-5.067')] [2023-12-28 07:42:16,346][106226] Updated weights for policy 0, policy_version 1731309 (0.0011) [2023-12-28 07:42:16,399][106226] Updated weights for policy 0, policy_version 1731319 (0.0010) [2023-12-28 07:42:16,455][106226] Updated weights for policy 0, policy_version 1731329 (0.0010) [2023-12-28 07:42:16,562][106225] Updated weights for policy 1, policy_version 1735497 (0.0005) [2023-12-28 07:42:16,621][106225] Updated weights for policy 1, policy_version 1735508 (0.0009) [2023-12-28 07:42:16,680][106225] Updated weights for policy 1, policy_version 1735518 (0.0009) [2023-12-28 07:42:16,745][106225] Updated weights for policy 1, policy_version 1735528 (0.0009) [2023-12-28 07:42:17,016][106226] Updated weights for policy 0, policy_version 1731339 (0.0006) [2023-12-28 07:42:17,072][106226] Updated weights for policy 0, policy_version 1731349 (0.0005) [2023-12-28 07:42:17,132][106226] Updated weights for policy 0, policy_version 1731359 (0.0005) [2023-12-28 07:42:17,372][106225] Updated weights for policy 1, policy_version 1735538 (0.0005) [2023-12-28 07:42:17,426][106225] Updated weights for policy 1, policy_version 1735548 (0.0005) [2023-12-28 07:42:17,482][106225] Updated weights for policy 1, policy_version 1735558 (0.0006) [2023-12-28 07:42:17,777][106226] Updated weights for policy 0, policy_version 1731369 (0.0011) [2023-12-28 07:42:17,829][106226] Updated weights for policy 0, policy_version 1731379 (0.0007) [2023-12-28 07:42:17,886][106226] Updated weights for policy 0, policy_version 1731389 (0.0005) [2023-12-28 07:42:17,943][106226] Updated weights for policy 0, policy_version 1731399 (0.0007) [2023-12-28 07:42:18,004][106225] Updated weights for policy 1, policy_version 1735568 (0.0006) [2023-12-28 07:42:18,058][106225] Updated weights for policy 1, policy_version 1735578 (0.0007) [2023-12-28 07:42:18,111][106225] Updated weights for policy 1, policy_version 1735588 (0.0008) [2023-12-28 07:42:18,549][106226] Updated weights for policy 0, policy_version 1731409 (0.0007) [2023-12-28 07:42:18,617][106226] Updated weights for policy 0, policy_version 1731419 (0.0010) [2023-12-28 07:42:18,680][106226] Updated weights for policy 0, policy_version 1731429 (0.0009) [2023-12-28 07:42:18,776][106225] Updated weights for policy 1, policy_version 1735598 (0.0006) [2023-12-28 07:42:18,824][106225] Updated weights for policy 1, policy_version 1735608 (0.0005) [2023-12-28 07:42:18,871][106225] Updated weights for policy 1, policy_version 1735618 (0.0007) [2023-12-28 07:42:19,369][106226] Updated weights for policy 0, policy_version 1731439 (0.0009) [2023-12-28 07:42:19,433][106226] Updated weights for policy 0, policy_version 1731449 (0.0010) [2023-12-28 07:42:19,496][106226] Updated weights for policy 0, policy_version 1731459 (0.0008) [2023-12-28 07:42:19,560][106225] Updated weights for policy 1, policy_version 1735628 (0.0007) [2023-12-28 07:42:19,618][106225] Updated weights for policy 1, policy_version 1735638 (0.0006) [2023-12-28 07:42:19,684][106225] Updated weights for policy 1, policy_version 1735648 (0.0006) [2023-12-28 07:42:20,305][106226] Updated weights for policy 0, policy_version 1731469 (0.0008) [2023-12-28 07:42:20,360][106225] Updated weights for policy 1, policy_version 1735658 (0.0006) [2023-12-28 07:42:20,374][106226] Updated weights for policy 0, policy_version 1731479 (0.0007) [2023-12-28 07:42:20,415][106225] Updated weights for policy 1, policy_version 1735668 (0.0007) [2023-12-28 07:42:20,441][106226] Updated weights for policy 0, policy_version 1731489 (0.0007) [2023-12-28 07:42:20,474][106225] Updated weights for policy 1, policy_version 1735678 (0.0006) [2023-12-28 07:42:20,538][106225] Updated weights for policy 1, policy_version 1735688 (0.0006) [2023-12-28 07:42:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 887734272. Throughput: 0: 9773.2, 1: 10096.1. Samples: 887748472. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:21,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.848')] [2023-12-28 07:42:21,198][106226] Updated weights for policy 0, policy_version 1731499 (0.0009) [2023-12-28 07:42:21,267][106226] Updated weights for policy 0, policy_version 1731509 (0.0011) [2023-12-28 07:42:21,304][106225] Updated weights for policy 1, policy_version 1735698 (0.0007) [2023-12-28 07:42:21,335][106226] Updated weights for policy 0, policy_version 1731519 (0.0011) [2023-12-28 07:42:21,369][106225] Updated weights for policy 1, policy_version 1735708 (0.0008) [2023-12-28 07:42:21,427][106225] Updated weights for policy 1, policy_version 1735718 (0.0009) [2023-12-28 07:42:22,135][106226] Updated weights for policy 0, policy_version 1731529 (0.0013) [2023-12-28 07:42:22,197][106226] Updated weights for policy 0, policy_version 1731539 (0.0011) [2023-12-28 07:42:22,244][106225] Updated weights for policy 1, policy_version 1735728 (0.0008) [2023-12-28 07:42:22,261][106226] Updated weights for policy 0, policy_version 1731549 (0.0010) [2023-12-28 07:42:22,302][106225] Updated weights for policy 1, policy_version 1735738 (0.0009) [2023-12-28 07:42:22,321][106226] Updated weights for policy 0, policy_version 1731559 (0.0008) [2023-12-28 07:42:22,371][106225] Updated weights for policy 1, policy_version 1735748 (0.0009) [2023-12-28 07:42:23,089][106225] Updated weights for policy 1, policy_version 1735758 (0.0009) [2023-12-28 07:42:23,104][106226] Updated weights for policy 0, policy_version 1731569 (0.0009) [2023-12-28 07:42:23,140][106225] Updated weights for policy 1, policy_version 1735768 (0.0010) [2023-12-28 07:42:23,166][106226] Updated weights for policy 0, policy_version 1731579 (0.0008) [2023-12-28 07:42:23,196][106225] Updated weights for policy 1, policy_version 1735778 (0.0011) [2023-12-28 07:42:23,222][106226] Updated weights for policy 0, policy_version 1731589 (0.0008) [2023-12-28 07:42:23,885][106225] Updated weights for policy 1, policy_version 1735788 (0.0009) [2023-12-28 07:42:23,939][106225] Updated weights for policy 1, policy_version 1735798 (0.0006) [2023-12-28 07:42:23,944][106226] Updated weights for policy 0, policy_version 1731599 (0.0008) [2023-12-28 07:42:23,992][106225] Updated weights for policy 1, policy_version 1735808 (0.0005) [2023-12-28 07:42:24,006][106226] Updated weights for policy 0, policy_version 1731609 (0.0007) [2023-12-28 07:42:24,058][106226] Updated weights for policy 0, policy_version 1731619 (0.0008) [2023-12-28 07:42:24,584][106225] Updated weights for policy 1, policy_version 1735818 (0.0006) [2023-12-28 07:42:24,647][106225] Updated weights for policy 1, policy_version 1735828 (0.0005) [2023-12-28 07:42:24,709][106226] Updated weights for policy 0, policy_version 1731629 (0.0006) [2023-12-28 07:42:24,709][106225] Updated weights for policy 1, policy_version 1735838 (0.0006) [2023-12-28 07:42:24,764][106226] Updated weights for policy 0, policy_version 1731639 (0.0005) [2023-12-28 07:42:24,772][106225] Updated weights for policy 1, policy_version 1735848 (0.0006) [2023-12-28 07:42:24,813][106226] Updated weights for policy 0, policy_version 1731649 (0.0005) [2023-12-28 07:42:25,299][106225] Updated weights for policy 1, policy_version 1735858 (0.0006) [2023-12-28 07:42:25,358][106225] Updated weights for policy 1, policy_version 1735868 (0.0008) [2023-12-28 07:42:25,377][106226] Updated weights for policy 0, policy_version 1731659 (0.0006) [2023-12-28 07:42:25,425][106225] Updated weights for policy 1, policy_version 1735878 (0.0007) [2023-12-28 07:42:25,430][106226] Updated weights for policy 0, policy_version 1731669 (0.0007) [2023-12-28 07:42:25,479][106226] Updated weights for policy 0, policy_version 1731679 (0.0009) [2023-12-28 07:42:26,115][106225] Updated weights for policy 1, policy_version 1735888 (0.0010) [2023-12-28 07:42:26,120][106226] Updated weights for policy 0, policy_version 1731689 (0.0010) [2023-12-28 07:42:26,165][106225] Updated weights for policy 1, policy_version 1735898 (0.0010) [2023-12-28 07:42:26,173][106226] Updated weights for policy 0, policy_version 1731699 (0.0010) [2023-12-28 07:42:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 887832576. Throughput: 0: 9718.0, 1: 10064.0. Samples: 887803192. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:26,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.726')] [2023-12-28 07:42:26,222][106225] Updated weights for policy 1, policy_version 1735908 (0.0010) [2023-12-28 07:42:26,226][106226] Updated weights for policy 0, policy_version 1731709 (0.0010) [2023-12-28 07:42:26,237][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001735912_444448768.pth... [2023-12-28 07:42:26,241][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001734728_444145664.pth [2023-12-28 07:42:26,281][106226] Updated weights for policy 0, policy_version 1731719 (0.0011) [2023-12-28 07:42:26,285][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001731720_443400192.pth... [2023-12-28 07:42:26,289][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001730568_443105280.pth [2023-12-28 07:42:26,970][106225] Updated weights for policy 1, policy_version 1735918 (0.0007) [2023-12-28 07:42:26,970][106226] Updated weights for policy 0, policy_version 1731729 (0.0010) [2023-12-28 07:42:27,030][106225] Updated weights for policy 1, policy_version 1735928 (0.0008) [2023-12-28 07:42:27,030][106226] Updated weights for policy 0, policy_version 1731739 (0.0010) [2023-12-28 07:42:27,087][106225] Updated weights for policy 1, policy_version 1735938 (0.0010) [2023-12-28 07:42:27,092][106226] Updated weights for policy 0, policy_version 1731749 (0.0010) [2023-12-28 07:42:27,692][106225] Updated weights for policy 1, policy_version 1735948 (0.0008) [2023-12-28 07:42:27,747][106225] Updated weights for policy 1, policy_version 1735958 (0.0007) [2023-12-28 07:42:27,801][106226] Updated weights for policy 0, policy_version 1731759 (0.0010) [2023-12-28 07:42:27,809][106225] Updated weights for policy 1, policy_version 1735968 (0.0010) [2023-12-28 07:42:27,847][106226] Updated weights for policy 0, policy_version 1731769 (0.0010) [2023-12-28 07:42:27,893][106226] Updated weights for policy 0, policy_version 1731779 (0.0010) [2023-12-28 07:42:28,353][106225] Updated weights for policy 1, policy_version 1735978 (0.0010) [2023-12-28 07:42:28,407][106225] Updated weights for policy 1, policy_version 1735988 (0.0010) [2023-12-28 07:42:28,470][106225] Updated weights for policy 1, policy_version 1735998 (0.0010) [2023-12-28 07:42:28,551][106225] Updated weights for policy 1, policy_version 1736008 (0.0010) [2023-12-28 07:42:28,622][106226] Updated weights for policy 0, policy_version 1731789 (0.0010) [2023-12-28 07:42:28,669][106226] Updated weights for policy 0, policy_version 1731799 (0.0010) [2023-12-28 07:42:28,715][106226] Updated weights for policy 0, policy_version 1731809 (0.0010) [2023-12-28 07:42:29,264][106225] Updated weights for policy 1, policy_version 1736018 (0.0008) [2023-12-28 07:42:29,324][106225] Updated weights for policy 1, policy_version 1736028 (0.0008) [2023-12-28 07:42:29,401][106225] Updated weights for policy 1, policy_version 1736038 (0.0008) [2023-12-28 07:42:29,479][106226] Updated weights for policy 0, policy_version 1731819 (0.0010) [2023-12-28 07:42:29,529][106226] Updated weights for policy 0, policy_version 1731829 (0.0010) [2023-12-28 07:42:29,586][106226] Updated weights for policy 0, policy_version 1731839 (0.0010) [2023-12-28 07:42:30,100][106225] Updated weights for policy 1, policy_version 1736048 (0.0008) [2023-12-28 07:42:30,161][106225] Updated weights for policy 1, policy_version 1736058 (0.0008) [2023-12-28 07:42:30,223][106225] Updated weights for policy 1, policy_version 1736068 (0.0008) [2023-12-28 07:42:30,292][106226] Updated weights for policy 0, policy_version 1731849 (0.0010) [2023-12-28 07:42:30,359][106226] Updated weights for policy 0, policy_version 1731859 (0.0007) [2023-12-28 07:42:30,423][106226] Updated weights for policy 0, policy_version 1731869 (0.0005) [2023-12-28 07:42:30,481][106226] Updated weights for policy 0, policy_version 1731879 (0.0005) [2023-12-28 07:42:30,869][106225] Updated weights for policy 1, policy_version 1736078 (0.0009) [2023-12-28 07:42:30,911][106225] Updated weights for policy 1, policy_version 1736088 (0.0008) [2023-12-28 07:42:30,963][106225] Updated weights for policy 1, policy_version 1736098 (0.0006) [2023-12-28 07:42:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 887939072. Throughput: 0: 9769.1, 1: 10201.6. Samples: 887929356. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:31,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.777')] [2023-12-28 07:42:31,179][106226] Updated weights for policy 0, policy_version 1731889 (0.0009) [2023-12-28 07:42:31,239][106226] Updated weights for policy 0, policy_version 1731899 (0.0007) [2023-12-28 07:42:31,298][106226] Updated weights for policy 0, policy_version 1731909 (0.0008) [2023-12-28 07:42:31,694][106225] Updated weights for policy 1, policy_version 1736108 (0.0007) [2023-12-28 07:42:31,762][106225] Updated weights for policy 1, policy_version 1736118 (0.0009) [2023-12-28 07:42:31,824][106225] Updated weights for policy 1, policy_version 1736128 (0.0007) [2023-12-28 07:42:32,014][106226] Updated weights for policy 0, policy_version 1731919 (0.0006) [2023-12-28 07:42:32,068][106226] Updated weights for policy 0, policy_version 1731929 (0.0006) [2023-12-28 07:42:32,124][106226] Updated weights for policy 0, policy_version 1731939 (0.0007) [2023-12-28 07:42:32,573][106225] Updated weights for policy 1, policy_version 1736138 (0.0009) [2023-12-28 07:42:32,635][106225] Updated weights for policy 1, policy_version 1736148 (0.0008) [2023-12-28 07:42:32,693][106225] Updated weights for policy 1, policy_version 1736158 (0.0008) [2023-12-28 07:42:32,755][106225] Updated weights for policy 1, policy_version 1736168 (0.0008) [2023-12-28 07:42:32,788][106226] Updated weights for policy 0, policy_version 1731949 (0.0007) [2023-12-28 07:42:32,845][106226] Updated weights for policy 0, policy_version 1731959 (0.0010) [2023-12-28 07:42:32,891][106226] Updated weights for policy 0, policy_version 1731969 (0.0008) [2023-12-28 07:42:33,406][106225] Updated weights for policy 1, policy_version 1736178 (0.0009) [2023-12-28 07:42:33,459][106225] Updated weights for policy 1, policy_version 1736188 (0.0007) [2023-12-28 07:42:33,521][106225] Updated weights for policy 1, policy_version 1736198 (0.0007) [2023-12-28 07:42:33,644][106226] Updated weights for policy 0, policy_version 1731979 (0.0008) [2023-12-28 07:42:33,691][106226] Updated weights for policy 0, policy_version 1731989 (0.0008) [2023-12-28 07:42:33,749][106226] Updated weights for policy 0, policy_version 1731999 (0.0009) [2023-12-28 07:42:34,184][106225] Updated weights for policy 1, policy_version 1736208 (0.0008) [2023-12-28 07:42:34,239][106225] Updated weights for policy 1, policy_version 1736218 (0.0006) [2023-12-28 07:42:34,308][106225] Updated weights for policy 1, policy_version 1736228 (0.0007) [2023-12-28 07:42:34,509][106226] Updated weights for policy 0, policy_version 1732009 (0.0009) [2023-12-28 07:42:34,567][106226] Updated weights for policy 0, policy_version 1732019 (0.0009) [2023-12-28 07:42:34,634][106226] Updated weights for policy 0, policy_version 1732029 (0.0008) [2023-12-28 07:42:34,692][106226] Updated weights for policy 0, policy_version 1732039 (0.0011) [2023-12-28 07:42:34,956][106225] Updated weights for policy 1, policy_version 1736238 (0.0007) [2023-12-28 07:42:35,005][106225] Updated weights for policy 1, policy_version 1736248 (0.0006) [2023-12-28 07:42:35,053][106225] Updated weights for policy 1, policy_version 1736258 (0.0008) [2023-12-28 07:42:35,321][106226] Updated weights for policy 0, policy_version 1732049 (0.0011) [2023-12-28 07:42:35,380][106226] Updated weights for policy 0, policy_version 1732059 (0.0010) [2023-12-28 07:42:35,440][106226] Updated weights for policy 0, policy_version 1732069 (0.0010) [2023-12-28 07:42:35,714][106225] Updated weights for policy 1, policy_version 1736268 (0.0006) [2023-12-28 07:42:35,762][106225] Updated weights for policy 1, policy_version 1736278 (0.0006) [2023-12-28 07:42:35,810][106225] Updated weights for policy 1, policy_version 1736288 (0.0008) [2023-12-28 07:42:36,171][106226] Updated weights for policy 0, policy_version 1732079 (0.0009) [2023-12-28 07:42:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 888037376. Throughput: 0: 9742.1, 1: 10173.9. Samples: 888048520. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:36,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-5.139')] [2023-12-28 07:42:36,236][106226] Updated weights for policy 0, policy_version 1732089 (0.0008) [2023-12-28 07:42:36,298][106226] Updated weights for policy 0, policy_version 1732099 (0.0008) [2023-12-28 07:42:36,514][106225] Updated weights for policy 1, policy_version 1736298 (0.0007) [2023-12-28 07:42:36,568][106225] Updated weights for policy 1, policy_version 1736308 (0.0010) [2023-12-28 07:42:36,622][106225] Updated weights for policy 1, policy_version 1736318 (0.0010) [2023-12-28 07:42:36,680][106225] Updated weights for policy 1, policy_version 1736328 (0.0011) [2023-12-28 07:42:37,032][106226] Updated weights for policy 0, policy_version 1732109 (0.0009) [2023-12-28 07:42:37,094][106226] Updated weights for policy 0, policy_version 1732119 (0.0010) [2023-12-28 07:42:37,157][106226] Updated weights for policy 0, policy_version 1732129 (0.0009) [2023-12-28 07:42:37,333][106225] Updated weights for policy 1, policy_version 1736338 (0.0010) [2023-12-28 07:42:37,389][106225] Updated weights for policy 1, policy_version 1736348 (0.0010) [2023-12-28 07:42:37,453][106225] Updated weights for policy 1, policy_version 1736358 (0.0010) [2023-12-28 07:42:37,941][106226] Updated weights for policy 0, policy_version 1732139 (0.0010) [2023-12-28 07:42:38,011][106226] Updated weights for policy 0, policy_version 1732149 (0.0010) [2023-12-28 07:42:38,030][106225] Updated weights for policy 1, policy_version 1736368 (0.0010) [2023-12-28 07:42:38,072][106226] Updated weights for policy 0, policy_version 1732159 (0.0010) [2023-12-28 07:42:38,090][106225] Updated weights for policy 1, policy_version 1736378 (0.0010) [2023-12-28 07:42:38,140][106225] Updated weights for policy 1, policy_version 1736388 (0.0010) [2023-12-28 07:42:38,768][106226] Updated weights for policy 0, policy_version 1732169 (0.0010) [2023-12-28 07:42:38,798][106225] Updated weights for policy 1, policy_version 1736398 (0.0009) [2023-12-28 07:42:38,819][106226] Updated weights for policy 0, policy_version 1732179 (0.0010) [2023-12-28 07:42:38,858][106225] Updated weights for policy 1, policy_version 1736408 (0.0007) [2023-12-28 07:42:38,883][106226] Updated weights for policy 0, policy_version 1732189 (0.0010) [2023-12-28 07:42:38,916][106225] Updated weights for policy 1, policy_version 1736418 (0.0006) [2023-12-28 07:42:38,950][106226] Updated weights for policy 0, policy_version 1732199 (0.0010) [2023-12-28 07:42:39,522][106225] Updated weights for policy 1, policy_version 1736428 (0.0007) [2023-12-28 07:42:39,585][106225] Updated weights for policy 1, policy_version 1736438 (0.0008) [2023-12-28 07:42:39,651][106225] Updated weights for policy 1, policy_version 1736448 (0.0008) [2023-12-28 07:42:39,724][106226] Updated weights for policy 0, policy_version 1732209 (0.0011) [2023-12-28 07:42:39,782][106226] Updated weights for policy 0, policy_version 1732219 (0.0011) [2023-12-28 07:42:39,845][106226] Updated weights for policy 0, policy_version 1732229 (0.0010) [2023-12-28 07:42:40,441][106225] Updated weights for policy 1, policy_version 1736458 (0.0008) [2023-12-28 07:42:40,497][106225] Updated weights for policy 1, policy_version 1736468 (0.0008) [2023-12-28 07:42:40,554][106225] Updated weights for policy 1, policy_version 1736478 (0.0008) [2023-12-28 07:42:40,560][106226] Updated weights for policy 0, policy_version 1732239 (0.0007) [2023-12-28 07:42:40,617][106226] Updated weights for policy 0, policy_version 1732249 (0.0007) [2023-12-28 07:42:40,617][106225] Updated weights for policy 1, policy_version 1736488 (0.0006) [2023-12-28 07:42:40,676][106226] Updated weights for policy 0, policy_version 1732259 (0.0010) [2023-12-28 07:42:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 888135680. Throughput: 0: 9752.5, 1: 10185.7. Samples: 888107980. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:41,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-5.122')] [2023-12-28 07:42:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001732264_443539456.pth... [2023-12-28 07:42:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001736488_444596224.pth... [2023-12-28 07:42:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001731144_443252736.pth [2023-12-28 07:42:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001735304_444293120.pth [2023-12-28 07:42:41,347][106225] Updated weights for policy 1, policy_version 1736498 (0.0008) [2023-12-28 07:42:41,417][106225] Updated weights for policy 1, policy_version 1736508 (0.0008) [2023-12-28 07:42:41,444][106226] Updated weights for policy 0, policy_version 1732269 (0.0008) [2023-12-28 07:42:41,485][106225] Updated weights for policy 1, policy_version 1736518 (0.0007) [2023-12-28 07:42:41,507][106226] Updated weights for policy 0, policy_version 1732279 (0.0006) [2023-12-28 07:42:41,564][106226] Updated weights for policy 0, policy_version 1732289 (0.0006) [2023-12-28 07:42:42,253][106225] Updated weights for policy 1, policy_version 1736528 (0.0009) [2023-12-28 07:42:42,311][106226] Updated weights for policy 0, policy_version 1732299 (0.0008) [2023-12-28 07:42:42,326][106225] Updated weights for policy 1, policy_version 1736538 (0.0007) [2023-12-28 07:42:42,386][106226] Updated weights for policy 0, policy_version 1732309 (0.0008) [2023-12-28 07:42:42,393][106225] Updated weights for policy 1, policy_version 1736548 (0.0008) [2023-12-28 07:42:42,438][106226] Updated weights for policy 0, policy_version 1732319 (0.0008) [2023-12-28 07:42:43,083][106225] Updated weights for policy 1, policy_version 1736558 (0.0007) [2023-12-28 07:42:43,139][106225] Updated weights for policy 1, policy_version 1736568 (0.0009) [2023-12-28 07:42:43,180][106226] Updated weights for policy 0, policy_version 1732329 (0.0008) [2023-12-28 07:42:43,197][106225] Updated weights for policy 1, policy_version 1736578 (0.0008) [2023-12-28 07:42:43,234][106226] Updated weights for policy 0, policy_version 1732339 (0.0006) [2023-12-28 07:42:43,285][106226] Updated weights for policy 0, policy_version 1732349 (0.0008) [2023-12-28 07:42:43,343][106226] Updated weights for policy 0, policy_version 1732359 (0.0008) [2023-12-28 07:42:43,779][106225] Updated weights for policy 1, policy_version 1736588 (0.0006) [2023-12-28 07:42:43,837][106225] Updated weights for policy 1, policy_version 1736598 (0.0005) [2023-12-28 07:42:43,885][106225] Updated weights for policy 1, policy_version 1736608 (0.0005) [2023-12-28 07:42:44,087][106226] Updated weights for policy 0, policy_version 1732369 (0.0006) [2023-12-28 07:42:44,143][106226] Updated weights for policy 0, policy_version 1732379 (0.0005) [2023-12-28 07:42:44,203][106226] Updated weights for policy 0, policy_version 1732389 (0.0007) [2023-12-28 07:42:44,586][106225] Updated weights for policy 1, policy_version 1736618 (0.0006) [2023-12-28 07:42:44,639][106225] Updated weights for policy 1, policy_version 1736628 (0.0008) [2023-12-28 07:42:44,697][106225] Updated weights for policy 1, policy_version 1736638 (0.0008) [2023-12-28 07:42:44,750][106225] Updated weights for policy 1, policy_version 1736648 (0.0008) [2023-12-28 07:42:44,822][106226] Updated weights for policy 0, policy_version 1732399 (0.0007) [2023-12-28 07:42:44,891][106226] Updated weights for policy 0, policy_version 1732409 (0.0008) [2023-12-28 07:42:44,956][106226] Updated weights for policy 0, policy_version 1732419 (0.0008) [2023-12-28 07:42:45,539][106225] Updated weights for policy 1, policy_version 1736658 (0.0010) [2023-12-28 07:42:45,599][106225] Updated weights for policy 1, policy_version 1736668 (0.0010) [2023-12-28 07:42:45,617][106226] Updated weights for policy 0, policy_version 1732429 (0.0007) [2023-12-28 07:42:45,656][106225] Updated weights for policy 1, policy_version 1736678 (0.0010) [2023-12-28 07:42:45,667][106226] Updated weights for policy 0, policy_version 1732439 (0.0009) [2023-12-28 07:42:45,723][106226] Updated weights for policy 0, policy_version 1732449 (0.0007) [2023-12-28 07:42:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 888233984. Throughput: 0: 9752.2, 1: 10102.8. Samples: 888224124. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:46,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-5.201')] [2023-12-28 07:42:46,357][106225] Updated weights for policy 1, policy_version 1736688 (0.0010) [2023-12-28 07:42:46,403][106226] Updated weights for policy 0, policy_version 1732459 (0.0008) [2023-12-28 07:42:46,414][106225] Updated weights for policy 1, policy_version 1736698 (0.0009) [2023-12-28 07:42:46,465][106226] Updated weights for policy 0, policy_version 1732469 (0.0010) [2023-12-28 07:42:46,475][106225] Updated weights for policy 1, policy_version 1736708 (0.0008) [2023-12-28 07:42:46,518][106226] Updated weights for policy 0, policy_version 1732479 (0.0008) [2023-12-28 07:42:47,146][106225] Updated weights for policy 1, policy_version 1736718 (0.0007) [2023-12-28 07:42:47,182][106226] Updated weights for policy 0, policy_version 1732489 (0.0009) [2023-12-28 07:42:47,202][106225] Updated weights for policy 1, policy_version 1736728 (0.0008) [2023-12-28 07:42:47,239][106226] Updated weights for policy 0, policy_version 1732499 (0.0006) [2023-12-28 07:42:47,253][106225] Updated weights for policy 1, policy_version 1736738 (0.0005) [2023-12-28 07:42:47,301][106226] Updated weights for policy 0, policy_version 1732509 (0.0009) [2023-12-28 07:42:47,372][106226] Updated weights for policy 0, policy_version 1732519 (0.0009) [2023-12-28 07:42:47,959][106225] Updated weights for policy 1, policy_version 1736748 (0.0007) [2023-12-28 07:42:48,010][106225] Updated weights for policy 1, policy_version 1736758 (0.0008) [2023-12-28 07:42:48,065][106225] Updated weights for policy 1, policy_version 1736768 (0.0009) [2023-12-28 07:42:48,071][106226] Updated weights for policy 0, policy_version 1732529 (0.0008) [2023-12-28 07:42:48,129][106226] Updated weights for policy 0, policy_version 1732539 (0.0009) [2023-12-28 07:42:48,195][106226] Updated weights for policy 0, policy_version 1732549 (0.0005) [2023-12-28 07:42:48,801][106226] Updated weights for policy 0, policy_version 1732559 (0.0008) [2023-12-28 07:42:48,833][106225] Updated weights for policy 1, policy_version 1736778 (0.0006) [2023-12-28 07:42:48,857][106226] Updated weights for policy 0, policy_version 1732569 (0.0009) [2023-12-28 07:42:48,893][106225] Updated weights for policy 1, policy_version 1736788 (0.0007) [2023-12-28 07:42:48,913][106226] Updated weights for policy 0, policy_version 1732579 (0.0009) [2023-12-28 07:42:48,945][106225] Updated weights for policy 1, policy_version 1736798 (0.0007) [2023-12-28 07:42:48,996][106225] Updated weights for policy 1, policy_version 1736808 (0.0007) [2023-12-28 07:42:49,664][106226] Updated weights for policy 0, policy_version 1732589 (0.0007) [2023-12-28 07:42:49,722][106225] Updated weights for policy 1, policy_version 1736818 (0.0008) [2023-12-28 07:42:49,728][106226] Updated weights for policy 0, policy_version 1732599 (0.0006) [2023-12-28 07:42:49,780][106225] Updated weights for policy 1, policy_version 1736828 (0.0007) [2023-12-28 07:42:49,789][106226] Updated weights for policy 0, policy_version 1732609 (0.0007) [2023-12-28 07:42:49,845][106225] Updated weights for policy 1, policy_version 1736838 (0.0008) [2023-12-28 07:42:50,414][106226] Updated weights for policy 0, policy_version 1732619 (0.0010) [2023-12-28 07:42:50,488][106226] Updated weights for policy 0, policy_version 1732629 (0.0010) [2023-12-28 07:42:50,527][106225] Updated weights for policy 1, policy_version 1736848 (0.0006) [2023-12-28 07:42:50,552][106226] Updated weights for policy 0, policy_version 1732639 (0.0011) [2023-12-28 07:42:50,590][106225] Updated weights for policy 1, policy_version 1736858 (0.0007) [2023-12-28 07:42:50,648][106225] Updated weights for policy 1, policy_version 1736868 (0.0007) [2023-12-28 07:42:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 888332288. Throughput: 0: 9766.9, 1: 10011.5. Samples: 888343220. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:51,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-4.821')] [2023-12-28 07:42:51,279][106226] Updated weights for policy 0, policy_version 1732649 (0.0008) [2023-12-28 07:42:51,349][106226] Updated weights for policy 0, policy_version 1732659 (0.0007) [2023-12-28 07:42:51,379][106225] Updated weights for policy 1, policy_version 1736878 (0.0010) [2023-12-28 07:42:51,414][106226] Updated weights for policy 0, policy_version 1732669 (0.0011) [2023-12-28 07:42:51,437][106225] Updated weights for policy 1, policy_version 1736888 (0.0008) [2023-12-28 07:42:51,482][106226] Updated weights for policy 0, policy_version 1732679 (0.0007) [2023-12-28 07:42:51,496][106225] Updated weights for policy 1, policy_version 1736898 (0.0006) [2023-12-28 07:42:52,162][106225] Updated weights for policy 1, policy_version 1736908 (0.0008) [2023-12-28 07:42:52,168][106226] Updated weights for policy 0, policy_version 1732689 (0.0007) [2023-12-28 07:42:52,217][106226] Updated weights for policy 0, policy_version 1732699 (0.0007) [2023-12-28 07:42:52,223][106225] Updated weights for policy 1, policy_version 1736918 (0.0010) [2023-12-28 07:42:52,272][106226] Updated weights for policy 0, policy_version 1732709 (0.0006) [2023-12-28 07:42:52,286][106225] Updated weights for policy 1, policy_version 1736928 (0.0009) [2023-12-28 07:42:52,986][106225] Updated weights for policy 1, policy_version 1736938 (0.0007) [2023-12-28 07:42:53,040][106225] Updated weights for policy 1, policy_version 1736948 (0.0005) [2023-12-28 07:42:53,057][106226] Updated weights for policy 0, policy_version 1732719 (0.0008) [2023-12-28 07:42:53,099][106225] Updated weights for policy 1, policy_version 1736958 (0.0006) [2023-12-28 07:42:53,117][106226] Updated weights for policy 0, policy_version 1732729 (0.0008) [2023-12-28 07:42:53,157][106225] Updated weights for policy 1, policy_version 1736968 (0.0006) [2023-12-28 07:42:53,167][106226] Updated weights for policy 0, policy_version 1732739 (0.0007) [2023-12-28 07:42:53,765][106225] Updated weights for policy 1, policy_version 1736978 (0.0007) [2023-12-28 07:42:53,812][106225] Updated weights for policy 1, policy_version 1736988 (0.0006) [2023-12-28 07:42:53,862][106225] Updated weights for policy 1, policy_version 1736998 (0.0009) [2023-12-28 07:42:53,948][106226] Updated weights for policy 0, policy_version 1732749 (0.0009) [2023-12-28 07:42:54,000][106226] Updated weights for policy 0, policy_version 1732759 (0.0008) [2023-12-28 07:42:54,058][106226] Updated weights for policy 0, policy_version 1732769 (0.0008) [2023-12-28 07:42:54,567][106225] Updated weights for policy 1, policy_version 1737008 (0.0006) [2023-12-28 07:42:54,617][106225] Updated weights for policy 1, policy_version 1737018 (0.0006) [2023-12-28 07:42:54,668][106225] Updated weights for policy 1, policy_version 1737028 (0.0008) [2023-12-28 07:42:54,723][106226] Updated weights for policy 0, policy_version 1732779 (0.0008) [2023-12-28 07:42:54,782][106226] Updated weights for policy 0, policy_version 1732789 (0.0008) [2023-12-28 07:42:54,828][106226] Updated weights for policy 0, policy_version 1732799 (0.0009) [2023-12-28 07:42:55,381][106225] Updated weights for policy 1, policy_version 1737038 (0.0008) [2023-12-28 07:42:55,425][106225] Updated weights for policy 1, policy_version 1737048 (0.0008) [2023-12-28 07:42:55,479][106225] Updated weights for policy 1, policy_version 1737058 (0.0008) [2023-12-28 07:42:55,546][106226] Updated weights for policy 0, policy_version 1732809 (0.0008) [2023-12-28 07:42:55,601][106226] Updated weights for policy 0, policy_version 1732819 (0.0006) [2023-12-28 07:42:55,658][106226] Updated weights for policy 0, policy_version 1732829 (0.0006) [2023-12-28 07:42:55,721][106226] Updated weights for policy 0, policy_version 1732839 (0.0010) [2023-12-28 07:42:56,094][106225] Updated weights for policy 1, policy_version 1737068 (0.0007) [2023-12-28 07:42:56,150][106225] Updated weights for policy 1, policy_version 1737078 (0.0007) [2023-12-28 07:42:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 888430592. Throughput: 0: 9717.7, 1: 10050.6. Samples: 888401708. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:42:56,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.651')] [2023-12-28 07:42:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001732840_443686912.pth... [2023-12-28 07:42:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001731720_443400192.pth [2023-12-28 07:42:56,217][106225] Updated weights for policy 1, policy_version 1737088 (0.0006) [2023-12-28 07:42:56,263][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001737096_444751872.pth... [2023-12-28 07:42:56,267][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001735912_444448768.pth [2023-12-28 07:42:56,325][106226] Updated weights for policy 0, policy_version 1732849 (0.0008) [2023-12-28 07:42:56,386][106226] Updated weights for policy 0, policy_version 1732859 (0.0005) [2023-12-28 07:42:56,445][106226] Updated weights for policy 0, policy_version 1732869 (0.0005) [2023-12-28 07:42:56,851][106225] Updated weights for policy 1, policy_version 1737098 (0.0010) [2023-12-28 07:42:56,897][106225] Updated weights for policy 1, policy_version 1737108 (0.0010) [2023-12-28 07:42:56,954][106225] Updated weights for policy 1, policy_version 1737118 (0.0007) [2023-12-28 07:42:56,967][106226] Updated weights for policy 0, policy_version 1732879 (0.0007) [2023-12-28 07:42:56,999][106225] Updated weights for policy 1, policy_version 1737128 (0.0005) [2023-12-28 07:42:57,022][106226] Updated weights for policy 0, policy_version 1732889 (0.0009) [2023-12-28 07:42:57,075][106226] Updated weights for policy 0, policy_version 1732899 (0.0007) [2023-12-28 07:42:57,655][106225] Updated weights for policy 1, policy_version 1737138 (0.0006) [2023-12-28 07:42:57,681][106226] Updated weights for policy 0, policy_version 1732909 (0.0008) [2023-12-28 07:42:57,712][106225] Updated weights for policy 1, policy_version 1737148 (0.0008) [2023-12-28 07:42:57,737][106226] Updated weights for policy 0, policy_version 1732919 (0.0007) [2023-12-28 07:42:57,762][106225] Updated weights for policy 1, policy_version 1737158 (0.0006) [2023-12-28 07:42:57,789][106226] Updated weights for policy 0, policy_version 1732929 (0.0007) [2023-12-28 07:42:58,482][106225] Updated weights for policy 1, policy_version 1737168 (0.0007) [2023-12-28 07:42:58,546][106225] Updated weights for policy 1, policy_version 1737178 (0.0007) [2023-12-28 07:42:58,548][106226] Updated weights for policy 0, policy_version 1732939 (0.0008) [2023-12-28 07:42:58,607][106225] Updated weights for policy 1, policy_version 1737188 (0.0007) [2023-12-28 07:42:58,615][106226] Updated weights for policy 0, policy_version 1732949 (0.0008) [2023-12-28 07:42:58,677][106226] Updated weights for policy 0, policy_version 1732959 (0.0008) [2023-12-28 07:42:59,461][106225] Updated weights for policy 1, policy_version 1737198 (0.0007) [2023-12-28 07:42:59,517][106226] Updated weights for policy 0, policy_version 1732969 (0.0008) [2023-12-28 07:42:59,522][106225] Updated weights for policy 1, policy_version 1737208 (0.0006) [2023-12-28 07:42:59,572][106226] Updated weights for policy 0, policy_version 1732979 (0.0008) [2023-12-28 07:42:59,584][106225] Updated weights for policy 1, policy_version 1737218 (0.0006) [2023-12-28 07:42:59,632][106226] Updated weights for policy 0, policy_version 1732989 (0.0008) [2023-12-28 07:42:59,698][106226] Updated weights for policy 0, policy_version 1732999 (0.0007) [2023-12-28 07:43:00,263][106225] Updated weights for policy 1, policy_version 1737228 (0.0006) [2023-12-28 07:43:00,313][106225] Updated weights for policy 1, policy_version 1737238 (0.0007) [2023-12-28 07:43:00,368][106225] Updated weights for policy 1, policy_version 1737248 (0.0007) [2023-12-28 07:43:00,451][106226] Updated weights for policy 0, policy_version 1733009 (0.0008) [2023-12-28 07:43:00,513][106226] Updated weights for policy 0, policy_version 1733019 (0.0009) [2023-12-28 07:43:00,574][106226] Updated weights for policy 0, policy_version 1733029 (0.0009) [2023-12-28 07:43:00,937][106225] Updated weights for policy 1, policy_version 1737258 (0.0006) [2023-12-28 07:43:00,986][106225] Updated weights for policy 1, policy_version 1737268 (0.0007) [2023-12-28 07:43:01,048][106225] Updated weights for policy 1, policy_version 1737278 (0.0008) [2023-12-28 07:43:01,101][106225] Updated weights for policy 1, policy_version 1737288 (0.0008) [2023-12-28 07:43:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 888537088. Throughput: 0: 9847.7, 1: 10133.5. Samples: 888523632. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:01,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.744')] [2023-12-28 07:43:01,246][106226] Updated weights for policy 0, policy_version 1733039 (0.0009) [2023-12-28 07:43:01,318][106226] Updated weights for policy 0, policy_version 1733049 (0.0011) [2023-12-28 07:43:01,395][106226] Updated weights for policy 0, policy_version 1733059 (0.0010) [2023-12-28 07:43:01,882][106225] Updated weights for policy 1, policy_version 1737298 (0.0009) [2023-12-28 07:43:01,932][106225] Updated weights for policy 1, policy_version 1737308 (0.0008) [2023-12-28 07:43:01,986][106225] Updated weights for policy 1, policy_version 1737318 (0.0009) [2023-12-28 07:43:02,009][106226] Updated weights for policy 0, policy_version 1733069 (0.0006) [2023-12-28 07:43:02,070][106226] Updated weights for policy 0, policy_version 1733079 (0.0010) [2023-12-28 07:43:02,123][106226] Updated weights for policy 0, policy_version 1733089 (0.0009) [2023-12-28 07:43:02,676][106225] Updated weights for policy 1, policy_version 1737328 (0.0008) [2023-12-28 07:43:02,726][106225] Updated weights for policy 1, policy_version 1737338 (0.0008) [2023-12-28 07:43:02,775][106225] Updated weights for policy 1, policy_version 1737348 (0.0008) [2023-12-28 07:43:02,862][106226] Updated weights for policy 0, policy_version 1733099 (0.0009) [2023-12-28 07:43:02,916][106226] Updated weights for policy 0, policy_version 1733109 (0.0009) [2023-12-28 07:43:02,977][106226] Updated weights for policy 0, policy_version 1733119 (0.0008) [2023-12-28 07:43:03,496][106225] Updated weights for policy 1, policy_version 1737358 (0.0007) [2023-12-28 07:43:03,555][106225] Updated weights for policy 1, policy_version 1737368 (0.0006) [2023-12-28 07:43:03,613][106225] Updated weights for policy 1, policy_version 1737378 (0.0005) [2023-12-28 07:43:03,746][106226] Updated weights for policy 0, policy_version 1733129 (0.0009) [2023-12-28 07:43:03,795][106226] Updated weights for policy 0, policy_version 1733139 (0.0008) [2023-12-28 07:43:03,858][106226] Updated weights for policy 0, policy_version 1733149 (0.0008) [2023-12-28 07:43:03,910][106226] Updated weights for policy 0, policy_version 1733159 (0.0008) [2023-12-28 07:43:04,273][106225] Updated weights for policy 1, policy_version 1737388 (0.0006) [2023-12-28 07:43:04,336][106225] Updated weights for policy 1, policy_version 1737398 (0.0009) [2023-12-28 07:43:04,397][106225] Updated weights for policy 1, policy_version 1737408 (0.0009) [2023-12-28 07:43:04,584][106226] Updated weights for policy 0, policy_version 1733169 (0.0010) [2023-12-28 07:43:04,648][106226] Updated weights for policy 0, policy_version 1733179 (0.0011) [2023-12-28 07:43:04,714][106226] Updated weights for policy 0, policy_version 1733189 (0.0011) [2023-12-28 07:43:05,072][106225] Updated weights for policy 1, policy_version 1737418 (0.0008) [2023-12-28 07:43:05,140][106225] Updated weights for policy 1, policy_version 1737428 (0.0006) [2023-12-28 07:43:05,201][106225] Updated weights for policy 1, policy_version 1737438 (0.0007) [2023-12-28 07:43:05,264][106225] Updated weights for policy 1, policy_version 1737448 (0.0007) [2023-12-28 07:43:05,349][106226] Updated weights for policy 0, policy_version 1733199 (0.0008) [2023-12-28 07:43:05,409][106226] Updated weights for policy 0, policy_version 1733209 (0.0009) [2023-12-28 07:43:05,471][106226] Updated weights for policy 0, policy_version 1733219 (0.0008) [2023-12-28 07:43:05,853][106225] Updated weights for policy 1, policy_version 1737458 (0.0010) [2023-12-28 07:43:05,899][106225] Updated weights for policy 1, policy_version 1737468 (0.0010) [2023-12-28 07:43:05,959][106225] Updated weights for policy 1, policy_version 1737478 (0.0010) [2023-12-28 07:43:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 888635392. Throughput: 0: 9846.9, 1: 10083.2. Samples: 888645324. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:06,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-5.063')] [2023-12-28 07:43:06,186][106226] Updated weights for policy 0, policy_version 1733229 (0.0008) [2023-12-28 07:43:06,249][106226] Updated weights for policy 0, policy_version 1733239 (0.0008) [2023-12-28 07:43:06,316][106226] Updated weights for policy 0, policy_version 1733249 (0.0008) [2023-12-28 07:43:06,644][106225] Updated weights for policy 1, policy_version 1737488 (0.0007) [2023-12-28 07:43:06,705][106225] Updated weights for policy 1, policy_version 1737498 (0.0008) [2023-12-28 07:43:06,753][106225] Updated weights for policy 1, policy_version 1737508 (0.0006) [2023-12-28 07:43:07,039][106226] Updated weights for policy 0, policy_version 1733259 (0.0008) [2023-12-28 07:43:07,087][106226] Updated weights for policy 0, policy_version 1733269 (0.0007) [2023-12-28 07:43:07,140][106226] Updated weights for policy 0, policy_version 1733279 (0.0008) [2023-12-28 07:43:07,297][106225] Updated weights for policy 1, policy_version 1737518 (0.0009) [2023-12-28 07:43:07,351][106225] Updated weights for policy 1, policy_version 1737528 (0.0007) [2023-12-28 07:43:07,417][106225] Updated weights for policy 1, policy_version 1737538 (0.0008) [2023-12-28 07:43:07,781][106226] Updated weights for policy 0, policy_version 1733289 (0.0009) [2023-12-28 07:43:07,836][106226] Updated weights for policy 0, policy_version 1733299 (0.0005) [2023-12-28 07:43:07,889][106226] Updated weights for policy 0, policy_version 1733309 (0.0005) [2023-12-28 07:43:07,940][106226] Updated weights for policy 0, policy_version 1733319 (0.0008) [2023-12-28 07:43:08,055][106225] Updated weights for policy 1, policy_version 1737548 (0.0009) [2023-12-28 07:43:08,122][106225] Updated weights for policy 1, policy_version 1737558 (0.0008) [2023-12-28 07:43:08,185][106225] Updated weights for policy 1, policy_version 1737568 (0.0008) [2023-12-28 07:43:08,607][106226] Updated weights for policy 0, policy_version 1733329 (0.0009) [2023-12-28 07:43:08,663][106226] Updated weights for policy 0, policy_version 1733339 (0.0008) [2023-12-28 07:43:08,724][106226] Updated weights for policy 0, policy_version 1733349 (0.0009) [2023-12-28 07:43:08,914][106225] Updated weights for policy 1, policy_version 1737578 (0.0007) [2023-12-28 07:43:08,975][106225] Updated weights for policy 1, policy_version 1737588 (0.0005) [2023-12-28 07:43:09,026][106225] Updated weights for policy 1, policy_version 1737598 (0.0005) [2023-12-28 07:43:09,084][106225] Updated weights for policy 1, policy_version 1737608 (0.0007) [2023-12-28 07:43:09,546][106226] Updated weights for policy 0, policy_version 1733359 (0.0007) [2023-12-28 07:43:09,617][106226] Updated weights for policy 0, policy_version 1733369 (0.0009) [2023-12-28 07:43:09,687][106226] Updated weights for policy 0, policy_version 1733379 (0.0009) [2023-12-28 07:43:09,779][106225] Updated weights for policy 1, policy_version 1737618 (0.0008) [2023-12-28 07:43:09,845][106225] Updated weights for policy 1, policy_version 1737628 (0.0008) [2023-12-28 07:43:09,904][106225] Updated weights for policy 1, policy_version 1737638 (0.0007) [2023-12-28 07:43:10,419][106226] Updated weights for policy 0, policy_version 1733389 (0.0011) [2023-12-28 07:43:10,482][106226] Updated weights for policy 0, policy_version 1733399 (0.0009) [2023-12-28 07:43:10,538][106226] Updated weights for policy 0, policy_version 1733409 (0.0005) [2023-12-28 07:43:10,565][106225] Updated weights for policy 1, policy_version 1737648 (0.0008) [2023-12-28 07:43:10,629][106225] Updated weights for policy 1, policy_version 1737658 (0.0011) [2023-12-28 07:43:10,693][106225] Updated weights for policy 1, policy_version 1737668 (0.0010) [2023-12-28 07:43:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 888733696. Throughput: 0: 9913.1, 1: 10181.6. Samples: 888707452. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:11,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-5.041')] [2023-12-28 07:43:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001737672_444899328.pth... [2023-12-28 07:43:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001733416_443834368.pth... [2023-12-28 07:43:11,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001736488_444596224.pth [2023-12-28 07:43:11,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001732264_443539456.pth [2023-12-28 07:43:11,226][106226] Updated weights for policy 0, policy_version 1733419 (0.0007) [2023-12-28 07:43:11,288][106226] Updated weights for policy 0, policy_version 1733429 (0.0007) [2023-12-28 07:43:11,357][106226] Updated weights for policy 0, policy_version 1733439 (0.0008) [2023-12-28 07:43:11,433][106225] Updated weights for policy 1, policy_version 1737678 (0.0008) [2023-12-28 07:43:11,504][106225] Updated weights for policy 1, policy_version 1737688 (0.0006) [2023-12-28 07:43:11,566][106225] Updated weights for policy 1, policy_version 1737698 (0.0010) [2023-12-28 07:43:12,114][106226] Updated weights for policy 0, policy_version 1733449 (0.0008) [2023-12-28 07:43:12,175][106226] Updated weights for policy 0, policy_version 1733459 (0.0006) [2023-12-28 07:43:12,240][106226] Updated weights for policy 0, policy_version 1733469 (0.0005) [2023-12-28 07:43:12,250][106225] Updated weights for policy 1, policy_version 1737708 (0.0011) [2023-12-28 07:43:12,307][106226] Updated weights for policy 0, policy_version 1733479 (0.0009) [2023-12-28 07:43:12,316][106225] Updated weights for policy 1, policy_version 1737718 (0.0011) [2023-12-28 07:43:12,388][106225] Updated weights for policy 1, policy_version 1737728 (0.0009) [2023-12-28 07:43:12,958][106226] Updated weights for policy 0, policy_version 1733489 (0.0011) [2023-12-28 07:43:13,027][106226] Updated weights for policy 0, policy_version 1733499 (0.0011) [2023-12-28 07:43:13,055][106225] Updated weights for policy 1, policy_version 1737738 (0.0006) [2023-12-28 07:43:13,083][106226] Updated weights for policy 0, policy_version 1733509 (0.0010) [2023-12-28 07:43:13,111][106225] Updated weights for policy 1, policy_version 1737748 (0.0006) [2023-12-28 07:43:13,167][106225] Updated weights for policy 1, policy_version 1737758 (0.0005) [2023-12-28 07:43:13,228][106225] Updated weights for policy 1, policy_version 1737768 (0.0010) [2023-12-28 07:43:13,728][106226] Updated weights for policy 0, policy_version 1733519 (0.0007) [2023-12-28 07:43:13,777][106226] Updated weights for policy 0, policy_version 1733529 (0.0006) [2023-12-28 07:43:13,824][106226] Updated weights for policy 0, policy_version 1733539 (0.0009) [2023-12-28 07:43:13,917][106225] Updated weights for policy 1, policy_version 1737778 (0.0005) [2023-12-28 07:43:13,977][106225] Updated weights for policy 1, policy_version 1737788 (0.0006) [2023-12-28 07:43:14,032][106225] Updated weights for policy 1, policy_version 1737798 (0.0006) [2023-12-28 07:43:14,616][106225] Updated weights for policy 1, policy_version 1737808 (0.0007) [2023-12-28 07:43:14,618][106226] Updated weights for policy 0, policy_version 1733549 (0.0009) [2023-12-28 07:43:14,669][106226] Updated weights for policy 0, policy_version 1733559 (0.0006) [2023-12-28 07:43:14,675][106225] Updated weights for policy 1, policy_version 1737818 (0.0007) [2023-12-28 07:43:14,726][106226] Updated weights for policy 0, policy_version 1733569 (0.0008) [2023-12-28 07:43:14,727][106225] Updated weights for policy 1, policy_version 1737828 (0.0005) [2023-12-28 07:43:15,381][106225] Updated weights for policy 1, policy_version 1737838 (0.0007) [2023-12-28 07:43:15,442][106225] Updated weights for policy 1, policy_version 1737848 (0.0008) [2023-12-28 07:43:15,506][106225] Updated weights for policy 1, policy_version 1737858 (0.0008) [2023-12-28 07:43:15,519][106226] Updated weights for policy 0, policy_version 1733579 (0.0008) [2023-12-28 07:43:15,584][106226] Updated weights for policy 0, policy_version 1733589 (0.0007) [2023-12-28 07:43:15,646][106226] Updated weights for policy 0, policy_version 1733599 (0.0008) [2023-12-28 07:43:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 888832000. Throughput: 0: 9808.6, 1: 10106.6. Samples: 888825536. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:16,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.895')] [2023-12-28 07:43:16,225][106225] Updated weights for policy 1, policy_version 1737868 (0.0008) [2023-12-28 07:43:16,286][106225] Updated weights for policy 1, policy_version 1737878 (0.0007) [2023-12-28 07:43:16,340][106226] Updated weights for policy 0, policy_version 1733609 (0.0007) [2023-12-28 07:43:16,344][106225] Updated weights for policy 1, policy_version 1737888 (0.0006) [2023-12-28 07:43:16,405][106226] Updated weights for policy 0, policy_version 1733619 (0.0009) [2023-12-28 07:43:16,468][106226] Updated weights for policy 0, policy_version 1733629 (0.0010) [2023-12-28 07:43:16,538][106226] Updated weights for policy 0, policy_version 1733639 (0.0010) [2023-12-28 07:43:16,929][106225] Updated weights for policy 1, policy_version 1737898 (0.0007) [2023-12-28 07:43:16,987][106225] Updated weights for policy 1, policy_version 1737908 (0.0008) [2023-12-28 07:43:17,046][106225] Updated weights for policy 1, policy_version 1737918 (0.0006) [2023-12-28 07:43:17,104][106225] Updated weights for policy 1, policy_version 1737928 (0.0007) [2023-12-28 07:43:17,290][106226] Updated weights for policy 0, policy_version 1733649 (0.0006) [2023-12-28 07:43:17,336][106226] Updated weights for policy 0, policy_version 1733659 (0.0007) [2023-12-28 07:43:17,388][106226] Updated weights for policy 0, policy_version 1733669 (0.0008) [2023-12-28 07:43:17,756][106225] Updated weights for policy 1, policy_version 1737938 (0.0008) [2023-12-28 07:43:17,813][106225] Updated weights for policy 1, policy_version 1737948 (0.0006) [2023-12-28 07:43:17,872][106225] Updated weights for policy 1, policy_version 1737958 (0.0005) [2023-12-28 07:43:18,165][106226] Updated weights for policy 0, policy_version 1733679 (0.0006) [2023-12-28 07:43:18,222][106226] Updated weights for policy 0, policy_version 1733689 (0.0005) [2023-12-28 07:43:18,281][106226] Updated weights for policy 0, policy_version 1733699 (0.0005) [2023-12-28 07:43:18,553][106225] Updated weights for policy 1, policy_version 1737968 (0.0009) [2023-12-28 07:43:18,611][106225] Updated weights for policy 1, policy_version 1737978 (0.0010) [2023-12-28 07:43:18,673][106225] Updated weights for policy 1, policy_version 1737988 (0.0010) [2023-12-28 07:43:18,958][106226] Updated weights for policy 0, policy_version 1733709 (0.0007) [2023-12-28 07:43:19,011][106226] Updated weights for policy 0, policy_version 1733719 (0.0009) [2023-12-28 07:43:19,065][106226] Updated weights for policy 0, policy_version 1733729 (0.0009) [2023-12-28 07:43:19,283][106225] Updated weights for policy 1, policy_version 1737998 (0.0009) [2023-12-28 07:43:19,346][106225] Updated weights for policy 1, policy_version 1738008 (0.0007) [2023-12-28 07:43:19,411][106225] Updated weights for policy 1, policy_version 1738018 (0.0006) [2023-12-28 07:43:19,861][106226] Updated weights for policy 0, policy_version 1733739 (0.0009) [2023-12-28 07:43:19,932][106226] Updated weights for policy 0, policy_version 1733749 (0.0011) [2023-12-28 07:43:19,998][106226] Updated weights for policy 0, policy_version 1733759 (0.0009) [2023-12-28 07:43:20,162][106225] Updated weights for policy 1, policy_version 1738028 (0.0008) [2023-12-28 07:43:20,224][106225] Updated weights for policy 1, policy_version 1738038 (0.0011) [2023-12-28 07:43:20,285][106225] Updated weights for policy 1, policy_version 1738048 (0.0010) [2023-12-28 07:43:20,718][106226] Updated weights for policy 0, policy_version 1733769 (0.0011) [2023-12-28 07:43:20,783][106226] Updated weights for policy 0, policy_version 1733779 (0.0011) [2023-12-28 07:43:20,836][106226] Updated weights for policy 0, policy_version 1733789 (0.0010) [2023-12-28 07:43:20,887][106226] Updated weights for policy 0, policy_version 1733799 (0.0010) [2023-12-28 07:43:21,032][106225] Updated weights for policy 1, policy_version 1738058 (0.0010) [2023-12-28 07:43:21,102][106225] Updated weights for policy 1, policy_version 1738068 (0.0011) [2023-12-28 07:43:21,170][106225] Updated weights for policy 1, policy_version 1738078 (0.0008) [2023-12-28 07:43:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 888930304. Throughput: 0: 9752.1, 1: 10122.0. Samples: 888942852. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:21,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.842')] [2023-12-28 07:43:21,233][106225] Updated weights for policy 1, policy_version 1738088 (0.0009) [2023-12-28 07:43:21,635][106226] Updated weights for policy 0, policy_version 1733809 (0.0009) [2023-12-28 07:43:21,694][106226] Updated weights for policy 0, policy_version 1733819 (0.0008) [2023-12-28 07:43:21,771][106226] Updated weights for policy 0, policy_version 1733829 (0.0011) [2023-12-28 07:43:21,994][106225] Updated weights for policy 1, policy_version 1738098 (0.0005) [2023-12-28 07:43:22,056][106225] Updated weights for policy 1, policy_version 1738108 (0.0005) [2023-12-28 07:43:22,120][106225] Updated weights for policy 1, policy_version 1738118 (0.0007) [2023-12-28 07:43:22,520][106226] Updated weights for policy 0, policy_version 1733839 (0.0009) [2023-12-28 07:43:22,582][106226] Updated weights for policy 0, policy_version 1733849 (0.0008) [2023-12-28 07:43:22,648][106226] Updated weights for policy 0, policy_version 1733859 (0.0008) [2023-12-28 07:43:22,787][106225] Updated weights for policy 1, policy_version 1738128 (0.0010) [2023-12-28 07:43:22,846][106225] Updated weights for policy 1, policy_version 1738138 (0.0011) [2023-12-28 07:43:22,903][106225] Updated weights for policy 1, policy_version 1738148 (0.0010) [2023-12-28 07:43:23,366][106226] Updated weights for policy 0, policy_version 1733869 (0.0009) [2023-12-28 07:43:23,410][106226] Updated weights for policy 0, policy_version 1733879 (0.0010) [2023-12-28 07:43:23,460][106226] Updated weights for policy 0, policy_version 1733889 (0.0010) [2023-12-28 07:43:23,579][106225] Updated weights for policy 1, policy_version 1738158 (0.0010) [2023-12-28 07:43:23,628][106225] Updated weights for policy 1, policy_version 1738168 (0.0010) [2023-12-28 07:43:23,685][106225] Updated weights for policy 1, policy_version 1738178 (0.0010) [2023-12-28 07:43:24,115][106226] Updated weights for policy 0, policy_version 1733899 (0.0010) [2023-12-28 07:43:24,172][106226] Updated weights for policy 0, policy_version 1733909 (0.0010) [2023-12-28 07:43:24,226][106226] Updated weights for policy 0, policy_version 1733919 (0.0007) [2023-12-28 07:43:24,391][106225] Updated weights for policy 1, policy_version 1738188 (0.0010) [2023-12-28 07:43:24,453][106225] Updated weights for policy 1, policy_version 1738198 (0.0011) [2023-12-28 07:43:24,508][106225] Updated weights for policy 1, policy_version 1738208 (0.0010) [2023-12-28 07:43:24,973][106226] Updated weights for policy 0, policy_version 1733929 (0.0010) [2023-12-28 07:43:25,044][106226] Updated weights for policy 0, policy_version 1733939 (0.0011) [2023-12-28 07:43:25,102][106226] Updated weights for policy 0, policy_version 1733949 (0.0008) [2023-12-28 07:43:25,115][106225] Updated weights for policy 1, policy_version 1738218 (0.0009) [2023-12-28 07:43:25,156][106226] Updated weights for policy 0, policy_version 1733959 (0.0008) [2023-12-28 07:43:25,181][106225] Updated weights for policy 1, policy_version 1738228 (0.0005) [2023-12-28 07:43:25,239][106225] Updated weights for policy 1, policy_version 1738238 (0.0005) [2023-12-28 07:43:25,300][106225] Updated weights for policy 1, policy_version 1738248 (0.0005) [2023-12-28 07:43:25,893][106225] Updated weights for policy 1, policy_version 1738258 (0.0010) [2023-12-28 07:43:25,936][106226] Updated weights for policy 0, policy_version 1733969 (0.0005) [2023-12-28 07:43:25,949][106225] Updated weights for policy 1, policy_version 1738268 (0.0010) [2023-12-28 07:43:25,989][106226] Updated weights for policy 0, policy_version 1733979 (0.0008) [2023-12-28 07:43:26,003][106225] Updated weights for policy 1, policy_version 1738278 (0.0008) [2023-12-28 07:43:26,044][106226] Updated weights for policy 0, policy_version 1733989 (0.0007) [2023-12-28 07:43:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 889036800. Throughput: 0: 9784.0, 1: 10062.4. Samples: 889001068. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:26,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.729')] [2023-12-28 07:43:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001738280_445054976.pth... [2023-12-28 07:43:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001733992_443981824.pth... [2023-12-28 07:43:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001737096_444751872.pth [2023-12-28 07:43:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001732840_443686912.pth [2023-12-28 07:43:26,717][106225] Updated weights for policy 1, policy_version 1738288 (0.0010) [2023-12-28 07:43:26,766][106226] Updated weights for policy 0, policy_version 1733999 (0.0010) [2023-12-28 07:43:26,773][106225] Updated weights for policy 1, policy_version 1738298 (0.0010) [2023-12-28 07:43:26,824][106226] Updated weights for policy 0, policy_version 1734009 (0.0007) [2023-12-28 07:43:26,829][106225] Updated weights for policy 1, policy_version 1738308 (0.0010) [2023-12-28 07:43:26,914][106226] Updated weights for policy 0, policy_version 1734019 (0.0009) [2023-12-28 07:43:27,499][106225] Updated weights for policy 1, policy_version 1738318 (0.0007) [2023-12-28 07:43:27,558][106225] Updated weights for policy 1, policy_version 1738328 (0.0005) [2023-12-28 07:43:27,615][106225] Updated weights for policy 1, policy_version 1738338 (0.0009) [2023-12-28 07:43:27,621][106226] Updated weights for policy 0, policy_version 1734029 (0.0007) [2023-12-28 07:43:27,676][106226] Updated weights for policy 0, policy_version 1734039 (0.0007) [2023-12-28 07:43:27,725][106226] Updated weights for policy 0, policy_version 1734049 (0.0008) [2023-12-28 07:43:28,262][106225] Updated weights for policy 1, policy_version 1738348 (0.0009) [2023-12-28 07:43:28,307][106225] Updated weights for policy 1, policy_version 1738358 (0.0008) [2023-12-28 07:43:28,371][106225] Updated weights for policy 1, policy_version 1738368 (0.0008) [2023-12-28 07:43:28,441][106226] Updated weights for policy 0, policy_version 1734059 (0.0009) [2023-12-28 07:43:28,490][106226] Updated weights for policy 0, policy_version 1734069 (0.0008) [2023-12-28 07:43:28,555][106226] Updated weights for policy 0, policy_version 1734079 (0.0005) [2023-12-28 07:43:29,029][106225] Updated weights for policy 1, policy_version 1738378 (0.0009) [2023-12-28 07:43:29,082][106225] Updated weights for policy 1, policy_version 1738388 (0.0010) [2023-12-28 07:43:29,135][106225] Updated weights for policy 1, policy_version 1738398 (0.0010) [2023-12-28 07:43:29,195][106225] Updated weights for policy 1, policy_version 1738408 (0.0009) [2023-12-28 07:43:29,275][106226] Updated weights for policy 0, policy_version 1734089 (0.0007) [2023-12-28 07:43:29,330][106226] Updated weights for policy 0, policy_version 1734099 (0.0009) [2023-12-28 07:43:29,399][106226] Updated weights for policy 0, policy_version 1734109 (0.0008) [2023-12-28 07:43:29,459][106226] Updated weights for policy 0, policy_version 1734119 (0.0008) [2023-12-28 07:43:29,999][106225] Updated weights for policy 1, policy_version 1738418 (0.0009) [2023-12-28 07:43:30,058][106225] Updated weights for policy 1, policy_version 1738428 (0.0009) [2023-12-28 07:43:30,121][106225] Updated weights for policy 1, policy_version 1738438 (0.0008) [2023-12-28 07:43:30,159][106226] Updated weights for policy 0, policy_version 1734129 (0.0008) [2023-12-28 07:43:30,215][106226] Updated weights for policy 0, policy_version 1734139 (0.0007) [2023-12-28 07:43:30,277][106226] Updated weights for policy 0, policy_version 1734149 (0.0005) [2023-12-28 07:43:30,851][106225] Updated weights for policy 1, policy_version 1738448 (0.0006) [2023-12-28 07:43:30,895][106225] Updated weights for policy 1, policy_version 1738458 (0.0008) [2023-12-28 07:43:30,945][106225] Updated weights for policy 1, policy_version 1738468 (0.0009) [2023-12-28 07:43:30,965][106226] Updated weights for policy 0, policy_version 1734159 (0.0005) [2023-12-28 07:43:31,038][106226] Updated weights for policy 0, policy_version 1734169 (0.0006) [2023-12-28 07:43:31,098][106226] Updated weights for policy 0, policy_version 1734179 (0.0006) [2023-12-28 07:43:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19882.9). Total num frames: 889135104. Throughput: 0: 9781.7, 1: 10129.3. Samples: 889120120. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:31,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.738')] [2023-12-28 07:43:31,716][106225] Updated weights for policy 1, policy_version 1738478 (0.0007) [2023-12-28 07:43:31,778][106225] Updated weights for policy 1, policy_version 1738488 (0.0008) [2023-12-28 07:43:31,818][106226] Updated weights for policy 0, policy_version 1734189 (0.0007) [2023-12-28 07:43:31,828][106225] Updated weights for policy 1, policy_version 1738498 (0.0008) [2023-12-28 07:43:31,874][106226] Updated weights for policy 0, policy_version 1734199 (0.0006) [2023-12-28 07:43:31,921][106226] Updated weights for policy 0, policy_version 1734209 (0.0009) [2023-12-28 07:43:32,571][106225] Updated weights for policy 1, policy_version 1738508 (0.0008) [2023-12-28 07:43:32,635][106225] Updated weights for policy 1, policy_version 1738518 (0.0010) [2023-12-28 07:43:32,679][106226] Updated weights for policy 0, policy_version 1734219 (0.0007) [2023-12-28 07:43:32,699][106225] Updated weights for policy 1, policy_version 1738528 (0.0008) [2023-12-28 07:43:32,738][106226] Updated weights for policy 0, policy_version 1734229 (0.0008) [2023-12-28 07:43:32,803][106226] Updated weights for policy 0, policy_version 1734239 (0.0010) [2023-12-28 07:43:33,335][106225] Updated weights for policy 1, policy_version 1738538 (0.0006) [2023-12-28 07:43:33,388][106226] Updated weights for policy 0, policy_version 1734249 (0.0007) [2023-12-28 07:43:33,403][106225] Updated weights for policy 1, policy_version 1738548 (0.0006) [2023-12-28 07:43:33,438][106226] Updated weights for policy 0, policy_version 1734259 (0.0005) [2023-12-28 07:43:33,478][106225] Updated weights for policy 1, policy_version 1738558 (0.0008) [2023-12-28 07:43:33,489][106226] Updated weights for policy 0, policy_version 1734269 (0.0005) [2023-12-28 07:43:33,538][106225] Updated weights for policy 1, policy_version 1738568 (0.0006) [2023-12-28 07:43:33,545][106226] Updated weights for policy 0, policy_version 1734279 (0.0005) [2023-12-28 07:43:34,043][106225] Updated weights for policy 1, policy_version 1738578 (0.0008) [2023-12-28 07:43:34,050][106226] Updated weights for policy 0, policy_version 1734289 (0.0005) [2023-12-28 07:43:34,096][106226] Updated weights for policy 0, policy_version 1734299 (0.0005) [2023-12-28 07:43:34,098][106225] Updated weights for policy 1, policy_version 1738588 (0.0007) [2023-12-28 07:43:34,154][106226] Updated weights for policy 0, policy_version 1734309 (0.0007) [2023-12-28 07:43:34,165][106225] Updated weights for policy 1, policy_version 1738598 (0.0008) [2023-12-28 07:43:34,896][106226] Updated weights for policy 0, policy_version 1734319 (0.0008) [2023-12-28 07:43:34,917][106225] Updated weights for policy 1, policy_version 1738608 (0.0006) [2023-12-28 07:43:34,959][106226] Updated weights for policy 0, policy_version 1734329 (0.0008) [2023-12-28 07:43:34,965][106225] Updated weights for policy 1, policy_version 1738618 (0.0006) [2023-12-28 07:43:35,019][106225] Updated weights for policy 1, policy_version 1738628 (0.0006) [2023-12-28 07:43:35,025][106226] Updated weights for policy 0, policy_version 1734339 (0.0007) [2023-12-28 07:43:35,580][106225] Updated weights for policy 1, policy_version 1738638 (0.0006) [2023-12-28 07:43:35,639][106225] Updated weights for policy 1, policy_version 1738648 (0.0005) [2023-12-28 07:43:35,693][106225] Updated weights for policy 1, policy_version 1738658 (0.0005) [2023-12-28 07:43:35,718][106226] Updated weights for policy 0, policy_version 1734349 (0.0007) [2023-12-28 07:43:35,770][106226] Updated weights for policy 0, policy_version 1734359 (0.0005) [2023-12-28 07:43:35,827][106226] Updated weights for policy 0, policy_version 1734369 (0.0005) [2023-12-28 07:43:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 889233408. Throughput: 0: 9798.8, 1: 10202.7. Samples: 889243284. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:36,175][105115] Avg episode reward: [(0, '-4.731'), (1, '-4.955')] [2023-12-28 07:43:36,250][106225] Updated weights for policy 1, policy_version 1738668 (0.0008) [2023-12-28 07:43:36,311][106225] Updated weights for policy 1, policy_version 1738678 (0.0009) [2023-12-28 07:43:36,372][106225] Updated weights for policy 1, policy_version 1738688 (0.0009) [2023-12-28 07:43:36,562][106226] Updated weights for policy 0, policy_version 1734379 (0.0007) [2023-12-28 07:43:36,624][106226] Updated weights for policy 0, policy_version 1734389 (0.0009) [2023-12-28 07:43:36,681][106226] Updated weights for policy 0, policy_version 1734399 (0.0008) [2023-12-28 07:43:37,159][106225] Updated weights for policy 1, policy_version 1738698 (0.0008) [2023-12-28 07:43:37,229][106225] Updated weights for policy 1, policy_version 1738708 (0.0010) [2023-12-28 07:43:37,285][106226] Updated weights for policy 0, policy_version 1734409 (0.0009) [2023-12-28 07:43:37,290][106225] Updated weights for policy 1, policy_version 1738718 (0.0009) [2023-12-28 07:43:37,341][106225] Updated weights for policy 1, policy_version 1738728 (0.0008) [2023-12-28 07:43:37,346][106226] Updated weights for policy 0, policy_version 1734419 (0.0005) [2023-12-28 07:43:37,413][106226] Updated weights for policy 0, policy_version 1734429 (0.0006) [2023-12-28 07:43:37,468][106226] Updated weights for policy 0, policy_version 1734439 (0.0008) [2023-12-28 07:43:38,076][106226] Updated weights for policy 0, policy_version 1734449 (0.0006) [2023-12-28 07:43:38,089][106225] Updated weights for policy 1, policy_version 1738738 (0.0007) [2023-12-28 07:43:38,131][106226] Updated weights for policy 0, policy_version 1734459 (0.0006) [2023-12-28 07:43:38,148][106225] Updated weights for policy 1, policy_version 1738748 (0.0007) [2023-12-28 07:43:38,181][106226] Updated weights for policy 0, policy_version 1734469 (0.0006) [2023-12-28 07:43:38,205][106225] Updated weights for policy 1, policy_version 1738758 (0.0008) [2023-12-28 07:43:38,757][106226] Updated weights for policy 0, policy_version 1734479 (0.0006) [2023-12-28 07:43:38,818][106226] Updated weights for policy 0, policy_version 1734489 (0.0008) [2023-12-28 07:43:38,873][106226] Updated weights for policy 0, policy_version 1734499 (0.0009) [2023-12-28 07:43:38,958][106225] Updated weights for policy 1, policy_version 1738768 (0.0010) [2023-12-28 07:43:39,017][106225] Updated weights for policy 1, policy_version 1738779 (0.0006) [2023-12-28 07:43:39,079][106225] Updated weights for policy 1, policy_version 1738789 (0.0005) [2023-12-28 07:43:39,678][106226] Updated weights for policy 0, policy_version 1734509 (0.0008) [2023-12-28 07:43:39,744][106226] Updated weights for policy 0, policy_version 1734519 (0.0009) [2023-12-28 07:43:39,809][106226] Updated weights for policy 0, policy_version 1734529 (0.0009) [2023-12-28 07:43:39,820][106225] Updated weights for policy 1, policy_version 1738799 (0.0006) [2023-12-28 07:43:39,888][106225] Updated weights for policy 1, policy_version 1738809 (0.0009) [2023-12-28 07:43:39,957][106225] Updated weights for policy 1, policy_version 1738819 (0.0008) [2023-12-28 07:43:40,519][106226] Updated weights for policy 0, policy_version 1734539 (0.0010) [2023-12-28 07:43:40,578][106226] Updated weights for policy 0, policy_version 1734549 (0.0006) [2023-12-28 07:43:40,636][106226] Updated weights for policy 0, policy_version 1734559 (0.0008) [2023-12-28 07:43:40,732][106225] Updated weights for policy 1, policy_version 1738829 (0.0007) [2023-12-28 07:43:40,792][106225] Updated weights for policy 1, policy_version 1738839 (0.0007) [2023-12-28 07:43:40,853][106225] Updated weights for policy 1, policy_version 1738849 (0.0008) [2023-12-28 07:43:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 889331712. Throughput: 0: 9897.3, 1: 10156.6. Samples: 889304136. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:41,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.981')] [2023-12-28 07:43:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001738856_445202432.pth... [2023-12-28 07:43:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001734568_444129280.pth... [2023-12-28 07:43:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001737672_444899328.pth [2023-12-28 07:43:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001733416_443834368.pth [2023-12-28 07:43:41,343][106226] Updated weights for policy 0, policy_version 1734569 (0.0008) [2023-12-28 07:43:41,414][106226] Updated weights for policy 0, policy_version 1734579 (0.0009) [2023-12-28 07:43:41,476][106226] Updated weights for policy 0, policy_version 1734589 (0.0011) [2023-12-28 07:43:41,545][106226] Updated weights for policy 0, policy_version 1734599 (0.0011) [2023-12-28 07:43:41,562][106225] Updated weights for policy 1, policy_version 1738859 (0.0008) [2023-12-28 07:43:41,616][106225] Updated weights for policy 1, policy_version 1738869 (0.0008) [2023-12-28 07:43:41,678][106225] Updated weights for policy 1, policy_version 1738879 (0.0008) [2023-12-28 07:43:42,193][106226] Updated weights for policy 0, policy_version 1734609 (0.0008) [2023-12-28 07:43:42,251][106226] Updated weights for policy 0, policy_version 1734619 (0.0009) [2023-12-28 07:43:42,314][106226] Updated weights for policy 0, policy_version 1734629 (0.0007) [2023-12-28 07:43:42,480][106225] Updated weights for policy 1, policy_version 1738889 (0.0008) [2023-12-28 07:43:42,536][106225] Updated weights for policy 1, policy_version 1738899 (0.0006) [2023-12-28 07:43:42,590][106225] Updated weights for policy 1, policy_version 1738909 (0.0006) [2023-12-28 07:43:42,650][106225] Updated weights for policy 1, policy_version 1738919 (0.0006) [2023-12-28 07:43:43,024][106226] Updated weights for policy 0, policy_version 1734639 (0.0006) [2023-12-28 07:43:43,084][106226] Updated weights for policy 0, policy_version 1734649 (0.0006) [2023-12-28 07:43:43,143][106226] Updated weights for policy 0, policy_version 1734659 (0.0006) [2023-12-28 07:43:43,313][106225] Updated weights for policy 1, policy_version 1738929 (0.0005) [2023-12-28 07:43:43,374][106225] Updated weights for policy 1, policy_version 1738939 (0.0006) [2023-12-28 07:43:43,435][106225] Updated weights for policy 1, policy_version 1738949 (0.0005) [2023-12-28 07:43:43,900][106226] Updated weights for policy 0, policy_version 1734669 (0.0008) [2023-12-28 07:43:43,958][106226] Updated weights for policy 0, policy_version 1734679 (0.0008) [2023-12-28 07:43:44,002][106225] Updated weights for policy 1, policy_version 1738959 (0.0005) [2023-12-28 07:43:44,016][106226] Updated weights for policy 0, policy_version 1734689 (0.0008) [2023-12-28 07:43:44,069][106225] Updated weights for policy 1, policy_version 1738969 (0.0007) [2023-12-28 07:43:44,126][106225] Updated weights for policy 1, policy_version 1738979 (0.0010) [2023-12-28 07:43:44,723][106226] Updated weights for policy 0, policy_version 1734699 (0.0008) [2023-12-28 07:43:44,782][106226] Updated weights for policy 0, policy_version 1734709 (0.0007) [2023-12-28 07:43:44,812][106225] Updated weights for policy 1, policy_version 1738989 (0.0008) [2023-12-28 07:43:44,845][106226] Updated weights for policy 0, policy_version 1734719 (0.0007) [2023-12-28 07:43:44,863][106225] Updated weights for policy 1, policy_version 1738999 (0.0010) [2023-12-28 07:43:44,918][106225] Updated weights for policy 1, policy_version 1739009 (0.0010) [2023-12-28 07:43:45,593][106226] Updated weights for policy 0, policy_version 1734729 (0.0006) [2023-12-28 07:43:45,663][106226] Updated weights for policy 0, policy_version 1734739 (0.0006) [2023-12-28 07:43:45,669][106225] Updated weights for policy 1, policy_version 1739019 (0.0011) [2023-12-28 07:43:45,726][106226] Updated weights for policy 0, policy_version 1734749 (0.0006) [2023-12-28 07:43:45,728][106225] Updated weights for policy 1, policy_version 1739029 (0.0010) [2023-12-28 07:43:45,786][106225] Updated weights for policy 1, policy_version 1739039 (0.0010) [2023-12-28 07:43:45,790][106226] Updated weights for policy 0, policy_version 1734759 (0.0006) [2023-12-28 07:43:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 889430016. Throughput: 0: 9813.9, 1: 10123.0. Samples: 889420800. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:46,176][105115] Avg episode reward: [(0, '-4.452'), (1, '-5.028')] [2023-12-28 07:43:46,456][106226] Updated weights for policy 0, policy_version 1734769 (0.0006) [2023-12-28 07:43:46,515][106226] Updated weights for policy 0, policy_version 1734779 (0.0006) [2023-12-28 07:43:46,518][106225] Updated weights for policy 1, policy_version 1739049 (0.0010) [2023-12-28 07:43:46,573][106226] Updated weights for policy 0, policy_version 1734789 (0.0005) [2023-12-28 07:43:46,575][106225] Updated weights for policy 1, policy_version 1739059 (0.0010) [2023-12-28 07:43:46,638][106225] Updated weights for policy 1, policy_version 1739069 (0.0010) [2023-12-28 07:43:46,710][106225] Updated weights for policy 1, policy_version 1739079 (0.0011) [2023-12-28 07:43:47,186][106226] Updated weights for policy 0, policy_version 1734799 (0.0007) [2023-12-28 07:43:47,246][106226] Updated weights for policy 0, policy_version 1734809 (0.0008) [2023-12-28 07:43:47,309][106226] Updated weights for policy 0, policy_version 1734819 (0.0008) [2023-12-28 07:43:47,406][106225] Updated weights for policy 1, policy_version 1739089 (0.0007) [2023-12-28 07:43:47,469][106225] Updated weights for policy 1, policy_version 1739099 (0.0010) [2023-12-28 07:43:47,538][106225] Updated weights for policy 1, policy_version 1739109 (0.0010) [2023-12-28 07:43:47,992][106226] Updated weights for policy 0, policy_version 1734829 (0.0009) [2023-12-28 07:43:48,053][106226] Updated weights for policy 0, policy_version 1734839 (0.0010) [2023-12-28 07:43:48,118][106226] Updated weights for policy 0, policy_version 1734849 (0.0010) [2023-12-28 07:43:48,153][106225] Updated weights for policy 1, policy_version 1739119 (0.0010) [2023-12-28 07:43:48,213][106225] Updated weights for policy 1, policy_version 1739129 (0.0010) [2023-12-28 07:43:48,263][106225] Updated weights for policy 1, policy_version 1739139 (0.0010) [2023-12-28 07:43:48,828][106226] Updated weights for policy 0, policy_version 1734859 (0.0010) [2023-12-28 07:43:48,896][106226] Updated weights for policy 0, policy_version 1734869 (0.0010) [2023-12-28 07:43:48,950][106226] Updated weights for policy 0, policy_version 1734879 (0.0010) [2023-12-28 07:43:49,008][106225] Updated weights for policy 1, policy_version 1739149 (0.0009) [2023-12-28 07:43:49,052][106225] Updated weights for policy 1, policy_version 1739159 (0.0005) [2023-12-28 07:43:49,103][106225] Updated weights for policy 1, policy_version 1739169 (0.0005) [2023-12-28 07:43:49,655][106226] Updated weights for policy 0, policy_version 1734889 (0.0010) [2023-12-28 07:43:49,714][106226] Updated weights for policy 0, policy_version 1734899 (0.0008) [2023-12-28 07:43:49,766][106226] Updated weights for policy 0, policy_version 1734909 (0.0008) [2023-12-28 07:43:49,814][106226] Updated weights for policy 0, policy_version 1734919 (0.0008) [2023-12-28 07:43:49,858][106225] Updated weights for policy 1, policy_version 1739179 (0.0007) [2023-12-28 07:43:49,923][106225] Updated weights for policy 1, policy_version 1739189 (0.0007) [2023-12-28 07:43:49,989][106225] Updated weights for policy 1, policy_version 1739199 (0.0006) [2023-12-28 07:43:50,634][106225] Updated weights for policy 1, policy_version 1739209 (0.0009) [2023-12-28 07:43:50,637][106226] Updated weights for policy 0, policy_version 1734929 (0.0009) [2023-12-28 07:43:50,693][106225] Updated weights for policy 1, policy_version 1739219 (0.0008) [2023-12-28 07:43:50,695][106226] Updated weights for policy 0, policy_version 1734939 (0.0006) [2023-12-28 07:43:50,749][106226] Updated weights for policy 0, policy_version 1734949 (0.0007) [2023-12-28 07:43:50,755][106225] Updated weights for policy 1, policy_version 1739229 (0.0008) [2023-12-28 07:43:50,821][106225] Updated weights for policy 1, policy_version 1739239 (0.0007) [2023-12-28 07:43:51,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 889528320. Throughput: 0: 9775.5, 1: 10071.7. Samples: 889538448. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:51,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.786')] [2023-12-28 07:43:51,495][106225] Updated weights for policy 1, policy_version 1739249 (0.0008) [2023-12-28 07:43:51,514][106226] Updated weights for policy 0, policy_version 1734959 (0.0006) [2023-12-28 07:43:51,550][106225] Updated weights for policy 1, policy_version 1739259 (0.0008) [2023-12-28 07:43:51,565][106226] Updated weights for policy 0, policy_version 1734969 (0.0006) [2023-12-28 07:43:51,601][106225] Updated weights for policy 1, policy_version 1739269 (0.0008) [2023-12-28 07:43:51,633][106226] Updated weights for policy 0, policy_version 1734980 (0.0007) [2023-12-28 07:43:52,245][106226] Updated weights for policy 0, policy_version 1734990 (0.0007) [2023-12-28 07:43:52,310][106226] Updated weights for policy 0, policy_version 1735000 (0.0008) [2023-12-28 07:43:52,379][106226] Updated weights for policy 0, policy_version 1735010 (0.0007) [2023-12-28 07:43:52,429][106225] Updated weights for policy 1, policy_version 1739279 (0.0009) [2023-12-28 07:43:52,478][106225] Updated weights for policy 1, policy_version 1739289 (0.0008) [2023-12-28 07:43:52,535][106225] Updated weights for policy 1, policy_version 1739299 (0.0008) [2023-12-28 07:43:53,038][106226] Updated weights for policy 0, policy_version 1735020 (0.0005) [2023-12-28 07:43:53,103][106226] Updated weights for policy 0, policy_version 1735030 (0.0010) [2023-12-28 07:43:53,165][106226] Updated weights for policy 0, policy_version 1735040 (0.0011) [2023-12-28 07:43:53,241][106225] Updated weights for policy 1, policy_version 1739309 (0.0007) [2023-12-28 07:43:53,295][106225] Updated weights for policy 1, policy_version 1739319 (0.0008) [2023-12-28 07:43:53,341][106225] Updated weights for policy 1, policy_version 1739329 (0.0008) [2023-12-28 07:43:53,797][106226] Updated weights for policy 0, policy_version 1735050 (0.0009) [2023-12-28 07:43:53,860][106226] Updated weights for policy 0, policy_version 1735060 (0.0007) [2023-12-28 07:43:53,916][106226] Updated weights for policy 0, policy_version 1735070 (0.0010) [2023-12-28 07:43:53,973][106226] Updated weights for policy 0, policy_version 1735080 (0.0011) [2023-12-28 07:43:54,119][106225] Updated weights for policy 1, policy_version 1739339 (0.0009) [2023-12-28 07:43:54,177][106225] Updated weights for policy 1, policy_version 1739349 (0.0008) [2023-12-28 07:43:54,224][106225] Updated weights for policy 1, policy_version 1739359 (0.0007) [2023-12-28 07:43:54,662][106226] Updated weights for policy 0, policy_version 1735090 (0.0008) [2023-12-28 07:43:54,729][106226] Updated weights for policy 0, policy_version 1735100 (0.0011) [2023-12-28 07:43:54,783][106226] Updated weights for policy 0, policy_version 1735110 (0.0011) [2023-12-28 07:43:54,885][106225] Updated weights for policy 1, policy_version 1739369 (0.0007) [2023-12-28 07:43:54,938][106225] Updated weights for policy 1, policy_version 1739379 (0.0008) [2023-12-28 07:43:54,986][106225] Updated weights for policy 1, policy_version 1739389 (0.0010) [2023-12-28 07:43:55,041][106225] Updated weights for policy 1, policy_version 1739399 (0.0010) [2023-12-28 07:43:55,461][106226] Updated weights for policy 0, policy_version 1735120 (0.0010) [2023-12-28 07:43:55,507][106226] Updated weights for policy 0, policy_version 1735130 (0.0010) [2023-12-28 07:43:55,570][106226] Updated weights for policy 0, policy_version 1735140 (0.0010) [2023-12-28 07:43:55,647][106225] Updated weights for policy 1, policy_version 1739409 (0.0008) [2023-12-28 07:43:55,703][106225] Updated weights for policy 1, policy_version 1739419 (0.0010) [2023-12-28 07:43:55,760][106225] Updated weights for policy 1, policy_version 1739429 (0.0010) [2023-12-28 07:43:56,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 889626624. Throughput: 0: 9811.9, 1: 9987.3. Samples: 889598412. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:43:56,175][105115] Avg episode reward: [(0, '-4.650'), (1, '-4.833')] [2023-12-28 07:43:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001735144_444276736.pth... [2023-12-28 07:43:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001739432_445349888.pth... [2023-12-28 07:43:56,182][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001733992_443981824.pth [2023-12-28 07:43:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001738280_445054976.pth [2023-12-28 07:43:56,269][106226] Updated weights for policy 0, policy_version 1735150 (0.0011) [2023-12-28 07:43:56,326][106226] Updated weights for policy 0, policy_version 1735160 (0.0011) [2023-12-28 07:43:56,379][106226] Updated weights for policy 0, policy_version 1735170 (0.0007) [2023-12-28 07:43:56,400][106225] Updated weights for policy 1, policy_version 1739439 (0.0010) [2023-12-28 07:43:56,451][106225] Updated weights for policy 1, policy_version 1739449 (0.0010) [2023-12-28 07:43:56,507][106225] Updated weights for policy 1, policy_version 1739459 (0.0005) [2023-12-28 07:43:57,028][106226] Updated weights for policy 0, policy_version 1735180 (0.0007) [2023-12-28 07:43:57,085][106226] Updated weights for policy 0, policy_version 1735190 (0.0005) [2023-12-28 07:43:57,135][106226] Updated weights for policy 0, policy_version 1735200 (0.0010) [2023-12-28 07:43:57,195][106225] Updated weights for policy 1, policy_version 1739469 (0.0006) [2023-12-28 07:43:57,261][106225] Updated weights for policy 1, policy_version 1739479 (0.0008) [2023-12-28 07:43:57,322][106225] Updated weights for policy 1, policy_version 1739489 (0.0008) [2023-12-28 07:43:57,833][106226] Updated weights for policy 0, policy_version 1735210 (0.0011) [2023-12-28 07:43:57,887][106226] Updated weights for policy 0, policy_version 1735220 (0.0010) [2023-12-28 07:43:57,921][106225] Updated weights for policy 1, policy_version 1739499 (0.0007) [2023-12-28 07:43:57,946][106226] Updated weights for policy 0, policy_version 1735230 (0.0009) [2023-12-28 07:43:57,976][106225] Updated weights for policy 1, policy_version 1739509 (0.0007) [2023-12-28 07:43:57,994][106226] Updated weights for policy 0, policy_version 1735240 (0.0007) [2023-12-28 07:43:58,029][106225] Updated weights for policy 1, policy_version 1739519 (0.0008) [2023-12-28 07:43:58,720][106226] Updated weights for policy 0, policy_version 1735250 (0.0010) [2023-12-28 07:43:58,790][106226] Updated weights for policy 0, policy_version 1735261 (0.0008) [2023-12-28 07:43:58,849][106225] Updated weights for policy 1, policy_version 1739529 (0.0009) [2023-12-28 07:43:58,867][106226] Updated weights for policy 0, policy_version 1735271 (0.0008) [2023-12-28 07:43:58,922][106225] Updated weights for policy 1, policy_version 1739539 (0.0009) [2023-12-28 07:43:58,977][106225] Updated weights for policy 1, policy_version 1739549 (0.0008) [2023-12-28 07:43:59,031][106225] Updated weights for policy 1, policy_version 1739559 (0.0009) [2023-12-28 07:43:59,593][106226] Updated weights for policy 0, policy_version 1735281 (0.0008) [2023-12-28 07:43:59,655][106226] Updated weights for policy 0, policy_version 1735291 (0.0010) [2023-12-28 07:43:59,720][106226] Updated weights for policy 0, policy_version 1735301 (0.0008) [2023-12-28 07:43:59,793][106225] Updated weights for policy 1, policy_version 1739569 (0.0009) [2023-12-28 07:43:59,861][106225] Updated weights for policy 1, policy_version 1739579 (0.0008) [2023-12-28 07:43:59,923][106225] Updated weights for policy 1, policy_version 1739589 (0.0010) [2023-12-28 07:44:00,446][106226] Updated weights for policy 0, policy_version 1735311 (0.0005) [2023-12-28 07:44:00,507][106226] Updated weights for policy 0, policy_version 1735321 (0.0005) [2023-12-28 07:44:00,567][106226] Updated weights for policy 0, policy_version 1735331 (0.0005) [2023-12-28 07:44:00,699][106225] Updated weights for policy 1, policy_version 1739599 (0.0007) [2023-12-28 07:44:00,761][106225] Updated weights for policy 1, policy_version 1739609 (0.0008) [2023-12-28 07:44:00,816][106225] Updated weights for policy 1, policy_version 1739619 (0.0007) [2023-12-28 07:44:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19882.9). Total num frames: 889724928. Throughput: 0: 9840.6, 1: 9993.8. Samples: 889718088. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:44:01,175][105115] Avg episode reward: [(0, '-4.148'), (1, '-4.785')] [2023-12-28 07:44:01,177][106226] Updated weights for policy 0, policy_version 1735341 (0.0007) [2023-12-28 07:44:01,236][106226] Updated weights for policy 0, policy_version 1735351 (0.0006) [2023-12-28 07:44:01,300][106226] Updated weights for policy 0, policy_version 1735361 (0.0008) [2023-12-28 07:44:01,534][106225] Updated weights for policy 1, policy_version 1739629 (0.0008) [2023-12-28 07:44:01,591][106225] Updated weights for policy 1, policy_version 1739639 (0.0006) [2023-12-28 07:44:01,659][106225] Updated weights for policy 1, policy_version 1739649 (0.0007) [2023-12-28 07:44:02,022][106226] Updated weights for policy 0, policy_version 1735371 (0.0008) [2023-12-28 07:44:02,079][106226] Updated weights for policy 0, policy_version 1735381 (0.0009) [2023-12-28 07:44:02,135][106226] Updated weights for policy 0, policy_version 1735391 (0.0006) [2023-12-28 07:44:02,392][106225] Updated weights for policy 1, policy_version 1739659 (0.0008) [2023-12-28 07:44:02,447][106225] Updated weights for policy 1, policy_version 1739669 (0.0008) [2023-12-28 07:44:02,507][106225] Updated weights for policy 1, policy_version 1739679 (0.0009) [2023-12-28 07:44:02,733][106226] Updated weights for policy 0, policy_version 1735401 (0.0007) [2023-12-28 07:44:02,791][106226] Updated weights for policy 0, policy_version 1735411 (0.0008) [2023-12-28 07:44:02,846][106226] Updated weights for policy 0, policy_version 1735421 (0.0009) [2023-12-28 07:44:02,910][106226] Updated weights for policy 0, policy_version 1735431 (0.0007) [2023-12-28 07:44:03,299][106225] Updated weights for policy 1, policy_version 1739689 (0.0009) [2023-12-28 07:44:03,363][106225] Updated weights for policy 1, policy_version 1739699 (0.0009) [2023-12-28 07:44:03,425][106225] Updated weights for policy 1, policy_version 1739709 (0.0008) [2023-12-28 07:44:03,480][106225] Updated weights for policy 1, policy_version 1739719 (0.0008) [2023-12-28 07:44:03,506][106226] Updated weights for policy 0, policy_version 1735441 (0.0006) [2023-12-28 07:44:03,561][106226] Updated weights for policy 0, policy_version 1735451 (0.0010) [2023-12-28 07:44:03,616][106226] Updated weights for policy 0, policy_version 1735461 (0.0010) [2023-12-28 07:44:04,215][106225] Updated weights for policy 1, policy_version 1739729 (0.0007) [2023-12-28 07:44:04,240][106226] Updated weights for policy 0, policy_version 1735471 (0.0011) [2023-12-28 07:44:04,274][106225] Updated weights for policy 1, policy_version 1739739 (0.0006) [2023-12-28 07:44:04,295][106226] Updated weights for policy 0, policy_version 1735481 (0.0011) [2023-12-28 07:44:04,336][106225] Updated weights for policy 1, policy_version 1739749 (0.0006) [2023-12-28 07:44:04,353][106226] Updated weights for policy 0, policy_version 1735491 (0.0011) [2023-12-28 07:44:04,963][106226] Updated weights for policy 0, policy_version 1735501 (0.0008) [2023-12-28 07:44:04,980][106225] Updated weights for policy 1, policy_version 1739759 (0.0008) [2023-12-28 07:44:05,020][106226] Updated weights for policy 0, policy_version 1735511 (0.0008) [2023-12-28 07:44:05,037][106225] Updated weights for policy 1, policy_version 1739769 (0.0007) [2023-12-28 07:44:05,080][106226] Updated weights for policy 0, policy_version 1735521 (0.0011) [2023-12-28 07:44:05,098][106225] Updated weights for policy 1, policy_version 1739779 (0.0007) [2023-12-28 07:44:05,651][106226] Updated weights for policy 0, policy_version 1735531 (0.0010) [2023-12-28 07:44:05,703][106226] Updated weights for policy 0, policy_version 1735541 (0.0010) [2023-12-28 07:44:05,762][106226] Updated weights for policy 0, policy_version 1735551 (0.0011) [2023-12-28 07:44:05,763][106225] Updated weights for policy 1, policy_version 1739789 (0.0009) [2023-12-28 07:44:05,820][106225] Updated weights for policy 1, policy_version 1739799 (0.0010) [2023-12-28 07:44:05,883][106225] Updated weights for policy 1, policy_version 1739809 (0.0010) [2023-12-28 07:44:06,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 889831424. Throughput: 0: 10038.9, 1: 9904.7. Samples: 889840316. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:44:06,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.614')] [2023-12-28 07:44:06,390][106226] Updated weights for policy 0, policy_version 1735561 (0.0010) [2023-12-28 07:44:06,454][106226] Updated weights for policy 0, policy_version 1735571 (0.0011) [2023-12-28 07:44:06,523][106226] Updated weights for policy 0, policy_version 1735581 (0.0011) [2023-12-28 07:44:06,567][106225] Updated weights for policy 1, policy_version 1739819 (0.0010) [2023-12-28 07:44:06,588][106226] Updated weights for policy 0, policy_version 1735591 (0.0011) [2023-12-28 07:44:06,635][106225] Updated weights for policy 1, policy_version 1739829 (0.0011) [2023-12-28 07:44:06,694][106225] Updated weights for policy 1, policy_version 1739839 (0.0010) [2023-12-28 07:44:07,211][106226] Updated weights for policy 0, policy_version 1735601 (0.0010) [2023-12-28 07:44:07,272][106226] Updated weights for policy 0, policy_version 1735611 (0.0011) [2023-12-28 07:44:07,329][106226] Updated weights for policy 0, policy_version 1735621 (0.0011) [2023-12-28 07:44:07,395][106225] Updated weights for policy 1, policy_version 1739849 (0.0010) [2023-12-28 07:44:07,461][106225] Updated weights for policy 1, policy_version 1739859 (0.0006) [2023-12-28 07:44:07,519][106225] Updated weights for policy 1, policy_version 1739869 (0.0010) [2023-12-28 07:44:07,580][106225] Updated weights for policy 1, policy_version 1739879 (0.0010) [2023-12-28 07:44:07,965][106226] Updated weights for policy 0, policy_version 1735631 (0.0007) [2023-12-28 07:44:08,032][106226] Updated weights for policy 0, policy_version 1735641 (0.0008) [2023-12-28 07:44:08,089][106226] Updated weights for policy 0, policy_version 1735651 (0.0005) [2023-12-28 07:44:08,315][106225] Updated weights for policy 1, policy_version 1739889 (0.0008) [2023-12-28 07:44:08,374][106225] Updated weights for policy 1, policy_version 1739899 (0.0009) [2023-12-28 07:44:08,427][106225] Updated weights for policy 1, policy_version 1739909 (0.0007) [2023-12-28 07:44:08,670][106226] Updated weights for policy 0, policy_version 1735661 (0.0008) [2023-12-28 07:44:08,737][106226] Updated weights for policy 0, policy_version 1735671 (0.0011) [2023-12-28 07:44:08,791][106226] Updated weights for policy 0, policy_version 1735681 (0.0011) [2023-12-28 07:44:09,055][106225] Updated weights for policy 1, policy_version 1739919 (0.0007) [2023-12-28 07:44:09,107][106225] Updated weights for policy 1, policy_version 1739929 (0.0008) [2023-12-28 07:44:09,150][106225] Updated weights for policy 1, policy_version 1739939 (0.0005) [2023-12-28 07:44:09,514][106226] Updated weights for policy 0, policy_version 1735691 (0.0010) [2023-12-28 07:44:09,572][106226] Updated weights for policy 0, policy_version 1735701 (0.0009) [2023-12-28 07:44:09,631][106226] Updated weights for policy 0, policy_version 1735711 (0.0008) [2023-12-28 07:44:09,960][106225] Updated weights for policy 1, policy_version 1739949 (0.0007) [2023-12-28 07:44:10,030][106225] Updated weights for policy 1, policy_version 1739959 (0.0008) [2023-12-28 07:44:10,090][106225] Updated weights for policy 1, policy_version 1739969 (0.0008) [2023-12-28 07:44:10,311][106226] Updated weights for policy 0, policy_version 1735721 (0.0009) [2023-12-28 07:44:10,370][106226] Updated weights for policy 0, policy_version 1735731 (0.0007) [2023-12-28 07:44:10,434][106226] Updated weights for policy 0, policy_version 1735741 (0.0009) [2023-12-28 07:44:10,493][106226] Updated weights for policy 0, policy_version 1735751 (0.0009) [2023-12-28 07:44:10,796][106225] Updated weights for policy 1, policy_version 1739979 (0.0009) [2023-12-28 07:44:10,854][106225] Updated weights for policy 1, policy_version 1739989 (0.0007) [2023-12-28 07:44:10,912][106225] Updated weights for policy 1, policy_version 1739999 (0.0008) [2023-12-28 07:44:11,142][106226] Updated weights for policy 0, policy_version 1735761 (0.0008) [2023-12-28 07:44:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 889929728. Throughput: 0: 10103.5, 1: 9908.5. Samples: 889901608. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:44:11,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-4.764')] [2023-12-28 07:44:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001740008_445497344.pth... [2023-12-28 07:44:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001738856_445202432.pth [2023-12-28 07:44:11,211][106226] Updated weights for policy 0, policy_version 1735771 (0.0008) [2023-12-28 07:44:11,284][106226] Updated weights for policy 0, policy_version 1735781 (0.0008) [2023-12-28 07:44:11,298][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001735784_444440576.pth... [2023-12-28 07:44:11,303][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001734568_444129280.pth [2023-12-28 07:44:11,623][106225] Updated weights for policy 1, policy_version 1740009 (0.0008) [2023-12-28 07:44:11,686][106225] Updated weights for policy 1, policy_version 1740019 (0.0009) [2023-12-28 07:44:11,750][106225] Updated weights for policy 1, policy_version 1740029 (0.0009) [2023-12-28 07:44:11,814][106225] Updated weights for policy 1, policy_version 1740039 (0.0008) [2023-12-28 07:44:12,125][106226] Updated weights for policy 0, policy_version 1735791 (0.0009) [2023-12-28 07:44:12,175][106226] Updated weights for policy 0, policy_version 1735801 (0.0008) [2023-12-28 07:44:12,243][106226] Updated weights for policy 0, policy_version 1735811 (0.0008) [2023-12-28 07:44:12,545][106225] Updated weights for policy 1, policy_version 1740049 (0.0009) [2023-12-28 07:44:12,607][106225] Updated weights for policy 1, policy_version 1740059 (0.0009) [2023-12-28 07:44:12,671][106225] Updated weights for policy 1, policy_version 1740069 (0.0008) [2023-12-28 07:44:13,003][106226] Updated weights for policy 0, policy_version 1735821 (0.0008) [2023-12-28 07:44:13,053][106226] Updated weights for policy 0, policy_version 1735831 (0.0008) [2023-12-28 07:44:13,110][106226] Updated weights for policy 0, policy_version 1735841 (0.0009) [2023-12-28 07:44:13,376][106225] Updated weights for policy 1, policy_version 1740079 (0.0009) [2023-12-28 07:44:13,428][106225] Updated weights for policy 1, policy_version 1740089 (0.0008) [2023-12-28 07:44:13,478][106225] Updated weights for policy 1, policy_version 1740099 (0.0008) [2023-12-28 07:44:13,853][106226] Updated weights for policy 0, policy_version 1735851 (0.0008) [2023-12-28 07:44:13,906][106226] Updated weights for policy 0, policy_version 1735861 (0.0008) [2023-12-28 07:44:13,954][106226] Updated weights for policy 0, policy_version 1735871 (0.0009) [2023-12-28 07:44:14,187][106225] Updated weights for policy 1, policy_version 1740109 (0.0009) [2023-12-28 07:44:14,247][106225] Updated weights for policy 1, policy_version 1740119 (0.0006) [2023-12-28 07:44:14,306][106225] Updated weights for policy 1, policy_version 1740129 (0.0005) [2023-12-28 07:44:14,592][106226] Updated weights for policy 0, policy_version 1735881 (0.0008) [2023-12-28 07:44:14,653][106226] Updated weights for policy 0, policy_version 1735891 (0.0006) [2023-12-28 07:44:14,717][106226] Updated weights for policy 0, policy_version 1735901 (0.0005) [2023-12-28 07:44:14,780][106226] Updated weights for policy 0, policy_version 1735911 (0.0007) [2023-12-28 07:44:14,951][106225] Updated weights for policy 1, policy_version 1740139 (0.0006) [2023-12-28 07:44:15,014][106225] Updated weights for policy 1, policy_version 1740149 (0.0008) [2023-12-28 07:44:15,074][106225] Updated weights for policy 1, policy_version 1740159 (0.0009) [2023-12-28 07:44:15,428][106226] Updated weights for policy 0, policy_version 1735921 (0.0008) [2023-12-28 07:44:15,481][106226] Updated weights for policy 0, policy_version 1735931 (0.0009) [2023-12-28 07:44:15,536][106226] Updated weights for policy 0, policy_version 1735941 (0.0008) [2023-12-28 07:44:15,807][106225] Updated weights for policy 1, policy_version 1740169 (0.0009) [2023-12-28 07:44:15,870][106225] Updated weights for policy 1, policy_version 1740179 (0.0008) [2023-12-28 07:44:15,939][106225] Updated weights for policy 1, policy_version 1740189 (0.0009) [2023-12-28 07:44:16,005][106225] Updated weights for policy 1, policy_version 1740199 (0.0010) [2023-12-28 07:44:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 890028032. Throughput: 0: 10146.4, 1: 9837.5. Samples: 890019396. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-28 07:44:16,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-5.078')] [2023-12-28 07:44:16,222][106226] Updated weights for policy 0, policy_version 1735951 (0.0009) [2023-12-28 07:44:16,279][106226] Updated weights for policy 0, policy_version 1735961 (0.0006) [2023-12-28 07:44:16,334][106226] Updated weights for policy 0, policy_version 1735971 (0.0007) [2023-12-28 07:44:16,742][106225] Updated weights for policy 1, policy_version 1740209 (0.0008) [2023-12-28 07:44:16,805][106225] Updated weights for policy 1, policy_version 1740219 (0.0008) [2023-12-28 07:44:16,863][106225] Updated weights for policy 1, policy_version 1740229 (0.0005) [2023-12-28 07:44:17,068][106226] Updated weights for policy 0, policy_version 1735981 (0.0009) [2023-12-28 07:44:17,134][106226] Updated weights for policy 0, policy_version 1735991 (0.0008) [2023-12-28 07:44:17,192][106226] Updated weights for policy 0, policy_version 1736001 (0.0008) [2023-12-28 07:44:17,497][106225] Updated weights for policy 1, policy_version 1740239 (0.0005) [2023-12-28 07:44:17,549][106225] Updated weights for policy 1, policy_version 1740249 (0.0006) [2023-12-28 07:44:17,593][106225] Updated weights for policy 1, policy_version 1740259 (0.0008) [2023-12-28 07:44:17,979][106226] Updated weights for policy 0, policy_version 1736011 (0.0009) [2023-12-28 07:44:18,038][106226] Updated weights for policy 0, policy_version 1736021 (0.0008) [2023-12-28 07:44:18,098][106226] Updated weights for policy 0, policy_version 1736031 (0.0008) [2023-12-28 07:44:18,232][106225] Updated weights for policy 1, policy_version 1740269 (0.0008) [2023-12-28 07:44:18,284][106225] Updated weights for policy 1, policy_version 1740279 (0.0007) [2023-12-28 07:44:18,356][106225] Updated weights for policy 1, policy_version 1740289 (0.0006) [2023-12-28 07:44:18,917][106226] Updated weights for policy 0, policy_version 1736041 (0.0009) [2023-12-28 07:44:18,969][106225] Updated weights for policy 1, policy_version 1740299 (0.0008) [2023-12-28 07:44:18,975][106226] Updated weights for policy 0, policy_version 1736051 (0.0008) [2023-12-28 07:44:19,019][106225] Updated weights for policy 1, policy_version 1740309 (0.0010) [2023-12-28 07:44:19,025][106226] Updated weights for policy 0, policy_version 1736061 (0.0005) [2023-12-28 07:44:19,077][106226] Updated weights for policy 0, policy_version 1736071 (0.0008) [2023-12-28 07:44:19,079][106225] Updated weights for policy 1, policy_version 1740319 (0.0010) [2023-12-28 07:44:19,803][106225] Updated weights for policy 1, policy_version 1740329 (0.0010) [2023-12-28 07:44:19,806][106226] Updated weights for policy 0, policy_version 1736081 (0.0007) [2023-12-28 07:44:19,874][106226] Updated weights for policy 0, policy_version 1736091 (0.0008) [2023-12-28 07:44:19,878][106225] Updated weights for policy 1, policy_version 1740339 (0.0007) [2023-12-28 07:44:19,936][106226] Updated weights for policy 0, policy_version 1736101 (0.0008) [2023-12-28 07:44:19,951][106225] Updated weights for policy 1, policy_version 1740349 (0.0007) [2023-12-28 07:44:20,014][106225] Updated weights for policy 1, policy_version 1740359 (0.0009) [2023-12-28 07:44:20,693][106225] Updated weights for policy 1, policy_version 1740369 (0.0008) [2023-12-28 07:44:20,705][106226] Updated weights for policy 0, policy_version 1736111 (0.0008) [2023-12-28 07:44:20,753][106225] Updated weights for policy 1, policy_version 1740379 (0.0007) [2023-12-28 07:44:20,772][106226] Updated weights for policy 0, policy_version 1736121 (0.0008) [2023-12-28 07:44:20,819][106225] Updated weights for policy 1, policy_version 1740389 (0.0007) [2023-12-28 07:44:20,835][106226] Updated weights for policy 0, policy_version 1736131 (0.0008) [2023-12-28 07:44:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 890126336. Throughput: 0: 10005.0, 1: 9804.5. Samples: 890134712. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:21,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.062')] [2023-12-28 07:44:21,594][106226] Updated weights for policy 0, policy_version 1736141 (0.0008) [2023-12-28 07:44:21,622][106225] Updated weights for policy 1, policy_version 1740399 (0.0008) [2023-12-28 07:44:21,665][106226] Updated weights for policy 0, policy_version 1736151 (0.0009) [2023-12-28 07:44:21,694][106225] Updated weights for policy 1, policy_version 1740409 (0.0009) [2023-12-28 07:44:21,738][106226] Updated weights for policy 0, policy_version 1736161 (0.0008) [2023-12-28 07:44:21,765][106225] Updated weights for policy 1, policy_version 1740419 (0.0008) [2023-12-28 07:44:22,433][106226] Updated weights for policy 0, policy_version 1736171 (0.0007) [2023-12-28 07:44:22,508][106226] Updated weights for policy 0, policy_version 1736181 (0.0006) [2023-12-28 07:44:22,517][106225] Updated weights for policy 1, policy_version 1740429 (0.0009) [2023-12-28 07:44:22,572][106226] Updated weights for policy 0, policy_version 1736191 (0.0006) [2023-12-28 07:44:22,584][106225] Updated weights for policy 1, policy_version 1740439 (0.0009) [2023-12-28 07:44:22,650][106225] Updated weights for policy 1, policy_version 1740449 (0.0006) [2023-12-28 07:44:23,161][106226] Updated weights for policy 0, policy_version 1736201 (0.0006) [2023-12-28 07:44:23,231][106226] Updated weights for policy 0, policy_version 1736211 (0.0006) [2023-12-28 07:44:23,305][106226] Updated weights for policy 0, policy_version 1736221 (0.0006) [2023-12-28 07:44:23,363][106226] Updated weights for policy 0, policy_version 1736231 (0.0009) [2023-12-28 07:44:23,444][106225] Updated weights for policy 1, policy_version 1740459 (0.0008) [2023-12-28 07:44:23,507][106225] Updated weights for policy 1, policy_version 1740469 (0.0009) [2023-12-28 07:44:23,564][106225] Updated weights for policy 1, policy_version 1740479 (0.0009) [2023-12-28 07:44:23,868][106226] Updated weights for policy 0, policy_version 1736241 (0.0005) [2023-12-28 07:44:23,926][106226] Updated weights for policy 0, policy_version 1736251 (0.0006) [2023-12-28 07:44:23,996][106226] Updated weights for policy 0, policy_version 1736261 (0.0005) [2023-12-28 07:44:24,392][106225] Updated weights for policy 1, policy_version 1740489 (0.0008) [2023-12-28 07:44:24,446][106225] Updated weights for policy 1, policy_version 1740499 (0.0009) [2023-12-28 07:44:24,495][106225] Updated weights for policy 1, policy_version 1740509 (0.0010) [2023-12-28 07:44:24,507][106226] Updated weights for policy 0, policy_version 1736271 (0.0008) [2023-12-28 07:44:24,556][106225] Updated weights for policy 1, policy_version 1740519 (0.0010) [2023-12-28 07:44:24,557][106226] Updated weights for policy 0, policy_version 1736281 (0.0006) [2023-12-28 07:44:24,605][106226] Updated weights for policy 0, policy_version 1736291 (0.0005) [2023-12-28 07:44:25,131][106226] Updated weights for policy 0, policy_version 1736301 (0.0005) [2023-12-28 07:44:25,189][106226] Updated weights for policy 0, policy_version 1736311 (0.0005) [2023-12-28 07:44:25,227][106225] Updated weights for policy 1, policy_version 1740529 (0.0006) [2023-12-28 07:44:25,249][106226] Updated weights for policy 0, policy_version 1736321 (0.0006) [2023-12-28 07:44:25,291][106225] Updated weights for policy 1, policy_version 1740539 (0.0007) [2023-12-28 07:44:25,344][106225] Updated weights for policy 1, policy_version 1740549 (0.0008) [2023-12-28 07:44:25,847][106226] Updated weights for policy 0, policy_version 1736331 (0.0006) [2023-12-28 07:44:25,896][106226] Updated weights for policy 0, policy_version 1736341 (0.0005) [2023-12-28 07:44:25,942][106226] Updated weights for policy 0, policy_version 1736351 (0.0005) [2023-12-28 07:44:26,025][106225] Updated weights for policy 1, policy_version 1740559 (0.0007) [2023-12-28 07:44:26,088][106225] Updated weights for policy 1, policy_version 1740569 (0.0005) [2023-12-28 07:44:26,152][106225] Updated weights for policy 1, policy_version 1740579 (0.0005) [2023-12-28 07:44:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 890224640. Throughput: 0: 10004.8, 1: 9753.6. Samples: 890193264. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:26,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.799')] [2023-12-28 07:44:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001736360_444588032.pth... [2023-12-28 07:44:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001740584_445644800.pth... [2023-12-28 07:44:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001735144_444276736.pth [2023-12-28 07:44:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001739432_445349888.pth [2023-12-28 07:44:26,596][106226] Updated weights for policy 0, policy_version 1736361 (0.0008) [2023-12-28 07:44:26,670][106226] Updated weights for policy 0, policy_version 1736371 (0.0011) [2023-12-28 07:44:26,707][106225] Updated weights for policy 1, policy_version 1740589 (0.0007) [2023-12-28 07:44:26,730][106226] Updated weights for policy 0, policy_version 1736381 (0.0011) [2023-12-28 07:44:26,763][106225] Updated weights for policy 1, policy_version 1740599 (0.0008) [2023-12-28 07:44:26,788][106226] Updated weights for policy 0, policy_version 1736391 (0.0010) [2023-12-28 07:44:26,814][106225] Updated weights for policy 1, policy_version 1740609 (0.0005) [2023-12-28 07:44:27,357][106226] Updated weights for policy 0, policy_version 1736401 (0.0007) [2023-12-28 07:44:27,413][106226] Updated weights for policy 0, policy_version 1736411 (0.0007) [2023-12-28 07:44:27,469][106226] Updated weights for policy 0, policy_version 1736421 (0.0008) [2023-12-28 07:44:27,518][106225] Updated weights for policy 1, policy_version 1740619 (0.0006) [2023-12-28 07:44:27,583][106225] Updated weights for policy 1, policy_version 1740629 (0.0008) [2023-12-28 07:44:27,650][106225] Updated weights for policy 1, policy_version 1740639 (0.0008) [2023-12-28 07:44:28,127][106226] Updated weights for policy 0, policy_version 1736431 (0.0007) [2023-12-28 07:44:28,188][106226] Updated weights for policy 0, policy_version 1736441 (0.0008) [2023-12-28 07:44:28,239][106226] Updated weights for policy 0, policy_version 1736451 (0.0008) [2023-12-28 07:44:28,359][106225] Updated weights for policy 1, policy_version 1740649 (0.0008) [2023-12-28 07:44:28,421][106225] Updated weights for policy 1, policy_version 1740659 (0.0008) [2023-12-28 07:44:28,484][106225] Updated weights for policy 1, policy_version 1740669 (0.0006) [2023-12-28 07:44:28,543][106225] Updated weights for policy 1, policy_version 1740679 (0.0008) [2023-12-28 07:44:28,935][106226] Updated weights for policy 0, policy_version 1736461 (0.0007) [2023-12-28 07:44:28,988][106226] Updated weights for policy 0, policy_version 1736471 (0.0008) [2023-12-28 07:44:29,040][106226] Updated weights for policy 0, policy_version 1736481 (0.0008) [2023-12-28 07:44:29,297][106225] Updated weights for policy 1, policy_version 1740689 (0.0009) [2023-12-28 07:44:29,367][106225] Updated weights for policy 1, policy_version 1740699 (0.0008) [2023-12-28 07:44:29,433][106225] Updated weights for policy 1, policy_version 1740709 (0.0008) [2023-12-28 07:44:29,728][106226] Updated weights for policy 0, policy_version 1736491 (0.0006) [2023-12-28 07:44:29,787][106226] Updated weights for policy 0, policy_version 1736501 (0.0010) [2023-12-28 07:44:29,857][106226] Updated weights for policy 0, policy_version 1736511 (0.0010) [2023-12-28 07:44:30,182][106225] Updated weights for policy 1, policy_version 1740719 (0.0009) [2023-12-28 07:44:30,247][106225] Updated weights for policy 1, policy_version 1740729 (0.0008) [2023-12-28 07:44:30,317][106225] Updated weights for policy 1, policy_version 1740739 (0.0008) [2023-12-28 07:44:30,475][106226] Updated weights for policy 0, policy_version 1736521 (0.0006) [2023-12-28 07:44:30,531][106226] Updated weights for policy 0, policy_version 1736531 (0.0006) [2023-12-28 07:44:30,580][106226] Updated weights for policy 0, policy_version 1736541 (0.0006) [2023-12-28 07:44:30,640][106226] Updated weights for policy 0, policy_version 1736551 (0.0009) [2023-12-28 07:44:30,924][106225] Updated weights for policy 1, policy_version 1740749 (0.0009) [2023-12-28 07:44:30,995][106225] Updated weights for policy 1, policy_version 1740759 (0.0007) [2023-12-28 07:44:31,061][106225] Updated weights for policy 1, policy_version 1740769 (0.0008) [2023-12-28 07:44:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 890331136. Throughput: 0: 10183.7, 1: 9764.4. Samples: 890318460. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:31,176][105115] Avg episode reward: [(0, '-4.562'), (1, '-4.832')] [2023-12-28 07:44:31,426][106226] Updated weights for policy 0, policy_version 1736561 (0.0007) [2023-12-28 07:44:31,487][106226] Updated weights for policy 0, policy_version 1736571 (0.0010) [2023-12-28 07:44:31,546][106226] Updated weights for policy 0, policy_version 1736581 (0.0010) [2023-12-28 07:44:31,770][106225] Updated weights for policy 1, policy_version 1740779 (0.0006) [2023-12-28 07:44:31,835][106225] Updated weights for policy 1, policy_version 1740789 (0.0008) [2023-12-28 07:44:31,890][106225] Updated weights for policy 1, policy_version 1740799 (0.0008) [2023-12-28 07:44:32,268][106226] Updated weights for policy 0, policy_version 1736591 (0.0007) [2023-12-28 07:44:32,332][106226] Updated weights for policy 0, policy_version 1736601 (0.0008) [2023-12-28 07:44:32,402][106226] Updated weights for policy 0, policy_version 1736611 (0.0010) [2023-12-28 07:44:32,610][106225] Updated weights for policy 1, policy_version 1740809 (0.0007) [2023-12-28 07:44:32,664][106225] Updated weights for policy 1, policy_version 1740819 (0.0005) [2023-12-28 07:44:32,712][106225] Updated weights for policy 1, policy_version 1740829 (0.0006) [2023-12-28 07:44:32,775][106225] Updated weights for policy 1, policy_version 1740839 (0.0008) [2023-12-28 07:44:33,120][106226] Updated weights for policy 0, policy_version 1736621 (0.0009) [2023-12-28 07:44:33,174][106226] Updated weights for policy 0, policy_version 1736631 (0.0008) [2023-12-28 07:44:33,222][106226] Updated weights for policy 0, policy_version 1736641 (0.0007) [2023-12-28 07:44:33,459][106225] Updated weights for policy 1, policy_version 1740849 (0.0009) [2023-12-28 07:44:33,520][106225] Updated weights for policy 1, policy_version 1740859 (0.0007) [2023-12-28 07:44:33,574][106225] Updated weights for policy 1, policy_version 1740869 (0.0009) [2023-12-28 07:44:33,853][106226] Updated weights for policy 0, policy_version 1736651 (0.0008) [2023-12-28 07:44:33,907][106226] Updated weights for policy 0, policy_version 1736661 (0.0008) [2023-12-28 07:44:33,961][106226] Updated weights for policy 0, policy_version 1736671 (0.0007) [2023-12-28 07:44:34,177][106225] Updated weights for policy 1, policy_version 1740879 (0.0007) [2023-12-28 07:44:34,236][106225] Updated weights for policy 1, policy_version 1740889 (0.0008) [2023-12-28 07:44:34,291][106225] Updated weights for policy 1, policy_version 1740899 (0.0008) [2023-12-28 07:44:34,652][106226] Updated weights for policy 0, policy_version 1736681 (0.0006) [2023-12-28 07:44:34,711][106226] Updated weights for policy 0, policy_version 1736691 (0.0008) [2023-12-28 07:44:34,780][106226] Updated weights for policy 0, policy_version 1736701 (0.0008) [2023-12-28 07:44:34,846][106226] Updated weights for policy 0, policy_version 1736711 (0.0008) [2023-12-28 07:44:34,947][106225] Updated weights for policy 1, policy_version 1740909 (0.0008) [2023-12-28 07:44:35,000][106225] Updated weights for policy 1, policy_version 1740919 (0.0008) [2023-12-28 07:44:35,063][106225] Updated weights for policy 1, policy_version 1740929 (0.0008) [2023-12-28 07:44:35,540][106226] Updated weights for policy 0, policy_version 1736721 (0.0010) [2023-12-28 07:44:35,599][106226] Updated weights for policy 0, policy_version 1736731 (0.0011) [2023-12-28 07:44:35,653][106225] Updated weights for policy 1, policy_version 1740939 (0.0007) [2023-12-28 07:44:35,659][106226] Updated weights for policy 0, policy_version 1736741 (0.0010) [2023-12-28 07:44:35,711][106225] Updated weights for policy 1, policy_version 1740949 (0.0007) [2023-12-28 07:44:35,770][106225] Updated weights for policy 1, policy_version 1740959 (0.0006) [2023-12-28 07:44:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 890429440. Throughput: 0: 10209.6, 1: 9816.9. Samples: 890439640. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:36,175][105115] Avg episode reward: [(0, '-4.178'), (1, '-4.756')] [2023-12-28 07:44:36,314][106226] Updated weights for policy 0, policy_version 1736751 (0.0009) [2023-12-28 07:44:36,374][106226] Updated weights for policy 0, policy_version 1736761 (0.0008) [2023-12-28 07:44:36,436][106226] Updated weights for policy 0, policy_version 1736771 (0.0007) [2023-12-28 07:44:36,474][106225] Updated weights for policy 1, policy_version 1740969 (0.0006) [2023-12-28 07:44:36,540][106225] Updated weights for policy 1, policy_version 1740979 (0.0008) [2023-12-28 07:44:36,596][106225] Updated weights for policy 1, policy_version 1740989 (0.0008) [2023-12-28 07:44:36,657][106225] Updated weights for policy 1, policy_version 1740999 (0.0009) [2023-12-28 07:44:37,152][106226] Updated weights for policy 0, policy_version 1736781 (0.0009) [2023-12-28 07:44:37,212][106226] Updated weights for policy 0, policy_version 1736791 (0.0009) [2023-12-28 07:44:37,267][106226] Updated weights for policy 0, policy_version 1736801 (0.0009) [2023-12-28 07:44:37,370][106225] Updated weights for policy 1, policy_version 1741009 (0.0009) [2023-12-28 07:44:37,423][106225] Updated weights for policy 1, policy_version 1741019 (0.0009) [2023-12-28 07:44:37,473][106225] Updated weights for policy 1, policy_version 1741029 (0.0008) [2023-12-28 07:44:38,040][106226] Updated weights for policy 0, policy_version 1736811 (0.0008) [2023-12-28 07:44:38,095][106226] Updated weights for policy 0, policy_version 1736821 (0.0009) [2023-12-28 07:44:38,133][106225] Updated weights for policy 1, policy_version 1741039 (0.0006) [2023-12-28 07:44:38,155][106226] Updated weights for policy 0, policy_version 1736831 (0.0008) [2023-12-28 07:44:38,187][106225] Updated weights for policy 1, policy_version 1741049 (0.0005) [2023-12-28 07:44:38,245][106225] Updated weights for policy 1, policy_version 1741059 (0.0006) [2023-12-28 07:44:38,913][106226] Updated weights for policy 0, policy_version 1736841 (0.0008) [2023-12-28 07:44:38,960][106225] Updated weights for policy 1, policy_version 1741069 (0.0007) [2023-12-28 07:44:38,962][106226] Updated weights for policy 0, policy_version 1736851 (0.0007) [2023-12-28 07:44:39,012][106225] Updated weights for policy 1, policy_version 1741079 (0.0006) [2023-12-28 07:44:39,020][106226] Updated weights for policy 0, policy_version 1736861 (0.0007) [2023-12-28 07:44:39,064][106225] Updated weights for policy 1, policy_version 1741089 (0.0007) [2023-12-28 07:44:39,080][106226] Updated weights for policy 0, policy_version 1736871 (0.0007) [2023-12-28 07:44:39,849][106225] Updated weights for policy 1, policy_version 1741099 (0.0007) [2023-12-28 07:44:39,874][106226] Updated weights for policy 0, policy_version 1736881 (0.0008) [2023-12-28 07:44:39,911][106225] Updated weights for policy 1, policy_version 1741109 (0.0008) [2023-12-28 07:44:39,939][106226] Updated weights for policy 0, policy_version 1736891 (0.0008) [2023-12-28 07:44:39,981][106225] Updated weights for policy 1, policy_version 1741119 (0.0007) [2023-12-28 07:44:40,001][106226] Updated weights for policy 0, policy_version 1736901 (0.0008) [2023-12-28 07:44:40,674][106225] Updated weights for policy 1, policy_version 1741129 (0.0006) [2023-12-28 07:44:40,735][106225] Updated weights for policy 1, policy_version 1741139 (0.0009) [2023-12-28 07:44:40,749][106226] Updated weights for policy 0, policy_version 1736911 (0.0007) [2023-12-28 07:44:40,791][106225] Updated weights for policy 1, policy_version 1741149 (0.0007) [2023-12-28 07:44:40,805][106226] Updated weights for policy 0, policy_version 1736921 (0.0006) [2023-12-28 07:44:40,846][106225] Updated weights for policy 1, policy_version 1741159 (0.0007) [2023-12-28 07:44:40,852][106226] Updated weights for policy 0, policy_version 1736931 (0.0006) [2023-12-28 07:44:41,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 890527744. Throughput: 0: 10127.4, 1: 9851.5. Samples: 890497468. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:41,175][105115] Avg episode reward: [(0, '-4.221'), (1, '-4.897')] [2023-12-28 07:44:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001736936_444735488.pth... [2023-12-28 07:44:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001741160_445792256.pth... [2023-12-28 07:44:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001735784_444440576.pth [2023-12-28 07:44:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001740008_445497344.pth [2023-12-28 07:44:41,586][106225] Updated weights for policy 1, policy_version 1741169 (0.0010) [2023-12-28 07:44:41,657][106226] Updated weights for policy 0, policy_version 1736941 (0.0008) [2023-12-28 07:44:41,662][106225] Updated weights for policy 1, policy_version 1741181 (0.0010) [2023-12-28 07:44:41,716][106226] Updated weights for policy 0, policy_version 1736951 (0.0007) [2023-12-28 07:44:41,726][106225] Updated weights for policy 1, policy_version 1741191 (0.0011) [2023-12-28 07:44:41,786][106226] Updated weights for policy 0, policy_version 1736961 (0.0008) [2023-12-28 07:44:42,516][106226] Updated weights for policy 0, policy_version 1736971 (0.0007) [2023-12-28 07:44:42,522][106225] Updated weights for policy 1, policy_version 1741201 (0.0011) [2023-12-28 07:44:42,578][106226] Updated weights for policy 0, policy_version 1736981 (0.0005) [2023-12-28 07:44:42,580][106225] Updated weights for policy 1, policy_version 1741211 (0.0010) [2023-12-28 07:44:42,640][106226] Updated weights for policy 0, policy_version 1736991 (0.0005) [2023-12-28 07:44:42,641][106225] Updated weights for policy 1, policy_version 1741221 (0.0010) [2023-12-28 07:44:43,244][106226] Updated weights for policy 0, policy_version 1737001 (0.0007) [2023-12-28 07:44:43,302][106226] Updated weights for policy 0, policy_version 1737011 (0.0008) [2023-12-28 07:44:43,364][106226] Updated weights for policy 0, policy_version 1737021 (0.0010) [2023-12-28 07:44:43,387][106225] Updated weights for policy 1, policy_version 1741231 (0.0010) [2023-12-28 07:44:43,417][106226] Updated weights for policy 0, policy_version 1737031 (0.0010) [2023-12-28 07:44:43,441][106225] Updated weights for policy 1, policy_version 1741241 (0.0010) [2023-12-28 07:44:43,500][106225] Updated weights for policy 1, policy_version 1741251 (0.0010) [2023-12-28 07:44:44,000][106226] Updated weights for policy 0, policy_version 1737041 (0.0010) [2023-12-28 07:44:44,051][106226] Updated weights for policy 0, policy_version 1737051 (0.0010) [2023-12-28 07:44:44,103][106226] Updated weights for policy 0, policy_version 1737061 (0.0010) [2023-12-28 07:44:44,194][106225] Updated weights for policy 1, policy_version 1741261 (0.0010) [2023-12-28 07:44:44,251][106225] Updated weights for policy 1, policy_version 1741271 (0.0010) [2023-12-28 07:44:44,311][106225] Updated weights for policy 1, policy_version 1741281 (0.0009) [2023-12-28 07:44:44,720][106226] Updated weights for policy 0, policy_version 1737071 (0.0007) [2023-12-28 07:44:44,776][106226] Updated weights for policy 0, policy_version 1737081 (0.0006) [2023-12-28 07:44:44,832][106226] Updated weights for policy 0, policy_version 1737091 (0.0008) [2023-12-28 07:44:44,963][106225] Updated weights for policy 1, policy_version 1741291 (0.0008) [2023-12-28 07:44:45,025][106225] Updated weights for policy 1, policy_version 1741301 (0.0010) [2023-12-28 07:44:45,087][106225] Updated weights for policy 1, policy_version 1741311 (0.0010) [2023-12-28 07:44:45,593][106226] Updated weights for policy 0, policy_version 1737101 (0.0008) [2023-12-28 07:44:45,642][106226] Updated weights for policy 0, policy_version 1737111 (0.0007) [2023-12-28 07:44:45,685][106226] Updated weights for policy 0, policy_version 1737121 (0.0007) [2023-12-28 07:44:45,795][106225] Updated weights for policy 1, policy_version 1741321 (0.0010) [2023-12-28 07:44:45,845][106225] Updated weights for policy 1, policy_version 1741331 (0.0010) [2023-12-28 07:44:45,904][106225] Updated weights for policy 1, policy_version 1741341 (0.0010) [2023-12-28 07:44:45,950][106225] Updated weights for policy 1, policy_version 1741351 (0.0010) [2023-12-28 07:44:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 890626048. Throughput: 0: 10143.0, 1: 9768.7. Samples: 890614116. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:46,175][105115] Avg episode reward: [(0, '-4.058'), (1, '-4.929')] [2023-12-28 07:44:46,422][106226] Updated weights for policy 0, policy_version 1737131 (0.0009) [2023-12-28 07:44:46,485][106226] Updated weights for policy 0, policy_version 1737141 (0.0011) [2023-12-28 07:44:46,551][106226] Updated weights for policy 0, policy_version 1737151 (0.0010) [2023-12-28 07:44:46,709][106225] Updated weights for policy 1, policy_version 1741361 (0.0010) [2023-12-28 07:44:46,768][106225] Updated weights for policy 1, policy_version 1741371 (0.0007) [2023-12-28 07:44:46,833][106225] Updated weights for policy 1, policy_version 1741381 (0.0010) [2023-12-28 07:44:47,195][106226] Updated weights for policy 0, policy_version 1737161 (0.0006) [2023-12-28 07:44:47,253][106226] Updated weights for policy 0, policy_version 1737171 (0.0009) [2023-12-28 07:44:47,309][106226] Updated weights for policy 0, policy_version 1737181 (0.0009) [2023-12-28 07:44:47,359][106226] Updated weights for policy 0, policy_version 1737191 (0.0010) [2023-12-28 07:44:47,512][106225] Updated weights for policy 1, policy_version 1741391 (0.0009) [2023-12-28 07:44:47,568][106225] Updated weights for policy 1, policy_version 1741401 (0.0006) [2023-12-28 07:44:47,621][106225] Updated weights for policy 1, policy_version 1741411 (0.0005) [2023-12-28 07:44:48,044][106226] Updated weights for policy 0, policy_version 1737201 (0.0011) [2023-12-28 07:44:48,094][106226] Updated weights for policy 0, policy_version 1737211 (0.0010) [2023-12-28 07:44:48,148][106226] Updated weights for policy 0, policy_version 1737221 (0.0011) [2023-12-28 07:44:48,173][106225] Updated weights for policy 1, policy_version 1741421 (0.0007) [2023-12-28 07:44:48,227][106225] Updated weights for policy 1, policy_version 1741431 (0.0008) [2023-12-28 07:44:48,286][106225] Updated weights for policy 1, policy_version 1741441 (0.0006) [2023-12-28 07:44:48,836][106226] Updated weights for policy 0, policy_version 1737231 (0.0011) [2023-12-28 07:44:48,894][106226] Updated weights for policy 0, policy_version 1737241 (0.0011) [2023-12-28 07:44:48,938][106225] Updated weights for policy 1, policy_version 1741451 (0.0006) [2023-12-28 07:44:48,962][106226] Updated weights for policy 0, policy_version 1737251 (0.0010) [2023-12-28 07:44:48,996][106225] Updated weights for policy 1, policy_version 1741461 (0.0006) [2023-12-28 07:44:49,059][106225] Updated weights for policy 1, policy_version 1741471 (0.0008) [2023-12-28 07:44:49,660][106226] Updated weights for policy 0, policy_version 1737261 (0.0011) [2023-12-28 07:44:49,716][106226] Updated weights for policy 0, policy_version 1737271 (0.0010) [2023-12-28 07:44:49,769][106226] Updated weights for policy 0, policy_version 1737281 (0.0011) [2023-12-28 07:44:49,784][106225] Updated weights for policy 1, policy_version 1741481 (0.0007) [2023-12-28 07:44:49,854][106225] Updated weights for policy 1, policy_version 1741491 (0.0009) [2023-12-28 07:44:49,918][106225] Updated weights for policy 1, policy_version 1741501 (0.0006) [2023-12-28 07:44:49,982][106225] Updated weights for policy 1, policy_version 1741511 (0.0008) [2023-12-28 07:44:50,541][106226] Updated weights for policy 0, policy_version 1737291 (0.0011) [2023-12-28 07:44:50,609][106226] Updated weights for policy 0, policy_version 1737301 (0.0010) [2023-12-28 07:44:50,672][106226] Updated weights for policy 0, policy_version 1737311 (0.0007) [2023-12-28 07:44:50,763][106225] Updated weights for policy 1, policy_version 1741521 (0.0006) [2023-12-28 07:44:50,829][106225] Updated weights for policy 1, policy_version 1741531 (0.0006) [2023-12-28 07:44:50,897][106225] Updated weights for policy 1, policy_version 1741541 (0.0007) [2023-12-28 07:44:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 890724352. Throughput: 0: 10005.2, 1: 9826.0. Samples: 890732716. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:51,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.902')] [2023-12-28 07:44:51,452][106226] Updated weights for policy 0, policy_version 1737321 (0.0007) [2023-12-28 07:44:51,506][106225] Updated weights for policy 1, policy_version 1741551 (0.0007) [2023-12-28 07:44:51,511][106226] Updated weights for policy 0, policy_version 1737331 (0.0008) [2023-12-28 07:44:51,565][106225] Updated weights for policy 1, policy_version 1741561 (0.0008) [2023-12-28 07:44:51,569][106226] Updated weights for policy 0, policy_version 1737341 (0.0008) [2023-12-28 07:44:51,621][106225] Updated weights for policy 1, policy_version 1741571 (0.0008) [2023-12-28 07:44:51,636][106226] Updated weights for policy 0, policy_version 1737351 (0.0006) [2023-12-28 07:44:52,362][106225] Updated weights for policy 1, policy_version 1741581 (0.0008) [2023-12-28 07:44:52,419][106226] Updated weights for policy 0, policy_version 1737361 (0.0007) [2023-12-28 07:44:52,421][106225] Updated weights for policy 1, policy_version 1741591 (0.0006) [2023-12-28 07:44:52,479][106226] Updated weights for policy 0, policy_version 1737371 (0.0008) [2023-12-28 07:44:52,483][106225] Updated weights for policy 1, policy_version 1741601 (0.0005) [2023-12-28 07:44:52,540][106226] Updated weights for policy 0, policy_version 1737381 (0.0009) [2023-12-28 07:44:53,185][106226] Updated weights for policy 0, policy_version 1737391 (0.0007) [2023-12-28 07:44:53,194][106225] Updated weights for policy 1, policy_version 1741611 (0.0007) [2023-12-28 07:44:53,245][106225] Updated weights for policy 1, policy_version 1741621 (0.0007) [2023-12-28 07:44:53,248][106226] Updated weights for policy 0, policy_version 1737401 (0.0008) [2023-12-28 07:44:53,296][106225] Updated weights for policy 1, policy_version 1741631 (0.0007) [2023-12-28 07:44:53,307][106226] Updated weights for policy 0, policy_version 1737411 (0.0007) [2023-12-28 07:44:53,931][106226] Updated weights for policy 0, policy_version 1737421 (0.0008) [2023-12-28 07:44:53,964][106225] Updated weights for policy 1, policy_version 1741641 (0.0007) [2023-12-28 07:44:53,975][106226] Updated weights for policy 0, policy_version 1737431 (0.0008) [2023-12-28 07:44:54,016][106225] Updated weights for policy 1, policy_version 1741651 (0.0007) [2023-12-28 07:44:54,024][106226] Updated weights for policy 0, policy_version 1737441 (0.0005) [2023-12-28 07:44:54,069][106225] Updated weights for policy 1, policy_version 1741661 (0.0008) [2023-12-28 07:44:54,122][106225] Updated weights for policy 1, policy_version 1741671 (0.0009) [2023-12-28 07:44:54,685][106226] Updated weights for policy 0, policy_version 1737451 (0.0006) [2023-12-28 07:44:54,748][106226] Updated weights for policy 0, policy_version 1737461 (0.0010) [2023-12-28 07:44:54,802][106226] Updated weights for policy 0, policy_version 1737471 (0.0009) [2023-12-28 07:44:54,859][106225] Updated weights for policy 1, policy_version 1741681 (0.0006) [2023-12-28 07:44:54,916][106225] Updated weights for policy 1, policy_version 1741691 (0.0008) [2023-12-28 07:44:54,964][106225] Updated weights for policy 1, policy_version 1741701 (0.0008) [2023-12-28 07:44:55,592][106226] Updated weights for policy 0, policy_version 1737481 (0.0007) [2023-12-28 07:44:55,594][106225] Updated weights for policy 1, policy_version 1741711 (0.0008) [2023-12-28 07:44:55,646][106225] Updated weights for policy 1, policy_version 1741721 (0.0005) [2023-12-28 07:44:55,646][106226] Updated weights for policy 0, policy_version 1737491 (0.0007) [2023-12-28 07:44:55,701][106226] Updated weights for policy 0, policy_version 1737501 (0.0007) [2023-12-28 07:44:55,703][106225] Updated weights for policy 1, policy_version 1741731 (0.0005) [2023-12-28 07:44:55,754][106226] Updated weights for policy 0, policy_version 1737511 (0.0007) [2023-12-28 07:44:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 890822656. Throughput: 0: 9946.9, 1: 9844.8. Samples: 890792236. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:44:56,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.876')] [2023-12-28 07:44:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001741736_445939712.pth... [2023-12-28 07:44:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001737512_444882944.pth... [2023-12-28 07:44:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001740584_445644800.pth [2023-12-28 07:44:56,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001736360_444588032.pth [2023-12-28 07:44:56,311][106225] Updated weights for policy 1, policy_version 1741741 (0.0006) [2023-12-28 07:44:56,363][106226] Updated weights for policy 0, policy_version 1737521 (0.0007) [2023-12-28 07:44:56,367][106225] Updated weights for policy 1, policy_version 1741751 (0.0005) [2023-12-28 07:44:56,415][106226] Updated weights for policy 0, policy_version 1737531 (0.0010) [2023-12-28 07:44:56,418][106225] Updated weights for policy 1, policy_version 1741761 (0.0007) [2023-12-28 07:44:56,472][106226] Updated weights for policy 0, policy_version 1737541 (0.0010) [2023-12-28 07:44:57,006][106225] Updated weights for policy 1, policy_version 1741771 (0.0009) [2023-12-28 07:44:57,071][106225] Updated weights for policy 1, policy_version 1741781 (0.0008) [2023-12-28 07:44:57,124][106225] Updated weights for policy 1, policy_version 1741791 (0.0010) [2023-12-28 07:44:57,132][106226] Updated weights for policy 0, policy_version 1737551 (0.0007) [2023-12-28 07:44:57,191][106226] Updated weights for policy 0, policy_version 1737561 (0.0008) [2023-12-28 07:44:57,238][106226] Updated weights for policy 0, policy_version 1737571 (0.0007) [2023-12-28 07:44:57,821][106225] Updated weights for policy 1, policy_version 1741801 (0.0010) [2023-12-28 07:44:57,866][106225] Updated weights for policy 1, policy_version 1741811 (0.0010) [2023-12-28 07:44:57,910][106226] Updated weights for policy 0, policy_version 1737581 (0.0006) [2023-12-28 07:44:57,916][106225] Updated weights for policy 1, policy_version 1741821 (0.0010) [2023-12-28 07:44:57,966][106226] Updated weights for policy 0, policy_version 1737591 (0.0005) [2023-12-28 07:44:57,972][106225] Updated weights for policy 1, policy_version 1741831 (0.0010) [2023-12-28 07:44:58,021][106226] Updated weights for policy 0, policy_version 1737601 (0.0007) [2023-12-28 07:44:58,764][106225] Updated weights for policy 1, policy_version 1741841 (0.0010) [2023-12-28 07:44:58,819][106225] Updated weights for policy 1, policy_version 1741851 (0.0009) [2023-12-28 07:44:58,883][106225] Updated weights for policy 1, policy_version 1741861 (0.0009) [2023-12-28 07:44:58,885][106226] Updated weights for policy 0, policy_version 1737611 (0.0008) [2023-12-28 07:44:58,952][106226] Updated weights for policy 0, policy_version 1737621 (0.0008) [2023-12-28 07:44:59,015][106226] Updated weights for policy 0, policy_version 1737631 (0.0011) [2023-12-28 07:44:59,697][106225] Updated weights for policy 1, policy_version 1741871 (0.0009) [2023-12-28 07:44:59,766][106225] Updated weights for policy 1, policy_version 1741881 (0.0010) [2023-12-28 07:44:59,832][106226] Updated weights for policy 0, policy_version 1737641 (0.0010) [2023-12-28 07:44:59,838][106225] Updated weights for policy 1, policy_version 1741891 (0.0011) [2023-12-28 07:44:59,900][106226] Updated weights for policy 0, policy_version 1737651 (0.0007) [2023-12-28 07:44:59,969][106226] Updated weights for policy 0, policy_version 1737661 (0.0008) [2023-12-28 07:45:00,031][106226] Updated weights for policy 0, policy_version 1737671 (0.0008) [2023-12-28 07:45:00,526][106225] Updated weights for policy 1, policy_version 1741901 (0.0011) [2023-12-28 07:45:00,586][106225] Updated weights for policy 1, policy_version 1741911 (0.0010) [2023-12-28 07:45:00,649][106225] Updated weights for policy 1, policy_version 1741921 (0.0010) [2023-12-28 07:45:00,710][106226] Updated weights for policy 0, policy_version 1737681 (0.0006) [2023-12-28 07:45:00,768][106226] Updated weights for policy 0, policy_version 1737691 (0.0007) [2023-12-28 07:45:00,820][106226] Updated weights for policy 0, policy_version 1737701 (0.0007) [2023-12-28 07:45:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 890920960. Throughput: 0: 9924.4, 1: 9893.2. Samples: 890911192. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:01,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.634')] [2023-12-28 07:45:01,308][106225] Updated weights for policy 1, policy_version 1741931 (0.0010) [2023-12-28 07:45:01,384][106225] Updated weights for policy 1, policy_version 1741943 (0.0008) [2023-12-28 07:45:01,445][106225] Updated weights for policy 1, policy_version 1741953 (0.0007) [2023-12-28 07:45:01,510][106226] Updated weights for policy 0, policy_version 1737711 (0.0009) [2023-12-28 07:45:01,570][106226] Updated weights for policy 0, policy_version 1737721 (0.0008) [2023-12-28 07:45:01,638][106226] Updated weights for policy 0, policy_version 1737731 (0.0008) [2023-12-28 07:45:02,105][106225] Updated weights for policy 1, policy_version 1741963 (0.0010) [2023-12-28 07:45:02,166][106225] Updated weights for policy 1, policy_version 1741973 (0.0009) [2023-12-28 07:45:02,253][106225] Updated weights for policy 1, policy_version 1741983 (0.0007) [2023-12-28 07:45:02,385][106226] Updated weights for policy 0, policy_version 1737741 (0.0007) [2023-12-28 07:45:02,444][106226] Updated weights for policy 0, policy_version 1737751 (0.0010) [2023-12-28 07:45:02,509][106226] Updated weights for policy 0, policy_version 1737761 (0.0011) [2023-12-28 07:45:02,909][106225] Updated weights for policy 1, policy_version 1741993 (0.0007) [2023-12-28 07:45:02,974][106225] Updated weights for policy 1, policy_version 1742003 (0.0009) [2023-12-28 07:45:03,016][106225] Updated weights for policy 1, policy_version 1742013 (0.0007) [2023-12-28 07:45:03,071][106225] Updated weights for policy 1, policy_version 1742023 (0.0008) [2023-12-28 07:45:03,177][106226] Updated weights for policy 0, policy_version 1737771 (0.0011) [2023-12-28 07:45:03,231][106226] Updated weights for policy 0, policy_version 1737781 (0.0010) [2023-12-28 07:45:03,281][106226] Updated weights for policy 0, policy_version 1737791 (0.0010) [2023-12-28 07:45:03,699][106225] Updated weights for policy 1, policy_version 1742033 (0.0005) [2023-12-28 07:45:03,756][106225] Updated weights for policy 1, policy_version 1742043 (0.0005) [2023-12-28 07:45:03,804][106225] Updated weights for policy 1, policy_version 1742053 (0.0005) [2023-12-28 07:45:03,928][106226] Updated weights for policy 0, policy_version 1737801 (0.0010) [2023-12-28 07:45:04,002][106226] Updated weights for policy 0, policy_version 1737811 (0.0009) [2023-12-28 07:45:04,062][106226] Updated weights for policy 0, policy_version 1737821 (0.0007) [2023-12-28 07:45:04,126][106226] Updated weights for policy 0, policy_version 1737831 (0.0010) [2023-12-28 07:45:04,399][106225] Updated weights for policy 1, policy_version 1742063 (0.0008) [2023-12-28 07:45:04,451][106225] Updated weights for policy 1, policy_version 1742073 (0.0008) [2023-12-28 07:45:04,501][106225] Updated weights for policy 1, policy_version 1742083 (0.0006) [2023-12-28 07:45:04,834][106226] Updated weights for policy 0, policy_version 1737841 (0.0010) [2023-12-28 07:45:04,885][106226] Updated weights for policy 0, policy_version 1737851 (0.0011) [2023-12-28 07:45:04,935][106226] Updated weights for policy 0, policy_version 1737861 (0.0010) [2023-12-28 07:45:05,161][106225] Updated weights for policy 1, policy_version 1742093 (0.0006) [2023-12-28 07:45:05,213][106225] Updated weights for policy 1, policy_version 1742103 (0.0005) [2023-12-28 07:45:05,270][106225] Updated weights for policy 1, policy_version 1742113 (0.0005) [2023-12-28 07:45:05,528][106226] Updated weights for policy 0, policy_version 1737871 (0.0010) [2023-12-28 07:45:05,581][106226] Updated weights for policy 0, policy_version 1737881 (0.0010) [2023-12-28 07:45:05,637][106226] Updated weights for policy 0, policy_version 1737891 (0.0010) [2023-12-28 07:45:05,951][106225] Updated weights for policy 1, policy_version 1742123 (0.0006) [2023-12-28 07:45:06,001][106225] Updated weights for policy 1, policy_version 1742133 (0.0009) [2023-12-28 07:45:06,058][106225] Updated weights for policy 1, policy_version 1742143 (0.0009) [2023-12-28 07:45:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 891027456. Throughput: 0: 10061.5, 1: 9947.0. Samples: 891035096. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:06,176][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.727')] [2023-12-28 07:45:06,296][106226] Updated weights for policy 0, policy_version 1737901 (0.0011) [2023-12-28 07:45:06,362][106226] Updated weights for policy 0, policy_version 1737911 (0.0009) [2023-12-28 07:45:06,423][106226] Updated weights for policy 0, policy_version 1737921 (0.0008) [2023-12-28 07:45:06,765][106225] Updated weights for policy 1, policy_version 1742153 (0.0007) [2023-12-28 07:45:06,832][106225] Updated weights for policy 1, policy_version 1742163 (0.0006) [2023-12-28 07:45:06,903][106225] Updated weights for policy 1, policy_version 1742173 (0.0008) [2023-12-28 07:45:06,968][106225] Updated weights for policy 1, policy_version 1742183 (0.0010) [2023-12-28 07:45:07,157][106226] Updated weights for policy 0, policy_version 1737931 (0.0011) [2023-12-28 07:45:07,220][106226] Updated weights for policy 0, policy_version 1737941 (0.0010) [2023-12-28 07:45:07,281][106226] Updated weights for policy 0, policy_version 1737951 (0.0011) [2023-12-28 07:45:07,593][106225] Updated weights for policy 1, policy_version 1742193 (0.0006) [2023-12-28 07:45:07,652][106225] Updated weights for policy 1, policy_version 1742203 (0.0008) [2023-12-28 07:45:07,721][106225] Updated weights for policy 1, policy_version 1742213 (0.0008) [2023-12-28 07:45:07,999][106226] Updated weights for policy 0, policy_version 1737961 (0.0010) [2023-12-28 07:45:08,052][106226] Updated weights for policy 0, policy_version 1737971 (0.0010) [2023-12-28 07:45:08,099][106226] Updated weights for policy 0, policy_version 1737981 (0.0010) [2023-12-28 07:45:08,159][106226] Updated weights for policy 0, policy_version 1737991 (0.0010) [2023-12-28 07:45:08,279][106225] Updated weights for policy 1, policy_version 1742223 (0.0007) [2023-12-28 07:45:08,329][106225] Updated weights for policy 1, policy_version 1742233 (0.0008) [2023-12-28 07:45:08,388][106225] Updated weights for policy 1, policy_version 1742243 (0.0008) [2023-12-28 07:45:08,906][106226] Updated weights for policy 0, policy_version 1738001 (0.0011) [2023-12-28 07:45:08,960][106226] Updated weights for policy 0, policy_version 1738011 (0.0010) [2023-12-28 07:45:09,008][106226] Updated weights for policy 0, policy_version 1738021 (0.0010) [2023-12-28 07:45:09,099][106225] Updated weights for policy 1, policy_version 1742253 (0.0008) [2023-12-28 07:45:09,148][106225] Updated weights for policy 1, policy_version 1742263 (0.0007) [2023-12-28 07:45:09,194][106225] Updated weights for policy 1, policy_version 1742273 (0.0007) [2023-12-28 07:45:09,768][106226] Updated weights for policy 0, policy_version 1738031 (0.0009) [2023-12-28 07:45:09,825][106226] Updated weights for policy 0, policy_version 1738041 (0.0008) [2023-12-28 07:45:09,901][106226] Updated weights for policy 0, policy_version 1738051 (0.0009) [2023-12-28 07:45:10,023][106225] Updated weights for policy 1, policy_version 1742283 (0.0008) [2023-12-28 07:45:10,076][106225] Updated weights for policy 1, policy_version 1742293 (0.0008) [2023-12-28 07:45:10,141][106225] Updated weights for policy 1, policy_version 1742303 (0.0009) [2023-12-28 07:45:10,659][106226] Updated weights for policy 0, policy_version 1738061 (0.0006) [2023-12-28 07:45:10,715][106226] Updated weights for policy 0, policy_version 1738071 (0.0007) [2023-12-28 07:45:10,764][106226] Updated weights for policy 0, policy_version 1738081 (0.0009) [2023-12-28 07:45:10,880][106225] Updated weights for policy 1, policy_version 1742313 (0.0009) [2023-12-28 07:45:10,935][106225] Updated weights for policy 1, policy_version 1742323 (0.0010) [2023-12-28 07:45:10,989][106225] Updated weights for policy 1, policy_version 1742333 (0.0010) [2023-12-28 07:45:11,049][106225] Updated weights for policy 1, policy_version 1742343 (0.0010) [2023-12-28 07:45:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 891125760. Throughput: 0: 9977.3, 1: 10058.6. Samples: 891094884. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:11,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-5.060')] [2023-12-28 07:45:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001742344_446095360.pth... [2023-12-28 07:45:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001738088_445030400.pth... [2023-12-28 07:45:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001741160_445792256.pth [2023-12-28 07:45:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001736936_444735488.pth [2023-12-28 07:45:11,528][106226] Updated weights for policy 0, policy_version 1738091 (0.0008) [2023-12-28 07:45:11,590][106226] Updated weights for policy 0, policy_version 1738101 (0.0008) [2023-12-28 07:45:11,660][106226] Updated weights for policy 0, policy_version 1738111 (0.0009) [2023-12-28 07:45:11,867][106225] Updated weights for policy 1, policy_version 1742353 (0.0009) [2023-12-28 07:45:11,930][106225] Updated weights for policy 1, policy_version 1742363 (0.0009) [2023-12-28 07:45:11,988][106225] Updated weights for policy 1, policy_version 1742373 (0.0009) [2023-12-28 07:45:12,526][106226] Updated weights for policy 0, policy_version 1738121 (0.0009) [2023-12-28 07:45:12,596][106226] Updated weights for policy 0, policy_version 1738131 (0.0008) [2023-12-28 07:45:12,658][106226] Updated weights for policy 0, policy_version 1738141 (0.0009) [2023-12-28 07:45:12,722][106226] Updated weights for policy 0, policy_version 1738151 (0.0008) [2023-12-28 07:45:12,774][106225] Updated weights for policy 1, policy_version 1742383 (0.0010) [2023-12-28 07:45:12,840][106225] Updated weights for policy 1, policy_version 1742393 (0.0011) [2023-12-28 07:45:12,909][106225] Updated weights for policy 1, policy_version 1742403 (0.0010) [2023-12-28 07:45:13,436][106226] Updated weights for policy 0, policy_version 1738161 (0.0008) [2023-12-28 07:45:13,481][106226] Updated weights for policy 0, policy_version 1738171 (0.0006) [2023-12-28 07:45:13,528][106226] Updated weights for policy 0, policy_version 1738181 (0.0007) [2023-12-28 07:45:13,616][106225] Updated weights for policy 1, policy_version 1742413 (0.0010) [2023-12-28 07:45:13,676][106225] Updated weights for policy 1, policy_version 1742423 (0.0009) [2023-12-28 07:45:13,744][106225] Updated weights for policy 1, policy_version 1742433 (0.0009) [2023-12-28 07:45:14,250][106226] Updated weights for policy 0, policy_version 1738191 (0.0008) [2023-12-28 07:45:14,301][106226] Updated weights for policy 0, policy_version 1738201 (0.0008) [2023-12-28 07:45:14,351][106226] Updated weights for policy 0, policy_version 1738211 (0.0008) [2023-12-28 07:45:14,439][106225] Updated weights for policy 1, policy_version 1742443 (0.0010) [2023-12-28 07:45:14,485][106225] Updated weights for policy 1, policy_version 1742453 (0.0010) [2023-12-28 07:45:14,534][106225] Updated weights for policy 1, policy_version 1742463 (0.0009) [2023-12-28 07:45:15,058][106226] Updated weights for policy 0, policy_version 1738221 (0.0008) [2023-12-28 07:45:15,122][106226] Updated weights for policy 0, policy_version 1738231 (0.0009) [2023-12-28 07:45:15,174][106226] Updated weights for policy 0, policy_version 1738241 (0.0008) [2023-12-28 07:45:15,286][106225] Updated weights for policy 1, policy_version 1742473 (0.0006) [2023-12-28 07:45:15,348][106225] Updated weights for policy 1, policy_version 1742483 (0.0011) [2023-12-28 07:45:15,410][106225] Updated weights for policy 1, policy_version 1742493 (0.0010) [2023-12-28 07:45:15,472][106225] Updated weights for policy 1, policy_version 1742503 (0.0010) [2023-12-28 07:45:15,958][106226] Updated weights for policy 0, policy_version 1738251 (0.0007) [2023-12-28 07:45:16,018][106226] Updated weights for policy 0, policy_version 1738261 (0.0006) [2023-12-28 07:45:16,079][106226] Updated weights for policy 0, policy_version 1738271 (0.0008) [2023-12-28 07:45:16,092][106225] Updated weights for policy 1, policy_version 1742513 (0.0007) [2023-12-28 07:45:16,153][106225] Updated weights for policy 1, policy_version 1742523 (0.0010) [2023-12-28 07:45:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 891215872. Throughput: 0: 9751.3, 1: 9981.5. Samples: 891206432. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:16,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.754')] [2023-12-28 07:45:16,214][106225] Updated weights for policy 1, policy_version 1742533 (0.0010) [2023-12-28 07:45:16,840][106226] Updated weights for policy 0, policy_version 1738281 (0.0006) [2023-12-28 07:45:16,905][106226] Updated weights for policy 0, policy_version 1738291 (0.0007) [2023-12-28 07:45:16,929][106225] Updated weights for policy 1, policy_version 1742543 (0.0010) [2023-12-28 07:45:16,966][106226] Updated weights for policy 0, policy_version 1738301 (0.0008) [2023-12-28 07:45:16,990][106225] Updated weights for policy 1, policy_version 1742553 (0.0009) [2023-12-28 07:45:17,025][106226] Updated weights for policy 0, policy_version 1738311 (0.0009) [2023-12-28 07:45:17,055][106225] Updated weights for policy 1, policy_version 1742563 (0.0011) [2023-12-28 07:45:17,657][106225] Updated weights for policy 1, policy_version 1742573 (0.0009) [2023-12-28 07:45:17,720][106225] Updated weights for policy 1, policy_version 1742583 (0.0010) [2023-12-28 07:45:17,778][106225] Updated weights for policy 1, policy_version 1742593 (0.0010) [2023-12-28 07:45:17,796][106226] Updated weights for policy 0, policy_version 1738321 (0.0007) [2023-12-28 07:45:17,852][106226] Updated weights for policy 0, policy_version 1738331 (0.0007) [2023-12-28 07:45:17,905][106226] Updated weights for policy 0, policy_version 1738341 (0.0007) [2023-12-28 07:45:18,434][106225] Updated weights for policy 1, policy_version 1742603 (0.0011) [2023-12-28 07:45:18,496][106225] Updated weights for policy 1, policy_version 1742613 (0.0011) [2023-12-28 07:45:18,558][106225] Updated weights for policy 1, policy_version 1742623 (0.0009) [2023-12-28 07:45:18,628][106226] Updated weights for policy 0, policy_version 1738351 (0.0006) [2023-12-28 07:45:18,691][106226] Updated weights for policy 0, policy_version 1738361 (0.0007) [2023-12-28 07:45:18,754][106226] Updated weights for policy 0, policy_version 1738371 (0.0009) [2023-12-28 07:45:19,287][106225] Updated weights for policy 1, policy_version 1742633 (0.0008) [2023-12-28 07:45:19,352][106225] Updated weights for policy 1, policy_version 1742643 (0.0010) [2023-12-28 07:45:19,429][106225] Updated weights for policy 1, policy_version 1742653 (0.0009) [2023-12-28 07:45:19,491][106225] Updated weights for policy 1, policy_version 1742663 (0.0011) [2023-12-28 07:45:19,553][106226] Updated weights for policy 0, policy_version 1738381 (0.0007) [2023-12-28 07:45:19,617][106226] Updated weights for policy 0, policy_version 1738391 (0.0008) [2023-12-28 07:45:19,682][106226] Updated weights for policy 0, policy_version 1738401 (0.0009) [2023-12-28 07:45:20,277][106225] Updated weights for policy 1, policy_version 1742673 (0.0010) [2023-12-28 07:45:20,334][106225] Updated weights for policy 1, policy_version 1742683 (0.0007) [2023-12-28 07:45:20,397][106225] Updated weights for policy 1, policy_version 1742693 (0.0010) [2023-12-28 07:45:20,419][106226] Updated weights for policy 0, policy_version 1738411 (0.0007) [2023-12-28 07:45:20,491][106226] Updated weights for policy 0, policy_version 1738421 (0.0008) [2023-12-28 07:45:20,548][106226] Updated weights for policy 0, policy_version 1738431 (0.0008) [2023-12-28 07:45:21,175][105115] Fps is (10 sec: 18022.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 891305984. Throughput: 0: 9645.3, 1: 9920.2. Samples: 891320088. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:21,175][105115] Avg episode reward: [(0, '-4.580'), (1, '-4.577')] [2023-12-28 07:45:21,195][106225] Updated weights for policy 1, policy_version 1742703 (0.0011) [2023-12-28 07:45:21,260][106225] Updated weights for policy 1, policy_version 1742713 (0.0010) [2023-12-28 07:45:21,325][106225] Updated weights for policy 1, policy_version 1742723 (0.0008) [2023-12-28 07:45:21,343][106226] Updated weights for policy 0, policy_version 1738441 (0.0008) [2023-12-28 07:45:21,417][106226] Updated weights for policy 0, policy_version 1738451 (0.0009) [2023-12-28 07:45:21,478][106226] Updated weights for policy 0, policy_version 1738461 (0.0008) [2023-12-28 07:45:21,542][106226] Updated weights for policy 0, policy_version 1738471 (0.0009) [2023-12-28 07:45:22,118][106225] Updated weights for policy 1, policy_version 1742733 (0.0009) [2023-12-28 07:45:22,171][106225] Updated weights for policy 1, policy_version 1742743 (0.0008) [2023-12-28 07:45:22,220][106225] Updated weights for policy 1, policy_version 1742753 (0.0008) [2023-12-28 07:45:22,306][106226] Updated weights for policy 0, policy_version 1738481 (0.0008) [2023-12-28 07:45:22,374][106226] Updated weights for policy 0, policy_version 1738491 (0.0009) [2023-12-28 07:45:22,441][106226] Updated weights for policy 0, policy_version 1738501 (0.0008) [2023-12-28 07:45:23,023][106225] Updated weights for policy 1, policy_version 1742763 (0.0008) [2023-12-28 07:45:23,088][106225] Updated weights for policy 1, policy_version 1742773 (0.0007) [2023-12-28 07:45:23,138][106226] Updated weights for policy 0, policy_version 1738511 (0.0007) [2023-12-28 07:45:23,151][106225] Updated weights for policy 1, policy_version 1742783 (0.0007) [2023-12-28 07:45:23,190][106226] Updated weights for policy 0, policy_version 1738521 (0.0007) [2023-12-28 07:45:23,253][106226] Updated weights for policy 0, policy_version 1738531 (0.0006) [2023-12-28 07:45:23,811][106225] Updated weights for policy 1, policy_version 1742793 (0.0006) [2023-12-28 07:45:23,851][106226] Updated weights for policy 0, policy_version 1738541 (0.0006) [2023-12-28 07:45:23,860][106225] Updated weights for policy 1, policy_version 1742803 (0.0008) [2023-12-28 07:45:23,910][106226] Updated weights for policy 0, policy_version 1738551 (0.0005) [2023-12-28 07:45:23,921][106225] Updated weights for policy 1, policy_version 1742813 (0.0008) [2023-12-28 07:45:23,969][106226] Updated weights for policy 0, policy_version 1738561 (0.0005) [2023-12-28 07:45:23,971][106225] Updated weights for policy 1, policy_version 1742823 (0.0008) [2023-12-28 07:45:24,572][106226] Updated weights for policy 0, policy_version 1738571 (0.0007) [2023-12-28 07:45:24,636][106226] Updated weights for policy 0, policy_version 1738581 (0.0010) [2023-12-28 07:45:24,689][106226] Updated weights for policy 0, policy_version 1738591 (0.0010) [2023-12-28 07:45:24,751][106225] Updated weights for policy 1, policy_version 1742833 (0.0007) [2023-12-28 07:45:24,800][106225] Updated weights for policy 1, policy_version 1742843 (0.0010) [2023-12-28 07:45:24,857][106225] Updated weights for policy 1, policy_version 1742853 (0.0010) [2023-12-28 07:45:25,394][106226] Updated weights for policy 0, policy_version 1738601 (0.0010) [2023-12-28 07:45:25,456][106226] Updated weights for policy 0, policy_version 1738611 (0.0010) [2023-12-28 07:45:25,482][106225] Updated weights for policy 1, policy_version 1742863 (0.0008) [2023-12-28 07:45:25,515][106226] Updated weights for policy 0, policy_version 1738621 (0.0010) [2023-12-28 07:45:25,529][106225] Updated weights for policy 1, policy_version 1742873 (0.0006) [2023-12-28 07:45:25,567][106226] Updated weights for policy 0, policy_version 1738631 (0.0009) [2023-12-28 07:45:25,579][106225] Updated weights for policy 1, policy_version 1742883 (0.0007) [2023-12-28 07:45:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 891404288. Throughput: 0: 9691.2, 1: 9868.8. Samples: 891377668. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:26,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.809')] [2023-12-28 07:45:26,178][106225] Updated weights for policy 1, policy_version 1742893 (0.0008) [2023-12-28 07:45:26,224][106226] Updated weights for policy 0, policy_version 1738641 (0.0007) [2023-12-28 07:45:26,234][106225] Updated weights for policy 1, policy_version 1742903 (0.0010) [2023-12-28 07:45:26,283][106226] Updated weights for policy 0, policy_version 1738651 (0.0006) [2023-12-28 07:45:26,295][106225] Updated weights for policy 1, policy_version 1742913 (0.0010) [2023-12-28 07:45:26,341][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001742920_446242816.pth... [2023-12-28 07:45:26,342][106226] Updated weights for policy 0, policy_version 1738661 (0.0005) [2023-12-28 07:45:26,345][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001741736_445939712.pth [2023-12-28 07:45:26,361][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001738664_445177856.pth... [2023-12-28 07:45:26,365][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001737512_444882944.pth [2023-12-28 07:45:26,923][106226] Updated weights for policy 0, policy_version 1738671 (0.0009) [2023-12-28 07:45:26,969][106226] Updated weights for policy 0, policy_version 1738681 (0.0010) [2023-12-28 07:45:27,007][106225] Updated weights for policy 1, policy_version 1742923 (0.0010) [2023-12-28 07:45:27,022][106226] Updated weights for policy 0, policy_version 1738691 (0.0010) [2023-12-28 07:45:27,056][106225] Updated weights for policy 1, policy_version 1742933 (0.0010) [2023-12-28 07:45:27,099][106225] Updated weights for policy 1, policy_version 1742943 (0.0010) [2023-12-28 07:45:27,705][106226] Updated weights for policy 0, policy_version 1738701 (0.0010) [2023-12-28 07:45:27,756][106226] Updated weights for policy 0, policy_version 1738711 (0.0010) [2023-12-28 07:45:27,786][106225] Updated weights for policy 1, policy_version 1742953 (0.0010) [2023-12-28 07:45:27,805][106226] Updated weights for policy 0, policy_version 1738721 (0.0007) [2023-12-28 07:45:27,848][106225] Updated weights for policy 1, policy_version 1742963 (0.0006) [2023-12-28 07:45:27,910][106225] Updated weights for policy 1, policy_version 1742973 (0.0006) [2023-12-28 07:45:27,968][106225] Updated weights for policy 1, policy_version 1742983 (0.0006) [2023-12-28 07:45:28,446][106226] Updated weights for policy 0, policy_version 1738731 (0.0006) [2023-12-28 07:45:28,513][106226] Updated weights for policy 0, policy_version 1738741 (0.0006) [2023-12-28 07:45:28,579][106226] Updated weights for policy 0, policy_version 1738751 (0.0007) [2023-12-28 07:45:28,620][106225] Updated weights for policy 1, policy_version 1742993 (0.0007) [2023-12-28 07:45:28,676][106225] Updated weights for policy 1, policy_version 1743003 (0.0008) [2023-12-28 07:45:28,735][106225] Updated weights for policy 1, policy_version 1743013 (0.0008) [2023-12-28 07:45:29,265][106226] Updated weights for policy 0, policy_version 1738761 (0.0006) [2023-12-28 07:45:29,324][106226] Updated weights for policy 0, policy_version 1738771 (0.0008) [2023-12-28 07:45:29,385][106226] Updated weights for policy 0, policy_version 1738781 (0.0008) [2023-12-28 07:45:29,433][106226] Updated weights for policy 0, policy_version 1738791 (0.0008) [2023-12-28 07:45:29,439][106225] Updated weights for policy 1, policy_version 1743023 (0.0007) [2023-12-28 07:45:29,499][106225] Updated weights for policy 1, policy_version 1743033 (0.0008) [2023-12-28 07:45:29,557][106225] Updated weights for policy 1, policy_version 1743043 (0.0010) [2023-12-28 07:45:30,186][106226] Updated weights for policy 0, policy_version 1738801 (0.0009) [2023-12-28 07:45:30,250][106226] Updated weights for policy 0, policy_version 1738811 (0.0007) [2023-12-28 07:45:30,252][106225] Updated weights for policy 1, policy_version 1743053 (0.0008) [2023-12-28 07:45:30,308][106226] Updated weights for policy 0, policy_version 1738821 (0.0009) [2023-12-28 07:45:30,319][106225] Updated weights for policy 1, policy_version 1743063 (0.0005) [2023-12-28 07:45:30,379][106225] Updated weights for policy 1, policy_version 1743073 (0.0006) [2023-12-28 07:45:31,049][106225] Updated weights for policy 1, policy_version 1743083 (0.0008) [2023-12-28 07:45:31,083][106226] Updated weights for policy 0, policy_version 1738831 (0.0008) [2023-12-28 07:45:31,109][106225] Updated weights for policy 1, policy_version 1743093 (0.0008) [2023-12-28 07:45:31,146][106226] Updated weights for policy 0, policy_version 1738841 (0.0007) [2023-12-28 07:45:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 891502592. Throughput: 0: 9746.4, 1: 9942.1. Samples: 891500100. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:31,175][105115] Avg episode reward: [(0, '-4.572'), (1, '-5.025')] [2023-12-28 07:45:31,182][106225] Updated weights for policy 1, policy_version 1743103 (0.0008) [2023-12-28 07:45:31,213][106226] Updated weights for policy 0, policy_version 1738851 (0.0009) [2023-12-28 07:45:31,926][106225] Updated weights for policy 1, policy_version 1743113 (0.0006) [2023-12-28 07:45:31,973][106226] Updated weights for policy 0, policy_version 1738861 (0.0007) [2023-12-28 07:45:31,978][106225] Updated weights for policy 1, policy_version 1743123 (0.0009) [2023-12-28 07:45:32,026][106225] Updated weights for policy 1, policy_version 1743133 (0.0010) [2023-12-28 07:45:32,032][106226] Updated weights for policy 0, policy_version 1738871 (0.0006) [2023-12-28 07:45:32,077][106225] Updated weights for policy 1, policy_version 1743143 (0.0010) [2023-12-28 07:45:32,090][106226] Updated weights for policy 0, policy_version 1738881 (0.0006) [2023-12-28 07:45:32,780][106225] Updated weights for policy 1, policy_version 1743153 (0.0009) [2023-12-28 07:45:32,796][106226] Updated weights for policy 0, policy_version 1738891 (0.0009) [2023-12-28 07:45:32,838][106225] Updated weights for policy 1, policy_version 1743163 (0.0006) [2023-12-28 07:45:32,857][106226] Updated weights for policy 0, policy_version 1738901 (0.0008) [2023-12-28 07:45:32,900][106225] Updated weights for policy 1, policy_version 1743173 (0.0007) [2023-12-28 07:45:32,917][106226] Updated weights for policy 0, policy_version 1738911 (0.0009) [2023-12-28 07:45:33,546][106225] Updated weights for policy 1, policy_version 1743183 (0.0009) [2023-12-28 07:45:33,605][106225] Updated weights for policy 1, policy_version 1743193 (0.0010) [2023-12-28 07:45:33,655][106225] Updated weights for policy 1, policy_version 1743203 (0.0010) [2023-12-28 07:45:33,680][106226] Updated weights for policy 0, policy_version 1738921 (0.0009) [2023-12-28 07:45:33,742][106226] Updated weights for policy 0, policy_version 1738931 (0.0008) [2023-12-28 07:45:33,798][106226] Updated weights for policy 0, policy_version 1738941 (0.0007) [2023-12-28 07:45:33,844][106226] Updated weights for policy 0, policy_version 1738951 (0.0005) [2023-12-28 07:45:34,341][106225] Updated weights for policy 1, policy_version 1743213 (0.0009) [2023-12-28 07:45:34,407][106225] Updated weights for policy 1, policy_version 1743223 (0.0007) [2023-12-28 07:45:34,461][106226] Updated weights for policy 0, policy_version 1738961 (0.0008) [2023-12-28 07:45:34,475][106225] Updated weights for policy 1, policy_version 1743233 (0.0006) [2023-12-28 07:45:34,522][106226] Updated weights for policy 0, policy_version 1738971 (0.0010) [2023-12-28 07:45:34,580][106226] Updated weights for policy 0, policy_version 1738981 (0.0011) [2023-12-28 07:45:35,171][106225] Updated weights for policy 1, policy_version 1743243 (0.0007) [2023-12-28 07:45:35,227][106225] Updated weights for policy 1, policy_version 1743253 (0.0009) [2023-12-28 07:45:35,285][106225] Updated weights for policy 1, policy_version 1743263 (0.0005) [2023-12-28 07:45:35,299][106226] Updated weights for policy 0, policy_version 1738991 (0.0009) [2023-12-28 07:45:35,353][106226] Updated weights for policy 0, policy_version 1739001 (0.0009) [2023-12-28 07:45:35,410][106226] Updated weights for policy 0, policy_version 1739011 (0.0010) [2023-12-28 07:45:35,895][106225] Updated weights for policy 1, policy_version 1743273 (0.0006) [2023-12-28 07:45:35,950][106225] Updated weights for policy 1, policy_version 1743283 (0.0008) [2023-12-28 07:45:36,002][106225] Updated weights for policy 1, policy_version 1743293 (0.0008) [2023-12-28 07:45:36,048][106225] Updated weights for policy 1, policy_version 1743303 (0.0008) [2023-12-28 07:45:36,155][106226] Updated weights for policy 0, policy_version 1739021 (0.0009) [2023-12-28 07:45:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 891609088. Throughput: 0: 9708.3, 1: 9982.4. Samples: 891618800. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:36,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.766')] [2023-12-28 07:45:36,210][106226] Updated weights for policy 0, policy_version 1739031 (0.0007) [2023-12-28 07:45:36,276][106226] Updated weights for policy 0, policy_version 1739041 (0.0009) [2023-12-28 07:45:36,835][106225] Updated weights for policy 1, policy_version 1743313 (0.0008) [2023-12-28 07:45:36,893][106225] Updated weights for policy 1, policy_version 1743323 (0.0007) [2023-12-28 07:45:36,942][106225] Updated weights for policy 1, policy_version 1743333 (0.0009) [2023-12-28 07:45:37,002][106226] Updated weights for policy 0, policy_version 1739051 (0.0009) [2023-12-28 07:45:37,069][106226] Updated weights for policy 0, policy_version 1739061 (0.0009) [2023-12-28 07:45:37,134][106226] Updated weights for policy 0, policy_version 1739071 (0.0008) [2023-12-28 07:45:37,665][106225] Updated weights for policy 1, policy_version 1743343 (0.0009) [2023-12-28 07:45:37,719][106225] Updated weights for policy 1, policy_version 1743353 (0.0009) [2023-12-28 07:45:37,775][106225] Updated weights for policy 1, policy_version 1743363 (0.0008) [2023-12-28 07:45:37,814][106226] Updated weights for policy 0, policy_version 1739081 (0.0008) [2023-12-28 07:45:37,864][106226] Updated weights for policy 0, policy_version 1739091 (0.0005) [2023-12-28 07:45:37,925][106226] Updated weights for policy 0, policy_version 1739101 (0.0008) [2023-12-28 07:45:37,978][106226] Updated weights for policy 0, policy_version 1739111 (0.0009) [2023-12-28 07:45:38,538][106225] Updated weights for policy 1, policy_version 1743373 (0.0008) [2023-12-28 07:45:38,586][106225] Updated weights for policy 1, policy_version 1743383 (0.0008) [2023-12-28 07:45:38,644][106225] Updated weights for policy 1, policy_version 1743393 (0.0008) [2023-12-28 07:45:38,707][106226] Updated weights for policy 0, policy_version 1739121 (0.0008) [2023-12-28 07:45:38,758][106226] Updated weights for policy 0, policy_version 1739131 (0.0008) [2023-12-28 07:45:38,824][106226] Updated weights for policy 0, policy_version 1739141 (0.0008) [2023-12-28 07:45:39,360][106225] Updated weights for policy 1, policy_version 1743403 (0.0007) [2023-12-28 07:45:39,429][106225] Updated weights for policy 1, policy_version 1743413 (0.0007) [2023-12-28 07:45:39,481][106225] Updated weights for policy 1, policy_version 1743423 (0.0007) [2023-12-28 07:45:39,611][106226] Updated weights for policy 0, policy_version 1739151 (0.0008) [2023-12-28 07:45:39,674][106226] Updated weights for policy 0, policy_version 1739161 (0.0008) [2023-12-28 07:45:39,726][106226] Updated weights for policy 0, policy_version 1739171 (0.0008) [2023-12-28 07:45:40,178][106225] Updated weights for policy 1, policy_version 1743433 (0.0007) [2023-12-28 07:45:40,236][106225] Updated weights for policy 1, policy_version 1743443 (0.0007) [2023-12-28 07:45:40,297][106225] Updated weights for policy 1, policy_version 1743453 (0.0006) [2023-12-28 07:45:40,361][106225] Updated weights for policy 1, policy_version 1743463 (0.0006) [2023-12-28 07:45:40,523][106226] Updated weights for policy 0, policy_version 1739181 (0.0007) [2023-12-28 07:45:40,585][106226] Updated weights for policy 0, policy_version 1739191 (0.0005) [2023-12-28 07:45:40,650][106226] Updated weights for policy 0, policy_version 1739201 (0.0005) [2023-12-28 07:45:40,974][106225] Updated weights for policy 1, policy_version 1743473 (0.0009) [2023-12-28 07:45:41,042][106225] Updated weights for policy 1, policy_version 1743483 (0.0009) [2023-12-28 07:45:41,108][106225] Updated weights for policy 1, policy_version 1743493 (0.0007) [2023-12-28 07:45:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 891707392. Throughput: 0: 9701.9, 1: 9929.6. Samples: 891675652. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:41,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.843')] [2023-12-28 07:45:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001739208_445317120.pth... [2023-12-28 07:45:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001743496_446390272.pth... [2023-12-28 07:45:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001738088_445030400.pth [2023-12-28 07:45:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001742344_446095360.pth [2023-12-28 07:45:41,220][106226] Updated weights for policy 0, policy_version 1739211 (0.0006) [2023-12-28 07:45:41,282][106226] Updated weights for policy 0, policy_version 1739221 (0.0008) [2023-12-28 07:45:41,342][106226] Updated weights for policy 0, policy_version 1739231 (0.0008) [2023-12-28 07:45:41,907][106225] Updated weights for policy 1, policy_version 1743503 (0.0008) [2023-12-28 07:45:41,975][106225] Updated weights for policy 1, policy_version 1743513 (0.0008) [2023-12-28 07:45:42,035][106225] Updated weights for policy 1, policy_version 1743523 (0.0008) [2023-12-28 07:45:42,139][106226] Updated weights for policy 0, policy_version 1739241 (0.0007) [2023-12-28 07:45:42,191][106226] Updated weights for policy 0, policy_version 1739251 (0.0008) [2023-12-28 07:45:42,254][106226] Updated weights for policy 0, policy_version 1739261 (0.0009) [2023-12-28 07:45:42,321][106226] Updated weights for policy 0, policy_version 1739271 (0.0008) [2023-12-28 07:45:42,771][106225] Updated weights for policy 1, policy_version 1743533 (0.0009) [2023-12-28 07:45:42,827][106225] Updated weights for policy 1, policy_version 1743543 (0.0007) [2023-12-28 07:45:42,884][106225] Updated weights for policy 1, policy_version 1743553 (0.0009) [2023-12-28 07:45:42,939][106226] Updated weights for policy 0, policy_version 1739281 (0.0006) [2023-12-28 07:45:43,008][106226] Updated weights for policy 0, policy_version 1739291 (0.0006) [2023-12-28 07:45:43,079][106226] Updated weights for policy 0, policy_version 1739301 (0.0009) [2023-12-28 07:45:43,501][106225] Updated weights for policy 1, policy_version 1743563 (0.0006) [2023-12-28 07:45:43,547][106225] Updated weights for policy 1, policy_version 1743573 (0.0005) [2023-12-28 07:45:43,594][106225] Updated weights for policy 1, policy_version 1743583 (0.0007) [2023-12-28 07:45:43,809][106226] Updated weights for policy 0, policy_version 1739311 (0.0009) [2023-12-28 07:45:43,860][106226] Updated weights for policy 0, policy_version 1739321 (0.0008) [2023-12-28 07:45:43,916][106226] Updated weights for policy 0, policy_version 1739331 (0.0008) [2023-12-28 07:45:44,267][106225] Updated weights for policy 1, policy_version 1743593 (0.0006) [2023-12-28 07:45:44,325][106225] Updated weights for policy 1, policy_version 1743603 (0.0008) [2023-12-28 07:45:44,371][106225] Updated weights for policy 1, policy_version 1743613 (0.0007) [2023-12-28 07:45:44,428][106225] Updated weights for policy 1, policy_version 1743623 (0.0008) [2023-12-28 07:45:44,658][106226] Updated weights for policy 0, policy_version 1739341 (0.0009) [2023-12-28 07:45:44,705][106226] Updated weights for policy 0, policy_version 1739351 (0.0008) [2023-12-28 07:45:44,750][106226] Updated weights for policy 0, policy_version 1739361 (0.0008) [2023-12-28 07:45:45,165][106225] Updated weights for policy 1, policy_version 1743633 (0.0008) [2023-12-28 07:45:45,230][106225] Updated weights for policy 1, policy_version 1743643 (0.0007) [2023-12-28 07:45:45,289][106225] Updated weights for policy 1, policy_version 1743653 (0.0009) [2023-12-28 07:45:45,542][106226] Updated weights for policy 0, policy_version 1739371 (0.0008) [2023-12-28 07:45:45,608][106226] Updated weights for policy 0, policy_version 1739381 (0.0008) [2023-12-28 07:45:45,674][106226] Updated weights for policy 0, policy_version 1739391 (0.0008) [2023-12-28 07:45:45,968][106225] Updated weights for policy 1, policy_version 1743663 (0.0008) [2023-12-28 07:45:46,017][106225] Updated weights for policy 1, policy_version 1743673 (0.0007) [2023-12-28 07:45:46,069][106225] Updated weights for policy 1, policy_version 1743683 (0.0005) [2023-12-28 07:45:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 891805696. Throughput: 0: 9694.9, 1: 9893.8. Samples: 891792688. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:46,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.027')] [2023-12-28 07:45:46,414][106226] Updated weights for policy 0, policy_version 1739401 (0.0008) [2023-12-28 07:45:46,483][106226] Updated weights for policy 0, policy_version 1739411 (0.0008) [2023-12-28 07:45:46,545][106226] Updated weights for policy 0, policy_version 1739421 (0.0008) [2023-12-28 07:45:46,606][106226] Updated weights for policy 0, policy_version 1739431 (0.0008) [2023-12-28 07:45:46,721][106225] Updated weights for policy 1, policy_version 1743693 (0.0006) [2023-12-28 07:45:46,788][106225] Updated weights for policy 1, policy_version 1743703 (0.0007) [2023-12-28 07:45:46,847][106225] Updated weights for policy 1, policy_version 1743713 (0.0008) [2023-12-28 07:45:47,345][106226] Updated weights for policy 0, policy_version 1739441 (0.0006) [2023-12-28 07:45:47,400][106226] Updated weights for policy 0, policy_version 1739451 (0.0008) [2023-12-28 07:45:47,450][106226] Updated weights for policy 0, policy_version 1739461 (0.0009) [2023-12-28 07:45:47,487][106225] Updated weights for policy 1, policy_version 1743723 (0.0008) [2023-12-28 07:45:47,536][106225] Updated weights for policy 1, policy_version 1743733 (0.0009) [2023-12-28 07:45:47,598][106225] Updated weights for policy 1, policy_version 1743743 (0.0008) [2023-12-28 07:45:48,006][106226] Updated weights for policy 0, policy_version 1739471 (0.0008) [2023-12-28 07:45:48,063][106226] Updated weights for policy 0, policy_version 1739481 (0.0008) [2023-12-28 07:45:48,119][106226] Updated weights for policy 0, policy_version 1739491 (0.0008) [2023-12-28 07:45:48,335][106225] Updated weights for policy 1, policy_version 1743753 (0.0008) [2023-12-28 07:45:48,404][106225] Updated weights for policy 1, policy_version 1743763 (0.0008) [2023-12-28 07:45:48,469][106225] Updated weights for policy 1, policy_version 1743773 (0.0009) [2023-12-28 07:45:48,527][106225] Updated weights for policy 1, policy_version 1743783 (0.0008) [2023-12-28 07:45:48,886][106226] Updated weights for policy 0, policy_version 1739501 (0.0007) [2023-12-28 07:45:48,936][106226] Updated weights for policy 0, policy_version 1739511 (0.0005) [2023-12-28 07:45:48,995][106226] Updated weights for policy 0, policy_version 1739521 (0.0005) [2023-12-28 07:45:49,198][106225] Updated weights for policy 1, policy_version 1743793 (0.0005) [2023-12-28 07:45:49,264][106225] Updated weights for policy 1, policy_version 1743803 (0.0008) [2023-12-28 07:45:49,317][106225] Updated weights for policy 1, policy_version 1743813 (0.0008) [2023-12-28 07:45:49,648][106226] Updated weights for policy 0, policy_version 1739531 (0.0006) [2023-12-28 07:45:49,704][106226] Updated weights for policy 0, policy_version 1739541 (0.0008) [2023-12-28 07:45:49,767][106226] Updated weights for policy 0, policy_version 1739551 (0.0006) [2023-12-28 07:45:50,088][106225] Updated weights for policy 1, policy_version 1743823 (0.0009) [2023-12-28 07:45:50,146][106225] Updated weights for policy 1, policy_version 1743833 (0.0009) [2023-12-28 07:45:50,203][106225] Updated weights for policy 1, policy_version 1743843 (0.0008) [2023-12-28 07:45:50,468][106226] Updated weights for policy 0, policy_version 1739561 (0.0007) [2023-12-28 07:45:50,522][106226] Updated weights for policy 0, policy_version 1739571 (0.0008) [2023-12-28 07:45:50,590][106226] Updated weights for policy 0, policy_version 1739581 (0.0009) [2023-12-28 07:45:50,649][106226] Updated weights for policy 0, policy_version 1739591 (0.0009) [2023-12-28 07:45:50,957][106225] Updated weights for policy 1, policy_version 1743853 (0.0008) [2023-12-28 07:45:51,009][106225] Updated weights for policy 1, policy_version 1743863 (0.0008) [2023-12-28 07:45:51,082][106225] Updated weights for policy 1, policy_version 1743873 (0.0008) [2023-12-28 07:45:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 891904000. Throughput: 0: 9640.2, 1: 9836.7. Samples: 891911556. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:51,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.663')] [2023-12-28 07:45:51,430][106226] Updated weights for policy 0, policy_version 1739601 (0.0009) [2023-12-28 07:45:51,492][106226] Updated weights for policy 0, policy_version 1739611 (0.0010) [2023-12-28 07:45:51,551][106226] Updated weights for policy 0, policy_version 1739621 (0.0009) [2023-12-28 07:45:51,773][106225] Updated weights for policy 1, policy_version 1743883 (0.0010) [2023-12-28 07:45:51,835][106225] Updated weights for policy 1, policy_version 1743893 (0.0009) [2023-12-28 07:45:51,887][106225] Updated weights for policy 1, policy_version 1743903 (0.0006) [2023-12-28 07:45:52,364][106226] Updated weights for policy 0, policy_version 1739631 (0.0008) [2023-12-28 07:45:52,432][106226] Updated weights for policy 0, policy_version 1739641 (0.0009) [2023-12-28 07:45:52,490][106226] Updated weights for policy 0, policy_version 1739651 (0.0009) [2023-12-28 07:45:52,582][106225] Updated weights for policy 1, policy_version 1743913 (0.0006) [2023-12-28 07:45:52,643][106225] Updated weights for policy 1, policy_version 1743923 (0.0008) [2023-12-28 07:45:52,706][106225] Updated weights for policy 1, policy_version 1743933 (0.0009) [2023-12-28 07:45:52,765][106225] Updated weights for policy 1, policy_version 1743943 (0.0008) [2023-12-28 07:45:53,230][106226] Updated weights for policy 0, policy_version 1739661 (0.0010) [2023-12-28 07:45:53,279][106226] Updated weights for policy 0, policy_version 1739671 (0.0009) [2023-12-28 07:45:53,328][106226] Updated weights for policy 0, policy_version 1739681 (0.0008) [2023-12-28 07:45:53,392][106225] Updated weights for policy 1, policy_version 1743953 (0.0005) [2023-12-28 07:45:53,440][106225] Updated weights for policy 1, policy_version 1743963 (0.0005) [2023-12-28 07:45:53,489][106225] Updated weights for policy 1, policy_version 1743973 (0.0005) [2023-12-28 07:45:53,991][106226] Updated weights for policy 0, policy_version 1739691 (0.0009) [2023-12-28 07:45:54,045][106226] Updated weights for policy 0, policy_version 1739701 (0.0005) [2023-12-28 07:45:54,097][106226] Updated weights for policy 0, policy_version 1739711 (0.0005) [2023-12-28 07:45:54,199][106225] Updated weights for policy 1, policy_version 1743983 (0.0007) [2023-12-28 07:45:54,253][106225] Updated weights for policy 1, policy_version 1743993 (0.0008) [2023-12-28 07:45:54,303][106225] Updated weights for policy 1, policy_version 1744003 (0.0009) [2023-12-28 07:45:54,668][106226] Updated weights for policy 0, policy_version 1739721 (0.0006) [2023-12-28 07:45:54,719][106226] Updated weights for policy 0, policy_version 1739731 (0.0010) [2023-12-28 07:45:54,769][106226] Updated weights for policy 0, policy_version 1739741 (0.0010) [2023-12-28 07:45:54,820][106226] Updated weights for policy 0, policy_version 1739751 (0.0010) [2023-12-28 07:45:55,029][106225] Updated weights for policy 1, policy_version 1744013 (0.0009) [2023-12-28 07:45:55,090][106225] Updated weights for policy 1, policy_version 1744023 (0.0008) [2023-12-28 07:45:55,148][106225] Updated weights for policy 1, policy_version 1744033 (0.0008) [2023-12-28 07:45:55,511][106226] Updated weights for policy 0, policy_version 1739761 (0.0006) [2023-12-28 07:45:55,564][106226] Updated weights for policy 0, policy_version 1739771 (0.0006) [2023-12-28 07:45:55,623][106226] Updated weights for policy 0, policy_version 1739781 (0.0005) [2023-12-28 07:45:55,839][106225] Updated weights for policy 1, policy_version 1744043 (0.0007) [2023-12-28 07:45:55,907][106225] Updated weights for policy 1, policy_version 1744053 (0.0005) [2023-12-28 07:45:55,974][106225] Updated weights for policy 1, policy_version 1744063 (0.0005) [2023-12-28 07:45:56,160][106226] Updated weights for policy 0, policy_version 1739791 (0.0005) [2023-12-28 07:45:56,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 892002304. Throughput: 0: 9651.4, 1: 9819.9. Samples: 891971088. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:45:56,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-5.019')] [2023-12-28 07:45:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001744072_446537728.pth... [2023-12-28 07:45:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001742920_446242816.pth [2023-12-28 07:45:56,235][106226] Updated weights for policy 0, policy_version 1739801 (0.0007) [2023-12-28 07:45:56,282][106226] Updated weights for policy 0, policy_version 1739811 (0.0008) [2023-12-28 07:45:56,303][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001739816_445472768.pth... [2023-12-28 07:45:56,306][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001738664_445177856.pth [2023-12-28 07:45:56,516][106225] Updated weights for policy 1, policy_version 1744073 (0.0006) [2023-12-28 07:45:56,579][106225] Updated weights for policy 1, policy_version 1744083 (0.0009) [2023-12-28 07:45:56,639][106225] Updated weights for policy 1, policy_version 1744093 (0.0010) [2023-12-28 07:45:56,690][106225] Updated weights for policy 1, policy_version 1744103 (0.0011) [2023-12-28 07:45:56,901][106226] Updated weights for policy 0, policy_version 1739821 (0.0008) [2023-12-28 07:45:56,959][106226] Updated weights for policy 0, policy_version 1739831 (0.0008) [2023-12-28 07:45:57,009][106226] Updated weights for policy 0, policy_version 1739841 (0.0008) [2023-12-28 07:45:57,350][106225] Updated weights for policy 1, policy_version 1744113 (0.0010) [2023-12-28 07:45:57,408][106225] Updated weights for policy 1, policy_version 1744123 (0.0010) [2023-12-28 07:45:57,463][106225] Updated weights for policy 1, policy_version 1744133 (0.0010) [2023-12-28 07:45:57,758][106226] Updated weights for policy 0, policy_version 1739851 (0.0010) [2023-12-28 07:45:57,818][106226] Updated weights for policy 0, policy_version 1739861 (0.0008) [2023-12-28 07:45:57,876][106226] Updated weights for policy 0, policy_version 1739871 (0.0007) [2023-12-28 07:45:58,140][106225] Updated weights for policy 1, policy_version 1744143 (0.0010) [2023-12-28 07:45:58,194][106225] Updated weights for policy 1, policy_version 1744153 (0.0010) [2023-12-28 07:45:58,263][106225] Updated weights for policy 1, policy_version 1744163 (0.0011) [2023-12-28 07:45:58,612][106226] Updated weights for policy 0, policy_version 1739881 (0.0007) [2023-12-28 07:45:58,682][106226] Updated weights for policy 0, policy_version 1739891 (0.0009) [2023-12-28 07:45:58,748][106226] Updated weights for policy 0, policy_version 1739901 (0.0010) [2023-12-28 07:45:58,812][106226] Updated weights for policy 0, policy_version 1739911 (0.0008) [2023-12-28 07:45:59,029][106225] Updated weights for policy 1, policy_version 1744173 (0.0008) [2023-12-28 07:45:59,093][106225] Updated weights for policy 1, policy_version 1744183 (0.0008) [2023-12-28 07:45:59,152][106225] Updated weights for policy 1, policy_version 1744193 (0.0011) [2023-12-28 07:45:59,672][106226] Updated weights for policy 0, policy_version 1739921 (0.0008) [2023-12-28 07:45:59,732][106226] Updated weights for policy 0, policy_version 1739931 (0.0010) [2023-12-28 07:45:59,787][106226] Updated weights for policy 0, policy_version 1739941 (0.0011) [2023-12-28 07:45:59,966][106225] Updated weights for policy 1, policy_version 1744203 (0.0009) [2023-12-28 07:46:00,032][106225] Updated weights for policy 1, policy_version 1744213 (0.0008) [2023-12-28 07:46:00,082][106225] Updated weights for policy 1, policy_version 1744223 (0.0008) [2023-12-28 07:46:00,543][106226] Updated weights for policy 0, policy_version 1739951 (0.0010) [2023-12-28 07:46:00,605][106226] Updated weights for policy 0, policy_version 1739961 (0.0010) [2023-12-28 07:46:00,655][106226] Updated weights for policy 0, policy_version 1739971 (0.0010) [2023-12-28 07:46:00,775][106225] Updated weights for policy 1, policy_version 1744233 (0.0008) [2023-12-28 07:46:00,823][106225] Updated weights for policy 1, policy_version 1744243 (0.0005) [2023-12-28 07:46:00,874][106225] Updated weights for policy 1, policy_version 1744253 (0.0006) [2023-12-28 07:46:00,919][106225] Updated weights for policy 1, policy_version 1744263 (0.0007) [2023-12-28 07:46:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 892100608. Throughput: 0: 9735.4, 1: 9892.7. Samples: 892089696. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:46:01,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.933')] [2023-12-28 07:46:01,403][106226] Updated weights for policy 0, policy_version 1739981 (0.0009) [2023-12-28 07:46:01,456][106226] Updated weights for policy 0, policy_version 1739991 (0.0008) [2023-12-28 07:46:01,504][106226] Updated weights for policy 0, policy_version 1740001 (0.0008) [2023-12-28 07:46:01,603][106225] Updated weights for policy 1, policy_version 1744273 (0.0009) [2023-12-28 07:46:01,679][106225] Updated weights for policy 1, policy_version 1744283 (0.0009) [2023-12-28 07:46:01,743][106225] Updated weights for policy 1, policy_version 1744293 (0.0006) [2023-12-28 07:46:02,267][106226] Updated weights for policy 0, policy_version 1740011 (0.0008) [2023-12-28 07:46:02,319][106226] Updated weights for policy 0, policy_version 1740021 (0.0008) [2023-12-28 07:46:02,388][106226] Updated weights for policy 0, policy_version 1740031 (0.0009) [2023-12-28 07:46:02,469][106225] Updated weights for policy 1, policy_version 1744303 (0.0007) [2023-12-28 07:46:02,521][106225] Updated weights for policy 1, policy_version 1744313 (0.0009) [2023-12-28 07:46:02,578][106225] Updated weights for policy 1, policy_version 1744323 (0.0008) [2023-12-28 07:46:03,099][106226] Updated weights for policy 0, policy_version 1740041 (0.0009) [2023-12-28 07:46:03,151][106226] Updated weights for policy 0, policy_version 1740051 (0.0010) [2023-12-28 07:46:03,200][106226] Updated weights for policy 0, policy_version 1740061 (0.0010) [2023-12-28 07:46:03,250][106226] Updated weights for policy 0, policy_version 1740071 (0.0010) [2023-12-28 07:46:03,314][106225] Updated weights for policy 1, policy_version 1744333 (0.0008) [2023-12-28 07:46:03,370][106225] Updated weights for policy 1, policy_version 1744343 (0.0007) [2023-12-28 07:46:03,430][106225] Updated weights for policy 1, policy_version 1744353 (0.0007) [2023-12-28 07:46:03,905][106226] Updated weights for policy 0, policy_version 1740081 (0.0010) [2023-12-28 07:46:03,969][106226] Updated weights for policy 0, policy_version 1740091 (0.0011) [2023-12-28 07:46:04,032][106226] Updated weights for policy 0, policy_version 1740101 (0.0011) [2023-12-28 07:46:04,222][106225] Updated weights for policy 1, policy_version 1744363 (0.0007) [2023-12-28 07:46:04,286][106225] Updated weights for policy 1, policy_version 1744373 (0.0008) [2023-12-28 07:46:04,338][106225] Updated weights for policy 1, policy_version 1744383 (0.0009) [2023-12-28 07:46:04,691][106226] Updated weights for policy 0, policy_version 1740111 (0.0011) [2023-12-28 07:46:04,749][106226] Updated weights for policy 0, policy_version 1740121 (0.0011) [2023-12-28 07:46:04,806][106226] Updated weights for policy 0, policy_version 1740131 (0.0011) [2023-12-28 07:46:05,067][106225] Updated weights for policy 1, policy_version 1744393 (0.0009) [2023-12-28 07:46:05,121][106225] Updated weights for policy 1, policy_version 1744403 (0.0007) [2023-12-28 07:46:05,173][106225] Updated weights for policy 1, policy_version 1744413 (0.0005) [2023-12-28 07:46:05,228][106225] Updated weights for policy 1, policy_version 1744423 (0.0005) [2023-12-28 07:46:05,459][106226] Updated weights for policy 0, policy_version 1740141 (0.0009) [2023-12-28 07:46:05,522][106226] Updated weights for policy 0, policy_version 1740151 (0.0008) [2023-12-28 07:46:05,593][106226] Updated weights for policy 0, policy_version 1740161 (0.0008) [2023-12-28 07:46:05,824][106225] Updated weights for policy 1, policy_version 1744433 (0.0006) [2023-12-28 07:46:05,871][106225] Updated weights for policy 1, policy_version 1744443 (0.0008) [2023-12-28 07:46:05,918][106225] Updated weights for policy 1, policy_version 1744453 (0.0008) [2023-12-28 07:46:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 892198912. Throughput: 0: 9858.9, 1: 9888.2. Samples: 892208708. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:46:06,175][105115] Avg episode reward: [(0, '-4.566'), (1, '-4.695')] [2023-12-28 07:46:06,279][106226] Updated weights for policy 0, policy_version 1740171 (0.0009) [2023-12-28 07:46:06,340][106226] Updated weights for policy 0, policy_version 1740181 (0.0011) [2023-12-28 07:46:06,397][106226] Updated weights for policy 0, policy_version 1740191 (0.0010) [2023-12-28 07:46:06,699][106225] Updated weights for policy 1, policy_version 1744463 (0.0008) [2023-12-28 07:46:06,764][106225] Updated weights for policy 1, policy_version 1744473 (0.0009) [2023-12-28 07:46:06,825][106225] Updated weights for policy 1, policy_version 1744483 (0.0008) [2023-12-28 07:46:07,127][106226] Updated weights for policy 0, policy_version 1740201 (0.0011) [2023-12-28 07:46:07,178][106226] Updated weights for policy 0, policy_version 1740211 (0.0011) [2023-12-28 07:46:07,232][106226] Updated weights for policy 0, policy_version 1740221 (0.0010) [2023-12-28 07:46:07,282][106226] Updated weights for policy 0, policy_version 1740231 (0.0010) [2023-12-28 07:46:07,429][106225] Updated weights for policy 1, policy_version 1744493 (0.0007) [2023-12-28 07:46:07,478][106225] Updated weights for policy 1, policy_version 1744503 (0.0008) [2023-12-28 07:46:07,539][106225] Updated weights for policy 1, policy_version 1744513 (0.0008) [2023-12-28 07:46:08,014][106226] Updated weights for policy 0, policy_version 1740241 (0.0009) [2023-12-28 07:46:08,077][106226] Updated weights for policy 0, policy_version 1740251 (0.0008) [2023-12-28 07:46:08,139][106226] Updated weights for policy 0, policy_version 1740261 (0.0009) [2023-12-28 07:46:08,266][106225] Updated weights for policy 1, policy_version 1744523 (0.0009) [2023-12-28 07:46:08,327][106225] Updated weights for policy 1, policy_version 1744533 (0.0007) [2023-12-28 07:46:08,394][106225] Updated weights for policy 1, policy_version 1744543 (0.0008) [2023-12-28 07:46:08,849][106226] Updated weights for policy 0, policy_version 1740271 (0.0009) [2023-12-28 07:46:08,911][106226] Updated weights for policy 0, policy_version 1740281 (0.0008) [2023-12-28 07:46:08,964][106226] Updated weights for policy 0, policy_version 1740291 (0.0007) [2023-12-28 07:46:09,056][106225] Updated weights for policy 1, policy_version 1744553 (0.0008) [2023-12-28 07:46:09,107][106225] Updated weights for policy 1, policy_version 1744563 (0.0005) [2023-12-28 07:46:09,165][106225] Updated weights for policy 1, policy_version 1744573 (0.0005) [2023-12-28 07:46:09,221][106225] Updated weights for policy 1, policy_version 1744583 (0.0010) [2023-12-28 07:46:09,730][106226] Updated weights for policy 0, policy_version 1740301 (0.0008) [2023-12-28 07:46:09,796][106226] Updated weights for policy 0, policy_version 1740311 (0.0008) [2023-12-28 07:46:09,869][106226] Updated weights for policy 0, policy_version 1740321 (0.0008) [2023-12-28 07:46:09,963][106225] Updated weights for policy 1, policy_version 1744593 (0.0009) [2023-12-28 07:46:10,026][106225] Updated weights for policy 1, policy_version 1744603 (0.0008) [2023-12-28 07:46:10,084][106225] Updated weights for policy 1, policy_version 1744613 (0.0008) [2023-12-28 07:46:10,606][106226] Updated weights for policy 0, policy_version 1740331 (0.0007) [2023-12-28 07:46:10,665][106226] Updated weights for policy 0, policy_version 1740341 (0.0007) [2023-12-28 07:46:10,730][106226] Updated weights for policy 0, policy_version 1740351 (0.0009) [2023-12-28 07:46:10,823][106225] Updated weights for policy 1, policy_version 1744623 (0.0009) [2023-12-28 07:46:10,890][106225] Updated weights for policy 1, policy_version 1744633 (0.0010) [2023-12-28 07:46:10,950][106225] Updated weights for policy 1, policy_version 1744643 (0.0007) [2023-12-28 07:46:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 892297216. Throughput: 0: 9824.6, 1: 9934.1. Samples: 892266812. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:46:11,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.728')] [2023-12-28 07:46:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001740360_445612032.pth... [2023-12-28 07:46:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001744648_446685184.pth... [2023-12-28 07:46:11,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001739208_445317120.pth [2023-12-28 07:46:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001743496_446390272.pth [2023-12-28 07:46:11,513][106226] Updated weights for policy 0, policy_version 1740361 (0.0006) [2023-12-28 07:46:11,579][106226] Updated weights for policy 0, policy_version 1740371 (0.0006) [2023-12-28 07:46:11,687][106226] Updated weights for policy 0, policy_version 1740381 (0.0007) [2023-12-28 07:46:11,760][106226] Updated weights for policy 0, policy_version 1740391 (0.0008) [2023-12-28 07:46:11,809][106225] Updated weights for policy 1, policy_version 1744653 (0.0007) [2023-12-28 07:46:11,877][106225] Updated weights for policy 1, policy_version 1744663 (0.0008) [2023-12-28 07:46:11,947][106225] Updated weights for policy 1, policy_version 1744673 (0.0008) [2023-12-28 07:46:12,444][106226] Updated weights for policy 0, policy_version 1740401 (0.0009) [2023-12-28 07:46:12,501][106226] Updated weights for policy 0, policy_version 1740411 (0.0009) [2023-12-28 07:46:12,562][106226] Updated weights for policy 0, policy_version 1740421 (0.0009) [2023-12-28 07:46:12,674][106225] Updated weights for policy 1, policy_version 1744683 (0.0008) [2023-12-28 07:46:12,730][106225] Updated weights for policy 1, policy_version 1744693 (0.0008) [2023-12-28 07:46:12,786][106225] Updated weights for policy 1, policy_version 1744703 (0.0005) [2023-12-28 07:46:13,249][106226] Updated weights for policy 0, policy_version 1740431 (0.0007) [2023-12-28 07:46:13,295][106226] Updated weights for policy 0, policy_version 1740441 (0.0005) [2023-12-28 07:46:13,344][106226] Updated weights for policy 0, policy_version 1740451 (0.0005) [2023-12-28 07:46:13,491][106225] Updated weights for policy 1, policy_version 1744713 (0.0008) [2023-12-28 07:46:13,539][106225] Updated weights for policy 1, policy_version 1744723 (0.0008) [2023-12-28 07:46:13,592][106225] Updated weights for policy 1, policy_version 1744733 (0.0005) [2023-12-28 07:46:13,644][106225] Updated weights for policy 1, policy_version 1744743 (0.0006) [2023-12-28 07:46:14,009][106226] Updated weights for policy 0, policy_version 1740461 (0.0006) [2023-12-28 07:46:14,061][106226] Updated weights for policy 0, policy_version 1740471 (0.0005) [2023-12-28 07:46:14,119][106226] Updated weights for policy 0, policy_version 1740481 (0.0006) [2023-12-28 07:46:14,415][106225] Updated weights for policy 1, policy_version 1744753 (0.0007) [2023-12-28 07:46:14,475][106225] Updated weights for policy 1, policy_version 1744763 (0.0007) [2023-12-28 07:46:14,532][106225] Updated weights for policy 1, policy_version 1744773 (0.0007) [2023-12-28 07:46:14,742][106226] Updated weights for policy 0, policy_version 1740491 (0.0008) [2023-12-28 07:46:14,824][106226] Updated weights for policy 0, policy_version 1740501 (0.0011) [2023-12-28 07:46:14,887][106226] Updated weights for policy 0, policy_version 1740511 (0.0011) [2023-12-28 07:46:15,348][106225] Updated weights for policy 1, policy_version 1744783 (0.0006) [2023-12-28 07:46:15,416][106225] Updated weights for policy 1, policy_version 1744793 (0.0005) [2023-12-28 07:46:15,478][106225] Updated weights for policy 1, policy_version 1744803 (0.0005) [2023-12-28 07:46:15,568][106226] Updated weights for policy 0, policy_version 1740521 (0.0010) [2023-12-28 07:46:15,630][106226] Updated weights for policy 0, policy_version 1740531 (0.0009) [2023-12-28 07:46:15,687][106226] Updated weights for policy 0, policy_version 1740541 (0.0009) [2023-12-28 07:46:15,747][106226] Updated weights for policy 0, policy_version 1740551 (0.0009) [2023-12-28 07:46:16,056][106225] Updated weights for policy 1, policy_version 1744813 (0.0006) [2023-12-28 07:46:16,118][106225] Updated weights for policy 1, policy_version 1744823 (0.0008) [2023-12-28 07:46:16,168][106225] Updated weights for policy 1, policy_version 1744833 (0.0008) [2023-12-28 07:46:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 892387328. Throughput: 0: 9745.9, 1: 9843.7. Samples: 892381628. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:46:16,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-4.724')] [2023-12-28 07:46:16,444][106226] Updated weights for policy 0, policy_version 1740561 (0.0010) [2023-12-28 07:46:16,500][106226] Updated weights for policy 0, policy_version 1740571 (0.0008) [2023-12-28 07:46:16,556][106226] Updated weights for policy 0, policy_version 1740581 (0.0010) [2023-12-28 07:46:16,916][106225] Updated weights for policy 1, policy_version 1744843 (0.0008) [2023-12-28 07:46:16,968][106225] Updated weights for policy 1, policy_version 1744853 (0.0008) [2023-12-28 07:46:17,021][106225] Updated weights for policy 1, policy_version 1744863 (0.0007) [2023-12-28 07:46:17,270][106226] Updated weights for policy 0, policy_version 1740591 (0.0010) [2023-12-28 07:46:17,340][106226] Updated weights for policy 0, policy_version 1740601 (0.0008) [2023-12-28 07:46:17,400][106226] Updated weights for policy 0, policy_version 1740611 (0.0005) [2023-12-28 07:46:17,655][106225] Updated weights for policy 1, policy_version 1744873 (0.0009) [2023-12-28 07:46:17,716][106225] Updated weights for policy 1, policy_version 1744883 (0.0007) [2023-12-28 07:46:17,776][106225] Updated weights for policy 1, policy_version 1744893 (0.0006) [2023-12-28 07:46:17,830][106225] Updated weights for policy 1, policy_version 1744903 (0.0006) [2023-12-28 07:46:18,067][106226] Updated weights for policy 0, policy_version 1740621 (0.0005) [2023-12-28 07:46:18,134][106226] Updated weights for policy 0, policy_version 1740631 (0.0007) [2023-12-28 07:46:18,200][106226] Updated weights for policy 0, policy_version 1740641 (0.0011) [2023-12-28 07:46:18,443][106225] Updated weights for policy 1, policy_version 1744913 (0.0009) [2023-12-28 07:46:18,506][106225] Updated weights for policy 1, policy_version 1744923 (0.0007) [2023-12-28 07:46:18,563][106225] Updated weights for policy 1, policy_version 1744933 (0.0005) [2023-12-28 07:46:18,910][106226] Updated weights for policy 0, policy_version 1740651 (0.0010) [2023-12-28 07:46:18,963][106226] Updated weights for policy 0, policy_version 1740661 (0.0008) [2023-12-28 07:46:19,017][106226] Updated weights for policy 0, policy_version 1740671 (0.0009) [2023-12-28 07:46:19,222][106225] Updated weights for policy 1, policy_version 1744943 (0.0007) [2023-12-28 07:46:19,288][106225] Updated weights for policy 1, policy_version 1744953 (0.0009) [2023-12-28 07:46:19,360][106225] Updated weights for policy 1, policy_version 1744963 (0.0009) [2023-12-28 07:46:19,763][106226] Updated weights for policy 0, policy_version 1740681 (0.0009) [2023-12-28 07:46:19,836][106226] Updated weights for policy 0, policy_version 1740691 (0.0007) [2023-12-28 07:46:19,897][106226] Updated weights for policy 0, policy_version 1740701 (0.0007) [2023-12-28 07:46:19,967][106226] Updated weights for policy 0, policy_version 1740711 (0.0009) [2023-12-28 07:46:20,099][106225] Updated weights for policy 1, policy_version 1744973 (0.0008) [2023-12-28 07:46:20,155][106225] Updated weights for policy 1, policy_version 1744983 (0.0008) [2023-12-28 07:46:20,203][106225] Updated weights for policy 1, policy_version 1744993 (0.0007) [2023-12-28 07:46:20,732][106226] Updated weights for policy 0, policy_version 1740721 (0.0006) [2023-12-28 07:46:20,800][106226] Updated weights for policy 0, policy_version 1740731 (0.0009) [2023-12-28 07:46:20,866][106226] Updated weights for policy 0, policy_version 1740741 (0.0008) [2023-12-28 07:46:20,957][106225] Updated weights for policy 1, policy_version 1745003 (0.0008) [2023-12-28 07:46:21,025][106225] Updated weights for policy 1, policy_version 1745013 (0.0009) [2023-12-28 07:46:21,092][106225] Updated weights for policy 1, policy_version 1745023 (0.0008) [2023-12-28 07:46:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 892493824. Throughput: 0: 9754.8, 1: 9821.5. Samples: 892499736. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-28 07:46:21,176][105115] Avg episode reward: [(0, '-4.440'), (1, '-5.105')] [2023-12-28 07:46:21,618][106226] Updated weights for policy 0, policy_version 1740751 (0.0009) [2023-12-28 07:46:21,695][106226] Updated weights for policy 0, policy_version 1740761 (0.0008) [2023-12-28 07:46:21,762][106226] Updated weights for policy 0, policy_version 1740771 (0.0008) [2023-12-28 07:46:21,849][106225] Updated weights for policy 1, policy_version 1745033 (0.0008) [2023-12-28 07:46:21,913][106225] Updated weights for policy 1, policy_version 1745043 (0.0006) [2023-12-28 07:46:21,985][106225] Updated weights for policy 1, policy_version 1745053 (0.0006) [2023-12-28 07:46:22,048][106225] Updated weights for policy 1, policy_version 1745063 (0.0007) [2023-12-28 07:46:22,458][106226] Updated weights for policy 0, policy_version 1740781 (0.0007) [2023-12-28 07:46:22,516][106226] Updated weights for policy 0, policy_version 1740791 (0.0009) [2023-12-28 07:46:22,574][106226] Updated weights for policy 0, policy_version 1740801 (0.0006) [2023-12-28 07:46:22,769][106225] Updated weights for policy 1, policy_version 1745073 (0.0009) [2023-12-28 07:46:22,829][106225] Updated weights for policy 1, policy_version 1745083 (0.0009) [2023-12-28 07:46:22,878][106225] Updated weights for policy 1, policy_version 1745093 (0.0009) [2023-12-28 07:46:23,278][106226] Updated weights for policy 0, policy_version 1740811 (0.0009) [2023-12-28 07:46:23,334][106226] Updated weights for policy 0, policy_version 1740821 (0.0008) [2023-12-28 07:46:23,390][106226] Updated weights for policy 0, policy_version 1740831 (0.0008) [2023-12-28 07:46:23,587][106225] Updated weights for policy 1, policy_version 1745103 (0.0010) [2023-12-28 07:46:23,646][106225] Updated weights for policy 1, policy_version 1745113 (0.0010) [2023-12-28 07:46:23,703][106225] Updated weights for policy 1, policy_version 1745123 (0.0010) [2023-12-28 07:46:24,169][106226] Updated weights for policy 0, policy_version 1740841 (0.0008) [2023-12-28 07:46:24,219][106226] Updated weights for policy 0, policy_version 1740851 (0.0008) [2023-12-28 07:46:24,266][106226] Updated weights for policy 0, policy_version 1740861 (0.0007) [2023-12-28 07:46:24,287][106225] Updated weights for policy 1, policy_version 1745133 (0.0010) [2023-12-28 07:46:24,313][106226] Updated weights for policy 0, policy_version 1740871 (0.0008) [2023-12-28 07:46:24,344][106225] Updated weights for policy 1, policy_version 1745143 (0.0010) [2023-12-28 07:46:24,415][106225] Updated weights for policy 1, policy_version 1745153 (0.0007) [2023-12-28 07:46:25,079][106226] Updated weights for policy 0, policy_version 1740881 (0.0008) [2023-12-28 07:46:25,103][106225] Updated weights for policy 1, policy_version 1745163 (0.0007) [2023-12-28 07:46:25,139][106226] Updated weights for policy 0, policy_version 1740891 (0.0007) [2023-12-28 07:46:25,159][106225] Updated weights for policy 1, policy_version 1745173 (0.0010) [2023-12-28 07:46:25,196][106226] Updated weights for policy 0, policy_version 1740901 (0.0008) [2023-12-28 07:46:25,212][106225] Updated weights for policy 1, policy_version 1745183 (0.0010) [2023-12-28 07:46:25,911][106226] Updated weights for policy 0, policy_version 1740911 (0.0009) [2023-12-28 07:46:25,930][106225] Updated weights for policy 1, policy_version 1745193 (0.0010) [2023-12-28 07:46:25,964][106226] Updated weights for policy 0, policy_version 1740921 (0.0010) [2023-12-28 07:46:25,983][106225] Updated weights for policy 1, policy_version 1745203 (0.0010) [2023-12-28 07:46:26,017][106226] Updated weights for policy 0, policy_version 1740931 (0.0010) [2023-12-28 07:46:26,042][106225] Updated weights for policy 1, policy_version 1745213 (0.0009) [2023-12-28 07:46:26,102][106225] Updated weights for policy 1, policy_version 1745223 (0.0008) [2023-12-28 07:46:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 892592128. Throughput: 0: 9736.4, 1: 9826.7. Samples: 892555988. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:26,175][105115] Avg episode reward: [(0, '-4.500'), (1, '-4.932')] [2023-12-28 07:46:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001745224_446832640.pth... [2023-12-28 07:46:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001740936_445759488.pth... [2023-12-28 07:46:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001744072_446537728.pth [2023-12-28 07:46:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001739816_445472768.pth [2023-12-28 07:46:26,749][106226] Updated weights for policy 0, policy_version 1740941 (0.0010) [2023-12-28 07:46:26,806][106226] Updated weights for policy 0, policy_version 1740951 (0.0008) [2023-12-28 07:46:26,815][106225] Updated weights for policy 1, policy_version 1745233 (0.0010) [2023-12-28 07:46:26,861][106225] Updated weights for policy 1, policy_version 1745243 (0.0010) [2023-12-28 07:46:26,863][106226] Updated weights for policy 0, policy_version 1740961 (0.0005) [2023-12-28 07:46:26,915][106225] Updated weights for policy 1, policy_version 1745253 (0.0010) [2023-12-28 07:46:27,552][106226] Updated weights for policy 0, policy_version 1740971 (0.0007) [2023-12-28 07:46:27,606][106226] Updated weights for policy 0, policy_version 1740981 (0.0008) [2023-12-28 07:46:27,640][106225] Updated weights for policy 1, policy_version 1745263 (0.0009) [2023-12-28 07:46:27,654][106226] Updated weights for policy 0, policy_version 1740991 (0.0006) [2023-12-28 07:46:27,691][106225] Updated weights for policy 1, policy_version 1745273 (0.0006) [2023-12-28 07:46:27,749][106225] Updated weights for policy 1, policy_version 1745283 (0.0008) [2023-12-28 07:46:28,315][106226] Updated weights for policy 0, policy_version 1741001 (0.0006) [2023-12-28 07:46:28,352][106225] Updated weights for policy 1, policy_version 1745293 (0.0008) [2023-12-28 07:46:28,379][106226] Updated weights for policy 0, policy_version 1741011 (0.0008) [2023-12-28 07:46:28,414][106225] Updated weights for policy 1, policy_version 1745303 (0.0007) [2023-12-28 07:46:28,441][106226] Updated weights for policy 0, policy_version 1741021 (0.0011) [2023-12-28 07:46:28,475][106225] Updated weights for policy 1, policy_version 1745313 (0.0005) [2023-12-28 07:46:28,503][106226] Updated weights for policy 0, policy_version 1741031 (0.0011) [2023-12-28 07:46:29,173][106225] Updated weights for policy 1, policy_version 1745323 (0.0007) [2023-12-28 07:46:29,205][106226] Updated weights for policy 0, policy_version 1741041 (0.0007) [2023-12-28 07:46:29,228][106225] Updated weights for policy 1, policy_version 1745333 (0.0007) [2023-12-28 07:46:29,273][106226] Updated weights for policy 0, policy_version 1741051 (0.0008) [2023-12-28 07:46:29,290][106225] Updated weights for policy 1, policy_version 1745343 (0.0007) [2023-12-28 07:46:29,333][106226] Updated weights for policy 0, policy_version 1741061 (0.0006) [2023-12-28 07:46:30,045][106225] Updated weights for policy 1, policy_version 1745353 (0.0006) [2023-12-28 07:46:30,115][106225] Updated weights for policy 1, policy_version 1745363 (0.0008) [2023-12-28 07:46:30,120][106226] Updated weights for policy 0, policy_version 1741071 (0.0008) [2023-12-28 07:46:30,172][106225] Updated weights for policy 1, policy_version 1745373 (0.0009) [2023-12-28 07:46:30,180][106226] Updated weights for policy 0, policy_version 1741081 (0.0006) [2023-12-28 07:46:30,233][106225] Updated weights for policy 1, policy_version 1745383 (0.0006) [2023-12-28 07:46:30,245][106226] Updated weights for policy 0, policy_version 1741091 (0.0008) [2023-12-28 07:46:30,851][106226] Updated weights for policy 0, policy_version 1741101 (0.0007) [2023-12-28 07:46:30,876][106225] Updated weights for policy 1, policy_version 1745393 (0.0009) [2023-12-28 07:46:30,903][106226] Updated weights for policy 0, policy_version 1741111 (0.0005) [2023-12-28 07:46:30,934][106225] Updated weights for policy 1, policy_version 1745403 (0.0010) [2023-12-28 07:46:30,956][106226] Updated weights for policy 0, policy_version 1741121 (0.0008) [2023-12-28 07:46:30,993][106225] Updated weights for policy 1, policy_version 1745413 (0.0010) [2023-12-28 07:46:31,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 892690432. Throughput: 0: 9754.9, 1: 9855.9. Samples: 892675172. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:31,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-5.026')] [2023-12-28 07:46:31,586][106226] Updated weights for policy 0, policy_version 1741131 (0.0008) [2023-12-28 07:46:31,648][106226] Updated weights for policy 0, policy_version 1741141 (0.0010) [2023-12-28 07:46:31,709][106226] Updated weights for policy 0, policy_version 1741151 (0.0009) [2023-12-28 07:46:31,764][106225] Updated weights for policy 1, policy_version 1745423 (0.0008) [2023-12-28 07:46:31,828][106225] Updated weights for policy 1, policy_version 1745433 (0.0006) [2023-12-28 07:46:31,894][106225] Updated weights for policy 1, policy_version 1745443 (0.0009) [2023-12-28 07:46:32,455][106226] Updated weights for policy 0, policy_version 1741161 (0.0010) [2023-12-28 07:46:32,506][106226] Updated weights for policy 0, policy_version 1741171 (0.0009) [2023-12-28 07:46:32,553][106225] Updated weights for policy 1, policy_version 1745453 (0.0008) [2023-12-28 07:46:32,561][106226] Updated weights for policy 0, policy_version 1741181 (0.0008) [2023-12-28 07:46:32,622][106225] Updated weights for policy 1, policy_version 1745463 (0.0007) [2023-12-28 07:46:32,623][106226] Updated weights for policy 0, policy_version 1741191 (0.0008) [2023-12-28 07:46:32,676][106225] Updated weights for policy 1, policy_version 1745473 (0.0007) [2023-12-28 07:46:33,257][106226] Updated weights for policy 0, policy_version 1741201 (0.0006) [2023-12-28 07:46:33,315][106226] Updated weights for policy 0, policy_version 1741211 (0.0005) [2023-12-28 07:46:33,364][106225] Updated weights for policy 1, policy_version 1745483 (0.0008) [2023-12-28 07:46:33,366][106226] Updated weights for policy 0, policy_version 1741221 (0.0006) [2023-12-28 07:46:33,421][106225] Updated weights for policy 1, policy_version 1745493 (0.0006) [2023-12-28 07:46:33,486][106225] Updated weights for policy 1, policy_version 1745503 (0.0005) [2023-12-28 07:46:33,899][106226] Updated weights for policy 0, policy_version 1741231 (0.0005) [2023-12-28 07:46:33,954][106226] Updated weights for policy 0, policy_version 1741241 (0.0005) [2023-12-28 07:46:34,005][106226] Updated weights for policy 0, policy_version 1741251 (0.0005) [2023-12-28 07:46:34,024][106225] Updated weights for policy 1, policy_version 1745513 (0.0005) [2023-12-28 07:46:34,082][106225] Updated weights for policy 1, policy_version 1745523 (0.0005) [2023-12-28 07:46:34,145][106225] Updated weights for policy 1, policy_version 1745533 (0.0009) [2023-12-28 07:46:34,204][106225] Updated weights for policy 1, policy_version 1745543 (0.0009) [2023-12-28 07:46:34,584][106226] Updated weights for policy 0, policy_version 1741261 (0.0006) [2023-12-28 07:46:34,655][106226] Updated weights for policy 0, policy_version 1741271 (0.0008) [2023-12-28 07:46:34,715][106226] Updated weights for policy 0, policy_version 1741281 (0.0009) [2023-12-28 07:46:34,919][106225] Updated weights for policy 1, policy_version 1745553 (0.0010) [2023-12-28 07:46:34,972][106225] Updated weights for policy 1, policy_version 1745563 (0.0010) [2023-12-28 07:46:35,022][106225] Updated weights for policy 1, policy_version 1745573 (0.0010) [2023-12-28 07:46:35,420][106226] Updated weights for policy 0, policy_version 1741291 (0.0007) [2023-12-28 07:46:35,476][106226] Updated weights for policy 0, policy_version 1741301 (0.0008) [2023-12-28 07:46:35,532][106226] Updated weights for policy 0, policy_version 1741311 (0.0007) [2023-12-28 07:46:35,754][106225] Updated weights for policy 1, policy_version 1745583 (0.0010) [2023-12-28 07:46:35,817][106225] Updated weights for policy 1, policy_version 1745593 (0.0010) [2023-12-28 07:46:35,877][106225] Updated weights for policy 1, policy_version 1745603 (0.0010) [2023-12-28 07:46:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 892788736. Throughput: 0: 9868.0, 1: 9865.2. Samples: 892799548. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:36,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.644')] [2023-12-28 07:46:36,222][106226] Updated weights for policy 0, policy_version 1741321 (0.0008) [2023-12-28 07:46:36,287][106226] Updated weights for policy 0, policy_version 1741331 (0.0007) [2023-12-28 07:46:36,339][106226] Updated weights for policy 0, policy_version 1741341 (0.0008) [2023-12-28 07:46:36,396][106226] Updated weights for policy 0, policy_version 1741351 (0.0008) [2023-12-28 07:46:36,619][106225] Updated weights for policy 1, policy_version 1745613 (0.0010) [2023-12-28 07:46:36,673][106225] Updated weights for policy 1, policy_version 1745623 (0.0010) [2023-12-28 07:46:36,727][106225] Updated weights for policy 1, policy_version 1745633 (0.0010) [2023-12-28 07:46:36,969][106226] Updated weights for policy 0, policy_version 1741361 (0.0008) [2023-12-28 07:46:37,032][106226] Updated weights for policy 0, policy_version 1741371 (0.0006) [2023-12-28 07:46:37,090][106226] Updated weights for policy 0, policy_version 1741381 (0.0006) [2023-12-28 07:46:37,467][106225] Updated weights for policy 1, policy_version 1745643 (0.0010) [2023-12-28 07:46:37,531][106225] Updated weights for policy 1, policy_version 1745653 (0.0008) [2023-12-28 07:46:37,591][106225] Updated weights for policy 1, policy_version 1745663 (0.0009) [2023-12-28 07:46:37,711][106226] Updated weights for policy 0, policy_version 1741391 (0.0006) [2023-12-28 07:46:37,779][106226] Updated weights for policy 0, policy_version 1741401 (0.0010) [2023-12-28 07:46:37,840][106226] Updated weights for policy 0, policy_version 1741411 (0.0010) [2023-12-28 07:46:38,197][106225] Updated weights for policy 1, policy_version 1745673 (0.0010) [2023-12-28 07:46:38,252][106225] Updated weights for policy 1, policy_version 1745683 (0.0006) [2023-12-28 07:46:38,306][106225] Updated weights for policy 1, policy_version 1745693 (0.0009) [2023-12-28 07:46:38,374][106225] Updated weights for policy 1, policy_version 1745703 (0.0008) [2023-12-28 07:46:38,536][106226] Updated weights for policy 0, policy_version 1741421 (0.0009) [2023-12-28 07:46:38,598][106226] Updated weights for policy 0, policy_version 1741431 (0.0009) [2023-12-28 07:46:38,663][106226] Updated weights for policy 0, policy_version 1741441 (0.0009) [2023-12-28 07:46:39,061][106225] Updated weights for policy 1, policy_version 1745713 (0.0006) [2023-12-28 07:46:39,123][106225] Updated weights for policy 1, policy_version 1745723 (0.0006) [2023-12-28 07:46:39,184][106225] Updated weights for policy 1, policy_version 1745733 (0.0006) [2023-12-28 07:46:39,320][106226] Updated weights for policy 0, policy_version 1741451 (0.0008) [2023-12-28 07:46:39,400][106226] Updated weights for policy 0, policy_version 1741461 (0.0008) [2023-12-28 07:46:39,469][106226] Updated weights for policy 0, policy_version 1741471 (0.0008) [2023-12-28 07:46:39,913][106225] Updated weights for policy 1, policy_version 1745743 (0.0010) [2023-12-28 07:46:39,984][106225] Updated weights for policy 1, policy_version 1745753 (0.0009) [2023-12-28 07:46:40,055][106225] Updated weights for policy 1, policy_version 1745763 (0.0008) [2023-12-28 07:46:40,195][106226] Updated weights for policy 0, policy_version 1741481 (0.0008) [2023-12-28 07:46:40,252][106226] Updated weights for policy 0, policy_version 1741491 (0.0009) [2023-12-28 07:46:40,319][106226] Updated weights for policy 0, policy_version 1741501 (0.0009) [2023-12-28 07:46:40,384][106226] Updated weights for policy 0, policy_version 1741511 (0.0009) [2023-12-28 07:46:40,749][106225] Updated weights for policy 1, policy_version 1745773 (0.0009) [2023-12-28 07:46:40,803][106225] Updated weights for policy 1, policy_version 1745783 (0.0010) [2023-12-28 07:46:40,876][106225] Updated weights for policy 1, policy_version 1745793 (0.0010) [2023-12-28 07:46:41,125][106226] Updated weights for policy 0, policy_version 1741521 (0.0009) [2023-12-28 07:46:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 892887040. Throughput: 0: 9927.1, 1: 9850.0. Samples: 892861060. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:41,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.727')] [2023-12-28 07:46:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001745800_446980096.pth... [2023-12-28 07:46:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001744648_446685184.pth [2023-12-28 07:46:41,189][106226] Updated weights for policy 0, policy_version 1741531 (0.0011) [2023-12-28 07:46:41,272][106226] Updated weights for policy 0, policy_version 1741541 (0.0010) [2023-12-28 07:46:41,289][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001741544_445915136.pth... [2023-12-28 07:46:41,292][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001740360_445612032.pth [2023-12-28 07:46:41,663][106225] Updated weights for policy 1, policy_version 1745803 (0.0010) [2023-12-28 07:46:41,727][106225] Updated weights for policy 1, policy_version 1745813 (0.0010) [2023-12-28 07:46:41,792][106225] Updated weights for policy 1, policy_version 1745823 (0.0010) [2023-12-28 07:46:41,968][106226] Updated weights for policy 0, policy_version 1741551 (0.0009) [2023-12-28 07:46:42,030][106226] Updated weights for policy 0, policy_version 1741561 (0.0008) [2023-12-28 07:46:42,077][106226] Updated weights for policy 0, policy_version 1741571 (0.0008) [2023-12-28 07:46:42,503][106225] Updated weights for policy 1, policy_version 1745833 (0.0008) [2023-12-28 07:46:42,571][106225] Updated weights for policy 1, policy_version 1745843 (0.0010) [2023-12-28 07:46:42,624][106225] Updated weights for policy 1, policy_version 1745853 (0.0010) [2023-12-28 07:46:42,671][106225] Updated weights for policy 1, policy_version 1745863 (0.0010) [2023-12-28 07:46:42,815][106226] Updated weights for policy 0, policy_version 1741581 (0.0007) [2023-12-28 07:46:42,877][106226] Updated weights for policy 0, policy_version 1741591 (0.0007) [2023-12-28 07:46:42,938][106226] Updated weights for policy 0, policy_version 1741601 (0.0007) [2023-12-28 07:46:43,396][106225] Updated weights for policy 1, policy_version 1745873 (0.0010) [2023-12-28 07:46:43,458][106225] Updated weights for policy 1, policy_version 1745883 (0.0010) [2023-12-28 07:46:43,517][106225] Updated weights for policy 1, policy_version 1745893 (0.0010) [2023-12-28 07:46:43,653][106226] Updated weights for policy 0, policy_version 1741611 (0.0010) [2023-12-28 07:46:43,700][106226] Updated weights for policy 0, policy_version 1741621 (0.0007) [2023-12-28 07:46:43,755][106226] Updated weights for policy 0, policy_version 1741631 (0.0009) [2023-12-28 07:46:44,058][106225] Updated weights for policy 1, policy_version 1745903 (0.0009) [2023-12-28 07:46:44,118][106225] Updated weights for policy 1, policy_version 1745913 (0.0006) [2023-12-28 07:46:44,177][106225] Updated weights for policy 1, policy_version 1745923 (0.0007) [2023-12-28 07:46:44,577][106226] Updated weights for policy 0, policy_version 1741641 (0.0009) [2023-12-28 07:46:44,627][106226] Updated weights for policy 0, policy_version 1741651 (0.0008) [2023-12-28 07:46:44,683][106226] Updated weights for policy 0, policy_version 1741661 (0.0008) [2023-12-28 07:46:44,726][106226] Updated weights for policy 0, policy_version 1741671 (0.0007) [2023-12-28 07:46:44,852][106225] Updated weights for policy 1, policy_version 1745933 (0.0009) [2023-12-28 07:46:44,918][106225] Updated weights for policy 1, policy_version 1745943 (0.0010) [2023-12-28 07:46:44,982][106225] Updated weights for policy 1, policy_version 1745953 (0.0011) [2023-12-28 07:46:45,446][106226] Updated weights for policy 0, policy_version 1741681 (0.0006) [2023-12-28 07:46:45,505][106226] Updated weights for policy 0, policy_version 1741691 (0.0008) [2023-12-28 07:46:45,564][106226] Updated weights for policy 0, policy_version 1741701 (0.0007) [2023-12-28 07:46:45,636][106225] Updated weights for policy 1, policy_version 1745963 (0.0011) [2023-12-28 07:46:45,696][106225] Updated weights for policy 1, policy_version 1745973 (0.0008) [2023-12-28 07:46:45,750][106225] Updated weights for policy 1, policy_version 1745983 (0.0006) [2023-12-28 07:46:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 892985344. Throughput: 0: 9856.8, 1: 9847.8. Samples: 892976404. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:46,176][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.876')] [2023-12-28 07:46:46,280][106225] Updated weights for policy 1, policy_version 1745993 (0.0005) [2023-12-28 07:46:46,316][106226] Updated weights for policy 0, policy_version 1741711 (0.0008) [2023-12-28 07:46:46,341][106225] Updated weights for policy 1, policy_version 1746003 (0.0005) [2023-12-28 07:46:46,379][106226] Updated weights for policy 0, policy_version 1741721 (0.0007) [2023-12-28 07:46:46,409][106225] Updated weights for policy 1, policy_version 1746013 (0.0005) [2023-12-28 07:46:46,433][106226] Updated weights for policy 0, policy_version 1741731 (0.0006) [2023-12-28 07:46:46,471][106225] Updated weights for policy 1, policy_version 1746023 (0.0006) [2023-12-28 07:46:47,051][106226] Updated weights for policy 0, policy_version 1741741 (0.0008) [2023-12-28 07:46:47,113][106226] Updated weights for policy 0, policy_version 1741751 (0.0008) [2023-12-28 07:46:47,170][106225] Updated weights for policy 1, policy_version 1746033 (0.0010) [2023-12-28 07:46:47,176][106226] Updated weights for policy 0, policy_version 1741761 (0.0006) [2023-12-28 07:46:47,231][106225] Updated weights for policy 1, policy_version 1746043 (0.0010) [2023-12-28 07:46:47,292][106225] Updated weights for policy 1, policy_version 1746053 (0.0010) [2023-12-28 07:46:47,864][106226] Updated weights for policy 0, policy_version 1741771 (0.0007) [2023-12-28 07:46:47,924][106226] Updated weights for policy 0, policy_version 1741781 (0.0008) [2023-12-28 07:46:47,971][106226] Updated weights for policy 0, policy_version 1741791 (0.0008) [2023-12-28 07:46:47,997][106225] Updated weights for policy 1, policy_version 1746063 (0.0011) [2023-12-28 07:46:48,052][106225] Updated weights for policy 1, policy_version 1746073 (0.0009) [2023-12-28 07:46:48,116][106225] Updated weights for policy 1, policy_version 1746083 (0.0008) [2023-12-28 07:46:48,685][106226] Updated weights for policy 0, policy_version 1741801 (0.0006) [2023-12-28 07:46:48,741][106226] Updated weights for policy 0, policy_version 1741811 (0.0008) [2023-12-28 07:46:48,798][106226] Updated weights for policy 0, policy_version 1741821 (0.0008) [2023-12-28 07:46:48,812][106225] Updated weights for policy 1, policy_version 1746093 (0.0010) [2023-12-28 07:46:48,853][106226] Updated weights for policy 0, policy_version 1741831 (0.0006) [2023-12-28 07:46:48,881][106225] Updated weights for policy 1, policy_version 1746103 (0.0011) [2023-12-28 07:46:48,943][106225] Updated weights for policy 1, policy_version 1746113 (0.0010) [2023-12-28 07:46:49,519][106226] Updated weights for policy 0, policy_version 1741841 (0.0007) [2023-12-28 07:46:49,577][106226] Updated weights for policy 0, policy_version 1741851 (0.0008) [2023-12-28 07:46:49,637][106226] Updated weights for policy 0, policy_version 1741861 (0.0008) [2023-12-28 07:46:49,659][106225] Updated weights for policy 1, policy_version 1746123 (0.0011) [2023-12-28 07:46:49,710][106225] Updated weights for policy 1, policy_version 1746133 (0.0010) [2023-12-28 07:46:49,765][106225] Updated weights for policy 1, policy_version 1746143 (0.0010) [2023-12-28 07:46:50,323][106226] Updated weights for policy 0, policy_version 1741871 (0.0007) [2023-12-28 07:46:50,382][106226] Updated weights for policy 0, policy_version 1741881 (0.0008) [2023-12-28 07:46:50,445][106226] Updated weights for policy 0, policy_version 1741891 (0.0008) [2023-12-28 07:46:50,546][106225] Updated weights for policy 1, policy_version 1746153 (0.0009) [2023-12-28 07:46:50,624][106225] Updated weights for policy 1, policy_version 1746164 (0.0010) [2023-12-28 07:46:50,686][106225] Updated weights for policy 1, policy_version 1746174 (0.0011) [2023-12-28 07:46:50,750][106225] Updated weights for policy 1, policy_version 1746184 (0.0010) [2023-12-28 07:46:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 893083648. Throughput: 0: 9839.7, 1: 9871.6. Samples: 893095720. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:51,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-5.062')] [2023-12-28 07:46:51,215][106226] Updated weights for policy 0, policy_version 1741901 (0.0008) [2023-12-28 07:46:51,282][106226] Updated weights for policy 0, policy_version 1741911 (0.0008) [2023-12-28 07:46:51,340][106226] Updated weights for policy 0, policy_version 1741921 (0.0008) [2023-12-28 07:46:51,526][106225] Updated weights for policy 1, policy_version 1746194 (0.0010) [2023-12-28 07:46:51,597][106225] Updated weights for policy 1, policy_version 1746204 (0.0008) [2023-12-28 07:46:51,657][106225] Updated weights for policy 1, policy_version 1746214 (0.0009) [2023-12-28 07:46:52,020][106226] Updated weights for policy 0, policy_version 1741931 (0.0008) [2023-12-28 07:46:52,075][106226] Updated weights for policy 0, policy_version 1741941 (0.0005) [2023-12-28 07:46:52,124][106226] Updated weights for policy 0, policy_version 1741951 (0.0006) [2023-12-28 07:46:52,408][106225] Updated weights for policy 1, policy_version 1746224 (0.0008) [2023-12-28 07:46:52,476][106225] Updated weights for policy 1, policy_version 1746234 (0.0010) [2023-12-28 07:46:52,544][106225] Updated weights for policy 1, policy_version 1746244 (0.0011) [2023-12-28 07:46:52,779][106226] Updated weights for policy 0, policy_version 1741961 (0.0005) [2023-12-28 07:46:52,842][106226] Updated weights for policy 0, policy_version 1741971 (0.0005) [2023-12-28 07:46:52,914][106226] Updated weights for policy 0, policy_version 1741981 (0.0007) [2023-12-28 07:46:52,974][106226] Updated weights for policy 0, policy_version 1741991 (0.0006) [2023-12-28 07:46:53,217][106225] Updated weights for policy 1, policy_version 1746254 (0.0010) [2023-12-28 07:46:53,274][106225] Updated weights for policy 1, policy_version 1746264 (0.0010) [2023-12-28 07:46:53,338][106225] Updated weights for policy 1, policy_version 1746274 (0.0010) [2023-12-28 07:46:53,540][106226] Updated weights for policy 0, policy_version 1742001 (0.0008) [2023-12-28 07:46:53,603][106226] Updated weights for policy 0, policy_version 1742011 (0.0006) [2023-12-28 07:46:53,670][106226] Updated weights for policy 0, policy_version 1742021 (0.0007) [2023-12-28 07:46:54,026][106225] Updated weights for policy 1, policy_version 1746284 (0.0008) [2023-12-28 07:46:54,077][106225] Updated weights for policy 1, policy_version 1746294 (0.0005) [2023-12-28 07:46:54,126][106225] Updated weights for policy 1, policy_version 1746304 (0.0009) [2023-12-28 07:46:54,294][106226] Updated weights for policy 0, policy_version 1742031 (0.0006) [2023-12-28 07:46:54,357][106226] Updated weights for policy 0, policy_version 1742041 (0.0006) [2023-12-28 07:46:54,407][106226] Updated weights for policy 0, policy_version 1742051 (0.0007) [2023-12-28 07:46:54,727][106225] Updated weights for policy 1, policy_version 1746314 (0.0009) [2023-12-28 07:46:54,786][106225] Updated weights for policy 1, policy_version 1746324 (0.0005) [2023-12-28 07:46:54,846][106225] Updated weights for policy 1, policy_version 1746334 (0.0005) [2023-12-28 07:46:54,902][106225] Updated weights for policy 1, policy_version 1746344 (0.0005) [2023-12-28 07:46:55,133][106226] Updated weights for policy 0, policy_version 1742061 (0.0007) [2023-12-28 07:46:55,189][106226] Updated weights for policy 0, policy_version 1742071 (0.0006) [2023-12-28 07:46:55,251][106226] Updated weights for policy 0, policy_version 1742081 (0.0006) [2023-12-28 07:46:55,426][106225] Updated weights for policy 1, policy_version 1746354 (0.0005) [2023-12-28 07:46:55,477][106225] Updated weights for policy 1, policy_version 1746364 (0.0005) [2023-12-28 07:46:55,527][106225] Updated weights for policy 1, policy_version 1746374 (0.0005) [2023-12-28 07:46:55,812][106226] Updated weights for policy 0, policy_version 1742091 (0.0007) [2023-12-28 07:46:55,865][106226] Updated weights for policy 0, policy_version 1742101 (0.0009) [2023-12-28 07:46:55,925][106226] Updated weights for policy 0, policy_version 1742111 (0.0009) [2023-12-28 07:46:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 893190144. Throughput: 0: 9910.0, 1: 9840.0. Samples: 893155564. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:46:56,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.800')] [2023-12-28 07:46:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001746376_447127552.pth... [2023-12-28 07:46:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001742120_446062592.pth... [2023-12-28 07:46:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001740936_445759488.pth [2023-12-28 07:46:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001745224_446832640.pth [2023-12-28 07:46:56,252][106225] Updated weights for policy 1, policy_version 1746384 (0.0007) [2023-12-28 07:46:56,311][106225] Updated weights for policy 1, policy_version 1746394 (0.0009) [2023-12-28 07:46:56,363][106225] Updated weights for policy 1, policy_version 1746404 (0.0009) [2023-12-28 07:46:56,584][106226] Updated weights for policy 0, policy_version 1742121 (0.0007) [2023-12-28 07:46:56,641][106226] Updated weights for policy 0, policy_version 1742131 (0.0009) [2023-12-28 07:46:56,695][106226] Updated weights for policy 0, policy_version 1742141 (0.0009) [2023-12-28 07:46:56,749][106226] Updated weights for policy 0, policy_version 1742151 (0.0009) [2023-12-28 07:46:57,023][106225] Updated weights for policy 1, policy_version 1746414 (0.0006) [2023-12-28 07:46:57,089][106225] Updated weights for policy 1, policy_version 1746424 (0.0005) [2023-12-28 07:46:57,149][106225] Updated weights for policy 1, policy_version 1746434 (0.0007) [2023-12-28 07:46:57,455][106226] Updated weights for policy 0, policy_version 1742161 (0.0008) [2023-12-28 07:46:57,516][106226] Updated weights for policy 0, policy_version 1742171 (0.0008) [2023-12-28 07:46:57,575][106226] Updated weights for policy 0, policy_version 1742181 (0.0008) [2023-12-28 07:46:57,715][106225] Updated weights for policy 1, policy_version 1746444 (0.0007) [2023-12-28 07:46:57,769][106225] Updated weights for policy 1, policy_version 1746454 (0.0009) [2023-12-28 07:46:57,827][106225] Updated weights for policy 1, policy_version 1746464 (0.0008) [2023-12-28 07:46:58,292][106226] Updated weights for policy 0, policy_version 1742191 (0.0009) [2023-12-28 07:46:58,373][106226] Updated weights for policy 0, policy_version 1742201 (0.0010) [2023-12-28 07:46:58,441][106226] Updated weights for policy 0, policy_version 1742211 (0.0008) [2023-12-28 07:46:58,582][106225] Updated weights for policy 1, policy_version 1746474 (0.0008) [2023-12-28 07:46:58,650][106225] Updated weights for policy 1, policy_version 1746484 (0.0008) [2023-12-28 07:46:58,705][106225] Updated weights for policy 1, policy_version 1746494 (0.0007) [2023-12-28 07:46:58,770][106225] Updated weights for policy 1, policy_version 1746504 (0.0008) [2023-12-28 07:46:59,196][106226] Updated weights for policy 0, policy_version 1742221 (0.0008) [2023-12-28 07:46:59,279][106226] Updated weights for policy 0, policy_version 1742231 (0.0010) [2023-12-28 07:46:59,347][106226] Updated weights for policy 0, policy_version 1742241 (0.0009) [2023-12-28 07:46:59,604][106225] Updated weights for policy 1, policy_version 1746514 (0.0008) [2023-12-28 07:46:59,663][106225] Updated weights for policy 1, policy_version 1746524 (0.0010) [2023-12-28 07:46:59,721][106225] Updated weights for policy 1, policy_version 1746534 (0.0010) [2023-12-28 07:47:00,061][106226] Updated weights for policy 0, policy_version 1742251 (0.0008) [2023-12-28 07:47:00,120][106226] Updated weights for policy 0, policy_version 1742261 (0.0007) [2023-12-28 07:47:00,183][106226] Updated weights for policy 0, policy_version 1742271 (0.0008) [2023-12-28 07:47:00,459][106225] Updated weights for policy 1, policy_version 1746544 (0.0010) [2023-12-28 07:47:00,509][106225] Updated weights for policy 1, policy_version 1746554 (0.0007) [2023-12-28 07:47:00,569][106225] Updated weights for policy 1, policy_version 1746564 (0.0008) [2023-12-28 07:47:00,894][106226] Updated weights for policy 0, policy_version 1742281 (0.0007) [2023-12-28 07:47:00,946][106226] Updated weights for policy 0, policy_version 1742291 (0.0005) [2023-12-28 07:47:01,004][106226] Updated weights for policy 0, policy_version 1742301 (0.0008) [2023-12-28 07:47:01,072][106226] Updated weights for policy 0, policy_version 1742311 (0.0009) [2023-12-28 07:47:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 893288448. Throughput: 0: 9930.4, 1: 9968.2. Samples: 893277064. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:01,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.819')] [2023-12-28 07:47:01,268][106225] Updated weights for policy 1, policy_version 1746574 (0.0009) [2023-12-28 07:47:01,333][106225] Updated weights for policy 1, policy_version 1746584 (0.0010) [2023-12-28 07:47:01,404][106225] Updated weights for policy 1, policy_version 1746594 (0.0012) [2023-12-28 07:47:01,816][106226] Updated weights for policy 0, policy_version 1742321 (0.0009) [2023-12-28 07:47:01,867][106226] Updated weights for policy 0, policy_version 1742331 (0.0008) [2023-12-28 07:47:01,930][106226] Updated weights for policy 0, policy_version 1742341 (0.0009) [2023-12-28 07:47:02,079][106225] Updated weights for policy 1, policy_version 1746604 (0.0009) [2023-12-28 07:47:02,139][106225] Updated weights for policy 1, policy_version 1746614 (0.0007) [2023-12-28 07:47:02,208][106225] Updated weights for policy 1, policy_version 1746624 (0.0006) [2023-12-28 07:47:02,700][106226] Updated weights for policy 0, policy_version 1742351 (0.0010) [2023-12-28 07:47:02,760][106226] Updated weights for policy 0, policy_version 1742361 (0.0007) [2023-12-28 07:47:02,826][106226] Updated weights for policy 0, policy_version 1742371 (0.0006) [2023-12-28 07:47:02,839][106225] Updated weights for policy 1, policy_version 1746634 (0.0008) [2023-12-28 07:47:02,898][106225] Updated weights for policy 1, policy_version 1746645 (0.0009) [2023-12-28 07:47:02,961][106225] Updated weights for policy 1, policy_version 1746655 (0.0006) [2023-12-28 07:47:03,487][106226] Updated weights for policy 0, policy_version 1742381 (0.0007) [2023-12-28 07:47:03,506][106225] Updated weights for policy 1, policy_version 1746665 (0.0005) [2023-12-28 07:47:03,540][106226] Updated weights for policy 0, policy_version 1742391 (0.0005) [2023-12-28 07:47:03,562][106225] Updated weights for policy 1, policy_version 1746675 (0.0008) [2023-12-28 07:47:03,599][106226] Updated weights for policy 0, policy_version 1742401 (0.0007) [2023-12-28 07:47:03,618][106225] Updated weights for policy 1, policy_version 1746685 (0.0010) [2023-12-28 07:47:03,674][106225] Updated weights for policy 1, policy_version 1746695 (0.0010) [2023-12-28 07:47:04,265][106226] Updated weights for policy 0, policy_version 1742411 (0.0010) [2023-12-28 07:47:04,323][106225] Updated weights for policy 1, policy_version 1746705 (0.0010) [2023-12-28 07:47:04,324][106226] Updated weights for policy 0, policy_version 1742421 (0.0011) [2023-12-28 07:47:04,383][106225] Updated weights for policy 1, policy_version 1746715 (0.0010) [2023-12-28 07:47:04,387][106226] Updated weights for policy 0, policy_version 1742431 (0.0011) [2023-12-28 07:47:04,438][106225] Updated weights for policy 1, policy_version 1746725 (0.0010) [2023-12-28 07:47:05,059][106226] Updated weights for policy 0, policy_version 1742441 (0.0010) [2023-12-28 07:47:05,071][106225] Updated weights for policy 1, policy_version 1746735 (0.0010) [2023-12-28 07:47:05,132][106226] Updated weights for policy 0, policy_version 1742451 (0.0009) [2023-12-28 07:47:05,135][106225] Updated weights for policy 1, policy_version 1746745 (0.0010) [2023-12-28 07:47:05,192][106225] Updated weights for policy 1, policy_version 1746755 (0.0010) [2023-12-28 07:47:05,204][106226] Updated weights for policy 0, policy_version 1742461 (0.0007) [2023-12-28 07:47:05,273][106226] Updated weights for policy 0, policy_version 1742471 (0.0005) [2023-12-28 07:47:05,892][106225] Updated weights for policy 1, policy_version 1746765 (0.0010) [2023-12-28 07:47:05,894][106226] Updated weights for policy 0, policy_version 1742481 (0.0010) [2023-12-28 07:47:05,952][106226] Updated weights for policy 0, policy_version 1742491 (0.0011) [2023-12-28 07:47:05,953][106225] Updated weights for policy 1, policy_version 1746775 (0.0010) [2023-12-28 07:47:06,010][106225] Updated weights for policy 1, policy_version 1746785 (0.0010) [2023-12-28 07:47:06,012][106226] Updated weights for policy 0, policy_version 1742501 (0.0010) [2023-12-28 07:47:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 893394944. Throughput: 0: 9955.8, 1: 10016.4. Samples: 893398484. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:06,175][105115] Avg episode reward: [(0, '-4.607'), (1, '-4.859')] [2023-12-28 07:47:06,708][106226] Updated weights for policy 0, policy_version 1742511 (0.0009) [2023-12-28 07:47:06,761][106226] Updated weights for policy 0, policy_version 1742521 (0.0009) [2023-12-28 07:47:06,779][106225] Updated weights for policy 1, policy_version 1746795 (0.0010) [2023-12-28 07:47:06,813][106226] Updated weights for policy 0, policy_version 1742531 (0.0006) [2023-12-28 07:47:06,834][106225] Updated weights for policy 1, policy_version 1746805 (0.0007) [2023-12-28 07:47:06,894][106225] Updated weights for policy 1, policy_version 1746815 (0.0007) [2023-12-28 07:47:07,520][106225] Updated weights for policy 1, policy_version 1746825 (0.0006) [2023-12-28 07:47:07,559][106226] Updated weights for policy 0, policy_version 1742541 (0.0006) [2023-12-28 07:47:07,586][106225] Updated weights for policy 1, policy_version 1746835 (0.0007) [2023-12-28 07:47:07,626][106226] Updated weights for policy 0, policy_version 1742551 (0.0006) [2023-12-28 07:47:07,642][106225] Updated weights for policy 1, policy_version 1746845 (0.0008) [2023-12-28 07:47:07,685][106226] Updated weights for policy 0, policy_version 1742561 (0.0008) [2023-12-28 07:47:07,702][106225] Updated weights for policy 1, policy_version 1746855 (0.0007) [2023-12-28 07:47:08,381][106225] Updated weights for policy 1, policy_version 1746865 (0.0008) [2023-12-28 07:47:08,395][106226] Updated weights for policy 0, policy_version 1742571 (0.0009) [2023-12-28 07:47:08,440][106225] Updated weights for policy 1, policy_version 1746875 (0.0006) [2023-12-28 07:47:08,457][106226] Updated weights for policy 0, policy_version 1742581 (0.0011) [2023-12-28 07:47:08,502][106225] Updated weights for policy 1, policy_version 1746885 (0.0006) [2023-12-28 07:47:08,518][106226] Updated weights for policy 0, policy_version 1742591 (0.0011) [2023-12-28 07:47:09,180][106226] Updated weights for policy 0, policy_version 1742601 (0.0010) [2023-12-28 07:47:09,226][106225] Updated weights for policy 1, policy_version 1746895 (0.0008) [2023-12-28 07:47:09,239][106226] Updated weights for policy 0, policy_version 1742611 (0.0007) [2023-12-28 07:47:09,284][106225] Updated weights for policy 1, policy_version 1746905 (0.0007) [2023-12-28 07:47:09,300][106226] Updated weights for policy 0, policy_version 1742621 (0.0008) [2023-12-28 07:47:09,350][106225] Updated weights for policy 1, policy_version 1746915 (0.0009) [2023-12-28 07:47:09,367][106226] Updated weights for policy 0, policy_version 1742631 (0.0009) [2023-12-28 07:47:10,074][106225] Updated weights for policy 1, policy_version 1746925 (0.0009) [2023-12-28 07:47:10,116][106226] Updated weights for policy 0, policy_version 1742641 (0.0009) [2023-12-28 07:47:10,135][106225] Updated weights for policy 1, policy_version 1746935 (0.0008) [2023-12-28 07:47:10,178][106226] Updated weights for policy 0, policy_version 1742651 (0.0008) [2023-12-28 07:47:10,196][106225] Updated weights for policy 1, policy_version 1746945 (0.0007) [2023-12-28 07:47:10,235][106226] Updated weights for policy 0, policy_version 1742661 (0.0007) [2023-12-28 07:47:10,881][106225] Updated weights for policy 1, policy_version 1746955 (0.0006) [2023-12-28 07:47:10,937][106225] Updated weights for policy 1, policy_version 1746965 (0.0005) [2023-12-28 07:47:10,962][106226] Updated weights for policy 0, policy_version 1742671 (0.0009) [2023-12-28 07:47:10,998][106225] Updated weights for policy 1, policy_version 1746975 (0.0006) [2023-12-28 07:47:11,016][106226] Updated weights for policy 0, policy_version 1742681 (0.0007) [2023-12-28 07:47:11,084][106226] Updated weights for policy 0, policy_version 1742691 (0.0008) [2023-12-28 07:47:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 893493248. Throughput: 0: 9977.8, 1: 10052.0. Samples: 893457328. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:11,175][105115] Avg episode reward: [(0, '-4.388'), (1, '-4.949')] [2023-12-28 07:47:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001746984_447283200.pth... [2023-12-28 07:47:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001742696_446210048.pth... [2023-12-28 07:47:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001745800_446980096.pth [2023-12-28 07:47:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001741544_445915136.pth [2023-12-28 07:47:11,738][106225] Updated weights for policy 1, policy_version 1746985 (0.0007) [2023-12-28 07:47:11,804][106225] Updated weights for policy 1, policy_version 1746995 (0.0008) [2023-12-28 07:47:11,858][106225] Updated weights for policy 1, policy_version 1747005 (0.0009) [2023-12-28 07:47:11,910][106226] Updated weights for policy 0, policy_version 1742701 (0.0008) [2023-12-28 07:47:11,912][106225] Updated weights for policy 1, policy_version 1747015 (0.0007) [2023-12-28 07:47:11,966][106226] Updated weights for policy 0, policy_version 1742711 (0.0008) [2023-12-28 07:47:12,017][106226] Updated weights for policy 0, policy_version 1742721 (0.0009) [2023-12-28 07:47:12,641][106225] Updated weights for policy 1, policy_version 1747025 (0.0008) [2023-12-28 07:47:12,702][106225] Updated weights for policy 1, policy_version 1747035 (0.0010) [2023-12-28 07:47:12,724][106226] Updated weights for policy 0, policy_version 1742731 (0.0006) [2023-12-28 07:47:12,766][106225] Updated weights for policy 1, policy_version 1747045 (0.0006) [2023-12-28 07:47:12,788][106226] Updated weights for policy 0, policy_version 1742741 (0.0009) [2023-12-28 07:47:12,854][106226] Updated weights for policy 0, policy_version 1742751 (0.0008) [2023-12-28 07:47:13,384][106225] Updated weights for policy 1, policy_version 1747055 (0.0007) [2023-12-28 07:47:13,444][106225] Updated weights for policy 1, policy_version 1747065 (0.0006) [2023-12-28 07:47:13,499][106225] Updated weights for policy 1, policy_version 1747075 (0.0005) [2023-12-28 07:47:13,596][106226] Updated weights for policy 0, policy_version 1742761 (0.0008) [2023-12-28 07:47:13,653][106226] Updated weights for policy 0, policy_version 1742771 (0.0009) [2023-12-28 07:47:13,704][106226] Updated weights for policy 0, policy_version 1742781 (0.0009) [2023-12-28 07:47:13,762][106226] Updated weights for policy 0, policy_version 1742791 (0.0009) [2023-12-28 07:47:14,040][106225] Updated weights for policy 1, policy_version 1747085 (0.0008) [2023-12-28 07:47:14,104][106225] Updated weights for policy 1, policy_version 1747095 (0.0008) [2023-12-28 07:47:14,163][106225] Updated weights for policy 1, policy_version 1747105 (0.0008) [2023-12-28 07:47:14,477][106226] Updated weights for policy 0, policy_version 1742801 (0.0007) [2023-12-28 07:47:14,530][106226] Updated weights for policy 0, policy_version 1742811 (0.0007) [2023-12-28 07:47:14,582][106226] Updated weights for policy 0, policy_version 1742821 (0.0008) [2023-12-28 07:47:14,905][106225] Updated weights for policy 1, policy_version 1747115 (0.0009) [2023-12-28 07:47:14,971][106225] Updated weights for policy 1, policy_version 1747125 (0.0009) [2023-12-28 07:47:15,034][106225] Updated weights for policy 1, policy_version 1747135 (0.0010) [2023-12-28 07:47:15,390][106226] Updated weights for policy 0, policy_version 1742831 (0.0010) [2023-12-28 07:47:15,438][106226] Updated weights for policy 0, policy_version 1742841 (0.0009) [2023-12-28 07:47:15,494][106226] Updated weights for policy 0, policy_version 1742851 (0.0009) [2023-12-28 07:47:15,589][106225] Updated weights for policy 1, policy_version 1747145 (0.0006) [2023-12-28 07:47:15,651][106225] Updated weights for policy 1, policy_version 1747155 (0.0005) [2023-12-28 07:47:15,707][106225] Updated weights for policy 1, policy_version 1747165 (0.0005) [2023-12-28 07:47:15,771][106225] Updated weights for policy 1, policy_version 1747175 (0.0005) [2023-12-28 07:47:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 893583360. Throughput: 0: 9941.3, 1: 10046.2. Samples: 893574608. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:16,175][105115] Avg episode reward: [(0, '-4.107'), (1, '-4.838')] [2023-12-28 07:47:16,269][106225] Updated weights for policy 1, policy_version 1747185 (0.0005) [2023-12-28 07:47:16,330][106225] Updated weights for policy 1, policy_version 1747195 (0.0005) [2023-12-28 07:47:16,366][106226] Updated weights for policy 0, policy_version 1742861 (0.0010) [2023-12-28 07:47:16,386][106225] Updated weights for policy 1, policy_version 1747205 (0.0005) [2023-12-28 07:47:16,420][106226] Updated weights for policy 0, policy_version 1742871 (0.0009) [2023-12-28 07:47:16,469][106226] Updated weights for policy 0, policy_version 1742881 (0.0008) [2023-12-28 07:47:16,990][106225] Updated weights for policy 1, policy_version 1747215 (0.0009) [2023-12-28 07:47:17,051][106225] Updated weights for policy 1, policy_version 1747225 (0.0010) [2023-12-28 07:47:17,111][106225] Updated weights for policy 1, policy_version 1747235 (0.0010) [2023-12-28 07:47:17,182][106226] Updated weights for policy 0, policy_version 1742891 (0.0007) [2023-12-28 07:47:17,261][106226] Updated weights for policy 0, policy_version 1742901 (0.0008) [2023-12-28 07:47:17,321][106226] Updated weights for policy 0, policy_version 1742911 (0.0009) [2023-12-28 07:47:17,742][106225] Updated weights for policy 1, policy_version 1747245 (0.0011) [2023-12-28 07:47:17,807][106225] Updated weights for policy 1, policy_version 1747255 (0.0011) [2023-12-28 07:47:17,864][106225] Updated weights for policy 1, policy_version 1747265 (0.0010) [2023-12-28 07:47:18,047][106226] Updated weights for policy 0, policy_version 1742921 (0.0010) [2023-12-28 07:47:18,100][106226] Updated weights for policy 0, policy_version 1742931 (0.0010) [2023-12-28 07:47:18,156][106226] Updated weights for policy 0, policy_version 1742941 (0.0010) [2023-12-28 07:47:18,213][106226] Updated weights for policy 0, policy_version 1742951 (0.0008) [2023-12-28 07:47:18,538][106225] Updated weights for policy 1, policy_version 1747275 (0.0010) [2023-12-28 07:47:18,591][106225] Updated weights for policy 1, policy_version 1747285 (0.0007) [2023-12-28 07:47:18,648][106225] Updated weights for policy 1, policy_version 1747295 (0.0005) [2023-12-28 07:47:18,975][106226] Updated weights for policy 0, policy_version 1742961 (0.0008) [2023-12-28 07:47:19,029][106226] Updated weights for policy 0, policy_version 1742971 (0.0008) [2023-12-28 07:47:19,085][106226] Updated weights for policy 0, policy_version 1742981 (0.0007) [2023-12-28 07:47:19,368][106225] Updated weights for policy 1, policy_version 1747305 (0.0006) [2023-12-28 07:47:19,438][106225] Updated weights for policy 1, policy_version 1747315 (0.0009) [2023-12-28 07:47:19,512][106225] Updated weights for policy 1, policy_version 1747325 (0.0008) [2023-12-28 07:47:19,575][106225] Updated weights for policy 1, policy_version 1747335 (0.0008) [2023-12-28 07:47:19,775][106226] Updated weights for policy 0, policy_version 1742991 (0.0006) [2023-12-28 07:47:19,843][106226] Updated weights for policy 0, policy_version 1743001 (0.0007) [2023-12-28 07:47:19,909][106226] Updated weights for policy 0, policy_version 1743011 (0.0008) [2023-12-28 07:47:20,243][106225] Updated weights for policy 1, policy_version 1747345 (0.0007) [2023-12-28 07:47:20,303][106225] Updated weights for policy 1, policy_version 1747355 (0.0007) [2023-12-28 07:47:20,367][106225] Updated weights for policy 1, policy_version 1747365 (0.0008) [2023-12-28 07:47:20,660][106226] Updated weights for policy 0, policy_version 1743021 (0.0008) [2023-12-28 07:47:20,720][106226] Updated weights for policy 0, policy_version 1743031 (0.0009) [2023-12-28 07:47:20,776][106226] Updated weights for policy 0, policy_version 1743041 (0.0009) [2023-12-28 07:47:21,100][106225] Updated weights for policy 1, policy_version 1747375 (0.0009) [2023-12-28 07:47:21,165][106225] Updated weights for policy 1, policy_version 1747385 (0.0007) [2023-12-28 07:47:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 893681664. Throughput: 0: 9740.3, 1: 10126.4. Samples: 893693552. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:21,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.744')] [2023-12-28 07:47:21,222][106225] Updated weights for policy 1, policy_version 1747395 (0.0007) [2023-12-28 07:47:21,582][106226] Updated weights for policy 0, policy_version 1743051 (0.0008) [2023-12-28 07:47:21,653][106226] Updated weights for policy 0, policy_version 1743061 (0.0008) [2023-12-28 07:47:21,724][106226] Updated weights for policy 0, policy_version 1743071 (0.0009) [2023-12-28 07:47:22,009][106225] Updated weights for policy 1, policy_version 1747405 (0.0007) [2023-12-28 07:47:22,079][106225] Updated weights for policy 1, policy_version 1747415 (0.0009) [2023-12-28 07:47:22,145][106225] Updated weights for policy 1, policy_version 1747425 (0.0009) [2023-12-28 07:47:22,438][106226] Updated weights for policy 0, policy_version 1743081 (0.0009) [2023-12-28 07:47:22,491][106226] Updated weights for policy 0, policy_version 1743091 (0.0007) [2023-12-28 07:47:22,556][106226] Updated weights for policy 0, policy_version 1743101 (0.0009) [2023-12-28 07:47:22,605][106226] Updated weights for policy 0, policy_version 1743111 (0.0008) [2023-12-28 07:47:22,907][106225] Updated weights for policy 1, policy_version 1747435 (0.0009) [2023-12-28 07:47:22,967][106225] Updated weights for policy 1, policy_version 1747445 (0.0008) [2023-12-28 07:47:23,028][106225] Updated weights for policy 1, policy_version 1747455 (0.0008) [2023-12-28 07:47:23,295][106226] Updated weights for policy 0, policy_version 1743121 (0.0008) [2023-12-28 07:47:23,341][106226] Updated weights for policy 0, policy_version 1743131 (0.0008) [2023-12-28 07:47:23,388][106226] Updated weights for policy 0, policy_version 1743141 (0.0008) [2023-12-28 07:47:23,710][106225] Updated weights for policy 1, policy_version 1747465 (0.0009) [2023-12-28 07:47:23,759][106225] Updated weights for policy 1, policy_version 1747475 (0.0008) [2023-12-28 07:47:23,814][106225] Updated weights for policy 1, policy_version 1747485 (0.0008) [2023-12-28 07:47:23,872][106225] Updated weights for policy 1, policy_version 1747495 (0.0008) [2023-12-28 07:47:24,104][106226] Updated weights for policy 0, policy_version 1743151 (0.0008) [2023-12-28 07:47:24,158][106226] Updated weights for policy 0, policy_version 1743161 (0.0009) [2023-12-28 07:47:24,212][106226] Updated weights for policy 0, policy_version 1743171 (0.0008) [2023-12-28 07:47:24,600][106225] Updated weights for policy 1, policy_version 1747505 (0.0007) [2023-12-28 07:47:24,658][106225] Updated weights for policy 1, policy_version 1747515 (0.0010) [2023-12-28 07:47:24,708][106225] Updated weights for policy 1, policy_version 1747526 (0.0009) [2023-12-28 07:47:24,882][106226] Updated weights for policy 0, policy_version 1743181 (0.0007) [2023-12-28 07:47:24,929][106226] Updated weights for policy 0, policy_version 1743191 (0.0006) [2023-12-28 07:47:24,977][106226] Updated weights for policy 0, policy_version 1743201 (0.0005) [2023-12-28 07:47:25,522][106225] Updated weights for policy 1, policy_version 1747536 (0.0009) [2023-12-28 07:47:25,577][106225] Updated weights for policy 1, policy_version 1747546 (0.0007) [2023-12-28 07:47:25,634][106225] Updated weights for policy 1, policy_version 1747556 (0.0005) [2023-12-28 07:47:25,653][106226] Updated weights for policy 0, policy_version 1743211 (0.0008) [2023-12-28 07:47:25,702][106226] Updated weights for policy 0, policy_version 1743221 (0.0009) [2023-12-28 07:47:25,750][106226] Updated weights for policy 0, policy_version 1743231 (0.0008) [2023-12-28 07:47:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 893779968. Throughput: 0: 9690.9, 1: 10094.7. Samples: 893751408. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:26,175][105115] Avg episode reward: [(0, '-4.533'), (1, '-4.767')] [2023-12-28 07:47:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001743240_446349312.pth... [2023-12-28 07:47:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001747560_447430656.pth... [2023-12-28 07:47:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001742120_446062592.pth [2023-12-28 07:47:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001746376_447127552.pth [2023-12-28 07:47:26,246][106225] Updated weights for policy 1, policy_version 1747566 (0.0005) [2023-12-28 07:47:26,303][106225] Updated weights for policy 1, policy_version 1747576 (0.0007) [2023-12-28 07:47:26,356][106225] Updated weights for policy 1, policy_version 1747586 (0.0010) [2023-12-28 07:47:26,431][106226] Updated weights for policy 0, policy_version 1743241 (0.0009) [2023-12-28 07:47:26,487][106226] Updated weights for policy 0, policy_version 1743251 (0.0009) [2023-12-28 07:47:26,542][106226] Updated weights for policy 0, policy_version 1743261 (0.0008) [2023-12-28 07:47:26,593][106226] Updated weights for policy 0, policy_version 1743271 (0.0006) [2023-12-28 07:47:26,907][106225] Updated weights for policy 1, policy_version 1747596 (0.0010) [2023-12-28 07:47:26,964][106225] Updated weights for policy 1, policy_version 1747606 (0.0010) [2023-12-28 07:47:27,013][106225] Updated weights for policy 1, policy_version 1747616 (0.0010) [2023-12-28 07:47:27,224][106226] Updated weights for policy 0, policy_version 1743281 (0.0005) [2023-12-28 07:47:27,278][106226] Updated weights for policy 0, policy_version 1743291 (0.0010) [2023-12-28 07:47:27,336][106226] Updated weights for policy 0, policy_version 1743301 (0.0007) [2023-12-28 07:47:27,648][106225] Updated weights for policy 1, policy_version 1747626 (0.0009) [2023-12-28 07:47:27,708][106225] Updated weights for policy 1, policy_version 1747636 (0.0005) [2023-12-28 07:47:27,767][106225] Updated weights for policy 1, policy_version 1747646 (0.0005) [2023-12-28 07:47:27,820][106225] Updated weights for policy 1, policy_version 1747656 (0.0005) [2023-12-28 07:47:27,985][106226] Updated weights for policy 0, policy_version 1743311 (0.0009) [2023-12-28 07:47:28,041][106226] Updated weights for policy 0, policy_version 1743321 (0.0010) [2023-12-28 07:47:28,096][106226] Updated weights for policy 0, policy_version 1743331 (0.0010) [2023-12-28 07:47:28,429][106225] Updated weights for policy 1, policy_version 1747666 (0.0006) [2023-12-28 07:47:28,483][106225] Updated weights for policy 1, policy_version 1747676 (0.0005) [2023-12-28 07:47:28,534][106225] Updated weights for policy 1, policy_version 1747686 (0.0005) [2023-12-28 07:47:28,835][106226] Updated weights for policy 0, policy_version 1743341 (0.0010) [2023-12-28 07:47:28,894][106226] Updated weights for policy 0, policy_version 1743351 (0.0011) [2023-12-28 07:47:28,947][106226] Updated weights for policy 0, policy_version 1743361 (0.0010) [2023-12-28 07:47:29,152][106225] Updated weights for policy 1, policy_version 1747696 (0.0006) [2023-12-28 07:47:29,221][106225] Updated weights for policy 1, policy_version 1747706 (0.0006) [2023-12-28 07:47:29,285][106225] Updated weights for policy 1, policy_version 1747716 (0.0008) [2023-12-28 07:47:29,612][106226] Updated weights for policy 0, policy_version 1743371 (0.0011) [2023-12-28 07:47:29,676][106226] Updated weights for policy 0, policy_version 1743381 (0.0011) [2023-12-28 07:47:29,737][106226] Updated weights for policy 0, policy_version 1743391 (0.0011) [2023-12-28 07:47:29,940][106225] Updated weights for policy 1, policy_version 1747726 (0.0009) [2023-12-28 07:47:30,003][106225] Updated weights for policy 1, policy_version 1747736 (0.0007) [2023-12-28 07:47:30,055][106225] Updated weights for policy 1, policy_version 1747746 (0.0009) [2023-12-28 07:47:30,448][106226] Updated weights for policy 0, policy_version 1743401 (0.0010) [2023-12-28 07:47:30,510][106226] Updated weights for policy 0, policy_version 1743411 (0.0008) [2023-12-28 07:47:30,570][106226] Updated weights for policy 0, policy_version 1743421 (0.0009) [2023-12-28 07:47:30,622][106226] Updated weights for policy 0, policy_version 1743431 (0.0007) [2023-12-28 07:47:30,702][106225] Updated weights for policy 1, policy_version 1747756 (0.0009) [2023-12-28 07:47:30,760][106225] Updated weights for policy 1, policy_version 1747766 (0.0010) [2023-12-28 07:47:30,825][106225] Updated weights for policy 1, policy_version 1747776 (0.0010) [2023-12-28 07:47:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 893886464. Throughput: 0: 9814.5, 1: 10191.7. Samples: 893876680. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:31,175][105115] Avg episode reward: [(0, '-4.512'), (1, '-5.125')] [2023-12-28 07:47:31,334][106226] Updated weights for policy 0, policy_version 1743441 (0.0008) [2023-12-28 07:47:31,405][106226] Updated weights for policy 0, policy_version 1743451 (0.0009) [2023-12-28 07:47:31,463][106226] Updated weights for policy 0, policy_version 1743461 (0.0008) [2023-12-28 07:47:31,539][106225] Updated weights for policy 1, policy_version 1747786 (0.0010) [2023-12-28 07:47:31,599][106225] Updated weights for policy 1, policy_version 1747796 (0.0008) [2023-12-28 07:47:31,663][106225] Updated weights for policy 1, policy_version 1747806 (0.0009) [2023-12-28 07:47:31,738][106225] Updated weights for policy 1, policy_version 1747816 (0.0008) [2023-12-28 07:47:32,176][106226] Updated weights for policy 0, policy_version 1743471 (0.0009) [2023-12-28 07:47:32,230][106226] Updated weights for policy 0, policy_version 1743481 (0.0011) [2023-12-28 07:47:32,295][106226] Updated weights for policy 0, policy_version 1743491 (0.0011) [2023-12-28 07:47:32,473][106225] Updated weights for policy 1, policy_version 1747826 (0.0008) [2023-12-28 07:47:32,537][106225] Updated weights for policy 1, policy_version 1747836 (0.0008) [2023-12-28 07:47:32,598][106225] Updated weights for policy 1, policy_version 1747846 (0.0008) [2023-12-28 07:47:33,048][106226] Updated weights for policy 0, policy_version 1743501 (0.0010) [2023-12-28 07:47:33,112][106226] Updated weights for policy 0, policy_version 1743511 (0.0008) [2023-12-28 07:47:33,171][106226] Updated weights for policy 0, policy_version 1743521 (0.0009) [2023-12-28 07:47:33,298][106225] Updated weights for policy 1, policy_version 1747856 (0.0008) [2023-12-28 07:47:33,348][106225] Updated weights for policy 1, policy_version 1747866 (0.0009) [2023-12-28 07:47:33,399][106225] Updated weights for policy 1, policy_version 1747876 (0.0007) [2023-12-28 07:47:33,791][106226] Updated weights for policy 0, policy_version 1743531 (0.0009) [2023-12-28 07:47:33,847][106226] Updated weights for policy 0, policy_version 1743541 (0.0006) [2023-12-28 07:47:33,899][106226] Updated weights for policy 0, policy_version 1743551 (0.0007) [2023-12-28 07:47:33,953][106225] Updated weights for policy 1, policy_version 1747886 (0.0007) [2023-12-28 07:47:34,003][106225] Updated weights for policy 1, policy_version 1747896 (0.0005) [2023-12-28 07:47:34,059][106225] Updated weights for policy 1, policy_version 1747906 (0.0007) [2023-12-28 07:47:34,658][106226] Updated weights for policy 0, policy_version 1743561 (0.0008) [2023-12-28 07:47:34,705][106226] Updated weights for policy 0, policy_version 1743571 (0.0011) [2023-12-28 07:47:34,757][106225] Updated weights for policy 1, policy_version 1747916 (0.0006) [2023-12-28 07:47:34,759][106226] Updated weights for policy 0, policy_version 1743581 (0.0011) [2023-12-28 07:47:34,811][106225] Updated weights for policy 1, policy_version 1747926 (0.0006) [2023-12-28 07:47:34,813][106226] Updated weights for policy 0, policy_version 1743591 (0.0011) [2023-12-28 07:47:34,871][106225] Updated weights for policy 1, policy_version 1747936 (0.0007) [2023-12-28 07:47:35,423][106226] Updated weights for policy 0, policy_version 1743601 (0.0010) [2023-12-28 07:47:35,483][106226] Updated weights for policy 0, policy_version 1743611 (0.0011) [2023-12-28 07:47:35,531][106225] Updated weights for policy 1, policy_version 1747946 (0.0007) [2023-12-28 07:47:35,539][106226] Updated weights for policy 0, policy_version 1743621 (0.0011) [2023-12-28 07:47:35,606][106225] Updated weights for policy 1, policy_version 1747956 (0.0010) [2023-12-28 07:47:35,655][106225] Updated weights for policy 1, policy_version 1747966 (0.0007) [2023-12-28 07:47:35,708][106225] Updated weights for policy 1, policy_version 1747976 (0.0006) [2023-12-28 07:47:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 893984768. Throughput: 0: 9818.0, 1: 10219.0. Samples: 893997388. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:36,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-4.939')] [2023-12-28 07:47:36,294][106226] Updated weights for policy 0, policy_version 1743631 (0.0007) [2023-12-28 07:47:36,362][106226] Updated weights for policy 0, policy_version 1743641 (0.0006) [2023-12-28 07:47:36,410][106225] Updated weights for policy 1, policy_version 1747986 (0.0011) [2023-12-28 07:47:36,424][106226] Updated weights for policy 0, policy_version 1743651 (0.0006) [2023-12-28 07:47:36,470][106225] Updated weights for policy 1, policy_version 1747996 (0.0011) [2023-12-28 07:47:36,531][106225] Updated weights for policy 1, policy_version 1748006 (0.0007) [2023-12-28 07:47:36,994][106226] Updated weights for policy 0, policy_version 1743661 (0.0008) [2023-12-28 07:47:37,045][106226] Updated weights for policy 0, policy_version 1743671 (0.0009) [2023-12-28 07:47:37,104][106226] Updated weights for policy 0, policy_version 1743681 (0.0011) [2023-12-28 07:47:37,229][106225] Updated weights for policy 1, policy_version 1748016 (0.0008) [2023-12-28 07:47:37,276][106225] Updated weights for policy 1, policy_version 1748026 (0.0008) [2023-12-28 07:47:37,331][106225] Updated weights for policy 1, policy_version 1748036 (0.0008) [2023-12-28 07:47:37,831][106226] Updated weights for policy 0, policy_version 1743691 (0.0011) [2023-12-28 07:47:37,882][106226] Updated weights for policy 0, policy_version 1743701 (0.0010) [2023-12-28 07:47:37,947][106226] Updated weights for policy 0, policy_version 1743711 (0.0011) [2023-12-28 07:47:38,085][106225] Updated weights for policy 1, policy_version 1748046 (0.0008) [2023-12-28 07:47:38,142][106225] Updated weights for policy 1, policy_version 1748056 (0.0008) [2023-12-28 07:47:38,191][106225] Updated weights for policy 1, policy_version 1748066 (0.0007) [2023-12-28 07:47:38,670][106226] Updated weights for policy 0, policy_version 1743721 (0.0008) [2023-12-28 07:47:38,725][106226] Updated weights for policy 0, policy_version 1743731 (0.0011) [2023-12-28 07:47:38,783][106226] Updated weights for policy 0, policy_version 1743741 (0.0010) [2023-12-28 07:47:38,844][106226] Updated weights for policy 0, policy_version 1743751 (0.0011) [2023-12-28 07:47:38,947][106225] Updated weights for policy 1, policy_version 1748076 (0.0008) [2023-12-28 07:47:39,003][106225] Updated weights for policy 1, policy_version 1748086 (0.0007) [2023-12-28 07:47:39,056][106225] Updated weights for policy 1, policy_version 1748096 (0.0008) [2023-12-28 07:47:39,646][106226] Updated weights for policy 0, policy_version 1743761 (0.0011) [2023-12-28 07:47:39,697][106226] Updated weights for policy 0, policy_version 1743771 (0.0011) [2023-12-28 07:47:39,751][106226] Updated weights for policy 0, policy_version 1743781 (0.0011) [2023-12-28 07:47:39,844][106225] Updated weights for policy 1, policy_version 1748106 (0.0008) [2023-12-28 07:47:39,911][106225] Updated weights for policy 1, policy_version 1748116 (0.0008) [2023-12-28 07:47:39,975][106225] Updated weights for policy 1, policy_version 1748126 (0.0009) [2023-12-28 07:47:40,042][106225] Updated weights for policy 1, policy_version 1748136 (0.0008) [2023-12-28 07:47:40,514][106226] Updated weights for policy 0, policy_version 1743791 (0.0011) [2023-12-28 07:47:40,574][106226] Updated weights for policy 0, policy_version 1743801 (0.0011) [2023-12-28 07:47:40,634][106226] Updated weights for policy 0, policy_version 1743811 (0.0011) [2023-12-28 07:47:40,772][106225] Updated weights for policy 1, policy_version 1748146 (0.0009) [2023-12-28 07:47:40,836][106225] Updated weights for policy 1, policy_version 1748156 (0.0009) [2023-12-28 07:47:40,897][106225] Updated weights for policy 1, policy_version 1748166 (0.0005) [2023-12-28 07:47:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 894083072. Throughput: 0: 9777.5, 1: 10229.6. Samples: 894055884. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:41,176][105115] Avg episode reward: [(0, '-4.216'), (1, '-4.851')] [2023-12-28 07:47:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001748168_447586304.pth... [2023-12-28 07:47:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001743816_446496768.pth... [2023-12-28 07:47:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001746984_447283200.pth [2023-12-28 07:47:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001742696_446210048.pth [2023-12-28 07:47:41,380][106226] Updated weights for policy 0, policy_version 1743821 (0.0012) [2023-12-28 07:47:41,441][106226] Updated weights for policy 0, policy_version 1743831 (0.0010) [2023-12-28 07:47:41,500][106226] Updated weights for policy 0, policy_version 1743841 (0.0006) [2023-12-28 07:47:41,644][106225] Updated weights for policy 1, policy_version 1748176 (0.0009) [2023-12-28 07:47:41,723][106225] Updated weights for policy 1, policy_version 1748186 (0.0009) [2023-12-28 07:47:41,778][106225] Updated weights for policy 1, policy_version 1748196 (0.0009) [2023-12-28 07:47:42,194][106226] Updated weights for policy 0, policy_version 1743851 (0.0007) [2023-12-28 07:47:42,245][106226] Updated weights for policy 0, policy_version 1743861 (0.0010) [2023-12-28 07:47:42,315][106226] Updated weights for policy 0, policy_version 1743871 (0.0009) [2023-12-28 07:47:42,464][106225] Updated weights for policy 1, policy_version 1748206 (0.0009) [2023-12-28 07:47:42,523][106225] Updated weights for policy 1, policy_version 1748216 (0.0009) [2023-12-28 07:47:42,578][106225] Updated weights for policy 1, policy_version 1748226 (0.0009) [2023-12-28 07:47:42,976][106226] Updated weights for policy 0, policy_version 1743881 (0.0010) [2023-12-28 07:47:43,034][106226] Updated weights for policy 0, policy_version 1743891 (0.0005) [2023-12-28 07:47:43,087][106226] Updated weights for policy 0, policy_version 1743901 (0.0005) [2023-12-28 07:47:43,143][106226] Updated weights for policy 0, policy_version 1743911 (0.0005) [2023-12-28 07:47:43,331][106225] Updated weights for policy 1, policy_version 1748236 (0.0009) [2023-12-28 07:47:43,398][106225] Updated weights for policy 1, policy_version 1748246 (0.0009) [2023-12-28 07:47:43,453][106225] Updated weights for policy 1, policy_version 1748256 (0.0008) [2023-12-28 07:47:43,779][106226] Updated weights for policy 0, policy_version 1743921 (0.0005) [2023-12-28 07:47:43,829][106226] Updated weights for policy 0, policy_version 1743931 (0.0005) [2023-12-28 07:47:43,887][106226] Updated weights for policy 0, policy_version 1743941 (0.0005) [2023-12-28 07:47:44,125][106225] Updated weights for policy 1, policy_version 1748266 (0.0008) [2023-12-28 07:47:44,172][106225] Updated weights for policy 1, policy_version 1748276 (0.0006) [2023-12-28 07:47:44,230][106225] Updated weights for policy 1, policy_version 1748286 (0.0005) [2023-12-28 07:47:44,294][106225] Updated weights for policy 1, policy_version 1748296 (0.0007) [2023-12-28 07:47:44,536][106226] Updated weights for policy 0, policy_version 1743951 (0.0005) [2023-12-28 07:47:44,592][106226] Updated weights for policy 0, policy_version 1743961 (0.0008) [2023-12-28 07:47:44,657][106226] Updated weights for policy 0, policy_version 1743971 (0.0006) [2023-12-28 07:47:44,948][106225] Updated weights for policy 1, policy_version 1748306 (0.0010) [2023-12-28 07:47:44,997][106225] Updated weights for policy 1, policy_version 1748316 (0.0008) [2023-12-28 07:47:45,048][106225] Updated weights for policy 1, policy_version 1748326 (0.0009) [2023-12-28 07:47:45,301][106226] Updated weights for policy 0, policy_version 1743981 (0.0006) [2023-12-28 07:47:45,369][106226] Updated weights for policy 0, policy_version 1743991 (0.0005) [2023-12-28 07:47:45,428][106226] Updated weights for policy 0, policy_version 1744001 (0.0006) [2023-12-28 07:47:45,829][106225] Updated weights for policy 1, policy_version 1748336 (0.0008) [2023-12-28 07:47:45,879][106225] Updated weights for policy 1, policy_version 1748346 (0.0009) [2023-12-28 07:47:45,928][106225] Updated weights for policy 1, policy_version 1748356 (0.0009) [2023-12-28 07:47:45,945][106226] Updated weights for policy 0, policy_version 1744011 (0.0007) [2023-12-28 07:47:45,994][106226] Updated weights for policy 0, policy_version 1744021 (0.0005) [2023-12-28 07:47:46,047][106226] Updated weights for policy 0, policy_version 1744031 (0.0008) [2023-12-28 07:47:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 894189568. Throughput: 0: 9784.5, 1: 10130.1. Samples: 894173224. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:46,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.840')] [2023-12-28 07:47:46,641][106225] Updated weights for policy 1, policy_version 1748366 (0.0007) [2023-12-28 07:47:46,655][106226] Updated weights for policy 0, policy_version 1744041 (0.0006) [2023-12-28 07:47:46,707][106225] Updated weights for policy 1, policy_version 1748376 (0.0007) [2023-12-28 07:47:46,711][106226] Updated weights for policy 0, policy_version 1744051 (0.0010) [2023-12-28 07:47:46,764][106226] Updated weights for policy 0, policy_version 1744061 (0.0010) [2023-12-28 07:47:46,765][106225] Updated weights for policy 1, policy_version 1748386 (0.0010) [2023-12-28 07:47:46,821][106226] Updated weights for policy 0, policy_version 1744071 (0.0010) [2023-12-28 07:47:47,412][106225] Updated weights for policy 1, policy_version 1748396 (0.0010) [2023-12-28 07:47:47,470][106225] Updated weights for policy 1, policy_version 1748406 (0.0010) [2023-12-28 07:47:47,515][106226] Updated weights for policy 0, policy_version 1744081 (0.0009) [2023-12-28 07:47:47,535][106225] Updated weights for policy 1, policy_version 1748416 (0.0009) [2023-12-28 07:47:47,577][106226] Updated weights for policy 0, policy_version 1744091 (0.0010) [2023-12-28 07:47:47,644][106226] Updated weights for policy 0, policy_version 1744101 (0.0010) [2023-12-28 07:47:48,241][106225] Updated weights for policy 1, policy_version 1748426 (0.0009) [2023-12-28 07:47:48,284][106226] Updated weights for policy 0, policy_version 1744111 (0.0009) [2023-12-28 07:47:48,295][106225] Updated weights for policy 1, policy_version 1748436 (0.0005) [2023-12-28 07:47:48,348][106226] Updated weights for policy 0, policy_version 1744121 (0.0008) [2023-12-28 07:47:48,355][106225] Updated weights for policy 1, policy_version 1748446 (0.0007) [2023-12-28 07:47:48,403][106226] Updated weights for policy 0, policy_version 1744131 (0.0007) [2023-12-28 07:47:48,406][106225] Updated weights for policy 1, policy_version 1748456 (0.0010) [2023-12-28 07:47:49,047][106226] Updated weights for policy 0, policy_version 1744141 (0.0007) [2023-12-28 07:47:49,098][106225] Updated weights for policy 1, policy_version 1748466 (0.0007) [2023-12-28 07:47:49,112][106226] Updated weights for policy 0, policy_version 1744151 (0.0006) [2023-12-28 07:47:49,144][106225] Updated weights for policy 1, policy_version 1748476 (0.0007) [2023-12-28 07:47:49,176][106226] Updated weights for policy 0, policy_version 1744161 (0.0007) [2023-12-28 07:47:49,195][106225] Updated weights for policy 1, policy_version 1748486 (0.0007) [2023-12-28 07:47:49,883][106226] Updated weights for policy 0, policy_version 1744171 (0.0007) [2023-12-28 07:47:49,917][106225] Updated weights for policy 1, policy_version 1748496 (0.0008) [2023-12-28 07:47:49,945][106226] Updated weights for policy 0, policy_version 1744181 (0.0007) [2023-12-28 07:47:49,977][106225] Updated weights for policy 1, policy_version 1748506 (0.0008) [2023-12-28 07:47:50,008][106226] Updated weights for policy 0, policy_version 1744191 (0.0008) [2023-12-28 07:47:50,033][106225] Updated weights for policy 1, policy_version 1748516 (0.0007) [2023-12-28 07:47:50,700][106225] Updated weights for policy 1, policy_version 1748526 (0.0008) [2023-12-28 07:47:50,756][106225] Updated weights for policy 1, policy_version 1748536 (0.0008) [2023-12-28 07:47:50,783][106226] Updated weights for policy 0, policy_version 1744201 (0.0008) [2023-12-28 07:47:50,813][106225] Updated weights for policy 1, policy_version 1748546 (0.0007) [2023-12-28 07:47:50,848][106226] Updated weights for policy 0, policy_version 1744211 (0.0008) [2023-12-28 07:47:50,909][106226] Updated weights for policy 0, policy_version 1744221 (0.0008) [2023-12-28 07:47:50,973][106226] Updated weights for policy 0, policy_version 1744231 (0.0008) [2023-12-28 07:47:51,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 894287872. Throughput: 0: 9853.6, 1: 10055.6. Samples: 894294396. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:51,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-5.097')] [2023-12-28 07:47:51,665][106226] Updated weights for policy 0, policy_version 1744241 (0.0011) [2023-12-28 07:47:51,693][106225] Updated weights for policy 1, policy_version 1748556 (0.0006) [2023-12-28 07:47:51,734][106226] Updated weights for policy 0, policy_version 1744251 (0.0011) [2023-12-28 07:47:51,763][106225] Updated weights for policy 1, policy_version 1748566 (0.0007) [2023-12-28 07:47:51,797][106226] Updated weights for policy 0, policy_version 1744261 (0.0011) [2023-12-28 07:47:51,825][106225] Updated weights for policy 1, policy_version 1748576 (0.0006) [2023-12-28 07:47:52,459][106225] Updated weights for policy 1, policy_version 1748586 (0.0006) [2023-12-28 07:47:52,513][106226] Updated weights for policy 0, policy_version 1744271 (0.0011) [2023-12-28 07:47:52,524][106225] Updated weights for policy 1, policy_version 1748596 (0.0007) [2023-12-28 07:47:52,574][106226] Updated weights for policy 0, policy_version 1744281 (0.0011) [2023-12-28 07:47:52,589][106225] Updated weights for policy 1, policy_version 1748606 (0.0009) [2023-12-28 07:47:52,636][106226] Updated weights for policy 0, policy_version 1744291 (0.0011) [2023-12-28 07:47:52,650][106225] Updated weights for policy 1, policy_version 1748616 (0.0007) [2023-12-28 07:47:53,265][106226] Updated weights for policy 0, policy_version 1744301 (0.0009) [2023-12-28 07:47:53,328][106226] Updated weights for policy 0, policy_version 1744311 (0.0010) [2023-12-28 07:47:53,352][106225] Updated weights for policy 1, policy_version 1748626 (0.0007) [2023-12-28 07:47:53,383][106226] Updated weights for policy 0, policy_version 1744321 (0.0006) [2023-12-28 07:47:53,412][106225] Updated weights for policy 1, policy_version 1748636 (0.0009) [2023-12-28 07:47:53,469][106225] Updated weights for policy 1, policy_version 1748646 (0.0008) [2023-12-28 07:47:53,946][106226] Updated weights for policy 0, policy_version 1744331 (0.0005) [2023-12-28 07:47:54,006][106226] Updated weights for policy 0, policy_version 1744341 (0.0005) [2023-12-28 07:47:54,058][106226] Updated weights for policy 0, policy_version 1744351 (0.0005) [2023-12-28 07:47:54,272][106225] Updated weights for policy 1, policy_version 1748656 (0.0008) [2023-12-28 07:47:54,322][106225] Updated weights for policy 1, policy_version 1748666 (0.0007) [2023-12-28 07:47:54,370][106225] Updated weights for policy 1, policy_version 1748676 (0.0008) [2023-12-28 07:47:54,749][106226] Updated weights for policy 0, policy_version 1744361 (0.0007) [2023-12-28 07:47:54,799][106226] Updated weights for policy 0, policy_version 1744371 (0.0005) [2023-12-28 07:47:54,864][106226] Updated weights for policy 0, policy_version 1744381 (0.0005) [2023-12-28 07:47:54,935][106226] Updated weights for policy 0, policy_version 1744391 (0.0005) [2023-12-28 07:47:55,045][106225] Updated weights for policy 1, policy_version 1748686 (0.0007) [2023-12-28 07:47:55,091][106225] Updated weights for policy 1, policy_version 1748696 (0.0005) [2023-12-28 07:47:55,151][106225] Updated weights for policy 1, policy_version 1748706 (0.0009) [2023-12-28 07:47:55,530][106226] Updated weights for policy 0, policy_version 1744401 (0.0006) [2023-12-28 07:47:55,589][106226] Updated weights for policy 0, policy_version 1744411 (0.0008) [2023-12-28 07:47:55,640][106226] Updated weights for policy 0, policy_version 1744421 (0.0010) [2023-12-28 07:47:55,881][106225] Updated weights for policy 1, policy_version 1748716 (0.0007) [2023-12-28 07:47:55,927][106225] Updated weights for policy 1, policy_version 1748726 (0.0007) [2023-12-28 07:47:55,977][106225] Updated weights for policy 1, policy_version 1748736 (0.0005) [2023-12-28 07:47:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 894386176. Throughput: 0: 9905.6, 1: 10024.0. Samples: 894354160. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:47:56,176][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.549')] [2023-12-28 07:47:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001748744_447733760.pth... [2023-12-28 07:47:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001744424_446652416.pth... [2023-12-28 07:47:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001747560_447430656.pth [2023-12-28 07:47:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001743240_446349312.pth [2023-12-28 07:47:56,345][106226] Updated weights for policy 0, policy_version 1744431 (0.0011) [2023-12-28 07:47:56,403][106226] Updated weights for policy 0, policy_version 1744441 (0.0010) [2023-12-28 07:47:56,473][106226] Updated weights for policy 0, policy_version 1744451 (0.0009) [2023-12-28 07:47:56,525][106225] Updated weights for policy 1, policy_version 1748746 (0.0006) [2023-12-28 07:47:56,585][106225] Updated weights for policy 1, policy_version 1748756 (0.0009) [2023-12-28 07:47:56,644][106225] Updated weights for policy 1, policy_version 1748766 (0.0008) [2023-12-28 07:47:56,707][106225] Updated weights for policy 1, policy_version 1748776 (0.0008) [2023-12-28 07:47:57,113][106226] Updated weights for policy 0, policy_version 1744461 (0.0008) [2023-12-28 07:47:57,176][106226] Updated weights for policy 0, policy_version 1744471 (0.0005) [2023-12-28 07:47:57,243][106226] Updated weights for policy 0, policy_version 1744481 (0.0005) [2023-12-28 07:47:57,490][106225] Updated weights for policy 1, policy_version 1748786 (0.0008) [2023-12-28 07:47:57,545][106225] Updated weights for policy 1, policy_version 1748796 (0.0008) [2023-12-28 07:47:57,610][106225] Updated weights for policy 1, policy_version 1748806 (0.0006) [2023-12-28 07:47:57,788][106226] Updated weights for policy 0, policy_version 1744491 (0.0005) [2023-12-28 07:47:57,841][106226] Updated weights for policy 0, policy_version 1744501 (0.0005) [2023-12-28 07:47:57,896][106226] Updated weights for policy 0, policy_version 1744511 (0.0006) [2023-12-28 07:47:58,211][106225] Updated weights for policy 1, policy_version 1748816 (0.0006) [2023-12-28 07:47:58,268][106225] Updated weights for policy 1, policy_version 1748826 (0.0008) [2023-12-28 07:47:58,332][106225] Updated weights for policy 1, policy_version 1748836 (0.0016) [2023-12-28 07:47:58,499][106226] Updated weights for policy 0, policy_version 1744521 (0.0005) [2023-12-28 07:47:58,560][106226] Updated weights for policy 0, policy_version 1744531 (0.0007) [2023-12-28 07:47:58,627][106226] Updated weights for policy 0, policy_version 1744541 (0.0009) [2023-12-28 07:47:58,690][106226] Updated weights for policy 0, policy_version 1744551 (0.0008) [2023-12-28 07:47:59,127][106225] Updated weights for policy 1, policy_version 1748846 (0.0009) [2023-12-28 07:47:59,195][106225] Updated weights for policy 1, policy_version 1748856 (0.0008) [2023-12-28 07:47:59,271][106225] Updated weights for policy 1, policy_version 1748866 (0.0009) [2023-12-28 07:47:59,537][106226] Updated weights for policy 0, policy_version 1744561 (0.0006) [2023-12-28 07:47:59,597][106226] Updated weights for policy 0, policy_version 1744571 (0.0007) [2023-12-28 07:47:59,657][106226] Updated weights for policy 0, policy_version 1744581 (0.0008) [2023-12-28 07:48:00,089][106225] Updated weights for policy 1, policy_version 1748876 (0.0008) [2023-12-28 07:48:00,149][106225] Updated weights for policy 1, policy_version 1748886 (0.0008) [2023-12-28 07:48:00,206][106225] Updated weights for policy 1, policy_version 1748896 (0.0008) [2023-12-28 07:48:00,336][106226] Updated weights for policy 0, policy_version 1744591 (0.0009) [2023-12-28 07:48:00,392][106226] Updated weights for policy 0, policy_version 1744601 (0.0010) [2023-12-28 07:48:00,443][106226] Updated weights for policy 0, policy_version 1744611 (0.0008) [2023-12-28 07:48:00,819][106225] Updated weights for policy 1, policy_version 1748906 (0.0008) [2023-12-28 07:48:00,867][106225] Updated weights for policy 1, policy_version 1748916 (0.0005) [2023-12-28 07:48:00,915][106225] Updated weights for policy 1, policy_version 1748926 (0.0005) [2023-12-28 07:48:00,969][106225] Updated weights for policy 1, policy_version 1748936 (0.0006) [2023-12-28 07:48:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 894484480. Throughput: 0: 10022.4, 1: 9986.7. Samples: 894475016. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:48:01,175][105115] Avg episode reward: [(0, '-4.745'), (1, '-4.946')] [2023-12-28 07:48:01,244][106226] Updated weights for policy 0, policy_version 1744621 (0.0008) [2023-12-28 07:48:01,307][106226] Updated weights for policy 0, policy_version 1744631 (0.0008) [2023-12-28 07:48:01,381][106226] Updated weights for policy 0, policy_version 1744641 (0.0009) [2023-12-28 07:48:01,651][106225] Updated weights for policy 1, policy_version 1748946 (0.0007) [2023-12-28 07:48:01,704][106225] Updated weights for policy 1, policy_version 1748956 (0.0006) [2023-12-28 07:48:01,782][106225] Updated weights for policy 1, policy_version 1748966 (0.0008) [2023-12-28 07:48:02,131][106226] Updated weights for policy 0, policy_version 1744651 (0.0009) [2023-12-28 07:48:02,195][106226] Updated weights for policy 0, policy_version 1744661 (0.0009) [2023-12-28 07:48:02,264][106226] Updated weights for policy 0, policy_version 1744671 (0.0009) [2023-12-28 07:48:02,482][106225] Updated weights for policy 1, policy_version 1748976 (0.0010) [2023-12-28 07:48:02,545][106225] Updated weights for policy 1, policy_version 1748986 (0.0010) [2023-12-28 07:48:02,613][106225] Updated weights for policy 1, policy_version 1748996 (0.0009) [2023-12-28 07:48:02,868][106226] Updated weights for policy 0, policy_version 1744681 (0.0009) [2023-12-28 07:48:02,918][106226] Updated weights for policy 0, policy_version 1744691 (0.0007) [2023-12-28 07:48:02,968][106226] Updated weights for policy 0, policy_version 1744701 (0.0008) [2023-12-28 07:48:03,013][106226] Updated weights for policy 0, policy_version 1744711 (0.0007) [2023-12-28 07:48:03,364][106225] Updated weights for policy 1, policy_version 1749006 (0.0007) [2023-12-28 07:48:03,421][106225] Updated weights for policy 1, policy_version 1749016 (0.0010) [2023-12-28 07:48:03,471][106225] Updated weights for policy 1, policy_version 1749026 (0.0010) [2023-12-28 07:48:03,812][106226] Updated weights for policy 0, policy_version 1744721 (0.0009) [2023-12-28 07:48:03,885][106226] Updated weights for policy 0, policy_version 1744731 (0.0008) [2023-12-28 07:48:03,947][106226] Updated weights for policy 0, policy_version 1744741 (0.0008) [2023-12-28 07:48:04,120][106225] Updated weights for policy 1, policy_version 1749036 (0.0009) [2023-12-28 07:48:04,180][106225] Updated weights for policy 1, policy_version 1749046 (0.0009) [2023-12-28 07:48:04,247][106225] Updated weights for policy 1, policy_version 1749056 (0.0008) [2023-12-28 07:48:04,699][106226] Updated weights for policy 0, policy_version 1744751 (0.0008) [2023-12-28 07:48:04,762][106226] Updated weights for policy 0, policy_version 1744761 (0.0008) [2023-12-28 07:48:04,821][106226] Updated weights for policy 0, policy_version 1744771 (0.0009) [2023-12-28 07:48:04,917][106225] Updated weights for policy 1, policy_version 1749066 (0.0007) [2023-12-28 07:48:04,967][106225] Updated weights for policy 1, policy_version 1749076 (0.0005) [2023-12-28 07:48:05,016][106225] Updated weights for policy 1, policy_version 1749086 (0.0005) [2023-12-28 07:48:05,072][106225] Updated weights for policy 1, policy_version 1749096 (0.0006) [2023-12-28 07:48:05,585][106226] Updated weights for policy 0, policy_version 1744781 (0.0008) [2023-12-28 07:48:05,606][106225] Updated weights for policy 1, policy_version 1749106 (0.0007) [2023-12-28 07:48:05,640][106226] Updated weights for policy 0, policy_version 1744791 (0.0006) [2023-12-28 07:48:05,653][106225] Updated weights for policy 1, policy_version 1749116 (0.0009) [2023-12-28 07:48:05,700][106226] Updated weights for policy 0, policy_version 1744801 (0.0005) [2023-12-28 07:48:05,707][106225] Updated weights for policy 1, policy_version 1749126 (0.0010) [2023-12-28 07:48:06,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 894582784. Throughput: 0: 10036.7, 1: 9944.0. Samples: 894592680. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:48:06,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.605')] [2023-12-28 07:48:06,425][106225] Updated weights for policy 1, policy_version 1749136 (0.0010) [2023-12-28 07:48:06,465][106226] Updated weights for policy 0, policy_version 1744811 (0.0008) [2023-12-28 07:48:06,490][106225] Updated weights for policy 1, policy_version 1749146 (0.0010) [2023-12-28 07:48:06,517][106226] Updated weights for policy 0, policy_version 1744821 (0.0011) [2023-12-28 07:48:06,556][106225] Updated weights for policy 1, policy_version 1749156 (0.0009) [2023-12-28 07:48:06,573][106226] Updated weights for policy 0, policy_version 1744831 (0.0011) [2023-12-28 07:48:07,186][106226] Updated weights for policy 0, policy_version 1744841 (0.0010) [2023-12-28 07:48:07,241][106226] Updated weights for policy 0, policy_version 1744851 (0.0005) [2023-12-28 07:48:07,252][106225] Updated weights for policy 1, policy_version 1749166 (0.0010) [2023-12-28 07:48:07,300][106226] Updated weights for policy 0, policy_version 1744861 (0.0006) [2023-12-28 07:48:07,307][106225] Updated weights for policy 1, policy_version 1749176 (0.0010) [2023-12-28 07:48:07,358][106225] Updated weights for policy 1, policy_version 1749186 (0.0010) [2023-12-28 07:48:07,359][106226] Updated weights for policy 0, policy_version 1744871 (0.0009) [2023-12-28 07:48:08,004][106226] Updated weights for policy 0, policy_version 1744881 (0.0007) [2023-12-28 07:48:08,013][106225] Updated weights for policy 1, policy_version 1749196 (0.0010) [2023-12-28 07:48:08,059][106226] Updated weights for policy 0, policy_version 1744891 (0.0007) [2023-12-28 07:48:08,063][106225] Updated weights for policy 1, policy_version 1749206 (0.0010) [2023-12-28 07:48:08,112][106226] Updated weights for policy 0, policy_version 1744901 (0.0007) [2023-12-28 07:48:08,117][106225] Updated weights for policy 1, policy_version 1749216 (0.0010) [2023-12-28 07:48:08,774][106226] Updated weights for policy 0, policy_version 1744911 (0.0010) [2023-12-28 07:48:08,835][106226] Updated weights for policy 0, policy_version 1744921 (0.0011) [2023-12-28 07:48:08,856][106225] Updated weights for policy 1, policy_version 1749226 (0.0009) [2023-12-28 07:48:08,896][106226] Updated weights for policy 0, policy_version 1744931 (0.0011) [2023-12-28 07:48:08,921][106225] Updated weights for policy 1, policy_version 1749236 (0.0006) [2023-12-28 07:48:08,984][106225] Updated weights for policy 1, policy_version 1749246 (0.0007) [2023-12-28 07:48:09,034][106225] Updated weights for policy 1, policy_version 1749256 (0.0008) [2023-12-28 07:48:09,740][106226] Updated weights for policy 0, policy_version 1744941 (0.0010) [2023-12-28 07:48:09,753][106225] Updated weights for policy 1, policy_version 1749266 (0.0008) [2023-12-28 07:48:09,809][106226] Updated weights for policy 0, policy_version 1744951 (0.0009) [2023-12-28 07:48:09,809][106225] Updated weights for policy 1, policy_version 1749276 (0.0006) [2023-12-28 07:48:09,876][106226] Updated weights for policy 0, policy_version 1744961 (0.0008) [2023-12-28 07:48:09,878][106225] Updated weights for policy 1, policy_version 1749286 (0.0008) [2023-12-28 07:48:10,495][106226] Updated weights for policy 0, policy_version 1744971 (0.0006) [2023-12-28 07:48:10,566][106226] Updated weights for policy 0, policy_version 1744981 (0.0007) [2023-12-28 07:48:10,630][106226] Updated weights for policy 0, policy_version 1744991 (0.0007) [2023-12-28 07:48:10,637][106225] Updated weights for policy 1, policy_version 1749296 (0.0009) [2023-12-28 07:48:10,692][106225] Updated weights for policy 1, policy_version 1749306 (0.0008) [2023-12-28 07:48:10,756][106225] Updated weights for policy 1, policy_version 1749316 (0.0008) [2023-12-28 07:48:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 894681088. Throughput: 0: 10072.8, 1: 9974.1. Samples: 894653520. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:48:11,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-5.188')] [2023-12-28 07:48:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001749320_447881216.pth... [2023-12-28 07:48:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001745000_446799872.pth... [2023-12-28 07:48:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001748168_447586304.pth [2023-12-28 07:48:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001743816_446496768.pth [2023-12-28 07:48:11,206][106226] Updated weights for policy 0, policy_version 1745001 (0.0006) [2023-12-28 07:48:11,275][106226] Updated weights for policy 0, policy_version 1745011 (0.0007) [2023-12-28 07:48:11,340][106226] Updated weights for policy 0, policy_version 1745021 (0.0008) [2023-12-28 07:48:11,409][106226] Updated weights for policy 0, policy_version 1745031 (0.0008) [2023-12-28 07:48:11,487][106225] Updated weights for policy 1, policy_version 1749326 (0.0007) [2023-12-28 07:48:11,550][106225] Updated weights for policy 1, policy_version 1749336 (0.0009) [2023-12-28 07:48:11,614][106225] Updated weights for policy 1, policy_version 1749346 (0.0009) [2023-12-28 07:48:12,183][106226] Updated weights for policy 0, policy_version 1745041 (0.0006) [2023-12-28 07:48:12,241][106226] Updated weights for policy 0, policy_version 1745051 (0.0007) [2023-12-28 07:48:12,306][106226] Updated weights for policy 0, policy_version 1745061 (0.0008) [2023-12-28 07:48:12,372][106225] Updated weights for policy 1, policy_version 1749356 (0.0008) [2023-12-28 07:48:12,430][106225] Updated weights for policy 1, policy_version 1749366 (0.0007) [2023-12-28 07:48:12,490][106225] Updated weights for policy 1, policy_version 1749376 (0.0008) [2023-12-28 07:48:13,029][106226] Updated weights for policy 0, policy_version 1745071 (0.0008) [2023-12-28 07:48:13,094][106226] Updated weights for policy 0, policy_version 1745081 (0.0008) [2023-12-28 07:48:13,156][106226] Updated weights for policy 0, policy_version 1745091 (0.0007) [2023-12-28 07:48:13,205][106225] Updated weights for policy 1, policy_version 1749386 (0.0007) [2023-12-28 07:48:13,265][106225] Updated weights for policy 1, policy_version 1749396 (0.0005) [2023-12-28 07:48:13,325][106225] Updated weights for policy 1, policy_version 1749406 (0.0005) [2023-12-28 07:48:13,392][106225] Updated weights for policy 1, policy_version 1749416 (0.0007) [2023-12-28 07:48:13,897][106226] Updated weights for policy 0, policy_version 1745101 (0.0008) [2023-12-28 07:48:13,957][106226] Updated weights for policy 0, policy_version 1745111 (0.0008) [2023-12-28 07:48:14,006][106226] Updated weights for policy 0, policy_version 1745121 (0.0007) [2023-12-28 07:48:14,007][106225] Updated weights for policy 1, policy_version 1749426 (0.0007) [2023-12-28 07:48:14,065][106225] Updated weights for policy 1, policy_version 1749436 (0.0008) [2023-12-28 07:48:14,120][106225] Updated weights for policy 1, policy_version 1749446 (0.0008) [2023-12-28 07:48:14,710][106225] Updated weights for policy 1, policy_version 1749456 (0.0006) [2023-12-28 07:48:14,770][106225] Updated weights for policy 1, policy_version 1749466 (0.0007) [2023-12-28 07:48:14,831][106226] Updated weights for policy 0, policy_version 1745131 (0.0007) [2023-12-28 07:48:14,833][106225] Updated weights for policy 1, policy_version 1749476 (0.0008) [2023-12-28 07:48:14,892][106226] Updated weights for policy 0, policy_version 1745141 (0.0007) [2023-12-28 07:48:14,963][106226] Updated weights for policy 0, policy_version 1745151 (0.0009) [2023-12-28 07:48:15,502][106225] Updated weights for policy 1, policy_version 1749486 (0.0006) [2023-12-28 07:48:15,565][106225] Updated weights for policy 1, policy_version 1749496 (0.0005) [2023-12-28 07:48:15,619][106225] Updated weights for policy 1, policy_version 1749506 (0.0005) [2023-12-28 07:48:15,711][106226] Updated weights for policy 0, policy_version 1745161 (0.0009) [2023-12-28 07:48:15,761][106226] Updated weights for policy 0, policy_version 1745171 (0.0005) [2023-12-28 07:48:15,807][106226] Updated weights for policy 0, policy_version 1745181 (0.0005) [2023-12-28 07:48:15,860][106226] Updated weights for policy 0, policy_version 1745191 (0.0005) [2023-12-28 07:48:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 894779392. Throughput: 0: 9973.1, 1: 9884.1. Samples: 894770252. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:48:16,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.691')] [2023-12-28 07:48:16,264][106225] Updated weights for policy 1, policy_version 1749516 (0.0005) [2023-12-28 07:48:16,329][106225] Updated weights for policy 1, policy_version 1749526 (0.0005) [2023-12-28 07:48:16,386][106225] Updated weights for policy 1, policy_version 1749536 (0.0005) [2023-12-28 07:48:16,406][106226] Updated weights for policy 0, policy_version 1745201 (0.0007) [2023-12-28 07:48:16,460][106226] Updated weights for policy 0, policy_version 1745211 (0.0005) [2023-12-28 07:48:16,508][106226] Updated weights for policy 0, policy_version 1745221 (0.0005) [2023-12-28 07:48:16,987][106225] Updated weights for policy 1, policy_version 1749546 (0.0007) [2023-12-28 07:48:17,038][106225] Updated weights for policy 1, policy_version 1749556 (0.0005) [2023-12-28 07:48:17,092][106225] Updated weights for policy 1, policy_version 1749566 (0.0005) [2023-12-28 07:48:17,149][106225] Updated weights for policy 1, policy_version 1749576 (0.0008) [2023-12-28 07:48:17,232][106226] Updated weights for policy 0, policy_version 1745231 (0.0007) [2023-12-28 07:48:17,290][106226] Updated weights for policy 0, policy_version 1745241 (0.0008) [2023-12-28 07:48:17,345][106226] Updated weights for policy 0, policy_version 1745251 (0.0008) [2023-12-28 07:48:17,810][106225] Updated weights for policy 1, policy_version 1749586 (0.0009) [2023-12-28 07:48:17,863][106225] Updated weights for policy 1, policy_version 1749596 (0.0008) [2023-12-28 07:48:17,926][106225] Updated weights for policy 1, policy_version 1749606 (0.0005) [2023-12-28 07:48:18,077][106226] Updated weights for policy 0, policy_version 1745261 (0.0009) [2023-12-28 07:48:18,133][106226] Updated weights for policy 0, policy_version 1745271 (0.0008) [2023-12-28 07:48:18,190][106226] Updated weights for policy 0, policy_version 1745281 (0.0010) [2023-12-28 07:48:18,595][106225] Updated weights for policy 1, policy_version 1749616 (0.0007) [2023-12-28 07:48:18,663][106225] Updated weights for policy 1, policy_version 1749626 (0.0008) [2023-12-28 07:48:18,734][106225] Updated weights for policy 1, policy_version 1749636 (0.0008) [2023-12-28 07:48:18,959][106226] Updated weights for policy 0, policy_version 1745291 (0.0008) [2023-12-28 07:48:19,029][106226] Updated weights for policy 0, policy_version 1745301 (0.0011) [2023-12-28 07:48:19,080][106226] Updated weights for policy 0, policy_version 1745311 (0.0011) [2023-12-28 07:48:19,342][106225] Updated weights for policy 1, policy_version 1749646 (0.0007) [2023-12-28 07:48:19,409][106225] Updated weights for policy 1, policy_version 1749656 (0.0007) [2023-12-28 07:48:19,466][106225] Updated weights for policy 1, policy_version 1749666 (0.0006) [2023-12-28 07:48:19,765][106226] Updated weights for policy 0, policy_version 1745321 (0.0010) [2023-12-28 07:48:19,831][106226] Updated weights for policy 0, policy_version 1745331 (0.0011) [2023-12-28 07:48:19,888][106226] Updated weights for policy 0, policy_version 1745341 (0.0010) [2023-12-28 07:48:19,955][106226] Updated weights for policy 0, policy_version 1745351 (0.0011) [2023-12-28 07:48:20,160][106225] Updated weights for policy 1, policy_version 1749676 (0.0007) [2023-12-28 07:48:20,223][106225] Updated weights for policy 1, policy_version 1749686 (0.0008) [2023-12-28 07:48:20,287][106225] Updated weights for policy 1, policy_version 1749696 (0.0007) [2023-12-28 07:48:20,683][106226] Updated weights for policy 0, policy_version 1745361 (0.0008) [2023-12-28 07:48:20,740][106226] Updated weights for policy 0, policy_version 1745371 (0.0010) [2023-12-28 07:48:20,800][106226] Updated weights for policy 0, policy_version 1745381 (0.0008) [2023-12-28 07:48:20,891][106225] Updated weights for policy 1, policy_version 1749706 (0.0006) [2023-12-28 07:48:20,953][106225] Updated weights for policy 1, policy_version 1749716 (0.0005) [2023-12-28 07:48:21,015][106225] Updated weights for policy 1, policy_version 1749726 (0.0006) [2023-12-28 07:48:21,082][106225] Updated weights for policy 1, policy_version 1749736 (0.0009) [2023-12-28 07:48:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 894885888. Throughput: 0: 9943.8, 1: 9921.1. Samples: 894891308. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-28 07:48:21,175][105115] Avg episode reward: [(0, '-4.355'), (1, '-4.878')] [2023-12-28 07:48:21,579][106226] Updated weights for policy 0, policy_version 1745391 (0.0008) [2023-12-28 07:48:21,652][106226] Updated weights for policy 0, policy_version 1745401 (0.0009) [2023-12-28 07:48:21,711][106226] Updated weights for policy 0, policy_version 1745411 (0.0008) [2023-12-28 07:48:21,811][106225] Updated weights for policy 1, policy_version 1749746 (0.0009) [2023-12-28 07:48:21,875][106225] Updated weights for policy 1, policy_version 1749756 (0.0009) [2023-12-28 07:48:21,933][106225] Updated weights for policy 1, policy_version 1749766 (0.0010) [2023-12-28 07:48:22,420][106226] Updated weights for policy 0, policy_version 1745421 (0.0008) [2023-12-28 07:48:22,487][106226] Updated weights for policy 0, policy_version 1745431 (0.0009) [2023-12-28 07:48:22,548][106226] Updated weights for policy 0, policy_version 1745441 (0.0009) [2023-12-28 07:48:22,734][106225] Updated weights for policy 1, policy_version 1749776 (0.0009) [2023-12-28 07:48:22,796][106225] Updated weights for policy 1, policy_version 1749786 (0.0007) [2023-12-28 07:48:22,855][106225] Updated weights for policy 1, policy_version 1749796 (0.0006) [2023-12-28 07:48:23,263][106226] Updated weights for policy 0, policy_version 1745451 (0.0008) [2023-12-28 07:48:23,315][106226] Updated weights for policy 0, policy_version 1745461 (0.0005) [2023-12-28 07:48:23,366][106226] Updated weights for policy 0, policy_version 1745471 (0.0005) [2023-12-28 07:48:23,538][106225] Updated weights for policy 1, policy_version 1749806 (0.0008) [2023-12-28 07:48:23,585][106225] Updated weights for policy 1, policy_version 1749816 (0.0007) [2023-12-28 07:48:23,643][106225] Updated weights for policy 1, policy_version 1749826 (0.0008) [2023-12-28 07:48:23,977][106226] Updated weights for policy 0, policy_version 1745481 (0.0010) [2023-12-28 07:48:24,040][106226] Updated weights for policy 0, policy_version 1745491 (0.0006) [2023-12-28 07:48:24,094][106226] Updated weights for policy 0, policy_version 1745501 (0.0005) [2023-12-28 07:48:24,158][106226] Updated weights for policy 0, policy_version 1745511 (0.0005) [2023-12-28 07:48:24,457][106225] Updated weights for policy 1, policy_version 1749836 (0.0009) [2023-12-28 07:48:24,506][106225] Updated weights for policy 1, policy_version 1749846 (0.0008) [2023-12-28 07:48:24,567][106225] Updated weights for policy 1, policy_version 1749857 (0.0009) [2023-12-28 07:48:24,718][106226] Updated weights for policy 0, policy_version 1745521 (0.0005) [2023-12-28 07:48:24,771][106226] Updated weights for policy 0, policy_version 1745531 (0.0005) [2023-12-28 07:48:24,833][106226] Updated weights for policy 0, policy_version 1745541 (0.0007) [2023-12-28 07:48:25,372][106225] Updated weights for policy 1, policy_version 1749867 (0.0009) [2023-12-28 07:48:25,404][106226] Updated weights for policy 0, policy_version 1745551 (0.0006) [2023-12-28 07:48:25,429][106225] Updated weights for policy 1, policy_version 1749877 (0.0008) [2023-12-28 07:48:25,461][106226] Updated weights for policy 0, policy_version 1745561 (0.0006) [2023-12-28 07:48:25,487][106225] Updated weights for policy 1, policy_version 1749887 (0.0006) [2023-12-28 07:48:25,526][106226] Updated weights for policy 0, policy_version 1745571 (0.0006) [2023-12-28 07:48:26,096][106226] Updated weights for policy 0, policy_version 1745581 (0.0006) [2023-12-28 07:48:26,147][106226] Updated weights for policy 0, policy_version 1745591 (0.0007) [2023-12-28 07:48:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 894976000. Throughput: 0: 9954.8, 1: 9913.7. Samples: 894949964. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:26,177][105115] Avg episode reward: [(0, '-4.334'), (1, '-5.059')] [2023-12-28 07:48:26,180][106225] Updated weights for policy 1, policy_version 1749897 (0.0007) [2023-12-28 07:48:26,201][106226] Updated weights for policy 0, policy_version 1745601 (0.0008) [2023-12-28 07:48:26,230][106225] Updated weights for policy 1, policy_version 1749907 (0.0005) [2023-12-28 07:48:26,239][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001745608_446955520.pth... [2023-12-28 07:48:26,242][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001744424_446652416.pth [2023-12-28 07:48:26,277][106225] Updated weights for policy 1, policy_version 1749917 (0.0007) [2023-12-28 07:48:26,323][106225] Updated weights for policy 1, policy_version 1749927 (0.0008) [2023-12-28 07:48:26,325][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001749928_448036864.pth... [2023-12-28 07:48:26,328][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001748744_447733760.pth [2023-12-28 07:48:26,936][106226] Updated weights for policy 0, policy_version 1745611 (0.0009) [2023-12-28 07:48:26,999][106226] Updated weights for policy 0, policy_version 1745621 (0.0009) [2023-12-28 07:48:27,000][106225] Updated weights for policy 1, policy_version 1749937 (0.0006) [2023-12-28 07:48:27,057][106226] Updated weights for policy 0, policy_version 1745631 (0.0009) [2023-12-28 07:48:27,061][106225] Updated weights for policy 1, policy_version 1749947 (0.0005) [2023-12-28 07:48:27,113][106225] Updated weights for policy 1, policy_version 1749957 (0.0005) [2023-12-28 07:48:27,662][106226] Updated weights for policy 0, policy_version 1745641 (0.0008) [2023-12-28 07:48:27,712][106226] Updated weights for policy 0, policy_version 1745651 (0.0009) [2023-12-28 07:48:27,775][106225] Updated weights for policy 1, policy_version 1749967 (0.0006) [2023-12-28 07:48:27,776][106226] Updated weights for policy 0, policy_version 1745661 (0.0006) [2023-12-28 07:48:27,834][106226] Updated weights for policy 0, policy_version 1745671 (0.0008) [2023-12-28 07:48:27,837][106225] Updated weights for policy 1, policy_version 1749977 (0.0011) [2023-12-28 07:48:27,895][106225] Updated weights for policy 1, policy_version 1749987 (0.0011) [2023-12-28 07:48:28,478][106226] Updated weights for policy 0, policy_version 1745681 (0.0007) [2023-12-28 07:48:28,546][106226] Updated weights for policy 0, policy_version 1745691 (0.0010) [2023-12-28 07:48:28,553][106225] Updated weights for policy 1, policy_version 1749997 (0.0010) [2023-12-28 07:48:28,596][106226] Updated weights for policy 0, policy_version 1745701 (0.0011) [2023-12-28 07:48:28,608][106225] Updated weights for policy 1, policy_version 1750007 (0.0010) [2023-12-28 07:48:28,660][106225] Updated weights for policy 1, policy_version 1750017 (0.0010) [2023-12-28 07:48:29,256][106226] Updated weights for policy 0, policy_version 1745711 (0.0010) [2023-12-28 07:48:29,316][106226] Updated weights for policy 0, policy_version 1745721 (0.0006) [2023-12-28 07:48:29,370][106225] Updated weights for policy 1, policy_version 1750027 (0.0010) [2023-12-28 07:48:29,389][106226] Updated weights for policy 0, policy_version 1745731 (0.0008) [2023-12-28 07:48:29,431][106225] Updated weights for policy 1, policy_version 1750037 (0.0010) [2023-12-28 07:48:29,485][106225] Updated weights for policy 1, policy_version 1750047 (0.0010) [2023-12-28 07:48:30,122][106226] Updated weights for policy 0, policy_version 1745741 (0.0010) [2023-12-28 07:48:30,182][106226] Updated weights for policy 0, policy_version 1745751 (0.0010) [2023-12-28 07:48:30,189][106225] Updated weights for policy 1, policy_version 1750057 (0.0010) [2023-12-28 07:48:30,239][106226] Updated weights for policy 0, policy_version 1745761 (0.0008) [2023-12-28 07:48:30,252][106225] Updated weights for policy 1, policy_version 1750067 (0.0010) [2023-12-28 07:48:30,313][106225] Updated weights for policy 1, policy_version 1750077 (0.0007) [2023-12-28 07:48:30,382][106225] Updated weights for policy 1, policy_version 1750087 (0.0007) [2023-12-28 07:48:30,853][106226] Updated weights for policy 0, policy_version 1745771 (0.0006) [2023-12-28 07:48:30,922][106226] Updated weights for policy 0, policy_version 1745781 (0.0006) [2023-12-28 07:48:30,946][106225] Updated weights for policy 1, policy_version 1750097 (0.0006) [2023-12-28 07:48:30,982][106226] Updated weights for policy 0, policy_version 1745791 (0.0011) [2023-12-28 07:48:31,001][106225] Updated weights for policy 1, policy_version 1750107 (0.0010) [2023-12-28 07:48:31,069][106225] Updated weights for policy 1, policy_version 1750117 (0.0010) [2023-12-28 07:48:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 895090688. Throughput: 0: 10053.5, 1: 9948.5. Samples: 895073316. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:31,175][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.643')] [2023-12-28 07:48:31,708][106226] Updated weights for policy 0, policy_version 1745801 (0.0011) [2023-12-28 07:48:31,754][106225] Updated weights for policy 1, policy_version 1750127 (0.0007) [2023-12-28 07:48:31,779][106226] Updated weights for policy 0, policy_version 1745811 (0.0009) [2023-12-28 07:48:31,820][106225] Updated weights for policy 1, policy_version 1750137 (0.0006) [2023-12-28 07:48:31,849][106226] Updated weights for policy 0, policy_version 1745821 (0.0008) [2023-12-28 07:48:31,886][106225] Updated weights for policy 1, policy_version 1750147 (0.0008) [2023-12-28 07:48:31,914][106226] Updated weights for policy 0, policy_version 1745831 (0.0009) [2023-12-28 07:48:32,515][106226] Updated weights for policy 0, policy_version 1745841 (0.0007) [2023-12-28 07:48:32,575][106226] Updated weights for policy 0, policy_version 1745851 (0.0010) [2023-12-28 07:48:32,581][106225] Updated weights for policy 1, policy_version 1750157 (0.0007) [2023-12-28 07:48:32,632][106226] Updated weights for policy 0, policy_version 1745861 (0.0008) [2023-12-28 07:48:32,645][106225] Updated weights for policy 1, policy_version 1750167 (0.0008) [2023-12-28 07:48:32,707][106225] Updated weights for policy 1, policy_version 1750177 (0.0008) [2023-12-28 07:48:33,312][106225] Updated weights for policy 1, policy_version 1750187 (0.0008) [2023-12-28 07:48:33,312][106226] Updated weights for policy 0, policy_version 1745871 (0.0006) [2023-12-28 07:48:33,369][106226] Updated weights for policy 0, policy_version 1745881 (0.0008) [2023-12-28 07:48:33,373][106225] Updated weights for policy 1, policy_version 1750197 (0.0005) [2023-12-28 07:48:33,425][106226] Updated weights for policy 0, policy_version 1745891 (0.0008) [2023-12-28 07:48:33,431][106225] Updated weights for policy 1, policy_version 1750207 (0.0007) [2023-12-28 07:48:34,044][106226] Updated weights for policy 0, policy_version 1745901 (0.0007) [2023-12-28 07:48:34,093][106226] Updated weights for policy 0, policy_version 1745911 (0.0009) [2023-12-28 07:48:34,094][106225] Updated weights for policy 1, policy_version 1750217 (0.0009) [2023-12-28 07:48:34,142][106226] Updated weights for policy 0, policy_version 1745921 (0.0008) [2023-12-28 07:48:34,173][106225] Updated weights for policy 1, policy_version 1750227 (0.0006) [2023-12-28 07:48:34,240][106225] Updated weights for policy 1, policy_version 1750237 (0.0007) [2023-12-28 07:48:34,306][106225] Updated weights for policy 1, policy_version 1750247 (0.0007) [2023-12-28 07:48:34,955][106226] Updated weights for policy 0, policy_version 1745932 (0.0009) [2023-12-28 07:48:34,985][106225] Updated weights for policy 1, policy_version 1750257 (0.0009) [2023-12-28 07:48:35,021][106226] Updated weights for policy 0, policy_version 1745942 (0.0008) [2023-12-28 07:48:35,044][106225] Updated weights for policy 1, policy_version 1750267 (0.0007) [2023-12-28 07:48:35,083][106226] Updated weights for policy 0, policy_version 1745952 (0.0010) [2023-12-28 07:48:35,104][106225] Updated weights for policy 1, policy_version 1750277 (0.0008) [2023-12-28 07:48:35,746][106226] Updated weights for policy 0, policy_version 1745962 (0.0006) [2023-12-28 07:48:35,803][106226] Updated weights for policy 0, policy_version 1745972 (0.0008) [2023-12-28 07:48:35,839][106225] Updated weights for policy 1, policy_version 1750287 (0.0006) [2023-12-28 07:48:35,864][106226] Updated weights for policy 0, policy_version 1745982 (0.0007) [2023-12-28 07:48:35,888][106225] Updated weights for policy 1, policy_version 1750297 (0.0006) [2023-12-28 07:48:35,920][106226] Updated weights for policy 0, policy_version 1745992 (0.0008) [2023-12-28 07:48:35,933][106225] Updated weights for policy 1, policy_version 1750307 (0.0005) [2023-12-28 07:48:36,175][105115] Fps is (10 sec: 21299.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 895188992. Throughput: 0: 10024.2, 1: 9986.8. Samples: 895194888. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:36,175][105115] Avg episode reward: [(0, '-4.567'), (1, '-4.862')] [2023-12-28 07:48:36,672][106226] Updated weights for policy 0, policy_version 1746002 (0.0006) [2023-12-28 07:48:36,681][106225] Updated weights for policy 1, policy_version 1750317 (0.0006) [2023-12-28 07:48:36,737][106225] Updated weights for policy 1, policy_version 1750327 (0.0006) [2023-12-28 07:48:36,738][106226] Updated weights for policy 0, policy_version 1746012 (0.0008) [2023-12-28 07:48:36,791][106225] Updated weights for policy 1, policy_version 1750337 (0.0007) [2023-12-28 07:48:36,800][106226] Updated weights for policy 0, policy_version 1746022 (0.0007) [2023-12-28 07:48:37,499][106226] Updated weights for policy 0, policy_version 1746032 (0.0009) [2023-12-28 07:48:37,536][106225] Updated weights for policy 1, policy_version 1750347 (0.0006) [2023-12-28 07:48:37,549][106226] Updated weights for policy 0, policy_version 1746042 (0.0008) [2023-12-28 07:48:37,591][106225] Updated weights for policy 1, policy_version 1750357 (0.0006) [2023-12-28 07:48:37,607][106226] Updated weights for policy 0, policy_version 1746052 (0.0008) [2023-12-28 07:48:37,642][106225] Updated weights for policy 1, policy_version 1750367 (0.0006) [2023-12-28 07:48:38,306][106225] Updated weights for policy 1, policy_version 1750377 (0.0008) [2023-12-28 07:48:38,382][106225] Updated weights for policy 1, policy_version 1750387 (0.0008) [2023-12-28 07:48:38,411][106226] Updated weights for policy 0, policy_version 1746062 (0.0009) [2023-12-28 07:48:38,443][106225] Updated weights for policy 1, policy_version 1750397 (0.0008) [2023-12-28 07:48:38,474][106226] Updated weights for policy 0, policy_version 1746072 (0.0008) [2023-12-28 07:48:38,505][106225] Updated weights for policy 1, policy_version 1750407 (0.0008) [2023-12-28 07:48:38,539][106226] Updated weights for policy 0, policy_version 1746082 (0.0008) [2023-12-28 07:48:39,086][106225] Updated weights for policy 1, policy_version 1750417 (0.0006) [2023-12-28 07:48:39,140][106225] Updated weights for policy 1, policy_version 1750427 (0.0008) [2023-12-28 07:48:39,177][106226] Updated weights for policy 0, policy_version 1746092 (0.0008) [2023-12-28 07:48:39,207][106225] Updated weights for policy 1, policy_version 1750437 (0.0006) [2023-12-28 07:48:39,237][106226] Updated weights for policy 0, policy_version 1746102 (0.0008) [2023-12-28 07:48:39,307][106226] Updated weights for policy 0, policy_version 1746112 (0.0008) [2023-12-28 07:48:39,986][106225] Updated weights for policy 1, policy_version 1750447 (0.0007) [2023-12-28 07:48:40,052][106225] Updated weights for policy 1, policy_version 1750457 (0.0006) [2023-12-28 07:48:40,078][106226] Updated weights for policy 0, policy_version 1746122 (0.0008) [2023-12-28 07:48:40,113][106225] Updated weights for policy 1, policy_version 1750467 (0.0007) [2023-12-28 07:48:40,134][106226] Updated weights for policy 0, policy_version 1746132 (0.0008) [2023-12-28 07:48:40,183][106226] Updated weights for policy 0, policy_version 1746142 (0.0008) [2023-12-28 07:48:40,235][106226] Updated weights for policy 0, policy_version 1746152 (0.0008) [2023-12-28 07:48:40,825][106225] Updated weights for policy 1, policy_version 1750477 (0.0008) [2023-12-28 07:48:40,884][106225] Updated weights for policy 1, policy_version 1750487 (0.0009) [2023-12-28 07:48:40,942][106225] Updated weights for policy 1, policy_version 1750497 (0.0009) [2023-12-28 07:48:41,003][106226] Updated weights for policy 0, policy_version 1746162 (0.0008) [2023-12-28 07:48:41,067][106226] Updated weights for policy 0, policy_version 1746172 (0.0009) [2023-12-28 07:48:41,129][106226] Updated weights for policy 0, policy_version 1746182 (0.0011) [2023-12-28 07:48:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 895287296. Throughput: 0: 9963.9, 1: 10020.7. Samples: 895253464. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:41,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.669')] [2023-12-28 07:48:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001750504_448184320.pth... [2023-12-28 07:48:41,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001746184_447102976.pth... [2023-12-28 07:48:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001749320_447881216.pth [2023-12-28 07:48:41,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001745000_446799872.pth [2023-12-28 07:48:41,681][106225] Updated weights for policy 1, policy_version 1750507 (0.0005) [2023-12-28 07:48:41,754][106225] Updated weights for policy 1, policy_version 1750517 (0.0007) [2023-12-28 07:48:41,818][106225] Updated weights for policy 1, policy_version 1750527 (0.0009) [2023-12-28 07:48:41,958][106226] Updated weights for policy 0, policy_version 1746192 (0.0009) [2023-12-28 07:48:42,019][106226] Updated weights for policy 0, policy_version 1746202 (0.0009) [2023-12-28 07:48:42,081][106226] Updated weights for policy 0, policy_version 1746212 (0.0009) [2023-12-28 07:48:42,634][106225] Updated weights for policy 1, policy_version 1750537 (0.0009) [2023-12-28 07:48:42,687][106225] Updated weights for policy 1, policy_version 1750547 (0.0008) [2023-12-28 07:48:42,736][106225] Updated weights for policy 1, policy_version 1750557 (0.0008) [2023-12-28 07:48:42,763][106226] Updated weights for policy 0, policy_version 1746222 (0.0007) [2023-12-28 07:48:42,785][106225] Updated weights for policy 1, policy_version 1750567 (0.0007) [2023-12-28 07:48:42,823][106226] Updated weights for policy 0, policy_version 1746232 (0.0007) [2023-12-28 07:48:42,886][106226] Updated weights for policy 0, policy_version 1746242 (0.0005) [2023-12-28 07:48:43,496][106225] Updated weights for policy 1, policy_version 1750577 (0.0007) [2023-12-28 07:48:43,503][106226] Updated weights for policy 0, policy_version 1746252 (0.0007) [2023-12-28 07:48:43,557][106225] Updated weights for policy 1, policy_version 1750587 (0.0005) [2023-12-28 07:48:43,565][106226] Updated weights for policy 0, policy_version 1746262 (0.0006) [2023-12-28 07:48:43,619][106225] Updated weights for policy 1, policy_version 1750597 (0.0005) [2023-12-28 07:48:43,625][106226] Updated weights for policy 0, policy_version 1746272 (0.0011) [2023-12-28 07:48:44,187][106226] Updated weights for policy 0, policy_version 1746282 (0.0010) [2023-12-28 07:48:44,227][106225] Updated weights for policy 1, policy_version 1750607 (0.0009) [2023-12-28 07:48:44,233][106226] Updated weights for policy 0, policy_version 1746292 (0.0007) [2023-12-28 07:48:44,282][106226] Updated weights for policy 0, policy_version 1746302 (0.0006) [2023-12-28 07:48:44,291][106225] Updated weights for policy 1, policy_version 1750617 (0.0008) [2023-12-28 07:48:44,327][106226] Updated weights for policy 0, policy_version 1746312 (0.0005) [2023-12-28 07:48:44,355][106225] Updated weights for policy 1, policy_version 1750627 (0.0009) [2023-12-28 07:48:44,969][106226] Updated weights for policy 0, policy_version 1746322 (0.0007) [2023-12-28 07:48:45,013][106225] Updated weights for policy 1, policy_version 1750637 (0.0010) [2023-12-28 07:48:45,035][106226] Updated weights for policy 0, policy_version 1746332 (0.0006) [2023-12-28 07:48:45,072][106225] Updated weights for policy 1, policy_version 1750647 (0.0010) [2023-12-28 07:48:45,096][106226] Updated weights for policy 0, policy_version 1746342 (0.0010) [2023-12-28 07:48:45,134][106225] Updated weights for policy 1, policy_version 1750657 (0.0010) [2023-12-28 07:48:45,794][106225] Updated weights for policy 1, policy_version 1750667 (0.0006) [2023-12-28 07:48:45,839][106226] Updated weights for policy 0, policy_version 1746352 (0.0008) [2023-12-28 07:48:45,857][106225] Updated weights for policy 1, policy_version 1750677 (0.0009) [2023-12-28 07:48:45,895][106226] Updated weights for policy 0, policy_version 1746362 (0.0005) [2023-12-28 07:48:45,910][106225] Updated weights for policy 1, policy_version 1750687 (0.0008) [2023-12-28 07:48:45,942][106226] Updated weights for policy 0, policy_version 1746372 (0.0006) [2023-12-28 07:48:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 895385600. Throughput: 0: 9925.0, 1: 10016.3. Samples: 895372376. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:46,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.941')] [2023-12-28 07:48:46,603][106225] Updated weights for policy 1, policy_version 1750697 (0.0006) [2023-12-28 07:48:46,663][106225] Updated weights for policy 1, policy_version 1750707 (0.0007) [2023-12-28 07:48:46,669][106226] Updated weights for policy 0, policy_version 1746382 (0.0009) [2023-12-28 07:48:46,712][106225] Updated weights for policy 1, policy_version 1750717 (0.0007) [2023-12-28 07:48:46,734][106226] Updated weights for policy 0, policy_version 1746392 (0.0007) [2023-12-28 07:48:46,766][106225] Updated weights for policy 1, policy_version 1750727 (0.0006) [2023-12-28 07:48:46,797][106226] Updated weights for policy 0, policy_version 1746402 (0.0009) [2023-12-28 07:48:47,335][106225] Updated weights for policy 1, policy_version 1750737 (0.0008) [2023-12-28 07:48:47,389][106225] Updated weights for policy 1, policy_version 1750747 (0.0005) [2023-12-28 07:48:47,451][106225] Updated weights for policy 1, policy_version 1750757 (0.0008) [2023-12-28 07:48:47,587][106226] Updated weights for policy 0, policy_version 1746412 (0.0009) [2023-12-28 07:48:47,642][106226] Updated weights for policy 0, policy_version 1746422 (0.0008) [2023-12-28 07:48:47,703][106226] Updated weights for policy 0, policy_version 1746432 (0.0007) [2023-12-28 07:48:48,131][106225] Updated weights for policy 1, policy_version 1750767 (0.0008) [2023-12-28 07:48:48,187][106225] Updated weights for policy 1, policy_version 1750777 (0.0009) [2023-12-28 07:48:48,232][106225] Updated weights for policy 1, policy_version 1750787 (0.0008) [2023-12-28 07:48:48,460][106226] Updated weights for policy 0, policy_version 1746442 (0.0007) [2023-12-28 07:48:48,529][106226] Updated weights for policy 0, policy_version 1746452 (0.0008) [2023-12-28 07:48:48,595][106226] Updated weights for policy 0, policy_version 1746462 (0.0007) [2023-12-28 07:48:48,661][106226] Updated weights for policy 0, policy_version 1746472 (0.0008) [2023-12-28 07:48:48,918][106225] Updated weights for policy 1, policy_version 1750797 (0.0009) [2023-12-28 07:48:48,981][106225] Updated weights for policy 1, policy_version 1750807 (0.0006) [2023-12-28 07:48:49,038][106225] Updated weights for policy 1, policy_version 1750817 (0.0005) [2023-12-28 07:48:49,425][106226] Updated weights for policy 0, policy_version 1746482 (0.0008) [2023-12-28 07:48:49,484][106226] Updated weights for policy 0, policy_version 1746492 (0.0008) [2023-12-28 07:48:49,542][106226] Updated weights for policy 0, policy_version 1746502 (0.0008) [2023-12-28 07:48:49,681][106225] Updated weights for policy 1, policy_version 1750827 (0.0006) [2023-12-28 07:48:49,747][106225] Updated weights for policy 1, policy_version 1750837 (0.0006) [2023-12-28 07:48:49,802][106225] Updated weights for policy 1, policy_version 1750847 (0.0009) [2023-12-28 07:48:50,350][106226] Updated weights for policy 0, policy_version 1746512 (0.0008) [2023-12-28 07:48:50,412][106226] Updated weights for policy 0, policy_version 1746522 (0.0009) [2023-12-28 07:48:50,471][106226] Updated weights for policy 0, policy_version 1746532 (0.0008) [2023-12-28 07:48:50,472][106225] Updated weights for policy 1, policy_version 1750857 (0.0009) [2023-12-28 07:48:50,534][106225] Updated weights for policy 1, policy_version 1750867 (0.0006) [2023-12-28 07:48:50,607][106225] Updated weights for policy 1, policy_version 1750877 (0.0007) [2023-12-28 07:48:50,661][106225] Updated weights for policy 1, policy_version 1750887 (0.0006) [2023-12-28 07:48:51,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 895475712. Throughput: 0: 9887.6, 1: 10021.3. Samples: 895488584. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:51,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-5.158')] [2023-12-28 07:48:51,254][106225] Updated weights for policy 1, policy_version 1750897 (0.0007) [2023-12-28 07:48:51,284][106226] Updated weights for policy 0, policy_version 1746542 (0.0009) [2023-12-28 07:48:51,318][106225] Updated weights for policy 1, policy_version 1750907 (0.0008) [2023-12-28 07:48:51,349][106226] Updated weights for policy 0, policy_version 1746552 (0.0007) [2023-12-28 07:48:51,388][106225] Updated weights for policy 1, policy_version 1750917 (0.0007) [2023-12-28 07:48:51,414][106226] Updated weights for policy 0, policy_version 1746562 (0.0009) [2023-12-28 07:48:52,107][106225] Updated weights for policy 1, policy_version 1750927 (0.0007) [2023-12-28 07:48:52,164][106225] Updated weights for policy 1, policy_version 1750937 (0.0008) [2023-12-28 07:48:52,195][106226] Updated weights for policy 0, policy_version 1746572 (0.0008) [2023-12-28 07:48:52,214][106225] Updated weights for policy 1, policy_version 1750947 (0.0006) [2023-12-28 07:48:52,261][106226] Updated weights for policy 0, policy_version 1746582 (0.0007) [2023-12-28 07:48:52,328][106226] Updated weights for policy 0, policy_version 1746592 (0.0008) [2023-12-28 07:48:52,962][106225] Updated weights for policy 1, policy_version 1750957 (0.0009) [2023-12-28 07:48:53,016][106225] Updated weights for policy 1, policy_version 1750967 (0.0007) [2023-12-28 07:48:53,046][106226] Updated weights for policy 0, policy_version 1746602 (0.0008) [2023-12-28 07:48:53,071][106225] Updated weights for policy 1, policy_version 1750977 (0.0007) [2023-12-28 07:48:53,094][106226] Updated weights for policy 0, policy_version 1746612 (0.0005) [2023-12-28 07:48:53,147][106226] Updated weights for policy 0, policy_version 1746622 (0.0009) [2023-12-28 07:48:53,202][106226] Updated weights for policy 0, policy_version 1746632 (0.0009) [2023-12-28 07:48:53,647][106225] Updated weights for policy 1, policy_version 1750987 (0.0005) [2023-12-28 07:48:53,697][106225] Updated weights for policy 1, policy_version 1750997 (0.0007) [2023-12-28 07:48:53,750][106225] Updated weights for policy 1, policy_version 1751007 (0.0008) [2023-12-28 07:48:53,911][106226] Updated weights for policy 0, policy_version 1746642 (0.0009) [2023-12-28 07:48:53,964][106226] Updated weights for policy 0, policy_version 1746652 (0.0010) [2023-12-28 07:48:54,024][106226] Updated weights for policy 0, policy_version 1746662 (0.0010) [2023-12-28 07:48:54,455][106225] Updated weights for policy 1, policy_version 1751017 (0.0007) [2023-12-28 07:48:54,506][106225] Updated weights for policy 1, policy_version 1751027 (0.0006) [2023-12-28 07:48:54,556][106225] Updated weights for policy 1, policy_version 1751037 (0.0007) [2023-12-28 07:48:54,606][106225] Updated weights for policy 1, policy_version 1751047 (0.0008) [2023-12-28 07:48:54,709][106226] Updated weights for policy 0, policy_version 1746672 (0.0011) [2023-12-28 07:48:54,766][106226] Updated weights for policy 0, policy_version 1746682 (0.0011) [2023-12-28 07:48:54,820][106226] Updated weights for policy 0, policy_version 1746692 (0.0008) [2023-12-28 07:48:55,330][106225] Updated weights for policy 1, policy_version 1751057 (0.0005) [2023-12-28 07:48:55,386][106225] Updated weights for policy 1, policy_version 1751067 (0.0005) [2023-12-28 07:48:55,441][106225] Updated weights for policy 1, policy_version 1751077 (0.0005) [2023-12-28 07:48:55,508][106226] Updated weights for policy 0, policy_version 1746702 (0.0010) [2023-12-28 07:48:55,554][106226] Updated weights for policy 0, policy_version 1746712 (0.0010) [2023-12-28 07:48:55,608][106226] Updated weights for policy 0, policy_version 1746722 (0.0010) [2023-12-28 07:48:56,009][106225] Updated weights for policy 1, policy_version 1751087 (0.0007) [2023-12-28 07:48:56,074][106225] Updated weights for policy 1, policy_version 1751097 (0.0007) [2023-12-28 07:48:56,134][106225] Updated weights for policy 1, policy_version 1751107 (0.0009) [2023-12-28 07:48:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 895582208. Throughput: 0: 9822.8, 1: 10067.4. Samples: 895548580. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:48:56,175][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.921')] [2023-12-28 07:48:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001751112_448339968.pth... [2023-12-28 07:48:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001746728_447242240.pth... [2023-12-28 07:48:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001749928_448036864.pth [2023-12-28 07:48:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001745608_446955520.pth [2023-12-28 07:48:56,350][106226] Updated weights for policy 0, policy_version 1746732 (0.0008) [2023-12-28 07:48:56,418][106226] Updated weights for policy 0, policy_version 1746742 (0.0005) [2023-12-28 07:48:56,471][106226] Updated weights for policy 0, policy_version 1746752 (0.0008) [2023-12-28 07:48:56,716][106225] Updated weights for policy 1, policy_version 1751117 (0.0009) [2023-12-28 07:48:56,765][106225] Updated weights for policy 1, policy_version 1751127 (0.0008) [2023-12-28 07:48:56,815][106225] Updated weights for policy 1, policy_version 1751137 (0.0005) [2023-12-28 07:48:57,078][106226] Updated weights for policy 0, policy_version 1746762 (0.0006) [2023-12-28 07:48:57,141][106226] Updated weights for policy 0, policy_version 1746772 (0.0011) [2023-12-28 07:48:57,201][106226] Updated weights for policy 0, policy_version 1746782 (0.0011) [2023-12-28 07:48:57,262][106226] Updated weights for policy 0, policy_version 1746792 (0.0011) [2023-12-28 07:48:57,396][106225] Updated weights for policy 1, policy_version 1751147 (0.0005) [2023-12-28 07:48:57,441][106225] Updated weights for policy 1, policy_version 1751157 (0.0005) [2023-12-28 07:48:57,486][106225] Updated weights for policy 1, policy_version 1751167 (0.0005) [2023-12-28 07:48:57,835][106226] Updated weights for policy 0, policy_version 1746802 (0.0007) [2023-12-28 07:48:57,891][106226] Updated weights for policy 0, policy_version 1746812 (0.0005) [2023-12-28 07:48:57,955][106226] Updated weights for policy 0, policy_version 1746822 (0.0005) [2023-12-28 07:48:58,070][106225] Updated weights for policy 1, policy_version 1751177 (0.0006) [2023-12-28 07:48:58,118][106225] Updated weights for policy 1, policy_version 1751187 (0.0010) [2023-12-28 07:48:58,165][106225] Updated weights for policy 1, policy_version 1751197 (0.0010) [2023-12-28 07:48:58,217][106225] Updated weights for policy 1, policy_version 1751207 (0.0010) [2023-12-28 07:48:58,604][106226] Updated weights for policy 0, policy_version 1746832 (0.0007) [2023-12-28 07:48:58,670][106226] Updated weights for policy 0, policy_version 1746842 (0.0009) [2023-12-28 07:48:58,734][106226] Updated weights for policy 0, policy_version 1746852 (0.0009) [2023-12-28 07:48:59,082][106225] Updated weights for policy 1, policy_version 1751217 (0.0007) [2023-12-28 07:48:59,153][106225] Updated weights for policy 1, policy_version 1751227 (0.0008) [2023-12-28 07:48:59,223][106225] Updated weights for policy 1, policy_version 1751237 (0.0008) [2023-12-28 07:48:59,517][106226] Updated weights for policy 0, policy_version 1746862 (0.0008) [2023-12-28 07:48:59,581][106226] Updated weights for policy 0, policy_version 1746872 (0.0008) [2023-12-28 07:48:59,640][106226] Updated weights for policy 0, policy_version 1746882 (0.0007) [2023-12-28 07:48:59,973][106225] Updated weights for policy 1, policy_version 1751247 (0.0009) [2023-12-28 07:49:00,024][106225] Updated weights for policy 1, policy_version 1751257 (0.0008) [2023-12-28 07:49:00,079][106225] Updated weights for policy 1, policy_version 1751267 (0.0007) [2023-12-28 07:49:00,322][106226] Updated weights for policy 0, policy_version 1746892 (0.0007) [2023-12-28 07:49:00,385][106226] Updated weights for policy 0, policy_version 1746902 (0.0008) [2023-12-28 07:49:00,442][106226] Updated weights for policy 0, policy_version 1746912 (0.0006) [2023-12-28 07:49:00,838][106225] Updated weights for policy 1, policy_version 1751277 (0.0008) [2023-12-28 07:49:00,888][106225] Updated weights for policy 1, policy_version 1751287 (0.0008) [2023-12-28 07:49:00,945][106225] Updated weights for policy 1, policy_version 1751297 (0.0008) [2023-12-28 07:49:01,156][106226] Updated weights for policy 0, policy_version 1746922 (0.0008) [2023-12-28 07:49:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 895680512. Throughput: 0: 9886.1, 1: 10134.1. Samples: 895671164. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:01,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.863')] [2023-12-28 07:49:01,219][106226] Updated weights for policy 0, policy_version 1746932 (0.0008) [2023-12-28 07:49:01,281][106226] Updated weights for policy 0, policy_version 1746942 (0.0007) [2023-12-28 07:49:01,351][106226] Updated weights for policy 0, policy_version 1746952 (0.0010) [2023-12-28 07:49:01,652][106225] Updated weights for policy 1, policy_version 1751307 (0.0008) [2023-12-28 07:49:01,716][106225] Updated weights for policy 1, policy_version 1751317 (0.0009) [2023-12-28 07:49:01,778][106225] Updated weights for policy 1, policy_version 1751327 (0.0008) [2023-12-28 07:49:02,066][106226] Updated weights for policy 0, policy_version 1746962 (0.0005) [2023-12-28 07:49:02,127][106226] Updated weights for policy 0, policy_version 1746972 (0.0005) [2023-12-28 07:49:02,188][106226] Updated weights for policy 0, policy_version 1746982 (0.0006) [2023-12-28 07:49:02,575][106225] Updated weights for policy 1, policy_version 1751337 (0.0006) [2023-12-28 07:49:02,639][106225] Updated weights for policy 1, policy_version 1751347 (0.0008) [2023-12-28 07:49:02,703][106225] Updated weights for policy 1, policy_version 1751357 (0.0009) [2023-12-28 07:49:02,756][106225] Updated weights for policy 1, policy_version 1751367 (0.0009) [2023-12-28 07:49:02,782][106226] Updated weights for policy 0, policy_version 1746992 (0.0006) [2023-12-28 07:49:02,834][106226] Updated weights for policy 0, policy_version 1747002 (0.0009) [2023-12-28 07:49:02,885][106226] Updated weights for policy 0, policy_version 1747012 (0.0008) [2023-12-28 07:49:03,404][106225] Updated weights for policy 1, policy_version 1751377 (0.0008) [2023-12-28 07:49:03,458][106225] Updated weights for policy 1, policy_version 1751387 (0.0009) [2023-12-28 07:49:03,517][106225] Updated weights for policy 1, policy_version 1751397 (0.0008) [2023-12-28 07:49:03,652][106226] Updated weights for policy 0, policy_version 1747022 (0.0009) [2023-12-28 07:49:03,715][106226] Updated weights for policy 0, policy_version 1747032 (0.0010) [2023-12-28 07:49:03,773][106226] Updated weights for policy 0, policy_version 1747042 (0.0010) [2023-12-28 07:49:04,198][106225] Updated weights for policy 1, policy_version 1751407 (0.0007) [2023-12-28 07:49:04,261][106225] Updated weights for policy 1, policy_version 1751417 (0.0009) [2023-12-28 07:49:04,321][106225] Updated weights for policy 1, policy_version 1751427 (0.0009) [2023-12-28 07:49:04,552][106226] Updated weights for policy 0, policy_version 1747052 (0.0009) [2023-12-28 07:49:04,603][106226] Updated weights for policy 0, policy_version 1747062 (0.0006) [2023-12-28 07:49:04,657][106226] Updated weights for policy 0, policy_version 1747072 (0.0009) [2023-12-28 07:49:05,051][106225] Updated weights for policy 1, policy_version 1751437 (0.0008) [2023-12-28 07:49:05,115][106225] Updated weights for policy 1, policy_version 1751447 (0.0009) [2023-12-28 07:49:05,183][106225] Updated weights for policy 1, policy_version 1751457 (0.0010) [2023-12-28 07:49:05,380][106226] Updated weights for policy 0, policy_version 1747082 (0.0009) [2023-12-28 07:49:05,448][106226] Updated weights for policy 0, policy_version 1747092 (0.0008) [2023-12-28 07:49:05,512][106226] Updated weights for policy 0, policy_version 1747102 (0.0011) [2023-12-28 07:49:05,565][106226] Updated weights for policy 0, policy_version 1747112 (0.0010) [2023-12-28 07:49:05,864][106225] Updated weights for policy 1, policy_version 1751467 (0.0005) [2023-12-28 07:49:05,918][106225] Updated weights for policy 1, policy_version 1751477 (0.0005) [2023-12-28 07:49:05,970][106225] Updated weights for policy 1, policy_version 1751487 (0.0006) [2023-12-28 07:49:06,148][106226] Updated weights for policy 0, policy_version 1747122 (0.0010) [2023-12-28 07:49:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 895778816. Throughput: 0: 9915.2, 1: 10031.9. Samples: 895788928. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:06,175][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.596')] [2023-12-28 07:49:06,208][106226] Updated weights for policy 0, policy_version 1747132 (0.0011) [2023-12-28 07:49:06,258][106226] Updated weights for policy 0, policy_version 1747142 (0.0009) [2023-12-28 07:49:06,664][106225] Updated weights for policy 1, policy_version 1751497 (0.0007) [2023-12-28 07:49:06,723][106225] Updated weights for policy 1, policy_version 1751507 (0.0008) [2023-12-28 07:49:06,792][106225] Updated weights for policy 1, policy_version 1751517 (0.0008) [2023-12-28 07:49:06,842][106225] Updated weights for policy 1, policy_version 1751527 (0.0006) [2023-12-28 07:49:06,886][106226] Updated weights for policy 0, policy_version 1747152 (0.0007) [2023-12-28 07:49:06,949][106226] Updated weights for policy 0, policy_version 1747162 (0.0007) [2023-12-28 07:49:07,016][106226] Updated weights for policy 0, policy_version 1747172 (0.0007) [2023-12-28 07:49:07,440][106225] Updated weights for policy 1, policy_version 1751537 (0.0007) [2023-12-28 07:49:07,493][106225] Updated weights for policy 1, policy_version 1751547 (0.0005) [2023-12-28 07:49:07,556][106225] Updated weights for policy 1, policy_version 1751557 (0.0006) [2023-12-28 07:49:07,585][106226] Updated weights for policy 0, policy_version 1747182 (0.0009) [2023-12-28 07:49:07,652][106226] Updated weights for policy 0, policy_version 1747192 (0.0011) [2023-12-28 07:49:07,723][106226] Updated weights for policy 0, policy_version 1747202 (0.0011) [2023-12-28 07:49:08,205][106225] Updated weights for policy 1, policy_version 1751567 (0.0007) [2023-12-28 07:49:08,268][106225] Updated weights for policy 1, policy_version 1751577 (0.0007) [2023-12-28 07:49:08,330][106225] Updated weights for policy 1, policy_version 1751587 (0.0009) [2023-12-28 07:49:08,358][106226] Updated weights for policy 0, policy_version 1747212 (0.0010) [2023-12-28 07:49:08,419][106226] Updated weights for policy 0, policy_version 1747222 (0.0009) [2023-12-28 07:49:08,481][106226] Updated weights for policy 0, policy_version 1747232 (0.0011) [2023-12-28 07:49:09,052][106225] Updated weights for policy 1, policy_version 1751597 (0.0008) [2023-12-28 07:49:09,110][106225] Updated weights for policy 1, policy_version 1751607 (0.0005) [2023-12-28 07:49:09,168][106225] Updated weights for policy 1, policy_version 1751617 (0.0005) [2023-12-28 07:49:09,225][106226] Updated weights for policy 0, policy_version 1747242 (0.0010) [2023-12-28 07:49:09,294][106226] Updated weights for policy 0, policy_version 1747252 (0.0006) [2023-12-28 07:49:09,363][106226] Updated weights for policy 0, policy_version 1747262 (0.0008) [2023-12-28 07:49:09,427][106226] Updated weights for policy 0, policy_version 1747272 (0.0009) [2023-12-28 07:49:09,898][106225] Updated weights for policy 1, policy_version 1751627 (0.0007) [2023-12-28 07:49:09,969][106225] Updated weights for policy 1, policy_version 1751637 (0.0008) [2023-12-28 07:49:10,033][106225] Updated weights for policy 1, policy_version 1751647 (0.0008) [2023-12-28 07:49:10,168][106226] Updated weights for policy 0, policy_version 1747282 (0.0007) [2023-12-28 07:49:10,237][106226] Updated weights for policy 0, policy_version 1747292 (0.0007) [2023-12-28 07:49:10,304][106226] Updated weights for policy 0, policy_version 1747302 (0.0006) [2023-12-28 07:49:10,806][106225] Updated weights for policy 1, policy_version 1751657 (0.0008) [2023-12-28 07:49:10,875][106225] Updated weights for policy 1, policy_version 1751667 (0.0006) [2023-12-28 07:49:10,937][106226] Updated weights for policy 0, policy_version 1747312 (0.0005) [2023-12-28 07:49:10,941][106225] Updated weights for policy 1, policy_version 1751677 (0.0006) [2023-12-28 07:49:10,988][106226] Updated weights for policy 0, policy_version 1747322 (0.0005) [2023-12-28 07:49:10,995][106225] Updated weights for policy 1, policy_version 1751687 (0.0009) [2023-12-28 07:49:11,052][106226] Updated weights for policy 0, policy_version 1747332 (0.0007) [2023-12-28 07:49:11,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 895885312. Throughput: 0: 9944.3, 1: 10085.2. Samples: 895851296. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:11,175][105115] Avg episode reward: [(0, '-4.223'), (1, '-4.981')] [2023-12-28 07:49:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001751688_448487424.pth... [2023-12-28 07:49:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001747336_447397888.pth... [2023-12-28 07:49:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001750504_448184320.pth [2023-12-28 07:49:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001746184_447102976.pth [2023-12-28 07:49:11,648][106225] Updated weights for policy 1, policy_version 1751697 (0.0009) [2023-12-28 07:49:11,713][106225] Updated weights for policy 1, policy_version 1751707 (0.0008) [2023-12-28 07:49:11,779][106225] Updated weights for policy 1, policy_version 1751717 (0.0008) [2023-12-28 07:49:11,830][106226] Updated weights for policy 0, policy_version 1747342 (0.0008) [2023-12-28 07:49:11,896][106226] Updated weights for policy 0, policy_version 1747352 (0.0008) [2023-12-28 07:49:11,960][106226] Updated weights for policy 0, policy_version 1747362 (0.0010) [2023-12-28 07:49:12,597][106225] Updated weights for policy 1, policy_version 1751727 (0.0009) [2023-12-28 07:49:12,602][106226] Updated weights for policy 0, policy_version 1747372 (0.0008) [2023-12-28 07:49:12,654][106225] Updated weights for policy 1, policy_version 1751737 (0.0007) [2023-12-28 07:49:12,660][106226] Updated weights for policy 0, policy_version 1747382 (0.0009) [2023-12-28 07:49:12,712][106225] Updated weights for policy 1, policy_version 1751747 (0.0008) [2023-12-28 07:49:12,719][106226] Updated weights for policy 0, policy_version 1747392 (0.0006) [2023-12-28 07:49:13,438][106225] Updated weights for policy 1, policy_version 1751757 (0.0005) [2023-12-28 07:49:13,466][106226] Updated weights for policy 0, policy_version 1747402 (0.0010) [2023-12-28 07:49:13,496][106225] Updated weights for policy 1, policy_version 1751767 (0.0005) [2023-12-28 07:49:13,527][106226] Updated weights for policy 0, policy_version 1747412 (0.0008) [2023-12-28 07:49:13,555][106225] Updated weights for policy 1, policy_version 1751777 (0.0006) [2023-12-28 07:49:13,591][106226] Updated weights for policy 0, policy_version 1747422 (0.0008) [2023-12-28 07:49:13,639][106226] Updated weights for policy 0, policy_version 1747432 (0.0008) [2023-12-28 07:49:14,073][106225] Updated weights for policy 1, policy_version 1751787 (0.0007) [2023-12-28 07:49:14,130][106225] Updated weights for policy 1, policy_version 1751797 (0.0007) [2023-12-28 07:49:14,195][106225] Updated weights for policy 1, policy_version 1751807 (0.0007) [2023-12-28 07:49:14,410][106226] Updated weights for policy 0, policy_version 1747442 (0.0008) [2023-12-28 07:49:14,470][106226] Updated weights for policy 0, policy_version 1747452 (0.0008) [2023-12-28 07:49:14,529][106226] Updated weights for policy 0, policy_version 1747462 (0.0007) [2023-12-28 07:49:14,855][106225] Updated weights for policy 1, policy_version 1751817 (0.0009) [2023-12-28 07:49:14,914][106225] Updated weights for policy 1, policy_version 1751827 (0.0006) [2023-12-28 07:49:14,978][106225] Updated weights for policy 1, policy_version 1751837 (0.0006) [2023-12-28 07:49:15,036][106225] Updated weights for policy 1, policy_version 1751847 (0.0006) [2023-12-28 07:49:15,333][106226] Updated weights for policy 0, policy_version 1747472 (0.0009) [2023-12-28 07:49:15,390][106226] Updated weights for policy 0, policy_version 1747482 (0.0009) [2023-12-28 07:49:15,455][106226] Updated weights for policy 0, policy_version 1747492 (0.0009) [2023-12-28 07:49:15,585][106225] Updated weights for policy 1, policy_version 1751857 (0.0006) [2023-12-28 07:49:15,641][106225] Updated weights for policy 1, policy_version 1751867 (0.0006) [2023-12-28 07:49:15,694][106225] Updated weights for policy 1, policy_version 1751877 (0.0008) [2023-12-28 07:49:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 895975424. Throughput: 0: 9797.3, 1: 10088.5. Samples: 895968180. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:16,176][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.665')] [2023-12-28 07:49:16,264][106226] Updated weights for policy 0, policy_version 1747502 (0.0007) [2023-12-28 07:49:16,281][106225] Updated weights for policy 1, policy_version 1751887 (0.0008) [2023-12-28 07:49:16,316][106226] Updated weights for policy 0, policy_version 1747512 (0.0006) [2023-12-28 07:49:16,336][106225] Updated weights for policy 1, policy_version 1751897 (0.0005) [2023-12-28 07:49:16,377][106226] Updated weights for policy 0, policy_version 1747522 (0.0008) [2023-12-28 07:49:16,397][106225] Updated weights for policy 1, policy_version 1751907 (0.0005) [2023-12-28 07:49:16,954][106225] Updated weights for policy 1, policy_version 1751917 (0.0006) [2023-12-28 07:49:17,016][106225] Updated weights for policy 1, policy_version 1751927 (0.0007) [2023-12-28 07:49:17,069][106225] Updated weights for policy 1, policy_version 1751937 (0.0005) [2023-12-28 07:49:17,112][106226] Updated weights for policy 0, policy_version 1747532 (0.0009) [2023-12-28 07:49:17,158][106226] Updated weights for policy 0, policy_version 1747542 (0.0009) [2023-12-28 07:49:17,212][106226] Updated weights for policy 0, policy_version 1747552 (0.0006) [2023-12-28 07:49:17,671][106225] Updated weights for policy 1, policy_version 1751947 (0.0006) [2023-12-28 07:49:17,725][106225] Updated weights for policy 1, policy_version 1751957 (0.0005) [2023-12-28 07:49:17,779][106225] Updated weights for policy 1, policy_version 1751967 (0.0006) [2023-12-28 07:49:17,838][106226] Updated weights for policy 0, policy_version 1747562 (0.0007) [2023-12-28 07:49:17,894][106226] Updated weights for policy 0, policy_version 1747572 (0.0008) [2023-12-28 07:49:17,944][106226] Updated weights for policy 0, policy_version 1747582 (0.0006) [2023-12-28 07:49:18,005][106226] Updated weights for policy 0, policy_version 1747592 (0.0006) [2023-12-28 07:49:18,478][106225] Updated weights for policy 1, policy_version 1751977 (0.0007) [2023-12-28 07:49:18,536][106225] Updated weights for policy 1, policy_version 1751987 (0.0005) [2023-12-28 07:49:18,593][106225] Updated weights for policy 1, policy_version 1751997 (0.0006) [2023-12-28 07:49:18,650][106225] Updated weights for policy 1, policy_version 1752007 (0.0008) [2023-12-28 07:49:18,755][106226] Updated weights for policy 0, policy_version 1747602 (0.0005) [2023-12-28 07:49:18,813][106226] Updated weights for policy 0, policy_version 1747612 (0.0005) [2023-12-28 07:49:18,871][106226] Updated weights for policy 0, policy_version 1747622 (0.0010) [2023-12-28 07:49:19,317][106225] Updated weights for policy 1, policy_version 1752017 (0.0010) [2023-12-28 07:49:19,384][106225] Updated weights for policy 1, policy_version 1752027 (0.0011) [2023-12-28 07:49:19,434][106225] Updated weights for policy 1, policy_version 1752037 (0.0008) [2023-12-28 07:49:19,556][106226] Updated weights for policy 0, policy_version 1747632 (0.0009) [2023-12-28 07:49:19,620][106226] Updated weights for policy 0, policy_version 1747642 (0.0009) [2023-12-28 07:49:19,680][106226] Updated weights for policy 0, policy_version 1747652 (0.0008) [2023-12-28 07:49:20,176][106225] Updated weights for policy 1, policy_version 1752047 (0.0010) [2023-12-28 07:49:20,241][106225] Updated weights for policy 1, policy_version 1752057 (0.0007) [2023-12-28 07:49:20,306][106225] Updated weights for policy 1, policy_version 1752067 (0.0007) [2023-12-28 07:49:20,411][106226] Updated weights for policy 0, policy_version 1747662 (0.0011) [2023-12-28 07:49:20,471][106226] Updated weights for policy 0, policy_version 1747672 (0.0011) [2023-12-28 07:49:20,539][106226] Updated weights for policy 0, policy_version 1747682 (0.0011) [2023-12-28 07:49:20,948][106225] Updated weights for policy 1, policy_version 1752077 (0.0006) [2023-12-28 07:49:21,010][106225] Updated weights for policy 1, policy_version 1752087 (0.0007) [2023-12-28 07:49:21,086][106225] Updated weights for policy 1, policy_version 1752097 (0.0008) [2023-12-28 07:49:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 896081920. Throughput: 0: 9708.5, 1: 10178.9. Samples: 896089816. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:21,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.854')] [2023-12-28 07:49:21,315][106226] Updated weights for policy 0, policy_version 1747692 (0.0009) [2023-12-28 07:49:21,390][106226] Updated weights for policy 0, policy_version 1747702 (0.0009) [2023-12-28 07:49:21,457][106226] Updated weights for policy 0, policy_version 1747712 (0.0007) [2023-12-28 07:49:21,909][106225] Updated weights for policy 1, policy_version 1752107 (0.0008) [2023-12-28 07:49:21,957][106225] Updated weights for policy 1, policy_version 1752117 (0.0009) [2023-12-28 07:49:22,007][106225] Updated weights for policy 1, policy_version 1752127 (0.0010) [2023-12-28 07:49:22,119][106226] Updated weights for policy 0, policy_version 1747722 (0.0010) [2023-12-28 07:49:22,191][106226] Updated weights for policy 0, policy_version 1747732 (0.0006) [2023-12-28 07:49:22,257][106226] Updated weights for policy 0, policy_version 1747742 (0.0006) [2023-12-28 07:49:22,329][106226] Updated weights for policy 0, policy_version 1747752 (0.0006) [2023-12-28 07:49:22,913][106225] Updated weights for policy 1, policy_version 1752137 (0.0010) [2023-12-28 07:49:22,925][106226] Updated weights for policy 0, policy_version 1747762 (0.0011) [2023-12-28 07:49:22,968][106225] Updated weights for policy 1, policy_version 1752147 (0.0007) [2023-12-28 07:49:22,983][106226] Updated weights for policy 0, policy_version 1747772 (0.0009) [2023-12-28 07:49:23,020][106225] Updated weights for policy 1, policy_version 1752157 (0.0005) [2023-12-28 07:49:23,033][106226] Updated weights for policy 0, policy_version 1747782 (0.0011) [2023-12-28 07:49:23,075][106225] Updated weights for policy 1, policy_version 1752167 (0.0006) [2023-12-28 07:49:23,674][106225] Updated weights for policy 1, policy_version 1752177 (0.0006) [2023-12-28 07:49:23,676][106226] Updated weights for policy 0, policy_version 1747792 (0.0006) [2023-12-28 07:49:23,727][106226] Updated weights for policy 0, policy_version 1747802 (0.0006) [2023-12-28 07:49:23,733][106225] Updated weights for policy 1, policy_version 1752187 (0.0008) [2023-12-28 07:49:23,776][106226] Updated weights for policy 0, policy_version 1747812 (0.0005) [2023-12-28 07:49:23,788][106225] Updated weights for policy 1, policy_version 1752197 (0.0008) [2023-12-28 07:49:24,377][106225] Updated weights for policy 1, policy_version 1752207 (0.0006) [2023-12-28 07:49:24,434][106225] Updated weights for policy 1, policy_version 1752217 (0.0007) [2023-12-28 07:49:24,462][106226] Updated weights for policy 0, policy_version 1747822 (0.0006) [2023-12-28 07:49:24,488][106225] Updated weights for policy 1, policy_version 1752227 (0.0006) [2023-12-28 07:49:24,512][106226] Updated weights for policy 0, policy_version 1747832 (0.0008) [2023-12-28 07:49:24,562][106226] Updated weights for policy 0, policy_version 1747842 (0.0009) [2023-12-28 07:49:25,044][106225] Updated weights for policy 1, policy_version 1752237 (0.0008) [2023-12-28 07:49:25,096][106225] Updated weights for policy 1, policy_version 1752247 (0.0010) [2023-12-28 07:49:25,142][106225] Updated weights for policy 1, policy_version 1752257 (0.0009) [2023-12-28 07:49:25,274][106226] Updated weights for policy 0, policy_version 1747852 (0.0008) [2023-12-28 07:49:25,340][106226] Updated weights for policy 0, policy_version 1747862 (0.0005) [2023-12-28 07:49:25,401][106226] Updated weights for policy 0, policy_version 1747872 (0.0005) [2023-12-28 07:49:25,735][106225] Updated weights for policy 1, policy_version 1752267 (0.0007) [2023-12-28 07:49:25,781][106225] Updated weights for policy 1, policy_version 1752277 (0.0010) [2023-12-28 07:49:25,837][106225] Updated weights for policy 1, policy_version 1752287 (0.0010) [2023-12-28 07:49:25,967][106226] Updated weights for policy 0, policy_version 1747882 (0.0006) [2023-12-28 07:49:26,025][106226] Updated weights for policy 0, policy_version 1747892 (0.0011) [2023-12-28 07:49:26,081][106226] Updated weights for policy 0, policy_version 1747902 (0.0010) [2023-12-28 07:49:26,131][106226] Updated weights for policy 0, policy_version 1747912 (0.0010) [2023-12-28 07:49:26,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 896188416. Throughput: 0: 9774.0, 1: 10136.3. Samples: 896149432. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:26,176][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.729')] [2023-12-28 07:49:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001752296_448643072.pth... [2023-12-28 07:49:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001747912_447545344.pth... [2023-12-28 07:49:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001751112_448339968.pth [2023-12-28 07:49:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001746728_447242240.pth [2023-12-28 07:49:26,518][106225] Updated weights for policy 1, policy_version 1752297 (0.0010) [2023-12-28 07:49:26,566][106225] Updated weights for policy 1, policy_version 1752307 (0.0005) [2023-12-28 07:49:26,610][106225] Updated weights for policy 1, policy_version 1752317 (0.0005) [2023-12-28 07:49:26,660][106225] Updated weights for policy 1, policy_version 1752327 (0.0005) [2023-12-28 07:49:26,849][106226] Updated weights for policy 0, policy_version 1747922 (0.0010) [2023-12-28 07:49:26,892][106226] Updated weights for policy 0, policy_version 1747932 (0.0010) [2023-12-28 07:49:26,938][106226] Updated weights for policy 0, policy_version 1747942 (0.0010) [2023-12-28 07:49:27,336][106225] Updated weights for policy 1, policy_version 1752337 (0.0008) [2023-12-28 07:49:27,383][106225] Updated weights for policy 1, policy_version 1752347 (0.0009) [2023-12-28 07:49:27,430][106225] Updated weights for policy 1, policy_version 1752357 (0.0010) [2023-12-28 07:49:27,670][106226] Updated weights for policy 0, policy_version 1747952 (0.0010) [2023-12-28 07:49:27,719][106226] Updated weights for policy 0, policy_version 1747962 (0.0010) [2023-12-28 07:49:27,763][106226] Updated weights for policy 0, policy_version 1747972 (0.0010) [2023-12-28 07:49:28,142][106225] Updated weights for policy 1, policy_version 1752367 (0.0010) [2023-12-28 07:49:28,201][106225] Updated weights for policy 1, policy_version 1752377 (0.0010) [2023-12-28 07:49:28,251][106225] Updated weights for policy 1, policy_version 1752387 (0.0010) [2023-12-28 07:49:28,483][106226] Updated weights for policy 0, policy_version 1747982 (0.0010) [2023-12-28 07:49:28,536][106226] Updated weights for policy 0, policy_version 1747992 (0.0010) [2023-12-28 07:49:28,589][106226] Updated weights for policy 0, policy_version 1748002 (0.0010) [2023-12-28 07:49:28,956][106225] Updated weights for policy 1, policy_version 1752397 (0.0010) [2023-12-28 07:49:29,005][106225] Updated weights for policy 1, policy_version 1752407 (0.0010) [2023-12-28 07:49:29,054][106225] Updated weights for policy 1, policy_version 1752417 (0.0010) [2023-12-28 07:49:29,305][106226] Updated weights for policy 0, policy_version 1748012 (0.0011) [2023-12-28 07:49:29,374][106226] Updated weights for policy 0, policy_version 1748022 (0.0010) [2023-12-28 07:49:29,419][106226] Updated weights for policy 0, policy_version 1748032 (0.0008) [2023-12-28 07:49:29,823][106225] Updated weights for policy 1, policy_version 1752427 (0.0009) [2023-12-28 07:49:29,889][106225] Updated weights for policy 1, policy_version 1752437 (0.0007) [2023-12-28 07:49:29,954][106225] Updated weights for policy 1, policy_version 1752447 (0.0007) [2023-12-28 07:49:30,165][106226] Updated weights for policy 0, policy_version 1748042 (0.0008) [2023-12-28 07:49:30,227][106226] Updated weights for policy 0, policy_version 1748052 (0.0011) [2023-12-28 07:49:30,287][106226] Updated weights for policy 0, policy_version 1748062 (0.0010) [2023-12-28 07:49:30,348][106226] Updated weights for policy 0, policy_version 1748072 (0.0011) [2023-12-28 07:49:30,674][106225] Updated weights for policy 1, policy_version 1752457 (0.0007) [2023-12-28 07:49:30,735][106225] Updated weights for policy 1, policy_version 1752467 (0.0009) [2023-12-28 07:49:30,786][106225] Updated weights for policy 1, policy_version 1752477 (0.0008) [2023-12-28 07:49:30,843][106225] Updated weights for policy 1, policy_version 1752487 (0.0008) [2023-12-28 07:49:30,977][106226] Updated weights for policy 0, policy_version 1748082 (0.0011) [2023-12-28 07:49:31,041][106226] Updated weights for policy 0, policy_version 1748093 (0.0010) [2023-12-28 07:49:31,131][106226] Updated weights for policy 0, policy_version 1748103 (0.0009) [2023-12-28 07:49:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 896286720. Throughput: 0: 9763.5, 1: 10250.3. Samples: 896272996. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:31,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-5.019')] [2023-12-28 07:49:31,622][106225] Updated weights for policy 1, policy_version 1752497 (0.0010) [2023-12-28 07:49:31,684][106225] Updated weights for policy 1, policy_version 1752507 (0.0009) [2023-12-28 07:49:31,748][106225] Updated weights for policy 1, policy_version 1752517 (0.0011) [2023-12-28 07:49:31,891][106226] Updated weights for policy 0, policy_version 1748113 (0.0010) [2023-12-28 07:49:31,944][106226] Updated weights for policy 0, policy_version 1748123 (0.0010) [2023-12-28 07:49:32,001][106226] Updated weights for policy 0, policy_version 1748133 (0.0010) [2023-12-28 07:49:32,488][106225] Updated weights for policy 1, policy_version 1752527 (0.0010) [2023-12-28 07:49:32,549][106225] Updated weights for policy 1, policy_version 1752537 (0.0010) [2023-12-28 07:49:32,611][106225] Updated weights for policy 1, policy_version 1752547 (0.0010) [2023-12-28 07:49:32,721][106226] Updated weights for policy 0, policy_version 1748143 (0.0008) [2023-12-28 07:49:32,785][106226] Updated weights for policy 0, policy_version 1748153 (0.0008) [2023-12-28 07:49:32,845][106226] Updated weights for policy 0, policy_version 1748163 (0.0008) [2023-12-28 07:49:33,240][106225] Updated weights for policy 1, policy_version 1752557 (0.0008) [2023-12-28 07:49:33,301][106225] Updated weights for policy 1, policy_version 1752567 (0.0008) [2023-12-28 07:49:33,357][106225] Updated weights for policy 1, policy_version 1752577 (0.0008) [2023-12-28 07:49:33,553][106226] Updated weights for policy 0, policy_version 1748173 (0.0008) [2023-12-28 07:49:33,611][106226] Updated weights for policy 0, policy_version 1748183 (0.0008) [2023-12-28 07:49:33,666][106226] Updated weights for policy 0, policy_version 1748193 (0.0009) [2023-12-28 07:49:34,033][106225] Updated weights for policy 1, policy_version 1752587 (0.0008) [2023-12-28 07:49:34,089][106225] Updated weights for policy 1, policy_version 1752597 (0.0009) [2023-12-28 07:49:34,153][106225] Updated weights for policy 1, policy_version 1752607 (0.0008) [2023-12-28 07:49:34,409][106226] Updated weights for policy 0, policy_version 1748203 (0.0008) [2023-12-28 07:49:34,466][106226] Updated weights for policy 0, policy_version 1748213 (0.0009) [2023-12-28 07:49:34,528][106226] Updated weights for policy 0, policy_version 1748223 (0.0008) [2023-12-28 07:49:34,887][106225] Updated weights for policy 1, policy_version 1752617 (0.0009) [2023-12-28 07:49:34,942][106225] Updated weights for policy 1, policy_version 1752627 (0.0007) [2023-12-28 07:49:35,000][106225] Updated weights for policy 1, policy_version 1752637 (0.0006) [2023-12-28 07:49:35,061][106225] Updated weights for policy 1, policy_version 1752647 (0.0006) [2023-12-28 07:49:35,225][106226] Updated weights for policy 0, policy_version 1748233 (0.0009) [2023-12-28 07:49:35,270][106226] Updated weights for policy 0, policy_version 1748243 (0.0008) [2023-12-28 07:49:35,327][106226] Updated weights for policy 0, policy_version 1748253 (0.0009) [2023-12-28 07:49:35,391][106226] Updated weights for policy 0, policy_version 1748263 (0.0010) [2023-12-28 07:49:35,647][106225] Updated weights for policy 1, policy_version 1752657 (0.0006) [2023-12-28 07:49:35,708][106225] Updated weights for policy 1, policy_version 1752667 (0.0008) [2023-12-28 07:49:35,775][106225] Updated weights for policy 1, policy_version 1752677 (0.0009) [2023-12-28 07:49:36,011][106226] Updated weights for policy 0, policy_version 1748273 (0.0008) [2023-12-28 07:49:36,077][106226] Updated weights for policy 0, policy_version 1748283 (0.0009) [2023-12-28 07:49:36,170][106226] Updated weights for policy 0, policy_version 1748293 (0.0008) [2023-12-28 07:49:36,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 896376832. Throughput: 0: 9874.8, 1: 10177.2. Samples: 896390928. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:36,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.903')] [2023-12-28 07:49:36,531][106225] Updated weights for policy 1, policy_version 1752687 (0.0009) [2023-12-28 07:49:36,596][106225] Updated weights for policy 1, policy_version 1752697 (0.0008) [2023-12-28 07:49:36,662][106225] Updated weights for policy 1, policy_version 1752707 (0.0009) [2023-12-28 07:49:36,812][106226] Updated weights for policy 0, policy_version 1748303 (0.0008) [2023-12-28 07:49:36,872][106226] Updated weights for policy 0, policy_version 1748313 (0.0008) [2023-12-28 07:49:36,937][106226] Updated weights for policy 0, policy_version 1748323 (0.0008) [2023-12-28 07:49:37,462][106225] Updated weights for policy 1, policy_version 1752717 (0.0009) [2023-12-28 07:49:37,490][106226] Updated weights for policy 0, policy_version 1748333 (0.0008) [2023-12-28 07:49:37,523][106225] Updated weights for policy 1, policy_version 1752727 (0.0007) [2023-12-28 07:49:37,541][106226] Updated weights for policy 0, policy_version 1748343 (0.0007) [2023-12-28 07:49:37,582][106225] Updated weights for policy 1, policy_version 1752737 (0.0008) [2023-12-28 07:49:37,601][106226] Updated weights for policy 0, policy_version 1748353 (0.0006) [2023-12-28 07:49:38,210][106225] Updated weights for policy 1, policy_version 1752747 (0.0008) [2023-12-28 07:49:38,261][106225] Updated weights for policy 1, policy_version 1752757 (0.0008) [2023-12-28 07:49:38,323][106225] Updated weights for policy 1, policy_version 1752767 (0.0010) [2023-12-28 07:49:38,384][106226] Updated weights for policy 0, policy_version 1748363 (0.0008) [2023-12-28 07:49:38,450][106226] Updated weights for policy 0, policy_version 1748373 (0.0008) [2023-12-28 07:49:38,509][106226] Updated weights for policy 0, policy_version 1748383 (0.0009) [2023-12-28 07:49:39,008][106225] Updated weights for policy 1, policy_version 1752777 (0.0008) [2023-12-28 07:49:39,069][106225] Updated weights for policy 1, policy_version 1752787 (0.0005) [2023-12-28 07:49:39,119][106225] Updated weights for policy 1, policy_version 1752797 (0.0008) [2023-12-28 07:49:39,168][106225] Updated weights for policy 1, policy_version 1752807 (0.0010) [2023-12-28 07:49:39,244][106226] Updated weights for policy 0, policy_version 1748393 (0.0009) [2023-12-28 07:49:39,310][106226] Updated weights for policy 0, policy_version 1748403 (0.0009) [2023-12-28 07:49:39,382][106226] Updated weights for policy 0, policy_version 1748413 (0.0008) [2023-12-28 07:49:39,452][106226] Updated weights for policy 0, policy_version 1748423 (0.0008) [2023-12-28 07:49:39,920][106225] Updated weights for policy 1, policy_version 1752817 (0.0010) [2023-12-28 07:49:39,991][106225] Updated weights for policy 1, policy_version 1752827 (0.0009) [2023-12-28 07:49:40,056][106225] Updated weights for policy 1, policy_version 1752837 (0.0011) [2023-12-28 07:49:40,177][106226] Updated weights for policy 0, policy_version 1748433 (0.0010) [2023-12-28 07:49:40,242][106226] Updated weights for policy 0, policy_version 1748443 (0.0011) [2023-12-28 07:49:40,307][106226] Updated weights for policy 0, policy_version 1748453 (0.0011) [2023-12-28 07:49:40,779][106225] Updated weights for policy 1, policy_version 1752847 (0.0010) [2023-12-28 07:49:40,838][106225] Updated weights for policy 1, policy_version 1752857 (0.0010) [2023-12-28 07:49:40,885][106225] Updated weights for policy 1, policy_version 1752867 (0.0010) [2023-12-28 07:49:41,014][106226] Updated weights for policy 0, policy_version 1748463 (0.0007) [2023-12-28 07:49:41,081][106226] Updated weights for policy 0, policy_version 1748473 (0.0008) [2023-12-28 07:49:41,138][106226] Updated weights for policy 0, policy_version 1748483 (0.0008) [2023-12-28 07:49:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 896483328. Throughput: 0: 9917.8, 1: 10100.4. Samples: 896449400. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:41,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.619')] [2023-12-28 07:49:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001748488_447692800.pth... [2023-12-28 07:49:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001752872_448790528.pth... [2023-12-28 07:49:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001747336_447397888.pth [2023-12-28 07:49:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001751688_448487424.pth [2023-12-28 07:49:41,657][106225] Updated weights for policy 1, policy_version 1752877 (0.0011) [2023-12-28 07:49:41,710][106225] Updated weights for policy 1, policy_version 1752887 (0.0010) [2023-12-28 07:49:41,778][106225] Updated weights for policy 1, policy_version 1752897 (0.0010) [2023-12-28 07:49:41,937][106226] Updated weights for policy 0, policy_version 1748493 (0.0010) [2023-12-28 07:49:42,004][106226] Updated weights for policy 0, policy_version 1748503 (0.0011) [2023-12-28 07:49:42,065][106226] Updated weights for policy 0, policy_version 1748513 (0.0010) [2023-12-28 07:49:42,520][106225] Updated weights for policy 1, policy_version 1752907 (0.0011) [2023-12-28 07:49:42,574][106225] Updated weights for policy 1, policy_version 1752917 (0.0010) [2023-12-28 07:49:42,628][106225] Updated weights for policy 1, policy_version 1752927 (0.0010) [2023-12-28 07:49:42,809][106226] Updated weights for policy 0, policy_version 1748523 (0.0008) [2023-12-28 07:49:42,875][106226] Updated weights for policy 0, policy_version 1748533 (0.0005) [2023-12-28 07:49:42,941][106226] Updated weights for policy 0, policy_version 1748543 (0.0008) [2023-12-28 07:49:43,321][106225] Updated weights for policy 1, policy_version 1752937 (0.0009) [2023-12-28 07:49:43,372][106225] Updated weights for policy 1, policy_version 1752947 (0.0009) [2023-12-28 07:49:43,417][106225] Updated weights for policy 1, policy_version 1752957 (0.0005) [2023-12-28 07:49:43,473][106225] Updated weights for policy 1, policy_version 1752967 (0.0005) [2023-12-28 07:49:43,633][106226] Updated weights for policy 0, policy_version 1748553 (0.0008) [2023-12-28 07:49:43,702][106226] Updated weights for policy 0, policy_version 1748563 (0.0010) [2023-12-28 07:49:43,763][106226] Updated weights for policy 0, policy_version 1748573 (0.0009) [2023-12-28 07:49:43,818][106226] Updated weights for policy 0, policy_version 1748583 (0.0008) [2023-12-28 07:49:44,116][106225] Updated weights for policy 1, policy_version 1752977 (0.0008) [2023-12-28 07:49:44,166][106225] Updated weights for policy 1, policy_version 1752987 (0.0009) [2023-12-28 07:49:44,223][106225] Updated weights for policy 1, policy_version 1752997 (0.0009) [2023-12-28 07:49:44,452][106226] Updated weights for policy 0, policy_version 1748593 (0.0010) [2023-12-28 07:49:44,512][106226] Updated weights for policy 0, policy_version 1748603 (0.0010) [2023-12-28 07:49:44,559][106226] Updated weights for policy 0, policy_version 1748613 (0.0008) [2023-12-28 07:49:44,862][106225] Updated weights for policy 1, policy_version 1753007 (0.0007) [2023-12-28 07:49:44,924][106225] Updated weights for policy 1, policy_version 1753017 (0.0006) [2023-12-28 07:49:44,985][106225] Updated weights for policy 1, policy_version 1753027 (0.0005) [2023-12-28 07:49:45,282][106226] Updated weights for policy 0, policy_version 1748623 (0.0011) [2023-12-28 07:49:45,340][106226] Updated weights for policy 0, policy_version 1748633 (0.0011) [2023-12-28 07:49:45,391][106226] Updated weights for policy 0, policy_version 1748643 (0.0010) [2023-12-28 07:49:45,644][106225] Updated weights for policy 1, policy_version 1753037 (0.0010) [2023-12-28 07:49:45,693][106225] Updated weights for policy 1, policy_version 1753047 (0.0010) [2023-12-28 07:49:45,748][106225] Updated weights for policy 1, policy_version 1753057 (0.0010) [2023-12-28 07:49:46,101][106226] Updated weights for policy 0, policy_version 1748653 (0.0008) [2023-12-28 07:49:46,149][106226] Updated weights for policy 0, policy_version 1748663 (0.0010) [2023-12-28 07:49:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 896573440. Throughput: 0: 9862.0, 1: 10024.4. Samples: 896566052. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:46,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-5.417')] [2023-12-28 07:49:46,211][106226] Updated weights for policy 0, policy_version 1748673 (0.0010) [2023-12-28 07:49:46,390][106225] Updated weights for policy 1, policy_version 1753067 (0.0010) [2023-12-28 07:49:46,446][106225] Updated weights for policy 1, policy_version 1753077 (0.0006) [2023-12-28 07:49:46,497][106225] Updated weights for policy 1, policy_version 1753087 (0.0005) [2023-12-28 07:49:46,811][106226] Updated weights for policy 0, policy_version 1748683 (0.0009) [2023-12-28 07:49:46,869][106226] Updated weights for policy 0, policy_version 1748693 (0.0005) [2023-12-28 07:49:46,925][106226] Updated weights for policy 0, policy_version 1748703 (0.0005) [2023-12-28 07:49:47,193][106225] Updated weights for policy 1, policy_version 1753097 (0.0010) [2023-12-28 07:49:47,255][106225] Updated weights for policy 1, policy_version 1753107 (0.0008) [2023-12-28 07:49:47,311][106225] Updated weights for policy 1, policy_version 1753117 (0.0007) [2023-12-28 07:49:47,386][106225] Updated weights for policy 1, policy_version 1753127 (0.0006) [2023-12-28 07:49:47,571][106226] Updated weights for policy 0, policy_version 1748713 (0.0005) [2023-12-28 07:49:47,636][106226] Updated weights for policy 0, policy_version 1748723 (0.0008) [2023-12-28 07:49:47,693][106226] Updated weights for policy 0, policy_version 1748733 (0.0006) [2023-12-28 07:49:47,748][106226] Updated weights for policy 0, policy_version 1748743 (0.0005) [2023-12-28 07:49:47,976][106225] Updated weights for policy 1, policy_version 1753137 (0.0005) [2023-12-28 07:49:48,039][106225] Updated weights for policy 1, policy_version 1753147 (0.0005) [2023-12-28 07:49:48,094][106225] Updated weights for policy 1, policy_version 1753157 (0.0005) [2023-12-28 07:49:48,365][106226] Updated weights for policy 0, policy_version 1748753 (0.0008) [2023-12-28 07:49:48,427][106226] Updated weights for policy 0, policy_version 1748763 (0.0007) [2023-12-28 07:49:48,481][106226] Updated weights for policy 0, policy_version 1748773 (0.0009) [2023-12-28 07:49:48,766][106225] Updated weights for policy 1, policy_version 1753167 (0.0008) [2023-12-28 07:49:48,818][106225] Updated weights for policy 1, policy_version 1753177 (0.0008) [2023-12-28 07:49:48,876][106225] Updated weights for policy 1, policy_version 1753187 (0.0009) [2023-12-28 07:49:49,166][106226] Updated weights for policy 0, policy_version 1748783 (0.0006) [2023-12-28 07:49:49,217][106226] Updated weights for policy 0, policy_version 1748793 (0.0006) [2023-12-28 07:49:49,284][106226] Updated weights for policy 0, policy_version 1748803 (0.0008) [2023-12-28 07:49:49,627][106225] Updated weights for policy 1, policy_version 1753197 (0.0008) [2023-12-28 07:49:49,685][106225] Updated weights for policy 1, policy_version 1753207 (0.0008) [2023-12-28 07:49:49,739][106225] Updated weights for policy 1, policy_version 1753217 (0.0008) [2023-12-28 07:49:49,998][106226] Updated weights for policy 0, policy_version 1748813 (0.0009) [2023-12-28 07:49:50,062][106226] Updated weights for policy 0, policy_version 1748823 (0.0008) [2023-12-28 07:49:50,125][106226] Updated weights for policy 0, policy_version 1748833 (0.0008) [2023-12-28 07:49:50,460][106225] Updated weights for policy 1, policy_version 1753227 (0.0009) [2023-12-28 07:49:50,516][106225] Updated weights for policy 1, policy_version 1753237 (0.0009) [2023-12-28 07:49:50,575][106225] Updated weights for policy 1, policy_version 1753247 (0.0008) [2023-12-28 07:49:50,804][106226] Updated weights for policy 0, policy_version 1748843 (0.0008) [2023-12-28 07:49:50,869][106226] Updated weights for policy 0, policy_version 1748853 (0.0008) [2023-12-28 07:49:50,936][106226] Updated weights for policy 0, policy_version 1748863 (0.0007) [2023-12-28 07:49:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 896679936. Throughput: 0: 9900.0, 1: 10084.9. Samples: 896688248. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:51,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-5.261')] [2023-12-28 07:49:51,328][106225] Updated weights for policy 1, policy_version 1753257 (0.0008) [2023-12-28 07:49:51,394][106225] Updated weights for policy 1, policy_version 1753267 (0.0007) [2023-12-28 07:49:51,461][106225] Updated weights for policy 1, policy_version 1753277 (0.0007) [2023-12-28 07:49:51,525][106225] Updated weights for policy 1, policy_version 1753287 (0.0008) [2023-12-28 07:49:51,672][106226] Updated weights for policy 0, policy_version 1748873 (0.0005) [2023-12-28 07:49:51,746][106226] Updated weights for policy 0, policy_version 1748883 (0.0008) [2023-12-28 07:49:51,808][106226] Updated weights for policy 0, policy_version 1748893 (0.0007) [2023-12-28 07:49:51,871][106226] Updated weights for policy 0, policy_version 1748903 (0.0007) [2023-12-28 07:49:52,258][106225] Updated weights for policy 1, policy_version 1753297 (0.0008) [2023-12-28 07:49:52,322][106225] Updated weights for policy 1, policy_version 1753307 (0.0006) [2023-12-28 07:49:52,388][106225] Updated weights for policy 1, policy_version 1753317 (0.0008) [2023-12-28 07:49:52,553][106226] Updated weights for policy 0, policy_version 1748913 (0.0010) [2023-12-28 07:49:52,620][106226] Updated weights for policy 0, policy_version 1748923 (0.0010) [2023-12-28 07:49:52,681][106226] Updated weights for policy 0, policy_version 1748933 (0.0011) [2023-12-28 07:49:52,984][106225] Updated weights for policy 1, policy_version 1753327 (0.0007) [2023-12-28 07:49:53,030][106225] Updated weights for policy 1, policy_version 1753337 (0.0008) [2023-12-28 07:49:53,092][106225] Updated weights for policy 1, policy_version 1753347 (0.0008) [2023-12-28 07:49:53,385][106226] Updated weights for policy 0, policy_version 1748943 (0.0010) [2023-12-28 07:49:53,445][106226] Updated weights for policy 0, policy_version 1748953 (0.0010) [2023-12-28 07:49:53,501][106226] Updated weights for policy 0, policy_version 1748963 (0.0010) [2023-12-28 07:49:53,830][106225] Updated weights for policy 1, policy_version 1753357 (0.0006) [2023-12-28 07:49:53,888][106225] Updated weights for policy 1, policy_version 1753367 (0.0006) [2023-12-28 07:49:53,945][106225] Updated weights for policy 1, policy_version 1753377 (0.0007) [2023-12-28 07:49:54,212][106226] Updated weights for policy 0, policy_version 1748973 (0.0011) [2023-12-28 07:49:54,269][106226] Updated weights for policy 0, policy_version 1748983 (0.0010) [2023-12-28 07:49:54,328][106226] Updated weights for policy 0, policy_version 1748993 (0.0010) [2023-12-28 07:49:54,582][106225] Updated weights for policy 1, policy_version 1753387 (0.0008) [2023-12-28 07:49:54,643][106225] Updated weights for policy 1, policy_version 1753397 (0.0007) [2023-12-28 07:49:54,692][106225] Updated weights for policy 1, policy_version 1753407 (0.0007) [2023-12-28 07:49:55,032][106226] Updated weights for policy 0, policy_version 1749003 (0.0010) [2023-12-28 07:49:55,088][106226] Updated weights for policy 0, policy_version 1749013 (0.0007) [2023-12-28 07:49:55,143][106226] Updated weights for policy 0, policy_version 1749023 (0.0005) [2023-12-28 07:49:55,291][106225] Updated weights for policy 1, policy_version 1753417 (0.0007) [2023-12-28 07:49:55,347][106225] Updated weights for policy 1, policy_version 1753427 (0.0005) [2023-12-28 07:49:55,402][106225] Updated weights for policy 1, policy_version 1753437 (0.0005) [2023-12-28 07:49:55,449][106225] Updated weights for policy 1, policy_version 1753447 (0.0005) [2023-12-28 07:49:55,728][106226] Updated weights for policy 0, policy_version 1749033 (0.0005) [2023-12-28 07:49:55,789][106226] Updated weights for policy 0, policy_version 1749043 (0.0005) [2023-12-28 07:49:55,853][106226] Updated weights for policy 0, policy_version 1749053 (0.0005) [2023-12-28 07:49:55,909][106226] Updated weights for policy 0, policy_version 1749063 (0.0005) [2023-12-28 07:49:56,112][106225] Updated weights for policy 1, policy_version 1753457 (0.0007) [2023-12-28 07:49:56,168][106225] Updated weights for policy 1, policy_version 1753467 (0.0009) [2023-12-28 07:49:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 896778240. Throughput: 0: 9846.9, 1: 10059.0. Samples: 896747060. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:49:56,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-5.103')] [2023-12-28 07:49:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001749064_447840256.pth... [2023-12-28 07:49:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001747912_447545344.pth [2023-12-28 07:49:56,228][106225] Updated weights for policy 1, policy_version 1753477 (0.0008) [2023-12-28 07:49:56,245][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001753480_448946176.pth... [2023-12-28 07:49:56,249][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001752296_448643072.pth [2023-12-28 07:49:56,487][106226] Updated weights for policy 0, policy_version 1749073 (0.0006) [2023-12-28 07:49:56,544][106226] Updated weights for policy 0, policy_version 1749083 (0.0005) [2023-12-28 07:49:56,606][106226] Updated weights for policy 0, policy_version 1749093 (0.0009) [2023-12-28 07:49:56,935][106225] Updated weights for policy 1, policy_version 1753487 (0.0007) [2023-12-28 07:49:56,990][106225] Updated weights for policy 1, policy_version 1753497 (0.0007) [2023-12-28 07:49:57,039][106225] Updated weights for policy 1, policy_version 1753507 (0.0006) [2023-12-28 07:49:57,205][106226] Updated weights for policy 0, policy_version 1749103 (0.0006) [2023-12-28 07:49:57,275][106226] Updated weights for policy 0, policy_version 1749113 (0.0007) [2023-12-28 07:49:57,336][106226] Updated weights for policy 0, policy_version 1749123 (0.0010) [2023-12-28 07:49:57,585][106225] Updated weights for policy 1, policy_version 1753517 (0.0008) [2023-12-28 07:49:57,645][106225] Updated weights for policy 1, policy_version 1753527 (0.0005) [2023-12-28 07:49:57,701][106225] Updated weights for policy 1, policy_version 1753537 (0.0005) [2023-12-28 07:49:57,994][106226] Updated weights for policy 0, policy_version 1749133 (0.0010) [2023-12-28 07:49:58,052][106226] Updated weights for policy 0, policy_version 1749143 (0.0010) [2023-12-28 07:49:58,102][106226] Updated weights for policy 0, policy_version 1749153 (0.0010) [2023-12-28 07:49:58,375][106225] Updated weights for policy 1, policy_version 1753547 (0.0009) [2023-12-28 07:49:58,440][106225] Updated weights for policy 1, policy_version 1753557 (0.0009) [2023-12-28 07:49:58,503][106225] Updated weights for policy 1, policy_version 1753567 (0.0010) [2023-12-28 07:49:58,902][106226] Updated weights for policy 0, policy_version 1749163 (0.0009) [2023-12-28 07:49:58,969][106226] Updated weights for policy 0, policy_version 1749173 (0.0007) [2023-12-28 07:49:59,027][106226] Updated weights for policy 0, policy_version 1749183 (0.0008) [2023-12-28 07:49:59,264][106225] Updated weights for policy 1, policy_version 1753577 (0.0007) [2023-12-28 07:49:59,328][106225] Updated weights for policy 1, policy_version 1753587 (0.0008) [2023-12-28 07:49:59,393][106225] Updated weights for policy 1, policy_version 1753597 (0.0008) [2023-12-28 07:49:59,451][106225] Updated weights for policy 1, policy_version 1753607 (0.0008) [2023-12-28 07:49:59,771][106226] Updated weights for policy 0, policy_version 1749193 (0.0007) [2023-12-28 07:49:59,838][106226] Updated weights for policy 0, policy_version 1749203 (0.0010) [2023-12-28 07:49:59,902][106226] Updated weights for policy 0, policy_version 1749213 (0.0010) [2023-12-28 07:49:59,969][106226] Updated weights for policy 0, policy_version 1749223 (0.0010) [2023-12-28 07:50:00,126][106225] Updated weights for policy 1, policy_version 1753617 (0.0008) [2023-12-28 07:50:00,185][106225] Updated weights for policy 1, policy_version 1753627 (0.0008) [2023-12-28 07:50:00,236][106225] Updated weights for policy 1, policy_version 1753637 (0.0009) [2023-12-28 07:50:00,630][106226] Updated weights for policy 0, policy_version 1749233 (0.0007) [2023-12-28 07:50:00,693][106226] Updated weights for policy 0, policy_version 1749243 (0.0009) [2023-12-28 07:50:00,748][106226] Updated weights for policy 0, policy_version 1749253 (0.0008) [2023-12-28 07:50:00,920][106225] Updated weights for policy 1, policy_version 1753647 (0.0009) [2023-12-28 07:50:00,969][106225] Updated weights for policy 1, policy_version 1753657 (0.0008) [2023-12-28 07:50:01,018][106225] Updated weights for policy 1, policy_version 1753667 (0.0008) [2023-12-28 07:50:01,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 896884736. Throughput: 0: 9920.6, 1: 10122.4. Samples: 896870108. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:50:01,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-4.865')] [2023-12-28 07:50:01,392][106226] Updated weights for policy 0, policy_version 1749263 (0.0007) [2023-12-28 07:50:01,465][106226] Updated weights for policy 0, policy_version 1749273 (0.0007) [2023-12-28 07:50:01,536][106226] Updated weights for policy 0, policy_version 1749283 (0.0006) [2023-12-28 07:50:01,818][106225] Updated weights for policy 1, policy_version 1753677 (0.0008) [2023-12-28 07:50:01,885][106225] Updated weights for policy 1, policy_version 1753687 (0.0009) [2023-12-28 07:50:01,953][106225] Updated weights for policy 1, policy_version 1753697 (0.0009) [2023-12-28 07:50:02,156][106226] Updated weights for policy 0, policy_version 1749293 (0.0007) [2023-12-28 07:50:02,212][106226] Updated weights for policy 0, policy_version 1749303 (0.0009) [2023-12-28 07:50:02,276][106226] Updated weights for policy 0, policy_version 1749313 (0.0008) [2023-12-28 07:50:02,630][106225] Updated weights for policy 1, policy_version 1753707 (0.0009) [2023-12-28 07:50:02,695][106225] Updated weights for policy 1, policy_version 1753717 (0.0006) [2023-12-28 07:50:02,761][106225] Updated weights for policy 1, policy_version 1753727 (0.0006) [2023-12-28 07:50:03,052][106226] Updated weights for policy 0, policy_version 1749323 (0.0007) [2023-12-28 07:50:03,111][106226] Updated weights for policy 0, policy_version 1749333 (0.0007) [2023-12-28 07:50:03,164][106226] Updated weights for policy 0, policy_version 1749343 (0.0007) [2023-12-28 07:50:03,440][106225] Updated weights for policy 1, policy_version 1753737 (0.0010) [2023-12-28 07:50:03,485][106225] Updated weights for policy 1, policy_version 1753747 (0.0010) [2023-12-28 07:50:03,534][106225] Updated weights for policy 1, policy_version 1753757 (0.0010) [2023-12-28 07:50:03,583][106225] Updated weights for policy 1, policy_version 1753767 (0.0010) [2023-12-28 07:50:03,912][106226] Updated weights for policy 0, policy_version 1749353 (0.0007) [2023-12-28 07:50:03,967][106226] Updated weights for policy 0, policy_version 1749363 (0.0008) [2023-12-28 07:50:04,027][106226] Updated weights for policy 0, policy_version 1749373 (0.0010) [2023-12-28 07:50:04,082][106226] Updated weights for policy 0, policy_version 1749383 (0.0009) [2023-12-28 07:50:04,239][106225] Updated weights for policy 1, policy_version 1753777 (0.0009) [2023-12-28 07:50:04,302][106225] Updated weights for policy 1, policy_version 1753787 (0.0011) [2023-12-28 07:50:04,365][106225] Updated weights for policy 1, policy_version 1753797 (0.0011) [2023-12-28 07:50:04,863][106226] Updated weights for policy 0, policy_version 1749393 (0.0008) [2023-12-28 07:50:04,910][106226] Updated weights for policy 0, policy_version 1749403 (0.0007) [2023-12-28 07:50:04,964][106226] Updated weights for policy 0, policy_version 1749413 (0.0008) [2023-12-28 07:50:05,040][106225] Updated weights for policy 1, policy_version 1753807 (0.0010) [2023-12-28 07:50:05,083][106225] Updated weights for policy 1, policy_version 1753817 (0.0010) [2023-12-28 07:50:05,135][106225] Updated weights for policy 1, policy_version 1753827 (0.0010) [2023-12-28 07:50:05,591][106226] Updated weights for policy 0, policy_version 1749423 (0.0009) [2023-12-28 07:50:05,648][106226] Updated weights for policy 0, policy_version 1749433 (0.0009) [2023-12-28 07:50:05,704][106226] Updated weights for policy 0, policy_version 1749443 (0.0009) [2023-12-28 07:50:05,886][106225] Updated weights for policy 1, policy_version 1753837 (0.0009) [2023-12-28 07:50:05,938][106225] Updated weights for policy 1, policy_version 1753847 (0.0009) [2023-12-28 07:50:05,992][106225] Updated weights for policy 1, policy_version 1753857 (0.0008) [2023-12-28 07:50:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 896983040. Throughput: 0: 9989.9, 1: 9995.3. Samples: 896989148. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:50:06,175][105115] Avg episode reward: [(0, '-4.570'), (1, '-4.668')] [2023-12-28 07:50:06,451][106226] Updated weights for policy 0, policy_version 1749453 (0.0008) [2023-12-28 07:50:06,505][106226] Updated weights for policy 0, policy_version 1749463 (0.0007) [2023-12-28 07:50:06,565][106226] Updated weights for policy 0, policy_version 1749473 (0.0008) [2023-12-28 07:50:06,788][106225] Updated weights for policy 1, policy_version 1753867 (0.0009) [2023-12-28 07:50:06,845][106225] Updated weights for policy 1, policy_version 1753877 (0.0008) [2023-12-28 07:50:06,915][106225] Updated weights for policy 1, policy_version 1753887 (0.0010) [2023-12-28 07:50:07,265][106226] Updated weights for policy 0, policy_version 1749483 (0.0008) [2023-12-28 07:50:07,322][106226] Updated weights for policy 0, policy_version 1749493 (0.0009) [2023-12-28 07:50:07,375][106226] Updated weights for policy 0, policy_version 1749503 (0.0009) [2023-12-28 07:50:07,648][106225] Updated weights for policy 1, policy_version 1753897 (0.0008) [2023-12-28 07:50:07,696][106225] Updated weights for policy 1, policy_version 1753907 (0.0008) [2023-12-28 07:50:07,754][106225] Updated weights for policy 1, policy_version 1753917 (0.0008) [2023-12-28 07:50:07,829][106225] Updated weights for policy 1, policy_version 1753927 (0.0008) [2023-12-28 07:50:08,110][106226] Updated weights for policy 0, policy_version 1749513 (0.0009) [2023-12-28 07:50:08,181][106226] Updated weights for policy 0, policy_version 1749523 (0.0010) [2023-12-28 07:50:08,240][106226] Updated weights for policy 0, policy_version 1749533 (0.0009) [2023-12-28 07:50:08,299][106226] Updated weights for policy 0, policy_version 1749543 (0.0008) [2023-12-28 07:50:08,576][106225] Updated weights for policy 1, policy_version 1753937 (0.0006) [2023-12-28 07:50:08,641][106225] Updated weights for policy 1, policy_version 1753947 (0.0005) [2023-12-28 07:50:08,703][106225] Updated weights for policy 1, policy_version 1753957 (0.0005) [2023-12-28 07:50:09,054][106226] Updated weights for policy 0, policy_version 1749553 (0.0009) [2023-12-28 07:50:09,103][106226] Updated weights for policy 0, policy_version 1749563 (0.0008) [2023-12-28 07:50:09,150][106226] Updated weights for policy 0, policy_version 1749573 (0.0009) [2023-12-28 07:50:09,242][106225] Updated weights for policy 1, policy_version 1753967 (0.0008) [2023-12-28 07:50:09,306][106225] Updated weights for policy 1, policy_version 1753977 (0.0007) [2023-12-28 07:50:09,376][106225] Updated weights for policy 1, policy_version 1753987 (0.0008) [2023-12-28 07:50:09,997][106226] Updated weights for policy 0, policy_version 1749583 (0.0009) [2023-12-28 07:50:10,059][106226] Updated weights for policy 0, policy_version 1749593 (0.0008) [2023-12-28 07:50:10,118][106226] Updated weights for policy 0, policy_version 1749603 (0.0009) [2023-12-28 07:50:10,212][106225] Updated weights for policy 1, policy_version 1753997 (0.0009) [2023-12-28 07:50:10,268][106225] Updated weights for policy 1, policy_version 1754007 (0.0009) [2023-12-28 07:50:10,326][106225] Updated weights for policy 1, policy_version 1754017 (0.0008) [2023-12-28 07:50:10,897][106226] Updated weights for policy 0, policy_version 1749613 (0.0009) [2023-12-28 07:50:10,951][106226] Updated weights for policy 0, policy_version 1749623 (0.0008) [2023-12-28 07:50:11,018][106226] Updated weights for policy 0, policy_version 1749633 (0.0009) [2023-12-28 07:50:11,042][106225] Updated weights for policy 1, policy_version 1754027 (0.0008) [2023-12-28 07:50:11,118][106225] Updated weights for policy 1, policy_version 1754037 (0.0008) [2023-12-28 07:50:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 897073152. Throughput: 0: 9917.1, 1: 10011.6. Samples: 897046220. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:50:11,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-5.020')] [2023-12-28 07:50:11,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001749640_447987712.pth... [2023-12-28 07:50:11,188][106225] Updated weights for policy 1, policy_version 1754047 (0.0008) [2023-12-28 07:50:11,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001748488_447692800.pth [2023-12-28 07:50:11,244][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001754056_449093632.pth... [2023-12-28 07:50:11,249][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001752872_448790528.pth [2023-12-28 07:50:11,848][106226] Updated weights for policy 0, policy_version 1749643 (0.0008) [2023-12-28 07:50:11,911][106226] Updated weights for policy 0, policy_version 1749653 (0.0010) [2023-12-28 07:50:11,916][106225] Updated weights for policy 1, policy_version 1754057 (0.0006) [2023-12-28 07:50:11,967][106225] Updated weights for policy 1, policy_version 1754067 (0.0005) [2023-12-28 07:50:11,980][106226] Updated weights for policy 0, policy_version 1749663 (0.0011) [2023-12-28 07:50:12,024][106225] Updated weights for policy 1, policy_version 1754077 (0.0008) [2023-12-28 07:50:12,081][106225] Updated weights for policy 1, policy_version 1754087 (0.0008) [2023-12-28 07:50:12,667][106226] Updated weights for policy 0, policy_version 1749673 (0.0008) [2023-12-28 07:50:12,724][106226] Updated weights for policy 0, policy_version 1749683 (0.0008) [2023-12-28 07:50:12,782][106226] Updated weights for policy 0, policy_version 1749693 (0.0006) [2023-12-28 07:50:12,845][106226] Updated weights for policy 0, policy_version 1749703 (0.0006) [2023-12-28 07:50:12,856][106225] Updated weights for policy 1, policy_version 1754097 (0.0008) [2023-12-28 07:50:12,910][106225] Updated weights for policy 1, policy_version 1754107 (0.0006) [2023-12-28 07:50:12,967][106225] Updated weights for policy 1, policy_version 1754117 (0.0006) [2023-12-28 07:50:13,548][106226] Updated weights for policy 0, policy_version 1749713 (0.0008) [2023-12-28 07:50:13,591][106225] Updated weights for policy 1, policy_version 1754127 (0.0008) [2023-12-28 07:50:13,601][106226] Updated weights for policy 0, policy_version 1749723 (0.0005) [2023-12-28 07:50:13,645][106225] Updated weights for policy 1, policy_version 1754137 (0.0010) [2023-12-28 07:50:13,653][106226] Updated weights for policy 0, policy_version 1749733 (0.0006) [2023-12-28 07:50:13,701][106225] Updated weights for policy 1, policy_version 1754147 (0.0010) [2023-12-28 07:50:14,196][106226] Updated weights for policy 0, policy_version 1749743 (0.0006) [2023-12-28 07:50:14,251][106226] Updated weights for policy 0, policy_version 1749753 (0.0008) [2023-12-28 07:50:14,297][106226] Updated weights for policy 0, policy_version 1749763 (0.0007) [2023-12-28 07:50:14,426][106225] Updated weights for policy 1, policy_version 1754157 (0.0010) [2023-12-28 07:50:14,484][106225] Updated weights for policy 1, policy_version 1754167 (0.0010) [2023-12-28 07:50:14,544][106225] Updated weights for policy 1, policy_version 1754177 (0.0010) [2023-12-28 07:50:14,991][106226] Updated weights for policy 0, policy_version 1749773 (0.0008) [2023-12-28 07:50:15,056][106226] Updated weights for policy 0, policy_version 1749783 (0.0007) [2023-12-28 07:50:15,123][106226] Updated weights for policy 0, policy_version 1749793 (0.0008) [2023-12-28 07:50:15,328][106225] Updated weights for policy 1, policy_version 1754187 (0.0010) [2023-12-28 07:50:15,383][106225] Updated weights for policy 1, policy_version 1754197 (0.0008) [2023-12-28 07:50:15,438][106225] Updated weights for policy 1, policy_version 1754207 (0.0008) [2023-12-28 07:50:15,802][106226] Updated weights for policy 0, policy_version 1749803 (0.0006) [2023-12-28 07:50:15,863][106226] Updated weights for policy 0, policy_version 1749813 (0.0008) [2023-12-28 07:50:15,919][106226] Updated weights for policy 0, policy_version 1749823 (0.0009) [2023-12-28 07:50:16,147][106225] Updated weights for policy 1, policy_version 1754217 (0.0008) [2023-12-28 07:50:16,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 897171456. Throughput: 0: 9873.1, 1: 9886.9. Samples: 897162192. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:50:16,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-5.052')] [2023-12-28 07:50:16,195][106225] Updated weights for policy 1, policy_version 1754227 (0.0007) [2023-12-28 07:50:16,242][106225] Updated weights for policy 1, policy_version 1754237 (0.0007) [2023-12-28 07:50:16,293][106225] Updated weights for policy 1, policy_version 1754248 (0.0007) [2023-12-28 07:50:16,469][106226] Updated weights for policy 0, policy_version 1749833 (0.0007) [2023-12-28 07:50:16,530][106226] Updated weights for policy 0, policy_version 1749843 (0.0008) [2023-12-28 07:50:16,580][106226] Updated weights for policy 0, policy_version 1749853 (0.0005) [2023-12-28 07:50:16,637][106226] Updated weights for policy 0, policy_version 1749863 (0.0007) [2023-12-28 07:50:17,054][106225] Updated weights for policy 1, policy_version 1754258 (0.0008) [2023-12-28 07:50:17,118][106225] Updated weights for policy 1, policy_version 1754268 (0.0008) [2023-12-28 07:50:17,184][106225] Updated weights for policy 1, policy_version 1754278 (0.0008) [2023-12-28 07:50:17,366][106226] Updated weights for policy 0, policy_version 1749873 (0.0008) [2023-12-28 07:50:17,425][106226] Updated weights for policy 0, policy_version 1749883 (0.0006) [2023-12-28 07:50:17,481][106226] Updated weights for policy 0, policy_version 1749893 (0.0010) [2023-12-28 07:50:17,894][106225] Updated weights for policy 1, policy_version 1754288 (0.0006) [2023-12-28 07:50:17,941][106225] Updated weights for policy 1, policy_version 1754298 (0.0005) [2023-12-28 07:50:17,992][106225] Updated weights for policy 1, policy_version 1754308 (0.0005) [2023-12-28 07:50:18,152][106226] Updated weights for policy 0, policy_version 1749903 (0.0011) [2023-12-28 07:50:18,213][106226] Updated weights for policy 0, policy_version 1749913 (0.0011) [2023-12-28 07:50:18,276][106226] Updated weights for policy 0, policy_version 1749923 (0.0011) [2023-12-28 07:50:18,622][106225] Updated weights for policy 1, policy_version 1754318 (0.0009) [2023-12-28 07:50:18,687][106225] Updated weights for policy 1, policy_version 1754328 (0.0010) [2023-12-28 07:50:18,750][106225] Updated weights for policy 1, policy_version 1754338 (0.0010) [2023-12-28 07:50:19,009][106226] Updated weights for policy 0, policy_version 1749933 (0.0011) [2023-12-28 07:50:19,070][106226] Updated weights for policy 0, policy_version 1749943 (0.0011) [2023-12-28 07:50:19,136][106226] Updated weights for policy 0, policy_version 1749953 (0.0011) [2023-12-28 07:50:19,350][106225] Updated weights for policy 1, policy_version 1754348 (0.0010) [2023-12-28 07:50:19,407][106225] Updated weights for policy 1, policy_version 1754358 (0.0010) [2023-12-28 07:50:19,473][106225] Updated weights for policy 1, policy_version 1754368 (0.0008) [2023-12-28 07:50:19,800][106226] Updated weights for policy 0, policy_version 1749963 (0.0010) [2023-12-28 07:50:19,867][106226] Updated weights for policy 0, policy_version 1749973 (0.0009) [2023-12-28 07:50:19,931][106226] Updated weights for policy 0, policy_version 1749983 (0.0008) [2023-12-28 07:50:20,202][106225] Updated weights for policy 1, policy_version 1754378 (0.0011) [2023-12-28 07:50:20,265][106225] Updated weights for policy 1, policy_version 1754388 (0.0011) [2023-12-28 07:50:20,331][106225] Updated weights for policy 1, policy_version 1754398 (0.0011) [2023-12-28 07:50:20,395][106225] Updated weights for policy 1, policy_version 1754408 (0.0010) [2023-12-28 07:50:20,691][106226] Updated weights for policy 0, policy_version 1749993 (0.0009) [2023-12-28 07:50:20,749][106226] Updated weights for policy 0, policy_version 1750003 (0.0011) [2023-12-28 07:50:20,810][106226] Updated weights for policy 0, policy_version 1750013 (0.0011) [2023-12-28 07:50:20,868][106226] Updated weights for policy 0, policy_version 1750023 (0.0010) [2023-12-28 07:50:21,021][106225] Updated weights for policy 1, policy_version 1754418 (0.0007) [2023-12-28 07:50:21,084][106225] Updated weights for policy 1, policy_version 1754428 (0.0007) [2023-12-28 07:50:21,153][106225] Updated weights for policy 1, policy_version 1754438 (0.0008) [2023-12-28 07:50:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 897277952. Throughput: 0: 9883.7, 1: 9910.1. Samples: 897281648. Policy #0 lag: (min: 28.0, avg: 41.4, max: 60.0) [2023-12-28 07:50:21,175][105115] Avg episode reward: [(0, '-4.684'), (1, '-4.804')] [2023-12-28 07:50:21,663][106226] Updated weights for policy 0, policy_version 1750033 (0.0008) [2023-12-28 07:50:21,727][106226] Updated weights for policy 0, policy_version 1750043 (0.0008) [2023-12-28 07:50:21,793][106226] Updated weights for policy 0, policy_version 1750053 (0.0008) [2023-12-28 07:50:21,842][106225] Updated weights for policy 1, policy_version 1754448 (0.0007) [2023-12-28 07:50:21,900][106225] Updated weights for policy 1, policy_version 1754458 (0.0008) [2023-12-28 07:50:21,954][106225] Updated weights for policy 1, policy_version 1754468 (0.0007) [2023-12-28 07:50:22,575][106226] Updated weights for policy 0, policy_version 1750063 (0.0010) [2023-12-28 07:50:22,641][106226] Updated weights for policy 0, policy_version 1750073 (0.0011) [2023-12-28 07:50:22,704][106226] Updated weights for policy 0, policy_version 1750083 (0.0008) [2023-12-28 07:50:22,714][106225] Updated weights for policy 1, policy_version 1754478 (0.0008) [2023-12-28 07:50:22,774][106225] Updated weights for policy 1, policy_version 1754488 (0.0010) [2023-12-28 07:50:22,833][106225] Updated weights for policy 1, policy_version 1754498 (0.0010) [2023-12-28 07:50:23,381][106226] Updated weights for policy 0, policy_version 1750093 (0.0009) [2023-12-28 07:50:23,442][106226] Updated weights for policy 0, policy_version 1750103 (0.0011) [2023-12-28 07:50:23,468][106225] Updated weights for policy 1, policy_version 1754508 (0.0008) [2023-12-28 07:50:23,500][106226] Updated weights for policy 0, policy_version 1750113 (0.0011) [2023-12-28 07:50:23,520][106225] Updated weights for policy 1, policy_version 1754518 (0.0007) [2023-12-28 07:50:23,581][106225] Updated weights for policy 1, policy_version 1754528 (0.0007) [2023-12-28 07:50:24,133][106226] Updated weights for policy 0, policy_version 1750123 (0.0009) [2023-12-28 07:50:24,193][106226] Updated weights for policy 0, policy_version 1750133 (0.0005) [2023-12-28 07:50:24,239][106225] Updated weights for policy 1, policy_version 1754538 (0.0005) [2023-12-28 07:50:24,241][106226] Updated weights for policy 0, policy_version 1750143 (0.0005) [2023-12-28 07:50:24,290][106225] Updated weights for policy 1, policy_version 1754548 (0.0005) [2023-12-28 07:50:24,349][106225] Updated weights for policy 1, policy_version 1754558 (0.0005) [2023-12-28 07:50:24,407][106225] Updated weights for policy 1, policy_version 1754568 (0.0007) [2023-12-28 07:50:24,912][106226] Updated weights for policy 0, policy_version 1750153 (0.0006) [2023-12-28 07:50:24,959][106225] Updated weights for policy 1, policy_version 1754578 (0.0006) [2023-12-28 07:50:24,969][106226] Updated weights for policy 0, policy_version 1750163 (0.0010) [2023-12-28 07:50:25,019][106226] Updated weights for policy 0, policy_version 1750173 (0.0010) [2023-12-28 07:50:25,021][106225] Updated weights for policy 1, policy_version 1754588 (0.0006) [2023-12-28 07:50:25,073][106225] Updated weights for policy 1, policy_version 1754598 (0.0007) [2023-12-28 07:50:25,076][106226] Updated weights for policy 0, policy_version 1750183 (0.0006) [2023-12-28 07:50:25,682][106226] Updated weights for policy 0, policy_version 1750193 (0.0008) [2023-12-28 07:50:25,735][106226] Updated weights for policy 0, policy_version 1750203 (0.0010) [2023-12-28 07:50:25,784][106226] Updated weights for policy 0, policy_version 1750213 (0.0006) [2023-12-28 07:50:25,813][106225] Updated weights for policy 1, policy_version 1754608 (0.0006) [2023-12-28 07:50:25,862][106225] Updated weights for policy 1, policy_version 1754618 (0.0005) [2023-12-28 07:50:25,907][106225] Updated weights for policy 1, policy_version 1754628 (0.0007) [2023-12-28 07:50:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 897376256. Throughput: 0: 9858.1, 1: 9954.7. Samples: 897340972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:26,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.823')] [2023-12-28 07:50:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001754632_449241088.pth... [2023-12-28 07:50:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001750216_448135168.pth... [2023-12-28 07:50:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001749064_447840256.pth [2023-12-28 07:50:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001753480_448946176.pth [2023-12-28 07:50:26,506][106226] Updated weights for policy 0, policy_version 1750223 (0.0006) [2023-12-28 07:50:26,529][106225] Updated weights for policy 1, policy_version 1754638 (0.0008) [2023-12-28 07:50:26,561][106226] Updated weights for policy 0, policy_version 1750233 (0.0006) [2023-12-28 07:50:26,581][106225] Updated weights for policy 1, policy_version 1754648 (0.0007) [2023-12-28 07:50:26,609][106226] Updated weights for policy 0, policy_version 1750243 (0.0005) [2023-12-28 07:50:26,628][106225] Updated weights for policy 1, policy_version 1754658 (0.0008) [2023-12-28 07:50:27,164][106226] Updated weights for policy 0, policy_version 1750253 (0.0005) [2023-12-28 07:50:27,218][106226] Updated weights for policy 0, policy_version 1750263 (0.0005) [2023-12-28 07:50:27,245][106225] Updated weights for policy 1, policy_version 1754668 (0.0007) [2023-12-28 07:50:27,270][106226] Updated weights for policy 0, policy_version 1750273 (0.0005) [2023-12-28 07:50:27,297][106225] Updated weights for policy 1, policy_version 1754678 (0.0006) [2023-12-28 07:50:27,346][106225] Updated weights for policy 1, policy_version 1754688 (0.0007) [2023-12-28 07:50:27,943][106225] Updated weights for policy 1, policy_version 1754698 (0.0006) [2023-12-28 07:50:27,984][106226] Updated weights for policy 0, policy_version 1750283 (0.0007) [2023-12-28 07:50:27,998][106225] Updated weights for policy 1, policy_version 1754708 (0.0007) [2023-12-28 07:50:28,032][106226] Updated weights for policy 0, policy_version 1750293 (0.0006) [2023-12-28 07:50:28,042][106225] Updated weights for policy 1, policy_version 1754718 (0.0006) [2023-12-28 07:50:28,085][106226] Updated weights for policy 0, policy_version 1750303 (0.0007) [2023-12-28 07:50:28,090][106225] Updated weights for policy 1, policy_version 1754728 (0.0008) [2023-12-28 07:50:28,805][106226] Updated weights for policy 0, policy_version 1750313 (0.0008) [2023-12-28 07:50:28,824][106225] Updated weights for policy 1, policy_version 1754738 (0.0008) [2023-12-28 07:50:28,865][106226] Updated weights for policy 0, policy_version 1750323 (0.0009) [2023-12-28 07:50:28,878][106225] Updated weights for policy 1, policy_version 1754748 (0.0007) [2023-12-28 07:50:28,919][106226] Updated weights for policy 0, policy_version 1750333 (0.0006) [2023-12-28 07:50:28,936][106225] Updated weights for policy 1, policy_version 1754758 (0.0009) [2023-12-28 07:50:28,979][106226] Updated weights for policy 0, policy_version 1750343 (0.0007) [2023-12-28 07:50:29,656][106226] Updated weights for policy 0, policy_version 1750353 (0.0008) [2023-12-28 07:50:29,672][106225] Updated weights for policy 1, policy_version 1754768 (0.0007) [2023-12-28 07:50:29,716][106226] Updated weights for policy 0, policy_version 1750363 (0.0008) [2023-12-28 07:50:29,731][106225] Updated weights for policy 1, policy_version 1754778 (0.0006) [2023-12-28 07:50:29,775][106226] Updated weights for policy 0, policy_version 1750373 (0.0007) [2023-12-28 07:50:29,787][106225] Updated weights for policy 1, policy_version 1754788 (0.0008) [2023-12-28 07:50:30,477][106225] Updated weights for policy 1, policy_version 1754798 (0.0009) [2023-12-28 07:50:30,510][106226] Updated weights for policy 0, policy_version 1750383 (0.0006) [2023-12-28 07:50:30,534][106225] Updated weights for policy 1, policy_version 1754808 (0.0008) [2023-12-28 07:50:30,580][106226] Updated weights for policy 0, policy_version 1750393 (0.0005) [2023-12-28 07:50:30,590][106225] Updated weights for policy 1, policy_version 1754818 (0.0008) [2023-12-28 07:50:30,645][106226] Updated weights for policy 0, policy_version 1750403 (0.0005) [2023-12-28 07:50:31,172][106226] Updated weights for policy 0, policy_version 1750413 (0.0007) [2023-12-28 07:50:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 897474560. Throughput: 0: 9965.2, 1: 10049.2. Samples: 897466704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:31,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-5.127')] [2023-12-28 07:50:31,214][106225] Updated weights for policy 1, policy_version 1754828 (0.0007) [2023-12-28 07:50:31,239][106226] Updated weights for policy 0, policy_version 1750423 (0.0008) [2023-12-28 07:50:31,273][106225] Updated weights for policy 1, policy_version 1754838 (0.0007) [2023-12-28 07:50:31,307][106226] Updated weights for policy 0, policy_version 1750433 (0.0009) [2023-12-28 07:50:31,325][106225] Updated weights for policy 1, policy_version 1754848 (0.0005) [2023-12-28 07:50:32,024][106225] Updated weights for policy 1, policy_version 1754858 (0.0009) [2023-12-28 07:50:32,069][106226] Updated weights for policy 0, policy_version 1750443 (0.0008) [2023-12-28 07:50:32,089][106225] Updated weights for policy 1, policy_version 1754868 (0.0006) [2023-12-28 07:50:32,127][106226] Updated weights for policy 0, policy_version 1750453 (0.0007) [2023-12-28 07:50:32,145][106225] Updated weights for policy 1, policy_version 1754878 (0.0006) [2023-12-28 07:50:32,189][106226] Updated weights for policy 0, policy_version 1750463 (0.0008) [2023-12-28 07:50:32,199][106225] Updated weights for policy 1, policy_version 1754888 (0.0008) [2023-12-28 07:50:32,867][106225] Updated weights for policy 1, policy_version 1754898 (0.0005) [2023-12-28 07:50:32,889][106226] Updated weights for policy 0, policy_version 1750473 (0.0007) [2023-12-28 07:50:32,923][106225] Updated weights for policy 1, policy_version 1754908 (0.0006) [2023-12-28 07:50:32,947][106226] Updated weights for policy 0, policy_version 1750483 (0.0009) [2023-12-28 07:50:32,978][106225] Updated weights for policy 1, policy_version 1754918 (0.0006) [2023-12-28 07:50:33,003][106226] Updated weights for policy 0, policy_version 1750493 (0.0008) [2023-12-28 07:50:33,061][106226] Updated weights for policy 0, policy_version 1750503 (0.0008) [2023-12-28 07:50:33,565][106225] Updated weights for policy 1, policy_version 1754928 (0.0008) [2023-12-28 07:50:33,622][106225] Updated weights for policy 1, policy_version 1754938 (0.0008) [2023-12-28 07:50:33,681][106225] Updated weights for policy 1, policy_version 1754948 (0.0008) [2023-12-28 07:50:33,781][106226] Updated weights for policy 0, policy_version 1750513 (0.0006) [2023-12-28 07:50:33,832][106226] Updated weights for policy 0, policy_version 1750523 (0.0005) [2023-12-28 07:50:33,886][106226] Updated weights for policy 0, policy_version 1750533 (0.0005) [2023-12-28 07:50:34,463][106225] Updated weights for policy 1, policy_version 1754958 (0.0007) [2023-12-28 07:50:34,526][106225] Updated weights for policy 1, policy_version 1754968 (0.0008) [2023-12-28 07:50:34,590][106225] Updated weights for policy 1, policy_version 1754978 (0.0008) [2023-12-28 07:50:34,652][106226] Updated weights for policy 0, policy_version 1750543 (0.0006) [2023-12-28 07:50:34,720][106226] Updated weights for policy 0, policy_version 1750553 (0.0006) [2023-12-28 07:50:34,781][106226] Updated weights for policy 0, policy_version 1750563 (0.0008) [2023-12-28 07:50:35,283][106225] Updated weights for policy 1, policy_version 1754988 (0.0009) [2023-12-28 07:50:35,334][106225] Updated weights for policy 1, policy_version 1754998 (0.0007) [2023-12-28 07:50:35,351][106226] Updated weights for policy 0, policy_version 1750573 (0.0007) [2023-12-28 07:50:35,388][106225] Updated weights for policy 1, policy_version 1755008 (0.0005) [2023-12-28 07:50:35,413][106226] Updated weights for policy 0, policy_version 1750583 (0.0005) [2023-12-28 07:50:35,478][106226] Updated weights for policy 0, policy_version 1750593 (0.0005) [2023-12-28 07:50:36,015][106226] Updated weights for policy 0, policy_version 1750603 (0.0005) [2023-12-28 07:50:36,081][106225] Updated weights for policy 1, policy_version 1755018 (0.0006) [2023-12-28 07:50:36,086][106226] Updated weights for policy 0, policy_version 1750613 (0.0005) [2023-12-28 07:50:36,151][106225] Updated weights for policy 1, policy_version 1755028 (0.0009) [2023-12-28 07:50:36,153][106226] Updated weights for policy 0, policy_version 1750623 (0.0009) [2023-12-28 07:50:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 897572864. Throughput: 0: 9986.0, 1: 10053.3. Samples: 897590020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:36,175][105115] Avg episode reward: [(0, '-4.499'), (1, '-4.734')] [2023-12-28 07:50:36,215][106225] Updated weights for policy 1, policy_version 1755038 (0.0008) [2023-12-28 07:50:36,282][106225] Updated weights for policy 1, policy_version 1755048 (0.0009) [2023-12-28 07:50:36,762][106226] Updated weights for policy 0, policy_version 1750633 (0.0007) [2023-12-28 07:50:36,830][106226] Updated weights for policy 0, policy_version 1750643 (0.0006) [2023-12-28 07:50:36,891][106226] Updated weights for policy 0, policy_version 1750653 (0.0007) [2023-12-28 07:50:36,937][106226] Updated weights for policy 0, policy_version 1750663 (0.0005) [2023-12-28 07:50:37,033][106225] Updated weights for policy 1, policy_version 1755058 (0.0009) [2023-12-28 07:50:37,095][106225] Updated weights for policy 1, policy_version 1755068 (0.0009) [2023-12-28 07:50:37,160][106225] Updated weights for policy 1, policy_version 1755078 (0.0009) [2023-12-28 07:50:37,551][106226] Updated weights for policy 0, policy_version 1750673 (0.0008) [2023-12-28 07:50:37,609][106226] Updated weights for policy 0, policy_version 1750683 (0.0006) [2023-12-28 07:50:37,674][106226] Updated weights for policy 0, policy_version 1750693 (0.0008) [2023-12-28 07:50:37,905][106225] Updated weights for policy 1, policy_version 1755088 (0.0009) [2023-12-28 07:50:37,970][106225] Updated weights for policy 1, policy_version 1755098 (0.0008) [2023-12-28 07:50:38,024][106225] Updated weights for policy 1, policy_version 1755108 (0.0008) [2023-12-28 07:50:38,330][106226] Updated weights for policy 0, policy_version 1750703 (0.0009) [2023-12-28 07:50:38,390][106226] Updated weights for policy 0, policy_version 1750713 (0.0010) [2023-12-28 07:50:38,454][106226] Updated weights for policy 0, policy_version 1750723 (0.0010) [2023-12-28 07:50:38,692][106225] Updated weights for policy 1, policy_version 1755118 (0.0006) [2023-12-28 07:50:38,755][106225] Updated weights for policy 1, policy_version 1755128 (0.0007) [2023-12-28 07:50:38,816][106225] Updated weights for policy 1, policy_version 1755138 (0.0009) [2023-12-28 07:50:39,142][106226] Updated weights for policy 0, policy_version 1750733 (0.0009) [2023-12-28 07:50:39,198][106226] Updated weights for policy 0, policy_version 1750743 (0.0007) [2023-12-28 07:50:39,260][106226] Updated weights for policy 0, policy_version 1750753 (0.0009) [2023-12-28 07:50:39,535][106225] Updated weights for policy 1, policy_version 1755148 (0.0007) [2023-12-28 07:50:39,584][106225] Updated weights for policy 1, policy_version 1755158 (0.0008) [2023-12-28 07:50:39,636][106225] Updated weights for policy 1, policy_version 1755168 (0.0008) [2023-12-28 07:50:39,999][106226] Updated weights for policy 0, policy_version 1750763 (0.0007) [2023-12-28 07:50:40,063][106226] Updated weights for policy 0, policy_version 1750773 (0.0009) [2023-12-28 07:50:40,127][106226] Updated weights for policy 0, policy_version 1750783 (0.0008) [2023-12-28 07:50:40,384][106225] Updated weights for policy 1, policy_version 1755178 (0.0009) [2023-12-28 07:50:40,443][106225] Updated weights for policy 1, policy_version 1755188 (0.0009) [2023-12-28 07:50:40,503][106225] Updated weights for policy 1, policy_version 1755198 (0.0008) [2023-12-28 07:50:40,565][106225] Updated weights for policy 1, policy_version 1755208 (0.0008) [2023-12-28 07:50:40,856][106226] Updated weights for policy 0, policy_version 1750793 (0.0009) [2023-12-28 07:50:40,910][106226] Updated weights for policy 0, policy_version 1750803 (0.0010) [2023-12-28 07:50:40,970][106226] Updated weights for policy 0, policy_version 1750813 (0.0007) [2023-12-28 07:50:41,034][106226] Updated weights for policy 0, policy_version 1750823 (0.0008) [2023-12-28 07:50:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 897679360. Throughput: 0: 10038.2, 1: 10040.0. Samples: 897650580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:41,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-4.981')] [2023-12-28 07:50:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001750824_448290816.pth... [2023-12-28 07:50:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001755208_449388544.pth... [2023-12-28 07:50:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001754056_449093632.pth [2023-12-28 07:50:41,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001749640_447987712.pth [2023-12-28 07:50:41,272][106225] Updated weights for policy 1, policy_version 1755218 (0.0008) [2023-12-28 07:50:41,337][106225] Updated weights for policy 1, policy_version 1755228 (0.0008) [2023-12-28 07:50:41,405][106225] Updated weights for policy 1, policy_version 1755238 (0.0007) [2023-12-28 07:50:41,816][106226] Updated weights for policy 0, policy_version 1750833 (0.0009) [2023-12-28 07:50:41,875][106226] Updated weights for policy 0, policy_version 1750843 (0.0009) [2023-12-28 07:50:41,931][106226] Updated weights for policy 0, policy_version 1750853 (0.0009) [2023-12-28 07:50:42,139][106225] Updated weights for policy 1, policy_version 1755248 (0.0009) [2023-12-28 07:50:42,203][106225] Updated weights for policy 1, policy_version 1755258 (0.0008) [2023-12-28 07:50:42,267][106225] Updated weights for policy 1, policy_version 1755268 (0.0008) [2023-12-28 07:50:42,643][106226] Updated weights for policy 0, policy_version 1750863 (0.0009) [2023-12-28 07:50:42,704][106226] Updated weights for policy 0, policy_version 1750873 (0.0009) [2023-12-28 07:50:42,761][106226] Updated weights for policy 0, policy_version 1750883 (0.0009) [2023-12-28 07:50:43,033][106225] Updated weights for policy 1, policy_version 1755278 (0.0008) [2023-12-28 07:50:43,086][106225] Updated weights for policy 1, policy_version 1755288 (0.0006) [2023-12-28 07:50:43,139][106225] Updated weights for policy 1, policy_version 1755298 (0.0005) [2023-12-28 07:50:43,461][106226] Updated weights for policy 0, policy_version 1750893 (0.0008) [2023-12-28 07:50:43,511][106226] Updated weights for policy 0, policy_version 1750903 (0.0009) [2023-12-28 07:50:43,564][106226] Updated weights for policy 0, policy_version 1750913 (0.0009) [2023-12-28 07:50:43,867][106225] Updated weights for policy 1, policy_version 1755308 (0.0008) [2023-12-28 07:50:43,918][106225] Updated weights for policy 1, policy_version 1755318 (0.0008) [2023-12-28 07:50:43,975][106225] Updated weights for policy 1, policy_version 1755328 (0.0008) [2023-12-28 07:50:44,249][106226] Updated weights for policy 0, policy_version 1750923 (0.0007) [2023-12-28 07:50:44,304][106226] Updated weights for policy 0, policy_version 1750933 (0.0008) [2023-12-28 07:50:44,359][106226] Updated weights for policy 0, policy_version 1750943 (0.0009) [2023-12-28 07:50:44,593][106225] Updated weights for policy 1, policy_version 1755338 (0.0008) [2023-12-28 07:50:44,654][106225] Updated weights for policy 1, policy_version 1755348 (0.0008) [2023-12-28 07:50:44,719][106225] Updated weights for policy 1, policy_version 1755358 (0.0008) [2023-12-28 07:50:44,790][106225] Updated weights for policy 1, policy_version 1755368 (0.0009) [2023-12-28 07:50:45,128][106226] Updated weights for policy 0, policy_version 1750953 (0.0010) [2023-12-28 07:50:45,179][106226] Updated weights for policy 0, policy_version 1750963 (0.0009) [2023-12-28 07:50:45,231][106226] Updated weights for policy 0, policy_version 1750973 (0.0008) [2023-12-28 07:50:45,280][106226] Updated weights for policy 0, policy_version 1750983 (0.0008) [2023-12-28 07:50:45,339][106225] Updated weights for policy 1, policy_version 1755378 (0.0005) [2023-12-28 07:50:45,394][106225] Updated weights for policy 1, policy_version 1755388 (0.0006) [2023-12-28 07:50:45,450][106225] Updated weights for policy 1, policy_version 1755398 (0.0008) [2023-12-28 07:50:46,008][106225] Updated weights for policy 1, policy_version 1755408 (0.0006) [2023-12-28 07:50:46,068][106225] Updated weights for policy 1, policy_version 1755418 (0.0008) [2023-12-28 07:50:46,121][106225] Updated weights for policy 1, policy_version 1755428 (0.0008) [2023-12-28 07:50:46,121][106226] Updated weights for policy 0, policy_version 1750993 (0.0007) [2023-12-28 07:50:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 897777664. Throughput: 0: 9948.3, 1: 9944.8. Samples: 897765296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:46,175][105115] Avg episode reward: [(0, '-4.128'), (1, '-4.898')] [2023-12-28 07:50:46,183][106226] Updated weights for policy 0, policy_version 1751003 (0.0007) [2023-12-28 07:50:46,245][106226] Updated weights for policy 0, policy_version 1751013 (0.0008) [2023-12-28 07:50:46,693][106225] Updated weights for policy 1, policy_version 1755438 (0.0008) [2023-12-28 07:50:46,759][106225] Updated weights for policy 1, policy_version 1755448 (0.0005) [2023-12-28 07:50:46,816][106225] Updated weights for policy 1, policy_version 1755458 (0.0007) [2023-12-28 07:50:46,992][106226] Updated weights for policy 0, policy_version 1751023 (0.0007) [2023-12-28 07:50:47,053][106226] Updated weights for policy 0, policy_version 1751033 (0.0010) [2023-12-28 07:50:47,109][106226] Updated weights for policy 0, policy_version 1751043 (0.0010) [2023-12-28 07:50:47,486][106225] Updated weights for policy 1, policy_version 1755468 (0.0009) [2023-12-28 07:50:47,552][106225] Updated weights for policy 1, policy_version 1755478 (0.0010) [2023-12-28 07:50:47,616][106225] Updated weights for policy 1, policy_version 1755488 (0.0006) [2023-12-28 07:50:47,742][106226] Updated weights for policy 0, policy_version 1751053 (0.0010) [2023-12-28 07:50:47,788][106226] Updated weights for policy 0, policy_version 1751063 (0.0010) [2023-12-28 07:50:47,842][106226] Updated weights for policy 0, policy_version 1751073 (0.0005) [2023-12-28 07:50:48,248][106225] Updated weights for policy 1, policy_version 1755498 (0.0005) [2023-12-28 07:50:48,299][106225] Updated weights for policy 1, policy_version 1755508 (0.0010) [2023-12-28 07:50:48,360][106225] Updated weights for policy 1, policy_version 1755518 (0.0009) [2023-12-28 07:50:48,423][106225] Updated weights for policy 1, policy_version 1755528 (0.0008) [2023-12-28 07:50:48,523][106226] Updated weights for policy 0, policy_version 1751083 (0.0005) [2023-12-28 07:50:48,582][106226] Updated weights for policy 0, policy_version 1751093 (0.0009) [2023-12-28 07:50:48,643][106226] Updated weights for policy 0, policy_version 1751103 (0.0009) [2023-12-28 07:50:49,085][106225] Updated weights for policy 1, policy_version 1755538 (0.0008) [2023-12-28 07:50:49,140][106225] Updated weights for policy 1, policy_version 1755548 (0.0008) [2023-12-28 07:50:49,211][106225] Updated weights for policy 1, policy_version 1755558 (0.0008) [2023-12-28 07:50:49,374][106226] Updated weights for policy 0, policy_version 1751113 (0.0010) [2023-12-28 07:50:49,441][106226] Updated weights for policy 0, policy_version 1751123 (0.0008) [2023-12-28 07:50:49,500][106226] Updated weights for policy 0, policy_version 1751133 (0.0005) [2023-12-28 07:50:49,570][106226] Updated weights for policy 0, policy_version 1751143 (0.0005) [2023-12-28 07:50:50,018][106225] Updated weights for policy 1, policy_version 1755568 (0.0007) [2023-12-28 07:50:50,069][106225] Updated weights for policy 1, policy_version 1755578 (0.0008) [2023-12-28 07:50:50,117][106225] Updated weights for policy 1, policy_version 1755588 (0.0008) [2023-12-28 07:50:50,195][106226] Updated weights for policy 0, policy_version 1751153 (0.0010) [2023-12-28 07:50:50,262][106226] Updated weights for policy 0, policy_version 1751163 (0.0011) [2023-12-28 07:50:50,313][106226] Updated weights for policy 0, policy_version 1751173 (0.0010) [2023-12-28 07:50:50,927][106225] Updated weights for policy 1, policy_version 1755598 (0.0009) [2023-12-28 07:50:50,946][106226] Updated weights for policy 0, policy_version 1751183 (0.0009) [2023-12-28 07:50:50,989][106225] Updated weights for policy 1, policy_version 1755608 (0.0007) [2023-12-28 07:50:51,010][106226] Updated weights for policy 0, policy_version 1751193 (0.0009) [2023-12-28 07:50:51,051][106225] Updated weights for policy 1, policy_version 1755618 (0.0006) [2023-12-28 07:50:51,074][106226] Updated weights for policy 0, policy_version 1751203 (0.0008) [2023-12-28 07:50:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 897884160. Throughput: 0: 9942.4, 1: 10012.5. Samples: 897887120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:51,175][105115] Avg episode reward: [(0, '-4.302'), (1, '-4.901')] [2023-12-28 07:50:51,795][106226] Updated weights for policy 0, policy_version 1751213 (0.0009) [2023-12-28 07:50:51,846][106226] Updated weights for policy 0, policy_version 1751223 (0.0007) [2023-12-28 07:50:51,860][106225] Updated weights for policy 1, policy_version 1755628 (0.0007) [2023-12-28 07:50:51,898][106226] Updated weights for policy 0, policy_version 1751233 (0.0008) [2023-12-28 07:50:51,926][106225] Updated weights for policy 1, policy_version 1755638 (0.0007) [2023-12-28 07:50:51,988][106225] Updated weights for policy 1, policy_version 1755648 (0.0008) [2023-12-28 07:50:52,617][106226] Updated weights for policy 0, policy_version 1751243 (0.0008) [2023-12-28 07:50:52,674][106226] Updated weights for policy 0, policy_version 1751253 (0.0010) [2023-12-28 07:50:52,695][106225] Updated weights for policy 1, policy_version 1755658 (0.0008) [2023-12-28 07:50:52,735][106226] Updated weights for policy 0, policy_version 1751263 (0.0011) [2023-12-28 07:50:52,757][106225] Updated weights for policy 1, policy_version 1755668 (0.0005) [2023-12-28 07:50:52,807][106225] Updated weights for policy 1, policy_version 1755678 (0.0007) [2023-12-28 07:50:52,858][106225] Updated weights for policy 1, policy_version 1755688 (0.0008) [2023-12-28 07:50:53,440][106226] Updated weights for policy 0, policy_version 1751273 (0.0010) [2023-12-28 07:50:53,505][106226] Updated weights for policy 0, policy_version 1751283 (0.0007) [2023-12-28 07:50:53,575][106226] Updated weights for policy 0, policy_version 1751293 (0.0005) [2023-12-28 07:50:53,618][106225] Updated weights for policy 1, policy_version 1755698 (0.0007) [2023-12-28 07:50:53,639][106226] Updated weights for policy 0, policy_version 1751303 (0.0007) [2023-12-28 07:50:53,676][106225] Updated weights for policy 1, policy_version 1755708 (0.0007) [2023-12-28 07:50:53,738][106225] Updated weights for policy 1, policy_version 1755718 (0.0008) [2023-12-28 07:50:54,211][106226] Updated weights for policy 0, policy_version 1751313 (0.0008) [2023-12-28 07:50:54,263][106226] Updated weights for policy 0, policy_version 1751323 (0.0008) [2023-12-28 07:50:54,324][106226] Updated weights for policy 0, policy_version 1751333 (0.0009) [2023-12-28 07:50:54,513][106225] Updated weights for policy 1, policy_version 1755728 (0.0009) [2023-12-28 07:50:54,574][106225] Updated weights for policy 1, policy_version 1755738 (0.0007) [2023-12-28 07:50:54,624][106225] Updated weights for policy 1, policy_version 1755748 (0.0008) [2023-12-28 07:50:54,924][106226] Updated weights for policy 0, policy_version 1751343 (0.0005) [2023-12-28 07:50:54,977][106226] Updated weights for policy 0, policy_version 1751353 (0.0005) [2023-12-28 07:50:55,042][106226] Updated weights for policy 0, policy_version 1751363 (0.0011) [2023-12-28 07:50:55,418][106225] Updated weights for policy 1, policy_version 1755758 (0.0008) [2023-12-28 07:50:55,472][106225] Updated weights for policy 1, policy_version 1755768 (0.0008) [2023-12-28 07:50:55,526][106225] Updated weights for policy 1, policy_version 1755778 (0.0007) [2023-12-28 07:50:55,689][106226] Updated weights for policy 0, policy_version 1751373 (0.0010) [2023-12-28 07:50:55,748][106226] Updated weights for policy 0, policy_version 1751383 (0.0010) [2023-12-28 07:50:55,813][106226] Updated weights for policy 0, policy_version 1751393 (0.0005) [2023-12-28 07:50:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 897974272. Throughput: 0: 9991.7, 1: 9984.5. Samples: 897945148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:50:56,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.892')] [2023-12-28 07:50:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001755784_449536000.pth... [2023-12-28 07:50:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001751400_448438272.pth... [2023-12-28 07:50:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001750216_448135168.pth [2023-12-28 07:50:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001754632_449241088.pth [2023-12-28 07:50:56,330][106226] Updated weights for policy 0, policy_version 1751403 (0.0005) [2023-12-28 07:50:56,373][106225] Updated weights for policy 1, policy_version 1755788 (0.0008) [2023-12-28 07:50:56,390][106226] Updated weights for policy 0, policy_version 1751413 (0.0005) [2023-12-28 07:50:56,429][106225] Updated weights for policy 1, policy_version 1755798 (0.0008) [2023-12-28 07:50:56,444][106226] Updated weights for policy 0, policy_version 1751423 (0.0005) [2023-12-28 07:50:56,485][106225] Updated weights for policy 1, policy_version 1755808 (0.0008) [2023-12-28 07:50:57,015][106226] Updated weights for policy 0, policy_version 1751433 (0.0006) [2023-12-28 07:50:57,068][106226] Updated weights for policy 0, policy_version 1751443 (0.0008) [2023-12-28 07:50:57,120][106226] Updated weights for policy 0, policy_version 1751453 (0.0009) [2023-12-28 07:50:57,180][106226] Updated weights for policy 0, policy_version 1751463 (0.0007) [2023-12-28 07:50:57,259][106225] Updated weights for policy 1, policy_version 1755818 (0.0007) [2023-12-28 07:50:57,318][106225] Updated weights for policy 1, policy_version 1755828 (0.0008) [2023-12-28 07:50:57,370][106225] Updated weights for policy 1, policy_version 1755838 (0.0008) [2023-12-28 07:50:57,438][106225] Updated weights for policy 1, policy_version 1755848 (0.0009) [2023-12-28 07:50:57,842][106226] Updated weights for policy 0, policy_version 1751473 (0.0006) [2023-12-28 07:50:57,908][106226] Updated weights for policy 0, policy_version 1751483 (0.0005) [2023-12-28 07:50:57,973][106226] Updated weights for policy 0, policy_version 1751493 (0.0005) [2023-12-28 07:50:58,199][106225] Updated weights for policy 1, policy_version 1755858 (0.0009) [2023-12-28 07:50:58,262][106225] Updated weights for policy 1, policy_version 1755868 (0.0008) [2023-12-28 07:50:58,319][106225] Updated weights for policy 1, policy_version 1755878 (0.0009) [2023-12-28 07:50:58,546][106226] Updated weights for policy 0, policy_version 1751503 (0.0007) [2023-12-28 07:50:58,609][106226] Updated weights for policy 0, policy_version 1751513 (0.0008) [2023-12-28 07:50:58,673][106226] Updated weights for policy 0, policy_version 1751523 (0.0007) [2023-12-28 07:50:59,239][106225] Updated weights for policy 1, policy_version 1755889 (0.0008) [2023-12-28 07:50:59,300][106225] Updated weights for policy 1, policy_version 1755899 (0.0008) [2023-12-28 07:50:59,366][106225] Updated weights for policy 1, policy_version 1755909 (0.0009) [2023-12-28 07:50:59,531][106226] Updated weights for policy 0, policy_version 1751533 (0.0008) [2023-12-28 07:50:59,586][106226] Updated weights for policy 0, policy_version 1751543 (0.0008) [2023-12-28 07:50:59,651][106226] Updated weights for policy 0, policy_version 1751553 (0.0009) [2023-12-28 07:51:00,124][106225] Updated weights for policy 1, policy_version 1755919 (0.0009) [2023-12-28 07:51:00,182][106225] Updated weights for policy 1, policy_version 1755929 (0.0008) [2023-12-28 07:51:00,231][106225] Updated weights for policy 1, policy_version 1755939 (0.0008) [2023-12-28 07:51:00,421][106226] Updated weights for policy 0, policy_version 1751563 (0.0008) [2023-12-28 07:51:00,466][106226] Updated weights for policy 0, policy_version 1751573 (0.0008) [2023-12-28 07:51:00,510][106226] Updated weights for policy 0, policy_version 1751583 (0.0008) [2023-12-28 07:51:00,984][106225] Updated weights for policy 1, policy_version 1755949 (0.0007) [2023-12-28 07:51:01,049][106225] Updated weights for policy 1, policy_version 1755959 (0.0007) [2023-12-28 07:51:01,131][106225] Updated weights for policy 1, policy_version 1755969 (0.0010) [2023-12-28 07:51:01,166][106226] Updated weights for policy 0, policy_version 1751593 (0.0006) [2023-12-28 07:51:01,175][105115] Fps is (10 sec: 18022.5, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 898064384. Throughput: 0: 10116.7, 1: 9871.9. Samples: 898061680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:01,175][105115] Avg episode reward: [(0, '-4.281'), (1, '-4.522')] [2023-12-28 07:51:01,213][106226] Updated weights for policy 0, policy_version 1751603 (0.0008) [2023-12-28 07:51:01,275][106226] Updated weights for policy 0, policy_version 1751613 (0.0008) [2023-12-28 07:51:01,332][106226] Updated weights for policy 0, policy_version 1751623 (0.0008) [2023-12-28 07:51:01,835][106225] Updated weights for policy 1, policy_version 1755979 (0.0009) [2023-12-28 07:51:01,900][106225] Updated weights for policy 1, policy_version 1755989 (0.0006) [2023-12-28 07:51:01,966][106225] Updated weights for policy 1, policy_version 1755999 (0.0006) [2023-12-28 07:51:02,059][106226] Updated weights for policy 0, policy_version 1751633 (0.0008) [2023-12-28 07:51:02,108][106226] Updated weights for policy 0, policy_version 1751643 (0.0008) [2023-12-28 07:51:02,160][106226] Updated weights for policy 0, policy_version 1751653 (0.0006) [2023-12-28 07:51:02,616][106225] Updated weights for policy 1, policy_version 1756009 (0.0006) [2023-12-28 07:51:02,670][106225] Updated weights for policy 1, policy_version 1756019 (0.0006) [2023-12-28 07:51:02,723][106225] Updated weights for policy 1, policy_version 1756029 (0.0006) [2023-12-28 07:51:02,785][106225] Updated weights for policy 1, policy_version 1756039 (0.0007) [2023-12-28 07:51:02,857][106226] Updated weights for policy 0, policy_version 1751663 (0.0008) [2023-12-28 07:51:02,910][106226] Updated weights for policy 0, policy_version 1751673 (0.0008) [2023-12-28 07:51:02,967][106226] Updated weights for policy 0, policy_version 1751683 (0.0008) [2023-12-28 07:51:03,431][106225] Updated weights for policy 1, policy_version 1756049 (0.0006) [2023-12-28 07:51:03,492][106225] Updated weights for policy 1, policy_version 1756059 (0.0007) [2023-12-28 07:51:03,546][106225] Updated weights for policy 1, policy_version 1756069 (0.0008) [2023-12-28 07:51:03,658][106226] Updated weights for policy 0, policy_version 1751693 (0.0009) [2023-12-28 07:51:03,716][106226] Updated weights for policy 0, policy_version 1751703 (0.0007) [2023-12-28 07:51:03,787][106226] Updated weights for policy 0, policy_version 1751713 (0.0006) [2023-12-28 07:51:04,299][106225] Updated weights for policy 1, policy_version 1756079 (0.0008) [2023-12-28 07:51:04,363][106225] Updated weights for policy 1, policy_version 1756089 (0.0007) [2023-12-28 07:51:04,432][106225] Updated weights for policy 1, policy_version 1756099 (0.0007) [2023-12-28 07:51:04,487][106226] Updated weights for policy 0, policy_version 1751723 (0.0007) [2023-12-28 07:51:04,549][106226] Updated weights for policy 0, policy_version 1751733 (0.0009) [2023-12-28 07:51:04,608][106226] Updated weights for policy 0, policy_version 1751743 (0.0011) [2023-12-28 07:51:05,184][106225] Updated weights for policy 1, policy_version 1756109 (0.0008) [2023-12-28 07:51:05,235][106225] Updated weights for policy 1, policy_version 1756119 (0.0008) [2023-12-28 07:51:05,246][106226] Updated weights for policy 0, policy_version 1751753 (0.0011) [2023-12-28 07:51:05,299][106225] Updated weights for policy 1, policy_version 1756129 (0.0005) [2023-12-28 07:51:05,311][106226] Updated weights for policy 0, policy_version 1751763 (0.0007) [2023-12-28 07:51:05,376][106226] Updated weights for policy 0, policy_version 1751773 (0.0011) [2023-12-28 07:51:05,440][106226] Updated weights for policy 0, policy_version 1751783 (0.0011) [2023-12-28 07:51:05,962][106225] Updated weights for policy 1, policy_version 1756139 (0.0006) [2023-12-28 07:51:06,024][106225] Updated weights for policy 1, policy_version 1756149 (0.0006) [2023-12-28 07:51:06,030][106226] Updated weights for policy 0, policy_version 1751793 (0.0010) [2023-12-28 07:51:06,081][106226] Updated weights for policy 0, policy_version 1751803 (0.0007) [2023-12-28 07:51:06,091][106225] Updated weights for policy 1, policy_version 1756159 (0.0009) [2023-12-28 07:51:06,148][106226] Updated weights for policy 0, policy_version 1751813 (0.0009) [2023-12-28 07:51:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 898179072. Throughput: 0: 10150.2, 1: 9851.7. Samples: 898181736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:06,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.631')] [2023-12-28 07:51:06,831][106225] Updated weights for policy 1, policy_version 1756169 (0.0010) [2023-12-28 07:51:06,889][106225] Updated weights for policy 1, policy_version 1756179 (0.0011) [2023-12-28 07:51:06,938][106226] Updated weights for policy 0, policy_version 1751823 (0.0010) [2023-12-28 07:51:06,949][106225] Updated weights for policy 1, policy_version 1756189 (0.0011) [2023-12-28 07:51:06,998][106226] Updated weights for policy 0, policy_version 1751833 (0.0007) [2023-12-28 07:51:07,007][106225] Updated weights for policy 1, policy_version 1756199 (0.0011) [2023-12-28 07:51:07,051][106226] Updated weights for policy 0, policy_version 1751843 (0.0007) [2023-12-28 07:51:07,728][106226] Updated weights for policy 0, policy_version 1751853 (0.0007) [2023-12-28 07:51:07,764][106225] Updated weights for policy 1, policy_version 1756209 (0.0006) [2023-12-28 07:51:07,793][106226] Updated weights for policy 0, policy_version 1751863 (0.0008) [2023-12-28 07:51:07,813][106225] Updated weights for policy 1, policy_version 1756219 (0.0007) [2023-12-28 07:51:07,851][106226] Updated weights for policy 0, policy_version 1751873 (0.0008) [2023-12-28 07:51:07,861][106225] Updated weights for policy 1, policy_version 1756229 (0.0007) [2023-12-28 07:51:08,523][106226] Updated weights for policy 0, policy_version 1751883 (0.0006) [2023-12-28 07:51:08,583][106226] Updated weights for policy 0, policy_version 1751893 (0.0007) [2023-12-28 07:51:08,598][106225] Updated weights for policy 1, policy_version 1756239 (0.0005) [2023-12-28 07:51:08,643][106226] Updated weights for policy 0, policy_version 1751903 (0.0008) [2023-12-28 07:51:08,661][106225] Updated weights for policy 1, policy_version 1756249 (0.0007) [2023-12-28 07:51:08,725][106225] Updated weights for policy 1, policy_version 1756259 (0.0006) [2023-12-28 07:51:09,353][106226] Updated weights for policy 0, policy_version 1751913 (0.0007) [2023-12-28 07:51:09,424][106226] Updated weights for policy 0, policy_version 1751923 (0.0008) [2023-12-28 07:51:09,489][106226] Updated weights for policy 0, policy_version 1751933 (0.0007) [2023-12-28 07:51:09,512][106225] Updated weights for policy 1, policy_version 1756269 (0.0007) [2023-12-28 07:51:09,547][106226] Updated weights for policy 0, policy_version 1751943 (0.0007) [2023-12-28 07:51:09,584][106225] Updated weights for policy 1, policy_version 1756279 (0.0006) [2023-12-28 07:51:09,651][106225] Updated weights for policy 1, policy_version 1756289 (0.0008) [2023-12-28 07:51:10,296][106226] Updated weights for policy 0, policy_version 1751953 (0.0010) [2023-12-28 07:51:10,354][106226] Updated weights for policy 0, policy_version 1751963 (0.0011) [2023-12-28 07:51:10,411][106225] Updated weights for policy 1, policy_version 1756299 (0.0008) [2023-12-28 07:51:10,418][106226] Updated weights for policy 0, policy_version 1751973 (0.0011) [2023-12-28 07:51:10,472][106225] Updated weights for policy 1, policy_version 1756309 (0.0008) [2023-12-28 07:51:10,535][106225] Updated weights for policy 1, policy_version 1756319 (0.0008) [2023-12-28 07:51:11,165][106226] Updated weights for policy 0, policy_version 1751983 (0.0009) [2023-12-28 07:51:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 898260992. Throughput: 0: 10168.2, 1: 9796.1. Samples: 898239364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:11,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-5.052')] [2023-12-28 07:51:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001756328_449675264.pth... [2023-12-28 07:51:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001755208_449388544.pth [2023-12-28 07:51:11,235][106226] Updated weights for policy 0, policy_version 1751993 (0.0011) [2023-12-28 07:51:11,300][106226] Updated weights for policy 0, policy_version 1752003 (0.0011) [2023-12-28 07:51:11,310][106225] Updated weights for policy 1, policy_version 1756329 (0.0008) [2023-12-28 07:51:11,324][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001752008_448593920.pth... [2023-12-28 07:51:11,328][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001750824_448290816.pth [2023-12-28 07:51:11,374][106225] Updated weights for policy 1, policy_version 1756339 (0.0008) [2023-12-28 07:51:11,436][106225] Updated weights for policy 1, policy_version 1756349 (0.0008) [2023-12-28 07:51:11,499][106225] Updated weights for policy 1, policy_version 1756359 (0.0008) [2023-12-28 07:51:12,066][106226] Updated weights for policy 0, policy_version 1752013 (0.0010) [2023-12-28 07:51:12,123][106226] Updated weights for policy 0, policy_version 1752023 (0.0011) [2023-12-28 07:51:12,184][106226] Updated weights for policy 0, policy_version 1752033 (0.0011) [2023-12-28 07:51:12,331][106225] Updated weights for policy 1, policy_version 1756369 (0.0008) [2023-12-28 07:51:12,397][106225] Updated weights for policy 1, policy_version 1756379 (0.0008) [2023-12-28 07:51:12,455][106225] Updated weights for policy 1, policy_version 1756389 (0.0008) [2023-12-28 07:51:12,928][106226] Updated weights for policy 0, policy_version 1752043 (0.0009) [2023-12-28 07:51:12,988][106226] Updated weights for policy 0, policy_version 1752053 (0.0005) [2023-12-28 07:51:13,045][106226] Updated weights for policy 0, policy_version 1752063 (0.0005) [2023-12-28 07:51:13,205][106225] Updated weights for policy 1, policy_version 1756399 (0.0006) [2023-12-28 07:51:13,251][106225] Updated weights for policy 1, policy_version 1756409 (0.0006) [2023-12-28 07:51:13,309][106225] Updated weights for policy 1, policy_version 1756419 (0.0010) [2023-12-28 07:51:13,660][106226] Updated weights for policy 0, policy_version 1752073 (0.0006) [2023-12-28 07:51:13,716][106226] Updated weights for policy 0, policy_version 1752083 (0.0009) [2023-12-28 07:51:13,769][106226] Updated weights for policy 0, policy_version 1752093 (0.0005) [2023-12-28 07:51:13,817][106226] Updated weights for policy 0, policy_version 1752103 (0.0007) [2023-12-28 07:51:13,991][106225] Updated weights for policy 1, policy_version 1756429 (0.0010) [2023-12-28 07:51:14,040][106225] Updated weights for policy 1, policy_version 1756439 (0.0009) [2023-12-28 07:51:14,098][106225] Updated weights for policy 1, policy_version 1756449 (0.0007) [2023-12-28 07:51:14,494][106226] Updated weights for policy 0, policy_version 1752113 (0.0010) [2023-12-28 07:51:14,557][106226] Updated weights for policy 0, policy_version 1752123 (0.0011) [2023-12-28 07:51:14,617][106226] Updated weights for policy 0, policy_version 1752133 (0.0011) [2023-12-28 07:51:14,661][106225] Updated weights for policy 1, policy_version 1756459 (0.0009) [2023-12-28 07:51:14,717][106225] Updated weights for policy 1, policy_version 1756469 (0.0010) [2023-12-28 07:51:14,775][106225] Updated weights for policy 1, policy_version 1756479 (0.0010) [2023-12-28 07:51:15,358][106226] Updated weights for policy 0, policy_version 1752143 (0.0009) [2023-12-28 07:51:15,413][106226] Updated weights for policy 0, policy_version 1752153 (0.0008) [2023-12-28 07:51:15,475][106226] Updated weights for policy 0, policy_version 1752163 (0.0008) [2023-12-28 07:51:15,531][106225] Updated weights for policy 1, policy_version 1756489 (0.0010) [2023-12-28 07:51:15,596][106225] Updated weights for policy 1, policy_version 1756499 (0.0010) [2023-12-28 07:51:15,659][106225] Updated weights for policy 1, policy_version 1756509 (0.0010) [2023-12-28 07:51:15,717][106225] Updated weights for policy 1, policy_version 1756519 (0.0010) [2023-12-28 07:51:16,142][106226] Updated weights for policy 0, policy_version 1752173 (0.0008) [2023-12-28 07:51:16,174][105115] Fps is (10 sec: 18022.4, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 898359296. Throughput: 0: 10057.4, 1: 9659.1. Samples: 898353948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:16,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-4.723')] [2023-12-28 07:51:16,196][106226] Updated weights for policy 0, policy_version 1752183 (0.0005) [2023-12-28 07:51:16,251][106226] Updated weights for policy 0, policy_version 1752193 (0.0006) [2023-12-28 07:51:16,422][106225] Updated weights for policy 1, policy_version 1756529 (0.0006) [2023-12-28 07:51:16,484][106225] Updated weights for policy 1, policy_version 1756539 (0.0008) [2023-12-28 07:51:16,540][106225] Updated weights for policy 1, policy_version 1756549 (0.0005) [2023-12-28 07:51:16,920][106226] Updated weights for policy 0, policy_version 1752203 (0.0007) [2023-12-28 07:51:16,965][106226] Updated weights for policy 0, policy_version 1752213 (0.0007) [2023-12-28 07:51:17,019][106226] Updated weights for policy 0, policy_version 1752223 (0.0005) [2023-12-28 07:51:17,037][106225] Updated weights for policy 1, policy_version 1756559 (0.0009) [2023-12-28 07:51:17,095][106225] Updated weights for policy 1, policy_version 1756569 (0.0010) [2023-12-28 07:51:17,154][106225] Updated weights for policy 1, policy_version 1756579 (0.0008) [2023-12-28 07:51:17,660][106226] Updated weights for policy 0, policy_version 1752233 (0.0008) [2023-12-28 07:51:17,705][106225] Updated weights for policy 1, policy_version 1756589 (0.0007) [2023-12-28 07:51:17,718][106226] Updated weights for policy 0, policy_version 1752243 (0.0007) [2023-12-28 07:51:17,759][106225] Updated weights for policy 1, policy_version 1756599 (0.0010) [2023-12-28 07:51:17,772][106226] Updated weights for policy 0, policy_version 1752253 (0.0006) [2023-12-28 07:51:17,813][106225] Updated weights for policy 1, policy_version 1756609 (0.0010) [2023-12-28 07:51:17,820][106226] Updated weights for policy 0, policy_version 1752263 (0.0006) [2023-12-28 07:51:18,476][106225] Updated weights for policy 1, policy_version 1756619 (0.0009) [2023-12-28 07:51:18,537][106225] Updated weights for policy 1, policy_version 1756629 (0.0009) [2023-12-28 07:51:18,588][106226] Updated weights for policy 0, policy_version 1752273 (0.0007) [2023-12-28 07:51:18,600][106225] Updated weights for policy 1, policy_version 1756639 (0.0009) [2023-12-28 07:51:18,647][106226] Updated weights for policy 0, policy_version 1752283 (0.0008) [2023-12-28 07:51:18,702][106226] Updated weights for policy 0, policy_version 1752293 (0.0007) [2023-12-28 07:51:19,328][106225] Updated weights for policy 1, policy_version 1756649 (0.0009) [2023-12-28 07:51:19,373][106226] Updated weights for policy 0, policy_version 1752303 (0.0008) [2023-12-28 07:51:19,401][106225] Updated weights for policy 1, policy_version 1756659 (0.0009) [2023-12-28 07:51:19,442][106226] Updated weights for policy 0, policy_version 1752313 (0.0008) [2023-12-28 07:51:19,469][106225] Updated weights for policy 1, policy_version 1756669 (0.0009) [2023-12-28 07:51:19,512][106226] Updated weights for policy 0, policy_version 1752323 (0.0008) [2023-12-28 07:51:19,526][106225] Updated weights for policy 1, policy_version 1756679 (0.0010) [2023-12-28 07:51:20,243][106226] Updated weights for policy 0, policy_version 1752333 (0.0007) [2023-12-28 07:51:20,263][106225] Updated weights for policy 1, policy_version 1756689 (0.0009) [2023-12-28 07:51:20,309][106226] Updated weights for policy 0, policy_version 1752343 (0.0008) [2023-12-28 07:51:20,325][106225] Updated weights for policy 1, policy_version 1756699 (0.0009) [2023-12-28 07:51:20,370][106226] Updated weights for policy 0, policy_version 1752353 (0.0007) [2023-12-28 07:51:20,389][106225] Updated weights for policy 1, policy_version 1756709 (0.0008) [2023-12-28 07:51:21,055][106225] Updated weights for policy 1, policy_version 1756719 (0.0010) [2023-12-28 07:51:21,119][106225] Updated weights for policy 1, policy_version 1756729 (0.0009) [2023-12-28 07:51:21,145][106226] Updated weights for policy 0, policy_version 1752363 (0.0009) [2023-12-28 07:51:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 898457600. Throughput: 0: 9974.1, 1: 9682.1. Samples: 898474552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:21,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.864')] [2023-12-28 07:51:21,186][106225] Updated weights for policy 1, policy_version 1756739 (0.0006) [2023-12-28 07:51:21,208][106226] Updated weights for policy 0, policy_version 1752373 (0.0011) [2023-12-28 07:51:21,278][106226] Updated weights for policy 0, policy_version 1752383 (0.0009) [2023-12-28 07:51:21,940][106226] Updated weights for policy 0, policy_version 1752393 (0.0009) [2023-12-28 07:51:21,997][106226] Updated weights for policy 0, policy_version 1752403 (0.0010) [2023-12-28 07:51:22,004][106225] Updated weights for policy 1, policy_version 1756749 (0.0009) [2023-12-28 07:51:22,062][106225] Updated weights for policy 1, policy_version 1756759 (0.0008) [2023-12-28 07:51:22,063][106226] Updated weights for policy 0, policy_version 1752413 (0.0008) [2023-12-28 07:51:22,115][106226] Updated weights for policy 0, policy_version 1752423 (0.0006) [2023-12-28 07:51:22,121][106225] Updated weights for policy 1, policy_version 1756769 (0.0011) [2023-12-28 07:51:22,797][106225] Updated weights for policy 1, policy_version 1756779 (0.0010) [2023-12-28 07:51:22,862][106225] Updated weights for policy 1, policy_version 1756789 (0.0011) [2023-12-28 07:51:22,873][106226] Updated weights for policy 0, policy_version 1752433 (0.0010) [2023-12-28 07:51:22,926][106225] Updated weights for policy 1, policy_version 1756799 (0.0010) [2023-12-28 07:51:22,933][106226] Updated weights for policy 0, policy_version 1752443 (0.0011) [2023-12-28 07:51:22,990][106226] Updated weights for policy 0, policy_version 1752453 (0.0011) [2023-12-28 07:51:23,508][106225] Updated weights for policy 1, policy_version 1756809 (0.0010) [2023-12-28 07:51:23,561][106225] Updated weights for policy 1, policy_version 1756819 (0.0010) [2023-12-28 07:51:23,607][106225] Updated weights for policy 1, policy_version 1756829 (0.0010) [2023-12-28 07:51:23,663][106225] Updated weights for policy 1, policy_version 1756839 (0.0010) [2023-12-28 07:51:23,712][106226] Updated weights for policy 0, policy_version 1752463 (0.0011) [2023-12-28 07:51:23,769][106226] Updated weights for policy 0, policy_version 1752473 (0.0009) [2023-12-28 07:51:23,824][106226] Updated weights for policy 0, policy_version 1752483 (0.0010) [2023-12-28 07:51:24,352][106225] Updated weights for policy 1, policy_version 1756849 (0.0006) [2023-12-28 07:51:24,418][106225] Updated weights for policy 1, policy_version 1756859 (0.0005) [2023-12-28 07:51:24,466][106226] Updated weights for policy 0, policy_version 1752493 (0.0010) [2023-12-28 07:51:24,484][106225] Updated weights for policy 1, policy_version 1756869 (0.0006) [2023-12-28 07:51:24,519][106226] Updated weights for policy 0, policy_version 1752503 (0.0010) [2023-12-28 07:51:24,586][106226] Updated weights for policy 0, policy_version 1752513 (0.0010) [2023-12-28 07:51:25,035][106225] Updated weights for policy 1, policy_version 1756879 (0.0006) [2023-12-28 07:51:25,083][106225] Updated weights for policy 1, policy_version 1756889 (0.0007) [2023-12-28 07:51:25,132][106225] Updated weights for policy 1, policy_version 1756899 (0.0009) [2023-12-28 07:51:25,299][106226] Updated weights for policy 0, policy_version 1752523 (0.0011) [2023-12-28 07:51:25,366][106226] Updated weights for policy 0, policy_version 1752533 (0.0010) [2023-12-28 07:51:25,439][106226] Updated weights for policy 0, policy_version 1752543 (0.0010) [2023-12-28 07:51:25,746][106225] Updated weights for policy 1, policy_version 1756909 (0.0005) [2023-12-28 07:51:25,802][106225] Updated weights for policy 1, policy_version 1756919 (0.0005) [2023-12-28 07:51:25,855][106225] Updated weights for policy 1, policy_version 1756929 (0.0005) [2023-12-28 07:51:26,000][106226] Updated weights for policy 0, policy_version 1752553 (0.0010) [2023-12-28 07:51:26,054][106226] Updated weights for policy 0, policy_version 1752563 (0.0005) [2023-12-28 07:51:26,118][106226] Updated weights for policy 0, policy_version 1752573 (0.0006) [2023-12-28 07:51:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19910.7). Total num frames: 898564096. Throughput: 0: 9928.5, 1: 9692.9. Samples: 898533540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:26,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-5.190')] [2023-12-28 07:51:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001756936_449830912.pth... [2023-12-28 07:51:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001755784_449536000.pth [2023-12-28 07:51:26,188][106226] Updated weights for policy 0, policy_version 1752583 (0.0005) [2023-12-28 07:51:26,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001752584_448741376.pth... [2023-12-28 07:51:26,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001751400_448438272.pth [2023-12-28 07:51:26,375][106225] Updated weights for policy 1, policy_version 1756939 (0.0005) [2023-12-28 07:51:26,436][106225] Updated weights for policy 1, policy_version 1756949 (0.0005) [2023-12-28 07:51:26,495][106225] Updated weights for policy 1, policy_version 1756959 (0.0006) [2023-12-28 07:51:26,695][106226] Updated weights for policy 0, policy_version 1752593 (0.0005) [2023-12-28 07:51:26,764][106226] Updated weights for policy 0, policy_version 1752603 (0.0009) [2023-12-28 07:51:26,833][106226] Updated weights for policy 0, policy_version 1752613 (0.0010) [2023-12-28 07:51:27,003][106225] Updated weights for policy 1, policy_version 1756969 (0.0006) [2023-12-28 07:51:27,059][106225] Updated weights for policy 1, policy_version 1756979 (0.0005) [2023-12-28 07:51:27,111][106225] Updated weights for policy 1, policy_version 1756989 (0.0006) [2023-12-28 07:51:27,155][106225] Updated weights for policy 1, policy_version 1756999 (0.0007) [2023-12-28 07:51:27,465][106226] Updated weights for policy 0, policy_version 1752623 (0.0010) [2023-12-28 07:51:27,514][106226] Updated weights for policy 0, policy_version 1752633 (0.0010) [2023-12-28 07:51:27,560][106226] Updated weights for policy 0, policy_version 1752643 (0.0010) [2023-12-28 07:51:27,836][106225] Updated weights for policy 1, policy_version 1757009 (0.0010) [2023-12-28 07:51:27,886][106225] Updated weights for policy 1, policy_version 1757019 (0.0010) [2023-12-28 07:51:27,935][106225] Updated weights for policy 1, policy_version 1757029 (0.0010) [2023-12-28 07:51:28,195][106226] Updated weights for policy 0, policy_version 1752653 (0.0008) [2023-12-28 07:51:28,257][106226] Updated weights for policy 0, policy_version 1752663 (0.0005) [2023-12-28 07:51:28,318][106226] Updated weights for policy 0, policy_version 1752673 (0.0005) [2023-12-28 07:51:28,688][106225] Updated weights for policy 1, policy_version 1757039 (0.0010) [2023-12-28 07:51:28,750][106225] Updated weights for policy 1, policy_version 1757049 (0.0009) [2023-12-28 07:51:28,816][106225] Updated weights for policy 1, policy_version 1757059 (0.0009) [2023-12-28 07:51:28,849][106226] Updated weights for policy 0, policy_version 1752683 (0.0009) [2023-12-28 07:51:28,895][106226] Updated weights for policy 0, policy_version 1752693 (0.0006) [2023-12-28 07:51:28,946][106226] Updated weights for policy 0, policy_version 1752703 (0.0008) [2023-12-28 07:51:29,561][106225] Updated weights for policy 1, policy_version 1757069 (0.0006) [2023-12-28 07:51:29,631][106225] Updated weights for policy 1, policy_version 1757079 (0.0007) [2023-12-28 07:51:29,683][106225] Updated weights for policy 1, policy_version 1757089 (0.0009) [2023-12-28 07:51:29,735][106226] Updated weights for policy 0, policy_version 1752713 (0.0009) [2023-12-28 07:51:29,788][106226] Updated weights for policy 0, policy_version 1752723 (0.0010) [2023-12-28 07:51:29,855][106226] Updated weights for policy 0, policy_version 1752733 (0.0007) [2023-12-28 07:51:29,917][106226] Updated weights for policy 0, policy_version 1752743 (0.0005) [2023-12-28 07:51:30,376][106225] Updated weights for policy 1, policy_version 1757099 (0.0006) [2023-12-28 07:51:30,429][106225] Updated weights for policy 1, policy_version 1757109 (0.0009) [2023-12-28 07:51:30,484][106225] Updated weights for policy 1, policy_version 1757119 (0.0008) [2023-12-28 07:51:30,643][106226] Updated weights for policy 0, policy_version 1752753 (0.0005) [2023-12-28 07:51:30,704][106226] Updated weights for policy 0, policy_version 1752763 (0.0005) [2023-12-28 07:51:30,763][106226] Updated weights for policy 0, policy_version 1752773 (0.0005) [2023-12-28 07:51:31,174][105115] Fps is (10 sec: 21299.4, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 898670592. Throughput: 0: 10106.1, 1: 9858.8. Samples: 898663712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:31,175][105115] Avg episode reward: [(0, '-4.308'), (1, '-4.662')] [2023-12-28 07:51:31,180][106225] Updated weights for policy 1, policy_version 1757129 (0.0006) [2023-12-28 07:51:31,243][106225] Updated weights for policy 1, policy_version 1757139 (0.0007) [2023-12-28 07:51:31,302][106225] Updated weights for policy 1, policy_version 1757149 (0.0007) [2023-12-28 07:51:31,364][106225] Updated weights for policy 1, policy_version 1757159 (0.0008) [2023-12-28 07:51:31,494][106226] Updated weights for policy 0, policy_version 1752783 (0.0008) [2023-12-28 07:51:31,552][106226] Updated weights for policy 0, policy_version 1752793 (0.0008) [2023-12-28 07:51:31,611][106226] Updated weights for policy 0, policy_version 1752803 (0.0008) [2023-12-28 07:51:32,078][106225] Updated weights for policy 1, policy_version 1757169 (0.0008) [2023-12-28 07:51:32,132][106225] Updated weights for policy 1, policy_version 1757179 (0.0010) [2023-12-28 07:51:32,188][106225] Updated weights for policy 1, policy_version 1757189 (0.0007) [2023-12-28 07:51:32,295][106226] Updated weights for policy 0, policy_version 1752813 (0.0009) [2023-12-28 07:51:32,363][106226] Updated weights for policy 0, policy_version 1752823 (0.0010) [2023-12-28 07:51:32,418][106226] Updated weights for policy 0, policy_version 1752833 (0.0010) [2023-12-28 07:51:32,870][106225] Updated weights for policy 1, policy_version 1757199 (0.0007) [2023-12-28 07:51:32,928][106225] Updated weights for policy 1, policy_version 1757210 (0.0007) [2023-12-28 07:51:32,982][106225] Updated weights for policy 1, policy_version 1757220 (0.0005) [2023-12-28 07:51:33,061][106226] Updated weights for policy 0, policy_version 1752843 (0.0009) [2023-12-28 07:51:33,123][106226] Updated weights for policy 0, policy_version 1752853 (0.0005) [2023-12-28 07:51:33,174][106226] Updated weights for policy 0, policy_version 1752863 (0.0005) [2023-12-28 07:51:33,646][106225] Updated weights for policy 1, policy_version 1757230 (0.0008) [2023-12-28 07:51:33,696][106225] Updated weights for policy 1, policy_version 1757240 (0.0010) [2023-12-28 07:51:33,748][106225] Updated weights for policy 1, policy_version 1757250 (0.0010) [2023-12-28 07:51:33,783][106226] Updated weights for policy 0, policy_version 1752873 (0.0005) [2023-12-28 07:51:33,834][106226] Updated weights for policy 0, policy_version 1752883 (0.0007) [2023-12-28 07:51:33,887][106226] Updated weights for policy 0, policy_version 1752893 (0.0008) [2023-12-28 07:51:33,945][106226] Updated weights for policy 0, policy_version 1752903 (0.0010) [2023-12-28 07:51:34,449][106225] Updated weights for policy 1, policy_version 1757260 (0.0010) [2023-12-28 07:51:34,519][106225] Updated weights for policy 1, policy_version 1757270 (0.0007) [2023-12-28 07:51:34,586][106225] Updated weights for policy 1, policy_version 1757280 (0.0007) [2023-12-28 07:51:34,620][106226] Updated weights for policy 0, policy_version 1752913 (0.0007) [2023-12-28 07:51:34,683][106226] Updated weights for policy 0, policy_version 1752923 (0.0005) [2023-12-28 07:51:34,749][106226] Updated weights for policy 0, policy_version 1752933 (0.0009) [2023-12-28 07:51:35,230][106225] Updated weights for policy 1, policy_version 1757290 (0.0006) [2023-12-28 07:51:35,300][106225] Updated weights for policy 1, policy_version 1757300 (0.0008) [2023-12-28 07:51:35,355][106226] Updated weights for policy 0, policy_version 1752943 (0.0006) [2023-12-28 07:51:35,363][106225] Updated weights for policy 1, policy_version 1757310 (0.0009) [2023-12-28 07:51:35,413][106226] Updated weights for policy 0, policy_version 1752953 (0.0008) [2023-12-28 07:51:35,415][106225] Updated weights for policy 1, policy_version 1757320 (0.0007) [2023-12-28 07:51:35,464][106226] Updated weights for policy 0, policy_version 1752963 (0.0008) [2023-12-28 07:51:36,147][106225] Updated weights for policy 1, policy_version 1757330 (0.0009) [2023-12-28 07:51:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 898768896. Throughput: 0: 10164.2, 1: 9800.4. Samples: 898785528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:36,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.944')] [2023-12-28 07:51:36,176][106226] Updated weights for policy 0, policy_version 1752973 (0.0008) [2023-12-28 07:51:36,214][106225] Updated weights for policy 1, policy_version 1757340 (0.0009) [2023-12-28 07:51:36,240][106226] Updated weights for policy 0, policy_version 1752983 (0.0007) [2023-12-28 07:51:36,275][106225] Updated weights for policy 1, policy_version 1757350 (0.0006) [2023-12-28 07:51:36,302][106226] Updated weights for policy 0, policy_version 1752993 (0.0008) [2023-12-28 07:51:37,024][106225] Updated weights for policy 1, policy_version 1757360 (0.0009) [2023-12-28 07:51:37,037][106226] Updated weights for policy 0, policy_version 1753003 (0.0008) [2023-12-28 07:51:37,086][106225] Updated weights for policy 1, policy_version 1757370 (0.0008) [2023-12-28 07:51:37,100][106226] Updated weights for policy 0, policy_version 1753013 (0.0008) [2023-12-28 07:51:37,150][106226] Updated weights for policy 0, policy_version 1753023 (0.0007) [2023-12-28 07:51:37,155][106225] Updated weights for policy 1, policy_version 1757380 (0.0008) [2023-12-28 07:51:37,841][106226] Updated weights for policy 0, policy_version 1753033 (0.0007) [2023-12-28 07:51:37,903][106225] Updated weights for policy 1, policy_version 1757390 (0.0008) [2023-12-28 07:51:37,905][106226] Updated weights for policy 0, policy_version 1753043 (0.0010) [2023-12-28 07:51:37,960][106225] Updated weights for policy 1, policy_version 1757400 (0.0007) [2023-12-28 07:51:37,961][106226] Updated weights for policy 0, policy_version 1753053 (0.0010) [2023-12-28 07:51:38,014][106225] Updated weights for policy 1, policy_version 1757410 (0.0008) [2023-12-28 07:51:38,021][106226] Updated weights for policy 0, policy_version 1753063 (0.0010) [2023-12-28 07:51:38,717][106226] Updated weights for policy 0, policy_version 1753073 (0.0010) [2023-12-28 07:51:38,763][106225] Updated weights for policy 1, policy_version 1757420 (0.0010) [2023-12-28 07:51:38,782][106226] Updated weights for policy 0, policy_version 1753083 (0.0009) [2023-12-28 07:51:38,822][106225] Updated weights for policy 1, policy_version 1757430 (0.0009) [2023-12-28 07:51:38,852][106226] Updated weights for policy 0, policy_version 1753093 (0.0009) [2023-12-28 07:51:38,889][106225] Updated weights for policy 1, policy_version 1757440 (0.0009) [2023-12-28 07:51:39,513][106225] Updated weights for policy 1, policy_version 1757450 (0.0005) [2023-12-28 07:51:39,538][106226] Updated weights for policy 0, policy_version 1753103 (0.0009) [2023-12-28 07:51:39,586][106225] Updated weights for policy 1, policy_version 1757460 (0.0006) [2023-12-28 07:51:39,604][106226] Updated weights for policy 0, policy_version 1753113 (0.0011) [2023-12-28 07:51:39,646][106225] Updated weights for policy 1, policy_version 1757470 (0.0006) [2023-12-28 07:51:39,670][106226] Updated weights for policy 0, policy_version 1753123 (0.0011) [2023-12-28 07:51:39,714][106225] Updated weights for policy 1, policy_version 1757480 (0.0007) [2023-12-28 07:51:40,358][106226] Updated weights for policy 0, policy_version 1753133 (0.0011) [2023-12-28 07:51:40,421][106226] Updated weights for policy 0, policy_version 1753143 (0.0011) [2023-12-28 07:51:40,431][106225] Updated weights for policy 1, policy_version 1757490 (0.0006) [2023-12-28 07:51:40,486][106226] Updated weights for policy 0, policy_version 1753153 (0.0011) [2023-12-28 07:51:40,492][106225] Updated weights for policy 1, policy_version 1757500 (0.0006) [2023-12-28 07:51:40,555][106225] Updated weights for policy 1, policy_version 1757510 (0.0007) [2023-12-28 07:51:41,152][106226] Updated weights for policy 0, policy_version 1753163 (0.0010) [2023-12-28 07:51:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 898867200. Throughput: 0: 10128.0, 1: 9815.5. Samples: 898842608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:41,175][105115] Avg episode reward: [(0, '-4.218'), (1, '-4.653')] [2023-12-28 07:51:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001757512_449978368.pth... [2023-12-28 07:51:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001756328_449675264.pth [2023-12-28 07:51:41,221][106226] Updated weights for policy 0, policy_version 1753173 (0.0008) [2023-12-28 07:51:41,281][106226] Updated weights for policy 0, policy_version 1753183 (0.0007) [2023-12-28 07:51:41,333][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001753192_448897024.pth... [2023-12-28 07:51:41,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001752008_448593920.pth [2023-12-28 07:51:41,338][106225] Updated weights for policy 1, policy_version 1757520 (0.0007) [2023-12-28 07:51:41,413][106225] Updated weights for policy 1, policy_version 1757530 (0.0007) [2023-12-28 07:51:41,477][106225] Updated weights for policy 1, policy_version 1757540 (0.0007) [2023-12-28 07:51:42,113][106226] Updated weights for policy 0, policy_version 1753193 (0.0009) [2023-12-28 07:51:42,177][106226] Updated weights for policy 0, policy_version 1753203 (0.0009) [2023-12-28 07:51:42,239][106225] Updated weights for policy 1, policy_version 1757550 (0.0008) [2023-12-28 07:51:42,240][106226] Updated weights for policy 0, policy_version 1753213 (0.0007) [2023-12-28 07:51:42,305][106226] Updated weights for policy 0, policy_version 1753223 (0.0007) [2023-12-28 07:51:42,307][106225] Updated weights for policy 1, policy_version 1757560 (0.0008) [2023-12-28 07:51:42,373][106225] Updated weights for policy 1, policy_version 1757570 (0.0006) [2023-12-28 07:51:42,910][106226] Updated weights for policy 0, policy_version 1753233 (0.0010) [2023-12-28 07:51:42,966][106226] Updated weights for policy 0, policy_version 1753243 (0.0011) [2023-12-28 07:51:43,026][106226] Updated weights for policy 0, policy_version 1753253 (0.0011) [2023-12-28 07:51:43,132][106225] Updated weights for policy 1, policy_version 1757580 (0.0008) [2023-12-28 07:51:43,194][106225] Updated weights for policy 1, policy_version 1757590 (0.0009) [2023-12-28 07:51:43,247][106225] Updated weights for policy 1, policy_version 1757600 (0.0008) [2023-12-28 07:51:43,704][106226] Updated weights for policy 0, policy_version 1753263 (0.0011) [2023-12-28 07:51:43,756][106226] Updated weights for policy 0, policy_version 1753273 (0.0010) [2023-12-28 07:51:43,819][106226] Updated weights for policy 0, policy_version 1753283 (0.0005) [2023-12-28 07:51:43,940][106225] Updated weights for policy 1, policy_version 1757610 (0.0007) [2023-12-28 07:51:43,997][106225] Updated weights for policy 1, policy_version 1757620 (0.0005) [2023-12-28 07:51:44,072][106225] Updated weights for policy 1, policy_version 1757630 (0.0006) [2023-12-28 07:51:44,126][106225] Updated weights for policy 1, policy_version 1757640 (0.0006) [2023-12-28 07:51:44,437][106226] Updated weights for policy 0, policy_version 1753293 (0.0008) [2023-12-28 07:51:44,499][106226] Updated weights for policy 0, policy_version 1753303 (0.0006) [2023-12-28 07:51:44,566][106226] Updated weights for policy 0, policy_version 1753313 (0.0010) [2023-12-28 07:51:44,690][106225] Updated weights for policy 1, policy_version 1757650 (0.0005) [2023-12-28 07:51:44,742][106225] Updated weights for policy 1, policy_version 1757660 (0.0006) [2023-12-28 07:51:44,828][106225] Updated weights for policy 1, policy_version 1757670 (0.0008) [2023-12-28 07:51:45,230][106226] Updated weights for policy 0, policy_version 1753323 (0.0011) [2023-12-28 07:51:45,291][106226] Updated weights for policy 0, policy_version 1753333 (0.0011) [2023-12-28 07:51:45,356][106226] Updated weights for policy 0, policy_version 1753343 (0.0011) [2023-12-28 07:51:45,482][106225] Updated weights for policy 1, policy_version 1757680 (0.0006) [2023-12-28 07:51:45,541][106225] Updated weights for policy 1, policy_version 1757690 (0.0005) [2023-12-28 07:51:45,599][106225] Updated weights for policy 1, policy_version 1757700 (0.0006) [2023-12-28 07:51:46,069][106226] Updated weights for policy 0, policy_version 1753353 (0.0011) [2023-12-28 07:51:46,137][106226] Updated weights for policy 0, policy_version 1753363 (0.0011) [2023-12-28 07:51:46,146][106225] Updated weights for policy 1, policy_version 1757710 (0.0005) [2023-12-28 07:51:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19938.5). Total num frames: 898965504. Throughput: 0: 10040.7, 1: 9935.9. Samples: 898960628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:46,175][105115] Avg episode reward: [(0, '-4.040'), (1, '-4.824')] [2023-12-28 07:51:46,191][106226] Updated weights for policy 0, policy_version 1753373 (0.0010) [2023-12-28 07:51:46,201][106225] Updated weights for policy 1, policy_version 1757720 (0.0005) [2023-12-28 07:51:46,254][106226] Updated weights for policy 0, policy_version 1753383 (0.0011) [2023-12-28 07:51:46,257][106225] Updated weights for policy 1, policy_version 1757730 (0.0007) [2023-12-28 07:51:46,831][106225] Updated weights for policy 1, policy_version 1757740 (0.0007) [2023-12-28 07:51:46,878][106225] Updated weights for policy 1, policy_version 1757750 (0.0008) [2023-12-28 07:51:46,937][106225] Updated weights for policy 1, policy_version 1757760 (0.0007) [2023-12-28 07:51:46,955][106226] Updated weights for policy 0, policy_version 1753393 (0.0010) [2023-12-28 07:51:47,008][106226] Updated weights for policy 0, policy_version 1753403 (0.0010) [2023-12-28 07:51:47,069][106226] Updated weights for policy 0, policy_version 1753413 (0.0011) [2023-12-28 07:51:47,535][106225] Updated weights for policy 1, policy_version 1757770 (0.0005) [2023-12-28 07:51:47,603][106225] Updated weights for policy 1, policy_version 1757780 (0.0005) [2023-12-28 07:51:47,665][106225] Updated weights for policy 1, policy_version 1757790 (0.0007) [2023-12-28 07:51:47,692][106226] Updated weights for policy 0, policy_version 1753423 (0.0007) [2023-12-28 07:51:47,728][106225] Updated weights for policy 1, policy_version 1757800 (0.0009) [2023-12-28 07:51:47,751][106226] Updated weights for policy 0, policy_version 1753433 (0.0006) [2023-12-28 07:51:47,805][106226] Updated weights for policy 0, policy_version 1753443 (0.0010) [2023-12-28 07:51:48,373][106225] Updated weights for policy 1, policy_version 1757810 (0.0008) [2023-12-28 07:51:48,432][106225] Updated weights for policy 1, policy_version 1757820 (0.0008) [2023-12-28 07:51:48,466][106226] Updated weights for policy 0, policy_version 1753453 (0.0008) [2023-12-28 07:51:48,498][106225] Updated weights for policy 1, policy_version 1757830 (0.0008) [2023-12-28 07:51:48,522][106226] Updated weights for policy 0, policy_version 1753463 (0.0006) [2023-12-28 07:51:48,578][106226] Updated weights for policy 0, policy_version 1753473 (0.0005) [2023-12-28 07:51:49,168][106225] Updated weights for policy 1, policy_version 1757840 (0.0009) [2023-12-28 07:51:49,190][106226] Updated weights for policy 0, policy_version 1753483 (0.0007) [2023-12-28 07:51:49,225][106225] Updated weights for policy 1, policy_version 1757851 (0.0009) [2023-12-28 07:51:49,258][106226] Updated weights for policy 0, policy_version 1753493 (0.0008) [2023-12-28 07:51:49,285][106225] Updated weights for policy 1, policy_version 1757861 (0.0008) [2023-12-28 07:51:49,326][106226] Updated weights for policy 0, policy_version 1753503 (0.0008) [2023-12-28 07:51:50,029][106225] Updated weights for policy 1, policy_version 1757871 (0.0010) [2023-12-28 07:51:50,045][106226] Updated weights for policy 0, policy_version 1753513 (0.0007) [2023-12-28 07:51:50,091][106225] Updated weights for policy 1, policy_version 1757881 (0.0008) [2023-12-28 07:51:50,105][106226] Updated weights for policy 0, policy_version 1753523 (0.0006) [2023-12-28 07:51:50,151][106225] Updated weights for policy 1, policy_version 1757891 (0.0007) [2023-12-28 07:51:50,165][106226] Updated weights for policy 0, policy_version 1753533 (0.0006) [2023-12-28 07:51:50,228][106226] Updated weights for policy 0, policy_version 1753543 (0.0008) [2023-12-28 07:51:50,937][106225] Updated weights for policy 1, policy_version 1757901 (0.0009) [2023-12-28 07:51:50,978][106226] Updated weights for policy 0, policy_version 1753553 (0.0008) [2023-12-28 07:51:51,005][106225] Updated weights for policy 1, policy_version 1757911 (0.0011) [2023-12-28 07:51:51,039][106226] Updated weights for policy 0, policy_version 1753563 (0.0008) [2023-12-28 07:51:51,068][106225] Updated weights for policy 1, policy_version 1757921 (0.0008) [2023-12-28 07:51:51,103][106226] Updated weights for policy 0, policy_version 1753573 (0.0008) [2023-12-28 07:51:51,174][105115] Fps is (10 sec: 21299.7, 60 sec: 19933.9, 300 sec: 19966.3). Total num frames: 899080192. Throughput: 0: 10020.6, 1: 10015.7. Samples: 899083368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:51,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.712')] [2023-12-28 07:51:51,873][106225] Updated weights for policy 1, policy_version 1757931 (0.0007) [2023-12-28 07:51:51,887][106226] Updated weights for policy 0, policy_version 1753583 (0.0008) [2023-12-28 07:51:51,935][106225] Updated weights for policy 1, policy_version 1757941 (0.0005) [2023-12-28 07:51:51,950][106226] Updated weights for policy 0, policy_version 1753593 (0.0009) [2023-12-28 07:51:51,993][106225] Updated weights for policy 1, policy_version 1757951 (0.0005) [2023-12-28 07:51:52,011][106226] Updated weights for policy 0, policy_version 1753603 (0.0008) [2023-12-28 07:51:52,623][106225] Updated weights for policy 1, policy_version 1757961 (0.0006) [2023-12-28 07:51:52,685][106225] Updated weights for policy 1, policy_version 1757971 (0.0006) [2023-12-28 07:51:52,721][106226] Updated weights for policy 0, policy_version 1753613 (0.0007) [2023-12-28 07:51:52,748][106225] Updated weights for policy 1, policy_version 1757981 (0.0006) [2023-12-28 07:51:52,784][106226] Updated weights for policy 0, policy_version 1753623 (0.0006) [2023-12-28 07:51:52,815][106225] Updated weights for policy 1, policy_version 1757991 (0.0007) [2023-12-28 07:51:52,836][106226] Updated weights for policy 0, policy_version 1753633 (0.0006) [2023-12-28 07:51:53,336][106225] Updated weights for policy 1, policy_version 1758001 (0.0005) [2023-12-28 07:51:53,405][106225] Updated weights for policy 1, policy_version 1758011 (0.0005) [2023-12-28 07:51:53,463][106225] Updated weights for policy 1, policy_version 1758021 (0.0005) [2023-12-28 07:51:53,491][106226] Updated weights for policy 0, policy_version 1753643 (0.0007) [2023-12-28 07:51:53,546][106226] Updated weights for policy 0, policy_version 1753653 (0.0009) [2023-12-28 07:51:53,605][106226] Updated weights for policy 0, policy_version 1753663 (0.0009) [2023-12-28 07:51:53,992][106225] Updated weights for policy 1, policy_version 1758031 (0.0008) [2023-12-28 07:51:54,051][106225] Updated weights for policy 1, policy_version 1758041 (0.0009) [2023-12-28 07:51:54,107][106225] Updated weights for policy 1, policy_version 1758051 (0.0008) [2023-12-28 07:51:54,342][106226] Updated weights for policy 0, policy_version 1753673 (0.0006) [2023-12-28 07:51:54,399][106226] Updated weights for policy 0, policy_version 1753683 (0.0008) [2023-12-28 07:51:54,455][106226] Updated weights for policy 0, policy_version 1753693 (0.0009) [2023-12-28 07:51:54,511][106226] Updated weights for policy 0, policy_version 1753703 (0.0009) [2023-12-28 07:51:54,846][106225] Updated weights for policy 1, policy_version 1758061 (0.0009) [2023-12-28 07:51:54,901][106225] Updated weights for policy 1, policy_version 1758071 (0.0008) [2023-12-28 07:51:54,956][106225] Updated weights for policy 1, policy_version 1758081 (0.0008) [2023-12-28 07:51:55,176][106226] Updated weights for policy 0, policy_version 1753713 (0.0008) [2023-12-28 07:51:55,230][106226] Updated weights for policy 0, policy_version 1753723 (0.0008) [2023-12-28 07:51:55,283][106226] Updated weights for policy 0, policy_version 1753733 (0.0008) [2023-12-28 07:51:55,618][106225] Updated weights for policy 1, policy_version 1758091 (0.0007) [2023-12-28 07:51:55,663][106225] Updated weights for policy 1, policy_version 1758101 (0.0005) [2023-12-28 07:51:55,711][106225] Updated weights for policy 1, policy_version 1758111 (0.0005) [2023-12-28 07:51:56,109][106226] Updated weights for policy 0, policy_version 1753743 (0.0009) [2023-12-28 07:51:56,167][106226] Updated weights for policy 0, policy_version 1753753 (0.0008) [2023-12-28 07:51:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 899170304. Throughput: 0: 10000.4, 1: 10112.3. Samples: 899144436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:51:56,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-5.010')] [2023-12-28 07:51:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001758120_450134016.pth... [2023-12-28 07:51:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001756936_449830912.pth [2023-12-28 07:51:56,216][106226] Updated weights for policy 0, policy_version 1753763 (0.0008) [2023-12-28 07:51:56,242][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001753768_449044480.pth... [2023-12-28 07:51:56,245][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001752584_448741376.pth [2023-12-28 07:51:56,279][106225] Updated weights for policy 1, policy_version 1758121 (0.0006) [2023-12-28 07:51:56,334][106225] Updated weights for policy 1, policy_version 1758131 (0.0010) [2023-12-28 07:51:56,387][106225] Updated weights for policy 1, policy_version 1758141 (0.0010) [2023-12-28 07:51:56,442][106225] Updated weights for policy 1, policy_version 1758151 (0.0010) [2023-12-28 07:51:56,954][106226] Updated weights for policy 0, policy_version 1753773 (0.0008) [2023-12-28 07:51:57,017][106226] Updated weights for policy 0, policy_version 1753783 (0.0008) [2023-12-28 07:51:57,075][106226] Updated weights for policy 0, policy_version 1753793 (0.0007) [2023-12-28 07:51:57,165][106225] Updated weights for policy 1, policy_version 1758161 (0.0010) [2023-12-28 07:51:57,217][106225] Updated weights for policy 1, policy_version 1758171 (0.0010) [2023-12-28 07:51:57,274][106225] Updated weights for policy 1, policy_version 1758181 (0.0010) [2023-12-28 07:51:57,802][106226] Updated weights for policy 0, policy_version 1753803 (0.0008) [2023-12-28 07:51:57,871][106226] Updated weights for policy 0, policy_version 1753813 (0.0008) [2023-12-28 07:51:57,927][106226] Updated weights for policy 0, policy_version 1753823 (0.0006) [2023-12-28 07:51:57,935][106225] Updated weights for policy 1, policy_version 1758191 (0.0010) [2023-12-28 07:51:57,985][106225] Updated weights for policy 1, policy_version 1758201 (0.0010) [2023-12-28 07:51:58,035][106225] Updated weights for policy 1, policy_version 1758211 (0.0010) [2023-12-28 07:51:58,694][106226] Updated weights for policy 0, policy_version 1753833 (0.0005) [2023-12-28 07:51:58,762][106226] Updated weights for policy 0, policy_version 1753843 (0.0010) [2023-12-28 07:51:58,833][106226] Updated weights for policy 0, policy_version 1753853 (0.0009) [2023-12-28 07:51:58,835][106225] Updated weights for policy 1, policy_version 1758221 (0.0009) [2023-12-28 07:51:58,908][106226] Updated weights for policy 0, policy_version 1753863 (0.0010) [2023-12-28 07:51:58,909][106225] Updated weights for policy 1, policy_version 1758231 (0.0007) [2023-12-28 07:51:58,975][106225] Updated weights for policy 1, policy_version 1758241 (0.0007) [2023-12-28 07:51:59,653][106226] Updated weights for policy 0, policy_version 1753873 (0.0007) [2023-12-28 07:51:59,680][106225] Updated weights for policy 1, policy_version 1758251 (0.0007) [2023-12-28 07:51:59,712][106226] Updated weights for policy 0, policy_version 1753883 (0.0005) [2023-12-28 07:51:59,737][106225] Updated weights for policy 1, policy_version 1758261 (0.0009) [2023-12-28 07:51:59,773][106226] Updated weights for policy 0, policy_version 1753893 (0.0006) [2023-12-28 07:51:59,796][106225] Updated weights for policy 1, policy_version 1758271 (0.0009) [2023-12-28 07:52:00,388][106226] Updated weights for policy 0, policy_version 1753903 (0.0008) [2023-12-28 07:52:00,441][106226] Updated weights for policy 0, policy_version 1753913 (0.0007) [2023-12-28 07:52:00,492][106226] Updated weights for policy 0, policy_version 1753923 (0.0010) [2023-12-28 07:52:00,506][106225] Updated weights for policy 1, policy_version 1758281 (0.0008) [2023-12-28 07:52:00,561][106225] Updated weights for policy 1, policy_version 1758291 (0.0005) [2023-12-28 07:52:00,612][106225] Updated weights for policy 1, policy_version 1758301 (0.0005) [2023-12-28 07:52:00,670][106225] Updated weights for policy 1, policy_version 1758311 (0.0009) [2023-12-28 07:52:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 899268608. Throughput: 0: 9981.2, 1: 10190.0. Samples: 899261656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:01,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.692')] [2023-12-28 07:52:01,263][106226] Updated weights for policy 0, policy_version 1753933 (0.0008) [2023-12-28 07:52:01,330][106226] Updated weights for policy 0, policy_version 1753943 (0.0008) [2023-12-28 07:52:01,391][106225] Updated weights for policy 1, policy_version 1758321 (0.0010) [2023-12-28 07:52:01,397][106226] Updated weights for policy 0, policy_version 1753953 (0.0008) [2023-12-28 07:52:01,457][106225] Updated weights for policy 1, policy_version 1758331 (0.0009) [2023-12-28 07:52:01,528][106225] Updated weights for policy 1, policy_version 1758341 (0.0008) [2023-12-28 07:52:02,120][106225] Updated weights for policy 1, policy_version 1758351 (0.0009) [2023-12-28 07:52:02,160][106226] Updated weights for policy 0, policy_version 1753963 (0.0008) [2023-12-28 07:52:02,184][106225] Updated weights for policy 1, policy_version 1758361 (0.0010) [2023-12-28 07:52:02,223][106226] Updated weights for policy 0, policy_version 1753973 (0.0008) [2023-12-28 07:52:02,246][106225] Updated weights for policy 1, policy_version 1758371 (0.0011) [2023-12-28 07:52:02,290][106226] Updated weights for policy 0, policy_version 1753983 (0.0008) [2023-12-28 07:52:02,946][106225] Updated weights for policy 1, policy_version 1758381 (0.0008) [2023-12-28 07:52:02,999][106225] Updated weights for policy 1, policy_version 1758391 (0.0005) [2023-12-28 07:52:03,013][106226] Updated weights for policy 0, policy_version 1753993 (0.0006) [2023-12-28 07:52:03,052][106225] Updated weights for policy 1, policy_version 1758401 (0.0007) [2023-12-28 07:52:03,066][106226] Updated weights for policy 0, policy_version 1754003 (0.0006) [2023-12-28 07:52:03,125][106226] Updated weights for policy 0, policy_version 1754013 (0.0009) [2023-12-28 07:52:03,184][106226] Updated weights for policy 0, policy_version 1754023 (0.0008) [2023-12-28 07:52:03,713][106225] Updated weights for policy 1, policy_version 1758411 (0.0006) [2023-12-28 07:52:03,776][106225] Updated weights for policy 1, policy_version 1758421 (0.0005) [2023-12-28 07:52:03,837][106225] Updated weights for policy 1, policy_version 1758431 (0.0006) [2023-12-28 07:52:03,905][106226] Updated weights for policy 0, policy_version 1754033 (0.0011) [2023-12-28 07:52:03,960][106226] Updated weights for policy 0, policy_version 1754043 (0.0011) [2023-12-28 07:52:04,018][106226] Updated weights for policy 0, policy_version 1754053 (0.0011) [2023-12-28 07:52:04,388][106225] Updated weights for policy 1, policy_version 1758441 (0.0007) [2023-12-28 07:52:04,438][106225] Updated weights for policy 1, policy_version 1758451 (0.0007) [2023-12-28 07:52:04,495][106225] Updated weights for policy 1, policy_version 1758461 (0.0007) [2023-12-28 07:52:04,551][106225] Updated weights for policy 1, policy_version 1758471 (0.0008) [2023-12-28 07:52:04,758][106226] Updated weights for policy 0, policy_version 1754063 (0.0009) [2023-12-28 07:52:04,825][106226] Updated weights for policy 0, policy_version 1754073 (0.0010) [2023-12-28 07:52:04,890][106226] Updated weights for policy 0, policy_version 1754083 (0.0011) [2023-12-28 07:52:05,264][106225] Updated weights for policy 1, policy_version 1758481 (0.0007) [2023-12-28 07:52:05,324][106225] Updated weights for policy 1, policy_version 1758491 (0.0007) [2023-12-28 07:52:05,376][106225] Updated weights for policy 1, policy_version 1758501 (0.0007) [2023-12-28 07:52:05,569][106226] Updated weights for policy 0, policy_version 1754093 (0.0011) [2023-12-28 07:52:05,628][106226] Updated weights for policy 0, policy_version 1754103 (0.0010) [2023-12-28 07:52:05,677][106226] Updated weights for policy 0, policy_version 1754113 (0.0010) [2023-12-28 07:52:05,936][106225] Updated weights for policy 1, policy_version 1758511 (0.0009) [2023-12-28 07:52:05,987][106225] Updated weights for policy 1, policy_version 1758521 (0.0010) [2023-12-28 07:52:06,038][106225] Updated weights for policy 1, policy_version 1758531 (0.0008) [2023-12-28 07:52:06,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19938.5). Total num frames: 899375104. Throughput: 0: 9964.6, 1: 10200.8. Samples: 899382000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:06,176][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.911')] [2023-12-28 07:52:06,338][106226] Updated weights for policy 0, policy_version 1754123 (0.0010) [2023-12-28 07:52:06,407][106226] Updated weights for policy 0, policy_version 1754133 (0.0011) [2023-12-28 07:52:06,472][106226] Updated weights for policy 0, policy_version 1754143 (0.0011) [2023-12-28 07:52:06,746][106225] Updated weights for policy 1, policy_version 1758541 (0.0009) [2023-12-28 07:52:06,800][106225] Updated weights for policy 1, policy_version 1758551 (0.0007) [2023-12-28 07:52:06,860][106225] Updated weights for policy 1, policy_version 1758561 (0.0007) [2023-12-28 07:52:07,176][106226] Updated weights for policy 0, policy_version 1754153 (0.0011) [2023-12-28 07:52:07,233][106226] Updated weights for policy 0, policy_version 1754163 (0.0011) [2023-12-28 07:52:07,295][106226] Updated weights for policy 0, policy_version 1754173 (0.0010) [2023-12-28 07:52:07,351][106226] Updated weights for policy 0, policy_version 1754183 (0.0010) [2023-12-28 07:52:07,598][106225] Updated weights for policy 1, policy_version 1758571 (0.0008) [2023-12-28 07:52:07,652][106225] Updated weights for policy 1, policy_version 1758581 (0.0008) [2023-12-28 07:52:07,717][106225] Updated weights for policy 1, policy_version 1758591 (0.0008) [2023-12-28 07:52:08,075][106226] Updated weights for policy 0, policy_version 1754193 (0.0011) [2023-12-28 07:52:08,135][106226] Updated weights for policy 0, policy_version 1754203 (0.0006) [2023-12-28 07:52:08,188][106226] Updated weights for policy 0, policy_version 1754213 (0.0005) [2023-12-28 07:52:08,480][106225] Updated weights for policy 1, policy_version 1758601 (0.0008) [2023-12-28 07:52:08,543][106225] Updated weights for policy 1, policy_version 1758611 (0.0008) [2023-12-28 07:52:08,610][106225] Updated weights for policy 1, policy_version 1758621 (0.0008) [2023-12-28 07:52:08,675][106225] Updated weights for policy 1, policy_version 1758631 (0.0006) [2023-12-28 07:52:08,898][106226] Updated weights for policy 0, policy_version 1754223 (0.0008) [2023-12-28 07:52:08,951][106226] Updated weights for policy 0, policy_version 1754233 (0.0010) [2023-12-28 07:52:09,003][106226] Updated weights for policy 0, policy_version 1754243 (0.0008) [2023-12-28 07:52:09,403][106225] Updated weights for policy 1, policy_version 1758641 (0.0009) [2023-12-28 07:52:09,473][106225] Updated weights for policy 1, policy_version 1758651 (0.0007) [2023-12-28 07:52:09,540][106225] Updated weights for policy 1, policy_version 1758661 (0.0008) [2023-12-28 07:52:09,701][106226] Updated weights for policy 0, policy_version 1754253 (0.0009) [2023-12-28 07:52:09,760][106226] Updated weights for policy 0, policy_version 1754263 (0.0006) [2023-12-28 07:52:09,822][106226] Updated weights for policy 0, policy_version 1754273 (0.0008) [2023-12-28 07:52:10,303][106225] Updated weights for policy 1, policy_version 1758671 (0.0007) [2023-12-28 07:52:10,364][106225] Updated weights for policy 1, policy_version 1758681 (0.0008) [2023-12-28 07:52:10,427][106225] Updated weights for policy 1, policy_version 1758691 (0.0009) [2023-12-28 07:52:10,597][106226] Updated weights for policy 0, policy_version 1754283 (0.0008) [2023-12-28 07:52:10,653][106226] Updated weights for policy 0, policy_version 1754293 (0.0009) [2023-12-28 07:52:10,714][106226] Updated weights for policy 0, policy_version 1754303 (0.0009) [2023-12-28 07:52:11,069][106225] Updated weights for policy 1, policy_version 1758701 (0.0009) [2023-12-28 07:52:11,132][106225] Updated weights for policy 1, policy_version 1758711 (0.0008) [2023-12-28 07:52:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 20070.4, 300 sec: 19938.5). Total num frames: 899465216. Throughput: 0: 9949.0, 1: 10182.1. Samples: 899439440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:11,175][105115] Avg episode reward: [(0, '-4.079'), (1, '-5.084')] [2023-12-28 07:52:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001754312_449183744.pth... [2023-12-28 07:52:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001753192_448897024.pth [2023-12-28 07:52:11,204][106225] Updated weights for policy 1, policy_version 1758721 (0.0008) [2023-12-28 07:52:11,246][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001758728_450289664.pth... [2023-12-28 07:52:11,252][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001757512_449978368.pth [2023-12-28 07:52:11,538][106226] Updated weights for policy 0, policy_version 1754313 (0.0009) [2023-12-28 07:52:11,595][106226] Updated weights for policy 0, policy_version 1754323 (0.0008) [2023-12-28 07:52:11,668][106226] Updated weights for policy 0, policy_version 1754333 (0.0009) [2023-12-28 07:52:11,738][106226] Updated weights for policy 0, policy_version 1754343 (0.0010) [2023-12-28 07:52:12,000][106225] Updated weights for policy 1, policy_version 1758731 (0.0008) [2023-12-28 07:52:12,067][106225] Updated weights for policy 1, policy_version 1758741 (0.0006) [2023-12-28 07:52:12,137][106225] Updated weights for policy 1, policy_version 1758751 (0.0007) [2023-12-28 07:52:12,435][106226] Updated weights for policy 0, policy_version 1754353 (0.0008) [2023-12-28 07:52:12,492][106226] Updated weights for policy 0, policy_version 1754363 (0.0010) [2023-12-28 07:52:12,561][106226] Updated weights for policy 0, policy_version 1754373 (0.0011) [2023-12-28 07:52:12,810][106225] Updated weights for policy 1, policy_version 1758761 (0.0008) [2023-12-28 07:52:12,859][106225] Updated weights for policy 1, policy_version 1758771 (0.0010) [2023-12-28 07:52:12,916][106225] Updated weights for policy 1, policy_version 1758781 (0.0010) [2023-12-28 07:52:12,968][106225] Updated weights for policy 1, policy_version 1758792 (0.0009) [2023-12-28 07:52:13,272][106226] Updated weights for policy 0, policy_version 1754383 (0.0011) [2023-12-28 07:52:13,322][106226] Updated weights for policy 0, policy_version 1754393 (0.0010) [2023-12-28 07:52:13,369][106226] Updated weights for policy 0, policy_version 1754403 (0.0010) [2023-12-28 07:52:13,608][106225] Updated weights for policy 1, policy_version 1758802 (0.0005) [2023-12-28 07:52:13,673][106225] Updated weights for policy 1, policy_version 1758812 (0.0005) [2023-12-28 07:52:13,742][106225] Updated weights for policy 1, policy_version 1758822 (0.0005) [2023-12-28 07:52:14,107][106226] Updated weights for policy 0, policy_version 1754413 (0.0011) [2023-12-28 07:52:14,164][106226] Updated weights for policy 0, policy_version 1754423 (0.0010) [2023-12-28 07:52:14,225][106226] Updated weights for policy 0, policy_version 1754433 (0.0010) [2023-12-28 07:52:14,350][106225] Updated weights for policy 1, policy_version 1758832 (0.0009) [2023-12-28 07:52:14,400][106225] Updated weights for policy 1, policy_version 1758842 (0.0010) [2023-12-28 07:52:14,456][106225] Updated weights for policy 1, policy_version 1758852 (0.0010) [2023-12-28 07:52:14,942][106226] Updated weights for policy 0, policy_version 1754443 (0.0010) [2023-12-28 07:52:15,012][106226] Updated weights for policy 0, policy_version 1754453 (0.0011) [2023-12-28 07:52:15,076][106226] Updated weights for policy 0, policy_version 1754463 (0.0010) [2023-12-28 07:52:15,161][106225] Updated weights for policy 1, policy_version 1758862 (0.0009) [2023-12-28 07:52:15,222][106225] Updated weights for policy 1, policy_version 1758872 (0.0008) [2023-12-28 07:52:15,279][106225] Updated weights for policy 1, policy_version 1758882 (0.0008) [2023-12-28 07:52:15,754][106226] Updated weights for policy 0, policy_version 1754473 (0.0010) [2023-12-28 07:52:15,814][106226] Updated weights for policy 0, policy_version 1754483 (0.0011) [2023-12-28 07:52:15,863][106226] Updated weights for policy 0, policy_version 1754493 (0.0010) [2023-12-28 07:52:15,913][106226] Updated weights for policy 0, policy_version 1754503 (0.0010) [2023-12-28 07:52:15,945][106225] Updated weights for policy 1, policy_version 1758892 (0.0007) [2023-12-28 07:52:15,993][106225] Updated weights for policy 1, policy_version 1758902 (0.0008) [2023-12-28 07:52:16,043][106225] Updated weights for policy 1, policy_version 1758912 (0.0008) [2023-12-28 07:52:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 899571712. Throughput: 0: 9771.9, 1: 10046.0. Samples: 899555520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:16,176][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.714')] [2023-12-28 07:52:16,609][106226] Updated weights for policy 0, policy_version 1754513 (0.0011) [2023-12-28 07:52:16,656][106226] Updated weights for policy 0, policy_version 1754523 (0.0010) [2023-12-28 07:52:16,710][106226] Updated weights for policy 0, policy_version 1754533 (0.0010) [2023-12-28 07:52:16,811][106225] Updated weights for policy 1, policy_version 1758922 (0.0008) [2023-12-28 07:52:16,868][106225] Updated weights for policy 1, policy_version 1758932 (0.0008) [2023-12-28 07:52:16,925][106225] Updated weights for policy 1, policy_version 1758942 (0.0006) [2023-12-28 07:52:16,976][106225] Updated weights for policy 1, policy_version 1758952 (0.0007) [2023-12-28 07:52:17,329][106226] Updated weights for policy 0, policy_version 1754543 (0.0010) [2023-12-28 07:52:17,382][106226] Updated weights for policy 0, policy_version 1754553 (0.0010) [2023-12-28 07:52:17,432][106226] Updated weights for policy 0, policy_version 1754563 (0.0010) [2023-12-28 07:52:17,754][106225] Updated weights for policy 1, policy_version 1758962 (0.0007) [2023-12-28 07:52:17,808][106225] Updated weights for policy 1, policy_version 1758972 (0.0007) [2023-12-28 07:52:17,866][106225] Updated weights for policy 1, policy_version 1758982 (0.0008) [2023-12-28 07:52:18,111][106226] Updated weights for policy 0, policy_version 1754573 (0.0008) [2023-12-28 07:52:18,159][106226] Updated weights for policy 0, policy_version 1754583 (0.0005) [2023-12-28 07:52:18,218][106226] Updated weights for policy 0, policy_version 1754593 (0.0005) [2023-12-28 07:52:18,581][106225] Updated weights for policy 1, policy_version 1758992 (0.0007) [2023-12-28 07:52:18,643][106225] Updated weights for policy 1, policy_version 1759002 (0.0008) [2023-12-28 07:52:18,708][106225] Updated weights for policy 1, policy_version 1759012 (0.0006) [2023-12-28 07:52:18,858][106226] Updated weights for policy 0, policy_version 1754603 (0.0007) [2023-12-28 07:52:18,916][106226] Updated weights for policy 0, policy_version 1754613 (0.0011) [2023-12-28 07:52:18,980][106226] Updated weights for policy 0, policy_version 1754623 (0.0010) [2023-12-28 07:52:19,268][106225] Updated weights for policy 1, policy_version 1759022 (0.0007) [2023-12-28 07:52:19,336][106225] Updated weights for policy 1, policy_version 1759032 (0.0007) [2023-12-28 07:52:19,395][106225] Updated weights for policy 1, policy_version 1759043 (0.0008) [2023-12-28 07:52:19,758][106226] Updated weights for policy 0, policy_version 1754633 (0.0011) [2023-12-28 07:52:19,827][106226] Updated weights for policy 0, policy_version 1754643 (0.0008) [2023-12-28 07:52:19,892][106226] Updated weights for policy 0, policy_version 1754653 (0.0008) [2023-12-28 07:52:19,956][106226] Updated weights for policy 0, policy_version 1754663 (0.0008) [2023-12-28 07:52:20,144][106225] Updated weights for policy 1, policy_version 1759053 (0.0009) [2023-12-28 07:52:20,209][106225] Updated weights for policy 1, policy_version 1759063 (0.0011) [2023-12-28 07:52:20,271][106225] Updated weights for policy 1, policy_version 1759073 (0.0010) [2023-12-28 07:52:20,728][106226] Updated weights for policy 0, policy_version 1754673 (0.0007) [2023-12-28 07:52:20,781][106226] Updated weights for policy 0, policy_version 1754683 (0.0008) [2023-12-28 07:52:20,841][106226] Updated weights for policy 0, policy_version 1754693 (0.0006) [2023-12-28 07:52:20,962][106225] Updated weights for policy 1, policy_version 1759083 (0.0010) [2023-12-28 07:52:21,025][106225] Updated weights for policy 1, policy_version 1759093 (0.0009) [2023-12-28 07:52:21,099][106225] Updated weights for policy 1, policy_version 1759103 (0.0009) [2023-12-28 07:52:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20206.9, 300 sec: 19966.3). Total num frames: 899670016. Throughput: 0: 9728.6, 1: 10039.4. Samples: 899675088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:21,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.677')] [2023-12-28 07:52:21,605][106226] Updated weights for policy 0, policy_version 1754703 (0.0007) [2023-12-28 07:52:21,677][106226] Updated weights for policy 0, policy_version 1754713 (0.0007) [2023-12-28 07:52:21,748][106226] Updated weights for policy 0, policy_version 1754723 (0.0010) [2023-12-28 07:52:21,844][106225] Updated weights for policy 1, policy_version 1759113 (0.0008) [2023-12-28 07:52:21,913][106225] Updated weights for policy 1, policy_version 1759123 (0.0007) [2023-12-28 07:52:21,978][106225] Updated weights for policy 1, policy_version 1759133 (0.0008) [2023-12-28 07:52:22,042][106225] Updated weights for policy 1, policy_version 1759143 (0.0006) [2023-12-28 07:52:22,443][106226] Updated weights for policy 0, policy_version 1754733 (0.0009) [2023-12-28 07:52:22,513][106226] Updated weights for policy 0, policy_version 1754743 (0.0008) [2023-12-28 07:52:22,584][106226] Updated weights for policy 0, policy_version 1754753 (0.0009) [2023-12-28 07:52:22,719][106225] Updated weights for policy 1, policy_version 1759153 (0.0009) [2023-12-28 07:52:22,773][106225] Updated weights for policy 1, policy_version 1759163 (0.0010) [2023-12-28 07:52:22,831][106225] Updated weights for policy 1, policy_version 1759173 (0.0010) [2023-12-28 07:52:23,274][106226] Updated weights for policy 0, policy_version 1754763 (0.0008) [2023-12-28 07:52:23,334][106226] Updated weights for policy 0, policy_version 1754773 (0.0009) [2023-12-28 07:52:23,393][106226] Updated weights for policy 0, policy_version 1754783 (0.0008) [2023-12-28 07:52:23,569][106225] Updated weights for policy 1, policy_version 1759183 (0.0006) [2023-12-28 07:52:23,625][106225] Updated weights for policy 1, policy_version 1759193 (0.0005) [2023-12-28 07:52:23,689][106225] Updated weights for policy 1, policy_version 1759203 (0.0005) [2023-12-28 07:52:24,094][106226] Updated weights for policy 0, policy_version 1754793 (0.0006) [2023-12-28 07:52:24,143][106226] Updated weights for policy 0, policy_version 1754803 (0.0009) [2023-12-28 07:52:24,198][106226] Updated weights for policy 0, policy_version 1754813 (0.0008) [2023-12-28 07:52:24,255][106226] Updated weights for policy 0, policy_version 1754823 (0.0007) [2023-12-28 07:52:24,257][106225] Updated weights for policy 1, policy_version 1759213 (0.0007) [2023-12-28 07:52:24,305][106225] Updated weights for policy 1, policy_version 1759223 (0.0008) [2023-12-28 07:52:24,363][106225] Updated weights for policy 1, policy_version 1759233 (0.0008) [2023-12-28 07:52:24,987][106226] Updated weights for policy 0, policy_version 1754833 (0.0010) [2023-12-28 07:52:25,033][106226] Updated weights for policy 0, policy_version 1754843 (0.0010) [2023-12-28 07:52:25,079][106226] Updated weights for policy 0, policy_version 1754853 (0.0010) [2023-12-28 07:52:25,115][106225] Updated weights for policy 1, policy_version 1759243 (0.0008) [2023-12-28 07:52:25,171][106225] Updated weights for policy 1, policy_version 1759253 (0.0007) [2023-12-28 07:52:25,219][106225] Updated weights for policy 1, policy_version 1759263 (0.0009) [2023-12-28 07:52:25,741][106226] Updated weights for policy 0, policy_version 1754863 (0.0010) [2023-12-28 07:52:25,794][106226] Updated weights for policy 0, policy_version 1754873 (0.0010) [2023-12-28 07:52:25,840][106226] Updated weights for policy 0, policy_version 1754883 (0.0010) [2023-12-28 07:52:25,975][106225] Updated weights for policy 1, policy_version 1759273 (0.0009) [2023-12-28 07:52:26,033][106225] Updated weights for policy 1, policy_version 1759283 (0.0008) [2023-12-28 07:52:26,084][106225] Updated weights for policy 1, policy_version 1759293 (0.0008) [2023-12-28 07:52:26,134][106225] Updated weights for policy 1, policy_version 1759303 (0.0009) [2023-12-28 07:52:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 20070.2, 300 sec: 19938.5). Total num frames: 899768320. Throughput: 0: 9716.1, 1: 10060.7. Samples: 899732572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:26,176][105115] Avg episode reward: [(0, '-4.638'), (1, '-4.737')] [2023-12-28 07:52:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001759304_450437120.pth... [2023-12-28 07:52:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001754888_449331200.pth... [2023-12-28 07:52:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001753768_449044480.pth [2023-12-28 07:52:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001758120_450134016.pth [2023-12-28 07:52:26,423][106226] Updated weights for policy 0, policy_version 1754893 (0.0010) [2023-12-28 07:52:26,473][106226] Updated weights for policy 0, policy_version 1754903 (0.0008) [2023-12-28 07:52:26,526][106226] Updated weights for policy 0, policy_version 1754913 (0.0005) [2023-12-28 07:52:26,891][106225] Updated weights for policy 1, policy_version 1759313 (0.0008) [2023-12-28 07:52:26,947][106225] Updated weights for policy 1, policy_version 1759323 (0.0008) [2023-12-28 07:52:27,002][106225] Updated weights for policy 1, policy_version 1759333 (0.0008) [2023-12-28 07:52:27,157][106226] Updated weights for policy 0, policy_version 1754923 (0.0008) [2023-12-28 07:52:27,215][106226] Updated weights for policy 0, policy_version 1754933 (0.0010) [2023-12-28 07:52:27,277][106226] Updated weights for policy 0, policy_version 1754943 (0.0010) [2023-12-28 07:52:27,789][106225] Updated weights for policy 1, policy_version 1759343 (0.0008) [2023-12-28 07:52:27,846][106225] Updated weights for policy 1, policy_version 1759353 (0.0008) [2023-12-28 07:52:27,857][106226] Updated weights for policy 0, policy_version 1754953 (0.0010) [2023-12-28 07:52:27,897][106225] Updated weights for policy 1, policy_version 1759363 (0.0008) [2023-12-28 07:52:27,907][106226] Updated weights for policy 0, policy_version 1754963 (0.0006) [2023-12-28 07:52:27,956][106226] Updated weights for policy 0, policy_version 1754973 (0.0007) [2023-12-28 07:52:28,015][106226] Updated weights for policy 0, policy_version 1754983 (0.0007) [2023-12-28 07:52:28,648][106225] Updated weights for policy 1, policy_version 1759373 (0.0008) [2023-12-28 07:52:28,708][106225] Updated weights for policy 1, policy_version 1759383 (0.0010) [2023-12-28 07:52:28,723][106226] Updated weights for policy 0, policy_version 1754993 (0.0006) [2023-12-28 07:52:28,769][106225] Updated weights for policy 1, policy_version 1759393 (0.0009) [2023-12-28 07:52:28,784][106226] Updated weights for policy 0, policy_version 1755003 (0.0006) [2023-12-28 07:52:28,840][106226] Updated weights for policy 0, policy_version 1755013 (0.0005) [2023-12-28 07:52:29,422][106225] Updated weights for policy 1, policy_version 1759403 (0.0008) [2023-12-28 07:52:29,472][106225] Updated weights for policy 1, policy_version 1759413 (0.0007) [2023-12-28 07:52:29,520][106225] Updated weights for policy 1, policy_version 1759423 (0.0006) [2023-12-28 07:52:29,530][106226] Updated weights for policy 0, policy_version 1755023 (0.0007) [2023-12-28 07:52:29,586][106226] Updated weights for policy 0, policy_version 1755033 (0.0008) [2023-12-28 07:52:29,637][106226] Updated weights for policy 0, policy_version 1755043 (0.0008) [2023-12-28 07:52:30,272][106225] Updated weights for policy 1, policy_version 1759433 (0.0007) [2023-12-28 07:52:30,325][106225] Updated weights for policy 1, policy_version 1759443 (0.0007) [2023-12-28 07:52:30,381][106225] Updated weights for policy 1, policy_version 1759453 (0.0007) [2023-12-28 07:52:30,400][106226] Updated weights for policy 0, policy_version 1755053 (0.0008) [2023-12-28 07:52:30,436][106225] Updated weights for policy 1, policy_version 1759463 (0.0009) [2023-12-28 07:52:30,455][106226] Updated weights for policy 0, policy_version 1755063 (0.0006) [2023-12-28 07:52:30,515][106226] Updated weights for policy 0, policy_version 1755073 (0.0008) [2023-12-28 07:52:31,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 899858432. Throughput: 0: 9790.9, 1: 10051.8. Samples: 899853552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:31,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.744')] [2023-12-28 07:52:31,210][106225] Updated weights for policy 1, policy_version 1759473 (0.0009) [2023-12-28 07:52:31,226][106226] Updated weights for policy 0, policy_version 1755083 (0.0009) [2023-12-28 07:52:31,271][106225] Updated weights for policy 1, policy_version 1759483 (0.0008) [2023-12-28 07:52:31,285][106226] Updated weights for policy 0, policy_version 1755093 (0.0007) [2023-12-28 07:52:31,330][106225] Updated weights for policy 1, policy_version 1759493 (0.0007) [2023-12-28 07:52:31,352][106226] Updated weights for policy 0, policy_version 1755103 (0.0008) [2023-12-28 07:52:31,980][106226] Updated weights for policy 0, policy_version 1755113 (0.0007) [2023-12-28 07:52:32,042][106226] Updated weights for policy 0, policy_version 1755123 (0.0008) [2023-12-28 07:52:32,105][106226] Updated weights for policy 0, policy_version 1755133 (0.0008) [2023-12-28 07:52:32,133][106225] Updated weights for policy 1, policy_version 1759503 (0.0008) [2023-12-28 07:52:32,159][106226] Updated weights for policy 0, policy_version 1755143 (0.0006) [2023-12-28 07:52:32,195][106225] Updated weights for policy 1, policy_version 1759513 (0.0008) [2023-12-28 07:52:32,264][106225] Updated weights for policy 1, policy_version 1759523 (0.0008) [2023-12-28 07:52:32,851][106226] Updated weights for policy 0, policy_version 1755153 (0.0005) [2023-12-28 07:52:32,917][106226] Updated weights for policy 0, policy_version 1755163 (0.0006) [2023-12-28 07:52:32,972][106226] Updated weights for policy 0, policy_version 1755173 (0.0007) [2023-12-28 07:52:33,035][106225] Updated weights for policy 1, policy_version 1759533 (0.0009) [2023-12-28 07:52:33,082][106225] Updated weights for policy 1, policy_version 1759543 (0.0007) [2023-12-28 07:52:33,139][106225] Updated weights for policy 1, policy_version 1759553 (0.0007) [2023-12-28 07:52:33,614][106226] Updated weights for policy 0, policy_version 1755183 (0.0008) [2023-12-28 07:52:33,660][106226] Updated weights for policy 0, policy_version 1755193 (0.0010) [2023-12-28 07:52:33,708][106226] Updated weights for policy 0, policy_version 1755203 (0.0010) [2023-12-28 07:52:33,770][106225] Updated weights for policy 1, policy_version 1759563 (0.0007) [2023-12-28 07:52:33,825][106225] Updated weights for policy 1, policy_version 1759573 (0.0005) [2023-12-28 07:52:33,875][106225] Updated weights for policy 1, policy_version 1759583 (0.0007) [2023-12-28 07:52:34,371][106226] Updated weights for policy 0, policy_version 1755213 (0.0006) [2023-12-28 07:52:34,438][106226] Updated weights for policy 0, policy_version 1755223 (0.0005) [2023-12-28 07:52:34,499][106226] Updated weights for policy 0, policy_version 1755233 (0.0007) [2023-12-28 07:52:34,567][106225] Updated weights for policy 1, policy_version 1759593 (0.0007) [2023-12-28 07:52:34,629][106225] Updated weights for policy 1, policy_version 1759603 (0.0008) [2023-12-28 07:52:34,691][106225] Updated weights for policy 1, policy_version 1759613 (0.0008) [2023-12-28 07:52:34,757][106225] Updated weights for policy 1, policy_version 1759623 (0.0008) [2023-12-28 07:52:35,114][106226] Updated weights for policy 0, policy_version 1755243 (0.0009) [2023-12-28 07:52:35,175][106226] Updated weights for policy 0, policy_version 1755253 (0.0010) [2023-12-28 07:52:35,238][106226] Updated weights for policy 0, policy_version 1755263 (0.0011) [2023-12-28 07:52:35,562][106225] Updated weights for policy 1, policy_version 1759633 (0.0008) [2023-12-28 07:52:35,623][106225] Updated weights for policy 1, policy_version 1759643 (0.0008) [2023-12-28 07:52:35,677][106225] Updated weights for policy 1, policy_version 1759653 (0.0008) [2023-12-28 07:52:35,895][106226] Updated weights for policy 0, policy_version 1755273 (0.0011) [2023-12-28 07:52:35,954][106226] Updated weights for policy 0, policy_version 1755283 (0.0010) [2023-12-28 07:52:36,007][106226] Updated weights for policy 0, policy_version 1755293 (0.0010) [2023-12-28 07:52:36,057][106226] Updated weights for policy 0, policy_version 1755303 (0.0010) [2023-12-28 07:52:36,174][105115] Fps is (10 sec: 19662.0, 60 sec: 19933.9, 300 sec: 19938.5). Total num frames: 899964928. Throughput: 0: 9822.9, 1: 9914.4. Samples: 899971548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:36,175][105115] Avg episode reward: [(0, '-4.718'), (1, '-5.138')] [2023-12-28 07:52:36,442][106225] Updated weights for policy 1, policy_version 1759663 (0.0008) [2023-12-28 07:52:36,495][106225] Updated weights for policy 1, policy_version 1759673 (0.0008) [2023-12-28 07:52:36,551][106225] Updated weights for policy 1, policy_version 1759683 (0.0008) [2023-12-28 07:52:36,805][106226] Updated weights for policy 0, policy_version 1755313 (0.0009) [2023-12-28 07:52:36,862][106226] Updated weights for policy 0, policy_version 1755323 (0.0005) [2023-12-28 07:52:36,919][106226] Updated weights for policy 0, policy_version 1755333 (0.0006) [2023-12-28 07:52:37,385][106225] Updated weights for policy 1, policy_version 1759693 (0.0008) [2023-12-28 07:52:37,440][106225] Updated weights for policy 1, policy_version 1759703 (0.0008) [2023-12-28 07:52:37,494][106225] Updated weights for policy 1, policy_version 1759713 (0.0007) [2023-12-28 07:52:37,496][106226] Updated weights for policy 0, policy_version 1755343 (0.0009) [2023-12-28 07:52:37,550][106226] Updated weights for policy 0, policy_version 1755353 (0.0011) [2023-12-28 07:52:37,608][106226] Updated weights for policy 0, policy_version 1755363 (0.0011) [2023-12-28 07:52:38,263][106225] Updated weights for policy 1, policy_version 1759723 (0.0007) [2023-12-28 07:52:38,283][106226] Updated weights for policy 0, policy_version 1755373 (0.0009) [2023-12-28 07:52:38,310][106225] Updated weights for policy 1, policy_version 1759733 (0.0007) [2023-12-28 07:52:38,348][106226] Updated weights for policy 0, policy_version 1755383 (0.0007) [2023-12-28 07:52:38,384][106225] Updated weights for policy 1, policy_version 1759743 (0.0006) [2023-12-28 07:52:38,412][106226] Updated weights for policy 0, policy_version 1755393 (0.0008) [2023-12-28 07:52:39,069][106226] Updated weights for policy 0, policy_version 1755403 (0.0007) [2023-12-28 07:52:39,133][106226] Updated weights for policy 0, policy_version 1755413 (0.0009) [2023-12-28 07:52:39,166][106225] Updated weights for policy 1, policy_version 1759753 (0.0006) [2023-12-28 07:52:39,192][106226] Updated weights for policy 0, policy_version 1755423 (0.0008) [2023-12-28 07:52:39,236][106225] Updated weights for policy 1, policy_version 1759763 (0.0008) [2023-12-28 07:52:39,310][106225] Updated weights for policy 1, policy_version 1759773 (0.0008) [2023-12-28 07:52:39,378][106225] Updated weights for policy 1, policy_version 1759783 (0.0007) [2023-12-28 07:52:40,006][106226] Updated weights for policy 0, policy_version 1755433 (0.0009) [2023-12-28 07:52:40,074][106226] Updated weights for policy 0, policy_version 1755443 (0.0009) [2023-12-28 07:52:40,137][106225] Updated weights for policy 1, policy_version 1759793 (0.0008) [2023-12-28 07:52:40,145][106226] Updated weights for policy 0, policy_version 1755453 (0.0006) [2023-12-28 07:52:40,205][106225] Updated weights for policy 1, policy_version 1759803 (0.0008) [2023-12-28 07:52:40,207][106226] Updated weights for policy 0, policy_version 1755463 (0.0006) [2023-12-28 07:52:40,272][106225] Updated weights for policy 1, policy_version 1759813 (0.0008) [2023-12-28 07:52:40,877][106226] Updated weights for policy 0, policy_version 1755473 (0.0008) [2023-12-28 07:52:40,939][106225] Updated weights for policy 1, policy_version 1759823 (0.0008) [2023-12-28 07:52:40,942][106226] Updated weights for policy 0, policy_version 1755483 (0.0011) [2023-12-28 07:52:40,997][106225] Updated weights for policy 1, policy_version 1759833 (0.0008) [2023-12-28 07:52:41,001][106226] Updated weights for policy 0, policy_version 1755493 (0.0011) [2023-12-28 07:52:41,072][106225] Updated weights for policy 1, policy_version 1759844 (0.0012) [2023-12-28 07:52:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 900063232. Throughput: 0: 9880.1, 1: 9794.5. Samples: 900029792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:41,175][105115] Avg episode reward: [(0, '-4.283'), (1, '-4.793')] [2023-12-28 07:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001759848_450576384.pth... [2023-12-28 07:52:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001755496_449486848.pth... [2023-12-28 07:52:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001754312_449183744.pth [2023-12-28 07:52:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001758728_450289664.pth [2023-12-28 07:52:41,779][106225] Updated weights for policy 1, policy_version 1759854 (0.0008) [2023-12-28 07:52:41,804][106226] Updated weights for policy 0, policy_version 1755503 (0.0008) [2023-12-28 07:52:41,847][106225] Updated weights for policy 1, policy_version 1759864 (0.0008) [2023-12-28 07:52:41,861][106226] Updated weights for policy 0, policy_version 1755513 (0.0005) [2023-12-28 07:52:41,912][106225] Updated weights for policy 1, policy_version 1759874 (0.0010) [2023-12-28 07:52:41,916][106226] Updated weights for policy 0, policy_version 1755523 (0.0010) [2023-12-28 07:52:42,616][106225] Updated weights for policy 1, policy_version 1759884 (0.0009) [2023-12-28 07:52:42,629][106226] Updated weights for policy 0, policy_version 1755533 (0.0009) [2023-12-28 07:52:42,675][106225] Updated weights for policy 1, policy_version 1759894 (0.0010) [2023-12-28 07:52:42,689][106226] Updated weights for policy 0, policy_version 1755543 (0.0008) [2023-12-28 07:52:42,754][106226] Updated weights for policy 0, policy_version 1755553 (0.0008) [2023-12-28 07:52:42,758][106225] Updated weights for policy 1, policy_version 1759904 (0.0009) [2023-12-28 07:52:43,342][106225] Updated weights for policy 1, policy_version 1759914 (0.0008) [2023-12-28 07:52:43,393][106225] Updated weights for policy 1, policy_version 1759924 (0.0006) [2023-12-28 07:52:43,442][106226] Updated weights for policy 0, policy_version 1755563 (0.0005) [2023-12-28 07:52:43,442][106225] Updated weights for policy 1, policy_version 1759934 (0.0006) [2023-12-28 07:52:43,488][106225] Updated weights for policy 1, policy_version 1759944 (0.0005) [2023-12-28 07:52:43,503][106226] Updated weights for policy 0, policy_version 1755573 (0.0005) [2023-12-28 07:52:43,562][106226] Updated weights for policy 0, policy_version 1755583 (0.0005) [2023-12-28 07:52:44,047][106225] Updated weights for policy 1, policy_version 1759954 (0.0008) [2023-12-28 07:52:44,098][106225] Updated weights for policy 1, policy_version 1759964 (0.0008) [2023-12-28 07:52:44,147][106225] Updated weights for policy 1, policy_version 1759974 (0.0008) [2023-12-28 07:52:44,170][106226] Updated weights for policy 0, policy_version 1755593 (0.0005) [2023-12-28 07:52:44,225][106226] Updated weights for policy 0, policy_version 1755603 (0.0009) [2023-12-28 07:52:44,283][106226] Updated weights for policy 0, policy_version 1755613 (0.0008) [2023-12-28 07:52:44,347][106226] Updated weights for policy 0, policy_version 1755623 (0.0009) [2023-12-28 07:52:44,907][106225] Updated weights for policy 1, policy_version 1759984 (0.0007) [2023-12-28 07:52:44,969][106225] Updated weights for policy 1, policy_version 1759994 (0.0009) [2023-12-28 07:52:45,015][106226] Updated weights for policy 0, policy_version 1755633 (0.0007) [2023-12-28 07:52:45,030][106225] Updated weights for policy 1, policy_version 1760004 (0.0007) [2023-12-28 07:52:45,084][106226] Updated weights for policy 0, policy_version 1755643 (0.0007) [2023-12-28 07:52:45,149][106226] Updated weights for policy 0, policy_version 1755653 (0.0009) [2023-12-28 07:52:45,706][106225] Updated weights for policy 1, policy_version 1760014 (0.0008) [2023-12-28 07:52:45,762][106225] Updated weights for policy 1, policy_version 1760024 (0.0008) [2023-12-28 07:52:45,820][106225] Updated weights for policy 1, policy_version 1760034 (0.0008) [2023-12-28 07:52:45,834][106226] Updated weights for policy 0, policy_version 1755663 (0.0007) [2023-12-28 07:52:45,882][106226] Updated weights for policy 0, policy_version 1755673 (0.0006) [2023-12-28 07:52:45,933][106226] Updated weights for policy 0, policy_version 1755683 (0.0005) [2023-12-28 07:52:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 900161536. Throughput: 0: 9923.2, 1: 9779.5. Samples: 900148280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:46,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-5.020')] [2023-12-28 07:52:46,506][106225] Updated weights for policy 1, policy_version 1760044 (0.0008) [2023-12-28 07:52:46,553][106225] Updated weights for policy 1, policy_version 1760054 (0.0006) [2023-12-28 07:52:46,604][106225] Updated weights for policy 1, policy_version 1760064 (0.0007) [2023-12-28 07:52:46,632][106226] Updated weights for policy 0, policy_version 1755693 (0.0005) [2023-12-28 07:52:46,687][106226] Updated weights for policy 0, policy_version 1755703 (0.0008) [2023-12-28 07:52:46,742][106226] Updated weights for policy 0, policy_version 1755713 (0.0008) [2023-12-28 07:52:47,317][106225] Updated weights for policy 1, policy_version 1760074 (0.0006) [2023-12-28 07:52:47,364][106225] Updated weights for policy 1, policy_version 1760084 (0.0005) [2023-12-28 07:52:47,415][106225] Updated weights for policy 1, policy_version 1760094 (0.0006) [2023-12-28 07:52:47,459][106225] Updated weights for policy 1, policy_version 1760104 (0.0008) [2023-12-28 07:52:47,499][106226] Updated weights for policy 0, policy_version 1755723 (0.0009) [2023-12-28 07:52:47,560][106226] Updated weights for policy 0, policy_version 1755733 (0.0007) [2023-12-28 07:52:47,616][106226] Updated weights for policy 0, policy_version 1755743 (0.0008) [2023-12-28 07:52:48,132][106225] Updated weights for policy 1, policy_version 1760114 (0.0009) [2023-12-28 07:52:48,190][106225] Updated weights for policy 1, policy_version 1760124 (0.0009) [2023-12-28 07:52:48,245][106225] Updated weights for policy 1, policy_version 1760134 (0.0007) [2023-12-28 07:52:48,339][106226] Updated weights for policy 0, policy_version 1755753 (0.0008) [2023-12-28 07:52:48,406][106226] Updated weights for policy 0, policy_version 1755763 (0.0008) [2023-12-28 07:52:48,474][106226] Updated weights for policy 0, policy_version 1755773 (0.0009) [2023-12-28 07:52:48,540][106226] Updated weights for policy 0, policy_version 1755783 (0.0009) [2023-12-28 07:52:48,960][106225] Updated weights for policy 1, policy_version 1760144 (0.0008) [2023-12-28 07:52:49,020][106225] Updated weights for policy 1, policy_version 1760154 (0.0009) [2023-12-28 07:52:49,083][106225] Updated weights for policy 1, policy_version 1760164 (0.0008) [2023-12-28 07:52:49,273][106226] Updated weights for policy 0, policy_version 1755793 (0.0008) [2023-12-28 07:52:49,342][106226] Updated weights for policy 0, policy_version 1755803 (0.0009) [2023-12-28 07:52:49,401][106226] Updated weights for policy 0, policy_version 1755813 (0.0008) [2023-12-28 07:52:49,859][106225] Updated weights for policy 1, policy_version 1760174 (0.0009) [2023-12-28 07:52:49,926][106225] Updated weights for policy 1, policy_version 1760184 (0.0006) [2023-12-28 07:52:49,986][106225] Updated weights for policy 1, policy_version 1760194 (0.0006) [2023-12-28 07:52:50,162][106226] Updated weights for policy 0, policy_version 1755823 (0.0009) [2023-12-28 07:52:50,215][106226] Updated weights for policy 0, policy_version 1755833 (0.0009) [2023-12-28 07:52:50,271][106226] Updated weights for policy 0, policy_version 1755843 (0.0009) [2023-12-28 07:52:50,659][106225] Updated weights for policy 1, policy_version 1760204 (0.0006) [2023-12-28 07:52:50,718][106225] Updated weights for policy 1, policy_version 1760214 (0.0006) [2023-12-28 07:52:50,779][106225] Updated weights for policy 1, policy_version 1760224 (0.0006) [2023-12-28 07:52:51,087][106226] Updated weights for policy 0, policy_version 1755853 (0.0010) [2023-12-28 07:52:51,152][106226] Updated weights for policy 0, policy_version 1755863 (0.0011) [2023-12-28 07:52:51,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.2, 300 sec: 19883.0). Total num frames: 900251648. Throughput: 0: 9893.8, 1: 9721.9. Samples: 900264704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:51,175][105115] Avg episode reward: [(0, '-4.651'), (1, '-5.068')] [2023-12-28 07:52:51,210][106226] Updated weights for policy 0, policy_version 1755873 (0.0009) [2023-12-28 07:52:51,455][106225] Updated weights for policy 1, policy_version 1760234 (0.0006) [2023-12-28 07:52:51,512][106225] Updated weights for policy 1, policy_version 1760244 (0.0008) [2023-12-28 07:52:51,564][106225] Updated weights for policy 1, policy_version 1760254 (0.0007) [2023-12-28 07:52:51,623][106225] Updated weights for policy 1, policy_version 1760264 (0.0008) [2023-12-28 07:52:51,916][106226] Updated weights for policy 0, policy_version 1755883 (0.0011) [2023-12-28 07:52:51,977][106226] Updated weights for policy 0, policy_version 1755893 (0.0011) [2023-12-28 07:52:52,038][106226] Updated weights for policy 0, policy_version 1755903 (0.0011) [2023-12-28 07:52:52,383][106225] Updated weights for policy 1, policy_version 1760274 (0.0008) [2023-12-28 07:52:52,443][106225] Updated weights for policy 1, policy_version 1760284 (0.0008) [2023-12-28 07:52:52,502][106225] Updated weights for policy 1, policy_version 1760294 (0.0008) [2023-12-28 07:52:52,755][106226] Updated weights for policy 0, policy_version 1755913 (0.0010) [2023-12-28 07:52:52,820][106226] Updated weights for policy 0, policy_version 1755923 (0.0006) [2023-12-28 07:52:52,886][106226] Updated weights for policy 0, policy_version 1755933 (0.0005) [2023-12-28 07:52:52,941][106226] Updated weights for policy 0, policy_version 1755943 (0.0005) [2023-12-28 07:52:53,274][106225] Updated weights for policy 1, policy_version 1760304 (0.0009) [2023-12-28 07:52:53,318][106225] Updated weights for policy 1, policy_version 1760314 (0.0008) [2023-12-28 07:52:53,368][106225] Updated weights for policy 1, policy_version 1760324 (0.0009) [2023-12-28 07:52:53,506][106226] Updated weights for policy 0, policy_version 1755953 (0.0007) [2023-12-28 07:52:53,566][106226] Updated weights for policy 0, policy_version 1755963 (0.0008) [2023-12-28 07:52:53,622][106226] Updated weights for policy 0, policy_version 1755973 (0.0009) [2023-12-28 07:52:54,124][106225] Updated weights for policy 1, policy_version 1760335 (0.0007) [2023-12-28 07:52:54,178][106225] Updated weights for policy 1, policy_version 1760345 (0.0005) [2023-12-28 07:52:54,204][106226] Updated weights for policy 0, policy_version 1755983 (0.0008) [2023-12-28 07:52:54,240][106225] Updated weights for policy 1, policy_version 1760355 (0.0005) [2023-12-28 07:52:54,253][106226] Updated weights for policy 0, policy_version 1755993 (0.0008) [2023-12-28 07:52:54,305][106226] Updated weights for policy 0, policy_version 1756003 (0.0008) [2023-12-28 07:52:54,912][106225] Updated weights for policy 1, policy_version 1760365 (0.0007) [2023-12-28 07:52:54,978][106225] Updated weights for policy 1, policy_version 1760375 (0.0008) [2023-12-28 07:52:55,004][106226] Updated weights for policy 0, policy_version 1756013 (0.0010) [2023-12-28 07:52:55,036][106225] Updated weights for policy 1, policy_version 1760385 (0.0006) [2023-12-28 07:52:55,066][106226] Updated weights for policy 0, policy_version 1756023 (0.0006) [2023-12-28 07:52:55,131][106226] Updated weights for policy 0, policy_version 1756033 (0.0006) [2023-12-28 07:52:55,675][106226] Updated weights for policy 0, policy_version 1756043 (0.0009) [2023-12-28 07:52:55,735][106226] Updated weights for policy 0, policy_version 1756053 (0.0007) [2023-12-28 07:52:55,793][106226] Updated weights for policy 0, policy_version 1756063 (0.0008) [2023-12-28 07:52:55,847][106225] Updated weights for policy 1, policy_version 1760395 (0.0008) [2023-12-28 07:52:55,908][106225] Updated weights for policy 1, policy_version 1760405 (0.0008) [2023-12-28 07:52:55,977][106225] Updated weights for policy 1, policy_version 1760415 (0.0009) [2023-12-28 07:52:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 900358144. Throughput: 0: 9946.9, 1: 9711.8. Samples: 900324084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:52:56,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.659')] [2023-12-28 07:52:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001756072_449634304.pth... [2023-12-28 07:52:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001760424_450723840.pth... [2023-12-28 07:52:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001754888_449331200.pth [2023-12-28 07:52:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001759304_450437120.pth [2023-12-28 07:52:56,408][106226] Updated weights for policy 0, policy_version 1756073 (0.0005) [2023-12-28 07:52:56,464][106226] Updated weights for policy 0, policy_version 1756083 (0.0008) [2023-12-28 07:52:56,522][106226] Updated weights for policy 0, policy_version 1756093 (0.0008) [2023-12-28 07:52:56,587][106226] Updated weights for policy 0, policy_version 1756103 (0.0008) [2023-12-28 07:52:56,717][106225] Updated weights for policy 1, policy_version 1760425 (0.0008) [2023-12-28 07:52:56,770][106225] Updated weights for policy 1, policy_version 1760435 (0.0009) [2023-12-28 07:52:56,830][106225] Updated weights for policy 1, policy_version 1760445 (0.0008) [2023-12-28 07:52:56,881][106225] Updated weights for policy 1, policy_version 1760455 (0.0008) [2023-12-28 07:52:57,256][106226] Updated weights for policy 0, policy_version 1756113 (0.0008) [2023-12-28 07:52:57,319][106226] Updated weights for policy 0, policy_version 1756123 (0.0009) [2023-12-28 07:52:57,377][106226] Updated weights for policy 0, policy_version 1756133 (0.0008) [2023-12-28 07:52:57,643][106225] Updated weights for policy 1, policy_version 1760465 (0.0008) [2023-12-28 07:52:57,692][106225] Updated weights for policy 1, policy_version 1760475 (0.0009) [2023-12-28 07:52:57,744][106225] Updated weights for policy 1, policy_version 1760485 (0.0008) [2023-12-28 07:52:57,953][106226] Updated weights for policy 0, policy_version 1756143 (0.0006) [2023-12-28 07:52:58,008][106226] Updated weights for policy 0, policy_version 1756153 (0.0006) [2023-12-28 07:52:58,055][106226] Updated weights for policy 0, policy_version 1756163 (0.0009) [2023-12-28 07:52:58,556][106225] Updated weights for policy 1, policy_version 1760495 (0.0008) [2023-12-28 07:52:58,619][106225] Updated weights for policy 1, policy_version 1760505 (0.0009) [2023-12-28 07:52:58,686][106225] Updated weights for policy 1, policy_version 1760515 (0.0007) [2023-12-28 07:52:58,844][106226] Updated weights for policy 0, policy_version 1756173 (0.0008) [2023-12-28 07:52:58,910][106226] Updated weights for policy 0, policy_version 1756183 (0.0008) [2023-12-28 07:52:58,980][106226] Updated weights for policy 0, policy_version 1756193 (0.0009) [2023-12-28 07:52:59,442][106225] Updated weights for policy 1, policy_version 1760525 (0.0008) [2023-12-28 07:52:59,499][106225] Updated weights for policy 1, policy_version 1760535 (0.0009) [2023-12-28 07:52:59,559][106225] Updated weights for policy 1, policy_version 1760545 (0.0009) [2023-12-28 07:52:59,741][106226] Updated weights for policy 0, policy_version 1756203 (0.0008) [2023-12-28 07:52:59,797][106226] Updated weights for policy 0, policy_version 1756213 (0.0007) [2023-12-28 07:52:59,856][106226] Updated weights for policy 0, policy_version 1756223 (0.0008) [2023-12-28 07:53:00,277][106225] Updated weights for policy 1, policy_version 1760555 (0.0009) [2023-12-28 07:53:00,343][106225] Updated weights for policy 1, policy_version 1760565 (0.0006) [2023-12-28 07:53:00,401][106225] Updated weights for policy 1, policy_version 1760575 (0.0006) [2023-12-28 07:53:00,586][106226] Updated weights for policy 0, policy_version 1756233 (0.0009) [2023-12-28 07:53:00,646][106226] Updated weights for policy 0, policy_version 1756243 (0.0010) [2023-12-28 07:53:00,691][106226] Updated weights for policy 0, policy_version 1756253 (0.0010) [2023-12-28 07:53:00,737][106226] Updated weights for policy 0, policy_version 1756263 (0.0010) [2023-12-28 07:53:00,995][106225] Updated weights for policy 1, policy_version 1760585 (0.0006) [2023-12-28 07:53:01,060][106225] Updated weights for policy 1, policy_version 1760595 (0.0008) [2023-12-28 07:53:01,118][106225] Updated weights for policy 1, policy_version 1760605 (0.0010) [2023-12-28 07:53:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 900448256. Throughput: 0: 10052.0, 1: 9625.5. Samples: 900441004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:01,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.013')] [2023-12-28 07:53:01,179][106225] Updated weights for policy 1, policy_version 1760615 (0.0008) [2023-12-28 07:53:01,454][106226] Updated weights for policy 0, policy_version 1756273 (0.0010) [2023-12-28 07:53:01,523][106226] Updated weights for policy 0, policy_version 1756283 (0.0011) [2023-12-28 07:53:01,591][106226] Updated weights for policy 0, policy_version 1756293 (0.0011) [2023-12-28 07:53:01,871][106225] Updated weights for policy 1, policy_version 1760625 (0.0008) [2023-12-28 07:53:01,933][106225] Updated weights for policy 1, policy_version 1760635 (0.0008) [2023-12-28 07:53:01,992][106225] Updated weights for policy 1, policy_version 1760645 (0.0007) [2023-12-28 07:53:02,315][106226] Updated weights for policy 0, policy_version 1756303 (0.0009) [2023-12-28 07:53:02,386][106226] Updated weights for policy 0, policy_version 1756313 (0.0010) [2023-12-28 07:53:02,450][106226] Updated weights for policy 0, policy_version 1756323 (0.0009) [2023-12-28 07:53:02,722][106225] Updated weights for policy 1, policy_version 1760655 (0.0010) [2023-12-28 07:53:02,782][106225] Updated weights for policy 1, policy_version 1760665 (0.0010) [2023-12-28 07:53:02,839][106225] Updated weights for policy 1, policy_version 1760675 (0.0010) [2023-12-28 07:53:03,100][106226] Updated weights for policy 0, policy_version 1756333 (0.0006) [2023-12-28 07:53:03,145][106226] Updated weights for policy 0, policy_version 1756343 (0.0005) [2023-12-28 07:53:03,197][106226] Updated weights for policy 0, policy_version 1756353 (0.0005) [2023-12-28 07:53:03,521][106225] Updated weights for policy 1, policy_version 1760685 (0.0009) [2023-12-28 07:53:03,573][106225] Updated weights for policy 1, policy_version 1760695 (0.0009) [2023-12-28 07:53:03,632][106225] Updated weights for policy 1, policy_version 1760705 (0.0010) [2023-12-28 07:53:03,749][106226] Updated weights for policy 0, policy_version 1756363 (0.0005) [2023-12-28 07:53:03,799][106226] Updated weights for policy 0, policy_version 1756373 (0.0006) [2023-12-28 07:53:03,865][106226] Updated weights for policy 0, policy_version 1756383 (0.0008) [2023-12-28 07:53:04,376][106225] Updated weights for policy 1, policy_version 1760715 (0.0010) [2023-12-28 07:53:04,430][106225] Updated weights for policy 1, policy_version 1760725 (0.0010) [2023-12-28 07:53:04,481][106225] Updated weights for policy 1, policy_version 1760735 (0.0010) [2023-12-28 07:53:04,573][106226] Updated weights for policy 0, policy_version 1756393 (0.0008) [2023-12-28 07:53:04,623][106226] Updated weights for policy 0, policy_version 1756403 (0.0008) [2023-12-28 07:53:04,669][106226] Updated weights for policy 0, policy_version 1756413 (0.0007) [2023-12-28 07:53:04,719][106226] Updated weights for policy 0, policy_version 1756423 (0.0007) [2023-12-28 07:53:05,109][106225] Updated weights for policy 1, policy_version 1760745 (0.0010) [2023-12-28 07:53:05,162][106225] Updated weights for policy 1, policy_version 1760755 (0.0009) [2023-12-28 07:53:05,208][106225] Updated weights for policy 1, policy_version 1760765 (0.0010) [2023-12-28 07:53:05,271][106225] Updated weights for policy 1, policy_version 1760775 (0.0008) [2023-12-28 07:53:05,479][106226] Updated weights for policy 0, policy_version 1756433 (0.0008) [2023-12-28 07:53:05,544][106226] Updated weights for policy 0, policy_version 1756443 (0.0008) [2023-12-28 07:53:05,610][106226] Updated weights for policy 0, policy_version 1756453 (0.0008) [2023-12-28 07:53:05,980][106225] Updated weights for policy 1, policy_version 1760785 (0.0010) [2023-12-28 07:53:06,036][106225] Updated weights for policy 1, policy_version 1760795 (0.0010) [2023-12-28 07:53:06,097][106225] Updated weights for policy 1, policy_version 1760805 (0.0010) [2023-12-28 07:53:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19910.7). Total num frames: 900554752. Throughput: 0: 10070.0, 1: 9658.8. Samples: 900562880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:06,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.630')] [2023-12-28 07:53:06,301][106226] Updated weights for policy 0, policy_version 1756463 (0.0006) [2023-12-28 07:53:06,363][106226] Updated weights for policy 0, policy_version 1756473 (0.0008) [2023-12-28 07:53:06,424][106226] Updated weights for policy 0, policy_version 1756483 (0.0009) [2023-12-28 07:53:06,875][106225] Updated weights for policy 1, policy_version 1760815 (0.0007) [2023-12-28 07:53:06,944][106225] Updated weights for policy 1, policy_version 1760825 (0.0009) [2023-12-28 07:53:07,006][106225] Updated weights for policy 1, policy_version 1760835 (0.0006) [2023-12-28 07:53:07,101][106226] Updated weights for policy 0, policy_version 1756493 (0.0010) [2023-12-28 07:53:07,156][106226] Updated weights for policy 0, policy_version 1756503 (0.0010) [2023-12-28 07:53:07,217][106226] Updated weights for policy 0, policy_version 1756513 (0.0011) [2023-12-28 07:53:07,636][106225] Updated weights for policy 1, policy_version 1760845 (0.0006) [2023-12-28 07:53:07,687][106225] Updated weights for policy 1, policy_version 1760855 (0.0008) [2023-12-28 07:53:07,740][106225] Updated weights for policy 1, policy_version 1760865 (0.0009) [2023-12-28 07:53:07,892][106226] Updated weights for policy 0, policy_version 1756523 (0.0009) [2023-12-28 07:53:07,952][106226] Updated weights for policy 0, policy_version 1756533 (0.0007) [2023-12-28 07:53:08,009][106226] Updated weights for policy 0, policy_version 1756543 (0.0011) [2023-12-28 07:53:08,472][106225] Updated weights for policy 1, policy_version 1760875 (0.0008) [2023-12-28 07:53:08,526][106225] Updated weights for policy 1, policy_version 1760885 (0.0008) [2023-12-28 07:53:08,579][106225] Updated weights for policy 1, policy_version 1760895 (0.0009) [2023-12-28 07:53:08,709][106226] Updated weights for policy 0, policy_version 1756553 (0.0010) [2023-12-28 07:53:08,769][106226] Updated weights for policy 0, policy_version 1756563 (0.0008) [2023-12-28 07:53:08,822][106226] Updated weights for policy 0, policy_version 1756573 (0.0009) [2023-12-28 07:53:08,886][106226] Updated weights for policy 0, policy_version 1756583 (0.0008) [2023-12-28 07:53:09,272][106225] Updated weights for policy 1, policy_version 1760905 (0.0008) [2023-12-28 07:53:09,332][106225] Updated weights for policy 1, policy_version 1760915 (0.0006) [2023-12-28 07:53:09,402][106225] Updated weights for policy 1, policy_version 1760925 (0.0008) [2023-12-28 07:53:09,462][106225] Updated weights for policy 1, policy_version 1760935 (0.0008) [2023-12-28 07:53:09,707][106226] Updated weights for policy 0, policy_version 1756593 (0.0009) [2023-12-28 07:53:09,765][106226] Updated weights for policy 0, policy_version 1756603 (0.0009) [2023-12-28 07:53:09,825][106226] Updated weights for policy 0, policy_version 1756613 (0.0009) [2023-12-28 07:53:10,189][106225] Updated weights for policy 1, policy_version 1760945 (0.0008) [2023-12-28 07:53:10,248][106225] Updated weights for policy 1, policy_version 1760955 (0.0008) [2023-12-28 07:53:10,317][106225] Updated weights for policy 1, policy_version 1760965 (0.0006) [2023-12-28 07:53:10,651][106226] Updated weights for policy 0, policy_version 1756623 (0.0010) [2023-12-28 07:53:10,716][106226] Updated weights for policy 0, policy_version 1756633 (0.0009) [2023-12-28 07:53:10,780][106226] Updated weights for policy 0, policy_version 1756643 (0.0006) [2023-12-28 07:53:10,987][106225] Updated weights for policy 1, policy_version 1760975 (0.0005) [2023-12-28 07:53:11,052][106225] Updated weights for policy 1, policy_version 1760985 (0.0008) [2023-12-28 07:53:11,113][106225] Updated weights for policy 1, policy_version 1760995 (0.0008) [2023-12-28 07:53:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 900653056. Throughput: 0: 10093.5, 1: 9661.9. Samples: 900621556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:11,175][105115] Avg episode reward: [(0, '-4.441'), (1, '-4.942')] [2023-12-28 07:53:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001761000_450871296.pth... [2023-12-28 07:53:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001756648_449781760.pth... [2023-12-28 07:53:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001759848_450576384.pth [2023-12-28 07:53:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001755496_449486848.pth [2023-12-28 07:53:11,607][106226] Updated weights for policy 0, policy_version 1756653 (0.0009) [2023-12-28 07:53:11,689][106226] Updated weights for policy 0, policy_version 1756663 (0.0008) [2023-12-28 07:53:11,759][106226] Updated weights for policy 0, policy_version 1756673 (0.0009) [2023-12-28 07:53:11,886][106225] Updated weights for policy 1, policy_version 1761005 (0.0007) [2023-12-28 07:53:11,941][106225] Updated weights for policy 1, policy_version 1761015 (0.0006) [2023-12-28 07:53:12,010][106225] Updated weights for policy 1, policy_version 1761025 (0.0007) [2023-12-28 07:53:12,549][106226] Updated weights for policy 0, policy_version 1756683 (0.0008) [2023-12-28 07:53:12,618][106226] Updated weights for policy 0, policy_version 1756693 (0.0008) [2023-12-28 07:53:12,679][106226] Updated weights for policy 0, policy_version 1756703 (0.0008) [2023-12-28 07:53:12,726][106225] Updated weights for policy 1, policy_version 1761035 (0.0008) [2023-12-28 07:53:12,779][106225] Updated weights for policy 1, policy_version 1761045 (0.0007) [2023-12-28 07:53:12,844][106225] Updated weights for policy 1, policy_version 1761055 (0.0007) [2023-12-28 07:53:13,348][106226] Updated weights for policy 0, policy_version 1756713 (0.0009) [2023-12-28 07:53:13,401][106226] Updated weights for policy 0, policy_version 1756723 (0.0005) [2023-12-28 07:53:13,432][106225] Updated weights for policy 1, policy_version 1761065 (0.0005) [2023-12-28 07:53:13,450][106226] Updated weights for policy 0, policy_version 1756733 (0.0008) [2023-12-28 07:53:13,483][106225] Updated weights for policy 1, policy_version 1761075 (0.0006) [2023-12-28 07:53:13,496][106226] Updated weights for policy 0, policy_version 1756743 (0.0010) [2023-12-28 07:53:13,531][106225] Updated weights for policy 1, policy_version 1761085 (0.0006) [2023-12-28 07:53:13,588][106225] Updated weights for policy 1, policy_version 1761095 (0.0010) [2023-12-28 07:53:14,104][106226] Updated weights for policy 0, policy_version 1756753 (0.0006) [2023-12-28 07:53:14,174][106226] Updated weights for policy 0, policy_version 1756763 (0.0006) [2023-12-28 07:53:14,225][106226] Updated weights for policy 0, policy_version 1756773 (0.0010) [2023-12-28 07:53:14,308][106225] Updated weights for policy 1, policy_version 1761105 (0.0010) [2023-12-28 07:53:14,364][106225] Updated weights for policy 1, policy_version 1761115 (0.0008) [2023-12-28 07:53:14,413][106225] Updated weights for policy 1, policy_version 1761125 (0.0009) [2023-12-28 07:53:14,749][106226] Updated weights for policy 0, policy_version 1756783 (0.0006) [2023-12-28 07:53:14,816][106226] Updated weights for policy 0, policy_version 1756793 (0.0009) [2023-12-28 07:53:14,883][106226] Updated weights for policy 0, policy_version 1756803 (0.0007) [2023-12-28 07:53:15,179][106225] Updated weights for policy 1, policy_version 1761135 (0.0010) [2023-12-28 07:53:15,239][106225] Updated weights for policy 1, policy_version 1761145 (0.0008) [2023-12-28 07:53:15,308][106225] Updated weights for policy 1, policy_version 1761155 (0.0009) [2023-12-28 07:53:15,455][106226] Updated weights for policy 0, policy_version 1756813 (0.0006) [2023-12-28 07:53:15,539][106226] Updated weights for policy 0, policy_version 1756823 (0.0006) [2023-12-28 07:53:15,595][106226] Updated weights for policy 0, policy_version 1756833 (0.0005) [2023-12-28 07:53:15,952][106225] Updated weights for policy 1, policy_version 1761165 (0.0008) [2023-12-28 07:53:16,008][106225] Updated weights for policy 1, policy_version 1761175 (0.0008) [2023-12-28 07:53:16,065][106225] Updated weights for policy 1, policy_version 1761185 (0.0008) [2023-12-28 07:53:16,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 900751360. Throughput: 0: 9996.1, 1: 9675.3. Samples: 900738772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:16,176][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.813')] [2023-12-28 07:53:16,203][106226] Updated weights for policy 0, policy_version 1756843 (0.0007) [2023-12-28 07:53:16,249][106226] Updated weights for policy 0, policy_version 1756853 (0.0010) [2023-12-28 07:53:16,306][106226] Updated weights for policy 0, policy_version 1756863 (0.0010) [2023-12-28 07:53:16,847][106225] Updated weights for policy 1, policy_version 1761195 (0.0008) [2023-12-28 07:53:16,898][106225] Updated weights for policy 1, policy_version 1761205 (0.0009) [2023-12-28 07:53:16,928][106226] Updated weights for policy 0, policy_version 1756873 (0.0010) [2023-12-28 07:53:16,951][106225] Updated weights for policy 1, policy_version 1761215 (0.0009) [2023-12-28 07:53:16,987][106226] Updated weights for policy 0, policy_version 1756883 (0.0011) [2023-12-28 07:53:17,040][106226] Updated weights for policy 0, policy_version 1756893 (0.0010) [2023-12-28 07:53:17,099][106226] Updated weights for policy 0, policy_version 1756903 (0.0010) [2023-12-28 07:53:17,701][106225] Updated weights for policy 1, policy_version 1761225 (0.0006) [2023-12-28 07:53:17,757][106225] Updated weights for policy 1, policy_version 1761235 (0.0007) [2023-12-28 07:53:17,794][106226] Updated weights for policy 0, policy_version 1756913 (0.0011) [2023-12-28 07:53:17,811][106225] Updated weights for policy 1, policy_version 1761245 (0.0006) [2023-12-28 07:53:17,844][106226] Updated weights for policy 0, policy_version 1756923 (0.0009) [2023-12-28 07:53:17,863][106225] Updated weights for policy 1, policy_version 1761255 (0.0006) [2023-12-28 07:53:17,894][106226] Updated weights for policy 0, policy_version 1756933 (0.0010) [2023-12-28 07:53:18,597][106226] Updated weights for policy 0, policy_version 1756943 (0.0009) [2023-12-28 07:53:18,644][106226] Updated weights for policy 0, policy_version 1756953 (0.0010) [2023-12-28 07:53:18,682][106225] Updated weights for policy 1, policy_version 1761265 (0.0007) [2023-12-28 07:53:18,715][106226] Updated weights for policy 0, policy_version 1756963 (0.0009) [2023-12-28 07:53:18,735][106225] Updated weights for policy 1, policy_version 1761275 (0.0007) [2023-12-28 07:53:18,794][106225] Updated weights for policy 1, policy_version 1761285 (0.0009) [2023-12-28 07:53:19,469][106226] Updated weights for policy 0, policy_version 1756973 (0.0010) [2023-12-28 07:53:19,520][106225] Updated weights for policy 1, policy_version 1761295 (0.0007) [2023-12-28 07:53:19,546][106226] Updated weights for policy 0, policy_version 1756983 (0.0011) [2023-12-28 07:53:19,582][106225] Updated weights for policy 1, policy_version 1761305 (0.0007) [2023-12-28 07:53:19,612][106226] Updated weights for policy 0, policy_version 1756993 (0.0009) [2023-12-28 07:53:19,650][106225] Updated weights for policy 1, policy_version 1761315 (0.0005) [2023-12-28 07:53:20,307][106226] Updated weights for policy 0, policy_version 1757003 (0.0009) [2023-12-28 07:53:20,373][106226] Updated weights for policy 0, policy_version 1757013 (0.0007) [2023-12-28 07:53:20,405][106225] Updated weights for policy 1, policy_version 1761325 (0.0007) [2023-12-28 07:53:20,438][106226] Updated weights for policy 0, policy_version 1757023 (0.0011) [2023-12-28 07:53:20,470][106225] Updated weights for policy 1, policy_version 1761335 (0.0008) [2023-12-28 07:53:20,522][106225] Updated weights for policy 1, policy_version 1761345 (0.0007) [2023-12-28 07:53:21,105][106226] Updated weights for policy 0, policy_version 1757033 (0.0008) [2023-12-28 07:53:21,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19883.0). Total num frames: 900841472. Throughput: 0: 9984.1, 1: 9683.2. Samples: 900856576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:21,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.763')] [2023-12-28 07:53:21,176][106226] Updated weights for policy 0, policy_version 1757043 (0.0010) [2023-12-28 07:53:21,244][106226] Updated weights for policy 0, policy_version 1757053 (0.0007) [2023-12-28 07:53:21,282][106225] Updated weights for policy 1, policy_version 1761355 (0.0008) [2023-12-28 07:53:21,313][106226] Updated weights for policy 0, policy_version 1757063 (0.0011) [2023-12-28 07:53:21,343][106225] Updated weights for policy 1, policy_version 1761365 (0.0007) [2023-12-28 07:53:21,408][106225] Updated weights for policy 1, policy_version 1761375 (0.0008) [2023-12-28 07:53:22,094][106226] Updated weights for policy 0, policy_version 1757073 (0.0010) [2023-12-28 07:53:22,144][106226] Updated weights for policy 0, policy_version 1757083 (0.0010) [2023-12-28 07:53:22,200][106225] Updated weights for policy 1, policy_version 1761385 (0.0008) [2023-12-28 07:53:22,202][106226] Updated weights for policy 0, policy_version 1757093 (0.0011) [2023-12-28 07:53:22,264][106225] Updated weights for policy 1, policy_version 1761395 (0.0008) [2023-12-28 07:53:22,316][106225] Updated weights for policy 1, policy_version 1761405 (0.0008) [2023-12-28 07:53:22,381][106225] Updated weights for policy 1, policy_version 1761415 (0.0008) [2023-12-28 07:53:22,962][106226] Updated weights for policy 0, policy_version 1757103 (0.0009) [2023-12-28 07:53:23,013][106226] Updated weights for policy 0, policy_version 1757113 (0.0007) [2023-12-28 07:53:23,065][106226] Updated weights for policy 0, policy_version 1757123 (0.0006) [2023-12-28 07:53:23,067][106225] Updated weights for policy 1, policy_version 1761425 (0.0007) [2023-12-28 07:53:23,124][106225] Updated weights for policy 1, policy_version 1761435 (0.0008) [2023-12-28 07:53:23,180][106225] Updated weights for policy 1, policy_version 1761445 (0.0008) [2023-12-28 07:53:23,769][106226] Updated weights for policy 0, policy_version 1757133 (0.0005) [2023-12-28 07:53:23,839][106226] Updated weights for policy 0, policy_version 1757143 (0.0005) [2023-12-28 07:53:23,891][106226] Updated weights for policy 0, policy_version 1757153 (0.0005) [2023-12-28 07:53:23,938][106225] Updated weights for policy 1, policy_version 1761455 (0.0009) [2023-12-28 07:53:23,992][106225] Updated weights for policy 1, policy_version 1761465 (0.0009) [2023-12-28 07:53:24,041][106225] Updated weights for policy 1, policy_version 1761475 (0.0008) [2023-12-28 07:53:24,414][106226] Updated weights for policy 0, policy_version 1757163 (0.0006) [2023-12-28 07:53:24,467][106226] Updated weights for policy 0, policy_version 1757173 (0.0008) [2023-12-28 07:53:24,519][106226] Updated weights for policy 0, policy_version 1757183 (0.0008) [2023-12-28 07:53:24,819][106225] Updated weights for policy 1, policy_version 1761486 (0.0007) [2023-12-28 07:53:24,866][106225] Updated weights for policy 1, policy_version 1761496 (0.0008) [2023-12-28 07:53:24,918][106225] Updated weights for policy 1, policy_version 1761506 (0.0008) [2023-12-28 07:53:25,203][106226] Updated weights for policy 0, policy_version 1757193 (0.0008) [2023-12-28 07:53:25,259][106226] Updated weights for policy 0, policy_version 1757203 (0.0008) [2023-12-28 07:53:25,315][106226] Updated weights for policy 0, policy_version 1757213 (0.0008) [2023-12-28 07:53:25,373][106226] Updated weights for policy 0, policy_version 1757223 (0.0007) [2023-12-28 07:53:25,645][106225] Updated weights for policy 1, policy_version 1761516 (0.0008) [2023-12-28 07:53:25,701][106225] Updated weights for policy 1, policy_version 1761526 (0.0008) [2023-12-28 07:53:25,751][106225] Updated weights for policy 1, policy_version 1761536 (0.0008) [2023-12-28 07:53:26,083][106226] Updated weights for policy 0, policy_version 1757233 (0.0005) [2023-12-28 07:53:26,131][106226] Updated weights for policy 0, policy_version 1757243 (0.0008) [2023-12-28 07:53:26,174][105115] Fps is (10 sec: 18842.2, 60 sec: 19524.4, 300 sec: 19827.4). Total num frames: 900939776. Throughput: 0: 9935.2, 1: 9709.5. Samples: 900913800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:26,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.847')] [2023-12-28 07:53:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001761544_451010560.pth... [2023-12-28 07:53:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001760424_450723840.pth [2023-12-28 07:53:26,186][106226] Updated weights for policy 0, policy_version 1757253 (0.0006) [2023-12-28 07:53:26,203][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001757256_449937408.pth... [2023-12-28 07:53:26,206][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001756072_449634304.pth [2023-12-28 07:53:26,488][106225] Updated weights for policy 1, policy_version 1761546 (0.0007) [2023-12-28 07:53:26,545][106225] Updated weights for policy 1, policy_version 1761556 (0.0008) [2023-12-28 07:53:26,601][106225] Updated weights for policy 1, policy_version 1761566 (0.0007) [2023-12-28 07:53:26,654][106225] Updated weights for policy 1, policy_version 1761576 (0.0007) [2023-12-28 07:53:26,806][106226] Updated weights for policy 0, policy_version 1757263 (0.0006) [2023-12-28 07:53:26,851][106226] Updated weights for policy 0, policy_version 1757273 (0.0005) [2023-12-28 07:53:26,908][106226] Updated weights for policy 0, policy_version 1757283 (0.0005) [2023-12-28 07:53:27,326][106225] Updated weights for policy 1, policy_version 1761586 (0.0006) [2023-12-28 07:53:27,378][106225] Updated weights for policy 1, policy_version 1761596 (0.0007) [2023-12-28 07:53:27,428][106225] Updated weights for policy 1, policy_version 1761606 (0.0006) [2023-12-28 07:53:27,576][106226] Updated weights for policy 0, policy_version 1757293 (0.0009) [2023-12-28 07:53:27,637][106226] Updated weights for policy 0, policy_version 1757303 (0.0008) [2023-12-28 07:53:27,700][106226] Updated weights for policy 0, policy_version 1757313 (0.0005) [2023-12-28 07:53:28,100][106225] Updated weights for policy 1, policy_version 1761616 (0.0009) [2023-12-28 07:53:28,152][106225] Updated weights for policy 1, policy_version 1761626 (0.0010) [2023-12-28 07:53:28,207][106225] Updated weights for policy 1, policy_version 1761636 (0.0008) [2023-12-28 07:53:28,220][106226] Updated weights for policy 0, policy_version 1757323 (0.0007) [2023-12-28 07:53:28,277][106226] Updated weights for policy 0, policy_version 1757333 (0.0006) [2023-12-28 07:53:28,334][106226] Updated weights for policy 0, policy_version 1757343 (0.0006) [2023-12-28 07:53:28,947][106226] Updated weights for policy 0, policy_version 1757353 (0.0007) [2023-12-28 07:53:28,951][106225] Updated weights for policy 1, policy_version 1761646 (0.0007) [2023-12-28 07:53:28,995][106226] Updated weights for policy 0, policy_version 1757363 (0.0005) [2023-12-28 07:53:29,010][106225] Updated weights for policy 1, policy_version 1761656 (0.0007) [2023-12-28 07:53:29,052][106226] Updated weights for policy 0, policy_version 1757373 (0.0009) [2023-12-28 07:53:29,066][106225] Updated weights for policy 1, policy_version 1761666 (0.0010) [2023-12-28 07:53:29,103][106226] Updated weights for policy 0, policy_version 1757383 (0.0007) [2023-12-28 07:53:29,768][106225] Updated weights for policy 1, policy_version 1761676 (0.0009) [2023-12-28 07:53:29,811][106226] Updated weights for policy 0, policy_version 1757393 (0.0006) [2023-12-28 07:53:29,826][106225] Updated weights for policy 1, policy_version 1761686 (0.0008) [2023-12-28 07:53:29,885][106225] Updated weights for policy 1, policy_version 1761696 (0.0007) [2023-12-28 07:53:29,891][106226] Updated weights for policy 0, policy_version 1757403 (0.0010) [2023-12-28 07:53:29,951][106226] Updated weights for policy 0, policy_version 1757413 (0.0011) [2023-12-28 07:53:30,631][106225] Updated weights for policy 1, policy_version 1761706 (0.0007) [2023-12-28 07:53:30,658][106226] Updated weights for policy 0, policy_version 1757423 (0.0007) [2023-12-28 07:53:30,688][106225] Updated weights for policy 1, policy_version 1761716 (0.0010) [2023-12-28 07:53:30,712][106226] Updated weights for policy 0, policy_version 1757433 (0.0007) [2023-12-28 07:53:30,747][106225] Updated weights for policy 1, policy_version 1761726 (0.0010) [2023-12-28 07:53:30,769][106226] Updated weights for policy 0, policy_version 1757443 (0.0008) [2023-12-28 07:53:30,796][106225] Updated weights for policy 1, policy_version 1761736 (0.0010) [2023-12-28 07:53:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 901046272. Throughput: 0: 10053.2, 1: 9677.6. Samples: 901036164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:31,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-5.146')] [2023-12-28 07:53:31,491][106226] Updated weights for policy 0, policy_version 1757453 (0.0008) [2023-12-28 07:53:31,543][106226] Updated weights for policy 0, policy_version 1757463 (0.0006) [2023-12-28 07:53:31,552][106225] Updated weights for policy 1, policy_version 1761746 (0.0006) [2023-12-28 07:53:31,594][106226] Updated weights for policy 0, policy_version 1757473 (0.0007) [2023-12-28 07:53:31,607][106225] Updated weights for policy 1, policy_version 1761756 (0.0010) [2023-12-28 07:53:31,671][106225] Updated weights for policy 1, policy_version 1761766 (0.0011) [2023-12-28 07:53:32,367][106225] Updated weights for policy 1, policy_version 1761776 (0.0008) [2023-12-28 07:53:32,380][106226] Updated weights for policy 0, policy_version 1757483 (0.0008) [2023-12-28 07:53:32,431][106225] Updated weights for policy 1, policy_version 1761786 (0.0007) [2023-12-28 07:53:32,441][106226] Updated weights for policy 0, policy_version 1757493 (0.0008) [2023-12-28 07:53:32,478][106225] Updated weights for policy 1, policy_version 1761796 (0.0005) [2023-12-28 07:53:32,502][106226] Updated weights for policy 0, policy_version 1757503 (0.0009) [2023-12-28 07:53:33,169][106226] Updated weights for policy 0, policy_version 1757513 (0.0009) [2023-12-28 07:53:33,201][106225] Updated weights for policy 1, policy_version 1761806 (0.0005) [2023-12-28 07:53:33,218][106226] Updated weights for policy 0, policy_version 1757523 (0.0007) [2023-12-28 07:53:33,268][106225] Updated weights for policy 1, policy_version 1761816 (0.0005) [2023-12-28 07:53:33,277][106226] Updated weights for policy 0, policy_version 1757533 (0.0007) [2023-12-28 07:53:33,334][106225] Updated weights for policy 1, policy_version 1761826 (0.0005) [2023-12-28 07:53:33,336][106226] Updated weights for policy 0, policy_version 1757543 (0.0006) [2023-12-28 07:53:33,987][106225] Updated weights for policy 1, policy_version 1761836 (0.0008) [2023-12-28 07:53:34,020][106226] Updated weights for policy 0, policy_version 1757553 (0.0008) [2023-12-28 07:53:34,040][106225] Updated weights for policy 1, policy_version 1761846 (0.0010) [2023-12-28 07:53:34,068][106226] Updated weights for policy 0, policy_version 1757563 (0.0008) [2023-12-28 07:53:34,093][106225] Updated weights for policy 1, policy_version 1761856 (0.0010) [2023-12-28 07:53:34,119][106226] Updated weights for policy 0, policy_version 1757573 (0.0006) [2023-12-28 07:53:34,809][106225] Updated weights for policy 1, policy_version 1761866 (0.0009) [2023-12-28 07:53:34,844][106226] Updated weights for policy 0, policy_version 1757583 (0.0006) [2023-12-28 07:53:34,873][106225] Updated weights for policy 1, policy_version 1761876 (0.0005) [2023-12-28 07:53:34,908][106226] Updated weights for policy 0, policy_version 1757593 (0.0007) [2023-12-28 07:53:34,932][106225] Updated weights for policy 1, policy_version 1761886 (0.0006) [2023-12-28 07:53:34,958][106226] Updated weights for policy 0, policy_version 1757603 (0.0006) [2023-12-28 07:53:34,992][106225] Updated weights for policy 1, policy_version 1761896 (0.0006) [2023-12-28 07:53:35,563][106226] Updated weights for policy 0, policy_version 1757613 (0.0008) [2023-12-28 07:53:35,588][106225] Updated weights for policy 1, policy_version 1761906 (0.0008) [2023-12-28 07:53:35,625][106226] Updated weights for policy 0, policy_version 1757623 (0.0008) [2023-12-28 07:53:35,640][106225] Updated weights for policy 1, policy_version 1761916 (0.0006) [2023-12-28 07:53:35,682][106226] Updated weights for policy 0, policy_version 1757633 (0.0007) [2023-12-28 07:53:35,699][106225] Updated weights for policy 1, policy_version 1761926 (0.0007) [2023-12-28 07:53:36,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 901144576. Throughput: 0: 10107.3, 1: 9660.5. Samples: 901154256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:36,175][105115] Avg episode reward: [(0, '-4.128'), (1, '-4.682')] [2023-12-28 07:53:36,390][106226] Updated weights for policy 0, policy_version 1757643 (0.0006) [2023-12-28 07:53:36,458][106226] Updated weights for policy 0, policy_version 1757653 (0.0008) [2023-12-28 07:53:36,482][106225] Updated weights for policy 1, policy_version 1761936 (0.0006) [2023-12-28 07:53:36,520][106226] Updated weights for policy 0, policy_version 1757663 (0.0008) [2023-12-28 07:53:36,549][106225] Updated weights for policy 1, policy_version 1761946 (0.0006) [2023-12-28 07:53:36,614][106225] Updated weights for policy 1, policy_version 1761956 (0.0008) [2023-12-28 07:53:37,234][106226] Updated weights for policy 0, policy_version 1757673 (0.0007) [2023-12-28 07:53:37,255][106225] Updated weights for policy 1, policy_version 1761966 (0.0007) [2023-12-28 07:53:37,285][106226] Updated weights for policy 0, policy_version 1757683 (0.0008) [2023-12-28 07:53:37,311][106225] Updated weights for policy 1, policy_version 1761976 (0.0006) [2023-12-28 07:53:37,334][106226] Updated weights for policy 0, policy_version 1757693 (0.0008) [2023-12-28 07:53:37,368][106225] Updated weights for policy 1, policy_version 1761986 (0.0006) [2023-12-28 07:53:37,384][106226] Updated weights for policy 0, policy_version 1757703 (0.0008) [2023-12-28 07:53:38,026][106225] Updated weights for policy 1, policy_version 1761996 (0.0007) [2023-12-28 07:53:38,087][106225] Updated weights for policy 1, policy_version 1762006 (0.0007) [2023-12-28 07:53:38,147][106225] Updated weights for policy 1, policy_version 1762016 (0.0005) [2023-12-28 07:53:38,177][106226] Updated weights for policy 0, policy_version 1757713 (0.0009) [2023-12-28 07:53:38,235][106226] Updated weights for policy 0, policy_version 1757723 (0.0006) [2023-12-28 07:53:38,300][106226] Updated weights for policy 0, policy_version 1757733 (0.0005) [2023-12-28 07:53:38,856][106225] Updated weights for policy 1, policy_version 1762026 (0.0006) [2023-12-28 07:53:38,915][106226] Updated weights for policy 0, policy_version 1757743 (0.0006) [2023-12-28 07:53:38,921][106225] Updated weights for policy 1, policy_version 1762036 (0.0011) [2023-12-28 07:53:38,971][106225] Updated weights for policy 1, policy_version 1762046 (0.0010) [2023-12-28 07:53:38,974][106226] Updated weights for policy 0, policy_version 1757753 (0.0006) [2023-12-28 07:53:39,026][106225] Updated weights for policy 1, policy_version 1762056 (0.0008) [2023-12-28 07:53:39,035][106226] Updated weights for policy 0, policy_version 1757763 (0.0006) [2023-12-28 07:53:39,715][106226] Updated weights for policy 0, policy_version 1757773 (0.0010) [2023-12-28 07:53:39,779][106226] Updated weights for policy 0, policy_version 1757783 (0.0011) [2023-12-28 07:53:39,814][106225] Updated weights for policy 1, policy_version 1762066 (0.0006) [2023-12-28 07:53:39,843][106226] Updated weights for policy 0, policy_version 1757793 (0.0010) [2023-12-28 07:53:39,872][106225] Updated weights for policy 1, policy_version 1762076 (0.0009) [2023-12-28 07:53:39,934][106225] Updated weights for policy 1, policy_version 1762086 (0.0009) [2023-12-28 07:53:40,583][106226] Updated weights for policy 0, policy_version 1757803 (0.0010) [2023-12-28 07:53:40,641][106226] Updated weights for policy 0, policy_version 1757813 (0.0010) [2023-12-28 07:53:40,696][106226] Updated weights for policy 0, policy_version 1757823 (0.0007) [2023-12-28 07:53:40,731][106225] Updated weights for policy 1, policy_version 1762096 (0.0008) [2023-12-28 07:53:40,781][106225] Updated weights for policy 1, policy_version 1762106 (0.0010) [2023-12-28 07:53:40,828][106225] Updated weights for policy 1, policy_version 1762116 (0.0010) [2023-12-28 07:53:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 901242880. Throughput: 0: 10081.7, 1: 9700.9. Samples: 901214300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:41,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-5.091')] [2023-12-28 07:53:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001757832_450084864.pth... [2023-12-28 07:53:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001762120_451158016.pth... [2023-12-28 07:53:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001756648_449781760.pth [2023-12-28 07:53:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001761000_450871296.pth [2023-12-28 07:53:41,188][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001757832_450084864.pth [2023-12-28 07:53:41,188][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001762120_451158016.pth [2023-12-28 07:53:41,550][106225] Updated weights for policy 1, policy_version 1762126 (0.0007) [2023-12-28 07:53:41,565][106226] Updated weights for policy 0, policy_version 1757833 (0.0008) [2023-12-28 07:53:41,616][106225] Updated weights for policy 1, policy_version 1762136 (0.0006) [2023-12-28 07:53:41,635][106226] Updated weights for policy 0, policy_version 1757843 (0.0008) [2023-12-28 07:53:41,678][106225] Updated weights for policy 1, policy_version 1762146 (0.0007) [2023-12-28 07:53:41,704][106226] Updated weights for policy 0, policy_version 1757853 (0.0009) [2023-12-28 07:53:41,773][106226] Updated weights for policy 0, policy_version 1757863 (0.0008) [2023-12-28 07:53:42,416][106225] Updated weights for policy 1, policy_version 1762156 (0.0007) [2023-12-28 07:53:42,485][106225] Updated weights for policy 1, policy_version 1762166 (0.0009) [2023-12-28 07:53:42,540][106226] Updated weights for policy 0, policy_version 1757873 (0.0008) [2023-12-28 07:53:42,555][106225] Updated weights for policy 1, policy_version 1762176 (0.0008) [2023-12-28 07:53:42,608][106226] Updated weights for policy 0, policy_version 1757883 (0.0009) [2023-12-28 07:53:42,670][106226] Updated weights for policy 0, policy_version 1757893 (0.0009) [2023-12-28 07:53:43,231][106225] Updated weights for policy 1, policy_version 1762186 (0.0008) [2023-12-28 07:53:43,290][106225] Updated weights for policy 1, policy_version 1762196 (0.0005) [2023-12-28 07:53:43,346][106225] Updated weights for policy 1, policy_version 1762206 (0.0005) [2023-12-28 07:53:43,402][106225] Updated weights for policy 1, policy_version 1762216 (0.0005) [2023-12-28 07:53:43,412][106226] Updated weights for policy 0, policy_version 1757903 (0.0009) [2023-12-28 07:53:43,468][106226] Updated weights for policy 0, policy_version 1757913 (0.0009) [2023-12-28 07:53:43,513][106226] Updated weights for policy 0, policy_version 1757923 (0.0009) [2023-12-28 07:53:43,929][106225] Updated weights for policy 1, policy_version 1762226 (0.0005) [2023-12-28 07:53:43,978][106225] Updated weights for policy 1, policy_version 1762236 (0.0006) [2023-12-28 07:53:44,028][106225] Updated weights for policy 1, policy_version 1762246 (0.0007) [2023-12-28 07:53:44,330][106226] Updated weights for policy 0, policy_version 1757933 (0.0007) [2023-12-28 07:53:44,400][106226] Updated weights for policy 0, policy_version 1757943 (0.0009) [2023-12-28 07:53:44,456][106226] Updated weights for policy 0, policy_version 1757953 (0.0009) [2023-12-28 07:53:44,683][106225] Updated weights for policy 1, policy_version 1762256 (0.0008) [2023-12-28 07:53:44,733][106225] Updated weights for policy 1, policy_version 1762266 (0.0008) [2023-12-28 07:53:44,799][106225] Updated weights for policy 1, policy_version 1762276 (0.0008) [2023-12-28 07:53:45,207][106226] Updated weights for policy 0, policy_version 1757963 (0.0009) [2023-12-28 07:53:45,273][106226] Updated weights for policy 0, policy_version 1757973 (0.0009) [2023-12-28 07:53:45,334][106226] Updated weights for policy 0, policy_version 1757983 (0.0008) [2023-12-28 07:53:45,487][106225] Updated weights for policy 1, policy_version 1762286 (0.0008) [2023-12-28 07:53:45,546][106225] Updated weights for policy 1, policy_version 1762296 (0.0008) [2023-12-28 07:53:45,600][106225] Updated weights for policy 1, policy_version 1762306 (0.0006) [2023-12-28 07:53:45,979][106226] Updated weights for policy 0, policy_version 1757993 (0.0008) [2023-12-28 07:53:46,028][106226] Updated weights for policy 0, policy_version 1758003 (0.0007) [2023-12-28 07:53:46,078][106226] Updated weights for policy 0, policy_version 1758013 (0.0010) [2023-12-28 07:53:46,134][106226] Updated weights for policy 0, policy_version 1758023 (0.0011) [2023-12-28 07:53:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19882.9). Total num frames: 901341184. Throughput: 0: 9928.3, 1: 9787.0. Samples: 901328196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:46,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.727')] [2023-12-28 07:53:46,360][106225] Updated weights for policy 1, policy_version 1762316 (0.0008) [2023-12-28 07:53:46,421][106225] Updated weights for policy 1, policy_version 1762326 (0.0005) [2023-12-28 07:53:46,490][106225] Updated weights for policy 1, policy_version 1762336 (0.0005) [2023-12-28 07:53:46,840][106226] Updated weights for policy 0, policy_version 1758033 (0.0008) [2023-12-28 07:53:46,890][106226] Updated weights for policy 0, policy_version 1758043 (0.0005) [2023-12-28 07:53:46,941][106226] Updated weights for policy 0, policy_version 1758053 (0.0005) [2023-12-28 07:53:47,047][106225] Updated weights for policy 1, policy_version 1762346 (0.0006) [2023-12-28 07:53:47,094][106225] Updated weights for policy 1, policy_version 1762356 (0.0008) [2023-12-28 07:53:47,139][106225] Updated weights for policy 1, policy_version 1762366 (0.0009) [2023-12-28 07:53:47,187][106225] Updated weights for policy 1, policy_version 1762376 (0.0008) [2023-12-28 07:53:47,526][106226] Updated weights for policy 0, policy_version 1758063 (0.0008) [2023-12-28 07:53:47,588][106226] Updated weights for policy 0, policy_version 1758073 (0.0007) [2023-12-28 07:53:47,644][106226] Updated weights for policy 0, policy_version 1758083 (0.0006) [2023-12-28 07:53:47,969][106225] Updated weights for policy 1, policy_version 1762386 (0.0008) [2023-12-28 07:53:48,022][106225] Updated weights for policy 1, policy_version 1762396 (0.0009) [2023-12-28 07:53:48,078][106225] Updated weights for policy 1, policy_version 1762406 (0.0008) [2023-12-28 07:53:48,266][106226] Updated weights for policy 0, policy_version 1758093 (0.0006) [2023-12-28 07:53:48,324][106226] Updated weights for policy 0, policy_version 1758103 (0.0010) [2023-12-28 07:53:48,390][106226] Updated weights for policy 0, policy_version 1758113 (0.0011) [2023-12-28 07:53:48,870][106225] Updated weights for policy 1, policy_version 1762416 (0.0008) [2023-12-28 07:53:48,926][106225] Updated weights for policy 1, policy_version 1762426 (0.0008) [2023-12-28 07:53:48,986][106225] Updated weights for policy 1, policy_version 1762436 (0.0009) [2023-12-28 07:53:48,991][106226] Updated weights for policy 0, policy_version 1758123 (0.0009) [2023-12-28 07:53:49,056][106226] Updated weights for policy 0, policy_version 1758133 (0.0011) [2023-12-28 07:53:49,115][106226] Updated weights for policy 0, policy_version 1758143 (0.0011) [2023-12-28 07:53:49,755][106225] Updated weights for policy 1, policy_version 1762446 (0.0006) [2023-12-28 07:53:49,812][106225] Updated weights for policy 1, policy_version 1762456 (0.0007) [2023-12-28 07:53:49,862][106226] Updated weights for policy 0, policy_version 1758153 (0.0010) [2023-12-28 07:53:49,880][106225] Updated weights for policy 1, policy_version 1762466 (0.0008) [2023-12-28 07:53:49,926][106226] Updated weights for policy 0, policy_version 1758163 (0.0009) [2023-12-28 07:53:49,989][106226] Updated weights for policy 0, policy_version 1758173 (0.0007) [2023-12-28 07:53:50,052][106226] Updated weights for policy 0, policy_version 1758183 (0.0008) [2023-12-28 07:53:50,618][106225] Updated weights for policy 1, policy_version 1762476 (0.0009) [2023-12-28 07:53:50,686][106225] Updated weights for policy 1, policy_version 1762486 (0.0008) [2023-12-28 07:53:50,752][106225] Updated weights for policy 1, policy_version 1762496 (0.0007) [2023-12-28 07:53:50,831][106226] Updated weights for policy 0, policy_version 1758193 (0.0008) [2023-12-28 07:53:50,890][106226] Updated weights for policy 0, policy_version 1758203 (0.0009) [2023-12-28 07:53:50,945][106226] Updated weights for policy 0, policy_version 1758213 (0.0007) [2023-12-28 07:53:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 901439488. Throughput: 0: 9928.4, 1: 9711.3. Samples: 901446664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:51,175][105115] Avg episode reward: [(0, '-4.194'), (1, '-4.941')] [2023-12-28 07:53:51,446][106225] Updated weights for policy 1, policy_version 1762506 (0.0006) [2023-12-28 07:53:51,508][106225] Updated weights for policy 1, policy_version 1762516 (0.0008) [2023-12-28 07:53:51,565][106225] Updated weights for policy 1, policy_version 1762526 (0.0009) [2023-12-28 07:53:51,633][106225] Updated weights for policy 1, policy_version 1762536 (0.0009) [2023-12-28 07:53:51,693][106226] Updated weights for policy 0, policy_version 1758223 (0.0006) [2023-12-28 07:53:51,758][106226] Updated weights for policy 0, policy_version 1758233 (0.0008) [2023-12-28 07:53:51,823][106226] Updated weights for policy 0, policy_version 1758243 (0.0006) [2023-12-28 07:53:52,386][106225] Updated weights for policy 1, policy_version 1762546 (0.0008) [2023-12-28 07:53:52,447][106225] Updated weights for policy 1, policy_version 1762556 (0.0009) [2023-12-28 07:53:52,493][106226] Updated weights for policy 0, policy_version 1758253 (0.0007) [2023-12-28 07:53:52,507][106225] Updated weights for policy 1, policy_version 1762566 (0.0008) [2023-12-28 07:53:52,544][106226] Updated weights for policy 0, policy_version 1758263 (0.0008) [2023-12-28 07:53:52,608][106226] Updated weights for policy 0, policy_version 1758273 (0.0010) [2023-12-28 07:53:53,205][106225] Updated weights for policy 1, policy_version 1762576 (0.0007) [2023-12-28 07:53:53,257][106225] Updated weights for policy 1, policy_version 1762586 (0.0008) [2023-12-28 07:53:53,315][106225] Updated weights for policy 1, policy_version 1762596 (0.0009) [2023-12-28 07:53:53,372][106226] Updated weights for policy 0, policy_version 1758283 (0.0010) [2023-12-28 07:53:53,430][106226] Updated weights for policy 0, policy_version 1758293 (0.0009) [2023-12-28 07:53:53,490][106226] Updated weights for policy 0, policy_version 1758303 (0.0009) [2023-12-28 07:53:54,057][106225] Updated weights for policy 1, policy_version 1762606 (0.0008) [2023-12-28 07:53:54,110][106225] Updated weights for policy 1, policy_version 1762616 (0.0007) [2023-12-28 07:53:54,175][106225] Updated weights for policy 1, policy_version 1762626 (0.0008) [2023-12-28 07:53:54,187][106226] Updated weights for policy 0, policy_version 1758313 (0.0008) [2023-12-28 07:53:54,253][106226] Updated weights for policy 0, policy_version 1758323 (0.0007) [2023-12-28 07:53:54,316][106226] Updated weights for policy 0, policy_version 1758333 (0.0009) [2023-12-28 07:53:54,375][106226] Updated weights for policy 0, policy_version 1758343 (0.0008) [2023-12-28 07:53:54,919][106225] Updated weights for policy 1, policy_version 1762636 (0.0009) [2023-12-28 07:53:54,974][106225] Updated weights for policy 1, policy_version 1762646 (0.0009) [2023-12-28 07:53:55,030][106225] Updated weights for policy 1, policy_version 1762656 (0.0007) [2023-12-28 07:53:55,063][106226] Updated weights for policy 0, policy_version 1758353 (0.0008) [2023-12-28 07:53:55,120][106226] Updated weights for policy 0, policy_version 1758363 (0.0009) [2023-12-28 07:53:55,172][106226] Updated weights for policy 0, policy_version 1758373 (0.0008) [2023-12-28 07:53:55,769][106225] Updated weights for policy 1, policy_version 1762666 (0.0007) [2023-12-28 07:53:55,817][106225] Updated weights for policy 1, policy_version 1762676 (0.0008) [2023-12-28 07:53:55,872][106225] Updated weights for policy 1, policy_version 1762686 (0.0008) [2023-12-28 07:53:55,901][106226] Updated weights for policy 0, policy_version 1758383 (0.0007) [2023-12-28 07:53:55,929][106225] Updated weights for policy 1, policy_version 1762696 (0.0006) [2023-12-28 07:53:55,955][106226] Updated weights for policy 0, policy_version 1758393 (0.0008) [2023-12-28 07:53:56,010][106226] Updated weights for policy 0, policy_version 1758403 (0.0009) [2023-12-28 07:53:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 901537792. Throughput: 0: 9914.4, 1: 9704.1. Samples: 901504388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:53:56,175][105115] Avg episode reward: [(0, '-4.495'), (1, '-5.178')] [2023-12-28 07:53:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001758408_450232320.pth... [2023-12-28 07:53:56,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001762696_451305472.pth... [2023-12-28 07:53:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001757256_449937408.pth [2023-12-28 07:53:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001761544_451010560.pth [2023-12-28 07:53:56,653][106225] Updated weights for policy 1, policy_version 1762706 (0.0006) [2023-12-28 07:53:56,710][106225] Updated weights for policy 1, policy_version 1762716 (0.0005) [2023-12-28 07:53:56,757][106226] Updated weights for policy 0, policy_version 1758413 (0.0009) [2023-12-28 07:53:56,764][106225] Updated weights for policy 1, policy_version 1762726 (0.0006) [2023-12-28 07:53:56,817][106226] Updated weights for policy 0, policy_version 1758423 (0.0008) [2023-12-28 07:53:56,877][106226] Updated weights for policy 0, policy_version 1758433 (0.0008) [2023-12-28 07:53:57,403][106225] Updated weights for policy 1, policy_version 1762736 (0.0010) [2023-12-28 07:53:57,455][106225] Updated weights for policy 1, policy_version 1762746 (0.0010) [2023-12-28 07:53:57,504][106225] Updated weights for policy 1, policy_version 1762756 (0.0010) [2023-12-28 07:53:57,555][106226] Updated weights for policy 0, policy_version 1758443 (0.0009) [2023-12-28 07:53:57,601][106226] Updated weights for policy 0, policy_version 1758453 (0.0010) [2023-12-28 07:53:57,651][106226] Updated weights for policy 0, policy_version 1758463 (0.0010) [2023-12-28 07:53:58,216][106225] Updated weights for policy 1, policy_version 1762766 (0.0010) [2023-12-28 07:53:58,282][106226] Updated weights for policy 0, policy_version 1758473 (0.0006) [2023-12-28 07:53:58,285][106225] Updated weights for policy 1, policy_version 1762776 (0.0008) [2023-12-28 07:53:58,350][106225] Updated weights for policy 1, policy_version 1762786 (0.0009) [2023-12-28 07:53:58,370][106226] Updated weights for policy 0, policy_version 1758483 (0.0009) [2023-12-28 07:53:58,434][106226] Updated weights for policy 0, policy_version 1758493 (0.0008) [2023-12-28 07:53:58,502][106226] Updated weights for policy 0, policy_version 1758503 (0.0009) [2023-12-28 07:53:59,078][106225] Updated weights for policy 1, policy_version 1762796 (0.0008) [2023-12-28 07:53:59,136][106225] Updated weights for policy 1, policy_version 1762806 (0.0008) [2023-12-28 07:53:59,200][106225] Updated weights for policy 1, policy_version 1762816 (0.0007) [2023-12-28 07:53:59,401][106226] Updated weights for policy 0, policy_version 1758513 (0.0008) [2023-12-28 07:53:59,466][106226] Updated weights for policy 0, policy_version 1758523 (0.0008) [2023-12-28 07:53:59,523][106226] Updated weights for policy 0, policy_version 1758533 (0.0009) [2023-12-28 07:53:59,913][106225] Updated weights for policy 1, policy_version 1762826 (0.0007) [2023-12-28 07:53:59,981][106225] Updated weights for policy 1, policy_version 1762836 (0.0009) [2023-12-28 07:54:00,045][106225] Updated weights for policy 1, policy_version 1762846 (0.0008) [2023-12-28 07:54:00,107][106225] Updated weights for policy 1, policy_version 1762856 (0.0008) [2023-12-28 07:54:00,302][106226] Updated weights for policy 0, policy_version 1758543 (0.0008) [2023-12-28 07:54:00,355][106226] Updated weights for policy 0, policy_version 1758553 (0.0008) [2023-12-28 07:54:00,415][106226] Updated weights for policy 0, policy_version 1758563 (0.0008) [2023-12-28 07:54:00,834][106225] Updated weights for policy 1, policy_version 1762866 (0.0006) [2023-12-28 07:54:00,901][106225] Updated weights for policy 1, policy_version 1762876 (0.0005) [2023-12-28 07:54:00,965][106225] Updated weights for policy 1, policy_version 1762886 (0.0006) [2023-12-28 07:54:01,153][106226] Updated weights for policy 0, policy_version 1758573 (0.0010) [2023-12-28 07:54:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 901627904. Throughput: 0: 9877.4, 1: 9691.1. Samples: 901619348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:54:01,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.874')] [2023-12-28 07:54:01,214][106226] Updated weights for policy 0, policy_version 1758583 (0.0010) [2023-12-28 07:54:01,282][106226] Updated weights for policy 0, policy_version 1758593 (0.0009) [2023-12-28 07:54:01,630][106225] Updated weights for policy 1, policy_version 1762896 (0.0007) [2023-12-28 07:54:01,699][106225] Updated weights for policy 1, policy_version 1762906 (0.0008) [2023-12-28 07:54:01,763][106225] Updated weights for policy 1, policy_version 1762916 (0.0007) [2023-12-28 07:54:02,026][106226] Updated weights for policy 0, policy_version 1758603 (0.0008) [2023-12-28 07:54:02,084][106226] Updated weights for policy 0, policy_version 1758613 (0.0008) [2023-12-28 07:54:02,146][106226] Updated weights for policy 0, policy_version 1758623 (0.0008) [2023-12-28 07:54:02,422][106225] Updated weights for policy 1, policy_version 1762926 (0.0008) [2023-12-28 07:54:02,477][106225] Updated weights for policy 1, policy_version 1762936 (0.0009) [2023-12-28 07:54:02,537][106225] Updated weights for policy 1, policy_version 1762946 (0.0008) [2023-12-28 07:54:02,821][106226] Updated weights for policy 0, policy_version 1758633 (0.0009) [2023-12-28 07:54:02,883][106226] Updated weights for policy 0, policy_version 1758643 (0.0009) [2023-12-28 07:54:02,937][106226] Updated weights for policy 0, policy_version 1758653 (0.0009) [2023-12-28 07:54:02,999][106226] Updated weights for policy 0, policy_version 1758663 (0.0008) [2023-12-28 07:54:03,246][106225] Updated weights for policy 1, policy_version 1762956 (0.0007) [2023-12-28 07:54:03,293][106225] Updated weights for policy 1, policy_version 1762966 (0.0005) [2023-12-28 07:54:03,345][106225] Updated weights for policy 1, policy_version 1762976 (0.0006) [2023-12-28 07:54:03,749][106226] Updated weights for policy 0, policy_version 1758673 (0.0006) [2023-12-28 07:54:03,806][106226] Updated weights for policy 0, policy_version 1758683 (0.0005) [2023-12-28 07:54:03,867][106226] Updated weights for policy 0, policy_version 1758693 (0.0007) [2023-12-28 07:54:03,977][106225] Updated weights for policy 1, policy_version 1762986 (0.0007) [2023-12-28 07:54:04,035][106225] Updated weights for policy 1, policy_version 1762996 (0.0008) [2023-12-28 07:54:04,099][106225] Updated weights for policy 1, policy_version 1763006 (0.0008) [2023-12-28 07:54:04,163][106225] Updated weights for policy 1, policy_version 1763016 (0.0007) [2023-12-28 07:54:04,522][106226] Updated weights for policy 0, policy_version 1758703 (0.0011) [2023-12-28 07:54:04,582][106226] Updated weights for policy 0, policy_version 1758713 (0.0010) [2023-12-28 07:54:04,639][106226] Updated weights for policy 0, policy_version 1758723 (0.0010) [2023-12-28 07:54:04,816][106225] Updated weights for policy 1, policy_version 1763026 (0.0006) [2023-12-28 07:54:04,871][106225] Updated weights for policy 1, policy_version 1763036 (0.0007) [2023-12-28 07:54:04,925][106225] Updated weights for policy 1, policy_version 1763046 (0.0009) [2023-12-28 07:54:05,195][106226] Updated weights for policy 0, policy_version 1758733 (0.0009) [2023-12-28 07:54:05,246][106226] Updated weights for policy 0, policy_version 1758743 (0.0010) [2023-12-28 07:54:05,309][106226] Updated weights for policy 0, policy_version 1758753 (0.0010) [2023-12-28 07:54:05,600][106225] Updated weights for policy 1, policy_version 1763056 (0.0008) [2023-12-28 07:54:05,659][106225] Updated weights for policy 1, policy_version 1763066 (0.0005) [2023-12-28 07:54:05,717][106225] Updated weights for policy 1, policy_version 1763076 (0.0005) [2023-12-28 07:54:05,983][106226] Updated weights for policy 0, policy_version 1758763 (0.0011) [2023-12-28 07:54:06,041][106226] Updated weights for policy 0, policy_version 1758773 (0.0011) [2023-12-28 07:54:06,106][106226] Updated weights for policy 0, policy_version 1758783 (0.0010) [2023-12-28 07:54:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 901734400. Throughput: 0: 9854.8, 1: 9787.2. Samples: 901740468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:54:06,175][105115] Avg episode reward: [(0, '-4.375'), (1, '-4.977')] [2023-12-28 07:54:06,357][106225] Updated weights for policy 1, policy_version 1763086 (0.0008) [2023-12-28 07:54:06,424][106225] Updated weights for policy 1, policy_version 1763096 (0.0008) [2023-12-28 07:54:06,489][106225] Updated weights for policy 1, policy_version 1763106 (0.0008) [2023-12-28 07:54:06,833][106226] Updated weights for policy 0, policy_version 1758793 (0.0011) [2023-12-28 07:54:06,886][106226] Updated weights for policy 0, policy_version 1758803 (0.0011) [2023-12-28 07:54:06,940][106226] Updated weights for policy 0, policy_version 1758813 (0.0010) [2023-12-28 07:54:06,995][106226] Updated weights for policy 0, policy_version 1758823 (0.0011) [2023-12-28 07:54:07,128][106225] Updated weights for policy 1, policy_version 1763116 (0.0008) [2023-12-28 07:54:07,186][106225] Updated weights for policy 1, policy_version 1763126 (0.0008) [2023-12-28 07:54:07,250][106225] Updated weights for policy 1, policy_version 1763136 (0.0008) [2023-12-28 07:54:07,771][106226] Updated weights for policy 0, policy_version 1758833 (0.0011) [2023-12-28 07:54:07,831][106226] Updated weights for policy 0, policy_version 1758843 (0.0011) [2023-12-28 07:54:07,837][106225] Updated weights for policy 1, policy_version 1763146 (0.0007) [2023-12-28 07:54:07,892][106226] Updated weights for policy 0, policy_version 1758853 (0.0010) [2023-12-28 07:54:07,897][106225] Updated weights for policy 1, policy_version 1763156 (0.0006) [2023-12-28 07:54:07,968][106225] Updated weights for policy 1, policy_version 1763166 (0.0007) [2023-12-28 07:54:08,029][106225] Updated weights for policy 1, policy_version 1763176 (0.0008) [2023-12-28 07:54:08,658][106226] Updated weights for policy 0, policy_version 1758863 (0.0011) [2023-12-28 07:54:08,721][106226] Updated weights for policy 0, policy_version 1758873 (0.0008) [2023-12-28 07:54:08,784][106226] Updated weights for policy 0, policy_version 1758883 (0.0010) [2023-12-28 07:54:08,798][106225] Updated weights for policy 1, policy_version 1763186 (0.0005) [2023-12-28 07:54:08,855][106225] Updated weights for policy 1, policy_version 1763196 (0.0008) [2023-12-28 07:54:08,910][106225] Updated weights for policy 1, policy_version 1763206 (0.0008) [2023-12-28 07:54:09,435][106226] Updated weights for policy 0, policy_version 1758893 (0.0009) [2023-12-28 07:54:09,487][106226] Updated weights for policy 0, policy_version 1758903 (0.0008) [2023-12-28 07:54:09,557][106226] Updated weights for policy 0, policy_version 1758913 (0.0010) [2023-12-28 07:54:09,705][106225] Updated weights for policy 1, policy_version 1763216 (0.0008) [2023-12-28 07:54:09,770][106225] Updated weights for policy 1, policy_version 1763226 (0.0008) [2023-12-28 07:54:09,835][106225] Updated weights for policy 1, policy_version 1763236 (0.0007) [2023-12-28 07:54:10,291][106226] Updated weights for policy 0, policy_version 1758923 (0.0011) [2023-12-28 07:54:10,345][106226] Updated weights for policy 0, policy_version 1758933 (0.0010) [2023-12-28 07:54:10,403][106226] Updated weights for policy 0, policy_version 1758943 (0.0011) [2023-12-28 07:54:10,555][106225] Updated weights for policy 1, policy_version 1763246 (0.0007) [2023-12-28 07:54:10,621][106225] Updated weights for policy 1, policy_version 1763256 (0.0005) [2023-12-28 07:54:10,684][106225] Updated weights for policy 1, policy_version 1763266 (0.0006) [2023-12-28 07:54:11,023][106226] Updated weights for policy 0, policy_version 1758953 (0.0010) [2023-12-28 07:54:11,088][106226] Updated weights for policy 0, policy_version 1758963 (0.0009) [2023-12-28 07:54:11,153][106226] Updated weights for policy 0, policy_version 1758973 (0.0011) [2023-12-28 07:54:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 901824512. Throughput: 0: 9837.0, 1: 9857.1. Samples: 901800036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:54:11,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.542')] [2023-12-28 07:54:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001763272_451452928.pth... [2023-12-28 07:54:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001762120_451158016.pth [2023-12-28 07:54:11,211][106226] Updated weights for policy 0, policy_version 1758983 (0.0011) [2023-12-28 07:54:11,217][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001758984_450379776.pth... [2023-12-28 07:54:11,222][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001757832_450084864.pth [2023-12-28 07:54:11,304][106225] Updated weights for policy 1, policy_version 1763276 (0.0007) [2023-12-28 07:54:11,372][106225] Updated weights for policy 1, policy_version 1763286 (0.0008) [2023-12-28 07:54:11,438][106225] Updated weights for policy 1, policy_version 1763296 (0.0009) [2023-12-28 07:54:12,002][106226] Updated weights for policy 0, policy_version 1758993 (0.0007) [2023-12-28 07:54:12,069][106226] Updated weights for policy 0, policy_version 1759003 (0.0006) [2023-12-28 07:54:12,119][106226] Updated weights for policy 0, policy_version 1759013 (0.0005) [2023-12-28 07:54:12,195][106225] Updated weights for policy 1, policy_version 1763306 (0.0007) [2023-12-28 07:54:12,252][106225] Updated weights for policy 1, policy_version 1763316 (0.0008) [2023-12-28 07:54:12,313][106225] Updated weights for policy 1, policy_version 1763326 (0.0009) [2023-12-28 07:54:12,382][106225] Updated weights for policy 1, policy_version 1763336 (0.0008) [2023-12-28 07:54:12,696][106226] Updated weights for policy 0, policy_version 1759023 (0.0006) [2023-12-28 07:54:12,750][106226] Updated weights for policy 0, policy_version 1759033 (0.0006) [2023-12-28 07:54:12,810][106226] Updated weights for policy 0, policy_version 1759043 (0.0006) [2023-12-28 07:54:13,247][106225] Updated weights for policy 1, policy_version 1763346 (0.0009) [2023-12-28 07:54:13,305][106225] Updated weights for policy 1, policy_version 1763356 (0.0008) [2023-12-28 07:54:13,365][106225] Updated weights for policy 1, policy_version 1763366 (0.0008) [2023-12-28 07:54:13,410][106226] Updated weights for policy 0, policy_version 1759053 (0.0008) [2023-12-28 07:54:13,467][106226] Updated weights for policy 0, policy_version 1759063 (0.0008) [2023-12-28 07:54:13,530][106226] Updated weights for policy 0, policy_version 1759073 (0.0008) [2023-12-28 07:54:14,067][106225] Updated weights for policy 1, policy_version 1763376 (0.0008) [2023-12-28 07:54:14,130][106225] Updated weights for policy 1, policy_version 1763386 (0.0008) [2023-12-28 07:54:14,197][106225] Updated weights for policy 1, policy_version 1763396 (0.0008) [2023-12-28 07:54:14,262][106226] Updated weights for policy 0, policy_version 1759083 (0.0009) [2023-12-28 07:54:14,316][106226] Updated weights for policy 0, policy_version 1759093 (0.0010) [2023-12-28 07:54:14,376][106226] Updated weights for policy 0, policy_version 1759103 (0.0010) [2023-12-28 07:54:14,947][106225] Updated weights for policy 1, policy_version 1763406 (0.0009) [2023-12-28 07:54:15,009][106225] Updated weights for policy 1, policy_version 1763416 (0.0006) [2023-12-28 07:54:15,061][106226] Updated weights for policy 0, policy_version 1759113 (0.0007) [2023-12-28 07:54:15,079][106225] Updated weights for policy 1, policy_version 1763426 (0.0006) [2023-12-28 07:54:15,131][106226] Updated weights for policy 0, policy_version 1759123 (0.0008) [2023-12-28 07:54:15,198][106226] Updated weights for policy 0, policy_version 1759133 (0.0009) [2023-12-28 07:54:15,267][106226] Updated weights for policy 0, policy_version 1759143 (0.0008) [2023-12-28 07:54:15,693][106225] Updated weights for policy 1, policy_version 1763436 (0.0006) [2023-12-28 07:54:15,756][106225] Updated weights for policy 1, policy_version 1763446 (0.0005) [2023-12-28 07:54:15,817][106225] Updated weights for policy 1, policy_version 1763456 (0.0007) [2023-12-28 07:54:15,928][106226] Updated weights for policy 0, policy_version 1759153 (0.0010) [2023-12-28 07:54:15,982][106226] Updated weights for policy 0, policy_version 1759163 (0.0008) [2023-12-28 07:54:16,042][106226] Updated weights for policy 0, policy_version 1759173 (0.0009) [2023-12-28 07:54:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 901931008. Throughput: 0: 9774.6, 1: 9788.4. Samples: 901916504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:54:16,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.748')] [2023-12-28 07:54:16,425][106225] Updated weights for policy 1, policy_version 1763466 (0.0006) [2023-12-28 07:54:16,479][106225] Updated weights for policy 1, policy_version 1763476 (0.0005) [2023-12-28 07:54:16,537][106225] Updated weights for policy 1, policy_version 1763486 (0.0006) [2023-12-28 07:54:16,584][106225] Updated weights for policy 1, policy_version 1763496 (0.0008) [2023-12-28 07:54:16,752][106226] Updated weights for policy 0, policy_version 1759183 (0.0006) [2023-12-28 07:54:16,802][106226] Updated weights for policy 0, policy_version 1759193 (0.0005) [2023-12-28 07:54:16,858][106226] Updated weights for policy 0, policy_version 1759203 (0.0005) [2023-12-28 07:54:17,337][106225] Updated weights for policy 1, policy_version 1763506 (0.0008) [2023-12-28 07:54:17,382][106225] Updated weights for policy 1, policy_version 1763516 (0.0008) [2023-12-28 07:54:17,429][106225] Updated weights for policy 1, policy_version 1763526 (0.0007) [2023-12-28 07:54:17,449][106226] Updated weights for policy 0, policy_version 1759213 (0.0007) [2023-12-28 07:54:17,506][106226] Updated weights for policy 0, policy_version 1759223 (0.0008) [2023-12-28 07:54:17,572][106226] Updated weights for policy 0, policy_version 1759233 (0.0009) [2023-12-28 07:54:18,177][106225] Updated weights for policy 1, policy_version 1763536 (0.0009) [2023-12-28 07:54:18,225][106225] Updated weights for policy 1, policy_version 1763546 (0.0007) [2023-12-28 07:54:18,277][106225] Updated weights for policy 1, policy_version 1763556 (0.0006) [2023-12-28 07:54:18,307][106226] Updated weights for policy 0, policy_version 1759243 (0.0009) [2023-12-28 07:54:18,380][106226] Updated weights for policy 0, policy_version 1759253 (0.0009) [2023-12-28 07:54:18,440][106226] Updated weights for policy 0, policy_version 1759263 (0.0009) [2023-12-28 07:54:19,047][106225] Updated weights for policy 1, policy_version 1763566 (0.0009) [2023-12-28 07:54:19,050][106226] Updated weights for policy 0, policy_version 1759273 (0.0008) [2023-12-28 07:54:19,098][106225] Updated weights for policy 1, policy_version 1763576 (0.0005) [2023-12-28 07:54:19,104][106226] Updated weights for policy 0, policy_version 1759283 (0.0007) [2023-12-28 07:54:19,147][106225] Updated weights for policy 1, policy_version 1763586 (0.0007) [2023-12-28 07:54:19,162][106226] Updated weights for policy 0, policy_version 1759293 (0.0008) [2023-12-28 07:54:19,232][106226] Updated weights for policy 0, policy_version 1759303 (0.0008) [2023-12-28 07:54:19,913][106225] Updated weights for policy 1, policy_version 1763596 (0.0008) [2023-12-28 07:54:19,980][106225] Updated weights for policy 1, policy_version 1763606 (0.0007) [2023-12-28 07:54:19,999][106226] Updated weights for policy 0, policy_version 1759313 (0.0008) [2023-12-28 07:54:20,044][106225] Updated weights for policy 1, policy_version 1763616 (0.0006) [2023-12-28 07:54:20,064][106226] Updated weights for policy 0, policy_version 1759323 (0.0006) [2023-12-28 07:54:20,123][106226] Updated weights for policy 0, policy_version 1759333 (0.0009) [2023-12-28 07:54:20,792][106225] Updated weights for policy 1, policy_version 1763626 (0.0009) [2023-12-28 07:54:20,851][106225] Updated weights for policy 1, policy_version 1763636 (0.0008) [2023-12-28 07:54:20,857][106226] Updated weights for policy 0, policy_version 1759343 (0.0008) [2023-12-28 07:54:20,923][106225] Updated weights for policy 1, policy_version 1763646 (0.0008) [2023-12-28 07:54:20,929][106226] Updated weights for policy 0, policy_version 1759353 (0.0008) [2023-12-28 07:54:20,986][106225] Updated weights for policy 1, policy_version 1763656 (0.0008) [2023-12-28 07:54:20,997][106226] Updated weights for policy 0, policy_version 1759363 (0.0008) [2023-12-28 07:54:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 902029312. Throughput: 0: 9774.8, 1: 9764.4. Samples: 902033524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 07:54:21,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-5.106')] [2023-12-28 07:54:21,797][106225] Updated weights for policy 1, policy_version 1763666 (0.0008) [2023-12-28 07:54:21,798][106226] Updated weights for policy 0, policy_version 1759373 (0.0008) [2023-12-28 07:54:21,858][106226] Updated weights for policy 0, policy_version 1759383 (0.0008) [2023-12-28 07:54:21,861][106225] Updated weights for policy 1, policy_version 1763676 (0.0008) [2023-12-28 07:54:21,922][106225] Updated weights for policy 1, policy_version 1763686 (0.0006) [2023-12-28 07:54:21,924][106226] Updated weights for policy 0, policy_version 1759393 (0.0008) [2023-12-28 07:54:22,587][106226] Updated weights for policy 0, policy_version 1759403 (0.0007) [2023-12-28 07:54:22,645][106225] Updated weights for policy 1, policy_version 1763696 (0.0008) [2023-12-28 07:54:22,650][106226] Updated weights for policy 0, policy_version 1759413 (0.0008) [2023-12-28 07:54:22,704][106225] Updated weights for policy 1, policy_version 1763706 (0.0008) [2023-12-28 07:54:22,710][106226] Updated weights for policy 0, policy_version 1759423 (0.0006) [2023-12-28 07:54:22,769][106225] Updated weights for policy 1, policy_version 1763716 (0.0008) [2023-12-28 07:54:23,340][106226] Updated weights for policy 0, policy_version 1759433 (0.0006) [2023-12-28 07:54:23,401][106226] Updated weights for policy 0, policy_version 1759443 (0.0005) [2023-12-28 07:54:23,460][106226] Updated weights for policy 0, policy_version 1759453 (0.0007) [2023-12-28 07:54:23,525][106226] Updated weights for policy 0, policy_version 1759463 (0.0006) [2023-12-28 07:54:23,556][106225] Updated weights for policy 1, policy_version 1763726 (0.0010) [2023-12-28 07:54:23,618][106225] Updated weights for policy 1, policy_version 1763736 (0.0008) [2023-12-28 07:54:23,665][106225] Updated weights for policy 1, policy_version 1763746 (0.0008) [2023-12-28 07:54:24,104][106226] Updated weights for policy 0, policy_version 1759473 (0.0006) [2023-12-28 07:54:24,161][106226] Updated weights for policy 0, policy_version 1759483 (0.0008) [2023-12-28 07:54:24,223][106226] Updated weights for policy 0, policy_version 1759493 (0.0008) [2023-12-28 07:54:24,435][106225] Updated weights for policy 1, policy_version 1763756 (0.0009) [2023-12-28 07:54:24,485][106225] Updated weights for policy 1, policy_version 1763766 (0.0009) [2023-12-28 07:54:24,536][106225] Updated weights for policy 1, policy_version 1763776 (0.0007) [2023-12-28 07:54:24,839][106226] Updated weights for policy 0, policy_version 1759503 (0.0008) [2023-12-28 07:54:24,896][106226] Updated weights for policy 0, policy_version 1759513 (0.0009) [2023-12-28 07:54:24,954][106226] Updated weights for policy 0, policy_version 1759523 (0.0010) [2023-12-28 07:54:25,253][106225] Updated weights for policy 1, policy_version 1763786 (0.0009) [2023-12-28 07:54:25,302][106225] Updated weights for policy 1, policy_version 1763796 (0.0008) [2023-12-28 07:54:25,352][106225] Updated weights for policy 1, policy_version 1763806 (0.0008) [2023-12-28 07:54:25,404][106225] Updated weights for policy 1, policy_version 1763816 (0.0008) [2023-12-28 07:54:25,674][106226] Updated weights for policy 0, policy_version 1759533 (0.0008) [2023-12-28 07:54:25,726][106226] Updated weights for policy 0, policy_version 1759543 (0.0009) [2023-12-28 07:54:25,783][106226] Updated weights for policy 0, policy_version 1759553 (0.0010) [2023-12-28 07:54:26,148][106225] Updated weights for policy 1, policy_version 1763826 (0.0008) [2023-12-28 07:54:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 902119424. Throughput: 0: 9804.3, 1: 9690.6. Samples: 902091568. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:26,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.905')] [2023-12-28 07:54:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001759560_450527232.pth... [2023-12-28 07:54:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001758408_450232320.pth [2023-12-28 07:54:26,208][106225] Updated weights for policy 1, policy_version 1763836 (0.0009) [2023-12-28 07:54:26,267][106225] Updated weights for policy 1, policy_version 1763846 (0.0007) [2023-12-28 07:54:26,277][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001763848_451600384.pth... [2023-12-28 07:54:26,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001762696_451305472.pth [2023-12-28 07:54:26,450][106226] Updated weights for policy 0, policy_version 1759563 (0.0010) [2023-12-28 07:54:26,502][106226] Updated weights for policy 0, policy_version 1759573 (0.0010) [2023-12-28 07:54:26,565][106226] Updated weights for policy 0, policy_version 1759583 (0.0011) [2023-12-28 07:54:26,963][106225] Updated weights for policy 1, policy_version 1763856 (0.0008) [2023-12-28 07:54:27,011][106225] Updated weights for policy 1, policy_version 1763866 (0.0006) [2023-12-28 07:54:27,063][106225] Updated weights for policy 1, policy_version 1763877 (0.0008) [2023-12-28 07:54:27,221][106226] Updated weights for policy 0, policy_version 1759593 (0.0008) [2023-12-28 07:54:27,287][106226] Updated weights for policy 0, policy_version 1759603 (0.0006) [2023-12-28 07:54:27,344][106226] Updated weights for policy 0, policy_version 1759613 (0.0007) [2023-12-28 07:54:27,392][106226] Updated weights for policy 0, policy_version 1759623 (0.0008) [2023-12-28 07:54:27,830][106225] Updated weights for policy 1, policy_version 1763887 (0.0009) [2023-12-28 07:54:27,879][106225] Updated weights for policy 1, policy_version 1763897 (0.0009) [2023-12-28 07:54:27,928][106225] Updated weights for policy 1, policy_version 1763908 (0.0009) [2023-12-28 07:54:27,986][106226] Updated weights for policy 0, policy_version 1759633 (0.0007) [2023-12-28 07:54:28,051][106226] Updated weights for policy 0, policy_version 1759643 (0.0007) [2023-12-28 07:54:28,113][106226] Updated weights for policy 0, policy_version 1759653 (0.0005) [2023-12-28 07:54:28,646][106226] Updated weights for policy 0, policy_version 1759663 (0.0005) [2023-12-28 07:54:28,654][106225] Updated weights for policy 1, policy_version 1763918 (0.0007) [2023-12-28 07:54:28,706][106225] Updated weights for policy 1, policy_version 1763928 (0.0008) [2023-12-28 07:54:28,713][106226] Updated weights for policy 0, policy_version 1759673 (0.0006) [2023-12-28 07:54:28,760][106225] Updated weights for policy 1, policy_version 1763938 (0.0009) [2023-12-28 07:54:28,766][106226] Updated weights for policy 0, policy_version 1759683 (0.0008) [2023-12-28 07:54:29,416][106226] Updated weights for policy 0, policy_version 1759693 (0.0008) [2023-12-28 07:54:29,483][106226] Updated weights for policy 0, policy_version 1759703 (0.0006) [2023-12-28 07:54:29,493][106225] Updated weights for policy 1, policy_version 1763948 (0.0006) [2023-12-28 07:54:29,551][106226] Updated weights for policy 0, policy_version 1759713 (0.0007) [2023-12-28 07:54:29,561][106225] Updated weights for policy 1, policy_version 1763958 (0.0006) [2023-12-28 07:54:29,615][106225] Updated weights for policy 1, policy_version 1763968 (0.0006) [2023-12-28 07:54:30,252][106226] Updated weights for policy 0, policy_version 1759723 (0.0007) [2023-12-28 07:54:30,298][106225] Updated weights for policy 1, policy_version 1763978 (0.0007) [2023-12-28 07:54:30,311][106226] Updated weights for policy 0, policy_version 1759733 (0.0009) [2023-12-28 07:54:30,356][106225] Updated weights for policy 1, policy_version 1763988 (0.0006) [2023-12-28 07:54:30,373][106226] Updated weights for policy 0, policy_version 1759743 (0.0007) [2023-12-28 07:54:30,422][106225] Updated weights for policy 1, policy_version 1763998 (0.0007) [2023-12-28 07:54:30,474][106225] Updated weights for policy 1, policy_version 1764008 (0.0005) [2023-12-28 07:54:31,108][106225] Updated weights for policy 1, policy_version 1764018 (0.0008) [2023-12-28 07:54:31,154][106226] Updated weights for policy 0, policy_version 1759753 (0.0006) [2023-12-28 07:54:31,172][106225] Updated weights for policy 1, policy_version 1764028 (0.0007) [2023-12-28 07:54:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 902217728. Throughput: 0: 10003.5, 1: 9664.7. Samples: 902213264. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:31,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.544')] [2023-12-28 07:54:31,214][106226] Updated weights for policy 0, policy_version 1759763 (0.0009) [2023-12-28 07:54:31,237][106225] Updated weights for policy 1, policy_version 1764038 (0.0007) [2023-12-28 07:54:31,273][106226] Updated weights for policy 0, policy_version 1759773 (0.0006) [2023-12-28 07:54:31,334][106226] Updated weights for policy 0, policy_version 1759783 (0.0008) [2023-12-28 07:54:32,035][106225] Updated weights for policy 1, policy_version 1764048 (0.0009) [2023-12-28 07:54:32,045][106226] Updated weights for policy 0, policy_version 1759793 (0.0008) [2023-12-28 07:54:32,092][106225] Updated weights for policy 1, policy_version 1764058 (0.0010) [2023-12-28 07:54:32,105][106226] Updated weights for policy 0, policy_version 1759803 (0.0008) [2023-12-28 07:54:32,153][106225] Updated weights for policy 1, policy_version 1764068 (0.0010) [2023-12-28 07:54:32,168][106226] Updated weights for policy 0, policy_version 1759813 (0.0005) [2023-12-28 07:54:32,821][106225] Updated weights for policy 1, policy_version 1764078 (0.0008) [2023-12-28 07:54:32,858][106226] Updated weights for policy 0, policy_version 1759823 (0.0007) [2023-12-28 07:54:32,868][106225] Updated weights for policy 1, policy_version 1764088 (0.0007) [2023-12-28 07:54:32,916][106226] Updated weights for policy 0, policy_version 1759833 (0.0005) [2023-12-28 07:54:32,921][106225] Updated weights for policy 1, policy_version 1764098 (0.0006) [2023-12-28 07:54:32,967][106226] Updated weights for policy 0, policy_version 1759843 (0.0009) [2023-12-28 07:54:33,586][106225] Updated weights for policy 1, policy_version 1764108 (0.0008) [2023-12-28 07:54:33,645][106225] Updated weights for policy 1, policy_version 1764118 (0.0010) [2023-12-28 07:54:33,702][106226] Updated weights for policy 0, policy_version 1759853 (0.0008) [2023-12-28 07:54:33,705][106225] Updated weights for policy 1, policy_version 1764128 (0.0010) [2023-12-28 07:54:33,752][106226] Updated weights for policy 0, policy_version 1759863 (0.0005) [2023-12-28 07:54:33,804][106226] Updated weights for policy 0, policy_version 1759873 (0.0007) [2023-12-28 07:54:34,416][106225] Updated weights for policy 1, policy_version 1764138 (0.0010) [2023-12-28 07:54:34,483][106225] Updated weights for policy 1, policy_version 1764148 (0.0010) [2023-12-28 07:54:34,540][106225] Updated weights for policy 1, policy_version 1764158 (0.0010) [2023-12-28 07:54:34,554][106226] Updated weights for policy 0, policy_version 1759883 (0.0007) [2023-12-28 07:54:34,598][106225] Updated weights for policy 1, policy_version 1764168 (0.0010) [2023-12-28 07:54:34,613][106226] Updated weights for policy 0, policy_version 1759893 (0.0006) [2023-12-28 07:54:34,672][106226] Updated weights for policy 0, policy_version 1759903 (0.0008) [2023-12-28 07:54:35,254][106225] Updated weights for policy 1, policy_version 1764178 (0.0005) [2023-12-28 07:54:35,309][106225] Updated weights for policy 1, policy_version 1764188 (0.0006) [2023-12-28 07:54:35,366][106225] Updated weights for policy 1, policy_version 1764198 (0.0007) [2023-12-28 07:54:35,416][106226] Updated weights for policy 0, policy_version 1759913 (0.0008) [2023-12-28 07:54:35,478][106226] Updated weights for policy 0, policy_version 1759923 (0.0010) [2023-12-28 07:54:35,543][106226] Updated weights for policy 0, policy_version 1759933 (0.0009) [2023-12-28 07:54:35,608][106226] Updated weights for policy 0, policy_version 1759943 (0.0008) [2023-12-28 07:54:35,911][106225] Updated weights for policy 1, policy_version 1764208 (0.0005) [2023-12-28 07:54:35,968][106225] Updated weights for policy 1, policy_version 1764218 (0.0006) [2023-12-28 07:54:36,023][106225] Updated weights for policy 1, policy_version 1764228 (0.0008) [2023-12-28 07:54:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 902324224. Throughput: 0: 9917.3, 1: 9753.1. Samples: 902331836. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:36,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-5.262')] [2023-12-28 07:54:36,345][106226] Updated weights for policy 0, policy_version 1759953 (0.0007) [2023-12-28 07:54:36,411][106226] Updated weights for policy 0, policy_version 1759963 (0.0008) [2023-12-28 07:54:36,477][106226] Updated weights for policy 0, policy_version 1759973 (0.0008) [2023-12-28 07:54:36,737][106225] Updated weights for policy 1, policy_version 1764238 (0.0009) [2023-12-28 07:54:36,791][106225] Updated weights for policy 1, policy_version 1764248 (0.0010) [2023-12-28 07:54:36,839][106225] Updated weights for policy 1, policy_version 1764258 (0.0009) [2023-12-28 07:54:37,218][106226] Updated weights for policy 0, policy_version 1759983 (0.0008) [2023-12-28 07:54:37,280][106226] Updated weights for policy 0, policy_version 1759993 (0.0009) [2023-12-28 07:54:37,346][106226] Updated weights for policy 0, policy_version 1760003 (0.0009) [2023-12-28 07:54:37,439][106225] Updated weights for policy 1, policy_version 1764268 (0.0005) [2023-12-28 07:54:37,491][106225] Updated weights for policy 1, policy_version 1764278 (0.0006) [2023-12-28 07:54:37,552][106225] Updated weights for policy 1, policy_version 1764288 (0.0006) [2023-12-28 07:54:38,100][106225] Updated weights for policy 1, policy_version 1764298 (0.0009) [2023-12-28 07:54:38,113][106226] Updated weights for policy 0, policy_version 1760013 (0.0008) [2023-12-28 07:54:38,163][106226] Updated weights for policy 0, policy_version 1760023 (0.0007) [2023-12-28 07:54:38,164][106225] Updated weights for policy 1, policy_version 1764308 (0.0008) [2023-12-28 07:54:38,213][106226] Updated weights for policy 0, policy_version 1760033 (0.0005) [2023-12-28 07:54:38,218][106225] Updated weights for policy 1, policy_version 1764318 (0.0010) [2023-12-28 07:54:38,279][106225] Updated weights for policy 1, policy_version 1764328 (0.0010) [2023-12-28 07:54:38,945][106225] Updated weights for policy 1, policy_version 1764338 (0.0011) [2023-12-28 07:54:39,005][106226] Updated weights for policy 0, policy_version 1760043 (0.0006) [2023-12-28 07:54:39,006][106225] Updated weights for policy 1, policy_version 1764348 (0.0008) [2023-12-28 07:54:39,062][106225] Updated weights for policy 1, policy_version 1764358 (0.0009) [2023-12-28 07:54:39,069][106226] Updated weights for policy 0, policy_version 1760053 (0.0007) [2023-12-28 07:54:39,135][106226] Updated weights for policy 0, policy_version 1760063 (0.0008) [2023-12-28 07:54:39,784][106225] Updated weights for policy 1, policy_version 1764368 (0.0008) [2023-12-28 07:54:39,848][106225] Updated weights for policy 1, policy_version 1764378 (0.0009) [2023-12-28 07:54:39,910][106225] Updated weights for policy 1, policy_version 1764388 (0.0008) [2023-12-28 07:54:39,917][106226] Updated weights for policy 0, policy_version 1760073 (0.0008) [2023-12-28 07:54:39,987][106226] Updated weights for policy 0, policy_version 1760083 (0.0008) [2023-12-28 07:54:40,041][106226] Updated weights for policy 0, policy_version 1760093 (0.0009) [2023-12-28 07:54:40,091][106226] Updated weights for policy 0, policy_version 1760103 (0.0009) [2023-12-28 07:54:40,673][106225] Updated weights for policy 1, policy_version 1764398 (0.0007) [2023-12-28 07:54:40,733][106225] Updated weights for policy 1, policy_version 1764408 (0.0005) [2023-12-28 07:54:40,802][106225] Updated weights for policy 1, policy_version 1764418 (0.0005) [2023-12-28 07:54:40,886][106226] Updated weights for policy 0, policy_version 1760113 (0.0008) [2023-12-28 07:54:40,938][106226] Updated weights for policy 0, policy_version 1760123 (0.0008) [2023-12-28 07:54:40,994][106226] Updated weights for policy 0, policy_version 1760133 (0.0009) [2023-12-28 07:54:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 902422528. Throughput: 0: 9883.5, 1: 9841.6. Samples: 902392020. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:41,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.789')] [2023-12-28 07:54:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001760136_450674688.pth... [2023-12-28 07:54:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001764424_451747840.pth... [2023-12-28 07:54:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001763272_451452928.pth [2023-12-28 07:54:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001758984_450379776.pth [2023-12-28 07:54:41,538][106225] Updated weights for policy 1, policy_version 1764428 (0.0006) [2023-12-28 07:54:41,594][106225] Updated weights for policy 1, policy_version 1764438 (0.0007) [2023-12-28 07:54:41,658][106225] Updated weights for policy 1, policy_version 1764448 (0.0008) [2023-12-28 07:54:41,812][106226] Updated weights for policy 0, policy_version 1760143 (0.0007) [2023-12-28 07:54:41,878][106226] Updated weights for policy 0, policy_version 1760153 (0.0007) [2023-12-28 07:54:41,943][106226] Updated weights for policy 0, policy_version 1760163 (0.0008) [2023-12-28 07:54:42,421][106225] Updated weights for policy 1, policy_version 1764458 (0.0007) [2023-12-28 07:54:42,484][106225] Updated weights for policy 1, policy_version 1764468 (0.0008) [2023-12-28 07:54:42,544][106225] Updated weights for policy 1, policy_version 1764478 (0.0008) [2023-12-28 07:54:42,606][106225] Updated weights for policy 1, policy_version 1764488 (0.0007) [2023-12-28 07:54:42,682][106226] Updated weights for policy 0, policy_version 1760173 (0.0007) [2023-12-28 07:54:42,747][106226] Updated weights for policy 0, policy_version 1760183 (0.0008) [2023-12-28 07:54:42,809][106226] Updated weights for policy 0, policy_version 1760193 (0.0006) [2023-12-28 07:54:43,247][106225] Updated weights for policy 1, policy_version 1764498 (0.0010) [2023-12-28 07:54:43,293][106225] Updated weights for policy 1, policy_version 1764508 (0.0005) [2023-12-28 07:54:43,350][106225] Updated weights for policy 1, policy_version 1764518 (0.0006) [2023-12-28 07:54:43,367][106226] Updated weights for policy 0, policy_version 1760203 (0.0006) [2023-12-28 07:54:43,421][106226] Updated weights for policy 0, policy_version 1760213 (0.0005) [2023-12-28 07:54:43,478][106226] Updated weights for policy 0, policy_version 1760223 (0.0005) [2023-12-28 07:54:44,038][106225] Updated weights for policy 1, policy_version 1764528 (0.0010) [2023-12-28 07:54:44,069][106226] Updated weights for policy 0, policy_version 1760233 (0.0005) [2023-12-28 07:54:44,102][106225] Updated weights for policy 1, policy_version 1764538 (0.0011) [2023-12-28 07:54:44,127][106226] Updated weights for policy 0, policy_version 1760243 (0.0005) [2023-12-28 07:54:44,160][106225] Updated weights for policy 1, policy_version 1764548 (0.0011) [2023-12-28 07:54:44,187][106226] Updated weights for policy 0, policy_version 1760253 (0.0010) [2023-12-28 07:54:44,249][106226] Updated weights for policy 0, policy_version 1760263 (0.0010) [2023-12-28 07:54:44,872][106225] Updated weights for policy 1, policy_version 1764558 (0.0010) [2023-12-28 07:54:44,874][106226] Updated weights for policy 0, policy_version 1760273 (0.0007) [2023-12-28 07:54:44,924][106225] Updated weights for policy 1, policy_version 1764568 (0.0010) [2023-12-28 07:54:44,930][106226] Updated weights for policy 0, policy_version 1760283 (0.0006) [2023-12-28 07:54:44,980][106225] Updated weights for policy 1, policy_version 1764578 (0.0011) [2023-12-28 07:54:44,993][106226] Updated weights for policy 0, policy_version 1760293 (0.0006) [2023-12-28 07:54:45,715][106225] Updated weights for policy 1, policy_version 1764588 (0.0009) [2023-12-28 07:54:45,724][106226] Updated weights for policy 0, policy_version 1760303 (0.0005) [2023-12-28 07:54:45,782][106225] Updated weights for policy 1, policy_version 1764598 (0.0005) [2023-12-28 07:54:45,787][106226] Updated weights for policy 0, policy_version 1760313 (0.0008) [2023-12-28 07:54:45,849][106225] Updated weights for policy 1, policy_version 1764608 (0.0007) [2023-12-28 07:54:45,851][106226] Updated weights for policy 0, policy_version 1760323 (0.0008) [2023-12-28 07:54:46,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 902520832. Throughput: 0: 9918.8, 1: 9847.1. Samples: 902508816. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:46,175][105115] Avg episode reward: [(0, '-4.653'), (1, '-4.667')] [2023-12-28 07:54:46,531][106225] Updated weights for policy 1, policy_version 1764618 (0.0009) [2023-12-28 07:54:46,550][106226] Updated weights for policy 0, policy_version 1760333 (0.0009) [2023-12-28 07:54:46,589][106225] Updated weights for policy 1, policy_version 1764628 (0.0005) [2023-12-28 07:54:46,608][106226] Updated weights for policy 0, policy_version 1760343 (0.0008) [2023-12-28 07:54:46,646][106225] Updated weights for policy 1, policy_version 1764638 (0.0010) [2023-12-28 07:54:46,670][106226] Updated weights for policy 0, policy_version 1760353 (0.0007) [2023-12-28 07:54:46,696][106225] Updated weights for policy 1, policy_version 1764648 (0.0009) [2023-12-28 07:54:47,237][106226] Updated weights for policy 0, policy_version 1760363 (0.0006) [2023-12-28 07:54:47,294][106226] Updated weights for policy 0, policy_version 1760373 (0.0005) [2023-12-28 07:54:47,350][106226] Updated weights for policy 0, policy_version 1760383 (0.0005) [2023-12-28 07:54:47,399][106225] Updated weights for policy 1, policy_version 1764658 (0.0010) [2023-12-28 07:54:47,446][106225] Updated weights for policy 1, policy_version 1764668 (0.0010) [2023-12-28 07:54:47,492][106225] Updated weights for policy 1, policy_version 1764678 (0.0010) [2023-12-28 07:54:47,953][106226] Updated weights for policy 0, policy_version 1760393 (0.0005) [2023-12-28 07:54:48,014][106226] Updated weights for policy 0, policy_version 1760403 (0.0005) [2023-12-28 07:54:48,075][106226] Updated weights for policy 0, policy_version 1760413 (0.0006) [2023-12-28 07:54:48,130][106226] Updated weights for policy 0, policy_version 1760423 (0.0007) [2023-12-28 07:54:48,250][106225] Updated weights for policy 1, policy_version 1764688 (0.0008) [2023-12-28 07:54:48,301][106225] Updated weights for policy 1, policy_version 1764698 (0.0008) [2023-12-28 07:54:48,368][106225] Updated weights for policy 1, policy_version 1764708 (0.0007) [2023-12-28 07:54:48,756][106226] Updated weights for policy 0, policy_version 1760433 (0.0009) [2023-12-28 07:54:48,819][106226] Updated weights for policy 0, policy_version 1760443 (0.0009) [2023-12-28 07:54:48,883][106226] Updated weights for policy 0, policy_version 1760453 (0.0005) [2023-12-28 07:54:49,144][106225] Updated weights for policy 1, policy_version 1764718 (0.0008) [2023-12-28 07:54:49,191][106225] Updated weights for policy 1, policy_version 1764728 (0.0009) [2023-12-28 07:54:49,253][106225] Updated weights for policy 1, policy_version 1764738 (0.0009) [2023-12-28 07:54:49,515][106226] Updated weights for policy 0, policy_version 1760463 (0.0009) [2023-12-28 07:54:49,579][106226] Updated weights for policy 0, policy_version 1760473 (0.0008) [2023-12-28 07:54:49,649][106226] Updated weights for policy 0, policy_version 1760483 (0.0010) [2023-12-28 07:54:50,038][106225] Updated weights for policy 1, policy_version 1764748 (0.0009) [2023-12-28 07:54:50,090][106225] Updated weights for policy 1, policy_version 1764758 (0.0008) [2023-12-28 07:54:50,143][106225] Updated weights for policy 1, policy_version 1764768 (0.0008) [2023-12-28 07:54:50,315][106226] Updated weights for policy 0, policy_version 1760493 (0.0009) [2023-12-28 07:54:50,377][106226] Updated weights for policy 0, policy_version 1760503 (0.0010) [2023-12-28 07:54:50,441][106226] Updated weights for policy 0, policy_version 1760513 (0.0010) [2023-12-28 07:54:50,894][106225] Updated weights for policy 1, policy_version 1764778 (0.0009) [2023-12-28 07:54:50,947][106225] Updated weights for policy 1, policy_version 1764788 (0.0010) [2023-12-28 07:54:50,998][106225] Updated weights for policy 1, policy_version 1764798 (0.0009) [2023-12-28 07:54:51,066][106225] Updated weights for policy 1, policy_version 1764808 (0.0009) [2023-12-28 07:54:51,107][106226] Updated weights for policy 0, policy_version 1760523 (0.0011) [2023-12-28 07:54:51,173][106226] Updated weights for policy 0, policy_version 1760533 (0.0009) [2023-12-28 07:54:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 902619136. Throughput: 0: 9980.5, 1: 9758.9. Samples: 902628740. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:51,175][105115] Avg episode reward: [(0, '-4.458'), (1, '-4.864')] [2023-12-28 07:54:51,242][106226] Updated weights for policy 0, policy_version 1760543 (0.0008) [2023-12-28 07:54:51,867][106225] Updated weights for policy 1, policy_version 1764818 (0.0010) [2023-12-28 07:54:51,929][106225] Updated weights for policy 1, policy_version 1764828 (0.0010) [2023-12-28 07:54:51,991][106225] Updated weights for policy 1, policy_version 1764838 (0.0010) [2023-12-28 07:54:52,053][106226] Updated weights for policy 0, policy_version 1760553 (0.0009) [2023-12-28 07:54:52,122][106226] Updated weights for policy 0, policy_version 1760563 (0.0008) [2023-12-28 07:54:52,173][106226] Updated weights for policy 0, policy_version 1760573 (0.0007) [2023-12-28 07:54:52,223][106226] Updated weights for policy 0, policy_version 1760583 (0.0008) [2023-12-28 07:54:52,672][106225] Updated weights for policy 1, policy_version 1764848 (0.0008) [2023-12-28 07:54:52,729][106225] Updated weights for policy 1, policy_version 1764858 (0.0008) [2023-12-28 07:54:52,776][106225] Updated weights for policy 1, policy_version 1764868 (0.0008) [2023-12-28 07:54:52,931][106226] Updated weights for policy 0, policy_version 1760593 (0.0010) [2023-12-28 07:54:52,998][106226] Updated weights for policy 0, policy_version 1760603 (0.0011) [2023-12-28 07:54:53,064][106226] Updated weights for policy 0, policy_version 1760613 (0.0010) [2023-12-28 07:54:53,523][106225] Updated weights for policy 1, policy_version 1764878 (0.0009) [2023-12-28 07:54:53,578][106225] Updated weights for policy 1, policy_version 1764888 (0.0009) [2023-12-28 07:54:53,633][106225] Updated weights for policy 1, policy_version 1764898 (0.0008) [2023-12-28 07:54:53,716][106226] Updated weights for policy 0, policy_version 1760623 (0.0010) [2023-12-28 07:54:53,772][106226] Updated weights for policy 0, policy_version 1760633 (0.0010) [2023-12-28 07:54:53,828][106226] Updated weights for policy 0, policy_version 1760643 (0.0010) [2023-12-28 07:54:54,382][106225] Updated weights for policy 1, policy_version 1764908 (0.0008) [2023-12-28 07:54:54,439][106225] Updated weights for policy 1, policy_version 1764918 (0.0008) [2023-12-28 07:54:54,502][106225] Updated weights for policy 1, policy_version 1764928 (0.0010) [2023-12-28 07:54:54,538][106226] Updated weights for policy 0, policy_version 1760653 (0.0008) [2023-12-28 07:54:54,591][106226] Updated weights for policy 0, policy_version 1760663 (0.0005) [2023-12-28 07:54:54,652][106226] Updated weights for policy 0, policy_version 1760673 (0.0007) [2023-12-28 07:54:55,221][106225] Updated weights for policy 1, policy_version 1764938 (0.0008) [2023-12-28 07:54:55,274][106225] Updated weights for policy 1, policy_version 1764948 (0.0005) [2023-12-28 07:54:55,325][106225] Updated weights for policy 1, policy_version 1764958 (0.0005) [2023-12-28 07:54:55,345][106226] Updated weights for policy 0, policy_version 1760683 (0.0008) [2023-12-28 07:54:55,381][106225] Updated weights for policy 1, policy_version 1764968 (0.0005) [2023-12-28 07:54:55,394][106226] Updated weights for policy 0, policy_version 1760693 (0.0010) [2023-12-28 07:54:55,448][106226] Updated weights for policy 0, policy_version 1760703 (0.0010) [2023-12-28 07:54:55,898][106225] Updated weights for policy 1, policy_version 1764978 (0.0010) [2023-12-28 07:54:55,954][106225] Updated weights for policy 1, policy_version 1764988 (0.0010) [2023-12-28 07:54:56,003][106225] Updated weights for policy 1, policy_version 1764998 (0.0010) [2023-12-28 07:54:56,167][106226] Updated weights for policy 0, policy_version 1760713 (0.0010) [2023-12-28 07:54:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 902717440. Throughput: 0: 9987.4, 1: 9687.4. Samples: 902685408. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:54:56,175][105115] Avg episode reward: [(0, '-4.310'), (1, '-4.703')] [2023-12-28 07:54:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001765000_451895296.pth... [2023-12-28 07:54:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001763848_451600384.pth [2023-12-28 07:54:56,225][106226] Updated weights for policy 0, policy_version 1760723 (0.0011) [2023-12-28 07:54:56,278][106226] Updated weights for policy 0, policy_version 1760733 (0.0010) [2023-12-28 07:54:56,326][106226] Updated weights for policy 0, policy_version 1760743 (0.0010) [2023-12-28 07:54:56,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001760744_450830336.pth... [2023-12-28 07:54:56,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001759560_450527232.pth [2023-12-28 07:54:56,723][106225] Updated weights for policy 1, policy_version 1765008 (0.0007) [2023-12-28 07:54:56,776][106225] Updated weights for policy 1, policy_version 1765018 (0.0008) [2023-12-28 07:54:56,837][106225] Updated weights for policy 1, policy_version 1765028 (0.0008) [2023-12-28 07:54:57,053][106226] Updated weights for policy 0, policy_version 1760753 (0.0008) [2023-12-28 07:54:57,116][106226] Updated weights for policy 0, policy_version 1760763 (0.0008) [2023-12-28 07:54:57,170][106226] Updated weights for policy 0, policy_version 1760773 (0.0008) [2023-12-28 07:54:57,547][106225] Updated weights for policy 1, policy_version 1765038 (0.0010) [2023-12-28 07:54:57,603][106225] Updated weights for policy 1, policy_version 1765048 (0.0010) [2023-12-28 07:54:57,663][106225] Updated weights for policy 1, policy_version 1765058 (0.0010) [2023-12-28 07:54:57,814][106226] Updated weights for policy 0, policy_version 1760783 (0.0007) [2023-12-28 07:54:57,856][106226] Updated weights for policy 0, policy_version 1760793 (0.0007) [2023-12-28 07:54:57,902][106226] Updated weights for policy 0, policy_version 1760803 (0.0005) [2023-12-28 07:54:58,409][106225] Updated weights for policy 1, policy_version 1765068 (0.0010) [2023-12-28 07:54:58,482][106225] Updated weights for policy 1, policy_version 1765078 (0.0010) [2023-12-28 07:54:58,548][106225] Updated weights for policy 1, policy_version 1765088 (0.0010) [2023-12-28 07:54:58,561][106226] Updated weights for policy 0, policy_version 1760813 (0.0008) [2023-12-28 07:54:58,637][106226] Updated weights for policy 0, policy_version 1760823 (0.0007) [2023-12-28 07:54:58,704][106226] Updated weights for policy 0, policy_version 1760833 (0.0009) [2023-12-28 07:54:59,315][106225] Updated weights for policy 1, policy_version 1765098 (0.0010) [2023-12-28 07:54:59,386][106225] Updated weights for policy 1, policy_version 1765108 (0.0008) [2023-12-28 07:54:59,444][106225] Updated weights for policy 1, policy_version 1765118 (0.0009) [2023-12-28 07:54:59,498][106225] Updated weights for policy 1, policy_version 1765128 (0.0010) [2023-12-28 07:54:59,544][106226] Updated weights for policy 0, policy_version 1760843 (0.0009) [2023-12-28 07:54:59,603][106226] Updated weights for policy 0, policy_version 1760853 (0.0008) [2023-12-28 07:54:59,657][106226] Updated weights for policy 0, policy_version 1760863 (0.0010) [2023-12-28 07:55:00,267][106225] Updated weights for policy 1, policy_version 1765138 (0.0010) [2023-12-28 07:55:00,314][106226] Updated weights for policy 0, policy_version 1760873 (0.0008) [2023-12-28 07:55:00,330][106225] Updated weights for policy 1, policy_version 1765148 (0.0010) [2023-12-28 07:55:00,368][106226] Updated weights for policy 0, policy_version 1760883 (0.0010) [2023-12-28 07:55:00,394][106225] Updated weights for policy 1, policy_version 1765158 (0.0010) [2023-12-28 07:55:00,419][106226] Updated weights for policy 0, policy_version 1760893 (0.0010) [2023-12-28 07:55:00,469][106226] Updated weights for policy 0, policy_version 1760903 (0.0006) [2023-12-28 07:55:01,109][106225] Updated weights for policy 1, policy_version 1765168 (0.0008) [2023-12-28 07:55:01,124][106226] Updated weights for policy 0, policy_version 1760913 (0.0010) [2023-12-28 07:55:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 902807552. Throughput: 0: 9945.9, 1: 9779.4. Samples: 902804140. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:01,175][105115] Avg episode reward: [(0, '-4.620'), (1, '-4.876')] [2023-12-28 07:55:01,178][106225] Updated weights for policy 1, policy_version 1765178 (0.0008) [2023-12-28 07:55:01,190][106226] Updated weights for policy 0, policy_version 1760923 (0.0008) [2023-12-28 07:55:01,239][106225] Updated weights for policy 1, policy_version 1765188 (0.0010) [2023-12-28 07:55:01,249][106226] Updated weights for policy 0, policy_version 1760933 (0.0009) [2023-12-28 07:55:01,922][106225] Updated weights for policy 1, policy_version 1765198 (0.0009) [2023-12-28 07:55:01,926][106226] Updated weights for policy 0, policy_version 1760943 (0.0007) [2023-12-28 07:55:01,982][106225] Updated weights for policy 1, policy_version 1765208 (0.0007) [2023-12-28 07:55:01,984][106226] Updated weights for policy 0, policy_version 1760953 (0.0005) [2023-12-28 07:55:02,044][106225] Updated weights for policy 1, policy_version 1765218 (0.0006) [2023-12-28 07:55:02,049][106226] Updated weights for policy 0, policy_version 1760963 (0.0008) [2023-12-28 07:55:02,777][106226] Updated weights for policy 0, policy_version 1760973 (0.0006) [2023-12-28 07:55:02,779][106225] Updated weights for policy 1, policy_version 1765228 (0.0008) [2023-12-28 07:55:02,846][106225] Updated weights for policy 1, policy_version 1765238 (0.0007) [2023-12-28 07:55:02,847][106226] Updated weights for policy 0, policy_version 1760983 (0.0006) [2023-12-28 07:55:02,908][106225] Updated weights for policy 1, policy_version 1765248 (0.0008) [2023-12-28 07:55:02,909][106226] Updated weights for policy 0, policy_version 1760993 (0.0007) [2023-12-28 07:55:03,449][106226] Updated weights for policy 0, policy_version 1761003 (0.0006) [2023-12-28 07:55:03,489][106226] Updated weights for policy 0, policy_version 1761013 (0.0007) [2023-12-28 07:55:03,500][106225] Updated weights for policy 1, policy_version 1765258 (0.0007) [2023-12-28 07:55:03,547][106225] Updated weights for policy 1, policy_version 1765268 (0.0008) [2023-12-28 07:55:03,549][106226] Updated weights for policy 0, policy_version 1761023 (0.0005) [2023-12-28 07:55:03,595][106225] Updated weights for policy 1, policy_version 1765278 (0.0008) [2023-12-28 07:55:03,652][106225] Updated weights for policy 1, policy_version 1765288 (0.0009) [2023-12-28 07:55:04,232][106226] Updated weights for policy 0, policy_version 1761033 (0.0006) [2023-12-28 07:55:04,296][106226] Updated weights for policy 0, policy_version 1761043 (0.0007) [2023-12-28 07:55:04,334][106225] Updated weights for policy 1, policy_version 1765298 (0.0008) [2023-12-28 07:55:04,348][106226] Updated weights for policy 0, policy_version 1761053 (0.0007) [2023-12-28 07:55:04,390][106225] Updated weights for policy 1, policy_version 1765308 (0.0006) [2023-12-28 07:55:04,407][106226] Updated weights for policy 0, policy_version 1761063 (0.0008) [2023-12-28 07:55:04,452][106225] Updated weights for policy 1, policy_version 1765318 (0.0009) [2023-12-28 07:55:05,045][106225] Updated weights for policy 1, policy_version 1765328 (0.0006) [2023-12-28 07:55:05,101][106225] Updated weights for policy 1, policy_version 1765338 (0.0005) [2023-12-28 07:55:05,108][106226] Updated weights for policy 0, policy_version 1761073 (0.0008) [2023-12-28 07:55:05,157][106225] Updated weights for policy 1, policy_version 1765348 (0.0006) [2023-12-28 07:55:05,175][106226] Updated weights for policy 0, policy_version 1761083 (0.0007) [2023-12-28 07:55:05,243][106226] Updated weights for policy 0, policy_version 1761093 (0.0009) [2023-12-28 07:55:05,814][106225] Updated weights for policy 1, policy_version 1765358 (0.0007) [2023-12-28 07:55:05,866][106225] Updated weights for policy 1, policy_version 1765368 (0.0005) [2023-12-28 07:55:05,917][106225] Updated weights for policy 1, policy_version 1765378 (0.0006) [2023-12-28 07:55:05,969][106226] Updated weights for policy 0, policy_version 1761103 (0.0008) [2023-12-28 07:55:06,020][106226] Updated weights for policy 0, policy_version 1761114 (0.0009) [2023-12-28 07:55:06,079][106226] Updated weights for policy 0, policy_version 1761125 (0.0009) [2023-12-28 07:55:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 902922240. Throughput: 0: 9989.1, 1: 9860.4. Samples: 902926752. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:06,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.786')] [2023-12-28 07:55:06,565][106225] Updated weights for policy 1, policy_version 1765388 (0.0007) [2023-12-28 07:55:06,626][106225] Updated weights for policy 1, policy_version 1765398 (0.0011) [2023-12-28 07:55:06,691][106225] Updated weights for policy 1, policy_version 1765408 (0.0010) [2023-12-28 07:55:06,885][106226] Updated weights for policy 0, policy_version 1761135 (0.0007) [2023-12-28 07:55:06,939][106226] Updated weights for policy 0, policy_version 1761145 (0.0007) [2023-12-28 07:55:06,996][106226] Updated weights for policy 0, policy_version 1761155 (0.0008) [2023-12-28 07:55:07,405][106225] Updated weights for policy 1, policy_version 1765418 (0.0009) [2023-12-28 07:55:07,463][106225] Updated weights for policy 1, policy_version 1765428 (0.0010) [2023-12-28 07:55:07,517][106225] Updated weights for policy 1, policy_version 1765438 (0.0010) [2023-12-28 07:55:07,565][106225] Updated weights for policy 1, policy_version 1765448 (0.0010) [2023-12-28 07:55:07,639][106226] Updated weights for policy 0, policy_version 1761165 (0.0008) [2023-12-28 07:55:07,700][106226] Updated weights for policy 0, policy_version 1761175 (0.0011) [2023-12-28 07:55:07,762][106226] Updated weights for policy 0, policy_version 1761185 (0.0011) [2023-12-28 07:55:08,258][106225] Updated weights for policy 1, policy_version 1765458 (0.0010) [2023-12-28 07:55:08,318][106225] Updated weights for policy 1, policy_version 1765468 (0.0010) [2023-12-28 07:55:08,325][106226] Updated weights for policy 0, policy_version 1761195 (0.0010) [2023-12-28 07:55:08,383][106225] Updated weights for policy 1, policy_version 1765478 (0.0009) [2023-12-28 07:55:08,387][106226] Updated weights for policy 0, policy_version 1761205 (0.0009) [2023-12-28 07:55:08,449][106226] Updated weights for policy 0, policy_version 1761215 (0.0011) [2023-12-28 07:55:09,118][106226] Updated weights for policy 0, policy_version 1761225 (0.0010) [2023-12-28 07:55:09,129][106225] Updated weights for policy 1, policy_version 1765488 (0.0010) [2023-12-28 07:55:09,179][106226] Updated weights for policy 0, policy_version 1761235 (0.0005) [2023-12-28 07:55:09,190][106225] Updated weights for policy 1, policy_version 1765498 (0.0007) [2023-12-28 07:55:09,247][106226] Updated weights for policy 0, policy_version 1761245 (0.0007) [2023-12-28 07:55:09,260][106225] Updated weights for policy 1, policy_version 1765509 (0.0008) [2023-12-28 07:55:09,303][106226] Updated weights for policy 0, policy_version 1761255 (0.0007) [2023-12-28 07:55:09,995][106226] Updated weights for policy 0, policy_version 1761265 (0.0008) [2023-12-28 07:55:10,034][106225] Updated weights for policy 1, policy_version 1765519 (0.0009) [2023-12-28 07:55:10,060][106226] Updated weights for policy 0, policy_version 1761275 (0.0007) [2023-12-28 07:55:10,096][106225] Updated weights for policy 1, policy_version 1765529 (0.0008) [2023-12-28 07:55:10,123][106226] Updated weights for policy 0, policy_version 1761285 (0.0008) [2023-12-28 07:55:10,152][106225] Updated weights for policy 1, policy_version 1765539 (0.0008) [2023-12-28 07:55:10,758][106226] Updated weights for policy 0, policy_version 1761295 (0.0008) [2023-12-28 07:55:10,813][106226] Updated weights for policy 0, policy_version 1761305 (0.0008) [2023-12-28 07:55:10,878][106226] Updated weights for policy 0, policy_version 1761315 (0.0006) [2023-12-28 07:55:10,936][106225] Updated weights for policy 1, policy_version 1765549 (0.0008) [2023-12-28 07:55:10,989][106225] Updated weights for policy 1, policy_version 1765559 (0.0008) [2023-12-28 07:55:11,044][106225] Updated weights for policy 1, policy_version 1765569 (0.0009) [2023-12-28 07:55:11,175][105115] Fps is (10 sec: 21299.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 903020544. Throughput: 0: 9988.7, 1: 9929.9. Samples: 902987904. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:11,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.831')] [2023-12-28 07:55:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001765576_452042752.pth... [2023-12-28 07:55:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001761320_450977792.pth... [2023-12-28 07:55:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001764424_451747840.pth [2023-12-28 07:55:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001760136_450674688.pth [2023-12-28 07:55:11,589][106226] Updated weights for policy 0, policy_version 1761325 (0.0008) [2023-12-28 07:55:11,667][106226] Updated weights for policy 0, policy_version 1761335 (0.0008) [2023-12-28 07:55:11,736][106226] Updated weights for policy 0, policy_version 1761345 (0.0008) [2023-12-28 07:55:11,838][106225] Updated weights for policy 1, policy_version 1765579 (0.0007) [2023-12-28 07:55:11,903][106225] Updated weights for policy 1, policy_version 1765589 (0.0009) [2023-12-28 07:55:11,972][106225] Updated weights for policy 1, policy_version 1765599 (0.0009) [2023-12-28 07:55:12,460][106226] Updated weights for policy 0, policy_version 1761355 (0.0008) [2023-12-28 07:55:12,518][106226] Updated weights for policy 0, policy_version 1761365 (0.0008) [2023-12-28 07:55:12,582][106226] Updated weights for policy 0, policy_version 1761375 (0.0007) [2023-12-28 07:55:12,714][106225] Updated weights for policy 1, policy_version 1765609 (0.0008) [2023-12-28 07:55:12,780][106225] Updated weights for policy 1, policy_version 1765619 (0.0008) [2023-12-28 07:55:12,842][106225] Updated weights for policy 1, policy_version 1765629 (0.0009) [2023-12-28 07:55:12,905][106225] Updated weights for policy 1, policy_version 1765639 (0.0009) [2023-12-28 07:55:13,258][106226] Updated weights for policy 0, policy_version 1761385 (0.0009) [2023-12-28 07:55:13,313][106226] Updated weights for policy 0, policy_version 1761395 (0.0005) [2023-12-28 07:55:13,369][106226] Updated weights for policy 0, policy_version 1761405 (0.0007) [2023-12-28 07:55:13,426][106226] Updated weights for policy 0, policy_version 1761415 (0.0007) [2023-12-28 07:55:13,637][106225] Updated weights for policy 1, policy_version 1765649 (0.0006) [2023-12-28 07:55:13,692][106225] Updated weights for policy 1, policy_version 1765659 (0.0005) [2023-12-28 07:55:13,743][106225] Updated weights for policy 1, policy_version 1765669 (0.0005) [2023-12-28 07:55:14,161][106226] Updated weights for policy 0, policy_version 1761425 (0.0009) [2023-12-28 07:55:14,211][106226] Updated weights for policy 0, policy_version 1761435 (0.0009) [2023-12-28 07:55:14,258][106226] Updated weights for policy 0, policy_version 1761445 (0.0008) [2023-12-28 07:55:14,357][106225] Updated weights for policy 1, policy_version 1765679 (0.0008) [2023-12-28 07:55:14,423][106225] Updated weights for policy 1, policy_version 1765689 (0.0008) [2023-12-28 07:55:14,479][106225] Updated weights for policy 1, policy_version 1765699 (0.0008) [2023-12-28 07:55:14,967][106226] Updated weights for policy 0, policy_version 1761455 (0.0009) [2023-12-28 07:55:15,035][106226] Updated weights for policy 0, policy_version 1761465 (0.0008) [2023-12-28 07:55:15,094][106226] Updated weights for policy 0, policy_version 1761475 (0.0009) [2023-12-28 07:55:15,249][106225] Updated weights for policy 1, policy_version 1765709 (0.0009) [2023-12-28 07:55:15,313][106225] Updated weights for policy 1, policy_version 1765719 (0.0009) [2023-12-28 07:55:15,369][106225] Updated weights for policy 1, policy_version 1765729 (0.0007) [2023-12-28 07:55:15,760][106226] Updated weights for policy 0, policy_version 1761485 (0.0007) [2023-12-28 07:55:15,815][106226] Updated weights for policy 0, policy_version 1761495 (0.0008) [2023-12-28 07:55:15,869][106226] Updated weights for policy 0, policy_version 1761505 (0.0007) [2023-12-28 07:55:16,145][106225] Updated weights for policy 1, policy_version 1765739 (0.0008) [2023-12-28 07:55:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 903110656. Throughput: 0: 9879.0, 1: 9886.7. Samples: 903102720. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:16,175][105115] Avg episode reward: [(0, '-4.234'), (1, '-4.878')] [2023-12-28 07:55:16,201][106225] Updated weights for policy 1, policy_version 1765749 (0.0005) [2023-12-28 07:55:16,257][106225] Updated weights for policy 1, policy_version 1765759 (0.0005) [2023-12-28 07:55:16,575][106226] Updated weights for policy 0, policy_version 1761515 (0.0006) [2023-12-28 07:55:16,624][106226] Updated weights for policy 0, policy_version 1761525 (0.0008) [2023-12-28 07:55:16,685][106226] Updated weights for policy 0, policy_version 1761535 (0.0006) [2023-12-28 07:55:16,930][106225] Updated weights for policy 1, policy_version 1765769 (0.0005) [2023-12-28 07:55:16,994][106225] Updated weights for policy 1, policy_version 1765779 (0.0008) [2023-12-28 07:55:17,042][106225] Updated weights for policy 1, policy_version 1765789 (0.0006) [2023-12-28 07:55:17,088][106225] Updated weights for policy 1, policy_version 1765799 (0.0007) [2023-12-28 07:55:17,358][106226] Updated weights for policy 0, policy_version 1761545 (0.0005) [2023-12-28 07:55:17,409][106226] Updated weights for policy 0, policy_version 1761555 (0.0005) [2023-12-28 07:55:17,460][106226] Updated weights for policy 0, policy_version 1761565 (0.0005) [2023-12-28 07:55:17,513][106226] Updated weights for policy 0, policy_version 1761575 (0.0005) [2023-12-28 07:55:17,757][106225] Updated weights for policy 1, policy_version 1765809 (0.0009) [2023-12-28 07:55:17,808][106225] Updated weights for policy 1, policy_version 1765819 (0.0008) [2023-12-28 07:55:17,875][106225] Updated weights for policy 1, policy_version 1765829 (0.0008) [2023-12-28 07:55:18,167][106226] Updated weights for policy 0, policy_version 1761585 (0.0010) [2023-12-28 07:55:18,232][106226] Updated weights for policy 0, policy_version 1761595 (0.0011) [2023-12-28 07:55:18,289][106226] Updated weights for policy 0, policy_version 1761605 (0.0008) [2023-12-28 07:55:18,623][106225] Updated weights for policy 1, policy_version 1765839 (0.0008) [2023-12-28 07:55:18,681][106225] Updated weights for policy 1, policy_version 1765849 (0.0009) [2023-12-28 07:55:18,739][106225] Updated weights for policy 1, policy_version 1765859 (0.0009) [2023-12-28 07:55:18,971][106226] Updated weights for policy 0, policy_version 1761615 (0.0007) [2023-12-28 07:55:19,036][106226] Updated weights for policy 0, policy_version 1761625 (0.0009) [2023-12-28 07:55:19,100][106226] Updated weights for policy 0, policy_version 1761635 (0.0007) [2023-12-28 07:55:19,406][106225] Updated weights for policy 1, policy_version 1765869 (0.0009) [2023-12-28 07:55:19,493][106225] Updated weights for policy 1, policy_version 1765879 (0.0008) [2023-12-28 07:55:19,555][106225] Updated weights for policy 1, policy_version 1765889 (0.0007) [2023-12-28 07:55:19,864][106226] Updated weights for policy 0, policy_version 1761645 (0.0009) [2023-12-28 07:55:19,922][106226] Updated weights for policy 0, policy_version 1761655 (0.0008) [2023-12-28 07:55:19,989][106226] Updated weights for policy 0, policy_version 1761665 (0.0009) [2023-12-28 07:55:20,243][106225] Updated weights for policy 1, policy_version 1765899 (0.0007) [2023-12-28 07:55:20,295][106225] Updated weights for policy 1, policy_version 1765909 (0.0010) [2023-12-28 07:55:20,356][106225] Updated weights for policy 1, policy_version 1765919 (0.0010) [2023-12-28 07:55:20,776][106226] Updated weights for policy 0, policy_version 1761675 (0.0008) [2023-12-28 07:55:20,830][106226] Updated weights for policy 0, policy_version 1761685 (0.0006) [2023-12-28 07:55:20,880][106226] Updated weights for policy 0, policy_version 1761695 (0.0005) [2023-12-28 07:55:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 903208960. Throughput: 0: 9936.2, 1: 9802.8. Samples: 903220088. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:21,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-4.798')] [2023-12-28 07:55:21,185][106225] Updated weights for policy 1, policy_version 1765929 (0.0010) [2023-12-28 07:55:21,245][106225] Updated weights for policy 1, policy_version 1765939 (0.0008) [2023-12-28 07:55:21,306][106225] Updated weights for policy 1, policy_version 1765949 (0.0008) [2023-12-28 07:55:21,377][106225] Updated weights for policy 1, policy_version 1765959 (0.0009) [2023-12-28 07:55:21,616][106226] Updated weights for policy 0, policy_version 1761705 (0.0006) [2023-12-28 07:55:21,688][106226] Updated weights for policy 0, policy_version 1761715 (0.0008) [2023-12-28 07:55:21,752][106226] Updated weights for policy 0, policy_version 1761725 (0.0008) [2023-12-28 07:55:21,814][106226] Updated weights for policy 0, policy_version 1761735 (0.0008) [2023-12-28 07:55:22,136][106225] Updated weights for policy 1, policy_version 1765969 (0.0006) [2023-12-28 07:55:22,198][106225] Updated weights for policy 1, policy_version 1765979 (0.0005) [2023-12-28 07:55:22,263][106225] Updated weights for policy 1, policy_version 1765989 (0.0008) [2023-12-28 07:55:22,627][106226] Updated weights for policy 0, policy_version 1761745 (0.0011) [2023-12-28 07:55:22,689][106226] Updated weights for policy 0, policy_version 1761755 (0.0011) [2023-12-28 07:55:22,746][106226] Updated weights for policy 0, policy_version 1761765 (0.0011) [2023-12-28 07:55:22,980][106225] Updated weights for policy 1, policy_version 1765999 (0.0009) [2023-12-28 07:55:23,043][106225] Updated weights for policy 1, policy_version 1766009 (0.0008) [2023-12-28 07:55:23,101][106225] Updated weights for policy 1, policy_version 1766019 (0.0008) [2023-12-28 07:55:23,474][106226] Updated weights for policy 0, policy_version 1761775 (0.0011) [2023-12-28 07:55:23,536][106226] Updated weights for policy 0, policy_version 1761785 (0.0010) [2023-12-28 07:55:23,598][106226] Updated weights for policy 0, policy_version 1761795 (0.0010) [2023-12-28 07:55:23,846][106225] Updated weights for policy 1, policy_version 1766029 (0.0008) [2023-12-28 07:55:23,903][106225] Updated weights for policy 1, policy_version 1766039 (0.0008) [2023-12-28 07:55:23,959][106225] Updated weights for policy 1, policy_version 1766049 (0.0008) [2023-12-28 07:55:24,286][106226] Updated weights for policy 0, policy_version 1761805 (0.0011) [2023-12-28 07:55:24,347][106226] Updated weights for policy 0, policy_version 1761815 (0.0011) [2023-12-28 07:55:24,409][106226] Updated weights for policy 0, policy_version 1761825 (0.0011) [2023-12-28 07:55:24,697][106225] Updated weights for policy 1, policy_version 1766059 (0.0008) [2023-12-28 07:55:24,747][106225] Updated weights for policy 1, policy_version 1766069 (0.0007) [2023-12-28 07:55:24,793][106225] Updated weights for policy 1, policy_version 1766079 (0.0007) [2023-12-28 07:55:24,797][106141] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000004 [2023-12-28 07:55:25,121][106226] Updated weights for policy 0, policy_version 1761835 (0.0011) [2023-12-28 07:55:25,180][106226] Updated weights for policy 0, policy_version 1761845 (0.0010) [2023-12-28 07:55:25,239][106226] Updated weights for policy 0, policy_version 1761855 (0.0010) [2023-12-28 07:55:25,578][106225] Updated weights for policy 1, policy_version 1766089 (0.0008) [2023-12-28 07:55:25,628][106225] Updated weights for policy 1, policy_version 1766099 (0.0008) [2023-12-28 07:55:25,689][106225] Updated weights for policy 1, policy_version 1766109 (0.0007) [2023-12-28 07:55:25,938][106226] Updated weights for policy 0, policy_version 1761865 (0.0010) [2023-12-28 07:55:25,984][106226] Updated weights for policy 0, policy_version 1761875 (0.0005) [2023-12-28 07:55:26,037][106226] Updated weights for policy 0, policy_version 1761885 (0.0008) [2023-12-28 07:55:26,107][106226] Updated weights for policy 0, policy_version 1761895 (0.0010) [2023-12-28 07:55:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 903307264. Throughput: 0: 9942.7, 1: 9685.5. Samples: 903275288. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:26,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-5.046')] [2023-12-28 07:55:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001761896_451125248.pth... [2023-12-28 07:55:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001766112_452182016.pth... [2023-12-28 07:55:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001760744_450830336.pth [2023-12-28 07:55:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001765000_451895296.pth [2023-12-28 07:55:26,379][106225] Updated weights for policy 1, policy_version 1766119 (0.0006) [2023-12-28 07:55:26,428][106225] Updated weights for policy 1, policy_version 1766129 (0.0005) [2023-12-28 07:55:26,486][106225] Updated weights for policy 1, policy_version 1766139 (0.0007) [2023-12-28 07:55:26,717][106226] Updated weights for policy 0, policy_version 1761905 (0.0006) [2023-12-28 07:55:26,777][106226] Updated weights for policy 0, policy_version 1761915 (0.0008) [2023-12-28 07:55:26,831][106226] Updated weights for policy 0, policy_version 1761925 (0.0009) [2023-12-28 07:55:27,106][106225] Updated weights for policy 1, policy_version 1766149 (0.0005) [2023-12-28 07:55:27,159][106225] Updated weights for policy 1, policy_version 1766159 (0.0005) [2023-12-28 07:55:27,216][106225] Updated weights for policy 1, policy_version 1766169 (0.0005) [2023-12-28 07:55:27,513][106226] Updated weights for policy 0, policy_version 1761935 (0.0009) [2023-12-28 07:55:27,566][106226] Updated weights for policy 0, policy_version 1761945 (0.0009) [2023-12-28 07:55:27,624][106226] Updated weights for policy 0, policy_version 1761955 (0.0010) [2023-12-28 07:55:27,727][106225] Updated weights for policy 1, policy_version 1766179 (0.0005) [2023-12-28 07:55:27,794][106225] Updated weights for policy 1, policy_version 1766189 (0.0005) [2023-12-28 07:55:27,862][106225] Updated weights for policy 1, policy_version 1766199 (0.0005) [2023-12-28 07:55:28,337][106226] Updated weights for policy 0, policy_version 1761965 (0.0008) [2023-12-28 07:55:28,396][106226] Updated weights for policy 0, policy_version 1761975 (0.0009) [2023-12-28 07:55:28,447][106226] Updated weights for policy 0, policy_version 1761985 (0.0009) [2023-12-28 07:55:28,483][106225] Updated weights for policy 1, policy_version 1766209 (0.0005) [2023-12-28 07:55:28,538][106225] Updated weights for policy 1, policy_version 1766219 (0.0008) [2023-12-28 07:55:28,597][106225] Updated weights for policy 1, policy_version 1766229 (0.0008) [2023-12-28 07:55:28,657][106225] Updated weights for policy 1, policy_version 1766239 (0.0008) [2023-12-28 07:55:29,169][106226] Updated weights for policy 0, policy_version 1761995 (0.0008) [2023-12-28 07:55:29,231][106226] Updated weights for policy 0, policy_version 1762005 (0.0009) [2023-12-28 07:55:29,298][106226] Updated weights for policy 0, policy_version 1762015 (0.0010) [2023-12-28 07:55:29,385][106225] Updated weights for policy 1, policy_version 1766249 (0.0007) [2023-12-28 07:55:29,438][106225] Updated weights for policy 1, policy_version 1766259 (0.0007) [2023-12-28 07:55:29,504][106225] Updated weights for policy 1, policy_version 1766269 (0.0007) [2023-12-28 07:55:29,955][106226] Updated weights for policy 0, policy_version 1762025 (0.0010) [2023-12-28 07:55:30,013][106226] Updated weights for policy 0, policy_version 1762035 (0.0008) [2023-12-28 07:55:30,081][106226] Updated weights for policy 0, policy_version 1762045 (0.0010) [2023-12-28 07:55:30,131][106226] Updated weights for policy 0, policy_version 1762055 (0.0009) [2023-12-28 07:55:30,208][106225] Updated weights for policy 1, policy_version 1766279 (0.0008) [2023-12-28 07:55:30,265][106225] Updated weights for policy 1, policy_version 1766289 (0.0009) [2023-12-28 07:55:30,319][106225] Updated weights for policy 1, policy_version 1766299 (0.0008) [2023-12-28 07:55:30,788][106226] Updated weights for policy 0, policy_version 1762065 (0.0007) [2023-12-28 07:55:30,837][106226] Updated weights for policy 0, policy_version 1762075 (0.0007) [2023-12-28 07:55:30,894][106226] Updated weights for policy 0, policy_version 1762085 (0.0008) [2023-12-28 07:55:31,106][106225] Updated weights for policy 1, policy_version 1766309 (0.0010) [2023-12-28 07:55:31,171][106225] Updated weights for policy 1, policy_version 1766319 (0.0011) [2023-12-28 07:55:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 903405568. Throughput: 0: 9976.1, 1: 9751.5. Samples: 903396556. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:31,175][105115] Avg episode reward: [(0, '-4.302'), (1, '-4.802')] [2023-12-28 07:55:31,225][106225] Updated weights for policy 1, policy_version 1766329 (0.0010) [2023-12-28 07:55:31,644][106226] Updated weights for policy 0, policy_version 1762095 (0.0008) [2023-12-28 07:55:31,704][106226] Updated weights for policy 0, policy_version 1762105 (0.0008) [2023-12-28 07:55:31,770][106226] Updated weights for policy 0, policy_version 1762115 (0.0007) [2023-12-28 07:55:31,919][106225] Updated weights for policy 1, policy_version 1766339 (0.0010) [2023-12-28 07:55:31,984][106225] Updated weights for policy 1, policy_version 1766349 (0.0008) [2023-12-28 07:55:32,045][106225] Updated weights for policy 1, policy_version 1766359 (0.0007) [2023-12-28 07:55:32,369][106226] Updated weights for policy 0, policy_version 1762125 (0.0008) [2023-12-28 07:55:32,430][106226] Updated weights for policy 0, policy_version 1762135 (0.0011) [2023-12-28 07:55:32,490][106226] Updated weights for policy 0, policy_version 1762145 (0.0010) [2023-12-28 07:55:32,744][106225] Updated weights for policy 1, policy_version 1766369 (0.0006) [2023-12-28 07:55:32,795][106225] Updated weights for policy 1, policy_version 1766379 (0.0008) [2023-12-28 07:55:32,853][106225] Updated weights for policy 1, policy_version 1766389 (0.0008) [2023-12-28 07:55:32,906][106225] Updated weights for policy 1, policy_version 1766399 (0.0008) [2023-12-28 07:55:33,110][106226] Updated weights for policy 0, policy_version 1762155 (0.0010) [2023-12-28 07:55:33,166][106226] Updated weights for policy 0, policy_version 1762165 (0.0007) [2023-12-28 07:55:33,220][106226] Updated weights for policy 0, policy_version 1762175 (0.0008) [2023-12-28 07:55:33,536][106225] Updated weights for policy 1, policy_version 1766409 (0.0007) [2023-12-28 07:55:33,586][106225] Updated weights for policy 1, policy_version 1766419 (0.0005) [2023-12-28 07:55:33,639][106225] Updated weights for policy 1, policy_version 1766429 (0.0010) [2023-12-28 07:55:33,952][106226] Updated weights for policy 0, policy_version 1762185 (0.0007) [2023-12-28 07:55:34,011][106226] Updated weights for policy 0, policy_version 1762195 (0.0008) [2023-12-28 07:55:34,070][106226] Updated weights for policy 0, policy_version 1762205 (0.0008) [2023-12-28 07:55:34,126][106226] Updated weights for policy 0, policy_version 1762215 (0.0007) [2023-12-28 07:55:34,307][106225] Updated weights for policy 1, policy_version 1766439 (0.0010) [2023-12-28 07:55:34,361][106225] Updated weights for policy 1, policy_version 1766449 (0.0010) [2023-12-28 07:55:34,414][106225] Updated weights for policy 1, policy_version 1766459 (0.0008) [2023-12-28 07:55:34,874][106226] Updated weights for policy 0, policy_version 1762225 (0.0010) [2023-12-28 07:55:34,919][106226] Updated weights for policy 0, policy_version 1762235 (0.0006) [2023-12-28 07:55:34,966][106226] Updated weights for policy 0, policy_version 1762245 (0.0010) [2023-12-28 07:55:35,121][106225] Updated weights for policy 1, policy_version 1766469 (0.0010) [2023-12-28 07:55:35,177][106225] Updated weights for policy 1, policy_version 1766479 (0.0010) [2023-12-28 07:55:35,234][106225] Updated weights for policy 1, policy_version 1766489 (0.0008) [2023-12-28 07:55:35,665][106226] Updated weights for policy 0, policy_version 1762255 (0.0010) [2023-12-28 07:55:35,715][106226] Updated weights for policy 0, policy_version 1762265 (0.0010) [2023-12-28 07:55:35,762][106226] Updated weights for policy 0, policy_version 1762275 (0.0010) [2023-12-28 07:55:35,948][106225] Updated weights for policy 1, policy_version 1766499 (0.0006) [2023-12-28 07:55:35,999][106225] Updated weights for policy 1, policy_version 1766509 (0.0010) [2023-12-28 07:55:36,053][106225] Updated weights for policy 1, policy_version 1766519 (0.0010) [2023-12-28 07:55:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 903512064. Throughput: 0: 9948.1, 1: 9816.0. Samples: 903518124. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:36,175][105115] Avg episode reward: [(0, '-4.552'), (1, '-4.676')] [2023-12-28 07:55:36,406][106226] Updated weights for policy 0, policy_version 1762285 (0.0009) [2023-12-28 07:55:36,472][106226] Updated weights for policy 0, policy_version 1762295 (0.0008) [2023-12-28 07:55:36,535][106226] Updated weights for policy 0, policy_version 1762305 (0.0009) [2023-12-28 07:55:36,766][106225] Updated weights for policy 1, policy_version 1766529 (0.0009) [2023-12-28 07:55:36,828][106225] Updated weights for policy 1, policy_version 1766539 (0.0008) [2023-12-28 07:55:36,897][106225] Updated weights for policy 1, policy_version 1766549 (0.0008) [2023-12-28 07:55:36,962][106225] Updated weights for policy 1, policy_version 1766559 (0.0009) [2023-12-28 07:55:37,265][106226] Updated weights for policy 0, policy_version 1762315 (0.0008) [2023-12-28 07:55:37,313][106226] Updated weights for policy 0, policy_version 1762325 (0.0008) [2023-12-28 07:55:37,380][106226] Updated weights for policy 0, policy_version 1762335 (0.0008) [2023-12-28 07:55:37,580][106225] Updated weights for policy 1, policy_version 1766569 (0.0006) [2023-12-28 07:55:37,643][106225] Updated weights for policy 1, policy_version 1766579 (0.0008) [2023-12-28 07:55:37,704][106225] Updated weights for policy 1, policy_version 1766589 (0.0007) [2023-12-28 07:55:38,101][106226] Updated weights for policy 0, policy_version 1762345 (0.0009) [2023-12-28 07:55:38,164][106226] Updated weights for policy 0, policy_version 1762355 (0.0005) [2023-12-28 07:55:38,231][106226] Updated weights for policy 0, policy_version 1762365 (0.0010) [2023-12-28 07:55:38,295][106226] Updated weights for policy 0, policy_version 1762375 (0.0011) [2023-12-28 07:55:38,320][106225] Updated weights for policy 1, policy_version 1766599 (0.0007) [2023-12-28 07:55:38,382][106225] Updated weights for policy 1, policy_version 1766609 (0.0008) [2023-12-28 07:55:38,448][106225] Updated weights for policy 1, policy_version 1766619 (0.0008) [2023-12-28 07:55:38,973][106226] Updated weights for policy 0, policy_version 1762385 (0.0009) [2023-12-28 07:55:39,020][106226] Updated weights for policy 0, policy_version 1762395 (0.0010) [2023-12-28 07:55:39,075][106226] Updated weights for policy 0, policy_version 1762405 (0.0010) [2023-12-28 07:55:39,237][106225] Updated weights for policy 1, policy_version 1766629 (0.0009) [2023-12-28 07:55:39,299][106225] Updated weights for policy 1, policy_version 1766639 (0.0008) [2023-12-28 07:55:39,354][106225] Updated weights for policy 1, policy_version 1766649 (0.0008) [2023-12-28 07:55:39,881][106226] Updated weights for policy 0, policy_version 1762415 (0.0009) [2023-12-28 07:55:39,940][106226] Updated weights for policy 0, policy_version 1762425 (0.0009) [2023-12-28 07:55:40,008][106226] Updated weights for policy 0, policy_version 1762435 (0.0009) [2023-12-28 07:55:40,167][106225] Updated weights for policy 1, policy_version 1766659 (0.0009) [2023-12-28 07:55:40,225][106225] Updated weights for policy 1, policy_version 1766669 (0.0006) [2023-12-28 07:55:40,283][106225] Updated weights for policy 1, policy_version 1766679 (0.0006) [2023-12-28 07:55:40,723][106226] Updated weights for policy 0, policy_version 1762445 (0.0008) [2023-12-28 07:55:40,788][106226] Updated weights for policy 0, policy_version 1762455 (0.0007) [2023-12-28 07:55:40,847][106226] Updated weights for policy 0, policy_version 1762465 (0.0007) [2023-12-28 07:55:41,051][106225] Updated weights for policy 1, policy_version 1766689 (0.0007) [2023-12-28 07:55:41,117][106225] Updated weights for policy 1, policy_version 1766699 (0.0009) [2023-12-28 07:55:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 903602176. Throughput: 0: 9958.7, 1: 9872.1. Samples: 903577792. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:41,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-5.177')] [2023-12-28 07:55:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001762472_451272704.pth... [2023-12-28 07:55:41,187][106225] Updated weights for policy 1, policy_version 1766709 (0.0010) [2023-12-28 07:55:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001761320_450977792.pth [2023-12-28 07:55:41,256][106225] Updated weights for policy 1, policy_version 1766719 (0.0008) [2023-12-28 07:55:41,261][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001766720_452337664.pth... [2023-12-28 07:55:41,265][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001765576_452042752.pth [2023-12-28 07:55:41,540][106226] Updated weights for policy 0, policy_version 1762475 (0.0008) [2023-12-28 07:55:41,609][106226] Updated weights for policy 0, policy_version 1762485 (0.0006) [2023-12-28 07:55:41,684][106226] Updated weights for policy 0, policy_version 1762495 (0.0008) [2023-12-28 07:55:42,026][106225] Updated weights for policy 1, policy_version 1766729 (0.0009) [2023-12-28 07:55:42,084][106225] Updated weights for policy 1, policy_version 1766739 (0.0006) [2023-12-28 07:55:42,134][106225] Updated weights for policy 1, policy_version 1766749 (0.0005) [2023-12-28 07:55:42,340][106226] Updated weights for policy 0, policy_version 1762505 (0.0009) [2023-12-28 07:55:42,408][106226] Updated weights for policy 0, policy_version 1762515 (0.0007) [2023-12-28 07:55:42,468][106226] Updated weights for policy 0, policy_version 1762525 (0.0005) [2023-12-28 07:55:42,533][106226] Updated weights for policy 0, policy_version 1762535 (0.0007) [2023-12-28 07:55:42,941][106225] Updated weights for policy 1, policy_version 1766759 (0.0008) [2023-12-28 07:55:43,003][106225] Updated weights for policy 1, policy_version 1766769 (0.0009) [2023-12-28 07:55:43,070][106225] Updated weights for policy 1, policy_version 1766779 (0.0009) [2023-12-28 07:55:43,229][106226] Updated weights for policy 0, policy_version 1762545 (0.0009) [2023-12-28 07:55:43,291][106226] Updated weights for policy 0, policy_version 1762555 (0.0008) [2023-12-28 07:55:43,359][106226] Updated weights for policy 0, policy_version 1762565 (0.0008) [2023-12-28 07:55:43,677][106225] Updated weights for policy 1, policy_version 1766789 (0.0007) [2023-12-28 07:55:43,746][106225] Updated weights for policy 1, policy_version 1766799 (0.0006) [2023-12-28 07:55:43,807][106225] Updated weights for policy 1, policy_version 1766809 (0.0006) [2023-12-28 07:55:44,195][106226] Updated weights for policy 0, policy_version 1762575 (0.0009) [2023-12-28 07:55:44,243][106226] Updated weights for policy 0, policy_version 1762585 (0.0009) [2023-12-28 07:55:44,295][106226] Updated weights for policy 0, policy_version 1762595 (0.0007) [2023-12-28 07:55:44,376][106225] Updated weights for policy 1, policy_version 1766819 (0.0006) [2023-12-28 07:55:44,440][106225] Updated weights for policy 1, policy_version 1766829 (0.0005) [2023-12-28 07:55:44,499][106225] Updated weights for policy 1, policy_version 1766839 (0.0007) [2023-12-28 07:55:45,054][106226] Updated weights for policy 0, policy_version 1762605 (0.0007) [2023-12-28 07:55:45,119][106226] Updated weights for policy 0, policy_version 1762615 (0.0007) [2023-12-28 07:55:45,160][106225] Updated weights for policy 1, policy_version 1766849 (0.0008) [2023-12-28 07:55:45,186][106226] Updated weights for policy 0, policy_version 1762625 (0.0008) [2023-12-28 07:55:45,226][106225] Updated weights for policy 1, policy_version 1766859 (0.0007) [2023-12-28 07:55:45,295][106225] Updated weights for policy 1, policy_version 1766869 (0.0007) [2023-12-28 07:55:45,364][106225] Updated weights for policy 1, policy_version 1766879 (0.0007) [2023-12-28 07:55:45,824][106226] Updated weights for policy 0, policy_version 1762635 (0.0008) [2023-12-28 07:55:45,871][106226] Updated weights for policy 0, policy_version 1762645 (0.0009) [2023-12-28 07:55:45,924][106226] Updated weights for policy 0, policy_version 1762655 (0.0007) [2023-12-28 07:55:45,976][106225] Updated weights for policy 1, policy_version 1766889 (0.0007) [2023-12-28 07:55:46,030][106225] Updated weights for policy 1, policy_version 1766899 (0.0006) [2023-12-28 07:55:46,078][106225] Updated weights for policy 1, policy_version 1766909 (0.0006) [2023-12-28 07:55:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 903708672. Throughput: 0: 9901.3, 1: 9839.5. Samples: 903692480. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:46,176][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.587')] [2023-12-28 07:55:46,657][106225] Updated weights for policy 1, policy_version 1766919 (0.0007) [2023-12-28 07:55:46,689][106226] Updated weights for policy 0, policy_version 1762665 (0.0008) [2023-12-28 07:55:46,718][106225] Updated weights for policy 1, policy_version 1766929 (0.0009) [2023-12-28 07:55:46,747][106226] Updated weights for policy 0, policy_version 1762675 (0.0008) [2023-12-28 07:55:46,765][106225] Updated weights for policy 1, policy_version 1766939 (0.0007) [2023-12-28 07:55:46,803][106226] Updated weights for policy 0, policy_version 1762685 (0.0007) [2023-12-28 07:55:46,858][106226] Updated weights for policy 0, policy_version 1762695 (0.0009) [2023-12-28 07:55:47,352][106225] Updated weights for policy 1, policy_version 1766949 (0.0008) [2023-12-28 07:55:47,411][106225] Updated weights for policy 1, policy_version 1766959 (0.0007) [2023-12-28 07:55:47,470][106225] Updated weights for policy 1, policy_version 1766969 (0.0006) [2023-12-28 07:55:47,674][106226] Updated weights for policy 0, policy_version 1762705 (0.0009) [2023-12-28 07:55:47,728][106226] Updated weights for policy 0, policy_version 1762715 (0.0008) [2023-12-28 07:55:47,779][106226] Updated weights for policy 0, policy_version 1762725 (0.0009) [2023-12-28 07:55:48,034][106225] Updated weights for policy 1, policy_version 1766979 (0.0009) [2023-12-28 07:55:48,082][106225] Updated weights for policy 1, policy_version 1766989 (0.0008) [2023-12-28 07:55:48,131][106225] Updated weights for policy 1, policy_version 1766999 (0.0007) [2023-12-28 07:55:48,443][106226] Updated weights for policy 0, policy_version 1762735 (0.0009) [2023-12-28 07:55:48,503][106226] Updated weights for policy 0, policy_version 1762745 (0.0008) [2023-12-28 07:55:48,561][106226] Updated weights for policy 0, policy_version 1762755 (0.0008) [2023-12-28 07:55:48,838][106225] Updated weights for policy 1, policy_version 1767009 (0.0006) [2023-12-28 07:55:48,897][106225] Updated weights for policy 1, policy_version 1767019 (0.0010) [2023-12-28 07:55:48,947][106225] Updated weights for policy 1, policy_version 1767029 (0.0008) [2023-12-28 07:55:49,007][106225] Updated weights for policy 1, policy_version 1767039 (0.0008) [2023-12-28 07:55:49,276][106226] Updated weights for policy 0, policy_version 1762765 (0.0009) [2023-12-28 07:55:49,342][106226] Updated weights for policy 0, policy_version 1762775 (0.0008) [2023-12-28 07:55:49,410][106226] Updated weights for policy 0, policy_version 1762785 (0.0009) [2023-12-28 07:55:49,860][106225] Updated weights for policy 1, policy_version 1767049 (0.0008) [2023-12-28 07:55:49,927][106225] Updated weights for policy 1, policy_version 1767059 (0.0008) [2023-12-28 07:55:49,990][106225] Updated weights for policy 1, policy_version 1767069 (0.0008) [2023-12-28 07:55:50,222][106226] Updated weights for policy 0, policy_version 1762795 (0.0008) [2023-12-28 07:55:50,279][106226] Updated weights for policy 0, policy_version 1762805 (0.0005) [2023-12-28 07:55:50,340][106226] Updated weights for policy 0, policy_version 1762815 (0.0006) [2023-12-28 07:55:50,729][106225] Updated weights for policy 1, policy_version 1767079 (0.0009) [2023-12-28 07:55:50,788][106225] Updated weights for policy 1, policy_version 1767089 (0.0008) [2023-12-28 07:55:50,845][106225] Updated weights for policy 1, policy_version 1767099 (0.0006) [2023-12-28 07:55:50,995][106226] Updated weights for policy 0, policy_version 1762825 (0.0009) [2023-12-28 07:55:51,059][106226] Updated weights for policy 0, policy_version 1762835 (0.0008) [2023-12-28 07:55:51,128][106226] Updated weights for policy 0, policy_version 1762845 (0.0008) [2023-12-28 07:55:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 903798784. Throughput: 0: 9824.0, 1: 9843.0. Samples: 903811768. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:51,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.980')] [2023-12-28 07:55:51,190][106226] Updated weights for policy 0, policy_version 1762855 (0.0006) [2023-12-28 07:55:51,493][106225] Updated weights for policy 1, policy_version 1767109 (0.0006) [2023-12-28 07:55:51,551][106225] Updated weights for policy 1, policy_version 1767119 (0.0009) [2023-12-28 07:55:51,612][106225] Updated weights for policy 1, policy_version 1767129 (0.0012) [2023-12-28 07:55:52,024][106226] Updated weights for policy 0, policy_version 1762865 (0.0009) [2023-12-28 07:55:52,084][106226] Updated weights for policy 0, policy_version 1762875 (0.0008) [2023-12-28 07:55:52,144][106226] Updated weights for policy 0, policy_version 1762885 (0.0008) [2023-12-28 07:55:52,297][106225] Updated weights for policy 1, policy_version 1767139 (0.0007) [2023-12-28 07:55:52,362][106225] Updated weights for policy 1, policy_version 1767149 (0.0007) [2023-12-28 07:55:52,417][106225] Updated weights for policy 1, policy_version 1767159 (0.0008) [2023-12-28 07:55:52,883][106226] Updated weights for policy 0, policy_version 1762895 (0.0010) [2023-12-28 07:55:52,933][106226] Updated weights for policy 0, policy_version 1762905 (0.0010) [2023-12-28 07:55:52,992][106226] Updated weights for policy 0, policy_version 1762915 (0.0010) [2023-12-28 07:55:53,187][106225] Updated weights for policy 1, policy_version 1767169 (0.0009) [2023-12-28 07:55:53,229][106225] Updated weights for policy 1, policy_version 1767179 (0.0007) [2023-12-28 07:55:53,277][106225] Updated weights for policy 1, policy_version 1767189 (0.0008) [2023-12-28 07:55:53,326][106225] Updated weights for policy 1, policy_version 1767199 (0.0008) [2023-12-28 07:55:53,662][106226] Updated weights for policy 0, policy_version 1762925 (0.0009) [2023-12-28 07:55:53,725][106226] Updated weights for policy 0, policy_version 1762935 (0.0008) [2023-12-28 07:55:53,782][106226] Updated weights for policy 0, policy_version 1762945 (0.0008) [2023-12-28 07:55:54,106][106225] Updated weights for policy 1, policy_version 1767209 (0.0010) [2023-12-28 07:55:54,153][106225] Updated weights for policy 1, policy_version 1767219 (0.0010) [2023-12-28 07:55:54,196][106225] Updated weights for policy 1, policy_version 1767229 (0.0008) [2023-12-28 07:55:54,466][106226] Updated weights for policy 0, policy_version 1762955 (0.0008) [2023-12-28 07:55:54,529][106226] Updated weights for policy 0, policy_version 1762965 (0.0008) [2023-12-28 07:55:54,595][106226] Updated weights for policy 0, policy_version 1762975 (0.0009) [2023-12-28 07:55:54,837][106225] Updated weights for policy 1, policy_version 1767239 (0.0008) [2023-12-28 07:55:54,885][106225] Updated weights for policy 1, policy_version 1767249 (0.0008) [2023-12-28 07:55:54,942][106225] Updated weights for policy 1, policy_version 1767259 (0.0008) [2023-12-28 07:55:55,342][106226] Updated weights for policy 0, policy_version 1762985 (0.0009) [2023-12-28 07:55:55,392][106226] Updated weights for policy 0, policy_version 1762995 (0.0008) [2023-12-28 07:55:55,444][106226] Updated weights for policy 0, policy_version 1763005 (0.0008) [2023-12-28 07:55:55,502][106226] Updated weights for policy 0, policy_version 1763015 (0.0008) [2023-12-28 07:55:55,611][106225] Updated weights for policy 1, policy_version 1767269 (0.0007) [2023-12-28 07:55:55,661][106225] Updated weights for policy 1, policy_version 1767279 (0.0005) [2023-12-28 07:55:55,713][106225] Updated weights for policy 1, policy_version 1767289 (0.0005) [2023-12-28 07:55:56,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 903897088. Throughput: 0: 9766.4, 1: 9833.1. Samples: 903869880. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:55:56,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.924')] [2023-12-28 07:55:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001763016_451411968.pth... [2023-12-28 07:55:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001767296_452485120.pth... [2023-12-28 07:55:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001761896_451125248.pth [2023-12-28 07:55:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001766112_452182016.pth [2023-12-28 07:55:56,221][106225] Updated weights for policy 1, policy_version 1767299 (0.0006) [2023-12-28 07:55:56,272][106225] Updated weights for policy 1, policy_version 1767309 (0.0008) [2023-12-28 07:55:56,305][106226] Updated weights for policy 0, policy_version 1763025 (0.0008) [2023-12-28 07:55:56,331][106225] Updated weights for policy 1, policy_version 1767319 (0.0007) [2023-12-28 07:55:56,353][106226] Updated weights for policy 0, policy_version 1763035 (0.0006) [2023-12-28 07:55:56,410][106226] Updated weights for policy 0, policy_version 1763045 (0.0007) [2023-12-28 07:55:56,951][106225] Updated weights for policy 1, policy_version 1767329 (0.0005) [2023-12-28 07:55:56,999][106225] Updated weights for policy 1, policy_version 1767339 (0.0008) [2023-12-28 07:55:57,042][106225] Updated weights for policy 1, policy_version 1767349 (0.0008) [2023-12-28 07:55:57,090][106225] Updated weights for policy 1, policy_version 1767359 (0.0008) [2023-12-28 07:55:57,140][106226] Updated weights for policy 0, policy_version 1763055 (0.0008) [2023-12-28 07:55:57,189][106226] Updated weights for policy 0, policy_version 1763065 (0.0005) [2023-12-28 07:55:57,252][106226] Updated weights for policy 0, policy_version 1763075 (0.0008) [2023-12-28 07:55:57,734][106225] Updated weights for policy 1, policy_version 1767369 (0.0006) [2023-12-28 07:55:57,785][106225] Updated weights for policy 1, policy_version 1767379 (0.0005) [2023-12-28 07:55:57,848][106225] Updated weights for policy 1, policy_version 1767389 (0.0005) [2023-12-28 07:55:58,026][106226] Updated weights for policy 0, policy_version 1763085 (0.0008) [2023-12-28 07:55:58,105][106226] Updated weights for policy 0, policy_version 1763095 (0.0010) [2023-12-28 07:55:58,165][106226] Updated weights for policy 0, policy_version 1763105 (0.0005) [2023-12-28 07:55:58,524][106225] Updated weights for policy 1, policy_version 1767399 (0.0008) [2023-12-28 07:55:58,589][106225] Updated weights for policy 1, policy_version 1767409 (0.0008) [2023-12-28 07:55:58,649][106225] Updated weights for policy 1, policy_version 1767419 (0.0008) [2023-12-28 07:55:58,953][106226] Updated weights for policy 0, policy_version 1763115 (0.0007) [2023-12-28 07:55:59,016][106226] Updated weights for policy 0, policy_version 1763125 (0.0011) [2023-12-28 07:55:59,073][106226] Updated weights for policy 0, policy_version 1763135 (0.0010) [2023-12-28 07:55:59,394][106225] Updated weights for policy 1, policy_version 1767429 (0.0009) [2023-12-28 07:55:59,457][106225] Updated weights for policy 1, policy_version 1767439 (0.0007) [2023-12-28 07:55:59,523][106225] Updated weights for policy 1, policy_version 1767449 (0.0005) [2023-12-28 07:55:59,847][106226] Updated weights for policy 0, policy_version 1763145 (0.0011) [2023-12-28 07:55:59,915][106226] Updated weights for policy 0, policy_version 1763155 (0.0008) [2023-12-28 07:55:59,980][106226] Updated weights for policy 0, policy_version 1763165 (0.0009) [2023-12-28 07:56:00,042][106226] Updated weights for policy 0, policy_version 1763175 (0.0009) [2023-12-28 07:56:00,184][106225] Updated weights for policy 1, policy_version 1767459 (0.0006) [2023-12-28 07:56:00,248][106225] Updated weights for policy 1, policy_version 1767469 (0.0006) [2023-12-28 07:56:00,319][106225] Updated weights for policy 1, policy_version 1767479 (0.0005) [2023-12-28 07:56:00,735][106226] Updated weights for policy 0, policy_version 1763185 (0.0008) [2023-12-28 07:56:00,794][106226] Updated weights for policy 0, policy_version 1763195 (0.0008) [2023-12-28 07:56:00,832][106225] Updated weights for policy 1, policy_version 1767489 (0.0006) [2023-12-28 07:56:00,839][106226] Updated weights for policy 0, policy_version 1763205 (0.0007) [2023-12-28 07:56:00,879][106225] Updated weights for policy 1, policy_version 1767499 (0.0008) [2023-12-28 07:56:00,934][106225] Updated weights for policy 1, policy_version 1767509 (0.0006) [2023-12-28 07:56:00,990][106225] Updated weights for policy 1, policy_version 1767519 (0.0009) [2023-12-28 07:56:01,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 904003584. Throughput: 0: 9670.6, 1: 10006.9. Samples: 903988208. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:56:01,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.717')] [2023-12-28 07:56:01,604][106226] Updated weights for policy 0, policy_version 1763215 (0.0007) [2023-12-28 07:56:01,674][106226] Updated weights for policy 0, policy_version 1763225 (0.0008) [2023-12-28 07:56:01,695][106225] Updated weights for policy 1, policy_version 1767529 (0.0007) [2023-12-28 07:56:01,745][106226] Updated weights for policy 0, policy_version 1763235 (0.0008) [2023-12-28 07:56:01,759][106225] Updated weights for policy 1, policy_version 1767539 (0.0007) [2023-12-28 07:56:01,820][106225] Updated weights for policy 1, policy_version 1767549 (0.0007) [2023-12-28 07:56:02,358][106226] Updated weights for policy 0, policy_version 1763245 (0.0007) [2023-12-28 07:56:02,421][106226] Updated weights for policy 0, policy_version 1763255 (0.0008) [2023-12-28 07:56:02,480][106226] Updated weights for policy 0, policy_version 1763265 (0.0007) [2023-12-28 07:56:02,596][106225] Updated weights for policy 1, policy_version 1767559 (0.0007) [2023-12-28 07:56:02,662][106225] Updated weights for policy 1, policy_version 1767569 (0.0010) [2023-12-28 07:56:02,724][106225] Updated weights for policy 1, policy_version 1767579 (0.0010) [2023-12-28 07:56:03,047][106226] Updated weights for policy 0, policy_version 1763275 (0.0005) [2023-12-28 07:56:03,102][106226] Updated weights for policy 0, policy_version 1763285 (0.0005) [2023-12-28 07:56:03,159][106226] Updated weights for policy 0, policy_version 1763295 (0.0005) [2023-12-28 07:56:03,432][106225] Updated weights for policy 1, policy_version 1767589 (0.0008) [2023-12-28 07:56:03,497][106225] Updated weights for policy 1, policy_version 1767599 (0.0005) [2023-12-28 07:56:03,562][106225] Updated weights for policy 1, policy_version 1767609 (0.0005) [2023-12-28 07:56:03,786][106226] Updated weights for policy 0, policy_version 1763305 (0.0007) [2023-12-28 07:56:03,833][106226] Updated weights for policy 0, policy_version 1763315 (0.0008) [2023-12-28 07:56:03,897][106226] Updated weights for policy 0, policy_version 1763325 (0.0008) [2023-12-28 07:56:03,951][106226] Updated weights for policy 0, policy_version 1763335 (0.0007) [2023-12-28 07:56:04,225][106225] Updated weights for policy 1, policy_version 1767619 (0.0009) [2023-12-28 07:56:04,288][106225] Updated weights for policy 1, policy_version 1767629 (0.0010) [2023-12-28 07:56:04,350][106225] Updated weights for policy 1, policy_version 1767639 (0.0010) [2023-12-28 07:56:04,701][106226] Updated weights for policy 0, policy_version 1763345 (0.0008) [2023-12-28 07:56:04,764][106226] Updated weights for policy 0, policy_version 1763355 (0.0008) [2023-12-28 07:56:04,823][106226] Updated weights for policy 0, policy_version 1763365 (0.0007) [2023-12-28 07:56:05,051][106225] Updated weights for policy 1, policy_version 1767649 (0.0011) [2023-12-28 07:56:05,111][106225] Updated weights for policy 1, policy_version 1767659 (0.0009) [2023-12-28 07:56:05,162][106225] Updated weights for policy 1, policy_version 1767669 (0.0009) [2023-12-28 07:56:05,212][106225] Updated weights for policy 1, policy_version 1767679 (0.0008) [2023-12-28 07:56:05,426][106226] Updated weights for policy 0, policy_version 1763375 (0.0008) [2023-12-28 07:56:05,473][106226] Updated weights for policy 0, policy_version 1763385 (0.0008) [2023-12-28 07:56:05,521][106226] Updated weights for policy 0, policy_version 1763395 (0.0005) [2023-12-28 07:56:05,970][106225] Updated weights for policy 1, policy_version 1767689 (0.0006) [2023-12-28 07:56:06,035][106225] Updated weights for policy 1, policy_version 1767699 (0.0005) [2023-12-28 07:56:06,095][106225] Updated weights for policy 1, policy_version 1767709 (0.0006) [2023-12-28 07:56:06,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 904101888. Throughput: 0: 9723.3, 1: 10054.4. Samples: 904110084. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:56:06,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.757')] [2023-12-28 07:56:06,283][106226] Updated weights for policy 0, policy_version 1763405 (0.0008) [2023-12-28 07:56:06,341][106226] Updated weights for policy 0, policy_version 1763415 (0.0008) [2023-12-28 07:56:06,395][106226] Updated weights for policy 0, policy_version 1763425 (0.0008) [2023-12-28 07:56:06,736][106225] Updated weights for policy 1, policy_version 1767719 (0.0009) [2023-12-28 07:56:06,804][106225] Updated weights for policy 1, policy_version 1767729 (0.0010) [2023-12-28 07:56:06,872][106225] Updated weights for policy 1, policy_version 1767739 (0.0009) [2023-12-28 07:56:07,166][106226] Updated weights for policy 0, policy_version 1763435 (0.0009) [2023-12-28 07:56:07,230][106226] Updated weights for policy 0, policy_version 1763445 (0.0010) [2023-12-28 07:56:07,298][106226] Updated weights for policy 0, policy_version 1763455 (0.0010) [2023-12-28 07:56:07,519][106225] Updated weights for policy 1, policy_version 1767749 (0.0008) [2023-12-28 07:56:07,578][106225] Updated weights for policy 1, policy_version 1767759 (0.0010) [2023-12-28 07:56:07,639][106225] Updated weights for policy 1, policy_version 1767769 (0.0010) [2023-12-28 07:56:08,024][106226] Updated weights for policy 0, policy_version 1763465 (0.0009) [2023-12-28 07:56:08,087][106226] Updated weights for policy 0, policy_version 1763475 (0.0006) [2023-12-28 07:56:08,149][106226] Updated weights for policy 0, policy_version 1763485 (0.0009) [2023-12-28 07:56:08,207][106226] Updated weights for policy 0, policy_version 1763495 (0.0009) [2023-12-28 07:56:08,275][106225] Updated weights for policy 1, policy_version 1767779 (0.0009) [2023-12-28 07:56:08,325][106225] Updated weights for policy 1, policy_version 1767789 (0.0006) [2023-12-28 07:56:08,396][106225] Updated weights for policy 1, policy_version 1767799 (0.0006) [2023-12-28 07:56:08,941][106226] Updated weights for policy 0, policy_version 1763505 (0.0011) [2023-12-28 07:56:09,002][106226] Updated weights for policy 0, policy_version 1763515 (0.0009) [2023-12-28 07:56:09,004][106225] Updated weights for policy 1, policy_version 1767809 (0.0006) [2023-12-28 07:56:09,058][106226] Updated weights for policy 0, policy_version 1763525 (0.0006) [2023-12-28 07:56:09,071][106225] Updated weights for policy 1, policy_version 1767819 (0.0006) [2023-12-28 07:56:09,144][106225] Updated weights for policy 1, policy_version 1767829 (0.0010) [2023-12-28 07:56:09,209][106225] Updated weights for policy 1, policy_version 1767839 (0.0006) [2023-12-28 07:56:09,769][106226] Updated weights for policy 0, policy_version 1763535 (0.0007) [2023-12-28 07:56:09,834][106226] Updated weights for policy 0, policy_version 1763545 (0.0008) [2023-12-28 07:56:09,902][106226] Updated weights for policy 0, policy_version 1763555 (0.0009) [2023-12-28 07:56:09,919][106225] Updated weights for policy 1, policy_version 1767849 (0.0007) [2023-12-28 07:56:09,987][106225] Updated weights for policy 1, policy_version 1767859 (0.0010) [2023-12-28 07:56:10,052][106225] Updated weights for policy 1, policy_version 1767869 (0.0009) [2023-12-28 07:56:10,676][106226] Updated weights for policy 0, policy_version 1763565 (0.0008) [2023-12-28 07:56:10,734][106226] Updated weights for policy 0, policy_version 1763575 (0.0006) [2023-12-28 07:56:10,795][106225] Updated weights for policy 1, policy_version 1767879 (0.0011) [2023-12-28 07:56:10,798][106226] Updated weights for policy 0, policy_version 1763585 (0.0007) [2023-12-28 07:56:10,846][106225] Updated weights for policy 1, policy_version 1767889 (0.0010) [2023-12-28 07:56:10,896][106225] Updated weights for policy 1, policy_version 1767899 (0.0010) [2023-12-28 07:56:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 904200192. Throughput: 0: 9732.5, 1: 10145.8. Samples: 904169812. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:56:11,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-4.596')] [2023-12-28 07:56:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001767904_452640768.pth... [2023-12-28 07:56:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001763592_451559424.pth... [2023-12-28 07:56:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001766720_452337664.pth [2023-12-28 07:56:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001762472_451272704.pth [2023-12-28 07:56:11,520][106226] Updated weights for policy 0, policy_version 1763595 (0.0006) [2023-12-28 07:56:11,583][106226] Updated weights for policy 0, policy_version 1763605 (0.0006) [2023-12-28 07:56:11,652][106226] Updated weights for policy 0, policy_version 1763615 (0.0008) [2023-12-28 07:56:11,708][106225] Updated weights for policy 1, policy_version 1767909 (0.0009) [2023-12-28 07:56:11,778][106225] Updated weights for policy 1, policy_version 1767919 (0.0008) [2023-12-28 07:56:11,834][106225] Updated weights for policy 1, policy_version 1767929 (0.0008) [2023-12-28 07:56:12,281][106226] Updated weights for policy 0, policy_version 1763625 (0.0008) [2023-12-28 07:56:12,348][106226] Updated weights for policy 0, policy_version 1763635 (0.0008) [2023-12-28 07:56:12,412][106226] Updated weights for policy 0, policy_version 1763645 (0.0009) [2023-12-28 07:56:12,474][106226] Updated weights for policy 0, policy_version 1763655 (0.0008) [2023-12-28 07:56:12,601][106225] Updated weights for policy 1, policy_version 1767939 (0.0008) [2023-12-28 07:56:12,666][106225] Updated weights for policy 1, policy_version 1767949 (0.0009) [2023-12-28 07:56:12,736][106225] Updated weights for policy 1, policy_version 1767959 (0.0010) [2023-12-28 07:56:13,129][106226] Updated weights for policy 0, policy_version 1763665 (0.0009) [2023-12-28 07:56:13,191][106226] Updated weights for policy 0, policy_version 1763675 (0.0008) [2023-12-28 07:56:13,259][106226] Updated weights for policy 0, policy_version 1763685 (0.0005) [2023-12-28 07:56:13,496][106225] Updated weights for policy 1, policy_version 1767969 (0.0010) [2023-12-28 07:56:13,545][106225] Updated weights for policy 1, policy_version 1767979 (0.0008) [2023-12-28 07:56:13,599][106225] Updated weights for policy 1, policy_version 1767989 (0.0006) [2023-12-28 07:56:13,644][106225] Updated weights for policy 1, policy_version 1767999 (0.0005) [2023-12-28 07:56:13,947][106226] Updated weights for policy 0, policy_version 1763695 (0.0008) [2023-12-28 07:56:14,007][106226] Updated weights for policy 0, policy_version 1763705 (0.0008) [2023-12-28 07:56:14,061][106226] Updated weights for policy 0, policy_version 1763715 (0.0008) [2023-12-28 07:56:14,204][106225] Updated weights for policy 1, policy_version 1768009 (0.0005) [2023-12-28 07:56:14,262][106225] Updated weights for policy 1, policy_version 1768019 (0.0008) [2023-12-28 07:56:14,312][106225] Updated weights for policy 1, policy_version 1768029 (0.0010) [2023-12-28 07:56:14,878][106226] Updated weights for policy 0, policy_version 1763725 (0.0008) [2023-12-28 07:56:14,938][106226] Updated weights for policy 0, policy_version 1763735 (0.0008) [2023-12-28 07:56:14,992][106225] Updated weights for policy 1, policy_version 1768039 (0.0008) [2023-12-28 07:56:14,998][106226] Updated weights for policy 0, policy_version 1763745 (0.0008) [2023-12-28 07:56:15,054][106225] Updated weights for policy 1, policy_version 1768049 (0.0008) [2023-12-28 07:56:15,116][106225] Updated weights for policy 1, policy_version 1768059 (0.0007) [2023-12-28 07:56:15,702][106225] Updated weights for policy 1, policy_version 1768069 (0.0010) [2023-12-28 07:56:15,759][106225] Updated weights for policy 1, policy_version 1768079 (0.0010) [2023-12-28 07:56:15,784][106226] Updated weights for policy 0, policy_version 1763755 (0.0009) [2023-12-28 07:56:15,814][106225] Updated weights for policy 1, policy_version 1768089 (0.0010) [2023-12-28 07:56:15,841][106226] Updated weights for policy 0, policy_version 1763765 (0.0007) [2023-12-28 07:56:15,896][106226] Updated weights for policy 0, policy_version 1763775 (0.0005) [2023-12-28 07:56:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 904298496. Throughput: 0: 9673.8, 1: 10074.0. Samples: 904285208. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:56:16,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-5.208')] [2023-12-28 07:56:16,436][106225] Updated weights for policy 1, policy_version 1768099 (0.0010) [2023-12-28 07:56:16,486][106225] Updated weights for policy 1, policy_version 1768109 (0.0010) [2023-12-28 07:56:16,496][106226] Updated weights for policy 0, policy_version 1763785 (0.0008) [2023-12-28 07:56:16,543][106225] Updated weights for policy 1, policy_version 1768119 (0.0010) [2023-12-28 07:56:16,549][106226] Updated weights for policy 0, policy_version 1763795 (0.0005) [2023-12-28 07:56:16,600][106226] Updated weights for policy 0, policy_version 1763805 (0.0007) [2023-12-28 07:56:16,645][106226] Updated weights for policy 0, policy_version 1763815 (0.0007) [2023-12-28 07:56:17,270][106225] Updated weights for policy 1, policy_version 1768129 (0.0010) [2023-12-28 07:56:17,294][106226] Updated weights for policy 0, policy_version 1763825 (0.0010) [2023-12-28 07:56:17,326][106225] Updated weights for policy 1, policy_version 1768139 (0.0006) [2023-12-28 07:56:17,348][106226] Updated weights for policy 0, policy_version 1763835 (0.0010) [2023-12-28 07:56:17,375][106225] Updated weights for policy 1, policy_version 1768149 (0.0006) [2023-12-28 07:56:17,397][106226] Updated weights for policy 0, policy_version 1763845 (0.0010) [2023-12-28 07:56:17,425][106225] Updated weights for policy 1, policy_version 1768159 (0.0005) [2023-12-28 07:56:18,026][106225] Updated weights for policy 1, policy_version 1768169 (0.0010) [2023-12-28 07:56:18,072][106225] Updated weights for policy 1, policy_version 1768179 (0.0010) [2023-12-28 07:56:18,122][106225] Updated weights for policy 1, policy_version 1768189 (0.0010) [2023-12-28 07:56:18,123][106226] Updated weights for policy 0, policy_version 1763855 (0.0011) [2023-12-28 07:56:18,176][106226] Updated weights for policy 0, policy_version 1763865 (0.0010) [2023-12-28 07:56:18,242][106226] Updated weights for policy 0, policy_version 1763875 (0.0011) [2023-12-28 07:56:18,867][106225] Updated weights for policy 1, policy_version 1768199 (0.0010) [2023-12-28 07:56:18,933][106225] Updated weights for policy 1, policy_version 1768209 (0.0010) [2023-12-28 07:56:18,984][106226] Updated weights for policy 0, policy_version 1763885 (0.0008) [2023-12-28 07:56:19,000][106225] Updated weights for policy 1, policy_version 1768219 (0.0010) [2023-12-28 07:56:19,034][106226] Updated weights for policy 0, policy_version 1763895 (0.0008) [2023-12-28 07:56:19,083][106226] Updated weights for policy 0, policy_version 1763905 (0.0008) [2023-12-28 07:56:19,734][106225] Updated weights for policy 1, policy_version 1768229 (0.0010) [2023-12-28 07:56:19,799][106225] Updated weights for policy 1, policy_version 1768239 (0.0010) [2023-12-28 07:56:19,813][106226] Updated weights for policy 0, policy_version 1763915 (0.0008) [2023-12-28 07:56:19,874][106225] Updated weights for policy 1, policy_version 1768249 (0.0011) [2023-12-28 07:56:19,883][106226] Updated weights for policy 0, policy_version 1763925 (0.0012) [2023-12-28 07:56:19,957][106226] Updated weights for policy 0, policy_version 1763935 (0.0008) [2023-12-28 07:56:20,594][106225] Updated weights for policy 1, policy_version 1768259 (0.0009) [2023-12-28 07:56:20,665][106226] Updated weights for policy 0, policy_version 1763945 (0.0006) [2023-12-28 07:56:20,666][106225] Updated weights for policy 1, policy_version 1768269 (0.0009) [2023-12-28 07:56:20,734][106226] Updated weights for policy 0, policy_version 1763955 (0.0006) [2023-12-28 07:56:20,735][106225] Updated weights for policy 1, policy_version 1768279 (0.0007) [2023-12-28 07:56:20,798][106226] Updated weights for policy 0, policy_version 1763965 (0.0007) [2023-12-28 07:56:20,862][106226] Updated weights for policy 0, policy_version 1763975 (0.0009) [2023-12-28 07:56:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 904396800. Throughput: 0: 9611.0, 1: 10098.5. Samples: 904405052. Policy #0 lag: (min: 21.0, avg: 24.5, max: 53.0) [2023-12-28 07:56:21,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.798')] [2023-12-28 07:56:21,482][106225] Updated weights for policy 1, policy_version 1768289 (0.0010) [2023-12-28 07:56:21,545][106225] Updated weights for policy 1, policy_version 1768299 (0.0008) [2023-12-28 07:56:21,606][106225] Updated weights for policy 1, policy_version 1768309 (0.0008) [2023-12-28 07:56:21,612][106226] Updated weights for policy 0, policy_version 1763985 (0.0006) [2023-12-28 07:56:21,672][106225] Updated weights for policy 1, policy_version 1768319 (0.0008) [2023-12-28 07:56:21,680][106226] Updated weights for policy 0, policy_version 1763995 (0.0008) [2023-12-28 07:56:21,743][106226] Updated weights for policy 0, policy_version 1764005 (0.0009) [2023-12-28 07:56:22,433][106225] Updated weights for policy 1, policy_version 1768329 (0.0008) [2023-12-28 07:56:22,491][106225] Updated weights for policy 1, policy_version 1768339 (0.0008) [2023-12-28 07:56:22,493][106226] Updated weights for policy 0, policy_version 1764015 (0.0010) [2023-12-28 07:56:22,543][106225] Updated weights for policy 1, policy_version 1768349 (0.0008) [2023-12-28 07:56:22,555][106226] Updated weights for policy 0, policy_version 1764025 (0.0011) [2023-12-28 07:56:22,616][106226] Updated weights for policy 0, policy_version 1764035 (0.0011) [2023-12-28 07:56:23,226][106225] Updated weights for policy 1, policy_version 1768359 (0.0006) [2023-12-28 07:56:23,260][106226] Updated weights for policy 0, policy_version 1764045 (0.0011) [2023-12-28 07:56:23,283][106225] Updated weights for policy 1, policy_version 1768369 (0.0005) [2023-12-28 07:56:23,323][106226] Updated weights for policy 0, policy_version 1764055 (0.0010) [2023-12-28 07:56:23,345][106225] Updated weights for policy 1, policy_version 1768379 (0.0005) [2023-12-28 07:56:23,383][106226] Updated weights for policy 0, policy_version 1764065 (0.0010) [2023-12-28 07:56:23,904][106225] Updated weights for policy 1, policy_version 1768389 (0.0005) [2023-12-28 07:56:23,962][106225] Updated weights for policy 1, policy_version 1768399 (0.0005) [2023-12-28 07:56:24,020][106225] Updated weights for policy 1, policy_version 1768409 (0.0006) [2023-12-28 07:56:24,062][106226] Updated weights for policy 0, policy_version 1764075 (0.0010) [2023-12-28 07:56:24,120][106226] Updated weights for policy 0, policy_version 1764085 (0.0007) [2023-12-28 07:56:24,176][106226] Updated weights for policy 0, policy_version 1764095 (0.0007) [2023-12-28 07:56:24,695][106225] Updated weights for policy 1, policy_version 1768419 (0.0009) [2023-12-28 07:56:24,760][106225] Updated weights for policy 1, policy_version 1768429 (0.0009) [2023-12-28 07:56:24,779][106226] Updated weights for policy 0, policy_version 1764105 (0.0006) [2023-12-28 07:56:24,816][106225] Updated weights for policy 1, policy_version 1768439 (0.0010) [2023-12-28 07:56:24,837][106226] Updated weights for policy 0, policy_version 1764115 (0.0010) [2023-12-28 07:56:24,886][106226] Updated weights for policy 0, policy_version 1764125 (0.0010) [2023-12-28 07:56:24,936][106226] Updated weights for policy 0, policy_version 1764135 (0.0011) [2023-12-28 07:56:25,400][106225] Updated weights for policy 1, policy_version 1768449 (0.0010) [2023-12-28 07:56:25,457][106225] Updated weights for policy 1, policy_version 1768459 (0.0005) [2023-12-28 07:56:25,514][106225] Updated weights for policy 1, policy_version 1768469 (0.0010) [2023-12-28 07:56:25,570][106225] Updated weights for policy 1, policy_version 1768479 (0.0010) [2023-12-28 07:56:25,599][106226] Updated weights for policy 0, policy_version 1764145 (0.0006) [2023-12-28 07:56:25,647][106226] Updated weights for policy 0, policy_version 1764155 (0.0005) [2023-12-28 07:56:25,696][106226] Updated weights for policy 0, policy_version 1764165 (0.0005) [2023-12-28 07:56:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 904495104. Throughput: 0: 9624.2, 1: 10081.6. Samples: 904464552. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:26,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.655')] [2023-12-28 07:56:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001764168_451706880.pth... [2023-12-28 07:56:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001763016_451411968.pth [2023-12-28 07:56:26,232][106225] Updated weights for policy 1, policy_version 1768489 (0.0009) [2023-12-28 07:56:26,275][106226] Updated weights for policy 0, policy_version 1764175 (0.0007) [2023-12-28 07:56:26,295][106225] Updated weights for policy 1, policy_version 1768499 (0.0007) [2023-12-28 07:56:26,326][106226] Updated weights for policy 0, policy_version 1764185 (0.0008) [2023-12-28 07:56:26,348][106225] Updated weights for policy 1, policy_version 1768509 (0.0006) [2023-12-28 07:56:26,360][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001768512_452796416.pth... [2023-12-28 07:56:26,363][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001767296_452485120.pth [2023-12-28 07:56:26,383][106226] Updated weights for policy 0, policy_version 1764195 (0.0010) [2023-12-28 07:56:26,967][106226] Updated weights for policy 0, policy_version 1764205 (0.0008) [2023-12-28 07:56:27,029][106226] Updated weights for policy 0, policy_version 1764215 (0.0005) [2023-12-28 07:56:27,085][106226] Updated weights for policy 0, policy_version 1764225 (0.0007) [2023-12-28 07:56:27,145][106225] Updated weights for policy 1, policy_version 1768519 (0.0006) [2023-12-28 07:56:27,200][106225] Updated weights for policy 1, policy_version 1768529 (0.0005) [2023-12-28 07:56:27,253][106225] Updated weights for policy 1, policy_version 1768539 (0.0005) [2023-12-28 07:56:27,660][106226] Updated weights for policy 0, policy_version 1764235 (0.0007) [2023-12-28 07:56:27,715][106226] Updated weights for policy 0, policy_version 1764245 (0.0008) [2023-12-28 07:56:27,774][106226] Updated weights for policy 0, policy_version 1764255 (0.0008) [2023-12-28 07:56:27,926][106225] Updated weights for policy 1, policy_version 1768549 (0.0007) [2023-12-28 07:56:27,977][106225] Updated weights for policy 1, policy_version 1768559 (0.0008) [2023-12-28 07:56:28,034][106225] Updated weights for policy 1, policy_version 1768569 (0.0008) [2023-12-28 07:56:28,493][106226] Updated weights for policy 0, policy_version 1764265 (0.0008) [2023-12-28 07:56:28,547][106226] Updated weights for policy 0, policy_version 1764275 (0.0005) [2023-12-28 07:56:28,604][106226] Updated weights for policy 0, policy_version 1764285 (0.0006) [2023-12-28 07:56:28,648][106226] Updated weights for policy 0, policy_version 1764295 (0.0008) [2023-12-28 07:56:28,819][106225] Updated weights for policy 1, policy_version 1768579 (0.0009) [2023-12-28 07:56:28,877][106225] Updated weights for policy 1, policy_version 1768589 (0.0008) [2023-12-28 07:56:28,927][106225] Updated weights for policy 1, policy_version 1768599 (0.0007) [2023-12-28 07:56:29,347][106226] Updated weights for policy 0, policy_version 1764305 (0.0008) [2023-12-28 07:56:29,407][106226] Updated weights for policy 0, policy_version 1764315 (0.0008) [2023-12-28 07:56:29,460][106226] Updated weights for policy 0, policy_version 1764325 (0.0009) [2023-12-28 07:56:29,668][106225] Updated weights for policy 1, policy_version 1768609 (0.0008) [2023-12-28 07:56:29,717][106225] Updated weights for policy 1, policy_version 1768619 (0.0008) [2023-12-28 07:56:29,774][106225] Updated weights for policy 1, policy_version 1768629 (0.0008) [2023-12-28 07:56:29,831][106225] Updated weights for policy 1, policy_version 1768639 (0.0009) [2023-12-28 07:56:30,187][106226] Updated weights for policy 0, policy_version 1764335 (0.0008) [2023-12-28 07:56:30,242][106226] Updated weights for policy 0, policy_version 1764345 (0.0009) [2023-12-28 07:56:30,294][106226] Updated weights for policy 0, policy_version 1764355 (0.0008) [2023-12-28 07:56:30,573][106225] Updated weights for policy 1, policy_version 1768649 (0.0010) [2023-12-28 07:56:30,629][106225] Updated weights for policy 1, policy_version 1768659 (0.0010) [2023-12-28 07:56:30,675][106225] Updated weights for policy 1, policy_version 1768669 (0.0010) [2023-12-28 07:56:31,035][106226] Updated weights for policy 0, policy_version 1764365 (0.0008) [2023-12-28 07:56:31,094][106226] Updated weights for policy 0, policy_version 1764375 (0.0008) [2023-12-28 07:56:31,156][106226] Updated weights for policy 0, policy_version 1764385 (0.0008) [2023-12-28 07:56:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 904593408. Throughput: 0: 9803.3, 1: 10124.3. Samples: 904589220. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:31,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.868')] [2023-12-28 07:56:31,452][106225] Updated weights for policy 1, policy_version 1768679 (0.0009) [2023-12-28 07:56:31,507][106225] Updated weights for policy 1, policy_version 1768689 (0.0009) [2023-12-28 07:56:31,556][106225] Updated weights for policy 1, policy_version 1768699 (0.0009) [2023-12-28 07:56:31,844][106226] Updated weights for policy 0, policy_version 1764395 (0.0009) [2023-12-28 07:56:31,904][106226] Updated weights for policy 0, policy_version 1764405 (0.0009) [2023-12-28 07:56:31,960][106226] Updated weights for policy 0, policy_version 1764415 (0.0009) [2023-12-28 07:56:32,338][106225] Updated weights for policy 1, policy_version 1768709 (0.0008) [2023-12-28 07:56:32,400][106225] Updated weights for policy 1, policy_version 1768719 (0.0008) [2023-12-28 07:56:32,448][106225] Updated weights for policy 1, policy_version 1768729 (0.0008) [2023-12-28 07:56:32,694][106226] Updated weights for policy 0, policy_version 1764425 (0.0007) [2023-12-28 07:56:32,756][106226] Updated weights for policy 0, policy_version 1764435 (0.0008) [2023-12-28 07:56:32,817][106226] Updated weights for policy 0, policy_version 1764445 (0.0008) [2023-12-28 07:56:32,879][106226] Updated weights for policy 0, policy_version 1764455 (0.0008) [2023-12-28 07:56:33,111][106225] Updated weights for policy 1, policy_version 1768739 (0.0008) [2023-12-28 07:56:33,167][106225] Updated weights for policy 1, policy_version 1768749 (0.0008) [2023-12-28 07:56:33,225][106225] Updated weights for policy 1, policy_version 1768759 (0.0008) [2023-12-28 07:56:33,605][106226] Updated weights for policy 0, policy_version 1764465 (0.0009) [2023-12-28 07:56:33,651][106226] Updated weights for policy 0, policy_version 1764475 (0.0008) [2023-12-28 07:56:33,708][106226] Updated weights for policy 0, policy_version 1764485 (0.0010) [2023-12-28 07:56:33,883][106225] Updated weights for policy 1, policy_version 1768769 (0.0007) [2023-12-28 07:56:33,934][106225] Updated weights for policy 1, policy_version 1768779 (0.0005) [2023-12-28 07:56:33,984][106225] Updated weights for policy 1, policy_version 1768789 (0.0005) [2023-12-28 07:56:34,036][106225] Updated weights for policy 1, policy_version 1768799 (0.0007) [2023-12-28 07:56:34,459][106226] Updated weights for policy 0, policy_version 1764495 (0.0008) [2023-12-28 07:56:34,517][106226] Updated weights for policy 0, policy_version 1764505 (0.0007) [2023-12-28 07:56:34,584][106226] Updated weights for policy 0, policy_version 1764515 (0.0009) [2023-12-28 07:56:34,723][106225] Updated weights for policy 1, policy_version 1768809 (0.0010) [2023-12-28 07:56:34,789][106225] Updated weights for policy 1, policy_version 1768819 (0.0010) [2023-12-28 07:56:34,853][106225] Updated weights for policy 1, policy_version 1768829 (0.0008) [2023-12-28 07:56:35,339][106226] Updated weights for policy 0, policy_version 1764525 (0.0006) [2023-12-28 07:56:35,392][106226] Updated weights for policy 0, policy_version 1764536 (0.0009) [2023-12-28 07:56:35,439][106225] Updated weights for policy 1, policy_version 1768839 (0.0005) [2023-12-28 07:56:35,448][106226] Updated weights for policy 0, policy_version 1764546 (0.0008) [2023-12-28 07:56:35,503][106225] Updated weights for policy 1, policy_version 1768849 (0.0006) [2023-12-28 07:56:35,564][106225] Updated weights for policy 1, policy_version 1768859 (0.0005) [2023-12-28 07:56:36,131][106225] Updated weights for policy 1, policy_version 1768869 (0.0007) [2023-12-28 07:56:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 904691712. Throughput: 0: 9779.5, 1: 10100.8. Samples: 904706384. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:36,175][105115] Avg episode reward: [(0, '-4.588'), (1, '-4.886')] [2023-12-28 07:56:36,196][106225] Updated weights for policy 1, policy_version 1768879 (0.0006) [2023-12-28 07:56:36,260][106226] Updated weights for policy 0, policy_version 1764556 (0.0009) [2023-12-28 07:56:36,261][106225] Updated weights for policy 1, policy_version 1768889 (0.0007) [2023-12-28 07:56:36,322][106226] Updated weights for policy 0, policy_version 1764566 (0.0008) [2023-12-28 07:56:36,392][106226] Updated weights for policy 0, policy_version 1764576 (0.0009) [2023-12-28 07:56:36,873][106225] Updated weights for policy 1, policy_version 1768899 (0.0007) [2023-12-28 07:56:36,926][106225] Updated weights for policy 1, policy_version 1768909 (0.0010) [2023-12-28 07:56:36,984][106225] Updated weights for policy 1, policy_version 1768919 (0.0010) [2023-12-28 07:56:37,132][106226] Updated weights for policy 0, policy_version 1764586 (0.0006) [2023-12-28 07:56:37,196][106226] Updated weights for policy 0, policy_version 1764596 (0.0006) [2023-12-28 07:56:37,261][106226] Updated weights for policy 0, policy_version 1764606 (0.0006) [2023-12-28 07:56:37,326][106226] Updated weights for policy 0, policy_version 1764616 (0.0005) [2023-12-28 07:56:37,738][106225] Updated weights for policy 1, policy_version 1768929 (0.0009) [2023-12-28 07:56:37,802][106225] Updated weights for policy 1, policy_version 1768939 (0.0009) [2023-12-28 07:56:37,868][106225] Updated weights for policy 1, policy_version 1768949 (0.0009) [2023-12-28 07:56:37,927][106225] Updated weights for policy 1, policy_version 1768959 (0.0010) [2023-12-28 07:56:37,972][106226] Updated weights for policy 0, policy_version 1764626 (0.0008) [2023-12-28 07:56:38,033][106226] Updated weights for policy 0, policy_version 1764636 (0.0009) [2023-12-28 07:56:38,094][106226] Updated weights for policy 0, policy_version 1764646 (0.0008) [2023-12-28 07:56:38,499][106225] Updated weights for policy 1, policy_version 1768969 (0.0008) [2023-12-28 07:56:38,554][106225] Updated weights for policy 1, policy_version 1768979 (0.0008) [2023-12-28 07:56:38,602][106225] Updated weights for policy 1, policy_version 1768989 (0.0008) [2023-12-28 07:56:38,871][106226] Updated weights for policy 0, policy_version 1764656 (0.0010) [2023-12-28 07:56:38,932][106226] Updated weights for policy 0, policy_version 1764666 (0.0011) [2023-12-28 07:56:38,985][106226] Updated weights for policy 0, policy_version 1764676 (0.0010) [2023-12-28 07:56:39,322][106225] Updated weights for policy 1, policy_version 1768999 (0.0010) [2023-12-28 07:56:39,390][106225] Updated weights for policy 1, policy_version 1769009 (0.0012) [2023-12-28 07:56:39,451][106225] Updated weights for policy 1, policy_version 1769019 (0.0007) [2023-12-28 07:56:39,773][106226] Updated weights for policy 0, policy_version 1764687 (0.0010) [2023-12-28 07:56:39,842][106226] Updated weights for policy 0, policy_version 1764697 (0.0010) [2023-12-28 07:56:39,891][106226] Updated weights for policy 0, policy_version 1764707 (0.0007) [2023-12-28 07:56:40,191][106225] Updated weights for policy 1, policy_version 1769029 (0.0007) [2023-12-28 07:56:40,254][106225] Updated weights for policy 1, policy_version 1769039 (0.0008) [2023-12-28 07:56:40,316][106225] Updated weights for policy 1, policy_version 1769049 (0.0008) [2023-12-28 07:56:40,635][106226] Updated weights for policy 0, policy_version 1764717 (0.0009) [2023-12-28 07:56:40,698][106226] Updated weights for policy 0, policy_version 1764727 (0.0010) [2023-12-28 07:56:40,762][106226] Updated weights for policy 0, policy_version 1764737 (0.0010) [2023-12-28 07:56:40,966][106225] Updated weights for policy 1, policy_version 1769059 (0.0009) [2023-12-28 07:56:41,027][106225] Updated weights for policy 1, policy_version 1769069 (0.0010) [2023-12-28 07:56:41,094][106225] Updated weights for policy 1, policy_version 1769079 (0.0009) [2023-12-28 07:56:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 904798208. Throughput: 0: 9771.5, 1: 10135.0. Samples: 904765676. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:41,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.855')] [2023-12-28 07:56:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001769088_452943872.pth... [2023-12-28 07:56:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001764744_451854336.pth... [2023-12-28 07:56:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001763592_451559424.pth [2023-12-28 07:56:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001767904_452640768.pth [2023-12-28 07:56:41,511][106226] Updated weights for policy 0, policy_version 1764747 (0.0009) [2023-12-28 07:56:41,574][106226] Updated weights for policy 0, policy_version 1764757 (0.0008) [2023-12-28 07:56:41,647][106226] Updated weights for policy 0, policy_version 1764767 (0.0009) [2023-12-28 07:56:41,906][106225] Updated weights for policy 1, policy_version 1769089 (0.0010) [2023-12-28 07:56:41,970][106225] Updated weights for policy 1, policy_version 1769099 (0.0009) [2023-12-28 07:56:42,027][106225] Updated weights for policy 1, policy_version 1769109 (0.0009) [2023-12-28 07:56:42,091][106225] Updated weights for policy 1, policy_version 1769119 (0.0006) [2023-12-28 07:56:42,268][106226] Updated weights for policy 0, policy_version 1764777 (0.0007) [2023-12-28 07:56:42,324][106226] Updated weights for policy 0, policy_version 1764787 (0.0008) [2023-12-28 07:56:42,397][106226] Updated weights for policy 0, policy_version 1764797 (0.0008) [2023-12-28 07:56:42,461][106226] Updated weights for policy 0, policy_version 1764807 (0.0009) [2023-12-28 07:56:42,810][106225] Updated weights for policy 1, policy_version 1769129 (0.0007) [2023-12-28 07:56:42,879][106225] Updated weights for policy 1, policy_version 1769139 (0.0009) [2023-12-28 07:56:42,942][106225] Updated weights for policy 1, policy_version 1769149 (0.0008) [2023-12-28 07:56:43,223][106226] Updated weights for policy 0, policy_version 1764817 (0.0008) [2023-12-28 07:56:43,283][106226] Updated weights for policy 0, policy_version 1764827 (0.0008) [2023-12-28 07:56:43,342][106226] Updated weights for policy 0, policy_version 1764837 (0.0007) [2023-12-28 07:56:43,644][106225] Updated weights for policy 1, policy_version 1769159 (0.0006) [2023-12-28 07:56:43,699][106225] Updated weights for policy 1, policy_version 1769169 (0.0005) [2023-12-28 07:56:43,764][106225] Updated weights for policy 1, policy_version 1769179 (0.0005) [2023-12-28 07:56:43,939][106226] Updated weights for policy 0, policy_version 1764847 (0.0009) [2023-12-28 07:56:43,995][106226] Updated weights for policy 0, policy_version 1764857 (0.0010) [2023-12-28 07:56:44,061][106226] Updated weights for policy 0, policy_version 1764867 (0.0010) [2023-12-28 07:56:44,379][106225] Updated weights for policy 1, policy_version 1769189 (0.0007) [2023-12-28 07:56:44,426][106225] Updated weights for policy 1, policy_version 1769199 (0.0010) [2023-12-28 07:56:44,474][106225] Updated weights for policy 1, policy_version 1769209 (0.0010) [2023-12-28 07:56:44,672][106226] Updated weights for policy 0, policy_version 1764877 (0.0011) [2023-12-28 07:56:44,729][106226] Updated weights for policy 0, policy_version 1764887 (0.0010) [2023-12-28 07:56:44,803][106226] Updated weights for policy 0, policy_version 1764897 (0.0009) [2023-12-28 07:56:45,225][106225] Updated weights for policy 1, policy_version 1769219 (0.0009) [2023-12-28 07:56:45,292][106225] Updated weights for policy 1, policy_version 1769229 (0.0007) [2023-12-28 07:56:45,359][106225] Updated weights for policy 1, policy_version 1769239 (0.0010) [2023-12-28 07:56:45,501][106226] Updated weights for policy 0, policy_version 1764907 (0.0009) [2023-12-28 07:56:45,553][106226] Updated weights for policy 0, policy_version 1764917 (0.0005) [2023-12-28 07:56:45,614][106226] Updated weights for policy 0, policy_version 1764927 (0.0005) [2023-12-28 07:56:46,027][106225] Updated weights for policy 1, policy_version 1769249 (0.0010) [2023-12-28 07:56:46,076][106225] Updated weights for policy 1, policy_version 1769259 (0.0005) [2023-12-28 07:56:46,144][106225] Updated weights for policy 1, policy_version 1769269 (0.0005) [2023-12-28 07:56:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 904888320. Throughput: 0: 9873.2, 1: 10010.5. Samples: 904882976. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:46,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.825')] [2023-12-28 07:56:46,195][106225] Updated weights for policy 1, policy_version 1769279 (0.0007) [2023-12-28 07:56:46,234][106226] Updated weights for policy 0, policy_version 1764937 (0.0006) [2023-12-28 07:56:46,284][106226] Updated weights for policy 0, policy_version 1764947 (0.0010) [2023-12-28 07:56:46,341][106226] Updated weights for policy 0, policy_version 1764957 (0.0010) [2023-12-28 07:56:46,399][106226] Updated weights for policy 0, policy_version 1764967 (0.0009) [2023-12-28 07:56:46,892][106225] Updated weights for policy 1, policy_version 1769289 (0.0010) [2023-12-28 07:56:46,939][106225] Updated weights for policy 1, policy_version 1769299 (0.0010) [2023-12-28 07:56:46,993][106225] Updated weights for policy 1, policy_version 1769309 (0.0010) [2023-12-28 07:56:47,011][106226] Updated weights for policy 0, policy_version 1764977 (0.0005) [2023-12-28 07:56:47,070][106226] Updated weights for policy 0, policy_version 1764987 (0.0005) [2023-12-28 07:56:47,129][106226] Updated weights for policy 0, policy_version 1764997 (0.0005) [2023-12-28 07:56:47,672][106225] Updated weights for policy 1, policy_version 1769319 (0.0009) [2023-12-28 07:56:47,742][106225] Updated weights for policy 1, policy_version 1769329 (0.0008) [2023-12-28 07:56:47,753][106226] Updated weights for policy 0, policy_version 1765007 (0.0008) [2023-12-28 07:56:47,792][106225] Updated weights for policy 1, policy_version 1769339 (0.0010) [2023-12-28 07:56:47,812][106226] Updated weights for policy 0, policy_version 1765017 (0.0006) [2023-12-28 07:56:47,878][106226] Updated weights for policy 0, policy_version 1765027 (0.0005) [2023-12-28 07:56:48,435][106226] Updated weights for policy 0, policy_version 1765037 (0.0007) [2023-12-28 07:56:48,495][106225] Updated weights for policy 1, policy_version 1769349 (0.0010) [2023-12-28 07:56:48,499][106226] Updated weights for policy 0, policy_version 1765047 (0.0008) [2023-12-28 07:56:48,549][106225] Updated weights for policy 1, policy_version 1769359 (0.0010) [2023-12-28 07:56:48,558][106226] Updated weights for policy 0, policy_version 1765057 (0.0008) [2023-12-28 07:56:48,603][106225] Updated weights for policy 1, policy_version 1769369 (0.0010) [2023-12-28 07:56:49,314][106226] Updated weights for policy 0, policy_version 1765067 (0.0008) [2023-12-28 07:56:49,354][106225] Updated weights for policy 1, policy_version 1769379 (0.0010) [2023-12-28 07:56:49,380][106226] Updated weights for policy 0, policy_version 1765077 (0.0007) [2023-12-28 07:56:49,422][106225] Updated weights for policy 1, policy_version 1769389 (0.0011) [2023-12-28 07:56:49,439][106226] Updated weights for policy 0, policy_version 1765087 (0.0008) [2023-12-28 07:56:49,482][106225] Updated weights for policy 1, policy_version 1769399 (0.0010) [2023-12-28 07:56:50,209][106225] Updated weights for policy 1, policy_version 1769409 (0.0010) [2023-12-28 07:56:50,222][106226] Updated weights for policy 0, policy_version 1765097 (0.0007) [2023-12-28 07:56:50,263][106225] Updated weights for policy 1, policy_version 1769419 (0.0010) [2023-12-28 07:56:50,278][106226] Updated weights for policy 0, policy_version 1765107 (0.0006) [2023-12-28 07:56:50,325][106225] Updated weights for policy 1, policy_version 1769429 (0.0011) [2023-12-28 07:56:50,343][106226] Updated weights for policy 0, policy_version 1765117 (0.0009) [2023-12-28 07:56:50,389][106225] Updated weights for policy 1, policy_version 1769439 (0.0009) [2023-12-28 07:56:50,401][106226] Updated weights for policy 0, policy_version 1765127 (0.0007) [2023-12-28 07:56:51,132][106225] Updated weights for policy 1, policy_version 1769449 (0.0010) [2023-12-28 07:56:51,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 904986624. Throughput: 0: 9850.9, 1: 9974.6. Samples: 905002228. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:51,175][105115] Avg episode reward: [(0, '-4.752'), (1, '-4.640')] [2023-12-28 07:56:51,195][106225] Updated weights for policy 1, policy_version 1769459 (0.0011) [2023-12-28 07:56:51,197][106226] Updated weights for policy 0, policy_version 1765137 (0.0007) [2023-12-28 07:56:51,256][106225] Updated weights for policy 1, policy_version 1769469 (0.0011) [2023-12-28 07:56:51,266][106226] Updated weights for policy 0, policy_version 1765147 (0.0006) [2023-12-28 07:56:51,331][106226] Updated weights for policy 0, policy_version 1765157 (0.0008) [2023-12-28 07:56:52,080][106225] Updated weights for policy 1, policy_version 1769479 (0.0010) [2023-12-28 07:56:52,125][106226] Updated weights for policy 0, policy_version 1765167 (0.0007) [2023-12-28 07:56:52,146][106225] Updated weights for policy 1, policy_version 1769489 (0.0010) [2023-12-28 07:56:52,189][106226] Updated weights for policy 0, policy_version 1765177 (0.0010) [2023-12-28 07:56:52,211][106225] Updated weights for policy 1, policy_version 1769499 (0.0011) [2023-12-28 07:56:52,254][106226] Updated weights for policy 0, policy_version 1765187 (0.0006) [2023-12-28 07:56:52,936][106225] Updated weights for policy 1, policy_version 1769509 (0.0010) [2023-12-28 07:56:52,996][106225] Updated weights for policy 1, policy_version 1769519 (0.0010) [2023-12-28 07:56:53,014][106226] Updated weights for policy 0, policy_version 1765197 (0.0006) [2023-12-28 07:56:53,050][106225] Updated weights for policy 1, policy_version 1769529 (0.0010) [2023-12-28 07:56:53,065][106226] Updated weights for policy 0, policy_version 1765207 (0.0010) [2023-12-28 07:56:53,125][106226] Updated weights for policy 0, policy_version 1765217 (0.0009) [2023-12-28 07:56:53,773][106225] Updated weights for policy 1, policy_version 1769539 (0.0010) [2023-12-28 07:56:53,790][106226] Updated weights for policy 0, policy_version 1765227 (0.0007) [2023-12-28 07:56:53,829][106225] Updated weights for policy 1, policy_version 1769549 (0.0008) [2023-12-28 07:56:53,852][106226] Updated weights for policy 0, policy_version 1765237 (0.0005) [2023-12-28 07:56:53,885][106225] Updated weights for policy 1, policy_version 1769559 (0.0010) [2023-12-28 07:56:53,903][106226] Updated weights for policy 0, policy_version 1765247 (0.0005) [2023-12-28 07:56:54,538][106226] Updated weights for policy 0, policy_version 1765257 (0.0007) [2023-12-28 07:56:54,590][106226] Updated weights for policy 0, policy_version 1765267 (0.0007) [2023-12-28 07:56:54,592][106225] Updated weights for policy 1, policy_version 1769569 (0.0010) [2023-12-28 07:56:54,638][106225] Updated weights for policy 1, policy_version 1769579 (0.0010) [2023-12-28 07:56:54,640][106226] Updated weights for policy 0, policy_version 1765277 (0.0006) [2023-12-28 07:56:54,688][106225] Updated weights for policy 1, policy_version 1769589 (0.0010) [2023-12-28 07:56:54,690][106226] Updated weights for policy 0, policy_version 1765287 (0.0005) [2023-12-28 07:56:54,731][106225] Updated weights for policy 1, policy_version 1769599 (0.0010) [2023-12-28 07:56:55,355][106226] Updated weights for policy 0, policy_version 1765297 (0.0005) [2023-12-28 07:56:55,419][106226] Updated weights for policy 0, policy_version 1765307 (0.0006) [2023-12-28 07:56:55,468][106226] Updated weights for policy 0, policy_version 1765317 (0.0005) [2023-12-28 07:56:55,475][106225] Updated weights for policy 1, policy_version 1769609 (0.0006) [2023-12-28 07:56:55,542][106225] Updated weights for policy 1, policy_version 1769619 (0.0007) [2023-12-28 07:56:55,605][106225] Updated weights for policy 1, policy_version 1769629 (0.0010) [2023-12-28 07:56:56,083][106226] Updated weights for policy 0, policy_version 1765327 (0.0008) [2023-12-28 07:56:56,140][106226] Updated weights for policy 0, policy_version 1765337 (0.0008) [2023-12-28 07:56:56,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 905084928. Throughput: 0: 9854.3, 1: 9898.1. Samples: 905058664. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:56:56,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.551')] [2023-12-28 07:56:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001769632_453083136.pth... [2023-12-28 07:56:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001768512_452796416.pth [2023-12-28 07:56:56,194][106226] Updated weights for policy 0, policy_version 1765347 (0.0008) [2023-12-28 07:56:56,224][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001765352_452009984.pth... [2023-12-28 07:56:56,228][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001764168_451706880.pth [2023-12-28 07:56:56,263][106225] Updated weights for policy 1, policy_version 1769639 (0.0009) [2023-12-28 07:56:56,324][106225] Updated weights for policy 1, policy_version 1769649 (0.0011) [2023-12-28 07:56:56,392][106225] Updated weights for policy 1, policy_version 1769659 (0.0010) [2023-12-28 07:56:56,814][106226] Updated weights for policy 0, policy_version 1765357 (0.0009) [2023-12-28 07:56:56,872][106226] Updated weights for policy 0, policy_version 1765367 (0.0009) [2023-12-28 07:56:56,938][106226] Updated weights for policy 0, policy_version 1765377 (0.0006) [2023-12-28 07:56:56,973][106225] Updated weights for policy 1, policy_version 1769669 (0.0008) [2023-12-28 07:56:57,030][106225] Updated weights for policy 1, policy_version 1769679 (0.0005) [2023-12-28 07:56:57,086][106225] Updated weights for policy 1, policy_version 1769689 (0.0005) [2023-12-28 07:56:57,593][106226] Updated weights for policy 0, policy_version 1765387 (0.0007) [2023-12-28 07:56:57,635][106225] Updated weights for policy 1, policy_version 1769699 (0.0006) [2023-12-28 07:56:57,654][106226] Updated weights for policy 0, policy_version 1765397 (0.0005) [2023-12-28 07:56:57,697][106225] Updated weights for policy 1, policy_version 1769709 (0.0008) [2023-12-28 07:56:57,705][106226] Updated weights for policy 0, policy_version 1765407 (0.0005) [2023-12-28 07:56:57,756][106225] Updated weights for policy 1, policy_version 1769719 (0.0009) [2023-12-28 07:56:58,350][106226] Updated weights for policy 0, policy_version 1765417 (0.0008) [2023-12-28 07:56:58,419][106226] Updated weights for policy 0, policy_version 1765427 (0.0009) [2023-12-28 07:56:58,493][106226] Updated weights for policy 0, policy_version 1765437 (0.0011) [2023-12-28 07:56:58,517][106225] Updated weights for policy 1, policy_version 1769729 (0.0009) [2023-12-28 07:56:58,557][106226] Updated weights for policy 0, policy_version 1765447 (0.0009) [2023-12-28 07:56:58,576][106225] Updated weights for policy 1, policy_version 1769739 (0.0007) [2023-12-28 07:56:58,640][106225] Updated weights for policy 1, policy_version 1769749 (0.0009) [2023-12-28 07:56:58,706][106225] Updated weights for policy 1, policy_version 1769759 (0.0008) [2023-12-28 07:56:59,329][106226] Updated weights for policy 0, policy_version 1765457 (0.0008) [2023-12-28 07:56:59,393][106226] Updated weights for policy 0, policy_version 1765467 (0.0009) [2023-12-28 07:56:59,440][106226] Updated weights for policy 0, policy_version 1765477 (0.0006) [2023-12-28 07:56:59,559][106225] Updated weights for policy 1, policy_version 1769769 (0.0009) [2023-12-28 07:56:59,629][106225] Updated weights for policy 1, policy_version 1769779 (0.0009) [2023-12-28 07:56:59,689][106225] Updated weights for policy 1, policy_version 1769789 (0.0005) [2023-12-28 07:57:00,080][106226] Updated weights for policy 0, policy_version 1765487 (0.0005) [2023-12-28 07:57:00,143][106226] Updated weights for policy 0, policy_version 1765497 (0.0005) [2023-12-28 07:57:00,204][106226] Updated weights for policy 0, policy_version 1765507 (0.0005) [2023-12-28 07:57:00,419][106225] Updated weights for policy 1, policy_version 1769799 (0.0009) [2023-12-28 07:57:00,469][106225] Updated weights for policy 1, policy_version 1769809 (0.0009) [2023-12-28 07:57:00,524][106225] Updated weights for policy 1, policy_version 1769819 (0.0010) [2023-12-28 07:57:00,747][106226] Updated weights for policy 0, policy_version 1765517 (0.0005) [2023-12-28 07:57:00,804][106226] Updated weights for policy 0, policy_version 1765527 (0.0005) [2023-12-28 07:57:00,862][106226] Updated weights for policy 0, policy_version 1765537 (0.0005) [2023-12-28 07:57:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 905191424. Throughput: 0: 9980.5, 1: 9928.9. Samples: 905181128. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:01,175][105115] Avg episode reward: [(0, '-4.163'), (1, '-4.954')] [2023-12-28 07:57:01,275][106225] Updated weights for policy 1, policy_version 1769829 (0.0010) [2023-12-28 07:57:01,323][106225] Updated weights for policy 1, policy_version 1769839 (0.0007) [2023-12-28 07:57:01,389][106225] Updated weights for policy 1, policy_version 1769849 (0.0007) [2023-12-28 07:57:01,462][106226] Updated weights for policy 0, policy_version 1765547 (0.0006) [2023-12-28 07:57:01,527][106226] Updated weights for policy 0, policy_version 1765557 (0.0009) [2023-12-28 07:57:01,589][106226] Updated weights for policy 0, policy_version 1765567 (0.0009) [2023-12-28 07:57:02,071][106225] Updated weights for policy 1, policy_version 1769859 (0.0006) [2023-12-28 07:57:02,127][106225] Updated weights for policy 1, policy_version 1769869 (0.0008) [2023-12-28 07:57:02,188][106225] Updated weights for policy 1, policy_version 1769879 (0.0009) [2023-12-28 07:57:02,337][106226] Updated weights for policy 0, policy_version 1765577 (0.0008) [2023-12-28 07:57:02,402][106226] Updated weights for policy 0, policy_version 1765587 (0.0009) [2023-12-28 07:57:02,462][106226] Updated weights for policy 0, policy_version 1765597 (0.0008) [2023-12-28 07:57:02,528][106226] Updated weights for policy 0, policy_version 1765607 (0.0008) [2023-12-28 07:57:02,933][106225] Updated weights for policy 1, policy_version 1769889 (0.0007) [2023-12-28 07:57:02,990][106225] Updated weights for policy 1, policy_version 1769899 (0.0009) [2023-12-28 07:57:03,043][106225] Updated weights for policy 1, policy_version 1769909 (0.0009) [2023-12-28 07:57:03,096][106225] Updated weights for policy 1, policy_version 1769919 (0.0008) [2023-12-28 07:57:03,251][106226] Updated weights for policy 0, policy_version 1765617 (0.0008) [2023-12-28 07:57:03,308][106226] Updated weights for policy 0, policy_version 1765627 (0.0008) [2023-12-28 07:57:03,371][106226] Updated weights for policy 0, policy_version 1765637 (0.0008) [2023-12-28 07:57:03,830][106225] Updated weights for policy 1, policy_version 1769929 (0.0009) [2023-12-28 07:57:03,898][106225] Updated weights for policy 1, policy_version 1769939 (0.0008) [2023-12-28 07:57:03,960][106225] Updated weights for policy 1, policy_version 1769949 (0.0009) [2023-12-28 07:57:04,092][106226] Updated weights for policy 0, policy_version 1765647 (0.0009) [2023-12-28 07:57:04,156][106226] Updated weights for policy 0, policy_version 1765657 (0.0009) [2023-12-28 07:57:04,210][106226] Updated weights for policy 0, policy_version 1765667 (0.0008) [2023-12-28 07:57:04,643][106225] Updated weights for policy 1, policy_version 1769959 (0.0006) [2023-12-28 07:57:04,697][106225] Updated weights for policy 1, policy_version 1769969 (0.0007) [2023-12-28 07:57:04,753][106225] Updated weights for policy 1, policy_version 1769979 (0.0008) [2023-12-28 07:57:04,950][106226] Updated weights for policy 0, policy_version 1765677 (0.0009) [2023-12-28 07:57:05,001][106226] Updated weights for policy 0, policy_version 1765687 (0.0008) [2023-12-28 07:57:05,057][106226] Updated weights for policy 0, policy_version 1765697 (0.0009) [2023-12-28 07:57:05,425][106225] Updated weights for policy 1, policy_version 1769989 (0.0009) [2023-12-28 07:57:05,478][106225] Updated weights for policy 1, policy_version 1769999 (0.0007) [2023-12-28 07:57:05,532][106225] Updated weights for policy 1, policy_version 1770009 (0.0005) [2023-12-28 07:57:05,809][106226] Updated weights for policy 0, policy_version 1765707 (0.0008) [2023-12-28 07:57:05,871][106226] Updated weights for policy 0, policy_version 1765717 (0.0009) [2023-12-28 07:57:05,928][106226] Updated weights for policy 0, policy_version 1765727 (0.0008) [2023-12-28 07:57:06,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 905289728. Throughput: 0: 9993.4, 1: 9871.9. Samples: 905298992. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:06,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.658')] [2023-12-28 07:57:06,254][106225] Updated weights for policy 1, policy_version 1770019 (0.0009) [2023-12-28 07:57:06,318][106225] Updated weights for policy 1, policy_version 1770029 (0.0008) [2023-12-28 07:57:06,384][106225] Updated weights for policy 1, policy_version 1770039 (0.0009) [2023-12-28 07:57:06,634][106226] Updated weights for policy 0, policy_version 1765737 (0.0008) [2023-12-28 07:57:06,702][106226] Updated weights for policy 0, policy_version 1765747 (0.0009) [2023-12-28 07:57:06,770][106226] Updated weights for policy 0, policy_version 1765757 (0.0008) [2023-12-28 07:57:06,836][106226] Updated weights for policy 0, policy_version 1765767 (0.0008) [2023-12-28 07:57:07,133][106225] Updated weights for policy 1, policy_version 1770049 (0.0009) [2023-12-28 07:57:07,197][106225] Updated weights for policy 1, policy_version 1770059 (0.0009) [2023-12-28 07:57:07,253][106225] Updated weights for policy 1, policy_version 1770069 (0.0008) [2023-12-28 07:57:07,322][106225] Updated weights for policy 1, policy_version 1770079 (0.0009) [2023-12-28 07:57:07,555][106226] Updated weights for policy 0, policy_version 1765777 (0.0007) [2023-12-28 07:57:07,623][106226] Updated weights for policy 0, policy_version 1765787 (0.0006) [2023-12-28 07:57:07,692][106226] Updated weights for policy 0, policy_version 1765797 (0.0006) [2023-12-28 07:57:08,140][106225] Updated weights for policy 1, policy_version 1770089 (0.0008) [2023-12-28 07:57:08,202][106225] Updated weights for policy 1, policy_version 1770099 (0.0010) [2023-12-28 07:57:08,228][106226] Updated weights for policy 0, policy_version 1765807 (0.0006) [2023-12-28 07:57:08,260][106225] Updated weights for policy 1, policy_version 1770109 (0.0007) [2023-12-28 07:57:08,291][106226] Updated weights for policy 0, policy_version 1765817 (0.0008) [2023-12-28 07:57:08,363][106226] Updated weights for policy 0, policy_version 1765827 (0.0008) [2023-12-28 07:57:08,964][106226] Updated weights for policy 0, policy_version 1765837 (0.0009) [2023-12-28 07:57:09,028][106226] Updated weights for policy 0, policy_version 1765847 (0.0007) [2023-12-28 07:57:09,062][106225] Updated weights for policy 1, policy_version 1770119 (0.0006) [2023-12-28 07:57:09,078][106226] Updated weights for policy 0, policy_version 1765857 (0.0007) [2023-12-28 07:57:09,114][106225] Updated weights for policy 1, policy_version 1770129 (0.0008) [2023-12-28 07:57:09,167][106225] Updated weights for policy 1, policy_version 1770139 (0.0010) [2023-12-28 07:57:09,858][106226] Updated weights for policy 0, policy_version 1765867 (0.0008) [2023-12-28 07:57:09,919][106226] Updated weights for policy 0, policy_version 1765877 (0.0011) [2023-12-28 07:57:09,939][106225] Updated weights for policy 1, policy_version 1770149 (0.0010) [2023-12-28 07:57:09,979][106226] Updated weights for policy 0, policy_version 1765887 (0.0011) [2023-12-28 07:57:09,994][106225] Updated weights for policy 1, policy_version 1770159 (0.0007) [2023-12-28 07:57:10,056][106225] Updated weights for policy 1, policy_version 1770169 (0.0007) [2023-12-28 07:57:10,732][106226] Updated weights for policy 0, policy_version 1765897 (0.0010) [2023-12-28 07:57:10,792][106225] Updated weights for policy 1, policy_version 1770179 (0.0008) [2023-12-28 07:57:10,799][106226] Updated weights for policy 0, policy_version 1765907 (0.0009) [2023-12-28 07:57:10,852][106226] Updated weights for policy 0, policy_version 1765917 (0.0007) [2023-12-28 07:57:10,854][106225] Updated weights for policy 1, policy_version 1770189 (0.0008) [2023-12-28 07:57:10,908][106225] Updated weights for policy 1, policy_version 1770199 (0.0009) [2023-12-28 07:57:10,910][106226] Updated weights for policy 0, policy_version 1765927 (0.0006) [2023-12-28 07:57:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 905388032. Throughput: 0: 10027.1, 1: 9806.9. Samples: 905357084. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:11,175][105115] Avg episode reward: [(0, '-4.546'), (1, '-4.938')] [2023-12-28 07:57:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001765928_452157440.pth... [2023-12-28 07:57:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001770208_453230592.pth... [2023-12-28 07:57:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001764744_451854336.pth [2023-12-28 07:57:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001769088_452943872.pth [2023-12-28 07:57:11,605][106226] Updated weights for policy 0, policy_version 1765937 (0.0008) [2023-12-28 07:57:11,673][106225] Updated weights for policy 1, policy_version 1770209 (0.0008) [2023-12-28 07:57:11,680][106226] Updated weights for policy 0, policy_version 1765947 (0.0009) [2023-12-28 07:57:11,750][106225] Updated weights for policy 1, policy_version 1770219 (0.0009) [2023-12-28 07:57:11,755][106226] Updated weights for policy 0, policy_version 1765957 (0.0010) [2023-12-28 07:57:11,814][106225] Updated weights for policy 1, policy_version 1770229 (0.0008) [2023-12-28 07:57:11,876][106225] Updated weights for policy 1, policy_version 1770239 (0.0011) [2023-12-28 07:57:12,488][106226] Updated weights for policy 0, policy_version 1765967 (0.0009) [2023-12-28 07:57:12,550][106226] Updated weights for policy 0, policy_version 1765977 (0.0011) [2023-12-28 07:57:12,570][106225] Updated weights for policy 1, policy_version 1770249 (0.0010) [2023-12-28 07:57:12,610][106226] Updated weights for policy 0, policy_version 1765987 (0.0011) [2023-12-28 07:57:12,631][106225] Updated weights for policy 1, policy_version 1770259 (0.0010) [2023-12-28 07:57:12,693][106225] Updated weights for policy 1, policy_version 1770269 (0.0010) [2023-12-28 07:57:13,280][106226] Updated weights for policy 0, policy_version 1765997 (0.0009) [2023-12-28 07:57:13,311][106225] Updated weights for policy 1, policy_version 1770279 (0.0008) [2023-12-28 07:57:13,335][106226] Updated weights for policy 0, policy_version 1766007 (0.0007) [2023-12-28 07:57:13,383][106225] Updated weights for policy 1, policy_version 1770289 (0.0006) [2023-12-28 07:57:13,399][106226] Updated weights for policy 0, policy_version 1766017 (0.0009) [2023-12-28 07:57:13,432][106225] Updated weights for policy 1, policy_version 1770299 (0.0009) [2023-12-28 07:57:14,030][106225] Updated weights for policy 1, policy_version 1770309 (0.0008) [2023-12-28 07:57:14,086][106225] Updated weights for policy 1, policy_version 1770319 (0.0007) [2023-12-28 07:57:14,106][106226] Updated weights for policy 0, policy_version 1766027 (0.0010) [2023-12-28 07:57:14,146][106225] Updated weights for policy 1, policy_version 1770329 (0.0005) [2023-12-28 07:57:14,167][106226] Updated weights for policy 0, policy_version 1766037 (0.0011) [2023-12-28 07:57:14,217][106226] Updated weights for policy 0, policy_version 1766047 (0.0010) [2023-12-28 07:57:14,914][106225] Updated weights for policy 1, policy_version 1770339 (0.0007) [2023-12-28 07:57:14,916][106226] Updated weights for policy 0, policy_version 1766057 (0.0010) [2023-12-28 07:57:14,976][106226] Updated weights for policy 0, policy_version 1766067 (0.0006) [2023-12-28 07:57:14,978][106225] Updated weights for policy 1, policy_version 1770349 (0.0008) [2023-12-28 07:57:15,032][106226] Updated weights for policy 0, policy_version 1766077 (0.0006) [2023-12-28 07:57:15,042][106225] Updated weights for policy 1, policy_version 1770359 (0.0008) [2023-12-28 07:57:15,097][106226] Updated weights for policy 0, policy_version 1766087 (0.0006) [2023-12-28 07:57:15,680][106226] Updated weights for policy 0, policy_version 1766097 (0.0008) [2023-12-28 07:57:15,739][106226] Updated weights for policy 0, policy_version 1766107 (0.0008) [2023-12-28 07:57:15,802][106226] Updated weights for policy 0, policy_version 1766117 (0.0008) [2023-12-28 07:57:15,829][106225] Updated weights for policy 1, policy_version 1770369 (0.0008) [2023-12-28 07:57:15,878][106225] Updated weights for policy 1, policy_version 1770379 (0.0008) [2023-12-28 07:57:15,931][106225] Updated weights for policy 1, policy_version 1770389 (0.0006) [2023-12-28 07:57:15,983][106225] Updated weights for policy 1, policy_version 1770399 (0.0010) [2023-12-28 07:57:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 905486336. Throughput: 0: 9886.0, 1: 9779.6. Samples: 905474172. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:16,175][105115] Avg episode reward: [(0, '-4.656'), (1, '-4.777')] [2023-12-28 07:57:16,581][106225] Updated weights for policy 1, policy_version 1770409 (0.0006) [2023-12-28 07:57:16,586][106226] Updated weights for policy 0, policy_version 1766127 (0.0007) [2023-12-28 07:57:16,636][106225] Updated weights for policy 1, policy_version 1770419 (0.0007) [2023-12-28 07:57:16,647][106226] Updated weights for policy 0, policy_version 1766137 (0.0008) [2023-12-28 07:57:16,691][106225] Updated weights for policy 1, policy_version 1770429 (0.0007) [2023-12-28 07:57:16,705][106226] Updated weights for policy 0, policy_version 1766147 (0.0006) [2023-12-28 07:57:17,347][106226] Updated weights for policy 0, policy_version 1766157 (0.0008) [2023-12-28 07:57:17,401][106226] Updated weights for policy 0, policy_version 1766167 (0.0008) [2023-12-28 07:57:17,405][106225] Updated weights for policy 1, policy_version 1770439 (0.0006) [2023-12-28 07:57:17,456][106225] Updated weights for policy 1, policy_version 1770449 (0.0006) [2023-12-28 07:57:17,467][106226] Updated weights for policy 0, policy_version 1766177 (0.0008) [2023-12-28 07:57:17,516][106225] Updated weights for policy 1, policy_version 1770459 (0.0005) [2023-12-28 07:57:18,167][106225] Updated weights for policy 1, policy_version 1770469 (0.0007) [2023-12-28 07:57:18,215][106226] Updated weights for policy 0, policy_version 1766187 (0.0008) [2023-12-28 07:57:18,218][106225] Updated weights for policy 1, policy_version 1770479 (0.0009) [2023-12-28 07:57:18,266][106226] Updated weights for policy 0, policy_version 1766197 (0.0005) [2023-12-28 07:57:18,274][106225] Updated weights for policy 1, policy_version 1770489 (0.0008) [2023-12-28 07:57:18,327][106226] Updated weights for policy 0, policy_version 1766207 (0.0006) [2023-12-28 07:57:19,020][106226] Updated weights for policy 0, policy_version 1766217 (0.0008) [2023-12-28 07:57:19,044][106225] Updated weights for policy 1, policy_version 1770499 (0.0008) [2023-12-28 07:57:19,088][106226] Updated weights for policy 0, policy_version 1766227 (0.0005) [2023-12-28 07:57:19,105][106225] Updated weights for policy 1, policy_version 1770509 (0.0008) [2023-12-28 07:57:19,150][106225] Updated weights for policy 1, policy_version 1770519 (0.0008) [2023-12-28 07:57:19,154][106226] Updated weights for policy 0, policy_version 1766237 (0.0005) [2023-12-28 07:57:19,210][106226] Updated weights for policy 0, policy_version 1766247 (0.0005) [2023-12-28 07:57:19,891][106226] Updated weights for policy 0, policy_version 1766257 (0.0010) [2023-12-28 07:57:19,952][106226] Updated weights for policy 0, policy_version 1766267 (0.0010) [2023-12-28 07:57:19,953][106225] Updated weights for policy 1, policy_version 1770529 (0.0007) [2023-12-28 07:57:20,012][106226] Updated weights for policy 0, policy_version 1766277 (0.0009) [2023-12-28 07:57:20,014][106225] Updated weights for policy 1, policy_version 1770539 (0.0007) [2023-12-28 07:57:20,081][106225] Updated weights for policy 1, policy_version 1770549 (0.0008) [2023-12-28 07:57:20,133][106225] Updated weights for policy 1, policy_version 1770559 (0.0008) [2023-12-28 07:57:20,784][106226] Updated weights for policy 0, policy_version 1766287 (0.0009) [2023-12-28 07:57:20,848][106226] Updated weights for policy 0, policy_version 1766297 (0.0006) [2023-12-28 07:57:20,850][106225] Updated weights for policy 1, policy_version 1770569 (0.0008) [2023-12-28 07:57:20,914][106226] Updated weights for policy 0, policy_version 1766307 (0.0007) [2023-12-28 07:57:20,917][106225] Updated weights for policy 1, policy_version 1770579 (0.0008) [2023-12-28 07:57:20,983][106225] Updated weights for policy 1, policy_version 1770589 (0.0008) [2023-12-28 07:57:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 905584640. Throughput: 0: 9938.9, 1: 9723.9. Samples: 905591212. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:21,175][105115] Avg episode reward: [(0, '-4.760'), (1, '-4.866')] [2023-12-28 07:57:21,623][106226] Updated weights for policy 0, policy_version 1766317 (0.0007) [2023-12-28 07:57:21,691][106226] Updated weights for policy 0, policy_version 1766327 (0.0008) [2023-12-28 07:57:21,710][106225] Updated weights for policy 1, policy_version 1770599 (0.0008) [2023-12-28 07:57:21,770][106226] Updated weights for policy 0, policy_version 1766337 (0.0007) [2023-12-28 07:57:21,780][106225] Updated weights for policy 1, policy_version 1770609 (0.0008) [2023-12-28 07:57:21,856][106225] Updated weights for policy 1, policy_version 1770619 (0.0008) [2023-12-28 07:57:22,429][106226] Updated weights for policy 0, policy_version 1766347 (0.0007) [2023-12-28 07:57:22,491][106226] Updated weights for policy 0, policy_version 1766357 (0.0008) [2023-12-28 07:57:22,548][106225] Updated weights for policy 1, policy_version 1770629 (0.0009) [2023-12-28 07:57:22,555][106226] Updated weights for policy 0, policy_version 1766367 (0.0008) [2023-12-28 07:57:22,610][106225] Updated weights for policy 1, policy_version 1770639 (0.0011) [2023-12-28 07:57:22,678][106225] Updated weights for policy 1, policy_version 1770649 (0.0011) [2023-12-28 07:57:23,321][106225] Updated weights for policy 1, policy_version 1770659 (0.0011) [2023-12-28 07:57:23,351][106226] Updated weights for policy 0, policy_version 1766377 (0.0007) [2023-12-28 07:57:23,390][106225] Updated weights for policy 1, policy_version 1770669 (0.0011) [2023-12-28 07:57:23,402][106226] Updated weights for policy 0, policy_version 1766387 (0.0007) [2023-12-28 07:57:23,450][106226] Updated weights for policy 0, policy_version 1766397 (0.0007) [2023-12-28 07:57:23,450][106225] Updated weights for policy 1, policy_version 1770679 (0.0010) [2023-12-28 07:57:23,513][106226] Updated weights for policy 0, policy_version 1766407 (0.0006) [2023-12-28 07:57:24,122][106225] Updated weights for policy 1, policy_version 1770689 (0.0009) [2023-12-28 07:57:24,187][106225] Updated weights for policy 1, policy_version 1770699 (0.0011) [2023-12-28 07:57:24,209][106226] Updated weights for policy 0, policy_version 1766417 (0.0006) [2023-12-28 07:57:24,240][106225] Updated weights for policy 1, policy_version 1770709 (0.0010) [2023-12-28 07:57:24,265][106226] Updated weights for policy 0, policy_version 1766427 (0.0009) [2023-12-28 07:57:24,287][106225] Updated weights for policy 1, policy_version 1770719 (0.0010) [2023-12-28 07:57:24,321][106226] Updated weights for policy 0, policy_version 1766437 (0.0007) [2023-12-28 07:57:24,960][106225] Updated weights for policy 1, policy_version 1770729 (0.0006) [2023-12-28 07:57:25,022][106225] Updated weights for policy 1, policy_version 1770739 (0.0008) [2023-12-28 07:57:25,044][106226] Updated weights for policy 0, policy_version 1766447 (0.0006) [2023-12-28 07:57:25,076][106225] Updated weights for policy 1, policy_version 1770749 (0.0009) [2023-12-28 07:57:25,093][106226] Updated weights for policy 0, policy_version 1766457 (0.0005) [2023-12-28 07:57:25,149][106226] Updated weights for policy 0, policy_version 1766467 (0.0005) [2023-12-28 07:57:25,681][106226] Updated weights for policy 0, policy_version 1766477 (0.0007) [2023-12-28 07:57:25,727][106226] Updated weights for policy 0, policy_version 1766487 (0.0007) [2023-12-28 07:57:25,782][106226] Updated weights for policy 0, policy_version 1766497 (0.0007) [2023-12-28 07:57:25,799][106225] Updated weights for policy 1, policy_version 1770759 (0.0009) [2023-12-28 07:57:25,849][106225] Updated weights for policy 1, policy_version 1770769 (0.0010) [2023-12-28 07:57:25,902][106225] Updated weights for policy 1, policy_version 1770779 (0.0010) [2023-12-28 07:57:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 905682944. Throughput: 0: 9957.6, 1: 9683.8. Samples: 905649540. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:26,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.782')] [2023-12-28 07:57:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001770784_453378048.pth... [2023-12-28 07:57:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001766504_452304896.pth... [2023-12-28 07:57:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001769632_453083136.pth [2023-12-28 07:57:26,202][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001765352_452009984.pth [2023-12-28 07:57:26,453][106226] Updated weights for policy 0, policy_version 1766507 (0.0006) [2023-12-28 07:57:26,506][106226] Updated weights for policy 0, policy_version 1766517 (0.0005) [2023-12-28 07:57:26,559][106226] Updated weights for policy 0, policy_version 1766527 (0.0005) [2023-12-28 07:57:26,595][106225] Updated weights for policy 1, policy_version 1770789 (0.0010) [2023-12-28 07:57:26,663][106225] Updated weights for policy 1, policy_version 1770799 (0.0010) [2023-12-28 07:57:26,722][106225] Updated weights for policy 1, policy_version 1770809 (0.0010) [2023-12-28 07:57:27,173][106226] Updated weights for policy 0, policy_version 1766537 (0.0006) [2023-12-28 07:57:27,226][106226] Updated weights for policy 0, policy_version 1766547 (0.0009) [2023-12-28 07:57:27,280][106225] Updated weights for policy 1, policy_version 1770819 (0.0010) [2023-12-28 07:57:27,285][106226] Updated weights for policy 0, policy_version 1766557 (0.0007) [2023-12-28 07:57:27,330][106225] Updated weights for policy 1, policy_version 1770829 (0.0007) [2023-12-28 07:57:27,347][106226] Updated weights for policy 0, policy_version 1766567 (0.0007) [2023-12-28 07:57:27,390][106225] Updated weights for policy 1, policy_version 1770839 (0.0006) [2023-12-28 07:57:27,941][106225] Updated weights for policy 1, policy_version 1770849 (0.0006) [2023-12-28 07:57:28,000][106225] Updated weights for policy 1, policy_version 1770859 (0.0006) [2023-12-28 07:57:28,056][106225] Updated weights for policy 1, policy_version 1770869 (0.0008) [2023-12-28 07:57:28,079][106226] Updated weights for policy 0, policy_version 1766577 (0.0005) [2023-12-28 07:57:28,113][106225] Updated weights for policy 1, policy_version 1770879 (0.0008) [2023-12-28 07:57:28,133][106226] Updated weights for policy 0, policy_version 1766587 (0.0007) [2023-12-28 07:57:28,182][106226] Updated weights for policy 0, policy_version 1766597 (0.0008) [2023-12-28 07:57:28,805][106225] Updated weights for policy 1, policy_version 1770889 (0.0008) [2023-12-28 07:57:28,868][106225] Updated weights for policy 1, policy_version 1770899 (0.0007) [2023-12-28 07:57:28,872][106226] Updated weights for policy 0, policy_version 1766607 (0.0010) [2023-12-28 07:57:28,926][106226] Updated weights for policy 0, policy_version 1766617 (0.0011) [2023-12-28 07:57:28,927][106225] Updated weights for policy 1, policy_version 1770909 (0.0010) [2023-12-28 07:57:28,982][106226] Updated weights for policy 0, policy_version 1766627 (0.0009) [2023-12-28 07:57:29,552][106225] Updated weights for policy 1, policy_version 1770919 (0.0009) [2023-12-28 07:57:29,615][106225] Updated weights for policy 1, policy_version 1770929 (0.0010) [2023-12-28 07:57:29,669][106225] Updated weights for policy 1, policy_version 1770939 (0.0010) [2023-12-28 07:57:29,680][106226] Updated weights for policy 0, policy_version 1766637 (0.0007) [2023-12-28 07:57:29,740][106226] Updated weights for policy 0, policy_version 1766647 (0.0007) [2023-12-28 07:57:29,799][106226] Updated weights for policy 0, policy_version 1766657 (0.0008) [2023-12-28 07:57:30,318][106225] Updated weights for policy 1, policy_version 1770949 (0.0008) [2023-12-28 07:57:30,373][106225] Updated weights for policy 1, policy_version 1770959 (0.0009) [2023-12-28 07:57:30,429][106225] Updated weights for policy 1, policy_version 1770969 (0.0010) [2023-12-28 07:57:30,434][106226] Updated weights for policy 0, policy_version 1766667 (0.0008) [2023-12-28 07:57:30,495][106226] Updated weights for policy 0, policy_version 1766677 (0.0006) [2023-12-28 07:57:30,552][106226] Updated weights for policy 0, policy_version 1766687 (0.0006) [2023-12-28 07:57:31,113][106225] Updated weights for policy 1, policy_version 1770979 (0.0010) [2023-12-28 07:57:31,118][106226] Updated weights for policy 0, policy_version 1766697 (0.0010) [2023-12-28 07:57:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 905781248. Throughput: 0: 10026.5, 1: 9789.3. Samples: 905774688. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:31,175][106225] Updated weights for policy 1, policy_version 1770989 (0.0008) [2023-12-28 07:57:31,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.883')] [2023-12-28 07:57:31,181][106226] Updated weights for policy 0, policy_version 1766707 (0.0010) [2023-12-28 07:57:31,235][106226] Updated weights for policy 0, policy_version 1766717 (0.0006) [2023-12-28 07:57:31,240][106225] Updated weights for policy 1, policy_version 1770999 (0.0008) [2023-12-28 07:57:31,299][106226] Updated weights for policy 0, policy_version 1766727 (0.0010) [2023-12-28 07:57:31,942][106226] Updated weights for policy 0, policy_version 1766737 (0.0010) [2023-12-28 07:57:31,990][106225] Updated weights for policy 1, policy_version 1771009 (0.0008) [2023-12-28 07:57:32,004][106226] Updated weights for policy 0, policy_version 1766747 (0.0006) [2023-12-28 07:57:32,056][106225] Updated weights for policy 1, policy_version 1771019 (0.0006) [2023-12-28 07:57:32,071][106226] Updated weights for policy 0, policy_version 1766757 (0.0006) [2023-12-28 07:57:32,121][106225] Updated weights for policy 1, policy_version 1771029 (0.0006) [2023-12-28 07:57:32,184][106225] Updated weights for policy 1, policy_version 1771039 (0.0008) [2023-12-28 07:57:32,639][106226] Updated weights for policy 0, policy_version 1766767 (0.0008) [2023-12-28 07:57:32,701][106226] Updated weights for policy 0, policy_version 1766777 (0.0009) [2023-12-28 07:57:32,763][106226] Updated weights for policy 0, policy_version 1766787 (0.0007) [2023-12-28 07:57:32,844][106225] Updated weights for policy 1, policy_version 1771049 (0.0009) [2023-12-28 07:57:32,895][106225] Updated weights for policy 1, policy_version 1771059 (0.0008) [2023-12-28 07:57:32,957][106225] Updated weights for policy 1, policy_version 1771069 (0.0009) [2023-12-28 07:57:33,398][106226] Updated weights for policy 0, policy_version 1766797 (0.0007) [2023-12-28 07:57:33,447][106226] Updated weights for policy 0, policy_version 1766807 (0.0009) [2023-12-28 07:57:33,500][106226] Updated weights for policy 0, policy_version 1766817 (0.0008) [2023-12-28 07:57:33,593][106225] Updated weights for policy 1, policy_version 1771079 (0.0006) [2023-12-28 07:57:33,650][106225] Updated weights for policy 1, policy_version 1771089 (0.0005) [2023-12-28 07:57:33,706][106225] Updated weights for policy 1, policy_version 1771099 (0.0005) [2023-12-28 07:57:34,232][106225] Updated weights for policy 1, policy_version 1771109 (0.0007) [2023-12-28 07:57:34,296][106225] Updated weights for policy 1, policy_version 1771119 (0.0009) [2023-12-28 07:57:34,349][106226] Updated weights for policy 0, policy_version 1766827 (0.0009) [2023-12-28 07:57:34,360][106225] Updated weights for policy 1, policy_version 1771129 (0.0008) [2023-12-28 07:57:34,405][106226] Updated weights for policy 0, policy_version 1766837 (0.0006) [2023-12-28 07:57:34,463][106226] Updated weights for policy 0, policy_version 1766847 (0.0008) [2023-12-28 07:57:35,050][106225] Updated weights for policy 1, policy_version 1771139 (0.0006) [2023-12-28 07:57:35,105][106225] Updated weights for policy 1, policy_version 1771149 (0.0005) [2023-12-28 07:57:35,164][106225] Updated weights for policy 1, policy_version 1771159 (0.0006) [2023-12-28 07:57:35,221][106226] Updated weights for policy 0, policy_version 1766857 (0.0009) [2023-12-28 07:57:35,274][106226] Updated weights for policy 0, policy_version 1766867 (0.0006) [2023-12-28 07:57:35,323][106226] Updated weights for policy 0, policy_version 1766877 (0.0008) [2023-12-28 07:57:35,375][106226] Updated weights for policy 0, policy_version 1766887 (0.0007) [2023-12-28 07:57:35,778][106225] Updated weights for policy 1, policy_version 1771169 (0.0006) [2023-12-28 07:57:35,838][106225] Updated weights for policy 1, policy_version 1771179 (0.0010) [2023-12-28 07:57:35,894][106225] Updated weights for policy 1, policy_version 1771189 (0.0009) [2023-12-28 07:57:35,944][106225] Updated weights for policy 1, policy_version 1771199 (0.0010) [2023-12-28 07:57:36,087][106226] Updated weights for policy 0, policy_version 1766897 (0.0008) [2023-12-28 07:57:36,152][106226] Updated weights for policy 0, policy_version 1766907 (0.0008) [2023-12-28 07:57:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 905887744. Throughput: 0: 10036.5, 1: 9904.8. Samples: 905899588. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:36,175][105115] Avg episode reward: [(0, '-4.210'), (1, '-4.931')] [2023-12-28 07:57:36,202][106226] Updated weights for policy 0, policy_version 1766917 (0.0006) [2023-12-28 07:57:36,681][106225] Updated weights for policy 1, policy_version 1771209 (0.0011) [2023-12-28 07:57:36,742][106225] Updated weights for policy 1, policy_version 1771219 (0.0010) [2023-12-28 07:57:36,801][106225] Updated weights for policy 1, policy_version 1771229 (0.0010) [2023-12-28 07:57:36,933][106226] Updated weights for policy 0, policy_version 1766927 (0.0007) [2023-12-28 07:57:37,005][106226] Updated weights for policy 0, policy_version 1766937 (0.0007) [2023-12-28 07:57:37,063][106226] Updated weights for policy 0, policy_version 1766947 (0.0011) [2023-12-28 07:57:37,462][106225] Updated weights for policy 1, policy_version 1771239 (0.0009) [2023-12-28 07:57:37,522][106225] Updated weights for policy 1, policy_version 1771249 (0.0008) [2023-12-28 07:57:37,585][106225] Updated weights for policy 1, policy_version 1771259 (0.0009) [2023-12-28 07:57:37,778][106226] Updated weights for policy 0, policy_version 1766957 (0.0009) [2023-12-28 07:57:37,846][106226] Updated weights for policy 0, policy_version 1766967 (0.0009) [2023-12-28 07:57:37,905][106226] Updated weights for policy 0, policy_version 1766977 (0.0008) [2023-12-28 07:57:38,247][106225] Updated weights for policy 1, policy_version 1771269 (0.0010) [2023-12-28 07:57:38,297][106225] Updated weights for policy 1, policy_version 1771279 (0.0010) [2023-12-28 07:57:38,368][106225] Updated weights for policy 1, policy_version 1771289 (0.0010) [2023-12-28 07:57:38,673][106226] Updated weights for policy 0, policy_version 1766987 (0.0006) [2023-12-28 07:57:38,737][106226] Updated weights for policy 0, policy_version 1766997 (0.0008) [2023-12-28 07:57:38,803][106226] Updated weights for policy 0, policy_version 1767007 (0.0008) [2023-12-28 07:57:39,020][106225] Updated weights for policy 1, policy_version 1771299 (0.0007) [2023-12-28 07:57:39,071][106225] Updated weights for policy 1, policy_version 1771309 (0.0010) [2023-12-28 07:57:39,122][106225] Updated weights for policy 1, policy_version 1771319 (0.0010) [2023-12-28 07:57:39,531][106226] Updated weights for policy 0, policy_version 1767017 (0.0008) [2023-12-28 07:57:39,588][106226] Updated weights for policy 0, policy_version 1767027 (0.0007) [2023-12-28 07:57:39,648][106226] Updated weights for policy 0, policy_version 1767037 (0.0006) [2023-12-28 07:57:39,703][106226] Updated weights for policy 0, policy_version 1767047 (0.0007) [2023-12-28 07:57:39,829][106225] Updated weights for policy 1, policy_version 1771329 (0.0010) [2023-12-28 07:57:39,895][106225] Updated weights for policy 1, policy_version 1771339 (0.0008) [2023-12-28 07:57:39,966][106225] Updated weights for policy 1, policy_version 1771349 (0.0009) [2023-12-28 07:57:40,030][106225] Updated weights for policy 1, policy_version 1771359 (0.0008) [2023-12-28 07:57:40,441][106226] Updated weights for policy 0, policy_version 1767057 (0.0006) [2023-12-28 07:57:40,496][106226] Updated weights for policy 0, policy_version 1767067 (0.0008) [2023-12-28 07:57:40,551][106226] Updated weights for policy 0, policy_version 1767077 (0.0009) [2023-12-28 07:57:40,749][106225] Updated weights for policy 1, policy_version 1771369 (0.0008) [2023-12-28 07:57:40,804][106225] Updated weights for policy 1, policy_version 1771379 (0.0009) [2023-12-28 07:57:40,859][106225] Updated weights for policy 1, policy_version 1771389 (0.0008) [2023-12-28 07:57:41,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 905986048. Throughput: 0: 10029.2, 1: 9955.7. Samples: 905957988. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:41,175][105115] Avg episode reward: [(0, '-4.246'), (1, '-4.808')] [2023-12-28 07:57:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001767080_452452352.pth... [2023-12-28 07:57:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001771392_453533696.pth... [2023-12-28 07:57:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001765928_452157440.pth [2023-12-28 07:57:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001770208_453230592.pth [2023-12-28 07:57:41,287][106226] Updated weights for policy 0, policy_version 1767087 (0.0008) [2023-12-28 07:57:41,355][106226] Updated weights for policy 0, policy_version 1767097 (0.0009) [2023-12-28 07:57:41,422][106226] Updated weights for policy 0, policy_version 1767107 (0.0009) [2023-12-28 07:57:41,719][106225] Updated weights for policy 1, policy_version 1771399 (0.0008) [2023-12-28 07:57:41,786][106225] Updated weights for policy 1, policy_version 1771409 (0.0008) [2023-12-28 07:57:41,851][106225] Updated weights for policy 1, policy_version 1771419 (0.0006) [2023-12-28 07:57:42,179][106226] Updated weights for policy 0, policy_version 1767117 (0.0008) [2023-12-28 07:57:42,235][106226] Updated weights for policy 0, policy_version 1767127 (0.0009) [2023-12-28 07:57:42,303][106226] Updated weights for policy 0, policy_version 1767137 (0.0010) [2023-12-28 07:57:42,559][106225] Updated weights for policy 1, policy_version 1771429 (0.0006) [2023-12-28 07:57:42,627][106225] Updated weights for policy 1, policy_version 1771439 (0.0009) [2023-12-28 07:57:42,690][106225] Updated weights for policy 1, policy_version 1771449 (0.0007) [2023-12-28 07:57:43,009][106226] Updated weights for policy 0, policy_version 1767147 (0.0008) [2023-12-28 07:57:43,068][106226] Updated weights for policy 0, policy_version 1767157 (0.0009) [2023-12-28 07:57:43,125][106226] Updated weights for policy 0, policy_version 1767167 (0.0009) [2023-12-28 07:57:43,351][106225] Updated weights for policy 1, policy_version 1771459 (0.0006) [2023-12-28 07:57:43,408][106225] Updated weights for policy 1, policy_version 1771469 (0.0005) [2023-12-28 07:57:43,456][106225] Updated weights for policy 1, policy_version 1771479 (0.0005) [2023-12-28 07:57:43,904][106226] Updated weights for policy 0, policy_version 1767177 (0.0009) [2023-12-28 07:57:43,959][106226] Updated weights for policy 0, policy_version 1767187 (0.0008) [2023-12-28 07:57:44,011][106226] Updated weights for policy 0, policy_version 1767197 (0.0009) [2023-12-28 07:57:44,043][106225] Updated weights for policy 1, policy_version 1771489 (0.0005) [2023-12-28 07:57:44,065][106226] Updated weights for policy 0, policy_version 1767207 (0.0007) [2023-12-28 07:57:44,092][106225] Updated weights for policy 1, policy_version 1771499 (0.0007) [2023-12-28 07:57:44,142][106225] Updated weights for policy 1, policy_version 1771509 (0.0009) [2023-12-28 07:57:44,198][106225] Updated weights for policy 1, policy_version 1771519 (0.0008) [2023-12-28 07:57:44,852][106225] Updated weights for policy 1, policy_version 1771529 (0.0008) [2023-12-28 07:57:44,858][106226] Updated weights for policy 0, policy_version 1767217 (0.0006) [2023-12-28 07:57:44,912][106225] Updated weights for policy 1, policy_version 1771539 (0.0007) [2023-12-28 07:57:44,918][106226] Updated weights for policy 0, policy_version 1767227 (0.0007) [2023-12-28 07:57:44,973][106225] Updated weights for policy 1, policy_version 1771549 (0.0007) [2023-12-28 07:57:44,984][106226] Updated weights for policy 0, policy_version 1767237 (0.0007) [2023-12-28 07:57:45,632][106225] Updated weights for policy 1, policy_version 1771559 (0.0007) [2023-12-28 07:57:45,686][106225] Updated weights for policy 1, policy_version 1771569 (0.0009) [2023-12-28 07:57:45,721][106226] Updated weights for policy 0, policy_version 1767247 (0.0007) [2023-12-28 07:57:45,744][106225] Updated weights for policy 1, policy_version 1771579 (0.0007) [2023-12-28 07:57:45,776][106226] Updated weights for policy 0, policy_version 1767257 (0.0007) [2023-12-28 07:57:45,829][106226] Updated weights for policy 0, policy_version 1767267 (0.0008) [2023-12-28 07:57:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 906084352. Throughput: 0: 9862.7, 1: 9954.7. Samples: 906072916. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:46,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.561')] [2023-12-28 07:57:46,448][106225] Updated weights for policy 1, policy_version 1771589 (0.0007) [2023-12-28 07:57:46,507][106225] Updated weights for policy 1, policy_version 1771599 (0.0008) [2023-12-28 07:57:46,519][106226] Updated weights for policy 0, policy_version 1767277 (0.0007) [2023-12-28 07:57:46,557][106225] Updated weights for policy 1, policy_version 1771609 (0.0008) [2023-12-28 07:57:46,579][106226] Updated weights for policy 0, policy_version 1767287 (0.0005) [2023-12-28 07:57:46,639][106226] Updated weights for policy 0, policy_version 1767297 (0.0007) [2023-12-28 07:57:47,265][106225] Updated weights for policy 1, policy_version 1771619 (0.0007) [2023-12-28 07:57:47,291][106226] Updated weights for policy 0, policy_version 1767307 (0.0009) [2023-12-28 07:57:47,319][106225] Updated weights for policy 1, policy_version 1771629 (0.0006) [2023-12-28 07:57:47,340][106226] Updated weights for policy 0, policy_version 1767317 (0.0010) [2023-12-28 07:57:47,367][106225] Updated weights for policy 1, policy_version 1771639 (0.0005) [2023-12-28 07:57:47,398][106226] Updated weights for policy 0, policy_version 1767327 (0.0010) [2023-12-28 07:57:48,013][106225] Updated weights for policy 1, policy_version 1771649 (0.0006) [2023-12-28 07:57:48,064][106226] Updated weights for policy 0, policy_version 1767337 (0.0010) [2023-12-28 07:57:48,077][106225] Updated weights for policy 1, policy_version 1771659 (0.0008) [2023-12-28 07:57:48,116][106226] Updated weights for policy 0, policy_version 1767347 (0.0007) [2023-12-28 07:57:48,130][106225] Updated weights for policy 1, policy_version 1771669 (0.0008) [2023-12-28 07:57:48,172][106226] Updated weights for policy 0, policy_version 1767357 (0.0010) [2023-12-28 07:57:48,178][106225] Updated weights for policy 1, policy_version 1771679 (0.0006) [2023-12-28 07:57:48,226][106226] Updated weights for policy 0, policy_version 1767367 (0.0010) [2023-12-28 07:57:48,920][106226] Updated weights for policy 0, policy_version 1767377 (0.0009) [2023-12-28 07:57:48,923][106225] Updated weights for policy 1, policy_version 1771689 (0.0006) [2023-12-28 07:57:48,975][106226] Updated weights for policy 0, policy_version 1767387 (0.0005) [2023-12-28 07:57:48,980][106225] Updated weights for policy 1, policy_version 1771699 (0.0007) [2023-12-28 07:57:49,032][106226] Updated weights for policy 0, policy_version 1767397 (0.0007) [2023-12-28 07:57:49,038][106225] Updated weights for policy 1, policy_version 1771709 (0.0006) [2023-12-28 07:57:49,711][106226] Updated weights for policy 0, policy_version 1767407 (0.0008) [2023-12-28 07:57:49,771][106226] Updated weights for policy 0, policy_version 1767417 (0.0005) [2023-12-28 07:57:49,797][106225] Updated weights for policy 1, policy_version 1771719 (0.0008) [2023-12-28 07:57:49,837][106226] Updated weights for policy 0, policy_version 1767427 (0.0006) [2023-12-28 07:57:49,863][106225] Updated weights for policy 1, policy_version 1771729 (0.0008) [2023-12-28 07:57:49,934][106225] Updated weights for policy 1, policy_version 1771739 (0.0009) [2023-12-28 07:57:50,572][106226] Updated weights for policy 0, policy_version 1767437 (0.0007) [2023-12-28 07:57:50,635][106226] Updated weights for policy 0, policy_version 1767447 (0.0010) [2023-12-28 07:57:50,677][106225] Updated weights for policy 1, policy_version 1771749 (0.0010) [2023-12-28 07:57:50,698][106226] Updated weights for policy 0, policy_version 1767457 (0.0008) [2023-12-28 07:57:50,739][106225] Updated weights for policy 1, policy_version 1771759 (0.0010) [2023-12-28 07:57:50,800][106225] Updated weights for policy 1, policy_version 1771769 (0.0010) [2023-12-28 07:57:51,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 906182656. Throughput: 0: 9881.3, 1: 9960.6. Samples: 906191880. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:51,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.993')] [2023-12-28 07:57:51,449][106226] Updated weights for policy 0, policy_version 1767467 (0.0006) [2023-12-28 07:57:51,504][106226] Updated weights for policy 0, policy_version 1767477 (0.0008) [2023-12-28 07:57:51,534][106225] Updated weights for policy 1, policy_version 1771779 (0.0010) [2023-12-28 07:57:51,563][106226] Updated weights for policy 0, policy_version 1767487 (0.0007) [2023-12-28 07:57:51,592][106225] Updated weights for policy 1, policy_version 1771789 (0.0010) [2023-12-28 07:57:51,661][106225] Updated weights for policy 1, policy_version 1771799 (0.0011) [2023-12-28 07:57:52,240][106226] Updated weights for policy 0, policy_version 1767497 (0.0006) [2023-12-28 07:57:52,303][106226] Updated weights for policy 0, policy_version 1767507 (0.0007) [2023-12-28 07:57:52,353][106225] Updated weights for policy 1, policy_version 1771809 (0.0010) [2023-12-28 07:57:52,371][106226] Updated weights for policy 0, policy_version 1767517 (0.0007) [2023-12-28 07:57:52,412][106225] Updated weights for policy 1, policy_version 1771819 (0.0009) [2023-12-28 07:57:52,440][106226] Updated weights for policy 0, policy_version 1767527 (0.0008) [2023-12-28 07:57:52,462][106225] Updated weights for policy 1, policy_version 1771829 (0.0005) [2023-12-28 07:57:52,515][106225] Updated weights for policy 1, policy_version 1771839 (0.0005) [2023-12-28 07:57:53,109][106226] Updated weights for policy 0, policy_version 1767537 (0.0009) [2023-12-28 07:57:53,166][106226] Updated weights for policy 0, policy_version 1767547 (0.0007) [2023-12-28 07:57:53,191][106225] Updated weights for policy 1, policy_version 1771849 (0.0006) [2023-12-28 07:57:53,221][106226] Updated weights for policy 0, policy_version 1767557 (0.0007) [2023-12-28 07:57:53,248][106225] Updated weights for policy 1, policy_version 1771859 (0.0007) [2023-12-28 07:57:53,300][106225] Updated weights for policy 1, policy_version 1771869 (0.0008) [2023-12-28 07:57:53,866][106226] Updated weights for policy 0, policy_version 1767567 (0.0008) [2023-12-28 07:57:53,928][106226] Updated weights for policy 0, policy_version 1767577 (0.0008) [2023-12-28 07:57:53,987][106226] Updated weights for policy 0, policy_version 1767587 (0.0009) [2023-12-28 07:57:54,032][106225] Updated weights for policy 1, policy_version 1771879 (0.0008) [2023-12-28 07:57:54,076][106225] Updated weights for policy 1, policy_version 1771889 (0.0008) [2023-12-28 07:57:54,130][106225] Updated weights for policy 1, policy_version 1771899 (0.0009) [2023-12-28 07:57:54,653][106226] Updated weights for policy 0, policy_version 1767597 (0.0009) [2023-12-28 07:57:54,699][106226] Updated weights for policy 0, policy_version 1767607 (0.0010) [2023-12-28 07:57:54,746][106226] Updated weights for policy 0, policy_version 1767617 (0.0007) [2023-12-28 07:57:54,870][106225] Updated weights for policy 1, policy_version 1771909 (0.0008) [2023-12-28 07:57:54,933][106225] Updated weights for policy 1, policy_version 1771919 (0.0009) [2023-12-28 07:57:54,989][106225] Updated weights for policy 1, policy_version 1771929 (0.0007) [2023-12-28 07:57:55,469][106226] Updated weights for policy 0, policy_version 1767627 (0.0007) [2023-12-28 07:57:55,521][106226] Updated weights for policy 0, policy_version 1767637 (0.0009) [2023-12-28 07:57:55,575][106226] Updated weights for policy 0, policy_version 1767647 (0.0008) [2023-12-28 07:57:55,686][106225] Updated weights for policy 1, policy_version 1771939 (0.0009) [2023-12-28 07:57:55,749][106225] Updated weights for policy 1, policy_version 1771949 (0.0009) [2023-12-28 07:57:55,805][106225] Updated weights for policy 1, policy_version 1771959 (0.0008) [2023-12-28 07:57:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 906280960. Throughput: 0: 9855.9, 1: 9999.5. Samples: 906250576. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:57:56,175][105115] Avg episode reward: [(0, '-4.472'), (1, '-5.128')] [2023-12-28 07:57:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001771968_453681152.pth... [2023-12-28 07:57:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001767656_452599808.pth... [2023-12-28 07:57:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001766504_452304896.pth [2023-12-28 07:57:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001770784_453378048.pth [2023-12-28 07:57:56,336][106226] Updated weights for policy 0, policy_version 1767657 (0.0009) [2023-12-28 07:57:56,395][106226] Updated weights for policy 0, policy_version 1767667 (0.0005) [2023-12-28 07:57:56,456][106226] Updated weights for policy 0, policy_version 1767677 (0.0007) [2023-12-28 07:57:56,507][106226] Updated weights for policy 0, policy_version 1767687 (0.0008) [2023-12-28 07:57:56,536][106225] Updated weights for policy 1, policy_version 1771969 (0.0009) [2023-12-28 07:57:56,594][106225] Updated weights for policy 1, policy_version 1771979 (0.0008) [2023-12-28 07:57:56,662][106225] Updated weights for policy 1, policy_version 1771989 (0.0010) [2023-12-28 07:57:56,720][106225] Updated weights for policy 1, policy_version 1771999 (0.0010) [2023-12-28 07:57:57,116][106226] Updated weights for policy 0, policy_version 1767697 (0.0008) [2023-12-28 07:57:57,183][106226] Updated weights for policy 0, policy_version 1767707 (0.0007) [2023-12-28 07:57:57,245][106226] Updated weights for policy 0, policy_version 1767717 (0.0008) [2023-12-28 07:57:57,375][106225] Updated weights for policy 1, policy_version 1772009 (0.0005) [2023-12-28 07:57:57,419][106225] Updated weights for policy 1, policy_version 1772019 (0.0005) [2023-12-28 07:57:57,462][106225] Updated weights for policy 1, policy_version 1772029 (0.0005) [2023-12-28 07:57:58,007][106226] Updated weights for policy 0, policy_version 1767727 (0.0006) [2023-12-28 07:57:58,056][106226] Updated weights for policy 0, policy_version 1767737 (0.0007) [2023-12-28 07:57:58,081][106225] Updated weights for policy 1, policy_version 1772039 (0.0008) [2023-12-28 07:57:58,110][106226] Updated weights for policy 0, policy_version 1767747 (0.0006) [2023-12-28 07:57:58,133][106225] Updated weights for policy 1, policy_version 1772049 (0.0006) [2023-12-28 07:57:58,199][106225] Updated weights for policy 1, policy_version 1772059 (0.0005) [2023-12-28 07:57:58,982][106226] Updated weights for policy 0, policy_version 1767757 (0.0008) [2023-12-28 07:57:59,017][106225] Updated weights for policy 1, policy_version 1772069 (0.0010) [2023-12-28 07:57:59,046][106226] Updated weights for policy 0, policy_version 1767767 (0.0007) [2023-12-28 07:57:59,075][106225] Updated weights for policy 1, policy_version 1772079 (0.0010) [2023-12-28 07:57:59,104][106226] Updated weights for policy 0, policy_version 1767777 (0.0006) [2023-12-28 07:57:59,132][106225] Updated weights for policy 1, policy_version 1772089 (0.0010) [2023-12-28 07:57:59,885][106226] Updated weights for policy 0, policy_version 1767787 (0.0005) [2023-12-28 07:57:59,890][106225] Updated weights for policy 1, policy_version 1772099 (0.0010) [2023-12-28 07:57:59,948][106225] Updated weights for policy 1, policy_version 1772109 (0.0008) [2023-12-28 07:57:59,958][106226] Updated weights for policy 0, policy_version 1767797 (0.0007) [2023-12-28 07:58:00,010][106225] Updated weights for policy 1, policy_version 1772119 (0.0006) [2023-12-28 07:58:00,014][106226] Updated weights for policy 0, policy_version 1767807 (0.0008) [2023-12-28 07:58:00,595][106225] Updated weights for policy 1, policy_version 1772129 (0.0006) [2023-12-28 07:58:00,655][106225] Updated weights for policy 1, policy_version 1772139 (0.0009) [2023-12-28 07:58:00,710][106225] Updated weights for policy 1, policy_version 1772149 (0.0008) [2023-12-28 07:58:00,767][106225] Updated weights for policy 1, policy_version 1772159 (0.0009) [2023-12-28 07:58:00,782][106226] Updated weights for policy 0, policy_version 1767817 (0.0008) [2023-12-28 07:58:00,843][106226] Updated weights for policy 0, policy_version 1767827 (0.0008) [2023-12-28 07:58:00,894][106226] Updated weights for policy 0, policy_version 1767837 (0.0008) [2023-12-28 07:58:00,947][106226] Updated weights for policy 0, policy_version 1767847 (0.0008) [2023-12-28 07:58:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 906379264. Throughput: 0: 9822.6, 1: 10001.0. Samples: 906366240. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:01,175][105115] Avg episode reward: [(0, '-4.596'), (1, '-4.736')] [2023-12-28 07:58:01,496][106225] Updated weights for policy 1, policy_version 1772169 (0.0010) [2023-12-28 07:58:01,550][106225] Updated weights for policy 1, policy_version 1772179 (0.0010) [2023-12-28 07:58:01,610][106225] Updated weights for policy 1, policy_version 1772189 (0.0010) [2023-12-28 07:58:01,722][106226] Updated weights for policy 0, policy_version 1767857 (0.0008) [2023-12-28 07:58:01,789][106226] Updated weights for policy 0, policy_version 1767867 (0.0008) [2023-12-28 07:58:01,849][106226] Updated weights for policy 0, policy_version 1767877 (0.0008) [2023-12-28 07:58:02,278][106225] Updated weights for policy 1, policy_version 1772199 (0.0009) [2023-12-28 07:58:02,338][106225] Updated weights for policy 1, policy_version 1772209 (0.0006) [2023-12-28 07:58:02,400][106225] Updated weights for policy 1, policy_version 1772219 (0.0012) [2023-12-28 07:58:02,631][106226] Updated weights for policy 0, policy_version 1767887 (0.0008) [2023-12-28 07:58:02,691][106226] Updated weights for policy 0, policy_version 1767897 (0.0008) [2023-12-28 07:58:02,758][106226] Updated weights for policy 0, policy_version 1767907 (0.0008) [2023-12-28 07:58:03,021][106225] Updated weights for policy 1, policy_version 1772229 (0.0010) [2023-12-28 07:58:03,080][106225] Updated weights for policy 1, policy_version 1772239 (0.0010) [2023-12-28 07:58:03,139][106225] Updated weights for policy 1, policy_version 1772249 (0.0010) [2023-12-28 07:58:03,465][106226] Updated weights for policy 0, policy_version 1767917 (0.0008) [2023-12-28 07:58:03,530][106226] Updated weights for policy 0, policy_version 1767927 (0.0008) [2023-12-28 07:58:03,582][106226] Updated weights for policy 0, policy_version 1767937 (0.0008) [2023-12-28 07:58:03,655][106225] Updated weights for policy 1, policy_version 1772259 (0.0006) [2023-12-28 07:58:03,707][106225] Updated weights for policy 1, policy_version 1772269 (0.0005) [2023-12-28 07:58:03,767][106225] Updated weights for policy 1, policy_version 1772279 (0.0005) [2023-12-28 07:58:04,366][106226] Updated weights for policy 0, policy_version 1767947 (0.0009) [2023-12-28 07:58:04,430][106226] Updated weights for policy 0, policy_version 1767957 (0.0007) [2023-12-28 07:58:04,452][106225] Updated weights for policy 1, policy_version 1772289 (0.0006) [2023-12-28 07:58:04,490][106226] Updated weights for policy 0, policy_version 1767967 (0.0008) [2023-12-28 07:58:04,508][106225] Updated weights for policy 1, policy_version 1772299 (0.0010) [2023-12-28 07:58:04,565][106225] Updated weights for policy 1, policy_version 1772309 (0.0010) [2023-12-28 07:58:04,625][106225] Updated weights for policy 1, policy_version 1772319 (0.0010) [2023-12-28 07:58:05,206][106226] Updated weights for policy 0, policy_version 1767977 (0.0007) [2023-12-28 07:58:05,251][106226] Updated weights for policy 0, policy_version 1767987 (0.0007) [2023-12-28 07:58:05,301][106226] Updated weights for policy 0, policy_version 1767997 (0.0007) [2023-12-28 07:58:05,336][106225] Updated weights for policy 1, policy_version 1772329 (0.0010) [2023-12-28 07:58:05,361][106226] Updated weights for policy 0, policy_version 1768007 (0.0005) [2023-12-28 07:58:05,392][106225] Updated weights for policy 1, policy_version 1772339 (0.0010) [2023-12-28 07:58:05,449][106225] Updated weights for policy 1, policy_version 1772349 (0.0010) [2023-12-28 07:58:06,094][106226] Updated weights for policy 0, policy_version 1768017 (0.0007) [2023-12-28 07:58:06,164][106226] Updated weights for policy 0, policy_version 1768027 (0.0008) [2023-12-28 07:58:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 906469376. Throughput: 0: 9758.0, 1: 10111.7. Samples: 906485344. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:06,175][105115] Avg episode reward: [(0, '-4.205'), (1, '-4.689')] [2023-12-28 07:58:06,193][106225] Updated weights for policy 1, policy_version 1772359 (0.0009) [2023-12-28 07:58:06,233][106226] Updated weights for policy 0, policy_version 1768037 (0.0008) [2023-12-28 07:58:06,258][106225] Updated weights for policy 1, policy_version 1772369 (0.0007) [2023-12-28 07:58:06,326][106225] Updated weights for policy 1, policy_version 1772379 (0.0008) [2023-12-28 07:58:07,000][106226] Updated weights for policy 0, policy_version 1768047 (0.0008) [2023-12-28 07:58:07,052][106225] Updated weights for policy 1, policy_version 1772389 (0.0011) [2023-12-28 07:58:07,066][106226] Updated weights for policy 0, policy_version 1768057 (0.0006) [2023-12-28 07:58:07,110][106225] Updated weights for policy 1, policy_version 1772399 (0.0010) [2023-12-28 07:58:07,128][106226] Updated weights for policy 0, policy_version 1768067 (0.0006) [2023-12-28 07:58:07,166][106225] Updated weights for policy 1, policy_version 1772409 (0.0011) [2023-12-28 07:58:07,848][106226] Updated weights for policy 0, policy_version 1768077 (0.0007) [2023-12-28 07:58:07,889][106225] Updated weights for policy 1, policy_version 1772419 (0.0010) [2023-12-28 07:58:07,913][106226] Updated weights for policy 0, policy_version 1768087 (0.0007) [2023-12-28 07:58:07,951][106225] Updated weights for policy 1, policy_version 1772429 (0.0007) [2023-12-28 07:58:07,975][106226] Updated weights for policy 0, policy_version 1768097 (0.0006) [2023-12-28 07:58:08,005][106225] Updated weights for policy 1, policy_version 1772439 (0.0008) [2023-12-28 07:58:08,653][106225] Updated weights for policy 1, policy_version 1772449 (0.0007) [2023-12-28 07:58:08,709][106225] Updated weights for policy 1, policy_version 1772459 (0.0008) [2023-12-28 07:58:08,760][106226] Updated weights for policy 0, policy_version 1768107 (0.0008) [2023-12-28 07:58:08,767][106225] Updated weights for policy 1, policy_version 1772469 (0.0007) [2023-12-28 07:58:08,819][106226] Updated weights for policy 0, policy_version 1768117 (0.0007) [2023-12-28 07:58:08,821][106225] Updated weights for policy 1, policy_version 1772479 (0.0005) [2023-12-28 07:58:08,877][106226] Updated weights for policy 0, policy_version 1768127 (0.0008) [2023-12-28 07:58:09,596][106225] Updated weights for policy 1, policy_version 1772489 (0.0009) [2023-12-28 07:58:09,629][106226] Updated weights for policy 0, policy_version 1768137 (0.0008) [2023-12-28 07:58:09,662][106225] Updated weights for policy 1, policy_version 1772499 (0.0008) [2023-12-28 07:58:09,692][106226] Updated weights for policy 0, policy_version 1768147 (0.0006) [2023-12-28 07:58:09,722][106225] Updated weights for policy 1, policy_version 1772509 (0.0007) [2023-12-28 07:58:09,757][106226] Updated weights for policy 0, policy_version 1768157 (0.0007) [2023-12-28 07:58:09,824][106226] Updated weights for policy 0, policy_version 1768167 (0.0009) [2023-12-28 07:58:10,450][106225] Updated weights for policy 1, policy_version 1772519 (0.0006) [2023-12-28 07:58:10,515][106225] Updated weights for policy 1, policy_version 1772529 (0.0008) [2023-12-28 07:58:10,542][106226] Updated weights for policy 0, policy_version 1768177 (0.0006) [2023-12-28 07:58:10,574][106225] Updated weights for policy 1, policy_version 1772539 (0.0007) [2023-12-28 07:58:10,603][106226] Updated weights for policy 0, policy_version 1768187 (0.0007) [2023-12-28 07:58:10,670][106226] Updated weights for policy 0, policy_version 1768197 (0.0008) [2023-12-28 07:58:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 906567680. Throughput: 0: 9712.4, 1: 10117.3. Samples: 906541880. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:11,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.560')] [2023-12-28 07:58:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001768200_452739072.pth... [2023-12-28 07:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001772544_453828608.pth... [2023-12-28 07:58:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001767080_452452352.pth [2023-12-28 07:58:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001771392_453533696.pth [2023-12-28 07:58:11,279][106225] Updated weights for policy 1, policy_version 1772549 (0.0007) [2023-12-28 07:58:11,342][106225] Updated weights for policy 1, policy_version 1772559 (0.0007) [2023-12-28 07:58:11,388][106226] Updated weights for policy 0, policy_version 1768207 (0.0008) [2023-12-28 07:58:11,415][106225] Updated weights for policy 1, policy_version 1772569 (0.0007) [2023-12-28 07:58:11,446][106226] Updated weights for policy 0, policy_version 1768217 (0.0008) [2023-12-28 07:58:11,509][106226] Updated weights for policy 0, policy_version 1768227 (0.0008) [2023-12-28 07:58:12,159][106225] Updated weights for policy 1, policy_version 1772579 (0.0008) [2023-12-28 07:58:12,212][106225] Updated weights for policy 1, policy_version 1772589 (0.0008) [2023-12-28 07:58:12,274][106225] Updated weights for policy 1, policy_version 1772599 (0.0008) [2023-12-28 07:58:12,281][106226] Updated weights for policy 0, policy_version 1768237 (0.0009) [2023-12-28 07:58:12,347][106226] Updated weights for policy 0, policy_version 1768247 (0.0010) [2023-12-28 07:58:12,413][106226] Updated weights for policy 0, policy_version 1768257 (0.0011) [2023-12-28 07:58:12,990][106225] Updated weights for policy 1, policy_version 1772609 (0.0009) [2023-12-28 07:58:13,050][106225] Updated weights for policy 1, policy_version 1772619 (0.0008) [2023-12-28 07:58:13,112][106225] Updated weights for policy 1, policy_version 1772629 (0.0008) [2023-12-28 07:58:13,147][106226] Updated weights for policy 0, policy_version 1768267 (0.0010) [2023-12-28 07:58:13,190][106225] Updated weights for policy 1, policy_version 1772639 (0.0009) [2023-12-28 07:58:13,211][106226] Updated weights for policy 0, policy_version 1768277 (0.0008) [2023-12-28 07:58:13,264][106226] Updated weights for policy 0, policy_version 1768287 (0.0009) [2023-12-28 07:58:13,797][106225] Updated weights for policy 1, policy_version 1772649 (0.0008) [2023-12-28 07:58:13,853][106225] Updated weights for policy 1, policy_version 1772659 (0.0008) [2023-12-28 07:58:13,907][106225] Updated weights for policy 1, policy_version 1772669 (0.0008) [2023-12-28 07:58:13,911][106226] Updated weights for policy 0, policy_version 1768297 (0.0008) [2023-12-28 07:58:13,968][106226] Updated weights for policy 0, policy_version 1768307 (0.0008) [2023-12-28 07:58:14,034][106226] Updated weights for policy 0, policy_version 1768317 (0.0008) [2023-12-28 07:58:14,094][106226] Updated weights for policy 0, policy_version 1768327 (0.0006) [2023-12-28 07:58:14,526][106225] Updated weights for policy 1, policy_version 1772679 (0.0007) [2023-12-28 07:58:14,580][106225] Updated weights for policy 1, policy_version 1772689 (0.0005) [2023-12-28 07:58:14,644][106225] Updated weights for policy 1, policy_version 1772699 (0.0006) [2023-12-28 07:58:14,783][106226] Updated weights for policy 0, policy_version 1768337 (0.0007) [2023-12-28 07:58:14,854][106226] Updated weights for policy 0, policy_version 1768347 (0.0009) [2023-12-28 07:58:14,919][106226] Updated weights for policy 0, policy_version 1768357 (0.0009) [2023-12-28 07:58:15,351][106225] Updated weights for policy 1, policy_version 1772709 (0.0007) [2023-12-28 07:58:15,413][106225] Updated weights for policy 1, policy_version 1772719 (0.0008) [2023-12-28 07:58:15,469][106225] Updated weights for policy 1, policy_version 1772729 (0.0007) [2023-12-28 07:58:15,574][106226] Updated weights for policy 0, policy_version 1768367 (0.0010) [2023-12-28 07:58:15,633][106226] Updated weights for policy 0, policy_version 1768377 (0.0009) [2023-12-28 07:58:15,692][106226] Updated weights for policy 0, policy_version 1768387 (0.0008) [2023-12-28 07:58:16,135][106225] Updated weights for policy 1, policy_version 1772739 (0.0008) [2023-12-28 07:58:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 906665984. Throughput: 0: 9609.4, 1: 10034.7. Samples: 906658676. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:16,175][105115] Avg episode reward: [(0, '-4.317'), (1, '-4.793')] [2023-12-28 07:58:16,202][106225] Updated weights for policy 1, policy_version 1772749 (0.0005) [2023-12-28 07:58:16,269][106225] Updated weights for policy 1, policy_version 1772759 (0.0005) [2023-12-28 07:58:16,495][106226] Updated weights for policy 0, policy_version 1768397 (0.0010) [2023-12-28 07:58:16,561][106226] Updated weights for policy 0, policy_version 1768407 (0.0010) [2023-12-28 07:58:16,615][106226] Updated weights for policy 0, policy_version 1768417 (0.0009) [2023-12-28 07:58:16,783][106225] Updated weights for policy 1, policy_version 1772769 (0.0006) [2023-12-28 07:58:16,849][106225] Updated weights for policy 1, policy_version 1772779 (0.0008) [2023-12-28 07:58:16,915][106225] Updated weights for policy 1, policy_version 1772789 (0.0008) [2023-12-28 07:58:16,971][106225] Updated weights for policy 1, policy_version 1772799 (0.0008) [2023-12-28 07:58:17,301][106226] Updated weights for policy 0, policy_version 1768427 (0.0008) [2023-12-28 07:58:17,369][106226] Updated weights for policy 0, policy_version 1768437 (0.0009) [2023-12-28 07:58:17,431][106226] Updated weights for policy 0, policy_version 1768447 (0.0009) [2023-12-28 07:58:17,703][106225] Updated weights for policy 1, policy_version 1772809 (0.0009) [2023-12-28 07:58:17,753][106225] Updated weights for policy 1, policy_version 1772819 (0.0005) [2023-12-28 07:58:17,799][106225] Updated weights for policy 1, policy_version 1772829 (0.0005) [2023-12-28 07:58:18,149][106226] Updated weights for policy 0, policy_version 1768457 (0.0009) [2023-12-28 07:58:18,212][106226] Updated weights for policy 0, policy_version 1768467 (0.0010) [2023-12-28 07:58:18,268][106226] Updated weights for policy 0, policy_version 1768477 (0.0010) [2023-12-28 07:58:18,321][106226] Updated weights for policy 0, policy_version 1768487 (0.0010) [2023-12-28 07:58:18,409][106225] Updated weights for policy 1, policy_version 1772839 (0.0007) [2023-12-28 07:58:18,465][106225] Updated weights for policy 1, policy_version 1772849 (0.0008) [2023-12-28 07:58:18,523][106225] Updated weights for policy 1, policy_version 1772859 (0.0008) [2023-12-28 07:58:18,998][106226] Updated weights for policy 0, policy_version 1768497 (0.0009) [2023-12-28 07:58:19,064][106226] Updated weights for policy 0, policy_version 1768507 (0.0008) [2023-12-28 07:58:19,125][106226] Updated weights for policy 0, policy_version 1768517 (0.0009) [2023-12-28 07:58:19,289][106225] Updated weights for policy 1, policy_version 1772869 (0.0009) [2023-12-28 07:58:19,350][106225] Updated weights for policy 1, policy_version 1772879 (0.0009) [2023-12-28 07:58:19,411][106225] Updated weights for policy 1, policy_version 1772889 (0.0007) [2023-12-28 07:58:19,867][106226] Updated weights for policy 0, policy_version 1768527 (0.0008) [2023-12-28 07:58:19,932][106226] Updated weights for policy 0, policy_version 1768537 (0.0010) [2023-12-28 07:58:19,997][106226] Updated weights for policy 0, policy_version 1768547 (0.0011) [2023-12-28 07:58:20,223][106225] Updated weights for policy 1, policy_version 1772899 (0.0008) [2023-12-28 07:58:20,283][106225] Updated weights for policy 1, policy_version 1772909 (0.0008) [2023-12-28 07:58:20,347][106225] Updated weights for policy 1, policy_version 1772919 (0.0008) [2023-12-28 07:58:20,689][106226] Updated weights for policy 0, policy_version 1768557 (0.0009) [2023-12-28 07:58:20,754][106226] Updated weights for policy 0, policy_version 1768567 (0.0006) [2023-12-28 07:58:20,819][106226] Updated weights for policy 0, policy_version 1768577 (0.0006) [2023-12-28 07:58:21,006][106225] Updated weights for policy 1, policy_version 1772929 (0.0006) [2023-12-28 07:58:21,074][106225] Updated weights for policy 1, policy_version 1772939 (0.0008) [2023-12-28 07:58:21,142][106225] Updated weights for policy 1, policy_version 1772949 (0.0007) [2023-12-28 07:58:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 906764288. Throughput: 0: 9552.7, 1: 9952.4. Samples: 906777320. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:21,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.741')] [2023-12-28 07:58:21,204][106225] Updated weights for policy 1, policy_version 1772959 (0.0006) [2023-12-28 07:58:21,457][106226] Updated weights for policy 0, policy_version 1768587 (0.0006) [2023-12-28 07:58:21,522][106226] Updated weights for policy 0, policy_version 1768597 (0.0008) [2023-12-28 07:58:21,583][106226] Updated weights for policy 0, policy_version 1768607 (0.0010) [2023-12-28 07:58:21,875][106225] Updated weights for policy 1, policy_version 1772969 (0.0008) [2023-12-28 07:58:21,941][106225] Updated weights for policy 1, policy_version 1772979 (0.0008) [2023-12-28 07:58:22,008][106225] Updated weights for policy 1, policy_version 1772989 (0.0008) [2023-12-28 07:58:22,325][106226] Updated weights for policy 0, policy_version 1768617 (0.0010) [2023-12-28 07:58:22,396][106226] Updated weights for policy 0, policy_version 1768627 (0.0010) [2023-12-28 07:58:22,464][106226] Updated weights for policy 0, policy_version 1768637 (0.0011) [2023-12-28 07:58:22,527][106226] Updated weights for policy 0, policy_version 1768647 (0.0008) [2023-12-28 07:58:22,745][106225] Updated weights for policy 1, policy_version 1772999 (0.0008) [2023-12-28 07:58:22,811][106225] Updated weights for policy 1, policy_version 1773009 (0.0008) [2023-12-28 07:58:22,874][106225] Updated weights for policy 1, policy_version 1773019 (0.0008) [2023-12-28 07:58:23,223][106226] Updated weights for policy 0, policy_version 1768657 (0.0010) [2023-12-28 07:58:23,278][106226] Updated weights for policy 0, policy_version 1768667 (0.0011) [2023-12-28 07:58:23,327][106226] Updated weights for policy 0, policy_version 1768677 (0.0010) [2023-12-28 07:58:23,564][106225] Updated weights for policy 1, policy_version 1773029 (0.0008) [2023-12-28 07:58:23,614][106225] Updated weights for policy 1, policy_version 1773039 (0.0007) [2023-12-28 07:58:23,657][106225] Updated weights for policy 1, policy_version 1773049 (0.0007) [2023-12-28 07:58:23,988][106226] Updated weights for policy 0, policy_version 1768687 (0.0009) [2023-12-28 07:58:24,037][106226] Updated weights for policy 0, policy_version 1768697 (0.0007) [2023-12-28 07:58:24,081][106226] Updated weights for policy 0, policy_version 1768707 (0.0007) [2023-12-28 07:58:24,429][106225] Updated weights for policy 1, policy_version 1773059 (0.0008) [2023-12-28 07:58:24,489][106225] Updated weights for policy 1, policy_version 1773069 (0.0010) [2023-12-28 07:58:24,550][106225] Updated weights for policy 1, policy_version 1773079 (0.0010) [2023-12-28 07:58:24,875][106226] Updated weights for policy 0, policy_version 1768717 (0.0008) [2023-12-28 07:58:24,930][106226] Updated weights for policy 0, policy_version 1768727 (0.0008) [2023-12-28 07:58:24,978][106226] Updated weights for policy 0, policy_version 1768737 (0.0008) [2023-12-28 07:58:25,200][106225] Updated weights for policy 1, policy_version 1773089 (0.0010) [2023-12-28 07:58:25,264][106225] Updated weights for policy 1, policy_version 1773099 (0.0008) [2023-12-28 07:58:25,326][106225] Updated weights for policy 1, policy_version 1773109 (0.0009) [2023-12-28 07:58:25,396][106225] Updated weights for policy 1, policy_version 1773119 (0.0009) [2023-12-28 07:58:25,639][106226] Updated weights for policy 0, policy_version 1768747 (0.0007) [2023-12-28 07:58:25,690][106226] Updated weights for policy 0, policy_version 1768757 (0.0008) [2023-12-28 07:58:25,742][106226] Updated weights for policy 0, policy_version 1768767 (0.0008) [2023-12-28 07:58:26,019][106225] Updated weights for policy 1, policy_version 1773129 (0.0008) [2023-12-28 07:58:26,076][106225] Updated weights for policy 1, policy_version 1773139 (0.0008) [2023-12-28 07:58:26,124][106225] Updated weights for policy 1, policy_version 1773149 (0.0007) [2023-12-28 07:58:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 906870784. Throughput: 0: 9575.3, 1: 9920.2. Samples: 906835284. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 07:58:26,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-5.059')] [2023-12-28 07:58:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001768776_452886528.pth... [2023-12-28 07:58:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001773152_453984256.pth... [2023-12-28 07:58:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001767656_452599808.pth [2023-12-28 07:58:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001771968_453681152.pth [2023-12-28 07:58:26,360][106226] Updated weights for policy 0, policy_version 1768777 (0.0006) [2023-12-28 07:58:26,414][106226] Updated weights for policy 0, policy_version 1768787 (0.0011) [2023-12-28 07:58:26,468][106226] Updated weights for policy 0, policy_version 1768797 (0.0010) [2023-12-28 07:58:26,525][106226] Updated weights for policy 0, policy_version 1768807 (0.0011) [2023-12-28 07:58:26,836][106225] Updated weights for policy 1, policy_version 1773159 (0.0009) [2023-12-28 07:58:26,897][106225] Updated weights for policy 1, policy_version 1773169 (0.0010) [2023-12-28 07:58:26,956][106225] Updated weights for policy 1, policy_version 1773179 (0.0010) [2023-12-28 07:58:27,221][106226] Updated weights for policy 0, policy_version 1768817 (0.0010) [2023-12-28 07:58:27,269][106226] Updated weights for policy 0, policy_version 1768827 (0.0009) [2023-12-28 07:58:27,333][106226] Updated weights for policy 0, policy_version 1768837 (0.0010) [2023-12-28 07:58:27,617][106225] Updated weights for policy 1, policy_version 1773189 (0.0007) [2023-12-28 07:58:27,674][106225] Updated weights for policy 1, policy_version 1773199 (0.0010) [2023-12-28 07:58:27,726][106225] Updated weights for policy 1, policy_version 1773209 (0.0010) [2023-12-28 07:58:27,991][106226] Updated weights for policy 0, policy_version 1768847 (0.0005) [2023-12-28 07:58:28,041][106226] Updated weights for policy 0, policy_version 1768857 (0.0006) [2023-12-28 07:58:28,098][106226] Updated weights for policy 0, policy_version 1768867 (0.0005) [2023-12-28 07:58:28,341][106225] Updated weights for policy 1, policy_version 1773219 (0.0008) [2023-12-28 07:58:28,403][106225] Updated weights for policy 1, policy_version 1773229 (0.0006) [2023-12-28 07:58:28,466][106225] Updated weights for policy 1, policy_version 1773239 (0.0008) [2023-12-28 07:58:28,742][106226] Updated weights for policy 0, policy_version 1768877 (0.0007) [2023-12-28 07:58:28,801][106226] Updated weights for policy 0, policy_version 1768887 (0.0007) [2023-12-28 07:58:28,858][106226] Updated weights for policy 0, policy_version 1768897 (0.0006) [2023-12-28 07:58:29,237][106225] Updated weights for policy 1, policy_version 1773249 (0.0008) [2023-12-28 07:58:29,308][106225] Updated weights for policy 1, policy_version 1773259 (0.0008) [2023-12-28 07:58:29,373][106225] Updated weights for policy 1, policy_version 1773269 (0.0008) [2023-12-28 07:58:29,433][106225] Updated weights for policy 1, policy_version 1773279 (0.0008) [2023-12-28 07:58:29,538][106226] Updated weights for policy 0, policy_version 1768907 (0.0007) [2023-12-28 07:58:29,607][106226] Updated weights for policy 0, policy_version 1768917 (0.0010) [2023-12-28 07:58:29,661][106226] Updated weights for policy 0, policy_version 1768927 (0.0009) [2023-12-28 07:58:30,098][106225] Updated weights for policy 1, policy_version 1773289 (0.0007) [2023-12-28 07:58:30,149][106225] Updated weights for policy 1, policy_version 1773299 (0.0008) [2023-12-28 07:58:30,197][106225] Updated weights for policy 1, policy_version 1773309 (0.0007) [2023-12-28 07:58:30,410][106226] Updated weights for policy 0, policy_version 1768937 (0.0009) [2023-12-28 07:58:30,468][106226] Updated weights for policy 0, policy_version 1768947 (0.0010) [2023-12-28 07:58:30,530][106226] Updated weights for policy 0, policy_version 1768957 (0.0009) [2023-12-28 07:58:30,586][106226] Updated weights for policy 0, policy_version 1768967 (0.0009) [2023-12-28 07:58:30,836][106225] Updated weights for policy 1, policy_version 1773319 (0.0009) [2023-12-28 07:58:30,902][106225] Updated weights for policy 1, policy_version 1773329 (0.0005) [2023-12-28 07:58:30,959][106225] Updated weights for policy 1, policy_version 1773339 (0.0005) [2023-12-28 07:58:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 906969088. Throughput: 0: 9721.6, 1: 9952.7. Samples: 906958260. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:31,175][105115] Avg episode reward: [(0, '-4.584'), (1, '-4.971')] [2023-12-28 07:58:31,374][106226] Updated weights for policy 0, policy_version 1768977 (0.0009) [2023-12-28 07:58:31,433][106226] Updated weights for policy 0, policy_version 1768987 (0.0009) [2023-12-28 07:58:31,494][106226] Updated weights for policy 0, policy_version 1768997 (0.0008) [2023-12-28 07:58:31,651][106225] Updated weights for policy 1, policy_version 1773349 (0.0008) [2023-12-28 07:58:31,713][106225] Updated weights for policy 1, policy_version 1773359 (0.0009) [2023-12-28 07:58:31,781][106225] Updated weights for policy 1, policy_version 1773369 (0.0009) [2023-12-28 07:58:32,231][106226] Updated weights for policy 0, policy_version 1769007 (0.0009) [2023-12-28 07:58:32,291][106226] Updated weights for policy 0, policy_version 1769017 (0.0007) [2023-12-28 07:58:32,339][106226] Updated weights for policy 0, policy_version 1769027 (0.0008) [2023-12-28 07:58:32,467][106225] Updated weights for policy 1, policy_version 1773379 (0.0008) [2023-12-28 07:58:32,524][106225] Updated weights for policy 1, policy_version 1773389 (0.0005) [2023-12-28 07:58:32,582][106225] Updated weights for policy 1, policy_version 1773399 (0.0005) [2023-12-28 07:58:33,101][106226] Updated weights for policy 0, policy_version 1769037 (0.0008) [2023-12-28 07:58:33,157][106226] Updated weights for policy 0, policy_version 1769047 (0.0007) [2023-12-28 07:58:33,219][106226] Updated weights for policy 0, policy_version 1769057 (0.0007) [2023-12-28 07:58:33,259][106225] Updated weights for policy 1, policy_version 1773409 (0.0007) [2023-12-28 07:58:33,313][106225] Updated weights for policy 1, policy_version 1773419 (0.0006) [2023-12-28 07:58:33,371][106225] Updated weights for policy 1, policy_version 1773429 (0.0010) [2023-12-28 07:58:33,433][106225] Updated weights for policy 1, policy_version 1773439 (0.0010) [2023-12-28 07:58:33,943][106226] Updated weights for policy 0, policy_version 1769067 (0.0008) [2023-12-28 07:58:34,009][106226] Updated weights for policy 0, policy_version 1769077 (0.0008) [2023-12-28 07:58:34,060][106225] Updated weights for policy 1, policy_version 1773449 (0.0010) [2023-12-28 07:58:34,061][106226] Updated weights for policy 0, policy_version 1769087 (0.0009) [2023-12-28 07:58:34,106][106225] Updated weights for policy 1, policy_version 1773459 (0.0010) [2023-12-28 07:58:34,165][106225] Updated weights for policy 1, policy_version 1773469 (0.0009) [2023-12-28 07:58:34,816][106226] Updated weights for policy 0, policy_version 1769097 (0.0006) [2023-12-28 07:58:34,874][106226] Updated weights for policy 0, policy_version 1769107 (0.0008) [2023-12-28 07:58:34,891][106225] Updated weights for policy 1, policy_version 1773479 (0.0010) [2023-12-28 07:58:34,922][106226] Updated weights for policy 0, policy_version 1769117 (0.0005) [2023-12-28 07:58:34,952][106225] Updated weights for policy 1, policy_version 1773489 (0.0010) [2023-12-28 07:58:34,978][106226] Updated weights for policy 0, policy_version 1769127 (0.0005) [2023-12-28 07:58:35,013][106225] Updated weights for policy 1, policy_version 1773499 (0.0010) [2023-12-28 07:58:35,601][106226] Updated weights for policy 0, policy_version 1769137 (0.0008) [2023-12-28 07:58:35,657][106226] Updated weights for policy 0, policy_version 1769147 (0.0008) [2023-12-28 07:58:35,713][106226] Updated weights for policy 0, policy_version 1769157 (0.0008) [2023-12-28 07:58:35,721][106225] Updated weights for policy 1, policy_version 1773509 (0.0007) [2023-12-28 07:58:35,776][106225] Updated weights for policy 1, policy_version 1773519 (0.0005) [2023-12-28 07:58:35,831][106225] Updated weights for policy 1, policy_version 1773529 (0.0005) [2023-12-28 07:58:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 907067392. Throughput: 0: 9659.4, 1: 9997.3. Samples: 907076436. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:36,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-5.164')] [2023-12-28 07:58:36,420][106226] Updated weights for policy 0, policy_version 1769167 (0.0010) [2023-12-28 07:58:36,475][106225] Updated weights for policy 1, policy_version 1773539 (0.0006) [2023-12-28 07:58:36,481][106226] Updated weights for policy 0, policy_version 1769177 (0.0011) [2023-12-28 07:58:36,533][106225] Updated weights for policy 1, policy_version 1773549 (0.0006) [2023-12-28 07:58:36,542][106226] Updated weights for policy 0, policy_version 1769187 (0.0010) [2023-12-28 07:58:36,591][106225] Updated weights for policy 1, policy_version 1773559 (0.0006) [2023-12-28 07:58:37,221][106225] Updated weights for policy 1, policy_version 1773569 (0.0008) [2023-12-28 07:58:37,246][106226] Updated weights for policy 0, policy_version 1769197 (0.0008) [2023-12-28 07:58:37,290][106225] Updated weights for policy 1, policy_version 1773579 (0.0008) [2023-12-28 07:58:37,310][106226] Updated weights for policy 0, policy_version 1769207 (0.0005) [2023-12-28 07:58:37,352][106225] Updated weights for policy 1, policy_version 1773589 (0.0009) [2023-12-28 07:58:37,372][106226] Updated weights for policy 0, policy_version 1769217 (0.0005) [2023-12-28 07:58:37,412][106225] Updated weights for policy 1, policy_version 1773599 (0.0008) [2023-12-28 07:58:37,887][106226] Updated weights for policy 0, policy_version 1769227 (0.0007) [2023-12-28 07:58:37,949][106226] Updated weights for policy 0, policy_version 1769237 (0.0009) [2023-12-28 07:58:37,998][106226] Updated weights for policy 0, policy_version 1769247 (0.0008) [2023-12-28 07:58:38,174][106225] Updated weights for policy 1, policy_version 1773609 (0.0009) [2023-12-28 07:58:38,229][106225] Updated weights for policy 1, policy_version 1773619 (0.0008) [2023-12-28 07:58:38,288][106225] Updated weights for policy 1, policy_version 1773629 (0.0007) [2023-12-28 07:58:38,711][106226] Updated weights for policy 0, policy_version 1769257 (0.0009) [2023-12-28 07:58:38,761][106226] Updated weights for policy 0, policy_version 1769267 (0.0009) [2023-12-28 07:58:38,815][106226] Updated weights for policy 0, policy_version 1769277 (0.0009) [2023-12-28 07:58:38,864][106226] Updated weights for policy 0, policy_version 1769287 (0.0009) [2023-12-28 07:58:38,918][106225] Updated weights for policy 1, policy_version 1773639 (0.0007) [2023-12-28 07:58:38,976][106225] Updated weights for policy 1, policy_version 1773649 (0.0006) [2023-12-28 07:58:39,034][106225] Updated weights for policy 1, policy_version 1773659 (0.0006) [2023-12-28 07:58:39,666][106226] Updated weights for policy 0, policy_version 1769297 (0.0009) [2023-12-28 07:58:39,726][106226] Updated weights for policy 0, policy_version 1769307 (0.0009) [2023-12-28 07:58:39,778][106225] Updated weights for policy 1, policy_version 1773669 (0.0006) [2023-12-28 07:58:39,787][106226] Updated weights for policy 0, policy_version 1769317 (0.0008) [2023-12-28 07:58:39,837][106225] Updated weights for policy 1, policy_version 1773679 (0.0008) [2023-12-28 07:58:39,901][106225] Updated weights for policy 1, policy_version 1773689 (0.0010) [2023-12-28 07:58:40,501][106226] Updated weights for policy 0, policy_version 1769327 (0.0008) [2023-12-28 07:58:40,566][106226] Updated weights for policy 0, policy_version 1769337 (0.0007) [2023-12-28 07:58:40,632][106226] Updated weights for policy 0, policy_version 1769347 (0.0008) [2023-12-28 07:58:40,688][106225] Updated weights for policy 1, policy_version 1773699 (0.0008) [2023-12-28 07:58:40,740][106225] Updated weights for policy 1, policy_version 1773709 (0.0007) [2023-12-28 07:58:40,789][106225] Updated weights for policy 1, policy_version 1773719 (0.0008) [2023-12-28 07:58:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 907165696. Throughput: 0: 9677.4, 1: 10038.6. Samples: 907137796. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:41,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.787')] [2023-12-28 07:58:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001773728_454131712.pth... [2023-12-28 07:58:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001769352_453033984.pth... [2023-12-28 07:58:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001768200_452739072.pth [2023-12-28 07:58:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001772544_453828608.pth [2023-12-28 07:58:41,397][106226] Updated weights for policy 0, policy_version 1769357 (0.0009) [2023-12-28 07:58:41,457][106226] Updated weights for policy 0, policy_version 1769367 (0.0010) [2023-12-28 07:58:41,517][106226] Updated weights for policy 0, policy_version 1769377 (0.0009) [2023-12-28 07:58:41,581][106225] Updated weights for policy 1, policy_version 1773729 (0.0008) [2023-12-28 07:58:41,645][106225] Updated weights for policy 1, policy_version 1773739 (0.0008) [2023-12-28 07:58:41,706][106225] Updated weights for policy 1, policy_version 1773749 (0.0008) [2023-12-28 07:58:41,773][106225] Updated weights for policy 1, policy_version 1773759 (0.0009) [2023-12-28 07:58:42,258][106226] Updated weights for policy 0, policy_version 1769387 (0.0008) [2023-12-28 07:58:42,329][106226] Updated weights for policy 0, policy_version 1769397 (0.0008) [2023-12-28 07:58:42,395][106226] Updated weights for policy 0, policy_version 1769407 (0.0007) [2023-12-28 07:58:42,557][106225] Updated weights for policy 1, policy_version 1773769 (0.0010) [2023-12-28 07:58:42,624][106225] Updated weights for policy 1, policy_version 1773779 (0.0010) [2023-12-28 07:58:42,689][106225] Updated weights for policy 1, policy_version 1773789 (0.0008) [2023-12-28 07:58:43,002][106226] Updated weights for policy 0, policy_version 1769417 (0.0006) [2023-12-28 07:58:43,055][106226] Updated weights for policy 0, policy_version 1769427 (0.0008) [2023-12-28 07:58:43,109][106226] Updated weights for policy 0, policy_version 1769437 (0.0008) [2023-12-28 07:58:43,157][106226] Updated weights for policy 0, policy_version 1769447 (0.0008) [2023-12-28 07:58:43,455][106225] Updated weights for policy 1, policy_version 1773799 (0.0008) [2023-12-28 07:58:43,513][106225] Updated weights for policy 1, policy_version 1773809 (0.0009) [2023-12-28 07:58:43,561][106225] Updated weights for policy 1, policy_version 1773819 (0.0008) [2023-12-28 07:58:43,917][106226] Updated weights for policy 0, policy_version 1769457 (0.0009) [2023-12-28 07:58:43,976][106226] Updated weights for policy 0, policy_version 1769467 (0.0009) [2023-12-28 07:58:44,040][106226] Updated weights for policy 0, policy_version 1769477 (0.0008) [2023-12-28 07:58:44,269][106225] Updated weights for policy 1, policy_version 1773829 (0.0007) [2023-12-28 07:58:44,336][106225] Updated weights for policy 1, policy_version 1773839 (0.0006) [2023-12-28 07:58:44,383][106225] Updated weights for policy 1, policy_version 1773849 (0.0005) [2023-12-28 07:58:44,780][106226] Updated weights for policy 0, policy_version 1769487 (0.0009) [2023-12-28 07:58:44,845][106226] Updated weights for policy 0, policy_version 1769497 (0.0007) [2023-12-28 07:58:44,906][106226] Updated weights for policy 0, policy_version 1769507 (0.0009) [2023-12-28 07:58:45,082][106225] Updated weights for policy 1, policy_version 1773859 (0.0008) [2023-12-28 07:58:45,150][106225] Updated weights for policy 1, policy_version 1773869 (0.0009) [2023-12-28 07:58:45,214][106225] Updated weights for policy 1, policy_version 1773879 (0.0007) [2023-12-28 07:58:45,661][106226] Updated weights for policy 0, policy_version 1769517 (0.0008) [2023-12-28 07:58:45,713][106226] Updated weights for policy 0, policy_version 1769527 (0.0009) [2023-12-28 07:58:45,763][106226] Updated weights for policy 0, policy_version 1769537 (0.0008) [2023-12-28 07:58:45,847][106225] Updated weights for policy 1, policy_version 1773889 (0.0007) [2023-12-28 07:58:45,910][106225] Updated weights for policy 1, policy_version 1773899 (0.0006) [2023-12-28 07:58:45,961][106225] Updated weights for policy 1, policy_version 1773909 (0.0005) [2023-12-28 07:58:46,011][106225] Updated weights for policy 1, policy_version 1773919 (0.0007) [2023-12-28 07:58:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 907264000. Throughput: 0: 9676.9, 1: 9984.1. Samples: 907250984. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:46,176][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.509')] [2023-12-28 07:58:46,556][106226] Updated weights for policy 0, policy_version 1769547 (0.0009) [2023-12-28 07:58:46,598][106225] Updated weights for policy 1, policy_version 1773929 (0.0006) [2023-12-28 07:58:46,616][106226] Updated weights for policy 0, policy_version 1769557 (0.0008) [2023-12-28 07:58:46,650][106225] Updated weights for policy 1, policy_version 1773939 (0.0005) [2023-12-28 07:58:46,673][106226] Updated weights for policy 0, policy_version 1769567 (0.0009) [2023-12-28 07:58:46,704][106225] Updated weights for policy 1, policy_version 1773949 (0.0009) [2023-12-28 07:58:47,358][106226] Updated weights for policy 0, policy_version 1769577 (0.0006) [2023-12-28 07:58:47,403][106226] Updated weights for policy 0, policy_version 1769587 (0.0007) [2023-12-28 07:58:47,413][106225] Updated weights for policy 1, policy_version 1773959 (0.0009) [2023-12-28 07:58:47,450][106226] Updated weights for policy 0, policy_version 1769597 (0.0006) [2023-12-28 07:58:47,466][106225] Updated weights for policy 1, policy_version 1773969 (0.0006) [2023-12-28 07:58:47,492][106226] Updated weights for policy 0, policy_version 1769607 (0.0007) [2023-12-28 07:58:47,517][106225] Updated weights for policy 1, policy_version 1773979 (0.0006) [2023-12-28 07:58:48,213][106226] Updated weights for policy 0, policy_version 1769617 (0.0006) [2023-12-28 07:58:48,239][106225] Updated weights for policy 1, policy_version 1773989 (0.0008) [2023-12-28 07:58:48,270][106226] Updated weights for policy 0, policy_version 1769627 (0.0006) [2023-12-28 07:58:48,299][106225] Updated weights for policy 1, policy_version 1773999 (0.0007) [2023-12-28 07:58:48,331][106226] Updated weights for policy 0, policy_version 1769638 (0.0006) [2023-12-28 07:58:48,368][106225] Updated weights for policy 1, policy_version 1774009 (0.0008) [2023-12-28 07:58:48,936][106226] Updated weights for policy 0, policy_version 1769648 (0.0006) [2023-12-28 07:58:48,994][106226] Updated weights for policy 0, policy_version 1769658 (0.0006) [2023-12-28 07:58:49,049][106226] Updated weights for policy 0, policy_version 1769668 (0.0008) [2023-12-28 07:58:49,106][106225] Updated weights for policy 1, policy_version 1774019 (0.0007) [2023-12-28 07:58:49,166][106225] Updated weights for policy 1, policy_version 1774029 (0.0008) [2023-12-28 07:58:49,233][106225] Updated weights for policy 1, policy_version 1774039 (0.0008) [2023-12-28 07:58:49,758][106226] Updated weights for policy 0, policy_version 1769678 (0.0009) [2023-12-28 07:58:49,817][106226] Updated weights for policy 0, policy_version 1769688 (0.0008) [2023-12-28 07:58:49,884][106226] Updated weights for policy 0, policy_version 1769698 (0.0008) [2023-12-28 07:58:49,969][106225] Updated weights for policy 1, policy_version 1774049 (0.0010) [2023-12-28 07:58:50,026][106225] Updated weights for policy 1, policy_version 1774059 (0.0009) [2023-12-28 07:58:50,081][106225] Updated weights for policy 1, policy_version 1774069 (0.0008) [2023-12-28 07:58:50,141][106225] Updated weights for policy 1, policy_version 1774079 (0.0009) [2023-12-28 07:58:50,623][106226] Updated weights for policy 0, policy_version 1769708 (0.0008) [2023-12-28 07:58:50,690][106226] Updated weights for policy 0, policy_version 1769718 (0.0007) [2023-12-28 07:58:50,756][106226] Updated weights for policy 0, policy_version 1769728 (0.0006) [2023-12-28 07:58:50,943][106225] Updated weights for policy 1, policy_version 1774089 (0.0008) [2023-12-28 07:58:50,994][106225] Updated weights for policy 1, policy_version 1774099 (0.0008) [2023-12-28 07:58:51,062][106225] Updated weights for policy 1, policy_version 1774109 (0.0008) [2023-12-28 07:58:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 907362304. Throughput: 0: 9753.9, 1: 9899.5. Samples: 907369752. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:51,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.937')] [2023-12-28 07:58:51,426][106226] Updated weights for policy 0, policy_version 1769738 (0.0006) [2023-12-28 07:58:51,486][106226] Updated weights for policy 0, policy_version 1769748 (0.0007) [2023-12-28 07:58:51,546][106226] Updated weights for policy 0, policy_version 1769758 (0.0010) [2023-12-28 07:58:51,610][106226] Updated weights for policy 0, policy_version 1769768 (0.0010) [2023-12-28 07:58:51,805][106225] Updated weights for policy 1, policy_version 1774119 (0.0010) [2023-12-28 07:58:51,868][106225] Updated weights for policy 1, policy_version 1774129 (0.0010) [2023-12-28 07:58:51,920][106225] Updated weights for policy 1, policy_version 1774139 (0.0006) [2023-12-28 07:58:52,351][106226] Updated weights for policy 0, policy_version 1769778 (0.0008) [2023-12-28 07:58:52,406][106226] Updated weights for policy 0, policy_version 1769789 (0.0009) [2023-12-28 07:58:52,464][106226] Updated weights for policy 0, policy_version 1769799 (0.0009) [2023-12-28 07:58:52,554][106225] Updated weights for policy 1, policy_version 1774149 (0.0008) [2023-12-28 07:58:52,615][106225] Updated weights for policy 1, policy_version 1774159 (0.0011) [2023-12-28 07:58:52,674][106225] Updated weights for policy 1, policy_version 1774169 (0.0010) [2023-12-28 07:58:53,180][106226] Updated weights for policy 0, policy_version 1769809 (0.0006) [2023-12-28 07:58:53,250][106226] Updated weights for policy 0, policy_version 1769819 (0.0006) [2023-12-28 07:58:53,305][106226] Updated weights for policy 0, policy_version 1769829 (0.0008) [2023-12-28 07:58:53,390][106225] Updated weights for policy 1, policy_version 1774179 (0.0010) [2023-12-28 07:58:53,440][106225] Updated weights for policy 1, policy_version 1774189 (0.0010) [2023-12-28 07:58:53,493][106225] Updated weights for policy 1, policy_version 1774199 (0.0010) [2023-12-28 07:58:53,954][106226] Updated weights for policy 0, policy_version 1769839 (0.0010) [2023-12-28 07:58:54,017][106226] Updated weights for policy 0, policy_version 1769849 (0.0010) [2023-12-28 07:58:54,074][106226] Updated weights for policy 0, policy_version 1769859 (0.0010) [2023-12-28 07:58:54,232][106225] Updated weights for policy 1, policy_version 1774209 (0.0010) [2023-12-28 07:58:54,289][106225] Updated weights for policy 1, policy_version 1774219 (0.0009) [2023-12-28 07:58:54,350][106225] Updated weights for policy 1, policy_version 1774229 (0.0007) [2023-12-28 07:58:54,403][106225] Updated weights for policy 1, policy_version 1774239 (0.0008) [2023-12-28 07:58:54,793][106226] Updated weights for policy 0, policy_version 1769869 (0.0009) [2023-12-28 07:58:54,851][106226] Updated weights for policy 0, policy_version 1769879 (0.0008) [2023-12-28 07:58:54,915][106226] Updated weights for policy 0, policy_version 1769889 (0.0007) [2023-12-28 07:58:55,107][106225] Updated weights for policy 1, policy_version 1774249 (0.0010) [2023-12-28 07:58:55,156][106225] Updated weights for policy 1, policy_version 1774259 (0.0010) [2023-12-28 07:58:55,211][106225] Updated weights for policy 1, policy_version 1774269 (0.0007) [2023-12-28 07:58:55,582][106226] Updated weights for policy 0, policy_version 1769899 (0.0008) [2023-12-28 07:58:55,639][106226] Updated weights for policy 0, policy_version 1769909 (0.0008) [2023-12-28 07:58:55,696][106226] Updated weights for policy 0, policy_version 1769919 (0.0006) [2023-12-28 07:58:55,873][106225] Updated weights for policy 1, policy_version 1774279 (0.0006) [2023-12-28 07:58:55,926][106225] Updated weights for policy 1, policy_version 1774289 (0.0009) [2023-12-28 07:58:55,977][106225] Updated weights for policy 1, policy_version 1774299 (0.0008) [2023-12-28 07:58:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.6, 300 sec: 19771.8). Total num frames: 907460608. Throughput: 0: 9798.5, 1: 9888.5. Samples: 907427804. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:58:56,176][105115] Avg episode reward: [(0, '-4.419'), (1, '-4.698')] [2023-12-28 07:58:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001769928_453181440.pth... [2023-12-28 07:58:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001774304_454279168.pth... [2023-12-28 07:58:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001768776_452886528.pth [2023-12-28 07:58:56,195][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001773152_453984256.pth [2023-12-28 07:58:56,270][106226] Updated weights for policy 0, policy_version 1769929 (0.0006) [2023-12-28 07:58:56,323][106226] Updated weights for policy 0, policy_version 1769939 (0.0010) [2023-12-28 07:58:56,373][106226] Updated weights for policy 0, policy_version 1769949 (0.0009) [2023-12-28 07:58:56,422][106226] Updated weights for policy 0, policy_version 1769959 (0.0005) [2023-12-28 07:58:56,779][106225] Updated weights for policy 1, policy_version 1774309 (0.0009) [2023-12-28 07:58:56,827][106225] Updated weights for policy 1, policy_version 1774319 (0.0008) [2023-12-28 07:58:56,876][106225] Updated weights for policy 1, policy_version 1774329 (0.0008) [2023-12-28 07:58:56,977][106226] Updated weights for policy 0, policy_version 1769969 (0.0005) [2023-12-28 07:58:57,042][106226] Updated weights for policy 0, policy_version 1769979 (0.0005) [2023-12-28 07:58:57,098][106226] Updated weights for policy 0, policy_version 1769989 (0.0006) [2023-12-28 07:58:57,681][106226] Updated weights for policy 0, policy_version 1769999 (0.0008) [2023-12-28 07:58:57,688][106225] Updated weights for policy 1, policy_version 1774339 (0.0007) [2023-12-28 07:58:57,734][106226] Updated weights for policy 0, policy_version 1770009 (0.0006) [2023-12-28 07:58:57,745][106225] Updated weights for policy 1, policy_version 1774349 (0.0007) [2023-12-28 07:58:57,793][106226] Updated weights for policy 0, policy_version 1770019 (0.0007) [2023-12-28 07:58:57,800][106225] Updated weights for policy 1, policy_version 1774359 (0.0007) [2023-12-28 07:58:58,416][106225] Updated weights for policy 1, policy_version 1774369 (0.0009) [2023-12-28 07:58:58,449][106226] Updated weights for policy 0, policy_version 1770029 (0.0007) [2023-12-28 07:58:58,479][106225] Updated weights for policy 1, policy_version 1774379 (0.0009) [2023-12-28 07:58:58,514][106226] Updated weights for policy 0, policy_version 1770039 (0.0009) [2023-12-28 07:58:58,544][106225] Updated weights for policy 1, policy_version 1774389 (0.0009) [2023-12-28 07:58:58,579][106226] Updated weights for policy 0, policy_version 1770049 (0.0007) [2023-12-28 07:58:58,612][106225] Updated weights for policy 1, policy_version 1774399 (0.0009) [2023-12-28 07:58:59,511][106226] Updated weights for policy 0, policy_version 1770059 (0.0008) [2023-12-28 07:58:59,511][106225] Updated weights for policy 1, policy_version 1774409 (0.0009) [2023-12-28 07:58:59,570][106225] Updated weights for policy 1, policy_version 1774419 (0.0007) [2023-12-28 07:58:59,572][106226] Updated weights for policy 0, policy_version 1770069 (0.0006) [2023-12-28 07:58:59,632][106226] Updated weights for policy 0, policy_version 1770079 (0.0008) [2023-12-28 07:58:59,633][106225] Updated weights for policy 1, policy_version 1774429 (0.0007) [2023-12-28 07:59:00,262][106225] Updated weights for policy 1, policy_version 1774439 (0.0006) [2023-12-28 07:59:00,312][106225] Updated weights for policy 1, policy_version 1774449 (0.0005) [2023-12-28 07:59:00,366][106225] Updated weights for policy 1, policy_version 1774459 (0.0005) [2023-12-28 07:59:00,415][106226] Updated weights for policy 0, policy_version 1770089 (0.0009) [2023-12-28 07:59:00,464][106226] Updated weights for policy 0, policy_version 1770099 (0.0010) [2023-12-28 07:59:00,523][106226] Updated weights for policy 0, policy_version 1770109 (0.0010) [2023-12-28 07:59:00,584][106226] Updated weights for policy 0, policy_version 1770119 (0.0005) [2023-12-28 07:59:00,923][106225] Updated weights for policy 1, policy_version 1774469 (0.0006) [2023-12-28 07:59:00,979][106225] Updated weights for policy 1, policy_version 1774479 (0.0007) [2023-12-28 07:59:01,037][106225] Updated weights for policy 1, policy_version 1774489 (0.0007) [2023-12-28 07:59:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 907558912. Throughput: 0: 9889.4, 1: 9829.8. Samples: 907546040. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:01,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-4.969')] [2023-12-28 07:59:01,307][106226] Updated weights for policy 0, policy_version 1770129 (0.0010) [2023-12-28 07:59:01,371][106226] Updated weights for policy 0, policy_version 1770139 (0.0009) [2023-12-28 07:59:01,438][106226] Updated weights for policy 0, policy_version 1770149 (0.0006) [2023-12-28 07:59:01,737][106225] Updated weights for policy 1, policy_version 1774499 (0.0008) [2023-12-28 07:59:01,804][106225] Updated weights for policy 1, policy_version 1774509 (0.0008) [2023-12-28 07:59:01,869][106225] Updated weights for policy 1, policy_version 1774519 (0.0009) [2023-12-28 07:59:02,053][106226] Updated weights for policy 0, policy_version 1770159 (0.0007) [2023-12-28 07:59:02,108][106226] Updated weights for policy 0, policy_version 1770169 (0.0008) [2023-12-28 07:59:02,167][106226] Updated weights for policy 0, policy_version 1770179 (0.0006) [2023-12-28 07:59:02,574][106225] Updated weights for policy 1, policy_version 1774529 (0.0008) [2023-12-28 07:59:02,644][106225] Updated weights for policy 1, policy_version 1774539 (0.0009) [2023-12-28 07:59:02,719][106225] Updated weights for policy 1, policy_version 1774549 (0.0009) [2023-12-28 07:59:02,776][106225] Updated weights for policy 1, policy_version 1774559 (0.0007) [2023-12-28 07:59:02,885][106226] Updated weights for policy 0, policy_version 1770189 (0.0009) [2023-12-28 07:59:02,940][106226] Updated weights for policy 0, policy_version 1770199 (0.0010) [2023-12-28 07:59:03,008][106226] Updated weights for policy 0, policy_version 1770209 (0.0010) [2023-12-28 07:59:03,438][106225] Updated weights for policy 1, policy_version 1774569 (0.0006) [2023-12-28 07:59:03,490][106225] Updated weights for policy 1, policy_version 1774579 (0.0005) [2023-12-28 07:59:03,543][106225] Updated weights for policy 1, policy_version 1774589 (0.0005) [2023-12-28 07:59:03,663][106226] Updated weights for policy 0, policy_version 1770219 (0.0009) [2023-12-28 07:59:03,723][106226] Updated weights for policy 0, policy_version 1770229 (0.0010) [2023-12-28 07:59:03,783][106226] Updated weights for policy 0, policy_version 1770239 (0.0010) [2023-12-28 07:59:04,168][106225] Updated weights for policy 1, policy_version 1774599 (0.0006) [2023-12-28 07:59:04,223][106225] Updated weights for policy 1, policy_version 1774609 (0.0007) [2023-12-28 07:59:04,284][106225] Updated weights for policy 1, policy_version 1774619 (0.0007) [2023-12-28 07:59:04,551][106226] Updated weights for policy 0, policy_version 1770249 (0.0010) [2023-12-28 07:59:04,616][106226] Updated weights for policy 0, policy_version 1770259 (0.0007) [2023-12-28 07:59:04,678][106226] Updated weights for policy 0, policy_version 1770269 (0.0005) [2023-12-28 07:59:04,739][106226] Updated weights for policy 0, policy_version 1770279 (0.0005) [2023-12-28 07:59:04,936][106225] Updated weights for policy 1, policy_version 1774629 (0.0009) [2023-12-28 07:59:04,990][106225] Updated weights for policy 1, policy_version 1774639 (0.0010) [2023-12-28 07:59:05,053][106225] Updated weights for policy 1, policy_version 1774649 (0.0010) [2023-12-28 07:59:05,262][106226] Updated weights for policy 0, policy_version 1770289 (0.0006) [2023-12-28 07:59:05,320][106226] Updated weights for policy 0, policy_version 1770299 (0.0007) [2023-12-28 07:59:05,370][106226] Updated weights for policy 0, policy_version 1770309 (0.0006) [2023-12-28 07:59:05,677][106225] Updated weights for policy 1, policy_version 1774659 (0.0008) [2023-12-28 07:59:05,723][106225] Updated weights for policy 1, policy_version 1774669 (0.0010) [2023-12-28 07:59:05,776][106225] Updated weights for policy 1, policy_version 1774679 (0.0010) [2023-12-28 07:59:06,028][106226] Updated weights for policy 0, policy_version 1770319 (0.0009) [2023-12-28 07:59:06,084][106226] Updated weights for policy 0, policy_version 1770329 (0.0010) [2023-12-28 07:59:06,156][106226] Updated weights for policy 0, policy_version 1770339 (0.0011) [2023-12-28 07:59:06,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 907657216. Throughput: 0: 9951.4, 1: 9916.8. Samples: 907671392. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:06,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.851')] [2023-12-28 07:59:06,495][106225] Updated weights for policy 1, policy_version 1774689 (0.0010) [2023-12-28 07:59:06,560][106225] Updated weights for policy 1, policy_version 1774699 (0.0011) [2023-12-28 07:59:06,621][106225] Updated weights for policy 1, policy_version 1774709 (0.0011) [2023-12-28 07:59:06,683][106225] Updated weights for policy 1, policy_version 1774719 (0.0010) [2023-12-28 07:59:06,867][106226] Updated weights for policy 0, policy_version 1770349 (0.0011) [2023-12-28 07:59:06,930][106226] Updated weights for policy 0, policy_version 1770359 (0.0011) [2023-12-28 07:59:06,993][106226] Updated weights for policy 0, policy_version 1770369 (0.0010) [2023-12-28 07:59:07,408][106225] Updated weights for policy 1, policy_version 1774729 (0.0010) [2023-12-28 07:59:07,467][106225] Updated weights for policy 1, policy_version 1774739 (0.0010) [2023-12-28 07:59:07,524][106225] Updated weights for policy 1, policy_version 1774749 (0.0010) [2023-12-28 07:59:07,681][106226] Updated weights for policy 0, policy_version 1770379 (0.0010) [2023-12-28 07:59:07,740][106226] Updated weights for policy 0, policy_version 1770389 (0.0007) [2023-12-28 07:59:07,813][106226] Updated weights for policy 0, policy_version 1770399 (0.0005) [2023-12-28 07:59:08,230][106225] Updated weights for policy 1, policy_version 1774759 (0.0010) [2023-12-28 07:59:08,283][106225] Updated weights for policy 1, policy_version 1774769 (0.0010) [2023-12-28 07:59:08,355][106225] Updated weights for policy 1, policy_version 1774779 (0.0010) [2023-12-28 07:59:08,442][106226] Updated weights for policy 0, policy_version 1770409 (0.0005) [2023-12-28 07:59:08,504][106226] Updated weights for policy 0, policy_version 1770419 (0.0006) [2023-12-28 07:59:08,564][106226] Updated weights for policy 0, policy_version 1770429 (0.0006) [2023-12-28 07:59:08,629][106226] Updated weights for policy 0, policy_version 1770439 (0.0007) [2023-12-28 07:59:09,034][106225] Updated weights for policy 1, policy_version 1774789 (0.0008) [2023-12-28 07:59:09,086][106225] Updated weights for policy 1, policy_version 1774799 (0.0005) [2023-12-28 07:59:09,138][106225] Updated weights for policy 1, policy_version 1774809 (0.0005) [2023-12-28 07:59:09,246][106226] Updated weights for policy 0, policy_version 1770449 (0.0010) [2023-12-28 07:59:09,315][106226] Updated weights for policy 0, policy_version 1770459 (0.0011) [2023-12-28 07:59:09,380][106226] Updated weights for policy 0, policy_version 1770469 (0.0008) [2023-12-28 07:59:09,815][106225] Updated weights for policy 1, policy_version 1774819 (0.0006) [2023-12-28 07:59:09,887][106225] Updated weights for policy 1, policy_version 1774829 (0.0009) [2023-12-28 07:59:09,956][106225] Updated weights for policy 1, policy_version 1774839 (0.0008) [2023-12-28 07:59:10,130][106226] Updated weights for policy 0, policy_version 1770479 (0.0008) [2023-12-28 07:59:10,199][106226] Updated weights for policy 0, policy_version 1770489 (0.0006) [2023-12-28 07:59:10,260][106226] Updated weights for policy 0, policy_version 1770499 (0.0007) [2023-12-28 07:59:10,681][106225] Updated weights for policy 1, policy_version 1774849 (0.0009) [2023-12-28 07:59:10,744][106225] Updated weights for policy 1, policy_version 1774859 (0.0008) [2023-12-28 07:59:10,803][106225] Updated weights for policy 1, policy_version 1774869 (0.0009) [2023-12-28 07:59:10,851][106225] Updated weights for policy 1, policy_version 1774879 (0.0008) [2023-12-28 07:59:10,938][106226] Updated weights for policy 0, policy_version 1770509 (0.0009) [2023-12-28 07:59:11,008][106226] Updated weights for policy 0, policy_version 1770519 (0.0008) [2023-12-28 07:59:11,082][106226] Updated weights for policy 0, policy_version 1770529 (0.0009) [2023-12-28 07:59:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 907763712. Throughput: 0: 9990.1, 1: 9911.3. Samples: 907730848. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:11,175][105115] Avg episode reward: [(0, '-4.699'), (1, '-4.982')] [2023-12-28 07:59:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001774880_454426624.pth... [2023-12-28 07:59:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001770536_453337088.pth... [2023-12-28 07:59:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001773728_454131712.pth [2023-12-28 07:59:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001769352_453033984.pth [2023-12-28 07:59:11,654][106225] Updated weights for policy 1, policy_version 1774889 (0.0008) [2023-12-28 07:59:11,722][106225] Updated weights for policy 1, policy_version 1774899 (0.0009) [2023-12-28 07:59:11,771][106226] Updated weights for policy 0, policy_version 1770539 (0.0006) [2023-12-28 07:59:11,788][106225] Updated weights for policy 1, policy_version 1774909 (0.0008) [2023-12-28 07:59:11,835][106226] Updated weights for policy 0, policy_version 1770549 (0.0006) [2023-12-28 07:59:11,906][106226] Updated weights for policy 0, policy_version 1770559 (0.0007) [2023-12-28 07:59:12,566][106225] Updated weights for policy 1, policy_version 1774919 (0.0008) [2023-12-28 07:59:12,587][106226] Updated weights for policy 0, policy_version 1770569 (0.0010) [2023-12-28 07:59:12,618][106225] Updated weights for policy 1, policy_version 1774929 (0.0009) [2023-12-28 07:59:12,642][106226] Updated weights for policy 0, policy_version 1770579 (0.0011) [2023-12-28 07:59:12,679][106225] Updated weights for policy 1, policy_version 1774939 (0.0007) [2023-12-28 07:59:12,700][106226] Updated weights for policy 0, policy_version 1770589 (0.0010) [2023-12-28 07:59:12,763][106226] Updated weights for policy 0, policy_version 1770599 (0.0011) [2023-12-28 07:59:13,388][106225] Updated weights for policy 1, policy_version 1774949 (0.0008) [2023-12-28 07:59:13,445][106225] Updated weights for policy 1, policy_version 1774959 (0.0010) [2023-12-28 07:59:13,484][106226] Updated weights for policy 0, policy_version 1770609 (0.0010) [2023-12-28 07:59:13,493][106225] Updated weights for policy 1, policy_version 1774969 (0.0010) [2023-12-28 07:59:13,534][106226] Updated weights for policy 0, policy_version 1770619 (0.0010) [2023-12-28 07:59:13,591][106226] Updated weights for policy 0, policy_version 1770629 (0.0010) [2023-12-28 07:59:14,162][106225] Updated weights for policy 1, policy_version 1774979 (0.0009) [2023-12-28 07:59:14,216][106225] Updated weights for policy 1, policy_version 1774989 (0.0009) [2023-12-28 07:59:14,279][106225] Updated weights for policy 1, policy_version 1774999 (0.0010) [2023-12-28 07:59:14,301][106226] Updated weights for policy 0, policy_version 1770639 (0.0010) [2023-12-28 07:59:14,356][106226] Updated weights for policy 0, policy_version 1770649 (0.0010) [2023-12-28 07:59:14,415][106226] Updated weights for policy 0, policy_version 1770659 (0.0010) [2023-12-28 07:59:14,864][106225] Updated weights for policy 1, policy_version 1775009 (0.0010) [2023-12-28 07:59:14,922][106225] Updated weights for policy 1, policy_version 1775019 (0.0008) [2023-12-28 07:59:14,986][106225] Updated weights for policy 1, policy_version 1775029 (0.0008) [2023-12-28 07:59:15,054][106225] Updated weights for policy 1, policy_version 1775039 (0.0008) [2023-12-28 07:59:15,147][106226] Updated weights for policy 0, policy_version 1770669 (0.0009) [2023-12-28 07:59:15,207][106226] Updated weights for policy 0, policy_version 1770679 (0.0008) [2023-12-28 07:59:15,269][106226] Updated weights for policy 0, policy_version 1770689 (0.0006) [2023-12-28 07:59:15,771][106225] Updated weights for policy 1, policy_version 1775049 (0.0010) [2023-12-28 07:59:15,830][106225] Updated weights for policy 1, policy_version 1775059 (0.0007) [2023-12-28 07:59:15,895][106225] Updated weights for policy 1, policy_version 1775069 (0.0006) [2023-12-28 07:59:15,920][106226] Updated weights for policy 0, policy_version 1770699 (0.0006) [2023-12-28 07:59:15,983][106226] Updated weights for policy 0, policy_version 1770709 (0.0008) [2023-12-28 07:59:16,039][106226] Updated weights for policy 0, policy_version 1770719 (0.0008) [2023-12-28 07:59:16,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 907862016. Throughput: 0: 9895.3, 1: 9882.4. Samples: 907848256. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:16,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.570')] [2023-12-28 07:59:16,481][106225] Updated weights for policy 1, policy_version 1775079 (0.0006) [2023-12-28 07:59:16,538][106225] Updated weights for policy 1, policy_version 1775089 (0.0005) [2023-12-28 07:59:16,602][106225] Updated weights for policy 1, policy_version 1775099 (0.0005) [2023-12-28 07:59:16,731][106226] Updated weights for policy 0, policy_version 1770729 (0.0008) [2023-12-28 07:59:16,788][106226] Updated weights for policy 0, policy_version 1770739 (0.0010) [2023-12-28 07:59:16,842][106226] Updated weights for policy 0, policy_version 1770749 (0.0010) [2023-12-28 07:59:16,889][106226] Updated weights for policy 0, policy_version 1770759 (0.0010) [2023-12-28 07:59:17,162][106225] Updated weights for policy 1, policy_version 1775109 (0.0007) [2023-12-28 07:59:17,222][106225] Updated weights for policy 1, policy_version 1775119 (0.0008) [2023-12-28 07:59:17,281][106225] Updated weights for policy 1, policy_version 1775129 (0.0007) [2023-12-28 07:59:17,575][106226] Updated weights for policy 0, policy_version 1770769 (0.0008) [2023-12-28 07:59:17,632][106226] Updated weights for policy 0, policy_version 1770779 (0.0009) [2023-12-28 07:59:17,692][106226] Updated weights for policy 0, policy_version 1770789 (0.0009) [2023-12-28 07:59:18,013][106225] Updated weights for policy 1, policy_version 1775139 (0.0008) [2023-12-28 07:59:18,063][106225] Updated weights for policy 1, policy_version 1775149 (0.0010) [2023-12-28 07:59:18,116][106225] Updated weights for policy 1, policy_version 1775159 (0.0010) [2023-12-28 07:59:18,368][106226] Updated weights for policy 0, policy_version 1770799 (0.0007) [2023-12-28 07:59:18,429][106226] Updated weights for policy 0, policy_version 1770809 (0.0008) [2023-12-28 07:59:18,484][106226] Updated weights for policy 0, policy_version 1770819 (0.0008) [2023-12-28 07:59:18,847][106225] Updated weights for policy 1, policy_version 1775169 (0.0010) [2023-12-28 07:59:18,909][106225] Updated weights for policy 1, policy_version 1775179 (0.0011) [2023-12-28 07:59:18,960][106225] Updated weights for policy 1, policy_version 1775189 (0.0010) [2023-12-28 07:59:19,016][106225] Updated weights for policy 1, policy_version 1775199 (0.0010) [2023-12-28 07:59:19,257][106226] Updated weights for policy 0, policy_version 1770829 (0.0009) [2023-12-28 07:59:19,319][106226] Updated weights for policy 0, policy_version 1770839 (0.0008) [2023-12-28 07:59:19,390][106226] Updated weights for policy 0, policy_version 1770849 (0.0008) [2023-12-28 07:59:19,795][106225] Updated weights for policy 1, policy_version 1775209 (0.0010) [2023-12-28 07:59:19,860][106225] Updated weights for policy 1, policy_version 1775219 (0.0008) [2023-12-28 07:59:19,924][106225] Updated weights for policy 1, policy_version 1775229 (0.0008) [2023-12-28 07:59:20,127][106226] Updated weights for policy 0, policy_version 1770859 (0.0008) [2023-12-28 07:59:20,190][106226] Updated weights for policy 0, policy_version 1770869 (0.0010) [2023-12-28 07:59:20,254][106226] Updated weights for policy 0, policy_version 1770879 (0.0009) [2023-12-28 07:59:20,635][106225] Updated weights for policy 1, policy_version 1775239 (0.0009) [2023-12-28 07:59:20,693][106225] Updated weights for policy 1, policy_version 1775249 (0.0009) [2023-12-28 07:59:20,752][106225] Updated weights for policy 1, policy_version 1775259 (0.0008) [2023-12-28 07:59:20,953][106226] Updated weights for policy 0, policy_version 1770889 (0.0008) [2023-12-28 07:59:21,020][106226] Updated weights for policy 0, policy_version 1770899 (0.0006) [2023-12-28 07:59:21,092][106226] Updated weights for policy 0, policy_version 1770909 (0.0007) [2023-12-28 07:59:21,163][106226] Updated weights for policy 0, policy_version 1770919 (0.0009) [2023-12-28 07:59:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 907960320. Throughput: 0: 9922.9, 1: 9854.9. Samples: 907966432. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:21,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.831')] [2023-12-28 07:59:21,514][106225] Updated weights for policy 1, policy_version 1775269 (0.0008) [2023-12-28 07:59:21,581][106225] Updated weights for policy 1, policy_version 1775279 (0.0008) [2023-12-28 07:59:21,646][106225] Updated weights for policy 1, policy_version 1775289 (0.0008) [2023-12-28 07:59:21,947][106226] Updated weights for policy 0, policy_version 1770929 (0.0008) [2023-12-28 07:59:22,010][106226] Updated weights for policy 0, policy_version 1770939 (0.0008) [2023-12-28 07:59:22,072][106226] Updated weights for policy 0, policy_version 1770949 (0.0008) [2023-12-28 07:59:22,415][106225] Updated weights for policy 1, policy_version 1775299 (0.0008) [2023-12-28 07:59:22,487][106225] Updated weights for policy 1, policy_version 1775309 (0.0006) [2023-12-28 07:59:22,558][106225] Updated weights for policy 1, policy_version 1775319 (0.0007) [2023-12-28 07:59:22,817][106226] Updated weights for policy 0, policy_version 1770959 (0.0008) [2023-12-28 07:59:22,866][106226] Updated weights for policy 0, policy_version 1770969 (0.0006) [2023-12-28 07:59:22,921][106226] Updated weights for policy 0, policy_version 1770979 (0.0005) [2023-12-28 07:59:23,333][106225] Updated weights for policy 1, policy_version 1775329 (0.0008) [2023-12-28 07:59:23,394][106225] Updated weights for policy 1, policy_version 1775339 (0.0009) [2023-12-28 07:59:23,458][106225] Updated weights for policy 1, policy_version 1775349 (0.0009) [2023-12-28 07:59:23,522][106225] Updated weights for policy 1, policy_version 1775359 (0.0009) [2023-12-28 07:59:23,588][106226] Updated weights for policy 0, policy_version 1770989 (0.0006) [2023-12-28 07:59:23,652][106226] Updated weights for policy 0, policy_version 1770999 (0.0009) [2023-12-28 07:59:23,712][106226] Updated weights for policy 0, policy_version 1771009 (0.0009) [2023-12-28 07:59:24,189][106225] Updated weights for policy 1, policy_version 1775369 (0.0006) [2023-12-28 07:59:24,241][106225] Updated weights for policy 1, policy_version 1775379 (0.0005) [2023-12-28 07:59:24,300][106225] Updated weights for policy 1, policy_version 1775389 (0.0005) [2023-12-28 07:59:24,516][106226] Updated weights for policy 0, policy_version 1771019 (0.0009) [2023-12-28 07:59:24,567][106226] Updated weights for policy 0, policy_version 1771029 (0.0009) [2023-12-28 07:59:24,621][106226] Updated weights for policy 0, policy_version 1771039 (0.0009) [2023-12-28 07:59:24,821][106225] Updated weights for policy 1, policy_version 1775399 (0.0005) [2023-12-28 07:59:24,867][106225] Updated weights for policy 1, policy_version 1775409 (0.0008) [2023-12-28 07:59:24,917][106225] Updated weights for policy 1, policy_version 1775419 (0.0008) [2023-12-28 07:59:25,409][106226] Updated weights for policy 0, policy_version 1771049 (0.0010) [2023-12-28 07:59:25,475][106226] Updated weights for policy 0, policy_version 1771059 (0.0011) [2023-12-28 07:59:25,537][106226] Updated weights for policy 0, policy_version 1771069 (0.0011) [2023-12-28 07:59:25,570][106225] Updated weights for policy 1, policy_version 1775429 (0.0008) [2023-12-28 07:59:25,587][106226] Updated weights for policy 0, policy_version 1771079 (0.0009) [2023-12-28 07:59:25,617][106225] Updated weights for policy 1, policy_version 1775439 (0.0010) [2023-12-28 07:59:25,670][106225] Updated weights for policy 1, policy_version 1775449 (0.0008) [2023-12-28 07:59:26,175][105115] Fps is (10 sec: 18840.9, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 908050432. Throughput: 0: 9871.3, 1: 9781.4. Samples: 908022172. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:26,176][105115] Avg episode reward: [(0, '-4.228'), (1, '-4.965')] [2023-12-28 07:59:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001771080_453476352.pth... [2023-12-28 07:59:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001775456_454574080.pth... [2023-12-28 07:59:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001769928_453181440.pth [2023-12-28 07:59:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001774304_454279168.pth [2023-12-28 07:59:26,227][106225] Updated weights for policy 1, policy_version 1775459 (0.0005) [2023-12-28 07:59:26,258][106226] Updated weights for policy 0, policy_version 1771089 (0.0010) [2023-12-28 07:59:26,282][106225] Updated weights for policy 1, policy_version 1775469 (0.0010) [2023-12-28 07:59:26,311][106226] Updated weights for policy 0, policy_version 1771099 (0.0010) [2023-12-28 07:59:26,332][106225] Updated weights for policy 1, policy_version 1775479 (0.0010) [2023-12-28 07:59:26,365][106226] Updated weights for policy 0, policy_version 1771109 (0.0010) [2023-12-28 07:59:26,938][106225] Updated weights for policy 1, policy_version 1775489 (0.0010) [2023-12-28 07:59:26,991][106225] Updated weights for policy 1, policy_version 1775499 (0.0006) [2023-12-28 07:59:27,044][106225] Updated weights for policy 1, policy_version 1775509 (0.0005) [2023-12-28 07:59:27,096][106225] Updated weights for policy 1, policy_version 1775519 (0.0006) [2023-12-28 07:59:27,097][106226] Updated weights for policy 0, policy_version 1771119 (0.0010) [2023-12-28 07:59:27,150][106226] Updated weights for policy 0, policy_version 1771129 (0.0010) [2023-12-28 07:59:27,212][106226] Updated weights for policy 0, policy_version 1771139 (0.0009) [2023-12-28 07:59:27,704][106225] Updated weights for policy 1, policy_version 1775529 (0.0008) [2023-12-28 07:59:27,774][106225] Updated weights for policy 1, policy_version 1775539 (0.0007) [2023-12-28 07:59:27,804][106226] Updated weights for policy 0, policy_version 1771149 (0.0006) [2023-12-28 07:59:27,830][106225] Updated weights for policy 1, policy_version 1775549 (0.0005) [2023-12-28 07:59:27,865][106226] Updated weights for policy 0, policy_version 1771159 (0.0008) [2023-12-28 07:59:27,932][106226] Updated weights for policy 0, policy_version 1771169 (0.0009) [2023-12-28 07:59:28,384][106225] Updated weights for policy 1, policy_version 1775559 (0.0006) [2023-12-28 07:59:28,444][106225] Updated weights for policy 1, policy_version 1775569 (0.0007) [2023-12-28 07:59:28,502][106225] Updated weights for policy 1, policy_version 1775579 (0.0008) [2023-12-28 07:59:28,616][106226] Updated weights for policy 0, policy_version 1771179 (0.0009) [2023-12-28 07:59:28,677][106226] Updated weights for policy 0, policy_version 1771189 (0.0007) [2023-12-28 07:59:28,737][106226] Updated weights for policy 0, policy_version 1771199 (0.0008) [2023-12-28 07:59:29,200][106225] Updated weights for policy 1, policy_version 1775589 (0.0007) [2023-12-28 07:59:29,264][106225] Updated weights for policy 1, policy_version 1775599 (0.0009) [2023-12-28 07:59:29,326][106225] Updated weights for policy 1, policy_version 1775609 (0.0010) [2023-12-28 07:59:29,386][106226] Updated weights for policy 0, policy_version 1771209 (0.0009) [2023-12-28 07:59:29,438][106226] Updated weights for policy 0, policy_version 1771219 (0.0006) [2023-12-28 07:59:29,494][106226] Updated weights for policy 0, policy_version 1771229 (0.0007) [2023-12-28 07:59:29,540][106226] Updated weights for policy 0, policy_version 1771239 (0.0008) [2023-12-28 07:59:30,068][106225] Updated weights for policy 1, policy_version 1775619 (0.0008) [2023-12-28 07:59:30,124][106225] Updated weights for policy 1, policy_version 1775629 (0.0008) [2023-12-28 07:59:30,172][106225] Updated weights for policy 1, policy_version 1775639 (0.0008) [2023-12-28 07:59:30,241][106226] Updated weights for policy 0, policy_version 1771249 (0.0007) [2023-12-28 07:59:30,301][106226] Updated weights for policy 0, policy_version 1771259 (0.0009) [2023-12-28 07:59:30,364][106226] Updated weights for policy 0, policy_version 1771269 (0.0009) [2023-12-28 07:59:30,813][106225] Updated weights for policy 1, policy_version 1775649 (0.0007) [2023-12-28 07:59:30,865][106225] Updated weights for policy 1, policy_version 1775659 (0.0009) [2023-12-28 07:59:30,919][106225] Updated weights for policy 1, policy_version 1775669 (0.0008) [2023-12-28 07:59:30,977][106225] Updated weights for policy 1, policy_version 1775679 (0.0009) [2023-12-28 07:59:31,088][106226] Updated weights for policy 0, policy_version 1771279 (0.0008) [2023-12-28 07:59:31,155][106226] Updated weights for policy 0, policy_version 1771289 (0.0007) [2023-12-28 07:59:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 908156928. Throughput: 0: 9930.8, 1: 10026.7. Samples: 908149068. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:31,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.551')] [2023-12-28 07:59:31,218][106226] Updated weights for policy 0, policy_version 1771299 (0.0007) [2023-12-28 07:59:31,712][106225] Updated weights for policy 1, policy_version 1775689 (0.0009) [2023-12-28 07:59:31,775][106225] Updated weights for policy 1, policy_version 1775699 (0.0008) [2023-12-28 07:59:31,820][106225] Updated weights for policy 1, policy_version 1775709 (0.0008) [2023-12-28 07:59:31,984][106226] Updated weights for policy 0, policy_version 1771309 (0.0008) [2023-12-28 07:59:32,041][106226] Updated weights for policy 0, policy_version 1771319 (0.0008) [2023-12-28 07:59:32,093][106226] Updated weights for policy 0, policy_version 1771329 (0.0009) [2023-12-28 07:59:32,461][106225] Updated weights for policy 1, policy_version 1775719 (0.0009) [2023-12-28 07:59:32,513][106225] Updated weights for policy 1, policy_version 1775729 (0.0006) [2023-12-28 07:59:32,565][106225] Updated weights for policy 1, policy_version 1775739 (0.0005) [2023-12-28 07:59:32,850][106226] Updated weights for policy 0, policy_version 1771339 (0.0008) [2023-12-28 07:59:32,913][106226] Updated weights for policy 0, policy_version 1771349 (0.0009) [2023-12-28 07:59:32,974][106226] Updated weights for policy 0, policy_version 1771359 (0.0007) [2023-12-28 07:59:33,179][106225] Updated weights for policy 1, policy_version 1775749 (0.0008) [2023-12-28 07:59:33,228][106225] Updated weights for policy 1, policy_version 1775759 (0.0008) [2023-12-28 07:59:33,277][106225] Updated weights for policy 1, policy_version 1775769 (0.0005) [2023-12-28 07:59:33,503][106226] Updated weights for policy 0, policy_version 1771369 (0.0006) [2023-12-28 07:59:33,555][106226] Updated weights for policy 0, policy_version 1771379 (0.0008) [2023-12-28 07:59:33,603][106226] Updated weights for policy 0, policy_version 1771389 (0.0008) [2023-12-28 07:59:33,657][106226] Updated weights for policy 0, policy_version 1771399 (0.0007) [2023-12-28 07:59:33,927][106225] Updated weights for policy 1, policy_version 1775779 (0.0007) [2023-12-28 07:59:33,982][106225] Updated weights for policy 1, policy_version 1775789 (0.0010) [2023-12-28 07:59:34,040][106225] Updated weights for policy 1, policy_version 1775799 (0.0010) [2023-12-28 07:59:34,420][106226] Updated weights for policy 0, policy_version 1771409 (0.0009) [2023-12-28 07:59:34,474][106226] Updated weights for policy 0, policy_version 1771419 (0.0008) [2023-12-28 07:59:34,538][106226] Updated weights for policy 0, policy_version 1771429 (0.0010) [2023-12-28 07:59:34,732][106225] Updated weights for policy 1, policy_version 1775809 (0.0009) [2023-12-28 07:59:34,785][106225] Updated weights for policy 1, policy_version 1775819 (0.0008) [2023-12-28 07:59:34,845][106225] Updated weights for policy 1, policy_version 1775829 (0.0008) [2023-12-28 07:59:34,903][106225] Updated weights for policy 1, policy_version 1775839 (0.0008) [2023-12-28 07:59:35,182][106226] Updated weights for policy 0, policy_version 1771439 (0.0007) [2023-12-28 07:59:35,250][106226] Updated weights for policy 0, policy_version 1771449 (0.0006) [2023-12-28 07:59:35,299][106226] Updated weights for policy 0, policy_version 1771459 (0.0010) [2023-12-28 07:59:35,676][106225] Updated weights for policy 1, policy_version 1775849 (0.0008) [2023-12-28 07:59:35,726][106225] Updated weights for policy 1, policy_version 1775860 (0.0008) [2023-12-28 07:59:35,781][106225] Updated weights for policy 1, policy_version 1775870 (0.0009) [2023-12-28 07:59:35,821][106226] Updated weights for policy 0, policy_version 1771469 (0.0008) [2023-12-28 07:59:35,885][106226] Updated weights for policy 0, policy_version 1771479 (0.0008) [2023-12-28 07:59:35,941][106226] Updated weights for policy 0, policy_version 1771489 (0.0009) [2023-12-28 07:59:36,174][105115] Fps is (10 sec: 21300.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 908263424. Throughput: 0: 9971.1, 1: 10059.1. Samples: 908271112. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:36,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.849')] [2023-12-28 07:59:36,547][106225] Updated weights for policy 1, policy_version 1775880 (0.0008) [2023-12-28 07:59:36,605][106226] Updated weights for policy 0, policy_version 1771499 (0.0007) [2023-12-28 07:59:36,615][106225] Updated weights for policy 1, policy_version 1775890 (0.0007) [2023-12-28 07:59:36,671][106226] Updated weights for policy 0, policy_version 1771509 (0.0009) [2023-12-28 07:59:36,676][106225] Updated weights for policy 1, policy_version 1775900 (0.0006) [2023-12-28 07:59:36,740][106226] Updated weights for policy 0, policy_version 1771519 (0.0008) [2023-12-28 07:59:37,334][106225] Updated weights for policy 1, policy_version 1775910 (0.0005) [2023-12-28 07:59:37,385][106225] Updated weights for policy 1, policy_version 1775920 (0.0005) [2023-12-28 07:59:37,436][106225] Updated weights for policy 1, policy_version 1775930 (0.0005) [2023-12-28 07:59:37,444][106226] Updated weights for policy 0, policy_version 1771529 (0.0008) [2023-12-28 07:59:37,494][106226] Updated weights for policy 0, policy_version 1771539 (0.0010) [2023-12-28 07:59:37,549][106226] Updated weights for policy 0, policy_version 1771549 (0.0008) [2023-12-28 07:59:37,600][106226] Updated weights for policy 0, policy_version 1771559 (0.0006) [2023-12-28 07:59:38,042][106225] Updated weights for policy 1, policy_version 1775940 (0.0007) [2023-12-28 07:59:38,090][106225] Updated weights for policy 1, policy_version 1775950 (0.0008) [2023-12-28 07:59:38,148][106225] Updated weights for policy 1, policy_version 1775960 (0.0007) [2023-12-28 07:59:38,239][106226] Updated weights for policy 0, policy_version 1771569 (0.0007) [2023-12-28 07:59:38,292][106226] Updated weights for policy 0, policy_version 1771579 (0.0010) [2023-12-28 07:59:38,350][106226] Updated weights for policy 0, policy_version 1771589 (0.0007) [2023-12-28 07:59:38,885][106225] Updated weights for policy 1, policy_version 1775970 (0.0008) [2023-12-28 07:59:38,948][106225] Updated weights for policy 1, policy_version 1775980 (0.0007) [2023-12-28 07:59:38,992][106226] Updated weights for policy 0, policy_version 1771599 (0.0009) [2023-12-28 07:59:39,006][106225] Updated weights for policy 1, policy_version 1775990 (0.0005) [2023-12-28 07:59:39,053][106226] Updated weights for policy 0, policy_version 1771609 (0.0008) [2023-12-28 07:59:39,059][106225] Updated weights for policy 1, policy_version 1776000 (0.0006) [2023-12-28 07:59:39,113][106226] Updated weights for policy 0, policy_version 1771619 (0.0009) [2023-12-28 07:59:39,835][106225] Updated weights for policy 1, policy_version 1776010 (0.0008) [2023-12-28 07:59:39,869][106226] Updated weights for policy 0, policy_version 1771629 (0.0010) [2023-12-28 07:59:39,897][106225] Updated weights for policy 1, policy_version 1776020 (0.0009) [2023-12-28 07:59:39,930][106226] Updated weights for policy 0, policy_version 1771639 (0.0009) [2023-12-28 07:59:39,962][106225] Updated weights for policy 1, policy_version 1776030 (0.0008) [2023-12-28 07:59:39,999][106226] Updated weights for policy 0, policy_version 1771649 (0.0008) [2023-12-28 07:59:40,575][106225] Updated weights for policy 1, policy_version 1776040 (0.0005) [2023-12-28 07:59:40,644][106225] Updated weights for policy 1, policy_version 1776050 (0.0008) [2023-12-28 07:59:40,708][106225] Updated weights for policy 1, policy_version 1776060 (0.0006) [2023-12-28 07:59:40,814][106226] Updated weights for policy 0, policy_version 1771659 (0.0009) [2023-12-28 07:59:40,878][106226] Updated weights for policy 0, policy_version 1771669 (0.0009) [2023-12-28 07:59:40,941][106226] Updated weights for policy 0, policy_version 1771679 (0.0010) [2023-12-28 07:59:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 908361728. Throughput: 0: 10009.1, 1: 10100.7. Samples: 908332736. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:41,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.793')] [2023-12-28 07:59:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001776064_454729728.pth... [2023-12-28 07:59:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001771688_453632000.pth... [2023-12-28 07:59:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001774880_454426624.pth [2023-12-28 07:59:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001770536_453337088.pth [2023-12-28 07:59:41,327][106225] Updated weights for policy 1, policy_version 1776070 (0.0008) [2023-12-28 07:59:41,401][106225] Updated weights for policy 1, policy_version 1776080 (0.0008) [2023-12-28 07:59:41,464][106225] Updated weights for policy 1, policy_version 1776090 (0.0008) [2023-12-28 07:59:41,768][106226] Updated weights for policy 0, policy_version 1771689 (0.0008) [2023-12-28 07:59:41,829][106226] Updated weights for policy 0, policy_version 1771699 (0.0011) [2023-12-28 07:59:41,897][106226] Updated weights for policy 0, policy_version 1771709 (0.0011) [2023-12-28 07:59:41,955][106226] Updated weights for policy 0, policy_version 1771719 (0.0011) [2023-12-28 07:59:42,197][106225] Updated weights for policy 1, policy_version 1776100 (0.0007) [2023-12-28 07:59:42,263][106225] Updated weights for policy 1, policy_version 1776110 (0.0006) [2023-12-28 07:59:42,326][106225] Updated weights for policy 1, policy_version 1776120 (0.0008) [2023-12-28 07:59:42,662][106226] Updated weights for policy 0, policy_version 1771729 (0.0009) [2023-12-28 07:59:42,727][106226] Updated weights for policy 0, policy_version 1771739 (0.0008) [2023-12-28 07:59:42,777][106226] Updated weights for policy 0, policy_version 1771749 (0.0009) [2023-12-28 07:59:43,037][106225] Updated weights for policy 1, policy_version 1776130 (0.0008) [2023-12-28 07:59:43,090][106225] Updated weights for policy 1, policy_version 1776140 (0.0010) [2023-12-28 07:59:43,153][106225] Updated weights for policy 1, policy_version 1776150 (0.0008) [2023-12-28 07:59:43,216][106225] Updated weights for policy 1, policy_version 1776160 (0.0010) [2023-12-28 07:59:43,416][106226] Updated weights for policy 0, policy_version 1771759 (0.0009) [2023-12-28 07:59:43,462][106226] Updated weights for policy 0, policy_version 1771769 (0.0010) [2023-12-28 07:59:43,508][106226] Updated weights for policy 0, policy_version 1771779 (0.0010) [2023-12-28 07:59:43,963][106225] Updated weights for policy 1, policy_version 1776170 (0.0008) [2023-12-28 07:59:44,019][106225] Updated weights for policy 1, policy_version 1776180 (0.0008) [2023-12-28 07:59:44,072][106225] Updated weights for policy 1, policy_version 1776190 (0.0008) [2023-12-28 07:59:44,237][106226] Updated weights for policy 0, policy_version 1771789 (0.0010) [2023-12-28 07:59:44,306][106226] Updated weights for policy 0, policy_version 1771799 (0.0011) [2023-12-28 07:59:44,367][106226] Updated weights for policy 0, policy_version 1771809 (0.0010) [2023-12-28 07:59:44,818][106225] Updated weights for policy 1, policy_version 1776200 (0.0008) [2023-12-28 07:59:44,877][106225] Updated weights for policy 1, policy_version 1776210 (0.0008) [2023-12-28 07:59:44,934][106225] Updated weights for policy 1, policy_version 1776220 (0.0008) [2023-12-28 07:59:45,070][106226] Updated weights for policy 0, policy_version 1771819 (0.0010) [2023-12-28 07:59:45,128][106226] Updated weights for policy 0, policy_version 1771829 (0.0011) [2023-12-28 07:59:45,194][106226] Updated weights for policy 0, policy_version 1771839 (0.0011) [2023-12-28 07:59:45,686][106225] Updated weights for policy 1, policy_version 1776230 (0.0008) [2023-12-28 07:59:45,733][106225] Updated weights for policy 1, policy_version 1776240 (0.0007) [2023-12-28 07:59:45,790][106225] Updated weights for policy 1, policy_version 1776250 (0.0008) [2023-12-28 07:59:45,912][106226] Updated weights for policy 0, policy_version 1771849 (0.0011) [2023-12-28 07:59:45,965][106226] Updated weights for policy 0, policy_version 1771859 (0.0009) [2023-12-28 07:59:46,022][106226] Updated weights for policy 0, policy_version 1771869 (0.0009) [2023-12-28 07:59:46,077][106226] Updated weights for policy 0, policy_version 1771879 (0.0009) [2023-12-28 07:59:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 908460032. Throughput: 0: 9893.7, 1: 10131.2. Samples: 908447160. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:46,175][105115] Avg episode reward: [(0, '-3.977'), (1, '-4.794')] [2023-12-28 07:59:46,453][106225] Updated weights for policy 1, policy_version 1776260 (0.0007) [2023-12-28 07:59:46,518][106225] Updated weights for policy 1, policy_version 1776270 (0.0008) [2023-12-28 07:59:46,577][106225] Updated weights for policy 1, policy_version 1776280 (0.0008) [2023-12-28 07:59:46,806][106226] Updated weights for policy 0, policy_version 1771889 (0.0011) [2023-12-28 07:59:46,853][106226] Updated weights for policy 0, policy_version 1771899 (0.0011) [2023-12-28 07:59:46,900][106226] Updated weights for policy 0, policy_version 1771909 (0.0010) [2023-12-28 07:59:47,356][106225] Updated weights for policy 1, policy_version 1776290 (0.0008) [2023-12-28 07:59:47,406][106225] Updated weights for policy 1, policy_version 1776300 (0.0008) [2023-12-28 07:59:47,449][106225] Updated weights for policy 1, policy_version 1776310 (0.0008) [2023-12-28 07:59:47,506][106225] Updated weights for policy 1, policy_version 1776320 (0.0007) [2023-12-28 07:59:47,507][106226] Updated weights for policy 0, policy_version 1771919 (0.0009) [2023-12-28 07:59:47,553][106226] Updated weights for policy 0, policy_version 1771929 (0.0005) [2023-12-28 07:59:47,606][106226] Updated weights for policy 0, policy_version 1771939 (0.0005) [2023-12-28 07:59:48,205][106226] Updated weights for policy 0, policy_version 1771949 (0.0008) [2023-12-28 07:59:48,265][106226] Updated weights for policy 0, policy_version 1771959 (0.0010) [2023-12-28 07:59:48,273][106225] Updated weights for policy 1, policy_version 1776330 (0.0007) [2023-12-28 07:59:48,324][106226] Updated weights for policy 0, policy_version 1771969 (0.0010) [2023-12-28 07:59:48,329][106225] Updated weights for policy 1, policy_version 1776340 (0.0006) [2023-12-28 07:59:48,389][106225] Updated weights for policy 1, policy_version 1776350 (0.0007) [2023-12-28 07:59:48,995][106226] Updated weights for policy 0, policy_version 1771979 (0.0010) [2023-12-28 07:59:49,050][106226] Updated weights for policy 0, policy_version 1771989 (0.0011) [2023-12-28 07:59:49,100][106226] Updated weights for policy 0, policy_version 1771999 (0.0010) [2023-12-28 07:59:49,113][106225] Updated weights for policy 1, policy_version 1776360 (0.0006) [2023-12-28 07:59:49,164][106225] Updated weights for policy 1, policy_version 1776370 (0.0006) [2023-12-28 07:59:49,214][106225] Updated weights for policy 1, policy_version 1776380 (0.0008) [2023-12-28 07:59:49,819][106226] Updated weights for policy 0, policy_version 1772009 (0.0010) [2023-12-28 07:59:49,890][106226] Updated weights for policy 0, policy_version 1772019 (0.0009) [2023-12-28 07:59:49,917][106225] Updated weights for policy 1, policy_version 1776390 (0.0007) [2023-12-28 07:59:49,957][106226] Updated weights for policy 0, policy_version 1772029 (0.0008) [2023-12-28 07:59:49,989][106225] Updated weights for policy 1, policy_version 1776400 (0.0009) [2023-12-28 07:59:50,024][106226] Updated weights for policy 0, policy_version 1772039 (0.0006) [2023-12-28 07:59:50,054][106225] Updated weights for policy 1, policy_version 1776410 (0.0009) [2023-12-28 07:59:50,640][106226] Updated weights for policy 0, policy_version 1772049 (0.0009) [2023-12-28 07:59:50,702][106226] Updated weights for policy 0, policy_version 1772059 (0.0009) [2023-12-28 07:59:50,760][106226] Updated weights for policy 0, policy_version 1772069 (0.0008) [2023-12-28 07:59:50,889][106225] Updated weights for policy 1, policy_version 1776420 (0.0010) [2023-12-28 07:59:50,955][106225] Updated weights for policy 1, policy_version 1776430 (0.0010) [2023-12-28 07:59:51,014][106225] Updated weights for policy 1, policy_version 1776440 (0.0009) [2023-12-28 07:59:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 908558336. Throughput: 0: 9907.6, 1: 9971.6. Samples: 908565956. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:51,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.868')] [2023-12-28 07:59:51,463][106226] Updated weights for policy 0, policy_version 1772079 (0.0006) [2023-12-28 07:59:51,525][106226] Updated weights for policy 0, policy_version 1772089 (0.0006) [2023-12-28 07:59:51,595][106226] Updated weights for policy 0, policy_version 1772099 (0.0007) [2023-12-28 07:59:51,746][106225] Updated weights for policy 1, policy_version 1776450 (0.0009) [2023-12-28 07:59:51,811][106225] Updated weights for policy 1, policy_version 1776460 (0.0009) [2023-12-28 07:59:51,872][106225] Updated weights for policy 1, policy_version 1776470 (0.0009) [2023-12-28 07:59:51,938][106225] Updated weights for policy 1, policy_version 1776480 (0.0008) [2023-12-28 07:59:52,233][106226] Updated weights for policy 0, policy_version 1772109 (0.0008) [2023-12-28 07:59:52,296][106226] Updated weights for policy 0, policy_version 1772119 (0.0008) [2023-12-28 07:59:52,351][106226] Updated weights for policy 0, policy_version 1772129 (0.0007) [2023-12-28 07:59:52,713][106225] Updated weights for policy 1, policy_version 1776490 (0.0010) [2023-12-28 07:59:52,766][106225] Updated weights for policy 1, policy_version 1776500 (0.0009) [2023-12-28 07:59:52,822][106225] Updated weights for policy 1, policy_version 1776510 (0.0009) [2023-12-28 07:59:53,078][106226] Updated weights for policy 0, policy_version 1772139 (0.0007) [2023-12-28 07:59:53,144][106226] Updated weights for policy 0, policy_version 1772149 (0.0005) [2023-12-28 07:59:53,196][106226] Updated weights for policy 0, policy_version 1772159 (0.0006) [2023-12-28 07:59:53,477][106225] Updated weights for policy 1, policy_version 1776520 (0.0006) [2023-12-28 07:59:53,525][106225] Updated weights for policy 1, policy_version 1776530 (0.0009) [2023-12-28 07:59:53,582][106225] Updated weights for policy 1, policy_version 1776540 (0.0010) [2023-12-28 07:59:53,745][106226] Updated weights for policy 0, policy_version 1772169 (0.0007) [2023-12-28 07:59:53,819][106226] Updated weights for policy 0, policy_version 1772179 (0.0008) [2023-12-28 07:59:53,886][106226] Updated weights for policy 0, policy_version 1772189 (0.0008) [2023-12-28 07:59:53,950][106226] Updated weights for policy 0, policy_version 1772199 (0.0006) [2023-12-28 07:59:54,295][106225] Updated weights for policy 1, policy_version 1776550 (0.0009) [2023-12-28 07:59:54,359][106225] Updated weights for policy 1, policy_version 1776560 (0.0009) [2023-12-28 07:59:54,426][106225] Updated weights for policy 1, policy_version 1776570 (0.0010) [2023-12-28 07:59:54,577][106226] Updated weights for policy 0, policy_version 1772209 (0.0008) [2023-12-28 07:59:54,634][106226] Updated weights for policy 0, policy_version 1772219 (0.0008) [2023-12-28 07:59:54,686][106226] Updated weights for policy 0, policy_version 1772229 (0.0008) [2023-12-28 07:59:55,186][106225] Updated weights for policy 1, policy_version 1776580 (0.0008) [2023-12-28 07:59:55,241][106225] Updated weights for policy 1, policy_version 1776590 (0.0008) [2023-12-28 07:59:55,298][106225] Updated weights for policy 1, policy_version 1776600 (0.0009) [2023-12-28 07:59:55,338][106226] Updated weights for policy 0, policy_version 1772239 (0.0006) [2023-12-28 07:59:55,392][106226] Updated weights for policy 0, policy_version 1772249 (0.0006) [2023-12-28 07:59:55,442][106226] Updated weights for policy 0, policy_version 1772259 (0.0010) [2023-12-28 07:59:56,034][106225] Updated weights for policy 1, policy_version 1776610 (0.0008) [2023-12-28 07:59:56,083][106226] Updated weights for policy 0, policy_version 1772269 (0.0010) [2023-12-28 07:59:56,092][106225] Updated weights for policy 1, policy_version 1776620 (0.0008) [2023-12-28 07:59:56,140][106226] Updated weights for policy 0, policy_version 1772279 (0.0011) [2023-12-28 07:59:56,150][106225] Updated weights for policy 1, policy_version 1776630 (0.0005) [2023-12-28 07:59:56,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.5, 300 sec: 19799.7). Total num frames: 908648448. Throughput: 0: 9909.7, 1: 9969.9. Samples: 908625428. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 07:59:56,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.615')] [2023-12-28 07:59:56,197][106226] Updated weights for policy 0, policy_version 1772289 (0.0010) [2023-12-28 07:59:56,213][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001776640_454877184.pth... [2023-12-28 07:59:56,214][106225] Updated weights for policy 1, policy_version 1776640 (0.0005) [2023-12-28 07:59:56,217][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001775456_454574080.pth [2023-12-28 07:59:56,232][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001772296_453787648.pth... [2023-12-28 07:59:56,235][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001771080_453476352.pth [2023-12-28 07:59:56,844][106226] Updated weights for policy 0, policy_version 1772299 (0.0009) [2023-12-28 07:59:56,899][106226] Updated weights for policy 0, policy_version 1772309 (0.0005) [2023-12-28 07:59:56,950][106226] Updated weights for policy 0, policy_version 1772319 (0.0006) [2023-12-28 07:59:56,970][106225] Updated weights for policy 1, policy_version 1776650 (0.0007) [2023-12-28 07:59:57,031][106225] Updated weights for policy 1, policy_version 1776660 (0.0008) [2023-12-28 07:59:57,098][106225] Updated weights for policy 1, policy_version 1776670 (0.0009) [2023-12-28 07:59:57,570][106226] Updated weights for policy 0, policy_version 1772329 (0.0005) [2023-12-28 07:59:57,627][106226] Updated weights for policy 0, policy_version 1772339 (0.0006) [2023-12-28 07:59:57,691][106226] Updated weights for policy 0, policy_version 1772349 (0.0005) [2023-12-28 07:59:57,748][106226] Updated weights for policy 0, policy_version 1772359 (0.0005) [2023-12-28 07:59:57,760][106225] Updated weights for policy 1, policy_version 1776680 (0.0006) [2023-12-28 07:59:57,816][106225] Updated weights for policy 1, policy_version 1776690 (0.0005) [2023-12-28 07:59:57,871][106225] Updated weights for policy 1, policy_version 1776700 (0.0005) [2023-12-28 07:59:58,284][106226] Updated weights for policy 0, policy_version 1772369 (0.0006) [2023-12-28 07:59:58,371][106226] Updated weights for policy 0, policy_version 1772379 (0.0008) [2023-12-28 07:59:58,439][106226] Updated weights for policy 0, policy_version 1772389 (0.0008) [2023-12-28 07:59:58,556][106225] Updated weights for policy 1, policy_version 1776710 (0.0008) [2023-12-28 07:59:58,617][106225] Updated weights for policy 1, policy_version 1776720 (0.0008) [2023-12-28 07:59:58,676][106225] Updated weights for policy 1, policy_version 1776730 (0.0008) [2023-12-28 07:59:59,191][106226] Updated weights for policy 0, policy_version 1772399 (0.0008) [2023-12-28 07:59:59,262][106226] Updated weights for policy 0, policy_version 1772409 (0.0009) [2023-12-28 07:59:59,322][106226] Updated weights for policy 0, policy_version 1772419 (0.0008) [2023-12-28 07:59:59,549][106225] Updated weights for policy 1, policy_version 1776740 (0.0008) [2023-12-28 07:59:59,610][106225] Updated weights for policy 1, policy_version 1776750 (0.0008) [2023-12-28 07:59:59,674][106225] Updated weights for policy 1, policy_version 1776760 (0.0009) [2023-12-28 08:00:00,091][106226] Updated weights for policy 0, policy_version 1772429 (0.0008) [2023-12-28 08:00:00,145][106226] Updated weights for policy 0, policy_version 1772439 (0.0011) [2023-12-28 08:00:00,202][106226] Updated weights for policy 0, policy_version 1772449 (0.0011) [2023-12-28 08:00:00,363][106225] Updated weights for policy 1, policy_version 1776770 (0.0008) [2023-12-28 08:00:00,423][106225] Updated weights for policy 1, policy_version 1776780 (0.0010) [2023-12-28 08:00:00,476][106225] Updated weights for policy 1, policy_version 1776790 (0.0010) [2023-12-28 08:00:00,532][106225] Updated weights for policy 1, policy_version 1776800 (0.0010) [2023-12-28 08:00:00,845][106226] Updated weights for policy 0, policy_version 1772459 (0.0010) [2023-12-28 08:00:00,907][106226] Updated weights for policy 0, policy_version 1772469 (0.0008) [2023-12-28 08:00:00,963][106226] Updated weights for policy 0, policy_version 1772479 (0.0009) [2023-12-28 08:00:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 908754944. Throughput: 0: 10015.3, 1: 9901.8. Samples: 908744528. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:01,175][105115] Avg episode reward: [(0, '-4.609'), (1, '-4.623')] [2023-12-28 08:00:01,273][106225] Updated weights for policy 1, policy_version 1776810 (0.0009) [2023-12-28 08:00:01,339][106225] Updated weights for policy 1, policy_version 1776820 (0.0008) [2023-12-28 08:00:01,404][106225] Updated weights for policy 1, policy_version 1776830 (0.0008) [2023-12-28 08:00:01,636][106226] Updated weights for policy 0, policy_version 1772489 (0.0008) [2023-12-28 08:00:01,703][106226] Updated weights for policy 0, policy_version 1772499 (0.0009) [2023-12-28 08:00:01,776][106226] Updated weights for policy 0, policy_version 1772509 (0.0008) [2023-12-28 08:00:01,840][106226] Updated weights for policy 0, policy_version 1772519 (0.0006) [2023-12-28 08:00:02,129][106225] Updated weights for policy 1, policy_version 1776840 (0.0007) [2023-12-28 08:00:02,197][106225] Updated weights for policy 1, policy_version 1776850 (0.0008) [2023-12-28 08:00:02,262][106225] Updated weights for policy 1, policy_version 1776860 (0.0008) [2023-12-28 08:00:02,620][106226] Updated weights for policy 0, policy_version 1772529 (0.0006) [2023-12-28 08:00:02,683][106226] Updated weights for policy 0, policy_version 1772539 (0.0006) [2023-12-28 08:00:02,751][106226] Updated weights for policy 0, policy_version 1772549 (0.0007) [2023-12-28 08:00:03,059][106225] Updated weights for policy 1, policy_version 1776870 (0.0009) [2023-12-28 08:00:03,118][106225] Updated weights for policy 1, policy_version 1776880 (0.0008) [2023-12-28 08:00:03,173][106225] Updated weights for policy 1, policy_version 1776890 (0.0008) [2023-12-28 08:00:03,392][106226] Updated weights for policy 0, policy_version 1772559 (0.0009) [2023-12-28 08:00:03,446][106226] Updated weights for policy 0, policy_version 1772569 (0.0008) [2023-12-28 08:00:03,509][106226] Updated weights for policy 0, policy_version 1772579 (0.0008) [2023-12-28 08:00:03,934][106225] Updated weights for policy 1, policy_version 1776900 (0.0008) [2023-12-28 08:00:04,003][106225] Updated weights for policy 1, policy_version 1776910 (0.0008) [2023-12-28 08:00:04,069][106225] Updated weights for policy 1, policy_version 1776920 (0.0007) [2023-12-28 08:00:04,326][106226] Updated weights for policy 0, policy_version 1772589 (0.0009) [2023-12-28 08:00:04,397][106226] Updated weights for policy 0, policy_version 1772599 (0.0009) [2023-12-28 08:00:04,470][106226] Updated weights for policy 0, policy_version 1772609 (0.0009) [2023-12-28 08:00:04,862][106225] Updated weights for policy 1, policy_version 1776930 (0.0008) [2023-12-28 08:00:04,922][106225] Updated weights for policy 1, policy_version 1776940 (0.0005) [2023-12-28 08:00:04,986][106225] Updated weights for policy 1, policy_version 1776950 (0.0005) [2023-12-28 08:00:05,036][106225] Updated weights for policy 1, policy_version 1776960 (0.0006) [2023-12-28 08:00:05,243][106226] Updated weights for policy 0, policy_version 1772619 (0.0009) [2023-12-28 08:00:05,292][106226] Updated weights for policy 0, policy_version 1772629 (0.0009) [2023-12-28 08:00:05,337][106226] Updated weights for policy 0, policy_version 1772639 (0.0009) [2023-12-28 08:00:05,603][106225] Updated weights for policy 1, policy_version 1776970 (0.0008) [2023-12-28 08:00:05,660][106225] Updated weights for policy 1, policy_version 1776980 (0.0010) [2023-12-28 08:00:05,709][106225] Updated weights for policy 1, policy_version 1776991 (0.0009) [2023-12-28 08:00:06,083][106226] Updated weights for policy 0, policy_version 1772649 (0.0008) [2023-12-28 08:00:06,155][106226] Updated weights for policy 0, policy_version 1772659 (0.0008) [2023-12-28 08:00:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 908845056. Throughput: 0: 9986.7, 1: 9858.1. Samples: 908859444. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:06,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-5.109')] [2023-12-28 08:00:06,215][106226] Updated weights for policy 0, policy_version 1772669 (0.0008) [2023-12-28 08:00:06,278][106226] Updated weights for policy 0, policy_version 1772679 (0.0008) [2023-12-28 08:00:06,319][106225] Updated weights for policy 1, policy_version 1777001 (0.0010) [2023-12-28 08:00:06,377][106225] Updated weights for policy 1, policy_version 1777011 (0.0010) [2023-12-28 08:00:06,443][106225] Updated weights for policy 1, policy_version 1777021 (0.0011) [2023-12-28 08:00:07,003][106226] Updated weights for policy 0, policy_version 1772689 (0.0007) [2023-12-28 08:00:07,058][106226] Updated weights for policy 0, policy_version 1772699 (0.0010) [2023-12-28 08:00:07,105][106225] Updated weights for policy 1, policy_version 1777031 (0.0011) [2023-12-28 08:00:07,114][106226] Updated weights for policy 0, policy_version 1772709 (0.0010) [2023-12-28 08:00:07,164][106225] Updated weights for policy 1, policy_version 1777041 (0.0009) [2023-12-28 08:00:07,238][106225] Updated weights for policy 1, policy_version 1777051 (0.0010) [2023-12-28 08:00:07,770][106226] Updated weights for policy 0, policy_version 1772719 (0.0007) [2023-12-28 08:00:07,837][106226] Updated weights for policy 0, policy_version 1772729 (0.0008) [2023-12-28 08:00:07,900][106226] Updated weights for policy 0, policy_version 1772739 (0.0008) [2023-12-28 08:00:07,968][106225] Updated weights for policy 1, policy_version 1777061 (0.0010) [2023-12-28 08:00:08,030][106225] Updated weights for policy 1, policy_version 1777071 (0.0011) [2023-12-28 08:00:08,080][106225] Updated weights for policy 1, policy_version 1777081 (0.0010) [2023-12-28 08:00:08,616][106226] Updated weights for policy 0, policy_version 1772749 (0.0008) [2023-12-28 08:00:08,684][106226] Updated weights for policy 0, policy_version 1772759 (0.0007) [2023-12-28 08:00:08,752][106226] Updated weights for policy 0, policy_version 1772769 (0.0006) [2023-12-28 08:00:08,813][106225] Updated weights for policy 1, policy_version 1777091 (0.0009) [2023-12-28 08:00:08,870][106225] Updated weights for policy 1, policy_version 1777101 (0.0007) [2023-12-28 08:00:08,932][106225] Updated weights for policy 1, policy_version 1777111 (0.0007) [2023-12-28 08:00:09,495][106226] Updated weights for policy 0, policy_version 1772779 (0.0006) [2023-12-28 08:00:09,561][106226] Updated weights for policy 0, policy_version 1772789 (0.0008) [2023-12-28 08:00:09,629][106226] Updated weights for policy 0, policy_version 1772799 (0.0008) [2023-12-28 08:00:09,737][106225] Updated weights for policy 1, policy_version 1777121 (0.0006) [2023-12-28 08:00:09,800][106225] Updated weights for policy 1, policy_version 1777131 (0.0009) [2023-12-28 08:00:09,874][106225] Updated weights for policy 1, policy_version 1777141 (0.0009) [2023-12-28 08:00:09,949][106225] Updated weights for policy 1, policy_version 1777151 (0.0009) [2023-12-28 08:00:10,281][106226] Updated weights for policy 0, policy_version 1772809 (0.0009) [2023-12-28 08:00:10,338][106226] Updated weights for policy 0, policy_version 1772819 (0.0008) [2023-12-28 08:00:10,398][106226] Updated weights for policy 0, policy_version 1772829 (0.0009) [2023-12-28 08:00:10,452][106226] Updated weights for policy 0, policy_version 1772839 (0.0007) [2023-12-28 08:00:10,741][106225] Updated weights for policy 1, policy_version 1777161 (0.0008) [2023-12-28 08:00:10,791][106225] Updated weights for policy 1, policy_version 1777171 (0.0009) [2023-12-28 08:00:10,841][106225] Updated weights for policy 1, policy_version 1777181 (0.0008) [2023-12-28 08:00:11,028][106226] Updated weights for policy 0, policy_version 1772849 (0.0008) [2023-12-28 08:00:11,087][106226] Updated weights for policy 0, policy_version 1772859 (0.0007) [2023-12-28 08:00:11,160][106226] Updated weights for policy 0, policy_version 1772869 (0.0008) [2023-12-28 08:00:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 908943360. Throughput: 0: 9995.8, 1: 9922.5. Samples: 908918492. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:11,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.445')] [2023-12-28 08:00:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001777184_455016448.pth... [2023-12-28 08:00:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001772872_453935104.pth... [2023-12-28 08:00:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001771688_453632000.pth [2023-12-28 08:00:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001776064_454729728.pth [2023-12-28 08:00:11,681][106225] Updated weights for policy 1, policy_version 1777191 (0.0010) [2023-12-28 08:00:11,752][106225] Updated weights for policy 1, policy_version 1777201 (0.0011) [2023-12-28 08:00:11,815][106225] Updated weights for policy 1, policy_version 1777211 (0.0009) [2023-12-28 08:00:11,957][106226] Updated weights for policy 0, policy_version 1772879 (0.0006) [2023-12-28 08:00:12,020][106226] Updated weights for policy 0, policy_version 1772889 (0.0007) [2023-12-28 08:00:12,074][106226] Updated weights for policy 0, policy_version 1772899 (0.0008) [2023-12-28 08:00:12,591][106225] Updated weights for policy 1, policy_version 1777221 (0.0010) [2023-12-28 08:00:12,646][106225] Updated weights for policy 1, policy_version 1777231 (0.0011) [2023-12-28 08:00:12,697][106225] Updated weights for policy 1, policy_version 1777241 (0.0010) [2023-12-28 08:00:12,804][106226] Updated weights for policy 0, policy_version 1772909 (0.0008) [2023-12-28 08:00:12,860][106226] Updated weights for policy 0, policy_version 1772919 (0.0006) [2023-12-28 08:00:12,923][106226] Updated weights for policy 0, policy_version 1772929 (0.0007) [2023-12-28 08:00:13,405][106225] Updated weights for policy 1, policy_version 1777251 (0.0009) [2023-12-28 08:00:13,469][106225] Updated weights for policy 1, policy_version 1777261 (0.0007) [2023-12-28 08:00:13,527][106225] Updated weights for policy 1, policy_version 1777271 (0.0008) [2023-12-28 08:00:13,621][106226] Updated weights for policy 0, policy_version 1772939 (0.0008) [2023-12-28 08:00:13,685][106226] Updated weights for policy 0, policy_version 1772949 (0.0011) [2023-12-28 08:00:13,748][106226] Updated weights for policy 0, policy_version 1772959 (0.0011) [2023-12-28 08:00:14,229][106225] Updated weights for policy 1, policy_version 1777281 (0.0008) [2023-12-28 08:00:14,284][106225] Updated weights for policy 1, policy_version 1777291 (0.0008) [2023-12-28 08:00:14,337][106225] Updated weights for policy 1, policy_version 1777301 (0.0008) [2023-12-28 08:00:14,399][106225] Updated weights for policy 1, policy_version 1777311 (0.0008) [2023-12-28 08:00:14,487][106226] Updated weights for policy 0, policy_version 1772969 (0.0011) [2023-12-28 08:00:14,538][106226] Updated weights for policy 0, policy_version 1772979 (0.0010) [2023-12-28 08:00:14,595][106226] Updated weights for policy 0, policy_version 1772989 (0.0006) [2023-12-28 08:00:14,652][106226] Updated weights for policy 0, policy_version 1772999 (0.0010) [2023-12-28 08:00:15,137][106225] Updated weights for policy 1, policy_version 1777321 (0.0006) [2023-12-28 08:00:15,204][106225] Updated weights for policy 1, policy_version 1777331 (0.0006) [2023-12-28 08:00:15,267][106225] Updated weights for policy 1, policy_version 1777341 (0.0008) [2023-12-28 08:00:15,346][106226] Updated weights for policy 0, policy_version 1773009 (0.0010) [2023-12-28 08:00:15,408][106226] Updated weights for policy 0, policy_version 1773019 (0.0010) [2023-12-28 08:00:15,465][106226] Updated weights for policy 0, policy_version 1773029 (0.0011) [2023-12-28 08:00:15,966][106225] Updated weights for policy 1, policy_version 1777351 (0.0008) [2023-12-28 08:00:16,019][106225] Updated weights for policy 1, policy_version 1777361 (0.0008) [2023-12-28 08:00:16,079][106225] Updated weights for policy 1, policy_version 1777371 (0.0005) [2023-12-28 08:00:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 909041664. Throughput: 0: 9975.7, 1: 9644.2. Samples: 909031964. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:16,175][105115] Avg episode reward: [(0, '-4.183'), (1, '-4.719')] [2023-12-28 08:00:16,243][106226] Updated weights for policy 0, policy_version 1773039 (0.0009) [2023-12-28 08:00:16,301][106226] Updated weights for policy 0, policy_version 1773049 (0.0008) [2023-12-28 08:00:16,355][106226] Updated weights for policy 0, policy_version 1773059 (0.0008) [2023-12-28 08:00:16,755][106225] Updated weights for policy 1, policy_version 1777381 (0.0006) [2023-12-28 08:00:16,811][106225] Updated weights for policy 1, policy_version 1777391 (0.0007) [2023-12-28 08:00:16,867][106225] Updated weights for policy 1, policy_version 1777401 (0.0010) [2023-12-28 08:00:16,984][106226] Updated weights for policy 0, policy_version 1773069 (0.0008) [2023-12-28 08:00:17,046][106226] Updated weights for policy 0, policy_version 1773079 (0.0009) [2023-12-28 08:00:17,107][106226] Updated weights for policy 0, policy_version 1773089 (0.0009) [2023-12-28 08:00:17,570][106225] Updated weights for policy 1, policy_version 1777411 (0.0010) [2023-12-28 08:00:17,623][106225] Updated weights for policy 1, policy_version 1777421 (0.0008) [2023-12-28 08:00:17,687][106225] Updated weights for policy 1, policy_version 1777431 (0.0009) [2023-12-28 08:00:17,826][106226] Updated weights for policy 0, policy_version 1773099 (0.0009) [2023-12-28 08:00:17,878][106226] Updated weights for policy 0, policy_version 1773109 (0.0008) [2023-12-28 08:00:17,928][106226] Updated weights for policy 0, policy_version 1773119 (0.0009) [2023-12-28 08:00:18,462][106225] Updated weights for policy 1, policy_version 1777441 (0.0009) [2023-12-28 08:00:18,522][106225] Updated weights for policy 1, policy_version 1777451 (0.0010) [2023-12-28 08:00:18,589][106225] Updated weights for policy 1, policy_version 1777461 (0.0011) [2023-12-28 08:00:18,644][106225] Updated weights for policy 1, policy_version 1777471 (0.0011) [2023-12-28 08:00:18,749][106226] Updated weights for policy 0, policy_version 1773129 (0.0009) [2023-12-28 08:00:18,803][106226] Updated weights for policy 0, policy_version 1773139 (0.0011) [2023-12-28 08:00:18,868][106226] Updated weights for policy 0, policy_version 1773149 (0.0011) [2023-12-28 08:00:18,929][106226] Updated weights for policy 0, policy_version 1773159 (0.0008) [2023-12-28 08:00:19,391][106225] Updated weights for policy 1, policy_version 1777481 (0.0008) [2023-12-28 08:00:19,460][106225] Updated weights for policy 1, policy_version 1777491 (0.0009) [2023-12-28 08:00:19,531][106225] Updated weights for policy 1, policy_version 1777501 (0.0008) [2023-12-28 08:00:19,734][106226] Updated weights for policy 0, policy_version 1773169 (0.0010) [2023-12-28 08:00:19,804][106226] Updated weights for policy 0, policy_version 1773179 (0.0009) [2023-12-28 08:00:19,875][106226] Updated weights for policy 0, policy_version 1773189 (0.0008) [2023-12-28 08:00:20,304][106225] Updated weights for policy 1, policy_version 1777511 (0.0010) [2023-12-28 08:00:20,365][106225] Updated weights for policy 1, policy_version 1777521 (0.0011) [2023-12-28 08:00:20,430][106225] Updated weights for policy 1, policy_version 1777531 (0.0011) [2023-12-28 08:00:20,663][106226] Updated weights for policy 0, policy_version 1773199 (0.0009) [2023-12-28 08:00:20,729][106226] Updated weights for policy 0, policy_version 1773209 (0.0011) [2023-12-28 08:00:20,800][106226] Updated weights for policy 0, policy_version 1773219 (0.0011) [2023-12-28 08:00:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 909131776. Throughput: 0: 9846.2, 1: 9536.7. Samples: 909143344. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:21,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-4.839')] [2023-12-28 08:00:21,186][106225] Updated weights for policy 1, policy_version 1777541 (0.0009) [2023-12-28 08:00:21,245][106225] Updated weights for policy 1, policy_version 1777551 (0.0008) [2023-12-28 08:00:21,316][106225] Updated weights for policy 1, policy_version 1777561 (0.0006) [2023-12-28 08:00:21,611][106226] Updated weights for policy 0, policy_version 1773229 (0.0010) [2023-12-28 08:00:21,684][106226] Updated weights for policy 0, policy_version 1773239 (0.0008) [2023-12-28 08:00:21,764][106226] Updated weights for policy 0, policy_version 1773249 (0.0008) [2023-12-28 08:00:22,170][106225] Updated weights for policy 1, policy_version 1777571 (0.0010) [2023-12-28 08:00:22,239][106225] Updated weights for policy 1, policy_version 1777581 (0.0008) [2023-12-28 08:00:22,310][106225] Updated weights for policy 1, policy_version 1777591 (0.0009) [2023-12-28 08:00:22,560][106226] Updated weights for policy 0, policy_version 1773259 (0.0008) [2023-12-28 08:00:22,628][106226] Updated weights for policy 0, policy_version 1773269 (0.0008) [2023-12-28 08:00:22,690][106226] Updated weights for policy 0, policy_version 1773279 (0.0009) [2023-12-28 08:00:23,056][106225] Updated weights for policy 1, policy_version 1777601 (0.0008) [2023-12-28 08:00:23,111][106225] Updated weights for policy 1, policy_version 1777611 (0.0006) [2023-12-28 08:00:23,172][106225] Updated weights for policy 1, policy_version 1777621 (0.0006) [2023-12-28 08:00:23,242][106225] Updated weights for policy 1, policy_version 1777631 (0.0007) [2023-12-28 08:00:23,464][106226] Updated weights for policy 0, policy_version 1773289 (0.0008) [2023-12-28 08:00:23,523][106226] Updated weights for policy 0, policy_version 1773299 (0.0009) [2023-12-28 08:00:23,589][106226] Updated weights for policy 0, policy_version 1773309 (0.0009) [2023-12-28 08:00:23,649][106226] Updated weights for policy 0, policy_version 1773319 (0.0008) [2023-12-28 08:00:23,858][106225] Updated weights for policy 1, policy_version 1777641 (0.0008) [2023-12-28 08:00:23,917][106225] Updated weights for policy 1, policy_version 1777651 (0.0008) [2023-12-28 08:00:23,986][106225] Updated weights for policy 1, policy_version 1777661 (0.0006) [2023-12-28 08:00:24,407][106226] Updated weights for policy 0, policy_version 1773329 (0.0008) [2023-12-28 08:00:24,475][106226] Updated weights for policy 0, policy_version 1773339 (0.0008) [2023-12-28 08:00:24,543][106226] Updated weights for policy 0, policy_version 1773349 (0.0008) [2023-12-28 08:00:24,708][106225] Updated weights for policy 1, policy_version 1777671 (0.0007) [2023-12-28 08:00:24,769][106225] Updated weights for policy 1, policy_version 1777681 (0.0008) [2023-12-28 08:00:24,831][106225] Updated weights for policy 1, policy_version 1777691 (0.0008) [2023-12-28 08:00:25,267][106226] Updated weights for policy 0, policy_version 1773359 (0.0009) [2023-12-28 08:00:25,318][106226] Updated weights for policy 0, policy_version 1773369 (0.0009) [2023-12-28 08:00:25,383][106226] Updated weights for policy 0, policy_version 1773379 (0.0009) [2023-12-28 08:00:25,442][106225] Updated weights for policy 1, policy_version 1777701 (0.0008) [2023-12-28 08:00:25,510][106225] Updated weights for policy 1, policy_version 1777711 (0.0007) [2023-12-28 08:00:25,572][106225] Updated weights for policy 1, policy_version 1777721 (0.0008) [2023-12-28 08:00:26,039][106226] Updated weights for policy 0, policy_version 1773389 (0.0008) [2023-12-28 08:00:26,088][106226] Updated weights for policy 0, policy_version 1773399 (0.0008) [2023-12-28 08:00:26,142][106226] Updated weights for policy 0, policy_version 1773409 (0.0006) [2023-12-28 08:00:26,175][105115] Fps is (10 sec: 18022.3, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 909221888. Throughput: 0: 9738.7, 1: 9474.6. Samples: 909197332. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-28 08:00:26,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-5.024')] [2023-12-28 08:00:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001773416_454074368.pth... [2023-12-28 08:00:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001772296_453787648.pth [2023-12-28 08:00:26,199][106225] Updated weights for policy 1, policy_version 1777731 (0.0007) [2023-12-28 08:00:26,266][106225] Updated weights for policy 1, policy_version 1777741 (0.0005) [2023-12-28 08:00:26,322][106225] Updated weights for policy 1, policy_version 1777751 (0.0005) [2023-12-28 08:00:26,375][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001777760_455163904.pth... [2023-12-28 08:00:26,378][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001776640_454877184.pth [2023-12-28 08:00:26,751][106226] Updated weights for policy 0, policy_version 1773419 (0.0007) [2023-12-28 08:00:26,817][106226] Updated weights for policy 0, policy_version 1773429 (0.0011) [2023-12-28 08:00:26,834][106225] Updated weights for policy 1, policy_version 1777761 (0.0005) [2023-12-28 08:00:26,882][106226] Updated weights for policy 0, policy_version 1773439 (0.0011) [2023-12-28 08:00:26,898][106225] Updated weights for policy 1, policy_version 1777771 (0.0005) [2023-12-28 08:00:26,945][106225] Updated weights for policy 1, policy_version 1777781 (0.0009) [2023-12-28 08:00:26,995][106225] Updated weights for policy 1, policy_version 1777791 (0.0010) [2023-12-28 08:00:27,553][106226] Updated weights for policy 0, policy_version 1773449 (0.0011) [2023-12-28 08:00:27,613][106226] Updated weights for policy 0, policy_version 1773459 (0.0010) [2023-12-28 08:00:27,667][106225] Updated weights for policy 1, policy_version 1777801 (0.0010) [2023-12-28 08:00:27,675][106226] Updated weights for policy 0, policy_version 1773469 (0.0010) [2023-12-28 08:00:27,721][106225] Updated weights for policy 1, policy_version 1777811 (0.0010) [2023-12-28 08:00:27,723][106226] Updated weights for policy 0, policy_version 1773479 (0.0008) [2023-12-28 08:00:27,770][106225] Updated weights for policy 1, policy_version 1777821 (0.0010) [2023-12-28 08:00:28,294][106226] Updated weights for policy 0, policy_version 1773489 (0.0010) [2023-12-28 08:00:28,355][106226] Updated weights for policy 0, policy_version 1773499 (0.0010) [2023-12-28 08:00:28,408][106226] Updated weights for policy 0, policy_version 1773509 (0.0010) [2023-12-28 08:00:28,509][106225] Updated weights for policy 1, policy_version 1777831 (0.0008) [2023-12-28 08:00:28,573][106225] Updated weights for policy 1, policy_version 1777841 (0.0007) [2023-12-28 08:00:28,632][106225] Updated weights for policy 1, policy_version 1777851 (0.0007) [2023-12-28 08:00:29,058][106226] Updated weights for policy 0, policy_version 1773519 (0.0009) [2023-12-28 08:00:29,118][106226] Updated weights for policy 0, policy_version 1773529 (0.0011) [2023-12-28 08:00:29,182][106226] Updated weights for policy 0, policy_version 1773539 (0.0011) [2023-12-28 08:00:29,350][106225] Updated weights for policy 1, policy_version 1777861 (0.0008) [2023-12-28 08:00:29,418][106225] Updated weights for policy 1, policy_version 1777871 (0.0008) [2023-12-28 08:00:29,481][106225] Updated weights for policy 1, policy_version 1777881 (0.0008) [2023-12-28 08:00:29,860][106226] Updated weights for policy 0, policy_version 1773549 (0.0010) [2023-12-28 08:00:29,931][106226] Updated weights for policy 0, policy_version 1773559 (0.0006) [2023-12-28 08:00:29,994][106226] Updated weights for policy 0, policy_version 1773569 (0.0009) [2023-12-28 08:00:30,182][106225] Updated weights for policy 1, policy_version 1777891 (0.0007) [2023-12-28 08:00:30,245][106225] Updated weights for policy 1, policy_version 1777901 (0.0005) [2023-12-28 08:00:30,313][106225] Updated weights for policy 1, policy_version 1777911 (0.0006) [2023-12-28 08:00:30,751][106226] Updated weights for policy 0, policy_version 1773579 (0.0007) [2023-12-28 08:00:30,813][106226] Updated weights for policy 0, policy_version 1773589 (0.0007) [2023-12-28 08:00:30,882][106226] Updated weights for policy 0, policy_version 1773599 (0.0008) [2023-12-28 08:00:30,955][106225] Updated weights for policy 1, policy_version 1777921 (0.0009) [2023-12-28 08:00:31,021][106225] Updated weights for policy 1, policy_version 1777931 (0.0006) [2023-12-28 08:00:31,090][106225] Updated weights for policy 1, policy_version 1777941 (0.0008) [2023-12-28 08:00:31,152][106225] Updated weights for policy 1, policy_version 1777951 (0.0007) [2023-12-28 08:00:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 909336576. Throughput: 0: 9869.6, 1: 9557.3. Samples: 909321372. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:31,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.704')] [2023-12-28 08:00:31,581][106226] Updated weights for policy 0, policy_version 1773609 (0.0008) [2023-12-28 08:00:31,643][106226] Updated weights for policy 0, policy_version 1773619 (0.0010) [2023-12-28 08:00:31,711][106226] Updated weights for policy 0, policy_version 1773629 (0.0007) [2023-12-28 08:00:31,779][106226] Updated weights for policy 0, policy_version 1773639 (0.0009) [2023-12-28 08:00:31,923][106225] Updated weights for policy 1, policy_version 1777961 (0.0008) [2023-12-28 08:00:31,982][106225] Updated weights for policy 1, policy_version 1777971 (0.0008) [2023-12-28 08:00:32,045][106225] Updated weights for policy 1, policy_version 1777981 (0.0006) [2023-12-28 08:00:32,528][106226] Updated weights for policy 0, policy_version 1773649 (0.0011) [2023-12-28 08:00:32,592][106226] Updated weights for policy 0, policy_version 1773659 (0.0011) [2023-12-28 08:00:32,654][106226] Updated weights for policy 0, policy_version 1773669 (0.0011) [2023-12-28 08:00:32,760][106225] Updated weights for policy 1, policy_version 1777991 (0.0007) [2023-12-28 08:00:32,818][106225] Updated weights for policy 1, policy_version 1778001 (0.0008) [2023-12-28 08:00:32,876][106225] Updated weights for policy 1, policy_version 1778011 (0.0008) [2023-12-28 08:00:33,365][106226] Updated weights for policy 0, policy_version 1773679 (0.0011) [2023-12-28 08:00:33,429][106226] Updated weights for policy 0, policy_version 1773689 (0.0008) [2023-12-28 08:00:33,490][106226] Updated weights for policy 0, policy_version 1773699 (0.0006) [2023-12-28 08:00:33,615][106225] Updated weights for policy 1, policy_version 1778021 (0.0008) [2023-12-28 08:00:33,684][106225] Updated weights for policy 1, policy_version 1778031 (0.0008) [2023-12-28 08:00:33,743][106225] Updated weights for policy 1, policy_version 1778041 (0.0008) [2023-12-28 08:00:34,114][106226] Updated weights for policy 0, policy_version 1773709 (0.0007) [2023-12-28 08:00:34,177][106226] Updated weights for policy 0, policy_version 1773719 (0.0009) [2023-12-28 08:00:34,247][106226] Updated weights for policy 0, policy_version 1773729 (0.0010) [2023-12-28 08:00:34,538][106225] Updated weights for policy 1, policy_version 1778051 (0.0008) [2023-12-28 08:00:34,601][106225] Updated weights for policy 1, policy_version 1778061 (0.0009) [2023-12-28 08:00:34,663][106225] Updated weights for policy 1, policy_version 1778071 (0.0010) [2023-12-28 08:00:34,879][106226] Updated weights for policy 0, policy_version 1773739 (0.0010) [2023-12-28 08:00:34,927][106226] Updated weights for policy 0, policy_version 1773749 (0.0009) [2023-12-28 08:00:34,981][106226] Updated weights for policy 0, policy_version 1773759 (0.0008) [2023-12-28 08:00:35,395][106225] Updated weights for policy 1, policy_version 1778081 (0.0011) [2023-12-28 08:00:35,451][106225] Updated weights for policy 1, policy_version 1778091 (0.0010) [2023-12-28 08:00:35,511][106225] Updated weights for policy 1, policy_version 1778101 (0.0010) [2023-12-28 08:00:35,565][106225] Updated weights for policy 1, policy_version 1778111 (0.0010) [2023-12-28 08:00:35,636][106226] Updated weights for policy 0, policy_version 1773769 (0.0009) [2023-12-28 08:00:35,685][106226] Updated weights for policy 0, policy_version 1773779 (0.0010) [2023-12-28 08:00:35,746][106226] Updated weights for policy 0, policy_version 1773789 (0.0010) [2023-12-28 08:00:35,812][106226] Updated weights for policy 0, policy_version 1773799 (0.0010) [2023-12-28 08:00:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 909426688. Throughput: 0: 9807.9, 1: 9573.7. Samples: 909438128. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:36,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.381')] [2023-12-28 08:00:36,273][106225] Updated weights for policy 1, policy_version 1778121 (0.0010) [2023-12-28 08:00:36,331][106225] Updated weights for policy 1, policy_version 1778131 (0.0010) [2023-12-28 08:00:36,389][106225] Updated weights for policy 1, policy_version 1778141 (0.0010) [2023-12-28 08:00:36,534][106226] Updated weights for policy 0, policy_version 1773809 (0.0011) [2023-12-28 08:00:36,593][106226] Updated weights for policy 0, policy_version 1773819 (0.0011) [2023-12-28 08:00:36,658][106226] Updated weights for policy 0, policy_version 1773829 (0.0011) [2023-12-28 08:00:37,026][106225] Updated weights for policy 1, policy_version 1778151 (0.0010) [2023-12-28 08:00:37,080][106225] Updated weights for policy 1, policy_version 1778161 (0.0010) [2023-12-28 08:00:37,134][106225] Updated weights for policy 1, policy_version 1778171 (0.0010) [2023-12-28 08:00:37,338][106226] Updated weights for policy 0, policy_version 1773839 (0.0008) [2023-12-28 08:00:37,396][106226] Updated weights for policy 0, policy_version 1773849 (0.0011) [2023-12-28 08:00:37,463][106226] Updated weights for policy 0, policy_version 1773859 (0.0011) [2023-12-28 08:00:37,881][106225] Updated weights for policy 1, policy_version 1778181 (0.0007) [2023-12-28 08:00:37,947][106225] Updated weights for policy 1, policy_version 1778191 (0.0005) [2023-12-28 08:00:38,005][106225] Updated weights for policy 1, policy_version 1778201 (0.0007) [2023-12-28 08:00:38,152][106226] Updated weights for policy 0, policy_version 1773869 (0.0010) [2023-12-28 08:00:38,204][106226] Updated weights for policy 0, policy_version 1773879 (0.0008) [2023-12-28 08:00:38,250][106226] Updated weights for policy 0, policy_version 1773889 (0.0008) [2023-12-28 08:00:38,713][106225] Updated weights for policy 1, policy_version 1778211 (0.0008) [2023-12-28 08:00:38,775][106225] Updated weights for policy 1, policy_version 1778221 (0.0008) [2023-12-28 08:00:38,839][106225] Updated weights for policy 1, policy_version 1778231 (0.0008) [2023-12-28 08:00:39,051][106226] Updated weights for policy 0, policy_version 1773899 (0.0009) [2023-12-28 08:00:39,100][106226] Updated weights for policy 0, policy_version 1773909 (0.0008) [2023-12-28 08:00:39,160][106226] Updated weights for policy 0, policy_version 1773919 (0.0009) [2023-12-28 08:00:39,530][106225] Updated weights for policy 1, policy_version 1778241 (0.0007) [2023-12-28 08:00:39,594][106225] Updated weights for policy 1, policy_version 1778251 (0.0006) [2023-12-28 08:00:39,657][106225] Updated weights for policy 1, policy_version 1778261 (0.0008) [2023-12-28 08:00:39,716][106225] Updated weights for policy 1, policy_version 1778271 (0.0005) [2023-12-28 08:00:40,047][106226] Updated weights for policy 0, policy_version 1773929 (0.0008) [2023-12-28 08:00:40,105][106226] Updated weights for policy 0, policy_version 1773939 (0.0009) [2023-12-28 08:00:40,164][106226] Updated weights for policy 0, policy_version 1773949 (0.0006) [2023-12-28 08:00:40,218][106226] Updated weights for policy 0, policy_version 1773959 (0.0009) [2023-12-28 08:00:40,408][106225] Updated weights for policy 1, policy_version 1778281 (0.0009) [2023-12-28 08:00:40,471][106225] Updated weights for policy 1, policy_version 1778291 (0.0008) [2023-12-28 08:00:40,528][106225] Updated weights for policy 1, policy_version 1778301 (0.0008) [2023-12-28 08:00:40,897][106226] Updated weights for policy 0, policy_version 1773969 (0.0007) [2023-12-28 08:00:40,956][106226] Updated weights for policy 0, policy_version 1773979 (0.0006) [2023-12-28 08:00:41,014][106226] Updated weights for policy 0, policy_version 1773989 (0.0006) [2023-12-28 08:00:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 909524992. Throughput: 0: 9769.0, 1: 9596.6. Samples: 909496884. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:41,175][105115] Avg episode reward: [(0, '-4.539'), (1, '-4.668')] [2023-12-28 08:00:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001773992_454221824.pth... [2023-12-28 08:00:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001778304_455303168.pth... [2023-12-28 08:00:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001772872_453935104.pth [2023-12-28 08:00:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001777184_455016448.pth [2023-12-28 08:00:41,243][106225] Updated weights for policy 1, policy_version 1778311 (0.0007) [2023-12-28 08:00:41,312][106225] Updated weights for policy 1, policy_version 1778321 (0.0009) [2023-12-28 08:00:41,371][106225] Updated weights for policy 1, policy_version 1778331 (0.0008) [2023-12-28 08:00:41,676][106226] Updated weights for policy 0, policy_version 1773999 (0.0009) [2023-12-28 08:00:41,742][106226] Updated weights for policy 0, policy_version 1774009 (0.0010) [2023-12-28 08:00:41,807][106226] Updated weights for policy 0, policy_version 1774019 (0.0006) [2023-12-28 08:00:42,154][106225] Updated weights for policy 1, policy_version 1778341 (0.0009) [2023-12-28 08:00:42,215][106225] Updated weights for policy 1, policy_version 1778351 (0.0009) [2023-12-28 08:00:42,270][106225] Updated weights for policy 1, policy_version 1778361 (0.0011) [2023-12-28 08:00:42,543][106226] Updated weights for policy 0, policy_version 1774029 (0.0006) [2023-12-28 08:00:42,613][106226] Updated weights for policy 0, policy_version 1774039 (0.0006) [2023-12-28 08:00:42,676][106226] Updated weights for policy 0, policy_version 1774049 (0.0008) [2023-12-28 08:00:42,955][106225] Updated weights for policy 1, policy_version 1778371 (0.0011) [2023-12-28 08:00:43,018][106225] Updated weights for policy 1, policy_version 1778381 (0.0010) [2023-12-28 08:00:43,080][106225] Updated weights for policy 1, policy_version 1778391 (0.0010) [2023-12-28 08:00:43,359][106226] Updated weights for policy 0, policy_version 1774059 (0.0008) [2023-12-28 08:00:43,420][106226] Updated weights for policy 0, policy_version 1774069 (0.0006) [2023-12-28 08:00:43,478][106226] Updated weights for policy 0, policy_version 1774079 (0.0005) [2023-12-28 08:00:43,787][106225] Updated weights for policy 1, policy_version 1778401 (0.0010) [2023-12-28 08:00:43,849][106225] Updated weights for policy 1, policy_version 1778411 (0.0006) [2023-12-28 08:00:43,899][106225] Updated weights for policy 1, policy_version 1778421 (0.0006) [2023-12-28 08:00:43,953][106225] Updated weights for policy 1, policy_version 1778431 (0.0005) [2023-12-28 08:00:44,140][106226] Updated weights for policy 0, policy_version 1774089 (0.0006) [2023-12-28 08:00:44,209][106226] Updated weights for policy 0, policy_version 1774099 (0.0006) [2023-12-28 08:00:44,274][106226] Updated weights for policy 0, policy_version 1774109 (0.0007) [2023-12-28 08:00:44,334][106226] Updated weights for policy 0, policy_version 1774119 (0.0007) [2023-12-28 08:00:44,552][106225] Updated weights for policy 1, policy_version 1778441 (0.0007) [2023-12-28 08:00:44,619][106225] Updated weights for policy 1, policy_version 1778451 (0.0010) [2023-12-28 08:00:44,677][106225] Updated weights for policy 1, policy_version 1778461 (0.0010) [2023-12-28 08:00:45,071][106226] Updated weights for policy 0, policy_version 1774129 (0.0009) [2023-12-28 08:00:45,133][106226] Updated weights for policy 0, policy_version 1774139 (0.0008) [2023-12-28 08:00:45,199][106226] Updated weights for policy 0, policy_version 1774149 (0.0008) [2023-12-28 08:00:45,389][106225] Updated weights for policy 1, policy_version 1778471 (0.0010) [2023-12-28 08:00:45,450][106225] Updated weights for policy 1, policy_version 1778481 (0.0011) [2023-12-28 08:00:45,504][106225] Updated weights for policy 1, policy_version 1778491 (0.0010) [2023-12-28 08:00:45,808][106226] Updated weights for policy 0, policy_version 1774159 (0.0007) [2023-12-28 08:00:45,873][106226] Updated weights for policy 0, policy_version 1774169 (0.0006) [2023-12-28 08:00:45,938][106226] Updated weights for policy 0, policy_version 1774179 (0.0008) [2023-12-28 08:00:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.8, 300 sec: 19744.1). Total num frames: 909623296. Throughput: 0: 9658.6, 1: 9645.9. Samples: 909613228. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:46,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.935')] [2023-12-28 08:00:46,231][106225] Updated weights for policy 1, policy_version 1778501 (0.0010) [2023-12-28 08:00:46,281][106225] Updated weights for policy 1, policy_version 1778511 (0.0010) [2023-12-28 08:00:46,345][106225] Updated weights for policy 1, policy_version 1778521 (0.0010) [2023-12-28 08:00:46,590][106226] Updated weights for policy 0, policy_version 1774189 (0.0008) [2023-12-28 08:00:46,640][106226] Updated weights for policy 0, policy_version 1774199 (0.0006) [2023-12-28 08:00:46,697][106226] Updated weights for policy 0, policy_version 1774209 (0.0005) [2023-12-28 08:00:47,057][106225] Updated weights for policy 1, policy_version 1778531 (0.0010) [2023-12-28 08:00:47,114][106225] Updated weights for policy 1, policy_version 1778541 (0.0010) [2023-12-28 08:00:47,167][106225] Updated weights for policy 1, policy_version 1778551 (0.0010) [2023-12-28 08:00:47,331][106226] Updated weights for policy 0, policy_version 1774219 (0.0008) [2023-12-28 08:00:47,391][106226] Updated weights for policy 0, policy_version 1774229 (0.0008) [2023-12-28 08:00:47,451][106226] Updated weights for policy 0, policy_version 1774239 (0.0008) [2023-12-28 08:00:47,887][106225] Updated weights for policy 1, policy_version 1778561 (0.0010) [2023-12-28 08:00:47,937][106225] Updated weights for policy 1, policy_version 1778571 (0.0005) [2023-12-28 08:00:47,986][106225] Updated weights for policy 1, policy_version 1778581 (0.0009) [2023-12-28 08:00:48,047][106225] Updated weights for policy 1, policy_version 1778591 (0.0011) [2023-12-28 08:00:48,111][106226] Updated weights for policy 0, policy_version 1774249 (0.0006) [2023-12-28 08:00:48,165][106226] Updated weights for policy 0, policy_version 1774259 (0.0008) [2023-12-28 08:00:48,213][106226] Updated weights for policy 0, policy_version 1774269 (0.0008) [2023-12-28 08:00:48,277][106226] Updated weights for policy 0, policy_version 1774279 (0.0007) [2023-12-28 08:00:48,780][106225] Updated weights for policy 1, policy_version 1778601 (0.0009) [2023-12-28 08:00:48,840][106225] Updated weights for policy 1, policy_version 1778611 (0.0008) [2023-12-28 08:00:48,932][106225] Updated weights for policy 1, policy_version 1778621 (0.0009) [2023-12-28 08:00:49,058][106226] Updated weights for policy 0, policy_version 1774289 (0.0008) [2023-12-28 08:00:49,124][106226] Updated weights for policy 0, policy_version 1774299 (0.0007) [2023-12-28 08:00:49,198][106226] Updated weights for policy 0, policy_version 1774309 (0.0008) [2023-12-28 08:00:49,662][106225] Updated weights for policy 1, policy_version 1778631 (0.0009) [2023-12-28 08:00:49,721][106225] Updated weights for policy 1, policy_version 1778641 (0.0007) [2023-12-28 08:00:49,779][106225] Updated weights for policy 1, policy_version 1778651 (0.0005) [2023-12-28 08:00:49,978][106226] Updated weights for policy 0, policy_version 1774319 (0.0008) [2023-12-28 08:00:50,042][106226] Updated weights for policy 0, policy_version 1774329 (0.0008) [2023-12-28 08:00:50,107][106226] Updated weights for policy 0, policy_version 1774339 (0.0008) [2023-12-28 08:00:50,456][106225] Updated weights for policy 1, policy_version 1778661 (0.0006) [2023-12-28 08:00:50,523][106225] Updated weights for policy 1, policy_version 1778671 (0.0008) [2023-12-28 08:00:50,581][106225] Updated weights for policy 1, policy_version 1778681 (0.0007) [2023-12-28 08:00:50,882][106226] Updated weights for policy 0, policy_version 1774349 (0.0007) [2023-12-28 08:00:50,946][106226] Updated weights for policy 0, policy_version 1774359 (0.0009) [2023-12-28 08:00:51,015][106226] Updated weights for policy 0, policy_version 1774369 (0.0009) [2023-12-28 08:00:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19744.1). Total num frames: 909721600. Throughput: 0: 9686.6, 1: 9659.0. Samples: 909730000. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:51,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.748')] [2023-12-28 08:00:51,297][106225] Updated weights for policy 1, policy_version 1778691 (0.0007) [2023-12-28 08:00:51,365][106225] Updated weights for policy 1, policy_version 1778701 (0.0008) [2023-12-28 08:00:51,437][106225] Updated weights for policy 1, policy_version 1778711 (0.0008) [2023-12-28 08:00:51,827][106226] Updated weights for policy 0, policy_version 1774379 (0.0008) [2023-12-28 08:00:51,893][106226] Updated weights for policy 0, policy_version 1774389 (0.0008) [2023-12-28 08:00:51,954][106226] Updated weights for policy 0, policy_version 1774399 (0.0009) [2023-12-28 08:00:52,144][106225] Updated weights for policy 1, policy_version 1778721 (0.0009) [2023-12-28 08:00:52,196][106225] Updated weights for policy 1, policy_version 1778731 (0.0008) [2023-12-28 08:00:52,254][106225] Updated weights for policy 1, policy_version 1778741 (0.0008) [2023-12-28 08:00:52,320][106225] Updated weights for policy 1, policy_version 1778751 (0.0009) [2023-12-28 08:00:52,726][106226] Updated weights for policy 0, policy_version 1774409 (0.0007) [2023-12-28 08:00:52,794][106226] Updated weights for policy 0, policy_version 1774419 (0.0008) [2023-12-28 08:00:52,859][106226] Updated weights for policy 0, policy_version 1774429 (0.0008) [2023-12-28 08:00:52,924][106226] Updated weights for policy 0, policy_version 1774439 (0.0008) [2023-12-28 08:00:53,060][106225] Updated weights for policy 1, policy_version 1778761 (0.0010) [2023-12-28 08:00:53,113][106225] Updated weights for policy 1, policy_version 1778771 (0.0010) [2023-12-28 08:00:53,167][106225] Updated weights for policy 1, policy_version 1778781 (0.0010) [2023-12-28 08:00:53,622][106226] Updated weights for policy 0, policy_version 1774449 (0.0005) [2023-12-28 08:00:53,684][106226] Updated weights for policy 0, policy_version 1774459 (0.0005) [2023-12-28 08:00:53,752][106226] Updated weights for policy 0, policy_version 1774469 (0.0005) [2023-12-28 08:00:53,841][106225] Updated weights for policy 1, policy_version 1778791 (0.0009) [2023-12-28 08:00:53,895][106225] Updated weights for policy 1, policy_version 1778801 (0.0009) [2023-12-28 08:00:53,946][106225] Updated weights for policy 1, policy_version 1778811 (0.0008) [2023-12-28 08:00:54,252][106226] Updated weights for policy 0, policy_version 1774479 (0.0005) [2023-12-28 08:00:54,306][106226] Updated weights for policy 0, policy_version 1774489 (0.0008) [2023-12-28 08:00:54,362][106226] Updated weights for policy 0, policy_version 1774499 (0.0009) [2023-12-28 08:00:54,623][106225] Updated weights for policy 1, policy_version 1778821 (0.0006) [2023-12-28 08:00:54,689][106225] Updated weights for policy 1, policy_version 1778831 (0.0007) [2023-12-28 08:00:54,755][106225] Updated weights for policy 1, policy_version 1778841 (0.0006) [2023-12-28 08:00:55,049][106226] Updated weights for policy 0, policy_version 1774509 (0.0009) [2023-12-28 08:00:55,118][106226] Updated weights for policy 0, policy_version 1774519 (0.0008) [2023-12-28 08:00:55,178][106226] Updated weights for policy 0, policy_version 1774529 (0.0008) [2023-12-28 08:00:55,338][106225] Updated weights for policy 1, policy_version 1778851 (0.0006) [2023-12-28 08:00:55,398][106225] Updated weights for policy 1, policy_version 1778861 (0.0005) [2023-12-28 08:00:55,457][106225] Updated weights for policy 1, policy_version 1778871 (0.0005) [2023-12-28 08:00:55,913][106226] Updated weights for policy 0, policy_version 1774539 (0.0008) [2023-12-28 08:00:55,971][106226] Updated weights for policy 0, policy_version 1774549 (0.0009) [2023-12-28 08:00:56,025][106226] Updated weights for policy 0, policy_version 1774559 (0.0008) [2023-12-28 08:00:56,102][106225] Updated weights for policy 1, policy_version 1778881 (0.0006) [2023-12-28 08:00:56,156][106225] Updated weights for policy 1, policy_version 1778891 (0.0009) [2023-12-28 08:00:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 909819904. Throughput: 0: 9693.1, 1: 9636.8. Samples: 909788336. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:00:56,175][105115] Avg episode reward: [(0, '-4.373'), (1, '-4.773')] [2023-12-28 08:00:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001774568_454369280.pth... [2023-12-28 08:00:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001773416_454074368.pth [2023-12-28 08:00:56,211][106225] Updated weights for policy 1, policy_version 1778901 (0.0009) [2023-12-28 08:00:56,264][106225] Updated weights for policy 1, policy_version 1778911 (0.0008) [2023-12-28 08:00:56,267][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001778912_455458816.pth... [2023-12-28 08:00:56,270][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001777760_455163904.pth [2023-12-28 08:00:56,641][106226] Updated weights for policy 0, policy_version 1774569 (0.0006) [2023-12-28 08:00:56,692][106226] Updated weights for policy 0, policy_version 1774579 (0.0008) [2023-12-28 08:00:56,750][106226] Updated weights for policy 0, policy_version 1774589 (0.0008) [2023-12-28 08:00:56,805][106226] Updated weights for policy 0, policy_version 1774599 (0.0009) [2023-12-28 08:00:57,025][106225] Updated weights for policy 1, policy_version 1778921 (0.0008) [2023-12-28 08:00:57,076][106225] Updated weights for policy 1, policy_version 1778931 (0.0008) [2023-12-28 08:00:57,134][106225] Updated weights for policy 1, policy_version 1778941 (0.0009) [2023-12-28 08:00:57,531][106226] Updated weights for policy 0, policy_version 1774609 (0.0009) [2023-12-28 08:00:57,597][106226] Updated weights for policy 0, policy_version 1774619 (0.0008) [2023-12-28 08:00:57,663][106226] Updated weights for policy 0, policy_version 1774629 (0.0009) [2023-12-28 08:00:57,757][106225] Updated weights for policy 1, policy_version 1778951 (0.0008) [2023-12-28 08:00:57,802][106225] Updated weights for policy 1, policy_version 1778961 (0.0008) [2023-12-28 08:00:57,857][106225] Updated weights for policy 1, policy_version 1778971 (0.0008) [2023-12-28 08:00:58,360][106226] Updated weights for policy 0, policy_version 1774639 (0.0009) [2023-12-28 08:00:58,432][106226] Updated weights for policy 0, policy_version 1774649 (0.0010) [2023-12-28 08:00:58,501][106226] Updated weights for policy 0, policy_version 1774659 (0.0010) [2023-12-28 08:00:58,642][106225] Updated weights for policy 1, policy_version 1778981 (0.0008) [2023-12-28 08:00:58,710][106225] Updated weights for policy 1, policy_version 1778991 (0.0009) [2023-12-28 08:00:58,775][106225] Updated weights for policy 1, policy_version 1779001 (0.0007) [2023-12-28 08:00:59,306][106226] Updated weights for policy 0, policy_version 1774669 (0.0009) [2023-12-28 08:00:59,376][106226] Updated weights for policy 0, policy_version 1774679 (0.0009) [2023-12-28 08:00:59,447][106226] Updated weights for policy 0, policy_version 1774689 (0.0011) [2023-12-28 08:00:59,549][106225] Updated weights for policy 1, policy_version 1779011 (0.0007) [2023-12-28 08:00:59,613][106225] Updated weights for policy 1, policy_version 1779021 (0.0007) [2023-12-28 08:00:59,671][106225] Updated weights for policy 1, policy_version 1779031 (0.0010) [2023-12-28 08:01:00,114][106226] Updated weights for policy 0, policy_version 1774699 (0.0008) [2023-12-28 08:01:00,181][106226] Updated weights for policy 0, policy_version 1774709 (0.0006) [2023-12-28 08:01:00,240][106226] Updated weights for policy 0, policy_version 1774719 (0.0009) [2023-12-28 08:01:00,413][106225] Updated weights for policy 1, policy_version 1779041 (0.0009) [2023-12-28 08:01:00,477][106225] Updated weights for policy 1, policy_version 1779051 (0.0008) [2023-12-28 08:01:00,538][106225] Updated weights for policy 1, policy_version 1779061 (0.0005) [2023-12-28 08:01:00,597][106225] Updated weights for policy 1, policy_version 1779071 (0.0005) [2023-12-28 08:01:01,028][106226] Updated weights for policy 0, policy_version 1774729 (0.0010) [2023-12-28 08:01:01,094][106226] Updated weights for policy 0, policy_version 1774739 (0.0008) [2023-12-28 08:01:01,162][106226] Updated weights for policy 0, policy_version 1774749 (0.0009) [2023-12-28 08:01:01,163][106225] Updated weights for policy 1, policy_version 1779081 (0.0008) [2023-12-28 08:01:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19251.2, 300 sec: 19688.6). Total num frames: 909910016. Throughput: 0: 9695.6, 1: 9749.0. Samples: 909906968. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:01,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.917')] [2023-12-28 08:01:01,223][106226] Updated weights for policy 0, policy_version 1774759 (0.0006) [2023-12-28 08:01:01,225][106225] Updated weights for policy 1, policy_version 1779091 (0.0009) [2023-12-28 08:01:01,287][106225] Updated weights for policy 1, policy_version 1779101 (0.0008) [2023-12-28 08:01:01,929][106226] Updated weights for policy 0, policy_version 1774769 (0.0006) [2023-12-28 08:01:01,980][106226] Updated weights for policy 0, policy_version 1774779 (0.0005) [2023-12-28 08:01:02,035][106226] Updated weights for policy 0, policy_version 1774789 (0.0005) [2023-12-28 08:01:02,074][106225] Updated weights for policy 1, policy_version 1779111 (0.0008) [2023-12-28 08:01:02,131][106225] Updated weights for policy 1, policy_version 1779121 (0.0009) [2023-12-28 08:01:02,184][106225] Updated weights for policy 1, policy_version 1779131 (0.0008) [2023-12-28 08:01:02,679][106226] Updated weights for policy 0, policy_version 1774799 (0.0009) [2023-12-28 08:01:02,740][106226] Updated weights for policy 0, policy_version 1774809 (0.0010) [2023-12-28 08:01:02,805][106226] Updated weights for policy 0, policy_version 1774819 (0.0011) [2023-12-28 08:01:02,831][106225] Updated weights for policy 1, policy_version 1779141 (0.0008) [2023-12-28 08:01:02,887][106225] Updated weights for policy 1, policy_version 1779151 (0.0007) [2023-12-28 08:01:02,944][106225] Updated weights for policy 1, policy_version 1779161 (0.0005) [2023-12-28 08:01:03,457][106226] Updated weights for policy 0, policy_version 1774829 (0.0008) [2023-12-28 08:01:03,507][106226] Updated weights for policy 0, policy_version 1774839 (0.0005) [2023-12-28 08:01:03,565][106226] Updated weights for policy 0, policy_version 1774849 (0.0006) [2023-12-28 08:01:03,607][106225] Updated weights for policy 1, policy_version 1779171 (0.0008) [2023-12-28 08:01:03,667][106225] Updated weights for policy 1, policy_version 1779181 (0.0007) [2023-12-28 08:01:03,720][106225] Updated weights for policy 1, policy_version 1779191 (0.0008) [2023-12-28 08:01:04,277][106226] Updated weights for policy 0, policy_version 1774859 (0.0011) [2023-12-28 08:01:04,344][106226] Updated weights for policy 0, policy_version 1774869 (0.0011) [2023-12-28 08:01:04,411][106226] Updated weights for policy 0, policy_version 1774879 (0.0011) [2023-12-28 08:01:04,463][106225] Updated weights for policy 1, policy_version 1779201 (0.0008) [2023-12-28 08:01:04,529][106225] Updated weights for policy 1, policy_version 1779211 (0.0008) [2023-12-28 08:01:04,595][106225] Updated weights for policy 1, policy_version 1779221 (0.0008) [2023-12-28 08:01:04,657][106225] Updated weights for policy 1, policy_version 1779231 (0.0010) [2023-12-28 08:01:05,113][106226] Updated weights for policy 0, policy_version 1774889 (0.0010) [2023-12-28 08:01:05,182][106226] Updated weights for policy 0, policy_version 1774899 (0.0011) [2023-12-28 08:01:05,243][106226] Updated weights for policy 0, policy_version 1774909 (0.0008) [2023-12-28 08:01:05,263][106225] Updated weights for policy 1, policy_version 1779241 (0.0008) [2023-12-28 08:01:05,311][106226] Updated weights for policy 0, policy_version 1774919 (0.0008) [2023-12-28 08:01:05,319][106225] Updated weights for policy 1, policy_version 1779251 (0.0008) [2023-12-28 08:01:05,372][106225] Updated weights for policy 1, policy_version 1779261 (0.0006) [2023-12-28 08:01:05,950][106226] Updated weights for policy 0, policy_version 1774929 (0.0011) [2023-12-28 08:01:06,010][106226] Updated weights for policy 0, policy_version 1774939 (0.0011) [2023-12-28 08:01:06,048][106225] Updated weights for policy 1, policy_version 1779271 (0.0007) [2023-12-28 08:01:06,070][106226] Updated weights for policy 0, policy_version 1774949 (0.0008) [2023-12-28 08:01:06,098][106225] Updated weights for policy 1, policy_version 1779281 (0.0008) [2023-12-28 08:01:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 910016512. Throughput: 0: 9777.6, 1: 9852.8. Samples: 910026712. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:06,175][105115] Avg episode reward: [(0, '-4.296'), (1, '-4.502')] [2023-12-28 08:01:06,176][106225] Updated weights for policy 1, policy_version 1779291 (0.0008) [2023-12-28 08:01:06,682][106226] Updated weights for policy 0, policy_version 1774959 (0.0008) [2023-12-28 08:01:06,737][106226] Updated weights for policy 0, policy_version 1774969 (0.0010) [2023-12-28 08:01:06,797][106226] Updated weights for policy 0, policy_version 1774979 (0.0008) [2023-12-28 08:01:06,891][106225] Updated weights for policy 1, policy_version 1779301 (0.0009) [2023-12-28 08:01:06,942][106225] Updated weights for policy 1, policy_version 1779311 (0.0008) [2023-12-28 08:01:06,996][106225] Updated weights for policy 1, policy_version 1779321 (0.0008) [2023-12-28 08:01:07,447][106226] Updated weights for policy 0, policy_version 1774989 (0.0008) [2023-12-28 08:01:07,499][106226] Updated weights for policy 0, policy_version 1774999 (0.0006) [2023-12-28 08:01:07,560][106226] Updated weights for policy 0, policy_version 1775009 (0.0011) [2023-12-28 08:01:07,679][106225] Updated weights for policy 1, policy_version 1779331 (0.0008) [2023-12-28 08:01:07,744][106225] Updated weights for policy 1, policy_version 1779341 (0.0009) [2023-12-28 08:01:07,802][106225] Updated weights for policy 1, policy_version 1779351 (0.0009) [2023-12-28 08:01:08,138][106226] Updated weights for policy 0, policy_version 1775019 (0.0009) [2023-12-28 08:01:08,195][106226] Updated weights for policy 0, policy_version 1775029 (0.0008) [2023-12-28 08:01:08,262][106226] Updated weights for policy 0, policy_version 1775039 (0.0010) [2023-12-28 08:01:08,612][106225] Updated weights for policy 1, policy_version 1779361 (0.0008) [2023-12-28 08:01:08,667][106225] Updated weights for policy 1, policy_version 1779371 (0.0008) [2023-12-28 08:01:08,722][106225] Updated weights for policy 1, policy_version 1779381 (0.0007) [2023-12-28 08:01:08,779][106225] Updated weights for policy 1, policy_version 1779391 (0.0007) [2023-12-28 08:01:08,923][106226] Updated weights for policy 0, policy_version 1775049 (0.0010) [2023-12-28 08:01:08,987][106226] Updated weights for policy 0, policy_version 1775059 (0.0011) [2023-12-28 08:01:09,053][106226] Updated weights for policy 0, policy_version 1775069 (0.0010) [2023-12-28 08:01:09,110][106226] Updated weights for policy 0, policy_version 1775079 (0.0011) [2023-12-28 08:01:09,563][106225] Updated weights for policy 1, policy_version 1779401 (0.0008) [2023-12-28 08:01:09,626][106225] Updated weights for policy 1, policy_version 1779411 (0.0008) [2023-12-28 08:01:09,687][106225] Updated weights for policy 1, policy_version 1779421 (0.0008) [2023-12-28 08:01:09,941][106226] Updated weights for policy 0, policy_version 1775089 (0.0011) [2023-12-28 08:01:10,007][106226] Updated weights for policy 0, policy_version 1775099 (0.0008) [2023-12-28 08:01:10,072][106226] Updated weights for policy 0, policy_version 1775109 (0.0011) [2023-12-28 08:01:10,451][106225] Updated weights for policy 1, policy_version 1779431 (0.0006) [2023-12-28 08:01:10,505][106225] Updated weights for policy 1, policy_version 1779441 (0.0006) [2023-12-28 08:01:10,570][106225] Updated weights for policy 1, policy_version 1779451 (0.0005) [2023-12-28 08:01:10,750][106226] Updated weights for policy 0, policy_version 1775119 (0.0011) [2023-12-28 08:01:10,811][106226] Updated weights for policy 0, policy_version 1775129 (0.0009) [2023-12-28 08:01:10,878][106226] Updated weights for policy 0, policy_version 1775139 (0.0005) [2023-12-28 08:01:11,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 910114816. Throughput: 0: 9917.2, 1: 9855.8. Samples: 910087116. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:11,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.634')] [2023-12-28 08:01:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001775144_454516736.pth... [2023-12-28 08:01:11,182][106225] Updated weights for policy 1, policy_version 1779461 (0.0008) [2023-12-28 08:01:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001773992_454221824.pth [2023-12-28 08:01:11,247][106225] Updated weights for policy 1, policy_version 1779471 (0.0010) [2023-12-28 08:01:11,311][106225] Updated weights for policy 1, policy_version 1779481 (0.0009) [2023-12-28 08:01:11,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001779488_455606272.pth... [2023-12-28 08:01:11,361][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001778304_455303168.pth [2023-12-28 08:01:11,628][106226] Updated weights for policy 0, policy_version 1775149 (0.0007) [2023-12-28 08:01:11,700][106226] Updated weights for policy 0, policy_version 1775159 (0.0010) [2023-12-28 08:01:11,770][106226] Updated weights for policy 0, policy_version 1775169 (0.0009) [2023-12-28 08:01:12,171][106225] Updated weights for policy 1, policy_version 1779491 (0.0012) [2023-12-28 08:01:12,231][106225] Updated weights for policy 1, policy_version 1779501 (0.0008) [2023-12-28 08:01:12,301][106225] Updated weights for policy 1, policy_version 1779511 (0.0009) [2023-12-28 08:01:12,473][106226] Updated weights for policy 0, policy_version 1775179 (0.0008) [2023-12-28 08:01:12,535][106226] Updated weights for policy 0, policy_version 1775189 (0.0007) [2023-12-28 08:01:12,598][106226] Updated weights for policy 0, policy_version 1775199 (0.0006) [2023-12-28 08:01:13,076][106225] Updated weights for policy 1, policy_version 1779521 (0.0008) [2023-12-28 08:01:13,137][106225] Updated weights for policy 1, policy_version 1779531 (0.0009) [2023-12-28 08:01:13,196][106225] Updated weights for policy 1, policy_version 1779541 (0.0009) [2023-12-28 08:01:13,225][106226] Updated weights for policy 0, policy_version 1775209 (0.0007) [2023-12-28 08:01:13,246][106225] Updated weights for policy 1, policy_version 1779551 (0.0007) [2023-12-28 08:01:13,284][106226] Updated weights for policy 0, policy_version 1775219 (0.0007) [2023-12-28 08:01:13,346][106226] Updated weights for policy 0, policy_version 1775229 (0.0008) [2023-12-28 08:01:13,404][106226] Updated weights for policy 0, policy_version 1775239 (0.0008) [2023-12-28 08:01:14,002][106225] Updated weights for policy 1, policy_version 1779561 (0.0005) [2023-12-28 08:01:14,054][106225] Updated weights for policy 1, policy_version 1779571 (0.0008) [2023-12-28 08:01:14,067][106226] Updated weights for policy 0, policy_version 1775249 (0.0011) [2023-12-28 08:01:14,110][106225] Updated weights for policy 1, policy_version 1779581 (0.0007) [2023-12-28 08:01:14,129][106226] Updated weights for policy 0, policy_version 1775259 (0.0011) [2023-12-28 08:01:14,185][106226] Updated weights for policy 0, policy_version 1775269 (0.0010) [2023-12-28 08:01:14,811][106225] Updated weights for policy 1, policy_version 1779591 (0.0010) [2023-12-28 08:01:14,868][106225] Updated weights for policy 1, policy_version 1779601 (0.0008) [2023-12-28 08:01:14,893][106226] Updated weights for policy 0, policy_version 1775279 (0.0008) [2023-12-28 08:01:14,927][106225] Updated weights for policy 1, policy_version 1779611 (0.0006) [2023-12-28 08:01:14,954][106226] Updated weights for policy 0, policy_version 1775289 (0.0006) [2023-12-28 08:01:15,020][106226] Updated weights for policy 0, policy_version 1775299 (0.0009) [2023-12-28 08:01:15,656][106225] Updated weights for policy 1, policy_version 1779621 (0.0007) [2023-12-28 08:01:15,717][106225] Updated weights for policy 1, policy_version 1779631 (0.0007) [2023-12-28 08:01:15,775][106226] Updated weights for policy 0, policy_version 1775309 (0.0006) [2023-12-28 08:01:15,777][106225] Updated weights for policy 1, policy_version 1779641 (0.0008) [2023-12-28 08:01:15,835][106226] Updated weights for policy 0, policy_version 1775319 (0.0007) [2023-12-28 08:01:15,888][106226] Updated weights for policy 0, policy_version 1775329 (0.0009) [2023-12-28 08:01:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 910213120. Throughput: 0: 9826.6, 1: 9729.3. Samples: 910201388. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:16,176][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.912')] [2023-12-28 08:01:16,477][106225] Updated weights for policy 1, policy_version 1779651 (0.0006) [2023-12-28 08:01:16,534][106225] Updated weights for policy 1, policy_version 1779661 (0.0005) [2023-12-28 08:01:16,592][106226] Updated weights for policy 0, policy_version 1775339 (0.0008) [2023-12-28 08:01:16,602][106225] Updated weights for policy 1, policy_version 1779671 (0.0005) [2023-12-28 08:01:16,654][106226] Updated weights for policy 0, policy_version 1775349 (0.0008) [2023-12-28 08:01:16,704][106226] Updated weights for policy 0, policy_version 1775359 (0.0009) [2023-12-28 08:01:17,146][106225] Updated weights for policy 1, policy_version 1779681 (0.0006) [2023-12-28 08:01:17,207][106225] Updated weights for policy 1, policy_version 1779691 (0.0006) [2023-12-28 08:01:17,269][106225] Updated weights for policy 1, policy_version 1779701 (0.0006) [2023-12-28 08:01:17,325][106225] Updated weights for policy 1, policy_version 1779711 (0.0006) [2023-12-28 08:01:17,478][106226] Updated weights for policy 0, policy_version 1775369 (0.0009) [2023-12-28 08:01:17,535][106226] Updated weights for policy 0, policy_version 1775379 (0.0009) [2023-12-28 08:01:17,595][106226] Updated weights for policy 0, policy_version 1775389 (0.0010) [2023-12-28 08:01:17,657][106226] Updated weights for policy 0, policy_version 1775399 (0.0008) [2023-12-28 08:01:17,857][106225] Updated weights for policy 1, policy_version 1779721 (0.0007) [2023-12-28 08:01:17,919][106225] Updated weights for policy 1, policy_version 1779731 (0.0006) [2023-12-28 08:01:17,984][106225] Updated weights for policy 1, policy_version 1779741 (0.0007) [2023-12-28 08:01:18,417][106226] Updated weights for policy 0, policy_version 1775409 (0.0008) [2023-12-28 08:01:18,480][106226] Updated weights for policy 0, policy_version 1775419 (0.0006) [2023-12-28 08:01:18,546][106226] Updated weights for policy 0, policy_version 1775429 (0.0008) [2023-12-28 08:01:18,571][106225] Updated weights for policy 1, policy_version 1779751 (0.0007) [2023-12-28 08:01:18,633][106225] Updated weights for policy 1, policy_version 1779761 (0.0009) [2023-12-28 08:01:18,683][106225] Updated weights for policy 1, policy_version 1779771 (0.0009) [2023-12-28 08:01:19,265][106226] Updated weights for policy 0, policy_version 1775439 (0.0007) [2023-12-28 08:01:19,330][106226] Updated weights for policy 0, policy_version 1775449 (0.0008) [2023-12-28 08:01:19,403][106226] Updated weights for policy 0, policy_version 1775459 (0.0008) [2023-12-28 08:01:19,454][106225] Updated weights for policy 1, policy_version 1779781 (0.0009) [2023-12-28 08:01:19,521][106225] Updated weights for policy 1, policy_version 1779791 (0.0007) [2023-12-28 08:01:19,586][106225] Updated weights for policy 1, policy_version 1779801 (0.0007) [2023-12-28 08:01:20,185][106226] Updated weights for policy 0, policy_version 1775469 (0.0008) [2023-12-28 08:01:20,257][106226] Updated weights for policy 0, policy_version 1775479 (0.0009) [2023-12-28 08:01:20,327][106226] Updated weights for policy 0, policy_version 1775489 (0.0009) [2023-12-28 08:01:20,407][106225] Updated weights for policy 1, policy_version 1779811 (0.0009) [2023-12-28 08:01:20,467][106225] Updated weights for policy 1, policy_version 1779821 (0.0008) [2023-12-28 08:01:20,527][106225] Updated weights for policy 1, policy_version 1779831 (0.0008) [2023-12-28 08:01:21,077][106226] Updated weights for policy 0, policy_version 1775499 (0.0008) [2023-12-28 08:01:21,146][106226] Updated weights for policy 0, policy_version 1775509 (0.0008) [2023-12-28 08:01:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 910303232. Throughput: 0: 9740.3, 1: 9799.6. Samples: 910317420. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:21,175][105115] Avg episode reward: [(0, '-4.206'), (1, '-4.868')] [2023-12-28 08:01:21,203][106226] Updated weights for policy 0, policy_version 1775519 (0.0008) [2023-12-28 08:01:21,302][106225] Updated weights for policy 1, policy_version 1779841 (0.0008) [2023-12-28 08:01:21,367][106225] Updated weights for policy 1, policy_version 1779851 (0.0008) [2023-12-28 08:01:21,444][106225] Updated weights for policy 1, policy_version 1779861 (0.0008) [2023-12-28 08:01:21,497][106225] Updated weights for policy 1, policy_version 1779871 (0.0008) [2023-12-28 08:01:22,140][106226] Updated weights for policy 0, policy_version 1775529 (0.0008) [2023-12-28 08:01:22,193][106226] Updated weights for policy 0, policy_version 1775539 (0.0010) [2023-12-28 08:01:22,243][106226] Updated weights for policy 0, policy_version 1775549 (0.0008) [2023-12-28 08:01:22,310][106226] Updated weights for policy 0, policy_version 1775559 (0.0010) [2023-12-28 08:01:22,337][106225] Updated weights for policy 1, policy_version 1779881 (0.0008) [2023-12-28 08:01:22,410][106225] Updated weights for policy 1, policy_version 1779891 (0.0008) [2023-12-28 08:01:22,466][106225] Updated weights for policy 1, policy_version 1779901 (0.0008) [2023-12-28 08:01:23,081][106226] Updated weights for policy 0, policy_version 1775569 (0.0011) [2023-12-28 08:01:23,140][106226] Updated weights for policy 0, policy_version 1775579 (0.0011) [2023-12-28 08:01:23,204][106226] Updated weights for policy 0, policy_version 1775589 (0.0011) [2023-12-28 08:01:23,205][106225] Updated weights for policy 1, policy_version 1779911 (0.0009) [2023-12-28 08:01:23,265][106225] Updated weights for policy 1, policy_version 1779921 (0.0007) [2023-12-28 08:01:23,331][106225] Updated weights for policy 1, policy_version 1779931 (0.0008) [2023-12-28 08:01:23,941][106226] Updated weights for policy 0, policy_version 1775599 (0.0011) [2023-12-28 08:01:23,988][106226] Updated weights for policy 0, policy_version 1775609 (0.0010) [2023-12-28 08:01:24,041][106226] Updated weights for policy 0, policy_version 1775619 (0.0011) [2023-12-28 08:01:24,043][106225] Updated weights for policy 1, policy_version 1779941 (0.0007) [2023-12-28 08:01:24,095][106225] Updated weights for policy 1, policy_version 1779951 (0.0007) [2023-12-28 08:01:24,147][106225] Updated weights for policy 1, policy_version 1779961 (0.0008) [2023-12-28 08:01:24,767][106226] Updated weights for policy 0, policy_version 1775629 (0.0008) [2023-12-28 08:01:24,836][106226] Updated weights for policy 0, policy_version 1775639 (0.0008) [2023-12-28 08:01:24,901][106226] Updated weights for policy 0, policy_version 1775649 (0.0010) [2023-12-28 08:01:24,913][106225] Updated weights for policy 1, policy_version 1779971 (0.0009) [2023-12-28 08:01:24,975][106225] Updated weights for policy 1, policy_version 1779981 (0.0006) [2023-12-28 08:01:25,032][106225] Updated weights for policy 1, policy_version 1779991 (0.0007) [2023-12-28 08:01:25,559][106226] Updated weights for policy 0, policy_version 1775659 (0.0011) [2023-12-28 08:01:25,609][106226] Updated weights for policy 0, policy_version 1775669 (0.0010) [2023-12-28 08:01:25,664][106225] Updated weights for policy 1, policy_version 1780001 (0.0005) [2023-12-28 08:01:25,667][106226] Updated weights for policy 0, policy_version 1775679 (0.0011) [2023-12-28 08:01:25,726][106225] Updated weights for policy 1, policy_version 1780011 (0.0008) [2023-12-28 08:01:25,781][106225] Updated weights for policy 1, policy_version 1780021 (0.0006) [2023-12-28 08:01:25,833][106225] Updated weights for policy 1, policy_version 1780031 (0.0005) [2023-12-28 08:01:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 910401536. Throughput: 0: 9694.2, 1: 9738.0. Samples: 910371336. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:26,176][105115] Avg episode reward: [(0, '-4.520'), (1, '-5.019')] [2023-12-28 08:01:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001780032_455745536.pth... [2023-12-28 08:01:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001775688_454656000.pth... [2023-12-28 08:01:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001778912_455458816.pth [2023-12-28 08:01:26,193][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001774568_454369280.pth [2023-12-28 08:01:26,325][106226] Updated weights for policy 0, policy_version 1775689 (0.0010) [2023-12-28 08:01:26,381][106226] Updated weights for policy 0, policy_version 1775699 (0.0005) [2023-12-28 08:01:26,434][106226] Updated weights for policy 0, policy_version 1775709 (0.0005) [2023-12-28 08:01:26,489][106226] Updated weights for policy 0, policy_version 1775719 (0.0006) [2023-12-28 08:01:26,530][106225] Updated weights for policy 1, policy_version 1780041 (0.0007) [2023-12-28 08:01:26,587][106225] Updated weights for policy 1, policy_version 1780051 (0.0010) [2023-12-28 08:01:26,639][106225] Updated weights for policy 1, policy_version 1780061 (0.0010) [2023-12-28 08:01:27,078][106226] Updated weights for policy 0, policy_version 1775729 (0.0006) [2023-12-28 08:01:27,127][106226] Updated weights for policy 0, policy_version 1775739 (0.0007) [2023-12-28 08:01:27,181][106226] Updated weights for policy 0, policy_version 1775749 (0.0008) [2023-12-28 08:01:27,406][106225] Updated weights for policy 1, policy_version 1780071 (0.0010) [2023-12-28 08:01:27,452][106225] Updated weights for policy 1, policy_version 1780081 (0.0010) [2023-12-28 08:01:27,508][106225] Updated weights for policy 1, policy_version 1780091 (0.0010) [2023-12-28 08:01:27,915][106226] Updated weights for policy 0, policy_version 1775759 (0.0006) [2023-12-28 08:01:27,983][106226] Updated weights for policy 0, policy_version 1775769 (0.0005) [2023-12-28 08:01:28,045][106226] Updated weights for policy 0, policy_version 1775779 (0.0005) [2023-12-28 08:01:28,142][106225] Updated weights for policy 1, policy_version 1780101 (0.0008) [2023-12-28 08:01:28,203][106225] Updated weights for policy 1, policy_version 1780111 (0.0007) [2023-12-28 08:01:28,255][106225] Updated weights for policy 1, policy_version 1780121 (0.0005) [2023-12-28 08:01:28,553][106226] Updated weights for policy 0, policy_version 1775789 (0.0007) [2023-12-28 08:01:28,613][106226] Updated weights for policy 0, policy_version 1775799 (0.0009) [2023-12-28 08:01:28,677][106226] Updated weights for policy 0, policy_version 1775809 (0.0008) [2023-12-28 08:01:28,928][106225] Updated weights for policy 1, policy_version 1780131 (0.0006) [2023-12-28 08:01:28,984][106225] Updated weights for policy 1, policy_version 1780141 (0.0008) [2023-12-28 08:01:29,047][106225] Updated weights for policy 1, policy_version 1780151 (0.0008) [2023-12-28 08:01:29,350][106226] Updated weights for policy 0, policy_version 1775819 (0.0009) [2023-12-28 08:01:29,412][106226] Updated weights for policy 0, policy_version 1775829 (0.0010) [2023-12-28 08:01:29,470][106226] Updated weights for policy 0, policy_version 1775839 (0.0009) [2023-12-28 08:01:29,818][106225] Updated weights for policy 1, policy_version 1780161 (0.0008) [2023-12-28 08:01:29,885][106225] Updated weights for policy 1, policy_version 1780171 (0.0008) [2023-12-28 08:01:29,954][106225] Updated weights for policy 1, policy_version 1780181 (0.0008) [2023-12-28 08:01:30,014][106225] Updated weights for policy 1, policy_version 1780191 (0.0010) [2023-12-28 08:01:30,220][106226] Updated weights for policy 0, policy_version 1775849 (0.0008) [2023-12-28 08:01:30,276][106226] Updated weights for policy 0, policy_version 1775859 (0.0011) [2023-12-28 08:01:30,329][106226] Updated weights for policy 0, policy_version 1775869 (0.0010) [2023-12-28 08:01:30,393][106226] Updated weights for policy 0, policy_version 1775879 (0.0011) [2023-12-28 08:01:30,724][106225] Updated weights for policy 1, policy_version 1780201 (0.0006) [2023-12-28 08:01:30,784][106225] Updated weights for policy 1, policy_version 1780211 (0.0008) [2023-12-28 08:01:30,844][106225] Updated weights for policy 1, policy_version 1780221 (0.0008) [2023-12-28 08:01:31,069][106226] Updated weights for policy 0, policy_version 1775889 (0.0008) [2023-12-28 08:01:31,136][106226] Updated weights for policy 0, policy_version 1775899 (0.0011) [2023-12-28 08:01:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19688.6). Total num frames: 910499840. Throughput: 0: 9788.0, 1: 9762.3. Samples: 910492992. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:31,175][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.714')] [2023-12-28 08:01:31,198][106226] Updated weights for policy 0, policy_version 1775909 (0.0009) [2023-12-28 08:01:31,548][106225] Updated weights for policy 1, policy_version 1780231 (0.0009) [2023-12-28 08:01:31,631][106225] Updated weights for policy 1, policy_version 1780241 (0.0009) [2023-12-28 08:01:31,688][106225] Updated weights for policy 1, policy_version 1780251 (0.0008) [2023-12-28 08:01:31,952][106226] Updated weights for policy 0, policy_version 1775919 (0.0007) [2023-12-28 08:01:32,002][106226] Updated weights for policy 0, policy_version 1775929 (0.0008) [2023-12-28 08:01:32,057][106226] Updated weights for policy 0, policy_version 1775939 (0.0008) [2023-12-28 08:01:32,413][106225] Updated weights for policy 1, policy_version 1780261 (0.0008) [2023-12-28 08:01:32,472][106225] Updated weights for policy 1, policy_version 1780271 (0.0008) [2023-12-28 08:01:32,524][106225] Updated weights for policy 1, policy_version 1780281 (0.0008) [2023-12-28 08:01:32,847][106226] Updated weights for policy 0, policy_version 1775949 (0.0009) [2023-12-28 08:01:32,899][106226] Updated weights for policy 0, policy_version 1775959 (0.0009) [2023-12-28 08:01:32,952][106226] Updated weights for policy 0, policy_version 1775969 (0.0007) [2023-12-28 08:01:33,197][106225] Updated weights for policy 1, policy_version 1780291 (0.0007) [2023-12-28 08:01:33,252][106225] Updated weights for policy 1, policy_version 1780301 (0.0008) [2023-12-28 08:01:33,311][106225] Updated weights for policy 1, policy_version 1780311 (0.0009) [2023-12-28 08:01:33,583][106226] Updated weights for policy 0, policy_version 1775979 (0.0008) [2023-12-28 08:01:33,636][106226] Updated weights for policy 0, policy_version 1775989 (0.0007) [2023-12-28 08:01:33,685][106226] Updated weights for policy 0, policy_version 1775999 (0.0008) [2023-12-28 08:01:34,025][106225] Updated weights for policy 1, policy_version 1780321 (0.0009) [2023-12-28 08:01:34,077][106225] Updated weights for policy 1, policy_version 1780331 (0.0007) [2023-12-28 08:01:34,125][106225] Updated weights for policy 1, policy_version 1780341 (0.0006) [2023-12-28 08:01:34,187][106225] Updated weights for policy 1, policy_version 1780351 (0.0009) [2023-12-28 08:01:34,398][106226] Updated weights for policy 0, policy_version 1776009 (0.0006) [2023-12-28 08:01:34,458][106226] Updated weights for policy 0, policy_version 1776019 (0.0008) [2023-12-28 08:01:34,526][106226] Updated weights for policy 0, policy_version 1776029 (0.0009) [2023-12-28 08:01:34,587][106226] Updated weights for policy 0, policy_version 1776039 (0.0009) [2023-12-28 08:01:34,891][106225] Updated weights for policy 1, policy_version 1780361 (0.0008) [2023-12-28 08:01:34,954][106225] Updated weights for policy 1, policy_version 1780371 (0.0008) [2023-12-28 08:01:35,002][106225] Updated weights for policy 1, policy_version 1780381 (0.0008) [2023-12-28 08:01:35,270][106226] Updated weights for policy 0, policy_version 1776049 (0.0009) [2023-12-28 08:01:35,316][106226] Updated weights for policy 0, policy_version 1776059 (0.0009) [2023-12-28 08:01:35,363][106226] Updated weights for policy 0, policy_version 1776069 (0.0008) [2023-12-28 08:01:35,657][106225] Updated weights for policy 1, policy_version 1780391 (0.0006) [2023-12-28 08:01:35,731][106225] Updated weights for policy 1, policy_version 1780401 (0.0006) [2023-12-28 08:01:35,804][106225] Updated weights for policy 1, policy_version 1780411 (0.0005) [2023-12-28 08:01:36,117][106226] Updated weights for policy 0, policy_version 1776079 (0.0006) [2023-12-28 08:01:36,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 910598144. Throughput: 0: 9808.4, 1: 9783.9. Samples: 910611652. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:36,175][105115] Avg episode reward: [(0, '-4.074'), (1, '-4.554')] [2023-12-28 08:01:36,178][106226] Updated weights for policy 0, policy_version 1776089 (0.0008) [2023-12-28 08:01:36,230][106226] Updated weights for policy 0, policy_version 1776099 (0.0008) [2023-12-28 08:01:36,451][106225] Updated weights for policy 1, policy_version 1780421 (0.0007) [2023-12-28 08:01:36,515][106225] Updated weights for policy 1, policy_version 1780431 (0.0008) [2023-12-28 08:01:36,580][106225] Updated weights for policy 1, policy_version 1780441 (0.0008) [2023-12-28 08:01:36,947][106226] Updated weights for policy 0, policy_version 1776109 (0.0008) [2023-12-28 08:01:37,013][106226] Updated weights for policy 0, policy_version 1776119 (0.0008) [2023-12-28 08:01:37,078][106226] Updated weights for policy 0, policy_version 1776129 (0.0008) [2023-12-28 08:01:37,324][106225] Updated weights for policy 1, policy_version 1780451 (0.0008) [2023-12-28 08:01:37,377][106225] Updated weights for policy 1, policy_version 1780461 (0.0009) [2023-12-28 08:01:37,425][106225] Updated weights for policy 1, policy_version 1780471 (0.0008) [2023-12-28 08:01:37,689][106226] Updated weights for policy 0, policy_version 1776139 (0.0007) [2023-12-28 08:01:37,752][106226] Updated weights for policy 0, policy_version 1776149 (0.0011) [2023-12-28 08:01:37,818][106226] Updated weights for policy 0, policy_version 1776159 (0.0008) [2023-12-28 08:01:38,155][106225] Updated weights for policy 1, policy_version 1780481 (0.0008) [2023-12-28 08:01:38,217][106225] Updated weights for policy 1, policy_version 1780491 (0.0006) [2023-12-28 08:01:38,277][106225] Updated weights for policy 1, policy_version 1780501 (0.0005) [2023-12-28 08:01:38,339][106225] Updated weights for policy 1, policy_version 1780511 (0.0007) [2023-12-28 08:01:38,491][106226] Updated weights for policy 0, policy_version 1776169 (0.0009) [2023-12-28 08:01:38,547][106226] Updated weights for policy 0, policy_version 1776179 (0.0006) [2023-12-28 08:01:38,601][106226] Updated weights for policy 0, policy_version 1776189 (0.0008) [2023-12-28 08:01:38,666][106226] Updated weights for policy 0, policy_version 1776199 (0.0009) [2023-12-28 08:01:39,122][106225] Updated weights for policy 1, policy_version 1780521 (0.0010) [2023-12-28 08:01:39,188][106225] Updated weights for policy 1, policy_version 1780531 (0.0010) [2023-12-28 08:01:39,257][106225] Updated weights for policy 1, policy_version 1780541 (0.0008) [2023-12-28 08:01:39,258][106226] Updated weights for policy 0, policy_version 1776209 (0.0008) [2023-12-28 08:01:39,317][106226] Updated weights for policy 0, policy_version 1776219 (0.0009) [2023-12-28 08:01:39,391][106226] Updated weights for policy 0, policy_version 1776229 (0.0009) [2023-12-28 08:01:40,034][106225] Updated weights for policy 1, policy_version 1780551 (0.0008) [2023-12-28 08:01:40,092][106225] Updated weights for policy 1, policy_version 1780561 (0.0008) [2023-12-28 08:01:40,151][106226] Updated weights for policy 0, policy_version 1776239 (0.0008) [2023-12-28 08:01:40,155][106225] Updated weights for policy 1, policy_version 1780571 (0.0007) [2023-12-28 08:01:40,215][106226] Updated weights for policy 0, policy_version 1776249 (0.0008) [2023-12-28 08:01:40,277][106226] Updated weights for policy 0, policy_version 1776259 (0.0008) [2023-12-28 08:01:40,873][106225] Updated weights for policy 1, policy_version 1780581 (0.0006) [2023-12-28 08:01:40,920][106225] Updated weights for policy 1, policy_version 1780591 (0.0005) [2023-12-28 08:01:40,958][106226] Updated weights for policy 0, policy_version 1776269 (0.0007) [2023-12-28 08:01:40,968][106225] Updated weights for policy 1, policy_version 1780601 (0.0006) [2023-12-28 08:01:41,022][106226] Updated weights for policy 0, policy_version 1776279 (0.0006) [2023-12-28 08:01:41,089][106226] Updated weights for policy 0, policy_version 1776289 (0.0008) [2023-12-28 08:01:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 910704640. Throughput: 0: 9846.9, 1: 9787.8. Samples: 910671900. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:41,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-5.014')] [2023-12-28 08:01:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001780608_455892992.pth... [2023-12-28 08:01:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001776296_454811648.pth... [2023-12-28 08:01:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001775144_454516736.pth [2023-12-28 08:01:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001779488_455606272.pth [2023-12-28 08:01:41,711][106225] Updated weights for policy 1, policy_version 1780611 (0.0007) [2023-12-28 08:01:41,778][106225] Updated weights for policy 1, policy_version 1780621 (0.0008) [2023-12-28 08:01:41,842][106225] Updated weights for policy 1, policy_version 1780631 (0.0006) [2023-12-28 08:01:41,848][106226] Updated weights for policy 0, policy_version 1776299 (0.0008) [2023-12-28 08:01:41,912][106226] Updated weights for policy 0, policy_version 1776309 (0.0006) [2023-12-28 08:01:41,980][106226] Updated weights for policy 0, policy_version 1776319 (0.0007) [2023-12-28 08:01:42,570][106225] Updated weights for policy 1, policy_version 1780641 (0.0007) [2023-12-28 08:01:42,612][106226] Updated weights for policy 0, policy_version 1776329 (0.0008) [2023-12-28 08:01:42,642][106225] Updated weights for policy 1, policy_version 1780651 (0.0007) [2023-12-28 08:01:42,679][106226] Updated weights for policy 0, policy_version 1776339 (0.0006) [2023-12-28 08:01:42,709][106225] Updated weights for policy 1, policy_version 1780661 (0.0008) [2023-12-28 08:01:42,745][106226] Updated weights for policy 0, policy_version 1776349 (0.0007) [2023-12-28 08:01:42,774][106225] Updated weights for policy 1, policy_version 1780671 (0.0007) [2023-12-28 08:01:42,807][106226] Updated weights for policy 0, policy_version 1776359 (0.0006) [2023-12-28 08:01:43,368][106226] Updated weights for policy 0, policy_version 1776369 (0.0005) [2023-12-28 08:01:43,419][106226] Updated weights for policy 0, policy_version 1776379 (0.0006) [2023-12-28 08:01:43,437][106225] Updated weights for policy 1, policy_version 1780681 (0.0007) [2023-12-28 08:01:43,472][106226] Updated weights for policy 0, policy_version 1776389 (0.0006) [2023-12-28 08:01:43,486][106225] Updated weights for policy 1, policy_version 1780691 (0.0006) [2023-12-28 08:01:43,535][106225] Updated weights for policy 1, policy_version 1780701 (0.0009) [2023-12-28 08:01:44,106][106226] Updated weights for policy 0, policy_version 1776399 (0.0008) [2023-12-28 08:01:44,154][106226] Updated weights for policy 0, policy_version 1776409 (0.0008) [2023-12-28 08:01:44,212][106226] Updated weights for policy 0, policy_version 1776419 (0.0008) [2023-12-28 08:01:44,301][106225] Updated weights for policy 1, policy_version 1780711 (0.0008) [2023-12-28 08:01:44,350][106225] Updated weights for policy 1, policy_version 1780721 (0.0008) [2023-12-28 08:01:44,396][106225] Updated weights for policy 1, policy_version 1780731 (0.0008) [2023-12-28 08:01:44,935][106226] Updated weights for policy 0, policy_version 1776429 (0.0008) [2023-12-28 08:01:44,999][106226] Updated weights for policy 0, policy_version 1776439 (0.0009) [2023-12-28 08:01:45,056][106226] Updated weights for policy 0, policy_version 1776449 (0.0008) [2023-12-28 08:01:45,141][106225] Updated weights for policy 1, policy_version 1780741 (0.0009) [2023-12-28 08:01:45,201][106225] Updated weights for policy 1, policy_version 1780751 (0.0008) [2023-12-28 08:01:45,257][106225] Updated weights for policy 1, policy_version 1780761 (0.0009) [2023-12-28 08:01:45,784][106226] Updated weights for policy 0, policy_version 1776459 (0.0009) [2023-12-28 08:01:45,843][106226] Updated weights for policy 0, policy_version 1776469 (0.0009) [2023-12-28 08:01:45,904][106226] Updated weights for policy 0, policy_version 1776479 (0.0008) [2023-12-28 08:01:45,983][106225] Updated weights for policy 1, policy_version 1780771 (0.0009) [2023-12-28 08:01:46,040][106225] Updated weights for policy 1, policy_version 1780781 (0.0009) [2023-12-28 08:01:46,091][106225] Updated weights for policy 1, policy_version 1780791 (0.0007) [2023-12-28 08:01:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 910802944. Throughput: 0: 9873.2, 1: 9693.3. Samples: 910787460. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:46,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.879')] [2023-12-28 08:01:46,548][106226] Updated weights for policy 0, policy_version 1776489 (0.0008) [2023-12-28 08:01:46,620][106226] Updated weights for policy 0, policy_version 1776499 (0.0005) [2023-12-28 08:01:46,688][106226] Updated weights for policy 0, policy_version 1776509 (0.0007) [2023-12-28 08:01:46,752][106226] Updated weights for policy 0, policy_version 1776519 (0.0011) [2023-12-28 08:01:46,865][106225] Updated weights for policy 1, policy_version 1780801 (0.0007) [2023-12-28 08:01:46,920][106225] Updated weights for policy 1, policy_version 1780811 (0.0007) [2023-12-28 08:01:46,968][106225] Updated weights for policy 1, policy_version 1780821 (0.0005) [2023-12-28 08:01:47,024][106225] Updated weights for policy 1, policy_version 1780831 (0.0005) [2023-12-28 08:01:47,359][106226] Updated weights for policy 0, policy_version 1776529 (0.0006) [2023-12-28 08:01:47,413][106226] Updated weights for policy 0, policy_version 1776539 (0.0007) [2023-12-28 08:01:47,470][106226] Updated weights for policy 0, policy_version 1776549 (0.0010) [2023-12-28 08:01:47,694][106225] Updated weights for policy 1, policy_version 1780841 (0.0010) [2023-12-28 08:01:47,749][106225] Updated weights for policy 1, policy_version 1780851 (0.0010) [2023-12-28 08:01:47,814][106225] Updated weights for policy 1, policy_version 1780861 (0.0010) [2023-12-28 08:01:48,113][106226] Updated weights for policy 0, policy_version 1776559 (0.0010) [2023-12-28 08:01:48,180][106226] Updated weights for policy 0, policy_version 1776569 (0.0011) [2023-12-28 08:01:48,240][106226] Updated weights for policy 0, policy_version 1776579 (0.0010) [2023-12-28 08:01:48,552][106225] Updated weights for policy 1, policy_version 1780871 (0.0007) [2023-12-28 08:01:48,606][106225] Updated weights for policy 1, policy_version 1780881 (0.0008) [2023-12-28 08:01:48,661][106225] Updated weights for policy 1, policy_version 1780891 (0.0010) [2023-12-28 08:01:49,008][106226] Updated weights for policy 0, policy_version 1776589 (0.0010) [2023-12-28 08:01:49,074][106226] Updated weights for policy 0, policy_version 1776599 (0.0011) [2023-12-28 08:01:49,135][106226] Updated weights for policy 0, policy_version 1776609 (0.0007) [2023-12-28 08:01:49,320][106225] Updated weights for policy 1, policy_version 1780901 (0.0009) [2023-12-28 08:01:49,390][106225] Updated weights for policy 1, policy_version 1780911 (0.0009) [2023-12-28 08:01:49,451][106225] Updated weights for policy 1, policy_version 1780921 (0.0008) [2023-12-28 08:01:49,796][106226] Updated weights for policy 0, policy_version 1776619 (0.0007) [2023-12-28 08:01:49,869][106226] Updated weights for policy 0, policy_version 1776629 (0.0008) [2023-12-28 08:01:49,920][106226] Updated weights for policy 0, policy_version 1776639 (0.0008) [2023-12-28 08:01:50,287][106225] Updated weights for policy 1, policy_version 1780931 (0.0008) [2023-12-28 08:01:50,341][106225] Updated weights for policy 1, policy_version 1780941 (0.0009) [2023-12-28 08:01:50,394][106225] Updated weights for policy 1, policy_version 1780951 (0.0009) [2023-12-28 08:01:50,762][106226] Updated weights for policy 0, policy_version 1776649 (0.0008) [2023-12-28 08:01:50,831][106226] Updated weights for policy 0, policy_version 1776659 (0.0007) [2023-12-28 08:01:50,900][106226] Updated weights for policy 0, policy_version 1776669 (0.0008) [2023-12-28 08:01:50,969][106226] Updated weights for policy 0, policy_version 1776679 (0.0008) [2023-12-28 08:01:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 910893056. Throughput: 0: 9867.1, 1: 9599.6. Samples: 910902712. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:51,175][105115] Avg episode reward: [(0, '-4.523'), (1, '-4.726')] [2023-12-28 08:01:51,182][106225] Updated weights for policy 1, policy_version 1780961 (0.0009) [2023-12-28 08:01:51,246][106225] Updated weights for policy 1, policy_version 1780971 (0.0009) [2023-12-28 08:01:51,311][106225] Updated weights for policy 1, policy_version 1780981 (0.0009) [2023-12-28 08:01:51,380][106225] Updated weights for policy 1, policy_version 1780991 (0.0009) [2023-12-28 08:01:51,671][106226] Updated weights for policy 0, policy_version 1776689 (0.0011) [2023-12-28 08:01:51,723][106226] Updated weights for policy 0, policy_version 1776699 (0.0012) [2023-12-28 08:01:51,795][106226] Updated weights for policy 0, policy_version 1776709 (0.0007) [2023-12-28 08:01:52,159][106225] Updated weights for policy 1, policy_version 1781001 (0.0010) [2023-12-28 08:01:52,220][106225] Updated weights for policy 1, policy_version 1781011 (0.0010) [2023-12-28 08:01:52,288][106225] Updated weights for policy 1, policy_version 1781021 (0.0009) [2023-12-28 08:01:52,516][106226] Updated weights for policy 0, policy_version 1776719 (0.0008) [2023-12-28 08:01:52,579][106226] Updated weights for policy 0, policy_version 1776729 (0.0008) [2023-12-28 08:01:52,642][106226] Updated weights for policy 0, policy_version 1776739 (0.0008) [2023-12-28 08:01:53,087][106225] Updated weights for policy 1, policy_version 1781031 (0.0010) [2023-12-28 08:01:53,145][106225] Updated weights for policy 1, policy_version 1781041 (0.0010) [2023-12-28 08:01:53,198][106225] Updated weights for policy 1, policy_version 1781051 (0.0010) [2023-12-28 08:01:53,316][106226] Updated weights for policy 0, policy_version 1776749 (0.0009) [2023-12-28 08:01:53,362][106226] Updated weights for policy 0, policy_version 1776759 (0.0010) [2023-12-28 08:01:53,409][106226] Updated weights for policy 0, policy_version 1776769 (0.0010) [2023-12-28 08:01:53,909][106225] Updated weights for policy 1, policy_version 1781061 (0.0010) [2023-12-28 08:01:53,973][106225] Updated weights for policy 1, policy_version 1781071 (0.0010) [2023-12-28 08:01:54,034][106225] Updated weights for policy 1, policy_version 1781081 (0.0010) [2023-12-28 08:01:54,151][106226] Updated weights for policy 0, policy_version 1776779 (0.0008) [2023-12-28 08:01:54,212][106226] Updated weights for policy 0, policy_version 1776789 (0.0008) [2023-12-28 08:01:54,269][106226] Updated weights for policy 0, policy_version 1776799 (0.0007) [2023-12-28 08:01:54,747][106225] Updated weights for policy 1, policy_version 1781091 (0.0010) [2023-12-28 08:01:54,800][106225] Updated weights for policy 1, policy_version 1781101 (0.0010) [2023-12-28 08:01:54,847][106225] Updated weights for policy 1, policy_version 1781111 (0.0010) [2023-12-28 08:01:54,982][106226] Updated weights for policy 0, policy_version 1776809 (0.0008) [2023-12-28 08:01:55,045][106226] Updated weights for policy 0, policy_version 1776819 (0.0008) [2023-12-28 08:01:55,104][106226] Updated weights for policy 0, policy_version 1776829 (0.0008) [2023-12-28 08:01:55,169][106226] Updated weights for policy 0, policy_version 1776839 (0.0007) [2023-12-28 08:01:55,574][106225] Updated weights for policy 1, policy_version 1781121 (0.0008) [2023-12-28 08:01:55,645][106225] Updated weights for policy 1, policy_version 1781131 (0.0010) [2023-12-28 08:01:55,714][106225] Updated weights for policy 1, policy_version 1781141 (0.0010) [2023-12-28 08:01:55,775][106225] Updated weights for policy 1, policy_version 1781151 (0.0010) [2023-12-28 08:01:55,791][106226] Updated weights for policy 0, policy_version 1776849 (0.0009) [2023-12-28 08:01:55,848][106226] Updated weights for policy 0, policy_version 1776859 (0.0008) [2023-12-28 08:01:55,913][106226] Updated weights for policy 0, policy_version 1776869 (0.0007) [2023-12-28 08:01:56,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 910991360. Throughput: 0: 9796.1, 1: 9590.9. Samples: 910959528. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:01:56,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.843')] [2023-12-28 08:01:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001781152_456032256.pth... [2023-12-28 08:01:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001776872_454959104.pth... [2023-12-28 08:01:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001775688_454656000.pth [2023-12-28 08:01:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001780032_455745536.pth [2023-12-28 08:01:56,423][106225] Updated weights for policy 1, policy_version 1781161 (0.0010) [2023-12-28 08:01:56,484][106225] Updated weights for policy 1, policy_version 1781171 (0.0010) [2023-12-28 08:01:56,552][106225] Updated weights for policy 1, policy_version 1781181 (0.0010) [2023-12-28 08:01:56,599][106226] Updated weights for policy 0, policy_version 1776879 (0.0005) [2023-12-28 08:01:56,657][106226] Updated weights for policy 0, policy_version 1776889 (0.0005) [2023-12-28 08:01:56,717][106226] Updated weights for policy 0, policy_version 1776899 (0.0005) [2023-12-28 08:01:57,235][106225] Updated weights for policy 1, policy_version 1781191 (0.0010) [2023-12-28 08:01:57,269][106226] Updated weights for policy 0, policy_version 1776909 (0.0005) [2023-12-28 08:01:57,296][106225] Updated weights for policy 1, policy_version 1781201 (0.0009) [2023-12-28 08:01:57,331][106226] Updated weights for policy 0, policy_version 1776919 (0.0005) [2023-12-28 08:01:57,352][106225] Updated weights for policy 1, policy_version 1781211 (0.0006) [2023-12-28 08:01:57,386][106226] Updated weights for policy 0, policy_version 1776929 (0.0006) [2023-12-28 08:01:58,045][106225] Updated weights for policy 1, policy_version 1781221 (0.0010) [2023-12-28 08:01:58,059][106226] Updated weights for policy 0, policy_version 1776939 (0.0006) [2023-12-28 08:01:58,098][106225] Updated weights for policy 1, policy_version 1781231 (0.0010) [2023-12-28 08:01:58,111][106226] Updated weights for policy 0, policy_version 1776949 (0.0006) [2023-12-28 08:01:58,156][106225] Updated weights for policy 1, policy_version 1781241 (0.0010) [2023-12-28 08:01:58,174][106226] Updated weights for policy 0, policy_version 1776959 (0.0006) [2023-12-28 08:01:59,007][106226] Updated weights for policy 0, policy_version 1776969 (0.0007) [2023-12-28 08:01:59,029][106225] Updated weights for policy 1, policy_version 1781251 (0.0009) [2023-12-28 08:01:59,073][106226] Updated weights for policy 0, policy_version 1776979 (0.0008) [2023-12-28 08:01:59,092][106225] Updated weights for policy 1, policy_version 1781261 (0.0007) [2023-12-28 08:01:59,138][106226] Updated weights for policy 0, policy_version 1776989 (0.0007) [2023-12-28 08:01:59,155][106225] Updated weights for policy 1, policy_version 1781271 (0.0006) [2023-12-28 08:01:59,200][106226] Updated weights for policy 0, policy_version 1776999 (0.0007) [2023-12-28 08:01:59,855][106226] Updated weights for policy 0, policy_version 1777009 (0.0009) [2023-12-28 08:01:59,920][106226] Updated weights for policy 0, policy_version 1777019 (0.0009) [2023-12-28 08:01:59,987][106226] Updated weights for policy 0, policy_version 1777029 (0.0009) [2023-12-28 08:02:00,033][106225] Updated weights for policy 1, policy_version 1781281 (0.0008) [2023-12-28 08:02:00,091][106225] Updated weights for policy 1, policy_version 1781291 (0.0008) [2023-12-28 08:02:00,141][106225] Updated weights for policy 1, policy_version 1781301 (0.0009) [2023-12-28 08:02:00,193][106225] Updated weights for policy 1, policy_version 1781311 (0.0009) [2023-12-28 08:02:00,696][106226] Updated weights for policy 0, policy_version 1777039 (0.0008) [2023-12-28 08:02:00,742][106226] Updated weights for policy 0, policy_version 1777049 (0.0005) [2023-12-28 08:02:00,797][106226] Updated weights for policy 0, policy_version 1777059 (0.0005) [2023-12-28 08:02:00,986][106225] Updated weights for policy 1, policy_version 1781321 (0.0008) [2023-12-28 08:02:01,046][106225] Updated weights for policy 1, policy_version 1781331 (0.0009) [2023-12-28 08:02:01,113][106225] Updated weights for policy 1, policy_version 1781341 (0.0009) [2023-12-28 08:02:01,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 911089664. Throughput: 0: 9845.0, 1: 9597.6. Samples: 911076304. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:01,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.889')] [2023-12-28 08:02:01,500][106226] Updated weights for policy 0, policy_version 1777069 (0.0007) [2023-12-28 08:02:01,563][106226] Updated weights for policy 0, policy_version 1777079 (0.0008) [2023-12-28 08:02:01,634][106226] Updated weights for policy 0, policy_version 1777089 (0.0009) [2023-12-28 08:02:01,855][106225] Updated weights for policy 1, policy_version 1781351 (0.0006) [2023-12-28 08:02:01,907][106225] Updated weights for policy 1, policy_version 1781361 (0.0005) [2023-12-28 08:02:01,959][106225] Updated weights for policy 1, policy_version 1781371 (0.0006) [2023-12-28 08:02:02,363][106226] Updated weights for policy 0, policy_version 1777099 (0.0008) [2023-12-28 08:02:02,430][106226] Updated weights for policy 0, policy_version 1777109 (0.0008) [2023-12-28 08:02:02,493][106226] Updated weights for policy 0, policy_version 1777119 (0.0008) [2023-12-28 08:02:02,692][106225] Updated weights for policy 1, policy_version 1781381 (0.0008) [2023-12-28 08:02:02,749][106225] Updated weights for policy 1, policy_version 1781391 (0.0008) [2023-12-28 08:02:02,802][106225] Updated weights for policy 1, policy_version 1781401 (0.0008) [2023-12-28 08:02:03,197][106226] Updated weights for policy 0, policy_version 1777129 (0.0009) [2023-12-28 08:02:03,247][106226] Updated weights for policy 0, policy_version 1777139 (0.0010) [2023-12-28 08:02:03,303][106226] Updated weights for policy 0, policy_version 1777149 (0.0010) [2023-12-28 08:02:03,367][106226] Updated weights for policy 0, policy_version 1777159 (0.0010) [2023-12-28 08:02:03,547][106225] Updated weights for policy 1, policy_version 1781411 (0.0009) [2023-12-28 08:02:03,599][106225] Updated weights for policy 1, policy_version 1781421 (0.0008) [2023-12-28 08:02:03,646][106225] Updated weights for policy 1, policy_version 1781431 (0.0008) [2023-12-28 08:02:04,007][106226] Updated weights for policy 0, policy_version 1777169 (0.0009) [2023-12-28 08:02:04,076][106226] Updated weights for policy 0, policy_version 1777179 (0.0009) [2023-12-28 08:02:04,142][106226] Updated weights for policy 0, policy_version 1777189 (0.0008) [2023-12-28 08:02:04,440][106225] Updated weights for policy 1, policy_version 1781441 (0.0008) [2023-12-28 08:02:04,494][106225] Updated weights for policy 1, policy_version 1781451 (0.0009) [2023-12-28 08:02:04,550][106225] Updated weights for policy 1, policy_version 1781461 (0.0009) [2023-12-28 08:02:04,612][106225] Updated weights for policy 1, policy_version 1781471 (0.0008) [2023-12-28 08:02:04,839][106226] Updated weights for policy 0, policy_version 1777199 (0.0007) [2023-12-28 08:02:04,890][106226] Updated weights for policy 0, policy_version 1777209 (0.0008) [2023-12-28 08:02:04,945][106226] Updated weights for policy 0, policy_version 1777219 (0.0009) [2023-12-28 08:02:05,269][106225] Updated weights for policy 1, policy_version 1781481 (0.0005) [2023-12-28 08:02:05,320][106225] Updated weights for policy 1, policy_version 1781491 (0.0005) [2023-12-28 08:02:05,377][106225] Updated weights for policy 1, policy_version 1781501 (0.0005) [2023-12-28 08:02:05,677][106226] Updated weights for policy 0, policy_version 1777229 (0.0009) [2023-12-28 08:02:05,729][106226] Updated weights for policy 0, policy_version 1777239 (0.0008) [2023-12-28 08:02:05,783][106226] Updated weights for policy 0, policy_version 1777249 (0.0005) [2023-12-28 08:02:06,053][106225] Updated weights for policy 1, policy_version 1781511 (0.0007) [2023-12-28 08:02:06,101][106225] Updated weights for policy 1, policy_version 1781521 (0.0008) [2023-12-28 08:02:06,161][106225] Updated weights for policy 1, policy_version 1781531 (0.0010) [2023-12-28 08:02:06,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.8, 300 sec: 19633.0). Total num frames: 911179776. Throughput: 0: 9934.1, 1: 9540.3. Samples: 911193768. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:06,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-5.007')] [2023-12-28 08:02:06,453][106226] Updated weights for policy 0, policy_version 1777259 (0.0006) [2023-12-28 08:02:06,524][106226] Updated weights for policy 0, policy_version 1777269 (0.0009) [2023-12-28 08:02:06,594][106226] Updated weights for policy 0, policy_version 1777279 (0.0008) [2023-12-28 08:02:06,846][106225] Updated weights for policy 1, policy_version 1781541 (0.0009) [2023-12-28 08:02:06,910][106225] Updated weights for policy 1, policy_version 1781551 (0.0009) [2023-12-28 08:02:06,977][106225] Updated weights for policy 1, policy_version 1781561 (0.0009) [2023-12-28 08:02:07,339][106226] Updated weights for policy 0, policy_version 1777289 (0.0010) [2023-12-28 08:02:07,399][106226] Updated weights for policy 0, policy_version 1777299 (0.0009) [2023-12-28 08:02:07,462][106226] Updated weights for policy 0, policy_version 1777309 (0.0008) [2023-12-28 08:02:07,525][106226] Updated weights for policy 0, policy_version 1777319 (0.0008) [2023-12-28 08:02:07,670][106225] Updated weights for policy 1, policy_version 1781571 (0.0008) [2023-12-28 08:02:07,723][106225] Updated weights for policy 1, policy_version 1781581 (0.0008) [2023-12-28 08:02:07,782][106225] Updated weights for policy 1, policy_version 1781591 (0.0008) [2023-12-28 08:02:08,238][106226] Updated weights for policy 0, policy_version 1777329 (0.0008) [2023-12-28 08:02:08,295][106226] Updated weights for policy 0, policy_version 1777339 (0.0005) [2023-12-28 08:02:08,362][106226] Updated weights for policy 0, policy_version 1777349 (0.0007) [2023-12-28 08:02:08,482][106225] Updated weights for policy 1, policy_version 1781601 (0.0009) [2023-12-28 08:02:08,544][106225] Updated weights for policy 1, policy_version 1781611 (0.0007) [2023-12-28 08:02:08,608][106225] Updated weights for policy 1, policy_version 1781621 (0.0009) [2023-12-28 08:02:08,671][106225] Updated weights for policy 1, policy_version 1781631 (0.0008) [2023-12-28 08:02:09,015][106226] Updated weights for policy 0, policy_version 1777359 (0.0006) [2023-12-28 08:02:09,067][106226] Updated weights for policy 0, policy_version 1777369 (0.0005) [2023-12-28 08:02:09,114][106226] Updated weights for policy 0, policy_version 1777379 (0.0005) [2023-12-28 08:02:09,488][106225] Updated weights for policy 1, policy_version 1781641 (0.0007) [2023-12-28 08:02:09,553][106225] Updated weights for policy 1, policy_version 1781651 (0.0006) [2023-12-28 08:02:09,614][106225] Updated weights for policy 1, policy_version 1781661 (0.0009) [2023-12-28 08:02:09,838][106226] Updated weights for policy 0, policy_version 1777389 (0.0007) [2023-12-28 08:02:09,895][106226] Updated weights for policy 0, policy_version 1777399 (0.0007) [2023-12-28 08:02:09,960][106226] Updated weights for policy 0, policy_version 1777409 (0.0007) [2023-12-28 08:02:10,406][106225] Updated weights for policy 1, policy_version 1781671 (0.0009) [2023-12-28 08:02:10,459][106225] Updated weights for policy 1, policy_version 1781681 (0.0009) [2023-12-28 08:02:10,527][106225] Updated weights for policy 1, policy_version 1781691 (0.0008) [2023-12-28 08:02:10,652][106226] Updated weights for policy 0, policy_version 1777419 (0.0007) [2023-12-28 08:02:10,722][106226] Updated weights for policy 0, policy_version 1777429 (0.0010) [2023-12-28 08:02:10,792][106226] Updated weights for policy 0, policy_version 1777439 (0.0010) [2023-12-28 08:02:11,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 911278080. Throughput: 0: 9986.9, 1: 9588.5. Samples: 911252224. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:11,175][105115] Avg episode reward: [(0, '-4.464'), (1, '-4.304')] [2023-12-28 08:02:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001777448_455106560.pth... [2023-12-28 08:02:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001781696_456171520.pth... [2023-12-28 08:02:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001776296_454811648.pth [2023-12-28 08:02:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001780608_455892992.pth [2023-12-28 08:02:11,241][106225] Updated weights for policy 1, policy_version 1781701 (0.0009) [2023-12-28 08:02:11,304][106225] Updated weights for policy 1, policy_version 1781711 (0.0008) [2023-12-28 08:02:11,371][106225] Updated weights for policy 1, policy_version 1781721 (0.0008) [2023-12-28 08:02:11,510][106226] Updated weights for policy 0, policy_version 1777449 (0.0010) [2023-12-28 08:02:11,575][106226] Updated weights for policy 0, policy_version 1777459 (0.0009) [2023-12-28 08:02:11,638][106226] Updated weights for policy 0, policy_version 1777469 (0.0008) [2023-12-28 08:02:11,708][106226] Updated weights for policy 0, policy_version 1777479 (0.0009) [2023-12-28 08:02:12,167][106225] Updated weights for policy 1, policy_version 1781731 (0.0009) [2023-12-28 08:02:12,230][106225] Updated weights for policy 1, policy_version 1781741 (0.0009) [2023-12-28 08:02:12,299][106225] Updated weights for policy 1, policy_version 1781751 (0.0009) [2023-12-28 08:02:12,419][106226] Updated weights for policy 0, policy_version 1777489 (0.0007) [2023-12-28 08:02:12,488][106226] Updated weights for policy 0, policy_version 1777499 (0.0006) [2023-12-28 08:02:12,554][106226] Updated weights for policy 0, policy_version 1777509 (0.0006) [2023-12-28 08:02:13,031][106225] Updated weights for policy 1, policy_version 1781761 (0.0009) [2023-12-28 08:02:13,094][106225] Updated weights for policy 1, policy_version 1781771 (0.0008) [2023-12-28 08:02:13,163][106225] Updated weights for policy 1, policy_version 1781781 (0.0009) [2023-12-28 08:02:13,221][106226] Updated weights for policy 0, policy_version 1777519 (0.0009) [2023-12-28 08:02:13,226][106225] Updated weights for policy 1, policy_version 1781791 (0.0006) [2023-12-28 08:02:13,280][106226] Updated weights for policy 0, policy_version 1777529 (0.0007) [2023-12-28 08:02:13,343][106226] Updated weights for policy 0, policy_version 1777539 (0.0009) [2023-12-28 08:02:13,848][106225] Updated weights for policy 1, policy_version 1781801 (0.0008) [2023-12-28 08:02:13,910][106225] Updated weights for policy 1, policy_version 1781811 (0.0010) [2023-12-28 08:02:13,965][106225] Updated weights for policy 1, policy_version 1781823 (0.0009) [2023-12-28 08:02:14,043][106226] Updated weights for policy 0, policy_version 1777549 (0.0006) [2023-12-28 08:02:14,101][106226] Updated weights for policy 0, policy_version 1777559 (0.0005) [2023-12-28 08:02:14,166][106226] Updated weights for policy 0, policy_version 1777569 (0.0007) [2023-12-28 08:02:14,648][106225] Updated weights for policy 1, policy_version 1781833 (0.0007) [2023-12-28 08:02:14,705][106225] Updated weights for policy 1, policy_version 1781843 (0.0006) [2023-12-28 08:02:14,759][106225] Updated weights for policy 1, policy_version 1781853 (0.0006) [2023-12-28 08:02:14,844][106226] Updated weights for policy 0, policy_version 1777579 (0.0008) [2023-12-28 08:02:14,905][106226] Updated weights for policy 0, policy_version 1777589 (0.0009) [2023-12-28 08:02:14,968][106226] Updated weights for policy 0, policy_version 1777599 (0.0009) [2023-12-28 08:02:15,491][106225] Updated weights for policy 1, policy_version 1781863 (0.0006) [2023-12-28 08:02:15,550][106225] Updated weights for policy 1, policy_version 1781873 (0.0005) [2023-12-28 08:02:15,609][106225] Updated weights for policy 1, policy_version 1781883 (0.0005) [2023-12-28 08:02:15,673][106226] Updated weights for policy 0, policy_version 1777609 (0.0008) [2023-12-28 08:02:15,725][106226] Updated weights for policy 0, policy_version 1777619 (0.0006) [2023-12-28 08:02:15,791][106226] Updated weights for policy 0, policy_version 1777629 (0.0006) [2023-12-28 08:02:15,858][106226] Updated weights for policy 0, policy_version 1777639 (0.0008) [2023-12-28 08:02:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19387.8, 300 sec: 19633.0). Total num frames: 911376384. Throughput: 0: 9908.1, 1: 9508.7. Samples: 911366748. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:16,175][105115] Avg episode reward: [(0, '-4.571'), (1, '-4.611')] [2023-12-28 08:02:16,271][106225] Updated weights for policy 1, policy_version 1781893 (0.0008) [2023-12-28 08:02:16,332][106225] Updated weights for policy 1, policy_version 1781903 (0.0010) [2023-12-28 08:02:16,396][106225] Updated weights for policy 1, policy_version 1781913 (0.0011) [2023-12-28 08:02:16,506][106226] Updated weights for policy 0, policy_version 1777649 (0.0005) [2023-12-28 08:02:16,555][106226] Updated weights for policy 0, policy_version 1777659 (0.0010) [2023-12-28 08:02:16,604][106226] Updated weights for policy 0, policy_version 1777669 (0.0010) [2023-12-28 08:02:17,060][106225] Updated weights for policy 1, policy_version 1781923 (0.0010) [2023-12-28 08:02:17,126][106225] Updated weights for policy 1, policy_version 1781933 (0.0006) [2023-12-28 08:02:17,194][106225] Updated weights for policy 1, policy_version 1781943 (0.0005) [2023-12-28 08:02:17,280][106226] Updated weights for policy 0, policy_version 1777679 (0.0007) [2023-12-28 08:02:17,337][106226] Updated weights for policy 0, policy_version 1777689 (0.0005) [2023-12-28 08:02:17,390][106226] Updated weights for policy 0, policy_version 1777699 (0.0005) [2023-12-28 08:02:17,873][106225] Updated weights for policy 1, policy_version 1781953 (0.0007) [2023-12-28 08:02:17,948][106225] Updated weights for policy 1, policy_version 1781963 (0.0010) [2023-12-28 08:02:17,992][106226] Updated weights for policy 0, policy_version 1777709 (0.0006) [2023-12-28 08:02:18,007][106225] Updated weights for policy 1, policy_version 1781973 (0.0007) [2023-12-28 08:02:18,053][106226] Updated weights for policy 0, policy_version 1777719 (0.0007) [2023-12-28 08:02:18,074][106225] Updated weights for policy 1, policy_version 1781983 (0.0008) [2023-12-28 08:02:18,122][106226] Updated weights for policy 0, policy_version 1777729 (0.0008) [2023-12-28 08:02:18,778][106225] Updated weights for policy 1, policy_version 1781993 (0.0009) [2023-12-28 08:02:18,833][106226] Updated weights for policy 0, policy_version 1777739 (0.0009) [2023-12-28 08:02:18,844][106225] Updated weights for policy 1, policy_version 1782003 (0.0008) [2023-12-28 08:02:18,903][106226] Updated weights for policy 0, policy_version 1777749 (0.0006) [2023-12-28 08:02:18,905][106225] Updated weights for policy 1, policy_version 1782013 (0.0008) [2023-12-28 08:02:18,972][106226] Updated weights for policy 0, policy_version 1777759 (0.0006) [2023-12-28 08:02:19,693][106225] Updated weights for policy 1, policy_version 1782023 (0.0008) [2023-12-28 08:02:19,711][106226] Updated weights for policy 0, policy_version 1777769 (0.0008) [2023-12-28 08:02:19,746][106225] Updated weights for policy 1, policy_version 1782033 (0.0008) [2023-12-28 08:02:19,773][106226] Updated weights for policy 0, policy_version 1777779 (0.0011) [2023-12-28 08:02:19,806][106225] Updated weights for policy 1, policy_version 1782043 (0.0008) [2023-12-28 08:02:19,842][106226] Updated weights for policy 0, policy_version 1777789 (0.0011) [2023-12-28 08:02:19,900][106226] Updated weights for policy 0, policy_version 1777799 (0.0009) [2023-12-28 08:02:20,565][106225] Updated weights for policy 1, policy_version 1782053 (0.0008) [2023-12-28 08:02:20,627][106225] Updated weights for policy 1, policy_version 1782063 (0.0007) [2023-12-28 08:02:20,689][106225] Updated weights for policy 1, policy_version 1782073 (0.0006) [2023-12-28 08:02:20,722][106226] Updated weights for policy 0, policy_version 1777809 (0.0008) [2023-12-28 08:02:20,785][106226] Updated weights for policy 0, policy_version 1777819 (0.0009) [2023-12-28 08:02:20,846][106226] Updated weights for policy 0, policy_version 1777829 (0.0009) [2023-12-28 08:02:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 911474688. Throughput: 0: 9889.4, 1: 9476.5. Samples: 911483120. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:21,176][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.619')] [2023-12-28 08:02:21,464][106225] Updated weights for policy 1, policy_version 1782083 (0.0008) [2023-12-28 08:02:21,530][106225] Updated weights for policy 1, policy_version 1782093 (0.0009) [2023-12-28 08:02:21,592][106225] Updated weights for policy 1, policy_version 1782103 (0.0009) [2023-12-28 08:02:21,656][106226] Updated weights for policy 0, policy_version 1777839 (0.0009) [2023-12-28 08:02:21,715][106226] Updated weights for policy 0, policy_version 1777849 (0.0008) [2023-12-28 08:02:21,787][106226] Updated weights for policy 0, policy_version 1777859 (0.0009) [2023-12-28 08:02:22,365][106225] Updated weights for policy 1, policy_version 1782113 (0.0008) [2023-12-28 08:02:22,432][106225] Updated weights for policy 1, policy_version 1782123 (0.0008) [2023-12-28 08:02:22,496][106225] Updated weights for policy 1, policy_version 1782133 (0.0008) [2023-12-28 08:02:22,559][106225] Updated weights for policy 1, policy_version 1782143 (0.0008) [2023-12-28 08:02:22,575][106226] Updated weights for policy 0, policy_version 1777869 (0.0008) [2023-12-28 08:02:22,632][106226] Updated weights for policy 0, policy_version 1777879 (0.0008) [2023-12-28 08:02:22,689][106226] Updated weights for policy 0, policy_version 1777889 (0.0009) [2023-12-28 08:02:23,294][106225] Updated weights for policy 1, policy_version 1782153 (0.0009) [2023-12-28 08:02:23,358][106225] Updated weights for policy 1, policy_version 1782163 (0.0009) [2023-12-28 08:02:23,411][106225] Updated weights for policy 1, policy_version 1782173 (0.0009) [2023-12-28 08:02:23,435][106226] Updated weights for policy 0, policy_version 1777899 (0.0009) [2023-12-28 08:02:23,492][106226] Updated weights for policy 0, policy_version 1777909 (0.0008) [2023-12-28 08:02:23,550][106226] Updated weights for policy 0, policy_version 1777919 (0.0009) [2023-12-28 08:02:24,177][106225] Updated weights for policy 1, policy_version 1782183 (0.0008) [2023-12-28 08:02:24,207][106226] Updated weights for policy 0, policy_version 1777929 (0.0007) [2023-12-28 08:02:24,237][106225] Updated weights for policy 1, policy_version 1782193 (0.0008) [2023-12-28 08:02:24,269][106226] Updated weights for policy 0, policy_version 1777939 (0.0007) [2023-12-28 08:02:24,298][106225] Updated weights for policy 1, policy_version 1782203 (0.0008) [2023-12-28 08:02:24,328][106226] Updated weights for policy 0, policy_version 1777949 (0.0007) [2023-12-28 08:02:24,390][106226] Updated weights for policy 0, policy_version 1777959 (0.0008) [2023-12-28 08:02:25,019][106225] Updated weights for policy 1, policy_version 1782213 (0.0009) [2023-12-28 08:02:25,081][106225] Updated weights for policy 1, policy_version 1782223 (0.0008) [2023-12-28 08:02:25,123][106226] Updated weights for policy 0, policy_version 1777969 (0.0007) [2023-12-28 08:02:25,143][106225] Updated weights for policy 1, policy_version 1782233 (0.0007) [2023-12-28 08:02:25,179][106226] Updated weights for policy 0, policy_version 1777979 (0.0006) [2023-12-28 08:02:25,237][106226] Updated weights for policy 0, policy_version 1777989 (0.0006) [2023-12-28 08:02:25,828][106225] Updated weights for policy 1, policy_version 1782243 (0.0008) [2023-12-28 08:02:25,887][106225] Updated weights for policy 1, policy_version 1782253 (0.0009) [2023-12-28 08:02:25,943][106225] Updated weights for policy 1, policy_version 1782263 (0.0007) [2023-12-28 08:02:25,952][106226] Updated weights for policy 0, policy_version 1777999 (0.0009) [2023-12-28 08:02:26,000][106226] Updated weights for policy 0, policy_version 1778009 (0.0007) [2023-12-28 08:02:26,057][106226] Updated weights for policy 0, policy_version 1778019 (0.0009) [2023-12-28 08:02:26,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 911572992. Throughput: 0: 9826.5, 1: 9422.3. Samples: 911538104. Policy #0 lag: (min: 23.0, avg: 34.9, max: 55.0) [2023-12-28 08:02:26,176][105115] Avg episode reward: [(0, '-4.486'), (1, '-4.820')] [2023-12-28 08:02:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001782272_456318976.pth... [2023-12-28 08:02:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001778024_455254016.pth... [2023-12-28 08:02:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001776872_454959104.pth [2023-12-28 08:02:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001781152_456032256.pth [2023-12-28 08:02:26,614][106225] Updated weights for policy 1, policy_version 1782273 (0.0006) [2023-12-28 08:02:26,672][106225] Updated weights for policy 1, policy_version 1782283 (0.0009) [2023-12-28 08:02:26,730][106225] Updated weights for policy 1, policy_version 1782293 (0.0009) [2023-12-28 08:02:26,782][106225] Updated weights for policy 1, policy_version 1782303 (0.0005) [2023-12-28 08:02:26,822][106226] Updated weights for policy 0, policy_version 1778029 (0.0010) [2023-12-28 08:02:26,872][106226] Updated weights for policy 0, policy_version 1778040 (0.0009) [2023-12-28 08:02:26,928][106226] Updated weights for policy 0, policy_version 1778050 (0.0009) [2023-12-28 08:02:27,443][106225] Updated weights for policy 1, policy_version 1782313 (0.0010) [2023-12-28 08:02:27,503][106225] Updated weights for policy 1, policy_version 1782323 (0.0008) [2023-12-28 08:02:27,563][106225] Updated weights for policy 1, policy_version 1782333 (0.0007) [2023-12-28 08:02:27,683][106226] Updated weights for policy 0, policy_version 1778060 (0.0008) [2023-12-28 08:02:27,737][106226] Updated weights for policy 0, policy_version 1778070 (0.0009) [2023-12-28 08:02:27,788][106226] Updated weights for policy 0, policy_version 1778080 (0.0009) [2023-12-28 08:02:28,158][106225] Updated weights for policy 1, policy_version 1782343 (0.0009) [2023-12-28 08:02:28,207][106225] Updated weights for policy 1, policy_version 1782353 (0.0008) [2023-12-28 08:02:28,254][106225] Updated weights for policy 1, policy_version 1782363 (0.0008) [2023-12-28 08:02:28,599][106226] Updated weights for policy 0, policy_version 1778090 (0.0008) [2023-12-28 08:02:28,655][106226] Updated weights for policy 0, policy_version 1778100 (0.0009) [2023-12-28 08:02:28,709][106226] Updated weights for policy 0, policy_version 1778110 (0.0009) [2023-12-28 08:02:28,775][106226] Updated weights for policy 0, policy_version 1778120 (0.0008) [2023-12-28 08:02:28,917][106225] Updated weights for policy 1, policy_version 1782373 (0.0007) [2023-12-28 08:02:28,966][106225] Updated weights for policy 1, policy_version 1782383 (0.0008) [2023-12-28 08:02:29,027][106225] Updated weights for policy 1, policy_version 1782393 (0.0009) [2023-12-28 08:02:29,489][106226] Updated weights for policy 0, policy_version 1778130 (0.0008) [2023-12-28 08:02:29,547][106226] Updated weights for policy 0, policy_version 1778140 (0.0008) [2023-12-28 08:02:29,604][106226] Updated weights for policy 0, policy_version 1778150 (0.0008) [2023-12-28 08:02:29,801][106225] Updated weights for policy 1, policy_version 1782403 (0.0010) [2023-12-28 08:02:29,867][106225] Updated weights for policy 1, policy_version 1782413 (0.0008) [2023-12-28 08:02:29,925][106225] Updated weights for policy 1, policy_version 1782423 (0.0008) [2023-12-28 08:02:30,271][106226] Updated weights for policy 0, policy_version 1778160 (0.0009) [2023-12-28 08:02:30,332][106226] Updated weights for policy 0, policy_version 1778170 (0.0009) [2023-12-28 08:02:30,394][106226] Updated weights for policy 0, policy_version 1778180 (0.0009) [2023-12-28 08:02:30,685][106225] Updated weights for policy 1, policy_version 1782433 (0.0008) [2023-12-28 08:02:30,751][106225] Updated weights for policy 1, policy_version 1782443 (0.0008) [2023-12-28 08:02:30,819][106225] Updated weights for policy 1, policy_version 1782453 (0.0008) [2023-12-28 08:02:30,877][106225] Updated weights for policy 1, policy_version 1782463 (0.0008) [2023-12-28 08:02:31,112][106226] Updated weights for policy 0, policy_version 1778190 (0.0007) [2023-12-28 08:02:31,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19577.5). Total num frames: 911663104. Throughput: 0: 9748.2, 1: 9533.6. Samples: 911655144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:31,175][105115] Avg episode reward: [(0, '-4.716'), (1, '-4.908')] [2023-12-28 08:02:31,185][106226] Updated weights for policy 0, policy_version 1778200 (0.0008) [2023-12-28 08:02:31,239][106226] Updated weights for policy 0, policy_version 1778210 (0.0008) [2023-12-28 08:02:31,670][106225] Updated weights for policy 1, policy_version 1782473 (0.0007) [2023-12-28 08:02:31,737][106225] Updated weights for policy 1, policy_version 1782483 (0.0008) [2023-12-28 08:02:31,804][106225] Updated weights for policy 1, policy_version 1782493 (0.0009) [2023-12-28 08:02:32,002][106226] Updated weights for policy 0, policy_version 1778220 (0.0008) [2023-12-28 08:02:32,058][106226] Updated weights for policy 0, policy_version 1778230 (0.0009) [2023-12-28 08:02:32,110][106226] Updated weights for policy 0, policy_version 1778240 (0.0009) [2023-12-28 08:02:32,508][106225] Updated weights for policy 1, policy_version 1782503 (0.0007) [2023-12-28 08:02:32,573][106225] Updated weights for policy 1, policy_version 1782513 (0.0008) [2023-12-28 08:02:32,641][106225] Updated weights for policy 1, policy_version 1782523 (0.0009) [2023-12-28 08:02:32,826][106226] Updated weights for policy 0, policy_version 1778250 (0.0010) [2023-12-28 08:02:32,889][106226] Updated weights for policy 0, policy_version 1778260 (0.0005) [2023-12-28 08:02:32,953][106226] Updated weights for policy 0, policy_version 1778270 (0.0006) [2023-12-28 08:02:33,013][106226] Updated weights for policy 0, policy_version 1778280 (0.0009) [2023-12-28 08:02:33,297][106225] Updated weights for policy 1, policy_version 1782533 (0.0008) [2023-12-28 08:02:33,362][106225] Updated weights for policy 1, policy_version 1782543 (0.0007) [2023-12-28 08:02:33,418][106225] Updated weights for policy 1, policy_version 1782553 (0.0008) [2023-12-28 08:02:33,684][106226] Updated weights for policy 0, policy_version 1778290 (0.0011) [2023-12-28 08:02:33,745][106226] Updated weights for policy 0, policy_version 1778300 (0.0010) [2023-12-28 08:02:33,806][106226] Updated weights for policy 0, policy_version 1778310 (0.0011) [2023-12-28 08:02:34,069][106225] Updated weights for policy 1, policy_version 1782563 (0.0008) [2023-12-28 08:02:34,131][106225] Updated weights for policy 1, policy_version 1782573 (0.0008) [2023-12-28 08:02:34,196][106225] Updated weights for policy 1, policy_version 1782583 (0.0009) [2023-12-28 08:02:34,538][106226] Updated weights for policy 0, policy_version 1778320 (0.0011) [2023-12-28 08:02:34,600][106226] Updated weights for policy 0, policy_version 1778330 (0.0010) [2023-12-28 08:02:34,664][106226] Updated weights for policy 0, policy_version 1778340 (0.0009) [2023-12-28 08:02:34,909][106225] Updated weights for policy 1, policy_version 1782593 (0.0008) [2023-12-28 08:02:34,967][106225] Updated weights for policy 1, policy_version 1782603 (0.0010) [2023-12-28 08:02:35,033][106225] Updated weights for policy 1, policy_version 1782613 (0.0011) [2023-12-28 08:02:35,091][106225] Updated weights for policy 1, policy_version 1782623 (0.0010) [2023-12-28 08:02:35,373][106226] Updated weights for policy 0, policy_version 1778350 (0.0007) [2023-12-28 08:02:35,436][106226] Updated weights for policy 0, policy_version 1778360 (0.0006) [2023-12-28 08:02:35,497][106226] Updated weights for policy 0, policy_version 1778370 (0.0005) [2023-12-28 08:02:35,809][106225] Updated weights for policy 1, policy_version 1782633 (0.0009) [2023-12-28 08:02:35,865][106225] Updated weights for policy 1, policy_version 1782643 (0.0007) [2023-12-28 08:02:35,930][106225] Updated weights for policy 1, policy_version 1782653 (0.0006) [2023-12-28 08:02:36,175][105115] Fps is (10 sec: 18842.3, 60 sec: 19387.7, 300 sec: 19577.5). Total num frames: 911761408. Throughput: 0: 9750.5, 1: 9555.9. Samples: 911771500. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:36,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.877')] [2023-12-28 08:02:36,212][106226] Updated weights for policy 0, policy_version 1778380 (0.0008) [2023-12-28 08:02:36,282][106226] Updated weights for policy 0, policy_version 1778390 (0.0011) [2023-12-28 08:02:36,348][106226] Updated weights for policy 0, policy_version 1778400 (0.0011) [2023-12-28 08:02:36,636][106225] Updated weights for policy 1, policy_version 1782663 (0.0009) [2023-12-28 08:02:36,703][106225] Updated weights for policy 1, policy_version 1782673 (0.0010) [2023-12-28 08:02:36,767][106225] Updated weights for policy 1, policy_version 1782683 (0.0010) [2023-12-28 08:02:37,076][106226] Updated weights for policy 0, policy_version 1778410 (0.0011) [2023-12-28 08:02:37,134][106226] Updated weights for policy 0, policy_version 1778420 (0.0011) [2023-12-28 08:02:37,199][106226] Updated weights for policy 0, policy_version 1778430 (0.0011) [2023-12-28 08:02:37,257][106226] Updated weights for policy 0, policy_version 1778440 (0.0011) [2023-12-28 08:02:37,471][106225] Updated weights for policy 1, policy_version 1782693 (0.0010) [2023-12-28 08:02:37,527][106225] Updated weights for policy 1, policy_version 1782703 (0.0009) [2023-12-28 08:02:37,584][106225] Updated weights for policy 1, policy_version 1782713 (0.0010) [2023-12-28 08:02:37,997][106226] Updated weights for policy 0, policy_version 1778450 (0.0011) [2023-12-28 08:02:38,055][106226] Updated weights for policy 0, policy_version 1778460 (0.0011) [2023-12-28 08:02:38,133][106226] Updated weights for policy 0, policy_version 1778470 (0.0010) [2023-12-28 08:02:38,255][106225] Updated weights for policy 1, policy_version 1782723 (0.0009) [2023-12-28 08:02:38,315][106225] Updated weights for policy 1, policy_version 1782733 (0.0010) [2023-12-28 08:02:38,388][106225] Updated weights for policy 1, policy_version 1782744 (0.0010) [2023-12-28 08:02:38,862][106226] Updated weights for policy 0, policy_version 1778480 (0.0010) [2023-12-28 08:02:38,930][106226] Updated weights for policy 0, policy_version 1778490 (0.0008) [2023-12-28 08:02:39,001][106226] Updated weights for policy 0, policy_version 1778500 (0.0009) [2023-12-28 08:02:39,091][106225] Updated weights for policy 1, policy_version 1782754 (0.0006) [2023-12-28 08:02:39,142][106225] Updated weights for policy 1, policy_version 1782764 (0.0007) [2023-12-28 08:02:39,200][106225] Updated weights for policy 1, policy_version 1782774 (0.0008) [2023-12-28 08:02:39,267][106225] Updated weights for policy 1, policy_version 1782784 (0.0008) [2023-12-28 08:02:39,791][106226] Updated weights for policy 0, policy_version 1778510 (0.0010) [2023-12-28 08:02:39,864][106226] Updated weights for policy 0, policy_version 1778520 (0.0009) [2023-12-28 08:02:39,932][106226] Updated weights for policy 0, policy_version 1778530 (0.0010) [2023-12-28 08:02:40,103][106225] Updated weights for policy 1, policy_version 1782794 (0.0008) [2023-12-28 08:02:40,162][106225] Updated weights for policy 1, policy_version 1782804 (0.0008) [2023-12-28 08:02:40,227][106225] Updated weights for policy 1, policy_version 1782814 (0.0008) [2023-12-28 08:02:40,654][106226] Updated weights for policy 0, policy_version 1778540 (0.0008) [2023-12-28 08:02:40,716][106226] Updated weights for policy 0, policy_version 1778550 (0.0011) [2023-12-28 08:02:40,782][106226] Updated weights for policy 0, policy_version 1778560 (0.0011) [2023-12-28 08:02:40,992][106225] Updated weights for policy 1, policy_version 1782824 (0.0006) [2023-12-28 08:02:41,059][106225] Updated weights for policy 1, policy_version 1782834 (0.0007) [2023-12-28 08:02:41,124][106225] Updated weights for policy 1, policy_version 1782844 (0.0008) [2023-12-28 08:02:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19251.2, 300 sec: 19577.5). Total num frames: 911859712. Throughput: 0: 9714.9, 1: 9604.3. Samples: 911828896. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:41,175][105115] Avg episode reward: [(0, '-4.543'), (1, '-4.878')] [2023-12-28 08:02:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001782848_456466432.pth... [2023-12-28 08:02:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001778568_455393280.pth... [2023-12-28 08:02:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001781696_456171520.pth [2023-12-28 08:02:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001777448_455106560.pth [2023-12-28 08:02:41,521][106226] Updated weights for policy 0, policy_version 1778570 (0.0008) [2023-12-28 08:02:41,587][106226] Updated weights for policy 0, policy_version 1778580 (0.0011) [2023-12-28 08:02:41,663][106226] Updated weights for policy 0, policy_version 1778590 (0.0011) [2023-12-28 08:02:41,737][106226] Updated weights for policy 0, policy_version 1778600 (0.0009) [2023-12-28 08:02:41,911][106225] Updated weights for policy 1, policy_version 1782854 (0.0008) [2023-12-28 08:02:41,979][106225] Updated weights for policy 1, policy_version 1782864 (0.0010) [2023-12-28 08:02:42,038][106225] Updated weights for policy 1, policy_version 1782874 (0.0011) [2023-12-28 08:02:42,465][106226] Updated weights for policy 0, policy_version 1778610 (0.0011) [2023-12-28 08:02:42,528][106226] Updated weights for policy 0, policy_version 1778620 (0.0011) [2023-12-28 08:02:42,587][106226] Updated weights for policy 0, policy_version 1778630 (0.0011) [2023-12-28 08:02:42,704][106225] Updated weights for policy 1, policy_version 1782884 (0.0009) [2023-12-28 08:02:42,762][106225] Updated weights for policy 1, policy_version 1782894 (0.0007) [2023-12-28 08:02:42,816][106225] Updated weights for policy 1, policy_version 1782904 (0.0006) [2023-12-28 08:02:43,274][106226] Updated weights for policy 0, policy_version 1778640 (0.0009) [2023-12-28 08:02:43,333][106226] Updated weights for policy 0, policy_version 1778650 (0.0008) [2023-12-28 08:02:43,392][106226] Updated weights for policy 0, policy_version 1778660 (0.0008) [2023-12-28 08:02:43,554][106225] Updated weights for policy 1, policy_version 1782914 (0.0008) [2023-12-28 08:02:43,614][106225] Updated weights for policy 1, policy_version 1782924 (0.0005) [2023-12-28 08:02:43,672][106225] Updated weights for policy 1, policy_version 1782934 (0.0006) [2023-12-28 08:02:43,721][106225] Updated weights for policy 1, policy_version 1782944 (0.0009) [2023-12-28 08:02:44,011][106226] Updated weights for policy 0, policy_version 1778670 (0.0009) [2023-12-28 08:02:44,069][106226] Updated weights for policy 0, policy_version 1778680 (0.0011) [2023-12-28 08:02:44,133][106226] Updated weights for policy 0, policy_version 1778690 (0.0010) [2023-12-28 08:02:44,399][106225] Updated weights for policy 1, policy_version 1782954 (0.0008) [2023-12-28 08:02:44,452][106225] Updated weights for policy 1, policy_version 1782964 (0.0010) [2023-12-28 08:02:44,516][106225] Updated weights for policy 1, policy_version 1782974 (0.0010) [2023-12-28 08:02:44,837][106226] Updated weights for policy 0, policy_version 1778700 (0.0010) [2023-12-28 08:02:44,899][106226] Updated weights for policy 0, policy_version 1778710 (0.0007) [2023-12-28 08:02:44,963][106226] Updated weights for policy 0, policy_version 1778720 (0.0009) [2023-12-28 08:02:45,256][106225] Updated weights for policy 1, policy_version 1782984 (0.0011) [2023-12-28 08:02:45,318][106225] Updated weights for policy 1, policy_version 1782994 (0.0008) [2023-12-28 08:02:45,378][106225] Updated weights for policy 1, policy_version 1783004 (0.0008) [2023-12-28 08:02:45,713][106226] Updated weights for policy 0, policy_version 1778730 (0.0011) [2023-12-28 08:02:45,779][106226] Updated weights for policy 0, policy_version 1778740 (0.0009) [2023-12-28 08:02:45,836][106226] Updated weights for policy 0, policy_version 1778750 (0.0008) [2023-12-28 08:02:45,902][106226] Updated weights for policy 0, policy_version 1778760 (0.0008) [2023-12-28 08:02:46,026][106225] Updated weights for policy 1, policy_version 1783014 (0.0010) [2023-12-28 08:02:46,084][106225] Updated weights for policy 1, policy_version 1783024 (0.0009) [2023-12-28 08:02:46,144][106225] Updated weights for policy 1, policy_version 1783034 (0.0008) [2023-12-28 08:02:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19114.7, 300 sec: 19549.7). Total num frames: 911949824. Throughput: 0: 9644.0, 1: 9603.2. Samples: 911942428. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:46,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.880')] [2023-12-28 08:02:46,646][106226] Updated weights for policy 0, policy_version 1778770 (0.0009) [2023-12-28 08:02:46,702][106226] Updated weights for policy 0, policy_version 1778780 (0.0009) [2023-12-28 08:02:46,752][106226] Updated weights for policy 0, policy_version 1778790 (0.0007) [2023-12-28 08:02:46,899][106225] Updated weights for policy 1, policy_version 1783044 (0.0009) [2023-12-28 08:02:46,959][106225] Updated weights for policy 1, policy_version 1783054 (0.0008) [2023-12-28 08:02:47,018][106225] Updated weights for policy 1, policy_version 1783064 (0.0005) [2023-12-28 08:02:47,438][106226] Updated weights for policy 0, policy_version 1778800 (0.0008) [2023-12-28 08:02:47,489][106226] Updated weights for policy 0, policy_version 1778810 (0.0008) [2023-12-28 08:02:47,545][106226] Updated weights for policy 0, policy_version 1778820 (0.0008) [2023-12-28 08:02:47,739][106225] Updated weights for policy 1, policy_version 1783074 (0.0008) [2023-12-28 08:02:47,794][106225] Updated weights for policy 1, policy_version 1783084 (0.0007) [2023-12-28 08:02:47,843][106225] Updated weights for policy 1, policy_version 1783094 (0.0008) [2023-12-28 08:02:47,902][106225] Updated weights for policy 1, policy_version 1783104 (0.0009) [2023-12-28 08:02:48,289][106226] Updated weights for policy 0, policy_version 1778830 (0.0007) [2023-12-28 08:02:48,351][106226] Updated weights for policy 0, policy_version 1778840 (0.0007) [2023-12-28 08:02:48,411][106226] Updated weights for policy 0, policy_version 1778850 (0.0007) [2023-12-28 08:02:48,695][106225] Updated weights for policy 1, policy_version 1783114 (0.0008) [2023-12-28 08:02:48,760][106225] Updated weights for policy 1, policy_version 1783124 (0.0009) [2023-12-28 08:02:48,821][106225] Updated weights for policy 1, policy_version 1783134 (0.0009) [2023-12-28 08:02:49,135][106226] Updated weights for policy 0, policy_version 1778860 (0.0007) [2023-12-28 08:02:49,184][106226] Updated weights for policy 0, policy_version 1778870 (0.0008) [2023-12-28 08:02:49,252][106226] Updated weights for policy 0, policy_version 1778880 (0.0008) [2023-12-28 08:02:49,612][106225] Updated weights for policy 1, policy_version 1783144 (0.0008) [2023-12-28 08:02:49,674][106225] Updated weights for policy 1, policy_version 1783154 (0.0009) [2023-12-28 08:02:49,739][106225] Updated weights for policy 1, policy_version 1783164 (0.0009) [2023-12-28 08:02:50,076][106226] Updated weights for policy 0, policy_version 1778890 (0.0009) [2023-12-28 08:02:50,137][106226] Updated weights for policy 0, policy_version 1778900 (0.0009) [2023-12-28 08:02:50,191][106226] Updated weights for policy 0, policy_version 1778910 (0.0008) [2023-12-28 08:02:50,249][106226] Updated weights for policy 0, policy_version 1778920 (0.0011) [2023-12-28 08:02:50,501][106225] Updated weights for policy 1, policy_version 1783174 (0.0008) [2023-12-28 08:02:50,549][106225] Updated weights for policy 1, policy_version 1783184 (0.0008) [2023-12-28 08:02:50,618][106225] Updated weights for policy 1, policy_version 1783194 (0.0008) [2023-12-28 08:02:51,013][106226] Updated weights for policy 0, policy_version 1778930 (0.0010) [2023-12-28 08:02:51,087][106226] Updated weights for policy 0, policy_version 1778940 (0.0010) [2023-12-28 08:02:51,155][106226] Updated weights for policy 0, policy_version 1778950 (0.0008) [2023-12-28 08:02:51,174][105115] Fps is (10 sec: 18842.3, 60 sec: 19251.2, 300 sec: 19549.7). Total num frames: 912048128. Throughput: 0: 9580.2, 1: 9564.9. Samples: 912055296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:51,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-5.101')] [2023-12-28 08:02:51,354][106225] Updated weights for policy 1, policy_version 1783204 (0.0006) [2023-12-28 08:02:51,424][106225] Updated weights for policy 1, policy_version 1783214 (0.0008) [2023-12-28 08:02:51,483][106225] Updated weights for policy 1, policy_version 1783224 (0.0008) [2023-12-28 08:02:51,942][106226] Updated weights for policy 0, policy_version 1778960 (0.0009) [2023-12-28 08:02:52,008][106226] Updated weights for policy 0, policy_version 1778970 (0.0008) [2023-12-28 08:02:52,067][106226] Updated weights for policy 0, policy_version 1778980 (0.0008) [2023-12-28 08:02:52,263][106225] Updated weights for policy 1, policy_version 1783234 (0.0009) [2023-12-28 08:02:52,325][106225] Updated weights for policy 1, policy_version 1783244 (0.0010) [2023-12-28 08:02:52,395][106225] Updated weights for policy 1, policy_version 1783254 (0.0011) [2023-12-28 08:02:52,455][106225] Updated weights for policy 1, policy_version 1783264 (0.0009) [2023-12-28 08:02:52,831][106226] Updated weights for policy 0, policy_version 1778990 (0.0009) [2023-12-28 08:02:52,897][106226] Updated weights for policy 0, policy_version 1779000 (0.0008) [2023-12-28 08:02:52,959][106226] Updated weights for policy 0, policy_version 1779010 (0.0008) [2023-12-28 08:02:53,186][106225] Updated weights for policy 1, policy_version 1783274 (0.0011) [2023-12-28 08:02:53,248][106225] Updated weights for policy 1, policy_version 1783284 (0.0010) [2023-12-28 08:02:53,310][106225] Updated weights for policy 1, policy_version 1783294 (0.0010) [2023-12-28 08:02:53,698][106226] Updated weights for policy 0, policy_version 1779020 (0.0008) [2023-12-28 08:02:53,752][106226] Updated weights for policy 0, policy_version 1779030 (0.0008) [2023-12-28 08:02:53,816][106226] Updated weights for policy 0, policy_version 1779040 (0.0008) [2023-12-28 08:02:54,038][106225] Updated weights for policy 1, policy_version 1783304 (0.0011) [2023-12-28 08:02:54,094][106225] Updated weights for policy 1, policy_version 1783314 (0.0011) [2023-12-28 08:02:54,153][106225] Updated weights for policy 1, policy_version 1783324 (0.0010) [2023-12-28 08:02:54,581][106226] Updated weights for policy 0, policy_version 1779050 (0.0009) [2023-12-28 08:02:54,639][106226] Updated weights for policy 0, policy_version 1779060 (0.0008) [2023-12-28 08:02:54,700][106226] Updated weights for policy 0, policy_version 1779070 (0.0007) [2023-12-28 08:02:54,761][106226] Updated weights for policy 0, policy_version 1779080 (0.0007) [2023-12-28 08:02:54,889][106225] Updated weights for policy 1, policy_version 1783334 (0.0010) [2023-12-28 08:02:54,940][106225] Updated weights for policy 1, policy_version 1783344 (0.0010) [2023-12-28 08:02:54,996][106225] Updated weights for policy 1, policy_version 1783354 (0.0010) [2023-12-28 08:02:55,455][106226] Updated weights for policy 0, policy_version 1779090 (0.0006) [2023-12-28 08:02:55,510][106226] Updated weights for policy 0, policy_version 1779100 (0.0008) [2023-12-28 08:02:55,576][106226] Updated weights for policy 0, policy_version 1779110 (0.0008) [2023-12-28 08:02:55,747][106225] Updated weights for policy 1, policy_version 1783364 (0.0010) [2023-12-28 08:02:55,812][106225] Updated weights for policy 1, policy_version 1783374 (0.0008) [2023-12-28 08:02:55,878][106225] Updated weights for policy 1, policy_version 1783384 (0.0007) [2023-12-28 08:02:56,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19114.7, 300 sec: 19522.0). Total num frames: 912138240. Throughput: 0: 9521.5, 1: 9543.5. Samples: 912110148. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:02:56,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.756')] [2023-12-28 08:02:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001779112_455532544.pth... [2023-12-28 08:02:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001783392_456605696.pth... [2023-12-28 08:02:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001778024_455254016.pth [2023-12-28 08:02:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001782272_456318976.pth [2023-12-28 08:02:56,354][106226] Updated weights for policy 0, policy_version 1779120 (0.0009) [2023-12-28 08:02:56,408][106226] Updated weights for policy 0, policy_version 1779130 (0.0008) [2023-12-28 08:02:56,458][106226] Updated weights for policy 0, policy_version 1779140 (0.0009) [2023-12-28 08:02:56,544][106225] Updated weights for policy 1, policy_version 1783394 (0.0008) [2023-12-28 08:02:56,594][106225] Updated weights for policy 1, policy_version 1783404 (0.0009) [2023-12-28 08:02:56,642][106225] Updated weights for policy 1, policy_version 1783414 (0.0008) [2023-12-28 08:02:56,696][106225] Updated weights for policy 1, policy_version 1783424 (0.0008) [2023-12-28 08:02:57,156][106226] Updated weights for policy 0, policy_version 1779150 (0.0010) [2023-12-28 08:02:57,208][106226] Updated weights for policy 0, policy_version 1779160 (0.0011) [2023-12-28 08:02:57,270][106226] Updated weights for policy 0, policy_version 1779170 (0.0010) [2023-12-28 08:02:57,406][106225] Updated weights for policy 1, policy_version 1783434 (0.0009) [2023-12-28 08:02:57,467][106225] Updated weights for policy 1, policy_version 1783444 (0.0008) [2023-12-28 08:02:57,523][106225] Updated weights for policy 1, policy_version 1783454 (0.0008) [2023-12-28 08:02:57,994][106226] Updated weights for policy 0, policy_version 1779180 (0.0009) [2023-12-28 08:02:58,048][106226] Updated weights for policy 0, policy_version 1779190 (0.0006) [2023-12-28 08:02:58,101][106226] Updated weights for policy 0, policy_version 1779200 (0.0005) [2023-12-28 08:02:58,200][106225] Updated weights for policy 1, policy_version 1783464 (0.0010) [2023-12-28 08:02:58,267][106225] Updated weights for policy 1, policy_version 1783474 (0.0008) [2023-12-28 08:02:58,351][106225] Updated weights for policy 1, policy_version 1783484 (0.0010) [2023-12-28 08:02:58,930][106226] Updated weights for policy 0, policy_version 1779210 (0.0007) [2023-12-28 08:02:59,000][106226] Updated weights for policy 0, policy_version 1779220 (0.0008) [2023-12-28 08:02:59,061][106226] Updated weights for policy 0, policy_version 1779230 (0.0008) [2023-12-28 08:02:59,118][106226] Updated weights for policy 0, policy_version 1779240 (0.0008) [2023-12-28 08:02:59,140][106225] Updated weights for policy 1, policy_version 1783494 (0.0010) [2023-12-28 08:02:59,206][106225] Updated weights for policy 1, policy_version 1783504 (0.0009) [2023-12-28 08:02:59,288][106225] Updated weights for policy 1, policy_version 1783514 (0.0009) [2023-12-28 08:02:59,902][106226] Updated weights for policy 0, policy_version 1779250 (0.0008) [2023-12-28 08:02:59,966][106226] Updated weights for policy 0, policy_version 1779260 (0.0008) [2023-12-28 08:03:00,030][106226] Updated weights for policy 0, policy_version 1779270 (0.0009) [2023-12-28 08:03:00,049][106225] Updated weights for policy 1, policy_version 1783524 (0.0008) [2023-12-28 08:03:00,108][106225] Updated weights for policy 1, policy_version 1783534 (0.0008) [2023-12-28 08:03:00,167][106225] Updated weights for policy 1, policy_version 1783544 (0.0008) [2023-12-28 08:03:00,748][106226] Updated weights for policy 0, policy_version 1779280 (0.0009) [2023-12-28 08:03:00,808][106226] Updated weights for policy 0, policy_version 1779290 (0.0009) [2023-12-28 08:03:00,865][106226] Updated weights for policy 0, policy_version 1779300 (0.0009) [2023-12-28 08:03:00,878][106225] Updated weights for policy 1, policy_version 1783554 (0.0009) [2023-12-28 08:03:00,934][106225] Updated weights for policy 1, policy_version 1783564 (0.0009) [2023-12-28 08:03:00,987][106225] Updated weights for policy 1, policy_version 1783574 (0.0008) [2023-12-28 08:03:01,065][106225] Updated weights for policy 1, policy_version 1783584 (0.0008) [2023-12-28 08:03:01,174][105115] Fps is (10 sec: 18841.3, 60 sec: 19114.7, 300 sec: 19549.7). Total num frames: 912236544. Throughput: 0: 9459.7, 1: 9556.6. Samples: 912222484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:01,175][105115] Avg episode reward: [(0, '-4.292'), (1, '-4.797')] [2023-12-28 08:03:01,665][106226] Updated weights for policy 0, policy_version 1779310 (0.0007) [2023-12-28 08:03:01,727][106226] Updated weights for policy 0, policy_version 1779320 (0.0006) [2023-12-28 08:03:01,793][106226] Updated weights for policy 0, policy_version 1779330 (0.0008) [2023-12-28 08:03:01,823][106225] Updated weights for policy 1, policy_version 1783594 (0.0009) [2023-12-28 08:03:01,878][106225] Updated weights for policy 1, policy_version 1783604 (0.0008) [2023-12-28 08:03:01,941][106225] Updated weights for policy 1, policy_version 1783614 (0.0008) [2023-12-28 08:03:02,504][106226] Updated weights for policy 0, policy_version 1779340 (0.0007) [2023-12-28 08:03:02,566][106226] Updated weights for policy 0, policy_version 1779350 (0.0006) [2023-12-28 08:03:02,629][106226] Updated weights for policy 0, policy_version 1779360 (0.0006) [2023-12-28 08:03:02,713][106225] Updated weights for policy 1, policy_version 1783624 (0.0007) [2023-12-28 08:03:02,776][106225] Updated weights for policy 1, policy_version 1783634 (0.0009) [2023-12-28 08:03:02,840][106225] Updated weights for policy 1, policy_version 1783644 (0.0007) [2023-12-28 08:03:03,328][106226] Updated weights for policy 0, policy_version 1779370 (0.0006) [2023-12-28 08:03:03,384][106226] Updated weights for policy 0, policy_version 1779380 (0.0007) [2023-12-28 08:03:03,438][106226] Updated weights for policy 0, policy_version 1779390 (0.0008) [2023-12-28 08:03:03,490][106225] Updated weights for policy 1, policy_version 1783654 (0.0006) [2023-12-28 08:03:03,500][106226] Updated weights for policy 0, policy_version 1779400 (0.0006) [2023-12-28 08:03:03,543][106225] Updated weights for policy 1, policy_version 1783664 (0.0008) [2023-12-28 08:03:03,605][106225] Updated weights for policy 1, policy_version 1783674 (0.0008) [2023-12-28 08:03:04,168][106226] Updated weights for policy 0, policy_version 1779410 (0.0009) [2023-12-28 08:03:04,231][106226] Updated weights for policy 0, policy_version 1779420 (0.0006) [2023-12-28 08:03:04,297][106226] Updated weights for policy 0, policy_version 1779430 (0.0010) [2023-12-28 08:03:04,342][106225] Updated weights for policy 1, policy_version 1783684 (0.0009) [2023-12-28 08:03:04,410][106225] Updated weights for policy 1, policy_version 1783694 (0.0008) [2023-12-28 08:03:04,471][106225] Updated weights for policy 1, policy_version 1783704 (0.0008) [2023-12-28 08:03:04,992][106226] Updated weights for policy 0, policy_version 1779440 (0.0010) [2023-12-28 08:03:05,053][106226] Updated weights for policy 0, policy_version 1779450 (0.0010) [2023-12-28 08:03:05,118][106226] Updated weights for policy 0, policy_version 1779460 (0.0011) [2023-12-28 08:03:05,224][106225] Updated weights for policy 1, policy_version 1783714 (0.0009) [2023-12-28 08:03:05,286][106225] Updated weights for policy 1, policy_version 1783724 (0.0010) [2023-12-28 08:03:05,343][106225] Updated weights for policy 1, policy_version 1783734 (0.0010) [2023-12-28 08:03:05,401][106225] Updated weights for policy 1, policy_version 1783744 (0.0010) [2023-12-28 08:03:05,832][106226] Updated weights for policy 0, policy_version 1779470 (0.0010) [2023-12-28 08:03:05,892][106226] Updated weights for policy 0, policy_version 1779480 (0.0011) [2023-12-28 08:03:05,946][106226] Updated weights for policy 0, policy_version 1779490 (0.0010) [2023-12-28 08:03:06,131][106225] Updated weights for policy 1, policy_version 1783754 (0.0010) [2023-12-28 08:03:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19114.7, 300 sec: 19522.0). Total num frames: 912326656. Throughput: 0: 9451.7, 1: 9536.1. Samples: 912337568. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:06,175][105115] Avg episode reward: [(0, '-4.522'), (1, '-4.711')] [2023-12-28 08:03:06,197][106225] Updated weights for policy 1, policy_version 1783764 (0.0011) [2023-12-28 08:03:06,263][106225] Updated weights for policy 1, policy_version 1783774 (0.0011) [2023-12-28 08:03:06,674][106226] Updated weights for policy 0, policy_version 1779500 (0.0011) [2023-12-28 08:03:06,732][106226] Updated weights for policy 0, policy_version 1779510 (0.0011) [2023-12-28 08:03:06,793][106226] Updated weights for policy 0, policy_version 1779520 (0.0011) [2023-12-28 08:03:07,005][106225] Updated weights for policy 1, policy_version 1783784 (0.0011) [2023-12-28 08:03:07,064][106225] Updated weights for policy 1, policy_version 1783794 (0.0010) [2023-12-28 08:03:07,125][106225] Updated weights for policy 1, policy_version 1783804 (0.0010) [2023-12-28 08:03:07,534][106226] Updated weights for policy 0, policy_version 1779530 (0.0011) [2023-12-28 08:03:07,597][106226] Updated weights for policy 0, policy_version 1779540 (0.0011) [2023-12-28 08:03:07,660][106226] Updated weights for policy 0, policy_version 1779550 (0.0011) [2023-12-28 08:03:07,729][106226] Updated weights for policy 0, policy_version 1779560 (0.0011) [2023-12-28 08:03:07,861][106225] Updated weights for policy 1, policy_version 1783814 (0.0009) [2023-12-28 08:03:07,918][106225] Updated weights for policy 1, policy_version 1783824 (0.0005) [2023-12-28 08:03:07,976][106225] Updated weights for policy 1, policy_version 1783834 (0.0005) [2023-12-28 08:03:08,443][106226] Updated weights for policy 0, policy_version 1779570 (0.0011) [2023-12-28 08:03:08,496][106226] Updated weights for policy 0, policy_version 1779580 (0.0010) [2023-12-28 08:03:08,565][106226] Updated weights for policy 0, policy_version 1779590 (0.0011) [2023-12-28 08:03:08,653][106225] Updated weights for policy 1, policy_version 1783844 (0.0009) [2023-12-28 08:03:08,717][106225] Updated weights for policy 1, policy_version 1783854 (0.0010) [2023-12-28 08:03:08,790][106225] Updated weights for policy 1, policy_version 1783864 (0.0011) [2023-12-28 08:03:09,289][106226] Updated weights for policy 0, policy_version 1779600 (0.0007) [2023-12-28 08:03:09,355][106226] Updated weights for policy 0, policy_version 1779610 (0.0007) [2023-12-28 08:03:09,426][106226] Updated weights for policy 0, policy_version 1779620 (0.0008) [2023-12-28 08:03:09,530][106225] Updated weights for policy 1, policy_version 1783874 (0.0011) [2023-12-28 08:03:09,582][106225] Updated weights for policy 1, policy_version 1783884 (0.0010) [2023-12-28 08:03:09,639][106225] Updated weights for policy 1, policy_version 1783894 (0.0010) [2023-12-28 08:03:09,710][106225] Updated weights for policy 1, policy_version 1783904 (0.0010) [2023-12-28 08:03:10,211][106226] Updated weights for policy 0, policy_version 1779630 (0.0009) [2023-12-28 08:03:10,269][106226] Updated weights for policy 0, policy_version 1779640 (0.0010) [2023-12-28 08:03:10,344][106226] Updated weights for policy 0, policy_version 1779650 (0.0007) [2023-12-28 08:03:10,407][106225] Updated weights for policy 1, policy_version 1783914 (0.0007) [2023-12-28 08:03:10,467][106225] Updated weights for policy 1, policy_version 1783924 (0.0009) [2023-12-28 08:03:10,534][106225] Updated weights for policy 1, policy_version 1783934 (0.0008) [2023-12-28 08:03:11,163][106226] Updated weights for policy 0, policy_version 1779660 (0.0008) [2023-12-28 08:03:11,175][105115] Fps is (10 sec: 18022.2, 60 sec: 18978.1, 300 sec: 19494.2). Total num frames: 912416768. Throughput: 0: 9455.4, 1: 9581.0. Samples: 912394740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:11,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.708')] [2023-12-28 08:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001783936_456744960.pth... [2023-12-28 08:03:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001782848_456466432.pth [2023-12-28 08:03:11,238][106226] Updated weights for policy 0, policy_version 1779670 (0.0007) [2023-12-28 08:03:11,308][106226] Updated weights for policy 0, policy_version 1779680 (0.0007) [2023-12-28 08:03:11,342][106225] Updated weights for policy 1, policy_version 1783944 (0.0008) [2023-12-28 08:03:11,366][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001779688_455680000.pth... [2023-12-28 08:03:11,370][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001778568_455393280.pth [2023-12-28 08:03:11,412][106225] Updated weights for policy 1, policy_version 1783954 (0.0009) [2023-12-28 08:03:11,475][106225] Updated weights for policy 1, policy_version 1783964 (0.0009) [2023-12-28 08:03:12,092][106226] Updated weights for policy 0, policy_version 1779690 (0.0009) [2023-12-28 08:03:12,142][106226] Updated weights for policy 0, policy_version 1779700 (0.0008) [2023-12-28 08:03:12,199][106226] Updated weights for policy 0, policy_version 1779710 (0.0009) [2023-12-28 08:03:12,237][106225] Updated weights for policy 1, policy_version 1783974 (0.0008) [2023-12-28 08:03:12,261][106226] Updated weights for policy 0, policy_version 1779720 (0.0009) [2023-12-28 08:03:12,302][106225] Updated weights for policy 1, policy_version 1783984 (0.0006) [2023-12-28 08:03:12,377][106225] Updated weights for policy 1, policy_version 1783994 (0.0007) [2023-12-28 08:03:13,052][106226] Updated weights for policy 0, policy_version 1779730 (0.0009) [2023-12-28 08:03:13,062][106225] Updated weights for policy 1, policy_version 1784004 (0.0007) [2023-12-28 08:03:13,108][106226] Updated weights for policy 0, policy_version 1779740 (0.0008) [2023-12-28 08:03:13,121][106225] Updated weights for policy 1, policy_version 1784014 (0.0007) [2023-12-28 08:03:13,163][106226] Updated weights for policy 0, policy_version 1779750 (0.0007) [2023-12-28 08:03:13,179][106225] Updated weights for policy 1, policy_version 1784024 (0.0009) [2023-12-28 08:03:13,841][106226] Updated weights for policy 0, policy_version 1779760 (0.0007) [2023-12-28 08:03:13,897][106226] Updated weights for policy 0, policy_version 1779770 (0.0006) [2023-12-28 08:03:13,954][106226] Updated weights for policy 0, policy_version 1779780 (0.0007) [2023-12-28 08:03:13,959][106225] Updated weights for policy 1, policy_version 1784034 (0.0008) [2023-12-28 08:03:14,021][106225] Updated weights for policy 1, policy_version 1784044 (0.0007) [2023-12-28 08:03:14,072][106225] Updated weights for policy 1, policy_version 1784054 (0.0008) [2023-12-28 08:03:14,130][106225] Updated weights for policy 1, policy_version 1784064 (0.0008) [2023-12-28 08:03:14,625][106226] Updated weights for policy 0, policy_version 1779790 (0.0008) [2023-12-28 08:03:14,686][106226] Updated weights for policy 0, policy_version 1779800 (0.0005) [2023-12-28 08:03:14,745][106226] Updated weights for policy 0, policy_version 1779810 (0.0006) [2023-12-28 08:03:14,915][106225] Updated weights for policy 1, policy_version 1784074 (0.0008) [2023-12-28 08:03:14,980][106225] Updated weights for policy 1, policy_version 1784084 (0.0009) [2023-12-28 08:03:15,044][106225] Updated weights for policy 1, policy_version 1784094 (0.0008) [2023-12-28 08:03:15,451][106226] Updated weights for policy 0, policy_version 1779820 (0.0008) [2023-12-28 08:03:15,515][106226] Updated weights for policy 0, policy_version 1779830 (0.0008) [2023-12-28 08:03:15,573][106226] Updated weights for policy 0, policy_version 1779840 (0.0008) [2023-12-28 08:03:15,720][106225] Updated weights for policy 1, policy_version 1784104 (0.0006) [2023-12-28 08:03:15,779][106225] Updated weights for policy 1, policy_version 1784114 (0.0006) [2023-12-28 08:03:15,843][106225] Updated weights for policy 1, policy_version 1784124 (0.0006) [2023-12-28 08:03:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 18978.1, 300 sec: 19494.2). Total num frames: 912515072. Throughput: 0: 9450.9, 1: 9459.9. Samples: 912506128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:16,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.806')] [2023-12-28 08:03:16,306][106226] Updated weights for policy 0, policy_version 1779850 (0.0009) [2023-12-28 08:03:16,359][106226] Updated weights for policy 0, policy_version 1779860 (0.0008) [2023-12-28 08:03:16,405][106226] Updated weights for policy 0, policy_version 1779870 (0.0009) [2023-12-28 08:03:16,454][106226] Updated weights for policy 0, policy_version 1779880 (0.0007) [2023-12-28 08:03:16,516][106225] Updated weights for policy 1, policy_version 1784134 (0.0007) [2023-12-28 08:03:16,568][106225] Updated weights for policy 1, policy_version 1784144 (0.0007) [2023-12-28 08:03:16,618][106225] Updated weights for policy 1, policy_version 1784154 (0.0009) [2023-12-28 08:03:17,163][106226] Updated weights for policy 0, policy_version 1779890 (0.0009) [2023-12-28 08:03:17,230][106226] Updated weights for policy 0, policy_version 1779900 (0.0006) [2023-12-28 08:03:17,287][106226] Updated weights for policy 0, policy_version 1779910 (0.0007) [2023-12-28 08:03:17,289][106225] Updated weights for policy 1, policy_version 1784164 (0.0008) [2023-12-28 08:03:17,353][106225] Updated weights for policy 1, policy_version 1784174 (0.0007) [2023-12-28 08:03:17,418][106225] Updated weights for policy 1, policy_version 1784184 (0.0008) [2023-12-28 08:03:17,937][106226] Updated weights for policy 0, policy_version 1779920 (0.0006) [2023-12-28 08:03:17,986][106226] Updated weights for policy 0, policy_version 1779930 (0.0005) [2023-12-28 08:03:18,041][106226] Updated weights for policy 0, policy_version 1779940 (0.0006) [2023-12-28 08:03:18,112][106225] Updated weights for policy 1, policy_version 1784194 (0.0008) [2023-12-28 08:03:18,173][106225] Updated weights for policy 1, policy_version 1784204 (0.0008) [2023-12-28 08:03:18,230][106225] Updated weights for policy 1, policy_version 1784214 (0.0008) [2023-12-28 08:03:18,295][106225] Updated weights for policy 1, policy_version 1784224 (0.0006) [2023-12-28 08:03:18,723][106226] Updated weights for policy 0, policy_version 1779950 (0.0008) [2023-12-28 08:03:18,783][106226] Updated weights for policy 0, policy_version 1779960 (0.0008) [2023-12-28 08:03:18,838][106226] Updated weights for policy 0, policy_version 1779970 (0.0009) [2023-12-28 08:03:19,000][106225] Updated weights for policy 1, policy_version 1784234 (0.0008) [2023-12-28 08:03:19,059][106225] Updated weights for policy 1, policy_version 1784244 (0.0008) [2023-12-28 08:03:19,107][106225] Updated weights for policy 1, policy_version 1784254 (0.0009) [2023-12-28 08:03:19,565][106226] Updated weights for policy 0, policy_version 1779980 (0.0007) [2023-12-28 08:03:19,630][106226] Updated weights for policy 0, policy_version 1779990 (0.0010) [2023-12-28 08:03:19,693][106226] Updated weights for policy 0, policy_version 1780000 (0.0009) [2023-12-28 08:03:19,952][106225] Updated weights for policy 1, policy_version 1784264 (0.0008) [2023-12-28 08:03:20,023][106225] Updated weights for policy 1, policy_version 1784274 (0.0006) [2023-12-28 08:03:20,093][106225] Updated weights for policy 1, policy_version 1784284 (0.0007) [2023-12-28 08:03:20,477][106226] Updated weights for policy 0, policy_version 1780010 (0.0008) [2023-12-28 08:03:20,538][106226] Updated weights for policy 0, policy_version 1780020 (0.0009) [2023-12-28 08:03:20,608][106226] Updated weights for policy 0, policy_version 1780030 (0.0008) [2023-12-28 08:03:20,670][106226] Updated weights for policy 0, policy_version 1780040 (0.0007) [2023-12-28 08:03:20,784][106225] Updated weights for policy 1, policy_version 1784294 (0.0007) [2023-12-28 08:03:20,851][106225] Updated weights for policy 1, policy_version 1784304 (0.0008) [2023-12-28 08:03:20,910][106225] Updated weights for policy 1, policy_version 1784314 (0.0008) [2023-12-28 08:03:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 18978.1, 300 sec: 19466.4). Total num frames: 912613376. Throughput: 0: 9412.4, 1: 9477.5. Samples: 912621544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:21,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.969')] [2023-12-28 08:03:21,513][106226] Updated weights for policy 0, policy_version 1780050 (0.0009) [2023-12-28 08:03:21,574][106226] Updated weights for policy 0, policy_version 1780060 (0.0009) [2023-12-28 08:03:21,642][106226] Updated weights for policy 0, policy_version 1780070 (0.0009) [2023-12-28 08:03:21,721][106225] Updated weights for policy 1, policy_version 1784324 (0.0007) [2023-12-28 08:03:21,791][106225] Updated weights for policy 1, policy_version 1784334 (0.0008) [2023-12-28 08:03:21,848][106225] Updated weights for policy 1, policy_version 1784344 (0.0008) [2023-12-28 08:03:22,454][106226] Updated weights for policy 0, policy_version 1780080 (0.0007) [2023-12-28 08:03:22,516][106226] Updated weights for policy 0, policy_version 1780090 (0.0006) [2023-12-28 08:03:22,577][106226] Updated weights for policy 0, policy_version 1780100 (0.0006) [2023-12-28 08:03:22,656][106225] Updated weights for policy 1, policy_version 1784354 (0.0008) [2023-12-28 08:03:22,716][106225] Updated weights for policy 1, policy_version 1784364 (0.0008) [2023-12-28 08:03:22,779][106225] Updated weights for policy 1, policy_version 1784374 (0.0009) [2023-12-28 08:03:22,841][106225] Updated weights for policy 1, policy_version 1784384 (0.0009) [2023-12-28 08:03:23,232][106226] Updated weights for policy 0, policy_version 1780110 (0.0008) [2023-12-28 08:03:23,300][106226] Updated weights for policy 0, policy_version 1780120 (0.0010) [2023-12-28 08:03:23,358][106226] Updated weights for policy 0, policy_version 1780130 (0.0009) [2023-12-28 08:03:23,570][106225] Updated weights for policy 1, policy_version 1784394 (0.0009) [2023-12-28 08:03:23,623][106225] Updated weights for policy 1, policy_version 1784404 (0.0008) [2023-12-28 08:03:23,683][106225] Updated weights for policy 1, policy_version 1784414 (0.0008) [2023-12-28 08:03:24,144][106226] Updated weights for policy 0, policy_version 1780140 (0.0009) [2023-12-28 08:03:24,207][106226] Updated weights for policy 0, policy_version 1780150 (0.0009) [2023-12-28 08:03:24,271][106226] Updated weights for policy 0, policy_version 1780160 (0.0009) [2023-12-28 08:03:24,343][106225] Updated weights for policy 1, policy_version 1784424 (0.0008) [2023-12-28 08:03:24,403][106225] Updated weights for policy 1, policy_version 1784434 (0.0009) [2023-12-28 08:03:24,463][106225] Updated weights for policy 1, policy_version 1784445 (0.0009) [2023-12-28 08:03:25,045][106226] Updated weights for policy 0, policy_version 1780170 (0.0009) [2023-12-28 08:03:25,109][106226] Updated weights for policy 0, policy_version 1780180 (0.0009) [2023-12-28 08:03:25,170][106226] Updated weights for policy 0, policy_version 1780190 (0.0009) [2023-12-28 08:03:25,181][106225] Updated weights for policy 1, policy_version 1784455 (0.0006) [2023-12-28 08:03:25,236][106226] Updated weights for policy 0, policy_version 1780200 (0.0008) [2023-12-28 08:03:25,238][106225] Updated weights for policy 1, policy_version 1784465 (0.0007) [2023-12-28 08:03:25,294][106225] Updated weights for policy 1, policy_version 1784475 (0.0007) [2023-12-28 08:03:25,954][106226] Updated weights for policy 0, policy_version 1780210 (0.0008) [2023-12-28 08:03:26,021][106226] Updated weights for policy 0, policy_version 1780220 (0.0009) [2023-12-28 08:03:26,084][106225] Updated weights for policy 1, policy_version 1784485 (0.0008) [2023-12-28 08:03:26,093][106226] Updated weights for policy 0, policy_version 1780230 (0.0009) [2023-12-28 08:03:26,146][106225] Updated weights for policy 1, policy_version 1784495 (0.0007) [2023-12-28 08:03:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 18841.7, 300 sec: 19438.6). Total num frames: 912703488. Throughput: 0: 9419.4, 1: 9412.4. Samples: 912676328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:26,176][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.577')] [2023-12-28 08:03:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001780232_455819264.pth... [2023-12-28 08:03:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001779112_455532544.pth [2023-12-28 08:03:26,214][106225] Updated weights for policy 1, policy_version 1784505 (0.0008) [2023-12-28 08:03:26,261][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001784512_456892416.pth... [2023-12-28 08:03:26,266][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001783392_456605696.pth [2023-12-28 08:03:26,823][106226] Updated weights for policy 0, policy_version 1780240 (0.0010) [2023-12-28 08:03:26,893][106226] Updated weights for policy 0, policy_version 1780250 (0.0007) [2023-12-28 08:03:26,895][106225] Updated weights for policy 1, policy_version 1784515 (0.0008) [2023-12-28 08:03:26,948][106226] Updated weights for policy 0, policy_version 1780260 (0.0007) [2023-12-28 08:03:26,953][106225] Updated weights for policy 1, policy_version 1784525 (0.0009) [2023-12-28 08:03:27,013][106225] Updated weights for policy 1, policy_version 1784535 (0.0009) [2023-12-28 08:03:27,650][106226] Updated weights for policy 0, policy_version 1780270 (0.0009) [2023-12-28 08:03:27,696][106226] Updated weights for policy 0, policy_version 1780280 (0.0006) [2023-12-28 08:03:27,753][106226] Updated weights for policy 0, policy_version 1780290 (0.0005) [2023-12-28 08:03:27,755][106225] Updated weights for policy 1, policy_version 1784545 (0.0008) [2023-12-28 08:03:27,819][106225] Updated weights for policy 1, policy_version 1784555 (0.0008) [2023-12-28 08:03:27,874][106225] Updated weights for policy 1, policy_version 1784565 (0.0005) [2023-12-28 08:03:27,929][106225] Updated weights for policy 1, policy_version 1784575 (0.0009) [2023-12-28 08:03:28,311][106226] Updated weights for policy 0, policy_version 1780300 (0.0006) [2023-12-28 08:03:28,376][106226] Updated weights for policy 0, policy_version 1780310 (0.0009) [2023-12-28 08:03:28,437][106226] Updated weights for policy 0, policy_version 1780320 (0.0007) [2023-12-28 08:03:28,731][106225] Updated weights for policy 1, policy_version 1784585 (0.0007) [2023-12-28 08:03:28,819][106225] Updated weights for policy 1, policy_version 1784595 (0.0007) [2023-12-28 08:03:28,876][106225] Updated weights for policy 1, policy_version 1784605 (0.0007) [2023-12-28 08:03:29,123][106226] Updated weights for policy 0, policy_version 1780330 (0.0007) [2023-12-28 08:03:29,182][106226] Updated weights for policy 0, policy_version 1780340 (0.0010) [2023-12-28 08:03:29,245][106226] Updated weights for policy 0, policy_version 1780350 (0.0009) [2023-12-28 08:03:29,312][106226] Updated weights for policy 0, policy_version 1780360 (0.0010) [2023-12-28 08:03:29,541][106225] Updated weights for policy 1, policy_version 1784615 (0.0008) [2023-12-28 08:03:29,607][106225] Updated weights for policy 1, policy_version 1784625 (0.0006) [2023-12-28 08:03:29,672][106225] Updated weights for policy 1, policy_version 1784635 (0.0006) [2023-12-28 08:03:30,060][106226] Updated weights for policy 0, policy_version 1780370 (0.0011) [2023-12-28 08:03:30,124][106226] Updated weights for policy 0, policy_version 1780380 (0.0011) [2023-12-28 08:03:30,189][106226] Updated weights for policy 0, policy_version 1780390 (0.0011) [2023-12-28 08:03:30,356][106225] Updated weights for policy 1, policy_version 1784645 (0.0006) [2023-12-28 08:03:30,418][106225] Updated weights for policy 1, policy_version 1784655 (0.0008) [2023-12-28 08:03:30,481][106225] Updated weights for policy 1, policy_version 1784665 (0.0008) [2023-12-28 08:03:30,815][106226] Updated weights for policy 0, policy_version 1780400 (0.0011) [2023-12-28 08:03:30,872][106226] Updated weights for policy 0, policy_version 1780410 (0.0010) [2023-12-28 08:03:30,933][106226] Updated weights for policy 0, policy_version 1780420 (0.0007) [2023-12-28 08:03:31,165][106225] Updated weights for policy 1, policy_version 1784675 (0.0007) [2023-12-28 08:03:31,175][105115] Fps is (10 sec: 18841.6, 60 sec: 18978.1, 300 sec: 19438.6). Total num frames: 912801792. Throughput: 0: 9439.7, 1: 9442.0. Samples: 912792108. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:31,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-4.522')] [2023-12-28 08:03:31,231][106225] Updated weights for policy 1, policy_version 1784685 (0.0006) [2023-12-28 08:03:31,299][106225] Updated weights for policy 1, policy_version 1784695 (0.0008) [2023-12-28 08:03:31,663][106226] Updated weights for policy 0, policy_version 1780430 (0.0010) [2023-12-28 08:03:31,731][106226] Updated weights for policy 0, policy_version 1780440 (0.0009) [2023-12-28 08:03:31,794][106226] Updated weights for policy 0, policy_version 1780450 (0.0009) [2023-12-28 08:03:31,988][106225] Updated weights for policy 1, policy_version 1784705 (0.0008) [2023-12-28 08:03:32,048][106225] Updated weights for policy 1, policy_version 1784715 (0.0009) [2023-12-28 08:03:32,105][106225] Updated weights for policy 1, policy_version 1784725 (0.0007) [2023-12-28 08:03:32,159][106225] Updated weights for policy 1, policy_version 1784735 (0.0008) [2023-12-28 08:03:32,580][106226] Updated weights for policy 0, policy_version 1780460 (0.0007) [2023-12-28 08:03:32,640][106226] Updated weights for policy 0, policy_version 1780470 (0.0006) [2023-12-28 08:03:32,699][106226] Updated weights for policy 0, policy_version 1780480 (0.0009) [2023-12-28 08:03:32,868][106225] Updated weights for policy 1, policy_version 1784745 (0.0006) [2023-12-28 08:03:32,929][106225] Updated weights for policy 1, policy_version 1784755 (0.0006) [2023-12-28 08:03:32,988][106225] Updated weights for policy 1, policy_version 1784765 (0.0005) [2023-12-28 08:03:33,456][106226] Updated weights for policy 0, policy_version 1780490 (0.0009) [2023-12-28 08:03:33,513][106226] Updated weights for policy 0, policy_version 1780500 (0.0008) [2023-12-28 08:03:33,569][106226] Updated weights for policy 0, policy_version 1780510 (0.0005) [2023-12-28 08:03:33,596][106225] Updated weights for policy 1, policy_version 1784775 (0.0006) [2023-12-28 08:03:33,627][106226] Updated weights for policy 0, policy_version 1780520 (0.0005) [2023-12-28 08:03:33,650][106225] Updated weights for policy 1, policy_version 1784785 (0.0008) [2023-12-28 08:03:33,696][106225] Updated weights for policy 1, policy_version 1784795 (0.0009) [2023-12-28 08:03:34,214][106226] Updated weights for policy 0, policy_version 1780530 (0.0010) [2023-12-28 08:03:34,268][106226] Updated weights for policy 0, policy_version 1780540 (0.0011) [2023-12-28 08:03:34,335][106226] Updated weights for policy 0, policy_version 1780550 (0.0011) [2023-12-28 08:03:34,468][106225] Updated weights for policy 1, policy_version 1784805 (0.0008) [2023-12-28 08:03:34,515][106225] Updated weights for policy 1, policy_version 1784815 (0.0008) [2023-12-28 08:03:34,570][106225] Updated weights for policy 1, policy_version 1784825 (0.0008) [2023-12-28 08:03:35,045][106226] Updated weights for policy 0, policy_version 1780560 (0.0008) [2023-12-28 08:03:35,093][106226] Updated weights for policy 0, policy_version 1780570 (0.0005) [2023-12-28 08:03:35,154][106226] Updated weights for policy 0, policy_version 1780580 (0.0006) [2023-12-28 08:03:35,284][106225] Updated weights for policy 1, policy_version 1784835 (0.0008) [2023-12-28 08:03:35,333][106225] Updated weights for policy 1, policy_version 1784845 (0.0005) [2023-12-28 08:03:35,386][106225] Updated weights for policy 1, policy_version 1784855 (0.0006) [2023-12-28 08:03:35,816][106226] Updated weights for policy 0, policy_version 1780590 (0.0009) [2023-12-28 08:03:35,881][106226] Updated weights for policy 0, policy_version 1780600 (0.0011) [2023-12-28 08:03:35,944][106226] Updated weights for policy 0, policy_version 1780610 (0.0005) [2023-12-28 08:03:36,141][106225] Updated weights for policy 1, policy_version 1784865 (0.0008) [2023-12-28 08:03:36,174][105115] Fps is (10 sec: 19661.2, 60 sec: 18978.2, 300 sec: 19438.7). Total num frames: 912900096. Throughput: 0: 9508.9, 1: 9516.9. Samples: 912911464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:36,175][105115] Avg episode reward: [(0, '-4.485'), (1, '-5.119')] [2023-12-28 08:03:36,205][106225] Updated weights for policy 1, policy_version 1784875 (0.0009) [2023-12-28 08:03:36,262][106225] Updated weights for policy 1, policy_version 1784885 (0.0008) [2023-12-28 08:03:36,319][106225] Updated weights for policy 1, policy_version 1784895 (0.0008) [2023-12-28 08:03:36,579][106226] Updated weights for policy 0, policy_version 1780620 (0.0007) [2023-12-28 08:03:36,640][106226] Updated weights for policy 0, policy_version 1780630 (0.0011) [2023-12-28 08:03:36,705][106226] Updated weights for policy 0, policy_version 1780640 (0.0011) [2023-12-28 08:03:37,068][106225] Updated weights for policy 1, policy_version 1784905 (0.0008) [2023-12-28 08:03:37,131][106225] Updated weights for policy 1, policy_version 1784915 (0.0008) [2023-12-28 08:03:37,190][106225] Updated weights for policy 1, policy_version 1784925 (0.0008) [2023-12-28 08:03:37,376][106226] Updated weights for policy 0, policy_version 1780650 (0.0010) [2023-12-28 08:03:37,438][106226] Updated weights for policy 0, policy_version 1780660 (0.0011) [2023-12-28 08:03:37,494][106226] Updated weights for policy 0, policy_version 1780670 (0.0007) [2023-12-28 08:03:37,564][106226] Updated weights for policy 0, policy_version 1780680 (0.0006) [2023-12-28 08:03:37,966][106225] Updated weights for policy 1, policy_version 1784935 (0.0009) [2023-12-28 08:03:38,018][106225] Updated weights for policy 1, policy_version 1784945 (0.0008) [2023-12-28 08:03:38,070][106225] Updated weights for policy 1, policy_version 1784955 (0.0008) [2023-12-28 08:03:38,117][106226] Updated weights for policy 0, policy_version 1780690 (0.0006) [2023-12-28 08:03:38,166][106226] Updated weights for policy 0, policy_version 1780700 (0.0008) [2023-12-28 08:03:38,213][106226] Updated weights for policy 0, policy_version 1780710 (0.0008) [2023-12-28 08:03:38,836][106225] Updated weights for policy 1, policy_version 1784965 (0.0008) [2023-12-28 08:03:38,897][106225] Updated weights for policy 1, policy_version 1784975 (0.0007) [2023-12-28 08:03:38,958][106225] Updated weights for policy 1, policy_version 1784985 (0.0005) [2023-12-28 08:03:38,960][106226] Updated weights for policy 0, policy_version 1780720 (0.0008) [2023-12-28 08:03:39,021][106226] Updated weights for policy 0, policy_version 1780730 (0.0009) [2023-12-28 08:03:39,078][106226] Updated weights for policy 0, policy_version 1780740 (0.0009) [2023-12-28 08:03:39,770][106225] Updated weights for policy 1, policy_version 1784995 (0.0006) [2023-12-28 08:03:39,806][106226] Updated weights for policy 0, policy_version 1780750 (0.0010) [2023-12-28 08:03:39,839][106225] Updated weights for policy 1, policy_version 1785005 (0.0008) [2023-12-28 08:03:39,870][106226] Updated weights for policy 0, policy_version 1780760 (0.0011) [2023-12-28 08:03:39,909][106225] Updated weights for policy 1, policy_version 1785015 (0.0007) [2023-12-28 08:03:39,941][106226] Updated weights for policy 0, policy_version 1780770 (0.0008) [2023-12-28 08:03:40,571][106225] Updated weights for policy 1, policy_version 1785025 (0.0008) [2023-12-28 08:03:40,622][106225] Updated weights for policy 1, policy_version 1785035 (0.0009) [2023-12-28 08:03:40,671][106226] Updated weights for policy 0, policy_version 1780780 (0.0011) [2023-12-28 08:03:40,676][106225] Updated weights for policy 1, policy_version 1785045 (0.0010) [2023-12-28 08:03:40,727][106225] Updated weights for policy 1, policy_version 1785055 (0.0010) [2023-12-28 08:03:40,733][106226] Updated weights for policy 0, policy_version 1780790 (0.0010) [2023-12-28 08:03:40,796][106226] Updated weights for policy 0, policy_version 1780800 (0.0011) [2023-12-28 08:03:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 18978.1, 300 sec: 19438.6). Total num frames: 912998400. Throughput: 0: 9597.3, 1: 9501.5. Samples: 912969600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:41,176][105115] Avg episode reward: [(0, '-4.599'), (1, '-4.833')] [2023-12-28 08:03:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001785056_457031680.pth... [2023-12-28 08:03:41,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001780808_455966720.pth... [2023-12-28 08:03:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001783936_456744960.pth [2023-12-28 08:03:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001779688_455680000.pth [2023-12-28 08:03:41,446][106225] Updated weights for policy 1, policy_version 1785065 (0.0007) [2023-12-28 08:03:41,516][106225] Updated weights for policy 1, policy_version 1785075 (0.0008) [2023-12-28 08:03:41,578][106225] Updated weights for policy 1, policy_version 1785085 (0.0008) [2023-12-28 08:03:41,599][106226] Updated weights for policy 0, policy_version 1780810 (0.0009) [2023-12-28 08:03:41,671][106226] Updated weights for policy 0, policy_version 1780820 (0.0011) [2023-12-28 08:03:41,739][106226] Updated weights for policy 0, policy_version 1780830 (0.0009) [2023-12-28 08:03:41,791][106226] Updated weights for policy 0, policy_version 1780840 (0.0011) [2023-12-28 08:03:42,377][106225] Updated weights for policy 1, policy_version 1785095 (0.0009) [2023-12-28 08:03:42,441][106225] Updated weights for policy 1, policy_version 1785105 (0.0009) [2023-12-28 08:03:42,501][106225] Updated weights for policy 1, policy_version 1785115 (0.0007) [2023-12-28 08:03:42,508][106226] Updated weights for policy 0, policy_version 1780850 (0.0011) [2023-12-28 08:03:42,573][106226] Updated weights for policy 0, policy_version 1780860 (0.0011) [2023-12-28 08:03:42,639][106226] Updated weights for policy 0, policy_version 1780870 (0.0011) [2023-12-28 08:03:43,235][106225] Updated weights for policy 1, policy_version 1785125 (0.0007) [2023-12-28 08:03:43,303][106225] Updated weights for policy 1, policy_version 1785135 (0.0009) [2023-12-28 08:03:43,343][106226] Updated weights for policy 0, policy_version 1780880 (0.0010) [2023-12-28 08:03:43,368][106225] Updated weights for policy 1, policy_version 1785145 (0.0007) [2023-12-28 08:03:43,404][106226] Updated weights for policy 0, policy_version 1780890 (0.0007) [2023-12-28 08:03:43,458][106226] Updated weights for policy 0, policy_version 1780900 (0.0008) [2023-12-28 08:03:43,956][106225] Updated weights for policy 1, policy_version 1785155 (0.0007) [2023-12-28 08:03:44,019][106225] Updated weights for policy 1, policy_version 1785165 (0.0008) [2023-12-28 08:03:44,053][106226] Updated weights for policy 0, policy_version 1780910 (0.0010) [2023-12-28 08:03:44,071][106225] Updated weights for policy 1, policy_version 1785175 (0.0006) [2023-12-28 08:03:44,106][106226] Updated weights for policy 0, policy_version 1780920 (0.0010) [2023-12-28 08:03:44,162][106226] Updated weights for policy 0, policy_version 1780930 (0.0005) [2023-12-28 08:03:44,729][106226] Updated weights for policy 0, policy_version 1780940 (0.0005) [2023-12-28 08:03:44,801][106226] Updated weights for policy 0, policy_version 1780950 (0.0009) [2023-12-28 08:03:44,867][106225] Updated weights for policy 1, policy_version 1785185 (0.0007) [2023-12-28 08:03:44,870][106226] Updated weights for policy 0, policy_version 1780960 (0.0011) [2023-12-28 08:03:44,930][106225] Updated weights for policy 1, policy_version 1785195 (0.0008) [2023-12-28 08:03:44,995][106225] Updated weights for policy 1, policy_version 1785205 (0.0006) [2023-12-28 08:03:45,062][106225] Updated weights for policy 1, policy_version 1785215 (0.0006) [2023-12-28 08:03:45,584][106226] Updated weights for policy 0, policy_version 1780970 (0.0010) [2023-12-28 08:03:45,640][106226] Updated weights for policy 0, policy_version 1780980 (0.0009) [2023-12-28 08:03:45,693][106226] Updated weights for policy 0, policy_version 1780990 (0.0007) [2023-12-28 08:03:45,695][106225] Updated weights for policy 1, policy_version 1785225 (0.0007) [2023-12-28 08:03:45,740][106226] Updated weights for policy 0, policy_version 1781000 (0.0008) [2023-12-28 08:03:45,755][106225] Updated weights for policy 1, policy_version 1785235 (0.0007) [2023-12-28 08:03:45,808][106225] Updated weights for policy 1, policy_version 1785245 (0.0008) [2023-12-28 08:03:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19114.7, 300 sec: 19438.7). Total num frames: 913096704. Throughput: 0: 9682.4, 1: 9511.3. Samples: 913086200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:46,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.884')] [2023-12-28 08:03:46,407][106226] Updated weights for policy 0, policy_version 1781010 (0.0008) [2023-12-28 08:03:46,467][106226] Updated weights for policy 0, policy_version 1781020 (0.0008) [2023-12-28 08:03:46,513][106225] Updated weights for policy 1, policy_version 1785255 (0.0009) [2023-12-28 08:03:46,525][106226] Updated weights for policy 0, policy_version 1781030 (0.0007) [2023-12-28 08:03:46,574][106225] Updated weights for policy 1, policy_version 1785265 (0.0006) [2023-12-28 08:03:46,635][106225] Updated weights for policy 1, policy_version 1785275 (0.0006) [2023-12-28 08:03:47,114][106226] Updated weights for policy 0, policy_version 1781040 (0.0006) [2023-12-28 08:03:47,169][106226] Updated weights for policy 0, policy_version 1781050 (0.0005) [2023-12-28 08:03:47,175][106225] Updated weights for policy 1, policy_version 1785285 (0.0008) [2023-12-28 08:03:47,222][106225] Updated weights for policy 1, policy_version 1785295 (0.0010) [2023-12-28 08:03:47,223][106226] Updated weights for policy 0, policy_version 1781060 (0.0005) [2023-12-28 08:03:47,278][106225] Updated weights for policy 1, policy_version 1785305 (0.0010) [2023-12-28 08:03:47,836][106225] Updated weights for policy 1, policy_version 1785315 (0.0006) [2023-12-28 08:03:47,893][106225] Updated weights for policy 1, policy_version 1785325 (0.0009) [2023-12-28 08:03:47,913][106226] Updated weights for policy 0, policy_version 1781070 (0.0006) [2023-12-28 08:03:47,942][106225] Updated weights for policy 1, policy_version 1785335 (0.0010) [2023-12-28 08:03:47,974][106226] Updated weights for policy 0, policy_version 1781080 (0.0007) [2023-12-28 08:03:48,038][106226] Updated weights for policy 0, policy_version 1781090 (0.0007) [2023-12-28 08:03:48,700][106225] Updated weights for policy 1, policy_version 1785345 (0.0010) [2023-12-28 08:03:48,715][106226] Updated weights for policy 0, policy_version 1781100 (0.0006) [2023-12-28 08:03:48,764][106225] Updated weights for policy 1, policy_version 1785355 (0.0010) [2023-12-28 08:03:48,777][106226] Updated weights for policy 0, policy_version 1781110 (0.0008) [2023-12-28 08:03:48,832][106225] Updated weights for policy 1, policy_version 1785365 (0.0011) [2023-12-28 08:03:48,842][106226] Updated weights for policy 0, policy_version 1781120 (0.0005) [2023-12-28 08:03:48,888][106225] Updated weights for policy 1, policy_version 1785375 (0.0010) [2023-12-28 08:03:49,564][106226] Updated weights for policy 0, policy_version 1781130 (0.0007) [2023-12-28 08:03:49,601][106225] Updated weights for policy 1, policy_version 1785385 (0.0010) [2023-12-28 08:03:49,627][106226] Updated weights for policy 0, policy_version 1781140 (0.0008) [2023-12-28 08:03:49,657][106225] Updated weights for policy 1, policy_version 1785395 (0.0006) [2023-12-28 08:03:49,686][106226] Updated weights for policy 0, policy_version 1781150 (0.0008) [2023-12-28 08:03:49,708][106225] Updated weights for policy 1, policy_version 1785405 (0.0006) [2023-12-28 08:03:49,740][106226] Updated weights for policy 0, policy_version 1781160 (0.0007) [2023-12-28 08:03:50,413][106226] Updated weights for policy 0, policy_version 1781170 (0.0006) [2023-12-28 08:03:50,466][106226] Updated weights for policy 0, policy_version 1781180 (0.0009) [2023-12-28 08:03:50,488][106225] Updated weights for policy 1, policy_version 1785415 (0.0007) [2023-12-28 08:03:50,521][106226] Updated weights for policy 0, policy_version 1781190 (0.0009) [2023-12-28 08:03:50,539][106225] Updated weights for policy 1, policy_version 1785425 (0.0006) [2023-12-28 08:03:50,599][106225] Updated weights for policy 1, policy_version 1785435 (0.0009) [2023-12-28 08:03:51,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19114.6, 300 sec: 19438.7). Total num frames: 913195008. Throughput: 0: 9734.4, 1: 9601.2. Samples: 913207672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:51,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.815')] [2023-12-28 08:03:51,270][106226] Updated weights for policy 0, policy_version 1781200 (0.0007) [2023-12-28 08:03:51,332][106226] Updated weights for policy 0, policy_version 1781210 (0.0009) [2023-12-28 08:03:51,398][106225] Updated weights for policy 1, policy_version 1785445 (0.0009) [2023-12-28 08:03:51,405][106226] Updated weights for policy 0, policy_version 1781220 (0.0009) [2023-12-28 08:03:51,462][106225] Updated weights for policy 1, policy_version 1785455 (0.0006) [2023-12-28 08:03:51,523][106225] Updated weights for policy 1, policy_version 1785465 (0.0005) [2023-12-28 08:03:52,169][106226] Updated weights for policy 0, policy_version 1781230 (0.0009) [2023-12-28 08:03:52,227][106226] Updated weights for policy 0, policy_version 1781240 (0.0008) [2023-12-28 08:03:52,229][106225] Updated weights for policy 1, policy_version 1785475 (0.0007) [2023-12-28 08:03:52,290][106225] Updated weights for policy 1, policy_version 1785485 (0.0008) [2023-12-28 08:03:52,291][106226] Updated weights for policy 0, policy_version 1781250 (0.0008) [2023-12-28 08:03:52,358][106225] Updated weights for policy 1, policy_version 1785495 (0.0008) [2023-12-28 08:03:53,020][106226] Updated weights for policy 0, policy_version 1781260 (0.0007) [2023-12-28 08:03:53,067][106226] Updated weights for policy 0, policy_version 1781270 (0.0008) [2023-12-28 08:03:53,088][106225] Updated weights for policy 1, policy_version 1785505 (0.0008) [2023-12-28 08:03:53,125][106226] Updated weights for policy 0, policy_version 1781280 (0.0008) [2023-12-28 08:03:53,142][106225] Updated weights for policy 1, policy_version 1785515 (0.0007) [2023-12-28 08:03:53,187][106225] Updated weights for policy 1, policy_version 1785525 (0.0007) [2023-12-28 08:03:53,235][106225] Updated weights for policy 1, policy_version 1785535 (0.0008) [2023-12-28 08:03:53,862][106226] Updated weights for policy 0, policy_version 1781290 (0.0008) [2023-12-28 08:03:53,923][106226] Updated weights for policy 0, policy_version 1781300 (0.0008) [2023-12-28 08:03:53,930][106225] Updated weights for policy 1, policy_version 1785545 (0.0006) [2023-12-28 08:03:53,981][106225] Updated weights for policy 1, policy_version 1785555 (0.0008) [2023-12-28 08:03:53,986][106226] Updated weights for policy 0, policy_version 1781310 (0.0008) [2023-12-28 08:03:54,034][106225] Updated weights for policy 1, policy_version 1785565 (0.0007) [2023-12-28 08:03:54,054][106226] Updated weights for policy 0, policy_version 1781320 (0.0006) [2023-12-28 08:03:54,681][106226] Updated weights for policy 0, policy_version 1781330 (0.0005) [2023-12-28 08:03:54,738][106226] Updated weights for policy 0, policy_version 1781340 (0.0008) [2023-12-28 08:03:54,794][106226] Updated weights for policy 0, policy_version 1781350 (0.0006) [2023-12-28 08:03:54,807][106225] Updated weights for policy 1, policy_version 1785575 (0.0009) [2023-12-28 08:03:54,860][106225] Updated weights for policy 1, policy_version 1785585 (0.0006) [2023-12-28 08:03:54,919][106225] Updated weights for policy 1, policy_version 1785595 (0.0005) [2023-12-28 08:03:55,490][106226] Updated weights for policy 0, policy_version 1781360 (0.0009) [2023-12-28 08:03:55,553][106226] Updated weights for policy 0, policy_version 1781370 (0.0011) [2023-12-28 08:03:55,608][106226] Updated weights for policy 0, policy_version 1781380 (0.0008) [2023-12-28 08:03:55,615][106225] Updated weights for policy 1, policy_version 1785605 (0.0007) [2023-12-28 08:03:55,672][106225] Updated weights for policy 1, policy_version 1785615 (0.0008) [2023-12-28 08:03:55,720][106225] Updated weights for policy 1, policy_version 1785625 (0.0008) [2023-12-28 08:03:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19251.2, 300 sec: 19438.6). Total num frames: 913293312. Throughput: 0: 9723.4, 1: 9591.4. Samples: 913263904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:03:56,175][105115] Avg episode reward: [(0, '-4.753'), (1, '-4.955')] [2023-12-28 08:03:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001785632_457179136.pth... [2023-12-28 08:03:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001784512_456892416.pth [2023-12-28 08:03:56,221][106226] Updated weights for policy 0, policy_version 1781390 (0.0009) [2023-12-28 08:03:56,282][106226] Updated weights for policy 0, policy_version 1781400 (0.0010) [2023-12-28 08:03:56,346][106226] Updated weights for policy 0, policy_version 1781410 (0.0008) [2023-12-28 08:03:56,386][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001781416_456122368.pth... [2023-12-28 08:03:56,389][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001780232_455819264.pth [2023-12-28 08:03:56,444][106225] Updated weights for policy 1, policy_version 1785635 (0.0007) [2023-12-28 08:03:56,514][106225] Updated weights for policy 1, policy_version 1785645 (0.0006) [2023-12-28 08:03:56,571][106225] Updated weights for policy 1, policy_version 1785655 (0.0005) [2023-12-28 08:03:56,994][106226] Updated weights for policy 0, policy_version 1781420 (0.0006) [2023-12-28 08:03:57,056][106226] Updated weights for policy 0, policy_version 1781430 (0.0011) [2023-12-28 08:03:57,112][106226] Updated weights for policy 0, policy_version 1781440 (0.0006) [2023-12-28 08:03:57,171][106225] Updated weights for policy 1, policy_version 1785665 (0.0005) [2023-12-28 08:03:57,228][106225] Updated weights for policy 1, policy_version 1785675 (0.0008) [2023-12-28 08:03:57,278][106225] Updated weights for policy 1, policy_version 1785685 (0.0008) [2023-12-28 08:03:57,335][106225] Updated weights for policy 1, policy_version 1785695 (0.0008) [2023-12-28 08:03:57,818][106226] Updated weights for policy 0, policy_version 1781450 (0.0010) [2023-12-28 08:03:57,874][106226] Updated weights for policy 0, policy_version 1781460 (0.0010) [2023-12-28 08:03:57,936][106226] Updated weights for policy 0, policy_version 1781470 (0.0010) [2023-12-28 08:03:57,998][106226] Updated weights for policy 0, policy_version 1781480 (0.0009) [2023-12-28 08:03:58,062][106225] Updated weights for policy 1, policy_version 1785705 (0.0005) [2023-12-28 08:03:58,114][106225] Updated weights for policy 1, policy_version 1785715 (0.0005) [2023-12-28 08:03:58,167][106225] Updated weights for policy 1, policy_version 1785725 (0.0005) [2023-12-28 08:03:58,666][106226] Updated weights for policy 0, policy_version 1781490 (0.0011) [2023-12-28 08:03:58,728][106226] Updated weights for policy 0, policy_version 1781500 (0.0009) [2023-12-28 08:03:58,800][106226] Updated weights for policy 0, policy_version 1781510 (0.0008) [2023-12-28 08:03:58,915][106225] Updated weights for policy 1, policy_version 1785735 (0.0006) [2023-12-28 08:03:58,984][106225] Updated weights for policy 1, policy_version 1785745 (0.0006) [2023-12-28 08:03:59,050][106225] Updated weights for policy 1, policy_version 1785755 (0.0007) [2023-12-28 08:03:59,649][106226] Updated weights for policy 0, policy_version 1781520 (0.0007) [2023-12-28 08:03:59,715][106226] Updated weights for policy 0, policy_version 1781530 (0.0009) [2023-12-28 08:03:59,776][106226] Updated weights for policy 0, policy_version 1781540 (0.0009) [2023-12-28 08:03:59,798][106225] Updated weights for policy 1, policy_version 1785765 (0.0008) [2023-12-28 08:03:59,863][106225] Updated weights for policy 1, policy_version 1785775 (0.0009) [2023-12-28 08:03:59,927][106225] Updated weights for policy 1, policy_version 1785785 (0.0009) [2023-12-28 08:04:00,488][106226] Updated weights for policy 0, policy_version 1781550 (0.0009) [2023-12-28 08:04:00,542][106226] Updated weights for policy 0, policy_version 1781560 (0.0008) [2023-12-28 08:04:00,596][106226] Updated weights for policy 0, policy_version 1781570 (0.0009) [2023-12-28 08:04:00,631][106225] Updated weights for policy 1, policy_version 1785795 (0.0010) [2023-12-28 08:04:00,689][106225] Updated weights for policy 1, policy_version 1785805 (0.0008) [2023-12-28 08:04:00,754][106225] Updated weights for policy 1, policy_version 1785815 (0.0006) [2023-12-28 08:04:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19251.2, 300 sec: 19438.7). Total num frames: 913391616. Throughput: 0: 9802.4, 1: 9672.8. Samples: 913382512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:01,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-4.676')] [2023-12-28 08:04:01,394][106226] Updated weights for policy 0, policy_version 1781580 (0.0008) [2023-12-28 08:04:01,421][106225] Updated weights for policy 1, policy_version 1785825 (0.0008) [2023-12-28 08:04:01,455][106226] Updated weights for policy 0, policy_version 1781590 (0.0006) [2023-12-28 08:04:01,478][106225] Updated weights for policy 1, policy_version 1785835 (0.0007) [2023-12-28 08:04:01,518][106226] Updated weights for policy 0, policy_version 1781600 (0.0006) [2023-12-28 08:04:01,532][106225] Updated weights for policy 1, policy_version 1785845 (0.0007) [2023-12-28 08:04:01,590][106225] Updated weights for policy 1, policy_version 1785855 (0.0007) [2023-12-28 08:04:02,129][106226] Updated weights for policy 0, policy_version 1781610 (0.0006) [2023-12-28 08:04:02,193][106226] Updated weights for policy 0, policy_version 1781620 (0.0008) [2023-12-28 08:04:02,248][106226] Updated weights for policy 0, policy_version 1781630 (0.0009) [2023-12-28 08:04:02,310][106226] Updated weights for policy 0, policy_version 1781640 (0.0008) [2023-12-28 08:04:02,342][106225] Updated weights for policy 1, policy_version 1785865 (0.0009) [2023-12-28 08:04:02,395][106225] Updated weights for policy 1, policy_version 1785875 (0.0008) [2023-12-28 08:04:02,450][106225] Updated weights for policy 1, policy_version 1785885 (0.0008) [2023-12-28 08:04:03,055][106226] Updated weights for policy 0, policy_version 1781650 (0.0008) [2023-12-28 08:04:03,104][106226] Updated weights for policy 0, policy_version 1781661 (0.0008) [2023-12-28 08:04:03,154][106226] Updated weights for policy 0, policy_version 1781671 (0.0009) [2023-12-28 08:04:03,168][106225] Updated weights for policy 1, policy_version 1785895 (0.0007) [2023-12-28 08:04:03,222][106225] Updated weights for policy 1, policy_version 1785905 (0.0008) [2023-12-28 08:04:03,273][106225] Updated weights for policy 1, policy_version 1785915 (0.0008) [2023-12-28 08:04:03,823][106226] Updated weights for policy 0, policy_version 1781681 (0.0006) [2023-12-28 08:04:03,884][106226] Updated weights for policy 0, policy_version 1781691 (0.0010) [2023-12-28 08:04:03,945][106226] Updated weights for policy 0, policy_version 1781701 (0.0011) [2023-12-28 08:04:04,075][106225] Updated weights for policy 1, policy_version 1785925 (0.0006) [2023-12-28 08:04:04,135][106225] Updated weights for policy 1, policy_version 1785935 (0.0005) [2023-12-28 08:04:04,198][106225] Updated weights for policy 1, policy_version 1785945 (0.0006) [2023-12-28 08:04:04,675][106226] Updated weights for policy 0, policy_version 1781711 (0.0011) [2023-12-28 08:04:04,732][106226] Updated weights for policy 0, policy_version 1781721 (0.0010) [2023-12-28 08:04:04,794][106226] Updated weights for policy 0, policy_version 1781731 (0.0010) [2023-12-28 08:04:04,825][106225] Updated weights for policy 1, policy_version 1785955 (0.0008) [2023-12-28 08:04:04,875][106225] Updated weights for policy 1, policy_version 1785965 (0.0009) [2023-12-28 08:04:04,921][106225] Updated weights for policy 1, policy_version 1785975 (0.0008) [2023-12-28 08:04:05,507][106226] Updated weights for policy 0, policy_version 1781741 (0.0011) [2023-12-28 08:04:05,560][106226] Updated weights for policy 0, policy_version 1781751 (0.0010) [2023-12-28 08:04:05,587][106225] Updated weights for policy 1, policy_version 1785985 (0.0007) [2023-12-28 08:04:05,607][106226] Updated weights for policy 0, policy_version 1781761 (0.0010) [2023-12-28 08:04:05,647][106225] Updated weights for policy 1, policy_version 1785995 (0.0010) [2023-12-28 08:04:05,703][106225] Updated weights for policy 1, policy_version 1786005 (0.0010) [2023-12-28 08:04:05,754][106225] Updated weights for policy 1, policy_version 1786015 (0.0010) [2023-12-28 08:04:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19410.9). Total num frames: 913489920. Throughput: 0: 9848.7, 1: 9690.6. Samples: 913500812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:06,175][105115] Avg episode reward: [(0, '-4.227'), (1, '-4.576')] [2023-12-28 08:04:06,334][106226] Updated weights for policy 0, policy_version 1781771 (0.0011) [2023-12-28 08:04:06,389][106226] Updated weights for policy 0, policy_version 1781781 (0.0011) [2023-12-28 08:04:06,448][106226] Updated weights for policy 0, policy_version 1781791 (0.0011) [2023-12-28 08:04:06,476][106225] Updated weights for policy 1, policy_version 1786025 (0.0008) [2023-12-28 08:04:06,528][106225] Updated weights for policy 1, policy_version 1786035 (0.0008) [2023-12-28 08:04:06,577][106225] Updated weights for policy 1, policy_version 1786045 (0.0008) [2023-12-28 08:04:07,201][106226] Updated weights for policy 0, policy_version 1781801 (0.0010) [2023-12-28 08:04:07,261][106225] Updated weights for policy 1, policy_version 1786055 (0.0006) [2023-12-28 08:04:07,270][106226] Updated weights for policy 0, policy_version 1781811 (0.0008) [2023-12-28 08:04:07,320][106225] Updated weights for policy 1, policy_version 1786065 (0.0007) [2023-12-28 08:04:07,327][106226] Updated weights for policy 0, policy_version 1781821 (0.0008) [2023-12-28 08:04:07,377][106225] Updated weights for policy 1, policy_version 1786075 (0.0005) [2023-12-28 08:04:07,384][106226] Updated weights for policy 0, policy_version 1781831 (0.0011) [2023-12-28 08:04:07,898][106225] Updated weights for policy 1, policy_version 1786085 (0.0007) [2023-12-28 08:04:07,941][106225] Updated weights for policy 1, policy_version 1786095 (0.0007) [2023-12-28 08:04:07,988][106225] Updated weights for policy 1, policy_version 1786105 (0.0007) [2023-12-28 08:04:08,101][106226] Updated weights for policy 0, policy_version 1781841 (0.0010) [2023-12-28 08:04:08,151][106226] Updated weights for policy 0, policy_version 1781851 (0.0010) [2023-12-28 08:04:08,207][106226] Updated weights for policy 0, policy_version 1781861 (0.0010) [2023-12-28 08:04:08,666][106225] Updated weights for policy 1, policy_version 1786115 (0.0005) [2023-12-28 08:04:08,735][106225] Updated weights for policy 1, policy_version 1786125 (0.0005) [2023-12-28 08:04:08,799][106225] Updated weights for policy 1, policy_version 1786135 (0.0006) [2023-12-28 08:04:08,892][106226] Updated weights for policy 0, policy_version 1781871 (0.0007) [2023-12-28 08:04:08,965][106226] Updated weights for policy 0, policy_version 1781881 (0.0009) [2023-12-28 08:04:09,033][106226] Updated weights for policy 0, policy_version 1781891 (0.0010) [2023-12-28 08:04:09,454][106225] Updated weights for policy 1, policy_version 1786145 (0.0008) [2023-12-28 08:04:09,508][106225] Updated weights for policy 1, policy_version 1786155 (0.0007) [2023-12-28 08:04:09,564][106225] Updated weights for policy 1, policy_version 1786165 (0.0005) [2023-12-28 08:04:09,625][106225] Updated weights for policy 1, policy_version 1786175 (0.0006) [2023-12-28 08:04:09,728][106226] Updated weights for policy 0, policy_version 1781901 (0.0008) [2023-12-28 08:04:09,785][106226] Updated weights for policy 0, policy_version 1781911 (0.0006) [2023-12-28 08:04:09,855][106226] Updated weights for policy 0, policy_version 1781921 (0.0008) [2023-12-28 08:04:10,277][106225] Updated weights for policy 1, policy_version 1786185 (0.0007) [2023-12-28 08:04:10,341][106225] Updated weights for policy 1, policy_version 1786195 (0.0006) [2023-12-28 08:04:10,405][106225] Updated weights for policy 1, policy_version 1786205 (0.0009) [2023-12-28 08:04:10,466][106226] Updated weights for policy 0, policy_version 1781931 (0.0008) [2023-12-28 08:04:10,528][106226] Updated weights for policy 0, policy_version 1781941 (0.0008) [2023-12-28 08:04:10,592][106226] Updated weights for policy 0, policy_version 1781951 (0.0006) [2023-12-28 08:04:11,080][106225] Updated weights for policy 1, policy_version 1786215 (0.0009) [2023-12-28 08:04:11,148][106225] Updated weights for policy 1, policy_version 1786225 (0.0008) [2023-12-28 08:04:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 913588224. Throughput: 0: 9876.5, 1: 9819.4. Samples: 913562644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:11,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.422')] [2023-12-28 08:04:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001781960_456261632.pth... [2023-12-28 08:04:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001780808_455966720.pth [2023-12-28 08:04:11,213][106225] Updated weights for policy 1, policy_version 1786235 (0.0008) [2023-12-28 08:04:11,242][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001786240_457334784.pth... [2023-12-28 08:04:11,247][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001785056_457031680.pth [2023-12-28 08:04:11,283][106226] Updated weights for policy 0, policy_version 1781961 (0.0006) [2023-12-28 08:04:11,349][106226] Updated weights for policy 0, policy_version 1781971 (0.0008) [2023-12-28 08:04:11,422][106226] Updated weights for policy 0, policy_version 1781981 (0.0008) [2023-12-28 08:04:11,480][106226] Updated weights for policy 0, policy_version 1781991 (0.0008) [2023-12-28 08:04:12,069][106225] Updated weights for policy 1, policy_version 1786245 (0.0009) [2023-12-28 08:04:12,119][106225] Updated weights for policy 1, policy_version 1786255 (0.0009) [2023-12-28 08:04:12,179][106225] Updated weights for policy 1, policy_version 1786265 (0.0008) [2023-12-28 08:04:12,235][106226] Updated weights for policy 0, policy_version 1782001 (0.0008) [2023-12-28 08:04:12,300][106226] Updated weights for policy 0, policy_version 1782011 (0.0009) [2023-12-28 08:04:12,371][106226] Updated weights for policy 0, policy_version 1782021 (0.0008) [2023-12-28 08:04:12,882][106225] Updated weights for policy 1, policy_version 1786275 (0.0005) [2023-12-28 08:04:12,927][106225] Updated weights for policy 1, policy_version 1786285 (0.0005) [2023-12-28 08:04:12,984][106225] Updated weights for policy 1, policy_version 1786295 (0.0005) [2023-12-28 08:04:13,096][106226] Updated weights for policy 0, policy_version 1782031 (0.0008) [2023-12-28 08:04:13,160][106226] Updated weights for policy 0, policy_version 1782041 (0.0009) [2023-12-28 08:04:13,207][106226] Updated weights for policy 0, policy_version 1782051 (0.0010) [2023-12-28 08:04:13,700][106225] Updated weights for policy 1, policy_version 1786305 (0.0006) [2023-12-28 08:04:13,761][106225] Updated weights for policy 1, policy_version 1786315 (0.0008) [2023-12-28 08:04:13,816][106225] Updated weights for policy 1, policy_version 1786325 (0.0008) [2023-12-28 08:04:13,868][106225] Updated weights for policy 1, policy_version 1786335 (0.0007) [2023-12-28 08:04:13,873][106226] Updated weights for policy 0, policy_version 1782061 (0.0010) [2023-12-28 08:04:13,940][106226] Updated weights for policy 0, policy_version 1782071 (0.0011) [2023-12-28 08:04:13,992][106226] Updated weights for policy 0, policy_version 1782081 (0.0008) [2023-12-28 08:04:14,630][106226] Updated weights for policy 0, policy_version 1782091 (0.0009) [2023-12-28 08:04:14,655][106225] Updated weights for policy 1, policy_version 1786345 (0.0008) [2023-12-28 08:04:14,681][106226] Updated weights for policy 0, policy_version 1782101 (0.0005) [2023-12-28 08:04:14,712][106225] Updated weights for policy 1, policy_version 1786355 (0.0007) [2023-12-28 08:04:14,735][106226] Updated weights for policy 0, policy_version 1782111 (0.0005) [2023-12-28 08:04:14,775][106225] Updated weights for policy 1, policy_version 1786365 (0.0009) [2023-12-28 08:04:15,387][106226] Updated weights for policy 0, policy_version 1782121 (0.0007) [2023-12-28 08:04:15,447][106226] Updated weights for policy 0, policy_version 1782131 (0.0006) [2023-12-28 08:04:15,511][106226] Updated weights for policy 0, policy_version 1782141 (0.0005) [2023-12-28 08:04:15,565][106225] Updated weights for policy 1, policy_version 1786375 (0.0007) [2023-12-28 08:04:15,567][106226] Updated weights for policy 0, policy_version 1782151 (0.0006) [2023-12-28 08:04:15,617][106225] Updated weights for policy 1, policy_version 1786385 (0.0008) [2023-12-28 08:04:15,668][106225] Updated weights for policy 1, policy_version 1786395 (0.0008) [2023-12-28 08:04:16,137][106226] Updated weights for policy 0, policy_version 1782161 (0.0007) [2023-12-28 08:04:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19410.9). Total num frames: 913686528. Throughput: 0: 9913.7, 1: 9815.6. Samples: 913679928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:16,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.711')] [2023-12-28 08:04:16,194][106226] Updated weights for policy 0, policy_version 1782171 (0.0008) [2023-12-28 08:04:16,247][106226] Updated weights for policy 0, policy_version 1782181 (0.0009) [2023-12-28 08:04:16,407][106225] Updated weights for policy 1, policy_version 1786405 (0.0008) [2023-12-28 08:04:16,465][106225] Updated weights for policy 1, policy_version 1786415 (0.0005) [2023-12-28 08:04:16,521][106225] Updated weights for policy 1, policy_version 1786425 (0.0005) [2023-12-28 08:04:16,934][106226] Updated weights for policy 0, policy_version 1782191 (0.0006) [2023-12-28 08:04:16,983][106226] Updated weights for policy 0, policy_version 1782201 (0.0005) [2023-12-28 08:04:17,035][106226] Updated weights for policy 0, policy_version 1782211 (0.0009) [2023-12-28 08:04:17,142][106225] Updated weights for policy 1, policy_version 1786435 (0.0005) [2023-12-28 08:04:17,189][106225] Updated weights for policy 1, policy_version 1786445 (0.0005) [2023-12-28 08:04:17,249][106225] Updated weights for policy 1, policy_version 1786455 (0.0005) [2023-12-28 08:04:17,700][106226] Updated weights for policy 0, policy_version 1782221 (0.0006) [2023-12-28 08:04:17,756][106226] Updated weights for policy 0, policy_version 1782231 (0.0005) [2023-12-28 08:04:17,797][106225] Updated weights for policy 1, policy_version 1786465 (0.0005) [2023-12-28 08:04:17,801][106226] Updated weights for policy 0, policy_version 1782241 (0.0005) [2023-12-28 08:04:17,853][106225] Updated weights for policy 1, policy_version 1786475 (0.0007) [2023-12-28 08:04:17,905][106225] Updated weights for policy 1, policy_version 1786485 (0.0007) [2023-12-28 08:04:17,957][106225] Updated weights for policy 1, policy_version 1786495 (0.0007) [2023-12-28 08:04:18,332][106226] Updated weights for policy 0, policy_version 1782251 (0.0006) [2023-12-28 08:04:18,392][106226] Updated weights for policy 0, policy_version 1782261 (0.0009) [2023-12-28 08:04:18,440][106226] Updated weights for policy 0, policy_version 1782271 (0.0007) [2023-12-28 08:04:18,718][106225] Updated weights for policy 1, policy_version 1786505 (0.0010) [2023-12-28 08:04:18,779][106225] Updated weights for policy 1, policy_version 1786515 (0.0010) [2023-12-28 08:04:18,839][106225] Updated weights for policy 1, policy_version 1786525 (0.0009) [2023-12-28 08:04:19,009][106226] Updated weights for policy 0, policy_version 1782281 (0.0008) [2023-12-28 08:04:19,075][106226] Updated weights for policy 0, policy_version 1782291 (0.0006) [2023-12-28 08:04:19,135][106226] Updated weights for policy 0, policy_version 1782301 (0.0007) [2023-12-28 08:04:19,184][106226] Updated weights for policy 0, policy_version 1782311 (0.0008) [2023-12-28 08:04:19,554][106225] Updated weights for policy 1, policy_version 1786535 (0.0007) [2023-12-28 08:04:19,619][106225] Updated weights for policy 1, policy_version 1786545 (0.0008) [2023-12-28 08:04:19,683][106225] Updated weights for policy 1, policy_version 1786555 (0.0008) [2023-12-28 08:04:19,971][106226] Updated weights for policy 0, policy_version 1782321 (0.0008) [2023-12-28 08:04:20,035][106226] Updated weights for policy 0, policy_version 1782331 (0.0008) [2023-12-28 08:04:20,095][106226] Updated weights for policy 0, policy_version 1782341 (0.0008) [2023-12-28 08:04:20,361][106225] Updated weights for policy 1, policy_version 1786565 (0.0008) [2023-12-28 08:04:20,415][106225] Updated weights for policy 1, policy_version 1786575 (0.0008) [2023-12-28 08:04:20,472][106225] Updated weights for policy 1, policy_version 1786585 (0.0006) [2023-12-28 08:04:20,875][106226] Updated weights for policy 0, policy_version 1782351 (0.0008) [2023-12-28 08:04:20,937][106226] Updated weights for policy 0, policy_version 1782361 (0.0008) [2023-12-28 08:04:20,997][106226] Updated weights for policy 0, policy_version 1782371 (0.0008) [2023-12-28 08:04:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19466.4). Total num frames: 913793024. Throughput: 0: 9980.9, 1: 9822.1. Samples: 913802600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:21,175][105115] Avg episode reward: [(0, '-4.519'), (1, '-4.464')] [2023-12-28 08:04:21,197][106225] Updated weights for policy 1, policy_version 1786595 (0.0007) [2023-12-28 08:04:21,265][106225] Updated weights for policy 1, policy_version 1786605 (0.0009) [2023-12-28 08:04:21,325][106225] Updated weights for policy 1, policy_version 1786615 (0.0009) [2023-12-28 08:04:21,735][106226] Updated weights for policy 0, policy_version 1782381 (0.0008) [2023-12-28 08:04:21,799][106226] Updated weights for policy 0, policy_version 1782391 (0.0008) [2023-12-28 08:04:21,863][106226] Updated weights for policy 0, policy_version 1782401 (0.0009) [2023-12-28 08:04:22,159][106225] Updated weights for policy 1, policy_version 1786625 (0.0009) [2023-12-28 08:04:22,229][106225] Updated weights for policy 1, policy_version 1786635 (0.0007) [2023-12-28 08:04:22,295][106225] Updated weights for policy 1, policy_version 1786645 (0.0008) [2023-12-28 08:04:22,366][106225] Updated weights for policy 1, policy_version 1786655 (0.0007) [2023-12-28 08:04:22,656][106226] Updated weights for policy 0, policy_version 1782411 (0.0008) [2023-12-28 08:04:22,713][106226] Updated weights for policy 0, policy_version 1782421 (0.0009) [2023-12-28 08:04:22,773][106226] Updated weights for policy 0, policy_version 1782431 (0.0009) [2023-12-28 08:04:23,079][106225] Updated weights for policy 1, policy_version 1786665 (0.0011) [2023-12-28 08:04:23,141][106225] Updated weights for policy 1, policy_version 1786675 (0.0010) [2023-12-28 08:04:23,203][106225] Updated weights for policy 1, policy_version 1786685 (0.0010) [2023-12-28 08:04:23,537][106226] Updated weights for policy 0, policy_version 1782441 (0.0008) [2023-12-28 08:04:23,604][106226] Updated weights for policy 0, policy_version 1782451 (0.0008) [2023-12-28 08:04:23,661][106226] Updated weights for policy 0, policy_version 1782461 (0.0008) [2023-12-28 08:04:23,714][106226] Updated weights for policy 0, policy_version 1782471 (0.0008) [2023-12-28 08:04:23,921][106225] Updated weights for policy 1, policy_version 1786695 (0.0010) [2023-12-28 08:04:23,964][106225] Updated weights for policy 1, policy_version 1786705 (0.0010) [2023-12-28 08:04:24,008][106225] Updated weights for policy 1, policy_version 1786715 (0.0010) [2023-12-28 08:04:24,435][106226] Updated weights for policy 0, policy_version 1782481 (0.0008) [2023-12-28 08:04:24,495][106226] Updated weights for policy 0, policy_version 1782491 (0.0007) [2023-12-28 08:04:24,552][106226] Updated weights for policy 0, policy_version 1782501 (0.0008) [2023-12-28 08:04:24,747][106225] Updated weights for policy 1, policy_version 1786725 (0.0010) [2023-12-28 08:04:24,793][106225] Updated weights for policy 1, policy_version 1786735 (0.0010) [2023-12-28 08:04:24,843][106225] Updated weights for policy 1, policy_version 1786745 (0.0010) [2023-12-28 08:04:25,282][106226] Updated weights for policy 0, policy_version 1782511 (0.0008) [2023-12-28 08:04:25,330][106226] Updated weights for policy 0, policy_version 1782521 (0.0009) [2023-12-28 08:04:25,379][106226] Updated weights for policy 0, policy_version 1782531 (0.0009) [2023-12-28 08:04:25,522][106225] Updated weights for policy 1, policy_version 1786755 (0.0008) [2023-12-28 08:04:25,587][106225] Updated weights for policy 1, policy_version 1786765 (0.0009) [2023-12-28 08:04:25,648][106225] Updated weights for policy 1, policy_version 1786775 (0.0009) [2023-12-28 08:04:26,028][106226] Updated weights for policy 0, policy_version 1782541 (0.0010) [2023-12-28 08:04:26,091][106226] Updated weights for policy 0, policy_version 1782551 (0.0010) [2023-12-28 08:04:26,144][106226] Updated weights for policy 0, policy_version 1782561 (0.0010) [2023-12-28 08:04:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19410.9). Total num frames: 913883136. Throughput: 0: 9916.2, 1: 9832.9. Samples: 913858308. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:04:26,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-5.154')] [2023-12-28 08:04:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001786784_457474048.pth... [2023-12-28 08:04:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001782568_456417280.pth... [2023-12-28 08:04:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001785632_457179136.pth [2023-12-28 08:04:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001781416_456122368.pth [2023-12-28 08:04:26,379][106225] Updated weights for policy 1, policy_version 1786785 (0.0007) [2023-12-28 08:04:26,459][106225] Updated weights for policy 1, policy_version 1786795 (0.0007) [2023-12-28 08:04:26,525][106225] Updated weights for policy 1, policy_version 1786805 (0.0007) [2023-12-28 08:04:26,594][106225] Updated weights for policy 1, policy_version 1786815 (0.0008) [2023-12-28 08:04:26,844][106226] Updated weights for policy 0, policy_version 1782571 (0.0010) [2023-12-28 08:04:26,904][106226] Updated weights for policy 0, policy_version 1782581 (0.0009) [2023-12-28 08:04:26,952][106226] Updated weights for policy 0, policy_version 1782591 (0.0009) [2023-12-28 08:04:27,329][106225] Updated weights for policy 1, policy_version 1786825 (0.0006) [2023-12-28 08:04:27,390][106225] Updated weights for policy 1, policy_version 1786835 (0.0006) [2023-12-28 08:04:27,442][106225] Updated weights for policy 1, policy_version 1786845 (0.0005) [2023-12-28 08:04:27,723][106226] Updated weights for policy 0, policy_version 1782601 (0.0009) [2023-12-28 08:04:27,777][106226] Updated weights for policy 0, policy_version 1782611 (0.0008) [2023-12-28 08:04:27,830][106226] Updated weights for policy 0, policy_version 1782621 (0.0008) [2023-12-28 08:04:27,880][106226] Updated weights for policy 0, policy_version 1782631 (0.0008) [2023-12-28 08:04:27,994][106225] Updated weights for policy 1, policy_version 1786855 (0.0008) [2023-12-28 08:04:28,045][106225] Updated weights for policy 1, policy_version 1786865 (0.0008) [2023-12-28 08:04:28,102][106225] Updated weights for policy 1, policy_version 1786875 (0.0008) [2023-12-28 08:04:28,623][106226] Updated weights for policy 0, policy_version 1782641 (0.0008) [2023-12-28 08:04:28,679][106226] Updated weights for policy 0, policy_version 1782651 (0.0005) [2023-12-28 08:04:28,735][106226] Updated weights for policy 0, policy_version 1782661 (0.0008) [2023-12-28 08:04:28,850][106225] Updated weights for policy 1, policy_version 1786885 (0.0009) [2023-12-28 08:04:28,910][106225] Updated weights for policy 1, policy_version 1786895 (0.0008) [2023-12-28 08:04:28,980][106225] Updated weights for policy 1, policy_version 1786905 (0.0008) [2023-12-28 08:04:29,404][106226] Updated weights for policy 0, policy_version 1782671 (0.0007) [2023-12-28 08:04:29,456][106226] Updated weights for policy 0, policy_version 1782681 (0.0005) [2023-12-28 08:04:29,505][106226] Updated weights for policy 0, policy_version 1782691 (0.0005) [2023-12-28 08:04:29,780][106225] Updated weights for policy 1, policy_version 1786915 (0.0009) [2023-12-28 08:04:29,842][106225] Updated weights for policy 1, policy_version 1786925 (0.0010) [2023-12-28 08:04:29,906][106225] Updated weights for policy 1, policy_version 1786935 (0.0008) [2023-12-28 08:04:30,140][106226] Updated weights for policy 0, policy_version 1782701 (0.0007) [2023-12-28 08:04:30,191][106226] Updated weights for policy 0, policy_version 1782711 (0.0008) [2023-12-28 08:04:30,254][106226] Updated weights for policy 0, policy_version 1782721 (0.0007) [2023-12-28 08:04:30,575][106225] Updated weights for policy 1, policy_version 1786945 (0.0008) [2023-12-28 08:04:30,643][106225] Updated weights for policy 1, policy_version 1786955 (0.0006) [2023-12-28 08:04:30,704][106225] Updated weights for policy 1, policy_version 1786965 (0.0007) [2023-12-28 08:04:30,751][106225] Updated weights for policy 1, policy_version 1786975 (0.0006) [2023-12-28 08:04:30,914][106226] Updated weights for policy 0, policy_version 1782731 (0.0006) [2023-12-28 08:04:30,972][106226] Updated weights for policy 0, policy_version 1782741 (0.0008) [2023-12-28 08:04:31,031][106226] Updated weights for policy 0, policy_version 1782751 (0.0008) [2023-12-28 08:04:31,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19410.9). Total num frames: 913989632. Throughput: 0: 9938.4, 1: 9855.2. Samples: 913976912. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:31,175][105115] Avg episode reward: [(0, '-4.606'), (1, '-4.510')] [2023-12-28 08:04:31,426][106225] Updated weights for policy 1, policy_version 1786985 (0.0008) [2023-12-28 08:04:31,484][106225] Updated weights for policy 1, policy_version 1786995 (0.0008) [2023-12-28 08:04:31,551][106225] Updated weights for policy 1, policy_version 1787005 (0.0009) [2023-12-28 08:04:31,765][106226] Updated weights for policy 0, policy_version 1782761 (0.0009) [2023-12-28 08:04:31,820][106226] Updated weights for policy 0, policy_version 1782771 (0.0008) [2023-12-28 08:04:31,867][106226] Updated weights for policy 0, policy_version 1782781 (0.0008) [2023-12-28 08:04:31,915][106226] Updated weights for policy 0, policy_version 1782791 (0.0008) [2023-12-28 08:04:32,294][106225] Updated weights for policy 1, policy_version 1787015 (0.0008) [2023-12-28 08:04:32,343][106225] Updated weights for policy 1, policy_version 1787025 (0.0008) [2023-12-28 08:04:32,409][106225] Updated weights for policy 1, policy_version 1787035 (0.0009) [2023-12-28 08:04:32,683][106226] Updated weights for policy 0, policy_version 1782801 (0.0006) [2023-12-28 08:04:32,737][106226] Updated weights for policy 0, policy_version 1782811 (0.0007) [2023-12-28 08:04:32,787][106226] Updated weights for policy 0, policy_version 1782821 (0.0007) [2023-12-28 08:04:33,116][106225] Updated weights for policy 1, policy_version 1787045 (0.0007) [2023-12-28 08:04:33,163][106225] Updated weights for policy 1, policy_version 1787055 (0.0005) [2023-12-28 08:04:33,209][106225] Updated weights for policy 1, policy_version 1787065 (0.0005) [2023-12-28 08:04:33,455][106226] Updated weights for policy 0, policy_version 1782831 (0.0006) [2023-12-28 08:04:33,517][106226] Updated weights for policy 0, policy_version 1782841 (0.0007) [2023-12-28 08:04:33,579][106226] Updated weights for policy 0, policy_version 1782851 (0.0010) [2023-12-28 08:04:33,791][106225] Updated weights for policy 1, policy_version 1787075 (0.0006) [2023-12-28 08:04:33,835][106225] Updated weights for policy 1, policy_version 1787085 (0.0006) [2023-12-28 08:04:33,891][106225] Updated weights for policy 1, policy_version 1787095 (0.0005) [2023-12-28 08:04:34,189][106226] Updated weights for policy 0, policy_version 1782861 (0.0008) [2023-12-28 08:04:34,252][106226] Updated weights for policy 0, policy_version 1782871 (0.0007) [2023-12-28 08:04:34,312][106226] Updated weights for policy 0, policy_version 1782881 (0.0008) [2023-12-28 08:04:34,552][106225] Updated weights for policy 1, policy_version 1787105 (0.0007) [2023-12-28 08:04:34,621][106225] Updated weights for policy 1, policy_version 1787115 (0.0011) [2023-12-28 08:04:34,682][106225] Updated weights for policy 1, policy_version 1787125 (0.0010) [2023-12-28 08:04:34,733][106225] Updated weights for policy 1, policy_version 1787135 (0.0011) [2023-12-28 08:04:35,024][106226] Updated weights for policy 0, policy_version 1782891 (0.0008) [2023-12-28 08:04:35,073][106226] Updated weights for policy 0, policy_version 1782901 (0.0008) [2023-12-28 08:04:35,120][106226] Updated weights for policy 0, policy_version 1782911 (0.0008) [2023-12-28 08:04:35,412][106225] Updated weights for policy 1, policy_version 1787145 (0.0006) [2023-12-28 08:04:35,468][106225] Updated weights for policy 1, policy_version 1787155 (0.0005) [2023-12-28 08:04:35,519][106225] Updated weights for policy 1, policy_version 1787165 (0.0006) [2023-12-28 08:04:35,823][106226] Updated weights for policy 0, policy_version 1782921 (0.0008) [2023-12-28 08:04:35,883][106226] Updated weights for policy 0, policy_version 1782931 (0.0008) [2023-12-28 08:04:35,942][106226] Updated weights for policy 0, policy_version 1782941 (0.0008) [2023-12-28 08:04:35,989][106226] Updated weights for policy 0, policy_version 1782951 (0.0008) [2023-12-28 08:04:36,132][106225] Updated weights for policy 1, policy_version 1787175 (0.0007) [2023-12-28 08:04:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19410.9). Total num frames: 914087936. Throughput: 0: 9912.1, 1: 9876.1. Samples: 914098140. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:36,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.598')] [2023-12-28 08:04:36,200][106225] Updated weights for policy 1, policy_version 1787185 (0.0009) [2023-12-28 08:04:36,264][106225] Updated weights for policy 1, policy_version 1787195 (0.0007) [2023-12-28 08:04:36,700][106226] Updated weights for policy 0, policy_version 1782961 (0.0007) [2023-12-28 08:04:36,760][106226] Updated weights for policy 0, policy_version 1782971 (0.0005) [2023-12-28 08:04:36,818][106226] Updated weights for policy 0, policy_version 1782981 (0.0006) [2023-12-28 08:04:37,017][106225] Updated weights for policy 1, policy_version 1787205 (0.0008) [2023-12-28 08:04:37,075][106225] Updated weights for policy 1, policy_version 1787215 (0.0008) [2023-12-28 08:04:37,129][106225] Updated weights for policy 1, policy_version 1787225 (0.0008) [2023-12-28 08:04:37,445][106226] Updated weights for policy 0, policy_version 1782991 (0.0008) [2023-12-28 08:04:37,495][106226] Updated weights for policy 0, policy_version 1783001 (0.0009) [2023-12-28 08:04:37,551][106226] Updated weights for policy 0, policy_version 1783011 (0.0008) [2023-12-28 08:04:37,852][106225] Updated weights for policy 1, policy_version 1787235 (0.0008) [2023-12-28 08:04:37,904][106225] Updated weights for policy 1, policy_version 1787245 (0.0009) [2023-12-28 08:04:37,952][106225] Updated weights for policy 1, policy_version 1787255 (0.0009) [2023-12-28 08:04:38,291][106226] Updated weights for policy 0, policy_version 1783021 (0.0009) [2023-12-28 08:04:38,356][106226] Updated weights for policy 0, policy_version 1783031 (0.0008) [2023-12-28 08:04:38,418][106226] Updated weights for policy 0, policy_version 1783041 (0.0008) [2023-12-28 08:04:38,714][106225] Updated weights for policy 1, policy_version 1787265 (0.0007) [2023-12-28 08:04:38,777][106225] Updated weights for policy 1, policy_version 1787275 (0.0010) [2023-12-28 08:04:38,843][106225] Updated weights for policy 1, policy_version 1787285 (0.0011) [2023-12-28 08:04:38,904][106225] Updated weights for policy 1, policy_version 1787295 (0.0010) [2023-12-28 08:04:39,166][106226] Updated weights for policy 0, policy_version 1783051 (0.0008) [2023-12-28 08:04:39,230][106226] Updated weights for policy 0, policy_version 1783061 (0.0008) [2023-12-28 08:04:39,294][106226] Updated weights for policy 0, policy_version 1783071 (0.0008) [2023-12-28 08:04:39,647][106225] Updated weights for policy 1, policy_version 1787305 (0.0007) [2023-12-28 08:04:39,707][106225] Updated weights for policy 1, policy_version 1787315 (0.0010) [2023-12-28 08:04:39,758][106225] Updated weights for policy 1, policy_version 1787325 (0.0010) [2023-12-28 08:04:39,999][106226] Updated weights for policy 0, policy_version 1783081 (0.0008) [2023-12-28 08:04:40,058][106226] Updated weights for policy 0, policy_version 1783091 (0.0009) [2023-12-28 08:04:40,121][106226] Updated weights for policy 0, policy_version 1783101 (0.0006) [2023-12-28 08:04:40,192][106226] Updated weights for policy 0, policy_version 1783111 (0.0006) [2023-12-28 08:04:40,482][106225] Updated weights for policy 1, policy_version 1787335 (0.0011) [2023-12-28 08:04:40,534][106225] Updated weights for policy 1, policy_version 1787345 (0.0009) [2023-12-28 08:04:40,586][106225] Updated weights for policy 1, policy_version 1787355 (0.0009) [2023-12-28 08:04:40,790][106226] Updated weights for policy 0, policy_version 1783121 (0.0006) [2023-12-28 08:04:40,858][106226] Updated weights for policy 0, policy_version 1783131 (0.0006) [2023-12-28 08:04:40,920][106226] Updated weights for policy 0, policy_version 1783141 (0.0005) [2023-12-28 08:04:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19410.9). Total num frames: 914186240. Throughput: 0: 9971.4, 1: 9887.4. Samples: 914157552. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:41,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.817')] [2023-12-28 08:04:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001787360_457621504.pth... [2023-12-28 08:04:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001783144_456564736.pth... [2023-12-28 08:04:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001781960_456261632.pth [2023-12-28 08:04:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001786240_457334784.pth [2023-12-28 08:04:41,328][106225] Updated weights for policy 1, policy_version 1787365 (0.0008) [2023-12-28 08:04:41,400][106225] Updated weights for policy 1, policy_version 1787375 (0.0010) [2023-12-28 08:04:41,458][106225] Updated weights for policy 1, policy_version 1787385 (0.0010) [2023-12-28 08:04:41,610][106226] Updated weights for policy 0, policy_version 1783151 (0.0008) [2023-12-28 08:04:41,689][106226] Updated weights for policy 0, policy_version 1783161 (0.0009) [2023-12-28 08:04:41,747][106226] Updated weights for policy 0, policy_version 1783171 (0.0008) [2023-12-28 08:04:42,221][106225] Updated weights for policy 1, policy_version 1787395 (0.0010) [2023-12-28 08:04:42,290][106225] Updated weights for policy 1, policy_version 1787405 (0.0011) [2023-12-28 08:04:42,355][106225] Updated weights for policy 1, policy_version 1787415 (0.0010) [2023-12-28 08:04:42,424][106226] Updated weights for policy 0, policy_version 1783181 (0.0009) [2023-12-28 08:04:42,480][106226] Updated weights for policy 0, policy_version 1783191 (0.0008) [2023-12-28 08:04:42,542][106226] Updated weights for policy 0, policy_version 1783201 (0.0008) [2023-12-28 08:04:43,068][106225] Updated weights for policy 1, policy_version 1787425 (0.0011) [2023-12-28 08:04:43,127][106225] Updated weights for policy 1, policy_version 1787435 (0.0010) [2023-12-28 08:04:43,179][106225] Updated weights for policy 1, policy_version 1787445 (0.0010) [2023-12-28 08:04:43,244][106225] Updated weights for policy 1, policy_version 1787455 (0.0011) [2023-12-28 08:04:43,262][106226] Updated weights for policy 0, policy_version 1783211 (0.0007) [2023-12-28 08:04:43,315][106226] Updated weights for policy 0, policy_version 1783221 (0.0005) [2023-12-28 08:04:43,369][106226] Updated weights for policy 0, policy_version 1783231 (0.0005) [2023-12-28 08:04:43,845][106225] Updated weights for policy 1, policy_version 1787465 (0.0010) [2023-12-28 08:04:43,905][106225] Updated weights for policy 1, policy_version 1787475 (0.0010) [2023-12-28 08:04:43,910][106226] Updated weights for policy 0, policy_version 1783241 (0.0005) [2023-12-28 08:04:43,958][106225] Updated weights for policy 1, policy_version 1787485 (0.0010) [2023-12-28 08:04:43,961][106226] Updated weights for policy 0, policy_version 1783251 (0.0005) [2023-12-28 08:04:44,023][106226] Updated weights for policy 0, policy_version 1783261 (0.0010) [2023-12-28 08:04:44,076][106226] Updated weights for policy 0, policy_version 1783271 (0.0010) [2023-12-28 08:04:44,654][106226] Updated weights for policy 0, policy_version 1783281 (0.0010) [2023-12-28 08:04:44,670][106225] Updated weights for policy 1, policy_version 1787495 (0.0010) [2023-12-28 08:04:44,711][106226] Updated weights for policy 0, policy_version 1783291 (0.0011) [2023-12-28 08:04:44,724][106225] Updated weights for policy 1, policy_version 1787505 (0.0010) [2023-12-28 08:04:44,782][106226] Updated weights for policy 0, policy_version 1783301 (0.0009) [2023-12-28 08:04:44,793][106225] Updated weights for policy 1, policy_version 1787515 (0.0012) [2023-12-28 08:04:45,514][106226] Updated weights for policy 0, policy_version 1783311 (0.0007) [2023-12-28 08:04:45,547][106225] Updated weights for policy 1, policy_version 1787525 (0.0011) [2023-12-28 08:04:45,588][106226] Updated weights for policy 0, policy_version 1783321 (0.0006) [2023-12-28 08:04:45,603][106225] Updated weights for policy 1, policy_version 1787535 (0.0008) [2023-12-28 08:04:45,650][106226] Updated weights for policy 0, policy_version 1783331 (0.0006) [2023-12-28 08:04:45,654][106225] Updated weights for policy 1, policy_version 1787545 (0.0008) [2023-12-28 08:04:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19410.9). Total num frames: 914284544. Throughput: 0: 10006.5, 1: 9866.7. Samples: 914276804. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:46,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.569')] [2023-12-28 08:04:46,203][106226] Updated weights for policy 0, policy_version 1783341 (0.0006) [2023-12-28 08:04:46,261][106226] Updated weights for policy 0, policy_version 1783351 (0.0006) [2023-12-28 08:04:46,329][106226] Updated weights for policy 0, policy_version 1783361 (0.0005) [2023-12-28 08:04:46,357][106225] Updated weights for policy 1, policy_version 1787555 (0.0006) [2023-12-28 08:04:46,427][106225] Updated weights for policy 1, policy_version 1787565 (0.0007) [2023-12-28 08:04:46,490][106225] Updated weights for policy 1, policy_version 1787575 (0.0006) [2023-12-28 08:04:46,885][106226] Updated weights for policy 0, policy_version 1783371 (0.0008) [2023-12-28 08:04:46,951][106226] Updated weights for policy 0, policy_version 1783381 (0.0010) [2023-12-28 08:04:47,008][106226] Updated weights for policy 0, policy_version 1783391 (0.0010) [2023-12-28 08:04:47,046][106225] Updated weights for policy 1, policy_version 1787585 (0.0006) [2023-12-28 08:04:47,099][106225] Updated weights for policy 1, policy_version 1787595 (0.0009) [2023-12-28 08:04:47,155][106225] Updated weights for policy 1, policy_version 1787605 (0.0005) [2023-12-28 08:04:47,215][106225] Updated weights for policy 1, policy_version 1787615 (0.0008) [2023-12-28 08:04:47,591][106226] Updated weights for policy 0, policy_version 1783401 (0.0011) [2023-12-28 08:04:47,664][106226] Updated weights for policy 0, policy_version 1783411 (0.0011) [2023-12-28 08:04:47,723][106226] Updated weights for policy 0, policy_version 1783421 (0.0010) [2023-12-28 08:04:47,779][106226] Updated weights for policy 0, policy_version 1783431 (0.0008) [2023-12-28 08:04:47,821][106225] Updated weights for policy 1, policy_version 1787625 (0.0008) [2023-12-28 08:04:47,889][106225] Updated weights for policy 1, policy_version 1787635 (0.0010) [2023-12-28 08:04:47,959][106225] Updated weights for policy 1, policy_version 1787645 (0.0010) [2023-12-28 08:04:48,328][106226] Updated weights for policy 0, policy_version 1783441 (0.0006) [2023-12-28 08:04:48,396][106226] Updated weights for policy 0, policy_version 1783451 (0.0006) [2023-12-28 08:04:48,461][106226] Updated weights for policy 0, policy_version 1783461 (0.0009) [2023-12-28 08:04:48,733][106225] Updated weights for policy 1, policy_version 1787655 (0.0008) [2023-12-28 08:04:48,787][106225] Updated weights for policy 1, policy_version 1787665 (0.0008) [2023-12-28 08:04:48,850][106225] Updated weights for policy 1, policy_version 1787675 (0.0008) [2023-12-28 08:04:49,134][106226] Updated weights for policy 0, policy_version 1783471 (0.0008) [2023-12-28 08:04:49,185][106226] Updated weights for policy 0, policy_version 1783481 (0.0008) [2023-12-28 08:04:49,264][106226] Updated weights for policy 0, policy_version 1783491 (0.0009) [2023-12-28 08:04:49,601][106225] Updated weights for policy 1, policy_version 1787685 (0.0008) [2023-12-28 08:04:49,661][106225] Updated weights for policy 1, policy_version 1787695 (0.0009) [2023-12-28 08:04:49,721][106225] Updated weights for policy 1, policy_version 1787705 (0.0009) [2023-12-28 08:04:49,945][106226] Updated weights for policy 0, policy_version 1783501 (0.0009) [2023-12-28 08:04:50,005][106226] Updated weights for policy 0, policy_version 1783511 (0.0006) [2023-12-28 08:04:50,060][106226] Updated weights for policy 0, policy_version 1783521 (0.0010) [2023-12-28 08:04:50,424][106225] Updated weights for policy 1, policy_version 1787715 (0.0009) [2023-12-28 08:04:50,495][106225] Updated weights for policy 1, policy_version 1787725 (0.0008) [2023-12-28 08:04:50,550][106225] Updated weights for policy 1, policy_version 1787735 (0.0005) [2023-12-28 08:04:50,734][106226] Updated weights for policy 0, policy_version 1783531 (0.0009) [2023-12-28 08:04:50,790][106226] Updated weights for policy 0, policy_version 1783541 (0.0008) [2023-12-28 08:04:50,852][106226] Updated weights for policy 0, policy_version 1783551 (0.0009) [2023-12-28 08:04:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19466.4). Total num frames: 914391040. Throughput: 0: 10121.9, 1: 9874.8. Samples: 914400668. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:51,175][105115] Avg episode reward: [(0, '-4.233'), (1, '-4.862')] [2023-12-28 08:04:51,315][106225] Updated weights for policy 1, policy_version 1787745 (0.0007) [2023-12-28 08:04:51,392][106225] Updated weights for policy 1, policy_version 1787755 (0.0008) [2023-12-28 08:04:51,456][106225] Updated weights for policy 1, policy_version 1787765 (0.0008) [2023-12-28 08:04:51,525][106225] Updated weights for policy 1, policy_version 1787775 (0.0009) [2023-12-28 08:04:51,599][106226] Updated weights for policy 0, policy_version 1783561 (0.0009) [2023-12-28 08:04:51,662][106226] Updated weights for policy 0, policy_version 1783571 (0.0008) [2023-12-28 08:04:51,718][106226] Updated weights for policy 0, policy_version 1783581 (0.0008) [2023-12-28 08:04:51,786][106226] Updated weights for policy 0, policy_version 1783591 (0.0009) [2023-12-28 08:04:52,302][106225] Updated weights for policy 1, policy_version 1787785 (0.0008) [2023-12-28 08:04:52,364][106225] Updated weights for policy 1, policy_version 1787795 (0.0008) [2023-12-28 08:04:52,433][106225] Updated weights for policy 1, policy_version 1787805 (0.0008) [2023-12-28 08:04:52,580][106226] Updated weights for policy 0, policy_version 1783601 (0.0008) [2023-12-28 08:04:52,643][106226] Updated weights for policy 0, policy_version 1783611 (0.0008) [2023-12-28 08:04:52,703][106226] Updated weights for policy 0, policy_version 1783621 (0.0009) [2023-12-28 08:04:53,165][106225] Updated weights for policy 1, policy_version 1787815 (0.0008) [2023-12-28 08:04:53,215][106225] Updated weights for policy 1, policy_version 1787825 (0.0009) [2023-12-28 08:04:53,270][106225] Updated weights for policy 1, policy_version 1787835 (0.0010) [2023-12-28 08:04:53,410][106226] Updated weights for policy 0, policy_version 1783631 (0.0007) [2023-12-28 08:04:53,479][106226] Updated weights for policy 0, policy_version 1783641 (0.0008) [2023-12-28 08:04:53,541][106226] Updated weights for policy 0, policy_version 1783651 (0.0008) [2023-12-28 08:04:53,924][106225] Updated weights for policy 1, policy_version 1787845 (0.0008) [2023-12-28 08:04:53,979][106225] Updated weights for policy 1, policy_version 1787855 (0.0008) [2023-12-28 08:04:54,034][106225] Updated weights for policy 1, policy_version 1787865 (0.0006) [2023-12-28 08:04:54,266][106226] Updated weights for policy 0, policy_version 1783661 (0.0009) [2023-12-28 08:04:54,330][106226] Updated weights for policy 0, policy_version 1783671 (0.0009) [2023-12-28 08:04:54,389][106226] Updated weights for policy 0, policy_version 1783681 (0.0008) [2023-12-28 08:04:54,672][106225] Updated weights for policy 1, policy_version 1787875 (0.0007) [2023-12-28 08:04:54,727][106225] Updated weights for policy 1, policy_version 1787885 (0.0010) [2023-12-28 08:04:54,774][106225] Updated weights for policy 1, policy_version 1787895 (0.0010) [2023-12-28 08:04:55,110][106226] Updated weights for policy 0, policy_version 1783691 (0.0008) [2023-12-28 08:04:55,166][106226] Updated weights for policy 0, policy_version 1783701 (0.0008) [2023-12-28 08:04:55,225][106226] Updated weights for policy 0, policy_version 1783711 (0.0008) [2023-12-28 08:04:55,501][106225] Updated weights for policy 1, policy_version 1787905 (0.0010) [2023-12-28 08:04:55,553][106225] Updated weights for policy 1, policy_version 1787915 (0.0008) [2023-12-28 08:04:55,604][106225] Updated weights for policy 1, policy_version 1787925 (0.0008) [2023-12-28 08:04:55,651][106225] Updated weights for policy 1, policy_version 1787935 (0.0008) [2023-12-28 08:04:55,923][106226] Updated weights for policy 0, policy_version 1783721 (0.0009) [2023-12-28 08:04:55,986][106226] Updated weights for policy 0, policy_version 1783731 (0.0010) [2023-12-28 08:04:56,037][106226] Updated weights for policy 0, policy_version 1783741 (0.0007) [2023-12-28 08:04:56,096][106226] Updated weights for policy 0, policy_version 1783751 (0.0008) [2023-12-28 08:04:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19438.7). Total num frames: 914489344. Throughput: 0: 10116.5, 1: 9771.2. Samples: 914457584. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:04:56,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.882')] [2023-12-28 08:04:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001783752_456720384.pth... [2023-12-28 08:04:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001787936_457768960.pth... [2023-12-28 08:04:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001782568_456417280.pth [2023-12-28 08:04:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001786784_457474048.pth [2023-12-28 08:04:56,435][106225] Updated weights for policy 1, policy_version 1787945 (0.0008) [2023-12-28 08:04:56,486][106225] Updated weights for policy 1, policy_version 1787955 (0.0007) [2023-12-28 08:04:56,539][106225] Updated weights for policy 1, policy_version 1787965 (0.0007) [2023-12-28 08:04:56,742][106226] Updated weights for policy 0, policy_version 1783761 (0.0009) [2023-12-28 08:04:56,801][106226] Updated weights for policy 0, policy_version 1783771 (0.0011) [2023-12-28 08:04:56,863][106226] Updated weights for policy 0, policy_version 1783781 (0.0011) [2023-12-28 08:04:57,236][106225] Updated weights for policy 1, policy_version 1787975 (0.0008) [2023-12-28 08:04:57,300][106225] Updated weights for policy 1, policy_version 1787985 (0.0008) [2023-12-28 08:04:57,354][106225] Updated weights for policy 1, policy_version 1787995 (0.0008) [2023-12-28 08:04:57,579][106226] Updated weights for policy 0, policy_version 1783791 (0.0011) [2023-12-28 08:04:57,635][106226] Updated weights for policy 0, policy_version 1783801 (0.0010) [2023-12-28 08:04:57,702][106226] Updated weights for policy 0, policy_version 1783811 (0.0011) [2023-12-28 08:04:58,075][106225] Updated weights for policy 1, policy_version 1788005 (0.0008) [2023-12-28 08:04:58,137][106225] Updated weights for policy 1, policy_version 1788015 (0.0008) [2023-12-28 08:04:58,196][106225] Updated weights for policy 1, policy_version 1788025 (0.0007) [2023-12-28 08:04:58,422][106226] Updated weights for policy 0, policy_version 1783821 (0.0011) [2023-12-28 08:04:58,486][106226] Updated weights for policy 0, policy_version 1783831 (0.0010) [2023-12-28 08:04:58,551][106226] Updated weights for policy 0, policy_version 1783841 (0.0011) [2023-12-28 08:04:59,066][106225] Updated weights for policy 1, policy_version 1788035 (0.0009) [2023-12-28 08:04:59,132][106225] Updated weights for policy 1, policy_version 1788045 (0.0006) [2023-12-28 08:04:59,202][106225] Updated weights for policy 1, policy_version 1788055 (0.0006) [2023-12-28 08:04:59,408][106226] Updated weights for policy 0, policy_version 1783851 (0.0010) [2023-12-28 08:04:59,471][106226] Updated weights for policy 0, policy_version 1783861 (0.0008) [2023-12-28 08:04:59,533][106226] Updated weights for policy 0, policy_version 1783871 (0.0008) [2023-12-28 08:04:59,906][106225] Updated weights for policy 1, policy_version 1788065 (0.0012) [2023-12-28 08:04:59,967][106225] Updated weights for policy 1, policy_version 1788075 (0.0009) [2023-12-28 08:05:00,020][106225] Updated weights for policy 1, policy_version 1788085 (0.0010) [2023-12-28 08:05:00,073][106225] Updated weights for policy 1, policy_version 1788095 (0.0010) [2023-12-28 08:05:00,202][106226] Updated weights for policy 0, policy_version 1783881 (0.0008) [2023-12-28 08:05:00,260][106226] Updated weights for policy 0, policy_version 1783891 (0.0008) [2023-12-28 08:05:00,317][106226] Updated weights for policy 0, policy_version 1783901 (0.0008) [2023-12-28 08:05:00,367][106226] Updated weights for policy 0, policy_version 1783911 (0.0008) [2023-12-28 08:05:00,743][106225] Updated weights for policy 1, policy_version 1788105 (0.0010) [2023-12-28 08:05:00,797][106225] Updated weights for policy 1, policy_version 1788115 (0.0008) [2023-12-28 08:05:00,848][106225] Updated weights for policy 1, policy_version 1788125 (0.0007) [2023-12-28 08:05:01,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19438.6). Total num frames: 914579456. Throughput: 0: 10051.9, 1: 9776.8. Samples: 914572220. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:01,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-5.095')] [2023-12-28 08:05:01,217][106226] Updated weights for policy 0, policy_version 1783921 (0.0008) [2023-12-28 08:05:01,283][106226] Updated weights for policy 0, policy_version 1783931 (0.0008) [2023-12-28 08:05:01,353][106226] Updated weights for policy 0, policy_version 1783941 (0.0007) [2023-12-28 08:05:01,540][106225] Updated weights for policy 1, policy_version 1788135 (0.0009) [2023-12-28 08:05:01,591][106225] Updated weights for policy 1, policy_version 1788145 (0.0009) [2023-12-28 08:05:01,659][106225] Updated weights for policy 1, policy_version 1788155 (0.0008) [2023-12-28 08:05:02,072][106226] Updated weights for policy 0, policy_version 1783951 (0.0008) [2023-12-28 08:05:02,134][106226] Updated weights for policy 0, policy_version 1783961 (0.0008) [2023-12-28 08:05:02,189][106226] Updated weights for policy 0, policy_version 1783971 (0.0008) [2023-12-28 08:05:02,380][106225] Updated weights for policy 1, policy_version 1788165 (0.0007) [2023-12-28 08:05:02,449][106225] Updated weights for policy 1, policy_version 1788175 (0.0010) [2023-12-28 08:05:02,517][106225] Updated weights for policy 1, policy_version 1788185 (0.0009) [2023-12-28 08:05:02,839][106226] Updated weights for policy 0, policy_version 1783981 (0.0007) [2023-12-28 08:05:02,894][106226] Updated weights for policy 0, policy_version 1783991 (0.0006) [2023-12-28 08:05:02,958][106226] Updated weights for policy 0, policy_version 1784001 (0.0005) [2023-12-28 08:05:03,190][106225] Updated weights for policy 1, policy_version 1788195 (0.0010) [2023-12-28 08:05:03,234][106225] Updated weights for policy 1, policy_version 1788205 (0.0007) [2023-12-28 08:05:03,282][106225] Updated weights for policy 1, policy_version 1788215 (0.0008) [2023-12-28 08:05:03,605][106226] Updated weights for policy 0, policy_version 1784011 (0.0007) [2023-12-28 08:05:03,665][106226] Updated weights for policy 0, policy_version 1784021 (0.0008) [2023-12-28 08:05:03,729][106226] Updated weights for policy 0, policy_version 1784031 (0.0008) [2023-12-28 08:05:03,997][106225] Updated weights for policy 1, policy_version 1788225 (0.0008) [2023-12-28 08:05:04,052][106225] Updated weights for policy 1, policy_version 1788235 (0.0008) [2023-12-28 08:05:04,118][106225] Updated weights for policy 1, policy_version 1788245 (0.0008) [2023-12-28 08:05:04,166][106225] Updated weights for policy 1, policy_version 1788255 (0.0009) [2023-12-28 08:05:04,507][106226] Updated weights for policy 0, policy_version 1784041 (0.0010) [2023-12-28 08:05:04,563][106226] Updated weights for policy 0, policy_version 1784051 (0.0009) [2023-12-28 08:05:04,621][106226] Updated weights for policy 0, policy_version 1784061 (0.0008) [2023-12-28 08:05:04,678][106226] Updated weights for policy 0, policy_version 1784071 (0.0009) [2023-12-28 08:05:04,838][106225] Updated weights for policy 1, policy_version 1788265 (0.0008) [2023-12-28 08:05:04,886][106225] Updated weights for policy 1, policy_version 1788275 (0.0008) [2023-12-28 08:05:04,933][106225] Updated weights for policy 1, policy_version 1788285 (0.0008) [2023-12-28 08:05:05,317][106226] Updated weights for policy 0, policy_version 1784081 (0.0008) [2023-12-28 08:05:05,370][106226] Updated weights for policy 0, policy_version 1784091 (0.0009) [2023-12-28 08:05:05,422][106226] Updated weights for policy 0, policy_version 1784101 (0.0010) [2023-12-28 08:05:05,671][106225] Updated weights for policy 1, policy_version 1788295 (0.0008) [2023-12-28 08:05:05,732][106225] Updated weights for policy 1, policy_version 1788305 (0.0008) [2023-12-28 08:05:05,786][106225] Updated weights for policy 1, policy_version 1788315 (0.0008) [2023-12-28 08:05:06,149][106226] Updated weights for policy 0, policy_version 1784113 (0.0009) [2023-12-28 08:05:06,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19438.6). Total num frames: 914677760. Throughput: 0: 9958.7, 1: 9768.9. Samples: 914690340. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:06,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.993')] [2023-12-28 08:05:06,205][106226] Updated weights for policy 0, policy_version 1784123 (0.0009) [2023-12-28 08:05:06,274][106226] Updated weights for policy 0, policy_version 1784133 (0.0007) [2023-12-28 08:05:06,539][106225] Updated weights for policy 1, policy_version 1788325 (0.0006) [2023-12-28 08:05:06,607][106225] Updated weights for policy 1, policy_version 1788335 (0.0007) [2023-12-28 08:05:06,669][106225] Updated weights for policy 1, policy_version 1788345 (0.0008) [2023-12-28 08:05:06,877][106226] Updated weights for policy 0, policy_version 1784143 (0.0007) [2023-12-28 08:05:06,931][106226] Updated weights for policy 0, policy_version 1784153 (0.0008) [2023-12-28 08:05:06,992][106226] Updated weights for policy 0, policy_version 1784163 (0.0007) [2023-12-28 08:05:07,361][106225] Updated weights for policy 1, policy_version 1788355 (0.0007) [2023-12-28 08:05:07,419][106225] Updated weights for policy 1, policy_version 1788365 (0.0008) [2023-12-28 08:05:07,481][106225] Updated weights for policy 1, policy_version 1788375 (0.0006) [2023-12-28 08:05:07,678][106226] Updated weights for policy 0, policy_version 1784173 (0.0007) [2023-12-28 08:05:07,729][106226] Updated weights for policy 0, policy_version 1784183 (0.0006) [2023-12-28 08:05:07,787][106226] Updated weights for policy 0, policy_version 1784193 (0.0009) [2023-12-28 08:05:08,198][106225] Updated weights for policy 1, policy_version 1788385 (0.0007) [2023-12-28 08:05:08,244][106225] Updated weights for policy 1, policy_version 1788395 (0.0009) [2023-12-28 08:05:08,292][106225] Updated weights for policy 1, policy_version 1788405 (0.0008) [2023-12-28 08:05:08,352][106225] Updated weights for policy 1, policy_version 1788415 (0.0007) [2023-12-28 08:05:08,451][106226] Updated weights for policy 0, policy_version 1784203 (0.0005) [2023-12-28 08:05:08,518][106226] Updated weights for policy 0, policy_version 1784213 (0.0006) [2023-12-28 08:05:08,586][106226] Updated weights for policy 0, policy_version 1784223 (0.0006) [2023-12-28 08:05:09,130][106225] Updated weights for policy 1, policy_version 1788425 (0.0005) [2023-12-28 08:05:09,191][106225] Updated weights for policy 1, policy_version 1788435 (0.0005) [2023-12-28 08:05:09,259][106225] Updated weights for policy 1, policy_version 1788445 (0.0007) [2023-12-28 08:05:09,293][106226] Updated weights for policy 0, policy_version 1784233 (0.0008) [2023-12-28 08:05:09,364][106226] Updated weights for policy 0, policy_version 1784243 (0.0007) [2023-12-28 08:05:09,438][106226] Updated weights for policy 0, policy_version 1784253 (0.0009) [2023-12-28 08:05:09,505][106226] Updated weights for policy 0, policy_version 1784263 (0.0010) [2023-12-28 08:05:09,931][106225] Updated weights for policy 1, policy_version 1788455 (0.0008) [2023-12-28 08:05:09,996][106225] Updated weights for policy 1, policy_version 1788465 (0.0008) [2023-12-28 08:05:10,053][106225] Updated weights for policy 1, policy_version 1788475 (0.0009) [2023-12-28 08:05:10,199][106226] Updated weights for policy 0, policy_version 1784273 (0.0007) [2023-12-28 08:05:10,266][106226] Updated weights for policy 0, policy_version 1784283 (0.0010) [2023-12-28 08:05:10,321][106226] Updated weights for policy 0, policy_version 1784293 (0.0008) [2023-12-28 08:05:10,763][106225] Updated weights for policy 1, policy_version 1788485 (0.0008) [2023-12-28 08:05:10,810][106225] Updated weights for policy 1, policy_version 1788495 (0.0006) [2023-12-28 08:05:10,869][106225] Updated weights for policy 1, policy_version 1788505 (0.0006) [2023-12-28 08:05:10,970][106226] Updated weights for policy 0, policy_version 1784303 (0.0011) [2023-12-28 08:05:11,035][106226] Updated weights for policy 0, policy_version 1784313 (0.0010) [2023-12-28 08:05:11,096][106226] Updated weights for policy 0, policy_version 1784323 (0.0011) [2023-12-28 08:05:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19466.4). Total num frames: 914784256. Throughput: 0: 10029.6, 1: 9778.7. Samples: 914749680. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:11,175][105115] Avg episode reward: [(0, '-4.510'), (1, '-4.818')] [2023-12-28 08:05:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001788512_457916416.pth... [2023-12-28 08:05:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001784328_456867840.pth... [2023-12-28 08:05:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001787360_457621504.pth [2023-12-28 08:05:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001783144_456564736.pth [2023-12-28 08:05:11,610][106225] Updated weights for policy 1, policy_version 1788515 (0.0007) [2023-12-28 08:05:11,681][106225] Updated weights for policy 1, policy_version 1788525 (0.0006) [2023-12-28 08:05:11,747][106225] Updated weights for policy 1, policy_version 1788535 (0.0008) [2023-12-28 08:05:11,912][106226] Updated weights for policy 0, policy_version 1784333 (0.0010) [2023-12-28 08:05:11,977][106226] Updated weights for policy 0, policy_version 1784343 (0.0008) [2023-12-28 08:05:12,039][106226] Updated weights for policy 0, policy_version 1784353 (0.0008) [2023-12-28 08:05:12,421][106225] Updated weights for policy 1, policy_version 1788545 (0.0007) [2023-12-28 08:05:12,472][106225] Updated weights for policy 1, policy_version 1788555 (0.0008) [2023-12-28 08:05:12,518][106225] Updated weights for policy 1, policy_version 1788565 (0.0008) [2023-12-28 08:05:12,567][106225] Updated weights for policy 1, policy_version 1788575 (0.0008) [2023-12-28 08:05:12,797][106226] Updated weights for policy 0, policy_version 1784363 (0.0008) [2023-12-28 08:05:12,853][106226] Updated weights for policy 0, policy_version 1784373 (0.0009) [2023-12-28 08:05:12,905][106226] Updated weights for policy 0, policy_version 1784383 (0.0009) [2023-12-28 08:05:13,184][106225] Updated weights for policy 1, policy_version 1788585 (0.0010) [2023-12-28 08:05:13,242][106225] Updated weights for policy 1, policy_version 1788595 (0.0009) [2023-12-28 08:05:13,298][106225] Updated weights for policy 1, policy_version 1788605 (0.0010) [2023-12-28 08:05:13,699][106226] Updated weights for policy 0, policy_version 1784393 (0.0009) [2023-12-28 08:05:13,760][106226] Updated weights for policy 0, policy_version 1784403 (0.0008) [2023-12-28 08:05:13,816][106226] Updated weights for policy 0, policy_version 1784413 (0.0009) [2023-12-28 08:05:13,872][106226] Updated weights for policy 0, policy_version 1784423 (0.0009) [2023-12-28 08:05:13,941][106225] Updated weights for policy 1, policy_version 1788615 (0.0007) [2023-12-28 08:05:14,004][106225] Updated weights for policy 1, policy_version 1788625 (0.0005) [2023-12-28 08:05:14,075][106225] Updated weights for policy 1, policy_version 1788635 (0.0006) [2023-12-28 08:05:14,539][106226] Updated weights for policy 0, policy_version 1784433 (0.0010) [2023-12-28 08:05:14,600][106226] Updated weights for policy 0, policy_version 1784443 (0.0011) [2023-12-28 08:05:14,656][106226] Updated weights for policy 0, policy_version 1784453 (0.0011) [2023-12-28 08:05:14,693][106225] Updated weights for policy 1, policy_version 1788645 (0.0008) [2023-12-28 08:05:14,745][106225] Updated weights for policy 1, policy_version 1788655 (0.0008) [2023-12-28 08:05:14,816][106225] Updated weights for policy 1, policy_version 1788665 (0.0009) [2023-12-28 08:05:15,376][106226] Updated weights for policy 0, policy_version 1784463 (0.0008) [2023-12-28 08:05:15,437][106226] Updated weights for policy 0, policy_version 1784473 (0.0008) [2023-12-28 08:05:15,499][106226] Updated weights for policy 0, policy_version 1784483 (0.0010) [2023-12-28 08:05:15,555][106225] Updated weights for policy 1, policy_version 1788675 (0.0007) [2023-12-28 08:05:15,609][106225] Updated weights for policy 1, policy_version 1788685 (0.0007) [2023-12-28 08:05:15,660][106225] Updated weights for policy 1, policy_version 1788695 (0.0008) [2023-12-28 08:05:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19466.4). Total num frames: 914874368. Throughput: 0: 9966.8, 1: 9848.8. Samples: 914868616. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:16,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.944')] [2023-12-28 08:05:16,213][106226] Updated weights for policy 0, policy_version 1784493 (0.0011) [2023-12-28 08:05:16,280][106226] Updated weights for policy 0, policy_version 1784503 (0.0011) [2023-12-28 08:05:16,346][106226] Updated weights for policy 0, policy_version 1784513 (0.0011) [2023-12-28 08:05:16,400][106225] Updated weights for policy 1, policy_version 1788705 (0.0007) [2023-12-28 08:05:16,467][106225] Updated weights for policy 1, policy_version 1788715 (0.0008) [2023-12-28 08:05:16,516][106225] Updated weights for policy 1, policy_version 1788725 (0.0007) [2023-12-28 08:05:16,570][106225] Updated weights for policy 1, policy_version 1788735 (0.0008) [2023-12-28 08:05:17,054][106226] Updated weights for policy 0, policy_version 1784523 (0.0010) [2023-12-28 08:05:17,111][106226] Updated weights for policy 0, policy_version 1784533 (0.0006) [2023-12-28 08:05:17,177][106226] Updated weights for policy 0, policy_version 1784544 (0.0006) [2023-12-28 08:05:17,340][106225] Updated weights for policy 1, policy_version 1788745 (0.0008) [2023-12-28 08:05:17,391][106225] Updated weights for policy 1, policy_version 1788755 (0.0008) [2023-12-28 08:05:17,450][106225] Updated weights for policy 1, policy_version 1788765 (0.0008) [2023-12-28 08:05:17,832][106226] Updated weights for policy 0, policy_version 1784554 (0.0005) [2023-12-28 08:05:17,891][106226] Updated weights for policy 0, policy_version 1784564 (0.0005) [2023-12-28 08:05:17,948][106226] Updated weights for policy 0, policy_version 1784574 (0.0006) [2023-12-28 08:05:18,007][106226] Updated weights for policy 0, policy_version 1784584 (0.0005) [2023-12-28 08:05:18,240][106225] Updated weights for policy 1, policy_version 1788775 (0.0008) [2023-12-28 08:05:18,288][106225] Updated weights for policy 1, policy_version 1788785 (0.0008) [2023-12-28 08:05:18,344][106225] Updated weights for policy 1, policy_version 1788795 (0.0009) [2023-12-28 08:05:18,568][106226] Updated weights for policy 0, policy_version 1784594 (0.0005) [2023-12-28 08:05:18,633][106226] Updated weights for policy 0, policy_version 1784604 (0.0008) [2023-12-28 08:05:18,697][106226] Updated weights for policy 0, policy_version 1784614 (0.0009) [2023-12-28 08:05:19,189][106225] Updated weights for policy 1, policy_version 1788805 (0.0009) [2023-12-28 08:05:19,258][106225] Updated weights for policy 1, policy_version 1788815 (0.0007) [2023-12-28 08:05:19,266][106226] Updated weights for policy 0, policy_version 1784624 (0.0006) [2023-12-28 08:05:19,324][106225] Updated weights for policy 1, policy_version 1788825 (0.0008) [2023-12-28 08:05:19,329][106226] Updated weights for policy 0, policy_version 1784634 (0.0006) [2023-12-28 08:05:19,398][106226] Updated weights for policy 0, policy_version 1784644 (0.0009) [2023-12-28 08:05:20,103][106225] Updated weights for policy 1, policy_version 1788835 (0.0007) [2023-12-28 08:05:20,104][106226] Updated weights for policy 0, policy_version 1784654 (0.0007) [2023-12-28 08:05:20,156][106225] Updated weights for policy 1, policy_version 1788845 (0.0008) [2023-12-28 08:05:20,162][106226] Updated weights for policy 0, policy_version 1784664 (0.0006) [2023-12-28 08:05:20,216][106225] Updated weights for policy 1, policy_version 1788855 (0.0006) [2023-12-28 08:05:20,221][106226] Updated weights for policy 0, policy_version 1784674 (0.0008) [2023-12-28 08:05:20,871][106225] Updated weights for policy 1, policy_version 1788865 (0.0007) [2023-12-28 08:05:20,935][106225] Updated weights for policy 1, policy_version 1788875 (0.0009) [2023-12-28 08:05:20,997][106225] Updated weights for policy 1, policy_version 1788885 (0.0008) [2023-12-28 08:05:21,008][106226] Updated weights for policy 0, policy_version 1784684 (0.0007) [2023-12-28 08:05:21,063][106225] Updated weights for policy 1, policy_version 1788895 (0.0008) [2023-12-28 08:05:21,074][106226] Updated weights for policy 0, policy_version 1784694 (0.0008) [2023-12-28 08:05:21,132][106226] Updated weights for policy 0, policy_version 1784704 (0.0007) [2023-12-28 08:05:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 914972672. Throughput: 0: 9982.6, 1: 9697.9. Samples: 914983764. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:21,175][105115] Avg episode reward: [(0, '-4.551'), (1, '-4.514')] [2023-12-28 08:05:21,821][106225] Updated weights for policy 1, policy_version 1788905 (0.0008) [2023-12-28 08:05:21,882][106225] Updated weights for policy 1, policy_version 1788915 (0.0006) [2023-12-28 08:05:21,932][106226] Updated weights for policy 0, policy_version 1784714 (0.0009) [2023-12-28 08:05:21,943][106225] Updated weights for policy 1, policy_version 1788925 (0.0006) [2023-12-28 08:05:21,998][106226] Updated weights for policy 0, policy_version 1784724 (0.0009) [2023-12-28 08:05:22,059][106226] Updated weights for policy 0, policy_version 1784734 (0.0010) [2023-12-28 08:05:22,124][106226] Updated weights for policy 0, policy_version 1784744 (0.0009) [2023-12-28 08:05:22,616][106225] Updated weights for policy 1, policy_version 1788935 (0.0008) [2023-12-28 08:05:22,676][106225] Updated weights for policy 1, policy_version 1788945 (0.0008) [2023-12-28 08:05:22,733][106225] Updated weights for policy 1, policy_version 1788955 (0.0007) [2023-12-28 08:05:22,906][106226] Updated weights for policy 0, policy_version 1784754 (0.0007) [2023-12-28 08:05:22,965][106226] Updated weights for policy 0, policy_version 1784764 (0.0009) [2023-12-28 08:05:23,020][106226] Updated weights for policy 0, policy_version 1784774 (0.0009) [2023-12-28 08:05:23,361][106225] Updated weights for policy 1, policy_version 1788965 (0.0006) [2023-12-28 08:05:23,407][106225] Updated weights for policy 1, policy_version 1788975 (0.0005) [2023-12-28 08:05:23,456][106225] Updated weights for policy 1, policy_version 1788985 (0.0005) [2023-12-28 08:05:23,681][106226] Updated weights for policy 0, policy_version 1784784 (0.0008) [2023-12-28 08:05:23,734][106226] Updated weights for policy 0, policy_version 1784794 (0.0010) [2023-12-28 08:05:23,784][106226] Updated weights for policy 0, policy_version 1784804 (0.0010) [2023-12-28 08:05:24,019][106225] Updated weights for policy 1, policy_version 1788995 (0.0005) [2023-12-28 08:05:24,086][106225] Updated weights for policy 1, policy_version 1789005 (0.0005) [2023-12-28 08:05:24,150][106225] Updated weights for policy 1, policy_version 1789015 (0.0008) [2023-12-28 08:05:24,441][106226] Updated weights for policy 0, policy_version 1784814 (0.0011) [2023-12-28 08:05:24,495][106226] Updated weights for policy 0, policy_version 1784824 (0.0011) [2023-12-28 08:05:24,545][106226] Updated weights for policy 0, policy_version 1784834 (0.0010) [2023-12-28 08:05:24,779][106225] Updated weights for policy 1, policy_version 1789025 (0.0009) [2023-12-28 08:05:24,840][106225] Updated weights for policy 1, policy_version 1789035 (0.0010) [2023-12-28 08:05:24,904][106225] Updated weights for policy 1, policy_version 1789045 (0.0010) [2023-12-28 08:05:24,964][106225] Updated weights for policy 1, policy_version 1789055 (0.0010) [2023-12-28 08:05:25,238][106226] Updated weights for policy 0, policy_version 1784844 (0.0009) [2023-12-28 08:05:25,284][106226] Updated weights for policy 0, policy_version 1784854 (0.0010) [2023-12-28 08:05:25,333][106226] Updated weights for policy 0, policy_version 1784864 (0.0010) [2023-12-28 08:05:25,590][106225] Updated weights for policy 1, policy_version 1789065 (0.0005) [2023-12-28 08:05:25,650][106225] Updated weights for policy 1, policy_version 1789075 (0.0008) [2023-12-28 08:05:25,699][106225] Updated weights for policy 1, policy_version 1789085 (0.0007) [2023-12-28 08:05:25,959][106226] Updated weights for policy 0, policy_version 1784874 (0.0009) [2023-12-28 08:05:26,005][106226] Updated weights for policy 0, policy_version 1784884 (0.0009) [2023-12-28 08:05:26,052][106226] Updated weights for policy 0, policy_version 1784894 (0.0005) [2023-12-28 08:05:26,113][106226] Updated weights for policy 0, policy_version 1784904 (0.0010) [2023-12-28 08:05:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19466.4). Total num frames: 915079168. Throughput: 0: 9944.9, 1: 9742.8. Samples: 915043496. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:26,175][105115] Avg episode reward: [(0, '-4.590'), (1, '-4.594')] [2023-12-28 08:05:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001784904_457015296.pth... [2023-12-28 08:05:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001789088_458063872.pth... [2023-12-28 08:05:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001783752_456720384.pth [2023-12-28 08:05:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001787936_457768960.pth [2023-12-28 08:05:26,276][106225] Updated weights for policy 1, policy_version 1789095 (0.0010) [2023-12-28 08:05:26,329][106225] Updated weights for policy 1, policy_version 1789105 (0.0010) [2023-12-28 08:05:26,378][106225] Updated weights for policy 1, policy_version 1789115 (0.0010) [2023-12-28 08:05:26,703][106226] Updated weights for policy 0, policy_version 1784914 (0.0005) [2023-12-28 08:05:26,752][106226] Updated weights for policy 0, policy_version 1784924 (0.0005) [2023-12-28 08:05:26,803][106226] Updated weights for policy 0, policy_version 1784934 (0.0005) [2023-12-28 08:05:27,084][106225] Updated weights for policy 1, policy_version 1789125 (0.0011) [2023-12-28 08:05:27,137][106225] Updated weights for policy 1, policy_version 1789135 (0.0010) [2023-12-28 08:05:27,192][106225] Updated weights for policy 1, policy_version 1789145 (0.0009) [2023-12-28 08:05:27,463][106226] Updated weights for policy 0, policy_version 1784944 (0.0005) [2023-12-28 08:05:27,524][106226] Updated weights for policy 0, policy_version 1784954 (0.0007) [2023-12-28 08:05:27,570][106226] Updated weights for policy 0, policy_version 1784964 (0.0010) [2023-12-28 08:05:27,805][106225] Updated weights for policy 1, policy_version 1789155 (0.0006) [2023-12-28 08:05:27,872][106225] Updated weights for policy 1, policy_version 1789165 (0.0007) [2023-12-28 08:05:27,935][106225] Updated weights for policy 1, policy_version 1789175 (0.0006) [2023-12-28 08:05:28,281][106226] Updated weights for policy 0, policy_version 1784974 (0.0010) [2023-12-28 08:05:28,350][106226] Updated weights for policy 0, policy_version 1784984 (0.0011) [2023-12-28 08:05:28,414][106226] Updated weights for policy 0, policy_version 1784994 (0.0011) [2023-12-28 08:05:28,624][106225] Updated weights for policy 1, policy_version 1789185 (0.0010) [2023-12-28 08:05:28,687][106225] Updated weights for policy 1, policy_version 1789195 (0.0010) [2023-12-28 08:05:28,754][106225] Updated weights for policy 1, policy_version 1789205 (0.0010) [2023-12-28 08:05:28,815][106225] Updated weights for policy 1, policy_version 1789215 (0.0010) [2023-12-28 08:05:29,089][106226] Updated weights for policy 0, policy_version 1785004 (0.0011) [2023-12-28 08:05:29,149][106226] Updated weights for policy 0, policy_version 1785014 (0.0010) [2023-12-28 08:05:29,209][106226] Updated weights for policy 0, policy_version 1785024 (0.0010) [2023-12-28 08:05:29,526][106225] Updated weights for policy 1, policy_version 1789225 (0.0010) [2023-12-28 08:05:29,596][106225] Updated weights for policy 1, policy_version 1789235 (0.0010) [2023-12-28 08:05:29,652][106225] Updated weights for policy 1, policy_version 1789245 (0.0007) [2023-12-28 08:05:29,974][106226] Updated weights for policy 0, policy_version 1785034 (0.0010) [2023-12-28 08:05:30,036][106226] Updated weights for policy 0, policy_version 1785044 (0.0011) [2023-12-28 08:05:30,096][106226] Updated weights for policy 0, policy_version 1785054 (0.0011) [2023-12-28 08:05:30,155][106226] Updated weights for policy 0, policy_version 1785064 (0.0010) [2023-12-28 08:05:30,353][106225] Updated weights for policy 1, policy_version 1789255 (0.0006) [2023-12-28 08:05:30,417][106225] Updated weights for policy 1, policy_version 1789265 (0.0006) [2023-12-28 08:05:30,481][106225] Updated weights for policy 1, policy_version 1789275 (0.0007) [2023-12-28 08:05:30,855][106226] Updated weights for policy 0, policy_version 1785074 (0.0007) [2023-12-28 08:05:30,912][106226] Updated weights for policy 0, policy_version 1785084 (0.0005) [2023-12-28 08:05:30,970][106226] Updated weights for policy 0, policy_version 1785094 (0.0005) [2023-12-28 08:05:31,162][106225] Updated weights for policy 1, policy_version 1789285 (0.0010) [2023-12-28 08:05:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 915177472. Throughput: 0: 9942.1, 1: 9862.1. Samples: 915167988. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:31,175][105115] Avg episode reward: [(0, '-4.466'), (1, '-4.899')] [2023-12-28 08:05:31,224][106225] Updated weights for policy 1, policy_version 1789295 (0.0010) [2023-12-28 08:05:31,291][106225] Updated weights for policy 1, policy_version 1789305 (0.0006) [2023-12-28 08:05:31,592][106226] Updated weights for policy 0, policy_version 1785104 (0.0005) [2023-12-28 08:05:31,659][106226] Updated weights for policy 0, policy_version 1785114 (0.0009) [2023-12-28 08:05:31,724][106226] Updated weights for policy 0, policy_version 1785124 (0.0009) [2023-12-28 08:05:32,026][106225] Updated weights for policy 1, policy_version 1789315 (0.0006) [2023-12-28 08:05:32,070][106225] Updated weights for policy 1, policy_version 1789325 (0.0008) [2023-12-28 08:05:32,118][106225] Updated weights for policy 1, policy_version 1789335 (0.0008) [2023-12-28 08:05:32,441][106226] Updated weights for policy 0, policy_version 1785134 (0.0009) [2023-12-28 08:05:32,505][106226] Updated weights for policy 0, policy_version 1785144 (0.0009) [2023-12-28 08:05:32,570][106226] Updated weights for policy 0, policy_version 1785154 (0.0008) [2023-12-28 08:05:32,884][106225] Updated weights for policy 1, policy_version 1789345 (0.0007) [2023-12-28 08:05:32,946][106225] Updated weights for policy 1, policy_version 1789355 (0.0008) [2023-12-28 08:05:33,006][106225] Updated weights for policy 1, policy_version 1789365 (0.0008) [2023-12-28 08:05:33,063][106225] Updated weights for policy 1, policy_version 1789375 (0.0008) [2023-12-28 08:05:33,299][106226] Updated weights for policy 0, policy_version 1785164 (0.0009) [2023-12-28 08:05:33,360][106226] Updated weights for policy 0, policy_version 1785174 (0.0009) [2023-12-28 08:05:33,413][106226] Updated weights for policy 0, policy_version 1785184 (0.0009) [2023-12-28 08:05:33,663][106225] Updated weights for policy 1, policy_version 1789385 (0.0006) [2023-12-28 08:05:33,725][106225] Updated weights for policy 1, policy_version 1789395 (0.0006) [2023-12-28 08:05:33,782][106225] Updated weights for policy 1, policy_version 1789405 (0.0009) [2023-12-28 08:05:34,009][106226] Updated weights for policy 0, policy_version 1785194 (0.0006) [2023-12-28 08:05:34,066][106226] Updated weights for policy 0, policy_version 1785204 (0.0005) [2023-12-28 08:05:34,117][106226] Updated weights for policy 0, policy_version 1785214 (0.0007) [2023-12-28 08:05:34,534][106225] Updated weights for policy 1, policy_version 1789415 (0.0007) [2023-12-28 08:05:34,594][106225] Updated weights for policy 1, policy_version 1789425 (0.0008) [2023-12-28 08:05:34,650][106225] Updated weights for policy 1, policy_version 1789435 (0.0008) [2023-12-28 08:05:34,775][106226] Updated weights for policy 0, policy_version 1785226 (0.0008) [2023-12-28 08:05:34,821][106226] Updated weights for policy 0, policy_version 1785236 (0.0008) [2023-12-28 08:05:34,873][106226] Updated weights for policy 0, policy_version 1785246 (0.0008) [2023-12-28 08:05:34,929][106226] Updated weights for policy 0, policy_version 1785256 (0.0009) [2023-12-28 08:05:35,383][106225] Updated weights for policy 1, policy_version 1789445 (0.0007) [2023-12-28 08:05:35,439][106225] Updated weights for policy 1, policy_version 1789455 (0.0009) [2023-12-28 08:05:35,498][106225] Updated weights for policy 1, policy_version 1789465 (0.0009) [2023-12-28 08:05:35,675][106226] Updated weights for policy 0, policy_version 1785266 (0.0010) [2023-12-28 08:05:35,740][106226] Updated weights for policy 0, policy_version 1785276 (0.0009) [2023-12-28 08:05:35,802][106226] Updated weights for policy 0, policy_version 1785286 (0.0009) [2023-12-28 08:05:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 915275776. Throughput: 0: 9850.2, 1: 9843.9. Samples: 915286904. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:36,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.653')] [2023-12-28 08:05:36,231][106225] Updated weights for policy 1, policy_version 1789475 (0.0008) [2023-12-28 08:05:36,284][106225] Updated weights for policy 1, policy_version 1789485 (0.0009) [2023-12-28 08:05:36,343][106225] Updated weights for policy 1, policy_version 1789495 (0.0008) [2023-12-28 08:05:36,541][106226] Updated weights for policy 0, policy_version 1785296 (0.0009) [2023-12-28 08:05:36,599][106226] Updated weights for policy 0, policy_version 1785306 (0.0010) [2023-12-28 08:05:36,657][106226] Updated weights for policy 0, policy_version 1785316 (0.0008) [2023-12-28 08:05:37,033][106225] Updated weights for policy 1, policy_version 1789505 (0.0008) [2023-12-28 08:05:37,085][106225] Updated weights for policy 1, policy_version 1789515 (0.0010) [2023-12-28 08:05:37,132][106225] Updated weights for policy 1, policy_version 1789525 (0.0010) [2023-12-28 08:05:37,183][106225] Updated weights for policy 1, policy_version 1789535 (0.0010) [2023-12-28 08:05:37,426][106226] Updated weights for policy 0, policy_version 1785326 (0.0006) [2023-12-28 08:05:37,494][106226] Updated weights for policy 0, policy_version 1785336 (0.0006) [2023-12-28 08:05:37,548][106226] Updated weights for policy 0, policy_version 1785346 (0.0006) [2023-12-28 08:05:37,842][106225] Updated weights for policy 1, policy_version 1789545 (0.0007) [2023-12-28 08:05:37,894][106225] Updated weights for policy 1, policy_version 1789555 (0.0006) [2023-12-28 08:05:37,961][106225] Updated weights for policy 1, policy_version 1789565 (0.0008) [2023-12-28 08:05:38,124][106226] Updated weights for policy 0, policy_version 1785356 (0.0005) [2023-12-28 08:05:38,187][106226] Updated weights for policy 0, policy_version 1785366 (0.0005) [2023-12-28 08:05:38,245][106226] Updated weights for policy 0, policy_version 1785376 (0.0005) [2023-12-28 08:05:38,666][106225] Updated weights for policy 1, policy_version 1789575 (0.0009) [2023-12-28 08:05:38,713][106225] Updated weights for policy 1, policy_version 1789585 (0.0007) [2023-12-28 08:05:38,760][106225] Updated weights for policy 1, policy_version 1789595 (0.0005) [2023-12-28 08:05:38,937][106226] Updated weights for policy 0, policy_version 1785386 (0.0006) [2023-12-28 08:05:38,987][106226] Updated weights for policy 0, policy_version 1785396 (0.0008) [2023-12-28 08:05:39,037][106226] Updated weights for policy 0, policy_version 1785406 (0.0009) [2023-12-28 08:05:39,104][106226] Updated weights for policy 0, policy_version 1785416 (0.0008) [2023-12-28 08:05:39,474][106225] Updated weights for policy 1, policy_version 1789605 (0.0008) [2023-12-28 08:05:39,544][106225] Updated weights for policy 1, policy_version 1789615 (0.0009) [2023-12-28 08:05:39,608][106225] Updated weights for policy 1, policy_version 1789625 (0.0007) [2023-12-28 08:05:39,985][106226] Updated weights for policy 0, policy_version 1785426 (0.0008) [2023-12-28 08:05:40,045][106226] Updated weights for policy 0, policy_version 1785436 (0.0008) [2023-12-28 08:05:40,106][106226] Updated weights for policy 0, policy_version 1785446 (0.0009) [2023-12-28 08:05:40,302][106225] Updated weights for policy 1, policy_version 1789635 (0.0006) [2023-12-28 08:05:40,369][106225] Updated weights for policy 1, policy_version 1789645 (0.0007) [2023-12-28 08:05:40,438][106225] Updated weights for policy 1, policy_version 1789655 (0.0009) [2023-12-28 08:05:40,806][106226] Updated weights for policy 0, policy_version 1785456 (0.0009) [2023-12-28 08:05:40,855][106226] Updated weights for policy 0, policy_version 1785466 (0.0009) [2023-12-28 08:05:40,905][106226] Updated weights for policy 0, policy_version 1785476 (0.0009) [2023-12-28 08:05:41,167][106225] Updated weights for policy 1, policy_version 1789665 (0.0009) [2023-12-28 08:05:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 915374080. Throughput: 0: 9872.1, 1: 9887.9. Samples: 915346788. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:41,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.883')] [2023-12-28 08:05:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001785480_457162752.pth... [2023-12-28 08:05:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001784328_456867840.pth [2023-12-28 08:05:41,231][106225] Updated weights for policy 1, policy_version 1789675 (0.0008) [2023-12-28 08:05:41,299][106225] Updated weights for policy 1, policy_version 1789685 (0.0008) [2023-12-28 08:05:41,370][106225] Updated weights for policy 1, policy_version 1789695 (0.0008) [2023-12-28 08:05:41,373][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001789696_458219520.pth... [2023-12-28 08:05:41,378][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001788512_457916416.pth [2023-12-28 08:05:41,732][106226] Updated weights for policy 0, policy_version 1785486 (0.0009) [2023-12-28 08:05:41,788][106226] Updated weights for policy 0, policy_version 1785496 (0.0008) [2023-12-28 08:05:41,847][106226] Updated weights for policy 0, policy_version 1785506 (0.0008) [2023-12-28 08:05:42,140][106225] Updated weights for policy 1, policy_version 1789705 (0.0007) [2023-12-28 08:05:42,196][106225] Updated weights for policy 1, policy_version 1789715 (0.0008) [2023-12-28 08:05:42,257][106225] Updated weights for policy 1, policy_version 1789725 (0.0006) [2023-12-28 08:05:42,638][106226] Updated weights for policy 0, policy_version 1785516 (0.0008) [2023-12-28 08:05:42,697][106226] Updated weights for policy 0, policy_version 1785526 (0.0009) [2023-12-28 08:05:42,765][106226] Updated weights for policy 0, policy_version 1785536 (0.0008) [2023-12-28 08:05:42,997][106225] Updated weights for policy 1, policy_version 1789735 (0.0008) [2023-12-28 08:05:43,053][106225] Updated weights for policy 1, policy_version 1789745 (0.0008) [2023-12-28 08:05:43,108][106225] Updated weights for policy 1, policy_version 1789755 (0.0008) [2023-12-28 08:05:43,392][106226] Updated weights for policy 0, policy_version 1785546 (0.0009) [2023-12-28 08:05:43,451][106226] Updated weights for policy 0, policy_version 1785556 (0.0011) [2023-12-28 08:05:43,501][106226] Updated weights for policy 0, policy_version 1785566 (0.0010) [2023-12-28 08:05:43,560][106226] Updated weights for policy 0, policy_version 1785576 (0.0011) [2023-12-28 08:05:43,870][106225] Updated weights for policy 1, policy_version 1789765 (0.0009) [2023-12-28 08:05:43,920][106225] Updated weights for policy 1, policy_version 1789775 (0.0007) [2023-12-28 08:05:43,970][106225] Updated weights for policy 1, policy_version 1789785 (0.0009) [2023-12-28 08:05:44,196][106226] Updated weights for policy 0, policy_version 1785586 (0.0008) [2023-12-28 08:05:44,249][106226] Updated weights for policy 0, policy_version 1785596 (0.0009) [2023-12-28 08:05:44,306][106226] Updated weights for policy 0, policy_version 1785606 (0.0009) [2023-12-28 08:05:44,798][106225] Updated weights for policy 1, policy_version 1789795 (0.0008) [2023-12-28 08:05:44,851][106225] Updated weights for policy 1, policy_version 1789805 (0.0008) [2023-12-28 08:05:44,898][106225] Updated weights for policy 1, policy_version 1789815 (0.0008) [2023-12-28 08:05:44,927][106226] Updated weights for policy 0, policy_version 1785616 (0.0010) [2023-12-28 08:05:44,987][106226] Updated weights for policy 0, policy_version 1785626 (0.0008) [2023-12-28 08:05:45,040][106226] Updated weights for policy 0, policy_version 1785636 (0.0009) [2023-12-28 08:05:45,607][106225] Updated weights for policy 1, policy_version 1789825 (0.0009) [2023-12-28 08:05:45,671][106225] Updated weights for policy 1, policy_version 1789835 (0.0009) [2023-12-28 08:05:45,724][106225] Updated weights for policy 1, policy_version 1789845 (0.0007) [2023-12-28 08:05:45,738][106226] Updated weights for policy 0, policy_version 1785646 (0.0008) [2023-12-28 08:05:45,784][106225] Updated weights for policy 1, policy_version 1789855 (0.0007) [2023-12-28 08:05:45,790][106226] Updated weights for policy 0, policy_version 1785656 (0.0007) [2023-12-28 08:05:45,845][106226] Updated weights for policy 0, policy_version 1785666 (0.0008) [2023-12-28 08:05:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 915472384. Throughput: 0: 9903.6, 1: 9849.4. Samples: 915461108. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:46,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.825')] [2023-12-28 08:05:46,446][106226] Updated weights for policy 0, policy_version 1785676 (0.0008) [2023-12-28 08:05:46,494][106226] Updated weights for policy 0, policy_version 1785686 (0.0008) [2023-12-28 08:05:46,544][106226] Updated weights for policy 0, policy_version 1785696 (0.0006) [2023-12-28 08:05:46,550][106225] Updated weights for policy 1, policy_version 1789865 (0.0006) [2023-12-28 08:05:46,598][106225] Updated weights for policy 1, policy_version 1789875 (0.0006) [2023-12-28 08:05:46,652][106225] Updated weights for policy 1, policy_version 1789885 (0.0008) [2023-12-28 08:05:47,210][106226] Updated weights for policy 0, policy_version 1785706 (0.0008) [2023-12-28 08:05:47,275][106226] Updated weights for policy 0, policy_version 1785716 (0.0008) [2023-12-28 08:05:47,340][106226] Updated weights for policy 0, policy_version 1785726 (0.0008) [2023-12-28 08:05:47,401][106226] Updated weights for policy 0, policy_version 1785736 (0.0008) [2023-12-28 08:05:47,418][106225] Updated weights for policy 1, policy_version 1789895 (0.0007) [2023-12-28 08:05:47,478][106225] Updated weights for policy 1, policy_version 1789905 (0.0008) [2023-12-28 08:05:47,531][106225] Updated weights for policy 1, policy_version 1789915 (0.0008) [2023-12-28 08:05:48,111][106226] Updated weights for policy 0, policy_version 1785746 (0.0010) [2023-12-28 08:05:48,176][106226] Updated weights for policy 0, policy_version 1785756 (0.0010) [2023-12-28 08:05:48,220][106225] Updated weights for policy 1, policy_version 1789925 (0.0007) [2023-12-28 08:05:48,233][106226] Updated weights for policy 0, policy_version 1785766 (0.0010) [2023-12-28 08:05:48,269][106225] Updated weights for policy 1, policy_version 1789935 (0.0006) [2023-12-28 08:05:48,317][106225] Updated weights for policy 1, policy_version 1789945 (0.0008) [2023-12-28 08:05:48,945][106226] Updated weights for policy 0, policy_version 1785777 (0.0009) [2023-12-28 08:05:49,001][106226] Updated weights for policy 0, policy_version 1785787 (0.0010) [2023-12-28 08:05:49,054][106226] Updated weights for policy 0, policy_version 1785797 (0.0010) [2023-12-28 08:05:49,104][106225] Updated weights for policy 1, policy_version 1789955 (0.0008) [2023-12-28 08:05:49,150][106225] Updated weights for policy 1, policy_version 1789965 (0.0007) [2023-12-28 08:05:49,199][106225] Updated weights for policy 1, policy_version 1789975 (0.0007) [2023-12-28 08:05:49,804][106226] Updated weights for policy 0, policy_version 1785807 (0.0009) [2023-12-28 08:05:49,878][106226] Updated weights for policy 0, policy_version 1785817 (0.0009) [2023-12-28 08:05:49,945][106226] Updated weights for policy 0, policy_version 1785827 (0.0011) [2023-12-28 08:05:49,979][106225] Updated weights for policy 1, policy_version 1789985 (0.0008) [2023-12-28 08:05:50,038][106225] Updated weights for policy 1, policy_version 1789995 (0.0007) [2023-12-28 08:05:50,097][106225] Updated weights for policy 1, policy_version 1790005 (0.0007) [2023-12-28 08:05:50,161][106225] Updated weights for policy 1, policy_version 1790015 (0.0005) [2023-12-28 08:05:50,640][106226] Updated weights for policy 0, policy_version 1785837 (0.0009) [2023-12-28 08:05:50,701][106226] Updated weights for policy 0, policy_version 1785847 (0.0010) [2023-12-28 08:05:50,761][106226] Updated weights for policy 0, policy_version 1785857 (0.0011) [2023-12-28 08:05:50,861][106225] Updated weights for policy 1, policy_version 1790025 (0.0008) [2023-12-28 08:05:50,919][106225] Updated weights for policy 1, policy_version 1790035 (0.0008) [2023-12-28 08:05:50,981][106225] Updated weights for policy 1, policy_version 1790045 (0.0008) [2023-12-28 08:05:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 915570688. Throughput: 0: 9933.0, 1: 9791.8. Samples: 915577952. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:51,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.921')] [2023-12-28 08:05:51,476][106226] Updated weights for policy 0, policy_version 1785867 (0.0010) [2023-12-28 08:05:51,546][106226] Updated weights for policy 0, policy_version 1785877 (0.0009) [2023-12-28 08:05:51,610][106226] Updated weights for policy 0, policy_version 1785887 (0.0009) [2023-12-28 08:05:51,747][106225] Updated weights for policy 1, policy_version 1790055 (0.0009) [2023-12-28 08:05:51,822][106225] Updated weights for policy 1, policy_version 1790065 (0.0009) [2023-12-28 08:05:51,893][106225] Updated weights for policy 1, policy_version 1790075 (0.0008) [2023-12-28 08:05:52,307][106226] Updated weights for policy 0, policy_version 1785897 (0.0008) [2023-12-28 08:05:52,372][106226] Updated weights for policy 0, policy_version 1785907 (0.0007) [2023-12-28 08:05:52,442][106226] Updated weights for policy 0, policy_version 1785917 (0.0009) [2023-12-28 08:05:52,503][106226] Updated weights for policy 0, policy_version 1785927 (0.0007) [2023-12-28 08:05:52,545][106225] Updated weights for policy 1, policy_version 1790085 (0.0008) [2023-12-28 08:05:52,601][106225] Updated weights for policy 1, policy_version 1790095 (0.0008) [2023-12-28 08:05:52,653][106225] Updated weights for policy 1, policy_version 1790105 (0.0008) [2023-12-28 08:05:53,202][106226] Updated weights for policy 0, policy_version 1785937 (0.0005) [2023-12-28 08:05:53,260][106226] Updated weights for policy 0, policy_version 1785947 (0.0005) [2023-12-28 08:05:53,322][106226] Updated weights for policy 0, policy_version 1785957 (0.0005) [2023-12-28 08:05:53,444][106225] Updated weights for policy 1, policy_version 1790115 (0.0009) [2023-12-28 08:05:53,498][106225] Updated weights for policy 1, policy_version 1790125 (0.0008) [2023-12-28 08:05:53,559][106225] Updated weights for policy 1, policy_version 1790135 (0.0005) [2023-12-28 08:05:54,015][106226] Updated weights for policy 0, policy_version 1785967 (0.0008) [2023-12-28 08:05:54,066][106226] Updated weights for policy 0, policy_version 1785977 (0.0010) [2023-12-28 08:05:54,094][106225] Updated weights for policy 1, policy_version 1790145 (0.0005) [2023-12-28 08:05:54,116][106226] Updated weights for policy 0, policy_version 1785987 (0.0010) [2023-12-28 08:05:54,149][106225] Updated weights for policy 1, policy_version 1790155 (0.0006) [2023-12-28 08:05:54,203][106225] Updated weights for policy 1, policy_version 1790165 (0.0006) [2023-12-28 08:05:54,257][106225] Updated weights for policy 1, policy_version 1790175 (0.0005) [2023-12-28 08:05:54,816][106226] Updated weights for policy 0, policy_version 1785997 (0.0008) [2023-12-28 08:05:54,870][106226] Updated weights for policy 0, policy_version 1786007 (0.0008) [2023-12-28 08:05:54,882][106225] Updated weights for policy 1, policy_version 1790185 (0.0005) [2023-12-28 08:05:54,916][106226] Updated weights for policy 0, policy_version 1786017 (0.0010) [2023-12-28 08:05:54,938][106225] Updated weights for policy 1, policy_version 1790195 (0.0005) [2023-12-28 08:05:55,002][106225] Updated weights for policy 1, policy_version 1790205 (0.0007) [2023-12-28 08:05:55,525][106225] Updated weights for policy 1, policy_version 1790215 (0.0007) [2023-12-28 08:05:55,574][106225] Updated weights for policy 1, policy_version 1790225 (0.0007) [2023-12-28 08:05:55,605][106226] Updated weights for policy 0, policy_version 1786027 (0.0009) [2023-12-28 08:05:55,641][106225] Updated weights for policy 1, policy_version 1790235 (0.0005) [2023-12-28 08:05:55,665][106226] Updated weights for policy 0, policy_version 1786037 (0.0005) [2023-12-28 08:05:55,731][106226] Updated weights for policy 0, policy_version 1786047 (0.0008) [2023-12-28 08:05:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.7, 300 sec: 19521.9). Total num frames: 915668992. Throughput: 0: 9901.0, 1: 9804.8. Samples: 915636444. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:05:56,176][105115] Avg episode reward: [(0, '-4.554'), (1, '-4.563')] [2023-12-28 08:05:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001786056_457310208.pth... [2023-12-28 08:05:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001784904_457015296.pth [2023-12-28 08:05:56,200][106225] Updated weights for policy 1, policy_version 1790245 (0.0005) [2023-12-28 08:05:56,257][106225] Updated weights for policy 1, policy_version 1790255 (0.0005) [2023-12-28 08:05:56,314][106225] Updated weights for policy 1, policy_version 1790265 (0.0007) [2023-12-28 08:05:56,315][106226] Updated weights for policy 0, policy_version 1786057 (0.0010) [2023-12-28 08:05:56,352][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001790272_458366976.pth... [2023-12-28 08:05:56,357][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001789088_458063872.pth [2023-12-28 08:05:56,379][106226] Updated weights for policy 0, policy_version 1786067 (0.0011) [2023-12-28 08:05:56,440][106226] Updated weights for policy 0, policy_version 1786077 (0.0011) [2023-12-28 08:05:56,508][106226] Updated weights for policy 0, policy_version 1786087 (0.0011) [2023-12-28 08:05:56,956][106225] Updated weights for policy 1, policy_version 1790275 (0.0007) [2023-12-28 08:05:57,015][106225] Updated weights for policy 1, policy_version 1790285 (0.0010) [2023-12-28 08:05:57,081][106225] Updated weights for policy 1, policy_version 1790296 (0.0010) [2023-12-28 08:05:57,113][106226] Updated weights for policy 0, policy_version 1786097 (0.0010) [2023-12-28 08:05:57,171][106226] Updated weights for policy 0, policy_version 1786107 (0.0010) [2023-12-28 08:05:57,230][106226] Updated weights for policy 0, policy_version 1786117 (0.0010) [2023-12-28 08:05:57,709][106225] Updated weights for policy 1, policy_version 1790306 (0.0006) [2023-12-28 08:05:57,771][106225] Updated weights for policy 1, policy_version 1790316 (0.0008) [2023-12-28 08:05:57,835][106225] Updated weights for policy 1, policy_version 1790326 (0.0005) [2023-12-28 08:05:57,894][106225] Updated weights for policy 1, policy_version 1790336 (0.0008) [2023-12-28 08:05:57,965][106226] Updated weights for policy 0, policy_version 1786127 (0.0010) [2023-12-28 08:05:58,023][106226] Updated weights for policy 0, policy_version 1786137 (0.0011) [2023-12-28 08:05:58,082][106226] Updated weights for policy 0, policy_version 1786147 (0.0010) [2023-12-28 08:05:58,580][106225] Updated weights for policy 1, policy_version 1790346 (0.0010) [2023-12-28 08:05:58,639][106225] Updated weights for policy 1, policy_version 1790356 (0.0009) [2023-12-28 08:05:58,708][106225] Updated weights for policy 1, policy_version 1790366 (0.0008) [2023-12-28 08:05:58,885][106226] Updated weights for policy 0, policy_version 1786157 (0.0009) [2023-12-28 08:05:58,963][106226] Updated weights for policy 0, policy_version 1786167 (0.0008) [2023-12-28 08:05:59,024][106226] Updated weights for policy 0, policy_version 1786177 (0.0008) [2023-12-28 08:05:59,511][106225] Updated weights for policy 1, policy_version 1790376 (0.0008) [2023-12-28 08:05:59,571][106225] Updated weights for policy 1, policy_version 1790386 (0.0006) [2023-12-28 08:05:59,636][106225] Updated weights for policy 1, policy_version 1790396 (0.0007) [2023-12-28 08:05:59,833][106226] Updated weights for policy 0, policy_version 1786187 (0.0007) [2023-12-28 08:05:59,892][106226] Updated weights for policy 0, policy_version 1786197 (0.0008) [2023-12-28 08:05:59,949][106226] Updated weights for policy 0, policy_version 1786207 (0.0007) [2023-12-28 08:06:00,338][106225] Updated weights for policy 1, policy_version 1790406 (0.0008) [2023-12-28 08:06:00,402][106225] Updated weights for policy 1, policy_version 1790416 (0.0009) [2023-12-28 08:06:00,456][106225] Updated weights for policy 1, policy_version 1790426 (0.0008) [2023-12-28 08:06:00,674][106226] Updated weights for policy 0, policy_version 1786217 (0.0007) [2023-12-28 08:06:00,727][106226] Updated weights for policy 0, policy_version 1786227 (0.0006) [2023-12-28 08:06:00,781][106226] Updated weights for policy 0, policy_version 1786237 (0.0005) [2023-12-28 08:06:00,846][106226] Updated weights for policy 0, policy_version 1786247 (0.0005) [2023-12-28 08:06:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19494.2). Total num frames: 915767296. Throughput: 0: 9917.9, 1: 9863.0. Samples: 915758756. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:01,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.707')] [2023-12-28 08:06:01,197][106225] Updated weights for policy 1, policy_version 1790436 (0.0007) [2023-12-28 08:06:01,258][106225] Updated weights for policy 1, policy_version 1790446 (0.0007) [2023-12-28 08:06:01,318][106225] Updated weights for policy 1, policy_version 1790456 (0.0007) [2023-12-28 08:06:01,467][106226] Updated weights for policy 0, policy_version 1786257 (0.0008) [2023-12-28 08:06:01,533][106226] Updated weights for policy 0, policy_version 1786267 (0.0009) [2023-12-28 08:06:01,594][106226] Updated weights for policy 0, policy_version 1786277 (0.0009) [2023-12-28 08:06:02,027][106225] Updated weights for policy 1, policy_version 1790466 (0.0009) [2023-12-28 08:06:02,079][106225] Updated weights for policy 1, policy_version 1790476 (0.0008) [2023-12-28 08:06:02,133][106225] Updated weights for policy 1, policy_version 1790486 (0.0009) [2023-12-28 08:06:02,183][106225] Updated weights for policy 1, policy_version 1790496 (0.0009) [2023-12-28 08:06:02,298][106226] Updated weights for policy 0, policy_version 1786287 (0.0007) [2023-12-28 08:06:02,361][106226] Updated weights for policy 0, policy_version 1786297 (0.0008) [2023-12-28 08:06:02,421][106226] Updated weights for policy 0, policy_version 1786307 (0.0006) [2023-12-28 08:06:03,013][106226] Updated weights for policy 0, policy_version 1786317 (0.0007) [2023-12-28 08:06:03,019][106225] Updated weights for policy 1, policy_version 1790506 (0.0006) [2023-12-28 08:06:03,066][106226] Updated weights for policy 0, policy_version 1786327 (0.0007) [2023-12-28 08:06:03,076][106225] Updated weights for policy 1, policy_version 1790516 (0.0007) [2023-12-28 08:06:03,123][106226] Updated weights for policy 0, policy_version 1786337 (0.0008) [2023-12-28 08:06:03,129][106225] Updated weights for policy 1, policy_version 1790526 (0.0007) [2023-12-28 08:06:03,738][106226] Updated weights for policy 0, policy_version 1786347 (0.0007) [2023-12-28 08:06:03,798][106226] Updated weights for policy 0, policy_version 1786357 (0.0007) [2023-12-28 08:06:03,860][106225] Updated weights for policy 1, policy_version 1790536 (0.0007) [2023-12-28 08:06:03,866][106226] Updated weights for policy 0, policy_version 1786368 (0.0013) [2023-12-28 08:06:03,917][106225] Updated weights for policy 1, policy_version 1790546 (0.0007) [2023-12-28 08:06:03,974][106225] Updated weights for policy 1, policy_version 1790556 (0.0007) [2023-12-28 08:06:04,516][106226] Updated weights for policy 0, policy_version 1786378 (0.0007) [2023-12-28 08:06:04,573][106226] Updated weights for policy 0, policy_version 1786388 (0.0008) [2023-12-28 08:06:04,630][106226] Updated weights for policy 0, policy_version 1786398 (0.0010) [2023-12-28 08:06:04,691][106226] Updated weights for policy 0, policy_version 1786408 (0.0010) [2023-12-28 08:06:04,784][106225] Updated weights for policy 1, policy_version 1790566 (0.0007) [2023-12-28 08:06:04,834][106225] Updated weights for policy 1, policy_version 1790576 (0.0005) [2023-12-28 08:06:04,882][106225] Updated weights for policy 1, policy_version 1790586 (0.0008) [2023-12-28 08:06:05,303][106226] Updated weights for policy 0, policy_version 1786418 (0.0010) [2023-12-28 08:06:05,366][106226] Updated weights for policy 0, policy_version 1786428 (0.0011) [2023-12-28 08:06:05,392][106225] Updated weights for policy 1, policy_version 1790596 (0.0007) [2023-12-28 08:06:05,422][106226] Updated weights for policy 0, policy_version 1786438 (0.0010) [2023-12-28 08:06:05,452][106225] Updated weights for policy 1, policy_version 1790606 (0.0010) [2023-12-28 08:06:05,512][106225] Updated weights for policy 1, policy_version 1790616 (0.0007) [2023-12-28 08:06:06,047][106225] Updated weights for policy 1, policy_version 1790626 (0.0006) [2023-12-28 08:06:06,115][106225] Updated weights for policy 1, policy_version 1790636 (0.0010) [2023-12-28 08:06:06,144][106226] Updated weights for policy 0, policy_version 1786448 (0.0010) [2023-12-28 08:06:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19494.2). Total num frames: 915865600. Throughput: 0: 9980.1, 1: 9947.6. Samples: 915880508. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:06,175][105115] Avg episode reward: [(0, '-4.770'), (1, '-4.981')] [2023-12-28 08:06:06,181][106225] Updated weights for policy 1, policy_version 1790646 (0.0006) [2023-12-28 08:06:06,192][106226] Updated weights for policy 0, policy_version 1786458 (0.0010) [2023-12-28 08:06:06,244][106225] Updated weights for policy 1, policy_version 1790656 (0.0006) [2023-12-28 08:06:06,250][106226] Updated weights for policy 0, policy_version 1786468 (0.0011) [2023-12-28 08:06:06,898][106226] Updated weights for policy 0, policy_version 1786478 (0.0011) [2023-12-28 08:06:06,923][106225] Updated weights for policy 1, policy_version 1790666 (0.0005) [2023-12-28 08:06:06,945][106226] Updated weights for policy 0, policy_version 1786488 (0.0011) [2023-12-28 08:06:06,978][106225] Updated weights for policy 1, policy_version 1790676 (0.0005) [2023-12-28 08:06:07,006][106226] Updated weights for policy 0, policy_version 1786498 (0.0011) [2023-12-28 08:06:07,040][106225] Updated weights for policy 1, policy_version 1790686 (0.0006) [2023-12-28 08:06:07,663][106225] Updated weights for policy 1, policy_version 1790696 (0.0008) [2023-12-28 08:06:07,668][106226] Updated weights for policy 0, policy_version 1786508 (0.0011) [2023-12-28 08:06:07,716][106225] Updated weights for policy 1, policy_version 1790706 (0.0008) [2023-12-28 08:06:07,729][106226] Updated weights for policy 0, policy_version 1786518 (0.0011) [2023-12-28 08:06:07,766][106225] Updated weights for policy 1, policy_version 1790716 (0.0005) [2023-12-28 08:06:07,782][106226] Updated weights for policy 0, policy_version 1786528 (0.0011) [2023-12-28 08:06:08,457][106226] Updated weights for policy 0, policy_version 1786538 (0.0010) [2023-12-28 08:06:08,520][106225] Updated weights for policy 1, policy_version 1790726 (0.0005) [2023-12-28 08:06:08,521][106226] Updated weights for policy 0, policy_version 1786548 (0.0011) [2023-12-28 08:06:08,571][106225] Updated weights for policy 1, policy_version 1790736 (0.0005) [2023-12-28 08:06:08,585][106226] Updated weights for policy 0, policy_version 1786558 (0.0011) [2023-12-28 08:06:08,625][106225] Updated weights for policy 1, policy_version 1790746 (0.0008) [2023-12-28 08:06:08,650][106226] Updated weights for policy 0, policy_version 1786568 (0.0011) [2023-12-28 08:06:09,303][106225] Updated weights for policy 1, policy_version 1790756 (0.0006) [2023-12-28 08:06:09,364][106226] Updated weights for policy 0, policy_version 1786578 (0.0009) [2023-12-28 08:06:09,378][106225] Updated weights for policy 1, policy_version 1790766 (0.0007) [2023-12-28 08:06:09,431][106226] Updated weights for policy 0, policy_version 1786588 (0.0008) [2023-12-28 08:06:09,443][106225] Updated weights for policy 1, policy_version 1790776 (0.0008) [2023-12-28 08:06:09,494][106226] Updated weights for policy 0, policy_version 1786598 (0.0008) [2023-12-28 08:06:10,191][106225] Updated weights for policy 1, policy_version 1790786 (0.0008) [2023-12-28 08:06:10,214][106226] Updated weights for policy 0, policy_version 1786608 (0.0009) [2023-12-28 08:06:10,252][106225] Updated weights for policy 1, policy_version 1790796 (0.0006) [2023-12-28 08:06:10,271][106226] Updated weights for policy 0, policy_version 1786618 (0.0007) [2023-12-28 08:06:10,306][106225] Updated weights for policy 1, policy_version 1790806 (0.0006) [2023-12-28 08:06:10,328][106226] Updated weights for policy 0, policy_version 1786628 (0.0007) [2023-12-28 08:06:10,364][106225] Updated weights for policy 1, policy_version 1790816 (0.0007) [2023-12-28 08:06:11,058][106225] Updated weights for policy 1, policy_version 1790826 (0.0008) [2023-12-28 08:06:11,104][106226] Updated weights for policy 0, policy_version 1786638 (0.0006) [2023-12-28 08:06:11,123][106225] Updated weights for policy 1, policy_version 1790836 (0.0011) [2023-12-28 08:06:11,169][106226] Updated weights for policy 0, policy_version 1786648 (0.0007) [2023-12-28 08:06:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19494.2). Total num frames: 915963904. Throughput: 0: 10026.6, 1: 9954.1. Samples: 915942632. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:11,175][105115] Avg episode reward: [(0, '-4.528'), (1, '-5.027')] [2023-12-28 08:06:11,199][106225] Updated weights for policy 1, policy_version 1790846 (0.0009) [2023-12-28 08:06:11,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001790848_458514432.pth... [2023-12-28 08:06:11,213][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001789696_458219520.pth [2023-12-28 08:06:11,242][106226] Updated weights for policy 0, policy_version 1786658 (0.0009) [2023-12-28 08:06:11,281][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001786664_457465856.pth... [2023-12-28 08:06:11,285][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001785480_457162752.pth [2023-12-28 08:06:11,861][106225] Updated weights for policy 1, policy_version 1790856 (0.0010) [2023-12-28 08:06:11,915][106225] Updated weights for policy 1, policy_version 1790866 (0.0007) [2023-12-28 08:06:11,978][106225] Updated weights for policy 1, policy_version 1790876 (0.0006) [2023-12-28 08:06:12,000][106226] Updated weights for policy 0, policy_version 1786668 (0.0008) [2023-12-28 08:06:12,064][106226] Updated weights for policy 0, policy_version 1786678 (0.0007) [2023-12-28 08:06:12,132][106226] Updated weights for policy 0, policy_version 1786688 (0.0007) [2023-12-28 08:06:12,676][106225] Updated weights for policy 1, policy_version 1790886 (0.0009) [2023-12-28 08:06:12,733][106225] Updated weights for policy 1, policy_version 1790896 (0.0010) [2023-12-28 08:06:12,793][106225] Updated weights for policy 1, policy_version 1790906 (0.0010) [2023-12-28 08:06:12,862][106226] Updated weights for policy 0, policy_version 1786698 (0.0008) [2023-12-28 08:06:12,920][106226] Updated weights for policy 0, policy_version 1786708 (0.0007) [2023-12-28 08:06:12,967][106226] Updated weights for policy 0, policy_version 1786718 (0.0008) [2023-12-28 08:06:13,011][106226] Updated weights for policy 0, policy_version 1786728 (0.0008) [2023-12-28 08:06:13,524][106225] Updated weights for policy 1, policy_version 1790916 (0.0010) [2023-12-28 08:06:13,573][106225] Updated weights for policy 1, policy_version 1790926 (0.0010) [2023-12-28 08:06:13,617][106225] Updated weights for policy 1, policy_version 1790936 (0.0008) [2023-12-28 08:06:13,740][106226] Updated weights for policy 0, policy_version 1786738 (0.0005) [2023-12-28 08:06:13,796][106226] Updated weights for policy 0, policy_version 1786748 (0.0008) [2023-12-28 08:06:13,852][106226] Updated weights for policy 0, policy_version 1786758 (0.0008) [2023-12-28 08:06:14,278][106225] Updated weights for policy 1, policy_version 1790946 (0.0006) [2023-12-28 08:06:14,328][106225] Updated weights for policy 1, policy_version 1790956 (0.0008) [2023-12-28 08:06:14,387][106225] Updated weights for policy 1, policy_version 1790966 (0.0009) [2023-12-28 08:06:14,448][106225] Updated weights for policy 1, policy_version 1790976 (0.0010) [2023-12-28 08:06:14,515][106226] Updated weights for policy 0, policy_version 1786768 (0.0006) [2023-12-28 08:06:14,575][106226] Updated weights for policy 0, policy_version 1786778 (0.0007) [2023-12-28 08:06:14,623][106226] Updated weights for policy 0, policy_version 1786788 (0.0008) [2023-12-28 08:06:15,225][106225] Updated weights for policy 1, policy_version 1790986 (0.0008) [2023-12-28 08:06:15,289][106225] Updated weights for policy 1, policy_version 1790996 (0.0008) [2023-12-28 08:06:15,328][106226] Updated weights for policy 0, policy_version 1786798 (0.0008) [2023-12-28 08:06:15,351][106225] Updated weights for policy 1, policy_version 1791006 (0.0010) [2023-12-28 08:06:15,393][106226] Updated weights for policy 0, policy_version 1786808 (0.0008) [2023-12-28 08:06:15,456][106226] Updated weights for policy 0, policy_version 1786818 (0.0009) [2023-12-28 08:06:16,052][106225] Updated weights for policy 1, policy_version 1791016 (0.0008) [2023-12-28 08:06:16,075][106226] Updated weights for policy 0, policy_version 1786828 (0.0007) [2023-12-28 08:06:16,100][106225] Updated weights for policy 1, policy_version 1791026 (0.0007) [2023-12-28 08:06:16,126][106226] Updated weights for policy 0, policy_version 1786838 (0.0006) [2023-12-28 08:06:16,147][106225] Updated weights for policy 1, policy_version 1791036 (0.0005) [2023-12-28 08:06:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19549.7). Total num frames: 916070400. Throughput: 0: 9950.5, 1: 9867.3. Samples: 916059788. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:16,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-5.026')] [2023-12-28 08:06:16,183][106226] Updated weights for policy 0, policy_version 1786848 (0.0009) [2023-12-28 08:06:16,745][106226] Updated weights for policy 0, policy_version 1786858 (0.0007) [2023-12-28 08:06:16,801][106226] Updated weights for policy 0, policy_version 1786868 (0.0005) [2023-12-28 08:06:16,808][106225] Updated weights for policy 1, policy_version 1791046 (0.0005) [2023-12-28 08:06:16,857][106225] Updated weights for policy 1, policy_version 1791056 (0.0006) [2023-12-28 08:06:16,860][106226] Updated weights for policy 0, policy_version 1786878 (0.0005) [2023-12-28 08:06:16,911][106225] Updated weights for policy 1, policy_version 1791066 (0.0005) [2023-12-28 08:06:16,913][106226] Updated weights for policy 0, policy_version 1786888 (0.0007) [2023-12-28 08:06:17,565][106226] Updated weights for policy 0, policy_version 1786898 (0.0008) [2023-12-28 08:06:17,614][106225] Updated weights for policy 1, policy_version 1791076 (0.0009) [2023-12-28 08:06:17,624][106226] Updated weights for policy 0, policy_version 1786908 (0.0008) [2023-12-28 08:06:17,662][106225] Updated weights for policy 1, policy_version 1791086 (0.0007) [2023-12-28 08:06:17,680][106226] Updated weights for policy 0, policy_version 1786918 (0.0007) [2023-12-28 08:06:17,724][106225] Updated weights for policy 1, policy_version 1791096 (0.0008) [2023-12-28 08:06:18,372][106225] Updated weights for policy 1, policy_version 1791106 (0.0008) [2023-12-28 08:06:18,430][106225] Updated weights for policy 1, policy_version 1791116 (0.0006) [2023-12-28 08:06:18,436][106226] Updated weights for policy 0, policy_version 1786928 (0.0010) [2023-12-28 08:06:18,486][106225] Updated weights for policy 1, policy_version 1791126 (0.0006) [2023-12-28 08:06:18,489][106226] Updated weights for policy 0, policy_version 1786938 (0.0010) [2023-12-28 08:06:18,547][106225] Updated weights for policy 1, policy_version 1791136 (0.0010) [2023-12-28 08:06:18,547][106226] Updated weights for policy 0, policy_version 1786948 (0.0010) [2023-12-28 08:06:19,241][106225] Updated weights for policy 1, policy_version 1791146 (0.0006) [2023-12-28 08:06:19,307][106225] Updated weights for policy 1, policy_version 1791156 (0.0008) [2023-12-28 08:06:19,318][106226] Updated weights for policy 0, policy_version 1786958 (0.0008) [2023-12-28 08:06:19,370][106225] Updated weights for policy 1, policy_version 1791166 (0.0008) [2023-12-28 08:06:19,391][106226] Updated weights for policy 0, policy_version 1786968 (0.0007) [2023-12-28 08:06:19,437][106226] Updated weights for policy 0, policy_version 1786978 (0.0008) [2023-12-28 08:06:20,138][106226] Updated weights for policy 0, policy_version 1786988 (0.0009) [2023-12-28 08:06:20,158][106225] Updated weights for policy 1, policy_version 1791176 (0.0008) [2023-12-28 08:06:20,202][106226] Updated weights for policy 0, policy_version 1786998 (0.0008) [2023-12-28 08:06:20,223][106225] Updated weights for policy 1, policy_version 1791186 (0.0008) [2023-12-28 08:06:20,269][106226] Updated weights for policy 0, policy_version 1787008 (0.0008) [2023-12-28 08:06:20,285][106225] Updated weights for policy 1, policy_version 1791196 (0.0007) [2023-12-28 08:06:20,964][106225] Updated weights for policy 1, policy_version 1791206 (0.0008) [2023-12-28 08:06:21,024][106226] Updated weights for policy 0, policy_version 1787018 (0.0009) [2023-12-28 08:06:21,027][106225] Updated weights for policy 1, policy_version 1791216 (0.0008) [2023-12-28 08:06:21,094][106225] Updated weights for policy 1, policy_version 1791226 (0.0008) [2023-12-28 08:06:21,100][106226] Updated weights for policy 0, policy_version 1787028 (0.0008) [2023-12-28 08:06:21,169][106226] Updated weights for policy 0, policy_version 1787038 (0.0008) [2023-12-28 08:06:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19549.7). Total num frames: 916168704. Throughput: 0: 9941.7, 1: 9865.8. Samples: 916178248. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:21,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.723')] [2023-12-28 08:06:21,235][106226] Updated weights for policy 0, policy_version 1787048 (0.0009) [2023-12-28 08:06:21,875][106225] Updated weights for policy 1, policy_version 1791236 (0.0009) [2023-12-28 08:06:21,936][106225] Updated weights for policy 1, policy_version 1791246 (0.0007) [2023-12-28 08:06:21,941][106226] Updated weights for policy 0, policy_version 1787058 (0.0007) [2023-12-28 08:06:21,993][106225] Updated weights for policy 1, policy_version 1791256 (0.0008) [2023-12-28 08:06:22,004][106226] Updated weights for policy 0, policy_version 1787068 (0.0008) [2023-12-28 08:06:22,069][106226] Updated weights for policy 0, policy_version 1787078 (0.0008) [2023-12-28 08:06:22,777][106226] Updated weights for policy 0, policy_version 1787088 (0.0006) [2023-12-28 08:06:22,781][106225] Updated weights for policy 1, policy_version 1791266 (0.0008) [2023-12-28 08:06:22,844][106226] Updated weights for policy 0, policy_version 1787098 (0.0007) [2023-12-28 08:06:22,845][106225] Updated weights for policy 1, policy_version 1791276 (0.0009) [2023-12-28 08:06:22,903][106226] Updated weights for policy 0, policy_version 1787108 (0.0009) [2023-12-28 08:06:22,903][106225] Updated weights for policy 1, policy_version 1791286 (0.0009) [2023-12-28 08:06:22,966][106225] Updated weights for policy 1, policy_version 1791296 (0.0009) [2023-12-28 08:06:23,575][106226] Updated weights for policy 0, policy_version 1787118 (0.0010) [2023-12-28 08:06:23,643][106226] Updated weights for policy 0, policy_version 1787128 (0.0011) [2023-12-28 08:06:23,680][106225] Updated weights for policy 1, policy_version 1791306 (0.0005) [2023-12-28 08:06:23,697][106226] Updated weights for policy 0, policy_version 1787138 (0.0011) [2023-12-28 08:06:23,740][106225] Updated weights for policy 1, policy_version 1791316 (0.0005) [2023-12-28 08:06:23,805][106225] Updated weights for policy 1, policy_version 1791326 (0.0006) [2023-12-28 08:06:24,310][106225] Updated weights for policy 1, policy_version 1791336 (0.0006) [2023-12-28 08:06:24,374][106225] Updated weights for policy 1, policy_version 1791346 (0.0005) [2023-12-28 08:06:24,377][106226] Updated weights for policy 0, policy_version 1787148 (0.0010) [2023-12-28 08:06:24,424][106225] Updated weights for policy 1, policy_version 1791356 (0.0006) [2023-12-28 08:06:24,440][106226] Updated weights for policy 0, policy_version 1787158 (0.0007) [2023-12-28 08:06:24,495][106226] Updated weights for policy 0, policy_version 1787168 (0.0005) [2023-12-28 08:06:25,005][106225] Updated weights for policy 1, policy_version 1791366 (0.0005) [2023-12-28 08:06:25,059][106225] Updated weights for policy 1, policy_version 1791376 (0.0008) [2023-12-28 08:06:25,105][106225] Updated weights for policy 1, policy_version 1791386 (0.0010) [2023-12-28 08:06:25,170][106226] Updated weights for policy 0, policy_version 1787178 (0.0008) [2023-12-28 08:06:25,238][106226] Updated weights for policy 0, policy_version 1787188 (0.0010) [2023-12-28 08:06:25,284][106226] Updated weights for policy 0, policy_version 1787198 (0.0010) [2023-12-28 08:06:25,333][106226] Updated weights for policy 0, policy_version 1787208 (0.0010) [2023-12-28 08:06:25,792][106225] Updated weights for policy 1, policy_version 1791396 (0.0009) [2023-12-28 08:06:25,847][106225] Updated weights for policy 1, policy_version 1791406 (0.0008) [2023-12-28 08:06:25,913][106225] Updated weights for policy 1, policy_version 1791416 (0.0008) [2023-12-28 08:06:26,032][106226] Updated weights for policy 0, policy_version 1787218 (0.0011) [2023-12-28 08:06:26,093][106226] Updated weights for policy 0, policy_version 1787228 (0.0011) [2023-12-28 08:06:26,154][106226] Updated weights for policy 0, policy_version 1787238 (0.0011) [2023-12-28 08:06:26,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19577.5). Total num frames: 916275200. Throughput: 0: 9934.8, 1: 9832.2. Samples: 916236300. Policy #0 lag: (min: 29.0, avg: 31.8, max: 61.0) [2023-12-28 08:06:26,175][105115] Avg episode reward: [(0, '-4.199'), (1, '-5.012')] [2023-12-28 08:06:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001787240_457613312.pth... [2023-12-28 08:06:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001791424_458661888.pth... [2023-12-28 08:06:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001786056_457310208.pth [2023-12-28 08:06:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001790272_458366976.pth [2023-12-28 08:06:26,555][106225] Updated weights for policy 1, policy_version 1791426 (0.0009) [2023-12-28 08:06:26,619][106225] Updated weights for policy 1, policy_version 1791436 (0.0009) [2023-12-28 08:06:26,680][106225] Updated weights for policy 1, policy_version 1791446 (0.0009) [2023-12-28 08:06:26,740][106225] Updated weights for policy 1, policy_version 1791456 (0.0008) [2023-12-28 08:06:26,758][106226] Updated weights for policy 0, policy_version 1787248 (0.0006) [2023-12-28 08:06:26,810][106226] Updated weights for policy 0, policy_version 1787258 (0.0005) [2023-12-28 08:06:26,864][106226] Updated weights for policy 0, policy_version 1787268 (0.0006) [2023-12-28 08:06:27,400][106226] Updated weights for policy 0, policy_version 1787278 (0.0007) [2023-12-28 08:06:27,462][106226] Updated weights for policy 0, policy_version 1787288 (0.0009) [2023-12-28 08:06:27,519][106226] Updated weights for policy 0, policy_version 1787298 (0.0010) [2023-12-28 08:06:27,575][106225] Updated weights for policy 1, policy_version 1791466 (0.0008) [2023-12-28 08:06:27,633][106225] Updated weights for policy 1, policy_version 1791476 (0.0008) [2023-12-28 08:06:27,678][106225] Updated weights for policy 1, policy_version 1791486 (0.0008) [2023-12-28 08:06:28,130][106226] Updated weights for policy 0, policy_version 1787308 (0.0007) [2023-12-28 08:06:28,196][106226] Updated weights for policy 0, policy_version 1787318 (0.0010) [2023-12-28 08:06:28,251][106226] Updated weights for policy 0, policy_version 1787328 (0.0008) [2023-12-28 08:06:28,431][106225] Updated weights for policy 1, policy_version 1791496 (0.0008) [2023-12-28 08:06:28,493][106225] Updated weights for policy 1, policy_version 1791506 (0.0007) [2023-12-28 08:06:28,553][106225] Updated weights for policy 1, policy_version 1791516 (0.0007) [2023-12-28 08:06:28,880][106226] Updated weights for policy 0, policy_version 1787338 (0.0006) [2023-12-28 08:06:28,936][106226] Updated weights for policy 0, policy_version 1787348 (0.0010) [2023-12-28 08:06:28,984][106226] Updated weights for policy 0, policy_version 1787358 (0.0008) [2023-12-28 08:06:29,039][106226] Updated weights for policy 0, policy_version 1787368 (0.0006) [2023-12-28 08:06:29,320][106225] Updated weights for policy 1, policy_version 1791526 (0.0009) [2023-12-28 08:06:29,396][106225] Updated weights for policy 1, policy_version 1791536 (0.0009) [2023-12-28 08:06:29,456][106225] Updated weights for policy 1, policy_version 1791546 (0.0009) [2023-12-28 08:06:29,719][106226] Updated weights for policy 0, policy_version 1787378 (0.0010) [2023-12-28 08:06:29,782][106226] Updated weights for policy 0, policy_version 1787388 (0.0011) [2023-12-28 08:06:29,847][106226] Updated weights for policy 0, policy_version 1787398 (0.0009) [2023-12-28 08:06:30,218][106225] Updated weights for policy 1, policy_version 1791556 (0.0008) [2023-12-28 08:06:30,271][106225] Updated weights for policy 1, policy_version 1791566 (0.0009) [2023-12-28 08:06:30,326][106225] Updated weights for policy 1, policy_version 1791576 (0.0008) [2023-12-28 08:06:30,604][106226] Updated weights for policy 0, policy_version 1787408 (0.0008) [2023-12-28 08:06:30,671][106226] Updated weights for policy 0, policy_version 1787418 (0.0009) [2023-12-28 08:06:30,732][106226] Updated weights for policy 0, policy_version 1787428 (0.0009) [2023-12-28 08:06:31,088][106225] Updated weights for policy 1, policy_version 1791586 (0.0008) [2023-12-28 08:06:31,157][106225] Updated weights for policy 1, policy_version 1791596 (0.0008) [2023-12-28 08:06:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 916365312. Throughput: 0: 10058.2, 1: 9913.7. Samples: 916359844. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:31,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-4.948')] [2023-12-28 08:06:31,224][106225] Updated weights for policy 1, policy_version 1791606 (0.0010) [2023-12-28 08:06:31,288][106225] Updated weights for policy 1, policy_version 1791616 (0.0007) [2023-12-28 08:06:31,418][106226] Updated weights for policy 0, policy_version 1787438 (0.0009) [2023-12-28 08:06:31,484][106226] Updated weights for policy 0, policy_version 1787448 (0.0008) [2023-12-28 08:06:31,541][106226] Updated weights for policy 0, policy_version 1787458 (0.0009) [2023-12-28 08:06:32,019][106225] Updated weights for policy 1, policy_version 1791626 (0.0009) [2023-12-28 08:06:32,074][106225] Updated weights for policy 1, policy_version 1791636 (0.0009) [2023-12-28 08:06:32,134][106225] Updated weights for policy 1, policy_version 1791646 (0.0009) [2023-12-28 08:06:32,280][106226] Updated weights for policy 0, policy_version 1787468 (0.0009) [2023-12-28 08:06:32,334][106226] Updated weights for policy 0, policy_version 1787478 (0.0007) [2023-12-28 08:06:32,405][106226] Updated weights for policy 0, policy_version 1787488 (0.0008) [2023-12-28 08:06:32,895][106225] Updated weights for policy 1, policy_version 1791656 (0.0006) [2023-12-28 08:06:32,952][106225] Updated weights for policy 1, policy_version 1791666 (0.0005) [2023-12-28 08:06:33,013][106225] Updated weights for policy 1, policy_version 1791676 (0.0005) [2023-12-28 08:06:33,118][106226] Updated weights for policy 0, policy_version 1787498 (0.0009) [2023-12-28 08:06:33,171][106226] Updated weights for policy 0, policy_version 1787508 (0.0005) [2023-12-28 08:06:33,216][106226] Updated weights for policy 0, policy_version 1787518 (0.0005) [2023-12-28 08:06:33,262][106226] Updated weights for policy 0, policy_version 1787528 (0.0005) [2023-12-28 08:06:33,572][106225] Updated weights for policy 1, policy_version 1791686 (0.0007) [2023-12-28 08:06:33,645][106225] Updated weights for policy 1, policy_version 1791696 (0.0009) [2023-12-28 08:06:33,703][106225] Updated weights for policy 1, policy_version 1791706 (0.0008) [2023-12-28 08:06:33,882][106226] Updated weights for policy 0, policy_version 1787538 (0.0010) [2023-12-28 08:06:33,943][106226] Updated weights for policy 0, policy_version 1787548 (0.0011) [2023-12-28 08:06:34,006][106226] Updated weights for policy 0, policy_version 1787558 (0.0010) [2023-12-28 08:06:34,354][106225] Updated weights for policy 1, policy_version 1791716 (0.0007) [2023-12-28 08:06:34,416][106225] Updated weights for policy 1, policy_version 1791726 (0.0008) [2023-12-28 08:06:34,479][106225] Updated weights for policy 1, policy_version 1791736 (0.0009) [2023-12-28 08:06:34,709][106226] Updated weights for policy 0, policy_version 1787568 (0.0011) [2023-12-28 08:06:34,762][106226] Updated weights for policy 0, policy_version 1787578 (0.0010) [2023-12-28 08:06:34,818][106226] Updated weights for policy 0, policy_version 1787588 (0.0010) [2023-12-28 08:06:35,217][106225] Updated weights for policy 1, policy_version 1791746 (0.0008) [2023-12-28 08:06:35,274][106225] Updated weights for policy 1, policy_version 1791756 (0.0008) [2023-12-28 08:06:35,334][106225] Updated weights for policy 1, policy_version 1791766 (0.0006) [2023-12-28 08:06:35,380][106225] Updated weights for policy 1, policy_version 1791776 (0.0008) [2023-12-28 08:06:35,527][106226] Updated weights for policy 0, policy_version 1787598 (0.0010) [2023-12-28 08:06:35,576][106226] Updated weights for policy 0, policy_version 1787608 (0.0010) [2023-12-28 08:06:35,633][106226] Updated weights for policy 0, policy_version 1787618 (0.0010) [2023-12-28 08:06:36,063][106225] Updated weights for policy 1, policy_version 1791786 (0.0005) [2023-12-28 08:06:36,118][106225] Updated weights for policy 1, policy_version 1791796 (0.0007) [2023-12-28 08:06:36,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19522.0). Total num frames: 916463616. Throughput: 0: 10048.2, 1: 9970.0. Samples: 916478772. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:36,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.853')] [2023-12-28 08:06:36,184][106225] Updated weights for policy 1, policy_version 1791806 (0.0009) [2023-12-28 08:06:36,333][106226] Updated weights for policy 0, policy_version 1787628 (0.0010) [2023-12-28 08:06:36,387][106226] Updated weights for policy 0, policy_version 1787638 (0.0010) [2023-12-28 08:06:36,448][106226] Updated weights for policy 0, policy_version 1787648 (0.0011) [2023-12-28 08:06:36,883][106225] Updated weights for policy 1, policy_version 1791816 (0.0008) [2023-12-28 08:06:36,944][106225] Updated weights for policy 1, policy_version 1791826 (0.0007) [2023-12-28 08:06:36,992][106225] Updated weights for policy 1, policy_version 1791836 (0.0008) [2023-12-28 08:06:37,143][106226] Updated weights for policy 0, policy_version 1787658 (0.0010) [2023-12-28 08:06:37,205][106226] Updated weights for policy 0, policy_version 1787668 (0.0008) [2023-12-28 08:06:37,269][106226] Updated weights for policy 0, policy_version 1787678 (0.0009) [2023-12-28 08:06:37,324][106226] Updated weights for policy 0, policy_version 1787688 (0.0009) [2023-12-28 08:06:37,636][106225] Updated weights for policy 1, policy_version 1791846 (0.0008) [2023-12-28 08:06:37,680][106225] Updated weights for policy 1, policy_version 1791856 (0.0008) [2023-12-28 08:06:37,732][106225] Updated weights for policy 1, policy_version 1791866 (0.0009) [2023-12-28 08:06:38,044][106226] Updated weights for policy 0, policy_version 1787698 (0.0008) [2023-12-28 08:06:38,108][106226] Updated weights for policy 0, policy_version 1787708 (0.0008) [2023-12-28 08:06:38,168][106226] Updated weights for policy 0, policy_version 1787718 (0.0005) [2023-12-28 08:06:38,582][106225] Updated weights for policy 1, policy_version 1791876 (0.0009) [2023-12-28 08:06:38,630][106225] Updated weights for policy 1, policy_version 1791886 (0.0008) [2023-12-28 08:06:38,690][106225] Updated weights for policy 1, policy_version 1791896 (0.0008) [2023-12-28 08:06:38,738][106226] Updated weights for policy 0, policy_version 1787728 (0.0006) [2023-12-28 08:06:38,803][106226] Updated weights for policy 0, policy_version 1787738 (0.0009) [2023-12-28 08:06:38,864][106226] Updated weights for policy 0, policy_version 1787748 (0.0009) [2023-12-28 08:06:39,434][106225] Updated weights for policy 1, policy_version 1791906 (0.0007) [2023-12-28 08:06:39,491][106225] Updated weights for policy 1, policy_version 1791916 (0.0008) [2023-12-28 08:06:39,545][106225] Updated weights for policy 1, policy_version 1791926 (0.0007) [2023-12-28 08:06:39,605][106225] Updated weights for policy 1, policy_version 1791936 (0.0008) [2023-12-28 08:06:39,617][106226] Updated weights for policy 0, policy_version 1787758 (0.0008) [2023-12-28 08:06:39,679][106226] Updated weights for policy 0, policy_version 1787768 (0.0011) [2023-12-28 08:06:39,737][106226] Updated weights for policy 0, policy_version 1787778 (0.0011) [2023-12-28 08:06:40,371][106225] Updated weights for policy 1, policy_version 1791946 (0.0007) [2023-12-28 08:06:40,429][106225] Updated weights for policy 1, policy_version 1791956 (0.0008) [2023-12-28 08:06:40,490][106225] Updated weights for policy 1, policy_version 1791966 (0.0008) [2023-12-28 08:06:40,508][106226] Updated weights for policy 0, policy_version 1787788 (0.0010) [2023-12-28 08:06:40,572][106226] Updated weights for policy 0, policy_version 1787798 (0.0010) [2023-12-28 08:06:40,636][106226] Updated weights for policy 0, policy_version 1787808 (0.0010) [2023-12-28 08:06:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19521.9). Total num frames: 916561920. Throughput: 0: 10061.0, 1: 9968.2. Samples: 916537756. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:41,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.994')] [2023-12-28 08:06:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001787816_457760768.pth... [2023-12-28 08:06:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001786664_457465856.pth [2023-12-28 08:06:41,250][106225] Updated weights for policy 1, policy_version 1791976 (0.0008) [2023-12-28 08:06:41,271][106226] Updated weights for policy 0, policy_version 1787818 (0.0010) [2023-12-28 08:06:41,316][106225] Updated weights for policy 1, policy_version 1791986 (0.0008) [2023-12-28 08:06:41,354][106226] Updated weights for policy 0, policy_version 1787828 (0.0008) [2023-12-28 08:06:41,385][106225] Updated weights for policy 1, policy_version 1791996 (0.0008) [2023-12-28 08:06:41,409][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001792000_458809344.pth... [2023-12-28 08:06:41,412][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001790848_458514432.pth [2023-12-28 08:06:41,423][106226] Updated weights for policy 0, policy_version 1787838 (0.0008) [2023-12-28 08:06:41,488][106226] Updated weights for policy 0, policy_version 1787848 (0.0008) [2023-12-28 08:06:42,131][106225] Updated weights for policy 1, policy_version 1792006 (0.0008) [2023-12-28 08:06:42,181][106225] Updated weights for policy 1, policy_version 1792016 (0.0008) [2023-12-28 08:06:42,229][106226] Updated weights for policy 0, policy_version 1787858 (0.0009) [2023-12-28 08:06:42,236][106225] Updated weights for policy 1, policy_version 1792026 (0.0008) [2023-12-28 08:06:42,296][106226] Updated weights for policy 0, policy_version 1787868 (0.0008) [2023-12-28 08:06:42,362][106226] Updated weights for policy 0, policy_version 1787878 (0.0007) [2023-12-28 08:06:42,969][106225] Updated weights for policy 1, policy_version 1792036 (0.0008) [2023-12-28 08:06:43,033][106225] Updated weights for policy 1, policy_version 1792046 (0.0005) [2023-12-28 08:06:43,094][106226] Updated weights for policy 0, policy_version 1787888 (0.0010) [2023-12-28 08:06:43,096][106225] Updated weights for policy 1, policy_version 1792056 (0.0005) [2023-12-28 08:06:43,150][106226] Updated weights for policy 0, policy_version 1787898 (0.0010) [2023-12-28 08:06:43,210][106226] Updated weights for policy 0, policy_version 1787908 (0.0010) [2023-12-28 08:06:43,782][106225] Updated weights for policy 1, policy_version 1792066 (0.0008) [2023-12-28 08:06:43,839][106226] Updated weights for policy 0, policy_version 1787918 (0.0009) [2023-12-28 08:06:43,839][106225] Updated weights for policy 1, policy_version 1792076 (0.0010) [2023-12-28 08:06:43,887][106226] Updated weights for policy 0, policy_version 1787928 (0.0009) [2023-12-28 08:06:43,889][106225] Updated weights for policy 1, policy_version 1792086 (0.0007) [2023-12-28 08:06:43,939][106226] Updated weights for policy 0, policy_version 1787938 (0.0008) [2023-12-28 08:06:43,943][106225] Updated weights for policy 1, policy_version 1792096 (0.0006) [2023-12-28 08:06:44,620][106226] Updated weights for policy 0, policy_version 1787948 (0.0007) [2023-12-28 08:06:44,681][106226] Updated weights for policy 0, policy_version 1787958 (0.0006) [2023-12-28 08:06:44,708][106225] Updated weights for policy 1, policy_version 1792106 (0.0006) [2023-12-28 08:06:44,741][106226] Updated weights for policy 0, policy_version 1787968 (0.0008) [2023-12-28 08:06:44,766][106225] Updated weights for policy 1, policy_version 1792116 (0.0006) [2023-12-28 08:06:44,828][106225] Updated weights for policy 1, policy_version 1792126 (0.0009) [2023-12-28 08:06:45,471][106226] Updated weights for policy 0, policy_version 1787978 (0.0007) [2023-12-28 08:06:45,527][106226] Updated weights for policy 0, policy_version 1787988 (0.0008) [2023-12-28 08:06:45,561][106225] Updated weights for policy 1, policy_version 1792136 (0.0007) [2023-12-28 08:06:45,579][106226] Updated weights for policy 0, policy_version 1787998 (0.0006) [2023-12-28 08:06:45,607][106225] Updated weights for policy 1, policy_version 1792146 (0.0008) [2023-12-28 08:06:45,632][106226] Updated weights for policy 0, policy_version 1788008 (0.0007) [2023-12-28 08:06:45,661][106225] Updated weights for policy 1, policy_version 1792156 (0.0007) [2023-12-28 08:06:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 916660224. Throughput: 0: 10068.8, 1: 9799.6. Samples: 916652836. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:46,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.945')] [2023-12-28 08:06:46,279][106226] Updated weights for policy 0, policy_version 1788018 (0.0009) [2023-12-28 08:06:46,334][106226] Updated weights for policy 0, policy_version 1788028 (0.0009) [2023-12-28 08:06:46,337][106225] Updated weights for policy 1, policy_version 1792166 (0.0006) [2023-12-28 08:06:46,392][106226] Updated weights for policy 0, policy_version 1788038 (0.0009) [2023-12-28 08:06:46,394][106225] Updated weights for policy 1, policy_version 1792176 (0.0005) [2023-12-28 08:06:46,447][106225] Updated weights for policy 1, policy_version 1792186 (0.0006) [2023-12-28 08:06:47,035][106225] Updated weights for policy 1, policy_version 1792196 (0.0007) [2023-12-28 08:06:47,091][106225] Updated weights for policy 1, policy_version 1792206 (0.0005) [2023-12-28 08:06:47,156][106225] Updated weights for policy 1, policy_version 1792216 (0.0005) [2023-12-28 08:06:47,160][106226] Updated weights for policy 0, policy_version 1788048 (0.0009) [2023-12-28 08:06:47,227][106226] Updated weights for policy 0, policy_version 1788058 (0.0008) [2023-12-28 08:06:47,285][106226] Updated weights for policy 0, policy_version 1788068 (0.0006) [2023-12-28 08:06:47,815][106225] Updated weights for policy 1, policy_version 1792226 (0.0005) [2023-12-28 08:06:47,881][106225] Updated weights for policy 1, policy_version 1792236 (0.0006) [2023-12-28 08:06:47,935][106225] Updated weights for policy 1, policy_version 1792246 (0.0007) [2023-12-28 08:06:48,001][106225] Updated weights for policy 1, policy_version 1792256 (0.0005) [2023-12-28 08:06:48,003][106226] Updated weights for policy 0, policy_version 1788078 (0.0008) [2023-12-28 08:06:48,061][106226] Updated weights for policy 0, policy_version 1788088 (0.0010) [2023-12-28 08:06:48,131][106226] Updated weights for policy 0, policy_version 1788098 (0.0010) [2023-12-28 08:06:48,570][106225] Updated weights for policy 1, policy_version 1792266 (0.0008) [2023-12-28 08:06:48,638][106225] Updated weights for policy 1, policy_version 1792276 (0.0009) [2023-12-28 08:06:48,712][106225] Updated weights for policy 1, policy_version 1792286 (0.0010) [2023-12-28 08:06:48,821][106226] Updated weights for policy 0, policy_version 1788108 (0.0008) [2023-12-28 08:06:48,883][106226] Updated weights for policy 0, policy_version 1788118 (0.0005) [2023-12-28 08:06:48,943][106226] Updated weights for policy 0, policy_version 1788128 (0.0005) [2023-12-28 08:06:49,539][106226] Updated weights for policy 0, policy_version 1788138 (0.0005) [2023-12-28 08:06:49,540][106225] Updated weights for policy 1, policy_version 1792296 (0.0008) [2023-12-28 08:06:49,602][106225] Updated weights for policy 1, policy_version 1792306 (0.0007) [2023-12-28 08:06:49,603][106226] Updated weights for policy 0, policy_version 1788148 (0.0006) [2023-12-28 08:06:49,663][106225] Updated weights for policy 1, policy_version 1792316 (0.0008) [2023-12-28 08:06:49,668][106226] Updated weights for policy 0, policy_version 1788158 (0.0006) [2023-12-28 08:06:49,732][106226] Updated weights for policy 0, policy_version 1788168 (0.0007) [2023-12-28 08:06:50,367][106226] Updated weights for policy 0, policy_version 1788178 (0.0006) [2023-12-28 08:06:50,436][106226] Updated weights for policy 0, policy_version 1788188 (0.0007) [2023-12-28 08:06:50,465][106225] Updated weights for policy 1, policy_version 1792326 (0.0007) [2023-12-28 08:06:50,492][106226] Updated weights for policy 0, policy_version 1788198 (0.0007) [2023-12-28 08:06:50,519][106225] Updated weights for policy 1, policy_version 1792336 (0.0006) [2023-12-28 08:06:50,573][106225] Updated weights for policy 1, policy_version 1792346 (0.0008) [2023-12-28 08:06:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19549.7). Total num frames: 916758528. Throughput: 0: 10014.1, 1: 9816.3. Samples: 916772880. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:51,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-5.011')] [2023-12-28 08:06:51,221][106226] Updated weights for policy 0, policy_version 1788208 (0.0008) [2023-12-28 08:06:51,283][106226] Updated weights for policy 0, policy_version 1788218 (0.0009) [2023-12-28 08:06:51,344][106226] Updated weights for policy 0, policy_version 1788228 (0.0009) [2023-12-28 08:06:51,345][106225] Updated weights for policy 1, policy_version 1792356 (0.0009) [2023-12-28 08:06:51,414][106225] Updated weights for policy 1, policy_version 1792366 (0.0007) [2023-12-28 08:06:51,477][106225] Updated weights for policy 1, policy_version 1792376 (0.0007) [2023-12-28 08:06:52,145][106226] Updated weights for policy 0, policy_version 1788238 (0.0009) [2023-12-28 08:06:52,154][106225] Updated weights for policy 1, policy_version 1792386 (0.0006) [2023-12-28 08:06:52,193][106226] Updated weights for policy 0, policy_version 1788248 (0.0007) [2023-12-28 08:06:52,206][106225] Updated weights for policy 1, policy_version 1792396 (0.0007) [2023-12-28 08:06:52,248][106226] Updated weights for policy 0, policy_version 1788258 (0.0007) [2023-12-28 08:06:52,267][106225] Updated weights for policy 1, policy_version 1792406 (0.0009) [2023-12-28 08:06:52,324][106225] Updated weights for policy 1, policy_version 1792416 (0.0009) [2023-12-28 08:06:52,993][106226] Updated weights for policy 0, policy_version 1788268 (0.0007) [2023-12-28 08:06:53,010][106225] Updated weights for policy 1, policy_version 1792426 (0.0009) [2023-12-28 08:06:53,065][106226] Updated weights for policy 0, policy_version 1788278 (0.0005) [2023-12-28 08:06:53,074][106225] Updated weights for policy 1, policy_version 1792436 (0.0008) [2023-12-28 08:06:53,131][106226] Updated weights for policy 0, policy_version 1788288 (0.0005) [2023-12-28 08:06:53,138][106225] Updated weights for policy 1, policy_version 1792446 (0.0008) [2023-12-28 08:06:53,722][106226] Updated weights for policy 0, policy_version 1788298 (0.0006) [2023-12-28 08:06:53,774][106226] Updated weights for policy 0, policy_version 1788308 (0.0008) [2023-12-28 08:06:53,824][106226] Updated weights for policy 0, policy_version 1788318 (0.0007) [2023-12-28 08:06:53,845][106225] Updated weights for policy 1, policy_version 1792456 (0.0008) [2023-12-28 08:06:53,871][106226] Updated weights for policy 0, policy_version 1788328 (0.0006) [2023-12-28 08:06:53,901][106225] Updated weights for policy 1, policy_version 1792466 (0.0008) [2023-12-28 08:06:53,946][106225] Updated weights for policy 1, policy_version 1792476 (0.0008) [2023-12-28 08:06:54,640][106226] Updated weights for policy 0, policy_version 1788338 (0.0009) [2023-12-28 08:06:54,663][106225] Updated weights for policy 1, policy_version 1792486 (0.0007) [2023-12-28 08:06:54,696][106226] Updated weights for policy 0, policy_version 1788348 (0.0007) [2023-12-28 08:06:54,721][106225] Updated weights for policy 1, policy_version 1792496 (0.0007) [2023-12-28 08:06:54,757][106226] Updated weights for policy 0, policy_version 1788358 (0.0007) [2023-12-28 08:06:54,767][106225] Updated weights for policy 1, policy_version 1792506 (0.0006) [2023-12-28 08:06:55,484][106226] Updated weights for policy 0, policy_version 1788368 (0.0008) [2023-12-28 08:06:55,502][106225] Updated weights for policy 1, policy_version 1792516 (0.0008) [2023-12-28 08:06:55,541][106226] Updated weights for policy 0, policy_version 1788378 (0.0007) [2023-12-28 08:06:55,550][106225] Updated weights for policy 1, policy_version 1792526 (0.0007) [2023-12-28 08:06:55,597][106226] Updated weights for policy 0, policy_version 1788388 (0.0007) [2023-12-28 08:06:55,598][106225] Updated weights for policy 1, policy_version 1792536 (0.0007) [2023-12-28 08:06:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19549.7). Total num frames: 916856832. Throughput: 0: 9965.9, 1: 9778.0. Samples: 916831104. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:06:56,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-5.117')] [2023-12-28 08:06:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001792544_458948608.pth... [2023-12-28 08:06:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001791424_458661888.pth [2023-12-28 08:06:56,215][106226] Updated weights for policy 0, policy_version 1788398 (0.0008) [2023-12-28 08:06:56,269][106226] Updated weights for policy 0, policy_version 1788408 (0.0010) [2023-12-28 08:06:56,329][106226] Updated weights for policy 0, policy_version 1788418 (0.0007) [2023-12-28 08:06:56,366][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001788424_457916416.pth... [2023-12-28 08:06:56,369][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001787240_457613312.pth [2023-12-28 08:06:56,397][106225] Updated weights for policy 1, policy_version 1792546 (0.0007) [2023-12-28 08:06:56,450][106225] Updated weights for policy 1, policy_version 1792556 (0.0005) [2023-12-28 08:06:56,507][106225] Updated weights for policy 1, policy_version 1792566 (0.0005) [2023-12-28 08:06:56,561][106225] Updated weights for policy 1, policy_version 1792576 (0.0005) [2023-12-28 08:06:56,982][106226] Updated weights for policy 0, policy_version 1788428 (0.0007) [2023-12-28 08:06:57,033][106226] Updated weights for policy 0, policy_version 1788438 (0.0009) [2023-12-28 08:06:57,086][106226] Updated weights for policy 0, policy_version 1788448 (0.0010) [2023-12-28 08:06:57,143][106225] Updated weights for policy 1, policy_version 1792586 (0.0008) [2023-12-28 08:06:57,195][106225] Updated weights for policy 1, policy_version 1792596 (0.0008) [2023-12-28 08:06:57,245][106225] Updated weights for policy 1, policy_version 1792606 (0.0008) [2023-12-28 08:06:57,699][106226] Updated weights for policy 0, policy_version 1788458 (0.0010) [2023-12-28 08:06:57,764][106226] Updated weights for policy 0, policy_version 1788468 (0.0010) [2023-12-28 08:06:57,818][106226] Updated weights for policy 0, policy_version 1788478 (0.0011) [2023-12-28 08:06:57,881][106226] Updated weights for policy 0, policy_version 1788488 (0.0011) [2023-12-28 08:06:58,033][106225] Updated weights for policy 1, policy_version 1792616 (0.0007) [2023-12-28 08:06:58,080][106225] Updated weights for policy 1, policy_version 1792626 (0.0007) [2023-12-28 08:06:58,129][106225] Updated weights for policy 1, policy_version 1792636 (0.0008) [2023-12-28 08:06:58,685][106226] Updated weights for policy 0, policy_version 1788498 (0.0008) [2023-12-28 08:06:58,747][106226] Updated weights for policy 0, policy_version 1788508 (0.0008) [2023-12-28 08:06:58,817][106226] Updated weights for policy 0, policy_version 1788518 (0.0008) [2023-12-28 08:06:58,984][106225] Updated weights for policy 1, policy_version 1792646 (0.0008) [2023-12-28 08:06:59,044][106225] Updated weights for policy 1, policy_version 1792656 (0.0007) [2023-12-28 08:06:59,108][106225] Updated weights for policy 1, policy_version 1792666 (0.0006) [2023-12-28 08:06:59,617][106226] Updated weights for policy 0, policy_version 1788528 (0.0008) [2023-12-28 08:06:59,689][106226] Updated weights for policy 0, policy_version 1788538 (0.0008) [2023-12-28 08:06:59,748][106226] Updated weights for policy 0, policy_version 1788548 (0.0007) [2023-12-28 08:06:59,836][106225] Updated weights for policy 1, policy_version 1792676 (0.0011) [2023-12-28 08:06:59,900][106225] Updated weights for policy 1, policy_version 1792686 (0.0011) [2023-12-28 08:06:59,974][106225] Updated weights for policy 1, policy_version 1792696 (0.0010) [2023-12-28 08:07:00,530][106226] Updated weights for policy 0, policy_version 1788558 (0.0009) [2023-12-28 08:07:00,580][106226] Updated weights for policy 0, policy_version 1788568 (0.0008) [2023-12-28 08:07:00,637][106226] Updated weights for policy 0, policy_version 1788578 (0.0007) [2023-12-28 08:07:00,698][106225] Updated weights for policy 1, policy_version 1792706 (0.0009) [2023-12-28 08:07:00,754][106225] Updated weights for policy 1, policy_version 1792716 (0.0010) [2023-12-28 08:07:00,819][106225] Updated weights for policy 1, policy_version 1792726 (0.0010) [2023-12-28 08:07:00,871][106225] Updated weights for policy 1, policy_version 1792736 (0.0010) [2023-12-28 08:07:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19577.5). Total num frames: 916955136. Throughput: 0: 9979.6, 1: 9729.6. Samples: 916946700. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:01,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.975')] [2023-12-28 08:07:01,426][106226] Updated weights for policy 0, policy_version 1788588 (0.0008) [2023-12-28 08:07:01,482][106226] Updated weights for policy 0, policy_version 1788598 (0.0008) [2023-12-28 08:07:01,534][106226] Updated weights for policy 0, policy_version 1788608 (0.0008) [2023-12-28 08:07:01,583][106225] Updated weights for policy 1, policy_version 1792746 (0.0011) [2023-12-28 08:07:01,650][106225] Updated weights for policy 1, policy_version 1792756 (0.0010) [2023-12-28 08:07:01,720][106225] Updated weights for policy 1, policy_version 1792766 (0.0007) [2023-12-28 08:07:02,328][106226] Updated weights for policy 0, policy_version 1788618 (0.0010) [2023-12-28 08:07:02,393][106226] Updated weights for policy 0, policy_version 1788628 (0.0008) [2023-12-28 08:07:02,450][106225] Updated weights for policy 1, policy_version 1792776 (0.0007) [2023-12-28 08:07:02,457][106226] Updated weights for policy 0, policy_version 1788638 (0.0006) [2023-12-28 08:07:02,509][106225] Updated weights for policy 1, policy_version 1792786 (0.0009) [2023-12-28 08:07:02,517][106226] Updated weights for policy 0, policy_version 1788648 (0.0010) [2023-12-28 08:07:02,563][106225] Updated weights for policy 1, policy_version 1792796 (0.0007) [2023-12-28 08:07:03,189][106226] Updated weights for policy 0, policy_version 1788658 (0.0010) [2023-12-28 08:07:03,235][106226] Updated weights for policy 0, policy_version 1788668 (0.0010) [2023-12-28 08:07:03,285][106226] Updated weights for policy 0, policy_version 1788678 (0.0007) [2023-12-28 08:07:03,291][106225] Updated weights for policy 1, policy_version 1792806 (0.0006) [2023-12-28 08:07:03,360][106225] Updated weights for policy 1, policy_version 1792816 (0.0005) [2023-12-28 08:07:03,429][106225] Updated weights for policy 1, policy_version 1792826 (0.0010) [2023-12-28 08:07:03,973][106226] Updated weights for policy 0, policy_version 1788688 (0.0010) [2023-12-28 08:07:04,033][106226] Updated weights for policy 0, policy_version 1788698 (0.0011) [2023-12-28 08:07:04,090][106225] Updated weights for policy 1, policy_version 1792836 (0.0008) [2023-12-28 08:07:04,100][106226] Updated weights for policy 0, policy_version 1788708 (0.0009) [2023-12-28 08:07:04,157][106225] Updated weights for policy 1, policy_version 1792846 (0.0007) [2023-12-28 08:07:04,217][106225] Updated weights for policy 1, policy_version 1792856 (0.0008) [2023-12-28 08:07:04,693][106226] Updated weights for policy 0, policy_version 1788718 (0.0010) [2023-12-28 08:07:04,743][106226] Updated weights for policy 0, policy_version 1788728 (0.0009) [2023-12-28 08:07:04,790][106226] Updated weights for policy 0, policy_version 1788738 (0.0007) [2023-12-28 08:07:04,903][106225] Updated weights for policy 1, policy_version 1792866 (0.0008) [2023-12-28 08:07:04,956][106225] Updated weights for policy 1, policy_version 1792876 (0.0009) [2023-12-28 08:07:05,006][106225] Updated weights for policy 1, policy_version 1792886 (0.0009) [2023-12-28 08:07:05,051][106225] Updated weights for policy 1, policy_version 1792896 (0.0008) [2023-12-28 08:07:05,451][106226] Updated weights for policy 0, policy_version 1788748 (0.0006) [2023-12-28 08:07:05,503][106226] Updated weights for policy 0, policy_version 1788758 (0.0005) [2023-12-28 08:07:05,559][106226] Updated weights for policy 0, policy_version 1788768 (0.0005) [2023-12-28 08:07:05,903][106225] Updated weights for policy 1, policy_version 1792906 (0.0008) [2023-12-28 08:07:05,954][106225] Updated weights for policy 1, policy_version 1792916 (0.0009) [2023-12-28 08:07:06,000][106225] Updated weights for policy 1, policy_version 1792926 (0.0009) [2023-12-28 08:07:06,146][106226] Updated weights for policy 0, policy_version 1788778 (0.0007) [2023-12-28 08:07:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19577.5). Total num frames: 917053440. Throughput: 0: 9994.0, 1: 9685.9. Samples: 917063844. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:06,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.651')] [2023-12-28 08:07:06,216][106226] Updated weights for policy 0, policy_version 1788788 (0.0009) [2023-12-28 08:07:06,282][106226] Updated weights for policy 0, policy_version 1788798 (0.0010) [2023-12-28 08:07:06,341][106226] Updated weights for policy 0, policy_version 1788808 (0.0006) [2023-12-28 08:07:06,651][106225] Updated weights for policy 1, policy_version 1792936 (0.0008) [2023-12-28 08:07:06,704][106225] Updated weights for policy 1, policy_version 1792946 (0.0009) [2023-12-28 08:07:06,759][106225] Updated weights for policy 1, policy_version 1792956 (0.0008) [2023-12-28 08:07:07,041][106226] Updated weights for policy 0, policy_version 1788818 (0.0009) [2023-12-28 08:07:07,097][106226] Updated weights for policy 0, policy_version 1788828 (0.0008) [2023-12-28 08:07:07,150][106226] Updated weights for policy 0, policy_version 1788838 (0.0009) [2023-12-28 08:07:07,458][106225] Updated weights for policy 1, policy_version 1792966 (0.0008) [2023-12-28 08:07:07,510][106225] Updated weights for policy 1, policy_version 1792976 (0.0008) [2023-12-28 08:07:07,575][106225] Updated weights for policy 1, policy_version 1792986 (0.0007) [2023-12-28 08:07:07,816][106226] Updated weights for policy 0, policy_version 1788848 (0.0006) [2023-12-28 08:07:07,870][106226] Updated weights for policy 0, policy_version 1788858 (0.0008) [2023-12-28 08:07:07,918][106226] Updated weights for policy 0, policy_version 1788868 (0.0008) [2023-12-28 08:07:08,235][106225] Updated weights for policy 1, policy_version 1792996 (0.0005) [2023-12-28 08:07:08,301][106225] Updated weights for policy 1, policy_version 1793006 (0.0007) [2023-12-28 08:07:08,359][106225] Updated weights for policy 1, policy_version 1793016 (0.0011) [2023-12-28 08:07:08,722][106226] Updated weights for policy 0, policy_version 1788878 (0.0008) [2023-12-28 08:07:08,776][106226] Updated weights for policy 0, policy_version 1788888 (0.0007) [2023-12-28 08:07:08,831][106226] Updated weights for policy 0, policy_version 1788898 (0.0009) [2023-12-28 08:07:08,896][106225] Updated weights for policy 1, policy_version 1793026 (0.0009) [2023-12-28 08:07:08,956][106225] Updated weights for policy 1, policy_version 1793036 (0.0010) [2023-12-28 08:07:09,016][106225] Updated weights for policy 1, policy_version 1793046 (0.0010) [2023-12-28 08:07:09,079][106225] Updated weights for policy 1, policy_version 1793056 (0.0010) [2023-12-28 08:07:09,617][106226] Updated weights for policy 0, policy_version 1788908 (0.0009) [2023-12-28 08:07:09,680][106226] Updated weights for policy 0, policy_version 1788918 (0.0008) [2023-12-28 08:07:09,738][106226] Updated weights for policy 0, policy_version 1788928 (0.0007) [2023-12-28 08:07:09,804][106225] Updated weights for policy 1, policy_version 1793066 (0.0010) [2023-12-28 08:07:09,870][106225] Updated weights for policy 1, policy_version 1793076 (0.0009) [2023-12-28 08:07:09,933][106225] Updated weights for policy 1, policy_version 1793086 (0.0008) [2023-12-28 08:07:10,477][106226] Updated weights for policy 0, policy_version 1788938 (0.0008) [2023-12-28 08:07:10,532][106226] Updated weights for policy 0, policy_version 1788948 (0.0006) [2023-12-28 08:07:10,587][106226] Updated weights for policy 0, policy_version 1788958 (0.0006) [2023-12-28 08:07:10,644][106226] Updated weights for policy 0, policy_version 1788968 (0.0006) [2023-12-28 08:07:10,669][106225] Updated weights for policy 1, policy_version 1793096 (0.0010) [2023-12-28 08:07:10,719][106225] Updated weights for policy 1, policy_version 1793106 (0.0009) [2023-12-28 08:07:10,769][106225] Updated weights for policy 1, policy_version 1793116 (0.0009) [2023-12-28 08:07:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19577.5). Total num frames: 917151744. Throughput: 0: 9971.3, 1: 9749.0. Samples: 917123716. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:11,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.984')] [2023-12-28 08:07:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001793120_459096064.pth... [2023-12-28 08:07:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001792000_458809344.pth [2023-12-28 08:07:11,260][106226] Updated weights for policy 0, policy_version 1788978 (0.0009) [2023-12-28 08:07:11,323][106226] Updated weights for policy 0, policy_version 1788988 (0.0009) [2023-12-28 08:07:11,394][106226] Updated weights for policy 0, policy_version 1788998 (0.0008) [2023-12-28 08:07:11,404][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001789000_458063872.pth... [2023-12-28 08:07:11,407][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001787816_457760768.pth [2023-12-28 08:07:11,688][106225] Updated weights for policy 1, policy_version 1793126 (0.0008) [2023-12-28 08:07:11,756][106225] Updated weights for policy 1, policy_version 1793136 (0.0009) [2023-12-28 08:07:11,815][106225] Updated weights for policy 1, policy_version 1793146 (0.0008) [2023-12-28 08:07:12,173][106226] Updated weights for policy 0, policy_version 1789008 (0.0008) [2023-12-28 08:07:12,237][106226] Updated weights for policy 0, policy_version 1789018 (0.0008) [2023-12-28 08:07:12,309][106226] Updated weights for policy 0, policy_version 1789028 (0.0008) [2023-12-28 08:07:12,551][106225] Updated weights for policy 1, policy_version 1793156 (0.0010) [2023-12-28 08:07:12,611][106225] Updated weights for policy 1, policy_version 1793166 (0.0009) [2023-12-28 08:07:12,673][106225] Updated weights for policy 1, policy_version 1793176 (0.0009) [2023-12-28 08:07:13,047][106226] Updated weights for policy 0, policy_version 1789038 (0.0008) [2023-12-28 08:07:13,109][106226] Updated weights for policy 0, policy_version 1789048 (0.0007) [2023-12-28 08:07:13,172][106226] Updated weights for policy 0, policy_version 1789058 (0.0008) [2023-12-28 08:07:13,424][106225] Updated weights for policy 1, policy_version 1793186 (0.0008) [2023-12-28 08:07:13,471][106225] Updated weights for policy 1, policy_version 1793196 (0.0005) [2023-12-28 08:07:13,516][106225] Updated weights for policy 1, policy_version 1793206 (0.0005) [2023-12-28 08:07:13,572][106225] Updated weights for policy 1, policy_version 1793216 (0.0005) [2023-12-28 08:07:13,920][106226] Updated weights for policy 0, policy_version 1789068 (0.0006) [2023-12-28 08:07:13,986][106226] Updated weights for policy 0, policy_version 1789078 (0.0005) [2023-12-28 08:07:14,045][106226] Updated weights for policy 0, policy_version 1789088 (0.0005) [2023-12-28 08:07:14,103][106225] Updated weights for policy 1, policy_version 1793226 (0.0006) [2023-12-28 08:07:14,160][106225] Updated weights for policy 1, policy_version 1793236 (0.0009) [2023-12-28 08:07:14,208][106225] Updated weights for policy 1, policy_version 1793246 (0.0008) [2023-12-28 08:07:14,693][106226] Updated weights for policy 0, policy_version 1789098 (0.0009) [2023-12-28 08:07:14,763][106226] Updated weights for policy 0, policy_version 1789108 (0.0008) [2023-12-28 08:07:14,831][106226] Updated weights for policy 0, policy_version 1789118 (0.0008) [2023-12-28 08:07:14,888][106226] Updated weights for policy 0, policy_version 1789128 (0.0007) [2023-12-28 08:07:14,907][106225] Updated weights for policy 1, policy_version 1793256 (0.0008) [2023-12-28 08:07:14,967][106225] Updated weights for policy 1, policy_version 1793266 (0.0009) [2023-12-28 08:07:15,027][106225] Updated weights for policy 1, policy_version 1793276 (0.0008) [2023-12-28 08:07:15,600][106226] Updated weights for policy 0, policy_version 1789138 (0.0006) [2023-12-28 08:07:15,657][106226] Updated weights for policy 0, policy_version 1789148 (0.0009) [2023-12-28 08:07:15,707][106226] Updated weights for policy 0, policy_version 1789158 (0.0008) [2023-12-28 08:07:15,766][106225] Updated weights for policy 1, policy_version 1793286 (0.0008) [2023-12-28 08:07:15,823][106225] Updated weights for policy 1, policy_version 1793296 (0.0005) [2023-12-28 08:07:15,878][106225] Updated weights for policy 1, policy_version 1793306 (0.0005) [2023-12-28 08:07:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 917250048. Throughput: 0: 9829.0, 1: 9730.8. Samples: 917240032. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:16,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-5.036')] [2023-12-28 08:07:16,340][106226] Updated weights for policy 0, policy_version 1789168 (0.0008) [2023-12-28 08:07:16,390][106226] Updated weights for policy 0, policy_version 1789178 (0.0007) [2023-12-28 08:07:16,445][106226] Updated weights for policy 0, policy_version 1789188 (0.0006) [2023-12-28 08:07:16,461][106225] Updated weights for policy 1, policy_version 1793316 (0.0008) [2023-12-28 08:07:16,517][106225] Updated weights for policy 1, policy_version 1793326 (0.0010) [2023-12-28 08:07:16,573][106225] Updated weights for policy 1, policy_version 1793336 (0.0012) [2023-12-28 08:07:17,149][106226] Updated weights for policy 0, policy_version 1789198 (0.0007) [2023-12-28 08:07:17,209][106226] Updated weights for policy 0, policy_version 1789208 (0.0009) [2023-12-28 08:07:17,261][106226] Updated weights for policy 0, policy_version 1789218 (0.0009) [2023-12-28 08:07:17,284][106225] Updated weights for policy 1, policy_version 1793346 (0.0008) [2023-12-28 08:07:17,337][106225] Updated weights for policy 1, policy_version 1793356 (0.0009) [2023-12-28 08:07:17,382][106225] Updated weights for policy 1, policy_version 1793366 (0.0007) [2023-12-28 08:07:17,427][106225] Updated weights for policy 1, policy_version 1793376 (0.0008) [2023-12-28 08:07:18,026][106226] Updated weights for policy 0, policy_version 1789228 (0.0007) [2023-12-28 08:07:18,079][106226] Updated weights for policy 0, policy_version 1789238 (0.0006) [2023-12-28 08:07:18,122][106225] Updated weights for policy 1, policy_version 1793386 (0.0007) [2023-12-28 08:07:18,129][106226] Updated weights for policy 0, policy_version 1789248 (0.0007) [2023-12-28 08:07:18,175][106225] Updated weights for policy 1, policy_version 1793396 (0.0005) [2023-12-28 08:07:18,241][106225] Updated weights for policy 1, policy_version 1793406 (0.0005) [2023-12-28 08:07:18,841][106226] Updated weights for policy 0, policy_version 1789258 (0.0008) [2023-12-28 08:07:18,903][106226] Updated weights for policy 0, policy_version 1789268 (0.0006) [2023-12-28 08:07:18,927][106225] Updated weights for policy 1, policy_version 1793416 (0.0008) [2023-12-28 08:07:18,963][106226] Updated weights for policy 0, policy_version 1789278 (0.0006) [2023-12-28 08:07:18,982][106225] Updated weights for policy 1, policy_version 1793426 (0.0008) [2023-12-28 08:07:19,024][106226] Updated weights for policy 0, policy_version 1789288 (0.0006) [2023-12-28 08:07:19,037][106225] Updated weights for policy 1, policy_version 1793436 (0.0006) [2023-12-28 08:07:19,711][106226] Updated weights for policy 0, policy_version 1789298 (0.0007) [2023-12-28 08:07:19,724][106225] Updated weights for policy 1, policy_version 1793446 (0.0009) [2023-12-28 08:07:19,771][106226] Updated weights for policy 0, policy_version 1789308 (0.0006) [2023-12-28 08:07:19,777][106225] Updated weights for policy 1, policy_version 1793456 (0.0006) [2023-12-28 08:07:19,837][106226] Updated weights for policy 0, policy_version 1789318 (0.0007) [2023-12-28 08:07:19,845][106225] Updated weights for policy 1, policy_version 1793466 (0.0007) [2023-12-28 08:07:20,557][106226] Updated weights for policy 0, policy_version 1789328 (0.0007) [2023-12-28 08:07:20,576][106225] Updated weights for policy 1, policy_version 1793476 (0.0008) [2023-12-28 08:07:20,622][106226] Updated weights for policy 0, policy_version 1789338 (0.0008) [2023-12-28 08:07:20,641][106225] Updated weights for policy 1, policy_version 1793486 (0.0009) [2023-12-28 08:07:20,688][106226] Updated weights for policy 0, policy_version 1789348 (0.0008) [2023-12-28 08:07:20,704][106225] Updated weights for policy 1, policy_version 1793496 (0.0008) [2023-12-28 08:07:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19577.5). Total num frames: 917348352. Throughput: 0: 9832.4, 1: 9745.2. Samples: 917359760. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:21,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.757')] [2023-12-28 08:07:21,421][106226] Updated weights for policy 0, policy_version 1789358 (0.0008) [2023-12-28 08:07:21,485][106226] Updated weights for policy 0, policy_version 1789368 (0.0007) [2023-12-28 08:07:21,487][106225] Updated weights for policy 1, policy_version 1793506 (0.0007) [2023-12-28 08:07:21,534][106225] Updated weights for policy 1, policy_version 1793516 (0.0008) [2023-12-28 08:07:21,547][106226] Updated weights for policy 0, policy_version 1789378 (0.0009) [2023-12-28 08:07:21,596][106225] Updated weights for policy 1, policy_version 1793526 (0.0009) [2023-12-28 08:07:21,662][106225] Updated weights for policy 1, policy_version 1793536 (0.0010) [2023-12-28 08:07:22,251][106226] Updated weights for policy 0, policy_version 1789388 (0.0009) [2023-12-28 08:07:22,321][106226] Updated weights for policy 0, policy_version 1789398 (0.0008) [2023-12-28 08:07:22,392][106226] Updated weights for policy 0, policy_version 1789408 (0.0008) [2023-12-28 08:07:22,443][106225] Updated weights for policy 1, policy_version 1793546 (0.0008) [2023-12-28 08:07:22,503][106225] Updated weights for policy 1, policy_version 1793556 (0.0011) [2023-12-28 08:07:22,566][106225] Updated weights for policy 1, policy_version 1793566 (0.0011) [2023-12-28 08:07:23,130][106226] Updated weights for policy 0, policy_version 1789418 (0.0007) [2023-12-28 08:07:23,198][106226] Updated weights for policy 0, policy_version 1789428 (0.0009) [2023-12-28 08:07:23,256][106225] Updated weights for policy 1, policy_version 1793576 (0.0007) [2023-12-28 08:07:23,259][106226] Updated weights for policy 0, policy_version 1789438 (0.0009) [2023-12-28 08:07:23,308][106226] Updated weights for policy 0, policy_version 1789448 (0.0008) [2023-12-28 08:07:23,316][106225] Updated weights for policy 1, policy_version 1793586 (0.0009) [2023-12-28 08:07:23,372][106225] Updated weights for policy 1, policy_version 1793596 (0.0008) [2023-12-28 08:07:24,001][106225] Updated weights for policy 1, policy_version 1793606 (0.0006) [2023-12-28 08:07:24,023][106226] Updated weights for policy 0, policy_version 1789458 (0.0011) [2023-12-28 08:07:24,050][106225] Updated weights for policy 1, policy_version 1793616 (0.0006) [2023-12-28 08:07:24,074][106226] Updated weights for policy 0, policy_version 1789468 (0.0008) [2023-12-28 08:07:24,100][106225] Updated weights for policy 1, policy_version 1793626 (0.0007) [2023-12-28 08:07:24,138][106226] Updated weights for policy 0, policy_version 1789478 (0.0007) [2023-12-28 08:07:24,798][106225] Updated weights for policy 1, policy_version 1793636 (0.0009) [2023-12-28 08:07:24,844][106225] Updated weights for policy 1, policy_version 1793646 (0.0010) [2023-12-28 08:07:24,874][106226] Updated weights for policy 0, policy_version 1789488 (0.0006) [2023-12-28 08:07:24,905][106225] Updated weights for policy 1, policy_version 1793656 (0.0011) [2023-12-28 08:07:24,922][106226] Updated weights for policy 0, policy_version 1789498 (0.0008) [2023-12-28 08:07:24,968][106226] Updated weights for policy 0, policy_version 1789508 (0.0007) [2023-12-28 08:07:25,492][106225] Updated weights for policy 1, policy_version 1793666 (0.0006) [2023-12-28 08:07:25,553][106225] Updated weights for policy 1, policy_version 1793676 (0.0005) [2023-12-28 08:07:25,608][106225] Updated weights for policy 1, policy_version 1793686 (0.0006) [2023-12-28 08:07:25,652][106225] Updated weights for policy 1, policy_version 1793696 (0.0008) [2023-12-28 08:07:25,671][106226] Updated weights for policy 0, policy_version 1789518 (0.0009) [2023-12-28 08:07:25,720][106226] Updated weights for policy 0, policy_version 1789528 (0.0008) [2023-12-28 08:07:25,770][106226] Updated weights for policy 0, policy_version 1789538 (0.0008) [2023-12-28 08:07:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19605.3). Total num frames: 917446656. Throughput: 0: 9793.9, 1: 9747.1. Samples: 917417100. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:26,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-4.683')] [2023-12-28 08:07:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001789544_458203136.pth... [2023-12-28 08:07:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001793696_459243520.pth... [2023-12-28 08:07:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001788424_457916416.pth [2023-12-28 08:07:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001792544_458948608.pth [2023-12-28 08:07:26,311][106225] Updated weights for policy 1, policy_version 1793706 (0.0007) [2023-12-28 08:07:26,368][106225] Updated weights for policy 1, policy_version 1793716 (0.0008) [2023-12-28 08:07:26,417][106225] Updated weights for policy 1, policy_version 1793726 (0.0008) [2023-12-28 08:07:26,488][106226] Updated weights for policy 0, policy_version 1789548 (0.0007) [2023-12-28 08:07:26,548][106226] Updated weights for policy 0, policy_version 1789558 (0.0008) [2023-12-28 08:07:26,600][106226] Updated weights for policy 0, policy_version 1789568 (0.0008) [2023-12-28 08:07:27,157][106225] Updated weights for policy 1, policy_version 1793736 (0.0010) [2023-12-28 08:07:27,217][106225] Updated weights for policy 1, policy_version 1793746 (0.0010) [2023-12-28 08:07:27,269][106225] Updated weights for policy 1, policy_version 1793756 (0.0010) [2023-12-28 08:07:27,282][106226] Updated weights for policy 0, policy_version 1789578 (0.0008) [2023-12-28 08:07:27,339][106226] Updated weights for policy 0, policy_version 1789588 (0.0010) [2023-12-28 08:07:27,401][106226] Updated weights for policy 0, policy_version 1789598 (0.0009) [2023-12-28 08:07:27,464][106226] Updated weights for policy 0, policy_version 1789608 (0.0010) [2023-12-28 08:07:27,910][106225] Updated weights for policy 1, policy_version 1793766 (0.0008) [2023-12-28 08:07:27,964][106225] Updated weights for policy 1, policy_version 1793776 (0.0010) [2023-12-28 08:07:28,013][106226] Updated weights for policy 0, policy_version 1789618 (0.0006) [2023-12-28 08:07:28,032][106225] Updated weights for policy 1, policy_version 1793786 (0.0007) [2023-12-28 08:07:28,074][106226] Updated weights for policy 0, policy_version 1789628 (0.0009) [2023-12-28 08:07:28,135][106226] Updated weights for policy 0, policy_version 1789638 (0.0011) [2023-12-28 08:07:28,754][106225] Updated weights for policy 1, policy_version 1793796 (0.0009) [2023-12-28 08:07:28,768][106226] Updated weights for policy 0, policy_version 1789648 (0.0011) [2023-12-28 08:07:28,797][106225] Updated weights for policy 1, policy_version 1793806 (0.0010) [2023-12-28 08:07:28,825][106226] Updated weights for policy 0, policy_version 1789658 (0.0010) [2023-12-28 08:07:28,851][106225] Updated weights for policy 1, policy_version 1793816 (0.0010) [2023-12-28 08:07:28,878][106226] Updated weights for policy 0, policy_version 1789668 (0.0011) [2023-12-28 08:07:29,547][106225] Updated weights for policy 1, policy_version 1793826 (0.0010) [2023-12-28 08:07:29,576][106226] Updated weights for policy 0, policy_version 1789678 (0.0008) [2023-12-28 08:07:29,601][106225] Updated weights for policy 1, policy_version 1793836 (0.0010) [2023-12-28 08:07:29,642][106226] Updated weights for policy 0, policy_version 1789688 (0.0006) [2023-12-28 08:07:29,662][106225] Updated weights for policy 1, policy_version 1793846 (0.0010) [2023-12-28 08:07:29,704][106226] Updated weights for policy 0, policy_version 1789698 (0.0005) [2023-12-28 08:07:29,723][106225] Updated weights for policy 1, policy_version 1793856 (0.0010) [2023-12-28 08:07:30,372][106226] Updated weights for policy 0, policy_version 1789708 (0.0006) [2023-12-28 08:07:30,428][106226] Updated weights for policy 0, policy_version 1789718 (0.0008) [2023-12-28 08:07:30,462][106225] Updated weights for policy 1, policy_version 1793866 (0.0010) [2023-12-28 08:07:30,483][106226] Updated weights for policy 0, policy_version 1789728 (0.0007) [2023-12-28 08:07:30,515][106225] Updated weights for policy 1, policy_version 1793876 (0.0010) [2023-12-28 08:07:30,571][106225] Updated weights for policy 1, policy_version 1793886 (0.0010) [2023-12-28 08:07:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19605.3). Total num frames: 917544960. Throughput: 0: 9862.8, 1: 9854.3. Samples: 917540104. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:31,175][105115] Avg episode reward: [(0, '-4.473'), (1, '-4.751')] [2023-12-28 08:07:31,182][106226] Updated weights for policy 0, policy_version 1789738 (0.0006) [2023-12-28 08:07:31,246][106226] Updated weights for policy 0, policy_version 1789748 (0.0008) [2023-12-28 08:07:31,313][106226] Updated weights for policy 0, policy_version 1789758 (0.0008) [2023-12-28 08:07:31,318][106225] Updated weights for policy 1, policy_version 1793896 (0.0010) [2023-12-28 08:07:31,372][106225] Updated weights for policy 1, policy_version 1793906 (0.0010) [2023-12-28 08:07:31,382][106226] Updated weights for policy 0, policy_version 1789768 (0.0007) [2023-12-28 08:07:31,440][106225] Updated weights for policy 1, policy_version 1793916 (0.0010) [2023-12-28 08:07:32,127][106226] Updated weights for policy 0, policy_version 1789778 (0.0007) [2023-12-28 08:07:32,153][106225] Updated weights for policy 1, policy_version 1793926 (0.0010) [2023-12-28 08:07:32,179][106226] Updated weights for policy 0, policy_version 1789788 (0.0006) [2023-12-28 08:07:32,211][106225] Updated weights for policy 1, policy_version 1793936 (0.0008) [2023-12-28 08:07:32,237][106226] Updated weights for policy 0, policy_version 1789798 (0.0006) [2023-12-28 08:07:32,281][106225] Updated weights for policy 1, policy_version 1793946 (0.0009) [2023-12-28 08:07:32,901][106226] Updated weights for policy 0, policy_version 1789808 (0.0009) [2023-12-28 08:07:32,966][106226] Updated weights for policy 0, policy_version 1789818 (0.0009) [2023-12-28 08:07:32,981][106225] Updated weights for policy 1, policy_version 1793956 (0.0010) [2023-12-28 08:07:33,032][106226] Updated weights for policy 0, policy_version 1789828 (0.0008) [2023-12-28 08:07:33,038][106225] Updated weights for policy 1, policy_version 1793966 (0.0006) [2023-12-28 08:07:33,095][106225] Updated weights for policy 1, policy_version 1793976 (0.0008) [2023-12-28 08:07:33,565][106226] Updated weights for policy 0, policy_version 1789838 (0.0008) [2023-12-28 08:07:33,621][106226] Updated weights for policy 0, policy_version 1789848 (0.0009) [2023-12-28 08:07:33,675][106226] Updated weights for policy 0, policy_version 1789858 (0.0008) [2023-12-28 08:07:33,837][106225] Updated weights for policy 1, policy_version 1793986 (0.0008) [2023-12-28 08:07:33,888][106225] Updated weights for policy 1, policy_version 1793996 (0.0008) [2023-12-28 08:07:33,942][106225] Updated weights for policy 1, policy_version 1794006 (0.0009) [2023-12-28 08:07:33,990][106225] Updated weights for policy 1, policy_version 1794016 (0.0008) [2023-12-28 08:07:34,374][106226] Updated weights for policy 0, policy_version 1789868 (0.0009) [2023-12-28 08:07:34,432][106226] Updated weights for policy 0, policy_version 1789878 (0.0008) [2023-12-28 08:07:34,496][106226] Updated weights for policy 0, policy_version 1789888 (0.0009) [2023-12-28 08:07:34,685][106225] Updated weights for policy 1, policy_version 1794026 (0.0009) [2023-12-28 08:07:34,742][106225] Updated weights for policy 1, policy_version 1794036 (0.0009) [2023-12-28 08:07:34,796][106225] Updated weights for policy 1, policy_version 1794046 (0.0009) [2023-12-28 08:07:35,199][106226] Updated weights for policy 0, policy_version 1789898 (0.0009) [2023-12-28 08:07:35,255][106226] Updated weights for policy 0, policy_version 1789908 (0.0008) [2023-12-28 08:07:35,310][106226] Updated weights for policy 0, policy_version 1789918 (0.0005) [2023-12-28 08:07:35,374][106226] Updated weights for policy 0, policy_version 1789928 (0.0006) [2023-12-28 08:07:35,503][106225] Updated weights for policy 1, policy_version 1794056 (0.0006) [2023-12-28 08:07:35,556][106225] Updated weights for policy 1, policy_version 1794066 (0.0006) [2023-12-28 08:07:35,606][106225] Updated weights for policy 1, policy_version 1794076 (0.0007) [2023-12-28 08:07:35,912][106226] Updated weights for policy 0, policy_version 1789938 (0.0008) [2023-12-28 08:07:35,976][106226] Updated weights for policy 0, policy_version 1789948 (0.0006) [2023-12-28 08:07:36,022][106226] Updated weights for policy 0, policy_version 1789958 (0.0009) [2023-12-28 08:07:36,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 917651456. Throughput: 0: 9894.2, 1: 9822.7. Samples: 917660140. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:36,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.599')] [2023-12-28 08:07:36,367][106225] Updated weights for policy 1, policy_version 1794086 (0.0008) [2023-12-28 08:07:36,428][106225] Updated weights for policy 1, policy_version 1794096 (0.0009) [2023-12-28 08:07:36,489][106225] Updated weights for policy 1, policy_version 1794106 (0.0008) [2023-12-28 08:07:36,753][106226] Updated weights for policy 0, policy_version 1789968 (0.0009) [2023-12-28 08:07:36,809][106226] Updated weights for policy 0, policy_version 1789978 (0.0008) [2023-12-28 08:07:36,878][106226] Updated weights for policy 0, policy_version 1789988 (0.0010) [2023-12-28 08:07:37,240][106225] Updated weights for policy 1, policy_version 1794116 (0.0009) [2023-12-28 08:07:37,289][106225] Updated weights for policy 1, policy_version 1794126 (0.0008) [2023-12-28 08:07:37,343][106225] Updated weights for policy 1, policy_version 1794136 (0.0009) [2023-12-28 08:07:37,631][106226] Updated weights for policy 0, policy_version 1789998 (0.0008) [2023-12-28 08:07:37,697][106226] Updated weights for policy 0, policy_version 1790008 (0.0008) [2023-12-28 08:07:37,758][106226] Updated weights for policy 0, policy_version 1790018 (0.0009) [2023-12-28 08:07:38,131][106225] Updated weights for policy 1, policy_version 1794146 (0.0009) [2023-12-28 08:07:38,201][106225] Updated weights for policy 1, policy_version 1794156 (0.0009) [2023-12-28 08:07:38,265][106225] Updated weights for policy 1, policy_version 1794166 (0.0008) [2023-12-28 08:07:38,335][106225] Updated weights for policy 1, policy_version 1794176 (0.0008) [2023-12-28 08:07:38,355][106226] Updated weights for policy 0, policy_version 1790028 (0.0008) [2023-12-28 08:07:38,427][106226] Updated weights for policy 0, policy_version 1790038 (0.0008) [2023-12-28 08:07:38,493][106226] Updated weights for policy 0, policy_version 1790048 (0.0007) [2023-12-28 08:07:39,091][106225] Updated weights for policy 1, policy_version 1794186 (0.0008) [2023-12-28 08:07:39,130][106226] Updated weights for policy 0, policy_version 1790058 (0.0006) [2023-12-28 08:07:39,149][106225] Updated weights for policy 1, policy_version 1794196 (0.0009) [2023-12-28 08:07:39,193][106226] Updated weights for policy 0, policy_version 1790068 (0.0007) [2023-12-28 08:07:39,200][106225] Updated weights for policy 1, policy_version 1794206 (0.0007) [2023-12-28 08:07:39,257][106226] Updated weights for policy 0, policy_version 1790078 (0.0008) [2023-12-28 08:07:39,318][106226] Updated weights for policy 0, policy_version 1790088 (0.0007) [2023-12-28 08:07:39,889][106225] Updated weights for policy 1, policy_version 1794216 (0.0007) [2023-12-28 08:07:39,961][106225] Updated weights for policy 1, policy_version 1794226 (0.0008) [2023-12-28 08:07:40,020][106225] Updated weights for policy 1, policy_version 1794236 (0.0008) [2023-12-28 08:07:40,085][106226] Updated weights for policy 0, policy_version 1790098 (0.0009) [2023-12-28 08:07:40,146][106226] Updated weights for policy 0, policy_version 1790108 (0.0009) [2023-12-28 08:07:40,207][106226] Updated weights for policy 0, policy_version 1790118 (0.0007) [2023-12-28 08:07:40,742][106225] Updated weights for policy 1, policy_version 1794246 (0.0008) [2023-12-28 08:07:40,806][106225] Updated weights for policy 1, policy_version 1794256 (0.0008) [2023-12-28 08:07:40,872][106225] Updated weights for policy 1, policy_version 1794266 (0.0008) [2023-12-28 08:07:40,910][106226] Updated weights for policy 0, policy_version 1790128 (0.0007) [2023-12-28 08:07:40,965][106226] Updated weights for policy 0, policy_version 1790138 (0.0009) [2023-12-28 08:07:41,018][106226] Updated weights for policy 0, policy_version 1790148 (0.0008) [2023-12-28 08:07:41,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 917749760. Throughput: 0: 9925.9, 1: 9775.3. Samples: 917717664. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:41,176][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.806')] [2023-12-28 08:07:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001794272_459390976.pth... [2023-12-28 08:07:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001790152_458358784.pth... [2023-12-28 08:07:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001793120_459096064.pth [2023-12-28 08:07:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001789000_458063872.pth [2023-12-28 08:07:41,635][106225] Updated weights for policy 1, policy_version 1794276 (0.0008) [2023-12-28 08:07:41,707][106225] Updated weights for policy 1, policy_version 1794286 (0.0008) [2023-12-28 08:07:41,771][106225] Updated weights for policy 1, policy_version 1794296 (0.0008) [2023-12-28 08:07:41,868][106226] Updated weights for policy 0, policy_version 1790158 (0.0008) [2023-12-28 08:07:41,924][106226] Updated weights for policy 0, policy_version 1790168 (0.0009) [2023-12-28 08:07:41,984][106226] Updated weights for policy 0, policy_version 1790178 (0.0008) [2023-12-28 08:07:42,536][106225] Updated weights for policy 1, policy_version 1794306 (0.0009) [2023-12-28 08:07:42,599][106225] Updated weights for policy 1, policy_version 1794316 (0.0007) [2023-12-28 08:07:42,663][106225] Updated weights for policy 1, policy_version 1794326 (0.0006) [2023-12-28 08:07:42,726][106225] Updated weights for policy 1, policy_version 1794336 (0.0011) [2023-12-28 08:07:42,749][106226] Updated weights for policy 0, policy_version 1790188 (0.0008) [2023-12-28 08:07:42,809][106226] Updated weights for policy 0, policy_version 1790198 (0.0009) [2023-12-28 08:07:42,870][106226] Updated weights for policy 0, policy_version 1790208 (0.0008) [2023-12-28 08:07:43,353][106225] Updated weights for policy 1, policy_version 1794346 (0.0008) [2023-12-28 08:07:43,408][106225] Updated weights for policy 1, policy_version 1794356 (0.0008) [2023-12-28 08:07:43,469][106225] Updated weights for policy 1, policy_version 1794366 (0.0007) [2023-12-28 08:07:43,607][106226] Updated weights for policy 0, policy_version 1790218 (0.0008) [2023-12-28 08:07:43,661][106226] Updated weights for policy 0, policy_version 1790228 (0.0011) [2023-12-28 08:07:43,718][106226] Updated weights for policy 0, policy_version 1790238 (0.0010) [2023-12-28 08:07:43,769][106226] Updated weights for policy 0, policy_version 1790248 (0.0011) [2023-12-28 08:07:44,171][106225] Updated weights for policy 1, policy_version 1794376 (0.0008) [2023-12-28 08:07:44,225][106225] Updated weights for policy 1, policy_version 1794386 (0.0007) [2023-12-28 08:07:44,276][106225] Updated weights for policy 1, policy_version 1794396 (0.0005) [2023-12-28 08:07:44,487][106226] Updated weights for policy 0, policy_version 1790258 (0.0005) [2023-12-28 08:07:44,545][106226] Updated weights for policy 0, policy_version 1790268 (0.0009) [2023-12-28 08:07:44,598][106226] Updated weights for policy 0, policy_version 1790278 (0.0010) [2023-12-28 08:07:45,013][106225] Updated weights for policy 1, policy_version 1794406 (0.0007) [2023-12-28 08:07:45,068][106225] Updated weights for policy 1, policy_version 1794416 (0.0007) [2023-12-28 08:07:45,123][106225] Updated weights for policy 1, policy_version 1794426 (0.0008) [2023-12-28 08:07:45,306][106226] Updated weights for policy 0, policy_version 1790288 (0.0011) [2023-12-28 08:07:45,368][106226] Updated weights for policy 0, policy_version 1790298 (0.0011) [2023-12-28 08:07:45,430][106226] Updated weights for policy 0, policy_version 1790308 (0.0011) [2023-12-28 08:07:45,870][106225] Updated weights for policy 1, policy_version 1794436 (0.0008) [2023-12-28 08:07:45,916][106225] Updated weights for policy 1, policy_version 1794446 (0.0007) [2023-12-28 08:07:45,960][106225] Updated weights for policy 1, policy_version 1794456 (0.0006) [2023-12-28 08:07:46,136][106226] Updated weights for policy 0, policy_version 1790318 (0.0011) [2023-12-28 08:07:46,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 917839872. Throughput: 0: 9887.4, 1: 9792.2. Samples: 917832284. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:46,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-5.058')] [2023-12-28 08:07:46,183][106226] Updated weights for policy 0, policy_version 1790328 (0.0010) [2023-12-28 08:07:46,234][106226] Updated weights for policy 0, policy_version 1790338 (0.0010) [2023-12-28 08:07:46,665][106225] Updated weights for policy 1, policy_version 1794466 (0.0007) [2023-12-28 08:07:46,724][106225] Updated weights for policy 1, policy_version 1794476 (0.0009) [2023-12-28 08:07:46,778][106225] Updated weights for policy 1, policy_version 1794486 (0.0010) [2023-12-28 08:07:46,832][106225] Updated weights for policy 1, policy_version 1794496 (0.0010) [2023-12-28 08:07:46,911][106226] Updated weights for policy 0, policy_version 1790348 (0.0010) [2023-12-28 08:07:46,959][106226] Updated weights for policy 0, policy_version 1790358 (0.0010) [2023-12-28 08:07:47,019][106226] Updated weights for policy 0, policy_version 1790368 (0.0010) [2023-12-28 08:07:47,466][106225] Updated weights for policy 1, policy_version 1794506 (0.0008) [2023-12-28 08:07:47,520][106225] Updated weights for policy 1, policy_version 1794516 (0.0007) [2023-12-28 08:07:47,581][106225] Updated weights for policy 1, policy_version 1794526 (0.0007) [2023-12-28 08:07:47,717][106226] Updated weights for policy 0, policy_version 1790378 (0.0010) [2023-12-28 08:07:47,767][106226] Updated weights for policy 0, policy_version 1790388 (0.0010) [2023-12-28 08:07:47,821][106226] Updated weights for policy 0, policy_version 1790398 (0.0007) [2023-12-28 08:07:47,873][106226] Updated weights for policy 0, policy_version 1790408 (0.0005) [2023-12-28 08:07:48,356][106225] Updated weights for policy 1, policy_version 1794536 (0.0008) [2023-12-28 08:07:48,423][106225] Updated weights for policy 1, policy_version 1794546 (0.0007) [2023-12-28 08:07:48,483][106225] Updated weights for policy 1, policy_version 1794556 (0.0008) [2023-12-28 08:07:48,613][106226] Updated weights for policy 0, policy_version 1790418 (0.0005) [2023-12-28 08:07:48,669][106226] Updated weights for policy 0, policy_version 1790428 (0.0006) [2023-12-28 08:07:48,729][106226] Updated weights for policy 0, policy_version 1790438 (0.0011) [2023-12-28 08:07:49,246][106225] Updated weights for policy 1, policy_version 1794566 (0.0008) [2023-12-28 08:07:49,298][106226] Updated weights for policy 0, policy_version 1790448 (0.0008) [2023-12-28 08:07:49,317][106225] Updated weights for policy 1, policy_version 1794577 (0.0007) [2023-12-28 08:07:49,361][106226] Updated weights for policy 0, policy_version 1790458 (0.0008) [2023-12-28 08:07:49,383][106225] Updated weights for policy 1, policy_version 1794587 (0.0008) [2023-12-28 08:07:49,421][106226] Updated weights for policy 0, policy_version 1790468 (0.0009) [2023-12-28 08:07:50,210][106226] Updated weights for policy 0, policy_version 1790478 (0.0010) [2023-12-28 08:07:50,249][106225] Updated weights for policy 1, policy_version 1794597 (0.0008) [2023-12-28 08:07:50,269][106226] Updated weights for policy 0, policy_version 1790488 (0.0011) [2023-12-28 08:07:50,301][106225] Updated weights for policy 1, policy_version 1794607 (0.0008) [2023-12-28 08:07:50,330][106226] Updated weights for policy 0, policy_version 1790498 (0.0011) [2023-12-28 08:07:50,361][106225] Updated weights for policy 1, policy_version 1794617 (0.0008) [2023-12-28 08:07:50,946][106226] Updated weights for policy 0, policy_version 1790508 (0.0009) [2023-12-28 08:07:50,999][106226] Updated weights for policy 0, policy_version 1790518 (0.0008) [2023-12-28 08:07:51,058][106226] Updated weights for policy 0, policy_version 1790528 (0.0009) [2023-12-28 08:07:51,130][106225] Updated weights for policy 1, policy_version 1794627 (0.0009) [2023-12-28 08:07:51,174][105115] Fps is (10 sec: 18842.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 917938176. Throughput: 0: 9877.6, 1: 9791.0. Samples: 917948928. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:51,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-4.716')] [2023-12-28 08:07:51,192][106225] Updated weights for policy 1, policy_version 1794637 (0.0008) [2023-12-28 08:07:51,261][106225] Updated weights for policy 1, policy_version 1794647 (0.0009) [2023-12-28 08:07:51,870][106226] Updated weights for policy 0, policy_version 1790538 (0.0009) [2023-12-28 08:07:51,927][106226] Updated weights for policy 0, policy_version 1790548 (0.0008) [2023-12-28 08:07:51,993][106226] Updated weights for policy 0, policy_version 1790558 (0.0009) [2023-12-28 08:07:52,027][106225] Updated weights for policy 1, policy_version 1794657 (0.0008) [2023-12-28 08:07:52,060][106226] Updated weights for policy 0, policy_version 1790568 (0.0008) [2023-12-28 08:07:52,080][106225] Updated weights for policy 1, policy_version 1794667 (0.0006) [2023-12-28 08:07:52,130][106225] Updated weights for policy 1, policy_version 1794677 (0.0005) [2023-12-28 08:07:52,189][106225] Updated weights for policy 1, policy_version 1794687 (0.0005) [2023-12-28 08:07:52,809][106226] Updated weights for policy 0, policy_version 1790578 (0.0008) [2023-12-28 08:07:52,835][106225] Updated weights for policy 1, policy_version 1794697 (0.0010) [2023-12-28 08:07:52,877][106226] Updated weights for policy 0, policy_version 1790588 (0.0008) [2023-12-28 08:07:52,908][106225] Updated weights for policy 1, policy_version 1794707 (0.0011) [2023-12-28 08:07:52,932][106226] Updated weights for policy 0, policy_version 1790598 (0.0007) [2023-12-28 08:07:52,965][106225] Updated weights for policy 1, policy_version 1794717 (0.0010) [2023-12-28 08:07:53,611][106225] Updated weights for policy 1, policy_version 1794727 (0.0006) [2023-12-28 08:07:53,657][106226] Updated weights for policy 0, policy_version 1790608 (0.0008) [2023-12-28 08:07:53,661][106225] Updated weights for policy 1, policy_version 1794737 (0.0005) [2023-12-28 08:07:53,707][106225] Updated weights for policy 1, policy_version 1794747 (0.0005) [2023-12-28 08:07:53,715][106226] Updated weights for policy 0, policy_version 1790618 (0.0008) [2023-12-28 08:07:53,770][106226] Updated weights for policy 0, policy_version 1790628 (0.0008) [2023-12-28 08:07:54,312][106225] Updated weights for policy 1, policy_version 1794757 (0.0009) [2023-12-28 08:07:54,363][106225] Updated weights for policy 1, policy_version 1794767 (0.0010) [2023-12-28 08:07:54,413][106225] Updated weights for policy 1, policy_version 1794777 (0.0010) [2023-12-28 08:07:54,502][106226] Updated weights for policy 0, policy_version 1790638 (0.0009) [2023-12-28 08:07:54,552][106226] Updated weights for policy 0, policy_version 1790648 (0.0007) [2023-12-28 08:07:54,603][106226] Updated weights for policy 0, policy_version 1790658 (0.0008) [2023-12-28 08:07:55,144][106225] Updated weights for policy 1, policy_version 1794787 (0.0010) [2023-12-28 08:07:55,200][106225] Updated weights for policy 1, policy_version 1794797 (0.0010) [2023-12-28 08:07:55,263][106225] Updated weights for policy 1, policy_version 1794807 (0.0010) [2023-12-28 08:07:55,273][106226] Updated weights for policy 0, policy_version 1790668 (0.0007) [2023-12-28 08:07:55,329][106226] Updated weights for policy 0, policy_version 1790678 (0.0006) [2023-12-28 08:07:55,383][106226] Updated weights for policy 0, policy_version 1790688 (0.0010) [2023-12-28 08:07:55,894][106225] Updated weights for policy 1, policy_version 1794817 (0.0006) [2023-12-28 08:07:55,944][106225] Updated weights for policy 1, policy_version 1794827 (0.0010) [2023-12-28 08:07:55,994][106225] Updated weights for policy 1, policy_version 1794837 (0.0010) [2023-12-28 08:07:56,019][106226] Updated weights for policy 0, policy_version 1790698 (0.0010) [2023-12-28 08:07:56,054][106225] Updated weights for policy 1, policy_version 1794847 (0.0010) [2023-12-28 08:07:56,080][106226] Updated weights for policy 0, policy_version 1790708 (0.0005) [2023-12-28 08:07:56,147][106226] Updated weights for policy 0, policy_version 1790718 (0.0009) [2023-12-28 08:07:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 918036480. Throughput: 0: 9860.0, 1: 9758.5. Samples: 918006548. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:07:56,175][105115] Avg episode reward: [(0, '-4.246'), (1, '-4.874')] [2023-12-28 08:07:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001794848_459538432.pth... [2023-12-28 08:07:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001793696_459243520.pth [2023-12-28 08:07:56,201][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001790728_458506240.pth... [2023-12-28 08:07:56,203][106226] Updated weights for policy 0, policy_version 1790728 (0.0010) [2023-12-28 08:07:56,204][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001789544_458203136.pth [2023-12-28 08:07:56,790][106225] Updated weights for policy 1, policy_version 1794857 (0.0008) [2023-12-28 08:07:56,843][106225] Updated weights for policy 1, policy_version 1794867 (0.0005) [2023-12-28 08:07:56,857][106226] Updated weights for policy 0, policy_version 1790738 (0.0008) [2023-12-28 08:07:56,896][106225] Updated weights for policy 1, policy_version 1794877 (0.0005) [2023-12-28 08:07:56,908][106226] Updated weights for policy 0, policy_version 1790748 (0.0008) [2023-12-28 08:07:56,952][106226] Updated weights for policy 0, policy_version 1790758 (0.0008) [2023-12-28 08:07:57,523][106225] Updated weights for policy 1, policy_version 1794887 (0.0009) [2023-12-28 08:07:57,578][106225] Updated weights for policy 1, policy_version 1794897 (0.0010) [2023-12-28 08:07:57,631][106225] Updated weights for policy 1, policy_version 1794907 (0.0010) [2023-12-28 08:07:57,639][106226] Updated weights for policy 0, policy_version 1790768 (0.0006) [2023-12-28 08:07:57,697][106226] Updated weights for policy 0, policy_version 1790778 (0.0006) [2023-12-28 08:07:57,757][106226] Updated weights for policy 0, policy_version 1790788 (0.0005) [2023-12-28 08:07:58,353][106226] Updated weights for policy 0, policy_version 1790798 (0.0008) [2023-12-28 08:07:58,426][106226] Updated weights for policy 0, policy_version 1790808 (0.0009) [2023-12-28 08:07:58,448][106225] Updated weights for policy 1, policy_version 1794917 (0.0009) [2023-12-28 08:07:58,488][106226] Updated weights for policy 0, policy_version 1790818 (0.0008) [2023-12-28 08:07:58,512][106225] Updated weights for policy 1, policy_version 1794927 (0.0007) [2023-12-28 08:07:58,578][106225] Updated weights for policy 1, policy_version 1794937 (0.0008) [2023-12-28 08:07:59,278][106226] Updated weights for policy 0, policy_version 1790828 (0.0008) [2023-12-28 08:07:59,348][106225] Updated weights for policy 1, policy_version 1794947 (0.0008) [2023-12-28 08:07:59,349][106226] Updated weights for policy 0, policy_version 1790838 (0.0008) [2023-12-28 08:07:59,428][106226] Updated weights for policy 0, policy_version 1790848 (0.0008) [2023-12-28 08:07:59,430][106225] Updated weights for policy 1, policy_version 1794957 (0.0008) [2023-12-28 08:07:59,489][106225] Updated weights for policy 1, policy_version 1794967 (0.0008) [2023-12-28 08:08:00,154][106226] Updated weights for policy 0, policy_version 1790858 (0.0009) [2023-12-28 08:08:00,206][106226] Updated weights for policy 0, policy_version 1790868 (0.0009) [2023-12-28 08:08:00,248][106225] Updated weights for policy 1, policy_version 1794977 (0.0008) [2023-12-28 08:08:00,258][106226] Updated weights for policy 0, policy_version 1790878 (0.0009) [2023-12-28 08:08:00,308][106225] Updated weights for policy 1, policy_version 1794987 (0.0009) [2023-12-28 08:08:00,313][106226] Updated weights for policy 0, policy_version 1790888 (0.0009) [2023-12-28 08:08:00,359][106225] Updated weights for policy 1, policy_version 1794997 (0.0008) [2023-12-28 08:08:00,422][106225] Updated weights for policy 1, policy_version 1795007 (0.0006) [2023-12-28 08:08:00,933][106226] Updated weights for policy 0, policy_version 1790898 (0.0005) [2023-12-28 08:08:00,982][106226] Updated weights for policy 0, policy_version 1790908 (0.0007) [2023-12-28 08:08:01,001][106225] Updated weights for policy 1, policy_version 1795017 (0.0006) [2023-12-28 08:08:01,049][106226] Updated weights for policy 0, policy_version 1790918 (0.0007) [2023-12-28 08:08:01,070][106225] Updated weights for policy 1, policy_version 1795027 (0.0007) [2023-12-28 08:08:01,142][106225] Updated weights for policy 1, policy_version 1795037 (0.0007) [2023-12-28 08:08:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 918142976. Throughput: 0: 9921.3, 1: 9753.3. Samples: 918125392. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:01,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-5.076')] [2023-12-28 08:08:01,744][106226] Updated weights for policy 0, policy_version 1790928 (0.0009) [2023-12-28 08:08:01,807][106225] Updated weights for policy 1, policy_version 1795047 (0.0008) [2023-12-28 08:08:01,809][106226] Updated weights for policy 0, policy_version 1790938 (0.0008) [2023-12-28 08:08:01,863][106225] Updated weights for policy 1, policy_version 1795057 (0.0006) [2023-12-28 08:08:01,865][106226] Updated weights for policy 0, policy_version 1790948 (0.0006) [2023-12-28 08:08:01,917][106225] Updated weights for policy 1, policy_version 1795067 (0.0007) [2023-12-28 08:08:02,575][106226] Updated weights for policy 0, policy_version 1790958 (0.0005) [2023-12-28 08:08:02,642][106226] Updated weights for policy 0, policy_version 1790968 (0.0005) [2023-12-28 08:08:02,653][106225] Updated weights for policy 1, policy_version 1795077 (0.0009) [2023-12-28 08:08:02,704][106225] Updated weights for policy 1, policy_version 1795087 (0.0010) [2023-12-28 08:08:02,710][106226] Updated weights for policy 0, policy_version 1790978 (0.0005) [2023-12-28 08:08:02,762][106225] Updated weights for policy 1, policy_version 1795097 (0.0009) [2023-12-28 08:08:03,329][106226] Updated weights for policy 0, policy_version 1790988 (0.0008) [2023-12-28 08:08:03,383][106226] Updated weights for policy 0, policy_version 1790998 (0.0010) [2023-12-28 08:08:03,439][106226] Updated weights for policy 0, policy_version 1791008 (0.0010) [2023-12-28 08:08:03,464][106225] Updated weights for policy 1, policy_version 1795107 (0.0010) [2023-12-28 08:08:03,517][106225] Updated weights for policy 1, policy_version 1795117 (0.0010) [2023-12-28 08:08:03,574][106225] Updated weights for policy 1, policy_version 1795127 (0.0010) [2023-12-28 08:08:04,061][106226] Updated weights for policy 0, policy_version 1791018 (0.0010) [2023-12-28 08:08:04,115][106226] Updated weights for policy 0, policy_version 1791028 (0.0011) [2023-12-28 08:08:04,180][106226] Updated weights for policy 0, policy_version 1791038 (0.0011) [2023-12-28 08:08:04,233][106226] Updated weights for policy 0, policy_version 1791048 (0.0010) [2023-12-28 08:08:04,237][106225] Updated weights for policy 1, policy_version 1795137 (0.0010) [2023-12-28 08:08:04,302][106225] Updated weights for policy 1, policy_version 1795147 (0.0010) [2023-12-28 08:08:04,356][106225] Updated weights for policy 1, policy_version 1795157 (0.0010) [2023-12-28 08:08:04,407][106225] Updated weights for policy 1, policy_version 1795167 (0.0010) [2023-12-28 08:08:04,948][106226] Updated weights for policy 0, policy_version 1791058 (0.0010) [2023-12-28 08:08:05,006][106226] Updated weights for policy 0, policy_version 1791068 (0.0011) [2023-12-28 08:08:05,052][106226] Updated weights for policy 0, policy_version 1791078 (0.0010) [2023-12-28 08:08:05,128][106225] Updated weights for policy 1, policy_version 1795177 (0.0010) [2023-12-28 08:08:05,180][106225] Updated weights for policy 1, policy_version 1795187 (0.0010) [2023-12-28 08:08:05,234][106225] Updated weights for policy 1, policy_version 1795197 (0.0010) [2023-12-28 08:08:05,750][106226] Updated weights for policy 0, policy_version 1791088 (0.0007) [2023-12-28 08:08:05,801][106226] Updated weights for policy 0, policy_version 1791098 (0.0007) [2023-12-28 08:08:05,854][106226] Updated weights for policy 0, policy_version 1791108 (0.0010) [2023-12-28 08:08:05,950][106225] Updated weights for policy 1, policy_version 1795207 (0.0010) [2023-12-28 08:08:06,006][106225] Updated weights for policy 1, policy_version 1795217 (0.0010) [2023-12-28 08:08:06,063][106225] Updated weights for policy 1, policy_version 1795227 (0.0010) [2023-12-28 08:08:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 918241280. Throughput: 0: 9960.1, 1: 9749.6. Samples: 918246696. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:06,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.686')] [2023-12-28 08:08:06,540][106226] Updated weights for policy 0, policy_version 1791118 (0.0009) [2023-12-28 08:08:06,606][106226] Updated weights for policy 0, policy_version 1791128 (0.0009) [2023-12-28 08:08:06,665][106226] Updated weights for policy 0, policy_version 1791138 (0.0009) [2023-12-28 08:08:06,857][106225] Updated weights for policy 1, policy_version 1795237 (0.0009) [2023-12-28 08:08:06,913][106225] Updated weights for policy 1, policy_version 1795247 (0.0008) [2023-12-28 08:08:06,963][106225] Updated weights for policy 1, policy_version 1795257 (0.0009) [2023-12-28 08:08:07,421][106226] Updated weights for policy 0, policy_version 1791148 (0.0008) [2023-12-28 08:08:07,477][106226] Updated weights for policy 0, policy_version 1791158 (0.0010) [2023-12-28 08:08:07,545][106226] Updated weights for policy 0, policy_version 1791168 (0.0010) [2023-12-28 08:08:07,560][106225] Updated weights for policy 1, policy_version 1795267 (0.0007) [2023-12-28 08:08:07,613][106225] Updated weights for policy 1, policy_version 1795277 (0.0005) [2023-12-28 08:08:07,667][106225] Updated weights for policy 1, policy_version 1795287 (0.0005) [2023-12-28 08:08:08,146][106226] Updated weights for policy 0, policy_version 1791178 (0.0006) [2023-12-28 08:08:08,208][106226] Updated weights for policy 0, policy_version 1791188 (0.0010) [2023-12-28 08:08:08,268][106226] Updated weights for policy 0, policy_version 1791198 (0.0008) [2023-12-28 08:08:08,268][106225] Updated weights for policy 1, policy_version 1795297 (0.0005) [2023-12-28 08:08:08,329][106225] Updated weights for policy 1, policy_version 1795307 (0.0005) [2023-12-28 08:08:08,333][106226] Updated weights for policy 0, policy_version 1791208 (0.0008) [2023-12-28 08:08:08,394][106225] Updated weights for policy 1, policy_version 1795317 (0.0006) [2023-12-28 08:08:08,450][106225] Updated weights for policy 1, policy_version 1795327 (0.0009) [2023-12-28 08:08:09,052][106226] Updated weights for policy 0, policy_version 1791218 (0.0008) [2023-12-28 08:08:09,088][106225] Updated weights for policy 1, policy_version 1795337 (0.0009) [2023-12-28 08:08:09,096][106226] Updated weights for policy 0, policy_version 1791228 (0.0008) [2023-12-28 08:08:09,144][106226] Updated weights for policy 0, policy_version 1791238 (0.0006) [2023-12-28 08:08:09,145][106225] Updated weights for policy 1, policy_version 1795347 (0.0007) [2023-12-28 08:08:09,202][106225] Updated weights for policy 1, policy_version 1795357 (0.0010) [2023-12-28 08:08:09,919][106226] Updated weights for policy 0, policy_version 1791248 (0.0009) [2023-12-28 08:08:09,978][106225] Updated weights for policy 1, policy_version 1795367 (0.0008) [2023-12-28 08:08:09,987][106226] Updated weights for policy 0, policy_version 1791258 (0.0007) [2023-12-28 08:08:10,037][106225] Updated weights for policy 1, policy_version 1795377 (0.0009) [2023-12-28 08:08:10,051][106226] Updated weights for policy 0, policy_version 1791268 (0.0007) [2023-12-28 08:08:10,099][106225] Updated weights for policy 1, policy_version 1795387 (0.0009) [2023-12-28 08:08:10,761][106226] Updated weights for policy 0, policy_version 1791278 (0.0006) [2023-12-28 08:08:10,818][106226] Updated weights for policy 0, policy_version 1791288 (0.0006) [2023-12-28 08:08:10,844][106225] Updated weights for policy 1, policy_version 1795397 (0.0008) [2023-12-28 08:08:10,870][106226] Updated weights for policy 0, policy_version 1791298 (0.0006) [2023-12-28 08:08:10,904][106225] Updated weights for policy 1, policy_version 1795407 (0.0008) [2023-12-28 08:08:10,956][106225] Updated weights for policy 1, policy_version 1795417 (0.0008) [2023-12-28 08:08:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 918339584. Throughput: 0: 9986.9, 1: 9802.4. Samples: 918307620. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:11,175][105115] Avg episode reward: [(0, '-4.674'), (1, '-4.512')] [2023-12-28 08:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001795424_459685888.pth... [2023-12-28 08:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001791304_458653696.pth... [2023-12-28 08:08:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001794272_459390976.pth [2023-12-28 08:08:11,208][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001790152_458358784.pth [2023-12-28 08:08:11,622][106226] Updated weights for policy 0, policy_version 1791308 (0.0009) [2023-12-28 08:08:11,695][106226] Updated weights for policy 0, policy_version 1791318 (0.0007) [2023-12-28 08:08:11,760][106226] Updated weights for policy 0, policy_version 1791328 (0.0008) [2023-12-28 08:08:11,803][106225] Updated weights for policy 1, policy_version 1795427 (0.0009) [2023-12-28 08:08:11,869][106225] Updated weights for policy 1, policy_version 1795437 (0.0007) [2023-12-28 08:08:11,935][106225] Updated weights for policy 1, policy_version 1795447 (0.0009) [2023-12-28 08:08:12,520][106226] Updated weights for policy 0, policy_version 1791338 (0.0006) [2023-12-28 08:08:12,585][106226] Updated weights for policy 0, policy_version 1791348 (0.0006) [2023-12-28 08:08:12,652][106226] Updated weights for policy 0, policy_version 1791358 (0.0010) [2023-12-28 08:08:12,665][106225] Updated weights for policy 1, policy_version 1795457 (0.0009) [2023-12-28 08:08:12,713][106226] Updated weights for policy 0, policy_version 1791368 (0.0011) [2023-12-28 08:08:12,718][106225] Updated weights for policy 1, policy_version 1795467 (0.0007) [2023-12-28 08:08:12,772][106225] Updated weights for policy 1, policy_version 1795477 (0.0007) [2023-12-28 08:08:12,826][106225] Updated weights for policy 1, policy_version 1795487 (0.0008) [2023-12-28 08:08:13,322][106226] Updated weights for policy 0, policy_version 1791378 (0.0009) [2023-12-28 08:08:13,381][106226] Updated weights for policy 0, policy_version 1791388 (0.0007) [2023-12-28 08:08:13,459][106226] Updated weights for policy 0, policy_version 1791398 (0.0005) [2023-12-28 08:08:13,596][106225] Updated weights for policy 1, policy_version 1795497 (0.0006) [2023-12-28 08:08:13,653][106225] Updated weights for policy 1, policy_version 1795507 (0.0006) [2023-12-28 08:08:13,712][106225] Updated weights for policy 1, policy_version 1795517 (0.0009) [2023-12-28 08:08:14,140][106226] Updated weights for policy 0, policy_version 1791408 (0.0011) [2023-12-28 08:08:14,211][106226] Updated weights for policy 0, policy_version 1791418 (0.0011) [2023-12-28 08:08:14,273][106226] Updated weights for policy 0, policy_version 1791428 (0.0011) [2023-12-28 08:08:14,386][106225] Updated weights for policy 1, policy_version 1795527 (0.0008) [2023-12-28 08:08:14,444][106225] Updated weights for policy 1, policy_version 1795537 (0.0008) [2023-12-28 08:08:14,500][106225] Updated weights for policy 1, policy_version 1795547 (0.0008) [2023-12-28 08:08:14,982][106226] Updated weights for policy 0, policy_version 1791438 (0.0010) [2023-12-28 08:08:15,049][106226] Updated weights for policy 0, policy_version 1791448 (0.0011) [2023-12-28 08:08:15,099][106226] Updated weights for policy 0, policy_version 1791458 (0.0011) [2023-12-28 08:08:15,253][106225] Updated weights for policy 1, policy_version 1795557 (0.0008) [2023-12-28 08:08:15,305][106225] Updated weights for policy 1, policy_version 1795567 (0.0008) [2023-12-28 08:08:15,361][106225] Updated weights for policy 1, policy_version 1795577 (0.0008) [2023-12-28 08:08:15,812][106226] Updated weights for policy 0, policy_version 1791468 (0.0011) [2023-12-28 08:08:15,862][106226] Updated weights for policy 0, policy_version 1791478 (0.0010) [2023-12-28 08:08:15,918][106226] Updated weights for policy 0, policy_version 1791488 (0.0011) [2023-12-28 08:08:16,109][106225] Updated weights for policy 1, policy_version 1795587 (0.0008) [2023-12-28 08:08:16,167][106225] Updated weights for policy 1, policy_version 1795597 (0.0008) [2023-12-28 08:08:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 918429696. Throughput: 0: 9912.2, 1: 9681.0. Samples: 918421796. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:16,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.766')] [2023-12-28 08:08:16,226][106225] Updated weights for policy 1, policy_version 1795607 (0.0009) [2023-12-28 08:08:16,617][106226] Updated weights for policy 0, policy_version 1791498 (0.0010) [2023-12-28 08:08:16,673][106226] Updated weights for policy 0, policy_version 1791508 (0.0008) [2023-12-28 08:08:16,726][106226] Updated weights for policy 0, policy_version 1791518 (0.0005) [2023-12-28 08:08:16,776][106226] Updated weights for policy 0, policy_version 1791528 (0.0005) [2023-12-28 08:08:16,959][106225] Updated weights for policy 1, policy_version 1795617 (0.0009) [2023-12-28 08:08:17,013][106225] Updated weights for policy 1, policy_version 1795627 (0.0010) [2023-12-28 08:08:17,075][106225] Updated weights for policy 1, policy_version 1795637 (0.0010) [2023-12-28 08:08:17,135][106225] Updated weights for policy 1, policy_version 1795647 (0.0010) [2023-12-28 08:08:17,469][106226] Updated weights for policy 0, policy_version 1791538 (0.0011) [2023-12-28 08:08:17,528][106226] Updated weights for policy 0, policy_version 1791548 (0.0010) [2023-12-28 08:08:17,585][106226] Updated weights for policy 0, policy_version 1791558 (0.0011) [2023-12-28 08:08:17,730][106225] Updated weights for policy 1, policy_version 1795657 (0.0006) [2023-12-28 08:08:17,782][106225] Updated weights for policy 1, policy_version 1795667 (0.0007) [2023-12-28 08:08:17,829][106225] Updated weights for policy 1, policy_version 1795677 (0.0005) [2023-12-28 08:08:18,298][106226] Updated weights for policy 0, policy_version 1791568 (0.0011) [2023-12-28 08:08:18,367][106226] Updated weights for policy 0, policy_version 1791578 (0.0010) [2023-12-28 08:08:18,408][106225] Updated weights for policy 1, policy_version 1795687 (0.0005) [2023-12-28 08:08:18,428][106226] Updated weights for policy 0, policy_version 1791588 (0.0011) [2023-12-28 08:08:18,464][106225] Updated weights for policy 1, policy_version 1795697 (0.0007) [2023-12-28 08:08:18,525][106225] Updated weights for policy 1, policy_version 1795707 (0.0008) [2023-12-28 08:08:19,112][106226] Updated weights for policy 0, policy_version 1791598 (0.0008) [2023-12-28 08:08:19,174][106226] Updated weights for policy 0, policy_version 1791608 (0.0005) [2023-12-28 08:08:19,247][106226] Updated weights for policy 0, policy_version 1791618 (0.0007) [2023-12-28 08:08:19,279][106225] Updated weights for policy 1, policy_version 1795717 (0.0008) [2023-12-28 08:08:19,350][106225] Updated weights for policy 1, policy_version 1795727 (0.0008) [2023-12-28 08:08:19,424][106225] Updated weights for policy 1, policy_version 1795737 (0.0007) [2023-12-28 08:08:19,938][106226] Updated weights for policy 0, policy_version 1791628 (0.0008) [2023-12-28 08:08:19,998][106226] Updated weights for policy 0, policy_version 1791638 (0.0007) [2023-12-28 08:08:20,060][106226] Updated weights for policy 0, policy_version 1791648 (0.0008) [2023-12-28 08:08:20,142][106225] Updated weights for policy 1, policy_version 1795747 (0.0006) [2023-12-28 08:08:20,203][106225] Updated weights for policy 1, policy_version 1795757 (0.0006) [2023-12-28 08:08:20,262][106225] Updated weights for policy 1, policy_version 1795767 (0.0006) [2023-12-28 08:08:20,794][106226] Updated weights for policy 0, policy_version 1791658 (0.0008) [2023-12-28 08:08:20,856][106226] Updated weights for policy 0, policy_version 1791668 (0.0009) [2023-12-28 08:08:20,881][106225] Updated weights for policy 1, policy_version 1795777 (0.0006) [2023-12-28 08:08:20,918][106226] Updated weights for policy 0, policy_version 1791678 (0.0007) [2023-12-28 08:08:20,942][106225] Updated weights for policy 1, policy_version 1795787 (0.0008) [2023-12-28 08:08:20,984][106226] Updated weights for policy 0, policy_version 1791688 (0.0007) [2023-12-28 08:08:20,992][106225] Updated weights for policy 1, policy_version 1795797 (0.0007) [2023-12-28 08:08:21,057][106225] Updated weights for policy 1, policy_version 1795807 (0.0008) [2023-12-28 08:08:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 918536192. Throughput: 0: 9832.6, 1: 9742.3. Samples: 918541004. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:21,175][105115] Avg episode reward: [(0, '-4.542'), (1, '-4.829')] [2023-12-28 08:08:21,798][106226] Updated weights for policy 0, policy_version 1791698 (0.0007) [2023-12-28 08:08:21,830][106225] Updated weights for policy 1, policy_version 1795817 (0.0008) [2023-12-28 08:08:21,865][106226] Updated weights for policy 0, policy_version 1791708 (0.0006) [2023-12-28 08:08:21,883][106225] Updated weights for policy 1, policy_version 1795827 (0.0008) [2023-12-28 08:08:21,935][106226] Updated weights for policy 0, policy_version 1791718 (0.0008) [2023-12-28 08:08:21,942][106225] Updated weights for policy 1, policy_version 1795837 (0.0008) [2023-12-28 08:08:22,580][106226] Updated weights for policy 0, policy_version 1791728 (0.0007) [2023-12-28 08:08:22,641][106226] Updated weights for policy 0, policy_version 1791738 (0.0008) [2023-12-28 08:08:22,689][106225] Updated weights for policy 1, policy_version 1795847 (0.0008) [2023-12-28 08:08:22,702][106226] Updated weights for policy 0, policy_version 1791748 (0.0008) [2023-12-28 08:08:22,748][106225] Updated weights for policy 1, policy_version 1795857 (0.0007) [2023-12-28 08:08:22,814][106225] Updated weights for policy 1, policy_version 1795867 (0.0008) [2023-12-28 08:08:23,327][106226] Updated weights for policy 0, policy_version 1791758 (0.0010) [2023-12-28 08:08:23,386][106226] Updated weights for policy 0, policy_version 1791768 (0.0008) [2023-12-28 08:08:23,437][106226] Updated weights for policy 0, policy_version 1791778 (0.0009) [2023-12-28 08:08:23,545][106225] Updated weights for policy 1, policy_version 1795877 (0.0007) [2023-12-28 08:08:23,602][106225] Updated weights for policy 1, policy_version 1795887 (0.0006) [2023-12-28 08:08:23,667][106225] Updated weights for policy 1, policy_version 1795897 (0.0009) [2023-12-28 08:08:24,190][106226] Updated weights for policy 0, policy_version 1791788 (0.0008) [2023-12-28 08:08:24,231][106225] Updated weights for policy 1, policy_version 1795907 (0.0007) [2023-12-28 08:08:24,248][106226] Updated weights for policy 0, policy_version 1791798 (0.0009) [2023-12-28 08:08:24,288][106225] Updated weights for policy 1, policy_version 1795917 (0.0011) [2023-12-28 08:08:24,313][106226] Updated weights for policy 0, policy_version 1791808 (0.0007) [2023-12-28 08:08:24,349][106225] Updated weights for policy 1, policy_version 1795927 (0.0011) [2023-12-28 08:08:24,964][106225] Updated weights for policy 1, policy_version 1795937 (0.0010) [2023-12-28 08:08:25,028][106225] Updated weights for policy 1, policy_version 1795947 (0.0008) [2023-12-28 08:08:25,033][106226] Updated weights for policy 0, policy_version 1791818 (0.0010) [2023-12-28 08:08:25,087][106225] Updated weights for policy 1, policy_version 1795957 (0.0005) [2023-12-28 08:08:25,096][106226] Updated weights for policy 0, policy_version 1791828 (0.0010) [2023-12-28 08:08:25,138][106225] Updated weights for policy 1, policy_version 1795967 (0.0008) [2023-12-28 08:08:25,152][106226] Updated weights for policy 0, policy_version 1791838 (0.0010) [2023-12-28 08:08:25,219][106226] Updated weights for policy 0, policy_version 1791848 (0.0011) [2023-12-28 08:08:25,838][106226] Updated weights for policy 0, policy_version 1791858 (0.0009) [2023-12-28 08:08:25,857][106225] Updated weights for policy 1, policy_version 1795977 (0.0005) [2023-12-28 08:08:25,899][106226] Updated weights for policy 0, policy_version 1791868 (0.0011) [2023-12-28 08:08:25,911][106225] Updated weights for policy 1, policy_version 1795987 (0.0005) [2023-12-28 08:08:25,961][106226] Updated weights for policy 0, policy_version 1791878 (0.0011) [2023-12-28 08:08:25,971][106225] Updated weights for policy 1, policy_version 1795997 (0.0006) [2023-12-28 08:08:26,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 918634496. Throughput: 0: 9822.3, 1: 9762.2. Samples: 918598960. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-28 08:08:26,175][105115] Avg episode reward: [(0, '-4.518'), (1, '-4.550')] [2023-12-28 08:08:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001796000_459833344.pth... [2023-12-28 08:08:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001791880_458801152.pth... [2023-12-28 08:08:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001794848_459538432.pth [2023-12-28 08:08:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001790728_458506240.pth [2023-12-28 08:08:26,519][106225] Updated weights for policy 1, policy_version 1796007 (0.0008) [2023-12-28 08:08:26,575][106225] Updated weights for policy 1, policy_version 1796017 (0.0008) [2023-12-28 08:08:26,624][106225] Updated weights for policy 1, policy_version 1796027 (0.0008) [2023-12-28 08:08:26,629][106226] Updated weights for policy 0, policy_version 1791888 (0.0007) [2023-12-28 08:08:26,673][106226] Updated weights for policy 0, policy_version 1791898 (0.0005) [2023-12-28 08:08:26,724][106226] Updated weights for policy 0, policy_version 1791908 (0.0005) [2023-12-28 08:08:27,263][106226] Updated weights for policy 0, policy_version 1791918 (0.0005) [2023-12-28 08:08:27,316][106226] Updated weights for policy 0, policy_version 1791928 (0.0006) [2023-12-28 08:08:27,368][106226] Updated weights for policy 0, policy_version 1791939 (0.0008) [2023-12-28 08:08:27,441][106225] Updated weights for policy 1, policy_version 1796037 (0.0007) [2023-12-28 08:08:27,495][106225] Updated weights for policy 1, policy_version 1796047 (0.0009) [2023-12-28 08:08:27,544][106225] Updated weights for policy 1, policy_version 1796058 (0.0008) [2023-12-28 08:08:27,987][106226] Updated weights for policy 0, policy_version 1791949 (0.0009) [2023-12-28 08:08:28,042][106226] Updated weights for policy 0, policy_version 1791959 (0.0010) [2023-12-28 08:08:28,095][106226] Updated weights for policy 0, policy_version 1791969 (0.0010) [2023-12-28 08:08:28,188][106225] Updated weights for policy 1, policy_version 1796068 (0.0007) [2023-12-28 08:08:28,242][106225] Updated weights for policy 1, policy_version 1796078 (0.0010) [2023-12-28 08:08:28,291][106225] Updated weights for policy 1, policy_version 1796088 (0.0010) [2023-12-28 08:08:28,815][106226] Updated weights for policy 0, policy_version 1791979 (0.0010) [2023-12-28 08:08:28,871][106226] Updated weights for policy 0, policy_version 1791989 (0.0008) [2023-12-28 08:08:28,927][106226] Updated weights for policy 0, policy_version 1791999 (0.0005) [2023-12-28 08:08:28,997][106225] Updated weights for policy 1, policy_version 1796098 (0.0010) [2023-12-28 08:08:29,056][106225] Updated weights for policy 1, policy_version 1796108 (0.0010) [2023-12-28 08:08:29,115][106225] Updated weights for policy 1, policy_version 1796118 (0.0010) [2023-12-28 08:08:29,177][106225] Updated weights for policy 1, policy_version 1796128 (0.0010) [2023-12-28 08:08:29,596][106226] Updated weights for policy 0, policy_version 1792009 (0.0006) [2023-12-28 08:08:29,654][106226] Updated weights for policy 0, policy_version 1792019 (0.0010) [2023-12-28 08:08:29,708][106226] Updated weights for policy 0, policy_version 1792029 (0.0010) [2023-12-28 08:08:29,770][106226] Updated weights for policy 0, policy_version 1792039 (0.0009) [2023-12-28 08:08:29,906][106225] Updated weights for policy 1, policy_version 1796138 (0.0008) [2023-12-28 08:08:29,969][106225] Updated weights for policy 1, policy_version 1796148 (0.0008) [2023-12-28 08:08:30,033][106225] Updated weights for policy 1, policy_version 1796158 (0.0008) [2023-12-28 08:08:30,465][106226] Updated weights for policy 0, policy_version 1792049 (0.0006) [2023-12-28 08:08:30,517][106226] Updated weights for policy 0, policy_version 1792059 (0.0005) [2023-12-28 08:08:30,563][106226] Updated weights for policy 0, policy_version 1792069 (0.0005) [2023-12-28 08:08:30,678][106225] Updated weights for policy 1, policy_version 1796168 (0.0007) [2023-12-28 08:08:30,730][106225] Updated weights for policy 1, policy_version 1796178 (0.0008) [2023-12-28 08:08:30,780][106225] Updated weights for policy 1, policy_version 1796188 (0.0009) [2023-12-28 08:08:31,105][106226] Updated weights for policy 0, policy_version 1792079 (0.0009) [2023-12-28 08:08:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 918732800. Throughput: 0: 9962.4, 1: 9851.6. Samples: 918723912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:31,175][105115] Avg episode reward: [(0, '-4.626'), (1, '-4.784')] [2023-12-28 08:08:31,183][106226] Updated weights for policy 0, policy_version 1792089 (0.0009) [2023-12-28 08:08:31,241][106226] Updated weights for policy 0, policy_version 1792099 (0.0008) [2023-12-28 08:08:31,460][106225] Updated weights for policy 1, policy_version 1796198 (0.0007) [2023-12-28 08:08:31,513][106225] Updated weights for policy 1, policy_version 1796208 (0.0006) [2023-12-28 08:08:31,566][106225] Updated weights for policy 1, policy_version 1796218 (0.0008) [2023-12-28 08:08:31,863][106226] Updated weights for policy 0, policy_version 1792109 (0.0007) [2023-12-28 08:08:31,923][106226] Updated weights for policy 0, policy_version 1792119 (0.0009) [2023-12-28 08:08:31,990][106226] Updated weights for policy 0, policy_version 1792129 (0.0008) [2023-12-28 08:08:32,355][106225] Updated weights for policy 1, policy_version 1796228 (0.0008) [2023-12-28 08:08:32,423][106225] Updated weights for policy 1, policy_version 1796238 (0.0008) [2023-12-28 08:08:32,483][106225] Updated weights for policy 1, policy_version 1796248 (0.0009) [2023-12-28 08:08:32,663][106226] Updated weights for policy 0, policy_version 1792139 (0.0009) [2023-12-28 08:08:32,726][106226] Updated weights for policy 0, policy_version 1792149 (0.0008) [2023-12-28 08:08:32,788][106226] Updated weights for policy 0, policy_version 1792159 (0.0008) [2023-12-28 08:08:33,185][106225] Updated weights for policy 1, policy_version 1796258 (0.0009) [2023-12-28 08:08:33,235][106225] Updated weights for policy 1, policy_version 1796268 (0.0008) [2023-12-28 08:08:33,289][106225] Updated weights for policy 1, policy_version 1796278 (0.0005) [2023-12-28 08:08:33,344][106225] Updated weights for policy 1, policy_version 1796288 (0.0006) [2023-12-28 08:08:33,555][106226] Updated weights for policy 0, policy_version 1792169 (0.0008) [2023-12-28 08:08:33,618][106226] Updated weights for policy 0, policy_version 1792179 (0.0009) [2023-12-28 08:08:33,681][106226] Updated weights for policy 0, policy_version 1792189 (0.0008) [2023-12-28 08:08:33,740][106226] Updated weights for policy 0, policy_version 1792199 (0.0009) [2023-12-28 08:08:33,965][106225] Updated weights for policy 1, policy_version 1796298 (0.0009) [2023-12-28 08:08:34,027][106225] Updated weights for policy 1, policy_version 1796308 (0.0009) [2023-12-28 08:08:34,089][106225] Updated weights for policy 1, policy_version 1796318 (0.0008) [2023-12-28 08:08:34,431][106226] Updated weights for policy 0, policy_version 1792209 (0.0009) [2023-12-28 08:08:34,498][106226] Updated weights for policy 0, policy_version 1792219 (0.0009) [2023-12-28 08:08:34,563][106226] Updated weights for policy 0, policy_version 1792229 (0.0008) [2023-12-28 08:08:34,834][106225] Updated weights for policy 1, policy_version 1796328 (0.0008) [2023-12-28 08:08:34,894][106225] Updated weights for policy 1, policy_version 1796338 (0.0009) [2023-12-28 08:08:34,956][106225] Updated weights for policy 1, policy_version 1796348 (0.0009) [2023-12-28 08:08:35,219][106226] Updated weights for policy 0, policy_version 1792239 (0.0007) [2023-12-28 08:08:35,277][106226] Updated weights for policy 0, policy_version 1792249 (0.0006) [2023-12-28 08:08:35,337][106226] Updated weights for policy 0, policy_version 1792259 (0.0005) [2023-12-28 08:08:35,716][106225] Updated weights for policy 1, policy_version 1796358 (0.0008) [2023-12-28 08:08:35,776][106225] Updated weights for policy 1, policy_version 1796368 (0.0009) [2023-12-28 08:08:35,825][106225] Updated weights for policy 1, policy_version 1796378 (0.0009) [2023-12-28 08:08:35,957][106226] Updated weights for policy 0, policy_version 1792269 (0.0007) [2023-12-28 08:08:36,012][106226] Updated weights for policy 0, policy_version 1792279 (0.0008) [2023-12-28 08:08:36,060][106226] Updated weights for policy 0, policy_version 1792289 (0.0008) [2023-12-28 08:08:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 918839296. Throughput: 0: 9998.5, 1: 9908.9. Samples: 918844760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:36,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.709')] [2023-12-28 08:08:36,557][106225] Updated weights for policy 1, policy_version 1796388 (0.0009) [2023-12-28 08:08:36,614][106225] Updated weights for policy 1, policy_version 1796398 (0.0008) [2023-12-28 08:08:36,686][106225] Updated weights for policy 1, policy_version 1796408 (0.0011) [2023-12-28 08:08:36,781][106226] Updated weights for policy 0, policy_version 1792299 (0.0007) [2023-12-28 08:08:36,847][106226] Updated weights for policy 0, policy_version 1792309 (0.0006) [2023-12-28 08:08:36,903][106226] Updated weights for policy 0, policy_version 1792319 (0.0007) [2023-12-28 08:08:37,311][106225] Updated weights for policy 1, policy_version 1796418 (0.0007) [2023-12-28 08:08:37,358][106225] Updated weights for policy 1, policy_version 1796428 (0.0010) [2023-12-28 08:08:37,408][106225] Updated weights for policy 1, policy_version 1796438 (0.0010) [2023-12-28 08:08:37,467][106225] Updated weights for policy 1, policy_version 1796448 (0.0006) [2023-12-28 08:08:37,534][106226] Updated weights for policy 0, policy_version 1792329 (0.0006) [2023-12-28 08:08:37,594][106226] Updated weights for policy 0, policy_version 1792339 (0.0006) [2023-12-28 08:08:37,643][106226] Updated weights for policy 0, policy_version 1792349 (0.0005) [2023-12-28 08:08:37,696][106226] Updated weights for policy 0, policy_version 1792359 (0.0005) [2023-12-28 08:08:38,058][106225] Updated weights for policy 1, policy_version 1796458 (0.0010) [2023-12-28 08:08:38,113][106225] Updated weights for policy 1, policy_version 1796468 (0.0010) [2023-12-28 08:08:38,167][106225] Updated weights for policy 1, policy_version 1796478 (0.0010) [2023-12-28 08:08:38,276][106226] Updated weights for policy 0, policy_version 1792369 (0.0005) [2023-12-28 08:08:38,340][106226] Updated weights for policy 0, policy_version 1792379 (0.0007) [2023-12-28 08:08:38,402][106226] Updated weights for policy 0, policy_version 1792389 (0.0006) [2023-12-28 08:08:38,888][106225] Updated weights for policy 1, policy_version 1796488 (0.0010) [2023-12-28 08:08:38,944][106225] Updated weights for policy 1, policy_version 1796498 (0.0008) [2023-12-28 08:08:38,966][106226] Updated weights for policy 0, policy_version 1792399 (0.0006) [2023-12-28 08:08:39,003][106225] Updated weights for policy 1, policy_version 1796508 (0.0010) [2023-12-28 08:08:39,031][106226] Updated weights for policy 0, policy_version 1792409 (0.0006) [2023-12-28 08:08:39,089][106226] Updated weights for policy 0, policy_version 1792419 (0.0007) [2023-12-28 08:08:39,746][106225] Updated weights for policy 1, policy_version 1796518 (0.0010) [2023-12-28 08:08:39,808][106225] Updated weights for policy 1, policy_version 1796528 (0.0010) [2023-12-28 08:08:39,836][106226] Updated weights for policy 0, policy_version 1792429 (0.0009) [2023-12-28 08:08:39,876][106225] Updated weights for policy 1, policy_version 1796538 (0.0012) [2023-12-28 08:08:39,906][106226] Updated weights for policy 0, policy_version 1792439 (0.0011) [2023-12-28 08:08:39,975][106226] Updated weights for policy 0, policy_version 1792449 (0.0010) [2023-12-28 08:08:40,614][106225] Updated weights for policy 1, policy_version 1796548 (0.0012) [2023-12-28 08:08:40,664][106225] Updated weights for policy 1, policy_version 1796558 (0.0010) [2023-12-28 08:08:40,696][106226] Updated weights for policy 0, policy_version 1792459 (0.0008) [2023-12-28 08:08:40,728][106225] Updated weights for policy 1, policy_version 1796568 (0.0010) [2023-12-28 08:08:40,750][106226] Updated weights for policy 0, policy_version 1792469 (0.0008) [2023-12-28 08:08:40,803][106226] Updated weights for policy 0, policy_version 1792479 (0.0005) [2023-12-28 08:08:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 918937600. Throughput: 0: 10123.7, 1: 9934.0. Samples: 918909148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:41,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.844')] [2023-12-28 08:08:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001796576_459980800.pth... [2023-12-28 08:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001792488_458956800.pth... [2023-12-28 08:08:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001795424_459685888.pth [2023-12-28 08:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001791304_458653696.pth [2023-12-28 08:08:41,460][106225] Updated weights for policy 1, policy_version 1796578 (0.0010) [2023-12-28 08:08:41,525][106225] Updated weights for policy 1, policy_version 1796588 (0.0009) [2023-12-28 08:08:41,587][106225] Updated weights for policy 1, policy_version 1796598 (0.0009) [2023-12-28 08:08:41,599][106226] Updated weights for policy 0, policy_version 1792489 (0.0007) [2023-12-28 08:08:41,656][106225] Updated weights for policy 1, policy_version 1796608 (0.0010) [2023-12-28 08:08:41,670][106226] Updated weights for policy 0, policy_version 1792499 (0.0008) [2023-12-28 08:08:41,744][106226] Updated weights for policy 0, policy_version 1792509 (0.0009) [2023-12-28 08:08:41,802][106226] Updated weights for policy 0, policy_version 1792519 (0.0008) [2023-12-28 08:08:42,323][106225] Updated weights for policy 1, policy_version 1796618 (0.0008) [2023-12-28 08:08:42,391][106225] Updated weights for policy 1, policy_version 1796628 (0.0008) [2023-12-28 08:08:42,457][106225] Updated weights for policy 1, policy_version 1796638 (0.0006) [2023-12-28 08:08:42,599][106226] Updated weights for policy 0, policy_version 1792529 (0.0009) [2023-12-28 08:08:42,664][106226] Updated weights for policy 0, policy_version 1792539 (0.0011) [2023-12-28 08:08:42,725][106226] Updated weights for policy 0, policy_version 1792549 (0.0011) [2023-12-28 08:08:43,128][106225] Updated weights for policy 1, policy_version 1796648 (0.0005) [2023-12-28 08:08:43,187][106225] Updated weights for policy 1, policy_version 1796658 (0.0005) [2023-12-28 08:08:43,252][106225] Updated weights for policy 1, policy_version 1796668 (0.0008) [2023-12-28 08:08:43,422][106226] Updated weights for policy 0, policy_version 1792559 (0.0011) [2023-12-28 08:08:43,480][106226] Updated weights for policy 0, policy_version 1792569 (0.0011) [2023-12-28 08:08:43,534][106226] Updated weights for policy 0, policy_version 1792579 (0.0010) [2023-12-28 08:08:43,866][106225] Updated weights for policy 1, policy_version 1796678 (0.0006) [2023-12-28 08:08:43,926][106225] Updated weights for policy 1, policy_version 1796688 (0.0006) [2023-12-28 08:08:43,986][106225] Updated weights for policy 1, policy_version 1796698 (0.0007) [2023-12-28 08:08:44,285][106226] Updated weights for policy 0, policy_version 1792589 (0.0011) [2023-12-28 08:08:44,343][106226] Updated weights for policy 0, policy_version 1792599 (0.0009) [2023-12-28 08:08:44,411][106226] Updated weights for policy 0, policy_version 1792609 (0.0010) [2023-12-28 08:08:44,657][106225] Updated weights for policy 1, policy_version 1796708 (0.0008) [2023-12-28 08:08:44,711][106225] Updated weights for policy 1, policy_version 1796718 (0.0006) [2023-12-28 08:08:44,760][106225] Updated weights for policy 1, policy_version 1796728 (0.0006) [2023-12-28 08:08:45,159][106226] Updated weights for policy 0, policy_version 1792619 (0.0011) [2023-12-28 08:08:45,218][106226] Updated weights for policy 0, policy_version 1792629 (0.0011) [2023-12-28 08:08:45,278][106226] Updated weights for policy 0, policy_version 1792639 (0.0011) [2023-12-28 08:08:45,508][106225] Updated weights for policy 1, policy_version 1796738 (0.0009) [2023-12-28 08:08:45,569][106225] Updated weights for policy 1, policy_version 1796748 (0.0008) [2023-12-28 08:08:45,627][106225] Updated weights for policy 1, policy_version 1796758 (0.0008) [2023-12-28 08:08:45,684][106225] Updated weights for policy 1, policy_version 1796768 (0.0007) [2023-12-28 08:08:45,955][106226] Updated weights for policy 0, policy_version 1792649 (0.0011) [2023-12-28 08:08:46,018][106226] Updated weights for policy 0, policy_version 1792659 (0.0011) [2023-12-28 08:08:46,079][106226] Updated weights for policy 0, policy_version 1792669 (0.0011) [2023-12-28 08:08:46,137][106226] Updated weights for policy 0, policy_version 1792679 (0.0011) [2023-12-28 08:08:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 919035904. Throughput: 0: 10017.5, 1: 9943.0. Samples: 919023616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:46,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.988')] [2023-12-28 08:08:46,419][106225] Updated weights for policy 1, policy_version 1796778 (0.0010) [2023-12-28 08:08:46,479][106225] Updated weights for policy 1, policy_version 1796788 (0.0010) [2023-12-28 08:08:46,536][106225] Updated weights for policy 1, policy_version 1796798 (0.0010) [2023-12-28 08:08:46,809][106226] Updated weights for policy 0, policy_version 1792689 (0.0006) [2023-12-28 08:08:46,857][106226] Updated weights for policy 0, policy_version 1792699 (0.0005) [2023-12-28 08:08:46,905][106226] Updated weights for policy 0, policy_version 1792709 (0.0008) [2023-12-28 08:08:47,183][106225] Updated weights for policy 1, policy_version 1796808 (0.0010) [2023-12-28 08:08:47,237][106225] Updated weights for policy 1, policy_version 1796818 (0.0010) [2023-12-28 08:08:47,291][106225] Updated weights for policy 1, policy_version 1796828 (0.0010) [2023-12-28 08:08:47,611][106226] Updated weights for policy 0, policy_version 1792719 (0.0008) [2023-12-28 08:08:47,662][106226] Updated weights for policy 0, policy_version 1792729 (0.0007) [2023-12-28 08:08:47,714][106226] Updated weights for policy 0, policy_version 1792739 (0.0008) [2023-12-28 08:08:48,019][106225] Updated weights for policy 1, policy_version 1796838 (0.0010) [2023-12-28 08:08:48,076][106225] Updated weights for policy 1, policy_version 1796848 (0.0010) [2023-12-28 08:08:48,130][106225] Updated weights for policy 1, policy_version 1796858 (0.0010) [2023-12-28 08:08:48,404][106226] Updated weights for policy 0, policy_version 1792749 (0.0008) [2023-12-28 08:08:48,460][106226] Updated weights for policy 0, policy_version 1792759 (0.0008) [2023-12-28 08:08:48,518][106226] Updated weights for policy 0, policy_version 1792769 (0.0008) [2023-12-28 08:08:48,812][106225] Updated weights for policy 1, policy_version 1796868 (0.0009) [2023-12-28 08:08:48,866][106225] Updated weights for policy 1, policy_version 1796878 (0.0005) [2023-12-28 08:08:48,913][106225] Updated weights for policy 1, policy_version 1796888 (0.0005) [2023-12-28 08:08:49,307][106226] Updated weights for policy 0, policy_version 1792779 (0.0008) [2023-12-28 08:08:49,371][106226] Updated weights for policy 0, policy_version 1792789 (0.0008) [2023-12-28 08:08:49,427][106226] Updated weights for policy 0, policy_version 1792799 (0.0008) [2023-12-28 08:08:49,524][106225] Updated weights for policy 1, policy_version 1796898 (0.0006) [2023-12-28 08:08:49,589][106225] Updated weights for policy 1, policy_version 1796908 (0.0008) [2023-12-28 08:08:49,655][106225] Updated weights for policy 1, policy_version 1796918 (0.0009) [2023-12-28 08:08:49,709][106225] Updated weights for policy 1, policy_version 1796928 (0.0009) [2023-12-28 08:08:50,075][106226] Updated weights for policy 0, policy_version 1792809 (0.0007) [2023-12-28 08:08:50,140][106226] Updated weights for policy 0, policy_version 1792819 (0.0008) [2023-12-28 08:08:50,204][106226] Updated weights for policy 0, policy_version 1792829 (0.0006) [2023-12-28 08:08:50,269][106226] Updated weights for policy 0, policy_version 1792839 (0.0008) [2023-12-28 08:08:50,531][106225] Updated weights for policy 1, policy_version 1796938 (0.0011) [2023-12-28 08:08:50,598][106225] Updated weights for policy 1, policy_version 1796948 (0.0013) [2023-12-28 08:08:50,662][106225] Updated weights for policy 1, policy_version 1796958 (0.0011) [2023-12-28 08:08:50,966][106226] Updated weights for policy 0, policy_version 1792849 (0.0007) [2023-12-28 08:08:51,031][106226] Updated weights for policy 0, policy_version 1792859 (0.0008) [2023-12-28 08:08:51,091][106226] Updated weights for policy 0, policy_version 1792869 (0.0008) [2023-12-28 08:08:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 919134208. Throughput: 0: 9964.6, 1: 9916.6. Samples: 919141352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:51,175][105115] Avg episode reward: [(0, '-4.538'), (1, '-4.801')] [2023-12-28 08:08:51,402][106225] Updated weights for policy 1, policy_version 1796968 (0.0008) [2023-12-28 08:08:51,467][106225] Updated weights for policy 1, policy_version 1796978 (0.0009) [2023-12-28 08:08:51,528][106225] Updated weights for policy 1, policy_version 1796988 (0.0009) [2023-12-28 08:08:51,852][106226] Updated weights for policy 0, policy_version 1792879 (0.0006) [2023-12-28 08:08:51,921][106226] Updated weights for policy 0, policy_version 1792889 (0.0006) [2023-12-28 08:08:51,977][106226] Updated weights for policy 0, policy_version 1792899 (0.0005) [2023-12-28 08:08:52,359][106225] Updated weights for policy 1, policy_version 1796998 (0.0008) [2023-12-28 08:08:52,421][106225] Updated weights for policy 1, policy_version 1797008 (0.0009) [2023-12-28 08:08:52,497][106225] Updated weights for policy 1, policy_version 1797018 (0.0008) [2023-12-28 08:08:52,611][106226] Updated weights for policy 0, policy_version 1792909 (0.0006) [2023-12-28 08:08:52,678][106226] Updated weights for policy 0, policy_version 1792919 (0.0007) [2023-12-28 08:08:52,741][106226] Updated weights for policy 0, policy_version 1792929 (0.0009) [2023-12-28 08:08:53,150][106225] Updated weights for policy 1, policy_version 1797028 (0.0007) [2023-12-28 08:08:53,208][106225] Updated weights for policy 1, policy_version 1797038 (0.0007) [2023-12-28 08:08:53,270][106225] Updated weights for policy 1, policy_version 1797048 (0.0008) [2023-12-28 08:08:53,454][106226] Updated weights for policy 0, policy_version 1792939 (0.0008) [2023-12-28 08:08:53,518][106226] Updated weights for policy 0, policy_version 1792949 (0.0009) [2023-12-28 08:08:53,572][106226] Updated weights for policy 0, policy_version 1792959 (0.0007) [2023-12-28 08:08:53,977][106225] Updated weights for policy 1, policy_version 1797058 (0.0008) [2023-12-28 08:08:54,032][106225] Updated weights for policy 1, policy_version 1797068 (0.0009) [2023-12-28 08:08:54,081][106225] Updated weights for policy 1, policy_version 1797078 (0.0008) [2023-12-28 08:08:54,131][106225] Updated weights for policy 1, policy_version 1797088 (0.0009) [2023-12-28 08:08:54,204][106226] Updated weights for policy 0, policy_version 1792969 (0.0006) [2023-12-28 08:08:54,251][106226] Updated weights for policy 0, policy_version 1792979 (0.0010) [2023-12-28 08:08:54,304][106226] Updated weights for policy 0, policy_version 1792989 (0.0010) [2023-12-28 08:08:54,363][106226] Updated weights for policy 0, policy_version 1792999 (0.0010) [2023-12-28 08:08:54,927][106225] Updated weights for policy 1, policy_version 1797098 (0.0010) [2023-12-28 08:08:54,980][106225] Updated weights for policy 1, policy_version 1797108 (0.0010) [2023-12-28 08:08:55,035][106226] Updated weights for policy 0, policy_version 1793009 (0.0006) [2023-12-28 08:08:55,039][106225] Updated weights for policy 1, policy_version 1797118 (0.0007) [2023-12-28 08:08:55,097][106226] Updated weights for policy 0, policy_version 1793019 (0.0006) [2023-12-28 08:08:55,151][106226] Updated weights for policy 0, policy_version 1793029 (0.0005) [2023-12-28 08:08:55,658][106225] Updated weights for policy 1, policy_version 1797128 (0.0009) [2023-12-28 08:08:55,711][106225] Updated weights for policy 1, policy_version 1797138 (0.0010) [2023-12-28 08:08:55,764][106225] Updated weights for policy 1, policy_version 1797148 (0.0010) [2023-12-28 08:08:55,802][106226] Updated weights for policy 0, policy_version 1793039 (0.0009) [2023-12-28 08:08:55,853][106226] Updated weights for policy 0, policy_version 1793049 (0.0010) [2023-12-28 08:08:55,909][106226] Updated weights for policy 0, policy_version 1793059 (0.0011) [2023-12-28 08:08:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 919232512. Throughput: 0: 9971.8, 1: 9851.9. Samples: 919199688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:08:56,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-5.283')] [2023-12-28 08:08:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001797152_460128256.pth... [2023-12-28 08:08:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001793064_459104256.pth... [2023-12-28 08:08:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001791880_458801152.pth [2023-12-28 08:08:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001796000_459833344.pth [2023-12-28 08:08:56,460][106225] Updated weights for policy 1, policy_version 1797158 (0.0010) [2023-12-28 08:08:56,512][106225] Updated weights for policy 1, policy_version 1797168 (0.0010) [2023-12-28 08:08:56,570][106226] Updated weights for policy 0, policy_version 1793069 (0.0011) [2023-12-28 08:08:56,572][106225] Updated weights for policy 1, policy_version 1797178 (0.0006) [2023-12-28 08:08:56,617][106226] Updated weights for policy 0, policy_version 1793079 (0.0010) [2023-12-28 08:08:56,679][106226] Updated weights for policy 0, policy_version 1793089 (0.0010) [2023-12-28 08:08:57,210][106225] Updated weights for policy 1, policy_version 1797188 (0.0007) [2023-12-28 08:08:57,261][106225] Updated weights for policy 1, policy_version 1797198 (0.0008) [2023-12-28 08:08:57,316][106225] Updated weights for policy 1, policy_version 1797208 (0.0009) [2023-12-28 08:08:57,360][106226] Updated weights for policy 0, policy_version 1793099 (0.0009) [2023-12-28 08:08:57,411][106226] Updated weights for policy 0, policy_version 1793109 (0.0006) [2023-12-28 08:08:57,458][106226] Updated weights for policy 0, policy_version 1793119 (0.0005) [2023-12-28 08:08:57,983][106226] Updated weights for policy 0, policy_version 1793129 (0.0006) [2023-12-28 08:08:58,031][106225] Updated weights for policy 1, policy_version 1797218 (0.0010) [2023-12-28 08:08:58,042][106226] Updated weights for policy 0, policy_version 1793139 (0.0009) [2023-12-28 08:08:58,080][106225] Updated weights for policy 1, policy_version 1797228 (0.0010) [2023-12-28 08:08:58,094][106226] Updated weights for policy 0, policy_version 1793149 (0.0010) [2023-12-28 08:08:58,129][106225] Updated weights for policy 1, policy_version 1797238 (0.0010) [2023-12-28 08:08:58,152][106226] Updated weights for policy 0, policy_version 1793159 (0.0010) [2023-12-28 08:08:58,183][106225] Updated weights for policy 1, policy_version 1797248 (0.0008) [2023-12-28 08:08:58,961][106226] Updated weights for policy 0, policy_version 1793169 (0.0010) [2023-12-28 08:08:59,025][106226] Updated weights for policy 0, policy_version 1793179 (0.0010) [2023-12-28 08:08:59,031][106225] Updated weights for policy 1, policy_version 1797258 (0.0006) [2023-12-28 08:08:59,093][106226] Updated weights for policy 0, policy_version 1793189 (0.0010) [2023-12-28 08:08:59,098][106225] Updated weights for policy 1, policy_version 1797268 (0.0008) [2023-12-28 08:08:59,160][106225] Updated weights for policy 1, policy_version 1797278 (0.0007) [2023-12-28 08:08:59,888][106226] Updated weights for policy 0, policy_version 1793199 (0.0006) [2023-12-28 08:08:59,957][106226] Updated weights for policy 0, policy_version 1793209 (0.0007) [2023-12-28 08:08:59,990][106225] Updated weights for policy 1, policy_version 1797288 (0.0007) [2023-12-28 08:09:00,027][106226] Updated weights for policy 0, policy_version 1793219 (0.0007) [2023-12-28 08:09:00,043][106225] Updated weights for policy 1, policy_version 1797298 (0.0008) [2023-12-28 08:09:00,087][106225] Updated weights for policy 1, policy_version 1797308 (0.0008) [2023-12-28 08:09:00,601][106226] Updated weights for policy 0, policy_version 1793229 (0.0007) [2023-12-28 08:09:00,648][106226] Updated weights for policy 0, policy_version 1793239 (0.0008) [2023-12-28 08:09:00,699][106226] Updated weights for policy 0, policy_version 1793249 (0.0008) [2023-12-28 08:09:00,768][106225] Updated weights for policy 1, policy_version 1797318 (0.0007) [2023-12-28 08:09:00,825][106225] Updated weights for policy 1, policy_version 1797328 (0.0006) [2023-12-28 08:09:00,880][106225] Updated weights for policy 1, policy_version 1797338 (0.0005) [2023-12-28 08:09:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 919330816. Throughput: 0: 10031.7, 1: 9896.9. Samples: 919318584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:01,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-4.804')] [2023-12-28 08:09:01,531][106226] Updated weights for policy 0, policy_version 1793259 (0.0009) [2023-12-28 08:09:01,562][106225] Updated weights for policy 1, policy_version 1797348 (0.0005) [2023-12-28 08:09:01,595][106226] Updated weights for policy 0, policy_version 1793269 (0.0011) [2023-12-28 08:09:01,632][106225] Updated weights for policy 1, policy_version 1797358 (0.0007) [2023-12-28 08:09:01,660][106226] Updated weights for policy 0, policy_version 1793279 (0.0009) [2023-12-28 08:09:01,691][106225] Updated weights for policy 1, policy_version 1797368 (0.0008) [2023-12-28 08:09:02,285][106226] Updated weights for policy 0, policy_version 1793289 (0.0006) [2023-12-28 08:09:02,344][106226] Updated weights for policy 0, policy_version 1793299 (0.0009) [2023-12-28 08:09:02,360][106225] Updated weights for policy 1, policy_version 1797378 (0.0008) [2023-12-28 08:09:02,405][106226] Updated weights for policy 0, policy_version 1793309 (0.0007) [2023-12-28 08:09:02,419][106225] Updated weights for policy 1, policy_version 1797388 (0.0006) [2023-12-28 08:09:02,470][106226] Updated weights for policy 0, policy_version 1793319 (0.0006) [2023-12-28 08:09:02,485][106225] Updated weights for policy 1, policy_version 1797398 (0.0008) [2023-12-28 08:09:02,551][106225] Updated weights for policy 1, policy_version 1797408 (0.0008) [2023-12-28 08:09:03,153][106226] Updated weights for policy 0, policy_version 1793329 (0.0006) [2023-12-28 08:09:03,170][106225] Updated weights for policy 1, policy_version 1797418 (0.0010) [2023-12-28 08:09:03,214][106226] Updated weights for policy 0, policy_version 1793339 (0.0005) [2023-12-28 08:09:03,220][106225] Updated weights for policy 1, policy_version 1797428 (0.0010) [2023-12-28 08:09:03,271][106226] Updated weights for policy 0, policy_version 1793349 (0.0007) [2023-12-28 08:09:03,273][106225] Updated weights for policy 1, policy_version 1797438 (0.0007) [2023-12-28 08:09:03,819][106226] Updated weights for policy 0, policy_version 1793359 (0.0006) [2023-12-28 08:09:03,878][106226] Updated weights for policy 0, policy_version 1793369 (0.0007) [2023-12-28 08:09:03,928][106226] Updated weights for policy 0, policy_version 1793379 (0.0006) [2023-12-28 08:09:04,039][106225] Updated weights for policy 1, policy_version 1797448 (0.0010) [2023-12-28 08:09:04,101][106225] Updated weights for policy 1, policy_version 1797458 (0.0010) [2023-12-28 08:09:04,148][106225] Updated weights for policy 1, policy_version 1797468 (0.0010) [2023-12-28 08:09:04,637][106226] Updated weights for policy 0, policy_version 1793389 (0.0008) [2023-12-28 08:09:04,685][106226] Updated weights for policy 0, policy_version 1793399 (0.0008) [2023-12-28 08:09:04,743][106226] Updated weights for policy 0, policy_version 1793409 (0.0008) [2023-12-28 08:09:04,883][106225] Updated weights for policy 1, policy_version 1797478 (0.0009) [2023-12-28 08:09:04,941][106225] Updated weights for policy 1, policy_version 1797488 (0.0007) [2023-12-28 08:09:05,003][106225] Updated weights for policy 1, policy_version 1797498 (0.0008) [2023-12-28 08:09:05,443][106226] Updated weights for policy 0, policy_version 1793419 (0.0007) [2023-12-28 08:09:05,502][106226] Updated weights for policy 0, policy_version 1793429 (0.0010) [2023-12-28 08:09:05,555][106226] Updated weights for policy 0, policy_version 1793439 (0.0010) [2023-12-28 08:09:05,728][106225] Updated weights for policy 1, policy_version 1797508 (0.0008) [2023-12-28 08:09:05,787][106225] Updated weights for policy 1, policy_version 1797518 (0.0008) [2023-12-28 08:09:05,840][106225] Updated weights for policy 1, policy_version 1797528 (0.0007) [2023-12-28 08:09:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 919429120. Throughput: 0: 10101.2, 1: 9870.5. Samples: 919439736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:06,175][105115] Avg episode reward: [(0, '-4.327'), (1, '-4.854')] [2023-12-28 08:09:06,261][106226] Updated weights for policy 0, policy_version 1793449 (0.0010) [2023-12-28 08:09:06,327][106226] Updated weights for policy 0, policy_version 1793459 (0.0006) [2023-12-28 08:09:06,389][106226] Updated weights for policy 0, policy_version 1793469 (0.0006) [2023-12-28 08:09:06,454][106226] Updated weights for policy 0, policy_version 1793479 (0.0008) [2023-12-28 08:09:06,565][106225] Updated weights for policy 1, policy_version 1797538 (0.0006) [2023-12-28 08:09:06,630][106225] Updated weights for policy 1, policy_version 1797548 (0.0006) [2023-12-28 08:09:06,697][106225] Updated weights for policy 1, policy_version 1797558 (0.0009) [2023-12-28 08:09:06,754][106225] Updated weights for policy 1, policy_version 1797568 (0.0008) [2023-12-28 08:09:07,213][106226] Updated weights for policy 0, policy_version 1793489 (0.0008) [2023-12-28 08:09:07,272][106226] Updated weights for policy 0, policy_version 1793499 (0.0006) [2023-12-28 08:09:07,325][106226] Updated weights for policy 0, policy_version 1793509 (0.0005) [2023-12-28 08:09:07,386][106225] Updated weights for policy 1, policy_version 1797578 (0.0009) [2023-12-28 08:09:07,439][106225] Updated weights for policy 1, policy_version 1797589 (0.0010) [2023-12-28 08:09:07,498][106225] Updated weights for policy 1, policy_version 1797599 (0.0006) [2023-12-28 08:09:07,939][106226] Updated weights for policy 0, policy_version 1793519 (0.0005) [2023-12-28 08:09:08,014][106226] Updated weights for policy 0, policy_version 1793529 (0.0005) [2023-12-28 08:09:08,078][106226] Updated weights for policy 0, policy_version 1793539 (0.0005) [2023-12-28 08:09:08,108][106225] Updated weights for policy 1, policy_version 1797609 (0.0006) [2023-12-28 08:09:08,175][106225] Updated weights for policy 1, policy_version 1797619 (0.0006) [2023-12-28 08:09:08,236][106225] Updated weights for policy 1, policy_version 1797629 (0.0005) [2023-12-28 08:09:08,718][106226] Updated weights for policy 0, policy_version 1793549 (0.0007) [2023-12-28 08:09:08,781][106226] Updated weights for policy 0, policy_version 1793559 (0.0008) [2023-12-28 08:09:08,849][106226] Updated weights for policy 0, policy_version 1793569 (0.0009) [2023-12-28 08:09:08,871][106225] Updated weights for policy 1, policy_version 1797639 (0.0007) [2023-12-28 08:09:08,918][106225] Updated weights for policy 1, policy_version 1797649 (0.0008) [2023-12-28 08:09:08,968][106225] Updated weights for policy 1, policy_version 1797659 (0.0009) [2023-12-28 08:09:09,497][106226] Updated weights for policy 0, policy_version 1793579 (0.0009) [2023-12-28 08:09:09,550][106226] Updated weights for policy 0, policy_version 1793589 (0.0008) [2023-12-28 08:09:09,609][106226] Updated weights for policy 0, policy_version 1793599 (0.0009) [2023-12-28 08:09:09,780][106225] Updated weights for policy 1, policy_version 1797669 (0.0008) [2023-12-28 08:09:09,843][106225] Updated weights for policy 1, policy_version 1797679 (0.0008) [2023-12-28 08:09:09,912][106225] Updated weights for policy 1, policy_version 1797689 (0.0006) [2023-12-28 08:09:10,427][106226] Updated weights for policy 0, policy_version 1793609 (0.0006) [2023-12-28 08:09:10,484][106226] Updated weights for policy 0, policy_version 1793619 (0.0008) [2023-12-28 08:09:10,537][106225] Updated weights for policy 1, policy_version 1797699 (0.0008) [2023-12-28 08:09:10,539][106226] Updated weights for policy 0, policy_version 1793629 (0.0008) [2023-12-28 08:09:10,584][106226] Updated weights for policy 0, policy_version 1793639 (0.0008) [2023-12-28 08:09:10,586][106225] Updated weights for policy 1, policy_version 1797709 (0.0007) [2023-12-28 08:09:10,636][106225] Updated weights for policy 1, policy_version 1797719 (0.0008) [2023-12-28 08:09:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 919527424. Throughput: 0: 10115.6, 1: 9942.4. Samples: 919501576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:11,175][105115] Avg episode reward: [(0, '-4.134'), (1, '-5.067')] [2023-12-28 08:09:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001797728_460275712.pth... [2023-12-28 08:09:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001793640_459251712.pth... [2023-12-28 08:09:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001796576_459980800.pth [2023-12-28 08:09:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001792488_458956800.pth [2023-12-28 08:09:11,276][106226] Updated weights for policy 0, policy_version 1793649 (0.0009) [2023-12-28 08:09:11,340][106226] Updated weights for policy 0, policy_version 1793659 (0.0009) [2023-12-28 08:09:11,372][106225] Updated weights for policy 1, policy_version 1797731 (0.0010) [2023-12-28 08:09:11,414][106226] Updated weights for policy 0, policy_version 1793669 (0.0007) [2023-12-28 08:09:11,441][106225] Updated weights for policy 1, policy_version 1797741 (0.0009) [2023-12-28 08:09:11,511][106225] Updated weights for policy 1, policy_version 1797751 (0.0008) [2023-12-28 08:09:12,141][106226] Updated weights for policy 0, policy_version 1793679 (0.0010) [2023-12-28 08:09:12,209][106226] Updated weights for policy 0, policy_version 1793689 (0.0011) [2023-12-28 08:09:12,233][106225] Updated weights for policy 1, policy_version 1797761 (0.0007) [2023-12-28 08:09:12,273][106226] Updated weights for policy 0, policy_version 1793699 (0.0007) [2023-12-28 08:09:12,302][106225] Updated weights for policy 1, policy_version 1797771 (0.0007) [2023-12-28 08:09:12,367][106225] Updated weights for policy 1, policy_version 1797781 (0.0008) [2023-12-28 08:09:12,428][106225] Updated weights for policy 1, policy_version 1797791 (0.0009) [2023-12-28 08:09:12,962][106226] Updated weights for policy 0, policy_version 1793709 (0.0006) [2023-12-28 08:09:13,010][106226] Updated weights for policy 0, policy_version 1793719 (0.0005) [2023-12-28 08:09:13,057][106226] Updated weights for policy 0, policy_version 1793729 (0.0006) [2023-12-28 08:09:13,205][106225] Updated weights for policy 1, policy_version 1797801 (0.0009) [2023-12-28 08:09:13,263][106225] Updated weights for policy 1, policy_version 1797811 (0.0009) [2023-12-28 08:09:13,321][106225] Updated weights for policy 1, policy_version 1797821 (0.0009) [2023-12-28 08:09:13,659][106226] Updated weights for policy 0, policy_version 1793739 (0.0006) [2023-12-28 08:09:13,711][106226] Updated weights for policy 0, policy_version 1793749 (0.0008) [2023-12-28 08:09:13,765][106226] Updated weights for policy 0, policy_version 1793759 (0.0009) [2023-12-28 08:09:13,999][106225] Updated weights for policy 1, policy_version 1797831 (0.0009) [2023-12-28 08:09:14,068][106225] Updated weights for policy 1, policy_version 1797841 (0.0008) [2023-12-28 08:09:14,127][106225] Updated weights for policy 1, policy_version 1797851 (0.0008) [2023-12-28 08:09:14,482][106226] Updated weights for policy 0, policy_version 1793769 (0.0009) [2023-12-28 08:09:14,540][106226] Updated weights for policy 0, policy_version 1793779 (0.0008) [2023-12-28 08:09:14,589][106226] Updated weights for policy 0, policy_version 1793789 (0.0009) [2023-12-28 08:09:14,641][106226] Updated weights for policy 0, policy_version 1793799 (0.0008) [2023-12-28 08:09:14,827][106225] Updated weights for policy 1, policy_version 1797861 (0.0008) [2023-12-28 08:09:14,887][106225] Updated weights for policy 1, policy_version 1797871 (0.0009) [2023-12-28 08:09:14,948][106225] Updated weights for policy 1, policy_version 1797881 (0.0008) [2023-12-28 08:09:15,438][106226] Updated weights for policy 0, policy_version 1793809 (0.0008) [2023-12-28 08:09:15,488][106226] Updated weights for policy 0, policy_version 1793819 (0.0008) [2023-12-28 08:09:15,543][106226] Updated weights for policy 0, policy_version 1793829 (0.0008) [2023-12-28 08:09:15,634][106225] Updated weights for policy 1, policy_version 1797891 (0.0008) [2023-12-28 08:09:15,683][106225] Updated weights for policy 1, policy_version 1797901 (0.0008) [2023-12-28 08:09:15,742][106225] Updated weights for policy 1, policy_version 1797911 (0.0008) [2023-12-28 08:09:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 919625728. Throughput: 0: 10019.5, 1: 9843.6. Samples: 919617756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:16,175][105115] Avg episode reward: [(0, '-3.946'), (1, '-4.589')] [2023-12-28 08:09:16,199][106226] Updated weights for policy 0, policy_version 1793839 (0.0009) [2023-12-28 08:09:16,262][106226] Updated weights for policy 0, policy_version 1793849 (0.0008) [2023-12-28 08:09:16,319][106226] Updated weights for policy 0, policy_version 1793859 (0.0008) [2023-12-28 08:09:16,383][106225] Updated weights for policy 1, policy_version 1797921 (0.0008) [2023-12-28 08:09:16,445][106225] Updated weights for policy 1, policy_version 1797931 (0.0010) [2023-12-28 08:09:16,506][106225] Updated weights for policy 1, policy_version 1797941 (0.0008) [2023-12-28 08:09:16,575][106225] Updated weights for policy 1, policy_version 1797951 (0.0007) [2023-12-28 08:09:16,990][106226] Updated weights for policy 0, policy_version 1793869 (0.0008) [2023-12-28 08:09:17,046][106226] Updated weights for policy 0, policy_version 1793879 (0.0008) [2023-12-28 08:09:17,097][106226] Updated weights for policy 0, policy_version 1793889 (0.0008) [2023-12-28 08:09:17,251][106225] Updated weights for policy 1, policy_version 1797961 (0.0006) [2023-12-28 08:09:17,297][106225] Updated weights for policy 1, policy_version 1797971 (0.0010) [2023-12-28 08:09:17,347][106225] Updated weights for policy 1, policy_version 1797981 (0.0010) [2023-12-28 08:09:17,771][106226] Updated weights for policy 0, policy_version 1793899 (0.0008) [2023-12-28 08:09:17,836][106226] Updated weights for policy 0, policy_version 1793909 (0.0007) [2023-12-28 08:09:17,899][106226] Updated weights for policy 0, policy_version 1793919 (0.0008) [2023-12-28 08:09:18,061][106225] Updated weights for policy 1, policy_version 1797991 (0.0009) [2023-12-28 08:09:18,114][106225] Updated weights for policy 1, policy_version 1798001 (0.0008) [2023-12-28 08:09:18,178][106225] Updated weights for policy 1, policy_version 1798011 (0.0006) [2023-12-28 08:09:18,580][106226] Updated weights for policy 0, policy_version 1793929 (0.0007) [2023-12-28 08:09:18,641][106226] Updated weights for policy 0, policy_version 1793939 (0.0008) [2023-12-28 08:09:18,704][106226] Updated weights for policy 0, policy_version 1793949 (0.0007) [2023-12-28 08:09:18,763][106226] Updated weights for policy 0, policy_version 1793959 (0.0008) [2023-12-28 08:09:18,934][106225] Updated weights for policy 1, policy_version 1798021 (0.0010) [2023-12-28 08:09:18,981][106225] Updated weights for policy 1, policy_version 1798031 (0.0010) [2023-12-28 08:09:19,027][106225] Updated weights for policy 1, policy_version 1798041 (0.0010) [2023-12-28 08:09:19,520][106226] Updated weights for policy 0, policy_version 1793969 (0.0009) [2023-12-28 08:09:19,579][106226] Updated weights for policy 0, policy_version 1793979 (0.0010) [2023-12-28 08:09:19,650][106226] Updated weights for policy 0, policy_version 1793989 (0.0008) [2023-12-28 08:09:19,802][106225] Updated weights for policy 1, policy_version 1798051 (0.0009) [2023-12-28 08:09:19,875][106225] Updated weights for policy 1, policy_version 1798061 (0.0007) [2023-12-28 08:09:19,941][106225] Updated weights for policy 1, policy_version 1798071 (0.0009) [2023-12-28 08:09:20,381][106226] Updated weights for policy 0, policy_version 1793999 (0.0006) [2023-12-28 08:09:20,442][106226] Updated weights for policy 0, policy_version 1794009 (0.0006) [2023-12-28 08:09:20,497][106226] Updated weights for policy 0, policy_version 1794019 (0.0006) [2023-12-28 08:09:20,706][106225] Updated weights for policy 1, policy_version 1798081 (0.0008) [2023-12-28 08:09:20,775][106225] Updated weights for policy 1, policy_version 1798091 (0.0010) [2023-12-28 08:09:20,833][106225] Updated weights for policy 1, policy_version 1798101 (0.0009) [2023-12-28 08:09:20,887][106225] Updated weights for policy 1, policy_version 1798111 (0.0010) [2023-12-28 08:09:21,081][106226] Updated weights for policy 0, policy_version 1794029 (0.0006) [2023-12-28 08:09:21,141][106226] Updated weights for policy 0, policy_version 1794039 (0.0008) [2023-12-28 08:09:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 919724032. Throughput: 0: 9989.9, 1: 9824.6. Samples: 919736408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:21,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.653')] [2023-12-28 08:09:21,209][106226] Updated weights for policy 0, policy_version 1794049 (0.0009) [2023-12-28 08:09:21,654][106225] Updated weights for policy 1, policy_version 1798121 (0.0009) [2023-12-28 08:09:21,719][106225] Updated weights for policy 1, policy_version 1798131 (0.0008) [2023-12-28 08:09:21,791][106225] Updated weights for policy 1, policy_version 1798141 (0.0008) [2023-12-28 08:09:21,968][106226] Updated weights for policy 0, policy_version 1794059 (0.0008) [2023-12-28 08:09:22,031][106226] Updated weights for policy 0, policy_version 1794069 (0.0009) [2023-12-28 08:09:22,088][106226] Updated weights for policy 0, policy_version 1794079 (0.0008) [2023-12-28 08:09:22,567][106225] Updated weights for policy 1, policy_version 1798151 (0.0008) [2023-12-28 08:09:22,642][106225] Updated weights for policy 1, policy_version 1798161 (0.0009) [2023-12-28 08:09:22,705][106225] Updated weights for policy 1, policy_version 1798171 (0.0008) [2023-12-28 08:09:22,828][106226] Updated weights for policy 0, policy_version 1794089 (0.0009) [2023-12-28 08:09:22,888][106226] Updated weights for policy 0, policy_version 1794099 (0.0006) [2023-12-28 08:09:22,953][106226] Updated weights for policy 0, policy_version 1794109 (0.0006) [2023-12-28 08:09:23,015][106226] Updated weights for policy 0, policy_version 1794119 (0.0008) [2023-12-28 08:09:23,467][106225] Updated weights for policy 1, policy_version 1798181 (0.0008) [2023-12-28 08:09:23,522][106225] Updated weights for policy 1, policy_version 1798191 (0.0008) [2023-12-28 08:09:23,579][106225] Updated weights for policy 1, policy_version 1798201 (0.0009) [2023-12-28 08:09:23,617][106226] Updated weights for policy 0, policy_version 1794129 (0.0006) [2023-12-28 08:09:23,676][106226] Updated weights for policy 0, policy_version 1794139 (0.0008) [2023-12-28 08:09:23,735][106226] Updated weights for policy 0, policy_version 1794149 (0.0010) [2023-12-28 08:09:24,187][106225] Updated weights for policy 1, policy_version 1798211 (0.0008) [2023-12-28 08:09:24,235][106225] Updated weights for policy 1, policy_version 1798221 (0.0009) [2023-12-28 08:09:24,287][106225] Updated weights for policy 1, policy_version 1798231 (0.0008) [2023-12-28 08:09:24,461][106226] Updated weights for policy 0, policy_version 1794159 (0.0006) [2023-12-28 08:09:24,507][106226] Updated weights for policy 0, policy_version 1794169 (0.0005) [2023-12-28 08:09:24,564][106226] Updated weights for policy 0, policy_version 1794179 (0.0005) [2023-12-28 08:09:24,924][106225] Updated weights for policy 1, policy_version 1798241 (0.0008) [2023-12-28 08:09:24,983][106225] Updated weights for policy 1, policy_version 1798251 (0.0008) [2023-12-28 08:09:25,035][106225] Updated weights for policy 1, policy_version 1798261 (0.0009) [2023-12-28 08:09:25,089][106225] Updated weights for policy 1, policy_version 1798271 (0.0010) [2023-12-28 08:09:25,113][106226] Updated weights for policy 0, policy_version 1794189 (0.0005) [2023-12-28 08:09:25,172][106226] Updated weights for policy 0, policy_version 1794199 (0.0005) [2023-12-28 08:09:25,220][106226] Updated weights for policy 0, policy_version 1794209 (0.0005) [2023-12-28 08:09:25,801][106225] Updated weights for policy 1, policy_version 1798281 (0.0006) [2023-12-28 08:09:25,853][106225] Updated weights for policy 1, policy_version 1798291 (0.0005) [2023-12-28 08:09:25,871][106226] Updated weights for policy 0, policy_version 1794219 (0.0007) [2023-12-28 08:09:25,910][106225] Updated weights for policy 1, policy_version 1798301 (0.0010) [2023-12-28 08:09:25,924][106226] Updated weights for policy 0, policy_version 1794229 (0.0008) [2023-12-28 08:09:25,984][106226] Updated weights for policy 0, policy_version 1794239 (0.0007) [2023-12-28 08:09:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 919830528. Throughput: 0: 9900.6, 1: 9723.0. Samples: 919792212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:26,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.757')] [2023-12-28 08:09:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001798304_460423168.pth... [2023-12-28 08:09:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001794248_459407360.pth... [2023-12-28 08:09:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001793064_459104256.pth [2023-12-28 08:09:26,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001797152_460128256.pth [2023-12-28 08:09:26,537][106225] Updated weights for policy 1, policy_version 1798311 (0.0007) [2023-12-28 08:09:26,562][106226] Updated weights for policy 0, policy_version 1794249 (0.0006) [2023-12-28 08:09:26,594][106225] Updated weights for policy 1, policy_version 1798321 (0.0010) [2023-12-28 08:09:26,611][106226] Updated weights for policy 0, policy_version 1794259 (0.0007) [2023-12-28 08:09:26,649][106225] Updated weights for policy 1, policy_version 1798331 (0.0010) [2023-12-28 08:09:26,667][106226] Updated weights for policy 0, policy_version 1794269 (0.0007) [2023-12-28 08:09:26,735][106226] Updated weights for policy 0, policy_version 1794279 (0.0006) [2023-12-28 08:09:27,284][106225] Updated weights for policy 1, policy_version 1798341 (0.0010) [2023-12-28 08:09:27,341][106225] Updated weights for policy 1, policy_version 1798351 (0.0010) [2023-12-28 08:09:27,360][106226] Updated weights for policy 0, policy_version 1794289 (0.0006) [2023-12-28 08:09:27,399][106225] Updated weights for policy 1, policy_version 1798361 (0.0006) [2023-12-28 08:09:27,412][106226] Updated weights for policy 0, policy_version 1794299 (0.0006) [2023-12-28 08:09:27,476][106226] Updated weights for policy 0, policy_version 1794309 (0.0007) [2023-12-28 08:09:28,007][106225] Updated weights for policy 1, policy_version 1798371 (0.0009) [2023-12-28 08:09:28,069][106225] Updated weights for policy 1, policy_version 1798381 (0.0010) [2023-12-28 08:09:28,097][106226] Updated weights for policy 0, policy_version 1794319 (0.0010) [2023-12-28 08:09:28,125][106225] Updated weights for policy 1, policy_version 1798391 (0.0010) [2023-12-28 08:09:28,150][106226] Updated weights for policy 0, policy_version 1794329 (0.0010) [2023-12-28 08:09:28,206][106226] Updated weights for policy 0, policy_version 1794339 (0.0009) [2023-12-28 08:09:28,825][106225] Updated weights for policy 1, policy_version 1798401 (0.0010) [2023-12-28 08:09:28,889][106225] Updated weights for policy 1, policy_version 1798411 (0.0011) [2023-12-28 08:09:28,908][106226] Updated weights for policy 0, policy_version 1794349 (0.0008) [2023-12-28 08:09:28,948][106225] Updated weights for policy 1, policy_version 1798421 (0.0011) [2023-12-28 08:09:28,956][106226] Updated weights for policy 0, policy_version 1794359 (0.0010) [2023-12-28 08:09:29,002][106225] Updated weights for policy 1, policy_version 1798431 (0.0010) [2023-12-28 08:09:29,003][106226] Updated weights for policy 0, policy_version 1794369 (0.0010) [2023-12-28 08:09:29,690][106225] Updated weights for policy 1, policy_version 1798441 (0.0010) [2023-12-28 08:09:29,739][106226] Updated weights for policy 0, policy_version 1794379 (0.0010) [2023-12-28 08:09:29,746][106225] Updated weights for policy 1, policy_version 1798451 (0.0010) [2023-12-28 08:09:29,800][106225] Updated weights for policy 1, policy_version 1798461 (0.0010) [2023-12-28 08:09:29,802][106226] Updated weights for policy 0, policy_version 1794389 (0.0011) [2023-12-28 08:09:29,869][106226] Updated weights for policy 0, policy_version 1794399 (0.0011) [2023-12-28 08:09:30,535][106225] Updated weights for policy 1, policy_version 1798471 (0.0007) [2023-12-28 08:09:30,588][106226] Updated weights for policy 0, policy_version 1794409 (0.0010) [2023-12-28 08:09:30,597][106225] Updated weights for policy 1, policy_version 1798481 (0.0005) [2023-12-28 08:09:30,638][106226] Updated weights for policy 0, policy_version 1794419 (0.0010) [2023-12-28 08:09:30,654][106225] Updated weights for policy 1, policy_version 1798491 (0.0005) [2023-12-28 08:09:30,681][106226] Updated weights for policy 0, policy_version 1794429 (0.0010) [2023-12-28 08:09:30,730][106226] Updated weights for policy 0, policy_version 1794439 (0.0010) [2023-12-28 08:09:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 919928832. Throughput: 0: 10090.2, 1: 9827.0. Samples: 919919892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:31,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.791')] [2023-12-28 08:09:31,267][106225] Updated weights for policy 1, policy_version 1798501 (0.0006) [2023-12-28 08:09:31,318][106225] Updated weights for policy 1, policy_version 1798511 (0.0007) [2023-12-28 08:09:31,381][106225] Updated weights for policy 1, policy_version 1798521 (0.0009) [2023-12-28 08:09:31,446][106226] Updated weights for policy 0, policy_version 1794449 (0.0007) [2023-12-28 08:09:31,510][106226] Updated weights for policy 0, policy_version 1794459 (0.0009) [2023-12-28 08:09:31,571][106226] Updated weights for policy 0, policy_version 1794469 (0.0008) [2023-12-28 08:09:32,076][106225] Updated weights for policy 1, policy_version 1798531 (0.0007) [2023-12-28 08:09:32,140][106225] Updated weights for policy 1, policy_version 1798541 (0.0005) [2023-12-28 08:09:32,201][106225] Updated weights for policy 1, policy_version 1798551 (0.0006) [2023-12-28 08:09:32,243][106226] Updated weights for policy 0, policy_version 1794479 (0.0010) [2023-12-28 08:09:32,310][106226] Updated weights for policy 0, policy_version 1794489 (0.0008) [2023-12-28 08:09:32,378][106226] Updated weights for policy 0, policy_version 1794499 (0.0008) [2023-12-28 08:09:32,897][106225] Updated weights for policy 1, policy_version 1798561 (0.0007) [2023-12-28 08:09:32,960][106225] Updated weights for policy 1, policy_version 1798571 (0.0008) [2023-12-28 08:09:33,012][106225] Updated weights for policy 1, policy_version 1798581 (0.0009) [2023-12-28 08:09:33,072][106225] Updated weights for policy 1, policy_version 1798591 (0.0009) [2023-12-28 08:09:33,132][106226] Updated weights for policy 0, policy_version 1794509 (0.0009) [2023-12-28 08:09:33,179][106226] Updated weights for policy 0, policy_version 1794519 (0.0006) [2023-12-28 08:09:33,229][106226] Updated weights for policy 0, policy_version 1794529 (0.0005) [2023-12-28 08:09:33,803][106226] Updated weights for policy 0, policy_version 1794539 (0.0005) [2023-12-28 08:09:33,864][106226] Updated weights for policy 0, policy_version 1794549 (0.0005) [2023-12-28 08:09:33,876][106225] Updated weights for policy 1, policy_version 1798601 (0.0008) [2023-12-28 08:09:33,921][106226] Updated weights for policy 0, policy_version 1794559 (0.0005) [2023-12-28 08:09:33,929][106225] Updated weights for policy 1, policy_version 1798611 (0.0008) [2023-12-28 08:09:33,982][106225] Updated weights for policy 1, policy_version 1798621 (0.0008) [2023-12-28 08:09:34,504][106226] Updated weights for policy 0, policy_version 1794569 (0.0006) [2023-12-28 08:09:34,563][106226] Updated weights for policy 0, policy_version 1794579 (0.0009) [2023-12-28 08:09:34,629][106226] Updated weights for policy 0, policy_version 1794589 (0.0007) [2023-12-28 08:09:34,683][106225] Updated weights for policy 1, policy_version 1798631 (0.0008) [2023-12-28 08:09:34,693][106226] Updated weights for policy 0, policy_version 1794599 (0.0008) [2023-12-28 08:09:34,749][106225] Updated weights for policy 1, policy_version 1798641 (0.0008) [2023-12-28 08:09:34,803][106225] Updated weights for policy 1, policy_version 1798651 (0.0009) [2023-12-28 08:09:35,363][106226] Updated weights for policy 0, policy_version 1794609 (0.0008) [2023-12-28 08:09:35,430][106226] Updated weights for policy 0, policy_version 1794619 (0.0008) [2023-12-28 08:09:35,488][106226] Updated weights for policy 0, policy_version 1794629 (0.0008) [2023-12-28 08:09:35,504][106225] Updated weights for policy 1, policy_version 1798661 (0.0008) [2023-12-28 08:09:35,568][106225] Updated weights for policy 1, policy_version 1798671 (0.0009) [2023-12-28 08:09:35,626][106225] Updated weights for policy 1, policy_version 1798681 (0.0008) [2023-12-28 08:09:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 920027136. Throughput: 0: 10139.9, 1: 9829.1. Samples: 920039960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:36,175][105115] Avg episode reward: [(0, '-4.196'), (1, '-4.870')] [2023-12-28 08:09:36,262][106225] Updated weights for policy 1, policy_version 1798691 (0.0008) [2023-12-28 08:09:36,270][106226] Updated weights for policy 0, policy_version 1794639 (0.0008) [2023-12-28 08:09:36,321][106225] Updated weights for policy 1, policy_version 1798701 (0.0006) [2023-12-28 08:09:36,334][106226] Updated weights for policy 0, policy_version 1794649 (0.0008) [2023-12-28 08:09:36,383][106225] Updated weights for policy 1, policy_version 1798711 (0.0007) [2023-12-28 08:09:36,395][106226] Updated weights for policy 0, policy_version 1794659 (0.0009) [2023-12-28 08:09:37,049][106225] Updated weights for policy 1, policy_version 1798721 (0.0008) [2023-12-28 08:09:37,113][106225] Updated weights for policy 1, policy_version 1798731 (0.0008) [2023-12-28 08:09:37,154][106226] Updated weights for policy 0, policy_version 1794669 (0.0007) [2023-12-28 08:09:37,175][106225] Updated weights for policy 1, policy_version 1798741 (0.0007) [2023-12-28 08:09:37,201][106226] Updated weights for policy 0, policy_version 1794679 (0.0007) [2023-12-28 08:09:37,230][106225] Updated weights for policy 1, policy_version 1798751 (0.0007) [2023-12-28 08:09:37,247][106226] Updated weights for policy 0, policy_version 1794689 (0.0008) [2023-12-28 08:09:37,894][106225] Updated weights for policy 1, policy_version 1798761 (0.0007) [2023-12-28 08:09:37,949][106225] Updated weights for policy 1, policy_version 1798771 (0.0005) [2023-12-28 08:09:38,003][106225] Updated weights for policy 1, policy_version 1798781 (0.0005) [2023-12-28 08:09:38,018][106226] Updated weights for policy 0, policy_version 1794699 (0.0008) [2023-12-28 08:09:38,071][106226] Updated weights for policy 0, policy_version 1794709 (0.0009) [2023-12-28 08:09:38,121][106226] Updated weights for policy 0, policy_version 1794719 (0.0009) [2023-12-28 08:09:38,693][106225] Updated weights for policy 1, policy_version 1798791 (0.0008) [2023-12-28 08:09:38,749][106225] Updated weights for policy 1, policy_version 1798801 (0.0008) [2023-12-28 08:09:38,809][106225] Updated weights for policy 1, policy_version 1798811 (0.0009) [2023-12-28 08:09:38,836][106226] Updated weights for policy 0, policy_version 1794729 (0.0009) [2023-12-28 08:09:38,893][106226] Updated weights for policy 0, policy_version 1794739 (0.0008) [2023-12-28 08:09:38,952][106226] Updated weights for policy 0, policy_version 1794749 (0.0008) [2023-12-28 08:09:39,005][106226] Updated weights for policy 0, policy_version 1794759 (0.0008) [2023-12-28 08:09:39,566][106225] Updated weights for policy 1, policy_version 1798821 (0.0008) [2023-12-28 08:09:39,628][106225] Updated weights for policy 1, policy_version 1798831 (0.0007) [2023-12-28 08:09:39,695][106225] Updated weights for policy 1, policy_version 1798841 (0.0008) [2023-12-28 08:09:39,811][106226] Updated weights for policy 0, policy_version 1794769 (0.0009) [2023-12-28 08:09:39,880][106226] Updated weights for policy 0, policy_version 1794779 (0.0011) [2023-12-28 08:09:39,946][106226] Updated weights for policy 0, policy_version 1794789 (0.0011) [2023-12-28 08:09:40,412][106225] Updated weights for policy 1, policy_version 1798851 (0.0008) [2023-12-28 08:09:40,471][106225] Updated weights for policy 1, policy_version 1798861 (0.0008) [2023-12-28 08:09:40,524][106225] Updated weights for policy 1, policy_version 1798871 (0.0007) [2023-12-28 08:09:40,707][106226] Updated weights for policy 0, policy_version 1794799 (0.0010) [2023-12-28 08:09:40,769][106226] Updated weights for policy 0, policy_version 1794809 (0.0006) [2023-12-28 08:09:40,838][106226] Updated weights for policy 0, policy_version 1794819 (0.0009) [2023-12-28 08:09:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 920125440. Throughput: 0: 10089.8, 1: 9899.6. Samples: 920099208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:41,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-5.027')] [2023-12-28 08:09:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001798880_460570624.pth... [2023-12-28 08:09:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001794824_459554816.pth... [2023-12-28 08:09:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001797728_460275712.pth [2023-12-28 08:09:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001793640_459251712.pth [2023-12-28 08:09:41,335][106225] Updated weights for policy 1, policy_version 1798881 (0.0008) [2023-12-28 08:09:41,405][106225] Updated weights for policy 1, policy_version 1798891 (0.0008) [2023-12-28 08:09:41,461][106225] Updated weights for policy 1, policy_version 1798901 (0.0008) [2023-12-28 08:09:41,520][106225] Updated weights for policy 1, policy_version 1798911 (0.0008) [2023-12-28 08:09:41,548][106226] Updated weights for policy 0, policy_version 1794829 (0.0010) [2023-12-28 08:09:41,615][106226] Updated weights for policy 0, policy_version 1794839 (0.0009) [2023-12-28 08:09:41,686][106226] Updated weights for policy 0, policy_version 1794849 (0.0008) [2023-12-28 08:09:42,229][106225] Updated weights for policy 1, policy_version 1798921 (0.0009) [2023-12-28 08:09:42,298][106225] Updated weights for policy 1, policy_version 1798931 (0.0008) [2023-12-28 08:09:42,371][106225] Updated weights for policy 1, policy_version 1798941 (0.0007) [2023-12-28 08:09:42,462][106226] Updated weights for policy 0, policy_version 1794859 (0.0009) [2023-12-28 08:09:42,518][106226] Updated weights for policy 0, policy_version 1794869 (0.0009) [2023-12-28 08:09:42,575][106226] Updated weights for policy 0, policy_version 1794879 (0.0009) [2023-12-28 08:09:42,985][106225] Updated weights for policy 1, policy_version 1798951 (0.0008) [2023-12-28 08:09:43,045][106225] Updated weights for policy 1, policy_version 1798961 (0.0007) [2023-12-28 08:09:43,099][106225] Updated weights for policy 1, policy_version 1798971 (0.0007) [2023-12-28 08:09:43,336][106226] Updated weights for policy 0, policy_version 1794889 (0.0009) [2023-12-28 08:09:43,399][106226] Updated weights for policy 0, policy_version 1794899 (0.0011) [2023-12-28 08:09:43,446][106226] Updated weights for policy 0, policy_version 1794909 (0.0011) [2023-12-28 08:09:43,508][106226] Updated weights for policy 0, policy_version 1794919 (0.0011) [2023-12-28 08:09:43,713][106225] Updated weights for policy 1, policy_version 1798981 (0.0007) [2023-12-28 08:09:43,770][106225] Updated weights for policy 1, policy_version 1798991 (0.0005) [2023-12-28 08:09:43,827][106225] Updated weights for policy 1, policy_version 1799001 (0.0006) [2023-12-28 08:09:44,221][106226] Updated weights for policy 0, policy_version 1794929 (0.0006) [2023-12-28 08:09:44,284][106226] Updated weights for policy 0, policy_version 1794939 (0.0009) [2023-12-28 08:09:44,351][106226] Updated weights for policy 0, policy_version 1794949 (0.0010) [2023-12-28 08:09:44,507][106225] Updated weights for policy 1, policy_version 1799011 (0.0011) [2023-12-28 08:09:44,561][106225] Updated weights for policy 1, policy_version 1799021 (0.0010) [2023-12-28 08:09:44,615][106225] Updated weights for policy 1, policy_version 1799031 (0.0010) [2023-12-28 08:09:45,043][106226] Updated weights for policy 0, policy_version 1794959 (0.0008) [2023-12-28 08:09:45,107][106226] Updated weights for policy 0, policy_version 1794969 (0.0008) [2023-12-28 08:09:45,171][106226] Updated weights for policy 0, policy_version 1794979 (0.0010) [2023-12-28 08:09:45,341][106225] Updated weights for policy 1, policy_version 1799041 (0.0010) [2023-12-28 08:09:45,404][106225] Updated weights for policy 1, policy_version 1799051 (0.0008) [2023-12-28 08:09:45,463][106225] Updated weights for policy 1, policy_version 1799061 (0.0009) [2023-12-28 08:09:45,525][106225] Updated weights for policy 1, policy_version 1799071 (0.0008) [2023-12-28 08:09:45,894][106226] Updated weights for policy 0, policy_version 1794989 (0.0009) [2023-12-28 08:09:45,944][106226] Updated weights for policy 0, policy_version 1794999 (0.0008) [2023-12-28 08:09:45,994][106226] Updated weights for policy 0, policy_version 1795009 (0.0008) [2023-12-28 08:09:46,156][106225] Updated weights for policy 1, policy_version 1799081 (0.0008) [2023-12-28 08:09:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 920223744. Throughput: 0: 9980.5, 1: 9921.4. Samples: 920214172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:46,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-5.088')] [2023-12-28 08:09:46,211][106225] Updated weights for policy 1, policy_version 1799091 (0.0009) [2023-12-28 08:09:46,259][106225] Updated weights for policy 1, policy_version 1799101 (0.0008) [2023-12-28 08:09:46,782][106226] Updated weights for policy 0, policy_version 1795019 (0.0009) [2023-12-28 08:09:46,834][106226] Updated weights for policy 0, policy_version 1795029 (0.0008) [2023-12-28 08:09:46,891][106226] Updated weights for policy 0, policy_version 1795039 (0.0007) [2023-12-28 08:09:46,893][106225] Updated weights for policy 1, policy_version 1799111 (0.0010) [2023-12-28 08:09:46,946][106225] Updated weights for policy 1, policy_version 1799121 (0.0010) [2023-12-28 08:09:46,993][106225] Updated weights for policy 1, policy_version 1799131 (0.0010) [2023-12-28 08:09:47,596][106226] Updated weights for policy 0, policy_version 1795049 (0.0005) [2023-12-28 08:09:47,664][106226] Updated weights for policy 0, policy_version 1795059 (0.0005) [2023-12-28 08:09:47,697][106225] Updated weights for policy 1, policy_version 1799141 (0.0009) [2023-12-28 08:09:47,734][106226] Updated weights for policy 0, policy_version 1795069 (0.0006) [2023-12-28 08:09:47,754][106225] Updated weights for policy 1, policy_version 1799151 (0.0007) [2023-12-28 08:09:47,798][106226] Updated weights for policy 0, policy_version 1795079 (0.0010) [2023-12-28 08:09:47,812][106225] Updated weights for policy 1, policy_version 1799161 (0.0008) [2023-12-28 08:09:48,369][106226] Updated weights for policy 0, policy_version 1795089 (0.0008) [2023-12-28 08:09:48,440][106226] Updated weights for policy 0, policy_version 1795099 (0.0008) [2023-12-28 08:09:48,506][106226] Updated weights for policy 0, policy_version 1795109 (0.0009) [2023-12-28 08:09:48,512][106225] Updated weights for policy 1, policy_version 1799171 (0.0007) [2023-12-28 08:09:48,573][106225] Updated weights for policy 1, policy_version 1799181 (0.0007) [2023-12-28 08:09:48,633][106225] Updated weights for policy 1, policy_version 1799191 (0.0007) [2023-12-28 08:09:49,080][106226] Updated weights for policy 0, policy_version 1795119 (0.0010) [2023-12-28 08:09:49,143][106226] Updated weights for policy 0, policy_version 1795129 (0.0005) [2023-12-28 08:09:49,202][106226] Updated weights for policy 0, policy_version 1795139 (0.0005) [2023-12-28 08:09:49,404][106225] Updated weights for policy 1, policy_version 1799201 (0.0005) [2023-12-28 08:09:49,467][106225] Updated weights for policy 1, policy_version 1799211 (0.0007) [2023-12-28 08:09:49,531][106225] Updated weights for policy 1, policy_version 1799221 (0.0008) [2023-12-28 08:09:49,596][106225] Updated weights for policy 1, policy_version 1799231 (0.0007) [2023-12-28 08:09:49,865][106226] Updated weights for policy 0, policy_version 1795149 (0.0009) [2023-12-28 08:09:49,928][106226] Updated weights for policy 0, policy_version 1795159 (0.0008) [2023-12-28 08:09:49,993][106226] Updated weights for policy 0, policy_version 1795169 (0.0008) [2023-12-28 08:09:50,305][106225] Updated weights for policy 1, policy_version 1799241 (0.0010) [2023-12-28 08:09:50,364][106225] Updated weights for policy 1, policy_version 1799251 (0.0007) [2023-12-28 08:09:50,415][106225] Updated weights for policy 1, policy_version 1799261 (0.0010) [2023-12-28 08:09:50,699][106226] Updated weights for policy 0, policy_version 1795179 (0.0008) [2023-12-28 08:09:50,759][106226] Updated weights for policy 0, policy_version 1795189 (0.0008) [2023-12-28 08:09:50,819][106226] Updated weights for policy 0, policy_version 1795199 (0.0008) [2023-12-28 08:09:51,141][106225] Updated weights for policy 1, policy_version 1799271 (0.0009) [2023-12-28 08:09:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 920322048. Throughput: 0: 9953.4, 1: 9923.3. Samples: 920334188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:51,175][105115] Avg episode reward: [(0, '-4.649'), (1, '-4.809')] [2023-12-28 08:09:51,203][106225] Updated weights for policy 1, policy_version 1799281 (0.0006) [2023-12-28 08:09:51,265][106225] Updated weights for policy 1, policy_version 1799291 (0.0009) [2023-12-28 08:09:51,572][106226] Updated weights for policy 0, policy_version 1795209 (0.0007) [2023-12-28 08:09:51,638][106226] Updated weights for policy 0, policy_version 1795219 (0.0007) [2023-12-28 08:09:51,705][106226] Updated weights for policy 0, policy_version 1795229 (0.0009) [2023-12-28 08:09:51,779][106226] Updated weights for policy 0, policy_version 1795239 (0.0008) [2023-12-28 08:09:51,931][106225] Updated weights for policy 1, policy_version 1799301 (0.0008) [2023-12-28 08:09:51,987][106225] Updated weights for policy 1, policy_version 1799311 (0.0009) [2023-12-28 08:09:52,039][106225] Updated weights for policy 1, policy_version 1799321 (0.0008) [2023-12-28 08:09:52,493][106226] Updated weights for policy 0, policy_version 1795249 (0.0007) [2023-12-28 08:09:52,542][106226] Updated weights for policy 0, policy_version 1795259 (0.0006) [2023-12-28 08:09:52,590][106226] Updated weights for policy 0, policy_version 1795269 (0.0006) [2023-12-28 08:09:52,773][106225] Updated weights for policy 1, policy_version 1799331 (0.0008) [2023-12-28 08:09:52,832][106225] Updated weights for policy 1, policy_version 1799341 (0.0008) [2023-12-28 08:09:52,894][106225] Updated weights for policy 1, policy_version 1799351 (0.0008) [2023-12-28 08:09:53,275][106226] Updated weights for policy 0, policy_version 1795279 (0.0009) [2023-12-28 08:09:53,321][106226] Updated weights for policy 0, policy_version 1795289 (0.0010) [2023-12-28 08:09:53,368][106226] Updated weights for policy 0, policy_version 1795299 (0.0010) [2023-12-28 08:09:53,558][106225] Updated weights for policy 1, policy_version 1799361 (0.0007) [2023-12-28 08:09:53,619][106225] Updated weights for policy 1, policy_version 1799371 (0.0006) [2023-12-28 08:09:53,671][106225] Updated weights for policy 1, policy_version 1799381 (0.0008) [2023-12-28 08:09:53,723][106225] Updated weights for policy 1, policy_version 1799392 (0.0010) [2023-12-28 08:09:53,963][106226] Updated weights for policy 0, policy_version 1795309 (0.0008) [2023-12-28 08:09:54,020][106226] Updated weights for policy 0, policy_version 1795319 (0.0006) [2023-12-28 08:09:54,080][106226] Updated weights for policy 0, policy_version 1795329 (0.0005) [2023-12-28 08:09:54,459][106225] Updated weights for policy 1, policy_version 1799402 (0.0009) [2023-12-28 08:09:54,523][106225] Updated weights for policy 1, policy_version 1799412 (0.0008) [2023-12-28 08:09:54,575][106225] Updated weights for policy 1, policy_version 1799422 (0.0006) [2023-12-28 08:09:54,769][106226] Updated weights for policy 0, policy_version 1795339 (0.0008) [2023-12-28 08:09:54,817][106226] Updated weights for policy 0, policy_version 1795349 (0.0008) [2023-12-28 08:09:54,869][106226] Updated weights for policy 0, policy_version 1795359 (0.0008) [2023-12-28 08:09:55,222][106225] Updated weights for policy 1, policy_version 1799432 (0.0009) [2023-12-28 08:09:55,284][106225] Updated weights for policy 1, policy_version 1799442 (0.0010) [2023-12-28 08:09:55,344][106225] Updated weights for policy 1, policy_version 1799452 (0.0010) [2023-12-28 08:09:55,606][106226] Updated weights for policy 0, policy_version 1795369 (0.0007) [2023-12-28 08:09:55,656][106226] Updated weights for policy 0, policy_version 1795379 (0.0008) [2023-12-28 08:09:55,715][106226] Updated weights for policy 0, policy_version 1795389 (0.0007) [2023-12-28 08:09:55,771][106226] Updated weights for policy 0, policy_version 1795399 (0.0007) [2023-12-28 08:09:56,048][106225] Updated weights for policy 1, policy_version 1799462 (0.0010) [2023-12-28 08:09:56,107][106225] Updated weights for policy 1, policy_version 1799472 (0.0010) [2023-12-28 08:09:56,161][106225] Updated weights for policy 1, policy_version 1799482 (0.0010) [2023-12-28 08:09:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 920420352. Throughput: 0: 9962.7, 1: 9885.2. Samples: 920394728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:09:56,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-4.444')] [2023-12-28 08:09:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001795400_459702272.pth... [2023-12-28 08:09:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001794248_459407360.pth [2023-12-28 08:09:56,190][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001799488_460726272.pth... [2023-12-28 08:09:56,193][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001798304_460423168.pth [2023-12-28 08:09:56,444][106226] Updated weights for policy 0, policy_version 1795409 (0.0008) [2023-12-28 08:09:56,499][106226] Updated weights for policy 0, policy_version 1795419 (0.0008) [2023-12-28 08:09:56,559][106226] Updated weights for policy 0, policy_version 1795429 (0.0006) [2023-12-28 08:09:56,872][106225] Updated weights for policy 1, policy_version 1799492 (0.0008) [2023-12-28 08:09:56,930][106225] Updated weights for policy 1, policy_version 1799502 (0.0010) [2023-12-28 08:09:56,976][106225] Updated weights for policy 1, policy_version 1799512 (0.0010) [2023-12-28 08:09:57,168][106226] Updated weights for policy 0, policy_version 1795439 (0.0005) [2023-12-28 08:09:57,217][106226] Updated weights for policy 0, policy_version 1795449 (0.0010) [2023-12-28 08:09:57,265][106226] Updated weights for policy 0, policy_version 1795459 (0.0010) [2023-12-28 08:09:57,646][106225] Updated weights for policy 1, policy_version 1799522 (0.0010) [2023-12-28 08:09:57,706][106225] Updated weights for policy 1, policy_version 1799532 (0.0009) [2023-12-28 08:09:57,760][106225] Updated weights for policy 1, policy_version 1799542 (0.0005) [2023-12-28 08:09:57,824][106225] Updated weights for policy 1, policy_version 1799552 (0.0009) [2023-12-28 08:09:57,920][106226] Updated weights for policy 0, policy_version 1795469 (0.0008) [2023-12-28 08:09:57,982][106226] Updated weights for policy 0, policy_version 1795479 (0.0005) [2023-12-28 08:09:58,047][106226] Updated weights for policy 0, policy_version 1795489 (0.0005) [2023-12-28 08:09:58,479][106225] Updated weights for policy 1, policy_version 1799562 (0.0009) [2023-12-28 08:09:58,541][106225] Updated weights for policy 1, policy_version 1799572 (0.0009) [2023-12-28 08:09:58,607][106225] Updated weights for policy 1, policy_version 1799582 (0.0010) [2023-12-28 08:09:58,710][106226] Updated weights for policy 0, policy_version 1795499 (0.0006) [2023-12-28 08:09:58,777][106226] Updated weights for policy 0, policy_version 1795509 (0.0008) [2023-12-28 08:09:58,849][106226] Updated weights for policy 0, policy_version 1795519 (0.0008) [2023-12-28 08:09:59,446][106225] Updated weights for policy 1, policy_version 1799592 (0.0010) [2023-12-28 08:09:59,507][106225] Updated weights for policy 1, policy_version 1799602 (0.0011) [2023-12-28 08:09:59,568][106225] Updated weights for policy 1, policy_version 1799612 (0.0011) [2023-12-28 08:09:59,626][106226] Updated weights for policy 0, policy_version 1795529 (0.0008) [2023-12-28 08:09:59,693][106226] Updated weights for policy 0, policy_version 1795539 (0.0007) [2023-12-28 08:09:59,753][106226] Updated weights for policy 0, policy_version 1795549 (0.0010) [2023-12-28 08:09:59,814][106226] Updated weights for policy 0, policy_version 1795559 (0.0010) [2023-12-28 08:10:00,224][106225] Updated weights for policy 1, policy_version 1799622 (0.0008) [2023-12-28 08:10:00,287][106225] Updated weights for policy 1, policy_version 1799632 (0.0009) [2023-12-28 08:10:00,341][106225] Updated weights for policy 1, policy_version 1799642 (0.0010) [2023-12-28 08:10:00,531][106226] Updated weights for policy 0, policy_version 1795569 (0.0008) [2023-12-28 08:10:00,592][106226] Updated weights for policy 0, policy_version 1795579 (0.0010) [2023-12-28 08:10:00,652][106226] Updated weights for policy 0, policy_version 1795589 (0.0009) [2023-12-28 08:10:01,030][106225] Updated weights for policy 1, policy_version 1799652 (0.0011) [2023-12-28 08:10:01,095][106225] Updated weights for policy 1, policy_version 1799662 (0.0011) [2023-12-28 08:10:01,167][106225] Updated weights for policy 1, policy_version 1799672 (0.0009) [2023-12-28 08:10:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 920518656. Throughput: 0: 9995.8, 1: 9905.2. Samples: 920513304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:01,175][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.782')] [2023-12-28 08:10:01,440][106226] Updated weights for policy 0, policy_version 1795599 (0.0008) [2023-12-28 08:10:01,495][106226] Updated weights for policy 0, policy_version 1795609 (0.0007) [2023-12-28 08:10:01,550][106226] Updated weights for policy 0, policy_version 1795619 (0.0007) [2023-12-28 08:10:01,928][106225] Updated weights for policy 1, policy_version 1799682 (0.0009) [2023-12-28 08:10:01,983][106225] Updated weights for policy 1, policy_version 1799692 (0.0010) [2023-12-28 08:10:02,037][106225] Updated weights for policy 1, policy_version 1799702 (0.0010) [2023-12-28 08:10:02,090][106225] Updated weights for policy 1, policy_version 1799712 (0.0010) [2023-12-28 08:10:02,202][106226] Updated weights for policy 0, policy_version 1795629 (0.0005) [2023-12-28 08:10:02,264][106226] Updated weights for policy 0, policy_version 1795639 (0.0007) [2023-12-28 08:10:02,325][106226] Updated weights for policy 0, policy_version 1795649 (0.0008) [2023-12-28 08:10:02,824][106225] Updated weights for policy 1, policy_version 1799722 (0.0010) [2023-12-28 08:10:02,883][106225] Updated weights for policy 1, policy_version 1799732 (0.0010) [2023-12-28 08:10:02,945][106225] Updated weights for policy 1, policy_version 1799742 (0.0010) [2023-12-28 08:10:03,005][106226] Updated weights for policy 0, policy_version 1795659 (0.0007) [2023-12-28 08:10:03,058][106226] Updated weights for policy 0, policy_version 1795669 (0.0006) [2023-12-28 08:10:03,110][106226] Updated weights for policy 0, policy_version 1795679 (0.0008) [2023-12-28 08:10:03,565][106225] Updated weights for policy 1, policy_version 1799752 (0.0006) [2023-12-28 08:10:03,631][106225] Updated weights for policy 1, policy_version 1799762 (0.0005) [2023-12-28 08:10:03,699][106225] Updated weights for policy 1, policy_version 1799772 (0.0005) [2023-12-28 08:10:03,895][106226] Updated weights for policy 0, policy_version 1795689 (0.0007) [2023-12-28 08:10:03,965][106226] Updated weights for policy 0, policy_version 1795699 (0.0007) [2023-12-28 08:10:04,030][106226] Updated weights for policy 0, policy_version 1795709 (0.0008) [2023-12-28 08:10:04,096][106226] Updated weights for policy 0, policy_version 1795719 (0.0008) [2023-12-28 08:10:04,295][106225] Updated weights for policy 1, policy_version 1799782 (0.0006) [2023-12-28 08:10:04,357][106225] Updated weights for policy 1, policy_version 1799792 (0.0011) [2023-12-28 08:10:04,421][106225] Updated weights for policy 1, policy_version 1799802 (0.0009) [2023-12-28 08:10:04,863][106226] Updated weights for policy 0, policy_version 1795729 (0.0009) [2023-12-28 08:10:04,916][106226] Updated weights for policy 0, policy_version 1795739 (0.0008) [2023-12-28 08:10:04,962][106226] Updated weights for policy 0, policy_version 1795749 (0.0008) [2023-12-28 08:10:05,022][106225] Updated weights for policy 1, policy_version 1799812 (0.0011) [2023-12-28 08:10:05,079][106225] Updated weights for policy 1, policy_version 1799822 (0.0010) [2023-12-28 08:10:05,135][106225] Updated weights for policy 1, policy_version 1799832 (0.0010) [2023-12-28 08:10:05,709][106226] Updated weights for policy 0, policy_version 1795759 (0.0008) [2023-12-28 08:10:05,760][106226] Updated weights for policy 0, policy_version 1795769 (0.0009) [2023-12-28 08:10:05,811][106226] Updated weights for policy 0, policy_version 1795779 (0.0008) [2023-12-28 08:10:05,845][106225] Updated weights for policy 1, policy_version 1799842 (0.0009) [2023-12-28 08:10:05,898][106225] Updated weights for policy 1, policy_version 1799852 (0.0005) [2023-12-28 08:10:05,953][106225] Updated weights for policy 1, policy_version 1799862 (0.0005) [2023-12-28 08:10:06,013][106225] Updated weights for policy 1, policy_version 1799872 (0.0005) [2023-12-28 08:10:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 920625152. Throughput: 0: 9904.9, 1: 9971.9. Samples: 920630864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:06,175][105115] Avg episode reward: [(0, '-4.465'), (1, '-4.563')] [2023-12-28 08:10:06,632][106225] Updated weights for policy 1, policy_version 1799882 (0.0008) [2023-12-28 08:10:06,636][106226] Updated weights for policy 0, policy_version 1795789 (0.0009) [2023-12-28 08:10:06,692][106226] Updated weights for policy 0, policy_version 1795799 (0.0005) [2023-12-28 08:10:06,699][106225] Updated weights for policy 1, policy_version 1799892 (0.0008) [2023-12-28 08:10:06,754][106226] Updated weights for policy 0, policy_version 1795809 (0.0006) [2023-12-28 08:10:06,759][106225] Updated weights for policy 1, policy_version 1799902 (0.0007) [2023-12-28 08:10:07,398][106225] Updated weights for policy 1, policy_version 1799912 (0.0006) [2023-12-28 08:10:07,434][106226] Updated weights for policy 0, policy_version 1795819 (0.0007) [2023-12-28 08:10:07,452][106225] Updated weights for policy 1, policy_version 1799922 (0.0005) [2023-12-28 08:10:07,491][106226] Updated weights for policy 0, policy_version 1795829 (0.0008) [2023-12-28 08:10:07,506][106225] Updated weights for policy 1, policy_version 1799932 (0.0005) [2023-12-28 08:10:07,548][106226] Updated weights for policy 0, policy_version 1795839 (0.0009) [2023-12-28 08:10:08,109][106225] Updated weights for policy 1, policy_version 1799942 (0.0009) [2023-12-28 08:10:08,169][106225] Updated weights for policy 1, policy_version 1799952 (0.0010) [2023-12-28 08:10:08,226][106225] Updated weights for policy 1, policy_version 1799962 (0.0010) [2023-12-28 08:10:08,269][106226] Updated weights for policy 0, policy_version 1795849 (0.0008) [2023-12-28 08:10:08,336][106226] Updated weights for policy 0, policy_version 1795859 (0.0008) [2023-12-28 08:10:08,405][106226] Updated weights for policy 0, policy_version 1795869 (0.0008) [2023-12-28 08:10:08,471][106226] Updated weights for policy 0, policy_version 1795879 (0.0008) [2023-12-28 08:10:08,894][106225] Updated weights for policy 1, policy_version 1799972 (0.0010) [2023-12-28 08:10:08,944][106225] Updated weights for policy 1, policy_version 1799982 (0.0007) [2023-12-28 08:10:09,006][106225] Updated weights for policy 1, policy_version 1799992 (0.0007) [2023-12-28 08:10:09,185][106226] Updated weights for policy 0, policy_version 1795889 (0.0009) [2023-12-28 08:10:09,247][106226] Updated weights for policy 0, policy_version 1795899 (0.0008) [2023-12-28 08:10:09,301][106226] Updated weights for policy 0, policy_version 1795909 (0.0008) [2023-12-28 08:10:09,755][106225] Updated weights for policy 1, policy_version 1800002 (0.0008) [2023-12-28 08:10:09,820][106225] Updated weights for policy 1, policy_version 1800012 (0.0009) [2023-12-28 08:10:09,886][106225] Updated weights for policy 1, policy_version 1800022 (0.0009) [2023-12-28 08:10:09,950][106225] Updated weights for policy 1, policy_version 1800032 (0.0009) [2023-12-28 08:10:10,107][106226] Updated weights for policy 0, policy_version 1795919 (0.0007) [2023-12-28 08:10:10,173][106226] Updated weights for policy 0, policy_version 1795929 (0.0008) [2023-12-28 08:10:10,245][106226] Updated weights for policy 0, policy_version 1795939 (0.0011) [2023-12-28 08:10:10,724][106225] Updated weights for policy 1, policy_version 1800042 (0.0007) [2023-12-28 08:10:10,780][106225] Updated weights for policy 1, policy_version 1800052 (0.0008) [2023-12-28 08:10:10,842][106225] Updated weights for policy 1, policy_version 1800062 (0.0008) [2023-12-28 08:10:10,903][106226] Updated weights for policy 0, policy_version 1795949 (0.0008) [2023-12-28 08:10:10,968][106226] Updated weights for policy 0, policy_version 1795959 (0.0011) [2023-12-28 08:10:11,030][106226] Updated weights for policy 0, policy_version 1795969 (0.0010) [2023-12-28 08:10:11,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 920723456. Throughput: 0: 9889.3, 1: 10086.7. Samples: 920691128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:11,175][105115] Avg episode reward: [(0, '-4.228'), (1, '-5.098')] [2023-12-28 08:10:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001800064_460873728.pth... [2023-12-28 08:10:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001795976_459849728.pth... [2023-12-28 08:10:11,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001798880_460570624.pth [2023-12-28 08:10:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001794824_459554816.pth [2023-12-28 08:10:11,692][106225] Updated weights for policy 1, policy_version 1800072 (0.0009) [2023-12-28 08:10:11,764][106225] Updated weights for policy 1, policy_version 1800082 (0.0009) [2023-12-28 08:10:11,788][106226] Updated weights for policy 0, policy_version 1795979 (0.0007) [2023-12-28 08:10:11,822][106225] Updated weights for policy 1, policy_version 1800092 (0.0009) [2023-12-28 08:10:11,850][106226] Updated weights for policy 0, policy_version 1795989 (0.0006) [2023-12-28 08:10:11,909][106226] Updated weights for policy 0, policy_version 1795999 (0.0006) [2023-12-28 08:10:12,528][106226] Updated weights for policy 0, policy_version 1796009 (0.0008) [2023-12-28 08:10:12,590][106226] Updated weights for policy 0, policy_version 1796019 (0.0008) [2023-12-28 08:10:12,655][106226] Updated weights for policy 0, policy_version 1796029 (0.0008) [2023-12-28 08:10:12,662][106225] Updated weights for policy 1, policy_version 1800102 (0.0007) [2023-12-28 08:10:12,717][106226] Updated weights for policy 0, policy_version 1796039 (0.0008) [2023-12-28 08:10:12,727][106225] Updated weights for policy 1, policy_version 1800112 (0.0006) [2023-12-28 08:10:12,787][106225] Updated weights for policy 1, policy_version 1800122 (0.0006) [2023-12-28 08:10:13,415][106225] Updated weights for policy 1, policy_version 1800132 (0.0006) [2023-12-28 08:10:13,452][106226] Updated weights for policy 0, policy_version 1796049 (0.0009) [2023-12-28 08:10:13,467][106225] Updated weights for policy 1, policy_version 1800142 (0.0005) [2023-12-28 08:10:13,508][106226] Updated weights for policy 0, policy_version 1796059 (0.0008) [2023-12-28 08:10:13,520][106225] Updated weights for policy 1, policy_version 1800152 (0.0005) [2023-12-28 08:10:13,572][106226] Updated weights for policy 0, policy_version 1796069 (0.0009) [2023-12-28 08:10:14,101][106225] Updated weights for policy 1, policy_version 1800162 (0.0005) [2023-12-28 08:10:14,168][106225] Updated weights for policy 1, policy_version 1800172 (0.0009) [2023-12-28 08:10:14,227][106225] Updated weights for policy 1, policy_version 1800182 (0.0008) [2023-12-28 08:10:14,273][106225] Updated weights for policy 1, policy_version 1800192 (0.0005) [2023-12-28 08:10:14,331][106226] Updated weights for policy 0, policy_version 1796079 (0.0010) [2023-12-28 08:10:14,388][106226] Updated weights for policy 0, policy_version 1796089 (0.0010) [2023-12-28 08:10:14,439][106226] Updated weights for policy 0, policy_version 1796099 (0.0010) [2023-12-28 08:10:15,008][106225] Updated weights for policy 1, policy_version 1800202 (0.0008) [2023-12-28 08:10:15,074][106225] Updated weights for policy 1, policy_version 1800212 (0.0008) [2023-12-28 08:10:15,140][106225] Updated weights for policy 1, policy_version 1800222 (0.0008) [2023-12-28 08:10:15,189][106226] Updated weights for policy 0, policy_version 1796109 (0.0010) [2023-12-28 08:10:15,253][106226] Updated weights for policy 0, policy_version 1796119 (0.0011) [2023-12-28 08:10:15,304][106226] Updated weights for policy 0, policy_version 1796129 (0.0010) [2023-12-28 08:10:15,853][106225] Updated weights for policy 1, policy_version 1800232 (0.0008) [2023-12-28 08:10:15,901][106225] Updated weights for policy 1, policy_version 1800242 (0.0007) [2023-12-28 08:10:15,957][106225] Updated weights for policy 1, policy_version 1800252 (0.0008) [2023-12-28 08:10:16,037][106226] Updated weights for policy 0, policy_version 1796139 (0.0010) [2023-12-28 08:10:16,090][106226] Updated weights for policy 0, policy_version 1796149 (0.0010) [2023-12-28 08:10:16,151][106226] Updated weights for policy 0, policy_version 1796159 (0.0010) [2023-12-28 08:10:16,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 920813568. Throughput: 0: 9741.6, 1: 9958.9. Samples: 920806416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:16,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.586')] [2023-12-28 08:10:16,664][106225] Updated weights for policy 1, policy_version 1800262 (0.0009) [2023-12-28 08:10:16,713][106225] Updated weights for policy 1, policy_version 1800272 (0.0010) [2023-12-28 08:10:16,767][106225] Updated weights for policy 1, policy_version 1800282 (0.0010) [2023-12-28 08:10:16,861][106226] Updated weights for policy 0, policy_version 1796169 (0.0010) [2023-12-28 08:10:16,914][106226] Updated weights for policy 0, policy_version 1796179 (0.0008) [2023-12-28 08:10:16,959][106226] Updated weights for policy 0, policy_version 1796189 (0.0007) [2023-12-28 08:10:17,006][106226] Updated weights for policy 0, policy_version 1796199 (0.0008) [2023-12-28 08:10:17,502][106225] Updated weights for policy 1, policy_version 1800292 (0.0008) [2023-12-28 08:10:17,559][106225] Updated weights for policy 1, policy_version 1800302 (0.0010) [2023-12-28 08:10:17,619][106225] Updated weights for policy 1, policy_version 1800312 (0.0010) [2023-12-28 08:10:17,752][106226] Updated weights for policy 0, policy_version 1796209 (0.0008) [2023-12-28 08:10:17,811][106226] Updated weights for policy 0, policy_version 1796219 (0.0008) [2023-12-28 08:10:17,870][106226] Updated weights for policy 0, policy_version 1796229 (0.0008) [2023-12-28 08:10:18,315][106225] Updated weights for policy 1, policy_version 1800322 (0.0010) [2023-12-28 08:10:18,376][106225] Updated weights for policy 1, policy_version 1800332 (0.0008) [2023-12-28 08:10:18,428][106225] Updated weights for policy 1, policy_version 1800342 (0.0005) [2023-12-28 08:10:18,486][106225] Updated weights for policy 1, policy_version 1800352 (0.0006) [2023-12-28 08:10:18,640][106226] Updated weights for policy 0, policy_version 1796239 (0.0010) [2023-12-28 08:10:18,703][106226] Updated weights for policy 0, policy_version 1796249 (0.0008) [2023-12-28 08:10:18,762][106226] Updated weights for policy 0, policy_version 1796259 (0.0008) [2023-12-28 08:10:19,109][106225] Updated weights for policy 1, policy_version 1800362 (0.0008) [2023-12-28 08:10:19,167][106225] Updated weights for policy 1, policy_version 1800372 (0.0006) [2023-12-28 08:10:19,230][106225] Updated weights for policy 1, policy_version 1800382 (0.0009) [2023-12-28 08:10:19,464][106226] Updated weights for policy 0, policy_version 1796269 (0.0008) [2023-12-28 08:10:19,534][106226] Updated weights for policy 0, policy_version 1796279 (0.0008) [2023-12-28 08:10:19,584][106226] Updated weights for policy 0, policy_version 1796289 (0.0007) [2023-12-28 08:10:19,991][106225] Updated weights for policy 1, policy_version 1800392 (0.0007) [2023-12-28 08:10:20,051][106225] Updated weights for policy 1, policy_version 1800402 (0.0006) [2023-12-28 08:10:20,113][106225] Updated weights for policy 1, policy_version 1800412 (0.0006) [2023-12-28 08:10:20,345][106226] Updated weights for policy 0, policy_version 1796299 (0.0008) [2023-12-28 08:10:20,409][106226] Updated weights for policy 0, policy_version 1796309 (0.0009) [2023-12-28 08:10:20,468][106226] Updated weights for policy 0, policy_version 1796319 (0.0009) [2023-12-28 08:10:20,801][106225] Updated weights for policy 1, policy_version 1800422 (0.0007) [2023-12-28 08:10:20,871][106225] Updated weights for policy 1, policy_version 1800432 (0.0010) [2023-12-28 08:10:20,927][106225] Updated weights for policy 1, policy_version 1800442 (0.0007) [2023-12-28 08:10:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 920911872. Throughput: 0: 9649.4, 1: 9961.0. Samples: 920922428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:21,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.785')] [2023-12-28 08:10:21,187][106226] Updated weights for policy 0, policy_version 1796329 (0.0009) [2023-12-28 08:10:21,252][106226] Updated weights for policy 0, policy_version 1796339 (0.0007) [2023-12-28 08:10:21,316][106226] Updated weights for policy 0, policy_version 1796349 (0.0008) [2023-12-28 08:10:21,387][106226] Updated weights for policy 0, policy_version 1796359 (0.0008) [2023-12-28 08:10:21,702][106225] Updated weights for policy 1, policy_version 1800452 (0.0008) [2023-12-28 08:10:21,778][106225] Updated weights for policy 1, policy_version 1800462 (0.0007) [2023-12-28 08:10:21,841][106225] Updated weights for policy 1, policy_version 1800472 (0.0005) [2023-12-28 08:10:22,176][106226] Updated weights for policy 0, policy_version 1796369 (0.0009) [2023-12-28 08:10:22,241][106226] Updated weights for policy 0, policy_version 1796379 (0.0009) [2023-12-28 08:10:22,308][106226] Updated weights for policy 0, policy_version 1796389 (0.0010) [2023-12-28 08:10:22,474][106225] Updated weights for policy 1, policy_version 1800482 (0.0006) [2023-12-28 08:10:22,530][106225] Updated weights for policy 1, policy_version 1800492 (0.0009) [2023-12-28 08:10:22,596][106225] Updated weights for policy 1, policy_version 1800502 (0.0006) [2023-12-28 08:10:22,657][106225] Updated weights for policy 1, policy_version 1800512 (0.0006) [2023-12-28 08:10:23,104][106226] Updated weights for policy 0, policy_version 1796399 (0.0010) [2023-12-28 08:10:23,159][106226] Updated weights for policy 0, policy_version 1796409 (0.0011) [2023-12-28 08:10:23,213][106226] Updated weights for policy 0, policy_version 1796419 (0.0010) [2023-12-28 08:10:23,260][106225] Updated weights for policy 1, policy_version 1800522 (0.0010) [2023-12-28 08:10:23,323][106225] Updated weights for policy 1, policy_version 1800532 (0.0010) [2023-12-28 08:10:23,384][106225] Updated weights for policy 1, policy_version 1800542 (0.0008) [2023-12-28 08:10:23,953][106226] Updated weights for policy 0, policy_version 1796429 (0.0010) [2023-12-28 08:10:24,012][106226] Updated weights for policy 0, policy_version 1796439 (0.0010) [2023-12-28 08:10:24,069][106226] Updated weights for policy 0, policy_version 1796449 (0.0010) [2023-12-28 08:10:24,094][106225] Updated weights for policy 1, policy_version 1800552 (0.0008) [2023-12-28 08:10:24,146][106225] Updated weights for policy 1, policy_version 1800562 (0.0007) [2023-12-28 08:10:24,200][106225] Updated weights for policy 1, policy_version 1800572 (0.0008) [2023-12-28 08:10:24,789][106226] Updated weights for policy 0, policy_version 1796459 (0.0011) [2023-12-28 08:10:24,848][106226] Updated weights for policy 0, policy_version 1796469 (0.0011) [2023-12-28 08:10:24,911][106226] Updated weights for policy 0, policy_version 1796479 (0.0011) [2023-12-28 08:10:24,922][106225] Updated weights for policy 1, policy_version 1800582 (0.0006) [2023-12-28 08:10:24,984][106225] Updated weights for policy 1, policy_version 1800592 (0.0005) [2023-12-28 08:10:25,043][106225] Updated weights for policy 1, policy_version 1800602 (0.0005) [2023-12-28 08:10:25,597][106225] Updated weights for policy 1, policy_version 1800612 (0.0006) [2023-12-28 08:10:25,613][106226] Updated weights for policy 0, policy_version 1796489 (0.0010) [2023-12-28 08:10:25,654][106225] Updated weights for policy 1, policy_version 1800622 (0.0008) [2023-12-28 08:10:25,663][106226] Updated weights for policy 0, policy_version 1796499 (0.0010) [2023-12-28 08:10:25,708][106225] Updated weights for policy 1, policy_version 1800632 (0.0005) [2023-12-28 08:10:25,710][106226] Updated weights for policy 0, policy_version 1796509 (0.0010) [2023-12-28 08:10:25,770][106226] Updated weights for policy 0, policy_version 1796519 (0.0010) [2023-12-28 08:10:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 921010176. Throughput: 0: 9634.9, 1: 9919.7. Samples: 920979160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:10:26,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-4.722')] [2023-12-28 08:10:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001796520_459988992.pth... [2023-12-28 08:10:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001800640_461021184.pth... [2023-12-28 08:10:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001795400_459702272.pth [2023-12-28 08:10:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001799488_460726272.pth [2023-12-28 08:10:26,402][106225] Updated weights for policy 1, policy_version 1800642 (0.0006) [2023-12-28 08:10:26,449][106225] Updated weights for policy 1, policy_version 1800652 (0.0010) [2023-12-28 08:10:26,493][106226] Updated weights for policy 0, policy_version 1796529 (0.0010) [2023-12-28 08:10:26,499][106225] Updated weights for policy 1, policy_version 1800662 (0.0010) [2023-12-28 08:10:26,543][106226] Updated weights for policy 0, policy_version 1796539 (0.0010) [2023-12-28 08:10:26,549][106225] Updated weights for policy 1, policy_version 1800672 (0.0010) [2023-12-28 08:10:26,604][106226] Updated weights for policy 0, policy_version 1796549 (0.0010) [2023-12-28 08:10:27,289][106225] Updated weights for policy 1, policy_version 1800682 (0.0008) [2023-12-28 08:10:27,311][106226] Updated weights for policy 0, policy_version 1796559 (0.0010) [2023-12-28 08:10:27,337][106225] Updated weights for policy 1, policy_version 1800692 (0.0006) [2023-12-28 08:10:27,368][106226] Updated weights for policy 0, policy_version 1796569 (0.0010) [2023-12-28 08:10:27,385][106225] Updated weights for policy 1, policy_version 1800702 (0.0007) [2023-12-28 08:10:27,428][106226] Updated weights for policy 0, policy_version 1796579 (0.0011) [2023-12-28 08:10:28,095][106226] Updated weights for policy 0, policy_version 1796589 (0.0010) [2023-12-28 08:10:28,105][106225] Updated weights for policy 1, policy_version 1800712 (0.0006) [2023-12-28 08:10:28,152][106226] Updated weights for policy 0, policy_version 1796599 (0.0010) [2023-12-28 08:10:28,158][106225] Updated weights for policy 1, policy_version 1800722 (0.0005) [2023-12-28 08:10:28,207][106226] Updated weights for policy 0, policy_version 1796609 (0.0009) [2023-12-28 08:10:28,212][106225] Updated weights for policy 1, policy_version 1800732 (0.0007) [2023-12-28 08:10:28,769][106225] Updated weights for policy 1, policy_version 1800742 (0.0005) [2023-12-28 08:10:28,816][106225] Updated weights for policy 1, policy_version 1800752 (0.0005) [2023-12-28 08:10:28,869][106225] Updated weights for policy 1, policy_version 1800762 (0.0006) [2023-12-28 08:10:28,918][106226] Updated weights for policy 0, policy_version 1796619 (0.0011) [2023-12-28 08:10:28,989][106226] Updated weights for policy 0, policy_version 1796629 (0.0010) [2023-12-28 08:10:29,042][106226] Updated weights for policy 0, policy_version 1796639 (0.0005) [2023-12-28 08:10:29,549][106225] Updated weights for policy 1, policy_version 1800772 (0.0007) [2023-12-28 08:10:29,602][106225] Updated weights for policy 1, policy_version 1800782 (0.0009) [2023-12-28 08:10:29,622][106226] Updated weights for policy 0, policy_version 1796649 (0.0006) [2023-12-28 08:10:29,659][106225] Updated weights for policy 1, policy_version 1800792 (0.0008) [2023-12-28 08:10:29,681][106226] Updated weights for policy 0, policy_version 1796659 (0.0010) [2023-12-28 08:10:29,743][106226] Updated weights for policy 0, policy_version 1796669 (0.0008) [2023-12-28 08:10:29,806][106226] Updated weights for policy 0, policy_version 1796679 (0.0006) [2023-12-28 08:10:30,404][106225] Updated weights for policy 1, policy_version 1800802 (0.0007) [2023-12-28 08:10:30,451][106225] Updated weights for policy 1, policy_version 1800812 (0.0010) [2023-12-28 08:10:30,505][106225] Updated weights for policy 1, policy_version 1800822 (0.0010) [2023-12-28 08:10:30,529][106226] Updated weights for policy 0, policy_version 1796689 (0.0011) [2023-12-28 08:10:30,559][106225] Updated weights for policy 1, policy_version 1800832 (0.0010) [2023-12-28 08:10:30,589][106226] Updated weights for policy 0, policy_version 1796699 (0.0011) [2023-12-28 08:10:30,651][106226] Updated weights for policy 0, policy_version 1796709 (0.0010) [2023-12-28 08:10:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 921108480. Throughput: 0: 9726.0, 1: 9987.9. Samples: 921101300. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:31,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.803')] [2023-12-28 08:10:31,320][106225] Updated weights for policy 1, policy_version 1800842 (0.0010) [2023-12-28 08:10:31,357][106226] Updated weights for policy 0, policy_version 1796719 (0.0009) [2023-12-28 08:10:31,397][106225] Updated weights for policy 1, policy_version 1800852 (0.0013) [2023-12-28 08:10:31,425][106226] Updated weights for policy 0, policy_version 1796729 (0.0010) [2023-12-28 08:10:31,459][106225] Updated weights for policy 1, policy_version 1800862 (0.0009) [2023-12-28 08:10:31,486][106226] Updated weights for policy 0, policy_version 1796739 (0.0011) [2023-12-28 08:10:32,186][106225] Updated weights for policy 1, policy_version 1800872 (0.0009) [2023-12-28 08:10:32,244][106225] Updated weights for policy 1, policy_version 1800882 (0.0007) [2023-12-28 08:10:32,255][106226] Updated weights for policy 0, policy_version 1796749 (0.0010) [2023-12-28 08:10:32,308][106225] Updated weights for policy 1, policy_version 1800892 (0.0007) [2023-12-28 08:10:32,314][106226] Updated weights for policy 0, policy_version 1796759 (0.0007) [2023-12-28 08:10:32,383][106226] Updated weights for policy 0, policy_version 1796769 (0.0007) [2023-12-28 08:10:33,031][106226] Updated weights for policy 0, policy_version 1796779 (0.0006) [2023-12-28 08:10:33,079][106226] Updated weights for policy 0, policy_version 1796789 (0.0008) [2023-12-28 08:10:33,096][106225] Updated weights for policy 1, policy_version 1800902 (0.0007) [2023-12-28 08:10:33,134][106226] Updated weights for policy 0, policy_version 1796799 (0.0006) [2023-12-28 08:10:33,152][106225] Updated weights for policy 1, policy_version 1800912 (0.0006) [2023-12-28 08:10:33,201][106225] Updated weights for policy 1, policy_version 1800922 (0.0005) [2023-12-28 08:10:33,823][106226] Updated weights for policy 0, policy_version 1796809 (0.0007) [2023-12-28 08:10:33,848][106225] Updated weights for policy 1, policy_version 1800932 (0.0005) [2023-12-28 08:10:33,886][106226] Updated weights for policy 0, policy_version 1796819 (0.0008) [2023-12-28 08:10:33,896][106225] Updated weights for policy 1, policy_version 1800942 (0.0005) [2023-12-28 08:10:33,943][106226] Updated weights for policy 0, policy_version 1796829 (0.0008) [2023-12-28 08:10:33,944][106225] Updated weights for policy 1, policy_version 1800952 (0.0006) [2023-12-28 08:10:34,002][106226] Updated weights for policy 0, policy_version 1796839 (0.0009) [2023-12-28 08:10:34,672][106225] Updated weights for policy 1, policy_version 1800962 (0.0006) [2023-12-28 08:10:34,673][106226] Updated weights for policy 0, policy_version 1796849 (0.0006) [2023-12-28 08:10:34,734][106225] Updated weights for policy 1, policy_version 1800972 (0.0008) [2023-12-28 08:10:34,735][106226] Updated weights for policy 0, policy_version 1796859 (0.0006) [2023-12-28 08:10:34,789][106226] Updated weights for policy 0, policy_version 1796869 (0.0006) [2023-12-28 08:10:34,793][106225] Updated weights for policy 1, policy_version 1800982 (0.0008) [2023-12-28 08:10:34,854][106225] Updated weights for policy 1, policy_version 1800992 (0.0006) [2023-12-28 08:10:35,503][106225] Updated weights for policy 1, policy_version 1801002 (0.0009) [2023-12-28 08:10:35,520][106226] Updated weights for policy 0, policy_version 1796879 (0.0008) [2023-12-28 08:10:35,555][106225] Updated weights for policy 1, policy_version 1801012 (0.0005) [2023-12-28 08:10:35,591][106226] Updated weights for policy 0, policy_version 1796889 (0.0008) [2023-12-28 08:10:35,615][106225] Updated weights for policy 1, policy_version 1801022 (0.0006) [2023-12-28 08:10:35,660][106226] Updated weights for policy 0, policy_version 1796899 (0.0008) [2023-12-28 08:10:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 921206784. Throughput: 0: 9692.5, 1: 9970.4. Samples: 921219020. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:36,175][105115] Avg episode reward: [(0, '-4.662'), (1, '-4.845')] [2023-12-28 08:10:36,311][106225] Updated weights for policy 1, policy_version 1801032 (0.0007) [2023-12-28 08:10:36,325][106226] Updated weights for policy 0, policy_version 1796909 (0.0008) [2023-12-28 08:10:36,378][106225] Updated weights for policy 1, policy_version 1801042 (0.0006) [2023-12-28 08:10:36,395][106226] Updated weights for policy 0, policy_version 1796919 (0.0008) [2023-12-28 08:10:36,446][106225] Updated weights for policy 1, policy_version 1801052 (0.0006) [2023-12-28 08:10:36,457][106226] Updated weights for policy 0, policy_version 1796929 (0.0007) [2023-12-28 08:10:37,107][106226] Updated weights for policy 0, policy_version 1796939 (0.0007) [2023-12-28 08:10:37,169][106226] Updated weights for policy 0, policy_version 1796949 (0.0008) [2023-12-28 08:10:37,172][106225] Updated weights for policy 1, policy_version 1801062 (0.0006) [2023-12-28 08:10:37,222][106225] Updated weights for policy 1, policy_version 1801072 (0.0006) [2023-12-28 08:10:37,223][106226] Updated weights for policy 0, policy_version 1796959 (0.0011) [2023-12-28 08:10:37,278][106225] Updated weights for policy 1, policy_version 1801082 (0.0005) [2023-12-28 08:10:37,920][106225] Updated weights for policy 1, policy_version 1801092 (0.0009) [2023-12-28 08:10:37,931][106226] Updated weights for policy 0, policy_version 1796969 (0.0010) [2023-12-28 08:10:37,981][106225] Updated weights for policy 1, policy_version 1801102 (0.0010) [2023-12-28 08:10:37,985][106226] Updated weights for policy 0, policy_version 1796979 (0.0006) [2023-12-28 08:10:38,035][106225] Updated weights for policy 1, policy_version 1801112 (0.0009) [2023-12-28 08:10:38,044][106226] Updated weights for policy 0, policy_version 1796989 (0.0005) [2023-12-28 08:10:38,104][106226] Updated weights for policy 0, policy_version 1796999 (0.0005) [2023-12-28 08:10:38,707][106226] Updated weights for policy 0, policy_version 1797009 (0.0010) [2023-12-28 08:10:38,721][106225] Updated weights for policy 1, policy_version 1801122 (0.0008) [2023-12-28 08:10:38,773][106226] Updated weights for policy 0, policy_version 1797019 (0.0011) [2023-12-28 08:10:38,783][106225] Updated weights for policy 1, policy_version 1801132 (0.0005) [2023-12-28 08:10:38,837][106226] Updated weights for policy 0, policy_version 1797029 (0.0011) [2023-12-28 08:10:38,846][106225] Updated weights for policy 1, policy_version 1801142 (0.0005) [2023-12-28 08:10:38,907][106225] Updated weights for policy 1, policy_version 1801152 (0.0007) [2023-12-28 08:10:39,602][106225] Updated weights for policy 1, policy_version 1801162 (0.0006) [2023-12-28 08:10:39,624][106226] Updated weights for policy 0, policy_version 1797039 (0.0008) [2023-12-28 08:10:39,662][106225] Updated weights for policy 1, policy_version 1801172 (0.0007) [2023-12-28 08:10:39,688][106226] Updated weights for policy 0, policy_version 1797049 (0.0007) [2023-12-28 08:10:39,729][106225] Updated weights for policy 1, policy_version 1801182 (0.0008) [2023-12-28 08:10:39,756][106226] Updated weights for policy 0, policy_version 1797059 (0.0007) [2023-12-28 08:10:40,478][106226] Updated weights for policy 0, policy_version 1797069 (0.0009) [2023-12-28 08:10:40,512][106225] Updated weights for policy 1, policy_version 1801192 (0.0008) [2023-12-28 08:10:40,538][106226] Updated weights for policy 0, policy_version 1797079 (0.0007) [2023-12-28 08:10:40,571][106225] Updated weights for policy 1, policy_version 1801202 (0.0006) [2023-12-28 08:10:40,608][106226] Updated weights for policy 0, policy_version 1797089 (0.0008) [2023-12-28 08:10:40,630][106225] Updated weights for policy 1, policy_version 1801212 (0.0007) [2023-12-28 08:10:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 921305088. Throughput: 0: 9689.9, 1: 9968.3. Samples: 921279348. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:41,175][105115] Avg episode reward: [(0, '-4.459'), (1, '-4.957')] [2023-12-28 08:10:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001801216_461168640.pth... [2023-12-28 08:10:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001797096_460136448.pth... [2023-12-28 08:10:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001800064_460873728.pth [2023-12-28 08:10:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001795976_459849728.pth [2023-12-28 08:10:41,284][106226] Updated weights for policy 0, policy_version 1797099 (0.0008) [2023-12-28 08:10:41,346][106226] Updated weights for policy 0, policy_version 1797109 (0.0008) [2023-12-28 08:10:41,356][106225] Updated weights for policy 1, policy_version 1801222 (0.0007) [2023-12-28 08:10:41,418][106226] Updated weights for policy 0, policy_version 1797119 (0.0008) [2023-12-28 08:10:41,427][106225] Updated weights for policy 1, policy_version 1801232 (0.0008) [2023-12-28 08:10:41,492][106225] Updated weights for policy 1, policy_version 1801242 (0.0009) [2023-12-28 08:10:42,179][106226] Updated weights for policy 0, policy_version 1797129 (0.0006) [2023-12-28 08:10:42,244][106226] Updated weights for policy 0, policy_version 1797139 (0.0009) [2023-12-28 08:10:42,276][106225] Updated weights for policy 1, policy_version 1801252 (0.0008) [2023-12-28 08:10:42,304][106226] Updated weights for policy 0, policy_version 1797149 (0.0006) [2023-12-28 08:10:42,337][106225] Updated weights for policy 1, policy_version 1801262 (0.0007) [2023-12-28 08:10:42,371][106226] Updated weights for policy 0, policy_version 1797159 (0.0008) [2023-12-28 08:10:42,400][106225] Updated weights for policy 1, policy_version 1801272 (0.0007) [2023-12-28 08:10:43,054][106226] Updated weights for policy 0, policy_version 1797169 (0.0006) [2023-12-28 08:10:43,078][106225] Updated weights for policy 1, policy_version 1801282 (0.0009) [2023-12-28 08:10:43,108][106226] Updated weights for policy 0, policy_version 1797179 (0.0005) [2023-12-28 08:10:43,140][106225] Updated weights for policy 1, policy_version 1801292 (0.0008) [2023-12-28 08:10:43,164][106226] Updated weights for policy 0, policy_version 1797189 (0.0006) [2023-12-28 08:10:43,190][106225] Updated weights for policy 1, policy_version 1801302 (0.0007) [2023-12-28 08:10:43,248][106225] Updated weights for policy 1, policy_version 1801312 (0.0008) [2023-12-28 08:10:43,761][106226] Updated weights for policy 0, policy_version 1797199 (0.0006) [2023-12-28 08:10:43,825][106226] Updated weights for policy 0, policy_version 1797209 (0.0005) [2023-12-28 08:10:43,882][106226] Updated weights for policy 0, policy_version 1797219 (0.0009) [2023-12-28 08:10:43,920][106225] Updated weights for policy 1, policy_version 1801322 (0.0007) [2023-12-28 08:10:43,982][106225] Updated weights for policy 1, policy_version 1801332 (0.0009) [2023-12-28 08:10:44,041][106225] Updated weights for policy 1, policy_version 1801342 (0.0008) [2023-12-28 08:10:44,519][106226] Updated weights for policy 0, policy_version 1797229 (0.0005) [2023-12-28 08:10:44,586][106226] Updated weights for policy 0, policy_version 1797239 (0.0005) [2023-12-28 08:10:44,635][106225] Updated weights for policy 1, policy_version 1801352 (0.0007) [2023-12-28 08:10:44,647][106226] Updated weights for policy 0, policy_version 1797249 (0.0006) [2023-12-28 08:10:44,690][106225] Updated weights for policy 1, policy_version 1801362 (0.0010) [2023-12-28 08:10:44,754][106225] Updated weights for policy 1, policy_version 1801372 (0.0010) [2023-12-28 08:10:45,315][106226] Updated weights for policy 0, policy_version 1797259 (0.0007) [2023-12-28 08:10:45,375][106226] Updated weights for policy 0, policy_version 1797269 (0.0011) [2023-12-28 08:10:45,438][106226] Updated weights for policy 0, policy_version 1797279 (0.0011) [2023-12-28 08:10:45,511][106225] Updated weights for policy 1, policy_version 1801382 (0.0009) [2023-12-28 08:10:45,558][106225] Updated weights for policy 1, policy_version 1801392 (0.0007) [2023-12-28 08:10:45,609][106225] Updated weights for policy 1, policy_version 1801402 (0.0007) [2023-12-28 08:10:46,110][106226] Updated weights for policy 0, policy_version 1797289 (0.0010) [2023-12-28 08:10:46,174][106226] Updated weights for policy 0, policy_version 1797299 (0.0010) [2023-12-28 08:10:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 921403392. Throughput: 0: 9679.3, 1: 9974.8. Samples: 921397736. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:46,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.394')] [2023-12-28 08:10:46,230][106226] Updated weights for policy 0, policy_version 1797309 (0.0010) [2023-12-28 08:10:46,288][106225] Updated weights for policy 1, policy_version 1801412 (0.0007) [2023-12-28 08:10:46,297][106226] Updated weights for policy 0, policy_version 1797319 (0.0011) [2023-12-28 08:10:46,335][106225] Updated weights for policy 1, policy_version 1801422 (0.0005) [2023-12-28 08:10:46,378][106225] Updated weights for policy 1, policy_version 1801432 (0.0007) [2023-12-28 08:10:46,860][106226] Updated weights for policy 0, policy_version 1797329 (0.0006) [2023-12-28 08:10:46,915][106226] Updated weights for policy 0, policy_version 1797339 (0.0008) [2023-12-28 08:10:46,965][106226] Updated weights for policy 0, policy_version 1797349 (0.0010) [2023-12-28 08:10:47,018][106225] Updated weights for policy 1, policy_version 1801442 (0.0009) [2023-12-28 08:10:47,077][106225] Updated weights for policy 1, policy_version 1801452 (0.0009) [2023-12-28 08:10:47,125][106225] Updated weights for policy 1, policy_version 1801462 (0.0010) [2023-12-28 08:10:47,177][106225] Updated weights for policy 1, policy_version 1801472 (0.0010) [2023-12-28 08:10:47,549][106226] Updated weights for policy 0, policy_version 1797359 (0.0007) [2023-12-28 08:10:47,610][106226] Updated weights for policy 0, policy_version 1797369 (0.0009) [2023-12-28 08:10:47,673][106226] Updated weights for policy 0, policy_version 1797379 (0.0010) [2023-12-28 08:10:47,890][106225] Updated weights for policy 1, policy_version 1801482 (0.0007) [2023-12-28 08:10:47,950][106225] Updated weights for policy 1, policy_version 1801492 (0.0006) [2023-12-28 08:10:48,015][106225] Updated weights for policy 1, policy_version 1801502 (0.0006) [2023-12-28 08:10:48,337][106226] Updated weights for policy 0, policy_version 1797389 (0.0010) [2023-12-28 08:10:48,404][106226] Updated weights for policy 0, policy_version 1797399 (0.0011) [2023-12-28 08:10:48,470][106226] Updated weights for policy 0, policy_version 1797409 (0.0011) [2023-12-28 08:10:48,669][106225] Updated weights for policy 1, policy_version 1801512 (0.0007) [2023-12-28 08:10:48,723][106225] Updated weights for policy 1, policy_version 1801522 (0.0006) [2023-12-28 08:10:48,769][106225] Updated weights for policy 1, policy_version 1801532 (0.0007) [2023-12-28 08:10:49,202][106226] Updated weights for policy 0, policy_version 1797419 (0.0011) [2023-12-28 08:10:49,272][106226] Updated weights for policy 0, policy_version 1797429 (0.0010) [2023-12-28 08:10:49,326][106226] Updated weights for policy 0, policy_version 1797439 (0.0010) [2023-12-28 08:10:49,486][106225] Updated weights for policy 1, policy_version 1801542 (0.0008) [2023-12-28 08:10:49,544][106225] Updated weights for policy 1, policy_version 1801552 (0.0006) [2023-12-28 08:10:49,597][106225] Updated weights for policy 1, policy_version 1801562 (0.0005) [2023-12-28 08:10:50,119][106226] Updated weights for policy 0, policy_version 1797449 (0.0009) [2023-12-28 08:10:50,186][106226] Updated weights for policy 0, policy_version 1797459 (0.0006) [2023-12-28 08:10:50,235][106225] Updated weights for policy 1, policy_version 1801572 (0.0007) [2023-12-28 08:10:50,253][106226] Updated weights for policy 0, policy_version 1797469 (0.0007) [2023-12-28 08:10:50,293][106225] Updated weights for policy 1, policy_version 1801582 (0.0010) [2023-12-28 08:10:50,317][106226] Updated weights for policy 0, policy_version 1797479 (0.0008) [2023-12-28 08:10:50,354][106225] Updated weights for policy 1, policy_version 1801592 (0.0008) [2023-12-28 08:10:50,981][106226] Updated weights for policy 0, policy_version 1797489 (0.0010) [2023-12-28 08:10:51,035][106225] Updated weights for policy 1, policy_version 1801602 (0.0008) [2023-12-28 08:10:51,048][106226] Updated weights for policy 0, policy_version 1797499 (0.0010) [2023-12-28 08:10:51,097][106225] Updated weights for policy 1, policy_version 1801612 (0.0007) [2023-12-28 08:10:51,113][106226] Updated weights for policy 0, policy_version 1797509 (0.0009) [2023-12-28 08:10:51,169][106225] Updated weights for policy 1, policy_version 1801622 (0.0008) [2023-12-28 08:10:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 921509888. Throughput: 0: 9784.5, 1: 9975.1. Samples: 921520048. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:51,175][105115] Avg episode reward: [(0, '-4.198'), (1, '-4.707')] [2023-12-28 08:10:51,229][106225] Updated weights for policy 1, policy_version 1801632 (0.0008) [2023-12-28 08:10:51,870][106226] Updated weights for policy 0, policy_version 1797519 (0.0007) [2023-12-28 08:10:51,932][106226] Updated weights for policy 0, policy_version 1797529 (0.0005) [2023-12-28 08:10:51,995][106225] Updated weights for policy 1, policy_version 1801642 (0.0008) [2023-12-28 08:10:51,999][106226] Updated weights for policy 0, policy_version 1797539 (0.0007) [2023-12-28 08:10:52,057][106225] Updated weights for policy 1, policy_version 1801652 (0.0008) [2023-12-28 08:10:52,116][106225] Updated weights for policy 1, policy_version 1801662 (0.0008) [2023-12-28 08:10:52,640][106226] Updated weights for policy 0, policy_version 1797549 (0.0007) [2023-12-28 08:10:52,703][106226] Updated weights for policy 0, policy_version 1797559 (0.0008) [2023-12-28 08:10:52,758][106226] Updated weights for policy 0, policy_version 1797569 (0.0007) [2023-12-28 08:10:52,898][106225] Updated weights for policy 1, policy_version 1801672 (0.0010) [2023-12-28 08:10:52,951][106225] Updated weights for policy 1, policy_version 1801682 (0.0007) [2023-12-28 08:10:53,006][106225] Updated weights for policy 1, policy_version 1801692 (0.0007) [2023-12-28 08:10:53,389][106226] Updated weights for policy 0, policy_version 1797579 (0.0008) [2023-12-28 08:10:53,438][106226] Updated weights for policy 0, policy_version 1797589 (0.0008) [2023-12-28 08:10:53,494][106226] Updated weights for policy 0, policy_version 1797599 (0.0007) [2023-12-28 08:10:53,643][106225] Updated weights for policy 1, policy_version 1801702 (0.0009) [2023-12-28 08:10:53,708][106225] Updated weights for policy 1, policy_version 1801712 (0.0010) [2023-12-28 08:10:53,772][106225] Updated weights for policy 1, policy_version 1801722 (0.0010) [2023-12-28 08:10:54,067][106226] Updated weights for policy 0, policy_version 1797609 (0.0005) [2023-12-28 08:10:54,131][106226] Updated weights for policy 0, policy_version 1797619 (0.0008) [2023-12-28 08:10:54,198][106226] Updated weights for policy 0, policy_version 1797629 (0.0011) [2023-12-28 08:10:54,266][106226] Updated weights for policy 0, policy_version 1797639 (0.0010) [2023-12-28 08:10:54,439][106225] Updated weights for policy 1, policy_version 1801732 (0.0010) [2023-12-28 08:10:54,500][106225] Updated weights for policy 1, policy_version 1801742 (0.0010) [2023-12-28 08:10:54,557][106225] Updated weights for policy 1, policy_version 1801752 (0.0010) [2023-12-28 08:10:54,865][106226] Updated weights for policy 0, policy_version 1797649 (0.0006) [2023-12-28 08:10:54,933][106226] Updated weights for policy 0, policy_version 1797659 (0.0005) [2023-12-28 08:10:54,995][106226] Updated weights for policy 0, policy_version 1797669 (0.0007) [2023-12-28 08:10:55,266][106225] Updated weights for policy 1, policy_version 1801762 (0.0010) [2023-12-28 08:10:55,322][106225] Updated weights for policy 1, policy_version 1801772 (0.0010) [2023-12-28 08:10:55,373][106225] Updated weights for policy 1, policy_version 1801782 (0.0008) [2023-12-28 08:10:55,422][106225] Updated weights for policy 1, policy_version 1801792 (0.0005) [2023-12-28 08:10:55,583][106226] Updated weights for policy 0, policy_version 1797679 (0.0007) [2023-12-28 08:10:55,642][106226] Updated weights for policy 0, policy_version 1797689 (0.0010) [2023-12-28 08:10:55,702][106226] Updated weights for policy 0, policy_version 1797699 (0.0006) [2023-12-28 08:10:56,003][106225] Updated weights for policy 1, policy_version 1801802 (0.0010) [2023-12-28 08:10:56,056][106225] Updated weights for policy 1, policy_version 1801812 (0.0009) [2023-12-28 08:10:56,110][106225] Updated weights for policy 1, policy_version 1801822 (0.0006) [2023-12-28 08:10:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 921616384. Throughput: 0: 9858.3, 1: 9896.6. Samples: 921580100. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:10:56,175][105115] Avg episode reward: [(0, '-4.352'), (1, '-4.769')] [2023-12-28 08:10:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001801824_461324288.pth... [2023-12-28 08:10:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001797704_460292096.pth... [2023-12-28 08:10:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001800640_461021184.pth [2023-12-28 08:10:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001796520_459988992.pth [2023-12-28 08:10:56,239][106226] Updated weights for policy 0, policy_version 1797709 (0.0006) [2023-12-28 08:10:56,296][106226] Updated weights for policy 0, policy_version 1797719 (0.0008) [2023-12-28 08:10:56,347][106226] Updated weights for policy 0, policy_version 1797729 (0.0008) [2023-12-28 08:10:56,765][106225] Updated weights for policy 1, policy_version 1801832 (0.0006) [2023-12-28 08:10:56,810][106225] Updated weights for policy 1, policy_version 1801842 (0.0005) [2023-12-28 08:10:56,867][106225] Updated weights for policy 1, policy_version 1801852 (0.0005) [2023-12-28 08:10:57,149][106226] Updated weights for policy 0, policy_version 1797739 (0.0008) [2023-12-28 08:10:57,209][106226] Updated weights for policy 0, policy_version 1797749 (0.0008) [2023-12-28 08:10:57,255][106226] Updated weights for policy 0, policy_version 1797759 (0.0007) [2023-12-28 08:10:57,461][106225] Updated weights for policy 1, policy_version 1801862 (0.0005) [2023-12-28 08:10:57,508][106225] Updated weights for policy 1, policy_version 1801872 (0.0007) [2023-12-28 08:10:57,554][106225] Updated weights for policy 1, policy_version 1801882 (0.0010) [2023-12-28 08:10:58,012][106226] Updated weights for policy 0, policy_version 1797769 (0.0008) [2023-12-28 08:10:58,067][106226] Updated weights for policy 0, policy_version 1797779 (0.0008) [2023-12-28 08:10:58,117][106226] Updated weights for policy 0, policy_version 1797789 (0.0008) [2023-12-28 08:10:58,172][106226] Updated weights for policy 0, policy_version 1797799 (0.0006) [2023-12-28 08:10:58,281][106225] Updated weights for policy 1, policy_version 1801892 (0.0009) [2023-12-28 08:10:58,342][106225] Updated weights for policy 1, policy_version 1801902 (0.0010) [2023-12-28 08:10:58,407][106225] Updated weights for policy 1, policy_version 1801912 (0.0009) [2023-12-28 08:10:58,986][106226] Updated weights for policy 0, policy_version 1797809 (0.0008) [2023-12-28 08:10:59,053][106226] Updated weights for policy 0, policy_version 1797819 (0.0008) [2023-12-28 08:10:59,122][106226] Updated weights for policy 0, policy_version 1797829 (0.0008) [2023-12-28 08:10:59,261][106225] Updated weights for policy 1, policy_version 1801923 (0.0007) [2023-12-28 08:10:59,334][106225] Updated weights for policy 1, policy_version 1801933 (0.0008) [2023-12-28 08:10:59,397][106225] Updated weights for policy 1, policy_version 1801943 (0.0007) [2023-12-28 08:10:59,906][106226] Updated weights for policy 0, policy_version 1797839 (0.0010) [2023-12-28 08:10:59,974][106226] Updated weights for policy 0, policy_version 1797849 (0.0010) [2023-12-28 08:11:00,034][106226] Updated weights for policy 0, policy_version 1797859 (0.0010) [2023-12-28 08:11:00,115][106225] Updated weights for policy 1, policy_version 1801953 (0.0006) [2023-12-28 08:11:00,179][106225] Updated weights for policy 1, policy_version 1801963 (0.0008) [2023-12-28 08:11:00,242][106225] Updated weights for policy 1, policy_version 1801973 (0.0009) [2023-12-28 08:11:00,307][106225] Updated weights for policy 1, policy_version 1801983 (0.0009) [2023-12-28 08:11:00,745][106226] Updated weights for policy 0, policy_version 1797869 (0.0007) [2023-12-28 08:11:00,793][106226] Updated weights for policy 0, policy_version 1797879 (0.0008) [2023-12-28 08:11:00,848][106226] Updated weights for policy 0, policy_version 1797889 (0.0008) [2023-12-28 08:11:01,035][106225] Updated weights for policy 1, policy_version 1801993 (0.0010) [2023-12-28 08:11:01,100][106225] Updated weights for policy 1, policy_version 1802003 (0.0011) [2023-12-28 08:11:01,160][106225] Updated weights for policy 1, policy_version 1802013 (0.0009) [2023-12-28 08:11:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 921706496. Throughput: 0: 9893.0, 1: 9963.7. Samples: 921699968. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:01,175][105115] Avg episode reward: [(0, '-4.126'), (1, '-4.771')] [2023-12-28 08:11:01,488][106226] Updated weights for policy 0, policy_version 1797899 (0.0006) [2023-12-28 08:11:01,548][106226] Updated weights for policy 0, policy_version 1797909 (0.0007) [2023-12-28 08:11:01,604][106226] Updated weights for policy 0, policy_version 1797919 (0.0006) [2023-12-28 08:11:01,884][106225] Updated weights for policy 1, policy_version 1802023 (0.0009) [2023-12-28 08:11:01,951][106225] Updated weights for policy 1, policy_version 1802033 (0.0010) [2023-12-28 08:11:02,013][106225] Updated weights for policy 1, policy_version 1802043 (0.0006) [2023-12-28 08:11:02,243][106226] Updated weights for policy 0, policy_version 1797929 (0.0007) [2023-12-28 08:11:02,308][106226] Updated weights for policy 0, policy_version 1797939 (0.0007) [2023-12-28 08:11:02,371][106226] Updated weights for policy 0, policy_version 1797949 (0.0011) [2023-12-28 08:11:02,424][106226] Updated weights for policy 0, policy_version 1797959 (0.0010) [2023-12-28 08:11:02,719][106225] Updated weights for policy 1, policy_version 1802053 (0.0007) [2023-12-28 08:11:02,774][106225] Updated weights for policy 1, policy_version 1802063 (0.0008) [2023-12-28 08:11:02,834][106225] Updated weights for policy 1, policy_version 1802073 (0.0009) [2023-12-28 08:11:03,076][106226] Updated weights for policy 0, policy_version 1797969 (0.0009) [2023-12-28 08:11:03,131][106226] Updated weights for policy 0, policy_version 1797979 (0.0009) [2023-12-28 08:11:03,193][106226] Updated weights for policy 0, policy_version 1797989 (0.0010) [2023-12-28 08:11:03,549][106225] Updated weights for policy 1, policy_version 1802083 (0.0009) [2023-12-28 08:11:03,611][106225] Updated weights for policy 1, policy_version 1802093 (0.0008) [2023-12-28 08:11:03,658][106225] Updated weights for policy 1, policy_version 1802103 (0.0008) [2023-12-28 08:11:03,901][106226] Updated weights for policy 0, policy_version 1797999 (0.0008) [2023-12-28 08:11:03,960][106226] Updated weights for policy 0, policy_version 1798009 (0.0008) [2023-12-28 08:11:04,010][106226] Updated weights for policy 0, policy_version 1798019 (0.0008) [2023-12-28 08:11:04,456][106225] Updated weights for policy 1, policy_version 1802113 (0.0009) [2023-12-28 08:11:04,519][106225] Updated weights for policy 1, policy_version 1802123 (0.0008) [2023-12-28 08:11:04,569][106225] Updated weights for policy 1, policy_version 1802133 (0.0008) [2023-12-28 08:11:04,624][106225] Updated weights for policy 1, policy_version 1802143 (0.0008) [2023-12-28 08:11:04,751][106226] Updated weights for policy 0, policy_version 1798029 (0.0007) [2023-12-28 08:11:04,804][106226] Updated weights for policy 0, policy_version 1798039 (0.0006) [2023-12-28 08:11:04,865][106226] Updated weights for policy 0, policy_version 1798049 (0.0011) [2023-12-28 08:11:05,374][106225] Updated weights for policy 1, policy_version 1802153 (0.0007) [2023-12-28 08:11:05,423][106225] Updated weights for policy 1, policy_version 1802164 (0.0009) [2023-12-28 08:11:05,483][106225] Updated weights for policy 1, policy_version 1802174 (0.0008) [2023-12-28 08:11:05,529][106226] Updated weights for policy 0, policy_version 1798059 (0.0011) [2023-12-28 08:11:05,586][106226] Updated weights for policy 0, policy_version 1798069 (0.0007) [2023-12-28 08:11:05,641][106226] Updated weights for policy 0, policy_version 1798079 (0.0007) [2023-12-28 08:11:06,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 921804800. Throughput: 0: 9978.3, 1: 9901.5. Samples: 921817020. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:06,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.875')] [2023-12-28 08:11:06,259][106225] Updated weights for policy 1, policy_version 1802184 (0.0008) [2023-12-28 08:11:06,316][106225] Updated weights for policy 1, policy_version 1802194 (0.0008) [2023-12-28 08:11:06,372][106226] Updated weights for policy 0, policy_version 1798089 (0.0010) [2023-12-28 08:11:06,374][106225] Updated weights for policy 1, policy_version 1802204 (0.0008) [2023-12-28 08:11:06,440][106226] Updated weights for policy 0, policy_version 1798099 (0.0011) [2023-12-28 08:11:06,508][106226] Updated weights for policy 0, policy_version 1798109 (0.0011) [2023-12-28 08:11:06,569][106226] Updated weights for policy 0, policy_version 1798119 (0.0011) [2023-12-28 08:11:07,143][106225] Updated weights for policy 1, policy_version 1802214 (0.0008) [2023-12-28 08:11:07,204][106225] Updated weights for policy 1, policy_version 1802224 (0.0007) [2023-12-28 08:11:07,245][106226] Updated weights for policy 0, policy_version 1798129 (0.0008) [2023-12-28 08:11:07,260][106225] Updated weights for policy 1, policy_version 1802234 (0.0008) [2023-12-28 08:11:07,306][106226] Updated weights for policy 0, policy_version 1798139 (0.0005) [2023-12-28 08:11:07,374][106226] Updated weights for policy 0, policy_version 1798149 (0.0005) [2023-12-28 08:11:07,986][106226] Updated weights for policy 0, policy_version 1798159 (0.0007) [2023-12-28 08:11:08,014][106225] Updated weights for policy 1, policy_version 1802244 (0.0008) [2023-12-28 08:11:08,039][106226] Updated weights for policy 0, policy_version 1798169 (0.0009) [2023-12-28 08:11:08,072][106225] Updated weights for policy 1, policy_version 1802254 (0.0006) [2023-12-28 08:11:08,110][106226] Updated weights for policy 0, policy_version 1798179 (0.0008) [2023-12-28 08:11:08,141][106225] Updated weights for policy 1, policy_version 1802264 (0.0006) [2023-12-28 08:11:08,842][106225] Updated weights for policy 1, policy_version 1802274 (0.0007) [2023-12-28 08:11:08,900][106226] Updated weights for policy 0, policy_version 1798189 (0.0008) [2023-12-28 08:11:08,901][106225] Updated weights for policy 1, policy_version 1802284 (0.0008) [2023-12-28 08:11:08,956][106226] Updated weights for policy 0, policy_version 1798199 (0.0008) [2023-12-28 08:11:08,959][106225] Updated weights for policy 1, policy_version 1802294 (0.0007) [2023-12-28 08:11:09,013][106226] Updated weights for policy 0, policy_version 1798209 (0.0008) [2023-12-28 08:11:09,014][106225] Updated weights for policy 1, policy_version 1802304 (0.0008) [2023-12-28 08:11:09,760][106226] Updated weights for policy 0, policy_version 1798219 (0.0007) [2023-12-28 08:11:09,789][106225] Updated weights for policy 1, policy_version 1802314 (0.0008) [2023-12-28 08:11:09,823][106226] Updated weights for policy 0, policy_version 1798229 (0.0008) [2023-12-28 08:11:09,859][106225] Updated weights for policy 1, policy_version 1802324 (0.0007) [2023-12-28 08:11:09,893][106226] Updated weights for policy 0, policy_version 1798239 (0.0008) [2023-12-28 08:11:09,926][106225] Updated weights for policy 1, policy_version 1802334 (0.0008) [2023-12-28 08:11:10,591][106225] Updated weights for policy 1, policy_version 1802344 (0.0006) [2023-12-28 08:11:10,613][106226] Updated weights for policy 0, policy_version 1798249 (0.0008) [2023-12-28 08:11:10,658][106225] Updated weights for policy 1, policy_version 1802354 (0.0010) [2023-12-28 08:11:10,670][106226] Updated weights for policy 0, policy_version 1798259 (0.0005) [2023-12-28 08:11:10,718][106225] Updated weights for policy 1, policy_version 1802364 (0.0010) [2023-12-28 08:11:10,722][106226] Updated weights for policy 0, policy_version 1798269 (0.0005) [2023-12-28 08:11:10,771][106226] Updated weights for policy 0, policy_version 1798279 (0.0005) [2023-12-28 08:11:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 921903104. Throughput: 0: 10026.2, 1: 9866.1. Samples: 921874316. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:11,175][105115] Avg episode reward: [(0, '-4.446'), (1, '-5.047')] [2023-12-28 08:11:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001802368_461463552.pth... [2023-12-28 08:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001798280_460439552.pth... [2023-12-28 08:11:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001801216_461168640.pth [2023-12-28 08:11:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001797096_460136448.pth [2023-12-28 08:11:11,427][106226] Updated weights for policy 0, policy_version 1798289 (0.0008) [2023-12-28 08:11:11,442][106225] Updated weights for policy 1, policy_version 1802374 (0.0011) [2023-12-28 08:11:11,491][106226] Updated weights for policy 0, policy_version 1798299 (0.0006) [2023-12-28 08:11:11,508][106225] Updated weights for policy 1, policy_version 1802384 (0.0011) [2023-12-28 08:11:11,553][106226] Updated weights for policy 0, policy_version 1798309 (0.0006) [2023-12-28 08:11:11,570][106225] Updated weights for policy 1, policy_version 1802394 (0.0011) [2023-12-28 08:11:12,237][106226] Updated weights for policy 0, policy_version 1798319 (0.0008) [2023-12-28 08:11:12,263][106225] Updated weights for policy 1, policy_version 1802404 (0.0010) [2023-12-28 08:11:12,310][106226] Updated weights for policy 0, policy_version 1798329 (0.0007) [2023-12-28 08:11:12,328][106225] Updated weights for policy 1, policy_version 1802414 (0.0009) [2023-12-28 08:11:12,376][106226] Updated weights for policy 0, policy_version 1798339 (0.0008) [2023-12-28 08:11:12,394][106225] Updated weights for policy 1, policy_version 1802424 (0.0010) [2023-12-28 08:11:12,998][106226] Updated weights for policy 0, policy_version 1798349 (0.0008) [2023-12-28 08:11:13,061][106226] Updated weights for policy 0, policy_version 1798359 (0.0007) [2023-12-28 08:11:13,105][106225] Updated weights for policy 1, policy_version 1802434 (0.0010) [2023-12-28 08:11:13,117][106226] Updated weights for policy 0, policy_version 1798369 (0.0007) [2023-12-28 08:11:13,155][106225] Updated weights for policy 1, policy_version 1802444 (0.0010) [2023-12-28 08:11:13,202][106225] Updated weights for policy 1, policy_version 1802454 (0.0010) [2023-12-28 08:11:13,252][106225] Updated weights for policy 1, policy_version 1802464 (0.0010) [2023-12-28 08:11:13,869][106225] Updated weights for policy 1, policy_version 1802474 (0.0005) [2023-12-28 08:11:13,877][106226] Updated weights for policy 0, policy_version 1798379 (0.0006) [2023-12-28 08:11:13,921][106225] Updated weights for policy 1, policy_version 1802484 (0.0005) [2023-12-28 08:11:13,929][106226] Updated weights for policy 0, policy_version 1798389 (0.0008) [2023-12-28 08:11:13,973][106225] Updated weights for policy 1, policy_version 1802494 (0.0005) [2023-12-28 08:11:13,983][106226] Updated weights for policy 0, policy_version 1798399 (0.0009) [2023-12-28 08:11:14,572][106225] Updated weights for policy 1, policy_version 1802504 (0.0006) [2023-12-28 08:11:14,619][106225] Updated weights for policy 1, policy_version 1802514 (0.0007) [2023-12-28 08:11:14,700][106225] Updated weights for policy 1, policy_version 1802524 (0.0006) [2023-12-28 08:11:14,746][106226] Updated weights for policy 0, policy_version 1798409 (0.0009) [2023-12-28 08:11:14,816][106226] Updated weights for policy 0, policy_version 1798419 (0.0008) [2023-12-28 08:11:14,878][106226] Updated weights for policy 0, policy_version 1798429 (0.0009) [2023-12-28 08:11:14,944][106226] Updated weights for policy 0, policy_version 1798439 (0.0006) [2023-12-28 08:11:15,354][106225] Updated weights for policy 1, policy_version 1802534 (0.0008) [2023-12-28 08:11:15,408][106225] Updated weights for policy 1, policy_version 1802544 (0.0010) [2023-12-28 08:11:15,454][106225] Updated weights for policy 1, policy_version 1802554 (0.0010) [2023-12-28 08:11:15,638][106226] Updated weights for policy 0, policy_version 1798449 (0.0005) [2023-12-28 08:11:15,703][106226] Updated weights for policy 0, policy_version 1798459 (0.0005) [2023-12-28 08:11:15,768][106226] Updated weights for policy 0, policy_version 1798469 (0.0005) [2023-12-28 08:11:16,172][106225] Updated weights for policy 1, policy_version 1802564 (0.0010) [2023-12-28 08:11:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 922001408. Throughput: 0: 9985.4, 1: 9833.1. Samples: 921993136. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:16,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.879')] [2023-12-28 08:11:16,222][106225] Updated weights for policy 1, policy_version 1802574 (0.0009) [2023-12-28 08:11:16,271][106225] Updated weights for policy 1, policy_version 1802584 (0.0010) [2023-12-28 08:11:16,385][106226] Updated weights for policy 0, policy_version 1798479 (0.0009) [2023-12-28 08:11:16,435][106226] Updated weights for policy 0, policy_version 1798489 (0.0010) [2023-12-28 08:11:16,487][106226] Updated weights for policy 0, policy_version 1798499 (0.0007) [2023-12-28 08:11:16,946][106225] Updated weights for policy 1, policy_version 1802594 (0.0009) [2023-12-28 08:11:16,992][106225] Updated weights for policy 1, policy_version 1802604 (0.0005) [2023-12-28 08:11:17,035][106225] Updated weights for policy 1, policy_version 1802614 (0.0006) [2023-12-28 08:11:17,081][106225] Updated weights for policy 1, policy_version 1802624 (0.0005) [2023-12-28 08:11:17,152][106226] Updated weights for policy 0, policy_version 1798509 (0.0008) [2023-12-28 08:11:17,198][106226] Updated weights for policy 0, policy_version 1798519 (0.0010) [2023-12-28 08:11:17,246][106226] Updated weights for policy 0, policy_version 1798529 (0.0008) [2023-12-28 08:11:17,741][106225] Updated weights for policy 1, policy_version 1802634 (0.0010) [2023-12-28 08:11:17,797][106225] Updated weights for policy 1, policy_version 1802644 (0.0010) [2023-12-28 08:11:17,857][106225] Updated weights for policy 1, policy_version 1802654 (0.0008) [2023-12-28 08:11:17,961][106226] Updated weights for policy 0, policy_version 1798539 (0.0007) [2023-12-28 08:11:18,017][106226] Updated weights for policy 0, policy_version 1798549 (0.0010) [2023-12-28 08:11:18,065][106226] Updated weights for policy 0, policy_version 1798559 (0.0010) [2023-12-28 08:11:18,486][106225] Updated weights for policy 1, policy_version 1802664 (0.0008) [2023-12-28 08:11:18,533][106225] Updated weights for policy 1, policy_version 1802674 (0.0005) [2023-12-28 08:11:18,596][106225] Updated weights for policy 1, policy_version 1802684 (0.0006) [2023-12-28 08:11:18,752][106226] Updated weights for policy 0, policy_version 1798569 (0.0010) [2023-12-28 08:11:18,821][106226] Updated weights for policy 0, policy_version 1798579 (0.0011) [2023-12-28 08:11:18,894][106226] Updated weights for policy 0, policy_version 1798589 (0.0011) [2023-12-28 08:11:18,951][106226] Updated weights for policy 0, policy_version 1798599 (0.0010) [2023-12-28 08:11:19,219][106225] Updated weights for policy 1, policy_version 1802694 (0.0007) [2023-12-28 08:11:19,292][106225] Updated weights for policy 1, policy_version 1802704 (0.0006) [2023-12-28 08:11:19,357][106225] Updated weights for policy 1, policy_version 1802714 (0.0006) [2023-12-28 08:11:19,693][106226] Updated weights for policy 0, policy_version 1798609 (0.0013) [2023-12-28 08:11:19,758][106226] Updated weights for policy 0, policy_version 1798619 (0.0011) [2023-12-28 08:11:19,836][106226] Updated weights for policy 0, policy_version 1798629 (0.0011) [2023-12-28 08:11:20,055][106225] Updated weights for policy 1, policy_version 1802724 (0.0009) [2023-12-28 08:11:20,114][106225] Updated weights for policy 1, policy_version 1802734 (0.0008) [2023-12-28 08:11:20,177][106225] Updated weights for policy 1, policy_version 1802744 (0.0008) [2023-12-28 08:11:20,551][106226] Updated weights for policy 0, policy_version 1798639 (0.0010) [2023-12-28 08:11:20,620][106226] Updated weights for policy 0, policy_version 1798649 (0.0009) [2023-12-28 08:11:20,685][106226] Updated weights for policy 0, policy_version 1798659 (0.0007) [2023-12-28 08:11:20,911][106225] Updated weights for policy 1, policy_version 1802754 (0.0007) [2023-12-28 08:11:20,974][106225] Updated weights for policy 1, policy_version 1802764 (0.0010) [2023-12-28 08:11:21,040][106225] Updated weights for policy 1, policy_version 1802774 (0.0010) [2023-12-28 08:11:21,103][106225] Updated weights for policy 1, policy_version 1802784 (0.0007) [2023-12-28 08:11:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 922107904. Throughput: 0: 10010.0, 1: 9909.3. Samples: 922115388. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:21,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.903')] [2023-12-28 08:11:21,425][106226] Updated weights for policy 0, policy_version 1798669 (0.0010) [2023-12-28 08:11:21,490][106226] Updated weights for policy 0, policy_version 1798679 (0.0011) [2023-12-28 08:11:21,558][106226] Updated weights for policy 0, policy_version 1798689 (0.0011) [2023-12-28 08:11:21,896][106225] Updated weights for policy 1, policy_version 1802794 (0.0011) [2023-12-28 08:11:21,961][106225] Updated weights for policy 1, policy_version 1802804 (0.0010) [2023-12-28 08:11:22,019][106225] Updated weights for policy 1, policy_version 1802814 (0.0010) [2023-12-28 08:11:22,279][106226] Updated weights for policy 0, policy_version 1798699 (0.0010) [2023-12-28 08:11:22,334][106226] Updated weights for policy 0, policy_version 1798709 (0.0011) [2023-12-28 08:11:22,400][106226] Updated weights for policy 0, policy_version 1798719 (0.0014) [2023-12-28 08:11:22,784][106225] Updated weights for policy 1, policy_version 1802824 (0.0009) [2023-12-28 08:11:22,839][106225] Updated weights for policy 1, policy_version 1802834 (0.0008) [2023-12-28 08:11:22,892][106225] Updated weights for policy 1, policy_version 1802844 (0.0008) [2023-12-28 08:11:23,063][106226] Updated weights for policy 0, policy_version 1798729 (0.0008) [2023-12-28 08:11:23,127][106226] Updated weights for policy 0, policy_version 1798739 (0.0010) [2023-12-28 08:11:23,187][106226] Updated weights for policy 0, policy_version 1798749 (0.0011) [2023-12-28 08:11:23,240][106226] Updated weights for policy 0, policy_version 1798759 (0.0010) [2023-12-28 08:11:23,555][106225] Updated weights for policy 1, policy_version 1802854 (0.0007) [2023-12-28 08:11:23,611][106225] Updated weights for policy 1, policy_version 1802864 (0.0005) [2023-12-28 08:11:23,667][106225] Updated weights for policy 1, policy_version 1802874 (0.0010) [2023-12-28 08:11:23,959][106226] Updated weights for policy 0, policy_version 1798769 (0.0011) [2023-12-28 08:11:24,016][106226] Updated weights for policy 0, policy_version 1798779 (0.0010) [2023-12-28 08:11:24,073][106226] Updated weights for policy 0, policy_version 1798789 (0.0010) [2023-12-28 08:11:24,274][106225] Updated weights for policy 1, policy_version 1802884 (0.0008) [2023-12-28 08:11:24,340][106225] Updated weights for policy 1, policy_version 1802894 (0.0010) [2023-12-28 08:11:24,402][106225] Updated weights for policy 1, policy_version 1802904 (0.0007) [2023-12-28 08:11:24,762][106226] Updated weights for policy 0, policy_version 1798799 (0.0010) [2023-12-28 08:11:24,809][106226] Updated weights for policy 0, policy_version 1798809 (0.0010) [2023-12-28 08:11:24,855][106226] Updated weights for policy 0, policy_version 1798819 (0.0010) [2023-12-28 08:11:24,955][106225] Updated weights for policy 1, policy_version 1802914 (0.0005) [2023-12-28 08:11:25,015][106225] Updated weights for policy 1, policy_version 1802924 (0.0006) [2023-12-28 08:11:25,072][106225] Updated weights for policy 1, policy_version 1802934 (0.0005) [2023-12-28 08:11:25,130][106225] Updated weights for policy 1, policy_version 1802944 (0.0005) [2023-12-28 08:11:25,522][106226] Updated weights for policy 0, policy_version 1798829 (0.0010) [2023-12-28 08:11:25,583][106226] Updated weights for policy 0, policy_version 1798839 (0.0011) [2023-12-28 08:11:25,640][106225] Updated weights for policy 1, policy_version 1802954 (0.0005) [2023-12-28 08:11:25,647][106226] Updated weights for policy 0, policy_version 1798849 (0.0011) [2023-12-28 08:11:25,687][106225] Updated weights for policy 1, policy_version 1802964 (0.0007) [2023-12-28 08:11:25,734][106225] Updated weights for policy 1, policy_version 1802974 (0.0010) [2023-12-28 08:11:26,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 922206208. Throughput: 0: 9970.1, 1: 9881.0. Samples: 922172648. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:26,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.592')] [2023-12-28 08:11:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001802976_461619200.pth... [2023-12-28 08:11:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001798856_460587008.pth... [2023-12-28 08:11:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001797704_460292096.pth [2023-12-28 08:11:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001801824_461324288.pth [2023-12-28 08:11:26,333][106225] Updated weights for policy 1, policy_version 1802984 (0.0010) [2023-12-28 08:11:26,345][106226] Updated weights for policy 0, policy_version 1798859 (0.0010) [2023-12-28 08:11:26,380][106225] Updated weights for policy 1, policy_version 1802994 (0.0010) [2023-12-28 08:11:26,403][106226] Updated weights for policy 0, policy_version 1798869 (0.0010) [2023-12-28 08:11:26,437][106225] Updated weights for policy 1, policy_version 1803004 (0.0010) [2023-12-28 08:11:26,459][106226] Updated weights for policy 0, policy_version 1798879 (0.0010) [2023-12-28 08:11:27,028][106226] Updated weights for policy 0, policy_version 1798889 (0.0010) [2023-12-28 08:11:27,085][106226] Updated weights for policy 0, policy_version 1798899 (0.0008) [2023-12-28 08:11:27,132][106225] Updated weights for policy 1, policy_version 1803014 (0.0010) [2023-12-28 08:11:27,149][106226] Updated weights for policy 0, policy_version 1798909 (0.0010) [2023-12-28 08:11:27,182][106225] Updated weights for policy 1, policy_version 1803024 (0.0010) [2023-12-28 08:11:27,213][106226] Updated weights for policy 0, policy_version 1798919 (0.0009) [2023-12-28 08:11:27,236][106225] Updated weights for policy 1, policy_version 1803034 (0.0008) [2023-12-28 08:11:27,869][106226] Updated weights for policy 0, policy_version 1798929 (0.0010) [2023-12-28 08:11:27,900][106225] Updated weights for policy 1, policy_version 1803044 (0.0005) [2023-12-28 08:11:27,929][106226] Updated weights for policy 0, policy_version 1798939 (0.0010) [2023-12-28 08:11:27,953][106225] Updated weights for policy 1, policy_version 1803054 (0.0005) [2023-12-28 08:11:27,992][106226] Updated weights for policy 0, policy_version 1798949 (0.0010) [2023-12-28 08:11:28,010][106225] Updated weights for policy 1, policy_version 1803064 (0.0006) [2023-12-28 08:11:28,667][106226] Updated weights for policy 0, policy_version 1798959 (0.0007) [2023-12-28 08:11:28,717][106225] Updated weights for policy 1, policy_version 1803074 (0.0007) [2023-12-28 08:11:28,726][106226] Updated weights for policy 0, policy_version 1798969 (0.0009) [2023-12-28 08:11:28,774][106225] Updated weights for policy 1, policy_version 1803084 (0.0005) [2023-12-28 08:11:28,785][106226] Updated weights for policy 0, policy_version 1798979 (0.0011) [2023-12-28 08:11:28,831][106225] Updated weights for policy 1, policy_version 1803094 (0.0006) [2023-12-28 08:11:28,881][106225] Updated weights for policy 1, policy_version 1803104 (0.0008) [2023-12-28 08:11:29,500][106226] Updated weights for policy 0, policy_version 1798989 (0.0009) [2023-12-28 08:11:29,564][106226] Updated weights for policy 0, policy_version 1798999 (0.0009) [2023-12-28 08:11:29,606][106225] Updated weights for policy 1, policy_version 1803114 (0.0006) [2023-12-28 08:11:29,627][106226] Updated weights for policy 0, policy_version 1799009 (0.0007) [2023-12-28 08:11:29,662][106225] Updated weights for policy 1, policy_version 1803124 (0.0008) [2023-12-28 08:11:29,716][106225] Updated weights for policy 1, policy_version 1803134 (0.0007) [2023-12-28 08:11:30,349][106226] Updated weights for policy 0, policy_version 1799019 (0.0008) [2023-12-28 08:11:30,403][106225] Updated weights for policy 1, policy_version 1803144 (0.0009) [2023-12-28 08:11:30,410][106226] Updated weights for policy 0, policy_version 1799029 (0.0006) [2023-12-28 08:11:30,454][106225] Updated weights for policy 1, policy_version 1803154 (0.0007) [2023-12-28 08:11:30,470][106226] Updated weights for policy 0, policy_version 1799039 (0.0007) [2023-12-28 08:11:30,498][106225] Updated weights for policy 1, policy_version 1803164 (0.0008) [2023-12-28 08:11:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 922304512. Throughput: 0: 10004.1, 1: 10012.8. Samples: 922298496. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:31,175][105115] Avg episode reward: [(0, '-4.502'), (1, '-4.893')] [2023-12-28 08:11:31,201][106226] Updated weights for policy 0, policy_version 1799049 (0.0007) [2023-12-28 08:11:31,236][106225] Updated weights for policy 1, policy_version 1803174 (0.0007) [2023-12-28 08:11:31,259][106226] Updated weights for policy 0, policy_version 1799059 (0.0007) [2023-12-28 08:11:31,295][106225] Updated weights for policy 1, policy_version 1803184 (0.0008) [2023-12-28 08:11:31,324][106226] Updated weights for policy 0, policy_version 1799069 (0.0008) [2023-12-28 08:11:31,351][106225] Updated weights for policy 1, policy_version 1803194 (0.0007) [2023-12-28 08:11:31,389][106226] Updated weights for policy 0, policy_version 1799079 (0.0009) [2023-12-28 08:11:32,075][106226] Updated weights for policy 0, policy_version 1799089 (0.0007) [2023-12-28 08:11:32,101][106225] Updated weights for policy 1, policy_version 1803204 (0.0008) [2023-12-28 08:11:32,132][106226] Updated weights for policy 0, policy_version 1799099 (0.0009) [2023-12-28 08:11:32,150][106225] Updated weights for policy 1, policy_version 1803214 (0.0009) [2023-12-28 08:11:32,183][106226] Updated weights for policy 0, policy_version 1799109 (0.0008) [2023-12-28 08:11:32,203][106225] Updated weights for policy 1, policy_version 1803224 (0.0006) [2023-12-28 08:11:32,860][106226] Updated weights for policy 0, policy_version 1799119 (0.0008) [2023-12-28 08:11:32,913][106226] Updated weights for policy 0, policy_version 1799129 (0.0007) [2023-12-28 08:11:32,937][106225] Updated weights for policy 1, policy_version 1803234 (0.0008) [2023-12-28 08:11:32,972][106226] Updated weights for policy 0, policy_version 1799139 (0.0009) [2023-12-28 08:11:32,989][106225] Updated weights for policy 1, policy_version 1803244 (0.0007) [2023-12-28 08:11:33,047][106225] Updated weights for policy 1, policy_version 1803254 (0.0009) [2023-12-28 08:11:33,107][106225] Updated weights for policy 1, policy_version 1803264 (0.0008) [2023-12-28 08:11:33,587][106226] Updated weights for policy 0, policy_version 1799149 (0.0008) [2023-12-28 08:11:33,641][106226] Updated weights for policy 0, policy_version 1799159 (0.0010) [2023-12-28 08:11:33,699][106226] Updated weights for policy 0, policy_version 1799169 (0.0006) [2023-12-28 08:11:33,762][106225] Updated weights for policy 1, policy_version 1803274 (0.0005) [2023-12-28 08:11:33,810][106225] Updated weights for policy 1, policy_version 1803284 (0.0005) [2023-12-28 08:11:33,855][106225] Updated weights for policy 1, policy_version 1803294 (0.0005) [2023-12-28 08:11:34,255][106226] Updated weights for policy 0, policy_version 1799179 (0.0006) [2023-12-28 08:11:34,319][106226] Updated weights for policy 0, policy_version 1799189 (0.0011) [2023-12-28 08:11:34,386][106226] Updated weights for policy 0, policy_version 1799199 (0.0009) [2023-12-28 08:11:34,549][106225] Updated weights for policy 1, policy_version 1803304 (0.0008) [2023-12-28 08:11:34,614][106225] Updated weights for policy 1, policy_version 1803314 (0.0009) [2023-12-28 08:11:34,682][106225] Updated weights for policy 1, policy_version 1803324 (0.0008) [2023-12-28 08:11:35,050][106226] Updated weights for policy 0, policy_version 1799209 (0.0006) [2023-12-28 08:11:35,111][106226] Updated weights for policy 0, policy_version 1799219 (0.0006) [2023-12-28 08:11:35,177][106226] Updated weights for policy 0, policy_version 1799229 (0.0005) [2023-12-28 08:11:35,237][106226] Updated weights for policy 0, policy_version 1799239 (0.0006) [2023-12-28 08:11:35,353][106225] Updated weights for policy 1, policy_version 1803334 (0.0006) [2023-12-28 08:11:35,403][106225] Updated weights for policy 1, policy_version 1803344 (0.0005) [2023-12-28 08:11:35,458][106225] Updated weights for policy 1, policy_version 1803354 (0.0007) [2023-12-28 08:11:35,874][106226] Updated weights for policy 0, policy_version 1799249 (0.0009) [2023-12-28 08:11:35,931][106226] Updated weights for policy 0, policy_version 1799259 (0.0008) [2023-12-28 08:11:35,990][106226] Updated weights for policy 0, policy_version 1799269 (0.0005) [2023-12-28 08:11:36,006][106225] Updated weights for policy 1, policy_version 1803364 (0.0007) [2023-12-28 08:11:36,059][106225] Updated weights for policy 1, policy_version 1803374 (0.0005) [2023-12-28 08:11:36,114][106225] Updated weights for policy 1, policy_version 1803384 (0.0007) [2023-12-28 08:11:36,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20207.0, 300 sec: 19855.2). Total num frames: 922419200. Throughput: 0: 10051.0, 1: 9990.7. Samples: 922421924. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:36,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.948')] [2023-12-28 08:11:36,695][106226] Updated weights for policy 0, policy_version 1799279 (0.0008) [2023-12-28 08:11:36,760][106226] Updated weights for policy 0, policy_version 1799289 (0.0009) [2023-12-28 08:11:36,820][106225] Updated weights for policy 1, policy_version 1803394 (0.0008) [2023-12-28 08:11:36,822][106226] Updated weights for policy 0, policy_version 1799299 (0.0011) [2023-12-28 08:11:36,880][106225] Updated weights for policy 1, policy_version 1803404 (0.0007) [2023-12-28 08:11:36,947][106225] Updated weights for policy 1, policy_version 1803414 (0.0007) [2023-12-28 08:11:37,009][106225] Updated weights for policy 1, policy_version 1803424 (0.0008) [2023-12-28 08:11:37,448][106226] Updated weights for policy 0, policy_version 1799309 (0.0008) [2023-12-28 08:11:37,505][106226] Updated weights for policy 0, policy_version 1799319 (0.0006) [2023-12-28 08:11:37,560][106226] Updated weights for policy 0, policy_version 1799329 (0.0010) [2023-12-28 08:11:37,585][106225] Updated weights for policy 1, policy_version 1803434 (0.0005) [2023-12-28 08:11:37,638][106225] Updated weights for policy 1, policy_version 1803444 (0.0008) [2023-12-28 08:11:37,704][106225] Updated weights for policy 1, policy_version 1803454 (0.0008) [2023-12-28 08:11:38,194][106226] Updated weights for policy 0, policy_version 1799339 (0.0010) [2023-12-28 08:11:38,254][106226] Updated weights for policy 0, policy_version 1799349 (0.0008) [2023-12-28 08:11:38,303][106226] Updated weights for policy 0, policy_version 1799359 (0.0008) [2023-12-28 08:11:38,358][106225] Updated weights for policy 1, policy_version 1803464 (0.0008) [2023-12-28 08:11:38,418][106225] Updated weights for policy 1, policy_version 1803474 (0.0009) [2023-12-28 08:11:38,474][106225] Updated weights for policy 1, policy_version 1803484 (0.0008) [2023-12-28 08:11:39,060][106226] Updated weights for policy 0, policy_version 1799369 (0.0007) [2023-12-28 08:11:39,121][106226] Updated weights for policy 0, policy_version 1799379 (0.0008) [2023-12-28 08:11:39,189][106226] Updated weights for policy 0, policy_version 1799389 (0.0006) [2023-12-28 08:11:39,190][106225] Updated weights for policy 1, policy_version 1803494 (0.0009) [2023-12-28 08:11:39,252][106226] Updated weights for policy 0, policy_version 1799399 (0.0008) [2023-12-28 08:11:39,256][106225] Updated weights for policy 1, policy_version 1803504 (0.0009) [2023-12-28 08:11:39,327][106225] Updated weights for policy 1, policy_version 1803514 (0.0008) [2023-12-28 08:11:39,966][106226] Updated weights for policy 0, policy_version 1799409 (0.0008) [2023-12-28 08:11:40,035][106226] Updated weights for policy 0, policy_version 1799419 (0.0009) [2023-12-28 08:11:40,104][106226] Updated weights for policy 0, policy_version 1799429 (0.0009) [2023-12-28 08:11:40,137][106225] Updated weights for policy 1, policy_version 1803524 (0.0009) [2023-12-28 08:11:40,197][106225] Updated weights for policy 1, policy_version 1803534 (0.0008) [2023-12-28 08:11:40,261][106225] Updated weights for policy 1, policy_version 1803545 (0.0008) [2023-12-28 08:11:40,778][106226] Updated weights for policy 0, policy_version 1799439 (0.0009) [2023-12-28 08:11:40,840][106226] Updated weights for policy 0, policy_version 1799449 (0.0007) [2023-12-28 08:11:40,894][106226] Updated weights for policy 0, policy_version 1799459 (0.0005) [2023-12-28 08:11:40,978][106225] Updated weights for policy 1, policy_version 1803555 (0.0008) [2023-12-28 08:11:41,054][106225] Updated weights for policy 1, policy_version 1803565 (0.0007) [2023-12-28 08:11:41,124][106225] Updated weights for policy 1, policy_version 1803575 (0.0006) [2023-12-28 08:11:41,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 922509312. Throughput: 0: 10014.8, 1: 10066.9. Samples: 922483780. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:41,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-5.041')] [2023-12-28 08:11:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001799464_460742656.pth... [2023-12-28 08:11:41,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001803584_461774848.pth... [2023-12-28 08:11:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001798280_460439552.pth [2023-12-28 08:11:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001802368_461463552.pth [2023-12-28 08:11:41,682][106226] Updated weights for policy 0, policy_version 1799469 (0.0009) [2023-12-28 08:11:41,753][106226] Updated weights for policy 0, policy_version 1799479 (0.0009) [2023-12-28 08:11:41,820][106226] Updated weights for policy 0, policy_version 1799489 (0.0007) [2023-12-28 08:11:41,867][106225] Updated weights for policy 1, policy_version 1803585 (0.0008) [2023-12-28 08:11:41,916][106225] Updated weights for policy 1, policy_version 1803595 (0.0009) [2023-12-28 08:11:41,969][106225] Updated weights for policy 1, policy_version 1803605 (0.0009) [2023-12-28 08:11:42,024][106225] Updated weights for policy 1, policy_version 1803615 (0.0008) [2023-12-28 08:11:42,546][106226] Updated weights for policy 0, policy_version 1799499 (0.0007) [2023-12-28 08:11:42,598][106226] Updated weights for policy 0, policy_version 1799509 (0.0007) [2023-12-28 08:11:42,648][106226] Updated weights for policy 0, policy_version 1799519 (0.0007) [2023-12-28 08:11:42,780][106225] Updated weights for policy 1, policy_version 1803625 (0.0007) [2023-12-28 08:11:42,840][106225] Updated weights for policy 1, policy_version 1803635 (0.0005) [2023-12-28 08:11:42,905][106225] Updated weights for policy 1, policy_version 1803645 (0.0006) [2023-12-28 08:11:43,392][106226] Updated weights for policy 0, policy_version 1799529 (0.0008) [2023-12-28 08:11:43,455][106226] Updated weights for policy 0, policy_version 1799539 (0.0009) [2023-12-28 08:11:43,517][106226] Updated weights for policy 0, policy_version 1799549 (0.0008) [2023-12-28 08:11:43,551][106225] Updated weights for policy 1, policy_version 1803655 (0.0007) [2023-12-28 08:11:43,579][106226] Updated weights for policy 0, policy_version 1799559 (0.0008) [2023-12-28 08:11:43,603][106225] Updated weights for policy 1, policy_version 1803665 (0.0005) [2023-12-28 08:11:43,651][106225] Updated weights for policy 1, policy_version 1803675 (0.0005) [2023-12-28 08:11:44,227][106225] Updated weights for policy 1, policy_version 1803685 (0.0006) [2023-12-28 08:11:44,279][106225] Updated weights for policy 1, policy_version 1803695 (0.0005) [2023-12-28 08:11:44,315][106226] Updated weights for policy 0, policy_version 1799569 (0.0008) [2023-12-28 08:11:44,328][106225] Updated weights for policy 1, policy_version 1803705 (0.0007) [2023-12-28 08:11:44,366][106226] Updated weights for policy 0, policy_version 1799579 (0.0007) [2023-12-28 08:11:44,414][106226] Updated weights for policy 0, policy_version 1799589 (0.0009) [2023-12-28 08:11:44,940][106225] Updated weights for policy 1, policy_version 1803715 (0.0006) [2023-12-28 08:11:44,994][106225] Updated weights for policy 1, policy_version 1803725 (0.0008) [2023-12-28 08:11:45,048][106225] Updated weights for policy 1, policy_version 1803735 (0.0008) [2023-12-28 08:11:45,166][106226] Updated weights for policy 0, policy_version 1799599 (0.0009) [2023-12-28 08:11:45,232][106226] Updated weights for policy 0, policy_version 1799609 (0.0009) [2023-12-28 08:11:45,294][106226] Updated weights for policy 0, policy_version 1799619 (0.0008) [2023-12-28 08:11:45,794][106225] Updated weights for policy 1, policy_version 1803745 (0.0010) [2023-12-28 08:11:45,842][106225] Updated weights for policy 1, policy_version 1803755 (0.0006) [2023-12-28 08:11:45,874][106226] Updated weights for policy 0, policy_version 1799629 (0.0006) [2023-12-28 08:11:45,902][106225] Updated weights for policy 1, policy_version 1803765 (0.0007) [2023-12-28 08:11:45,927][106226] Updated weights for policy 0, policy_version 1799639 (0.0006) [2023-12-28 08:11:45,956][106225] Updated weights for policy 1, policy_version 1803775 (0.0008) [2023-12-28 08:11:45,980][106226] Updated weights for policy 0, policy_version 1799649 (0.0005) [2023-12-28 08:11:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20206.9, 300 sec: 19855.2). Total num frames: 922615808. Throughput: 0: 9960.8, 1: 10046.8. Samples: 922600312. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:46,175][105115] Avg episode reward: [(0, '-4.092'), (1, '-4.826')] [2023-12-28 08:11:46,513][106226] Updated weights for policy 0, policy_version 1799659 (0.0005) [2023-12-28 08:11:46,570][106226] Updated weights for policy 0, policy_version 1799669 (0.0007) [2023-12-28 08:11:46,625][106226] Updated weights for policy 0, policy_version 1799679 (0.0006) [2023-12-28 08:11:46,688][106225] Updated weights for policy 1, policy_version 1803785 (0.0007) [2023-12-28 08:11:46,738][106225] Updated weights for policy 1, policy_version 1803795 (0.0008) [2023-12-28 08:11:46,790][106225] Updated weights for policy 1, policy_version 1803805 (0.0009) [2023-12-28 08:11:47,226][106226] Updated weights for policy 0, policy_version 1799689 (0.0008) [2023-12-28 08:11:47,286][106226] Updated weights for policy 0, policy_version 1799699 (0.0007) [2023-12-28 08:11:47,339][106226] Updated weights for policy 0, policy_version 1799709 (0.0010) [2023-12-28 08:11:47,388][106226] Updated weights for policy 0, policy_version 1799719 (0.0010) [2023-12-28 08:11:47,575][106225] Updated weights for policy 1, policy_version 1803815 (0.0008) [2023-12-28 08:11:47,632][106225] Updated weights for policy 1, policy_version 1803825 (0.0008) [2023-12-28 08:11:47,702][106225] Updated weights for policy 1, policy_version 1803835 (0.0009) [2023-12-28 08:11:48,022][106226] Updated weights for policy 0, policy_version 1799729 (0.0009) [2023-12-28 08:11:48,072][106226] Updated weights for policy 0, policy_version 1799739 (0.0008) [2023-12-28 08:11:48,120][106226] Updated weights for policy 0, policy_version 1799749 (0.0009) [2023-12-28 08:11:48,452][106225] Updated weights for policy 1, policy_version 1803845 (0.0009) [2023-12-28 08:11:48,501][106225] Updated weights for policy 1, policy_version 1803855 (0.0008) [2023-12-28 08:11:48,553][106225] Updated weights for policy 1, policy_version 1803865 (0.0008) [2023-12-28 08:11:48,842][106226] Updated weights for policy 0, policy_version 1799759 (0.0009) [2023-12-28 08:11:48,904][106226] Updated weights for policy 0, policy_version 1799769 (0.0008) [2023-12-28 08:11:48,967][106226] Updated weights for policy 0, policy_version 1799779 (0.0008) [2023-12-28 08:11:49,229][106225] Updated weights for policy 1, policy_version 1803875 (0.0008) [2023-12-28 08:11:49,298][106225] Updated weights for policy 1, policy_version 1803885 (0.0010) [2023-12-28 08:11:49,365][106225] Updated weights for policy 1, policy_version 1803895 (0.0008) [2023-12-28 08:11:49,661][106226] Updated weights for policy 0, policy_version 1799789 (0.0009) [2023-12-28 08:11:49,719][106226] Updated weights for policy 0, policy_version 1799799 (0.0006) [2023-12-28 08:11:49,769][106226] Updated weights for policy 0, policy_version 1799809 (0.0005) [2023-12-28 08:11:50,110][106225] Updated weights for policy 1, policy_version 1803905 (0.0008) [2023-12-28 08:11:50,165][106225] Updated weights for policy 1, policy_version 1803915 (0.0005) [2023-12-28 08:11:50,224][106225] Updated weights for policy 1, policy_version 1803925 (0.0006) [2023-12-28 08:11:50,278][106225] Updated weights for policy 1, policy_version 1803935 (0.0009) [2023-12-28 08:11:50,423][106226] Updated weights for policy 0, policy_version 1799819 (0.0007) [2023-12-28 08:11:50,479][106226] Updated weights for policy 0, policy_version 1799829 (0.0009) [2023-12-28 08:11:50,537][106226] Updated weights for policy 0, policy_version 1799839 (0.0009) [2023-12-28 08:11:51,012][106225] Updated weights for policy 1, policy_version 1803945 (0.0009) [2023-12-28 08:11:51,076][106225] Updated weights for policy 1, policy_version 1803955 (0.0008) [2023-12-28 08:11:51,133][106225] Updated weights for policy 1, policy_version 1803965 (0.0007) [2023-12-28 08:11:51,174][105115] Fps is (10 sec: 20480.3, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 922714112. Throughput: 0: 10025.0, 1: 10078.7. Samples: 922721684. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:51,175][105115] Avg episode reward: [(0, '-4.612'), (1, '-4.764')] [2023-12-28 08:11:51,268][106226] Updated weights for policy 0, policy_version 1799849 (0.0008) [2023-12-28 08:11:51,327][106226] Updated weights for policy 0, policy_version 1799859 (0.0006) [2023-12-28 08:11:51,394][106226] Updated weights for policy 0, policy_version 1799869 (0.0010) [2023-12-28 08:11:51,454][106226] Updated weights for policy 0, policy_version 1799879 (0.0009) [2023-12-28 08:11:51,928][106225] Updated weights for policy 1, policy_version 1803975 (0.0010) [2023-12-28 08:11:51,978][106225] Updated weights for policy 1, policy_version 1803985 (0.0009) [2023-12-28 08:11:52,035][106225] Updated weights for policy 1, policy_version 1803995 (0.0009) [2023-12-28 08:11:52,166][106226] Updated weights for policy 0, policy_version 1799889 (0.0008) [2023-12-28 08:11:52,234][106226] Updated weights for policy 0, policy_version 1799899 (0.0008) [2023-12-28 08:11:52,306][106226] Updated weights for policy 0, policy_version 1799909 (0.0007) [2023-12-28 08:11:52,775][106225] Updated weights for policy 1, policy_version 1804005 (0.0007) [2023-12-28 08:11:52,842][106225] Updated weights for policy 1, policy_version 1804015 (0.0005) [2023-12-28 08:11:52,904][106225] Updated weights for policy 1, policy_version 1804025 (0.0009) [2023-12-28 08:11:53,070][106226] Updated weights for policy 0, policy_version 1799919 (0.0008) [2023-12-28 08:11:53,135][106226] Updated weights for policy 0, policy_version 1799929 (0.0007) [2023-12-28 08:11:53,193][106226] Updated weights for policy 0, policy_version 1799939 (0.0005) [2023-12-28 08:11:53,608][106225] Updated weights for policy 1, policy_version 1804035 (0.0009) [2023-12-28 08:11:53,663][106225] Updated weights for policy 1, policy_version 1804045 (0.0008) [2023-12-28 08:11:53,709][106225] Updated weights for policy 1, policy_version 1804055 (0.0008) [2023-12-28 08:11:53,813][106226] Updated weights for policy 0, policy_version 1799949 (0.0007) [2023-12-28 08:11:53,861][106226] Updated weights for policy 0, policy_version 1799959 (0.0005) [2023-12-28 08:11:53,919][106226] Updated weights for policy 0, policy_version 1799969 (0.0005) [2023-12-28 08:11:54,515][106225] Updated weights for policy 1, policy_version 1804065 (0.0009) [2023-12-28 08:11:54,525][106226] Updated weights for policy 0, policy_version 1799979 (0.0005) [2023-12-28 08:11:54,578][106225] Updated weights for policy 1, policy_version 1804075 (0.0006) [2023-12-28 08:11:54,584][106226] Updated weights for policy 0, policy_version 1799989 (0.0008) [2023-12-28 08:11:54,636][106225] Updated weights for policy 1, policy_version 1804085 (0.0006) [2023-12-28 08:11:54,642][106226] Updated weights for policy 0, policy_version 1799999 (0.0006) [2023-12-28 08:11:54,694][106225] Updated weights for policy 1, policy_version 1804095 (0.0007) [2023-12-28 08:11:55,280][106226] Updated weights for policy 0, policy_version 1800009 (0.0006) [2023-12-28 08:11:55,340][106226] Updated weights for policy 0, policy_version 1800019 (0.0008) [2023-12-28 08:11:55,388][106226] Updated weights for policy 0, policy_version 1800029 (0.0008) [2023-12-28 08:11:55,439][106226] Updated weights for policy 0, policy_version 1800039 (0.0006) [2023-12-28 08:11:55,448][106225] Updated weights for policy 1, policy_version 1804105 (0.0009) [2023-12-28 08:11:55,509][106225] Updated weights for policy 1, policy_version 1804115 (0.0007) [2023-12-28 08:11:55,565][106225] Updated weights for policy 1, policy_version 1804125 (0.0005) [2023-12-28 08:11:56,124][106226] Updated weights for policy 0, policy_version 1800049 (0.0007) [2023-12-28 08:11:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 922804224. Throughput: 0: 10041.2, 1: 10071.4. Samples: 922779380. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:11:56,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.877')] [2023-12-28 08:11:56,186][106226] Updated weights for policy 0, policy_version 1800059 (0.0005) [2023-12-28 08:11:56,207][106225] Updated weights for policy 1, policy_version 1804135 (0.0007) [2023-12-28 08:11:56,232][106226] Updated weights for policy 0, policy_version 1800069 (0.0005) [2023-12-28 08:11:56,245][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001800072_460898304.pth... [2023-12-28 08:11:56,249][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001798856_460587008.pth [2023-12-28 08:11:56,256][106225] Updated weights for policy 1, policy_version 1804145 (0.0007) [2023-12-28 08:11:56,307][106225] Updated weights for policy 1, policy_version 1804155 (0.0007) [2023-12-28 08:11:56,328][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001804160_461922304.pth... [2023-12-28 08:11:56,331][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001802976_461619200.pth [2023-12-28 08:11:56,850][106226] Updated weights for policy 0, policy_version 1800079 (0.0005) [2023-12-28 08:11:56,911][106226] Updated weights for policy 0, policy_version 1800089 (0.0005) [2023-12-28 08:11:56,971][106226] Updated weights for policy 0, policy_version 1800099 (0.0006) [2023-12-28 08:11:57,112][106225] Updated weights for policy 1, policy_version 1804165 (0.0008) [2023-12-28 08:11:57,166][106225] Updated weights for policy 1, policy_version 1804175 (0.0008) [2023-12-28 08:11:57,223][106225] Updated weights for policy 1, policy_version 1804185 (0.0008) [2023-12-28 08:11:57,570][106226] Updated weights for policy 0, policy_version 1800109 (0.0009) [2023-12-28 08:11:57,616][106226] Updated weights for policy 0, policy_version 1800119 (0.0010) [2023-12-28 08:11:57,663][106226] Updated weights for policy 0, policy_version 1800129 (0.0009) [2023-12-28 08:11:57,938][106225] Updated weights for policy 1, policy_version 1804195 (0.0008) [2023-12-28 08:11:58,005][106225] Updated weights for policy 1, policy_version 1804205 (0.0008) [2023-12-28 08:11:58,065][106225] Updated weights for policy 1, policy_version 1804215 (0.0008) [2023-12-28 08:11:58,281][106226] Updated weights for policy 0, policy_version 1800139 (0.0006) [2023-12-28 08:11:58,343][106226] Updated weights for policy 0, policy_version 1800149 (0.0008) [2023-12-28 08:11:58,409][106226] Updated weights for policy 0, policy_version 1800159 (0.0008) [2023-12-28 08:11:58,881][106225] Updated weights for policy 1, policy_version 1804225 (0.0007) [2023-12-28 08:11:58,961][106225] Updated weights for policy 1, policy_version 1804235 (0.0008) [2023-12-28 08:11:59,028][106225] Updated weights for policy 1, policy_version 1804245 (0.0008) [2023-12-28 08:11:59,090][106225] Updated weights for policy 1, policy_version 1804255 (0.0010) [2023-12-28 08:11:59,182][106226] Updated weights for policy 0, policy_version 1800169 (0.0009) [2023-12-28 08:11:59,257][106226] Updated weights for policy 0, policy_version 1800179 (0.0008) [2023-12-28 08:11:59,331][106226] Updated weights for policy 0, policy_version 1800189 (0.0008) [2023-12-28 08:11:59,405][106226] Updated weights for policy 0, policy_version 1800199 (0.0007) [2023-12-28 08:11:59,862][106225] Updated weights for policy 1, policy_version 1804265 (0.0008) [2023-12-28 08:11:59,926][106225] Updated weights for policy 1, policy_version 1804275 (0.0008) [2023-12-28 08:11:59,990][106225] Updated weights for policy 1, policy_version 1804285 (0.0007) [2023-12-28 08:12:00,138][106226] Updated weights for policy 0, policy_version 1800209 (0.0009) [2023-12-28 08:12:00,187][106226] Updated weights for policy 0, policy_version 1800219 (0.0009) [2023-12-28 08:12:00,235][106226] Updated weights for policy 0, policy_version 1800229 (0.0008) [2023-12-28 08:12:00,578][106225] Updated weights for policy 1, policy_version 1804295 (0.0008) [2023-12-28 08:12:00,624][106225] Updated weights for policy 1, policy_version 1804305 (0.0007) [2023-12-28 08:12:00,680][106225] Updated weights for policy 1, policy_version 1804315 (0.0008) [2023-12-28 08:12:00,991][106226] Updated weights for policy 0, policy_version 1800239 (0.0010) [2023-12-28 08:12:01,064][106226] Updated weights for policy 0, policy_version 1800249 (0.0011) [2023-12-28 08:12:01,129][106226] Updated weights for policy 0, policy_version 1800259 (0.0010) [2023-12-28 08:12:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 922910720. Throughput: 0: 10131.0, 1: 9965.2. Samples: 922897464. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:01,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.894')] [2023-12-28 08:12:01,457][106225] Updated weights for policy 1, policy_version 1804325 (0.0008) [2023-12-28 08:12:01,516][106225] Updated weights for policy 1, policy_version 1804335 (0.0008) [2023-12-28 08:12:01,572][106225] Updated weights for policy 1, policy_version 1804345 (0.0007) [2023-12-28 08:12:01,826][106226] Updated weights for policy 0, policy_version 1800269 (0.0011) [2023-12-28 08:12:01,883][106226] Updated weights for policy 0, policy_version 1800279 (0.0010) [2023-12-28 08:12:01,939][106226] Updated weights for policy 0, policy_version 1800289 (0.0009) [2023-12-28 08:12:02,272][106225] Updated weights for policy 1, policy_version 1804355 (0.0009) [2023-12-28 08:12:02,335][106225] Updated weights for policy 1, policy_version 1804365 (0.0006) [2023-12-28 08:12:02,405][106225] Updated weights for policy 1, policy_version 1804375 (0.0008) [2023-12-28 08:12:02,655][106226] Updated weights for policy 0, policy_version 1800299 (0.0008) [2023-12-28 08:12:02,713][106226] Updated weights for policy 0, policy_version 1800309 (0.0011) [2023-12-28 08:12:02,785][106226] Updated weights for policy 0, policy_version 1800319 (0.0010) [2023-12-28 08:12:02,967][106225] Updated weights for policy 1, policy_version 1804385 (0.0007) [2023-12-28 08:12:03,013][106225] Updated weights for policy 1, policy_version 1804395 (0.0006) [2023-12-28 08:12:03,068][106225] Updated weights for policy 1, policy_version 1804405 (0.0010) [2023-12-28 08:12:03,117][106225] Updated weights for policy 1, policy_version 1804415 (0.0010) [2023-12-28 08:12:03,481][106226] Updated weights for policy 0, policy_version 1800329 (0.0010) [2023-12-28 08:12:03,530][106226] Updated weights for policy 0, policy_version 1800339 (0.0010) [2023-12-28 08:12:03,576][106226] Updated weights for policy 0, policy_version 1800349 (0.0010) [2023-12-28 08:12:03,622][106226] Updated weights for policy 0, policy_version 1800359 (0.0010) [2023-12-28 08:12:03,841][106225] Updated weights for policy 1, policy_version 1804425 (0.0011) [2023-12-28 08:12:03,901][106225] Updated weights for policy 1, policy_version 1804435 (0.0011) [2023-12-28 08:12:03,956][106225] Updated weights for policy 1, policy_version 1804445 (0.0010) [2023-12-28 08:12:04,401][106226] Updated weights for policy 0, policy_version 1800369 (0.0010) [2023-12-28 08:12:04,462][106226] Updated weights for policy 0, policy_version 1800379 (0.0011) [2023-12-28 08:12:04,515][106226] Updated weights for policy 0, policy_version 1800389 (0.0010) [2023-12-28 08:12:04,564][106225] Updated weights for policy 1, policy_version 1804455 (0.0010) [2023-12-28 08:12:04,617][106225] Updated weights for policy 1, policy_version 1804465 (0.0010) [2023-12-28 08:12:04,670][106225] Updated weights for policy 1, policy_version 1804475 (0.0010) [2023-12-28 08:12:05,155][106226] Updated weights for policy 0, policy_version 1800399 (0.0010) [2023-12-28 08:12:05,204][106226] Updated weights for policy 0, policy_version 1800409 (0.0010) [2023-12-28 08:12:05,256][106226] Updated weights for policy 0, policy_version 1800419 (0.0010) [2023-12-28 08:12:05,397][106225] Updated weights for policy 1, policy_version 1804485 (0.0010) [2023-12-28 08:12:05,446][106225] Updated weights for policy 1, policy_version 1804495 (0.0010) [2023-12-28 08:12:05,502][106225] Updated weights for policy 1, policy_version 1804505 (0.0010) [2023-12-28 08:12:05,972][106226] Updated weights for policy 0, policy_version 1800429 (0.0010) [2023-12-28 08:12:06,035][106226] Updated weights for policy 0, policy_version 1800439 (0.0010) [2023-12-28 08:12:06,094][106226] Updated weights for policy 0, policy_version 1800449 (0.0010) [2023-12-28 08:12:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 923009024. Throughput: 0: 10101.4, 1: 9942.8. Samples: 923017380. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:06,175][105115] Avg episode reward: [(0, '-4.429'), (1, '-4.732')] [2023-12-28 08:12:06,250][106225] Updated weights for policy 1, policy_version 1804515 (0.0010) [2023-12-28 08:12:06,313][106225] Updated weights for policy 1, policy_version 1804525 (0.0010) [2023-12-28 08:12:06,380][106225] Updated weights for policy 1, policy_version 1804535 (0.0010) [2023-12-28 08:12:06,848][106226] Updated weights for policy 0, policy_version 1800459 (0.0011) [2023-12-28 08:12:06,897][106226] Updated weights for policy 0, policy_version 1800469 (0.0006) [2023-12-28 08:12:06,946][106226] Updated weights for policy 0, policy_version 1800479 (0.0005) [2023-12-28 08:12:07,086][106225] Updated weights for policy 1, policy_version 1804545 (0.0007) [2023-12-28 08:12:07,151][106225] Updated weights for policy 1, policy_version 1804555 (0.0010) [2023-12-28 08:12:07,215][106225] Updated weights for policy 1, policy_version 1804565 (0.0010) [2023-12-28 08:12:07,282][106225] Updated weights for policy 1, policy_version 1804575 (0.0011) [2023-12-28 08:12:07,675][106226] Updated weights for policy 0, policy_version 1800489 (0.0010) [2023-12-28 08:12:07,735][106226] Updated weights for policy 0, policy_version 1800499 (0.0011) [2023-12-28 08:12:07,792][106226] Updated weights for policy 0, policy_version 1800509 (0.0010) [2023-12-28 08:12:07,853][106226] Updated weights for policy 0, policy_version 1800519 (0.0011) [2023-12-28 08:12:07,974][106225] Updated weights for policy 1, policy_version 1804585 (0.0010) [2023-12-28 08:12:08,036][106225] Updated weights for policy 1, policy_version 1804595 (0.0006) [2023-12-28 08:12:08,091][106225] Updated weights for policy 1, policy_version 1804605 (0.0006) [2023-12-28 08:12:08,495][106226] Updated weights for policy 0, policy_version 1800529 (0.0008) [2023-12-28 08:12:08,552][106226] Updated weights for policy 0, policy_version 1800539 (0.0008) [2023-12-28 08:12:08,607][106226] Updated weights for policy 0, policy_version 1800549 (0.0008) [2023-12-28 08:12:08,787][106225] Updated weights for policy 1, policy_version 1804615 (0.0009) [2023-12-28 08:12:08,846][106225] Updated weights for policy 1, policy_version 1804625 (0.0010) [2023-12-28 08:12:08,904][106225] Updated weights for policy 1, policy_version 1804635 (0.0008) [2023-12-28 08:12:09,278][106226] Updated weights for policy 0, policy_version 1800559 (0.0008) [2023-12-28 08:12:09,338][106226] Updated weights for policy 0, policy_version 1800569 (0.0007) [2023-12-28 08:12:09,410][106226] Updated weights for policy 0, policy_version 1800579 (0.0009) [2023-12-28 08:12:09,667][106225] Updated weights for policy 1, policy_version 1804645 (0.0010) [2023-12-28 08:12:09,726][106225] Updated weights for policy 1, policy_version 1804655 (0.0011) [2023-12-28 08:12:09,792][106225] Updated weights for policy 1, policy_version 1804665 (0.0011) [2023-12-28 08:12:10,203][106226] Updated weights for policy 0, policy_version 1800589 (0.0009) [2023-12-28 08:12:10,263][106226] Updated weights for policy 0, policy_version 1800599 (0.0009) [2023-12-28 08:12:10,327][106226] Updated weights for policy 0, policy_version 1800609 (0.0009) [2023-12-28 08:12:10,484][106225] Updated weights for policy 1, policy_version 1804675 (0.0011) [2023-12-28 08:12:10,545][106225] Updated weights for policy 1, policy_version 1804685 (0.0010) [2023-12-28 08:12:10,602][106225] Updated weights for policy 1, policy_version 1804695 (0.0010) [2023-12-28 08:12:11,094][106226] Updated weights for policy 0, policy_version 1800619 (0.0008) [2023-12-28 08:12:11,168][106226] Updated weights for policy 0, policy_version 1800629 (0.0009) [2023-12-28 08:12:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 923099136. Throughput: 0: 10124.7, 1: 9961.9. Samples: 923076544. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:11,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-5.182')] [2023-12-28 08:12:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001804704_462061568.pth... [2023-12-28 08:12:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001803584_461774848.pth [2023-12-28 08:12:11,226][106226] Updated weights for policy 0, policy_version 1800639 (0.0009) [2023-12-28 08:12:11,288][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001800648_461045760.pth... [2023-12-28 08:12:11,293][106225] Updated weights for policy 1, policy_version 1804705 (0.0010) [2023-12-28 08:12:11,293][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001799464_460742656.pth [2023-12-28 08:12:11,354][106225] Updated weights for policy 1, policy_version 1804715 (0.0007) [2023-12-28 08:12:11,430][106225] Updated weights for policy 1, policy_version 1804725 (0.0008) [2023-12-28 08:12:11,493][106225] Updated weights for policy 1, policy_version 1804735 (0.0008) [2023-12-28 08:12:12,006][106226] Updated weights for policy 0, policy_version 1800649 (0.0008) [2023-12-28 08:12:12,061][106226] Updated weights for policy 0, policy_version 1800659 (0.0009) [2023-12-28 08:12:12,120][106226] Updated weights for policy 0, policy_version 1800669 (0.0010) [2023-12-28 08:12:12,181][106226] Updated weights for policy 0, policy_version 1800679 (0.0009) [2023-12-28 08:12:12,301][106225] Updated weights for policy 1, policy_version 1804745 (0.0009) [2023-12-28 08:12:12,364][106225] Updated weights for policy 1, policy_version 1804755 (0.0008) [2023-12-28 08:12:12,433][106225] Updated weights for policy 1, policy_version 1804765 (0.0009) [2023-12-28 08:12:12,942][106226] Updated weights for policy 0, policy_version 1800689 (0.0007) [2023-12-28 08:12:13,004][106226] Updated weights for policy 0, policy_version 1800699 (0.0007) [2023-12-28 08:12:13,063][106226] Updated weights for policy 0, policy_version 1800709 (0.0007) [2023-12-28 08:12:13,183][106225] Updated weights for policy 1, policy_version 1804775 (0.0007) [2023-12-28 08:12:13,247][106225] Updated weights for policy 1, policy_version 1804785 (0.0005) [2023-12-28 08:12:13,312][106225] Updated weights for policy 1, policy_version 1804795 (0.0006) [2023-12-28 08:12:13,635][106226] Updated weights for policy 0, policy_version 1800719 (0.0011) [2023-12-28 08:12:13,685][106226] Updated weights for policy 0, policy_version 1800729 (0.0010) [2023-12-28 08:12:13,741][106226] Updated weights for policy 0, policy_version 1800739 (0.0010) [2023-12-28 08:12:13,857][106225] Updated weights for policy 1, policy_version 1804805 (0.0005) [2023-12-28 08:12:13,918][106225] Updated weights for policy 1, policy_version 1804815 (0.0006) [2023-12-28 08:12:13,980][106225] Updated weights for policy 1, policy_version 1804825 (0.0009) [2023-12-28 08:12:14,361][106226] Updated weights for policy 0, policy_version 1800749 (0.0011) [2023-12-28 08:12:14,412][106226] Updated weights for policy 0, policy_version 1800759 (0.0010) [2023-12-28 08:12:14,476][106226] Updated weights for policy 0, policy_version 1800769 (0.0011) [2023-12-28 08:12:14,656][106225] Updated weights for policy 1, policy_version 1804835 (0.0010) [2023-12-28 08:12:14,714][106225] Updated weights for policy 1, policy_version 1804845 (0.0006) [2023-12-28 08:12:14,779][106225] Updated weights for policy 1, policy_version 1804855 (0.0007) [2023-12-28 08:12:15,220][106226] Updated weights for policy 0, policy_version 1800779 (0.0009) [2023-12-28 08:12:15,283][106226] Updated weights for policy 0, policy_version 1800789 (0.0008) [2023-12-28 08:12:15,345][106226] Updated weights for policy 0, policy_version 1800799 (0.0008) [2023-12-28 08:12:15,470][106225] Updated weights for policy 1, policy_version 1804865 (0.0010) [2023-12-28 08:12:15,533][106225] Updated weights for policy 1, policy_version 1804875 (0.0010) [2023-12-28 08:12:15,587][106225] Updated weights for policy 1, policy_version 1804885 (0.0010) [2023-12-28 08:12:15,651][106225] Updated weights for policy 1, policy_version 1804895 (0.0011) [2023-12-28 08:12:16,099][106226] Updated weights for policy 0, policy_version 1800809 (0.0009) [2023-12-28 08:12:16,157][106226] Updated weights for policy 0, policy_version 1800819 (0.0008) [2023-12-28 08:12:16,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 923197440. Throughput: 0: 10052.3, 1: 9828.7. Samples: 923193140. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:16,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-5.043')] [2023-12-28 08:12:16,214][106226] Updated weights for policy 0, policy_version 1800829 (0.0008) [2023-12-28 08:12:16,261][106226] Updated weights for policy 0, policy_version 1800839 (0.0007) [2023-12-28 08:12:16,357][106225] Updated weights for policy 1, policy_version 1804905 (0.0010) [2023-12-28 08:12:16,412][106225] Updated weights for policy 1, policy_version 1804915 (0.0010) [2023-12-28 08:12:16,467][106225] Updated weights for policy 1, policy_version 1804925 (0.0010) [2023-12-28 08:12:17,009][106226] Updated weights for policy 0, policy_version 1800849 (0.0007) [2023-12-28 08:12:17,075][106226] Updated weights for policy 0, policy_version 1800859 (0.0007) [2023-12-28 08:12:17,088][106225] Updated weights for policy 1, policy_version 1804935 (0.0010) [2023-12-28 08:12:17,135][106226] Updated weights for policy 0, policy_version 1800869 (0.0005) [2023-12-28 08:12:17,155][106225] Updated weights for policy 1, policy_version 1804945 (0.0011) [2023-12-28 08:12:17,205][106225] Updated weights for policy 1, policy_version 1804955 (0.0010) [2023-12-28 08:12:17,801][106226] Updated weights for policy 0, policy_version 1800879 (0.0007) [2023-12-28 08:12:17,822][106225] Updated weights for policy 1, policy_version 1804965 (0.0006) [2023-12-28 08:12:17,854][106226] Updated weights for policy 0, policy_version 1800889 (0.0008) [2023-12-28 08:12:17,871][106225] Updated weights for policy 1, policy_version 1804975 (0.0005) [2023-12-28 08:12:17,900][106226] Updated weights for policy 0, policy_version 1800899 (0.0008) [2023-12-28 08:12:17,925][106225] Updated weights for policy 1, policy_version 1804985 (0.0005) [2023-12-28 08:12:18,588][106225] Updated weights for policy 1, policy_version 1804995 (0.0005) [2023-12-28 08:12:18,649][106225] Updated weights for policy 1, policy_version 1805005 (0.0006) [2023-12-28 08:12:18,678][106226] Updated weights for policy 0, policy_version 1800909 (0.0007) [2023-12-28 08:12:18,704][106225] Updated weights for policy 1, policy_version 1805015 (0.0010) [2023-12-28 08:12:18,734][106226] Updated weights for policy 0, policy_version 1800919 (0.0006) [2023-12-28 08:12:18,793][106226] Updated weights for policy 0, policy_version 1800929 (0.0007) [2023-12-28 08:12:19,313][106225] Updated weights for policy 1, policy_version 1805025 (0.0010) [2023-12-28 08:12:19,381][106225] Updated weights for policy 1, policy_version 1805035 (0.0008) [2023-12-28 08:12:19,438][106225] Updated weights for policy 1, policy_version 1805045 (0.0005) [2023-12-28 08:12:19,501][106225] Updated weights for policy 1, policy_version 1805055 (0.0009) [2023-12-28 08:12:19,612][106226] Updated weights for policy 0, policy_version 1800939 (0.0008) [2023-12-28 08:12:19,674][106226] Updated weights for policy 0, policy_version 1800949 (0.0008) [2023-12-28 08:12:19,738][106226] Updated weights for policy 0, policy_version 1800959 (0.0008) [2023-12-28 08:12:20,220][106225] Updated weights for policy 1, policy_version 1805065 (0.0011) [2023-12-28 08:12:20,273][106225] Updated weights for policy 1, policy_version 1805075 (0.0011) [2023-12-28 08:12:20,331][106225] Updated weights for policy 1, policy_version 1805085 (0.0010) [2023-12-28 08:12:20,450][106226] Updated weights for policy 0, policy_version 1800969 (0.0008) [2023-12-28 08:12:20,508][106226] Updated weights for policy 0, policy_version 1800979 (0.0008) [2023-12-28 08:12:20,576][106226] Updated weights for policy 0, policy_version 1800989 (0.0008) [2023-12-28 08:12:20,642][106226] Updated weights for policy 0, policy_version 1800999 (0.0007) [2023-12-28 08:12:21,094][106225] Updated weights for policy 1, policy_version 1805095 (0.0009) [2023-12-28 08:12:21,164][106225] Updated weights for policy 1, policy_version 1805105 (0.0007) [2023-12-28 08:12:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 923295744. Throughput: 0: 9912.3, 1: 9850.8. Samples: 923311268. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:21,175][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.861')] [2023-12-28 08:12:21,225][106225] Updated weights for policy 1, policy_version 1805115 (0.0010) [2023-12-28 08:12:21,258][106226] Updated weights for policy 0, policy_version 1801009 (0.0006) [2023-12-28 08:12:21,324][106226] Updated weights for policy 0, policy_version 1801019 (0.0007) [2023-12-28 08:12:21,397][106226] Updated weights for policy 0, policy_version 1801029 (0.0008) [2023-12-28 08:12:22,024][106225] Updated weights for policy 1, policy_version 1805125 (0.0010) [2023-12-28 08:12:22,070][106226] Updated weights for policy 0, policy_version 1801039 (0.0006) [2023-12-28 08:12:22,080][106225] Updated weights for policy 1, policy_version 1805135 (0.0010) [2023-12-28 08:12:22,129][106226] Updated weights for policy 0, policy_version 1801049 (0.0006) [2023-12-28 08:12:22,141][106225] Updated weights for policy 1, policy_version 1805145 (0.0010) [2023-12-28 08:12:22,181][106226] Updated weights for policy 0, policy_version 1801059 (0.0008) [2023-12-28 08:12:22,884][106225] Updated weights for policy 1, policy_version 1805155 (0.0010) [2023-12-28 08:12:22,941][106225] Updated weights for policy 1, policy_version 1805165 (0.0007) [2023-12-28 08:12:22,955][106226] Updated weights for policy 0, policy_version 1801069 (0.0009) [2023-12-28 08:12:22,994][106225] Updated weights for policy 1, policy_version 1805175 (0.0007) [2023-12-28 08:12:23,018][106226] Updated weights for policy 0, policy_version 1801079 (0.0007) [2023-12-28 08:12:23,080][106226] Updated weights for policy 0, policy_version 1801089 (0.0009) [2023-12-28 08:12:23,724][106225] Updated weights for policy 1, policy_version 1805185 (0.0006) [2023-12-28 08:12:23,743][106226] Updated weights for policy 0, policy_version 1801099 (0.0008) [2023-12-28 08:12:23,794][106225] Updated weights for policy 1, policy_version 1805195 (0.0006) [2023-12-28 08:12:23,800][106226] Updated weights for policy 0, policy_version 1801109 (0.0005) [2023-12-28 08:12:23,852][106225] Updated weights for policy 1, policy_version 1805205 (0.0005) [2023-12-28 08:12:23,864][106226] Updated weights for policy 0, policy_version 1801119 (0.0008) [2023-12-28 08:12:23,912][106225] Updated weights for policy 1, policy_version 1805215 (0.0006) [2023-12-28 08:12:24,483][106225] Updated weights for policy 1, policy_version 1805225 (0.0005) [2023-12-28 08:12:24,533][106225] Updated weights for policy 1, policy_version 1805235 (0.0005) [2023-12-28 08:12:24,555][106226] Updated weights for policy 0, policy_version 1801129 (0.0008) [2023-12-28 08:12:24,592][106225] Updated weights for policy 1, policy_version 1805245 (0.0006) [2023-12-28 08:12:24,617][106226] Updated weights for policy 0, policy_version 1801139 (0.0008) [2023-12-28 08:12:24,667][106226] Updated weights for policy 0, policy_version 1801149 (0.0008) [2023-12-28 08:12:24,724][106226] Updated weights for policy 0, policy_version 1801159 (0.0009) [2023-12-28 08:12:25,110][106225] Updated weights for policy 1, policy_version 1805255 (0.0006) [2023-12-28 08:12:25,168][106225] Updated weights for policy 1, policy_version 1805265 (0.0009) [2023-12-28 08:12:25,224][106225] Updated weights for policy 1, policy_version 1805275 (0.0009) [2023-12-28 08:12:25,313][106226] Updated weights for policy 0, policy_version 1801169 (0.0009) [2023-12-28 08:12:25,367][106226] Updated weights for policy 0, policy_version 1801179 (0.0008) [2023-12-28 08:12:25,421][106226] Updated weights for policy 0, policy_version 1801189 (0.0008) [2023-12-28 08:12:25,990][106225] Updated weights for policy 1, policy_version 1805285 (0.0009) [2023-12-28 08:12:26,041][106225] Updated weights for policy 1, policy_version 1805295 (0.0008) [2023-12-28 08:12:26,052][106226] Updated weights for policy 0, policy_version 1801199 (0.0006) [2023-12-28 08:12:26,095][106225] Updated weights for policy 1, policy_version 1805305 (0.0008) [2023-12-28 08:12:26,105][106226] Updated weights for policy 0, policy_version 1801209 (0.0006) [2023-12-28 08:12:26,158][106226] Updated weights for policy 0, policy_version 1801219 (0.0007) [2023-12-28 08:12:26,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 923402240. Throughput: 0: 9891.0, 1: 9766.4. Samples: 923368364. Policy #0 lag: (min: 29.0, avg: 29.3, max: 41.0) [2023-12-28 08:12:26,176][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.671')] [2023-12-28 08:12:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001805312_462217216.pth... [2023-12-28 08:12:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001801224_461193216.pth... [2023-12-28 08:12:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001804160_461922304.pth [2023-12-28 08:12:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001800072_460898304.pth [2023-12-28 08:12:26,798][106226] Updated weights for policy 0, policy_version 1801229 (0.0008) [2023-12-28 08:12:26,842][106226] Updated weights for policy 0, policy_version 1801239 (0.0008) [2023-12-28 08:12:26,860][106225] Updated weights for policy 1, policy_version 1805315 (0.0007) [2023-12-28 08:12:26,897][106226] Updated weights for policy 0, policy_version 1801249 (0.0007) [2023-12-28 08:12:26,913][106225] Updated weights for policy 1, policy_version 1805325 (0.0006) [2023-12-28 08:12:26,971][106225] Updated weights for policy 1, policy_version 1805335 (0.0009) [2023-12-28 08:12:27,595][106226] Updated weights for policy 0, policy_version 1801259 (0.0009) [2023-12-28 08:12:27,642][106226] Updated weights for policy 0, policy_version 1801269 (0.0009) [2023-12-28 08:12:27,695][106226] Updated weights for policy 0, policy_version 1801279 (0.0008) [2023-12-28 08:12:27,697][106225] Updated weights for policy 1, policy_version 1805345 (0.0008) [2023-12-28 08:12:27,751][106225] Updated weights for policy 1, policy_version 1805355 (0.0009) [2023-12-28 08:12:27,806][106225] Updated weights for policy 1, policy_version 1805365 (0.0010) [2023-12-28 08:12:27,863][106225] Updated weights for policy 1, policy_version 1805375 (0.0008) [2023-12-28 08:12:28,401][106226] Updated weights for policy 0, policy_version 1801289 (0.0006) [2023-12-28 08:12:28,455][106226] Updated weights for policy 0, policy_version 1801299 (0.0008) [2023-12-28 08:12:28,517][106226] Updated weights for policy 0, policy_version 1801309 (0.0009) [2023-12-28 08:12:28,579][106226] Updated weights for policy 0, policy_version 1801319 (0.0008) [2023-12-28 08:12:28,583][106225] Updated weights for policy 1, policy_version 1805385 (0.0005) [2023-12-28 08:12:28,649][106225] Updated weights for policy 1, policy_version 1805395 (0.0008) [2023-12-28 08:12:28,712][106225] Updated weights for policy 1, policy_version 1805405 (0.0010) [2023-12-28 08:12:29,251][106226] Updated weights for policy 0, policy_version 1801329 (0.0009) [2023-12-28 08:12:29,323][106226] Updated weights for policy 0, policy_version 1801339 (0.0009) [2023-12-28 08:12:29,364][106225] Updated weights for policy 1, policy_version 1805415 (0.0009) [2023-12-28 08:12:29,387][106226] Updated weights for policy 0, policy_version 1801349 (0.0010) [2023-12-28 08:12:29,427][106225] Updated weights for policy 1, policy_version 1805425 (0.0008) [2023-12-28 08:12:29,485][106225] Updated weights for policy 1, policy_version 1805435 (0.0008) [2023-12-28 08:12:30,155][106226] Updated weights for policy 0, policy_version 1801359 (0.0009) [2023-12-28 08:12:30,169][106225] Updated weights for policy 1, policy_version 1805445 (0.0008) [2023-12-28 08:12:30,216][106226] Updated weights for policy 0, policy_version 1801369 (0.0006) [2023-12-28 08:12:30,230][106225] Updated weights for policy 1, policy_version 1805455 (0.0007) [2023-12-28 08:12:30,275][106226] Updated weights for policy 0, policy_version 1801379 (0.0008) [2023-12-28 08:12:30,285][106225] Updated weights for policy 1, policy_version 1805465 (0.0007) [2023-12-28 08:12:30,929][106226] Updated weights for policy 0, policy_version 1801389 (0.0009) [2023-12-28 08:12:30,995][106226] Updated weights for policy 0, policy_version 1801399 (0.0010) [2023-12-28 08:12:31,020][106225] Updated weights for policy 1, policy_version 1805475 (0.0009) [2023-12-28 08:12:31,064][106226] Updated weights for policy 0, policy_version 1801409 (0.0009) [2023-12-28 08:12:31,086][106225] Updated weights for policy 1, policy_version 1805485 (0.0007) [2023-12-28 08:12:31,151][106225] Updated weights for policy 1, policy_version 1805495 (0.0007) [2023-12-28 08:12:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 923500544. Throughput: 0: 10019.7, 1: 9777.6. Samples: 923491188. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:31,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-4.653')] [2023-12-28 08:12:31,744][106226] Updated weights for policy 0, policy_version 1801419 (0.0010) [2023-12-28 08:12:31,804][106226] Updated weights for policy 0, policy_version 1801429 (0.0010) [2023-12-28 08:12:31,871][106226] Updated weights for policy 0, policy_version 1801439 (0.0010) [2023-12-28 08:12:31,871][106225] Updated weights for policy 1, policy_version 1805505 (0.0007) [2023-12-28 08:12:31,933][106225] Updated weights for policy 1, policy_version 1805515 (0.0005) [2023-12-28 08:12:31,999][106225] Updated weights for policy 1, policy_version 1805525 (0.0008) [2023-12-28 08:12:32,056][106225] Updated weights for policy 1, policy_version 1805535 (0.0007) [2023-12-28 08:12:32,497][106226] Updated weights for policy 0, policy_version 1801449 (0.0010) [2023-12-28 08:12:32,562][106226] Updated weights for policy 0, policy_version 1801459 (0.0008) [2023-12-28 08:12:32,622][106226] Updated weights for policy 0, policy_version 1801469 (0.0008) [2023-12-28 08:12:32,676][106226] Updated weights for policy 0, policy_version 1801479 (0.0009) [2023-12-28 08:12:32,737][106225] Updated weights for policy 1, policy_version 1805545 (0.0006) [2023-12-28 08:12:32,791][106225] Updated weights for policy 1, policy_version 1805555 (0.0005) [2023-12-28 08:12:32,845][106225] Updated weights for policy 1, policy_version 1805565 (0.0007) [2023-12-28 08:12:33,322][106226] Updated weights for policy 0, policy_version 1801489 (0.0006) [2023-12-28 08:12:33,379][106226] Updated weights for policy 0, policy_version 1801499 (0.0008) [2023-12-28 08:12:33,444][106226] Updated weights for policy 0, policy_version 1801509 (0.0008) [2023-12-28 08:12:33,571][106225] Updated weights for policy 1, policy_version 1805575 (0.0008) [2023-12-28 08:12:33,615][106225] Updated weights for policy 1, policy_version 1805585 (0.0007) [2023-12-28 08:12:33,672][106225] Updated weights for policy 1, policy_version 1805595 (0.0007) [2023-12-28 08:12:34,136][106226] Updated weights for policy 0, policy_version 1801519 (0.0009) [2023-12-28 08:12:34,203][106226] Updated weights for policy 0, policy_version 1801529 (0.0006) [2023-12-28 08:12:34,267][106226] Updated weights for policy 0, policy_version 1801539 (0.0006) [2023-12-28 08:12:34,430][106225] Updated weights for policy 1, policy_version 1805605 (0.0008) [2023-12-28 08:12:34,502][106225] Updated weights for policy 1, policy_version 1805615 (0.0008) [2023-12-28 08:12:34,577][106225] Updated weights for policy 1, policy_version 1805625 (0.0008) [2023-12-28 08:12:34,905][106226] Updated weights for policy 0, policy_version 1801549 (0.0007) [2023-12-28 08:12:34,957][106226] Updated weights for policy 0, policy_version 1801559 (0.0008) [2023-12-28 08:12:35,018][106226] Updated weights for policy 0, policy_version 1801569 (0.0009) [2023-12-28 08:12:35,268][106225] Updated weights for policy 1, policy_version 1805635 (0.0008) [2023-12-28 08:12:35,327][106225] Updated weights for policy 1, policy_version 1805645 (0.0008) [2023-12-28 08:12:35,377][106225] Updated weights for policy 1, policy_version 1805655 (0.0008) [2023-12-28 08:12:35,745][106226] Updated weights for policy 0, policy_version 1801579 (0.0009) [2023-12-28 08:12:35,796][106226] Updated weights for policy 0, policy_version 1801589 (0.0007) [2023-12-28 08:12:35,846][106226] Updated weights for policy 0, policy_version 1801599 (0.0009) [2023-12-28 08:12:36,045][106225] Updated weights for policy 1, policy_version 1805665 (0.0009) [2023-12-28 08:12:36,107][106225] Updated weights for policy 1, policy_version 1805675 (0.0010) [2023-12-28 08:12:36,174][106225] Updated weights for policy 1, policy_version 1805685 (0.0008) [2023-12-28 08:12:36,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 923598848. Throughput: 0: 9930.1, 1: 9797.7. Samples: 923609436. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:36,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.680')] [2023-12-28 08:12:36,234][106225] Updated weights for policy 1, policy_version 1805695 (0.0009) [2023-12-28 08:12:36,679][106226] Updated weights for policy 0, policy_version 1801609 (0.0008) [2023-12-28 08:12:36,745][106226] Updated weights for policy 0, policy_version 1801619 (0.0011) [2023-12-28 08:12:36,810][106226] Updated weights for policy 0, policy_version 1801629 (0.0011) [2023-12-28 08:12:36,859][106226] Updated weights for policy 0, policy_version 1801639 (0.0010) [2023-12-28 08:12:36,909][106225] Updated weights for policy 1, policy_version 1805705 (0.0010) [2023-12-28 08:12:36,969][106225] Updated weights for policy 1, policy_version 1805715 (0.0009) [2023-12-28 08:12:37,033][106225] Updated weights for policy 1, policy_version 1805725 (0.0010) [2023-12-28 08:12:37,603][106226] Updated weights for policy 0, policy_version 1801649 (0.0009) [2023-12-28 08:12:37,638][106225] Updated weights for policy 1, policy_version 1805735 (0.0008) [2023-12-28 08:12:37,669][106226] Updated weights for policy 0, policy_version 1801659 (0.0007) [2023-12-28 08:12:37,702][106225] Updated weights for policy 1, policy_version 1805745 (0.0011) [2023-12-28 08:12:37,729][106226] Updated weights for policy 0, policy_version 1801669 (0.0007) [2023-12-28 08:12:37,765][106225] Updated weights for policy 1, policy_version 1805755 (0.0006) [2023-12-28 08:12:38,380][106225] Updated weights for policy 1, policy_version 1805765 (0.0008) [2023-12-28 08:12:38,441][106225] Updated weights for policy 1, policy_version 1805775 (0.0006) [2023-12-28 08:12:38,509][106225] Updated weights for policy 1, policy_version 1805785 (0.0006) [2023-12-28 08:12:38,571][106226] Updated weights for policy 0, policy_version 1801679 (0.0009) [2023-12-28 08:12:38,637][106226] Updated weights for policy 0, policy_version 1801689 (0.0008) [2023-12-28 08:12:38,694][106226] Updated weights for policy 0, policy_version 1801699 (0.0008) [2023-12-28 08:12:39,146][106225] Updated weights for policy 1, policy_version 1805795 (0.0008) [2023-12-28 08:12:39,196][106225] Updated weights for policy 1, policy_version 1805805 (0.0007) [2023-12-28 08:12:39,268][106225] Updated weights for policy 1, policy_version 1805815 (0.0009) [2023-12-28 08:12:39,499][106226] Updated weights for policy 0, policy_version 1801709 (0.0007) [2023-12-28 08:12:39,561][106226] Updated weights for policy 0, policy_version 1801719 (0.0008) [2023-12-28 08:12:39,619][106226] Updated weights for policy 0, policy_version 1801729 (0.0008) [2023-12-28 08:12:40,017][106225] Updated weights for policy 1, policy_version 1805825 (0.0009) [2023-12-28 08:12:40,084][106225] Updated weights for policy 1, policy_version 1805835 (0.0010) [2023-12-28 08:12:40,149][106225] Updated weights for policy 1, policy_version 1805845 (0.0011) [2023-12-28 08:12:40,214][106225] Updated weights for policy 1, policy_version 1805855 (0.0011) [2023-12-28 08:12:40,313][106226] Updated weights for policy 0, policy_version 1801739 (0.0009) [2023-12-28 08:12:40,374][106226] Updated weights for policy 0, policy_version 1801749 (0.0009) [2023-12-28 08:12:40,444][106226] Updated weights for policy 0, policy_version 1801759 (0.0011) [2023-12-28 08:12:40,933][106225] Updated weights for policy 1, policy_version 1805865 (0.0010) [2023-12-28 08:12:40,987][106225] Updated weights for policy 1, policy_version 1805875 (0.0010) [2023-12-28 08:12:41,050][106225] Updated weights for policy 1, policy_version 1805885 (0.0010) [2023-12-28 08:12:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 923697152. Throughput: 0: 9856.4, 1: 9890.7. Samples: 923668000. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:41,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.974')] [2023-12-28 08:12:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001801768_461332480.pth... [2023-12-28 08:12:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001805888_462364672.pth... [2023-12-28 08:12:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001800648_461045760.pth [2023-12-28 08:12:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001804704_462061568.pth [2023-12-28 08:12:41,228][106226] Updated weights for policy 0, policy_version 1801769 (0.0010) [2023-12-28 08:12:41,296][106226] Updated weights for policy 0, policy_version 1801779 (0.0008) [2023-12-28 08:12:41,357][106226] Updated weights for policy 0, policy_version 1801789 (0.0007) [2023-12-28 08:12:41,421][106226] Updated weights for policy 0, policy_version 1801799 (0.0009) [2023-12-28 08:12:41,805][106225] Updated weights for policy 1, policy_version 1805895 (0.0006) [2023-12-28 08:12:41,853][106225] Updated weights for policy 1, policy_version 1805905 (0.0005) [2023-12-28 08:12:41,901][106225] Updated weights for policy 1, policy_version 1805915 (0.0005) [2023-12-28 08:12:42,149][106226] Updated weights for policy 0, policy_version 1801809 (0.0011) [2023-12-28 08:12:42,203][106226] Updated weights for policy 0, policy_version 1801819 (0.0010) [2023-12-28 08:12:42,261][106226] Updated weights for policy 0, policy_version 1801829 (0.0011) [2023-12-28 08:12:42,617][106225] Updated weights for policy 1, policy_version 1805925 (0.0008) [2023-12-28 08:12:42,676][106225] Updated weights for policy 1, policy_version 1805935 (0.0008) [2023-12-28 08:12:42,725][106225] Updated weights for policy 1, policy_version 1805945 (0.0010) [2023-12-28 08:12:43,000][106226] Updated weights for policy 0, policy_version 1801839 (0.0010) [2023-12-28 08:12:43,050][106226] Updated weights for policy 0, policy_version 1801849 (0.0010) [2023-12-28 08:12:43,097][106226] Updated weights for policy 0, policy_version 1801859 (0.0011) [2023-12-28 08:12:43,415][106225] Updated weights for policy 1, policy_version 1805955 (0.0011) [2023-12-28 08:12:43,471][106225] Updated weights for policy 1, policy_version 1805965 (0.0010) [2023-12-28 08:12:43,517][106225] Updated weights for policy 1, policy_version 1805975 (0.0010) [2023-12-28 08:12:43,832][106226] Updated weights for policy 0, policy_version 1801869 (0.0010) [2023-12-28 08:12:43,879][106226] Updated weights for policy 0, policy_version 1801879 (0.0010) [2023-12-28 08:12:43,929][106226] Updated weights for policy 0, policy_version 1801889 (0.0010) [2023-12-28 08:12:44,057][106225] Updated weights for policy 1, policy_version 1805985 (0.0006) [2023-12-28 08:12:44,106][106225] Updated weights for policy 1, policy_version 1805995 (0.0005) [2023-12-28 08:12:44,160][106225] Updated weights for policy 1, policy_version 1806005 (0.0005) [2023-12-28 08:12:44,218][106225] Updated weights for policy 1, policy_version 1806015 (0.0005) [2023-12-28 08:12:44,653][106226] Updated weights for policy 0, policy_version 1801899 (0.0011) [2023-12-28 08:12:44,713][106226] Updated weights for policy 0, policy_version 1801909 (0.0010) [2023-12-28 08:12:44,757][106225] Updated weights for policy 1, policy_version 1806025 (0.0007) [2023-12-28 08:12:44,784][106226] Updated weights for policy 0, policy_version 1801919 (0.0007) [2023-12-28 08:12:44,825][106225] Updated weights for policy 1, policy_version 1806035 (0.0009) [2023-12-28 08:12:44,887][106225] Updated weights for policy 1, policy_version 1806045 (0.0010) [2023-12-28 08:12:45,521][106226] Updated weights for policy 0, policy_version 1801929 (0.0008) [2023-12-28 08:12:45,564][106225] Updated weights for policy 1, policy_version 1806055 (0.0010) [2023-12-28 08:12:45,579][106226] Updated weights for policy 0, policy_version 1801939 (0.0010) [2023-12-28 08:12:45,614][106225] Updated weights for policy 1, policy_version 1806065 (0.0010) [2023-12-28 08:12:45,640][106226] Updated weights for policy 0, policy_version 1801949 (0.0011) [2023-12-28 08:12:45,664][106225] Updated weights for policy 1, policy_version 1806075 (0.0010) [2023-12-28 08:12:45,700][106226] Updated weights for policy 0, policy_version 1801959 (0.0010) [2023-12-28 08:12:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 923795456. Throughput: 0: 9736.5, 1: 10021.9. Samples: 923786588. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:46,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.746')] [2023-12-28 08:12:46,411][106226] Updated weights for policy 0, policy_version 1801969 (0.0011) [2023-12-28 08:12:46,435][106225] Updated weights for policy 1, policy_version 1806085 (0.0010) [2023-12-28 08:12:46,473][106226] Updated weights for policy 0, policy_version 1801979 (0.0010) [2023-12-28 08:12:46,489][106225] Updated weights for policy 1, policy_version 1806095 (0.0010) [2023-12-28 08:12:46,527][106226] Updated weights for policy 0, policy_version 1801989 (0.0010) [2023-12-28 08:12:46,540][106225] Updated weights for policy 1, policy_version 1806105 (0.0010) [2023-12-28 08:12:47,125][106225] Updated weights for policy 1, policy_version 1806115 (0.0010) [2023-12-28 08:12:47,182][106225] Updated weights for policy 1, policy_version 1806125 (0.0010) [2023-12-28 08:12:47,239][106225] Updated weights for policy 1, policy_version 1806135 (0.0010) [2023-12-28 08:12:47,239][106226] Updated weights for policy 0, policy_version 1801999 (0.0011) [2023-12-28 08:12:47,289][106226] Updated weights for policy 0, policy_version 1802009 (0.0010) [2023-12-28 08:12:47,338][106226] Updated weights for policy 0, policy_version 1802019 (0.0010) [2023-12-28 08:12:47,902][106225] Updated weights for policy 1, policy_version 1806145 (0.0010) [2023-12-28 08:12:47,961][106225] Updated weights for policy 1, policy_version 1806155 (0.0008) [2023-12-28 08:12:48,015][106225] Updated weights for policy 1, policy_version 1806165 (0.0005) [2023-12-28 08:12:48,031][106226] Updated weights for policy 0, policy_version 1802029 (0.0010) [2023-12-28 08:12:48,075][106225] Updated weights for policy 1, policy_version 1806175 (0.0005) [2023-12-28 08:12:48,086][106226] Updated weights for policy 0, policy_version 1802039 (0.0010) [2023-12-28 08:12:48,139][106226] Updated weights for policy 0, policy_version 1802049 (0.0011) [2023-12-28 08:12:48,735][106225] Updated weights for policy 1, policy_version 1806185 (0.0008) [2023-12-28 08:12:48,797][106225] Updated weights for policy 1, policy_version 1806195 (0.0008) [2023-12-28 08:12:48,824][106226] Updated weights for policy 0, policy_version 1802059 (0.0009) [2023-12-28 08:12:48,860][106225] Updated weights for policy 1, policy_version 1806205 (0.0009) [2023-12-28 08:12:48,883][106226] Updated weights for policy 0, policy_version 1802069 (0.0010) [2023-12-28 08:12:48,943][106226] Updated weights for policy 0, policy_version 1802079 (0.0010) [2023-12-28 08:12:49,492][106225] Updated weights for policy 1, policy_version 1806215 (0.0007) [2023-12-28 08:12:49,551][106226] Updated weights for policy 0, policy_version 1802089 (0.0007) [2023-12-28 08:12:49,558][106225] Updated weights for policy 1, policy_version 1806225 (0.0010) [2023-12-28 08:12:49,612][106226] Updated weights for policy 0, policy_version 1802099 (0.0010) [2023-12-28 08:12:49,621][106225] Updated weights for policy 1, policy_version 1806235 (0.0010) [2023-12-28 08:12:49,675][106226] Updated weights for policy 0, policy_version 1802109 (0.0009) [2023-12-28 08:12:49,730][106226] Updated weights for policy 0, policy_version 1802119 (0.0011) [2023-12-28 08:12:50,271][106225] Updated weights for policy 1, policy_version 1806245 (0.0008) [2023-12-28 08:12:50,336][106225] Updated weights for policy 1, policy_version 1806255 (0.0007) [2023-12-28 08:12:50,397][106226] Updated weights for policy 0, policy_version 1802129 (0.0007) [2023-12-28 08:12:50,397][106225] Updated weights for policy 1, policy_version 1806265 (0.0008) [2023-12-28 08:12:50,457][106226] Updated weights for policy 0, policy_version 1802139 (0.0008) [2023-12-28 08:12:50,528][106226] Updated weights for policy 0, policy_version 1802149 (0.0009) [2023-12-28 08:12:51,067][106225] Updated weights for policy 1, policy_version 1806275 (0.0007) [2023-12-28 08:12:51,134][106225] Updated weights for policy 1, policy_version 1806285 (0.0007) [2023-12-28 08:12:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 923893760. Throughput: 0: 9760.2, 1: 10036.1. Samples: 923908212. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:51,175][105115] Avg episode reward: [(0, '-4.286'), (1, '-4.639')] [2023-12-28 08:12:51,197][106225] Updated weights for policy 1, policy_version 1806295 (0.0007) [2023-12-28 08:12:51,291][106226] Updated weights for policy 0, policy_version 1802159 (0.0007) [2023-12-28 08:12:51,354][106226] Updated weights for policy 0, policy_version 1802169 (0.0010) [2023-12-28 08:12:51,422][106226] Updated weights for policy 0, policy_version 1802179 (0.0008) [2023-12-28 08:12:51,899][106225] Updated weights for policy 1, policy_version 1806305 (0.0007) [2023-12-28 08:12:51,966][106225] Updated weights for policy 1, policy_version 1806315 (0.0009) [2023-12-28 08:12:52,030][106225] Updated weights for policy 1, policy_version 1806325 (0.0008) [2023-12-28 08:12:52,089][106225] Updated weights for policy 1, policy_version 1806335 (0.0008) [2023-12-28 08:12:52,155][106226] Updated weights for policy 0, policy_version 1802189 (0.0009) [2023-12-28 08:12:52,207][106226] Updated weights for policy 0, policy_version 1802199 (0.0008) [2023-12-28 08:12:52,276][106226] Updated weights for policy 0, policy_version 1802209 (0.0009) [2023-12-28 08:12:52,745][106225] Updated weights for policy 1, policy_version 1806345 (0.0006) [2023-12-28 08:12:52,812][106225] Updated weights for policy 1, policy_version 1806355 (0.0006) [2023-12-28 08:12:52,868][106225] Updated weights for policy 1, policy_version 1806365 (0.0007) [2023-12-28 08:12:53,010][106226] Updated weights for policy 0, policy_version 1802219 (0.0009) [2023-12-28 08:12:53,064][106226] Updated weights for policy 0, policy_version 1802229 (0.0006) [2023-12-28 08:12:53,122][106226] Updated weights for policy 0, policy_version 1802239 (0.0005) [2023-12-28 08:12:53,488][106225] Updated weights for policy 1, policy_version 1806375 (0.0007) [2023-12-28 08:12:53,546][106225] Updated weights for policy 1, policy_version 1806385 (0.0008) [2023-12-28 08:12:53,600][106225] Updated weights for policy 1, policy_version 1806395 (0.0008) [2023-12-28 08:12:53,655][106226] Updated weights for policy 0, policy_version 1802249 (0.0005) [2023-12-28 08:12:53,720][106226] Updated weights for policy 0, policy_version 1802259 (0.0006) [2023-12-28 08:12:53,786][106226] Updated weights for policy 0, policy_version 1802269 (0.0006) [2023-12-28 08:12:53,854][106226] Updated weights for policy 0, policy_version 1802279 (0.0005) [2023-12-28 08:12:54,310][106225] Updated weights for policy 1, policy_version 1806405 (0.0007) [2023-12-28 08:12:54,376][106225] Updated weights for policy 1, policy_version 1806415 (0.0006) [2023-12-28 08:12:54,380][106226] Updated weights for policy 0, policy_version 1802289 (0.0006) [2023-12-28 08:12:54,434][106225] Updated weights for policy 1, policy_version 1806425 (0.0006) [2023-12-28 08:12:54,434][106226] Updated weights for policy 0, policy_version 1802299 (0.0008) [2023-12-28 08:12:54,486][106226] Updated weights for policy 0, policy_version 1802309 (0.0007) [2023-12-28 08:12:55,073][106226] Updated weights for policy 0, policy_version 1802319 (0.0007) [2023-12-28 08:12:55,128][106226] Updated weights for policy 0, policy_version 1802329 (0.0005) [2023-12-28 08:12:55,181][106226] Updated weights for policy 0, policy_version 1802339 (0.0006) [2023-12-28 08:12:55,191][106225] Updated weights for policy 1, policy_version 1806435 (0.0008) [2023-12-28 08:12:55,244][106225] Updated weights for policy 1, policy_version 1806445 (0.0009) [2023-12-28 08:12:55,294][106225] Updated weights for policy 1, policy_version 1806455 (0.0008) [2023-12-28 08:12:55,850][106226] Updated weights for policy 0, policy_version 1802349 (0.0008) [2023-12-28 08:12:55,905][106226] Updated weights for policy 0, policy_version 1802359 (0.0008) [2023-12-28 08:12:55,966][106226] Updated weights for policy 0, policy_version 1802369 (0.0009) [2023-12-28 08:12:56,010][106225] Updated weights for policy 1, policy_version 1806465 (0.0008) [2023-12-28 08:12:56,068][106225] Updated weights for policy 1, policy_version 1806475 (0.0008) [2023-12-28 08:12:56,116][106225] Updated weights for policy 1, policy_version 1806485 (0.0008) [2023-12-28 08:12:56,164][106225] Updated weights for policy 1, policy_version 1806495 (0.0008) [2023-12-28 08:12:56,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 924008448. Throughput: 0: 9783.9, 1: 10058.1. Samples: 923969436. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:12:56,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.676')] [2023-12-28 08:12:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001802376_461488128.pth... [2023-12-28 08:12:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001806496_462520320.pth... [2023-12-28 08:12:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001805312_462217216.pth [2023-12-28 08:12:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001801224_461193216.pth [2023-12-28 08:12:56,689][106226] Updated weights for policy 0, policy_version 1802379 (0.0008) [2023-12-28 08:12:56,743][106226] Updated weights for policy 0, policy_version 1802389 (0.0008) [2023-12-28 08:12:56,801][106226] Updated weights for policy 0, policy_version 1802399 (0.0008) [2023-12-28 08:12:56,898][106225] Updated weights for policy 1, policy_version 1806505 (0.0008) [2023-12-28 08:12:56,956][106225] Updated weights for policy 1, policy_version 1806515 (0.0008) [2023-12-28 08:12:57,010][106225] Updated weights for policy 1, policy_version 1806525 (0.0008) [2023-12-28 08:12:57,574][106226] Updated weights for policy 0, policy_version 1802409 (0.0009) [2023-12-28 08:12:57,616][106225] Updated weights for policy 1, policy_version 1806535 (0.0006) [2023-12-28 08:12:57,633][106226] Updated weights for policy 0, policy_version 1802419 (0.0008) [2023-12-28 08:12:57,666][106225] Updated weights for policy 1, policy_version 1806545 (0.0006) [2023-12-28 08:12:57,690][106226] Updated weights for policy 0, policy_version 1802429 (0.0007) [2023-12-28 08:12:57,716][106225] Updated weights for policy 1, policy_version 1806555 (0.0005) [2023-12-28 08:12:57,748][106226] Updated weights for policy 0, policy_version 1802439 (0.0008) [2023-12-28 08:12:58,447][106226] Updated weights for policy 0, policy_version 1802449 (0.0009) [2023-12-28 08:12:58,502][106226] Updated weights for policy 0, policy_version 1802459 (0.0011) [2023-12-28 08:12:58,537][106225] Updated weights for policy 1, policy_version 1806565 (0.0008) [2023-12-28 08:12:58,569][106226] Updated weights for policy 0, policy_version 1802469 (0.0011) [2023-12-28 08:12:58,600][106225] Updated weights for policy 1, policy_version 1806575 (0.0010) [2023-12-28 08:12:58,669][106225] Updated weights for policy 1, policy_version 1806585 (0.0008) [2023-12-28 08:12:59,347][106226] Updated weights for policy 0, policy_version 1802479 (0.0010) [2023-12-28 08:12:59,412][106226] Updated weights for policy 0, policy_version 1802489 (0.0009) [2023-12-28 08:12:59,472][106226] Updated weights for policy 0, policy_version 1802499 (0.0009) [2023-12-28 08:12:59,498][106225] Updated weights for policy 1, policy_version 1806595 (0.0007) [2023-12-28 08:12:59,548][106225] Updated weights for policy 1, policy_version 1806605 (0.0007) [2023-12-28 08:12:59,604][106225] Updated weights for policy 1, policy_version 1806615 (0.0008) [2023-12-28 08:13:00,187][106226] Updated weights for policy 0, policy_version 1802509 (0.0008) [2023-12-28 08:13:00,255][106226] Updated weights for policy 0, policy_version 1802519 (0.0007) [2023-12-28 08:13:00,320][106226] Updated weights for policy 0, policy_version 1802529 (0.0008) [2023-12-28 08:13:00,365][106225] Updated weights for policy 1, policy_version 1806625 (0.0009) [2023-12-28 08:13:00,425][106225] Updated weights for policy 1, policy_version 1806635 (0.0008) [2023-12-28 08:13:00,485][106225] Updated weights for policy 1, policy_version 1806645 (0.0008) [2023-12-28 08:13:00,537][106225] Updated weights for policy 1, policy_version 1806655 (0.0009) [2023-12-28 08:13:00,887][106226] Updated weights for policy 0, policy_version 1802539 (0.0008) [2023-12-28 08:13:00,939][106226] Updated weights for policy 0, policy_version 1802549 (0.0009) [2023-12-28 08:13:01,001][106226] Updated weights for policy 0, policy_version 1802559 (0.0010) [2023-12-28 08:13:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 924098560. Throughput: 0: 9808.2, 1: 10017.5. Samples: 924085296. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:01,175][105115] Avg episode reward: [(0, '-4.517'), (1, '-5.077')] [2023-12-28 08:13:01,310][106225] Updated weights for policy 1, policy_version 1806665 (0.0006) [2023-12-28 08:13:01,373][106225] Updated weights for policy 1, policy_version 1806675 (0.0008) [2023-12-28 08:13:01,435][106225] Updated weights for policy 1, policy_version 1806685 (0.0007) [2023-12-28 08:13:01,737][106226] Updated weights for policy 0, policy_version 1802569 (0.0010) [2023-12-28 08:13:01,803][106226] Updated weights for policy 0, policy_version 1802579 (0.0008) [2023-12-28 08:13:01,857][106226] Updated weights for policy 0, policy_version 1802589 (0.0008) [2023-12-28 08:13:01,908][106226] Updated weights for policy 0, policy_version 1802599 (0.0008) [2023-12-28 08:13:02,079][106225] Updated weights for policy 1, policy_version 1806695 (0.0006) [2023-12-28 08:13:02,142][106225] Updated weights for policy 1, policy_version 1806705 (0.0009) [2023-12-28 08:13:02,201][106225] Updated weights for policy 1, policy_version 1806715 (0.0008) [2023-12-28 08:13:02,496][106226] Updated weights for policy 0, policy_version 1802609 (0.0008) [2023-12-28 08:13:02,549][106226] Updated weights for policy 0, policy_version 1802619 (0.0005) [2023-12-28 08:13:02,609][106226] Updated weights for policy 0, policy_version 1802629 (0.0006) [2023-12-28 08:13:02,923][106225] Updated weights for policy 1, policy_version 1806725 (0.0007) [2023-12-28 08:13:02,973][106225] Updated weights for policy 1, policy_version 1806735 (0.0008) [2023-12-28 08:13:03,032][106225] Updated weights for policy 1, policy_version 1806745 (0.0008) [2023-12-28 08:13:03,270][106226] Updated weights for policy 0, policy_version 1802639 (0.0011) [2023-12-28 08:13:03,329][106226] Updated weights for policy 0, policy_version 1802649 (0.0010) [2023-12-28 08:13:03,377][106226] Updated weights for policy 0, policy_version 1802659 (0.0007) [2023-12-28 08:13:03,656][106225] Updated weights for policy 1, policy_version 1806755 (0.0007) [2023-12-28 08:13:03,702][106225] Updated weights for policy 1, policy_version 1806765 (0.0005) [2023-12-28 08:13:03,751][106225] Updated weights for policy 1, policy_version 1806775 (0.0005) [2023-12-28 08:13:04,019][106226] Updated weights for policy 0, policy_version 1802669 (0.0008) [2023-12-28 08:13:04,077][106226] Updated weights for policy 0, policy_version 1802679 (0.0007) [2023-12-28 08:13:04,134][106226] Updated weights for policy 0, policy_version 1802689 (0.0005) [2023-12-28 08:13:04,406][106225] Updated weights for policy 1, policy_version 1806785 (0.0006) [2023-12-28 08:13:04,460][106225] Updated weights for policy 1, policy_version 1806795 (0.0008) [2023-12-28 08:13:04,508][106225] Updated weights for policy 1, policy_version 1806805 (0.0008) [2023-12-28 08:13:04,562][106225] Updated weights for policy 1, policy_version 1806815 (0.0008) [2023-12-28 08:13:04,781][106226] Updated weights for policy 0, policy_version 1802699 (0.0007) [2023-12-28 08:13:04,830][106226] Updated weights for policy 0, policy_version 1802709 (0.0010) [2023-12-28 08:13:04,880][106226] Updated weights for policy 0, policy_version 1802719 (0.0011) [2023-12-28 08:13:05,216][106225] Updated weights for policy 1, policy_version 1806825 (0.0007) [2023-12-28 08:13:05,269][106225] Updated weights for policy 1, policy_version 1806835 (0.0007) [2023-12-28 08:13:05,329][106225] Updated weights for policy 1, policy_version 1806845 (0.0007) [2023-12-28 08:13:05,597][106226] Updated weights for policy 0, policy_version 1802729 (0.0010) [2023-12-28 08:13:05,654][106226] Updated weights for policy 0, policy_version 1802739 (0.0010) [2023-12-28 08:13:05,713][106226] Updated weights for policy 0, policy_version 1802749 (0.0010) [2023-12-28 08:13:05,769][106226] Updated weights for policy 0, policy_version 1802759 (0.0009) [2023-12-28 08:13:06,076][106225] Updated weights for policy 1, policy_version 1806855 (0.0008) [2023-12-28 08:13:06,143][106225] Updated weights for policy 1, policy_version 1806865 (0.0008) [2023-12-28 08:13:06,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 924196864. Throughput: 0: 9949.0, 1: 10006.5. Samples: 924209264. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:06,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.754')] [2023-12-28 08:13:06,204][106225] Updated weights for policy 1, policy_version 1806875 (0.0007) [2023-12-28 08:13:06,521][106226] Updated weights for policy 0, policy_version 1802769 (0.0010) [2023-12-28 08:13:06,583][106226] Updated weights for policy 0, policy_version 1802779 (0.0008) [2023-12-28 08:13:06,633][106226] Updated weights for policy 0, policy_version 1802789 (0.0009) [2023-12-28 08:13:06,847][106225] Updated weights for policy 1, policy_version 1806885 (0.0006) [2023-12-28 08:13:06,909][106225] Updated weights for policy 1, policy_version 1806895 (0.0006) [2023-12-28 08:13:06,976][106225] Updated weights for policy 1, policy_version 1806905 (0.0010) [2023-12-28 08:13:07,298][106226] Updated weights for policy 0, policy_version 1802799 (0.0007) [2023-12-28 08:13:07,364][106226] Updated weights for policy 0, policy_version 1802809 (0.0005) [2023-12-28 08:13:07,420][106226] Updated weights for policy 0, policy_version 1802819 (0.0005) [2023-12-28 08:13:07,553][106225] Updated weights for policy 1, policy_version 1806915 (0.0005) [2023-12-28 08:13:07,610][106225] Updated weights for policy 1, policy_version 1806925 (0.0005) [2023-12-28 08:13:07,676][106225] Updated weights for policy 1, policy_version 1806935 (0.0005) [2023-12-28 08:13:07,941][106226] Updated weights for policy 0, policy_version 1802829 (0.0005) [2023-12-28 08:13:07,994][106226] Updated weights for policy 0, policy_version 1802839 (0.0008) [2023-12-28 08:13:08,057][106226] Updated weights for policy 0, policy_version 1802849 (0.0009) [2023-12-28 08:13:08,314][106225] Updated weights for policy 1, policy_version 1806945 (0.0010) [2023-12-28 08:13:08,376][106225] Updated weights for policy 1, policy_version 1806955 (0.0008) [2023-12-28 08:13:08,424][106225] Updated weights for policy 1, policy_version 1806965 (0.0005) [2023-12-28 08:13:08,480][106225] Updated weights for policy 1, policy_version 1806975 (0.0006) [2023-12-28 08:13:08,803][106226] Updated weights for policy 0, policy_version 1802859 (0.0008) [2023-12-28 08:13:08,863][106226] Updated weights for policy 0, policy_version 1802869 (0.0006) [2023-12-28 08:13:08,930][106226] Updated weights for policy 0, policy_version 1802879 (0.0006) [2023-12-28 08:13:09,146][106225] Updated weights for policy 1, policy_version 1806985 (0.0007) [2023-12-28 08:13:09,211][106225] Updated weights for policy 1, policy_version 1806995 (0.0009) [2023-12-28 08:13:09,283][106225] Updated weights for policy 1, policy_version 1807005 (0.0009) [2023-12-28 08:13:09,666][106226] Updated weights for policy 0, policy_version 1802889 (0.0008) [2023-12-28 08:13:09,723][106226] Updated weights for policy 0, policy_version 1802899 (0.0008) [2023-12-28 08:13:09,790][106226] Updated weights for policy 0, policy_version 1802909 (0.0008) [2023-12-28 08:13:09,866][106226] Updated weights for policy 0, policy_version 1802919 (0.0007) [2023-12-28 08:13:10,077][106225] Updated weights for policy 1, policy_version 1807015 (0.0007) [2023-12-28 08:13:10,139][106225] Updated weights for policy 1, policy_version 1807025 (0.0008) [2023-12-28 08:13:10,200][106225] Updated weights for policy 1, policy_version 1807035 (0.0008) [2023-12-28 08:13:10,568][106226] Updated weights for policy 0, policy_version 1802929 (0.0006) [2023-12-28 08:13:10,632][106226] Updated weights for policy 0, policy_version 1802939 (0.0006) [2023-12-28 08:13:10,694][106226] Updated weights for policy 0, policy_version 1802949 (0.0010) [2023-12-28 08:13:10,888][106225] Updated weights for policy 1, policy_version 1807045 (0.0007) [2023-12-28 08:13:10,950][106225] Updated weights for policy 1, policy_version 1807055 (0.0008) [2023-12-28 08:13:11,018][106225] Updated weights for policy 1, policy_version 1807065 (0.0006) [2023-12-28 08:13:11,175][105115] Fps is (10 sec: 20480.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 924303360. Throughput: 0: 9994.0, 1: 10104.0. Samples: 924272768. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:11,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.769')] [2023-12-28 08:13:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001807072_462667776.pth... [2023-12-28 08:13:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001802952_461635584.pth... [2023-12-28 08:13:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001805888_462364672.pth [2023-12-28 08:13:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001801768_461332480.pth [2023-12-28 08:13:11,436][106226] Updated weights for policy 0, policy_version 1802959 (0.0008) [2023-12-28 08:13:11,501][106226] Updated weights for policy 0, policy_version 1802969 (0.0008) [2023-12-28 08:13:11,562][106226] Updated weights for policy 0, policy_version 1802979 (0.0008) [2023-12-28 08:13:11,854][106225] Updated weights for policy 1, policy_version 1807075 (0.0008) [2023-12-28 08:13:11,917][106225] Updated weights for policy 1, policy_version 1807085 (0.0009) [2023-12-28 08:13:11,967][106225] Updated weights for policy 1, policy_version 1807095 (0.0010) [2023-12-28 08:13:12,229][106226] Updated weights for policy 0, policy_version 1802989 (0.0007) [2023-12-28 08:13:12,295][106226] Updated weights for policy 0, policy_version 1802999 (0.0009) [2023-12-28 08:13:12,358][106226] Updated weights for policy 0, policy_version 1803009 (0.0009) [2023-12-28 08:13:12,738][106225] Updated weights for policy 1, policy_version 1807105 (0.0009) [2023-12-28 08:13:12,803][106225] Updated weights for policy 1, policy_version 1807115 (0.0008) [2023-12-28 08:13:12,870][106225] Updated weights for policy 1, policy_version 1807125 (0.0010) [2023-12-28 08:13:12,932][106225] Updated weights for policy 1, policy_version 1807135 (0.0006) [2023-12-28 08:13:13,139][106226] Updated weights for policy 0, policy_version 1803019 (0.0007) [2023-12-28 08:13:13,189][106226] Updated weights for policy 0, policy_version 1803029 (0.0008) [2023-12-28 08:13:13,238][106226] Updated weights for policy 0, policy_version 1803039 (0.0007) [2023-12-28 08:13:13,476][106225] Updated weights for policy 1, policy_version 1807145 (0.0005) [2023-12-28 08:13:13,523][106225] Updated weights for policy 1, policy_version 1807155 (0.0006) [2023-12-28 08:13:13,582][106225] Updated weights for policy 1, policy_version 1807165 (0.0010) [2023-12-28 08:13:13,815][106226] Updated weights for policy 0, policy_version 1803049 (0.0006) [2023-12-28 08:13:13,872][106226] Updated weights for policy 0, policy_version 1803059 (0.0005) [2023-12-28 08:13:13,923][106226] Updated weights for policy 0, policy_version 1803069 (0.0005) [2023-12-28 08:13:13,976][106226] Updated weights for policy 0, policy_version 1803079 (0.0005) [2023-12-28 08:13:14,191][106225] Updated weights for policy 1, policy_version 1807175 (0.0007) [2023-12-28 08:13:14,258][106225] Updated weights for policy 1, policy_version 1807185 (0.0009) [2023-12-28 08:13:14,330][106225] Updated weights for policy 1, policy_version 1807195 (0.0009) [2023-12-28 08:13:14,578][106226] Updated weights for policy 0, policy_version 1803089 (0.0005) [2023-12-28 08:13:14,624][106226] Updated weights for policy 0, policy_version 1803099 (0.0005) [2023-12-28 08:13:14,674][106226] Updated weights for policy 0, policy_version 1803109 (0.0005) [2023-12-28 08:13:15,025][106225] Updated weights for policy 1, policy_version 1807205 (0.0007) [2023-12-28 08:13:15,088][106225] Updated weights for policy 1, policy_version 1807215 (0.0008) [2023-12-28 08:13:15,152][106225] Updated weights for policy 1, policy_version 1807225 (0.0009) [2023-12-28 08:13:15,387][106226] Updated weights for policy 0, policy_version 1803119 (0.0007) [2023-12-28 08:13:15,451][106226] Updated weights for policy 0, policy_version 1803129 (0.0008) [2023-12-28 08:13:15,508][106226] Updated weights for policy 0, policy_version 1803139 (0.0009) [2023-12-28 08:13:15,848][106225] Updated weights for policy 1, policy_version 1807235 (0.0007) [2023-12-28 08:13:15,894][106225] Updated weights for policy 1, policy_version 1807245 (0.0007) [2023-12-28 08:13:15,946][106225] Updated weights for policy 1, policy_version 1807255 (0.0008) [2023-12-28 08:13:16,174][106226] Updated weights for policy 0, policy_version 1803149 (0.0011) [2023-12-28 08:13:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 924401664. Throughput: 0: 9949.0, 1: 10066.7. Samples: 924391900. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:16,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.673')] [2023-12-28 08:13:16,242][106226] Updated weights for policy 0, policy_version 1803159 (0.0011) [2023-12-28 08:13:16,301][106226] Updated weights for policy 0, policy_version 1803169 (0.0008) [2023-12-28 08:13:16,643][106225] Updated weights for policy 1, policy_version 1807265 (0.0008) [2023-12-28 08:13:16,701][106225] Updated weights for policy 1, policy_version 1807275 (0.0009) [2023-12-28 08:13:16,756][106225] Updated weights for policy 1, policy_version 1807285 (0.0005) [2023-12-28 08:13:16,809][106225] Updated weights for policy 1, policy_version 1807295 (0.0007) [2023-12-28 08:13:17,010][106226] Updated weights for policy 0, policy_version 1803179 (0.0007) [2023-12-28 08:13:17,081][106226] Updated weights for policy 0, policy_version 1803189 (0.0005) [2023-12-28 08:13:17,153][106226] Updated weights for policy 0, policy_version 1803199 (0.0008) [2023-12-28 08:13:17,397][106225] Updated weights for policy 1, policy_version 1807305 (0.0006) [2023-12-28 08:13:17,445][106225] Updated weights for policy 1, policy_version 1807315 (0.0005) [2023-12-28 08:13:17,501][106225] Updated weights for policy 1, policy_version 1807325 (0.0006) [2023-12-28 08:13:17,674][106226] Updated weights for policy 0, policy_version 1803209 (0.0010) [2023-12-28 08:13:17,725][106226] Updated weights for policy 0, policy_version 1803219 (0.0009) [2023-12-28 08:13:17,780][106226] Updated weights for policy 0, policy_version 1803229 (0.0008) [2023-12-28 08:13:17,834][106226] Updated weights for policy 0, policy_version 1803239 (0.0010) [2023-12-28 08:13:18,076][106225] Updated weights for policy 1, policy_version 1807335 (0.0006) [2023-12-28 08:13:18,132][106225] Updated weights for policy 1, policy_version 1807345 (0.0006) [2023-12-28 08:13:18,180][106225] Updated weights for policy 1, policy_version 1807355 (0.0008) [2023-12-28 08:13:18,527][106226] Updated weights for policy 0, policy_version 1803249 (0.0008) [2023-12-28 08:13:18,590][106226] Updated weights for policy 0, policy_version 1803259 (0.0008) [2023-12-28 08:13:18,679][106226] Updated weights for policy 0, policy_version 1803269 (0.0009) [2023-12-28 08:13:18,909][106225] Updated weights for policy 1, policy_version 1807365 (0.0009) [2023-12-28 08:13:18,963][106225] Updated weights for policy 1, policy_version 1807375 (0.0010) [2023-12-28 08:13:19,010][106225] Updated weights for policy 1, policy_version 1807385 (0.0010) [2023-12-28 08:13:19,411][106226] Updated weights for policy 0, policy_version 1803279 (0.0010) [2023-12-28 08:13:19,476][106226] Updated weights for policy 0, policy_version 1803289 (0.0011) [2023-12-28 08:13:19,542][106226] Updated weights for policy 0, policy_version 1803299 (0.0010) [2023-12-28 08:13:19,762][106225] Updated weights for policy 1, policy_version 1807395 (0.0010) [2023-12-28 08:13:19,832][106225] Updated weights for policy 1, policy_version 1807405 (0.0009) [2023-12-28 08:13:19,897][106225] Updated weights for policy 1, policy_version 1807415 (0.0009) [2023-12-28 08:13:20,334][106226] Updated weights for policy 0, policy_version 1803309 (0.0008) [2023-12-28 08:13:20,401][106226] Updated weights for policy 0, policy_version 1803319 (0.0008) [2023-12-28 08:13:20,463][106226] Updated weights for policy 0, policy_version 1803329 (0.0008) [2023-12-28 08:13:20,636][106225] Updated weights for policy 1, policy_version 1807425 (0.0009) [2023-12-28 08:13:20,701][106225] Updated weights for policy 1, policy_version 1807435 (0.0011) [2023-12-28 08:13:20,764][106225] Updated weights for policy 1, policy_version 1807445 (0.0006) [2023-12-28 08:13:20,825][106225] Updated weights for policy 1, policy_version 1807455 (0.0009) [2023-12-28 08:13:21,174][105115] Fps is (10 sec: 19660.8, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 924499968. Throughput: 0: 9924.0, 1: 10117.3. Samples: 924511292. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:21,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.787')] [2023-12-28 08:13:21,259][106226] Updated weights for policy 0, policy_version 1803339 (0.0008) [2023-12-28 08:13:21,323][106226] Updated weights for policy 0, policy_version 1803349 (0.0008) [2023-12-28 08:13:21,394][106226] Updated weights for policy 0, policy_version 1803359 (0.0007) [2023-12-28 08:13:21,528][106225] Updated weights for policy 1, policy_version 1807465 (0.0008) [2023-12-28 08:13:21,600][106225] Updated weights for policy 1, policy_version 1807475 (0.0006) [2023-12-28 08:13:21,665][106225] Updated weights for policy 1, policy_version 1807485 (0.0009) [2023-12-28 08:13:22,023][106226] Updated weights for policy 0, policy_version 1803369 (0.0006) [2023-12-28 08:13:22,082][106226] Updated weights for policy 0, policy_version 1803379 (0.0008) [2023-12-28 08:13:22,146][106226] Updated weights for policy 0, policy_version 1803389 (0.0009) [2023-12-28 08:13:22,210][106226] Updated weights for policy 0, policy_version 1803399 (0.0006) [2023-12-28 08:13:22,329][106225] Updated weights for policy 1, policy_version 1807495 (0.0007) [2023-12-28 08:13:22,398][106225] Updated weights for policy 1, policy_version 1807505 (0.0008) [2023-12-28 08:13:22,470][106225] Updated weights for policy 1, policy_version 1807515 (0.0008) [2023-12-28 08:13:22,955][106226] Updated weights for policy 0, policy_version 1803409 (0.0009) [2023-12-28 08:13:23,023][106226] Updated weights for policy 0, policy_version 1803419 (0.0010) [2023-12-28 08:13:23,036][106225] Updated weights for policy 1, policy_version 1807525 (0.0007) [2023-12-28 08:13:23,083][106226] Updated weights for policy 0, policy_version 1803429 (0.0008) [2023-12-28 08:13:23,085][106225] Updated weights for policy 1, policy_version 1807535 (0.0007) [2023-12-28 08:13:23,136][106225] Updated weights for policy 1, policy_version 1807545 (0.0007) [2023-12-28 08:13:23,776][106226] Updated weights for policy 0, policy_version 1803439 (0.0008) [2023-12-28 08:13:23,824][106226] Updated weights for policy 0, policy_version 1803449 (0.0008) [2023-12-28 08:13:23,874][106225] Updated weights for policy 1, policy_version 1807555 (0.0009) [2023-12-28 08:13:23,880][106226] Updated weights for policy 0, policy_version 1803459 (0.0007) [2023-12-28 08:13:23,923][106225] Updated weights for policy 1, policy_version 1807565 (0.0007) [2023-12-28 08:13:23,975][106225] Updated weights for policy 1, policy_version 1807575 (0.0008) [2023-12-28 08:13:24,558][106226] Updated weights for policy 0, policy_version 1803469 (0.0005) [2023-12-28 08:13:24,617][106226] Updated weights for policy 0, policy_version 1803479 (0.0007) [2023-12-28 08:13:24,647][106225] Updated weights for policy 1, policy_version 1807585 (0.0009) [2023-12-28 08:13:24,669][106226] Updated weights for policy 0, policy_version 1803489 (0.0006) [2023-12-28 08:13:24,710][106225] Updated weights for policy 1, policy_version 1807595 (0.0005) [2023-12-28 08:13:24,776][106225] Updated weights for policy 1, policy_version 1807605 (0.0008) [2023-12-28 08:13:24,842][106225] Updated weights for policy 1, policy_version 1807615 (0.0010) [2023-12-28 08:13:25,216][106226] Updated weights for policy 0, policy_version 1803499 (0.0007) [2023-12-28 08:13:25,273][106226] Updated weights for policy 0, policy_version 1803509 (0.0008) [2023-12-28 08:13:25,330][106226] Updated weights for policy 0, policy_version 1803519 (0.0008) [2023-12-28 08:13:25,507][106225] Updated weights for policy 1, policy_version 1807625 (0.0010) [2023-12-28 08:13:25,564][106225] Updated weights for policy 1, policy_version 1807635 (0.0010) [2023-12-28 08:13:25,625][106225] Updated weights for policy 1, policy_version 1807645 (0.0010) [2023-12-28 08:13:26,022][106226] Updated weights for policy 0, policy_version 1803529 (0.0007) [2023-12-28 08:13:26,083][106226] Updated weights for policy 0, policy_version 1803539 (0.0008) [2023-12-28 08:13:26,149][106226] Updated weights for policy 0, policy_version 1803549 (0.0010) [2023-12-28 08:13:26,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19934.0, 300 sec: 19883.0). Total num frames: 924598272. Throughput: 0: 9984.8, 1: 10073.3. Samples: 924570612. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:26,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.884')] [2023-12-28 08:13:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001807648_462815232.pth... [2023-12-28 08:13:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001806496_462520320.pth [2023-12-28 08:13:26,204][106226] Updated weights for policy 0, policy_version 1803559 (0.0009) [2023-12-28 08:13:26,207][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001803560_461791232.pth... [2023-12-28 08:13:26,210][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001802376_461488128.pth [2023-12-28 08:13:26,266][106225] Updated weights for policy 1, policy_version 1807655 (0.0009) [2023-12-28 08:13:26,314][106225] Updated weights for policy 1, policy_version 1807665 (0.0007) [2023-12-28 08:13:26,368][106225] Updated weights for policy 1, policy_version 1807675 (0.0006) [2023-12-28 08:13:26,906][106225] Updated weights for policy 1, policy_version 1807685 (0.0007) [2023-12-28 08:13:26,920][106226] Updated weights for policy 0, policy_version 1803569 (0.0007) [2023-12-28 08:13:26,956][106225] Updated weights for policy 1, policy_version 1807695 (0.0006) [2023-12-28 08:13:26,974][106226] Updated weights for policy 0, policy_version 1803579 (0.0007) [2023-12-28 08:13:27,010][106225] Updated weights for policy 1, policy_version 1807705 (0.0005) [2023-12-28 08:13:27,035][106226] Updated weights for policy 0, policy_version 1803589 (0.0007) [2023-12-28 08:13:27,581][106226] Updated weights for policy 0, policy_version 1803599 (0.0005) [2023-12-28 08:13:27,629][106226] Updated weights for policy 0, policy_version 1803609 (0.0005) [2023-12-28 08:13:27,676][106226] Updated weights for policy 0, policy_version 1803619 (0.0009) [2023-12-28 08:13:27,827][106225] Updated weights for policy 1, policy_version 1807715 (0.0008) [2023-12-28 08:13:27,877][106225] Updated weights for policy 1, policy_version 1807725 (0.0008) [2023-12-28 08:13:27,931][106225] Updated weights for policy 1, policy_version 1807735 (0.0008) [2023-12-28 08:13:28,375][106226] Updated weights for policy 0, policy_version 1803629 (0.0011) [2023-12-28 08:13:28,431][106226] Updated weights for policy 0, policy_version 1803639 (0.0010) [2023-12-28 08:13:28,488][106226] Updated weights for policy 0, policy_version 1803649 (0.0011) [2023-12-28 08:13:28,670][106225] Updated weights for policy 1, policy_version 1807745 (0.0008) [2023-12-28 08:13:28,717][106225] Updated weights for policy 1, policy_version 1807755 (0.0008) [2023-12-28 08:13:28,765][106225] Updated weights for policy 1, policy_version 1807765 (0.0008) [2023-12-28 08:13:28,815][106225] Updated weights for policy 1, policy_version 1807775 (0.0008) [2023-12-28 08:13:29,207][106226] Updated weights for policy 0, policy_version 1803659 (0.0010) [2023-12-28 08:13:29,282][106226] Updated weights for policy 0, policy_version 1803669 (0.0009) [2023-12-28 08:13:29,356][106226] Updated weights for policy 0, policy_version 1803679 (0.0008) [2023-12-28 08:13:29,525][106225] Updated weights for policy 1, policy_version 1807785 (0.0006) [2023-12-28 08:13:29,591][106225] Updated weights for policy 1, policy_version 1807795 (0.0006) [2023-12-28 08:13:29,662][106225] Updated weights for policy 1, policy_version 1807805 (0.0005) [2023-12-28 08:13:30,070][106226] Updated weights for policy 0, policy_version 1803689 (0.0008) [2023-12-28 08:13:30,131][106226] Updated weights for policy 0, policy_version 1803699 (0.0009) [2023-12-28 08:13:30,191][106226] Updated weights for policy 0, policy_version 1803709 (0.0009) [2023-12-28 08:13:30,250][106226] Updated weights for policy 0, policy_version 1803719 (0.0009) [2023-12-28 08:13:30,302][106225] Updated weights for policy 1, policy_version 1807815 (0.0008) [2023-12-28 08:13:30,354][106225] Updated weights for policy 1, policy_version 1807825 (0.0009) [2023-12-28 08:13:30,403][106225] Updated weights for policy 1, policy_version 1807835 (0.0009) [2023-12-28 08:13:30,956][106226] Updated weights for policy 0, policy_version 1803729 (0.0006) [2023-12-28 08:13:31,012][106226] Updated weights for policy 0, policy_version 1803739 (0.0006) [2023-12-28 08:13:31,074][106226] Updated weights for policy 0, policy_version 1803749 (0.0011) [2023-12-28 08:13:31,162][106225] Updated weights for policy 1, policy_version 1807845 (0.0010) [2023-12-28 08:13:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 924704768. Throughput: 0: 10111.2, 1: 10066.3. Samples: 924694576. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:31,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.928')] [2023-12-28 08:13:31,218][106225] Updated weights for policy 1, policy_version 1807855 (0.0010) [2023-12-28 08:13:31,286][106225] Updated weights for policy 1, policy_version 1807865 (0.0011) [2023-12-28 08:13:31,711][106226] Updated weights for policy 0, policy_version 1803759 (0.0011) [2023-12-28 08:13:31,778][106226] Updated weights for policy 0, policy_version 1803769 (0.0008) [2023-12-28 08:13:31,839][106226] Updated weights for policy 0, policy_version 1803779 (0.0010) [2023-12-28 08:13:31,961][106225] Updated weights for policy 1, policy_version 1807875 (0.0009) [2023-12-28 08:13:32,020][106225] Updated weights for policy 1, policy_version 1807885 (0.0006) [2023-12-28 08:13:32,074][106225] Updated weights for policy 1, policy_version 1807895 (0.0007) [2023-12-28 08:13:32,479][106226] Updated weights for policy 0, policy_version 1803789 (0.0010) [2023-12-28 08:13:32,546][106226] Updated weights for policy 0, policy_version 1803799 (0.0010) [2023-12-28 08:13:32,612][106226] Updated weights for policy 0, policy_version 1803809 (0.0010) [2023-12-28 08:13:32,751][106225] Updated weights for policy 1, policy_version 1807905 (0.0006) [2023-12-28 08:13:32,803][106225] Updated weights for policy 1, policy_version 1807915 (0.0008) [2023-12-28 08:13:32,852][106225] Updated weights for policy 1, policy_version 1807925 (0.0008) [2023-12-28 08:13:32,903][106225] Updated weights for policy 1, policy_version 1807935 (0.0008) [2023-12-28 08:13:33,270][106226] Updated weights for policy 0, policy_version 1803819 (0.0008) [2023-12-28 08:13:33,326][106226] Updated weights for policy 0, policy_version 1803829 (0.0008) [2023-12-28 08:13:33,389][106226] Updated weights for policy 0, policy_version 1803839 (0.0007) [2023-12-28 08:13:33,617][106225] Updated weights for policy 1, policy_version 1807945 (0.0008) [2023-12-28 08:13:33,673][106225] Updated weights for policy 1, policy_version 1807955 (0.0008) [2023-12-28 08:13:33,726][106225] Updated weights for policy 1, policy_version 1807965 (0.0008) [2023-12-28 08:13:33,975][106226] Updated weights for policy 0, policy_version 1803849 (0.0008) [2023-12-28 08:13:34,039][106226] Updated weights for policy 0, policy_version 1803859 (0.0005) [2023-12-28 08:13:34,106][106226] Updated weights for policy 0, policy_version 1803869 (0.0005) [2023-12-28 08:13:34,180][106226] Updated weights for policy 0, policy_version 1803879 (0.0025) [2023-12-28 08:13:34,547][106225] Updated weights for policy 1, policy_version 1807975 (0.0009) [2023-12-28 08:13:34,610][106225] Updated weights for policy 1, policy_version 1807985 (0.0006) [2023-12-28 08:13:34,672][106225] Updated weights for policy 1, policy_version 1807995 (0.0007) [2023-12-28 08:13:34,810][106226] Updated weights for policy 0, policy_version 1803889 (0.0009) [2023-12-28 08:13:34,865][106226] Updated weights for policy 0, policy_version 1803899 (0.0008) [2023-12-28 08:13:34,916][106226] Updated weights for policy 0, policy_version 1803909 (0.0008) [2023-12-28 08:13:35,314][106225] Updated weights for policy 1, policy_version 1808005 (0.0009) [2023-12-28 08:13:35,370][106225] Updated weights for policy 1, policy_version 1808015 (0.0008) [2023-12-28 08:13:35,417][106225] Updated weights for policy 1, policy_version 1808025 (0.0007) [2023-12-28 08:13:35,637][106226] Updated weights for policy 0, policy_version 1803919 (0.0008) [2023-12-28 08:13:35,701][106226] Updated weights for policy 0, policy_version 1803929 (0.0008) [2023-12-28 08:13:35,762][106226] Updated weights for policy 0, policy_version 1803939 (0.0008) [2023-12-28 08:13:36,124][106225] Updated weights for policy 1, policy_version 1808035 (0.0006) [2023-12-28 08:13:36,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 924803072. Throughput: 0: 10168.0, 1: 10000.2. Samples: 924815780. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:36,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-5.069')] [2023-12-28 08:13:36,185][106225] Updated weights for policy 1, policy_version 1808045 (0.0007) [2023-12-28 08:13:36,247][106225] Updated weights for policy 1, policy_version 1808055 (0.0009) [2023-12-28 08:13:36,415][106226] Updated weights for policy 0, policy_version 1803949 (0.0009) [2023-12-28 08:13:36,477][106226] Updated weights for policy 0, policy_version 1803959 (0.0011) [2023-12-28 08:13:36,541][106226] Updated weights for policy 0, policy_version 1803969 (0.0011) [2023-12-28 08:13:36,969][106225] Updated weights for policy 1, policy_version 1808065 (0.0007) [2023-12-28 08:13:37,027][106225] Updated weights for policy 1, policy_version 1808075 (0.0008) [2023-12-28 08:13:37,084][106225] Updated weights for policy 1, policy_version 1808085 (0.0010) [2023-12-28 08:13:37,145][106225] Updated weights for policy 1, policy_version 1808095 (0.0010) [2023-12-28 08:13:37,234][106226] Updated weights for policy 0, policy_version 1803979 (0.0011) [2023-12-28 08:13:37,285][106226] Updated weights for policy 0, policy_version 1803989 (0.0010) [2023-12-28 08:13:37,331][106226] Updated weights for policy 0, policy_version 1803999 (0.0010) [2023-12-28 08:13:37,781][106225] Updated weights for policy 1, policy_version 1808105 (0.0010) [2023-12-28 08:13:37,838][106225] Updated weights for policy 1, policy_version 1808115 (0.0010) [2023-12-28 08:13:37,898][106225] Updated weights for policy 1, policy_version 1808125 (0.0010) [2023-12-28 08:13:38,071][106226] Updated weights for policy 0, policy_version 1804009 (0.0011) [2023-12-28 08:13:38,124][106226] Updated weights for policy 0, policy_version 1804019 (0.0010) [2023-12-28 08:13:38,176][106226] Updated weights for policy 0, policy_version 1804029 (0.0010) [2023-12-28 08:13:38,226][106226] Updated weights for policy 0, policy_version 1804039 (0.0010) [2023-12-28 08:13:38,616][106225] Updated weights for policy 1, policy_version 1808135 (0.0008) [2023-12-28 08:13:38,664][106225] Updated weights for policy 1, policy_version 1808145 (0.0008) [2023-12-28 08:13:38,712][106225] Updated weights for policy 1, policy_version 1808155 (0.0008) [2023-12-28 08:13:38,955][106226] Updated weights for policy 0, policy_version 1804049 (0.0010) [2023-12-28 08:13:39,012][106226] Updated weights for policy 0, policy_version 1804059 (0.0010) [2023-12-28 08:13:39,069][106226] Updated weights for policy 0, policy_version 1804069 (0.0010) [2023-12-28 08:13:39,387][106225] Updated weights for policy 1, policy_version 1808165 (0.0008) [2023-12-28 08:13:39,454][106225] Updated weights for policy 1, policy_version 1808175 (0.0008) [2023-12-28 08:13:39,517][106225] Updated weights for policy 1, policy_version 1808185 (0.0007) [2023-12-28 08:13:39,853][106226] Updated weights for policy 0, policy_version 1804079 (0.0009) [2023-12-28 08:13:39,918][106226] Updated weights for policy 0, policy_version 1804089 (0.0011) [2023-12-28 08:13:39,987][106226] Updated weights for policy 0, policy_version 1804099 (0.0008) [2023-12-28 08:13:40,248][106225] Updated weights for policy 1, policy_version 1808195 (0.0007) [2023-12-28 08:13:40,303][106225] Updated weights for policy 1, policy_version 1808205 (0.0006) [2023-12-28 08:13:40,358][106225] Updated weights for policy 1, policy_version 1808215 (0.0006) [2023-12-28 08:13:40,713][106226] Updated weights for policy 0, policy_version 1804109 (0.0010) [2023-12-28 08:13:40,765][106226] Updated weights for policy 0, policy_version 1804119 (0.0010) [2023-12-28 08:13:40,822][106226] Updated weights for policy 0, policy_version 1804129 (0.0011) [2023-12-28 08:13:40,988][106225] Updated weights for policy 1, policy_version 1808225 (0.0008) [2023-12-28 08:13:41,058][106225] Updated weights for policy 1, policy_version 1808235 (0.0010) [2023-12-28 08:13:41,128][106225] Updated weights for policy 1, policy_version 1808245 (0.0011) [2023-12-28 08:13:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 924901376. Throughput: 0: 10125.7, 1: 9977.4. Samples: 924874080. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:41,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.696')] [2023-12-28 08:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001804136_461938688.pth... [2023-12-28 08:13:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001802952_461635584.pth [2023-12-28 08:13:41,187][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001804136_461938688.pth [2023-12-28 08:13:41,198][106225] Updated weights for policy 1, policy_version 1808255 (0.0008) [2023-12-28 08:13:41,204][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001808256_462970880.pth... [2023-12-28 08:13:41,207][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001807072_462667776.pth [2023-12-28 08:13:41,208][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001808256_462970880.pth [2023-12-28 08:13:41,695][106226] Updated weights for policy 0, policy_version 1804139 (0.0010) [2023-12-28 08:13:41,770][106226] Updated weights for policy 0, policy_version 1804149 (0.0009) [2023-12-28 08:13:41,841][106226] Updated weights for policy 0, policy_version 1804159 (0.0008) [2023-12-28 08:13:42,002][106225] Updated weights for policy 1, policy_version 1808265 (0.0006) [2023-12-28 08:13:42,070][106225] Updated weights for policy 1, policy_version 1808275 (0.0006) [2023-12-28 08:13:42,136][106225] Updated weights for policy 1, policy_version 1808285 (0.0009) [2023-12-28 08:13:42,569][106226] Updated weights for policy 0, policy_version 1804169 (0.0006) [2023-12-28 08:13:42,624][106226] Updated weights for policy 0, policy_version 1804179 (0.0008) [2023-12-28 08:13:42,681][106226] Updated weights for policy 0, policy_version 1804189 (0.0007) [2023-12-28 08:13:42,744][106226] Updated weights for policy 0, policy_version 1804199 (0.0008) [2023-12-28 08:13:42,841][106225] Updated weights for policy 1, policy_version 1808295 (0.0007) [2023-12-28 08:13:42,904][106225] Updated weights for policy 1, policy_version 1808305 (0.0005) [2023-12-28 08:13:42,965][106225] Updated weights for policy 1, policy_version 1808315 (0.0005) [2023-12-28 08:13:43,499][106226] Updated weights for policy 0, policy_version 1804209 (0.0006) [2023-12-28 08:13:43,567][106226] Updated weights for policy 0, policy_version 1804219 (0.0005) [2023-12-28 08:13:43,614][106226] Updated weights for policy 0, policy_version 1804229 (0.0008) [2023-12-28 08:13:43,632][106225] Updated weights for policy 1, policy_version 1808325 (0.0008) [2023-12-28 08:13:43,697][106225] Updated weights for policy 1, policy_version 1808335 (0.0005) [2023-12-28 08:13:43,746][106225] Updated weights for policy 1, policy_version 1808345 (0.0008) [2023-12-28 08:13:44,238][106226] Updated weights for policy 0, policy_version 1804239 (0.0008) [2023-12-28 08:13:44,298][106226] Updated weights for policy 0, policy_version 1804249 (0.0008) [2023-12-28 08:13:44,349][106226] Updated weights for policy 0, policy_version 1804259 (0.0006) [2023-12-28 08:13:44,417][106225] Updated weights for policy 1, policy_version 1808355 (0.0008) [2023-12-28 08:13:44,465][106225] Updated weights for policy 1, policy_version 1808365 (0.0005) [2023-12-28 08:13:44,513][106225] Updated weights for policy 1, policy_version 1808375 (0.0005) [2023-12-28 08:13:45,038][106226] Updated weights for policy 0, policy_version 1804269 (0.0011) [2023-12-28 08:13:45,101][106226] Updated weights for policy 0, policy_version 1804279 (0.0011) [2023-12-28 08:13:45,159][106225] Updated weights for policy 1, policy_version 1808385 (0.0007) [2023-12-28 08:13:45,166][106226] Updated weights for policy 0, policy_version 1804289 (0.0009) [2023-12-28 08:13:45,219][106225] Updated weights for policy 1, policy_version 1808395 (0.0009) [2023-12-28 08:13:45,280][106225] Updated weights for policy 1, policy_version 1808405 (0.0009) [2023-12-28 08:13:45,333][106225] Updated weights for policy 1, policy_version 1808415 (0.0009) [2023-12-28 08:13:45,793][106226] Updated weights for policy 0, policy_version 1804299 (0.0008) [2023-12-28 08:13:45,843][106226] Updated weights for policy 0, policy_version 1804309 (0.0010) [2023-12-28 08:13:45,893][106226] Updated weights for policy 0, policy_version 1804319 (0.0010) [2023-12-28 08:13:45,956][106225] Updated weights for policy 1, policy_version 1808425 (0.0006) [2023-12-28 08:13:46,006][106225] Updated weights for policy 1, policy_version 1808435 (0.0008) [2023-12-28 08:13:46,074][106225] Updated weights for policy 1, policy_version 1808445 (0.0010) [2023-12-28 08:13:46,174][105115] Fps is (10 sec: 20480.2, 60 sec: 20206.9, 300 sec: 19910.7). Total num frames: 925007872. Throughput: 0: 10074.4, 1: 10059.4. Samples: 924991316. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:46,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.960')] [2023-12-28 08:13:46,517][106226] Updated weights for policy 0, policy_version 1804329 (0.0010) [2023-12-28 08:13:46,580][106226] Updated weights for policy 0, policy_version 1804339 (0.0010) [2023-12-28 08:13:46,640][106226] Updated weights for policy 0, policy_version 1804349 (0.0011) [2023-12-28 08:13:46,706][106226] Updated weights for policy 0, policy_version 1804359 (0.0011) [2023-12-28 08:13:46,899][106225] Updated weights for policy 1, policy_version 1808455 (0.0009) [2023-12-28 08:13:46,963][106225] Updated weights for policy 1, policy_version 1808465 (0.0008) [2023-12-28 08:13:47,025][106225] Updated weights for policy 1, policy_version 1808475 (0.0008) [2023-12-28 08:13:47,407][106226] Updated weights for policy 0, policy_version 1804369 (0.0007) [2023-12-28 08:13:47,456][106226] Updated weights for policy 0, policy_version 1804379 (0.0010) [2023-12-28 08:13:47,515][106226] Updated weights for policy 0, policy_version 1804389 (0.0011) [2023-12-28 08:13:47,804][106225] Updated weights for policy 1, policy_version 1808485 (0.0009) [2023-12-28 08:13:47,891][106225] Updated weights for policy 1, policy_version 1808495 (0.0009) [2023-12-28 08:13:47,952][106225] Updated weights for policy 1, policy_version 1808505 (0.0009) [2023-12-28 08:13:48,114][106226] Updated weights for policy 0, policy_version 1804399 (0.0006) [2023-12-28 08:13:48,169][106226] Updated weights for policy 0, policy_version 1804409 (0.0006) [2023-12-28 08:13:48,222][106226] Updated weights for policy 0, policy_version 1804419 (0.0008) [2023-12-28 08:13:48,730][106225] Updated weights for policy 1, policy_version 1808515 (0.0008) [2023-12-28 08:13:48,793][106225] Updated weights for policy 1, policy_version 1808525 (0.0008) [2023-12-28 08:13:48,858][106225] Updated weights for policy 1, policy_version 1808535 (0.0008) [2023-12-28 08:13:48,892][106226] Updated weights for policy 0, policy_version 1804429 (0.0008) [2023-12-28 08:13:48,951][106226] Updated weights for policy 0, policy_version 1804439 (0.0006) [2023-12-28 08:13:49,011][106226] Updated weights for policy 0, policy_version 1804449 (0.0008) [2023-12-28 08:13:49,580][106225] Updated weights for policy 1, policy_version 1808545 (0.0008) [2023-12-28 08:13:49,633][106225] Updated weights for policy 1, policy_version 1808555 (0.0009) [2023-12-28 08:13:49,693][106225] Updated weights for policy 1, policy_version 1808565 (0.0009) [2023-12-28 08:13:49,711][106226] Updated weights for policy 0, policy_version 1804459 (0.0008) [2023-12-28 08:13:49,755][106225] Updated weights for policy 1, policy_version 1808575 (0.0008) [2023-12-28 08:13:49,774][106226] Updated weights for policy 0, policy_version 1804469 (0.0006) [2023-12-28 08:13:49,838][106226] Updated weights for policy 0, policy_version 1804479 (0.0009) [2023-12-28 08:13:50,498][106225] Updated weights for policy 1, policy_version 1808585 (0.0008) [2023-12-28 08:13:50,566][106225] Updated weights for policy 1, policy_version 1808595 (0.0009) [2023-12-28 08:13:50,617][106226] Updated weights for policy 0, policy_version 1804489 (0.0009) [2023-12-28 08:13:50,635][106225] Updated weights for policy 1, policy_version 1808605 (0.0007) [2023-12-28 08:13:50,679][106226] Updated weights for policy 0, policy_version 1804499 (0.0010) [2023-12-28 08:13:50,743][106226] Updated weights for policy 0, policy_version 1804509 (0.0008) [2023-12-28 08:13:50,806][106226] Updated weights for policy 0, policy_version 1804519 (0.0008) [2023-12-28 08:13:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 925097984. Throughput: 0: 10033.6, 1: 9950.7. Samples: 925108556. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:51,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-5.036')] [2023-12-28 08:13:51,397][106225] Updated weights for policy 1, policy_version 1808615 (0.0008) [2023-12-28 08:13:51,460][106225] Updated weights for policy 1, policy_version 1808625 (0.0006) [2023-12-28 08:13:51,488][106226] Updated weights for policy 0, policy_version 1804529 (0.0010) [2023-12-28 08:13:51,522][106225] Updated weights for policy 1, policy_version 1808635 (0.0005) [2023-12-28 08:13:51,549][106226] Updated weights for policy 0, policy_version 1804539 (0.0011) [2023-12-28 08:13:51,614][106226] Updated weights for policy 0, policy_version 1804549 (0.0011) [2023-12-28 08:13:52,194][106225] Updated weights for policy 1, policy_version 1808645 (0.0008) [2023-12-28 08:13:52,254][106225] Updated weights for policy 1, policy_version 1808655 (0.0010) [2023-12-28 08:13:52,312][106225] Updated weights for policy 1, policy_version 1808665 (0.0010) [2023-12-28 08:13:52,395][106226] Updated weights for policy 0, policy_version 1804559 (0.0010) [2023-12-28 08:13:52,460][106226] Updated weights for policy 0, policy_version 1804569 (0.0011) [2023-12-28 08:13:52,521][106226] Updated weights for policy 0, policy_version 1804579 (0.0011) [2023-12-28 08:13:53,014][106225] Updated weights for policy 1, policy_version 1808675 (0.0010) [2023-12-28 08:13:53,068][106225] Updated weights for policy 1, policy_version 1808685 (0.0010) [2023-12-28 08:13:53,121][106225] Updated weights for policy 1, policy_version 1808695 (0.0010) [2023-12-28 08:13:53,146][106226] Updated weights for policy 0, policy_version 1804589 (0.0008) [2023-12-28 08:13:53,192][106226] Updated weights for policy 0, policy_version 1804599 (0.0005) [2023-12-28 08:13:53,245][106226] Updated weights for policy 0, policy_version 1804609 (0.0005) [2023-12-28 08:13:53,761][106225] Updated weights for policy 1, policy_version 1808705 (0.0010) [2023-12-28 08:13:53,832][106225] Updated weights for policy 1, policy_version 1808715 (0.0005) [2023-12-28 08:13:53,885][106226] Updated weights for policy 0, policy_version 1804619 (0.0005) [2023-12-28 08:13:53,901][106225] Updated weights for policy 1, policy_version 1808725 (0.0006) [2023-12-28 08:13:53,948][106226] Updated weights for policy 0, policy_version 1804629 (0.0007) [2023-12-28 08:13:53,961][106225] Updated weights for policy 1, policy_version 1808735 (0.0006) [2023-12-28 08:13:54,007][106226] Updated weights for policy 0, policy_version 1804639 (0.0008) [2023-12-28 08:13:54,510][106225] Updated weights for policy 1, policy_version 1808745 (0.0008) [2023-12-28 08:13:54,561][106225] Updated weights for policy 1, policy_version 1808755 (0.0008) [2023-12-28 08:13:54,623][106225] Updated weights for policy 1, policy_version 1808765 (0.0007) [2023-12-28 08:13:54,695][106226] Updated weights for policy 0, policy_version 1804649 (0.0008) [2023-12-28 08:13:54,764][106226] Updated weights for policy 0, policy_version 1804659 (0.0011) [2023-12-28 08:13:54,826][106226] Updated weights for policy 0, policy_version 1804669 (0.0010) [2023-12-28 08:13:54,872][106226] Updated weights for policy 0, policy_version 1804679 (0.0010) [2023-12-28 08:13:55,253][106225] Updated weights for policy 1, policy_version 1808775 (0.0009) [2023-12-28 08:13:55,309][106225] Updated weights for policy 1, policy_version 1808785 (0.0010) [2023-12-28 08:13:55,352][106225] Updated weights for policy 1, policy_version 1808795 (0.0010) [2023-12-28 08:13:55,478][106226] Updated weights for policy 0, policy_version 1804689 (0.0006) [2023-12-28 08:13:55,523][106226] Updated weights for policy 0, policy_version 1804699 (0.0005) [2023-12-28 08:13:55,577][106226] Updated weights for policy 0, policy_version 1804709 (0.0005) [2023-12-28 08:13:56,007][106225] Updated weights for policy 1, policy_version 1808805 (0.0008) [2023-12-28 08:13:56,071][106225] Updated weights for policy 1, policy_version 1808815 (0.0007) [2023-12-28 08:13:56,121][106225] Updated weights for policy 1, policy_version 1808825 (0.0008) [2023-12-28 08:13:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19910.7). Total num frames: 925204480. Throughput: 0: 10015.3, 1: 9900.1. Samples: 925168960. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:13:56,175][105115] Avg episode reward: [(0, '-4.238'), (1, '-4.914')] [2023-12-28 08:13:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001808832_463118336.pth... [2023-12-28 08:13:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001807648_462815232.pth [2023-12-28 08:13:56,197][106226] Updated weights for policy 0, policy_version 1804719 (0.0005) [2023-12-28 08:13:56,254][106226] Updated weights for policy 0, policy_version 1804729 (0.0005) [2023-12-28 08:13:56,318][106226] Updated weights for policy 0, policy_version 1804739 (0.0005) [2023-12-28 08:13:56,353][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001804744_462094336.pth... [2023-12-28 08:13:56,357][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001803560_461791232.pth [2023-12-28 08:13:56,773][106225] Updated weights for policy 1, policy_version 1808835 (0.0010) [2023-12-28 08:13:56,835][106225] Updated weights for policy 1, policy_version 1808845 (0.0009) [2023-12-28 08:13:56,894][106225] Updated weights for policy 1, policy_version 1808855 (0.0005) [2023-12-28 08:13:56,896][106226] Updated weights for policy 0, policy_version 1804749 (0.0008) [2023-12-28 08:13:56,946][106226] Updated weights for policy 0, policy_version 1804759 (0.0010) [2023-12-28 08:13:56,996][106226] Updated weights for policy 0, policy_version 1804769 (0.0010) [2023-12-28 08:13:57,522][106225] Updated weights for policy 1, policy_version 1808865 (0.0006) [2023-12-28 08:13:57,575][106225] Updated weights for policy 1, policy_version 1808875 (0.0010) [2023-12-28 08:13:57,625][106225] Updated weights for policy 1, policy_version 1808885 (0.0010) [2023-12-28 08:13:57,640][106226] Updated weights for policy 0, policy_version 1804779 (0.0010) [2023-12-28 08:13:57,671][106225] Updated weights for policy 1, policy_version 1808895 (0.0010) [2023-12-28 08:13:57,693][106226] Updated weights for policy 0, policy_version 1804789 (0.0008) [2023-12-28 08:13:57,742][106226] Updated weights for policy 0, policy_version 1804799 (0.0009) [2023-12-28 08:13:58,436][106225] Updated weights for policy 1, policy_version 1808905 (0.0010) [2023-12-28 08:13:58,498][106225] Updated weights for policy 1, policy_version 1808915 (0.0011) [2023-12-28 08:13:58,499][106226] Updated weights for policy 0, policy_version 1804809 (0.0010) [2023-12-28 08:13:58,561][106225] Updated weights for policy 1, policy_version 1808925 (0.0010) [2023-12-28 08:13:58,562][106226] Updated weights for policy 0, policy_version 1804819 (0.0010) [2023-12-28 08:13:58,627][106226] Updated weights for policy 0, policy_version 1804829 (0.0010) [2023-12-28 08:13:58,692][106226] Updated weights for policy 0, policy_version 1804839 (0.0010) [2023-12-28 08:13:59,397][106225] Updated weights for policy 1, policy_version 1808935 (0.0009) [2023-12-28 08:13:59,462][106225] Updated weights for policy 1, policy_version 1808945 (0.0008) [2023-12-28 08:13:59,484][106226] Updated weights for policy 0, policy_version 1804849 (0.0006) [2023-12-28 08:13:59,524][106225] Updated weights for policy 1, policy_version 1808955 (0.0007) [2023-12-28 08:13:59,541][106226] Updated weights for policy 0, policy_version 1804859 (0.0007) [2023-12-28 08:13:59,598][106226] Updated weights for policy 0, policy_version 1804869 (0.0009) [2023-12-28 08:14:00,201][106225] Updated weights for policy 1, policy_version 1808965 (0.0009) [2023-12-28 08:14:00,243][106226] Updated weights for policy 0, policy_version 1804879 (0.0007) [2023-12-28 08:14:00,249][106225] Updated weights for policy 1, policy_version 1808975 (0.0006) [2023-12-28 08:14:00,305][106226] Updated weights for policy 0, policy_version 1804889 (0.0008) [2023-12-28 08:14:00,307][106225] Updated weights for policy 1, policy_version 1808985 (0.0006) [2023-12-28 08:14:00,366][106226] Updated weights for policy 0, policy_version 1804899 (0.0007) [2023-12-28 08:14:01,073][106225] Updated weights for policy 1, policy_version 1808995 (0.0007) [2023-12-28 08:14:01,107][106226] Updated weights for policy 0, policy_version 1804909 (0.0007) [2023-12-28 08:14:01,134][106225] Updated weights for policy 1, policy_version 1809005 (0.0008) [2023-12-28 08:14:01,169][106226] Updated weights for policy 0, policy_version 1804919 (0.0008) [2023-12-28 08:14:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19883.0). Total num frames: 925294592. Throughput: 0: 10045.3, 1: 9948.4. Samples: 925291616. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:01,175][105115] Avg episode reward: [(0, '-4.592'), (1, '-4.913')] [2023-12-28 08:14:01,197][106225] Updated weights for policy 1, policy_version 1809015 (0.0008) [2023-12-28 08:14:01,227][106226] Updated weights for policy 0, policy_version 1804929 (0.0007) [2023-12-28 08:14:01,934][106225] Updated weights for policy 1, policy_version 1809025 (0.0008) [2023-12-28 08:14:01,949][106226] Updated weights for policy 0, policy_version 1804939 (0.0008) [2023-12-28 08:14:01,998][106225] Updated weights for policy 1, policy_version 1809035 (0.0007) [2023-12-28 08:14:02,010][106226] Updated weights for policy 0, policy_version 1804949 (0.0009) [2023-12-28 08:14:02,054][106225] Updated weights for policy 1, policy_version 1809045 (0.0006) [2023-12-28 08:14:02,068][106226] Updated weights for policy 0, policy_version 1804959 (0.0008) [2023-12-28 08:14:02,111][106225] Updated weights for policy 1, policy_version 1809055 (0.0005) [2023-12-28 08:14:02,801][106225] Updated weights for policy 1, policy_version 1809065 (0.0006) [2023-12-28 08:14:02,812][106226] Updated weights for policy 0, policy_version 1804969 (0.0008) [2023-12-28 08:14:02,858][106225] Updated weights for policy 1, policy_version 1809075 (0.0007) [2023-12-28 08:14:02,869][106226] Updated weights for policy 0, policy_version 1804979 (0.0008) [2023-12-28 08:14:02,916][106225] Updated weights for policy 1, policy_version 1809085 (0.0007) [2023-12-28 08:14:02,918][106226] Updated weights for policy 0, policy_version 1804989 (0.0008) [2023-12-28 08:14:02,976][106226] Updated weights for policy 0, policy_version 1804999 (0.0008) [2023-12-28 08:14:03,524][106225] Updated weights for policy 1, policy_version 1809095 (0.0005) [2023-12-28 08:14:03,579][106225] Updated weights for policy 1, policy_version 1809105 (0.0005) [2023-12-28 08:14:03,643][106225] Updated weights for policy 1, policy_version 1809115 (0.0007) [2023-12-28 08:14:03,735][106226] Updated weights for policy 0, policy_version 1805009 (0.0009) [2023-12-28 08:14:03,794][106226] Updated weights for policy 0, policy_version 1805019 (0.0009) [2023-12-28 08:14:03,855][106226] Updated weights for policy 0, policy_version 1805029 (0.0008) [2023-12-28 08:14:04,303][106225] Updated weights for policy 1, policy_version 1809125 (0.0009) [2023-12-28 08:14:04,365][106225] Updated weights for policy 1, policy_version 1809135 (0.0008) [2023-12-28 08:14:04,424][106225] Updated weights for policy 1, policy_version 1809145 (0.0009) [2023-12-28 08:14:04,489][106226] Updated weights for policy 0, policy_version 1805039 (0.0008) [2023-12-28 08:14:04,550][106226] Updated weights for policy 0, policy_version 1805049 (0.0008) [2023-12-28 08:14:04,603][106226] Updated weights for policy 0, policy_version 1805059 (0.0009) [2023-12-28 08:14:05,190][106225] Updated weights for policy 1, policy_version 1809155 (0.0008) [2023-12-28 08:14:05,240][106225] Updated weights for policy 1, policy_version 1809165 (0.0008) [2023-12-28 08:14:05,247][106226] Updated weights for policy 0, policy_version 1805069 (0.0008) [2023-12-28 08:14:05,302][106225] Updated weights for policy 1, policy_version 1809175 (0.0006) [2023-12-28 08:14:05,307][106226] Updated weights for policy 0, policy_version 1805079 (0.0011) [2023-12-28 08:14:05,354][106226] Updated weights for policy 0, policy_version 1805089 (0.0010) [2023-12-28 08:14:05,995][106226] Updated weights for policy 0, policy_version 1805099 (0.0009) [2023-12-28 08:14:06,046][106226] Updated weights for policy 0, policy_version 1805109 (0.0005) [2023-12-28 08:14:06,073][106225] Updated weights for policy 1, policy_version 1809185 (0.0006) [2023-12-28 08:14:06,106][106226] Updated weights for policy 0, policy_version 1805119 (0.0007) [2023-12-28 08:14:06,133][106225] Updated weights for policy 1, policy_version 1809195 (0.0008) [2023-12-28 08:14:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 20070.4, 300 sec: 19910.7). Total num frames: 925401088. Throughput: 0: 10082.0, 1: 9914.0. Samples: 925411116. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:06,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.829')] [2023-12-28 08:14:06,187][106225] Updated weights for policy 1, policy_version 1809205 (0.0008) [2023-12-28 08:14:06,252][106225] Updated weights for policy 1, policy_version 1809215 (0.0009) [2023-12-28 08:14:06,724][106226] Updated weights for policy 0, policy_version 1805129 (0.0006) [2023-12-28 08:14:06,781][106226] Updated weights for policy 0, policy_version 1805139 (0.0005) [2023-12-28 08:14:06,845][106226] Updated weights for policy 0, policy_version 1805149 (0.0008) [2023-12-28 08:14:06,896][106226] Updated weights for policy 0, policy_version 1805159 (0.0009) [2023-12-28 08:14:07,028][106225] Updated weights for policy 1, policy_version 1809225 (0.0007) [2023-12-28 08:14:07,078][106225] Updated weights for policy 1, policy_version 1809235 (0.0009) [2023-12-28 08:14:07,127][106225] Updated weights for policy 1, policy_version 1809245 (0.0009) [2023-12-28 08:14:07,546][106226] Updated weights for policy 0, policy_version 1805169 (0.0009) [2023-12-28 08:14:07,595][106226] Updated weights for policy 0, policy_version 1805179 (0.0008) [2023-12-28 08:14:07,648][106226] Updated weights for policy 0, policy_version 1805189 (0.0008) [2023-12-28 08:14:07,891][106225] Updated weights for policy 1, policy_version 1809255 (0.0009) [2023-12-28 08:14:07,943][106225] Updated weights for policy 1, policy_version 1809265 (0.0009) [2023-12-28 08:14:07,991][106225] Updated weights for policy 1, policy_version 1809275 (0.0008) [2023-12-28 08:14:08,406][106226] Updated weights for policy 0, policy_version 1805199 (0.0009) [2023-12-28 08:14:08,456][106226] Updated weights for policy 0, policy_version 1805209 (0.0009) [2023-12-28 08:14:08,513][106226] Updated weights for policy 0, policy_version 1805219 (0.0008) [2023-12-28 08:14:08,745][106225] Updated weights for policy 1, policy_version 1809285 (0.0009) [2023-12-28 08:14:08,806][106225] Updated weights for policy 1, policy_version 1809295 (0.0008) [2023-12-28 08:14:08,867][106225] Updated weights for policy 1, policy_version 1809305 (0.0009) [2023-12-28 08:14:09,287][106226] Updated weights for policy 0, policy_version 1805229 (0.0009) [2023-12-28 08:14:09,351][106226] Updated weights for policy 0, policy_version 1805239 (0.0009) [2023-12-28 08:14:09,419][106226] Updated weights for policy 0, policy_version 1805249 (0.0008) [2023-12-28 08:14:09,575][106225] Updated weights for policy 1, policy_version 1809315 (0.0007) [2023-12-28 08:14:09,627][106225] Updated weights for policy 1, policy_version 1809325 (0.0009) [2023-12-28 08:14:09,694][106225] Updated weights for policy 1, policy_version 1809335 (0.0010) [2023-12-28 08:14:10,115][106226] Updated weights for policy 0, policy_version 1805259 (0.0008) [2023-12-28 08:14:10,176][106226] Updated weights for policy 0, policy_version 1805269 (0.0009) [2023-12-28 08:14:10,237][106226] Updated weights for policy 0, policy_version 1805279 (0.0009) [2023-12-28 08:14:10,452][106225] Updated weights for policy 1, policy_version 1809345 (0.0010) [2023-12-28 08:14:10,516][106225] Updated weights for policy 1, policy_version 1809355 (0.0009) [2023-12-28 08:14:10,570][106225] Updated weights for policy 1, policy_version 1809365 (0.0009) [2023-12-28 08:14:10,618][106225] Updated weights for policy 1, policy_version 1809375 (0.0009) [2023-12-28 08:14:10,990][106226] Updated weights for policy 0, policy_version 1805289 (0.0009) [2023-12-28 08:14:11,060][106226] Updated weights for policy 0, policy_version 1805299 (0.0008) [2023-12-28 08:14:11,135][106226] Updated weights for policy 0, policy_version 1805309 (0.0008) [2023-12-28 08:14:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 925491200. Throughput: 0: 10093.7, 1: 9870.2. Samples: 925468988. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:11,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.644')] [2023-12-28 08:14:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001809376_463257600.pth... [2023-12-28 08:14:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001808256_462970880.pth [2023-12-28 08:14:11,200][106226] Updated weights for policy 0, policy_version 1805319 (0.0008) [2023-12-28 08:14:11,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001805320_462241792.pth... [2023-12-28 08:14:11,211][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001804136_461938688.pth [2023-12-28 08:14:11,432][106225] Updated weights for policy 1, policy_version 1809385 (0.0009) [2023-12-28 08:14:11,487][106225] Updated weights for policy 1, policy_version 1809395 (0.0006) [2023-12-28 08:14:11,556][106225] Updated weights for policy 1, policy_version 1809405 (0.0006) [2023-12-28 08:14:11,958][106226] Updated weights for policy 0, policy_version 1805329 (0.0007) [2023-12-28 08:14:12,020][106226] Updated weights for policy 0, policy_version 1805339 (0.0007) [2023-12-28 08:14:12,082][106226] Updated weights for policy 0, policy_version 1805349 (0.0009) [2023-12-28 08:14:12,221][106225] Updated weights for policy 1, policy_version 1809415 (0.0006) [2023-12-28 08:14:12,293][106225] Updated weights for policy 1, policy_version 1809425 (0.0009) [2023-12-28 08:14:12,363][106225] Updated weights for policy 1, policy_version 1809435 (0.0008) [2023-12-28 08:14:12,819][106226] Updated weights for policy 0, policy_version 1805359 (0.0010) [2023-12-28 08:14:12,878][106226] Updated weights for policy 0, policy_version 1805369 (0.0008) [2023-12-28 08:14:12,948][106226] Updated weights for policy 0, policy_version 1805379 (0.0008) [2023-12-28 08:14:13,114][106225] Updated weights for policy 1, policy_version 1809445 (0.0008) [2023-12-28 08:14:13,180][106225] Updated weights for policy 1, policy_version 1809455 (0.0008) [2023-12-28 08:14:13,245][106225] Updated weights for policy 1, policy_version 1809465 (0.0009) [2023-12-28 08:14:13,751][106226] Updated weights for policy 0, policy_version 1805389 (0.0010) [2023-12-28 08:14:13,821][106226] Updated weights for policy 0, policy_version 1805399 (0.0011) [2023-12-28 08:14:13,827][106225] Updated weights for policy 1, policy_version 1809475 (0.0008) [2023-12-28 08:14:13,882][106226] Updated weights for policy 0, policy_version 1805409 (0.0011) [2023-12-28 08:14:13,894][106225] Updated weights for policy 1, policy_version 1809485 (0.0005) [2023-12-28 08:14:13,947][106225] Updated weights for policy 1, policy_version 1809495 (0.0008) [2023-12-28 08:14:14,532][106226] Updated weights for policy 0, policy_version 1805419 (0.0010) [2023-12-28 08:14:14,583][106226] Updated weights for policy 0, policy_version 1805429 (0.0009) [2023-12-28 08:14:14,626][106225] Updated weights for policy 1, policy_version 1809505 (0.0008) [2023-12-28 08:14:14,640][106226] Updated weights for policy 0, policy_version 1805439 (0.0005) [2023-12-28 08:14:14,688][106225] Updated weights for policy 1, policy_version 1809515 (0.0006) [2023-12-28 08:14:14,741][106225] Updated weights for policy 1, policy_version 1809525 (0.0006) [2023-12-28 08:14:14,805][106225] Updated weights for policy 1, policy_version 1809535 (0.0011) [2023-12-28 08:14:15,325][106226] Updated weights for policy 0, policy_version 1805449 (0.0005) [2023-12-28 08:14:15,383][106226] Updated weights for policy 0, policy_version 1805459 (0.0007) [2023-12-28 08:14:15,441][106226] Updated weights for policy 0, policy_version 1805469 (0.0007) [2023-12-28 08:14:15,499][106226] Updated weights for policy 0, policy_version 1805479 (0.0006) [2023-12-28 08:14:15,536][106225] Updated weights for policy 1, policy_version 1809545 (0.0010) [2023-12-28 08:14:15,595][106225] Updated weights for policy 1, policy_version 1809555 (0.0010) [2023-12-28 08:14:15,658][106225] Updated weights for policy 1, policy_version 1809565 (0.0010) [2023-12-28 08:14:16,104][106226] Updated weights for policy 0, policy_version 1805489 (0.0006) [2023-12-28 08:14:16,168][106226] Updated weights for policy 0, policy_version 1805499 (0.0006) [2023-12-28 08:14:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 925589504. Throughput: 0: 9964.0, 1: 9804.9. Samples: 925584176. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:16,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.738')] [2023-12-28 08:14:16,220][106226] Updated weights for policy 0, policy_version 1805509 (0.0007) [2023-12-28 08:14:16,381][106225] Updated weights for policy 1, policy_version 1809575 (0.0008) [2023-12-28 08:14:16,438][106225] Updated weights for policy 1, policy_version 1809585 (0.0010) [2023-12-28 08:14:16,496][106225] Updated weights for policy 1, policy_version 1809595 (0.0010) [2023-12-28 08:14:16,968][106226] Updated weights for policy 0, policy_version 1805519 (0.0009) [2023-12-28 08:14:17,022][106226] Updated weights for policy 0, policy_version 1805529 (0.0009) [2023-12-28 08:14:17,080][106226] Updated weights for policy 0, policy_version 1805539 (0.0008) [2023-12-28 08:14:17,139][106225] Updated weights for policy 1, policy_version 1809605 (0.0010) [2023-12-28 08:14:17,199][106225] Updated weights for policy 1, policy_version 1809615 (0.0010) [2023-12-28 08:14:17,263][106225] Updated weights for policy 1, policy_version 1809625 (0.0010) [2023-12-28 08:14:17,728][106226] Updated weights for policy 0, policy_version 1805549 (0.0007) [2023-12-28 08:14:17,785][106226] Updated weights for policy 0, policy_version 1805559 (0.0009) [2023-12-28 08:14:17,841][106226] Updated weights for policy 0, policy_version 1805569 (0.0008) [2023-12-28 08:14:17,890][106225] Updated weights for policy 1, policy_version 1809635 (0.0009) [2023-12-28 08:14:17,941][106225] Updated weights for policy 1, policy_version 1809645 (0.0005) [2023-12-28 08:14:17,993][106225] Updated weights for policy 1, policy_version 1809655 (0.0006) [2023-12-28 08:14:18,568][106226] Updated weights for policy 0, policy_version 1805579 (0.0007) [2023-12-28 08:14:18,631][106226] Updated weights for policy 0, policy_version 1805589 (0.0005) [2023-12-28 08:14:18,671][106225] Updated weights for policy 1, policy_version 1809665 (0.0008) [2023-12-28 08:14:18,698][106226] Updated weights for policy 0, policy_version 1805599 (0.0008) [2023-12-28 08:14:18,732][106225] Updated weights for policy 1, policy_version 1809675 (0.0006) [2023-12-28 08:14:18,793][106225] Updated weights for policy 1, policy_version 1809685 (0.0008) [2023-12-28 08:14:18,847][106225] Updated weights for policy 1, policy_version 1809695 (0.0008) [2023-12-28 08:14:19,403][106226] Updated weights for policy 0, policy_version 1805609 (0.0009) [2023-12-28 08:14:19,470][106226] Updated weights for policy 0, policy_version 1805619 (0.0007) [2023-12-28 08:14:19,472][106225] Updated weights for policy 1, policy_version 1809705 (0.0007) [2023-12-28 08:14:19,537][106226] Updated weights for policy 0, policy_version 1805629 (0.0009) [2023-12-28 08:14:19,537][106225] Updated weights for policy 1, policy_version 1809715 (0.0009) [2023-12-28 08:14:19,601][106226] Updated weights for policy 0, policy_version 1805639 (0.0007) [2023-12-28 08:14:19,603][106225] Updated weights for policy 1, policy_version 1809725 (0.0009) [2023-12-28 08:14:20,279][106226] Updated weights for policy 0, policy_version 1805649 (0.0007) [2023-12-28 08:14:20,306][106225] Updated weights for policy 1, policy_version 1809735 (0.0008) [2023-12-28 08:14:20,340][106226] Updated weights for policy 0, policy_version 1805659 (0.0007) [2023-12-28 08:14:20,364][106225] Updated weights for policy 1, policy_version 1809745 (0.0007) [2023-12-28 08:14:20,416][106226] Updated weights for policy 0, policy_version 1805669 (0.0006) [2023-12-28 08:14:20,429][106225] Updated weights for policy 1, policy_version 1809755 (0.0007) [2023-12-28 08:14:21,134][106226] Updated weights for policy 0, policy_version 1805679 (0.0009) [2023-12-28 08:14:21,153][106225] Updated weights for policy 1, policy_version 1809765 (0.0009) [2023-12-28 08:14:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 925687808. Throughput: 0: 9911.4, 1: 9846.5. Samples: 925704884. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:21,175][105115] Avg episode reward: [(0, '-4.347'), (1, '-4.941')] [2023-12-28 08:14:21,202][106226] Updated weights for policy 0, policy_version 1805689 (0.0007) [2023-12-28 08:14:21,212][106225] Updated weights for policy 1, policy_version 1809775 (0.0007) [2023-12-28 08:14:21,264][106226] Updated weights for policy 0, policy_version 1805699 (0.0007) [2023-12-28 08:14:21,277][106225] Updated weights for policy 1, policy_version 1809785 (0.0007) [2023-12-28 08:14:21,986][106226] Updated weights for policy 0, policy_version 1805709 (0.0008) [2023-12-28 08:14:22,026][106225] Updated weights for policy 1, policy_version 1809795 (0.0007) [2023-12-28 08:14:22,053][106226] Updated weights for policy 0, policy_version 1805719 (0.0008) [2023-12-28 08:14:22,087][106225] Updated weights for policy 1, policy_version 1809805 (0.0008) [2023-12-28 08:14:22,114][106226] Updated weights for policy 0, policy_version 1805729 (0.0008) [2023-12-28 08:14:22,140][106225] Updated weights for policy 1, policy_version 1809815 (0.0007) [2023-12-28 08:14:22,872][106226] Updated weights for policy 0, policy_version 1805739 (0.0007) [2023-12-28 08:14:22,904][106225] Updated weights for policy 1, policy_version 1809825 (0.0008) [2023-12-28 08:14:22,929][106226] Updated weights for policy 0, policy_version 1805749 (0.0008) [2023-12-28 08:14:22,963][106225] Updated weights for policy 1, policy_version 1809835 (0.0007) [2023-12-28 08:14:22,984][106226] Updated weights for policy 0, policy_version 1805759 (0.0007) [2023-12-28 08:14:23,018][106225] Updated weights for policy 1, policy_version 1809845 (0.0007) [2023-12-28 08:14:23,072][106225] Updated weights for policy 1, policy_version 1809855 (0.0006) [2023-12-28 08:14:23,629][106225] Updated weights for policy 1, policy_version 1809865 (0.0005) [2023-12-28 08:14:23,686][106225] Updated weights for policy 1, policy_version 1809875 (0.0005) [2023-12-28 08:14:23,743][106225] Updated weights for policy 1, policy_version 1809885 (0.0005) [2023-12-28 08:14:23,815][106226] Updated weights for policy 0, policy_version 1805769 (0.0008) [2023-12-28 08:14:23,862][106226] Updated weights for policy 0, policy_version 1805779 (0.0008) [2023-12-28 08:14:23,906][106226] Updated weights for policy 0, policy_version 1805789 (0.0008) [2023-12-28 08:14:23,958][106226] Updated weights for policy 0, policy_version 1805799 (0.0009) [2023-12-28 08:14:24,370][106225] Updated weights for policy 1, policy_version 1809895 (0.0009) [2023-12-28 08:14:24,420][106225] Updated weights for policy 1, policy_version 1809905 (0.0008) [2023-12-28 08:14:24,475][106225] Updated weights for policy 1, policy_version 1809915 (0.0009) [2023-12-28 08:14:24,740][106226] Updated weights for policy 0, policy_version 1805809 (0.0010) [2023-12-28 08:14:24,804][106226] Updated weights for policy 0, policy_version 1805819 (0.0009) [2023-12-28 08:14:24,853][106226] Updated weights for policy 0, policy_version 1805829 (0.0007) [2023-12-28 08:14:25,076][106225] Updated weights for policy 1, policy_version 1809925 (0.0007) [2023-12-28 08:14:25,123][106225] Updated weights for policy 1, policy_version 1809935 (0.0007) [2023-12-28 08:14:25,182][106225] Updated weights for policy 1, policy_version 1809945 (0.0009) [2023-12-28 08:14:25,603][106226] Updated weights for policy 0, policy_version 1805839 (0.0009) [2023-12-28 08:14:25,655][106226] Updated weights for policy 0, policy_version 1805849 (0.0008) [2023-12-28 08:14:25,702][106226] Updated weights for policy 0, policy_version 1805859 (0.0008) [2023-12-28 08:14:25,878][106225] Updated weights for policy 1, policy_version 1809955 (0.0009) [2023-12-28 08:14:25,933][106225] Updated weights for policy 1, policy_version 1809965 (0.0008) [2023-12-28 08:14:25,984][106225] Updated weights for policy 1, policy_version 1809975 (0.0008) [2023-12-28 08:14:26,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19882.9). Total num frames: 925794304. Throughput: 0: 9866.3, 1: 9870.4. Samples: 925762232. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-28 08:14:26,176][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.694')] [2023-12-28 08:14:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001809984_463413248.pth... [2023-12-28 08:14:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001805864_462381056.pth... [2023-12-28 08:14:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001804744_462094336.pth [2023-12-28 08:14:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001808832_463118336.pth [2023-12-28 08:14:26,459][106226] Updated weights for policy 0, policy_version 1805869 (0.0008) [2023-12-28 08:14:26,519][106226] Updated weights for policy 0, policy_version 1805879 (0.0008) [2023-12-28 08:14:26,581][106226] Updated weights for policy 0, policy_version 1805889 (0.0009) [2023-12-28 08:14:26,633][106225] Updated weights for policy 1, policy_version 1809985 (0.0005) [2023-12-28 08:14:26,682][106225] Updated weights for policy 1, policy_version 1809995 (0.0008) [2023-12-28 08:14:26,728][106225] Updated weights for policy 1, policy_version 1810005 (0.0009) [2023-12-28 08:14:26,775][106225] Updated weights for policy 1, policy_version 1810015 (0.0008) [2023-12-28 08:14:27,280][106226] Updated weights for policy 0, policy_version 1805899 (0.0008) [2023-12-28 08:14:27,341][106226] Updated weights for policy 0, policy_version 1805909 (0.0010) [2023-12-28 08:14:27,390][106226] Updated weights for policy 0, policy_version 1805919 (0.0007) [2023-12-28 08:14:27,487][106225] Updated weights for policy 1, policy_version 1810025 (0.0006) [2023-12-28 08:14:27,532][106225] Updated weights for policy 1, policy_version 1810035 (0.0005) [2023-12-28 08:14:27,586][106225] Updated weights for policy 1, policy_version 1810045 (0.0005) [2023-12-28 08:14:28,097][106226] Updated weights for policy 0, policy_version 1805929 (0.0010) [2023-12-28 08:14:28,157][106226] Updated weights for policy 0, policy_version 1805939 (0.0005) [2023-12-28 08:14:28,186][106225] Updated weights for policy 1, policy_version 1810055 (0.0005) [2023-12-28 08:14:28,207][106226] Updated weights for policy 0, policy_version 1805949 (0.0005) [2023-12-28 08:14:28,235][106225] Updated weights for policy 1, policy_version 1810065 (0.0005) [2023-12-28 08:14:28,260][106226] Updated weights for policy 0, policy_version 1805959 (0.0008) [2023-12-28 08:14:28,281][106225] Updated weights for policy 1, policy_version 1810075 (0.0005) [2023-12-28 08:14:28,961][106226] Updated weights for policy 0, policy_version 1805969 (0.0009) [2023-12-28 08:14:28,964][106225] Updated weights for policy 1, policy_version 1810085 (0.0008) [2023-12-28 08:14:29,017][106225] Updated weights for policy 1, policy_version 1810095 (0.0008) [2023-12-28 08:14:29,018][106226] Updated weights for policy 0, policy_version 1805979 (0.0008) [2023-12-28 08:14:29,076][106226] Updated weights for policy 0, policy_version 1805989 (0.0007) [2023-12-28 08:14:29,077][106225] Updated weights for policy 1, policy_version 1810105 (0.0006) [2023-12-28 08:14:29,805][106225] Updated weights for policy 1, policy_version 1810115 (0.0007) [2023-12-28 08:14:29,828][106226] Updated weights for policy 0, policy_version 1805999 (0.0008) [2023-12-28 08:14:29,867][106225] Updated weights for policy 1, policy_version 1810125 (0.0008) [2023-12-28 08:14:29,896][106226] Updated weights for policy 0, policy_version 1806009 (0.0009) [2023-12-28 08:14:29,922][106225] Updated weights for policy 1, policy_version 1810135 (0.0006) [2023-12-28 08:14:29,964][106226] Updated weights for policy 0, policy_version 1806019 (0.0008) [2023-12-28 08:14:30,552][106226] Updated weights for policy 0, policy_version 1806029 (0.0007) [2023-12-28 08:14:30,608][106226] Updated weights for policy 0, policy_version 1806039 (0.0006) [2023-12-28 08:14:30,667][106226] Updated weights for policy 0, policy_version 1806049 (0.0006) [2023-12-28 08:14:30,689][106225] Updated weights for policy 1, policy_version 1810145 (0.0006) [2023-12-28 08:14:30,743][106225] Updated weights for policy 1, policy_version 1810155 (0.0008) [2023-12-28 08:14:30,801][106225] Updated weights for policy 1, policy_version 1810165 (0.0007) [2023-12-28 08:14:30,859][106225] Updated weights for policy 1, policy_version 1810175 (0.0005) [2023-12-28 08:14:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 925892608. Throughput: 0: 9878.7, 1: 9928.5. Samples: 925882640. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:31,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-5.152')] [2023-12-28 08:14:31,346][106226] Updated weights for policy 0, policy_version 1806059 (0.0008) [2023-12-28 08:14:31,414][106226] Updated weights for policy 0, policy_version 1806069 (0.0010) [2023-12-28 08:14:31,465][106226] Updated weights for policy 0, policy_version 1806079 (0.0011) [2023-12-28 08:14:31,522][106225] Updated weights for policy 1, policy_version 1810185 (0.0008) [2023-12-28 08:14:31,579][106225] Updated weights for policy 1, policy_version 1810195 (0.0009) [2023-12-28 08:14:31,648][106225] Updated weights for policy 1, policy_version 1810205 (0.0010) [2023-12-28 08:14:32,220][106226] Updated weights for policy 0, policy_version 1806089 (0.0008) [2023-12-28 08:14:32,285][106226] Updated weights for policy 0, policy_version 1806099 (0.0011) [2023-12-28 08:14:32,349][106226] Updated weights for policy 0, policy_version 1806109 (0.0011) [2023-12-28 08:14:32,377][106225] Updated weights for policy 1, policy_version 1810215 (0.0009) [2023-12-28 08:14:32,411][106226] Updated weights for policy 0, policy_version 1806119 (0.0010) [2023-12-28 08:14:32,432][106225] Updated weights for policy 1, policy_version 1810225 (0.0005) [2023-12-28 08:14:32,481][106225] Updated weights for policy 1, policy_version 1810235 (0.0005) [2023-12-28 08:14:33,090][106226] Updated weights for policy 0, policy_version 1806129 (0.0007) [2023-12-28 08:14:33,143][106226] Updated weights for policy 0, policy_version 1806139 (0.0006) [2023-12-28 08:14:33,154][106225] Updated weights for policy 1, policy_version 1810245 (0.0008) [2023-12-28 08:14:33,199][106226] Updated weights for policy 0, policy_version 1806149 (0.0005) [2023-12-28 08:14:33,200][106225] Updated weights for policy 1, policy_version 1810255 (0.0010) [2023-12-28 08:14:33,256][106225] Updated weights for policy 1, policy_version 1810265 (0.0010) [2023-12-28 08:14:33,900][106225] Updated weights for policy 1, policy_version 1810275 (0.0009) [2023-12-28 08:14:33,927][106226] Updated weights for policy 0, policy_version 1806159 (0.0007) [2023-12-28 08:14:33,952][106225] Updated weights for policy 1, policy_version 1810285 (0.0005) [2023-12-28 08:14:33,985][106226] Updated weights for policy 0, policy_version 1806169 (0.0008) [2023-12-28 08:14:34,009][106225] Updated weights for policy 1, policy_version 1810295 (0.0008) [2023-12-28 08:14:34,043][106226] Updated weights for policy 0, policy_version 1806179 (0.0007) [2023-12-28 08:14:34,709][106225] Updated weights for policy 1, policy_version 1810305 (0.0006) [2023-12-28 08:14:34,769][106225] Updated weights for policy 1, policy_version 1810315 (0.0008) [2023-12-28 08:14:34,802][106226] Updated weights for policy 0, policy_version 1806189 (0.0007) [2023-12-28 08:14:34,826][106225] Updated weights for policy 1, policy_version 1810325 (0.0010) [2023-12-28 08:14:34,860][106226] Updated weights for policy 0, policy_version 1806199 (0.0006) [2023-12-28 08:14:34,886][106225] Updated weights for policy 1, policy_version 1810335 (0.0008) [2023-12-28 08:14:34,912][106226] Updated weights for policy 0, policy_version 1806209 (0.0009) [2023-12-28 08:14:35,574][106225] Updated weights for policy 1, policy_version 1810345 (0.0008) [2023-12-28 08:14:35,626][106226] Updated weights for policy 0, policy_version 1806219 (0.0008) [2023-12-28 08:14:35,636][106225] Updated weights for policy 1, policy_version 1810355 (0.0008) [2023-12-28 08:14:35,677][106226] Updated weights for policy 0, policy_version 1806229 (0.0007) [2023-12-28 08:14:35,688][106225] Updated weights for policy 1, policy_version 1810365 (0.0006) [2023-12-28 08:14:35,726][106226] Updated weights for policy 0, policy_version 1806239 (0.0007) [2023-12-28 08:14:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 925990912. Throughput: 0: 9831.7, 1: 10001.9. Samples: 926001072. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:36,175][105115] Avg episode reward: [(0, '-4.227'), (1, '-4.564')] [2023-12-28 08:14:36,336][106225] Updated weights for policy 1, policy_version 1810375 (0.0008) [2023-12-28 08:14:36,400][106225] Updated weights for policy 1, policy_version 1810385 (0.0007) [2023-12-28 08:14:36,464][106225] Updated weights for policy 1, policy_version 1810395 (0.0008) [2023-12-28 08:14:36,526][106226] Updated weights for policy 0, policy_version 1806249 (0.0008) [2023-12-28 08:14:36,582][106226] Updated weights for policy 0, policy_version 1806259 (0.0010) [2023-12-28 08:14:36,634][106226] Updated weights for policy 0, policy_version 1806269 (0.0005) [2023-12-28 08:14:36,681][106226] Updated weights for policy 0, policy_version 1806279 (0.0005) [2023-12-28 08:14:37,053][106225] Updated weights for policy 1, policy_version 1810405 (0.0007) [2023-12-28 08:14:37,107][106225] Updated weights for policy 1, policy_version 1810415 (0.0005) [2023-12-28 08:14:37,159][106225] Updated weights for policy 1, policy_version 1810425 (0.0005) [2023-12-28 08:14:37,461][106226] Updated weights for policy 0, policy_version 1806289 (0.0008) [2023-12-28 08:14:37,510][106226] Updated weights for policy 0, policy_version 1806299 (0.0008) [2023-12-28 08:14:37,558][106226] Updated weights for policy 0, policy_version 1806309 (0.0009) [2023-12-28 08:14:37,723][106225] Updated weights for policy 1, policy_version 1810435 (0.0006) [2023-12-28 08:14:37,781][106225] Updated weights for policy 1, policy_version 1810445 (0.0006) [2023-12-28 08:14:37,836][106225] Updated weights for policy 1, policy_version 1810455 (0.0005) [2023-12-28 08:14:38,395][106226] Updated weights for policy 0, policy_version 1806319 (0.0008) [2023-12-28 08:14:38,416][106225] Updated weights for policy 1, policy_version 1810465 (0.0006) [2023-12-28 08:14:38,455][106226] Updated weights for policy 0, policy_version 1806329 (0.0006) [2023-12-28 08:14:38,474][106225] Updated weights for policy 1, policy_version 1810475 (0.0008) [2023-12-28 08:14:38,517][106226] Updated weights for policy 0, policy_version 1806339 (0.0007) [2023-12-28 08:14:38,540][106225] Updated weights for policy 1, policy_version 1810485 (0.0008) [2023-12-28 08:14:38,595][106225] Updated weights for policy 1, policy_version 1810495 (0.0008) [2023-12-28 08:14:39,227][106226] Updated weights for policy 0, policy_version 1806349 (0.0007) [2023-12-28 08:14:39,292][106226] Updated weights for policy 0, policy_version 1806359 (0.0006) [2023-12-28 08:14:39,356][106226] Updated weights for policy 0, policy_version 1806369 (0.0007) [2023-12-28 08:14:39,356][106225] Updated weights for policy 1, policy_version 1810505 (0.0008) [2023-12-28 08:14:39,425][106225] Updated weights for policy 1, policy_version 1810515 (0.0008) [2023-12-28 08:14:39,485][106225] Updated weights for policy 1, policy_version 1810525 (0.0007) [2023-12-28 08:14:40,062][106226] Updated weights for policy 0, policy_version 1806379 (0.0009) [2023-12-28 08:14:40,123][106226] Updated weights for policy 0, policy_version 1806389 (0.0009) [2023-12-28 08:14:40,184][106226] Updated weights for policy 0, policy_version 1806399 (0.0009) [2023-12-28 08:14:40,231][106225] Updated weights for policy 1, policy_version 1810535 (0.0007) [2023-12-28 08:14:40,298][106225] Updated weights for policy 1, policy_version 1810545 (0.0009) [2023-12-28 08:14:40,365][106225] Updated weights for policy 1, policy_version 1810555 (0.0010) [2023-12-28 08:14:40,767][106226] Updated weights for policy 0, policy_version 1806409 (0.0006) [2023-12-28 08:14:40,816][106226] Updated weights for policy 0, policy_version 1806419 (0.0005) [2023-12-28 08:14:40,871][106226] Updated weights for policy 0, policy_version 1806429 (0.0009) [2023-12-28 08:14:40,921][106226] Updated weights for policy 0, policy_version 1806439 (0.0008) [2023-12-28 08:14:41,095][106225] Updated weights for policy 1, policy_version 1810565 (0.0010) [2023-12-28 08:14:41,162][106225] Updated weights for policy 1, policy_version 1810575 (0.0009) [2023-12-28 08:14:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 926089216. Throughput: 0: 9762.4, 1: 10080.9. Samples: 926061908. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:41,175][105115] Avg episode reward: [(0, '-4.529'), (1, '-4.878')] [2023-12-28 08:14:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001806440_462528512.pth... [2023-12-28 08:14:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001805320_462241792.pth [2023-12-28 08:14:41,224][106225] Updated weights for policy 1, policy_version 1810585 (0.0009) [2023-12-28 08:14:41,277][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001810592_463568896.pth... [2023-12-28 08:14:41,281][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001809376_463257600.pth [2023-12-28 08:14:41,745][106226] Updated weights for policy 0, policy_version 1806449 (0.0009) [2023-12-28 08:14:41,829][106226] Updated weights for policy 0, policy_version 1806459 (0.0009) [2023-12-28 08:14:41,901][106226] Updated weights for policy 0, policy_version 1806469 (0.0009) [2023-12-28 08:14:41,944][106225] Updated weights for policy 1, policy_version 1810595 (0.0007) [2023-12-28 08:14:42,007][106225] Updated weights for policy 1, policy_version 1810605 (0.0008) [2023-12-28 08:14:42,073][106225] Updated weights for policy 1, policy_version 1810615 (0.0010) [2023-12-28 08:14:42,648][106226] Updated weights for policy 0, policy_version 1806479 (0.0009) [2023-12-28 08:14:42,709][106226] Updated weights for policy 0, policy_version 1806489 (0.0008) [2023-12-28 08:14:42,769][106226] Updated weights for policy 0, policy_version 1806499 (0.0008) [2023-12-28 08:14:42,782][106225] Updated weights for policy 1, policy_version 1810625 (0.0008) [2023-12-28 08:14:42,839][106225] Updated weights for policy 1, policy_version 1810635 (0.0006) [2023-12-28 08:14:42,896][106225] Updated weights for policy 1, policy_version 1810645 (0.0006) [2023-12-28 08:14:42,951][106225] Updated weights for policy 1, policy_version 1810655 (0.0010) [2023-12-28 08:14:43,554][106226] Updated weights for policy 0, policy_version 1806509 (0.0006) [2023-12-28 08:14:43,563][106225] Updated weights for policy 1, policy_version 1810665 (0.0010) [2023-12-28 08:14:43,603][106226] Updated weights for policy 0, policy_version 1806519 (0.0008) [2023-12-28 08:14:43,613][106225] Updated weights for policy 1, policy_version 1810675 (0.0010) [2023-12-28 08:14:43,657][106226] Updated weights for policy 0, policy_version 1806529 (0.0005) [2023-12-28 08:14:43,666][106225] Updated weights for policy 1, policy_version 1810685 (0.0010) [2023-12-28 08:14:44,333][106225] Updated weights for policy 1, policy_version 1810695 (0.0008) [2023-12-28 08:14:44,382][106225] Updated weights for policy 1, policy_version 1810705 (0.0010) [2023-12-28 08:14:44,434][106226] Updated weights for policy 0, policy_version 1806539 (0.0007) [2023-12-28 08:14:44,444][106225] Updated weights for policy 1, policy_version 1810715 (0.0010) [2023-12-28 08:14:44,486][106226] Updated weights for policy 0, policy_version 1806549 (0.0007) [2023-12-28 08:14:44,541][106226] Updated weights for policy 0, policy_version 1806559 (0.0005) [2023-12-28 08:14:45,181][106225] Updated weights for policy 1, policy_version 1810725 (0.0010) [2023-12-28 08:14:45,220][106226] Updated weights for policy 0, policy_version 1806569 (0.0005) [2023-12-28 08:14:45,244][106225] Updated weights for policy 1, policy_version 1810735 (0.0008) [2023-12-28 08:14:45,287][106226] Updated weights for policy 0, policy_version 1806579 (0.0007) [2023-12-28 08:14:45,307][106225] Updated weights for policy 1, policy_version 1810745 (0.0008) [2023-12-28 08:14:45,348][106226] Updated weights for policy 0, policy_version 1806589 (0.0006) [2023-12-28 08:14:45,400][106226] Updated weights for policy 0, policy_version 1806599 (0.0008) [2023-12-28 08:14:45,946][106226] Updated weights for policy 0, policy_version 1806609 (0.0005) [2023-12-28 08:14:45,946][106225] Updated weights for policy 1, policy_version 1810755 (0.0007) [2023-12-28 08:14:46,002][106225] Updated weights for policy 1, policy_version 1810765 (0.0010) [2023-12-28 08:14:46,008][106226] Updated weights for policy 0, policy_version 1806619 (0.0005) [2023-12-28 08:14:46,049][106225] Updated weights for policy 1, policy_version 1810775 (0.0010) [2023-12-28 08:14:46,059][106226] Updated weights for policy 0, policy_version 1806629 (0.0005) [2023-12-28 08:14:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19910.7). Total num frames: 926195712. Throughput: 0: 9653.8, 1: 10024.1. Samples: 926177124. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:46,176][105115] Avg episode reward: [(0, '-4.163'), (1, '-4.887')] [2023-12-28 08:14:46,737][106226] Updated weights for policy 0, policy_version 1806639 (0.0009) [2023-12-28 08:14:46,777][106225] Updated weights for policy 1, policy_version 1810785 (0.0010) [2023-12-28 08:14:46,791][106226] Updated weights for policy 0, policy_version 1806649 (0.0010) [2023-12-28 08:14:46,827][106225] Updated weights for policy 1, policy_version 1810795 (0.0010) [2023-12-28 08:14:46,841][106226] Updated weights for policy 0, policy_version 1806659 (0.0010) [2023-12-28 08:14:46,879][106225] Updated weights for policy 1, policy_version 1810805 (0.0006) [2023-12-28 08:14:46,947][106225] Updated weights for policy 1, policy_version 1810815 (0.0008) [2023-12-28 08:14:47,523][106226] Updated weights for policy 0, policy_version 1806669 (0.0008) [2023-12-28 08:14:47,590][106226] Updated weights for policy 0, policy_version 1806679 (0.0006) [2023-12-28 08:14:47,653][106226] Updated weights for policy 0, policy_version 1806689 (0.0007) [2023-12-28 08:14:47,666][106225] Updated weights for policy 1, policy_version 1810825 (0.0010) [2023-12-28 08:14:47,728][106225] Updated weights for policy 1, policy_version 1810835 (0.0010) [2023-12-28 08:14:47,799][106225] Updated weights for policy 1, policy_version 1810845 (0.0010) [2023-12-28 08:14:48,238][106226] Updated weights for policy 0, policy_version 1806699 (0.0006) [2023-12-28 08:14:48,293][106226] Updated weights for policy 0, policy_version 1806709 (0.0005) [2023-12-28 08:14:48,369][106226] Updated weights for policy 0, policy_version 1806719 (0.0007) [2023-12-28 08:14:48,391][106225] Updated weights for policy 1, policy_version 1810855 (0.0009) [2023-12-28 08:14:48,454][106225] Updated weights for policy 1, policy_version 1810865 (0.0009) [2023-12-28 08:14:48,513][106225] Updated weights for policy 1, policy_version 1810875 (0.0010) [2023-12-28 08:14:49,021][106226] Updated weights for policy 0, policy_version 1806729 (0.0007) [2023-12-28 08:14:49,074][106226] Updated weights for policy 0, policy_version 1806739 (0.0010) [2023-12-28 08:14:49,133][106226] Updated weights for policy 0, policy_version 1806749 (0.0010) [2023-12-28 08:14:49,189][106226] Updated weights for policy 0, policy_version 1806759 (0.0010) [2023-12-28 08:14:49,251][106225] Updated weights for policy 1, policy_version 1810885 (0.0009) [2023-12-28 08:14:49,316][106225] Updated weights for policy 1, policy_version 1810895 (0.0007) [2023-12-28 08:14:49,381][106225] Updated weights for policy 1, policy_version 1810905 (0.0009) [2023-12-28 08:14:49,970][106226] Updated weights for policy 0, policy_version 1806769 (0.0009) [2023-12-28 08:14:50,036][106226] Updated weights for policy 0, policy_version 1806779 (0.0009) [2023-12-28 08:14:50,086][106225] Updated weights for policy 1, policy_version 1810915 (0.0008) [2023-12-28 08:14:50,100][106226] Updated weights for policy 0, policy_version 1806789 (0.0006) [2023-12-28 08:14:50,150][106225] Updated weights for policy 1, policy_version 1810925 (0.0005) [2023-12-28 08:14:50,214][106225] Updated weights for policy 1, policy_version 1810935 (0.0006) [2023-12-28 08:14:50,785][106225] Updated weights for policy 1, policy_version 1810945 (0.0009) [2023-12-28 08:14:50,848][106225] Updated weights for policy 1, policy_version 1810955 (0.0011) [2023-12-28 08:14:50,848][106226] Updated weights for policy 0, policy_version 1806799 (0.0008) [2023-12-28 08:14:50,914][106225] Updated weights for policy 1, policy_version 1810965 (0.0010) [2023-12-28 08:14:50,915][106226] Updated weights for policy 0, policy_version 1806809 (0.0006) [2023-12-28 08:14:50,970][106225] Updated weights for policy 1, policy_version 1810975 (0.0008) [2023-12-28 08:14:50,980][106226] Updated weights for policy 0, policy_version 1806819 (0.0007) [2023-12-28 08:14:51,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19910.7). Total num frames: 926294016. Throughput: 0: 9677.9, 1: 10059.5. Samples: 926299296. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:51,175][105115] Avg episode reward: [(0, '-4.261'), (1, '-4.782')] [2023-12-28 08:14:51,760][106226] Updated weights for policy 0, policy_version 1806829 (0.0009) [2023-12-28 08:14:51,794][106225] Updated weights for policy 1, policy_version 1810985 (0.0010) [2023-12-28 08:14:51,823][106226] Updated weights for policy 0, policy_version 1806839 (0.0008) [2023-12-28 08:14:51,852][106225] Updated weights for policy 1, policy_version 1810995 (0.0010) [2023-12-28 08:14:51,882][106226] Updated weights for policy 0, policy_version 1806849 (0.0006) [2023-12-28 08:14:51,914][106225] Updated weights for policy 1, policy_version 1811005 (0.0010) [2023-12-28 08:14:52,573][106225] Updated weights for policy 1, policy_version 1811015 (0.0009) [2023-12-28 08:14:52,623][106226] Updated weights for policy 0, policy_version 1806859 (0.0007) [2023-12-28 08:14:52,627][106225] Updated weights for policy 1, policy_version 1811025 (0.0009) [2023-12-28 08:14:52,680][106226] Updated weights for policy 0, policy_version 1806869 (0.0009) [2023-12-28 08:14:52,682][106225] Updated weights for policy 1, policy_version 1811035 (0.0009) [2023-12-28 08:14:52,742][106226] Updated weights for policy 0, policy_version 1806879 (0.0008) [2023-12-28 08:14:53,278][106225] Updated weights for policy 1, policy_version 1811045 (0.0005) [2023-12-28 08:14:53,336][106225] Updated weights for policy 1, policy_version 1811055 (0.0005) [2023-12-28 08:14:53,395][106225] Updated weights for policy 1, policy_version 1811065 (0.0005) [2023-12-28 08:14:53,536][106226] Updated weights for policy 0, policy_version 1806889 (0.0010) [2023-12-28 08:14:53,592][106226] Updated weights for policy 0, policy_version 1806899 (0.0009) [2023-12-28 08:14:53,652][106226] Updated weights for policy 0, policy_version 1806909 (0.0008) [2023-12-28 08:14:53,708][106226] Updated weights for policy 0, policy_version 1806919 (0.0008) [2023-12-28 08:14:53,983][106225] Updated weights for policy 1, policy_version 1811075 (0.0007) [2023-12-28 08:14:54,041][106225] Updated weights for policy 1, policy_version 1811085 (0.0008) [2023-12-28 08:14:54,098][106225] Updated weights for policy 1, policy_version 1811095 (0.0007) [2023-12-28 08:14:54,473][106226] Updated weights for policy 0, policy_version 1806929 (0.0009) [2023-12-28 08:14:54,526][106226] Updated weights for policy 0, policy_version 1806939 (0.0009) [2023-12-28 08:14:54,591][106226] Updated weights for policy 0, policy_version 1806949 (0.0009) [2023-12-28 08:14:54,757][106225] Updated weights for policy 1, policy_version 1811105 (0.0008) [2023-12-28 08:14:54,815][106225] Updated weights for policy 1, policy_version 1811115 (0.0009) [2023-12-28 08:14:54,868][106225] Updated weights for policy 1, policy_version 1811125 (0.0010) [2023-12-28 08:14:54,912][106225] Updated weights for policy 1, policy_version 1811135 (0.0008) [2023-12-28 08:14:55,371][106226] Updated weights for policy 0, policy_version 1806959 (0.0010) [2023-12-28 08:14:55,432][106226] Updated weights for policy 0, policy_version 1806969 (0.0010) [2023-12-28 08:14:55,489][106226] Updated weights for policy 0, policy_version 1806979 (0.0009) [2023-12-28 08:14:55,532][106225] Updated weights for policy 1, policy_version 1811145 (0.0005) [2023-12-28 08:14:55,596][106225] Updated weights for policy 1, policy_version 1811155 (0.0007) [2023-12-28 08:14:55,646][106225] Updated weights for policy 1, policy_version 1811165 (0.0005) [2023-12-28 08:14:56,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.7, 300 sec: 19882.9). Total num frames: 926384128. Throughput: 0: 9619.1, 1: 10128.2. Samples: 926357624. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:14:56,176][105115] Avg episode reward: [(0, '-4.451'), (1, '-4.860')] [2023-12-28 08:14:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001806984_462667776.pth... [2023-12-28 08:14:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001805864_462381056.pth [2023-12-28 08:14:56,224][106225] Updated weights for policy 1, policy_version 1811175 (0.0008) [2023-12-28 08:14:56,273][106225] Updated weights for policy 1, policy_version 1811185 (0.0008) [2023-12-28 08:14:56,279][106226] Updated weights for policy 0, policy_version 1806989 (0.0009) [2023-12-28 08:14:56,327][106225] Updated weights for policy 1, policy_version 1811195 (0.0007) [2023-12-28 08:14:56,339][106226] Updated weights for policy 0, policy_version 1806999 (0.0009) [2023-12-28 08:14:56,354][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001811200_463724544.pth... [2023-12-28 08:14:56,358][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001809984_463413248.pth [2023-12-28 08:14:56,400][106226] Updated weights for policy 0, policy_version 1807009 (0.0009) [2023-12-28 08:14:56,944][106225] Updated weights for policy 1, policy_version 1811205 (0.0008) [2023-12-28 08:14:56,991][106225] Updated weights for policy 1, policy_version 1811215 (0.0008) [2023-12-28 08:14:57,036][106225] Updated weights for policy 1, policy_version 1811225 (0.0008) [2023-12-28 08:14:57,146][106226] Updated weights for policy 0, policy_version 1807019 (0.0008) [2023-12-28 08:14:57,196][106226] Updated weights for policy 0, policy_version 1807029 (0.0008) [2023-12-28 08:14:57,244][106226] Updated weights for policy 0, policy_version 1807039 (0.0008) [2023-12-28 08:14:57,805][106225] Updated weights for policy 1, policy_version 1811235 (0.0007) [2023-12-28 08:14:57,855][106226] Updated weights for policy 0, policy_version 1807049 (0.0008) [2023-12-28 08:14:57,858][106225] Updated weights for policy 1, policy_version 1811245 (0.0005) [2023-12-28 08:14:57,911][106226] Updated weights for policy 0, policy_version 1807059 (0.0010) [2023-12-28 08:14:57,915][106225] Updated weights for policy 1, policy_version 1811255 (0.0005) [2023-12-28 08:14:57,961][106226] Updated weights for policy 0, policy_version 1807069 (0.0010) [2023-12-28 08:14:58,014][106226] Updated weights for policy 0, policy_version 1807079 (0.0010) [2023-12-28 08:14:58,603][106225] Updated weights for policy 1, policy_version 1811265 (0.0007) [2023-12-28 08:14:58,674][106225] Updated weights for policy 1, policy_version 1811275 (0.0008) [2023-12-28 08:14:58,740][106225] Updated weights for policy 1, policy_version 1811285 (0.0008) [2023-12-28 08:14:58,794][106226] Updated weights for policy 0, policy_version 1807089 (0.0008) [2023-12-28 08:14:58,803][106225] Updated weights for policy 1, policy_version 1811295 (0.0006) [2023-12-28 08:14:58,864][106226] Updated weights for policy 0, policy_version 1807099 (0.0007) [2023-12-28 08:14:58,937][106226] Updated weights for policy 0, policy_version 1807109 (0.0007) [2023-12-28 08:14:59,658][106225] Updated weights for policy 1, policy_version 1811305 (0.0008) [2023-12-28 08:14:59,703][106225] Updated weights for policy 1, policy_version 1811315 (0.0007) [2023-12-28 08:14:59,722][106226] Updated weights for policy 0, policy_version 1807119 (0.0009) [2023-12-28 08:14:59,748][106225] Updated weights for policy 1, policy_version 1811325 (0.0006) [2023-12-28 08:14:59,781][106226] Updated weights for policy 0, policy_version 1807129 (0.0008) [2023-12-28 08:14:59,844][106226] Updated weights for policy 0, policy_version 1807139 (0.0008) [2023-12-28 08:15:00,516][106225] Updated weights for policy 1, policy_version 1811335 (0.0008) [2023-12-28 08:15:00,569][106225] Updated weights for policy 1, policy_version 1811345 (0.0008) [2023-12-28 08:15:00,594][106226] Updated weights for policy 0, policy_version 1807149 (0.0010) [2023-12-28 08:15:00,624][106225] Updated weights for policy 1, policy_version 1811355 (0.0005) [2023-12-28 08:15:00,641][106226] Updated weights for policy 0, policy_version 1807159 (0.0010) [2023-12-28 08:15:00,688][106226] Updated weights for policy 0, policy_version 1807169 (0.0010) [2023-12-28 08:15:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 926482432. Throughput: 0: 9591.5, 1: 10187.4. Samples: 926474232. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:01,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.711')] [2023-12-28 08:15:01,327][106225] Updated weights for policy 1, policy_version 1811365 (0.0007) [2023-12-28 08:15:01,391][106225] Updated weights for policy 1, policy_version 1811375 (0.0008) [2023-12-28 08:15:01,417][106226] Updated weights for policy 0, policy_version 1807179 (0.0009) [2023-12-28 08:15:01,456][106225] Updated weights for policy 1, policy_version 1811385 (0.0006) [2023-12-28 08:15:01,480][106226] Updated weights for policy 0, policy_version 1807189 (0.0009) [2023-12-28 08:15:01,536][106226] Updated weights for policy 0, policy_version 1807199 (0.0010) [2023-12-28 08:15:02,133][106225] Updated weights for policy 1, policy_version 1811395 (0.0007) [2023-12-28 08:15:02,154][106226] Updated weights for policy 0, policy_version 1807209 (0.0010) [2023-12-28 08:15:02,200][106225] Updated weights for policy 1, policy_version 1811405 (0.0010) [2023-12-28 08:15:02,220][106226] Updated weights for policy 0, policy_version 1807219 (0.0006) [2023-12-28 08:15:02,267][106225] Updated weights for policy 1, policy_version 1811415 (0.0010) [2023-12-28 08:15:02,287][106226] Updated weights for policy 0, policy_version 1807229 (0.0008) [2023-12-28 08:15:02,350][106226] Updated weights for policy 0, policy_version 1807239 (0.0006) [2023-12-28 08:15:02,959][106225] Updated weights for policy 1, policy_version 1811425 (0.0009) [2023-12-28 08:15:03,012][106226] Updated weights for policy 0, policy_version 1807249 (0.0006) [2023-12-28 08:15:03,016][106225] Updated weights for policy 1, policy_version 1811435 (0.0010) [2023-12-28 08:15:03,067][106226] Updated weights for policy 0, policy_version 1807259 (0.0008) [2023-12-28 08:15:03,076][106225] Updated weights for policy 1, policy_version 1811445 (0.0010) [2023-12-28 08:15:03,121][106226] Updated weights for policy 0, policy_version 1807269 (0.0005) [2023-12-28 08:15:03,134][106225] Updated weights for policy 1, policy_version 1811455 (0.0010) [2023-12-28 08:15:03,682][106226] Updated weights for policy 0, policy_version 1807279 (0.0005) [2023-12-28 08:15:03,737][106226] Updated weights for policy 0, policy_version 1807289 (0.0010) [2023-12-28 08:15:03,790][106226] Updated weights for policy 0, policy_version 1807299 (0.0010) [2023-12-28 08:15:03,826][106225] Updated weights for policy 1, policy_version 1811465 (0.0010) [2023-12-28 08:15:03,891][106225] Updated weights for policy 1, policy_version 1811475 (0.0010) [2023-12-28 08:15:03,945][106225] Updated weights for policy 1, policy_version 1811485 (0.0010) [2023-12-28 08:15:04,477][106226] Updated weights for policy 0, policy_version 1807309 (0.0010) [2023-12-28 08:15:04,524][106226] Updated weights for policy 0, policy_version 1807319 (0.0010) [2023-12-28 08:15:04,571][106226] Updated weights for policy 0, policy_version 1807329 (0.0010) [2023-12-28 08:15:04,684][106225] Updated weights for policy 1, policy_version 1811495 (0.0005) [2023-12-28 08:15:04,744][106225] Updated weights for policy 1, policy_version 1811505 (0.0005) [2023-12-28 08:15:04,802][106225] Updated weights for policy 1, policy_version 1811515 (0.0005) [2023-12-28 08:15:05,262][106226] Updated weights for policy 0, policy_version 1807339 (0.0009) [2023-12-28 08:15:05,318][106226] Updated weights for policy 0, policy_version 1807349 (0.0005) [2023-12-28 08:15:05,350][106225] Updated weights for policy 1, policy_version 1811525 (0.0009) [2023-12-28 08:15:05,373][106226] Updated weights for policy 0, policy_version 1807359 (0.0008) [2023-12-28 08:15:05,401][106225] Updated weights for policy 1, policy_version 1811535 (0.0010) [2023-12-28 08:15:05,458][106225] Updated weights for policy 1, policy_version 1811545 (0.0010) [2023-12-28 08:15:05,952][106226] Updated weights for policy 0, policy_version 1807369 (0.0010) [2023-12-28 08:15:06,019][106226] Updated weights for policy 0, policy_version 1807379 (0.0007) [2023-12-28 08:15:06,080][106226] Updated weights for policy 0, policy_version 1807389 (0.0007) [2023-12-28 08:15:06,148][106226] Updated weights for policy 0, policy_version 1807399 (0.0007) [2023-12-28 08:15:06,174][105115] Fps is (10 sec: 20481.0, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 926588928. Throughput: 0: 9666.4, 1: 10174.9. Samples: 926597740. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:06,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.861')] [2023-12-28 08:15:06,208][106225] Updated weights for policy 1, policy_version 1811555 (0.0010) [2023-12-28 08:15:06,263][106225] Updated weights for policy 1, policy_version 1811565 (0.0010) [2023-12-28 08:15:06,323][106225] Updated weights for policy 1, policy_version 1811575 (0.0011) [2023-12-28 08:15:06,842][106226] Updated weights for policy 0, policy_version 1807409 (0.0008) [2023-12-28 08:15:06,915][106226] Updated weights for policy 0, policy_version 1807419 (0.0007) [2023-12-28 08:15:06,973][106226] Updated weights for policy 0, policy_version 1807429 (0.0008) [2023-12-28 08:15:07,050][106225] Updated weights for policy 1, policy_version 1811585 (0.0007) [2023-12-28 08:15:07,110][106225] Updated weights for policy 1, policy_version 1811595 (0.0010) [2023-12-28 08:15:07,174][106225] Updated weights for policy 1, policy_version 1811605 (0.0010) [2023-12-28 08:15:07,235][106225] Updated weights for policy 1, policy_version 1811615 (0.0010) [2023-12-28 08:15:07,669][106226] Updated weights for policy 0, policy_version 1807439 (0.0008) [2023-12-28 08:15:07,728][106226] Updated weights for policy 0, policy_version 1807449 (0.0008) [2023-12-28 08:15:07,792][106226] Updated weights for policy 0, policy_version 1807459 (0.0008) [2023-12-28 08:15:07,848][106225] Updated weights for policy 1, policy_version 1811625 (0.0010) [2023-12-28 08:15:07,902][106225] Updated weights for policy 1, policy_version 1811635 (0.0010) [2023-12-28 08:15:07,964][106225] Updated weights for policy 1, policy_version 1811645 (0.0011) [2023-12-28 08:15:08,502][106226] Updated weights for policy 0, policy_version 1807469 (0.0007) [2023-12-28 08:15:08,569][106226] Updated weights for policy 0, policy_version 1807479 (0.0008) [2023-12-28 08:15:08,622][106226] Updated weights for policy 0, policy_version 1807489 (0.0008) [2023-12-28 08:15:08,699][106225] Updated weights for policy 1, policy_version 1811655 (0.0008) [2023-12-28 08:15:08,767][106225] Updated weights for policy 1, policy_version 1811665 (0.0006) [2023-12-28 08:15:08,829][106225] Updated weights for policy 1, policy_version 1811675 (0.0007) [2023-12-28 08:15:09,328][106226] Updated weights for policy 0, policy_version 1807499 (0.0008) [2023-12-28 08:15:09,403][106226] Updated weights for policy 0, policy_version 1807509 (0.0009) [2023-12-28 08:15:09,467][106226] Updated weights for policy 0, policy_version 1807519 (0.0007) [2023-12-28 08:15:09,487][106225] Updated weights for policy 1, policy_version 1811685 (0.0008) [2023-12-28 08:15:09,549][106225] Updated weights for policy 1, policy_version 1811695 (0.0007) [2023-12-28 08:15:09,616][106225] Updated weights for policy 1, policy_version 1811705 (0.0008) [2023-12-28 08:15:10,157][106226] Updated weights for policy 0, policy_version 1807529 (0.0008) [2023-12-28 08:15:10,219][106226] Updated weights for policy 0, policy_version 1807539 (0.0008) [2023-12-28 08:15:10,281][106226] Updated weights for policy 0, policy_version 1807549 (0.0008) [2023-12-28 08:15:10,341][106226] Updated weights for policy 0, policy_version 1807559 (0.0008) [2023-12-28 08:15:10,342][106225] Updated weights for policy 1, policy_version 1811715 (0.0008) [2023-12-28 08:15:10,404][106225] Updated weights for policy 1, policy_version 1811725 (0.0008) [2023-12-28 08:15:10,468][106225] Updated weights for policy 1, policy_version 1811735 (0.0008) [2023-12-28 08:15:11,044][106226] Updated weights for policy 0, policy_version 1807569 (0.0007) [2023-12-28 08:15:11,119][106226] Updated weights for policy 0, policy_version 1807579 (0.0007) [2023-12-28 08:15:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 926679040. Throughput: 0: 9706.3, 1: 10164.9. Samples: 926656436. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:11,175][105115] Avg episode reward: [(0, '-4.257'), (1, '-4.881')] [2023-12-28 08:15:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001811744_463863808.pth... [2023-12-28 08:15:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001810592_463568896.pth [2023-12-28 08:15:11,194][106226] Updated weights for policy 0, policy_version 1807589 (0.0008) [2023-12-28 08:15:11,210][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001807592_462823424.pth... [2023-12-28 08:15:11,213][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001806440_462528512.pth [2023-12-28 08:15:11,254][106225] Updated weights for policy 1, policy_version 1811745 (0.0009) [2023-12-28 08:15:11,323][106225] Updated weights for policy 1, policy_version 1811755 (0.0009) [2023-12-28 08:15:11,391][106225] Updated weights for policy 1, policy_version 1811765 (0.0009) [2023-12-28 08:15:11,451][106225] Updated weights for policy 1, policy_version 1811775 (0.0007) [2023-12-28 08:15:11,971][106226] Updated weights for policy 0, policy_version 1807599 (0.0007) [2023-12-28 08:15:12,025][106226] Updated weights for policy 0, policy_version 1807609 (0.0008) [2023-12-28 08:15:12,088][106226] Updated weights for policy 0, policy_version 1807619 (0.0008) [2023-12-28 08:15:12,223][106225] Updated weights for policy 1, policy_version 1811785 (0.0008) [2023-12-28 08:15:12,288][106225] Updated weights for policy 1, policy_version 1811795 (0.0007) [2023-12-28 08:15:12,356][106225] Updated weights for policy 1, policy_version 1811805 (0.0008) [2023-12-28 08:15:12,855][106226] Updated weights for policy 0, policy_version 1807629 (0.0008) [2023-12-28 08:15:12,917][106226] Updated weights for policy 0, policy_version 1807639 (0.0009) [2023-12-28 08:15:12,972][106226] Updated weights for policy 0, policy_version 1807649 (0.0008) [2023-12-28 08:15:13,042][106225] Updated weights for policy 1, policy_version 1811815 (0.0007) [2023-12-28 08:15:13,110][106225] Updated weights for policy 1, policy_version 1811825 (0.0007) [2023-12-28 08:15:13,172][106225] Updated weights for policy 1, policy_version 1811835 (0.0008) [2023-12-28 08:15:13,667][106226] Updated weights for policy 0, policy_version 1807659 (0.0007) [2023-12-28 08:15:13,713][106226] Updated weights for policy 0, policy_version 1807669 (0.0005) [2023-12-28 08:15:13,763][106226] Updated weights for policy 0, policy_version 1807679 (0.0005) [2023-12-28 08:15:13,831][106225] Updated weights for policy 1, policy_version 1811845 (0.0007) [2023-12-28 08:15:13,884][106225] Updated weights for policy 1, policy_version 1811855 (0.0010) [2023-12-28 08:15:13,939][106225] Updated weights for policy 1, policy_version 1811865 (0.0007) [2023-12-28 08:15:14,445][106226] Updated weights for policy 0, policy_version 1807689 (0.0008) [2023-12-28 08:15:14,509][106226] Updated weights for policy 0, policy_version 1807699 (0.0011) [2023-12-28 08:15:14,573][106226] Updated weights for policy 0, policy_version 1807709 (0.0011) [2023-12-28 08:15:14,615][106225] Updated weights for policy 1, policy_version 1811875 (0.0006) [2023-12-28 08:15:14,639][106226] Updated weights for policy 0, policy_version 1807719 (0.0010) [2023-12-28 08:15:14,670][106225] Updated weights for policy 1, policy_version 1811885 (0.0007) [2023-12-28 08:15:14,733][106225] Updated weights for policy 1, policy_version 1811895 (0.0008) [2023-12-28 08:15:15,390][106226] Updated weights for policy 0, policy_version 1807729 (0.0009) [2023-12-28 08:15:15,410][106225] Updated weights for policy 1, policy_version 1811905 (0.0008) [2023-12-28 08:15:15,451][106226] Updated weights for policy 0, policy_version 1807739 (0.0007) [2023-12-28 08:15:15,471][106225] Updated weights for policy 1, policy_version 1811915 (0.0007) [2023-12-28 08:15:15,508][106226] Updated weights for policy 0, policy_version 1807749 (0.0008) [2023-12-28 08:15:15,530][106225] Updated weights for policy 1, policy_version 1811925 (0.0006) [2023-12-28 08:15:15,591][106225] Updated weights for policy 1, policy_version 1811935 (0.0006) [2023-12-28 08:15:16,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19797.2, 300 sec: 19882.9). Total num frames: 926777344. Throughput: 0: 9719.9, 1: 10054.5. Samples: 926772496. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:16,176][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.921')] [2023-12-28 08:15:16,195][106225] Updated weights for policy 1, policy_version 1811945 (0.0010) [2023-12-28 08:15:16,225][106226] Updated weights for policy 0, policy_version 1807759 (0.0006) [2023-12-28 08:15:16,250][106225] Updated weights for policy 1, policy_version 1811955 (0.0010) [2023-12-28 08:15:16,280][106226] Updated weights for policy 0, policy_version 1807769 (0.0008) [2023-12-28 08:15:16,303][106225] Updated weights for policy 1, policy_version 1811965 (0.0010) [2023-12-28 08:15:16,340][106226] Updated weights for policy 0, policy_version 1807779 (0.0008) [2023-12-28 08:15:16,968][106226] Updated weights for policy 0, policy_version 1807789 (0.0008) [2023-12-28 08:15:17,017][106225] Updated weights for policy 1, policy_version 1811975 (0.0010) [2023-12-28 08:15:17,030][106226] Updated weights for policy 0, policy_version 1807799 (0.0007) [2023-12-28 08:15:17,082][106225] Updated weights for policy 1, policy_version 1811985 (0.0010) [2023-12-28 08:15:17,091][106226] Updated weights for policy 0, policy_version 1807809 (0.0009) [2023-12-28 08:15:17,136][106225] Updated weights for policy 1, policy_version 1811995 (0.0010) [2023-12-28 08:15:17,824][106226] Updated weights for policy 0, policy_version 1807819 (0.0006) [2023-12-28 08:15:17,868][106225] Updated weights for policy 1, policy_version 1812005 (0.0010) [2023-12-28 08:15:17,885][106226] Updated weights for policy 0, policy_version 1807829 (0.0007) [2023-12-28 08:15:17,925][106225] Updated weights for policy 1, policy_version 1812015 (0.0010) [2023-12-28 08:15:17,940][106226] Updated weights for policy 0, policy_version 1807839 (0.0009) [2023-12-28 08:15:17,980][106225] Updated weights for policy 1, policy_version 1812025 (0.0010) [2023-12-28 08:15:18,656][106225] Updated weights for policy 1, policy_version 1812035 (0.0009) [2023-12-28 08:15:18,719][106225] Updated weights for policy 1, policy_version 1812045 (0.0006) [2023-12-28 08:15:18,733][106226] Updated weights for policy 0, policy_version 1807849 (0.0008) [2023-12-28 08:15:18,775][106225] Updated weights for policy 1, policy_version 1812055 (0.0006) [2023-12-28 08:15:18,798][106226] Updated weights for policy 0, policy_version 1807859 (0.0010) [2023-12-28 08:15:18,857][106226] Updated weights for policy 0, policy_version 1807869 (0.0010) [2023-12-28 08:15:18,923][106226] Updated weights for policy 0, policy_version 1807879 (0.0011) [2023-12-28 08:15:19,510][106225] Updated weights for policy 1, policy_version 1812065 (0.0008) [2023-12-28 08:15:19,573][106225] Updated weights for policy 1, policy_version 1812075 (0.0008) [2023-12-28 08:15:19,613][106226] Updated weights for policy 0, policy_version 1807889 (0.0011) [2023-12-28 08:15:19,630][106225] Updated weights for policy 1, policy_version 1812085 (0.0007) [2023-12-28 08:15:19,672][106226] Updated weights for policy 0, policy_version 1807899 (0.0011) [2023-12-28 08:15:19,692][106225] Updated weights for policy 1, policy_version 1812095 (0.0007) [2023-12-28 08:15:19,734][106226] Updated weights for policy 0, policy_version 1807909 (0.0011) [2023-12-28 08:15:20,501][106225] Updated weights for policy 1, policy_version 1812105 (0.0010) [2023-12-28 08:15:20,519][106226] Updated weights for policy 0, policy_version 1807919 (0.0009) [2023-12-28 08:15:20,564][106225] Updated weights for policy 1, policy_version 1812115 (0.0011) [2023-12-28 08:15:20,586][106226] Updated weights for policy 0, policy_version 1807929 (0.0007) [2023-12-28 08:15:20,631][106225] Updated weights for policy 1, policy_version 1812125 (0.0010) [2023-12-28 08:15:20,649][106226] Updated weights for policy 0, policy_version 1807939 (0.0007) [2023-12-28 08:15:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 926875648. Throughput: 0: 9683.3, 1: 10031.5. Samples: 926888236. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:21,175][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.784')] [2023-12-28 08:15:21,361][106226] Updated weights for policy 0, policy_version 1807949 (0.0007) [2023-12-28 08:15:21,430][106226] Updated weights for policy 0, policy_version 1807959 (0.0008) [2023-12-28 08:15:21,457][106225] Updated weights for policy 1, policy_version 1812135 (0.0010) [2023-12-28 08:15:21,493][106226] Updated weights for policy 0, policy_version 1807969 (0.0010) [2023-12-28 08:15:21,512][106225] Updated weights for policy 1, policy_version 1812145 (0.0011) [2023-12-28 08:15:21,581][106225] Updated weights for policy 1, policy_version 1812155 (0.0010) [2023-12-28 08:15:22,246][106226] Updated weights for policy 0, policy_version 1807979 (0.0007) [2023-12-28 08:15:22,314][106226] Updated weights for policy 0, policy_version 1807989 (0.0009) [2023-12-28 08:15:22,385][106226] Updated weights for policy 0, policy_version 1807999 (0.0008) [2023-12-28 08:15:22,395][106225] Updated weights for policy 1, policy_version 1812165 (0.0008) [2023-12-28 08:15:22,458][106225] Updated weights for policy 1, policy_version 1812175 (0.0009) [2023-12-28 08:15:22,519][106225] Updated weights for policy 1, policy_version 1812185 (0.0008) [2023-12-28 08:15:23,165][106225] Updated weights for policy 1, policy_version 1812195 (0.0009) [2023-12-28 08:15:23,170][106226] Updated weights for policy 0, policy_version 1808009 (0.0007) [2023-12-28 08:15:23,220][106225] Updated weights for policy 1, policy_version 1812205 (0.0007) [2023-12-28 08:15:23,226][106226] Updated weights for policy 0, policy_version 1808019 (0.0007) [2023-12-28 08:15:23,272][106225] Updated weights for policy 1, policy_version 1812215 (0.0007) [2023-12-28 08:15:23,284][106226] Updated weights for policy 0, policy_version 1808029 (0.0006) [2023-12-28 08:15:23,345][106226] Updated weights for policy 0, policy_version 1808039 (0.0007) [2023-12-28 08:15:23,928][106226] Updated weights for policy 0, policy_version 1808049 (0.0006) [2023-12-28 08:15:23,979][106226] Updated weights for policy 0, policy_version 1808059 (0.0006) [2023-12-28 08:15:24,043][106226] Updated weights for policy 0, policy_version 1808069 (0.0006) [2023-12-28 08:15:24,082][106225] Updated weights for policy 1, policy_version 1812225 (0.0009) [2023-12-28 08:15:24,144][106225] Updated weights for policy 1, policy_version 1812235 (0.0009) [2023-12-28 08:15:24,203][106225] Updated weights for policy 1, policy_version 1812245 (0.0007) [2023-12-28 08:15:24,265][106225] Updated weights for policy 1, policy_version 1812255 (0.0008) [2023-12-28 08:15:24,670][106226] Updated weights for policy 0, policy_version 1808079 (0.0008) [2023-12-28 08:15:24,725][106226] Updated weights for policy 0, policy_version 1808089 (0.0009) [2023-12-28 08:15:24,780][106226] Updated weights for policy 0, policy_version 1808099 (0.0008) [2023-12-28 08:15:24,940][106225] Updated weights for policy 1, policy_version 1812265 (0.0009) [2023-12-28 08:15:25,003][106225] Updated weights for policy 1, policy_version 1812275 (0.0008) [2023-12-28 08:15:25,061][106225] Updated weights for policy 1, policy_version 1812285 (0.0008) [2023-12-28 08:15:25,574][106226] Updated weights for policy 0, policy_version 1808109 (0.0009) [2023-12-28 08:15:25,627][106226] Updated weights for policy 0, policy_version 1808119 (0.0009) [2023-12-28 08:15:25,682][106226] Updated weights for policy 0, policy_version 1808129 (0.0009) [2023-12-28 08:15:25,716][106225] Updated weights for policy 1, policy_version 1812295 (0.0006) [2023-12-28 08:15:25,782][106225] Updated weights for policy 1, policy_version 1812305 (0.0005) [2023-12-28 08:15:25,836][106225] Updated weights for policy 1, policy_version 1812315 (0.0007) [2023-12-28 08:15:26,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.9, 300 sec: 19883.0). Total num frames: 926973952. Throughput: 0: 9716.7, 1: 9892.2. Samples: 926944308. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:26,175][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.882')] [2023-12-28 08:15:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001812320_464011264.pth... [2023-12-28 08:15:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001808136_462962688.pth... [2023-12-28 08:15:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001811200_463724544.pth [2023-12-28 08:15:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001806984_462667776.pth [2023-12-28 08:15:26,449][106226] Updated weights for policy 0, policy_version 1808139 (0.0008) [2023-12-28 08:15:26,499][106226] Updated weights for policy 0, policy_version 1808149 (0.0010) [2023-12-28 08:15:26,512][106225] Updated weights for policy 1, policy_version 1812325 (0.0007) [2023-12-28 08:15:26,556][106226] Updated weights for policy 0, policy_version 1808159 (0.0006) [2023-12-28 08:15:26,577][106225] Updated weights for policy 1, policy_version 1812335 (0.0011) [2023-12-28 08:15:26,632][106225] Updated weights for policy 1, policy_version 1812345 (0.0010) [2023-12-28 08:15:27,322][106226] Updated weights for policy 0, policy_version 1808169 (0.0009) [2023-12-28 08:15:27,323][106225] Updated weights for policy 1, policy_version 1812355 (0.0010) [2023-12-28 08:15:27,372][106226] Updated weights for policy 0, policy_version 1808179 (0.0006) [2023-12-28 08:15:27,380][106225] Updated weights for policy 1, policy_version 1812365 (0.0010) [2023-12-28 08:15:27,432][106226] Updated weights for policy 0, policy_version 1808189 (0.0006) [2023-12-28 08:15:27,436][106225] Updated weights for policy 1, policy_version 1812375 (0.0010) [2023-12-28 08:15:27,485][106226] Updated weights for policy 0, policy_version 1808199 (0.0006) [2023-12-28 08:15:28,090][106225] Updated weights for policy 1, policy_version 1812385 (0.0010) [2023-12-28 08:15:28,145][106225] Updated weights for policy 1, policy_version 1812395 (0.0008) [2023-12-28 08:15:28,200][106225] Updated weights for policy 1, policy_version 1812405 (0.0007) [2023-12-28 08:15:28,254][106225] Updated weights for policy 1, policy_version 1812415 (0.0007) [2023-12-28 08:15:28,256][106226] Updated weights for policy 0, policy_version 1808209 (0.0008) [2023-12-28 08:15:28,309][106226] Updated weights for policy 0, policy_version 1808219 (0.0008) [2023-12-28 08:15:28,367][106226] Updated weights for policy 0, policy_version 1808229 (0.0009) [2023-12-28 08:15:29,007][106225] Updated weights for policy 1, policy_version 1812425 (0.0008) [2023-12-28 08:15:29,071][106225] Updated weights for policy 1, policy_version 1812435 (0.0008) [2023-12-28 08:15:29,105][106226] Updated weights for policy 0, policy_version 1808239 (0.0006) [2023-12-28 08:15:29,128][106225] Updated weights for policy 1, policy_version 1812445 (0.0008) [2023-12-28 08:15:29,158][106226] Updated weights for policy 0, policy_version 1808249 (0.0005) [2023-12-28 08:15:29,214][106226] Updated weights for policy 0, policy_version 1808259 (0.0006) [2023-12-28 08:15:29,882][106225] Updated weights for policy 1, policy_version 1812455 (0.0008) [2023-12-28 08:15:29,897][106226] Updated weights for policy 0, policy_version 1808269 (0.0008) [2023-12-28 08:15:29,941][106225] Updated weights for policy 1, policy_version 1812465 (0.0009) [2023-12-28 08:15:29,960][106226] Updated weights for policy 0, policy_version 1808279 (0.0007) [2023-12-28 08:15:30,007][106225] Updated weights for policy 1, policy_version 1812475 (0.0008) [2023-12-28 08:15:30,014][106226] Updated weights for policy 0, policy_version 1808289 (0.0006) [2023-12-28 08:15:30,712][106225] Updated weights for policy 1, policy_version 1812485 (0.0008) [2023-12-28 08:15:30,739][106226] Updated weights for policy 0, policy_version 1808299 (0.0006) [2023-12-28 08:15:30,770][106225] Updated weights for policy 1, policy_version 1812495 (0.0009) [2023-12-28 08:15:30,795][106226] Updated weights for policy 0, policy_version 1808309 (0.0006) [2023-12-28 08:15:30,826][106225] Updated weights for policy 1, policy_version 1812505 (0.0008) [2023-12-28 08:15:30,856][106226] Updated weights for policy 0, policy_version 1808319 (0.0007) [2023-12-28 08:15:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 927072256. Throughput: 0: 9712.3, 1: 9915.9. Samples: 927060388. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:31,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.591')] [2023-12-28 08:15:31,514][106225] Updated weights for policy 1, policy_version 1812515 (0.0006) [2023-12-28 08:15:31,564][106225] Updated weights for policy 1, policy_version 1812525 (0.0008) [2023-12-28 08:15:31,592][106226] Updated weights for policy 0, policy_version 1808329 (0.0008) [2023-12-28 08:15:31,616][106225] Updated weights for policy 1, policy_version 1812535 (0.0008) [2023-12-28 08:15:31,660][106226] Updated weights for policy 0, policy_version 1808339 (0.0008) [2023-12-28 08:15:31,713][106226] Updated weights for policy 0, policy_version 1808349 (0.0008) [2023-12-28 08:15:31,783][106226] Updated weights for policy 0, policy_version 1808359 (0.0008) [2023-12-28 08:15:32,321][106225] Updated weights for policy 1, policy_version 1812545 (0.0006) [2023-12-28 08:15:32,385][106225] Updated weights for policy 1, policy_version 1812555 (0.0007) [2023-12-28 08:15:32,454][106225] Updated weights for policy 1, policy_version 1812565 (0.0007) [2023-12-28 08:15:32,516][106225] Updated weights for policy 1, policy_version 1812575 (0.0006) [2023-12-28 08:15:32,549][106226] Updated weights for policy 0, policy_version 1808369 (0.0008) [2023-12-28 08:15:32,608][106226] Updated weights for policy 0, policy_version 1808379 (0.0008) [2023-12-28 08:15:32,671][106226] Updated weights for policy 0, policy_version 1808389 (0.0009) [2023-12-28 08:15:33,223][106225] Updated weights for policy 1, policy_version 1812585 (0.0010) [2023-12-28 08:15:33,273][106225] Updated weights for policy 1, policy_version 1812595 (0.0010) [2023-12-28 08:15:33,323][106225] Updated weights for policy 1, policy_version 1812605 (0.0010) [2023-12-28 08:15:33,397][106226] Updated weights for policy 0, policy_version 1808399 (0.0008) [2023-12-28 08:15:33,458][106226] Updated weights for policy 0, policy_version 1808409 (0.0007) [2023-12-28 08:15:33,511][106226] Updated weights for policy 0, policy_version 1808419 (0.0008) [2023-12-28 08:15:34,059][106225] Updated weights for policy 1, policy_version 1812615 (0.0007) [2023-12-28 08:15:34,115][106225] Updated weights for policy 1, policy_version 1812625 (0.0005) [2023-12-28 08:15:34,179][106225] Updated weights for policy 1, policy_version 1812635 (0.0009) [2023-12-28 08:15:34,265][106226] Updated weights for policy 0, policy_version 1808429 (0.0008) [2023-12-28 08:15:34,328][106226] Updated weights for policy 0, policy_version 1808439 (0.0008) [2023-12-28 08:15:34,394][106226] Updated weights for policy 0, policy_version 1808449 (0.0011) [2023-12-28 08:15:34,895][106225] Updated weights for policy 1, policy_version 1812645 (0.0009) [2023-12-28 08:15:34,954][106225] Updated weights for policy 1, policy_version 1812655 (0.0006) [2023-12-28 08:15:35,015][106225] Updated weights for policy 1, policy_version 1812665 (0.0006) [2023-12-28 08:15:35,112][106226] Updated weights for policy 0, policy_version 1808459 (0.0010) [2023-12-28 08:15:35,160][106226] Updated weights for policy 0, policy_version 1808469 (0.0008) [2023-12-28 08:15:35,215][106226] Updated weights for policy 0, policy_version 1808479 (0.0009) [2023-12-28 08:15:35,581][106225] Updated weights for policy 1, policy_version 1812675 (0.0005) [2023-12-28 08:15:35,641][106225] Updated weights for policy 1, policy_version 1812685 (0.0005) [2023-12-28 08:15:35,698][106225] Updated weights for policy 1, policy_version 1812695 (0.0008) [2023-12-28 08:15:35,962][106226] Updated weights for policy 0, policy_version 1808489 (0.0008) [2023-12-28 08:15:36,023][106226] Updated weights for policy 0, policy_version 1808499 (0.0006) [2023-12-28 08:15:36,086][106226] Updated weights for policy 0, policy_version 1808509 (0.0006) [2023-12-28 08:15:36,157][106226] Updated weights for policy 0, policy_version 1808519 (0.0010) [2023-12-28 08:15:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19883.0). Total num frames: 927170560. Throughput: 0: 9596.4, 1: 9904.5. Samples: 927176840. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:36,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.685')] [2023-12-28 08:15:36,374][106225] Updated weights for policy 1, policy_version 1812705 (0.0008) [2023-12-28 08:15:36,435][106225] Updated weights for policy 1, policy_version 1812715 (0.0010) [2023-12-28 08:15:36,493][106225] Updated weights for policy 1, policy_version 1812725 (0.0008) [2023-12-28 08:15:36,561][106225] Updated weights for policy 1, policy_version 1812735 (0.0008) [2023-12-28 08:15:36,840][106226] Updated weights for policy 0, policy_version 1808529 (0.0009) [2023-12-28 08:15:36,900][106226] Updated weights for policy 0, policy_version 1808539 (0.0010) [2023-12-28 08:15:36,970][106226] Updated weights for policy 0, policy_version 1808549 (0.0010) [2023-12-28 08:15:37,197][106225] Updated weights for policy 1, policy_version 1812745 (0.0006) [2023-12-28 08:15:37,245][106225] Updated weights for policy 1, policy_version 1812755 (0.0010) [2023-12-28 08:15:37,307][106225] Updated weights for policy 1, policy_version 1812765 (0.0006) [2023-12-28 08:15:37,606][106226] Updated weights for policy 0, policy_version 1808559 (0.0011) [2023-12-28 08:15:37,668][106226] Updated weights for policy 0, policy_version 1808569 (0.0011) [2023-12-28 08:15:37,728][106226] Updated weights for policy 0, policy_version 1808579 (0.0011) [2023-12-28 08:15:37,980][106225] Updated weights for policy 1, policy_version 1812775 (0.0007) [2023-12-28 08:15:38,034][106225] Updated weights for policy 1, policy_version 1812785 (0.0007) [2023-12-28 08:15:38,092][106225] Updated weights for policy 1, policy_version 1812795 (0.0007) [2023-12-28 08:15:38,361][106226] Updated weights for policy 0, policy_version 1808589 (0.0010) [2023-12-28 08:15:38,422][106226] Updated weights for policy 0, policy_version 1808599 (0.0011) [2023-12-28 08:15:38,483][106226] Updated weights for policy 0, policy_version 1808609 (0.0010) [2023-12-28 08:15:38,884][106225] Updated weights for policy 1, policy_version 1812805 (0.0008) [2023-12-28 08:15:38,946][106225] Updated weights for policy 1, policy_version 1812815 (0.0008) [2023-12-28 08:15:38,991][106225] Updated weights for policy 1, policy_version 1812825 (0.0007) [2023-12-28 08:15:39,219][106226] Updated weights for policy 0, policy_version 1808619 (0.0010) [2023-12-28 08:15:39,283][106226] Updated weights for policy 0, policy_version 1808629 (0.0009) [2023-12-28 08:15:39,352][106226] Updated weights for policy 0, policy_version 1808639 (0.0010) [2023-12-28 08:15:39,728][106225] Updated weights for policy 1, policy_version 1812835 (0.0008) [2023-12-28 08:15:39,790][106225] Updated weights for policy 1, policy_version 1812845 (0.0008) [2023-12-28 08:15:39,855][106225] Updated weights for policy 1, policy_version 1812855 (0.0008) [2023-12-28 08:15:40,195][106226] Updated weights for policy 0, policy_version 1808649 (0.0009) [2023-12-28 08:15:40,269][106226] Updated weights for policy 0, policy_version 1808659 (0.0008) [2023-12-28 08:15:40,337][106226] Updated weights for policy 0, policy_version 1808669 (0.0008) [2023-12-28 08:15:40,403][106226] Updated weights for policy 0, policy_version 1808679 (0.0008) [2023-12-28 08:15:40,526][106225] Updated weights for policy 1, policy_version 1812865 (0.0008) [2023-12-28 08:15:40,583][106225] Updated weights for policy 1, policy_version 1812875 (0.0009) [2023-12-28 08:15:40,637][106225] Updated weights for policy 1, policy_version 1812885 (0.0009) [2023-12-28 08:15:40,688][106225] Updated weights for policy 1, policy_version 1812895 (0.0009) [2023-12-28 08:15:41,014][106226] Updated weights for policy 0, policy_version 1808689 (0.0008) [2023-12-28 08:15:41,096][106226] Updated weights for policy 0, policy_version 1808699 (0.0009) [2023-12-28 08:15:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 927260672. Throughput: 0: 9673.3, 1: 9881.3. Samples: 927237576. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:41,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.868')] [2023-12-28 08:15:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001812896_464158720.pth... [2023-12-28 08:15:41,184][106226] Updated weights for policy 0, policy_version 1808709 (0.0008) [2023-12-28 08:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001811744_463863808.pth [2023-12-28 08:15:41,200][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001808712_463110144.pth... [2023-12-28 08:15:41,204][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001807592_462823424.pth [2023-12-28 08:15:41,529][106225] Updated weights for policy 1, policy_version 1812905 (0.0006) [2023-12-28 08:15:41,577][106225] Updated weights for policy 1, policy_version 1812915 (0.0005) [2023-12-28 08:15:41,643][106225] Updated weights for policy 1, policy_version 1812925 (0.0006) [2023-12-28 08:15:41,980][106226] Updated weights for policy 0, policy_version 1808719 (0.0008) [2023-12-28 08:15:42,033][106226] Updated weights for policy 0, policy_version 1808729 (0.0010) [2023-12-28 08:15:42,087][106226] Updated weights for policy 0, policy_version 1808739 (0.0008) [2023-12-28 08:15:42,276][106225] Updated weights for policy 1, policy_version 1812935 (0.0010) [2023-12-28 08:15:42,339][106225] Updated weights for policy 1, policy_version 1812945 (0.0008) [2023-12-28 08:15:42,410][106225] Updated weights for policy 1, policy_version 1812955 (0.0008) [2023-12-28 08:15:42,817][106226] Updated weights for policy 0, policy_version 1808749 (0.0008) [2023-12-28 08:15:42,883][106226] Updated weights for policy 0, policy_version 1808759 (0.0007) [2023-12-28 08:15:42,948][106226] Updated weights for policy 0, policy_version 1808769 (0.0008) [2023-12-28 08:15:43,159][106225] Updated weights for policy 1, policy_version 1812965 (0.0009) [2023-12-28 08:15:43,226][106225] Updated weights for policy 1, policy_version 1812975 (0.0011) [2023-12-28 08:15:43,278][106225] Updated weights for policy 1, policy_version 1812985 (0.0011) [2023-12-28 08:15:43,662][106226] Updated weights for policy 0, policy_version 1808779 (0.0007) [2023-12-28 08:15:43,715][106226] Updated weights for policy 0, policy_version 1808789 (0.0005) [2023-12-28 08:15:43,778][106226] Updated weights for policy 0, policy_version 1808799 (0.0005) [2023-12-28 08:15:43,906][106225] Updated weights for policy 1, policy_version 1812995 (0.0008) [2023-12-28 08:15:43,959][106225] Updated weights for policy 1, policy_version 1813005 (0.0005) [2023-12-28 08:15:44,017][106225] Updated weights for policy 1, policy_version 1813015 (0.0005) [2023-12-28 08:15:44,444][106226] Updated weights for policy 0, policy_version 1808809 (0.0006) [2023-12-28 08:15:44,507][106226] Updated weights for policy 0, policy_version 1808819 (0.0009) [2023-12-28 08:15:44,569][106226] Updated weights for policy 0, policy_version 1808829 (0.0008) [2023-12-28 08:15:44,613][106225] Updated weights for policy 1, policy_version 1813025 (0.0006) [2023-12-28 08:15:44,623][106226] Updated weights for policy 0, policy_version 1808839 (0.0008) [2023-12-28 08:15:44,669][106225] Updated weights for policy 1, policy_version 1813035 (0.0009) [2023-12-28 08:15:44,722][106225] Updated weights for policy 1, policy_version 1813045 (0.0008) [2023-12-28 08:15:44,787][106225] Updated weights for policy 1, policy_version 1813055 (0.0008) [2023-12-28 08:15:45,342][106226] Updated weights for policy 0, policy_version 1808849 (0.0011) [2023-12-28 08:15:45,401][106226] Updated weights for policy 0, policy_version 1808859 (0.0011) [2023-12-28 08:15:45,462][106226] Updated weights for policy 0, policy_version 1808869 (0.0009) [2023-12-28 08:15:45,550][106225] Updated weights for policy 1, policy_version 1813065 (0.0011) [2023-12-28 08:15:45,615][106225] Updated weights for policy 1, policy_version 1813075 (0.0011) [2023-12-28 08:15:45,670][106225] Updated weights for policy 1, policy_version 1813085 (0.0011) [2023-12-28 08:15:46,115][106226] Updated weights for policy 0, policy_version 1808879 (0.0009) [2023-12-28 08:15:46,169][106226] Updated weights for policy 0, policy_version 1808889 (0.0011) [2023-12-28 08:15:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19387.7, 300 sec: 19827.4). Total num frames: 927358976. Throughput: 0: 9700.3, 1: 9839.2. Samples: 927353512. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:46,176][105115] Avg episode reward: [(0, '-4.512'), (1, '-4.389')] [2023-12-28 08:15:46,220][106226] Updated weights for policy 0, policy_version 1808899 (0.0010) [2023-12-28 08:15:46,335][106225] Updated weights for policy 1, policy_version 1813095 (0.0009) [2023-12-28 08:15:46,391][106225] Updated weights for policy 1, policy_version 1813105 (0.0008) [2023-12-28 08:15:46,441][106225] Updated weights for policy 1, policy_version 1813115 (0.0007) [2023-12-28 08:15:46,946][106226] Updated weights for policy 0, policy_version 1808909 (0.0008) [2023-12-28 08:15:47,008][106226] Updated weights for policy 0, policy_version 1808919 (0.0010) [2023-12-28 08:15:47,040][106225] Updated weights for policy 1, policy_version 1813125 (0.0007) [2023-12-28 08:15:47,065][106226] Updated weights for policy 0, policy_version 1808929 (0.0008) [2023-12-28 08:15:47,087][106225] Updated weights for policy 1, policy_version 1813135 (0.0006) [2023-12-28 08:15:47,140][106225] Updated weights for policy 1, policy_version 1813145 (0.0007) [2023-12-28 08:15:47,790][106226] Updated weights for policy 0, policy_version 1808939 (0.0009) [2023-12-28 08:15:47,841][106226] Updated weights for policy 0, policy_version 1808949 (0.0010) [2023-12-28 08:15:47,882][106225] Updated weights for policy 1, policy_version 1813155 (0.0008) [2023-12-28 08:15:47,896][106226] Updated weights for policy 0, policy_version 1808959 (0.0011) [2023-12-28 08:15:47,945][106225] Updated weights for policy 1, policy_version 1813165 (0.0006) [2023-12-28 08:15:48,007][106225] Updated weights for policy 1, policy_version 1813175 (0.0008) [2023-12-28 08:15:48,607][106226] Updated weights for policy 0, policy_version 1808969 (0.0010) [2023-12-28 08:15:48,659][106226] Updated weights for policy 0, policy_version 1808979 (0.0008) [2023-12-28 08:15:48,718][106226] Updated weights for policy 0, policy_version 1808989 (0.0008) [2023-12-28 08:15:48,775][106226] Updated weights for policy 0, policy_version 1808999 (0.0009) [2023-12-28 08:15:48,778][106225] Updated weights for policy 1, policy_version 1813185 (0.0008) [2023-12-28 08:15:48,827][106225] Updated weights for policy 1, policy_version 1813195 (0.0008) [2023-12-28 08:15:48,877][106225] Updated weights for policy 1, policy_version 1813205 (0.0009) [2023-12-28 08:15:48,939][106225] Updated weights for policy 1, policy_version 1813215 (0.0008) [2023-12-28 08:15:49,547][106226] Updated weights for policy 0, policy_version 1809009 (0.0009) [2023-12-28 08:15:49,602][106226] Updated weights for policy 0, policy_version 1809019 (0.0008) [2023-12-28 08:15:49,662][106226] Updated weights for policy 0, policy_version 1809029 (0.0008) [2023-12-28 08:15:49,693][106225] Updated weights for policy 1, policy_version 1813225 (0.0007) [2023-12-28 08:15:49,753][106225] Updated weights for policy 1, policy_version 1813235 (0.0009) [2023-12-28 08:15:49,799][106225] Updated weights for policy 1, policy_version 1813245 (0.0009) [2023-12-28 08:15:50,451][106226] Updated weights for policy 0, policy_version 1809039 (0.0006) [2023-12-28 08:15:50,485][106225] Updated weights for policy 1, policy_version 1813255 (0.0006) [2023-12-28 08:15:50,517][106226] Updated weights for policy 0, policy_version 1809049 (0.0007) [2023-12-28 08:15:50,552][106225] Updated weights for policy 1, policy_version 1813265 (0.0006) [2023-12-28 08:15:50,581][106226] Updated weights for policy 0, policy_version 1809059 (0.0007) [2023-12-28 08:15:50,621][106225] Updated weights for policy 1, policy_version 1813275 (0.0008) [2023-12-28 08:15:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19387.7, 300 sec: 19799.6). Total num frames: 927457280. Throughput: 0: 9573.5, 1: 9812.4. Samples: 927470108. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:51,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.738')] [2023-12-28 08:15:51,291][106226] Updated weights for policy 0, policy_version 1809069 (0.0008) [2023-12-28 08:15:51,351][106225] Updated weights for policy 1, policy_version 1813285 (0.0007) [2023-12-28 08:15:51,356][106226] Updated weights for policy 0, policy_version 1809079 (0.0008) [2023-12-28 08:15:51,424][106225] Updated weights for policy 1, policy_version 1813295 (0.0008) [2023-12-28 08:15:51,435][106226] Updated weights for policy 0, policy_version 1809089 (0.0008) [2023-12-28 08:15:51,490][106225] Updated weights for policy 1, policy_version 1813305 (0.0007) [2023-12-28 08:15:52,145][106226] Updated weights for policy 0, policy_version 1809099 (0.0007) [2023-12-28 08:15:52,153][106225] Updated weights for policy 1, policy_version 1813315 (0.0006) [2023-12-28 08:15:52,199][106226] Updated weights for policy 0, policy_version 1809109 (0.0008) [2023-12-28 08:15:52,204][106225] Updated weights for policy 1, policy_version 1813325 (0.0008) [2023-12-28 08:15:52,255][106226] Updated weights for policy 0, policy_version 1809119 (0.0007) [2023-12-28 08:15:52,262][106225] Updated weights for policy 1, policy_version 1813335 (0.0008) [2023-12-28 08:15:52,853][106225] Updated weights for policy 1, policy_version 1813345 (0.0006) [2023-12-28 08:15:52,917][106225] Updated weights for policy 1, policy_version 1813355 (0.0007) [2023-12-28 08:15:52,950][106226] Updated weights for policy 0, policy_version 1809129 (0.0007) [2023-12-28 08:15:52,971][106225] Updated weights for policy 1, policy_version 1813365 (0.0005) [2023-12-28 08:15:53,004][106226] Updated weights for policy 0, policy_version 1809139 (0.0008) [2023-12-28 08:15:53,027][106225] Updated weights for policy 1, policy_version 1813375 (0.0005) [2023-12-28 08:15:53,067][106226] Updated weights for policy 0, policy_version 1809149 (0.0010) [2023-12-28 08:15:53,121][106226] Updated weights for policy 0, policy_version 1809159 (0.0008) [2023-12-28 08:15:53,592][106225] Updated weights for policy 1, policy_version 1813385 (0.0005) [2023-12-28 08:15:53,645][106225] Updated weights for policy 1, policy_version 1813395 (0.0007) [2023-12-28 08:15:53,700][106225] Updated weights for policy 1, policy_version 1813405 (0.0005) [2023-12-28 08:15:53,930][106226] Updated weights for policy 0, policy_version 1809169 (0.0007) [2023-12-28 08:15:53,995][106226] Updated weights for policy 0, policy_version 1809179 (0.0008) [2023-12-28 08:15:54,049][106226] Updated weights for policy 0, policy_version 1809189 (0.0008) [2023-12-28 08:15:54,381][106225] Updated weights for policy 1, policy_version 1813415 (0.0009) [2023-12-28 08:15:54,441][106225] Updated weights for policy 1, policy_version 1813425 (0.0010) [2023-12-28 08:15:54,508][106225] Updated weights for policy 1, policy_version 1813435 (0.0010) [2023-12-28 08:15:54,776][106226] Updated weights for policy 0, policy_version 1809199 (0.0008) [2023-12-28 08:15:54,836][106226] Updated weights for policy 0, policy_version 1809209 (0.0008) [2023-12-28 08:15:54,883][106226] Updated weights for policy 0, policy_version 1809219 (0.0008) [2023-12-28 08:15:55,189][106225] Updated weights for policy 1, policy_version 1813445 (0.0010) [2023-12-28 08:15:55,250][106225] Updated weights for policy 1, policy_version 1813455 (0.0007) [2023-12-28 08:15:55,318][106225] Updated weights for policy 1, policy_version 1813465 (0.0005) [2023-12-28 08:15:55,637][106226] Updated weights for policy 0, policy_version 1809229 (0.0008) [2023-12-28 08:15:55,692][106226] Updated weights for policy 0, policy_version 1809239 (0.0008) [2023-12-28 08:15:55,763][106226] Updated weights for policy 0, policy_version 1809249 (0.0008) [2023-12-28 08:15:55,935][106225] Updated weights for policy 1, policy_version 1813475 (0.0008) [2023-12-28 08:15:55,991][106225] Updated weights for policy 1, policy_version 1813485 (0.0007) [2023-12-28 08:15:56,042][106225] Updated weights for policy 1, policy_version 1813495 (0.0007) [2023-12-28 08:15:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 927563776. Throughput: 0: 9551.1, 1: 9861.5. Samples: 927530004. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:15:56,176][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.682')] [2023-12-28 08:15:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001813504_464314368.pth... [2023-12-28 08:15:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001809256_463249408.pth... [2023-12-28 08:15:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001812320_464011264.pth [2023-12-28 08:15:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001808136_462962688.pth [2023-12-28 08:15:56,508][106226] Updated weights for policy 0, policy_version 1809259 (0.0008) [2023-12-28 08:15:56,577][106226] Updated weights for policy 0, policy_version 1809269 (0.0008) [2023-12-28 08:15:56,641][106226] Updated weights for policy 0, policy_version 1809279 (0.0007) [2023-12-28 08:15:56,745][106225] Updated weights for policy 1, policy_version 1813505 (0.0008) [2023-12-28 08:15:56,804][106225] Updated weights for policy 1, policy_version 1813515 (0.0008) [2023-12-28 08:15:56,859][106225] Updated weights for policy 1, policy_version 1813525 (0.0008) [2023-12-28 08:15:56,909][106225] Updated weights for policy 1, policy_version 1813535 (0.0008) [2023-12-28 08:15:57,357][106226] Updated weights for policy 0, policy_version 1809289 (0.0008) [2023-12-28 08:15:57,414][106226] Updated weights for policy 0, policy_version 1809299 (0.0009) [2023-12-28 08:15:57,467][106226] Updated weights for policy 0, policy_version 1809309 (0.0009) [2023-12-28 08:15:57,524][106226] Updated weights for policy 0, policy_version 1809319 (0.0008) [2023-12-28 08:15:57,566][106225] Updated weights for policy 1, policy_version 1813545 (0.0008) [2023-12-28 08:15:57,616][106225] Updated weights for policy 1, policy_version 1813555 (0.0009) [2023-12-28 08:15:57,672][106225] Updated weights for policy 1, policy_version 1813565 (0.0008) [2023-12-28 08:15:58,292][106226] Updated weights for policy 0, policy_version 1809329 (0.0007) [2023-12-28 08:15:58,334][106225] Updated weights for policy 1, policy_version 1813575 (0.0008) [2023-12-28 08:15:58,366][106226] Updated weights for policy 0, policy_version 1809340 (0.0008) [2023-12-28 08:15:58,398][106225] Updated weights for policy 1, policy_version 1813585 (0.0008) [2023-12-28 08:15:58,436][106226] Updated weights for policy 0, policy_version 1809350 (0.0007) [2023-12-28 08:15:58,463][106225] Updated weights for policy 1, policy_version 1813595 (0.0008) [2023-12-28 08:15:59,218][106225] Updated weights for policy 1, policy_version 1813605 (0.0009) [2023-12-28 08:15:59,284][106225] Updated weights for policy 1, policy_version 1813615 (0.0007) [2023-12-28 08:15:59,352][106225] Updated weights for policy 1, policy_version 1813625 (0.0009) [2023-12-28 08:15:59,365][106226] Updated weights for policy 0, policy_version 1809360 (0.0007) [2023-12-28 08:15:59,428][106226] Updated weights for policy 0, policy_version 1809370 (0.0008) [2023-12-28 08:15:59,489][106226] Updated weights for policy 0, policy_version 1809380 (0.0008) [2023-12-28 08:16:00,062][106225] Updated weights for policy 1, policy_version 1813635 (0.0008) [2023-12-28 08:16:00,126][106225] Updated weights for policy 1, policy_version 1813645 (0.0009) [2023-12-28 08:16:00,183][106225] Updated weights for policy 1, policy_version 1813655 (0.0008) [2023-12-28 08:16:00,229][106226] Updated weights for policy 0, policy_version 1809390 (0.0008) [2023-12-28 08:16:00,289][106226] Updated weights for policy 0, policy_version 1809400 (0.0008) [2023-12-28 08:16:00,348][106226] Updated weights for policy 0, policy_version 1809410 (0.0008) [2023-12-28 08:16:00,871][106225] Updated weights for policy 1, policy_version 1813665 (0.0007) [2023-12-28 08:16:00,919][106225] Updated weights for policy 1, policy_version 1813675 (0.0010) [2023-12-28 08:16:00,969][106225] Updated weights for policy 1, policy_version 1813685 (0.0010) [2023-12-28 08:16:01,034][106225] Updated weights for policy 1, policy_version 1813695 (0.0008) [2023-12-28 08:16:01,070][106226] Updated weights for policy 0, policy_version 1809420 (0.0010) [2023-12-28 08:16:01,130][106226] Updated weights for policy 0, policy_version 1809430 (0.0008) [2023-12-28 08:16:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 927653888. Throughput: 0: 9476.4, 1: 9917.1. Samples: 927645200. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:01,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.734')] [2023-12-28 08:16:01,191][106226] Updated weights for policy 0, policy_version 1809440 (0.0007) [2023-12-28 08:16:01,830][106225] Updated weights for policy 1, policy_version 1813705 (0.0009) [2023-12-28 08:16:01,878][106225] Updated weights for policy 1, policy_version 1813715 (0.0008) [2023-12-28 08:16:01,904][106226] Updated weights for policy 0, policy_version 1809450 (0.0008) [2023-12-28 08:16:01,941][106225] Updated weights for policy 1, policy_version 1813725 (0.0007) [2023-12-28 08:16:01,963][106226] Updated weights for policy 0, policy_version 1809460 (0.0006) [2023-12-28 08:16:02,017][106226] Updated weights for policy 0, policy_version 1809470 (0.0009) [2023-12-28 08:16:02,074][106226] Updated weights for policy 0, policy_version 1809480 (0.0009) [2023-12-28 08:16:02,640][106225] Updated weights for policy 1, policy_version 1813735 (0.0006) [2023-12-28 08:16:02,701][106226] Updated weights for policy 0, policy_version 1809490 (0.0011) [2023-12-28 08:16:02,714][106225] Updated weights for policy 1, policy_version 1813745 (0.0007) [2023-12-28 08:16:02,764][106226] Updated weights for policy 0, policy_version 1809500 (0.0011) [2023-12-28 08:16:02,774][106225] Updated weights for policy 1, policy_version 1813755 (0.0007) [2023-12-28 08:16:02,821][106226] Updated weights for policy 0, policy_version 1809510 (0.0011) [2023-12-28 08:16:03,439][106225] Updated weights for policy 1, policy_version 1813765 (0.0007) [2023-12-28 08:16:03,473][106226] Updated weights for policy 0, policy_version 1809520 (0.0006) [2023-12-28 08:16:03,492][106225] Updated weights for policy 1, policy_version 1813775 (0.0006) [2023-12-28 08:16:03,527][106226] Updated weights for policy 0, policy_version 1809530 (0.0005) [2023-12-28 08:16:03,545][106225] Updated weights for policy 1, policy_version 1813785 (0.0006) [2023-12-28 08:16:03,584][106226] Updated weights for policy 0, policy_version 1809540 (0.0005) [2023-12-28 08:16:04,173][106225] Updated weights for policy 1, policy_version 1813795 (0.0006) [2023-12-28 08:16:04,216][106226] Updated weights for policy 0, policy_version 1809550 (0.0008) [2023-12-28 08:16:04,240][106225] Updated weights for policy 1, policy_version 1813805 (0.0007) [2023-12-28 08:16:04,282][106226] Updated weights for policy 0, policy_version 1809560 (0.0009) [2023-12-28 08:16:04,297][106225] Updated weights for policy 1, policy_version 1813815 (0.0006) [2023-12-28 08:16:04,347][106226] Updated weights for policy 0, policy_version 1809570 (0.0008) [2023-12-28 08:16:05,017][106225] Updated weights for policy 1, policy_version 1813825 (0.0007) [2023-12-28 08:16:05,029][106226] Updated weights for policy 0, policy_version 1809580 (0.0009) [2023-12-28 08:16:05,072][106225] Updated weights for policy 1, policy_version 1813835 (0.0008) [2023-12-28 08:16:05,087][106226] Updated weights for policy 0, policy_version 1809590 (0.0005) [2023-12-28 08:16:05,121][106225] Updated weights for policy 1, policy_version 1813845 (0.0007) [2023-12-28 08:16:05,147][106226] Updated weights for policy 0, policy_version 1809600 (0.0005) [2023-12-28 08:16:05,170][106225] Updated weights for policy 1, policy_version 1813855 (0.0008) [2023-12-28 08:16:05,812][106226] Updated weights for policy 0, policy_version 1809610 (0.0007) [2023-12-28 08:16:05,860][106226] Updated weights for policy 0, policy_version 1809620 (0.0009) [2023-12-28 08:16:05,909][106226] Updated weights for policy 0, policy_version 1809630 (0.0007) [2023-12-28 08:16:05,932][106225] Updated weights for policy 1, policy_version 1813865 (0.0007) [2023-12-28 08:16:05,958][106226] Updated weights for policy 0, policy_version 1809640 (0.0007) [2023-12-28 08:16:05,998][106225] Updated weights for policy 1, policy_version 1813875 (0.0007) [2023-12-28 08:16:06,056][106225] Updated weights for policy 1, policy_version 1813885 (0.0008) [2023-12-28 08:16:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19524.3, 300 sec: 19855.2). Total num frames: 927760384. Throughput: 0: 9551.5, 1: 9929.3. Samples: 927764868. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:06,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.920')] [2023-12-28 08:16:06,727][106226] Updated weights for policy 0, policy_version 1809650 (0.0006) [2023-12-28 08:16:06,791][106226] Updated weights for policy 0, policy_version 1809660 (0.0005) [2023-12-28 08:16:06,806][106225] Updated weights for policy 1, policy_version 1813895 (0.0008) [2023-12-28 08:16:06,850][106226] Updated weights for policy 0, policy_version 1809670 (0.0007) [2023-12-28 08:16:06,862][106225] Updated weights for policy 1, policy_version 1813905 (0.0007) [2023-12-28 08:16:06,928][106225] Updated weights for policy 1, policy_version 1813915 (0.0009) [2023-12-28 08:16:07,442][106226] Updated weights for policy 0, policy_version 1809680 (0.0009) [2023-12-28 08:16:07,505][106226] Updated weights for policy 0, policy_version 1809690 (0.0011) [2023-12-28 08:16:07,559][106226] Updated weights for policy 0, policy_version 1809700 (0.0005) [2023-12-28 08:16:07,694][106225] Updated weights for policy 1, policy_version 1813925 (0.0008) [2023-12-28 08:16:07,755][106225] Updated weights for policy 1, policy_version 1813935 (0.0008) [2023-12-28 08:16:07,814][106225] Updated weights for policy 1, policy_version 1813945 (0.0008) [2023-12-28 08:16:08,207][106226] Updated weights for policy 0, policy_version 1809710 (0.0005) [2023-12-28 08:16:08,266][106226] Updated weights for policy 0, policy_version 1809720 (0.0005) [2023-12-28 08:16:08,313][106226] Updated weights for policy 0, policy_version 1809730 (0.0005) [2023-12-28 08:16:08,548][106225] Updated weights for policy 1, policy_version 1813955 (0.0007) [2023-12-28 08:16:08,601][106225] Updated weights for policy 1, policy_version 1813965 (0.0008) [2023-12-28 08:16:08,659][106225] Updated weights for policy 1, policy_version 1813975 (0.0007) [2023-12-28 08:16:08,983][106226] Updated weights for policy 0, policy_version 1809740 (0.0008) [2023-12-28 08:16:09,036][106226] Updated weights for policy 0, policy_version 1809750 (0.0006) [2023-12-28 08:16:09,087][106226] Updated weights for policy 0, policy_version 1809760 (0.0007) [2023-12-28 08:16:09,332][106225] Updated weights for policy 1, policy_version 1813985 (0.0006) [2023-12-28 08:16:09,397][106225] Updated weights for policy 1, policy_version 1813995 (0.0009) [2023-12-28 08:16:09,469][106225] Updated weights for policy 1, policy_version 1814005 (0.0009) [2023-12-28 08:16:09,533][106225] Updated weights for policy 1, policy_version 1814015 (0.0010) [2023-12-28 08:16:09,885][106226] Updated weights for policy 0, policy_version 1809770 (0.0006) [2023-12-28 08:16:09,951][106226] Updated weights for policy 0, policy_version 1809780 (0.0009) [2023-12-28 08:16:09,999][106226] Updated weights for policy 0, policy_version 1809790 (0.0008) [2023-12-28 08:16:10,058][106226] Updated weights for policy 0, policy_version 1809800 (0.0008) [2023-12-28 08:16:10,306][106225] Updated weights for policy 1, policy_version 1814025 (0.0010) [2023-12-28 08:16:10,363][106225] Updated weights for policy 1, policy_version 1814035 (0.0010) [2023-12-28 08:16:10,423][106225] Updated weights for policy 1, policy_version 1814045 (0.0010) [2023-12-28 08:16:10,831][106226] Updated weights for policy 0, policy_version 1809810 (0.0008) [2023-12-28 08:16:10,896][106226] Updated weights for policy 0, policy_version 1809820 (0.0008) [2023-12-28 08:16:10,949][106226] Updated weights for policy 0, policy_version 1809830 (0.0007) [2023-12-28 08:16:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 927850496. Throughput: 0: 9605.1, 1: 9945.9. Samples: 927824100. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:11,175][105115] Avg episode reward: [(0, '-4.548'), (1, '-4.500')] [2023-12-28 08:16:11,179][106225] Updated weights for policy 1, policy_version 1814055 (0.0009) [2023-12-28 08:16:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001809832_463396864.pth... [2023-12-28 08:16:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001808712_463110144.pth [2023-12-28 08:16:11,244][106225] Updated weights for policy 1, policy_version 1814065 (0.0006) [2023-12-28 08:16:11,308][106225] Updated weights for policy 1, policy_version 1814075 (0.0008) [2023-12-28 08:16:11,356][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001814080_464461824.pth... [2023-12-28 08:16:11,362][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001812896_464158720.pth [2023-12-28 08:16:11,777][106226] Updated weights for policy 0, policy_version 1809840 (0.0009) [2023-12-28 08:16:11,835][106226] Updated weights for policy 0, policy_version 1809850 (0.0009) [2023-12-28 08:16:11,891][106226] Updated weights for policy 0, policy_version 1809860 (0.0008) [2023-12-28 08:16:12,102][106225] Updated weights for policy 1, policy_version 1814085 (0.0007) [2023-12-28 08:16:12,165][106225] Updated weights for policy 1, policy_version 1814095 (0.0008) [2023-12-28 08:16:12,220][106225] Updated weights for policy 1, policy_version 1814105 (0.0007) [2023-12-28 08:16:12,610][106226] Updated weights for policy 0, policy_version 1809870 (0.0009) [2023-12-28 08:16:12,672][106226] Updated weights for policy 0, policy_version 1809880 (0.0009) [2023-12-28 08:16:12,740][106226] Updated weights for policy 0, policy_version 1809890 (0.0010) [2023-12-28 08:16:12,976][106225] Updated weights for policy 1, policy_version 1814115 (0.0009) [2023-12-28 08:16:13,031][106225] Updated weights for policy 1, policy_version 1814125 (0.0008) [2023-12-28 08:16:13,090][106225] Updated weights for policy 1, policy_version 1814135 (0.0007) [2023-12-28 08:16:13,409][106226] Updated weights for policy 0, policy_version 1809900 (0.0011) [2023-12-28 08:16:13,469][106226] Updated weights for policy 0, policy_version 1809910 (0.0010) [2023-12-28 08:16:13,528][106226] Updated weights for policy 0, policy_version 1809920 (0.0009) [2023-12-28 08:16:13,826][106225] Updated weights for policy 1, policy_version 1814145 (0.0008) [2023-12-28 08:16:13,875][106225] Updated weights for policy 1, policy_version 1814155 (0.0008) [2023-12-28 08:16:13,922][106225] Updated weights for policy 1, policy_version 1814165 (0.0008) [2023-12-28 08:16:13,977][106225] Updated weights for policy 1, policy_version 1814175 (0.0008) [2023-12-28 08:16:14,274][106226] Updated weights for policy 0, policy_version 1809930 (0.0009) [2023-12-28 08:16:14,330][106226] Updated weights for policy 0, policy_version 1809940 (0.0009) [2023-12-28 08:16:14,379][106226] Updated weights for policy 0, policy_version 1809950 (0.0008) [2023-12-28 08:16:14,430][106226] Updated weights for policy 0, policy_version 1809960 (0.0008) [2023-12-28 08:16:14,608][106225] Updated weights for policy 1, policy_version 1814185 (0.0008) [2023-12-28 08:16:14,671][106225] Updated weights for policy 1, policy_version 1814195 (0.0009) [2023-12-28 08:16:14,732][106225] Updated weights for policy 1, policy_version 1814205 (0.0009) [2023-12-28 08:16:15,218][106226] Updated weights for policy 0, policy_version 1809970 (0.0006) [2023-12-28 08:16:15,274][106226] Updated weights for policy 0, policy_version 1809980 (0.0005) [2023-12-28 08:16:15,333][106226] Updated weights for policy 0, policy_version 1809990 (0.0006) [2023-12-28 08:16:15,524][106225] Updated weights for policy 1, policy_version 1814215 (0.0008) [2023-12-28 08:16:15,575][106225] Updated weights for policy 1, policy_version 1814225 (0.0009) [2023-12-28 08:16:15,624][106225] Updated weights for policy 1, policy_version 1814235 (0.0007) [2023-12-28 08:16:15,853][106226] Updated weights for policy 0, policy_version 1810000 (0.0006) [2023-12-28 08:16:15,921][106226] Updated weights for policy 0, policy_version 1810010 (0.0005) [2023-12-28 08:16:15,986][106226] Updated weights for policy 0, policy_version 1810020 (0.0006) [2023-12-28 08:16:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.4, 300 sec: 19799.7). Total num frames: 927948800. Throughput: 0: 9587.5, 1: 9881.6. Samples: 927936496. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:16,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.994')] [2023-12-28 08:16:16,236][106225] Updated weights for policy 1, policy_version 1814245 (0.0007) [2023-12-28 08:16:16,287][106225] Updated weights for policy 1, policy_version 1814255 (0.0009) [2023-12-28 08:16:16,342][106225] Updated weights for policy 1, policy_version 1814265 (0.0008) [2023-12-28 08:16:16,546][106226] Updated weights for policy 0, policy_version 1810030 (0.0010) [2023-12-28 08:16:16,600][106226] Updated weights for policy 0, policy_version 1810040 (0.0009) [2023-12-28 08:16:16,656][106226] Updated weights for policy 0, policy_version 1810050 (0.0008) [2023-12-28 08:16:17,010][106225] Updated weights for policy 1, policy_version 1814275 (0.0007) [2023-12-28 08:16:17,066][106225] Updated weights for policy 1, policy_version 1814285 (0.0010) [2023-12-28 08:16:17,121][106225] Updated weights for policy 1, policy_version 1814295 (0.0010) [2023-12-28 08:16:17,427][106226] Updated weights for policy 0, policy_version 1810060 (0.0008) [2023-12-28 08:16:17,481][106226] Updated weights for policy 0, policy_version 1810070 (0.0008) [2023-12-28 08:16:17,552][106226] Updated weights for policy 0, policy_version 1810080 (0.0005) [2023-12-28 08:16:17,824][106225] Updated weights for policy 1, policy_version 1814305 (0.0009) [2023-12-28 08:16:17,899][106225] Updated weights for policy 1, policy_version 1814315 (0.0009) [2023-12-28 08:16:17,969][106225] Updated weights for policy 1, policy_version 1814325 (0.0009) [2023-12-28 08:16:18,028][106225] Updated weights for policy 1, policy_version 1814335 (0.0008) [2023-12-28 08:16:18,179][106226] Updated weights for policy 0, policy_version 1810090 (0.0005) [2023-12-28 08:16:18,229][106226] Updated weights for policy 0, policy_version 1810100 (0.0008) [2023-12-28 08:16:18,274][106226] Updated weights for policy 0, policy_version 1810110 (0.0008) [2023-12-28 08:16:18,339][106226] Updated weights for policy 0, policy_version 1810120 (0.0009) [2023-12-28 08:16:18,766][106225] Updated weights for policy 1, policy_version 1814345 (0.0009) [2023-12-28 08:16:18,826][106225] Updated weights for policy 1, policy_version 1814355 (0.0009) [2023-12-28 08:16:18,878][106225] Updated weights for policy 1, policy_version 1814365 (0.0008) [2023-12-28 08:16:19,079][106226] Updated weights for policy 0, policy_version 1810130 (0.0008) [2023-12-28 08:16:19,146][106226] Updated weights for policy 0, policy_version 1810140 (0.0007) [2023-12-28 08:16:19,203][106226] Updated weights for policy 0, policy_version 1810150 (0.0005) [2023-12-28 08:16:19,657][106225] Updated weights for policy 1, policy_version 1814375 (0.0008) [2023-12-28 08:16:19,722][106225] Updated weights for policy 1, policy_version 1814385 (0.0007) [2023-12-28 08:16:19,785][106225] Updated weights for policy 1, policy_version 1814395 (0.0008) [2023-12-28 08:16:19,916][106226] Updated weights for policy 0, policy_version 1810160 (0.0009) [2023-12-28 08:16:19,985][106226] Updated weights for policy 0, policy_version 1810170 (0.0008) [2023-12-28 08:16:20,048][106226] Updated weights for policy 0, policy_version 1810180 (0.0008) [2023-12-28 08:16:20,544][106225] Updated weights for policy 1, policy_version 1814405 (0.0008) [2023-12-28 08:16:20,626][106225] Updated weights for policy 1, policy_version 1814415 (0.0008) [2023-12-28 08:16:20,689][106225] Updated weights for policy 1, policy_version 1814425 (0.0007) [2023-12-28 08:16:20,787][106226] Updated weights for policy 0, policy_version 1810190 (0.0009) [2023-12-28 08:16:20,848][106226] Updated weights for policy 0, policy_version 1810200 (0.0008) [2023-12-28 08:16:20,914][106226] Updated weights for policy 0, policy_version 1810210 (0.0008) [2023-12-28 08:16:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 928047104. Throughput: 0: 9688.8, 1: 9831.1. Samples: 928055236. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:21,175][105115] Avg episode reward: [(0, '-4.203'), (1, '-4.997')] [2023-12-28 08:16:21,470][106225] Updated weights for policy 1, policy_version 1814435 (0.0008) [2023-12-28 08:16:21,540][106225] Updated weights for policy 1, policy_version 1814445 (0.0007) [2023-12-28 08:16:21,604][106225] Updated weights for policy 1, policy_version 1814455 (0.0010) [2023-12-28 08:16:21,702][106226] Updated weights for policy 0, policy_version 1810220 (0.0008) [2023-12-28 08:16:21,775][106226] Updated weights for policy 0, policy_version 1810230 (0.0008) [2023-12-28 08:16:21,840][106226] Updated weights for policy 0, policy_version 1810240 (0.0007) [2023-12-28 08:16:22,304][106225] Updated weights for policy 1, policy_version 1814465 (0.0009) [2023-12-28 08:16:22,394][106225] Updated weights for policy 1, policy_version 1814475 (0.0009) [2023-12-28 08:16:22,450][106225] Updated weights for policy 1, policy_version 1814485 (0.0008) [2023-12-28 08:16:22,503][106225] Updated weights for policy 1, policy_version 1814495 (0.0009) [2023-12-28 08:16:22,598][106226] Updated weights for policy 0, policy_version 1810250 (0.0009) [2023-12-28 08:16:22,668][106226] Updated weights for policy 0, policy_version 1810260 (0.0010) [2023-12-28 08:16:22,734][106226] Updated weights for policy 0, policy_version 1810270 (0.0008) [2023-12-28 08:16:22,801][106226] Updated weights for policy 0, policy_version 1810280 (0.0006) [2023-12-28 08:16:23,179][106225] Updated weights for policy 1, policy_version 1814505 (0.0009) [2023-12-28 08:16:23,242][106225] Updated weights for policy 1, policy_version 1814515 (0.0008) [2023-12-28 08:16:23,302][106225] Updated weights for policy 1, policy_version 1814525 (0.0008) [2023-12-28 08:16:23,504][106226] Updated weights for policy 0, policy_version 1810290 (0.0009) [2023-12-28 08:16:23,563][106226] Updated weights for policy 0, policy_version 1810300 (0.0008) [2023-12-28 08:16:23,627][106226] Updated weights for policy 0, policy_version 1810310 (0.0008) [2023-12-28 08:16:24,033][106225] Updated weights for policy 1, policy_version 1814535 (0.0008) [2023-12-28 08:16:24,095][106225] Updated weights for policy 1, policy_version 1814545 (0.0006) [2023-12-28 08:16:24,145][106225] Updated weights for policy 1, policy_version 1814555 (0.0010) [2023-12-28 08:16:24,343][106226] Updated weights for policy 0, policy_version 1810320 (0.0008) [2023-12-28 08:16:24,414][106226] Updated weights for policy 0, policy_version 1810330 (0.0009) [2023-12-28 08:16:24,481][106226] Updated weights for policy 0, policy_version 1810340 (0.0008) [2023-12-28 08:16:24,810][106225] Updated weights for policy 1, policy_version 1814565 (0.0009) [2023-12-28 08:16:24,857][106225] Updated weights for policy 1, policy_version 1814575 (0.0010) [2023-12-28 08:16:24,907][106225] Updated weights for policy 1, policy_version 1814585 (0.0010) [2023-12-28 08:16:25,188][106226] Updated weights for policy 0, policy_version 1810350 (0.0008) [2023-12-28 08:16:25,246][106226] Updated weights for policy 0, policy_version 1810360 (0.0009) [2023-12-28 08:16:25,304][106226] Updated weights for policy 0, policy_version 1810370 (0.0008) [2023-12-28 08:16:25,635][106225] Updated weights for policy 1, policy_version 1814595 (0.0010) [2023-12-28 08:16:25,696][106225] Updated weights for policy 1, policy_version 1814605 (0.0008) [2023-12-28 08:16:25,751][106225] Updated weights for policy 1, policy_version 1814615 (0.0009) [2023-12-28 08:16:26,046][106226] Updated weights for policy 0, policy_version 1810380 (0.0009) [2023-12-28 08:16:26,097][106226] Updated weights for policy 0, policy_version 1810390 (0.0008) [2023-12-28 08:16:26,162][106226] Updated weights for policy 0, policy_version 1810400 (0.0008) [2023-12-28 08:16:26,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19387.8, 300 sec: 19771.9). Total num frames: 928137216. Throughput: 0: 9631.3, 1: 9793.2. Samples: 928111676. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-28 08:16:26,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.949')] [2023-12-28 08:16:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001814624_464601088.pth... [2023-12-28 08:16:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001813504_464314368.pth [2023-12-28 08:16:26,210][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001810408_463544320.pth... [2023-12-28 08:16:26,214][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001809256_463249408.pth [2023-12-28 08:16:26,456][106225] Updated weights for policy 1, policy_version 1814625 (0.0008) [2023-12-28 08:16:26,507][106225] Updated weights for policy 1, policy_version 1814635 (0.0008) [2023-12-28 08:16:26,571][106225] Updated weights for policy 1, policy_version 1814645 (0.0008) [2023-12-28 08:16:26,627][106225] Updated weights for policy 1, policy_version 1814655 (0.0007) [2023-12-28 08:16:26,920][106226] Updated weights for policy 0, policy_version 1810410 (0.0009) [2023-12-28 08:16:26,982][106226] Updated weights for policy 0, policy_version 1810420 (0.0009) [2023-12-28 08:16:27,042][106226] Updated weights for policy 0, policy_version 1810430 (0.0009) [2023-12-28 08:16:27,095][106226] Updated weights for policy 0, policy_version 1810440 (0.0008) [2023-12-28 08:16:27,231][106225] Updated weights for policy 1, policy_version 1814665 (0.0006) [2023-12-28 08:16:27,285][106225] Updated weights for policy 1, policy_version 1814675 (0.0007) [2023-12-28 08:16:27,338][106225] Updated weights for policy 1, policy_version 1814685 (0.0008) [2023-12-28 08:16:27,805][106226] Updated weights for policy 0, policy_version 1810450 (0.0006) [2023-12-28 08:16:27,853][106226] Updated weights for policy 0, policy_version 1810460 (0.0008) [2023-12-28 08:16:27,896][106226] Updated weights for policy 0, policy_version 1810470 (0.0008) [2023-12-28 08:16:28,073][106225] Updated weights for policy 1, policy_version 1814695 (0.0008) [2023-12-28 08:16:28,138][106225] Updated weights for policy 1, policy_version 1814705 (0.0008) [2023-12-28 08:16:28,194][106225] Updated weights for policy 1, policy_version 1814715 (0.0008) [2023-12-28 08:16:28,585][106226] Updated weights for policy 0, policy_version 1810480 (0.0009) [2023-12-28 08:16:28,640][106226] Updated weights for policy 0, policy_version 1810490 (0.0008) [2023-12-28 08:16:28,695][106226] Updated weights for policy 0, policy_version 1810500 (0.0007) [2023-12-28 08:16:28,968][106225] Updated weights for policy 1, policy_version 1814725 (0.0008) [2023-12-28 08:16:29,028][106225] Updated weights for policy 1, policy_version 1814735 (0.0009) [2023-12-28 08:16:29,088][106225] Updated weights for policy 1, policy_version 1814745 (0.0009) [2023-12-28 08:16:29,356][106226] Updated weights for policy 0, policy_version 1810510 (0.0008) [2023-12-28 08:16:29,419][106226] Updated weights for policy 0, policy_version 1810520 (0.0008) [2023-12-28 08:16:29,481][106226] Updated weights for policy 0, policy_version 1810530 (0.0005) [2023-12-28 08:16:29,786][106225] Updated weights for policy 1, policy_version 1814755 (0.0007) [2023-12-28 08:16:29,855][106225] Updated weights for policy 1, policy_version 1814765 (0.0007) [2023-12-28 08:16:29,921][106225] Updated weights for policy 1, policy_version 1814775 (0.0009) [2023-12-28 08:16:30,122][106226] Updated weights for policy 0, policy_version 1810540 (0.0005) [2023-12-28 08:16:30,175][106226] Updated weights for policy 0, policy_version 1810550 (0.0007) [2023-12-28 08:16:30,229][106226] Updated weights for policy 0, policy_version 1810560 (0.0009) [2023-12-28 08:16:30,533][106225] Updated weights for policy 1, policy_version 1814785 (0.0009) [2023-12-28 08:16:30,577][106225] Updated weights for policy 1, policy_version 1814795 (0.0008) [2023-12-28 08:16:30,629][106225] Updated weights for policy 1, policy_version 1814805 (0.0009) [2023-12-28 08:16:30,686][106225] Updated weights for policy 1, policy_version 1814815 (0.0008) [2023-12-28 08:16:30,944][106226] Updated weights for policy 0, policy_version 1810570 (0.0008) [2023-12-28 08:16:30,992][106226] Updated weights for policy 0, policy_version 1810580 (0.0008) [2023-12-28 08:16:31,053][106226] Updated weights for policy 0, policy_version 1810590 (0.0008) [2023-12-28 08:16:31,124][106226] Updated weights for policy 0, policy_version 1810600 (0.0007) [2023-12-28 08:16:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 928243712. Throughput: 0: 9679.9, 1: 9800.7. Samples: 928230136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:31,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.693')] [2023-12-28 08:16:31,403][106225] Updated weights for policy 1, policy_version 1814825 (0.0011) [2023-12-28 08:16:31,464][106225] Updated weights for policy 1, policy_version 1814835 (0.0010) [2023-12-28 08:16:31,521][106225] Updated weights for policy 1, policy_version 1814845 (0.0010) [2023-12-28 08:16:31,928][106226] Updated weights for policy 0, policy_version 1810610 (0.0009) [2023-12-28 08:16:31,976][106226] Updated weights for policy 0, policy_version 1810620 (0.0008) [2023-12-28 08:16:32,039][106226] Updated weights for policy 0, policy_version 1810630 (0.0008) [2023-12-28 08:16:32,252][106225] Updated weights for policy 1, policy_version 1814855 (0.0010) [2023-12-28 08:16:32,300][106225] Updated weights for policy 1, policy_version 1814865 (0.0009) [2023-12-28 08:16:32,355][106225] Updated weights for policy 1, policy_version 1814875 (0.0008) [2023-12-28 08:16:32,739][106226] Updated weights for policy 0, policy_version 1810640 (0.0008) [2023-12-28 08:16:32,801][106226] Updated weights for policy 0, policy_version 1810650 (0.0008) [2023-12-28 08:16:32,863][106226] Updated weights for policy 0, policy_version 1810660 (0.0008) [2023-12-28 08:16:33,075][106225] Updated weights for policy 1, policy_version 1814885 (0.0009) [2023-12-28 08:16:33,134][106225] Updated weights for policy 1, policy_version 1814895 (0.0008) [2023-12-28 08:16:33,199][106225] Updated weights for policy 1, policy_version 1814905 (0.0010) [2023-12-28 08:16:33,487][106226] Updated weights for policy 0, policy_version 1810670 (0.0007) [2023-12-28 08:16:33,543][106226] Updated weights for policy 0, policy_version 1810680 (0.0009) [2023-12-28 08:16:33,608][106226] Updated weights for policy 0, policy_version 1810690 (0.0009) [2023-12-28 08:16:33,833][106225] Updated weights for policy 1, policy_version 1814915 (0.0008) [2023-12-28 08:16:33,894][106225] Updated weights for policy 1, policy_version 1814925 (0.0008) [2023-12-28 08:16:33,960][106225] Updated weights for policy 1, policy_version 1814935 (0.0009) [2023-12-28 08:16:34,309][106226] Updated weights for policy 0, policy_version 1810700 (0.0009) [2023-12-28 08:16:34,368][106226] Updated weights for policy 0, policy_version 1810710 (0.0010) [2023-12-28 08:16:34,431][106226] Updated weights for policy 0, policy_version 1810720 (0.0007) [2023-12-28 08:16:34,769][106225] Updated weights for policy 1, policy_version 1814945 (0.0009) [2023-12-28 08:16:34,825][106225] Updated weights for policy 1, policy_version 1814955 (0.0008) [2023-12-28 08:16:34,882][106225] Updated weights for policy 1, policy_version 1814965 (0.0008) [2023-12-28 08:16:34,941][106225] Updated weights for policy 1, policy_version 1814975 (0.0008) [2023-12-28 08:16:35,073][106226] Updated weights for policy 0, policy_version 1810730 (0.0006) [2023-12-28 08:16:35,134][106226] Updated weights for policy 0, policy_version 1810740 (0.0008) [2023-12-28 08:16:35,184][106226] Updated weights for policy 0, policy_version 1810750 (0.0006) [2023-12-28 08:16:35,233][106226] Updated weights for policy 0, policy_version 1810760 (0.0007) [2023-12-28 08:16:35,608][106225] Updated weights for policy 1, policy_version 1814985 (0.0007) [2023-12-28 08:16:35,657][106225] Updated weights for policy 1, policy_version 1814995 (0.0008) [2023-12-28 08:16:35,712][106225] Updated weights for policy 1, policy_version 1815005 (0.0009) [2023-12-28 08:16:35,950][106226] Updated weights for policy 0, policy_version 1810770 (0.0010) [2023-12-28 08:16:36,008][106226] Updated weights for policy 0, policy_version 1810780 (0.0011) [2023-12-28 08:16:36,068][106226] Updated weights for policy 0, policy_version 1810790 (0.0010) [2023-12-28 08:16:36,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 928342016. Throughput: 0: 9724.8, 1: 9805.7. Samples: 928348980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:36,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.698')] [2023-12-28 08:16:36,443][106225] Updated weights for policy 1, policy_version 1815015 (0.0008) [2023-12-28 08:16:36,505][106225] Updated weights for policy 1, policy_version 1815025 (0.0009) [2023-12-28 08:16:36,568][106225] Updated weights for policy 1, policy_version 1815035 (0.0009) [2023-12-28 08:16:36,790][106226] Updated weights for policy 0, policy_version 1810800 (0.0009) [2023-12-28 08:16:36,839][106226] Updated weights for policy 0, policy_version 1810810 (0.0005) [2023-12-28 08:16:36,891][106226] Updated weights for policy 0, policy_version 1810820 (0.0010) [2023-12-28 08:16:37,191][106225] Updated weights for policy 1, policy_version 1815045 (0.0007) [2023-12-28 08:16:37,256][106225] Updated weights for policy 1, policy_version 1815055 (0.0008) [2023-12-28 08:16:37,316][106225] Updated weights for policy 1, policy_version 1815065 (0.0010) [2023-12-28 08:16:37,602][106226] Updated weights for policy 0, policy_version 1810830 (0.0010) [2023-12-28 08:16:37,659][106226] Updated weights for policy 0, policy_version 1810840 (0.0010) [2023-12-28 08:16:37,712][106226] Updated weights for policy 0, policy_version 1810850 (0.0010) [2023-12-28 08:16:38,016][106225] Updated weights for policy 1, policy_version 1815075 (0.0009) [2023-12-28 08:16:38,073][106225] Updated weights for policy 1, policy_version 1815085 (0.0006) [2023-12-28 08:16:38,123][106225] Updated weights for policy 1, policy_version 1815095 (0.0005) [2023-12-28 08:16:38,422][106226] Updated weights for policy 0, policy_version 1810860 (0.0011) [2023-12-28 08:16:38,482][106226] Updated weights for policy 0, policy_version 1810870 (0.0010) [2023-12-28 08:16:38,539][106226] Updated weights for policy 0, policy_version 1810880 (0.0010) [2023-12-28 08:16:38,825][106225] Updated weights for policy 1, policy_version 1815105 (0.0006) [2023-12-28 08:16:38,874][106225] Updated weights for policy 1, policy_version 1815115 (0.0008) [2023-12-28 08:16:38,925][106225] Updated weights for policy 1, policy_version 1815125 (0.0008) [2023-12-28 08:16:38,984][106225] Updated weights for policy 1, policy_version 1815135 (0.0008) [2023-12-28 08:16:39,207][106226] Updated weights for policy 0, policy_version 1810890 (0.0009) [2023-12-28 08:16:39,277][106226] Updated weights for policy 0, policy_version 1810900 (0.0007) [2023-12-28 08:16:39,342][106226] Updated weights for policy 0, policy_version 1810910 (0.0009) [2023-12-28 08:16:39,416][106226] Updated weights for policy 0, policy_version 1810920 (0.0009) [2023-12-28 08:16:39,775][106225] Updated weights for policy 1, policy_version 1815145 (0.0008) [2023-12-28 08:16:39,836][106225] Updated weights for policy 1, policy_version 1815155 (0.0009) [2023-12-28 08:16:39,899][106225] Updated weights for policy 1, policy_version 1815165 (0.0008) [2023-12-28 08:16:40,156][106226] Updated weights for policy 0, policy_version 1810930 (0.0010) [2023-12-28 08:16:40,218][106226] Updated weights for policy 0, policy_version 1810940 (0.0008) [2023-12-28 08:16:40,278][106226] Updated weights for policy 0, policy_version 1810950 (0.0008) [2023-12-28 08:16:40,671][106225] Updated weights for policy 1, policy_version 1815175 (0.0006) [2023-12-28 08:16:40,719][106225] Updated weights for policy 1, policy_version 1815185 (0.0005) [2023-12-28 08:16:40,770][106225] Updated weights for policy 1, policy_version 1815195 (0.0007) [2023-12-28 08:16:40,922][106226] Updated weights for policy 0, policy_version 1810960 (0.0006) [2023-12-28 08:16:40,986][106226] Updated weights for policy 0, policy_version 1810970 (0.0009) [2023-12-28 08:16:41,052][106226] Updated weights for policy 0, policy_version 1810980 (0.0008) [2023-12-28 08:16:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 928440320. Throughput: 0: 9767.9, 1: 9771.3. Samples: 928409264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:41,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.771')] [2023-12-28 08:16:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001815200_464748544.pth... [2023-12-28 08:16:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001810984_463691776.pth... [2023-12-28 08:16:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001809832_463396864.pth [2023-12-28 08:16:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001814080_464461824.pth [2023-12-28 08:16:41,560][106225] Updated weights for policy 1, policy_version 1815205 (0.0008) [2023-12-28 08:16:41,617][106225] Updated weights for policy 1, policy_version 1815215 (0.0010) [2023-12-28 08:16:41,681][106225] Updated weights for policy 1, policy_version 1815225 (0.0008) [2023-12-28 08:16:41,801][106226] Updated weights for policy 0, policy_version 1810990 (0.0007) [2023-12-28 08:16:41,860][106226] Updated weights for policy 0, policy_version 1811000 (0.0005) [2023-12-28 08:16:41,914][106226] Updated weights for policy 0, policy_version 1811010 (0.0005) [2023-12-28 08:16:42,463][106225] Updated weights for policy 1, policy_version 1815235 (0.0009) [2023-12-28 08:16:42,522][106225] Updated weights for policy 1, policy_version 1815245 (0.0008) [2023-12-28 08:16:42,585][106225] Updated weights for policy 1, policy_version 1815255 (0.0008) [2023-12-28 08:16:42,596][106226] Updated weights for policy 0, policy_version 1811020 (0.0008) [2023-12-28 08:16:42,658][106226] Updated weights for policy 0, policy_version 1811030 (0.0007) [2023-12-28 08:16:42,713][106226] Updated weights for policy 0, policy_version 1811040 (0.0009) [2023-12-28 08:16:43,295][106225] Updated weights for policy 1, policy_version 1815265 (0.0008) [2023-12-28 08:16:43,349][106225] Updated weights for policy 1, policy_version 1815275 (0.0005) [2023-12-28 08:16:43,403][106225] Updated weights for policy 1, policy_version 1815285 (0.0005) [2023-12-28 08:16:43,453][106225] Updated weights for policy 1, policy_version 1815295 (0.0005) [2023-12-28 08:16:43,457][106226] Updated weights for policy 0, policy_version 1811050 (0.0008) [2023-12-28 08:16:43,510][106226] Updated weights for policy 0, policy_version 1811060 (0.0009) [2023-12-28 08:16:43,558][106226] Updated weights for policy 0, policy_version 1811070 (0.0008) [2023-12-28 08:16:43,611][106226] Updated weights for policy 0, policy_version 1811080 (0.0008) [2023-12-28 08:16:43,996][106225] Updated weights for policy 1, policy_version 1815305 (0.0007) [2023-12-28 08:16:44,051][106225] Updated weights for policy 1, policy_version 1815315 (0.0008) [2023-12-28 08:16:44,099][106225] Updated weights for policy 1, policy_version 1815325 (0.0008) [2023-12-28 08:16:44,409][106226] Updated weights for policy 0, policy_version 1811090 (0.0009) [2023-12-28 08:16:44,467][106226] Updated weights for policy 0, policy_version 1811100 (0.0009) [2023-12-28 08:16:44,529][106226] Updated weights for policy 0, policy_version 1811110 (0.0008) [2023-12-28 08:16:44,752][106225] Updated weights for policy 1, policy_version 1815335 (0.0009) [2023-12-28 08:16:44,830][106225] Updated weights for policy 1, policy_version 1815345 (0.0009) [2023-12-28 08:16:44,897][106225] Updated weights for policy 1, policy_version 1815355 (0.0009) [2023-12-28 08:16:45,349][106226] Updated weights for policy 0, policy_version 1811120 (0.0008) [2023-12-28 08:16:45,406][106226] Updated weights for policy 0, policy_version 1811130 (0.0008) [2023-12-28 08:16:45,462][106226] Updated weights for policy 0, policy_version 1811140 (0.0007) [2023-12-28 08:16:45,578][106225] Updated weights for policy 1, policy_version 1815365 (0.0008) [2023-12-28 08:16:45,628][106225] Updated weights for policy 1, policy_version 1815375 (0.0010) [2023-12-28 08:16:45,681][106225] Updated weights for policy 1, policy_version 1815385 (0.0010) [2023-12-28 08:16:46,062][106226] Updated weights for policy 0, policy_version 1811150 (0.0007) [2023-12-28 08:16:46,126][106226] Updated weights for policy 0, policy_version 1811160 (0.0005) [2023-12-28 08:16:46,174][106226] Updated weights for policy 0, policy_version 1811170 (0.0005) [2023-12-28 08:16:46,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 928530432. Throughput: 0: 9813.5, 1: 9719.9. Samples: 928524208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:46,176][105115] Avg episode reward: [(0, '-4.365'), (1, '-5.041')] [2023-12-28 08:16:46,395][106225] Updated weights for policy 1, policy_version 1815395 (0.0010) [2023-12-28 08:16:46,447][106225] Updated weights for policy 1, policy_version 1815405 (0.0010) [2023-12-28 08:16:46,504][106225] Updated weights for policy 1, policy_version 1815415 (0.0010) [2023-12-28 08:16:46,756][106226] Updated weights for policy 0, policy_version 1811180 (0.0005) [2023-12-28 08:16:46,823][106226] Updated weights for policy 0, policy_version 1811190 (0.0007) [2023-12-28 08:16:46,888][106226] Updated weights for policy 0, policy_version 1811200 (0.0006) [2023-12-28 08:16:47,184][106225] Updated weights for policy 1, policy_version 1815425 (0.0010) [2023-12-28 08:16:47,253][106225] Updated weights for policy 1, policy_version 1815435 (0.0007) [2023-12-28 08:16:47,320][106225] Updated weights for policy 1, policy_version 1815445 (0.0008) [2023-12-28 08:16:47,388][106225] Updated weights for policy 1, policy_version 1815455 (0.0008) [2023-12-28 08:16:47,477][106226] Updated weights for policy 0, policy_version 1811210 (0.0008) [2023-12-28 08:16:47,540][106226] Updated weights for policy 0, policy_version 1811220 (0.0011) [2023-12-28 08:16:47,596][106226] Updated weights for policy 0, policy_version 1811230 (0.0009) [2023-12-28 08:16:47,649][106226] Updated weights for policy 0, policy_version 1811240 (0.0007) [2023-12-28 08:16:47,966][106225] Updated weights for policy 1, policy_version 1815465 (0.0009) [2023-12-28 08:16:48,025][106225] Updated weights for policy 1, policy_version 1815475 (0.0008) [2023-12-28 08:16:48,084][106225] Updated weights for policy 1, policy_version 1815485 (0.0008) [2023-12-28 08:16:48,431][106226] Updated weights for policy 0, policy_version 1811250 (0.0009) [2023-12-28 08:16:48,482][106226] Updated weights for policy 0, policy_version 1811260 (0.0010) [2023-12-28 08:16:48,541][106226] Updated weights for policy 0, policy_version 1811270 (0.0008) [2023-12-28 08:16:48,837][106225] Updated weights for policy 1, policy_version 1815495 (0.0008) [2023-12-28 08:16:48,884][106225] Updated weights for policy 1, policy_version 1815505 (0.0008) [2023-12-28 08:16:48,939][106225] Updated weights for policy 1, policy_version 1815515 (0.0010) [2023-12-28 08:16:49,326][106226] Updated weights for policy 0, policy_version 1811280 (0.0009) [2023-12-28 08:16:49,389][106226] Updated weights for policy 0, policy_version 1811290 (0.0007) [2023-12-28 08:16:49,449][106226] Updated weights for policy 0, policy_version 1811300 (0.0007) [2023-12-28 08:16:49,732][106225] Updated weights for policy 1, policy_version 1815525 (0.0009) [2023-12-28 08:16:49,786][106225] Updated weights for policy 1, policy_version 1815535 (0.0007) [2023-12-28 08:16:49,849][106225] Updated weights for policy 1, policy_version 1815545 (0.0009) [2023-12-28 08:16:50,120][106226] Updated weights for policy 0, policy_version 1811310 (0.0008) [2023-12-28 08:16:50,174][106226] Updated weights for policy 0, policy_version 1811320 (0.0008) [2023-12-28 08:16:50,237][106226] Updated weights for policy 0, policy_version 1811330 (0.0008) [2023-12-28 08:16:50,598][106225] Updated weights for policy 1, policy_version 1815555 (0.0011) [2023-12-28 08:16:50,659][106225] Updated weights for policy 1, policy_version 1815565 (0.0011) [2023-12-28 08:16:50,726][106225] Updated weights for policy 1, policy_version 1815575 (0.0010) [2023-12-28 08:16:51,031][106226] Updated weights for policy 0, policy_version 1811340 (0.0009) [2023-12-28 08:16:51,092][106226] Updated weights for policy 0, policy_version 1811350 (0.0009) [2023-12-28 08:16:51,157][106226] Updated weights for policy 0, policy_version 1811360 (0.0011) [2023-12-28 08:16:51,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 928628736. Throughput: 0: 9805.4, 1: 9714.0. Samples: 928643244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:51,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.901')] [2023-12-28 08:16:51,506][106225] Updated weights for policy 1, policy_version 1815585 (0.0011) [2023-12-28 08:16:51,560][106225] Updated weights for policy 1, policy_version 1815595 (0.0010) [2023-12-28 08:16:51,614][106225] Updated weights for policy 1, policy_version 1815605 (0.0010) [2023-12-28 08:16:51,681][106225] Updated weights for policy 1, policy_version 1815615 (0.0010) [2023-12-28 08:16:51,949][106226] Updated weights for policy 0, policy_version 1811370 (0.0010) [2023-12-28 08:16:52,015][106226] Updated weights for policy 0, policy_version 1811380 (0.0008) [2023-12-28 08:16:52,074][106226] Updated weights for policy 0, policy_version 1811390 (0.0009) [2023-12-28 08:16:52,140][106226] Updated weights for policy 0, policy_version 1811400 (0.0006) [2023-12-28 08:16:52,448][106225] Updated weights for policy 1, policy_version 1815625 (0.0009) [2023-12-28 08:16:52,495][106225] Updated weights for policy 1, policy_version 1815635 (0.0010) [2023-12-28 08:16:52,546][106225] Updated weights for policy 1, policy_version 1815645 (0.0010) [2023-12-28 08:16:52,833][106226] Updated weights for policy 0, policy_version 1811410 (0.0009) [2023-12-28 08:16:52,896][106226] Updated weights for policy 0, policy_version 1811420 (0.0008) [2023-12-28 08:16:52,953][106226] Updated weights for policy 0, policy_version 1811430 (0.0009) [2023-12-28 08:16:53,266][106225] Updated weights for policy 1, policy_version 1815655 (0.0009) [2023-12-28 08:16:53,328][106225] Updated weights for policy 1, policy_version 1815665 (0.0009) [2023-12-28 08:16:53,391][106225] Updated weights for policy 1, policy_version 1815676 (0.0009) [2023-12-28 08:16:53,610][106226] Updated weights for policy 0, policy_version 1811440 (0.0006) [2023-12-28 08:16:53,663][106226] Updated weights for policy 0, policy_version 1811450 (0.0006) [2023-12-28 08:16:53,726][106226] Updated weights for policy 0, policy_version 1811460 (0.0009) [2023-12-28 08:16:54,052][106225] Updated weights for policy 1, policy_version 1815686 (0.0009) [2023-12-28 08:16:54,099][106225] Updated weights for policy 1, policy_version 1815696 (0.0010) [2023-12-28 08:16:54,149][106225] Updated weights for policy 1, policy_version 1815706 (0.0010) [2023-12-28 08:16:54,305][106226] Updated weights for policy 0, policy_version 1811470 (0.0007) [2023-12-28 08:16:54,360][106226] Updated weights for policy 0, policy_version 1811480 (0.0007) [2023-12-28 08:16:54,428][106226] Updated weights for policy 0, policy_version 1811490 (0.0007) [2023-12-28 08:16:54,757][106225] Updated weights for policy 1, policy_version 1815716 (0.0008) [2023-12-28 08:16:54,810][106225] Updated weights for policy 1, policy_version 1815726 (0.0005) [2023-12-28 08:16:54,867][106225] Updated weights for policy 1, policy_version 1815736 (0.0005) [2023-12-28 08:16:55,204][106226] Updated weights for policy 0, policy_version 1811500 (0.0009) [2023-12-28 08:16:55,253][106226] Updated weights for policy 0, policy_version 1811510 (0.0008) [2023-12-28 08:16:55,307][106226] Updated weights for policy 0, policy_version 1811520 (0.0009) [2023-12-28 08:16:55,390][106225] Updated weights for policy 1, policy_version 1815746 (0.0005) [2023-12-28 08:16:55,449][106225] Updated weights for policy 1, policy_version 1815756 (0.0006) [2023-12-28 08:16:55,501][106225] Updated weights for policy 1, policy_version 1815766 (0.0010) [2023-12-28 08:16:55,547][106225] Updated weights for policy 1, policy_version 1815776 (0.0010) [2023-12-28 08:16:56,083][106226] Updated weights for policy 0, policy_version 1811530 (0.0008) [2023-12-28 08:16:56,133][106226] Updated weights for policy 0, policy_version 1811540 (0.0008) [2023-12-28 08:16:56,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19387.8, 300 sec: 19716.3). Total num frames: 928727040. Throughput: 0: 9765.6, 1: 9730.5. Samples: 928701424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:16:56,175][105115] Avg episode reward: [(0, '-4.604'), (1, '-4.673')] [2023-12-28 08:16:56,185][106226] Updated weights for policy 0, policy_version 1811550 (0.0008) [2023-12-28 08:16:56,234][106225] Updated weights for policy 1, policy_version 1815786 (0.0005) [2023-12-28 08:16:56,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001811560_463839232.pth... [2023-12-28 08:16:56,238][106226] Updated weights for policy 0, policy_version 1811560 (0.0008) [2023-12-28 08:16:56,239][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001810408_463544320.pth [2023-12-28 08:16:56,295][106225] Updated weights for policy 1, policy_version 1815796 (0.0010) [2023-12-28 08:16:56,351][106225] Updated weights for policy 1, policy_version 1815806 (0.0010) [2023-12-28 08:16:56,362][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001815808_464904192.pth... [2023-12-28 08:16:56,366][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001814624_464601088.pth [2023-12-28 08:16:56,994][106226] Updated weights for policy 0, policy_version 1811570 (0.0008) [2023-12-28 08:16:57,045][106226] Updated weights for policy 0, policy_version 1811580 (0.0006) [2023-12-28 08:16:57,050][106225] Updated weights for policy 1, policy_version 1815816 (0.0011) [2023-12-28 08:16:57,102][106226] Updated weights for policy 0, policy_version 1811590 (0.0006) [2023-12-28 08:16:57,107][106225] Updated weights for policy 1, policy_version 1815826 (0.0010) [2023-12-28 08:16:57,166][106225] Updated weights for policy 1, policy_version 1815836 (0.0010) [2023-12-28 08:16:57,701][106225] Updated weights for policy 1, policy_version 1815846 (0.0007) [2023-12-28 08:16:57,757][106225] Updated weights for policy 1, policy_version 1815856 (0.0006) [2023-12-28 08:16:57,806][106225] Updated weights for policy 1, policy_version 1815866 (0.0010) [2023-12-28 08:16:57,889][106226] Updated weights for policy 0, policy_version 1811600 (0.0007) [2023-12-28 08:16:57,949][106226] Updated weights for policy 0, policy_version 1811610 (0.0007) [2023-12-28 08:16:58,014][106226] Updated weights for policy 0, policy_version 1811620 (0.0008) [2023-12-28 08:16:58,544][106225] Updated weights for policy 1, policy_version 1815876 (0.0010) [2023-12-28 08:16:58,602][106225] Updated weights for policy 1, policy_version 1815886 (0.0010) [2023-12-28 08:16:58,666][106225] Updated weights for policy 1, policy_version 1815896 (0.0011) [2023-12-28 08:16:58,731][106226] Updated weights for policy 0, policy_version 1811630 (0.0007) [2023-12-28 08:16:58,798][106226] Updated weights for policy 0, policy_version 1811640 (0.0008) [2023-12-28 08:16:58,865][106226] Updated weights for policy 0, policy_version 1811650 (0.0008) [2023-12-28 08:16:59,444][106225] Updated weights for policy 1, policy_version 1815906 (0.0007) [2023-12-28 08:16:59,509][106225] Updated weights for policy 1, policy_version 1815916 (0.0007) [2023-12-28 08:16:59,566][106225] Updated weights for policy 1, policy_version 1815926 (0.0009) [2023-12-28 08:16:59,617][106226] Updated weights for policy 0, policy_version 1811660 (0.0008) [2023-12-28 08:16:59,628][106225] Updated weights for policy 1, policy_version 1815936 (0.0008) [2023-12-28 08:16:59,675][106226] Updated weights for policy 0, policy_version 1811670 (0.0008) [2023-12-28 08:16:59,727][106226] Updated weights for policy 0, policy_version 1811680 (0.0009) [2023-12-28 08:17:00,296][106225] Updated weights for policy 1, policy_version 1815946 (0.0008) [2023-12-28 08:17:00,348][106225] Updated weights for policy 1, policy_version 1815956 (0.0006) [2023-12-28 08:17:00,403][106225] Updated weights for policy 1, policy_version 1815966 (0.0009) [2023-12-28 08:17:00,508][106226] Updated weights for policy 0, policy_version 1811690 (0.0009) [2023-12-28 08:17:00,556][106226] Updated weights for policy 0, policy_version 1811700 (0.0007) [2023-12-28 08:17:00,604][106226] Updated weights for policy 0, policy_version 1811710 (0.0008) [2023-12-28 08:17:00,653][106226] Updated weights for policy 0, policy_version 1811720 (0.0007) [2023-12-28 08:17:01,091][106225] Updated weights for policy 1, policy_version 1815976 (0.0007) [2023-12-28 08:17:01,155][106225] Updated weights for policy 1, policy_version 1815986 (0.0008) [2023-12-28 08:17:01,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 928825344. Throughput: 0: 9764.7, 1: 9854.0. Samples: 928819340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:01,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.618')] [2023-12-28 08:17:01,217][106225] Updated weights for policy 1, policy_version 1815996 (0.0006) [2023-12-28 08:17:01,455][106226] Updated weights for policy 0, policy_version 1811730 (0.0009) [2023-12-28 08:17:01,503][106226] Updated weights for policy 0, policy_version 1811740 (0.0008) [2023-12-28 08:17:01,565][106226] Updated weights for policy 0, policy_version 1811750 (0.0011) [2023-12-28 08:17:01,956][106225] Updated weights for policy 1, policy_version 1816006 (0.0008) [2023-12-28 08:17:02,007][106225] Updated weights for policy 1, policy_version 1816016 (0.0008) [2023-12-28 08:17:02,057][106225] Updated weights for policy 1, policy_version 1816026 (0.0007) [2023-12-28 08:17:02,324][106226] Updated weights for policy 0, policy_version 1811760 (0.0010) [2023-12-28 08:17:02,391][106226] Updated weights for policy 0, policy_version 1811770 (0.0010) [2023-12-28 08:17:02,457][106226] Updated weights for policy 0, policy_version 1811780 (0.0008) [2023-12-28 08:17:02,848][106225] Updated weights for policy 1, policy_version 1816036 (0.0009) [2023-12-28 08:17:02,911][106225] Updated weights for policy 1, policy_version 1816046 (0.0010) [2023-12-28 08:17:02,967][106225] Updated weights for policy 1, policy_version 1816056 (0.0010) [2023-12-28 08:17:03,153][106226] Updated weights for policy 0, policy_version 1811790 (0.0007) [2023-12-28 08:17:03,213][106226] Updated weights for policy 0, policy_version 1811800 (0.0005) [2023-12-28 08:17:03,280][106226] Updated weights for policy 0, policy_version 1811810 (0.0007) [2023-12-28 08:17:03,584][106225] Updated weights for policy 1, policy_version 1816066 (0.0009) [2023-12-28 08:17:03,644][106225] Updated weights for policy 1, policy_version 1816076 (0.0006) [2023-12-28 08:17:03,710][106225] Updated weights for policy 1, policy_version 1816086 (0.0005) [2023-12-28 08:17:03,775][106225] Updated weights for policy 1, policy_version 1816096 (0.0005) [2023-12-28 08:17:03,941][106226] Updated weights for policy 0, policy_version 1811820 (0.0010) [2023-12-28 08:17:04,005][106226] Updated weights for policy 0, policy_version 1811830 (0.0008) [2023-12-28 08:17:04,071][106226] Updated weights for policy 0, policy_version 1811840 (0.0008) [2023-12-28 08:17:04,375][106225] Updated weights for policy 1, policy_version 1816106 (0.0010) [2023-12-28 08:17:04,438][106225] Updated weights for policy 1, policy_version 1816116 (0.0005) [2023-12-28 08:17:04,499][106225] Updated weights for policy 1, policy_version 1816126 (0.0005) [2023-12-28 08:17:04,819][106226] Updated weights for policy 0, policy_version 1811850 (0.0009) [2023-12-28 08:17:04,876][106226] Updated weights for policy 0, policy_version 1811860 (0.0006) [2023-12-28 08:17:04,931][106226] Updated weights for policy 0, policy_version 1811870 (0.0008) [2023-12-28 08:17:04,990][106226] Updated weights for policy 0, policy_version 1811880 (0.0010) [2023-12-28 08:17:05,093][106225] Updated weights for policy 1, policy_version 1816136 (0.0009) [2023-12-28 08:17:05,149][106225] Updated weights for policy 1, policy_version 1816146 (0.0010) [2023-12-28 08:17:05,205][106225] Updated weights for policy 1, policy_version 1816156 (0.0010) [2023-12-28 08:17:05,633][106226] Updated weights for policy 0, policy_version 1811890 (0.0008) [2023-12-28 08:17:05,693][106226] Updated weights for policy 0, policy_version 1811900 (0.0010) [2023-12-28 08:17:05,757][106226] Updated weights for policy 0, policy_version 1811910 (0.0011) [2023-12-28 08:17:05,914][106225] Updated weights for policy 1, policy_version 1816166 (0.0010) [2023-12-28 08:17:05,969][106225] Updated weights for policy 1, policy_version 1816176 (0.0010) [2023-12-28 08:17:06,026][106225] Updated weights for policy 1, policy_version 1816186 (0.0010) [2023-12-28 08:17:06,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 928931840. Throughput: 0: 9704.9, 1: 9931.1. Samples: 928938856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:06,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.626')] [2023-12-28 08:17:06,413][106226] Updated weights for policy 0, policy_version 1811920 (0.0011) [2023-12-28 08:17:06,467][106226] Updated weights for policy 0, policy_version 1811930 (0.0011) [2023-12-28 08:17:06,522][106226] Updated weights for policy 0, policy_version 1811940 (0.0011) [2023-12-28 08:17:06,787][106225] Updated weights for policy 1, policy_version 1816196 (0.0010) [2023-12-28 08:17:06,846][106225] Updated weights for policy 1, policy_version 1816206 (0.0010) [2023-12-28 08:17:06,909][106225] Updated weights for policy 1, policy_version 1816216 (0.0010) [2023-12-28 08:17:07,251][106226] Updated weights for policy 0, policy_version 1811950 (0.0010) [2023-12-28 08:17:07,306][106226] Updated weights for policy 0, policy_version 1811960 (0.0007) [2023-12-28 08:17:07,364][106226] Updated weights for policy 0, policy_version 1811970 (0.0005) [2023-12-28 08:17:07,623][106225] Updated weights for policy 1, policy_version 1816226 (0.0010) [2023-12-28 08:17:07,681][106225] Updated weights for policy 1, policy_version 1816236 (0.0010) [2023-12-28 08:17:07,729][106225] Updated weights for policy 1, policy_version 1816246 (0.0010) [2023-12-28 08:17:07,789][106225] Updated weights for policy 1, policy_version 1816256 (0.0010) [2023-12-28 08:17:07,906][106226] Updated weights for policy 0, policy_version 1811980 (0.0005) [2023-12-28 08:17:07,972][106226] Updated weights for policy 0, policy_version 1811990 (0.0008) [2023-12-28 08:17:08,045][106226] Updated weights for policy 0, policy_version 1812000 (0.0008) [2023-12-28 08:17:08,425][106225] Updated weights for policy 1, policy_version 1816266 (0.0009) [2023-12-28 08:17:08,485][106225] Updated weights for policy 1, policy_version 1816276 (0.0010) [2023-12-28 08:17:08,553][106225] Updated weights for policy 1, policy_version 1816286 (0.0011) [2023-12-28 08:17:08,703][106226] Updated weights for policy 0, policy_version 1812010 (0.0007) [2023-12-28 08:17:08,768][106226] Updated weights for policy 0, policy_version 1812020 (0.0007) [2023-12-28 08:17:08,830][106226] Updated weights for policy 0, policy_version 1812030 (0.0005) [2023-12-28 08:17:08,888][106226] Updated weights for policy 0, policy_version 1812040 (0.0006) [2023-12-28 08:17:09,233][106225] Updated weights for policy 1, policy_version 1816296 (0.0010) [2023-12-28 08:17:09,292][106225] Updated weights for policy 1, policy_version 1816307 (0.0010) [2023-12-28 08:17:09,353][106225] Updated weights for policy 1, policy_version 1816317 (0.0009) [2023-12-28 08:17:09,606][106226] Updated weights for policy 0, policy_version 1812050 (0.0006) [2023-12-28 08:17:09,666][106226] Updated weights for policy 0, policy_version 1812060 (0.0006) [2023-12-28 08:17:09,722][106226] Updated weights for policy 0, policy_version 1812070 (0.0007) [2023-12-28 08:17:10,195][106225] Updated weights for policy 1, policy_version 1816327 (0.0008) [2023-12-28 08:17:10,255][106225] Updated weights for policy 1, policy_version 1816337 (0.0008) [2023-12-28 08:17:10,315][106225] Updated weights for policy 1, policy_version 1816347 (0.0008) [2023-12-28 08:17:10,453][106226] Updated weights for policy 0, policy_version 1812080 (0.0009) [2023-12-28 08:17:10,514][106226] Updated weights for policy 0, policy_version 1812090 (0.0009) [2023-12-28 08:17:10,573][106226] Updated weights for policy 0, policy_version 1812100 (0.0008) [2023-12-28 08:17:11,147][106225] Updated weights for policy 1, policy_version 1816357 (0.0008) [2023-12-28 08:17:11,157][106226] Updated weights for policy 0, policy_version 1812110 (0.0006) [2023-12-28 08:17:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 929021952. Throughput: 0: 9782.2, 1: 9960.3. Samples: 929000092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:11,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.712')] [2023-12-28 08:17:11,213][106225] Updated weights for policy 1, policy_version 1816367 (0.0011) [2023-12-28 08:17:11,219][106226] Updated weights for policy 0, policy_version 1812120 (0.0007) [2023-12-28 08:17:11,281][106225] Updated weights for policy 1, policy_version 1816377 (0.0007) [2023-12-28 08:17:11,292][106226] Updated weights for policy 0, policy_version 1812130 (0.0009) [2023-12-28 08:17:11,324][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001816384_465051648.pth... [2023-12-28 08:17:11,330][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001815200_464748544.pth [2023-12-28 08:17:11,332][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001812136_463986688.pth... [2023-12-28 08:17:11,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001810984_463691776.pth [2023-12-28 08:17:11,997][106226] Updated weights for policy 0, policy_version 1812140 (0.0008) [2023-12-28 08:17:12,020][106225] Updated weights for policy 1, policy_version 1816387 (0.0010) [2023-12-28 08:17:12,060][106226] Updated weights for policy 0, policy_version 1812150 (0.0011) [2023-12-28 08:17:12,093][106225] Updated weights for policy 1, policy_version 1816397 (0.0008) [2023-12-28 08:17:12,123][106226] Updated weights for policy 0, policy_version 1812160 (0.0009) [2023-12-28 08:17:12,161][106225] Updated weights for policy 1, policy_version 1816407 (0.0008) [2023-12-28 08:17:12,853][106226] Updated weights for policy 0, policy_version 1812170 (0.0008) [2023-12-28 08:17:12,870][106225] Updated weights for policy 1, policy_version 1816417 (0.0009) [2023-12-28 08:17:12,914][106226] Updated weights for policy 0, policy_version 1812180 (0.0009) [2023-12-28 08:17:12,933][106225] Updated weights for policy 1, policy_version 1816427 (0.0009) [2023-12-28 08:17:12,964][106226] Updated weights for policy 0, policy_version 1812190 (0.0008) [2023-12-28 08:17:12,995][106225] Updated weights for policy 1, policy_version 1816437 (0.0007) [2023-12-28 08:17:13,018][106226] Updated weights for policy 0, policy_version 1812200 (0.0008) [2023-12-28 08:17:13,054][106225] Updated weights for policy 1, policy_version 1816447 (0.0010) [2023-12-28 08:17:13,689][106225] Updated weights for policy 1, policy_version 1816457 (0.0010) [2023-12-28 08:17:13,712][106226] Updated weights for policy 0, policy_version 1812210 (0.0005) [2023-12-28 08:17:13,737][106225] Updated weights for policy 1, policy_version 1816467 (0.0010) [2023-12-28 08:17:13,770][106226] Updated weights for policy 0, policy_version 1812220 (0.0005) [2023-12-28 08:17:13,787][106225] Updated weights for policy 1, policy_version 1816477 (0.0010) [2023-12-28 08:17:13,832][106226] Updated weights for policy 0, policy_version 1812230 (0.0007) [2023-12-28 08:17:14,405][106226] Updated weights for policy 0, policy_version 1812240 (0.0005) [2023-12-28 08:17:14,460][106226] Updated weights for policy 0, policy_version 1812250 (0.0005) [2023-12-28 08:17:14,469][106225] Updated weights for policy 1, policy_version 1816487 (0.0010) [2023-12-28 08:17:14,514][106226] Updated weights for policy 0, policy_version 1812260 (0.0005) [2023-12-28 08:17:14,526][106225] Updated weights for policy 1, policy_version 1816497 (0.0010) [2023-12-28 08:17:14,586][106225] Updated weights for policy 1, policy_version 1816507 (0.0010) [2023-12-28 08:17:15,145][106226] Updated weights for policy 0, policy_version 1812270 (0.0007) [2023-12-28 08:17:15,202][106226] Updated weights for policy 0, policy_version 1812280 (0.0007) [2023-12-28 08:17:15,264][106226] Updated weights for policy 0, policy_version 1812290 (0.0008) [2023-12-28 08:17:15,313][106225] Updated weights for policy 1, policy_version 1816517 (0.0009) [2023-12-28 08:17:15,374][106225] Updated weights for policy 1, policy_version 1816527 (0.0011) [2023-12-28 08:17:15,435][106225] Updated weights for policy 1, policy_version 1816537 (0.0010) [2023-12-28 08:17:15,986][106226] Updated weights for policy 0, policy_version 1812300 (0.0006) [2023-12-28 08:17:16,031][106226] Updated weights for policy 0, policy_version 1812310 (0.0007) [2023-12-28 08:17:16,077][106226] Updated weights for policy 0, policy_version 1812320 (0.0007) [2023-12-28 08:17:16,174][106225] Updated weights for policy 1, policy_version 1816547 (0.0011) [2023-12-28 08:17:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 929128448. Throughput: 0: 9843.9, 1: 9900.1. Samples: 929118616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:16,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.764')] [2023-12-28 08:17:16,235][106225] Updated weights for policy 1, policy_version 1816557 (0.0010) [2023-12-28 08:17:16,290][106225] Updated weights for policy 1, policy_version 1816567 (0.0010) [2023-12-28 08:17:16,816][106226] Updated weights for policy 0, policy_version 1812330 (0.0008) [2023-12-28 08:17:16,867][106226] Updated weights for policy 0, policy_version 1812340 (0.0007) [2023-12-28 08:17:16,930][106226] Updated weights for policy 0, policy_version 1812350 (0.0008) [2023-12-28 08:17:16,987][106226] Updated weights for policy 0, policy_version 1812360 (0.0007) [2023-12-28 08:17:16,999][106225] Updated weights for policy 1, policy_version 1816577 (0.0010) [2023-12-28 08:17:17,059][106225] Updated weights for policy 1, policy_version 1816587 (0.0010) [2023-12-28 08:17:17,113][106225] Updated weights for policy 1, policy_version 1816597 (0.0010) [2023-12-28 08:17:17,180][106225] Updated weights for policy 1, policy_version 1816607 (0.0010) [2023-12-28 08:17:17,644][106226] Updated weights for policy 0, policy_version 1812370 (0.0009) [2023-12-28 08:17:17,697][106226] Updated weights for policy 0, policy_version 1812380 (0.0007) [2023-12-28 08:17:17,744][106226] Updated weights for policy 0, policy_version 1812390 (0.0008) [2023-12-28 08:17:17,905][106225] Updated weights for policy 1, policy_version 1816617 (0.0011) [2023-12-28 08:17:17,968][106225] Updated weights for policy 1, policy_version 1816627 (0.0010) [2023-12-28 08:17:18,022][106225] Updated weights for policy 1, policy_version 1816637 (0.0010) [2023-12-28 08:17:18,501][106226] Updated weights for policy 0, policy_version 1812400 (0.0008) [2023-12-28 08:17:18,564][106226] Updated weights for policy 0, policy_version 1812410 (0.0009) [2023-12-28 08:17:18,631][106226] Updated weights for policy 0, policy_version 1812420 (0.0009) [2023-12-28 08:17:18,758][106225] Updated weights for policy 1, policy_version 1816647 (0.0009) [2023-12-28 08:17:18,819][106225] Updated weights for policy 1, policy_version 1816657 (0.0009) [2023-12-28 08:17:18,883][106225] Updated weights for policy 1, policy_version 1816667 (0.0009) [2023-12-28 08:17:19,363][106226] Updated weights for policy 0, policy_version 1812430 (0.0008) [2023-12-28 08:17:19,432][106226] Updated weights for policy 0, policy_version 1812440 (0.0008) [2023-12-28 08:17:19,498][106226] Updated weights for policy 0, policy_version 1812450 (0.0008) [2023-12-28 08:17:19,625][106225] Updated weights for policy 1, policy_version 1816677 (0.0007) [2023-12-28 08:17:19,697][106225] Updated weights for policy 1, policy_version 1816687 (0.0006) [2023-12-28 08:17:19,764][106225] Updated weights for policy 1, policy_version 1816697 (0.0006) [2023-12-28 08:17:20,280][106226] Updated weights for policy 0, policy_version 1812460 (0.0007) [2023-12-28 08:17:20,341][106226] Updated weights for policy 0, policy_version 1812470 (0.0008) [2023-12-28 08:17:20,404][106226] Updated weights for policy 0, policy_version 1812480 (0.0008) [2023-12-28 08:17:20,438][106225] Updated weights for policy 1, policy_version 1816707 (0.0006) [2023-12-28 08:17:20,496][106225] Updated weights for policy 1, policy_version 1816717 (0.0008) [2023-12-28 08:17:20,561][106225] Updated weights for policy 1, policy_version 1816727 (0.0009) [2023-12-28 08:17:21,149][106226] Updated weights for policy 0, policy_version 1812490 (0.0007) [2023-12-28 08:17:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 929218560. Throughput: 0: 9797.5, 1: 9844.6. Samples: 929232876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:21,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.752')] [2023-12-28 08:17:21,210][106225] Updated weights for policy 1, policy_version 1816737 (0.0009) [2023-12-28 08:17:21,212][106226] Updated weights for policy 0, policy_version 1812500 (0.0008) [2023-12-28 08:17:21,276][106225] Updated weights for policy 1, policy_version 1816747 (0.0007) [2023-12-28 08:17:21,278][106226] Updated weights for policy 0, policy_version 1812510 (0.0008) [2023-12-28 08:17:21,338][106225] Updated weights for policy 1, policy_version 1816757 (0.0008) [2023-12-28 08:17:21,347][106226] Updated weights for policy 0, policy_version 1812520 (0.0008) [2023-12-28 08:17:21,406][106225] Updated weights for policy 1, policy_version 1816767 (0.0009) [2023-12-28 08:17:22,080][106226] Updated weights for policy 0, policy_version 1812530 (0.0008) [2023-12-28 08:17:22,146][106226] Updated weights for policy 0, policy_version 1812540 (0.0008) [2023-12-28 08:17:22,215][106226] Updated weights for policy 0, policy_version 1812550 (0.0008) [2023-12-28 08:17:22,293][106225] Updated weights for policy 1, policy_version 1816777 (0.0007) [2023-12-28 08:17:22,362][106225] Updated weights for policy 1, policy_version 1816787 (0.0009) [2023-12-28 08:17:22,435][106225] Updated weights for policy 1, policy_version 1816797 (0.0007) [2023-12-28 08:17:23,056][106226] Updated weights for policy 0, policy_version 1812560 (0.0009) [2023-12-28 08:17:23,066][106225] Updated weights for policy 1, policy_version 1816807 (0.0005) [2023-12-28 08:17:23,115][106226] Updated weights for policy 0, policy_version 1812570 (0.0008) [2023-12-28 08:17:23,129][106225] Updated weights for policy 1, policy_version 1816817 (0.0005) [2023-12-28 08:17:23,184][106226] Updated weights for policy 0, policy_version 1812580 (0.0009) [2023-12-28 08:17:23,187][106225] Updated weights for policy 1, policy_version 1816827 (0.0005) [2023-12-28 08:17:23,871][106225] Updated weights for policy 1, policy_version 1816837 (0.0009) [2023-12-28 08:17:23,905][106226] Updated weights for policy 0, policy_version 1812590 (0.0005) [2023-12-28 08:17:23,933][106225] Updated weights for policy 1, policy_version 1816847 (0.0009) [2023-12-28 08:17:23,953][106226] Updated weights for policy 0, policy_version 1812600 (0.0005) [2023-12-28 08:17:23,983][106225] Updated weights for policy 1, policy_version 1816857 (0.0008) [2023-12-28 08:17:24,008][106226] Updated weights for policy 0, policy_version 1812610 (0.0005) [2023-12-28 08:17:24,542][106226] Updated weights for policy 0, policy_version 1812620 (0.0006) [2023-12-28 08:17:24,601][106226] Updated weights for policy 0, policy_version 1812630 (0.0008) [2023-12-28 08:17:24,651][106226] Updated weights for policy 0, policy_version 1812640 (0.0007) [2023-12-28 08:17:24,786][106225] Updated weights for policy 1, policy_version 1816868 (0.0008) [2023-12-28 08:17:24,841][106225] Updated weights for policy 1, policy_version 1816878 (0.0008) [2023-12-28 08:17:24,897][106225] Updated weights for policy 1, policy_version 1816888 (0.0008) [2023-12-28 08:17:25,339][106226] Updated weights for policy 0, policy_version 1812650 (0.0008) [2023-12-28 08:17:25,403][106226] Updated weights for policy 0, policy_version 1812660 (0.0007) [2023-12-28 08:17:25,457][106226] Updated weights for policy 0, policy_version 1812670 (0.0008) [2023-12-28 08:17:25,507][106226] Updated weights for policy 0, policy_version 1812680 (0.0008) [2023-12-28 08:17:25,665][106225] Updated weights for policy 1, policy_version 1816898 (0.0008) [2023-12-28 08:17:25,715][106225] Updated weights for policy 1, policy_version 1816908 (0.0005) [2023-12-28 08:17:25,763][106225] Updated weights for policy 1, policy_version 1816918 (0.0005) [2023-12-28 08:17:25,817][106225] Updated weights for policy 1, policy_version 1816928 (0.0005) [2023-12-28 08:17:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 929316864. Throughput: 0: 9748.9, 1: 9831.7. Samples: 929290396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:26,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.456')] [2023-12-28 08:17:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001816928_465190912.pth... [2023-12-28 08:17:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001812680_464125952.pth... [2023-12-28 08:17:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001815808_464904192.pth [2023-12-28 08:17:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001811560_463839232.pth [2023-12-28 08:17:26,266][106226] Updated weights for policy 0, policy_version 1812690 (0.0009) [2023-12-28 08:17:26,331][106226] Updated weights for policy 0, policy_version 1812700 (0.0010) [2023-12-28 08:17:26,394][106226] Updated weights for policy 0, policy_version 1812710 (0.0008) [2023-12-28 08:17:26,431][106225] Updated weights for policy 1, policy_version 1816938 (0.0009) [2023-12-28 08:17:26,476][106225] Updated weights for policy 1, policy_version 1816948 (0.0008) [2023-12-28 08:17:26,527][106225] Updated weights for policy 1, policy_version 1816958 (0.0008) [2023-12-28 08:17:27,071][106226] Updated weights for policy 0, policy_version 1812720 (0.0006) [2023-12-28 08:17:27,132][106226] Updated weights for policy 0, policy_version 1812730 (0.0007) [2023-12-28 08:17:27,195][106226] Updated weights for policy 0, policy_version 1812740 (0.0007) [2023-12-28 08:17:27,244][106225] Updated weights for policy 1, policy_version 1816968 (0.0006) [2023-12-28 08:17:27,293][106225] Updated weights for policy 1, policy_version 1816978 (0.0006) [2023-12-28 08:17:27,348][106225] Updated weights for policy 1, policy_version 1816988 (0.0007) [2023-12-28 08:17:27,859][106226] Updated weights for policy 0, policy_version 1812750 (0.0006) [2023-12-28 08:17:27,909][106225] Updated weights for policy 1, policy_version 1816998 (0.0006) [2023-12-28 08:17:27,918][106226] Updated weights for policy 0, policy_version 1812760 (0.0008) [2023-12-28 08:17:27,955][106225] Updated weights for policy 1, policy_version 1817008 (0.0005) [2023-12-28 08:17:27,969][106226] Updated weights for policy 0, policy_version 1812770 (0.0008) [2023-12-28 08:17:28,005][106225] Updated weights for policy 1, policy_version 1817018 (0.0007) [2023-12-28 08:17:28,681][106225] Updated weights for policy 1, policy_version 1817028 (0.0009) [2023-12-28 08:17:28,699][106226] Updated weights for policy 0, policy_version 1812780 (0.0006) [2023-12-28 08:17:28,744][106225] Updated weights for policy 1, policy_version 1817038 (0.0009) [2023-12-28 08:17:28,755][106226] Updated weights for policy 0, policy_version 1812790 (0.0008) [2023-12-28 08:17:28,808][106225] Updated weights for policy 1, policy_version 1817048 (0.0007) [2023-12-28 08:17:28,816][106226] Updated weights for policy 0, policy_version 1812800 (0.0007) [2023-12-28 08:17:29,468][106226] Updated weights for policy 0, policy_version 1812810 (0.0007) [2023-12-28 08:17:29,522][106225] Updated weights for policy 1, policy_version 1817058 (0.0009) [2023-12-28 08:17:29,533][106226] Updated weights for policy 0, policy_version 1812820 (0.0008) [2023-12-28 08:17:29,576][106225] Updated weights for policy 1, policy_version 1817068 (0.0010) [2023-12-28 08:17:29,591][106226] Updated weights for policy 0, policy_version 1812830 (0.0008) [2023-12-28 08:17:29,635][106225] Updated weights for policy 1, policy_version 1817078 (0.0008) [2023-12-28 08:17:29,643][106226] Updated weights for policy 0, policy_version 1812840 (0.0007) [2023-12-28 08:17:29,694][106225] Updated weights for policy 1, policy_version 1817088 (0.0005) [2023-12-28 08:17:30,304][106225] Updated weights for policy 1, policy_version 1817098 (0.0008) [2023-12-28 08:17:30,366][106225] Updated weights for policy 1, policy_version 1817108 (0.0006) [2023-12-28 08:17:30,380][106226] Updated weights for policy 0, policy_version 1812850 (0.0007) [2023-12-28 08:17:30,425][106225] Updated weights for policy 1, policy_version 1817118 (0.0006) [2023-12-28 08:17:30,435][106226] Updated weights for policy 0, policy_version 1812860 (0.0006) [2023-12-28 08:17:30,482][106226] Updated weights for policy 0, policy_version 1812870 (0.0008) [2023-12-28 08:17:31,007][106225] Updated weights for policy 1, policy_version 1817128 (0.0005) [2023-12-28 08:17:31,074][106225] Updated weights for policy 1, policy_version 1817138 (0.0008) [2023-12-28 08:17:31,147][106225] Updated weights for policy 1, policy_version 1817148 (0.0008) [2023-12-28 08:17:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 929423360. Throughput: 0: 9842.9, 1: 9880.1. Samples: 929411736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:31,175][105115] Avg episode reward: [(0, '-4.293'), (1, '-4.785')] [2023-12-28 08:17:31,264][106226] Updated weights for policy 0, policy_version 1812880 (0.0008) [2023-12-28 08:17:31,327][106226] Updated weights for policy 0, policy_version 1812890 (0.0009) [2023-12-28 08:17:31,395][106226] Updated weights for policy 0, policy_version 1812900 (0.0008) [2023-12-28 08:17:31,881][106225] Updated weights for policy 1, policy_version 1817158 (0.0009) [2023-12-28 08:17:31,942][106225] Updated weights for policy 1, policy_version 1817168 (0.0008) [2023-12-28 08:17:32,009][106226] Updated weights for policy 0, policy_version 1812910 (0.0005) [2023-12-28 08:17:32,013][106225] Updated weights for policy 1, policy_version 1817178 (0.0007) [2023-12-28 08:17:32,076][106226] Updated weights for policy 0, policy_version 1812920 (0.0006) [2023-12-28 08:17:32,137][106226] Updated weights for policy 0, policy_version 1812930 (0.0006) [2023-12-28 08:17:32,694][106225] Updated weights for policy 1, policy_version 1817188 (0.0006) [2023-12-28 08:17:32,744][106225] Updated weights for policy 1, policy_version 1817198 (0.0008) [2023-12-28 08:17:32,791][106225] Updated weights for policy 1, policy_version 1817208 (0.0010) [2023-12-28 08:17:32,832][106226] Updated weights for policy 0, policy_version 1812940 (0.0007) [2023-12-28 08:17:32,885][106226] Updated weights for policy 0, policy_version 1812950 (0.0006) [2023-12-28 08:17:32,934][106226] Updated weights for policy 0, policy_version 1812960 (0.0007) [2023-12-28 08:17:33,490][106225] Updated weights for policy 1, policy_version 1817218 (0.0010) [2023-12-28 08:17:33,545][106225] Updated weights for policy 1, policy_version 1817228 (0.0009) [2023-12-28 08:17:33,601][106225] Updated weights for policy 1, policy_version 1817238 (0.0009) [2023-12-28 08:17:33,653][106225] Updated weights for policy 1, policy_version 1817248 (0.0010) [2023-12-28 08:17:33,680][106226] Updated weights for policy 0, policy_version 1812970 (0.0007) [2023-12-28 08:17:33,741][106226] Updated weights for policy 0, policy_version 1812980 (0.0008) [2023-12-28 08:17:33,802][106226] Updated weights for policy 0, policy_version 1812990 (0.0008) [2023-12-28 08:17:33,873][106226] Updated weights for policy 0, policy_version 1813000 (0.0008) [2023-12-28 08:17:34,435][106225] Updated weights for policy 1, policy_version 1817258 (0.0010) [2023-12-28 08:17:34,490][106225] Updated weights for policy 1, policy_version 1817268 (0.0010) [2023-12-28 08:17:34,551][106225] Updated weights for policy 1, policy_version 1817278 (0.0011) [2023-12-28 08:17:34,610][106226] Updated weights for policy 0, policy_version 1813010 (0.0008) [2023-12-28 08:17:34,659][106226] Updated weights for policy 0, policy_version 1813020 (0.0008) [2023-12-28 08:17:34,712][106226] Updated weights for policy 0, policy_version 1813030 (0.0008) [2023-12-28 08:17:35,189][106225] Updated weights for policy 1, policy_version 1817288 (0.0006) [2023-12-28 08:17:35,241][106225] Updated weights for policy 1, policy_version 1817298 (0.0005) [2023-12-28 08:17:35,297][106225] Updated weights for policy 1, policy_version 1817308 (0.0005) [2023-12-28 08:17:35,345][106226] Updated weights for policy 0, policy_version 1813040 (0.0006) [2023-12-28 08:17:35,415][106226] Updated weights for policy 0, policy_version 1813050 (0.0005) [2023-12-28 08:17:35,485][106226] Updated weights for policy 0, policy_version 1813060 (0.0005) [2023-12-28 08:17:35,830][106225] Updated weights for policy 1, policy_version 1817318 (0.0005) [2023-12-28 08:17:35,882][106225] Updated weights for policy 1, policy_version 1817328 (0.0006) [2023-12-28 08:17:35,943][106225] Updated weights for policy 1, policy_version 1817338 (0.0009) [2023-12-28 08:17:35,995][106226] Updated weights for policy 0, policy_version 1813070 (0.0007) [2023-12-28 08:17:36,046][106226] Updated weights for policy 0, policy_version 1813080 (0.0008) [2023-12-28 08:17:36,092][106226] Updated weights for policy 0, policy_version 1813090 (0.0008) [2023-12-28 08:17:36,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 929529856. Throughput: 0: 9838.0, 1: 9972.9. Samples: 929534740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:36,176][105115] Avg episode reward: [(0, '-4.215'), (1, '-4.950')] [2023-12-28 08:17:36,622][106225] Updated weights for policy 1, policy_version 1817348 (0.0008) [2023-12-28 08:17:36,685][106225] Updated weights for policy 1, policy_version 1817358 (0.0009) [2023-12-28 08:17:36,745][106225] Updated weights for policy 1, policy_version 1817368 (0.0008) [2023-12-28 08:17:36,795][106226] Updated weights for policy 0, policy_version 1813100 (0.0007) [2023-12-28 08:17:36,853][106226] Updated weights for policy 0, policy_version 1813110 (0.0006) [2023-12-28 08:17:36,904][106226] Updated weights for policy 0, policy_version 1813120 (0.0005) [2023-12-28 08:17:37,497][106226] Updated weights for policy 0, policy_version 1813130 (0.0006) [2023-12-28 08:17:37,526][106225] Updated weights for policy 1, policy_version 1817378 (0.0009) [2023-12-28 08:17:37,561][106226] Updated weights for policy 0, policy_version 1813140 (0.0006) [2023-12-28 08:17:37,582][106225] Updated weights for policy 1, policy_version 1817388 (0.0007) [2023-12-28 08:17:37,613][106226] Updated weights for policy 0, policy_version 1813150 (0.0006) [2023-12-28 08:17:37,641][106225] Updated weights for policy 1, policy_version 1817398 (0.0008) [2023-12-28 08:17:37,663][106226] Updated weights for policy 0, policy_version 1813160 (0.0007) [2023-12-28 08:17:37,689][106225] Updated weights for policy 1, policy_version 1817408 (0.0008) [2023-12-28 08:17:38,347][106225] Updated weights for policy 1, policy_version 1817418 (0.0008) [2023-12-28 08:17:38,373][106226] Updated weights for policy 0, policy_version 1813170 (0.0007) [2023-12-28 08:17:38,412][106225] Updated weights for policy 1, policy_version 1817428 (0.0007) [2023-12-28 08:17:38,432][106226] Updated weights for policy 0, policy_version 1813180 (0.0006) [2023-12-28 08:17:38,473][106225] Updated weights for policy 1, policy_version 1817438 (0.0007) [2023-12-28 08:17:38,492][106226] Updated weights for policy 0, policy_version 1813190 (0.0005) [2023-12-28 08:17:39,135][106226] Updated weights for policy 0, policy_version 1813200 (0.0008) [2023-12-28 08:17:39,196][106226] Updated weights for policy 0, policy_version 1813210 (0.0007) [2023-12-28 08:17:39,225][106225] Updated weights for policy 1, policy_version 1817448 (0.0008) [2023-12-28 08:17:39,274][106226] Updated weights for policy 0, policy_version 1813220 (0.0008) [2023-12-28 08:17:39,293][106225] Updated weights for policy 1, policy_version 1817458 (0.0010) [2023-12-28 08:17:39,356][106225] Updated weights for policy 1, policy_version 1817468 (0.0010) [2023-12-28 08:17:39,940][106226] Updated weights for policy 0, policy_version 1813230 (0.0009) [2023-12-28 08:17:40,011][106226] Updated weights for policy 0, policy_version 1813240 (0.0010) [2023-12-28 08:17:40,076][106226] Updated weights for policy 0, policy_version 1813250 (0.0011) [2023-12-28 08:17:40,153][106225] Updated weights for policy 1, policy_version 1817478 (0.0008) [2023-12-28 08:17:40,217][106225] Updated weights for policy 1, policy_version 1817488 (0.0006) [2023-12-28 08:17:40,285][106225] Updated weights for policy 1, policy_version 1817498 (0.0006) [2023-12-28 08:17:40,778][106226] Updated weights for policy 0, policy_version 1813260 (0.0011) [2023-12-28 08:17:40,838][106226] Updated weights for policy 0, policy_version 1813270 (0.0011) [2023-12-28 08:17:40,899][106225] Updated weights for policy 1, policy_version 1817508 (0.0008) [2023-12-28 08:17:40,899][106226] Updated weights for policy 0, policy_version 1813280 (0.0011) [2023-12-28 08:17:40,953][106225] Updated weights for policy 1, policy_version 1817518 (0.0010) [2023-12-28 08:17:41,012][106225] Updated weights for policy 1, policy_version 1817528 (0.0010) [2023-12-28 08:17:41,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 929628160. Throughput: 0: 9889.3, 1: 9976.7. Samples: 929595396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:41,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.632')] [2023-12-28 08:17:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001817536_465346560.pth... [2023-12-28 08:17:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001813288_464281600.pth... [2023-12-28 08:17:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001816384_465051648.pth [2023-12-28 08:17:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001812136_463986688.pth [2023-12-28 08:17:41,650][106226] Updated weights for policy 0, policy_version 1813290 (0.0011) [2023-12-28 08:17:41,726][106226] Updated weights for policy 0, policy_version 1813300 (0.0011) [2023-12-28 08:17:41,793][106226] Updated weights for policy 0, policy_version 1813310 (0.0011) [2023-12-28 08:17:41,831][106225] Updated weights for policy 1, policy_version 1817538 (0.0008) [2023-12-28 08:17:41,853][106226] Updated weights for policy 0, policy_version 1813320 (0.0009) [2023-12-28 08:17:41,900][106225] Updated weights for policy 1, policy_version 1817548 (0.0007) [2023-12-28 08:17:41,961][106225] Updated weights for policy 1, policy_version 1817558 (0.0008) [2023-12-28 08:17:42,020][106225] Updated weights for policy 1, policy_version 1817568 (0.0006) [2023-12-28 08:17:42,585][106226] Updated weights for policy 0, policy_version 1813330 (0.0011) [2023-12-28 08:17:42,646][106226] Updated weights for policy 0, policy_version 1813340 (0.0010) [2023-12-28 08:17:42,687][106225] Updated weights for policy 1, policy_version 1817578 (0.0008) [2023-12-28 08:17:42,709][106226] Updated weights for policy 0, policy_version 1813350 (0.0011) [2023-12-28 08:17:42,741][106225] Updated weights for policy 1, policy_version 1817588 (0.0006) [2023-12-28 08:17:42,801][106225] Updated weights for policy 1, policy_version 1817598 (0.0006) [2023-12-28 08:17:43,389][106225] Updated weights for policy 1, policy_version 1817608 (0.0008) [2023-12-28 08:17:43,420][106226] Updated weights for policy 0, policy_version 1813360 (0.0010) [2023-12-28 08:17:43,445][106225] Updated weights for policy 1, policy_version 1817618 (0.0007) [2023-12-28 08:17:43,480][106226] Updated weights for policy 0, policy_version 1813370 (0.0011) [2023-12-28 08:17:43,502][106225] Updated weights for policy 1, policy_version 1817628 (0.0006) [2023-12-28 08:17:43,533][106226] Updated weights for policy 0, policy_version 1813380 (0.0010) [2023-12-28 08:17:44,112][106225] Updated weights for policy 1, policy_version 1817638 (0.0007) [2023-12-28 08:17:44,168][106225] Updated weights for policy 1, policy_version 1817648 (0.0007) [2023-12-28 08:17:44,226][106225] Updated weights for policy 1, policy_version 1817658 (0.0006) [2023-12-28 08:17:44,239][106226] Updated weights for policy 0, policy_version 1813390 (0.0011) [2023-12-28 08:17:44,292][106226] Updated weights for policy 0, policy_version 1813400 (0.0010) [2023-12-28 08:17:44,355][106226] Updated weights for policy 0, policy_version 1813410 (0.0011) [2023-12-28 08:17:44,939][106225] Updated weights for policy 1, policy_version 1817668 (0.0007) [2023-12-28 08:17:45,003][106225] Updated weights for policy 1, policy_version 1817678 (0.0008) [2023-12-28 08:17:45,063][106225] Updated weights for policy 1, policy_version 1817688 (0.0008) [2023-12-28 08:17:45,125][106226] Updated weights for policy 0, policy_version 1813420 (0.0010) [2023-12-28 08:17:45,181][106226] Updated weights for policy 0, policy_version 1813430 (0.0008) [2023-12-28 08:17:45,240][106226] Updated weights for policy 0, policy_version 1813440 (0.0008) [2023-12-28 08:17:45,760][106225] Updated weights for policy 1, policy_version 1817698 (0.0008) [2023-12-28 08:17:45,808][106225] Updated weights for policy 1, policy_version 1817708 (0.0007) [2023-12-28 08:17:45,871][106225] Updated weights for policy 1, policy_version 1817718 (0.0008) [2023-12-28 08:17:45,931][106225] Updated weights for policy 1, policy_version 1817728 (0.0008) [2023-12-28 08:17:45,933][106226] Updated weights for policy 0, policy_version 1813450 (0.0009) [2023-12-28 08:17:45,992][106226] Updated weights for policy 0, policy_version 1813460 (0.0010) [2023-12-28 08:17:46,049][106226] Updated weights for policy 0, policy_version 1813470 (0.0010) [2023-12-28 08:17:46,109][106226] Updated weights for policy 0, policy_version 1813480 (0.0010) [2023-12-28 08:17:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19934.0, 300 sec: 19771.9). Total num frames: 929726464. Throughput: 0: 9928.6, 1: 9923.2. Samples: 929712672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:46,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.943')] [2023-12-28 08:17:46,676][106225] Updated weights for policy 1, policy_version 1817738 (0.0010) [2023-12-28 08:17:46,732][106225] Updated weights for policy 1, policy_version 1817748 (0.0010) [2023-12-28 08:17:46,770][106226] Updated weights for policy 0, policy_version 1813490 (0.0007) [2023-12-28 08:17:46,789][106225] Updated weights for policy 1, policy_version 1817758 (0.0010) [2023-12-28 08:17:46,833][106226] Updated weights for policy 0, policy_version 1813500 (0.0006) [2023-12-28 08:17:46,896][106226] Updated weights for policy 0, policy_version 1813510 (0.0005) [2023-12-28 08:17:47,473][106225] Updated weights for policy 1, policy_version 1817768 (0.0010) [2023-12-28 08:17:47,530][106225] Updated weights for policy 1, policy_version 1817778 (0.0010) [2023-12-28 08:17:47,540][106226] Updated weights for policy 0, policy_version 1813520 (0.0006) [2023-12-28 08:17:47,589][106225] Updated weights for policy 1, policy_version 1817788 (0.0010) [2023-12-28 08:17:47,596][106226] Updated weights for policy 0, policy_version 1813530 (0.0008) [2023-12-28 08:17:47,645][106226] Updated weights for policy 0, policy_version 1813540 (0.0007) [2023-12-28 08:17:48,287][106225] Updated weights for policy 1, policy_version 1817798 (0.0010) [2023-12-28 08:17:48,343][106225] Updated weights for policy 1, policy_version 1817808 (0.0010) [2023-12-28 08:17:48,382][106226] Updated weights for policy 0, policy_version 1813550 (0.0008) [2023-12-28 08:17:48,411][106225] Updated weights for policy 1, policy_version 1817818 (0.0007) [2023-12-28 08:17:48,444][106226] Updated weights for policy 0, policy_version 1813560 (0.0008) [2023-12-28 08:17:48,503][106226] Updated weights for policy 0, policy_version 1813570 (0.0008) [2023-12-28 08:17:49,181][106225] Updated weights for policy 1, policy_version 1817828 (0.0008) [2023-12-28 08:17:49,195][106226] Updated weights for policy 0, policy_version 1813580 (0.0007) [2023-12-28 08:17:49,243][106225] Updated weights for policy 1, policy_version 1817838 (0.0007) [2023-12-28 08:17:49,263][106226] Updated weights for policy 0, policy_version 1813590 (0.0008) [2023-12-28 08:17:49,298][106225] Updated weights for policy 1, policy_version 1817848 (0.0007) [2023-12-28 08:17:49,327][106226] Updated weights for policy 0, policy_version 1813600 (0.0008) [2023-12-28 08:17:50,042][106225] Updated weights for policy 1, policy_version 1817858 (0.0008) [2023-12-28 08:17:50,068][106226] Updated weights for policy 0, policy_version 1813610 (0.0008) [2023-12-28 08:17:50,105][106225] Updated weights for policy 1, policy_version 1817868 (0.0008) [2023-12-28 08:17:50,131][106226] Updated weights for policy 0, policy_version 1813620 (0.0007) [2023-12-28 08:17:50,161][106225] Updated weights for policy 1, policy_version 1817878 (0.0007) [2023-12-28 08:17:50,192][106226] Updated weights for policy 0, policy_version 1813630 (0.0006) [2023-12-28 08:17:50,215][106225] Updated weights for policy 1, policy_version 1817888 (0.0007) [2023-12-28 08:17:50,254][106226] Updated weights for policy 0, policy_version 1813640 (0.0007) [2023-12-28 08:17:50,853][106226] Updated weights for policy 0, policy_version 1813650 (0.0009) [2023-12-28 08:17:50,909][106226] Updated weights for policy 0, policy_version 1813660 (0.0009) [2023-12-28 08:17:50,969][106226] Updated weights for policy 0, policy_version 1813670 (0.0009) [2023-12-28 08:17:51,038][106225] Updated weights for policy 1, policy_version 1817898 (0.0009) [2023-12-28 08:17:51,095][106225] Updated weights for policy 1, policy_version 1817908 (0.0009) [2023-12-28 08:17:51,162][106225] Updated weights for policy 1, policy_version 1817918 (0.0008) [2023-12-28 08:17:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.8, 300 sec: 19716.3). Total num frames: 929824768. Throughput: 0: 9961.4, 1: 9824.3. Samples: 929829212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:51,175][105115] Avg episode reward: [(0, '-4.141'), (1, '-4.698')] [2023-12-28 08:17:51,730][106226] Updated weights for policy 0, policy_version 1813680 (0.0008) [2023-12-28 08:17:51,799][106226] Updated weights for policy 0, policy_version 1813690 (0.0009) [2023-12-28 08:17:51,860][106226] Updated weights for policy 0, policy_version 1813700 (0.0008) [2023-12-28 08:17:51,958][106225] Updated weights for policy 1, policy_version 1817928 (0.0007) [2023-12-28 08:17:52,014][106225] Updated weights for policy 1, policy_version 1817938 (0.0009) [2023-12-28 08:17:52,074][106225] Updated weights for policy 1, policy_version 1817948 (0.0009) [2023-12-28 08:17:52,602][106226] Updated weights for policy 0, policy_version 1813710 (0.0009) [2023-12-28 08:17:52,667][106226] Updated weights for policy 0, policy_version 1813720 (0.0007) [2023-12-28 08:17:52,736][106226] Updated weights for policy 0, policy_version 1813730 (0.0008) [2023-12-28 08:17:52,816][106225] Updated weights for policy 1, policy_version 1817958 (0.0007) [2023-12-28 08:17:52,864][106225] Updated weights for policy 1, policy_version 1817968 (0.0005) [2023-12-28 08:17:52,915][106225] Updated weights for policy 1, policy_version 1817978 (0.0005) [2023-12-28 08:17:53,475][106225] Updated weights for policy 1, policy_version 1817988 (0.0005) [2023-12-28 08:17:53,529][106226] Updated weights for policy 0, policy_version 1813740 (0.0008) [2023-12-28 08:17:53,537][106225] Updated weights for policy 1, policy_version 1817998 (0.0006) [2023-12-28 08:17:53,593][106226] Updated weights for policy 0, policy_version 1813750 (0.0008) [2023-12-28 08:17:53,594][106225] Updated weights for policy 1, policy_version 1818008 (0.0010) [2023-12-28 08:17:53,660][106226] Updated weights for policy 0, policy_version 1813760 (0.0007) [2023-12-28 08:17:54,272][106225] Updated weights for policy 1, policy_version 1818018 (0.0010) [2023-12-28 08:17:54,329][106225] Updated weights for policy 1, policy_version 1818028 (0.0011) [2023-12-28 08:17:54,390][106225] Updated weights for policy 1, policy_version 1818038 (0.0010) [2023-12-28 08:17:54,400][106226] Updated weights for policy 0, policy_version 1813770 (0.0008) [2023-12-28 08:17:54,449][106225] Updated weights for policy 1, policy_version 1818048 (0.0010) [2023-12-28 08:17:54,463][106226] Updated weights for policy 0, policy_version 1813780 (0.0006) [2023-12-28 08:17:54,519][106226] Updated weights for policy 0, policy_version 1813790 (0.0005) [2023-12-28 08:17:54,588][106226] Updated weights for policy 0, policy_version 1813800 (0.0005) [2023-12-28 08:17:55,163][106226] Updated weights for policy 0, policy_version 1813810 (0.0007) [2023-12-28 08:17:55,176][106225] Updated weights for policy 1, policy_version 1818058 (0.0007) [2023-12-28 08:17:55,221][106226] Updated weights for policy 0, policy_version 1813820 (0.0006) [2023-12-28 08:17:55,230][106225] Updated weights for policy 1, policy_version 1818068 (0.0007) [2023-12-28 08:17:55,280][106226] Updated weights for policy 0, policy_version 1813830 (0.0007) [2023-12-28 08:17:55,291][106225] Updated weights for policy 1, policy_version 1818078 (0.0007) [2023-12-28 08:17:55,931][106225] Updated weights for policy 1, policy_version 1818088 (0.0006) [2023-12-28 08:17:55,988][106225] Updated weights for policy 1, policy_version 1818098 (0.0005) [2023-12-28 08:17:56,019][106226] Updated weights for policy 0, policy_version 1813840 (0.0007) [2023-12-28 08:17:56,047][106225] Updated weights for policy 1, policy_version 1818108 (0.0005) [2023-12-28 08:17:56,080][106226] Updated weights for policy 0, policy_version 1813850 (0.0009) [2023-12-28 08:17:56,137][106226] Updated weights for policy 0, policy_version 1813860 (0.0007) [2023-12-28 08:17:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 929923072. Throughput: 0: 9874.2, 1: 9831.0. Samples: 929886824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:17:56,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-4.696')] [2023-12-28 08:17:56,179][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001813864_464429056.pth... [2023-12-28 08:17:56,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001818112_465494016.pth... [2023-12-28 08:17:56,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001812680_464125952.pth [2023-12-28 08:17:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001816928_465190912.pth [2023-12-28 08:17:56,554][106225] Updated weights for policy 1, policy_version 1818118 (0.0007) [2023-12-28 08:17:56,605][106225] Updated weights for policy 1, policy_version 1818128 (0.0008) [2023-12-28 08:17:56,658][106225] Updated weights for policy 1, policy_version 1818138 (0.0008) [2023-12-28 08:17:56,915][106226] Updated weights for policy 0, policy_version 1813870 (0.0009) [2023-12-28 08:17:56,958][106226] Updated weights for policy 0, policy_version 1813880 (0.0008) [2023-12-28 08:17:57,005][106226] Updated weights for policy 0, policy_version 1813890 (0.0006) [2023-12-28 08:17:57,377][106225] Updated weights for policy 1, policy_version 1818148 (0.0007) [2023-12-28 08:17:57,427][106225] Updated weights for policy 1, policy_version 1818158 (0.0005) [2023-12-28 08:17:57,477][106225] Updated weights for policy 1, policy_version 1818168 (0.0005) [2023-12-28 08:17:57,737][106226] Updated weights for policy 0, policy_version 1813900 (0.0006) [2023-12-28 08:17:57,790][106226] Updated weights for policy 0, policy_version 1813910 (0.0008) [2023-12-28 08:17:57,838][106226] Updated weights for policy 0, policy_version 1813920 (0.0008) [2023-12-28 08:17:58,014][106225] Updated weights for policy 1, policy_version 1818178 (0.0005) [2023-12-28 08:17:58,076][106225] Updated weights for policy 1, policy_version 1818188 (0.0005) [2023-12-28 08:17:58,140][106225] Updated weights for policy 1, policy_version 1818198 (0.0006) [2023-12-28 08:17:58,198][106225] Updated weights for policy 1, policy_version 1818208 (0.0008) [2023-12-28 08:17:58,663][106226] Updated weights for policy 0, policy_version 1813930 (0.0009) [2023-12-28 08:17:58,722][106226] Updated weights for policy 0, policy_version 1813940 (0.0012) [2023-12-28 08:17:58,798][106226] Updated weights for policy 0, policy_version 1813950 (0.0009) [2023-12-28 08:17:58,865][106226] Updated weights for policy 0, policy_version 1813960 (0.0008) [2023-12-28 08:17:59,023][106225] Updated weights for policy 1, policy_version 1818218 (0.0008) [2023-12-28 08:17:59,083][106225] Updated weights for policy 1, policy_version 1818228 (0.0008) [2023-12-28 08:17:59,150][106225] Updated weights for policy 1, policy_version 1818238 (0.0008) [2023-12-28 08:17:59,626][106226] Updated weights for policy 0, policy_version 1813970 (0.0009) [2023-12-28 08:17:59,681][106226] Updated weights for policy 0, policy_version 1813980 (0.0007) [2023-12-28 08:17:59,741][106226] Updated weights for policy 0, policy_version 1813990 (0.0007) [2023-12-28 08:17:59,887][106225] Updated weights for policy 1, policy_version 1818248 (0.0007) [2023-12-28 08:17:59,953][106225] Updated weights for policy 1, policy_version 1818258 (0.0007) [2023-12-28 08:18:00,009][106225] Updated weights for policy 1, policy_version 1818268 (0.0008) [2023-12-28 08:18:00,527][106226] Updated weights for policy 0, policy_version 1814000 (0.0010) [2023-12-28 08:18:00,578][106226] Updated weights for policy 0, policy_version 1814010 (0.0009) [2023-12-28 08:18:00,633][106226] Updated weights for policy 0, policy_version 1814020 (0.0009) [2023-12-28 08:18:00,638][106225] Updated weights for policy 1, policy_version 1818278 (0.0006) [2023-12-28 08:18:00,689][106225] Updated weights for policy 1, policy_version 1818288 (0.0005) [2023-12-28 08:18:00,741][106225] Updated weights for policy 1, policy_version 1818298 (0.0005) [2023-12-28 08:18:01,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 930013184. Throughput: 0: 9758.5, 1: 9932.4. Samples: 930004704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:01,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.812')] [2023-12-28 08:18:01,367][106225] Updated weights for policy 1, policy_version 1818308 (0.0006) [2023-12-28 08:18:01,421][106226] Updated weights for policy 0, policy_version 1814030 (0.0009) [2023-12-28 08:18:01,430][106225] Updated weights for policy 1, policy_version 1818318 (0.0007) [2023-12-28 08:18:01,478][106225] Updated weights for policy 1, policy_version 1818328 (0.0006) [2023-12-28 08:18:01,481][106226] Updated weights for policy 0, policy_version 1814040 (0.0008) [2023-12-28 08:18:01,534][106226] Updated weights for policy 0, policy_version 1814050 (0.0007) [2023-12-28 08:18:02,104][106225] Updated weights for policy 1, policy_version 1818338 (0.0007) [2023-12-28 08:18:02,159][106225] Updated weights for policy 1, policy_version 1818348 (0.0007) [2023-12-28 08:18:02,199][106226] Updated weights for policy 0, policy_version 1814061 (0.0008) [2023-12-28 08:18:02,222][106225] Updated weights for policy 1, policy_version 1818358 (0.0007) [2023-12-28 08:18:02,255][106226] Updated weights for policy 0, policy_version 1814071 (0.0008) [2023-12-28 08:18:02,286][106225] Updated weights for policy 1, policy_version 1818368 (0.0007) [2023-12-28 08:18:02,319][106226] Updated weights for policy 0, policy_version 1814081 (0.0006) [2023-12-28 08:18:02,962][106226] Updated weights for policy 0, policy_version 1814091 (0.0007) [2023-12-28 08:18:02,968][106225] Updated weights for policy 1, policy_version 1818378 (0.0008) [2023-12-28 08:18:03,019][106226] Updated weights for policy 0, policy_version 1814101 (0.0005) [2023-12-28 08:18:03,020][106225] Updated weights for policy 1, policy_version 1818388 (0.0005) [2023-12-28 08:18:03,065][106226] Updated weights for policy 0, policy_version 1814111 (0.0005) [2023-12-28 08:18:03,072][106225] Updated weights for policy 1, policy_version 1818398 (0.0006) [2023-12-28 08:18:03,600][106226] Updated weights for policy 0, policy_version 1814121 (0.0005) [2023-12-28 08:18:03,614][106225] Updated weights for policy 1, policy_version 1818408 (0.0006) [2023-12-28 08:18:03,650][106226] Updated weights for policy 0, policy_version 1814131 (0.0009) [2023-12-28 08:18:03,664][106225] Updated weights for policy 1, policy_version 1818418 (0.0006) [2023-12-28 08:18:03,707][106226] Updated weights for policy 0, policy_version 1814141 (0.0010) [2023-12-28 08:18:03,713][106225] Updated weights for policy 1, policy_version 1818428 (0.0005) [2023-12-28 08:18:03,765][106226] Updated weights for policy 0, policy_version 1814151 (0.0010) [2023-12-28 08:18:04,441][106225] Updated weights for policy 1, policy_version 1818438 (0.0010) [2023-12-28 08:18:04,501][106225] Updated weights for policy 1, policy_version 1818448 (0.0010) [2023-12-28 08:18:04,509][106226] Updated weights for policy 0, policy_version 1814161 (0.0006) [2023-12-28 08:18:04,551][106225] Updated weights for policy 1, policy_version 1818458 (0.0008) [2023-12-28 08:18:04,565][106226] Updated weights for policy 0, policy_version 1814171 (0.0006) [2023-12-28 08:18:04,621][106226] Updated weights for policy 0, policy_version 1814181 (0.0008) [2023-12-28 08:18:05,251][106225] Updated weights for policy 1, policy_version 1818468 (0.0007) [2023-12-28 08:18:05,288][106226] Updated weights for policy 0, policy_version 1814191 (0.0007) [2023-12-28 08:18:05,311][106225] Updated weights for policy 1, policy_version 1818478 (0.0010) [2023-12-28 08:18:05,349][106226] Updated weights for policy 0, policy_version 1814201 (0.0007) [2023-12-28 08:18:05,371][106225] Updated weights for policy 1, policy_version 1818488 (0.0010) [2023-12-28 08:18:05,411][106226] Updated weights for policy 0, policy_version 1814211 (0.0007) [2023-12-28 08:18:05,991][106225] Updated weights for policy 1, policy_version 1818498 (0.0007) [2023-12-28 08:18:06,052][106225] Updated weights for policy 1, policy_version 1818508 (0.0010) [2023-12-28 08:18:06,076][106226] Updated weights for policy 0, policy_version 1814221 (0.0009) [2023-12-28 08:18:06,112][106225] Updated weights for policy 1, policy_version 1818518 (0.0008) [2023-12-28 08:18:06,138][106226] Updated weights for policy 0, policy_version 1814231 (0.0006) [2023-12-28 08:18:06,159][106225] Updated weights for policy 1, policy_version 1818528 (0.0008) [2023-12-28 08:18:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 930119680. Throughput: 0: 9845.3, 1: 10087.4. Samples: 930129844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:06,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-5.073')] [2023-12-28 08:18:06,197][106226] Updated weights for policy 0, policy_version 1814241 (0.0008) [2023-12-28 08:18:06,862][106225] Updated weights for policy 1, policy_version 1818538 (0.0010) [2023-12-28 08:18:06,922][106225] Updated weights for policy 1, policy_version 1818548 (0.0010) [2023-12-28 08:18:06,938][106226] Updated weights for policy 0, policy_version 1814251 (0.0008) [2023-12-28 08:18:06,980][106225] Updated weights for policy 1, policy_version 1818558 (0.0011) [2023-12-28 08:18:06,992][106226] Updated weights for policy 0, policy_version 1814261 (0.0005) [2023-12-28 08:18:07,054][106226] Updated weights for policy 0, policy_version 1814271 (0.0008) [2023-12-28 08:18:07,690][106226] Updated weights for policy 0, policy_version 1814281 (0.0007) [2023-12-28 08:18:07,694][106225] Updated weights for policy 1, policy_version 1818568 (0.0010) [2023-12-28 08:18:07,740][106226] Updated weights for policy 0, policy_version 1814291 (0.0010) [2023-12-28 08:18:07,747][106225] Updated weights for policy 1, policy_version 1818578 (0.0010) [2023-12-28 08:18:07,793][106226] Updated weights for policy 0, policy_version 1814301 (0.0010) [2023-12-28 08:18:07,800][106225] Updated weights for policy 1, policy_version 1818588 (0.0010) [2023-12-28 08:18:07,843][106226] Updated weights for policy 0, policy_version 1814311 (0.0010) [2023-12-28 08:18:08,449][106226] Updated weights for policy 0, policy_version 1814321 (0.0008) [2023-12-28 08:18:08,496][106226] Updated weights for policy 0, policy_version 1814331 (0.0008) [2023-12-28 08:18:08,553][106226] Updated weights for policy 0, policy_version 1814341 (0.0007) [2023-12-28 08:18:08,582][106225] Updated weights for policy 1, policy_version 1818598 (0.0009) [2023-12-28 08:18:08,651][106225] Updated weights for policy 1, policy_version 1818608 (0.0008) [2023-12-28 08:18:08,713][106225] Updated weights for policy 1, policy_version 1818618 (0.0008) [2023-12-28 08:18:09,237][106226] Updated weights for policy 0, policy_version 1814351 (0.0007) [2023-12-28 08:18:09,305][106226] Updated weights for policy 0, policy_version 1814361 (0.0007) [2023-12-28 08:18:09,372][106226] Updated weights for policy 0, policy_version 1814371 (0.0011) [2023-12-28 08:18:09,378][106225] Updated weights for policy 1, policy_version 1818628 (0.0008) [2023-12-28 08:18:09,449][106225] Updated weights for policy 1, policy_version 1818638 (0.0007) [2023-12-28 08:18:09,509][106225] Updated weights for policy 1, policy_version 1818648 (0.0006) [2023-12-28 08:18:10,112][106226] Updated weights for policy 0, policy_version 1814381 (0.0011) [2023-12-28 08:18:10,177][106226] Updated weights for policy 0, policy_version 1814391 (0.0011) [2023-12-28 08:18:10,232][106226] Updated weights for policy 0, policy_version 1814401 (0.0011) [2023-12-28 08:18:10,245][106225] Updated weights for policy 1, policy_version 1818658 (0.0006) [2023-12-28 08:18:10,302][106225] Updated weights for policy 1, policy_version 1818668 (0.0006) [2023-12-28 08:18:10,362][106225] Updated weights for policy 1, policy_version 1818678 (0.0006) [2023-12-28 08:18:10,423][106225] Updated weights for policy 1, policy_version 1818688 (0.0007) [2023-12-28 08:18:10,957][106226] Updated weights for policy 0, policy_version 1814411 (0.0011) [2023-12-28 08:18:11,024][106226] Updated weights for policy 0, policy_version 1814421 (0.0010) [2023-12-28 08:18:11,089][106226] Updated weights for policy 0, policy_version 1814431 (0.0008) [2023-12-28 08:18:11,153][106225] Updated weights for policy 1, policy_version 1818698 (0.0008) [2023-12-28 08:18:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 930217984. Throughput: 0: 9932.7, 1: 10063.0. Samples: 930190204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:11,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.408')] [2023-12-28 08:18:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001814440_464576512.pth... [2023-12-28 08:18:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001813288_464281600.pth [2023-12-28 08:18:11,222][106225] Updated weights for policy 1, policy_version 1818708 (0.0009) [2023-12-28 08:18:11,291][106225] Updated weights for policy 1, policy_version 1818718 (0.0007) [2023-12-28 08:18:11,302][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001818720_465649664.pth... [2023-12-28 08:18:11,307][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001817536_465346560.pth [2023-12-28 08:18:11,937][106226] Updated weights for policy 0, policy_version 1814441 (0.0008) [2023-12-28 08:18:11,968][106225] Updated weights for policy 1, policy_version 1818728 (0.0010) [2023-12-28 08:18:11,993][106226] Updated weights for policy 0, policy_version 1814451 (0.0006) [2023-12-28 08:18:12,028][106225] Updated weights for policy 1, policy_version 1818738 (0.0008) [2023-12-28 08:18:12,046][106226] Updated weights for policy 0, policy_version 1814461 (0.0007) [2023-12-28 08:18:12,091][106225] Updated weights for policy 1, policy_version 1818748 (0.0006) [2023-12-28 08:18:12,112][106226] Updated weights for policy 0, policy_version 1814471 (0.0008) [2023-12-28 08:18:12,727][106225] Updated weights for policy 1, policy_version 1818758 (0.0007) [2023-12-28 08:18:12,786][106225] Updated weights for policy 1, policy_version 1818768 (0.0008) [2023-12-28 08:18:12,844][106225] Updated weights for policy 1, policy_version 1818778 (0.0006) [2023-12-28 08:18:12,922][106226] Updated weights for policy 0, policy_version 1814481 (0.0006) [2023-12-28 08:18:12,982][106226] Updated weights for policy 0, policy_version 1814491 (0.0006) [2023-12-28 08:18:13,038][106226] Updated weights for policy 0, policy_version 1814501 (0.0005) [2023-12-28 08:18:13,501][106225] Updated weights for policy 1, policy_version 1818788 (0.0007) [2023-12-28 08:18:13,555][106225] Updated weights for policy 1, policy_version 1818798 (0.0010) [2023-12-28 08:18:13,624][106225] Updated weights for policy 1, policy_version 1818808 (0.0010) [2023-12-28 08:18:13,703][106226] Updated weights for policy 0, policy_version 1814511 (0.0007) [2023-12-28 08:18:13,762][106226] Updated weights for policy 0, policy_version 1814521 (0.0008) [2023-12-28 08:18:13,819][106226] Updated weights for policy 0, policy_version 1814531 (0.0009) [2023-12-28 08:18:14,219][106225] Updated weights for policy 1, policy_version 1818818 (0.0010) [2023-12-28 08:18:14,271][106225] Updated weights for policy 1, policy_version 1818828 (0.0008) [2023-12-28 08:18:14,322][106225] Updated weights for policy 1, policy_version 1818838 (0.0008) [2023-12-28 08:18:14,378][106225] Updated weights for policy 1, policy_version 1818848 (0.0008) [2023-12-28 08:18:14,522][106226] Updated weights for policy 0, policy_version 1814541 (0.0009) [2023-12-28 08:18:14,581][106226] Updated weights for policy 0, policy_version 1814551 (0.0009) [2023-12-28 08:18:14,635][106226] Updated weights for policy 0, policy_version 1814561 (0.0009) [2023-12-28 08:18:15,141][106225] Updated weights for policy 1, policy_version 1818858 (0.0008) [2023-12-28 08:18:15,207][106225] Updated weights for policy 1, policy_version 1818868 (0.0009) [2023-12-28 08:18:15,269][106225] Updated weights for policy 1, policy_version 1818878 (0.0008) [2023-12-28 08:18:15,337][106226] Updated weights for policy 0, policy_version 1814571 (0.0008) [2023-12-28 08:18:15,401][106226] Updated weights for policy 0, policy_version 1814581 (0.0009) [2023-12-28 08:18:15,465][106226] Updated weights for policy 0, policy_version 1814591 (0.0007) [2023-12-28 08:18:15,941][106225] Updated weights for policy 1, policy_version 1818888 (0.0006) [2023-12-28 08:18:15,994][106225] Updated weights for policy 1, policy_version 1818898 (0.0008) [2023-12-28 08:18:16,063][106225] Updated weights for policy 1, policy_version 1818908 (0.0008) [2023-12-28 08:18:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 930316288. Throughput: 0: 9816.7, 1: 10060.4. Samples: 930306208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:16,175][105115] Avg episode reward: [(0, '-4.554'), (1, '-5.097')] [2023-12-28 08:18:16,214][106226] Updated weights for policy 0, policy_version 1814601 (0.0009) [2023-12-28 08:18:16,275][106226] Updated weights for policy 0, policy_version 1814611 (0.0008) [2023-12-28 08:18:16,327][106226] Updated weights for policy 0, policy_version 1814621 (0.0008) [2023-12-28 08:18:16,379][106226] Updated weights for policy 0, policy_version 1814631 (0.0008) [2023-12-28 08:18:16,664][106225] Updated weights for policy 1, policy_version 1818918 (0.0008) [2023-12-28 08:18:16,712][106225] Updated weights for policy 1, policy_version 1818928 (0.0008) [2023-12-28 08:18:16,764][106225] Updated weights for policy 1, policy_version 1818938 (0.0008) [2023-12-28 08:18:17,187][106226] Updated weights for policy 0, policy_version 1814641 (0.0008) [2023-12-28 08:18:17,247][106226] Updated weights for policy 0, policy_version 1814651 (0.0009) [2023-12-28 08:18:17,304][106226] Updated weights for policy 0, policy_version 1814661 (0.0009) [2023-12-28 08:18:17,465][106225] Updated weights for policy 1, policy_version 1818948 (0.0008) [2023-12-28 08:18:17,523][106225] Updated weights for policy 1, policy_version 1818958 (0.0008) [2023-12-28 08:18:17,588][106225] Updated weights for policy 1, policy_version 1818968 (0.0009) [2023-12-28 08:18:17,967][106226] Updated weights for policy 0, policy_version 1814671 (0.0006) [2023-12-28 08:18:18,032][106226] Updated weights for policy 0, policy_version 1814681 (0.0007) [2023-12-28 08:18:18,086][106226] Updated weights for policy 0, policy_version 1814692 (0.0008) [2023-12-28 08:18:18,353][106225] Updated weights for policy 1, policy_version 1818978 (0.0008) [2023-12-28 08:18:18,420][106225] Updated weights for policy 1, policy_version 1818988 (0.0008) [2023-12-28 08:18:18,485][106225] Updated weights for policy 1, policy_version 1818998 (0.0009) [2023-12-28 08:18:18,541][106225] Updated weights for policy 1, policy_version 1819008 (0.0008) [2023-12-28 08:18:18,788][106226] Updated weights for policy 0, policy_version 1814702 (0.0010) [2023-12-28 08:18:18,840][106226] Updated weights for policy 0, policy_version 1814712 (0.0008) [2023-12-28 08:18:18,899][106226] Updated weights for policy 0, policy_version 1814722 (0.0009) [2023-12-28 08:18:19,346][106225] Updated weights for policy 1, policy_version 1819018 (0.0009) [2023-12-28 08:18:19,414][106225] Updated weights for policy 1, policy_version 1819028 (0.0008) [2023-12-28 08:18:19,475][106225] Updated weights for policy 1, policy_version 1819038 (0.0008) [2023-12-28 08:18:19,602][106226] Updated weights for policy 0, policy_version 1814732 (0.0010) [2023-12-28 08:18:19,669][106226] Updated weights for policy 0, policy_version 1814742 (0.0009) [2023-12-28 08:18:19,733][106226] Updated weights for policy 0, policy_version 1814752 (0.0007) [2023-12-28 08:18:20,189][106225] Updated weights for policy 1, policy_version 1819048 (0.0008) [2023-12-28 08:18:20,258][106225] Updated weights for policy 1, policy_version 1819058 (0.0007) [2023-12-28 08:18:20,327][106225] Updated weights for policy 1, policy_version 1819068 (0.0008) [2023-12-28 08:18:20,439][106226] Updated weights for policy 0, policy_version 1814762 (0.0009) [2023-12-28 08:18:20,502][106226] Updated weights for policy 0, policy_version 1814772 (0.0008) [2023-12-28 08:18:20,582][106226] Updated weights for policy 0, policy_version 1814782 (0.0008) [2023-12-28 08:18:20,653][106226] Updated weights for policy 0, policy_version 1814792 (0.0009) [2023-12-28 08:18:21,094][106225] Updated weights for policy 1, policy_version 1819078 (0.0008) [2023-12-28 08:18:21,165][106225] Updated weights for policy 1, policy_version 1819088 (0.0007) [2023-12-28 08:18:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 930406400. Throughput: 0: 9750.9, 1: 9955.5. Samples: 930421528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:21,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.702')] [2023-12-28 08:18:21,228][106225] Updated weights for policy 1, policy_version 1819098 (0.0006) [2023-12-28 08:18:21,394][106226] Updated weights for policy 0, policy_version 1814802 (0.0008) [2023-12-28 08:18:21,452][106226] Updated weights for policy 0, policy_version 1814812 (0.0007) [2023-12-28 08:18:21,515][106226] Updated weights for policy 0, policy_version 1814822 (0.0008) [2023-12-28 08:18:22,002][106225] Updated weights for policy 1, policy_version 1819108 (0.0009) [2023-12-28 08:18:22,049][106225] Updated weights for policy 1, policy_version 1819118 (0.0006) [2023-12-28 08:18:22,100][106225] Updated weights for policy 1, policy_version 1819128 (0.0007) [2023-12-28 08:18:22,216][106226] Updated weights for policy 0, policy_version 1814832 (0.0010) [2023-12-28 08:18:22,285][106226] Updated weights for policy 0, policy_version 1814842 (0.0010) [2023-12-28 08:18:22,352][106226] Updated weights for policy 0, policy_version 1814852 (0.0011) [2023-12-28 08:18:22,879][106225] Updated weights for policy 1, policy_version 1819138 (0.0009) [2023-12-28 08:18:22,941][106225] Updated weights for policy 1, policy_version 1819148 (0.0010) [2023-12-28 08:18:22,990][106225] Updated weights for policy 1, policy_version 1819158 (0.0009) [2023-12-28 08:18:23,014][106226] Updated weights for policy 0, policy_version 1814862 (0.0008) [2023-12-28 08:18:23,041][106225] Updated weights for policy 1, policy_version 1819168 (0.0009) [2023-12-28 08:18:23,083][106226] Updated weights for policy 0, policy_version 1814872 (0.0005) [2023-12-28 08:18:23,153][106226] Updated weights for policy 0, policy_version 1814882 (0.0005) [2023-12-28 08:18:23,648][106226] Updated weights for policy 0, policy_version 1814892 (0.0006) [2023-12-28 08:18:23,705][106226] Updated weights for policy 0, policy_version 1814902 (0.0005) [2023-12-28 08:18:23,773][106226] Updated weights for policy 0, policy_version 1814912 (0.0005) [2023-12-28 08:18:23,840][106225] Updated weights for policy 1, policy_version 1819178 (0.0008) [2023-12-28 08:18:23,887][106225] Updated weights for policy 1, policy_version 1819188 (0.0008) [2023-12-28 08:18:23,944][106225] Updated weights for policy 1, policy_version 1819199 (0.0009) [2023-12-28 08:18:24,303][106226] Updated weights for policy 0, policy_version 1814922 (0.0008) [2023-12-28 08:18:24,360][106226] Updated weights for policy 0, policy_version 1814932 (0.0005) [2023-12-28 08:18:24,418][106226] Updated weights for policy 0, policy_version 1814942 (0.0005) [2023-12-28 08:18:24,473][106226] Updated weights for policy 0, policy_version 1814952 (0.0008) [2023-12-28 08:18:24,559][106225] Updated weights for policy 1, policy_version 1819210 (0.0007) [2023-12-28 08:18:24,611][106225] Updated weights for policy 1, policy_version 1819220 (0.0006) [2023-12-28 08:18:24,675][106225] Updated weights for policy 1, policy_version 1819230 (0.0005) [2023-12-28 08:18:25,131][106226] Updated weights for policy 0, policy_version 1814962 (0.0005) [2023-12-28 08:18:25,184][106226] Updated weights for policy 0, policy_version 1814972 (0.0006) [2023-12-28 08:18:25,242][106226] Updated weights for policy 0, policy_version 1814982 (0.0005) [2023-12-28 08:18:25,272][106225] Updated weights for policy 1, policy_version 1819240 (0.0008) [2023-12-28 08:18:25,336][106225] Updated weights for policy 1, policy_version 1819250 (0.0009) [2023-12-28 08:18:25,390][106225] Updated weights for policy 1, policy_version 1819260 (0.0007) [2023-12-28 08:18:25,882][106226] Updated weights for policy 0, policy_version 1814992 (0.0007) [2023-12-28 08:18:25,935][106226] Updated weights for policy 0, policy_version 1815002 (0.0006) [2023-12-28 08:18:25,991][106226] Updated weights for policy 0, policy_version 1815012 (0.0005) [2023-12-28 08:18:26,068][106225] Updated weights for policy 1, policy_version 1819270 (0.0006) [2023-12-28 08:18:26,123][106225] Updated weights for policy 1, policy_version 1819280 (0.0006) [2023-12-28 08:18:26,172][106225] Updated weights for policy 1, policy_version 1819290 (0.0005) [2023-12-28 08:18:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 930512896. Throughput: 0: 9757.3, 1: 9923.1. Samples: 930481016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:26,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-4.931')] [2023-12-28 08:18:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001815016_464723968.pth... [2023-12-28 08:18:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001813864_464429056.pth [2023-12-28 08:18:26,205][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001819296_465797120.pth... [2023-12-28 08:18:26,210][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001818112_465494016.pth [2023-12-28 08:18:26,686][106225] Updated weights for policy 1, policy_version 1819300 (0.0005) [2023-12-28 08:18:26,747][106225] Updated weights for policy 1, policy_version 1819310 (0.0006) [2023-12-28 08:18:26,765][106226] Updated weights for policy 0, policy_version 1815022 (0.0008) [2023-12-28 08:18:26,805][106225] Updated weights for policy 1, policy_version 1819320 (0.0005) [2023-12-28 08:18:26,825][106226] Updated weights for policy 0, policy_version 1815032 (0.0008) [2023-12-28 08:18:26,871][106226] Updated weights for policy 0, policy_version 1815042 (0.0008) [2023-12-28 08:18:27,394][106225] Updated weights for policy 1, policy_version 1819330 (0.0006) [2023-12-28 08:18:27,443][106225] Updated weights for policy 1, policy_version 1819340 (0.0007) [2023-12-28 08:18:27,491][106225] Updated weights for policy 1, policy_version 1819350 (0.0005) [2023-12-28 08:18:27,540][106225] Updated weights for policy 1, policy_version 1819360 (0.0006) [2023-12-28 08:18:27,650][106226] Updated weights for policy 0, policy_version 1815052 (0.0009) [2023-12-28 08:18:27,700][106226] Updated weights for policy 0, policy_version 1815062 (0.0008) [2023-12-28 08:18:27,749][106226] Updated weights for policy 0, policy_version 1815072 (0.0008) [2023-12-28 08:18:28,230][106225] Updated weights for policy 1, policy_version 1819370 (0.0008) [2023-12-28 08:18:28,277][106225] Updated weights for policy 1, policy_version 1819380 (0.0008) [2023-12-28 08:18:28,335][106225] Updated weights for policy 1, policy_version 1819390 (0.0008) [2023-12-28 08:18:28,484][106226] Updated weights for policy 0, policy_version 1815082 (0.0008) [2023-12-28 08:18:28,536][106226] Updated weights for policy 0, policy_version 1815092 (0.0008) [2023-12-28 08:18:28,587][106226] Updated weights for policy 0, policy_version 1815102 (0.0008) [2023-12-28 08:18:28,636][106226] Updated weights for policy 0, policy_version 1815112 (0.0007) [2023-12-28 08:18:29,067][106225] Updated weights for policy 1, policy_version 1819400 (0.0006) [2023-12-28 08:18:29,118][106225] Updated weights for policy 1, policy_version 1819410 (0.0005) [2023-12-28 08:18:29,163][106225] Updated weights for policy 1, policy_version 1819420 (0.0005) [2023-12-28 08:18:29,421][106226] Updated weights for policy 0, policy_version 1815122 (0.0007) [2023-12-28 08:18:29,488][106226] Updated weights for policy 0, policy_version 1815132 (0.0005) [2023-12-28 08:18:29,557][106226] Updated weights for policy 0, policy_version 1815142 (0.0005) [2023-12-28 08:18:29,770][106225] Updated weights for policy 1, policy_version 1819430 (0.0007) [2023-12-28 08:18:29,833][106225] Updated weights for policy 1, policy_version 1819440 (0.0008) [2023-12-28 08:18:29,901][106225] Updated weights for policy 1, policy_version 1819450 (0.0009) [2023-12-28 08:18:30,251][106226] Updated weights for policy 0, policy_version 1815152 (0.0009) [2023-12-28 08:18:30,301][106226] Updated weights for policy 0, policy_version 1815162 (0.0008) [2023-12-28 08:18:30,359][106226] Updated weights for policy 0, policy_version 1815172 (0.0008) [2023-12-28 08:18:30,618][106225] Updated weights for policy 1, policy_version 1819460 (0.0007) [2023-12-28 08:18:30,662][106225] Updated weights for policy 1, policy_version 1819470 (0.0008) [2023-12-28 08:18:30,706][106225] Updated weights for policy 1, policy_version 1819480 (0.0008) [2023-12-28 08:18:31,023][106226] Updated weights for policy 0, policy_version 1815182 (0.0008) [2023-12-28 08:18:31,087][106226] Updated weights for policy 0, policy_version 1815192 (0.0008) [2023-12-28 08:18:31,157][106226] Updated weights for policy 0, policy_version 1815202 (0.0009) [2023-12-28 08:18:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 930611200. Throughput: 0: 9790.3, 1: 10058.9. Samples: 930605888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:18:31,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.499')] [2023-12-28 08:18:31,449][106225] Updated weights for policy 1, policy_version 1819490 (0.0008) [2023-12-28 08:18:31,508][106225] Updated weights for policy 1, policy_version 1819500 (0.0009) [2023-12-28 08:18:31,562][106225] Updated weights for policy 1, policy_version 1819510 (0.0009) [2023-12-28 08:18:31,616][106225] Updated weights for policy 1, policy_version 1819520 (0.0008) [2023-12-28 08:18:31,833][106226] Updated weights for policy 0, policy_version 1815212 (0.0008) [2023-12-28 08:18:31,901][106226] Updated weights for policy 0, policy_version 1815222 (0.0008) [2023-12-28 08:18:31,988][106226] Updated weights for policy 0, policy_version 1815232 (0.0010) [2023-12-28 08:18:32,304][106225] Updated weights for policy 1, policy_version 1819530 (0.0009) [2023-12-28 08:18:32,372][106225] Updated weights for policy 1, policy_version 1819540 (0.0010) [2023-12-28 08:18:32,433][106225] Updated weights for policy 1, policy_version 1819550 (0.0010) [2023-12-28 08:18:32,731][106226] Updated weights for policy 0, policy_version 1815242 (0.0008) [2023-12-28 08:18:32,781][106226] Updated weights for policy 0, policy_version 1815252 (0.0007) [2023-12-28 08:18:32,839][106226] Updated weights for policy 0, policy_version 1815262 (0.0007) [2023-12-28 08:18:32,895][106226] Updated weights for policy 0, policy_version 1815272 (0.0008) [2023-12-28 08:18:33,117][106225] Updated weights for policy 1, policy_version 1819560 (0.0005) [2023-12-28 08:18:33,161][106225] Updated weights for policy 1, policy_version 1819570 (0.0005) [2023-12-28 08:18:33,205][106225] Updated weights for policy 1, policy_version 1819580 (0.0005) [2023-12-28 08:18:33,575][106226] Updated weights for policy 0, policy_version 1815282 (0.0008) [2023-12-28 08:18:33,621][106226] Updated weights for policy 0, policy_version 1815292 (0.0008) [2023-12-28 08:18:33,666][106226] Updated weights for policy 0, policy_version 1815302 (0.0008) [2023-12-28 08:18:33,870][106225] Updated weights for policy 1, policy_version 1819590 (0.0008) [2023-12-28 08:18:33,922][106225] Updated weights for policy 1, policy_version 1819600 (0.0010) [2023-12-28 08:18:33,978][106225] Updated weights for policy 1, policy_version 1819610 (0.0010) [2023-12-28 08:18:34,408][106226] Updated weights for policy 0, policy_version 1815312 (0.0008) [2023-12-28 08:18:34,473][106226] Updated weights for policy 0, policy_version 1815322 (0.0009) [2023-12-28 08:18:34,547][106226] Updated weights for policy 0, policy_version 1815332 (0.0009) [2023-12-28 08:18:34,648][106225] Updated weights for policy 1, policy_version 1819620 (0.0008) [2023-12-28 08:18:34,703][106225] Updated weights for policy 1, policy_version 1819630 (0.0006) [2023-12-28 08:18:34,754][106225] Updated weights for policy 1, policy_version 1819640 (0.0005) [2023-12-28 08:18:35,254][106226] Updated weights for policy 0, policy_version 1815342 (0.0009) [2023-12-28 08:18:35,278][106225] Updated weights for policy 1, policy_version 1819650 (0.0005) [2023-12-28 08:18:35,316][106226] Updated weights for policy 0, policy_version 1815352 (0.0008) [2023-12-28 08:18:35,329][106225] Updated weights for policy 1, policy_version 1819660 (0.0005) [2023-12-28 08:18:35,374][106226] Updated weights for policy 0, policy_version 1815362 (0.0008) [2023-12-28 08:18:35,386][106225] Updated weights for policy 1, policy_version 1819670 (0.0010) [2023-12-28 08:18:35,439][106225] Updated weights for policy 1, policy_version 1819680 (0.0010) [2023-12-28 08:18:36,129][106226] Updated weights for policy 0, policy_version 1815372 (0.0006) [2023-12-28 08:18:36,155][106225] Updated weights for policy 1, policy_version 1819690 (0.0007) [2023-12-28 08:18:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 930709504. Throughput: 0: 9769.0, 1: 10159.2. Samples: 930725980. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:18:36,176][105115] Avg episode reward: [(0, '-4.221'), (1, '-4.804')] [2023-12-28 08:18:36,196][106226] Updated weights for policy 0, policy_version 1815382 (0.0008) [2023-12-28 08:18:36,221][106225] Updated weights for policy 1, policy_version 1819700 (0.0006) [2023-12-28 08:18:36,263][106226] Updated weights for policy 0, policy_version 1815392 (0.0008) [2023-12-28 08:18:36,276][106225] Updated weights for policy 1, policy_version 1819710 (0.0007) [2023-12-28 08:18:36,974][106225] Updated weights for policy 1, policy_version 1819720 (0.0008) [2023-12-28 08:18:36,987][106226] Updated weights for policy 0, policy_version 1815402 (0.0008) [2023-12-28 08:18:37,026][106225] Updated weights for policy 1, policy_version 1819730 (0.0006) [2023-12-28 08:18:37,040][106226] Updated weights for policy 0, policy_version 1815412 (0.0007) [2023-12-28 08:18:37,079][106225] Updated weights for policy 1, policy_version 1819740 (0.0006) [2023-12-28 08:18:37,096][106226] Updated weights for policy 0, policy_version 1815422 (0.0008) [2023-12-28 08:18:37,156][106226] Updated weights for policy 0, policy_version 1815432 (0.0009) [2023-12-28 08:18:37,817][106225] Updated weights for policy 1, policy_version 1819750 (0.0008) [2023-12-28 08:18:37,871][106225] Updated weights for policy 1, policy_version 1819760 (0.0008) [2023-12-28 08:18:37,894][106226] Updated weights for policy 0, policy_version 1815442 (0.0010) [2023-12-28 08:18:37,928][106225] Updated weights for policy 1, policy_version 1819770 (0.0008) [2023-12-28 08:18:37,942][106226] Updated weights for policy 0, policy_version 1815452 (0.0007) [2023-12-28 08:18:37,989][106226] Updated weights for policy 0, policy_version 1815462 (0.0008) [2023-12-28 08:18:38,586][106225] Updated weights for policy 1, policy_version 1819780 (0.0008) [2023-12-28 08:18:38,647][106225] Updated weights for policy 1, policy_version 1819790 (0.0011) [2023-12-28 08:18:38,707][106225] Updated weights for policy 1, policy_version 1819800 (0.0008) [2023-12-28 08:18:38,781][106226] Updated weights for policy 0, policy_version 1815472 (0.0008) [2023-12-28 08:18:38,836][106226] Updated weights for policy 0, policy_version 1815482 (0.0008) [2023-12-28 08:18:38,898][106226] Updated weights for policy 0, policy_version 1815492 (0.0008) [2023-12-28 08:18:39,448][106225] Updated weights for policy 1, policy_version 1819810 (0.0007) [2023-12-28 08:18:39,507][106225] Updated weights for policy 1, policy_version 1819820 (0.0006) [2023-12-28 08:18:39,570][106225] Updated weights for policy 1, policy_version 1819830 (0.0005) [2023-12-28 08:18:39,626][106225] Updated weights for policy 1, policy_version 1819840 (0.0005) [2023-12-28 08:18:39,723][106226] Updated weights for policy 0, policy_version 1815502 (0.0009) [2023-12-28 08:18:39,781][106226] Updated weights for policy 0, policy_version 1815512 (0.0009) [2023-12-28 08:18:39,839][106226] Updated weights for policy 0, policy_version 1815522 (0.0009) [2023-12-28 08:18:40,198][106225] Updated weights for policy 1, policy_version 1819850 (0.0006) [2023-12-28 08:18:40,256][106225] Updated weights for policy 1, policy_version 1819860 (0.0009) [2023-12-28 08:18:40,312][106225] Updated weights for policy 1, policy_version 1819870 (0.0008) [2023-12-28 08:18:40,664][106226] Updated weights for policy 0, policy_version 1815532 (0.0009) [2023-12-28 08:18:40,711][106226] Updated weights for policy 0, policy_version 1815542 (0.0008) [2023-12-28 08:18:40,775][106226] Updated weights for policy 0, policy_version 1815552 (0.0008) [2023-12-28 08:18:41,040][106225] Updated weights for policy 1, policy_version 1819880 (0.0009) [2023-12-28 08:18:41,107][106225] Updated weights for policy 1, policy_version 1819890 (0.0011) [2023-12-28 08:18:41,173][106225] Updated weights for policy 1, policy_version 1819900 (0.0008) [2023-12-28 08:18:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 930807808. Throughput: 0: 9766.7, 1: 10153.8. Samples: 930783244. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:18:41,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.560')] [2023-12-28 08:18:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001815560_464863232.pth... [2023-12-28 08:18:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001814440_464576512.pth [2023-12-28 08:18:41,197][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001819904_465952768.pth... [2023-12-28 08:18:41,201][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001818720_465649664.pth [2023-12-28 08:18:41,592][106226] Updated weights for policy 0, policy_version 1815562 (0.0008) [2023-12-28 08:18:41,663][106226] Updated weights for policy 0, policy_version 1815572 (0.0008) [2023-12-28 08:18:41,720][106226] Updated weights for policy 0, policy_version 1815582 (0.0008) [2023-12-28 08:18:41,785][106226] Updated weights for policy 0, policy_version 1815592 (0.0008) [2023-12-28 08:18:41,895][106225] Updated weights for policy 1, policy_version 1819910 (0.0008) [2023-12-28 08:18:41,957][106225] Updated weights for policy 1, policy_version 1819920 (0.0008) [2023-12-28 08:18:42,013][106225] Updated weights for policy 1, policy_version 1819930 (0.0009) [2023-12-28 08:18:42,544][106226] Updated weights for policy 0, policy_version 1815602 (0.0007) [2023-12-28 08:18:42,606][106226] Updated weights for policy 0, policy_version 1815612 (0.0008) [2023-12-28 08:18:42,655][106226] Updated weights for policy 0, policy_version 1815622 (0.0008) [2023-12-28 08:18:42,774][106225] Updated weights for policy 1, policy_version 1819940 (0.0008) [2023-12-28 08:18:42,839][106225] Updated weights for policy 1, policy_version 1819950 (0.0007) [2023-12-28 08:18:42,906][106225] Updated weights for policy 1, policy_version 1819960 (0.0008) [2023-12-28 08:18:43,354][106226] Updated weights for policy 0, policy_version 1815632 (0.0008) [2023-12-28 08:18:43,405][106226] Updated weights for policy 0, policy_version 1815642 (0.0008) [2023-12-28 08:18:43,456][106226] Updated weights for policy 0, policy_version 1815652 (0.0008) [2023-12-28 08:18:43,640][106225] Updated weights for policy 1, policy_version 1819970 (0.0009) [2023-12-28 08:18:43,689][106225] Updated weights for policy 1, policy_version 1819980 (0.0008) [2023-12-28 08:18:43,737][106225] Updated weights for policy 1, policy_version 1819990 (0.0008) [2023-12-28 08:18:43,789][106225] Updated weights for policy 1, policy_version 1820000 (0.0009) [2023-12-28 08:18:44,143][106226] Updated weights for policy 0, policy_version 1815662 (0.0010) [2023-12-28 08:18:44,204][106226] Updated weights for policy 0, policy_version 1815672 (0.0011) [2023-12-28 08:18:44,258][106226] Updated weights for policy 0, policy_version 1815682 (0.0011) [2023-12-28 08:18:44,564][106225] Updated weights for policy 1, policy_version 1820010 (0.0008) [2023-12-28 08:18:44,612][106225] Updated weights for policy 1, policy_version 1820020 (0.0005) [2023-12-28 08:18:44,669][106225] Updated weights for policy 1, policy_version 1820030 (0.0005) [2023-12-28 08:18:44,995][106226] Updated weights for policy 0, policy_version 1815692 (0.0009) [2023-12-28 08:18:45,062][106226] Updated weights for policy 0, policy_version 1815702 (0.0006) [2023-12-28 08:18:45,131][106226] Updated weights for policy 0, policy_version 1815712 (0.0008) [2023-12-28 08:18:45,387][106225] Updated weights for policy 1, policy_version 1820040 (0.0007) [2023-12-28 08:18:45,450][106225] Updated weights for policy 1, policy_version 1820050 (0.0010) [2023-12-28 08:18:45,513][106225] Updated weights for policy 1, policy_version 1820060 (0.0009) [2023-12-28 08:18:45,715][106226] Updated weights for policy 0, policy_version 1815722 (0.0011) [2023-12-28 08:18:45,778][106226] Updated weights for policy 0, policy_version 1815732 (0.0010) [2023-12-28 08:18:45,836][106226] Updated weights for policy 0, policy_version 1815742 (0.0005) [2023-12-28 08:18:45,905][106226] Updated weights for policy 0, policy_version 1815752 (0.0006) [2023-12-28 08:18:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 930906112. Throughput: 0: 9752.1, 1: 10087.7. Samples: 930897500. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:18:46,176][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.861')] [2023-12-28 08:18:46,296][106225] Updated weights for policy 1, policy_version 1820070 (0.0009) [2023-12-28 08:18:46,342][106225] Updated weights for policy 1, policy_version 1820080 (0.0007) [2023-12-28 08:18:46,399][106225] Updated weights for policy 1, policy_version 1820090 (0.0008) [2023-12-28 08:18:46,555][106226] Updated weights for policy 0, policy_version 1815762 (0.0010) [2023-12-28 08:18:46,605][106226] Updated weights for policy 0, policy_version 1815772 (0.0011) [2023-12-28 08:18:46,655][106226] Updated weights for policy 0, policy_version 1815782 (0.0010) [2023-12-28 08:18:47,116][106225] Updated weights for policy 1, policy_version 1820100 (0.0007) [2023-12-28 08:18:47,177][106225] Updated weights for policy 1, policy_version 1820110 (0.0005) [2023-12-28 08:18:47,244][106225] Updated weights for policy 1, policy_version 1820120 (0.0006) [2023-12-28 08:18:47,378][106226] Updated weights for policy 0, policy_version 1815792 (0.0010) [2023-12-28 08:18:47,437][106226] Updated weights for policy 0, policy_version 1815802 (0.0010) [2023-12-28 08:18:47,500][106226] Updated weights for policy 0, policy_version 1815812 (0.0011) [2023-12-28 08:18:47,863][106225] Updated weights for policy 1, policy_version 1820130 (0.0006) [2023-12-28 08:18:47,923][106225] Updated weights for policy 1, policy_version 1820140 (0.0007) [2023-12-28 08:18:47,975][106225] Updated weights for policy 1, policy_version 1820150 (0.0008) [2023-12-28 08:18:48,038][106225] Updated weights for policy 1, policy_version 1820160 (0.0008) [2023-12-28 08:18:48,222][106226] Updated weights for policy 0, policy_version 1815822 (0.0011) [2023-12-28 08:18:48,287][106226] Updated weights for policy 0, policy_version 1815832 (0.0011) [2023-12-28 08:18:48,356][106226] Updated weights for policy 0, policy_version 1815842 (0.0011) [2023-12-28 08:18:48,751][106225] Updated weights for policy 1, policy_version 1820170 (0.0007) [2023-12-28 08:18:48,802][106225] Updated weights for policy 1, policy_version 1820180 (0.0010) [2023-12-28 08:18:48,866][106225] Updated weights for policy 1, policy_version 1820190 (0.0011) [2023-12-28 08:18:49,065][106226] Updated weights for policy 0, policy_version 1815852 (0.0010) [2023-12-28 08:18:49,117][106226] Updated weights for policy 0, policy_version 1815862 (0.0010) [2023-12-28 08:18:49,171][106226] Updated weights for policy 0, policy_version 1815872 (0.0005) [2023-12-28 08:18:49,598][106225] Updated weights for policy 1, policy_version 1820200 (0.0010) [2023-12-28 08:18:49,659][106225] Updated weights for policy 1, policy_version 1820210 (0.0010) [2023-12-28 08:18:49,716][106225] Updated weights for policy 1, policy_version 1820220 (0.0010) [2023-12-28 08:18:49,889][106226] Updated weights for policy 0, policy_version 1815882 (0.0006) [2023-12-28 08:18:49,953][106226] Updated weights for policy 0, policy_version 1815892 (0.0008) [2023-12-28 08:18:50,010][106226] Updated weights for policy 0, policy_version 1815902 (0.0006) [2023-12-28 08:18:50,064][106226] Updated weights for policy 0, policy_version 1815912 (0.0007) [2023-12-28 08:18:50,428][106225] Updated weights for policy 1, policy_version 1820230 (0.0010) [2023-12-28 08:18:50,489][106225] Updated weights for policy 1, policy_version 1820240 (0.0010) [2023-12-28 08:18:50,553][106225] Updated weights for policy 1, policy_version 1820250 (0.0010) [2023-12-28 08:18:50,794][106226] Updated weights for policy 0, policy_version 1815922 (0.0011) [2023-12-28 08:18:50,855][106226] Updated weights for policy 0, policy_version 1815932 (0.0011) [2023-12-28 08:18:50,909][106226] Updated weights for policy 0, policy_version 1815942 (0.0011) [2023-12-28 08:18:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 931004416. Throughput: 0: 9709.2, 1: 9957.7. Samples: 931014860. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:18:51,175][105115] Avg episode reward: [(0, '-4.621'), (1, '-4.996')] [2023-12-28 08:18:51,248][106225] Updated weights for policy 1, policy_version 1820260 (0.0010) [2023-12-28 08:18:51,313][106225] Updated weights for policy 1, policy_version 1820270 (0.0009) [2023-12-28 08:18:51,380][106225] Updated weights for policy 1, policy_version 1820280 (0.0009) [2023-12-28 08:18:51,675][106226] Updated weights for policy 0, policy_version 1815952 (0.0008) [2023-12-28 08:18:51,758][106226] Updated weights for policy 0, policy_version 1815962 (0.0008) [2023-12-28 08:18:51,832][106226] Updated weights for policy 0, policy_version 1815972 (0.0007) [2023-12-28 08:18:52,175][106225] Updated weights for policy 1, policy_version 1820290 (0.0010) [2023-12-28 08:18:52,231][106225] Updated weights for policy 1, policy_version 1820300 (0.0009) [2023-12-28 08:18:52,291][106225] Updated weights for policy 1, policy_version 1820310 (0.0006) [2023-12-28 08:18:52,351][106225] Updated weights for policy 1, policy_version 1820320 (0.0009) [2023-12-28 08:18:52,577][106226] Updated weights for policy 0, policy_version 1815982 (0.0007) [2023-12-28 08:18:52,635][106226] Updated weights for policy 0, policy_version 1815992 (0.0007) [2023-12-28 08:18:52,689][106226] Updated weights for policy 0, policy_version 1816002 (0.0008) [2023-12-28 08:18:52,990][106225] Updated weights for policy 1, policy_version 1820330 (0.0010) [2023-12-28 08:18:53,043][106225] Updated weights for policy 1, policy_version 1820340 (0.0010) [2023-12-28 08:18:53,105][106225] Updated weights for policy 1, policy_version 1820350 (0.0010) [2023-12-28 08:18:53,415][106226] Updated weights for policy 0, policy_version 1816012 (0.0009) [2023-12-28 08:18:53,473][106226] Updated weights for policy 0, policy_version 1816022 (0.0010) [2023-12-28 08:18:53,531][106226] Updated weights for policy 0, policy_version 1816032 (0.0011) [2023-12-28 08:18:53,818][106225] Updated weights for policy 1, policy_version 1820360 (0.0009) [2023-12-28 08:18:53,865][106225] Updated weights for policy 1, policy_version 1820370 (0.0008) [2023-12-28 08:18:53,927][106225] Updated weights for policy 1, policy_version 1820380 (0.0009) [2023-12-28 08:18:54,133][106226] Updated weights for policy 0, policy_version 1816042 (0.0010) [2023-12-28 08:18:54,194][106226] Updated weights for policy 0, policy_version 1816052 (0.0009) [2023-12-28 08:18:54,254][106226] Updated weights for policy 0, policy_version 1816062 (0.0010) [2023-12-28 08:18:54,314][106226] Updated weights for policy 0, policy_version 1816072 (0.0009) [2023-12-28 08:18:54,689][106225] Updated weights for policy 1, policy_version 1820390 (0.0008) [2023-12-28 08:18:54,752][106225] Updated weights for policy 1, policy_version 1820400 (0.0008) [2023-12-28 08:18:54,809][106225] Updated weights for policy 1, policy_version 1820410 (0.0007) [2023-12-28 08:18:54,962][106226] Updated weights for policy 0, policy_version 1816082 (0.0010) [2023-12-28 08:18:55,028][106226] Updated weights for policy 0, policy_version 1816092 (0.0011) [2023-12-28 08:18:55,091][106226] Updated weights for policy 0, policy_version 1816102 (0.0011) [2023-12-28 08:18:55,404][106225] Updated weights for policy 1, policy_version 1820420 (0.0008) [2023-12-28 08:18:55,457][106225] Updated weights for policy 1, policy_version 1820430 (0.0008) [2023-12-28 08:18:55,517][106225] Updated weights for policy 1, policy_version 1820440 (0.0007) [2023-12-28 08:18:55,735][106226] Updated weights for policy 0, policy_version 1816112 (0.0010) [2023-12-28 08:18:55,801][106226] Updated weights for policy 0, policy_version 1816122 (0.0010) [2023-12-28 08:18:55,864][106226] Updated weights for policy 0, policy_version 1816132 (0.0010) [2023-12-28 08:18:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 931102720. Throughput: 0: 9657.5, 1: 9964.5. Samples: 931073196. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:18:56,175][105115] Avg episode reward: [(0, '-4.005'), (1, '-4.862')] [2023-12-28 08:18:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001820448_466092032.pth... [2023-12-28 08:18:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001816136_465010688.pth... [2023-12-28 08:18:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001815016_464723968.pth [2023-12-28 08:18:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001819296_465797120.pth [2023-12-28 08:18:56,257][106225] Updated weights for policy 1, policy_version 1820450 (0.0007) [2023-12-28 08:18:56,309][106225] Updated weights for policy 1, policy_version 1820460 (0.0008) [2023-12-28 08:18:56,366][106225] Updated weights for policy 1, policy_version 1820470 (0.0008) [2023-12-28 08:18:56,420][106225] Updated weights for policy 1, policy_version 1820480 (0.0007) [2023-12-28 08:18:56,561][106226] Updated weights for policy 0, policy_version 1816142 (0.0008) [2023-12-28 08:18:56,612][106226] Updated weights for policy 0, policy_version 1816152 (0.0005) [2023-12-28 08:18:56,677][106226] Updated weights for policy 0, policy_version 1816162 (0.0006) [2023-12-28 08:18:57,158][106225] Updated weights for policy 1, policy_version 1820490 (0.0007) [2023-12-28 08:18:57,206][106225] Updated weights for policy 1, policy_version 1820500 (0.0008) [2023-12-28 08:18:57,256][106225] Updated weights for policy 1, policy_version 1820510 (0.0008) [2023-12-28 08:18:57,357][106226] Updated weights for policy 0, policy_version 1816172 (0.0011) [2023-12-28 08:18:57,413][106226] Updated weights for policy 0, policy_version 1816182 (0.0010) [2023-12-28 08:18:57,477][106226] Updated weights for policy 0, policy_version 1816192 (0.0010) [2023-12-28 08:18:57,962][106225] Updated weights for policy 1, policy_version 1820520 (0.0006) [2023-12-28 08:18:58,020][106225] Updated weights for policy 1, policy_version 1820530 (0.0005) [2023-12-28 08:18:58,074][106225] Updated weights for policy 1, policy_version 1820540 (0.0006) [2023-12-28 08:18:58,165][106226] Updated weights for policy 0, policy_version 1816202 (0.0010) [2023-12-28 08:18:58,223][106226] Updated weights for policy 0, policy_version 1816212 (0.0008) [2023-12-28 08:18:58,280][106226] Updated weights for policy 0, policy_version 1816222 (0.0010) [2023-12-28 08:18:58,339][106226] Updated weights for policy 0, policy_version 1816232 (0.0010) [2023-12-28 08:18:58,818][106225] Updated weights for policy 1, policy_version 1820550 (0.0007) [2023-12-28 08:18:58,895][106225] Updated weights for policy 1, policy_version 1820560 (0.0008) [2023-12-28 08:18:58,959][106225] Updated weights for policy 1, policy_version 1820570 (0.0008) [2023-12-28 08:18:59,143][106226] Updated weights for policy 0, policy_version 1816242 (0.0009) [2023-12-28 08:18:59,201][106226] Updated weights for policy 0, policy_version 1816252 (0.0008) [2023-12-28 08:18:59,270][106226] Updated weights for policy 0, policy_version 1816262 (0.0008) [2023-12-28 08:18:59,744][106225] Updated weights for policy 1, policy_version 1820580 (0.0009) [2023-12-28 08:18:59,804][106225] Updated weights for policy 1, policy_version 1820590 (0.0009) [2023-12-28 08:18:59,866][106225] Updated weights for policy 1, policy_version 1820600 (0.0008) [2023-12-28 08:18:59,966][106226] Updated weights for policy 0, policy_version 1816272 (0.0008) [2023-12-28 08:19:00,023][106226] Updated weights for policy 0, policy_version 1816282 (0.0010) [2023-12-28 08:19:00,077][106226] Updated weights for policy 0, policy_version 1816292 (0.0010) [2023-12-28 08:19:00,519][106225] Updated weights for policy 1, policy_version 1820610 (0.0006) [2023-12-28 08:19:00,571][106225] Updated weights for policy 1, policy_version 1820620 (0.0008) [2023-12-28 08:19:00,619][106225] Updated weights for policy 1, policy_version 1820630 (0.0008) [2023-12-28 08:19:00,664][106225] Updated weights for policy 1, policy_version 1820640 (0.0007) [2023-12-28 08:19:00,774][106226] Updated weights for policy 0, policy_version 1816302 (0.0009) [2023-12-28 08:19:00,823][106226] Updated weights for policy 0, policy_version 1816312 (0.0010) [2023-12-28 08:19:00,875][106226] Updated weights for policy 0, policy_version 1816322 (0.0010) [2023-12-28 08:19:01,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 931201024. Throughput: 0: 9732.3, 1: 9900.2. Samples: 931189668. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:01,175][105115] Avg episode reward: [(0, '-4.553'), (1, '-4.933')] [2023-12-28 08:19:01,412][106225] Updated weights for policy 1, policy_version 1820650 (0.0007) [2023-12-28 08:19:01,476][106225] Updated weights for policy 1, policy_version 1820660 (0.0007) [2023-12-28 08:19:01,539][106225] Updated weights for policy 1, policy_version 1820670 (0.0008) [2023-12-28 08:19:01,629][106226] Updated weights for policy 0, policy_version 1816332 (0.0010) [2023-12-28 08:19:01,699][106226] Updated weights for policy 0, policy_version 1816342 (0.0009) [2023-12-28 08:19:01,769][106226] Updated weights for policy 0, policy_version 1816352 (0.0010) [2023-12-28 08:19:02,166][106225] Updated weights for policy 1, policy_version 1820680 (0.0010) [2023-12-28 08:19:02,220][106225] Updated weights for policy 1, policy_version 1820690 (0.0010) [2023-12-28 08:19:02,281][106225] Updated weights for policy 1, policy_version 1820700 (0.0010) [2023-12-28 08:19:02,449][106226] Updated weights for policy 0, policy_version 1816362 (0.0009) [2023-12-28 08:19:02,498][106226] Updated weights for policy 0, policy_version 1816372 (0.0005) [2023-12-28 08:19:02,560][106226] Updated weights for policy 0, policy_version 1816382 (0.0006) [2023-12-28 08:19:02,618][106226] Updated weights for policy 0, policy_version 1816392 (0.0008) [2023-12-28 08:19:02,996][106225] Updated weights for policy 1, policy_version 1820710 (0.0010) [2023-12-28 08:19:03,052][106225] Updated weights for policy 1, policy_version 1820720 (0.0010) [2023-12-28 08:19:03,102][106225] Updated weights for policy 1, policy_version 1820730 (0.0010) [2023-12-28 08:19:03,296][106226] Updated weights for policy 0, policy_version 1816402 (0.0005) [2023-12-28 08:19:03,348][106226] Updated weights for policy 0, policy_version 1816412 (0.0005) [2023-12-28 08:19:03,404][106226] Updated weights for policy 0, policy_version 1816422 (0.0006) [2023-12-28 08:19:03,771][106225] Updated weights for policy 1, policy_version 1820740 (0.0009) [2023-12-28 08:19:03,820][106225] Updated weights for policy 1, policy_version 1820750 (0.0010) [2023-12-28 08:19:03,882][106225] Updated weights for policy 1, policy_version 1820760 (0.0009) [2023-12-28 08:19:04,071][106226] Updated weights for policy 0, policy_version 1816432 (0.0010) [2023-12-28 08:19:04,130][106226] Updated weights for policy 0, policy_version 1816442 (0.0011) [2023-12-28 08:19:04,189][106226] Updated weights for policy 0, policy_version 1816452 (0.0011) [2023-12-28 08:19:04,635][106225] Updated weights for policy 1, policy_version 1820770 (0.0007) [2023-12-28 08:19:04,695][106225] Updated weights for policy 1, policy_version 1820780 (0.0010) [2023-12-28 08:19:04,756][106225] Updated weights for policy 1, policy_version 1820790 (0.0010) [2023-12-28 08:19:04,806][106225] Updated weights for policy 1, policy_version 1820800 (0.0010) [2023-12-28 08:19:04,946][106226] Updated weights for policy 0, policy_version 1816462 (0.0010) [2023-12-28 08:19:05,000][106226] Updated weights for policy 0, policy_version 1816472 (0.0010) [2023-12-28 08:19:05,054][106226] Updated weights for policy 0, policy_version 1816482 (0.0011) [2023-12-28 08:19:05,472][106225] Updated weights for policy 1, policy_version 1820810 (0.0005) [2023-12-28 08:19:05,530][106225] Updated weights for policy 1, policy_version 1820820 (0.0009) [2023-12-28 08:19:05,586][106225] Updated weights for policy 1, policy_version 1820830 (0.0010) [2023-12-28 08:19:05,761][106226] Updated weights for policy 0, policy_version 1816492 (0.0011) [2023-12-28 08:19:05,818][106226] Updated weights for policy 0, policy_version 1816502 (0.0007) [2023-12-28 08:19:05,879][106226] Updated weights for policy 0, policy_version 1816512 (0.0005) [2023-12-28 08:19:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 931299328. Throughput: 0: 9784.5, 1: 9963.0. Samples: 931310164. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:06,175][105115] Avg episode reward: [(0, '-4.629'), (1, '-4.709')] [2023-12-28 08:19:06,192][106225] Updated weights for policy 1, policy_version 1820840 (0.0011) [2023-12-28 08:19:06,253][106225] Updated weights for policy 1, policy_version 1820850 (0.0010) [2023-12-28 08:19:06,315][106225] Updated weights for policy 1, policy_version 1820860 (0.0009) [2023-12-28 08:19:06,497][106226] Updated weights for policy 0, policy_version 1816522 (0.0007) [2023-12-28 08:19:06,566][106226] Updated weights for policy 0, policy_version 1816532 (0.0011) [2023-12-28 08:19:06,630][106226] Updated weights for policy 0, policy_version 1816542 (0.0011) [2023-12-28 08:19:06,694][106226] Updated weights for policy 0, policy_version 1816552 (0.0011) [2023-12-28 08:19:06,969][106225] Updated weights for policy 1, policy_version 1820870 (0.0010) [2023-12-28 08:19:07,023][106225] Updated weights for policy 1, policy_version 1820880 (0.0010) [2023-12-28 08:19:07,080][106225] Updated weights for policy 1, policy_version 1820890 (0.0010) [2023-12-28 08:19:07,415][106226] Updated weights for policy 0, policy_version 1816562 (0.0011) [2023-12-28 08:19:07,469][106226] Updated weights for policy 0, policy_version 1816572 (0.0011) [2023-12-28 08:19:07,519][106226] Updated weights for policy 0, policy_version 1816582 (0.0010) [2023-12-28 08:19:07,808][106225] Updated weights for policy 1, policy_version 1820900 (0.0010) [2023-12-28 08:19:07,867][106225] Updated weights for policy 1, policy_version 1820910 (0.0010) [2023-12-28 08:19:07,927][106225] Updated weights for policy 1, policy_version 1820920 (0.0010) [2023-12-28 08:19:08,244][106226] Updated weights for policy 0, policy_version 1816592 (0.0011) [2023-12-28 08:19:08,290][106226] Updated weights for policy 0, policy_version 1816602 (0.0010) [2023-12-28 08:19:08,347][106226] Updated weights for policy 0, policy_version 1816612 (0.0009) [2023-12-28 08:19:08,630][106225] Updated weights for policy 1, policy_version 1820930 (0.0010) [2023-12-28 08:19:08,692][106225] Updated weights for policy 1, policy_version 1820940 (0.0008) [2023-12-28 08:19:08,757][106225] Updated weights for policy 1, policy_version 1820950 (0.0006) [2023-12-28 08:19:08,820][106225] Updated weights for policy 1, policy_version 1820960 (0.0010) [2023-12-28 08:19:09,147][106226] Updated weights for policy 0, policy_version 1816622 (0.0011) [2023-12-28 08:19:09,204][106226] Updated weights for policy 0, policy_version 1816632 (0.0011) [2023-12-28 08:19:09,272][106226] Updated weights for policy 0, policy_version 1816642 (0.0010) [2023-12-28 08:19:09,512][106225] Updated weights for policy 1, policy_version 1820970 (0.0008) [2023-12-28 08:19:09,579][106225] Updated weights for policy 1, policy_version 1820980 (0.0008) [2023-12-28 08:19:09,635][106225] Updated weights for policy 1, policy_version 1820990 (0.0006) [2023-12-28 08:19:10,049][106226] Updated weights for policy 0, policy_version 1816652 (0.0008) [2023-12-28 08:19:10,109][106226] Updated weights for policy 0, policy_version 1816662 (0.0008) [2023-12-28 08:19:10,169][106226] Updated weights for policy 0, policy_version 1816672 (0.0009) [2023-12-28 08:19:10,384][106225] Updated weights for policy 1, policy_version 1821000 (0.0008) [2023-12-28 08:19:10,451][106225] Updated weights for policy 1, policy_version 1821010 (0.0008) [2023-12-28 08:19:10,517][106225] Updated weights for policy 1, policy_version 1821020 (0.0008) [2023-12-28 08:19:10,907][106226] Updated weights for policy 0, policy_version 1816682 (0.0010) [2023-12-28 08:19:10,973][106226] Updated weights for policy 0, policy_version 1816692 (0.0011) [2023-12-28 08:19:11,036][106226] Updated weights for policy 0, policy_version 1816702 (0.0010) [2023-12-28 08:19:11,094][106226] Updated weights for policy 0, policy_version 1816712 (0.0009) [2023-12-28 08:19:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 931397632. Throughput: 0: 9712.1, 1: 10024.3. Samples: 931369156. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:11,175][105115] Avg episode reward: [(0, '-4.608'), (1, '-4.675')] [2023-12-28 08:19:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001816712_465158144.pth... [2023-12-28 08:19:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001821024_466239488.pth... [2023-12-28 08:19:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001815560_464863232.pth [2023-12-28 08:19:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001819904_465952768.pth [2023-12-28 08:19:11,295][106225] Updated weights for policy 1, policy_version 1821030 (0.0008) [2023-12-28 08:19:11,366][106225] Updated weights for policy 1, policy_version 1821040 (0.0008) [2023-12-28 08:19:11,428][106225] Updated weights for policy 1, policy_version 1821050 (0.0008) [2023-12-28 08:19:11,875][106226] Updated weights for policy 0, policy_version 1816722 (0.0008) [2023-12-28 08:19:11,943][106226] Updated weights for policy 0, policy_version 1816732 (0.0008) [2023-12-28 08:19:11,998][106226] Updated weights for policy 0, policy_version 1816742 (0.0008) [2023-12-28 08:19:12,150][106225] Updated weights for policy 1, policy_version 1821060 (0.0009) [2023-12-28 08:19:12,200][106225] Updated weights for policy 1, policy_version 1821070 (0.0008) [2023-12-28 08:19:12,261][106225] Updated weights for policy 1, policy_version 1821080 (0.0008) [2023-12-28 08:19:12,737][106226] Updated weights for policy 0, policy_version 1816752 (0.0010) [2023-12-28 08:19:12,790][106226] Updated weights for policy 0, policy_version 1816762 (0.0009) [2023-12-28 08:19:12,844][106226] Updated weights for policy 0, policy_version 1816772 (0.0010) [2023-12-28 08:19:12,884][106225] Updated weights for policy 1, policy_version 1821090 (0.0007) [2023-12-28 08:19:12,934][106225] Updated weights for policy 1, policy_version 1821100 (0.0005) [2023-12-28 08:19:12,982][106225] Updated weights for policy 1, policy_version 1821110 (0.0007) [2023-12-28 08:19:13,026][106225] Updated weights for policy 1, policy_version 1821120 (0.0008) [2023-12-28 08:19:13,498][106226] Updated weights for policy 0, policy_version 1816782 (0.0009) [2023-12-28 08:19:13,555][106226] Updated weights for policy 0, policy_version 1816792 (0.0009) [2023-12-28 08:19:13,622][106226] Updated weights for policy 0, policy_version 1816802 (0.0005) [2023-12-28 08:19:13,671][106225] Updated weights for policy 1, policy_version 1821130 (0.0009) [2023-12-28 08:19:13,725][106225] Updated weights for policy 1, policy_version 1821140 (0.0009) [2023-12-28 08:19:13,775][106225] Updated weights for policy 1, policy_version 1821150 (0.0009) [2023-12-28 08:19:14,199][106226] Updated weights for policy 0, policy_version 1816812 (0.0007) [2023-12-28 08:19:14,255][106226] Updated weights for policy 0, policy_version 1816822 (0.0010) [2023-12-28 08:19:14,321][106226] Updated weights for policy 0, policy_version 1816832 (0.0011) [2023-12-28 08:19:14,475][106225] Updated weights for policy 1, policy_version 1821160 (0.0006) [2023-12-28 08:19:14,531][106225] Updated weights for policy 1, policy_version 1821170 (0.0005) [2023-12-28 08:19:14,591][106225] Updated weights for policy 1, policy_version 1821180 (0.0006) [2023-12-28 08:19:15,000][106226] Updated weights for policy 0, policy_version 1816842 (0.0011) [2023-12-28 08:19:15,058][106226] Updated weights for policy 0, policy_version 1816852 (0.0009) [2023-12-28 08:19:15,130][106226] Updated weights for policy 0, policy_version 1816862 (0.0007) [2023-12-28 08:19:15,193][106226] Updated weights for policy 0, policy_version 1816872 (0.0007) [2023-12-28 08:19:15,302][106225] Updated weights for policy 1, policy_version 1821190 (0.0007) [2023-12-28 08:19:15,359][106225] Updated weights for policy 1, policy_version 1821200 (0.0008) [2023-12-28 08:19:15,427][106225] Updated weights for policy 1, policy_version 1821210 (0.0007) [2023-12-28 08:19:15,944][106226] Updated weights for policy 0, policy_version 1816882 (0.0011) [2023-12-28 08:19:15,998][106226] Updated weights for policy 0, policy_version 1816892 (0.0005) [2023-12-28 08:19:16,008][106225] Updated weights for policy 1, policy_version 1821221 (0.0009) [2023-12-28 08:19:16,055][106226] Updated weights for policy 0, policy_version 1816902 (0.0010) [2023-12-28 08:19:16,057][106225] Updated weights for policy 1, policy_version 1821231 (0.0007) [2023-12-28 08:19:16,103][106225] Updated weights for policy 1, policy_version 1821241 (0.0008) [2023-12-28 08:19:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 931504128. Throughput: 0: 9696.5, 1: 9874.9. Samples: 931486604. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:16,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.759')] [2023-12-28 08:19:16,703][106225] Updated weights for policy 1, policy_version 1821251 (0.0007) [2023-12-28 08:19:16,762][106225] Updated weights for policy 1, policy_version 1821261 (0.0008) [2023-12-28 08:19:16,779][106226] Updated weights for policy 0, policy_version 1816912 (0.0006) [2023-12-28 08:19:16,823][106225] Updated weights for policy 1, policy_version 1821271 (0.0007) [2023-12-28 08:19:16,844][106226] Updated weights for policy 0, policy_version 1816922 (0.0008) [2023-12-28 08:19:16,895][106226] Updated weights for policy 0, policy_version 1816932 (0.0008) [2023-12-28 08:19:17,520][106225] Updated weights for policy 1, policy_version 1821281 (0.0006) [2023-12-28 08:19:17,568][106225] Updated weights for policy 1, policy_version 1821291 (0.0008) [2023-12-28 08:19:17,601][106226] Updated weights for policy 0, policy_version 1816942 (0.0008) [2023-12-28 08:19:17,623][106225] Updated weights for policy 1, policy_version 1821301 (0.0007) [2023-12-28 08:19:17,660][106226] Updated weights for policy 0, policy_version 1816952 (0.0006) [2023-12-28 08:19:17,675][106225] Updated weights for policy 1, policy_version 1821311 (0.0006) [2023-12-28 08:19:17,727][106226] Updated weights for policy 0, policy_version 1816962 (0.0006) [2023-12-28 08:19:18,369][106225] Updated weights for policy 1, policy_version 1821321 (0.0008) [2023-12-28 08:19:18,428][106225] Updated weights for policy 1, policy_version 1821331 (0.0008) [2023-12-28 08:19:18,447][106226] Updated weights for policy 0, policy_version 1816972 (0.0009) [2023-12-28 08:19:18,487][106225] Updated weights for policy 1, policy_version 1821341 (0.0008) [2023-12-28 08:19:18,506][106226] Updated weights for policy 0, policy_version 1816982 (0.0008) [2023-12-28 08:19:18,564][106226] Updated weights for policy 0, policy_version 1816992 (0.0008) [2023-12-28 08:19:19,273][106225] Updated weights for policy 1, policy_version 1821351 (0.0008) [2023-12-28 08:19:19,307][106226] Updated weights for policy 0, policy_version 1817002 (0.0008) [2023-12-28 08:19:19,334][106225] Updated weights for policy 1, policy_version 1821361 (0.0008) [2023-12-28 08:19:19,372][106226] Updated weights for policy 0, policy_version 1817012 (0.0008) [2023-12-28 08:19:19,411][106225] Updated weights for policy 1, policy_version 1821372 (0.0010) [2023-12-28 08:19:19,427][106226] Updated weights for policy 0, policy_version 1817022 (0.0008) [2023-12-28 08:19:19,495][106226] Updated weights for policy 0, policy_version 1817032 (0.0007) [2023-12-28 08:19:20,164][106225] Updated weights for policy 1, policy_version 1821382 (0.0009) [2023-12-28 08:19:20,222][106225] Updated weights for policy 1, policy_version 1821392 (0.0010) [2023-12-28 08:19:20,285][106225] Updated weights for policy 1, policy_version 1821402 (0.0011) [2023-12-28 08:19:20,288][106226] Updated weights for policy 0, policy_version 1817042 (0.0008) [2023-12-28 08:19:20,347][106226] Updated weights for policy 0, policy_version 1817052 (0.0008) [2023-12-28 08:19:20,413][106226] Updated weights for policy 0, policy_version 1817062 (0.0008) [2023-12-28 08:19:20,996][106225] Updated weights for policy 1, policy_version 1821412 (0.0010) [2023-12-28 08:19:21,060][106225] Updated weights for policy 1, policy_version 1821422 (0.0008) [2023-12-28 08:19:21,118][106225] Updated weights for policy 1, policy_version 1821432 (0.0008) [2023-12-28 08:19:21,132][106226] Updated weights for policy 0, policy_version 1817072 (0.0009) [2023-12-28 08:19:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 931594240. Throughput: 0: 9644.1, 1: 9845.9. Samples: 931603028. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:21,175][105115] Avg episode reward: [(0, '-4.314'), (1, '-4.840')] [2023-12-28 08:19:21,193][106226] Updated weights for policy 0, policy_version 1817082 (0.0008) [2023-12-28 08:19:21,254][106226] Updated weights for policy 0, policy_version 1817092 (0.0009) [2023-12-28 08:19:21,961][106225] Updated weights for policy 1, policy_version 1821442 (0.0010) [2023-12-28 08:19:22,013][106225] Updated weights for policy 1, policy_version 1821452 (0.0010) [2023-12-28 08:19:22,070][106226] Updated weights for policy 0, policy_version 1817102 (0.0007) [2023-12-28 08:19:22,071][106225] Updated weights for policy 1, policy_version 1821462 (0.0010) [2023-12-28 08:19:22,132][106225] Updated weights for policy 1, policy_version 1821472 (0.0010) [2023-12-28 08:19:22,134][106226] Updated weights for policy 0, policy_version 1817112 (0.0006) [2023-12-28 08:19:22,192][106226] Updated weights for policy 0, policy_version 1817122 (0.0008) [2023-12-28 08:19:22,886][106225] Updated weights for policy 1, policy_version 1821482 (0.0006) [2023-12-28 08:19:22,946][106225] Updated weights for policy 1, policy_version 1821492 (0.0011) [2023-12-28 08:19:22,971][106226] Updated weights for policy 0, policy_version 1817132 (0.0009) [2023-12-28 08:19:23,008][106225] Updated weights for policy 1, policy_version 1821502 (0.0010) [2023-12-28 08:19:23,034][106226] Updated weights for policy 0, policy_version 1817142 (0.0007) [2023-12-28 08:19:23,094][106226] Updated weights for policy 0, policy_version 1817152 (0.0006) [2023-12-28 08:19:23,647][106225] Updated weights for policy 1, policy_version 1821512 (0.0007) [2023-12-28 08:19:23,695][106225] Updated weights for policy 1, policy_version 1821522 (0.0008) [2023-12-28 08:19:23,742][106225] Updated weights for policy 1, policy_version 1821532 (0.0005) [2023-12-28 08:19:23,792][106226] Updated weights for policy 0, policy_version 1817162 (0.0006) [2023-12-28 08:19:23,844][106226] Updated weights for policy 0, policy_version 1817172 (0.0006) [2023-12-28 08:19:23,905][106226] Updated weights for policy 0, policy_version 1817182 (0.0005) [2023-12-28 08:19:23,955][106226] Updated weights for policy 0, policy_version 1817192 (0.0005) [2023-12-28 08:19:24,347][106225] Updated weights for policy 1, policy_version 1821542 (0.0005) [2023-12-28 08:19:24,408][106225] Updated weights for policy 1, policy_version 1821552 (0.0007) [2023-12-28 08:19:24,459][106225] Updated weights for policy 1, policy_version 1821562 (0.0008) [2023-12-28 08:19:24,559][106226] Updated weights for policy 0, policy_version 1817202 (0.0009) [2023-12-28 08:19:24,623][106226] Updated weights for policy 0, policy_version 1817212 (0.0011) [2023-12-28 08:19:24,683][106226] Updated weights for policy 0, policy_version 1817222 (0.0008) [2023-12-28 08:19:25,071][106225] Updated weights for policy 1, policy_version 1821572 (0.0007) [2023-12-28 08:19:25,121][106225] Updated weights for policy 1, policy_version 1821582 (0.0005) [2023-12-28 08:19:25,174][106225] Updated weights for policy 1, policy_version 1821592 (0.0005) [2023-12-28 08:19:25,292][106226] Updated weights for policy 0, policy_version 1817232 (0.0005) [2023-12-28 08:19:25,356][106226] Updated weights for policy 0, policy_version 1817242 (0.0007) [2023-12-28 08:19:25,408][106226] Updated weights for policy 0, policy_version 1817252 (0.0007) [2023-12-28 08:19:25,875][106225] Updated weights for policy 1, policy_version 1821602 (0.0009) [2023-12-28 08:19:25,934][106225] Updated weights for policy 1, policy_version 1821612 (0.0010) [2023-12-28 08:19:25,990][106225] Updated weights for policy 1, policy_version 1821622 (0.0010) [2023-12-28 08:19:26,052][106225] Updated weights for policy 1, policy_version 1821632 (0.0010) [2023-12-28 08:19:26,056][106226] Updated weights for policy 0, policy_version 1817262 (0.0006) [2023-12-28 08:19:26,104][106226] Updated weights for policy 0, policy_version 1817272 (0.0005) [2023-12-28 08:19:26,156][106226] Updated weights for policy 0, policy_version 1817282 (0.0005) [2023-12-28 08:19:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 931692544. Throughput: 0: 9651.9, 1: 9811.3. Samples: 931659088. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:26,175][105115] Avg episode reward: [(0, '-4.618'), (1, '-4.830')] [2023-12-28 08:19:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001821632_466395136.pth... [2023-12-28 08:19:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001820448_466092032.pth [2023-12-28 08:19:26,192][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001817288_465305600.pth... [2023-12-28 08:19:26,195][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001816136_465010688.pth [2023-12-28 08:19:26,727][106226] Updated weights for policy 0, policy_version 1817292 (0.0007) [2023-12-28 08:19:26,735][106225] Updated weights for policy 1, policy_version 1821642 (0.0010) [2023-12-28 08:19:26,786][106226] Updated weights for policy 0, policy_version 1817302 (0.0010) [2023-12-28 08:19:26,793][106225] Updated weights for policy 1, policy_version 1821652 (0.0010) [2023-12-28 08:19:26,839][106226] Updated weights for policy 0, policy_version 1817312 (0.0010) [2023-12-28 08:19:26,843][106225] Updated weights for policy 1, policy_version 1821662 (0.0010) [2023-12-28 08:19:27,556][106225] Updated weights for policy 1, policy_version 1821672 (0.0010) [2023-12-28 08:19:27,565][106226] Updated weights for policy 0, policy_version 1817322 (0.0011) [2023-12-28 08:19:27,619][106225] Updated weights for policy 1, policy_version 1821682 (0.0010) [2023-12-28 08:19:27,625][106226] Updated weights for policy 0, policy_version 1817332 (0.0008) [2023-12-28 08:19:27,674][106225] Updated weights for policy 1, policy_version 1821692 (0.0011) [2023-12-28 08:19:27,685][106226] Updated weights for policy 0, policy_version 1817342 (0.0006) [2023-12-28 08:19:27,745][106226] Updated weights for policy 0, policy_version 1817352 (0.0009) [2023-12-28 08:19:28,379][106225] Updated weights for policy 1, policy_version 1821702 (0.0010) [2023-12-28 08:19:28,422][106226] Updated weights for policy 0, policy_version 1817362 (0.0011) [2023-12-28 08:19:28,444][106225] Updated weights for policy 1, policy_version 1821712 (0.0010) [2023-12-28 08:19:28,483][106226] Updated weights for policy 0, policy_version 1817372 (0.0011) [2023-12-28 08:19:28,502][106225] Updated weights for policy 1, policy_version 1821722 (0.0010) [2023-12-28 08:19:28,543][106226] Updated weights for policy 0, policy_version 1817382 (0.0011) [2023-12-28 08:19:29,241][106225] Updated weights for policy 1, policy_version 1821732 (0.0009) [2023-12-28 08:19:29,262][106226] Updated weights for policy 0, policy_version 1817392 (0.0011) [2023-12-28 08:19:29,303][106225] Updated weights for policy 1, policy_version 1821742 (0.0008) [2023-12-28 08:19:29,324][106226] Updated weights for policy 0, policy_version 1817402 (0.0011) [2023-12-28 08:19:29,363][106225] Updated weights for policy 1, policy_version 1821752 (0.0008) [2023-12-28 08:19:29,389][106226] Updated weights for policy 0, policy_version 1817412 (0.0011) [2023-12-28 08:19:30,102][106226] Updated weights for policy 0, policy_version 1817422 (0.0009) [2023-12-28 08:19:30,143][106225] Updated weights for policy 1, policy_version 1821762 (0.0008) [2023-12-28 08:19:30,161][106226] Updated weights for policy 0, policy_version 1817432 (0.0008) [2023-12-28 08:19:30,206][106225] Updated weights for policy 1, policy_version 1821772 (0.0010) [2023-12-28 08:19:30,216][106226] Updated weights for policy 0, policy_version 1817442 (0.0008) [2023-12-28 08:19:30,259][106225] Updated weights for policy 1, policy_version 1821782 (0.0010) [2023-12-28 08:19:30,312][106225] Updated weights for policy 1, policy_version 1821792 (0.0010) [2023-12-28 08:19:30,912][106226] Updated weights for policy 0, policy_version 1817452 (0.0008) [2023-12-28 08:19:30,960][106226] Updated weights for policy 0, policy_version 1817462 (0.0005) [2023-12-28 08:19:31,014][106226] Updated weights for policy 0, policy_version 1817472 (0.0005) [2023-12-28 08:19:31,028][106225] Updated weights for policy 1, policy_version 1821802 (0.0010) [2023-12-28 08:19:31,089][106225] Updated weights for policy 1, policy_version 1821812 (0.0011) [2023-12-28 08:19:31,154][106225] Updated weights for policy 1, policy_version 1821822 (0.0009) [2023-12-28 08:19:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 931799040. Throughput: 0: 9795.8, 1: 9869.2. Samples: 931782424. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:31,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-5.179')] [2023-12-28 08:19:31,735][106226] Updated weights for policy 0, policy_version 1817482 (0.0007) [2023-12-28 08:19:31,800][106226] Updated weights for policy 0, policy_version 1817492 (0.0008) [2023-12-28 08:19:31,862][106226] Updated weights for policy 0, policy_version 1817502 (0.0008) [2023-12-28 08:19:31,896][106225] Updated weights for policy 1, policy_version 1821832 (0.0006) [2023-12-28 08:19:31,920][106226] Updated weights for policy 0, policy_version 1817512 (0.0007) [2023-12-28 08:19:31,960][106225] Updated weights for policy 1, policy_version 1821842 (0.0010) [2023-12-28 08:19:32,010][106225] Updated weights for policy 1, policy_version 1821852 (0.0008) [2023-12-28 08:19:32,610][106226] Updated weights for policy 0, policy_version 1817522 (0.0008) [2023-12-28 08:19:32,662][106225] Updated weights for policy 1, policy_version 1821862 (0.0005) [2023-12-28 08:19:32,672][106226] Updated weights for policy 0, policy_version 1817532 (0.0007) [2023-12-28 08:19:32,720][106225] Updated weights for policy 1, policy_version 1821872 (0.0006) [2023-12-28 08:19:32,726][106226] Updated weights for policy 0, policy_version 1817542 (0.0008) [2023-12-28 08:19:32,782][106225] Updated weights for policy 1, policy_version 1821882 (0.0006) [2023-12-28 08:19:33,383][106225] Updated weights for policy 1, policy_version 1821892 (0.0007) [2023-12-28 08:19:33,431][106225] Updated weights for policy 1, policy_version 1821902 (0.0005) [2023-12-28 08:19:33,484][106225] Updated weights for policy 1, policy_version 1821912 (0.0005) [2023-12-28 08:19:33,522][106226] Updated weights for policy 0, policy_version 1817552 (0.0007) [2023-12-28 08:19:33,570][106226] Updated weights for policy 0, policy_version 1817562 (0.0008) [2023-12-28 08:19:33,622][106226] Updated weights for policy 0, policy_version 1817572 (0.0008) [2023-12-28 08:19:34,138][106225] Updated weights for policy 1, policy_version 1821922 (0.0005) [2023-12-28 08:19:34,207][106225] Updated weights for policy 1, policy_version 1821932 (0.0006) [2023-12-28 08:19:34,279][106225] Updated weights for policy 1, policy_version 1821942 (0.0006) [2023-12-28 08:19:34,343][106225] Updated weights for policy 1, policy_version 1821952 (0.0007) [2023-12-28 08:19:34,348][106226] Updated weights for policy 0, policy_version 1817582 (0.0007) [2023-12-28 08:19:34,402][106226] Updated weights for policy 0, policy_version 1817592 (0.0006) [2023-12-28 08:19:34,467][106226] Updated weights for policy 0, policy_version 1817602 (0.0006) [2023-12-28 08:19:35,109][106226] Updated weights for policy 0, policy_version 1817612 (0.0006) [2023-12-28 08:19:35,143][106225] Updated weights for policy 1, policy_version 1821962 (0.0008) [2023-12-28 08:19:35,169][106226] Updated weights for policy 0, policy_version 1817622 (0.0007) [2023-12-28 08:19:35,191][106225] Updated weights for policy 1, policy_version 1821972 (0.0006) [2023-12-28 08:19:35,219][106226] Updated weights for policy 0, policy_version 1817632 (0.0008) [2023-12-28 08:19:35,242][106225] Updated weights for policy 1, policy_version 1821982 (0.0007) [2023-12-28 08:19:35,919][106226] Updated weights for policy 0, policy_version 1817642 (0.0008) [2023-12-28 08:19:35,976][106226] Updated weights for policy 0, policy_version 1817652 (0.0008) [2023-12-28 08:19:35,994][106225] Updated weights for policy 1, policy_version 1821992 (0.0006) [2023-12-28 08:19:36,031][106226] Updated weights for policy 0, policy_version 1817662 (0.0008) [2023-12-28 08:19:36,050][106225] Updated weights for policy 1, policy_version 1822002 (0.0006) [2023-12-28 08:19:36,079][106226] Updated weights for policy 0, policy_version 1817672 (0.0006) [2023-12-28 08:19:36,102][106225] Updated weights for policy 1, policy_version 1822012 (0.0006) [2023-12-28 08:19:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 931897344. Throughput: 0: 9782.5, 1: 9897.2. Samples: 931900448. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:36,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.818')] [2023-12-28 08:19:36,797][106226] Updated weights for policy 0, policy_version 1817682 (0.0008) [2023-12-28 08:19:36,847][106226] Updated weights for policy 0, policy_version 1817692 (0.0007) [2023-12-28 08:19:36,864][106225] Updated weights for policy 1, policy_version 1822022 (0.0009) [2023-12-28 08:19:36,899][106226] Updated weights for policy 0, policy_version 1817702 (0.0008) [2023-12-28 08:19:36,924][106225] Updated weights for policy 1, policy_version 1822032 (0.0007) [2023-12-28 08:19:36,982][106225] Updated weights for policy 1, policy_version 1822042 (0.0008) [2023-12-28 08:19:37,542][106226] Updated weights for policy 0, policy_version 1817712 (0.0008) [2023-12-28 08:19:37,588][106226] Updated weights for policy 0, policy_version 1817722 (0.0008) [2023-12-28 08:19:37,636][106226] Updated weights for policy 0, policy_version 1817732 (0.0007) [2023-12-28 08:19:37,702][106225] Updated weights for policy 1, policy_version 1822052 (0.0006) [2023-12-28 08:19:37,757][106225] Updated weights for policy 1, policy_version 1822062 (0.0007) [2023-12-28 08:19:37,809][106225] Updated weights for policy 1, policy_version 1822072 (0.0010) [2023-12-28 08:19:38,357][106226] Updated weights for policy 0, policy_version 1817742 (0.0007) [2023-12-28 08:19:38,416][106226] Updated weights for policy 0, policy_version 1817752 (0.0008) [2023-12-28 08:19:38,471][106226] Updated weights for policy 0, policy_version 1817762 (0.0008) [2023-12-28 08:19:38,538][106225] Updated weights for policy 1, policy_version 1822082 (0.0010) [2023-12-28 08:19:38,599][106225] Updated weights for policy 1, policy_version 1822092 (0.0009) [2023-12-28 08:19:38,648][106225] Updated weights for policy 1, policy_version 1822102 (0.0008) [2023-12-28 08:19:38,705][106225] Updated weights for policy 1, policy_version 1822112 (0.0009) [2023-12-28 08:19:39,215][106226] Updated weights for policy 0, policy_version 1817772 (0.0009) [2023-12-28 08:19:39,279][106226] Updated weights for policy 0, policy_version 1817782 (0.0007) [2023-12-28 08:19:39,343][106226] Updated weights for policy 0, policy_version 1817792 (0.0008) [2023-12-28 08:19:39,461][106225] Updated weights for policy 1, policy_version 1822122 (0.0008) [2023-12-28 08:19:39,528][106225] Updated weights for policy 1, policy_version 1822132 (0.0008) [2023-12-28 08:19:39,591][106225] Updated weights for policy 1, policy_version 1822142 (0.0008) [2023-12-28 08:19:40,162][106226] Updated weights for policy 0, policy_version 1817802 (0.0009) [2023-12-28 08:19:40,222][106226] Updated weights for policy 0, policy_version 1817812 (0.0010) [2023-12-28 08:19:40,282][106226] Updated weights for policy 0, policy_version 1817822 (0.0006) [2023-12-28 08:19:40,330][106225] Updated weights for policy 1, policy_version 1822152 (0.0008) [2023-12-28 08:19:40,332][106226] Updated weights for policy 0, policy_version 1817832 (0.0006) [2023-12-28 08:19:40,391][106225] Updated weights for policy 1, policy_version 1822162 (0.0008) [2023-12-28 08:19:40,467][106225] Updated weights for policy 1, policy_version 1822172 (0.0009) [2023-12-28 08:19:40,919][106226] Updated weights for policy 0, policy_version 1817842 (0.0005) [2023-12-28 08:19:40,980][106226] Updated weights for policy 0, policy_version 1817852 (0.0006) [2023-12-28 08:19:41,034][106226] Updated weights for policy 0, policy_version 1817862 (0.0007) [2023-12-28 08:19:41,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 931987456. Throughput: 0: 9804.5, 1: 9878.5. Samples: 931958928. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:41,175][105115] Avg episode reward: [(0, '-4.139'), (1, '-4.863')] [2023-12-28 08:19:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001822176_466534400.pth... [2023-12-28 08:19:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001817864_465453056.pth... [2023-12-28 08:19:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001821024_466239488.pth [2023-12-28 08:19:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001816712_465158144.pth [2023-12-28 08:19:41,320][106225] Updated weights for policy 1, policy_version 1822182 (0.0009) [2023-12-28 08:19:41,393][106225] Updated weights for policy 1, policy_version 1822192 (0.0008) [2023-12-28 08:19:41,457][106225] Updated weights for policy 1, policy_version 1822202 (0.0006) [2023-12-28 08:19:41,771][106226] Updated weights for policy 0, policy_version 1817872 (0.0009) [2023-12-28 08:19:41,835][106226] Updated weights for policy 0, policy_version 1817882 (0.0008) [2023-12-28 08:19:41,897][106226] Updated weights for policy 0, policy_version 1817892 (0.0008) [2023-12-28 08:19:42,215][106225] Updated weights for policy 1, policy_version 1822212 (0.0008) [2023-12-28 08:19:42,290][106225] Updated weights for policy 1, policy_version 1822222 (0.0007) [2023-12-28 08:19:42,358][106225] Updated weights for policy 1, policy_version 1822232 (0.0009) [2023-12-28 08:19:42,617][106226] Updated weights for policy 0, policy_version 1817902 (0.0007) [2023-12-28 08:19:42,684][106226] Updated weights for policy 0, policy_version 1817912 (0.0008) [2023-12-28 08:19:42,750][106226] Updated weights for policy 0, policy_version 1817922 (0.0011) [2023-12-28 08:19:43,093][106225] Updated weights for policy 1, policy_version 1822242 (0.0006) [2023-12-28 08:19:43,143][106225] Updated weights for policy 1, policy_version 1822252 (0.0005) [2023-12-28 08:19:43,194][106225] Updated weights for policy 1, policy_version 1822262 (0.0007) [2023-12-28 08:19:43,252][106225] Updated weights for policy 1, policy_version 1822272 (0.0010) [2023-12-28 08:19:43,362][106226] Updated weights for policy 0, policy_version 1817932 (0.0009) [2023-12-28 08:19:43,410][106226] Updated weights for policy 0, policy_version 1817942 (0.0005) [2023-12-28 08:19:43,467][106226] Updated weights for policy 0, policy_version 1817952 (0.0005) [2023-12-28 08:19:43,875][106225] Updated weights for policy 1, policy_version 1822282 (0.0008) [2023-12-28 08:19:43,936][106225] Updated weights for policy 1, policy_version 1822292 (0.0010) [2023-12-28 08:19:43,990][106226] Updated weights for policy 0, policy_version 1817962 (0.0005) [2023-12-28 08:19:43,998][106225] Updated weights for policy 1, policy_version 1822302 (0.0006) [2023-12-28 08:19:44,049][106226] Updated weights for policy 0, policy_version 1817972 (0.0006) [2023-12-28 08:19:44,105][106226] Updated weights for policy 0, policy_version 1817982 (0.0009) [2023-12-28 08:19:44,155][106226] Updated weights for policy 0, policy_version 1817992 (0.0010) [2023-12-28 08:19:44,602][106225] Updated weights for policy 1, policy_version 1822312 (0.0009) [2023-12-28 08:19:44,656][106225] Updated weights for policy 1, policy_version 1822322 (0.0010) [2023-12-28 08:19:44,726][106225] Updated weights for policy 1, policy_version 1822332 (0.0010) [2023-12-28 08:19:44,798][106226] Updated weights for policy 0, policy_version 1818002 (0.0009) [2023-12-28 08:19:44,857][106226] Updated weights for policy 0, policy_version 1818012 (0.0007) [2023-12-28 08:19:44,924][106226] Updated weights for policy 0, policy_version 1818022 (0.0007) [2023-12-28 08:19:45,461][106225] Updated weights for policy 1, policy_version 1822342 (0.0011) [2023-12-28 08:19:45,519][106225] Updated weights for policy 1, policy_version 1822352 (0.0010) [2023-12-28 08:19:45,534][106226] Updated weights for policy 0, policy_version 1818032 (0.0006) [2023-12-28 08:19:45,578][106225] Updated weights for policy 1, policy_version 1822362 (0.0010) [2023-12-28 08:19:45,599][106226] Updated weights for policy 0, policy_version 1818042 (0.0006) [2023-12-28 08:19:45,659][106226] Updated weights for policy 0, policy_version 1818052 (0.0008) [2023-12-28 08:19:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.9, 300 sec: 19633.0). Total num frames: 932085760. Throughput: 0: 9875.8, 1: 9872.4. Samples: 932078340. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:46,175][105115] Avg episode reward: [(0, '-4.311'), (1, '-4.996')] [2023-12-28 08:19:46,299][106225] Updated weights for policy 1, policy_version 1822372 (0.0010) [2023-12-28 08:19:46,358][106225] Updated weights for policy 1, policy_version 1822382 (0.0010) [2023-12-28 08:19:46,379][106226] Updated weights for policy 0, policy_version 1818062 (0.0006) [2023-12-28 08:19:46,411][106225] Updated weights for policy 1, policy_version 1822392 (0.0010) [2023-12-28 08:19:46,435][106226] Updated weights for policy 0, policy_version 1818072 (0.0006) [2023-12-28 08:19:46,491][106226] Updated weights for policy 0, policy_version 1818082 (0.0006) [2023-12-28 08:19:47,129][106225] Updated weights for policy 1, policy_version 1822402 (0.0011) [2023-12-28 08:19:47,171][106226] Updated weights for policy 0, policy_version 1818092 (0.0008) [2023-12-28 08:19:47,179][106225] Updated weights for policy 1, policy_version 1822412 (0.0010) [2023-12-28 08:19:47,227][106226] Updated weights for policy 0, policy_version 1818102 (0.0010) [2023-12-28 08:19:47,232][106225] Updated weights for policy 1, policy_version 1822422 (0.0010) [2023-12-28 08:19:47,280][106226] Updated weights for policy 0, policy_version 1818112 (0.0010) [2023-12-28 08:19:47,281][106225] Updated weights for policy 1, policy_version 1822432 (0.0010) [2023-12-28 08:19:47,933][106225] Updated weights for policy 1, policy_version 1822442 (0.0010) [2023-12-28 08:19:47,971][106226] Updated weights for policy 0, policy_version 1818122 (0.0010) [2023-12-28 08:19:47,983][106225] Updated weights for policy 1, policy_version 1822452 (0.0009) [2023-12-28 08:19:48,031][106226] Updated weights for policy 0, policy_version 1818132 (0.0007) [2023-12-28 08:19:48,035][106225] Updated weights for policy 1, policy_version 1822462 (0.0006) [2023-12-28 08:19:48,095][106226] Updated weights for policy 0, policy_version 1818142 (0.0010) [2023-12-28 08:19:48,156][106226] Updated weights for policy 0, policy_version 1818152 (0.0011) [2023-12-28 08:19:48,695][106225] Updated weights for policy 1, policy_version 1822472 (0.0005) [2023-12-28 08:19:48,760][106225] Updated weights for policy 1, policy_version 1822482 (0.0006) [2023-12-28 08:19:48,822][106225] Updated weights for policy 1, policy_version 1822492 (0.0005) [2023-12-28 08:19:48,825][106226] Updated weights for policy 0, policy_version 1818162 (0.0008) [2023-12-28 08:19:48,882][106226] Updated weights for policy 0, policy_version 1818172 (0.0011) [2023-12-28 08:19:48,942][106226] Updated weights for policy 0, policy_version 1818182 (0.0011) [2023-12-28 08:19:49,509][106225] Updated weights for policy 1, policy_version 1822502 (0.0008) [2023-12-28 08:19:49,574][106225] Updated weights for policy 1, policy_version 1822512 (0.0010) [2023-12-28 08:19:49,639][106225] Updated weights for policy 1, policy_version 1822522 (0.0010) [2023-12-28 08:19:49,703][106226] Updated weights for policy 0, policy_version 1818192 (0.0008) [2023-12-28 08:19:49,771][106226] Updated weights for policy 0, policy_version 1818202 (0.0008) [2023-12-28 08:19:49,834][106226] Updated weights for policy 0, policy_version 1818212 (0.0009) [2023-12-28 08:19:50,330][106225] Updated weights for policy 1, policy_version 1822532 (0.0009) [2023-12-28 08:19:50,400][106225] Updated weights for policy 1, policy_version 1822542 (0.0006) [2023-12-28 08:19:50,450][106225] Updated weights for policy 1, policy_version 1822552 (0.0010) [2023-12-28 08:19:50,602][106226] Updated weights for policy 0, policy_version 1818222 (0.0007) [2023-12-28 08:19:50,651][106226] Updated weights for policy 0, policy_version 1818232 (0.0006) [2023-12-28 08:19:50,700][106226] Updated weights for policy 0, policy_version 1818242 (0.0008) [2023-12-28 08:19:51,163][106225] Updated weights for policy 1, policy_version 1822562 (0.0006) [2023-12-28 08:19:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 932184064. Throughput: 0: 9854.2, 1: 9852.9. Samples: 932196984. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:51,175][105115] Avg episode reward: [(0, '-4.336'), (1, '-4.611')] [2023-12-28 08:19:51,217][106225] Updated weights for policy 1, policy_version 1822572 (0.0010) [2023-12-28 08:19:51,283][106225] Updated weights for policy 1, policy_version 1822582 (0.0010) [2023-12-28 08:19:51,351][106225] Updated weights for policy 1, policy_version 1822592 (0.0010) [2023-12-28 08:19:51,415][106226] Updated weights for policy 0, policy_version 1818252 (0.0006) [2023-12-28 08:19:51,481][106226] Updated weights for policy 0, policy_version 1818262 (0.0006) [2023-12-28 08:19:51,531][106226] Updated weights for policy 0, policy_version 1818272 (0.0005) [2023-12-28 08:19:52,041][106225] Updated weights for policy 1, policy_version 1822602 (0.0011) [2023-12-28 08:19:52,105][106225] Updated weights for policy 1, policy_version 1822612 (0.0010) [2023-12-28 08:19:52,141][106226] Updated weights for policy 0, policy_version 1818282 (0.0005) [2023-12-28 08:19:52,177][106225] Updated weights for policy 1, policy_version 1822622 (0.0010) [2023-12-28 08:19:52,206][106226] Updated weights for policy 0, policy_version 1818292 (0.0005) [2023-12-28 08:19:52,271][106226] Updated weights for policy 0, policy_version 1818302 (0.0007) [2023-12-28 08:19:52,335][106226] Updated weights for policy 0, policy_version 1818312 (0.0008) [2023-12-28 08:19:52,867][106225] Updated weights for policy 1, policy_version 1822632 (0.0010) [2023-12-28 08:19:52,928][106225] Updated weights for policy 1, policy_version 1822642 (0.0010) [2023-12-28 08:19:52,982][106226] Updated weights for policy 0, policy_version 1818322 (0.0007) [2023-12-28 08:19:52,984][106225] Updated weights for policy 1, policy_version 1822652 (0.0008) [2023-12-28 08:19:53,037][106226] Updated weights for policy 0, policy_version 1818332 (0.0007) [2023-12-28 08:19:53,081][106226] Updated weights for policy 0, policy_version 1818342 (0.0007) [2023-12-28 08:19:53,662][106225] Updated weights for policy 1, policy_version 1822662 (0.0009) [2023-12-28 08:19:53,718][106225] Updated weights for policy 1, policy_version 1822672 (0.0010) [2023-12-28 08:19:53,766][106225] Updated weights for policy 1, policy_version 1822682 (0.0009) [2023-12-28 08:19:53,849][106226] Updated weights for policy 0, policy_version 1818352 (0.0008) [2023-12-28 08:19:53,896][106226] Updated weights for policy 0, policy_version 1818362 (0.0009) [2023-12-28 08:19:53,957][106226] Updated weights for policy 0, policy_version 1818372 (0.0009) [2023-12-28 08:19:54,467][106225] Updated weights for policy 1, policy_version 1822692 (0.0007) [2023-12-28 08:19:54,526][106225] Updated weights for policy 1, policy_version 1822702 (0.0009) [2023-12-28 08:19:54,589][106225] Updated weights for policy 1, policy_version 1822712 (0.0008) [2023-12-28 08:19:54,638][106226] Updated weights for policy 0, policy_version 1818382 (0.0009) [2023-12-28 08:19:54,694][106226] Updated weights for policy 0, policy_version 1818392 (0.0009) [2023-12-28 08:19:54,754][106226] Updated weights for policy 0, policy_version 1818402 (0.0009) [2023-12-28 08:19:55,164][106225] Updated weights for policy 1, policy_version 1822722 (0.0007) [2023-12-28 08:19:55,229][106225] Updated weights for policy 1, policy_version 1822732 (0.0005) [2023-12-28 08:19:55,291][106225] Updated weights for policy 1, policy_version 1822742 (0.0006) [2023-12-28 08:19:55,352][106225] Updated weights for policy 1, policy_version 1822752 (0.0009) [2023-12-28 08:19:55,518][106226] Updated weights for policy 0, policy_version 1818412 (0.0007) [2023-12-28 08:19:55,564][106226] Updated weights for policy 0, policy_version 1818422 (0.0005) [2023-12-28 08:19:55,612][106226] Updated weights for policy 0, policy_version 1818432 (0.0005) [2023-12-28 08:19:55,965][106225] Updated weights for policy 1, policy_version 1822762 (0.0010) [2023-12-28 08:19:56,030][106225] Updated weights for policy 1, policy_version 1822772 (0.0011) [2023-12-28 08:19:56,083][106225] Updated weights for policy 1, policy_version 1822782 (0.0010) [2023-12-28 08:19:56,164][106226] Updated weights for policy 0, policy_version 1818442 (0.0006) [2023-12-28 08:19:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 932290560. Throughput: 0: 9876.0, 1: 9836.4. Samples: 932256208. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:19:56,175][105115] Avg episode reward: [(0, '-4.395'), (1, '-4.904')] [2023-12-28 08:19:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001822784_466690048.pth... [2023-12-28 08:19:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001821632_466395136.pth [2023-12-28 08:19:56,221][106226] Updated weights for policy 0, policy_version 1818452 (0.0008) [2023-12-28 08:19:56,270][106226] Updated weights for policy 0, policy_version 1818462 (0.0008) [2023-12-28 08:19:56,327][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001818472_465608704.pth... [2023-12-28 08:19:56,330][106226] Updated weights for policy 0, policy_version 1818472 (0.0008) [2023-12-28 08:19:56,330][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001817288_465305600.pth [2023-12-28 08:19:56,778][106225] Updated weights for policy 1, policy_version 1822792 (0.0007) [2023-12-28 08:19:56,843][106225] Updated weights for policy 1, policy_version 1822802 (0.0010) [2023-12-28 08:19:56,889][106225] Updated weights for policy 1, policy_version 1822812 (0.0010) [2023-12-28 08:19:57,030][106226] Updated weights for policy 0, policy_version 1818482 (0.0009) [2023-12-28 08:19:57,095][106226] Updated weights for policy 0, policy_version 1818492 (0.0005) [2023-12-28 08:19:57,160][106226] Updated weights for policy 0, policy_version 1818502 (0.0007) [2023-12-28 08:19:57,538][106225] Updated weights for policy 1, policy_version 1822822 (0.0010) [2023-12-28 08:19:57,591][106225] Updated weights for policy 1, policy_version 1822832 (0.0010) [2023-12-28 08:19:57,643][106225] Updated weights for policy 1, policy_version 1822842 (0.0010) [2023-12-28 08:19:57,806][106226] Updated weights for policy 0, policy_version 1818512 (0.0010) [2023-12-28 08:19:57,858][106226] Updated weights for policy 0, policy_version 1818522 (0.0010) [2023-12-28 08:19:57,909][106226] Updated weights for policy 0, policy_version 1818532 (0.0010) [2023-12-28 08:19:58,395][106225] Updated weights for policy 1, policy_version 1822853 (0.0009) [2023-12-28 08:19:58,461][106225] Updated weights for policy 1, policy_version 1822863 (0.0009) [2023-12-28 08:19:58,523][106225] Updated weights for policy 1, policy_version 1822873 (0.0011) [2023-12-28 08:19:58,698][106226] Updated weights for policy 0, policy_version 1818542 (0.0009) [2023-12-28 08:19:58,765][106226] Updated weights for policy 0, policy_version 1818552 (0.0008) [2023-12-28 08:19:58,831][106226] Updated weights for policy 0, policy_version 1818562 (0.0010) [2023-12-28 08:19:59,256][106225] Updated weights for policy 1, policy_version 1822883 (0.0011) [2023-12-28 08:19:59,322][106225] Updated weights for policy 1, policy_version 1822893 (0.0009) [2023-12-28 08:19:59,387][106225] Updated weights for policy 1, policy_version 1822903 (0.0008) [2023-12-28 08:19:59,590][106226] Updated weights for policy 0, policy_version 1818572 (0.0008) [2023-12-28 08:19:59,643][106226] Updated weights for policy 0, policy_version 1818582 (0.0009) [2023-12-28 08:19:59,693][106226] Updated weights for policy 0, policy_version 1818592 (0.0009) [2023-12-28 08:20:00,185][106225] Updated weights for policy 1, policy_version 1822913 (0.0009) [2023-12-28 08:20:00,237][106225] Updated weights for policy 1, policy_version 1822923 (0.0009) [2023-12-28 08:20:00,304][106225] Updated weights for policy 1, policy_version 1822933 (0.0008) [2023-12-28 08:20:00,369][106225] Updated weights for policy 1, policy_version 1822943 (0.0007) [2023-12-28 08:20:00,373][106226] Updated weights for policy 0, policy_version 1818602 (0.0008) [2023-12-28 08:20:00,435][106226] Updated weights for policy 0, policy_version 1818612 (0.0009) [2023-12-28 08:20:00,492][106226] Updated weights for policy 0, policy_version 1818622 (0.0009) [2023-12-28 08:20:00,547][106226] Updated weights for policy 0, policy_version 1818632 (0.0009) [2023-12-28 08:20:01,033][106225] Updated weights for policy 1, policy_version 1822953 (0.0006) [2023-12-28 08:20:01,091][106225] Updated weights for policy 1, policy_version 1822963 (0.0007) [2023-12-28 08:20:01,157][106225] Updated weights for policy 1, policy_version 1822973 (0.0007) [2023-12-28 08:20:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19633.0). Total num frames: 932380672. Throughput: 0: 9916.4, 1: 9854.0. Samples: 932376268. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:01,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-4.922')] [2023-12-28 08:20:01,352][106226] Updated weights for policy 0, policy_version 1818642 (0.0008) [2023-12-28 08:20:01,417][106226] Updated weights for policy 0, policy_version 1818652 (0.0006) [2023-12-28 08:20:01,475][106226] Updated weights for policy 0, policy_version 1818662 (0.0005) [2023-12-28 08:20:01,892][106225] Updated weights for policy 1, policy_version 1822983 (0.0009) [2023-12-28 08:20:01,949][106225] Updated weights for policy 1, policy_version 1822993 (0.0009) [2023-12-28 08:20:02,009][106225] Updated weights for policy 1, policy_version 1823003 (0.0009) [2023-12-28 08:20:02,113][106226] Updated weights for policy 0, policy_version 1818672 (0.0008) [2023-12-28 08:20:02,171][106226] Updated weights for policy 0, policy_version 1818682 (0.0006) [2023-12-28 08:20:02,226][106226] Updated weights for policy 0, policy_version 1818692 (0.0005) [2023-12-28 08:20:02,716][106225] Updated weights for policy 1, policy_version 1823013 (0.0010) [2023-12-28 08:20:02,766][106225] Updated weights for policy 1, policy_version 1823023 (0.0008) [2023-12-28 08:20:02,814][106225] Updated weights for policy 1, policy_version 1823033 (0.0009) [2023-12-28 08:20:02,908][106226] Updated weights for policy 0, policy_version 1818702 (0.0008) [2023-12-28 08:20:02,959][106226] Updated weights for policy 0, policy_version 1818712 (0.0008) [2023-12-28 08:20:03,015][106226] Updated weights for policy 0, policy_version 1818722 (0.0007) [2023-12-28 08:20:03,526][106225] Updated weights for policy 1, policy_version 1823043 (0.0008) [2023-12-28 08:20:03,578][106226] Updated weights for policy 0, policy_version 1818732 (0.0005) [2023-12-28 08:20:03,581][106225] Updated weights for policy 1, policy_version 1823053 (0.0010) [2023-12-28 08:20:03,637][106226] Updated weights for policy 0, policy_version 1818742 (0.0005) [2023-12-28 08:20:03,644][106225] Updated weights for policy 1, policy_version 1823063 (0.0010) [2023-12-28 08:20:03,690][106226] Updated weights for policy 0, policy_version 1818752 (0.0005) [2023-12-28 08:20:04,293][106226] Updated weights for policy 0, policy_version 1818762 (0.0006) [2023-12-28 08:20:04,354][106226] Updated weights for policy 0, policy_version 1818772 (0.0011) [2023-12-28 08:20:04,355][106225] Updated weights for policy 1, policy_version 1823073 (0.0010) [2023-12-28 08:20:04,415][106226] Updated weights for policy 0, policy_version 1818782 (0.0011) [2023-12-28 08:20:04,417][106225] Updated weights for policy 1, policy_version 1823083 (0.0006) [2023-12-28 08:20:04,465][106226] Updated weights for policy 0, policy_version 1818792 (0.0011) [2023-12-28 08:20:04,479][106225] Updated weights for policy 1, policy_version 1823093 (0.0006) [2023-12-28 08:20:04,532][106225] Updated weights for policy 1, policy_version 1823103 (0.0008) [2023-12-28 08:20:05,206][106226] Updated weights for policy 0, policy_version 1818802 (0.0006) [2023-12-28 08:20:05,229][106225] Updated weights for policy 1, policy_version 1823113 (0.0008) [2023-12-28 08:20:05,265][106226] Updated weights for policy 0, policy_version 1818812 (0.0008) [2023-12-28 08:20:05,290][106225] Updated weights for policy 1, policy_version 1823123 (0.0009) [2023-12-28 08:20:05,328][106226] Updated weights for policy 0, policy_version 1818822 (0.0006) [2023-12-28 08:20:05,350][106225] Updated weights for policy 1, policy_version 1823133 (0.0006) [2023-12-28 08:20:05,999][106226] Updated weights for policy 0, policy_version 1818832 (0.0005) [2023-12-28 08:20:06,057][106226] Updated weights for policy 0, policy_version 1818842 (0.0007) [2023-12-28 08:20:06,097][106225] Updated weights for policy 1, policy_version 1823143 (0.0006) [2023-12-28 08:20:06,108][106226] Updated weights for policy 0, policy_version 1818852 (0.0009) [2023-12-28 08:20:06,162][106225] Updated weights for policy 1, policy_version 1823153 (0.0007) [2023-12-28 08:20:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 932487168. Throughput: 0: 10047.2, 1: 9807.5. Samples: 932496488. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:06,175][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.615')] [2023-12-28 08:20:06,227][106225] Updated weights for policy 1, policy_version 1823163 (0.0009) [2023-12-28 08:20:06,764][106226] Updated weights for policy 0, policy_version 1818862 (0.0008) [2023-12-28 08:20:06,821][106226] Updated weights for policy 0, policy_version 1818872 (0.0008) [2023-12-28 08:20:06,883][106226] Updated weights for policy 0, policy_version 1818882 (0.0007) [2023-12-28 08:20:06,965][106225] Updated weights for policy 1, policy_version 1823173 (0.0009) [2023-12-28 08:20:07,031][106225] Updated weights for policy 1, policy_version 1823183 (0.0010) [2023-12-28 08:20:07,098][106225] Updated weights for policy 1, policy_version 1823193 (0.0009) [2023-12-28 08:20:07,528][106226] Updated weights for policy 0, policy_version 1818892 (0.0007) [2023-12-28 08:20:07,577][106226] Updated weights for policy 0, policy_version 1818902 (0.0008) [2023-12-28 08:20:07,637][106226] Updated weights for policy 0, policy_version 1818912 (0.0008) [2023-12-28 08:20:07,814][106225] Updated weights for policy 1, policy_version 1823203 (0.0008) [2023-12-28 08:20:07,873][106225] Updated weights for policy 1, policy_version 1823213 (0.0009) [2023-12-28 08:20:07,934][106225] Updated weights for policy 1, policy_version 1823223 (0.0008) [2023-12-28 08:20:08,370][106226] Updated weights for policy 0, policy_version 1818922 (0.0009) [2023-12-28 08:20:08,419][106226] Updated weights for policy 0, policy_version 1818932 (0.0008) [2023-12-28 08:20:08,469][106226] Updated weights for policy 0, policy_version 1818942 (0.0008) [2023-12-28 08:20:08,519][106226] Updated weights for policy 0, policy_version 1818952 (0.0009) [2023-12-28 08:20:08,680][106225] Updated weights for policy 1, policy_version 1823233 (0.0008) [2023-12-28 08:20:08,740][106225] Updated weights for policy 1, policy_version 1823243 (0.0008) [2023-12-28 08:20:08,803][106225] Updated weights for policy 1, policy_version 1823253 (0.0008) [2023-12-28 08:20:08,865][106225] Updated weights for policy 1, policy_version 1823263 (0.0008) [2023-12-28 08:20:09,293][106226] Updated weights for policy 0, policy_version 1818962 (0.0011) [2023-12-28 08:20:09,363][106226] Updated weights for policy 0, policy_version 1818972 (0.0012) [2023-12-28 08:20:09,434][106226] Updated weights for policy 0, policy_version 1818982 (0.0008) [2023-12-28 08:20:09,656][106225] Updated weights for policy 1, policy_version 1823273 (0.0008) [2023-12-28 08:20:09,722][106225] Updated weights for policy 1, policy_version 1823283 (0.0009) [2023-12-28 08:20:09,788][106225] Updated weights for policy 1, policy_version 1823293 (0.0008) [2023-12-28 08:20:10,169][106226] Updated weights for policy 0, policy_version 1818992 (0.0010) [2023-12-28 08:20:10,236][106226] Updated weights for policy 0, policy_version 1819002 (0.0011) [2023-12-28 08:20:10,298][106226] Updated weights for policy 0, policy_version 1819012 (0.0011) [2023-12-28 08:20:10,528][106225] Updated weights for policy 1, policy_version 1823303 (0.0007) [2023-12-28 08:20:10,595][106225] Updated weights for policy 1, policy_version 1823313 (0.0009) [2023-12-28 08:20:10,657][106225] Updated weights for policy 1, policy_version 1823323 (0.0006) [2023-12-28 08:20:11,007][106226] Updated weights for policy 0, policy_version 1819022 (0.0008) [2023-12-28 08:20:11,074][106226] Updated weights for policy 0, policy_version 1819032 (0.0007) [2023-12-28 08:20:11,139][106226] Updated weights for policy 0, policy_version 1819042 (0.0007) [2023-12-28 08:20:11,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 932577280. Throughput: 0: 10093.9, 1: 9806.9. Samples: 932554620. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:11,175][105115] Avg episode reward: [(0, '-4.622'), (1, '-4.962')] [2023-12-28 08:20:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001823328_466829312.pth... [2023-12-28 08:20:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001819048_465756160.pth... [2023-12-28 08:20:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001817864_465453056.pth [2023-12-28 08:20:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001822176_466534400.pth [2023-12-28 08:20:11,284][106225] Updated weights for policy 1, policy_version 1823333 (0.0008) [2023-12-28 08:20:11,339][106225] Updated weights for policy 1, policy_version 1823343 (0.0010) [2023-12-28 08:20:11,403][106225] Updated weights for policy 1, policy_version 1823353 (0.0010) [2023-12-28 08:20:11,956][106226] Updated weights for policy 0, policy_version 1819052 (0.0008) [2023-12-28 08:20:12,012][106226] Updated weights for policy 0, policy_version 1819062 (0.0009) [2023-12-28 08:20:12,071][106226] Updated weights for policy 0, policy_version 1819072 (0.0009) [2023-12-28 08:20:12,141][106225] Updated weights for policy 1, policy_version 1823363 (0.0010) [2023-12-28 08:20:12,201][106225] Updated weights for policy 1, policy_version 1823373 (0.0006) [2023-12-28 08:20:12,260][106225] Updated weights for policy 1, policy_version 1823383 (0.0008) [2023-12-28 08:20:12,823][106226] Updated weights for policy 0, policy_version 1819082 (0.0007) [2023-12-28 08:20:12,878][106226] Updated weights for policy 0, policy_version 1819092 (0.0008) [2023-12-28 08:20:12,930][106226] Updated weights for policy 0, policy_version 1819102 (0.0008) [2023-12-28 08:20:12,980][106226] Updated weights for policy 0, policy_version 1819112 (0.0008) [2023-12-28 08:20:12,988][106225] Updated weights for policy 1, policy_version 1823393 (0.0009) [2023-12-28 08:20:13,033][106225] Updated weights for policy 1, policy_version 1823403 (0.0008) [2023-12-28 08:20:13,084][106225] Updated weights for policy 1, policy_version 1823413 (0.0008) [2023-12-28 08:20:13,135][106225] Updated weights for policy 1, policy_version 1823423 (0.0009) [2023-12-28 08:20:13,696][106226] Updated weights for policy 0, policy_version 1819122 (0.0009) [2023-12-28 08:20:13,756][106226] Updated weights for policy 0, policy_version 1819132 (0.0008) [2023-12-28 08:20:13,816][106226] Updated weights for policy 0, policy_version 1819142 (0.0007) [2023-12-28 08:20:13,858][106225] Updated weights for policy 1, policy_version 1823433 (0.0009) [2023-12-28 08:20:13,925][106225] Updated weights for policy 1, policy_version 1823443 (0.0009) [2023-12-28 08:20:13,974][106225] Updated weights for policy 1, policy_version 1823453 (0.0008) [2023-12-28 08:20:14,455][106226] Updated weights for policy 0, policy_version 1819152 (0.0008) [2023-12-28 08:20:14,505][106226] Updated weights for policy 0, policy_version 1819162 (0.0008) [2023-12-28 08:20:14,557][106226] Updated weights for policy 0, policy_version 1819172 (0.0009) [2023-12-28 08:20:14,766][106225] Updated weights for policy 1, policy_version 1823463 (0.0009) [2023-12-28 08:20:14,828][106225] Updated weights for policy 1, policy_version 1823473 (0.0007) [2023-12-28 08:20:14,892][106225] Updated weights for policy 1, policy_version 1823483 (0.0008) [2023-12-28 08:20:15,247][106226] Updated weights for policy 0, policy_version 1819182 (0.0007) [2023-12-28 08:20:15,311][106226] Updated weights for policy 0, policy_version 1819192 (0.0009) [2023-12-28 08:20:15,376][106226] Updated weights for policy 0, policy_version 1819202 (0.0009) [2023-12-28 08:20:15,571][106225] Updated weights for policy 1, policy_version 1823493 (0.0008) [2023-12-28 08:20:15,622][106225] Updated weights for policy 1, policy_version 1823503 (0.0005) [2023-12-28 08:20:15,675][106225] Updated weights for policy 1, policy_version 1823513 (0.0006) [2023-12-28 08:20:16,078][106226] Updated weights for policy 0, policy_version 1819212 (0.0009) [2023-12-28 08:20:16,135][106226] Updated weights for policy 0, policy_version 1819222 (0.0008) [2023-12-28 08:20:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 932675584. Throughput: 0: 9983.0, 1: 9729.6. Samples: 932669492. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:16,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.881')] [2023-12-28 08:20:16,193][106226] Updated weights for policy 0, policy_version 1819232 (0.0008) [2023-12-28 08:20:16,372][106225] Updated weights for policy 1, policy_version 1823523 (0.0008) [2023-12-28 08:20:16,419][106225] Updated weights for policy 1, policy_version 1823533 (0.0009) [2023-12-28 08:20:16,486][106225] Updated weights for policy 1, policy_version 1823543 (0.0009) [2023-12-28 08:20:16,876][106226] Updated weights for policy 0, policy_version 1819242 (0.0008) [2023-12-28 08:20:16,929][106226] Updated weights for policy 0, policy_version 1819252 (0.0008) [2023-12-28 08:20:16,993][106226] Updated weights for policy 0, policy_version 1819262 (0.0008) [2023-12-28 08:20:17,051][106226] Updated weights for policy 0, policy_version 1819272 (0.0009) [2023-12-28 08:20:17,238][106225] Updated weights for policy 1, policy_version 1823553 (0.0008) [2023-12-28 08:20:17,295][106225] Updated weights for policy 1, policy_version 1823563 (0.0009) [2023-12-28 08:20:17,353][106225] Updated weights for policy 1, policy_version 1823573 (0.0009) [2023-12-28 08:20:17,405][106225] Updated weights for policy 1, policy_version 1823583 (0.0008) [2023-12-28 08:20:17,688][106226] Updated weights for policy 0, policy_version 1819282 (0.0009) [2023-12-28 08:20:17,745][106226] Updated weights for policy 0, policy_version 1819292 (0.0009) [2023-12-28 08:20:17,795][106226] Updated weights for policy 0, policy_version 1819302 (0.0009) [2023-12-28 08:20:18,051][106225] Updated weights for policy 1, policy_version 1823593 (0.0010) [2023-12-28 08:20:18,115][106225] Updated weights for policy 1, policy_version 1823603 (0.0010) [2023-12-28 08:20:18,175][106225] Updated weights for policy 1, policy_version 1823613 (0.0008) [2023-12-28 08:20:18,597][106226] Updated weights for policy 0, policy_version 1819312 (0.0008) [2023-12-28 08:20:18,655][106226] Updated weights for policy 0, policy_version 1819322 (0.0008) [2023-12-28 08:20:18,713][106226] Updated weights for policy 0, policy_version 1819332 (0.0008) [2023-12-28 08:20:18,842][106225] Updated weights for policy 1, policy_version 1823623 (0.0009) [2023-12-28 08:20:18,897][106225] Updated weights for policy 1, policy_version 1823633 (0.0010) [2023-12-28 08:20:18,956][106225] Updated weights for policy 1, policy_version 1823643 (0.0010) [2023-12-28 08:20:19,456][106226] Updated weights for policy 0, policy_version 1819342 (0.0006) [2023-12-28 08:20:19,536][106226] Updated weights for policy 0, policy_version 1819352 (0.0008) [2023-12-28 08:20:19,602][106226] Updated weights for policy 0, policy_version 1819362 (0.0008) [2023-12-28 08:20:19,751][106225] Updated weights for policy 1, policy_version 1823653 (0.0009) [2023-12-28 08:20:19,808][106225] Updated weights for policy 1, policy_version 1823663 (0.0008) [2023-12-28 08:20:19,876][106225] Updated weights for policy 1, policy_version 1823673 (0.0008) [2023-12-28 08:20:20,357][106226] Updated weights for policy 0, policy_version 1819372 (0.0010) [2023-12-28 08:20:20,422][106226] Updated weights for policy 0, policy_version 1819382 (0.0011) [2023-12-28 08:20:20,474][106226] Updated weights for policy 0, policy_version 1819392 (0.0011) [2023-12-28 08:20:20,643][106225] Updated weights for policy 1, policy_version 1823683 (0.0007) [2023-12-28 08:20:20,703][106225] Updated weights for policy 1, policy_version 1823693 (0.0006) [2023-12-28 08:20:20,772][106225] Updated weights for policy 1, policy_version 1823703 (0.0006) [2023-12-28 08:20:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 932773888. Throughput: 0: 9945.2, 1: 9713.5. Samples: 932785088. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:21,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.625')] [2023-12-28 08:20:21,270][106226] Updated weights for policy 0, policy_version 1819402 (0.0010) [2023-12-28 08:20:21,338][106226] Updated weights for policy 0, policy_version 1819412 (0.0009) [2023-12-28 08:20:21,414][106226] Updated weights for policy 0, policy_version 1819422 (0.0012) [2023-12-28 08:20:21,446][106225] Updated weights for policy 1, policy_version 1823713 (0.0007) [2023-12-28 08:20:21,475][106226] Updated weights for policy 0, policy_version 1819432 (0.0011) [2023-12-28 08:20:21,498][106225] Updated weights for policy 1, policy_version 1823723 (0.0008) [2023-12-28 08:20:21,557][106225] Updated weights for policy 1, policy_version 1823733 (0.0008) [2023-12-28 08:20:21,617][106225] Updated weights for policy 1, policy_version 1823743 (0.0008) [2023-12-28 08:20:22,143][106226] Updated weights for policy 0, policy_version 1819442 (0.0010) [2023-12-28 08:20:22,193][106226] Updated weights for policy 0, policy_version 1819452 (0.0010) [2023-12-28 08:20:22,255][106226] Updated weights for policy 0, policy_version 1819462 (0.0009) [2023-12-28 08:20:22,412][106225] Updated weights for policy 1, policy_version 1823753 (0.0008) [2023-12-28 08:20:22,466][106225] Updated weights for policy 1, policy_version 1823763 (0.0009) [2023-12-28 08:20:22,526][106225] Updated weights for policy 1, policy_version 1823773 (0.0009) [2023-12-28 08:20:23,006][106226] Updated weights for policy 0, policy_version 1819472 (0.0009) [2023-12-28 08:20:23,067][106226] Updated weights for policy 0, policy_version 1819482 (0.0009) [2023-12-28 08:20:23,124][106226] Updated weights for policy 0, policy_version 1819492 (0.0008) [2023-12-28 08:20:23,224][106225] Updated weights for policy 1, policy_version 1823783 (0.0007) [2023-12-28 08:20:23,283][106225] Updated weights for policy 1, policy_version 1823793 (0.0005) [2023-12-28 08:20:23,342][106225] Updated weights for policy 1, policy_version 1823803 (0.0005) [2023-12-28 08:20:23,852][106226] Updated weights for policy 0, policy_version 1819502 (0.0009) [2023-12-28 08:20:23,900][106226] Updated weights for policy 0, policy_version 1819512 (0.0008) [2023-12-28 08:20:23,948][106226] Updated weights for policy 0, policy_version 1819522 (0.0008) [2023-12-28 08:20:24,008][106225] Updated weights for policy 1, policy_version 1823813 (0.0007) [2023-12-28 08:20:24,063][106225] Updated weights for policy 1, policy_version 1823823 (0.0006) [2023-12-28 08:20:24,115][106225] Updated weights for policy 1, policy_version 1823833 (0.0008) [2023-12-28 08:20:24,637][106226] Updated weights for policy 0, policy_version 1819532 (0.0007) [2023-12-28 08:20:24,695][106226] Updated weights for policy 0, policy_version 1819542 (0.0006) [2023-12-28 08:20:24,753][106226] Updated weights for policy 0, policy_version 1819552 (0.0005) [2023-12-28 08:20:24,845][106225] Updated weights for policy 1, policy_version 1823843 (0.0009) [2023-12-28 08:20:24,909][106225] Updated weights for policy 1, policy_version 1823853 (0.0008) [2023-12-28 08:20:24,965][106225] Updated weights for policy 1, policy_version 1823863 (0.0008) [2023-12-28 08:20:25,419][106226] Updated weights for policy 0, policy_version 1819562 (0.0006) [2023-12-28 08:20:25,470][106226] Updated weights for policy 0, policy_version 1819572 (0.0009) [2023-12-28 08:20:25,522][106226] Updated weights for policy 0, policy_version 1819582 (0.0008) [2023-12-28 08:20:25,570][106226] Updated weights for policy 0, policy_version 1819592 (0.0008) [2023-12-28 08:20:25,687][106225] Updated weights for policy 1, policy_version 1823873 (0.0008) [2023-12-28 08:20:25,738][106225] Updated weights for policy 1, policy_version 1823883 (0.0005) [2023-12-28 08:20:25,783][106225] Updated weights for policy 1, policy_version 1823893 (0.0007) [2023-12-28 08:20:25,837][106225] Updated weights for policy 1, policy_version 1823903 (0.0008) [2023-12-28 08:20:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 932872192. Throughput: 0: 9901.4, 1: 9730.2. Samples: 932842352. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:26,176][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.957')] [2023-12-28 08:20:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001823904_466976768.pth... [2023-12-28 08:20:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001822784_466690048.pth [2023-12-28 08:20:26,230][106226] Updated weights for policy 0, policy_version 1819602 (0.0005) [2023-12-28 08:20:26,282][106226] Updated weights for policy 0, policy_version 1819612 (0.0005) [2023-12-28 08:20:26,331][106226] Updated weights for policy 0, policy_version 1819622 (0.0007) [2023-12-28 08:20:26,337][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001819624_465903616.pth... [2023-12-28 08:20:26,340][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001818472_465608704.pth [2023-12-28 08:20:26,616][106225] Updated weights for policy 1, policy_version 1823913 (0.0006) [2023-12-28 08:20:26,675][106225] Updated weights for policy 1, policy_version 1823923 (0.0005) [2023-12-28 08:20:26,731][106225] Updated weights for policy 1, policy_version 1823933 (0.0006) [2023-12-28 08:20:27,070][106226] Updated weights for policy 0, policy_version 1819632 (0.0006) [2023-12-28 08:20:27,122][106226] Updated weights for policy 0, policy_version 1819642 (0.0005) [2023-12-28 08:20:27,171][106226] Updated weights for policy 0, policy_version 1819652 (0.0008) [2023-12-28 08:20:27,293][106225] Updated weights for policy 1, policy_version 1823943 (0.0007) [2023-12-28 08:20:27,347][106225] Updated weights for policy 1, policy_version 1823953 (0.0007) [2023-12-28 08:20:27,397][106225] Updated weights for policy 1, policy_version 1823963 (0.0005) [2023-12-28 08:20:27,938][106226] Updated weights for policy 0, policy_version 1819662 (0.0009) [2023-12-28 08:20:27,939][106225] Updated weights for policy 1, policy_version 1823973 (0.0005) [2023-12-28 08:20:27,992][106225] Updated weights for policy 1, policy_version 1823983 (0.0005) [2023-12-28 08:20:28,002][106226] Updated weights for policy 0, policy_version 1819672 (0.0008) [2023-12-28 08:20:28,048][106225] Updated weights for policy 1, policy_version 1823993 (0.0006) [2023-12-28 08:20:28,068][106226] Updated weights for policy 0, policy_version 1819682 (0.0008) [2023-12-28 08:20:28,715][106226] Updated weights for policy 0, policy_version 1819692 (0.0007) [2023-12-28 08:20:28,777][106225] Updated weights for policy 1, policy_version 1824003 (0.0006) [2023-12-28 08:20:28,789][106226] Updated weights for policy 0, policy_version 1819702 (0.0010) [2023-12-28 08:20:28,835][106225] Updated weights for policy 1, policy_version 1824013 (0.0009) [2023-12-28 08:20:28,849][106226] Updated weights for policy 0, policy_version 1819712 (0.0007) [2023-12-28 08:20:28,894][106225] Updated weights for policy 1, policy_version 1824023 (0.0008) [2023-12-28 08:20:29,587][106225] Updated weights for policy 1, policy_version 1824033 (0.0010) [2023-12-28 08:20:29,623][106226] Updated weights for policy 0, policy_version 1819722 (0.0007) [2023-12-28 08:20:29,645][106225] Updated weights for policy 1, policy_version 1824043 (0.0010) [2023-12-28 08:20:29,685][106226] Updated weights for policy 0, policy_version 1819732 (0.0006) [2023-12-28 08:20:29,695][106225] Updated weights for policy 1, policy_version 1824053 (0.0010) [2023-12-28 08:20:29,747][106226] Updated weights for policy 0, policy_version 1819742 (0.0006) [2023-12-28 08:20:29,756][106225] Updated weights for policy 1, policy_version 1824063 (0.0010) [2023-12-28 08:20:29,807][106226] Updated weights for policy 0, policy_version 1819752 (0.0007) [2023-12-28 08:20:30,426][106226] Updated weights for policy 0, policy_version 1819762 (0.0010) [2023-12-28 08:20:30,429][106225] Updated weights for policy 1, policy_version 1824073 (0.0008) [2023-12-28 08:20:30,484][106226] Updated weights for policy 0, policy_version 1819772 (0.0009) [2023-12-28 08:20:30,496][106225] Updated weights for policy 1, policy_version 1824083 (0.0008) [2023-12-28 08:20:30,539][106226] Updated weights for policy 0, policy_version 1819782 (0.0005) [2023-12-28 08:20:30,559][106225] Updated weights for policy 1, policy_version 1824093 (0.0008) [2023-12-28 08:20:31,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 932970496. Throughput: 0: 9849.3, 1: 9822.7. Samples: 932963584. Policy #0 lag: (min: 13.0, avg: 13.6, max: 24.0) [2023-12-28 08:20:31,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.594')] [2023-12-28 08:20:31,280][106225] Updated weights for policy 1, policy_version 1824103 (0.0010) [2023-12-28 08:20:31,286][106226] Updated weights for policy 0, policy_version 1819792 (0.0008) [2023-12-28 08:20:31,334][106225] Updated weights for policy 1, policy_version 1824113 (0.0010) [2023-12-28 08:20:31,349][106226] Updated weights for policy 0, policy_version 1819802 (0.0006) [2023-12-28 08:20:31,405][106225] Updated weights for policy 1, policy_version 1824123 (0.0010) [2023-12-28 08:20:31,422][106226] Updated weights for policy 0, policy_version 1819812 (0.0008) [2023-12-28 08:20:32,129][106226] Updated weights for policy 0, policy_version 1819822 (0.0008) [2023-12-28 08:20:32,138][106225] Updated weights for policy 1, policy_version 1824133 (0.0007) [2023-12-28 08:20:32,204][106225] Updated weights for policy 1, policy_version 1824143 (0.0008) [2023-12-28 08:20:32,204][106226] Updated weights for policy 0, policy_version 1819832 (0.0007) [2023-12-28 08:20:32,266][106225] Updated weights for policy 1, policy_version 1824153 (0.0008) [2023-12-28 08:20:32,266][106226] Updated weights for policy 0, policy_version 1819842 (0.0007) [2023-12-28 08:20:32,941][106225] Updated weights for policy 1, policy_version 1824163 (0.0007) [2023-12-28 08:20:32,942][106226] Updated weights for policy 0, policy_version 1819852 (0.0007) [2023-12-28 08:20:32,987][106225] Updated weights for policy 1, policy_version 1824173 (0.0010) [2023-12-28 08:20:32,989][106226] Updated weights for policy 0, policy_version 1819862 (0.0006) [2023-12-28 08:20:33,039][106226] Updated weights for policy 0, policy_version 1819872 (0.0009) [2023-12-28 08:20:33,043][106225] Updated weights for policy 1, policy_version 1824183 (0.0010) [2023-12-28 08:20:33,746][106225] Updated weights for policy 1, policy_version 1824193 (0.0010) [2023-12-28 08:20:33,751][106226] Updated weights for policy 0, policy_version 1819882 (0.0006) [2023-12-28 08:20:33,798][106225] Updated weights for policy 1, policy_version 1824203 (0.0010) [2023-12-28 08:20:33,804][106226] Updated weights for policy 0, policy_version 1819892 (0.0005) [2023-12-28 08:20:33,843][106225] Updated weights for policy 1, policy_version 1824213 (0.0009) [2023-12-28 08:20:33,852][106226] Updated weights for policy 0, policy_version 1819902 (0.0006) [2023-12-28 08:20:33,898][106225] Updated weights for policy 1, policy_version 1824223 (0.0005) [2023-12-28 08:20:33,913][106226] Updated weights for policy 0, policy_version 1819912 (0.0007) [2023-12-28 08:20:34,521][106226] Updated weights for policy 0, policy_version 1819922 (0.0011) [2023-12-28 08:20:34,570][106225] Updated weights for policy 1, policy_version 1824233 (0.0010) [2023-12-28 08:20:34,574][106226] Updated weights for policy 0, policy_version 1819932 (0.0010) [2023-12-28 08:20:34,625][106225] Updated weights for policy 1, policy_version 1824243 (0.0010) [2023-12-28 08:20:34,636][106226] Updated weights for policy 0, policy_version 1819942 (0.0011) [2023-12-28 08:20:34,687][106225] Updated weights for policy 1, policy_version 1824253 (0.0010) [2023-12-28 08:20:35,356][106225] Updated weights for policy 1, policy_version 1824263 (0.0010) [2023-12-28 08:20:35,364][106226] Updated weights for policy 0, policy_version 1819952 (0.0010) [2023-12-28 08:20:35,413][106225] Updated weights for policy 1, policy_version 1824273 (0.0010) [2023-12-28 08:20:35,421][106226] Updated weights for policy 0, policy_version 1819962 (0.0010) [2023-12-28 08:20:35,474][106225] Updated weights for policy 1, policy_version 1824283 (0.0010) [2023-12-28 08:20:35,482][106226] Updated weights for policy 0, policy_version 1819972 (0.0010) [2023-12-28 08:20:36,135][106226] Updated weights for policy 0, policy_version 1819982 (0.0009) [2023-12-28 08:20:36,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 933068800. Throughput: 0: 9899.8, 1: 9823.3. Samples: 933084524. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:20:36,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.925')] [2023-12-28 08:20:36,190][106225] Updated weights for policy 1, policy_version 1824293 (0.0011) [2023-12-28 08:20:36,193][106226] Updated weights for policy 0, policy_version 1819992 (0.0006) [2023-12-28 08:20:36,246][106225] Updated weights for policy 1, policy_version 1824303 (0.0010) [2023-12-28 08:20:36,250][106226] Updated weights for policy 0, policy_version 1820002 (0.0008) [2023-12-28 08:20:36,307][106225] Updated weights for policy 1, policy_version 1824313 (0.0010) [2023-12-28 08:20:36,917][106226] Updated weights for policy 0, policy_version 1820012 (0.0006) [2023-12-28 08:20:36,973][106226] Updated weights for policy 0, policy_version 1820022 (0.0006) [2023-12-28 08:20:37,015][106225] Updated weights for policy 1, policy_version 1824323 (0.0010) [2023-12-28 08:20:37,036][106226] Updated weights for policy 0, policy_version 1820032 (0.0006) [2023-12-28 08:20:37,064][106225] Updated weights for policy 1, policy_version 1824333 (0.0006) [2023-12-28 08:20:37,112][106225] Updated weights for policy 1, policy_version 1824343 (0.0008) [2023-12-28 08:20:37,590][106226] Updated weights for policy 0, policy_version 1820042 (0.0007) [2023-12-28 08:20:37,645][106226] Updated weights for policy 0, policy_version 1820052 (0.0010) [2023-12-28 08:20:37,706][106226] Updated weights for policy 0, policy_version 1820062 (0.0009) [2023-12-28 08:20:37,761][106226] Updated weights for policy 0, policy_version 1820072 (0.0008) [2023-12-28 08:20:37,862][106225] Updated weights for policy 1, policy_version 1824353 (0.0008) [2023-12-28 08:20:37,923][106225] Updated weights for policy 1, policy_version 1824363 (0.0008) [2023-12-28 08:20:37,989][106225] Updated weights for policy 1, policy_version 1824373 (0.0008) [2023-12-28 08:20:38,053][106225] Updated weights for policy 1, policy_version 1824383 (0.0008) [2023-12-28 08:20:38,473][106226] Updated weights for policy 0, policy_version 1820082 (0.0008) [2023-12-28 08:20:38,535][106226] Updated weights for policy 0, policy_version 1820092 (0.0005) [2023-12-28 08:20:38,600][106226] Updated weights for policy 0, policy_version 1820102 (0.0008) [2023-12-28 08:20:38,728][106225] Updated weights for policy 1, policy_version 1824393 (0.0008) [2023-12-28 08:20:38,786][106225] Updated weights for policy 1, policy_version 1824403 (0.0008) [2023-12-28 08:20:38,839][106225] Updated weights for policy 1, policy_version 1824413 (0.0007) [2023-12-28 08:20:39,287][106226] Updated weights for policy 0, policy_version 1820112 (0.0010) [2023-12-28 08:20:39,343][106226] Updated weights for policy 0, policy_version 1820122 (0.0012) [2023-12-28 08:20:39,410][106226] Updated weights for policy 0, policy_version 1820132 (0.0009) [2023-12-28 08:20:39,615][106225] Updated weights for policy 1, policy_version 1824423 (0.0008) [2023-12-28 08:20:39,675][106225] Updated weights for policy 1, policy_version 1824433 (0.0008) [2023-12-28 08:20:39,736][106225] Updated weights for policy 1, policy_version 1824443 (0.0008) [2023-12-28 08:20:40,149][106226] Updated weights for policy 0, policy_version 1820142 (0.0011) [2023-12-28 08:20:40,218][106226] Updated weights for policy 0, policy_version 1820152 (0.0011) [2023-12-28 08:20:40,284][106226] Updated weights for policy 0, policy_version 1820162 (0.0011) [2023-12-28 08:20:40,457][106225] Updated weights for policy 1, policy_version 1824453 (0.0008) [2023-12-28 08:20:40,506][106225] Updated weights for policy 1, policy_version 1824463 (0.0008) [2023-12-28 08:20:40,556][106225] Updated weights for policy 1, policy_version 1824473 (0.0008) [2023-12-28 08:20:40,925][106226] Updated weights for policy 0, policy_version 1820172 (0.0009) [2023-12-28 08:20:40,981][106226] Updated weights for policy 0, policy_version 1820182 (0.0005) [2023-12-28 08:20:41,054][106226] Updated weights for policy 0, policy_version 1820192 (0.0011) [2023-12-28 08:20:41,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 933175296. Throughput: 0: 9935.4, 1: 9825.3. Samples: 933145440. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:20:41,175][105115] Avg episode reward: [(0, '-4.654'), (1, '-4.986')] [2023-12-28 08:20:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001824480_467124224.pth... [2023-12-28 08:20:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001820200_466051072.pth... [2023-12-28 08:20:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001819048_465756160.pth [2023-12-28 08:20:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001823328_466829312.pth [2023-12-28 08:20:41,387][106225] Updated weights for policy 1, policy_version 1824483 (0.0009) [2023-12-28 08:20:41,452][106225] Updated weights for policy 1, policy_version 1824493 (0.0010) [2023-12-28 08:20:41,500][106225] Updated weights for policy 1, policy_version 1824503 (0.0010) [2023-12-28 08:20:41,774][106226] Updated weights for policy 0, policy_version 1820202 (0.0008) [2023-12-28 08:20:41,842][106226] Updated weights for policy 0, policy_version 1820212 (0.0008) [2023-12-28 08:20:41,902][106226] Updated weights for policy 0, policy_version 1820222 (0.0008) [2023-12-28 08:20:41,961][106226] Updated weights for policy 0, policy_version 1820232 (0.0008) [2023-12-28 08:20:42,184][106225] Updated weights for policy 1, policy_version 1824513 (0.0010) [2023-12-28 08:20:42,254][106225] Updated weights for policy 1, policy_version 1824523 (0.0005) [2023-12-28 08:20:42,326][106225] Updated weights for policy 1, policy_version 1824533 (0.0008) [2023-12-28 08:20:42,393][106225] Updated weights for policy 1, policy_version 1824543 (0.0008) [2023-12-28 08:20:42,638][106226] Updated weights for policy 0, policy_version 1820242 (0.0007) [2023-12-28 08:20:42,705][106226] Updated weights for policy 0, policy_version 1820252 (0.0008) [2023-12-28 08:20:42,771][106226] Updated weights for policy 0, policy_version 1820262 (0.0009) [2023-12-28 08:20:43,024][106225] Updated weights for policy 1, policy_version 1824553 (0.0005) [2023-12-28 08:20:43,087][106225] Updated weights for policy 1, policy_version 1824563 (0.0005) [2023-12-28 08:20:43,141][106225] Updated weights for policy 1, policy_version 1824573 (0.0008) [2023-12-28 08:20:43,469][106226] Updated weights for policy 0, policy_version 1820272 (0.0010) [2023-12-28 08:20:43,512][106226] Updated weights for policy 0, policy_version 1820282 (0.0010) [2023-12-28 08:20:43,559][106226] Updated weights for policy 0, policy_version 1820292 (0.0010) [2023-12-28 08:20:43,750][106225] Updated weights for policy 1, policy_version 1824583 (0.0011) [2023-12-28 08:20:43,806][106225] Updated weights for policy 1, policy_version 1824593 (0.0010) [2023-12-28 08:20:43,869][106225] Updated weights for policy 1, policy_version 1824603 (0.0010) [2023-12-28 08:20:44,279][106226] Updated weights for policy 0, policy_version 1820302 (0.0008) [2023-12-28 08:20:44,329][106226] Updated weights for policy 0, policy_version 1820312 (0.0005) [2023-12-28 08:20:44,379][106226] Updated weights for policy 0, policy_version 1820322 (0.0007) [2023-12-28 08:20:44,525][106225] Updated weights for policy 1, policy_version 1824613 (0.0009) [2023-12-28 08:20:44,580][106225] Updated weights for policy 1, policy_version 1824623 (0.0009) [2023-12-28 08:20:44,639][106225] Updated weights for policy 1, policy_version 1824633 (0.0010) [2023-12-28 08:20:45,034][106226] Updated weights for policy 0, policy_version 1820332 (0.0007) [2023-12-28 08:20:45,095][106226] Updated weights for policy 0, policy_version 1820342 (0.0008) [2023-12-28 08:20:45,151][106226] Updated weights for policy 0, policy_version 1820352 (0.0008) [2023-12-28 08:20:45,375][106225] Updated weights for policy 1, policy_version 1824643 (0.0010) [2023-12-28 08:20:45,424][106225] Updated weights for policy 1, policy_version 1824653 (0.0010) [2023-12-28 08:20:45,476][106225] Updated weights for policy 1, policy_version 1824663 (0.0009) [2023-12-28 08:20:45,769][106226] Updated weights for policy 0, policy_version 1820362 (0.0006) [2023-12-28 08:20:45,819][106226] Updated weights for policy 0, policy_version 1820372 (0.0007) [2023-12-28 08:20:45,865][106226] Updated weights for policy 0, policy_version 1820382 (0.0010) [2023-12-28 08:20:45,919][106226] Updated weights for policy 0, policy_version 1820392 (0.0007) [2023-12-28 08:20:46,136][106225] Updated weights for policy 1, policy_version 1824673 (0.0006) [2023-12-28 08:20:46,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 933273600. Throughput: 0: 9910.3, 1: 9792.3. Samples: 933262880. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:20:46,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-4.499')] [2023-12-28 08:20:46,190][106225] Updated weights for policy 1, policy_version 1824683 (0.0010) [2023-12-28 08:20:46,240][106225] Updated weights for policy 1, policy_version 1824693 (0.0010) [2023-12-28 08:20:46,294][106225] Updated weights for policy 1, policy_version 1824703 (0.0006) [2023-12-28 08:20:46,510][106226] Updated weights for policy 0, policy_version 1820402 (0.0005) [2023-12-28 08:20:46,569][106226] Updated weights for policy 0, policy_version 1820412 (0.0005) [2023-12-28 08:20:46,627][106226] Updated weights for policy 0, policy_version 1820422 (0.0005) [2023-12-28 08:20:46,874][106225] Updated weights for policy 1, policy_version 1824713 (0.0007) [2023-12-28 08:20:46,926][106225] Updated weights for policy 1, policy_version 1824723 (0.0005) [2023-12-28 08:20:46,986][106225] Updated weights for policy 1, policy_version 1824733 (0.0005) [2023-12-28 08:20:47,144][106226] Updated weights for policy 0, policy_version 1820432 (0.0009) [2023-12-28 08:20:47,211][106226] Updated weights for policy 0, policy_version 1820442 (0.0011) [2023-12-28 08:20:47,276][106226] Updated weights for policy 0, policy_version 1820452 (0.0008) [2023-12-28 08:20:47,673][106225] Updated weights for policy 1, policy_version 1824743 (0.0007) [2023-12-28 08:20:47,727][106225] Updated weights for policy 1, policy_version 1824753 (0.0006) [2023-12-28 08:20:47,780][106225] Updated weights for policy 1, policy_version 1824763 (0.0005) [2023-12-28 08:20:47,849][106226] Updated weights for policy 0, policy_version 1820462 (0.0006) [2023-12-28 08:20:47,904][106226] Updated weights for policy 0, policy_version 1820472 (0.0005) [2023-12-28 08:20:47,962][106226] Updated weights for policy 0, policy_version 1820482 (0.0005) [2023-12-28 08:20:48,538][106225] Updated weights for policy 1, policy_version 1824773 (0.0008) [2023-12-28 08:20:48,601][106225] Updated weights for policy 1, policy_version 1824783 (0.0008) [2023-12-28 08:20:48,629][106226] Updated weights for policy 0, policy_version 1820492 (0.0008) [2023-12-28 08:20:48,662][106225] Updated weights for policy 1, policy_version 1824793 (0.0008) [2023-12-28 08:20:48,683][106226] Updated weights for policy 0, policy_version 1820502 (0.0010) [2023-12-28 08:20:48,744][106226] Updated weights for policy 0, policy_version 1820512 (0.0011) [2023-12-28 08:20:49,363][106225] Updated weights for policy 1, policy_version 1824803 (0.0006) [2023-12-28 08:20:49,430][106225] Updated weights for policy 1, policy_version 1824813 (0.0006) [2023-12-28 08:20:49,472][106226] Updated weights for policy 0, policy_version 1820522 (0.0010) [2023-12-28 08:20:49,490][106225] Updated weights for policy 1, policy_version 1824823 (0.0006) [2023-12-28 08:20:49,529][106226] Updated weights for policy 0, policy_version 1820532 (0.0007) [2023-12-28 08:20:49,588][106226] Updated weights for policy 0, policy_version 1820542 (0.0005) [2023-12-28 08:20:49,661][106226] Updated weights for policy 0, policy_version 1820552 (0.0006) [2023-12-28 08:20:50,208][106225] Updated weights for policy 1, policy_version 1824833 (0.0006) [2023-12-28 08:20:50,267][106225] Updated weights for policy 1, policy_version 1824843 (0.0008) [2023-12-28 08:20:50,326][106225] Updated weights for policy 1, policy_version 1824853 (0.0008) [2023-12-28 08:20:50,387][106226] Updated weights for policy 0, policy_version 1820562 (0.0009) [2023-12-28 08:20:50,394][106225] Updated weights for policy 1, policy_version 1824863 (0.0006) [2023-12-28 08:20:50,455][106226] Updated weights for policy 0, policy_version 1820572 (0.0007) [2023-12-28 08:20:50,519][106226] Updated weights for policy 0, policy_version 1820582 (0.0009) [2023-12-28 08:20:51,135][106225] Updated weights for policy 1, policy_version 1824873 (0.0008) [2023-12-28 08:20:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 933371904. Throughput: 0: 9940.6, 1: 9836.9. Samples: 933386476. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:20:51,175][105115] Avg episode reward: [(0, '-4.556'), (1, '-4.784')] [2023-12-28 08:20:51,199][106225] Updated weights for policy 1, policy_version 1824883 (0.0006) [2023-12-28 08:20:51,266][106225] Updated weights for policy 1, policy_version 1824893 (0.0007) [2023-12-28 08:20:51,269][106226] Updated weights for policy 0, policy_version 1820592 (0.0008) [2023-12-28 08:20:51,325][106226] Updated weights for policy 0, policy_version 1820602 (0.0008) [2023-12-28 08:20:51,386][106226] Updated weights for policy 0, policy_version 1820612 (0.0008) [2023-12-28 08:20:51,963][106225] Updated weights for policy 1, policy_version 1824903 (0.0008) [2023-12-28 08:20:52,019][106225] Updated weights for policy 1, policy_version 1824913 (0.0009) [2023-12-28 08:20:52,076][106225] Updated weights for policy 1, policy_version 1824923 (0.0009) [2023-12-28 08:20:52,128][106226] Updated weights for policy 0, policy_version 1820622 (0.0007) [2023-12-28 08:20:52,186][106226] Updated weights for policy 0, policy_version 1820632 (0.0008) [2023-12-28 08:20:52,250][106226] Updated weights for policy 0, policy_version 1820642 (0.0009) [2023-12-28 08:20:52,772][106225] Updated weights for policy 1, policy_version 1824933 (0.0009) [2023-12-28 08:20:52,832][106225] Updated weights for policy 1, policy_version 1824943 (0.0007) [2023-12-28 08:20:52,894][106225] Updated weights for policy 1, policy_version 1824953 (0.0009) [2023-12-28 08:20:52,979][106226] Updated weights for policy 0, policy_version 1820652 (0.0009) [2023-12-28 08:20:53,033][106226] Updated weights for policy 0, policy_version 1820662 (0.0010) [2023-12-28 08:20:53,097][106226] Updated weights for policy 0, policy_version 1820672 (0.0009) [2023-12-28 08:20:53,644][106225] Updated weights for policy 1, policy_version 1824963 (0.0008) [2023-12-28 08:20:53,695][106225] Updated weights for policy 1, policy_version 1824973 (0.0008) [2023-12-28 08:20:53,747][106225] Updated weights for policy 1, policy_version 1824983 (0.0008) [2023-12-28 08:20:53,776][106226] Updated weights for policy 0, policy_version 1820682 (0.0006) [2023-12-28 08:20:53,821][106226] Updated weights for policy 0, policy_version 1820692 (0.0006) [2023-12-28 08:20:53,870][106226] Updated weights for policy 0, policy_version 1820702 (0.0005) [2023-12-28 08:20:53,919][106226] Updated weights for policy 0, policy_version 1820712 (0.0005) [2023-12-28 08:20:54,509][106225] Updated weights for policy 1, policy_version 1824993 (0.0008) [2023-12-28 08:20:54,559][106225] Updated weights for policy 1, policy_version 1825003 (0.0007) [2023-12-28 08:20:54,607][106225] Updated weights for policy 1, policy_version 1825013 (0.0007) [2023-12-28 08:20:54,615][106226] Updated weights for policy 0, policy_version 1820722 (0.0010) [2023-12-28 08:20:54,652][106225] Updated weights for policy 1, policy_version 1825023 (0.0006) [2023-12-28 08:20:54,675][106226] Updated weights for policy 0, policy_version 1820732 (0.0010) [2023-12-28 08:20:54,735][106226] Updated weights for policy 0, policy_version 1820742 (0.0009) [2023-12-28 08:20:55,380][106225] Updated weights for policy 1, policy_version 1825033 (0.0007) [2023-12-28 08:20:55,427][106225] Updated weights for policy 1, policy_version 1825043 (0.0006) [2023-12-28 08:20:55,443][106226] Updated weights for policy 0, policy_version 1820752 (0.0010) [2023-12-28 08:20:55,477][106225] Updated weights for policy 1, policy_version 1825053 (0.0008) [2023-12-28 08:20:55,503][106226] Updated weights for policy 0, policy_version 1820762 (0.0010) [2023-12-28 08:20:55,559][106226] Updated weights for policy 0, policy_version 1820772 (0.0010) [2023-12-28 08:20:56,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 933470208. Throughput: 0: 9924.8, 1: 9848.7. Samples: 933444436. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:20:56,176][105115] Avg episode reward: [(0, '-4.693'), (1, '-4.818')] [2023-12-28 08:20:56,180][106226] Updated weights for policy 0, policy_version 1820782 (0.0008) [2023-12-28 08:20:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001825056_467271680.pth... [2023-12-28 08:20:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001823904_466976768.pth [2023-12-28 08:20:56,240][106226] Updated weights for policy 0, policy_version 1820792 (0.0011) [2023-12-28 08:20:56,291][106226] Updated weights for policy 0, policy_version 1820802 (0.0007) [2023-12-28 08:20:56,296][106225] Updated weights for policy 1, policy_version 1825063 (0.0007) [2023-12-28 08:20:56,326][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001820808_466206720.pth... [2023-12-28 08:20:56,329][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001819624_465903616.pth [2023-12-28 08:20:56,363][106225] Updated weights for policy 1, policy_version 1825073 (0.0007) [2023-12-28 08:20:56,419][106225] Updated weights for policy 1, policy_version 1825083 (0.0008) [2023-12-28 08:20:56,938][106226] Updated weights for policy 0, policy_version 1820812 (0.0008) [2023-12-28 08:20:56,996][106226] Updated weights for policy 0, policy_version 1820822 (0.0010) [2023-12-28 08:20:57,056][106226] Updated weights for policy 0, policy_version 1820832 (0.0010) [2023-12-28 08:20:57,139][106225] Updated weights for policy 1, policy_version 1825093 (0.0008) [2023-12-28 08:20:57,189][106225] Updated weights for policy 1, policy_version 1825103 (0.0008) [2023-12-28 08:20:57,242][106225] Updated weights for policy 1, policy_version 1825113 (0.0008) [2023-12-28 08:20:57,743][106226] Updated weights for policy 0, policy_version 1820842 (0.0009) [2023-12-28 08:20:57,801][106226] Updated weights for policy 0, policy_version 1820852 (0.0005) [2023-12-28 08:20:57,848][106226] Updated weights for policy 0, policy_version 1820862 (0.0008) [2023-12-28 08:20:57,900][106226] Updated weights for policy 0, policy_version 1820872 (0.0008) [2023-12-28 08:20:57,928][106225] Updated weights for policy 1, policy_version 1825123 (0.0008) [2023-12-28 08:20:57,976][106225] Updated weights for policy 1, policy_version 1825133 (0.0008) [2023-12-28 08:20:58,026][106225] Updated weights for policy 1, policy_version 1825143 (0.0008) [2023-12-28 08:20:58,613][106226] Updated weights for policy 0, policy_version 1820882 (0.0008) [2023-12-28 08:20:58,675][106226] Updated weights for policy 0, policy_version 1820892 (0.0008) [2023-12-28 08:20:58,733][106226] Updated weights for policy 0, policy_version 1820902 (0.0008) [2023-12-28 08:20:58,859][106225] Updated weights for policy 1, policy_version 1825153 (0.0008) [2023-12-28 08:20:58,921][106225] Updated weights for policy 1, policy_version 1825163 (0.0008) [2023-12-28 08:20:58,983][106225] Updated weights for policy 1, policy_version 1825173 (0.0008) [2023-12-28 08:20:59,050][106225] Updated weights for policy 1, policy_version 1825183 (0.0007) [2023-12-28 08:20:59,606][106226] Updated weights for policy 0, policy_version 1820912 (0.0008) [2023-12-28 08:20:59,674][106226] Updated weights for policy 0, policy_version 1820922 (0.0007) [2023-12-28 08:20:59,729][106226] Updated weights for policy 0, policy_version 1820932 (0.0008) [2023-12-28 08:20:59,839][106225] Updated weights for policy 1, policy_version 1825193 (0.0007) [2023-12-28 08:20:59,899][106225] Updated weights for policy 1, policy_version 1825203 (0.0007) [2023-12-28 08:20:59,959][106225] Updated weights for policy 1, policy_version 1825213 (0.0008) [2023-12-28 08:21:00,399][106226] Updated weights for policy 0, policy_version 1820942 (0.0009) [2023-12-28 08:21:00,458][106226] Updated weights for policy 0, policy_version 1820952 (0.0009) [2023-12-28 08:21:00,516][106226] Updated weights for policy 0, policy_version 1820962 (0.0009) [2023-12-28 08:21:00,713][106225] Updated weights for policy 1, policy_version 1825223 (0.0009) [2023-12-28 08:21:00,766][106225] Updated weights for policy 1, policy_version 1825233 (0.0009) [2023-12-28 08:21:00,819][106225] Updated weights for policy 1, policy_version 1825243 (0.0009) [2023-12-28 08:21:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19688.6). Total num frames: 933568512. Throughput: 0: 9969.9, 1: 9806.3. Samples: 933559420. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:01,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.876')] [2023-12-28 08:21:01,262][106226] Updated weights for policy 0, policy_version 1820972 (0.0009) [2023-12-28 08:21:01,327][106226] Updated weights for policy 0, policy_version 1820982 (0.0008) [2023-12-28 08:21:01,401][106226] Updated weights for policy 0, policy_version 1820992 (0.0009) [2023-12-28 08:21:01,582][106225] Updated weights for policy 1, policy_version 1825253 (0.0008) [2023-12-28 08:21:01,648][106225] Updated weights for policy 1, policy_version 1825263 (0.0007) [2023-12-28 08:21:01,706][106225] Updated weights for policy 1, policy_version 1825273 (0.0008) [2023-12-28 08:21:02,106][106226] Updated weights for policy 0, policy_version 1821002 (0.0008) [2023-12-28 08:21:02,160][106226] Updated weights for policy 0, policy_version 1821012 (0.0011) [2023-12-28 08:21:02,218][106226] Updated weights for policy 0, policy_version 1821022 (0.0010) [2023-12-28 08:21:02,284][106226] Updated weights for policy 0, policy_version 1821032 (0.0010) [2023-12-28 08:21:02,420][106225] Updated weights for policy 1, policy_version 1825283 (0.0009) [2023-12-28 08:21:02,473][106225] Updated weights for policy 1, policy_version 1825293 (0.0007) [2023-12-28 08:21:02,529][106225] Updated weights for policy 1, policy_version 1825303 (0.0006) [2023-12-28 08:21:02,958][106226] Updated weights for policy 0, policy_version 1821042 (0.0006) [2023-12-28 08:21:03,024][106226] Updated weights for policy 0, policy_version 1821052 (0.0008) [2023-12-28 08:21:03,081][106226] Updated weights for policy 0, policy_version 1821062 (0.0008) [2023-12-28 08:21:03,177][106225] Updated weights for policy 1, policy_version 1825313 (0.0006) [2023-12-28 08:21:03,237][106225] Updated weights for policy 1, policy_version 1825323 (0.0005) [2023-12-28 08:21:03,291][106225] Updated weights for policy 1, policy_version 1825333 (0.0005) [2023-12-28 08:21:03,346][106225] Updated weights for policy 1, policy_version 1825343 (0.0005) [2023-12-28 08:21:03,691][106226] Updated weights for policy 0, policy_version 1821072 (0.0006) [2023-12-28 08:21:03,747][106226] Updated weights for policy 0, policy_version 1821082 (0.0005) [2023-12-28 08:21:03,808][106226] Updated weights for policy 0, policy_version 1821092 (0.0005) [2023-12-28 08:21:03,958][106225] Updated weights for policy 1, policy_version 1825353 (0.0009) [2023-12-28 08:21:04,024][106225] Updated weights for policy 1, policy_version 1825363 (0.0007) [2023-12-28 08:21:04,093][106225] Updated weights for policy 1, policy_version 1825373 (0.0010) [2023-12-28 08:21:04,452][106226] Updated weights for policy 0, policy_version 1821102 (0.0008) [2023-12-28 08:21:04,517][106226] Updated weights for policy 0, policy_version 1821112 (0.0009) [2023-12-28 08:21:04,580][106226] Updated weights for policy 0, policy_version 1821122 (0.0009) [2023-12-28 08:21:04,821][106225] Updated weights for policy 1, policy_version 1825383 (0.0008) [2023-12-28 08:21:04,877][106225] Updated weights for policy 1, policy_version 1825393 (0.0009) [2023-12-28 08:21:04,930][106225] Updated weights for policy 1, policy_version 1825403 (0.0010) [2023-12-28 08:21:05,320][106226] Updated weights for policy 0, policy_version 1821132 (0.0009) [2023-12-28 08:21:05,383][106226] Updated weights for policy 0, policy_version 1821142 (0.0008) [2023-12-28 08:21:05,440][106226] Updated weights for policy 0, policy_version 1821152 (0.0008) [2023-12-28 08:21:05,562][106225] Updated weights for policy 1, policy_version 1825413 (0.0009) [2023-12-28 08:21:05,624][106225] Updated weights for policy 1, policy_version 1825423 (0.0011) [2023-12-28 08:21:05,672][106225] Updated weights for policy 1, policy_version 1825433 (0.0010) [2023-12-28 08:21:06,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 933666816. Throughput: 0: 10032.5, 1: 9836.6. Samples: 933679196. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:06,175][105115] Avg episode reward: [(0, '-4.109'), (1, '-4.711')] [2023-12-28 08:21:06,214][106226] Updated weights for policy 0, policy_version 1821162 (0.0008) [2023-12-28 08:21:06,267][106226] Updated weights for policy 0, policy_version 1821172 (0.0009) [2023-12-28 08:21:06,323][106226] Updated weights for policy 0, policy_version 1821182 (0.0009) [2023-12-28 08:21:06,383][106226] Updated weights for policy 0, policy_version 1821192 (0.0009) [2023-12-28 08:21:06,390][106225] Updated weights for policy 1, policy_version 1825443 (0.0010) [2023-12-28 08:21:06,437][106225] Updated weights for policy 1, policy_version 1825453 (0.0010) [2023-12-28 08:21:06,485][106225] Updated weights for policy 1, policy_version 1825463 (0.0010) [2023-12-28 08:21:07,068][106226] Updated weights for policy 0, policy_version 1821202 (0.0010) [2023-12-28 08:21:07,131][106226] Updated weights for policy 0, policy_version 1821212 (0.0005) [2023-12-28 08:21:07,174][106225] Updated weights for policy 1, policy_version 1825473 (0.0010) [2023-12-28 08:21:07,195][106226] Updated weights for policy 0, policy_version 1821222 (0.0006) [2023-12-28 08:21:07,237][106225] Updated weights for policy 1, policy_version 1825483 (0.0008) [2023-12-28 08:21:07,304][106225] Updated weights for policy 1, policy_version 1825493 (0.0008) [2023-12-28 08:21:07,355][106225] Updated weights for policy 1, policy_version 1825503 (0.0009) [2023-12-28 08:21:07,802][106226] Updated weights for policy 0, policy_version 1821232 (0.0010) [2023-12-28 08:21:07,862][106226] Updated weights for policy 0, policy_version 1821242 (0.0010) [2023-12-28 08:21:07,922][106226] Updated weights for policy 0, policy_version 1821252 (0.0011) [2023-12-28 08:21:08,049][106225] Updated weights for policy 1, policy_version 1825513 (0.0006) [2023-12-28 08:21:08,111][106225] Updated weights for policy 1, policy_version 1825523 (0.0006) [2023-12-28 08:21:08,169][106225] Updated weights for policy 1, policy_version 1825533 (0.0006) [2023-12-28 08:21:08,621][106226] Updated weights for policy 0, policy_version 1821262 (0.0009) [2023-12-28 08:21:08,679][106226] Updated weights for policy 0, policy_version 1821272 (0.0009) [2023-12-28 08:21:08,734][106226] Updated weights for policy 0, policy_version 1821282 (0.0011) [2023-12-28 08:21:08,821][106225] Updated weights for policy 1, policy_version 1825543 (0.0008) [2023-12-28 08:21:08,870][106225] Updated weights for policy 1, policy_version 1825553 (0.0008) [2023-12-28 08:21:08,917][106225] Updated weights for policy 1, policy_version 1825563 (0.0007) [2023-12-28 08:21:09,451][106226] Updated weights for policy 0, policy_version 1821292 (0.0009) [2023-12-28 08:21:09,515][106226] Updated weights for policy 0, policy_version 1821302 (0.0011) [2023-12-28 08:21:09,576][106226] Updated weights for policy 0, policy_version 1821312 (0.0011) [2023-12-28 08:21:09,788][106225] Updated weights for policy 1, policy_version 1825573 (0.0008) [2023-12-28 08:21:09,850][106225] Updated weights for policy 1, policy_version 1825583 (0.0008) [2023-12-28 08:21:09,902][106225] Updated weights for policy 1, policy_version 1825593 (0.0008) [2023-12-28 08:21:10,342][106226] Updated weights for policy 0, policy_version 1821322 (0.0011) [2023-12-28 08:21:10,401][106226] Updated weights for policy 0, policy_version 1821332 (0.0011) [2023-12-28 08:21:10,460][106226] Updated weights for policy 0, policy_version 1821342 (0.0011) [2023-12-28 08:21:10,520][106226] Updated weights for policy 0, policy_version 1821352 (0.0010) [2023-12-28 08:21:10,670][106225] Updated weights for policy 1, policy_version 1825603 (0.0008) [2023-12-28 08:21:10,726][106225] Updated weights for policy 1, policy_version 1825613 (0.0007) [2023-12-28 08:21:10,787][106225] Updated weights for policy 1, policy_version 1825623 (0.0008) [2023-12-28 08:21:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 933765120. Throughput: 0: 10074.7, 1: 9867.6. Samples: 933739752. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:11,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.944')] [2023-12-28 08:21:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001825632_467419136.pth... [2023-12-28 08:21:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001824480_467124224.pth [2023-12-28 08:21:11,214][106226] Updated weights for policy 0, policy_version 1821362 (0.0009) [2023-12-28 08:21:11,285][106226] Updated weights for policy 0, policy_version 1821372 (0.0009) [2023-12-28 08:21:11,349][106226] Updated weights for policy 0, policy_version 1821382 (0.0010) [2023-12-28 08:21:11,363][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001821384_466354176.pth... [2023-12-28 08:21:11,367][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001820200_466051072.pth [2023-12-28 08:21:11,621][106225] Updated weights for policy 1, policy_version 1825633 (0.0009) [2023-12-28 08:21:11,700][106225] Updated weights for policy 1, policy_version 1825643 (0.0012) [2023-12-28 08:21:11,762][106225] Updated weights for policy 1, policy_version 1825653 (0.0009) [2023-12-28 08:21:11,819][106225] Updated weights for policy 1, policy_version 1825663 (0.0008) [2023-12-28 08:21:12,082][106226] Updated weights for policy 0, policy_version 1821392 (0.0006) [2023-12-28 08:21:12,141][106226] Updated weights for policy 0, policy_version 1821402 (0.0005) [2023-12-28 08:21:12,199][106226] Updated weights for policy 0, policy_version 1821412 (0.0007) [2023-12-28 08:21:12,643][106225] Updated weights for policy 1, policy_version 1825673 (0.0008) [2023-12-28 08:21:12,705][106225] Updated weights for policy 1, policy_version 1825683 (0.0008) [2023-12-28 08:21:12,762][106225] Updated weights for policy 1, policy_version 1825693 (0.0009) [2023-12-28 08:21:12,850][106226] Updated weights for policy 0, policy_version 1821422 (0.0007) [2023-12-28 08:21:12,908][106226] Updated weights for policy 0, policy_version 1821432 (0.0009) [2023-12-28 08:21:12,959][106226] Updated weights for policy 0, policy_version 1821442 (0.0009) [2023-12-28 08:21:13,505][106225] Updated weights for policy 1, policy_version 1825703 (0.0008) [2023-12-28 08:21:13,556][106225] Updated weights for policy 1, policy_version 1825713 (0.0005) [2023-12-28 08:21:13,616][106225] Updated weights for policy 1, policy_version 1825723 (0.0007) [2023-12-28 08:21:13,641][106226] Updated weights for policy 0, policy_version 1821452 (0.0010) [2023-12-28 08:21:13,694][106226] Updated weights for policy 0, policy_version 1821462 (0.0010) [2023-12-28 08:21:13,753][106226] Updated weights for policy 0, policy_version 1821472 (0.0010) [2023-12-28 08:21:14,264][106225] Updated weights for policy 1, policy_version 1825733 (0.0009) [2023-12-28 08:21:14,328][106225] Updated weights for policy 1, policy_version 1825743 (0.0008) [2023-12-28 08:21:14,360][106226] Updated weights for policy 0, policy_version 1821482 (0.0010) [2023-12-28 08:21:14,385][106225] Updated weights for policy 1, policy_version 1825753 (0.0006) [2023-12-28 08:21:14,424][106226] Updated weights for policy 0, policy_version 1821492 (0.0011) [2023-12-28 08:21:14,482][106226] Updated weights for policy 0, policy_version 1821502 (0.0007) [2023-12-28 08:21:14,546][106226] Updated weights for policy 0, policy_version 1821512 (0.0006) [2023-12-28 08:21:15,001][106225] Updated weights for policy 1, policy_version 1825763 (0.0005) [2023-12-28 08:21:15,061][106225] Updated weights for policy 1, policy_version 1825773 (0.0008) [2023-12-28 08:21:15,109][106225] Updated weights for policy 1, policy_version 1825783 (0.0008) [2023-12-28 08:21:15,210][106226] Updated weights for policy 0, policy_version 1821522 (0.0011) [2023-12-28 08:21:15,277][106226] Updated weights for policy 0, policy_version 1821532 (0.0011) [2023-12-28 08:21:15,344][106226] Updated weights for policy 0, policy_version 1821542 (0.0011) [2023-12-28 08:21:15,770][106225] Updated weights for policy 1, policy_version 1825793 (0.0008) [2023-12-28 08:21:15,820][106225] Updated weights for policy 1, policy_version 1825803 (0.0008) [2023-12-28 08:21:15,877][106225] Updated weights for policy 1, policy_version 1825813 (0.0010) [2023-12-28 08:21:15,937][106225] Updated weights for policy 1, policy_version 1825823 (0.0010) [2023-12-28 08:21:16,035][106226] Updated weights for policy 0, policy_version 1821552 (0.0008) [2023-12-28 08:21:16,092][106226] Updated weights for policy 0, policy_version 1821562 (0.0008) [2023-12-28 08:21:16,153][106226] Updated weights for policy 0, policy_version 1821572 (0.0008) [2023-12-28 08:21:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 933863424. Throughput: 0: 10075.3, 1: 9734.5. Samples: 933855024. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:16,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.773')] [2023-12-28 08:21:16,667][106225] Updated weights for policy 1, policy_version 1825833 (0.0009) [2023-12-28 08:21:16,718][106225] Updated weights for policy 1, policy_version 1825843 (0.0008) [2023-12-28 08:21:16,770][106225] Updated weights for policy 1, policy_version 1825853 (0.0008) [2023-12-28 08:21:16,835][106226] Updated weights for policy 0, policy_version 1821582 (0.0008) [2023-12-28 08:21:16,885][106226] Updated weights for policy 0, policy_version 1821592 (0.0008) [2023-12-28 08:21:16,936][106226] Updated weights for policy 0, policy_version 1821602 (0.0009) [2023-12-28 08:21:17,426][106225] Updated weights for policy 1, policy_version 1825863 (0.0009) [2023-12-28 08:21:17,483][106225] Updated weights for policy 1, policy_version 1825873 (0.0010) [2023-12-28 08:21:17,537][106225] Updated weights for policy 1, policy_version 1825883 (0.0009) [2023-12-28 08:21:17,712][106226] Updated weights for policy 0, policy_version 1821612 (0.0010) [2023-12-28 08:21:17,770][106226] Updated weights for policy 0, policy_version 1821622 (0.0011) [2023-12-28 08:21:17,832][106226] Updated weights for policy 0, policy_version 1821632 (0.0011) [2023-12-28 08:21:18,215][106225] Updated weights for policy 1, policy_version 1825893 (0.0009) [2023-12-28 08:21:18,269][106225] Updated weights for policy 1, policy_version 1825903 (0.0010) [2023-12-28 08:21:18,316][106225] Updated weights for policy 1, policy_version 1825913 (0.0010) [2023-12-28 08:21:18,551][106226] Updated weights for policy 0, policy_version 1821642 (0.0011) [2023-12-28 08:21:18,611][106226] Updated weights for policy 0, policy_version 1821652 (0.0011) [2023-12-28 08:21:18,672][106226] Updated weights for policy 0, policy_version 1821662 (0.0011) [2023-12-28 08:21:18,734][106226] Updated weights for policy 0, policy_version 1821672 (0.0011) [2023-12-28 08:21:19,075][106225] Updated weights for policy 1, policy_version 1825923 (0.0009) [2023-12-28 08:21:19,132][106225] Updated weights for policy 1, policy_version 1825933 (0.0010) [2023-12-28 08:21:19,185][106225] Updated weights for policy 1, policy_version 1825943 (0.0010) [2023-12-28 08:21:19,321][106226] Updated weights for policy 0, policy_version 1821682 (0.0007) [2023-12-28 08:21:19,389][106226] Updated weights for policy 0, policy_version 1821692 (0.0009) [2023-12-28 08:21:19,442][106226] Updated weights for policy 0, policy_version 1821702 (0.0009) [2023-12-28 08:21:19,964][106225] Updated weights for policy 1, policy_version 1825953 (0.0009) [2023-12-28 08:21:20,026][106225] Updated weights for policy 1, policy_version 1825963 (0.0009) [2023-12-28 08:21:20,089][106225] Updated weights for policy 1, policy_version 1825973 (0.0009) [2023-12-28 08:21:20,144][106225] Updated weights for policy 1, policy_version 1825983 (0.0007) [2023-12-28 08:21:20,146][106226] Updated weights for policy 0, policy_version 1821712 (0.0010) [2023-12-28 08:21:20,201][106226] Updated weights for policy 0, policy_version 1821722 (0.0008) [2023-12-28 08:21:20,265][106226] Updated weights for policy 0, policy_version 1821732 (0.0009) [2023-12-28 08:21:20,896][106225] Updated weights for policy 1, policy_version 1825993 (0.0008) [2023-12-28 08:21:20,947][106225] Updated weights for policy 1, policy_version 1826003 (0.0008) [2023-12-28 08:21:21,004][106226] Updated weights for policy 0, policy_version 1821742 (0.0010) [2023-12-28 08:21:21,007][106225] Updated weights for policy 1, policy_version 1826013 (0.0006) [2023-12-28 08:21:21,073][106226] Updated weights for policy 0, policy_version 1821752 (0.0010) [2023-12-28 08:21:21,134][106226] Updated weights for policy 0, policy_version 1821762 (0.0011) [2023-12-28 08:21:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 933961728. Throughput: 0: 10029.9, 1: 9706.6. Samples: 933972664. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:21,175][105115] Avg episode reward: [(0, '-4.218'), (1, '-4.880')] [2023-12-28 08:21:21,846][106225] Updated weights for policy 1, policy_version 1826023 (0.0006) [2023-12-28 08:21:21,915][106225] Updated weights for policy 1, policy_version 1826033 (0.0006) [2023-12-28 08:21:21,960][106226] Updated weights for policy 0, policy_version 1821772 (0.0009) [2023-12-28 08:21:21,980][106225] Updated weights for policy 1, policy_version 1826043 (0.0008) [2023-12-28 08:21:22,020][106226] Updated weights for policy 0, policy_version 1821782 (0.0008) [2023-12-28 08:21:22,084][106226] Updated weights for policy 0, policy_version 1821792 (0.0008) [2023-12-28 08:21:22,698][106225] Updated weights for policy 1, policy_version 1826053 (0.0007) [2023-12-28 08:21:22,761][106225] Updated weights for policy 1, policy_version 1826063 (0.0008) [2023-12-28 08:21:22,822][106225] Updated weights for policy 1, policy_version 1826073 (0.0008) [2023-12-28 08:21:22,838][106226] Updated weights for policy 0, policy_version 1821802 (0.0009) [2023-12-28 08:21:22,900][106226] Updated weights for policy 0, policy_version 1821812 (0.0010) [2023-12-28 08:21:22,964][106226] Updated weights for policy 0, policy_version 1821822 (0.0006) [2023-12-28 08:21:23,021][106226] Updated weights for policy 0, policy_version 1821832 (0.0005) [2023-12-28 08:21:23,579][106226] Updated weights for policy 0, policy_version 1821842 (0.0005) [2023-12-28 08:21:23,630][106225] Updated weights for policy 1, policy_version 1826083 (0.0008) [2023-12-28 08:21:23,638][106226] Updated weights for policy 0, policy_version 1821852 (0.0005) [2023-12-28 08:21:23,683][106225] Updated weights for policy 1, policy_version 1826093 (0.0005) [2023-12-28 08:21:23,692][106226] Updated weights for policy 0, policy_version 1821862 (0.0005) [2023-12-28 08:21:23,734][106225] Updated weights for policy 1, policy_version 1826103 (0.0005) [2023-12-28 08:21:24,342][106226] Updated weights for policy 0, policy_version 1821872 (0.0009) [2023-12-28 08:21:24,364][106225] Updated weights for policy 1, policy_version 1826113 (0.0007) [2023-12-28 08:21:24,399][106226] Updated weights for policy 0, policy_version 1821882 (0.0010) [2023-12-28 08:21:24,420][106225] Updated weights for policy 1, policy_version 1826123 (0.0007) [2023-12-28 08:21:24,463][106226] Updated weights for policy 0, policy_version 1821892 (0.0010) [2023-12-28 08:21:24,480][106225] Updated weights for policy 1, policy_version 1826133 (0.0005) [2023-12-28 08:21:24,527][106225] Updated weights for policy 1, policy_version 1826143 (0.0008) [2023-12-28 08:21:25,152][106226] Updated weights for policy 0, policy_version 1821902 (0.0009) [2023-12-28 08:21:25,215][106226] Updated weights for policy 0, policy_version 1821912 (0.0007) [2023-12-28 08:21:25,232][106225] Updated weights for policy 1, policy_version 1826153 (0.0008) [2023-12-28 08:21:25,282][106226] Updated weights for policy 0, policy_version 1821922 (0.0005) [2023-12-28 08:21:25,285][106225] Updated weights for policy 1, policy_version 1826163 (0.0009) [2023-12-28 08:21:25,332][106225] Updated weights for policy 1, policy_version 1826173 (0.0008) [2023-12-28 08:21:25,915][106226] Updated weights for policy 0, policy_version 1821932 (0.0007) [2023-12-28 08:21:25,979][106226] Updated weights for policy 0, policy_version 1821942 (0.0008) [2023-12-28 08:21:26,034][106226] Updated weights for policy 0, policy_version 1821952 (0.0009) [2023-12-28 08:21:26,091][106225] Updated weights for policy 1, policy_version 1826183 (0.0008) [2023-12-28 08:21:26,145][106225] Updated weights for policy 1, policy_version 1826193 (0.0009) [2023-12-28 08:21:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 934060032. Throughput: 0: 9999.8, 1: 9648.3. Samples: 934029604. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:26,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.903')] [2023-12-28 08:21:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001821960_466501632.pth... [2023-12-28 08:21:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001820808_466206720.pth [2023-12-28 08:21:26,195][106225] Updated weights for policy 1, policy_version 1826203 (0.0008) [2023-12-28 08:21:26,216][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001826208_467566592.pth... [2023-12-28 08:21:26,219][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001825056_467271680.pth [2023-12-28 08:21:26,759][106226] Updated weights for policy 0, policy_version 1821962 (0.0008) [2023-12-28 08:21:26,817][106226] Updated weights for policy 0, policy_version 1821972 (0.0010) [2023-12-28 08:21:26,875][106226] Updated weights for policy 0, policy_version 1821982 (0.0009) [2023-12-28 08:21:26,940][106226] Updated weights for policy 0, policy_version 1821992 (0.0005) [2023-12-28 08:21:26,949][106225] Updated weights for policy 1, policy_version 1826213 (0.0006) [2023-12-28 08:21:27,013][106225] Updated weights for policy 1, policy_version 1826223 (0.0005) [2023-12-28 08:21:27,082][106225] Updated weights for policy 1, policy_version 1826233 (0.0005) [2023-12-28 08:21:27,491][106226] Updated weights for policy 0, policy_version 1822002 (0.0010) [2023-12-28 08:21:27,550][106226] Updated weights for policy 0, policy_version 1822012 (0.0010) [2023-12-28 08:21:27,610][106226] Updated weights for policy 0, policy_version 1822022 (0.0010) [2023-12-28 08:21:27,748][106225] Updated weights for policy 1, policy_version 1826243 (0.0006) [2023-12-28 08:21:27,802][106225] Updated weights for policy 1, policy_version 1826253 (0.0006) [2023-12-28 08:21:27,863][106225] Updated weights for policy 1, policy_version 1826263 (0.0007) [2023-12-28 08:21:28,218][106226] Updated weights for policy 0, policy_version 1822032 (0.0006) [2023-12-28 08:21:28,274][106226] Updated weights for policy 0, policy_version 1822042 (0.0005) [2023-12-28 08:21:28,320][106226] Updated weights for policy 0, policy_version 1822052 (0.0005) [2023-12-28 08:21:28,549][106225] Updated weights for policy 1, policy_version 1826273 (0.0008) [2023-12-28 08:21:28,611][106225] Updated weights for policy 1, policy_version 1826283 (0.0010) [2023-12-28 08:21:28,676][106225] Updated weights for policy 1, policy_version 1826293 (0.0010) [2023-12-28 08:21:28,742][106225] Updated weights for policy 1, policy_version 1826303 (0.0010) [2023-12-28 08:21:28,891][106226] Updated weights for policy 0, policy_version 1822062 (0.0006) [2023-12-28 08:21:28,951][106226] Updated weights for policy 0, policy_version 1822072 (0.0005) [2023-12-28 08:21:29,009][106226] Updated weights for policy 0, policy_version 1822082 (0.0005) [2023-12-28 08:21:29,543][106225] Updated weights for policy 1, policy_version 1826313 (0.0007) [2023-12-28 08:21:29,598][106225] Updated weights for policy 1, policy_version 1826323 (0.0005) [2023-12-28 08:21:29,642][106226] Updated weights for policy 0, policy_version 1822092 (0.0006) [2023-12-28 08:21:29,659][106225] Updated weights for policy 1, policy_version 1826333 (0.0007) [2023-12-28 08:21:29,702][106226] Updated weights for policy 0, policy_version 1822102 (0.0008) [2023-12-28 08:21:29,764][106226] Updated weights for policy 0, policy_version 1822112 (0.0008) [2023-12-28 08:21:30,308][106225] Updated weights for policy 1, policy_version 1826343 (0.0008) [2023-12-28 08:21:30,374][106225] Updated weights for policy 1, policy_version 1826353 (0.0008) [2023-12-28 08:21:30,432][106225] Updated weights for policy 1, policy_version 1826363 (0.0006) [2023-12-28 08:21:30,555][106226] Updated weights for policy 0, policy_version 1822122 (0.0008) [2023-12-28 08:21:30,605][106226] Updated weights for policy 0, policy_version 1822132 (0.0009) [2023-12-28 08:21:30,658][106226] Updated weights for policy 0, policy_version 1822142 (0.0009) [2023-12-28 08:21:30,725][106226] Updated weights for policy 0, policy_version 1822152 (0.0009) [2023-12-28 08:21:31,070][106225] Updated weights for policy 1, policy_version 1826373 (0.0007) [2023-12-28 08:21:31,135][106225] Updated weights for policy 1, policy_version 1826383 (0.0010) [2023-12-28 08:21:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 934158336. Throughput: 0: 10106.7, 1: 9642.5. Samples: 934151596. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:31,175][105115] Avg episode reward: [(0, '-3.979'), (1, '-4.638')] [2023-12-28 08:21:31,195][106225] Updated weights for policy 1, policy_version 1826393 (0.0008) [2023-12-28 08:21:31,547][106226] Updated weights for policy 0, policy_version 1822162 (0.0008) [2023-12-28 08:21:31,600][106226] Updated weights for policy 0, policy_version 1822172 (0.0008) [2023-12-28 08:21:31,663][106226] Updated weights for policy 0, policy_version 1822182 (0.0009) [2023-12-28 08:21:31,981][106225] Updated weights for policy 1, policy_version 1826403 (0.0009) [2023-12-28 08:21:32,044][106225] Updated weights for policy 1, policy_version 1826413 (0.0008) [2023-12-28 08:21:32,106][106225] Updated weights for policy 1, policy_version 1826423 (0.0007) [2023-12-28 08:21:32,490][106226] Updated weights for policy 0, policy_version 1822192 (0.0008) [2023-12-28 08:21:32,548][106226] Updated weights for policy 0, policy_version 1822202 (0.0008) [2023-12-28 08:21:32,607][106226] Updated weights for policy 0, policy_version 1822212 (0.0009) [2023-12-28 08:21:32,801][106225] Updated weights for policy 1, policy_version 1826433 (0.0008) [2023-12-28 08:21:32,859][106225] Updated weights for policy 1, policy_version 1826443 (0.0008) [2023-12-28 08:21:32,915][106225] Updated weights for policy 1, policy_version 1826453 (0.0008) [2023-12-28 08:21:32,979][106225] Updated weights for policy 1, policy_version 1826463 (0.0008) [2023-12-28 08:21:33,330][106226] Updated weights for policy 0, policy_version 1822222 (0.0009) [2023-12-28 08:21:33,381][106226] Updated weights for policy 0, policy_version 1822232 (0.0009) [2023-12-28 08:21:33,432][106226] Updated weights for policy 0, policy_version 1822242 (0.0009) [2023-12-28 08:21:33,689][106225] Updated weights for policy 1, policy_version 1826473 (0.0009) [2023-12-28 08:21:33,741][106225] Updated weights for policy 1, policy_version 1826483 (0.0008) [2023-12-28 08:21:33,802][106225] Updated weights for policy 1, policy_version 1826493 (0.0008) [2023-12-28 08:21:34,162][106226] Updated weights for policy 0, policy_version 1822252 (0.0009) [2023-12-28 08:21:34,231][106226] Updated weights for policy 0, policy_version 1822262 (0.0008) [2023-12-28 08:21:34,298][106226] Updated weights for policy 0, policy_version 1822272 (0.0010) [2023-12-28 08:21:34,503][106225] Updated weights for policy 1, policy_version 1826503 (0.0008) [2023-12-28 08:21:34,563][106225] Updated weights for policy 1, policy_version 1826513 (0.0009) [2023-12-28 08:21:34,625][106225] Updated weights for policy 1, policy_version 1826523 (0.0007) [2023-12-28 08:21:35,047][106226] Updated weights for policy 0, policy_version 1822282 (0.0009) [2023-12-28 08:21:35,098][106226] Updated weights for policy 0, policy_version 1822292 (0.0008) [2023-12-28 08:21:35,146][106226] Updated weights for policy 0, policy_version 1822302 (0.0008) [2023-12-28 08:21:35,198][106226] Updated weights for policy 0, policy_version 1822312 (0.0008) [2023-12-28 08:21:35,305][106225] Updated weights for policy 1, policy_version 1826533 (0.0007) [2023-12-28 08:21:35,365][106225] Updated weights for policy 1, policy_version 1826543 (0.0005) [2023-12-28 08:21:35,418][106225] Updated weights for policy 1, policy_version 1826553 (0.0008) [2023-12-28 08:21:35,968][106226] Updated weights for policy 0, policy_version 1822322 (0.0008) [2023-12-28 08:21:36,033][106226] Updated weights for policy 0, policy_version 1822332 (0.0008) [2023-12-28 08:21:36,086][106226] Updated weights for policy 0, policy_version 1822342 (0.0008) [2023-12-28 08:21:36,110][106225] Updated weights for policy 1, policy_version 1826563 (0.0008) [2023-12-28 08:21:36,173][106225] Updated weights for policy 1, policy_version 1826573 (0.0008) [2023-12-28 08:21:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 934256640. Throughput: 0: 9908.9, 1: 9647.5. Samples: 934266516. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:36,175][105115] Avg episode reward: [(0, '-4.216'), (1, '-4.544')] [2023-12-28 08:21:36,225][106225] Updated weights for policy 1, policy_version 1826583 (0.0008) [2023-12-28 08:21:36,774][106226] Updated weights for policy 0, policy_version 1822352 (0.0007) [2023-12-28 08:21:36,845][106226] Updated weights for policy 0, policy_version 1822362 (0.0005) [2023-12-28 08:21:36,914][106226] Updated weights for policy 0, policy_version 1822372 (0.0005) [2023-12-28 08:21:36,974][106225] Updated weights for policy 1, policy_version 1826593 (0.0008) [2023-12-28 08:21:37,020][106225] Updated weights for policy 1, policy_version 1826603 (0.0006) [2023-12-28 08:21:37,067][106225] Updated weights for policy 1, policy_version 1826613 (0.0005) [2023-12-28 08:21:37,124][106225] Updated weights for policy 1, policy_version 1826623 (0.0009) [2023-12-28 08:21:37,449][106226] Updated weights for policy 0, policy_version 1822382 (0.0007) [2023-12-28 08:21:37,507][106226] Updated weights for policy 0, policy_version 1822392 (0.0007) [2023-12-28 08:21:37,563][106226] Updated weights for policy 0, policy_version 1822402 (0.0009) [2023-12-28 08:21:37,820][106225] Updated weights for policy 1, policy_version 1826633 (0.0006) [2023-12-28 08:21:37,883][106225] Updated weights for policy 1, policy_version 1826643 (0.0010) [2023-12-28 08:21:37,936][106225] Updated weights for policy 1, policy_version 1826653 (0.0010) [2023-12-28 08:21:38,308][106226] Updated weights for policy 0, policy_version 1822412 (0.0010) [2023-12-28 08:21:38,372][106226] Updated weights for policy 0, policy_version 1822422 (0.0006) [2023-12-28 08:21:38,434][106226] Updated weights for policy 0, policy_version 1822432 (0.0008) [2023-12-28 08:21:38,553][106225] Updated weights for policy 1, policy_version 1826663 (0.0009) [2023-12-28 08:21:38,619][106225] Updated weights for policy 1, policy_version 1826673 (0.0009) [2023-12-28 08:21:38,683][106225] Updated weights for policy 1, policy_version 1826683 (0.0009) [2023-12-28 08:21:39,220][106226] Updated weights for policy 0, policy_version 1822442 (0.0008) [2023-12-28 08:21:39,288][106226] Updated weights for policy 0, policy_version 1822452 (0.0008) [2023-12-28 08:21:39,355][106226] Updated weights for policy 0, policy_version 1822462 (0.0008) [2023-12-28 08:21:39,403][106225] Updated weights for policy 1, policy_version 1826693 (0.0010) [2023-12-28 08:21:39,425][106226] Updated weights for policy 0, policy_version 1822472 (0.0007) [2023-12-28 08:21:39,463][106225] Updated weights for policy 1, policy_version 1826703 (0.0008) [2023-12-28 08:21:39,526][106225] Updated weights for policy 1, policy_version 1826713 (0.0008) [2023-12-28 08:21:40,168][106226] Updated weights for policy 0, policy_version 1822482 (0.0009) [2023-12-28 08:21:40,233][106226] Updated weights for policy 0, policy_version 1822492 (0.0007) [2023-12-28 08:21:40,251][106225] Updated weights for policy 1, policy_version 1826723 (0.0009) [2023-12-28 08:21:40,298][106226] Updated weights for policy 0, policy_version 1822502 (0.0008) [2023-12-28 08:21:40,300][106225] Updated weights for policy 1, policy_version 1826733 (0.0007) [2023-12-28 08:21:40,344][106225] Updated weights for policy 1, policy_version 1826743 (0.0008) [2023-12-28 08:21:40,995][106226] Updated weights for policy 0, policy_version 1822512 (0.0006) [2023-12-28 08:21:41,068][106226] Updated weights for policy 0, policy_version 1822522 (0.0007) [2023-12-28 08:21:41,098][106225] Updated weights for policy 1, policy_version 1826753 (0.0008) [2023-12-28 08:21:41,128][106226] Updated weights for policy 0, policy_version 1822532 (0.0007) [2023-12-28 08:21:41,165][106225] Updated weights for policy 1, policy_version 1826763 (0.0011) [2023-12-28 08:21:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 934354944. Throughput: 0: 9934.4, 1: 9677.7. Samples: 934326976. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:41,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.777')] [2023-12-28 08:21:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001822536_466649088.pth... [2023-12-28 08:21:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001821384_466354176.pth [2023-12-28 08:21:41,220][106225] Updated weights for policy 1, policy_version 1826773 (0.0009) [2023-12-28 08:21:41,286][106225] Updated weights for policy 1, policy_version 1826783 (0.0007) [2023-12-28 08:21:41,290][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001826784_467714048.pth... [2023-12-28 08:21:41,295][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001825632_467419136.pth [2023-12-28 08:21:41,869][106226] Updated weights for policy 0, policy_version 1822542 (0.0008) [2023-12-28 08:21:41,920][106226] Updated weights for policy 0, policy_version 1822552 (0.0008) [2023-12-28 08:21:41,975][106226] Updated weights for policy 0, policy_version 1822562 (0.0008) [2023-12-28 08:21:42,089][106225] Updated weights for policy 1, policy_version 1826793 (0.0011) [2023-12-28 08:21:42,144][106225] Updated weights for policy 1, policy_version 1826803 (0.0010) [2023-12-28 08:21:42,191][106225] Updated weights for policy 1, policy_version 1826813 (0.0009) [2023-12-28 08:21:42,762][106226] Updated weights for policy 0, policy_version 1822572 (0.0009) [2023-12-28 08:21:42,823][106226] Updated weights for policy 0, policy_version 1822582 (0.0011) [2023-12-28 08:21:42,885][106226] Updated weights for policy 0, policy_version 1822592 (0.0010) [2023-12-28 08:21:42,962][106225] Updated weights for policy 1, policy_version 1826823 (0.0006) [2023-12-28 08:21:43,014][106225] Updated weights for policy 1, policy_version 1826833 (0.0005) [2023-12-28 08:21:43,072][106225] Updated weights for policy 1, policy_version 1826843 (0.0008) [2023-12-28 08:21:43,554][106226] Updated weights for policy 0, policy_version 1822602 (0.0006) [2023-12-28 08:21:43,617][106226] Updated weights for policy 0, policy_version 1822612 (0.0010) [2023-12-28 08:21:43,649][106225] Updated weights for policy 1, policy_version 1826853 (0.0006) [2023-12-28 08:21:43,667][106226] Updated weights for policy 0, policy_version 1822622 (0.0008) [2023-12-28 08:21:43,693][106225] Updated weights for policy 1, policy_version 1826863 (0.0006) [2023-12-28 08:21:43,711][106226] Updated weights for policy 0, policy_version 1822632 (0.0006) [2023-12-28 08:21:43,756][106225] Updated weights for policy 1, policy_version 1826873 (0.0008) [2023-12-28 08:21:44,441][106226] Updated weights for policy 0, policy_version 1822642 (0.0011) [2023-12-28 08:21:44,454][106225] Updated weights for policy 1, policy_version 1826883 (0.0008) [2023-12-28 08:21:44,501][106226] Updated weights for policy 0, policy_version 1822652 (0.0011) [2023-12-28 08:21:44,510][106225] Updated weights for policy 1, policy_version 1826893 (0.0005) [2023-12-28 08:21:44,555][106226] Updated weights for policy 0, policy_version 1822662 (0.0010) [2023-12-28 08:21:44,572][106225] Updated weights for policy 1, policy_version 1826903 (0.0007) [2023-12-28 08:21:45,257][106225] Updated weights for policy 1, policy_version 1826913 (0.0008) [2023-12-28 08:21:45,313][106226] Updated weights for policy 0, policy_version 1822672 (0.0010) [2023-12-28 08:21:45,315][106225] Updated weights for policy 1, policy_version 1826923 (0.0007) [2023-12-28 08:21:45,374][106225] Updated weights for policy 1, policy_version 1826933 (0.0008) [2023-12-28 08:21:45,377][106226] Updated weights for policy 0, policy_version 1822682 (0.0011) [2023-12-28 08:21:45,425][106225] Updated weights for policy 1, policy_version 1826943 (0.0010) [2023-12-28 08:21:45,434][106226] Updated weights for policy 0, policy_version 1822692 (0.0010) [2023-12-28 08:21:45,979][106225] Updated weights for policy 1, policy_version 1826953 (0.0005) [2023-12-28 08:21:46,039][106225] Updated weights for policy 1, policy_version 1826963 (0.0005) [2023-12-28 08:21:46,095][106225] Updated weights for policy 1, policy_version 1826973 (0.0006) [2023-12-28 08:21:46,121][106226] Updated weights for policy 0, policy_version 1822702 (0.0010) [2023-12-28 08:21:46,174][106226] Updated weights for policy 0, policy_version 1822712 (0.0010) [2023-12-28 08:21:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 934453248. Throughput: 0: 9862.8, 1: 9744.2. Samples: 934441740. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:46,176][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.735')] [2023-12-28 08:21:46,225][106226] Updated weights for policy 0, policy_version 1822722 (0.0010) [2023-12-28 08:21:46,774][106225] Updated weights for policy 1, policy_version 1826983 (0.0010) [2023-12-28 08:21:46,825][106226] Updated weights for policy 0, policy_version 1822732 (0.0005) [2023-12-28 08:21:46,829][106225] Updated weights for policy 1, policy_version 1826993 (0.0010) [2023-12-28 08:21:46,879][106225] Updated weights for policy 1, policy_version 1827003 (0.0010) [2023-12-28 08:21:46,890][106226] Updated weights for policy 0, policy_version 1822742 (0.0006) [2023-12-28 08:21:46,949][106226] Updated weights for policy 0, policy_version 1822752 (0.0008) [2023-12-28 08:21:47,536][106226] Updated weights for policy 0, policy_version 1822762 (0.0010) [2023-12-28 08:21:47,598][106225] Updated weights for policy 1, policy_version 1827013 (0.0010) [2023-12-28 08:21:47,599][106226] Updated weights for policy 0, policy_version 1822772 (0.0006) [2023-12-28 08:21:47,649][106225] Updated weights for policy 1, policy_version 1827023 (0.0010) [2023-12-28 08:21:47,667][106226] Updated weights for policy 0, policy_version 1822782 (0.0009) [2023-12-28 08:21:47,696][106225] Updated weights for policy 1, policy_version 1827033 (0.0010) [2023-12-28 08:21:47,724][106226] Updated weights for policy 0, policy_version 1822792 (0.0011) [2023-12-28 08:21:48,308][106225] Updated weights for policy 1, policy_version 1827043 (0.0009) [2023-12-28 08:21:48,369][106225] Updated weights for policy 1, policy_version 1827053 (0.0007) [2023-12-28 08:21:48,394][106226] Updated weights for policy 0, policy_version 1822802 (0.0011) [2023-12-28 08:21:48,434][106225] Updated weights for policy 1, policy_version 1827063 (0.0007) [2023-12-28 08:21:48,457][106226] Updated weights for policy 0, policy_version 1822812 (0.0011) [2023-12-28 08:21:48,514][106226] Updated weights for policy 0, policy_version 1822822 (0.0010) [2023-12-28 08:21:49,137][106225] Updated weights for policy 1, policy_version 1827073 (0.0008) [2023-12-28 08:21:49,176][106226] Updated weights for policy 0, policy_version 1822832 (0.0011) [2023-12-28 08:21:49,198][106225] Updated weights for policy 1, policy_version 1827083 (0.0007) [2023-12-28 08:21:49,241][106226] Updated weights for policy 0, policy_version 1822842 (0.0009) [2023-12-28 08:21:49,264][106225] Updated weights for policy 1, policy_version 1827093 (0.0008) [2023-12-28 08:21:49,306][106226] Updated weights for policy 0, policy_version 1822852 (0.0009) [2023-12-28 08:21:49,326][106225] Updated weights for policy 1, policy_version 1827103 (0.0008) [2023-12-28 08:21:49,989][106226] Updated weights for policy 0, policy_version 1822862 (0.0008) [2023-12-28 08:21:49,994][106225] Updated weights for policy 1, policy_version 1827113 (0.0007) [2023-12-28 08:21:50,052][106226] Updated weights for policy 0, policy_version 1822872 (0.0009) [2023-12-28 08:21:50,057][106225] Updated weights for policy 1, policy_version 1827123 (0.0006) [2023-12-28 08:21:50,118][106226] Updated weights for policy 0, policy_version 1822882 (0.0008) [2023-12-28 08:21:50,122][106225] Updated weights for policy 1, policy_version 1827133 (0.0006) [2023-12-28 08:21:50,739][106225] Updated weights for policy 1, policy_version 1827143 (0.0007) [2023-12-28 08:21:50,809][106225] Updated weights for policy 1, policy_version 1827153 (0.0009) [2023-12-28 08:21:50,867][106225] Updated weights for policy 1, policy_version 1827163 (0.0008) [2023-12-28 08:21:50,908][106226] Updated weights for policy 0, policy_version 1822892 (0.0010) [2023-12-28 08:21:50,978][106226] Updated weights for policy 0, policy_version 1822902 (0.0006) [2023-12-28 08:21:51,045][106226] Updated weights for policy 0, policy_version 1822912 (0.0007) [2023-12-28 08:21:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 934559744. Throughput: 0: 9891.2, 1: 9795.0. Samples: 934565076. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:51,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.392')] [2023-12-28 08:21:51,608][106225] Updated weights for policy 1, policy_version 1827173 (0.0009) [2023-12-28 08:21:51,667][106225] Updated weights for policy 1, policy_version 1827183 (0.0009) [2023-12-28 08:21:51,732][106225] Updated weights for policy 1, policy_version 1827193 (0.0007) [2023-12-28 08:21:51,739][106226] Updated weights for policy 0, policy_version 1822922 (0.0009) [2023-12-28 08:21:51,800][106226] Updated weights for policy 0, policy_version 1822932 (0.0008) [2023-12-28 08:21:51,855][106226] Updated weights for policy 0, policy_version 1822942 (0.0008) [2023-12-28 08:21:51,910][106226] Updated weights for policy 0, policy_version 1822952 (0.0007) [2023-12-28 08:21:52,554][106225] Updated weights for policy 1, policy_version 1827203 (0.0007) [2023-12-28 08:21:52,617][106225] Updated weights for policy 1, policy_version 1827213 (0.0008) [2023-12-28 08:21:52,671][106226] Updated weights for policy 0, policy_version 1822962 (0.0008) [2023-12-28 08:21:52,683][106225] Updated weights for policy 1, policy_version 1827223 (0.0009) [2023-12-28 08:21:52,727][106226] Updated weights for policy 0, policy_version 1822972 (0.0008) [2023-12-28 08:21:52,786][106226] Updated weights for policy 0, policy_version 1822982 (0.0008) [2023-12-28 08:21:53,386][106225] Updated weights for policy 1, policy_version 1827233 (0.0006) [2023-12-28 08:21:53,448][106225] Updated weights for policy 1, policy_version 1827243 (0.0008) [2023-12-28 08:21:53,511][106225] Updated weights for policy 1, policy_version 1827253 (0.0007) [2023-12-28 08:21:53,528][106226] Updated weights for policy 0, policy_version 1822992 (0.0008) [2023-12-28 08:21:53,568][106225] Updated weights for policy 1, policy_version 1827263 (0.0008) [2023-12-28 08:21:53,593][106226] Updated weights for policy 0, policy_version 1823002 (0.0007) [2023-12-28 08:21:53,658][106226] Updated weights for policy 0, policy_version 1823012 (0.0010) [2023-12-28 08:21:54,166][106225] Updated weights for policy 1, policy_version 1827273 (0.0006) [2023-12-28 08:21:54,220][106225] Updated weights for policy 1, policy_version 1827283 (0.0010) [2023-12-28 08:21:54,263][106225] Updated weights for policy 1, policy_version 1827293 (0.0010) [2023-12-28 08:21:54,417][106226] Updated weights for policy 0, policy_version 1823022 (0.0008) [2023-12-28 08:21:54,482][106226] Updated weights for policy 0, policy_version 1823032 (0.0008) [2023-12-28 08:21:54,550][106226] Updated weights for policy 0, policy_version 1823042 (0.0009) [2023-12-28 08:21:54,874][106225] Updated weights for policy 1, policy_version 1827303 (0.0007) [2023-12-28 08:21:54,928][106225] Updated weights for policy 1, policy_version 1827313 (0.0005) [2023-12-28 08:21:54,977][106225] Updated weights for policy 1, policy_version 1827323 (0.0005) [2023-12-28 08:21:55,330][106226] Updated weights for policy 0, policy_version 1823052 (0.0008) [2023-12-28 08:21:55,390][106226] Updated weights for policy 0, policy_version 1823062 (0.0008) [2023-12-28 08:21:55,435][106226] Updated weights for policy 0, policy_version 1823072 (0.0008) [2023-12-28 08:21:55,594][106225] Updated weights for policy 1, policy_version 1827333 (0.0010) [2023-12-28 08:21:55,654][106225] Updated weights for policy 1, policy_version 1827343 (0.0010) [2023-12-28 08:21:55,713][106225] Updated weights for policy 1, policy_version 1827353 (0.0010) [2023-12-28 08:21:56,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 934649856. Throughput: 0: 9837.5, 1: 9746.7. Samples: 934621040. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:21:56,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.816')] [2023-12-28 08:21:56,177][106226] Updated weights for policy 0, policy_version 1823082 (0.0007) [2023-12-28 08:21:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001827360_467861504.pth... [2023-12-28 08:21:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001826208_467566592.pth [2023-12-28 08:21:56,239][106226] Updated weights for policy 0, policy_version 1823092 (0.0006) [2023-12-28 08:21:56,295][106226] Updated weights for policy 0, policy_version 1823102 (0.0005) [2023-12-28 08:21:56,355][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001823112_466796544.pth... [2023-12-28 08:21:56,359][106226] Updated weights for policy 0, policy_version 1823112 (0.0007) [2023-12-28 08:21:56,360][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001821960_466501632.pth [2023-12-28 08:21:56,370][106225] Updated weights for policy 1, policy_version 1827363 (0.0009) [2023-12-28 08:21:56,426][106225] Updated weights for policy 1, policy_version 1827373 (0.0005) [2023-12-28 08:21:56,478][106225] Updated weights for policy 1, policy_version 1827383 (0.0005) [2023-12-28 08:21:56,962][106226] Updated weights for policy 0, policy_version 1823122 (0.0007) [2023-12-28 08:21:57,019][106226] Updated weights for policy 0, policy_version 1823132 (0.0009) [2023-12-28 08:21:57,067][106226] Updated weights for policy 0, policy_version 1823142 (0.0009) [2023-12-28 08:21:57,173][106225] Updated weights for policy 1, policy_version 1827393 (0.0007) [2023-12-28 08:21:57,233][106225] Updated weights for policy 1, policy_version 1827403 (0.0005) [2023-12-28 08:21:57,300][106225] Updated weights for policy 1, policy_version 1827413 (0.0006) [2023-12-28 08:21:57,366][106225] Updated weights for policy 1, policy_version 1827423 (0.0007) [2023-12-28 08:21:57,817][106226] Updated weights for policy 0, policy_version 1823152 (0.0009) [2023-12-28 08:21:57,879][106226] Updated weights for policy 0, policy_version 1823162 (0.0010) [2023-12-28 08:21:57,944][106226] Updated weights for policy 0, policy_version 1823172 (0.0009) [2023-12-28 08:21:57,969][106225] Updated weights for policy 1, policy_version 1827433 (0.0006) [2023-12-28 08:21:58,015][106225] Updated weights for policy 1, policy_version 1827443 (0.0006) [2023-12-28 08:21:58,063][106225] Updated weights for policy 1, policy_version 1827453 (0.0006) [2023-12-28 08:21:58,727][106226] Updated weights for policy 0, policy_version 1823182 (0.0008) [2023-12-28 08:21:58,779][106225] Updated weights for policy 1, policy_version 1827463 (0.0007) [2023-12-28 08:21:58,789][106226] Updated weights for policy 0, policy_version 1823192 (0.0007) [2023-12-28 08:21:58,850][106225] Updated weights for policy 1, policy_version 1827473 (0.0009) [2023-12-28 08:21:58,871][106226] Updated weights for policy 0, policy_version 1823202 (0.0009) [2023-12-28 08:21:58,910][106225] Updated weights for policy 1, policy_version 1827483 (0.0009) [2023-12-28 08:21:59,553][106226] Updated weights for policy 0, policy_version 1823212 (0.0007) [2023-12-28 08:21:59,621][106226] Updated weights for policy 0, policy_version 1823222 (0.0005) [2023-12-28 08:21:59,673][106226] Updated weights for policy 0, policy_version 1823232 (0.0005) [2023-12-28 08:21:59,724][106225] Updated weights for policy 1, policy_version 1827493 (0.0008) [2023-12-28 08:21:59,777][106225] Updated weights for policy 1, policy_version 1827503 (0.0009) [2023-12-28 08:21:59,837][106225] Updated weights for policy 1, policy_version 1827513 (0.0008) [2023-12-28 08:22:00,244][106226] Updated weights for policy 0, policy_version 1823242 (0.0005) [2023-12-28 08:22:00,302][106226] Updated weights for policy 0, policy_version 1823252 (0.0005) [2023-12-28 08:22:00,364][106226] Updated weights for policy 0, policy_version 1823262 (0.0006) [2023-12-28 08:22:00,416][106226] Updated weights for policy 0, policy_version 1823272 (0.0005) [2023-12-28 08:22:00,595][106225] Updated weights for policy 1, policy_version 1827523 (0.0009) [2023-12-28 08:22:00,642][106225] Updated weights for policy 1, policy_version 1827533 (0.0009) [2023-12-28 08:22:00,693][106225] Updated weights for policy 1, policy_version 1827543 (0.0005) [2023-12-28 08:22:01,041][106226] Updated weights for policy 0, policy_version 1823282 (0.0007) [2023-12-28 08:22:01,102][106226] Updated weights for policy 0, policy_version 1823292 (0.0008) [2023-12-28 08:22:01,165][106226] Updated weights for policy 0, policy_version 1823302 (0.0008) [2023-12-28 08:22:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 934748160. Throughput: 0: 9806.2, 1: 9897.7. Samples: 934741700. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:01,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-4.767')] [2023-12-28 08:22:01,341][106225] Updated weights for policy 1, policy_version 1827553 (0.0005) [2023-12-28 08:22:01,414][106225] Updated weights for policy 1, policy_version 1827563 (0.0008) [2023-12-28 08:22:01,466][106225] Updated weights for policy 1, policy_version 1827573 (0.0008) [2023-12-28 08:22:01,524][106225] Updated weights for policy 1, policy_version 1827583 (0.0008) [2023-12-28 08:22:01,906][106226] Updated weights for policy 0, policy_version 1823312 (0.0006) [2023-12-28 08:22:01,970][106226] Updated weights for policy 0, policy_version 1823322 (0.0005) [2023-12-28 08:22:02,036][106226] Updated weights for policy 0, policy_version 1823332 (0.0006) [2023-12-28 08:22:02,364][106225] Updated weights for policy 1, policy_version 1827593 (0.0009) [2023-12-28 08:22:02,420][106225] Updated weights for policy 1, policy_version 1827603 (0.0007) [2023-12-28 08:22:02,471][106225] Updated weights for policy 1, policy_version 1827613 (0.0008) [2023-12-28 08:22:02,661][106226] Updated weights for policy 0, policy_version 1823342 (0.0007) [2023-12-28 08:22:02,719][106226] Updated weights for policy 0, policy_version 1823352 (0.0008) [2023-12-28 08:22:02,780][106226] Updated weights for policy 0, policy_version 1823362 (0.0008) [2023-12-28 08:22:03,170][106225] Updated weights for policy 1, policy_version 1827623 (0.0006) [2023-12-28 08:22:03,231][106225] Updated weights for policy 1, policy_version 1827634 (0.0006) [2023-12-28 08:22:03,282][106225] Updated weights for policy 1, policy_version 1827644 (0.0005) [2023-12-28 08:22:03,432][106226] Updated weights for policy 0, policy_version 1823372 (0.0007) [2023-12-28 08:22:03,481][106226] Updated weights for policy 0, policy_version 1823382 (0.0005) [2023-12-28 08:22:03,534][106226] Updated weights for policy 0, policy_version 1823392 (0.0005) [2023-12-28 08:22:03,938][106225] Updated weights for policy 1, policy_version 1827654 (0.0008) [2023-12-28 08:22:03,995][106225] Updated weights for policy 1, policy_version 1827664 (0.0010) [2023-12-28 08:22:04,049][106225] Updated weights for policy 1, policy_version 1827674 (0.0010) [2023-12-28 08:22:04,181][106226] Updated weights for policy 0, policy_version 1823402 (0.0006) [2023-12-28 08:22:04,243][106226] Updated weights for policy 0, policy_version 1823412 (0.0008) [2023-12-28 08:22:04,303][106226] Updated weights for policy 0, policy_version 1823422 (0.0008) [2023-12-28 08:22:04,367][106226] Updated weights for policy 0, policy_version 1823432 (0.0008) [2023-12-28 08:22:04,759][106225] Updated weights for policy 1, policy_version 1827684 (0.0010) [2023-12-28 08:22:04,812][106225] Updated weights for policy 1, policy_version 1827694 (0.0010) [2023-12-28 08:22:04,871][106225] Updated weights for policy 1, policy_version 1827704 (0.0010) [2023-12-28 08:22:05,115][106226] Updated weights for policy 0, policy_version 1823442 (0.0008) [2023-12-28 08:22:05,176][106226] Updated weights for policy 0, policy_version 1823452 (0.0008) [2023-12-28 08:22:05,238][106226] Updated weights for policy 0, policy_version 1823462 (0.0008) [2023-12-28 08:22:05,556][106225] Updated weights for policy 1, policy_version 1827714 (0.0010) [2023-12-28 08:22:05,619][106225] Updated weights for policy 1, policy_version 1827724 (0.0010) [2023-12-28 08:22:05,678][106225] Updated weights for policy 1, policy_version 1827734 (0.0010) [2023-12-28 08:22:05,735][106225] Updated weights for policy 1, policy_version 1827744 (0.0005) [2023-12-28 08:22:05,986][106226] Updated weights for policy 0, policy_version 1823472 (0.0009) [2023-12-28 08:22:06,054][106226] Updated weights for policy 0, policy_version 1823482 (0.0008) [2023-12-28 08:22:06,110][106226] Updated weights for policy 0, policy_version 1823492 (0.0008) [2023-12-28 08:22:06,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 934854656. Throughput: 0: 9830.3, 1: 9897.2. Samples: 934860404. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:06,176][105115] Avg episode reward: [(0, '-4.260'), (1, '-4.831')] [2023-12-28 08:22:06,384][106225] Updated weights for policy 1, policy_version 1827754 (0.0011) [2023-12-28 08:22:06,435][106225] Updated weights for policy 1, policy_version 1827764 (0.0011) [2023-12-28 08:22:06,490][106225] Updated weights for policy 1, policy_version 1827774 (0.0010) [2023-12-28 08:22:06,809][106226] Updated weights for policy 0, policy_version 1823502 (0.0008) [2023-12-28 08:22:06,866][106226] Updated weights for policy 0, policy_version 1823512 (0.0008) [2023-12-28 08:22:06,924][106226] Updated weights for policy 0, policy_version 1823522 (0.0007) [2023-12-28 08:22:07,243][106225] Updated weights for policy 1, policy_version 1827784 (0.0009) [2023-12-28 08:22:07,301][106225] Updated weights for policy 1, policy_version 1827794 (0.0008) [2023-12-28 08:22:07,361][106225] Updated weights for policy 1, policy_version 1827804 (0.0008) [2023-12-28 08:22:07,638][106226] Updated weights for policy 0, policy_version 1823532 (0.0009) [2023-12-28 08:22:07,690][106226] Updated weights for policy 0, policy_version 1823542 (0.0006) [2023-12-28 08:22:07,746][106226] Updated weights for policy 0, policy_version 1823552 (0.0006) [2023-12-28 08:22:08,088][106225] Updated weights for policy 1, policy_version 1827814 (0.0008) [2023-12-28 08:22:08,137][106225] Updated weights for policy 1, policy_version 1827824 (0.0008) [2023-12-28 08:22:08,187][106225] Updated weights for policy 1, policy_version 1827835 (0.0009) [2023-12-28 08:22:08,311][106226] Updated weights for policy 0, policy_version 1823562 (0.0006) [2023-12-28 08:22:08,383][106226] Updated weights for policy 0, policy_version 1823572 (0.0009) [2023-12-28 08:22:08,439][106226] Updated weights for policy 0, policy_version 1823582 (0.0007) [2023-12-28 08:22:08,504][106226] Updated weights for policy 0, policy_version 1823592 (0.0009) [2023-12-28 08:22:08,972][106225] Updated weights for policy 1, policy_version 1827845 (0.0009) [2023-12-28 08:22:09,032][106225] Updated weights for policy 1, policy_version 1827855 (0.0008) [2023-12-28 08:22:09,081][106225] Updated weights for policy 1, policy_version 1827865 (0.0009) [2023-12-28 08:22:09,206][106226] Updated weights for policy 0, policy_version 1823602 (0.0009) [2023-12-28 08:22:09,269][106226] Updated weights for policy 0, policy_version 1823612 (0.0009) [2023-12-28 08:22:09,338][106226] Updated weights for policy 0, policy_version 1823622 (0.0010) [2023-12-28 08:22:09,898][106225] Updated weights for policy 1, policy_version 1827875 (0.0008) [2023-12-28 08:22:09,966][106225] Updated weights for policy 1, policy_version 1827885 (0.0009) [2023-12-28 08:22:10,024][106226] Updated weights for policy 0, policy_version 1823632 (0.0008) [2023-12-28 08:22:10,031][106225] Updated weights for policy 1, policy_version 1827895 (0.0007) [2023-12-28 08:22:10,088][106226] Updated weights for policy 0, policy_version 1823642 (0.0007) [2023-12-28 08:22:10,156][106226] Updated weights for policy 0, policy_version 1823652 (0.0006) [2023-12-28 08:22:10,755][106226] Updated weights for policy 0, policy_version 1823662 (0.0005) [2023-12-28 08:22:10,812][106225] Updated weights for policy 1, policy_version 1827905 (0.0008) [2023-12-28 08:22:10,814][106226] Updated weights for policy 0, policy_version 1823672 (0.0005) [2023-12-28 08:22:10,865][106225] Updated weights for policy 1, policy_version 1827915 (0.0007) [2023-12-28 08:22:10,871][106226] Updated weights for policy 0, policy_version 1823682 (0.0007) [2023-12-28 08:22:10,925][106225] Updated weights for policy 1, policy_version 1827925 (0.0007) [2023-12-28 08:22:10,977][106225] Updated weights for policy 1, policy_version 1827935 (0.0009) [2023-12-28 08:22:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 934952960. Throughput: 0: 9845.1, 1: 9950.1. Samples: 934920388. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:11,175][105115] Avg episode reward: [(0, '-4.463'), (1, '-4.817')] [2023-12-28 08:22:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001827936_468008960.pth... [2023-12-28 08:22:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001823688_466944000.pth... [2023-12-28 08:22:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001826784_467714048.pth [2023-12-28 08:22:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001822536_466649088.pth [2023-12-28 08:22:11,614][106226] Updated weights for policy 0, policy_version 1823692 (0.0007) [2023-12-28 08:22:11,686][106226] Updated weights for policy 0, policy_version 1823702 (0.0008) [2023-12-28 08:22:11,756][106226] Updated weights for policy 0, policy_version 1823712 (0.0008) [2023-12-28 08:22:11,808][106225] Updated weights for policy 1, policy_version 1827945 (0.0008) [2023-12-28 08:22:11,867][106225] Updated weights for policy 1, policy_version 1827955 (0.0008) [2023-12-28 08:22:11,924][106225] Updated weights for policy 1, policy_version 1827965 (0.0007) [2023-12-28 08:22:12,428][106226] Updated weights for policy 0, policy_version 1823722 (0.0006) [2023-12-28 08:22:12,490][106226] Updated weights for policy 0, policy_version 1823732 (0.0006) [2023-12-28 08:22:12,548][106226] Updated weights for policy 0, policy_version 1823742 (0.0006) [2023-12-28 08:22:12,606][106226] Updated weights for policy 0, policy_version 1823752 (0.0006) [2023-12-28 08:22:12,694][106225] Updated weights for policy 1, policy_version 1827975 (0.0005) [2023-12-28 08:22:12,750][106225] Updated weights for policy 1, policy_version 1827985 (0.0007) [2023-12-28 08:22:12,804][106225] Updated weights for policy 1, policy_version 1827995 (0.0008) [2023-12-28 08:22:13,214][106226] Updated weights for policy 0, policy_version 1823762 (0.0010) [2023-12-28 08:22:13,270][106226] Updated weights for policy 0, policy_version 1823772 (0.0010) [2023-12-28 08:22:13,337][106226] Updated weights for policy 0, policy_version 1823782 (0.0007) [2023-12-28 08:22:13,575][106225] Updated weights for policy 1, policy_version 1828005 (0.0009) [2023-12-28 08:22:13,636][106225] Updated weights for policy 1, policy_version 1828015 (0.0008) [2023-12-28 08:22:13,690][106225] Updated weights for policy 1, policy_version 1828025 (0.0008) [2023-12-28 08:22:13,986][106226] Updated weights for policy 0, policy_version 1823792 (0.0009) [2023-12-28 08:22:14,035][106226] Updated weights for policy 0, policy_version 1823802 (0.0010) [2023-12-28 08:22:14,085][106226] Updated weights for policy 0, policy_version 1823812 (0.0010) [2023-12-28 08:22:14,418][106225] Updated weights for policy 1, policy_version 1828035 (0.0007) [2023-12-28 08:22:14,480][106225] Updated weights for policy 1, policy_version 1828045 (0.0007) [2023-12-28 08:22:14,538][106225] Updated weights for policy 1, policy_version 1828055 (0.0005) [2023-12-28 08:22:14,776][106226] Updated weights for policy 0, policy_version 1823822 (0.0009) [2023-12-28 08:22:14,834][106226] Updated weights for policy 0, policy_version 1823832 (0.0008) [2023-12-28 08:22:14,897][106226] Updated weights for policy 0, policy_version 1823842 (0.0009) [2023-12-28 08:22:15,205][106225] Updated weights for policy 1, policy_version 1828065 (0.0007) [2023-12-28 08:22:15,275][106225] Updated weights for policy 1, policy_version 1828075 (0.0006) [2023-12-28 08:22:15,339][106225] Updated weights for policy 1, policy_version 1828085 (0.0005) [2023-12-28 08:22:15,399][106225] Updated weights for policy 1, policy_version 1828095 (0.0008) [2023-12-28 08:22:15,667][106226] Updated weights for policy 0, policy_version 1823852 (0.0008) [2023-12-28 08:22:15,729][106226] Updated weights for policy 0, policy_version 1823862 (0.0006) [2023-12-28 08:22:15,797][106226] Updated weights for policy 0, policy_version 1823872 (0.0005) [2023-12-28 08:22:16,064][106225] Updated weights for policy 1, policy_version 1828105 (0.0008) [2023-12-28 08:22:16,126][106225] Updated weights for policy 1, policy_version 1828115 (0.0008) [2023-12-28 08:22:16,171][106225] Updated weights for policy 1, policy_version 1828125 (0.0008) [2023-12-28 08:22:16,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 935043072. Throughput: 0: 9792.0, 1: 9863.4. Samples: 935036092. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:16,176][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.783')] [2023-12-28 08:22:16,440][106226] Updated weights for policy 0, policy_version 1823882 (0.0008) [2023-12-28 08:22:16,485][106226] Updated weights for policy 0, policy_version 1823892 (0.0008) [2023-12-28 08:22:16,530][106226] Updated weights for policy 0, policy_version 1823902 (0.0008) [2023-12-28 08:22:16,578][106226] Updated weights for policy 0, policy_version 1823912 (0.0008) [2023-12-28 08:22:16,894][106225] Updated weights for policy 1, policy_version 1828135 (0.0009) [2023-12-28 08:22:16,951][106225] Updated weights for policy 1, policy_version 1828146 (0.0008) [2023-12-28 08:22:17,001][106225] Updated weights for policy 1, policy_version 1828156 (0.0005) [2023-12-28 08:22:17,380][106226] Updated weights for policy 0, policy_version 1823922 (0.0009) [2023-12-28 08:22:17,428][106226] Updated weights for policy 0, policy_version 1823932 (0.0008) [2023-12-28 08:22:17,475][106226] Updated weights for policy 0, policy_version 1823942 (0.0007) [2023-12-28 08:22:17,610][106225] Updated weights for policy 1, policy_version 1828166 (0.0008) [2023-12-28 08:22:17,668][106225] Updated weights for policy 1, policy_version 1828176 (0.0010) [2023-12-28 08:22:17,728][106225] Updated weights for policy 1, policy_version 1828186 (0.0010) [2023-12-28 08:22:18,262][106226] Updated weights for policy 0, policy_version 1823952 (0.0009) [2023-12-28 08:22:18,310][106226] Updated weights for policy 0, policy_version 1823962 (0.0008) [2023-12-28 08:22:18,375][106226] Updated weights for policy 0, policy_version 1823972 (0.0008) [2023-12-28 08:22:18,435][106225] Updated weights for policy 1, policy_version 1828196 (0.0010) [2023-12-28 08:22:18,495][106225] Updated weights for policy 1, policy_version 1828206 (0.0009) [2023-12-28 08:22:18,554][106225] Updated weights for policy 1, policy_version 1828216 (0.0008) [2023-12-28 08:22:19,126][106226] Updated weights for policy 0, policy_version 1823982 (0.0007) [2023-12-28 08:22:19,184][106226] Updated weights for policy 0, policy_version 1823992 (0.0006) [2023-12-28 08:22:19,266][106226] Updated weights for policy 0, policy_version 1824002 (0.0008) [2023-12-28 08:22:19,302][106225] Updated weights for policy 1, policy_version 1828226 (0.0008) [2023-12-28 08:22:19,370][106225] Updated weights for policy 1, policy_version 1828236 (0.0008) [2023-12-28 08:22:19,434][106225] Updated weights for policy 1, policy_version 1828246 (0.0008) [2023-12-28 08:22:19,489][106225] Updated weights for policy 1, policy_version 1828256 (0.0008) [2023-12-28 08:22:19,942][106226] Updated weights for policy 0, policy_version 1824012 (0.0007) [2023-12-28 08:22:20,001][106226] Updated weights for policy 0, policy_version 1824022 (0.0008) [2023-12-28 08:22:20,072][106226] Updated weights for policy 0, policy_version 1824032 (0.0009) [2023-12-28 08:22:20,272][106225] Updated weights for policy 1, policy_version 1828266 (0.0006) [2023-12-28 08:22:20,323][106225] Updated weights for policy 1, policy_version 1828276 (0.0009) [2023-12-28 08:22:20,381][106225] Updated weights for policy 1, policy_version 1828286 (0.0008) [2023-12-28 08:22:20,703][106226] Updated weights for policy 0, policy_version 1824042 (0.0009) [2023-12-28 08:22:20,765][106226] Updated weights for policy 0, policy_version 1824052 (0.0009) [2023-12-28 08:22:20,829][106226] Updated weights for policy 0, policy_version 1824062 (0.0009) [2023-12-28 08:22:20,889][106226] Updated weights for policy 0, policy_version 1824072 (0.0008) [2023-12-28 08:22:21,095][106225] Updated weights for policy 1, policy_version 1828296 (0.0007) [2023-12-28 08:22:21,160][106225] Updated weights for policy 1, policy_version 1828306 (0.0008) [2023-12-28 08:22:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 935141376. Throughput: 0: 9859.3, 1: 9830.4. Samples: 935152552. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:21,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.655')] [2023-12-28 08:22:21,218][106225] Updated weights for policy 1, policy_version 1828316 (0.0007) [2023-12-28 08:22:21,721][106226] Updated weights for policy 0, policy_version 1824082 (0.0009) [2023-12-28 08:22:21,792][106226] Updated weights for policy 0, policy_version 1824092 (0.0009) [2023-12-28 08:22:21,861][106226] Updated weights for policy 0, policy_version 1824102 (0.0008) [2023-12-28 08:22:21,947][106225] Updated weights for policy 1, policy_version 1828326 (0.0007) [2023-12-28 08:22:22,015][106225] Updated weights for policy 1, policy_version 1828336 (0.0009) [2023-12-28 08:22:22,073][106225] Updated weights for policy 1, policy_version 1828346 (0.0008) [2023-12-28 08:22:22,570][106226] Updated weights for policy 0, policy_version 1824112 (0.0008) [2023-12-28 08:22:22,625][106226] Updated weights for policy 0, policy_version 1824122 (0.0011) [2023-12-28 08:22:22,684][106226] Updated weights for policy 0, policy_version 1824132 (0.0011) [2023-12-28 08:22:22,739][106225] Updated weights for policy 1, policy_version 1828356 (0.0008) [2023-12-28 08:22:22,800][106225] Updated weights for policy 1, policy_version 1828366 (0.0006) [2023-12-28 08:22:22,860][106225] Updated weights for policy 1, policy_version 1828376 (0.0007) [2023-12-28 08:22:23,454][106226] Updated weights for policy 0, policy_version 1824142 (0.0007) [2023-12-28 08:22:23,459][106225] Updated weights for policy 1, policy_version 1828386 (0.0010) [2023-12-28 08:22:23,514][106225] Updated weights for policy 1, policy_version 1828396 (0.0009) [2023-12-28 08:22:23,517][106226] Updated weights for policy 0, policy_version 1824152 (0.0006) [2023-12-28 08:22:23,569][106226] Updated weights for policy 0, policy_version 1824162 (0.0007) [2023-12-28 08:22:23,570][106225] Updated weights for policy 1, policy_version 1828406 (0.0008) [2023-12-28 08:22:23,627][106225] Updated weights for policy 1, policy_version 1828416 (0.0008) [2023-12-28 08:22:24,120][106226] Updated weights for policy 0, policy_version 1824172 (0.0005) [2023-12-28 08:22:24,184][106226] Updated weights for policy 0, policy_version 1824182 (0.0005) [2023-12-28 08:22:24,242][106226] Updated weights for policy 0, policy_version 1824192 (0.0008) [2023-12-28 08:22:24,489][106225] Updated weights for policy 1, policy_version 1828426 (0.0008) [2023-12-28 08:22:24,538][106225] Updated weights for policy 1, policy_version 1828436 (0.0007) [2023-12-28 08:22:24,582][106225] Updated weights for policy 1, policy_version 1828446 (0.0009) [2023-12-28 08:22:24,849][106226] Updated weights for policy 0, policy_version 1824202 (0.0007) [2023-12-28 08:22:24,906][106226] Updated weights for policy 0, policy_version 1824212 (0.0009) [2023-12-28 08:22:24,960][106226] Updated weights for policy 0, policy_version 1824222 (0.0008) [2023-12-28 08:22:25,012][106226] Updated weights for policy 0, policy_version 1824232 (0.0009) [2023-12-28 08:22:25,339][106225] Updated weights for policy 1, policy_version 1828456 (0.0008) [2023-12-28 08:22:25,397][106225] Updated weights for policy 1, policy_version 1828466 (0.0008) [2023-12-28 08:22:25,457][106225] Updated weights for policy 1, policy_version 1828476 (0.0008) [2023-12-28 08:22:25,744][106226] Updated weights for policy 0, policy_version 1824242 (0.0009) [2023-12-28 08:22:25,791][106226] Updated weights for policy 0, policy_version 1824252 (0.0007) [2023-12-28 08:22:25,847][106226] Updated weights for policy 0, policy_version 1824262 (0.0008) [2023-12-28 08:22:26,169][106225] Updated weights for policy 1, policy_version 1828486 (0.0007) [2023-12-28 08:22:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 935239680. Throughput: 0: 9837.9, 1: 9832.9. Samples: 935212164. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:26,176][105115] Avg episode reward: [(0, '-4.304'), (1, '-4.766')] [2023-12-28 08:22:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001824264_467091456.pth... [2023-12-28 08:22:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001823112_466796544.pth [2023-12-28 08:22:26,226][106225] Updated weights for policy 1, policy_version 1828496 (0.0005) [2023-12-28 08:22:26,286][106225] Updated weights for policy 1, policy_version 1828506 (0.0008) [2023-12-28 08:22:26,319][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001828512_468156416.pth... [2023-12-28 08:22:26,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001827360_467861504.pth [2023-12-28 08:22:26,453][106226] Updated weights for policy 0, policy_version 1824272 (0.0007) [2023-12-28 08:22:26,509][106226] Updated weights for policy 0, policy_version 1824282 (0.0009) [2023-12-28 08:22:26,571][106226] Updated weights for policy 0, policy_version 1824292 (0.0008) [2023-12-28 08:22:26,968][106225] Updated weights for policy 1, policy_version 1828516 (0.0008) [2023-12-28 08:22:27,018][106225] Updated weights for policy 1, policy_version 1828526 (0.0009) [2023-12-28 08:22:27,067][106225] Updated weights for policy 1, policy_version 1828537 (0.0008) [2023-12-28 08:22:27,108][106226] Updated weights for policy 0, policy_version 1824302 (0.0007) [2023-12-28 08:22:27,153][106226] Updated weights for policy 0, policy_version 1824312 (0.0005) [2023-12-28 08:22:27,217][106226] Updated weights for policy 0, policy_version 1824322 (0.0007) [2023-12-28 08:22:27,804][106226] Updated weights for policy 0, policy_version 1824332 (0.0009) [2023-12-28 08:22:27,864][106226] Updated weights for policy 0, policy_version 1824342 (0.0009) [2023-12-28 08:22:27,889][106225] Updated weights for policy 1, policy_version 1828547 (0.0007) [2023-12-28 08:22:27,921][106226] Updated weights for policy 0, policy_version 1824352 (0.0008) [2023-12-28 08:22:27,949][106225] Updated weights for policy 1, policy_version 1828557 (0.0007) [2023-12-28 08:22:28,007][106225] Updated weights for policy 1, policy_version 1828567 (0.0007) [2023-12-28 08:22:28,619][106226] Updated weights for policy 0, policy_version 1824362 (0.0007) [2023-12-28 08:22:28,673][106226] Updated weights for policy 0, policy_version 1824372 (0.0010) [2023-12-28 08:22:28,727][106226] Updated weights for policy 0, policy_version 1824382 (0.0010) [2023-12-28 08:22:28,739][106225] Updated weights for policy 1, policy_version 1828577 (0.0009) [2023-12-28 08:22:28,781][106226] Updated weights for policy 0, policy_version 1824392 (0.0010) [2023-12-28 08:22:28,787][106225] Updated weights for policy 1, policy_version 1828587 (0.0006) [2023-12-28 08:22:28,834][106225] Updated weights for policy 1, policy_version 1828597 (0.0008) [2023-12-28 08:22:28,886][106225] Updated weights for policy 1, policy_version 1828607 (0.0008) [2023-12-28 08:22:29,501][106226] Updated weights for policy 0, policy_version 1824402 (0.0011) [2023-12-28 08:22:29,561][106226] Updated weights for policy 0, policy_version 1824412 (0.0010) [2023-12-28 08:22:29,618][106226] Updated weights for policy 0, policy_version 1824422 (0.0011) [2023-12-28 08:22:29,669][106225] Updated weights for policy 1, policy_version 1828617 (0.0010) [2023-12-28 08:22:29,719][106225] Updated weights for policy 1, policy_version 1828627 (0.0010) [2023-12-28 08:22:29,769][106225] Updated weights for policy 1, policy_version 1828637 (0.0010) [2023-12-28 08:22:30,337][106226] Updated weights for policy 0, policy_version 1824432 (0.0011) [2023-12-28 08:22:30,391][106226] Updated weights for policy 0, policy_version 1824442 (0.0010) [2023-12-28 08:22:30,441][106226] Updated weights for policy 0, policy_version 1824452 (0.0010) [2023-12-28 08:22:30,457][106225] Updated weights for policy 1, policy_version 1828647 (0.0010) [2023-12-28 08:22:30,516][106225] Updated weights for policy 1, policy_version 1828657 (0.0010) [2023-12-28 08:22:30,571][106225] Updated weights for policy 1, policy_version 1828667 (0.0010) [2023-12-28 08:22:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 935337984. Throughput: 0: 9993.2, 1: 9781.2. Samples: 935331584. Policy #0 lag: (min: 13.0, avg: 22.9, max: 45.0) [2023-12-28 08:22:31,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.847')] [2023-12-28 08:22:31,186][106226] Updated weights for policy 0, policy_version 1824462 (0.0009) [2023-12-28 08:22:31,248][106226] Updated weights for policy 0, policy_version 1824472 (0.0008) [2023-12-28 08:22:31,304][106225] Updated weights for policy 1, policy_version 1828677 (0.0010) [2023-12-28 08:22:31,309][106226] Updated weights for policy 0, policy_version 1824482 (0.0008) [2023-12-28 08:22:31,375][106225] Updated weights for policy 1, policy_version 1828687 (0.0011) [2023-12-28 08:22:31,434][106225] Updated weights for policy 1, policy_version 1828697 (0.0008) [2023-12-28 08:22:32,080][106225] Updated weights for policy 1, policy_version 1828707 (0.0007) [2023-12-28 08:22:32,081][106226] Updated weights for policy 0, policy_version 1824492 (0.0008) [2023-12-28 08:22:32,144][106225] Updated weights for policy 1, policy_version 1828717 (0.0005) [2023-12-28 08:22:32,144][106226] Updated weights for policy 0, policy_version 1824502 (0.0008) [2023-12-28 08:22:32,202][106225] Updated weights for policy 1, policy_version 1828727 (0.0006) [2023-12-28 08:22:32,207][106226] Updated weights for policy 0, policy_version 1824512 (0.0008) [2023-12-28 08:22:32,870][106226] Updated weights for policy 0, policy_version 1824522 (0.0008) [2023-12-28 08:22:32,919][106226] Updated weights for policy 0, policy_version 1824532 (0.0005) [2023-12-28 08:22:32,956][106225] Updated weights for policy 1, policy_version 1828737 (0.0007) [2023-12-28 08:22:32,975][106226] Updated weights for policy 0, policy_version 1824542 (0.0005) [2023-12-28 08:22:33,019][106225] Updated weights for policy 1, policy_version 1828747 (0.0008) [2023-12-28 08:22:33,033][106226] Updated weights for policy 0, policy_version 1824552 (0.0005) [2023-12-28 08:22:33,077][106225] Updated weights for policy 1, policy_version 1828757 (0.0009) [2023-12-28 08:22:33,135][106225] Updated weights for policy 1, policy_version 1828767 (0.0008) [2023-12-28 08:22:33,673][106226] Updated weights for policy 0, policy_version 1824562 (0.0008) [2023-12-28 08:22:33,722][106226] Updated weights for policy 0, policy_version 1824572 (0.0008) [2023-12-28 08:22:33,766][106226] Updated weights for policy 0, policy_version 1824582 (0.0008) [2023-12-28 08:22:33,847][106225] Updated weights for policy 1, policy_version 1828777 (0.0008) [2023-12-28 08:22:33,890][106225] Updated weights for policy 1, policy_version 1828787 (0.0006) [2023-12-28 08:22:33,942][106225] Updated weights for policy 1, policy_version 1828797 (0.0008) [2023-12-28 08:22:34,418][106226] Updated weights for policy 0, policy_version 1824592 (0.0008) [2023-12-28 08:22:34,485][106226] Updated weights for policy 0, policy_version 1824602 (0.0009) [2023-12-28 08:22:34,551][106226] Updated weights for policy 0, policy_version 1824612 (0.0009) [2023-12-28 08:22:34,685][106225] Updated weights for policy 1, policy_version 1828807 (0.0008) [2023-12-28 08:22:34,744][106225] Updated weights for policy 1, policy_version 1828817 (0.0009) [2023-12-28 08:22:34,795][106225] Updated weights for policy 1, policy_version 1828827 (0.0008) [2023-12-28 08:22:35,169][106226] Updated weights for policy 0, policy_version 1824622 (0.0006) [2023-12-28 08:22:35,219][106226] Updated weights for policy 0, policy_version 1824632 (0.0005) [2023-12-28 08:22:35,268][106226] Updated weights for policy 0, policy_version 1824642 (0.0005) [2023-12-28 08:22:35,482][106225] Updated weights for policy 1, policy_version 1828837 (0.0007) [2023-12-28 08:22:35,532][106225] Updated weights for policy 1, policy_version 1828847 (0.0006) [2023-12-28 08:22:35,580][106225] Updated weights for policy 1, policy_version 1828857 (0.0008) [2023-12-28 08:22:35,901][106226] Updated weights for policy 0, policy_version 1824652 (0.0007) [2023-12-28 08:22:35,951][106226] Updated weights for policy 0, policy_version 1824662 (0.0009) [2023-12-28 08:22:36,000][106226] Updated weights for policy 0, policy_version 1824672 (0.0008) [2023-12-28 08:22:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 935444480. Throughput: 0: 9998.1, 1: 9708.4. Samples: 935451872. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:22:36,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.570')] [2023-12-28 08:22:36,274][106225] Updated weights for policy 1, policy_version 1828867 (0.0009) [2023-12-28 08:22:36,327][106225] Updated weights for policy 1, policy_version 1828877 (0.0008) [2023-12-28 08:22:36,379][106225] Updated weights for policy 1, policy_version 1828887 (0.0007) [2023-12-28 08:22:36,751][106226] Updated weights for policy 0, policy_version 1824682 (0.0009) [2023-12-28 08:22:36,812][106226] Updated weights for policy 0, policy_version 1824692 (0.0010) [2023-12-28 08:22:36,867][106226] Updated weights for policy 0, policy_version 1824702 (0.0006) [2023-12-28 08:22:36,934][106226] Updated weights for policy 0, policy_version 1824712 (0.0008) [2023-12-28 08:22:37,176][106225] Updated weights for policy 1, policy_version 1828897 (0.0007) [2023-12-28 08:22:37,233][106225] Updated weights for policy 1, policy_version 1828907 (0.0005) [2023-12-28 08:22:37,296][106225] Updated weights for policy 1, policy_version 1828917 (0.0008) [2023-12-28 08:22:37,349][106225] Updated weights for policy 1, policy_version 1828927 (0.0008) [2023-12-28 08:22:37,659][106226] Updated weights for policy 0, policy_version 1824722 (0.0009) [2023-12-28 08:22:37,717][106226] Updated weights for policy 0, policy_version 1824732 (0.0007) [2023-12-28 08:22:37,765][106226] Updated weights for policy 0, policy_version 1824742 (0.0008) [2023-12-28 08:22:37,973][106225] Updated weights for policy 1, policy_version 1828937 (0.0006) [2023-12-28 08:22:38,029][106225] Updated weights for policy 1, policy_version 1828947 (0.0007) [2023-12-28 08:22:38,087][106225] Updated weights for policy 1, policy_version 1828957 (0.0006) [2023-12-28 08:22:38,495][106226] Updated weights for policy 0, policy_version 1824752 (0.0010) [2023-12-28 08:22:38,559][106226] Updated weights for policy 0, policy_version 1824762 (0.0011) [2023-12-28 08:22:38,616][106226] Updated weights for policy 0, policy_version 1824772 (0.0010) [2023-12-28 08:22:38,744][106225] Updated weights for policy 1, policy_version 1828967 (0.0006) [2023-12-28 08:22:38,805][106225] Updated weights for policy 1, policy_version 1828977 (0.0007) [2023-12-28 08:22:38,863][106225] Updated weights for policy 1, policy_version 1828987 (0.0007) [2023-12-28 08:22:39,334][106226] Updated weights for policy 0, policy_version 1824782 (0.0009) [2023-12-28 08:22:39,413][106226] Updated weights for policy 0, policy_version 1824792 (0.0008) [2023-12-28 08:22:39,480][106226] Updated weights for policy 0, policy_version 1824802 (0.0009) [2023-12-28 08:22:39,598][106225] Updated weights for policy 1, policy_version 1828997 (0.0007) [2023-12-28 08:22:39,661][106225] Updated weights for policy 1, policy_version 1829007 (0.0008) [2023-12-28 08:22:39,725][106225] Updated weights for policy 1, policy_version 1829017 (0.0009) [2023-12-28 08:22:40,228][106226] Updated weights for policy 0, policy_version 1824812 (0.0008) [2023-12-28 08:22:40,280][106226] Updated weights for policy 0, policy_version 1824822 (0.0008) [2023-12-28 08:22:40,333][106226] Updated weights for policy 0, policy_version 1824832 (0.0008) [2023-12-28 08:22:40,458][106225] Updated weights for policy 1, policy_version 1829027 (0.0009) [2023-12-28 08:22:40,520][106225] Updated weights for policy 1, policy_version 1829037 (0.0008) [2023-12-28 08:22:40,570][106225] Updated weights for policy 1, policy_version 1829047 (0.0009) [2023-12-28 08:22:41,099][106226] Updated weights for policy 0, policy_version 1824842 (0.0009) [2023-12-28 08:22:41,168][106226] Updated weights for policy 0, policy_version 1824852 (0.0008) [2023-12-28 08:22:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 935534592. Throughput: 0: 10018.4, 1: 9758.3. Samples: 935510992. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:22:41,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.532')] [2023-12-28 08:22:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001829056_468295680.pth... [2023-12-28 08:22:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001827936_468008960.pth [2023-12-28 08:22:41,232][106226] Updated weights for policy 0, policy_version 1824862 (0.0009) [2023-12-28 08:22:41,292][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001824872_467247104.pth... [2023-12-28 08:22:41,293][106226] Updated weights for policy 0, policy_version 1824872 (0.0008) [2023-12-28 08:22:41,298][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001823688_466944000.pth [2023-12-28 08:22:41,344][106225] Updated weights for policy 1, policy_version 1829057 (0.0011) [2023-12-28 08:22:41,415][106225] Updated weights for policy 1, policy_version 1829067 (0.0008) [2023-12-28 08:22:41,481][106225] Updated weights for policy 1, policy_version 1829077 (0.0008) [2023-12-28 08:22:41,541][106225] Updated weights for policy 1, policy_version 1829087 (0.0008) [2023-12-28 08:22:42,119][106226] Updated weights for policy 0, policy_version 1824882 (0.0006) [2023-12-28 08:22:42,183][106226] Updated weights for policy 0, policy_version 1824892 (0.0006) [2023-12-28 08:22:42,249][106226] Updated weights for policy 0, policy_version 1824902 (0.0010) [2023-12-28 08:22:42,288][106225] Updated weights for policy 1, policy_version 1829097 (0.0009) [2023-12-28 08:22:42,352][106225] Updated weights for policy 1, policy_version 1829107 (0.0009) [2023-12-28 08:22:42,406][106225] Updated weights for policy 1, policy_version 1829117 (0.0010) [2023-12-28 08:22:42,905][106226] Updated weights for policy 0, policy_version 1824912 (0.0010) [2023-12-28 08:22:42,977][106226] Updated weights for policy 0, policy_version 1824922 (0.0008) [2023-12-28 08:22:43,043][106226] Updated weights for policy 0, policy_version 1824932 (0.0010) [2023-12-28 08:22:43,078][106225] Updated weights for policy 1, policy_version 1829127 (0.0008) [2023-12-28 08:22:43,132][106225] Updated weights for policy 1, policy_version 1829137 (0.0010) [2023-12-28 08:22:43,189][106225] Updated weights for policy 1, policy_version 1829147 (0.0009) [2023-12-28 08:22:43,639][106226] Updated weights for policy 0, policy_version 1824942 (0.0010) [2023-12-28 08:22:43,690][106226] Updated weights for policy 0, policy_version 1824952 (0.0009) [2023-12-28 08:22:43,751][106226] Updated weights for policy 0, policy_version 1824962 (0.0009) [2023-12-28 08:22:43,842][106225] Updated weights for policy 1, policy_version 1829157 (0.0008) [2023-12-28 08:22:43,907][106225] Updated weights for policy 1, policy_version 1829167 (0.0008) [2023-12-28 08:22:43,970][106225] Updated weights for policy 1, policy_version 1829177 (0.0005) [2023-12-28 08:22:44,423][106226] Updated weights for policy 0, policy_version 1824972 (0.0007) [2023-12-28 08:22:44,476][106226] Updated weights for policy 0, policy_version 1824982 (0.0008) [2023-12-28 08:22:44,534][106226] Updated weights for policy 0, policy_version 1824992 (0.0010) [2023-12-28 08:22:44,668][106225] Updated weights for policy 1, policy_version 1829187 (0.0008) [2023-12-28 08:22:44,723][106225] Updated weights for policy 1, policy_version 1829197 (0.0008) [2023-12-28 08:22:44,788][106225] Updated weights for policy 1, policy_version 1829207 (0.0008) [2023-12-28 08:22:45,278][106226] Updated weights for policy 0, policy_version 1825002 (0.0010) [2023-12-28 08:22:45,337][106226] Updated weights for policy 0, policy_version 1825012 (0.0011) [2023-12-28 08:22:45,384][106226] Updated weights for policy 0, policy_version 1825022 (0.0010) [2023-12-28 08:22:45,437][106226] Updated weights for policy 0, policy_version 1825032 (0.0010) [2023-12-28 08:22:45,526][106225] Updated weights for policy 1, policy_version 1829217 (0.0007) [2023-12-28 08:22:45,585][106225] Updated weights for policy 1, policy_version 1829227 (0.0005) [2023-12-28 08:22:45,645][106225] Updated weights for policy 1, policy_version 1829237 (0.0005) [2023-12-28 08:22:45,699][106225] Updated weights for policy 1, policy_version 1829247 (0.0007) [2023-12-28 08:22:46,155][106226] Updated weights for policy 0, policy_version 1825042 (0.0010) [2023-12-28 08:22:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 935632896. Throughput: 0: 10003.9, 1: 9667.0. Samples: 935626888. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:22:46,175][105115] Avg episode reward: [(0, '-4.558'), (1, '-4.892')] [2023-12-28 08:22:46,216][106226] Updated weights for policy 0, policy_version 1825052 (0.0008) [2023-12-28 08:22:46,282][106226] Updated weights for policy 0, policy_version 1825062 (0.0005) [2023-12-28 08:22:46,380][106225] Updated weights for policy 1, policy_version 1829257 (0.0008) [2023-12-28 08:22:46,425][106225] Updated weights for policy 1, policy_version 1829267 (0.0008) [2023-12-28 08:22:46,477][106225] Updated weights for policy 1, policy_version 1829277 (0.0008) [2023-12-28 08:22:46,936][106226] Updated weights for policy 0, policy_version 1825072 (0.0008) [2023-12-28 08:22:46,996][106226] Updated weights for policy 0, policy_version 1825082 (0.0009) [2023-12-28 08:22:47,052][106226] Updated weights for policy 0, policy_version 1825092 (0.0007) [2023-12-28 08:22:47,216][106225] Updated weights for policy 1, policy_version 1829287 (0.0007) [2023-12-28 08:22:47,273][106225] Updated weights for policy 1, policy_version 1829297 (0.0005) [2023-12-28 08:22:47,322][106225] Updated weights for policy 1, policy_version 1829307 (0.0005) [2023-12-28 08:22:47,642][106226] Updated weights for policy 0, policy_version 1825102 (0.0007) [2023-12-28 08:22:47,701][106226] Updated weights for policy 0, policy_version 1825112 (0.0009) [2023-12-28 08:22:47,762][106226] Updated weights for policy 0, policy_version 1825122 (0.0006) [2023-12-28 08:22:48,009][106225] Updated weights for policy 1, policy_version 1829317 (0.0008) [2023-12-28 08:22:48,068][106225] Updated weights for policy 1, policy_version 1829327 (0.0007) [2023-12-28 08:22:48,124][106225] Updated weights for policy 1, policy_version 1829337 (0.0010) [2023-12-28 08:22:48,394][106226] Updated weights for policy 0, policy_version 1825132 (0.0007) [2023-12-28 08:22:48,457][106226] Updated weights for policy 0, policy_version 1825142 (0.0006) [2023-12-28 08:22:48,516][106226] Updated weights for policy 0, policy_version 1825152 (0.0005) [2023-12-28 08:22:48,939][106225] Updated weights for policy 1, policy_version 1829347 (0.0008) [2023-12-28 08:22:49,002][106225] Updated weights for policy 1, policy_version 1829357 (0.0008) [2023-12-28 08:22:49,065][106225] Updated weights for policy 1, policy_version 1829367 (0.0008) [2023-12-28 08:22:49,107][106226] Updated weights for policy 0, policy_version 1825162 (0.0006) [2023-12-28 08:22:49,159][106226] Updated weights for policy 0, policy_version 1825172 (0.0008) [2023-12-28 08:22:49,224][106226] Updated weights for policy 0, policy_version 1825182 (0.0010) [2023-12-28 08:22:49,291][106226] Updated weights for policy 0, policy_version 1825192 (0.0008) [2023-12-28 08:22:49,779][106225] Updated weights for policy 1, policy_version 1829377 (0.0006) [2023-12-28 08:22:49,840][106225] Updated weights for policy 1, policy_version 1829387 (0.0009) [2023-12-28 08:22:49,908][106225] Updated weights for policy 1, policy_version 1829397 (0.0008) [2023-12-28 08:22:49,951][106226] Updated weights for policy 0, policy_version 1825202 (0.0007) [2023-12-28 08:22:49,976][106225] Updated weights for policy 1, policy_version 1829407 (0.0007) [2023-12-28 08:22:50,015][106226] Updated weights for policy 0, policy_version 1825212 (0.0009) [2023-12-28 08:22:50,073][106226] Updated weights for policy 0, policy_version 1825222 (0.0009) [2023-12-28 08:22:50,751][106226] Updated weights for policy 0, policy_version 1825232 (0.0008) [2023-12-28 08:22:50,768][106225] Updated weights for policy 1, policy_version 1829417 (0.0007) [2023-12-28 08:22:50,813][106226] Updated weights for policy 0, policy_version 1825242 (0.0010) [2023-12-28 08:22:50,830][106225] Updated weights for policy 1, policy_version 1829427 (0.0009) [2023-12-28 08:22:50,873][106226] Updated weights for policy 0, policy_version 1825252 (0.0006) [2023-12-28 08:22:50,894][106225] Updated weights for policy 1, policy_version 1829437 (0.0010) [2023-12-28 08:22:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 935739392. Throughput: 0: 10053.7, 1: 9626.8. Samples: 935746024. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:22:51,175][105115] Avg episode reward: [(0, '-4.557'), (1, '-4.625')] [2023-12-28 08:22:51,647][106225] Updated weights for policy 1, policy_version 1829447 (0.0010) [2023-12-28 08:22:51,648][106226] Updated weights for policy 0, policy_version 1825262 (0.0011) [2023-12-28 08:22:51,710][106225] Updated weights for policy 1, policy_version 1829457 (0.0008) [2023-12-28 08:22:51,715][106226] Updated weights for policy 0, policy_version 1825272 (0.0010) [2023-12-28 08:22:51,777][106225] Updated weights for policy 1, policy_version 1829467 (0.0006) [2023-12-28 08:22:51,780][106226] Updated weights for policy 0, policy_version 1825282 (0.0008) [2023-12-28 08:22:52,396][106225] Updated weights for policy 1, policy_version 1829477 (0.0007) [2023-12-28 08:22:52,459][106225] Updated weights for policy 1, policy_version 1829487 (0.0008) [2023-12-28 08:22:52,518][106225] Updated weights for policy 1, policy_version 1829497 (0.0008) [2023-12-28 08:22:52,574][106226] Updated weights for policy 0, policy_version 1825292 (0.0009) [2023-12-28 08:22:52,630][106226] Updated weights for policy 0, policy_version 1825302 (0.0009) [2023-12-28 08:22:52,684][106226] Updated weights for policy 0, policy_version 1825312 (0.0009) [2023-12-28 08:22:53,244][106225] Updated weights for policy 1, policy_version 1829507 (0.0008) [2023-12-28 08:22:53,296][106225] Updated weights for policy 1, policy_version 1829517 (0.0008) [2023-12-28 08:22:53,354][106225] Updated weights for policy 1, policy_version 1829527 (0.0009) [2023-12-28 08:22:53,403][106226] Updated weights for policy 0, policy_version 1825322 (0.0008) [2023-12-28 08:22:53,452][106226] Updated weights for policy 0, policy_version 1825332 (0.0006) [2023-12-28 08:22:53,518][106226] Updated weights for policy 0, policy_version 1825342 (0.0009) [2023-12-28 08:22:53,572][106226] Updated weights for policy 0, policy_version 1825352 (0.0007) [2023-12-28 08:22:54,101][106225] Updated weights for policy 1, policy_version 1829537 (0.0009) [2023-12-28 08:22:54,158][106225] Updated weights for policy 1, policy_version 1829547 (0.0007) [2023-12-28 08:22:54,208][106225] Updated weights for policy 1, policy_version 1829557 (0.0007) [2023-12-28 08:22:54,229][106226] Updated weights for policy 0, policy_version 1825362 (0.0011) [2023-12-28 08:22:54,259][106225] Updated weights for policy 1, policy_version 1829567 (0.0007) [2023-12-28 08:22:54,292][106226] Updated weights for policy 0, policy_version 1825372 (0.0011) [2023-12-28 08:22:54,352][106226] Updated weights for policy 0, policy_version 1825382 (0.0010) [2023-12-28 08:22:54,899][106225] Updated weights for policy 1, policy_version 1829577 (0.0006) [2023-12-28 08:22:54,963][106225] Updated weights for policy 1, policy_version 1829587 (0.0005) [2023-12-28 08:22:55,020][106225] Updated weights for policy 1, policy_version 1829597 (0.0009) [2023-12-28 08:22:55,039][106226] Updated weights for policy 0, policy_version 1825392 (0.0011) [2023-12-28 08:22:55,085][106226] Updated weights for policy 0, policy_version 1825402 (0.0009) [2023-12-28 08:22:55,145][106226] Updated weights for policy 0, policy_version 1825412 (0.0006) [2023-12-28 08:22:55,648][106225] Updated weights for policy 1, policy_version 1829607 (0.0010) [2023-12-28 08:22:55,710][106225] Updated weights for policy 1, policy_version 1829617 (0.0006) [2023-12-28 08:22:55,760][106225] Updated weights for policy 1, policy_version 1829627 (0.0005) [2023-12-28 08:22:55,791][106226] Updated weights for policy 0, policy_version 1825422 (0.0008) [2023-12-28 08:22:55,837][106226] Updated weights for policy 0, policy_version 1825432 (0.0010) [2023-12-28 08:22:55,893][106226] Updated weights for policy 0, policy_version 1825442 (0.0010) [2023-12-28 08:22:56,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 935837696. Throughput: 0: 10005.8, 1: 9620.2. Samples: 935803556. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:22:56,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-4.842')] [2023-12-28 08:22:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001825448_467394560.pth... [2023-12-28 08:22:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001829632_468443136.pth... [2023-12-28 08:22:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001824264_467091456.pth [2023-12-28 08:22:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001828512_468156416.pth [2023-12-28 08:22:56,412][106225] Updated weights for policy 1, policy_version 1829637 (0.0010) [2023-12-28 08:22:56,472][106225] Updated weights for policy 1, policy_version 1829647 (0.0010) [2023-12-28 08:22:56,532][106225] Updated weights for policy 1, policy_version 1829657 (0.0010) [2023-12-28 08:22:56,540][106226] Updated weights for policy 0, policy_version 1825452 (0.0010) [2023-12-28 08:22:56,600][106226] Updated weights for policy 0, policy_version 1825462 (0.0011) [2023-12-28 08:22:56,659][106226] Updated weights for policy 0, policy_version 1825472 (0.0011) [2023-12-28 08:22:57,193][106225] Updated weights for policy 1, policy_version 1829667 (0.0010) [2023-12-28 08:22:57,242][106225] Updated weights for policy 1, policy_version 1829677 (0.0010) [2023-12-28 08:22:57,295][106225] Updated weights for policy 1, policy_version 1829687 (0.0010) [2023-12-28 08:22:57,355][106226] Updated weights for policy 0, policy_version 1825482 (0.0010) [2023-12-28 08:22:57,413][106226] Updated weights for policy 0, policy_version 1825492 (0.0006) [2023-12-28 08:22:57,467][106226] Updated weights for policy 0, policy_version 1825502 (0.0005) [2023-12-28 08:22:57,529][106226] Updated weights for policy 0, policy_version 1825512 (0.0005) [2023-12-28 08:22:58,014][106225] Updated weights for policy 1, policy_version 1829697 (0.0010) [2023-12-28 08:22:58,066][106225] Updated weights for policy 1, policy_version 1829707 (0.0010) [2023-12-28 08:22:58,106][106226] Updated weights for policy 0, policy_version 1825522 (0.0010) [2023-12-28 08:22:58,125][106225] Updated weights for policy 1, policy_version 1829717 (0.0010) [2023-12-28 08:22:58,165][106226] Updated weights for policy 0, policy_version 1825532 (0.0010) [2023-12-28 08:22:58,191][106225] Updated weights for policy 1, policy_version 1829727 (0.0009) [2023-12-28 08:22:58,234][106226] Updated weights for policy 0, policy_version 1825542 (0.0010) [2023-12-28 08:22:58,996][106225] Updated weights for policy 1, policy_version 1829737 (0.0008) [2023-12-28 08:22:59,056][106225] Updated weights for policy 1, policy_version 1829747 (0.0006) [2023-12-28 08:22:59,123][106225] Updated weights for policy 1, policy_version 1829757 (0.0008) [2023-12-28 08:22:59,137][106226] Updated weights for policy 0, policy_version 1825552 (0.0007) [2023-12-28 08:22:59,198][106226] Updated weights for policy 0, policy_version 1825562 (0.0008) [2023-12-28 08:22:59,270][106226] Updated weights for policy 0, policy_version 1825572 (0.0008) [2023-12-28 08:22:59,842][106225] Updated weights for policy 1, policy_version 1829767 (0.0008) [2023-12-28 08:22:59,900][106225] Updated weights for policy 1, policy_version 1829777 (0.0010) [2023-12-28 08:22:59,966][106225] Updated weights for policy 1, policy_version 1829787 (0.0008) [2023-12-28 08:22:59,998][106226] Updated weights for policy 0, policy_version 1825582 (0.0010) [2023-12-28 08:23:00,064][106226] Updated weights for policy 0, policy_version 1825592 (0.0009) [2023-12-28 08:23:00,129][106226] Updated weights for policy 0, policy_version 1825602 (0.0008) [2023-12-28 08:23:00,693][106225] Updated weights for policy 1, policy_version 1829797 (0.0009) [2023-12-28 08:23:00,735][106225] Updated weights for policy 1, policy_version 1829807 (0.0010) [2023-12-28 08:23:00,785][106225] Updated weights for policy 1, policy_version 1829817 (0.0010) [2023-12-28 08:23:00,821][106226] Updated weights for policy 0, policy_version 1825612 (0.0009) [2023-12-28 08:23:00,867][106226] Updated weights for policy 0, policy_version 1825622 (0.0010) [2023-12-28 08:23:00,912][106226] Updated weights for policy 0, policy_version 1825632 (0.0010) [2023-12-28 08:23:01,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 935936000. Throughput: 0: 9967.2, 1: 9743.0. Samples: 935923048. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:01,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.860')] [2023-12-28 08:23:01,548][106225] Updated weights for policy 1, policy_version 1829827 (0.0009) [2023-12-28 08:23:01,609][106225] Updated weights for policy 1, policy_version 1829837 (0.0009) [2023-12-28 08:23:01,665][106226] Updated weights for policy 0, policy_version 1825642 (0.0009) [2023-12-28 08:23:01,672][106225] Updated weights for policy 1, policy_version 1829847 (0.0009) [2023-12-28 08:23:01,718][106226] Updated weights for policy 0, policy_version 1825652 (0.0006) [2023-12-28 08:23:01,787][106226] Updated weights for policy 0, policy_version 1825662 (0.0008) [2023-12-28 08:23:01,851][106226] Updated weights for policy 0, policy_version 1825672 (0.0011) [2023-12-28 08:23:02,452][106225] Updated weights for policy 1, policy_version 1829857 (0.0010) [2023-12-28 08:23:02,506][106225] Updated weights for policy 1, policy_version 1829867 (0.0010) [2023-12-28 08:23:02,548][106226] Updated weights for policy 0, policy_version 1825682 (0.0009) [2023-12-28 08:23:02,563][106225] Updated weights for policy 1, policy_version 1829877 (0.0010) [2023-12-28 08:23:02,611][106226] Updated weights for policy 0, policy_version 1825692 (0.0006) [2023-12-28 08:23:02,623][106225] Updated weights for policy 1, policy_version 1829887 (0.0009) [2023-12-28 08:23:02,660][106226] Updated weights for policy 0, policy_version 1825702 (0.0009) [2023-12-28 08:23:03,226][106226] Updated weights for policy 0, policy_version 1825712 (0.0006) [2023-12-28 08:23:03,281][106226] Updated weights for policy 0, policy_version 1825722 (0.0010) [2023-12-28 08:23:03,314][106225] Updated weights for policy 1, policy_version 1829897 (0.0005) [2023-12-28 08:23:03,335][106226] Updated weights for policy 0, policy_version 1825732 (0.0009) [2023-12-28 08:23:03,363][106225] Updated weights for policy 1, policy_version 1829907 (0.0007) [2023-12-28 08:23:03,415][106225] Updated weights for policy 1, policy_version 1829917 (0.0008) [2023-12-28 08:23:04,025][106226] Updated weights for policy 0, policy_version 1825742 (0.0008) [2023-12-28 08:23:04,031][106225] Updated weights for policy 1, policy_version 1829927 (0.0006) [2023-12-28 08:23:04,082][106225] Updated weights for policy 1, policy_version 1829937 (0.0006) [2023-12-28 08:23:04,084][106226] Updated weights for policy 0, policy_version 1825752 (0.0010) [2023-12-28 08:23:04,145][106226] Updated weights for policy 0, policy_version 1825762 (0.0011) [2023-12-28 08:23:04,146][106225] Updated weights for policy 1, policy_version 1829947 (0.0006) [2023-12-28 08:23:04,848][106226] Updated weights for policy 0, policy_version 1825772 (0.0010) [2023-12-28 08:23:04,870][106225] Updated weights for policy 1, policy_version 1829957 (0.0009) [2023-12-28 08:23:04,901][106226] Updated weights for policy 0, policy_version 1825782 (0.0010) [2023-12-28 08:23:04,917][106225] Updated weights for policy 1, policy_version 1829967 (0.0010) [2023-12-28 08:23:04,959][106226] Updated weights for policy 0, policy_version 1825792 (0.0010) [2023-12-28 08:23:04,964][106225] Updated weights for policy 1, policy_version 1829977 (0.0006) [2023-12-28 08:23:05,594][106226] Updated weights for policy 0, policy_version 1825802 (0.0009) [2023-12-28 08:23:05,660][106226] Updated weights for policy 0, policy_version 1825812 (0.0005) [2023-12-28 08:23:05,732][106226] Updated weights for policy 0, policy_version 1825822 (0.0005) [2023-12-28 08:23:05,764][106225] Updated weights for policy 1, policy_version 1829987 (0.0006) [2023-12-28 08:23:05,786][106226] Updated weights for policy 0, policy_version 1825832 (0.0005) [2023-12-28 08:23:05,820][106225] Updated weights for policy 1, policy_version 1829997 (0.0008) [2023-12-28 08:23:05,870][106225] Updated weights for policy 1, policy_version 1830007 (0.0009) [2023-12-28 08:23:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 936034304. Throughput: 0: 10080.1, 1: 9730.5. Samples: 936044028. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:06,175][105115] Avg episode reward: [(0, '-4.487'), (1, '-4.905')] [2023-12-28 08:23:06,300][106226] Updated weights for policy 0, policy_version 1825842 (0.0006) [2023-12-28 08:23:06,360][106226] Updated weights for policy 0, policy_version 1825852 (0.0008) [2023-12-28 08:23:06,432][106226] Updated weights for policy 0, policy_version 1825862 (0.0007) [2023-12-28 08:23:06,665][106225] Updated weights for policy 1, policy_version 1830017 (0.0009) [2023-12-28 08:23:06,730][106225] Updated weights for policy 1, policy_version 1830027 (0.0008) [2023-12-28 08:23:06,794][106225] Updated weights for policy 1, policy_version 1830037 (0.0007) [2023-12-28 08:23:06,862][106225] Updated weights for policy 1, policy_version 1830047 (0.0008) [2023-12-28 08:23:07,064][106226] Updated weights for policy 0, policy_version 1825872 (0.0009) [2023-12-28 08:23:07,123][106226] Updated weights for policy 0, policy_version 1825882 (0.0011) [2023-12-28 08:23:07,186][106226] Updated weights for policy 0, policy_version 1825892 (0.0011) [2023-12-28 08:23:07,636][106225] Updated weights for policy 1, policy_version 1830057 (0.0007) [2023-12-28 08:23:07,694][106225] Updated weights for policy 1, policy_version 1830067 (0.0010) [2023-12-28 08:23:07,747][106225] Updated weights for policy 1, policy_version 1830077 (0.0008) [2023-12-28 08:23:07,758][106226] Updated weights for policy 0, policy_version 1825902 (0.0007) [2023-12-28 08:23:07,816][106226] Updated weights for policy 0, policy_version 1825912 (0.0005) [2023-12-28 08:23:07,876][106226] Updated weights for policy 0, policy_version 1825922 (0.0005) [2023-12-28 08:23:08,449][106226] Updated weights for policy 0, policy_version 1825932 (0.0008) [2023-12-28 08:23:08,518][106226] Updated weights for policy 0, policy_version 1825942 (0.0008) [2023-12-28 08:23:08,583][106226] Updated weights for policy 0, policy_version 1825952 (0.0006) [2023-12-28 08:23:08,601][106225] Updated weights for policy 1, policy_version 1830087 (0.0008) [2023-12-28 08:23:08,664][106225] Updated weights for policy 1, policy_version 1830097 (0.0008) [2023-12-28 08:23:08,726][106225] Updated weights for policy 1, policy_version 1830107 (0.0007) [2023-12-28 08:23:09,291][106226] Updated weights for policy 0, policy_version 1825962 (0.0009) [2023-12-28 08:23:09,345][106226] Updated weights for policy 0, policy_version 1825972 (0.0009) [2023-12-28 08:23:09,420][106226] Updated weights for policy 0, policy_version 1825982 (0.0009) [2023-12-28 08:23:09,483][106226] Updated weights for policy 0, policy_version 1825992 (0.0009) [2023-12-28 08:23:09,506][106225] Updated weights for policy 1, policy_version 1830117 (0.0008) [2023-12-28 08:23:09,569][106225] Updated weights for policy 1, policy_version 1830127 (0.0008) [2023-12-28 08:23:09,627][106225] Updated weights for policy 1, policy_version 1830137 (0.0009) [2023-12-28 08:23:10,191][106226] Updated weights for policy 0, policy_version 1826002 (0.0008) [2023-12-28 08:23:10,253][106226] Updated weights for policy 0, policy_version 1826012 (0.0007) [2023-12-28 08:23:10,312][106226] Updated weights for policy 0, policy_version 1826022 (0.0007) [2023-12-28 08:23:10,466][106225] Updated weights for policy 1, policy_version 1830147 (0.0009) [2023-12-28 08:23:10,527][106225] Updated weights for policy 1, policy_version 1830157 (0.0008) [2023-12-28 08:23:10,576][106225] Updated weights for policy 1, policy_version 1830167 (0.0008) [2023-12-28 08:23:10,904][106226] Updated weights for policy 0, policy_version 1826032 (0.0009) [2023-12-28 08:23:10,962][106226] Updated weights for policy 0, policy_version 1826042 (0.0009) [2023-12-28 08:23:11,014][106226] Updated weights for policy 0, policy_version 1826052 (0.0008) [2023-12-28 08:23:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 936132608. Throughput: 0: 10149.9, 1: 9637.2. Samples: 936102580. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:11,175][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.658')] [2023-12-28 08:23:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001830176_468582400.pth... [2023-12-28 08:23:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001826056_467550208.pth... [2023-12-28 08:23:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001824872_467247104.pth [2023-12-28 08:23:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001829056_468295680.pth [2023-12-28 08:23:11,303][106225] Updated weights for policy 1, policy_version 1830178 (0.0008) [2023-12-28 08:23:11,377][106225] Updated weights for policy 1, policy_version 1830188 (0.0008) [2023-12-28 08:23:11,438][106225] Updated weights for policy 1, policy_version 1830198 (0.0009) [2023-12-28 08:23:11,505][106225] Updated weights for policy 1, policy_version 1830208 (0.0008) [2023-12-28 08:23:11,817][106226] Updated weights for policy 0, policy_version 1826062 (0.0008) [2023-12-28 08:23:11,884][106226] Updated weights for policy 0, policy_version 1826072 (0.0008) [2023-12-28 08:23:11,951][106226] Updated weights for policy 0, policy_version 1826082 (0.0008) [2023-12-28 08:23:12,295][106225] Updated weights for policy 1, policy_version 1830218 (0.0008) [2023-12-28 08:23:12,361][106225] Updated weights for policy 1, policy_version 1830228 (0.0009) [2023-12-28 08:23:12,428][106225] Updated weights for policy 1, policy_version 1830238 (0.0009) [2023-12-28 08:23:12,608][106226] Updated weights for policy 0, policy_version 1826092 (0.0008) [2023-12-28 08:23:12,668][106226] Updated weights for policy 0, policy_version 1826102 (0.0008) [2023-12-28 08:23:12,720][106226] Updated weights for policy 0, policy_version 1826112 (0.0008) [2023-12-28 08:23:13,160][106225] Updated weights for policy 1, policy_version 1830248 (0.0008) [2023-12-28 08:23:13,208][106225] Updated weights for policy 1, policy_version 1830258 (0.0008) [2023-12-28 08:23:13,255][106225] Updated weights for policy 1, policy_version 1830268 (0.0006) [2023-12-28 08:23:13,453][106226] Updated weights for policy 0, policy_version 1826122 (0.0008) [2023-12-28 08:23:13,509][106226] Updated weights for policy 0, policy_version 1826132 (0.0009) [2023-12-28 08:23:13,562][106226] Updated weights for policy 0, policy_version 1826142 (0.0009) [2023-12-28 08:23:13,617][106226] Updated weights for policy 0, policy_version 1826152 (0.0008) [2023-12-28 08:23:13,904][106225] Updated weights for policy 1, policy_version 1830278 (0.0007) [2023-12-28 08:23:13,958][106225] Updated weights for policy 1, policy_version 1830288 (0.0009) [2023-12-28 08:23:14,013][106225] Updated weights for policy 1, policy_version 1830298 (0.0009) [2023-12-28 08:23:14,269][106226] Updated weights for policy 0, policy_version 1826162 (0.0008) [2023-12-28 08:23:14,334][106226] Updated weights for policy 0, policy_version 1826172 (0.0008) [2023-12-28 08:23:14,395][106226] Updated weights for policy 0, policy_version 1826182 (0.0007) [2023-12-28 08:23:14,705][106225] Updated weights for policy 1, policy_version 1830308 (0.0008) [2023-12-28 08:23:14,754][106225] Updated weights for policy 1, policy_version 1830318 (0.0008) [2023-12-28 08:23:14,814][106225] Updated weights for policy 1, policy_version 1830328 (0.0008) [2023-12-28 08:23:15,116][106226] Updated weights for policy 0, policy_version 1826192 (0.0006) [2023-12-28 08:23:15,175][106226] Updated weights for policy 0, policy_version 1826202 (0.0006) [2023-12-28 08:23:15,239][106226] Updated weights for policy 0, policy_version 1826212 (0.0007) [2023-12-28 08:23:15,635][106225] Updated weights for policy 1, policy_version 1830338 (0.0009) [2023-12-28 08:23:15,703][106225] Updated weights for policy 1, policy_version 1830348 (0.0009) [2023-12-28 08:23:15,771][106225] Updated weights for policy 1, policy_version 1830358 (0.0009) [2023-12-28 08:23:15,815][106226] Updated weights for policy 0, policy_version 1826222 (0.0006) [2023-12-28 08:23:15,837][106225] Updated weights for policy 1, policy_version 1830368 (0.0009) [2023-12-28 08:23:15,867][106226] Updated weights for policy 0, policy_version 1826232 (0.0005) [2023-12-28 08:23:15,912][106226] Updated weights for policy 0, policy_version 1826242 (0.0005) [2023-12-28 08:23:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 936230912. Throughput: 0: 10074.1, 1: 9638.3. Samples: 936218644. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:16,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.886')] [2023-12-28 08:23:16,547][106225] Updated weights for policy 1, policy_version 1830378 (0.0005) [2023-12-28 08:23:16,600][106226] Updated weights for policy 0, policy_version 1826252 (0.0006) [2023-12-28 08:23:16,605][106225] Updated weights for policy 1, policy_version 1830388 (0.0007) [2023-12-28 08:23:16,664][106226] Updated weights for policy 0, policy_version 1826262 (0.0007) [2023-12-28 08:23:16,664][106225] Updated weights for policy 1, policy_version 1830398 (0.0008) [2023-12-28 08:23:16,722][106226] Updated weights for policy 0, policy_version 1826272 (0.0006) [2023-12-28 08:23:17,283][106226] Updated weights for policy 0, policy_version 1826282 (0.0008) [2023-12-28 08:23:17,338][106226] Updated weights for policy 0, policy_version 1826292 (0.0005) [2023-12-28 08:23:17,345][106225] Updated weights for policy 1, policy_version 1830408 (0.0010) [2023-12-28 08:23:17,391][106226] Updated weights for policy 0, policy_version 1826302 (0.0005) [2023-12-28 08:23:17,393][106225] Updated weights for policy 1, policy_version 1830418 (0.0010) [2023-12-28 08:23:17,436][106225] Updated weights for policy 1, policy_version 1830428 (0.0010) [2023-12-28 08:23:17,449][106226] Updated weights for policy 0, policy_version 1826312 (0.0006) [2023-12-28 08:23:18,105][106225] Updated weights for policy 1, policy_version 1830438 (0.0007) [2023-12-28 08:23:18,116][106226] Updated weights for policy 0, policy_version 1826322 (0.0011) [2023-12-28 08:23:18,152][106225] Updated weights for policy 1, policy_version 1830448 (0.0005) [2023-12-28 08:23:18,171][106226] Updated weights for policy 0, policy_version 1826332 (0.0010) [2023-12-28 08:23:18,206][106225] Updated weights for policy 1, policy_version 1830458 (0.0007) [2023-12-28 08:23:18,220][106226] Updated weights for policy 0, policy_version 1826342 (0.0005) [2023-12-28 08:23:18,827][106226] Updated weights for policy 0, policy_version 1826352 (0.0010) [2023-12-28 08:23:18,888][106226] Updated weights for policy 0, policy_version 1826362 (0.0011) [2023-12-28 08:23:18,948][106226] Updated weights for policy 0, policy_version 1826372 (0.0011) [2023-12-28 08:23:19,003][106225] Updated weights for policy 1, policy_version 1830468 (0.0008) [2023-12-28 08:23:19,059][106225] Updated weights for policy 1, policy_version 1830478 (0.0008) [2023-12-28 08:23:19,121][106225] Updated weights for policy 1, policy_version 1830488 (0.0008) [2023-12-28 08:23:19,703][106226] Updated weights for policy 0, policy_version 1826382 (0.0010) [2023-12-28 08:23:19,772][106226] Updated weights for policy 0, policy_version 1826392 (0.0009) [2023-12-28 08:23:19,840][106226] Updated weights for policy 0, policy_version 1826402 (0.0009) [2023-12-28 08:23:19,947][106225] Updated weights for policy 1, policy_version 1830498 (0.0009) [2023-12-28 08:23:20,015][106225] Updated weights for policy 1, policy_version 1830508 (0.0009) [2023-12-28 08:23:20,079][106225] Updated weights for policy 1, policy_version 1830518 (0.0009) [2023-12-28 08:23:20,146][106225] Updated weights for policy 1, policy_version 1830528 (0.0008) [2023-12-28 08:23:20,619][106226] Updated weights for policy 0, policy_version 1826412 (0.0009) [2023-12-28 08:23:20,679][106226] Updated weights for policy 0, policy_version 1826422 (0.0009) [2023-12-28 08:23:20,742][106226] Updated weights for policy 0, policy_version 1826432 (0.0009) [2023-12-28 08:23:20,850][106225] Updated weights for policy 1, policy_version 1830538 (0.0008) [2023-12-28 08:23:20,904][106225] Updated weights for policy 1, policy_version 1830548 (0.0009) [2023-12-28 08:23:20,968][106225] Updated weights for policy 1, policy_version 1830558 (0.0008) [2023-12-28 08:23:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 936329216. Throughput: 0: 10077.7, 1: 9572.1. Samples: 936336116. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:21,175][105115] Avg episode reward: [(0, '-4.401'), (1, '-5.032')] [2023-12-28 08:23:21,433][106226] Updated weights for policy 0, policy_version 1826442 (0.0009) [2023-12-28 08:23:21,484][106226] Updated weights for policy 0, policy_version 1826452 (0.0008) [2023-12-28 08:23:21,567][106226] Updated weights for policy 0, policy_version 1826462 (0.0009) [2023-12-28 08:23:21,628][106226] Updated weights for policy 0, policy_version 1826472 (0.0008) [2023-12-28 08:23:21,832][106225] Updated weights for policy 1, policy_version 1830568 (0.0011) [2023-12-28 08:23:21,891][106225] Updated weights for policy 1, policy_version 1830578 (0.0010) [2023-12-28 08:23:21,951][106225] Updated weights for policy 1, policy_version 1830588 (0.0010) [2023-12-28 08:23:22,417][106226] Updated weights for policy 0, policy_version 1826482 (0.0008) [2023-12-28 08:23:22,484][106226] Updated weights for policy 0, policy_version 1826492 (0.0011) [2023-12-28 08:23:22,551][106226] Updated weights for policy 0, policy_version 1826502 (0.0011) [2023-12-28 08:23:22,661][106225] Updated weights for policy 1, policy_version 1830598 (0.0009) [2023-12-28 08:23:22,712][106225] Updated weights for policy 1, policy_version 1830608 (0.0010) [2023-12-28 08:23:22,766][106225] Updated weights for policy 1, policy_version 1830618 (0.0010) [2023-12-28 08:23:23,272][106226] Updated weights for policy 0, policy_version 1826512 (0.0010) [2023-12-28 08:23:23,325][106226] Updated weights for policy 0, policy_version 1826522 (0.0010) [2023-12-28 08:23:23,376][106226] Updated weights for policy 0, policy_version 1826532 (0.0010) [2023-12-28 08:23:23,479][106225] Updated weights for policy 1, policy_version 1830628 (0.0010) [2023-12-28 08:23:23,535][106225] Updated weights for policy 1, policy_version 1830638 (0.0010) [2023-12-28 08:23:23,585][106225] Updated weights for policy 1, policy_version 1830648 (0.0010) [2023-12-28 08:23:24,004][106226] Updated weights for policy 0, policy_version 1826542 (0.0008) [2023-12-28 08:23:24,051][106226] Updated weights for policy 0, policy_version 1826552 (0.0005) [2023-12-28 08:23:24,099][106226] Updated weights for policy 0, policy_version 1826562 (0.0008) [2023-12-28 08:23:24,281][106225] Updated weights for policy 1, policy_version 1830658 (0.0010) [2023-12-28 08:23:24,346][106225] Updated weights for policy 1, policy_version 1830668 (0.0008) [2023-12-28 08:23:24,412][106225] Updated weights for policy 1, policy_version 1830678 (0.0007) [2023-12-28 08:23:24,478][106225] Updated weights for policy 1, policy_version 1830688 (0.0007) [2023-12-28 08:23:24,747][106226] Updated weights for policy 0, policy_version 1826572 (0.0011) [2023-12-28 08:23:24,813][106226] Updated weights for policy 0, policy_version 1826582 (0.0010) [2023-12-28 08:23:24,878][106226] Updated weights for policy 0, policy_version 1826592 (0.0011) [2023-12-28 08:23:25,088][106225] Updated weights for policy 1, policy_version 1830698 (0.0008) [2023-12-28 08:23:25,151][106225] Updated weights for policy 1, policy_version 1830708 (0.0009) [2023-12-28 08:23:25,210][106225] Updated weights for policy 1, policy_version 1830718 (0.0006) [2023-12-28 08:23:25,481][106226] Updated weights for policy 0, policy_version 1826602 (0.0010) [2023-12-28 08:23:25,536][106226] Updated weights for policy 0, policy_version 1826612 (0.0005) [2023-12-28 08:23:25,588][106226] Updated weights for policy 0, policy_version 1826622 (0.0005) [2023-12-28 08:23:25,643][106226] Updated weights for policy 0, policy_version 1826632 (0.0005) [2023-12-28 08:23:26,007][106225] Updated weights for policy 1, policy_version 1830728 (0.0008) [2023-12-28 08:23:26,063][106225] Updated weights for policy 1, policy_version 1830738 (0.0006) [2023-12-28 08:23:26,124][106225] Updated weights for policy 1, policy_version 1830748 (0.0005) [2023-12-28 08:23:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 936427520. Throughput: 0: 10093.3, 1: 9507.5. Samples: 936393032. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:26,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.826')] [2023-12-28 08:23:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001830752_468729856.pth... [2023-12-28 08:23:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001829632_468443136.pth [2023-12-28 08:23:26,195][106226] Updated weights for policy 0, policy_version 1826642 (0.0010) [2023-12-28 08:23:26,245][106226] Updated weights for policy 0, policy_version 1826652 (0.0010) [2023-12-28 08:23:26,296][106226] Updated weights for policy 0, policy_version 1826662 (0.0005) [2023-12-28 08:23:26,304][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001826664_467705856.pth... [2023-12-28 08:23:26,307][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001825448_467394560.pth [2023-12-28 08:23:26,734][106225] Updated weights for policy 1, policy_version 1830758 (0.0006) [2023-12-28 08:23:26,801][106225] Updated weights for policy 1, policy_version 1830768 (0.0005) [2023-12-28 08:23:26,868][106225] Updated weights for policy 1, policy_version 1830778 (0.0005) [2023-12-28 08:23:26,980][106226] Updated weights for policy 0, policy_version 1826672 (0.0009) [2023-12-28 08:23:27,027][106226] Updated weights for policy 0, policy_version 1826682 (0.0010) [2023-12-28 08:23:27,081][106226] Updated weights for policy 0, policy_version 1826692 (0.0007) [2023-12-28 08:23:27,437][106225] Updated weights for policy 1, policy_version 1830788 (0.0007) [2023-12-28 08:23:27,485][106225] Updated weights for policy 1, policy_version 1830798 (0.0008) [2023-12-28 08:23:27,538][106225] Updated weights for policy 1, policy_version 1830808 (0.0009) [2023-12-28 08:23:27,632][106226] Updated weights for policy 0, policy_version 1826702 (0.0005) [2023-12-28 08:23:27,684][106226] Updated weights for policy 0, policy_version 1826712 (0.0005) [2023-12-28 08:23:27,736][106226] Updated weights for policy 0, policy_version 1826722 (0.0006) [2023-12-28 08:23:28,294][106225] Updated weights for policy 1, policy_version 1830818 (0.0008) [2023-12-28 08:23:28,362][106225] Updated weights for policy 1, policy_version 1830828 (0.0007) [2023-12-28 08:23:28,418][106225] Updated weights for policy 1, policy_version 1830838 (0.0008) [2023-12-28 08:23:28,438][106226] Updated weights for policy 0, policy_version 1826732 (0.0008) [2023-12-28 08:23:28,475][106225] Updated weights for policy 1, policy_version 1830848 (0.0006) [2023-12-28 08:23:28,492][106226] Updated weights for policy 0, policy_version 1826742 (0.0010) [2023-12-28 08:23:28,548][106226] Updated weights for policy 0, policy_version 1826752 (0.0010) [2023-12-28 08:23:29,169][106225] Updated weights for policy 1, policy_version 1830858 (0.0007) [2023-12-28 08:23:29,220][106225] Updated weights for policy 1, policy_version 1830868 (0.0008) [2023-12-28 08:23:29,277][106226] Updated weights for policy 0, policy_version 1826762 (0.0010) [2023-12-28 08:23:29,280][106225] Updated weights for policy 1, policy_version 1830878 (0.0008) [2023-12-28 08:23:29,334][106226] Updated weights for policy 0, policy_version 1826772 (0.0008) [2023-12-28 08:23:29,403][106226] Updated weights for policy 0, policy_version 1826782 (0.0011) [2023-12-28 08:23:29,465][106226] Updated weights for policy 0, policy_version 1826792 (0.0009) [2023-12-28 08:23:30,062][106225] Updated weights for policy 1, policy_version 1830888 (0.0008) [2023-12-28 08:23:30,122][106225] Updated weights for policy 1, policy_version 1830898 (0.0008) [2023-12-28 08:23:30,182][106225] Updated weights for policy 1, policy_version 1830908 (0.0007) [2023-12-28 08:23:30,214][106226] Updated weights for policy 0, policy_version 1826802 (0.0007) [2023-12-28 08:23:30,272][106226] Updated weights for policy 0, policy_version 1826812 (0.0007) [2023-12-28 08:23:30,334][106226] Updated weights for policy 0, policy_version 1826822 (0.0007) [2023-12-28 08:23:30,919][106225] Updated weights for policy 1, policy_version 1830918 (0.0008) [2023-12-28 08:23:30,956][106226] Updated weights for policy 0, policy_version 1826832 (0.0008) [2023-12-28 08:23:30,973][106225] Updated weights for policy 1, policy_version 1830928 (0.0007) [2023-12-28 08:23:31,011][106226] Updated weights for policy 0, policy_version 1826842 (0.0007) [2023-12-28 08:23:31,025][106225] Updated weights for policy 1, policy_version 1830938 (0.0007) [2023-12-28 08:23:31,075][106226] Updated weights for policy 0, policy_version 1826852 (0.0010) [2023-12-28 08:23:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 936534016. Throughput: 0: 10222.1, 1: 9558.2. Samples: 936517004. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:31,175][105115] Avg episode reward: [(0, '-4.420'), (1, '-4.890')] [2023-12-28 08:23:31,786][106225] Updated weights for policy 1, policy_version 1830948 (0.0008) [2023-12-28 08:23:31,846][106225] Updated weights for policy 1, policy_version 1830958 (0.0008) [2023-12-28 08:23:31,884][106226] Updated weights for policy 0, policy_version 1826862 (0.0008) [2023-12-28 08:23:31,901][106225] Updated weights for policy 1, policy_version 1830968 (0.0009) [2023-12-28 08:23:31,942][106226] Updated weights for policy 0, policy_version 1826872 (0.0006) [2023-12-28 08:23:31,999][106226] Updated weights for policy 0, policy_version 1826882 (0.0007) [2023-12-28 08:23:32,637][106225] Updated weights for policy 1, policy_version 1830978 (0.0005) [2023-12-28 08:23:32,697][106225] Updated weights for policy 1, policy_version 1830988 (0.0006) [2023-12-28 08:23:32,700][106226] Updated weights for policy 0, policy_version 1826892 (0.0007) [2023-12-28 08:23:32,754][106225] Updated weights for policy 1, policy_version 1830998 (0.0006) [2023-12-28 08:23:32,767][106226] Updated weights for policy 0, policy_version 1826902 (0.0011) [2023-12-28 08:23:32,809][106225] Updated weights for policy 1, policy_version 1831008 (0.0006) [2023-12-28 08:23:32,830][106226] Updated weights for policy 0, policy_version 1826912 (0.0006) [2023-12-28 08:23:33,333][106225] Updated weights for policy 1, policy_version 1831018 (0.0008) [2023-12-28 08:23:33,348][106226] Updated weights for policy 0, policy_version 1826922 (0.0005) [2023-12-28 08:23:33,379][106225] Updated weights for policy 1, policy_version 1831028 (0.0008) [2023-12-28 08:23:33,402][106226] Updated weights for policy 0, policy_version 1826932 (0.0005) [2023-12-28 08:23:33,434][106225] Updated weights for policy 1, policy_version 1831038 (0.0007) [2023-12-28 08:23:33,447][106226] Updated weights for policy 0, policy_version 1826942 (0.0007) [2023-12-28 08:23:33,498][106226] Updated weights for policy 0, policy_version 1826952 (0.0010) [2023-12-28 08:23:34,122][106225] Updated weights for policy 1, policy_version 1831048 (0.0007) [2023-12-28 08:23:34,186][106225] Updated weights for policy 1, policy_version 1831058 (0.0009) [2023-12-28 08:23:34,190][106226] Updated weights for policy 0, policy_version 1826962 (0.0010) [2023-12-28 08:23:34,246][106225] Updated weights for policy 1, policy_version 1831068 (0.0008) [2023-12-28 08:23:34,251][106226] Updated weights for policy 0, policy_version 1826972 (0.0008) [2023-12-28 08:23:34,321][106226] Updated weights for policy 0, policy_version 1826982 (0.0007) [2023-12-28 08:23:34,956][106225] Updated weights for policy 1, policy_version 1831078 (0.0006) [2023-12-28 08:23:35,008][106226] Updated weights for policy 0, policy_version 1826992 (0.0007) [2023-12-28 08:23:35,014][106225] Updated weights for policy 1, policy_version 1831088 (0.0007) [2023-12-28 08:23:35,059][106226] Updated weights for policy 0, policy_version 1827002 (0.0006) [2023-12-28 08:23:35,064][106225] Updated weights for policy 1, policy_version 1831098 (0.0007) [2023-12-28 08:23:35,111][106226] Updated weights for policy 0, policy_version 1827012 (0.0005) [2023-12-28 08:23:35,739][106226] Updated weights for policy 0, policy_version 1827022 (0.0005) [2023-12-28 08:23:35,792][106226] Updated weights for policy 0, policy_version 1827032 (0.0006) [2023-12-28 08:23:35,836][106225] Updated weights for policy 1, policy_version 1831108 (0.0007) [2023-12-28 08:23:35,844][106226] Updated weights for policy 0, policy_version 1827042 (0.0007) [2023-12-28 08:23:35,889][106225] Updated weights for policy 1, policy_version 1831118 (0.0008) [2023-12-28 08:23:35,943][106225] Updated weights for policy 1, policy_version 1831128 (0.0008) [2023-12-28 08:23:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 936632320. Throughput: 0: 10214.3, 1: 9615.1. Samples: 936638344. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:36,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.676')] [2023-12-28 08:23:36,528][106226] Updated weights for policy 0, policy_version 1827052 (0.0006) [2023-12-28 08:23:36,585][106226] Updated weights for policy 0, policy_version 1827062 (0.0005) [2023-12-28 08:23:36,655][106226] Updated weights for policy 0, policy_version 1827072 (0.0008) [2023-12-28 08:23:36,766][106225] Updated weights for policy 1, policy_version 1831138 (0.0008) [2023-12-28 08:23:36,827][106225] Updated weights for policy 1, policy_version 1831148 (0.0008) [2023-12-28 08:23:36,888][106225] Updated weights for policy 1, policy_version 1831158 (0.0008) [2023-12-28 08:23:36,953][106225] Updated weights for policy 1, policy_version 1831168 (0.0011) [2023-12-28 08:23:37,326][106226] Updated weights for policy 0, policy_version 1827082 (0.0006) [2023-12-28 08:23:37,377][106226] Updated weights for policy 0, policy_version 1827092 (0.0008) [2023-12-28 08:23:37,424][106226] Updated weights for policy 0, policy_version 1827102 (0.0008) [2023-12-28 08:23:37,474][106226] Updated weights for policy 0, policy_version 1827112 (0.0008) [2023-12-28 08:23:37,688][106225] Updated weights for policy 1, policy_version 1831178 (0.0010) [2023-12-28 08:23:37,751][106225] Updated weights for policy 1, policy_version 1831188 (0.0010) [2023-12-28 08:23:37,810][106225] Updated weights for policy 1, policy_version 1831198 (0.0010) [2023-12-28 08:23:38,227][106226] Updated weights for policy 0, policy_version 1827122 (0.0008) [2023-12-28 08:23:38,276][106226] Updated weights for policy 0, policy_version 1827132 (0.0008) [2023-12-28 08:23:38,336][106226] Updated weights for policy 0, policy_version 1827142 (0.0006) [2023-12-28 08:23:38,519][106225] Updated weights for policy 1, policy_version 1831208 (0.0006) [2023-12-28 08:23:38,578][106225] Updated weights for policy 1, policy_version 1831218 (0.0005) [2023-12-28 08:23:38,642][106225] Updated weights for policy 1, policy_version 1831228 (0.0008) [2023-12-28 08:23:39,035][106226] Updated weights for policy 0, policy_version 1827152 (0.0008) [2023-12-28 08:23:39,085][106226] Updated weights for policy 0, policy_version 1827162 (0.0008) [2023-12-28 08:23:39,144][106226] Updated weights for policy 0, policy_version 1827172 (0.0007) [2023-12-28 08:23:39,327][106225] Updated weights for policy 1, policy_version 1831238 (0.0008) [2023-12-28 08:23:39,400][106225] Updated weights for policy 1, policy_version 1831248 (0.0008) [2023-12-28 08:23:39,464][106225] Updated weights for policy 1, policy_version 1831258 (0.0008) [2023-12-28 08:23:39,938][106226] Updated weights for policy 0, policy_version 1827182 (0.0009) [2023-12-28 08:23:40,006][106226] Updated weights for policy 0, policy_version 1827192 (0.0010) [2023-12-28 08:23:40,071][106226] Updated weights for policy 0, policy_version 1827202 (0.0007) [2023-12-28 08:23:40,199][106225] Updated weights for policy 1, policy_version 1831268 (0.0007) [2023-12-28 08:23:40,268][106225] Updated weights for policy 1, policy_version 1831278 (0.0006) [2023-12-28 08:23:40,330][106225] Updated weights for policy 1, policy_version 1831288 (0.0006) [2023-12-28 08:23:40,830][106226] Updated weights for policy 0, policy_version 1827212 (0.0009) [2023-12-28 08:23:40,879][106226] Updated weights for policy 0, policy_version 1827222 (0.0008) [2023-12-28 08:23:40,927][106226] Updated weights for policy 0, policy_version 1827232 (0.0008) [2023-12-28 08:23:40,972][106225] Updated weights for policy 1, policy_version 1831298 (0.0007) [2023-12-28 08:23:41,033][106225] Updated weights for policy 1, policy_version 1831308 (0.0007) [2023-12-28 08:23:41,100][106225] Updated weights for policy 1, policy_version 1831318 (0.0007) [2023-12-28 08:23:41,167][106225] Updated weights for policy 1, policy_version 1831328 (0.0010) [2023-12-28 08:23:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 936730624. Throughput: 0: 10229.9, 1: 9595.0. Samples: 936695680. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:41,175][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.786')] [2023-12-28 08:23:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001831328_468877312.pth... [2023-12-28 08:23:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001827240_467853312.pth... [2023-12-28 08:23:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001830176_468582400.pth [2023-12-28 08:23:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001826056_467550208.pth [2023-12-28 08:23:41,661][106226] Updated weights for policy 0, policy_version 1827242 (0.0008) [2023-12-28 08:23:41,720][106226] Updated weights for policy 0, policy_version 1827252 (0.0008) [2023-12-28 08:23:41,788][106226] Updated weights for policy 0, policy_version 1827262 (0.0009) [2023-12-28 08:23:41,858][106226] Updated weights for policy 0, policy_version 1827272 (0.0008) [2023-12-28 08:23:41,982][106225] Updated weights for policy 1, policy_version 1831338 (0.0007) [2023-12-28 08:23:42,045][106225] Updated weights for policy 1, policy_version 1831348 (0.0008) [2023-12-28 08:23:42,103][106225] Updated weights for policy 1, policy_version 1831358 (0.0007) [2023-12-28 08:23:42,591][106226] Updated weights for policy 0, policy_version 1827282 (0.0005) [2023-12-28 08:23:42,649][106226] Updated weights for policy 0, policy_version 1827292 (0.0005) [2023-12-28 08:23:42,710][106226] Updated weights for policy 0, policy_version 1827302 (0.0007) [2023-12-28 08:23:42,852][106225] Updated weights for policy 1, policy_version 1831368 (0.0008) [2023-12-28 08:23:42,911][106225] Updated weights for policy 1, policy_version 1831378 (0.0008) [2023-12-28 08:23:42,955][106225] Updated weights for policy 1, policy_version 1831388 (0.0008) [2023-12-28 08:23:43,442][106226] Updated weights for policy 0, policy_version 1827312 (0.0009) [2023-12-28 08:23:43,504][106226] Updated weights for policy 0, policy_version 1827322 (0.0010) [2023-12-28 08:23:43,565][106225] Updated weights for policy 1, policy_version 1831398 (0.0006) [2023-12-28 08:23:43,567][106226] Updated weights for policy 0, policy_version 1827332 (0.0007) [2023-12-28 08:23:43,622][106225] Updated weights for policy 1, policy_version 1831408 (0.0007) [2023-12-28 08:23:43,678][106225] Updated weights for policy 1, policy_version 1831418 (0.0008) [2023-12-28 08:23:44,292][106225] Updated weights for policy 1, policy_version 1831428 (0.0008) [2023-12-28 08:23:44,349][106226] Updated weights for policy 0, policy_version 1827342 (0.0007) [2023-12-28 08:23:44,358][106225] Updated weights for policy 1, policy_version 1831438 (0.0009) [2023-12-28 08:23:44,414][106226] Updated weights for policy 0, policy_version 1827352 (0.0007) [2023-12-28 08:23:44,420][106225] Updated weights for policy 1, policy_version 1831448 (0.0006) [2023-12-28 08:23:44,473][106226] Updated weights for policy 0, policy_version 1827362 (0.0009) [2023-12-28 08:23:45,161][106226] Updated weights for policy 0, policy_version 1827372 (0.0008) [2023-12-28 08:23:45,184][106225] Updated weights for policy 1, policy_version 1831458 (0.0007) [2023-12-28 08:23:45,220][106226] Updated weights for policy 0, policy_version 1827382 (0.0008) [2023-12-28 08:23:45,249][106225] Updated weights for policy 1, policy_version 1831468 (0.0005) [2023-12-28 08:23:45,283][106226] Updated weights for policy 0, policy_version 1827392 (0.0007) [2023-12-28 08:23:45,311][106225] Updated weights for policy 1, policy_version 1831478 (0.0007) [2023-12-28 08:23:45,371][106225] Updated weights for policy 1, policy_version 1831488 (0.0005) [2023-12-28 08:23:45,937][106225] Updated weights for policy 1, policy_version 1831498 (0.0008) [2023-12-28 08:23:45,999][106225] Updated weights for policy 1, policy_version 1831508 (0.0007) [2023-12-28 08:23:46,036][106226] Updated weights for policy 0, policy_version 1827402 (0.0008) [2023-12-28 08:23:46,059][106225] Updated weights for policy 1, policy_version 1831518 (0.0006) [2023-12-28 08:23:46,085][106226] Updated weights for policy 0, policy_version 1827412 (0.0007) [2023-12-28 08:23:46,140][106226] Updated weights for policy 0, policy_version 1827422 (0.0008) [2023-12-28 08:23:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 936820736. Throughput: 0: 10151.0, 1: 9574.4. Samples: 936810692. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:46,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.712')] [2023-12-28 08:23:46,190][106226] Updated weights for policy 0, policy_version 1827432 (0.0008) [2023-12-28 08:23:46,659][106225] Updated weights for policy 1, policy_version 1831528 (0.0005) [2023-12-28 08:23:46,712][106225] Updated weights for policy 1, policy_version 1831538 (0.0005) [2023-12-28 08:23:46,767][106225] Updated weights for policy 1, policy_version 1831548 (0.0008) [2023-12-28 08:23:47,038][106226] Updated weights for policy 0, policy_version 1827442 (0.0008) [2023-12-28 08:23:47,097][106226] Updated weights for policy 0, policy_version 1827452 (0.0008) [2023-12-28 08:23:47,153][106226] Updated weights for policy 0, policy_version 1827462 (0.0008) [2023-12-28 08:23:47,351][106225] Updated weights for policy 1, policy_version 1831558 (0.0005) [2023-12-28 08:23:47,404][106225] Updated weights for policy 1, policy_version 1831568 (0.0005) [2023-12-28 08:23:47,460][106225] Updated weights for policy 1, policy_version 1831578 (0.0005) [2023-12-28 08:23:47,955][106226] Updated weights for policy 0, policy_version 1827472 (0.0008) [2023-12-28 08:23:48,004][106226] Updated weights for policy 0, policy_version 1827482 (0.0007) [2023-12-28 08:23:48,024][106225] Updated weights for policy 1, policy_version 1831588 (0.0007) [2023-12-28 08:23:48,053][106226] Updated weights for policy 0, policy_version 1827492 (0.0009) [2023-12-28 08:23:48,071][106225] Updated weights for policy 1, policy_version 1831598 (0.0010) [2023-12-28 08:23:48,141][106225] Updated weights for policy 1, policy_version 1831608 (0.0011) [2023-12-28 08:23:48,836][106226] Updated weights for policy 0, policy_version 1827502 (0.0007) [2023-12-28 08:23:48,868][106225] Updated weights for policy 1, policy_version 1831618 (0.0010) [2023-12-28 08:23:48,904][106226] Updated weights for policy 0, policy_version 1827512 (0.0006) [2023-12-28 08:23:48,935][106225] Updated weights for policy 1, policy_version 1831628 (0.0006) [2023-12-28 08:23:48,955][106226] Updated weights for policy 0, policy_version 1827522 (0.0008) [2023-12-28 08:23:48,997][106225] Updated weights for policy 1, policy_version 1831638 (0.0006) [2023-12-28 08:23:49,047][106225] Updated weights for policy 1, policy_version 1831648 (0.0005) [2023-12-28 08:23:49,710][106226] Updated weights for policy 0, policy_version 1827532 (0.0008) [2023-12-28 08:23:49,774][106226] Updated weights for policy 0, policy_version 1827542 (0.0007) [2023-12-28 08:23:49,777][106225] Updated weights for policy 1, policy_version 1831658 (0.0006) [2023-12-28 08:23:49,847][106226] Updated weights for policy 0, policy_version 1827552 (0.0008) [2023-12-28 08:23:49,850][106225] Updated weights for policy 1, policy_version 1831668 (0.0007) [2023-12-28 08:23:49,912][106225] Updated weights for policy 1, policy_version 1831678 (0.0007) [2023-12-28 08:23:50,574][106226] Updated weights for policy 0, policy_version 1827562 (0.0007) [2023-12-28 08:23:50,628][106225] Updated weights for policy 1, policy_version 1831688 (0.0006) [2023-12-28 08:23:50,633][106226] Updated weights for policy 0, policy_version 1827572 (0.0008) [2023-12-28 08:23:50,687][106225] Updated weights for policy 1, policy_version 1831698 (0.0006) [2023-12-28 08:23:50,693][106226] Updated weights for policy 0, policy_version 1827582 (0.0006) [2023-12-28 08:23:50,752][106225] Updated weights for policy 1, policy_version 1831708 (0.0008) [2023-12-28 08:23:50,759][106226] Updated weights for policy 0, policy_version 1827592 (0.0008) [2023-12-28 08:23:51,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.9, 300 sec: 19716.4). Total num frames: 936919040. Throughput: 0: 9994.0, 1: 9679.8. Samples: 936929348. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:51,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.419')] [2023-12-28 08:23:51,512][106226] Updated weights for policy 0, policy_version 1827602 (0.0008) [2023-12-28 08:23:51,531][106225] Updated weights for policy 1, policy_version 1831718 (0.0009) [2023-12-28 08:23:51,572][106226] Updated weights for policy 0, policy_version 1827612 (0.0006) [2023-12-28 08:23:51,592][106225] Updated weights for policy 1, policy_version 1831728 (0.0011) [2023-12-28 08:23:51,639][106226] Updated weights for policy 0, policy_version 1827622 (0.0007) [2023-12-28 08:23:51,658][106225] Updated weights for policy 1, policy_version 1831738 (0.0010) [2023-12-28 08:23:52,408][106226] Updated weights for policy 0, policy_version 1827632 (0.0008) [2023-12-28 08:23:52,428][106225] Updated weights for policy 1, policy_version 1831748 (0.0008) [2023-12-28 08:23:52,462][106226] Updated weights for policy 0, policy_version 1827642 (0.0008) [2023-12-28 08:23:52,489][106225] Updated weights for policy 1, policy_version 1831758 (0.0007) [2023-12-28 08:23:52,526][106226] Updated weights for policy 0, policy_version 1827652 (0.0009) [2023-12-28 08:23:52,549][106225] Updated weights for policy 1, policy_version 1831768 (0.0008) [2023-12-28 08:23:53,165][106226] Updated weights for policy 0, policy_version 1827662 (0.0007) [2023-12-28 08:23:53,213][106226] Updated weights for policy 0, policy_version 1827672 (0.0006) [2023-12-28 08:23:53,256][106225] Updated weights for policy 1, policy_version 1831778 (0.0006) [2023-12-28 08:23:53,265][106226] Updated weights for policy 0, policy_version 1827682 (0.0007) [2023-12-28 08:23:53,314][106225] Updated weights for policy 1, policy_version 1831788 (0.0009) [2023-12-28 08:23:53,367][106225] Updated weights for policy 1, policy_version 1831798 (0.0008) [2023-12-28 08:23:53,416][106225] Updated weights for policy 1, policy_version 1831808 (0.0008) [2023-12-28 08:23:53,861][106226] Updated weights for policy 0, policy_version 1827692 (0.0006) [2023-12-28 08:23:53,930][106226] Updated weights for policy 0, policy_version 1827702 (0.0008) [2023-12-28 08:23:54,000][106226] Updated weights for policy 0, policy_version 1827712 (0.0009) [2023-12-28 08:23:54,122][106225] Updated weights for policy 1, policy_version 1831818 (0.0010) [2023-12-28 08:23:54,182][106225] Updated weights for policy 1, policy_version 1831828 (0.0010) [2023-12-28 08:23:54,241][106225] Updated weights for policy 1, policy_version 1831838 (0.0005) [2023-12-28 08:23:54,736][106226] Updated weights for policy 0, policy_version 1827722 (0.0008) [2023-12-28 08:23:54,790][106226] Updated weights for policy 0, policy_version 1827732 (0.0008) [2023-12-28 08:23:54,841][106226] Updated weights for policy 0, policy_version 1827742 (0.0008) [2023-12-28 08:23:54,852][106225] Updated weights for policy 1, policy_version 1831848 (0.0005) [2023-12-28 08:23:54,899][106226] Updated weights for policy 0, policy_version 1827752 (0.0009) [2023-12-28 08:23:54,914][106225] Updated weights for policy 1, policy_version 1831858 (0.0006) [2023-12-28 08:23:54,980][106225] Updated weights for policy 1, policy_version 1831868 (0.0008) [2023-12-28 08:23:55,541][106225] Updated weights for policy 1, policy_version 1831878 (0.0007) [2023-12-28 08:23:55,607][106225] Updated weights for policy 1, policy_version 1831888 (0.0006) [2023-12-28 08:23:55,662][106226] Updated weights for policy 0, policy_version 1827762 (0.0011) [2023-12-28 08:23:55,664][106225] Updated weights for policy 1, policy_version 1831898 (0.0006) [2023-12-28 08:23:55,725][106226] Updated weights for policy 0, policy_version 1827772 (0.0010) [2023-12-28 08:23:55,785][106226] Updated weights for policy 0, policy_version 1827782 (0.0011) [2023-12-28 08:23:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 937017344. Throughput: 0: 9935.1, 1: 9720.5. Samples: 936987080. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:23:56,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.711')] [2023-12-28 08:23:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001827784_467992576.pth... [2023-12-28 08:23:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001826664_467705856.pth [2023-12-28 08:23:56,196][106225] Updated weights for policy 1, policy_version 1831908 (0.0007) [2023-12-28 08:23:56,249][106225] Updated weights for policy 1, policy_version 1831918 (0.0010) [2023-12-28 08:23:56,304][106225] Updated weights for policy 1, policy_version 1831928 (0.0010) [2023-12-28 08:23:56,340][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001831936_469032960.pth... [2023-12-28 08:23:56,343][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001830752_468729856.pth [2023-12-28 08:23:56,476][106226] Updated weights for policy 0, policy_version 1827792 (0.0006) [2023-12-28 08:23:56,523][106226] Updated weights for policy 0, policy_version 1827802 (0.0005) [2023-12-28 08:23:56,575][106226] Updated weights for policy 0, policy_version 1827812 (0.0007) [2023-12-28 08:23:56,937][106225] Updated weights for policy 1, policy_version 1831938 (0.0010) [2023-12-28 08:23:56,992][106225] Updated weights for policy 1, policy_version 1831948 (0.0008) [2023-12-28 08:23:57,038][106225] Updated weights for policy 1, policy_version 1831958 (0.0007) [2023-12-28 08:23:57,081][106225] Updated weights for policy 1, policy_version 1831968 (0.0005) [2023-12-28 08:23:57,257][106226] Updated weights for policy 0, policy_version 1827822 (0.0007) [2023-12-28 08:23:57,305][106226] Updated weights for policy 0, policy_version 1827832 (0.0006) [2023-12-28 08:23:57,365][106226] Updated weights for policy 0, policy_version 1827842 (0.0007) [2023-12-28 08:23:57,712][106225] Updated weights for policy 1, policy_version 1831978 (0.0009) [2023-12-28 08:23:57,764][106225] Updated weights for policy 1, policy_version 1831988 (0.0009) [2023-12-28 08:23:57,813][106225] Updated weights for policy 1, policy_version 1831998 (0.0008) [2023-12-28 08:23:57,944][106226] Updated weights for policy 0, policy_version 1827852 (0.0008) [2023-12-28 08:23:58,003][106226] Updated weights for policy 0, policy_version 1827862 (0.0008) [2023-12-28 08:23:58,056][106226] Updated weights for policy 0, policy_version 1827872 (0.0009) [2023-12-28 08:23:58,549][106225] Updated weights for policy 1, policy_version 1832008 (0.0010) [2023-12-28 08:23:58,615][106225] Updated weights for policy 1, policy_version 1832018 (0.0010) [2023-12-28 08:23:58,685][106225] Updated weights for policy 1, policy_version 1832028 (0.0009) [2023-12-28 08:23:58,825][106226] Updated weights for policy 0, policy_version 1827882 (0.0008) [2023-12-28 08:23:58,889][106226] Updated weights for policy 0, policy_version 1827892 (0.0008) [2023-12-28 08:23:58,949][106226] Updated weights for policy 0, policy_version 1827902 (0.0008) [2023-12-28 08:23:59,011][106226] Updated weights for policy 0, policy_version 1827912 (0.0008) [2023-12-28 08:23:59,443][106225] Updated weights for policy 1, policy_version 1832038 (0.0008) [2023-12-28 08:23:59,500][106225] Updated weights for policy 1, policy_version 1832048 (0.0007) [2023-12-28 08:23:59,566][106225] Updated weights for policy 1, policy_version 1832058 (0.0009) [2023-12-28 08:23:59,756][106226] Updated weights for policy 0, policy_version 1827922 (0.0007) [2023-12-28 08:23:59,824][106226] Updated weights for policy 0, policy_version 1827932 (0.0006) [2023-12-28 08:23:59,888][106226] Updated weights for policy 0, policy_version 1827942 (0.0008) [2023-12-28 08:24:00,271][106225] Updated weights for policy 1, policy_version 1832068 (0.0008) [2023-12-28 08:24:00,339][106225] Updated weights for policy 1, policy_version 1832078 (0.0005) [2023-12-28 08:24:00,404][106225] Updated weights for policy 1, policy_version 1832088 (0.0007) [2023-12-28 08:24:00,599][106226] Updated weights for policy 0, policy_version 1827952 (0.0008) [2023-12-28 08:24:00,654][106226] Updated weights for policy 0, policy_version 1827962 (0.0008) [2023-12-28 08:24:00,723][106226] Updated weights for policy 0, policy_version 1827972 (0.0009) [2023-12-28 08:24:00,971][106225] Updated weights for policy 1, policy_version 1832098 (0.0006) [2023-12-28 08:24:01,019][106225] Updated weights for policy 1, policy_version 1832108 (0.0005) [2023-12-28 08:24:01,084][106225] Updated weights for policy 1, policy_version 1832118 (0.0008) [2023-12-28 08:24:01,155][106225] Updated weights for policy 1, policy_version 1832128 (0.0009) [2023-12-28 08:24:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 937123840. Throughput: 0: 9906.8, 1: 9887.0. Samples: 937109368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:01,175][105115] Avg episode reward: [(0, '-4.103'), (1, '-4.463')] [2023-12-28 08:24:01,524][106226] Updated weights for policy 0, policy_version 1827982 (0.0008) [2023-12-28 08:24:01,578][106226] Updated weights for policy 0, policy_version 1827992 (0.0008) [2023-12-28 08:24:01,639][106226] Updated weights for policy 0, policy_version 1828002 (0.0009) [2023-12-28 08:24:01,828][106225] Updated weights for policy 1, policy_version 1832138 (0.0008) [2023-12-28 08:24:01,884][106225] Updated weights for policy 1, policy_version 1832148 (0.0008) [2023-12-28 08:24:01,948][106225] Updated weights for policy 1, policy_version 1832158 (0.0009) [2023-12-28 08:24:02,317][106226] Updated weights for policy 0, policy_version 1828012 (0.0006) [2023-12-28 08:24:02,386][106226] Updated weights for policy 0, policy_version 1828022 (0.0008) [2023-12-28 08:24:02,453][106226] Updated weights for policy 0, policy_version 1828032 (0.0009) [2023-12-28 08:24:02,677][106225] Updated weights for policy 1, policy_version 1832168 (0.0006) [2023-12-28 08:24:02,741][106225] Updated weights for policy 1, policy_version 1832178 (0.0007) [2023-12-28 08:24:02,800][106225] Updated weights for policy 1, policy_version 1832188 (0.0008) [2023-12-28 08:24:03,068][106226] Updated weights for policy 0, policy_version 1828042 (0.0007) [2023-12-28 08:24:03,123][106226] Updated weights for policy 0, policy_version 1828052 (0.0010) [2023-12-28 08:24:03,185][106226] Updated weights for policy 0, policy_version 1828062 (0.0005) [2023-12-28 08:24:03,251][106226] Updated weights for policy 0, policy_version 1828072 (0.0005) [2023-12-28 08:24:03,508][106225] Updated weights for policy 1, policy_version 1832198 (0.0009) [2023-12-28 08:24:03,567][106225] Updated weights for policy 1, policy_version 1832208 (0.0010) [2023-12-28 08:24:03,619][106225] Updated weights for policy 1, policy_version 1832218 (0.0009) [2023-12-28 08:24:03,863][106226] Updated weights for policy 0, policy_version 1828082 (0.0009) [2023-12-28 08:24:03,920][106226] Updated weights for policy 0, policy_version 1828092 (0.0010) [2023-12-28 08:24:03,971][106226] Updated weights for policy 0, policy_version 1828102 (0.0011) [2023-12-28 08:24:04,313][106225] Updated weights for policy 1, policy_version 1832228 (0.0008) [2023-12-28 08:24:04,373][106225] Updated weights for policy 1, policy_version 1832238 (0.0008) [2023-12-28 08:24:04,434][106225] Updated weights for policy 1, policy_version 1832248 (0.0008) [2023-12-28 08:24:04,667][106226] Updated weights for policy 0, policy_version 1828112 (0.0011) [2023-12-28 08:24:04,733][106226] Updated weights for policy 0, policy_version 1828122 (0.0010) [2023-12-28 08:24:04,796][106226] Updated weights for policy 0, policy_version 1828132 (0.0011) [2023-12-28 08:24:05,050][106225] Updated weights for policy 1, policy_version 1832258 (0.0008) [2023-12-28 08:24:05,097][106225] Updated weights for policy 1, policy_version 1832268 (0.0010) [2023-12-28 08:24:05,151][106225] Updated weights for policy 1, policy_version 1832278 (0.0010) [2023-12-28 08:24:05,209][106225] Updated weights for policy 1, policy_version 1832288 (0.0010) [2023-12-28 08:24:05,428][106226] Updated weights for policy 0, policy_version 1828142 (0.0008) [2023-12-28 08:24:05,476][106226] Updated weights for policy 0, policy_version 1828152 (0.0007) [2023-12-28 08:24:05,528][106226] Updated weights for policy 0, policy_version 1828162 (0.0006) [2023-12-28 08:24:05,940][106225] Updated weights for policy 1, policy_version 1832298 (0.0005) [2023-12-28 08:24:05,989][106225] Updated weights for policy 1, policy_version 1832308 (0.0009) [2023-12-28 08:24:06,039][106225] Updated weights for policy 1, policy_version 1832318 (0.0010) [2023-12-28 08:24:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 937222144. Throughput: 0: 9887.0, 1: 9991.2. Samples: 937230632. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:06,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.714')] [2023-12-28 08:24:06,239][106226] Updated weights for policy 0, policy_version 1828172 (0.0010) [2023-12-28 08:24:06,296][106226] Updated weights for policy 0, policy_version 1828182 (0.0008) [2023-12-28 08:24:06,360][106226] Updated weights for policy 0, policy_version 1828192 (0.0007) [2023-12-28 08:24:06,802][106225] Updated weights for policy 1, policy_version 1832328 (0.0009) [2023-12-28 08:24:06,872][106225] Updated weights for policy 1, policy_version 1832338 (0.0011) [2023-12-28 08:24:06,928][106225] Updated weights for policy 1, policy_version 1832348 (0.0011) [2023-12-28 08:24:07,097][106226] Updated weights for policy 0, policy_version 1828202 (0.0009) [2023-12-28 08:24:07,160][106226] Updated weights for policy 0, policy_version 1828212 (0.0007) [2023-12-28 08:24:07,224][106226] Updated weights for policy 0, policy_version 1828222 (0.0011) [2023-12-28 08:24:07,285][106226] Updated weights for policy 0, policy_version 1828232 (0.0011) [2023-12-28 08:24:07,693][106225] Updated weights for policy 1, policy_version 1832358 (0.0011) [2023-12-28 08:24:07,742][106225] Updated weights for policy 1, policy_version 1832368 (0.0010) [2023-12-28 08:24:07,802][106225] Updated weights for policy 1, policy_version 1832378 (0.0010) [2023-12-28 08:24:07,980][106226] Updated weights for policy 0, policy_version 1828242 (0.0010) [2023-12-28 08:24:08,030][106226] Updated weights for policy 0, policy_version 1828252 (0.0010) [2023-12-28 08:24:08,080][106226] Updated weights for policy 0, policy_version 1828262 (0.0010) [2023-12-28 08:24:08,485][106225] Updated weights for policy 1, policy_version 1832388 (0.0009) [2023-12-28 08:24:08,542][106225] Updated weights for policy 1, policy_version 1832398 (0.0007) [2023-12-28 08:24:08,629][106225] Updated weights for policy 1, policy_version 1832408 (0.0008) [2023-12-28 08:24:08,847][106226] Updated weights for policy 0, policy_version 1828272 (0.0011) [2023-12-28 08:24:08,902][106226] Updated weights for policy 0, policy_version 1828282 (0.0011) [2023-12-28 08:24:08,959][106226] Updated weights for policy 0, policy_version 1828292 (0.0011) [2023-12-28 08:24:09,323][106225] Updated weights for policy 1, policy_version 1832418 (0.0008) [2023-12-28 08:24:09,392][106225] Updated weights for policy 1, policy_version 1832428 (0.0011) [2023-12-28 08:24:09,457][106225] Updated weights for policy 1, policy_version 1832438 (0.0008) [2023-12-28 08:24:09,514][106225] Updated weights for policy 1, policy_version 1832448 (0.0007) [2023-12-28 08:24:09,724][106226] Updated weights for policy 0, policy_version 1828302 (0.0011) [2023-12-28 08:24:09,790][106226] Updated weights for policy 0, policy_version 1828312 (0.0007) [2023-12-28 08:24:09,859][106226] Updated weights for policy 0, policy_version 1828322 (0.0009) [2023-12-28 08:24:10,286][106225] Updated weights for policy 1, policy_version 1832458 (0.0010) [2023-12-28 08:24:10,329][106225] Updated weights for policy 1, policy_version 1832468 (0.0010) [2023-12-28 08:24:10,386][106225] Updated weights for policy 1, policy_version 1832478 (0.0010) [2023-12-28 08:24:10,551][106226] Updated weights for policy 0, policy_version 1828332 (0.0008) [2023-12-28 08:24:10,602][106226] Updated weights for policy 0, policy_version 1828342 (0.0011) [2023-12-28 08:24:10,660][106226] Updated weights for policy 0, policy_version 1828352 (0.0011) [2023-12-28 08:24:11,167][106225] Updated weights for policy 1, policy_version 1832488 (0.0009) [2023-12-28 08:24:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 937312256. Throughput: 0: 9871.8, 1: 10017.7. Samples: 937288056. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:11,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.588')] [2023-12-28 08:24:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001828360_468140032.pth... [2023-12-28 08:24:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001827240_467853312.pth [2023-12-28 08:24:11,230][106225] Updated weights for policy 1, policy_version 1832498 (0.0009) [2023-12-28 08:24:11,302][106225] Updated weights for policy 1, policy_version 1832508 (0.0008) [2023-12-28 08:24:11,326][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001832512_469180416.pth... [2023-12-28 08:24:11,333][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001831328_468877312.pth [2023-12-28 08:24:11,448][106226] Updated weights for policy 0, policy_version 1828362 (0.0012) [2023-12-28 08:24:11,502][106226] Updated weights for policy 0, policy_version 1828372 (0.0008) [2023-12-28 08:24:11,565][106226] Updated weights for policy 0, policy_version 1828382 (0.0007) [2023-12-28 08:24:11,633][106226] Updated weights for policy 0, policy_version 1828392 (0.0010) [2023-12-28 08:24:12,108][106225] Updated weights for policy 1, policy_version 1832518 (0.0007) [2023-12-28 08:24:12,173][106225] Updated weights for policy 1, policy_version 1832528 (0.0008) [2023-12-28 08:24:12,235][106225] Updated weights for policy 1, policy_version 1832538 (0.0008) [2023-12-28 08:24:12,430][106226] Updated weights for policy 0, policy_version 1828402 (0.0008) [2023-12-28 08:24:12,494][106226] Updated weights for policy 0, policy_version 1828412 (0.0009) [2023-12-28 08:24:12,563][106226] Updated weights for policy 0, policy_version 1828422 (0.0008) [2023-12-28 08:24:13,015][106225] Updated weights for policy 1, policy_version 1832548 (0.0008) [2023-12-28 08:24:13,071][106225] Updated weights for policy 1, policy_version 1832558 (0.0009) [2023-12-28 08:24:13,129][106225] Updated weights for policy 1, policy_version 1832568 (0.0011) [2023-12-28 08:24:13,178][106226] Updated weights for policy 0, policy_version 1828432 (0.0006) [2023-12-28 08:24:13,241][106226] Updated weights for policy 0, policy_version 1828442 (0.0009) [2023-12-28 08:24:13,297][106226] Updated weights for policy 0, policy_version 1828452 (0.0010) [2023-12-28 08:24:13,720][106225] Updated weights for policy 1, policy_version 1832578 (0.0010) [2023-12-28 08:24:13,782][106225] Updated weights for policy 1, policy_version 1832588 (0.0009) [2023-12-28 08:24:13,838][106225] Updated weights for policy 1, policy_version 1832598 (0.0005) [2023-12-28 08:24:13,898][106225] Updated weights for policy 1, policy_version 1832608 (0.0009) [2023-12-28 08:24:13,906][106226] Updated weights for policy 0, policy_version 1828462 (0.0008) [2023-12-28 08:24:13,965][106226] Updated weights for policy 0, policy_version 1828472 (0.0007) [2023-12-28 08:24:14,028][106226] Updated weights for policy 0, policy_version 1828482 (0.0009) [2023-12-28 08:24:14,580][106225] Updated weights for policy 1, policy_version 1832618 (0.0008) [2023-12-28 08:24:14,642][106225] Updated weights for policy 1, policy_version 1832628 (0.0007) [2023-12-28 08:24:14,689][106226] Updated weights for policy 0, policy_version 1828492 (0.0007) [2023-12-28 08:24:14,701][106225] Updated weights for policy 1, policy_version 1832638 (0.0008) [2023-12-28 08:24:14,740][106226] Updated weights for policy 0, policy_version 1828502 (0.0008) [2023-12-28 08:24:14,803][106226] Updated weights for policy 0, policy_version 1828512 (0.0009) [2023-12-28 08:24:15,447][106226] Updated weights for policy 0, policy_version 1828522 (0.0006) [2023-12-28 08:24:15,500][106225] Updated weights for policy 1, policy_version 1832648 (0.0007) [2023-12-28 08:24:15,504][106226] Updated weights for policy 0, policy_version 1828532 (0.0007) [2023-12-28 08:24:15,551][106225] Updated weights for policy 1, policy_version 1832658 (0.0008) [2023-12-28 08:24:15,564][106226] Updated weights for policy 0, policy_version 1828542 (0.0006) [2023-12-28 08:24:15,598][106225] Updated weights for policy 1, policy_version 1832668 (0.0007) [2023-12-28 08:24:15,629][106226] Updated weights for policy 0, policy_version 1828552 (0.0009) [2023-12-28 08:24:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 937410560. Throughput: 0: 9771.7, 1: 9945.7. Samples: 937404288. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:16,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.625')] [2023-12-28 08:24:16,303][106226] Updated weights for policy 0, policy_version 1828562 (0.0011) [2023-12-28 08:24:16,338][106225] Updated weights for policy 1, policy_version 1832678 (0.0007) [2023-12-28 08:24:16,363][106226] Updated weights for policy 0, policy_version 1828572 (0.0010) [2023-12-28 08:24:16,381][106225] Updated weights for policy 1, policy_version 1832688 (0.0007) [2023-12-28 08:24:16,423][106226] Updated weights for policy 0, policy_version 1828582 (0.0011) [2023-12-28 08:24:16,429][106225] Updated weights for policy 1, policy_version 1832698 (0.0006) [2023-12-28 08:24:17,068][106226] Updated weights for policy 0, policy_version 1828592 (0.0006) [2023-12-28 08:24:17,127][106226] Updated weights for policy 0, policy_version 1828602 (0.0006) [2023-12-28 08:24:17,140][106225] Updated weights for policy 1, policy_version 1832708 (0.0008) [2023-12-28 08:24:17,185][106226] Updated weights for policy 0, policy_version 1828612 (0.0007) [2023-12-28 08:24:17,199][106225] Updated weights for policy 1, policy_version 1832718 (0.0006) [2023-12-28 08:24:17,256][106225] Updated weights for policy 1, policy_version 1832728 (0.0008) [2023-12-28 08:24:17,815][106226] Updated weights for policy 0, policy_version 1828622 (0.0007) [2023-12-28 08:24:17,884][106226] Updated weights for policy 0, policy_version 1828632 (0.0006) [2023-12-28 08:24:17,919][106225] Updated weights for policy 1, policy_version 1832738 (0.0007) [2023-12-28 08:24:17,945][106226] Updated weights for policy 0, policy_version 1828642 (0.0006) [2023-12-28 08:24:17,972][106225] Updated weights for policy 1, policy_version 1832748 (0.0007) [2023-12-28 08:24:18,020][106225] Updated weights for policy 1, policy_version 1832758 (0.0008) [2023-12-28 08:24:18,066][106225] Updated weights for policy 1, policy_version 1832768 (0.0007) [2023-12-28 08:24:18,558][106226] Updated weights for policy 0, policy_version 1828652 (0.0008) [2023-12-28 08:24:18,619][106226] Updated weights for policy 0, policy_version 1828662 (0.0010) [2023-12-28 08:24:18,679][106226] Updated weights for policy 0, policy_version 1828672 (0.0011) [2023-12-28 08:24:18,824][106225] Updated weights for policy 1, policy_version 1832778 (0.0007) [2023-12-28 08:24:18,890][106225] Updated weights for policy 1, policy_version 1832788 (0.0008) [2023-12-28 08:24:18,954][106225] Updated weights for policy 1, policy_version 1832798 (0.0007) [2023-12-28 08:24:19,322][106226] Updated weights for policy 0, policy_version 1828682 (0.0010) [2023-12-28 08:24:19,389][106226] Updated weights for policy 0, policy_version 1828692 (0.0009) [2023-12-28 08:24:19,450][106226] Updated weights for policy 0, policy_version 1828702 (0.0009) [2023-12-28 08:24:19,514][106226] Updated weights for policy 0, policy_version 1828712 (0.0008) [2023-12-28 08:24:19,718][106225] Updated weights for policy 1, policy_version 1832808 (0.0010) [2023-12-28 08:24:19,778][106225] Updated weights for policy 1, policy_version 1832818 (0.0010) [2023-12-28 08:24:19,835][106225] Updated weights for policy 1, policy_version 1832828 (0.0008) [2023-12-28 08:24:20,344][106226] Updated weights for policy 0, policy_version 1828722 (0.0010) [2023-12-28 08:24:20,399][106226] Updated weights for policy 0, policy_version 1828732 (0.0009) [2023-12-28 08:24:20,450][106226] Updated weights for policy 0, policy_version 1828742 (0.0008) [2023-12-28 08:24:20,520][106225] Updated weights for policy 1, policy_version 1832838 (0.0008) [2023-12-28 08:24:20,582][106225] Updated weights for policy 1, policy_version 1832848 (0.0008) [2023-12-28 08:24:20,645][106225] Updated weights for policy 1, policy_version 1832858 (0.0009) [2023-12-28 08:24:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 937508864. Throughput: 0: 9751.5, 1: 9897.7. Samples: 937522556. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:21,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.795')] [2023-12-28 08:24:21,217][106226] Updated weights for policy 0, policy_version 1828752 (0.0010) [2023-12-28 08:24:21,295][106226] Updated weights for policy 0, policy_version 1828762 (0.0010) [2023-12-28 08:24:21,364][106226] Updated weights for policy 0, policy_version 1828772 (0.0011) [2023-12-28 08:24:21,498][106225] Updated weights for policy 1, policy_version 1832868 (0.0010) [2023-12-28 08:24:21,563][106225] Updated weights for policy 1, policy_version 1832878 (0.0011) [2023-12-28 08:24:21,631][106225] Updated weights for policy 1, policy_version 1832888 (0.0009) [2023-12-28 08:24:22,100][106226] Updated weights for policy 0, policy_version 1828782 (0.0009) [2023-12-28 08:24:22,159][106226] Updated weights for policy 0, policy_version 1828792 (0.0011) [2023-12-28 08:24:22,222][106226] Updated weights for policy 0, policy_version 1828802 (0.0011) [2023-12-28 08:24:22,406][106225] Updated weights for policy 1, policy_version 1832898 (0.0008) [2023-12-28 08:24:22,465][106225] Updated weights for policy 1, policy_version 1832908 (0.0008) [2023-12-28 08:24:22,527][106225] Updated weights for policy 1, policy_version 1832918 (0.0008) [2023-12-28 08:24:22,594][106225] Updated weights for policy 1, policy_version 1832928 (0.0008) [2023-12-28 08:24:22,983][106226] Updated weights for policy 0, policy_version 1828812 (0.0010) [2023-12-28 08:24:23,045][106226] Updated weights for policy 0, policy_version 1828822 (0.0008) [2023-12-28 08:24:23,101][106226] Updated weights for policy 0, policy_version 1828832 (0.0008) [2023-12-28 08:24:23,364][106225] Updated weights for policy 1, policy_version 1832938 (0.0009) [2023-12-28 08:24:23,427][106225] Updated weights for policy 1, policy_version 1832948 (0.0008) [2023-12-28 08:24:23,490][106225] Updated weights for policy 1, policy_version 1832958 (0.0008) [2023-12-28 08:24:23,732][106226] Updated weights for policy 0, policy_version 1828842 (0.0006) [2023-12-28 08:24:23,789][106226] Updated weights for policy 0, policy_version 1828852 (0.0009) [2023-12-28 08:24:23,848][106226] Updated weights for policy 0, policy_version 1828862 (0.0009) [2023-12-28 08:24:23,904][106226] Updated weights for policy 0, policy_version 1828872 (0.0008) [2023-12-28 08:24:24,208][106225] Updated weights for policy 1, policy_version 1832968 (0.0008) [2023-12-28 08:24:24,270][106225] Updated weights for policy 1, policy_version 1832978 (0.0008) [2023-12-28 08:24:24,325][106225] Updated weights for policy 1, policy_version 1832988 (0.0008) [2023-12-28 08:24:24,605][106226] Updated weights for policy 0, policy_version 1828882 (0.0011) [2023-12-28 08:24:24,657][106226] Updated weights for policy 0, policy_version 1828892 (0.0010) [2023-12-28 08:24:24,711][106226] Updated weights for policy 0, policy_version 1828902 (0.0010) [2023-12-28 08:24:25,057][106225] Updated weights for policy 1, policy_version 1832998 (0.0007) [2023-12-28 08:24:25,103][106225] Updated weights for policy 1, policy_version 1833008 (0.0005) [2023-12-28 08:24:25,150][106225] Updated weights for policy 1, policy_version 1833018 (0.0005) [2023-12-28 08:24:25,424][106226] Updated weights for policy 0, policy_version 1828912 (0.0010) [2023-12-28 08:24:25,478][106226] Updated weights for policy 0, policy_version 1828922 (0.0011) [2023-12-28 08:24:25,529][106226] Updated weights for policy 0, policy_version 1828932 (0.0011) [2023-12-28 08:24:25,737][106225] Updated weights for policy 1, policy_version 1833028 (0.0006) [2023-12-28 08:24:25,805][106225] Updated weights for policy 1, policy_version 1833038 (0.0005) [2023-12-28 08:24:25,866][106225] Updated weights for policy 1, policy_version 1833048 (0.0008) [2023-12-28 08:24:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 937607168. Throughput: 0: 9733.1, 1: 9871.3. Samples: 937577876. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:26,175][105115] Avg episode reward: [(0, '-4.577'), (1, '-4.672')] [2023-12-28 08:24:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001833056_469319680.pth... [2023-12-28 08:24:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001828936_468287488.pth... [2023-12-28 08:24:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001831936_469032960.pth [2023-12-28 08:24:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001827784_467992576.pth [2023-12-28 08:24:26,265][106226] Updated weights for policy 0, policy_version 1828942 (0.0011) [2023-12-28 08:24:26,320][106226] Updated weights for policy 0, policy_version 1828952 (0.0010) [2023-12-28 08:24:26,376][106226] Updated weights for policy 0, policy_version 1828962 (0.0010) [2023-12-28 08:24:26,559][106225] Updated weights for policy 1, policy_version 1833058 (0.0008) [2023-12-28 08:24:26,609][106225] Updated weights for policy 1, policy_version 1833068 (0.0008) [2023-12-28 08:24:26,668][106225] Updated weights for policy 1, policy_version 1833078 (0.0007) [2023-12-28 08:24:26,721][106225] Updated weights for policy 1, policy_version 1833088 (0.0007) [2023-12-28 08:24:27,085][106226] Updated weights for policy 0, policy_version 1828972 (0.0011) [2023-12-28 08:24:27,137][106226] Updated weights for policy 0, policy_version 1828982 (0.0010) [2023-12-28 08:24:27,189][106226] Updated weights for policy 0, policy_version 1828992 (0.0010) [2023-12-28 08:24:27,413][106225] Updated weights for policy 1, policy_version 1833098 (0.0008) [2023-12-28 08:24:27,462][106225] Updated weights for policy 1, policy_version 1833108 (0.0007) [2023-12-28 08:24:27,514][106225] Updated weights for policy 1, policy_version 1833118 (0.0007) [2023-12-28 08:24:27,910][106226] Updated weights for policy 0, policy_version 1829002 (0.0010) [2023-12-28 08:24:27,962][106226] Updated weights for policy 0, policy_version 1829012 (0.0010) [2023-12-28 08:24:28,028][106226] Updated weights for policy 0, policy_version 1829022 (0.0011) [2023-12-28 08:24:28,090][106226] Updated weights for policy 0, policy_version 1829032 (0.0010) [2023-12-28 08:24:28,245][106225] Updated weights for policy 1, policy_version 1833128 (0.0008) [2023-12-28 08:24:28,307][106225] Updated weights for policy 1, policy_version 1833138 (0.0007) [2023-12-28 08:24:28,364][106225] Updated weights for policy 1, policy_version 1833148 (0.0008) [2023-12-28 08:24:28,821][106226] Updated weights for policy 0, policy_version 1829042 (0.0010) [2023-12-28 08:24:28,878][106226] Updated weights for policy 0, policy_version 1829052 (0.0010) [2023-12-28 08:24:28,928][106226] Updated weights for policy 0, policy_version 1829062 (0.0010) [2023-12-28 08:24:29,003][106225] Updated weights for policy 1, policy_version 1833158 (0.0009) [2023-12-28 08:24:29,067][106225] Updated weights for policy 1, policy_version 1833168 (0.0006) [2023-12-28 08:24:29,130][106225] Updated weights for policy 1, policy_version 1833178 (0.0005) [2023-12-28 08:24:29,678][106226] Updated weights for policy 0, policy_version 1829072 (0.0011) [2023-12-28 08:24:29,740][106226] Updated weights for policy 0, policy_version 1829082 (0.0010) [2023-12-28 08:24:29,796][106226] Updated weights for policy 0, policy_version 1829092 (0.0010) [2023-12-28 08:24:29,797][106225] Updated weights for policy 1, policy_version 1833188 (0.0008) [2023-12-28 08:24:29,859][106225] Updated weights for policy 1, policy_version 1833198 (0.0009) [2023-12-28 08:24:29,931][106225] Updated weights for policy 1, policy_version 1833208 (0.0009) [2023-12-28 08:24:30,523][106226] Updated weights for policy 0, policy_version 1829102 (0.0010) [2023-12-28 08:24:30,572][106226] Updated weights for policy 0, policy_version 1829112 (0.0010) [2023-12-28 08:24:30,635][106226] Updated weights for policy 0, policy_version 1829122 (0.0010) [2023-12-28 08:24:30,637][106225] Updated weights for policy 1, policy_version 1833218 (0.0010) [2023-12-28 08:24:30,697][106225] Updated weights for policy 1, policy_version 1833228 (0.0009) [2023-12-28 08:24:30,759][106225] Updated weights for policy 1, policy_version 1833238 (0.0010) [2023-12-28 08:24:30,814][106225] Updated weights for policy 1, policy_version 1833248 (0.0010) [2023-12-28 08:24:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 937705472. Throughput: 0: 9785.3, 1: 9924.2. Samples: 937697620. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-28 08:24:31,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.753')] [2023-12-28 08:24:31,307][106226] Updated weights for policy 0, policy_version 1829132 (0.0011) [2023-12-28 08:24:31,381][106226] Updated weights for policy 0, policy_version 1829142 (0.0009) [2023-12-28 08:24:31,442][106226] Updated weights for policy 0, policy_version 1829152 (0.0009) [2023-12-28 08:24:31,519][106225] Updated weights for policy 1, policy_version 1833258 (0.0006) [2023-12-28 08:24:31,585][106225] Updated weights for policy 1, policy_version 1833268 (0.0005) [2023-12-28 08:24:31,671][106225] Updated weights for policy 1, policy_version 1833278 (0.0006) [2023-12-28 08:24:32,233][106226] Updated weights for policy 0, policy_version 1829162 (0.0008) [2023-12-28 08:24:32,302][106226] Updated weights for policy 0, policy_version 1829172 (0.0008) [2023-12-28 08:24:32,303][106225] Updated weights for policy 1, policy_version 1833288 (0.0006) [2023-12-28 08:24:32,367][106225] Updated weights for policy 1, policy_version 1833298 (0.0008) [2023-12-28 08:24:32,370][106226] Updated weights for policy 0, policy_version 1829182 (0.0007) [2023-12-28 08:24:32,424][106225] Updated weights for policy 1, policy_version 1833308 (0.0006) [2023-12-28 08:24:32,430][106226] Updated weights for policy 0, policy_version 1829192 (0.0009) [2023-12-28 08:24:33,035][106226] Updated weights for policy 0, policy_version 1829202 (0.0009) [2023-12-28 08:24:33,095][106226] Updated weights for policy 0, policy_version 1829212 (0.0009) [2023-12-28 08:24:33,134][106225] Updated weights for policy 1, policy_version 1833318 (0.0006) [2023-12-28 08:24:33,154][106226] Updated weights for policy 0, policy_version 1829222 (0.0009) [2023-12-28 08:24:33,182][106225] Updated weights for policy 1, policy_version 1833328 (0.0005) [2023-12-28 08:24:33,242][106225] Updated weights for policy 1, policy_version 1833338 (0.0005) [2023-12-28 08:24:33,806][106225] Updated weights for policy 1, policy_version 1833348 (0.0007) [2023-12-28 08:24:33,854][106225] Updated weights for policy 1, policy_version 1833358 (0.0009) [2023-12-28 08:24:33,900][106225] Updated weights for policy 1, policy_version 1833368 (0.0008) [2023-12-28 08:24:33,905][106226] Updated weights for policy 0, policy_version 1829232 (0.0006) [2023-12-28 08:24:33,952][106226] Updated weights for policy 0, policy_version 1829242 (0.0005) [2023-12-28 08:24:33,998][106226] Updated weights for policy 0, policy_version 1829252 (0.0005) [2023-12-28 08:24:34,626][106226] Updated weights for policy 0, policy_version 1829262 (0.0007) [2023-12-28 08:24:34,660][106225] Updated weights for policy 1, policy_version 1833378 (0.0007) [2023-12-28 08:24:34,683][106226] Updated weights for policy 0, policy_version 1829272 (0.0009) [2023-12-28 08:24:34,721][106225] Updated weights for policy 1, policy_version 1833388 (0.0006) [2023-12-28 08:24:34,743][106226] Updated weights for policy 0, policy_version 1829282 (0.0008) [2023-12-28 08:24:34,781][106225] Updated weights for policy 1, policy_version 1833398 (0.0006) [2023-12-28 08:24:34,839][106225] Updated weights for policy 1, policy_version 1833408 (0.0005) [2023-12-28 08:24:35,427][106225] Updated weights for policy 1, policy_version 1833418 (0.0008) [2023-12-28 08:24:35,490][106225] Updated weights for policy 1, policy_version 1833428 (0.0008) [2023-12-28 08:24:35,535][106226] Updated weights for policy 0, policy_version 1829292 (0.0007) [2023-12-28 08:24:35,555][106225] Updated weights for policy 1, policy_version 1833438 (0.0008) [2023-12-28 08:24:35,595][106226] Updated weights for policy 0, policy_version 1829302 (0.0008) [2023-12-28 08:24:35,651][106226] Updated weights for policy 0, policy_version 1829312 (0.0010) [2023-12-28 08:24:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 937803776. Throughput: 0: 9859.0, 1: 9869.6. Samples: 937817136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:24:36,175][105115] Avg episode reward: [(0, '-4.619'), (1, '-4.717')] [2023-12-28 08:24:36,242][106225] Updated weights for policy 1, policy_version 1833448 (0.0009) [2023-12-28 08:24:36,300][106226] Updated weights for policy 0, policy_version 1829322 (0.0007) [2023-12-28 08:24:36,303][106225] Updated weights for policy 1, policy_version 1833458 (0.0007) [2023-12-28 08:24:36,360][106226] Updated weights for policy 0, policy_version 1829332 (0.0007) [2023-12-28 08:24:36,362][106225] Updated weights for policy 1, policy_version 1833468 (0.0006) [2023-12-28 08:24:36,421][106226] Updated weights for policy 0, policy_version 1829342 (0.0008) [2023-12-28 08:24:36,481][106226] Updated weights for policy 0, policy_version 1829352 (0.0008) [2023-12-28 08:24:37,114][106226] Updated weights for policy 0, policy_version 1829362 (0.0006) [2023-12-28 08:24:37,174][106225] Updated weights for policy 1, policy_version 1833478 (0.0005) [2023-12-28 08:24:37,183][106226] Updated weights for policy 0, policy_version 1829372 (0.0010) [2023-12-28 08:24:37,240][106225] Updated weights for policy 1, policy_version 1833488 (0.0006) [2023-12-28 08:24:37,253][106226] Updated weights for policy 0, policy_version 1829382 (0.0011) [2023-12-28 08:24:37,305][106225] Updated weights for policy 1, policy_version 1833498 (0.0008) [2023-12-28 08:24:37,945][106226] Updated weights for policy 0, policy_version 1829392 (0.0007) [2023-12-28 08:24:38,001][106226] Updated weights for policy 0, policy_version 1829402 (0.0005) [2023-12-28 08:24:38,055][106225] Updated weights for policy 1, policy_version 1833508 (0.0008) [2023-12-28 08:24:38,064][106226] Updated weights for policy 0, policy_version 1829412 (0.0005) [2023-12-28 08:24:38,107][106225] Updated weights for policy 1, policy_version 1833518 (0.0010) [2023-12-28 08:24:38,161][106225] Updated weights for policy 1, policy_version 1833528 (0.0008) [2023-12-28 08:24:38,688][106226] Updated weights for policy 0, policy_version 1829422 (0.0009) [2023-12-28 08:24:38,746][106226] Updated weights for policy 0, policy_version 1829432 (0.0010) [2023-12-28 08:24:38,806][106226] Updated weights for policy 0, policy_version 1829442 (0.0010) [2023-12-28 08:24:38,893][106225] Updated weights for policy 1, policy_version 1833538 (0.0008) [2023-12-28 08:24:38,957][106225] Updated weights for policy 1, policy_version 1833548 (0.0006) [2023-12-28 08:24:39,014][106225] Updated weights for policy 1, policy_version 1833558 (0.0008) [2023-12-28 08:24:39,063][106225] Updated weights for policy 1, policy_version 1833568 (0.0008) [2023-12-28 08:24:39,499][106226] Updated weights for policy 0, policy_version 1829452 (0.0008) [2023-12-28 08:24:39,566][106226] Updated weights for policy 0, policy_version 1829462 (0.0006) [2023-12-28 08:24:39,642][106226] Updated weights for policy 0, policy_version 1829472 (0.0007) [2023-12-28 08:24:39,863][106225] Updated weights for policy 1, policy_version 1833578 (0.0008) [2023-12-28 08:24:39,929][106225] Updated weights for policy 1, policy_version 1833588 (0.0008) [2023-12-28 08:24:39,993][106225] Updated weights for policy 1, policy_version 1833598 (0.0007) [2023-12-28 08:24:40,337][106226] Updated weights for policy 0, policy_version 1829482 (0.0011) [2023-12-28 08:24:40,402][106226] Updated weights for policy 0, policy_version 1829492 (0.0011) [2023-12-28 08:24:40,453][106226] Updated weights for policy 0, policy_version 1829502 (0.0010) [2023-12-28 08:24:40,513][106226] Updated weights for policy 0, policy_version 1829512 (0.0009) [2023-12-28 08:24:40,718][106225] Updated weights for policy 1, policy_version 1833608 (0.0008) [2023-12-28 08:24:40,772][106225] Updated weights for policy 1, policy_version 1833618 (0.0008) [2023-12-28 08:24:40,823][106225] Updated weights for policy 1, policy_version 1833628 (0.0007) [2023-12-28 08:24:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 937902080. Throughput: 0: 9878.9, 1: 9868.3. Samples: 937875708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:24:41,176][105115] Avg episode reward: [(0, '-4.532'), (1, '-4.814')] [2023-12-28 08:24:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001829512_468434944.pth... [2023-12-28 08:24:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001833632_469467136.pth... [2023-12-28 08:24:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001828360_468140032.pth [2023-12-28 08:24:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001832512_469180416.pth [2023-12-28 08:24:41,271][106226] Updated weights for policy 0, policy_version 1829522 (0.0009) [2023-12-28 08:24:41,340][106226] Updated weights for policy 0, policy_version 1829532 (0.0011) [2023-12-28 08:24:41,412][106226] Updated weights for policy 0, policy_version 1829542 (0.0010) [2023-12-28 08:24:41,550][106225] Updated weights for policy 1, policy_version 1833638 (0.0008) [2023-12-28 08:24:41,605][106225] Updated weights for policy 1, policy_version 1833648 (0.0010) [2023-12-28 08:24:41,674][106225] Updated weights for policy 1, policy_version 1833658 (0.0008) [2023-12-28 08:24:42,107][106226] Updated weights for policy 0, policy_version 1829552 (0.0008) [2023-12-28 08:24:42,163][106226] Updated weights for policy 0, policy_version 1829562 (0.0008) [2023-12-28 08:24:42,222][106226] Updated weights for policy 0, policy_version 1829572 (0.0008) [2023-12-28 08:24:42,381][106225] Updated weights for policy 1, policy_version 1833668 (0.0008) [2023-12-28 08:24:42,455][106225] Updated weights for policy 1, policy_version 1833678 (0.0008) [2023-12-28 08:24:42,518][106225] Updated weights for policy 1, policy_version 1833688 (0.0009) [2023-12-28 08:24:42,962][106226] Updated weights for policy 0, policy_version 1829582 (0.0007) [2023-12-28 08:24:43,024][106226] Updated weights for policy 0, policy_version 1829592 (0.0006) [2023-12-28 08:24:43,088][106226] Updated weights for policy 0, policy_version 1829602 (0.0006) [2023-12-28 08:24:43,267][106225] Updated weights for policy 1, policy_version 1833698 (0.0008) [2023-12-28 08:24:43,333][106225] Updated weights for policy 1, policy_version 1833708 (0.0008) [2023-12-28 08:24:43,391][106225] Updated weights for policy 1, policy_version 1833718 (0.0009) [2023-12-28 08:24:43,444][106225] Updated weights for policy 1, policy_version 1833728 (0.0008) [2023-12-28 08:24:43,610][106226] Updated weights for policy 0, policy_version 1829612 (0.0005) [2023-12-28 08:24:43,666][106226] Updated weights for policy 0, policy_version 1829622 (0.0005) [2023-12-28 08:24:43,722][106226] Updated weights for policy 0, policy_version 1829632 (0.0005) [2023-12-28 08:24:44,147][106225] Updated weights for policy 1, policy_version 1833738 (0.0008) [2023-12-28 08:24:44,200][106225] Updated weights for policy 1, policy_version 1833748 (0.0008) [2023-12-28 08:24:44,249][106225] Updated weights for policy 1, policy_version 1833758 (0.0009) [2023-12-28 08:24:44,303][106226] Updated weights for policy 0, policy_version 1829642 (0.0005) [2023-12-28 08:24:44,362][106226] Updated weights for policy 0, policy_version 1829652 (0.0007) [2023-12-28 08:24:44,426][106226] Updated weights for policy 0, policy_version 1829662 (0.0008) [2023-12-28 08:24:44,482][106226] Updated weights for policy 0, policy_version 1829672 (0.0008) [2023-12-28 08:24:44,975][106225] Updated weights for policy 1, policy_version 1833768 (0.0008) [2023-12-28 08:24:45,036][106225] Updated weights for policy 1, policy_version 1833778 (0.0009) [2023-12-28 08:24:45,098][106225] Updated weights for policy 1, policy_version 1833788 (0.0007) [2023-12-28 08:24:45,147][106226] Updated weights for policy 0, policy_version 1829682 (0.0008) [2023-12-28 08:24:45,208][106226] Updated weights for policy 0, policy_version 1829692 (0.0009) [2023-12-28 08:24:45,272][106226] Updated weights for policy 0, policy_version 1829702 (0.0009) [2023-12-28 08:24:45,822][106225] Updated weights for policy 1, policy_version 1833798 (0.0007) [2023-12-28 08:24:45,870][106225] Updated weights for policy 1, policy_version 1833808 (0.0008) [2023-12-28 08:24:45,922][106225] Updated weights for policy 1, policy_version 1833818 (0.0008) [2023-12-28 08:24:45,994][106226] Updated weights for policy 0, policy_version 1829712 (0.0009) [2023-12-28 08:24:46,053][106226] Updated weights for policy 0, policy_version 1829722 (0.0008) [2023-12-28 08:24:46,113][106226] Updated weights for policy 0, policy_version 1829732 (0.0009) [2023-12-28 08:24:46,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 938008576. Throughput: 0: 9939.4, 1: 9734.0. Samples: 937994672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:24:46,176][105115] Avg episode reward: [(0, '-4.290'), (1, '-4.518')] [2023-12-28 08:24:46,698][106225] Updated weights for policy 1, policy_version 1833828 (0.0008) [2023-12-28 08:24:46,743][106226] Updated weights for policy 0, policy_version 1829742 (0.0007) [2023-12-28 08:24:46,751][106225] Updated weights for policy 1, policy_version 1833838 (0.0008) [2023-12-28 08:24:46,791][106226] Updated weights for policy 0, policy_version 1829752 (0.0008) [2023-12-28 08:24:46,809][106225] Updated weights for policy 1, policy_version 1833848 (0.0007) [2023-12-28 08:24:46,838][106226] Updated weights for policy 0, policy_version 1829762 (0.0005) [2023-12-28 08:24:47,541][106225] Updated weights for policy 1, policy_version 1833858 (0.0007) [2023-12-28 08:24:47,584][106226] Updated weights for policy 0, policy_version 1829772 (0.0007) [2023-12-28 08:24:47,603][106225] Updated weights for policy 1, policy_version 1833868 (0.0007) [2023-12-28 08:24:47,644][106226] Updated weights for policy 0, policy_version 1829782 (0.0010) [2023-12-28 08:24:47,659][106225] Updated weights for policy 1, policy_version 1833878 (0.0006) [2023-12-28 08:24:47,701][106226] Updated weights for policy 0, policy_version 1829793 (0.0008) [2023-12-28 08:24:47,719][106225] Updated weights for policy 1, policy_version 1833888 (0.0007) [2023-12-28 08:24:48,305][106225] Updated weights for policy 1, policy_version 1833898 (0.0005) [2023-12-28 08:24:48,369][106225] Updated weights for policy 1, policy_version 1833908 (0.0007) [2023-12-28 08:24:48,432][106225] Updated weights for policy 1, policy_version 1833918 (0.0006) [2023-12-28 08:24:48,527][106226] Updated weights for policy 0, policy_version 1829803 (0.0008) [2023-12-28 08:24:48,599][106226] Updated weights for policy 0, policy_version 1829813 (0.0006) [2023-12-28 08:24:48,662][106226] Updated weights for policy 0, policy_version 1829823 (0.0008) [2023-12-28 08:24:49,131][106225] Updated weights for policy 1, policy_version 1833928 (0.0009) [2023-12-28 08:24:49,197][106225] Updated weights for policy 1, policy_version 1833938 (0.0010) [2023-12-28 08:24:49,217][106226] Updated weights for policy 0, policy_version 1829833 (0.0006) [2023-12-28 08:24:49,259][106225] Updated weights for policy 1, policy_version 1833948 (0.0008) [2023-12-28 08:24:49,280][106226] Updated weights for policy 0, policy_version 1829843 (0.0007) [2023-12-28 08:24:49,342][106226] Updated weights for policy 0, policy_version 1829853 (0.0007) [2023-12-28 08:24:49,414][106226] Updated weights for policy 0, policy_version 1829863 (0.0009) [2023-12-28 08:24:49,969][106225] Updated weights for policy 1, policy_version 1833958 (0.0011) [2023-12-28 08:24:50,033][106225] Updated weights for policy 1, policy_version 1833968 (0.0010) [2023-12-28 08:24:50,099][106225] Updated weights for policy 1, policy_version 1833978 (0.0010) [2023-12-28 08:24:50,149][106226] Updated weights for policy 0, policy_version 1829873 (0.0008) [2023-12-28 08:24:50,200][106226] Updated weights for policy 0, policy_version 1829883 (0.0008) [2023-12-28 08:24:50,256][106226] Updated weights for policy 0, policy_version 1829893 (0.0008) [2023-12-28 08:24:50,821][106225] Updated weights for policy 1, policy_version 1833988 (0.0011) [2023-12-28 08:24:50,875][106225] Updated weights for policy 1, policy_version 1833998 (0.0010) [2023-12-28 08:24:50,933][106225] Updated weights for policy 1, policy_version 1834008 (0.0010) [2023-12-28 08:24:50,991][106226] Updated weights for policy 0, policy_version 1829903 (0.0006) [2023-12-28 08:24:51,052][106226] Updated weights for policy 0, policy_version 1829913 (0.0007) [2023-12-28 08:24:51,110][106226] Updated weights for policy 0, policy_version 1829923 (0.0008) [2023-12-28 08:24:51,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 938106880. Throughput: 0: 9887.0, 1: 9689.3. Samples: 938111568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:24:51,175][105115] Avg episode reward: [(0, '-4.116'), (1, '-4.697')] [2023-12-28 08:24:51,718][106225] Updated weights for policy 1, policy_version 1834018 (0.0010) [2023-12-28 08:24:51,791][106225] Updated weights for policy 1, policy_version 1834028 (0.0008) [2023-12-28 08:24:51,851][106226] Updated weights for policy 0, policy_version 1829933 (0.0009) [2023-12-28 08:24:51,854][106225] Updated weights for policy 1, policy_version 1834038 (0.0009) [2023-12-28 08:24:51,910][106226] Updated weights for policy 0, policy_version 1829943 (0.0007) [2023-12-28 08:24:51,913][106225] Updated weights for policy 1, policy_version 1834048 (0.0007) [2023-12-28 08:24:51,975][106226] Updated weights for policy 0, policy_version 1829953 (0.0008) [2023-12-28 08:24:52,590][106225] Updated weights for policy 1, policy_version 1834058 (0.0009) [2023-12-28 08:24:52,648][106225] Updated weights for policy 1, policy_version 1834068 (0.0008) [2023-12-28 08:24:52,707][106225] Updated weights for policy 1, policy_version 1834078 (0.0009) [2023-12-28 08:24:52,763][106226] Updated weights for policy 0, policy_version 1829963 (0.0009) [2023-12-28 08:24:52,827][106226] Updated weights for policy 0, policy_version 1829973 (0.0008) [2023-12-28 08:24:52,890][106226] Updated weights for policy 0, policy_version 1829983 (0.0009) [2023-12-28 08:24:53,392][106225] Updated weights for policy 1, policy_version 1834088 (0.0008) [2023-12-28 08:24:53,450][106225] Updated weights for policy 1, policy_version 1834098 (0.0008) [2023-12-28 08:24:53,512][106225] Updated weights for policy 1, policy_version 1834108 (0.0009) [2023-12-28 08:24:53,628][106226] Updated weights for policy 0, policy_version 1829993 (0.0010) [2023-12-28 08:24:53,684][106226] Updated weights for policy 0, policy_version 1830003 (0.0009) [2023-12-28 08:24:53,736][106226] Updated weights for policy 0, policy_version 1830013 (0.0009) [2023-12-28 08:24:53,785][106226] Updated weights for policy 0, policy_version 1830023 (0.0008) [2023-12-28 08:24:54,210][106225] Updated weights for policy 1, policy_version 1834118 (0.0008) [2023-12-28 08:24:54,277][106225] Updated weights for policy 1, policy_version 1834128 (0.0008) [2023-12-28 08:24:54,339][106225] Updated weights for policy 1, policy_version 1834138 (0.0008) [2023-12-28 08:24:54,538][106226] Updated weights for policy 0, policy_version 1830033 (0.0006) [2023-12-28 08:24:54,602][106226] Updated weights for policy 0, policy_version 1830043 (0.0008) [2023-12-28 08:24:54,647][106226] Updated weights for policy 0, policy_version 1830053 (0.0008) [2023-12-28 08:24:55,044][106225] Updated weights for policy 1, policy_version 1834148 (0.0009) [2023-12-28 08:24:55,097][106225] Updated weights for policy 1, policy_version 1834158 (0.0009) [2023-12-28 08:24:55,156][106225] Updated weights for policy 1, policy_version 1834168 (0.0009) [2023-12-28 08:24:55,309][106226] Updated weights for policy 0, policy_version 1830063 (0.0009) [2023-12-28 08:24:55,363][106226] Updated weights for policy 0, policy_version 1830073 (0.0008) [2023-12-28 08:24:55,419][106226] Updated weights for policy 0, policy_version 1830083 (0.0009) [2023-12-28 08:24:55,799][106225] Updated weights for policy 1, policy_version 1834178 (0.0008) [2023-12-28 08:24:55,852][106225] Updated weights for policy 1, policy_version 1834188 (0.0005) [2023-12-28 08:24:55,905][106225] Updated weights for policy 1, policy_version 1834198 (0.0005) [2023-12-28 08:24:55,958][106225] Updated weights for policy 1, policy_version 1834208 (0.0007) [2023-12-28 08:24:56,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 938196992. Throughput: 0: 9868.2, 1: 9691.0. Samples: 938168220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:24:56,175][105115] Avg episode reward: [(0, '-4.537'), (1, '-4.773')] [2023-12-28 08:24:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001830088_468582400.pth... [2023-12-28 08:24:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001834208_469614592.pth... [2023-12-28 08:24:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001833056_469319680.pth [2023-12-28 08:24:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001828936_468287488.pth [2023-12-28 08:24:56,252][106226] Updated weights for policy 0, policy_version 1830093 (0.0008) [2023-12-28 08:24:56,302][106226] Updated weights for policy 0, policy_version 1830103 (0.0009) [2023-12-28 08:24:56,355][106226] Updated weights for policy 0, policy_version 1830113 (0.0008) [2023-12-28 08:24:56,524][106225] Updated weights for policy 1, policy_version 1834218 (0.0005) [2023-12-28 08:24:56,577][106225] Updated weights for policy 1, policy_version 1834228 (0.0008) [2023-12-28 08:24:56,624][106225] Updated weights for policy 1, policy_version 1834238 (0.0007) [2023-12-28 08:24:56,956][106226] Updated weights for policy 0, policy_version 1830123 (0.0007) [2023-12-28 08:24:57,010][106226] Updated weights for policy 0, policy_version 1830133 (0.0010) [2023-12-28 08:24:57,061][106226] Updated weights for policy 0, policy_version 1830143 (0.0010) [2023-12-28 08:24:57,365][106225] Updated weights for policy 1, policy_version 1834248 (0.0010) [2023-12-28 08:24:57,411][106225] Updated weights for policy 1, policy_version 1834258 (0.0010) [2023-12-28 08:24:57,470][106225] Updated weights for policy 1, policy_version 1834268 (0.0010) [2023-12-28 08:24:57,768][106226] Updated weights for policy 0, policy_version 1830153 (0.0010) [2023-12-28 08:24:57,824][106226] Updated weights for policy 0, policy_version 1830163 (0.0010) [2023-12-28 08:24:57,887][106226] Updated weights for policy 0, policy_version 1830173 (0.0010) [2023-12-28 08:24:57,946][106226] Updated weights for policy 0, policy_version 1830183 (0.0010) [2023-12-28 08:24:58,065][106225] Updated weights for policy 1, policy_version 1834278 (0.0007) [2023-12-28 08:24:58,112][106225] Updated weights for policy 1, policy_version 1834288 (0.0005) [2023-12-28 08:24:58,168][106225] Updated weights for policy 1, policy_version 1834298 (0.0006) [2023-12-28 08:24:58,637][106226] Updated weights for policy 0, policy_version 1830193 (0.0008) [2023-12-28 08:24:58,699][106226] Updated weights for policy 0, policy_version 1830203 (0.0008) [2023-12-28 08:24:58,770][106226] Updated weights for policy 0, policy_version 1830213 (0.0009) [2023-12-28 08:24:58,931][106225] Updated weights for policy 1, policy_version 1834308 (0.0008) [2023-12-28 08:24:58,987][106225] Updated weights for policy 1, policy_version 1834318 (0.0010) [2023-12-28 08:24:59,045][106225] Updated weights for policy 1, policy_version 1834328 (0.0010) [2023-12-28 08:24:59,541][106226] Updated weights for policy 0, policy_version 1830223 (0.0008) [2023-12-28 08:24:59,599][106226] Updated weights for policy 0, policy_version 1830233 (0.0005) [2023-12-28 08:24:59,664][106226] Updated weights for policy 0, policy_version 1830243 (0.0006) [2023-12-28 08:24:59,831][106225] Updated weights for policy 1, policy_version 1834338 (0.0010) [2023-12-28 08:24:59,896][106225] Updated weights for policy 1, policy_version 1834348 (0.0006) [2023-12-28 08:24:59,961][106225] Updated weights for policy 1, policy_version 1834358 (0.0009) [2023-12-28 08:25:00,019][106225] Updated weights for policy 1, policy_version 1834368 (0.0010) [2023-12-28 08:25:00,359][106226] Updated weights for policy 0, policy_version 1830253 (0.0008) [2023-12-28 08:25:00,413][106226] Updated weights for policy 0, policy_version 1830263 (0.0009) [2023-12-28 08:25:00,461][106226] Updated weights for policy 0, policy_version 1830273 (0.0008) [2023-12-28 08:25:00,643][106225] Updated weights for policy 1, policy_version 1834378 (0.0005) [2023-12-28 08:25:00,698][106225] Updated weights for policy 1, policy_version 1834388 (0.0007) [2023-12-28 08:25:00,758][106225] Updated weights for policy 1, policy_version 1834398 (0.0006) [2023-12-28 08:25:01,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 938295296. Throughput: 0: 9855.3, 1: 9780.2. Samples: 938287884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:01,175][105115] Avg episode reward: [(0, '-4.598'), (1, '-4.970')] [2023-12-28 08:25:01,214][106226] Updated weights for policy 0, policy_version 1830283 (0.0008) [2023-12-28 08:25:01,273][106226] Updated weights for policy 0, policy_version 1830293 (0.0008) [2023-12-28 08:25:01,331][106226] Updated weights for policy 0, policy_version 1830303 (0.0006) [2023-12-28 08:25:01,416][106225] Updated weights for policy 1, policy_version 1834408 (0.0008) [2023-12-28 08:25:01,481][106225] Updated weights for policy 1, policy_version 1834418 (0.0008) [2023-12-28 08:25:01,546][106225] Updated weights for policy 1, policy_version 1834428 (0.0009) [2023-12-28 08:25:02,065][106226] Updated weights for policy 0, policy_version 1830313 (0.0008) [2023-12-28 08:25:02,123][106226] Updated weights for policy 0, policy_version 1830323 (0.0008) [2023-12-28 08:25:02,183][106226] Updated weights for policy 0, policy_version 1830333 (0.0009) [2023-12-28 08:25:02,238][106225] Updated weights for policy 1, policy_version 1834438 (0.0008) [2023-12-28 08:25:02,240][106226] Updated weights for policy 0, policy_version 1830343 (0.0008) [2023-12-28 08:25:02,303][106225] Updated weights for policy 1, policy_version 1834448 (0.0006) [2023-12-28 08:25:02,364][106225] Updated weights for policy 1, policy_version 1834458 (0.0007) [2023-12-28 08:25:02,951][106225] Updated weights for policy 1, policy_version 1834468 (0.0009) [2023-12-28 08:25:02,998][106226] Updated weights for policy 0, policy_version 1830353 (0.0006) [2023-12-28 08:25:02,998][106225] Updated weights for policy 1, policy_version 1834478 (0.0009) [2023-12-28 08:25:03,044][106225] Updated weights for policy 1, policy_version 1834488 (0.0005) [2023-12-28 08:25:03,050][106226] Updated weights for policy 0, policy_version 1830363 (0.0008) [2023-12-28 08:25:03,099][106226] Updated weights for policy 0, policy_version 1830373 (0.0007) [2023-12-28 08:25:03,680][106226] Updated weights for policy 0, policy_version 1830383 (0.0006) [2023-12-28 08:25:03,702][106225] Updated weights for policy 1, policy_version 1834498 (0.0006) [2023-12-28 08:25:03,730][106226] Updated weights for policy 0, policy_version 1830393 (0.0008) [2023-12-28 08:25:03,751][106225] Updated weights for policy 1, policy_version 1834508 (0.0007) [2023-12-28 08:25:03,777][106226] Updated weights for policy 0, policy_version 1830403 (0.0006) [2023-12-28 08:25:03,798][106225] Updated weights for policy 1, policy_version 1834518 (0.0007) [2023-12-28 08:25:03,861][106225] Updated weights for policy 1, policy_version 1834528 (0.0009) [2023-12-28 08:25:04,403][106226] Updated weights for policy 0, policy_version 1830413 (0.0006) [2023-12-28 08:25:04,451][106226] Updated weights for policy 0, policy_version 1830423 (0.0007) [2023-12-28 08:25:04,500][106226] Updated weights for policy 0, policy_version 1830433 (0.0006) [2023-12-28 08:25:04,558][106225] Updated weights for policy 1, policy_version 1834538 (0.0005) [2023-12-28 08:25:04,605][106225] Updated weights for policy 1, policy_version 1834548 (0.0005) [2023-12-28 08:25:04,656][106225] Updated weights for policy 1, policy_version 1834558 (0.0005) [2023-12-28 08:25:05,251][106226] Updated weights for policy 0, policy_version 1830443 (0.0009) [2023-12-28 08:25:05,312][106226] Updated weights for policy 0, policy_version 1830453 (0.0009) [2023-12-28 08:25:05,341][106225] Updated weights for policy 1, policy_version 1834568 (0.0006) [2023-12-28 08:25:05,370][106226] Updated weights for policy 0, policy_version 1830463 (0.0008) [2023-12-28 08:25:05,397][106225] Updated weights for policy 1, policy_version 1834578 (0.0006) [2023-12-28 08:25:05,450][106225] Updated weights for policy 1, policy_version 1834588 (0.0006) [2023-12-28 08:25:06,068][106225] Updated weights for policy 1, policy_version 1834598 (0.0006) [2023-12-28 08:25:06,133][106225] Updated weights for policy 1, policy_version 1834608 (0.0007) [2023-12-28 08:25:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 938393600. Throughput: 0: 9814.7, 1: 9910.6. Samples: 938410192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:06,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.798')] [2023-12-28 08:25:06,192][106226] Updated weights for policy 0, policy_version 1830473 (0.0008) [2023-12-28 08:25:06,201][106225] Updated weights for policy 1, policy_version 1834618 (0.0007) [2023-12-28 08:25:06,257][106226] Updated weights for policy 0, policy_version 1830483 (0.0007) [2023-12-28 08:25:06,320][106226] Updated weights for policy 0, policy_version 1830493 (0.0007) [2023-12-28 08:25:06,382][106226] Updated weights for policy 0, policy_version 1830503 (0.0009) [2023-12-28 08:25:06,819][106225] Updated weights for policy 1, policy_version 1834628 (0.0007) [2023-12-28 08:25:06,871][106225] Updated weights for policy 1, policy_version 1834638 (0.0008) [2023-12-28 08:25:06,924][106225] Updated weights for policy 1, policy_version 1834648 (0.0007) [2023-12-28 08:25:07,136][106226] Updated weights for policy 0, policy_version 1830513 (0.0008) [2023-12-28 08:25:07,191][106226] Updated weights for policy 0, policy_version 1830523 (0.0009) [2023-12-28 08:25:07,244][106226] Updated weights for policy 0, policy_version 1830533 (0.0009) [2023-12-28 08:25:07,578][106225] Updated weights for policy 1, policy_version 1834658 (0.0006) [2023-12-28 08:25:07,631][106225] Updated weights for policy 1, policy_version 1834668 (0.0010) [2023-12-28 08:25:07,678][106225] Updated weights for policy 1, policy_version 1834678 (0.0010) [2023-12-28 08:25:07,732][106225] Updated weights for policy 1, policy_version 1834688 (0.0009) [2023-12-28 08:25:07,942][106226] Updated weights for policy 0, policy_version 1830543 (0.0008) [2023-12-28 08:25:08,005][106226] Updated weights for policy 0, policy_version 1830553 (0.0007) [2023-12-28 08:25:08,068][106226] Updated weights for policy 0, policy_version 1830563 (0.0008) [2023-12-28 08:25:08,490][106225] Updated weights for policy 1, policy_version 1834698 (0.0008) [2023-12-28 08:25:08,546][106225] Updated weights for policy 1, policy_version 1834708 (0.0008) [2023-12-28 08:25:08,600][106225] Updated weights for policy 1, policy_version 1834718 (0.0008) [2023-12-28 08:25:08,783][106226] Updated weights for policy 0, policy_version 1830573 (0.0009) [2023-12-28 08:25:08,843][106226] Updated weights for policy 0, policy_version 1830583 (0.0010) [2023-12-28 08:25:08,906][106226] Updated weights for policy 0, policy_version 1830593 (0.0009) [2023-12-28 08:25:09,315][106225] Updated weights for policy 1, policy_version 1834728 (0.0009) [2023-12-28 08:25:09,389][106225] Updated weights for policy 1, policy_version 1834738 (0.0010) [2023-12-28 08:25:09,450][106225] Updated weights for policy 1, policy_version 1834748 (0.0007) [2023-12-28 08:25:09,689][106226] Updated weights for policy 0, policy_version 1830603 (0.0008) [2023-12-28 08:25:09,753][106226] Updated weights for policy 0, policy_version 1830613 (0.0009) [2023-12-28 08:25:09,818][106226] Updated weights for policy 0, policy_version 1830623 (0.0009) [2023-12-28 08:25:10,174][106225] Updated weights for policy 1, policy_version 1834758 (0.0009) [2023-12-28 08:25:10,233][106225] Updated weights for policy 1, policy_version 1834768 (0.0010) [2023-12-28 08:25:10,298][106225] Updated weights for policy 1, policy_version 1834778 (0.0008) [2023-12-28 08:25:10,505][106226] Updated weights for policy 0, policy_version 1830633 (0.0008) [2023-12-28 08:25:10,569][106226] Updated weights for policy 0, policy_version 1830643 (0.0010) [2023-12-28 08:25:10,626][106226] Updated weights for policy 0, policy_version 1830653 (0.0011) [2023-12-28 08:25:10,685][106226] Updated weights for policy 0, policy_version 1830663 (0.0010) [2023-12-28 08:25:10,978][106225] Updated weights for policy 1, policy_version 1834788 (0.0009) [2023-12-28 08:25:11,038][106225] Updated weights for policy 1, policy_version 1834798 (0.0009) [2023-12-28 08:25:11,100][106225] Updated weights for policy 1, policy_version 1834808 (0.0008) [2023-12-28 08:25:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 938500096. Throughput: 0: 9802.4, 1: 9979.2. Samples: 938468048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:11,175][105115] Avg episode reward: [(0, '-4.146'), (1, '-4.685')] [2023-12-28 08:25:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001834816_469770240.pth... [2023-12-28 08:25:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001830664_468729856.pth... [2023-12-28 08:25:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001833632_469467136.pth [2023-12-28 08:25:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001829512_468434944.pth [2023-12-28 08:25:11,309][106226] Updated weights for policy 0, policy_version 1830673 (0.0009) [2023-12-28 08:25:11,377][106226] Updated weights for policy 0, policy_version 1830683 (0.0008) [2023-12-28 08:25:11,433][106226] Updated weights for policy 0, policy_version 1830693 (0.0007) [2023-12-28 08:25:11,947][106225] Updated weights for policy 1, policy_version 1834818 (0.0008) [2023-12-28 08:25:12,009][106225] Updated weights for policy 1, policy_version 1834828 (0.0007) [2023-12-28 08:25:12,070][106225] Updated weights for policy 1, policy_version 1834838 (0.0008) [2023-12-28 08:25:12,122][106226] Updated weights for policy 0, policy_version 1830703 (0.0007) [2023-12-28 08:25:12,134][106225] Updated weights for policy 1, policy_version 1834848 (0.0005) [2023-12-28 08:25:12,183][106226] Updated weights for policy 0, policy_version 1830713 (0.0009) [2023-12-28 08:25:12,242][106226] Updated weights for policy 0, policy_version 1830723 (0.0008) [2023-12-28 08:25:12,852][106225] Updated weights for policy 1, policy_version 1834858 (0.0010) [2023-12-28 08:25:12,909][106225] Updated weights for policy 1, policy_version 1834868 (0.0010) [2023-12-28 08:25:12,960][106225] Updated weights for policy 1, policy_version 1834878 (0.0010) [2023-12-28 08:25:13,043][106226] Updated weights for policy 0, policy_version 1830733 (0.0008) [2023-12-28 08:25:13,089][106226] Updated weights for policy 0, policy_version 1830743 (0.0008) [2023-12-28 08:25:13,146][106226] Updated weights for policy 0, policy_version 1830753 (0.0008) [2023-12-28 08:25:13,678][106225] Updated weights for policy 1, policy_version 1834888 (0.0010) [2023-12-28 08:25:13,732][106225] Updated weights for policy 1, policy_version 1834898 (0.0010) [2023-12-28 08:25:13,781][106225] Updated weights for policy 1, policy_version 1834908 (0.0010) [2023-12-28 08:25:13,902][106226] Updated weights for policy 0, policy_version 1830763 (0.0007) [2023-12-28 08:25:13,964][106226] Updated weights for policy 0, policy_version 1830773 (0.0006) [2023-12-28 08:25:14,025][106226] Updated weights for policy 0, policy_version 1830783 (0.0006) [2023-12-28 08:25:14,463][106225] Updated weights for policy 1, policy_version 1834918 (0.0007) [2023-12-28 08:25:14,532][106225] Updated weights for policy 1, policy_version 1834928 (0.0005) [2023-12-28 08:25:14,581][106225] Updated weights for policy 1, policy_version 1834938 (0.0005) [2023-12-28 08:25:14,655][106226] Updated weights for policy 0, policy_version 1830793 (0.0006) [2023-12-28 08:25:14,718][106226] Updated weights for policy 0, policy_version 1830803 (0.0007) [2023-12-28 08:25:14,771][106226] Updated weights for policy 0, policy_version 1830813 (0.0007) [2023-12-28 08:25:14,839][106226] Updated weights for policy 0, policy_version 1830823 (0.0008) [2023-12-28 08:25:15,241][106225] Updated weights for policy 1, policy_version 1834948 (0.0007) [2023-12-28 08:25:15,297][106225] Updated weights for policy 1, policy_version 1834958 (0.0011) [2023-12-28 08:25:15,360][106225] Updated weights for policy 1, policy_version 1834968 (0.0011) [2023-12-28 08:25:15,456][106226] Updated weights for policy 0, policy_version 1830833 (0.0008) [2023-12-28 08:25:15,506][106226] Updated weights for policy 0, policy_version 1830843 (0.0005) [2023-12-28 08:25:15,560][106226] Updated weights for policy 0, policy_version 1830853 (0.0008) [2023-12-28 08:25:16,095][106225] Updated weights for policy 1, policy_version 1834978 (0.0010) [2023-12-28 08:25:16,146][106225] Updated weights for policy 1, policy_version 1834988 (0.0010) [2023-12-28 08:25:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 938590208. Throughput: 0: 9806.4, 1: 9898.3. Samples: 938584332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:16,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.460')] [2023-12-28 08:25:16,189][106226] Updated weights for policy 0, policy_version 1830863 (0.0007) [2023-12-28 08:25:16,194][106225] Updated weights for policy 1, policy_version 1834998 (0.0010) [2023-12-28 08:25:16,242][106226] Updated weights for policy 0, policy_version 1830873 (0.0006) [2023-12-28 08:25:16,250][106225] Updated weights for policy 1, policy_version 1835008 (0.0010) [2023-12-28 08:25:16,291][106226] Updated weights for policy 0, policy_version 1830883 (0.0008) [2023-12-28 08:25:16,958][106226] Updated weights for policy 0, policy_version 1830893 (0.0006) [2023-12-28 08:25:16,985][106225] Updated weights for policy 1, policy_version 1835018 (0.0010) [2023-12-28 08:25:17,011][106226] Updated weights for policy 0, policy_version 1830903 (0.0005) [2023-12-28 08:25:17,045][106225] Updated weights for policy 1, policy_version 1835028 (0.0010) [2023-12-28 08:25:17,065][106226] Updated weights for policy 0, policy_version 1830913 (0.0011) [2023-12-28 08:25:17,095][106225] Updated weights for policy 1, policy_version 1835038 (0.0010) [2023-12-28 08:25:17,601][106226] Updated weights for policy 0, policy_version 1830923 (0.0010) [2023-12-28 08:25:17,658][106226] Updated weights for policy 0, policy_version 1830933 (0.0008) [2023-12-28 08:25:17,718][106226] Updated weights for policy 0, policy_version 1830943 (0.0008) [2023-12-28 08:25:17,816][106225] Updated weights for policy 1, policy_version 1835048 (0.0010) [2023-12-28 08:25:17,875][106225] Updated weights for policy 1, policy_version 1835058 (0.0010) [2023-12-28 08:25:17,940][106225] Updated weights for policy 1, policy_version 1835068 (0.0005) [2023-12-28 08:25:18,404][106226] Updated weights for policy 0, policy_version 1830953 (0.0008) [2023-12-28 08:25:18,468][106226] Updated weights for policy 0, policy_version 1830963 (0.0008) [2023-12-28 08:25:18,531][106226] Updated weights for policy 0, policy_version 1830973 (0.0008) [2023-12-28 08:25:18,572][106225] Updated weights for policy 1, policy_version 1835078 (0.0006) [2023-12-28 08:25:18,586][106226] Updated weights for policy 0, policy_version 1830983 (0.0007) [2023-12-28 08:25:18,619][106225] Updated weights for policy 1, policy_version 1835088 (0.0007) [2023-12-28 08:25:18,669][106225] Updated weights for policy 1, policy_version 1835098 (0.0008) [2023-12-28 08:25:19,253][106226] Updated weights for policy 0, policy_version 1830993 (0.0009) [2023-12-28 08:25:19,320][106226] Updated weights for policy 0, policy_version 1831003 (0.0007) [2023-12-28 08:25:19,389][106226] Updated weights for policy 0, policy_version 1831013 (0.0011) [2023-12-28 08:25:19,549][106225] Updated weights for policy 1, policy_version 1835108 (0.0008) [2023-12-28 08:25:19,614][106225] Updated weights for policy 1, policy_version 1835118 (0.0009) [2023-12-28 08:25:19,678][106225] Updated weights for policy 1, policy_version 1835128 (0.0008) [2023-12-28 08:25:20,126][106226] Updated weights for policy 0, policy_version 1831023 (0.0011) [2023-12-28 08:25:20,190][106226] Updated weights for policy 0, policy_version 1831033 (0.0011) [2023-12-28 08:25:20,255][106226] Updated weights for policy 0, policy_version 1831043 (0.0011) [2023-12-28 08:25:20,465][106225] Updated weights for policy 1, policy_version 1835138 (0.0008) [2023-12-28 08:25:20,523][106225] Updated weights for policy 1, policy_version 1835148 (0.0008) [2023-12-28 08:25:20,587][106225] Updated weights for policy 1, policy_version 1835158 (0.0008) [2023-12-28 08:25:20,644][106225] Updated weights for policy 1, policy_version 1835168 (0.0008) [2023-12-28 08:25:21,000][106226] Updated weights for policy 0, policy_version 1831053 (0.0011) [2023-12-28 08:25:21,067][106226] Updated weights for policy 0, policy_version 1831063 (0.0009) [2023-12-28 08:25:21,138][106226] Updated weights for policy 0, policy_version 1831073 (0.0010) [2023-12-28 08:25:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 938688512. Throughput: 0: 9867.0, 1: 9812.6. Samples: 938702712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:21,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.527')] [2023-12-28 08:25:21,404][106225] Updated weights for policy 1, policy_version 1835178 (0.0014) [2023-12-28 08:25:21,459][106225] Updated weights for policy 1, policy_version 1835188 (0.0009) [2023-12-28 08:25:21,518][106225] Updated weights for policy 1, policy_version 1835198 (0.0009) [2023-12-28 08:25:21,898][106226] Updated weights for policy 0, policy_version 1831083 (0.0010) [2023-12-28 08:25:21,956][106226] Updated weights for policy 0, policy_version 1831093 (0.0011) [2023-12-28 08:25:22,011][106226] Updated weights for policy 0, policy_version 1831103 (0.0011) [2023-12-28 08:25:22,287][106225] Updated weights for policy 1, policy_version 1835208 (0.0008) [2023-12-28 08:25:22,354][106225] Updated weights for policy 1, policy_version 1835218 (0.0008) [2023-12-28 08:25:22,420][106225] Updated weights for policy 1, policy_version 1835228 (0.0009) [2023-12-28 08:25:22,772][106226] Updated weights for policy 0, policy_version 1831113 (0.0010) [2023-12-28 08:25:22,826][106226] Updated weights for policy 0, policy_version 1831123 (0.0008) [2023-12-28 08:25:22,881][106226] Updated weights for policy 0, policy_version 1831133 (0.0009) [2023-12-28 08:25:22,933][106226] Updated weights for policy 0, policy_version 1831143 (0.0009) [2023-12-28 08:25:23,220][106225] Updated weights for policy 1, policy_version 1835238 (0.0008) [2023-12-28 08:25:23,276][106225] Updated weights for policy 1, policy_version 1835248 (0.0009) [2023-12-28 08:25:23,328][106225] Updated weights for policy 1, policy_version 1835258 (0.0009) [2023-12-28 08:25:23,723][106226] Updated weights for policy 0, policy_version 1831153 (0.0009) [2023-12-28 08:25:23,791][106226] Updated weights for policy 0, policy_version 1831163 (0.0008) [2023-12-28 08:25:23,836][106226] Updated weights for policy 0, policy_version 1831173 (0.0007) [2023-12-28 08:25:23,971][106225] Updated weights for policy 1, policy_version 1835268 (0.0009) [2023-12-28 08:25:24,018][106225] Updated weights for policy 1, policy_version 1835278 (0.0010) [2023-12-28 08:25:24,072][106225] Updated weights for policy 1, policy_version 1835288 (0.0010) [2023-12-28 08:25:24,529][106226] Updated weights for policy 0, policy_version 1831183 (0.0007) [2023-12-28 08:25:24,593][106226] Updated weights for policy 0, policy_version 1831193 (0.0006) [2023-12-28 08:25:24,655][106226] Updated weights for policy 0, policy_version 1831203 (0.0005) [2023-12-28 08:25:24,816][106225] Updated weights for policy 1, policy_version 1835298 (0.0010) [2023-12-28 08:25:24,872][106225] Updated weights for policy 1, policy_version 1835308 (0.0010) [2023-12-28 08:25:24,936][106225] Updated weights for policy 1, policy_version 1835318 (0.0010) [2023-12-28 08:25:25,000][106225] Updated weights for policy 1, policy_version 1835328 (0.0009) [2023-12-28 08:25:25,286][106226] Updated weights for policy 0, policy_version 1831213 (0.0008) [2023-12-28 08:25:25,340][106226] Updated weights for policy 0, policy_version 1831223 (0.0010) [2023-12-28 08:25:25,386][106226] Updated weights for policy 0, policy_version 1831233 (0.0005) [2023-12-28 08:25:25,675][106225] Updated weights for policy 1, policy_version 1835338 (0.0006) [2023-12-28 08:25:25,732][106225] Updated weights for policy 1, policy_version 1835348 (0.0006) [2023-12-28 08:25:25,794][106225] Updated weights for policy 1, policy_version 1835358 (0.0006) [2023-12-28 08:25:26,047][106226] Updated weights for policy 0, policy_version 1831243 (0.0007) [2023-12-28 08:25:26,111][106226] Updated weights for policy 0, policy_version 1831253 (0.0011) [2023-12-28 08:25:26,173][106226] Updated weights for policy 0, policy_version 1831263 (0.0009) [2023-12-28 08:25:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 938786816. Throughput: 0: 9804.3, 1: 9831.1. Samples: 938759296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:26,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.545')] [2023-12-28 08:25:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001835360_469909504.pth... [2023-12-28 08:25:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001834208_469614592.pth [2023-12-28 08:25:26,225][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001831272_468885504.pth... [2023-12-28 08:25:26,229][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001830088_468582400.pth [2023-12-28 08:25:26,427][106225] Updated weights for policy 1, policy_version 1835368 (0.0007) [2023-12-28 08:25:26,473][106225] Updated weights for policy 1, policy_version 1835378 (0.0010) [2023-12-28 08:25:26,519][106225] Updated weights for policy 1, policy_version 1835388 (0.0010) [2023-12-28 08:25:26,744][106226] Updated weights for policy 0, policy_version 1831273 (0.0009) [2023-12-28 08:25:26,800][106226] Updated weights for policy 0, policy_version 1831283 (0.0005) [2023-12-28 08:25:26,852][106226] Updated weights for policy 0, policy_version 1831293 (0.0005) [2023-12-28 08:25:26,905][106226] Updated weights for policy 0, policy_version 1831303 (0.0005) [2023-12-28 08:25:27,207][106225] Updated weights for policy 1, policy_version 1835398 (0.0010) [2023-12-28 08:25:27,266][106225] Updated weights for policy 1, policy_version 1835408 (0.0010) [2023-12-28 08:25:27,320][106225] Updated weights for policy 1, policy_version 1835418 (0.0010) [2023-12-28 08:25:27,452][106226] Updated weights for policy 0, policy_version 1831313 (0.0005) [2023-12-28 08:25:27,517][106226] Updated weights for policy 0, policy_version 1831323 (0.0005) [2023-12-28 08:25:27,583][106226] Updated weights for policy 0, policy_version 1831333 (0.0005) [2023-12-28 08:25:28,055][106225] Updated weights for policy 1, policy_version 1835428 (0.0010) [2023-12-28 08:25:28,108][106225] Updated weights for policy 1, policy_version 1835438 (0.0010) [2023-12-28 08:25:28,157][106225] Updated weights for policy 1, policy_version 1835448 (0.0010) [2023-12-28 08:25:28,205][106226] Updated weights for policy 0, policy_version 1831343 (0.0006) [2023-12-28 08:25:28,254][106226] Updated weights for policy 0, policy_version 1831353 (0.0007) [2023-12-28 08:25:28,301][106226] Updated weights for policy 0, policy_version 1831363 (0.0008) [2023-12-28 08:25:28,889][106225] Updated weights for policy 1, policy_version 1835458 (0.0010) [2023-12-28 08:25:28,890][106226] Updated weights for policy 0, policy_version 1831373 (0.0009) [2023-12-28 08:25:28,939][106225] Updated weights for policy 1, policy_version 1835468 (0.0010) [2023-12-28 08:25:28,950][106226] Updated weights for policy 0, policy_version 1831383 (0.0010) [2023-12-28 08:25:29,000][106225] Updated weights for policy 1, policy_version 1835478 (0.0010) [2023-12-28 08:25:29,006][106226] Updated weights for policy 0, policy_version 1831393 (0.0010) [2023-12-28 08:25:29,053][106225] Updated weights for policy 1, policy_version 1835488 (0.0008) [2023-12-28 08:25:29,719][106226] Updated weights for policy 0, policy_version 1831403 (0.0010) [2023-12-28 08:25:29,768][106226] Updated weights for policy 0, policy_version 1831413 (0.0006) [2023-12-28 08:25:29,784][106225] Updated weights for policy 1, policy_version 1835498 (0.0010) [2023-12-28 08:25:29,821][106226] Updated weights for policy 0, policy_version 1831423 (0.0008) [2023-12-28 08:25:29,838][106225] Updated weights for policy 1, policy_version 1835508 (0.0010) [2023-12-28 08:25:29,898][106225] Updated weights for policy 1, policy_version 1835518 (0.0010) [2023-12-28 08:25:30,619][106226] Updated weights for policy 0, policy_version 1831433 (0.0007) [2023-12-28 08:25:30,644][106225] Updated weights for policy 1, policy_version 1835528 (0.0010) [2023-12-28 08:25:30,676][106226] Updated weights for policy 0, policy_version 1831443 (0.0005) [2023-12-28 08:25:30,696][106225] Updated weights for policy 1, policy_version 1835538 (0.0010) [2023-12-28 08:25:30,735][106226] Updated weights for policy 0, policy_version 1831453 (0.0005) [2023-12-28 08:25:30,752][106225] Updated weights for policy 1, policy_version 1835548 (0.0010) [2023-12-28 08:25:30,790][106226] Updated weights for policy 0, policy_version 1831463 (0.0008) [2023-12-28 08:25:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 938893312. Throughput: 0: 9883.5, 1: 9871.7. Samples: 938883652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:31,175][105115] Avg episode reward: [(0, '-4.646'), (1, '-4.570')] [2023-12-28 08:25:31,486][106225] Updated weights for policy 1, policy_version 1835558 (0.0010) [2023-12-28 08:25:31,516][106226] Updated weights for policy 0, policy_version 1831473 (0.0009) [2023-12-28 08:25:31,544][106225] Updated weights for policy 1, policy_version 1835568 (0.0010) [2023-12-28 08:25:31,569][106226] Updated weights for policy 0, policy_version 1831483 (0.0010) [2023-12-28 08:25:31,605][106225] Updated weights for policy 1, policy_version 1835578 (0.0009) [2023-12-28 08:25:31,632][106226] Updated weights for policy 0, policy_version 1831493 (0.0012) [2023-12-28 08:25:32,270][106225] Updated weights for policy 1, policy_version 1835588 (0.0008) [2023-12-28 08:25:32,323][106225] Updated weights for policy 1, policy_version 1835598 (0.0007) [2023-12-28 08:25:32,368][106226] Updated weights for policy 0, policy_version 1831503 (0.0009) [2023-12-28 08:25:32,388][106225] Updated weights for policy 1, policy_version 1835608 (0.0008) [2023-12-28 08:25:32,430][106226] Updated weights for policy 0, policy_version 1831513 (0.0008) [2023-12-28 08:25:32,492][106226] Updated weights for policy 0, policy_version 1831523 (0.0009) [2023-12-28 08:25:33,062][106225] Updated weights for policy 1, policy_version 1835618 (0.0009) [2023-12-28 08:25:33,109][106225] Updated weights for policy 1, policy_version 1835628 (0.0008) [2023-12-28 08:25:33,161][106225] Updated weights for policy 1, policy_version 1835638 (0.0009) [2023-12-28 08:25:33,213][106226] Updated weights for policy 0, policy_version 1831533 (0.0008) [2023-12-28 08:25:33,214][106225] Updated weights for policy 1, policy_version 1835648 (0.0007) [2023-12-28 08:25:33,266][106226] Updated weights for policy 0, policy_version 1831543 (0.0009) [2023-12-28 08:25:33,315][106226] Updated weights for policy 0, policy_version 1831553 (0.0008) [2023-12-28 08:25:33,889][106225] Updated weights for policy 1, policy_version 1835658 (0.0010) [2023-12-28 08:25:33,951][106225] Updated weights for policy 1, policy_version 1835668 (0.0010) [2023-12-28 08:25:34,006][106225] Updated weights for policy 1, policy_version 1835678 (0.0006) [2023-12-28 08:25:34,121][106226] Updated weights for policy 0, policy_version 1831563 (0.0008) [2023-12-28 08:25:34,194][106226] Updated weights for policy 0, policy_version 1831573 (0.0011) [2023-12-28 08:25:34,259][106226] Updated weights for policy 0, policy_version 1831583 (0.0007) [2023-12-28 08:25:34,690][106225] Updated weights for policy 1, policy_version 1835688 (0.0005) [2023-12-28 08:25:34,756][106225] Updated weights for policy 1, policy_version 1835698 (0.0005) [2023-12-28 08:25:34,817][106225] Updated weights for policy 1, policy_version 1835708 (0.0006) [2023-12-28 08:25:34,948][106226] Updated weights for policy 0, policy_version 1831593 (0.0007) [2023-12-28 08:25:34,998][106226] Updated weights for policy 0, policy_version 1831603 (0.0009) [2023-12-28 08:25:35,051][106226] Updated weights for policy 0, policy_version 1831613 (0.0009) [2023-12-28 08:25:35,111][106226] Updated weights for policy 0, policy_version 1831623 (0.0009) [2023-12-28 08:25:35,454][106225] Updated weights for policy 1, policy_version 1835718 (0.0007) [2023-12-28 08:25:35,517][106225] Updated weights for policy 1, policy_version 1835728 (0.0008) [2023-12-28 08:25:35,574][106225] Updated weights for policy 1, policy_version 1835738 (0.0008) [2023-12-28 08:25:35,865][106226] Updated weights for policy 0, policy_version 1831633 (0.0007) [2023-12-28 08:25:35,923][106226] Updated weights for policy 0, policy_version 1831643 (0.0008) [2023-12-28 08:25:35,974][106226] Updated weights for policy 0, policy_version 1831653 (0.0009) [2023-12-28 08:25:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 938991616. Throughput: 0: 9846.0, 1: 9896.9. Samples: 939000000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:36,175][105115] Avg episode reward: [(0, '-4.582'), (1, '-4.993')] [2023-12-28 08:25:36,314][106225] Updated weights for policy 1, policy_version 1835748 (0.0009) [2023-12-28 08:25:36,370][106225] Updated weights for policy 1, policy_version 1835758 (0.0010) [2023-12-28 08:25:36,425][106225] Updated weights for policy 1, policy_version 1835768 (0.0009) [2023-12-28 08:25:36,720][106226] Updated weights for policy 0, policy_version 1831663 (0.0007) [2023-12-28 08:25:36,765][106226] Updated weights for policy 0, policy_version 1831673 (0.0008) [2023-12-28 08:25:36,820][106226] Updated weights for policy 0, policy_version 1831683 (0.0008) [2023-12-28 08:25:37,179][106225] Updated weights for policy 1, policy_version 1835778 (0.0009) [2023-12-28 08:25:37,241][106225] Updated weights for policy 1, policy_version 1835788 (0.0008) [2023-12-28 08:25:37,305][106225] Updated weights for policy 1, policy_version 1835798 (0.0008) [2023-12-28 08:25:37,368][106225] Updated weights for policy 1, policy_version 1835808 (0.0009) [2023-12-28 08:25:37,563][106226] Updated weights for policy 0, policy_version 1831693 (0.0009) [2023-12-28 08:25:37,612][106226] Updated weights for policy 0, policy_version 1831703 (0.0008) [2023-12-28 08:25:37,675][106226] Updated weights for policy 0, policy_version 1831713 (0.0010) [2023-12-28 08:25:38,104][106225] Updated weights for policy 1, policy_version 1835818 (0.0008) [2023-12-28 08:25:38,164][106225] Updated weights for policy 1, policy_version 1835828 (0.0006) [2023-12-28 08:25:38,226][106225] Updated weights for policy 1, policy_version 1835838 (0.0005) [2023-12-28 08:25:38,379][106226] Updated weights for policy 0, policy_version 1831723 (0.0009) [2023-12-28 08:25:38,444][106226] Updated weights for policy 0, policy_version 1831733 (0.0011) [2023-12-28 08:25:38,511][106226] Updated weights for policy 0, policy_version 1831743 (0.0011) [2023-12-28 08:25:38,834][106225] Updated weights for policy 1, policy_version 1835848 (0.0008) [2023-12-28 08:25:38,890][106225] Updated weights for policy 1, policy_version 1835858 (0.0008) [2023-12-28 08:25:38,953][106225] Updated weights for policy 1, policy_version 1835868 (0.0005) [2023-12-28 08:25:39,178][106226] Updated weights for policy 0, policy_version 1831753 (0.0008) [2023-12-28 08:25:39,230][106226] Updated weights for policy 0, policy_version 1831763 (0.0010) [2023-12-28 08:25:39,298][106226] Updated weights for policy 0, policy_version 1831773 (0.0011) [2023-12-28 08:25:39,369][106226] Updated weights for policy 0, policy_version 1831783 (0.0010) [2023-12-28 08:25:39,594][106225] Updated weights for policy 1, policy_version 1835878 (0.0006) [2023-12-28 08:25:39,658][106225] Updated weights for policy 1, policy_version 1835888 (0.0006) [2023-12-28 08:25:39,721][106225] Updated weights for policy 1, policy_version 1835898 (0.0007) [2023-12-28 08:25:40,183][106226] Updated weights for policy 0, policy_version 1831793 (0.0011) [2023-12-28 08:25:40,253][106226] Updated weights for policy 0, policy_version 1831803 (0.0011) [2023-12-28 08:25:40,319][106226] Updated weights for policy 0, policy_version 1831813 (0.0011) [2023-12-28 08:25:40,445][106225] Updated weights for policy 1, policy_version 1835908 (0.0008) [2023-12-28 08:25:40,500][106225] Updated weights for policy 1, policy_version 1835918 (0.0007) [2023-12-28 08:25:40,564][106225] Updated weights for policy 1, policy_version 1835928 (0.0008) [2023-12-28 08:25:40,998][106226] Updated weights for policy 0, policy_version 1831823 (0.0009) [2023-12-28 08:25:41,076][106226] Updated weights for policy 0, policy_version 1831833 (0.0010) [2023-12-28 08:25:41,144][106226] Updated weights for policy 0, policy_version 1831843 (0.0011) [2023-12-28 08:25:41,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.9, 300 sec: 19688.6). Total num frames: 939081728. Throughput: 0: 9886.5, 1: 9902.0. Samples: 939058700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:41,175][105115] Avg episode reward: [(0, '-4.663'), (1, '-4.590')] [2023-12-28 08:25:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001835936_470056960.pth... [2023-12-28 08:25:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001831848_469032960.pth... [2023-12-28 08:25:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001834816_469770240.pth [2023-12-28 08:25:41,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001830664_468729856.pth [2023-12-28 08:25:41,356][106225] Updated weights for policy 1, policy_version 1835938 (0.0008) [2023-12-28 08:25:41,424][106225] Updated weights for policy 1, policy_version 1835948 (0.0008) [2023-12-28 08:25:41,483][106225] Updated weights for policy 1, policy_version 1835958 (0.0009) [2023-12-28 08:25:41,543][106225] Updated weights for policy 1, policy_version 1835968 (0.0009) [2023-12-28 08:25:41,884][106226] Updated weights for policy 0, policy_version 1831853 (0.0010) [2023-12-28 08:25:41,937][106226] Updated weights for policy 0, policy_version 1831863 (0.0009) [2023-12-28 08:25:42,001][106226] Updated weights for policy 0, policy_version 1831873 (0.0009) [2023-12-28 08:25:42,383][106225] Updated weights for policy 1, policy_version 1835978 (0.0009) [2023-12-28 08:25:42,444][106225] Updated weights for policy 1, policy_version 1835988 (0.0009) [2023-12-28 08:25:42,495][106225] Updated weights for policy 1, policy_version 1835998 (0.0007) [2023-12-28 08:25:42,751][106226] Updated weights for policy 0, policy_version 1831883 (0.0009) [2023-12-28 08:25:42,807][106226] Updated weights for policy 0, policy_version 1831893 (0.0008) [2023-12-28 08:25:42,865][106226] Updated weights for policy 0, policy_version 1831903 (0.0011) [2023-12-28 08:25:43,274][106225] Updated weights for policy 1, policy_version 1836008 (0.0006) [2023-12-28 08:25:43,330][106225] Updated weights for policy 1, policy_version 1836018 (0.0009) [2023-12-28 08:25:43,393][106225] Updated weights for policy 1, policy_version 1836028 (0.0010) [2023-12-28 08:25:43,549][106226] Updated weights for policy 0, policy_version 1831913 (0.0008) [2023-12-28 08:25:43,603][106226] Updated weights for policy 0, policy_version 1831923 (0.0005) [2023-12-28 08:25:43,659][106226] Updated weights for policy 0, policy_version 1831933 (0.0005) [2023-12-28 08:25:43,712][106226] Updated weights for policy 0, policy_version 1831943 (0.0005) [2023-12-28 08:25:44,076][106225] Updated weights for policy 1, policy_version 1836038 (0.0010) [2023-12-28 08:25:44,134][106225] Updated weights for policy 1, policy_version 1836048 (0.0010) [2023-12-28 08:25:44,195][106225] Updated weights for policy 1, policy_version 1836058 (0.0006) [2023-12-28 08:25:44,345][106226] Updated weights for policy 0, policy_version 1831953 (0.0009) [2023-12-28 08:25:44,402][106226] Updated weights for policy 0, policy_version 1831963 (0.0006) [2023-12-28 08:25:44,460][106226] Updated weights for policy 0, policy_version 1831973 (0.0007) [2023-12-28 08:25:44,878][106225] Updated weights for policy 1, policy_version 1836068 (0.0005) [2023-12-28 08:25:44,934][106225] Updated weights for policy 1, policy_version 1836078 (0.0006) [2023-12-28 08:25:44,985][106225] Updated weights for policy 1, policy_version 1836088 (0.0006) [2023-12-28 08:25:45,165][106226] Updated weights for policy 0, policy_version 1831983 (0.0010) [2023-12-28 08:25:45,229][106226] Updated weights for policy 0, policy_version 1831993 (0.0010) [2023-12-28 08:25:45,291][106226] Updated weights for policy 0, policy_version 1832003 (0.0008) [2023-12-28 08:25:45,569][106225] Updated weights for policy 1, policy_version 1836098 (0.0006) [2023-12-28 08:25:45,627][106225] Updated weights for policy 1, policy_version 1836108 (0.0007) [2023-12-28 08:25:45,686][106225] Updated weights for policy 1, policy_version 1836118 (0.0007) [2023-12-28 08:25:45,745][106225] Updated weights for policy 1, policy_version 1836128 (0.0005) [2023-12-28 08:25:46,059][106226] Updated weights for policy 0, policy_version 1832013 (0.0007) [2023-12-28 08:25:46,117][106226] Updated weights for policy 0, policy_version 1832023 (0.0005) [2023-12-28 08:25:46,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19688.6). Total num frames: 939180032. Throughput: 0: 9876.8, 1: 9815.0. Samples: 939174012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:46,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.542')] [2023-12-28 08:25:46,176][106226] Updated weights for policy 0, policy_version 1832033 (0.0008) [2023-12-28 08:25:46,368][106225] Updated weights for policy 1, policy_version 1836138 (0.0005) [2023-12-28 08:25:46,414][106225] Updated weights for policy 1, policy_version 1836148 (0.0005) [2023-12-28 08:25:46,460][106225] Updated weights for policy 1, policy_version 1836158 (0.0009) [2023-12-28 08:25:46,922][106226] Updated weights for policy 0, policy_version 1832043 (0.0008) [2023-12-28 08:25:46,969][106226] Updated weights for policy 0, policy_version 1832053 (0.0008) [2023-12-28 08:25:47,020][106226] Updated weights for policy 0, policy_version 1832063 (0.0009) [2023-12-28 08:25:47,083][106225] Updated weights for policy 1, policy_version 1836168 (0.0006) [2023-12-28 08:25:47,140][106225] Updated weights for policy 1, policy_version 1836178 (0.0005) [2023-12-28 08:25:47,202][106225] Updated weights for policy 1, policy_version 1836188 (0.0008) [2023-12-28 08:25:47,705][106226] Updated weights for policy 0, policy_version 1832073 (0.0007) [2023-12-28 08:25:47,772][106226] Updated weights for policy 0, policy_version 1832083 (0.0005) [2023-12-28 08:25:47,835][106226] Updated weights for policy 0, policy_version 1832093 (0.0005) [2023-12-28 08:25:47,875][106225] Updated weights for policy 1, policy_version 1836198 (0.0010) [2023-12-28 08:25:47,895][106226] Updated weights for policy 0, policy_version 1832103 (0.0005) [2023-12-28 08:25:47,936][106225] Updated weights for policy 1, policy_version 1836208 (0.0010) [2023-12-28 08:25:47,992][106225] Updated weights for policy 1, policy_version 1836218 (0.0010) [2023-12-28 08:25:48,402][106226] Updated weights for policy 0, policy_version 1832113 (0.0006) [2023-12-28 08:25:48,467][106226] Updated weights for policy 0, policy_version 1832123 (0.0007) [2023-12-28 08:25:48,524][106226] Updated weights for policy 0, policy_version 1832133 (0.0005) [2023-12-28 08:25:48,753][106225] Updated weights for policy 1, policy_version 1836228 (0.0010) [2023-12-28 08:25:48,815][106225] Updated weights for policy 1, policy_version 1836238 (0.0007) [2023-12-28 08:25:48,870][106225] Updated weights for policy 1, policy_version 1836248 (0.0009) [2023-12-28 08:25:49,059][106226] Updated weights for policy 0, policy_version 1832143 (0.0009) [2023-12-28 08:25:49,126][106226] Updated weights for policy 0, policy_version 1832153 (0.0011) [2023-12-28 08:25:49,195][106226] Updated weights for policy 0, policy_version 1832163 (0.0011) [2023-12-28 08:25:49,527][106225] Updated weights for policy 1, policy_version 1836258 (0.0007) [2023-12-28 08:25:49,592][106225] Updated weights for policy 1, policy_version 1836268 (0.0008) [2023-12-28 08:25:49,642][106225] Updated weights for policy 1, policy_version 1836278 (0.0007) [2023-12-28 08:25:49,689][106225] Updated weights for policy 1, policy_version 1836288 (0.0007) [2023-12-28 08:25:49,976][106226] Updated weights for policy 0, policy_version 1832173 (0.0009) [2023-12-28 08:25:50,038][106226] Updated weights for policy 0, policy_version 1832183 (0.0007) [2023-12-28 08:25:50,099][106226] Updated weights for policy 0, policy_version 1832193 (0.0007) [2023-12-28 08:25:50,426][106225] Updated weights for policy 1, policy_version 1836298 (0.0010) [2023-12-28 08:25:50,480][106225] Updated weights for policy 1, policy_version 1836308 (0.0010) [2023-12-28 08:25:50,537][106225] Updated weights for policy 1, policy_version 1836318 (0.0010) [2023-12-28 08:25:50,862][106226] Updated weights for policy 0, policy_version 1832203 (0.0007) [2023-12-28 08:25:50,927][106226] Updated weights for policy 0, policy_version 1832213 (0.0006) [2023-12-28 08:25:50,980][106226] Updated weights for policy 0, policy_version 1832223 (0.0006) [2023-12-28 08:25:51,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 939286528. Throughput: 0: 9898.6, 1: 9781.6. Samples: 939295800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:51,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.697')] [2023-12-28 08:25:51,287][106225] Updated weights for policy 1, policy_version 1836328 (0.0010) [2023-12-28 08:25:51,351][106225] Updated weights for policy 1, policy_version 1836338 (0.0011) [2023-12-28 08:25:51,425][106225] Updated weights for policy 1, policy_version 1836348 (0.0010) [2023-12-28 08:25:51,723][106226] Updated weights for policy 0, policy_version 1832233 (0.0007) [2023-12-28 08:25:51,791][106226] Updated weights for policy 0, policy_version 1832243 (0.0008) [2023-12-28 08:25:51,855][106226] Updated weights for policy 0, policy_version 1832253 (0.0007) [2023-12-28 08:25:51,902][106226] Updated weights for policy 0, policy_version 1832263 (0.0008) [2023-12-28 08:25:52,159][106225] Updated weights for policy 1, policy_version 1836358 (0.0010) [2023-12-28 08:25:52,202][106225] Updated weights for policy 1, policy_version 1836368 (0.0010) [2023-12-28 08:25:52,253][106225] Updated weights for policy 1, policy_version 1836378 (0.0010) [2023-12-28 08:25:52,689][106226] Updated weights for policy 0, policy_version 1832273 (0.0008) [2023-12-28 08:25:52,744][106226] Updated weights for policy 0, policy_version 1832283 (0.0008) [2023-12-28 08:25:52,800][106226] Updated weights for policy 0, policy_version 1832293 (0.0008) [2023-12-28 08:25:53,068][106225] Updated weights for policy 1, policy_version 1836388 (0.0007) [2023-12-28 08:25:53,122][106225] Updated weights for policy 1, policy_version 1836398 (0.0008) [2023-12-28 08:25:53,184][106225] Updated weights for policy 1, policy_version 1836408 (0.0008) [2023-12-28 08:25:53,459][106226] Updated weights for policy 0, policy_version 1832303 (0.0008) [2023-12-28 08:25:53,518][106226] Updated weights for policy 0, policy_version 1832313 (0.0009) [2023-12-28 08:25:53,566][106226] Updated weights for policy 0, policy_version 1832323 (0.0008) [2023-12-28 08:25:53,824][106225] Updated weights for policy 1, policy_version 1836418 (0.0007) [2023-12-28 08:25:53,870][106225] Updated weights for policy 1, policy_version 1836428 (0.0010) [2023-12-28 08:25:53,919][106225] Updated weights for policy 1, policy_version 1836438 (0.0010) [2023-12-28 08:25:53,976][106225] Updated weights for policy 1, policy_version 1836448 (0.0010) [2023-12-28 08:25:54,284][106226] Updated weights for policy 0, policy_version 1832333 (0.0006) [2023-12-28 08:25:54,359][106226] Updated weights for policy 0, policy_version 1832343 (0.0005) [2023-12-28 08:25:54,411][106226] Updated weights for policy 0, policy_version 1832353 (0.0005) [2023-12-28 08:25:54,558][106225] Updated weights for policy 1, policy_version 1836458 (0.0010) [2023-12-28 08:25:54,614][106225] Updated weights for policy 1, policy_version 1836468 (0.0010) [2023-12-28 08:25:54,668][106225] Updated weights for policy 1, policy_version 1836478 (0.0009) [2023-12-28 08:25:55,073][106226] Updated weights for policy 0, policy_version 1832363 (0.0007) [2023-12-28 08:25:55,134][106226] Updated weights for policy 0, policy_version 1832373 (0.0008) [2023-12-28 08:25:55,192][106226] Updated weights for policy 0, policy_version 1832383 (0.0007) [2023-12-28 08:25:55,393][106225] Updated weights for policy 1, policy_version 1836488 (0.0009) [2023-12-28 08:25:55,445][106225] Updated weights for policy 1, policy_version 1836498 (0.0008) [2023-12-28 08:25:55,503][106225] Updated weights for policy 1, policy_version 1836508 (0.0005) [2023-12-28 08:25:55,842][106226] Updated weights for policy 0, policy_version 1832393 (0.0006) [2023-12-28 08:25:55,895][106226] Updated weights for policy 0, policy_version 1832403 (0.0008) [2023-12-28 08:25:55,947][106226] Updated weights for policy 0, policy_version 1832413 (0.0009) [2023-12-28 08:25:56,004][106226] Updated weights for policy 0, policy_version 1832423 (0.0006) [2023-12-28 08:25:56,146][106225] Updated weights for policy 1, policy_version 1836518 (0.0005) [2023-12-28 08:25:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939384832. Throughput: 0: 9914.2, 1: 9753.4. Samples: 939353092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:25:56,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.834')] [2023-12-28 08:25:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001832424_469180416.pth... [2023-12-28 08:25:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001831272_468885504.pth [2023-12-28 08:25:56,214][106225] Updated weights for policy 1, policy_version 1836528 (0.0008) [2023-12-28 08:25:56,277][106225] Updated weights for policy 1, policy_version 1836538 (0.0010) [2023-12-28 08:25:56,315][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001836544_470212608.pth... [2023-12-28 08:25:56,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001835360_469909504.pth [2023-12-28 08:25:56,740][106226] Updated weights for policy 0, policy_version 1832433 (0.0008) [2023-12-28 08:25:56,789][106226] Updated weights for policy 0, policy_version 1832443 (0.0008) [2023-12-28 08:25:56,835][106225] Updated weights for policy 1, policy_version 1836548 (0.0008) [2023-12-28 08:25:56,839][106226] Updated weights for policy 0, policy_version 1832453 (0.0008) [2023-12-28 08:25:56,888][106225] Updated weights for policy 1, policy_version 1836558 (0.0005) [2023-12-28 08:25:56,943][106225] Updated weights for policy 1, policy_version 1836568 (0.0005) [2023-12-28 08:25:57,438][106226] Updated weights for policy 0, policy_version 1832463 (0.0007) [2023-12-28 08:25:57,486][106226] Updated weights for policy 0, policy_version 1832473 (0.0007) [2023-12-28 08:25:57,530][106225] Updated weights for policy 1, policy_version 1836578 (0.0005) [2023-12-28 08:25:57,544][106226] Updated weights for policy 0, policy_version 1832483 (0.0009) [2023-12-28 08:25:57,581][106225] Updated weights for policy 1, policy_version 1836588 (0.0005) [2023-12-28 08:25:57,630][106225] Updated weights for policy 1, policy_version 1836598 (0.0007) [2023-12-28 08:25:57,674][106225] Updated weights for policy 1, policy_version 1836608 (0.0008) [2023-12-28 08:25:58,251][106226] Updated weights for policy 0, policy_version 1832493 (0.0007) [2023-12-28 08:25:58,314][106226] Updated weights for policy 0, policy_version 1832503 (0.0007) [2023-12-28 08:25:58,355][106225] Updated weights for policy 1, policy_version 1836618 (0.0009) [2023-12-28 08:25:58,385][106226] Updated weights for policy 0, policy_version 1832513 (0.0008) [2023-12-28 08:25:58,430][106225] Updated weights for policy 1, policy_version 1836628 (0.0009) [2023-12-28 08:25:58,497][106225] Updated weights for policy 1, policy_version 1836638 (0.0007) [2023-12-28 08:25:59,277][106225] Updated weights for policy 1, policy_version 1836648 (0.0008) [2023-12-28 08:25:59,294][106226] Updated weights for policy 0, policy_version 1832523 (0.0008) [2023-12-28 08:25:59,347][106225] Updated weights for policy 1, policy_version 1836658 (0.0007) [2023-12-28 08:25:59,365][106226] Updated weights for policy 0, policy_version 1832533 (0.0007) [2023-12-28 08:25:59,417][106225] Updated weights for policy 1, policy_version 1836668 (0.0009) [2023-12-28 08:25:59,429][106226] Updated weights for policy 0, policy_version 1832543 (0.0009) [2023-12-28 08:26:00,043][106226] Updated weights for policy 0, policy_version 1832553 (0.0007) [2023-12-28 08:26:00,097][106226] Updated weights for policy 0, policy_version 1832563 (0.0005) [2023-12-28 08:26:00,163][106226] Updated weights for policy 0, policy_version 1832573 (0.0005) [2023-12-28 08:26:00,191][106225] Updated weights for policy 1, policy_version 1836678 (0.0008) [2023-12-28 08:26:00,226][106226] Updated weights for policy 0, policy_version 1832583 (0.0006) [2023-12-28 08:26:00,245][106225] Updated weights for policy 1, policy_version 1836688 (0.0008) [2023-12-28 08:26:00,299][106225] Updated weights for policy 1, policy_version 1836698 (0.0009) [2023-12-28 08:26:00,747][106226] Updated weights for policy 0, policy_version 1832593 (0.0006) [2023-12-28 08:26:00,801][106226] Updated weights for policy 0, policy_version 1832603 (0.0005) [2023-12-28 08:26:00,863][106226] Updated weights for policy 0, policy_version 1832613 (0.0005) [2023-12-28 08:26:01,139][106225] Updated weights for policy 1, policy_version 1836708 (0.0009) [2023-12-28 08:26:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939483136. Throughput: 0: 9951.2, 1: 9864.4. Samples: 939476036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:01,175][105115] Avg episode reward: [(0, '-4.159'), (1, '-4.448')] [2023-12-28 08:26:01,204][106225] Updated weights for policy 1, policy_version 1836718 (0.0009) [2023-12-28 08:26:01,275][106225] Updated weights for policy 1, policy_version 1836728 (0.0009) [2023-12-28 08:26:01,480][106226] Updated weights for policy 0, policy_version 1832623 (0.0007) [2023-12-28 08:26:01,537][106226] Updated weights for policy 0, policy_version 1832633 (0.0009) [2023-12-28 08:26:01,594][106226] Updated weights for policy 0, policy_version 1832643 (0.0010) [2023-12-28 08:26:02,000][106225] Updated weights for policy 1, policy_version 1836738 (0.0008) [2023-12-28 08:26:02,056][106225] Updated weights for policy 1, policy_version 1836748 (0.0009) [2023-12-28 08:26:02,113][106225] Updated weights for policy 1, policy_version 1836758 (0.0007) [2023-12-28 08:26:02,164][106225] Updated weights for policy 1, policy_version 1836768 (0.0010) [2023-12-28 08:26:02,297][106226] Updated weights for policy 0, policy_version 1832653 (0.0010) [2023-12-28 08:26:02,363][106226] Updated weights for policy 0, policy_version 1832663 (0.0010) [2023-12-28 08:26:02,427][106226] Updated weights for policy 0, policy_version 1832673 (0.0011) [2023-12-28 08:26:02,933][106225] Updated weights for policy 1, policy_version 1836778 (0.0006) [2023-12-28 08:26:02,990][106225] Updated weights for policy 1, policy_version 1836788 (0.0007) [2023-12-28 08:26:03,046][106225] Updated weights for policy 1, policy_version 1836798 (0.0007) [2023-12-28 08:26:03,131][106226] Updated weights for policy 0, policy_version 1832683 (0.0010) [2023-12-28 08:26:03,179][106226] Updated weights for policy 0, policy_version 1832693 (0.0010) [2023-12-28 08:26:03,223][106226] Updated weights for policy 0, policy_version 1832703 (0.0008) [2023-12-28 08:26:03,718][106225] Updated weights for policy 1, policy_version 1836808 (0.0009) [2023-12-28 08:26:03,766][106225] Updated weights for policy 1, policy_version 1836818 (0.0008) [2023-12-28 08:26:03,816][106225] Updated weights for policy 1, policy_version 1836828 (0.0008) [2023-12-28 08:26:04,036][106226] Updated weights for policy 0, policy_version 1832713 (0.0008) [2023-12-28 08:26:04,099][106226] Updated weights for policy 0, policy_version 1832723 (0.0011) [2023-12-28 08:26:04,162][106226] Updated weights for policy 0, policy_version 1832733 (0.0011) [2023-12-28 08:26:04,226][106226] Updated weights for policy 0, policy_version 1832743 (0.0011) [2023-12-28 08:26:04,602][106225] Updated weights for policy 1, policy_version 1836838 (0.0007) [2023-12-28 08:26:04,658][106225] Updated weights for policy 1, policy_version 1836848 (0.0005) [2023-12-28 08:26:04,719][106225] Updated weights for policy 1, policy_version 1836858 (0.0005) [2023-12-28 08:26:04,955][106226] Updated weights for policy 0, policy_version 1832753 (0.0011) [2023-12-28 08:26:05,017][106226] Updated weights for policy 0, policy_version 1832763 (0.0010) [2023-12-28 08:26:05,067][106226] Updated weights for policy 0, policy_version 1832773 (0.0010) [2023-12-28 08:26:05,391][106225] Updated weights for policy 1, policy_version 1836868 (0.0008) [2023-12-28 08:26:05,451][106225] Updated weights for policy 1, policy_version 1836878 (0.0009) [2023-12-28 08:26:05,503][106225] Updated weights for policy 1, policy_version 1836888 (0.0008) [2023-12-28 08:26:05,697][106226] Updated weights for policy 0, policy_version 1832783 (0.0007) [2023-12-28 08:26:05,748][106226] Updated weights for policy 0, policy_version 1832793 (0.0008) [2023-12-28 08:26:05,798][106226] Updated weights for policy 0, policy_version 1832803 (0.0010) [2023-12-28 08:26:06,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939581440. Throughput: 0: 9947.6, 1: 9845.8. Samples: 939593416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:06,175][105115] Avg episode reward: [(0, '-4.568'), (1, '-4.574')] [2023-12-28 08:26:06,284][106225] Updated weights for policy 1, policy_version 1836898 (0.0007) [2023-12-28 08:26:06,350][106225] Updated weights for policy 1, policy_version 1836908 (0.0008) [2023-12-28 08:26:06,415][106225] Updated weights for policy 1, policy_version 1836918 (0.0008) [2023-12-28 08:26:06,472][106225] Updated weights for policy 1, policy_version 1836928 (0.0007) [2023-12-28 08:26:06,490][106226] Updated weights for policy 0, policy_version 1832813 (0.0011) [2023-12-28 08:26:06,559][106226] Updated weights for policy 0, policy_version 1832823 (0.0011) [2023-12-28 08:26:06,614][106226] Updated weights for policy 0, policy_version 1832833 (0.0009) [2023-12-28 08:26:07,206][106225] Updated weights for policy 1, policy_version 1836938 (0.0008) [2023-12-28 08:26:07,268][106225] Updated weights for policy 1, policy_version 1836948 (0.0008) [2023-12-28 08:26:07,318][106225] Updated weights for policy 1, policy_version 1836958 (0.0008) [2023-12-28 08:26:07,328][106226] Updated weights for policy 0, policy_version 1832843 (0.0009) [2023-12-28 08:26:07,388][106226] Updated weights for policy 0, policy_version 1832853 (0.0009) [2023-12-28 08:26:07,442][106226] Updated weights for policy 0, policy_version 1832863 (0.0009) [2023-12-28 08:26:08,074][106225] Updated weights for policy 1, policy_version 1836968 (0.0008) [2023-12-28 08:26:08,138][106225] Updated weights for policy 1, policy_version 1836978 (0.0008) [2023-12-28 08:26:08,174][106226] Updated weights for policy 0, policy_version 1832873 (0.0008) [2023-12-28 08:26:08,208][106225] Updated weights for policy 1, policy_version 1836988 (0.0008) [2023-12-28 08:26:08,239][106226] Updated weights for policy 0, policy_version 1832883 (0.0011) [2023-12-28 08:26:08,298][106226] Updated weights for policy 0, policy_version 1832893 (0.0011) [2023-12-28 08:26:08,367][106226] Updated weights for policy 0, policy_version 1832903 (0.0009) [2023-12-28 08:26:08,947][106225] Updated weights for policy 1, policy_version 1836998 (0.0008) [2023-12-28 08:26:08,995][106226] Updated weights for policy 0, policy_version 1832913 (0.0008) [2023-12-28 08:26:09,009][106225] Updated weights for policy 1, policy_version 1837008 (0.0006) [2023-12-28 08:26:09,053][106226] Updated weights for policy 0, policy_version 1832923 (0.0008) [2023-12-28 08:26:09,068][106225] Updated weights for policy 1, policy_version 1837018 (0.0006) [2023-12-28 08:26:09,106][106226] Updated weights for policy 0, policy_version 1832933 (0.0007) [2023-12-28 08:26:09,791][106225] Updated weights for policy 1, policy_version 1837028 (0.0008) [2023-12-28 08:26:09,858][106225] Updated weights for policy 1, policy_version 1837038 (0.0009) [2023-12-28 08:26:09,878][106226] Updated weights for policy 0, policy_version 1832943 (0.0007) [2023-12-28 08:26:09,922][106225] Updated weights for policy 1, policy_version 1837048 (0.0008) [2023-12-28 08:26:09,948][106226] Updated weights for policy 0, policy_version 1832953 (0.0007) [2023-12-28 08:26:10,016][106226] Updated weights for policy 0, policy_version 1832963 (0.0008) [2023-12-28 08:26:10,675][106225] Updated weights for policy 1, policy_version 1837058 (0.0009) [2023-12-28 08:26:10,723][106226] Updated weights for policy 0, policy_version 1832973 (0.0007) [2023-12-28 08:26:10,725][106225] Updated weights for policy 1, policy_version 1837068 (0.0007) [2023-12-28 08:26:10,782][106225] Updated weights for policy 1, policy_version 1837078 (0.0007) [2023-12-28 08:26:10,783][106226] Updated weights for policy 0, policy_version 1832983 (0.0006) [2023-12-28 08:26:10,830][106225] Updated weights for policy 1, policy_version 1837088 (0.0006) [2023-12-28 08:26:10,837][106226] Updated weights for policy 0, policy_version 1832993 (0.0008) [2023-12-28 08:26:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 939679744. Throughput: 0: 9976.6, 1: 9839.5. Samples: 939651024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:11,175][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.647')] [2023-12-28 08:26:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001837088_470351872.pth... [2023-12-28 08:26:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001833000_469327872.pth... [2023-12-28 08:26:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001835936_470056960.pth [2023-12-28 08:26:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001831848_469032960.pth [2023-12-28 08:26:11,598][106225] Updated weights for policy 1, policy_version 1837098 (0.0008) [2023-12-28 08:26:11,644][106226] Updated weights for policy 0, policy_version 1833003 (0.0008) [2023-12-28 08:26:11,673][106225] Updated weights for policy 1, policy_version 1837108 (0.0008) [2023-12-28 08:26:11,718][106226] Updated weights for policy 0, policy_version 1833013 (0.0007) [2023-12-28 08:26:11,742][106225] Updated weights for policy 1, policy_version 1837118 (0.0008) [2023-12-28 08:26:11,785][106226] Updated weights for policy 0, policy_version 1833023 (0.0008) [2023-12-28 08:26:12,506][106225] Updated weights for policy 1, policy_version 1837128 (0.0008) [2023-12-28 08:26:12,567][106225] Updated weights for policy 1, policy_version 1837138 (0.0008) [2023-12-28 08:26:12,602][106226] Updated weights for policy 0, policy_version 1833033 (0.0008) [2023-12-28 08:26:12,629][106225] Updated weights for policy 1, policy_version 1837148 (0.0008) [2023-12-28 08:26:12,663][106226] Updated weights for policy 0, policy_version 1833043 (0.0008) [2023-12-28 08:26:12,718][106226] Updated weights for policy 0, policy_version 1833053 (0.0008) [2023-12-28 08:26:12,772][106226] Updated weights for policy 0, policy_version 1833063 (0.0008) [2023-12-28 08:26:13,284][106225] Updated weights for policy 1, policy_version 1837158 (0.0008) [2023-12-28 08:26:13,332][106225] Updated weights for policy 1, policy_version 1837168 (0.0008) [2023-12-28 08:26:13,376][106225] Updated weights for policy 1, policy_version 1837178 (0.0008) [2023-12-28 08:26:13,527][106226] Updated weights for policy 0, policy_version 1833073 (0.0006) [2023-12-28 08:26:13,575][106226] Updated weights for policy 0, policy_version 1833083 (0.0008) [2023-12-28 08:26:13,632][106226] Updated weights for policy 0, policy_version 1833093 (0.0009) [2023-12-28 08:26:14,047][106225] Updated weights for policy 1, policy_version 1837188 (0.0007) [2023-12-28 08:26:14,117][106225] Updated weights for policy 1, policy_version 1837198 (0.0006) [2023-12-28 08:26:14,164][106225] Updated weights for policy 1, policy_version 1837208 (0.0008) [2023-12-28 08:26:14,425][106226] Updated weights for policy 0, policy_version 1833103 (0.0007) [2023-12-28 08:26:14,481][106226] Updated weights for policy 0, policy_version 1833113 (0.0005) [2023-12-28 08:26:14,536][106226] Updated weights for policy 0, policy_version 1833123 (0.0005) [2023-12-28 08:26:14,804][106225] Updated weights for policy 1, policy_version 1837218 (0.0007) [2023-12-28 08:26:14,858][106225] Updated weights for policy 1, policy_version 1837228 (0.0010) [2023-12-28 08:26:14,927][106225] Updated weights for policy 1, policy_version 1837238 (0.0010) [2023-12-28 08:26:14,991][106225] Updated weights for policy 1, policy_version 1837248 (0.0010) [2023-12-28 08:26:15,166][106226] Updated weights for policy 0, policy_version 1833133 (0.0008) [2023-12-28 08:26:15,218][106226] Updated weights for policy 0, policy_version 1833143 (0.0010) [2023-12-28 08:26:15,270][106226] Updated weights for policy 0, policy_version 1833153 (0.0011) [2023-12-28 08:26:15,676][106225] Updated weights for policy 1, policy_version 1837258 (0.0007) [2023-12-28 08:26:15,745][106225] Updated weights for policy 1, policy_version 1837268 (0.0005) [2023-12-28 08:26:15,796][106225] Updated weights for policy 1, policy_version 1837278 (0.0009) [2023-12-28 08:26:15,902][106226] Updated weights for policy 0, policy_version 1833163 (0.0010) [2023-12-28 08:26:15,955][106226] Updated weights for policy 0, policy_version 1833173 (0.0009) [2023-12-28 08:26:16,007][106226] Updated weights for policy 0, policy_version 1833183 (0.0010) [2023-12-28 08:26:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939778048. Throughput: 0: 9776.1, 1: 9813.3. Samples: 939765176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:16,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.660')] [2023-12-28 08:26:16,373][106225] Updated weights for policy 1, policy_version 1837288 (0.0007) [2023-12-28 08:26:16,426][106225] Updated weights for policy 1, policy_version 1837298 (0.0005) [2023-12-28 08:26:16,488][106225] Updated weights for policy 1, policy_version 1837308 (0.0005) [2023-12-28 08:26:16,643][106226] Updated weights for policy 0, policy_version 1833193 (0.0010) [2023-12-28 08:26:16,704][106226] Updated weights for policy 0, policy_version 1833203 (0.0005) [2023-12-28 08:26:16,761][106226] Updated weights for policy 0, policy_version 1833213 (0.0005) [2023-12-28 08:26:16,807][106226] Updated weights for policy 0, policy_version 1833223 (0.0005) [2023-12-28 08:26:17,059][106225] Updated weights for policy 1, policy_version 1837318 (0.0005) [2023-12-28 08:26:17,127][106225] Updated weights for policy 1, policy_version 1837328 (0.0007) [2023-12-28 08:26:17,186][106225] Updated weights for policy 1, policy_version 1837338 (0.0008) [2023-12-28 08:26:17,403][106226] Updated weights for policy 0, policy_version 1833233 (0.0005) [2023-12-28 08:26:17,463][106226] Updated weights for policy 0, policy_version 1833243 (0.0008) [2023-12-28 08:26:17,525][106226] Updated weights for policy 0, policy_version 1833253 (0.0007) [2023-12-28 08:26:17,852][106225] Updated weights for policy 1, policy_version 1837348 (0.0007) [2023-12-28 08:26:17,896][106225] Updated weights for policy 1, policy_version 1837358 (0.0008) [2023-12-28 08:26:17,947][106225] Updated weights for policy 1, policy_version 1837368 (0.0009) [2023-12-28 08:26:18,189][106226] Updated weights for policy 0, policy_version 1833263 (0.0008) [2023-12-28 08:26:18,237][106226] Updated weights for policy 0, policy_version 1833273 (0.0008) [2023-12-28 08:26:18,287][106226] Updated weights for policy 0, policy_version 1833283 (0.0008) [2023-12-28 08:26:18,670][106225] Updated weights for policy 1, policy_version 1837378 (0.0009) [2023-12-28 08:26:18,729][106225] Updated weights for policy 1, policy_version 1837388 (0.0011) [2023-12-28 08:26:18,786][106225] Updated weights for policy 1, policy_version 1837398 (0.0009) [2023-12-28 08:26:18,836][106225] Updated weights for policy 1, policy_version 1837408 (0.0009) [2023-12-28 08:26:19,007][106226] Updated weights for policy 0, policy_version 1833293 (0.0008) [2023-12-28 08:26:19,065][106226] Updated weights for policy 0, policy_version 1833303 (0.0009) [2023-12-28 08:26:19,124][106226] Updated weights for policy 0, policy_version 1833313 (0.0008) [2023-12-28 08:26:19,600][106225] Updated weights for policy 1, policy_version 1837418 (0.0009) [2023-12-28 08:26:19,659][106225] Updated weights for policy 1, policy_version 1837428 (0.0008) [2023-12-28 08:26:19,721][106225] Updated weights for policy 1, policy_version 1837438 (0.0005) [2023-12-28 08:26:19,831][106226] Updated weights for policy 0, policy_version 1833323 (0.0009) [2023-12-28 08:26:19,898][106226] Updated weights for policy 0, policy_version 1833333 (0.0008) [2023-12-28 08:26:19,963][106226] Updated weights for policy 0, policy_version 1833343 (0.0007) [2023-12-28 08:26:20,468][106225] Updated weights for policy 1, policy_version 1837448 (0.0008) [2023-12-28 08:26:20,532][106225] Updated weights for policy 1, policy_version 1837458 (0.0009) [2023-12-28 08:26:20,612][106225] Updated weights for policy 1, policy_version 1837468 (0.0008) [2023-12-28 08:26:20,664][106226] Updated weights for policy 0, policy_version 1833353 (0.0006) [2023-12-28 08:26:20,727][106226] Updated weights for policy 0, policy_version 1833363 (0.0008) [2023-12-28 08:26:20,795][106226] Updated weights for policy 0, policy_version 1833373 (0.0010) [2023-12-28 08:26:20,861][106226] Updated weights for policy 0, policy_version 1833383 (0.0011) [2023-12-28 08:26:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939876352. Throughput: 0: 9886.4, 1: 9822.7. Samples: 939886908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:21,175][105115] Avg episode reward: [(0, '-4.286'), (1, '-4.983')] [2023-12-28 08:26:21,375][106225] Updated weights for policy 1, policy_version 1837478 (0.0009) [2023-12-28 08:26:21,440][106225] Updated weights for policy 1, policy_version 1837488 (0.0009) [2023-12-28 08:26:21,509][106225] Updated weights for policy 1, policy_version 1837498 (0.0008) [2023-12-28 08:26:21,566][106226] Updated weights for policy 0, policy_version 1833393 (0.0007) [2023-12-28 08:26:21,629][106226] Updated weights for policy 0, policy_version 1833403 (0.0008) [2023-12-28 08:26:21,686][106226] Updated weights for policy 0, policy_version 1833413 (0.0008) [2023-12-28 08:26:22,309][106225] Updated weights for policy 1, policy_version 1837508 (0.0009) [2023-12-28 08:26:22,380][106225] Updated weights for policy 1, policy_version 1837518 (0.0010) [2023-12-28 08:26:22,432][106226] Updated weights for policy 0, policy_version 1833423 (0.0008) [2023-12-28 08:26:22,438][106225] Updated weights for policy 1, policy_version 1837528 (0.0007) [2023-12-28 08:26:22,492][106226] Updated weights for policy 0, policy_version 1833433 (0.0008) [2023-12-28 08:26:22,554][106226] Updated weights for policy 0, policy_version 1833443 (0.0008) [2023-12-28 08:26:23,217][106225] Updated weights for policy 1, policy_version 1837538 (0.0008) [2023-12-28 08:26:23,234][106226] Updated weights for policy 0, policy_version 1833453 (0.0009) [2023-12-28 08:26:23,276][106225] Updated weights for policy 1, policy_version 1837548 (0.0007) [2023-12-28 08:26:23,293][106226] Updated weights for policy 0, policy_version 1833463 (0.0006) [2023-12-28 08:26:23,331][106225] Updated weights for policy 1, policy_version 1837558 (0.0006) [2023-12-28 08:26:23,354][106226] Updated weights for policy 0, policy_version 1833473 (0.0007) [2023-12-28 08:26:23,388][106225] Updated weights for policy 1, policy_version 1837568 (0.0006) [2023-12-28 08:26:23,968][106226] Updated weights for policy 0, policy_version 1833483 (0.0007) [2023-12-28 08:26:24,021][106226] Updated weights for policy 0, policy_version 1833493 (0.0009) [2023-12-28 08:26:24,080][106226] Updated weights for policy 0, policy_version 1833503 (0.0006) [2023-12-28 08:26:24,163][106225] Updated weights for policy 1, policy_version 1837578 (0.0009) [2023-12-28 08:26:24,216][106225] Updated weights for policy 1, policy_version 1837588 (0.0008) [2023-12-28 08:26:24,268][106225] Updated weights for policy 1, policy_version 1837598 (0.0009) [2023-12-28 08:26:24,708][106226] Updated weights for policy 0, policy_version 1833513 (0.0006) [2023-12-28 08:26:24,768][106226] Updated weights for policy 0, policy_version 1833523 (0.0009) [2023-12-28 08:26:24,817][106226] Updated weights for policy 0, policy_version 1833533 (0.0008) [2023-12-28 08:26:24,865][106226] Updated weights for policy 0, policy_version 1833543 (0.0009) [2023-12-28 08:26:25,044][106225] Updated weights for policy 1, policy_version 1837608 (0.0006) [2023-12-28 08:26:25,091][106225] Updated weights for policy 1, policy_version 1837618 (0.0005) [2023-12-28 08:26:25,139][106225] Updated weights for policy 1, policy_version 1837628 (0.0005) [2023-12-28 08:26:25,656][106226] Updated weights for policy 0, policy_version 1833553 (0.0006) [2023-12-28 08:26:25,706][106226] Updated weights for policy 0, policy_version 1833563 (0.0005) [2023-12-28 08:26:25,713][106225] Updated weights for policy 1, policy_version 1837638 (0.0007) [2023-12-28 08:26:25,753][106226] Updated weights for policy 0, policy_version 1833573 (0.0009) [2023-12-28 08:26:25,763][106225] Updated weights for policy 1, policy_version 1837648 (0.0007) [2023-12-28 08:26:25,816][106225] Updated weights for policy 1, policy_version 1837658 (0.0007) [2023-12-28 08:26:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 939974656. Throughput: 0: 9886.8, 1: 9762.1. Samples: 939942904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:26,175][105115] Avg episode reward: [(0, '-4.449'), (1, '-4.628')] [2023-12-28 08:26:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001837664_470499328.pth... [2023-12-28 08:26:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001833576_469475328.pth... [2023-12-28 08:26:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001836544_470212608.pth [2023-12-28 08:26:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001832424_469180416.pth [2023-12-28 08:26:26,378][106226] Updated weights for policy 0, policy_version 1833583 (0.0010) [2023-12-28 08:26:26,434][106226] Updated weights for policy 0, policy_version 1833593 (0.0010) [2023-12-28 08:26:26,487][106226] Updated weights for policy 0, policy_version 1833603 (0.0010) [2023-12-28 08:26:26,596][106225] Updated weights for policy 1, policy_version 1837668 (0.0008) [2023-12-28 08:26:26,646][106225] Updated weights for policy 1, policy_version 1837678 (0.0008) [2023-12-28 08:26:26,698][106225] Updated weights for policy 1, policy_version 1837688 (0.0007) [2023-12-28 08:26:27,139][106226] Updated weights for policy 0, policy_version 1833613 (0.0010) [2023-12-28 08:26:27,185][106226] Updated weights for policy 0, policy_version 1833623 (0.0010) [2023-12-28 08:26:27,238][106226] Updated weights for policy 0, policy_version 1833633 (0.0009) [2023-12-28 08:26:27,462][106225] Updated weights for policy 1, policy_version 1837698 (0.0007) [2023-12-28 08:26:27,515][106225] Updated weights for policy 1, policy_version 1837708 (0.0009) [2023-12-28 08:26:27,568][106225] Updated weights for policy 1, policy_version 1837718 (0.0009) [2023-12-28 08:26:27,625][106225] Updated weights for policy 1, policy_version 1837728 (0.0009) [2023-12-28 08:26:27,785][106226] Updated weights for policy 0, policy_version 1833643 (0.0005) [2023-12-28 08:26:27,845][106226] Updated weights for policy 0, policy_version 1833653 (0.0005) [2023-12-28 08:26:27,912][106226] Updated weights for policy 0, policy_version 1833663 (0.0007) [2023-12-28 08:26:28,412][106225] Updated weights for policy 1, policy_version 1837738 (0.0008) [2023-12-28 08:26:28,470][106225] Updated weights for policy 1, policy_version 1837748 (0.0010) [2023-12-28 08:26:28,527][106225] Updated weights for policy 1, policy_version 1837758 (0.0010) [2023-12-28 08:26:28,550][106226] Updated weights for policy 0, policy_version 1833673 (0.0010) [2023-12-28 08:26:28,606][106226] Updated weights for policy 0, policy_version 1833683 (0.0010) [2023-12-28 08:26:28,667][106226] Updated weights for policy 0, policy_version 1833693 (0.0011) [2023-12-28 08:26:28,723][106226] Updated weights for policy 0, policy_version 1833703 (0.0010) [2023-12-28 08:26:29,263][106225] Updated weights for policy 1, policy_version 1837768 (0.0009) [2023-12-28 08:26:29,328][106225] Updated weights for policy 1, policy_version 1837778 (0.0010) [2023-12-28 08:26:29,402][106225] Updated weights for policy 1, policy_version 1837788 (0.0010) [2023-12-28 08:26:29,444][106226] Updated weights for policy 0, policy_version 1833713 (0.0007) [2023-12-28 08:26:29,509][106226] Updated weights for policy 0, policy_version 1833723 (0.0007) [2023-12-28 08:26:29,573][106226] Updated weights for policy 0, policy_version 1833733 (0.0007) [2023-12-28 08:26:30,109][106225] Updated weights for policy 1, policy_version 1837798 (0.0007) [2023-12-28 08:26:30,156][106225] Updated weights for policy 1, policy_version 1837808 (0.0005) [2023-12-28 08:26:30,212][106225] Updated weights for policy 1, policy_version 1837818 (0.0005) [2023-12-28 08:26:30,261][106226] Updated weights for policy 0, policy_version 1833743 (0.0008) [2023-12-28 08:26:30,321][106226] Updated weights for policy 0, policy_version 1833753 (0.0008) [2023-12-28 08:26:30,382][106226] Updated weights for policy 0, policy_version 1833763 (0.0008) [2023-12-28 08:26:30,838][106225] Updated weights for policy 1, policy_version 1837828 (0.0007) [2023-12-28 08:26:30,891][106225] Updated weights for policy 1, policy_version 1837838 (0.0005) [2023-12-28 08:26:30,961][106225] Updated weights for policy 1, policy_version 1837848 (0.0005) [2023-12-28 08:26:31,062][106226] Updated weights for policy 0, policy_version 1833773 (0.0008) [2023-12-28 08:26:31,119][106226] Updated weights for policy 0, policy_version 1833783 (0.0009) [2023-12-28 08:26:31,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 940072960. Throughput: 0: 10002.2, 1: 9763.9. Samples: 940063488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 08:26:31,175][105115] Avg episode reward: [(0, '-4.532'), (1, '-5.021')] [2023-12-28 08:26:31,185][106226] Updated weights for policy 0, policy_version 1833793 (0.0007) [2023-12-28 08:26:31,680][106225] Updated weights for policy 1, policy_version 1837858 (0.0007) [2023-12-28 08:26:31,753][106225] Updated weights for policy 1, policy_version 1837868 (0.0008) [2023-12-28 08:26:31,804][106225] Updated weights for policy 1, policy_version 1837878 (0.0008) [2023-12-28 08:26:31,861][106225] Updated weights for policy 1, policy_version 1837888 (0.0010) [2023-12-28 08:26:31,961][106226] Updated weights for policy 0, policy_version 1833803 (0.0007) [2023-12-28 08:26:32,026][106226] Updated weights for policy 0, policy_version 1833813 (0.0008) [2023-12-28 08:26:32,091][106226] Updated weights for policy 0, policy_version 1833823 (0.0008) [2023-12-28 08:26:32,557][106225] Updated weights for policy 1, policy_version 1837898 (0.0006) [2023-12-28 08:26:32,609][106225] Updated weights for policy 1, policy_version 1837908 (0.0008) [2023-12-28 08:26:32,659][106225] Updated weights for policy 1, policy_version 1837918 (0.0009) [2023-12-28 08:26:32,848][106226] Updated weights for policy 0, policy_version 1833833 (0.0008) [2023-12-28 08:26:32,913][106226] Updated weights for policy 0, policy_version 1833843 (0.0008) [2023-12-28 08:26:32,965][106226] Updated weights for policy 0, policy_version 1833853 (0.0008) [2023-12-28 08:26:33,010][106226] Updated weights for policy 0, policy_version 1833863 (0.0008) [2023-12-28 08:26:33,391][106225] Updated weights for policy 1, policy_version 1837928 (0.0008) [2023-12-28 08:26:33,440][106225] Updated weights for policy 1, policy_version 1837938 (0.0008) [2023-12-28 08:26:33,500][106225] Updated weights for policy 1, policy_version 1837948 (0.0009) [2023-12-28 08:26:33,750][106226] Updated weights for policy 0, policy_version 1833873 (0.0008) [2023-12-28 08:26:33,795][106226] Updated weights for policy 0, policy_version 1833883 (0.0008) [2023-12-28 08:26:33,844][106226] Updated weights for policy 0, policy_version 1833893 (0.0007) [2023-12-28 08:26:34,122][106225] Updated weights for policy 1, policy_version 1837958 (0.0008) [2023-12-28 08:26:34,190][106225] Updated weights for policy 1, policy_version 1837968 (0.0008) [2023-12-28 08:26:34,246][106225] Updated weights for policy 1, policy_version 1837978 (0.0008) [2023-12-28 08:26:34,626][106226] Updated weights for policy 0, policy_version 1833903 (0.0009) [2023-12-28 08:26:34,690][106226] Updated weights for policy 0, policy_version 1833913 (0.0008) [2023-12-28 08:26:34,749][106226] Updated weights for policy 0, policy_version 1833923 (0.0009) [2023-12-28 08:26:34,990][106225] Updated weights for policy 1, policy_version 1837988 (0.0009) [2023-12-28 08:26:35,046][106225] Updated weights for policy 1, policy_version 1837998 (0.0009) [2023-12-28 08:26:35,099][106225] Updated weights for policy 1, policy_version 1838008 (0.0008) [2023-12-28 08:26:35,399][106226] Updated weights for policy 0, policy_version 1833933 (0.0008) [2023-12-28 08:26:35,459][106226] Updated weights for policy 0, policy_version 1833943 (0.0009) [2023-12-28 08:26:35,517][106226] Updated weights for policy 0, policy_version 1833953 (0.0008) [2023-12-28 08:26:35,824][106225] Updated weights for policy 1, policy_version 1838018 (0.0007) [2023-12-28 08:26:35,881][106225] Updated weights for policy 1, policy_version 1838028 (0.0008) [2023-12-28 08:26:35,938][106225] Updated weights for policy 1, policy_version 1838038 (0.0009) [2023-12-28 08:26:35,990][106225] Updated weights for policy 1, policy_version 1838048 (0.0008) [2023-12-28 08:26:36,167][106226] Updated weights for policy 0, policy_version 1833963 (0.0007) [2023-12-28 08:26:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 940171264. Throughput: 0: 9953.5, 1: 9740.8. Samples: 940182044. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:26:36,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.714')] [2023-12-28 08:26:36,231][106226] Updated weights for policy 0, policy_version 1833973 (0.0009) [2023-12-28 08:26:36,293][106226] Updated weights for policy 0, policy_version 1833983 (0.0008) [2023-12-28 08:26:36,754][106225] Updated weights for policy 1, policy_version 1838058 (0.0008) [2023-12-28 08:26:36,806][106225] Updated weights for policy 1, policy_version 1838068 (0.0007) [2023-12-28 08:26:36,855][106225] Updated weights for policy 1, policy_version 1838078 (0.0006) [2023-12-28 08:26:36,942][106226] Updated weights for policy 0, policy_version 1833993 (0.0009) [2023-12-28 08:26:36,988][106226] Updated weights for policy 0, policy_version 1834003 (0.0007) [2023-12-28 08:26:37,037][106226] Updated weights for policy 0, policy_version 1834013 (0.0008) [2023-12-28 08:26:37,085][106226] Updated weights for policy 0, policy_version 1834023 (0.0006) [2023-12-28 08:26:37,570][106225] Updated weights for policy 1, policy_version 1838088 (0.0006) [2023-12-28 08:26:37,631][106225] Updated weights for policy 1, policy_version 1838098 (0.0009) [2023-12-28 08:26:37,688][106225] Updated weights for policy 1, policy_version 1838108 (0.0010) [2023-12-28 08:26:37,765][106226] Updated weights for policy 0, policy_version 1834033 (0.0007) [2023-12-28 08:26:37,811][106226] Updated weights for policy 0, policy_version 1834043 (0.0008) [2023-12-28 08:26:37,856][106226] Updated weights for policy 0, policy_version 1834053 (0.0007) [2023-12-28 08:26:38,363][106225] Updated weights for policy 1, policy_version 1838118 (0.0010) [2023-12-28 08:26:38,430][106225] Updated weights for policy 1, policy_version 1838128 (0.0010) [2023-12-28 08:26:38,490][106225] Updated weights for policy 1, policy_version 1838138 (0.0010) [2023-12-28 08:26:38,654][106226] Updated weights for policy 0, policy_version 1834063 (0.0008) [2023-12-28 08:26:38,715][106226] Updated weights for policy 0, policy_version 1834073 (0.0009) [2023-12-28 08:26:38,777][106226] Updated weights for policy 0, policy_version 1834083 (0.0009) [2023-12-28 08:26:39,124][106225] Updated weights for policy 1, policy_version 1838148 (0.0006) [2023-12-28 08:26:39,173][106225] Updated weights for policy 1, policy_version 1838158 (0.0008) [2023-12-28 08:26:39,229][106225] Updated weights for policy 1, policy_version 1838168 (0.0007) [2023-12-28 08:26:39,534][106226] Updated weights for policy 0, policy_version 1834093 (0.0007) [2023-12-28 08:26:39,593][106226] Updated weights for policy 0, policy_version 1834103 (0.0006) [2023-12-28 08:26:39,652][106226] Updated weights for policy 0, policy_version 1834113 (0.0006) [2023-12-28 08:26:40,016][106225] Updated weights for policy 1, policy_version 1838178 (0.0008) [2023-12-28 08:26:40,083][106225] Updated weights for policy 1, policy_version 1838188 (0.0008) [2023-12-28 08:26:40,143][106225] Updated weights for policy 1, policy_version 1838198 (0.0007) [2023-12-28 08:26:40,204][106225] Updated weights for policy 1, policy_version 1838208 (0.0005) [2023-12-28 08:26:40,279][106226] Updated weights for policy 0, policy_version 1834123 (0.0007) [2023-12-28 08:26:40,330][106226] Updated weights for policy 0, policy_version 1834133 (0.0008) [2023-12-28 08:26:40,384][106226] Updated weights for policy 0, policy_version 1834143 (0.0009) [2023-12-28 08:26:40,824][106225] Updated weights for policy 1, policy_version 1838218 (0.0010) [2023-12-28 08:26:40,869][106225] Updated weights for policy 1, policy_version 1838228 (0.0010) [2023-12-28 08:26:40,916][106225] Updated weights for policy 1, policy_version 1838238 (0.0010) [2023-12-28 08:26:41,158][106226] Updated weights for policy 0, policy_version 1834153 (0.0010) [2023-12-28 08:26:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 940269568. Throughput: 0: 9961.8, 1: 9764.1. Samples: 940240756. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:26:41,175][105115] Avg episode reward: [(0, '-4.479'), (1, '-4.640')] [2023-12-28 08:26:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001838240_470646784.pth... [2023-12-28 08:26:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001837088_470351872.pth [2023-12-28 08:26:41,224][106226] Updated weights for policy 0, policy_version 1834163 (0.0009) [2023-12-28 08:26:41,299][106226] Updated weights for policy 0, policy_version 1834173 (0.0007) [2023-12-28 08:26:41,351][106226] Updated weights for policy 0, policy_version 1834183 (0.0008) [2023-12-28 08:26:41,356][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001834184_469630976.pth... [2023-12-28 08:26:41,362][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001833000_469327872.pth [2023-12-28 08:26:41,733][106225] Updated weights for policy 1, policy_version 1838248 (0.0009) [2023-12-28 08:26:41,794][106225] Updated weights for policy 1, policy_version 1838258 (0.0008) [2023-12-28 08:26:41,861][106225] Updated weights for policy 1, policy_version 1838268 (0.0008) [2023-12-28 08:26:42,075][106226] Updated weights for policy 0, policy_version 1834193 (0.0008) [2023-12-28 08:26:42,128][106226] Updated weights for policy 0, policy_version 1834203 (0.0008) [2023-12-28 08:26:42,182][106226] Updated weights for policy 0, policy_version 1834213 (0.0009) [2023-12-28 08:26:42,585][106225] Updated weights for policy 1, policy_version 1838278 (0.0009) [2023-12-28 08:26:42,645][106225] Updated weights for policy 1, policy_version 1838288 (0.0010) [2023-12-28 08:26:42,699][106225] Updated weights for policy 1, policy_version 1838298 (0.0010) [2023-12-28 08:26:42,861][106226] Updated weights for policy 0, policy_version 1834223 (0.0009) [2023-12-28 08:26:42,921][106226] Updated weights for policy 0, policy_version 1834233 (0.0010) [2023-12-28 08:26:42,982][106226] Updated weights for policy 0, policy_version 1834243 (0.0007) [2023-12-28 08:26:43,405][106225] Updated weights for policy 1, policy_version 1838308 (0.0010) [2023-12-28 08:26:43,454][106225] Updated weights for policy 1, policy_version 1838318 (0.0010) [2023-12-28 08:26:43,509][106225] Updated weights for policy 1, policy_version 1838328 (0.0009) [2023-12-28 08:26:43,569][106226] Updated weights for policy 0, policy_version 1834253 (0.0008) [2023-12-28 08:26:43,622][106226] Updated weights for policy 0, policy_version 1834263 (0.0010) [2023-12-28 08:26:43,675][106226] Updated weights for policy 0, policy_version 1834273 (0.0010) [2023-12-28 08:26:44,143][106225] Updated weights for policy 1, policy_version 1838338 (0.0009) [2023-12-28 08:26:44,203][106225] Updated weights for policy 1, policy_version 1838348 (0.0006) [2023-12-28 08:26:44,260][106225] Updated weights for policy 1, policy_version 1838358 (0.0005) [2023-12-28 08:26:44,321][106225] Updated weights for policy 1, policy_version 1838368 (0.0005) [2023-12-28 08:26:44,416][106226] Updated weights for policy 0, policy_version 1834283 (0.0011) [2023-12-28 08:26:44,489][106226] Updated weights for policy 0, policy_version 1834293 (0.0011) [2023-12-28 08:26:44,545][106226] Updated weights for policy 0, policy_version 1834303 (0.0010) [2023-12-28 08:26:44,914][106225] Updated weights for policy 1, policy_version 1838378 (0.0008) [2023-12-28 08:26:44,983][106225] Updated weights for policy 1, policy_version 1838388 (0.0009) [2023-12-28 08:26:45,050][106225] Updated weights for policy 1, policy_version 1838398 (0.0009) [2023-12-28 08:26:45,226][106226] Updated weights for policy 0, policy_version 1834313 (0.0010) [2023-12-28 08:26:45,287][106226] Updated weights for policy 0, policy_version 1834323 (0.0011) [2023-12-28 08:26:45,352][106226] Updated weights for policy 0, policy_version 1834333 (0.0011) [2023-12-28 08:26:45,408][106226] Updated weights for policy 0, policy_version 1834343 (0.0010) [2023-12-28 08:26:45,757][106225] Updated weights for policy 1, policy_version 1838408 (0.0006) [2023-12-28 08:26:45,804][106225] Updated weights for policy 1, policy_version 1838418 (0.0006) [2023-12-28 08:26:45,853][106225] Updated weights for policy 1, policy_version 1838428 (0.0007) [2023-12-28 08:26:46,131][106226] Updated weights for policy 0, policy_version 1834353 (0.0011) [2023-12-28 08:26:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 940367872. Throughput: 0: 9953.4, 1: 9707.8. Samples: 940360788. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:26:46,175][105115] Avg episode reward: [(0, '-4.430'), (1, '-4.497')] [2023-12-28 08:26:46,198][106226] Updated weights for policy 0, policy_version 1834363 (0.0011) [2023-12-28 08:26:46,261][106226] Updated weights for policy 0, policy_version 1834373 (0.0010) [2023-12-28 08:26:46,481][106225] Updated weights for policy 1, policy_version 1838438 (0.0008) [2023-12-28 08:26:46,546][106225] Updated weights for policy 1, policy_version 1838448 (0.0007) [2023-12-28 08:26:46,609][106225] Updated weights for policy 1, policy_version 1838458 (0.0008) [2023-12-28 08:26:46,955][106226] Updated weights for policy 0, policy_version 1834383 (0.0011) [2023-12-28 08:26:47,018][106226] Updated weights for policy 0, policy_version 1834393 (0.0011) [2023-12-28 08:26:47,077][106226] Updated weights for policy 0, policy_version 1834403 (0.0010) [2023-12-28 08:26:47,329][106225] Updated weights for policy 1, policy_version 1838468 (0.0008) [2023-12-28 08:26:47,395][106225] Updated weights for policy 1, policy_version 1838478 (0.0007) [2023-12-28 08:26:47,457][106225] Updated weights for policy 1, policy_version 1838488 (0.0007) [2023-12-28 08:26:47,783][106226] Updated weights for policy 0, policy_version 1834413 (0.0010) [2023-12-28 08:26:47,842][106226] Updated weights for policy 0, policy_version 1834423 (0.0010) [2023-12-28 08:26:47,902][106226] Updated weights for policy 0, policy_version 1834433 (0.0010) [2023-12-28 08:26:48,165][106225] Updated weights for policy 1, policy_version 1838498 (0.0008) [2023-12-28 08:26:48,230][106225] Updated weights for policy 1, policy_version 1838508 (0.0008) [2023-12-28 08:26:48,283][106225] Updated weights for policy 1, policy_version 1838518 (0.0007) [2023-12-28 08:26:48,346][106225] Updated weights for policy 1, policy_version 1838528 (0.0007) [2023-12-28 08:26:48,582][106226] Updated weights for policy 0, policy_version 1834443 (0.0010) [2023-12-28 08:26:48,641][106226] Updated weights for policy 0, policy_version 1834453 (0.0006) [2023-12-28 08:26:48,708][106226] Updated weights for policy 0, policy_version 1834463 (0.0005) [2023-12-28 08:26:49,069][106225] Updated weights for policy 1, policy_version 1838538 (0.0008) [2023-12-28 08:26:49,122][106225] Updated weights for policy 1, policy_version 1838548 (0.0009) [2023-12-28 08:26:49,187][106225] Updated weights for policy 1, policy_version 1838558 (0.0007) [2023-12-28 08:26:49,379][106226] Updated weights for policy 0, policy_version 1834473 (0.0007) [2023-12-28 08:26:49,438][106226] Updated weights for policy 0, policy_version 1834483 (0.0007) [2023-12-28 08:26:49,509][106226] Updated weights for policy 0, policy_version 1834493 (0.0005) [2023-12-28 08:26:49,567][106226] Updated weights for policy 0, policy_version 1834503 (0.0005) [2023-12-28 08:26:49,919][106225] Updated weights for policy 1, policy_version 1838568 (0.0008) [2023-12-28 08:26:49,986][106225] Updated weights for policy 1, policy_version 1838578 (0.0008) [2023-12-28 08:26:50,049][106225] Updated weights for policy 1, policy_version 1838588 (0.0006) [2023-12-28 08:26:50,288][106226] Updated weights for policy 0, policy_version 1834513 (0.0008) [2023-12-28 08:26:50,355][106226] Updated weights for policy 0, policy_version 1834523 (0.0006) [2023-12-28 08:26:50,405][106226] Updated weights for policy 0, policy_version 1834533 (0.0010) [2023-12-28 08:26:50,716][106225] Updated weights for policy 1, policy_version 1838598 (0.0007) [2023-12-28 08:26:50,786][106225] Updated weights for policy 1, policy_version 1838608 (0.0008) [2023-12-28 08:26:50,854][106225] Updated weights for policy 1, policy_version 1838618 (0.0006) [2023-12-28 08:26:51,055][106226] Updated weights for policy 0, policy_version 1834543 (0.0011) [2023-12-28 08:26:51,122][106226] Updated weights for policy 0, policy_version 1834553 (0.0011) [2023-12-28 08:26:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 940466176. Throughput: 0: 9903.1, 1: 9773.6. Samples: 940478868. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:26:51,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.713')] [2023-12-28 08:26:51,190][106226] Updated weights for policy 0, policy_version 1834563 (0.0011) [2023-12-28 08:26:51,558][106225] Updated weights for policy 1, policy_version 1838628 (0.0006) [2023-12-28 08:26:51,611][106225] Updated weights for policy 1, policy_version 1838638 (0.0006) [2023-12-28 08:26:51,678][106225] Updated weights for policy 1, policy_version 1838648 (0.0009) [2023-12-28 08:26:51,878][106226] Updated weights for policy 0, policy_version 1834573 (0.0011) [2023-12-28 08:26:51,944][106226] Updated weights for policy 0, policy_version 1834583 (0.0008) [2023-12-28 08:26:52,013][106226] Updated weights for policy 0, policy_version 1834593 (0.0008) [2023-12-28 08:26:52,361][106225] Updated weights for policy 1, policy_version 1838658 (0.0009) [2023-12-28 08:26:52,419][106225] Updated weights for policy 1, policy_version 1838668 (0.0008) [2023-12-28 08:26:52,473][106225] Updated weights for policy 1, policy_version 1838678 (0.0007) [2023-12-28 08:26:52,530][106225] Updated weights for policy 1, policy_version 1838688 (0.0008) [2023-12-28 08:26:52,704][106226] Updated weights for policy 0, policy_version 1834603 (0.0011) [2023-12-28 08:26:52,769][106226] Updated weights for policy 0, policy_version 1834613 (0.0011) [2023-12-28 08:26:52,832][106226] Updated weights for policy 0, policy_version 1834623 (0.0011) [2023-12-28 08:26:53,249][106225] Updated weights for policy 1, policy_version 1838698 (0.0008) [2023-12-28 08:26:53,307][106225] Updated weights for policy 1, policy_version 1838708 (0.0010) [2023-12-28 08:26:53,379][106225] Updated weights for policy 1, policy_version 1838718 (0.0008) [2023-12-28 08:26:53,434][106226] Updated weights for policy 0, policy_version 1834633 (0.0011) [2023-12-28 08:26:53,502][106226] Updated weights for policy 0, policy_version 1834643 (0.0008) [2023-12-28 08:26:53,564][106226] Updated weights for policy 0, policy_version 1834653 (0.0007) [2023-12-28 08:26:53,626][106226] Updated weights for policy 0, policy_version 1834663 (0.0007) [2023-12-28 08:26:54,007][106225] Updated weights for policy 1, policy_version 1838728 (0.0007) [2023-12-28 08:26:54,055][106225] Updated weights for policy 1, policy_version 1838738 (0.0008) [2023-12-28 08:26:54,125][106225] Updated weights for policy 1, policy_version 1838748 (0.0007) [2023-12-28 08:26:54,254][106226] Updated weights for policy 0, policy_version 1834673 (0.0005) [2023-12-28 08:26:54,311][106226] Updated weights for policy 0, policy_version 1834683 (0.0007) [2023-12-28 08:26:54,358][106226] Updated weights for policy 0, policy_version 1834693 (0.0008) [2023-12-28 08:26:54,876][106225] Updated weights for policy 1, policy_version 1838758 (0.0008) [2023-12-28 08:26:54,922][106225] Updated weights for policy 1, policy_version 1838768 (0.0005) [2023-12-28 08:26:54,971][106225] Updated weights for policy 1, policy_version 1838778 (0.0005) [2023-12-28 08:26:55,055][106226] Updated weights for policy 0, policy_version 1834703 (0.0009) [2023-12-28 08:26:55,102][106226] Updated weights for policy 0, policy_version 1834713 (0.0010) [2023-12-28 08:26:55,153][106226] Updated weights for policy 0, policy_version 1834723 (0.0010) [2023-12-28 08:26:55,732][106225] Updated weights for policy 1, policy_version 1838788 (0.0008) [2023-12-28 08:26:55,737][106226] Updated weights for policy 0, policy_version 1834733 (0.0008) [2023-12-28 08:26:55,786][106225] Updated weights for policy 1, policy_version 1838798 (0.0010) [2023-12-28 08:26:55,794][106226] Updated weights for policy 0, policy_version 1834743 (0.0005) [2023-12-28 08:26:55,845][106225] Updated weights for policy 1, policy_version 1838808 (0.0009) [2023-12-28 08:26:55,850][106226] Updated weights for policy 0, policy_version 1834753 (0.0006) [2023-12-28 08:26:56,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 940572672. Throughput: 0: 9926.6, 1: 9796.4. Samples: 940538556. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:26:56,175][105115] Avg episode reward: [(0, '-4.475'), (1, '-4.549')] [2023-12-28 08:26:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001838816_470794240.pth... [2023-12-28 08:26:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001834760_469778432.pth... [2023-12-28 08:26:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001833576_469475328.pth [2023-12-28 08:26:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001837664_470499328.pth [2023-12-28 08:26:56,525][106226] Updated weights for policy 0, policy_version 1834763 (0.0009) [2023-12-28 08:26:56,536][106225] Updated weights for policy 1, policy_version 1838818 (0.0007) [2023-12-28 08:26:56,581][106226] Updated weights for policy 0, policy_version 1834773 (0.0007) [2023-12-28 08:26:56,591][106225] Updated weights for policy 1, policy_version 1838828 (0.0006) [2023-12-28 08:26:56,633][106226] Updated weights for policy 0, policy_version 1834783 (0.0010) [2023-12-28 08:26:56,650][106225] Updated weights for policy 1, policy_version 1838838 (0.0005) [2023-12-28 08:26:56,709][106225] Updated weights for policy 1, policy_version 1838848 (0.0007) [2023-12-28 08:26:57,337][106226] Updated weights for policy 0, policy_version 1834793 (0.0010) [2023-12-28 08:26:57,396][106226] Updated weights for policy 0, policy_version 1834803 (0.0006) [2023-12-28 08:26:57,413][106225] Updated weights for policy 1, policy_version 1838858 (0.0006) [2023-12-28 08:26:57,463][106226] Updated weights for policy 0, policy_version 1834813 (0.0006) [2023-12-28 08:26:57,470][106225] Updated weights for policy 1, policy_version 1838868 (0.0006) [2023-12-28 08:26:57,523][106226] Updated weights for policy 0, policy_version 1834823 (0.0010) [2023-12-28 08:26:57,536][106225] Updated weights for policy 1, policy_version 1838878 (0.0006) [2023-12-28 08:26:58,139][106225] Updated weights for policy 1, policy_version 1838888 (0.0005) [2023-12-28 08:26:58,196][106226] Updated weights for policy 0, policy_version 1834833 (0.0011) [2023-12-28 08:26:58,200][106225] Updated weights for policy 1, policy_version 1838898 (0.0006) [2023-12-28 08:26:58,260][106226] Updated weights for policy 0, policy_version 1834843 (0.0011) [2023-12-28 08:26:58,266][106225] Updated weights for policy 1, policy_version 1838908 (0.0007) [2023-12-28 08:26:58,320][106226] Updated weights for policy 0, policy_version 1834853 (0.0009) [2023-12-28 08:26:59,057][106225] Updated weights for policy 1, policy_version 1838918 (0.0008) [2023-12-28 08:26:59,121][106225] Updated weights for policy 1, policy_version 1838928 (0.0009) [2023-12-28 08:26:59,153][106226] Updated weights for policy 0, policy_version 1834863 (0.0008) [2023-12-28 08:26:59,176][106225] Updated weights for policy 1, policy_version 1838938 (0.0006) [2023-12-28 08:26:59,215][106226] Updated weights for policy 0, policy_version 1834873 (0.0007) [2023-12-28 08:26:59,286][106226] Updated weights for policy 0, policy_version 1834883 (0.0009) [2023-12-28 08:26:59,970][106226] Updated weights for policy 0, policy_version 1834893 (0.0010) [2023-12-28 08:26:59,988][106225] Updated weights for policy 1, policy_version 1838948 (0.0007) [2023-12-28 08:27:00,036][106226] Updated weights for policy 0, policy_version 1834903 (0.0007) [2023-12-28 08:27:00,043][106225] Updated weights for policy 1, policy_version 1838958 (0.0007) [2023-12-28 08:27:00,096][106225] Updated weights for policy 1, policy_version 1838968 (0.0008) [2023-12-28 08:27:00,098][106226] Updated weights for policy 0, policy_version 1834913 (0.0007) [2023-12-28 08:27:00,805][106225] Updated weights for policy 1, policy_version 1838978 (0.0006) [2023-12-28 08:27:00,842][106226] Updated weights for policy 0, policy_version 1834923 (0.0007) [2023-12-28 08:27:00,856][106225] Updated weights for policy 1, policy_version 1838988 (0.0006) [2023-12-28 08:27:00,905][106226] Updated weights for policy 0, policy_version 1834933 (0.0007) [2023-12-28 08:27:00,911][106225] Updated weights for policy 1, policy_version 1838998 (0.0008) [2023-12-28 08:27:00,955][106225] Updated weights for policy 1, policy_version 1839008 (0.0007) [2023-12-28 08:27:00,964][106226] Updated weights for policy 0, policy_version 1834943 (0.0006) [2023-12-28 08:27:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19716.4). Total num frames: 940670976. Throughput: 0: 10036.2, 1: 9794.7. Samples: 940657564. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:01,175][105115] Avg episode reward: [(0, '-4.265'), (1, '-4.846')] [2023-12-28 08:27:01,638][106226] Updated weights for policy 0, policy_version 1834953 (0.0007) [2023-12-28 08:27:01,698][106226] Updated weights for policy 0, policy_version 1834963 (0.0007) [2023-12-28 08:27:01,711][106225] Updated weights for policy 1, policy_version 1839018 (0.0006) [2023-12-28 08:27:01,766][106226] Updated weights for policy 0, policy_version 1834973 (0.0008) [2023-12-28 08:27:01,768][106225] Updated weights for policy 1, policy_version 1839028 (0.0007) [2023-12-28 08:27:01,823][106225] Updated weights for policy 1, policy_version 1839038 (0.0008) [2023-12-28 08:27:01,825][106226] Updated weights for policy 0, policy_version 1834983 (0.0006) [2023-12-28 08:27:02,465][106226] Updated weights for policy 0, policy_version 1834993 (0.0007) [2023-12-28 08:27:02,494][106225] Updated weights for policy 1, policy_version 1839048 (0.0007) [2023-12-28 08:27:02,520][106226] Updated weights for policy 0, policy_version 1835003 (0.0006) [2023-12-28 08:27:02,553][106225] Updated weights for policy 1, policy_version 1839058 (0.0006) [2023-12-28 08:27:02,571][106226] Updated weights for policy 0, policy_version 1835013 (0.0007) [2023-12-28 08:27:02,603][106225] Updated weights for policy 1, policy_version 1839068 (0.0007) [2023-12-28 08:27:03,270][106225] Updated weights for policy 1, policy_version 1839078 (0.0007) [2023-12-28 08:27:03,328][106225] Updated weights for policy 1, policy_version 1839088 (0.0005) [2023-12-28 08:27:03,346][106226] Updated weights for policy 0, policy_version 1835023 (0.0008) [2023-12-28 08:27:03,378][106225] Updated weights for policy 1, policy_version 1839098 (0.0005) [2023-12-28 08:27:03,395][106226] Updated weights for policy 0, policy_version 1835033 (0.0008) [2023-12-28 08:27:03,443][106226] Updated weights for policy 0, policy_version 1835043 (0.0008) [2023-12-28 08:27:03,941][106225] Updated weights for policy 1, policy_version 1839108 (0.0005) [2023-12-28 08:27:04,006][106225] Updated weights for policy 1, policy_version 1839118 (0.0005) [2023-12-28 08:27:04,068][106225] Updated weights for policy 1, policy_version 1839128 (0.0005) [2023-12-28 08:27:04,226][106226] Updated weights for policy 0, policy_version 1835053 (0.0008) [2023-12-28 08:27:04,286][106226] Updated weights for policy 0, policy_version 1835063 (0.0008) [2023-12-28 08:27:04,348][106226] Updated weights for policy 0, policy_version 1835073 (0.0007) [2023-12-28 08:27:04,734][106225] Updated weights for policy 1, policy_version 1839138 (0.0006) [2023-12-28 08:27:04,789][106225] Updated weights for policy 1, policy_version 1839148 (0.0008) [2023-12-28 08:27:04,851][106225] Updated weights for policy 1, policy_version 1839158 (0.0009) [2023-12-28 08:27:04,901][106225] Updated weights for policy 1, policy_version 1839168 (0.0008) [2023-12-28 08:27:05,031][106226] Updated weights for policy 0, policy_version 1835083 (0.0008) [2023-12-28 08:27:05,095][106226] Updated weights for policy 0, policy_version 1835093 (0.0008) [2023-12-28 08:27:05,162][106226] Updated weights for policy 0, policy_version 1835103 (0.0008) [2023-12-28 08:27:05,649][106225] Updated weights for policy 1, policy_version 1839178 (0.0011) [2023-12-28 08:27:05,717][106225] Updated weights for policy 1, policy_version 1839188 (0.0010) [2023-12-28 08:27:05,780][106225] Updated weights for policy 1, policy_version 1839198 (0.0010) [2023-12-28 08:27:05,880][106226] Updated weights for policy 0, policy_version 1835113 (0.0008) [2023-12-28 08:27:05,939][106226] Updated weights for policy 0, policy_version 1835123 (0.0008) [2023-12-28 08:27:05,998][106226] Updated weights for policy 0, policy_version 1835133 (0.0008) [2023-12-28 08:27:06,063][106226] Updated weights for policy 0, policy_version 1835143 (0.0010) [2023-12-28 08:27:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 940769280. Throughput: 0: 9947.3, 1: 9805.7. Samples: 940775792. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:06,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.393')] [2023-12-28 08:27:06,477][106225] Updated weights for policy 1, policy_version 1839208 (0.0010) [2023-12-28 08:27:06,536][106225] Updated weights for policy 1, policy_version 1839218 (0.0010) [2023-12-28 08:27:06,584][106225] Updated weights for policy 1, policy_version 1839228 (0.0010) [2023-12-28 08:27:06,817][106226] Updated weights for policy 0, policy_version 1835153 (0.0006) [2023-12-28 08:27:06,870][106226] Updated weights for policy 0, policy_version 1835163 (0.0009) [2023-12-28 08:27:06,922][106226] Updated weights for policy 0, policy_version 1835173 (0.0009) [2023-12-28 08:27:07,305][106225] Updated weights for policy 1, policy_version 1839238 (0.0007) [2023-12-28 08:27:07,361][106225] Updated weights for policy 1, policy_version 1839248 (0.0005) [2023-12-28 08:27:07,426][106225] Updated weights for policy 1, policy_version 1839258 (0.0006) [2023-12-28 08:27:07,620][106226] Updated weights for policy 0, policy_version 1835183 (0.0006) [2023-12-28 08:27:07,683][106226] Updated weights for policy 0, policy_version 1835193 (0.0005) [2023-12-28 08:27:07,741][106226] Updated weights for policy 0, policy_version 1835203 (0.0009) [2023-12-28 08:27:08,036][106225] Updated weights for policy 1, policy_version 1839268 (0.0007) [2023-12-28 08:27:08,092][106225] Updated weights for policy 1, policy_version 1839278 (0.0009) [2023-12-28 08:27:08,141][106225] Updated weights for policy 1, policy_version 1839288 (0.0009) [2023-12-28 08:27:08,292][106226] Updated weights for policy 0, policy_version 1835213 (0.0008) [2023-12-28 08:27:08,360][106226] Updated weights for policy 0, policy_version 1835223 (0.0008) [2023-12-28 08:27:08,422][106226] Updated weights for policy 0, policy_version 1835233 (0.0009) [2023-12-28 08:27:08,888][106225] Updated weights for policy 1, policy_version 1839299 (0.0008) [2023-12-28 08:27:08,951][106225] Updated weights for policy 1, policy_version 1839309 (0.0008) [2023-12-28 08:27:09,010][106225] Updated weights for policy 1, policy_version 1839319 (0.0008) [2023-12-28 08:27:09,165][106226] Updated weights for policy 0, policy_version 1835243 (0.0008) [2023-12-28 08:27:09,227][106226] Updated weights for policy 0, policy_version 1835253 (0.0006) [2023-12-28 08:27:09,284][106226] Updated weights for policy 0, policy_version 1835263 (0.0008) [2023-12-28 08:27:09,754][106225] Updated weights for policy 1, policy_version 1839329 (0.0007) [2023-12-28 08:27:09,827][106225] Updated weights for policy 1, policy_version 1839339 (0.0010) [2023-12-28 08:27:09,889][106225] Updated weights for policy 1, policy_version 1839349 (0.0008) [2023-12-28 08:27:09,952][106225] Updated weights for policy 1, policy_version 1839359 (0.0009) [2023-12-28 08:27:09,987][106226] Updated weights for policy 0, policy_version 1835273 (0.0008) [2023-12-28 08:27:10,041][106226] Updated weights for policy 0, policy_version 1835283 (0.0007) [2023-12-28 08:27:10,093][106226] Updated weights for policy 0, policy_version 1835293 (0.0006) [2023-12-28 08:27:10,147][106226] Updated weights for policy 0, policy_version 1835303 (0.0007) [2023-12-28 08:27:10,724][106225] Updated weights for policy 1, policy_version 1839369 (0.0008) [2023-12-28 08:27:10,776][106225] Updated weights for policy 1, policy_version 1839379 (0.0008) [2023-12-28 08:27:10,822][106225] Updated weights for policy 1, policy_version 1839389 (0.0008) [2023-12-28 08:27:10,832][106226] Updated weights for policy 0, policy_version 1835313 (0.0008) [2023-12-28 08:27:10,895][106226] Updated weights for policy 0, policy_version 1835323 (0.0008) [2023-12-28 08:27:10,951][106226] Updated weights for policy 0, policy_version 1835333 (0.0008) [2023-12-28 08:27:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 940867584. Throughput: 0: 9971.4, 1: 9867.5. Samples: 940835652. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:11,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.705')] [2023-12-28 08:27:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001839392_470941696.pth... [2023-12-28 08:27:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001835336_469925888.pth... [2023-12-28 08:27:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001838240_470646784.pth [2023-12-28 08:27:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001834184_469630976.pth [2023-12-28 08:27:11,603][106225] Updated weights for policy 1, policy_version 1839399 (0.0008) [2023-12-28 08:27:11,672][106225] Updated weights for policy 1, policy_version 1839409 (0.0008) [2023-12-28 08:27:11,737][106225] Updated weights for policy 1, policy_version 1839419 (0.0009) [2023-12-28 08:27:11,787][106226] Updated weights for policy 0, policy_version 1835343 (0.0006) [2023-12-28 08:27:11,839][106226] Updated weights for policy 0, policy_version 1835353 (0.0006) [2023-12-28 08:27:11,893][106226] Updated weights for policy 0, policy_version 1835363 (0.0009) [2023-12-28 08:27:12,498][106225] Updated weights for policy 1, policy_version 1839429 (0.0009) [2023-12-28 08:27:12,552][106225] Updated weights for policy 1, policy_version 1839439 (0.0009) [2023-12-28 08:27:12,602][106226] Updated weights for policy 0, policy_version 1835373 (0.0010) [2023-12-28 08:27:12,617][106225] Updated weights for policy 1, policy_version 1839449 (0.0007) [2023-12-28 08:27:12,663][106226] Updated weights for policy 0, policy_version 1835383 (0.0011) [2023-12-28 08:27:12,727][106226] Updated weights for policy 0, policy_version 1835393 (0.0011) [2023-12-28 08:27:13,319][106225] Updated weights for policy 1, policy_version 1839459 (0.0008) [2023-12-28 08:27:13,379][106225] Updated weights for policy 1, policy_version 1839469 (0.0009) [2023-12-28 08:27:13,396][106226] Updated weights for policy 0, policy_version 1835403 (0.0009) [2023-12-28 08:27:13,440][106225] Updated weights for policy 1, policy_version 1839479 (0.0010) [2023-12-28 08:27:13,457][106226] Updated weights for policy 0, policy_version 1835413 (0.0007) [2023-12-28 08:27:13,524][106226] Updated weights for policy 0, policy_version 1835423 (0.0005) [2023-12-28 08:27:14,072][106225] Updated weights for policy 1, policy_version 1839489 (0.0010) [2023-12-28 08:27:14,077][106226] Updated weights for policy 0, policy_version 1835433 (0.0006) [2023-12-28 08:27:14,121][106225] Updated weights for policy 1, policy_version 1839499 (0.0008) [2023-12-28 08:27:14,138][106226] Updated weights for policy 0, policy_version 1835443 (0.0011) [2023-12-28 08:27:14,169][106225] Updated weights for policy 1, policy_version 1839509 (0.0009) [2023-12-28 08:27:14,195][106226] Updated weights for policy 0, policy_version 1835453 (0.0010) [2023-12-28 08:27:14,219][106225] Updated weights for policy 1, policy_version 1839519 (0.0007) [2023-12-28 08:27:14,254][106226] Updated weights for policy 0, policy_version 1835463 (0.0010) [2023-12-28 08:27:14,857][106225] Updated weights for policy 1, policy_version 1839529 (0.0008) [2023-12-28 08:27:14,917][106225] Updated weights for policy 1, policy_version 1839539 (0.0007) [2023-12-28 08:27:14,942][106226] Updated weights for policy 0, policy_version 1835473 (0.0008) [2023-12-28 08:27:14,979][106225] Updated weights for policy 1, policy_version 1839549 (0.0007) [2023-12-28 08:27:15,002][106226] Updated weights for policy 0, policy_version 1835483 (0.0007) [2023-12-28 08:27:15,063][106226] Updated weights for policy 0, policy_version 1835493 (0.0008) [2023-12-28 08:27:15,645][106226] Updated weights for policy 0, policy_version 1835503 (0.0008) [2023-12-28 08:27:15,696][106226] Updated weights for policy 0, policy_version 1835513 (0.0008) [2023-12-28 08:27:15,764][106226] Updated weights for policy 0, policy_version 1835523 (0.0008) [2023-12-28 08:27:15,782][106225] Updated weights for policy 1, policy_version 1839559 (0.0008) [2023-12-28 08:27:15,832][106225] Updated weights for policy 1, policy_version 1839569 (0.0008) [2023-12-28 08:27:15,877][106225] Updated weights for policy 1, policy_version 1839579 (0.0006) [2023-12-28 08:27:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 940965888. Throughput: 0: 9898.7, 1: 9880.7. Samples: 940953560. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:16,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.801')] [2023-12-28 08:27:16,400][106226] Updated weights for policy 0, policy_version 1835533 (0.0007) [2023-12-28 08:27:16,453][106226] Updated weights for policy 0, policy_version 1835543 (0.0009) [2023-12-28 08:27:16,509][106226] Updated weights for policy 0, policy_version 1835553 (0.0008) [2023-12-28 08:27:16,651][106225] Updated weights for policy 1, policy_version 1839589 (0.0007) [2023-12-28 08:27:16,702][106225] Updated weights for policy 1, policy_version 1839599 (0.0008) [2023-12-28 08:27:16,756][106225] Updated weights for policy 1, policy_version 1839609 (0.0008) [2023-12-28 08:27:17,180][106226] Updated weights for policy 0, policy_version 1835563 (0.0008) [2023-12-28 08:27:17,236][106226] Updated weights for policy 0, policy_version 1835573 (0.0005) [2023-12-28 08:27:17,292][106226] Updated weights for policy 0, policy_version 1835583 (0.0006) [2023-12-28 08:27:17,554][106225] Updated weights for policy 1, policy_version 1839619 (0.0008) [2023-12-28 08:27:17,608][106225] Updated weights for policy 1, policy_version 1839629 (0.0008) [2023-12-28 08:27:17,665][106225] Updated weights for policy 1, policy_version 1839639 (0.0009) [2023-12-28 08:27:17,853][106226] Updated weights for policy 0, policy_version 1835593 (0.0009) [2023-12-28 08:27:17,908][106226] Updated weights for policy 0, policy_version 1835603 (0.0005) [2023-12-28 08:27:17,967][106226] Updated weights for policy 0, policy_version 1835613 (0.0005) [2023-12-28 08:27:18,025][106226] Updated weights for policy 0, policy_version 1835623 (0.0008) [2023-12-28 08:27:18,477][106225] Updated weights for policy 1, policy_version 1839649 (0.0008) [2023-12-28 08:27:18,540][106225] Updated weights for policy 1, policy_version 1839659 (0.0005) [2023-12-28 08:27:18,600][106225] Updated weights for policy 1, policy_version 1839669 (0.0008) [2023-12-28 08:27:18,643][106226] Updated weights for policy 0, policy_version 1835633 (0.0007) [2023-12-28 08:27:18,657][106225] Updated weights for policy 1, policy_version 1839679 (0.0007) [2023-12-28 08:27:18,700][106226] Updated weights for policy 0, policy_version 1835643 (0.0011) [2023-12-28 08:27:18,762][106226] Updated weights for policy 0, policy_version 1835653 (0.0011) [2023-12-28 08:27:19,375][106225] Updated weights for policy 1, policy_version 1839689 (0.0008) [2023-12-28 08:27:19,439][106225] Updated weights for policy 1, policy_version 1839699 (0.0008) [2023-12-28 08:27:19,483][106226] Updated weights for policy 0, policy_version 1835663 (0.0010) [2023-12-28 08:27:19,498][106225] Updated weights for policy 1, policy_version 1839709 (0.0007) [2023-12-28 08:27:19,551][106226] Updated weights for policy 0, policy_version 1835673 (0.0010) [2023-12-28 08:27:19,612][106226] Updated weights for policy 0, policy_version 1835683 (0.0011) [2023-12-28 08:27:20,269][106225] Updated weights for policy 1, policy_version 1839719 (0.0007) [2023-12-28 08:27:20,326][106225] Updated weights for policy 1, policy_version 1839729 (0.0008) [2023-12-28 08:27:20,382][106225] Updated weights for policy 1, policy_version 1839739 (0.0006) [2023-12-28 08:27:20,389][106226] Updated weights for policy 0, policy_version 1835693 (0.0010) [2023-12-28 08:27:20,450][106226] Updated weights for policy 0, policy_version 1835703 (0.0008) [2023-12-28 08:27:20,502][106226] Updated weights for policy 0, policy_version 1835713 (0.0009) [2023-12-28 08:27:21,159][106225] Updated weights for policy 1, policy_version 1839749 (0.0008) [2023-12-28 08:27:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 941056000. Throughput: 0: 9975.5, 1: 9750.2. Samples: 941069704. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:21,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.562')] [2023-12-28 08:27:21,223][106225] Updated weights for policy 1, policy_version 1839759 (0.0008) [2023-12-28 08:27:21,290][106225] Updated weights for policy 1, policy_version 1839769 (0.0010) [2023-12-28 08:27:21,373][106226] Updated weights for policy 0, policy_version 1835723 (0.0009) [2023-12-28 08:27:21,432][106226] Updated weights for policy 0, policy_version 1835733 (0.0009) [2023-12-28 08:27:21,487][106226] Updated weights for policy 0, policy_version 1835743 (0.0009) [2023-12-28 08:27:22,074][106225] Updated weights for policy 1, policy_version 1839779 (0.0009) [2023-12-28 08:27:22,141][106225] Updated weights for policy 1, policy_version 1839789 (0.0006) [2023-12-28 08:27:22,207][106225] Updated weights for policy 1, policy_version 1839799 (0.0006) [2023-12-28 08:27:22,288][106226] Updated weights for policy 0, policy_version 1835753 (0.0009) [2023-12-28 08:27:22,360][106226] Updated weights for policy 0, policy_version 1835763 (0.0010) [2023-12-28 08:27:22,430][106226] Updated weights for policy 0, policy_version 1835773 (0.0010) [2023-12-28 08:27:22,496][106226] Updated weights for policy 0, policy_version 1835783 (0.0011) [2023-12-28 08:27:22,895][106225] Updated weights for policy 1, policy_version 1839809 (0.0006) [2023-12-28 08:27:22,963][106225] Updated weights for policy 1, policy_version 1839819 (0.0006) [2023-12-28 08:27:23,029][106225] Updated weights for policy 1, policy_version 1839829 (0.0006) [2023-12-28 08:27:23,085][106225] Updated weights for policy 1, policy_version 1839839 (0.0006) [2023-12-28 08:27:23,162][106226] Updated weights for policy 0, policy_version 1835793 (0.0010) [2023-12-28 08:27:23,216][106226] Updated weights for policy 0, policy_version 1835803 (0.0011) [2023-12-28 08:27:23,262][106226] Updated weights for policy 0, policy_version 1835813 (0.0010) [2023-12-28 08:27:23,719][106225] Updated weights for policy 1, policy_version 1839849 (0.0008) [2023-12-28 08:27:23,774][106225] Updated weights for policy 1, policy_version 1839859 (0.0008) [2023-12-28 08:27:23,832][106225] Updated weights for policy 1, policy_version 1839869 (0.0009) [2023-12-28 08:27:23,968][106226] Updated weights for policy 0, policy_version 1835823 (0.0009) [2023-12-28 08:27:24,036][106226] Updated weights for policy 0, policy_version 1835833 (0.0009) [2023-12-28 08:27:24,103][106226] Updated weights for policy 0, policy_version 1835843 (0.0009) [2023-12-28 08:27:24,521][106225] Updated weights for policy 1, policy_version 1839879 (0.0007) [2023-12-28 08:27:24,576][106225] Updated weights for policy 1, policy_version 1839889 (0.0008) [2023-12-28 08:27:24,628][106225] Updated weights for policy 1, policy_version 1839899 (0.0008) [2023-12-28 08:27:24,749][106226] Updated weights for policy 0, policy_version 1835853 (0.0009) [2023-12-28 08:27:24,802][106226] Updated weights for policy 0, policy_version 1835863 (0.0005) [2023-12-28 08:27:24,856][106226] Updated weights for policy 0, policy_version 1835873 (0.0005) [2023-12-28 08:27:25,404][106225] Updated weights for policy 1, policy_version 1839909 (0.0007) [2023-12-28 08:27:25,426][106226] Updated weights for policy 0, policy_version 1835883 (0.0006) [2023-12-28 08:27:25,463][106225] Updated weights for policy 1, policy_version 1839919 (0.0006) [2023-12-28 08:27:25,483][106226] Updated weights for policy 0, policy_version 1835893 (0.0005) [2023-12-28 08:27:25,528][106225] Updated weights for policy 1, policy_version 1839929 (0.0006) [2023-12-28 08:27:25,536][106226] Updated weights for policy 0, policy_version 1835903 (0.0005) [2023-12-28 08:27:26,154][106226] Updated weights for policy 0, policy_version 1835913 (0.0006) [2023-12-28 08:27:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 941154304. Throughput: 0: 9955.2, 1: 9732.2. Samples: 941126688. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:26,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-5.007')] [2023-12-28 08:27:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001839936_471080960.pth... [2023-12-28 08:27:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001838816_470794240.pth [2023-12-28 08:27:26,219][106226] Updated weights for policy 0, policy_version 1835923 (0.0009) [2023-12-28 08:27:26,237][106225] Updated weights for policy 1, policy_version 1839939 (0.0008) [2023-12-28 08:27:26,271][106226] Updated weights for policy 0, policy_version 1835933 (0.0006) [2023-12-28 08:27:26,296][106225] Updated weights for policy 1, policy_version 1839949 (0.0007) [2023-12-28 08:27:26,322][106226] Updated weights for policy 0, policy_version 1835943 (0.0007) [2023-12-28 08:27:26,324][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001835944_470081536.pth... [2023-12-28 08:27:26,327][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001834760_469778432.pth [2023-12-28 08:27:26,353][106225] Updated weights for policy 1, policy_version 1839959 (0.0006) [2023-12-28 08:27:27,019][106226] Updated weights for policy 0, policy_version 1835953 (0.0008) [2023-12-28 08:27:27,071][106225] Updated weights for policy 1, policy_version 1839969 (0.0008) [2023-12-28 08:27:27,074][106226] Updated weights for policy 0, policy_version 1835963 (0.0009) [2023-12-28 08:27:27,118][106225] Updated weights for policy 1, policy_version 1839979 (0.0005) [2023-12-28 08:27:27,130][106226] Updated weights for policy 0, policy_version 1835973 (0.0008) [2023-12-28 08:27:27,168][106225] Updated weights for policy 1, policy_version 1839989 (0.0005) [2023-12-28 08:27:27,218][106225] Updated weights for policy 1, policy_version 1839999 (0.0008) [2023-12-28 08:27:27,833][106226] Updated weights for policy 0, policy_version 1835983 (0.0005) [2023-12-28 08:27:27,894][106226] Updated weights for policy 0, policy_version 1835993 (0.0005) [2023-12-28 08:27:27,905][106225] Updated weights for policy 1, policy_version 1840009 (0.0009) [2023-12-28 08:27:27,955][106226] Updated weights for policy 0, policy_version 1836003 (0.0005) [2023-12-28 08:27:27,961][106225] Updated weights for policy 1, policy_version 1840019 (0.0007) [2023-12-28 08:27:28,019][106225] Updated weights for policy 1, policy_version 1840029 (0.0006) [2023-12-28 08:27:28,592][106226] Updated weights for policy 0, policy_version 1836013 (0.0008) [2023-12-28 08:27:28,644][106226] Updated weights for policy 0, policy_version 1836023 (0.0009) [2023-12-28 08:27:28,691][106225] Updated weights for policy 1, policy_version 1840039 (0.0008) [2023-12-28 08:27:28,700][106226] Updated weights for policy 0, policy_version 1836033 (0.0009) [2023-12-28 08:27:28,747][106225] Updated weights for policy 1, policy_version 1840049 (0.0006) [2023-12-28 08:27:28,804][106225] Updated weights for policy 1, policy_version 1840059 (0.0005) [2023-12-28 08:27:29,379][106226] Updated weights for policy 0, policy_version 1836043 (0.0010) [2023-12-28 08:27:29,440][106226] Updated weights for policy 0, policy_version 1836053 (0.0010) [2023-12-28 08:27:29,499][106226] Updated weights for policy 0, policy_version 1836063 (0.0010) [2023-12-28 08:27:29,524][106225] Updated weights for policy 1, policy_version 1840069 (0.0007) [2023-12-28 08:27:29,584][106225] Updated weights for policy 1, policy_version 1840079 (0.0007) [2023-12-28 08:27:29,641][106225] Updated weights for policy 1, policy_version 1840089 (0.0007) [2023-12-28 08:27:30,246][106225] Updated weights for policy 1, policy_version 1840099 (0.0007) [2023-12-28 08:27:30,257][106226] Updated weights for policy 0, policy_version 1836073 (0.0010) [2023-12-28 08:27:30,300][106225] Updated weights for policy 1, policy_version 1840109 (0.0005) [2023-12-28 08:27:30,320][106226] Updated weights for policy 0, policy_version 1836083 (0.0008) [2023-12-28 08:27:30,357][106225] Updated weights for policy 1, policy_version 1840119 (0.0006) [2023-12-28 08:27:30,383][106226] Updated weights for policy 0, policy_version 1836093 (0.0006) [2023-12-28 08:27:30,439][106226] Updated weights for policy 0, policy_version 1836103 (0.0008) [2023-12-28 08:27:30,985][106225] Updated weights for policy 1, policy_version 1840129 (0.0006) [2023-12-28 08:27:31,054][106225] Updated weights for policy 1, policy_version 1840139 (0.0007) [2023-12-28 08:27:31,123][106225] Updated weights for policy 1, policy_version 1840149 (0.0009) [2023-12-28 08:27:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 941252608. Throughput: 0: 10018.0, 1: 9714.9. Samples: 941248772. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:31,175][105115] Avg episode reward: [(0, '-4.875'), (1, '-4.544')] [2023-12-28 08:27:31,197][106225] Updated weights for policy 1, policy_version 1840159 (0.0008) [2023-12-28 08:27:31,202][106226] Updated weights for policy 0, policy_version 1836113 (0.0009) [2023-12-28 08:27:31,267][106226] Updated weights for policy 0, policy_version 1836123 (0.0008) [2023-12-28 08:27:31,330][106226] Updated weights for policy 0, policy_version 1836133 (0.0011) [2023-12-28 08:27:32,013][106226] Updated weights for policy 0, policy_version 1836143 (0.0008) [2023-12-28 08:27:32,033][106225] Updated weights for policy 1, policy_version 1840169 (0.0007) [2023-12-28 08:27:32,067][106226] Updated weights for policy 0, policy_version 1836153 (0.0010) [2023-12-28 08:27:32,085][106225] Updated weights for policy 1, policy_version 1840179 (0.0007) [2023-12-28 08:27:32,118][106226] Updated weights for policy 0, policy_version 1836163 (0.0010) [2023-12-28 08:27:32,140][106225] Updated weights for policy 1, policy_version 1840189 (0.0006) [2023-12-28 08:27:32,832][106226] Updated weights for policy 0, policy_version 1836173 (0.0010) [2023-12-28 08:27:32,843][106225] Updated weights for policy 1, policy_version 1840199 (0.0009) [2023-12-28 08:27:32,891][106225] Updated weights for policy 1, policy_version 1840209 (0.0010) [2023-12-28 08:27:32,892][106226] Updated weights for policy 0, policy_version 1836183 (0.0010) [2023-12-28 08:27:32,935][106225] Updated weights for policy 1, policy_version 1840219 (0.0006) [2023-12-28 08:27:32,955][106226] Updated weights for policy 0, policy_version 1836193 (0.0010) [2023-12-28 08:27:33,584][106225] Updated weights for policy 1, policy_version 1840229 (0.0010) [2023-12-28 08:27:33,640][106225] Updated weights for policy 1, policy_version 1840239 (0.0010) [2023-12-28 08:27:33,649][106226] Updated weights for policy 0, policy_version 1836203 (0.0009) [2023-12-28 08:27:33,699][106225] Updated weights for policy 1, policy_version 1840249 (0.0010) [2023-12-28 08:27:33,708][106226] Updated weights for policy 0, policy_version 1836213 (0.0005) [2023-12-28 08:27:33,765][106226] Updated weights for policy 0, policy_version 1836223 (0.0005) [2023-12-28 08:27:34,276][106226] Updated weights for policy 0, policy_version 1836233 (0.0006) [2023-12-28 08:27:34,339][106226] Updated weights for policy 0, policy_version 1836243 (0.0008) [2023-12-28 08:27:34,394][106226] Updated weights for policy 0, policy_version 1836253 (0.0008) [2023-12-28 08:27:34,410][106225] Updated weights for policy 1, policy_version 1840259 (0.0010) [2023-12-28 08:27:34,454][106226] Updated weights for policy 0, policy_version 1836263 (0.0008) [2023-12-28 08:27:34,471][106225] Updated weights for policy 1, policy_version 1840269 (0.0010) [2023-12-28 08:27:34,527][106225] Updated weights for policy 1, policy_version 1840279 (0.0008) [2023-12-28 08:27:35,170][106226] Updated weights for policy 0, policy_version 1836273 (0.0008) [2023-12-28 08:27:35,228][106226] Updated weights for policy 0, policy_version 1836283 (0.0007) [2023-12-28 08:27:35,262][106225] Updated weights for policy 1, policy_version 1840289 (0.0008) [2023-12-28 08:27:35,288][106226] Updated weights for policy 0, policy_version 1836293 (0.0005) [2023-12-28 08:27:35,318][106225] Updated weights for policy 1, policy_version 1840299 (0.0010) [2023-12-28 08:27:35,372][106225] Updated weights for policy 1, policy_version 1840309 (0.0010) [2023-12-28 08:27:35,425][106225] Updated weights for policy 1, policy_version 1840319 (0.0010) [2023-12-28 08:27:35,946][106226] Updated weights for policy 0, policy_version 1836303 (0.0006) [2023-12-28 08:27:36,014][106226] Updated weights for policy 0, policy_version 1836313 (0.0006) [2023-12-28 08:27:36,065][106226] Updated weights for policy 0, policy_version 1836323 (0.0007) [2023-12-28 08:27:36,143][106225] Updated weights for policy 1, policy_version 1840329 (0.0008) [2023-12-28 08:27:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 941359104. Throughput: 0: 10048.5, 1: 9736.3. Samples: 941369180. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:36,175][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.537')] [2023-12-28 08:27:36,200][106225] Updated weights for policy 1, policy_version 1840339 (0.0006) [2023-12-28 08:27:36,259][106225] Updated weights for policy 1, policy_version 1840349 (0.0008) [2023-12-28 08:27:36,862][106225] Updated weights for policy 1, policy_version 1840359 (0.0008) [2023-12-28 08:27:36,893][106226] Updated weights for policy 0, policy_version 1836333 (0.0006) [2023-12-28 08:27:36,923][106225] Updated weights for policy 1, policy_version 1840369 (0.0007) [2023-12-28 08:27:36,949][106226] Updated weights for policy 0, policy_version 1836343 (0.0007) [2023-12-28 08:27:36,983][106225] Updated weights for policy 1, policy_version 1840379 (0.0008) [2023-12-28 08:27:37,014][106226] Updated weights for policy 0, policy_version 1836353 (0.0006) [2023-12-28 08:27:37,675][106226] Updated weights for policy 0, policy_version 1836363 (0.0007) [2023-12-28 08:27:37,732][106226] Updated weights for policy 0, policy_version 1836373 (0.0010) [2023-12-28 08:27:37,764][106225] Updated weights for policy 1, policy_version 1840389 (0.0008) [2023-12-28 08:27:37,793][106226] Updated weights for policy 0, policy_version 1836383 (0.0009) [2023-12-28 08:27:37,821][106225] Updated weights for policy 1, policy_version 1840399 (0.0006) [2023-12-28 08:27:37,879][106225] Updated weights for policy 1, policy_version 1840409 (0.0007) [2023-12-28 08:27:38,454][106226] Updated weights for policy 0, policy_version 1836393 (0.0010) [2023-12-28 08:27:38,521][106226] Updated weights for policy 0, policy_version 1836403 (0.0010) [2023-12-28 08:27:38,578][106226] Updated weights for policy 0, policy_version 1836413 (0.0011) [2023-12-28 08:27:38,615][106225] Updated weights for policy 1, policy_version 1840419 (0.0007) [2023-12-28 08:27:38,640][106226] Updated weights for policy 0, policy_version 1836423 (0.0011) [2023-12-28 08:27:38,669][106225] Updated weights for policy 1, policy_version 1840429 (0.0006) [2023-12-28 08:27:38,726][106225] Updated weights for policy 1, policy_version 1840439 (0.0008) [2023-12-28 08:27:39,306][106226] Updated weights for policy 0, policy_version 1836433 (0.0008) [2023-12-28 08:27:39,380][106226] Updated weights for policy 0, policy_version 1836443 (0.0009) [2023-12-28 08:27:39,445][106226] Updated weights for policy 0, policy_version 1836453 (0.0009) [2023-12-28 08:27:39,534][106225] Updated weights for policy 1, policy_version 1840449 (0.0010) [2023-12-28 08:27:39,596][106225] Updated weights for policy 1, policy_version 1840459 (0.0011) [2023-12-28 08:27:39,658][106225] Updated weights for policy 1, policy_version 1840469 (0.0011) [2023-12-28 08:27:39,717][106225] Updated weights for policy 1, policy_version 1840479 (0.0011) [2023-12-28 08:27:40,182][106226] Updated weights for policy 0, policy_version 1836463 (0.0009) [2023-12-28 08:27:40,250][106226] Updated weights for policy 0, policy_version 1836473 (0.0009) [2023-12-28 08:27:40,317][106226] Updated weights for policy 0, policy_version 1836483 (0.0008) [2023-12-28 08:27:40,480][106225] Updated weights for policy 1, policy_version 1840489 (0.0009) [2023-12-28 08:27:40,541][106225] Updated weights for policy 1, policy_version 1840499 (0.0009) [2023-12-28 08:27:40,595][106225] Updated weights for policy 1, policy_version 1840509 (0.0009) [2023-12-28 08:27:40,935][106226] Updated weights for policy 0, policy_version 1836493 (0.0007) [2023-12-28 08:27:40,989][106226] Updated weights for policy 0, policy_version 1836503 (0.0007) [2023-12-28 08:27:41,067][106226] Updated weights for policy 0, policy_version 1836513 (0.0009) [2023-12-28 08:27:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 941457408. Throughput: 0: 10018.2, 1: 9733.8. Samples: 941427400. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:41,175][105115] Avg episode reward: [(0, '-4.156'), (1, '-4.558')] [2023-12-28 08:27:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001840512_471228416.pth... [2023-12-28 08:27:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001836520_470228992.pth... [2023-12-28 08:27:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001835336_469925888.pth [2023-12-28 08:27:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001839392_470941696.pth [2023-12-28 08:27:41,502][106225] Updated weights for policy 1, policy_version 1840519 (0.0008) [2023-12-28 08:27:41,563][106225] Updated weights for policy 1, policy_version 1840529 (0.0009) [2023-12-28 08:27:41,624][106225] Updated weights for policy 1, policy_version 1840539 (0.0009) [2023-12-28 08:27:41,831][106226] Updated weights for policy 0, policy_version 1836523 (0.0009) [2023-12-28 08:27:41,883][106226] Updated weights for policy 0, policy_version 1836533 (0.0008) [2023-12-28 08:27:41,935][106226] Updated weights for policy 0, policy_version 1836543 (0.0008) [2023-12-28 08:27:42,400][106225] Updated weights for policy 1, policy_version 1840549 (0.0009) [2023-12-28 08:27:42,458][106225] Updated weights for policy 1, policy_version 1840559 (0.0009) [2023-12-28 08:27:42,511][106225] Updated weights for policy 1, policy_version 1840569 (0.0006) [2023-12-28 08:27:42,697][106226] Updated weights for policy 0, policy_version 1836553 (0.0009) [2023-12-28 08:27:42,750][106226] Updated weights for policy 0, policy_version 1836563 (0.0010) [2023-12-28 08:27:42,806][106226] Updated weights for policy 0, policy_version 1836573 (0.0011) [2023-12-28 08:27:42,866][106226] Updated weights for policy 0, policy_version 1836583 (0.0010) [2023-12-28 08:27:43,158][106225] Updated weights for policy 1, policy_version 1840579 (0.0008) [2023-12-28 08:27:43,221][106225] Updated weights for policy 1, policy_version 1840589 (0.0005) [2023-12-28 08:27:43,270][106225] Updated weights for policy 1, policy_version 1840599 (0.0006) [2023-12-28 08:27:43,587][106226] Updated weights for policy 0, policy_version 1836593 (0.0006) [2023-12-28 08:27:43,651][106226] Updated weights for policy 0, policy_version 1836603 (0.0005) [2023-12-28 08:27:43,715][106226] Updated weights for policy 0, policy_version 1836613 (0.0009) [2023-12-28 08:27:43,912][106225] Updated weights for policy 1, policy_version 1840609 (0.0005) [2023-12-28 08:27:43,974][106225] Updated weights for policy 1, policy_version 1840619 (0.0007) [2023-12-28 08:27:44,032][106225] Updated weights for policy 1, policy_version 1840629 (0.0008) [2023-12-28 08:27:44,096][106225] Updated weights for policy 1, policy_version 1840639 (0.0008) [2023-12-28 08:27:44,390][106226] Updated weights for policy 0, policy_version 1836623 (0.0009) [2023-12-28 08:27:44,454][106226] Updated weights for policy 0, policy_version 1836633 (0.0009) [2023-12-28 08:27:44,519][106226] Updated weights for policy 0, policy_version 1836643 (0.0008) [2023-12-28 08:27:44,722][106225] Updated weights for policy 1, policy_version 1840649 (0.0007) [2023-12-28 08:27:44,792][106225] Updated weights for policy 1, policy_version 1840659 (0.0008) [2023-12-28 08:27:44,858][106225] Updated weights for policy 1, policy_version 1840669 (0.0008) [2023-12-28 08:27:45,193][106226] Updated weights for policy 0, policy_version 1836653 (0.0010) [2023-12-28 08:27:45,252][106226] Updated weights for policy 0, policy_version 1836663 (0.0008) [2023-12-28 08:27:45,307][106226] Updated weights for policy 0, policy_version 1836673 (0.0009) [2023-12-28 08:27:45,519][106225] Updated weights for policy 1, policy_version 1840679 (0.0009) [2023-12-28 08:27:45,572][106225] Updated weights for policy 1, policy_version 1840689 (0.0009) [2023-12-28 08:27:45,617][106225] Updated weights for policy 1, policy_version 1840699 (0.0008) [2023-12-28 08:27:45,951][106226] Updated weights for policy 0, policy_version 1836683 (0.0008) [2023-12-28 08:27:45,999][106226] Updated weights for policy 0, policy_version 1836693 (0.0008) [2023-12-28 08:27:46,053][106226] Updated weights for policy 0, policy_version 1836703 (0.0008) [2023-12-28 08:27:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19716.4). Total num frames: 941555712. Throughput: 0: 9971.6, 1: 9711.2. Samples: 941543288. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:46,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-4.550')] [2023-12-28 08:27:46,411][106225] Updated weights for policy 1, policy_version 1840709 (0.0008) [2023-12-28 08:27:46,473][106225] Updated weights for policy 1, policy_version 1840719 (0.0009) [2023-12-28 08:27:46,539][106225] Updated weights for policy 1, policy_version 1840729 (0.0008) [2023-12-28 08:27:46,678][106226] Updated weights for policy 0, policy_version 1836713 (0.0008) [2023-12-28 08:27:46,740][106226] Updated weights for policy 0, policy_version 1836723 (0.0008) [2023-12-28 08:27:46,799][106226] Updated weights for policy 0, policy_version 1836733 (0.0007) [2023-12-28 08:27:46,846][106226] Updated weights for policy 0, policy_version 1836743 (0.0005) [2023-12-28 08:27:47,311][106225] Updated weights for policy 1, policy_version 1840739 (0.0008) [2023-12-28 08:27:47,371][106225] Updated weights for policy 1, policy_version 1840749 (0.0008) [2023-12-28 08:27:47,431][106225] Updated weights for policy 1, policy_version 1840759 (0.0006) [2023-12-28 08:27:47,440][106226] Updated weights for policy 0, policy_version 1836753 (0.0009) [2023-12-28 08:27:47,495][106226] Updated weights for policy 0, policy_version 1836763 (0.0008) [2023-12-28 08:27:47,541][106226] Updated weights for policy 0, policy_version 1836773 (0.0008) [2023-12-28 08:27:48,166][106226] Updated weights for policy 0, policy_version 1836783 (0.0009) [2023-12-28 08:27:48,187][106225] Updated weights for policy 1, policy_version 1840769 (0.0005) [2023-12-28 08:27:48,224][106226] Updated weights for policy 0, policy_version 1836793 (0.0009) [2023-12-28 08:27:48,259][106225] Updated weights for policy 1, policy_version 1840779 (0.0006) [2023-12-28 08:27:48,277][106226] Updated weights for policy 0, policy_version 1836803 (0.0006) [2023-12-28 08:27:48,314][106225] Updated weights for policy 1, policy_version 1840789 (0.0007) [2023-12-28 08:27:48,374][106225] Updated weights for policy 1, policy_version 1840799 (0.0008) [2023-12-28 08:27:48,967][106226] Updated weights for policy 0, policy_version 1836813 (0.0008) [2023-12-28 08:27:49,022][106226] Updated weights for policy 0, policy_version 1836823 (0.0008) [2023-12-28 08:27:49,077][106226] Updated weights for policy 0, policy_version 1836833 (0.0007) [2023-12-28 08:27:49,110][106225] Updated weights for policy 1, policy_version 1840809 (0.0009) [2023-12-28 08:27:49,174][106225] Updated weights for policy 1, policy_version 1840819 (0.0009) [2023-12-28 08:27:49,242][106225] Updated weights for policy 1, policy_version 1840829 (0.0009) [2023-12-28 08:27:49,810][106226] Updated weights for policy 0, policy_version 1836843 (0.0006) [2023-12-28 08:27:49,877][106226] Updated weights for policy 0, policy_version 1836853 (0.0009) [2023-12-28 08:27:49,952][106226] Updated weights for policy 0, policy_version 1836863 (0.0008) [2023-12-28 08:27:49,998][106225] Updated weights for policy 1, policy_version 1840839 (0.0006) [2023-12-28 08:27:50,061][106225] Updated weights for policy 1, policy_version 1840849 (0.0009) [2023-12-28 08:27:50,121][106225] Updated weights for policy 1, policy_version 1840859 (0.0009) [2023-12-28 08:27:50,642][106226] Updated weights for policy 0, policy_version 1836873 (0.0006) [2023-12-28 08:27:50,698][106226] Updated weights for policy 0, policy_version 1836883 (0.0009) [2023-12-28 08:27:50,750][106226] Updated weights for policy 0, policy_version 1836893 (0.0008) [2023-12-28 08:27:50,818][106226] Updated weights for policy 0, policy_version 1836903 (0.0008) [2023-12-28 08:27:50,866][106225] Updated weights for policy 1, policy_version 1840869 (0.0008) [2023-12-28 08:27:50,932][106225] Updated weights for policy 1, policy_version 1840879 (0.0008) [2023-12-28 08:27:50,996][106225] Updated weights for policy 1, policy_version 1840889 (0.0009) [2023-12-28 08:27:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 941654016. Throughput: 0: 10074.5, 1: 9587.6. Samples: 941660584. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:51,175][105115] Avg episode reward: [(0, '-4.635'), (1, '-4.672')] [2023-12-28 08:27:51,628][106226] Updated weights for policy 0, policy_version 1836913 (0.0009) [2023-12-28 08:27:51,688][106226] Updated weights for policy 0, policy_version 1836923 (0.0009) [2023-12-28 08:27:51,758][106226] Updated weights for policy 0, policy_version 1836933 (0.0008) [2023-12-28 08:27:51,795][106225] Updated weights for policy 1, policy_version 1840899 (0.0008) [2023-12-28 08:27:51,862][106225] Updated weights for policy 1, policy_version 1840909 (0.0005) [2023-12-28 08:27:51,930][106225] Updated weights for policy 1, policy_version 1840919 (0.0005) [2023-12-28 08:27:52,513][106226] Updated weights for policy 0, policy_version 1836943 (0.0006) [2023-12-28 08:27:52,579][106226] Updated weights for policy 0, policy_version 1836953 (0.0006) [2023-12-28 08:27:52,608][106225] Updated weights for policy 1, policy_version 1840929 (0.0006) [2023-12-28 08:27:52,644][106226] Updated weights for policy 0, policy_version 1836963 (0.0007) [2023-12-28 08:27:52,676][106225] Updated weights for policy 1, policy_version 1840939 (0.0010) [2023-12-28 08:27:52,735][106225] Updated weights for policy 1, policy_version 1840949 (0.0008) [2023-12-28 08:27:52,791][106225] Updated weights for policy 1, policy_version 1840959 (0.0008) [2023-12-28 08:27:53,249][106226] Updated weights for policy 0, policy_version 1836973 (0.0008) [2023-12-28 08:27:53,310][106226] Updated weights for policy 0, policy_version 1836983 (0.0006) [2023-12-28 08:27:53,370][106226] Updated weights for policy 0, policy_version 1836993 (0.0006) [2023-12-28 08:27:53,530][106225] Updated weights for policy 1, policy_version 1840969 (0.0008) [2023-12-28 08:27:53,588][106225] Updated weights for policy 1, policy_version 1840979 (0.0008) [2023-12-28 08:27:53,637][106225] Updated weights for policy 1, policy_version 1840989 (0.0009) [2023-12-28 08:27:53,910][106226] Updated weights for policy 0, policy_version 1837003 (0.0010) [2023-12-28 08:27:53,976][106226] Updated weights for policy 0, policy_version 1837013 (0.0010) [2023-12-28 08:27:54,041][106226] Updated weights for policy 0, policy_version 1837023 (0.0011) [2023-12-28 08:27:54,352][106225] Updated weights for policy 1, policy_version 1840999 (0.0008) [2023-12-28 08:27:54,414][106225] Updated weights for policy 1, policy_version 1841009 (0.0008) [2023-12-28 08:27:54,475][106225] Updated weights for policy 1, policy_version 1841019 (0.0008) [2023-12-28 08:27:54,762][106226] Updated weights for policy 0, policy_version 1837033 (0.0011) [2023-12-28 08:27:54,811][106226] Updated weights for policy 0, policy_version 1837043 (0.0009) [2023-12-28 08:27:54,861][106226] Updated weights for policy 0, policy_version 1837054 (0.0009) [2023-12-28 08:27:54,917][106226] Updated weights for policy 0, policy_version 1837064 (0.0008) [2023-12-28 08:27:55,119][106225] Updated weights for policy 1, policy_version 1841029 (0.0005) [2023-12-28 08:27:55,174][106225] Updated weights for policy 1, policy_version 1841039 (0.0005) [2023-12-28 08:27:55,229][106225] Updated weights for policy 1, policy_version 1841049 (0.0006) [2023-12-28 08:27:55,687][106226] Updated weights for policy 0, policy_version 1837074 (0.0009) [2023-12-28 08:27:55,737][106226] Updated weights for policy 0, policy_version 1837084 (0.0008) [2023-12-28 08:27:55,789][106226] Updated weights for policy 0, policy_version 1837094 (0.0009) [2023-12-28 08:27:55,843][106225] Updated weights for policy 1, policy_version 1841059 (0.0007) [2023-12-28 08:27:55,895][106225] Updated weights for policy 1, policy_version 1841069 (0.0009) [2023-12-28 08:27:55,939][106225] Updated weights for policy 1, policy_version 1841079 (0.0008) [2023-12-28 08:27:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 941752320. Throughput: 0: 10071.7, 1: 9565.0. Samples: 941719304. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:27:56,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.966')] [2023-12-28 08:27:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001841088_471375872.pth... [2023-12-28 08:27:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001837096_470376448.pth... [2023-12-28 08:27:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001839936_471080960.pth [2023-12-28 08:27:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001835944_470081536.pth [2023-12-28 08:27:56,481][106226] Updated weights for policy 0, policy_version 1837104 (0.0008) [2023-12-28 08:27:56,548][106226] Updated weights for policy 0, policy_version 1837114 (0.0006) [2023-12-28 08:27:56,584][106225] Updated weights for policy 1, policy_version 1841089 (0.0007) [2023-12-28 08:27:56,615][106226] Updated weights for policy 0, policy_version 1837124 (0.0005) [2023-12-28 08:27:56,637][106225] Updated weights for policy 1, policy_version 1841099 (0.0006) [2023-12-28 08:27:56,692][106225] Updated weights for policy 1, policy_version 1841109 (0.0005) [2023-12-28 08:27:56,748][106225] Updated weights for policy 1, policy_version 1841119 (0.0005) [2023-12-28 08:27:57,147][106226] Updated weights for policy 0, policy_version 1837134 (0.0008) [2023-12-28 08:27:57,205][106226] Updated weights for policy 0, policy_version 1837144 (0.0008) [2023-12-28 08:27:57,264][106226] Updated weights for policy 0, policy_version 1837154 (0.0007) [2023-12-28 08:27:57,336][106225] Updated weights for policy 1, policy_version 1841129 (0.0005) [2023-12-28 08:27:57,392][106225] Updated weights for policy 1, policy_version 1841139 (0.0005) [2023-12-28 08:27:57,442][106225] Updated weights for policy 1, policy_version 1841149 (0.0005) [2023-12-28 08:27:57,962][106225] Updated weights for policy 1, policy_version 1841159 (0.0007) [2023-12-28 08:27:57,977][106226] Updated weights for policy 0, policy_version 1837164 (0.0008) [2023-12-28 08:27:58,015][106225] Updated weights for policy 1, policy_version 1841169 (0.0006) [2023-12-28 08:27:58,042][106226] Updated weights for policy 0, policy_version 1837174 (0.0007) [2023-12-28 08:27:58,059][106225] Updated weights for policy 1, policy_version 1841179 (0.0008) [2023-12-28 08:27:58,101][106226] Updated weights for policy 0, policy_version 1837184 (0.0007) [2023-12-28 08:27:58,868][106226] Updated weights for policy 0, policy_version 1837194 (0.0008) [2023-12-28 08:27:58,871][106225] Updated weights for policy 1, policy_version 1841189 (0.0007) [2023-12-28 08:27:58,947][106226] Updated weights for policy 0, policy_version 1837204 (0.0009) [2023-12-28 08:27:58,948][106225] Updated weights for policy 1, policy_version 1841199 (0.0007) [2023-12-28 08:27:59,009][106225] Updated weights for policy 1, policy_version 1841209 (0.0009) [2023-12-28 08:27:59,009][106226] Updated weights for policy 0, policy_version 1837214 (0.0009) [2023-12-28 08:27:59,071][106226] Updated weights for policy 0, policy_version 1837224 (0.0009) [2023-12-28 08:27:59,790][106225] Updated weights for policy 1, policy_version 1841219 (0.0009) [2023-12-28 08:27:59,847][106225] Updated weights for policy 1, policy_version 1841229 (0.0007) [2023-12-28 08:27:59,867][106226] Updated weights for policy 0, policy_version 1837234 (0.0007) [2023-12-28 08:27:59,903][106225] Updated weights for policy 1, policy_version 1841239 (0.0008) [2023-12-28 08:27:59,917][106226] Updated weights for policy 0, policy_version 1837244 (0.0008) [2023-12-28 08:27:59,978][106226] Updated weights for policy 0, policy_version 1837254 (0.0007) [2023-12-28 08:28:00,610][106225] Updated weights for policy 1, policy_version 1841249 (0.0007) [2023-12-28 08:28:00,686][106225] Updated weights for policy 1, policy_version 1841259 (0.0007) [2023-12-28 08:28:00,696][106226] Updated weights for policy 0, policy_version 1837264 (0.0007) [2023-12-28 08:28:00,744][106225] Updated weights for policy 1, policy_version 1841269 (0.0006) [2023-12-28 08:28:00,755][106226] Updated weights for policy 0, policy_version 1837274 (0.0008) [2023-12-28 08:28:00,797][106225] Updated weights for policy 1, policy_version 1841279 (0.0006) [2023-12-28 08:28:00,803][106226] Updated weights for policy 0, policy_version 1837284 (0.0008) [2023-12-28 08:28:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 941850624. Throughput: 0: 10025.0, 1: 9666.9. Samples: 941839700. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:01,175][105115] Avg episode reward: [(0, '-4.507'), (1, '-4.653')] [2023-12-28 08:28:01,459][106225] Updated weights for policy 1, policy_version 1841289 (0.0008) [2023-12-28 08:28:01,514][106225] Updated weights for policy 1, policy_version 1841299 (0.0008) [2023-12-28 08:28:01,528][106226] Updated weights for policy 0, policy_version 1837294 (0.0007) [2023-12-28 08:28:01,562][106225] Updated weights for policy 1, policy_version 1841309 (0.0008) [2023-12-28 08:28:01,586][106226] Updated weights for policy 0, policy_version 1837304 (0.0007) [2023-12-28 08:28:01,649][106226] Updated weights for policy 0, policy_version 1837314 (0.0008) [2023-12-28 08:28:02,303][106226] Updated weights for policy 0, policy_version 1837324 (0.0006) [2023-12-28 08:28:02,367][106226] Updated weights for policy 0, policy_version 1837334 (0.0008) [2023-12-28 08:28:02,413][106225] Updated weights for policy 1, policy_version 1841319 (0.0006) [2023-12-28 08:28:02,426][106226] Updated weights for policy 0, policy_version 1837344 (0.0008) [2023-12-28 08:28:02,470][106225] Updated weights for policy 1, policy_version 1841329 (0.0007) [2023-12-28 08:28:02,520][106225] Updated weights for policy 1, policy_version 1841339 (0.0008) [2023-12-28 08:28:02,994][106226] Updated weights for policy 0, policy_version 1837354 (0.0005) [2023-12-28 08:28:03,057][106226] Updated weights for policy 0, policy_version 1837364 (0.0005) [2023-12-28 08:28:03,111][106226] Updated weights for policy 0, policy_version 1837374 (0.0005) [2023-12-28 08:28:03,173][106226] Updated weights for policy 0, policy_version 1837384 (0.0007) [2023-12-28 08:28:03,343][106225] Updated weights for policy 1, policy_version 1841349 (0.0010) [2023-12-28 08:28:03,397][106225] Updated weights for policy 1, policy_version 1841359 (0.0008) [2023-12-28 08:28:03,458][106225] Updated weights for policy 1, policy_version 1841369 (0.0008) [2023-12-28 08:28:03,756][106226] Updated weights for policy 0, policy_version 1837394 (0.0005) [2023-12-28 08:28:03,809][106226] Updated weights for policy 0, policy_version 1837404 (0.0005) [2023-12-28 08:28:03,889][106226] Updated weights for policy 0, policy_version 1837414 (0.0007) [2023-12-28 08:28:04,156][106225] Updated weights for policy 1, policy_version 1841379 (0.0009) [2023-12-28 08:28:04,217][106225] Updated weights for policy 1, policy_version 1841389 (0.0011) [2023-12-28 08:28:04,283][106225] Updated weights for policy 1, policy_version 1841399 (0.0006) [2023-12-28 08:28:04,553][106226] Updated weights for policy 0, policy_version 1837424 (0.0008) [2023-12-28 08:28:04,605][106226] Updated weights for policy 0, policy_version 1837434 (0.0009) [2023-12-28 08:28:04,663][106226] Updated weights for policy 0, policy_version 1837444 (0.0008) [2023-12-28 08:28:04,880][106225] Updated weights for policy 1, policy_version 1841409 (0.0008) [2023-12-28 08:28:04,940][106225] Updated weights for policy 1, policy_version 1841419 (0.0005) [2023-12-28 08:28:05,002][106225] Updated weights for policy 1, policy_version 1841429 (0.0008) [2023-12-28 08:28:05,051][106225] Updated weights for policy 1, policy_version 1841439 (0.0006) [2023-12-28 08:28:05,309][106226] Updated weights for policy 0, policy_version 1837454 (0.0007) [2023-12-28 08:28:05,358][106226] Updated weights for policy 0, policy_version 1837464 (0.0005) [2023-12-28 08:28:05,427][106226] Updated weights for policy 0, policy_version 1837474 (0.0008) [2023-12-28 08:28:05,703][106225] Updated weights for policy 1, policy_version 1841449 (0.0007) [2023-12-28 08:28:05,756][106225] Updated weights for policy 1, policy_version 1841459 (0.0008) [2023-12-28 08:28:05,812][106225] Updated weights for policy 1, policy_version 1841469 (0.0008) [2023-12-28 08:28:06,075][106226] Updated weights for policy 0, policy_version 1837484 (0.0008) [2023-12-28 08:28:06,150][106226] Updated weights for policy 0, policy_version 1837494 (0.0008) [2023-12-28 08:28:06,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19716.4). Total num frames: 941948928. Throughput: 0: 10069.7, 1: 9752.7. Samples: 941961708. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:06,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.681')] [2023-12-28 08:28:06,207][106226] Updated weights for policy 0, policy_version 1837504 (0.0006) [2023-12-28 08:28:06,569][106225] Updated weights for policy 1, policy_version 1841479 (0.0009) [2023-12-28 08:28:06,627][106225] Updated weights for policy 1, policy_version 1841489 (0.0009) [2023-12-28 08:28:06,692][106225] Updated weights for policy 1, policy_version 1841499 (0.0009) [2023-12-28 08:28:06,803][106226] Updated weights for policy 0, policy_version 1837514 (0.0007) [2023-12-28 08:28:06,857][106226] Updated weights for policy 0, policy_version 1837524 (0.0011) [2023-12-28 08:28:06,915][106226] Updated weights for policy 0, policy_version 1837534 (0.0008) [2023-12-28 08:28:06,974][106226] Updated weights for policy 0, policy_version 1837544 (0.0009) [2023-12-28 08:28:07,478][106225] Updated weights for policy 1, policy_version 1841509 (0.0008) [2023-12-28 08:28:07,534][106225] Updated weights for policy 1, policy_version 1841519 (0.0008) [2023-12-28 08:28:07,587][106225] Updated weights for policy 1, policy_version 1841529 (0.0006) [2023-12-28 08:28:07,605][106226] Updated weights for policy 0, policy_version 1837554 (0.0010) [2023-12-28 08:28:07,665][106226] Updated weights for policy 0, policy_version 1837564 (0.0010) [2023-12-28 08:28:07,724][106226] Updated weights for policy 0, policy_version 1837574 (0.0010) [2023-12-28 08:28:08,240][106225] Updated weights for policy 1, policy_version 1841539 (0.0007) [2023-12-28 08:28:08,293][106225] Updated weights for policy 1, policy_version 1841549 (0.0009) [2023-12-28 08:28:08,371][106225] Updated weights for policy 1, policy_version 1841559 (0.0009) [2023-12-28 08:28:08,417][106226] Updated weights for policy 0, policy_version 1837584 (0.0008) [2023-12-28 08:28:08,482][106226] Updated weights for policy 0, policy_version 1837594 (0.0011) [2023-12-28 08:28:08,545][106226] Updated weights for policy 0, policy_version 1837604 (0.0009) [2023-12-28 08:28:09,088][106225] Updated weights for policy 1, policy_version 1841569 (0.0009) [2023-12-28 08:28:09,148][106225] Updated weights for policy 1, policy_version 1841579 (0.0008) [2023-12-28 08:28:09,211][106225] Updated weights for policy 1, policy_version 1841589 (0.0008) [2023-12-28 08:28:09,275][106225] Updated weights for policy 1, policy_version 1841599 (0.0007) [2023-12-28 08:28:09,289][106226] Updated weights for policy 0, policy_version 1837614 (0.0010) [2023-12-28 08:28:09,356][106226] Updated weights for policy 0, policy_version 1837624 (0.0011) [2023-12-28 08:28:09,429][106226] Updated weights for policy 0, policy_version 1837634 (0.0008) [2023-12-28 08:28:10,042][106225] Updated weights for policy 1, policy_version 1841609 (0.0008) [2023-12-28 08:28:10,095][106225] Updated weights for policy 1, policy_version 1841619 (0.0008) [2023-12-28 08:28:10,152][106225] Updated weights for policy 1, policy_version 1841629 (0.0009) [2023-12-28 08:28:10,174][106226] Updated weights for policy 0, policy_version 1837644 (0.0008) [2023-12-28 08:28:10,223][106226] Updated weights for policy 0, policy_version 1837654 (0.0009) [2023-12-28 08:28:10,275][106226] Updated weights for policy 0, policy_version 1837664 (0.0008) [2023-12-28 08:28:10,896][106225] Updated weights for policy 1, policy_version 1841639 (0.0008) [2023-12-28 08:28:10,950][106225] Updated weights for policy 1, policy_version 1841649 (0.0007) [2023-12-28 08:28:11,007][106225] Updated weights for policy 1, policy_version 1841659 (0.0009) [2023-12-28 08:28:11,029][106226] Updated weights for policy 0, policy_version 1837674 (0.0008) [2023-12-28 08:28:11,091][106226] Updated weights for policy 0, policy_version 1837684 (0.0008) [2023-12-28 08:28:11,155][106226] Updated weights for policy 0, policy_version 1837694 (0.0009) [2023-12-28 08:28:11,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 942047232. Throughput: 0: 10135.2, 1: 9732.0. Samples: 942020712. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:11,175][105115] Avg episode reward: [(0, '-4.521'), (1, '-4.685')] [2023-12-28 08:28:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001841664_471523328.pth... [2023-12-28 08:28:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001840512_471228416.pth [2023-12-28 08:28:11,213][106226] Updated weights for policy 0, policy_version 1837704 (0.0008) [2023-12-28 08:28:11,213][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001837704_470532096.pth... [2023-12-28 08:28:11,216][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001836520_470228992.pth [2023-12-28 08:28:11,788][106225] Updated weights for policy 1, policy_version 1841669 (0.0009) [2023-12-28 08:28:11,853][106225] Updated weights for policy 1, policy_version 1841679 (0.0008) [2023-12-28 08:28:11,915][106225] Updated weights for policy 1, policy_version 1841689 (0.0008) [2023-12-28 08:28:12,047][106226] Updated weights for policy 0, policy_version 1837714 (0.0009) [2023-12-28 08:28:12,107][106226] Updated weights for policy 0, policy_version 1837724 (0.0009) [2023-12-28 08:28:12,164][106226] Updated weights for policy 0, policy_version 1837734 (0.0009) [2023-12-28 08:28:12,620][106225] Updated weights for policy 1, policy_version 1841699 (0.0007) [2023-12-28 08:28:12,675][106225] Updated weights for policy 1, policy_version 1841709 (0.0008) [2023-12-28 08:28:12,734][106225] Updated weights for policy 1, policy_version 1841719 (0.0008) [2023-12-28 08:28:12,892][106226] Updated weights for policy 0, policy_version 1837744 (0.0008) [2023-12-28 08:28:12,958][106226] Updated weights for policy 0, policy_version 1837754 (0.0008) [2023-12-28 08:28:13,015][106226] Updated weights for policy 0, policy_version 1837764 (0.0006) [2023-12-28 08:28:13,479][106225] Updated weights for policy 1, policy_version 1841729 (0.0009) [2023-12-28 08:28:13,537][106225] Updated weights for policy 1, policy_version 1841739 (0.0008) [2023-12-28 08:28:13,600][106225] Updated weights for policy 1, policy_version 1841749 (0.0008) [2023-12-28 08:28:13,659][106225] Updated weights for policy 1, policy_version 1841759 (0.0008) [2023-12-28 08:28:13,741][106226] Updated weights for policy 0, policy_version 1837774 (0.0008) [2023-12-28 08:28:13,797][106226] Updated weights for policy 0, policy_version 1837784 (0.0009) [2023-12-28 08:28:13,845][106226] Updated weights for policy 0, policy_version 1837794 (0.0008) [2023-12-28 08:28:14,389][106225] Updated weights for policy 1, policy_version 1841769 (0.0008) [2023-12-28 08:28:14,441][106225] Updated weights for policy 1, policy_version 1841779 (0.0008) [2023-12-28 08:28:14,486][106225] Updated weights for policy 1, policy_version 1841789 (0.0008) [2023-12-28 08:28:14,522][106226] Updated weights for policy 0, policy_version 1837804 (0.0008) [2023-12-28 08:28:14,566][106226] Updated weights for policy 0, policy_version 1837814 (0.0008) [2023-12-28 08:28:14,614][106226] Updated weights for policy 0, policy_version 1837824 (0.0008) [2023-12-28 08:28:15,237][106225] Updated weights for policy 1, policy_version 1841799 (0.0008) [2023-12-28 08:28:15,305][106225] Updated weights for policy 1, policy_version 1841809 (0.0008) [2023-12-28 08:28:15,368][106225] Updated weights for policy 1, policy_version 1841819 (0.0009) [2023-12-28 08:28:15,398][106226] Updated weights for policy 0, policy_version 1837834 (0.0009) [2023-12-28 08:28:15,460][106226] Updated weights for policy 0, policy_version 1837844 (0.0008) [2023-12-28 08:28:15,519][106226] Updated weights for policy 0, policy_version 1837854 (0.0008) [2023-12-28 08:28:15,582][106226] Updated weights for policy 0, policy_version 1837864 (0.0009) [2023-12-28 08:28:16,081][106225] Updated weights for policy 1, policy_version 1841829 (0.0008) [2023-12-28 08:28:16,146][106225] Updated weights for policy 1, policy_version 1841839 (0.0008) [2023-12-28 08:28:16,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 942137344. Throughput: 0: 9983.8, 1: 9668.3. Samples: 942133120. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:16,176][105115] Avg episode reward: [(0, '-4.640'), (1, '-4.571')] [2023-12-28 08:28:16,205][106225] Updated weights for policy 1, policy_version 1841849 (0.0008) [2023-12-28 08:28:16,319][106226] Updated weights for policy 0, policy_version 1837874 (0.0009) [2023-12-28 08:28:16,376][106226] Updated weights for policy 0, policy_version 1837884 (0.0009) [2023-12-28 08:28:16,439][106226] Updated weights for policy 0, policy_version 1837894 (0.0009) [2023-12-28 08:28:16,897][106225] Updated weights for policy 1, policy_version 1841859 (0.0009) [2023-12-28 08:28:16,960][106225] Updated weights for policy 1, policy_version 1841869 (0.0009) [2023-12-28 08:28:17,018][106225] Updated weights for policy 1, policy_version 1841879 (0.0008) [2023-12-28 08:28:17,180][106226] Updated weights for policy 0, policy_version 1837904 (0.0009) [2023-12-28 08:28:17,239][106226] Updated weights for policy 0, policy_version 1837914 (0.0006) [2023-12-28 08:28:17,290][106226] Updated weights for policy 0, policy_version 1837924 (0.0005) [2023-12-28 08:28:17,676][106225] Updated weights for policy 1, policy_version 1841889 (0.0008) [2023-12-28 08:28:17,737][106225] Updated weights for policy 1, policy_version 1841899 (0.0008) [2023-12-28 08:28:17,802][106225] Updated weights for policy 1, policy_version 1841909 (0.0008) [2023-12-28 08:28:17,865][106225] Updated weights for policy 1, policy_version 1841919 (0.0008) [2023-12-28 08:28:17,936][106226] Updated weights for policy 0, policy_version 1837934 (0.0009) [2023-12-28 08:28:17,995][106226] Updated weights for policy 0, policy_version 1837944 (0.0010) [2023-12-28 08:28:18,057][106226] Updated weights for policy 0, policy_version 1837954 (0.0010) [2023-12-28 08:28:18,568][106225] Updated weights for policy 1, policy_version 1841929 (0.0007) [2023-12-28 08:28:18,633][106225] Updated weights for policy 1, policy_version 1841939 (0.0008) [2023-12-28 08:28:18,687][106225] Updated weights for policy 1, policy_version 1841949 (0.0008) [2023-12-28 08:28:18,802][106226] Updated weights for policy 0, policy_version 1837964 (0.0011) [2023-12-28 08:28:18,859][106226] Updated weights for policy 0, policy_version 1837974 (0.0010) [2023-12-28 08:28:18,923][106226] Updated weights for policy 0, policy_version 1837984 (0.0011) [2023-12-28 08:28:19,451][106225] Updated weights for policy 1, policy_version 1841959 (0.0008) [2023-12-28 08:28:19,509][106225] Updated weights for policy 1, policy_version 1841969 (0.0008) [2023-12-28 08:28:19,574][106225] Updated weights for policy 1, policy_version 1841979 (0.0008) [2023-12-28 08:28:19,576][106226] Updated weights for policy 0, policy_version 1837994 (0.0008) [2023-12-28 08:28:19,630][106226] Updated weights for policy 0, policy_version 1838004 (0.0007) [2023-12-28 08:28:19,690][106226] Updated weights for policy 0, policy_version 1838014 (0.0008) [2023-12-28 08:28:19,758][106226] Updated weights for policy 0, policy_version 1838024 (0.0009) [2023-12-28 08:28:20,313][106225] Updated weights for policy 1, policy_version 1841989 (0.0007) [2023-12-28 08:28:20,376][106225] Updated weights for policy 1, policy_version 1841999 (0.0008) [2023-12-28 08:28:20,437][106225] Updated weights for policy 1, policy_version 1842009 (0.0008) [2023-12-28 08:28:20,535][106226] Updated weights for policy 0, policy_version 1838034 (0.0005) [2023-12-28 08:28:20,600][106226] Updated weights for policy 0, policy_version 1838044 (0.0006) [2023-12-28 08:28:20,660][106226] Updated weights for policy 0, policy_version 1838054 (0.0007) [2023-12-28 08:28:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 942235648. Throughput: 0: 9947.6, 1: 9636.4. Samples: 942250456. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:21,175][105115] Avg episode reward: [(0, '-4.180'), (1, '-4.463')] [2023-12-28 08:28:21,255][106225] Updated weights for policy 1, policy_version 1842019 (0.0010) [2023-12-28 08:28:21,276][106226] Updated weights for policy 0, policy_version 1838064 (0.0008) [2023-12-28 08:28:21,319][106225] Updated weights for policy 1, policy_version 1842029 (0.0008) [2023-12-28 08:28:21,343][106226] Updated weights for policy 0, policy_version 1838074 (0.0006) [2023-12-28 08:28:21,389][106225] Updated weights for policy 1, policy_version 1842039 (0.0008) [2023-12-28 08:28:21,414][106226] Updated weights for policy 0, policy_version 1838084 (0.0008) [2023-12-28 08:28:22,118][106225] Updated weights for policy 1, policy_version 1842049 (0.0007) [2023-12-28 08:28:22,158][106226] Updated weights for policy 0, policy_version 1838094 (0.0010) [2023-12-28 08:28:22,182][106225] Updated weights for policy 1, policy_version 1842059 (0.0010) [2023-12-28 08:28:22,211][106226] Updated weights for policy 0, policy_version 1838104 (0.0008) [2023-12-28 08:28:22,230][106225] Updated weights for policy 1, policy_version 1842069 (0.0007) [2023-12-28 08:28:22,269][106226] Updated weights for policy 0, policy_version 1838114 (0.0009) [2023-12-28 08:28:22,289][106225] Updated weights for policy 1, policy_version 1842079 (0.0007) [2023-12-28 08:28:23,026][106225] Updated weights for policy 1, policy_version 1842089 (0.0010) [2023-12-28 08:28:23,044][106226] Updated weights for policy 0, policy_version 1838124 (0.0007) [2023-12-28 08:28:23,080][106225] Updated weights for policy 1, policy_version 1842099 (0.0010) [2023-12-28 08:28:23,095][106226] Updated weights for policy 0, policy_version 1838134 (0.0005) [2023-12-28 08:28:23,134][106225] Updated weights for policy 1, policy_version 1842109 (0.0010) [2023-12-28 08:28:23,144][106226] Updated weights for policy 0, policy_version 1838144 (0.0007) [2023-12-28 08:28:23,786][106226] Updated weights for policy 0, policy_version 1838154 (0.0008) [2023-12-28 08:28:23,790][106225] Updated weights for policy 1, policy_version 1842119 (0.0010) [2023-12-28 08:28:23,841][106225] Updated weights for policy 1, policy_version 1842129 (0.0010) [2023-12-28 08:28:23,843][106226] Updated weights for policy 0, policy_version 1838164 (0.0010) [2023-12-28 08:28:23,894][106225] Updated weights for policy 1, policy_version 1842139 (0.0010) [2023-12-28 08:28:23,903][106226] Updated weights for policy 0, policy_version 1838174 (0.0011) [2023-12-28 08:28:23,967][106226] Updated weights for policy 0, policy_version 1838184 (0.0011) [2023-12-28 08:28:24,629][106225] Updated weights for policy 1, policy_version 1842149 (0.0010) [2023-12-28 08:28:24,686][106225] Updated weights for policy 1, policy_version 1842159 (0.0010) [2023-12-28 08:28:24,745][106225] Updated weights for policy 1, policy_version 1842169 (0.0010) [2023-12-28 08:28:24,762][106226] Updated weights for policy 0, policy_version 1838194 (0.0008) [2023-12-28 08:28:24,819][106226] Updated weights for policy 0, policy_version 1838204 (0.0008) [2023-12-28 08:28:24,869][106226] Updated weights for policy 0, policy_version 1838214 (0.0007) [2023-12-28 08:28:25,422][106225] Updated weights for policy 1, policy_version 1842179 (0.0009) [2023-12-28 08:28:25,479][106225] Updated weights for policy 1, policy_version 1842189 (0.0005) [2023-12-28 08:28:25,492][106226] Updated weights for policy 0, policy_version 1838224 (0.0006) [2023-12-28 08:28:25,536][106225] Updated weights for policy 1, policy_version 1842199 (0.0006) [2023-12-28 08:28:25,547][106226] Updated weights for policy 0, policy_version 1838234 (0.0005) [2023-12-28 08:28:25,606][106226] Updated weights for policy 0, policy_version 1838244 (0.0005) [2023-12-28 08:28:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 942333952. Throughput: 0: 9937.4, 1: 9622.6. Samples: 942307600. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:26,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-4.573')] [2023-12-28 08:28:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001842208_471662592.pth... [2023-12-28 08:28:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001841088_471375872.pth [2023-12-28 08:28:26,194][106226] Updated weights for policy 0, policy_version 1838254 (0.0006) [2023-12-28 08:28:26,242][106225] Updated weights for policy 1, policy_version 1842209 (0.0008) [2023-12-28 08:28:26,245][106226] Updated weights for policy 0, policy_version 1838264 (0.0008) [2023-12-28 08:28:26,299][106226] Updated weights for policy 0, policy_version 1838274 (0.0007) [2023-12-28 08:28:26,305][106225] Updated weights for policy 1, policy_version 1842219 (0.0011) [2023-12-28 08:28:26,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001838280_470679552.pth... [2023-12-28 08:28:26,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001837096_470376448.pth [2023-12-28 08:28:26,356][106225] Updated weights for policy 1, policy_version 1842229 (0.0010) [2023-12-28 08:28:26,409][106225] Updated weights for policy 1, policy_version 1842239 (0.0010) [2023-12-28 08:28:26,924][106226] Updated weights for policy 0, policy_version 1838284 (0.0005) [2023-12-28 08:28:26,987][106226] Updated weights for policy 0, policy_version 1838294 (0.0005) [2023-12-28 08:28:27,050][106226] Updated weights for policy 0, policy_version 1838304 (0.0006) [2023-12-28 08:28:27,105][106225] Updated weights for policy 1, policy_version 1842249 (0.0008) [2023-12-28 08:28:27,166][106225] Updated weights for policy 1, policy_version 1842259 (0.0007) [2023-12-28 08:28:27,214][106225] Updated weights for policy 1, policy_version 1842269 (0.0005) [2023-12-28 08:28:27,602][106226] Updated weights for policy 0, policy_version 1838314 (0.0007) [2023-12-28 08:28:27,655][106226] Updated weights for policy 0, policy_version 1838324 (0.0005) [2023-12-28 08:28:27,707][106226] Updated weights for policy 0, policy_version 1838334 (0.0008) [2023-12-28 08:28:27,756][106226] Updated weights for policy 0, policy_version 1838344 (0.0010) [2023-12-28 08:28:27,855][106225] Updated weights for policy 1, policy_version 1842279 (0.0007) [2023-12-28 08:28:27,898][106225] Updated weights for policy 1, policy_version 1842289 (0.0008) [2023-12-28 08:28:27,941][106225] Updated weights for policy 1, policy_version 1842299 (0.0008) [2023-12-28 08:28:28,437][106226] Updated weights for policy 0, policy_version 1838354 (0.0011) [2023-12-28 08:28:28,500][106226] Updated weights for policy 0, policy_version 1838364 (0.0011) [2023-12-28 08:28:28,560][106226] Updated weights for policy 0, policy_version 1838374 (0.0010) [2023-12-28 08:28:28,598][106225] Updated weights for policy 1, policy_version 1842309 (0.0007) [2023-12-28 08:28:28,652][106225] Updated weights for policy 1, policy_version 1842319 (0.0008) [2023-12-28 08:28:28,718][106225] Updated weights for policy 1, policy_version 1842329 (0.0006) [2023-12-28 08:28:29,202][106226] Updated weights for policy 0, policy_version 1838384 (0.0009) [2023-12-28 08:28:29,276][106226] Updated weights for policy 0, policy_version 1838394 (0.0008) [2023-12-28 08:28:29,338][106226] Updated weights for policy 0, policy_version 1838404 (0.0009) [2023-12-28 08:28:29,425][106225] Updated weights for policy 1, policy_version 1842339 (0.0007) [2023-12-28 08:28:29,472][106225] Updated weights for policy 1, policy_version 1842349 (0.0009) [2023-12-28 08:28:29,517][106225] Updated weights for policy 1, policy_version 1842359 (0.0008) [2023-12-28 08:28:30,068][106226] Updated weights for policy 0, policy_version 1838414 (0.0009) [2023-12-28 08:28:30,127][106226] Updated weights for policy 0, policy_version 1838424 (0.0009) [2023-12-28 08:28:30,188][106226] Updated weights for policy 0, policy_version 1838434 (0.0009) [2023-12-28 08:28:30,247][106225] Updated weights for policy 1, policy_version 1842369 (0.0007) [2023-12-28 08:28:30,311][106225] Updated weights for policy 1, policy_version 1842379 (0.0008) [2023-12-28 08:28:30,374][106225] Updated weights for policy 1, policy_version 1842389 (0.0009) [2023-12-28 08:28:30,437][106225] Updated weights for policy 1, policy_version 1842399 (0.0009) [2023-12-28 08:28:30,898][106226] Updated weights for policy 0, policy_version 1838444 (0.0009) [2023-12-28 08:28:30,944][106226] Updated weights for policy 0, policy_version 1838454 (0.0007) [2023-12-28 08:28:30,995][106226] Updated weights for policy 0, policy_version 1838464 (0.0008) [2023-12-28 08:28:31,174][106225] Updated weights for policy 1, policy_version 1842409 (0.0007) [2023-12-28 08:28:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 942440448. Throughput: 0: 10044.7, 1: 9687.6. Samples: 942431244. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-28 08:28:31,175][105115] Avg episode reward: [(0, '-4.540'), (1, '-4.715')] [2023-12-28 08:28:31,236][106225] Updated weights for policy 1, policy_version 1842419 (0.0008) [2023-12-28 08:28:31,298][106225] Updated weights for policy 1, policy_version 1842429 (0.0009) [2023-12-28 08:28:31,750][106226] Updated weights for policy 0, policy_version 1838474 (0.0008) [2023-12-28 08:28:31,823][106226] Updated weights for policy 0, policy_version 1838484 (0.0008) [2023-12-28 08:28:31,883][106226] Updated weights for policy 0, policy_version 1838494 (0.0006) [2023-12-28 08:28:31,941][106226] Updated weights for policy 0, policy_version 1838504 (0.0005) [2023-12-28 08:28:32,025][106225] Updated weights for policy 1, policy_version 1842439 (0.0009) [2023-12-28 08:28:32,082][106225] Updated weights for policy 1, policy_version 1842449 (0.0010) [2023-12-28 08:28:32,140][106225] Updated weights for policy 1, policy_version 1842459 (0.0010) [2023-12-28 08:28:32,661][106226] Updated weights for policy 0, policy_version 1838514 (0.0008) [2023-12-28 08:28:32,730][106226] Updated weights for policy 0, policy_version 1838524 (0.0008) [2023-12-28 08:28:32,795][106226] Updated weights for policy 0, policy_version 1838534 (0.0007) [2023-12-28 08:28:32,853][106225] Updated weights for policy 1, policy_version 1842469 (0.0008) [2023-12-28 08:28:32,916][106225] Updated weights for policy 1, policy_version 1842479 (0.0006) [2023-12-28 08:28:32,971][106225] Updated weights for policy 1, policy_version 1842489 (0.0009) [2023-12-28 08:28:33,398][106226] Updated weights for policy 0, policy_version 1838544 (0.0006) [2023-12-28 08:28:33,444][106226] Updated weights for policy 0, policy_version 1838554 (0.0005) [2023-12-28 08:28:33,493][106226] Updated weights for policy 0, policy_version 1838564 (0.0005) [2023-12-28 08:28:33,616][106225] Updated weights for policy 1, policy_version 1842499 (0.0010) [2023-12-28 08:28:33,671][106225] Updated weights for policy 1, policy_version 1842509 (0.0010) [2023-12-28 08:28:33,714][106225] Updated weights for policy 1, policy_version 1842519 (0.0009) [2023-12-28 08:28:34,036][106226] Updated weights for policy 0, policy_version 1838574 (0.0007) [2023-12-28 08:28:34,089][106226] Updated weights for policy 0, policy_version 1838584 (0.0009) [2023-12-28 08:28:34,142][106226] Updated weights for policy 0, policy_version 1838594 (0.0009) [2023-12-28 08:28:34,365][106225] Updated weights for policy 1, policy_version 1842529 (0.0006) [2023-12-28 08:28:34,428][106225] Updated weights for policy 1, policy_version 1842539 (0.0008) [2023-12-28 08:28:34,484][106225] Updated weights for policy 1, policy_version 1842549 (0.0010) [2023-12-28 08:28:34,535][106225] Updated weights for policy 1, policy_version 1842559 (0.0010) [2023-12-28 08:28:34,931][106226] Updated weights for policy 0, policy_version 1838604 (0.0007) [2023-12-28 08:28:34,984][106226] Updated weights for policy 0, policy_version 1838614 (0.0008) [2023-12-28 08:28:35,039][106226] Updated weights for policy 0, policy_version 1838624 (0.0008) [2023-12-28 08:28:35,219][106225] Updated weights for policy 1, policy_version 1842569 (0.0006) [2023-12-28 08:28:35,267][106225] Updated weights for policy 1, policy_version 1842579 (0.0008) [2023-12-28 08:28:35,322][106225] Updated weights for policy 1, policy_version 1842589 (0.0009) [2023-12-28 08:28:35,766][106226] Updated weights for policy 0, policy_version 1838634 (0.0009) [2023-12-28 08:28:35,825][106226] Updated weights for policy 0, policy_version 1838644 (0.0008) [2023-12-28 08:28:35,880][106226] Updated weights for policy 0, policy_version 1838654 (0.0009) [2023-12-28 08:28:35,941][106226] Updated weights for policy 0, policy_version 1838664 (0.0008) [2023-12-28 08:28:36,055][106225] Updated weights for policy 1, policy_version 1842599 (0.0008) [2023-12-28 08:28:36,123][106225] Updated weights for policy 1, policy_version 1842609 (0.0008) [2023-12-28 08:28:36,173][106225] Updated weights for policy 1, policy_version 1842619 (0.0009) [2023-12-28 08:28:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 942538752. Throughput: 0: 9995.6, 1: 9794.8. Samples: 942551148. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:28:36,175][105115] Avg episode reward: [(0, '-4.443'), (1, '-4.580')] [2023-12-28 08:28:36,688][106226] Updated weights for policy 0, policy_version 1838674 (0.0009) [2023-12-28 08:28:36,763][106226] Updated weights for policy 0, policy_version 1838684 (0.0009) [2023-12-28 08:28:36,826][106226] Updated weights for policy 0, policy_version 1838694 (0.0009) [2023-12-28 08:28:36,904][106225] Updated weights for policy 1, policy_version 1842629 (0.0008) [2023-12-28 08:28:36,963][106225] Updated weights for policy 1, policy_version 1842639 (0.0008) [2023-12-28 08:28:37,022][106225] Updated weights for policy 1, policy_version 1842649 (0.0008) [2023-12-28 08:28:37,548][106226] Updated weights for policy 0, policy_version 1838704 (0.0009) [2023-12-28 08:28:37,609][106226] Updated weights for policy 0, policy_version 1838714 (0.0008) [2023-12-28 08:28:37,668][106226] Updated weights for policy 0, policy_version 1838724 (0.0009) [2023-12-28 08:28:37,753][106225] Updated weights for policy 1, policy_version 1842659 (0.0009) [2023-12-28 08:28:37,804][106225] Updated weights for policy 1, policy_version 1842669 (0.0008) [2023-12-28 08:28:37,863][106225] Updated weights for policy 1, policy_version 1842679 (0.0009) [2023-12-28 08:28:38,363][106226] Updated weights for policy 0, policy_version 1838734 (0.0008) [2023-12-28 08:28:38,417][106226] Updated weights for policy 0, policy_version 1838744 (0.0008) [2023-12-28 08:28:38,475][106226] Updated weights for policy 0, policy_version 1838754 (0.0008) [2023-12-28 08:28:38,577][106225] Updated weights for policy 1, policy_version 1842689 (0.0008) [2023-12-28 08:28:38,630][106225] Updated weights for policy 1, policy_version 1842699 (0.0006) [2023-12-28 08:28:38,690][106225] Updated weights for policy 1, policy_version 1842709 (0.0006) [2023-12-28 08:28:38,750][106225] Updated weights for policy 1, policy_version 1842719 (0.0006) [2023-12-28 08:28:39,307][106226] Updated weights for policy 0, policy_version 1838764 (0.0007) [2023-12-28 08:28:39,325][106225] Updated weights for policy 1, policy_version 1842729 (0.0008) [2023-12-28 08:28:39,378][106226] Updated weights for policy 0, policy_version 1838774 (0.0008) [2023-12-28 08:28:39,396][106225] Updated weights for policy 1, policy_version 1842739 (0.0009) [2023-12-28 08:28:39,449][106226] Updated weights for policy 0, policy_version 1838784 (0.0007) [2023-12-28 08:28:39,464][106225] Updated weights for policy 1, policy_version 1842749 (0.0008) [2023-12-28 08:28:40,135][106226] Updated weights for policy 0, policy_version 1838794 (0.0007) [2023-12-28 08:28:40,201][106226] Updated weights for policy 0, policy_version 1838804 (0.0008) [2023-12-28 08:28:40,239][106225] Updated weights for policy 1, policy_version 1842759 (0.0009) [2023-12-28 08:28:40,267][106226] Updated weights for policy 0, policy_version 1838814 (0.0007) [2023-12-28 08:28:40,299][106225] Updated weights for policy 1, policy_version 1842769 (0.0008) [2023-12-28 08:28:40,330][106226] Updated weights for policy 0, policy_version 1838824 (0.0007) [2023-12-28 08:28:40,364][106225] Updated weights for policy 1, policy_version 1842779 (0.0009) [2023-12-28 08:28:40,946][106225] Updated weights for policy 1, policy_version 1842789 (0.0007) [2023-12-28 08:28:41,007][106225] Updated weights for policy 1, policy_version 1842799 (0.0007) [2023-12-28 08:28:41,041][106226] Updated weights for policy 0, policy_version 1838834 (0.0007) [2023-12-28 08:28:41,077][106225] Updated weights for policy 1, policy_version 1842809 (0.0008) [2023-12-28 08:28:41,103][106226] Updated weights for policy 0, policy_version 1838844 (0.0007) [2023-12-28 08:28:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 942637056. Throughput: 0: 9941.7, 1: 9815.5. Samples: 942608376. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:28:41,175][105115] Avg episode reward: [(0, '-4.363'), (1, '-4.725')] [2023-12-28 08:28:41,175][106226] Updated weights for policy 0, policy_version 1838854 (0.0007) [2023-12-28 08:28:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001842816_471818240.pth... [2023-12-28 08:28:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001841664_471523328.pth [2023-12-28 08:28:41,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001838856_470827008.pth... [2023-12-28 08:28:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001837704_470532096.pth [2023-12-28 08:28:41,902][106226] Updated weights for policy 0, policy_version 1838864 (0.0008) [2023-12-28 08:28:41,911][106225] Updated weights for policy 1, policy_version 1842819 (0.0009) [2023-12-28 08:28:41,965][106226] Updated weights for policy 0, policy_version 1838874 (0.0009) [2023-12-28 08:28:41,975][106225] Updated weights for policy 1, policy_version 1842829 (0.0006) [2023-12-28 08:28:42,027][106226] Updated weights for policy 0, policy_version 1838884 (0.0010) [2023-12-28 08:28:42,034][106225] Updated weights for policy 1, policy_version 1842839 (0.0009) [2023-12-28 08:28:42,681][106226] Updated weights for policy 0, policy_version 1838894 (0.0006) [2023-12-28 08:28:42,750][106226] Updated weights for policy 0, policy_version 1838904 (0.0007) [2023-12-28 08:28:42,764][106225] Updated weights for policy 1, policy_version 1842849 (0.0007) [2023-12-28 08:28:42,820][106226] Updated weights for policy 0, policy_version 1838914 (0.0008) [2023-12-28 08:28:42,823][106225] Updated weights for policy 1, policy_version 1842859 (0.0006) [2023-12-28 08:28:42,876][106225] Updated weights for policy 1, policy_version 1842869 (0.0006) [2023-12-28 08:28:42,930][106225] Updated weights for policy 1, policy_version 1842879 (0.0009) [2023-12-28 08:28:43,350][106226] Updated weights for policy 0, policy_version 1838924 (0.0006) [2023-12-28 08:28:43,406][106226] Updated weights for policy 0, policy_version 1838934 (0.0007) [2023-12-28 08:28:43,468][106226] Updated weights for policy 0, policy_version 1838944 (0.0008) [2023-12-28 08:28:43,729][106225] Updated weights for policy 1, policy_version 1842889 (0.0009) [2023-12-28 08:28:43,786][106225] Updated weights for policy 1, policy_version 1842899 (0.0008) [2023-12-28 08:28:43,838][106225] Updated weights for policy 1, policy_version 1842909 (0.0008) [2023-12-28 08:28:44,164][106226] Updated weights for policy 0, policy_version 1838954 (0.0008) [2023-12-28 08:28:44,216][106226] Updated weights for policy 0, policy_version 1838964 (0.0009) [2023-12-28 08:28:44,271][106226] Updated weights for policy 0, policy_version 1838974 (0.0008) [2023-12-28 08:28:44,331][106226] Updated weights for policy 0, policy_version 1838984 (0.0010) [2023-12-28 08:28:44,503][106225] Updated weights for policy 1, policy_version 1842919 (0.0008) [2023-12-28 08:28:44,555][106225] Updated weights for policy 1, policy_version 1842929 (0.0006) [2023-12-28 08:28:44,605][106225] Updated weights for policy 1, policy_version 1842939 (0.0005) [2023-12-28 08:28:45,152][106226] Updated weights for policy 0, policy_version 1838994 (0.0009) [2023-12-28 08:28:45,216][106226] Updated weights for policy 0, policy_version 1839004 (0.0009) [2023-12-28 08:28:45,257][106225] Updated weights for policy 1, policy_version 1842949 (0.0005) [2023-12-28 08:28:45,275][106226] Updated weights for policy 0, policy_version 1839014 (0.0009) [2023-12-28 08:28:45,314][106225] Updated weights for policy 1, policy_version 1842959 (0.0008) [2023-12-28 08:28:45,377][106225] Updated weights for policy 1, policy_version 1842969 (0.0009) [2023-12-28 08:28:46,022][106226] Updated weights for policy 0, policy_version 1839024 (0.0009) [2023-12-28 08:28:46,090][106226] Updated weights for policy 0, policy_version 1839034 (0.0008) [2023-12-28 08:28:46,099][106225] Updated weights for policy 1, policy_version 1842979 (0.0009) [2023-12-28 08:28:46,143][106226] Updated weights for policy 0, policy_version 1839044 (0.0008) [2023-12-28 08:28:46,159][106225] Updated weights for policy 1, policy_version 1842989 (0.0006) [2023-12-28 08:28:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 942735360. Throughput: 0: 9956.2, 1: 9735.9. Samples: 942725844. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:28:46,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-4.623')] [2023-12-28 08:28:46,220][106225] Updated weights for policy 1, policy_version 1842999 (0.0008) [2023-12-28 08:28:46,874][106226] Updated weights for policy 0, policy_version 1839054 (0.0009) [2023-12-28 08:28:46,891][106225] Updated weights for policy 1, policy_version 1843009 (0.0007) [2023-12-28 08:28:46,933][106226] Updated weights for policy 0, policy_version 1839064 (0.0006) [2023-12-28 08:28:46,952][106225] Updated weights for policy 1, policy_version 1843019 (0.0006) [2023-12-28 08:28:46,999][106226] Updated weights for policy 0, policy_version 1839074 (0.0009) [2023-12-28 08:28:47,009][106225] Updated weights for policy 1, policy_version 1843029 (0.0006) [2023-12-28 08:28:47,063][106225] Updated weights for policy 1, policy_version 1843039 (0.0008) [2023-12-28 08:28:47,681][106226] Updated weights for policy 0, policy_version 1839084 (0.0007) [2023-12-28 08:28:47,727][106225] Updated weights for policy 1, policy_version 1843049 (0.0008) [2023-12-28 08:28:47,741][106226] Updated weights for policy 0, policy_version 1839094 (0.0008) [2023-12-28 08:28:47,786][106225] Updated weights for policy 1, policy_version 1843059 (0.0006) [2023-12-28 08:28:47,801][106226] Updated weights for policy 0, policy_version 1839104 (0.0008) [2023-12-28 08:28:47,842][106225] Updated weights for policy 1, policy_version 1843069 (0.0005) [2023-12-28 08:28:48,398][106225] Updated weights for policy 1, policy_version 1843079 (0.0007) [2023-12-28 08:28:48,461][106225] Updated weights for policy 1, policy_version 1843089 (0.0008) [2023-12-28 08:28:48,521][106226] Updated weights for policy 0, policy_version 1839114 (0.0008) [2023-12-28 08:28:48,523][106225] Updated weights for policy 1, policy_version 1843099 (0.0008) [2023-12-28 08:28:48,579][106226] Updated weights for policy 0, policy_version 1839124 (0.0007) [2023-12-28 08:28:48,636][106226] Updated weights for policy 0, policy_version 1839134 (0.0008) [2023-12-28 08:28:48,696][106226] Updated weights for policy 0, policy_version 1839144 (0.0009) [2023-12-28 08:28:49,245][106225] Updated weights for policy 1, policy_version 1843109 (0.0008) [2023-12-28 08:28:49,309][106225] Updated weights for policy 1, policy_version 1843119 (0.0007) [2023-12-28 08:28:49,371][106225] Updated weights for policy 1, policy_version 1843129 (0.0007) [2023-12-28 08:28:49,431][106226] Updated weights for policy 0, policy_version 1839154 (0.0008) [2023-12-28 08:28:49,485][106226] Updated weights for policy 0, policy_version 1839164 (0.0009) [2023-12-28 08:28:49,545][106226] Updated weights for policy 0, policy_version 1839174 (0.0008) [2023-12-28 08:28:50,070][106225] Updated weights for policy 1, policy_version 1843139 (0.0009) [2023-12-28 08:28:50,133][106225] Updated weights for policy 1, policy_version 1843149 (0.0008) [2023-12-28 08:28:50,196][106225] Updated weights for policy 1, policy_version 1843159 (0.0008) [2023-12-28 08:28:50,314][106226] Updated weights for policy 0, policy_version 1839184 (0.0009) [2023-12-28 08:28:50,382][106226] Updated weights for policy 0, policy_version 1839194 (0.0010) [2023-12-28 08:28:50,443][106226] Updated weights for policy 0, policy_version 1839204 (0.0009) [2023-12-28 08:28:50,941][106225] Updated weights for policy 1, policy_version 1843169 (0.0008) [2023-12-28 08:28:51,009][106225] Updated weights for policy 1, policy_version 1843179 (0.0009) [2023-12-28 08:28:51,070][106225] Updated weights for policy 1, policy_version 1843189 (0.0009) [2023-12-28 08:28:51,132][106225] Updated weights for policy 1, policy_version 1843199 (0.0009) [2023-12-28 08:28:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 942833664. Throughput: 0: 9800.2, 1: 9778.8. Samples: 942842768. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:28:51,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-4.816')] [2023-12-28 08:28:51,212][106226] Updated weights for policy 0, policy_version 1839214 (0.0009) [2023-12-28 08:28:51,278][106226] Updated weights for policy 0, policy_version 1839224 (0.0007) [2023-12-28 08:28:51,340][106226] Updated weights for policy 0, policy_version 1839234 (0.0006) [2023-12-28 08:28:51,827][106225] Updated weights for policy 1, policy_version 1843209 (0.0009) [2023-12-28 08:28:51,887][106225] Updated weights for policy 1, policy_version 1843219 (0.0009) [2023-12-28 08:28:51,955][106225] Updated weights for policy 1, policy_version 1843229 (0.0008) [2023-12-28 08:28:52,141][106226] Updated weights for policy 0, policy_version 1839244 (0.0008) [2023-12-28 08:28:52,201][106226] Updated weights for policy 0, policy_version 1839254 (0.0010) [2023-12-28 08:28:52,268][106226] Updated weights for policy 0, policy_version 1839264 (0.0009) [2023-12-28 08:28:52,692][106225] Updated weights for policy 1, policy_version 1843239 (0.0009) [2023-12-28 08:28:52,752][106225] Updated weights for policy 1, policy_version 1843249 (0.0010) [2023-12-28 08:28:52,819][106225] Updated weights for policy 1, policy_version 1843259 (0.0009) [2023-12-28 08:28:52,861][106226] Updated weights for policy 0, policy_version 1839274 (0.0009) [2023-12-28 08:28:52,919][106226] Updated weights for policy 0, policy_version 1839284 (0.0008) [2023-12-28 08:28:52,972][106226] Updated weights for policy 0, policy_version 1839294 (0.0009) [2023-12-28 08:28:53,021][106226] Updated weights for policy 0, policy_version 1839304 (0.0009) [2023-12-28 08:28:53,546][106225] Updated weights for policy 1, policy_version 1843269 (0.0009) [2023-12-28 08:28:53,605][106225] Updated weights for policy 1, policy_version 1843279 (0.0008) [2023-12-28 08:28:53,653][106225] Updated weights for policy 1, policy_version 1843289 (0.0008) [2023-12-28 08:28:53,777][106226] Updated weights for policy 0, policy_version 1839314 (0.0008) [2023-12-28 08:28:53,840][106226] Updated weights for policy 0, policy_version 1839324 (0.0009) [2023-12-28 08:28:53,902][106226] Updated weights for policy 0, policy_version 1839334 (0.0008) [2023-12-28 08:28:54,386][106225] Updated weights for policy 1, policy_version 1843299 (0.0009) [2023-12-28 08:28:54,448][106225] Updated weights for policy 1, policy_version 1843309 (0.0009) [2023-12-28 08:28:54,506][106225] Updated weights for policy 1, policy_version 1843319 (0.0008) [2023-12-28 08:28:54,643][106226] Updated weights for policy 0, policy_version 1839344 (0.0009) [2023-12-28 08:28:54,699][106226] Updated weights for policy 0, policy_version 1839354 (0.0008) [2023-12-28 08:28:54,759][106226] Updated weights for policy 0, policy_version 1839364 (0.0009) [2023-12-28 08:28:55,188][106225] Updated weights for policy 1, policy_version 1843329 (0.0008) [2023-12-28 08:28:55,240][106225] Updated weights for policy 1, policy_version 1843339 (0.0005) [2023-12-28 08:28:55,291][106225] Updated weights for policy 1, policy_version 1843349 (0.0005) [2023-12-28 08:28:55,348][106225] Updated weights for policy 1, policy_version 1843359 (0.0005) [2023-12-28 08:28:55,546][106226] Updated weights for policy 0, policy_version 1839374 (0.0009) [2023-12-28 08:28:55,611][106226] Updated weights for policy 0, policy_version 1839384 (0.0008) [2023-12-28 08:28:55,663][106226] Updated weights for policy 0, policy_version 1839394 (0.0008) [2023-12-28 08:28:55,950][106225] Updated weights for policy 1, policy_version 1843369 (0.0008) [2023-12-28 08:28:56,006][106225] Updated weights for policy 1, policy_version 1843379 (0.0008) [2023-12-28 08:28:56,061][106225] Updated weights for policy 1, policy_version 1843389 (0.0009) [2023-12-28 08:28:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 942931968. Throughput: 0: 9754.8, 1: 9784.2. Samples: 942899972. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:28:56,176][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.672')] [2023-12-28 08:28:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001839400_470966272.pth... [2023-12-28 08:28:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001843392_471965696.pth... [2023-12-28 08:28:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001838280_470679552.pth [2023-12-28 08:28:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001842208_471662592.pth [2023-12-28 08:28:56,430][106226] Updated weights for policy 0, policy_version 1839404 (0.0010) [2023-12-28 08:28:56,486][106226] Updated weights for policy 0, policy_version 1839414 (0.0008) [2023-12-28 08:28:56,537][106226] Updated weights for policy 0, policy_version 1839424 (0.0008) [2023-12-28 08:28:56,724][106225] Updated weights for policy 1, policy_version 1843399 (0.0006) [2023-12-28 08:28:56,772][106225] Updated weights for policy 1, policy_version 1843409 (0.0005) [2023-12-28 08:28:56,820][106225] Updated weights for policy 1, policy_version 1843419 (0.0005) [2023-12-28 08:28:57,327][106226] Updated weights for policy 0, policy_version 1839434 (0.0007) [2023-12-28 08:28:57,385][106226] Updated weights for policy 0, policy_version 1839444 (0.0008) [2023-12-28 08:28:57,418][106225] Updated weights for policy 1, policy_version 1843429 (0.0007) [2023-12-28 08:28:57,444][106226] Updated weights for policy 0, policy_version 1839454 (0.0007) [2023-12-28 08:28:57,466][106225] Updated weights for policy 1, policy_version 1843439 (0.0006) [2023-12-28 08:28:57,500][106226] Updated weights for policy 0, policy_version 1839464 (0.0007) [2023-12-28 08:28:57,518][106225] Updated weights for policy 1, policy_version 1843449 (0.0009) [2023-12-28 08:28:58,181][106225] Updated weights for policy 1, policy_version 1843459 (0.0005) [2023-12-28 08:28:58,247][106225] Updated weights for policy 1, policy_version 1843469 (0.0008) [2023-12-28 08:28:58,285][106226] Updated weights for policy 0, policy_version 1839474 (0.0008) [2023-12-28 08:28:58,310][106225] Updated weights for policy 1, policy_version 1843479 (0.0008) [2023-12-28 08:28:58,352][106226] Updated weights for policy 0, policy_version 1839484 (0.0007) [2023-12-28 08:28:58,418][106226] Updated weights for policy 0, policy_version 1839494 (0.0008) [2023-12-28 08:28:59,106][106225] Updated weights for policy 1, policy_version 1843489 (0.0008) [2023-12-28 08:28:59,136][106226] Updated weights for policy 0, policy_version 1839504 (0.0007) [2023-12-28 08:28:59,170][106225] Updated weights for policy 1, policy_version 1843499 (0.0008) [2023-12-28 08:28:59,200][106226] Updated weights for policy 0, policy_version 1839514 (0.0006) [2023-12-28 08:28:59,227][106225] Updated weights for policy 1, policy_version 1843509 (0.0008) [2023-12-28 08:28:59,273][106226] Updated weights for policy 0, policy_version 1839524 (0.0009) [2023-12-28 08:28:59,297][106225] Updated weights for policy 1, policy_version 1843519 (0.0007) [2023-12-28 08:28:59,961][106226] Updated weights for policy 0, policy_version 1839534 (0.0008) [2023-12-28 08:29:00,017][106226] Updated weights for policy 0, policy_version 1839544 (0.0008) [2023-12-28 08:29:00,074][106226] Updated weights for policy 0, policy_version 1839554 (0.0008) [2023-12-28 08:29:00,076][106225] Updated weights for policy 1, policy_version 1843529 (0.0006) [2023-12-28 08:29:00,135][106225] Updated weights for policy 1, policy_version 1843539 (0.0008) [2023-12-28 08:29:00,194][106225] Updated weights for policy 1, policy_version 1843549 (0.0008) [2023-12-28 08:29:00,828][106226] Updated weights for policy 0, policy_version 1839564 (0.0009) [2023-12-28 08:29:00,874][106226] Updated weights for policy 0, policy_version 1839574 (0.0010) [2023-12-28 08:29:00,895][106225] Updated weights for policy 1, policy_version 1843559 (0.0006) [2023-12-28 08:29:00,934][106226] Updated weights for policy 0, policy_version 1839584 (0.0009) [2023-12-28 08:29:00,954][106225] Updated weights for policy 1, policy_version 1843569 (0.0006) [2023-12-28 08:29:01,010][106225] Updated weights for policy 1, policy_version 1843579 (0.0008) [2023-12-28 08:29:01,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 943030272. Throughput: 0: 9735.9, 1: 9879.5. Samples: 943015808. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:01,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-4.520')] [2023-12-28 08:29:01,617][106226] Updated weights for policy 0, policy_version 1839594 (0.0006) [2023-12-28 08:29:01,678][106226] Updated weights for policy 0, policy_version 1839604 (0.0008) [2023-12-28 08:29:01,758][106226] Updated weights for policy 0, policy_version 1839614 (0.0010) [2023-12-28 08:29:01,800][106225] Updated weights for policy 1, policy_version 1843589 (0.0009) [2023-12-28 08:29:01,819][106226] Updated weights for policy 0, policy_version 1839624 (0.0011) [2023-12-28 08:29:01,857][106225] Updated weights for policy 1, policy_version 1843599 (0.0008) [2023-12-28 08:29:01,910][106225] Updated weights for policy 1, policy_version 1843609 (0.0007) [2023-12-28 08:29:02,524][106226] Updated weights for policy 0, policy_version 1839634 (0.0010) [2023-12-28 08:29:02,561][106225] Updated weights for policy 1, policy_version 1843619 (0.0007) [2023-12-28 08:29:02,590][106226] Updated weights for policy 0, policy_version 1839644 (0.0011) [2023-12-28 08:29:02,616][106225] Updated weights for policy 1, policy_version 1843629 (0.0005) [2023-12-28 08:29:02,648][106226] Updated weights for policy 0, policy_version 1839654 (0.0010) [2023-12-28 08:29:02,664][106225] Updated weights for policy 1, policy_version 1843639 (0.0005) [2023-12-28 08:29:03,336][106225] Updated weights for policy 1, policy_version 1843649 (0.0006) [2023-12-28 08:29:03,354][106226] Updated weights for policy 0, policy_version 1839664 (0.0006) [2023-12-28 08:29:03,399][106225] Updated weights for policy 1, policy_version 1843659 (0.0007) [2023-12-28 08:29:03,411][106226] Updated weights for policy 0, policy_version 1839674 (0.0008) [2023-12-28 08:29:03,448][106225] Updated weights for policy 1, policy_version 1843669 (0.0005) [2023-12-28 08:29:03,458][106226] Updated weights for policy 0, policy_version 1839684 (0.0010) [2023-12-28 08:29:03,496][106225] Updated weights for policy 1, policy_version 1843679 (0.0006) [2023-12-28 08:29:04,106][106225] Updated weights for policy 1, policy_version 1843689 (0.0006) [2023-12-28 08:29:04,137][106226] Updated weights for policy 0, policy_version 1839694 (0.0010) [2023-12-28 08:29:04,166][106225] Updated weights for policy 1, policy_version 1843699 (0.0006) [2023-12-28 08:29:04,197][106226] Updated weights for policy 0, policy_version 1839704 (0.0011) [2023-12-28 08:29:04,228][106225] Updated weights for policy 1, policy_version 1843709 (0.0007) [2023-12-28 08:29:04,259][106226] Updated weights for policy 0, policy_version 1839714 (0.0010) [2023-12-28 08:29:04,931][106225] Updated weights for policy 1, policy_version 1843719 (0.0007) [2023-12-28 08:29:04,985][106226] Updated weights for policy 0, policy_version 1839724 (0.0011) [2023-12-28 08:29:04,991][106225] Updated weights for policy 1, policy_version 1843729 (0.0005) [2023-12-28 08:29:05,032][106226] Updated weights for policy 0, policy_version 1839734 (0.0010) [2023-12-28 08:29:05,049][106225] Updated weights for policy 1, policy_version 1843739 (0.0006) [2023-12-28 08:29:05,081][106226] Updated weights for policy 0, policy_version 1839744 (0.0010) [2023-12-28 08:29:05,746][106225] Updated weights for policy 1, policy_version 1843749 (0.0005) [2023-12-28 08:29:05,753][106226] Updated weights for policy 0, policy_version 1839754 (0.0010) [2023-12-28 08:29:05,803][106226] Updated weights for policy 0, policy_version 1839764 (0.0007) [2023-12-28 08:29:05,807][106225] Updated weights for policy 1, policy_version 1843759 (0.0006) [2023-12-28 08:29:05,864][106226] Updated weights for policy 0, policy_version 1839774 (0.0006) [2023-12-28 08:29:05,866][106225] Updated weights for policy 1, policy_version 1843769 (0.0007) [2023-12-28 08:29:05,923][106226] Updated weights for policy 0, policy_version 1839784 (0.0005) [2023-12-28 08:29:06,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 943128576. Throughput: 0: 9762.7, 1: 9925.1. Samples: 943136404. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:06,176][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.974')] [2023-12-28 08:29:06,484][106225] Updated weights for policy 1, policy_version 1843779 (0.0008) [2023-12-28 08:29:06,543][106225] Updated weights for policy 1, policy_version 1843789 (0.0007) [2023-12-28 08:29:06,573][106226] Updated weights for policy 0, policy_version 1839794 (0.0011) [2023-12-28 08:29:06,609][106225] Updated weights for policy 1, policy_version 1843799 (0.0007) [2023-12-28 08:29:06,635][106226] Updated weights for policy 0, policy_version 1839804 (0.0011) [2023-12-28 08:29:06,697][106226] Updated weights for policy 0, policy_version 1839814 (0.0011) [2023-12-28 08:29:07,337][106225] Updated weights for policy 1, policy_version 1843809 (0.0006) [2023-12-28 08:29:07,390][106225] Updated weights for policy 1, policy_version 1843819 (0.0005) [2023-12-28 08:29:07,448][106226] Updated weights for policy 0, policy_version 1839824 (0.0008) [2023-12-28 08:29:07,457][106225] Updated weights for policy 1, policy_version 1843829 (0.0006) [2023-12-28 08:29:07,508][106226] Updated weights for policy 0, policy_version 1839834 (0.0006) [2023-12-28 08:29:07,513][106225] Updated weights for policy 1, policy_version 1843839 (0.0007) [2023-12-28 08:29:07,559][106226] Updated weights for policy 0, policy_version 1839844 (0.0008) [2023-12-28 08:29:08,108][106225] Updated weights for policy 1, policy_version 1843849 (0.0007) [2023-12-28 08:29:08,166][106225] Updated weights for policy 1, policy_version 1843859 (0.0008) [2023-12-28 08:29:08,224][106225] Updated weights for policy 1, policy_version 1843869 (0.0008) [2023-12-28 08:29:08,228][106226] Updated weights for policy 0, policy_version 1839854 (0.0006) [2023-12-28 08:29:08,278][106226] Updated weights for policy 0, policy_version 1839864 (0.0007) [2023-12-28 08:29:08,340][106226] Updated weights for policy 0, policy_version 1839874 (0.0008) [2023-12-28 08:29:08,963][106225] Updated weights for policy 1, policy_version 1843879 (0.0007) [2023-12-28 08:29:09,019][106225] Updated weights for policy 1, policy_version 1843889 (0.0005) [2023-12-28 08:29:09,049][106226] Updated weights for policy 0, policy_version 1839884 (0.0009) [2023-12-28 08:29:09,069][106225] Updated weights for policy 1, policy_version 1843899 (0.0007) [2023-12-28 08:29:09,103][106226] Updated weights for policy 0, policy_version 1839894 (0.0005) [2023-12-28 08:29:09,149][106226] Updated weights for policy 0, policy_version 1839904 (0.0005) [2023-12-28 08:29:09,838][106225] Updated weights for policy 1, policy_version 1843909 (0.0008) [2023-12-28 08:29:09,884][106226] Updated weights for policy 0, policy_version 1839914 (0.0006) [2023-12-28 08:29:09,905][106225] Updated weights for policy 1, policy_version 1843919 (0.0008) [2023-12-28 08:29:09,944][106226] Updated weights for policy 0, policy_version 1839924 (0.0011) [2023-12-28 08:29:09,970][106225] Updated weights for policy 1, policy_version 1843929 (0.0010) [2023-12-28 08:29:10,013][106226] Updated weights for policy 0, policy_version 1839934 (0.0011) [2023-12-28 08:29:10,074][106226] Updated weights for policy 0, policy_version 1839944 (0.0011) [2023-12-28 08:29:10,737][106225] Updated weights for policy 1, policy_version 1843939 (0.0008) [2023-12-28 08:29:10,806][106225] Updated weights for policy 1, policy_version 1843949 (0.0006) [2023-12-28 08:29:10,806][106226] Updated weights for policy 0, policy_version 1839954 (0.0009) [2023-12-28 08:29:10,865][106226] Updated weights for policy 0, policy_version 1839964 (0.0009) [2023-12-28 08:29:10,876][106225] Updated weights for policy 1, policy_version 1843959 (0.0005) [2023-12-28 08:29:10,915][106226] Updated weights for policy 0, policy_version 1839974 (0.0008) [2023-12-28 08:29:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 943226880. Throughput: 0: 9783.1, 1: 9969.4. Samples: 943196456. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:11,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.724')] [2023-12-28 08:29:11,179][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001843968_472113152.pth... [2023-12-28 08:29:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001839976_471113728.pth... [2023-12-28 08:29:11,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001842816_471818240.pth [2023-12-28 08:29:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001838856_470827008.pth [2023-12-28 08:29:11,630][106225] Updated weights for policy 1, policy_version 1843969 (0.0006) [2023-12-28 08:29:11,694][106225] Updated weights for policy 1, policy_version 1843979 (0.0008) [2023-12-28 08:29:11,751][106226] Updated weights for policy 0, policy_version 1839984 (0.0008) [2023-12-28 08:29:11,761][106225] Updated weights for policy 1, policy_version 1843989 (0.0008) [2023-12-28 08:29:11,811][106226] Updated weights for policy 0, policy_version 1839994 (0.0006) [2023-12-28 08:29:11,828][106225] Updated weights for policy 1, policy_version 1843999 (0.0008) [2023-12-28 08:29:11,876][106226] Updated weights for policy 0, policy_version 1840004 (0.0008) [2023-12-28 08:29:12,581][106225] Updated weights for policy 1, policy_version 1844009 (0.0009) [2023-12-28 08:29:12,625][106226] Updated weights for policy 0, policy_version 1840014 (0.0010) [2023-12-28 08:29:12,646][106225] Updated weights for policy 1, policy_version 1844019 (0.0008) [2023-12-28 08:29:12,693][106226] Updated weights for policy 0, policy_version 1840024 (0.0008) [2023-12-28 08:29:12,704][106225] Updated weights for policy 1, policy_version 1844029 (0.0008) [2023-12-28 08:29:12,748][106226] Updated weights for policy 0, policy_version 1840034 (0.0008) [2023-12-28 08:29:13,355][106225] Updated weights for policy 1, policy_version 1844039 (0.0008) [2023-12-28 08:29:13,404][106225] Updated weights for policy 1, policy_version 1844049 (0.0008) [2023-12-28 08:29:13,439][106226] Updated weights for policy 0, policy_version 1840044 (0.0008) [2023-12-28 08:29:13,456][106225] Updated weights for policy 1, policy_version 1844059 (0.0007) [2023-12-28 08:29:13,489][106226] Updated weights for policy 0, policy_version 1840054 (0.0005) [2023-12-28 08:29:13,542][106226] Updated weights for policy 0, policy_version 1840064 (0.0009) [2023-12-28 08:29:14,191][106225] Updated weights for policy 1, policy_version 1844069 (0.0008) [2023-12-28 08:29:14,244][106225] Updated weights for policy 1, policy_version 1844079 (0.0008) [2023-12-28 08:29:14,266][106226] Updated weights for policy 0, policy_version 1840074 (0.0009) [2023-12-28 08:29:14,293][106225] Updated weights for policy 1, policy_version 1844089 (0.0007) [2023-12-28 08:29:14,320][106226] Updated weights for policy 0, policy_version 1840084 (0.0007) [2023-12-28 08:29:14,367][106226] Updated weights for policy 0, policy_version 1840094 (0.0007) [2023-12-28 08:29:14,426][106226] Updated weights for policy 0, policy_version 1840104 (0.0006) [2023-12-28 08:29:15,031][106225] Updated weights for policy 1, policy_version 1844099 (0.0008) [2023-12-28 08:29:15,096][106225] Updated weights for policy 1, policy_version 1844109 (0.0009) [2023-12-28 08:29:15,120][106226] Updated weights for policy 0, policy_version 1840114 (0.0006) [2023-12-28 08:29:15,152][106225] Updated weights for policy 1, policy_version 1844119 (0.0009) [2023-12-28 08:29:15,176][106226] Updated weights for policy 0, policy_version 1840124 (0.0007) [2023-12-28 08:29:15,239][106226] Updated weights for policy 0, policy_version 1840134 (0.0006) [2023-12-28 08:29:15,807][106225] Updated weights for policy 1, policy_version 1844129 (0.0006) [2023-12-28 08:29:15,864][106225] Updated weights for policy 1, policy_version 1844139 (0.0005) [2023-12-28 08:29:15,891][106226] Updated weights for policy 0, policy_version 1840144 (0.0006) [2023-12-28 08:29:15,923][106225] Updated weights for policy 1, policy_version 1844149 (0.0005) [2023-12-28 08:29:15,946][106226] Updated weights for policy 0, policy_version 1840154 (0.0007) [2023-12-28 08:29:15,980][106225] Updated weights for policy 1, policy_version 1844159 (0.0005) [2023-12-28 08:29:16,002][106226] Updated weights for policy 0, policy_version 1840164 (0.0005) [2023-12-28 08:29:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 943325184. Throughput: 0: 9640.8, 1: 9892.1. Samples: 943310224. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:16,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.575')] [2023-12-28 08:29:16,628][106226] Updated weights for policy 0, policy_version 1840174 (0.0007) [2023-12-28 08:29:16,666][106225] Updated weights for policy 1, policy_version 1844169 (0.0006) [2023-12-28 08:29:16,684][106226] Updated weights for policy 0, policy_version 1840184 (0.0007) [2023-12-28 08:29:16,724][106225] Updated weights for policy 1, policy_version 1844179 (0.0008) [2023-12-28 08:29:16,742][106226] Updated weights for policy 0, policy_version 1840194 (0.0006) [2023-12-28 08:29:16,783][106225] Updated weights for policy 1, policy_version 1844189 (0.0008) [2023-12-28 08:29:17,376][106226] Updated weights for policy 0, policy_version 1840204 (0.0006) [2023-12-28 08:29:17,441][106226] Updated weights for policy 0, policy_version 1840214 (0.0005) [2023-12-28 08:29:17,503][106226] Updated weights for policy 0, policy_version 1840224 (0.0006) [2023-12-28 08:29:17,576][106225] Updated weights for policy 1, policy_version 1844199 (0.0009) [2023-12-28 08:29:17,630][106225] Updated weights for policy 1, policy_version 1844209 (0.0008) [2023-12-28 08:29:17,687][106225] Updated weights for policy 1, policy_version 1844219 (0.0008) [2023-12-28 08:29:18,097][106226] Updated weights for policy 0, policy_version 1840234 (0.0007) [2023-12-28 08:29:18,150][106226] Updated weights for policy 0, policy_version 1840244 (0.0005) [2023-12-28 08:29:18,200][106226] Updated weights for policy 0, policy_version 1840254 (0.0005) [2023-12-28 08:29:18,263][106226] Updated weights for policy 0, policy_version 1840264 (0.0008) [2023-12-28 08:29:18,453][106225] Updated weights for policy 1, policy_version 1844229 (0.0008) [2023-12-28 08:29:18,510][106225] Updated weights for policy 1, policy_version 1844239 (0.0009) [2023-12-28 08:29:18,572][106225] Updated weights for policy 1, policy_version 1844249 (0.0008) [2023-12-28 08:29:18,937][106226] Updated weights for policy 0, policy_version 1840274 (0.0007) [2023-12-28 08:29:18,991][106226] Updated weights for policy 0, policy_version 1840284 (0.0005) [2023-12-28 08:29:19,049][106226] Updated weights for policy 0, policy_version 1840294 (0.0005) [2023-12-28 08:29:19,302][106225] Updated weights for policy 1, policy_version 1844259 (0.0009) [2023-12-28 08:29:19,371][106225] Updated weights for policy 1, policy_version 1844269 (0.0008) [2023-12-28 08:29:19,444][106225] Updated weights for policy 1, policy_version 1844279 (0.0009) [2023-12-28 08:29:19,732][106226] Updated weights for policy 0, policy_version 1840304 (0.0008) [2023-12-28 08:29:19,792][106226] Updated weights for policy 0, policy_version 1840314 (0.0009) [2023-12-28 08:29:19,860][106226] Updated weights for policy 0, policy_version 1840324 (0.0009) [2023-12-28 08:29:20,111][106225] Updated weights for policy 1, policy_version 1844289 (0.0007) [2023-12-28 08:29:20,166][106225] Updated weights for policy 1, policy_version 1844299 (0.0009) [2023-12-28 08:29:20,219][106225] Updated weights for policy 1, policy_version 1844309 (0.0008) [2023-12-28 08:29:20,281][106225] Updated weights for policy 1, policy_version 1844319 (0.0009) [2023-12-28 08:29:20,613][106226] Updated weights for policy 0, policy_version 1840334 (0.0008) [2023-12-28 08:29:20,673][106226] Updated weights for policy 0, policy_version 1840344 (0.0009) [2023-12-28 08:29:20,729][106226] Updated weights for policy 0, policy_version 1840354 (0.0008) [2023-12-28 08:29:21,038][106225] Updated weights for policy 1, policy_version 1844329 (0.0008) [2023-12-28 08:29:21,106][106225] Updated weights for policy 1, policy_version 1844339 (0.0008) [2023-12-28 08:29:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 943415296. Throughput: 0: 9672.3, 1: 9840.7. Samples: 943429232. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:21,175][106225] Updated weights for policy 1, policy_version 1844349 (0.0009) [2023-12-28 08:29:21,175][105115] Avg episode reward: [(0, '-4.561'), (1, '-4.496')] [2023-12-28 08:29:21,529][106226] Updated weights for policy 0, policy_version 1840364 (0.0008) [2023-12-28 08:29:21,594][106226] Updated weights for policy 0, policy_version 1840374 (0.0009) [2023-12-28 08:29:21,664][106226] Updated weights for policy 0, policy_version 1840384 (0.0009) [2023-12-28 08:29:21,939][106225] Updated weights for policy 1, policy_version 1844359 (0.0008) [2023-12-28 08:29:22,005][106225] Updated weights for policy 1, policy_version 1844369 (0.0008) [2023-12-28 08:29:22,067][106225] Updated weights for policy 1, policy_version 1844379 (0.0008) [2023-12-28 08:29:22,437][106226] Updated weights for policy 0, policy_version 1840394 (0.0009) [2023-12-28 08:29:22,504][106226] Updated weights for policy 0, policy_version 1840404 (0.0009) [2023-12-28 08:29:22,571][106226] Updated weights for policy 0, policy_version 1840414 (0.0007) [2023-12-28 08:29:22,639][106226] Updated weights for policy 0, policy_version 1840424 (0.0008) [2023-12-28 08:29:22,817][106225] Updated weights for policy 1, policy_version 1844389 (0.0009) [2023-12-28 08:29:22,872][106225] Updated weights for policy 1, policy_version 1844399 (0.0008) [2023-12-28 08:29:22,924][106225] Updated weights for policy 1, policy_version 1844409 (0.0008) [2023-12-28 08:29:23,337][106226] Updated weights for policy 0, policy_version 1840434 (0.0005) [2023-12-28 08:29:23,390][106226] Updated weights for policy 0, policy_version 1840444 (0.0009) [2023-12-28 08:29:23,446][106226] Updated weights for policy 0, policy_version 1840454 (0.0010) [2023-12-28 08:29:23,639][106225] Updated weights for policy 1, policy_version 1844419 (0.0008) [2023-12-28 08:29:23,699][106225] Updated weights for policy 1, policy_version 1844429 (0.0006) [2023-12-28 08:29:23,761][106225] Updated weights for policy 1, policy_version 1844439 (0.0005) [2023-12-28 08:29:24,141][106226] Updated weights for policy 0, policy_version 1840464 (0.0009) [2023-12-28 08:29:24,189][106226] Updated weights for policy 0, policy_version 1840474 (0.0008) [2023-12-28 08:29:24,247][106226] Updated weights for policy 0, policy_version 1840484 (0.0008) [2023-12-28 08:29:24,382][106225] Updated weights for policy 1, policy_version 1844449 (0.0006) [2023-12-28 08:29:24,440][106225] Updated weights for policy 1, policy_version 1844459 (0.0005) [2023-12-28 08:29:24,502][106225] Updated weights for policy 1, policy_version 1844469 (0.0005) [2023-12-28 08:29:24,564][106225] Updated weights for policy 1, policy_version 1844479 (0.0005) [2023-12-28 08:29:25,006][106226] Updated weights for policy 0, policy_version 1840494 (0.0009) [2023-12-28 08:29:25,070][106226] Updated weights for policy 0, policy_version 1840504 (0.0008) [2023-12-28 08:29:25,141][106226] Updated weights for policy 0, policy_version 1840514 (0.0006) [2023-12-28 08:29:25,197][106225] Updated weights for policy 1, policy_version 1844489 (0.0006) [2023-12-28 08:29:25,255][106225] Updated weights for policy 1, policy_version 1844499 (0.0008) [2023-12-28 08:29:25,310][106225] Updated weights for policy 1, policy_version 1844509 (0.0008) [2023-12-28 08:29:25,830][106226] Updated weights for policy 0, policy_version 1840524 (0.0008) [2023-12-28 08:29:25,881][106226] Updated weights for policy 0, policy_version 1840534 (0.0007) [2023-12-28 08:29:25,941][106226] Updated weights for policy 0, policy_version 1840544 (0.0006) [2023-12-28 08:29:26,047][106225] Updated weights for policy 1, policy_version 1844519 (0.0008) [2023-12-28 08:29:26,106][106225] Updated weights for policy 1, policy_version 1844529 (0.0008) [2023-12-28 08:29:26,159][106225] Updated weights for policy 1, policy_version 1844539 (0.0008) [2023-12-28 08:29:26,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 943513600. Throughput: 0: 9677.9, 1: 9817.0. Samples: 943485644. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:26,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.965')] [2023-12-28 08:29:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001840552_471261184.pth... [2023-12-28 08:29:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001844544_472260608.pth... [2023-12-28 08:29:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001843392_471965696.pth [2023-12-28 08:29:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001839400_470966272.pth [2023-12-28 08:29:26,622][106226] Updated weights for policy 0, policy_version 1840554 (0.0008) [2023-12-28 08:29:26,673][106226] Updated weights for policy 0, policy_version 1840564 (0.0009) [2023-12-28 08:29:26,730][106226] Updated weights for policy 0, policy_version 1840574 (0.0008) [2023-12-28 08:29:26,776][106226] Updated weights for policy 0, policy_version 1840584 (0.0008) [2023-12-28 08:29:26,889][106225] Updated weights for policy 1, policy_version 1844549 (0.0008) [2023-12-28 08:29:26,937][106225] Updated weights for policy 1, policy_version 1844559 (0.0008) [2023-12-28 08:29:26,996][106225] Updated weights for policy 1, policy_version 1844569 (0.0009) [2023-12-28 08:29:27,402][106226] Updated weights for policy 0, policy_version 1840594 (0.0008) [2023-12-28 08:29:27,455][106226] Updated weights for policy 0, policy_version 1840604 (0.0007) [2023-12-28 08:29:27,504][106226] Updated weights for policy 0, policy_version 1840614 (0.0007) [2023-12-28 08:29:27,707][106225] Updated weights for policy 1, policy_version 1844579 (0.0008) [2023-12-28 08:29:27,771][106225] Updated weights for policy 1, policy_version 1844589 (0.0011) [2023-12-28 08:29:27,831][106225] Updated weights for policy 1, policy_version 1844599 (0.0010) [2023-12-28 08:29:28,194][106226] Updated weights for policy 0, policy_version 1840624 (0.0006) [2023-12-28 08:29:28,247][106226] Updated weights for policy 0, policy_version 1840634 (0.0005) [2023-12-28 08:29:28,293][106226] Updated weights for policy 0, policy_version 1840644 (0.0005) [2023-12-28 08:29:28,425][106225] Updated weights for policy 1, policy_version 1844609 (0.0007) [2023-12-28 08:29:28,489][106225] Updated weights for policy 1, policy_version 1844619 (0.0005) [2023-12-28 08:29:28,543][106225] Updated weights for policy 1, policy_version 1844629 (0.0005) [2023-12-28 08:29:28,601][106225] Updated weights for policy 1, policy_version 1844639 (0.0005) [2023-12-28 08:29:28,856][106226] Updated weights for policy 0, policy_version 1840654 (0.0008) [2023-12-28 08:29:28,909][106226] Updated weights for policy 0, policy_version 1840664 (0.0010) [2023-12-28 08:29:28,961][106226] Updated weights for policy 0, policy_version 1840674 (0.0010) [2023-12-28 08:29:29,264][106225] Updated weights for policy 1, policy_version 1844649 (0.0009) [2023-12-28 08:29:29,331][106225] Updated weights for policy 1, policy_version 1844659 (0.0010) [2023-12-28 08:29:29,397][106225] Updated weights for policy 1, policy_version 1844669 (0.0010) [2023-12-28 08:29:29,655][106226] Updated weights for policy 0, policy_version 1840684 (0.0008) [2023-12-28 08:29:29,720][106226] Updated weights for policy 0, policy_version 1840694 (0.0007) [2023-12-28 08:29:29,778][106226] Updated weights for policy 0, policy_version 1840704 (0.0008) [2023-12-28 08:29:30,135][106225] Updated weights for policy 1, policy_version 1844679 (0.0010) [2023-12-28 08:29:30,195][106225] Updated weights for policy 1, policy_version 1844689 (0.0010) [2023-12-28 08:29:30,255][106225] Updated weights for policy 1, policy_version 1844699 (0.0010) [2023-12-28 08:29:30,492][106226] Updated weights for policy 0, policy_version 1840714 (0.0008) [2023-12-28 08:29:30,546][106226] Updated weights for policy 0, policy_version 1840724 (0.0008) [2023-12-28 08:29:30,603][106226] Updated weights for policy 0, policy_version 1840734 (0.0006) [2023-12-28 08:29:30,666][106226] Updated weights for policy 0, policy_version 1840744 (0.0007) [2023-12-28 08:29:30,988][106225] Updated weights for policy 1, policy_version 1844709 (0.0010) [2023-12-28 08:29:31,046][106225] Updated weights for policy 1, policy_version 1844719 (0.0010) [2023-12-28 08:29:31,099][106225] Updated weights for policy 1, policy_version 1844729 (0.0009) [2023-12-28 08:29:31,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 943620096. Throughput: 0: 9747.0, 1: 9859.1. Samples: 943608120. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:31,175][105115] Avg episode reward: [(0, '-4.724'), (1, '-4.741')] [2023-12-28 08:29:31,358][106226] Updated weights for policy 0, policy_version 1840754 (0.0010) [2023-12-28 08:29:31,433][106226] Updated weights for policy 0, policy_version 1840764 (0.0010) [2023-12-28 08:29:31,479][106226] Updated weights for policy 0, policy_version 1840774 (0.0010) [2023-12-28 08:29:31,781][106225] Updated weights for policy 1, policy_version 1844739 (0.0009) [2023-12-28 08:29:31,835][106225] Updated weights for policy 1, policy_version 1844749 (0.0010) [2023-12-28 08:29:31,885][106225] Updated weights for policy 1, policy_version 1844759 (0.0010) [2023-12-28 08:29:32,184][106226] Updated weights for policy 0, policy_version 1840784 (0.0010) [2023-12-28 08:29:32,234][106226] Updated weights for policy 0, policy_version 1840794 (0.0010) [2023-12-28 08:29:32,301][106226] Updated weights for policy 0, policy_version 1840804 (0.0011) [2023-12-28 08:29:32,628][106225] Updated weights for policy 1, policy_version 1844769 (0.0010) [2023-12-28 08:29:32,692][106225] Updated weights for policy 1, policy_version 1844779 (0.0010) [2023-12-28 08:29:32,750][106225] Updated weights for policy 1, policy_version 1844789 (0.0010) [2023-12-28 08:29:32,806][106225] Updated weights for policy 1, policy_version 1844799 (0.0009) [2023-12-28 08:29:33,048][106226] Updated weights for policy 0, policy_version 1840814 (0.0010) [2023-12-28 08:29:33,098][106226] Updated weights for policy 0, policy_version 1840824 (0.0010) [2023-12-28 08:29:33,151][106226] Updated weights for policy 0, policy_version 1840834 (0.0010) [2023-12-28 08:29:33,450][106225] Updated weights for policy 1, policy_version 1844809 (0.0010) [2023-12-28 08:29:33,519][106225] Updated weights for policy 1, policy_version 1844819 (0.0010) [2023-12-28 08:29:33,575][106225] Updated weights for policy 1, policy_version 1844829 (0.0009) [2023-12-28 08:29:33,756][106226] Updated weights for policy 0, policy_version 1840844 (0.0008) [2023-12-28 08:29:33,808][106226] Updated weights for policy 0, policy_version 1840854 (0.0005) [2023-12-28 08:29:33,865][106226] Updated weights for policy 0, policy_version 1840864 (0.0005) [2023-12-28 08:29:34,252][106225] Updated weights for policy 1, policy_version 1844839 (0.0009) [2023-12-28 08:29:34,308][106225] Updated weights for policy 1, policy_version 1844849 (0.0008) [2023-12-28 08:29:34,370][106225] Updated weights for policy 1, policy_version 1844859 (0.0008) [2023-12-28 08:29:34,488][106226] Updated weights for policy 0, policy_version 1840874 (0.0006) [2023-12-28 08:29:34,553][106226] Updated weights for policy 0, policy_version 1840884 (0.0009) [2023-12-28 08:29:34,616][106226] Updated weights for policy 0, policy_version 1840894 (0.0009) [2023-12-28 08:29:34,683][106226] Updated weights for policy 0, policy_version 1840904 (0.0010) [2023-12-28 08:29:35,046][106225] Updated weights for policy 1, policy_version 1844869 (0.0010) [2023-12-28 08:29:35,112][106225] Updated weights for policy 1, policy_version 1844879 (0.0010) [2023-12-28 08:29:35,169][106225] Updated weights for policy 1, policy_version 1844889 (0.0005) [2023-12-28 08:29:35,320][106226] Updated weights for policy 0, policy_version 1840914 (0.0009) [2023-12-28 08:29:35,372][106226] Updated weights for policy 0, policy_version 1840924 (0.0009) [2023-12-28 08:29:35,428][106226] Updated weights for policy 0, policy_version 1840934 (0.0009) [2023-12-28 08:29:35,827][106225] Updated weights for policy 1, policy_version 1844899 (0.0005) [2023-12-28 08:29:35,887][106225] Updated weights for policy 1, policy_version 1844909 (0.0005) [2023-12-28 08:29:35,933][106225] Updated weights for policy 1, policy_version 1844919 (0.0005) [2023-12-28 08:29:36,084][106226] Updated weights for policy 0, policy_version 1840944 (0.0009) [2023-12-28 08:29:36,146][106226] Updated weights for policy 0, policy_version 1840954 (0.0008) [2023-12-28 08:29:36,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19660.9, 300 sec: 19716.4). Total num frames: 943718400. Throughput: 0: 9862.6, 1: 9851.4. Samples: 943729892. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:36,175][105115] Avg episode reward: [(0, '-4.610'), (1, '-4.600')] [2023-12-28 08:29:36,208][106226] Updated weights for policy 0, policy_version 1840964 (0.0008) [2023-12-28 08:29:36,490][106225] Updated weights for policy 1, policy_version 1844929 (0.0005) [2023-12-28 08:29:36,555][106225] Updated weights for policy 1, policy_version 1844939 (0.0007) [2023-12-28 08:29:36,617][106225] Updated weights for policy 1, policy_version 1844949 (0.0008) [2023-12-28 08:29:36,677][106225] Updated weights for policy 1, policy_version 1844959 (0.0006) [2023-12-28 08:29:37,042][106226] Updated weights for policy 0, policy_version 1840974 (0.0009) [2023-12-28 08:29:37,089][106226] Updated weights for policy 0, policy_version 1840984 (0.0007) [2023-12-28 08:29:37,150][106226] Updated weights for policy 0, policy_version 1840994 (0.0009) [2023-12-28 08:29:37,223][106225] Updated weights for policy 1, policy_version 1844969 (0.0007) [2023-12-28 08:29:37,287][106225] Updated weights for policy 1, policy_version 1844979 (0.0010) [2023-12-28 08:29:37,343][106225] Updated weights for policy 1, policy_version 1844989 (0.0010) [2023-12-28 08:29:37,926][106226] Updated weights for policy 0, policy_version 1841004 (0.0008) [2023-12-28 08:29:37,978][106226] Updated weights for policy 0, policy_version 1841014 (0.0007) [2023-12-28 08:29:37,984][106225] Updated weights for policy 1, policy_version 1844999 (0.0010) [2023-12-28 08:29:38,028][106226] Updated weights for policy 0, policy_version 1841024 (0.0006) [2023-12-28 08:29:38,043][106225] Updated weights for policy 1, policy_version 1845009 (0.0010) [2023-12-28 08:29:38,103][106225] Updated weights for policy 1, policy_version 1845019 (0.0010) [2023-12-28 08:29:38,784][106226] Updated weights for policy 0, policy_version 1841034 (0.0007) [2023-12-28 08:29:38,797][106225] Updated weights for policy 1, policy_version 1845029 (0.0010) [2023-12-28 08:29:38,845][106226] Updated weights for policy 0, policy_version 1841044 (0.0006) [2023-12-28 08:29:38,855][106225] Updated weights for policy 1, policy_version 1845039 (0.0010) [2023-12-28 08:29:38,904][106226] Updated weights for policy 0, policy_version 1841054 (0.0007) [2023-12-28 08:29:38,915][106225] Updated weights for policy 1, policy_version 1845049 (0.0010) [2023-12-28 08:29:38,963][106226] Updated weights for policy 0, policy_version 1841064 (0.0006) [2023-12-28 08:29:39,701][106225] Updated weights for policy 1, policy_version 1845059 (0.0010) [2023-12-28 08:29:39,709][106226] Updated weights for policy 0, policy_version 1841074 (0.0009) [2023-12-28 08:29:39,757][106225] Updated weights for policy 1, policy_version 1845069 (0.0010) [2023-12-28 08:29:39,771][106226] Updated weights for policy 0, policy_version 1841084 (0.0007) [2023-12-28 08:29:39,820][106225] Updated weights for policy 1, policy_version 1845079 (0.0011) [2023-12-28 08:29:39,833][106226] Updated weights for policy 0, policy_version 1841094 (0.0007) [2023-12-28 08:29:40,574][106225] Updated weights for policy 1, policy_version 1845089 (0.0009) [2023-12-28 08:29:40,616][106226] Updated weights for policy 0, policy_version 1841104 (0.0008) [2023-12-28 08:29:40,634][106225] Updated weights for policy 1, policy_version 1845099 (0.0006) [2023-12-28 08:29:40,679][106226] Updated weights for policy 0, policy_version 1841114 (0.0008) [2023-12-28 08:29:40,689][106225] Updated weights for policy 1, policy_version 1845109 (0.0006) [2023-12-28 08:29:40,735][106226] Updated weights for policy 0, policy_version 1841124 (0.0007) [2023-12-28 08:29:40,744][106225] Updated weights for policy 1, policy_version 1845119 (0.0007) [2023-12-28 08:29:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 943816704. Throughput: 0: 9817.9, 1: 9961.9. Samples: 943790060. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:41,175][105115] Avg episode reward: [(0, '-4.240'), (1, '-4.456')] [2023-12-28 08:29:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001845120_472408064.pth... [2023-12-28 08:29:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001841128_471408640.pth... [2023-12-28 08:29:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001843968_472113152.pth [2023-12-28 08:29:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001839976_471113728.pth [2023-12-28 08:29:41,496][106225] Updated weights for policy 1, policy_version 1845129 (0.0010) [2023-12-28 08:29:41,517][106226] Updated weights for policy 0, policy_version 1841134 (0.0008) [2023-12-28 08:29:41,561][106225] Updated weights for policy 1, policy_version 1845139 (0.0011) [2023-12-28 08:29:41,579][106226] Updated weights for policy 0, policy_version 1841144 (0.0005) [2023-12-28 08:29:41,628][106225] Updated weights for policy 1, policy_version 1845149 (0.0010) [2023-12-28 08:29:41,649][106226] Updated weights for policy 0, policy_version 1841154 (0.0007) [2023-12-28 08:29:42,400][106225] Updated weights for policy 1, policy_version 1845159 (0.0009) [2023-12-28 08:29:42,409][106226] Updated weights for policy 0, policy_version 1841164 (0.0009) [2023-12-28 08:29:42,461][106225] Updated weights for policy 1, policy_version 1845169 (0.0006) [2023-12-28 08:29:42,463][106226] Updated weights for policy 0, policy_version 1841174 (0.0008) [2023-12-28 08:29:42,523][106225] Updated weights for policy 1, policy_version 1845179 (0.0006) [2023-12-28 08:29:42,524][106226] Updated weights for policy 0, policy_version 1841184 (0.0008) [2023-12-28 08:29:43,223][106225] Updated weights for policy 1, policy_version 1845189 (0.0006) [2023-12-28 08:29:43,273][106226] Updated weights for policy 0, policy_version 1841194 (0.0008) [2023-12-28 08:29:43,287][106225] Updated weights for policy 1, policy_version 1845199 (0.0007) [2023-12-28 08:29:43,321][106226] Updated weights for policy 0, policy_version 1841204 (0.0007) [2023-12-28 08:29:43,346][106225] Updated weights for policy 1, policy_version 1845209 (0.0008) [2023-12-28 08:29:43,376][106226] Updated weights for policy 0, policy_version 1841214 (0.0007) [2023-12-28 08:29:43,436][106226] Updated weights for policy 0, policy_version 1841224 (0.0010) [2023-12-28 08:29:43,978][106225] Updated weights for policy 1, policy_version 1845219 (0.0006) [2023-12-28 08:29:44,031][106225] Updated weights for policy 1, policy_version 1845229 (0.0007) [2023-12-28 08:29:44,091][106225] Updated weights for policy 1, policy_version 1845239 (0.0008) [2023-12-28 08:29:44,182][106226] Updated weights for policy 0, policy_version 1841234 (0.0008) [2023-12-28 08:29:44,235][106226] Updated weights for policy 0, policy_version 1841244 (0.0010) [2023-12-28 08:29:44,285][106226] Updated weights for policy 0, policy_version 1841254 (0.0010) [2023-12-28 08:29:44,850][106225] Updated weights for policy 1, policy_version 1845249 (0.0008) [2023-12-28 08:29:44,901][106226] Updated weights for policy 0, policy_version 1841264 (0.0011) [2023-12-28 08:29:44,915][106225] Updated weights for policy 1, policy_version 1845259 (0.0006) [2023-12-28 08:29:44,960][106226] Updated weights for policy 0, policy_version 1841274 (0.0007) [2023-12-28 08:29:44,977][106225] Updated weights for policy 1, policy_version 1845269 (0.0008) [2023-12-28 08:29:45,022][106226] Updated weights for policy 0, policy_version 1841284 (0.0011) [2023-12-28 08:29:45,032][106225] Updated weights for policy 1, policy_version 1845279 (0.0006) [2023-12-28 08:29:45,693][106226] Updated weights for policy 0, policy_version 1841294 (0.0011) [2023-12-28 08:29:45,759][106226] Updated weights for policy 0, policy_version 1841304 (0.0009) [2023-12-28 08:29:45,810][106225] Updated weights for policy 1, policy_version 1845289 (0.0006) [2023-12-28 08:29:45,812][106226] Updated weights for policy 0, policy_version 1841314 (0.0010) [2023-12-28 08:29:45,867][106225] Updated weights for policy 1, policy_version 1845299 (0.0006) [2023-12-28 08:29:45,925][106225] Updated weights for policy 1, policy_version 1845309 (0.0008) [2023-12-28 08:29:46,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.7, 300 sec: 19688.6). Total num frames: 943915008. Throughput: 0: 9853.0, 1: 9871.7. Samples: 943903424. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:46,176][105115] Avg episode reward: [(0, '-4.320'), (1, '-4.724')] [2023-12-28 08:29:46,504][106226] Updated weights for policy 0, policy_version 1841324 (0.0008) [2023-12-28 08:29:46,562][106226] Updated weights for policy 0, policy_version 1841334 (0.0005) [2023-12-28 08:29:46,621][106226] Updated weights for policy 0, policy_version 1841344 (0.0005) [2023-12-28 08:29:46,668][106225] Updated weights for policy 1, policy_version 1845319 (0.0009) [2023-12-28 08:29:46,725][106225] Updated weights for policy 1, policy_version 1845329 (0.0007) [2023-12-28 08:29:46,773][106225] Updated weights for policy 1, policy_version 1845339 (0.0008) [2023-12-28 08:29:47,178][106226] Updated weights for policy 0, policy_version 1841354 (0.0006) [2023-12-28 08:29:47,231][106226] Updated weights for policy 0, policy_version 1841364 (0.0008) [2023-12-28 08:29:47,281][106226] Updated weights for policy 0, policy_version 1841374 (0.0006) [2023-12-28 08:29:47,336][106226] Updated weights for policy 0, policy_version 1841384 (0.0005) [2023-12-28 08:29:47,542][106225] Updated weights for policy 1, policy_version 1845349 (0.0007) [2023-12-28 08:29:47,608][106225] Updated weights for policy 1, policy_version 1845359 (0.0005) [2023-12-28 08:29:47,675][106225] Updated weights for policy 1, policy_version 1845369 (0.0005) [2023-12-28 08:29:48,023][106226] Updated weights for policy 0, policy_version 1841394 (0.0008) [2023-12-28 08:29:48,073][106226] Updated weights for policy 0, policy_version 1841404 (0.0005) [2023-12-28 08:29:48,126][106226] Updated weights for policy 0, policy_version 1841414 (0.0006) [2023-12-28 08:29:48,258][106225] Updated weights for policy 1, policy_version 1845379 (0.0005) [2023-12-28 08:29:48,308][106225] Updated weights for policy 1, policy_version 1845389 (0.0009) [2023-12-28 08:29:48,369][106225] Updated weights for policy 1, policy_version 1845399 (0.0010) [2023-12-28 08:29:48,785][106226] Updated weights for policy 0, policy_version 1841424 (0.0010) [2023-12-28 08:29:48,843][106226] Updated weights for policy 0, policy_version 1841434 (0.0011) [2023-12-28 08:29:48,909][106226] Updated weights for policy 0, policy_version 1841444 (0.0011) [2023-12-28 08:29:49,078][106225] Updated weights for policy 1, policy_version 1845409 (0.0011) [2023-12-28 08:29:49,134][106225] Updated weights for policy 1, policy_version 1845419 (0.0010) [2023-12-28 08:29:49,190][106225] Updated weights for policy 1, policy_version 1845429 (0.0010) [2023-12-28 08:29:49,258][106225] Updated weights for policy 1, policy_version 1845439 (0.0010) [2023-12-28 08:29:49,665][106226] Updated weights for policy 0, policy_version 1841454 (0.0010) [2023-12-28 08:29:49,720][106226] Updated weights for policy 0, policy_version 1841464 (0.0006) [2023-12-28 08:29:49,781][106226] Updated weights for policy 0, policy_version 1841474 (0.0005) [2023-12-28 08:29:49,972][106225] Updated weights for policy 1, policy_version 1845449 (0.0009) [2023-12-28 08:29:50,040][106225] Updated weights for policy 1, policy_version 1845459 (0.0009) [2023-12-28 08:29:50,114][106225] Updated weights for policy 1, policy_version 1845469 (0.0011) [2023-12-28 08:29:50,440][106226] Updated weights for policy 0, policy_version 1841484 (0.0007) [2023-12-28 08:29:50,494][106226] Updated weights for policy 0, policy_version 1841494 (0.0008) [2023-12-28 08:29:50,544][106226] Updated weights for policy 0, policy_version 1841504 (0.0008) [2023-12-28 08:29:50,810][106225] Updated weights for policy 1, policy_version 1845479 (0.0010) [2023-12-28 08:29:50,870][106225] Updated weights for policy 1, policy_version 1845489 (0.0010) [2023-12-28 08:29:50,930][106225] Updated weights for policy 1, policy_version 1845499 (0.0010) [2023-12-28 08:29:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 944013312. Throughput: 0: 9884.0, 1: 9819.0. Samples: 944023040. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:51,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.774')] [2023-12-28 08:29:51,284][106226] Updated weights for policy 0, policy_version 1841514 (0.0008) [2023-12-28 08:29:51,343][106226] Updated weights for policy 0, policy_version 1841524 (0.0008) [2023-12-28 08:29:51,418][106226] Updated weights for policy 0, policy_version 1841534 (0.0009) [2023-12-28 08:29:51,482][106226] Updated weights for policy 0, policy_version 1841544 (0.0008) [2023-12-28 08:29:51,755][106225] Updated weights for policy 1, policy_version 1845509 (0.0010) [2023-12-28 08:29:51,818][106225] Updated weights for policy 1, policy_version 1845519 (0.0009) [2023-12-28 08:29:51,879][106225] Updated weights for policy 1, policy_version 1845529 (0.0006) [2023-12-28 08:29:52,244][106226] Updated weights for policy 0, policy_version 1841554 (0.0007) [2023-12-28 08:29:52,311][106226] Updated weights for policy 0, policy_version 1841564 (0.0010) [2023-12-28 08:29:52,373][106226] Updated weights for policy 0, policy_version 1841574 (0.0009) [2023-12-28 08:29:52,558][106225] Updated weights for policy 1, policy_version 1845539 (0.0007) [2023-12-28 08:29:52,624][106225] Updated weights for policy 1, policy_version 1845549 (0.0011) [2023-12-28 08:29:52,680][106225] Updated weights for policy 1, policy_version 1845559 (0.0010) [2023-12-28 08:29:53,164][106226] Updated weights for policy 0, policy_version 1841584 (0.0007) [2023-12-28 08:29:53,228][106226] Updated weights for policy 0, policy_version 1841594 (0.0008) [2023-12-28 08:29:53,288][106226] Updated weights for policy 0, policy_version 1841604 (0.0007) [2023-12-28 08:29:53,331][106225] Updated weights for policy 1, policy_version 1845569 (0.0010) [2023-12-28 08:29:53,390][106225] Updated weights for policy 1, policy_version 1845579 (0.0010) [2023-12-28 08:29:53,446][106225] Updated weights for policy 1, policy_version 1845589 (0.0010) [2023-12-28 08:29:53,503][106225] Updated weights for policy 1, policy_version 1845599 (0.0010) [2023-12-28 08:29:53,997][106226] Updated weights for policy 0, policy_version 1841614 (0.0008) [2023-12-28 08:29:54,054][106226] Updated weights for policy 0, policy_version 1841624 (0.0009) [2023-12-28 08:29:54,114][106226] Updated weights for policy 0, policy_version 1841634 (0.0008) [2023-12-28 08:29:54,211][106225] Updated weights for policy 1, policy_version 1845609 (0.0006) [2023-12-28 08:29:54,261][106225] Updated weights for policy 1, policy_version 1845619 (0.0006) [2023-12-28 08:29:54,316][106225] Updated weights for policy 1, policy_version 1845629 (0.0005) [2023-12-28 08:29:54,882][106226] Updated weights for policy 0, policy_version 1841644 (0.0008) [2023-12-28 08:29:54,892][106225] Updated weights for policy 1, policy_version 1845639 (0.0005) [2023-12-28 08:29:54,935][106226] Updated weights for policy 0, policy_version 1841654 (0.0008) [2023-12-28 08:29:54,948][106225] Updated weights for policy 1, policy_version 1845649 (0.0006) [2023-12-28 08:29:55,006][106226] Updated weights for policy 0, policy_version 1841664 (0.0008) [2023-12-28 08:29:55,020][106225] Updated weights for policy 1, policy_version 1845659 (0.0007) [2023-12-28 08:29:55,702][106225] Updated weights for policy 1, policy_version 1845669 (0.0007) [2023-12-28 08:29:55,751][106226] Updated weights for policy 0, policy_version 1841674 (0.0006) [2023-12-28 08:29:55,760][106225] Updated weights for policy 1, policy_version 1845679 (0.0008) [2023-12-28 08:29:55,809][106226] Updated weights for policy 0, policy_version 1841684 (0.0006) [2023-12-28 08:29:55,814][106225] Updated weights for policy 1, policy_version 1845689 (0.0007) [2023-12-28 08:29:55,863][106226] Updated weights for policy 0, policy_version 1841694 (0.0005) [2023-12-28 08:29:55,909][106226] Updated weights for policy 0, policy_version 1841704 (0.0008) [2023-12-28 08:29:56,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.9, 300 sec: 19716.3). Total num frames: 944111616. Throughput: 0: 9842.7, 1: 9786.0. Samples: 944079744. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:29:56,175][105115] Avg episode reward: [(0, '-4.505'), (1, '-4.649')] [2023-12-28 08:29:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001845696_472555520.pth... [2023-12-28 08:29:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001841704_471556096.pth... [2023-12-28 08:29:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001844544_472260608.pth [2023-12-28 08:29:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001840552_471261184.pth [2023-12-28 08:29:56,510][106225] Updated weights for policy 1, policy_version 1845699 (0.0007) [2023-12-28 08:29:56,570][106225] Updated weights for policy 1, policy_version 1845709 (0.0008) [2023-12-28 08:29:56,625][106225] Updated weights for policy 1, policy_version 1845719 (0.0006) [2023-12-28 08:29:56,631][106226] Updated weights for policy 0, policy_version 1841714 (0.0006) [2023-12-28 08:29:56,689][106226] Updated weights for policy 0, policy_version 1841724 (0.0005) [2023-12-28 08:29:56,742][106226] Updated weights for policy 0, policy_version 1841734 (0.0005) [2023-12-28 08:29:57,308][106226] Updated weights for policy 0, policy_version 1841744 (0.0007) [2023-12-28 08:29:57,322][106225] Updated weights for policy 1, policy_version 1845729 (0.0006) [2023-12-28 08:29:57,360][106226] Updated weights for policy 0, policy_version 1841754 (0.0006) [2023-12-28 08:29:57,376][106225] Updated weights for policy 1, policy_version 1845739 (0.0009) [2023-12-28 08:29:57,407][106226] Updated weights for policy 0, policy_version 1841764 (0.0006) [2023-12-28 08:29:57,426][106225] Updated weights for policy 1, policy_version 1845749 (0.0010) [2023-12-28 08:29:57,476][106225] Updated weights for policy 1, policy_version 1845759 (0.0010) [2023-12-28 08:29:57,945][106226] Updated weights for policy 0, policy_version 1841774 (0.0005) [2023-12-28 08:29:58,002][106226] Updated weights for policy 0, policy_version 1841784 (0.0006) [2023-12-28 08:29:58,060][106226] Updated weights for policy 0, policy_version 1841794 (0.0005) [2023-12-28 08:29:58,197][106225] Updated weights for policy 1, policy_version 1845769 (0.0006) [2023-12-28 08:29:58,260][106225] Updated weights for policy 1, policy_version 1845779 (0.0010) [2023-12-28 08:29:58,327][106225] Updated weights for policy 1, policy_version 1845789 (0.0010) [2023-12-28 08:29:58,738][106226] Updated weights for policy 0, policy_version 1841804 (0.0007) [2023-12-28 08:29:58,809][106226] Updated weights for policy 0, policy_version 1841814 (0.0009) [2023-12-28 08:29:58,881][106226] Updated weights for policy 0, policy_version 1841824 (0.0009) [2023-12-28 08:29:59,115][106225] Updated weights for policy 1, policy_version 1845799 (0.0009) [2023-12-28 08:29:59,185][106225] Updated weights for policy 1, policy_version 1845809 (0.0008) [2023-12-28 08:29:59,261][106225] Updated weights for policy 1, policy_version 1845819 (0.0008) [2023-12-28 08:29:59,742][106226] Updated weights for policy 0, policy_version 1841834 (0.0010) [2023-12-28 08:29:59,801][106226] Updated weights for policy 0, policy_version 1841844 (0.0009) [2023-12-28 08:29:59,868][106226] Updated weights for policy 0, policy_version 1841854 (0.0008) [2023-12-28 08:29:59,920][106226] Updated weights for policy 0, policy_version 1841864 (0.0009) [2023-12-28 08:30:00,034][106225] Updated weights for policy 1, policy_version 1845829 (0.0008) [2023-12-28 08:30:00,089][106225] Updated weights for policy 1, policy_version 1845839 (0.0008) [2023-12-28 08:30:00,147][106225] Updated weights for policy 1, policy_version 1845849 (0.0006) [2023-12-28 08:30:00,627][106226] Updated weights for policy 0, policy_version 1841874 (0.0008) [2023-12-28 08:30:00,675][106226] Updated weights for policy 0, policy_version 1841884 (0.0008) [2023-12-28 08:30:00,726][106226] Updated weights for policy 0, policy_version 1841894 (0.0009) [2023-12-28 08:30:00,852][106225] Updated weights for policy 1, policy_version 1845859 (0.0009) [2023-12-28 08:30:00,910][106225] Updated weights for policy 1, policy_version 1845869 (0.0008) [2023-12-28 08:30:00,959][106225] Updated weights for policy 1, policy_version 1845879 (0.0007) [2023-12-28 08:30:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 944209920. Throughput: 0: 9886.9, 1: 9836.2. Samples: 944197760. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:01,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.678')] [2023-12-28 08:30:01,518][106226] Updated weights for policy 0, policy_version 1841904 (0.0006) [2023-12-28 08:30:01,584][106226] Updated weights for policy 0, policy_version 1841914 (0.0007) [2023-12-28 08:30:01,652][106226] Updated weights for policy 0, policy_version 1841924 (0.0009) [2023-12-28 08:30:01,685][106225] Updated weights for policy 1, policy_version 1845889 (0.0007) [2023-12-28 08:30:01,757][106225] Updated weights for policy 1, policy_version 1845899 (0.0008) [2023-12-28 08:30:01,818][106225] Updated weights for policy 1, policy_version 1845909 (0.0008) [2023-12-28 08:30:01,886][106225] Updated weights for policy 1, policy_version 1845919 (0.0007) [2023-12-28 08:30:02,323][106226] Updated weights for policy 0, policy_version 1841934 (0.0009) [2023-12-28 08:30:02,391][106226] Updated weights for policy 0, policy_version 1841944 (0.0010) [2023-12-28 08:30:02,458][106226] Updated weights for policy 0, policy_version 1841954 (0.0008) [2023-12-28 08:30:02,510][106225] Updated weights for policy 1, policy_version 1845929 (0.0008) [2023-12-28 08:30:02,568][106225] Updated weights for policy 1, policy_version 1845939 (0.0010) [2023-12-28 08:30:02,618][106225] Updated weights for policy 1, policy_version 1845949 (0.0010) [2023-12-28 08:30:03,134][106226] Updated weights for policy 0, policy_version 1841964 (0.0009) [2023-12-28 08:30:03,197][106226] Updated weights for policy 0, policy_version 1841974 (0.0011) [2023-12-28 08:30:03,255][106226] Updated weights for policy 0, policy_version 1841984 (0.0007) [2023-12-28 08:30:03,316][106225] Updated weights for policy 1, policy_version 1845959 (0.0008) [2023-12-28 08:30:03,367][106225] Updated weights for policy 1, policy_version 1845969 (0.0005) [2023-12-28 08:30:03,419][106225] Updated weights for policy 1, policy_version 1845979 (0.0009) [2023-12-28 08:30:03,870][106226] Updated weights for policy 0, policy_version 1841994 (0.0006) [2023-12-28 08:30:03,932][106226] Updated weights for policy 0, policy_version 1842004 (0.0007) [2023-12-28 08:30:03,994][106226] Updated weights for policy 0, policy_version 1842014 (0.0007) [2023-12-28 08:30:04,015][106225] Updated weights for policy 1, policy_version 1845989 (0.0009) [2023-12-28 08:30:04,051][106226] Updated weights for policy 0, policy_version 1842024 (0.0007) [2023-12-28 08:30:04,075][106225] Updated weights for policy 1, policy_version 1845999 (0.0010) [2023-12-28 08:30:04,135][106225] Updated weights for policy 1, policy_version 1846009 (0.0010) [2023-12-28 08:30:04,717][106226] Updated weights for policy 0, policy_version 1842034 (0.0006) [2023-12-28 08:30:04,779][106226] Updated weights for policy 0, policy_version 1842044 (0.0007) [2023-12-28 08:30:04,808][106225] Updated weights for policy 1, policy_version 1846019 (0.0011) [2023-12-28 08:30:04,845][106226] Updated weights for policy 0, policy_version 1842054 (0.0010) [2023-12-28 08:30:04,873][106225] Updated weights for policy 1, policy_version 1846029 (0.0011) [2023-12-28 08:30:04,941][106225] Updated weights for policy 1, policy_version 1846039 (0.0010) [2023-12-28 08:30:05,548][106226] Updated weights for policy 0, policy_version 1842064 (0.0010) [2023-12-28 08:30:05,597][106226] Updated weights for policy 0, policy_version 1842074 (0.0010) [2023-12-28 08:30:05,597][106225] Updated weights for policy 1, policy_version 1846049 (0.0010) [2023-12-28 08:30:05,646][106226] Updated weights for policy 0, policy_version 1842084 (0.0010) [2023-12-28 08:30:05,653][106225] Updated weights for policy 1, policy_version 1846059 (0.0005) [2023-12-28 08:30:05,710][106225] Updated weights for policy 1, policy_version 1846069 (0.0005) [2023-12-28 08:30:05,771][106225] Updated weights for policy 1, policy_version 1846079 (0.0009) [2023-12-28 08:30:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19688.6). Total num frames: 944308224. Throughput: 0: 9861.3, 1: 9921.1. Samples: 944319440. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:06,175][105115] Avg episode reward: [(0, '-4.292'), (1, '-4.425')] [2023-12-28 08:30:06,400][106226] Updated weights for policy 0, policy_version 1842094 (0.0011) [2023-12-28 08:30:06,463][106226] Updated weights for policy 0, policy_version 1842104 (0.0011) [2023-12-28 08:30:06,475][106225] Updated weights for policy 1, policy_version 1846089 (0.0010) [2023-12-28 08:30:06,525][106226] Updated weights for policy 0, policy_version 1842114 (0.0011) [2023-12-28 08:30:06,537][106225] Updated weights for policy 1, policy_version 1846099 (0.0009) [2023-12-28 08:30:06,599][106225] Updated weights for policy 1, policy_version 1846109 (0.0010) [2023-12-28 08:30:07,174][106226] Updated weights for policy 0, policy_version 1842124 (0.0011) [2023-12-28 08:30:07,230][106226] Updated weights for policy 0, policy_version 1842134 (0.0010) [2023-12-28 08:30:07,284][106226] Updated weights for policy 0, policy_version 1842144 (0.0011) [2023-12-28 08:30:07,305][106225] Updated weights for policy 1, policy_version 1846119 (0.0010) [2023-12-28 08:30:07,360][106225] Updated weights for policy 1, policy_version 1846129 (0.0010) [2023-12-28 08:30:07,423][106225] Updated weights for policy 1, policy_version 1846139 (0.0010) [2023-12-28 08:30:07,932][106226] Updated weights for policy 0, policy_version 1842154 (0.0011) [2023-12-28 08:30:07,989][106226] Updated weights for policy 0, policy_version 1842164 (0.0010) [2023-12-28 08:30:08,046][106226] Updated weights for policy 0, policy_version 1842174 (0.0010) [2023-12-28 08:30:08,104][106226] Updated weights for policy 0, policy_version 1842184 (0.0010) [2023-12-28 08:30:08,149][106225] Updated weights for policy 1, policy_version 1846149 (0.0010) [2023-12-28 08:30:08,206][106225] Updated weights for policy 1, policy_version 1846159 (0.0010) [2023-12-28 08:30:08,260][106225] Updated weights for policy 1, policy_version 1846169 (0.0010) [2023-12-28 08:30:08,812][106226] Updated weights for policy 0, policy_version 1842194 (0.0011) [2023-12-28 08:30:08,859][106226] Updated weights for policy 0, policy_version 1842204 (0.0009) [2023-12-28 08:30:08,906][106226] Updated weights for policy 0, policy_version 1842214 (0.0007) [2023-12-28 08:30:08,928][106225] Updated weights for policy 1, policy_version 1846179 (0.0010) [2023-12-28 08:30:08,977][106225] Updated weights for policy 1, policy_version 1846189 (0.0006) [2023-12-28 08:30:09,041][106225] Updated weights for policy 1, policy_version 1846199 (0.0005) [2023-12-28 08:30:09,656][106226] Updated weights for policy 0, policy_version 1842224 (0.0010) [2023-12-28 08:30:09,705][106225] Updated weights for policy 1, policy_version 1846209 (0.0005) [2023-12-28 08:30:09,709][106226] Updated weights for policy 0, policy_version 1842234 (0.0010) [2023-12-28 08:30:09,759][106225] Updated weights for policy 1, policy_version 1846219 (0.0007) [2023-12-28 08:30:09,772][106226] Updated weights for policy 0, policy_version 1842244 (0.0010) [2023-12-28 08:30:09,823][106225] Updated weights for policy 1, policy_version 1846229 (0.0007) [2023-12-28 08:30:09,886][106225] Updated weights for policy 1, policy_version 1846239 (0.0008) [2023-12-28 08:30:10,485][106226] Updated weights for policy 0, policy_version 1842254 (0.0008) [2023-12-28 08:30:10,544][106226] Updated weights for policy 0, policy_version 1842264 (0.0008) [2023-12-28 08:30:10,598][106226] Updated weights for policy 0, policy_version 1842274 (0.0009) [2023-12-28 08:30:10,649][106225] Updated weights for policy 1, policy_version 1846249 (0.0007) [2023-12-28 08:30:10,693][106225] Updated weights for policy 1, policy_version 1846259 (0.0008) [2023-12-28 08:30:10,739][106225] Updated weights for policy 1, policy_version 1846269 (0.0008) [2023-12-28 08:30:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 944406528. Throughput: 0: 9904.1, 1: 9944.7. Samples: 944378840. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:11,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.630')] [2023-12-28 08:30:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001846272_472702976.pth... [2023-12-28 08:30:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001842280_471703552.pth... [2023-12-28 08:30:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001845120_472408064.pth [2023-12-28 08:30:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001841128_471408640.pth [2023-12-28 08:30:11,400][106226] Updated weights for policy 0, policy_version 1842284 (0.0006) [2023-12-28 08:30:11,475][106226] Updated weights for policy 0, policy_version 1842294 (0.0006) [2023-12-28 08:30:11,545][106226] Updated weights for policy 0, policy_version 1842304 (0.0008) [2023-12-28 08:30:11,587][106225] Updated weights for policy 1, policy_version 1846279 (0.0007) [2023-12-28 08:30:11,657][106225] Updated weights for policy 1, policy_version 1846289 (0.0008) [2023-12-28 08:30:11,723][106225] Updated weights for policy 1, policy_version 1846299 (0.0007) [2023-12-28 08:30:12,284][106226] Updated weights for policy 0, policy_version 1842314 (0.0007) [2023-12-28 08:30:12,344][106226] Updated weights for policy 0, policy_version 1842324 (0.0008) [2023-12-28 08:30:12,422][106226] Updated weights for policy 0, policy_version 1842334 (0.0007) [2023-12-28 08:30:12,466][106225] Updated weights for policy 1, policy_version 1846309 (0.0008) [2023-12-28 08:30:12,489][106226] Updated weights for policy 0, policy_version 1842344 (0.0008) [2023-12-28 08:30:12,532][106225] Updated weights for policy 1, policy_version 1846319 (0.0010) [2023-12-28 08:30:12,590][106225] Updated weights for policy 1, policy_version 1846329 (0.0010) [2023-12-28 08:30:13,168][106226] Updated weights for policy 0, policy_version 1842354 (0.0005) [2023-12-28 08:30:13,236][106226] Updated weights for policy 0, policy_version 1842364 (0.0005) [2023-12-28 08:30:13,268][106225] Updated weights for policy 1, policy_version 1846339 (0.0011) [2023-12-28 08:30:13,298][106226] Updated weights for policy 0, policy_version 1842374 (0.0005) [2023-12-28 08:30:13,322][106225] Updated weights for policy 1, policy_version 1846349 (0.0010) [2023-12-28 08:30:13,370][106225] Updated weights for policy 1, policy_version 1846359 (0.0009) [2023-12-28 08:30:13,846][106226] Updated weights for policy 0, policy_version 1842384 (0.0005) [2023-12-28 08:30:13,900][106226] Updated weights for policy 0, policy_version 1842394 (0.0006) [2023-12-28 08:30:13,954][106226] Updated weights for policy 0, policy_version 1842404 (0.0009) [2023-12-28 08:30:14,042][106225] Updated weights for policy 1, policy_version 1846369 (0.0008) [2023-12-28 08:30:14,110][106225] Updated weights for policy 1, policy_version 1846379 (0.0009) [2023-12-28 08:30:14,168][106225] Updated weights for policy 1, policy_version 1846389 (0.0007) [2023-12-28 08:30:14,223][106225] Updated weights for policy 1, policy_version 1846399 (0.0006) [2023-12-28 08:30:14,739][106226] Updated weights for policy 0, policy_version 1842414 (0.0009) [2023-12-28 08:30:14,808][106226] Updated weights for policy 0, policy_version 1842424 (0.0009) [2023-12-28 08:30:14,874][106226] Updated weights for policy 0, policy_version 1842434 (0.0009) [2023-12-28 08:30:14,947][106225] Updated weights for policy 1, policy_version 1846409 (0.0008) [2023-12-28 08:30:15,007][106225] Updated weights for policy 1, policy_version 1846419 (0.0008) [2023-12-28 08:30:15,073][106225] Updated weights for policy 1, policy_version 1846429 (0.0008) [2023-12-28 08:30:15,676][106226] Updated weights for policy 0, policy_version 1842444 (0.0007) [2023-12-28 08:30:15,710][106225] Updated weights for policy 1, policy_version 1846439 (0.0007) [2023-12-28 08:30:15,739][106226] Updated weights for policy 0, policy_version 1842454 (0.0007) [2023-12-28 08:30:15,764][106225] Updated weights for policy 1, policy_version 1846449 (0.0006) [2023-12-28 08:30:15,804][106226] Updated weights for policy 0, policy_version 1842464 (0.0008) [2023-12-28 08:30:15,824][106225] Updated weights for policy 1, policy_version 1846459 (0.0006) [2023-12-28 08:30:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 944504832. Throughput: 0: 9804.9, 1: 9888.2. Samples: 944494308. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:16,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.761')] [2023-12-28 08:30:16,495][106226] Updated weights for policy 0, policy_version 1842474 (0.0006) [2023-12-28 08:30:16,545][106226] Updated weights for policy 0, policy_version 1842484 (0.0008) [2023-12-28 08:30:16,547][106225] Updated weights for policy 1, policy_version 1846469 (0.0006) [2023-12-28 08:30:16,600][106225] Updated weights for policy 1, policy_version 1846479 (0.0006) [2023-12-28 08:30:16,602][106226] Updated weights for policy 0, policy_version 1842494 (0.0008) [2023-12-28 08:30:16,646][106225] Updated weights for policy 1, policy_version 1846489 (0.0005) [2023-12-28 08:30:16,657][106226] Updated weights for policy 0, policy_version 1842504 (0.0007) [2023-12-28 08:30:17,363][106225] Updated weights for policy 1, policy_version 1846499 (0.0008) [2023-12-28 08:30:17,425][106226] Updated weights for policy 0, policy_version 1842514 (0.0006) [2023-12-28 08:30:17,426][106225] Updated weights for policy 1, policy_version 1846509 (0.0007) [2023-12-28 08:30:17,478][106226] Updated weights for policy 0, policy_version 1842524 (0.0007) [2023-12-28 08:30:17,489][106225] Updated weights for policy 1, policy_version 1846519 (0.0006) [2023-12-28 08:30:17,536][106226] Updated weights for policy 0, policy_version 1842534 (0.0007) [2023-12-28 08:30:18,174][106225] Updated weights for policy 1, policy_version 1846529 (0.0008) [2023-12-28 08:30:18,236][106225] Updated weights for policy 1, policy_version 1846539 (0.0010) [2023-12-28 08:30:18,282][106226] Updated weights for policy 0, policy_version 1842544 (0.0006) [2023-12-28 08:30:18,299][106225] Updated weights for policy 1, policy_version 1846549 (0.0009) [2023-12-28 08:30:18,354][106226] Updated weights for policy 0, policy_version 1842554 (0.0007) [2023-12-28 08:30:18,367][106225] Updated weights for policy 1, policy_version 1846559 (0.0007) [2023-12-28 08:30:18,416][106226] Updated weights for policy 0, policy_version 1842564 (0.0007) [2023-12-28 08:30:19,158][106226] Updated weights for policy 0, policy_version 1842574 (0.0007) [2023-12-28 08:30:19,160][106225] Updated weights for policy 1, policy_version 1846569 (0.0007) [2023-12-28 08:30:19,223][106225] Updated weights for policy 1, policy_version 1846579 (0.0010) [2023-12-28 08:30:19,223][106226] Updated weights for policy 0, policy_version 1842584 (0.0009) [2023-12-28 08:30:19,290][106226] Updated weights for policy 0, policy_version 1842594 (0.0011) [2023-12-28 08:30:19,293][106225] Updated weights for policy 1, policy_version 1846589 (0.0010) [2023-12-28 08:30:19,994][106225] Updated weights for policy 1, policy_version 1846599 (0.0008) [2023-12-28 08:30:20,063][106225] Updated weights for policy 1, policy_version 1846609 (0.0009) [2023-12-28 08:30:20,074][106226] Updated weights for policy 0, policy_version 1842604 (0.0010) [2023-12-28 08:30:20,125][106225] Updated weights for policy 1, policy_version 1846619 (0.0011) [2023-12-28 08:30:20,140][106226] Updated weights for policy 0, policy_version 1842614 (0.0010) [2023-12-28 08:30:20,200][106226] Updated weights for policy 0, policy_version 1842624 (0.0007) [2023-12-28 08:30:20,885][106225] Updated weights for policy 1, policy_version 1846629 (0.0011) [2023-12-28 08:30:20,945][106225] Updated weights for policy 1, policy_version 1846639 (0.0009) [2023-12-28 08:30:20,952][106226] Updated weights for policy 0, policy_version 1842634 (0.0008) [2023-12-28 08:30:21,002][106225] Updated weights for policy 1, policy_version 1846649 (0.0007) [2023-12-28 08:30:21,015][106226] Updated weights for policy 0, policy_version 1842644 (0.0006) [2023-12-28 08:30:21,084][106226] Updated weights for policy 0, policy_version 1842654 (0.0008) [2023-12-28 08:30:21,155][106226] Updated weights for policy 0, policy_version 1842664 (0.0008) [2023-12-28 08:30:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19716.3). Total num frames: 944603136. Throughput: 0: 9662.8, 1: 9826.6. Samples: 944606916. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:21,175][105115] Avg episode reward: [(0, '-4.589'), (1, '-4.656')] [2023-12-28 08:30:21,792][106225] Updated weights for policy 1, policy_version 1846659 (0.0009) [2023-12-28 08:30:21,854][106225] Updated weights for policy 1, policy_version 1846669 (0.0008) [2023-12-28 08:30:21,911][106225] Updated weights for policy 1, policy_version 1846679 (0.0008) [2023-12-28 08:30:21,969][106226] Updated weights for policy 0, policy_version 1842674 (0.0008) [2023-12-28 08:30:22,037][106226] Updated weights for policy 0, policy_version 1842684 (0.0008) [2023-12-28 08:30:22,102][106226] Updated weights for policy 0, policy_version 1842694 (0.0009) [2023-12-28 08:30:22,735][106225] Updated weights for policy 1, policy_version 1846689 (0.0007) [2023-12-28 08:30:22,802][106225] Updated weights for policy 1, policy_version 1846699 (0.0008) [2023-12-28 08:30:22,848][106226] Updated weights for policy 0, policy_version 1842704 (0.0007) [2023-12-28 08:30:22,866][106225] Updated weights for policy 1, policy_version 1846709 (0.0008) [2023-12-28 08:30:22,905][106226] Updated weights for policy 0, policy_version 1842714 (0.0007) [2023-12-28 08:30:22,926][106225] Updated weights for policy 1, policy_version 1846719 (0.0008) [2023-12-28 08:30:22,963][106226] Updated weights for policy 0, policy_version 1842724 (0.0007) [2023-12-28 08:30:23,600][106225] Updated weights for policy 1, policy_version 1846729 (0.0008) [2023-12-28 08:30:23,652][106225] Updated weights for policy 1, policy_version 1846739 (0.0008) [2023-12-28 08:30:23,717][106225] Updated weights for policy 1, policy_version 1846750 (0.0007) [2023-12-28 08:30:23,734][106226] Updated weights for policy 0, policy_version 1842734 (0.0009) [2023-12-28 08:30:23,787][106226] Updated weights for policy 0, policy_version 1842744 (0.0009) [2023-12-28 08:30:23,844][106226] Updated weights for policy 0, policy_version 1842754 (0.0009) [2023-12-28 08:30:24,399][106225] Updated weights for policy 1, policy_version 1846760 (0.0007) [2023-12-28 08:30:24,458][106225] Updated weights for policy 1, policy_version 1846770 (0.0009) [2023-12-28 08:30:24,503][106225] Updated weights for policy 1, policy_version 1846780 (0.0008) [2023-12-28 08:30:24,620][106226] Updated weights for policy 0, policy_version 1842764 (0.0009) [2023-12-28 08:30:24,683][106226] Updated weights for policy 0, policy_version 1842774 (0.0010) [2023-12-28 08:30:24,746][106226] Updated weights for policy 0, policy_version 1842784 (0.0005) [2023-12-28 08:30:25,207][106225] Updated weights for policy 1, policy_version 1846790 (0.0007) [2023-12-28 08:30:25,273][106225] Updated weights for policy 1, policy_version 1846800 (0.0008) [2023-12-28 08:30:25,337][106225] Updated weights for policy 1, policy_version 1846810 (0.0007) [2023-12-28 08:30:25,359][106226] Updated weights for policy 0, policy_version 1842794 (0.0006) [2023-12-28 08:30:25,416][106226] Updated weights for policy 0, policy_version 1842804 (0.0007) [2023-12-28 08:30:25,479][106226] Updated weights for policy 0, policy_version 1842814 (0.0006) [2023-12-28 08:30:25,536][106226] Updated weights for policy 0, policy_version 1842824 (0.0006) [2023-12-28 08:30:25,995][106225] Updated weights for policy 1, policy_version 1846820 (0.0006) [2023-12-28 08:30:26,055][106225] Updated weights for policy 1, policy_version 1846830 (0.0005) [2023-12-28 08:30:26,099][106225] Updated weights for policy 1, policy_version 1846840 (0.0005) [2023-12-28 08:30:26,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 944693248. Throughput: 0: 9655.8, 1: 9688.7. Samples: 944660564. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:26,176][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.779')] [2023-12-28 08:30:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001846848_472850432.pth... [2023-12-28 08:30:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001845696_472555520.pth [2023-12-28 08:30:26,207][106226] Updated weights for policy 0, policy_version 1842834 (0.0006) [2023-12-28 08:30:26,272][106226] Updated weights for policy 0, policy_version 1842844 (0.0005) [2023-12-28 08:30:26,324][106226] Updated weights for policy 0, policy_version 1842854 (0.0007) [2023-12-28 08:30:26,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001842856_471851008.pth... [2023-12-28 08:30:26,334][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001841704_471556096.pth [2023-12-28 08:30:26,810][106225] Updated weights for policy 1, policy_version 1846850 (0.0006) [2023-12-28 08:30:26,868][106225] Updated weights for policy 1, policy_version 1846860 (0.0007) [2023-12-28 08:30:26,904][106226] Updated weights for policy 0, policy_version 1842864 (0.0009) [2023-12-28 08:30:26,932][106225] Updated weights for policy 1, policy_version 1846870 (0.0008) [2023-12-28 08:30:26,965][106226] Updated weights for policy 0, policy_version 1842874 (0.0007) [2023-12-28 08:30:26,990][106225] Updated weights for policy 1, policy_version 1846880 (0.0008) [2023-12-28 08:30:27,020][106226] Updated weights for policy 0, policy_version 1842884 (0.0007) [2023-12-28 08:30:27,530][106225] Updated weights for policy 1, policy_version 1846890 (0.0005) [2023-12-28 08:30:27,593][106225] Updated weights for policy 1, policy_version 1846900 (0.0007) [2023-12-28 08:30:27,651][106225] Updated weights for policy 1, policy_version 1846910 (0.0007) [2023-12-28 08:30:27,737][106226] Updated weights for policy 0, policy_version 1842894 (0.0008) [2023-12-28 08:30:27,798][106226] Updated weights for policy 0, policy_version 1842904 (0.0008) [2023-12-28 08:30:27,841][106226] Updated weights for policy 0, policy_version 1842914 (0.0008) [2023-12-28 08:30:28,332][106225] Updated weights for policy 1, policy_version 1846920 (0.0009) [2023-12-28 08:30:28,394][106225] Updated weights for policy 1, policy_version 1846930 (0.0009) [2023-12-28 08:30:28,453][106225] Updated weights for policy 1, policy_version 1846940 (0.0009) [2023-12-28 08:30:28,569][106226] Updated weights for policy 0, policy_version 1842924 (0.0008) [2023-12-28 08:30:28,620][106226] Updated weights for policy 0, policy_version 1842934 (0.0008) [2023-12-28 08:30:28,672][106226] Updated weights for policy 0, policy_version 1842944 (0.0008) [2023-12-28 08:30:29,171][106225] Updated weights for policy 1, policy_version 1846950 (0.0009) [2023-12-28 08:30:29,224][106225] Updated weights for policy 1, policy_version 1846960 (0.0008) [2023-12-28 08:30:29,286][106225] Updated weights for policy 1, policy_version 1846970 (0.0007) [2023-12-28 08:30:29,405][106226] Updated weights for policy 0, policy_version 1842954 (0.0008) [2023-12-28 08:30:29,472][106226] Updated weights for policy 0, policy_version 1842964 (0.0007) [2023-12-28 08:30:29,543][106226] Updated weights for policy 0, policy_version 1842974 (0.0007) [2023-12-28 08:30:29,604][106226] Updated weights for policy 0, policy_version 1842984 (0.0007) [2023-12-28 08:30:29,948][106225] Updated weights for policy 1, policy_version 1846980 (0.0007) [2023-12-28 08:30:30,011][106225] Updated weights for policy 1, policy_version 1846990 (0.0009) [2023-12-28 08:30:30,071][106225] Updated weights for policy 1, policy_version 1847000 (0.0009) [2023-12-28 08:30:30,332][106226] Updated weights for policy 0, policy_version 1842994 (0.0009) [2023-12-28 08:30:30,395][106226] Updated weights for policy 0, policy_version 1843004 (0.0008) [2023-12-28 08:30:30,462][106226] Updated weights for policy 0, policy_version 1843014 (0.0009) [2023-12-28 08:30:30,738][106225] Updated weights for policy 1, policy_version 1847010 (0.0008) [2023-12-28 08:30:30,794][106225] Updated weights for policy 1, policy_version 1847020 (0.0008) [2023-12-28 08:30:30,848][106225] Updated weights for policy 1, policy_version 1847030 (0.0008) [2023-12-28 08:30:30,904][106225] Updated weights for policy 1, policy_version 1847040 (0.0005) [2023-12-28 08:30:31,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 944791552. Throughput: 0: 9746.6, 1: 9804.9. Samples: 944783236. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-28 08:30:31,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.958')] [2023-12-28 08:30:31,248][106226] Updated weights for policy 0, policy_version 1843024 (0.0006) [2023-12-28 08:30:31,306][106226] Updated weights for policy 0, policy_version 1843034 (0.0008) [2023-12-28 08:30:31,375][106226] Updated weights for policy 0, policy_version 1843044 (0.0007) [2023-12-28 08:30:31,581][106225] Updated weights for policy 1, policy_version 1847050 (0.0011) [2023-12-28 08:30:31,645][106225] Updated weights for policy 1, policy_version 1847060 (0.0010) [2023-12-28 08:30:31,708][106225] Updated weights for policy 1, policy_version 1847070 (0.0010) [2023-12-28 08:30:32,076][106226] Updated weights for policy 0, policy_version 1843054 (0.0007) [2023-12-28 08:30:32,130][106226] Updated weights for policy 0, policy_version 1843064 (0.0006) [2023-12-28 08:30:32,183][106226] Updated weights for policy 0, policy_version 1843074 (0.0008) [2023-12-28 08:30:32,427][106225] Updated weights for policy 1, policy_version 1847080 (0.0010) [2023-12-28 08:30:32,484][106225] Updated weights for policy 1, policy_version 1847090 (0.0010) [2023-12-28 08:30:32,541][106225] Updated weights for policy 1, policy_version 1847100 (0.0010) [2023-12-28 08:30:32,903][106226] Updated weights for policy 0, policy_version 1843084 (0.0008) [2023-12-28 08:30:32,963][106226] Updated weights for policy 0, policy_version 1843094 (0.0008) [2023-12-28 08:30:33,027][106226] Updated weights for policy 0, policy_version 1843104 (0.0008) [2023-12-28 08:30:33,269][106225] Updated weights for policy 1, policy_version 1847110 (0.0010) [2023-12-28 08:30:33,329][106225] Updated weights for policy 1, policy_version 1847120 (0.0010) [2023-12-28 08:30:33,382][106225] Updated weights for policy 1, policy_version 1847130 (0.0010) [2023-12-28 08:30:33,667][106226] Updated weights for policy 0, policy_version 1843114 (0.0008) [2023-12-28 08:30:33,720][106226] Updated weights for policy 0, policy_version 1843124 (0.0009) [2023-12-28 08:30:33,784][106226] Updated weights for policy 0, policy_version 1843134 (0.0007) [2023-12-28 08:30:33,844][106226] Updated weights for policy 0, policy_version 1843144 (0.0007) [2023-12-28 08:30:34,030][106225] Updated weights for policy 1, policy_version 1847140 (0.0010) [2023-12-28 08:30:34,091][106225] Updated weights for policy 1, policy_version 1847150 (0.0009) [2023-12-28 08:30:34,155][106225] Updated weights for policy 1, policy_version 1847160 (0.0008) [2023-12-28 08:30:34,502][106226] Updated weights for policy 0, policy_version 1843154 (0.0008) [2023-12-28 08:30:34,562][106226] Updated weights for policy 0, policy_version 1843164 (0.0009) [2023-12-28 08:30:34,626][106226] Updated weights for policy 0, policy_version 1843174 (0.0008) [2023-12-28 08:30:34,891][106225] Updated weights for policy 1, policy_version 1847170 (0.0006) [2023-12-28 08:30:34,958][106225] Updated weights for policy 1, policy_version 1847180 (0.0008) [2023-12-28 08:30:35,019][106225] Updated weights for policy 1, policy_version 1847190 (0.0010) [2023-12-28 08:30:35,070][106225] Updated weights for policy 1, policy_version 1847200 (0.0010) [2023-12-28 08:30:35,312][106226] Updated weights for policy 0, policy_version 1843184 (0.0008) [2023-12-28 08:30:35,373][106226] Updated weights for policy 0, policy_version 1843194 (0.0008) [2023-12-28 08:30:35,433][106226] Updated weights for policy 0, policy_version 1843204 (0.0007) [2023-12-28 08:30:35,773][106225] Updated weights for policy 1, policy_version 1847210 (0.0010) [2023-12-28 08:30:35,824][106225] Updated weights for policy 1, policy_version 1847220 (0.0010) [2023-12-28 08:30:35,880][106225] Updated weights for policy 1, policy_version 1847230 (0.0008) [2023-12-28 08:30:36,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 944889856. Throughput: 0: 9674.9, 1: 9831.6. Samples: 944900836. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:30:36,175][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.605')] [2023-12-28 08:30:36,248][106226] Updated weights for policy 0, policy_version 1843214 (0.0009) [2023-12-28 08:30:36,313][106226] Updated weights for policy 0, policy_version 1843224 (0.0009) [2023-12-28 08:30:36,373][106226] Updated weights for policy 0, policy_version 1843234 (0.0008) [2023-12-28 08:30:36,561][106225] Updated weights for policy 1, policy_version 1847240 (0.0008) [2023-12-28 08:30:36,619][106225] Updated weights for policy 1, policy_version 1847250 (0.0009) [2023-12-28 08:30:36,681][106225] Updated weights for policy 1, policy_version 1847260 (0.0009) [2023-12-28 08:30:37,130][106226] Updated weights for policy 0, policy_version 1843244 (0.0008) [2023-12-28 08:30:37,192][106226] Updated weights for policy 0, policy_version 1843254 (0.0007) [2023-12-28 08:30:37,243][106226] Updated weights for policy 0, policy_version 1843264 (0.0008) [2023-12-28 08:30:37,377][106225] Updated weights for policy 1, policy_version 1847270 (0.0010) [2023-12-28 08:30:37,434][106225] Updated weights for policy 1, policy_version 1847280 (0.0010) [2023-12-28 08:30:37,491][106225] Updated weights for policy 1, policy_version 1847290 (0.0010) [2023-12-28 08:30:37,968][106226] Updated weights for policy 0, policy_version 1843274 (0.0007) [2023-12-28 08:30:38,029][106226] Updated weights for policy 0, policy_version 1843284 (0.0007) [2023-12-28 08:30:38,085][106226] Updated weights for policy 0, policy_version 1843294 (0.0008) [2023-12-28 08:30:38,135][106226] Updated weights for policy 0, policy_version 1843304 (0.0009) [2023-12-28 08:30:38,154][106225] Updated weights for policy 1, policy_version 1847300 (0.0009) [2023-12-28 08:30:38,219][106225] Updated weights for policy 1, policy_version 1847310 (0.0008) [2023-12-28 08:30:38,284][106225] Updated weights for policy 1, policy_version 1847320 (0.0007) [2023-12-28 08:30:38,880][106226] Updated weights for policy 0, policy_version 1843314 (0.0009) [2023-12-28 08:30:38,945][106226] Updated weights for policy 0, policy_version 1843324 (0.0007) [2023-12-28 08:30:38,967][106225] Updated weights for policy 1, policy_version 1847330 (0.0006) [2023-12-28 08:30:39,007][106226] Updated weights for policy 0, policy_version 1843334 (0.0008) [2023-12-28 08:30:39,016][106225] Updated weights for policy 1, policy_version 1847340 (0.0007) [2023-12-28 08:30:39,063][106225] Updated weights for policy 1, policy_version 1847350 (0.0007) [2023-12-28 08:30:39,107][106225] Updated weights for policy 1, policy_version 1847360 (0.0008) [2023-12-28 08:30:39,738][106226] Updated weights for policy 0, policy_version 1843344 (0.0009) [2023-12-28 08:30:39,809][106226] Updated weights for policy 0, policy_version 1843354 (0.0009) [2023-12-28 08:30:39,878][106226] Updated weights for policy 0, policy_version 1843364 (0.0007) [2023-12-28 08:30:39,918][106225] Updated weights for policy 1, policy_version 1847370 (0.0007) [2023-12-28 08:30:39,983][106225] Updated weights for policy 1, policy_version 1847380 (0.0009) [2023-12-28 08:30:40,047][106225] Updated weights for policy 1, policy_version 1847390 (0.0008) [2023-12-28 08:30:40,537][106226] Updated weights for policy 0, policy_version 1843374 (0.0008) [2023-12-28 08:30:40,602][106226] Updated weights for policy 0, policy_version 1843384 (0.0008) [2023-12-28 08:30:40,664][106226] Updated weights for policy 0, policy_version 1843394 (0.0008) [2023-12-28 08:30:40,767][106225] Updated weights for policy 1, policy_version 1847400 (0.0010) [2023-12-28 08:30:40,828][106225] Updated weights for policy 1, policy_version 1847410 (0.0005) [2023-12-28 08:30:40,885][106225] Updated weights for policy 1, policy_version 1847420 (0.0007) [2023-12-28 08:30:41,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.2, 300 sec: 19688.6). Total num frames: 944988160. Throughput: 0: 9680.6, 1: 9853.2. Samples: 944958768. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:30:41,176][105115] Avg episode reward: [(0, '-4.595'), (1, '-4.713')] [2023-12-28 08:30:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001847424_472997888.pth... [2023-12-28 08:30:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001843400_471990272.pth... [2023-12-28 08:30:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001846272_472702976.pth [2023-12-28 08:30:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001842280_471703552.pth [2023-12-28 08:30:41,436][106226] Updated weights for policy 0, policy_version 1843404 (0.0007) [2023-12-28 08:30:41,488][106226] Updated weights for policy 0, policy_version 1843414 (0.0005) [2023-12-28 08:30:41,548][106226] Updated weights for policy 0, policy_version 1843424 (0.0008) [2023-12-28 08:30:41,604][106225] Updated weights for policy 1, policy_version 1847430 (0.0008) [2023-12-28 08:30:41,673][106225] Updated weights for policy 1, policy_version 1847440 (0.0008) [2023-12-28 08:30:41,735][106225] Updated weights for policy 1, policy_version 1847450 (0.0008) [2023-12-28 08:30:42,328][106226] Updated weights for policy 0, policy_version 1843434 (0.0008) [2023-12-28 08:30:42,393][106226] Updated weights for policy 0, policy_version 1843444 (0.0009) [2023-12-28 08:30:42,459][106226] Updated weights for policy 0, policy_version 1843454 (0.0009) [2023-12-28 08:30:42,487][106225] Updated weights for policy 1, policy_version 1847460 (0.0009) [2023-12-28 08:30:42,521][106226] Updated weights for policy 0, policy_version 1843464 (0.0006) [2023-12-28 08:30:42,546][106225] Updated weights for policy 1, policy_version 1847470 (0.0006) [2023-12-28 08:30:42,606][106225] Updated weights for policy 1, policy_version 1847480 (0.0008) [2023-12-28 08:30:43,211][106225] Updated weights for policy 1, policy_version 1847490 (0.0008) [2023-12-28 08:30:43,263][106225] Updated weights for policy 1, policy_version 1847500 (0.0006) [2023-12-28 08:30:43,267][106226] Updated weights for policy 0, policy_version 1843474 (0.0009) [2023-12-28 08:30:43,308][106225] Updated weights for policy 1, policy_version 1847510 (0.0006) [2023-12-28 08:30:43,318][106226] Updated weights for policy 0, policy_version 1843484 (0.0008) [2023-12-28 08:30:43,357][106225] Updated weights for policy 1, policy_version 1847520 (0.0005) [2023-12-28 08:30:43,367][106226] Updated weights for policy 0, policy_version 1843494 (0.0008) [2023-12-28 08:30:43,991][106225] Updated weights for policy 1, policy_version 1847530 (0.0005) [2023-12-28 08:30:44,046][106225] Updated weights for policy 1, policy_version 1847540 (0.0005) [2023-12-28 08:30:44,103][106225] Updated weights for policy 1, policy_version 1847550 (0.0005) [2023-12-28 08:30:44,173][106226] Updated weights for policy 0, policy_version 1843504 (0.0009) [2023-12-28 08:30:44,228][106226] Updated weights for policy 0, policy_version 1843514 (0.0008) [2023-12-28 08:30:44,274][106226] Updated weights for policy 0, policy_version 1843524 (0.0009) [2023-12-28 08:30:44,763][106225] Updated weights for policy 1, policy_version 1847560 (0.0006) [2023-12-28 08:30:44,837][106225] Updated weights for policy 1, policy_version 1847570 (0.0006) [2023-12-28 08:30:44,907][106225] Updated weights for policy 1, policy_version 1847580 (0.0007) [2023-12-28 08:30:45,078][106226] Updated weights for policy 0, policy_version 1843534 (0.0009) [2023-12-28 08:30:45,139][106226] Updated weights for policy 0, policy_version 1843544 (0.0009) [2023-12-28 08:30:45,206][106226] Updated weights for policy 0, policy_version 1843554 (0.0009) [2023-12-28 08:30:45,532][106225] Updated weights for policy 1, policy_version 1847590 (0.0008) [2023-12-28 08:30:45,599][106225] Updated weights for policy 1, policy_version 1847600 (0.0007) [2023-12-28 08:30:45,653][106225] Updated weights for policy 1, policy_version 1847610 (0.0008) [2023-12-28 08:30:45,930][106226] Updated weights for policy 0, policy_version 1843564 (0.0008) [2023-12-28 08:30:45,978][106226] Updated weights for policy 0, policy_version 1843574 (0.0008) [2023-12-28 08:30:46,030][106226] Updated weights for policy 0, policy_version 1843584 (0.0008) [2023-12-28 08:30:46,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 945086464. Throughput: 0: 9594.1, 1: 9870.3. Samples: 945073664. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:30:46,176][105115] Avg episode reward: [(0, '-4.239'), (1, '-4.806')] [2023-12-28 08:30:46,345][106225] Updated weights for policy 1, policy_version 1847620 (0.0007) [2023-12-28 08:30:46,403][106225] Updated weights for policy 1, policy_version 1847630 (0.0006) [2023-12-28 08:30:46,453][106225] Updated weights for policy 1, policy_version 1847640 (0.0008) [2023-12-28 08:30:46,722][106226] Updated weights for policy 0, policy_version 1843594 (0.0009) [2023-12-28 08:30:46,791][106226] Updated weights for policy 0, policy_version 1843604 (0.0010) [2023-12-28 08:30:46,840][106226] Updated weights for policy 0, policy_version 1843614 (0.0008) [2023-12-28 08:30:46,892][106226] Updated weights for policy 0, policy_version 1843624 (0.0008) [2023-12-28 08:30:47,166][106225] Updated weights for policy 1, policy_version 1847650 (0.0010) [2023-12-28 08:30:47,228][106225] Updated weights for policy 1, policy_version 1847660 (0.0009) [2023-12-28 08:30:47,291][106225] Updated weights for policy 1, policy_version 1847670 (0.0006) [2023-12-28 08:30:47,354][106225] Updated weights for policy 1, policy_version 1847680 (0.0005) [2023-12-28 08:30:47,586][106226] Updated weights for policy 0, policy_version 1843634 (0.0009) [2023-12-28 08:30:47,648][106226] Updated weights for policy 0, policy_version 1843644 (0.0010) [2023-12-28 08:30:47,714][106226] Updated weights for policy 0, policy_version 1843654 (0.0011) [2023-12-28 08:30:48,020][106225] Updated weights for policy 1, policy_version 1847690 (0.0009) [2023-12-28 08:30:48,070][106225] Updated weights for policy 1, policy_version 1847700 (0.0010) [2023-12-28 08:30:48,117][106225] Updated weights for policy 1, policy_version 1847710 (0.0010) [2023-12-28 08:30:48,323][106226] Updated weights for policy 0, policy_version 1843664 (0.0007) [2023-12-28 08:30:48,392][106226] Updated weights for policy 0, policy_version 1843674 (0.0008) [2023-12-28 08:30:48,443][106226] Updated weights for policy 0, policy_version 1843684 (0.0008) [2023-12-28 08:30:48,769][106225] Updated weights for policy 1, policy_version 1847720 (0.0010) [2023-12-28 08:30:48,830][106225] Updated weights for policy 1, policy_version 1847730 (0.0011) [2023-12-28 08:30:48,887][106225] Updated weights for policy 1, policy_version 1847740 (0.0010) [2023-12-28 08:30:49,171][106226] Updated weights for policy 0, policy_version 1843694 (0.0010) [2023-12-28 08:30:49,241][106226] Updated weights for policy 0, policy_version 1843704 (0.0010) [2023-12-28 08:30:49,305][106226] Updated weights for policy 0, policy_version 1843714 (0.0008) [2023-12-28 08:30:49,632][106225] Updated weights for policy 1, policy_version 1847750 (0.0009) [2023-12-28 08:30:49,680][106225] Updated weights for policy 1, policy_version 1847761 (0.0008) [2023-12-28 08:30:49,728][106225] Updated weights for policy 1, policy_version 1847771 (0.0008) [2023-12-28 08:30:49,951][106226] Updated weights for policy 0, policy_version 1843724 (0.0009) [2023-12-28 08:30:50,016][106226] Updated weights for policy 0, policy_version 1843734 (0.0008) [2023-12-28 08:30:50,071][106226] Updated weights for policy 0, policy_version 1843744 (0.0006) [2023-12-28 08:30:50,587][106225] Updated weights for policy 1, policy_version 1847781 (0.0008) [2023-12-28 08:30:50,657][106225] Updated weights for policy 1, policy_version 1847791 (0.0008) [2023-12-28 08:30:50,669][106226] Updated weights for policy 0, policy_version 1843754 (0.0006) [2023-12-28 08:30:50,718][106225] Updated weights for policy 1, policy_version 1847801 (0.0008) [2023-12-28 08:30:50,727][106226] Updated weights for policy 0, policy_version 1843764 (0.0007) [2023-12-28 08:30:50,786][106226] Updated weights for policy 0, policy_version 1843774 (0.0007) [2023-12-28 08:30:50,852][106226] Updated weights for policy 0, policy_version 1843784 (0.0009) [2023-12-28 08:30:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 945184768. Throughput: 0: 9601.3, 1: 9803.6. Samples: 945192660. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:30:51,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.389')] [2023-12-28 08:30:51,528][106225] Updated weights for policy 1, policy_version 1847811 (0.0008) [2023-12-28 08:30:51,553][106226] Updated weights for policy 0, policy_version 1843794 (0.0007) [2023-12-28 08:30:51,590][106225] Updated weights for policy 1, policy_version 1847821 (0.0006) [2023-12-28 08:30:51,632][106226] Updated weights for policy 0, policy_version 1843804 (0.0006) [2023-12-28 08:30:51,658][106225] Updated weights for policy 1, policy_version 1847831 (0.0007) [2023-12-28 08:30:51,693][106226] Updated weights for policy 0, policy_version 1843814 (0.0006) [2023-12-28 08:30:52,331][106226] Updated weights for policy 0, policy_version 1843824 (0.0008) [2023-12-28 08:30:52,400][106226] Updated weights for policy 0, policy_version 1843834 (0.0009) [2023-12-28 08:30:52,446][106225] Updated weights for policy 1, policy_version 1847841 (0.0008) [2023-12-28 08:30:52,461][106226] Updated weights for policy 0, policy_version 1843844 (0.0009) [2023-12-28 08:30:52,497][106225] Updated weights for policy 1, policy_version 1847851 (0.0007) [2023-12-28 08:30:52,555][106225] Updated weights for policy 1, policy_version 1847861 (0.0008) [2023-12-28 08:30:52,615][106225] Updated weights for policy 1, policy_version 1847871 (0.0007) [2023-12-28 08:30:53,189][106226] Updated weights for policy 0, policy_version 1843854 (0.0007) [2023-12-28 08:30:53,252][106226] Updated weights for policy 0, policy_version 1843864 (0.0009) [2023-12-28 08:30:53,314][106226] Updated weights for policy 0, policy_version 1843874 (0.0008) [2023-12-28 08:30:53,335][106225] Updated weights for policy 1, policy_version 1847881 (0.0006) [2023-12-28 08:30:53,392][106225] Updated weights for policy 1, policy_version 1847891 (0.0007) [2023-12-28 08:30:53,452][106225] Updated weights for policy 1, policy_version 1847901 (0.0008) [2023-12-28 08:30:53,909][106226] Updated weights for policy 0, policy_version 1843884 (0.0006) [2023-12-28 08:30:53,960][106226] Updated weights for policy 0, policy_version 1843894 (0.0006) [2023-12-28 08:30:54,009][106226] Updated weights for policy 0, policy_version 1843904 (0.0005) [2023-12-28 08:30:54,190][106225] Updated weights for policy 1, policy_version 1847911 (0.0007) [2023-12-28 08:30:54,248][106225] Updated weights for policy 1, policy_version 1847921 (0.0007) [2023-12-28 08:30:54,302][106225] Updated weights for policy 1, policy_version 1847931 (0.0005) [2023-12-28 08:30:54,636][106226] Updated weights for policy 0, policy_version 1843914 (0.0006) [2023-12-28 08:30:54,699][106226] Updated weights for policy 0, policy_version 1843924 (0.0008) [2023-12-28 08:30:54,759][106226] Updated weights for policy 0, policy_version 1843934 (0.0005) [2023-12-28 08:30:54,819][106226] Updated weights for policy 0, policy_version 1843944 (0.0006) [2023-12-28 08:30:55,025][106225] Updated weights for policy 1, policy_version 1847941 (0.0007) [2023-12-28 08:30:55,077][106225] Updated weights for policy 1, policy_version 1847951 (0.0008) [2023-12-28 08:30:55,130][106225] Updated weights for policy 1, policy_version 1847961 (0.0008) [2023-12-28 08:30:55,413][106226] Updated weights for policy 0, policy_version 1843954 (0.0009) [2023-12-28 08:30:55,467][106226] Updated weights for policy 0, policy_version 1843964 (0.0009) [2023-12-28 08:30:55,517][106226] Updated weights for policy 0, policy_version 1843974 (0.0009) [2023-12-28 08:30:55,897][106225] Updated weights for policy 1, policy_version 1847971 (0.0010) [2023-12-28 08:30:55,958][106225] Updated weights for policy 1, policy_version 1847981 (0.0008) [2023-12-28 08:30:56,015][106225] Updated weights for policy 1, policy_version 1847991 (0.0009) [2023-12-28 08:30:56,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 945283072. Throughput: 0: 9616.7, 1: 9759.1. Samples: 945250752. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:30:56,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.844')] [2023-12-28 08:30:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001848000_473145344.pth... [2023-12-28 08:30:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001846848_472850432.pth [2023-12-28 08:30:56,219][106226] Updated weights for policy 0, policy_version 1843984 (0.0006) [2023-12-28 08:30:56,277][106226] Updated weights for policy 0, policy_version 1843994 (0.0005) [2023-12-28 08:30:56,343][106226] Updated weights for policy 0, policy_version 1844004 (0.0009) [2023-12-28 08:30:56,367][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001844008_472145920.pth... [2023-12-28 08:30:56,372][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001842856_471851008.pth [2023-12-28 08:30:56,805][106225] Updated weights for policy 1, policy_version 1848001 (0.0007) [2023-12-28 08:30:56,854][106225] Updated weights for policy 1, policy_version 1848011 (0.0005) [2023-12-28 08:30:56,911][106225] Updated weights for policy 1, policy_version 1848021 (0.0008) [2023-12-28 08:30:56,945][106226] Updated weights for policy 0, policy_version 1844014 (0.0007) [2023-12-28 08:30:56,973][106225] Updated weights for policy 1, policy_version 1848031 (0.0007) [2023-12-28 08:30:57,007][106226] Updated weights for policy 0, policy_version 1844024 (0.0007) [2023-12-28 08:30:57,061][106226] Updated weights for policy 0, policy_version 1844034 (0.0008) [2023-12-28 08:30:57,652][106226] Updated weights for policy 0, policy_version 1844044 (0.0007) [2023-12-28 08:30:57,673][106225] Updated weights for policy 1, policy_version 1848041 (0.0008) [2023-12-28 08:30:57,706][106226] Updated weights for policy 0, policy_version 1844054 (0.0007) [2023-12-28 08:30:57,730][106225] Updated weights for policy 1, policy_version 1848051 (0.0006) [2023-12-28 08:30:57,767][106226] Updated weights for policy 0, policy_version 1844064 (0.0006) [2023-12-28 08:30:57,788][106225] Updated weights for policy 1, policy_version 1848061 (0.0009) [2023-12-28 08:30:58,422][106226] Updated weights for policy 0, policy_version 1844074 (0.0006) [2023-12-28 08:30:58,430][106225] Updated weights for policy 1, policy_version 1848071 (0.0007) [2023-12-28 08:30:58,489][106226] Updated weights for policy 0, policy_version 1844084 (0.0009) [2023-12-28 08:30:58,498][106225] Updated weights for policy 1, policy_version 1848081 (0.0006) [2023-12-28 08:30:58,557][106226] Updated weights for policy 0, policy_version 1844094 (0.0008) [2023-12-28 08:30:58,563][106225] Updated weights for policy 1, policy_version 1848091 (0.0007) [2023-12-28 08:30:58,623][106226] Updated weights for policy 0, policy_version 1844104 (0.0008) [2023-12-28 08:30:59,310][106225] Updated weights for policy 1, policy_version 1848101 (0.0008) [2023-12-28 08:30:59,376][106225] Updated weights for policy 1, policy_version 1848111 (0.0009) [2023-12-28 08:30:59,426][106226] Updated weights for policy 0, policy_version 1844114 (0.0007) [2023-12-28 08:30:59,437][106225] Updated weights for policy 1, policy_version 1848121 (0.0008) [2023-12-28 08:30:59,489][106226] Updated weights for policy 0, policy_version 1844124 (0.0005) [2023-12-28 08:30:59,550][106226] Updated weights for policy 0, policy_version 1844134 (0.0007) [2023-12-28 08:31:00,115][106225] Updated weights for policy 1, policy_version 1848131 (0.0009) [2023-12-28 08:31:00,172][106225] Updated weights for policy 1, policy_version 1848141 (0.0008) [2023-12-28 08:31:00,217][106225] Updated weights for policy 1, policy_version 1848151 (0.0008) [2023-12-28 08:31:00,292][106226] Updated weights for policy 0, policy_version 1844144 (0.0008) [2023-12-28 08:31:00,347][106226] Updated weights for policy 0, policy_version 1844154 (0.0008) [2023-12-28 08:31:00,407][106226] Updated weights for policy 0, policy_version 1844164 (0.0008) [2023-12-28 08:31:00,941][106225] Updated weights for policy 1, policy_version 1848161 (0.0008) [2023-12-28 08:31:00,983][106225] Updated weights for policy 1, policy_version 1848171 (0.0008) [2023-12-28 08:31:01,037][106225] Updated weights for policy 1, policy_version 1848181 (0.0008) [2023-12-28 08:31:01,099][106225] Updated weights for policy 1, policy_version 1848191 (0.0008) [2023-12-28 08:31:01,146][106226] Updated weights for policy 0, policy_version 1844174 (0.0007) [2023-12-28 08:31:01,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 945381376. Throughput: 0: 9720.4, 1: 9756.2. Samples: 945370752. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:01,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-4.890')] [2023-12-28 08:31:01,211][106226] Updated weights for policy 0, policy_version 1844184 (0.0007) [2023-12-28 08:31:01,269][106226] Updated weights for policy 0, policy_version 1844194 (0.0009) [2023-12-28 08:31:01,918][106225] Updated weights for policy 1, policy_version 1848201 (0.0008) [2023-12-28 08:31:01,972][106225] Updated weights for policy 1, policy_version 1848211 (0.0008) [2023-12-28 08:31:02,020][106226] Updated weights for policy 0, policy_version 1844204 (0.0010) [2023-12-28 08:31:02,025][106225] Updated weights for policy 1, policy_version 1848221 (0.0009) [2023-12-28 08:31:02,078][106226] Updated weights for policy 0, policy_version 1844214 (0.0010) [2023-12-28 08:31:02,139][106226] Updated weights for policy 0, policy_version 1844224 (0.0011) [2023-12-28 08:31:02,749][106225] Updated weights for policy 1, policy_version 1848231 (0.0008) [2023-12-28 08:31:02,810][106225] Updated weights for policy 1, policy_version 1848241 (0.0006) [2023-12-28 08:31:02,857][106226] Updated weights for policy 0, policy_version 1844234 (0.0009) [2023-12-28 08:31:02,873][106225] Updated weights for policy 1, policy_version 1848251 (0.0008) [2023-12-28 08:31:02,921][106226] Updated weights for policy 0, policy_version 1844244 (0.0007) [2023-12-28 08:31:02,986][106226] Updated weights for policy 0, policy_version 1844254 (0.0008) [2023-12-28 08:31:03,050][106226] Updated weights for policy 0, policy_version 1844264 (0.0008) [2023-12-28 08:31:03,473][106225] Updated weights for policy 1, policy_version 1848261 (0.0005) [2023-12-28 08:31:03,522][106225] Updated weights for policy 1, policy_version 1848271 (0.0005) [2023-12-28 08:31:03,571][106225] Updated weights for policy 1, policy_version 1848281 (0.0005) [2023-12-28 08:31:03,808][106226] Updated weights for policy 0, policy_version 1844274 (0.0008) [2023-12-28 08:31:03,869][106226] Updated weights for policy 0, policy_version 1844284 (0.0007) [2023-12-28 08:31:03,932][106226] Updated weights for policy 0, policy_version 1844294 (0.0007) [2023-12-28 08:31:04,273][106225] Updated weights for policy 1, policy_version 1848291 (0.0008) [2023-12-28 08:31:04,339][106225] Updated weights for policy 1, policy_version 1848301 (0.0006) [2023-12-28 08:31:04,406][106225] Updated weights for policy 1, policy_version 1848311 (0.0007) [2023-12-28 08:31:04,649][106226] Updated weights for policy 0, policy_version 1844304 (0.0008) [2023-12-28 08:31:04,699][106226] Updated weights for policy 0, policy_version 1844314 (0.0008) [2023-12-28 08:31:04,761][106226] Updated weights for policy 0, policy_version 1844324 (0.0009) [2023-12-28 08:31:04,973][106225] Updated weights for policy 1, policy_version 1848321 (0.0008) [2023-12-28 08:31:05,029][106225] Updated weights for policy 1, policy_version 1848331 (0.0011) [2023-12-28 08:31:05,079][106225] Updated weights for policy 1, policy_version 1848341 (0.0010) [2023-12-28 08:31:05,133][106225] Updated weights for policy 1, policy_version 1848351 (0.0010) [2023-12-28 08:31:05,518][106226] Updated weights for policy 0, policy_version 1844334 (0.0010) [2023-12-28 08:31:05,578][106226] Updated weights for policy 0, policy_version 1844344 (0.0010) [2023-12-28 08:31:05,629][106226] Updated weights for policy 0, policy_version 1844354 (0.0010) [2023-12-28 08:31:05,865][106225] Updated weights for policy 1, policy_version 1848361 (0.0006) [2023-12-28 08:31:05,919][106225] Updated weights for policy 1, policy_version 1848371 (0.0005) [2023-12-28 08:31:05,965][106225] Updated weights for policy 1, policy_version 1848381 (0.0006) [2023-12-28 08:31:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 945479680. Throughput: 0: 9763.6, 1: 9827.6. Samples: 945488524. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:06,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.637')] [2023-12-28 08:31:06,279][106226] Updated weights for policy 0, policy_version 1844364 (0.0009) [2023-12-28 08:31:06,336][106226] Updated weights for policy 0, policy_version 1844374 (0.0008) [2023-12-28 08:31:06,390][106226] Updated weights for policy 0, policy_version 1844384 (0.0007) [2023-12-28 08:31:06,601][106225] Updated weights for policy 1, policy_version 1848391 (0.0008) [2023-12-28 08:31:06,657][106225] Updated weights for policy 1, policy_version 1848401 (0.0009) [2023-12-28 08:31:06,717][106225] Updated weights for policy 1, policy_version 1848411 (0.0008) [2023-12-28 08:31:07,080][106226] Updated weights for policy 0, policy_version 1844394 (0.0007) [2023-12-28 08:31:07,138][106226] Updated weights for policy 0, policy_version 1844404 (0.0009) [2023-12-28 08:31:07,204][106226] Updated weights for policy 0, policy_version 1844414 (0.0007) [2023-12-28 08:31:07,269][106226] Updated weights for policy 0, policy_version 1844424 (0.0011) [2023-12-28 08:31:07,522][106225] Updated weights for policy 1, policy_version 1848421 (0.0007) [2023-12-28 08:31:07,573][106225] Updated weights for policy 1, policy_version 1848431 (0.0007) [2023-12-28 08:31:07,639][106225] Updated weights for policy 1, policy_version 1848441 (0.0009) [2023-12-28 08:31:07,831][106226] Updated weights for policy 0, policy_version 1844434 (0.0005) [2023-12-28 08:31:07,892][106226] Updated weights for policy 0, policy_version 1844444 (0.0005) [2023-12-28 08:31:07,940][106226] Updated weights for policy 0, policy_version 1844454 (0.0005) [2023-12-28 08:31:08,384][106225] Updated weights for policy 1, policy_version 1848451 (0.0008) [2023-12-28 08:31:08,453][106225] Updated weights for policy 1, policy_version 1848461 (0.0007) [2023-12-28 08:31:08,512][106225] Updated weights for policy 1, policy_version 1848471 (0.0008) [2023-12-28 08:31:08,613][106226] Updated weights for policy 0, policy_version 1844464 (0.0009) [2023-12-28 08:31:08,667][106226] Updated weights for policy 0, policy_version 1844474 (0.0010) [2023-12-28 08:31:08,717][106226] Updated weights for policy 0, policy_version 1844484 (0.0010) [2023-12-28 08:31:09,250][106225] Updated weights for policy 1, policy_version 1848481 (0.0008) [2023-12-28 08:31:09,314][106225] Updated weights for policy 1, policy_version 1848491 (0.0007) [2023-12-28 08:31:09,383][106225] Updated weights for policy 1, policy_version 1848501 (0.0008) [2023-12-28 08:31:09,445][106226] Updated weights for policy 0, policy_version 1844494 (0.0009) [2023-12-28 08:31:09,451][106225] Updated weights for policy 1, policy_version 1848511 (0.0008) [2023-12-28 08:31:09,503][106226] Updated weights for policy 0, policy_version 1844504 (0.0008) [2023-12-28 08:31:09,562][106226] Updated weights for policy 0, policy_version 1844514 (0.0008) [2023-12-28 08:31:10,223][106225] Updated weights for policy 1, policy_version 1848521 (0.0008) [2023-12-28 08:31:10,277][106226] Updated weights for policy 0, policy_version 1844524 (0.0007) [2023-12-28 08:31:10,283][106225] Updated weights for policy 1, policy_version 1848531 (0.0008) [2023-12-28 08:31:10,339][106226] Updated weights for policy 0, policy_version 1844534 (0.0009) [2023-12-28 08:31:10,342][106225] Updated weights for policy 1, policy_version 1848541 (0.0007) [2023-12-28 08:31:10,404][106226] Updated weights for policy 0, policy_version 1844544 (0.0008) [2023-12-28 08:31:11,118][106225] Updated weights for policy 1, policy_version 1848551 (0.0009) [2023-12-28 08:31:11,169][106226] Updated weights for policy 0, policy_version 1844554 (0.0008) [2023-12-28 08:31:11,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 945569792. Throughput: 0: 9870.0, 1: 9866.3. Samples: 945548692. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:11,175][105115] Avg episode reward: [(0, '-4.317'), (1, '-4.616')] [2023-12-28 08:31:11,185][106225] Updated weights for policy 1, policy_version 1848561 (0.0008) [2023-12-28 08:31:11,234][106226] Updated weights for policy 0, policy_version 1844564 (0.0006) [2023-12-28 08:31:11,247][106225] Updated weights for policy 1, policy_version 1848571 (0.0009) [2023-12-28 08:31:11,280][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001848576_473292800.pth... [2023-12-28 08:31:11,284][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001847424_472997888.pth [2023-12-28 08:31:11,302][106226] Updated weights for policy 0, policy_version 1844574 (0.0008) [2023-12-28 08:31:11,365][106226] Updated weights for policy 0, policy_version 1844584 (0.0008) [2023-12-28 08:31:11,365][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001844584_472293376.pth... [2023-12-28 08:31:11,371][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001843400_471990272.pth [2023-12-28 08:31:12,002][106225] Updated weights for policy 1, policy_version 1848581 (0.0008) [2023-12-28 08:31:12,063][106225] Updated weights for policy 1, policy_version 1848591 (0.0007) [2023-12-28 08:31:12,069][106226] Updated weights for policy 0, policy_version 1844594 (0.0006) [2023-12-28 08:31:12,127][106226] Updated weights for policy 0, policy_version 1844604 (0.0006) [2023-12-28 08:31:12,128][106225] Updated weights for policy 1, policy_version 1848601 (0.0008) [2023-12-28 08:31:12,182][106226] Updated weights for policy 0, policy_version 1844614 (0.0006) [2023-12-28 08:31:12,847][106226] Updated weights for policy 0, policy_version 1844624 (0.0006) [2023-12-28 08:31:12,902][106226] Updated weights for policy 0, policy_version 1844634 (0.0007) [2023-12-28 08:31:12,911][106225] Updated weights for policy 1, policy_version 1848611 (0.0008) [2023-12-28 08:31:12,952][106226] Updated weights for policy 0, policy_version 1844644 (0.0005) [2023-12-28 08:31:12,968][106225] Updated weights for policy 1, policy_version 1848621 (0.0007) [2023-12-28 08:31:13,034][106225] Updated weights for policy 1, policy_version 1848631 (0.0010) [2023-12-28 08:31:13,521][106226] Updated weights for policy 0, policy_version 1844654 (0.0005) [2023-12-28 08:31:13,596][106226] Updated weights for policy 0, policy_version 1844664 (0.0006) [2023-12-28 08:31:13,664][106226] Updated weights for policy 0, policy_version 1844674 (0.0006) [2023-12-28 08:31:13,739][106225] Updated weights for policy 1, policy_version 1848641 (0.0008) [2023-12-28 08:31:13,793][106225] Updated weights for policy 1, policy_version 1848651 (0.0010) [2023-12-28 08:31:13,851][106225] Updated weights for policy 1, policy_version 1848661 (0.0010) [2023-12-28 08:31:13,904][106225] Updated weights for policy 1, policy_version 1848671 (0.0009) [2023-12-28 08:31:14,197][106226] Updated weights for policy 0, policy_version 1844684 (0.0007) [2023-12-28 08:31:14,250][106226] Updated weights for policy 0, policy_version 1844694 (0.0007) [2023-12-28 08:31:14,305][106226] Updated weights for policy 0, policy_version 1844704 (0.0009) [2023-12-28 08:31:14,522][106225] Updated weights for policy 1, policy_version 1848681 (0.0006) [2023-12-28 08:31:14,574][106225] Updated weights for policy 1, policy_version 1848691 (0.0005) [2023-12-28 08:31:14,635][106225] Updated weights for policy 1, policy_version 1848701 (0.0006) [2023-12-28 08:31:15,032][106226] Updated weights for policy 0, policy_version 1844714 (0.0009) [2023-12-28 08:31:15,086][106226] Updated weights for policy 0, policy_version 1844724 (0.0009) [2023-12-28 08:31:15,150][106226] Updated weights for policy 0, policy_version 1844734 (0.0009) [2023-12-28 08:31:15,206][106226] Updated weights for policy 0, policy_version 1844744 (0.0008) [2023-12-28 08:31:15,297][106225] Updated weights for policy 1, policy_version 1848711 (0.0007) [2023-12-28 08:31:15,355][106225] Updated weights for policy 1, policy_version 1848721 (0.0008) [2023-12-28 08:31:15,409][106225] Updated weights for policy 1, policy_version 1848731 (0.0009) [2023-12-28 08:31:15,848][106226] Updated weights for policy 0, policy_version 1844754 (0.0007) [2023-12-28 08:31:15,900][106226] Updated weights for policy 0, policy_version 1844764 (0.0008) [2023-12-28 08:31:15,969][106226] Updated weights for policy 0, policy_version 1844774 (0.0006) [2023-12-28 08:31:16,172][106225] Updated weights for policy 1, policy_version 1848741 (0.0008) [2023-12-28 08:31:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19660.8). Total num frames: 945676288. Throughput: 0: 9881.2, 1: 9749.0. Samples: 945666600. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:16,176][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.759')] [2023-12-28 08:31:16,219][106225] Updated weights for policy 1, policy_version 1848751 (0.0010) [2023-12-28 08:31:16,270][106225] Updated weights for policy 1, policy_version 1848761 (0.0010) [2023-12-28 08:31:16,686][106226] Updated weights for policy 0, policy_version 1844784 (0.0007) [2023-12-28 08:31:16,743][106226] Updated weights for policy 0, policy_version 1844794 (0.0009) [2023-12-28 08:31:16,800][106226] Updated weights for policy 0, policy_version 1844804 (0.0009) [2023-12-28 08:31:17,004][106225] Updated weights for policy 1, policy_version 1848771 (0.0010) [2023-12-28 08:31:17,055][106225] Updated weights for policy 1, policy_version 1848781 (0.0005) [2023-12-28 08:31:17,107][106225] Updated weights for policy 1, policy_version 1848791 (0.0005) [2023-12-28 08:31:17,534][106226] Updated weights for policy 0, policy_version 1844814 (0.0009) [2023-12-28 08:31:17,586][106226] Updated weights for policy 0, policy_version 1844824 (0.0008) [2023-12-28 08:31:17,632][106226] Updated weights for policy 0, policy_version 1844834 (0.0006) [2023-12-28 08:31:17,775][106225] Updated weights for policy 1, policy_version 1848801 (0.0006) [2023-12-28 08:31:17,835][106225] Updated weights for policy 1, policy_version 1848811 (0.0009) [2023-12-28 08:31:17,885][106225] Updated weights for policy 1, policy_version 1848821 (0.0008) [2023-12-28 08:31:17,929][106225] Updated weights for policy 1, policy_version 1848831 (0.0008) [2023-12-28 08:31:18,299][106226] Updated weights for policy 0, policy_version 1844844 (0.0009) [2023-12-28 08:31:18,380][106226] Updated weights for policy 0, policy_version 1844854 (0.0011) [2023-12-28 08:31:18,444][106226] Updated weights for policy 0, policy_version 1844864 (0.0011) [2023-12-28 08:31:18,661][106225] Updated weights for policy 1, policy_version 1848841 (0.0007) [2023-12-28 08:31:18,722][106225] Updated weights for policy 1, policy_version 1848851 (0.0008) [2023-12-28 08:31:18,770][106225] Updated weights for policy 1, policy_version 1848861 (0.0008) [2023-12-28 08:31:19,120][106226] Updated weights for policy 0, policy_version 1844874 (0.0010) [2023-12-28 08:31:19,175][106226] Updated weights for policy 0, policy_version 1844884 (0.0005) [2023-12-28 08:31:19,237][106226] Updated weights for policy 0, policy_version 1844894 (0.0006) [2023-12-28 08:31:19,301][106226] Updated weights for policy 0, policy_version 1844904 (0.0006) [2023-12-28 08:31:19,469][106225] Updated weights for policy 1, policy_version 1848871 (0.0008) [2023-12-28 08:31:19,535][106225] Updated weights for policy 1, policy_version 1848881 (0.0008) [2023-12-28 08:31:19,605][106225] Updated weights for policy 1, policy_version 1848891 (0.0007) [2023-12-28 08:31:19,992][106226] Updated weights for policy 0, policy_version 1844914 (0.0009) [2023-12-28 08:31:20,050][106226] Updated weights for policy 0, policy_version 1844924 (0.0009) [2023-12-28 08:31:20,106][106226] Updated weights for policy 0, policy_version 1844934 (0.0008) [2023-12-28 08:31:20,115][106140] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000002 [2023-12-28 08:31:20,260][106225] Updated weights for policy 1, policy_version 1848901 (0.0008) [2023-12-28 08:31:20,328][106225] Updated weights for policy 1, policy_version 1848911 (0.0009) [2023-12-28 08:31:20,401][106225] Updated weights for policy 1, policy_version 1848921 (0.0008) [2023-12-28 08:31:20,839][106226] Updated weights for policy 0, policy_version 1844944 (0.0006) [2023-12-28 08:31:20,905][106226] Updated weights for policy 0, policy_version 1844954 (0.0006) [2023-12-28 08:31:20,971][106226] Updated weights for policy 0, policy_version 1844964 (0.0011) [2023-12-28 08:31:21,171][106225] Updated weights for policy 1, policy_version 1848931 (0.0007) [2023-12-28 08:31:21,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.3, 300 sec: 19660.8). Total num frames: 945774592. Throughput: 0: 9907.7, 1: 9737.8. Samples: 945784880. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:21,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.981')] [2023-12-28 08:31:21,234][106225] Updated weights for policy 1, policy_version 1848941 (0.0008) [2023-12-28 08:31:21,321][106225] Updated weights for policy 1, policy_version 1848951 (0.0008) [2023-12-28 08:31:21,740][106226] Updated weights for policy 0, policy_version 1844974 (0.0009) [2023-12-28 08:31:21,806][106226] Updated weights for policy 0, policy_version 1844984 (0.0010) [2023-12-28 08:31:21,868][106226] Updated weights for policy 0, policy_version 1844994 (0.0009) [2023-12-28 08:31:22,037][106225] Updated weights for policy 1, policy_version 1848961 (0.0008) [2023-12-28 08:31:22,096][106225] Updated weights for policy 1, policy_version 1848971 (0.0009) [2023-12-28 08:31:22,155][106225] Updated weights for policy 1, policy_version 1848981 (0.0010) [2023-12-28 08:31:22,217][106225] Updated weights for policy 1, policy_version 1848991 (0.0009) [2023-12-28 08:31:22,573][106226] Updated weights for policy 0, policy_version 1845004 (0.0008) [2023-12-28 08:31:22,635][106226] Updated weights for policy 0, policy_version 1845014 (0.0009) [2023-12-28 08:31:22,693][106226] Updated weights for policy 0, policy_version 1845024 (0.0009) [2023-12-28 08:31:22,966][106225] Updated weights for policy 1, policy_version 1849001 (0.0009) [2023-12-28 08:31:23,030][106225] Updated weights for policy 1, policy_version 1849011 (0.0008) [2023-12-28 08:31:23,088][106225] Updated weights for policy 1, policy_version 1849021 (0.0008) [2023-12-28 08:31:23,431][106226] Updated weights for policy 0, policy_version 1845034 (0.0009) [2023-12-28 08:31:23,482][106226] Updated weights for policy 0, policy_version 1845044 (0.0005) [2023-12-28 08:31:23,532][106226] Updated weights for policy 0, policy_version 1845054 (0.0006) [2023-12-28 08:31:23,586][106226] Updated weights for policy 0, policy_version 1845064 (0.0006) [2023-12-28 08:31:23,873][106225] Updated weights for policy 1, policy_version 1849031 (0.0009) [2023-12-28 08:31:23,921][106225] Updated weights for policy 1, policy_version 1849041 (0.0008) [2023-12-28 08:31:23,986][106225] Updated weights for policy 1, policy_version 1849051 (0.0006) [2023-12-28 08:31:24,187][106226] Updated weights for policy 0, policy_version 1845074 (0.0011) [2023-12-28 08:31:24,252][106226] Updated weights for policy 0, policy_version 1845084 (0.0011) [2023-12-28 08:31:24,308][106226] Updated weights for policy 0, policy_version 1845094 (0.0010) [2023-12-28 08:31:24,684][106225] Updated weights for policy 1, policy_version 1849061 (0.0007) [2023-12-28 08:31:24,740][106225] Updated weights for policy 1, policy_version 1849071 (0.0008) [2023-12-28 08:31:24,788][106225] Updated weights for policy 1, policy_version 1849081 (0.0007) [2023-12-28 08:31:25,010][106226] Updated weights for policy 0, policy_version 1845104 (0.0011) [2023-12-28 08:31:25,062][106226] Updated weights for policy 0, policy_version 1845114 (0.0010) [2023-12-28 08:31:25,119][106226] Updated weights for policy 0, policy_version 1845124 (0.0010) [2023-12-28 08:31:25,449][106225] Updated weights for policy 1, policy_version 1849091 (0.0006) [2023-12-28 08:31:25,495][106225] Updated weights for policy 1, policy_version 1849101 (0.0005) [2023-12-28 08:31:25,542][106225] Updated weights for policy 1, policy_version 1849111 (0.0007) [2023-12-28 08:31:25,853][106226] Updated weights for policy 0, policy_version 1845134 (0.0011) [2023-12-28 08:31:25,913][106226] Updated weights for policy 0, policy_version 1845144 (0.0010) [2023-12-28 08:31:25,978][106226] Updated weights for policy 0, policy_version 1845154 (0.0011) [2023-12-28 08:31:26,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 945872896. Throughput: 0: 9943.2, 1: 9679.8. Samples: 945841796. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:26,175][105115] Avg episode reward: [(0, '-4.547'), (1, '-4.473')] [2023-12-28 08:31:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001849120_473432064.pth... [2023-12-28 08:31:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001845160_472440832.pth... [2023-12-28 08:31:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001848000_473145344.pth [2023-12-28 08:31:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001844008_472145920.pth [2023-12-28 08:31:26,251][106225] Updated weights for policy 1, policy_version 1849121 (0.0010) [2023-12-28 08:31:26,316][106225] Updated weights for policy 1, policy_version 1849131 (0.0011) [2023-12-28 08:31:26,373][106225] Updated weights for policy 1, policy_version 1849141 (0.0010) [2023-12-28 08:31:26,434][106225] Updated weights for policy 1, policy_version 1849151 (0.0010) [2023-12-28 08:31:26,670][106226] Updated weights for policy 0, policy_version 1845164 (0.0009) [2023-12-28 08:31:26,728][106226] Updated weights for policy 0, policy_version 1845174 (0.0007) [2023-12-28 08:31:26,785][106226] Updated weights for policy 0, policy_version 1845184 (0.0008) [2023-12-28 08:31:27,082][106225] Updated weights for policy 1, policy_version 1849161 (0.0006) [2023-12-28 08:31:27,145][106225] Updated weights for policy 1, policy_version 1849171 (0.0005) [2023-12-28 08:31:27,200][106225] Updated weights for policy 1, policy_version 1849181 (0.0006) [2023-12-28 08:31:27,492][106226] Updated weights for policy 0, policy_version 1845194 (0.0009) [2023-12-28 08:31:27,543][106226] Updated weights for policy 0, policy_version 1845204 (0.0009) [2023-12-28 08:31:27,590][106226] Updated weights for policy 0, policy_version 1845214 (0.0008) [2023-12-28 08:31:27,635][106226] Updated weights for policy 0, policy_version 1845224 (0.0009) [2023-12-28 08:31:27,766][106225] Updated weights for policy 1, policy_version 1849191 (0.0009) [2023-12-28 08:31:27,813][106225] Updated weights for policy 1, policy_version 1849201 (0.0009) [2023-12-28 08:31:27,868][106225] Updated weights for policy 1, policy_version 1849211 (0.0006) [2023-12-28 08:31:28,389][106226] Updated weights for policy 0, policy_version 1845234 (0.0010) [2023-12-28 08:31:28,445][106226] Updated weights for policy 0, policy_version 1845244 (0.0008) [2023-12-28 08:31:28,496][106226] Updated weights for policy 0, policy_version 1845254 (0.0009) [2023-12-28 08:31:28,586][106225] Updated weights for policy 1, policy_version 1849221 (0.0007) [2023-12-28 08:31:28,646][106225] Updated weights for policy 1, policy_version 1849231 (0.0005) [2023-12-28 08:31:28,711][106225] Updated weights for policy 1, policy_version 1849241 (0.0008) [2023-12-28 08:31:29,204][106226] Updated weights for policy 0, policy_version 1845264 (0.0006) [2023-12-28 08:31:29,272][106226] Updated weights for policy 0, policy_version 1845274 (0.0008) [2023-12-28 08:31:29,334][106226] Updated weights for policy 0, policy_version 1845284 (0.0008) [2023-12-28 08:31:29,341][106225] Updated weights for policy 1, policy_version 1849251 (0.0008) [2023-12-28 08:31:29,401][106225] Updated weights for policy 1, policy_version 1849261 (0.0007) [2023-12-28 08:31:29,449][106225] Updated weights for policy 1, policy_version 1849271 (0.0008) [2023-12-28 08:31:30,005][106226] Updated weights for policy 0, policy_version 1845294 (0.0008) [2023-12-28 08:31:30,058][106226] Updated weights for policy 0, policy_version 1845304 (0.0008) [2023-12-28 08:31:30,117][106226] Updated weights for policy 0, policy_version 1845314 (0.0008) [2023-12-28 08:31:30,212][106225] Updated weights for policy 1, policy_version 1849281 (0.0008) [2023-12-28 08:31:30,273][106225] Updated weights for policy 1, policy_version 1849291 (0.0008) [2023-12-28 08:31:30,330][106225] Updated weights for policy 1, policy_version 1849301 (0.0010) [2023-12-28 08:31:30,397][106225] Updated weights for policy 1, policy_version 1849311 (0.0008) [2023-12-28 08:31:30,797][106226] Updated weights for policy 0, policy_version 1845324 (0.0008) [2023-12-28 08:31:30,850][106226] Updated weights for policy 0, policy_version 1845334 (0.0008) [2023-12-28 08:31:30,909][106226] Updated weights for policy 0, policy_version 1845344 (0.0007) [2023-12-28 08:31:31,069][106225] Updated weights for policy 1, policy_version 1849321 (0.0008) [2023-12-28 08:31:31,133][106225] Updated weights for policy 1, policy_version 1849331 (0.0008) [2023-12-28 08:31:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 945971200. Throughput: 0: 10019.8, 1: 9723.8. Samples: 945962120. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:31,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.912')] [2023-12-28 08:31:31,191][106225] Updated weights for policy 1, policy_version 1849341 (0.0008) [2023-12-28 08:31:31,677][106226] Updated weights for policy 0, policy_version 1845354 (0.0009) [2023-12-28 08:31:31,750][106226] Updated weights for policy 0, policy_version 1845364 (0.0007) [2023-12-28 08:31:31,813][106226] Updated weights for policy 0, policy_version 1845374 (0.0005) [2023-12-28 08:31:31,877][106226] Updated weights for policy 0, policy_version 1845384 (0.0005) [2023-12-28 08:31:31,946][106225] Updated weights for policy 1, policy_version 1849351 (0.0008) [2023-12-28 08:31:32,008][106225] Updated weights for policy 1, policy_version 1849361 (0.0008) [2023-12-28 08:31:32,073][106225] Updated weights for policy 1, policy_version 1849371 (0.0009) [2023-12-28 08:31:32,499][106226] Updated weights for policy 0, policy_version 1845394 (0.0011) [2023-12-28 08:31:32,563][106226] Updated weights for policy 0, policy_version 1845404 (0.0011) [2023-12-28 08:31:32,627][106226] Updated weights for policy 0, policy_version 1845414 (0.0008) [2023-12-28 08:31:32,816][106225] Updated weights for policy 1, policy_version 1849381 (0.0008) [2023-12-28 08:31:32,877][106225] Updated weights for policy 1, policy_version 1849391 (0.0009) [2023-12-28 08:31:32,931][106225] Updated weights for policy 1, policy_version 1849401 (0.0008) [2023-12-28 08:31:33,233][106226] Updated weights for policy 0, policy_version 1845424 (0.0006) [2023-12-28 08:31:33,294][106226] Updated weights for policy 0, policy_version 1845434 (0.0008) [2023-12-28 08:31:33,361][106226] Updated weights for policy 0, policy_version 1845444 (0.0008) [2023-12-28 08:31:33,574][106225] Updated weights for policy 1, policy_version 1849411 (0.0009) [2023-12-28 08:31:33,624][106225] Updated weights for policy 1, policy_version 1849421 (0.0005) [2023-12-28 08:31:33,670][106225] Updated weights for policy 1, policy_version 1849431 (0.0005) [2023-12-28 08:31:34,071][106226] Updated weights for policy 0, policy_version 1845454 (0.0008) [2023-12-28 08:31:34,127][106226] Updated weights for policy 0, policy_version 1845464 (0.0008) [2023-12-28 08:31:34,188][106226] Updated weights for policy 0, policy_version 1845474 (0.0009) [2023-12-28 08:31:34,324][106225] Updated weights for policy 1, policy_version 1849441 (0.0005) [2023-12-28 08:31:34,389][106225] Updated weights for policy 1, policy_version 1849451 (0.0009) [2023-12-28 08:31:34,455][106225] Updated weights for policy 1, policy_version 1849461 (0.0009) [2023-12-28 08:31:34,519][106225] Updated weights for policy 1, policy_version 1849471 (0.0009) [2023-12-28 08:31:34,879][106226] Updated weights for policy 0, policy_version 1845484 (0.0007) [2023-12-28 08:31:34,925][106226] Updated weights for policy 0, policy_version 1845494 (0.0007) [2023-12-28 08:31:34,973][106226] Updated weights for policy 0, policy_version 1845504 (0.0005) [2023-12-28 08:31:35,290][106225] Updated weights for policy 1, policy_version 1849481 (0.0008) [2023-12-28 08:31:35,335][106225] Updated weights for policy 1, policy_version 1849491 (0.0007) [2023-12-28 08:31:35,383][106225] Updated weights for policy 1, policy_version 1849501 (0.0008) [2023-12-28 08:31:35,590][106226] Updated weights for policy 0, policy_version 1845514 (0.0006) [2023-12-28 08:31:35,645][106226] Updated weights for policy 0, policy_version 1845524 (0.0008) [2023-12-28 08:31:35,705][106226] Updated weights for policy 0, policy_version 1845534 (0.0009) [2023-12-28 08:31:35,762][106226] Updated weights for policy 0, policy_version 1845544 (0.0007) [2023-12-28 08:31:36,158][106225] Updated weights for policy 1, policy_version 1849511 (0.0007) [2023-12-28 08:31:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 946069504. Throughput: 0: 10038.7, 1: 9719.2. Samples: 946081764. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:36,175][105115] Avg episode reward: [(0, '-4.506'), (1, '-4.517')] [2023-12-28 08:31:36,217][106225] Updated weights for policy 1, policy_version 1849521 (0.0008) [2023-12-28 08:31:36,279][106225] Updated weights for policy 1, policy_version 1849531 (0.0008) [2023-12-28 08:31:36,542][106226] Updated weights for policy 0, policy_version 1845554 (0.0009) [2023-12-28 08:31:36,607][106226] Updated weights for policy 0, policy_version 1845564 (0.0009) [2023-12-28 08:31:36,674][106226] Updated weights for policy 0, policy_version 1845574 (0.0010) [2023-12-28 08:31:36,949][106225] Updated weights for policy 1, policy_version 1849541 (0.0008) [2023-12-28 08:31:37,010][106225] Updated weights for policy 1, policy_version 1849551 (0.0009) [2023-12-28 08:31:37,068][106225] Updated weights for policy 1, policy_version 1849561 (0.0006) [2023-12-28 08:31:37,292][106226] Updated weights for policy 0, policy_version 1845584 (0.0006) [2023-12-28 08:31:37,356][106226] Updated weights for policy 0, policy_version 1845594 (0.0008) [2023-12-28 08:31:37,418][106226] Updated weights for policy 0, policy_version 1845604 (0.0009) [2023-12-28 08:31:37,799][106225] Updated weights for policy 1, policy_version 1849571 (0.0007) [2023-12-28 08:31:37,865][106225] Updated weights for policy 1, policy_version 1849581 (0.0008) [2023-12-28 08:31:37,922][106225] Updated weights for policy 1, policy_version 1849591 (0.0008) [2023-12-28 08:31:38,121][106226] Updated weights for policy 0, policy_version 1845614 (0.0008) [2023-12-28 08:31:38,174][106226] Updated weights for policy 0, policy_version 1845624 (0.0007) [2023-12-28 08:31:38,226][106226] Updated weights for policy 0, policy_version 1845634 (0.0008) [2023-12-28 08:31:38,663][106225] Updated weights for policy 1, policy_version 1849601 (0.0007) [2023-12-28 08:31:38,724][106225] Updated weights for policy 1, policy_version 1849611 (0.0008) [2023-12-28 08:31:38,788][106225] Updated weights for policy 1, policy_version 1849621 (0.0009) [2023-12-28 08:31:38,843][106225] Updated weights for policy 1, policy_version 1849631 (0.0009) [2023-12-28 08:31:38,998][106226] Updated weights for policy 0, policy_version 1845644 (0.0007) [2023-12-28 08:31:39,063][106226] Updated weights for policy 0, policy_version 1845654 (0.0006) [2023-12-28 08:31:39,131][106226] Updated weights for policy 0, policy_version 1845664 (0.0008) [2023-12-28 08:31:39,517][106225] Updated weights for policy 1, policy_version 1849641 (0.0008) [2023-12-28 08:31:39,568][106225] Updated weights for policy 1, policy_version 1849651 (0.0008) [2023-12-28 08:31:39,623][106225] Updated weights for policy 1, policy_version 1849661 (0.0008) [2023-12-28 08:31:39,823][106226] Updated weights for policy 0, policy_version 1845674 (0.0011) [2023-12-28 08:31:39,888][106226] Updated weights for policy 0, policy_version 1845684 (0.0011) [2023-12-28 08:31:39,956][106226] Updated weights for policy 0, policy_version 1845694 (0.0011) [2023-12-28 08:31:40,019][106226] Updated weights for policy 0, policy_version 1845704 (0.0009) [2023-12-28 08:31:40,381][106225] Updated weights for policy 1, policy_version 1849671 (0.0008) [2023-12-28 08:31:40,439][106225] Updated weights for policy 1, policy_version 1849681 (0.0005) [2023-12-28 08:31:40,500][106225] Updated weights for policy 1, policy_version 1849691 (0.0008) [2023-12-28 08:31:40,725][106226] Updated weights for policy 0, policy_version 1845714 (0.0011) [2023-12-28 08:31:40,789][106226] Updated weights for policy 0, policy_version 1845724 (0.0009) [2023-12-28 08:31:40,844][106226] Updated weights for policy 0, policy_version 1845734 (0.0007) [2023-12-28 08:31:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 946167808. Throughput: 0: 10008.3, 1: 9763.7. Samples: 946140496. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:41,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-4.423')] [2023-12-28 08:31:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001849696_473579520.pth... [2023-12-28 08:31:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001845736_472588288.pth... [2023-12-28 08:31:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001848576_473292800.pth [2023-12-28 08:31:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001844584_472293376.pth [2023-12-28 08:31:41,244][106225] Updated weights for policy 1, policy_version 1849701 (0.0007) [2023-12-28 08:31:41,312][106225] Updated weights for policy 1, policy_version 1849711 (0.0007) [2023-12-28 08:31:41,377][106225] Updated weights for policy 1, policy_version 1849721 (0.0008) [2023-12-28 08:31:41,624][106226] Updated weights for policy 0, policy_version 1845744 (0.0009) [2023-12-28 08:31:41,690][106226] Updated weights for policy 0, policy_version 1845754 (0.0008) [2023-12-28 08:31:41,758][106226] Updated weights for policy 0, policy_version 1845764 (0.0008) [2023-12-28 08:31:42,137][106225] Updated weights for policy 1, policy_version 1849731 (0.0008) [2023-12-28 08:31:42,200][106225] Updated weights for policy 1, policy_version 1849741 (0.0009) [2023-12-28 08:31:42,258][106225] Updated weights for policy 1, policy_version 1849751 (0.0008) [2023-12-28 08:31:42,507][106226] Updated weights for policy 0, policy_version 1845774 (0.0009) [2023-12-28 08:31:42,559][106226] Updated weights for policy 0, policy_version 1845784 (0.0008) [2023-12-28 08:31:42,616][106226] Updated weights for policy 0, policy_version 1845794 (0.0009) [2023-12-28 08:31:42,995][106225] Updated weights for policy 1, policy_version 1849761 (0.0008) [2023-12-28 08:31:43,049][106225] Updated weights for policy 1, policy_version 1849771 (0.0005) [2023-12-28 08:31:43,103][106225] Updated weights for policy 1, policy_version 1849781 (0.0008) [2023-12-28 08:31:43,160][106225] Updated weights for policy 1, policy_version 1849791 (0.0009) [2023-12-28 08:31:43,404][106226] Updated weights for policy 0, policy_version 1845804 (0.0009) [2023-12-28 08:31:43,475][106226] Updated weights for policy 0, policy_version 1845814 (0.0009) [2023-12-28 08:31:43,525][106226] Updated weights for policy 0, policy_version 1845824 (0.0009) [2023-12-28 08:31:43,778][106225] Updated weights for policy 1, policy_version 1849801 (0.0007) [2023-12-28 08:31:43,837][106225] Updated weights for policy 1, policy_version 1849811 (0.0009) [2023-12-28 08:31:43,882][106225] Updated weights for policy 1, policy_version 1849821 (0.0008) [2023-12-28 08:31:44,261][106226] Updated weights for policy 0, policy_version 1845834 (0.0009) [2023-12-28 08:31:44,323][106226] Updated weights for policy 0, policy_version 1845844 (0.0008) [2023-12-28 08:31:44,386][106226] Updated weights for policy 0, policy_version 1845854 (0.0009) [2023-12-28 08:31:44,439][106226] Updated weights for policy 0, policy_version 1845864 (0.0008) [2023-12-28 08:31:44,623][106225] Updated weights for policy 1, policy_version 1849831 (0.0008) [2023-12-28 08:31:44,675][106225] Updated weights for policy 1, policy_version 1849841 (0.0007) [2023-12-28 08:31:44,727][106225] Updated weights for policy 1, policy_version 1849851 (0.0005) [2023-12-28 08:31:45,132][106226] Updated weights for policy 0, policy_version 1845874 (0.0006) [2023-12-28 08:31:45,196][106226] Updated weights for policy 0, policy_version 1845884 (0.0008) [2023-12-28 08:31:45,256][106226] Updated weights for policy 0, policy_version 1845894 (0.0008) [2023-12-28 08:31:45,531][106225] Updated weights for policy 1, policy_version 1849861 (0.0006) [2023-12-28 08:31:45,577][106225] Updated weights for policy 1, policy_version 1849871 (0.0007) [2023-12-28 08:31:45,622][106225] Updated weights for policy 1, policy_version 1849881 (0.0008) [2023-12-28 08:31:45,895][106226] Updated weights for policy 0, policy_version 1845904 (0.0009) [2023-12-28 08:31:45,944][106226] Updated weights for policy 0, policy_version 1845914 (0.0009) [2023-12-28 08:31:45,998][106226] Updated weights for policy 0, policy_version 1845924 (0.0008) [2023-12-28 08:31:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.9, 300 sec: 19660.8). Total num frames: 946266112. Throughput: 0: 9882.6, 1: 9764.4. Samples: 946254864. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:46,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-4.637')] [2023-12-28 08:31:46,202][106225] Updated weights for policy 1, policy_version 1849891 (0.0008) [2023-12-28 08:31:46,266][106225] Updated weights for policy 1, policy_version 1849901 (0.0009) [2023-12-28 08:31:46,322][106225] Updated weights for policy 1, policy_version 1849911 (0.0008) [2023-12-28 08:31:46,653][106226] Updated weights for policy 0, policy_version 1845934 (0.0008) [2023-12-28 08:31:46,708][106226] Updated weights for policy 0, policy_version 1845944 (0.0007) [2023-12-28 08:31:46,776][106226] Updated weights for policy 0, policy_version 1845954 (0.0006) [2023-12-28 08:31:47,039][106225] Updated weights for policy 1, policy_version 1849921 (0.0008) [2023-12-28 08:31:47,094][106225] Updated weights for policy 1, policy_version 1849931 (0.0005) [2023-12-28 08:31:47,142][106225] Updated weights for policy 1, policy_version 1849941 (0.0005) [2023-12-28 08:31:47,191][106225] Updated weights for policy 1, policy_version 1849951 (0.0005) [2023-12-28 08:31:47,423][106226] Updated weights for policy 0, policy_version 1845964 (0.0008) [2023-12-28 08:31:47,478][106226] Updated weights for policy 0, policy_version 1845975 (0.0009) [2023-12-28 08:31:47,532][106226] Updated weights for policy 0, policy_version 1845985 (0.0009) [2023-12-28 08:31:47,771][106225] Updated weights for policy 1, policy_version 1849961 (0.0010) [2023-12-28 08:31:47,832][106225] Updated weights for policy 1, policy_version 1849971 (0.0010) [2023-12-28 08:31:47,892][106225] Updated weights for policy 1, policy_version 1849981 (0.0010) [2023-12-28 08:31:48,211][106226] Updated weights for policy 0, policy_version 1845995 (0.0008) [2023-12-28 08:31:48,273][106226] Updated weights for policy 0, policy_version 1846005 (0.0008) [2023-12-28 08:31:48,340][106226] Updated weights for policy 0, policy_version 1846015 (0.0009) [2023-12-28 08:31:48,588][106225] Updated weights for policy 1, policy_version 1849991 (0.0009) [2023-12-28 08:31:48,643][106225] Updated weights for policy 1, policy_version 1850001 (0.0007) [2023-12-28 08:31:48,710][106225] Updated weights for policy 1, policy_version 1850011 (0.0005) [2023-12-28 08:31:49,069][106226] Updated weights for policy 0, policy_version 1846025 (0.0009) [2023-12-28 08:31:49,128][106226] Updated weights for policy 0, policy_version 1846035 (0.0009) [2023-12-28 08:31:49,188][106226] Updated weights for policy 0, policy_version 1846045 (0.0009) [2023-12-28 08:31:49,253][106226] Updated weights for policy 0, policy_version 1846055 (0.0008) [2023-12-28 08:31:49,453][106225] Updated weights for policy 1, policy_version 1850021 (0.0007) [2023-12-28 08:31:49,519][106225] Updated weights for policy 1, policy_version 1850031 (0.0006) [2023-12-28 08:31:49,576][106225] Updated weights for policy 1, policy_version 1850041 (0.0005) [2023-12-28 08:31:49,984][106226] Updated weights for policy 0, policy_version 1846065 (0.0008) [2023-12-28 08:31:50,046][106226] Updated weights for policy 0, policy_version 1846075 (0.0008) [2023-12-28 08:31:50,108][106226] Updated weights for policy 0, policy_version 1846085 (0.0008) [2023-12-28 08:31:50,174][106225] Updated weights for policy 1, policy_version 1850051 (0.0008) [2023-12-28 08:31:50,239][106225] Updated weights for policy 1, policy_version 1850061 (0.0007) [2023-12-28 08:31:50,303][106225] Updated weights for policy 1, policy_version 1850071 (0.0008) [2023-12-28 08:31:50,826][106226] Updated weights for policy 0, policy_version 1846095 (0.0007) [2023-12-28 08:31:50,889][106226] Updated weights for policy 0, policy_version 1846105 (0.0006) [2023-12-28 08:31:50,953][106226] Updated weights for policy 0, policy_version 1846115 (0.0006) [2023-12-28 08:31:51,012][106225] Updated weights for policy 1, policy_version 1850081 (0.0009) [2023-12-28 08:31:51,079][106225] Updated weights for policy 1, policy_version 1850091 (0.0008) [2023-12-28 08:31:51,138][106225] Updated weights for policy 1, policy_version 1850101 (0.0008) [2023-12-28 08:31:51,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 946364416. Throughput: 0: 9934.1, 1: 9787.8. Samples: 946376004. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:51,175][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.463')] [2023-12-28 08:31:51,212][106225] Updated weights for policy 1, policy_version 1850111 (0.0008) [2023-12-28 08:31:51,657][106226] Updated weights for policy 0, policy_version 1846125 (0.0008) [2023-12-28 08:31:51,723][106226] Updated weights for policy 0, policy_version 1846135 (0.0008) [2023-12-28 08:31:51,795][106226] Updated weights for policy 0, policy_version 1846145 (0.0009) [2023-12-28 08:31:51,943][106225] Updated weights for policy 1, policy_version 1850121 (0.0008) [2023-12-28 08:31:52,004][106225] Updated weights for policy 1, policy_version 1850131 (0.0009) [2023-12-28 08:31:52,067][106225] Updated weights for policy 1, policy_version 1850141 (0.0009) [2023-12-28 08:31:52,517][106226] Updated weights for policy 0, policy_version 1846155 (0.0009) [2023-12-28 08:31:52,578][106226] Updated weights for policy 0, policy_version 1846165 (0.0009) [2023-12-28 08:31:52,643][106226] Updated weights for policy 0, policy_version 1846175 (0.0009) [2023-12-28 08:31:52,825][106225] Updated weights for policy 1, policy_version 1850151 (0.0009) [2023-12-28 08:31:52,874][106225] Updated weights for policy 1, policy_version 1850161 (0.0008) [2023-12-28 08:31:52,926][106225] Updated weights for policy 1, policy_version 1850171 (0.0009) [2023-12-28 08:31:53,367][106226] Updated weights for policy 0, policy_version 1846185 (0.0008) [2023-12-28 08:31:53,425][106226] Updated weights for policy 0, policy_version 1846195 (0.0009) [2023-12-28 08:31:53,482][106226] Updated weights for policy 0, policy_version 1846205 (0.0008) [2023-12-28 08:31:53,548][106226] Updated weights for policy 0, policy_version 1846215 (0.0008) [2023-12-28 08:31:53,668][106225] Updated weights for policy 1, policy_version 1850181 (0.0008) [2023-12-28 08:31:53,721][106225] Updated weights for policy 1, policy_version 1850191 (0.0008) [2023-12-28 08:31:53,773][106225] Updated weights for policy 1, policy_version 1850201 (0.0008) [2023-12-28 08:31:54,219][106226] Updated weights for policy 0, policy_version 1846225 (0.0008) [2023-12-28 08:31:54,278][106226] Updated weights for policy 0, policy_version 1846235 (0.0008) [2023-12-28 08:31:54,337][106226] Updated weights for policy 0, policy_version 1846245 (0.0009) [2023-12-28 08:31:54,521][106225] Updated weights for policy 1, policy_version 1850211 (0.0009) [2023-12-28 08:31:54,571][106225] Updated weights for policy 1, policy_version 1850221 (0.0009) [2023-12-28 08:31:54,624][106225] Updated weights for policy 1, policy_version 1850231 (0.0008) [2023-12-28 08:31:55,084][106226] Updated weights for policy 0, policy_version 1846255 (0.0008) [2023-12-28 08:31:55,128][106226] Updated weights for policy 0, policy_version 1846265 (0.0009) [2023-12-28 08:31:55,177][106226] Updated weights for policy 0, policy_version 1846275 (0.0008) [2023-12-28 08:31:55,336][106225] Updated weights for policy 1, policy_version 1850241 (0.0008) [2023-12-28 08:31:55,399][106225] Updated weights for policy 1, policy_version 1850251 (0.0005) [2023-12-28 08:31:55,470][106225] Updated weights for policy 1, policy_version 1850261 (0.0005) [2023-12-28 08:31:55,533][106225] Updated weights for policy 1, policy_version 1850271 (0.0005) [2023-12-28 08:31:55,825][106226] Updated weights for policy 0, policy_version 1846285 (0.0009) [2023-12-28 08:31:55,878][106226] Updated weights for policy 0, policy_version 1846296 (0.0009) [2023-12-28 08:31:55,926][106226] Updated weights for policy 0, policy_version 1846307 (0.0009) [2023-12-28 08:31:56,068][106225] Updated weights for policy 1, policy_version 1850281 (0.0010) [2023-12-28 08:31:56,139][106225] Updated weights for policy 1, policy_version 1850291 (0.0009) [2023-12-28 08:31:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 946462720. Throughput: 0: 9873.7, 1: 9769.7. Samples: 946432644. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:31:56,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.779')] [2023-12-28 08:31:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001846312_472735744.pth... [2023-12-28 08:31:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001845160_472440832.pth [2023-12-28 08:31:56,195][106225] Updated weights for policy 1, policy_version 1850301 (0.0008) [2023-12-28 08:31:56,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001850304_473735168.pth... [2023-12-28 08:31:56,212][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001849120_473432064.pth [2023-12-28 08:31:56,728][106226] Updated weights for policy 0, policy_version 1846317 (0.0009) [2023-12-28 08:31:56,785][106226] Updated weights for policy 0, policy_version 1846327 (0.0011) [2023-12-28 08:31:56,842][106226] Updated weights for policy 0, policy_version 1846337 (0.0007) [2023-12-28 08:31:56,900][106225] Updated weights for policy 1, policy_version 1850311 (0.0009) [2023-12-28 08:31:56,953][106225] Updated weights for policy 1, policy_version 1850321 (0.0010) [2023-12-28 08:31:57,002][106225] Updated weights for policy 1, policy_version 1850331 (0.0010) [2023-12-28 08:31:57,515][106226] Updated weights for policy 0, policy_version 1846347 (0.0008) [2023-12-28 08:31:57,571][106226] Updated weights for policy 0, policy_version 1846357 (0.0008) [2023-12-28 08:31:57,621][106226] Updated weights for policy 0, policy_version 1846367 (0.0007) [2023-12-28 08:31:57,732][106225] Updated weights for policy 1, policy_version 1850341 (0.0010) [2023-12-28 08:31:57,785][106225] Updated weights for policy 1, policy_version 1850351 (0.0010) [2023-12-28 08:31:57,832][106225] Updated weights for policy 1, policy_version 1850361 (0.0010) [2023-12-28 08:31:58,227][106226] Updated weights for policy 0, policy_version 1846377 (0.0008) [2023-12-28 08:31:58,286][106226] Updated weights for policy 0, policy_version 1846387 (0.0008) [2023-12-28 08:31:58,345][106226] Updated weights for policy 0, policy_version 1846397 (0.0008) [2023-12-28 08:31:58,406][106226] Updated weights for policy 0, policy_version 1846407 (0.0008) [2023-12-28 08:31:58,595][106225] Updated weights for policy 1, policy_version 1850371 (0.0009) [2023-12-28 08:31:58,659][106225] Updated weights for policy 1, policy_version 1850381 (0.0008) [2023-12-28 08:31:58,722][106225] Updated weights for policy 1, policy_version 1850391 (0.0008) [2023-12-28 08:31:59,239][106226] Updated weights for policy 0, policy_version 1846417 (0.0010) [2023-12-28 08:31:59,313][106226] Updated weights for policy 0, policy_version 1846427 (0.0011) [2023-12-28 08:31:59,383][106226] Updated weights for policy 0, policy_version 1846437 (0.0010) [2023-12-28 08:31:59,515][106225] Updated weights for policy 1, policy_version 1850401 (0.0007) [2023-12-28 08:31:59,571][106225] Updated weights for policy 1, policy_version 1850411 (0.0007) [2023-12-28 08:31:59,615][106225] Updated weights for policy 1, policy_version 1850421 (0.0005) [2023-12-28 08:31:59,682][106225] Updated weights for policy 1, policy_version 1850431 (0.0007) [2023-12-28 08:32:00,104][106226] Updated weights for policy 0, policy_version 1846447 (0.0009) [2023-12-28 08:32:00,162][106226] Updated weights for policy 0, policy_version 1846457 (0.0008) [2023-12-28 08:32:00,220][106226] Updated weights for policy 0, policy_version 1846467 (0.0010) [2023-12-28 08:32:00,373][106225] Updated weights for policy 1, policy_version 1850441 (0.0008) [2023-12-28 08:32:00,428][106225] Updated weights for policy 1, policy_version 1850451 (0.0005) [2023-12-28 08:32:00,486][106225] Updated weights for policy 1, policy_version 1850461 (0.0008) [2023-12-28 08:32:00,827][106226] Updated weights for policy 0, policy_version 1846477 (0.0008) [2023-12-28 08:32:00,885][106226] Updated weights for policy 0, policy_version 1846487 (0.0005) [2023-12-28 08:32:00,946][106226] Updated weights for policy 0, policy_version 1846497 (0.0005) [2023-12-28 08:32:01,161][106225] Updated weights for policy 1, policy_version 1850471 (0.0008) [2023-12-28 08:32:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 946561024. Throughput: 0: 9823.9, 1: 9813.6. Samples: 946550284. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:01,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.906')] [2023-12-28 08:32:01,229][106225] Updated weights for policy 1, policy_version 1850481 (0.0009) [2023-12-28 08:32:01,285][106225] Updated weights for policy 1, policy_version 1850491 (0.0008) [2023-12-28 08:32:01,591][106226] Updated weights for policy 0, policy_version 1846507 (0.0007) [2023-12-28 08:32:01,660][106226] Updated weights for policy 0, policy_version 1846517 (0.0008) [2023-12-28 08:32:01,716][106226] Updated weights for policy 0, policy_version 1846527 (0.0009) [2023-12-28 08:32:02,050][106225] Updated weights for policy 1, policy_version 1850501 (0.0009) [2023-12-28 08:32:02,103][106225] Updated weights for policy 1, policy_version 1850511 (0.0008) [2023-12-28 08:32:02,164][106225] Updated weights for policy 1, policy_version 1850521 (0.0007) [2023-12-28 08:32:02,421][106226] Updated weights for policy 0, policy_version 1846537 (0.0008) [2023-12-28 08:32:02,486][106226] Updated weights for policy 0, policy_version 1846547 (0.0006) [2023-12-28 08:32:02,545][106226] Updated weights for policy 0, policy_version 1846557 (0.0005) [2023-12-28 08:32:02,604][106226] Updated weights for policy 0, policy_version 1846567 (0.0006) [2023-12-28 08:32:02,862][106225] Updated weights for policy 1, policy_version 1850531 (0.0007) [2023-12-28 08:32:02,925][106225] Updated weights for policy 1, policy_version 1850541 (0.0010) [2023-12-28 08:32:02,985][106225] Updated weights for policy 1, policy_version 1850551 (0.0010) [2023-12-28 08:32:03,230][106226] Updated weights for policy 0, policy_version 1846577 (0.0009) [2023-12-28 08:32:03,293][106226] Updated weights for policy 0, policy_version 1846587 (0.0008) [2023-12-28 08:32:03,347][106226] Updated weights for policy 0, policy_version 1846597 (0.0008) [2023-12-28 08:32:03,575][106225] Updated weights for policy 1, policy_version 1850561 (0.0010) [2023-12-28 08:32:03,643][106225] Updated weights for policy 1, policy_version 1850571 (0.0007) [2023-12-28 08:32:03,695][106225] Updated weights for policy 1, policy_version 1850581 (0.0007) [2023-12-28 08:32:03,753][106225] Updated weights for policy 1, policy_version 1850591 (0.0010) [2023-12-28 08:32:03,955][106226] Updated weights for policy 0, policy_version 1846607 (0.0009) [2023-12-28 08:32:04,027][106226] Updated weights for policy 0, policy_version 1846617 (0.0011) [2023-12-28 08:32:04,091][106226] Updated weights for policy 0, policy_version 1846627 (0.0010) [2023-12-28 08:32:04,520][106225] Updated weights for policy 1, policy_version 1850601 (0.0010) [2023-12-28 08:32:04,580][106225] Updated weights for policy 1, policy_version 1850611 (0.0010) [2023-12-28 08:32:04,641][106225] Updated weights for policy 1, policy_version 1850621 (0.0009) [2023-12-28 08:32:04,767][106226] Updated weights for policy 0, policy_version 1846637 (0.0008) [2023-12-28 08:32:04,817][106226] Updated weights for policy 0, policy_version 1846647 (0.0010) [2023-12-28 08:32:04,871][106226] Updated weights for policy 0, policy_version 1846657 (0.0011) [2023-12-28 08:32:05,220][106225] Updated weights for policy 1, policy_version 1850631 (0.0006) [2023-12-28 08:32:05,271][106225] Updated weights for policy 1, policy_version 1850641 (0.0007) [2023-12-28 08:32:05,317][106225] Updated weights for policy 1, policy_version 1850651 (0.0007) [2023-12-28 08:32:05,564][106226] Updated weights for policy 0, policy_version 1846667 (0.0011) [2023-12-28 08:32:05,612][106226] Updated weights for policy 0, policy_version 1846677 (0.0010) [2023-12-28 08:32:05,662][106226] Updated weights for policy 0, policy_version 1846687 (0.0010) [2023-12-28 08:32:06,079][106225] Updated weights for policy 1, policy_version 1850661 (0.0008) [2023-12-28 08:32:06,141][106225] Updated weights for policy 1, policy_version 1850671 (0.0008) [2023-12-28 08:32:06,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19660.7, 300 sec: 19633.0). Total num frames: 946659328. Throughput: 0: 9900.7, 1: 9848.6. Samples: 946673608. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:06,176][105115] Avg episode reward: [(0, '-4.187'), (1, '-4.769')] [2023-12-28 08:32:06,214][106225] Updated weights for policy 1, policy_version 1850681 (0.0009) [2023-12-28 08:32:06,301][106226] Updated weights for policy 0, policy_version 1846697 (0.0011) [2023-12-28 08:32:06,370][106226] Updated weights for policy 0, policy_version 1846707 (0.0011) [2023-12-28 08:32:06,431][106226] Updated weights for policy 0, policy_version 1846717 (0.0009) [2023-12-28 08:32:06,488][106226] Updated weights for policy 0, policy_version 1846727 (0.0009) [2023-12-28 08:32:06,996][106225] Updated weights for policy 1, policy_version 1850691 (0.0008) [2023-12-28 08:32:07,048][106225] Updated weights for policy 1, policy_version 1850701 (0.0008) [2023-12-28 08:32:07,105][106225] Updated weights for policy 1, policy_version 1850711 (0.0008) [2023-12-28 08:32:07,201][106226] Updated weights for policy 0, policy_version 1846737 (0.0011) [2023-12-28 08:32:07,270][106226] Updated weights for policy 0, policy_version 1846747 (0.0011) [2023-12-28 08:32:07,330][106226] Updated weights for policy 0, policy_version 1846757 (0.0011) [2023-12-28 08:32:07,777][106225] Updated weights for policy 1, policy_version 1850721 (0.0007) [2023-12-28 08:32:07,837][106225] Updated weights for policy 1, policy_version 1850731 (0.0008) [2023-12-28 08:32:07,899][106225] Updated weights for policy 1, policy_version 1850741 (0.0006) [2023-12-28 08:32:07,949][106225] Updated weights for policy 1, policy_version 1850751 (0.0009) [2023-12-28 08:32:08,007][106226] Updated weights for policy 0, policy_version 1846767 (0.0009) [2023-12-28 08:32:08,068][106226] Updated weights for policy 0, policy_version 1846777 (0.0010) [2023-12-28 08:32:08,135][106226] Updated weights for policy 0, policy_version 1846787 (0.0010) [2023-12-28 08:32:08,640][106225] Updated weights for policy 1, policy_version 1850761 (0.0010) [2023-12-28 08:32:08,690][106225] Updated weights for policy 1, policy_version 1850771 (0.0008) [2023-12-28 08:32:08,745][106225] Updated weights for policy 1, policy_version 1850781 (0.0005) [2023-12-28 08:32:08,808][106226] Updated weights for policy 0, policy_version 1846797 (0.0011) [2023-12-28 08:32:08,868][106226] Updated weights for policy 0, policy_version 1846807 (0.0006) [2023-12-28 08:32:08,929][106226] Updated weights for policy 0, policy_version 1846817 (0.0007) [2023-12-28 08:32:09,457][106225] Updated weights for policy 1, policy_version 1850791 (0.0006) [2023-12-28 08:32:09,524][106225] Updated weights for policy 1, policy_version 1850801 (0.0008) [2023-12-28 08:32:09,590][106225] Updated weights for policy 1, policy_version 1850811 (0.0009) [2023-12-28 08:32:09,607][106226] Updated weights for policy 0, policy_version 1846827 (0.0008) [2023-12-28 08:32:09,661][106226] Updated weights for policy 0, policy_version 1846837 (0.0011) [2023-12-28 08:32:09,716][106226] Updated weights for policy 0, policy_version 1846847 (0.0011) [2023-12-28 08:32:10,372][106225] Updated weights for policy 1, policy_version 1850821 (0.0007) [2023-12-28 08:32:10,435][106225] Updated weights for policy 1, policy_version 1850831 (0.0008) [2023-12-28 08:32:10,463][106226] Updated weights for policy 0, policy_version 1846857 (0.0010) [2023-12-28 08:32:10,494][106225] Updated weights for policy 1, policy_version 1850841 (0.0008) [2023-12-28 08:32:10,521][106226] Updated weights for policy 0, policy_version 1846867 (0.0007) [2023-12-28 08:32:10,585][106226] Updated weights for policy 0, policy_version 1846877 (0.0008) [2023-12-28 08:32:10,639][106226] Updated weights for policy 0, policy_version 1846887 (0.0008) [2023-12-28 08:32:11,114][106225] Updated weights for policy 1, policy_version 1850851 (0.0008) [2023-12-28 08:32:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 946757632. Throughput: 0: 9905.8, 1: 9883.8. Samples: 946732332. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:11,175][105115] Avg episode reward: [(0, '-4.490'), (1, '-4.704')] [2023-12-28 08:32:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001846888_472883200.pth... [2023-12-28 08:32:11,185][106225] Updated weights for policy 1, policy_version 1850861 (0.0008) [2023-12-28 08:32:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001845736_472588288.pth [2023-12-28 08:32:11,249][106225] Updated weights for policy 1, policy_version 1850871 (0.0009) [2023-12-28 08:32:11,306][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001850880_473882624.pth... [2023-12-28 08:32:11,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001849696_473579520.pth [2023-12-28 08:32:11,409][106226] Updated weights for policy 0, policy_version 1846897 (0.0009) [2023-12-28 08:32:11,468][106226] Updated weights for policy 0, policy_version 1846907 (0.0009) [2023-12-28 08:32:11,532][106226] Updated weights for policy 0, policy_version 1846917 (0.0009) [2023-12-28 08:32:12,015][106225] Updated weights for policy 1, policy_version 1850881 (0.0008) [2023-12-28 08:32:12,076][106225] Updated weights for policy 1, policy_version 1850891 (0.0009) [2023-12-28 08:32:12,145][106225] Updated weights for policy 1, policy_version 1850901 (0.0009) [2023-12-28 08:32:12,199][106226] Updated weights for policy 0, policy_version 1846927 (0.0007) [2023-12-28 08:32:12,215][106225] Updated weights for policy 1, policy_version 1850911 (0.0008) [2023-12-28 08:32:12,261][106226] Updated weights for policy 0, policy_version 1846937 (0.0008) [2023-12-28 08:32:12,333][106226] Updated weights for policy 0, policy_version 1846947 (0.0007) [2023-12-28 08:32:12,991][106225] Updated weights for policy 1, policy_version 1850921 (0.0009) [2023-12-28 08:32:13,029][106226] Updated weights for policy 0, policy_version 1846957 (0.0008) [2023-12-28 08:32:13,051][106225] Updated weights for policy 1, policy_version 1850931 (0.0006) [2023-12-28 08:32:13,090][106226] Updated weights for policy 0, policy_version 1846967 (0.0009) [2023-12-28 08:32:13,105][106225] Updated weights for policy 1, policy_version 1850941 (0.0006) [2023-12-28 08:32:13,153][106226] Updated weights for policy 0, policy_version 1846977 (0.0008) [2023-12-28 08:32:13,803][106225] Updated weights for policy 1, policy_version 1850951 (0.0007) [2023-12-28 08:32:13,849][106226] Updated weights for policy 0, policy_version 1846987 (0.0006) [2023-12-28 08:32:13,865][106225] Updated weights for policy 1, policy_version 1850961 (0.0008) [2023-12-28 08:32:13,900][106226] Updated weights for policy 0, policy_version 1846997 (0.0006) [2023-12-28 08:32:13,925][106225] Updated weights for policy 1, policy_version 1850971 (0.0007) [2023-12-28 08:32:13,951][106226] Updated weights for policy 0, policy_version 1847007 (0.0005) [2023-12-28 08:32:14,635][106225] Updated weights for policy 1, policy_version 1850981 (0.0008) [2023-12-28 08:32:14,679][106226] Updated weights for policy 0, policy_version 1847017 (0.0008) [2023-12-28 08:32:14,693][106225] Updated weights for policy 1, policy_version 1850991 (0.0007) [2023-12-28 08:32:14,743][106226] Updated weights for policy 0, policy_version 1847027 (0.0008) [2023-12-28 08:32:14,753][106225] Updated weights for policy 1, policy_version 1851001 (0.0009) [2023-12-28 08:32:14,813][106226] Updated weights for policy 0, policy_version 1847037 (0.0007) [2023-12-28 08:32:14,879][106226] Updated weights for policy 0, policy_version 1847047 (0.0008) [2023-12-28 08:32:15,429][106225] Updated weights for policy 1, policy_version 1851012 (0.0007) [2023-12-28 08:32:15,476][106225] Updated weights for policy 1, policy_version 1851022 (0.0008) [2023-12-28 08:32:15,531][106225] Updated weights for policy 1, policy_version 1851032 (0.0007) [2023-12-28 08:32:15,545][106226] Updated weights for policy 0, policy_version 1847057 (0.0007) [2023-12-28 08:32:15,596][106226] Updated weights for policy 0, policy_version 1847067 (0.0008) [2023-12-28 08:32:15,651][106226] Updated weights for policy 0, policy_version 1847077 (0.0008) [2023-12-28 08:32:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.7, 300 sec: 19660.8). Total num frames: 946855936. Throughput: 0: 9887.8, 1: 9778.3. Samples: 946847104. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:16,176][105115] Avg episode reward: [(0, '-3.999'), (1, '-4.791')] [2023-12-28 08:32:16,259][106225] Updated weights for policy 1, policy_version 1851042 (0.0009) [2023-12-28 08:32:16,304][106225] Updated weights for policy 1, policy_version 1851052 (0.0008) [2023-12-28 08:32:16,353][106225] Updated weights for policy 1, policy_version 1851062 (0.0008) [2023-12-28 08:32:16,383][106226] Updated weights for policy 0, policy_version 1847087 (0.0007) [2023-12-28 08:32:16,407][106225] Updated weights for policy 1, policy_version 1851072 (0.0007) [2023-12-28 08:32:16,432][106226] Updated weights for policy 0, policy_version 1847097 (0.0007) [2023-12-28 08:32:16,487][106226] Updated weights for policy 0, policy_version 1847107 (0.0008) [2023-12-28 08:32:17,164][106225] Updated weights for policy 1, policy_version 1851082 (0.0009) [2023-12-28 08:32:17,220][106225] Updated weights for policy 1, policy_version 1851092 (0.0009) [2023-12-28 08:32:17,238][106226] Updated weights for policy 0, policy_version 1847117 (0.0008) [2023-12-28 08:32:17,285][106225] Updated weights for policy 1, policy_version 1851102 (0.0006) [2023-12-28 08:32:17,304][106226] Updated weights for policy 0, policy_version 1847127 (0.0008) [2023-12-28 08:32:17,353][106226] Updated weights for policy 0, policy_version 1847137 (0.0008) [2023-12-28 08:32:18,004][106225] Updated weights for policy 1, policy_version 1851112 (0.0008) [2023-12-28 08:32:18,060][106225] Updated weights for policy 1, policy_version 1851122 (0.0008) [2023-12-28 08:32:18,080][106226] Updated weights for policy 0, policy_version 1847147 (0.0008) [2023-12-28 08:32:18,122][106225] Updated weights for policy 1, policy_version 1851132 (0.0008) [2023-12-28 08:32:18,146][106226] Updated weights for policy 0, policy_version 1847157 (0.0005) [2023-12-28 08:32:18,196][106226] Updated weights for policy 0, policy_version 1847167 (0.0006) [2023-12-28 08:32:18,859][106226] Updated weights for policy 0, policy_version 1847177 (0.0009) [2023-12-28 08:32:18,922][106225] Updated weights for policy 1, policy_version 1851142 (0.0008) [2023-12-28 08:32:18,925][106226] Updated weights for policy 0, policy_version 1847187 (0.0007) [2023-12-28 08:32:18,981][106225] Updated weights for policy 1, policy_version 1851152 (0.0006) [2023-12-28 08:32:18,987][106226] Updated weights for policy 0, policy_version 1847197 (0.0010) [2023-12-28 08:32:19,037][106225] Updated weights for policy 1, policy_version 1851162 (0.0007) [2023-12-28 08:32:19,039][106226] Updated weights for policy 0, policy_version 1847207 (0.0007) [2023-12-28 08:32:19,741][106226] Updated weights for policy 0, policy_version 1847217 (0.0006) [2023-12-28 08:32:19,799][106226] Updated weights for policy 0, policy_version 1847227 (0.0005) [2023-12-28 08:32:19,833][106225] Updated weights for policy 1, policy_version 1851172 (0.0007) [2023-12-28 08:32:19,858][106226] Updated weights for policy 0, policy_version 1847237 (0.0008) [2023-12-28 08:32:19,900][106225] Updated weights for policy 1, policy_version 1851182 (0.0008) [2023-12-28 08:32:19,965][106225] Updated weights for policy 1, policy_version 1851192 (0.0008) [2023-12-28 08:32:20,584][106226] Updated weights for policy 0, policy_version 1847247 (0.0007) [2023-12-28 08:32:20,650][106226] Updated weights for policy 0, policy_version 1847257 (0.0008) [2023-12-28 08:32:20,712][106226] Updated weights for policy 0, policy_version 1847267 (0.0009) [2023-12-28 08:32:20,716][106225] Updated weights for policy 1, policy_version 1851202 (0.0007) [2023-12-28 08:32:20,779][106225] Updated weights for policy 1, policy_version 1851212 (0.0006) [2023-12-28 08:32:20,841][106225] Updated weights for policy 1, policy_version 1851222 (0.0006) [2023-12-28 08:32:20,889][106225] Updated weights for policy 1, policy_version 1851232 (0.0008) [2023-12-28 08:32:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 946954240. Throughput: 0: 9824.1, 1: 9762.5. Samples: 946963160. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:21,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.642')] [2023-12-28 08:32:21,450][106226] Updated weights for policy 0, policy_version 1847277 (0.0007) [2023-12-28 08:32:21,507][106226] Updated weights for policy 0, policy_version 1847287 (0.0005) [2023-12-28 08:32:21,566][106226] Updated weights for policy 0, policy_version 1847297 (0.0006) [2023-12-28 08:32:21,658][106225] Updated weights for policy 1, policy_version 1851242 (0.0008) [2023-12-28 08:32:21,726][106225] Updated weights for policy 1, policy_version 1851252 (0.0008) [2023-12-28 08:32:21,782][106225] Updated weights for policy 1, policy_version 1851262 (0.0008) [2023-12-28 08:32:22,230][106226] Updated weights for policy 0, policy_version 1847307 (0.0008) [2023-12-28 08:32:22,302][106226] Updated weights for policy 0, policy_version 1847317 (0.0008) [2023-12-28 08:32:22,373][106226] Updated weights for policy 0, policy_version 1847327 (0.0009) [2023-12-28 08:32:22,552][106225] Updated weights for policy 1, policy_version 1851272 (0.0008) [2023-12-28 08:32:22,611][106225] Updated weights for policy 1, policy_version 1851282 (0.0008) [2023-12-28 08:32:22,677][106225] Updated weights for policy 1, policy_version 1851292 (0.0008) [2023-12-28 08:32:23,077][106226] Updated weights for policy 0, policy_version 1847337 (0.0009) [2023-12-28 08:32:23,134][106226] Updated weights for policy 0, policy_version 1847347 (0.0009) [2023-12-28 08:32:23,191][106226] Updated weights for policy 0, policy_version 1847357 (0.0010) [2023-12-28 08:32:23,249][106226] Updated weights for policy 0, policy_version 1847367 (0.0011) [2023-12-28 08:32:23,393][106225] Updated weights for policy 1, policy_version 1851302 (0.0008) [2023-12-28 08:32:23,448][106225] Updated weights for policy 1, policy_version 1851312 (0.0009) [2023-12-28 08:32:23,501][106225] Updated weights for policy 1, policy_version 1851322 (0.0007) [2023-12-28 08:32:23,950][106226] Updated weights for policy 0, policy_version 1847377 (0.0011) [2023-12-28 08:32:24,013][106226] Updated weights for policy 0, policy_version 1847387 (0.0011) [2023-12-28 08:32:24,067][106226] Updated weights for policy 0, policy_version 1847397 (0.0010) [2023-12-28 08:32:24,113][106225] Updated weights for policy 1, policy_version 1851332 (0.0006) [2023-12-28 08:32:24,167][106225] Updated weights for policy 1, policy_version 1851342 (0.0009) [2023-12-28 08:32:24,225][106225] Updated weights for policy 1, policy_version 1851352 (0.0010) [2023-12-28 08:32:24,778][106226] Updated weights for policy 0, policy_version 1847407 (0.0008) [2023-12-28 08:32:24,836][106226] Updated weights for policy 0, policy_version 1847417 (0.0008) [2023-12-28 08:32:24,896][106226] Updated weights for policy 0, policy_version 1847427 (0.0008) [2023-12-28 08:32:24,945][106225] Updated weights for policy 1, policy_version 1851362 (0.0009) [2023-12-28 08:32:25,003][106225] Updated weights for policy 1, policy_version 1851372 (0.0009) [2023-12-28 08:32:25,054][106225] Updated weights for policy 1, policy_version 1851382 (0.0007) [2023-12-28 08:32:25,105][106225] Updated weights for policy 1, policy_version 1851392 (0.0010) [2023-12-28 08:32:25,569][106226] Updated weights for policy 0, policy_version 1847437 (0.0006) [2023-12-28 08:32:25,628][106226] Updated weights for policy 0, policy_version 1847447 (0.0005) [2023-12-28 08:32:25,685][106226] Updated weights for policy 0, policy_version 1847457 (0.0006) [2023-12-28 08:32:25,747][106225] Updated weights for policy 1, policy_version 1851402 (0.0005) [2023-12-28 08:32:25,795][106225] Updated weights for policy 1, policy_version 1851412 (0.0005) [2023-12-28 08:32:25,850][106225] Updated weights for policy 1, policy_version 1851422 (0.0005) [2023-12-28 08:32:26,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19660.8, 300 sec: 19660.8). Total num frames: 947052544. Throughput: 0: 9819.2, 1: 9743.8. Samples: 947020832. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:26,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.905')] [2023-12-28 08:32:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001851424_474021888.pth... [2023-12-28 08:32:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001847464_473030656.pth... [2023-12-28 08:32:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001850304_473735168.pth [2023-12-28 08:32:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001846312_472735744.pth [2023-12-28 08:32:26,276][106226] Updated weights for policy 0, policy_version 1847467 (0.0008) [2023-12-28 08:32:26,323][106226] Updated weights for policy 0, policy_version 1847477 (0.0010) [2023-12-28 08:32:26,371][106226] Updated weights for policy 0, policy_version 1847487 (0.0010) [2023-12-28 08:32:26,408][106225] Updated weights for policy 1, policy_version 1851432 (0.0006) [2023-12-28 08:32:26,462][106225] Updated weights for policy 1, policy_version 1851442 (0.0006) [2023-12-28 08:32:26,518][106225] Updated weights for policy 1, policy_version 1851452 (0.0006) [2023-12-28 08:32:27,004][106226] Updated weights for policy 0, policy_version 1847497 (0.0011) [2023-12-28 08:32:27,054][106226] Updated weights for policy 0, policy_version 1847507 (0.0010) [2023-12-28 08:32:27,123][106226] Updated weights for policy 0, policy_version 1847517 (0.0010) [2023-12-28 08:32:27,185][106226] Updated weights for policy 0, policy_version 1847527 (0.0010) [2023-12-28 08:32:27,204][106225] Updated weights for policy 1, policy_version 1851462 (0.0006) [2023-12-28 08:32:27,253][106225] Updated weights for policy 1, policy_version 1851472 (0.0009) [2023-12-28 08:32:27,312][106225] Updated weights for policy 1, policy_version 1851482 (0.0006) [2023-12-28 08:32:27,792][106226] Updated weights for policy 0, policy_version 1847537 (0.0010) [2023-12-28 08:32:27,852][106226] Updated weights for policy 0, policy_version 1847547 (0.0011) [2023-12-28 08:32:27,876][106225] Updated weights for policy 1, policy_version 1851492 (0.0006) [2023-12-28 08:32:27,901][106226] Updated weights for policy 0, policy_version 1847557 (0.0010) [2023-12-28 08:32:27,929][106225] Updated weights for policy 1, policy_version 1851502 (0.0006) [2023-12-28 08:32:27,985][106225] Updated weights for policy 1, policy_version 1851512 (0.0007) [2023-12-28 08:32:28,592][106226] Updated weights for policy 0, policy_version 1847567 (0.0010) [2023-12-28 08:32:28,656][106226] Updated weights for policy 0, policy_version 1847577 (0.0011) [2023-12-28 08:32:28,706][106225] Updated weights for policy 1, policy_version 1851522 (0.0008) [2023-12-28 08:32:28,712][106226] Updated weights for policy 0, policy_version 1847587 (0.0010) [2023-12-28 08:32:28,757][106225] Updated weights for policy 1, policy_version 1851532 (0.0006) [2023-12-28 08:32:28,814][106225] Updated weights for policy 1, policy_version 1851542 (0.0007) [2023-12-28 08:32:28,869][106225] Updated weights for policy 1, policy_version 1851552 (0.0008) [2023-12-28 08:32:29,381][106226] Updated weights for policy 0, policy_version 1847597 (0.0010) [2023-12-28 08:32:29,435][106226] Updated weights for policy 0, policy_version 1847607 (0.0010) [2023-12-28 08:32:29,487][106226] Updated weights for policy 0, policy_version 1847617 (0.0010) [2023-12-28 08:32:29,647][106225] Updated weights for policy 1, policy_version 1851562 (0.0008) [2023-12-28 08:32:29,705][106225] Updated weights for policy 1, policy_version 1851572 (0.0009) [2023-12-28 08:32:29,760][106225] Updated weights for policy 1, policy_version 1851583 (0.0009) [2023-12-28 08:32:30,128][106226] Updated weights for policy 0, policy_version 1847627 (0.0007) [2023-12-28 08:32:30,188][106226] Updated weights for policy 0, policy_version 1847637 (0.0010) [2023-12-28 08:32:30,246][106226] Updated weights for policy 0, policy_version 1847647 (0.0010) [2023-12-28 08:32:30,505][106225] Updated weights for policy 1, policy_version 1851593 (0.0008) [2023-12-28 08:32:30,566][106225] Updated weights for policy 1, policy_version 1851603 (0.0007) [2023-12-28 08:32:30,623][106225] Updated weights for policy 1, policy_version 1851613 (0.0009) [2023-12-28 08:32:30,868][106226] Updated weights for policy 0, policy_version 1847657 (0.0010) [2023-12-28 08:32:30,917][106226] Updated weights for policy 0, policy_version 1847667 (0.0009) [2023-12-28 08:32:30,971][106226] Updated weights for policy 0, policy_version 1847677 (0.0008) [2023-12-28 08:32:31,021][106226] Updated weights for policy 0, policy_version 1847687 (0.0007) [2023-12-28 08:32:31,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 947159040. Throughput: 0: 9985.2, 1: 9842.1. Samples: 947147092. Policy #0 lag: (min: 18.0, avg: 28.7, max: 50.0) [2023-12-28 08:32:31,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.569')] [2023-12-28 08:32:31,412][106225] Updated weights for policy 1, policy_version 1851623 (0.0008) [2023-12-28 08:32:31,476][106225] Updated weights for policy 1, policy_version 1851633 (0.0007) [2023-12-28 08:32:31,538][106225] Updated weights for policy 1, policy_version 1851643 (0.0008) [2023-12-28 08:32:31,778][106226] Updated weights for policy 0, policy_version 1847697 (0.0009) [2023-12-28 08:32:31,834][106226] Updated weights for policy 0, policy_version 1847707 (0.0009) [2023-12-28 08:32:31,894][106226] Updated weights for policy 0, policy_version 1847717 (0.0009) [2023-12-28 08:32:32,254][106225] Updated weights for policy 1, policy_version 1851653 (0.0009) [2023-12-28 08:32:32,319][106225] Updated weights for policy 1, policy_version 1851663 (0.0007) [2023-12-28 08:32:32,384][106225] Updated weights for policy 1, policy_version 1851673 (0.0008) [2023-12-28 08:32:32,643][106226] Updated weights for policy 0, policy_version 1847727 (0.0009) [2023-12-28 08:32:32,696][106226] Updated weights for policy 0, policy_version 1847737 (0.0009) [2023-12-28 08:32:32,748][106226] Updated weights for policy 0, policy_version 1847747 (0.0009) [2023-12-28 08:32:33,085][106225] Updated weights for policy 1, policy_version 1851683 (0.0008) [2023-12-28 08:32:33,138][106225] Updated weights for policy 1, policy_version 1851693 (0.0008) [2023-12-28 08:32:33,182][106225] Updated weights for policy 1, policy_version 1851703 (0.0008) [2023-12-28 08:32:33,492][106226] Updated weights for policy 0, policy_version 1847757 (0.0008) [2023-12-28 08:32:33,554][106226] Updated weights for policy 0, policy_version 1847767 (0.0008) [2023-12-28 08:32:33,615][106226] Updated weights for policy 0, policy_version 1847777 (0.0008) [2023-12-28 08:32:33,915][106225] Updated weights for policy 1, policy_version 1851713 (0.0008) [2023-12-28 08:32:33,963][106225] Updated weights for policy 1, policy_version 1851723 (0.0008) [2023-12-28 08:32:34,025][106225] Updated weights for policy 1, policy_version 1851733 (0.0008) [2023-12-28 08:32:34,083][106225] Updated weights for policy 1, policy_version 1851743 (0.0009) [2023-12-28 08:32:34,281][106226] Updated weights for policy 0, policy_version 1847787 (0.0008) [2023-12-28 08:32:34,347][106226] Updated weights for policy 0, policy_version 1847797 (0.0006) [2023-12-28 08:32:34,411][106226] Updated weights for policy 0, policy_version 1847807 (0.0008) [2023-12-28 08:32:34,858][106225] Updated weights for policy 1, policy_version 1851753 (0.0008) [2023-12-28 08:32:34,906][106225] Updated weights for policy 1, policy_version 1851763 (0.0008) [2023-12-28 08:32:34,952][106225] Updated weights for policy 1, policy_version 1851773 (0.0009) [2023-12-28 08:32:35,080][106226] Updated weights for policy 0, policy_version 1847817 (0.0008) [2023-12-28 08:32:35,138][106226] Updated weights for policy 0, policy_version 1847827 (0.0010) [2023-12-28 08:32:35,197][106226] Updated weights for policy 0, policy_version 1847837 (0.0007) [2023-12-28 08:32:35,249][106226] Updated weights for policy 0, policy_version 1847847 (0.0005) [2023-12-28 08:32:35,797][106225] Updated weights for policy 1, policy_version 1851783 (0.0008) [2023-12-28 08:32:35,798][106226] Updated weights for policy 0, policy_version 1847857 (0.0006) [2023-12-28 08:32:35,847][106225] Updated weights for policy 1, policy_version 1851793 (0.0007) [2023-12-28 08:32:35,865][106226] Updated weights for policy 0, policy_version 1847867 (0.0005) [2023-12-28 08:32:35,897][106225] Updated weights for policy 1, policy_version 1851803 (0.0008) [2023-12-28 08:32:35,925][106226] Updated weights for policy 0, policy_version 1847877 (0.0006) [2023-12-28 08:32:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 947257344. Throughput: 0: 10031.9, 1: 9722.0. Samples: 947264932. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:32:36,175][105115] Avg episode reward: [(0, '-4.524'), (1, '-4.986')] [2023-12-28 08:32:36,581][106225] Updated weights for policy 1, policy_version 1851813 (0.0007) [2023-12-28 08:32:36,599][106226] Updated weights for policy 0, policy_version 1847887 (0.0008) [2023-12-28 08:32:36,641][106225] Updated weights for policy 1, policy_version 1851823 (0.0008) [2023-12-28 08:32:36,664][106226] Updated weights for policy 0, policy_version 1847897 (0.0008) [2023-12-28 08:32:36,704][106225] Updated weights for policy 1, policy_version 1851833 (0.0007) [2023-12-28 08:32:36,726][106226] Updated weights for policy 0, policy_version 1847907 (0.0008) [2023-12-28 08:32:37,350][106225] Updated weights for policy 1, policy_version 1851843 (0.0007) [2023-12-28 08:32:37,391][106226] Updated weights for policy 0, policy_version 1847917 (0.0006) [2023-12-28 08:32:37,408][106225] Updated weights for policy 1, policy_version 1851853 (0.0008) [2023-12-28 08:32:37,441][106226] Updated weights for policy 0, policy_version 1847927 (0.0006) [2023-12-28 08:32:37,464][106225] Updated weights for policy 1, policy_version 1851863 (0.0009) [2023-12-28 08:32:37,502][106226] Updated weights for policy 0, policy_version 1847937 (0.0007) [2023-12-28 08:32:38,172][106226] Updated weights for policy 0, policy_version 1847947 (0.0007) [2023-12-28 08:32:38,196][106225] Updated weights for policy 1, policy_version 1851873 (0.0008) [2023-12-28 08:32:38,229][106226] Updated weights for policy 0, policy_version 1847957 (0.0008) [2023-12-28 08:32:38,250][106225] Updated weights for policy 1, policy_version 1851883 (0.0008) [2023-12-28 08:32:38,277][106226] Updated weights for policy 0, policy_version 1847967 (0.0008) [2023-12-28 08:32:38,307][106225] Updated weights for policy 1, policy_version 1851893 (0.0010) [2023-12-28 08:32:38,381][106225] Updated weights for policy 1, policy_version 1851903 (0.0008) [2023-12-28 08:32:38,988][106225] Updated weights for policy 1, policy_version 1851913 (0.0010) [2023-12-28 08:32:39,054][106225] Updated weights for policy 1, policy_version 1851923 (0.0009) [2023-12-28 08:32:39,111][106225] Updated weights for policy 1, policy_version 1851933 (0.0010) [2023-12-28 08:32:39,112][106226] Updated weights for policy 0, policy_version 1847977 (0.0009) [2023-12-28 08:32:39,179][106226] Updated weights for policy 0, policy_version 1847987 (0.0008) [2023-12-28 08:32:39,250][106226] Updated weights for policy 0, policy_version 1847997 (0.0008) [2023-12-28 08:32:39,317][106226] Updated weights for policy 0, policy_version 1848007 (0.0008) [2023-12-28 08:32:39,826][106225] Updated weights for policy 1, policy_version 1851943 (0.0009) [2023-12-28 08:32:39,891][106225] Updated weights for policy 1, policy_version 1851953 (0.0009) [2023-12-28 08:32:39,958][106225] Updated weights for policy 1, policy_version 1851963 (0.0008) [2023-12-28 08:32:40,077][106226] Updated weights for policy 0, policy_version 1848017 (0.0007) [2023-12-28 08:32:40,152][106226] Updated weights for policy 0, policy_version 1848027 (0.0006) [2023-12-28 08:32:40,217][106226] Updated weights for policy 0, policy_version 1848037 (0.0008) [2023-12-28 08:32:40,705][106225] Updated weights for policy 1, policy_version 1851973 (0.0008) [2023-12-28 08:32:40,772][106225] Updated weights for policy 1, policy_version 1851983 (0.0007) [2023-12-28 08:32:40,835][106225] Updated weights for policy 1, policy_version 1851993 (0.0007) [2023-12-28 08:32:40,881][106226] Updated weights for policy 0, policy_version 1848047 (0.0009) [2023-12-28 08:32:40,934][106226] Updated weights for policy 0, policy_version 1848057 (0.0008) [2023-12-28 08:32:40,984][106226] Updated weights for policy 0, policy_version 1848067 (0.0008) [2023-12-28 08:32:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19660.8). Total num frames: 947355648. Throughput: 0: 10027.0, 1: 9774.1. Samples: 947323696. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:32:41,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.601')] [2023-12-28 08:32:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001852000_474169344.pth... [2023-12-28 08:32:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001848072_473186304.pth... [2023-12-28 08:32:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001850880_473882624.pth [2023-12-28 08:32:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001846888_472883200.pth [2023-12-28 08:32:41,585][106225] Updated weights for policy 1, policy_version 1852003 (0.0009) [2023-12-28 08:32:41,654][106225] Updated weights for policy 1, policy_version 1852013 (0.0008) [2023-12-28 08:32:41,727][106225] Updated weights for policy 1, policy_version 1852023 (0.0009) [2023-12-28 08:32:41,782][106226] Updated weights for policy 0, policy_version 1848077 (0.0007) [2023-12-28 08:32:41,847][106226] Updated weights for policy 0, policy_version 1848087 (0.0009) [2023-12-28 08:32:41,911][106226] Updated weights for policy 0, policy_version 1848097 (0.0009) [2023-12-28 08:32:42,381][106225] Updated weights for policy 1, policy_version 1852033 (0.0008) [2023-12-28 08:32:42,444][106225] Updated weights for policy 1, policy_version 1852043 (0.0008) [2023-12-28 08:32:42,508][106225] Updated weights for policy 1, policy_version 1852053 (0.0006) [2023-12-28 08:32:42,578][106225] Updated weights for policy 1, policy_version 1852063 (0.0010) [2023-12-28 08:32:42,661][106226] Updated weights for policy 0, policy_version 1848107 (0.0010) [2023-12-28 08:32:42,728][106226] Updated weights for policy 0, policy_version 1848117 (0.0006) [2023-12-28 08:32:42,795][106226] Updated weights for policy 0, policy_version 1848127 (0.0008) [2023-12-28 08:32:43,305][106225] Updated weights for policy 1, policy_version 1852073 (0.0010) [2023-12-28 08:32:43,355][106225] Updated weights for policy 1, policy_version 1852083 (0.0010) [2023-12-28 08:32:43,408][106225] Updated weights for policy 1, policy_version 1852093 (0.0010) [2023-12-28 08:32:43,430][106226] Updated weights for policy 0, policy_version 1848137 (0.0007) [2023-12-28 08:32:43,497][106226] Updated weights for policy 0, policy_version 1848147 (0.0008) [2023-12-28 08:32:43,557][106226] Updated weights for policy 0, policy_version 1848157 (0.0008) [2023-12-28 08:32:43,614][106226] Updated weights for policy 0, policy_version 1848167 (0.0006) [2023-12-28 08:32:44,105][106225] Updated weights for policy 1, policy_version 1852103 (0.0007) [2023-12-28 08:32:44,152][106225] Updated weights for policy 1, policy_version 1852113 (0.0010) [2023-12-28 08:32:44,206][106225] Updated weights for policy 1, policy_version 1852123 (0.0010) [2023-12-28 08:32:44,225][106226] Updated weights for policy 0, policy_version 1848177 (0.0009) [2023-12-28 08:32:44,286][106226] Updated weights for policy 0, policy_version 1848187 (0.0010) [2023-12-28 08:32:44,336][106226] Updated weights for policy 0, policy_version 1848197 (0.0010) [2023-12-28 08:32:44,815][106225] Updated weights for policy 1, policy_version 1852133 (0.0009) [2023-12-28 08:32:44,880][106225] Updated weights for policy 1, policy_version 1852143 (0.0011) [2023-12-28 08:32:44,941][106225] Updated weights for policy 1, policy_version 1852153 (0.0010) [2023-12-28 08:32:45,035][106226] Updated weights for policy 0, policy_version 1848207 (0.0011) [2023-12-28 08:32:45,097][106226] Updated weights for policy 0, policy_version 1848217 (0.0010) [2023-12-28 08:32:45,162][106226] Updated weights for policy 0, policy_version 1848227 (0.0011) [2023-12-28 08:32:45,645][106225] Updated weights for policy 1, policy_version 1852163 (0.0010) [2023-12-28 08:32:45,702][106225] Updated weights for policy 1, policy_version 1852173 (0.0010) [2023-12-28 08:32:45,763][106225] Updated weights for policy 1, policy_version 1852183 (0.0010) [2023-12-28 08:32:45,879][106226] Updated weights for policy 0, policy_version 1848237 (0.0009) [2023-12-28 08:32:45,936][106226] Updated weights for policy 0, policy_version 1848247 (0.0005) [2023-12-28 08:32:45,991][106226] Updated weights for policy 0, policy_version 1848257 (0.0008) [2023-12-28 08:32:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 947453952. Throughput: 0: 10006.3, 1: 9786.8. Samples: 947440972. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:32:46,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.722')] [2023-12-28 08:32:46,382][106225] Updated weights for policy 1, policy_version 1852193 (0.0010) [2023-12-28 08:32:46,430][106225] Updated weights for policy 1, policy_version 1852203 (0.0007) [2023-12-28 08:32:46,484][106225] Updated weights for policy 1, policy_version 1852213 (0.0010) [2023-12-28 08:32:46,547][106225] Updated weights for policy 1, policy_version 1852223 (0.0006) [2023-12-28 08:32:46,706][106226] Updated weights for policy 0, policy_version 1848267 (0.0008) [2023-12-28 08:32:46,758][106226] Updated weights for policy 0, policy_version 1848277 (0.0010) [2023-12-28 08:32:46,808][106226] Updated weights for policy 0, policy_version 1848287 (0.0010) [2023-12-28 08:32:47,215][106225] Updated weights for policy 1, policy_version 1852233 (0.0006) [2023-12-28 08:32:47,274][106225] Updated weights for policy 1, policy_version 1852243 (0.0007) [2023-12-28 08:32:47,323][106225] Updated weights for policy 1, policy_version 1852253 (0.0007) [2023-12-28 08:32:47,528][106226] Updated weights for policy 0, policy_version 1848297 (0.0010) [2023-12-28 08:32:47,595][106226] Updated weights for policy 0, policy_version 1848307 (0.0008) [2023-12-28 08:32:47,660][106226] Updated weights for policy 0, policy_version 1848317 (0.0005) [2023-12-28 08:32:47,724][106226] Updated weights for policy 0, policy_version 1848327 (0.0005) [2023-12-28 08:32:47,961][106225] Updated weights for policy 1, policy_version 1852263 (0.0006) [2023-12-28 08:32:48,019][106225] Updated weights for policy 1, policy_version 1852273 (0.0006) [2023-12-28 08:32:48,078][106225] Updated weights for policy 1, policy_version 1852283 (0.0007) [2023-12-28 08:32:48,378][106226] Updated weights for policy 0, policy_version 1848337 (0.0011) [2023-12-28 08:32:48,434][106226] Updated weights for policy 0, policy_version 1848347 (0.0011) [2023-12-28 08:32:48,493][106226] Updated weights for policy 0, policy_version 1848357 (0.0006) [2023-12-28 08:32:48,789][106225] Updated weights for policy 1, policy_version 1852293 (0.0008) [2023-12-28 08:32:48,847][106225] Updated weights for policy 1, policy_version 1852303 (0.0008) [2023-12-28 08:32:48,905][106225] Updated weights for policy 1, policy_version 1852313 (0.0007) [2023-12-28 08:32:49,147][106226] Updated weights for policy 0, policy_version 1848367 (0.0010) [2023-12-28 08:32:49,210][106226] Updated weights for policy 0, policy_version 1848377 (0.0011) [2023-12-28 08:32:49,277][106226] Updated weights for policy 0, policy_version 1848387 (0.0010) [2023-12-28 08:32:49,690][106225] Updated weights for policy 1, policy_version 1852323 (0.0009) [2023-12-28 08:32:49,751][106225] Updated weights for policy 1, policy_version 1852333 (0.0010) [2023-12-28 08:32:49,808][106225] Updated weights for policy 1, policy_version 1852343 (0.0010) [2023-12-28 08:32:50,017][106226] Updated weights for policy 0, policy_version 1848397 (0.0009) [2023-12-28 08:32:50,072][106226] Updated weights for policy 0, policy_version 1848407 (0.0008) [2023-12-28 08:32:50,124][106226] Updated weights for policy 0, policy_version 1848417 (0.0008) [2023-12-28 08:32:50,577][106225] Updated weights for policy 1, policy_version 1852353 (0.0009) [2023-12-28 08:32:50,646][106225] Updated weights for policy 1, policy_version 1852363 (0.0009) [2023-12-28 08:32:50,710][106225] Updated weights for policy 1, policy_version 1852373 (0.0005) [2023-12-28 08:32:50,775][106225] Updated weights for policy 1, policy_version 1852383 (0.0006) [2023-12-28 08:32:50,825][106226] Updated weights for policy 0, policy_version 1848427 (0.0007) [2023-12-28 08:32:50,883][106226] Updated weights for policy 0, policy_version 1848437 (0.0008) [2023-12-28 08:32:50,939][106226] Updated weights for policy 0, policy_version 1848447 (0.0008) [2023-12-28 08:32:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 947552256. Throughput: 0: 9913.2, 1: 9767.9. Samples: 947559248. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:32:51,175][105115] Avg episode reward: [(0, '-4.300'), (1, '-4.615')] [2023-12-28 08:32:51,448][106225] Updated weights for policy 1, policy_version 1852393 (0.0009) [2023-12-28 08:32:51,514][106225] Updated weights for policy 1, policy_version 1852403 (0.0010) [2023-12-28 08:32:51,568][106225] Updated weights for policy 1, policy_version 1852413 (0.0010) [2023-12-28 08:32:51,738][106226] Updated weights for policy 0, policy_version 1848457 (0.0008) [2023-12-28 08:32:51,802][106226] Updated weights for policy 0, policy_version 1848467 (0.0006) [2023-12-28 08:32:51,863][106226] Updated weights for policy 0, policy_version 1848477 (0.0006) [2023-12-28 08:32:51,922][106226] Updated weights for policy 0, policy_version 1848487 (0.0006) [2023-12-28 08:32:52,216][106225] Updated weights for policy 1, policy_version 1852423 (0.0009) [2023-12-28 08:32:52,268][106225] Updated weights for policy 1, policy_version 1852433 (0.0008) [2023-12-28 08:32:52,325][106225] Updated weights for policy 1, policy_version 1852443 (0.0007) [2023-12-28 08:32:52,630][106226] Updated weights for policy 0, policy_version 1848497 (0.0010) [2023-12-28 08:32:52,694][106226] Updated weights for policy 0, policy_version 1848507 (0.0010) [2023-12-28 08:32:52,753][106226] Updated weights for policy 0, policy_version 1848517 (0.0009) [2023-12-28 08:32:52,932][106225] Updated weights for policy 1, policy_version 1852453 (0.0009) [2023-12-28 08:32:52,978][106225] Updated weights for policy 1, policy_version 1852463 (0.0010) [2023-12-28 08:32:53,027][106225] Updated weights for policy 1, policy_version 1852473 (0.0005) [2023-12-28 08:32:53,333][106226] Updated weights for policy 0, policy_version 1848527 (0.0010) [2023-12-28 08:32:53,394][106226] Updated weights for policy 0, policy_version 1848538 (0.0011) [2023-12-28 08:32:53,452][106226] Updated weights for policy 0, policy_version 1848548 (0.0008) [2023-12-28 08:32:53,633][106225] Updated weights for policy 1, policy_version 1852483 (0.0006) [2023-12-28 08:32:53,696][106225] Updated weights for policy 1, policy_version 1852493 (0.0010) [2023-12-28 08:32:53,751][106225] Updated weights for policy 1, policy_version 1852503 (0.0010) [2023-12-28 08:32:54,096][106226] Updated weights for policy 0, policy_version 1848558 (0.0007) [2023-12-28 08:32:54,148][106226] Updated weights for policy 0, policy_version 1848568 (0.0008) [2023-12-28 08:32:54,199][106226] Updated weights for policy 0, policy_version 1848578 (0.0009) [2023-12-28 08:32:54,380][106225] Updated weights for policy 1, policy_version 1852513 (0.0010) [2023-12-28 08:32:54,449][106225] Updated weights for policy 1, policy_version 1852523 (0.0006) [2023-12-28 08:32:54,510][106225] Updated weights for policy 1, policy_version 1852533 (0.0010) [2023-12-28 08:32:54,572][106225] Updated weights for policy 1, policy_version 1852543 (0.0010) [2023-12-28 08:32:55,038][106226] Updated weights for policy 0, policy_version 1848588 (0.0008) [2023-12-28 08:32:55,098][106226] Updated weights for policy 0, policy_version 1848598 (0.0009) [2023-12-28 08:32:55,113][106225] Updated weights for policy 1, policy_version 1852553 (0.0010) [2023-12-28 08:32:55,154][106226] Updated weights for policy 0, policy_version 1848608 (0.0006) [2023-12-28 08:32:55,166][106225] Updated weights for policy 1, policy_version 1852563 (0.0010) [2023-12-28 08:32:55,222][106225] Updated weights for policy 1, policy_version 1852573 (0.0010) [2023-12-28 08:32:55,827][106226] Updated weights for policy 0, policy_version 1848618 (0.0006) [2023-12-28 08:32:55,887][106226] Updated weights for policy 0, policy_version 1848628 (0.0006) [2023-12-28 08:32:55,904][106225] Updated weights for policy 1, policy_version 1852583 (0.0010) [2023-12-28 08:32:55,941][106226] Updated weights for policy 0, policy_version 1848638 (0.0005) [2023-12-28 08:32:55,951][106225] Updated weights for policy 1, policy_version 1852593 (0.0010) [2023-12-28 08:32:55,993][106226] Updated weights for policy 0, policy_version 1848648 (0.0005) [2023-12-28 08:32:56,005][106225] Updated weights for policy 1, policy_version 1852603 (0.0010) [2023-12-28 08:32:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 947658752. Throughput: 0: 9927.8, 1: 9840.4. Samples: 947621900. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:32:56,175][105115] Avg episode reward: [(0, '-4.520'), (1, '-4.858')] [2023-12-28 08:32:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001848648_473333760.pth... [2023-12-28 08:32:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001852608_474324992.pth... [2023-12-28 08:32:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001847464_473030656.pth [2023-12-28 08:32:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001851424_474021888.pth [2023-12-28 08:32:56,620][106226] Updated weights for policy 0, policy_version 1848658 (0.0007) [2023-12-28 08:32:56,682][106225] Updated weights for policy 1, policy_version 1852613 (0.0010) [2023-12-28 08:32:56,685][106226] Updated weights for policy 0, policy_version 1848668 (0.0008) [2023-12-28 08:32:56,747][106225] Updated weights for policy 1, policy_version 1852623 (0.0010) [2023-12-28 08:32:56,752][106226] Updated weights for policy 0, policy_version 1848678 (0.0006) [2023-12-28 08:32:56,808][106225] Updated weights for policy 1, policy_version 1852633 (0.0010) [2023-12-28 08:32:57,420][106225] Updated weights for policy 1, policy_version 1852644 (0.0010) [2023-12-28 08:32:57,459][106226] Updated weights for policy 0, policy_version 1848688 (0.0007) [2023-12-28 08:32:57,475][106225] Updated weights for policy 1, policy_version 1852654 (0.0006) [2023-12-28 08:32:57,521][106226] Updated weights for policy 0, policy_version 1848698 (0.0005) [2023-12-28 08:32:57,538][106225] Updated weights for policy 1, policy_version 1852664 (0.0007) [2023-12-28 08:32:57,583][106226] Updated weights for policy 0, policy_version 1848708 (0.0006) [2023-12-28 08:32:58,151][106226] Updated weights for policy 0, policy_version 1848718 (0.0005) [2023-12-28 08:32:58,204][106226] Updated weights for policy 0, policy_version 1848728 (0.0005) [2023-12-28 08:32:58,246][106225] Updated weights for policy 1, policy_version 1852674 (0.0007) [2023-12-28 08:32:58,266][106226] Updated weights for policy 0, policy_version 1848738 (0.0007) [2023-12-28 08:32:58,309][106225] Updated weights for policy 1, policy_version 1852684 (0.0008) [2023-12-28 08:32:58,375][106225] Updated weights for policy 1, policy_version 1852694 (0.0008) [2023-12-28 08:32:58,438][106225] Updated weights for policy 1, policy_version 1852704 (0.0008) [2023-12-28 08:32:59,049][106226] Updated weights for policy 0, policy_version 1848748 (0.0007) [2023-12-28 08:32:59,112][106226] Updated weights for policy 0, policy_version 1848758 (0.0009) [2023-12-28 08:32:59,172][106226] Updated weights for policy 0, policy_version 1848768 (0.0009) [2023-12-28 08:32:59,228][106225] Updated weights for policy 1, policy_version 1852714 (0.0007) [2023-12-28 08:32:59,298][106225] Updated weights for policy 1, policy_version 1852724 (0.0009) [2023-12-28 08:32:59,365][106225] Updated weights for policy 1, policy_version 1852734 (0.0008) [2023-12-28 08:32:59,978][106226] Updated weights for policy 0, policy_version 1848778 (0.0008) [2023-12-28 08:33:00,029][106226] Updated weights for policy 0, policy_version 1848788 (0.0008) [2023-12-28 08:33:00,082][106225] Updated weights for policy 1, policy_version 1852744 (0.0008) [2023-12-28 08:33:00,092][106226] Updated weights for policy 0, policy_version 1848798 (0.0007) [2023-12-28 08:33:00,130][106225] Updated weights for policy 1, policy_version 1852754 (0.0006) [2023-12-28 08:33:00,144][106226] Updated weights for policy 0, policy_version 1848808 (0.0006) [2023-12-28 08:33:00,177][106225] Updated weights for policy 1, policy_version 1852764 (0.0008) [2023-12-28 08:33:00,770][106225] Updated weights for policy 1, policy_version 1852774 (0.0007) [2023-12-28 08:33:00,836][106225] Updated weights for policy 1, policy_version 1852784 (0.0005) [2023-12-28 08:33:00,903][106225] Updated weights for policy 1, policy_version 1852794 (0.0005) [2023-12-28 08:33:00,979][106226] Updated weights for policy 0, policy_version 1848818 (0.0010) [2023-12-28 08:33:01,035][106226] Updated weights for policy 0, policy_version 1848828 (0.0008) [2023-12-28 08:33:01,103][106226] Updated weights for policy 0, policy_version 1848838 (0.0007) [2023-12-28 08:33:01,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19688.6). Total num frames: 947757056. Throughput: 0: 9933.6, 1: 9936.6. Samples: 947741256. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:01,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.430')] [2023-12-28 08:33:01,502][106225] Updated weights for policy 1, policy_version 1852804 (0.0008) [2023-12-28 08:33:01,558][106225] Updated weights for policy 1, policy_version 1852814 (0.0008) [2023-12-28 08:33:01,617][106225] Updated weights for policy 1, policy_version 1852824 (0.0008) [2023-12-28 08:33:01,855][106226] Updated weights for policy 0, policy_version 1848848 (0.0009) [2023-12-28 08:33:01,907][106226] Updated weights for policy 0, policy_version 1848858 (0.0008) [2023-12-28 08:33:01,966][106226] Updated weights for policy 0, policy_version 1848868 (0.0008) [2023-12-28 08:33:02,370][106225] Updated weights for policy 1, policy_version 1852834 (0.0007) [2023-12-28 08:33:02,426][106225] Updated weights for policy 1, policy_version 1852844 (0.0008) [2023-12-28 08:33:02,480][106225] Updated weights for policy 1, policy_version 1852854 (0.0009) [2023-12-28 08:33:02,536][106225] Updated weights for policy 1, policy_version 1852864 (0.0007) [2023-12-28 08:33:02,672][106226] Updated weights for policy 0, policy_version 1848878 (0.0008) [2023-12-28 08:33:02,736][106226] Updated weights for policy 0, policy_version 1848888 (0.0008) [2023-12-28 08:33:02,786][106226] Updated weights for policy 0, policy_version 1848898 (0.0009) [2023-12-28 08:33:03,230][106225] Updated weights for policy 1, policy_version 1852874 (0.0009) [2023-12-28 08:33:03,289][106225] Updated weights for policy 1, policy_version 1852884 (0.0008) [2023-12-28 08:33:03,338][106225] Updated weights for policy 1, policy_version 1852894 (0.0007) [2023-12-28 08:33:03,410][106226] Updated weights for policy 0, policy_version 1848908 (0.0007) [2023-12-28 08:33:03,460][106226] Updated weights for policy 0, policy_version 1848918 (0.0010) [2023-12-28 08:33:03,512][106226] Updated weights for policy 0, policy_version 1848928 (0.0010) [2023-12-28 08:33:04,070][106225] Updated weights for policy 1, policy_version 1852904 (0.0008) [2023-12-28 08:33:04,142][106225] Updated weights for policy 1, policy_version 1852914 (0.0008) [2023-12-28 08:33:04,204][106225] Updated weights for policy 1, policy_version 1852924 (0.0006) [2023-12-28 08:33:04,223][106226] Updated weights for policy 0, policy_version 1848938 (0.0010) [2023-12-28 08:33:04,278][106226] Updated weights for policy 0, policy_version 1848948 (0.0008) [2023-12-28 08:33:04,339][106226] Updated weights for policy 0, policy_version 1848958 (0.0008) [2023-12-28 08:33:04,400][106226] Updated weights for policy 0, policy_version 1848968 (0.0009) [2023-12-28 08:33:04,967][106225] Updated weights for policy 1, policy_version 1852934 (0.0008) [2023-12-28 08:33:05,022][106225] Updated weights for policy 1, policy_version 1852944 (0.0008) [2023-12-28 08:33:05,039][106226] Updated weights for policy 0, policy_version 1848978 (0.0006) [2023-12-28 08:33:05,092][106225] Updated weights for policy 1, policy_version 1852954 (0.0008) [2023-12-28 08:33:05,100][106226] Updated weights for policy 0, policy_version 1848988 (0.0006) [2023-12-28 08:33:05,161][106226] Updated weights for policy 0, policy_version 1848998 (0.0005) [2023-12-28 08:33:05,745][106226] Updated weights for policy 0, policy_version 1849008 (0.0008) [2023-12-28 08:33:05,798][106226] Updated weights for policy 0, policy_version 1849018 (0.0009) [2023-12-28 08:33:05,852][106225] Updated weights for policy 1, policy_version 1852964 (0.0008) [2023-12-28 08:33:05,854][106226] Updated weights for policy 0, policy_version 1849028 (0.0007) [2023-12-28 08:33:05,909][106225] Updated weights for policy 1, policy_version 1852974 (0.0007) [2023-12-28 08:33:05,962][106225] Updated weights for policy 1, policy_version 1852984 (0.0007) [2023-12-28 08:33:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19934.0, 300 sec: 19688.6). Total num frames: 947855360. Throughput: 0: 9970.2, 1: 9978.6. Samples: 947860860. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:06,175][105115] Avg episode reward: [(0, '-4.143'), (1, '-4.740')] [2023-12-28 08:33:06,615][106226] Updated weights for policy 0, policy_version 1849038 (0.0008) [2023-12-28 08:33:06,673][106225] Updated weights for policy 1, policy_version 1852994 (0.0008) [2023-12-28 08:33:06,686][106226] Updated weights for policy 0, policy_version 1849048 (0.0009) [2023-12-28 08:33:06,734][106225] Updated weights for policy 1, policy_version 1853004 (0.0006) [2023-12-28 08:33:06,755][106226] Updated weights for policy 0, policy_version 1849058 (0.0009) [2023-12-28 08:33:06,787][106225] Updated weights for policy 1, policy_version 1853014 (0.0006) [2023-12-28 08:33:06,853][106225] Updated weights for policy 1, policy_version 1853024 (0.0008) [2023-12-28 08:33:07,392][106226] Updated weights for policy 0, policy_version 1849068 (0.0008) [2023-12-28 08:33:07,462][106226] Updated weights for policy 0, policy_version 1849078 (0.0010) [2023-12-28 08:33:07,532][106226] Updated weights for policy 0, policy_version 1849088 (0.0011) [2023-12-28 08:33:07,558][106225] Updated weights for policy 1, policy_version 1853034 (0.0006) [2023-12-28 08:33:07,616][106225] Updated weights for policy 1, policy_version 1853044 (0.0006) [2023-12-28 08:33:07,678][106225] Updated weights for policy 1, policy_version 1853054 (0.0008) [2023-12-28 08:33:08,171][106226] Updated weights for policy 0, policy_version 1849098 (0.0007) [2023-12-28 08:33:08,231][106226] Updated weights for policy 0, policy_version 1849108 (0.0006) [2023-12-28 08:33:08,286][106226] Updated weights for policy 0, policy_version 1849118 (0.0005) [2023-12-28 08:33:08,337][106225] Updated weights for policy 1, policy_version 1853064 (0.0006) [2023-12-28 08:33:08,357][106226] Updated weights for policy 0, policy_version 1849128 (0.0009) [2023-12-28 08:33:08,400][106225] Updated weights for policy 1, policy_version 1853074 (0.0008) [2023-12-28 08:33:08,460][106225] Updated weights for policy 1, policy_version 1853084 (0.0008) [2023-12-28 08:33:09,040][106226] Updated weights for policy 0, policy_version 1849138 (0.0005) [2023-12-28 08:33:09,091][106226] Updated weights for policy 0, policy_version 1849148 (0.0008) [2023-12-28 08:33:09,131][106225] Updated weights for policy 1, policy_version 1853094 (0.0009) [2023-12-28 08:33:09,142][106226] Updated weights for policy 0, policy_version 1849158 (0.0011) [2023-12-28 08:33:09,185][106225] Updated weights for policy 1, policy_version 1853104 (0.0005) [2023-12-28 08:33:09,246][106225] Updated weights for policy 1, policy_version 1853114 (0.0009) [2023-12-28 08:33:09,915][106226] Updated weights for policy 0, policy_version 1849168 (0.0011) [2023-12-28 08:33:09,960][106225] Updated weights for policy 1, policy_version 1853124 (0.0007) [2023-12-28 08:33:09,988][106226] Updated weights for policy 0, policy_version 1849178 (0.0009) [2023-12-28 08:33:10,030][106225] Updated weights for policy 1, policy_version 1853134 (0.0008) [2023-12-28 08:33:10,057][106226] Updated weights for policy 0, policy_version 1849188 (0.0007) [2023-12-28 08:33:10,098][106225] Updated weights for policy 1, policy_version 1853144 (0.0008) [2023-12-28 08:33:10,801][106226] Updated weights for policy 0, policy_version 1849198 (0.0008) [2023-12-28 08:33:10,862][106226] Updated weights for policy 0, policy_version 1849208 (0.0008) [2023-12-28 08:33:10,904][106225] Updated weights for policy 1, policy_version 1853154 (0.0009) [2023-12-28 08:33:10,919][106226] Updated weights for policy 0, policy_version 1849218 (0.0007) [2023-12-28 08:33:10,962][106225] Updated weights for policy 1, policy_version 1853164 (0.0010) [2023-12-28 08:33:11,015][106225] Updated weights for policy 1, policy_version 1853174 (0.0008) [2023-12-28 08:33:11,080][106225] Updated weights for policy 1, policy_version 1853184 (0.0008) [2023-12-28 08:33:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 947953664. Throughput: 0: 9990.0, 1: 10008.4. Samples: 947920756. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:11,175][105115] Avg episode reward: [(0, '-4.294'), (1, '-4.493')] [2023-12-28 08:33:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001853184_474472448.pth... [2023-12-28 08:33:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001849224_473481216.pth... [2023-12-28 08:33:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001852000_474169344.pth [2023-12-28 08:33:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001848072_473186304.pth [2023-12-28 08:33:11,719][106226] Updated weights for policy 0, policy_version 1849228 (0.0009) [2023-12-28 08:33:11,787][106226] Updated weights for policy 0, policy_version 1849238 (0.0009) [2023-12-28 08:33:11,852][106226] Updated weights for policy 0, policy_version 1849248 (0.0009) [2023-12-28 08:33:11,903][106225] Updated weights for policy 1, policy_version 1853194 (0.0008) [2023-12-28 08:33:11,967][106225] Updated weights for policy 1, policy_version 1853204 (0.0009) [2023-12-28 08:33:12,032][106225] Updated weights for policy 1, policy_version 1853214 (0.0009) [2023-12-28 08:33:12,579][106226] Updated weights for policy 0, policy_version 1849258 (0.0008) [2023-12-28 08:33:12,646][106226] Updated weights for policy 0, policy_version 1849268 (0.0006) [2023-12-28 08:33:12,709][106226] Updated weights for policy 0, policy_version 1849278 (0.0006) [2023-12-28 08:33:12,750][106225] Updated weights for policy 1, policy_version 1853224 (0.0007) [2023-12-28 08:33:12,764][106226] Updated weights for policy 0, policy_version 1849288 (0.0008) [2023-12-28 08:33:12,802][106225] Updated weights for policy 1, policy_version 1853234 (0.0007) [2023-12-28 08:33:12,851][106225] Updated weights for policy 1, policy_version 1853244 (0.0008) [2023-12-28 08:33:13,437][106226] Updated weights for policy 0, policy_version 1849298 (0.0008) [2023-12-28 08:33:13,496][106226] Updated weights for policy 0, policy_version 1849308 (0.0009) [2023-12-28 08:33:13,551][106226] Updated weights for policy 0, policy_version 1849318 (0.0008) [2023-12-28 08:33:13,605][106225] Updated weights for policy 1, policy_version 1853254 (0.0009) [2023-12-28 08:33:13,661][106225] Updated weights for policy 1, policy_version 1853264 (0.0008) [2023-12-28 08:33:13,712][106225] Updated weights for policy 1, policy_version 1853274 (0.0008) [2023-12-28 08:33:14,267][106226] Updated weights for policy 0, policy_version 1849328 (0.0008) [2023-12-28 08:33:14,328][106226] Updated weights for policy 0, policy_version 1849338 (0.0010) [2023-12-28 08:33:14,384][106226] Updated weights for policy 0, policy_version 1849348 (0.0009) [2023-12-28 08:33:14,423][106225] Updated weights for policy 1, policy_version 1853284 (0.0008) [2023-12-28 08:33:14,473][106225] Updated weights for policy 1, policy_version 1853294 (0.0008) [2023-12-28 08:33:14,532][106225] Updated weights for policy 1, policy_version 1853304 (0.0009) [2023-12-28 08:33:15,151][106226] Updated weights for policy 0, policy_version 1849358 (0.0009) [2023-12-28 08:33:15,216][106226] Updated weights for policy 0, policy_version 1849368 (0.0009) [2023-12-28 08:33:15,227][106225] Updated weights for policy 1, policy_version 1853314 (0.0008) [2023-12-28 08:33:15,281][106226] Updated weights for policy 0, policy_version 1849378 (0.0009) [2023-12-28 08:33:15,288][106225] Updated weights for policy 1, policy_version 1853324 (0.0006) [2023-12-28 08:33:15,345][106225] Updated weights for policy 1, policy_version 1853334 (0.0007) [2023-12-28 08:33:15,398][106225] Updated weights for policy 1, policy_version 1853344 (0.0009) [2023-12-28 08:33:15,999][106226] Updated weights for policy 0, policy_version 1849388 (0.0007) [2023-12-28 08:33:16,062][106226] Updated weights for policy 0, policy_version 1849398 (0.0009) [2023-12-28 08:33:16,121][106226] Updated weights for policy 0, policy_version 1849408 (0.0008) [2023-12-28 08:33:16,144][106225] Updated weights for policy 1, policy_version 1853354 (0.0007) [2023-12-28 08:33:16,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.5, 300 sec: 19688.6). Total num frames: 948043776. Throughput: 0: 9820.1, 1: 9867.1. Samples: 948033016. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:16,175][105115] Avg episode reward: [(0, '-4.243'), (1, '-4.872')] [2023-12-28 08:33:16,201][106225] Updated weights for policy 1, policy_version 1853364 (0.0006) [2023-12-28 08:33:16,251][106225] Updated weights for policy 1, policy_version 1853374 (0.0006) [2023-12-28 08:33:16,829][106225] Updated weights for policy 1, policy_version 1853384 (0.0005) [2023-12-28 08:33:16,855][106226] Updated weights for policy 0, policy_version 1849418 (0.0009) [2023-12-28 08:33:16,890][106225] Updated weights for policy 1, policy_version 1853394 (0.0006) [2023-12-28 08:33:16,913][106226] Updated weights for policy 0, policy_version 1849428 (0.0010) [2023-12-28 08:33:16,953][106225] Updated weights for policy 1, policy_version 1853404 (0.0006) [2023-12-28 08:33:16,973][106226] Updated weights for policy 0, policy_version 1849438 (0.0011) [2023-12-28 08:33:17,034][106226] Updated weights for policy 0, policy_version 1849448 (0.0011) [2023-12-28 08:33:17,558][106225] Updated weights for policy 1, policy_version 1853414 (0.0007) [2023-12-28 08:33:17,614][106225] Updated weights for policy 1, policy_version 1853424 (0.0007) [2023-12-28 08:33:17,667][106225] Updated weights for policy 1, policy_version 1853434 (0.0008) [2023-12-28 08:33:17,757][106226] Updated weights for policy 0, policy_version 1849458 (0.0010) [2023-12-28 08:33:17,811][106226] Updated weights for policy 0, policy_version 1849468 (0.0010) [2023-12-28 08:33:17,870][106226] Updated weights for policy 0, policy_version 1849478 (0.0010) [2023-12-28 08:33:18,306][106225] Updated weights for policy 1, policy_version 1853444 (0.0007) [2023-12-28 08:33:18,373][106225] Updated weights for policy 1, policy_version 1853454 (0.0008) [2023-12-28 08:33:18,425][106225] Updated weights for policy 1, policy_version 1853464 (0.0008) [2023-12-28 08:33:18,594][106226] Updated weights for policy 0, policy_version 1849488 (0.0011) [2023-12-28 08:33:18,656][106226] Updated weights for policy 0, policy_version 1849498 (0.0011) [2023-12-28 08:33:18,719][106226] Updated weights for policy 0, policy_version 1849508 (0.0010) [2023-12-28 08:33:19,150][106225] Updated weights for policy 1, policy_version 1853474 (0.0008) [2023-12-28 08:33:19,210][106225] Updated weights for policy 1, policy_version 1853484 (0.0008) [2023-12-28 08:33:19,270][106225] Updated weights for policy 1, policy_version 1853494 (0.0009) [2023-12-28 08:33:19,329][106225] Updated weights for policy 1, policy_version 1853504 (0.0008) [2023-12-28 08:33:19,446][106226] Updated weights for policy 0, policy_version 1849518 (0.0008) [2023-12-28 08:33:19,514][106226] Updated weights for policy 0, policy_version 1849528 (0.0008) [2023-12-28 08:33:19,581][106226] Updated weights for policy 0, policy_version 1849538 (0.0011) [2023-12-28 08:33:20,065][106225] Updated weights for policy 1, policy_version 1853514 (0.0009) [2023-12-28 08:33:20,129][106225] Updated weights for policy 1, policy_version 1853524 (0.0009) [2023-12-28 08:33:20,195][106225] Updated weights for policy 1, policy_version 1853534 (0.0008) [2023-12-28 08:33:20,273][106226] Updated weights for policy 0, policy_version 1849548 (0.0010) [2023-12-28 08:33:20,329][106226] Updated weights for policy 0, policy_version 1849558 (0.0008) [2023-12-28 08:33:20,386][106226] Updated weights for policy 0, policy_version 1849568 (0.0006) [2023-12-28 08:33:20,990][106225] Updated weights for policy 1, policy_version 1853544 (0.0008) [2023-12-28 08:33:21,060][106225] Updated weights for policy 1, policy_version 1853554 (0.0008) [2023-12-28 08:33:21,134][106225] Updated weights for policy 1, policy_version 1853564 (0.0009) [2023-12-28 08:33:21,173][106226] Updated weights for policy 0, policy_version 1849578 (0.0009) [2023-12-28 08:33:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 948142080. Throughput: 0: 9717.2, 1: 9961.3. Samples: 948150460. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:21,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.834')] [2023-12-28 08:33:21,234][106226] Updated weights for policy 0, policy_version 1849588 (0.0009) [2023-12-28 08:33:21,300][106226] Updated weights for policy 0, policy_version 1849598 (0.0009) [2023-12-28 08:33:21,361][106226] Updated weights for policy 0, policy_version 1849608 (0.0007) [2023-12-28 08:33:21,917][106225] Updated weights for policy 1, policy_version 1853574 (0.0008) [2023-12-28 08:33:21,980][106225] Updated weights for policy 1, policy_version 1853584 (0.0006) [2023-12-28 08:33:22,032][106225] Updated weights for policy 1, policy_version 1853594 (0.0006) [2023-12-28 08:33:22,111][106226] Updated weights for policy 0, policy_version 1849618 (0.0007) [2023-12-28 08:33:22,178][106226] Updated weights for policy 0, policy_version 1849628 (0.0007) [2023-12-28 08:33:22,238][106226] Updated weights for policy 0, policy_version 1849638 (0.0005) [2023-12-28 08:33:22,744][106225] Updated weights for policy 1, policy_version 1853604 (0.0007) [2023-12-28 08:33:22,807][106225] Updated weights for policy 1, policy_version 1853614 (0.0007) [2023-12-28 08:33:22,869][106225] Updated weights for policy 1, policy_version 1853624 (0.0010) [2023-12-28 08:33:22,912][106226] Updated weights for policy 0, policy_version 1849648 (0.0010) [2023-12-28 08:33:22,973][106226] Updated weights for policy 0, policy_version 1849658 (0.0010) [2023-12-28 08:33:23,033][106226] Updated weights for policy 0, policy_version 1849668 (0.0010) [2023-12-28 08:33:23,456][106225] Updated weights for policy 1, policy_version 1853634 (0.0007) [2023-12-28 08:33:23,506][106225] Updated weights for policy 1, policy_version 1853644 (0.0005) [2023-12-28 08:33:23,559][106225] Updated weights for policy 1, policy_version 1853654 (0.0005) [2023-12-28 08:33:23,612][106225] Updated weights for policy 1, policy_version 1853664 (0.0005) [2023-12-28 08:33:23,735][106226] Updated weights for policy 0, policy_version 1849678 (0.0007) [2023-12-28 08:33:23,786][106226] Updated weights for policy 0, policy_version 1849688 (0.0005) [2023-12-28 08:33:23,841][106226] Updated weights for policy 0, policy_version 1849698 (0.0009) [2023-12-28 08:33:24,201][106225] Updated weights for policy 1, policy_version 1853674 (0.0011) [2023-12-28 08:33:24,254][106225] Updated weights for policy 1, policy_version 1853684 (0.0005) [2023-12-28 08:33:24,321][106225] Updated weights for policy 1, policy_version 1853694 (0.0006) [2023-12-28 08:33:24,540][106226] Updated weights for policy 0, policy_version 1849708 (0.0009) [2023-12-28 08:33:24,598][106226] Updated weights for policy 0, policy_version 1849718 (0.0009) [2023-12-28 08:33:24,650][106226] Updated weights for policy 0, policy_version 1849728 (0.0008) [2023-12-28 08:33:24,902][106225] Updated weights for policy 1, policy_version 1853704 (0.0008) [2023-12-28 08:33:24,962][106225] Updated weights for policy 1, policy_version 1853714 (0.0008) [2023-12-28 08:33:25,029][106225] Updated weights for policy 1, policy_version 1853724 (0.0008) [2023-12-28 08:33:25,439][106226] Updated weights for policy 0, policy_version 1849738 (0.0009) [2023-12-28 08:33:25,497][106226] Updated weights for policy 0, policy_version 1849748 (0.0008) [2023-12-28 08:33:25,558][106226] Updated weights for policy 0, policy_version 1849758 (0.0008) [2023-12-28 08:33:25,605][106226] Updated weights for policy 0, policy_version 1849768 (0.0010) [2023-12-28 08:33:25,651][106225] Updated weights for policy 1, policy_version 1853734 (0.0009) [2023-12-28 08:33:25,707][106225] Updated weights for policy 1, policy_version 1853744 (0.0010) [2023-12-28 08:33:25,769][106225] Updated weights for policy 1, policy_version 1853754 (0.0011) [2023-12-28 08:33:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.3, 300 sec: 19660.8). Total num frames: 948240384. Throughput: 0: 9733.0, 1: 9951.4. Samples: 948209500. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:26,176][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.754')] [2023-12-28 08:33:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001853760_474619904.pth... [2023-12-28 08:33:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001849768_473620480.pth... [2023-12-28 08:33:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001852608_474324992.pth [2023-12-28 08:33:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001848648_473333760.pth [2023-12-28 08:33:26,261][106226] Updated weights for policy 0, policy_version 1849778 (0.0011) [2023-12-28 08:33:26,323][106226] Updated weights for policy 0, policy_version 1849788 (0.0007) [2023-12-28 08:33:26,387][106226] Updated weights for policy 0, policy_version 1849798 (0.0009) [2023-12-28 08:33:26,397][106225] Updated weights for policy 1, policy_version 1853764 (0.0008) [2023-12-28 08:33:26,465][106225] Updated weights for policy 1, policy_version 1853774 (0.0005) [2023-12-28 08:33:26,527][106225] Updated weights for policy 1, policy_version 1853784 (0.0008) [2023-12-28 08:33:26,991][106226] Updated weights for policy 0, policy_version 1849808 (0.0010) [2023-12-28 08:33:27,037][106226] Updated weights for policy 0, policy_version 1849818 (0.0010) [2023-12-28 08:33:27,085][106226] Updated weights for policy 0, policy_version 1849828 (0.0010) [2023-12-28 08:33:27,142][106225] Updated weights for policy 1, policy_version 1853794 (0.0007) [2023-12-28 08:33:27,194][106225] Updated weights for policy 1, policy_version 1853804 (0.0006) [2023-12-28 08:33:27,250][106225] Updated weights for policy 1, policy_version 1853814 (0.0006) [2023-12-28 08:33:27,313][106225] Updated weights for policy 1, policy_version 1853824 (0.0006) [2023-12-28 08:33:27,736][106226] Updated weights for policy 0, policy_version 1849838 (0.0008) [2023-12-28 08:33:27,796][106226] Updated weights for policy 0, policy_version 1849848 (0.0005) [2023-12-28 08:33:27,850][106226] Updated weights for policy 0, policy_version 1849858 (0.0005) [2023-12-28 08:33:28,084][106225] Updated weights for policy 1, policy_version 1853834 (0.0005) [2023-12-28 08:33:28,147][106225] Updated weights for policy 1, policy_version 1853844 (0.0005) [2023-12-28 08:33:28,203][106225] Updated weights for policy 1, policy_version 1853854 (0.0005) [2023-12-28 08:33:28,344][106226] Updated weights for policy 0, policy_version 1849868 (0.0006) [2023-12-28 08:33:28,408][106226] Updated weights for policy 0, policy_version 1849878 (0.0008) [2023-12-28 08:33:28,463][106226] Updated weights for policy 0, policy_version 1849888 (0.0008) [2023-12-28 08:33:28,737][106225] Updated weights for policy 1, policy_version 1853864 (0.0005) [2023-12-28 08:33:28,794][106225] Updated weights for policy 1, policy_version 1853874 (0.0005) [2023-12-28 08:33:28,855][106225] Updated weights for policy 1, policy_version 1853884 (0.0005) [2023-12-28 08:33:29,183][106226] Updated weights for policy 0, policy_version 1849898 (0.0008) [2023-12-28 08:33:29,249][106226] Updated weights for policy 0, policy_version 1849908 (0.0011) [2023-12-28 08:33:29,313][106226] Updated weights for policy 0, policy_version 1849918 (0.0011) [2023-12-28 08:33:29,377][106226] Updated weights for policy 0, policy_version 1849928 (0.0011) [2023-12-28 08:33:29,523][106225] Updated weights for policy 1, policy_version 1853894 (0.0006) [2023-12-28 08:33:29,572][106225] Updated weights for policy 1, policy_version 1853904 (0.0008) [2023-12-28 08:33:29,629][106225] Updated weights for policy 1, policy_version 1853914 (0.0008) [2023-12-28 08:33:30,079][106226] Updated weights for policy 0, policy_version 1849938 (0.0011) [2023-12-28 08:33:30,125][106226] Updated weights for policy 0, policy_version 1849948 (0.0010) [2023-12-28 08:33:30,175][106226] Updated weights for policy 0, policy_version 1849958 (0.0010) [2023-12-28 08:33:30,371][106225] Updated weights for policy 1, policy_version 1853924 (0.0007) [2023-12-28 08:33:30,432][106225] Updated weights for policy 1, policy_version 1853934 (0.0007) [2023-12-28 08:33:30,490][106225] Updated weights for policy 1, policy_version 1853944 (0.0008) [2023-12-28 08:33:30,904][106226] Updated weights for policy 0, policy_version 1849968 (0.0011) [2023-12-28 08:33:30,959][106226] Updated weights for policy 0, policy_version 1849978 (0.0010) [2023-12-28 08:33:31,021][106226] Updated weights for policy 0, policy_version 1849988 (0.0011) [2023-12-28 08:33:31,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 948346880. Throughput: 0: 9840.0, 1: 10056.1. Samples: 948336300. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:31,175][105115] Avg episode reward: [(0, '-4.288'), (1, '-4.675')] [2023-12-28 08:33:31,198][106225] Updated weights for policy 1, policy_version 1853954 (0.0007) [2023-12-28 08:33:31,256][106225] Updated weights for policy 1, policy_version 1853964 (0.0008) [2023-12-28 08:33:31,314][106225] Updated weights for policy 1, policy_version 1853974 (0.0008) [2023-12-28 08:33:31,379][106225] Updated weights for policy 1, policy_version 1853984 (0.0009) [2023-12-28 08:33:31,793][106226] Updated weights for policy 0, policy_version 1849998 (0.0010) [2023-12-28 08:33:31,853][106226] Updated weights for policy 0, policy_version 1850008 (0.0009) [2023-12-28 08:33:31,907][106226] Updated weights for policy 0, policy_version 1850018 (0.0010) [2023-12-28 08:33:32,068][106225] Updated weights for policy 1, policy_version 1853994 (0.0006) [2023-12-28 08:33:32,132][106225] Updated weights for policy 1, policy_version 1854004 (0.0006) [2023-12-28 08:33:32,204][106225] Updated weights for policy 1, policy_version 1854014 (0.0005) [2023-12-28 08:33:32,708][106226] Updated weights for policy 0, policy_version 1850028 (0.0009) [2023-12-28 08:33:32,769][106226] Updated weights for policy 0, policy_version 1850038 (0.0011) [2023-12-28 08:33:32,810][106225] Updated weights for policy 1, policy_version 1854024 (0.0009) [2023-12-28 08:33:32,826][106226] Updated weights for policy 0, policy_version 1850048 (0.0010) [2023-12-28 08:33:32,870][106225] Updated weights for policy 1, policy_version 1854034 (0.0010) [2023-12-28 08:33:32,926][106225] Updated weights for policy 1, policy_version 1854044 (0.0010) [2023-12-28 08:33:33,446][106226] Updated weights for policy 0, policy_version 1850058 (0.0010) [2023-12-28 08:33:33,496][106226] Updated weights for policy 0, policy_version 1850068 (0.0007) [2023-12-28 08:33:33,556][106226] Updated weights for policy 0, policy_version 1850078 (0.0008) [2023-12-28 08:33:33,605][106226] Updated weights for policy 0, policy_version 1850088 (0.0007) [2023-12-28 08:33:33,607][106225] Updated weights for policy 1, policy_version 1854054 (0.0008) [2023-12-28 08:33:33,663][106225] Updated weights for policy 1, policy_version 1854064 (0.0007) [2023-12-28 08:33:33,723][106225] Updated weights for policy 1, policy_version 1854074 (0.0005) [2023-12-28 08:33:34,334][106226] Updated weights for policy 0, policy_version 1850098 (0.0008) [2023-12-28 08:33:34,372][106225] Updated weights for policy 1, policy_version 1854084 (0.0008) [2023-12-28 08:33:34,400][106226] Updated weights for policy 0, policy_version 1850108 (0.0008) [2023-12-28 08:33:34,436][106225] Updated weights for policy 1, policy_version 1854094 (0.0008) [2023-12-28 08:33:34,459][106226] Updated weights for policy 0, policy_version 1850118 (0.0008) [2023-12-28 08:33:34,499][106225] Updated weights for policy 1, policy_version 1854104 (0.0006) [2023-12-28 08:33:35,119][106226] Updated weights for policy 0, policy_version 1850128 (0.0006) [2023-12-28 08:33:35,183][106226] Updated weights for policy 0, policy_version 1850138 (0.0005) [2023-12-28 08:33:35,231][106225] Updated weights for policy 1, policy_version 1854114 (0.0006) [2023-12-28 08:33:35,237][106226] Updated weights for policy 0, policy_version 1850148 (0.0006) [2023-12-28 08:33:35,291][106225] Updated weights for policy 1, policy_version 1854124 (0.0008) [2023-12-28 08:33:35,354][106225] Updated weights for policy 1, policy_version 1854134 (0.0008) [2023-12-28 08:33:35,408][106225] Updated weights for policy 1, policy_version 1854144 (0.0009) [2023-12-28 08:33:35,776][106226] Updated weights for policy 0, policy_version 1850158 (0.0005) [2023-12-28 08:33:35,836][106226] Updated weights for policy 0, policy_version 1850168 (0.0009) [2023-12-28 08:33:35,894][106226] Updated weights for policy 0, policy_version 1850178 (0.0009) [2023-12-28 08:33:36,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 948445184. Throughput: 0: 9885.2, 1: 10066.0. Samples: 948457048. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:36,175][105115] Avg episode reward: [(0, '-4.503'), (1, '-4.670')] [2023-12-28 08:33:36,216][106225] Updated weights for policy 1, policy_version 1854154 (0.0007) [2023-12-28 08:33:36,284][106225] Updated weights for policy 1, policy_version 1854164 (0.0008) [2023-12-28 08:33:36,351][106225] Updated weights for policy 1, policy_version 1854174 (0.0008) [2023-12-28 08:33:36,537][106226] Updated weights for policy 0, policy_version 1850188 (0.0007) [2023-12-28 08:33:36,598][106226] Updated weights for policy 0, policy_version 1850198 (0.0011) [2023-12-28 08:33:36,665][106226] Updated weights for policy 0, policy_version 1850208 (0.0011) [2023-12-28 08:33:37,016][106225] Updated weights for policy 1, policy_version 1854184 (0.0008) [2023-12-28 08:33:37,068][106225] Updated weights for policy 1, policy_version 1854194 (0.0009) [2023-12-28 08:33:37,125][106225] Updated weights for policy 1, policy_version 1854204 (0.0009) [2023-12-28 08:33:37,275][106226] Updated weights for policy 0, policy_version 1850218 (0.0010) [2023-12-28 08:33:37,339][106226] Updated weights for policy 0, policy_version 1850228 (0.0006) [2023-12-28 08:33:37,405][106226] Updated weights for policy 0, policy_version 1850238 (0.0005) [2023-12-28 08:33:37,461][106226] Updated weights for policy 0, policy_version 1850248 (0.0006) [2023-12-28 08:33:37,972][106225] Updated weights for policy 1, policy_version 1854214 (0.0008) [2023-12-28 08:33:38,023][106226] Updated weights for policy 0, policy_version 1850258 (0.0007) [2023-12-28 08:33:38,024][106225] Updated weights for policy 1, policy_version 1854224 (0.0007) [2023-12-28 08:33:38,074][106225] Updated weights for policy 1, policy_version 1854234 (0.0007) [2023-12-28 08:33:38,074][106226] Updated weights for policy 0, policy_version 1850268 (0.0007) [2023-12-28 08:33:38,137][106226] Updated weights for policy 0, policy_version 1850278 (0.0008) [2023-12-28 08:33:38,787][106226] Updated weights for policy 0, policy_version 1850288 (0.0007) [2023-12-28 08:33:38,832][106225] Updated weights for policy 1, policy_version 1854244 (0.0007) [2023-12-28 08:33:38,849][106226] Updated weights for policy 0, policy_version 1850298 (0.0008) [2023-12-28 08:33:38,889][106225] Updated weights for policy 1, policy_version 1854254 (0.0006) [2023-12-28 08:33:38,908][106226] Updated weights for policy 0, policy_version 1850308 (0.0007) [2023-12-28 08:33:38,946][106225] Updated weights for policy 1, policy_version 1854264 (0.0009) [2023-12-28 08:33:39,580][106226] Updated weights for policy 0, policy_version 1850318 (0.0007) [2023-12-28 08:33:39,644][106226] Updated weights for policy 0, policy_version 1850328 (0.0008) [2023-12-28 08:33:39,711][106226] Updated weights for policy 0, policy_version 1850338 (0.0007) [2023-12-28 08:33:39,731][106225] Updated weights for policy 1, policy_version 1854274 (0.0008) [2023-12-28 08:33:39,796][106225] Updated weights for policy 1, policy_version 1854284 (0.0006) [2023-12-28 08:33:39,865][106225] Updated weights for policy 1, policy_version 1854294 (0.0009) [2023-12-28 08:33:39,933][106225] Updated weights for policy 1, policy_version 1854304 (0.0008) [2023-12-28 08:33:40,413][106226] Updated weights for policy 0, policy_version 1850348 (0.0007) [2023-12-28 08:33:40,475][106226] Updated weights for policy 0, policy_version 1850358 (0.0006) [2023-12-28 08:33:40,532][106226] Updated weights for policy 0, policy_version 1850368 (0.0007) [2023-12-28 08:33:40,726][106225] Updated weights for policy 1, policy_version 1854314 (0.0008) [2023-12-28 08:33:40,793][106225] Updated weights for policy 1, policy_version 1854324 (0.0009) [2023-12-28 08:33:40,848][106225] Updated weights for policy 1, policy_version 1854334 (0.0008) [2023-12-28 08:33:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19688.6). Total num frames: 948543488. Throughput: 0: 9923.0, 1: 9962.8. Samples: 948516764. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:41,176][105115] Avg episode reward: [(0, '-4.495'), (1, '-4.709')] [2023-12-28 08:33:41,188][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001854336_474767360.pth... [2023-12-28 08:33:41,188][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001850376_473776128.pth... [2023-12-28 08:33:41,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001853184_474472448.pth [2023-12-28 08:33:41,193][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001854336_474767360.pth [2023-12-28 08:33:41,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001849224_473481216.pth [2023-12-28 08:33:41,195][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001850376_473776128.pth [2023-12-28 08:33:41,310][106226] Updated weights for policy 0, policy_version 1850378 (0.0007) [2023-12-28 08:33:41,397][106226] Updated weights for policy 0, policy_version 1850388 (0.0009) [2023-12-28 08:33:41,462][106226] Updated weights for policy 0, policy_version 1850398 (0.0009) [2023-12-28 08:33:41,541][106226] Updated weights for policy 0, policy_version 1850408 (0.0011) [2023-12-28 08:33:41,620][106225] Updated weights for policy 1, policy_version 1854344 (0.0007) [2023-12-28 08:33:41,691][106225] Updated weights for policy 1, policy_version 1854354 (0.0008) [2023-12-28 08:33:41,769][106225] Updated weights for policy 1, policy_version 1854364 (0.0008) [2023-12-28 08:33:42,216][106226] Updated weights for policy 0, policy_version 1850418 (0.0009) [2023-12-28 08:33:42,282][106226] Updated weights for policy 0, policy_version 1850428 (0.0010) [2023-12-28 08:33:42,341][106226] Updated weights for policy 0, policy_version 1850438 (0.0010) [2023-12-28 08:33:42,485][106225] Updated weights for policy 1, policy_version 1854374 (0.0008) [2023-12-28 08:33:42,549][106225] Updated weights for policy 1, policy_version 1854384 (0.0007) [2023-12-28 08:33:42,606][106225] Updated weights for policy 1, policy_version 1854394 (0.0007) [2023-12-28 08:33:43,053][106226] Updated weights for policy 0, policy_version 1850448 (0.0011) [2023-12-28 08:33:43,100][106226] Updated weights for policy 0, policy_version 1850458 (0.0010) [2023-12-28 08:33:43,146][106226] Updated weights for policy 0, policy_version 1850468 (0.0007) [2023-12-28 08:33:43,323][106225] Updated weights for policy 1, policy_version 1854404 (0.0009) [2023-12-28 08:33:43,372][106225] Updated weights for policy 1, policy_version 1854414 (0.0010) [2023-12-28 08:33:43,423][106225] Updated weights for policy 1, policy_version 1854424 (0.0010) [2023-12-28 08:33:43,694][106226] Updated weights for policy 0, policy_version 1850478 (0.0008) [2023-12-28 08:33:43,759][106226] Updated weights for policy 0, policy_version 1850488 (0.0010) [2023-12-28 08:33:43,816][106226] Updated weights for policy 0, policy_version 1850498 (0.0010) [2023-12-28 08:33:44,139][106225] Updated weights for policy 1, policy_version 1854434 (0.0010) [2023-12-28 08:33:44,197][106225] Updated weights for policy 1, policy_version 1854444 (0.0008) [2023-12-28 08:33:44,246][106225] Updated weights for policy 1, policy_version 1854454 (0.0005) [2023-12-28 08:33:44,298][106225] Updated weights for policy 1, policy_version 1854464 (0.0009) [2023-12-28 08:33:44,395][106226] Updated weights for policy 0, policy_version 1850508 (0.0011) [2023-12-28 08:33:44,441][106226] Updated weights for policy 0, policy_version 1850518 (0.0010) [2023-12-28 08:33:44,490][106226] Updated weights for policy 0, policy_version 1850528 (0.0010) [2023-12-28 08:33:45,008][106225] Updated weights for policy 1, policy_version 1854474 (0.0010) [2023-12-28 08:33:45,067][106225] Updated weights for policy 1, policy_version 1854484 (0.0010) [2023-12-28 08:33:45,129][106225] Updated weights for policy 1, policy_version 1854494 (0.0011) [2023-12-28 08:33:45,187][106226] Updated weights for policy 0, policy_version 1850538 (0.0010) [2023-12-28 08:33:45,251][106226] Updated weights for policy 0, policy_version 1850548 (0.0011) [2023-12-28 08:33:45,311][106226] Updated weights for policy 0, policy_version 1850558 (0.0010) [2023-12-28 08:33:45,374][106226] Updated weights for policy 0, policy_version 1850568 (0.0008) [2023-12-28 08:33:45,779][106225] Updated weights for policy 1, policy_version 1854504 (0.0009) [2023-12-28 08:33:45,836][106225] Updated weights for policy 1, policy_version 1854514 (0.0010) [2023-12-28 08:33:45,892][106225] Updated weights for policy 1, policy_version 1854524 (0.0010) [2023-12-28 08:33:46,014][106226] Updated weights for policy 0, policy_version 1850578 (0.0007) [2023-12-28 08:33:46,078][106226] Updated weights for policy 0, policy_version 1850588 (0.0008) [2023-12-28 08:33:46,144][106226] Updated weights for policy 0, policy_version 1850598 (0.0008) [2023-12-28 08:33:46,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19716.4). Total num frames: 948649984. Throughput: 0: 10004.4, 1: 9854.6. Samples: 948634908. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:46,176][105115] Avg episode reward: [(0, '-4.564'), (1, '-4.890')] [2023-12-28 08:33:46,493][106225] Updated weights for policy 1, policy_version 1854534 (0.0008) [2023-12-28 08:33:46,547][106225] Updated weights for policy 1, policy_version 1854544 (0.0010) [2023-12-28 08:33:46,602][106225] Updated weights for policy 1, policy_version 1854554 (0.0006) [2023-12-28 08:33:46,716][106226] Updated weights for policy 0, policy_version 1850608 (0.0008) [2023-12-28 08:33:46,771][106226] Updated weights for policy 0, policy_version 1850618 (0.0009) [2023-12-28 08:33:46,827][106226] Updated weights for policy 0, policy_version 1850628 (0.0010) [2023-12-28 08:33:47,192][106225] Updated weights for policy 1, policy_version 1854564 (0.0007) [2023-12-28 08:33:47,242][106225] Updated weights for policy 1, policy_version 1854574 (0.0010) [2023-12-28 08:33:47,292][106225] Updated weights for policy 1, policy_version 1854584 (0.0010) [2023-12-28 08:33:47,458][106226] Updated weights for policy 0, policy_version 1850638 (0.0008) [2023-12-28 08:33:47,527][106226] Updated weights for policy 0, policy_version 1850648 (0.0005) [2023-12-28 08:33:47,594][106226] Updated weights for policy 0, policy_version 1850658 (0.0006) [2023-12-28 08:33:47,955][106225] Updated weights for policy 1, policy_version 1854594 (0.0009) [2023-12-28 08:33:48,015][106225] Updated weights for policy 1, policy_version 1854604 (0.0007) [2023-12-28 08:33:48,067][106225] Updated weights for policy 1, policy_version 1854614 (0.0005) [2023-12-28 08:33:48,116][106225] Updated weights for policy 1, policy_version 1854624 (0.0006) [2023-12-28 08:33:48,298][106226] Updated weights for policy 0, policy_version 1850668 (0.0009) [2023-12-28 08:33:48,356][106226] Updated weights for policy 0, policy_version 1850678 (0.0009) [2023-12-28 08:33:48,414][106226] Updated weights for policy 0, policy_version 1850688 (0.0008) [2023-12-28 08:33:48,774][106225] Updated weights for policy 1, policy_version 1854634 (0.0009) [2023-12-28 08:33:48,838][106225] Updated weights for policy 1, policy_version 1854644 (0.0009) [2023-12-28 08:33:48,891][106225] Updated weights for policy 1, policy_version 1854654 (0.0009) [2023-12-28 08:33:49,139][106226] Updated weights for policy 0, policy_version 1850698 (0.0009) [2023-12-28 08:33:49,197][106226] Updated weights for policy 0, policy_version 1850708 (0.0008) [2023-12-28 08:33:49,263][106226] Updated weights for policy 0, policy_version 1850718 (0.0008) [2023-12-28 08:33:49,316][106226] Updated weights for policy 0, policy_version 1850728 (0.0009) [2023-12-28 08:33:49,624][106225] Updated weights for policy 1, policy_version 1854664 (0.0009) [2023-12-28 08:33:49,687][106225] Updated weights for policy 1, policy_version 1854674 (0.0009) [2023-12-28 08:33:49,735][106225] Updated weights for policy 1, policy_version 1854684 (0.0008) [2023-12-28 08:33:50,055][106226] Updated weights for policy 0, policy_version 1850738 (0.0008) [2023-12-28 08:33:50,118][106226] Updated weights for policy 0, policy_version 1850748 (0.0009) [2023-12-28 08:33:50,178][106226] Updated weights for policy 0, policy_version 1850758 (0.0009) [2023-12-28 08:33:50,468][106225] Updated weights for policy 1, policy_version 1854694 (0.0008) [2023-12-28 08:33:50,524][106225] Updated weights for policy 1, policy_version 1854704 (0.0008) [2023-12-28 08:33:50,585][106225] Updated weights for policy 1, policy_version 1854714 (0.0008) [2023-12-28 08:33:50,948][106226] Updated weights for policy 0, policy_version 1850768 (0.0010) [2023-12-28 08:33:51,008][106226] Updated weights for policy 0, policy_version 1850778 (0.0011) [2023-12-28 08:33:51,076][106226] Updated weights for policy 0, policy_version 1850788 (0.0010) [2023-12-28 08:33:51,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19716.4). Total num frames: 948748288. Throughput: 0: 9991.6, 1: 9898.6. Samples: 948755916. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:51,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.509')] [2023-12-28 08:33:51,420][106225] Updated weights for policy 1, policy_version 1854724 (0.0008) [2023-12-28 08:33:51,479][106225] Updated weights for policy 1, policy_version 1854734 (0.0008) [2023-12-28 08:33:51,535][106225] Updated weights for policy 1, policy_version 1854744 (0.0008) [2023-12-28 08:33:51,760][106226] Updated weights for policy 0, policy_version 1850798 (0.0009) [2023-12-28 08:33:51,809][106226] Updated weights for policy 0, policy_version 1850808 (0.0007) [2023-12-28 08:33:51,874][106226] Updated weights for policy 0, policy_version 1850818 (0.0008) [2023-12-28 08:33:52,275][106225] Updated weights for policy 1, policy_version 1854754 (0.0008) [2023-12-28 08:33:52,336][106225] Updated weights for policy 1, policy_version 1854764 (0.0008) [2023-12-28 08:33:52,399][106225] Updated weights for policy 1, policy_version 1854774 (0.0008) [2023-12-28 08:33:52,458][106225] Updated weights for policy 1, policy_version 1854784 (0.0008) [2023-12-28 08:33:52,553][106226] Updated weights for policy 0, policy_version 1850828 (0.0008) [2023-12-28 08:33:52,606][106226] Updated weights for policy 0, policy_version 1850838 (0.0008) [2023-12-28 08:33:52,659][106226] Updated weights for policy 0, policy_version 1850848 (0.0008) [2023-12-28 08:33:53,130][106225] Updated weights for policy 1, policy_version 1854794 (0.0005) [2023-12-28 08:33:53,192][106225] Updated weights for policy 1, policy_version 1854804 (0.0008) [2023-12-28 08:33:53,249][106225] Updated weights for policy 1, policy_version 1854814 (0.0010) [2023-12-28 08:33:53,299][106226] Updated weights for policy 0, policy_version 1850858 (0.0008) [2023-12-28 08:33:53,346][106226] Updated weights for policy 0, policy_version 1850868 (0.0007) [2023-12-28 08:33:53,395][106226] Updated weights for policy 0, policy_version 1850878 (0.0007) [2023-12-28 08:33:53,934][106225] Updated weights for policy 1, policy_version 1854824 (0.0010) [2023-12-28 08:33:53,992][106225] Updated weights for policy 1, policy_version 1854834 (0.0010) [2023-12-28 08:33:54,048][106225] Updated weights for policy 1, policy_version 1854844 (0.0010) [2023-12-28 08:33:54,105][106226] Updated weights for policy 0, policy_version 1850889 (0.0009) [2023-12-28 08:33:54,168][106226] Updated weights for policy 0, policy_version 1850899 (0.0008) [2023-12-28 08:33:54,226][106226] Updated weights for policy 0, policy_version 1850909 (0.0008) [2023-12-28 08:33:54,287][106226] Updated weights for policy 0, policy_version 1850919 (0.0007) [2023-12-28 08:33:54,711][106225] Updated weights for policy 1, policy_version 1854854 (0.0010) [2023-12-28 08:33:54,761][106225] Updated weights for policy 1, policy_version 1854864 (0.0010) [2023-12-28 08:33:54,809][106225] Updated weights for policy 1, policy_version 1854874 (0.0010) [2023-12-28 08:33:55,035][106226] Updated weights for policy 0, policy_version 1850929 (0.0008) [2023-12-28 08:33:55,084][106226] Updated weights for policy 0, policy_version 1850939 (0.0008) [2023-12-28 08:33:55,138][106226] Updated weights for policy 0, policy_version 1850949 (0.0007) [2023-12-28 08:33:55,503][106225] Updated weights for policy 1, policy_version 1854884 (0.0010) [2023-12-28 08:33:55,549][106225] Updated weights for policy 1, policy_version 1854894 (0.0010) [2023-12-28 08:33:55,602][106225] Updated weights for policy 1, policy_version 1854904 (0.0010) [2023-12-28 08:33:55,853][106226] Updated weights for policy 0, policy_version 1850959 (0.0008) [2023-12-28 08:33:55,913][106226] Updated weights for policy 0, policy_version 1850969 (0.0008) [2023-12-28 08:33:55,964][106226] Updated weights for policy 0, policy_version 1850979 (0.0008) [2023-12-28 08:33:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 948846592. Throughput: 0: 9996.0, 1: 9892.8. Samples: 948815756. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:33:56,176][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.691')] [2023-12-28 08:33:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001854912_474914816.pth... [2023-12-28 08:33:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001850984_473931776.pth... [2023-12-28 08:33:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001853760_474619904.pth [2023-12-28 08:33:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001849768_473620480.pth [2023-12-28 08:33:56,337][106225] Updated weights for policy 1, policy_version 1854914 (0.0010) [2023-12-28 08:33:56,416][106225] Updated weights for policy 1, policy_version 1854924 (0.0010) [2023-12-28 08:33:56,478][106225] Updated weights for policy 1, policy_version 1854934 (0.0010) [2023-12-28 08:33:56,537][106225] Updated weights for policy 1, policy_version 1854944 (0.0010) [2023-12-28 08:33:56,592][106226] Updated weights for policy 0, policy_version 1850989 (0.0007) [2023-12-28 08:33:56,652][106226] Updated weights for policy 0, policy_version 1850999 (0.0008) [2023-12-28 08:33:56,700][106226] Updated weights for policy 0, policy_version 1851009 (0.0007) [2023-12-28 08:33:57,143][106225] Updated weights for policy 1, policy_version 1854954 (0.0009) [2023-12-28 08:33:57,207][106225] Updated weights for policy 1, policy_version 1854964 (0.0010) [2023-12-28 08:33:57,275][106225] Updated weights for policy 1, policy_version 1854974 (0.0011) [2023-12-28 08:33:57,311][106226] Updated weights for policy 0, policy_version 1851019 (0.0005) [2023-12-28 08:33:57,375][106226] Updated weights for policy 0, policy_version 1851029 (0.0007) [2023-12-28 08:33:57,441][106226] Updated weights for policy 0, policy_version 1851039 (0.0009) [2023-12-28 08:33:57,906][106225] Updated weights for policy 1, policy_version 1854984 (0.0007) [2023-12-28 08:33:57,973][106225] Updated weights for policy 1, policy_version 1854994 (0.0008) [2023-12-28 08:33:58,032][106225] Updated weights for policy 1, policy_version 1855004 (0.0010) [2023-12-28 08:33:58,114][106226] Updated weights for policy 0, policy_version 1851049 (0.0008) [2023-12-28 08:33:58,173][106226] Updated weights for policy 0, policy_version 1851059 (0.0005) [2023-12-28 08:33:58,242][106226] Updated weights for policy 0, policy_version 1851070 (0.0007) [2023-12-28 08:33:58,306][106226] Updated weights for policy 0, policy_version 1851080 (0.0011) [2023-12-28 08:33:58,715][106225] Updated weights for policy 1, policy_version 1855014 (0.0009) [2023-12-28 08:33:58,784][106225] Updated weights for policy 1, policy_version 1855024 (0.0008) [2023-12-28 08:33:58,846][106225] Updated weights for policy 1, policy_version 1855034 (0.0009) [2023-12-28 08:33:59,074][106226] Updated weights for policy 0, policy_version 1851090 (0.0007) [2023-12-28 08:33:59,128][106226] Updated weights for policy 0, policy_version 1851100 (0.0008) [2023-12-28 08:33:59,191][106226] Updated weights for policy 0, policy_version 1851110 (0.0007) [2023-12-28 08:33:59,613][106225] Updated weights for policy 1, policy_version 1855044 (0.0010) [2023-12-28 08:33:59,662][106225] Updated weights for policy 1, policy_version 1855054 (0.0008) [2023-12-28 08:33:59,724][106225] Updated weights for policy 1, policy_version 1855064 (0.0007) [2023-12-28 08:33:59,999][106226] Updated weights for policy 0, policy_version 1851120 (0.0008) [2023-12-28 08:34:00,054][106226] Updated weights for policy 0, policy_version 1851130 (0.0009) [2023-12-28 08:34:00,115][106226] Updated weights for policy 0, policy_version 1851140 (0.0009) [2023-12-28 08:34:00,363][106225] Updated weights for policy 1, policy_version 1855074 (0.0007) [2023-12-28 08:34:00,418][106225] Updated weights for policy 1, policy_version 1855084 (0.0005) [2023-12-28 08:34:00,486][106225] Updated weights for policy 1, policy_version 1855094 (0.0005) [2023-12-28 08:34:00,534][106225] Updated weights for policy 1, policy_version 1855104 (0.0006) [2023-12-28 08:34:00,897][106226] Updated weights for policy 0, policy_version 1851150 (0.0009) [2023-12-28 08:34:00,946][106226] Updated weights for policy 0, policy_version 1851160 (0.0009) [2023-12-28 08:34:01,006][106226] Updated weights for policy 0, policy_version 1851170 (0.0008) [2023-12-28 08:34:01,102][106225] Updated weights for policy 1, policy_version 1855114 (0.0008) [2023-12-28 08:34:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 948944896. Throughput: 0: 10046.1, 1: 9978.7. Samples: 948934136. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:01,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.778')] [2023-12-28 08:34:01,182][106225] Updated weights for policy 1, policy_version 1855124 (0.0008) [2023-12-28 08:34:01,241][106225] Updated weights for policy 1, policy_version 1855134 (0.0008) [2023-12-28 08:34:01,743][106226] Updated weights for policy 0, policy_version 1851180 (0.0009) [2023-12-28 08:34:01,804][106226] Updated weights for policy 0, policy_version 1851190 (0.0009) [2023-12-28 08:34:01,861][106226] Updated weights for policy 0, policy_version 1851200 (0.0009) [2023-12-28 08:34:02,004][106225] Updated weights for policy 1, policy_version 1855144 (0.0007) [2023-12-28 08:34:02,067][106225] Updated weights for policy 1, policy_version 1855154 (0.0005) [2023-12-28 08:34:02,132][106225] Updated weights for policy 1, policy_version 1855164 (0.0007) [2023-12-28 08:34:02,584][106226] Updated weights for policy 0, policy_version 1851210 (0.0008) [2023-12-28 08:34:02,655][106226] Updated weights for policy 0, policy_version 1851220 (0.0009) [2023-12-28 08:34:02,709][106226] Updated weights for policy 0, policy_version 1851230 (0.0008) [2023-12-28 08:34:02,763][106226] Updated weights for policy 0, policy_version 1851240 (0.0009) [2023-12-28 08:34:02,807][106225] Updated weights for policy 1, policy_version 1855174 (0.0008) [2023-12-28 08:34:02,873][106225] Updated weights for policy 1, policy_version 1855184 (0.0006) [2023-12-28 08:34:02,932][106225] Updated weights for policy 1, policy_version 1855194 (0.0006) [2023-12-28 08:34:03,475][106226] Updated weights for policy 0, policy_version 1851250 (0.0008) [2023-12-28 08:34:03,520][106226] Updated weights for policy 0, policy_version 1851260 (0.0008) [2023-12-28 08:34:03,567][106226] Updated weights for policy 0, policy_version 1851270 (0.0008) [2023-12-28 08:34:03,573][106225] Updated weights for policy 1, policy_version 1855204 (0.0007) [2023-12-28 08:34:03,634][106225] Updated weights for policy 1, policy_version 1855214 (0.0008) [2023-12-28 08:34:03,691][106225] Updated weights for policy 1, policy_version 1855224 (0.0008) [2023-12-28 08:34:04,319][106225] Updated weights for policy 1, policy_version 1855234 (0.0006) [2023-12-28 08:34:04,361][106226] Updated weights for policy 0, policy_version 1851280 (0.0008) [2023-12-28 08:34:04,375][106225] Updated weights for policy 1, policy_version 1855244 (0.0006) [2023-12-28 08:34:04,428][106225] Updated weights for policy 1, policy_version 1855254 (0.0006) [2023-12-28 08:34:04,430][106226] Updated weights for policy 0, policy_version 1851290 (0.0007) [2023-12-28 08:34:04,487][106225] Updated weights for policy 1, policy_version 1855264 (0.0006) [2023-12-28 08:34:04,494][106226] Updated weights for policy 0, policy_version 1851300 (0.0007) [2023-12-28 08:34:05,109][106226] Updated weights for policy 0, policy_version 1851310 (0.0009) [2023-12-28 08:34:05,111][106225] Updated weights for policy 1, policy_version 1855274 (0.0007) [2023-12-28 08:34:05,169][106226] Updated weights for policy 0, policy_version 1851320 (0.0010) [2023-12-28 08:34:05,172][106225] Updated weights for policy 1, policy_version 1855284 (0.0005) [2023-12-28 08:34:05,219][106225] Updated weights for policy 1, policy_version 1855294 (0.0005) [2023-12-28 08:34:05,230][106226] Updated weights for policy 0, policy_version 1851330 (0.0007) [2023-12-28 08:34:05,784][106226] Updated weights for policy 0, policy_version 1851340 (0.0006) [2023-12-28 08:34:05,841][106226] Updated weights for policy 0, policy_version 1851350 (0.0008) [2023-12-28 08:34:05,895][106226] Updated weights for policy 0, policy_version 1851360 (0.0010) [2023-12-28 08:34:05,898][106225] Updated weights for policy 1, policy_version 1855304 (0.0006) [2023-12-28 08:34:05,956][106225] Updated weights for policy 1, policy_version 1855314 (0.0006) [2023-12-28 08:34:06,012][106225] Updated weights for policy 1, policy_version 1855324 (0.0007) [2023-12-28 08:34:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 949051392. Throughput: 0: 10105.0, 1: 10030.6. Samples: 949056560. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:06,177][105115] Avg episode reward: [(0, '-4.345'), (1, '-4.985')] [2023-12-28 08:34:06,623][106226] Updated weights for policy 0, policy_version 1851370 (0.0011) [2023-12-28 08:34:06,627][106225] Updated weights for policy 1, policy_version 1855334 (0.0009) [2023-12-28 08:34:06,687][106226] Updated weights for policy 0, policy_version 1851380 (0.0011) [2023-12-28 08:34:06,691][106225] Updated weights for policy 1, policy_version 1855344 (0.0007) [2023-12-28 08:34:06,751][106226] Updated weights for policy 0, policy_version 1851390 (0.0011) [2023-12-28 08:34:06,754][106225] Updated weights for policy 1, policy_version 1855354 (0.0007) [2023-12-28 08:34:06,812][106226] Updated weights for policy 0, policy_version 1851400 (0.0011) [2023-12-28 08:34:07,287][106225] Updated weights for policy 1, policy_version 1855364 (0.0006) [2023-12-28 08:34:07,345][106225] Updated weights for policy 1, policy_version 1855374 (0.0006) [2023-12-28 08:34:07,408][106225] Updated weights for policy 1, policy_version 1855384 (0.0008) [2023-12-28 08:34:07,482][106226] Updated weights for policy 0, policy_version 1851410 (0.0010) [2023-12-28 08:34:07,544][106226] Updated weights for policy 0, policy_version 1851420 (0.0010) [2023-12-28 08:34:07,606][106226] Updated weights for policy 0, policy_version 1851430 (0.0010) [2023-12-28 08:34:08,101][106225] Updated weights for policy 1, policy_version 1855394 (0.0010) [2023-12-28 08:34:08,159][106225] Updated weights for policy 1, policy_version 1855404 (0.0006) [2023-12-28 08:34:08,213][106225] Updated weights for policy 1, policy_version 1855414 (0.0007) [2023-12-28 08:34:08,271][106225] Updated weights for policy 1, policy_version 1855424 (0.0008) [2023-12-28 08:34:08,308][106226] Updated weights for policy 0, policy_version 1851440 (0.0011) [2023-12-28 08:34:08,378][106226] Updated weights for policy 0, policy_version 1851450 (0.0009) [2023-12-28 08:34:08,438][106226] Updated weights for policy 0, policy_version 1851460 (0.0009) [2023-12-28 08:34:08,965][106225] Updated weights for policy 1, policy_version 1855434 (0.0005) [2023-12-28 08:34:09,022][106225] Updated weights for policy 1, policy_version 1855444 (0.0006) [2023-12-28 08:34:09,080][106225] Updated weights for policy 1, policy_version 1855454 (0.0006) [2023-12-28 08:34:09,105][106226] Updated weights for policy 0, policy_version 1851470 (0.0011) [2023-12-28 08:34:09,168][106226] Updated weights for policy 0, policy_version 1851480 (0.0011) [2023-12-28 08:34:09,237][106226] Updated weights for policy 0, policy_version 1851490 (0.0009) [2023-12-28 08:34:09,803][106225] Updated weights for policy 1, policy_version 1855464 (0.0008) [2023-12-28 08:34:09,874][106225] Updated weights for policy 1, policy_version 1855474 (0.0010) [2023-12-28 08:34:09,940][106225] Updated weights for policy 1, policy_version 1855484 (0.0010) [2023-12-28 08:34:09,984][106226] Updated weights for policy 0, policy_version 1851500 (0.0008) [2023-12-28 08:34:10,047][106226] Updated weights for policy 0, policy_version 1851510 (0.0008) [2023-12-28 08:34:10,100][106226] Updated weights for policy 0, policy_version 1851520 (0.0008) [2023-12-28 08:34:10,633][106225] Updated weights for policy 1, policy_version 1855494 (0.0011) [2023-12-28 08:34:10,691][106225] Updated weights for policy 1, policy_version 1855504 (0.0010) [2023-12-28 08:34:10,748][106225] Updated weights for policy 1, policy_version 1855514 (0.0010) [2023-12-28 08:34:10,852][106226] Updated weights for policy 0, policy_version 1851530 (0.0008) [2023-12-28 08:34:10,904][106226] Updated weights for policy 0, policy_version 1851540 (0.0006) [2023-12-28 08:34:10,963][106226] Updated weights for policy 0, policy_version 1851550 (0.0007) [2023-12-28 08:34:11,018][106226] Updated weights for policy 0, policy_version 1851560 (0.0009) [2023-12-28 08:34:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 949149696. Throughput: 0: 10115.5, 1: 10088.0. Samples: 949118656. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:11,175][105115] Avg episode reward: [(0, '-4.746'), (1, '-4.819')] [2023-12-28 08:34:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001855520_475070464.pth... [2023-12-28 08:34:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001851560_474079232.pth... [2023-12-28 08:34:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001854336_474767360.pth [2023-12-28 08:34:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001850376_473776128.pth [2023-12-28 08:34:11,552][106225] Updated weights for policy 1, policy_version 1855524 (0.0010) [2023-12-28 08:34:11,612][106225] Updated weights for policy 1, policy_version 1855534 (0.0008) [2023-12-28 08:34:11,688][106225] Updated weights for policy 1, policy_version 1855544 (0.0008) [2023-12-28 08:34:11,913][106226] Updated weights for policy 0, policy_version 1851570 (0.0008) [2023-12-28 08:34:11,976][106226] Updated weights for policy 0, policy_version 1851580 (0.0009) [2023-12-28 08:34:12,046][106226] Updated weights for policy 0, policy_version 1851590 (0.0009) [2023-12-28 08:34:12,406][106225] Updated weights for policy 1, policy_version 1855554 (0.0008) [2023-12-28 08:34:12,473][106225] Updated weights for policy 1, policy_version 1855564 (0.0006) [2023-12-28 08:34:12,533][106225] Updated weights for policy 1, policy_version 1855574 (0.0005) [2023-12-28 08:34:12,589][106225] Updated weights for policy 1, policy_version 1855584 (0.0007) [2023-12-28 08:34:12,879][106226] Updated weights for policy 0, policy_version 1851600 (0.0007) [2023-12-28 08:34:12,935][106226] Updated weights for policy 0, policy_version 1851610 (0.0005) [2023-12-28 08:34:12,992][106226] Updated weights for policy 0, policy_version 1851620 (0.0005) [2023-12-28 08:34:13,274][106225] Updated weights for policy 1, policy_version 1855594 (0.0009) [2023-12-28 08:34:13,338][106225] Updated weights for policy 1, policy_version 1855604 (0.0009) [2023-12-28 08:34:13,398][106225] Updated weights for policy 1, policy_version 1855614 (0.0010) [2023-12-28 08:34:13,632][106226] Updated weights for policy 0, policy_version 1851630 (0.0006) [2023-12-28 08:34:13,683][106226] Updated weights for policy 0, policy_version 1851640 (0.0006) [2023-12-28 08:34:13,731][106226] Updated weights for policy 0, policy_version 1851650 (0.0005) [2023-12-28 08:34:14,175][106225] Updated weights for policy 1, policy_version 1855624 (0.0006) [2023-12-28 08:34:14,228][106225] Updated weights for policy 1, policy_version 1855634 (0.0008) [2023-12-28 08:34:14,287][106225] Updated weights for policy 1, policy_version 1855644 (0.0009) [2023-12-28 08:34:14,327][106226] Updated weights for policy 0, policy_version 1851660 (0.0007) [2023-12-28 08:34:14,377][106226] Updated weights for policy 0, policy_version 1851670 (0.0008) [2023-12-28 08:34:14,433][106226] Updated weights for policy 0, policy_version 1851680 (0.0009) [2023-12-28 08:34:14,982][106225] Updated weights for policy 1, policy_version 1855654 (0.0008) [2023-12-28 08:34:15,044][106225] Updated weights for policy 1, policy_version 1855664 (0.0007) [2023-12-28 08:34:15,104][106225] Updated weights for policy 1, policy_version 1855674 (0.0009) [2023-12-28 08:34:15,176][106226] Updated weights for policy 0, policy_version 1851690 (0.0008) [2023-12-28 08:34:15,237][106226] Updated weights for policy 0, policy_version 1851700 (0.0009) [2023-12-28 08:34:15,299][106226] Updated weights for policy 0, policy_version 1851710 (0.0009) [2023-12-28 08:34:15,356][106226] Updated weights for policy 0, policy_version 1851720 (0.0009) [2023-12-28 08:34:15,753][106225] Updated weights for policy 1, policy_version 1855684 (0.0008) [2023-12-28 08:34:15,809][106225] Updated weights for policy 1, policy_version 1855694 (0.0005) [2023-12-28 08:34:15,863][106225] Updated weights for policy 1, policy_version 1855704 (0.0005) [2023-12-28 08:34:16,123][106226] Updated weights for policy 0, policy_version 1851730 (0.0009) [2023-12-28 08:34:16,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19933.8, 300 sec: 19744.1). Total num frames: 949239808. Throughput: 0: 9984.7, 1: 9934.4. Samples: 949232660. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:16,176][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.650')] [2023-12-28 08:34:16,189][106226] Updated weights for policy 0, policy_version 1851740 (0.0009) [2023-12-28 08:34:16,255][106226] Updated weights for policy 0, policy_version 1851750 (0.0009) [2023-12-28 08:34:16,440][106225] Updated weights for policy 1, policy_version 1855714 (0.0006) [2023-12-28 08:34:16,490][106225] Updated weights for policy 1, policy_version 1855724 (0.0008) [2023-12-28 08:34:16,539][106225] Updated weights for policy 1, policy_version 1855734 (0.0009) [2023-12-28 08:34:16,586][106225] Updated weights for policy 1, policy_version 1855744 (0.0008) [2023-12-28 08:34:16,952][106226] Updated weights for policy 0, policy_version 1851760 (0.0006) [2023-12-28 08:34:17,010][106226] Updated weights for policy 0, policy_version 1851770 (0.0005) [2023-12-28 08:34:17,056][106226] Updated weights for policy 0, policy_version 1851780 (0.0006) [2023-12-28 08:34:17,211][106225] Updated weights for policy 1, policy_version 1855754 (0.0009) [2023-12-28 08:34:17,263][106225] Updated weights for policy 1, policy_version 1855764 (0.0008) [2023-12-28 08:34:17,328][106225] Updated weights for policy 1, policy_version 1855774 (0.0008) [2023-12-28 08:34:17,641][106226] Updated weights for policy 0, policy_version 1851790 (0.0008) [2023-12-28 08:34:17,709][106226] Updated weights for policy 0, policy_version 1851800 (0.0008) [2023-12-28 08:34:17,779][106226] Updated weights for policy 0, policy_version 1851810 (0.0009) [2023-12-28 08:34:18,050][106225] Updated weights for policy 1, policy_version 1855784 (0.0009) [2023-12-28 08:34:18,101][106225] Updated weights for policy 1, policy_version 1855794 (0.0009) [2023-12-28 08:34:18,159][106225] Updated weights for policy 1, policy_version 1855804 (0.0010) [2023-12-28 08:34:18,367][106226] Updated weights for policy 0, policy_version 1851820 (0.0008) [2023-12-28 08:34:18,436][106226] Updated weights for policy 0, policy_version 1851830 (0.0009) [2023-12-28 08:34:18,503][106226] Updated weights for policy 0, policy_version 1851840 (0.0010) [2023-12-28 08:34:18,962][106225] Updated weights for policy 1, policy_version 1855814 (0.0007) [2023-12-28 08:34:19,013][106225] Updated weights for policy 1, policy_version 1855824 (0.0006) [2023-12-28 08:34:19,067][106225] Updated weights for policy 1, policy_version 1855834 (0.0008) [2023-12-28 08:34:19,330][106226] Updated weights for policy 0, policy_version 1851850 (0.0009) [2023-12-28 08:34:19,396][106226] Updated weights for policy 0, policy_version 1851860 (0.0007) [2023-12-28 08:34:19,448][106226] Updated weights for policy 0, policy_version 1851870 (0.0009) [2023-12-28 08:34:19,515][106226] Updated weights for policy 0, policy_version 1851880 (0.0009) [2023-12-28 08:34:19,728][106225] Updated weights for policy 1, policy_version 1855844 (0.0008) [2023-12-28 08:34:19,790][106225] Updated weights for policy 1, policy_version 1855854 (0.0011) [2023-12-28 08:34:19,858][106225] Updated weights for policy 1, policy_version 1855864 (0.0010) [2023-12-28 08:34:20,306][106226] Updated weights for policy 0, policy_version 1851890 (0.0008) [2023-12-28 08:34:20,365][106226] Updated weights for policy 0, policy_version 1851900 (0.0008) [2023-12-28 08:34:20,431][106226] Updated weights for policy 0, policy_version 1851910 (0.0008) [2023-12-28 08:34:20,592][106225] Updated weights for policy 1, policy_version 1855874 (0.0011) [2023-12-28 08:34:20,647][106225] Updated weights for policy 1, policy_version 1855884 (0.0010) [2023-12-28 08:34:20,705][106225] Updated weights for policy 1, policy_version 1855894 (0.0011) [2023-12-28 08:34:20,761][106225] Updated weights for policy 1, policy_version 1855904 (0.0010) [2023-12-28 08:34:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 949338112. Throughput: 0: 9926.8, 1: 9953.4. Samples: 949351656. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:21,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.374')] [2023-12-28 08:34:21,186][106226] Updated weights for policy 0, policy_version 1851920 (0.0007) [2023-12-28 08:34:21,243][106226] Updated weights for policy 0, policy_version 1851930 (0.0006) [2023-12-28 08:34:21,301][106226] Updated weights for policy 0, policy_version 1851940 (0.0008) [2023-12-28 08:34:21,528][106225] Updated weights for policy 1, policy_version 1855914 (0.0009) [2023-12-28 08:34:21,584][106225] Updated weights for policy 1, policy_version 1855924 (0.0008) [2023-12-28 08:34:21,649][106225] Updated weights for policy 1, policy_version 1855934 (0.0009) [2023-12-28 08:34:22,015][106226] Updated weights for policy 0, policy_version 1851950 (0.0008) [2023-12-28 08:34:22,077][106226] Updated weights for policy 0, policy_version 1851960 (0.0008) [2023-12-28 08:34:22,140][106226] Updated weights for policy 0, policy_version 1851970 (0.0008) [2023-12-28 08:34:22,415][106225] Updated weights for policy 1, policy_version 1855944 (0.0010) [2023-12-28 08:34:22,469][106225] Updated weights for policy 1, policy_version 1855954 (0.0011) [2023-12-28 08:34:22,524][106225] Updated weights for policy 1, policy_version 1855964 (0.0010) [2023-12-28 08:34:22,878][106226] Updated weights for policy 0, policy_version 1851980 (0.0008) [2023-12-28 08:34:22,948][106226] Updated weights for policy 0, policy_version 1851990 (0.0010) [2023-12-28 08:34:23,018][106226] Updated weights for policy 0, policy_version 1852000 (0.0009) [2023-12-28 08:34:23,193][106225] Updated weights for policy 1, policy_version 1855974 (0.0010) [2023-12-28 08:34:23,250][106225] Updated weights for policy 1, policy_version 1855984 (0.0010) [2023-12-28 08:34:23,310][106225] Updated weights for policy 1, policy_version 1855994 (0.0010) [2023-12-28 08:34:23,664][106226] Updated weights for policy 0, policy_version 1852010 (0.0008) [2023-12-28 08:34:23,730][106226] Updated weights for policy 0, policy_version 1852020 (0.0006) [2023-12-28 08:34:23,789][106226] Updated weights for policy 0, policy_version 1852030 (0.0006) [2023-12-28 08:34:23,847][106226] Updated weights for policy 0, policy_version 1852040 (0.0008) [2023-12-28 08:34:24,047][106225] Updated weights for policy 1, policy_version 1856004 (0.0008) [2023-12-28 08:34:24,103][106225] Updated weights for policy 1, policy_version 1856014 (0.0008) [2023-12-28 08:34:24,158][106225] Updated weights for policy 1, policy_version 1856024 (0.0008) [2023-12-28 08:34:24,440][106226] Updated weights for policy 0, policy_version 1852050 (0.0010) [2023-12-28 08:34:24,494][106226] Updated weights for policy 0, policy_version 1852060 (0.0010) [2023-12-28 08:34:24,548][106226] Updated weights for policy 0, policy_version 1852070 (0.0010) [2023-12-28 08:34:24,788][106225] Updated weights for policy 1, policy_version 1856034 (0.0009) [2023-12-28 08:34:24,841][106225] Updated weights for policy 1, policy_version 1856044 (0.0010) [2023-12-28 08:34:24,889][106225] Updated weights for policy 1, policy_version 1856054 (0.0007) [2023-12-28 08:34:24,937][106225] Updated weights for policy 1, policy_version 1856064 (0.0010) [2023-12-28 08:34:25,137][106226] Updated weights for policy 0, policy_version 1852080 (0.0007) [2023-12-28 08:34:25,196][106226] Updated weights for policy 0, policy_version 1852090 (0.0005) [2023-12-28 08:34:25,261][106226] Updated weights for policy 0, policy_version 1852100 (0.0007) [2023-12-28 08:34:25,693][106225] Updated weights for policy 1, policy_version 1856074 (0.0009) [2023-12-28 08:34:25,745][106225] Updated weights for policy 1, policy_version 1856084 (0.0009) [2023-12-28 08:34:25,807][106225] Updated weights for policy 1, policy_version 1856094 (0.0008) [2023-12-28 08:34:25,809][106226] Updated weights for policy 0, policy_version 1852110 (0.0007) [2023-12-28 08:34:25,863][106226] Updated weights for policy 0, policy_version 1852120 (0.0005) [2023-12-28 08:34:25,923][106226] Updated weights for policy 0, policy_version 1852130 (0.0008) [2023-12-28 08:34:26,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.5, 300 sec: 19744.1). Total num frames: 949444608. Throughput: 0: 9875.8, 1: 9968.4. Samples: 949409752. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:26,175][105115] Avg episode reward: [(0, '-4.089'), (1, '-5.105')] [2023-12-28 08:34:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001856096_475217920.pth... [2023-12-28 08:34:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001852136_474226688.pth... [2023-12-28 08:34:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001854912_474914816.pth [2023-12-28 08:34:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001850984_473931776.pth [2023-12-28 08:34:26,472][106226] Updated weights for policy 0, policy_version 1852140 (0.0008) [2023-12-28 08:34:26,523][106226] Updated weights for policy 0, policy_version 1852150 (0.0008) [2023-12-28 08:34:26,587][106226] Updated weights for policy 0, policy_version 1852160 (0.0008) [2023-12-28 08:34:26,591][106225] Updated weights for policy 1, policy_version 1856104 (0.0006) [2023-12-28 08:34:26,641][106225] Updated weights for policy 1, policy_version 1856114 (0.0005) [2023-12-28 08:34:26,696][106225] Updated weights for policy 1, policy_version 1856124 (0.0005) [2023-12-28 08:34:27,333][106226] Updated weights for policy 0, policy_version 1852170 (0.0008) [2023-12-28 08:34:27,374][106225] Updated weights for policy 1, policy_version 1856134 (0.0008) [2023-12-28 08:34:27,385][106226] Updated weights for policy 0, policy_version 1852180 (0.0006) [2023-12-28 08:34:27,435][106225] Updated weights for policy 1, policy_version 1856144 (0.0007) [2023-12-28 08:34:27,439][106226] Updated weights for policy 0, policy_version 1852190 (0.0007) [2023-12-28 08:34:27,502][106226] Updated weights for policy 0, policy_version 1852200 (0.0007) [2023-12-28 08:34:27,504][106225] Updated weights for policy 1, policy_version 1856154 (0.0006) [2023-12-28 08:34:28,184][106226] Updated weights for policy 0, policy_version 1852210 (0.0005) [2023-12-28 08:34:28,241][106226] Updated weights for policy 0, policy_version 1852220 (0.0005) [2023-12-28 08:34:28,257][106225] Updated weights for policy 1, policy_version 1856164 (0.0008) [2023-12-28 08:34:28,290][106226] Updated weights for policy 0, policy_version 1852230 (0.0005) [2023-12-28 08:34:28,321][106225] Updated weights for policy 1, policy_version 1856174 (0.0009) [2023-12-28 08:34:28,385][106225] Updated weights for policy 1, policy_version 1856184 (0.0007) [2023-12-28 08:34:28,946][106226] Updated weights for policy 0, policy_version 1852240 (0.0008) [2023-12-28 08:34:28,999][106226] Updated weights for policy 0, policy_version 1852250 (0.0008) [2023-12-28 08:34:29,058][106226] Updated weights for policy 0, policy_version 1852260 (0.0009) [2023-12-28 08:34:29,089][106225] Updated weights for policy 1, policy_version 1856194 (0.0008) [2023-12-28 08:34:29,141][106225] Updated weights for policy 1, policy_version 1856204 (0.0008) [2023-12-28 08:34:29,202][106225] Updated weights for policy 1, policy_version 1856214 (0.0008) [2023-12-28 08:34:29,270][106225] Updated weights for policy 1, policy_version 1856224 (0.0008) [2023-12-28 08:34:29,783][106226] Updated weights for policy 0, policy_version 1852270 (0.0006) [2023-12-28 08:34:29,847][106226] Updated weights for policy 0, policy_version 1852280 (0.0007) [2023-12-28 08:34:29,904][106226] Updated weights for policy 0, policy_version 1852290 (0.0006) [2023-12-28 08:34:30,076][106225] Updated weights for policy 1, policy_version 1856234 (0.0008) [2023-12-28 08:34:30,135][106225] Updated weights for policy 1, policy_version 1856244 (0.0008) [2023-12-28 08:34:30,194][106225] Updated weights for policy 1, policy_version 1856254 (0.0008) [2023-12-28 08:34:30,572][106226] Updated weights for policy 0, policy_version 1852300 (0.0008) [2023-12-28 08:34:30,624][106226] Updated weights for policy 0, policy_version 1852310 (0.0008) [2023-12-28 08:34:30,672][106226] Updated weights for policy 0, policy_version 1852320 (0.0008) [2023-12-28 08:34:30,914][106225] Updated weights for policy 1, policy_version 1856264 (0.0006) [2023-12-28 08:34:30,964][106225] Updated weights for policy 1, policy_version 1856274 (0.0007) [2023-12-28 08:34:31,021][106225] Updated weights for policy 1, policy_version 1856284 (0.0010) [2023-12-28 08:34:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 949542912. Throughput: 0: 9934.3, 1: 9994.6. Samples: 949531708. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:31,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.523')] [2023-12-28 08:34:31,308][106226] Updated weights for policy 0, policy_version 1852330 (0.0007) [2023-12-28 08:34:31,368][106226] Updated weights for policy 0, policy_version 1852340 (0.0007) [2023-12-28 08:34:31,437][106226] Updated weights for policy 0, policy_version 1852350 (0.0009) [2023-12-28 08:34:31,492][106226] Updated weights for policy 0, policy_version 1852360 (0.0008) [2023-12-28 08:34:31,743][106225] Updated weights for policy 1, policy_version 1856294 (0.0008) [2023-12-28 08:34:31,814][106225] Updated weights for policy 1, policy_version 1856304 (0.0006) [2023-12-28 08:34:31,885][106225] Updated weights for policy 1, policy_version 1856314 (0.0005) [2023-12-28 08:34:32,143][106226] Updated weights for policy 0, policy_version 1852370 (0.0008) [2023-12-28 08:34:32,200][106226] Updated weights for policy 0, policy_version 1852380 (0.0008) [2023-12-28 08:34:32,258][106226] Updated weights for policy 0, policy_version 1852390 (0.0011) [2023-12-28 08:34:32,537][106225] Updated weights for policy 1, policy_version 1856324 (0.0007) [2023-12-28 08:34:32,600][106225] Updated weights for policy 1, policy_version 1856334 (0.0009) [2023-12-28 08:34:32,655][106225] Updated weights for policy 1, policy_version 1856344 (0.0007) [2023-12-28 08:34:33,026][106226] Updated weights for policy 0, policy_version 1852400 (0.0009) [2023-12-28 08:34:33,088][106226] Updated weights for policy 0, policy_version 1852410 (0.0008) [2023-12-28 08:34:33,136][106226] Updated weights for policy 0, policy_version 1852420 (0.0008) [2023-12-28 08:34:33,282][106225] Updated weights for policy 1, policy_version 1856354 (0.0007) [2023-12-28 08:34:33,329][106225] Updated weights for policy 1, policy_version 1856364 (0.0005) [2023-12-28 08:34:33,377][106225] Updated weights for policy 1, policy_version 1856374 (0.0007) [2023-12-28 08:34:33,425][106225] Updated weights for policy 1, policy_version 1856384 (0.0008) [2023-12-28 08:34:33,867][106226] Updated weights for policy 0, policy_version 1852430 (0.0007) [2023-12-28 08:34:33,930][106226] Updated weights for policy 0, policy_version 1852440 (0.0005) [2023-12-28 08:34:33,990][106226] Updated weights for policy 0, policy_version 1852450 (0.0005) [2023-12-28 08:34:34,048][106225] Updated weights for policy 1, policy_version 1856394 (0.0005) [2023-12-28 08:34:34,098][106225] Updated weights for policy 1, policy_version 1856404 (0.0005) [2023-12-28 08:34:34,178][106225] Updated weights for policy 1, policy_version 1856414 (0.0007) [2023-12-28 08:34:34,626][106226] Updated weights for policy 0, policy_version 1852460 (0.0008) [2023-12-28 08:34:34,691][106226] Updated weights for policy 0, policy_version 1852470 (0.0011) [2023-12-28 08:34:34,749][106226] Updated weights for policy 0, policy_version 1852480 (0.0010) [2023-12-28 08:34:34,858][106225] Updated weights for policy 1, policy_version 1856424 (0.0008) [2023-12-28 08:34:34,914][106225] Updated weights for policy 1, policy_version 1856434 (0.0009) [2023-12-28 08:34:34,971][106225] Updated weights for policy 1, policy_version 1856444 (0.0010) [2023-12-28 08:34:35,339][106226] Updated weights for policy 0, policy_version 1852490 (0.0010) [2023-12-28 08:34:35,396][106226] Updated weights for policy 0, policy_version 1852500 (0.0009) [2023-12-28 08:34:35,453][106226] Updated weights for policy 0, policy_version 1852510 (0.0010) [2023-12-28 08:34:35,509][106226] Updated weights for policy 0, policy_version 1852520 (0.0010) [2023-12-28 08:34:35,728][106225] Updated weights for policy 1, policy_version 1856454 (0.0008) [2023-12-28 08:34:35,785][106225] Updated weights for policy 1, policy_version 1856464 (0.0008) [2023-12-28 08:34:35,835][106225] Updated weights for policy 1, policy_version 1856474 (0.0008) [2023-12-28 08:34:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 949641216. Throughput: 0: 9971.2, 1: 9971.5. Samples: 949653340. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-28 08:34:36,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.887')] [2023-12-28 08:34:36,203][106226] Updated weights for policy 0, policy_version 1852530 (0.0011) [2023-12-28 08:34:36,268][106226] Updated weights for policy 0, policy_version 1852540 (0.0011) [2023-12-28 08:34:36,332][106226] Updated weights for policy 0, policy_version 1852550 (0.0010) [2023-12-28 08:34:36,597][106225] Updated weights for policy 1, policy_version 1856484 (0.0010) [2023-12-28 08:34:36,659][106225] Updated weights for policy 1, policy_version 1856494 (0.0011) [2023-12-28 08:34:36,727][106225] Updated weights for policy 1, policy_version 1856504 (0.0011) [2023-12-28 08:34:37,033][106226] Updated weights for policy 0, policy_version 1852560 (0.0006) [2023-12-28 08:34:37,100][106226] Updated weights for policy 0, policy_version 1852570 (0.0005) [2023-12-28 08:34:37,170][106226] Updated weights for policy 0, policy_version 1852580 (0.0005) [2023-12-28 08:34:37,422][106225] Updated weights for policy 1, policy_version 1856514 (0.0009) [2023-12-28 08:34:37,483][106225] Updated weights for policy 1, policy_version 1856524 (0.0005) [2023-12-28 08:34:37,550][106225] Updated weights for policy 1, policy_version 1856534 (0.0005) [2023-12-28 08:34:37,613][106225] Updated weights for policy 1, policy_version 1856544 (0.0005) [2023-12-28 08:34:37,718][106226] Updated weights for policy 0, policy_version 1852590 (0.0005) [2023-12-28 08:34:37,771][106226] Updated weights for policy 0, policy_version 1852600 (0.0006) [2023-12-28 08:34:37,822][106226] Updated weights for policy 0, policy_version 1852610 (0.0008) [2023-12-28 08:34:38,212][106225] Updated weights for policy 1, policy_version 1856554 (0.0005) [2023-12-28 08:34:38,278][106225] Updated weights for policy 1, policy_version 1856564 (0.0005) [2023-12-28 08:34:38,342][106225] Updated weights for policy 1, policy_version 1856574 (0.0008) [2023-12-28 08:34:38,566][106226] Updated weights for policy 0, policy_version 1852620 (0.0008) [2023-12-28 08:34:38,621][106226] Updated weights for policy 0, policy_version 1852630 (0.0008) [2023-12-28 08:34:38,689][106226] Updated weights for policy 0, policy_version 1852640 (0.0008) [2023-12-28 08:34:38,964][106225] Updated weights for policy 1, policy_version 1856584 (0.0010) [2023-12-28 08:34:39,017][106225] Updated weights for policy 1, policy_version 1856594 (0.0005) [2023-12-28 08:34:39,071][106225] Updated weights for policy 1, policy_version 1856604 (0.0006) [2023-12-28 08:34:39,508][106226] Updated weights for policy 0, policy_version 1852650 (0.0010) [2023-12-28 08:34:39,572][106226] Updated weights for policy 0, policy_version 1852660 (0.0011) [2023-12-28 08:34:39,638][106226] Updated weights for policy 0, policy_version 1852670 (0.0011) [2023-12-28 08:34:39,705][106226] Updated weights for policy 0, policy_version 1852680 (0.0011) [2023-12-28 08:34:39,842][106225] Updated weights for policy 1, policy_version 1856614 (0.0009) [2023-12-28 08:34:39,906][106225] Updated weights for policy 1, policy_version 1856624 (0.0008) [2023-12-28 08:34:39,976][106225] Updated weights for policy 1, policy_version 1856634 (0.0009) [2023-12-28 08:34:40,450][106226] Updated weights for policy 0, policy_version 1852690 (0.0011) [2023-12-28 08:34:40,512][106226] Updated weights for policy 0, policy_version 1852700 (0.0011) [2023-12-28 08:34:40,579][106226] Updated weights for policy 0, policy_version 1852710 (0.0009) [2023-12-28 08:34:40,600][106225] Updated weights for policy 1, policy_version 1856644 (0.0007) [2023-12-28 08:34:40,660][106225] Updated weights for policy 1, policy_version 1856654 (0.0005) [2023-12-28 08:34:40,722][106225] Updated weights for policy 1, policy_version 1856664 (0.0005) [2023-12-28 08:34:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 949739520. Throughput: 0: 9949.7, 1: 9988.7. Samples: 949712980. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:34:41,175][105115] Avg episode reward: [(0, '-4.272'), (1, '-4.738')] [2023-12-28 08:34:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001852712_474374144.pth... [2023-12-28 08:34:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001856672_475365376.pth... [2023-12-28 08:34:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001851560_474079232.pth [2023-12-28 08:34:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001855520_475070464.pth [2023-12-28 08:34:41,277][106226] Updated weights for policy 0, policy_version 1852720 (0.0011) [2023-12-28 08:34:41,347][106226] Updated weights for policy 0, policy_version 1852730 (0.0011) [2023-12-28 08:34:41,419][106226] Updated weights for policy 0, policy_version 1852740 (0.0008) [2023-12-28 08:34:41,435][106225] Updated weights for policy 1, policy_version 1856674 (0.0007) [2023-12-28 08:34:41,497][106225] Updated weights for policy 1, policy_version 1856684 (0.0007) [2023-12-28 08:34:41,564][106225] Updated weights for policy 1, policy_version 1856694 (0.0008) [2023-12-28 08:34:41,639][106225] Updated weights for policy 1, policy_version 1856704 (0.0008) [2023-12-28 08:34:42,160][106226] Updated weights for policy 0, policy_version 1852750 (0.0009) [2023-12-28 08:34:42,227][106226] Updated weights for policy 0, policy_version 1852760 (0.0010) [2023-12-28 08:34:42,308][106226] Updated weights for policy 0, policy_version 1852770 (0.0010) [2023-12-28 08:34:42,386][106225] Updated weights for policy 1, policy_version 1856714 (0.0007) [2023-12-28 08:34:42,448][106225] Updated weights for policy 1, policy_version 1856724 (0.0009) [2023-12-28 08:34:42,510][106225] Updated weights for policy 1, policy_version 1856734 (0.0009) [2023-12-28 08:34:43,101][106226] Updated weights for policy 0, policy_version 1852780 (0.0010) [2023-12-28 08:34:43,175][106226] Updated weights for policy 0, policy_version 1852790 (0.0011) [2023-12-28 08:34:43,242][106226] Updated weights for policy 0, policy_version 1852800 (0.0011) [2023-12-28 08:34:43,301][106225] Updated weights for policy 1, policy_version 1856744 (0.0006) [2023-12-28 08:34:43,361][106225] Updated weights for policy 1, policy_version 1856754 (0.0005) [2023-12-28 08:34:43,418][106225] Updated weights for policy 1, policy_version 1856764 (0.0005) [2023-12-28 08:34:43,935][106226] Updated weights for policy 0, policy_version 1852810 (0.0011) [2023-12-28 08:34:43,964][106225] Updated weights for policy 1, policy_version 1856774 (0.0005) [2023-12-28 08:34:43,995][106226] Updated weights for policy 0, policy_version 1852820 (0.0011) [2023-12-28 08:34:44,030][106225] Updated weights for policy 1, policy_version 1856784 (0.0006) [2023-12-28 08:34:44,048][106226] Updated weights for policy 0, policy_version 1852830 (0.0010) [2023-12-28 08:34:44,079][106225] Updated weights for policy 1, policy_version 1856794 (0.0005) [2023-12-28 08:34:44,099][106226] Updated weights for policy 0, policy_version 1852840 (0.0010) [2023-12-28 08:34:44,785][106226] Updated weights for policy 0, policy_version 1852850 (0.0007) [2023-12-28 08:34:44,797][106225] Updated weights for policy 1, policy_version 1856804 (0.0006) [2023-12-28 08:34:44,848][106226] Updated weights for policy 0, policy_version 1852860 (0.0010) [2023-12-28 08:34:44,850][106225] Updated weights for policy 1, policy_version 1856814 (0.0007) [2023-12-28 08:34:44,903][106225] Updated weights for policy 1, policy_version 1856824 (0.0007) [2023-12-28 08:34:44,909][106226] Updated weights for policy 0, policy_version 1852870 (0.0011) [2023-12-28 08:34:45,625][106225] Updated weights for policy 1, policy_version 1856834 (0.0007) [2023-12-28 08:34:45,632][106226] Updated weights for policy 0, policy_version 1852880 (0.0009) [2023-12-28 08:34:45,684][106226] Updated weights for policy 0, policy_version 1852890 (0.0008) [2023-12-28 08:34:45,690][106225] Updated weights for policy 1, policy_version 1856844 (0.0005) [2023-12-28 08:34:45,735][106226] Updated weights for policy 0, policy_version 1852900 (0.0010) [2023-12-28 08:34:45,738][106225] Updated weights for policy 1, policy_version 1856854 (0.0005) [2023-12-28 08:34:45,789][106225] Updated weights for policy 1, policy_version 1856864 (0.0005) [2023-12-28 08:34:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 949837824. Throughput: 0: 9889.2, 1: 9972.7. Samples: 949827924. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:34:46,176][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.768')] [2023-12-28 08:34:46,333][106226] Updated weights for policy 0, policy_version 1852910 (0.0007) [2023-12-28 08:34:46,376][106225] Updated weights for policy 1, policy_version 1856874 (0.0010) [2023-12-28 08:34:46,386][106226] Updated weights for policy 0, policy_version 1852920 (0.0005) [2023-12-28 08:34:46,431][106225] Updated weights for policy 1, policy_version 1856884 (0.0010) [2023-12-28 08:34:46,443][106226] Updated weights for policy 0, policy_version 1852930 (0.0008) [2023-12-28 08:34:46,481][106225] Updated weights for policy 1, policy_version 1856894 (0.0010) [2023-12-28 08:34:47,077][106226] Updated weights for policy 0, policy_version 1852940 (0.0010) [2023-12-28 08:34:47,138][106226] Updated weights for policy 0, policy_version 1852950 (0.0010) [2023-12-28 08:34:47,167][106225] Updated weights for policy 1, policy_version 1856904 (0.0010) [2023-12-28 08:34:47,194][106226] Updated weights for policy 0, policy_version 1852960 (0.0010) [2023-12-28 08:34:47,217][106225] Updated weights for policy 1, policy_version 1856914 (0.0010) [2023-12-28 08:34:47,263][106225] Updated weights for policy 1, policy_version 1856924 (0.0010) [2023-12-28 08:34:47,830][106226] Updated weights for policy 0, policy_version 1852970 (0.0010) [2023-12-28 08:34:47,887][106226] Updated weights for policy 0, policy_version 1852980 (0.0006) [2023-12-28 08:34:47,950][106226] Updated weights for policy 0, policy_version 1852990 (0.0006) [2023-12-28 08:34:48,002][106226] Updated weights for policy 0, policy_version 1853000 (0.0006) [2023-12-28 08:34:48,004][106225] Updated weights for policy 1, policy_version 1856934 (0.0010) [2023-12-28 08:34:48,071][106225] Updated weights for policy 1, policy_version 1856944 (0.0008) [2023-12-28 08:34:48,131][106225] Updated weights for policy 1, policy_version 1856954 (0.0009) [2023-12-28 08:34:48,655][106226] Updated weights for policy 0, policy_version 1853010 (0.0011) [2023-12-28 08:34:48,720][106226] Updated weights for policy 0, policy_version 1853020 (0.0011) [2023-12-28 08:34:48,784][106226] Updated weights for policy 0, policy_version 1853030 (0.0011) [2023-12-28 08:34:48,880][106225] Updated weights for policy 1, policy_version 1856964 (0.0008) [2023-12-28 08:34:48,941][106225] Updated weights for policy 1, policy_version 1856974 (0.0008) [2023-12-28 08:34:49,007][106225] Updated weights for policy 1, policy_version 1856984 (0.0008) [2023-12-28 08:34:49,516][106226] Updated weights for policy 0, policy_version 1853040 (0.0008) [2023-12-28 08:34:49,575][106226] Updated weights for policy 0, policy_version 1853050 (0.0009) [2023-12-28 08:34:49,642][106226] Updated weights for policy 0, policy_version 1853060 (0.0006) [2023-12-28 08:34:49,793][106225] Updated weights for policy 1, policy_version 1856994 (0.0008) [2023-12-28 08:34:49,857][106225] Updated weights for policy 1, policy_version 1857004 (0.0009) [2023-12-28 08:34:49,928][106225] Updated weights for policy 1, policy_version 1857014 (0.0008) [2023-12-28 08:34:49,991][106225] Updated weights for policy 1, policy_version 1857024 (0.0008) [2023-12-28 08:34:50,311][106226] Updated weights for policy 0, policy_version 1853070 (0.0007) [2023-12-28 08:34:50,374][106226] Updated weights for policy 0, policy_version 1853080 (0.0009) [2023-12-28 08:34:50,424][106226] Updated weights for policy 0, policy_version 1853090 (0.0008) [2023-12-28 08:34:50,753][106225] Updated weights for policy 1, policy_version 1857034 (0.0009) [2023-12-28 08:34:50,812][106225] Updated weights for policy 1, policy_version 1857044 (0.0008) [2023-12-28 08:34:50,883][106225] Updated weights for policy 1, policy_version 1857054 (0.0008) [2023-12-28 08:34:51,091][106226] Updated weights for policy 0, policy_version 1853100 (0.0009) [2023-12-28 08:34:51,160][106226] Updated weights for policy 0, policy_version 1853110 (0.0008) [2023-12-28 08:34:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 949936128. Throughput: 0: 9944.7, 1: 9869.2. Samples: 949948188. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:34:51,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.786')] [2023-12-28 08:34:51,219][106226] Updated weights for policy 0, policy_version 1853120 (0.0008) [2023-12-28 08:34:51,526][106225] Updated weights for policy 1, policy_version 1857064 (0.0006) [2023-12-28 08:34:51,585][106225] Updated weights for policy 1, policy_version 1857074 (0.0008) [2023-12-28 08:34:51,651][106225] Updated weights for policy 1, policy_version 1857084 (0.0008) [2023-12-28 08:34:51,942][106226] Updated weights for policy 0, policy_version 1853130 (0.0008) [2023-12-28 08:34:52,003][106226] Updated weights for policy 0, policy_version 1853140 (0.0005) [2023-12-28 08:34:52,074][106226] Updated weights for policy 0, policy_version 1853150 (0.0009) [2023-12-28 08:34:52,137][106226] Updated weights for policy 0, policy_version 1853160 (0.0008) [2023-12-28 08:34:52,429][106225] Updated weights for policy 1, policy_version 1857094 (0.0008) [2023-12-28 08:34:52,486][106225] Updated weights for policy 1, policy_version 1857104 (0.0009) [2023-12-28 08:34:52,550][106225] Updated weights for policy 1, policy_version 1857114 (0.0008) [2023-12-28 08:34:52,814][106226] Updated weights for policy 0, policy_version 1853170 (0.0009) [2023-12-28 08:34:52,888][106226] Updated weights for policy 0, policy_version 1853180 (0.0009) [2023-12-28 08:34:52,956][106226] Updated weights for policy 0, policy_version 1853190 (0.0009) [2023-12-28 08:34:53,176][106225] Updated weights for policy 1, policy_version 1857124 (0.0008) [2023-12-28 08:34:53,226][106225] Updated weights for policy 1, policy_version 1857134 (0.0008) [2023-12-28 08:34:53,273][106225] Updated weights for policy 1, policy_version 1857144 (0.0008) [2023-12-28 08:34:53,659][106226] Updated weights for policy 0, policy_version 1853200 (0.0006) [2023-12-28 08:34:53,733][106226] Updated weights for policy 0, policy_version 1853210 (0.0008) [2023-12-28 08:34:53,798][106226] Updated weights for policy 0, policy_version 1853220 (0.0010) [2023-12-28 08:34:53,947][106225] Updated weights for policy 1, policy_version 1857154 (0.0008) [2023-12-28 08:34:53,999][106225] Updated weights for policy 1, policy_version 1857164 (0.0010) [2023-12-28 08:34:54,055][106225] Updated weights for policy 1, policy_version 1857174 (0.0008) [2023-12-28 08:34:54,117][106225] Updated weights for policy 1, policy_version 1857184 (0.0008) [2023-12-28 08:34:54,417][106226] Updated weights for policy 0, policy_version 1853230 (0.0006) [2023-12-28 08:34:54,468][106226] Updated weights for policy 0, policy_version 1853240 (0.0009) [2023-12-28 08:34:54,530][106226] Updated weights for policy 0, policy_version 1853250 (0.0009) [2023-12-28 08:34:54,816][106225] Updated weights for policy 1, policy_version 1857194 (0.0005) [2023-12-28 08:34:54,864][106225] Updated weights for policy 1, policy_version 1857204 (0.0005) [2023-12-28 08:34:54,917][106225] Updated weights for policy 1, policy_version 1857214 (0.0005) [2023-12-28 08:34:55,134][106226] Updated weights for policy 0, policy_version 1853260 (0.0009) [2023-12-28 08:34:55,186][106226] Updated weights for policy 0, policy_version 1853270 (0.0007) [2023-12-28 08:34:55,240][106226] Updated weights for policy 0, policy_version 1853280 (0.0008) [2023-12-28 08:34:55,512][106225] Updated weights for policy 1, policy_version 1857224 (0.0008) [2023-12-28 08:34:55,569][106225] Updated weights for policy 1, policy_version 1857234 (0.0009) [2023-12-28 08:34:55,626][106225] Updated weights for policy 1, policy_version 1857244 (0.0009) [2023-12-28 08:34:55,938][106226] Updated weights for policy 0, policy_version 1853290 (0.0008) [2023-12-28 08:34:56,001][106226] Updated weights for policy 0, policy_version 1853300 (0.0009) [2023-12-28 08:34:56,049][106226] Updated weights for policy 0, policy_version 1853310 (0.0008) [2023-12-28 08:34:56,099][106226] Updated weights for policy 0, policy_version 1853320 (0.0006) [2023-12-28 08:34:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 950042624. Throughput: 0: 9942.7, 1: 9817.8. Samples: 950007884. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:34:56,176][105115] Avg episode reward: [(0, '-4.183'), (1, '-4.972')] [2023-12-28 08:34:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001857248_475512832.pth... [2023-12-28 08:34:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001853320_474529792.pth... [2023-12-28 08:34:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001856096_475217920.pth [2023-12-28 08:34:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001852136_474226688.pth [2023-12-28 08:34:56,261][106225] Updated weights for policy 1, policy_version 1857254 (0.0008) [2023-12-28 08:34:56,312][106225] Updated weights for policy 1, policy_version 1857264 (0.0008) [2023-12-28 08:34:56,362][106225] Updated weights for policy 1, policy_version 1857274 (0.0008) [2023-12-28 08:34:56,758][106226] Updated weights for policy 0, policy_version 1853330 (0.0005) [2023-12-28 08:34:56,821][106226] Updated weights for policy 0, policy_version 1853340 (0.0006) [2023-12-28 08:34:56,873][106226] Updated weights for policy 0, policy_version 1853350 (0.0006) [2023-12-28 08:34:57,133][106225] Updated weights for policy 1, policy_version 1857284 (0.0008) [2023-12-28 08:34:57,176][106225] Updated weights for policy 1, policy_version 1857294 (0.0008) [2023-12-28 08:34:57,224][106225] Updated weights for policy 1, policy_version 1857304 (0.0009) [2023-12-28 08:34:57,517][106226] Updated weights for policy 0, policy_version 1853360 (0.0008) [2023-12-28 08:34:57,576][106226] Updated weights for policy 0, policy_version 1853370 (0.0009) [2023-12-28 08:34:57,634][106226] Updated weights for policy 0, policy_version 1853380 (0.0008) [2023-12-28 08:34:57,911][106225] Updated weights for policy 1, policy_version 1857314 (0.0007) [2023-12-28 08:34:57,972][106225] Updated weights for policy 1, policy_version 1857324 (0.0009) [2023-12-28 08:34:58,030][106225] Updated weights for policy 1, policy_version 1857334 (0.0008) [2023-12-28 08:34:58,095][106225] Updated weights for policy 1, policy_version 1857344 (0.0009) [2023-12-28 08:34:58,432][106226] Updated weights for policy 0, policy_version 1853390 (0.0010) [2023-12-28 08:34:58,496][106226] Updated weights for policy 0, policy_version 1853400 (0.0009) [2023-12-28 08:34:58,568][106226] Updated weights for policy 0, policy_version 1853410 (0.0012) [2023-12-28 08:34:58,996][106225] Updated weights for policy 1, policy_version 1857354 (0.0010) [2023-12-28 08:34:59,054][106225] Updated weights for policy 1, policy_version 1857365 (0.0009) [2023-12-28 08:34:59,115][106225] Updated weights for policy 1, policy_version 1857375 (0.0008) [2023-12-28 08:34:59,291][106226] Updated weights for policy 0, policy_version 1853420 (0.0009) [2023-12-28 08:34:59,358][106226] Updated weights for policy 0, policy_version 1853430 (0.0009) [2023-12-28 08:34:59,420][106226] Updated weights for policy 0, policy_version 1853440 (0.0009) [2023-12-28 08:34:59,888][106225] Updated weights for policy 1, policy_version 1857385 (0.0008) [2023-12-28 08:34:59,951][106225] Updated weights for policy 1, policy_version 1857395 (0.0007) [2023-12-28 08:35:00,012][106225] Updated weights for policy 1, policy_version 1857405 (0.0005) [2023-12-28 08:35:00,199][106226] Updated weights for policy 0, policy_version 1853450 (0.0008) [2023-12-28 08:35:00,258][106226] Updated weights for policy 0, policy_version 1853460 (0.0008) [2023-12-28 08:35:00,313][106226] Updated weights for policy 0, policy_version 1853470 (0.0008) [2023-12-28 08:35:00,369][106226] Updated weights for policy 0, policy_version 1853480 (0.0009) [2023-12-28 08:35:00,628][106225] Updated weights for policy 1, policy_version 1857415 (0.0005) [2023-12-28 08:35:00,693][106225] Updated weights for policy 1, policy_version 1857425 (0.0005) [2023-12-28 08:35:00,754][106225] Updated weights for policy 1, policy_version 1857435 (0.0005) [2023-12-28 08:35:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 950132736. Throughput: 0: 9998.8, 1: 9852.4. Samples: 950125960. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:01,175][105115] Avg episode reward: [(0, '-4.525'), (1, '-4.629')] [2023-12-28 08:35:01,213][106226] Updated weights for policy 0, policy_version 1853490 (0.0007) [2023-12-28 08:35:01,282][106226] Updated weights for policy 0, policy_version 1853500 (0.0009) [2023-12-28 08:35:01,332][106225] Updated weights for policy 1, policy_version 1857445 (0.0007) [2023-12-28 08:35:01,342][106226] Updated weights for policy 0, policy_version 1853510 (0.0006) [2023-12-28 08:35:01,397][106225] Updated weights for policy 1, policy_version 1857455 (0.0006) [2023-12-28 08:35:01,456][106225] Updated weights for policy 1, policy_version 1857465 (0.0008) [2023-12-28 08:35:02,050][106226] Updated weights for policy 0, policy_version 1853520 (0.0010) [2023-12-28 08:35:02,107][106226] Updated weights for policy 0, policy_version 1853530 (0.0009) [2023-12-28 08:35:02,160][106226] Updated weights for policy 0, policy_version 1853540 (0.0010) [2023-12-28 08:35:02,176][106225] Updated weights for policy 1, policy_version 1857475 (0.0008) [2023-12-28 08:35:02,236][106225] Updated weights for policy 1, policy_version 1857485 (0.0010) [2023-12-28 08:35:02,307][106225] Updated weights for policy 1, policy_version 1857495 (0.0007) [2023-12-28 08:35:02,838][106226] Updated weights for policy 0, policy_version 1853550 (0.0007) [2023-12-28 08:35:02,897][106226] Updated weights for policy 0, policy_version 1853560 (0.0008) [2023-12-28 08:35:02,962][106226] Updated weights for policy 0, policy_version 1853570 (0.0008) [2023-12-28 08:35:02,985][106225] Updated weights for policy 1, policy_version 1857505 (0.0007) [2023-12-28 08:35:03,039][106225] Updated weights for policy 1, policy_version 1857515 (0.0009) [2023-12-28 08:35:03,091][106225] Updated weights for policy 1, policy_version 1857525 (0.0008) [2023-12-28 08:35:03,150][106225] Updated weights for policy 1, policy_version 1857535 (0.0010) [2023-12-28 08:35:03,516][106226] Updated weights for policy 0, policy_version 1853580 (0.0006) [2023-12-28 08:35:03,561][106226] Updated weights for policy 0, policy_version 1853590 (0.0005) [2023-12-28 08:35:03,611][106226] Updated weights for policy 0, policy_version 1853600 (0.0005) [2023-12-28 08:35:03,906][106225] Updated weights for policy 1, policy_version 1857545 (0.0010) [2023-12-28 08:35:03,967][106225] Updated weights for policy 1, policy_version 1857555 (0.0010) [2023-12-28 08:35:04,029][106225] Updated weights for policy 1, policy_version 1857565 (0.0010) [2023-12-28 08:35:04,232][106226] Updated weights for policy 0, policy_version 1853610 (0.0006) [2023-12-28 08:35:04,294][106226] Updated weights for policy 0, policy_version 1853620 (0.0007) [2023-12-28 08:35:04,355][106226] Updated weights for policy 0, policy_version 1853630 (0.0010) [2023-12-28 08:35:04,413][106226] Updated weights for policy 0, policy_version 1853640 (0.0011) [2023-12-28 08:35:04,733][106225] Updated weights for policy 1, policy_version 1857575 (0.0010) [2023-12-28 08:35:04,794][106225] Updated weights for policy 1, policy_version 1857585 (0.0010) [2023-12-28 08:35:04,853][106225] Updated weights for policy 1, policy_version 1857595 (0.0010) [2023-12-28 08:35:05,121][106226] Updated weights for policy 0, policy_version 1853650 (0.0007) [2023-12-28 08:35:05,182][106226] Updated weights for policy 0, policy_version 1853660 (0.0007) [2023-12-28 08:35:05,232][106226] Updated weights for policy 0, policy_version 1853670 (0.0008) [2023-12-28 08:35:05,540][106225] Updated weights for policy 1, policy_version 1857605 (0.0008) [2023-12-28 08:35:05,584][106225] Updated weights for policy 1, policy_version 1857615 (0.0005) [2023-12-28 08:35:05,640][106225] Updated weights for policy 1, policy_version 1857625 (0.0005) [2023-12-28 08:35:05,954][106226] Updated weights for policy 0, policy_version 1853680 (0.0010) [2023-12-28 08:35:06,013][106226] Updated weights for policy 0, policy_version 1853690 (0.0010) [2023-12-28 08:35:06,072][106226] Updated weights for policy 0, policy_version 1853700 (0.0011) [2023-12-28 08:35:06,174][105115] Fps is (10 sec: 19661.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 950239232. Throughput: 0: 10045.4, 1: 9855.9. Samples: 950247216. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:06,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.831')] [2023-12-28 08:35:06,236][106225] Updated weights for policy 1, policy_version 1857635 (0.0007) [2023-12-28 08:35:06,301][106225] Updated weights for policy 1, policy_version 1857645 (0.0011) [2023-12-28 08:35:06,356][106225] Updated weights for policy 1, policy_version 1857655 (0.0010) [2023-12-28 08:35:06,838][106226] Updated weights for policy 0, policy_version 1853710 (0.0009) [2023-12-28 08:35:06,903][106226] Updated weights for policy 0, policy_version 1853720 (0.0011) [2023-12-28 08:35:06,968][106226] Updated weights for policy 0, policy_version 1853730 (0.0011) [2023-12-28 08:35:07,034][106225] Updated weights for policy 1, policy_version 1857665 (0.0010) [2023-12-28 08:35:07,090][106225] Updated weights for policy 1, policy_version 1857675 (0.0005) [2023-12-28 08:35:07,145][106225] Updated weights for policy 1, policy_version 1857685 (0.0005) [2023-12-28 08:35:07,203][106225] Updated weights for policy 1, policy_version 1857695 (0.0005) [2023-12-28 08:35:07,676][106226] Updated weights for policy 0, policy_version 1853740 (0.0011) [2023-12-28 08:35:07,737][106226] Updated weights for policy 0, policy_version 1853750 (0.0011) [2023-12-28 08:35:07,754][106225] Updated weights for policy 1, policy_version 1857705 (0.0010) [2023-12-28 08:35:07,789][106226] Updated weights for policy 0, policy_version 1853760 (0.0010) [2023-12-28 08:35:07,804][106225] Updated weights for policy 1, policy_version 1857715 (0.0010) [2023-12-28 08:35:07,861][106225] Updated weights for policy 1, policy_version 1857725 (0.0010) [2023-12-28 08:35:08,396][106226] Updated weights for policy 0, policy_version 1853770 (0.0011) [2023-12-28 08:35:08,457][106226] Updated weights for policy 0, policy_version 1853780 (0.0010) [2023-12-28 08:35:08,517][106226] Updated weights for policy 0, policy_version 1853790 (0.0010) [2023-12-28 08:35:08,578][106226] Updated weights for policy 0, policy_version 1853800 (0.0011) [2023-12-28 08:35:08,611][106225] Updated weights for policy 1, policy_version 1857735 (0.0010) [2023-12-28 08:35:08,675][106225] Updated weights for policy 1, policy_version 1857745 (0.0011) [2023-12-28 08:35:08,738][106225] Updated weights for policy 1, policy_version 1857755 (0.0010) [2023-12-28 08:35:09,257][106226] Updated weights for policy 0, policy_version 1853810 (0.0010) [2023-12-28 08:35:09,325][106226] Updated weights for policy 0, policy_version 1853820 (0.0010) [2023-12-28 08:35:09,395][106226] Updated weights for policy 0, policy_version 1853830 (0.0008) [2023-12-28 08:35:09,434][106225] Updated weights for policy 1, policy_version 1857765 (0.0008) [2023-12-28 08:35:09,498][106225] Updated weights for policy 1, policy_version 1857775 (0.0009) [2023-12-28 08:35:09,566][106225] Updated weights for policy 1, policy_version 1857785 (0.0007) [2023-12-28 08:35:10,102][106226] Updated weights for policy 0, policy_version 1853840 (0.0008) [2023-12-28 08:35:10,174][106226] Updated weights for policy 0, policy_version 1853850 (0.0006) [2023-12-28 08:35:10,240][106226] Updated weights for policy 0, policy_version 1853860 (0.0007) [2023-12-28 08:35:10,315][106225] Updated weights for policy 1, policy_version 1857795 (0.0007) [2023-12-28 08:35:10,371][106225] Updated weights for policy 1, policy_version 1857805 (0.0009) [2023-12-28 08:35:10,430][106225] Updated weights for policy 1, policy_version 1857815 (0.0006) [2023-12-28 08:35:10,983][106226] Updated weights for policy 0, policy_version 1853870 (0.0009) [2023-12-28 08:35:11,001][106225] Updated weights for policy 1, policy_version 1857825 (0.0006) [2023-12-28 08:35:11,062][106226] Updated weights for policy 0, policy_version 1853880 (0.0007) [2023-12-28 08:35:11,068][106225] Updated weights for policy 1, policy_version 1857835 (0.0007) [2023-12-28 08:35:11,136][106226] Updated weights for policy 0, policy_version 1853890 (0.0010) [2023-12-28 08:35:11,140][106225] Updated weights for policy 1, policy_version 1857845 (0.0008) [2023-12-28 08:35:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 950329344. Throughput: 0: 10059.6, 1: 9931.5. Samples: 950309356. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:11,175][105115] Avg episode reward: [(0, '-4.262'), (1, '-4.502')] [2023-12-28 08:35:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001853896_474677248.pth... [2023-12-28 08:35:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001852712_474374144.pth [2023-12-28 08:35:11,201][106225] Updated weights for policy 1, policy_version 1857855 (0.0007) [2023-12-28 08:35:11,209][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001857856_475668480.pth... [2023-12-28 08:35:11,214][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001856672_475365376.pth [2023-12-28 08:35:11,908][106226] Updated weights for policy 0, policy_version 1853900 (0.0007) [2023-12-28 08:35:11,956][106225] Updated weights for policy 1, policy_version 1857865 (0.0009) [2023-12-28 08:35:11,977][106226] Updated weights for policy 0, policy_version 1853910 (0.0005) [2023-12-28 08:35:12,022][106225] Updated weights for policy 1, policy_version 1857875 (0.0009) [2023-12-28 08:35:12,039][106226] Updated weights for policy 0, policy_version 1853920 (0.0006) [2023-12-28 08:35:12,088][106225] Updated weights for policy 1, policy_version 1857885 (0.0008) [2023-12-28 08:35:12,673][106226] Updated weights for policy 0, policy_version 1853930 (0.0007) [2023-12-28 08:35:12,736][106226] Updated weights for policy 0, policy_version 1853940 (0.0008) [2023-12-28 08:35:12,799][106226] Updated weights for policy 0, policy_version 1853950 (0.0008) [2023-12-28 08:35:12,842][106225] Updated weights for policy 1, policy_version 1857895 (0.0007) [2023-12-28 08:35:12,864][106226] Updated weights for policy 0, policy_version 1853960 (0.0009) [2023-12-28 08:35:12,900][106225] Updated weights for policy 1, policy_version 1857905 (0.0006) [2023-12-28 08:35:12,961][106225] Updated weights for policy 1, policy_version 1857915 (0.0008) [2023-12-28 08:35:13,542][106226] Updated weights for policy 0, policy_version 1853970 (0.0007) [2023-12-28 08:35:13,605][106226] Updated weights for policy 0, policy_version 1853980 (0.0005) [2023-12-28 08:35:13,638][106225] Updated weights for policy 1, policy_version 1857925 (0.0008) [2023-12-28 08:35:13,664][106226] Updated weights for policy 0, policy_version 1853990 (0.0006) [2023-12-28 08:35:13,693][106225] Updated weights for policy 1, policy_version 1857935 (0.0008) [2023-12-28 08:35:13,746][106225] Updated weights for policy 1, policy_version 1857945 (0.0008) [2023-12-28 08:35:14,267][106226] Updated weights for policy 0, policy_version 1854000 (0.0008) [2023-12-28 08:35:14,330][106226] Updated weights for policy 0, policy_version 1854010 (0.0008) [2023-12-28 08:35:14,392][106226] Updated weights for policy 0, policy_version 1854020 (0.0009) [2023-12-28 08:35:14,530][106225] Updated weights for policy 1, policy_version 1857955 (0.0008) [2023-12-28 08:35:14,584][106225] Updated weights for policy 1, policy_version 1857965 (0.0009) [2023-12-28 08:35:14,637][106225] Updated weights for policy 1, policy_version 1857975 (0.0008) [2023-12-28 08:35:15,019][106226] Updated weights for policy 0, policy_version 1854030 (0.0008) [2023-12-28 08:35:15,087][106226] Updated weights for policy 0, policy_version 1854040 (0.0010) [2023-12-28 08:35:15,160][106226] Updated weights for policy 0, policy_version 1854050 (0.0010) [2023-12-28 08:35:15,368][106225] Updated weights for policy 1, policy_version 1857985 (0.0010) [2023-12-28 08:35:15,441][106225] Updated weights for policy 1, policy_version 1857995 (0.0008) [2023-12-28 08:35:15,494][106225] Updated weights for policy 1, policy_version 1858005 (0.0008) [2023-12-28 08:35:15,550][106225] Updated weights for policy 1, policy_version 1858015 (0.0008) [2023-12-28 08:35:15,880][106226] Updated weights for policy 0, policy_version 1854060 (0.0008) [2023-12-28 08:35:15,934][106226] Updated weights for policy 0, policy_version 1854070 (0.0008) [2023-12-28 08:35:15,990][106226] Updated weights for policy 0, policy_version 1854080 (0.0007) [2023-12-28 08:35:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 950435840. Throughput: 0: 9941.5, 1: 9921.2. Samples: 950425528. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:16,175][105115] Avg episode reward: [(0, '-4.534'), (1, '-4.668')] [2023-12-28 08:35:16,228][106225] Updated weights for policy 1, policy_version 1858025 (0.0010) [2023-12-28 08:35:16,278][106225] Updated weights for policy 1, policy_version 1858035 (0.0010) [2023-12-28 08:35:16,326][106225] Updated weights for policy 1, policy_version 1858045 (0.0010) [2023-12-28 08:35:16,562][106226] Updated weights for policy 0, policy_version 1854090 (0.0005) [2023-12-28 08:35:16,610][106226] Updated weights for policy 0, policy_version 1854100 (0.0005) [2023-12-28 08:35:16,656][106226] Updated weights for policy 0, policy_version 1854110 (0.0005) [2023-12-28 08:35:16,705][106226] Updated weights for policy 0, policy_version 1854120 (0.0005) [2023-12-28 08:35:17,066][106225] Updated weights for policy 1, policy_version 1858055 (0.0009) [2023-12-28 08:35:17,123][106225] Updated weights for policy 1, policy_version 1858065 (0.0010) [2023-12-28 08:35:17,179][106225] Updated weights for policy 1, policy_version 1858075 (0.0010) [2023-12-28 08:35:17,368][106226] Updated weights for policy 0, policy_version 1854130 (0.0008) [2023-12-28 08:35:17,426][106226] Updated weights for policy 0, policy_version 1854140 (0.0007) [2023-12-28 08:35:17,479][106226] Updated weights for policy 0, policy_version 1854150 (0.0007) [2023-12-28 08:35:17,875][106225] Updated weights for policy 1, policy_version 1858085 (0.0008) [2023-12-28 08:35:17,936][106225] Updated weights for policy 1, policy_version 1858095 (0.0005) [2023-12-28 08:35:17,997][106225] Updated weights for policy 1, policy_version 1858105 (0.0005) [2023-12-28 08:35:18,234][106226] Updated weights for policy 0, policy_version 1854160 (0.0007) [2023-12-28 08:35:18,298][106226] Updated weights for policy 0, policy_version 1854170 (0.0005) [2023-12-28 08:35:18,370][106226] Updated weights for policy 0, policy_version 1854180 (0.0006) [2023-12-28 08:35:18,625][106225] Updated weights for policy 1, policy_version 1858115 (0.0007) [2023-12-28 08:35:18,684][106225] Updated weights for policy 1, policy_version 1858125 (0.0008) [2023-12-28 08:35:18,742][106225] Updated weights for policy 1, policy_version 1858135 (0.0011) [2023-12-28 08:35:19,007][106226] Updated weights for policy 0, policy_version 1854190 (0.0008) [2023-12-28 08:35:19,057][106226] Updated weights for policy 0, policy_version 1854200 (0.0008) [2023-12-28 08:35:19,106][106226] Updated weights for policy 0, policy_version 1854210 (0.0007) [2023-12-28 08:35:19,464][106225] Updated weights for policy 1, policy_version 1858145 (0.0012) [2023-12-28 08:35:19,524][106225] Updated weights for policy 1, policy_version 1858155 (0.0010) [2023-12-28 08:35:19,592][106225] Updated weights for policy 1, policy_version 1858165 (0.0009) [2023-12-28 08:35:19,655][106225] Updated weights for policy 1, policy_version 1858175 (0.0011) [2023-12-28 08:35:19,918][106226] Updated weights for policy 0, policy_version 1854220 (0.0008) [2023-12-28 08:35:19,988][106226] Updated weights for policy 0, policy_version 1854230 (0.0008) [2023-12-28 08:35:20,055][106226] Updated weights for policy 0, policy_version 1854240 (0.0008) [2023-12-28 08:35:20,398][106225] Updated weights for policy 1, policy_version 1858185 (0.0010) [2023-12-28 08:35:20,463][106225] Updated weights for policy 1, policy_version 1858195 (0.0010) [2023-12-28 08:35:20,520][106225] Updated weights for policy 1, policy_version 1858205 (0.0010) [2023-12-28 08:35:20,743][106226] Updated weights for policy 0, policy_version 1854250 (0.0007) [2023-12-28 08:35:20,806][106226] Updated weights for policy 0, policy_version 1854260 (0.0007) [2023-12-28 08:35:20,861][106226] Updated weights for policy 0, policy_version 1854270 (0.0006) [2023-12-28 08:35:20,925][106226] Updated weights for policy 0, policy_version 1854280 (0.0008) [2023-12-28 08:35:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 950534144. Throughput: 0: 9910.0, 1: 9893.3. Samples: 950544492. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:21,175][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.734')] [2023-12-28 08:35:21,261][106225] Updated weights for policy 1, policy_version 1858215 (0.0008) [2023-12-28 08:35:21,325][106225] Updated weights for policy 1, policy_version 1858225 (0.0006) [2023-12-28 08:35:21,406][106225] Updated weights for policy 1, policy_version 1858235 (0.0008) [2023-12-28 08:35:21,599][106226] Updated weights for policy 0, policy_version 1854290 (0.0007) [2023-12-28 08:35:21,670][106226] Updated weights for policy 0, policy_version 1854300 (0.0008) [2023-12-28 08:35:21,738][106226] Updated weights for policy 0, policy_version 1854310 (0.0008) [2023-12-28 08:35:22,121][106225] Updated weights for policy 1, policy_version 1858245 (0.0009) [2023-12-28 08:35:22,186][106225] Updated weights for policy 1, policy_version 1858255 (0.0007) [2023-12-28 08:35:22,243][106225] Updated weights for policy 1, policy_version 1858265 (0.0008) [2023-12-28 08:35:22,487][106226] Updated weights for policy 0, policy_version 1854320 (0.0008) [2023-12-28 08:35:22,552][106226] Updated weights for policy 0, policy_version 1854330 (0.0007) [2023-12-28 08:35:22,614][106226] Updated weights for policy 0, policy_version 1854340 (0.0008) [2023-12-28 08:35:23,050][106225] Updated weights for policy 1, policy_version 1858275 (0.0010) [2023-12-28 08:35:23,120][106225] Updated weights for policy 1, policy_version 1858285 (0.0010) [2023-12-28 08:35:23,186][106225] Updated weights for policy 1, policy_version 1858295 (0.0008) [2023-12-28 08:35:23,276][106226] Updated weights for policy 0, policy_version 1854350 (0.0007) [2023-12-28 08:35:23,339][106226] Updated weights for policy 0, policy_version 1854360 (0.0009) [2023-12-28 08:35:23,398][106226] Updated weights for policy 0, policy_version 1854370 (0.0008) [2023-12-28 08:35:23,893][106225] Updated weights for policy 1, policy_version 1858305 (0.0009) [2023-12-28 08:35:23,941][106225] Updated weights for policy 1, policy_version 1858315 (0.0008) [2023-12-28 08:35:23,989][106225] Updated weights for policy 1, policy_version 1858325 (0.0008) [2023-12-28 08:35:24,044][106225] Updated weights for policy 1, policy_version 1858335 (0.0008) [2023-12-28 08:35:24,120][106226] Updated weights for policy 0, policy_version 1854380 (0.0008) [2023-12-28 08:35:24,179][106226] Updated weights for policy 0, policy_version 1854390 (0.0008) [2023-12-28 08:35:24,242][106226] Updated weights for policy 0, policy_version 1854400 (0.0009) [2023-12-28 08:35:24,765][106225] Updated weights for policy 1, policy_version 1858345 (0.0009) [2023-12-28 08:35:24,815][106225] Updated weights for policy 1, policy_version 1858355 (0.0008) [2023-12-28 08:35:24,861][106225] Updated weights for policy 1, policy_version 1858365 (0.0010) [2023-12-28 08:35:24,922][106226] Updated weights for policy 0, policy_version 1854410 (0.0008) [2023-12-28 08:35:24,983][106226] Updated weights for policy 0, policy_version 1854420 (0.0005) [2023-12-28 08:35:25,036][106226] Updated weights for policy 0, policy_version 1854430 (0.0009) [2023-12-28 08:35:25,092][106226] Updated weights for policy 0, policy_version 1854440 (0.0010) [2023-12-28 08:35:25,468][106225] Updated weights for policy 1, policy_version 1858375 (0.0007) [2023-12-28 08:35:25,537][106225] Updated weights for policy 1, policy_version 1858385 (0.0008) [2023-12-28 08:35:25,603][106225] Updated weights for policy 1, policy_version 1858395 (0.0006) [2023-12-28 08:35:25,706][106226] Updated weights for policy 0, policy_version 1854450 (0.0005) [2023-12-28 08:35:25,763][106226] Updated weights for policy 0, policy_version 1854460 (0.0005) [2023-12-28 08:35:25,823][106226] Updated weights for policy 0, policy_version 1854470 (0.0005) [2023-12-28 08:35:26,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 950632448. Throughput: 0: 9901.5, 1: 9838.9. Samples: 950601300. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:26,176][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.399')] [2023-12-28 08:35:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001854472_474824704.pth... [2023-12-28 08:35:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001853320_474529792.pth [2023-12-28 08:35:26,197][106225] Updated weights for policy 1, policy_version 1858405 (0.0008) [2023-12-28 08:35:26,261][106225] Updated weights for policy 1, policy_version 1858415 (0.0010) [2023-12-28 08:35:26,318][106225] Updated weights for policy 1, policy_version 1858425 (0.0010) [2023-12-28 08:35:26,355][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001858432_475815936.pth... [2023-12-28 08:35:26,359][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001857248_475512832.pth [2023-12-28 08:35:26,415][106226] Updated weights for policy 0, policy_version 1854480 (0.0009) [2023-12-28 08:35:26,478][106226] Updated weights for policy 0, policy_version 1854490 (0.0008) [2023-12-28 08:35:26,533][106226] Updated weights for policy 0, policy_version 1854500 (0.0008) [2023-12-28 08:35:26,992][106225] Updated weights for policy 1, policy_version 1858435 (0.0009) [2023-12-28 08:35:27,048][106225] Updated weights for policy 1, policy_version 1858445 (0.0006) [2023-12-28 08:35:27,101][106225] Updated weights for policy 1, policy_version 1858455 (0.0005) [2023-12-28 08:35:27,229][106226] Updated weights for policy 0, policy_version 1854510 (0.0010) [2023-12-28 08:35:27,286][106226] Updated weights for policy 0, policy_version 1854520 (0.0010) [2023-12-28 08:35:27,342][106226] Updated weights for policy 0, policy_version 1854530 (0.0011) [2023-12-28 08:35:27,710][106225] Updated weights for policy 1, policy_version 1858465 (0.0006) [2023-12-28 08:35:27,768][106225] Updated weights for policy 1, policy_version 1858475 (0.0005) [2023-12-28 08:35:27,825][106225] Updated weights for policy 1, policy_version 1858485 (0.0005) [2023-12-28 08:35:27,883][106225] Updated weights for policy 1, policy_version 1858495 (0.0006) [2023-12-28 08:35:28,074][106226] Updated weights for policy 0, policy_version 1854540 (0.0011) [2023-12-28 08:35:28,138][106226] Updated weights for policy 0, policy_version 1854550 (0.0011) [2023-12-28 08:35:28,202][106226] Updated weights for policy 0, policy_version 1854560 (0.0011) [2023-12-28 08:35:28,578][106225] Updated weights for policy 1, policy_version 1858505 (0.0010) [2023-12-28 08:35:28,634][106225] Updated weights for policy 1, policy_version 1858515 (0.0010) [2023-12-28 08:35:28,695][106225] Updated weights for policy 1, policy_version 1858525 (0.0010) [2023-12-28 08:35:28,864][106226] Updated weights for policy 0, policy_version 1854570 (0.0010) [2023-12-28 08:35:28,923][106226] Updated weights for policy 0, policy_version 1854580 (0.0010) [2023-12-28 08:35:28,973][106226] Updated weights for policy 0, policy_version 1854590 (0.0010) [2023-12-28 08:35:29,035][106226] Updated weights for policy 0, policy_version 1854600 (0.0006) [2023-12-28 08:35:29,397][106225] Updated weights for policy 1, policy_version 1858535 (0.0010) [2023-12-28 08:35:29,456][106225] Updated weights for policy 1, policy_version 1858545 (0.0010) [2023-12-28 08:35:29,517][106225] Updated weights for policy 1, policy_version 1858555 (0.0010) [2023-12-28 08:35:29,691][106226] Updated weights for policy 0, policy_version 1854610 (0.0007) [2023-12-28 08:35:29,753][106226] Updated weights for policy 0, policy_version 1854620 (0.0007) [2023-12-28 08:35:29,818][106226] Updated weights for policy 0, policy_version 1854630 (0.0007) [2023-12-28 08:35:30,263][106225] Updated weights for policy 1, policy_version 1858565 (0.0010) [2023-12-28 08:35:30,331][106225] Updated weights for policy 1, policy_version 1858575 (0.0010) [2023-12-28 08:35:30,385][106225] Updated weights for policy 1, policy_version 1858585 (0.0010) [2023-12-28 08:35:30,440][106226] Updated weights for policy 0, policy_version 1854640 (0.0007) [2023-12-28 08:35:30,503][106226] Updated weights for policy 0, policy_version 1854650 (0.0005) [2023-12-28 08:35:30,570][106226] Updated weights for policy 0, policy_version 1854660 (0.0005) [2023-12-28 08:35:30,988][106225] Updated weights for policy 1, policy_version 1858595 (0.0009) [2023-12-28 08:35:31,068][106225] Updated weights for policy 1, policy_version 1858605 (0.0009) [2023-12-28 08:35:31,126][106225] Updated weights for policy 1, policy_version 1858615 (0.0006) [2023-12-28 08:35:31,139][106226] Updated weights for policy 0, policy_version 1854670 (0.0006) [2023-12-28 08:35:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 950730752. Throughput: 0: 10044.5, 1: 9914.5. Samples: 950726080. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:31,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.518')] [2023-12-28 08:35:31,219][106226] Updated weights for policy 0, policy_version 1854680 (0.0008) [2023-12-28 08:35:31,291][106226] Updated weights for policy 0, policy_version 1854690 (0.0007) [2023-12-28 08:35:31,816][106225] Updated weights for policy 1, policy_version 1858625 (0.0010) [2023-12-28 08:35:31,876][106225] Updated weights for policy 1, policy_version 1858635 (0.0010) [2023-12-28 08:35:31,928][106225] Updated weights for policy 1, policy_version 1858645 (0.0010) [2023-12-28 08:35:31,990][106225] Updated weights for policy 1, policy_version 1858655 (0.0010) [2023-12-28 08:35:32,008][106226] Updated weights for policy 0, policy_version 1854700 (0.0008) [2023-12-28 08:35:32,069][106226] Updated weights for policy 0, policy_version 1854710 (0.0008) [2023-12-28 08:35:32,126][106226] Updated weights for policy 0, policy_version 1854720 (0.0007) [2023-12-28 08:35:32,681][106225] Updated weights for policy 1, policy_version 1858665 (0.0010) [2023-12-28 08:35:32,738][106225] Updated weights for policy 1, policy_version 1858675 (0.0005) [2023-12-28 08:35:32,799][106225] Updated weights for policy 1, policy_version 1858685 (0.0007) [2023-12-28 08:35:32,895][106226] Updated weights for policy 0, policy_version 1854730 (0.0008) [2023-12-28 08:35:32,940][106226] Updated weights for policy 0, policy_version 1854740 (0.0007) [2023-12-28 08:35:32,990][106226] Updated weights for policy 0, policy_version 1854750 (0.0008) [2023-12-28 08:35:33,043][106226] Updated weights for policy 0, policy_version 1854760 (0.0008) [2023-12-28 08:35:33,485][106225] Updated weights for policy 1, policy_version 1858695 (0.0010) [2023-12-28 08:35:33,537][106225] Updated weights for policy 1, policy_version 1858705 (0.0010) [2023-12-28 08:35:33,592][106225] Updated weights for policy 1, policy_version 1858715 (0.0010) [2023-12-28 08:35:33,785][106226] Updated weights for policy 0, policy_version 1854770 (0.0009) [2023-12-28 08:35:33,832][106226] Updated weights for policy 0, policy_version 1854780 (0.0010) [2023-12-28 08:35:33,888][106226] Updated weights for policy 0, policy_version 1854790 (0.0010) [2023-12-28 08:35:34,215][106225] Updated weights for policy 1, policy_version 1858725 (0.0010) [2023-12-28 08:35:34,277][106225] Updated weights for policy 1, policy_version 1858735 (0.0010) [2023-12-28 08:35:34,340][106225] Updated weights for policy 1, policy_version 1858745 (0.0010) [2023-12-28 08:35:34,617][106226] Updated weights for policy 0, policy_version 1854800 (0.0010) [2023-12-28 08:35:34,683][106226] Updated weights for policy 0, policy_version 1854810 (0.0010) [2023-12-28 08:35:34,745][106226] Updated weights for policy 0, policy_version 1854820 (0.0009) [2023-12-28 08:35:35,087][106225] Updated weights for policy 1, policy_version 1858755 (0.0010) [2023-12-28 08:35:35,137][106225] Updated weights for policy 1, policy_version 1858765 (0.0010) [2023-12-28 08:35:35,188][106225] Updated weights for policy 1, policy_version 1858775 (0.0009) [2023-12-28 08:35:35,471][106226] Updated weights for policy 0, policy_version 1854830 (0.0007) [2023-12-28 08:35:35,517][106226] Updated weights for policy 0, policy_version 1854840 (0.0005) [2023-12-28 08:35:35,564][106226] Updated weights for policy 0, policy_version 1854850 (0.0010) [2023-12-28 08:35:35,840][106225] Updated weights for policy 1, policy_version 1858785 (0.0008) [2023-12-28 08:35:35,887][106225] Updated weights for policy 1, policy_version 1858795 (0.0007) [2023-12-28 08:35:35,941][106225] Updated weights for policy 1, policy_version 1858805 (0.0008) [2023-12-28 08:35:35,997][106225] Updated weights for policy 1, policy_version 1858815 (0.0007) [2023-12-28 08:35:36,174][105115] Fps is (10 sec: 20480.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 950837248. Throughput: 0: 9993.6, 1: 9971.4. Samples: 950846612. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:36,175][105115] Avg episode reward: [(0, '-4.236'), (1, '-4.533')] [2023-12-28 08:35:36,264][106226] Updated weights for policy 0, policy_version 1854860 (0.0008) [2023-12-28 08:35:36,324][106226] Updated weights for policy 0, policy_version 1854870 (0.0006) [2023-12-28 08:35:36,382][106226] Updated weights for policy 0, policy_version 1854880 (0.0007) [2023-12-28 08:35:36,794][106225] Updated weights for policy 1, policy_version 1858825 (0.0009) [2023-12-28 08:35:36,848][106225] Updated weights for policy 1, policy_version 1858835 (0.0009) [2023-12-28 08:35:36,895][106225] Updated weights for policy 1, policy_version 1858845 (0.0007) [2023-12-28 08:35:37,019][106226] Updated weights for policy 0, policy_version 1854890 (0.0011) [2023-12-28 08:35:37,082][106226] Updated weights for policy 0, policy_version 1854900 (0.0011) [2023-12-28 08:35:37,143][106226] Updated weights for policy 0, policy_version 1854910 (0.0011) [2023-12-28 08:35:37,193][106226] Updated weights for policy 0, policy_version 1854920 (0.0011) [2023-12-28 08:35:37,606][106225] Updated weights for policy 1, policy_version 1858855 (0.0010) [2023-12-28 08:35:37,665][106225] Updated weights for policy 1, policy_version 1858865 (0.0010) [2023-12-28 08:35:37,730][106225] Updated weights for policy 1, policy_version 1858875 (0.0010) [2023-12-28 08:35:37,792][106226] Updated weights for policy 0, policy_version 1854930 (0.0007) [2023-12-28 08:35:37,848][106226] Updated weights for policy 0, policy_version 1854940 (0.0007) [2023-12-28 08:35:37,903][106226] Updated weights for policy 0, policy_version 1854950 (0.0008) [2023-12-28 08:35:38,411][106225] Updated weights for policy 1, policy_version 1858885 (0.0010) [2023-12-28 08:35:38,477][106225] Updated weights for policy 1, policy_version 1858895 (0.0006) [2023-12-28 08:35:38,528][106225] Updated weights for policy 1, policy_version 1858905 (0.0010) [2023-12-28 08:35:38,588][106226] Updated weights for policy 0, policy_version 1854960 (0.0006) [2023-12-28 08:35:38,656][106226] Updated weights for policy 0, policy_version 1854970 (0.0006) [2023-12-28 08:35:38,720][106226] Updated weights for policy 0, policy_version 1854980 (0.0009) [2023-12-28 08:35:39,155][106225] Updated weights for policy 1, policy_version 1858915 (0.0009) [2023-12-28 08:35:39,220][106225] Updated weights for policy 1, policy_version 1858925 (0.0007) [2023-12-28 08:35:39,280][106225] Updated weights for policy 1, policy_version 1858935 (0.0008) [2023-12-28 08:35:39,413][106226] Updated weights for policy 0, policy_version 1854990 (0.0009) [2023-12-28 08:35:39,483][106226] Updated weights for policy 0, policy_version 1855000 (0.0007) [2023-12-28 08:35:39,549][106226] Updated weights for policy 0, policy_version 1855010 (0.0009) [2023-12-28 08:35:39,993][106225] Updated weights for policy 1, policy_version 1858945 (0.0007) [2023-12-28 08:35:40,059][106225] Updated weights for policy 1, policy_version 1858955 (0.0008) [2023-12-28 08:35:40,122][106225] Updated weights for policy 1, policy_version 1858965 (0.0008) [2023-12-28 08:35:40,186][106225] Updated weights for policy 1, policy_version 1858975 (0.0007) [2023-12-28 08:35:40,221][106226] Updated weights for policy 0, policy_version 1855020 (0.0008) [2023-12-28 08:35:40,290][106226] Updated weights for policy 0, policy_version 1855030 (0.0008) [2023-12-28 08:35:40,356][106226] Updated weights for policy 0, policy_version 1855040 (0.0008) [2023-12-28 08:35:40,940][106226] Updated weights for policy 0, policy_version 1855050 (0.0008) [2023-12-28 08:35:40,941][106225] Updated weights for policy 1, policy_version 1858985 (0.0008) [2023-12-28 08:35:40,995][106226] Updated weights for policy 0, policy_version 1855060 (0.0008) [2023-12-28 08:35:40,997][106225] Updated weights for policy 1, policy_version 1858995 (0.0006) [2023-12-28 08:35:41,058][106226] Updated weights for policy 0, policy_version 1855070 (0.0008) [2023-12-28 08:35:41,062][106225] Updated weights for policy 1, policy_version 1859005 (0.0008) [2023-12-28 08:35:41,129][106226] Updated weights for policy 0, policy_version 1855080 (0.0006) [2023-12-28 08:35:41,175][105115] Fps is (10 sec: 21298.9, 60 sec: 20070.3, 300 sec: 19855.2). Total num frames: 950943744. Throughput: 0: 10040.2, 1: 9945.9. Samples: 950907256. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:41,176][105115] Avg episode reward: [(0, '-4.239'), (1, '-4.878')] [2023-12-28 08:35:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001859008_475963392.pth... [2023-12-28 08:35:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001855080_474980352.pth... [2023-12-28 08:35:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001853896_474677248.pth [2023-12-28 08:35:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001857856_475668480.pth [2023-12-28 08:35:41,885][106225] Updated weights for policy 1, policy_version 1859015 (0.0007) [2023-12-28 08:35:41,912][106226] Updated weights for policy 0, policy_version 1855090 (0.0007) [2023-12-28 08:35:41,942][106225] Updated weights for policy 1, policy_version 1859025 (0.0007) [2023-12-28 08:35:41,966][106226] Updated weights for policy 0, policy_version 1855100 (0.0007) [2023-12-28 08:35:42,000][106225] Updated weights for policy 1, policy_version 1859035 (0.0007) [2023-12-28 08:35:42,026][106226] Updated weights for policy 0, policy_version 1855110 (0.0008) [2023-12-28 08:35:42,732][106226] Updated weights for policy 0, policy_version 1855120 (0.0008) [2023-12-28 08:35:42,733][106225] Updated weights for policy 1, policy_version 1859045 (0.0008) [2023-12-28 08:35:42,792][106225] Updated weights for policy 1, policy_version 1859055 (0.0009) [2023-12-28 08:35:42,794][106226] Updated weights for policy 0, policy_version 1855130 (0.0010) [2023-12-28 08:35:42,848][106226] Updated weights for policy 0, policy_version 1855140 (0.0007) [2023-12-28 08:35:42,857][106225] Updated weights for policy 1, policy_version 1859065 (0.0008) [2023-12-28 08:35:43,564][106226] Updated weights for policy 0, policy_version 1855150 (0.0006) [2023-12-28 08:35:43,629][106226] Updated weights for policy 0, policy_version 1855160 (0.0006) [2023-12-28 08:35:43,633][106225] Updated weights for policy 1, policy_version 1859075 (0.0007) [2023-12-28 08:35:43,691][106226] Updated weights for policy 0, policy_version 1855170 (0.0005) [2023-12-28 08:35:43,696][106225] Updated weights for policy 1, policy_version 1859085 (0.0008) [2023-12-28 08:35:43,745][106225] Updated weights for policy 1, policy_version 1859095 (0.0008) [2023-12-28 08:35:44,268][106226] Updated weights for policy 0, policy_version 1855180 (0.0006) [2023-12-28 08:35:44,337][106226] Updated weights for policy 0, policy_version 1855190 (0.0006) [2023-12-28 08:35:44,396][106226] Updated weights for policy 0, policy_version 1855200 (0.0009) [2023-12-28 08:35:44,475][106225] Updated weights for policy 1, policy_version 1859105 (0.0009) [2023-12-28 08:35:44,536][106225] Updated weights for policy 1, policy_version 1859115 (0.0007) [2023-12-28 08:35:44,594][106225] Updated weights for policy 1, policy_version 1859125 (0.0008) [2023-12-28 08:35:44,654][106225] Updated weights for policy 1, policy_version 1859135 (0.0006) [2023-12-28 08:35:45,082][106226] Updated weights for policy 0, policy_version 1855210 (0.0008) [2023-12-28 08:35:45,140][106226] Updated weights for policy 0, policy_version 1855220 (0.0007) [2023-12-28 08:35:45,208][106226] Updated weights for policy 0, policy_version 1855230 (0.0009) [2023-12-28 08:35:45,278][106226] Updated weights for policy 0, policy_version 1855240 (0.0009) [2023-12-28 08:35:45,378][106225] Updated weights for policy 1, policy_version 1859145 (0.0008) [2023-12-28 08:35:45,440][106225] Updated weights for policy 1, policy_version 1859155 (0.0009) [2023-12-28 08:35:45,500][106225] Updated weights for policy 1, policy_version 1859165 (0.0008) [2023-12-28 08:35:45,986][106226] Updated weights for policy 0, policy_version 1855250 (0.0009) [2023-12-28 08:35:46,041][106226] Updated weights for policy 0, policy_version 1855260 (0.0008) [2023-12-28 08:35:46,094][106226] Updated weights for policy 0, policy_version 1855270 (0.0008) [2023-12-28 08:35:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 951033856. Throughput: 0: 10048.1, 1: 9891.8. Samples: 951023252. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:46,175][105115] Avg episode reward: [(0, '-4.059'), (1, '-4.949')] [2023-12-28 08:35:46,257][106225] Updated weights for policy 1, policy_version 1859175 (0.0009) [2023-12-28 08:35:46,307][106225] Updated weights for policy 1, policy_version 1859185 (0.0007) [2023-12-28 08:35:46,363][106225] Updated weights for policy 1, policy_version 1859195 (0.0009) [2023-12-28 08:35:46,788][106226] Updated weights for policy 0, policy_version 1855280 (0.0008) [2023-12-28 08:35:46,851][106226] Updated weights for policy 0, policy_version 1855290 (0.0010) [2023-12-28 08:35:46,911][106226] Updated weights for policy 0, policy_version 1855300 (0.0009) [2023-12-28 08:35:47,122][106225] Updated weights for policy 1, policy_version 1859205 (0.0008) [2023-12-28 08:35:47,171][106225] Updated weights for policy 1, policy_version 1859215 (0.0008) [2023-12-28 08:35:47,239][106225] Updated weights for policy 1, policy_version 1859225 (0.0009) [2023-12-28 08:35:47,504][106226] Updated weights for policy 0, policy_version 1855310 (0.0008) [2023-12-28 08:35:47,563][106226] Updated weights for policy 0, policy_version 1855320 (0.0009) [2023-12-28 08:35:47,613][106226] Updated weights for policy 0, policy_version 1855330 (0.0008) [2023-12-28 08:35:47,929][106225] Updated weights for policy 1, policy_version 1859235 (0.0008) [2023-12-28 08:35:47,973][106225] Updated weights for policy 1, policy_version 1859245 (0.0007) [2023-12-28 08:35:48,037][106225] Updated weights for policy 1, policy_version 1859255 (0.0009) [2023-12-28 08:35:48,226][106226] Updated weights for policy 0, policy_version 1855340 (0.0007) [2023-12-28 08:35:48,286][106226] Updated weights for policy 0, policy_version 1855350 (0.0006) [2023-12-28 08:35:48,346][106226] Updated weights for policy 0, policy_version 1855360 (0.0008) [2023-12-28 08:35:48,892][106225] Updated weights for policy 1, policy_version 1859265 (0.0009) [2023-12-28 08:35:48,957][106225] Updated weights for policy 1, policy_version 1859275 (0.0009) [2023-12-28 08:35:49,028][106225] Updated weights for policy 1, policy_version 1859285 (0.0008) [2023-12-28 08:35:49,051][106226] Updated weights for policy 0, policy_version 1855370 (0.0009) [2023-12-28 08:35:49,094][106225] Updated weights for policy 1, policy_version 1859295 (0.0006) [2023-12-28 08:35:49,116][106226] Updated weights for policy 0, policy_version 1855380 (0.0006) [2023-12-28 08:35:49,180][106226] Updated weights for policy 0, policy_version 1855390 (0.0009) [2023-12-28 08:35:49,248][106226] Updated weights for policy 0, policy_version 1855400 (0.0008) [2023-12-28 08:35:49,755][106225] Updated weights for policy 1, policy_version 1859305 (0.0008) [2023-12-28 08:35:49,807][106225] Updated weights for policy 1, policy_version 1859315 (0.0008) [2023-12-28 08:35:49,889][106225] Updated weights for policy 1, policy_version 1859325 (0.0008) [2023-12-28 08:35:49,939][106226] Updated weights for policy 0, policy_version 1855410 (0.0011) [2023-12-28 08:35:49,992][106226] Updated weights for policy 0, policy_version 1855420 (0.0008) [2023-12-28 08:35:50,043][106226] Updated weights for policy 0, policy_version 1855430 (0.0008) [2023-12-28 08:35:50,716][106225] Updated weights for policy 1, policy_version 1859335 (0.0007) [2023-12-28 08:35:50,780][106226] Updated weights for policy 0, policy_version 1855440 (0.0006) [2023-12-28 08:35:50,785][106225] Updated weights for policy 1, policy_version 1859345 (0.0008) [2023-12-28 08:35:50,840][106226] Updated weights for policy 0, policy_version 1855450 (0.0007) [2023-12-28 08:35:50,854][106225] Updated weights for policy 1, policy_version 1859355 (0.0006) [2023-12-28 08:35:50,901][106226] Updated weights for policy 0, policy_version 1855460 (0.0006) [2023-12-28 08:35:51,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 951132160. Throughput: 0: 10057.0, 1: 9787.3. Samples: 951140212. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:51,175][105115] Avg episode reward: [(0, '-4.477'), (1, '-4.540')] [2023-12-28 08:35:51,597][106226] Updated weights for policy 0, policy_version 1855470 (0.0006) [2023-12-28 08:35:51,608][106225] Updated weights for policy 1, policy_version 1859365 (0.0007) [2023-12-28 08:35:51,659][106226] Updated weights for policy 0, policy_version 1855480 (0.0008) [2023-12-28 08:35:51,674][106225] Updated weights for policy 1, policy_version 1859375 (0.0008) [2023-12-28 08:35:51,715][106226] Updated weights for policy 0, policy_version 1855490 (0.0007) [2023-12-28 08:35:51,737][106225] Updated weights for policy 1, policy_version 1859385 (0.0008) [2023-12-28 08:35:52,431][106225] Updated weights for policy 1, policy_version 1859395 (0.0007) [2023-12-28 08:35:52,484][106226] Updated weights for policy 0, policy_version 1855502 (0.0007) [2023-12-28 08:35:52,492][106225] Updated weights for policy 1, policy_version 1859405 (0.0008) [2023-12-28 08:35:52,548][106226] Updated weights for policy 0, policy_version 1855512 (0.0006) [2023-12-28 08:35:52,554][106225] Updated weights for policy 1, policy_version 1859415 (0.0007) [2023-12-28 08:35:52,610][106226] Updated weights for policy 0, policy_version 1855522 (0.0007) [2023-12-28 08:35:53,243][106226] Updated weights for policy 0, policy_version 1855532 (0.0008) [2023-12-28 08:35:53,299][106226] Updated weights for policy 0, policy_version 1855542 (0.0008) [2023-12-28 08:35:53,299][106225] Updated weights for policy 1, policy_version 1859425 (0.0007) [2023-12-28 08:35:53,357][106225] Updated weights for policy 1, policy_version 1859435 (0.0010) [2023-12-28 08:35:53,359][106226] Updated weights for policy 0, policy_version 1855552 (0.0006) [2023-12-28 08:35:53,415][106225] Updated weights for policy 1, policy_version 1859445 (0.0011) [2023-12-28 08:35:53,482][106225] Updated weights for policy 1, policy_version 1859455 (0.0010) [2023-12-28 08:35:54,068][106225] Updated weights for policy 1, policy_version 1859465 (0.0007) [2023-12-28 08:35:54,108][106226] Updated weights for policy 0, policy_version 1855562 (0.0006) [2023-12-28 08:35:54,128][106225] Updated weights for policy 1, policy_version 1859475 (0.0006) [2023-12-28 08:35:54,158][106226] Updated weights for policy 0, policy_version 1855572 (0.0007) [2023-12-28 08:35:54,189][106225] Updated weights for policy 1, policy_version 1859485 (0.0006) [2023-12-28 08:35:54,223][106226] Updated weights for policy 0, policy_version 1855582 (0.0008) [2023-12-28 08:35:54,277][106226] Updated weights for policy 0, policy_version 1855592 (0.0008) [2023-12-28 08:35:54,812][106225] Updated weights for policy 1, policy_version 1859495 (0.0008) [2023-12-28 08:35:54,867][106225] Updated weights for policy 1, policy_version 1859505 (0.0009) [2023-12-28 08:35:54,922][106225] Updated weights for policy 1, policy_version 1859515 (0.0009) [2023-12-28 08:35:54,989][106226] Updated weights for policy 0, policy_version 1855602 (0.0005) [2023-12-28 08:35:55,051][106226] Updated weights for policy 0, policy_version 1855612 (0.0005) [2023-12-28 08:35:55,109][106226] Updated weights for policy 0, policy_version 1855622 (0.0005) [2023-12-28 08:35:55,637][106225] Updated weights for policy 1, policy_version 1859525 (0.0006) [2023-12-28 08:35:55,645][106226] Updated weights for policy 0, policy_version 1855632 (0.0005) [2023-12-28 08:35:55,699][106226] Updated weights for policy 0, policy_version 1855642 (0.0007) [2023-12-28 08:35:55,700][106225] Updated weights for policy 1, policy_version 1859535 (0.0006) [2023-12-28 08:35:55,749][106226] Updated weights for policy 0, policy_version 1855652 (0.0007) [2023-12-28 08:35:55,763][106225] Updated weights for policy 1, policy_version 1859545 (0.0005) [2023-12-28 08:35:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 951230464. Throughput: 0: 10024.8, 1: 9714.9. Samples: 951197640. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:35:56,175][105115] Avg episode reward: [(0, '-4.197'), (1, '-4.613')] [2023-12-28 08:35:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001859552_476102656.pth... [2023-12-28 08:35:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001855656_475127808.pth... [2023-12-28 08:35:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001858432_475815936.pth [2023-12-28 08:35:56,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001854472_474824704.pth [2023-12-28 08:35:56,284][106225] Updated weights for policy 1, policy_version 1859555 (0.0005) [2023-12-28 08:35:56,338][106225] Updated weights for policy 1, policy_version 1859565 (0.0008) [2023-12-28 08:35:56,391][106225] Updated weights for policy 1, policy_version 1859575 (0.0008) [2023-12-28 08:35:56,507][106226] Updated weights for policy 0, policy_version 1855662 (0.0008) [2023-12-28 08:35:56,551][106226] Updated weights for policy 0, policy_version 1855672 (0.0008) [2023-12-28 08:35:56,616][106226] Updated weights for policy 0, policy_version 1855682 (0.0007) [2023-12-28 08:35:57,038][106225] Updated weights for policy 1, policy_version 1859585 (0.0008) [2023-12-28 08:35:57,093][106225] Updated weights for policy 1, policy_version 1859595 (0.0006) [2023-12-28 08:35:57,149][106225] Updated weights for policy 1, policy_version 1859605 (0.0007) [2023-12-28 08:35:57,203][106225] Updated weights for policy 1, policy_version 1859615 (0.0008) [2023-12-28 08:35:57,350][106226] Updated weights for policy 0, policy_version 1855692 (0.0007) [2023-12-28 08:35:57,410][106226] Updated weights for policy 0, policy_version 1855702 (0.0010) [2023-12-28 08:35:57,466][106226] Updated weights for policy 0, policy_version 1855712 (0.0010) [2023-12-28 08:35:57,867][106225] Updated weights for policy 1, policy_version 1859625 (0.0007) [2023-12-28 08:35:57,922][106225] Updated weights for policy 1, policy_version 1859635 (0.0006) [2023-12-28 08:35:57,989][106225] Updated weights for policy 1, policy_version 1859645 (0.0005) [2023-12-28 08:35:58,146][106226] Updated weights for policy 0, policy_version 1855722 (0.0011) [2023-12-28 08:35:58,198][106226] Updated weights for policy 0, policy_version 1855732 (0.0010) [2023-12-28 08:35:58,265][106226] Updated weights for policy 0, policy_version 1855742 (0.0009) [2023-12-28 08:35:58,342][106226] Updated weights for policy 0, policy_version 1855752 (0.0025) [2023-12-28 08:35:58,699][106225] Updated weights for policy 1, policy_version 1859655 (0.0006) [2023-12-28 08:35:58,767][106225] Updated weights for policy 1, policy_version 1859665 (0.0007) [2023-12-28 08:35:58,830][106225] Updated weights for policy 1, policy_version 1859675 (0.0007) [2023-12-28 08:35:59,133][106226] Updated weights for policy 0, policy_version 1855762 (0.0009) [2023-12-28 08:35:59,191][106226] Updated weights for policy 0, policy_version 1855772 (0.0009) [2023-12-28 08:35:59,267][106226] Updated weights for policy 0, policy_version 1855782 (0.0009) [2023-12-28 08:35:59,719][106225] Updated weights for policy 1, policy_version 1859685 (0.0008) [2023-12-28 08:35:59,785][106225] Updated weights for policy 1, policy_version 1859695 (0.0009) [2023-12-28 08:35:59,846][106225] Updated weights for policy 1, policy_version 1859705 (0.0008) [2023-12-28 08:35:59,993][106226] Updated weights for policy 0, policy_version 1855792 (0.0006) [2023-12-28 08:36:00,053][106226] Updated weights for policy 0, policy_version 1855802 (0.0008) [2023-12-28 08:36:00,115][106226] Updated weights for policy 0, policy_version 1855812 (0.0009) [2023-12-28 08:36:00,513][106225] Updated weights for policy 1, policy_version 1859715 (0.0007) [2023-12-28 08:36:00,571][106225] Updated weights for policy 1, policy_version 1859725 (0.0005) [2023-12-28 08:36:00,634][106225] Updated weights for policy 1, policy_version 1859735 (0.0005) [2023-12-28 08:36:00,872][106226] Updated weights for policy 0, policy_version 1855822 (0.0008) [2023-12-28 08:36:00,935][106226] Updated weights for policy 0, policy_version 1855832 (0.0008) [2023-12-28 08:36:00,982][106226] Updated weights for policy 0, policy_version 1855842 (0.0006) [2023-12-28 08:36:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 951328768. Throughput: 0: 10017.2, 1: 9809.6. Samples: 951317736. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:01,175][105115] Avg episode reward: [(0, '-4.494'), (1, '-4.810')] [2023-12-28 08:36:01,315][106225] Updated weights for policy 1, policy_version 1859745 (0.0006) [2023-12-28 08:36:01,387][106225] Updated weights for policy 1, policy_version 1859755 (0.0008) [2023-12-28 08:36:01,446][106225] Updated weights for policy 1, policy_version 1859765 (0.0008) [2023-12-28 08:36:01,500][106225] Updated weights for policy 1, policy_version 1859775 (0.0008) [2023-12-28 08:36:01,674][106226] Updated weights for policy 0, policy_version 1855852 (0.0008) [2023-12-28 08:36:01,738][106226] Updated weights for policy 0, policy_version 1855862 (0.0010) [2023-12-28 08:36:01,802][106226] Updated weights for policy 0, policy_version 1855872 (0.0010) [2023-12-28 08:36:02,208][106225] Updated weights for policy 1, policy_version 1859785 (0.0008) [2023-12-28 08:36:02,269][106225] Updated weights for policy 1, policy_version 1859795 (0.0007) [2023-12-28 08:36:02,328][106225] Updated weights for policy 1, policy_version 1859805 (0.0007) [2023-12-28 08:36:02,484][106226] Updated weights for policy 0, policy_version 1855882 (0.0011) [2023-12-28 08:36:02,552][106226] Updated weights for policy 0, policy_version 1855892 (0.0007) [2023-12-28 08:36:02,618][106226] Updated weights for policy 0, policy_version 1855902 (0.0005) [2023-12-28 08:36:02,675][106226] Updated weights for policy 0, policy_version 1855912 (0.0005) [2023-12-28 08:36:03,062][106225] Updated weights for policy 1, policy_version 1859815 (0.0007) [2023-12-28 08:36:03,118][106225] Updated weights for policy 1, policy_version 1859825 (0.0005) [2023-12-28 08:36:03,173][106225] Updated weights for policy 1, policy_version 1859835 (0.0005) [2023-12-28 08:36:03,298][106226] Updated weights for policy 0, policy_version 1855922 (0.0006) [2023-12-28 08:36:03,351][106226] Updated weights for policy 0, policy_version 1855932 (0.0006) [2023-12-28 08:36:03,398][106226] Updated weights for policy 0, policy_version 1855942 (0.0005) [2023-12-28 08:36:03,831][106225] Updated weights for policy 1, policy_version 1859845 (0.0008) [2023-12-28 08:36:03,899][106225] Updated weights for policy 1, policy_version 1859855 (0.0010) [2023-12-28 08:36:03,961][106225] Updated weights for policy 1, policy_version 1859865 (0.0010) [2023-12-28 08:36:04,089][106226] Updated weights for policy 0, policy_version 1855952 (0.0008) [2023-12-28 08:36:04,149][106226] Updated weights for policy 0, policy_version 1855962 (0.0008) [2023-12-28 08:36:04,214][106226] Updated weights for policy 0, policy_version 1855972 (0.0008) [2023-12-28 08:36:04,670][106225] Updated weights for policy 1, policy_version 1859875 (0.0010) [2023-12-28 08:36:04,718][106225] Updated weights for policy 1, policy_version 1859885 (0.0008) [2023-12-28 08:36:04,763][106225] Updated weights for policy 1, policy_version 1859895 (0.0007) [2023-12-28 08:36:04,925][106226] Updated weights for policy 0, policy_version 1855982 (0.0006) [2023-12-28 08:36:04,985][106226] Updated weights for policy 0, policy_version 1855992 (0.0005) [2023-12-28 08:36:05,041][106226] Updated weights for policy 0, policy_version 1856002 (0.0005) [2023-12-28 08:36:05,473][106225] Updated weights for policy 1, policy_version 1859905 (0.0005) [2023-12-28 08:36:05,539][106225] Updated weights for policy 1, policy_version 1859915 (0.0007) [2023-12-28 08:36:05,595][106225] Updated weights for policy 1, policy_version 1859925 (0.0008) [2023-12-28 08:36:05,654][106225] Updated weights for policy 1, policy_version 1859935 (0.0008) [2023-12-28 08:36:05,655][106226] Updated weights for policy 0, policy_version 1856012 (0.0005) [2023-12-28 08:36:05,716][106226] Updated weights for policy 0, policy_version 1856022 (0.0005) [2023-12-28 08:36:05,783][106226] Updated weights for policy 0, policy_version 1856032 (0.0005) [2023-12-28 08:36:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 951427072. Throughput: 0: 10048.0, 1: 9812.6. Samples: 951438220. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:06,176][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.673')] [2023-12-28 08:36:06,396][106226] Updated weights for policy 0, policy_version 1856042 (0.0006) [2023-12-28 08:36:06,421][106225] Updated weights for policy 1, policy_version 1859945 (0.0008) [2023-12-28 08:36:06,461][106226] Updated weights for policy 0, policy_version 1856052 (0.0007) [2023-12-28 08:36:06,485][106225] Updated weights for policy 1, policy_version 1859955 (0.0007) [2023-12-28 08:36:06,526][106226] Updated weights for policy 0, policy_version 1856062 (0.0009) [2023-12-28 08:36:06,548][106225] Updated weights for policy 1, policy_version 1859965 (0.0007) [2023-12-28 08:36:06,583][106226] Updated weights for policy 0, policy_version 1856072 (0.0007) [2023-12-28 08:36:07,232][106225] Updated weights for policy 1, policy_version 1859975 (0.0008) [2023-12-28 08:36:07,290][106225] Updated weights for policy 1, policy_version 1859985 (0.0008) [2023-12-28 08:36:07,317][106226] Updated weights for policy 0, policy_version 1856082 (0.0007) [2023-12-28 08:36:07,351][106225] Updated weights for policy 1, policy_version 1859995 (0.0007) [2023-12-28 08:36:07,374][106226] Updated weights for policy 0, policy_version 1856092 (0.0008) [2023-12-28 08:36:07,429][106226] Updated weights for policy 0, policy_version 1856102 (0.0005) [2023-12-28 08:36:08,049][106225] Updated weights for policy 1, policy_version 1860005 (0.0008) [2023-12-28 08:36:08,102][106226] Updated weights for policy 0, policy_version 1856112 (0.0010) [2023-12-28 08:36:08,108][106225] Updated weights for policy 1, policy_version 1860015 (0.0006) [2023-12-28 08:36:08,151][106226] Updated weights for policy 0, policy_version 1856122 (0.0010) [2023-12-28 08:36:08,164][106225] Updated weights for policy 1, policy_version 1860025 (0.0005) [2023-12-28 08:36:08,211][106226] Updated weights for policy 0, policy_version 1856132 (0.0010) [2023-12-28 08:36:08,856][106225] Updated weights for policy 1, policy_version 1860035 (0.0007) [2023-12-28 08:36:08,909][106226] Updated weights for policy 0, policy_version 1856142 (0.0011) [2023-12-28 08:36:08,912][106225] Updated weights for policy 1, policy_version 1860045 (0.0007) [2023-12-28 08:36:08,968][106225] Updated weights for policy 1, policy_version 1860055 (0.0007) [2023-12-28 08:36:08,969][106226] Updated weights for policy 0, policy_version 1856152 (0.0010) [2023-12-28 08:36:09,036][106226] Updated weights for policy 0, policy_version 1856162 (0.0011) [2023-12-28 08:36:09,714][106225] Updated weights for policy 1, policy_version 1860065 (0.0006) [2023-12-28 08:36:09,776][106225] Updated weights for policy 1, policy_version 1860075 (0.0009) [2023-12-28 08:36:09,805][106226] Updated weights for policy 0, policy_version 1856172 (0.0009) [2023-12-28 08:36:09,842][106225] Updated weights for policy 1, policy_version 1860085 (0.0007) [2023-12-28 08:36:09,879][106226] Updated weights for policy 0, policy_version 1856182 (0.0008) [2023-12-28 08:36:09,908][106225] Updated weights for policy 1, policy_version 1860095 (0.0008) [2023-12-28 08:36:09,943][106226] Updated weights for policy 0, policy_version 1856192 (0.0007) [2023-12-28 08:36:10,619][106226] Updated weights for policy 0, policy_version 1856202 (0.0009) [2023-12-28 08:36:10,664][106225] Updated weights for policy 1, policy_version 1860105 (0.0005) [2023-12-28 08:36:10,666][106226] Updated weights for policy 0, policy_version 1856212 (0.0007) [2023-12-28 08:36:10,715][106226] Updated weights for policy 0, policy_version 1856222 (0.0007) [2023-12-28 08:36:10,716][106225] Updated weights for policy 1, policy_version 1860115 (0.0006) [2023-12-28 08:36:10,765][106226] Updated weights for policy 0, policy_version 1856232 (0.0007) [2023-12-28 08:36:10,771][106225] Updated weights for policy 1, policy_version 1860125 (0.0007) [2023-12-28 08:36:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 951525376. Throughput: 0: 10051.2, 1: 9860.1. Samples: 951497308. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:11,175][105115] Avg episode reward: [(0, '-4.416'), (1, '-4.884')] [2023-12-28 08:36:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001860128_476250112.pth... [2023-12-28 08:36:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001856232_475275264.pth... [2023-12-28 08:36:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001859008_475963392.pth [2023-12-28 08:36:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001855080_474980352.pth [2023-12-28 08:36:11,507][106225] Updated weights for policy 1, policy_version 1860135 (0.0008) [2023-12-28 08:36:11,562][106226] Updated weights for policy 0, policy_version 1856242 (0.0011) [2023-12-28 08:36:11,564][106225] Updated weights for policy 1, policy_version 1860145 (0.0007) [2023-12-28 08:36:11,625][106225] Updated weights for policy 1, policy_version 1860155 (0.0006) [2023-12-28 08:36:11,628][106226] Updated weights for policy 0, policy_version 1856252 (0.0011) [2023-12-28 08:36:11,691][106226] Updated weights for policy 0, policy_version 1856262 (0.0010) [2023-12-28 08:36:12,428][106226] Updated weights for policy 0, policy_version 1856272 (0.0008) [2023-12-28 08:36:12,457][106225] Updated weights for policy 1, policy_version 1860165 (0.0010) [2023-12-28 08:36:12,487][106226] Updated weights for policy 0, policy_version 1856282 (0.0008) [2023-12-28 08:36:12,517][106225] Updated weights for policy 1, policy_version 1860175 (0.0007) [2023-12-28 08:36:12,552][106226] Updated weights for policy 0, policy_version 1856292 (0.0008) [2023-12-28 08:36:12,571][106225] Updated weights for policy 1, policy_version 1860185 (0.0006) [2023-12-28 08:36:13,251][106226] Updated weights for policy 0, policy_version 1856302 (0.0006) [2023-12-28 08:36:13,298][106226] Updated weights for policy 0, policy_version 1856312 (0.0005) [2023-12-28 08:36:13,348][106226] Updated weights for policy 0, policy_version 1856322 (0.0005) [2023-12-28 08:36:13,356][106225] Updated weights for policy 1, policy_version 1860195 (0.0008) [2023-12-28 08:36:13,419][106225] Updated weights for policy 1, policy_version 1860205 (0.0008) [2023-12-28 08:36:13,490][106225] Updated weights for policy 1, policy_version 1860215 (0.0009) [2023-12-28 08:36:13,981][106226] Updated weights for policy 0, policy_version 1856332 (0.0008) [2023-12-28 08:36:14,039][106226] Updated weights for policy 0, policy_version 1856342 (0.0011) [2023-12-28 08:36:14,098][106226] Updated weights for policy 0, policy_version 1856352 (0.0010) [2023-12-28 08:36:14,167][106225] Updated weights for policy 1, policy_version 1860225 (0.0008) [2023-12-28 08:36:14,222][106225] Updated weights for policy 1, policy_version 1860235 (0.0009) [2023-12-28 08:36:14,283][106225] Updated weights for policy 1, policy_version 1860245 (0.0008) [2023-12-28 08:36:14,333][106225] Updated weights for policy 1, policy_version 1860255 (0.0007) [2023-12-28 08:36:14,776][106226] Updated weights for policy 0, policy_version 1856362 (0.0006) [2023-12-28 08:36:14,844][106226] Updated weights for policy 0, policy_version 1856372 (0.0008) [2023-12-28 08:36:14,911][106226] Updated weights for policy 0, policy_version 1856382 (0.0008) [2023-12-28 08:36:14,975][106226] Updated weights for policy 0, policy_version 1856392 (0.0008) [2023-12-28 08:36:15,140][106225] Updated weights for policy 1, policy_version 1860265 (0.0007) [2023-12-28 08:36:15,205][106225] Updated weights for policy 1, policy_version 1860275 (0.0007) [2023-12-28 08:36:15,265][106225] Updated weights for policy 1, policy_version 1860285 (0.0008) [2023-12-28 08:36:15,694][106226] Updated weights for policy 0, policy_version 1856402 (0.0006) [2023-12-28 08:36:15,745][106226] Updated weights for policy 0, policy_version 1856412 (0.0005) [2023-12-28 08:36:15,796][106226] Updated weights for policy 0, policy_version 1856422 (0.0005) [2023-12-28 08:36:16,076][106225] Updated weights for policy 1, policy_version 1860295 (0.0007) [2023-12-28 08:36:16,140][106225] Updated weights for policy 1, policy_version 1860305 (0.0005) [2023-12-28 08:36:16,174][105115] Fps is (10 sec: 18842.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 951615488. Throughput: 0: 9972.1, 1: 9690.3. Samples: 951610888. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:16,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.653')] [2023-12-28 08:36:16,198][106225] Updated weights for policy 1, policy_version 1860315 (0.0005) [2023-12-28 08:36:16,470][106226] Updated weights for policy 0, policy_version 1856432 (0.0005) [2023-12-28 08:36:16,523][106226] Updated weights for policy 0, policy_version 1856442 (0.0007) [2023-12-28 08:36:16,582][106226] Updated weights for policy 0, policy_version 1856452 (0.0008) [2023-12-28 08:36:16,836][106225] Updated weights for policy 1, policy_version 1860325 (0.0007) [2023-12-28 08:36:16,889][106225] Updated weights for policy 1, policy_version 1860335 (0.0009) [2023-12-28 08:36:16,944][106225] Updated weights for policy 1, policy_version 1860345 (0.0008) [2023-12-28 08:36:17,257][106226] Updated weights for policy 0, policy_version 1856462 (0.0009) [2023-12-28 08:36:17,316][106226] Updated weights for policy 0, policy_version 1856472 (0.0009) [2023-12-28 08:36:17,370][106226] Updated weights for policy 0, policy_version 1856482 (0.0008) [2023-12-28 08:36:17,726][106225] Updated weights for policy 1, policy_version 1860355 (0.0008) [2023-12-28 08:36:17,787][106225] Updated weights for policy 1, policy_version 1860365 (0.0008) [2023-12-28 08:36:17,847][106225] Updated weights for policy 1, policy_version 1860375 (0.0008) [2023-12-28 08:36:18,044][106226] Updated weights for policy 0, policy_version 1856492 (0.0007) [2023-12-28 08:36:18,107][106226] Updated weights for policy 0, policy_version 1856502 (0.0008) [2023-12-28 08:36:18,172][106226] Updated weights for policy 0, policy_version 1856512 (0.0008) [2023-12-28 08:36:18,607][106225] Updated weights for policy 1, policy_version 1860385 (0.0008) [2023-12-28 08:36:18,664][106225] Updated weights for policy 1, policy_version 1860395 (0.0009) [2023-12-28 08:36:18,715][106225] Updated weights for policy 1, policy_version 1860405 (0.0008) [2023-12-28 08:36:18,765][106225] Updated weights for policy 1, policy_version 1860415 (0.0009) [2023-12-28 08:36:18,826][106226] Updated weights for policy 0, policy_version 1856522 (0.0009) [2023-12-28 08:36:18,890][106226] Updated weights for policy 0, policy_version 1856532 (0.0009) [2023-12-28 08:36:18,950][106226] Updated weights for policy 0, policy_version 1856542 (0.0009) [2023-12-28 08:36:19,012][106226] Updated weights for policy 0, policy_version 1856552 (0.0007) [2023-12-28 08:36:19,586][106225] Updated weights for policy 1, policy_version 1860425 (0.0008) [2023-12-28 08:36:19,638][106225] Updated weights for policy 1, policy_version 1860435 (0.0009) [2023-12-28 08:36:19,676][106226] Updated weights for policy 0, policy_version 1856562 (0.0009) [2023-12-28 08:36:19,688][106225] Updated weights for policy 1, policy_version 1860445 (0.0008) [2023-12-28 08:36:19,739][106226] Updated weights for policy 0, policy_version 1856572 (0.0008) [2023-12-28 08:36:19,805][106226] Updated weights for policy 0, policy_version 1856582 (0.0008) [2023-12-28 08:36:20,504][106225] Updated weights for policy 1, policy_version 1860455 (0.0007) [2023-12-28 08:36:20,529][106226] Updated weights for policy 0, policy_version 1856592 (0.0009) [2023-12-28 08:36:20,560][106225] Updated weights for policy 1, policy_version 1860465 (0.0008) [2023-12-28 08:36:20,589][106226] Updated weights for policy 0, policy_version 1856602 (0.0007) [2023-12-28 08:36:20,630][106225] Updated weights for policy 1, policy_version 1860475 (0.0009) [2023-12-28 08:36:20,646][106226] Updated weights for policy 0, policy_version 1856612 (0.0006) [2023-12-28 08:36:21,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 951713792. Throughput: 0: 10000.6, 1: 9551.4. Samples: 951726456. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:21,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.878')] [2023-12-28 08:36:21,315][106226] Updated weights for policy 0, policy_version 1856622 (0.0007) [2023-12-28 08:36:21,394][106226] Updated weights for policy 0, policy_version 1856632 (0.0008) [2023-12-28 08:36:21,458][106226] Updated weights for policy 0, policy_version 1856642 (0.0008) [2023-12-28 08:36:21,498][106225] Updated weights for policy 1, policy_version 1860485 (0.0009) [2023-12-28 08:36:21,555][106225] Updated weights for policy 1, policy_version 1860495 (0.0009) [2023-12-28 08:36:21,618][106225] Updated weights for policy 1, policy_version 1860505 (0.0009) [2023-12-28 08:36:22,252][106226] Updated weights for policy 0, policy_version 1856652 (0.0008) [2023-12-28 08:36:22,319][106226] Updated weights for policy 0, policy_version 1856662 (0.0008) [2023-12-28 08:36:22,384][106226] Updated weights for policy 0, policy_version 1856672 (0.0008) [2023-12-28 08:36:22,385][106225] Updated weights for policy 1, policy_version 1860515 (0.0008) [2023-12-28 08:36:22,454][106225] Updated weights for policy 1, policy_version 1860525 (0.0006) [2023-12-28 08:36:22,522][106225] Updated weights for policy 1, policy_version 1860535 (0.0009) [2023-12-28 08:36:23,123][106226] Updated weights for policy 0, policy_version 1856682 (0.0009) [2023-12-28 08:36:23,177][106226] Updated weights for policy 0, policy_version 1856692 (0.0010) [2023-12-28 08:36:23,228][106226] Updated weights for policy 0, policy_version 1856702 (0.0009) [2023-12-28 08:36:23,261][106225] Updated weights for policy 1, policy_version 1860545 (0.0007) [2023-12-28 08:36:23,283][106226] Updated weights for policy 0, policy_version 1856712 (0.0005) [2023-12-28 08:36:23,324][106225] Updated weights for policy 1, policy_version 1860555 (0.0010) [2023-12-28 08:36:23,382][106225] Updated weights for policy 1, policy_version 1860565 (0.0008) [2023-12-28 08:36:23,439][106225] Updated weights for policy 1, policy_version 1860575 (0.0008) [2023-12-28 08:36:23,855][106226] Updated weights for policy 0, policy_version 1856722 (0.0006) [2023-12-28 08:36:23,906][106226] Updated weights for policy 0, policy_version 1856732 (0.0005) [2023-12-28 08:36:23,956][106226] Updated weights for policy 0, policy_version 1856742 (0.0005) [2023-12-28 08:36:24,283][106225] Updated weights for policy 1, policy_version 1860585 (0.0008) [2023-12-28 08:36:24,340][106225] Updated weights for policy 1, policy_version 1860595 (0.0008) [2023-12-28 08:36:24,401][106225] Updated weights for policy 1, policy_version 1860605 (0.0008) [2023-12-28 08:36:24,582][106226] Updated weights for policy 0, policy_version 1856752 (0.0008) [2023-12-28 08:36:24,640][106226] Updated weights for policy 0, policy_version 1856762 (0.0011) [2023-12-28 08:36:24,700][106226] Updated weights for policy 0, policy_version 1856772 (0.0007) [2023-12-28 08:36:25,152][106225] Updated weights for policy 1, policy_version 1860615 (0.0008) [2023-12-28 08:36:25,208][106225] Updated weights for policy 1, policy_version 1860625 (0.0008) [2023-12-28 08:36:25,273][106225] Updated weights for policy 1, policy_version 1860635 (0.0008) [2023-12-28 08:36:25,392][106226] Updated weights for policy 0, policy_version 1856782 (0.0009) [2023-12-28 08:36:25,452][106226] Updated weights for policy 0, policy_version 1856792 (0.0010) [2023-12-28 08:36:25,510][106226] Updated weights for policy 0, policy_version 1856802 (0.0011) [2023-12-28 08:36:26,028][106225] Updated weights for policy 1, policy_version 1860645 (0.0008) [2023-12-28 08:36:26,080][106225] Updated weights for policy 1, policy_version 1860655 (0.0009) [2023-12-28 08:36:26,137][106225] Updated weights for policy 1, policy_version 1860665 (0.0009) [2023-12-28 08:36:26,173][106226] Updated weights for policy 0, policy_version 1856812 (0.0009) [2023-12-28 08:36:26,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 951812096. Throughput: 0: 9952.6, 1: 9490.8. Samples: 951782204. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:26,175][105115] Avg episode reward: [(0, '-4.318'), (1, '-4.997')] [2023-12-28 08:36:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001860672_476389376.pth... [2023-12-28 08:36:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001859552_476102656.pth [2023-12-28 08:36:26,225][106226] Updated weights for policy 0, policy_version 1856822 (0.0008) [2023-12-28 08:36:26,282][106226] Updated weights for policy 0, policy_version 1856832 (0.0008) [2023-12-28 08:36:26,322][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001856840_475430912.pth... [2023-12-28 08:36:26,325][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001855656_475127808.pth [2023-12-28 08:36:26,776][106225] Updated weights for policy 1, policy_version 1860675 (0.0008) [2023-12-28 08:36:26,835][106225] Updated weights for policy 1, policy_version 1860685 (0.0007) [2023-12-28 08:36:26,887][106225] Updated weights for policy 1, policy_version 1860695 (0.0008) [2023-12-28 08:36:27,002][106226] Updated weights for policy 0, policy_version 1856842 (0.0008) [2023-12-28 08:36:27,058][106226] Updated weights for policy 0, policy_version 1856852 (0.0005) [2023-12-28 08:36:27,108][106226] Updated weights for policy 0, policy_version 1856862 (0.0007) [2023-12-28 08:36:27,157][106226] Updated weights for policy 0, policy_version 1856872 (0.0010) [2023-12-28 08:36:27,664][106225] Updated weights for policy 1, policy_version 1860705 (0.0009) [2023-12-28 08:36:27,717][106225] Updated weights for policy 1, policy_version 1860715 (0.0009) [2023-12-28 08:36:27,776][106225] Updated weights for policy 1, policy_version 1860725 (0.0007) [2023-12-28 08:36:27,821][106226] Updated weights for policy 0, policy_version 1856882 (0.0007) [2023-12-28 08:36:27,830][106225] Updated weights for policy 1, policy_version 1860735 (0.0007) [2023-12-28 08:36:27,881][106226] Updated weights for policy 0, policy_version 1856892 (0.0008) [2023-12-28 08:36:27,937][106226] Updated weights for policy 0, policy_version 1856902 (0.0008) [2023-12-28 08:36:28,574][106225] Updated weights for policy 1, policy_version 1860745 (0.0008) [2023-12-28 08:36:28,627][106225] Updated weights for policy 1, policy_version 1860755 (0.0008) [2023-12-28 08:36:28,649][106226] Updated weights for policy 0, policy_version 1856912 (0.0007) [2023-12-28 08:36:28,687][106225] Updated weights for policy 1, policy_version 1860765 (0.0006) [2023-12-28 08:36:28,704][106226] Updated weights for policy 0, policy_version 1856922 (0.0007) [2023-12-28 08:36:28,764][106226] Updated weights for policy 0, policy_version 1856932 (0.0009) [2023-12-28 08:36:29,398][106225] Updated weights for policy 1, policy_version 1860775 (0.0007) [2023-12-28 08:36:29,457][106225] Updated weights for policy 1, policy_version 1860785 (0.0009) [2023-12-28 08:36:29,513][106226] Updated weights for policy 0, policy_version 1856942 (0.0007) [2023-12-28 08:36:29,518][106225] Updated weights for policy 1, policy_version 1860795 (0.0008) [2023-12-28 08:36:29,565][106226] Updated weights for policy 0, policy_version 1856952 (0.0006) [2023-12-28 08:36:29,620][106226] Updated weights for policy 0, policy_version 1856962 (0.0006) [2023-12-28 08:36:30,272][106225] Updated weights for policy 1, policy_version 1860805 (0.0008) [2023-12-28 08:36:30,273][106226] Updated weights for policy 0, policy_version 1856972 (0.0007) [2023-12-28 08:36:30,329][106225] Updated weights for policy 1, policy_version 1860815 (0.0006) [2023-12-28 08:36:30,338][106226] Updated weights for policy 0, policy_version 1856982 (0.0009) [2023-12-28 08:36:30,386][106225] Updated weights for policy 1, policy_version 1860825 (0.0007) [2023-12-28 08:36:30,398][106226] Updated weights for policy 0, policy_version 1856992 (0.0009) [2023-12-28 08:36:31,040][106226] Updated weights for policy 0, policy_version 1857002 (0.0008) [2023-12-28 08:36:31,073][106225] Updated weights for policy 1, policy_version 1860835 (0.0007) [2023-12-28 08:36:31,106][106226] Updated weights for policy 0, policy_version 1857012 (0.0010) [2023-12-28 08:36:31,137][106225] Updated weights for policy 1, policy_version 1860845 (0.0007) [2023-12-28 08:36:31,172][106226] Updated weights for policy 0, policy_version 1857022 (0.0008) [2023-12-28 08:36:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 951902208. Throughput: 0: 9973.7, 1: 9498.5. Samples: 951899508. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:31,175][105115] Avg episode reward: [(0, '-4.215'), (1, '-4.487')] [2023-12-28 08:36:31,198][106225] Updated weights for policy 1, policy_version 1860855 (0.0009) [2023-12-28 08:36:31,230][106226] Updated weights for policy 0, policy_version 1857032 (0.0006) [2023-12-28 08:36:31,893][106226] Updated weights for policy 0, policy_version 1857042 (0.0009) [2023-12-28 08:36:31,949][106226] Updated weights for policy 0, policy_version 1857052 (0.0008) [2023-12-28 08:36:31,985][106225] Updated weights for policy 1, policy_version 1860865 (0.0008) [2023-12-28 08:36:32,003][106226] Updated weights for policy 0, policy_version 1857062 (0.0008) [2023-12-28 08:36:32,044][106225] Updated weights for policy 1, policy_version 1860875 (0.0008) [2023-12-28 08:36:32,093][106225] Updated weights for policy 1, policy_version 1860885 (0.0008) [2023-12-28 08:36:32,147][106225] Updated weights for policy 1, policy_version 1860895 (0.0009) [2023-12-28 08:36:32,761][106226] Updated weights for policy 0, policy_version 1857072 (0.0008) [2023-12-28 08:36:32,813][106226] Updated weights for policy 0, policy_version 1857082 (0.0009) [2023-12-28 08:36:32,866][106226] Updated weights for policy 0, policy_version 1857092 (0.0008) [2023-12-28 08:36:32,947][106225] Updated weights for policy 1, policy_version 1860905 (0.0008) [2023-12-28 08:36:33,012][106225] Updated weights for policy 1, policy_version 1860915 (0.0009) [2023-12-28 08:36:33,074][106225] Updated weights for policy 1, policy_version 1860925 (0.0009) [2023-12-28 08:36:33,522][106226] Updated weights for policy 0, policy_version 1857102 (0.0007) [2023-12-28 08:36:33,579][106226] Updated weights for policy 0, policy_version 1857112 (0.0006) [2023-12-28 08:36:33,624][106226] Updated weights for policy 0, policy_version 1857122 (0.0005) [2023-12-28 08:36:33,765][106225] Updated weights for policy 1, policy_version 1860935 (0.0008) [2023-12-28 08:36:33,814][106225] Updated weights for policy 1, policy_version 1860945 (0.0008) [2023-12-28 08:36:33,862][106225] Updated weights for policy 1, policy_version 1860955 (0.0008) [2023-12-28 08:36:34,229][106226] Updated weights for policy 0, policy_version 1857132 (0.0005) [2023-12-28 08:36:34,292][106226] Updated weights for policy 0, policy_version 1857142 (0.0007) [2023-12-28 08:36:34,362][106226] Updated weights for policy 0, policy_version 1857152 (0.0007) [2023-12-28 08:36:34,711][106225] Updated weights for policy 1, policy_version 1860965 (0.0009) [2023-12-28 08:36:34,769][106225] Updated weights for policy 1, policy_version 1860975 (0.0009) [2023-12-28 08:36:34,828][106225] Updated weights for policy 1, policy_version 1860985 (0.0009) [2023-12-28 08:36:34,883][106226] Updated weights for policy 0, policy_version 1857162 (0.0006) [2023-12-28 08:36:34,935][106226] Updated weights for policy 0, policy_version 1857172 (0.0008) [2023-12-28 08:36:34,980][106226] Updated weights for policy 0, policy_version 1857182 (0.0008) [2023-12-28 08:36:35,036][106226] Updated weights for policy 0, policy_version 1857192 (0.0009) [2023-12-28 08:36:35,596][106225] Updated weights for policy 1, policy_version 1860995 (0.0010) [2023-12-28 08:36:35,654][106225] Updated weights for policy 1, policy_version 1861005 (0.0007) [2023-12-28 08:36:35,702][106225] Updated weights for policy 1, policy_version 1861015 (0.0006) [2023-12-28 08:36:35,751][106226] Updated weights for policy 0, policy_version 1857202 (0.0005) [2023-12-28 08:36:35,802][106226] Updated weights for policy 0, policy_version 1857212 (0.0005) [2023-12-28 08:36:35,848][106226] Updated weights for policy 0, policy_version 1857222 (0.0005) [2023-12-28 08:36:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19799.7). Total num frames: 952008704. Throughput: 0: 10037.5, 1: 9473.3. Samples: 952018196. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-28 08:36:36,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.677')] [2023-12-28 08:36:36,447][106226] Updated weights for policy 0, policy_version 1857232 (0.0008) [2023-12-28 08:36:36,511][106226] Updated weights for policy 0, policy_version 1857242 (0.0008) [2023-12-28 08:36:36,544][106225] Updated weights for policy 1, policy_version 1861026 (0.0008) [2023-12-28 08:36:36,576][106226] Updated weights for policy 0, policy_version 1857252 (0.0007) [2023-12-28 08:36:36,607][106225] Updated weights for policy 1, policy_version 1861036 (0.0008) [2023-12-28 08:36:36,677][106225] Updated weights for policy 1, policy_version 1861046 (0.0006) [2023-12-28 08:36:36,746][106225] Updated weights for policy 1, policy_version 1861056 (0.0006) [2023-12-28 08:36:37,138][106226] Updated weights for policy 0, policy_version 1857262 (0.0006) [2023-12-28 08:36:37,200][106226] Updated weights for policy 0, policy_version 1857272 (0.0005) [2023-12-28 08:36:37,268][106226] Updated weights for policy 0, policy_version 1857282 (0.0007) [2023-12-28 08:36:37,303][106225] Updated weights for policy 1, policy_version 1861066 (0.0005) [2023-12-28 08:36:37,358][106225] Updated weights for policy 1, policy_version 1861076 (0.0006) [2023-12-28 08:36:37,427][106225] Updated weights for policy 1, policy_version 1861086 (0.0005) [2023-12-28 08:36:37,935][106226] Updated weights for policy 0, policy_version 1857292 (0.0010) [2023-12-28 08:36:37,994][106226] Updated weights for policy 0, policy_version 1857302 (0.0010) [2023-12-28 08:36:38,004][106225] Updated weights for policy 1, policy_version 1861096 (0.0005) [2023-12-28 08:36:38,045][106226] Updated weights for policy 0, policy_version 1857312 (0.0010) [2023-12-28 08:36:38,055][106225] Updated weights for policy 1, policy_version 1861106 (0.0007) [2023-12-28 08:36:38,102][106225] Updated weights for policy 1, policy_version 1861116 (0.0008) [2023-12-28 08:36:38,770][106226] Updated weights for policy 0, policy_version 1857322 (0.0011) [2023-12-28 08:36:38,827][106226] Updated weights for policy 0, policy_version 1857332 (0.0011) [2023-12-28 08:36:38,881][106226] Updated weights for policy 0, policy_version 1857342 (0.0011) [2023-12-28 08:36:38,899][106225] Updated weights for policy 1, policy_version 1861126 (0.0006) [2023-12-28 08:36:38,931][106226] Updated weights for policy 0, policy_version 1857352 (0.0010) [2023-12-28 08:36:38,944][106225] Updated weights for policy 1, policy_version 1861136 (0.0009) [2023-12-28 08:36:38,995][106225] Updated weights for policy 1, policy_version 1861146 (0.0007) [2023-12-28 08:36:39,695][106226] Updated weights for policy 0, policy_version 1857362 (0.0010) [2023-12-28 08:36:39,760][106226] Updated weights for policy 0, policy_version 1857372 (0.0011) [2023-12-28 08:36:39,786][106225] Updated weights for policy 1, policy_version 1861156 (0.0007) [2023-12-28 08:36:39,819][106226] Updated weights for policy 0, policy_version 1857382 (0.0010) [2023-12-28 08:36:39,845][106225] Updated weights for policy 1, policy_version 1861166 (0.0006) [2023-12-28 08:36:39,907][106225] Updated weights for policy 1, policy_version 1861176 (0.0008) [2023-12-28 08:36:40,534][106226] Updated weights for policy 0, policy_version 1857392 (0.0007) [2023-12-28 08:36:40,594][106226] Updated weights for policy 0, policy_version 1857402 (0.0006) [2023-12-28 08:36:40,643][106226] Updated weights for policy 0, policy_version 1857412 (0.0005) [2023-12-28 08:36:40,655][106225] Updated weights for policy 1, policy_version 1861186 (0.0008) [2023-12-28 08:36:40,711][106225] Updated weights for policy 1, policy_version 1861196 (0.0005) [2023-12-28 08:36:40,775][106225] Updated weights for policy 1, policy_version 1861206 (0.0009) [2023-12-28 08:36:40,834][106225] Updated weights for policy 1, policy_version 1861216 (0.0008) [2023-12-28 08:36:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19387.8, 300 sec: 19799.6). Total num frames: 952107008. Throughput: 0: 10080.5, 1: 9521.4. Samples: 952079728. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:36:41,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.816')] [2023-12-28 08:36:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001861216_476528640.pth... [2023-12-28 08:36:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001857416_475578368.pth... [2023-12-28 08:36:41,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001856232_475275264.pth [2023-12-28 08:36:41,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001860128_476250112.pth [2023-12-28 08:36:41,241][106226] Updated weights for policy 0, policy_version 1857422 (0.0009) [2023-12-28 08:36:41,305][106226] Updated weights for policy 0, policy_version 1857432 (0.0007) [2023-12-28 08:36:41,386][106226] Updated weights for policy 0, policy_version 1857442 (0.0009) [2023-12-28 08:36:41,614][106225] Updated weights for policy 1, policy_version 1861226 (0.0009) [2023-12-28 08:36:41,676][106225] Updated weights for policy 1, policy_version 1861236 (0.0009) [2023-12-28 08:36:41,749][106225] Updated weights for policy 1, policy_version 1861246 (0.0008) [2023-12-28 08:36:42,178][106226] Updated weights for policy 0, policy_version 1857452 (0.0008) [2023-12-28 08:36:42,235][106226] Updated weights for policy 0, policy_version 1857462 (0.0008) [2023-12-28 08:36:42,299][106226] Updated weights for policy 0, policy_version 1857472 (0.0009) [2023-12-28 08:36:42,437][106225] Updated weights for policy 1, policy_version 1861256 (0.0007) [2023-12-28 08:36:42,501][106225] Updated weights for policy 1, policy_version 1861266 (0.0008) [2023-12-28 08:36:42,558][106225] Updated weights for policy 1, policy_version 1861276 (0.0009) [2023-12-28 08:36:43,048][106226] Updated weights for policy 0, policy_version 1857482 (0.0009) [2023-12-28 08:36:43,110][106226] Updated weights for policy 0, policy_version 1857492 (0.0007) [2023-12-28 08:36:43,171][106226] Updated weights for policy 0, policy_version 1857502 (0.0008) [2023-12-28 08:36:43,227][106226] Updated weights for policy 0, policy_version 1857512 (0.0007) [2023-12-28 08:36:43,331][106225] Updated weights for policy 1, policy_version 1861286 (0.0010) [2023-12-28 08:36:43,381][106225] Updated weights for policy 1, policy_version 1861296 (0.0010) [2023-12-28 08:36:43,431][106225] Updated weights for policy 1, policy_version 1861306 (0.0010) [2023-12-28 08:36:43,952][106226] Updated weights for policy 0, policy_version 1857522 (0.0010) [2023-12-28 08:36:44,003][106226] Updated weights for policy 0, policy_version 1857532 (0.0010) [2023-12-28 08:36:44,056][106226] Updated weights for policy 0, policy_version 1857542 (0.0009) [2023-12-28 08:36:44,121][106225] Updated weights for policy 1, policy_version 1861316 (0.0010) [2023-12-28 08:36:44,184][106225] Updated weights for policy 1, policy_version 1861326 (0.0007) [2023-12-28 08:36:44,231][106225] Updated weights for policy 1, policy_version 1861336 (0.0010) [2023-12-28 08:36:44,814][106226] Updated weights for policy 0, policy_version 1857552 (0.0011) [2023-12-28 08:36:44,878][106226] Updated weights for policy 0, policy_version 1857562 (0.0010) [2023-12-28 08:36:44,902][106225] Updated weights for policy 1, policy_version 1861346 (0.0010) [2023-12-28 08:36:44,939][106226] Updated weights for policy 0, policy_version 1857572 (0.0010) [2023-12-28 08:36:44,969][106225] Updated weights for policy 1, policy_version 1861356 (0.0011) [2023-12-28 08:36:45,034][106225] Updated weights for policy 1, policy_version 1861366 (0.0010) [2023-12-28 08:36:45,101][106225] Updated weights for policy 1, policy_version 1861376 (0.0010) [2023-12-28 08:36:45,610][106226] Updated weights for policy 0, policy_version 1857582 (0.0008) [2023-12-28 08:36:45,675][106226] Updated weights for policy 0, policy_version 1857592 (0.0008) [2023-12-28 08:36:45,740][106226] Updated weights for policy 0, policy_version 1857602 (0.0009) [2023-12-28 08:36:45,833][106225] Updated weights for policy 1, policy_version 1861386 (0.0010) [2023-12-28 08:36:45,889][106225] Updated weights for policy 1, policy_version 1861396 (0.0010) [2023-12-28 08:36:45,939][106225] Updated weights for policy 1, policy_version 1861406 (0.0010) [2023-12-28 08:36:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 952205312. Throughput: 0: 10053.7, 1: 9425.3. Samples: 952194292. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:36:46,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.820')] [2023-12-28 08:36:46,256][106226] Updated weights for policy 0, policy_version 1857612 (0.0006) [2023-12-28 08:36:46,315][106226] Updated weights for policy 0, policy_version 1857622 (0.0006) [2023-12-28 08:36:46,378][106226] Updated weights for policy 0, policy_version 1857632 (0.0006) [2023-12-28 08:36:46,642][106225] Updated weights for policy 1, policy_version 1861416 (0.0006) [2023-12-28 08:36:46,703][106225] Updated weights for policy 1, policy_version 1861426 (0.0006) [2023-12-28 08:36:46,771][106225] Updated weights for policy 1, policy_version 1861436 (0.0005) [2023-12-28 08:36:46,912][106226] Updated weights for policy 0, policy_version 1857642 (0.0006) [2023-12-28 08:36:46,996][106226] Updated weights for policy 0, policy_version 1857652 (0.0010) [2023-12-28 08:36:47,069][106226] Updated weights for policy 0, policy_version 1857662 (0.0011) [2023-12-28 08:36:47,136][106226] Updated weights for policy 0, policy_version 1857672 (0.0010) [2023-12-28 08:36:47,294][106225] Updated weights for policy 1, policy_version 1861446 (0.0005) [2023-12-28 08:36:47,349][106225] Updated weights for policy 1, policy_version 1861456 (0.0005) [2023-12-28 08:36:47,421][106225] Updated weights for policy 1, policy_version 1861466 (0.0005) [2023-12-28 08:36:47,751][106226] Updated weights for policy 0, policy_version 1857682 (0.0007) [2023-12-28 08:36:47,797][106226] Updated weights for policy 0, policy_version 1857692 (0.0010) [2023-12-28 08:36:47,854][106226] Updated weights for policy 0, policy_version 1857702 (0.0006) [2023-12-28 08:36:47,985][106225] Updated weights for policy 1, policy_version 1861476 (0.0005) [2023-12-28 08:36:48,035][106225] Updated weights for policy 1, policy_version 1861486 (0.0009) [2023-12-28 08:36:48,087][106225] Updated weights for policy 1, policy_version 1861496 (0.0010) [2023-12-28 08:36:48,501][106226] Updated weights for policy 0, policy_version 1857712 (0.0010) [2023-12-28 08:36:48,568][106226] Updated weights for policy 0, policy_version 1857722 (0.0011) [2023-12-28 08:36:48,631][106226] Updated weights for policy 0, policy_version 1857732 (0.0011) [2023-12-28 08:36:48,802][106225] Updated weights for policy 1, policy_version 1861506 (0.0010) [2023-12-28 08:36:48,856][106225] Updated weights for policy 1, policy_version 1861516 (0.0010) [2023-12-28 08:36:48,909][106225] Updated weights for policy 1, policy_version 1861526 (0.0009) [2023-12-28 08:36:48,963][106225] Updated weights for policy 1, policy_version 1861536 (0.0010) [2023-12-28 08:36:49,347][106226] Updated weights for policy 0, policy_version 1857742 (0.0009) [2023-12-28 08:36:49,420][106226] Updated weights for policy 0, policy_version 1857752 (0.0008) [2023-12-28 08:36:49,479][106226] Updated weights for policy 0, policy_version 1857762 (0.0008) [2023-12-28 08:36:49,768][106225] Updated weights for policy 1, policy_version 1861546 (0.0009) [2023-12-28 08:36:49,826][106225] Updated weights for policy 1, policy_version 1861556 (0.0008) [2023-12-28 08:36:49,893][106225] Updated weights for policy 1, policy_version 1861567 (0.0008) [2023-12-28 08:36:50,207][106226] Updated weights for policy 0, policy_version 1857772 (0.0007) [2023-12-28 08:36:50,271][106226] Updated weights for policy 0, policy_version 1857782 (0.0006) [2023-12-28 08:36:50,325][106226] Updated weights for policy 0, policy_version 1857792 (0.0005) [2023-12-28 08:36:50,663][106225] Updated weights for policy 1, policy_version 1861577 (0.0008) [2023-12-28 08:36:50,724][106225] Updated weights for policy 1, policy_version 1861587 (0.0008) [2023-12-28 08:36:50,788][106225] Updated weights for policy 1, policy_version 1861597 (0.0009) [2023-12-28 08:36:51,003][106226] Updated weights for policy 0, policy_version 1857802 (0.0007) [2023-12-28 08:36:51,064][106226] Updated weights for policy 0, policy_version 1857812 (0.0009) [2023-12-28 08:36:51,123][106226] Updated weights for policy 0, policy_version 1857822 (0.0008) [2023-12-28 08:36:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 952303616. Throughput: 0: 10094.6, 1: 9447.8. Samples: 952317624. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:36:51,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.680')] [2023-12-28 08:36:51,193][106226] Updated weights for policy 0, policy_version 1857832 (0.0005) [2023-12-28 08:36:51,535][106225] Updated weights for policy 1, policy_version 1861607 (0.0009) [2023-12-28 08:36:51,591][106225] Updated weights for policy 1, policy_version 1861617 (0.0009) [2023-12-28 08:36:51,655][106225] Updated weights for policy 1, policy_version 1861627 (0.0008) [2023-12-28 08:36:51,915][106226] Updated weights for policy 0, policy_version 1857842 (0.0008) [2023-12-28 08:36:51,975][106226] Updated weights for policy 0, policy_version 1857852 (0.0009) [2023-12-28 08:36:52,029][106226] Updated weights for policy 0, policy_version 1857862 (0.0009) [2023-12-28 08:36:52,425][106225] Updated weights for policy 1, policy_version 1861637 (0.0007) [2023-12-28 08:36:52,481][106225] Updated weights for policy 1, policy_version 1861647 (0.0005) [2023-12-28 08:36:52,542][106225] Updated weights for policy 1, policy_version 1861657 (0.0007) [2023-12-28 08:36:52,719][106226] Updated weights for policy 0, policy_version 1857872 (0.0006) [2023-12-28 08:36:52,772][106226] Updated weights for policy 0, policy_version 1857882 (0.0009) [2023-12-28 08:36:52,826][106226] Updated weights for policy 0, policy_version 1857892 (0.0008) [2023-12-28 08:36:53,210][106225] Updated weights for policy 1, policy_version 1861667 (0.0008) [2023-12-28 08:36:53,266][106225] Updated weights for policy 1, policy_version 1861677 (0.0006) [2023-12-28 08:36:53,314][106225] Updated weights for policy 1, policy_version 1861687 (0.0006) [2023-12-28 08:36:53,599][106226] Updated weights for policy 0, policy_version 1857902 (0.0009) [2023-12-28 08:36:53,646][106226] Updated weights for policy 0, policy_version 1857912 (0.0008) [2023-12-28 08:36:53,695][106226] Updated weights for policy 0, policy_version 1857922 (0.0008) [2023-12-28 08:36:53,930][106225] Updated weights for policy 1, policy_version 1861697 (0.0005) [2023-12-28 08:36:53,984][106225] Updated weights for policy 1, policy_version 1861707 (0.0007) [2023-12-28 08:36:54,032][106225] Updated weights for policy 1, policy_version 1861717 (0.0009) [2023-12-28 08:36:54,078][106225] Updated weights for policy 1, policy_version 1861727 (0.0007) [2023-12-28 08:36:54,475][106226] Updated weights for policy 0, policy_version 1857932 (0.0007) [2023-12-28 08:36:54,531][106226] Updated weights for policy 0, policy_version 1857942 (0.0005) [2023-12-28 08:36:54,590][106226] Updated weights for policy 0, policy_version 1857952 (0.0008) [2023-12-28 08:36:54,792][106225] Updated weights for policy 1, policy_version 1861737 (0.0007) [2023-12-28 08:36:54,842][106225] Updated weights for policy 1, policy_version 1861747 (0.0008) [2023-12-28 08:36:54,899][106225] Updated weights for policy 1, policy_version 1861757 (0.0008) [2023-12-28 08:36:55,366][106226] Updated weights for policy 0, policy_version 1857962 (0.0009) [2023-12-28 08:36:55,426][106226] Updated weights for policy 0, policy_version 1857972 (0.0008) [2023-12-28 08:36:55,488][106226] Updated weights for policy 0, policy_version 1857982 (0.0006) [2023-12-28 08:36:55,528][106225] Updated weights for policy 1, policy_version 1861767 (0.0007) [2023-12-28 08:36:55,545][106226] Updated weights for policy 0, policy_version 1857992 (0.0008) [2023-12-28 08:36:55,596][106225] Updated weights for policy 1, policy_version 1861777 (0.0006) [2023-12-28 08:36:55,658][106225] Updated weights for policy 1, policy_version 1861787 (0.0007) [2023-12-28 08:36:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.2, 300 sec: 19799.6). Total num frames: 952401920. Throughput: 0: 10067.9, 1: 9423.9. Samples: 952374440. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:36:56,176][105115] Avg episode reward: [(0, '-4.415'), (1, '-4.649')] [2023-12-28 08:36:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001861792_476676096.pth... [2023-12-28 08:36:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001857992_475725824.pth... [2023-12-28 08:36:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001860672_476389376.pth [2023-12-28 08:36:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001856840_475430912.pth [2023-12-28 08:36:56,280][106226] Updated weights for policy 0, policy_version 1858002 (0.0009) [2023-12-28 08:36:56,331][106225] Updated weights for policy 1, policy_version 1861797 (0.0009) [2023-12-28 08:36:56,334][106226] Updated weights for policy 0, policy_version 1858012 (0.0007) [2023-12-28 08:36:56,389][106226] Updated weights for policy 0, policy_version 1858022 (0.0009) [2023-12-28 08:36:56,391][106225] Updated weights for policy 1, policy_version 1861807 (0.0006) [2023-12-28 08:36:56,448][106225] Updated weights for policy 1, policy_version 1861817 (0.0008) [2023-12-28 08:36:57,106][106225] Updated weights for policy 1, policy_version 1861827 (0.0007) [2023-12-28 08:36:57,152][106226] Updated weights for policy 0, policy_version 1858032 (0.0009) [2023-12-28 08:36:57,162][106225] Updated weights for policy 1, policy_version 1861837 (0.0005) [2023-12-28 08:36:57,208][106226] Updated weights for policy 0, policy_version 1858042 (0.0008) [2023-12-28 08:36:57,213][106225] Updated weights for policy 1, policy_version 1861847 (0.0006) [2023-12-28 08:36:57,264][106226] Updated weights for policy 0, policy_version 1858052 (0.0007) [2023-12-28 08:36:57,861][106225] Updated weights for policy 1, policy_version 1861857 (0.0005) [2023-12-28 08:36:57,923][106225] Updated weights for policy 1, policy_version 1861867 (0.0005) [2023-12-28 08:36:57,979][106225] Updated weights for policy 1, policy_version 1861877 (0.0005) [2023-12-28 08:36:58,013][106226] Updated weights for policy 0, policy_version 1858062 (0.0010) [2023-12-28 08:36:58,036][106225] Updated weights for policy 1, policy_version 1861887 (0.0006) [2023-12-28 08:36:58,063][106226] Updated weights for policy 0, policy_version 1858072 (0.0010) [2023-12-28 08:36:58,112][106226] Updated weights for policy 0, policy_version 1858082 (0.0010) [2023-12-28 08:36:58,769][106225] Updated weights for policy 1, policy_version 1861898 (0.0007) [2023-12-28 08:36:58,841][106225] Updated weights for policy 1, policy_version 1861908 (0.0010) [2023-12-28 08:36:58,907][106225] Updated weights for policy 1, policy_version 1861918 (0.0008) [2023-12-28 08:36:58,947][106226] Updated weights for policy 0, policy_version 1858092 (0.0009) [2023-12-28 08:36:59,019][106226] Updated weights for policy 0, policy_version 1858102 (0.0007) [2023-12-28 08:36:59,090][106226] Updated weights for policy 0, policy_version 1858112 (0.0007) [2023-12-28 08:36:59,667][106225] Updated weights for policy 1, policy_version 1861928 (0.0006) [2023-12-28 08:36:59,724][106225] Updated weights for policy 1, policy_version 1861938 (0.0005) [2023-12-28 08:36:59,785][106225] Updated weights for policy 1, policy_version 1861948 (0.0008) [2023-12-28 08:36:59,833][106226] Updated weights for policy 0, policy_version 1858122 (0.0008) [2023-12-28 08:36:59,893][106226] Updated weights for policy 0, policy_version 1858132 (0.0008) [2023-12-28 08:36:59,953][106226] Updated weights for policy 0, policy_version 1858142 (0.0008) [2023-12-28 08:37:00,017][106226] Updated weights for policy 0, policy_version 1858152 (0.0009) [2023-12-28 08:37:00,442][106225] Updated weights for policy 1, policy_version 1861958 (0.0007) [2023-12-28 08:37:00,497][106225] Updated weights for policy 1, policy_version 1861968 (0.0006) [2023-12-28 08:37:00,550][106225] Updated weights for policy 1, policy_version 1861978 (0.0005) [2023-12-28 08:37:00,711][106226] Updated weights for policy 0, policy_version 1858162 (0.0005) [2023-12-28 08:37:00,760][106226] Updated weights for policy 0, policy_version 1858172 (0.0005) [2023-12-28 08:37:00,812][106226] Updated weights for policy 0, policy_version 1858182 (0.0009) [2023-12-28 08:37:01,141][106225] Updated weights for policy 1, policy_version 1861988 (0.0007) [2023-12-28 08:37:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.7). Total num frames: 952500224. Throughput: 0: 9981.7, 1: 9554.6. Samples: 952490020. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:01,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.919')] [2023-12-28 08:37:01,209][106225] Updated weights for policy 1, policy_version 1861998 (0.0007) [2023-12-28 08:37:01,274][106225] Updated weights for policy 1, policy_version 1862008 (0.0008) [2023-12-28 08:37:01,618][106226] Updated weights for policy 0, policy_version 1858192 (0.0008) [2023-12-28 08:37:01,686][106226] Updated weights for policy 0, policy_version 1858202 (0.0008) [2023-12-28 08:37:01,754][106226] Updated weights for policy 0, policy_version 1858212 (0.0007) [2023-12-28 08:37:01,945][106225] Updated weights for policy 1, policy_version 1862018 (0.0008) [2023-12-28 08:37:02,000][106225] Updated weights for policy 1, policy_version 1862028 (0.0008) [2023-12-28 08:37:02,048][106225] Updated weights for policy 1, policy_version 1862038 (0.0008) [2023-12-28 08:37:02,096][106225] Updated weights for policy 1, policy_version 1862048 (0.0008) [2023-12-28 08:37:02,473][106226] Updated weights for policy 0, policy_version 1858222 (0.0009) [2023-12-28 08:37:02,532][106226] Updated weights for policy 0, policy_version 1858232 (0.0008) [2023-12-28 08:37:02,596][106226] Updated weights for policy 0, policy_version 1858242 (0.0008) [2023-12-28 08:37:02,880][106225] Updated weights for policy 1, policy_version 1862058 (0.0006) [2023-12-28 08:37:02,943][106225] Updated weights for policy 1, policy_version 1862068 (0.0005) [2023-12-28 08:37:02,999][106225] Updated weights for policy 1, policy_version 1862078 (0.0005) [2023-12-28 08:37:03,175][106226] Updated weights for policy 0, policy_version 1858252 (0.0005) [2023-12-28 08:37:03,238][106226] Updated weights for policy 0, policy_version 1858262 (0.0006) [2023-12-28 08:37:03,299][106226] Updated weights for policy 0, policy_version 1858272 (0.0007) [2023-12-28 08:37:03,583][106225] Updated weights for policy 1, policy_version 1862088 (0.0008) [2023-12-28 08:37:03,636][106225] Updated weights for policy 1, policy_version 1862098 (0.0008) [2023-12-28 08:37:03,688][106225] Updated weights for policy 1, policy_version 1862108 (0.0007) [2023-12-28 08:37:03,837][106226] Updated weights for policy 0, policy_version 1858282 (0.0006) [2023-12-28 08:37:03,902][106226] Updated weights for policy 0, policy_version 1858292 (0.0008) [2023-12-28 08:37:03,967][106226] Updated weights for policy 0, policy_version 1858302 (0.0008) [2023-12-28 08:37:04,035][106226] Updated weights for policy 0, policy_version 1858312 (0.0008) [2023-12-28 08:37:04,332][106225] Updated weights for policy 1, policy_version 1862118 (0.0007) [2023-12-28 08:37:04,395][106225] Updated weights for policy 1, policy_version 1862128 (0.0005) [2023-12-28 08:37:04,451][106225] Updated weights for policy 1, policy_version 1862138 (0.0006) [2023-12-28 08:37:04,765][106226] Updated weights for policy 0, policy_version 1858322 (0.0008) [2023-12-28 08:37:04,819][106226] Updated weights for policy 0, policy_version 1858332 (0.0005) [2023-12-28 08:37:04,878][106226] Updated weights for policy 0, policy_version 1858342 (0.0008) [2023-12-28 08:37:05,059][106225] Updated weights for policy 1, policy_version 1862148 (0.0007) [2023-12-28 08:37:05,118][106225] Updated weights for policy 1, policy_version 1862158 (0.0006) [2023-12-28 08:37:05,175][106225] Updated weights for policy 1, policy_version 1862168 (0.0006) [2023-12-28 08:37:05,523][106226] Updated weights for policy 0, policy_version 1858352 (0.0008) [2023-12-28 08:37:05,574][106226] Updated weights for policy 0, policy_version 1858362 (0.0007) [2023-12-28 08:37:05,637][106226] Updated weights for policy 0, policy_version 1858372 (0.0005) [2023-12-28 08:37:05,701][106225] Updated weights for policy 1, policy_version 1862178 (0.0008) [2023-12-28 08:37:05,751][106225] Updated weights for policy 1, policy_version 1862188 (0.0009) [2023-12-28 08:37:05,804][106225] Updated weights for policy 1, policy_version 1862198 (0.0008) [2023-12-28 08:37:05,863][106225] Updated weights for policy 1, policy_version 1862208 (0.0009) [2023-12-28 08:37:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19660.9, 300 sec: 19827.4). Total num frames: 952606720. Throughput: 0: 10013.1, 1: 9780.5. Samples: 952617164. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:06,175][105115] Avg episode reward: [(0, '-4.173'), (1, '-4.475')] [2023-12-28 08:37:06,268][106226] Updated weights for policy 0, policy_version 1858382 (0.0008) [2023-12-28 08:37:06,326][106226] Updated weights for policy 0, policy_version 1858392 (0.0010) [2023-12-28 08:37:06,390][106226] Updated weights for policy 0, policy_version 1858402 (0.0008) [2023-12-28 08:37:06,553][106225] Updated weights for policy 1, policy_version 1862218 (0.0006) [2023-12-28 08:37:06,616][106225] Updated weights for policy 1, policy_version 1862228 (0.0006) [2023-12-28 08:37:06,681][106225] Updated weights for policy 1, policy_version 1862238 (0.0006) [2023-12-28 08:37:07,163][106226] Updated weights for policy 0, policy_version 1858412 (0.0009) [2023-12-28 08:37:07,233][106226] Updated weights for policy 0, policy_version 1858422 (0.0011) [2023-12-28 08:37:07,297][106226] Updated weights for policy 0, policy_version 1858432 (0.0011) [2023-12-28 08:37:07,297][106225] Updated weights for policy 1, policy_version 1862248 (0.0009) [2023-12-28 08:37:07,343][106225] Updated weights for policy 1, policy_version 1862258 (0.0010) [2023-12-28 08:37:07,391][106225] Updated weights for policy 1, policy_version 1862268 (0.0009) [2023-12-28 08:37:07,969][106226] Updated weights for policy 0, policy_version 1858442 (0.0010) [2023-12-28 08:37:08,019][106226] Updated weights for policy 0, policy_version 1858452 (0.0010) [2023-12-28 08:37:08,072][106226] Updated weights for policy 0, policy_version 1858462 (0.0010) [2023-12-28 08:37:08,122][106225] Updated weights for policy 1, policy_version 1862278 (0.0009) [2023-12-28 08:37:08,128][106226] Updated weights for policy 0, policy_version 1858472 (0.0010) [2023-12-28 08:37:08,172][106225] Updated weights for policy 1, policy_version 1862288 (0.0010) [2023-12-28 08:37:08,225][106225] Updated weights for policy 1, policy_version 1862298 (0.0010) [2023-12-28 08:37:08,858][106226] Updated weights for policy 0, policy_version 1858482 (0.0011) [2023-12-28 08:37:08,884][106225] Updated weights for policy 1, policy_version 1862308 (0.0009) [2023-12-28 08:37:08,923][106226] Updated weights for policy 0, policy_version 1858492 (0.0011) [2023-12-28 08:37:08,945][106225] Updated weights for policy 1, policy_version 1862318 (0.0010) [2023-12-28 08:37:08,987][106226] Updated weights for policy 0, policy_version 1858502 (0.0009) [2023-12-28 08:37:09,010][106225] Updated weights for policy 1, policy_version 1862328 (0.0007) [2023-12-28 08:37:09,706][106225] Updated weights for policy 1, policy_version 1862338 (0.0006) [2023-12-28 08:37:09,708][106226] Updated weights for policy 0, policy_version 1858512 (0.0009) [2023-12-28 08:37:09,763][106225] Updated weights for policy 1, policy_version 1862348 (0.0006) [2023-12-28 08:37:09,774][106226] Updated weights for policy 0, policy_version 1858522 (0.0008) [2023-12-28 08:37:09,825][106225] Updated weights for policy 1, policy_version 1862358 (0.0007) [2023-12-28 08:37:09,844][106226] Updated weights for policy 0, policy_version 1858532 (0.0010) [2023-12-28 08:37:09,889][106225] Updated weights for policy 1, policy_version 1862368 (0.0008) [2023-12-28 08:37:10,451][106226] Updated weights for policy 0, policy_version 1858542 (0.0006) [2023-12-28 08:37:10,506][106226] Updated weights for policy 0, policy_version 1858552 (0.0005) [2023-12-28 08:37:10,565][106226] Updated weights for policy 0, policy_version 1858562 (0.0008) [2023-12-28 08:37:10,687][106225] Updated weights for policy 1, policy_version 1862378 (0.0007) [2023-12-28 08:37:10,745][106225] Updated weights for policy 1, policy_version 1862388 (0.0006) [2023-12-28 08:37:10,804][106225] Updated weights for policy 1, policy_version 1862398 (0.0009) [2023-12-28 08:37:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 952705024. Throughput: 0: 9986.8, 1: 9881.9. Samples: 952676300. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:11,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.595')] [2023-12-28 08:37:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001862400_476831744.pth... [2023-12-28 08:37:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001858568_475873280.pth... [2023-12-28 08:37:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001861216_476528640.pth [2023-12-28 08:37:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001857416_475578368.pth [2023-12-28 08:37:11,265][106226] Updated weights for policy 0, policy_version 1858572 (0.0009) [2023-12-28 08:37:11,339][106226] Updated weights for policy 0, policy_version 1858582 (0.0007) [2023-12-28 08:37:11,407][106226] Updated weights for policy 0, policy_version 1858592 (0.0009) [2023-12-28 08:37:11,518][106225] Updated weights for policy 1, policy_version 1862408 (0.0009) [2023-12-28 08:37:11,584][106225] Updated weights for policy 1, policy_version 1862418 (0.0009) [2023-12-28 08:37:11,656][106225] Updated weights for policy 1, policy_version 1862428 (0.0008) [2023-12-28 08:37:12,138][106226] Updated weights for policy 0, policy_version 1858602 (0.0007) [2023-12-28 08:37:12,194][106226] Updated weights for policy 0, policy_version 1858612 (0.0009) [2023-12-28 08:37:12,260][106226] Updated weights for policy 0, policy_version 1858622 (0.0009) [2023-12-28 08:37:12,331][106226] Updated weights for policy 0, policy_version 1858632 (0.0007) [2023-12-28 08:37:12,395][106225] Updated weights for policy 1, policy_version 1862438 (0.0007) [2023-12-28 08:37:12,465][106225] Updated weights for policy 1, policy_version 1862448 (0.0006) [2023-12-28 08:37:12,534][106225] Updated weights for policy 1, policy_version 1862458 (0.0007) [2023-12-28 08:37:13,006][106226] Updated weights for policy 0, policy_version 1858642 (0.0008) [2023-12-28 08:37:13,069][106226] Updated weights for policy 0, policy_version 1858652 (0.0008) [2023-12-28 08:37:13,134][106226] Updated weights for policy 0, policy_version 1858662 (0.0008) [2023-12-28 08:37:13,159][106225] Updated weights for policy 1, policy_version 1862468 (0.0006) [2023-12-28 08:37:13,215][106225] Updated weights for policy 1, policy_version 1862478 (0.0009) [2023-12-28 08:37:13,280][106225] Updated weights for policy 1, policy_version 1862488 (0.0005) [2023-12-28 08:37:13,889][106226] Updated weights for policy 0, policy_version 1858672 (0.0008) [2023-12-28 08:37:13,941][106225] Updated weights for policy 1, policy_version 1862498 (0.0005) [2023-12-28 08:37:13,950][106226] Updated weights for policy 0, policy_version 1858682 (0.0009) [2023-12-28 08:37:14,000][106225] Updated weights for policy 1, policy_version 1862508 (0.0006) [2023-12-28 08:37:14,020][106226] Updated weights for policy 0, policy_version 1858692 (0.0011) [2023-12-28 08:37:14,066][106225] Updated weights for policy 1, policy_version 1862518 (0.0008) [2023-12-28 08:37:14,138][106225] Updated weights for policy 1, policy_version 1862528 (0.0006) [2023-12-28 08:37:14,738][106226] Updated weights for policy 0, policy_version 1858702 (0.0007) [2023-12-28 08:37:14,816][106226] Updated weights for policy 0, policy_version 1858713 (0.0009) [2023-12-28 08:37:14,847][106225] Updated weights for policy 1, policy_version 1862538 (0.0008) [2023-12-28 08:37:14,878][106226] Updated weights for policy 0, policy_version 1858723 (0.0007) [2023-12-28 08:37:14,913][106225] Updated weights for policy 1, policy_version 1862548 (0.0008) [2023-12-28 08:37:14,975][106225] Updated weights for policy 1, policy_version 1862558 (0.0008) [2023-12-28 08:37:15,549][106226] Updated weights for policy 0, policy_version 1858733 (0.0008) [2023-12-28 08:37:15,607][106226] Updated weights for policy 0, policy_version 1858743 (0.0007) [2023-12-28 08:37:15,677][106226] Updated weights for policy 0, policy_version 1858753 (0.0006) [2023-12-28 08:37:15,733][106225] Updated weights for policy 1, policy_version 1862568 (0.0008) [2023-12-28 08:37:15,796][106225] Updated weights for policy 1, policy_version 1862578 (0.0010) [2023-12-28 08:37:15,858][106225] Updated weights for policy 1, policy_version 1862588 (0.0010) [2023-12-28 08:37:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 952803328. Throughput: 0: 9926.9, 1: 9922.1. Samples: 952792716. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:16,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.811')] [2023-12-28 08:37:16,244][106226] Updated weights for policy 0, policy_version 1858763 (0.0006) [2023-12-28 08:37:16,311][106226] Updated weights for policy 0, policy_version 1858773 (0.0008) [2023-12-28 08:37:16,380][106226] Updated weights for policy 0, policy_version 1858783 (0.0006) [2023-12-28 08:37:16,547][106225] Updated weights for policy 1, policy_version 1862598 (0.0010) [2023-12-28 08:37:16,603][106225] Updated weights for policy 1, policy_version 1862608 (0.0010) [2023-12-28 08:37:16,653][106225] Updated weights for policy 1, policy_version 1862618 (0.0009) [2023-12-28 08:37:17,012][106226] Updated weights for policy 0, policy_version 1858793 (0.0006) [2023-12-28 08:37:17,072][106226] Updated weights for policy 0, policy_version 1858803 (0.0008) [2023-12-28 08:37:17,117][106226] Updated weights for policy 0, policy_version 1858813 (0.0008) [2023-12-28 08:37:17,168][106226] Updated weights for policy 0, policy_version 1858823 (0.0008) [2023-12-28 08:37:17,372][106225] Updated weights for policy 1, policy_version 1862628 (0.0008) [2023-12-28 08:37:17,428][106225] Updated weights for policy 1, policy_version 1862638 (0.0008) [2023-12-28 08:37:17,484][106225] Updated weights for policy 1, policy_version 1862648 (0.0009) [2023-12-28 08:37:17,934][106226] Updated weights for policy 0, policy_version 1858833 (0.0008) [2023-12-28 08:37:17,987][106226] Updated weights for policy 0, policy_version 1858843 (0.0008) [2023-12-28 08:37:18,045][106226] Updated weights for policy 0, policy_version 1858853 (0.0009) [2023-12-28 08:37:18,141][106225] Updated weights for policy 1, policy_version 1862658 (0.0009) [2023-12-28 08:37:18,206][106225] Updated weights for policy 1, policy_version 1862668 (0.0006) [2023-12-28 08:37:18,263][106225] Updated weights for policy 1, policy_version 1862678 (0.0008) [2023-12-28 08:37:18,324][106225] Updated weights for policy 1, policy_version 1862688 (0.0009) [2023-12-28 08:37:18,843][106226] Updated weights for policy 0, policy_version 1858863 (0.0007) [2023-12-28 08:37:18,908][106226] Updated weights for policy 0, policy_version 1858873 (0.0005) [2023-12-28 08:37:18,969][106226] Updated weights for policy 0, policy_version 1858883 (0.0008) [2023-12-28 08:37:19,062][106225] Updated weights for policy 1, policy_version 1862698 (0.0010) [2023-12-28 08:37:19,135][106225] Updated weights for policy 1, policy_version 1862708 (0.0010) [2023-12-28 08:37:19,203][106225] Updated weights for policy 1, policy_version 1862718 (0.0010) [2023-12-28 08:37:19,636][106226] Updated weights for policy 0, policy_version 1858893 (0.0007) [2023-12-28 08:37:19,699][106226] Updated weights for policy 0, policy_version 1858903 (0.0007) [2023-12-28 08:37:19,757][106226] Updated weights for policy 0, policy_version 1858913 (0.0007) [2023-12-28 08:37:19,987][106225] Updated weights for policy 1, policy_version 1862728 (0.0009) [2023-12-28 08:37:20,052][106225] Updated weights for policy 1, policy_version 1862738 (0.0010) [2023-12-28 08:37:20,118][106225] Updated weights for policy 1, policy_version 1862748 (0.0011) [2023-12-28 08:37:20,576][106226] Updated weights for policy 0, policy_version 1858923 (0.0008) [2023-12-28 08:37:20,645][106226] Updated weights for policy 0, policy_version 1858933 (0.0009) [2023-12-28 08:37:20,711][106226] Updated weights for policy 0, policy_version 1858943 (0.0008) [2023-12-28 08:37:20,821][106225] Updated weights for policy 1, policy_version 1862758 (0.0009) [2023-12-28 08:37:20,881][106225] Updated weights for policy 1, policy_version 1862768 (0.0011) [2023-12-28 08:37:20,950][106225] Updated weights for policy 1, policy_version 1862778 (0.0011) [2023-12-28 08:37:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 952901632. Throughput: 0: 9825.8, 1: 9970.2. Samples: 952909012. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:21,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.812')] [2023-12-28 08:37:21,467][106226] Updated weights for policy 0, policy_version 1858953 (0.0010) [2023-12-28 08:37:21,530][106226] Updated weights for policy 0, policy_version 1858963 (0.0008) [2023-12-28 08:37:21,599][106226] Updated weights for policy 0, policy_version 1858973 (0.0008) [2023-12-28 08:37:21,670][106226] Updated weights for policy 0, policy_version 1858983 (0.0008) [2023-12-28 08:37:21,734][106225] Updated weights for policy 1, policy_version 1862788 (0.0010) [2023-12-28 08:37:21,799][106225] Updated weights for policy 1, policy_version 1862798 (0.0008) [2023-12-28 08:37:21,865][106225] Updated weights for policy 1, policy_version 1862808 (0.0006) [2023-12-28 08:37:22,403][106226] Updated weights for policy 0, policy_version 1858993 (0.0008) [2023-12-28 08:37:22,462][106226] Updated weights for policy 0, policy_version 1859003 (0.0008) [2023-12-28 08:37:22,525][106226] Updated weights for policy 0, policy_version 1859013 (0.0008) [2023-12-28 08:37:22,608][106225] Updated weights for policy 1, policy_version 1862818 (0.0008) [2023-12-28 08:37:22,668][106225] Updated weights for policy 1, policy_version 1862828 (0.0007) [2023-12-28 08:37:22,727][106225] Updated weights for policy 1, policy_version 1862838 (0.0007) [2023-12-28 08:37:22,787][106225] Updated weights for policy 1, policy_version 1862848 (0.0009) [2023-12-28 08:37:23,214][106226] Updated weights for policy 0, policy_version 1859023 (0.0009) [2023-12-28 08:37:23,261][106226] Updated weights for policy 0, policy_version 1859033 (0.0008) [2023-12-28 08:37:23,310][106226] Updated weights for policy 0, policy_version 1859043 (0.0009) [2023-12-28 08:37:23,470][106225] Updated weights for policy 1, policy_version 1862858 (0.0005) [2023-12-28 08:37:23,528][106225] Updated weights for policy 1, policy_version 1862868 (0.0006) [2023-12-28 08:37:23,591][106225] Updated weights for policy 1, policy_version 1862878 (0.0009) [2023-12-28 08:37:24,071][106226] Updated weights for policy 0, policy_version 1859053 (0.0007) [2023-12-28 08:37:24,135][106226] Updated weights for policy 0, policy_version 1859063 (0.0005) [2023-12-28 08:37:24,196][106226] Updated weights for policy 0, policy_version 1859073 (0.0007) [2023-12-28 08:37:24,267][106225] Updated weights for policy 1, policy_version 1862888 (0.0008) [2023-12-28 08:37:24,317][106225] Updated weights for policy 1, policy_version 1862898 (0.0009) [2023-12-28 08:37:24,367][106225] Updated weights for policy 1, policy_version 1862908 (0.0008) [2023-12-28 08:37:24,825][106226] Updated weights for policy 0, policy_version 1859083 (0.0008) [2023-12-28 08:37:24,884][106226] Updated weights for policy 0, policy_version 1859093 (0.0009) [2023-12-28 08:37:24,935][106226] Updated weights for policy 0, policy_version 1859103 (0.0008) [2023-12-28 08:37:25,108][106225] Updated weights for policy 1, policy_version 1862918 (0.0008) [2023-12-28 08:37:25,155][106225] Updated weights for policy 1, policy_version 1862928 (0.0008) [2023-12-28 08:37:25,201][106225] Updated weights for policy 1, policy_version 1862938 (0.0008) [2023-12-28 08:37:25,578][106226] Updated weights for policy 0, policy_version 1859113 (0.0008) [2023-12-28 08:37:25,636][106226] Updated weights for policy 0, policy_version 1859123 (0.0009) [2023-12-28 08:37:25,697][106226] Updated weights for policy 0, policy_version 1859133 (0.0008) [2023-12-28 08:37:25,758][106226] Updated weights for policy 0, policy_version 1859143 (0.0009) [2023-12-28 08:37:25,973][106225] Updated weights for policy 1, policy_version 1862948 (0.0009) [2023-12-28 08:37:26,039][106225] Updated weights for policy 1, policy_version 1862958 (0.0009) [2023-12-28 08:37:26,092][106225] Updated weights for policy 1, policy_version 1862968 (0.0007) [2023-12-28 08:37:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 952999936. Throughput: 0: 9767.7, 1: 9917.3. Samples: 952965552. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:26,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.707')] [2023-12-28 08:37:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001862976_476979200.pth... [2023-12-28 08:37:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001859144_476020736.pth... [2023-12-28 08:37:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001857992_475725824.pth [2023-12-28 08:37:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001861792_476676096.pth [2023-12-28 08:37:26,425][106226] Updated weights for policy 0, policy_version 1859153 (0.0008) [2023-12-28 08:37:26,487][106226] Updated weights for policy 0, policy_version 1859163 (0.0009) [2023-12-28 08:37:26,550][106226] Updated weights for policy 0, policy_version 1859173 (0.0008) [2023-12-28 08:37:26,820][106225] Updated weights for policy 1, policy_version 1862978 (0.0008) [2023-12-28 08:37:26,867][106225] Updated weights for policy 1, policy_version 1862988 (0.0008) [2023-12-28 08:37:26,923][106225] Updated weights for policy 1, policy_version 1862998 (0.0009) [2023-12-28 08:37:26,976][106225] Updated weights for policy 1, policy_version 1863008 (0.0008) [2023-12-28 08:37:27,274][106226] Updated weights for policy 0, policy_version 1859183 (0.0009) [2023-12-28 08:37:27,332][106226] Updated weights for policy 0, policy_version 1859193 (0.0009) [2023-12-28 08:37:27,395][106226] Updated weights for policy 0, policy_version 1859203 (0.0009) [2023-12-28 08:37:27,722][106225] Updated weights for policy 1, policy_version 1863018 (0.0008) [2023-12-28 08:37:27,774][106225] Updated weights for policy 1, policy_version 1863028 (0.0008) [2023-12-28 08:37:27,824][106225] Updated weights for policy 1, policy_version 1863038 (0.0007) [2023-12-28 08:37:28,091][106226] Updated weights for policy 0, policy_version 1859213 (0.0009) [2023-12-28 08:37:28,146][106226] Updated weights for policy 0, policy_version 1859223 (0.0010) [2023-12-28 08:37:28,192][106226] Updated weights for policy 0, policy_version 1859233 (0.0010) [2023-12-28 08:37:28,494][106225] Updated weights for policy 1, policy_version 1863048 (0.0007) [2023-12-28 08:37:28,552][106225] Updated weights for policy 1, policy_version 1863058 (0.0007) [2023-12-28 08:37:28,609][106225] Updated weights for policy 1, policy_version 1863068 (0.0008) [2023-12-28 08:37:28,931][106226] Updated weights for policy 0, policy_version 1859243 (0.0011) [2023-12-28 08:37:28,987][106226] Updated weights for policy 0, policy_version 1859253 (0.0011) [2023-12-28 08:37:29,043][106226] Updated weights for policy 0, policy_version 1859263 (0.0010) [2023-12-28 08:37:29,407][106225] Updated weights for policy 1, policy_version 1863078 (0.0009) [2023-12-28 08:37:29,468][106225] Updated weights for policy 1, policy_version 1863088 (0.0008) [2023-12-28 08:37:29,529][106225] Updated weights for policy 1, policy_version 1863098 (0.0007) [2023-12-28 08:37:29,719][106226] Updated weights for policy 0, policy_version 1859273 (0.0010) [2023-12-28 08:37:29,786][106226] Updated weights for policy 0, policy_version 1859283 (0.0011) [2023-12-28 08:37:29,857][106226] Updated weights for policy 0, policy_version 1859293 (0.0010) [2023-12-28 08:37:29,921][106226] Updated weights for policy 0, policy_version 1859303 (0.0010) [2023-12-28 08:37:30,310][106225] Updated weights for policy 1, policy_version 1863108 (0.0008) [2023-12-28 08:37:30,361][106225] Updated weights for policy 1, policy_version 1863118 (0.0008) [2023-12-28 08:37:30,414][106225] Updated weights for policy 1, policy_version 1863128 (0.0007) [2023-12-28 08:37:30,624][106226] Updated weights for policy 0, policy_version 1859313 (0.0010) [2023-12-28 08:37:30,673][106226] Updated weights for policy 0, policy_version 1859323 (0.0010) [2023-12-28 08:37:30,726][106226] Updated weights for policy 0, policy_version 1859333 (0.0010) [2023-12-28 08:37:31,130][106225] Updated weights for policy 1, policy_version 1863138 (0.0008) [2023-12-28 08:37:31,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 953090048. Throughput: 0: 9816.7, 1: 9922.1. Samples: 953082540. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:31,175][105115] Avg episode reward: [(0, '-4.460'), (1, '-4.516')] [2023-12-28 08:37:31,194][106225] Updated weights for policy 1, policy_version 1863148 (0.0008) [2023-12-28 08:37:31,244][106225] Updated weights for policy 1, policy_version 1863158 (0.0008) [2023-12-28 08:37:31,305][106225] Updated weights for policy 1, policy_version 1863168 (0.0009) [2023-12-28 08:37:31,443][106226] Updated weights for policy 0, policy_version 1859343 (0.0011) [2023-12-28 08:37:31,506][106226] Updated weights for policy 0, policy_version 1859353 (0.0010) [2023-12-28 08:37:31,559][106226] Updated weights for policy 0, policy_version 1859363 (0.0010) [2023-12-28 08:37:32,013][106225] Updated weights for policy 1, policy_version 1863178 (0.0010) [2023-12-28 08:37:32,077][106225] Updated weights for policy 1, policy_version 1863188 (0.0010) [2023-12-28 08:37:32,130][106225] Updated weights for policy 1, policy_version 1863198 (0.0010) [2023-12-28 08:37:32,277][106226] Updated weights for policy 0, policy_version 1859373 (0.0007) [2023-12-28 08:37:32,337][106226] Updated weights for policy 0, policy_version 1859383 (0.0008) [2023-12-28 08:37:32,403][106226] Updated weights for policy 0, policy_version 1859393 (0.0007) [2023-12-28 08:37:32,888][106225] Updated weights for policy 1, policy_version 1863208 (0.0010) [2023-12-28 08:37:32,946][106225] Updated weights for policy 1, policy_version 1863218 (0.0010) [2023-12-28 08:37:33,008][106225] Updated weights for policy 1, policy_version 1863228 (0.0010) [2023-12-28 08:37:33,079][106226] Updated weights for policy 0, policy_version 1859403 (0.0008) [2023-12-28 08:37:33,129][106226] Updated weights for policy 0, policy_version 1859413 (0.0010) [2023-12-28 08:37:33,181][106226] Updated weights for policy 0, policy_version 1859423 (0.0010) [2023-12-28 08:37:33,657][106225] Updated weights for policy 1, policy_version 1863238 (0.0007) [2023-12-28 08:37:33,710][106225] Updated weights for policy 1, policy_version 1863248 (0.0007) [2023-12-28 08:37:33,771][106225] Updated weights for policy 1, policy_version 1863258 (0.0010) [2023-12-28 08:37:33,886][106226] Updated weights for policy 0, policy_version 1859433 (0.0010) [2023-12-28 08:37:33,949][106226] Updated weights for policy 0, policy_version 1859443 (0.0008) [2023-12-28 08:37:34,009][106226] Updated weights for policy 0, policy_version 1859453 (0.0011) [2023-12-28 08:37:34,067][106226] Updated weights for policy 0, policy_version 1859463 (0.0010) [2023-12-28 08:37:34,469][106225] Updated weights for policy 1, policy_version 1863268 (0.0009) [2023-12-28 08:37:34,537][106225] Updated weights for policy 1, policy_version 1863278 (0.0011) [2023-12-28 08:37:34,595][106225] Updated weights for policy 1, policy_version 1863288 (0.0008) [2023-12-28 08:37:34,832][106226] Updated weights for policy 0, policy_version 1859473 (0.0008) [2023-12-28 08:37:34,885][106226] Updated weights for policy 0, policy_version 1859483 (0.0005) [2023-12-28 08:37:34,934][106226] Updated weights for policy 0, policy_version 1859493 (0.0005) [2023-12-28 08:37:35,285][106225] Updated weights for policy 1, policy_version 1863298 (0.0007) [2023-12-28 08:37:35,352][106225] Updated weights for policy 1, policy_version 1863308 (0.0008) [2023-12-28 08:37:35,416][106225] Updated weights for policy 1, policy_version 1863318 (0.0007) [2023-12-28 08:37:35,480][106225] Updated weights for policy 1, policy_version 1863328 (0.0007) [2023-12-28 08:37:35,564][106226] Updated weights for policy 0, policy_version 1859503 (0.0007) [2023-12-28 08:37:35,610][106226] Updated weights for policy 0, policy_version 1859513 (0.0005) [2023-12-28 08:37:35,664][106226] Updated weights for policy 0, policy_version 1859523 (0.0007) [2023-12-28 08:37:36,173][106225] Updated weights for policy 1, policy_version 1863338 (0.0007) [2023-12-28 08:37:36,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 953188352. Throughput: 0: 9733.1, 1: 9882.3. Samples: 953200316. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:36,175][105115] Avg episode reward: [(0, '-4.087'), (1, '-4.513')] [2023-12-28 08:37:36,229][106225] Updated weights for policy 1, policy_version 1863348 (0.0008) [2023-12-28 08:37:36,283][106225] Updated weights for policy 1, policy_version 1863358 (0.0008) [2023-12-28 08:37:36,390][106226] Updated weights for policy 0, policy_version 1859533 (0.0008) [2023-12-28 08:37:36,445][106226] Updated weights for policy 0, policy_version 1859543 (0.0009) [2023-12-28 08:37:36,500][106226] Updated weights for policy 0, policy_version 1859553 (0.0008) [2023-12-28 08:37:37,049][106225] Updated weights for policy 1, policy_version 1863368 (0.0006) [2023-12-28 08:37:37,102][106225] Updated weights for policy 1, policy_version 1863378 (0.0008) [2023-12-28 08:37:37,158][106225] Updated weights for policy 1, policy_version 1863388 (0.0008) [2023-12-28 08:37:37,258][106226] Updated weights for policy 0, policy_version 1859563 (0.0008) [2023-12-28 08:37:37,304][106226] Updated weights for policy 0, policy_version 1859573 (0.0008) [2023-12-28 08:37:37,365][106226] Updated weights for policy 0, policy_version 1859583 (0.0008) [2023-12-28 08:37:37,896][106225] Updated weights for policy 1, policy_version 1863398 (0.0010) [2023-12-28 08:37:37,954][106225] Updated weights for policy 1, policy_version 1863408 (0.0010) [2023-12-28 08:37:38,008][106225] Updated weights for policy 1, policy_version 1863418 (0.0008) [2023-12-28 08:37:38,067][106226] Updated weights for policy 0, policy_version 1859593 (0.0008) [2023-12-28 08:37:38,132][106226] Updated weights for policy 0, policy_version 1859603 (0.0009) [2023-12-28 08:37:38,182][106226] Updated weights for policy 0, policy_version 1859613 (0.0009) [2023-12-28 08:37:38,250][106226] Updated weights for policy 0, policy_version 1859623 (0.0007) [2023-12-28 08:37:38,647][106225] Updated weights for policy 1, policy_version 1863428 (0.0008) [2023-12-28 08:37:38,705][106225] Updated weights for policy 1, policy_version 1863438 (0.0005) [2023-12-28 08:37:38,767][106225] Updated weights for policy 1, policy_version 1863448 (0.0008) [2023-12-28 08:37:39,023][106226] Updated weights for policy 0, policy_version 1859633 (0.0008) [2023-12-28 08:37:39,077][106226] Updated weights for policy 0, policy_version 1859643 (0.0008) [2023-12-28 08:37:39,136][106226] Updated weights for policy 0, policy_version 1859653 (0.0008) [2023-12-28 08:37:39,454][106225] Updated weights for policy 1, policy_version 1863458 (0.0008) [2023-12-28 08:37:39,525][106225] Updated weights for policy 1, policy_version 1863468 (0.0007) [2023-12-28 08:37:39,590][106225] Updated weights for policy 1, policy_version 1863478 (0.0009) [2023-12-28 08:37:39,650][106225] Updated weights for policy 1, policy_version 1863488 (0.0006) [2023-12-28 08:37:40,009][106226] Updated weights for policy 0, policy_version 1859663 (0.0010) [2023-12-28 08:37:40,071][106226] Updated weights for policy 0, policy_version 1859673 (0.0009) [2023-12-28 08:37:40,134][106226] Updated weights for policy 0, policy_version 1859683 (0.0009) [2023-12-28 08:37:40,277][106225] Updated weights for policy 1, policy_version 1863498 (0.0008) [2023-12-28 08:37:40,341][106225] Updated weights for policy 1, policy_version 1863508 (0.0008) [2023-12-28 08:37:40,403][106225] Updated weights for policy 1, policy_version 1863518 (0.0008) [2023-12-28 08:37:40,901][106226] Updated weights for policy 0, policy_version 1859693 (0.0009) [2023-12-28 08:37:40,951][106226] Updated weights for policy 0, policy_version 1859703 (0.0008) [2023-12-28 08:37:41,010][106226] Updated weights for policy 0, policy_version 1859713 (0.0009) [2023-12-28 08:37:41,063][106225] Updated weights for policy 1, policy_version 1863528 (0.0008) [2023-12-28 08:37:41,134][106225] Updated weights for policy 1, policy_version 1863538 (0.0008) [2023-12-28 08:37:41,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19771.9). Total num frames: 953286656. Throughput: 0: 9739.2, 1: 9902.7. Samples: 953258324. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:41,176][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.267')] [2023-12-28 08:37:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001859720_476168192.pth... [2023-12-28 08:37:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001858568_475873280.pth [2023-12-28 08:37:41,210][106225] Updated weights for policy 1, policy_version 1863548 (0.0008) [2023-12-28 08:37:41,235][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001863552_477126656.pth... [2023-12-28 08:37:41,240][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001862400_476831744.pth [2023-12-28 08:37:41,803][106226] Updated weights for policy 0, policy_version 1859723 (0.0009) [2023-12-28 08:37:41,870][106226] Updated weights for policy 0, policy_version 1859733 (0.0008) [2023-12-28 08:37:41,926][106226] Updated weights for policy 0, policy_version 1859743 (0.0008) [2023-12-28 08:37:41,935][106225] Updated weights for policy 1, policy_version 1863558 (0.0007) [2023-12-28 08:37:41,996][106225] Updated weights for policy 1, policy_version 1863568 (0.0005) [2023-12-28 08:37:42,063][106225] Updated weights for policy 1, policy_version 1863578 (0.0005) [2023-12-28 08:37:42,631][106225] Updated weights for policy 1, policy_version 1863588 (0.0007) [2023-12-28 08:37:42,693][106225] Updated weights for policy 1, policy_version 1863598 (0.0008) [2023-12-28 08:37:42,736][106226] Updated weights for policy 0, policy_version 1859753 (0.0008) [2023-12-28 08:37:42,754][106225] Updated weights for policy 1, policy_version 1863608 (0.0007) [2023-12-28 08:37:42,792][106226] Updated weights for policy 0, policy_version 1859763 (0.0006) [2023-12-28 08:37:42,857][106226] Updated weights for policy 0, policy_version 1859773 (0.0005) [2023-12-28 08:37:42,926][106226] Updated weights for policy 0, policy_version 1859783 (0.0007) [2023-12-28 08:37:43,494][106226] Updated weights for policy 0, policy_version 1859794 (0.0009) [2023-12-28 08:37:43,498][106225] Updated weights for policy 1, policy_version 1863618 (0.0008) [2023-12-28 08:37:43,546][106226] Updated weights for policy 0, policy_version 1859804 (0.0005) [2023-12-28 08:37:43,566][106225] Updated weights for policy 1, policy_version 1863628 (0.0005) [2023-12-28 08:37:43,605][106226] Updated weights for policy 0, policy_version 1859814 (0.0006) [2023-12-28 08:37:43,622][106225] Updated weights for policy 1, policy_version 1863638 (0.0006) [2023-12-28 08:37:43,677][106225] Updated weights for policy 1, policy_version 1863648 (0.0005) [2023-12-28 08:37:44,212][106225] Updated weights for policy 1, policy_version 1863658 (0.0006) [2023-12-28 08:37:44,220][106226] Updated weights for policy 0, policy_version 1859824 (0.0007) [2023-12-28 08:37:44,261][106225] Updated weights for policy 1, policy_version 1863668 (0.0007) [2023-12-28 08:37:44,283][106226] Updated weights for policy 0, policy_version 1859834 (0.0005) [2023-12-28 08:37:44,319][106225] Updated weights for policy 1, policy_version 1863678 (0.0005) [2023-12-28 08:37:44,354][106226] Updated weights for policy 0, policy_version 1859844 (0.0006) [2023-12-28 08:37:44,995][106225] Updated weights for policy 1, policy_version 1863688 (0.0009) [2023-12-28 08:37:45,041][106226] Updated weights for policy 0, policy_version 1859854 (0.0007) [2023-12-28 08:37:45,055][106225] Updated weights for policy 1, policy_version 1863698 (0.0008) [2023-12-28 08:37:45,106][106226] Updated weights for policy 0, policy_version 1859864 (0.0010) [2023-12-28 08:37:45,112][106225] Updated weights for policy 1, policy_version 1863708 (0.0006) [2023-12-28 08:37:45,162][106226] Updated weights for policy 0, policy_version 1859874 (0.0011) [2023-12-28 08:37:45,827][106225] Updated weights for policy 1, policy_version 1863718 (0.0005) [2023-12-28 08:37:45,846][106226] Updated weights for policy 0, policy_version 1859884 (0.0011) [2023-12-28 08:37:45,887][106225] Updated weights for policy 1, policy_version 1863728 (0.0005) [2023-12-28 08:37:45,896][106226] Updated weights for policy 0, policy_version 1859894 (0.0010) [2023-12-28 08:37:45,936][106225] Updated weights for policy 1, policy_version 1863738 (0.0006) [2023-12-28 08:37:45,953][106226] Updated weights for policy 0, policy_version 1859904 (0.0007) [2023-12-28 08:37:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 953393152. Throughput: 0: 9802.6, 1: 9923.6. Samples: 953377704. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:46,176][105115] Avg episode reward: [(0, '-4.328'), (1, '-4.900')] [2023-12-28 08:37:46,586][106226] Updated weights for policy 0, policy_version 1859914 (0.0007) [2023-12-28 08:37:46,633][106225] Updated weights for policy 1, policy_version 1863748 (0.0008) [2023-12-28 08:37:46,646][106226] Updated weights for policy 0, policy_version 1859924 (0.0009) [2023-12-28 08:37:46,699][106225] Updated weights for policy 1, policy_version 1863758 (0.0005) [2023-12-28 08:37:46,707][106226] Updated weights for policy 0, policy_version 1859934 (0.0010) [2023-12-28 08:37:46,756][106225] Updated weights for policy 1, policy_version 1863768 (0.0005) [2023-12-28 08:37:46,767][106226] Updated weights for policy 0, policy_version 1859944 (0.0011) [2023-12-28 08:37:47,390][106225] Updated weights for policy 1, policy_version 1863778 (0.0006) [2023-12-28 08:37:47,452][106225] Updated weights for policy 1, policy_version 1863788 (0.0006) [2023-12-28 08:37:47,462][106226] Updated weights for policy 0, policy_version 1859954 (0.0011) [2023-12-28 08:37:47,499][106225] Updated weights for policy 1, policy_version 1863798 (0.0005) [2023-12-28 08:37:47,509][106226] Updated weights for policy 0, policy_version 1859964 (0.0010) [2023-12-28 08:37:47,547][106225] Updated weights for policy 1, policy_version 1863808 (0.0005) [2023-12-28 08:37:47,563][106226] Updated weights for policy 0, policy_version 1859974 (0.0010) [2023-12-28 08:37:48,158][106225] Updated weights for policy 1, policy_version 1863818 (0.0008) [2023-12-28 08:37:48,215][106225] Updated weights for policy 1, policy_version 1863828 (0.0008) [2023-12-28 08:37:48,273][106225] Updated weights for policy 1, policy_version 1863838 (0.0009) [2023-12-28 08:37:48,275][106226] Updated weights for policy 0, policy_version 1859984 (0.0006) [2023-12-28 08:37:48,338][106226] Updated weights for policy 0, policy_version 1859994 (0.0006) [2023-12-28 08:37:48,400][106226] Updated weights for policy 0, policy_version 1860004 (0.0009) [2023-12-28 08:37:49,027][106225] Updated weights for policy 1, policy_version 1863848 (0.0006) [2023-12-28 08:37:49,094][106225] Updated weights for policy 1, policy_version 1863858 (0.0005) [2023-12-28 08:37:49,095][106226] Updated weights for policy 0, policy_version 1860014 (0.0011) [2023-12-28 08:37:49,152][106225] Updated weights for policy 1, policy_version 1863868 (0.0009) [2023-12-28 08:37:49,160][106226] Updated weights for policy 0, policy_version 1860024 (0.0011) [2023-12-28 08:37:49,230][106226] Updated weights for policy 0, policy_version 1860034 (0.0010) [2023-12-28 08:37:49,769][106225] Updated weights for policy 1, policy_version 1863878 (0.0007) [2023-12-28 08:37:49,821][106225] Updated weights for policy 1, policy_version 1863888 (0.0008) [2023-12-28 08:37:49,888][106225] Updated weights for policy 1, policy_version 1863898 (0.0008) [2023-12-28 08:37:49,893][106226] Updated weights for policy 0, policy_version 1860044 (0.0007) [2023-12-28 08:37:49,977][106226] Updated weights for policy 0, policy_version 1860054 (0.0007) [2023-12-28 08:37:50,038][106226] Updated weights for policy 0, policy_version 1860064 (0.0009) [2023-12-28 08:37:50,698][106225] Updated weights for policy 1, policy_version 1863908 (0.0008) [2023-12-28 08:37:50,706][106226] Updated weights for policy 0, policy_version 1860074 (0.0008) [2023-12-28 08:37:50,759][106225] Updated weights for policy 1, policy_version 1863918 (0.0007) [2023-12-28 08:37:50,774][106226] Updated weights for policy 0, policy_version 1860084 (0.0006) [2023-12-28 08:37:50,818][106225] Updated weights for policy 1, policy_version 1863928 (0.0007) [2023-12-28 08:37:50,840][106226] Updated weights for policy 0, policy_version 1860094 (0.0006) [2023-12-28 08:37:50,906][106226] Updated weights for policy 0, policy_version 1860104 (0.0006) [2023-12-28 08:37:51,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 953491456. Throughput: 0: 9759.5, 1: 9823.5. Samples: 953498400. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:51,175][105115] Avg episode reward: [(0, '-4.367'), (1, '-4.405')] [2023-12-28 08:37:51,594][106226] Updated weights for policy 0, policy_version 1860114 (0.0009) [2023-12-28 08:37:51,634][106225] Updated weights for policy 1, policy_version 1863938 (0.0008) [2023-12-28 08:37:51,666][106226] Updated weights for policy 0, policy_version 1860125 (0.0012) [2023-12-28 08:37:51,699][106225] Updated weights for policy 1, policy_version 1863948 (0.0008) [2023-12-28 08:37:51,728][106226] Updated weights for policy 0, policy_version 1860135 (0.0011) [2023-12-28 08:37:51,768][106225] Updated weights for policy 1, policy_version 1863958 (0.0011) [2023-12-28 08:37:51,832][106225] Updated weights for policy 1, policy_version 1863968 (0.0006) [2023-12-28 08:37:52,423][106226] Updated weights for policy 0, policy_version 1860145 (0.0011) [2023-12-28 08:37:52,480][106226] Updated weights for policy 0, policy_version 1860155 (0.0011) [2023-12-28 08:37:52,537][106226] Updated weights for policy 0, policy_version 1860165 (0.0010) [2023-12-28 08:37:52,596][106225] Updated weights for policy 1, policy_version 1863978 (0.0006) [2023-12-28 08:37:52,668][106225] Updated weights for policy 1, policy_version 1863988 (0.0008) [2023-12-28 08:37:52,738][106225] Updated weights for policy 1, policy_version 1863998 (0.0009) [2023-12-28 08:37:53,267][106226] Updated weights for policy 0, policy_version 1860175 (0.0010) [2023-12-28 08:37:53,326][106225] Updated weights for policy 1, policy_version 1864008 (0.0006) [2023-12-28 08:37:53,327][106226] Updated weights for policy 0, policy_version 1860185 (0.0010) [2023-12-28 08:37:53,381][106225] Updated weights for policy 1, policy_version 1864018 (0.0009) [2023-12-28 08:37:53,383][106226] Updated weights for policy 0, policy_version 1860195 (0.0010) [2023-12-28 08:37:53,433][106225] Updated weights for policy 1, policy_version 1864028 (0.0007) [2023-12-28 08:37:54,078][106226] Updated weights for policy 0, policy_version 1860205 (0.0010) [2023-12-28 08:37:54,136][106226] Updated weights for policy 0, policy_version 1860215 (0.0009) [2023-12-28 08:37:54,178][106225] Updated weights for policy 1, policy_version 1864038 (0.0008) [2023-12-28 08:37:54,193][106226] Updated weights for policy 0, policy_version 1860225 (0.0009) [2023-12-28 08:37:54,233][106225] Updated weights for policy 1, policy_version 1864048 (0.0010) [2023-12-28 08:37:54,299][106225] Updated weights for policy 1, policy_version 1864058 (0.0005) [2023-12-28 08:37:54,919][106226] Updated weights for policy 0, policy_version 1860235 (0.0009) [2023-12-28 08:37:54,958][106225] Updated weights for policy 1, policy_version 1864068 (0.0005) [2023-12-28 08:37:54,983][106226] Updated weights for policy 0, policy_version 1860245 (0.0008) [2023-12-28 08:37:55,010][106225] Updated weights for policy 1, policy_version 1864078 (0.0008) [2023-12-28 08:37:55,050][106226] Updated weights for policy 0, policy_version 1860255 (0.0010) [2023-12-28 08:37:55,061][106225] Updated weights for policy 1, policy_version 1864088 (0.0007) [2023-12-28 08:37:55,711][106226] Updated weights for policy 0, policy_version 1860265 (0.0008) [2023-12-28 08:37:55,775][106226] Updated weights for policy 0, policy_version 1860275 (0.0007) [2023-12-28 08:37:55,784][106225] Updated weights for policy 1, policy_version 1864098 (0.0006) [2023-12-28 08:37:55,836][106226] Updated weights for policy 0, policy_version 1860285 (0.0007) [2023-12-28 08:37:55,842][106225] Updated weights for policy 1, policy_version 1864108 (0.0006) [2023-12-28 08:37:55,884][106226] Updated weights for policy 0, policy_version 1860295 (0.0006) [2023-12-28 08:37:55,893][106225] Updated weights for policy 1, policy_version 1864118 (0.0006) [2023-12-28 08:37:55,944][106225] Updated weights for policy 1, policy_version 1864128 (0.0008) [2023-12-28 08:37:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 953589760. Throughput: 0: 9776.9, 1: 9772.1. Samples: 953556012. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:37:56,176][105115] Avg episode reward: [(0, '-4.600'), (1, '-4.757')] [2023-12-28 08:37:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001864128_477274112.pth... [2023-12-28 08:37:56,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001860296_476315648.pth... [2023-12-28 08:37:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001862976_476979200.pth [2023-12-28 08:37:56,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001859144_476020736.pth [2023-12-28 08:37:56,526][106226] Updated weights for policy 0, policy_version 1860305 (0.0006) [2023-12-28 08:37:56,581][106226] Updated weights for policy 0, policy_version 1860315 (0.0005) [2023-12-28 08:37:56,620][106225] Updated weights for policy 1, policy_version 1864138 (0.0007) [2023-12-28 08:37:56,637][106226] Updated weights for policy 0, policy_version 1860325 (0.0007) [2023-12-28 08:37:56,672][106225] Updated weights for policy 1, policy_version 1864148 (0.0005) [2023-12-28 08:37:56,728][106225] Updated weights for policy 1, policy_version 1864158 (0.0007) [2023-12-28 08:37:57,261][106226] Updated weights for policy 0, policy_version 1860335 (0.0009) [2023-12-28 08:37:57,316][106226] Updated weights for policy 0, policy_version 1860345 (0.0008) [2023-12-28 08:37:57,359][106225] Updated weights for policy 1, policy_version 1864168 (0.0007) [2023-12-28 08:37:57,373][106226] Updated weights for policy 0, policy_version 1860355 (0.0008) [2023-12-28 08:37:57,405][106225] Updated weights for policy 1, policy_version 1864178 (0.0005) [2023-12-28 08:37:57,455][106225] Updated weights for policy 1, policy_version 1864188 (0.0005) [2023-12-28 08:37:58,109][106225] Updated weights for policy 1, policy_version 1864198 (0.0008) [2023-12-28 08:37:58,118][106226] Updated weights for policy 0, policy_version 1860365 (0.0009) [2023-12-28 08:37:58,155][106225] Updated weights for policy 1, policy_version 1864208 (0.0006) [2023-12-28 08:37:58,169][106226] Updated weights for policy 0, policy_version 1860375 (0.0008) [2023-12-28 08:37:58,209][106225] Updated weights for policy 1, policy_version 1864218 (0.0006) [2023-12-28 08:37:58,230][106226] Updated weights for policy 0, policy_version 1860385 (0.0007) [2023-12-28 08:37:59,038][106225] Updated weights for policy 1, policy_version 1864228 (0.0007) [2023-12-28 08:37:59,060][106226] Updated weights for policy 0, policy_version 1860395 (0.0009) [2023-12-28 08:37:59,098][106225] Updated weights for policy 1, policy_version 1864238 (0.0007) [2023-12-28 08:37:59,118][106226] Updated weights for policy 0, policy_version 1860405 (0.0007) [2023-12-28 08:37:59,147][106225] Updated weights for policy 1, policy_version 1864248 (0.0005) [2023-12-28 08:37:59,181][106226] Updated weights for policy 0, policy_version 1860415 (0.0007) [2023-12-28 08:37:59,936][106226] Updated weights for policy 0, policy_version 1860425 (0.0008) [2023-12-28 08:37:59,936][106225] Updated weights for policy 1, policy_version 1864258 (0.0008) [2023-12-28 08:37:59,991][106225] Updated weights for policy 1, policy_version 1864268 (0.0009) [2023-12-28 08:37:59,993][106226] Updated weights for policy 0, policy_version 1860435 (0.0007) [2023-12-28 08:38:00,055][106226] Updated weights for policy 0, policy_version 1860445 (0.0007) [2023-12-28 08:38:00,057][106225] Updated weights for policy 1, policy_version 1864278 (0.0007) [2023-12-28 08:38:00,106][106226] Updated weights for policy 0, policy_version 1860455 (0.0006) [2023-12-28 08:38:00,119][106225] Updated weights for policy 1, policy_version 1864288 (0.0008) [2023-12-28 08:38:00,830][106226] Updated weights for policy 0, policy_version 1860465 (0.0009) [2023-12-28 08:38:00,843][106225] Updated weights for policy 1, policy_version 1864298 (0.0010) [2023-12-28 08:38:00,892][106226] Updated weights for policy 0, policy_version 1860475 (0.0008) [2023-12-28 08:38:00,894][106225] Updated weights for policy 1, policy_version 1864308 (0.0005) [2023-12-28 08:38:00,945][106225] Updated weights for policy 1, policy_version 1864318 (0.0005) [2023-12-28 08:38:00,960][106226] Updated weights for policy 0, policy_version 1860485 (0.0008) [2023-12-28 08:38:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 953688064. Throughput: 0: 9802.2, 1: 9805.6. Samples: 953675064. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:01,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.814')] [2023-12-28 08:38:01,635][106225] Updated weights for policy 1, policy_version 1864328 (0.0009) [2023-12-28 08:38:01,693][106225] Updated weights for policy 1, policy_version 1864338 (0.0008) [2023-12-28 08:38:01,700][106226] Updated weights for policy 0, policy_version 1860495 (0.0008) [2023-12-28 08:38:01,759][106225] Updated weights for policy 1, policy_version 1864348 (0.0009) [2023-12-28 08:38:01,766][106226] Updated weights for policy 0, policy_version 1860505 (0.0008) [2023-12-28 08:38:01,833][106226] Updated weights for policy 0, policy_version 1860515 (0.0008) [2023-12-28 08:38:02,431][106225] Updated weights for policy 1, policy_version 1864358 (0.0009) [2023-12-28 08:38:02,490][106225] Updated weights for policy 1, policy_version 1864368 (0.0008) [2023-12-28 08:38:02,547][106225] Updated weights for policy 1, policy_version 1864378 (0.0008) [2023-12-28 08:38:02,594][106226] Updated weights for policy 0, policy_version 1860525 (0.0007) [2023-12-28 08:38:02,653][106226] Updated weights for policy 0, policy_version 1860535 (0.0008) [2023-12-28 08:38:02,705][106226] Updated weights for policy 0, policy_version 1860545 (0.0008) [2023-12-28 08:38:03,184][106225] Updated weights for policy 1, policy_version 1864388 (0.0006) [2023-12-28 08:38:03,240][106225] Updated weights for policy 1, policy_version 1864398 (0.0006) [2023-12-28 08:38:03,297][106225] Updated weights for policy 1, policy_version 1864408 (0.0008) [2023-12-28 08:38:03,514][106226] Updated weights for policy 0, policy_version 1860555 (0.0009) [2023-12-28 08:38:03,565][106226] Updated weights for policy 0, policy_version 1860565 (0.0008) [2023-12-28 08:38:03,615][106226] Updated weights for policy 0, policy_version 1860575 (0.0007) [2023-12-28 08:38:03,855][106225] Updated weights for policy 1, policy_version 1864418 (0.0007) [2023-12-28 08:38:03,908][106225] Updated weights for policy 1, policy_version 1864428 (0.0006) [2023-12-28 08:38:03,962][106225] Updated weights for policy 1, policy_version 1864438 (0.0006) [2023-12-28 08:38:04,026][106225] Updated weights for policy 1, policy_version 1864448 (0.0006) [2023-12-28 08:38:04,280][106226] Updated weights for policy 0, policy_version 1860585 (0.0008) [2023-12-28 08:38:04,344][106226] Updated weights for policy 0, policy_version 1860595 (0.0009) [2023-12-28 08:38:04,409][106226] Updated weights for policy 0, policy_version 1860605 (0.0008) [2023-12-28 08:38:04,473][106226] Updated weights for policy 0, policy_version 1860615 (0.0008) [2023-12-28 08:38:04,684][106225] Updated weights for policy 1, policy_version 1864458 (0.0009) [2023-12-28 08:38:04,746][106225] Updated weights for policy 1, policy_version 1864468 (0.0008) [2023-12-28 08:38:04,811][106225] Updated weights for policy 1, policy_version 1864478 (0.0008) [2023-12-28 08:38:05,149][106226] Updated weights for policy 0, policy_version 1860625 (0.0006) [2023-12-28 08:38:05,212][106226] Updated weights for policy 0, policy_version 1860635 (0.0009) [2023-12-28 08:38:05,272][106226] Updated weights for policy 0, policy_version 1860645 (0.0006) [2023-12-28 08:38:05,588][106225] Updated weights for policy 1, policy_version 1864488 (0.0007) [2023-12-28 08:38:05,634][106225] Updated weights for policy 1, policy_version 1864498 (0.0006) [2023-12-28 08:38:05,698][106225] Updated weights for policy 1, policy_version 1864508 (0.0007) [2023-12-28 08:38:05,806][106226] Updated weights for policy 0, policy_version 1860655 (0.0007) [2023-12-28 08:38:05,856][106226] Updated weights for policy 0, policy_version 1860665 (0.0005) [2023-12-28 08:38:05,912][106226] Updated weights for policy 0, policy_version 1860675 (0.0006) [2023-12-28 08:38:06,175][105115] Fps is (10 sec: 19661.3, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 953786368. Throughput: 0: 9791.5, 1: 9886.2. Samples: 953794508. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:06,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.480')] [2023-12-28 08:38:06,378][106225] Updated weights for policy 1, policy_version 1864518 (0.0010) [2023-12-28 08:38:06,442][106225] Updated weights for policy 1, policy_version 1864528 (0.0010) [2023-12-28 08:38:06,498][106225] Updated weights for policy 1, policy_version 1864538 (0.0011) [2023-12-28 08:38:06,664][106226] Updated weights for policy 0, policy_version 1860685 (0.0008) [2023-12-28 08:38:06,713][106226] Updated weights for policy 0, policy_version 1860695 (0.0005) [2023-12-28 08:38:06,771][106226] Updated weights for policy 0, policy_version 1860705 (0.0006) [2023-12-28 08:38:07,263][106225] Updated weights for policy 1, policy_version 1864548 (0.0008) [2023-12-28 08:38:07,321][106225] Updated weights for policy 1, policy_version 1864558 (0.0006) [2023-12-28 08:38:07,376][106225] Updated weights for policy 1, policy_version 1864568 (0.0006) [2023-12-28 08:38:07,411][106226] Updated weights for policy 0, policy_version 1860715 (0.0008) [2023-12-28 08:38:07,471][106226] Updated weights for policy 0, policy_version 1860725 (0.0010) [2023-12-28 08:38:07,530][106226] Updated weights for policy 0, policy_version 1860735 (0.0009) [2023-12-28 08:38:07,938][106225] Updated weights for policy 1, policy_version 1864578 (0.0006) [2023-12-28 08:38:07,991][106225] Updated weights for policy 1, policy_version 1864588 (0.0005) [2023-12-28 08:38:08,040][106225] Updated weights for policy 1, policy_version 1864598 (0.0010) [2023-12-28 08:38:08,100][106225] Updated weights for policy 1, policy_version 1864608 (0.0010) [2023-12-28 08:38:08,164][106226] Updated weights for policy 0, policy_version 1860745 (0.0006) [2023-12-28 08:38:08,214][106226] Updated weights for policy 0, policy_version 1860755 (0.0006) [2023-12-28 08:38:08,268][106226] Updated weights for policy 0, policy_version 1860765 (0.0005) [2023-12-28 08:38:08,340][106226] Updated weights for policy 0, policy_version 1860775 (0.0006) [2023-12-28 08:38:08,802][106225] Updated weights for policy 1, policy_version 1864618 (0.0010) [2023-12-28 08:38:08,869][106225] Updated weights for policy 1, policy_version 1864628 (0.0010) [2023-12-28 08:38:08,932][106225] Updated weights for policy 1, policy_version 1864638 (0.0010) [2023-12-28 08:38:08,990][106226] Updated weights for policy 0, policy_version 1860785 (0.0005) [2023-12-28 08:38:09,049][106226] Updated weights for policy 0, policy_version 1860795 (0.0005) [2023-12-28 08:38:09,120][106226] Updated weights for policy 0, policy_version 1860805 (0.0006) [2023-12-28 08:38:09,618][106225] Updated weights for policy 1, policy_version 1864648 (0.0006) [2023-12-28 08:38:09,687][106225] Updated weights for policy 1, policy_version 1864658 (0.0006) [2023-12-28 08:38:09,693][106226] Updated weights for policy 0, policy_version 1860815 (0.0007) [2023-12-28 08:38:09,753][106225] Updated weights for policy 1, policy_version 1864668 (0.0006) [2023-12-28 08:38:09,762][106226] Updated weights for policy 0, policy_version 1860825 (0.0009) [2023-12-28 08:38:09,831][106226] Updated weights for policy 0, policy_version 1860835 (0.0008) [2023-12-28 08:38:10,439][106225] Updated weights for policy 1, policy_version 1864678 (0.0008) [2023-12-28 08:38:10,502][106225] Updated weights for policy 1, policy_version 1864688 (0.0009) [2023-12-28 08:38:10,566][106225] Updated weights for policy 1, policy_version 1864698 (0.0009) [2023-12-28 08:38:10,626][106226] Updated weights for policy 0, policy_version 1860845 (0.0008) [2023-12-28 08:38:10,683][106226] Updated weights for policy 0, policy_version 1860855 (0.0008) [2023-12-28 08:38:10,736][106226] Updated weights for policy 0, policy_version 1860865 (0.0008) [2023-12-28 08:38:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 953884672. Throughput: 0: 9866.4, 1: 9956.1. Samples: 953857564. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:11,175][105115] Avg episode reward: [(0, '-4.671'), (1, '-4.686')] [2023-12-28 08:38:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001864704_477421568.pth... [2023-12-28 08:38:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001860872_476463104.pth... [2023-12-28 08:38:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001859720_476168192.pth [2023-12-28 08:38:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001863552_477126656.pth [2023-12-28 08:38:11,268][106225] Updated weights for policy 1, policy_version 1864708 (0.0010) [2023-12-28 08:38:11,327][106225] Updated weights for policy 1, policy_version 1864718 (0.0010) [2023-12-28 08:38:11,399][106225] Updated weights for policy 1, policy_version 1864728 (0.0009) [2023-12-28 08:38:11,566][106226] Updated weights for policy 0, policy_version 1860875 (0.0007) [2023-12-28 08:38:11,626][106226] Updated weights for policy 0, policy_version 1860885 (0.0009) [2023-12-28 08:38:11,692][106226] Updated weights for policy 0, policy_version 1860895 (0.0009) [2023-12-28 08:38:12,089][106225] Updated weights for policy 1, policy_version 1864738 (0.0009) [2023-12-28 08:38:12,142][106225] Updated weights for policy 1, policy_version 1864748 (0.0008) [2023-12-28 08:38:12,198][106225] Updated weights for policy 1, policy_version 1864758 (0.0008) [2023-12-28 08:38:12,252][106225] Updated weights for policy 1, policy_version 1864768 (0.0009) [2023-12-28 08:38:12,443][106226] Updated weights for policy 0, policy_version 1860905 (0.0009) [2023-12-28 08:38:12,510][106226] Updated weights for policy 0, policy_version 1860915 (0.0009) [2023-12-28 08:38:12,577][106226] Updated weights for policy 0, policy_version 1860925 (0.0006) [2023-12-28 08:38:12,645][106226] Updated weights for policy 0, policy_version 1860935 (0.0006) [2023-12-28 08:38:12,991][106225] Updated weights for policy 1, policy_version 1864778 (0.0006) [2023-12-28 08:38:13,059][106225] Updated weights for policy 1, policy_version 1864788 (0.0009) [2023-12-28 08:38:13,120][106225] Updated weights for policy 1, policy_version 1864798 (0.0008) [2023-12-28 08:38:13,275][106226] Updated weights for policy 0, policy_version 1860945 (0.0005) [2023-12-28 08:38:13,348][106226] Updated weights for policy 0, policy_version 1860955 (0.0007) [2023-12-28 08:38:13,405][106226] Updated weights for policy 0, policy_version 1860965 (0.0008) [2023-12-28 08:38:13,694][106225] Updated weights for policy 1, policy_version 1864808 (0.0006) [2023-12-28 08:38:13,752][106225] Updated weights for policy 1, policy_version 1864818 (0.0005) [2023-12-28 08:38:13,811][106225] Updated weights for policy 1, policy_version 1864828 (0.0005) [2023-12-28 08:38:13,923][106226] Updated weights for policy 0, policy_version 1860975 (0.0005) [2023-12-28 08:38:13,973][106226] Updated weights for policy 0, policy_version 1860985 (0.0006) [2023-12-28 08:38:14,030][106226] Updated weights for policy 0, policy_version 1860995 (0.0010) [2023-12-28 08:38:14,424][106225] Updated weights for policy 1, policy_version 1864838 (0.0005) [2023-12-28 08:38:14,483][106225] Updated weights for policy 1, policy_version 1864848 (0.0005) [2023-12-28 08:38:14,544][106225] Updated weights for policy 1, policy_version 1864858 (0.0005) [2023-12-28 08:38:14,691][106226] Updated weights for policy 0, policy_version 1861005 (0.0009) [2023-12-28 08:38:14,760][106226] Updated weights for policy 0, policy_version 1861015 (0.0006) [2023-12-28 08:38:14,830][106226] Updated weights for policy 0, policy_version 1861025 (0.0009) [2023-12-28 08:38:15,236][106225] Updated weights for policy 1, policy_version 1864868 (0.0009) [2023-12-28 08:38:15,302][106225] Updated weights for policy 1, policy_version 1864878 (0.0010) [2023-12-28 08:38:15,369][106225] Updated weights for policy 1, policy_version 1864888 (0.0010) [2023-12-28 08:38:15,465][106226] Updated weights for policy 0, policy_version 1861035 (0.0011) [2023-12-28 08:38:15,522][106226] Updated weights for policy 0, policy_version 1861045 (0.0010) [2023-12-28 08:38:15,581][106226] Updated weights for policy 0, policy_version 1861055 (0.0007) [2023-12-28 08:38:16,055][106225] Updated weights for policy 1, policy_version 1864898 (0.0009) [2023-12-28 08:38:16,112][106225] Updated weights for policy 1, policy_version 1864908 (0.0006) [2023-12-28 08:38:16,161][106225] Updated weights for policy 1, policy_version 1864918 (0.0008) [2023-12-28 08:38:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 953982976. Throughput: 0: 9869.3, 1: 10042.4. Samples: 953978568. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:16,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.851')] [2023-12-28 08:38:16,211][106226] Updated weights for policy 0, policy_version 1861065 (0.0007) [2023-12-28 08:38:16,213][106225] Updated weights for policy 1, policy_version 1864928 (0.0008) [2023-12-28 08:38:16,279][106226] Updated weights for policy 0, policy_version 1861075 (0.0006) [2023-12-28 08:38:16,341][106226] Updated weights for policy 0, policy_version 1861085 (0.0006) [2023-12-28 08:38:16,399][106226] Updated weights for policy 0, policy_version 1861095 (0.0006) [2023-12-28 08:38:16,854][106225] Updated weights for policy 1, policy_version 1864938 (0.0005) [2023-12-28 08:38:16,905][106225] Updated weights for policy 1, policy_version 1864948 (0.0005) [2023-12-28 08:38:16,954][106225] Updated weights for policy 1, policy_version 1864958 (0.0005) [2023-12-28 08:38:17,109][106226] Updated weights for policy 0, policy_version 1861105 (0.0008) [2023-12-28 08:38:17,159][106226] Updated weights for policy 0, policy_version 1861115 (0.0010) [2023-12-28 08:38:17,211][106226] Updated weights for policy 0, policy_version 1861125 (0.0008) [2023-12-28 08:38:17,580][106225] Updated weights for policy 1, policy_version 1864968 (0.0009) [2023-12-28 08:38:17,642][106225] Updated weights for policy 1, policy_version 1864978 (0.0011) [2023-12-28 08:38:17,704][106225] Updated weights for policy 1, policy_version 1864988 (0.0010) [2023-12-28 08:38:17,921][106226] Updated weights for policy 0, policy_version 1861135 (0.0008) [2023-12-28 08:38:17,970][106226] Updated weights for policy 0, policy_version 1861145 (0.0007) [2023-12-28 08:38:18,025][106226] Updated weights for policy 0, policy_version 1861155 (0.0006) [2023-12-28 08:38:18,413][106225] Updated weights for policy 1, policy_version 1864998 (0.0010) [2023-12-28 08:38:18,466][106225] Updated weights for policy 1, policy_version 1865008 (0.0006) [2023-12-28 08:38:18,523][106225] Updated weights for policy 1, policy_version 1865018 (0.0005) [2023-12-28 08:38:18,768][106226] Updated weights for policy 0, policy_version 1861165 (0.0008) [2023-12-28 08:38:18,828][106226] Updated weights for policy 0, policy_version 1861175 (0.0008) [2023-12-28 08:38:18,888][106226] Updated weights for policy 0, policy_version 1861185 (0.0007) [2023-12-28 08:38:19,215][106225] Updated weights for policy 1, policy_version 1865028 (0.0007) [2023-12-28 08:38:19,285][106225] Updated weights for policy 1, policy_version 1865038 (0.0011) [2023-12-28 08:38:19,345][106225] Updated weights for policy 1, policy_version 1865048 (0.0010) [2023-12-28 08:38:19,624][106226] Updated weights for policy 0, policy_version 1861195 (0.0007) [2023-12-28 08:38:19,691][106226] Updated weights for policy 0, policy_version 1861205 (0.0005) [2023-12-28 08:38:19,760][106226] Updated weights for policy 0, policy_version 1861215 (0.0006) [2023-12-28 08:38:20,059][106225] Updated weights for policy 1, policy_version 1865058 (0.0010) [2023-12-28 08:38:20,129][106225] Updated weights for policy 1, policy_version 1865068 (0.0006) [2023-12-28 08:38:20,195][106225] Updated weights for policy 1, policy_version 1865078 (0.0006) [2023-12-28 08:38:20,257][106225] Updated weights for policy 1, policy_version 1865088 (0.0007) [2023-12-28 08:38:20,435][106226] Updated weights for policy 0, policy_version 1861225 (0.0007) [2023-12-28 08:38:20,498][106226] Updated weights for policy 0, policy_version 1861235 (0.0009) [2023-12-28 08:38:20,558][106226] Updated weights for policy 0, policy_version 1861245 (0.0008) [2023-12-28 08:38:20,631][106226] Updated weights for policy 0, policy_version 1861255 (0.0009) [2023-12-28 08:38:20,915][106225] Updated weights for policy 1, policy_version 1865098 (0.0009) [2023-12-28 08:38:20,978][106225] Updated weights for policy 1, policy_version 1865108 (0.0008) [2023-12-28 08:38:21,044][106225] Updated weights for policy 1, policy_version 1865118 (0.0007) [2023-12-28 08:38:21,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 954089472. Throughput: 0: 9850.6, 1: 10083.0. Samples: 954097332. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:21,175][105115] Avg episode reward: [(0, '-4.260'), (1, '-4.585')] [2023-12-28 08:38:21,413][106226] Updated weights for policy 0, policy_version 1861265 (0.0009) [2023-12-28 08:38:21,470][106226] Updated weights for policy 0, policy_version 1861275 (0.0008) [2023-12-28 08:38:21,533][106226] Updated weights for policy 0, policy_version 1861285 (0.0008) [2023-12-28 08:38:21,847][106225] Updated weights for policy 1, policy_version 1865128 (0.0008) [2023-12-28 08:38:21,907][106225] Updated weights for policy 1, policy_version 1865138 (0.0010) [2023-12-28 08:38:21,971][106225] Updated weights for policy 1, policy_version 1865148 (0.0010) [2023-12-28 08:38:22,286][106226] Updated weights for policy 0, policy_version 1861295 (0.0008) [2023-12-28 08:38:22,352][106226] Updated weights for policy 0, policy_version 1861305 (0.0009) [2023-12-28 08:38:22,416][106226] Updated weights for policy 0, policy_version 1861315 (0.0009) [2023-12-28 08:38:22,770][106225] Updated weights for policy 1, policy_version 1865158 (0.0010) [2023-12-28 08:38:22,834][106225] Updated weights for policy 1, policy_version 1865168 (0.0010) [2023-12-28 08:38:22,892][106225] Updated weights for policy 1, policy_version 1865178 (0.0011) [2023-12-28 08:38:23,066][106226] Updated weights for policy 0, policy_version 1861325 (0.0008) [2023-12-28 08:38:23,124][106226] Updated weights for policy 0, policy_version 1861335 (0.0008) [2023-12-28 08:38:23,183][106226] Updated weights for policy 0, policy_version 1861345 (0.0008) [2023-12-28 08:38:23,611][106225] Updated weights for policy 1, policy_version 1865188 (0.0010) [2023-12-28 08:38:23,669][106225] Updated weights for policy 1, policy_version 1865198 (0.0010) [2023-12-28 08:38:23,737][106225] Updated weights for policy 1, policy_version 1865208 (0.0006) [2023-12-28 08:38:23,930][106226] Updated weights for policy 0, policy_version 1861355 (0.0007) [2023-12-28 08:38:24,001][106226] Updated weights for policy 0, policy_version 1861365 (0.0010) [2023-12-28 08:38:24,061][106226] Updated weights for policy 0, policy_version 1861375 (0.0008) [2023-12-28 08:38:24,387][106225] Updated weights for policy 1, policy_version 1865218 (0.0006) [2023-12-28 08:38:24,447][106225] Updated weights for policy 1, policy_version 1865228 (0.0006) [2023-12-28 08:38:24,517][106225] Updated weights for policy 1, policy_version 1865238 (0.0005) [2023-12-28 08:38:24,576][106225] Updated weights for policy 1, policy_version 1865248 (0.0008) [2023-12-28 08:38:24,783][106226] Updated weights for policy 0, policy_version 1861385 (0.0007) [2023-12-28 08:38:24,849][106226] Updated weights for policy 0, policy_version 1861395 (0.0009) [2023-12-28 08:38:24,918][106226] Updated weights for policy 0, policy_version 1861405 (0.0008) [2023-12-28 08:38:24,968][106226] Updated weights for policy 0, policy_version 1861415 (0.0008) [2023-12-28 08:38:25,187][106225] Updated weights for policy 1, policy_version 1865258 (0.0007) [2023-12-28 08:38:25,239][106225] Updated weights for policy 1, policy_version 1865268 (0.0007) [2023-12-28 08:38:25,305][106225] Updated weights for policy 1, policy_version 1865278 (0.0009) [2023-12-28 08:38:25,635][106226] Updated weights for policy 0, policy_version 1861425 (0.0007) [2023-12-28 08:38:25,688][106226] Updated weights for policy 0, policy_version 1861435 (0.0009) [2023-12-28 08:38:25,749][106226] Updated weights for policy 0, policy_version 1861445 (0.0009) [2023-12-28 08:38:25,974][106225] Updated weights for policy 1, policy_version 1865288 (0.0009) [2023-12-28 08:38:26,026][106225] Updated weights for policy 1, policy_version 1865298 (0.0009) [2023-12-28 08:38:26,074][106225] Updated weights for policy 1, policy_version 1865308 (0.0008) [2023-12-28 08:38:26,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 954187776. Throughput: 0: 9849.7, 1: 10036.5. Samples: 954153204. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:26,176][105115] Avg episode reward: [(0, '-4.394'), (1, '-4.496')] [2023-12-28 08:38:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001865312_477577216.pth... [2023-12-28 08:38:26,185][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001861448_476610560.pth... [2023-12-28 08:38:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001860296_476315648.pth [2023-12-28 08:38:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001864128_477274112.pth [2023-12-28 08:38:26,539][106226] Updated weights for policy 0, policy_version 1861455 (0.0008) [2023-12-28 08:38:26,598][106226] Updated weights for policy 0, policy_version 1861465 (0.0008) [2023-12-28 08:38:26,646][106226] Updated weights for policy 0, policy_version 1861475 (0.0008) [2023-12-28 08:38:26,695][106225] Updated weights for policy 1, policy_version 1865318 (0.0007) [2023-12-28 08:38:26,752][106225] Updated weights for policy 1, policy_version 1865328 (0.0005) [2023-12-28 08:38:26,798][106225] Updated weights for policy 1, policy_version 1865338 (0.0006) [2023-12-28 08:38:27,387][106226] Updated weights for policy 0, policy_version 1861485 (0.0007) [2023-12-28 08:38:27,436][106226] Updated weights for policy 0, policy_version 1861495 (0.0008) [2023-12-28 08:38:27,471][106225] Updated weights for policy 1, policy_version 1865348 (0.0007) [2023-12-28 08:38:27,485][106226] Updated weights for policy 0, policy_version 1861505 (0.0008) [2023-12-28 08:38:27,528][106225] Updated weights for policy 1, policy_version 1865358 (0.0009) [2023-12-28 08:38:27,587][106225] Updated weights for policy 1, policy_version 1865368 (0.0010) [2023-12-28 08:38:28,165][106225] Updated weights for policy 1, policy_version 1865378 (0.0010) [2023-12-28 08:38:28,214][106225] Updated weights for policy 1, policy_version 1865388 (0.0010) [2023-12-28 08:38:28,265][106225] Updated weights for policy 1, policy_version 1865398 (0.0010) [2023-12-28 08:38:28,279][106226] Updated weights for policy 0, policy_version 1861515 (0.0007) [2023-12-28 08:38:28,312][106225] Updated weights for policy 1, policy_version 1865408 (0.0010) [2023-12-28 08:38:28,341][106226] Updated weights for policy 0, policy_version 1861525 (0.0011) [2023-12-28 08:38:28,399][106226] Updated weights for policy 0, policy_version 1861535 (0.0008) [2023-12-28 08:38:28,923][106225] Updated weights for policy 1, policy_version 1865418 (0.0010) [2023-12-28 08:38:28,989][106225] Updated weights for policy 1, policy_version 1865428 (0.0010) [2023-12-28 08:38:29,051][106225] Updated weights for policy 1, policy_version 1865438 (0.0010) [2023-12-28 08:38:29,132][106226] Updated weights for policy 0, policy_version 1861545 (0.0008) [2023-12-28 08:38:29,191][106226] Updated weights for policy 0, policy_version 1861555 (0.0010) [2023-12-28 08:38:29,256][106226] Updated weights for policy 0, policy_version 1861565 (0.0010) [2023-12-28 08:38:29,317][106226] Updated weights for policy 0, policy_version 1861575 (0.0008) [2023-12-28 08:38:29,684][106225] Updated weights for policy 1, policy_version 1865448 (0.0006) [2023-12-28 08:38:29,736][106225] Updated weights for policy 1, policy_version 1865458 (0.0007) [2023-12-28 08:38:29,794][106225] Updated weights for policy 1, policy_version 1865468 (0.0006) [2023-12-28 08:38:30,131][106226] Updated weights for policy 0, policy_version 1861585 (0.0007) [2023-12-28 08:38:30,188][106226] Updated weights for policy 0, policy_version 1861595 (0.0008) [2023-12-28 08:38:30,242][106226] Updated weights for policy 0, policy_version 1861605 (0.0008) [2023-12-28 08:38:30,506][106225] Updated weights for policy 1, policy_version 1865478 (0.0008) [2023-12-28 08:38:30,568][106225] Updated weights for policy 1, policy_version 1865488 (0.0007) [2023-12-28 08:38:30,638][106225] Updated weights for policy 1, policy_version 1865498 (0.0005) [2023-12-28 08:38:30,971][106226] Updated weights for policy 0, policy_version 1861615 (0.0006) [2023-12-28 08:38:31,026][106226] Updated weights for policy 0, policy_version 1861625 (0.0006) [2023-12-28 08:38:31,095][106226] Updated weights for policy 0, policy_version 1861635 (0.0008) [2023-12-28 08:38:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 954286080. Throughput: 0: 9822.0, 1: 10107.5. Samples: 954274528. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:31,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-4.588')] [2023-12-28 08:38:31,269][106225] Updated weights for policy 1, policy_version 1865508 (0.0008) [2023-12-28 08:38:31,317][106225] Updated weights for policy 1, policy_version 1865518 (0.0009) [2023-12-28 08:38:31,381][106225] Updated weights for policy 1, policy_version 1865528 (0.0009) [2023-12-28 08:38:31,812][106226] Updated weights for policy 0, policy_version 1861645 (0.0008) [2023-12-28 08:38:31,875][106226] Updated weights for policy 0, policy_version 1861655 (0.0008) [2023-12-28 08:38:31,935][106226] Updated weights for policy 0, policy_version 1861665 (0.0009) [2023-12-28 08:38:32,157][106225] Updated weights for policy 1, policy_version 1865538 (0.0007) [2023-12-28 08:38:32,219][106225] Updated weights for policy 1, policy_version 1865548 (0.0009) [2023-12-28 08:38:32,283][106225] Updated weights for policy 1, policy_version 1865558 (0.0008) [2023-12-28 08:38:32,338][106225] Updated weights for policy 1, policy_version 1865568 (0.0008) [2023-12-28 08:38:32,632][106226] Updated weights for policy 0, policy_version 1861675 (0.0008) [2023-12-28 08:38:32,684][106226] Updated weights for policy 0, policy_version 1861685 (0.0007) [2023-12-28 08:38:32,768][106226] Updated weights for policy 0, policy_version 1861695 (0.0007) [2023-12-28 08:38:33,122][106225] Updated weights for policy 1, policy_version 1865578 (0.0008) [2023-12-28 08:38:33,179][106225] Updated weights for policy 1, policy_version 1865588 (0.0008) [2023-12-28 08:38:33,230][106225] Updated weights for policy 1, policy_version 1865598 (0.0008) [2023-12-28 08:38:33,369][106226] Updated weights for policy 0, policy_version 1861705 (0.0008) [2023-12-28 08:38:33,432][106226] Updated weights for policy 0, policy_version 1861715 (0.0009) [2023-12-28 08:38:33,489][106226] Updated weights for policy 0, policy_version 1861725 (0.0008) [2023-12-28 08:38:33,548][106226] Updated weights for policy 0, policy_version 1861735 (0.0007) [2023-12-28 08:38:33,812][106225] Updated weights for policy 1, policy_version 1865608 (0.0006) [2023-12-28 08:38:33,855][106225] Updated weights for policy 1, policy_version 1865618 (0.0006) [2023-12-28 08:38:33,900][106225] Updated weights for policy 1, policy_version 1865628 (0.0005) [2023-12-28 08:38:34,189][106226] Updated weights for policy 0, policy_version 1861745 (0.0008) [2023-12-28 08:38:34,251][106226] Updated weights for policy 0, policy_version 1861755 (0.0007) [2023-12-28 08:38:34,315][106226] Updated weights for policy 0, policy_version 1861765 (0.0007) [2023-12-28 08:38:34,602][106225] Updated weights for policy 1, policy_version 1865638 (0.0007) [2023-12-28 08:38:34,670][106225] Updated weights for policy 1, policy_version 1865648 (0.0009) [2023-12-28 08:38:34,729][106225] Updated weights for policy 1, policy_version 1865658 (0.0008) [2023-12-28 08:38:34,978][106226] Updated weights for policy 0, policy_version 1861775 (0.0007) [2023-12-28 08:38:35,048][106226] Updated weights for policy 0, policy_version 1861785 (0.0009) [2023-12-28 08:38:35,112][106226] Updated weights for policy 0, policy_version 1861795 (0.0009) [2023-12-28 08:38:35,303][106225] Updated weights for policy 1, policy_version 1865668 (0.0008) [2023-12-28 08:38:35,363][106225] Updated weights for policy 1, policy_version 1865678 (0.0005) [2023-12-28 08:38:35,423][106225] Updated weights for policy 1, policy_version 1865688 (0.0008) [2023-12-28 08:38:35,758][106226] Updated weights for policy 0, policy_version 1861805 (0.0010) [2023-12-28 08:38:35,812][106226] Updated weights for policy 0, policy_version 1861815 (0.0010) [2023-12-28 08:38:35,872][106226] Updated weights for policy 0, policy_version 1861825 (0.0005) [2023-12-28 08:38:36,125][106225] Updated weights for policy 1, policy_version 1865698 (0.0009) [2023-12-28 08:38:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 954384384. Throughput: 0: 9834.0, 1: 10125.4. Samples: 954396576. Policy #0 lag: (min: 5.0, avg: 12.8, max: 37.0) [2023-12-28 08:38:36,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.556')] [2023-12-28 08:38:36,191][106225] Updated weights for policy 1, policy_version 1865708 (0.0008) [2023-12-28 08:38:36,254][106225] Updated weights for policy 1, policy_version 1865718 (0.0008) [2023-12-28 08:38:36,317][106225] Updated weights for policy 1, policy_version 1865728 (0.0008) [2023-12-28 08:38:36,604][106226] Updated weights for policy 0, policy_version 1861835 (0.0009) [2023-12-28 08:38:36,659][106226] Updated weights for policy 0, policy_version 1861845 (0.0008) [2023-12-28 08:38:36,714][106226] Updated weights for policy 0, policy_version 1861855 (0.0008) [2023-12-28 08:38:37,058][106225] Updated weights for policy 1, policy_version 1865738 (0.0009) [2023-12-28 08:38:37,127][106225] Updated weights for policy 1, policy_version 1865748 (0.0008) [2023-12-28 08:38:37,185][106225] Updated weights for policy 1, policy_version 1865758 (0.0010) [2023-12-28 08:38:37,386][106226] Updated weights for policy 0, policy_version 1861865 (0.0008) [2023-12-28 08:38:37,441][106226] Updated weights for policy 0, policy_version 1861875 (0.0006) [2023-12-28 08:38:37,509][106226] Updated weights for policy 0, policy_version 1861885 (0.0008) [2023-12-28 08:38:37,571][106226] Updated weights for policy 0, policy_version 1861895 (0.0008) [2023-12-28 08:38:37,798][106225] Updated weights for policy 1, policy_version 1865768 (0.0010) [2023-12-28 08:38:37,855][106225] Updated weights for policy 1, policy_version 1865778 (0.0010) [2023-12-28 08:38:37,915][106225] Updated weights for policy 1, policy_version 1865788 (0.0010) [2023-12-28 08:38:38,187][106226] Updated weights for policy 0, policy_version 1861905 (0.0010) [2023-12-28 08:38:38,249][106226] Updated weights for policy 0, policy_version 1861915 (0.0010) [2023-12-28 08:38:38,308][106226] Updated weights for policy 0, policy_version 1861925 (0.0008) [2023-12-28 08:38:38,638][106225] Updated weights for policy 1, policy_version 1865798 (0.0010) [2023-12-28 08:38:38,702][106225] Updated weights for policy 1, policy_version 1865808 (0.0007) [2023-12-28 08:38:38,765][106225] Updated weights for policy 1, policy_version 1865818 (0.0009) [2023-12-28 08:38:38,961][106226] Updated weights for policy 0, policy_version 1861935 (0.0007) [2023-12-28 08:38:39,018][106226] Updated weights for policy 0, policy_version 1861945 (0.0010) [2023-12-28 08:38:39,075][106226] Updated weights for policy 0, policy_version 1861955 (0.0010) [2023-12-28 08:38:39,469][106225] Updated weights for policy 1, policy_version 1865828 (0.0009) [2023-12-28 08:38:39,521][106225] Updated weights for policy 1, policy_version 1865838 (0.0008) [2023-12-28 08:38:39,581][106225] Updated weights for policy 1, policy_version 1865848 (0.0009) [2023-12-28 08:38:39,814][106226] Updated weights for policy 0, policy_version 1861965 (0.0008) [2023-12-28 08:38:39,878][106226] Updated weights for policy 0, policy_version 1861975 (0.0008) [2023-12-28 08:38:39,945][106226] Updated weights for policy 0, policy_version 1861985 (0.0008) [2023-12-28 08:38:40,282][106225] Updated weights for policy 1, policy_version 1865858 (0.0008) [2023-12-28 08:38:40,349][106225] Updated weights for policy 1, policy_version 1865868 (0.0007) [2023-12-28 08:38:40,413][106225] Updated weights for policy 1, policy_version 1865878 (0.0006) [2023-12-28 08:38:40,476][106225] Updated weights for policy 1, policy_version 1865888 (0.0010) [2023-12-28 08:38:40,699][106226] Updated weights for policy 0, policy_version 1861995 (0.0009) [2023-12-28 08:38:40,755][106226] Updated weights for policy 0, policy_version 1862005 (0.0007) [2023-12-28 08:38:40,813][106226] Updated weights for policy 0, policy_version 1862015 (0.0011) [2023-12-28 08:38:41,145][106225] Updated weights for policy 1, policy_version 1865898 (0.0009) [2023-12-28 08:38:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 954482688. Throughput: 0: 9868.7, 1: 10147.9. Samples: 954456756. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:38:41,175][105115] Avg episode reward: [(0, '-4.254'), (1, '-5.013')] [2023-12-28 08:38:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001862024_476758016.pth... [2023-12-28 08:38:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001860872_476463104.pth [2023-12-28 08:38:41,211][106225] Updated weights for policy 1, policy_version 1865908 (0.0008) [2023-12-28 08:38:41,277][106225] Updated weights for policy 1, policy_version 1865918 (0.0008) [2023-12-28 08:38:41,291][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001865920_477732864.pth... [2023-12-28 08:38:41,294][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001864704_477421568.pth [2023-12-28 08:38:41,632][106226] Updated weights for policy 0, policy_version 1862025 (0.0008) [2023-12-28 08:38:41,700][106226] Updated weights for policy 0, policy_version 1862035 (0.0008) [2023-12-28 08:38:41,776][106226] Updated weights for policy 0, policy_version 1862045 (0.0008) [2023-12-28 08:38:41,850][106226] Updated weights for policy 0, policy_version 1862055 (0.0008) [2023-12-28 08:38:41,975][106225] Updated weights for policy 1, policy_version 1865928 (0.0009) [2023-12-28 08:38:42,036][106225] Updated weights for policy 1, policy_version 1865938 (0.0009) [2023-12-28 08:38:42,089][106225] Updated weights for policy 1, policy_version 1865948 (0.0009) [2023-12-28 08:38:42,604][106226] Updated weights for policy 0, policy_version 1862065 (0.0009) [2023-12-28 08:38:42,662][106226] Updated weights for policy 0, policy_version 1862075 (0.0009) [2023-12-28 08:38:42,733][106226] Updated weights for policy 0, policy_version 1862085 (0.0010) [2023-12-28 08:38:42,840][106225] Updated weights for policy 1, policy_version 1865958 (0.0006) [2023-12-28 08:38:42,911][106225] Updated weights for policy 1, policy_version 1865968 (0.0008) [2023-12-28 08:38:42,969][106225] Updated weights for policy 1, policy_version 1865978 (0.0008) [2023-12-28 08:38:43,429][106226] Updated weights for policy 0, policy_version 1862095 (0.0008) [2023-12-28 08:38:43,486][106226] Updated weights for policy 0, policy_version 1862105 (0.0007) [2023-12-28 08:38:43,546][106226] Updated weights for policy 0, policy_version 1862115 (0.0005) [2023-12-28 08:38:43,580][106225] Updated weights for policy 1, policy_version 1865988 (0.0008) [2023-12-28 08:38:43,630][106225] Updated weights for policy 1, policy_version 1865998 (0.0010) [2023-12-28 08:38:43,676][106225] Updated weights for policy 1, policy_version 1866008 (0.0010) [2023-12-28 08:38:44,111][106226] Updated weights for policy 0, policy_version 1862125 (0.0007) [2023-12-28 08:38:44,168][106226] Updated weights for policy 0, policy_version 1862135 (0.0010) [2023-12-28 08:38:44,220][106226] Updated weights for policy 0, policy_version 1862145 (0.0005) [2023-12-28 08:38:44,337][106225] Updated weights for policy 1, policy_version 1866018 (0.0010) [2023-12-28 08:38:44,400][106225] Updated weights for policy 1, policy_version 1866028 (0.0010) [2023-12-28 08:38:44,451][106225] Updated weights for policy 1, policy_version 1866038 (0.0010) [2023-12-28 08:38:44,504][106225] Updated weights for policy 1, policy_version 1866048 (0.0010) [2023-12-28 08:38:44,873][106226] Updated weights for policy 0, policy_version 1862155 (0.0007) [2023-12-28 08:38:44,943][106226] Updated weights for policy 0, policy_version 1862165 (0.0010) [2023-12-28 08:38:45,006][106226] Updated weights for policy 0, policy_version 1862175 (0.0008) [2023-12-28 08:38:45,157][106225] Updated weights for policy 1, policy_version 1866058 (0.0008) [2023-12-28 08:38:45,218][106225] Updated weights for policy 1, policy_version 1866068 (0.0006) [2023-12-28 08:38:45,287][106225] Updated weights for policy 1, policy_version 1866078 (0.0006) [2023-12-28 08:38:45,730][106226] Updated weights for policy 0, policy_version 1862185 (0.0008) [2023-12-28 08:38:45,786][106226] Updated weights for policy 0, policy_version 1862195 (0.0007) [2023-12-28 08:38:45,822][106225] Updated weights for policy 1, policy_version 1866088 (0.0009) [2023-12-28 08:38:45,840][106226] Updated weights for policy 0, policy_version 1862205 (0.0006) [2023-12-28 08:38:45,869][106225] Updated weights for policy 1, policy_version 1866098 (0.0010) [2023-12-28 08:38:45,899][106226] Updated weights for policy 0, policy_version 1862215 (0.0006) [2023-12-28 08:38:45,923][106225] Updated weights for policy 1, policy_version 1866108 (0.0010) [2023-12-28 08:38:46,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 954589184. Throughput: 0: 9837.6, 1: 10155.7. Samples: 954574764. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:38:46,175][105115] Avg episode reward: [(0, '-4.228'), (1, '-4.528')] [2023-12-28 08:38:46,543][106226] Updated weights for policy 0, policy_version 1862225 (0.0008) [2023-12-28 08:38:46,597][106226] Updated weights for policy 0, policy_version 1862235 (0.0008) [2023-12-28 08:38:46,657][106226] Updated weights for policy 0, policy_version 1862245 (0.0008) [2023-12-28 08:38:46,681][106225] Updated weights for policy 1, policy_version 1866118 (0.0010) [2023-12-28 08:38:46,733][106225] Updated weights for policy 1, policy_version 1866128 (0.0009) [2023-12-28 08:38:46,790][106225] Updated weights for policy 1, policy_version 1866138 (0.0005) [2023-12-28 08:38:47,357][106225] Updated weights for policy 1, policy_version 1866148 (0.0007) [2023-12-28 08:38:47,393][106226] Updated weights for policy 0, policy_version 1862255 (0.0009) [2023-12-28 08:38:47,413][106225] Updated weights for policy 1, policy_version 1866158 (0.0008) [2023-12-28 08:38:47,451][106226] Updated weights for policy 0, policy_version 1862265 (0.0008) [2023-12-28 08:38:47,485][106225] Updated weights for policy 1, policy_version 1866168 (0.0008) [2023-12-28 08:38:47,507][106226] Updated weights for policy 0, policy_version 1862275 (0.0007) [2023-12-28 08:38:48,008][106225] Updated weights for policy 1, policy_version 1866178 (0.0006) [2023-12-28 08:38:48,073][106225] Updated weights for policy 1, policy_version 1866188 (0.0005) [2023-12-28 08:38:48,136][106225] Updated weights for policy 1, policy_version 1866198 (0.0005) [2023-12-28 08:38:48,197][106225] Updated weights for policy 1, policy_version 1866208 (0.0006) [2023-12-28 08:38:48,210][106226] Updated weights for policy 0, policy_version 1862285 (0.0010) [2023-12-28 08:38:48,266][106226] Updated weights for policy 0, policy_version 1862295 (0.0007) [2023-12-28 08:38:48,333][106226] Updated weights for policy 0, policy_version 1862305 (0.0010) [2023-12-28 08:38:48,865][106225] Updated weights for policy 1, policy_version 1866218 (0.0008) [2023-12-28 08:38:48,926][106225] Updated weights for policy 1, policy_version 1866228 (0.0006) [2023-12-28 08:38:48,983][106225] Updated weights for policy 1, policy_version 1866238 (0.0005) [2023-12-28 08:38:49,078][106226] Updated weights for policy 0, policy_version 1862315 (0.0010) [2023-12-28 08:38:49,131][106226] Updated weights for policy 0, policy_version 1862325 (0.0010) [2023-12-28 08:38:49,190][106226] Updated weights for policy 0, policy_version 1862335 (0.0010) [2023-12-28 08:38:49,646][106225] Updated weights for policy 1, policy_version 1866248 (0.0009) [2023-12-28 08:38:49,701][106225] Updated weights for policy 1, policy_version 1866258 (0.0008) [2023-12-28 08:38:49,766][106225] Updated weights for policy 1, policy_version 1866268 (0.0009) [2023-12-28 08:38:49,951][106226] Updated weights for policy 0, policy_version 1862345 (0.0009) [2023-12-28 08:38:50,012][106226] Updated weights for policy 0, policy_version 1862355 (0.0008) [2023-12-28 08:38:50,069][106226] Updated weights for policy 0, policy_version 1862365 (0.0008) [2023-12-28 08:38:50,127][106226] Updated weights for policy 0, policy_version 1862375 (0.0009) [2023-12-28 08:38:50,470][106225] Updated weights for policy 1, policy_version 1866278 (0.0010) [2023-12-28 08:38:50,518][106225] Updated weights for policy 1, policy_version 1866288 (0.0007) [2023-12-28 08:38:50,575][106225] Updated weights for policy 1, policy_version 1866298 (0.0009) [2023-12-28 08:38:50,948][106226] Updated weights for policy 0, policy_version 1862385 (0.0008) [2023-12-28 08:38:51,003][106226] Updated weights for policy 0, policy_version 1862395 (0.0007) [2023-12-28 08:38:51,070][106226] Updated weights for policy 0, policy_version 1862405 (0.0008) [2023-12-28 08:38:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 954687488. Throughput: 0: 9806.3, 1: 10218.1. Samples: 954695608. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:38:51,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.271')] [2023-12-28 08:38:51,296][106225] Updated weights for policy 1, policy_version 1866308 (0.0007) [2023-12-28 08:38:51,359][106225] Updated weights for policy 1, policy_version 1866318 (0.0009) [2023-12-28 08:38:51,423][106225] Updated weights for policy 1, policy_version 1866328 (0.0007) [2023-12-28 08:38:51,803][106226] Updated weights for policy 0, policy_version 1862415 (0.0007) [2023-12-28 08:38:51,868][106226] Updated weights for policy 0, policy_version 1862425 (0.0009) [2023-12-28 08:38:51,930][106226] Updated weights for policy 0, policy_version 1862435 (0.0010) [2023-12-28 08:38:52,098][106225] Updated weights for policy 1, policy_version 1866338 (0.0008) [2023-12-28 08:38:52,145][106225] Updated weights for policy 1, policy_version 1866348 (0.0005) [2023-12-28 08:38:52,192][106225] Updated weights for policy 1, policy_version 1866358 (0.0005) [2023-12-28 08:38:52,238][106225] Updated weights for policy 1, policy_version 1866368 (0.0005) [2023-12-28 08:38:52,717][106226] Updated weights for policy 0, policy_version 1862445 (0.0008) [2023-12-28 08:38:52,773][106226] Updated weights for policy 0, policy_version 1862455 (0.0008) [2023-12-28 08:38:52,836][106226] Updated weights for policy 0, policy_version 1862465 (0.0007) [2023-12-28 08:38:52,949][106225] Updated weights for policy 1, policy_version 1866378 (0.0009) [2023-12-28 08:38:53,009][106225] Updated weights for policy 1, policy_version 1866388 (0.0008) [2023-12-28 08:38:53,056][106225] Updated weights for policy 1, policy_version 1866398 (0.0008) [2023-12-28 08:38:53,485][106226] Updated weights for policy 0, policy_version 1862475 (0.0007) [2023-12-28 08:38:53,534][106226] Updated weights for policy 0, policy_version 1862485 (0.0005) [2023-12-28 08:38:53,583][106226] Updated weights for policy 0, policy_version 1862495 (0.0005) [2023-12-28 08:38:53,760][106225] Updated weights for policy 1, policy_version 1866408 (0.0006) [2023-12-28 08:38:53,815][106225] Updated weights for policy 1, policy_version 1866418 (0.0008) [2023-12-28 08:38:53,867][106225] Updated weights for policy 1, policy_version 1866428 (0.0007) [2023-12-28 08:38:54,145][106226] Updated weights for policy 0, policy_version 1862505 (0.0007) [2023-12-28 08:38:54,194][106226] Updated weights for policy 0, policy_version 1862515 (0.0008) [2023-12-28 08:38:54,245][106226] Updated weights for policy 0, policy_version 1862525 (0.0008) [2023-12-28 08:38:54,293][106226] Updated weights for policy 0, policy_version 1862535 (0.0008) [2023-12-28 08:38:54,632][106225] Updated weights for policy 1, policy_version 1866438 (0.0007) [2023-12-28 08:38:54,681][106225] Updated weights for policy 1, policy_version 1866448 (0.0006) [2023-12-28 08:38:54,735][106225] Updated weights for policy 1, policy_version 1866458 (0.0010) [2023-12-28 08:38:55,056][106226] Updated weights for policy 0, policy_version 1862545 (0.0008) [2023-12-28 08:38:55,115][106226] Updated weights for policy 0, policy_version 1862555 (0.0008) [2023-12-28 08:38:55,165][106226] Updated weights for policy 0, policy_version 1862565 (0.0008) [2023-12-28 08:38:55,469][106225] Updated weights for policy 1, policy_version 1866468 (0.0010) [2023-12-28 08:38:55,526][106225] Updated weights for policy 1, policy_version 1866478 (0.0010) [2023-12-28 08:38:55,587][106225] Updated weights for policy 1, policy_version 1866488 (0.0010) [2023-12-28 08:38:55,835][106226] Updated weights for policy 0, policy_version 1862575 (0.0009) [2023-12-28 08:38:55,883][106226] Updated weights for policy 0, policy_version 1862585 (0.0011) [2023-12-28 08:38:55,936][106226] Updated weights for policy 0, policy_version 1862595 (0.0010) [2023-12-28 08:38:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 954785792. Throughput: 0: 9771.4, 1: 10182.7. Samples: 954755504. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:38:56,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.882')] [2023-12-28 08:38:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001866496_477880320.pth... [2023-12-28 08:38:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001862600_476905472.pth... [2023-12-28 08:38:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001865312_477577216.pth [2023-12-28 08:38:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001861448_476610560.pth [2023-12-28 08:38:56,309][106225] Updated weights for policy 1, policy_version 1866498 (0.0010) [2023-12-28 08:38:56,368][106225] Updated weights for policy 1, policy_version 1866508 (0.0010) [2023-12-28 08:38:56,429][106225] Updated weights for policy 1, policy_version 1866518 (0.0010) [2023-12-28 08:38:56,492][106225] Updated weights for policy 1, policy_version 1866528 (0.0010) [2023-12-28 08:38:56,634][106226] Updated weights for policy 0, policy_version 1862605 (0.0009) [2023-12-28 08:38:56,695][106226] Updated weights for policy 0, policy_version 1862615 (0.0005) [2023-12-28 08:38:56,753][106226] Updated weights for policy 0, policy_version 1862625 (0.0005) [2023-12-28 08:38:57,157][106225] Updated weights for policy 1, policy_version 1866538 (0.0005) [2023-12-28 08:38:57,205][106225] Updated weights for policy 1, policy_version 1866548 (0.0005) [2023-12-28 08:38:57,255][106226] Updated weights for policy 0, policy_version 1862635 (0.0007) [2023-12-28 08:38:57,256][106225] Updated weights for policy 1, policy_version 1866558 (0.0005) [2023-12-28 08:38:57,313][106226] Updated weights for policy 0, policy_version 1862645 (0.0010) [2023-12-28 08:38:57,365][106226] Updated weights for policy 0, policy_version 1862655 (0.0010) [2023-12-28 08:38:57,934][106225] Updated weights for policy 1, policy_version 1866568 (0.0009) [2023-12-28 08:38:57,987][106225] Updated weights for policy 1, policy_version 1866578 (0.0010) [2023-12-28 08:38:58,046][106225] Updated weights for policy 1, policy_version 1866588 (0.0010) [2023-12-28 08:38:58,068][106226] Updated weights for policy 0, policy_version 1862665 (0.0010) [2023-12-28 08:38:58,118][106226] Updated weights for policy 0, policy_version 1862675 (0.0010) [2023-12-28 08:38:58,166][106226] Updated weights for policy 0, policy_version 1862685 (0.0010) [2023-12-28 08:38:58,236][106226] Updated weights for policy 0, policy_version 1862695 (0.0007) [2023-12-28 08:38:58,785][106225] Updated weights for policy 1, policy_version 1866598 (0.0010) [2023-12-28 08:38:58,884][106225] Updated weights for policy 1, policy_version 1866608 (0.0009) [2023-12-28 08:38:58,954][106225] Updated weights for policy 1, policy_version 1866618 (0.0007) [2023-12-28 08:38:59,078][106226] Updated weights for policy 0, policy_version 1862705 (0.0008) [2023-12-28 08:38:59,144][106226] Updated weights for policy 0, policy_version 1862715 (0.0008) [2023-12-28 08:38:59,208][106226] Updated weights for policy 0, policy_version 1862725 (0.0008) [2023-12-28 08:38:59,634][106225] Updated weights for policy 1, policy_version 1866628 (0.0008) [2023-12-28 08:38:59,693][106225] Updated weights for policy 1, policy_version 1866638 (0.0008) [2023-12-28 08:38:59,755][106225] Updated weights for policy 1, policy_version 1866648 (0.0007) [2023-12-28 08:38:59,994][106226] Updated weights for policy 0, policy_version 1862735 (0.0008) [2023-12-28 08:39:00,061][106226] Updated weights for policy 0, policy_version 1862745 (0.0009) [2023-12-28 08:39:00,122][106226] Updated weights for policy 0, policy_version 1862755 (0.0008) [2023-12-28 08:39:00,371][106225] Updated weights for policy 1, policy_version 1866658 (0.0006) [2023-12-28 08:39:00,424][106225] Updated weights for policy 1, policy_version 1866668 (0.0007) [2023-12-28 08:39:00,484][106225] Updated weights for policy 1, policy_version 1866678 (0.0006) [2023-12-28 08:39:00,546][106225] Updated weights for policy 1, policy_version 1866688 (0.0005) [2023-12-28 08:39:00,905][106226] Updated weights for policy 0, policy_version 1862765 (0.0008) [2023-12-28 08:39:00,962][106226] Updated weights for policy 0, policy_version 1862775 (0.0009) [2023-12-28 08:39:01,013][106226] Updated weights for policy 0, policy_version 1862785 (0.0009) [2023-12-28 08:39:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 954884096. Throughput: 0: 9753.3, 1: 10117.7. Samples: 954872760. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:01,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.644')] [2023-12-28 08:39:01,197][106225] Updated weights for policy 1, policy_version 1866698 (0.0008) [2023-12-28 08:39:01,256][106225] Updated weights for policy 1, policy_version 1866708 (0.0008) [2023-12-28 08:39:01,319][106225] Updated weights for policy 1, policy_version 1866718 (0.0008) [2023-12-28 08:39:01,802][106226] Updated weights for policy 0, policy_version 1862795 (0.0007) [2023-12-28 08:39:01,861][106226] Updated weights for policy 0, policy_version 1862805 (0.0008) [2023-12-28 08:39:01,916][106226] Updated weights for policy 0, policy_version 1862815 (0.0008) [2023-12-28 08:39:02,025][106225] Updated weights for policy 1, policy_version 1866728 (0.0010) [2023-12-28 08:39:02,082][106225] Updated weights for policy 1, policy_version 1866738 (0.0010) [2023-12-28 08:39:02,140][106225] Updated weights for policy 1, policy_version 1866748 (0.0010) [2023-12-28 08:39:02,617][106226] Updated weights for policy 0, policy_version 1862825 (0.0008) [2023-12-28 08:39:02,671][106226] Updated weights for policy 0, policy_version 1862835 (0.0006) [2023-12-28 08:39:02,729][106226] Updated weights for policy 0, policy_version 1862845 (0.0007) [2023-12-28 08:39:02,797][106226] Updated weights for policy 0, policy_version 1862855 (0.0005) [2023-12-28 08:39:02,884][106225] Updated weights for policy 1, policy_version 1866758 (0.0009) [2023-12-28 08:39:02,934][106225] Updated weights for policy 1, policy_version 1866768 (0.0007) [2023-12-28 08:39:02,989][106225] Updated weights for policy 1, policy_version 1866778 (0.0009) [2023-12-28 08:39:03,347][106226] Updated weights for policy 0, policy_version 1862865 (0.0005) [2023-12-28 08:39:03,410][106226] Updated weights for policy 0, policy_version 1862875 (0.0005) [2023-12-28 08:39:03,466][106226] Updated weights for policy 0, policy_version 1862885 (0.0005) [2023-12-28 08:39:03,796][106225] Updated weights for policy 1, policy_version 1866788 (0.0009) [2023-12-28 08:39:03,857][106225] Updated weights for policy 1, policy_version 1866798 (0.0009) [2023-12-28 08:39:03,919][106225] Updated weights for policy 1, policy_version 1866808 (0.0008) [2023-12-28 08:39:04,033][106226] Updated weights for policy 0, policy_version 1862895 (0.0007) [2023-12-28 08:39:04,091][106226] Updated weights for policy 0, policy_version 1862905 (0.0010) [2023-12-28 08:39:04,153][106226] Updated weights for policy 0, policy_version 1862915 (0.0011) [2023-12-28 08:39:04,693][106225] Updated weights for policy 1, policy_version 1866818 (0.0009) [2023-12-28 08:39:04,750][106225] Updated weights for policy 1, policy_version 1866828 (0.0010) [2023-12-28 08:39:04,803][106225] Updated weights for policy 1, policy_version 1866838 (0.0010) [2023-12-28 08:39:04,831][106226] Updated weights for policy 0, policy_version 1862925 (0.0008) [2023-12-28 08:39:04,857][106225] Updated weights for policy 1, policy_version 1866848 (0.0010) [2023-12-28 08:39:04,884][106226] Updated weights for policy 0, policy_version 1862935 (0.0005) [2023-12-28 08:39:04,934][106226] Updated weights for policy 0, policy_version 1862945 (0.0005) [2023-12-28 08:39:05,483][106226] Updated weights for policy 0, policy_version 1862955 (0.0007) [2023-12-28 08:39:05,536][106226] Updated weights for policy 0, policy_version 1862965 (0.0010) [2023-12-28 08:39:05,538][106225] Updated weights for policy 1, policy_version 1866858 (0.0010) [2023-12-28 08:39:05,587][106225] Updated weights for policy 1, policy_version 1866868 (0.0010) [2023-12-28 08:39:05,589][106226] Updated weights for policy 0, policy_version 1862975 (0.0005) [2023-12-28 08:39:05,658][106225] Updated weights for policy 1, policy_version 1866878 (0.0008) [2023-12-28 08:39:06,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 954982400. Throughput: 0: 9855.2, 1: 10070.1. Samples: 954993968. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:06,175][105115] Avg episode reward: [(0, '-4.364'), (1, '-4.725')] [2023-12-28 08:39:06,295][106226] Updated weights for policy 0, policy_version 1862985 (0.0007) [2023-12-28 08:39:06,362][106226] Updated weights for policy 0, policy_version 1862995 (0.0009) [2023-12-28 08:39:06,402][106225] Updated weights for policy 1, policy_version 1866888 (0.0007) [2023-12-28 08:39:06,420][106226] Updated weights for policy 0, policy_version 1863005 (0.0010) [2023-12-28 08:39:06,466][106225] Updated weights for policy 1, policy_version 1866898 (0.0008) [2023-12-28 08:39:06,487][106226] Updated weights for policy 0, policy_version 1863015 (0.0006) [2023-12-28 08:39:06,534][106225] Updated weights for policy 1, policy_version 1866908 (0.0009) [2023-12-28 08:39:07,145][106226] Updated weights for policy 0, policy_version 1863025 (0.0006) [2023-12-28 08:39:07,213][106226] Updated weights for policy 0, policy_version 1863035 (0.0009) [2023-12-28 08:39:07,271][106225] Updated weights for policy 1, policy_version 1866918 (0.0007) [2023-12-28 08:39:07,276][106226] Updated weights for policy 0, policy_version 1863045 (0.0009) [2023-12-28 08:39:07,332][106225] Updated weights for policy 1, policy_version 1866928 (0.0010) [2023-12-28 08:39:07,392][106225] Updated weights for policy 1, policy_version 1866938 (0.0010) [2023-12-28 08:39:07,953][106226] Updated weights for policy 0, policy_version 1863055 (0.0010) [2023-12-28 08:39:08,014][106226] Updated weights for policy 0, policy_version 1863065 (0.0011) [2023-12-28 08:39:08,027][106225] Updated weights for policy 1, policy_version 1866948 (0.0008) [2023-12-28 08:39:08,067][106226] Updated weights for policy 0, policy_version 1863075 (0.0010) [2023-12-28 08:39:08,085][106225] Updated weights for policy 1, policy_version 1866958 (0.0007) [2023-12-28 08:39:08,146][106225] Updated weights for policy 1, policy_version 1866968 (0.0008) [2023-12-28 08:39:08,740][106226] Updated weights for policy 0, policy_version 1863085 (0.0011) [2023-12-28 08:39:08,742][106225] Updated weights for policy 1, policy_version 1866978 (0.0007) [2023-12-28 08:39:08,796][106225] Updated weights for policy 1, policy_version 1866988 (0.0007) [2023-12-28 08:39:08,802][106226] Updated weights for policy 0, policy_version 1863095 (0.0010) [2023-12-28 08:39:08,859][106225] Updated weights for policy 1, policy_version 1866998 (0.0007) [2023-12-28 08:39:08,860][106226] Updated weights for policy 0, policy_version 1863105 (0.0010) [2023-12-28 08:39:08,923][106225] Updated weights for policy 1, policy_version 1867008 (0.0005) [2023-12-28 08:39:09,613][106226] Updated weights for policy 0, policy_version 1863115 (0.0010) [2023-12-28 08:39:09,620][106225] Updated weights for policy 1, policy_version 1867018 (0.0005) [2023-12-28 08:39:09,671][106226] Updated weights for policy 0, policy_version 1863125 (0.0008) [2023-12-28 08:39:09,686][106225] Updated weights for policy 1, policy_version 1867028 (0.0006) [2023-12-28 08:39:09,727][106226] Updated weights for policy 0, policy_version 1863135 (0.0006) [2023-12-28 08:39:09,744][106225] Updated weights for policy 1, policy_version 1867038 (0.0010) [2023-12-28 08:39:10,460][106225] Updated weights for policy 1, policy_version 1867048 (0.0009) [2023-12-28 08:39:10,501][106226] Updated weights for policy 0, policy_version 1863145 (0.0007) [2023-12-28 08:39:10,512][106225] Updated weights for policy 1, policy_version 1867058 (0.0008) [2023-12-28 08:39:10,557][106226] Updated weights for policy 0, policy_version 1863155 (0.0006) [2023-12-28 08:39:10,571][106225] Updated weights for policy 1, policy_version 1867068 (0.0006) [2023-12-28 08:39:10,614][106226] Updated weights for policy 0, policy_version 1863165 (0.0007) [2023-12-28 08:39:10,674][106226] Updated weights for policy 0, policy_version 1863175 (0.0009) [2023-12-28 08:39:11,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 955080704. Throughput: 0: 9886.8, 1: 10137.0. Samples: 955054272. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:11,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.669')] [2023-12-28 08:39:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001867072_478027776.pth... [2023-12-28 08:39:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001863176_477052928.pth... [2023-12-28 08:39:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001865920_477732864.pth [2023-12-28 08:39:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001862024_476758016.pth [2023-12-28 08:39:11,389][106225] Updated weights for policy 1, policy_version 1867078 (0.0008) [2023-12-28 08:39:11,413][106226] Updated weights for policy 0, policy_version 1863185 (0.0009) [2023-12-28 08:39:11,454][106225] Updated weights for policy 1, policy_version 1867088 (0.0011) [2023-12-28 08:39:11,476][106226] Updated weights for policy 0, policy_version 1863195 (0.0006) [2023-12-28 08:39:11,505][106225] Updated weights for policy 1, policy_version 1867098 (0.0010) [2023-12-28 08:39:11,532][106226] Updated weights for policy 0, policy_version 1863205 (0.0006) [2023-12-28 08:39:12,221][106225] Updated weights for policy 1, policy_version 1867108 (0.0008) [2023-12-28 08:39:12,241][106226] Updated weights for policy 0, policy_version 1863215 (0.0008) [2023-12-28 08:39:12,284][106225] Updated weights for policy 1, policy_version 1867118 (0.0010) [2023-12-28 08:39:12,304][106226] Updated weights for policy 0, policy_version 1863225 (0.0009) [2023-12-28 08:39:12,344][106225] Updated weights for policy 1, policy_version 1867128 (0.0010) [2023-12-28 08:39:12,374][106226] Updated weights for policy 0, policy_version 1863235 (0.0009) [2023-12-28 08:39:13,060][106225] Updated weights for policy 1, policy_version 1867138 (0.0010) [2023-12-28 08:39:13,110][106225] Updated weights for policy 1, policy_version 1867148 (0.0006) [2023-12-28 08:39:13,128][106226] Updated weights for policy 0, policy_version 1863245 (0.0007) [2023-12-28 08:39:13,174][106225] Updated weights for policy 1, policy_version 1867158 (0.0006) [2023-12-28 08:39:13,184][106226] Updated weights for policy 0, policy_version 1863255 (0.0005) [2023-12-28 08:39:13,236][106226] Updated weights for policy 0, policy_version 1863265 (0.0007) [2023-12-28 08:39:13,240][106225] Updated weights for policy 1, policy_version 1867168 (0.0006) [2023-12-28 08:39:13,780][106225] Updated weights for policy 1, policy_version 1867178 (0.0008) [2023-12-28 08:39:13,829][106226] Updated weights for policy 0, policy_version 1863275 (0.0008) [2023-12-28 08:39:13,840][106225] Updated weights for policy 1, policy_version 1867188 (0.0010) [2023-12-28 08:39:13,876][106226] Updated weights for policy 0, policy_version 1863285 (0.0007) [2023-12-28 08:39:13,906][106225] Updated weights for policy 1, policy_version 1867198 (0.0010) [2023-12-28 08:39:13,926][106226] Updated weights for policy 0, policy_version 1863295 (0.0006) [2023-12-28 08:39:14,556][106226] Updated weights for policy 0, policy_version 1863305 (0.0006) [2023-12-28 08:39:14,594][106225] Updated weights for policy 1, policy_version 1867208 (0.0010) [2023-12-28 08:39:14,609][106226] Updated weights for policy 0, policy_version 1863315 (0.0007) [2023-12-28 08:39:14,648][106225] Updated weights for policy 1, policy_version 1867218 (0.0010) [2023-12-28 08:39:14,655][106226] Updated weights for policy 0, policy_version 1863325 (0.0007) [2023-12-28 08:39:14,698][106226] Updated weights for policy 0, policy_version 1863335 (0.0005) [2023-12-28 08:39:14,701][106225] Updated weights for policy 1, policy_version 1867228 (0.0010) [2023-12-28 08:39:15,404][106225] Updated weights for policy 1, policy_version 1867238 (0.0009) [2023-12-28 08:39:15,454][106226] Updated weights for policy 0, policy_version 1863345 (0.0008) [2023-12-28 08:39:15,463][106225] Updated weights for policy 1, policy_version 1867248 (0.0008) [2023-12-28 08:39:15,509][106226] Updated weights for policy 0, policy_version 1863355 (0.0011) [2023-12-28 08:39:15,523][106225] Updated weights for policy 1, policy_version 1867258 (0.0008) [2023-12-28 08:39:15,571][106226] Updated weights for policy 0, policy_version 1863365 (0.0011) [2023-12-28 08:39:16,169][106225] Updated weights for policy 1, policy_version 1867268 (0.0007) [2023-12-28 08:39:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 955179008. Throughput: 0: 9952.4, 1: 9997.4. Samples: 955172264. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:16,175][105115] Avg episode reward: [(0, '-4.382'), (1, '-4.651')] [2023-12-28 08:39:16,228][106225] Updated weights for policy 1, policy_version 1867278 (0.0009) [2023-12-28 08:39:16,233][106226] Updated weights for policy 0, policy_version 1863375 (0.0009) [2023-12-28 08:39:16,278][106225] Updated weights for policy 1, policy_version 1867288 (0.0010) [2023-12-28 08:39:16,297][106226] Updated weights for policy 0, policy_version 1863385 (0.0008) [2023-12-28 08:39:16,363][106226] Updated weights for policy 0, policy_version 1863395 (0.0008) [2023-12-28 08:39:16,929][106225] Updated weights for policy 1, policy_version 1867298 (0.0010) [2023-12-28 08:39:16,978][106225] Updated weights for policy 1, policy_version 1867308 (0.0006) [2023-12-28 08:39:17,026][106225] Updated weights for policy 1, policy_version 1867318 (0.0005) [2023-12-28 08:39:17,056][106226] Updated weights for policy 0, policy_version 1863405 (0.0009) [2023-12-28 08:39:17,079][106225] Updated weights for policy 1, policy_version 1867328 (0.0005) [2023-12-28 08:39:17,109][106226] Updated weights for policy 0, policy_version 1863415 (0.0006) [2023-12-28 08:39:17,168][106226] Updated weights for policy 0, policy_version 1863425 (0.0005) [2023-12-28 08:39:17,745][106225] Updated weights for policy 1, policy_version 1867338 (0.0008) [2023-12-28 08:39:17,761][106226] Updated weights for policy 0, policy_version 1863435 (0.0006) [2023-12-28 08:39:17,795][106225] Updated weights for policy 1, policy_version 1867348 (0.0008) [2023-12-28 08:39:17,815][106226] Updated weights for policy 0, policy_version 1863445 (0.0008) [2023-12-28 08:39:17,850][106225] Updated weights for policy 1, policy_version 1867358 (0.0010) [2023-12-28 08:39:17,868][106226] Updated weights for policy 0, policy_version 1863455 (0.0008) [2023-12-28 08:39:18,512][106225] Updated weights for policy 1, policy_version 1867368 (0.0009) [2023-12-28 08:39:18,571][106225] Updated weights for policy 1, policy_version 1867378 (0.0008) [2023-12-28 08:39:18,591][106226] Updated weights for policy 0, policy_version 1863466 (0.0008) [2023-12-28 08:39:18,634][106225] Updated weights for policy 1, policy_version 1867388 (0.0008) [2023-12-28 08:39:18,642][106226] Updated weights for policy 0, policy_version 1863476 (0.0006) [2023-12-28 08:39:18,698][106226] Updated weights for policy 0, policy_version 1863486 (0.0007) [2023-12-28 08:39:18,749][106226] Updated weights for policy 0, policy_version 1863496 (0.0007) [2023-12-28 08:39:19,420][106225] Updated weights for policy 1, policy_version 1867398 (0.0009) [2023-12-28 08:39:19,485][106225] Updated weights for policy 1, policy_version 1867408 (0.0008) [2023-12-28 08:39:19,539][106226] Updated weights for policy 0, policy_version 1863506 (0.0008) [2023-12-28 08:39:19,549][106225] Updated weights for policy 1, policy_version 1867418 (0.0008) [2023-12-28 08:39:19,607][106226] Updated weights for policy 0, policy_version 1863516 (0.0008) [2023-12-28 08:39:19,673][106226] Updated weights for policy 0, policy_version 1863526 (0.0008) [2023-12-28 08:39:20,295][106225] Updated weights for policy 1, policy_version 1867428 (0.0008) [2023-12-28 08:39:20,359][106225] Updated weights for policy 1, policy_version 1867438 (0.0008) [2023-12-28 08:39:20,421][106225] Updated weights for policy 1, policy_version 1867448 (0.0008) [2023-12-28 08:39:20,436][106226] Updated weights for policy 0, policy_version 1863536 (0.0007) [2023-12-28 08:39:20,493][106226] Updated weights for policy 0, policy_version 1863546 (0.0007) [2023-12-28 08:39:20,561][106226] Updated weights for policy 0, policy_version 1863556 (0.0008) [2023-12-28 08:39:21,132][106225] Updated weights for policy 1, policy_version 1867458 (0.0007) [2023-12-28 08:39:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 955277312. Throughput: 0: 9889.5, 1: 9974.0. Samples: 955290436. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:21,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.362')] [2023-12-28 08:39:21,192][106225] Updated weights for policy 1, policy_version 1867468 (0.0008) [2023-12-28 08:39:21,246][106225] Updated weights for policy 1, policy_version 1867478 (0.0008) [2023-12-28 08:39:21,315][106225] Updated weights for policy 1, policy_version 1867488 (0.0008) [2023-12-28 08:39:21,351][106226] Updated weights for policy 0, policy_version 1863566 (0.0009) [2023-12-28 08:39:21,416][106226] Updated weights for policy 0, policy_version 1863576 (0.0008) [2023-12-28 08:39:21,486][106226] Updated weights for policy 0, policy_version 1863586 (0.0006) [2023-12-28 08:39:22,118][106225] Updated weights for policy 1, policy_version 1867498 (0.0009) [2023-12-28 08:39:22,176][106225] Updated weights for policy 1, policy_version 1867508 (0.0009) [2023-12-28 08:39:22,187][106226] Updated weights for policy 0, policy_version 1863596 (0.0006) [2023-12-28 08:39:22,227][106225] Updated weights for policy 1, policy_version 1867518 (0.0008) [2023-12-28 08:39:22,237][106226] Updated weights for policy 0, policy_version 1863606 (0.0009) [2023-12-28 08:39:22,296][106226] Updated weights for policy 0, policy_version 1863616 (0.0009) [2023-12-28 08:39:23,022][106225] Updated weights for policy 1, policy_version 1867528 (0.0008) [2023-12-28 08:39:23,041][106226] Updated weights for policy 0, policy_version 1863626 (0.0008) [2023-12-28 08:39:23,088][106225] Updated weights for policy 1, policy_version 1867538 (0.0008) [2023-12-28 08:39:23,106][106226] Updated weights for policy 0, policy_version 1863636 (0.0005) [2023-12-28 08:39:23,149][106225] Updated weights for policy 1, policy_version 1867548 (0.0007) [2023-12-28 08:39:23,172][106226] Updated weights for policy 0, policy_version 1863646 (0.0010) [2023-12-28 08:39:23,223][106226] Updated weights for policy 0, policy_version 1863656 (0.0010) [2023-12-28 08:39:23,851][106225] Updated weights for policy 1, policy_version 1867558 (0.0010) [2023-12-28 08:39:23,907][106225] Updated weights for policy 1, policy_version 1867568 (0.0010) [2023-12-28 08:39:23,935][106226] Updated weights for policy 0, policy_version 1863666 (0.0005) [2023-12-28 08:39:23,960][106225] Updated weights for policy 1, policy_version 1867578 (0.0010) [2023-12-28 08:39:23,993][106226] Updated weights for policy 0, policy_version 1863676 (0.0005) [2023-12-28 08:39:24,043][106226] Updated weights for policy 0, policy_version 1863686 (0.0008) [2023-12-28 08:39:24,585][106225] Updated weights for policy 1, policy_version 1867588 (0.0010) [2023-12-28 08:39:24,646][106225] Updated weights for policy 1, policy_version 1867598 (0.0010) [2023-12-28 08:39:24,711][106225] Updated weights for policy 1, policy_version 1867608 (0.0010) [2023-12-28 08:39:24,733][106226] Updated weights for policy 0, policy_version 1863696 (0.0006) [2023-12-28 08:39:24,787][106226] Updated weights for policy 0, policy_version 1863706 (0.0008) [2023-12-28 08:39:24,842][106226] Updated weights for policy 0, policy_version 1863716 (0.0009) [2023-12-28 08:39:25,345][106225] Updated weights for policy 1, policy_version 1867618 (0.0008) [2023-12-28 08:39:25,394][106225] Updated weights for policy 1, policy_version 1867628 (0.0008) [2023-12-28 08:39:25,449][106225] Updated weights for policy 1, policy_version 1867638 (0.0008) [2023-12-28 08:39:25,459][106226] Updated weights for policy 0, policy_version 1863726 (0.0007) [2023-12-28 08:39:25,506][106225] Updated weights for policy 1, policy_version 1867648 (0.0009) [2023-12-28 08:39:25,518][106226] Updated weights for policy 0, policy_version 1863736 (0.0007) [2023-12-28 08:39:25,575][106226] Updated weights for policy 0, policy_version 1863746 (0.0009) [2023-12-28 08:39:26,156][106226] Updated weights for policy 0, policy_version 1863756 (0.0007) [2023-12-28 08:39:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 955375616. Throughput: 0: 9843.8, 1: 9934.1. Samples: 955346756. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:26,175][105115] Avg episode reward: [(0, '-4.035'), (1, '-4.414')] [2023-12-28 08:39:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001867648_478175232.pth... [2023-12-28 08:39:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001866496_477880320.pth [2023-12-28 08:39:26,216][106226] Updated weights for policy 0, policy_version 1863766 (0.0005) [2023-12-28 08:39:26,266][106226] Updated weights for policy 0, policy_version 1863776 (0.0005) [2023-12-28 08:39:26,298][106225] Updated weights for policy 1, policy_version 1867658 (0.0007) [2023-12-28 08:39:26,309][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001863784_477208576.pth... [2023-12-28 08:39:26,312][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001862600_476905472.pth [2023-12-28 08:39:26,363][106225] Updated weights for policy 1, policy_version 1867668 (0.0009) [2023-12-28 08:39:26,420][106225] Updated weights for policy 1, policy_version 1867678 (0.0009) [2023-12-28 08:39:26,899][106226] Updated weights for policy 0, policy_version 1863786 (0.0007) [2023-12-28 08:39:26,960][106226] Updated weights for policy 0, policy_version 1863796 (0.0011) [2023-12-28 08:39:27,023][106226] Updated weights for policy 0, policy_version 1863806 (0.0011) [2023-12-28 08:39:27,083][106226] Updated weights for policy 0, policy_version 1863816 (0.0010) [2023-12-28 08:39:27,107][106225] Updated weights for policy 1, policy_version 1867688 (0.0009) [2023-12-28 08:39:27,164][106225] Updated weights for policy 1, policy_version 1867698 (0.0007) [2023-12-28 08:39:27,229][106225] Updated weights for policy 1, policy_version 1867708 (0.0008) [2023-12-28 08:39:27,691][106226] Updated weights for policy 0, policy_version 1863826 (0.0010) [2023-12-28 08:39:27,741][106226] Updated weights for policy 0, policy_version 1863836 (0.0009) [2023-12-28 08:39:27,806][106226] Updated weights for policy 0, policy_version 1863846 (0.0008) [2023-12-28 08:39:27,987][106225] Updated weights for policy 1, policy_version 1867718 (0.0010) [2023-12-28 08:39:28,041][106225] Updated weights for policy 1, policy_version 1867728 (0.0010) [2023-12-28 08:39:28,089][106225] Updated weights for policy 1, policy_version 1867738 (0.0010) [2023-12-28 08:39:28,461][106226] Updated weights for policy 0, policy_version 1863856 (0.0011) [2023-12-28 08:39:28,524][106226] Updated weights for policy 0, policy_version 1863866 (0.0010) [2023-12-28 08:39:28,590][106226] Updated weights for policy 0, policy_version 1863876 (0.0010) [2023-12-28 08:39:28,838][106225] Updated weights for policy 1, policy_version 1867748 (0.0009) [2023-12-28 08:39:28,894][106225] Updated weights for policy 1, policy_version 1867758 (0.0005) [2023-12-28 08:39:28,944][106225] Updated weights for policy 1, policy_version 1867768 (0.0005) [2023-12-28 08:39:29,261][106226] Updated weights for policy 0, policy_version 1863886 (0.0009) [2023-12-28 08:39:29,315][106226] Updated weights for policy 0, policy_version 1863896 (0.0008) [2023-12-28 08:39:29,373][106226] Updated weights for policy 0, policy_version 1863906 (0.0009) [2023-12-28 08:39:29,554][106225] Updated weights for policy 1, policy_version 1867778 (0.0009) [2023-12-28 08:39:29,607][106225] Updated weights for policy 1, policy_version 1867788 (0.0005) [2023-12-28 08:39:29,659][106225] Updated weights for policy 1, policy_version 1867798 (0.0010) [2023-12-28 08:39:29,709][106225] Updated weights for policy 1, policy_version 1867808 (0.0009) [2023-12-28 08:39:30,073][106226] Updated weights for policy 0, policy_version 1863916 (0.0007) [2023-12-28 08:39:30,143][106226] Updated weights for policy 0, policy_version 1863926 (0.0005) [2023-12-28 08:39:30,205][106226] Updated weights for policy 0, policy_version 1863936 (0.0006) [2023-12-28 08:39:30,451][106225] Updated weights for policy 1, policy_version 1867818 (0.0011) [2023-12-28 08:39:30,512][106225] Updated weights for policy 1, policy_version 1867828 (0.0010) [2023-12-28 08:39:30,578][106225] Updated weights for policy 1, policy_version 1867838 (0.0010) [2023-12-28 08:39:30,821][106226] Updated weights for policy 0, policy_version 1863946 (0.0007) [2023-12-28 08:39:30,874][106226] Updated weights for policy 0, policy_version 1863956 (0.0005) [2023-12-28 08:39:30,922][106226] Updated weights for policy 0, policy_version 1863966 (0.0005) [2023-12-28 08:39:30,972][106226] Updated weights for policy 0, policy_version 1863976 (0.0005) [2023-12-28 08:39:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 955482112. Throughput: 0: 9974.2, 1: 9928.3. Samples: 955470380. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:31,175][105115] Avg episode reward: [(0, '-4.201'), (1, '-4.428')] [2023-12-28 08:39:31,331][106225] Updated weights for policy 1, policy_version 1867848 (0.0008) [2023-12-28 08:39:31,408][106225] Updated weights for policy 1, policy_version 1867858 (0.0009) [2023-12-28 08:39:31,473][106225] Updated weights for policy 1, policy_version 1867868 (0.0010) [2023-12-28 08:39:31,686][106226] Updated weights for policy 0, policy_version 1863986 (0.0008) [2023-12-28 08:39:31,747][106226] Updated weights for policy 0, policy_version 1863996 (0.0006) [2023-12-28 08:39:31,808][106226] Updated weights for policy 0, policy_version 1864006 (0.0008) [2023-12-28 08:39:32,169][106225] Updated weights for policy 1, policy_version 1867878 (0.0009) [2023-12-28 08:39:32,238][106225] Updated weights for policy 1, policy_version 1867888 (0.0009) [2023-12-28 08:39:32,299][106225] Updated weights for policy 1, policy_version 1867898 (0.0008) [2023-12-28 08:39:32,511][106226] Updated weights for policy 0, policy_version 1864016 (0.0008) [2023-12-28 08:39:32,566][106226] Updated weights for policy 0, policy_version 1864026 (0.0008) [2023-12-28 08:39:32,611][106226] Updated weights for policy 0, policy_version 1864036 (0.0009) [2023-12-28 08:39:33,013][106225] Updated weights for policy 1, policy_version 1867908 (0.0008) [2023-12-28 08:39:33,064][106225] Updated weights for policy 1, policy_version 1867918 (0.0008) [2023-12-28 08:39:33,115][106225] Updated weights for policy 1, policy_version 1867928 (0.0009) [2023-12-28 08:39:33,306][106226] Updated weights for policy 0, policy_version 1864046 (0.0006) [2023-12-28 08:39:33,362][106226] Updated weights for policy 0, policy_version 1864056 (0.0005) [2023-12-28 08:39:33,431][106226] Updated weights for policy 0, policy_version 1864066 (0.0007) [2023-12-28 08:39:33,888][106225] Updated weights for policy 1, policy_version 1867938 (0.0009) [2023-12-28 08:39:33,944][106225] Updated weights for policy 1, policy_version 1867948 (0.0008) [2023-12-28 08:39:34,002][106225] Updated weights for policy 1, policy_version 1867958 (0.0008) [2023-12-28 08:39:34,061][106225] Updated weights for policy 1, policy_version 1867968 (0.0008) [2023-12-28 08:39:34,064][106226] Updated weights for policy 0, policy_version 1864076 (0.0008) [2023-12-28 08:39:34,122][106226] Updated weights for policy 0, policy_version 1864086 (0.0008) [2023-12-28 08:39:34,183][106226] Updated weights for policy 0, policy_version 1864096 (0.0010) [2023-12-28 08:39:34,769][106225] Updated weights for policy 1, policy_version 1867978 (0.0008) [2023-12-28 08:39:34,816][106225] Updated weights for policy 1, policy_version 1867988 (0.0007) [2023-12-28 08:39:34,869][106225] Updated weights for policy 1, policy_version 1867998 (0.0005) [2023-12-28 08:39:34,979][106226] Updated weights for policy 0, policy_version 1864106 (0.0009) [2023-12-28 08:39:35,047][106226] Updated weights for policy 0, policy_version 1864116 (0.0009) [2023-12-28 08:39:35,110][106226] Updated weights for policy 0, policy_version 1864126 (0.0009) [2023-12-28 08:39:35,178][106226] Updated weights for policy 0, policy_version 1864136 (0.0010) [2023-12-28 08:39:35,449][106225] Updated weights for policy 1, policy_version 1868008 (0.0006) [2023-12-28 08:39:35,513][106225] Updated weights for policy 1, policy_version 1868018 (0.0006) [2023-12-28 08:39:35,575][106225] Updated weights for policy 1, policy_version 1868028 (0.0006) [2023-12-28 08:39:35,912][106226] Updated weights for policy 0, policy_version 1864146 (0.0008) [2023-12-28 08:39:35,960][106226] Updated weights for policy 0, policy_version 1864156 (0.0008) [2023-12-28 08:39:36,010][106226] Updated weights for policy 0, policy_version 1864166 (0.0008) [2023-12-28 08:39:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 955580416. Throughput: 0: 10015.8, 1: 9842.9. Samples: 955589244. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:36,175][105115] Avg episode reward: [(0, '-4.219'), (1, '-4.392')] [2023-12-28 08:39:36,183][106225] Updated weights for policy 1, policy_version 1868038 (0.0008) [2023-12-28 08:39:36,244][106225] Updated weights for policy 1, policy_version 1868048 (0.0009) [2023-12-28 08:39:36,308][106225] Updated weights for policy 1, policy_version 1868058 (0.0007) [2023-12-28 08:39:36,714][106226] Updated weights for policy 0, policy_version 1864176 (0.0010) [2023-12-28 08:39:36,784][106226] Updated weights for policy 0, policy_version 1864186 (0.0010) [2023-12-28 08:39:36,857][106226] Updated weights for policy 0, policy_version 1864196 (0.0010) [2023-12-28 08:39:36,991][106225] Updated weights for policy 1, policy_version 1868068 (0.0009) [2023-12-28 08:39:37,040][106225] Updated weights for policy 1, policy_version 1868078 (0.0005) [2023-12-28 08:39:37,093][106225] Updated weights for policy 1, policy_version 1868088 (0.0007) [2023-12-28 08:39:37,439][106226] Updated weights for policy 0, policy_version 1864206 (0.0008) [2023-12-28 08:39:37,489][106226] Updated weights for policy 0, policy_version 1864216 (0.0008) [2023-12-28 08:39:37,542][106226] Updated weights for policy 0, policy_version 1864226 (0.0008) [2023-12-28 08:39:37,762][106225] Updated weights for policy 1, policy_version 1868098 (0.0008) [2023-12-28 08:39:37,819][106225] Updated weights for policy 1, policy_version 1868108 (0.0005) [2023-12-28 08:39:37,877][106225] Updated weights for policy 1, policy_version 1868118 (0.0005) [2023-12-28 08:39:37,935][106225] Updated weights for policy 1, policy_version 1868128 (0.0010) [2023-12-28 08:39:38,323][106226] Updated weights for policy 0, policy_version 1864236 (0.0008) [2023-12-28 08:39:38,380][106226] Updated weights for policy 0, policy_version 1864246 (0.0008) [2023-12-28 08:39:38,437][106226] Updated weights for policy 0, policy_version 1864256 (0.0008) [2023-12-28 08:39:38,621][106225] Updated weights for policy 1, policy_version 1868138 (0.0009) [2023-12-28 08:39:38,682][106225] Updated weights for policy 1, policy_version 1868148 (0.0011) [2023-12-28 08:39:38,736][106225] Updated weights for policy 1, policy_version 1868158 (0.0010) [2023-12-28 08:39:39,182][106226] Updated weights for policy 0, policy_version 1864266 (0.0006) [2023-12-28 08:39:39,261][106226] Updated weights for policy 0, policy_version 1864276 (0.0008) [2023-12-28 08:39:39,330][106226] Updated weights for policy 0, policy_version 1864286 (0.0008) [2023-12-28 08:39:39,384][106225] Updated weights for policy 1, policy_version 1868168 (0.0010) [2023-12-28 08:39:39,400][106226] Updated weights for policy 0, policy_version 1864296 (0.0010) [2023-12-28 08:39:39,448][106225] Updated weights for policy 1, policy_version 1868178 (0.0008) [2023-12-28 08:39:39,510][106225] Updated weights for policy 1, policy_version 1868188 (0.0008) [2023-12-28 08:39:40,085][106226] Updated weights for policy 0, policy_version 1864306 (0.0007) [2023-12-28 08:39:40,149][106226] Updated weights for policy 0, policy_version 1864316 (0.0009) [2023-12-28 08:39:40,211][106226] Updated weights for policy 0, policy_version 1864326 (0.0006) [2023-12-28 08:39:40,328][106225] Updated weights for policy 1, policy_version 1868198 (0.0008) [2023-12-28 08:39:40,389][106225] Updated weights for policy 1, policy_version 1868208 (0.0008) [2023-12-28 08:39:40,446][106225] Updated weights for policy 1, policy_version 1868218 (0.0005) [2023-12-28 08:39:40,856][106226] Updated weights for policy 0, policy_version 1864336 (0.0006) [2023-12-28 08:39:40,914][106226] Updated weights for policy 0, policy_version 1864346 (0.0006) [2023-12-28 08:39:40,969][106226] Updated weights for policy 0, policy_version 1864356 (0.0005) [2023-12-28 08:39:41,124][106225] Updated weights for policy 1, policy_version 1868228 (0.0007) [2023-12-28 08:39:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 955678720. Throughput: 0: 10024.1, 1: 9859.7. Samples: 955650276. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:41,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.711')] [2023-12-28 08:39:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001864360_477356032.pth... [2023-12-28 08:39:41,186][106225] Updated weights for policy 1, policy_version 1868238 (0.0010) [2023-12-28 08:39:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001863176_477052928.pth [2023-12-28 08:39:41,238][106225] Updated weights for policy 1, policy_version 1868248 (0.0009) [2023-12-28 08:39:41,285][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001868256_478330880.pth... [2023-12-28 08:39:41,289][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001867072_478027776.pth [2023-12-28 08:39:41,689][106226] Updated weights for policy 0, policy_version 1864366 (0.0007) [2023-12-28 08:39:41,756][106226] Updated weights for policy 0, policy_version 1864376 (0.0009) [2023-12-28 08:39:41,809][106226] Updated weights for policy 0, policy_version 1864386 (0.0009) [2023-12-28 08:39:42,018][106225] Updated weights for policy 1, policy_version 1868258 (0.0009) [2023-12-28 08:39:42,080][106225] Updated weights for policy 1, policy_version 1868268 (0.0011) [2023-12-28 08:39:42,142][106225] Updated weights for policy 1, policy_version 1868278 (0.0010) [2023-12-28 08:39:42,207][106225] Updated weights for policy 1, policy_version 1868288 (0.0010) [2023-12-28 08:39:42,567][106226] Updated weights for policy 0, policy_version 1864396 (0.0007) [2023-12-28 08:39:42,630][106226] Updated weights for policy 0, policy_version 1864406 (0.0006) [2023-12-28 08:39:42,695][106226] Updated weights for policy 0, policy_version 1864416 (0.0006) [2023-12-28 08:39:42,893][106225] Updated weights for policy 1, policy_version 1868298 (0.0011) [2023-12-28 08:39:42,956][106225] Updated weights for policy 1, policy_version 1868308 (0.0010) [2023-12-28 08:39:43,021][106225] Updated weights for policy 1, policy_version 1868318 (0.0010) [2023-12-28 08:39:43,351][106226] Updated weights for policy 0, policy_version 1864426 (0.0006) [2023-12-28 08:39:43,418][106226] Updated weights for policy 0, policy_version 1864436 (0.0008) [2023-12-28 08:39:43,468][106226] Updated weights for policy 0, policy_version 1864446 (0.0009) [2023-12-28 08:39:43,516][106226] Updated weights for policy 0, policy_version 1864456 (0.0009) [2023-12-28 08:39:43,681][106225] Updated weights for policy 1, policy_version 1868328 (0.0007) [2023-12-28 08:39:43,736][106225] Updated weights for policy 1, policy_version 1868338 (0.0008) [2023-12-28 08:39:43,793][106225] Updated weights for policy 1, policy_version 1868348 (0.0008) [2023-12-28 08:39:44,213][106226] Updated weights for policy 0, policy_version 1864466 (0.0006) [2023-12-28 08:39:44,276][106226] Updated weights for policy 0, policy_version 1864476 (0.0006) [2023-12-28 08:39:44,327][106226] Updated weights for policy 0, policy_version 1864486 (0.0008) [2023-12-28 08:39:44,469][106225] Updated weights for policy 1, policy_version 1868358 (0.0008) [2023-12-28 08:39:44,522][106225] Updated weights for policy 1, policy_version 1868368 (0.0009) [2023-12-28 08:39:44,574][106225] Updated weights for policy 1, policy_version 1868378 (0.0008) [2023-12-28 08:39:45,108][106226] Updated weights for policy 0, policy_version 1864496 (0.0010) [2023-12-28 08:39:45,165][106226] Updated weights for policy 0, policy_version 1864506 (0.0009) [2023-12-28 08:39:45,230][106226] Updated weights for policy 0, policy_version 1864516 (0.0009) [2023-12-28 08:39:45,286][106225] Updated weights for policy 1, policy_version 1868388 (0.0009) [2023-12-28 08:39:45,349][106225] Updated weights for policy 1, policy_version 1868398 (0.0009) [2023-12-28 08:39:45,413][106225] Updated weights for policy 1, policy_version 1868408 (0.0009) [2023-12-28 08:39:45,960][106226] Updated weights for policy 0, policy_version 1864526 (0.0010) [2023-12-28 08:39:46,015][106226] Updated weights for policy 0, policy_version 1864536 (0.0011) [2023-12-28 08:39:46,076][106226] Updated weights for policy 0, policy_version 1864546 (0.0011) [2023-12-28 08:39:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 955777024. Throughput: 0: 10015.9, 1: 9854.6. Samples: 955766932. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:46,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.915')] [2023-12-28 08:39:46,199][106225] Updated weights for policy 1, policy_version 1868418 (0.0007) [2023-12-28 08:39:46,258][106225] Updated weights for policy 1, policy_version 1868428 (0.0006) [2023-12-28 08:39:46,318][106225] Updated weights for policy 1, policy_version 1868438 (0.0008) [2023-12-28 08:39:46,376][106225] Updated weights for policy 1, policy_version 1868448 (0.0007) [2023-12-28 08:39:46,751][106226] Updated weights for policy 0, policy_version 1864556 (0.0011) [2023-12-28 08:39:46,811][106226] Updated weights for policy 0, policy_version 1864566 (0.0010) [2023-12-28 08:39:46,858][106226] Updated weights for policy 0, policy_version 1864576 (0.0010) [2023-12-28 08:39:47,015][106225] Updated weights for policy 1, policy_version 1868458 (0.0009) [2023-12-28 08:39:47,066][106225] Updated weights for policy 1, policy_version 1868468 (0.0009) [2023-12-28 08:39:47,121][106225] Updated weights for policy 1, policy_version 1868478 (0.0009) [2023-12-28 08:39:47,461][106226] Updated weights for policy 0, policy_version 1864586 (0.0010) [2023-12-28 08:39:47,524][106226] Updated weights for policy 0, policy_version 1864596 (0.0011) [2023-12-28 08:39:47,586][106226] Updated weights for policy 0, policy_version 1864606 (0.0011) [2023-12-28 08:39:47,646][106226] Updated weights for policy 0, policy_version 1864616 (0.0010) [2023-12-28 08:39:47,875][106225] Updated weights for policy 1, policy_version 1868488 (0.0007) [2023-12-28 08:39:47,928][106225] Updated weights for policy 1, policy_version 1868498 (0.0007) [2023-12-28 08:39:47,983][106225] Updated weights for policy 1, policy_version 1868508 (0.0005) [2023-12-28 08:39:48,324][106226] Updated weights for policy 0, policy_version 1864626 (0.0011) [2023-12-28 08:39:48,381][106226] Updated weights for policy 0, policy_version 1864636 (0.0011) [2023-12-28 08:39:48,443][106226] Updated weights for policy 0, policy_version 1864646 (0.0010) [2023-12-28 08:39:48,653][106225] Updated weights for policy 1, policy_version 1868518 (0.0008) [2023-12-28 08:39:48,721][106225] Updated weights for policy 1, policy_version 1868528 (0.0009) [2023-12-28 08:39:48,783][106225] Updated weights for policy 1, policy_version 1868538 (0.0007) [2023-12-28 08:39:49,096][106226] Updated weights for policy 0, policy_version 1864656 (0.0009) [2023-12-28 08:39:49,156][106226] Updated weights for policy 0, policy_version 1864666 (0.0008) [2023-12-28 08:39:49,218][106226] Updated weights for policy 0, policy_version 1864676 (0.0007) [2023-12-28 08:39:49,559][106225] Updated weights for policy 1, policy_version 1868548 (0.0008) [2023-12-28 08:39:49,614][106225] Updated weights for policy 1, policy_version 1868558 (0.0009) [2023-12-28 08:39:49,667][106225] Updated weights for policy 1, policy_version 1868568 (0.0008) [2023-12-28 08:39:49,889][106226] Updated weights for policy 0, policy_version 1864686 (0.0009) [2023-12-28 08:39:49,952][106226] Updated weights for policy 0, policy_version 1864696 (0.0007) [2023-12-28 08:39:50,016][106226] Updated weights for policy 0, policy_version 1864706 (0.0009) [2023-12-28 08:39:50,452][106225] Updated weights for policy 1, policy_version 1868578 (0.0009) [2023-12-28 08:39:50,498][106225] Updated weights for policy 1, policy_version 1868588 (0.0008) [2023-12-28 08:39:50,547][106225] Updated weights for policy 1, policy_version 1868598 (0.0008) [2023-12-28 08:39:50,612][106225] Updated weights for policy 1, policy_version 1868608 (0.0009) [2023-12-28 08:39:50,789][106226] Updated weights for policy 0, policy_version 1864716 (0.0009) [2023-12-28 08:39:50,850][106226] Updated weights for policy 0, policy_version 1864726 (0.0011) [2023-12-28 08:39:50,910][106226] Updated weights for policy 0, policy_version 1864736 (0.0010) [2023-12-28 08:39:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 955875328. Throughput: 0: 9951.3, 1: 9838.4. Samples: 955884508. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:51,176][105115] Avg episode reward: [(0, '-4.492'), (1, '-4.734')] [2023-12-28 08:39:51,428][106225] Updated weights for policy 1, policy_version 1868618 (0.0008) [2023-12-28 08:39:51,492][106225] Updated weights for policy 1, policy_version 1868628 (0.0009) [2023-12-28 08:39:51,555][106225] Updated weights for policy 1, policy_version 1868638 (0.0007) [2023-12-28 08:39:51,639][106226] Updated weights for policy 0, policy_version 1864746 (0.0010) [2023-12-28 08:39:51,706][106226] Updated weights for policy 0, policy_version 1864756 (0.0008) [2023-12-28 08:39:51,773][106226] Updated weights for policy 0, policy_version 1864766 (0.0006) [2023-12-28 08:39:51,840][106226] Updated weights for policy 0, policy_version 1864776 (0.0005) [2023-12-28 08:39:52,374][106225] Updated weights for policy 1, policy_version 1868649 (0.0009) [2023-12-28 08:39:52,420][106226] Updated weights for policy 0, policy_version 1864786 (0.0008) [2023-12-28 08:39:52,429][106225] Updated weights for policy 1, policy_version 1868659 (0.0009) [2023-12-28 08:39:52,483][106226] Updated weights for policy 0, policy_version 1864796 (0.0008) [2023-12-28 08:39:52,489][106225] Updated weights for policy 1, policy_version 1868669 (0.0007) [2023-12-28 08:39:52,541][106226] Updated weights for policy 0, policy_version 1864806 (0.0008) [2023-12-28 08:39:53,144][106225] Updated weights for policy 1, policy_version 1868679 (0.0008) [2023-12-28 08:39:53,198][106225] Updated weights for policy 1, policy_version 1868689 (0.0008) [2023-12-28 08:39:53,263][106225] Updated weights for policy 1, policy_version 1868699 (0.0006) [2023-12-28 08:39:53,328][106226] Updated weights for policy 0, policy_version 1864816 (0.0008) [2023-12-28 08:39:53,382][106226] Updated weights for policy 0, policy_version 1864826 (0.0008) [2023-12-28 08:39:53,433][106226] Updated weights for policy 0, policy_version 1864836 (0.0009) [2023-12-28 08:39:53,797][106225] Updated weights for policy 1, policy_version 1868709 (0.0005) [2023-12-28 08:39:53,850][106225] Updated weights for policy 1, policy_version 1868719 (0.0005) [2023-12-28 08:39:53,913][106225] Updated weights for policy 1, policy_version 1868729 (0.0005) [2023-12-28 08:39:54,178][106226] Updated weights for policy 0, policy_version 1864846 (0.0008) [2023-12-28 08:39:54,231][106226] Updated weights for policy 0, policy_version 1864856 (0.0008) [2023-12-28 08:39:54,289][106226] Updated weights for policy 0, policy_version 1864866 (0.0009) [2023-12-28 08:39:54,518][106225] Updated weights for policy 1, policy_version 1868739 (0.0006) [2023-12-28 08:39:54,569][106225] Updated weights for policy 1, policy_version 1868749 (0.0006) [2023-12-28 08:39:54,623][106225] Updated weights for policy 1, policy_version 1868759 (0.0005) [2023-12-28 08:39:54,935][106226] Updated weights for policy 0, policy_version 1864876 (0.0009) [2023-12-28 08:39:54,989][106226] Updated weights for policy 0, policy_version 1864886 (0.0010) [2023-12-28 08:39:55,053][106226] Updated weights for policy 0, policy_version 1864896 (0.0011) [2023-12-28 08:39:55,244][106225] Updated weights for policy 1, policy_version 1868769 (0.0006) [2023-12-28 08:39:55,293][106225] Updated weights for policy 1, policy_version 1868779 (0.0010) [2023-12-28 08:39:55,343][106225] Updated weights for policy 1, policy_version 1868789 (0.0010) [2023-12-28 08:39:55,394][106225] Updated weights for policy 1, policy_version 1868799 (0.0010) [2023-12-28 08:39:55,676][106226] Updated weights for policy 0, policy_version 1864906 (0.0010) [2023-12-28 08:39:55,731][106226] Updated weights for policy 0, policy_version 1864916 (0.0010) [2023-12-28 08:39:55,788][106226] Updated weights for policy 0, policy_version 1864926 (0.0010) [2023-12-28 08:39:55,844][106226] Updated weights for policy 0, policy_version 1864936 (0.0010) [2023-12-28 08:39:56,051][106225] Updated weights for policy 1, policy_version 1868809 (0.0006) [2023-12-28 08:39:56,101][106225] Updated weights for policy 1, policy_version 1868819 (0.0007) [2023-12-28 08:39:56,152][106225] Updated weights for policy 1, policy_version 1868829 (0.0008) [2023-12-28 08:39:56,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 955981824. Throughput: 0: 9928.4, 1: 9824.1. Samples: 955943136. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:39:56,175][105115] Avg episode reward: [(0, '-4.400'), (1, '-4.728')] [2023-12-28 08:39:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001868832_478478336.pth... [2023-12-28 08:39:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001864936_477503488.pth... [2023-12-28 08:39:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001867648_478175232.pth [2023-12-28 08:39:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001863784_477208576.pth [2023-12-28 08:39:56,531][106226] Updated weights for policy 0, policy_version 1864946 (0.0010) [2023-12-28 08:39:56,588][106226] Updated weights for policy 0, policy_version 1864956 (0.0008) [2023-12-28 08:39:56,639][106226] Updated weights for policy 0, policy_version 1864966 (0.0007) [2023-12-28 08:39:56,912][106225] Updated weights for policy 1, policy_version 1868839 (0.0008) [2023-12-28 08:39:56,972][106225] Updated weights for policy 1, policy_version 1868849 (0.0005) [2023-12-28 08:39:57,023][106225] Updated weights for policy 1, policy_version 1868859 (0.0005) [2023-12-28 08:39:57,304][106226] Updated weights for policy 0, policy_version 1864976 (0.0009) [2023-12-28 08:39:57,354][106226] Updated weights for policy 0, policy_version 1864986 (0.0011) [2023-12-28 08:39:57,406][106226] Updated weights for policy 0, policy_version 1864996 (0.0010) [2023-12-28 08:39:57,638][106225] Updated weights for policy 1, policy_version 1868869 (0.0006) [2023-12-28 08:39:57,695][106225] Updated weights for policy 1, policy_version 1868879 (0.0009) [2023-12-28 08:39:57,745][106225] Updated weights for policy 1, policy_version 1868889 (0.0009) [2023-12-28 08:39:58,016][106226] Updated weights for policy 0, policy_version 1865006 (0.0008) [2023-12-28 08:39:58,076][106226] Updated weights for policy 0, policy_version 1865016 (0.0010) [2023-12-28 08:39:58,132][106226] Updated weights for policy 0, policy_version 1865026 (0.0009) [2023-12-28 08:39:58,525][106225] Updated weights for policy 1, policy_version 1868899 (0.0008) [2023-12-28 08:39:58,588][106225] Updated weights for policy 1, policy_version 1868909 (0.0009) [2023-12-28 08:39:58,647][106225] Updated weights for policy 1, policy_version 1868919 (0.0009) [2023-12-28 08:39:58,962][106226] Updated weights for policy 0, policy_version 1865036 (0.0012) [2023-12-28 08:39:59,039][106226] Updated weights for policy 0, policy_version 1865046 (0.0012) [2023-12-28 08:39:59,107][106226] Updated weights for policy 0, policy_version 1865056 (0.0006) [2023-12-28 08:39:59,611][106225] Updated weights for policy 1, policy_version 1868929 (0.0006) [2023-12-28 08:39:59,669][106225] Updated weights for policy 1, policy_version 1868939 (0.0008) [2023-12-28 08:39:59,730][106225] Updated weights for policy 1, policy_version 1868949 (0.0009) [2023-12-28 08:39:59,785][106225] Updated weights for policy 1, policy_version 1868959 (0.0007) [2023-12-28 08:39:59,861][106226] Updated weights for policy 0, policy_version 1865066 (0.0007) [2023-12-28 08:39:59,924][106226] Updated weights for policy 0, policy_version 1865076 (0.0007) [2023-12-28 08:39:59,986][106226] Updated weights for policy 0, policy_version 1865086 (0.0009) [2023-12-28 08:40:00,042][106226] Updated weights for policy 0, policy_version 1865096 (0.0009) [2023-12-28 08:40:00,602][106225] Updated weights for policy 1, policy_version 1868969 (0.0008) [2023-12-28 08:40:00,656][106225] Updated weights for policy 1, policy_version 1868979 (0.0008) [2023-12-28 08:40:00,718][106225] Updated weights for policy 1, policy_version 1868989 (0.0008) [2023-12-28 08:40:00,839][106226] Updated weights for policy 0, policy_version 1865106 (0.0011) [2023-12-28 08:40:00,898][106226] Updated weights for policy 0, policy_version 1865116 (0.0010) [2023-12-28 08:40:00,952][106226] Updated weights for policy 0, policy_version 1865126 (0.0010) [2023-12-28 08:40:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 956071936. Throughput: 0: 9941.3, 1: 9831.5. Samples: 956062044. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:01,176][105115] Avg episode reward: [(0, '-4.555'), (1, '-4.392')] [2023-12-28 08:40:01,449][106225] Updated weights for policy 1, policy_version 1868999 (0.0009) [2023-12-28 08:40:01,513][106225] Updated weights for policy 1, policy_version 1869009 (0.0010) [2023-12-28 08:40:01,573][106225] Updated weights for policy 1, policy_version 1869019 (0.0010) [2023-12-28 08:40:01,698][106226] Updated weights for policy 0, policy_version 1865136 (0.0008) [2023-12-28 08:40:01,759][106226] Updated weights for policy 0, policy_version 1865146 (0.0012) [2023-12-28 08:40:01,817][106226] Updated weights for policy 0, policy_version 1865156 (0.0010) [2023-12-28 08:40:02,321][106225] Updated weights for policy 1, policy_version 1869029 (0.0010) [2023-12-28 08:40:02,382][106225] Updated weights for policy 1, policy_version 1869039 (0.0009) [2023-12-28 08:40:02,414][106226] Updated weights for policy 0, policy_version 1865166 (0.0011) [2023-12-28 08:40:02,444][106225] Updated weights for policy 1, policy_version 1869049 (0.0007) [2023-12-28 08:40:02,464][106226] Updated weights for policy 0, policy_version 1865176 (0.0010) [2023-12-28 08:40:02,514][106226] Updated weights for policy 0, policy_version 1865186 (0.0010) [2023-12-28 08:40:03,073][106225] Updated weights for policy 1, policy_version 1869059 (0.0009) [2023-12-28 08:40:03,105][106226] Updated weights for policy 0, policy_version 1865196 (0.0008) [2023-12-28 08:40:03,128][106225] Updated weights for policy 1, policy_version 1869069 (0.0006) [2023-12-28 08:40:03,170][106226] Updated weights for policy 0, policy_version 1865206 (0.0005) [2023-12-28 08:40:03,177][106225] Updated weights for policy 1, policy_version 1869079 (0.0008) [2023-12-28 08:40:03,229][106226] Updated weights for policy 0, policy_version 1865216 (0.0005) [2023-12-28 08:40:03,746][106225] Updated weights for policy 1, policy_version 1869089 (0.0008) [2023-12-28 08:40:03,812][106225] Updated weights for policy 1, policy_version 1869099 (0.0006) [2023-12-28 08:40:03,829][106226] Updated weights for policy 0, policy_version 1865226 (0.0008) [2023-12-28 08:40:03,876][106225] Updated weights for policy 1, policy_version 1869109 (0.0008) [2023-12-28 08:40:03,895][106226] Updated weights for policy 0, policy_version 1865236 (0.0008) [2023-12-28 08:40:03,938][106225] Updated weights for policy 1, policy_version 1869119 (0.0007) [2023-12-28 08:40:03,959][106226] Updated weights for policy 0, policy_version 1865246 (0.0008) [2023-12-28 08:40:04,025][106226] Updated weights for policy 0, policy_version 1865256 (0.0009) [2023-12-28 08:40:04,631][106225] Updated weights for policy 1, policy_version 1869129 (0.0009) [2023-12-28 08:40:04,695][106225] Updated weights for policy 1, policy_version 1869139 (0.0009) [2023-12-28 08:40:04,738][106226] Updated weights for policy 0, policy_version 1865266 (0.0007) [2023-12-28 08:40:04,755][106225] Updated weights for policy 1, policy_version 1869149 (0.0008) [2023-12-28 08:40:04,797][106226] Updated weights for policy 0, policy_version 1865276 (0.0007) [2023-12-28 08:40:04,864][106226] Updated weights for policy 0, policy_version 1865286 (0.0009) [2023-12-28 08:40:05,402][106225] Updated weights for policy 1, policy_version 1869159 (0.0008) [2023-12-28 08:40:05,461][106225] Updated weights for policy 1, policy_version 1869169 (0.0010) [2023-12-28 08:40:05,494][106226] Updated weights for policy 0, policy_version 1865296 (0.0006) [2023-12-28 08:40:05,515][106225] Updated weights for policy 1, policy_version 1869179 (0.0010) [2023-12-28 08:40:05,556][106226] Updated weights for policy 0, policy_version 1865306 (0.0007) [2023-12-28 08:40:05,607][106226] Updated weights for policy 0, policy_version 1865316 (0.0008) [2023-12-28 08:40:06,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 956170240. Throughput: 0: 10003.9, 1: 9824.6. Samples: 956182720. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:06,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.858')] [2023-12-28 08:40:06,241][106225] Updated weights for policy 1, policy_version 1869189 (0.0011) [2023-12-28 08:40:06,306][106225] Updated weights for policy 1, policy_version 1869199 (0.0010) [2023-12-28 08:40:06,339][106226] Updated weights for policy 0, policy_version 1865326 (0.0008) [2023-12-28 08:40:06,374][106225] Updated weights for policy 1, policy_version 1869209 (0.0011) [2023-12-28 08:40:06,408][106226] Updated weights for policy 0, policy_version 1865336 (0.0007) [2023-12-28 08:40:06,471][106226] Updated weights for policy 0, policy_version 1865346 (0.0006) [2023-12-28 08:40:07,054][106225] Updated weights for policy 1, policy_version 1869219 (0.0010) [2023-12-28 08:40:07,067][106226] Updated weights for policy 0, policy_version 1865356 (0.0006) [2023-12-28 08:40:07,113][106225] Updated weights for policy 1, policy_version 1869229 (0.0011) [2023-12-28 08:40:07,126][106226] Updated weights for policy 0, policy_version 1865366 (0.0006) [2023-12-28 08:40:07,174][106225] Updated weights for policy 1, policy_version 1869239 (0.0010) [2023-12-28 08:40:07,184][106226] Updated weights for policy 0, policy_version 1865376 (0.0006) [2023-12-28 08:40:07,725][106225] Updated weights for policy 1, policy_version 1869249 (0.0010) [2023-12-28 08:40:07,774][106225] Updated weights for policy 1, policy_version 1869259 (0.0010) [2023-12-28 08:40:07,823][106225] Updated weights for policy 1, policy_version 1869269 (0.0008) [2023-12-28 08:40:07,833][106226] Updated weights for policy 0, policy_version 1865386 (0.0006) [2023-12-28 08:40:07,882][106225] Updated weights for policy 1, policy_version 1869279 (0.0005) [2023-12-28 08:40:07,894][106226] Updated weights for policy 0, policy_version 1865396 (0.0008) [2023-12-28 08:40:07,956][106226] Updated weights for policy 0, policy_version 1865406 (0.0007) [2023-12-28 08:40:08,004][106226] Updated weights for policy 0, policy_version 1865416 (0.0008) [2023-12-28 08:40:08,445][106225] Updated weights for policy 1, policy_version 1869289 (0.0009) [2023-12-28 08:40:08,515][106225] Updated weights for policy 1, policy_version 1869299 (0.0010) [2023-12-28 08:40:08,577][106225] Updated weights for policy 1, policy_version 1869309 (0.0010) [2023-12-28 08:40:08,784][106226] Updated weights for policy 0, policy_version 1865426 (0.0007) [2023-12-28 08:40:08,843][106226] Updated weights for policy 0, policy_version 1865436 (0.0005) [2023-12-28 08:40:08,903][106226] Updated weights for policy 0, policy_version 1865446 (0.0007) [2023-12-28 08:40:09,212][106225] Updated weights for policy 1, policy_version 1869319 (0.0007) [2023-12-28 08:40:09,279][106225] Updated weights for policy 1, policy_version 1869329 (0.0008) [2023-12-28 08:40:09,341][106225] Updated weights for policy 1, policy_version 1869339 (0.0008) [2023-12-28 08:40:09,634][106226] Updated weights for policy 0, policy_version 1865456 (0.0010) [2023-12-28 08:40:09,699][106226] Updated weights for policy 0, policy_version 1865466 (0.0011) [2023-12-28 08:40:09,747][106226] Updated weights for policy 0, policy_version 1865476 (0.0011) [2023-12-28 08:40:10,058][106225] Updated weights for policy 1, policy_version 1869349 (0.0009) [2023-12-28 08:40:10,120][106225] Updated weights for policy 1, policy_version 1869359 (0.0009) [2023-12-28 08:40:10,183][106225] Updated weights for policy 1, policy_version 1869369 (0.0012) [2023-12-28 08:40:10,497][106226] Updated weights for policy 0, policy_version 1865486 (0.0009) [2023-12-28 08:40:10,560][106226] Updated weights for policy 0, policy_version 1865496 (0.0008) [2023-12-28 08:40:10,622][106226] Updated weights for policy 0, policy_version 1865506 (0.0009) [2023-12-28 08:40:10,899][106225] Updated weights for policy 1, policy_version 1869379 (0.0010) [2023-12-28 08:40:10,951][106225] Updated weights for policy 1, policy_version 1869389 (0.0009) [2023-12-28 08:40:11,008][106225] Updated weights for policy 1, policy_version 1869399 (0.0008) [2023-12-28 08:40:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 956276736. Throughput: 0: 10036.7, 1: 9928.2. Samples: 956245176. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:11,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.718')] [2023-12-28 08:40:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001869408_478625792.pth... [2023-12-28 08:40:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001865512_477650944.pth... [2023-12-28 08:40:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001868256_478330880.pth [2023-12-28 08:40:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001864360_477356032.pth [2023-12-28 08:40:11,339][106226] Updated weights for policy 0, policy_version 1865516 (0.0008) [2023-12-28 08:40:11,412][106226] Updated weights for policy 0, policy_version 1865526 (0.0008) [2023-12-28 08:40:11,470][106226] Updated weights for policy 0, policy_version 1865536 (0.0010) [2023-12-28 08:40:11,825][106225] Updated weights for policy 1, policy_version 1869409 (0.0008) [2023-12-28 08:40:11,883][106225] Updated weights for policy 1, policy_version 1869419 (0.0010) [2023-12-28 08:40:11,948][106225] Updated weights for policy 1, policy_version 1869429 (0.0010) [2023-12-28 08:40:12,006][106225] Updated weights for policy 1, policy_version 1869439 (0.0011) [2023-12-28 08:40:12,199][106226] Updated weights for policy 0, policy_version 1865546 (0.0010) [2023-12-28 08:40:12,270][106226] Updated weights for policy 0, policy_version 1865556 (0.0007) [2023-12-28 08:40:12,337][106226] Updated weights for policy 0, policy_version 1865566 (0.0010) [2023-12-28 08:40:12,403][106226] Updated weights for policy 0, policy_version 1865576 (0.0009) [2023-12-28 08:40:12,718][106225] Updated weights for policy 1, policy_version 1869449 (0.0010) [2023-12-28 08:40:12,788][106225] Updated weights for policy 1, policy_version 1869459 (0.0010) [2023-12-28 08:40:12,849][106225] Updated weights for policy 1, policy_version 1869469 (0.0010) [2023-12-28 08:40:12,980][106226] Updated weights for policy 0, policy_version 1865586 (0.0010) [2023-12-28 08:40:13,027][106226] Updated weights for policy 0, policy_version 1865596 (0.0010) [2023-12-28 08:40:13,075][106226] Updated weights for policy 0, policy_version 1865606 (0.0009) [2023-12-28 08:40:13,429][106225] Updated weights for policy 1, policy_version 1869479 (0.0010) [2023-12-28 08:40:13,476][106225] Updated weights for policy 1, policy_version 1869489 (0.0010) [2023-12-28 08:40:13,530][106225] Updated weights for policy 1, policy_version 1869499 (0.0010) [2023-12-28 08:40:13,754][106226] Updated weights for policy 0, policy_version 1865616 (0.0007) [2023-12-28 08:40:13,807][106226] Updated weights for policy 0, policy_version 1865626 (0.0010) [2023-12-28 08:40:13,856][106226] Updated weights for policy 0, policy_version 1865636 (0.0010) [2023-12-28 08:40:14,255][106225] Updated weights for policy 1, policy_version 1869509 (0.0010) [2023-12-28 08:40:14,328][106225] Updated weights for policy 1, policy_version 1869519 (0.0010) [2023-12-28 08:40:14,391][106225] Updated weights for policy 1, policy_version 1869529 (0.0010) [2023-12-28 08:40:14,492][106226] Updated weights for policy 0, policy_version 1865646 (0.0008) [2023-12-28 08:40:14,538][106226] Updated weights for policy 0, policy_version 1865656 (0.0007) [2023-12-28 08:40:14,595][106226] Updated weights for policy 0, policy_version 1865666 (0.0008) [2023-12-28 08:40:15,035][106225] Updated weights for policy 1, policy_version 1869539 (0.0010) [2023-12-28 08:40:15,096][106225] Updated weights for policy 1, policy_version 1869549 (0.0009) [2023-12-28 08:40:15,164][106225] Updated weights for policy 1, policy_version 1869559 (0.0009) [2023-12-28 08:40:15,386][106226] Updated weights for policy 0, policy_version 1865676 (0.0008) [2023-12-28 08:40:15,439][106226] Updated weights for policy 0, policy_version 1865686 (0.0008) [2023-12-28 08:40:15,497][106226] Updated weights for policy 0, policy_version 1865696 (0.0008) [2023-12-28 08:40:15,817][106225] Updated weights for policy 1, policy_version 1869569 (0.0008) [2023-12-28 08:40:15,878][106225] Updated weights for policy 1, policy_version 1869579 (0.0005) [2023-12-28 08:40:15,939][106225] Updated weights for policy 1, policy_version 1869589 (0.0007) [2023-12-28 08:40:15,999][106225] Updated weights for policy 1, policy_version 1869599 (0.0009) [2023-12-28 08:40:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 956375040. Throughput: 0: 9932.7, 1: 9908.1. Samples: 956363216. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:16,175][105115] Avg episode reward: [(0, '-4.405'), (1, '-4.568')] [2023-12-28 08:40:16,350][106226] Updated weights for policy 0, policy_version 1865706 (0.0010) [2023-12-28 08:40:16,411][106226] Updated weights for policy 0, policy_version 1865716 (0.0006) [2023-12-28 08:40:16,466][106226] Updated weights for policy 0, policy_version 1865726 (0.0005) [2023-12-28 08:40:16,519][106226] Updated weights for policy 0, policy_version 1865736 (0.0006) [2023-12-28 08:40:16,630][106225] Updated weights for policy 1, policy_version 1869609 (0.0007) [2023-12-28 08:40:16,688][106225] Updated weights for policy 1, policy_version 1869619 (0.0008) [2023-12-28 08:40:16,733][106225] Updated weights for policy 1, policy_version 1869629 (0.0008) [2023-12-28 08:40:17,132][106226] Updated weights for policy 0, policy_version 1865746 (0.0009) [2023-12-28 08:40:17,178][106226] Updated weights for policy 0, policy_version 1865756 (0.0007) [2023-12-28 08:40:17,236][106226] Updated weights for policy 0, policy_version 1865766 (0.0008) [2023-12-28 08:40:17,450][106225] Updated weights for policy 1, policy_version 1869639 (0.0008) [2023-12-28 08:40:17,506][106225] Updated weights for policy 1, policy_version 1869649 (0.0005) [2023-12-28 08:40:17,560][106225] Updated weights for policy 1, policy_version 1869659 (0.0005) [2023-12-28 08:40:17,972][106226] Updated weights for policy 0, policy_version 1865776 (0.0007) [2023-12-28 08:40:18,026][106226] Updated weights for policy 0, policy_version 1865786 (0.0007) [2023-12-28 08:40:18,075][106226] Updated weights for policy 0, policy_version 1865796 (0.0005) [2023-12-28 08:40:18,241][106225] Updated weights for policy 1, policy_version 1869669 (0.0008) [2023-12-28 08:40:18,297][106225] Updated weights for policy 1, policy_version 1869679 (0.0010) [2023-12-28 08:40:18,357][106225] Updated weights for policy 1, policy_version 1869689 (0.0008) [2023-12-28 08:40:18,712][106226] Updated weights for policy 0, policy_version 1865806 (0.0006) [2023-12-28 08:40:18,775][106226] Updated weights for policy 0, policy_version 1865816 (0.0009) [2023-12-28 08:40:18,837][106226] Updated weights for policy 0, policy_version 1865826 (0.0005) [2023-12-28 08:40:19,091][106225] Updated weights for policy 1, policy_version 1869699 (0.0008) [2023-12-28 08:40:19,163][106225] Updated weights for policy 1, policy_version 1869709 (0.0010) [2023-12-28 08:40:19,232][106225] Updated weights for policy 1, policy_version 1869719 (0.0010) [2023-12-28 08:40:19,445][106226] Updated weights for policy 0, policy_version 1865836 (0.0006) [2023-12-28 08:40:19,520][106226] Updated weights for policy 0, policy_version 1865846 (0.0007) [2023-12-28 08:40:19,579][106226] Updated weights for policy 0, policy_version 1865856 (0.0009) [2023-12-28 08:40:19,878][106225] Updated weights for policy 1, policy_version 1869729 (0.0009) [2023-12-28 08:40:19,943][106225] Updated weights for policy 1, policy_version 1869739 (0.0008) [2023-12-28 08:40:20,006][106225] Updated weights for policy 1, policy_version 1869749 (0.0007) [2023-12-28 08:40:20,056][106225] Updated weights for policy 1, policy_version 1869759 (0.0008) [2023-12-28 08:40:20,374][106226] Updated weights for policy 0, policy_version 1865866 (0.0009) [2023-12-28 08:40:20,438][106226] Updated weights for policy 0, policy_version 1865876 (0.0008) [2023-12-28 08:40:20,502][106226] Updated weights for policy 0, policy_version 1865886 (0.0009) [2023-12-28 08:40:20,568][106226] Updated weights for policy 0, policy_version 1865896 (0.0008) [2023-12-28 08:40:20,839][106225] Updated weights for policy 1, policy_version 1869769 (0.0009) [2023-12-28 08:40:20,908][106225] Updated weights for policy 1, policy_version 1869779 (0.0009) [2023-12-28 08:40:20,965][106225] Updated weights for policy 1, policy_version 1869789 (0.0008) [2023-12-28 08:40:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 956473344. Throughput: 0: 9920.5, 1: 9919.5. Samples: 956482048. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:21,175][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.795')] [2023-12-28 08:40:21,405][106226] Updated weights for policy 0, policy_version 1865906 (0.0009) [2023-12-28 08:40:21,458][106226] Updated weights for policy 0, policy_version 1865916 (0.0007) [2023-12-28 08:40:21,514][106226] Updated weights for policy 0, policy_version 1865926 (0.0008) [2023-12-28 08:40:21,702][106225] Updated weights for policy 1, policy_version 1869799 (0.0008) [2023-12-28 08:40:21,770][106225] Updated weights for policy 1, policy_version 1869809 (0.0008) [2023-12-28 08:40:21,830][106225] Updated weights for policy 1, policy_version 1869819 (0.0008) [2023-12-28 08:40:22,236][106226] Updated weights for policy 0, policy_version 1865936 (0.0008) [2023-12-28 08:40:22,297][106226] Updated weights for policy 0, policy_version 1865946 (0.0010) [2023-12-28 08:40:22,355][106226] Updated weights for policy 0, policy_version 1865956 (0.0008) [2023-12-28 08:40:22,621][106225] Updated weights for policy 1, policy_version 1869829 (0.0008) [2023-12-28 08:40:22,679][106225] Updated weights for policy 1, policy_version 1869839 (0.0009) [2023-12-28 08:40:22,733][106225] Updated weights for policy 1, policy_version 1869849 (0.0010) [2023-12-28 08:40:23,057][106226] Updated weights for policy 0, policy_version 1865966 (0.0008) [2023-12-28 08:40:23,117][106226] Updated weights for policy 0, policy_version 1865976 (0.0008) [2023-12-28 08:40:23,175][106226] Updated weights for policy 0, policy_version 1865986 (0.0008) [2023-12-28 08:40:23,464][106225] Updated weights for policy 1, policy_version 1869859 (0.0007) [2023-12-28 08:40:23,522][106225] Updated weights for policy 1, policy_version 1869869 (0.0009) [2023-12-28 08:40:23,572][106225] Updated weights for policy 1, policy_version 1869879 (0.0008) [2023-12-28 08:40:23,801][106226] Updated weights for policy 0, policy_version 1865996 (0.0009) [2023-12-28 08:40:23,864][106226] Updated weights for policy 0, policy_version 1866006 (0.0007) [2023-12-28 08:40:23,928][106226] Updated weights for policy 0, policy_version 1866016 (0.0005) [2023-12-28 08:40:24,202][106225] Updated weights for policy 1, policy_version 1869889 (0.0008) [2023-12-28 08:40:24,251][106225] Updated weights for policy 1, policy_version 1869899 (0.0008) [2023-12-28 08:40:24,301][106225] Updated weights for policy 1, policy_version 1869909 (0.0007) [2023-12-28 08:40:24,354][106225] Updated weights for policy 1, policy_version 1869919 (0.0008) [2023-12-28 08:40:24,590][106226] Updated weights for policy 0, policy_version 1866026 (0.0008) [2023-12-28 08:40:24,643][106226] Updated weights for policy 0, policy_version 1866036 (0.0008) [2023-12-28 08:40:24,693][106226] Updated weights for policy 0, policy_version 1866046 (0.0011) [2023-12-28 08:40:24,740][106226] Updated weights for policy 0, policy_version 1866056 (0.0010) [2023-12-28 08:40:25,140][106225] Updated weights for policy 1, policy_version 1869929 (0.0008) [2023-12-28 08:40:25,190][106225] Updated weights for policy 1, policy_version 1869939 (0.0008) [2023-12-28 08:40:25,242][106225] Updated weights for policy 1, policy_version 1869949 (0.0007) [2023-12-28 08:40:25,421][106226] Updated weights for policy 0, policy_version 1866066 (0.0010) [2023-12-28 08:40:25,473][106226] Updated weights for policy 0, policy_version 1866076 (0.0010) [2023-12-28 08:40:25,536][106226] Updated weights for policy 0, policy_version 1866086 (0.0011) [2023-12-28 08:40:25,920][106225] Updated weights for policy 1, policy_version 1869959 (0.0006) [2023-12-28 08:40:25,982][106225] Updated weights for policy 1, policy_version 1869969 (0.0007) [2023-12-28 08:40:26,039][106225] Updated weights for policy 1, policy_version 1869979 (0.0010) [2023-12-28 08:40:26,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 956571648. Throughput: 0: 9891.6, 1: 9853.0. Samples: 956538780. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:26,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.399')] [2023-12-28 08:40:26,176][106226] Updated weights for policy 0, policy_version 1866096 (0.0006) [2023-12-28 08:40:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001869984_478773248.pth... [2023-12-28 08:40:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001868832_478478336.pth [2023-12-28 08:40:26,230][106226] Updated weights for policy 0, policy_version 1866106 (0.0006) [2023-12-28 08:40:26,287][106226] Updated weights for policy 0, policy_version 1866116 (0.0007) [2023-12-28 08:40:26,312][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001866120_477806592.pth... [2023-12-28 08:40:26,317][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001864936_477503488.pth [2023-12-28 08:40:26,608][106225] Updated weights for policy 1, policy_version 1869989 (0.0008) [2023-12-28 08:40:26,674][106225] Updated weights for policy 1, policy_version 1869999 (0.0005) [2023-12-28 08:40:26,739][106225] Updated weights for policy 1, policy_version 1870009 (0.0006) [2023-12-28 08:40:26,844][106226] Updated weights for policy 0, policy_version 1866126 (0.0005) [2023-12-28 08:40:26,910][106226] Updated weights for policy 0, policy_version 1866136 (0.0005) [2023-12-28 08:40:26,979][106226] Updated weights for policy 0, policy_version 1866146 (0.0005) [2023-12-28 08:40:27,380][106225] Updated weights for policy 1, policy_version 1870019 (0.0010) [2023-12-28 08:40:27,434][106225] Updated weights for policy 1, policy_version 1870029 (0.0010) [2023-12-28 08:40:27,484][106225] Updated weights for policy 1, policy_version 1870039 (0.0010) [2023-12-28 08:40:27,507][106226] Updated weights for policy 0, policy_version 1866156 (0.0008) [2023-12-28 08:40:27,563][106226] Updated weights for policy 0, policy_version 1866166 (0.0006) [2023-12-28 08:40:27,613][106226] Updated weights for policy 0, policy_version 1866176 (0.0008) [2023-12-28 08:40:28,057][106225] Updated weights for policy 1, policy_version 1870049 (0.0007) [2023-12-28 08:40:28,119][106225] Updated weights for policy 1, policy_version 1870059 (0.0010) [2023-12-28 08:40:28,181][106225] Updated weights for policy 1, policy_version 1870069 (0.0009) [2023-12-28 08:40:28,190][106226] Updated weights for policy 0, policy_version 1866186 (0.0005) [2023-12-28 08:40:28,235][106225] Updated weights for policy 1, policy_version 1870079 (0.0010) [2023-12-28 08:40:28,251][106226] Updated weights for policy 0, policy_version 1866196 (0.0009) [2023-12-28 08:40:28,314][106226] Updated weights for policy 0, policy_version 1866206 (0.0007) [2023-12-28 08:40:28,378][106226] Updated weights for policy 0, policy_version 1866216 (0.0010) [2023-12-28 08:40:28,939][106225] Updated weights for policy 1, policy_version 1870089 (0.0010) [2023-12-28 08:40:28,992][106225] Updated weights for policy 1, policy_version 1870099 (0.0006) [2023-12-28 08:40:29,053][106225] Updated weights for policy 1, policy_version 1870109 (0.0006) [2023-12-28 08:40:29,102][106226] Updated weights for policy 0, policy_version 1866226 (0.0010) [2023-12-28 08:40:29,158][106226] Updated weights for policy 0, policy_version 1866236 (0.0010) [2023-12-28 08:40:29,220][106226] Updated weights for policy 0, policy_version 1866246 (0.0010) [2023-12-28 08:40:29,780][106225] Updated weights for policy 1, policy_version 1870119 (0.0007) [2023-12-28 08:40:29,849][106225] Updated weights for policy 1, policy_version 1870129 (0.0009) [2023-12-28 08:40:29,914][106225] Updated weights for policy 1, policy_version 1870139 (0.0007) [2023-12-28 08:40:29,990][106226] Updated weights for policy 0, policy_version 1866256 (0.0011) [2023-12-28 08:40:30,054][106226] Updated weights for policy 0, policy_version 1866266 (0.0011) [2023-12-28 08:40:30,113][106226] Updated weights for policy 0, policy_version 1866276 (0.0011) [2023-12-28 08:40:30,637][106225] Updated weights for policy 1, policy_version 1870149 (0.0008) [2023-12-28 08:40:30,696][106225] Updated weights for policy 1, policy_version 1870159 (0.0008) [2023-12-28 08:40:30,757][106225] Updated weights for policy 1, policy_version 1870169 (0.0008) [2023-12-28 08:40:30,810][106226] Updated weights for policy 0, policy_version 1866286 (0.0009) [2023-12-28 08:40:30,867][106226] Updated weights for policy 0, policy_version 1866296 (0.0006) [2023-12-28 08:40:30,926][106226] Updated weights for policy 0, policy_version 1866306 (0.0009) [2023-12-28 08:40:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 956678144. Throughput: 0: 10016.2, 1: 9970.3. Samples: 956666324. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:31,175][105115] Avg episode reward: [(0, '-4.408'), (1, '-4.661')] [2023-12-28 08:40:31,446][106225] Updated weights for policy 1, policy_version 1870179 (0.0009) [2023-12-28 08:40:31,498][106225] Updated weights for policy 1, policy_version 1870189 (0.0005) [2023-12-28 08:40:31,549][106225] Updated weights for policy 1, policy_version 1870199 (0.0005) [2023-12-28 08:40:31,678][106226] Updated weights for policy 0, policy_version 1866316 (0.0009) [2023-12-28 08:40:31,741][106226] Updated weights for policy 0, policy_version 1866326 (0.0008) [2023-12-28 08:40:31,795][106226] Updated weights for policy 0, policy_version 1866336 (0.0009) [2023-12-28 08:40:32,293][106225] Updated weights for policy 1, policy_version 1870209 (0.0007) [2023-12-28 08:40:32,356][106225] Updated weights for policy 1, policy_version 1870219 (0.0008) [2023-12-28 08:40:32,416][106225] Updated weights for policy 1, policy_version 1870229 (0.0008) [2023-12-28 08:40:32,472][106225] Updated weights for policy 1, policy_version 1870239 (0.0008) [2023-12-28 08:40:32,489][106226] Updated weights for policy 0, policy_version 1866346 (0.0008) [2023-12-28 08:40:32,554][106226] Updated weights for policy 0, policy_version 1866356 (0.0009) [2023-12-28 08:40:32,610][106226] Updated weights for policy 0, policy_version 1866366 (0.0009) [2023-12-28 08:40:32,666][106226] Updated weights for policy 0, policy_version 1866376 (0.0008) [2023-12-28 08:40:33,161][106225] Updated weights for policy 1, policy_version 1870249 (0.0009) [2023-12-28 08:40:33,211][106225] Updated weights for policy 1, policy_version 1870259 (0.0007) [2023-12-28 08:40:33,270][106225] Updated weights for policy 1, policy_version 1870269 (0.0008) [2023-12-28 08:40:33,450][106226] Updated weights for policy 0, policy_version 1866386 (0.0009) [2023-12-28 08:40:33,522][106226] Updated weights for policy 0, policy_version 1866396 (0.0008) [2023-12-28 08:40:33,590][106226] Updated weights for policy 0, policy_version 1866406 (0.0009) [2023-12-28 08:40:33,868][106225] Updated weights for policy 1, policy_version 1870279 (0.0005) [2023-12-28 08:40:33,926][106225] Updated weights for policy 1, policy_version 1870289 (0.0005) [2023-12-28 08:40:33,979][106225] Updated weights for policy 1, policy_version 1870299 (0.0005) [2023-12-28 08:40:34,265][106226] Updated weights for policy 0, policy_version 1866416 (0.0009) [2023-12-28 08:40:34,332][106226] Updated weights for policy 0, policy_version 1866426 (0.0008) [2023-12-28 08:40:34,396][106226] Updated weights for policy 0, policy_version 1866436 (0.0009) [2023-12-28 08:40:34,605][106225] Updated weights for policy 1, policy_version 1870309 (0.0007) [2023-12-28 08:40:34,671][106225] Updated weights for policy 1, policy_version 1870319 (0.0008) [2023-12-28 08:40:34,736][106225] Updated weights for policy 1, policy_version 1870329 (0.0009) [2023-12-28 08:40:35,124][106226] Updated weights for policy 0, policy_version 1866446 (0.0008) [2023-12-28 08:40:35,176][106226] Updated weights for policy 0, policy_version 1866456 (0.0008) [2023-12-28 08:40:35,227][106226] Updated weights for policy 0, policy_version 1866466 (0.0008) [2023-12-28 08:40:35,450][106225] Updated weights for policy 1, policy_version 1870339 (0.0009) [2023-12-28 08:40:35,499][106225] Updated weights for policy 1, policy_version 1870349 (0.0008) [2023-12-28 08:40:35,547][106225] Updated weights for policy 1, policy_version 1870359 (0.0008) [2023-12-28 08:40:35,962][106226] Updated weights for policy 0, policy_version 1866476 (0.0008) [2023-12-28 08:40:36,011][106226] Updated weights for policy 0, policy_version 1866486 (0.0008) [2023-12-28 08:40:36,061][106226] Updated weights for policy 0, policy_version 1866496 (0.0008) [2023-12-28 08:40:36,175][105115] Fps is (10 sec: 20479.3, 60 sec: 19933.7, 300 sec: 19771.9). Total num frames: 956776448. Throughput: 0: 9946.2, 1: 10025.3. Samples: 956783228. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-28 08:40:36,176][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.668')] [2023-12-28 08:40:36,302][106225] Updated weights for policy 1, policy_version 1870369 (0.0009) [2023-12-28 08:40:36,360][106225] Updated weights for policy 1, policy_version 1870379 (0.0010) [2023-12-28 08:40:36,412][106225] Updated weights for policy 1, policy_version 1870389 (0.0010) [2023-12-28 08:40:36,474][106225] Updated weights for policy 1, policy_version 1870399 (0.0011) [2023-12-28 08:40:36,823][106226] Updated weights for policy 0, policy_version 1866506 (0.0008) [2023-12-28 08:40:36,878][106226] Updated weights for policy 0, policy_version 1866516 (0.0008) [2023-12-28 08:40:36,929][106226] Updated weights for policy 0, policy_version 1866526 (0.0009) [2023-12-28 08:40:36,984][106226] Updated weights for policy 0, policy_version 1866536 (0.0009) [2023-12-28 08:40:37,138][106225] Updated weights for policy 1, policy_version 1870409 (0.0006) [2023-12-28 08:40:37,195][106225] Updated weights for policy 1, policy_version 1870419 (0.0005) [2023-12-28 08:40:37,254][106225] Updated weights for policy 1, policy_version 1870429 (0.0008) [2023-12-28 08:40:37,699][106226] Updated weights for policy 0, policy_version 1866546 (0.0006) [2023-12-28 08:40:37,755][106226] Updated weights for policy 0, policy_version 1866556 (0.0006) [2023-12-28 08:40:37,803][106226] Updated weights for policy 0, policy_version 1866566 (0.0005) [2023-12-28 08:40:38,016][106225] Updated weights for policy 1, policy_version 1870439 (0.0008) [2023-12-28 08:40:38,084][106225] Updated weights for policy 1, policy_version 1870449 (0.0006) [2023-12-28 08:40:38,152][106225] Updated weights for policy 1, policy_version 1870459 (0.0008) [2023-12-28 08:40:38,429][106226] Updated weights for policy 0, policy_version 1866576 (0.0008) [2023-12-28 08:40:38,492][106226] Updated weights for policy 0, policy_version 1866586 (0.0008) [2023-12-28 08:40:38,557][106226] Updated weights for policy 0, policy_version 1866596 (0.0008) [2023-12-28 08:40:38,898][106225] Updated weights for policy 1, policy_version 1870469 (0.0008) [2023-12-28 08:40:38,956][106225] Updated weights for policy 1, policy_version 1870479 (0.0010) [2023-12-28 08:40:39,011][106225] Updated weights for policy 1, policy_version 1870489 (0.0009) [2023-12-28 08:40:39,263][106226] Updated weights for policy 0, policy_version 1866606 (0.0010) [2023-12-28 08:40:39,326][106226] Updated weights for policy 0, policy_version 1866616 (0.0008) [2023-12-28 08:40:39,396][106226] Updated weights for policy 0, policy_version 1866626 (0.0009) [2023-12-28 08:40:39,883][106225] Updated weights for policy 1, policy_version 1870499 (0.0008) [2023-12-28 08:40:39,947][106225] Updated weights for policy 1, policy_version 1870509 (0.0008) [2023-12-28 08:40:40,015][106225] Updated weights for policy 1, policy_version 1870519 (0.0006) [2023-12-28 08:40:40,166][106226] Updated weights for policy 0, policy_version 1866636 (0.0010) [2023-12-28 08:40:40,228][106226] Updated weights for policy 0, policy_version 1866646 (0.0006) [2023-12-28 08:40:40,291][106226] Updated weights for policy 0, policy_version 1866656 (0.0007) [2023-12-28 08:40:40,732][106225] Updated weights for policy 1, policy_version 1870529 (0.0006) [2023-12-28 08:40:40,796][106225] Updated weights for policy 1, policy_version 1870539 (0.0009) [2023-12-28 08:40:40,857][106225] Updated weights for policy 1, policy_version 1870549 (0.0009) [2023-12-28 08:40:40,889][106226] Updated weights for policy 0, policy_version 1866666 (0.0007) [2023-12-28 08:40:40,913][106225] Updated weights for policy 1, policy_version 1870559 (0.0008) [2023-12-28 08:40:40,945][106226] Updated weights for policy 0, policy_version 1866676 (0.0008) [2023-12-28 08:40:41,004][106226] Updated weights for policy 0, policy_version 1866686 (0.0008) [2023-12-28 08:40:41,071][106226] Updated weights for policy 0, policy_version 1866696 (0.0009) [2023-12-28 08:40:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 956874752. Throughput: 0: 9980.0, 1: 10004.5. Samples: 956842436. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:40:41,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.491')] [2023-12-28 08:40:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001870560_478920704.pth... [2023-12-28 08:40:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001866696_477954048.pth... [2023-12-28 08:40:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001869408_478625792.pth [2023-12-28 08:40:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001865512_477650944.pth [2023-12-28 08:40:41,676][106225] Updated weights for policy 1, policy_version 1870569 (0.0007) [2023-12-28 08:40:41,745][106225] Updated weights for policy 1, policy_version 1870579 (0.0009) [2023-12-28 08:40:41,804][106225] Updated weights for policy 1, policy_version 1870589 (0.0010) [2023-12-28 08:40:41,844][106226] Updated weights for policy 0, policy_version 1866706 (0.0007) [2023-12-28 08:40:41,899][106226] Updated weights for policy 0, policy_version 1866716 (0.0007) [2023-12-28 08:40:41,957][106226] Updated weights for policy 0, policy_version 1866726 (0.0008) [2023-12-28 08:40:42,558][106225] Updated weights for policy 1, policy_version 1870599 (0.0007) [2023-12-28 08:40:42,620][106225] Updated weights for policy 1, policy_version 1870609 (0.0008) [2023-12-28 08:40:42,669][106225] Updated weights for policy 1, policy_version 1870619 (0.0008) [2023-12-28 08:40:42,692][106226] Updated weights for policy 0, policy_version 1866736 (0.0007) [2023-12-28 08:40:42,761][106226] Updated weights for policy 0, policy_version 1866746 (0.0008) [2023-12-28 08:40:42,826][106226] Updated weights for policy 0, policy_version 1866756 (0.0009) [2023-12-28 08:40:43,303][106225] Updated weights for policy 1, policy_version 1870629 (0.0010) [2023-12-28 08:40:43,366][106225] Updated weights for policy 1, policy_version 1870639 (0.0010) [2023-12-28 08:40:43,422][106225] Updated weights for policy 1, policy_version 1870649 (0.0010) [2023-12-28 08:40:43,620][106226] Updated weights for policy 0, policy_version 1866766 (0.0008) [2023-12-28 08:40:43,689][106226] Updated weights for policy 0, policy_version 1866776 (0.0009) [2023-12-28 08:40:43,762][106226] Updated weights for policy 0, policy_version 1866786 (0.0005) [2023-12-28 08:40:44,024][106225] Updated weights for policy 1, policy_version 1870659 (0.0009) [2023-12-28 08:40:44,081][106225] Updated weights for policy 1, policy_version 1870669 (0.0005) [2023-12-28 08:40:44,137][106225] Updated weights for policy 1, policy_version 1870679 (0.0005) [2023-12-28 08:40:44,422][106226] Updated weights for policy 0, policy_version 1866796 (0.0009) [2023-12-28 08:40:44,475][106226] Updated weights for policy 0, policy_version 1866806 (0.0009) [2023-12-28 08:40:44,524][106226] Updated weights for policy 0, policy_version 1866816 (0.0005) [2023-12-28 08:40:44,816][106225] Updated weights for policy 1, policy_version 1870689 (0.0007) [2023-12-28 08:40:44,877][106225] Updated weights for policy 1, policy_version 1870699 (0.0006) [2023-12-28 08:40:44,942][106225] Updated weights for policy 1, policy_version 1870709 (0.0006) [2023-12-28 08:40:45,000][106225] Updated weights for policy 1, policy_version 1870719 (0.0006) [2023-12-28 08:40:45,330][106226] Updated weights for policy 0, policy_version 1866826 (0.0008) [2023-12-28 08:40:45,381][106226] Updated weights for policy 0, policy_version 1866836 (0.0010) [2023-12-28 08:40:45,435][106226] Updated weights for policy 0, policy_version 1866846 (0.0008) [2023-12-28 08:40:45,491][106226] Updated weights for policy 0, policy_version 1866856 (0.0007) [2023-12-28 08:40:45,548][106225] Updated weights for policy 1, policy_version 1870729 (0.0010) [2023-12-28 08:40:45,602][106225] Updated weights for policy 1, policy_version 1870739 (0.0008) [2023-12-28 08:40:45,660][106225] Updated weights for policy 1, policy_version 1870749 (0.0009) [2023-12-28 08:40:46,175][105115] Fps is (10 sec: 18842.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 956964864. Throughput: 0: 9917.3, 1: 9977.7. Samples: 956957316. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:40:46,175][105115] Avg episode reward: [(0, '-4.294'), (1, '-4.636')] [2023-12-28 08:40:46,191][106226] Updated weights for policy 0, policy_version 1866866 (0.0008) [2023-12-28 08:40:46,244][106225] Updated weights for policy 1, policy_version 1870759 (0.0009) [2023-12-28 08:40:46,250][106226] Updated weights for policy 0, policy_version 1866876 (0.0007) [2023-12-28 08:40:46,306][106225] Updated weights for policy 1, policy_version 1870769 (0.0010) [2023-12-28 08:40:46,308][106226] Updated weights for policy 0, policy_version 1866886 (0.0006) [2023-12-28 08:40:46,356][106225] Updated weights for policy 1, policy_version 1870779 (0.0010) [2023-12-28 08:40:47,062][106225] Updated weights for policy 1, policy_version 1870789 (0.0010) [2023-12-28 08:40:47,087][106226] Updated weights for policy 0, policy_version 1866896 (0.0006) [2023-12-28 08:40:47,116][106225] Updated weights for policy 1, policy_version 1870799 (0.0010) [2023-12-28 08:40:47,141][106226] Updated weights for policy 0, policy_version 1866906 (0.0005) [2023-12-28 08:40:47,177][106225] Updated weights for policy 1, policy_version 1870809 (0.0005) [2023-12-28 08:40:47,201][106226] Updated weights for policy 0, policy_version 1866916 (0.0008) [2023-12-28 08:40:47,778][106225] Updated weights for policy 1, policy_version 1870819 (0.0007) [2023-12-28 08:40:47,831][106225] Updated weights for policy 1, policy_version 1870829 (0.0010) [2023-12-28 08:40:47,881][106225] Updated weights for policy 1, policy_version 1870839 (0.0010) [2023-12-28 08:40:47,958][106226] Updated weights for policy 0, policy_version 1866926 (0.0008) [2023-12-28 08:40:48,009][106226] Updated weights for policy 0, policy_version 1866936 (0.0008) [2023-12-28 08:40:48,057][106226] Updated weights for policy 0, policy_version 1866946 (0.0008) [2023-12-28 08:40:48,628][106225] Updated weights for policy 1, policy_version 1870849 (0.0010) [2023-12-28 08:40:48,678][106225] Updated weights for policy 1, policy_version 1870859 (0.0010) [2023-12-28 08:40:48,732][106225] Updated weights for policy 1, policy_version 1870869 (0.0010) [2023-12-28 08:40:48,787][106225] Updated weights for policy 1, policy_version 1870879 (0.0010) [2023-12-28 08:40:48,836][106226] Updated weights for policy 0, policy_version 1866956 (0.0008) [2023-12-28 08:40:48,899][106226] Updated weights for policy 0, policy_version 1866966 (0.0008) [2023-12-28 08:40:48,960][106226] Updated weights for policy 0, policy_version 1866976 (0.0005) [2023-12-28 08:40:49,547][106225] Updated weights for policy 1, policy_version 1870889 (0.0009) [2023-12-28 08:40:49,596][106225] Updated weights for policy 1, policy_version 1870899 (0.0008) [2023-12-28 08:40:49,602][106226] Updated weights for policy 0, policy_version 1866986 (0.0007) [2023-12-28 08:40:49,652][106225] Updated weights for policy 1, policy_version 1870909 (0.0008) [2023-12-28 08:40:49,661][106226] Updated weights for policy 0, policy_version 1866996 (0.0007) [2023-12-28 08:40:49,725][106226] Updated weights for policy 0, policy_version 1867006 (0.0007) [2023-12-28 08:40:49,792][106226] Updated weights for policy 0, policy_version 1867016 (0.0005) [2023-12-28 08:40:50,381][106225] Updated weights for policy 1, policy_version 1870919 (0.0007) [2023-12-28 08:40:50,441][106225] Updated weights for policy 1, policy_version 1870929 (0.0009) [2023-12-28 08:40:50,502][106225] Updated weights for policy 1, policy_version 1870939 (0.0009) [2023-12-28 08:40:50,512][106226] Updated weights for policy 0, policy_version 1867026 (0.0007) [2023-12-28 08:40:50,571][106226] Updated weights for policy 0, policy_version 1867036 (0.0007) [2023-12-28 08:40:50,638][106226] Updated weights for policy 0, policy_version 1867046 (0.0008) [2023-12-28 08:40:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 957063168. Throughput: 0: 9813.6, 1: 10025.3. Samples: 957075472. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:40:51,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.734')] [2023-12-28 08:40:51,240][106225] Updated weights for policy 1, policy_version 1870949 (0.0008) [2023-12-28 08:40:51,303][106225] Updated weights for policy 1, policy_version 1870959 (0.0008) [2023-12-28 08:40:51,372][106225] Updated weights for policy 1, policy_version 1870969 (0.0009) [2023-12-28 08:40:51,459][106226] Updated weights for policy 0, policy_version 1867056 (0.0008) [2023-12-28 08:40:51,517][106226] Updated weights for policy 0, policy_version 1867066 (0.0009) [2023-12-28 08:40:51,579][106226] Updated weights for policy 0, policy_version 1867076 (0.0009) [2023-12-28 08:40:52,108][106225] Updated weights for policy 1, policy_version 1870979 (0.0008) [2023-12-28 08:40:52,168][106225] Updated weights for policy 1, policy_version 1870989 (0.0008) [2023-12-28 08:40:52,236][106225] Updated weights for policy 1, policy_version 1870999 (0.0008) [2023-12-28 08:40:52,360][106226] Updated weights for policy 0, policy_version 1867086 (0.0010) [2023-12-28 08:40:52,422][106226] Updated weights for policy 0, policy_version 1867096 (0.0008) [2023-12-28 08:40:52,486][106226] Updated weights for policy 0, policy_version 1867106 (0.0006) [2023-12-28 08:40:52,978][106225] Updated weights for policy 1, policy_version 1871009 (0.0009) [2023-12-28 08:40:53,028][106225] Updated weights for policy 1, policy_version 1871019 (0.0009) [2023-12-28 08:40:53,070][106226] Updated weights for policy 0, policy_version 1867116 (0.0007) [2023-12-28 08:40:53,084][106225] Updated weights for policy 1, policy_version 1871029 (0.0007) [2023-12-28 08:40:53,125][106226] Updated weights for policy 0, policy_version 1867126 (0.0006) [2023-12-28 08:40:53,146][106225] Updated weights for policy 1, policy_version 1871039 (0.0007) [2023-12-28 08:40:53,173][106226] Updated weights for policy 0, policy_version 1867136 (0.0008) [2023-12-28 08:40:53,828][106226] Updated weights for policy 0, policy_version 1867146 (0.0007) [2023-12-28 08:40:53,885][106226] Updated weights for policy 0, policy_version 1867156 (0.0006) [2023-12-28 08:40:53,895][106225] Updated weights for policy 1, policy_version 1871049 (0.0007) [2023-12-28 08:40:53,933][106226] Updated weights for policy 0, policy_version 1867166 (0.0005) [2023-12-28 08:40:53,944][106225] Updated weights for policy 1, policy_version 1871059 (0.0009) [2023-12-28 08:40:53,985][106226] Updated weights for policy 0, policy_version 1867176 (0.0008) [2023-12-28 08:40:53,997][106225] Updated weights for policy 1, policy_version 1871069 (0.0007) [2023-12-28 08:40:54,630][106225] Updated weights for policy 1, policy_version 1871079 (0.0006) [2023-12-28 08:40:54,683][106225] Updated weights for policy 1, policy_version 1871089 (0.0006) [2023-12-28 08:40:54,739][106225] Updated weights for policy 1, policy_version 1871099 (0.0006) [2023-12-28 08:40:54,750][106226] Updated weights for policy 0, policy_version 1867186 (0.0005) [2023-12-28 08:40:54,813][106226] Updated weights for policy 0, policy_version 1867196 (0.0007) [2023-12-28 08:40:54,870][106226] Updated weights for policy 0, policy_version 1867206 (0.0008) [2023-12-28 08:40:55,416][106225] Updated weights for policy 1, policy_version 1871109 (0.0010) [2023-12-28 08:40:55,473][106225] Updated weights for policy 1, policy_version 1871119 (0.0010) [2023-12-28 08:40:55,536][106225] Updated weights for policy 1, policy_version 1871129 (0.0010) [2023-12-28 08:40:55,578][106226] Updated weights for policy 0, policy_version 1867216 (0.0009) [2023-12-28 08:40:55,638][106226] Updated weights for policy 0, policy_version 1867226 (0.0008) [2023-12-28 08:40:55,686][106226] Updated weights for policy 0, policy_version 1867236 (0.0008) [2023-12-28 08:40:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 957161472. Throughput: 0: 9811.9, 1: 9931.0. Samples: 957133608. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:40:56,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.654')] [2023-12-28 08:40:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001871136_479068160.pth... [2023-12-28 08:40:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001867240_478093312.pth... [2023-12-28 08:40:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001866120_477806592.pth [2023-12-28 08:40:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001869984_478773248.pth [2023-12-28 08:40:56,231][106225] Updated weights for policy 1, policy_version 1871139 (0.0010) [2023-12-28 08:40:56,291][106225] Updated weights for policy 1, policy_version 1871149 (0.0010) [2023-12-28 08:40:56,347][106225] Updated weights for policy 1, policy_version 1871159 (0.0010) [2023-12-28 08:40:56,418][106226] Updated weights for policy 0, policy_version 1867246 (0.0008) [2023-12-28 08:40:56,464][106226] Updated weights for policy 0, policy_version 1867256 (0.0008) [2023-12-28 08:40:56,514][106226] Updated weights for policy 0, policy_version 1867266 (0.0008) [2023-12-28 08:40:57,015][106225] Updated weights for policy 1, policy_version 1871169 (0.0010) [2023-12-28 08:40:57,073][106225] Updated weights for policy 1, policy_version 1871179 (0.0006) [2023-12-28 08:40:57,134][106225] Updated weights for policy 1, policy_version 1871189 (0.0009) [2023-12-28 08:40:57,188][106225] Updated weights for policy 1, policy_version 1871199 (0.0008) [2023-12-28 08:40:57,262][106226] Updated weights for policy 0, policy_version 1867276 (0.0006) [2023-12-28 08:40:57,317][106226] Updated weights for policy 0, policy_version 1867286 (0.0008) [2023-12-28 08:40:57,365][106226] Updated weights for policy 0, policy_version 1867296 (0.0007) [2023-12-28 08:40:57,851][106225] Updated weights for policy 1, policy_version 1871209 (0.0007) [2023-12-28 08:40:57,911][106225] Updated weights for policy 1, policy_version 1871219 (0.0006) [2023-12-28 08:40:57,973][106225] Updated weights for policy 1, policy_version 1871229 (0.0005) [2023-12-28 08:40:58,022][106226] Updated weights for policy 0, policy_version 1867306 (0.0006) [2023-12-28 08:40:58,071][106226] Updated weights for policy 0, policy_version 1867316 (0.0008) [2023-12-28 08:40:58,125][106226] Updated weights for policy 0, policy_version 1867327 (0.0010) [2023-12-28 08:40:58,594][106225] Updated weights for policy 1, policy_version 1871239 (0.0008) [2023-12-28 08:40:58,661][106225] Updated weights for policy 1, policy_version 1871249 (0.0006) [2023-12-28 08:40:58,728][106225] Updated weights for policy 1, policy_version 1871259 (0.0009) [2023-12-28 08:40:58,964][106226] Updated weights for policy 0, policy_version 1867337 (0.0008) [2023-12-28 08:40:59,026][106226] Updated weights for policy 0, policy_version 1867347 (0.0008) [2023-12-28 08:40:59,095][106226] Updated weights for policy 0, policy_version 1867357 (0.0008) [2023-12-28 08:40:59,158][106226] Updated weights for policy 0, policy_version 1867367 (0.0009) [2023-12-28 08:40:59,504][106225] Updated weights for policy 1, policy_version 1871269 (0.0007) [2023-12-28 08:40:59,560][106225] Updated weights for policy 1, policy_version 1871279 (0.0006) [2023-12-28 08:40:59,618][106225] Updated weights for policy 1, policy_version 1871289 (0.0008) [2023-12-28 08:40:59,906][106226] Updated weights for policy 0, policy_version 1867377 (0.0009) [2023-12-28 08:40:59,984][106226] Updated weights for policy 0, policy_version 1867387 (0.0009) [2023-12-28 08:41:00,044][106226] Updated weights for policy 0, policy_version 1867397 (0.0009) [2023-12-28 08:41:00,284][106225] Updated weights for policy 1, policy_version 1871299 (0.0008) [2023-12-28 08:41:00,339][106225] Updated weights for policy 1, policy_version 1871309 (0.0007) [2023-12-28 08:41:00,401][106225] Updated weights for policy 1, policy_version 1871319 (0.0007) [2023-12-28 08:41:00,717][106226] Updated weights for policy 0, policy_version 1867407 (0.0009) [2023-12-28 08:41:00,771][106226] Updated weights for policy 0, policy_version 1867417 (0.0010) [2023-12-28 08:41:00,827][106226] Updated weights for policy 0, policy_version 1867427 (0.0009) [2023-12-28 08:41:00,987][106225] Updated weights for policy 1, policy_version 1871329 (0.0005) [2023-12-28 08:41:01,076][106225] Updated weights for policy 1, policy_version 1871341 (0.0007) [2023-12-28 08:41:01,143][106225] Updated weights for policy 1, policy_version 1871351 (0.0010) [2023-12-28 08:41:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 957259776. Throughput: 0: 9754.7, 1: 9959.5. Samples: 957250360. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:01,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.800')] [2023-12-28 08:41:01,637][106226] Updated weights for policy 0, policy_version 1867437 (0.0008) [2023-12-28 08:41:01,707][106226] Updated weights for policy 0, policy_version 1867447 (0.0007) [2023-12-28 08:41:01,771][106226] Updated weights for policy 0, policy_version 1867457 (0.0010) [2023-12-28 08:41:01,950][106225] Updated weights for policy 1, policy_version 1871361 (0.0009) [2023-12-28 08:41:02,001][106225] Updated weights for policy 1, policy_version 1871371 (0.0010) [2023-12-28 08:41:02,059][106225] Updated weights for policy 1, policy_version 1871381 (0.0010) [2023-12-28 08:41:02,125][106225] Updated weights for policy 1, policy_version 1871391 (0.0011) [2023-12-28 08:41:02,444][106226] Updated weights for policy 0, policy_version 1867467 (0.0010) [2023-12-28 08:41:02,507][106226] Updated weights for policy 0, policy_version 1867477 (0.0010) [2023-12-28 08:41:02,573][106226] Updated weights for policy 0, policy_version 1867487 (0.0010) [2023-12-28 08:41:02,840][106225] Updated weights for policy 1, policy_version 1871401 (0.0006) [2023-12-28 08:41:02,894][106225] Updated weights for policy 1, policy_version 1871411 (0.0006) [2023-12-28 08:41:02,954][106225] Updated weights for policy 1, policy_version 1871421 (0.0008) [2023-12-28 08:41:03,204][106226] Updated weights for policy 0, policy_version 1867497 (0.0010) [2023-12-28 08:41:03,264][106226] Updated weights for policy 0, policy_version 1867507 (0.0009) [2023-12-28 08:41:03,320][106226] Updated weights for policy 0, policy_version 1867517 (0.0010) [2023-12-28 08:41:03,365][106226] Updated weights for policy 0, policy_version 1867527 (0.0010) [2023-12-28 08:41:03,577][106225] Updated weights for policy 1, policy_version 1871431 (0.0010) [2023-12-28 08:41:03,639][106225] Updated weights for policy 1, policy_version 1871441 (0.0010) [2023-12-28 08:41:03,702][106225] Updated weights for policy 1, policy_version 1871451 (0.0010) [2023-12-28 08:41:03,980][106226] Updated weights for policy 0, policy_version 1867537 (0.0007) [2023-12-28 08:41:04,046][106226] Updated weights for policy 0, policy_version 1867547 (0.0011) [2023-12-28 08:41:04,112][106226] Updated weights for policy 0, policy_version 1867557 (0.0011) [2023-12-28 08:41:04,440][106225] Updated weights for policy 1, policy_version 1871461 (0.0009) [2023-12-28 08:41:04,504][106225] Updated weights for policy 1, policy_version 1871471 (0.0007) [2023-12-28 08:41:04,566][106225] Updated weights for policy 1, policy_version 1871481 (0.0005) [2023-12-28 08:41:04,822][106226] Updated weights for policy 0, policy_version 1867567 (0.0010) [2023-12-28 08:41:04,877][106226] Updated weights for policy 0, policy_version 1867577 (0.0009) [2023-12-28 08:41:04,933][106226] Updated weights for policy 0, policy_version 1867587 (0.0010) [2023-12-28 08:41:05,155][106225] Updated weights for policy 1, policy_version 1871491 (0.0006) [2023-12-28 08:41:05,212][106225] Updated weights for policy 1, policy_version 1871501 (0.0008) [2023-12-28 08:41:05,279][106225] Updated weights for policy 1, policy_version 1871511 (0.0009) [2023-12-28 08:41:05,658][106226] Updated weights for policy 0, policy_version 1867597 (0.0009) [2023-12-28 08:41:05,716][106226] Updated weights for policy 0, policy_version 1867607 (0.0007) [2023-12-28 08:41:05,766][106226] Updated weights for policy 0, policy_version 1867617 (0.0010) [2023-12-28 08:41:05,816][106225] Updated weights for policy 1, policy_version 1871521 (0.0005) [2023-12-28 08:41:05,879][106225] Updated weights for policy 1, policy_version 1871531 (0.0005) [2023-12-28 08:41:05,941][106225] Updated weights for policy 1, policy_version 1871541 (0.0005) [2023-12-28 08:41:06,006][106225] Updated weights for policy 1, policy_version 1871551 (0.0006) [2023-12-28 08:41:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 957366272. Throughput: 0: 9792.7, 1: 9997.7. Samples: 957372616. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:06,176][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.886')] [2023-12-28 08:41:06,441][106226] Updated weights for policy 0, policy_version 1867627 (0.0011) [2023-12-28 08:41:06,510][106226] Updated weights for policy 0, policy_version 1867637 (0.0011) [2023-12-28 08:41:06,569][106225] Updated weights for policy 1, policy_version 1871561 (0.0010) [2023-12-28 08:41:06,575][106226] Updated weights for policy 0, policy_version 1867647 (0.0011) [2023-12-28 08:41:06,628][106225] Updated weights for policy 1, policy_version 1871571 (0.0010) [2023-12-28 08:41:06,693][106225] Updated weights for policy 1, policy_version 1871581 (0.0010) [2023-12-28 08:41:07,286][106226] Updated weights for policy 0, policy_version 1867657 (0.0011) [2023-12-28 08:41:07,336][106226] Updated weights for policy 0, policy_version 1867667 (0.0010) [2023-12-28 08:41:07,420][106226] Updated weights for policy 0, policy_version 1867677 (0.0009) [2023-12-28 08:41:07,421][106225] Updated weights for policy 1, policy_version 1871591 (0.0010) [2023-12-28 08:41:07,468][106225] Updated weights for policy 1, policy_version 1871601 (0.0010) [2023-12-28 08:41:07,482][106226] Updated weights for policy 0, policy_version 1867687 (0.0006) [2023-12-28 08:41:07,522][106225] Updated weights for policy 1, policy_version 1871611 (0.0010) [2023-12-28 08:41:08,210][106226] Updated weights for policy 0, policy_version 1867697 (0.0009) [2023-12-28 08:41:08,217][106225] Updated weights for policy 1, policy_version 1871621 (0.0010) [2023-12-28 08:41:08,272][106226] Updated weights for policy 0, policy_version 1867707 (0.0011) [2023-12-28 08:41:08,278][106225] Updated weights for policy 1, policy_version 1871631 (0.0010) [2023-12-28 08:41:08,338][106225] Updated weights for policy 1, policy_version 1871641 (0.0008) [2023-12-28 08:41:08,341][106226] Updated weights for policy 0, policy_version 1867717 (0.0010) [2023-12-28 08:41:08,929][106226] Updated weights for policy 0, policy_version 1867727 (0.0009) [2023-12-28 08:41:08,994][106226] Updated weights for policy 0, policy_version 1867737 (0.0006) [2023-12-28 08:41:09,052][106226] Updated weights for policy 0, policy_version 1867747 (0.0006) [2023-12-28 08:41:09,088][106225] Updated weights for policy 1, policy_version 1871651 (0.0010) [2023-12-28 08:41:09,136][106225] Updated weights for policy 1, policy_version 1871661 (0.0008) [2023-12-28 08:41:09,188][106225] Updated weights for policy 1, policy_version 1871671 (0.0008) [2023-12-28 08:41:09,785][106226] Updated weights for policy 0, policy_version 1867757 (0.0009) [2023-12-28 08:41:09,855][106226] Updated weights for policy 0, policy_version 1867767 (0.0009) [2023-12-28 08:41:09,919][106226] Updated weights for policy 0, policy_version 1867777 (0.0009) [2023-12-28 08:41:09,980][106225] Updated weights for policy 1, policy_version 1871681 (0.0008) [2023-12-28 08:41:10,047][106225] Updated weights for policy 1, policy_version 1871691 (0.0006) [2023-12-28 08:41:10,110][106225] Updated weights for policy 1, policy_version 1871701 (0.0006) [2023-12-28 08:41:10,174][106225] Updated weights for policy 1, policy_version 1871711 (0.0005) [2023-12-28 08:41:10,726][106225] Updated weights for policy 1, policy_version 1871721 (0.0006) [2023-12-28 08:41:10,738][106226] Updated weights for policy 0, policy_version 1867787 (0.0008) [2023-12-28 08:41:10,786][106225] Updated weights for policy 1, policy_version 1871731 (0.0006) [2023-12-28 08:41:10,800][106226] Updated weights for policy 0, policy_version 1867797 (0.0008) [2023-12-28 08:41:10,842][106225] Updated weights for policy 1, policy_version 1871741 (0.0006) [2023-12-28 08:41:10,861][106226] Updated weights for policy 0, policy_version 1867807 (0.0008) [2023-12-28 08:41:11,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 957464576. Throughput: 0: 9810.6, 1: 10058.3. Samples: 957432884. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:11,176][105115] Avg episode reward: [(0, '-4.419'), (1, '-4.840')] [2023-12-28 08:41:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001871744_479223808.pth... [2023-12-28 08:41:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001867816_478240768.pth... [2023-12-28 08:41:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001866696_477954048.pth [2023-12-28 08:41:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001870560_478920704.pth [2023-12-28 08:41:11,596][106225] Updated weights for policy 1, policy_version 1871751 (0.0008) [2023-12-28 08:41:11,662][106225] Updated weights for policy 1, policy_version 1871761 (0.0008) [2023-12-28 08:41:11,690][106226] Updated weights for policy 0, policy_version 1867817 (0.0008) [2023-12-28 08:41:11,727][106225] Updated weights for policy 1, policy_version 1871771 (0.0008) [2023-12-28 08:41:11,761][106226] Updated weights for policy 0, policy_version 1867827 (0.0007) [2023-12-28 08:41:11,813][106226] Updated weights for policy 0, policy_version 1867837 (0.0008) [2023-12-28 08:41:11,876][106226] Updated weights for policy 0, policy_version 1867847 (0.0008) [2023-12-28 08:41:12,565][106225] Updated weights for policy 1, policy_version 1871781 (0.0008) [2023-12-28 08:41:12,589][106226] Updated weights for policy 0, policy_version 1867857 (0.0008) [2023-12-28 08:41:12,627][106225] Updated weights for policy 1, policy_version 1871791 (0.0007) [2023-12-28 08:41:12,651][106226] Updated weights for policy 0, policy_version 1867867 (0.0009) [2023-12-28 08:41:12,681][106225] Updated weights for policy 1, policy_version 1871801 (0.0007) [2023-12-28 08:41:12,712][106226] Updated weights for policy 0, policy_version 1867877 (0.0008) [2023-12-28 08:41:13,354][106225] Updated weights for policy 1, policy_version 1871811 (0.0008) [2023-12-28 08:41:13,413][106225] Updated weights for policy 1, policy_version 1871821 (0.0008) [2023-12-28 08:41:13,450][106226] Updated weights for policy 0, policy_version 1867887 (0.0008) [2023-12-28 08:41:13,470][106225] Updated weights for policy 1, policy_version 1871831 (0.0009) [2023-12-28 08:41:13,503][106226] Updated weights for policy 0, policy_version 1867897 (0.0006) [2023-12-28 08:41:13,561][106226] Updated weights for policy 0, policy_version 1867907 (0.0007) [2023-12-28 08:41:14,091][106225] Updated weights for policy 1, policy_version 1871841 (0.0010) [2023-12-28 08:41:14,142][106226] Updated weights for policy 0, policy_version 1867917 (0.0008) [2023-12-28 08:41:14,155][106225] Updated weights for policy 1, policy_version 1871851 (0.0005) [2023-12-28 08:41:14,196][106226] Updated weights for policy 0, policy_version 1867927 (0.0008) [2023-12-28 08:41:14,211][106225] Updated weights for policy 1, policy_version 1871861 (0.0010) [2023-12-28 08:41:14,253][106226] Updated weights for policy 0, policy_version 1867937 (0.0006) [2023-12-28 08:41:14,271][106225] Updated weights for policy 1, policy_version 1871871 (0.0008) [2023-12-28 08:41:14,860][106226] Updated weights for policy 0, policy_version 1867947 (0.0009) [2023-12-28 08:41:14,875][106225] Updated weights for policy 1, policy_version 1871881 (0.0010) [2023-12-28 08:41:14,912][106226] Updated weights for policy 0, policy_version 1867957 (0.0006) [2023-12-28 08:41:14,936][106225] Updated weights for policy 1, policy_version 1871891 (0.0011) [2023-12-28 08:41:14,971][106226] Updated weights for policy 0, policy_version 1867967 (0.0011) [2023-12-28 08:41:14,994][106225] Updated weights for policy 1, policy_version 1871901 (0.0010) [2023-12-28 08:41:15,698][106226] Updated weights for policy 0, policy_version 1867977 (0.0011) [2023-12-28 08:41:15,722][106225] Updated weights for policy 1, policy_version 1871911 (0.0010) [2023-12-28 08:41:15,755][106226] Updated weights for policy 0, policy_version 1867987 (0.0011) [2023-12-28 08:41:15,777][106225] Updated weights for policy 1, policy_version 1871921 (0.0010) [2023-12-28 08:41:15,814][106226] Updated weights for policy 0, policy_version 1867997 (0.0011) [2023-12-28 08:41:15,834][106225] Updated weights for policy 1, policy_version 1871931 (0.0010) [2023-12-28 08:41:15,875][106226] Updated weights for policy 0, policy_version 1868007 (0.0011) [2023-12-28 08:41:16,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 957562880. Throughput: 0: 9660.4, 1: 9997.8. Samples: 957550944. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:16,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.820')] [2023-12-28 08:41:16,485][106225] Updated weights for policy 1, policy_version 1871941 (0.0010) [2023-12-28 08:41:16,538][106226] Updated weights for policy 0, policy_version 1868017 (0.0011) [2023-12-28 08:41:16,546][106225] Updated weights for policy 1, policy_version 1871951 (0.0010) [2023-12-28 08:41:16,598][106226] Updated weights for policy 0, policy_version 1868027 (0.0011) [2023-12-28 08:41:16,608][106225] Updated weights for policy 1, policy_version 1871961 (0.0009) [2023-12-28 08:41:16,646][106226] Updated weights for policy 0, policy_version 1868037 (0.0007) [2023-12-28 08:41:17,263][106225] Updated weights for policy 1, policy_version 1871971 (0.0007) [2023-12-28 08:41:17,269][106226] Updated weights for policy 0, policy_version 1868047 (0.0006) [2023-12-28 08:41:17,323][106225] Updated weights for policy 1, policy_version 1871981 (0.0008) [2023-12-28 08:41:17,330][106226] Updated weights for policy 0, policy_version 1868057 (0.0006) [2023-12-28 08:41:17,374][106226] Updated weights for policy 0, policy_version 1868067 (0.0005) [2023-12-28 08:41:17,382][106225] Updated weights for policy 1, policy_version 1871991 (0.0008) [2023-12-28 08:41:17,944][106226] Updated weights for policy 0, policy_version 1868077 (0.0008) [2023-12-28 08:41:17,980][106225] Updated weights for policy 1, policy_version 1872001 (0.0008) [2023-12-28 08:41:17,999][106226] Updated weights for policy 0, policy_version 1868087 (0.0010) [2023-12-28 08:41:18,036][106225] Updated weights for policy 1, policy_version 1872011 (0.0006) [2023-12-28 08:41:18,058][106226] Updated weights for policy 0, policy_version 1868097 (0.0010) [2023-12-28 08:41:18,098][106225] Updated weights for policy 1, policy_version 1872021 (0.0007) [2023-12-28 08:41:18,152][106225] Updated weights for policy 1, policy_version 1872031 (0.0008) [2023-12-28 08:41:18,773][106226] Updated weights for policy 0, policy_version 1868107 (0.0010) [2023-12-28 08:41:18,840][106226] Updated weights for policy 0, policy_version 1868117 (0.0011) [2023-12-28 08:41:18,902][106226] Updated weights for policy 0, policy_version 1868127 (0.0011) [2023-12-28 08:41:18,911][106225] Updated weights for policy 1, policy_version 1872041 (0.0006) [2023-12-28 08:41:18,955][106225] Updated weights for policy 1, policy_version 1872051 (0.0008) [2023-12-28 08:41:19,000][106225] Updated weights for policy 1, policy_version 1872061 (0.0007) [2023-12-28 08:41:19,664][106226] Updated weights for policy 0, policy_version 1868137 (0.0010) [2023-12-28 08:41:19,720][106226] Updated weights for policy 0, policy_version 1868147 (0.0009) [2023-12-28 08:41:19,769][106226] Updated weights for policy 0, policy_version 1868157 (0.0009) [2023-12-28 08:41:19,789][106225] Updated weights for policy 1, policy_version 1872071 (0.0008) [2023-12-28 08:41:19,819][106226] Updated weights for policy 0, policy_version 1868167 (0.0007) [2023-12-28 08:41:19,858][106225] Updated weights for policy 1, policy_version 1872081 (0.0008) [2023-12-28 08:41:19,923][106225] Updated weights for policy 1, policy_version 1872091 (0.0007) [2023-12-28 08:41:20,579][106225] Updated weights for policy 1, policy_version 1872101 (0.0006) [2023-12-28 08:41:20,592][106226] Updated weights for policy 0, policy_version 1868177 (0.0011) [2023-12-28 08:41:20,637][106225] Updated weights for policy 1, policy_version 1872111 (0.0007) [2023-12-28 08:41:20,657][106226] Updated weights for policy 0, policy_version 1868187 (0.0009) [2023-12-28 08:41:20,699][106225] Updated weights for policy 1, policy_version 1872121 (0.0006) [2023-12-28 08:41:20,719][106226] Updated weights for policy 0, policy_version 1868197 (0.0011) [2023-12-28 08:41:21,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 957661184. Throughput: 0: 9733.1, 1: 9996.9. Samples: 957671076. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:21,175][105115] Avg episode reward: [(0, '-4.438'), (1, '-4.656')] [2023-12-28 08:41:21,482][106225] Updated weights for policy 1, policy_version 1872131 (0.0008) [2023-12-28 08:41:21,514][106226] Updated weights for policy 0, policy_version 1868207 (0.0010) [2023-12-28 08:41:21,542][106225] Updated weights for policy 1, policy_version 1872141 (0.0007) [2023-12-28 08:41:21,574][106226] Updated weights for policy 0, policy_version 1868217 (0.0007) [2023-12-28 08:41:21,603][106225] Updated weights for policy 1, policy_version 1872151 (0.0009) [2023-12-28 08:41:21,639][106226] Updated weights for policy 0, policy_version 1868227 (0.0007) [2023-12-28 08:41:22,371][106225] Updated weights for policy 1, policy_version 1872161 (0.0008) [2023-12-28 08:41:22,441][106225] Updated weights for policy 1, policy_version 1872171 (0.0009) [2023-12-28 08:41:22,474][106226] Updated weights for policy 0, policy_version 1868237 (0.0009) [2023-12-28 08:41:22,506][106225] Updated weights for policy 1, policy_version 1872181 (0.0008) [2023-12-28 08:41:22,535][106226] Updated weights for policy 0, policy_version 1868247 (0.0008) [2023-12-28 08:41:22,565][106225] Updated weights for policy 1, policy_version 1872191 (0.0006) [2023-12-28 08:41:22,588][106226] Updated weights for policy 0, policy_version 1868257 (0.0008) [2023-12-28 08:41:23,236][106225] Updated weights for policy 1, policy_version 1872201 (0.0006) [2023-12-28 08:41:23,299][106225] Updated weights for policy 1, policy_version 1872211 (0.0005) [2023-12-28 08:41:23,355][106225] Updated weights for policy 1, policy_version 1872221 (0.0006) [2023-12-28 08:41:23,389][106226] Updated weights for policy 0, policy_version 1868267 (0.0008) [2023-12-28 08:41:23,445][106226] Updated weights for policy 0, policy_version 1868277 (0.0009) [2023-12-28 08:41:23,507][106226] Updated weights for policy 0, policy_version 1868287 (0.0008) [2023-12-28 08:41:23,998][106225] Updated weights for policy 1, policy_version 1872231 (0.0006) [2023-12-28 08:41:24,056][106225] Updated weights for policy 1, policy_version 1872241 (0.0006) [2023-12-28 08:41:24,106][106225] Updated weights for policy 1, policy_version 1872251 (0.0008) [2023-12-28 08:41:24,185][106226] Updated weights for policy 0, policy_version 1868297 (0.0009) [2023-12-28 08:41:24,245][106226] Updated weights for policy 0, policy_version 1868307 (0.0009) [2023-12-28 08:41:24,303][106226] Updated weights for policy 0, policy_version 1868317 (0.0008) [2023-12-28 08:41:24,368][106226] Updated weights for policy 0, policy_version 1868327 (0.0009) [2023-12-28 08:41:24,665][106225] Updated weights for policy 1, policy_version 1872261 (0.0006) [2023-12-28 08:41:24,719][106225] Updated weights for policy 1, policy_version 1872271 (0.0007) [2023-12-28 08:41:24,787][106225] Updated weights for policy 1, policy_version 1872281 (0.0007) [2023-12-28 08:41:24,967][106226] Updated weights for policy 0, policy_version 1868337 (0.0008) [2023-12-28 08:41:25,024][106226] Updated weights for policy 0, policy_version 1868347 (0.0005) [2023-12-28 08:41:25,091][106226] Updated weights for policy 0, policy_version 1868357 (0.0008) [2023-12-28 08:41:25,402][106225] Updated weights for policy 1, policy_version 1872291 (0.0009) [2023-12-28 08:41:25,452][106225] Updated weights for policy 1, policy_version 1872301 (0.0005) [2023-12-28 08:41:25,510][106225] Updated weights for policy 1, policy_version 1872311 (0.0005) [2023-12-28 08:41:25,681][106226] Updated weights for policy 0, policy_version 1868367 (0.0010) [2023-12-28 08:41:25,734][106226] Updated weights for policy 0, policy_version 1868377 (0.0010) [2023-12-28 08:41:25,784][106226] Updated weights for policy 0, policy_version 1868387 (0.0010) [2023-12-28 08:41:26,020][106225] Updated weights for policy 1, policy_version 1872321 (0.0005) [2023-12-28 08:41:26,076][106225] Updated weights for policy 1, policy_version 1872331 (0.0006) [2023-12-28 08:41:26,133][106225] Updated weights for policy 1, policy_version 1872341 (0.0005) [2023-12-28 08:41:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 957759488. Throughput: 0: 9656.8, 1: 9990.5. Samples: 957726564. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:26,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.792')] [2023-12-28 08:41:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001868392_478388224.pth... [2023-12-28 08:41:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001867240_478093312.pth [2023-12-28 08:41:26,187][106225] Updated weights for policy 1, policy_version 1872351 (0.0005) [2023-12-28 08:41:26,191][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001872352_479379456.pth... [2023-12-28 08:41:26,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001871136_479068160.pth [2023-12-28 08:41:26,493][106226] Updated weights for policy 0, policy_version 1868397 (0.0011) [2023-12-28 08:41:26,557][106226] Updated weights for policy 0, policy_version 1868407 (0.0008) [2023-12-28 08:41:26,613][106226] Updated weights for policy 0, policy_version 1868417 (0.0009) [2023-12-28 08:41:26,882][106225] Updated weights for policy 1, policy_version 1872361 (0.0009) [2023-12-28 08:41:26,941][106225] Updated weights for policy 1, policy_version 1872371 (0.0008) [2023-12-28 08:41:27,000][106225] Updated weights for policy 1, policy_version 1872381 (0.0008) [2023-12-28 08:41:27,297][106226] Updated weights for policy 0, policy_version 1868427 (0.0007) [2023-12-28 08:41:27,358][106226] Updated weights for policy 0, policy_version 1868437 (0.0005) [2023-12-28 08:41:27,415][106226] Updated weights for policy 0, policy_version 1868447 (0.0005) [2023-12-28 08:41:27,674][106225] Updated weights for policy 1, policy_version 1872391 (0.0008) [2023-12-28 08:41:27,719][106225] Updated weights for policy 1, policy_version 1872401 (0.0009) [2023-12-28 08:41:27,771][106225] Updated weights for policy 1, policy_version 1872411 (0.0008) [2023-12-28 08:41:27,933][106226] Updated weights for policy 0, policy_version 1868457 (0.0005) [2023-12-28 08:41:28,000][106226] Updated weights for policy 0, policy_version 1868467 (0.0005) [2023-12-28 08:41:28,051][106226] Updated weights for policy 0, policy_version 1868477 (0.0005) [2023-12-28 08:41:28,107][106226] Updated weights for policy 0, policy_version 1868487 (0.0005) [2023-12-28 08:41:28,496][106225] Updated weights for policy 1, policy_version 1872421 (0.0008) [2023-12-28 08:41:28,551][106225] Updated weights for policy 1, policy_version 1872431 (0.0008) [2023-12-28 08:41:28,606][106225] Updated weights for policy 1, policy_version 1872441 (0.0008) [2023-12-28 08:41:28,728][106226] Updated weights for policy 0, policy_version 1868497 (0.0009) [2023-12-28 08:41:28,781][106226] Updated weights for policy 0, policy_version 1868507 (0.0005) [2023-12-28 08:41:28,837][106226] Updated weights for policy 0, policy_version 1868517 (0.0007) [2023-12-28 08:41:29,406][106226] Updated weights for policy 0, policy_version 1868527 (0.0010) [2023-12-28 08:41:29,416][106225] Updated weights for policy 1, policy_version 1872451 (0.0007) [2023-12-28 08:41:29,468][106226] Updated weights for policy 0, policy_version 1868537 (0.0011) [2023-12-28 08:41:29,476][106225] Updated weights for policy 1, policy_version 1872461 (0.0006) [2023-12-28 08:41:29,531][106226] Updated weights for policy 0, policy_version 1868547 (0.0011) [2023-12-28 08:41:29,534][106225] Updated weights for policy 1, policy_version 1872471 (0.0006) [2023-12-28 08:41:30,229][106225] Updated weights for policy 1, policy_version 1872481 (0.0007) [2023-12-28 08:41:30,284][106226] Updated weights for policy 0, policy_version 1868557 (0.0009) [2023-12-28 08:41:30,290][106225] Updated weights for policy 1, policy_version 1872491 (0.0008) [2023-12-28 08:41:30,343][106226] Updated weights for policy 0, policy_version 1868567 (0.0006) [2023-12-28 08:41:30,345][106225] Updated weights for policy 1, policy_version 1872501 (0.0007) [2023-12-28 08:41:30,397][106226] Updated weights for policy 0, policy_version 1868577 (0.0007) [2023-12-28 08:41:30,402][106225] Updated weights for policy 1, policy_version 1872511 (0.0008) [2023-12-28 08:41:31,070][106226] Updated weights for policy 0, policy_version 1868587 (0.0007) [2023-12-28 08:41:31,099][106225] Updated weights for policy 1, policy_version 1872521 (0.0008) [2023-12-28 08:41:31,137][106226] Updated weights for policy 0, policy_version 1868597 (0.0006) [2023-12-28 08:41:31,170][106225] Updated weights for policy 1, policy_version 1872531 (0.0008) [2023-12-28 08:41:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 957857792. Throughput: 0: 9831.7, 1: 10098.0. Samples: 957854156. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:31,176][105115] Avg episode reward: [(0, '-4.260'), (1, '-4.916')] [2023-12-28 08:41:31,205][106226] Updated weights for policy 0, policy_version 1868607 (0.0008) [2023-12-28 08:41:31,232][106225] Updated weights for policy 1, policy_version 1872541 (0.0008) [2023-12-28 08:41:31,917][106226] Updated weights for policy 0, policy_version 1868617 (0.0007) [2023-12-28 08:41:31,976][106226] Updated weights for policy 0, policy_version 1868627 (0.0006) [2023-12-28 08:41:32,019][106225] Updated weights for policy 1, policy_version 1872551 (0.0010) [2023-12-28 08:41:32,038][106226] Updated weights for policy 0, policy_version 1868637 (0.0006) [2023-12-28 08:41:32,077][106225] Updated weights for policy 1, policy_version 1872561 (0.0010) [2023-12-28 08:41:32,100][106226] Updated weights for policy 0, policy_version 1868647 (0.0006) [2023-12-28 08:41:32,131][106225] Updated weights for policy 1, policy_version 1872571 (0.0010) [2023-12-28 08:41:32,803][106225] Updated weights for policy 1, policy_version 1872581 (0.0008) [2023-12-28 08:41:32,819][106226] Updated weights for policy 0, policy_version 1868657 (0.0009) [2023-12-28 08:41:32,862][106225] Updated weights for policy 1, policy_version 1872591 (0.0005) [2023-12-28 08:41:32,876][106226] Updated weights for policy 0, policy_version 1868667 (0.0009) [2023-12-28 08:41:32,920][106225] Updated weights for policy 1, policy_version 1872601 (0.0005) [2023-12-28 08:41:32,936][106226] Updated weights for policy 0, policy_version 1868677 (0.0008) [2023-12-28 08:41:33,453][106225] Updated weights for policy 1, policy_version 1872611 (0.0006) [2023-12-28 08:41:33,503][106225] Updated weights for policy 1, policy_version 1872621 (0.0005) [2023-12-28 08:41:33,557][106225] Updated weights for policy 1, policy_version 1872631 (0.0005) [2023-12-28 08:41:33,787][106226] Updated weights for policy 0, policy_version 1868687 (0.0009) [2023-12-28 08:41:33,841][106226] Updated weights for policy 0, policy_version 1868697 (0.0009) [2023-12-28 08:41:33,899][106226] Updated weights for policy 0, policy_version 1868707 (0.0009) [2023-12-28 08:41:34,129][106225] Updated weights for policy 1, policy_version 1872641 (0.0006) [2023-12-28 08:41:34,197][106225] Updated weights for policy 1, policy_version 1872651 (0.0010) [2023-12-28 08:41:34,258][106225] Updated weights for policy 1, policy_version 1872661 (0.0007) [2023-12-28 08:41:34,316][106225] Updated weights for policy 1, policy_version 1872671 (0.0008) [2023-12-28 08:41:34,620][106226] Updated weights for policy 0, policy_version 1868717 (0.0008) [2023-12-28 08:41:34,679][106226] Updated weights for policy 0, policy_version 1868727 (0.0008) [2023-12-28 08:41:34,730][106226] Updated weights for policy 0, policy_version 1868737 (0.0008) [2023-12-28 08:41:35,041][106225] Updated weights for policy 1, policy_version 1872681 (0.0008) [2023-12-28 08:41:35,087][106225] Updated weights for policy 1, policy_version 1872691 (0.0010) [2023-12-28 08:41:35,138][106225] Updated weights for policy 1, policy_version 1872701 (0.0010) [2023-12-28 08:41:35,305][106226] Updated weights for policy 0, policy_version 1868747 (0.0005) [2023-12-28 08:41:35,362][106226] Updated weights for policy 0, policy_version 1868757 (0.0005) [2023-12-28 08:41:35,417][106226] Updated weights for policy 0, policy_version 1868767 (0.0007) [2023-12-28 08:41:35,861][106225] Updated weights for policy 1, policy_version 1872711 (0.0010) [2023-12-28 08:41:35,911][106225] Updated weights for policy 1, policy_version 1872721 (0.0010) [2023-12-28 08:41:35,961][106225] Updated weights for policy 1, policy_version 1872731 (0.0010) [2023-12-28 08:41:36,058][106226] Updated weights for policy 0, policy_version 1868777 (0.0008) [2023-12-28 08:41:36,117][106226] Updated weights for policy 0, policy_version 1868787 (0.0009) [2023-12-28 08:41:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 957964288. Throughput: 0: 9895.6, 1: 10090.2. Samples: 957974836. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:36,175][105115] Avg episode reward: [(0, '-4.153'), (1, '-4.760')] [2023-12-28 08:41:36,178][106226] Updated weights for policy 0, policy_version 1868797 (0.0007) [2023-12-28 08:41:36,236][106226] Updated weights for policy 0, policy_version 1868807 (0.0008) [2023-12-28 08:41:36,704][106225] Updated weights for policy 1, policy_version 1872741 (0.0008) [2023-12-28 08:41:36,764][106225] Updated weights for policy 1, policy_version 1872751 (0.0006) [2023-12-28 08:41:36,824][106225] Updated weights for policy 1, policy_version 1872761 (0.0006) [2023-12-28 08:41:36,861][106226] Updated weights for policy 0, policy_version 1868817 (0.0009) [2023-12-28 08:41:36,922][106226] Updated weights for policy 0, policy_version 1868827 (0.0006) [2023-12-28 08:41:36,984][106226] Updated weights for policy 0, policy_version 1868837 (0.0009) [2023-12-28 08:41:37,439][106225] Updated weights for policy 1, policy_version 1872771 (0.0006) [2023-12-28 08:41:37,497][106225] Updated weights for policy 1, policy_version 1872781 (0.0007) [2023-12-28 08:41:37,545][106225] Updated weights for policy 1, policy_version 1872791 (0.0007) [2023-12-28 08:41:37,671][106226] Updated weights for policy 0, policy_version 1868847 (0.0009) [2023-12-28 08:41:37,722][106226] Updated weights for policy 0, policy_version 1868857 (0.0010) [2023-12-28 08:41:37,772][106226] Updated weights for policy 0, policy_version 1868867 (0.0010) [2023-12-28 08:41:38,252][106225] Updated weights for policy 1, policy_version 1872801 (0.0008) [2023-12-28 08:41:38,310][106225] Updated weights for policy 1, policy_version 1872811 (0.0008) [2023-12-28 08:41:38,374][106225] Updated weights for policy 1, policy_version 1872821 (0.0009) [2023-12-28 08:41:38,431][106225] Updated weights for policy 1, policy_version 1872831 (0.0008) [2023-12-28 08:41:38,525][106226] Updated weights for policy 0, policy_version 1868877 (0.0010) [2023-12-28 08:41:38,579][106226] Updated weights for policy 0, policy_version 1868887 (0.0010) [2023-12-28 08:41:38,633][106226] Updated weights for policy 0, policy_version 1868897 (0.0010) [2023-12-28 08:41:39,193][106225] Updated weights for policy 1, policy_version 1872841 (0.0006) [2023-12-28 08:41:39,251][106226] Updated weights for policy 0, policy_version 1868907 (0.0009) [2023-12-28 08:41:39,283][106225] Updated weights for policy 1, policy_version 1872851 (0.0007) [2023-12-28 08:41:39,317][106226] Updated weights for policy 0, policy_version 1868917 (0.0007) [2023-12-28 08:41:39,347][106225] Updated weights for policy 1, policy_version 1872861 (0.0009) [2023-12-28 08:41:39,386][106226] Updated weights for policy 0, policy_version 1868927 (0.0007) [2023-12-28 08:41:40,117][106226] Updated weights for policy 0, policy_version 1868937 (0.0008) [2023-12-28 08:41:40,156][106225] Updated weights for policy 1, policy_version 1872871 (0.0007) [2023-12-28 08:41:40,182][106226] Updated weights for policy 0, policy_version 1868947 (0.0008) [2023-12-28 08:41:40,221][106225] Updated weights for policy 1, policy_version 1872881 (0.0007) [2023-12-28 08:41:40,251][106226] Updated weights for policy 0, policy_version 1868957 (0.0006) [2023-12-28 08:41:40,288][106225] Updated weights for policy 1, policy_version 1872891 (0.0008) [2023-12-28 08:41:40,315][106226] Updated weights for policy 0, policy_version 1868967 (0.0006) [2023-12-28 08:41:40,906][106225] Updated weights for policy 1, policy_version 1872901 (0.0009) [2023-12-28 08:41:40,968][106225] Updated weights for policy 1, policy_version 1872911 (0.0008) [2023-12-28 08:41:41,029][106225] Updated weights for policy 1, policy_version 1872921 (0.0009) [2023-12-28 08:41:41,085][106226] Updated weights for policy 0, policy_version 1868977 (0.0008) [2023-12-28 08:41:41,160][106226] Updated weights for policy 0, policy_version 1868987 (0.0007) [2023-12-28 08:41:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 958062592. Throughput: 0: 9907.7, 1: 10126.4. Samples: 958035144. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:41,175][105115] Avg episode reward: [(0, '-4.638'), (1, '-4.509')] [2023-12-28 08:41:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001872928_479526912.pth... [2023-12-28 08:41:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001871744_479223808.pth [2023-12-28 08:41:41,223][106226] Updated weights for policy 0, policy_version 1868997 (0.0008) [2023-12-28 08:41:41,239][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001869000_478543872.pth... [2023-12-28 08:41:41,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001867816_478240768.pth [2023-12-28 08:41:41,788][106225] Updated weights for policy 1, policy_version 1872931 (0.0009) [2023-12-28 08:41:41,846][106225] Updated weights for policy 1, policy_version 1872941 (0.0009) [2023-12-28 08:41:41,901][106225] Updated weights for policy 1, policy_version 1872951 (0.0009) [2023-12-28 08:41:42,051][106226] Updated weights for policy 0, policy_version 1869007 (0.0009) [2023-12-28 08:41:42,113][106226] Updated weights for policy 0, policy_version 1869017 (0.0008) [2023-12-28 08:41:42,176][106226] Updated weights for policy 0, policy_version 1869027 (0.0008) [2023-12-28 08:41:42,634][106225] Updated weights for policy 1, policy_version 1872961 (0.0007) [2023-12-28 08:41:42,694][106225] Updated weights for policy 1, policy_version 1872971 (0.0008) [2023-12-28 08:41:42,753][106225] Updated weights for policy 1, policy_version 1872981 (0.0009) [2023-12-28 08:41:42,816][106225] Updated weights for policy 1, policy_version 1872991 (0.0009) [2023-12-28 08:41:42,881][106226] Updated weights for policy 0, policy_version 1869037 (0.0006) [2023-12-28 08:41:42,944][106226] Updated weights for policy 0, policy_version 1869047 (0.0005) [2023-12-28 08:41:42,998][106226] Updated weights for policy 0, policy_version 1869057 (0.0007) [2023-12-28 08:41:43,513][106225] Updated weights for policy 1, policy_version 1873001 (0.0009) [2023-12-28 08:41:43,544][106226] Updated weights for policy 0, policy_version 1869067 (0.0008) [2023-12-28 08:41:43,579][106225] Updated weights for policy 1, policy_version 1873011 (0.0008) [2023-12-28 08:41:43,605][106226] Updated weights for policy 0, policy_version 1869077 (0.0005) [2023-12-28 08:41:43,640][106225] Updated weights for policy 1, policy_version 1873021 (0.0007) [2023-12-28 08:41:43,660][106226] Updated weights for policy 0, policy_version 1869087 (0.0005) [2023-12-28 08:41:44,203][106226] Updated weights for policy 0, policy_version 1869097 (0.0005) [2023-12-28 08:41:44,262][106226] Updated weights for policy 0, policy_version 1869107 (0.0008) [2023-12-28 08:41:44,317][106226] Updated weights for policy 0, policy_version 1869117 (0.0007) [2023-12-28 08:41:44,371][106226] Updated weights for policy 0, policy_version 1869127 (0.0008) [2023-12-28 08:41:44,434][106225] Updated weights for policy 1, policy_version 1873031 (0.0009) [2023-12-28 08:41:44,489][106225] Updated weights for policy 1, policy_version 1873041 (0.0009) [2023-12-28 08:41:44,534][106225] Updated weights for policy 1, policy_version 1873051 (0.0008) [2023-12-28 08:41:45,068][106226] Updated weights for policy 0, policy_version 1869137 (0.0009) [2023-12-28 08:41:45,128][106226] Updated weights for policy 0, policy_version 1869147 (0.0009) [2023-12-28 08:41:45,194][106226] Updated weights for policy 0, policy_version 1869157 (0.0006) [2023-12-28 08:41:45,286][106225] Updated weights for policy 1, policy_version 1873061 (0.0009) [2023-12-28 08:41:45,337][106225] Updated weights for policy 1, policy_version 1873071 (0.0009) [2023-12-28 08:41:45,396][106225] Updated weights for policy 1, policy_version 1873081 (0.0006) [2023-12-28 08:41:45,756][106226] Updated weights for policy 0, policy_version 1869167 (0.0007) [2023-12-28 08:41:45,808][106226] Updated weights for policy 0, policy_version 1869177 (0.0007) [2023-12-28 08:41:45,857][106226] Updated weights for policy 0, policy_version 1869187 (0.0007) [2023-12-28 08:41:46,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 958160896. Throughput: 0: 9975.0, 1: 10032.3. Samples: 958150684. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:46,175][105115] Avg episode reward: [(0, '-4.151'), (1, '-4.761')] [2023-12-28 08:41:46,179][106225] Updated weights for policy 1, policy_version 1873091 (0.0008) [2023-12-28 08:41:46,229][106225] Updated weights for policy 1, policy_version 1873101 (0.0009) [2023-12-28 08:41:46,276][106225] Updated weights for policy 1, policy_version 1873111 (0.0009) [2023-12-28 08:41:46,506][106226] Updated weights for policy 0, policy_version 1869197 (0.0008) [2023-12-28 08:41:46,566][106226] Updated weights for policy 0, policy_version 1869207 (0.0009) [2023-12-28 08:41:46,626][106226] Updated weights for policy 0, policy_version 1869217 (0.0008) [2023-12-28 08:41:47,052][106225] Updated weights for policy 1, policy_version 1873121 (0.0008) [2023-12-28 08:41:47,104][106225] Updated weights for policy 1, policy_version 1873131 (0.0008) [2023-12-28 08:41:47,161][106225] Updated weights for policy 1, policy_version 1873141 (0.0007) [2023-12-28 08:41:47,220][106225] Updated weights for policy 1, policy_version 1873151 (0.0005) [2023-12-28 08:41:47,364][106226] Updated weights for policy 0, policy_version 1869227 (0.0008) [2023-12-28 08:41:47,426][106226] Updated weights for policy 0, policy_version 1869237 (0.0009) [2023-12-28 08:41:47,479][106226] Updated weights for policy 0, policy_version 1869247 (0.0008) [2023-12-28 08:41:47,849][106225] Updated weights for policy 1, policy_version 1873161 (0.0007) [2023-12-28 08:41:47,910][106225] Updated weights for policy 1, policy_version 1873171 (0.0006) [2023-12-28 08:41:47,966][106225] Updated weights for policy 1, policy_version 1873181 (0.0005) [2023-12-28 08:41:48,202][106226] Updated weights for policy 0, policy_version 1869257 (0.0008) [2023-12-28 08:41:48,255][106226] Updated weights for policy 0, policy_version 1869267 (0.0009) [2023-12-28 08:41:48,310][106226] Updated weights for policy 0, policy_version 1869277 (0.0009) [2023-12-28 08:41:48,374][106226] Updated weights for policy 0, policy_version 1869287 (0.0008) [2023-12-28 08:41:48,615][106225] Updated weights for policy 1, policy_version 1873191 (0.0008) [2023-12-28 08:41:48,661][106225] Updated weights for policy 1, policy_version 1873201 (0.0008) [2023-12-28 08:41:48,713][106225] Updated weights for policy 1, policy_version 1873211 (0.0008) [2023-12-28 08:41:49,033][106226] Updated weights for policy 0, policy_version 1869297 (0.0008) [2023-12-28 08:41:49,089][106226] Updated weights for policy 0, policy_version 1869307 (0.0009) [2023-12-28 08:41:49,141][106226] Updated weights for policy 0, policy_version 1869317 (0.0009) [2023-12-28 08:41:49,473][106225] Updated weights for policy 1, policy_version 1873221 (0.0007) [2023-12-28 08:41:49,530][106225] Updated weights for policy 1, policy_version 1873231 (0.0006) [2023-12-28 08:41:49,582][106225] Updated weights for policy 1, policy_version 1873241 (0.0005) [2023-12-28 08:41:49,896][106226] Updated weights for policy 0, policy_version 1869327 (0.0008) [2023-12-28 08:41:49,964][106226] Updated weights for policy 0, policy_version 1869337 (0.0009) [2023-12-28 08:41:50,024][106226] Updated weights for policy 0, policy_version 1869347 (0.0009) [2023-12-28 08:41:50,205][106225] Updated weights for policy 1, policy_version 1873251 (0.0006) [2023-12-28 08:41:50,265][106225] Updated weights for policy 1, policy_version 1873261 (0.0009) [2023-12-28 08:41:50,324][106225] Updated weights for policy 1, policy_version 1873271 (0.0008) [2023-12-28 08:41:50,796][106226] Updated weights for policy 0, policy_version 1869357 (0.0009) [2023-12-28 08:41:50,862][106226] Updated weights for policy 0, policy_version 1869367 (0.0008) [2023-12-28 08:41:50,926][106226] Updated weights for policy 0, policy_version 1869377 (0.0009) [2023-12-28 08:41:51,080][106225] Updated weights for policy 1, policy_version 1873281 (0.0009) [2023-12-28 08:41:51,147][106225] Updated weights for policy 1, policy_version 1873291 (0.0008) [2023-12-28 08:41:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 958259200. Throughput: 0: 9963.0, 1: 9966.7. Samples: 958269448. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:51,175][105115] Avg episode reward: [(0, '-4.311'), (1, '-4.664')] [2023-12-28 08:41:51,204][106225] Updated weights for policy 1, policy_version 1873301 (0.0006) [2023-12-28 08:41:51,273][106225] Updated weights for policy 1, policy_version 1873311 (0.0006) [2023-12-28 08:41:51,664][106226] Updated weights for policy 0, policy_version 1869387 (0.0006) [2023-12-28 08:41:51,723][106226] Updated weights for policy 0, policy_version 1869397 (0.0008) [2023-12-28 08:41:51,789][106226] Updated weights for policy 0, policy_version 1869407 (0.0008) [2023-12-28 08:41:51,986][106225] Updated weights for policy 1, policy_version 1873321 (0.0008) [2023-12-28 08:41:52,048][106225] Updated weights for policy 1, policy_version 1873331 (0.0009) [2023-12-28 08:41:52,116][106225] Updated weights for policy 1, policy_version 1873341 (0.0009) [2023-12-28 08:41:52,521][106226] Updated weights for policy 0, policy_version 1869417 (0.0008) [2023-12-28 08:41:52,587][106226] Updated weights for policy 0, policy_version 1869427 (0.0009) [2023-12-28 08:41:52,650][106226] Updated weights for policy 0, policy_version 1869437 (0.0009) [2023-12-28 08:41:52,716][106226] Updated weights for policy 0, policy_version 1869447 (0.0009) [2023-12-28 08:41:52,820][106225] Updated weights for policy 1, policy_version 1873351 (0.0010) [2023-12-28 08:41:52,877][106225] Updated weights for policy 1, policy_version 1873361 (0.0010) [2023-12-28 08:41:52,942][106225] Updated weights for policy 1, policy_version 1873371 (0.0010) [2023-12-28 08:41:53,427][106226] Updated weights for policy 0, policy_version 1869457 (0.0006) [2023-12-28 08:41:53,484][106226] Updated weights for policy 0, policy_version 1869467 (0.0005) [2023-12-28 08:41:53,550][106226] Updated weights for policy 0, policy_version 1869477 (0.0006) [2023-12-28 08:41:53,666][106225] Updated weights for policy 1, policy_version 1873381 (0.0011) [2023-12-28 08:41:53,722][106225] Updated weights for policy 1, policy_version 1873391 (0.0010) [2023-12-28 08:41:53,778][106225] Updated weights for policy 1, policy_version 1873401 (0.0009) [2023-12-28 08:41:54,222][106226] Updated weights for policy 0, policy_version 1869487 (0.0007) [2023-12-28 08:41:54,290][106226] Updated weights for policy 0, policy_version 1869497 (0.0008) [2023-12-28 08:41:54,355][106226] Updated weights for policy 0, policy_version 1869507 (0.0006) [2023-12-28 08:41:54,441][106225] Updated weights for policy 1, policy_version 1873411 (0.0007) [2023-12-28 08:41:54,504][106225] Updated weights for policy 1, policy_version 1873421 (0.0010) [2023-12-28 08:41:54,570][106225] Updated weights for policy 1, policy_version 1873431 (0.0010) [2023-12-28 08:41:55,036][106226] Updated weights for policy 0, policy_version 1869517 (0.0007) [2023-12-28 08:41:55,087][106226] Updated weights for policy 0, policy_version 1869527 (0.0009) [2023-12-28 08:41:55,133][106226] Updated weights for policy 0, policy_version 1869537 (0.0007) [2023-12-28 08:41:55,208][106225] Updated weights for policy 1, policy_version 1873441 (0.0010) [2023-12-28 08:41:55,253][106225] Updated weights for policy 1, policy_version 1873451 (0.0009) [2023-12-28 08:41:55,320][106225] Updated weights for policy 1, policy_version 1873461 (0.0005) [2023-12-28 08:41:55,370][106225] Updated weights for policy 1, policy_version 1873471 (0.0005) [2023-12-28 08:41:55,928][106226] Updated weights for policy 0, policy_version 1869547 (0.0007) [2023-12-28 08:41:55,980][106226] Updated weights for policy 0, policy_version 1869557 (0.0008) [2023-12-28 08:41:56,016][106225] Updated weights for policy 1, policy_version 1873481 (0.0010) [2023-12-28 08:41:56,037][106226] Updated weights for policy 0, policy_version 1869567 (0.0006) [2023-12-28 08:41:56,081][106225] Updated weights for policy 1, policy_version 1873491 (0.0006) [2023-12-28 08:41:56,135][106225] Updated weights for policy 1, policy_version 1873501 (0.0005) [2023-12-28 08:41:56,175][105115] Fps is (10 sec: 20479.5, 60 sec: 20070.4, 300 sec: 19882.9). Total num frames: 958365696. Throughput: 0: 9937.2, 1: 9934.2. Samples: 958327096. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:41:56,175][105115] Avg episode reward: [(0, '-4.129'), (1, '-4.710')] [2023-12-28 08:41:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001873504_479674368.pth... [2023-12-28 08:41:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001869576_478691328.pth... [2023-12-28 08:41:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001872352_479379456.pth [2023-12-28 08:41:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001868392_478388224.pth [2023-12-28 08:41:56,777][106226] Updated weights for policy 0, policy_version 1869577 (0.0006) [2023-12-28 08:41:56,808][106225] Updated weights for policy 1, policy_version 1873511 (0.0009) [2023-12-28 08:41:56,827][106226] Updated weights for policy 0, policy_version 1869587 (0.0009) [2023-12-28 08:41:56,850][106225] Updated weights for policy 1, policy_version 1873521 (0.0010) [2023-12-28 08:41:56,878][106226] Updated weights for policy 0, policy_version 1869597 (0.0010) [2023-12-28 08:41:56,911][106225] Updated weights for policy 1, policy_version 1873531 (0.0010) [2023-12-28 08:41:56,942][106226] Updated weights for policy 0, policy_version 1869607 (0.0007) [2023-12-28 08:41:57,611][106225] Updated weights for policy 1, policy_version 1873541 (0.0010) [2023-12-28 08:41:57,662][106226] Updated weights for policy 0, policy_version 1869617 (0.0010) [2023-12-28 08:41:57,664][106225] Updated weights for policy 1, policy_version 1873551 (0.0010) [2023-12-28 08:41:57,718][106225] Updated weights for policy 1, policy_version 1873561 (0.0010) [2023-12-28 08:41:57,722][106226] Updated weights for policy 0, policy_version 1869627 (0.0011) [2023-12-28 08:41:57,778][106226] Updated weights for policy 0, policy_version 1869637 (0.0011) [2023-12-28 08:41:58,405][106226] Updated weights for policy 0, policy_version 1869647 (0.0009) [2023-12-28 08:41:58,473][106226] Updated weights for policy 0, policy_version 1869657 (0.0008) [2023-12-28 08:41:58,484][106225] Updated weights for policy 1, policy_version 1873571 (0.0010) [2023-12-28 08:41:58,533][106226] Updated weights for policy 0, policy_version 1869667 (0.0008) [2023-12-28 08:41:58,548][106225] Updated weights for policy 1, policy_version 1873581 (0.0011) [2023-12-28 08:41:58,613][106225] Updated weights for policy 1, policy_version 1873591 (0.0011) [2023-12-28 08:41:59,249][106226] Updated weights for policy 0, policy_version 1869677 (0.0008) [2023-12-28 08:41:59,317][106226] Updated weights for policy 0, policy_version 1869687 (0.0007) [2023-12-28 08:41:59,387][106226] Updated weights for policy 0, policy_version 1869697 (0.0007) [2023-12-28 08:41:59,423][106225] Updated weights for policy 1, policy_version 1873601 (0.0010) [2023-12-28 08:41:59,481][106225] Updated weights for policy 1, policy_version 1873611 (0.0012) [2023-12-28 08:41:59,543][106225] Updated weights for policy 1, policy_version 1873621 (0.0007) [2023-12-28 08:41:59,609][106225] Updated weights for policy 1, policy_version 1873631 (0.0007) [2023-12-28 08:42:00,043][106226] Updated weights for policy 0, policy_version 1869707 (0.0006) [2023-12-28 08:42:00,101][106226] Updated weights for policy 0, policy_version 1869717 (0.0008) [2023-12-28 08:42:00,153][106226] Updated weights for policy 0, policy_version 1869727 (0.0009) [2023-12-28 08:42:00,314][106225] Updated weights for policy 1, policy_version 1873641 (0.0006) [2023-12-28 08:42:00,362][106225] Updated weights for policy 1, policy_version 1873651 (0.0008) [2023-12-28 08:42:00,408][106225] Updated weights for policy 1, policy_version 1873661 (0.0007) [2023-12-28 08:42:00,844][106226] Updated weights for policy 0, policy_version 1869737 (0.0009) [2023-12-28 08:42:00,913][106226] Updated weights for policy 0, policy_version 1869747 (0.0011) [2023-12-28 08:42:00,975][106226] Updated weights for policy 0, policy_version 1869757 (0.0010) [2023-12-28 08:42:01,042][106226] Updated weights for policy 0, policy_version 1869767 (0.0010) [2023-12-28 08:42:01,073][106225] Updated weights for policy 1, policy_version 1873671 (0.0008) [2023-12-28 08:42:01,120][106225] Updated weights for policy 1, policy_version 1873681 (0.0007) [2023-12-28 08:42:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 958455808. Throughput: 0: 9973.5, 1: 9902.0. Samples: 958445340. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:01,175][105115] Avg episode reward: [(0, '-4.153'), (1, '-4.818')] [2023-12-28 08:42:01,184][106225] Updated weights for policy 1, policy_version 1873691 (0.0009) [2023-12-28 08:42:01,775][106226] Updated weights for policy 0, policy_version 1869777 (0.0009) [2023-12-28 08:42:01,838][106226] Updated weights for policy 0, policy_version 1869787 (0.0010) [2023-12-28 08:42:01,898][106226] Updated weights for policy 0, policy_version 1869797 (0.0010) [2023-12-28 08:42:01,953][106225] Updated weights for policy 1, policy_version 1873701 (0.0008) [2023-12-28 08:42:02,019][106225] Updated weights for policy 1, policy_version 1873711 (0.0008) [2023-12-28 08:42:02,076][106225] Updated weights for policy 1, policy_version 1873721 (0.0008) [2023-12-28 08:42:02,649][106226] Updated weights for policy 0, policy_version 1869807 (0.0007) [2023-12-28 08:42:02,716][106226] Updated weights for policy 0, policy_version 1869817 (0.0007) [2023-12-28 08:42:02,779][106226] Updated weights for policy 0, policy_version 1869827 (0.0009) [2023-12-28 08:42:02,846][106225] Updated weights for policy 1, policy_version 1873731 (0.0008) [2023-12-28 08:42:02,908][106225] Updated weights for policy 1, policy_version 1873741 (0.0009) [2023-12-28 08:42:02,966][106225] Updated weights for policy 1, policy_version 1873751 (0.0008) [2023-12-28 08:42:03,419][106226] Updated weights for policy 0, policy_version 1869837 (0.0009) [2023-12-28 08:42:03,474][106226] Updated weights for policy 0, policy_version 1869847 (0.0007) [2023-12-28 08:42:03,537][106226] Updated weights for policy 0, policy_version 1869857 (0.0005) [2023-12-28 08:42:03,745][106225] Updated weights for policy 1, policy_version 1873761 (0.0008) [2023-12-28 08:42:03,789][106225] Updated weights for policy 1, policy_version 1873771 (0.0008) [2023-12-28 08:42:03,847][106225] Updated weights for policy 1, policy_version 1873781 (0.0008) [2023-12-28 08:42:03,907][106225] Updated weights for policy 1, policy_version 1873791 (0.0008) [2023-12-28 08:42:04,148][106226] Updated weights for policy 0, policy_version 1869867 (0.0006) [2023-12-28 08:42:04,204][106226] Updated weights for policy 0, policy_version 1869877 (0.0008) [2023-12-28 08:42:04,257][106226] Updated weights for policy 0, policy_version 1869887 (0.0008) [2023-12-28 08:42:04,664][106225] Updated weights for policy 1, policy_version 1873801 (0.0007) [2023-12-28 08:42:04,718][106225] Updated weights for policy 1, policy_version 1873811 (0.0008) [2023-12-28 08:42:04,773][106225] Updated weights for policy 1, policy_version 1873821 (0.0008) [2023-12-28 08:42:04,951][106226] Updated weights for policy 0, policy_version 1869897 (0.0008) [2023-12-28 08:42:05,008][106226] Updated weights for policy 0, policy_version 1869907 (0.0007) [2023-12-28 08:42:05,076][106226] Updated weights for policy 0, policy_version 1869917 (0.0011) [2023-12-28 08:42:05,133][106226] Updated weights for policy 0, policy_version 1869927 (0.0011) [2023-12-28 08:42:05,442][106225] Updated weights for policy 1, policy_version 1873831 (0.0008) [2023-12-28 08:42:05,493][106225] Updated weights for policy 1, policy_version 1873841 (0.0007) [2023-12-28 08:42:05,545][106225] Updated weights for policy 1, policy_version 1873851 (0.0007) [2023-12-28 08:42:05,815][106226] Updated weights for policy 0, policy_version 1869937 (0.0010) [2023-12-28 08:42:05,877][106226] Updated weights for policy 0, policy_version 1869947 (0.0010) [2023-12-28 08:42:05,936][106226] Updated weights for policy 0, policy_version 1869957 (0.0011) [2023-12-28 08:42:06,175][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 958554112. Throughput: 0: 9971.7, 1: 9858.9. Samples: 958563448. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:06,175][105115] Avg episode reward: [(0, '-4.099'), (1, '-4.551')] [2023-12-28 08:42:06,232][106225] Updated weights for policy 1, policy_version 1873861 (0.0006) [2023-12-28 08:42:06,300][106225] Updated weights for policy 1, policy_version 1873871 (0.0005) [2023-12-28 08:42:06,360][106225] Updated weights for policy 1, policy_version 1873881 (0.0009) [2023-12-28 08:42:06,648][106226] Updated weights for policy 0, policy_version 1869967 (0.0011) [2023-12-28 08:42:06,720][106226] Updated weights for policy 0, policy_version 1869977 (0.0011) [2023-12-28 08:42:06,785][106226] Updated weights for policy 0, policy_version 1869987 (0.0011) [2023-12-28 08:42:07,045][106225] Updated weights for policy 1, policy_version 1873891 (0.0011) [2023-12-28 08:42:07,110][106225] Updated weights for policy 1, policy_version 1873901 (0.0011) [2023-12-28 08:42:07,168][106225] Updated weights for policy 1, policy_version 1873911 (0.0008) [2023-12-28 08:42:07,473][106226] Updated weights for policy 0, policy_version 1869997 (0.0011) [2023-12-28 08:42:07,523][106226] Updated weights for policy 0, policy_version 1870007 (0.0010) [2023-12-28 08:42:07,575][106226] Updated weights for policy 0, policy_version 1870017 (0.0010) [2023-12-28 08:42:07,739][106225] Updated weights for policy 1, policy_version 1873921 (0.0006) [2023-12-28 08:42:07,791][106225] Updated weights for policy 1, policy_version 1873931 (0.0008) [2023-12-28 08:42:07,846][106225] Updated weights for policy 1, policy_version 1873941 (0.0008) [2023-12-28 08:42:07,907][106225] Updated weights for policy 1, policy_version 1873951 (0.0008) [2023-12-28 08:42:08,340][106226] Updated weights for policy 0, policy_version 1870027 (0.0010) [2023-12-28 08:42:08,403][106226] Updated weights for policy 0, policy_version 1870037 (0.0008) [2023-12-28 08:42:08,461][106226] Updated weights for policy 0, policy_version 1870047 (0.0010) [2023-12-28 08:42:08,567][106225] Updated weights for policy 1, policy_version 1873961 (0.0008) [2023-12-28 08:42:08,628][106225] Updated weights for policy 1, policy_version 1873971 (0.0008) [2023-12-28 08:42:08,693][106225] Updated weights for policy 1, policy_version 1873981 (0.0008) [2023-12-28 08:42:09,211][106226] Updated weights for policy 0, policy_version 1870057 (0.0010) [2023-12-28 08:42:09,277][106226] Updated weights for policy 0, policy_version 1870067 (0.0009) [2023-12-28 08:42:09,351][106226] Updated weights for policy 0, policy_version 1870077 (0.0009) [2023-12-28 08:42:09,419][106226] Updated weights for policy 0, policy_version 1870087 (0.0008) [2023-12-28 08:42:09,428][106225] Updated weights for policy 1, policy_version 1873991 (0.0009) [2023-12-28 08:42:09,491][106225] Updated weights for policy 1, policy_version 1874001 (0.0010) [2023-12-28 08:42:09,549][106225] Updated weights for policy 1, policy_version 1874011 (0.0010) [2023-12-28 08:42:10,103][106226] Updated weights for policy 0, policy_version 1870097 (0.0008) [2023-12-28 08:42:10,155][106226] Updated weights for policy 0, policy_version 1870107 (0.0008) [2023-12-28 08:42:10,220][106226] Updated weights for policy 0, policy_version 1870117 (0.0008) [2023-12-28 08:42:10,285][106225] Updated weights for policy 1, policy_version 1874021 (0.0009) [2023-12-28 08:42:10,351][106225] Updated weights for policy 1, policy_version 1874031 (0.0006) [2023-12-28 08:42:10,411][106225] Updated weights for policy 1, policy_version 1874041 (0.0008) [2023-12-28 08:42:10,986][106226] Updated weights for policy 0, policy_version 1870127 (0.0008) [2023-12-28 08:42:11,027][106225] Updated weights for policy 1, policy_version 1874051 (0.0009) [2023-12-28 08:42:11,050][106226] Updated weights for policy 0, policy_version 1870137 (0.0008) [2023-12-28 08:42:11,085][106225] Updated weights for policy 1, policy_version 1874061 (0.0008) [2023-12-28 08:42:11,105][106226] Updated weights for policy 0, policy_version 1870147 (0.0008) [2023-12-28 08:42:11,156][106225] Updated weights for policy 1, policy_version 1874071 (0.0010) [2023-12-28 08:42:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 958652416. Throughput: 0: 10008.4, 1: 9921.9. Samples: 958623428. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:11,175][105115] Avg episode reward: [(0, '-4.615'), (1, '-4.676')] [2023-12-28 08:42:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001870152_478838784.pth... [2023-12-28 08:42:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001869000_478543872.pth [2023-12-28 08:42:11,214][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001874080_479821824.pth... [2023-12-28 08:42:11,219][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001872928_479526912.pth [2023-12-28 08:42:11,876][106226] Updated weights for policy 0, policy_version 1870157 (0.0009) [2023-12-28 08:42:11,914][106225] Updated weights for policy 1, policy_version 1874081 (0.0008) [2023-12-28 08:42:11,940][106226] Updated weights for policy 0, policy_version 1870167 (0.0007) [2023-12-28 08:42:11,977][106225] Updated weights for policy 1, policy_version 1874091 (0.0009) [2023-12-28 08:42:12,003][106226] Updated weights for policy 0, policy_version 1870177 (0.0007) [2023-12-28 08:42:12,035][106225] Updated weights for policy 1, policy_version 1874101 (0.0007) [2023-12-28 08:42:12,101][106225] Updated weights for policy 1, policy_version 1874111 (0.0006) [2023-12-28 08:42:12,797][106226] Updated weights for policy 0, policy_version 1870187 (0.0009) [2023-12-28 08:42:12,799][106225] Updated weights for policy 1, policy_version 1874121 (0.0007) [2023-12-28 08:42:12,844][106226] Updated weights for policy 0, policy_version 1870197 (0.0010) [2023-12-28 08:42:12,854][106225] Updated weights for policy 1, policy_version 1874131 (0.0006) [2023-12-28 08:42:12,897][106226] Updated weights for policy 0, policy_version 1870207 (0.0010) [2023-12-28 08:42:12,907][106225] Updated weights for policy 1, policy_version 1874141 (0.0006) [2023-12-28 08:42:13,628][106226] Updated weights for policy 0, policy_version 1870217 (0.0010) [2023-12-28 08:42:13,635][106225] Updated weights for policy 1, policy_version 1874151 (0.0006) [2023-12-28 08:42:13,686][106225] Updated weights for policy 1, policy_version 1874161 (0.0005) [2023-12-28 08:42:13,688][106226] Updated weights for policy 0, policy_version 1870227 (0.0010) [2023-12-28 08:42:13,738][106226] Updated weights for policy 0, policy_version 1870237 (0.0010) [2023-12-28 08:42:13,744][106225] Updated weights for policy 1, policy_version 1874171 (0.0005) [2023-12-28 08:42:13,788][106226] Updated weights for policy 0, policy_version 1870247 (0.0010) [2023-12-28 08:42:14,416][106226] Updated weights for policy 0, policy_version 1870257 (0.0011) [2023-12-28 08:42:14,473][106226] Updated weights for policy 0, policy_version 1870267 (0.0010) [2023-12-28 08:42:14,503][106225] Updated weights for policy 1, policy_version 1874181 (0.0007) [2023-12-28 08:42:14,521][106226] Updated weights for policy 0, policy_version 1870277 (0.0008) [2023-12-28 08:42:14,553][106225] Updated weights for policy 1, policy_version 1874191 (0.0009) [2023-12-28 08:42:14,599][106225] Updated weights for policy 1, policy_version 1874201 (0.0007) [2023-12-28 08:42:15,241][106226] Updated weights for policy 0, policy_version 1870287 (0.0009) [2023-12-28 08:42:15,303][106226] Updated weights for policy 0, policy_version 1870297 (0.0011) [2023-12-28 08:42:15,361][106226] Updated weights for policy 0, policy_version 1870307 (0.0011) [2023-12-28 08:42:15,363][106225] Updated weights for policy 1, policy_version 1874211 (0.0007) [2023-12-28 08:42:15,421][106225] Updated weights for policy 1, policy_version 1874221 (0.0007) [2023-12-28 08:42:15,473][106225] Updated weights for policy 1, policy_version 1874231 (0.0009) [2023-12-28 08:42:15,958][106226] Updated weights for policy 0, policy_version 1870317 (0.0011) [2023-12-28 08:42:16,015][106226] Updated weights for policy 0, policy_version 1870327 (0.0011) [2023-12-28 08:42:16,075][106226] Updated weights for policy 0, policy_version 1870337 (0.0011) [2023-12-28 08:42:16,092][106225] Updated weights for policy 1, policy_version 1874241 (0.0008) [2023-12-28 08:42:16,153][106225] Updated weights for policy 1, policy_version 1874251 (0.0007) [2023-12-28 08:42:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 958750720. Throughput: 0: 9841.6, 1: 9805.9. Samples: 958738296. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:16,176][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.870')] [2023-12-28 08:42:16,206][106225] Updated weights for policy 1, policy_version 1874261 (0.0005) [2023-12-28 08:42:16,258][106225] Updated weights for policy 1, policy_version 1874271 (0.0005) [2023-12-28 08:42:16,778][106226] Updated weights for policy 0, policy_version 1870347 (0.0011) [2023-12-28 08:42:16,836][106226] Updated weights for policy 0, policy_version 1870357 (0.0010) [2023-12-28 08:42:16,867][106225] Updated weights for policy 1, policy_version 1874281 (0.0010) [2023-12-28 08:42:16,892][106226] Updated weights for policy 0, policy_version 1870367 (0.0009) [2023-12-28 08:42:16,919][106225] Updated weights for policy 1, policy_version 1874291 (0.0010) [2023-12-28 08:42:16,980][106225] Updated weights for policy 1, policy_version 1874301 (0.0010) [2023-12-28 08:42:17,586][106226] Updated weights for policy 0, policy_version 1870377 (0.0010) [2023-12-28 08:42:17,628][106225] Updated weights for policy 1, policy_version 1874311 (0.0007) [2023-12-28 08:42:17,633][106226] Updated weights for policy 0, policy_version 1870387 (0.0010) [2023-12-28 08:42:17,679][106226] Updated weights for policy 0, policy_version 1870397 (0.0009) [2023-12-28 08:42:17,687][106225] Updated weights for policy 1, policy_version 1874321 (0.0005) [2023-12-28 08:42:17,731][106226] Updated weights for policy 0, policy_version 1870407 (0.0005) [2023-12-28 08:42:17,746][106225] Updated weights for policy 1, policy_version 1874331 (0.0008) [2023-12-28 08:42:18,420][106225] Updated weights for policy 1, policy_version 1874341 (0.0008) [2023-12-28 08:42:18,460][106226] Updated weights for policy 0, policy_version 1870417 (0.0007) [2023-12-28 08:42:18,476][106225] Updated weights for policy 1, policy_version 1874351 (0.0009) [2023-12-28 08:42:18,513][106226] Updated weights for policy 0, policy_version 1870427 (0.0005) [2023-12-28 08:42:18,530][106225] Updated weights for policy 1, policy_version 1874361 (0.0010) [2023-12-28 08:42:18,574][106226] Updated weights for policy 0, policy_version 1870437 (0.0006) [2023-12-28 08:42:19,151][106226] Updated weights for policy 0, policy_version 1870447 (0.0009) [2023-12-28 08:42:19,213][106226] Updated weights for policy 0, policy_version 1870457 (0.0006) [2023-12-28 08:42:19,278][106226] Updated weights for policy 0, policy_version 1870467 (0.0008) [2023-12-28 08:42:19,279][106225] Updated weights for policy 1, policy_version 1874371 (0.0009) [2023-12-28 08:42:19,337][106225] Updated weights for policy 1, policy_version 1874381 (0.0008) [2023-12-28 08:42:19,407][106225] Updated weights for policy 1, policy_version 1874391 (0.0008) [2023-12-28 08:42:20,021][106226] Updated weights for policy 0, policy_version 1870477 (0.0007) [2023-12-28 08:42:20,081][106226] Updated weights for policy 0, policy_version 1870487 (0.0006) [2023-12-28 08:42:20,141][106226] Updated weights for policy 0, policy_version 1870497 (0.0007) [2023-12-28 08:42:20,189][106225] Updated weights for policy 1, policy_version 1874401 (0.0008) [2023-12-28 08:42:20,244][106225] Updated weights for policy 1, policy_version 1874411 (0.0011) [2023-12-28 08:42:20,292][106225] Updated weights for policy 1, policy_version 1874421 (0.0010) [2023-12-28 08:42:20,352][106225] Updated weights for policy 1, policy_version 1874431 (0.0010) [2023-12-28 08:42:20,827][106226] Updated weights for policy 0, policy_version 1870507 (0.0008) [2023-12-28 08:42:20,885][106226] Updated weights for policy 0, policy_version 1870517 (0.0011) [2023-12-28 08:42:20,943][106226] Updated weights for policy 0, policy_version 1870527 (0.0011) [2023-12-28 08:42:21,115][106225] Updated weights for policy 1, policy_version 1874441 (0.0009) [2023-12-28 08:42:21,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 958849024. Throughput: 0: 9879.5, 1: 9782.0. Samples: 958859600. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:21,175][105115] Avg episode reward: [(0, '-3.982'), (1, '-4.667')] [2023-12-28 08:42:21,181][106225] Updated weights for policy 1, policy_version 1874451 (0.0009) [2023-12-28 08:42:21,251][106225] Updated weights for policy 1, policy_version 1874461 (0.0008) [2023-12-28 08:42:21,697][106226] Updated weights for policy 0, policy_version 1870537 (0.0011) [2023-12-28 08:42:21,765][106226] Updated weights for policy 0, policy_version 1870547 (0.0010) [2023-12-28 08:42:21,837][106226] Updated weights for policy 0, policy_version 1870557 (0.0011) [2023-12-28 08:42:21,903][106226] Updated weights for policy 0, policy_version 1870567 (0.0008) [2023-12-28 08:42:21,966][106225] Updated weights for policy 1, policy_version 1874471 (0.0008) [2023-12-28 08:42:22,028][106225] Updated weights for policy 1, policy_version 1874481 (0.0007) [2023-12-28 08:42:22,083][106225] Updated weights for policy 1, policy_version 1874491 (0.0008) [2023-12-28 08:42:22,608][106226] Updated weights for policy 0, policy_version 1870577 (0.0011) [2023-12-28 08:42:22,666][106226] Updated weights for policy 0, policy_version 1870587 (0.0011) [2023-12-28 08:42:22,730][106226] Updated weights for policy 0, policy_version 1870597 (0.0011) [2023-12-28 08:42:22,760][106225] Updated weights for policy 1, policy_version 1874501 (0.0008) [2023-12-28 08:42:22,821][106225] Updated weights for policy 1, policy_version 1874511 (0.0006) [2023-12-28 08:42:22,874][106225] Updated weights for policy 1, policy_version 1874521 (0.0005) [2023-12-28 08:42:23,366][106226] Updated weights for policy 0, policy_version 1870607 (0.0007) [2023-12-28 08:42:23,437][106226] Updated weights for policy 0, policy_version 1870617 (0.0006) [2023-12-28 08:42:23,492][106226] Updated weights for policy 0, policy_version 1870627 (0.0009) [2023-12-28 08:42:23,540][106225] Updated weights for policy 1, policy_version 1874531 (0.0006) [2023-12-28 08:42:23,589][106225] Updated weights for policy 1, policy_version 1874541 (0.0006) [2023-12-28 08:42:23,641][106225] Updated weights for policy 1, policy_version 1874551 (0.0008) [2023-12-28 08:42:24,158][106226] Updated weights for policy 0, policy_version 1870637 (0.0007) [2023-12-28 08:42:24,209][106226] Updated weights for policy 0, policy_version 1870647 (0.0008) [2023-12-28 08:42:24,269][106226] Updated weights for policy 0, policy_version 1870657 (0.0008) [2023-12-28 08:42:24,288][106225] Updated weights for policy 1, policy_version 1874561 (0.0006) [2023-12-28 08:42:24,351][106225] Updated weights for policy 1, policy_version 1874571 (0.0009) [2023-12-28 08:42:24,418][106225] Updated weights for policy 1, policy_version 1874581 (0.0009) [2023-12-28 08:42:24,480][106225] Updated weights for policy 1, policy_version 1874591 (0.0008) [2023-12-28 08:42:24,972][106226] Updated weights for policy 0, policy_version 1870667 (0.0008) [2023-12-28 08:42:25,031][106226] Updated weights for policy 0, policy_version 1870677 (0.0008) [2023-12-28 08:42:25,091][106226] Updated weights for policy 0, policy_version 1870687 (0.0008) [2023-12-28 08:42:25,240][106225] Updated weights for policy 1, policy_version 1874601 (0.0008) [2023-12-28 08:42:25,290][106225] Updated weights for policy 1, policy_version 1874611 (0.0009) [2023-12-28 08:42:25,342][106225] Updated weights for policy 1, policy_version 1874621 (0.0009) [2023-12-28 08:42:25,775][106226] Updated weights for policy 0, policy_version 1870697 (0.0008) [2023-12-28 08:42:25,830][106226] Updated weights for policy 0, policy_version 1870707 (0.0008) [2023-12-28 08:42:25,888][106226] Updated weights for policy 0, policy_version 1870717 (0.0008) [2023-12-28 08:42:25,941][106226] Updated weights for policy 0, policy_version 1870727 (0.0007) [2023-12-28 08:42:26,107][106225] Updated weights for policy 1, policy_version 1874631 (0.0008) [2023-12-28 08:42:26,162][106225] Updated weights for policy 1, policy_version 1874641 (0.0009) [2023-12-28 08:42:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 958947328. Throughput: 0: 9850.8, 1: 9775.0. Samples: 958918308. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:26,176][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.823')] [2023-12-28 08:42:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001870728_478986240.pth... [2023-12-28 08:42:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001869576_478691328.pth [2023-12-28 08:42:26,211][106225] Updated weights for policy 1, policy_version 1874651 (0.0008) [2023-12-28 08:42:26,241][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001874656_479969280.pth... [2023-12-28 08:42:26,245][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001873504_479674368.pth [2023-12-28 08:42:26,596][106226] Updated weights for policy 0, policy_version 1870737 (0.0008) [2023-12-28 08:42:26,646][106226] Updated weights for policy 0, policy_version 1870747 (0.0008) [2023-12-28 08:42:26,706][106226] Updated weights for policy 0, policy_version 1870757 (0.0008) [2023-12-28 08:42:26,958][106225] Updated weights for policy 1, policy_version 1874661 (0.0008) [2023-12-28 08:42:27,012][106225] Updated weights for policy 1, policy_version 1874671 (0.0009) [2023-12-28 08:42:27,063][106225] Updated weights for policy 1, policy_version 1874681 (0.0008) [2023-12-28 08:42:27,394][106226] Updated weights for policy 0, policy_version 1870767 (0.0009) [2023-12-28 08:42:27,444][106226] Updated weights for policy 0, policy_version 1870777 (0.0008) [2023-12-28 08:42:27,502][106226] Updated weights for policy 0, policy_version 1870787 (0.0008) [2023-12-28 08:42:27,802][106225] Updated weights for policy 1, policy_version 1874691 (0.0008) [2023-12-28 08:42:27,857][106225] Updated weights for policy 1, policy_version 1874701 (0.0008) [2023-12-28 08:42:27,915][106225] Updated weights for policy 1, policy_version 1874711 (0.0008) [2023-12-28 08:42:28,224][106226] Updated weights for policy 0, policy_version 1870797 (0.0008) [2023-12-28 08:42:28,278][106226] Updated weights for policy 0, policy_version 1870807 (0.0007) [2023-12-28 08:42:28,323][106226] Updated weights for policy 0, policy_version 1870817 (0.0008) [2023-12-28 08:42:28,657][106225] Updated weights for policy 1, policy_version 1874721 (0.0008) [2023-12-28 08:42:28,717][106225] Updated weights for policy 1, policy_version 1874731 (0.0010) [2023-12-28 08:42:28,779][106225] Updated weights for policy 1, policy_version 1874741 (0.0008) [2023-12-28 08:42:28,829][106225] Updated weights for policy 1, policy_version 1874751 (0.0006) [2023-12-28 08:42:29,034][106226] Updated weights for policy 0, policy_version 1870827 (0.0008) [2023-12-28 08:42:29,088][106226] Updated weights for policy 0, policy_version 1870837 (0.0008) [2023-12-28 08:42:29,148][106226] Updated weights for policy 0, policy_version 1870847 (0.0009) [2023-12-28 08:42:29,459][106225] Updated weights for policy 1, policy_version 1874761 (0.0007) [2023-12-28 08:42:29,512][106225] Updated weights for policy 1, policy_version 1874771 (0.0008) [2023-12-28 08:42:29,574][106225] Updated weights for policy 1, policy_version 1874781 (0.0009) [2023-12-28 08:42:29,857][106226] Updated weights for policy 0, policy_version 1870857 (0.0008) [2023-12-28 08:42:29,923][106226] Updated weights for policy 0, policy_version 1870867 (0.0011) [2023-12-28 08:42:29,994][106226] Updated weights for policy 0, policy_version 1870877 (0.0008) [2023-12-28 08:42:30,054][106226] Updated weights for policy 0, policy_version 1870887 (0.0010) [2023-12-28 08:42:30,322][106225] Updated weights for policy 1, policy_version 1874791 (0.0008) [2023-12-28 08:42:30,383][106225] Updated weights for policy 1, policy_version 1874801 (0.0008) [2023-12-28 08:42:30,442][106225] Updated weights for policy 1, policy_version 1874811 (0.0008) [2023-12-28 08:42:30,757][106226] Updated weights for policy 0, policy_version 1870897 (0.0010) [2023-12-28 08:42:30,807][106226] Updated weights for policy 0, policy_version 1870907 (0.0010) [2023-12-28 08:42:30,859][106226] Updated weights for policy 0, policy_version 1870917 (0.0010) [2023-12-28 08:42:31,120][106225] Updated weights for policy 1, policy_version 1874821 (0.0007) [2023-12-28 08:42:31,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 959045632. Throughput: 0: 9868.1, 1: 9823.6. Samples: 959036812. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:31,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.985')] [2023-12-28 08:42:31,195][106225] Updated weights for policy 1, policy_version 1874831 (0.0009) [2023-12-28 08:42:31,256][106225] Updated weights for policy 1, policy_version 1874841 (0.0008) [2023-12-28 08:42:31,635][106226] Updated weights for policy 0, policy_version 1870927 (0.0009) [2023-12-28 08:42:31,701][106226] Updated weights for policy 0, policy_version 1870937 (0.0009) [2023-12-28 08:42:31,772][106226] Updated weights for policy 0, policy_version 1870947 (0.0009) [2023-12-28 08:42:32,063][106225] Updated weights for policy 1, policy_version 1874851 (0.0008) [2023-12-28 08:42:32,129][106225] Updated weights for policy 1, policy_version 1874861 (0.0008) [2023-12-28 08:42:32,190][106225] Updated weights for policy 1, policy_version 1874871 (0.0008) [2023-12-28 08:42:32,434][106226] Updated weights for policy 0, policy_version 1870957 (0.0007) [2023-12-28 08:42:32,493][106226] Updated weights for policy 0, policy_version 1870967 (0.0005) [2023-12-28 08:42:32,544][106226] Updated weights for policy 0, policy_version 1870977 (0.0005) [2023-12-28 08:42:32,996][106225] Updated weights for policy 1, policy_version 1874881 (0.0008) [2023-12-28 08:42:33,050][106225] Updated weights for policy 1, policy_version 1874891 (0.0008) [2023-12-28 08:42:33,099][106225] Updated weights for policy 1, policy_version 1874901 (0.0009) [2023-12-28 08:42:33,100][106226] Updated weights for policy 0, policy_version 1870987 (0.0005) [2023-12-28 08:42:33,152][106225] Updated weights for policy 1, policy_version 1874911 (0.0008) [2023-12-28 08:42:33,153][106226] Updated weights for policy 0, policy_version 1870997 (0.0005) [2023-12-28 08:42:33,209][106226] Updated weights for policy 0, policy_version 1871007 (0.0008) [2023-12-28 08:42:33,908][106225] Updated weights for policy 1, policy_version 1874921 (0.0007) [2023-12-28 08:42:33,919][106226] Updated weights for policy 0, policy_version 1871017 (0.0008) [2023-12-28 08:42:33,952][106225] Updated weights for policy 1, policy_version 1874931 (0.0006) [2023-12-28 08:42:33,966][106226] Updated weights for policy 0, policy_version 1871027 (0.0005) [2023-12-28 08:42:34,001][106225] Updated weights for policy 1, policy_version 1874941 (0.0006) [2023-12-28 08:42:34,022][106226] Updated weights for policy 0, policy_version 1871037 (0.0009) [2023-12-28 08:42:34,066][106226] Updated weights for policy 0, policy_version 1871047 (0.0008) [2023-12-28 08:42:34,738][106225] Updated weights for policy 1, policy_version 1874951 (0.0008) [2023-12-28 08:42:34,796][106225] Updated weights for policy 1, policy_version 1874961 (0.0007) [2023-12-28 08:42:34,797][106226] Updated weights for policy 0, policy_version 1871057 (0.0008) [2023-12-28 08:42:34,851][106226] Updated weights for policy 0, policy_version 1871067 (0.0006) [2023-12-28 08:42:34,852][106225] Updated weights for policy 1, policy_version 1874971 (0.0007) [2023-12-28 08:42:34,909][106226] Updated weights for policy 0, policy_version 1871077 (0.0005) [2023-12-28 08:42:35,442][106226] Updated weights for policy 0, policy_version 1871087 (0.0005) [2023-12-28 08:42:35,494][106226] Updated weights for policy 0, policy_version 1871097 (0.0005) [2023-12-28 08:42:35,550][106226] Updated weights for policy 0, policy_version 1871107 (0.0005) [2023-12-28 08:42:35,654][106225] Updated weights for policy 1, policy_version 1874981 (0.0008) [2023-12-28 08:42:35,704][106225] Updated weights for policy 1, policy_version 1874991 (0.0009) [2023-12-28 08:42:35,770][106225] Updated weights for policy 1, policy_version 1875001 (0.0009) [2023-12-28 08:42:36,138][106226] Updated weights for policy 0, policy_version 1871117 (0.0007) [2023-12-28 08:42:36,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19855.2). Total num frames: 959143936. Throughput: 0: 9949.9, 1: 9752.7. Samples: 959156068. Policy #0 lag: (min: 25.0, avg: 46.0, max: 57.0) [2023-12-28 08:42:36,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.454')] [2023-12-28 08:42:36,204][106226] Updated weights for policy 0, policy_version 1871127 (0.0008) [2023-12-28 08:42:36,260][106226] Updated weights for policy 0, policy_version 1871137 (0.0008) [2023-12-28 08:42:36,549][106225] Updated weights for policy 1, policy_version 1875011 (0.0008) [2023-12-28 08:42:36,614][106225] Updated weights for policy 1, policy_version 1875021 (0.0007) [2023-12-28 08:42:36,677][106225] Updated weights for policy 1, policy_version 1875031 (0.0008) [2023-12-28 08:42:37,042][106226] Updated weights for policy 0, policy_version 1871147 (0.0009) [2023-12-28 08:42:37,100][106226] Updated weights for policy 0, policy_version 1871157 (0.0011) [2023-12-28 08:42:37,162][106226] Updated weights for policy 0, policy_version 1871167 (0.0011) [2023-12-28 08:42:37,317][106225] Updated weights for policy 1, policy_version 1875041 (0.0008) [2023-12-28 08:42:37,384][106225] Updated weights for policy 1, policy_version 1875051 (0.0007) [2023-12-28 08:42:37,440][106225] Updated weights for policy 1, policy_version 1875061 (0.0006) [2023-12-28 08:42:37,500][106225] Updated weights for policy 1, policy_version 1875071 (0.0006) [2023-12-28 08:42:37,840][106226] Updated weights for policy 0, policy_version 1871177 (0.0011) [2023-12-28 08:42:37,896][106226] Updated weights for policy 0, policy_version 1871187 (0.0010) [2023-12-28 08:42:37,959][106226] Updated weights for policy 0, policy_version 1871197 (0.0011) [2023-12-28 08:42:38,016][106226] Updated weights for policy 0, policy_version 1871207 (0.0010) [2023-12-28 08:42:38,152][106225] Updated weights for policy 1, policy_version 1875081 (0.0008) [2023-12-28 08:42:38,205][106225] Updated weights for policy 1, policy_version 1875091 (0.0005) [2023-12-28 08:42:38,260][106225] Updated weights for policy 1, policy_version 1875101 (0.0008) [2023-12-28 08:42:38,732][106226] Updated weights for policy 0, policy_version 1871217 (0.0009) [2023-12-28 08:42:38,789][106226] Updated weights for policy 0, policy_version 1871227 (0.0011) [2023-12-28 08:42:38,853][106226] Updated weights for policy 0, policy_version 1871237 (0.0011) [2023-12-28 08:42:38,979][106225] Updated weights for policy 1, policy_version 1875111 (0.0010) [2023-12-28 08:42:39,045][106225] Updated weights for policy 1, policy_version 1875121 (0.0007) [2023-12-28 08:42:39,102][106225] Updated weights for policy 1, policy_version 1875131 (0.0008) [2023-12-28 08:42:39,567][106226] Updated weights for policy 0, policy_version 1871247 (0.0008) [2023-12-28 08:42:39,628][106226] Updated weights for policy 0, policy_version 1871257 (0.0009) [2023-12-28 08:42:39,687][106226] Updated weights for policy 0, policy_version 1871267 (0.0008) [2023-12-28 08:42:39,872][106225] Updated weights for policy 1, policy_version 1875141 (0.0008) [2023-12-28 08:42:39,944][106225] Updated weights for policy 1, policy_version 1875151 (0.0007) [2023-12-28 08:42:40,013][106225] Updated weights for policy 1, policy_version 1875161 (0.0007) [2023-12-28 08:42:40,488][106226] Updated weights for policy 0, policy_version 1871277 (0.0008) [2023-12-28 08:42:40,550][106226] Updated weights for policy 0, policy_version 1871287 (0.0008) [2023-12-28 08:42:40,616][106226] Updated weights for policy 0, policy_version 1871297 (0.0008) [2023-12-28 08:42:40,715][106225] Updated weights for policy 1, policy_version 1875171 (0.0006) [2023-12-28 08:42:40,780][106225] Updated weights for policy 1, policy_version 1875181 (0.0008) [2023-12-28 08:42:40,840][106225] Updated weights for policy 1, policy_version 1875191 (0.0008) [2023-12-28 08:42:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 959242240. Throughput: 0: 9954.2, 1: 9780.2. Samples: 959215140. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:42:41,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.609')] [2023-12-28 08:42:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001875200_480108544.pth... [2023-12-28 08:42:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001871304_479133696.pth... [2023-12-28 08:42:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001874080_479821824.pth [2023-12-28 08:42:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001870152_478838784.pth [2023-12-28 08:42:41,328][106226] Updated weights for policy 0, policy_version 1871307 (0.0009) [2023-12-28 08:42:41,401][106226] Updated weights for policy 0, policy_version 1871317 (0.0009) [2023-12-28 08:42:41,462][106226] Updated weights for policy 0, policy_version 1871327 (0.0008) [2023-12-28 08:42:41,640][106225] Updated weights for policy 1, policy_version 1875201 (0.0008) [2023-12-28 08:42:41,707][106225] Updated weights for policy 1, policy_version 1875211 (0.0008) [2023-12-28 08:42:41,775][106225] Updated weights for policy 1, policy_version 1875221 (0.0007) [2023-12-28 08:42:41,847][106225] Updated weights for policy 1, policy_version 1875231 (0.0008) [2023-12-28 08:42:42,202][106226] Updated weights for policy 0, policy_version 1871337 (0.0008) [2023-12-28 08:42:42,260][106226] Updated weights for policy 0, policy_version 1871347 (0.0008) [2023-12-28 08:42:42,324][106226] Updated weights for policy 0, policy_version 1871357 (0.0008) [2023-12-28 08:42:42,388][106226] Updated weights for policy 0, policy_version 1871367 (0.0008) [2023-12-28 08:42:42,553][106225] Updated weights for policy 1, policy_version 1875241 (0.0008) [2023-12-28 08:42:42,607][106225] Updated weights for policy 1, policy_version 1875251 (0.0009) [2023-12-28 08:42:42,660][106225] Updated weights for policy 1, policy_version 1875261 (0.0008) [2023-12-28 08:42:43,058][106226] Updated weights for policy 0, policy_version 1871377 (0.0006) [2023-12-28 08:42:43,115][106226] Updated weights for policy 0, policy_version 1871387 (0.0005) [2023-12-28 08:42:43,171][106226] Updated weights for policy 0, policy_version 1871397 (0.0005) [2023-12-28 08:42:43,341][106225] Updated weights for policy 1, policy_version 1875271 (0.0010) [2023-12-28 08:42:43,407][106225] Updated weights for policy 1, policy_version 1875281 (0.0010) [2023-12-28 08:42:43,474][106225] Updated weights for policy 1, policy_version 1875291 (0.0007) [2023-12-28 08:42:43,783][106226] Updated weights for policy 0, policy_version 1871407 (0.0005) [2023-12-28 08:42:43,844][106226] Updated weights for policy 0, policy_version 1871417 (0.0005) [2023-12-28 08:42:43,905][106226] Updated weights for policy 0, policy_version 1871427 (0.0008) [2023-12-28 08:42:44,039][106225] Updated weights for policy 1, policy_version 1875301 (0.0008) [2023-12-28 08:42:44,095][106225] Updated weights for policy 1, policy_version 1875311 (0.0010) [2023-12-28 08:42:44,154][106225] Updated weights for policy 1, policy_version 1875321 (0.0010) [2023-12-28 08:42:44,614][106226] Updated weights for policy 0, policy_version 1871437 (0.0008) [2023-12-28 08:42:44,684][106226] Updated weights for policy 0, policy_version 1871447 (0.0008) [2023-12-28 08:42:44,740][106226] Updated weights for policy 0, policy_version 1871457 (0.0008) [2023-12-28 08:42:44,788][106225] Updated weights for policy 1, policy_version 1875331 (0.0010) [2023-12-28 08:42:44,838][106225] Updated weights for policy 1, policy_version 1875341 (0.0009) [2023-12-28 08:42:44,907][106225] Updated weights for policy 1, policy_version 1875351 (0.0006) [2023-12-28 08:42:45,498][106226] Updated weights for policy 0, policy_version 1871467 (0.0008) [2023-12-28 08:42:45,566][106226] Updated weights for policy 0, policy_version 1871477 (0.0009) [2023-12-28 08:42:45,606][106225] Updated weights for policy 1, policy_version 1875361 (0.0006) [2023-12-28 08:42:45,627][106226] Updated weights for policy 0, policy_version 1871487 (0.0007) [2023-12-28 08:42:45,661][106225] Updated weights for policy 1, policy_version 1875371 (0.0008) [2023-12-28 08:42:45,718][106225] Updated weights for policy 1, policy_version 1875381 (0.0008) [2023-12-28 08:42:45,771][106225] Updated weights for policy 1, policy_version 1875391 (0.0008) [2023-12-28 08:42:46,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 959340544. Throughput: 0: 9921.2, 1: 9773.8. Samples: 959331612. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:42:46,175][105115] Avg episode reward: [(0, '-4.240'), (1, '-4.774')] [2023-12-28 08:42:46,345][106226] Updated weights for policy 0, policy_version 1871497 (0.0006) [2023-12-28 08:42:46,400][106226] Updated weights for policy 0, policy_version 1871507 (0.0005) [2023-12-28 08:42:46,458][106226] Updated weights for policy 0, policy_version 1871517 (0.0005) [2023-12-28 08:42:46,512][106225] Updated weights for policy 1, policy_version 1875401 (0.0009) [2023-12-28 08:42:46,519][106226] Updated weights for policy 0, policy_version 1871527 (0.0005) [2023-12-28 08:42:46,569][106225] Updated weights for policy 1, policy_version 1875411 (0.0010) [2023-12-28 08:42:46,619][106225] Updated weights for policy 1, policy_version 1875421 (0.0008) [2023-12-28 08:42:47,036][106226] Updated weights for policy 0, policy_version 1871537 (0.0006) [2023-12-28 08:42:47,095][106226] Updated weights for policy 0, policy_version 1871547 (0.0008) [2023-12-28 08:42:47,158][106226] Updated weights for policy 0, policy_version 1871557 (0.0006) [2023-12-28 08:42:47,442][106225] Updated weights for policy 1, policy_version 1875431 (0.0009) [2023-12-28 08:42:47,502][106225] Updated weights for policy 1, policy_version 1875441 (0.0008) [2023-12-28 08:42:47,563][106225] Updated weights for policy 1, policy_version 1875451 (0.0007) [2023-12-28 08:42:47,738][106226] Updated weights for policy 0, policy_version 1871567 (0.0007) [2023-12-28 08:42:47,791][106226] Updated weights for policy 0, policy_version 1871577 (0.0008) [2023-12-28 08:42:47,845][106226] Updated weights for policy 0, policy_version 1871587 (0.0008) [2023-12-28 08:42:48,262][106225] Updated weights for policy 1, policy_version 1875461 (0.0008) [2023-12-28 08:42:48,321][106225] Updated weights for policy 1, policy_version 1875471 (0.0006) [2023-12-28 08:42:48,384][106225] Updated weights for policy 1, policy_version 1875481 (0.0007) [2023-12-28 08:42:48,611][106226] Updated weights for policy 0, policy_version 1871597 (0.0007) [2023-12-28 08:42:48,670][106226] Updated weights for policy 0, policy_version 1871607 (0.0008) [2023-12-28 08:42:48,731][106226] Updated weights for policy 0, policy_version 1871617 (0.0008) [2023-12-28 08:42:49,069][106225] Updated weights for policy 1, policy_version 1875491 (0.0008) [2023-12-28 08:42:49,130][106225] Updated weights for policy 1, policy_version 1875501 (0.0010) [2023-12-28 08:42:49,190][106225] Updated weights for policy 1, policy_version 1875511 (0.0010) [2023-12-28 08:42:49,510][106226] Updated weights for policy 0, policy_version 1871627 (0.0008) [2023-12-28 08:42:49,571][106226] Updated weights for policy 0, policy_version 1871637 (0.0008) [2023-12-28 08:42:49,630][106226] Updated weights for policy 0, policy_version 1871647 (0.0008) [2023-12-28 08:42:49,941][106225] Updated weights for policy 1, policy_version 1875521 (0.0009) [2023-12-28 08:42:50,014][106225] Updated weights for policy 1, policy_version 1875531 (0.0006) [2023-12-28 08:42:50,088][106225] Updated weights for policy 1, policy_version 1875541 (0.0006) [2023-12-28 08:42:50,149][106225] Updated weights for policy 1, policy_version 1875551 (0.0006) [2023-12-28 08:42:50,403][106226] Updated weights for policy 0, policy_version 1871657 (0.0008) [2023-12-28 08:42:50,461][106226] Updated weights for policy 0, policy_version 1871667 (0.0008) [2023-12-28 08:42:50,518][106226] Updated weights for policy 0, policy_version 1871677 (0.0008) [2023-12-28 08:42:50,599][106226] Updated weights for policy 0, policy_version 1871687 (0.0007) [2023-12-28 08:42:50,727][106225] Updated weights for policy 1, policy_version 1875561 (0.0008) [2023-12-28 08:42:50,793][106225] Updated weights for policy 1, policy_version 1875571 (0.0008) [2023-12-28 08:42:50,858][106225] Updated weights for policy 1, policy_version 1875581 (0.0010) [2023-12-28 08:42:51,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 959438848. Throughput: 0: 9910.1, 1: 9778.6. Samples: 959449440. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:42:51,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.747')] [2023-12-28 08:42:51,335][106226] Updated weights for policy 0, policy_version 1871697 (0.0009) [2023-12-28 08:42:51,405][106226] Updated weights for policy 0, policy_version 1871707 (0.0010) [2023-12-28 08:42:51,465][106226] Updated weights for policy 0, policy_version 1871717 (0.0009) [2023-12-28 08:42:51,634][106225] Updated weights for policy 1, policy_version 1875591 (0.0010) [2023-12-28 08:42:51,688][106225] Updated weights for policy 1, policy_version 1875601 (0.0010) [2023-12-28 08:42:51,751][106225] Updated weights for policy 1, policy_version 1875611 (0.0008) [2023-12-28 08:42:52,173][106226] Updated weights for policy 0, policy_version 1871727 (0.0006) [2023-12-28 08:42:52,225][106226] Updated weights for policy 0, policy_version 1871737 (0.0005) [2023-12-28 08:42:52,288][106226] Updated weights for policy 0, policy_version 1871747 (0.0009) [2023-12-28 08:42:52,596][106225] Updated weights for policy 1, policy_version 1875621 (0.0006) [2023-12-28 08:42:52,658][106225] Updated weights for policy 1, policy_version 1875631 (0.0006) [2023-12-28 08:42:52,717][106225] Updated weights for policy 1, policy_version 1875641 (0.0006) [2023-12-28 08:42:52,959][106226] Updated weights for policy 0, policy_version 1871757 (0.0008) [2023-12-28 08:42:53,016][106226] Updated weights for policy 0, policy_version 1871767 (0.0009) [2023-12-28 08:42:53,063][106226] Updated weights for policy 0, policy_version 1871777 (0.0005) [2023-12-28 08:42:53,416][106225] Updated weights for policy 1, policy_version 1875651 (0.0009) [2023-12-28 08:42:53,466][106225] Updated weights for policy 1, policy_version 1875661 (0.0006) [2023-12-28 08:42:53,519][106225] Updated weights for policy 1, policy_version 1875671 (0.0005) [2023-12-28 08:42:53,763][106226] Updated weights for policy 0, policy_version 1871787 (0.0007) [2023-12-28 08:42:53,816][106226] Updated weights for policy 0, policy_version 1871797 (0.0010) [2023-12-28 08:42:53,870][106226] Updated weights for policy 0, policy_version 1871807 (0.0010) [2023-12-28 08:42:54,204][106225] Updated weights for policy 1, policy_version 1875681 (0.0007) [2023-12-28 08:42:54,258][106225] Updated weights for policy 1, policy_version 1875691 (0.0009) [2023-12-28 08:42:54,316][106225] Updated weights for policy 1, policy_version 1875701 (0.0009) [2023-12-28 08:42:54,372][106225] Updated weights for policy 1, policy_version 1875711 (0.0009) [2023-12-28 08:42:54,606][106226] Updated weights for policy 0, policy_version 1871817 (0.0010) [2023-12-28 08:42:54,661][106226] Updated weights for policy 0, policy_version 1871827 (0.0011) [2023-12-28 08:42:54,709][106226] Updated weights for policy 0, policy_version 1871837 (0.0010) [2023-12-28 08:42:54,756][106226] Updated weights for policy 0, policy_version 1871847 (0.0010) [2023-12-28 08:42:55,071][106225] Updated weights for policy 1, policy_version 1875721 (0.0010) [2023-12-28 08:42:55,128][106225] Updated weights for policy 1, policy_version 1875731 (0.0010) [2023-12-28 08:42:55,179][106225] Updated weights for policy 1, policy_version 1875741 (0.0010) [2023-12-28 08:42:55,497][106226] Updated weights for policy 0, policy_version 1871857 (0.0010) [2023-12-28 08:42:55,546][106226] Updated weights for policy 0, policy_version 1871867 (0.0006) [2023-12-28 08:42:55,609][106226] Updated weights for policy 0, policy_version 1871877 (0.0006) [2023-12-28 08:42:55,914][106225] Updated weights for policy 1, policy_version 1875751 (0.0010) [2023-12-28 08:42:55,968][106225] Updated weights for policy 1, policy_version 1875761 (0.0010) [2023-12-28 08:42:56,018][106225] Updated weights for policy 1, policy_version 1875771 (0.0010) [2023-12-28 08:42:56,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 959537152. Throughput: 0: 9940.7, 1: 9690.2. Samples: 959506820. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:42:56,176][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.699')] [2023-12-28 08:42:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001875776_480256000.pth... [2023-12-28 08:42:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001871880_479281152.pth... [2023-12-28 08:42:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001874656_479969280.pth [2023-12-28 08:42:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001870728_478986240.pth [2023-12-28 08:42:56,351][106226] Updated weights for policy 0, policy_version 1871887 (0.0010) [2023-12-28 08:42:56,405][106226] Updated weights for policy 0, policy_version 1871897 (0.0011) [2023-12-28 08:42:56,456][106226] Updated weights for policy 0, policy_version 1871907 (0.0011) [2023-12-28 08:42:56,658][106225] Updated weights for policy 1, policy_version 1875781 (0.0010) [2023-12-28 08:42:56,713][106225] Updated weights for policy 1, policy_version 1875791 (0.0010) [2023-12-28 08:42:56,762][106225] Updated weights for policy 1, policy_version 1875801 (0.0010) [2023-12-28 08:42:57,172][106226] Updated weights for policy 0, policy_version 1871917 (0.0010) [2023-12-28 08:42:57,224][106226] Updated weights for policy 0, policy_version 1871927 (0.0010) [2023-12-28 08:42:57,281][106226] Updated weights for policy 0, policy_version 1871937 (0.0011) [2023-12-28 08:42:57,453][106225] Updated weights for policy 1, policy_version 1875811 (0.0009) [2023-12-28 08:42:57,507][106225] Updated weights for policy 1, policy_version 1875821 (0.0005) [2023-12-28 08:42:57,562][106225] Updated weights for policy 1, policy_version 1875831 (0.0006) [2023-12-28 08:42:57,950][106226] Updated weights for policy 0, policy_version 1871947 (0.0008) [2023-12-28 08:42:58,008][106226] Updated weights for policy 0, policy_version 1871957 (0.0010) [2023-12-28 08:42:58,067][106226] Updated weights for policy 0, policy_version 1871967 (0.0010) [2023-12-28 08:42:58,155][106225] Updated weights for policy 1, policy_version 1875841 (0.0005) [2023-12-28 08:42:58,211][106225] Updated weights for policy 1, policy_version 1875851 (0.0005) [2023-12-28 08:42:58,279][106225] Updated weights for policy 1, policy_version 1875861 (0.0008) [2023-12-28 08:42:58,343][106225] Updated weights for policy 1, policy_version 1875871 (0.0008) [2023-12-28 08:42:58,781][106226] Updated weights for policy 0, policy_version 1871977 (0.0010) [2023-12-28 08:42:58,851][106226] Updated weights for policy 0, policy_version 1871987 (0.0007) [2023-12-28 08:42:58,922][106226] Updated weights for policy 0, policy_version 1871997 (0.0009) [2023-12-28 08:42:58,973][106226] Updated weights for policy 0, policy_version 1872007 (0.0008) [2023-12-28 08:42:59,167][106225] Updated weights for policy 1, policy_version 1875881 (0.0010) [2023-12-28 08:42:59,235][106225] Updated weights for policy 1, policy_version 1875891 (0.0009) [2023-12-28 08:42:59,304][106225] Updated weights for policy 1, policy_version 1875901 (0.0010) [2023-12-28 08:42:59,749][106226] Updated weights for policy 0, policy_version 1872017 (0.0006) [2023-12-28 08:42:59,814][106226] Updated weights for policy 0, policy_version 1872027 (0.0006) [2023-12-28 08:42:59,885][106226] Updated weights for policy 0, policy_version 1872037 (0.0008) [2023-12-28 08:43:00,018][106225] Updated weights for policy 1, policy_version 1875911 (0.0007) [2023-12-28 08:43:00,070][106225] Updated weights for policy 1, policy_version 1875921 (0.0005) [2023-12-28 08:43:00,128][106225] Updated weights for policy 1, policy_version 1875931 (0.0007) [2023-12-28 08:43:00,651][106226] Updated weights for policy 0, policy_version 1872047 (0.0009) [2023-12-28 08:43:00,689][106225] Updated weights for policy 1, policy_version 1875941 (0.0008) [2023-12-28 08:43:00,703][106226] Updated weights for policy 0, policy_version 1872057 (0.0007) [2023-12-28 08:43:00,742][106225] Updated weights for policy 1, policy_version 1875951 (0.0007) [2023-12-28 08:43:00,761][106226] Updated weights for policy 0, policy_version 1872067 (0.0006) [2023-12-28 08:43:00,794][106225] Updated weights for policy 1, policy_version 1875961 (0.0005) [2023-12-28 08:43:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 959635456. Throughput: 0: 9949.6, 1: 9733.3. Samples: 959624020. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:01,175][105115] Avg episode reward: [(0, '-4.366'), (1, '-4.595')] [2023-12-28 08:43:01,482][106225] Updated weights for policy 1, policy_version 1875971 (0.0007) [2023-12-28 08:43:01,535][106226] Updated weights for policy 0, policy_version 1872077 (0.0008) [2023-12-28 08:43:01,541][106225] Updated weights for policy 1, policy_version 1875981 (0.0010) [2023-12-28 08:43:01,589][106226] Updated weights for policy 0, policy_version 1872087 (0.0005) [2023-12-28 08:43:01,602][106225] Updated weights for policy 1, policy_version 1875991 (0.0010) [2023-12-28 08:43:01,654][106226] Updated weights for policy 0, policy_version 1872097 (0.0009) [2023-12-28 08:43:02,383][106226] Updated weights for policy 0, policy_version 1872107 (0.0009) [2023-12-28 08:43:02,410][106225] Updated weights for policy 1, policy_version 1876001 (0.0010) [2023-12-28 08:43:02,438][106226] Updated weights for policy 0, policy_version 1872117 (0.0009) [2023-12-28 08:43:02,470][106225] Updated weights for policy 1, policy_version 1876011 (0.0010) [2023-12-28 08:43:02,488][106226] Updated weights for policy 0, policy_version 1872127 (0.0006) [2023-12-28 08:43:02,528][106225] Updated weights for policy 1, policy_version 1876021 (0.0010) [2023-12-28 08:43:02,594][106225] Updated weights for policy 1, policy_version 1876031 (0.0010) [2023-12-28 08:43:03,231][106226] Updated weights for policy 0, policy_version 1872137 (0.0006) [2023-12-28 08:43:03,249][106225] Updated weights for policy 1, policy_version 1876041 (0.0008) [2023-12-28 08:43:03,282][106226] Updated weights for policy 0, policy_version 1872147 (0.0006) [2023-12-28 08:43:03,295][106225] Updated weights for policy 1, policy_version 1876051 (0.0010) [2023-12-28 08:43:03,328][106226] Updated weights for policy 0, policy_version 1872157 (0.0005) [2023-12-28 08:43:03,345][106225] Updated weights for policy 1, policy_version 1876061 (0.0010) [2023-12-28 08:43:03,375][106226] Updated weights for policy 0, policy_version 1872167 (0.0006) [2023-12-28 08:43:04,002][106225] Updated weights for policy 1, policy_version 1876071 (0.0008) [2023-12-28 08:43:04,062][106225] Updated weights for policy 1, policy_version 1876081 (0.0008) [2023-12-28 08:43:04,126][106225] Updated weights for policy 1, policy_version 1876091 (0.0007) [2023-12-28 08:43:04,151][106226] Updated weights for policy 0, policy_version 1872177 (0.0006) [2023-12-28 08:43:04,211][106226] Updated weights for policy 0, policy_version 1872187 (0.0008) [2023-12-28 08:43:04,279][106226] Updated weights for policy 0, policy_version 1872197 (0.0009) [2023-12-28 08:43:04,851][106225] Updated weights for policy 1, policy_version 1876101 (0.0005) [2023-12-28 08:43:04,907][106225] Updated weights for policy 1, policy_version 1876111 (0.0007) [2023-12-28 08:43:04,959][106225] Updated weights for policy 1, policy_version 1876121 (0.0005) [2023-12-28 08:43:04,977][106226] Updated weights for policy 0, policy_version 1872207 (0.0008) [2023-12-28 08:43:05,031][106226] Updated weights for policy 0, policy_version 1872217 (0.0008) [2023-12-28 08:43:05,085][106226] Updated weights for policy 0, policy_version 1872227 (0.0007) [2023-12-28 08:43:05,663][106225] Updated weights for policy 1, policy_version 1876131 (0.0008) [2023-12-28 08:43:05,723][106225] Updated weights for policy 1, policy_version 1876141 (0.0008) [2023-12-28 08:43:05,769][106226] Updated weights for policy 0, policy_version 1872237 (0.0005) [2023-12-28 08:43:05,782][106225] Updated weights for policy 1, policy_version 1876151 (0.0008) [2023-12-28 08:43:05,821][106226] Updated weights for policy 0, policy_version 1872247 (0.0007) [2023-12-28 08:43:05,878][106226] Updated weights for policy 0, policy_version 1872257 (0.0008) [2023-12-28 08:43:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.7, 300 sec: 19827.4). Total num frames: 959733760. Throughput: 0: 9866.8, 1: 9749.3. Samples: 959742328. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:06,176][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.569')] [2023-12-28 08:43:06,544][106225] Updated weights for policy 1, policy_version 1876161 (0.0008) [2023-12-28 08:43:06,607][106225] Updated weights for policy 1, policy_version 1876171 (0.0008) [2023-12-28 08:43:06,613][106226] Updated weights for policy 0, policy_version 1872267 (0.0008) [2023-12-28 08:43:06,666][106226] Updated weights for policy 0, policy_version 1872277 (0.0006) [2023-12-28 08:43:06,671][106225] Updated weights for policy 1, policy_version 1876181 (0.0007) [2023-12-28 08:43:06,725][106226] Updated weights for policy 0, policy_version 1872287 (0.0006) [2023-12-28 08:43:06,735][106225] Updated weights for policy 1, policy_version 1876191 (0.0007) [2023-12-28 08:43:07,355][106225] Updated weights for policy 1, policy_version 1876201 (0.0006) [2023-12-28 08:43:07,417][106225] Updated weights for policy 1, policy_version 1876211 (0.0005) [2023-12-28 08:43:07,482][106225] Updated weights for policy 1, policy_version 1876221 (0.0005) [2023-12-28 08:43:07,534][106226] Updated weights for policy 0, policy_version 1872297 (0.0009) [2023-12-28 08:43:07,602][106226] Updated weights for policy 0, policy_version 1872307 (0.0011) [2023-12-28 08:43:07,671][106226] Updated weights for policy 0, policy_version 1872317 (0.0010) [2023-12-28 08:43:07,737][106226] Updated weights for policy 0, policy_version 1872327 (0.0007) [2023-12-28 08:43:08,085][106225] Updated weights for policy 1, policy_version 1876231 (0.0009) [2023-12-28 08:43:08,136][106225] Updated weights for policy 1, policy_version 1876241 (0.0009) [2023-12-28 08:43:08,188][106225] Updated weights for policy 1, policy_version 1876251 (0.0005) [2023-12-28 08:43:08,384][106226] Updated weights for policy 0, policy_version 1872337 (0.0007) [2023-12-28 08:43:08,446][106226] Updated weights for policy 0, policy_version 1872347 (0.0008) [2023-12-28 08:43:08,514][106226] Updated weights for policy 0, policy_version 1872357 (0.0008) [2023-12-28 08:43:08,924][106225] Updated weights for policy 1, policy_version 1876261 (0.0007) [2023-12-28 08:43:08,980][106225] Updated weights for policy 1, policy_version 1876271 (0.0009) [2023-12-28 08:43:09,042][106225] Updated weights for policy 1, policy_version 1876281 (0.0008) [2023-12-28 08:43:09,242][106226] Updated weights for policy 0, policy_version 1872367 (0.0008) [2023-12-28 08:43:09,310][106226] Updated weights for policy 0, policy_version 1872377 (0.0007) [2023-12-28 08:43:09,373][106226] Updated weights for policy 0, policy_version 1872387 (0.0008) [2023-12-28 08:43:09,738][106225] Updated weights for policy 1, policy_version 1876291 (0.0006) [2023-12-28 08:43:09,805][106225] Updated weights for policy 1, policy_version 1876301 (0.0009) [2023-12-28 08:43:09,874][106225] Updated weights for policy 1, policy_version 1876311 (0.0009) [2023-12-28 08:43:10,067][106226] Updated weights for policy 0, policy_version 1872397 (0.0007) [2023-12-28 08:43:10,123][106226] Updated weights for policy 0, policy_version 1872407 (0.0006) [2023-12-28 08:43:10,185][106226] Updated weights for policy 0, policy_version 1872417 (0.0006) [2023-12-28 08:43:10,623][106225] Updated weights for policy 1, policy_version 1876321 (0.0009) [2023-12-28 08:43:10,683][106225] Updated weights for policy 1, policy_version 1876331 (0.0007) [2023-12-28 08:43:10,729][106225] Updated weights for policy 1, policy_version 1876341 (0.0005) [2023-12-28 08:43:10,775][106225] Updated weights for policy 1, policy_version 1876351 (0.0005) [2023-12-28 08:43:10,896][106226] Updated weights for policy 0, policy_version 1872427 (0.0007) [2023-12-28 08:43:10,947][106226] Updated weights for policy 0, policy_version 1872437 (0.0008) [2023-12-28 08:43:10,999][106226] Updated weights for policy 0, policy_version 1872447 (0.0008) [2023-12-28 08:43:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 959832064. Throughput: 0: 9854.7, 1: 9776.2. Samples: 959801696. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:11,175][105115] Avg episode reward: [(0, '-4.419'), (1, '-4.724')] [2023-12-28 08:43:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001876352_480403456.pth... [2023-12-28 08:43:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001872456_479428608.pth... [2023-12-28 08:43:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001875200_480108544.pth [2023-12-28 08:43:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001871304_479133696.pth [2023-12-28 08:43:11,496][106225] Updated weights for policy 1, policy_version 1876361 (0.0008) [2023-12-28 08:43:11,562][106225] Updated weights for policy 1, policy_version 1876371 (0.0008) [2023-12-28 08:43:11,626][106225] Updated weights for policy 1, policy_version 1876381 (0.0008) [2023-12-28 08:43:11,779][106226] Updated weights for policy 0, policy_version 1872457 (0.0008) [2023-12-28 08:43:11,847][106226] Updated weights for policy 0, policy_version 1872467 (0.0007) [2023-12-28 08:43:11,907][106226] Updated weights for policy 0, policy_version 1872477 (0.0009) [2023-12-28 08:43:11,972][106226] Updated weights for policy 0, policy_version 1872487 (0.0009) [2023-12-28 08:43:12,343][106225] Updated weights for policy 1, policy_version 1876391 (0.0009) [2023-12-28 08:43:12,410][106225] Updated weights for policy 1, policy_version 1876401 (0.0007) [2023-12-28 08:43:12,479][106225] Updated weights for policy 1, policy_version 1876411 (0.0009) [2023-12-28 08:43:12,688][106226] Updated weights for policy 0, policy_version 1872497 (0.0006) [2023-12-28 08:43:12,745][106226] Updated weights for policy 0, policy_version 1872507 (0.0005) [2023-12-28 08:43:12,808][106226] Updated weights for policy 0, policy_version 1872517 (0.0007) [2023-12-28 08:43:13,205][106225] Updated weights for policy 1, policy_version 1876421 (0.0007) [2023-12-28 08:43:13,273][106225] Updated weights for policy 1, policy_version 1876431 (0.0005) [2023-12-28 08:43:13,326][106225] Updated weights for policy 1, policy_version 1876441 (0.0006) [2023-12-28 08:43:13,349][106226] Updated weights for policy 0, policy_version 1872527 (0.0009) [2023-12-28 08:43:13,407][106226] Updated weights for policy 0, policy_version 1872537 (0.0008) [2023-12-28 08:43:13,466][106226] Updated weights for policy 0, policy_version 1872547 (0.0008) [2023-12-28 08:43:13,990][106225] Updated weights for policy 1, policy_version 1876451 (0.0006) [2023-12-28 08:43:14,045][106225] Updated weights for policy 1, policy_version 1876461 (0.0005) [2023-12-28 08:43:14,095][106225] Updated weights for policy 1, policy_version 1876471 (0.0007) [2023-12-28 08:43:14,187][106226] Updated weights for policy 0, policy_version 1872557 (0.0007) [2023-12-28 08:43:14,245][106226] Updated weights for policy 0, policy_version 1872567 (0.0008) [2023-12-28 08:43:14,300][106226] Updated weights for policy 0, policy_version 1872577 (0.0008) [2023-12-28 08:43:14,778][106225] Updated weights for policy 1, policy_version 1876481 (0.0008) [2023-12-28 08:43:14,848][106225] Updated weights for policy 1, policy_version 1876491 (0.0009) [2023-12-28 08:43:14,913][106225] Updated weights for policy 1, policy_version 1876501 (0.0008) [2023-12-28 08:43:14,981][106225] Updated weights for policy 1, policy_version 1876511 (0.0008) [2023-12-28 08:43:14,989][106226] Updated weights for policy 0, policy_version 1872587 (0.0007) [2023-12-28 08:43:15,047][106226] Updated weights for policy 0, policy_version 1872597 (0.0010) [2023-12-28 08:43:15,111][106226] Updated weights for policy 0, policy_version 1872607 (0.0008) [2023-12-28 08:43:15,634][106225] Updated weights for policy 1, policy_version 1876521 (0.0008) [2023-12-28 08:43:15,690][106225] Updated weights for policy 1, policy_version 1876531 (0.0006) [2023-12-28 08:43:15,693][106226] Updated weights for policy 0, policy_version 1872617 (0.0007) [2023-12-28 08:43:15,735][106225] Updated weights for policy 1, policy_version 1876541 (0.0005) [2023-12-28 08:43:15,748][106226] Updated weights for policy 0, policy_version 1872627 (0.0006) [2023-12-28 08:43:15,807][106226] Updated weights for policy 0, policy_version 1872637 (0.0005) [2023-12-28 08:43:15,870][106226] Updated weights for policy 0, policy_version 1872647 (0.0007) [2023-12-28 08:43:16,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 959930368. Throughput: 0: 9817.4, 1: 9773.9. Samples: 959918420. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:16,175][105115] Avg episode reward: [(0, '-4.527'), (1, '-4.630')] [2023-12-28 08:43:16,418][106225] Updated weights for policy 1, policy_version 1876551 (0.0010) [2023-12-28 08:43:16,438][106226] Updated weights for policy 0, policy_version 1872657 (0.0007) [2023-12-28 08:43:16,479][106225] Updated weights for policy 1, policy_version 1876561 (0.0010) [2023-12-28 08:43:16,493][106226] Updated weights for policy 0, policy_version 1872667 (0.0008) [2023-12-28 08:43:16,532][106225] Updated weights for policy 1, policy_version 1876571 (0.0010) [2023-12-28 08:43:16,537][106226] Updated weights for policy 0, policy_version 1872677 (0.0007) [2023-12-28 08:43:17,131][106225] Updated weights for policy 1, policy_version 1876581 (0.0010) [2023-12-28 08:43:17,178][106225] Updated weights for policy 1, policy_version 1876591 (0.0010) [2023-12-28 08:43:17,242][106225] Updated weights for policy 1, policy_version 1876601 (0.0009) [2023-12-28 08:43:17,246][106226] Updated weights for policy 0, policy_version 1872687 (0.0008) [2023-12-28 08:43:17,301][106226] Updated weights for policy 0, policy_version 1872697 (0.0010) [2023-12-28 08:43:17,366][106226] Updated weights for policy 0, policy_version 1872707 (0.0011) [2023-12-28 08:43:17,896][106225] Updated weights for policy 1, policy_version 1876611 (0.0007) [2023-12-28 08:43:17,946][106225] Updated weights for policy 1, policy_version 1876621 (0.0010) [2023-12-28 08:43:17,995][106225] Updated weights for policy 1, policy_version 1876631 (0.0010) [2023-12-28 08:43:18,044][106226] Updated weights for policy 0, policy_version 1872717 (0.0010) [2023-12-28 08:43:18,101][106226] Updated weights for policy 0, policy_version 1872727 (0.0010) [2023-12-28 08:43:18,167][106226] Updated weights for policy 0, policy_version 1872737 (0.0011) [2023-12-28 08:43:18,737][106225] Updated weights for policy 1, policy_version 1876641 (0.0010) [2023-12-28 08:43:18,797][106225] Updated weights for policy 1, policy_version 1876651 (0.0010) [2023-12-28 08:43:18,862][106225] Updated weights for policy 1, policy_version 1876661 (0.0010) [2023-12-28 08:43:18,881][106226] Updated weights for policy 0, policy_version 1872747 (0.0010) [2023-12-28 08:43:18,920][106225] Updated weights for policy 1, policy_version 1876671 (0.0005) [2023-12-28 08:43:18,938][106226] Updated weights for policy 0, policy_version 1872757 (0.0010) [2023-12-28 08:43:18,995][106226] Updated weights for policy 0, policy_version 1872767 (0.0011) [2023-12-28 08:43:19,634][106226] Updated weights for policy 0, policy_version 1872777 (0.0010) [2023-12-28 08:43:19,645][106225] Updated weights for policy 1, policy_version 1876681 (0.0010) [2023-12-28 08:43:19,693][106226] Updated weights for policy 0, policy_version 1872787 (0.0006) [2023-12-28 08:43:19,707][106225] Updated weights for policy 1, policy_version 1876691 (0.0010) [2023-12-28 08:43:19,755][106226] Updated weights for policy 0, policy_version 1872797 (0.0006) [2023-12-28 08:43:19,768][106225] Updated weights for policy 1, policy_version 1876701 (0.0010) [2023-12-28 08:43:19,819][106226] Updated weights for policy 0, policy_version 1872807 (0.0007) [2023-12-28 08:43:20,518][106225] Updated weights for policy 1, policy_version 1876711 (0.0010) [2023-12-28 08:43:20,520][106226] Updated weights for policy 0, policy_version 1872817 (0.0007) [2023-12-28 08:43:20,573][106226] Updated weights for policy 0, policy_version 1872827 (0.0006) [2023-12-28 08:43:20,573][106225] Updated weights for policy 1, policy_version 1876721 (0.0010) [2023-12-28 08:43:20,629][106225] Updated weights for policy 1, policy_version 1876731 (0.0011) [2023-12-28 08:43:20,635][106226] Updated weights for policy 0, policy_version 1872837 (0.0006) [2023-12-28 08:43:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 960028672. Throughput: 0: 9780.6, 1: 9859.9. Samples: 960039884. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:21,175][105115] Avg episode reward: [(0, '-4.178'), (1, '-4.781')] [2023-12-28 08:43:21,411][106225] Updated weights for policy 1, policy_version 1876741 (0.0008) [2023-12-28 08:43:21,440][106226] Updated weights for policy 0, policy_version 1872847 (0.0006) [2023-12-28 08:43:21,460][106225] Updated weights for policy 1, policy_version 1876751 (0.0006) [2023-12-28 08:43:21,503][106226] Updated weights for policy 0, policy_version 1872857 (0.0007) [2023-12-28 08:43:21,508][106225] Updated weights for policy 1, policy_version 1876761 (0.0006) [2023-12-28 08:43:21,566][106226] Updated weights for policy 0, policy_version 1872867 (0.0007) [2023-12-28 08:43:22,233][106225] Updated weights for policy 1, policy_version 1876771 (0.0006) [2023-12-28 08:43:22,300][106225] Updated weights for policy 1, policy_version 1876781 (0.0009) [2023-12-28 08:43:22,334][106226] Updated weights for policy 0, policy_version 1872877 (0.0008) [2023-12-28 08:43:22,363][106225] Updated weights for policy 1, policy_version 1876791 (0.0007) [2023-12-28 08:43:22,400][106226] Updated weights for policy 0, policy_version 1872887 (0.0008) [2023-12-28 08:43:22,469][106226] Updated weights for policy 0, policy_version 1872897 (0.0007) [2023-12-28 08:43:23,079][106225] Updated weights for policy 1, policy_version 1876801 (0.0008) [2023-12-28 08:43:23,138][106225] Updated weights for policy 1, policy_version 1876811 (0.0008) [2023-12-28 08:43:23,190][106226] Updated weights for policy 0, policy_version 1872907 (0.0007) [2023-12-28 08:43:23,190][106225] Updated weights for policy 1, policy_version 1876821 (0.0009) [2023-12-28 08:43:23,248][106226] Updated weights for policy 0, policy_version 1872917 (0.0005) [2023-12-28 08:43:23,254][106225] Updated weights for policy 1, policy_version 1876831 (0.0008) [2023-12-28 08:43:23,304][106226] Updated weights for policy 0, policy_version 1872927 (0.0005) [2023-12-28 08:43:23,927][106225] Updated weights for policy 1, policy_version 1876841 (0.0006) [2023-12-28 08:43:23,960][106226] Updated weights for policy 0, policy_version 1872937 (0.0007) [2023-12-28 08:43:23,981][106225] Updated weights for policy 1, policy_version 1876851 (0.0010) [2023-12-28 08:43:24,018][106226] Updated weights for policy 0, policy_version 1872947 (0.0006) [2023-12-28 08:43:24,032][106225] Updated weights for policy 1, policy_version 1876861 (0.0010) [2023-12-28 08:43:24,078][106226] Updated weights for policy 0, policy_version 1872957 (0.0007) [2023-12-28 08:43:24,141][106226] Updated weights for policy 0, policy_version 1872967 (0.0008) [2023-12-28 08:43:24,679][106225] Updated weights for policy 1, policy_version 1876871 (0.0010) [2023-12-28 08:43:24,729][106225] Updated weights for policy 1, policy_version 1876881 (0.0010) [2023-12-28 08:43:24,779][106225] Updated weights for policy 1, policy_version 1876891 (0.0010) [2023-12-28 08:43:24,804][106226] Updated weights for policy 0, policy_version 1872977 (0.0005) [2023-12-28 08:43:24,859][106226] Updated weights for policy 0, policy_version 1872987 (0.0008) [2023-12-28 08:43:24,909][106226] Updated weights for policy 0, policy_version 1872997 (0.0008) [2023-12-28 08:43:25,497][106225] Updated weights for policy 1, policy_version 1876901 (0.0011) [2023-12-28 08:43:25,555][106225] Updated weights for policy 1, policy_version 1876911 (0.0010) [2023-12-28 08:43:25,617][106225] Updated weights for policy 1, policy_version 1876921 (0.0010) [2023-12-28 08:43:25,645][106226] Updated weights for policy 0, policy_version 1873007 (0.0006) [2023-12-28 08:43:25,706][106226] Updated weights for policy 0, policy_version 1873017 (0.0005) [2023-12-28 08:43:25,764][106226] Updated weights for policy 0, policy_version 1873027 (0.0005) [2023-12-28 08:43:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.9, 300 sec: 19799.7). Total num frames: 960126976. Throughput: 0: 9764.1, 1: 9837.1. Samples: 960097192. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:26,175][105115] Avg episode reward: [(0, '-4.476'), (1, '-4.815')] [2023-12-28 08:43:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001876928_480550912.pth... [2023-12-28 08:43:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001873032_479576064.pth... [2023-12-28 08:43:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001871880_479281152.pth [2023-12-28 08:43:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001875776_480256000.pth [2023-12-28 08:43:26,229][106225] Updated weights for policy 1, policy_version 1876931 (0.0010) [2023-12-28 08:43:26,282][106225] Updated weights for policy 1, policy_version 1876941 (0.0010) [2023-12-28 08:43:26,308][106226] Updated weights for policy 0, policy_version 1873037 (0.0006) [2023-12-28 08:43:26,329][106225] Updated weights for policy 1, policy_version 1876951 (0.0010) [2023-12-28 08:43:26,364][106226] Updated weights for policy 0, policy_version 1873047 (0.0005) [2023-12-28 08:43:26,413][106226] Updated weights for policy 0, policy_version 1873057 (0.0005) [2023-12-28 08:43:26,939][106225] Updated weights for policy 1, policy_version 1876961 (0.0005) [2023-12-28 08:43:26,996][106225] Updated weights for policy 1, policy_version 1876971 (0.0006) [2023-12-28 08:43:26,998][106226] Updated weights for policy 0, policy_version 1873067 (0.0006) [2023-12-28 08:43:27,049][106226] Updated weights for policy 0, policy_version 1873077 (0.0006) [2023-12-28 08:43:27,050][106225] Updated weights for policy 1, policy_version 1876981 (0.0007) [2023-12-28 08:43:27,104][106226] Updated weights for policy 0, policy_version 1873087 (0.0008) [2023-12-28 08:43:27,106][106225] Updated weights for policy 1, policy_version 1876991 (0.0005) [2023-12-28 08:43:27,681][106225] Updated weights for policy 1, policy_version 1877001 (0.0010) [2023-12-28 08:43:27,732][106225] Updated weights for policy 1, policy_version 1877011 (0.0009) [2023-12-28 08:43:27,790][106225] Updated weights for policy 1, policy_version 1877021 (0.0008) [2023-12-28 08:43:27,853][106226] Updated weights for policy 0, policy_version 1873097 (0.0009) [2023-12-28 08:43:27,910][106226] Updated weights for policy 0, policy_version 1873107 (0.0007) [2023-12-28 08:43:27,956][106226] Updated weights for policy 0, policy_version 1873117 (0.0007) [2023-12-28 08:43:28,012][106226] Updated weights for policy 0, policy_version 1873127 (0.0008) [2023-12-28 08:43:28,505][106225] Updated weights for policy 1, policy_version 1877031 (0.0009) [2023-12-28 08:43:28,568][106225] Updated weights for policy 1, policy_version 1877041 (0.0006) [2023-12-28 08:43:28,625][106225] Updated weights for policy 1, policy_version 1877051 (0.0010) [2023-12-28 08:43:28,768][106226] Updated weights for policy 0, policy_version 1873137 (0.0008) [2023-12-28 08:43:28,825][106226] Updated weights for policy 0, policy_version 1873147 (0.0008) [2023-12-28 08:43:28,878][106226] Updated weights for policy 0, policy_version 1873157 (0.0008) [2023-12-28 08:43:29,236][106225] Updated weights for policy 1, policy_version 1877061 (0.0009) [2023-12-28 08:43:29,299][106225] Updated weights for policy 1, policy_version 1877071 (0.0007) [2023-12-28 08:43:29,364][106225] Updated weights for policy 1, policy_version 1877081 (0.0006) [2023-12-28 08:43:29,654][106226] Updated weights for policy 0, policy_version 1873167 (0.0008) [2023-12-28 08:43:29,713][106226] Updated weights for policy 0, policy_version 1873177 (0.0008) [2023-12-28 08:43:29,783][106226] Updated weights for policy 0, policy_version 1873187 (0.0011) [2023-12-28 08:43:29,976][106225] Updated weights for policy 1, policy_version 1877091 (0.0007) [2023-12-28 08:43:30,039][106225] Updated weights for policy 1, policy_version 1877101 (0.0009) [2023-12-28 08:43:30,092][106225] Updated weights for policy 1, policy_version 1877111 (0.0008) [2023-12-28 08:43:30,418][106226] Updated weights for policy 0, policy_version 1873197 (0.0008) [2023-12-28 08:43:30,466][106226] Updated weights for policy 0, policy_version 1873207 (0.0005) [2023-12-28 08:43:30,522][106226] Updated weights for policy 0, policy_version 1873217 (0.0010) [2023-12-28 08:43:30,768][106225] Updated weights for policy 1, policy_version 1877121 (0.0009) [2023-12-28 08:43:30,828][106225] Updated weights for policy 1, policy_version 1877131 (0.0010) [2023-12-28 08:43:30,885][106225] Updated weights for policy 1, policy_version 1877141 (0.0010) [2023-12-28 08:43:30,932][106225] Updated weights for policy 1, policy_version 1877151 (0.0010) [2023-12-28 08:43:31,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 960233472. Throughput: 0: 9835.4, 1: 9968.2. Samples: 960222776. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:31,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.441')] [2023-12-28 08:43:31,293][106226] Updated weights for policy 0, policy_version 1873227 (0.0010) [2023-12-28 08:43:31,353][106226] Updated weights for policy 0, policy_version 1873237 (0.0010) [2023-12-28 08:43:31,423][106226] Updated weights for policy 0, policy_version 1873247 (0.0008) [2023-12-28 08:43:31,715][106225] Updated weights for policy 1, policy_version 1877161 (0.0009) [2023-12-28 08:43:31,789][106225] Updated weights for policy 1, policy_version 1877171 (0.0008) [2023-12-28 08:43:31,856][106225] Updated weights for policy 1, policy_version 1877181 (0.0007) [2023-12-28 08:43:32,051][106226] Updated weights for policy 0, policy_version 1873257 (0.0007) [2023-12-28 08:43:32,120][106226] Updated weights for policy 0, policy_version 1873267 (0.0008) [2023-12-28 08:43:32,174][106226] Updated weights for policy 0, policy_version 1873277 (0.0005) [2023-12-28 08:43:32,225][106226] Updated weights for policy 0, policy_version 1873287 (0.0005) [2023-12-28 08:43:32,473][106225] Updated weights for policy 1, policy_version 1877191 (0.0005) [2023-12-28 08:43:32,532][106225] Updated weights for policy 1, policy_version 1877201 (0.0005) [2023-12-28 08:43:32,589][106225] Updated weights for policy 1, policy_version 1877211 (0.0006) [2023-12-28 08:43:32,912][106226] Updated weights for policy 0, policy_version 1873297 (0.0010) [2023-12-28 08:43:32,965][106226] Updated weights for policy 0, policy_version 1873307 (0.0010) [2023-12-28 08:43:33,020][106226] Updated weights for policy 0, policy_version 1873317 (0.0010) [2023-12-28 08:43:33,258][106225] Updated weights for policy 1, policy_version 1877221 (0.0008) [2023-12-28 08:43:33,304][106225] Updated weights for policy 1, policy_version 1877231 (0.0008) [2023-12-28 08:43:33,355][106225] Updated weights for policy 1, policy_version 1877241 (0.0008) [2023-12-28 08:43:33,725][106226] Updated weights for policy 0, policy_version 1873327 (0.0009) [2023-12-28 08:43:33,780][106226] Updated weights for policy 0, policy_version 1873337 (0.0009) [2023-12-28 08:43:33,836][106226] Updated weights for policy 0, policy_version 1873347 (0.0008) [2023-12-28 08:43:34,086][106225] Updated weights for policy 1, policy_version 1877251 (0.0007) [2023-12-28 08:43:34,152][106225] Updated weights for policy 1, policy_version 1877261 (0.0008) [2023-12-28 08:43:34,215][106225] Updated weights for policy 1, policy_version 1877271 (0.0007) [2023-12-28 08:43:34,550][106226] Updated weights for policy 0, policy_version 1873357 (0.0007) [2023-12-28 08:43:34,612][106226] Updated weights for policy 0, policy_version 1873367 (0.0008) [2023-12-28 08:43:34,666][106226] Updated weights for policy 0, policy_version 1873377 (0.0008) [2023-12-28 08:43:34,935][106225] Updated weights for policy 1, policy_version 1877281 (0.0007) [2023-12-28 08:43:34,997][106225] Updated weights for policy 1, policy_version 1877291 (0.0005) [2023-12-28 08:43:35,062][106225] Updated weights for policy 1, policy_version 1877301 (0.0007) [2023-12-28 08:43:35,134][106225] Updated weights for policy 1, policy_version 1877311 (0.0007) [2023-12-28 08:43:35,243][106226] Updated weights for policy 0, policy_version 1873387 (0.0006) [2023-12-28 08:43:35,302][106226] Updated weights for policy 0, policy_version 1873397 (0.0005) [2023-12-28 08:43:35,359][106226] Updated weights for policy 0, policy_version 1873407 (0.0005) [2023-12-28 08:43:35,861][106225] Updated weights for policy 1, policy_version 1877321 (0.0009) [2023-12-28 08:43:35,918][106225] Updated weights for policy 1, policy_version 1877331 (0.0008) [2023-12-28 08:43:35,929][106226] Updated weights for policy 0, policy_version 1873417 (0.0006) [2023-12-28 08:43:35,969][106225] Updated weights for policy 1, policy_version 1877341 (0.0008) [2023-12-28 08:43:35,976][106226] Updated weights for policy 0, policy_version 1873427 (0.0010) [2023-12-28 08:43:36,030][106226] Updated weights for policy 0, policy_version 1873437 (0.0011) [2023-12-28 08:43:36,083][106226] Updated weights for policy 0, policy_version 1873447 (0.0010) [2023-12-28 08:43:36,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 960339968. Throughput: 0: 9899.4, 1: 9988.0. Samples: 960344372. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:36,175][105115] Avg episode reward: [(0, '-4.071'), (1, '-4.574')] [2023-12-28 08:43:36,766][106225] Updated weights for policy 1, policy_version 1877351 (0.0008) [2023-12-28 08:43:36,802][106226] Updated weights for policy 0, policy_version 1873457 (0.0010) [2023-12-28 08:43:36,816][106225] Updated weights for policy 1, policy_version 1877361 (0.0005) [2023-12-28 08:43:36,848][106226] Updated weights for policy 0, policy_version 1873467 (0.0011) [2023-12-28 08:43:36,863][106225] Updated weights for policy 1, policy_version 1877371 (0.0005) [2023-12-28 08:43:36,898][106226] Updated weights for policy 0, policy_version 1873477 (0.0010) [2023-12-28 08:43:37,620][106225] Updated weights for policy 1, policy_version 1877381 (0.0007) [2023-12-28 08:43:37,634][106226] Updated weights for policy 0, policy_version 1873487 (0.0011) [2023-12-28 08:43:37,675][106225] Updated weights for policy 1, policy_version 1877391 (0.0005) [2023-12-28 08:43:37,688][106226] Updated weights for policy 0, policy_version 1873497 (0.0011) [2023-12-28 08:43:37,730][106225] Updated weights for policy 1, policy_version 1877401 (0.0006) [2023-12-28 08:43:37,746][106226] Updated weights for policy 0, policy_version 1873507 (0.0010) [2023-12-28 08:43:38,483][106226] Updated weights for policy 0, policy_version 1873517 (0.0011) [2023-12-28 08:43:38,507][106225] Updated weights for policy 1, policy_version 1877411 (0.0009) [2023-12-28 08:43:38,544][106226] Updated weights for policy 0, policy_version 1873527 (0.0011) [2023-12-28 08:43:38,558][106225] Updated weights for policy 1, policy_version 1877421 (0.0006) [2023-12-28 08:43:38,605][106226] Updated weights for policy 0, policy_version 1873537 (0.0011) [2023-12-28 08:43:38,609][106225] Updated weights for policy 1, policy_version 1877431 (0.0006) [2023-12-28 08:43:39,359][106226] Updated weights for policy 0, policy_version 1873547 (0.0011) [2023-12-28 08:43:39,411][106225] Updated weights for policy 1, policy_version 1877441 (0.0008) [2023-12-28 08:43:39,432][106226] Updated weights for policy 0, policy_version 1873557 (0.0011) [2023-12-28 08:43:39,479][106225] Updated weights for policy 1, policy_version 1877451 (0.0006) [2023-12-28 08:43:39,496][106226] Updated weights for policy 0, policy_version 1873567 (0.0010) [2023-12-28 08:43:39,544][106225] Updated weights for policy 1, policy_version 1877461 (0.0006) [2023-12-28 08:43:39,609][106225] Updated weights for policy 1, policy_version 1877471 (0.0006) [2023-12-28 08:43:40,299][106225] Updated weights for policy 1, policy_version 1877481 (0.0008) [2023-12-28 08:43:40,315][106226] Updated weights for policy 0, policy_version 1873577 (0.0009) [2023-12-28 08:43:40,357][106225] Updated weights for policy 1, policy_version 1877491 (0.0007) [2023-12-28 08:43:40,373][106226] Updated weights for policy 0, policy_version 1873587 (0.0007) [2023-12-28 08:43:40,417][106225] Updated weights for policy 1, policy_version 1877501 (0.0006) [2023-12-28 08:43:40,436][106226] Updated weights for policy 0, policy_version 1873597 (0.0007) [2023-12-28 08:43:40,494][106226] Updated weights for policy 0, policy_version 1873607 (0.0009) [2023-12-28 08:43:41,056][106225] Updated weights for policy 1, policy_version 1877511 (0.0008) [2023-12-28 08:43:41,124][106225] Updated weights for policy 1, policy_version 1877521 (0.0011) [2023-12-28 08:43:41,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 960421888. Throughput: 0: 9878.4, 1: 9992.8. Samples: 960401024. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:41,175][105115] Avg episode reward: [(0, '-4.315'), (1, '-4.392')] [2023-12-28 08:43:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001873608_479723520.pth... [2023-12-28 08:43:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001872456_479428608.pth [2023-12-28 08:43:41,192][106225] Updated weights for policy 1, policy_version 1877531 (0.0010) [2023-12-28 08:43:41,217][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001877536_480706560.pth... [2023-12-28 08:43:41,220][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001876352_480403456.pth [2023-12-28 08:43:41,286][106226] Updated weights for policy 0, policy_version 1873617 (0.0008) [2023-12-28 08:43:41,340][106226] Updated weights for policy 0, policy_version 1873627 (0.0009) [2023-12-28 08:43:41,414][106226] Updated weights for policy 0, policy_version 1873637 (0.0009) [2023-12-28 08:43:41,971][106225] Updated weights for policy 1, policy_version 1877541 (0.0011) [2023-12-28 08:43:42,032][106225] Updated weights for policy 1, policy_version 1877551 (0.0010) [2023-12-28 08:43:42,086][106225] Updated weights for policy 1, policy_version 1877561 (0.0010) [2023-12-28 08:43:42,170][106226] Updated weights for policy 0, policy_version 1873647 (0.0008) [2023-12-28 08:43:42,255][106226] Updated weights for policy 0, policy_version 1873657 (0.0008) [2023-12-28 08:43:42,319][106226] Updated weights for policy 0, policy_version 1873667 (0.0008) [2023-12-28 08:43:42,814][106225] Updated weights for policy 1, policy_version 1877571 (0.0009) [2023-12-28 08:43:42,873][106225] Updated weights for policy 1, policy_version 1877581 (0.0009) [2023-12-28 08:43:42,928][106225] Updated weights for policy 1, policy_version 1877591 (0.0008) [2023-12-28 08:43:43,047][106226] Updated weights for policy 0, policy_version 1873678 (0.0010) [2023-12-28 08:43:43,094][106226] Updated weights for policy 0, policy_version 1873688 (0.0008) [2023-12-28 08:43:43,144][106226] Updated weights for policy 0, policy_version 1873698 (0.0009) [2023-12-28 08:43:43,492][106225] Updated weights for policy 1, policy_version 1877601 (0.0008) [2023-12-28 08:43:43,538][106225] Updated weights for policy 1, policy_version 1877611 (0.0005) [2023-12-28 08:43:43,585][106225] Updated weights for policy 1, policy_version 1877621 (0.0007) [2023-12-28 08:43:43,633][106225] Updated weights for policy 1, policy_version 1877631 (0.0008) [2023-12-28 08:43:43,941][106226] Updated weights for policy 0, policy_version 1873708 (0.0008) [2023-12-28 08:43:44,000][106226] Updated weights for policy 0, policy_version 1873718 (0.0009) [2023-12-28 08:43:44,053][106226] Updated weights for policy 0, policy_version 1873728 (0.0008) [2023-12-28 08:43:44,351][106225] Updated weights for policy 1, policy_version 1877641 (0.0008) [2023-12-28 08:43:44,407][106225] Updated weights for policy 1, policy_version 1877651 (0.0006) [2023-12-28 08:43:44,456][106225] Updated weights for policy 1, policy_version 1877661 (0.0005) [2023-12-28 08:43:44,803][106226] Updated weights for policy 0, policy_version 1873738 (0.0009) [2023-12-28 08:43:44,867][106226] Updated weights for policy 0, policy_version 1873748 (0.0009) [2023-12-28 08:43:44,929][106226] Updated weights for policy 0, policy_version 1873758 (0.0008) [2023-12-28 08:43:44,988][106226] Updated weights for policy 0, policy_version 1873768 (0.0008) [2023-12-28 08:43:45,133][106225] Updated weights for policy 1, policy_version 1877671 (0.0005) [2023-12-28 08:43:45,199][106225] Updated weights for policy 1, policy_version 1877681 (0.0008) [2023-12-28 08:43:45,266][106225] Updated weights for policy 1, policy_version 1877691 (0.0008) [2023-12-28 08:43:45,720][106226] Updated weights for policy 0, policy_version 1873778 (0.0010) [2023-12-28 08:43:45,789][106226] Updated weights for policy 0, policy_version 1873788 (0.0006) [2023-12-28 08:43:45,824][106225] Updated weights for policy 1, policy_version 1877701 (0.0006) [2023-12-28 08:43:45,851][106226] Updated weights for policy 0, policy_version 1873798 (0.0005) [2023-12-28 08:43:45,880][106225] Updated weights for policy 1, policy_version 1877711 (0.0007) [2023-12-28 08:43:45,945][106225] Updated weights for policy 1, policy_version 1877721 (0.0008) [2023-12-28 08:43:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 960528384. Throughput: 0: 9805.5, 1: 9984.4. Samples: 960514568. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:46,176][105115] Avg episode reward: [(0, '-4.299'), (1, '-4.563')] [2023-12-28 08:43:46,475][106226] Updated weights for policy 0, policy_version 1873808 (0.0010) [2023-12-28 08:43:46,534][106226] Updated weights for policy 0, policy_version 1873818 (0.0010) [2023-12-28 08:43:46,598][106226] Updated weights for policy 0, policy_version 1873828 (0.0009) [2023-12-28 08:43:46,692][106225] Updated weights for policy 1, policy_version 1877731 (0.0008) [2023-12-28 08:43:46,751][106225] Updated weights for policy 1, policy_version 1877741 (0.0009) [2023-12-28 08:43:46,806][106225] Updated weights for policy 1, policy_version 1877751 (0.0009) [2023-12-28 08:43:47,242][106226] Updated weights for policy 0, policy_version 1873838 (0.0007) [2023-12-28 08:43:47,305][106226] Updated weights for policy 0, policy_version 1873848 (0.0008) [2023-12-28 08:43:47,364][106226] Updated weights for policy 0, policy_version 1873858 (0.0008) [2023-12-28 08:43:47,552][106225] Updated weights for policy 1, policy_version 1877761 (0.0008) [2023-12-28 08:43:47,613][106225] Updated weights for policy 1, policy_version 1877771 (0.0008) [2023-12-28 08:43:47,676][106225] Updated weights for policy 1, policy_version 1877781 (0.0009) [2023-12-28 08:43:47,737][106225] Updated weights for policy 1, policy_version 1877791 (0.0008) [2023-12-28 08:43:48,065][106226] Updated weights for policy 0, policy_version 1873868 (0.0009) [2023-12-28 08:43:48,125][106226] Updated weights for policy 0, policy_version 1873878 (0.0009) [2023-12-28 08:43:48,188][106226] Updated weights for policy 0, policy_version 1873888 (0.0008) [2023-12-28 08:43:48,474][106225] Updated weights for policy 1, policy_version 1877801 (0.0008) [2023-12-28 08:43:48,534][106225] Updated weights for policy 1, policy_version 1877811 (0.0008) [2023-12-28 08:43:48,583][106225] Updated weights for policy 1, policy_version 1877821 (0.0009) [2023-12-28 08:43:48,916][106226] Updated weights for policy 0, policy_version 1873898 (0.0008) [2023-12-28 08:43:48,978][106226] Updated weights for policy 0, policy_version 1873908 (0.0009) [2023-12-28 08:43:49,046][106226] Updated weights for policy 0, policy_version 1873918 (0.0008) [2023-12-28 08:43:49,108][106226] Updated weights for policy 0, policy_version 1873928 (0.0009) [2023-12-28 08:43:49,329][106225] Updated weights for policy 1, policy_version 1877831 (0.0007) [2023-12-28 08:43:49,395][106225] Updated weights for policy 1, policy_version 1877841 (0.0008) [2023-12-28 08:43:49,456][106225] Updated weights for policy 1, policy_version 1877851 (0.0009) [2023-12-28 08:43:49,834][106226] Updated weights for policy 0, policy_version 1873938 (0.0007) [2023-12-28 08:43:49,898][106226] Updated weights for policy 0, policy_version 1873948 (0.0008) [2023-12-28 08:43:49,966][106226] Updated weights for policy 0, policy_version 1873958 (0.0009) [2023-12-28 08:43:50,171][106225] Updated weights for policy 1, policy_version 1877861 (0.0010) [2023-12-28 08:43:50,235][106225] Updated weights for policy 1, policy_version 1877871 (0.0010) [2023-12-28 08:43:50,299][106225] Updated weights for policy 1, policy_version 1877881 (0.0011) [2023-12-28 08:43:50,703][106226] Updated weights for policy 0, policy_version 1873968 (0.0009) [2023-12-28 08:43:50,770][106226] Updated weights for policy 0, policy_version 1873978 (0.0010) [2023-12-28 08:43:50,833][106226] Updated weights for policy 0, policy_version 1873988 (0.0008) [2023-12-28 08:43:50,977][106225] Updated weights for policy 1, policy_version 1877891 (0.0007) [2023-12-28 08:43:51,041][106225] Updated weights for policy 1, policy_version 1877901 (0.0007) [2023-12-28 08:43:51,108][106225] Updated weights for policy 1, policy_version 1877911 (0.0010) [2023-12-28 08:43:51,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 960626688. Throughput: 0: 9826.6, 1: 9926.3. Samples: 960631204. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:51,175][105115] Avg episode reward: [(0, '-4.353'), (1, '-4.921')] [2023-12-28 08:43:51,533][106226] Updated weights for policy 0, policy_version 1873998 (0.0008) [2023-12-28 08:43:51,593][106226] Updated weights for policy 0, policy_version 1874008 (0.0008) [2023-12-28 08:43:51,660][106226] Updated weights for policy 0, policy_version 1874018 (0.0008) [2023-12-28 08:43:51,837][106225] Updated weights for policy 1, policy_version 1877921 (0.0007) [2023-12-28 08:43:51,896][106225] Updated weights for policy 1, policy_version 1877931 (0.0006) [2023-12-28 08:43:51,952][106225] Updated weights for policy 1, policy_version 1877941 (0.0006) [2023-12-28 08:43:52,013][106225] Updated weights for policy 1, policy_version 1877951 (0.0006) [2023-12-28 08:43:52,403][106226] Updated weights for policy 0, policy_version 1874028 (0.0009) [2023-12-28 08:43:52,464][106226] Updated weights for policy 0, policy_version 1874038 (0.0010) [2023-12-28 08:43:52,527][106226] Updated weights for policy 0, policy_version 1874048 (0.0008) [2023-12-28 08:43:52,669][106225] Updated weights for policy 1, policy_version 1877961 (0.0008) [2023-12-28 08:43:52,734][106225] Updated weights for policy 1, policy_version 1877971 (0.0008) [2023-12-28 08:43:52,803][106225] Updated weights for policy 1, policy_version 1877981 (0.0008) [2023-12-28 08:43:53,191][106226] Updated weights for policy 0, policy_version 1874058 (0.0007) [2023-12-28 08:43:53,246][106226] Updated weights for policy 0, policy_version 1874068 (0.0006) [2023-12-28 08:43:53,306][106226] Updated weights for policy 0, policy_version 1874078 (0.0010) [2023-12-28 08:43:53,361][106226] Updated weights for policy 0, policy_version 1874088 (0.0008) [2023-12-28 08:43:53,455][106225] Updated weights for policy 1, policy_version 1877991 (0.0007) [2023-12-28 08:43:53,502][106225] Updated weights for policy 1, policy_version 1878001 (0.0008) [2023-12-28 08:43:53,550][106225] Updated weights for policy 1, policy_version 1878011 (0.0008) [2023-12-28 08:43:54,048][106226] Updated weights for policy 0, policy_version 1874098 (0.0007) [2023-12-28 08:43:54,107][106226] Updated weights for policy 0, policy_version 1874108 (0.0005) [2023-12-28 08:43:54,160][106226] Updated weights for policy 0, policy_version 1874118 (0.0009) [2023-12-28 08:43:54,184][106225] Updated weights for policy 1, policy_version 1878021 (0.0009) [2023-12-28 08:43:54,250][106225] Updated weights for policy 1, policy_version 1878031 (0.0010) [2023-12-28 08:43:54,307][106225] Updated weights for policy 1, policy_version 1878041 (0.0009) [2023-12-28 08:43:54,779][106226] Updated weights for policy 0, policy_version 1874128 (0.0006) [2023-12-28 08:43:54,834][106226] Updated weights for policy 0, policy_version 1874138 (0.0008) [2023-12-28 08:43:54,884][106226] Updated weights for policy 0, policy_version 1874148 (0.0005) [2023-12-28 08:43:54,918][106225] Updated weights for policy 1, policy_version 1878051 (0.0007) [2023-12-28 08:43:54,971][106225] Updated weights for policy 1, policy_version 1878061 (0.0010) [2023-12-28 08:43:55,032][106225] Updated weights for policy 1, policy_version 1878071 (0.0010) [2023-12-28 08:43:55,533][106226] Updated weights for policy 0, policy_version 1874158 (0.0008) [2023-12-28 08:43:55,593][106226] Updated weights for policy 0, policy_version 1874168 (0.0008) [2023-12-28 08:43:55,656][106226] Updated weights for policy 0, policy_version 1874178 (0.0009) [2023-12-28 08:43:55,714][106225] Updated weights for policy 1, policy_version 1878081 (0.0010) [2023-12-28 08:43:55,767][106225] Updated weights for policy 1, policy_version 1878091 (0.0005) [2023-12-28 08:43:55,832][106225] Updated weights for policy 1, policy_version 1878101 (0.0010) [2023-12-28 08:43:55,901][106225] Updated weights for policy 1, policy_version 1878111 (0.0011) [2023-12-28 08:43:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 960724992. Throughput: 0: 9855.1, 1: 9917.5. Samples: 960691464. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:43:56,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.805')] [2023-12-28 08:43:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001878112_480854016.pth... [2023-12-28 08:43:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001874184_479870976.pth... [2023-12-28 08:43:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001873032_479576064.pth [2023-12-28 08:43:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001876928_480550912.pth [2023-12-28 08:43:56,374][106226] Updated weights for policy 0, policy_version 1874188 (0.0010) [2023-12-28 08:43:56,420][106226] Updated weights for policy 0, policy_version 1874198 (0.0008) [2023-12-28 08:43:56,450][106225] Updated weights for policy 1, policy_version 1878121 (0.0006) [2023-12-28 08:43:56,475][106226] Updated weights for policy 0, policy_version 1874208 (0.0009) [2023-12-28 08:43:56,512][106225] Updated weights for policy 1, policy_version 1878131 (0.0005) [2023-12-28 08:43:56,577][106225] Updated weights for policy 1, policy_version 1878141 (0.0005) [2023-12-28 08:43:57,119][106226] Updated weights for policy 0, policy_version 1874218 (0.0008) [2023-12-28 08:43:57,166][106226] Updated weights for policy 0, policy_version 1874228 (0.0008) [2023-12-28 08:43:57,203][106225] Updated weights for policy 1, policy_version 1878151 (0.0006) [2023-12-28 08:43:57,214][106226] Updated weights for policy 0, policy_version 1874238 (0.0006) [2023-12-28 08:43:57,260][106226] Updated weights for policy 0, policy_version 1874248 (0.0008) [2023-12-28 08:43:57,263][106225] Updated weights for policy 1, policy_version 1878161 (0.0005) [2023-12-28 08:43:57,321][106225] Updated weights for policy 1, policy_version 1878171 (0.0005) [2023-12-28 08:43:57,885][106225] Updated weights for policy 1, policy_version 1878181 (0.0007) [2023-12-28 08:43:57,948][106225] Updated weights for policy 1, policy_version 1878191 (0.0010) [2023-12-28 08:43:57,994][106225] Updated weights for policy 1, policy_version 1878201 (0.0010) [2023-12-28 08:43:58,017][106226] Updated weights for policy 0, policy_version 1874258 (0.0007) [2023-12-28 08:43:58,067][106226] Updated weights for policy 0, policy_version 1874268 (0.0008) [2023-12-28 08:43:58,113][106226] Updated weights for policy 0, policy_version 1874278 (0.0008) [2023-12-28 08:43:58,701][106225] Updated weights for policy 1, policy_version 1878211 (0.0006) [2023-12-28 08:43:58,769][106225] Updated weights for policy 1, policy_version 1878221 (0.0008) [2023-12-28 08:43:58,841][106225] Updated weights for policy 1, policy_version 1878231 (0.0008) [2023-12-28 08:43:58,967][106226] Updated weights for policy 0, policy_version 1874288 (0.0008) [2023-12-28 08:43:59,032][106226] Updated weights for policy 0, policy_version 1874298 (0.0008) [2023-12-28 08:43:59,099][106226] Updated weights for policy 0, policy_version 1874308 (0.0007) [2023-12-28 08:43:59,705][106225] Updated weights for policy 1, policy_version 1878241 (0.0008) [2023-12-28 08:43:59,740][106226] Updated weights for policy 0, policy_version 1874318 (0.0007) [2023-12-28 08:43:59,762][106225] Updated weights for policy 1, policy_version 1878251 (0.0010) [2023-12-28 08:43:59,794][106226] Updated weights for policy 0, policy_version 1874328 (0.0006) [2023-12-28 08:43:59,831][106225] Updated weights for policy 1, policy_version 1878261 (0.0008) [2023-12-28 08:43:59,863][106226] Updated weights for policy 0, policy_version 1874339 (0.0009) [2023-12-28 08:43:59,895][106225] Updated weights for policy 1, policy_version 1878271 (0.0008) [2023-12-28 08:44:00,523][106226] Updated weights for policy 0, policy_version 1874349 (0.0007) [2023-12-28 08:44:00,586][106226] Updated weights for policy 0, policy_version 1874359 (0.0006) [2023-12-28 08:44:00,622][106225] Updated weights for policy 1, policy_version 1878281 (0.0006) [2023-12-28 08:44:00,639][106226] Updated weights for policy 0, policy_version 1874369 (0.0005) [2023-12-28 08:44:00,668][106225] Updated weights for policy 1, policy_version 1878291 (0.0005) [2023-12-28 08:44:00,716][106225] Updated weights for policy 1, policy_version 1878301 (0.0008) [2023-12-28 08:44:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 960823296. Throughput: 0: 9887.6, 1: 10018.2. Samples: 960814180. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:01,175][105115] Avg episode reward: [(0, '-4.456'), (1, '-4.695')] [2023-12-28 08:44:01,287][106226] Updated weights for policy 0, policy_version 1874379 (0.0006) [2023-12-28 08:44:01,350][106226] Updated weights for policy 0, policy_version 1874389 (0.0009) [2023-12-28 08:44:01,420][106226] Updated weights for policy 0, policy_version 1874399 (0.0007) [2023-12-28 08:44:01,442][106225] Updated weights for policy 1, policy_version 1878311 (0.0008) [2023-12-28 08:44:01,506][106225] Updated weights for policy 1, policy_version 1878321 (0.0009) [2023-12-28 08:44:01,566][106225] Updated weights for policy 1, policy_version 1878331 (0.0008) [2023-12-28 08:44:02,075][106226] Updated weights for policy 0, policy_version 1874409 (0.0005) [2023-12-28 08:44:02,124][106226] Updated weights for policy 0, policy_version 1874419 (0.0006) [2023-12-28 08:44:02,182][106226] Updated weights for policy 0, policy_version 1874429 (0.0006) [2023-12-28 08:44:02,250][106226] Updated weights for policy 0, policy_version 1874439 (0.0006) [2023-12-28 08:44:02,387][106225] Updated weights for policy 1, policy_version 1878341 (0.0008) [2023-12-28 08:44:02,448][106225] Updated weights for policy 1, policy_version 1878351 (0.0008) [2023-12-28 08:44:02,506][106225] Updated weights for policy 1, policy_version 1878361 (0.0005) [2023-12-28 08:44:02,905][106226] Updated weights for policy 0, policy_version 1874449 (0.0006) [2023-12-28 08:44:02,957][106226] Updated weights for policy 0, policy_version 1874459 (0.0005) [2023-12-28 08:44:03,014][106226] Updated weights for policy 0, policy_version 1874469 (0.0005) [2023-12-28 08:44:03,148][106225] Updated weights for policy 1, policy_version 1878371 (0.0008) [2023-12-28 08:44:03,196][106225] Updated weights for policy 1, policy_version 1878381 (0.0007) [2023-12-28 08:44:03,243][106225] Updated weights for policy 1, policy_version 1878391 (0.0008) [2023-12-28 08:44:03,588][106226] Updated weights for policy 0, policy_version 1874479 (0.0007) [2023-12-28 08:44:03,634][106226] Updated weights for policy 0, policy_version 1874489 (0.0005) [2023-12-28 08:44:03,689][106226] Updated weights for policy 0, policy_version 1874499 (0.0005) [2023-12-28 08:44:04,085][106225] Updated weights for policy 1, policy_version 1878401 (0.0006) [2023-12-28 08:44:04,144][106225] Updated weights for policy 1, policy_version 1878411 (0.0007) [2023-12-28 08:44:04,203][106225] Updated weights for policy 1, policy_version 1878421 (0.0008) [2023-12-28 08:44:04,264][106225] Updated weights for policy 1, policy_version 1878431 (0.0008) [2023-12-28 08:44:04,304][106226] Updated weights for policy 0, policy_version 1874509 (0.0007) [2023-12-28 08:44:04,365][106226] Updated weights for policy 0, policy_version 1874519 (0.0008) [2023-12-28 08:44:04,426][106226] Updated weights for policy 0, policy_version 1874529 (0.0006) [2023-12-28 08:44:04,916][106225] Updated weights for policy 1, policy_version 1878441 (0.0008) [2023-12-28 08:44:04,964][106225] Updated weights for policy 1, policy_version 1878451 (0.0008) [2023-12-28 08:44:05,018][106225] Updated weights for policy 1, policy_version 1878461 (0.0008) [2023-12-28 08:44:05,111][106226] Updated weights for policy 0, policy_version 1874539 (0.0008) [2023-12-28 08:44:05,175][106226] Updated weights for policy 0, policy_version 1874549 (0.0009) [2023-12-28 08:44:05,241][106226] Updated weights for policy 0, policy_version 1874559 (0.0011) [2023-12-28 08:44:05,674][106225] Updated weights for policy 1, policy_version 1878471 (0.0006) [2023-12-28 08:44:05,735][106225] Updated weights for policy 1, policy_version 1878481 (0.0005) [2023-12-28 08:44:05,798][106225] Updated weights for policy 1, policy_version 1878491 (0.0005) [2023-12-28 08:44:05,945][106226] Updated weights for policy 0, policy_version 1874569 (0.0011) [2023-12-28 08:44:06,001][106226] Updated weights for policy 0, policy_version 1874579 (0.0010) [2023-12-28 08:44:06,048][106226] Updated weights for policy 0, policy_version 1874589 (0.0010) [2023-12-28 08:44:06,106][106226] Updated weights for policy 0, policy_version 1874599 (0.0010) [2023-12-28 08:44:06,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 960929792. Throughput: 0: 9920.7, 1: 9985.2. Samples: 960935648. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:06,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.754')] [2023-12-28 08:44:06,347][106225] Updated weights for policy 1, policy_version 1878501 (0.0008) [2023-12-28 08:44:06,406][106225] Updated weights for policy 1, policy_version 1878511 (0.0010) [2023-12-28 08:44:06,471][106225] Updated weights for policy 1, policy_version 1878521 (0.0010) [2023-12-28 08:44:06,815][106226] Updated weights for policy 0, policy_version 1874609 (0.0010) [2023-12-28 08:44:06,872][106226] Updated weights for policy 0, policy_version 1874619 (0.0011) [2023-12-28 08:44:06,922][106226] Updated weights for policy 0, policy_version 1874629 (0.0010) [2023-12-28 08:44:07,130][106225] Updated weights for policy 1, policy_version 1878531 (0.0009) [2023-12-28 08:44:07,193][106225] Updated weights for policy 1, policy_version 1878541 (0.0005) [2023-12-28 08:44:07,258][106225] Updated weights for policy 1, policy_version 1878551 (0.0005) [2023-12-28 08:44:07,642][106226] Updated weights for policy 0, policy_version 1874639 (0.0011) [2023-12-28 08:44:07,697][106226] Updated weights for policy 0, policy_version 1874649 (0.0010) [2023-12-28 08:44:07,757][106226] Updated weights for policy 0, policy_version 1874659 (0.0011) [2023-12-28 08:44:07,829][106225] Updated weights for policy 1, policy_version 1878561 (0.0010) [2023-12-28 08:44:07,889][106225] Updated weights for policy 1, policy_version 1878571 (0.0010) [2023-12-28 08:44:07,939][106225] Updated weights for policy 1, policy_version 1878581 (0.0010) [2023-12-28 08:44:07,990][106225] Updated weights for policy 1, policy_version 1878591 (0.0010) [2023-12-28 08:44:08,376][106226] Updated weights for policy 0, policy_version 1874669 (0.0009) [2023-12-28 08:44:08,441][106226] Updated weights for policy 0, policy_version 1874679 (0.0009) [2023-12-28 08:44:08,508][106226] Updated weights for policy 0, policy_version 1874689 (0.0009) [2023-12-28 08:44:08,719][106225] Updated weights for policy 1, policy_version 1878601 (0.0010) [2023-12-28 08:44:08,783][106225] Updated weights for policy 1, policy_version 1878611 (0.0010) [2023-12-28 08:44:08,844][106225] Updated weights for policy 1, policy_version 1878621 (0.0011) [2023-12-28 08:44:09,217][106226] Updated weights for policy 0, policy_version 1874699 (0.0008) [2023-12-28 08:44:09,279][106226] Updated weights for policy 0, policy_version 1874709 (0.0008) [2023-12-28 08:44:09,339][106226] Updated weights for policy 0, policy_version 1874719 (0.0008) [2023-12-28 08:44:09,538][106225] Updated weights for policy 1, policy_version 1878631 (0.0007) [2023-12-28 08:44:09,599][106225] Updated weights for policy 1, policy_version 1878641 (0.0007) [2023-12-28 08:44:09,663][106225] Updated weights for policy 1, policy_version 1878651 (0.0007) [2023-12-28 08:44:10,219][106226] Updated weights for policy 0, policy_version 1874729 (0.0009) [2023-12-28 08:44:10,274][106226] Updated weights for policy 0, policy_version 1874739 (0.0007) [2023-12-28 08:44:10,276][106225] Updated weights for policy 1, policy_version 1878661 (0.0005) [2023-12-28 08:44:10,335][106226] Updated weights for policy 0, policy_version 1874749 (0.0007) [2023-12-28 08:44:10,344][106225] Updated weights for policy 1, policy_version 1878671 (0.0007) [2023-12-28 08:44:10,397][106226] Updated weights for policy 0, policy_version 1874759 (0.0006) [2023-12-28 08:44:10,411][106225] Updated weights for policy 1, policy_version 1878681 (0.0007) [2023-12-28 08:44:11,055][106225] Updated weights for policy 1, policy_version 1878691 (0.0009) [2023-12-28 08:44:11,118][106226] Updated weights for policy 0, policy_version 1874769 (0.0008) [2023-12-28 08:44:11,122][106225] Updated weights for policy 1, policy_version 1878701 (0.0008) [2023-12-28 08:44:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 961019904. Throughput: 0: 9958.9, 1: 10053.8. Samples: 960997764. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:11,175][105115] Avg episode reward: [(0, '-4.022'), (1, '-4.665')] [2023-12-28 08:44:11,188][106226] Updated weights for policy 0, policy_version 1874779 (0.0008) [2023-12-28 08:44:11,196][106225] Updated weights for policy 1, policy_version 1878711 (0.0009) [2023-12-28 08:44:11,252][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001878720_481009664.pth... [2023-12-28 08:44:11,254][106226] Updated weights for policy 0, policy_version 1874789 (0.0008) [2023-12-28 08:44:11,257][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001877536_480706560.pth [2023-12-28 08:44:11,271][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001874792_480026624.pth... [2023-12-28 08:44:11,275][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001873608_479723520.pth [2023-12-28 08:44:11,954][106225] Updated weights for policy 1, policy_version 1878721 (0.0007) [2023-12-28 08:44:12,015][106225] Updated weights for policy 1, policy_version 1878731 (0.0010) [2023-12-28 08:44:12,046][106226] Updated weights for policy 0, policy_version 1874799 (0.0011) [2023-12-28 08:44:12,076][106225] Updated weights for policy 1, policy_version 1878741 (0.0007) [2023-12-28 08:44:12,108][106226] Updated weights for policy 0, policy_version 1874809 (0.0010) [2023-12-28 08:44:12,133][106225] Updated weights for policy 1, policy_version 1878751 (0.0008) [2023-12-28 08:44:12,167][106226] Updated weights for policy 0, policy_version 1874819 (0.0010) [2023-12-28 08:44:12,856][106226] Updated weights for policy 0, policy_version 1874829 (0.0008) [2023-12-28 08:44:12,885][106225] Updated weights for policy 1, policy_version 1878761 (0.0009) [2023-12-28 08:44:12,912][106226] Updated weights for policy 0, policy_version 1874839 (0.0006) [2023-12-28 08:44:12,944][106225] Updated weights for policy 1, policy_version 1878771 (0.0008) [2023-12-28 08:44:12,964][106226] Updated weights for policy 0, policy_version 1874849 (0.0006) [2023-12-28 08:44:13,003][106225] Updated weights for policy 1, policy_version 1878781 (0.0007) [2023-12-28 08:44:13,623][106226] Updated weights for policy 0, policy_version 1874859 (0.0010) [2023-12-28 08:44:13,683][106226] Updated weights for policy 0, policy_version 1874869 (0.0009) [2023-12-28 08:44:13,741][106226] Updated weights for policy 0, policy_version 1874879 (0.0008) [2023-12-28 08:44:13,758][106225] Updated weights for policy 1, policy_version 1878791 (0.0008) [2023-12-28 08:44:13,804][106225] Updated weights for policy 1, policy_version 1878801 (0.0007) [2023-12-28 08:44:13,854][106225] Updated weights for policy 1, policy_version 1878811 (0.0008) [2023-12-28 08:44:14,333][106226] Updated weights for policy 0, policy_version 1874889 (0.0006) [2023-12-28 08:44:14,383][106226] Updated weights for policy 0, policy_version 1874899 (0.0005) [2023-12-28 08:44:14,438][106226] Updated weights for policy 0, policy_version 1874909 (0.0005) [2023-12-28 08:44:14,489][106226] Updated weights for policy 0, policy_version 1874919 (0.0008) [2023-12-28 08:44:14,673][106225] Updated weights for policy 1, policy_version 1878821 (0.0008) [2023-12-28 08:44:14,746][106225] Updated weights for policy 1, policy_version 1878831 (0.0008) [2023-12-28 08:44:14,816][106225] Updated weights for policy 1, policy_version 1878841 (0.0008) [2023-12-28 08:44:15,203][106226] Updated weights for policy 0, policy_version 1874929 (0.0009) [2023-12-28 08:44:15,262][106226] Updated weights for policy 0, policy_version 1874939 (0.0008) [2023-12-28 08:44:15,320][106226] Updated weights for policy 0, policy_version 1874949 (0.0005) [2023-12-28 08:44:15,591][106225] Updated weights for policy 1, policy_version 1878851 (0.0008) [2023-12-28 08:44:15,650][106225] Updated weights for policy 1, policy_version 1878861 (0.0009) [2023-12-28 08:44:15,707][106225] Updated weights for policy 1, policy_version 1878871 (0.0009) [2023-12-28 08:44:15,927][106226] Updated weights for policy 0, policy_version 1874959 (0.0007) [2023-12-28 08:44:15,981][106226] Updated weights for policy 0, policy_version 1874969 (0.0010) [2023-12-28 08:44:16,030][106226] Updated weights for policy 0, policy_version 1874979 (0.0008) [2023-12-28 08:44:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 961126400. Throughput: 0: 9902.5, 1: 9887.7. Samples: 961113336. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:16,175][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.336')] [2023-12-28 08:44:16,326][106225] Updated weights for policy 1, policy_version 1878881 (0.0008) [2023-12-28 08:44:16,378][106225] Updated weights for policy 1, policy_version 1878891 (0.0005) [2023-12-28 08:44:16,432][106225] Updated weights for policy 1, policy_version 1878901 (0.0005) [2023-12-28 08:44:16,490][106225] Updated weights for policy 1, policy_version 1878911 (0.0005) [2023-12-28 08:44:16,780][106226] Updated weights for policy 0, policy_version 1874989 (0.0007) [2023-12-28 08:44:16,839][106226] Updated weights for policy 0, policy_version 1874999 (0.0008) [2023-12-28 08:44:16,904][106226] Updated weights for policy 0, policy_version 1875009 (0.0006) [2023-12-28 08:44:17,090][106225] Updated weights for policy 1, policy_version 1878921 (0.0005) [2023-12-28 08:44:17,141][106225] Updated weights for policy 1, policy_version 1878931 (0.0005) [2023-12-28 08:44:17,195][106225] Updated weights for policy 1, policy_version 1878941 (0.0005) [2023-12-28 08:44:17,443][106226] Updated weights for policy 0, policy_version 1875019 (0.0006) [2023-12-28 08:44:17,496][106226] Updated weights for policy 0, policy_version 1875029 (0.0005) [2023-12-28 08:44:17,554][106226] Updated weights for policy 0, policy_version 1875039 (0.0005) [2023-12-28 08:44:17,861][106225] Updated weights for policy 1, policy_version 1878951 (0.0007) [2023-12-28 08:44:17,914][106225] Updated weights for policy 1, policy_version 1878961 (0.0009) [2023-12-28 08:44:17,981][106225] Updated weights for policy 1, policy_version 1878971 (0.0009) [2023-12-28 08:44:18,201][106226] Updated weights for policy 0, policy_version 1875049 (0.0006) [2023-12-28 08:44:18,265][106226] Updated weights for policy 0, policy_version 1875059 (0.0006) [2023-12-28 08:44:18,330][106226] Updated weights for policy 0, policy_version 1875069 (0.0007) [2023-12-28 08:44:18,399][106226] Updated weights for policy 0, policy_version 1875079 (0.0008) [2023-12-28 08:44:18,722][106225] Updated weights for policy 1, policy_version 1878981 (0.0007) [2023-12-28 08:44:18,782][106225] Updated weights for policy 1, policy_version 1878991 (0.0005) [2023-12-28 08:44:18,847][106225] Updated weights for policy 1, policy_version 1879001 (0.0005) [2023-12-28 08:44:19,091][106226] Updated weights for policy 0, policy_version 1875089 (0.0008) [2023-12-28 08:44:19,141][106226] Updated weights for policy 0, policy_version 1875099 (0.0006) [2023-12-28 08:44:19,191][106226] Updated weights for policy 0, policy_version 1875109 (0.0005) [2023-12-28 08:44:19,424][106225] Updated weights for policy 1, policy_version 1879011 (0.0006) [2023-12-28 08:44:19,486][106225] Updated weights for policy 1, policy_version 1879021 (0.0008) [2023-12-28 08:44:19,548][106225] Updated weights for policy 1, policy_version 1879031 (0.0008) [2023-12-28 08:44:19,977][106226] Updated weights for policy 0, policy_version 1875119 (0.0008) [2023-12-28 08:44:20,039][106226] Updated weights for policy 0, policy_version 1875129 (0.0009) [2023-12-28 08:44:20,098][106226] Updated weights for policy 0, policy_version 1875139 (0.0008) [2023-12-28 08:44:20,333][106225] Updated weights for policy 1, policy_version 1879041 (0.0009) [2023-12-28 08:44:20,382][106225] Updated weights for policy 1, policy_version 1879051 (0.0007) [2023-12-28 08:44:20,445][106225] Updated weights for policy 1, policy_version 1879061 (0.0006) [2023-12-28 08:44:20,492][106225] Updated weights for policy 1, policy_version 1879071 (0.0008) [2023-12-28 08:44:20,890][106226] Updated weights for policy 0, policy_version 1875149 (0.0008) [2023-12-28 08:44:20,945][106226] Updated weights for policy 0, policy_version 1875159 (0.0009) [2023-12-28 08:44:21,006][106226] Updated weights for policy 0, policy_version 1875169 (0.0007) [2023-12-28 08:44:21,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 961224704. Throughput: 0: 9840.0, 1: 9910.4. Samples: 961233140. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:21,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.662')] [2023-12-28 08:44:21,298][106225] Updated weights for policy 1, policy_version 1879081 (0.0008) [2023-12-28 08:44:21,355][106225] Updated weights for policy 1, policy_version 1879091 (0.0009) [2023-12-28 08:44:21,424][106225] Updated weights for policy 1, policy_version 1879101 (0.0009) [2023-12-28 08:44:21,764][106226] Updated weights for policy 0, policy_version 1875179 (0.0009) [2023-12-28 08:44:21,823][106226] Updated weights for policy 0, policy_version 1875189 (0.0008) [2023-12-28 08:44:21,887][106226] Updated weights for policy 0, policy_version 1875199 (0.0008) [2023-12-28 08:44:22,186][106225] Updated weights for policy 1, policy_version 1879111 (0.0008) [2023-12-28 08:44:22,257][106225] Updated weights for policy 1, policy_version 1879121 (0.0007) [2023-12-28 08:44:22,322][106225] Updated weights for policy 1, policy_version 1879131 (0.0008) [2023-12-28 08:44:22,645][106226] Updated weights for policy 0, policy_version 1875209 (0.0009) [2023-12-28 08:44:22,706][106226] Updated weights for policy 0, policy_version 1875219 (0.0008) [2023-12-28 08:44:22,772][106226] Updated weights for policy 0, policy_version 1875229 (0.0007) [2023-12-28 08:44:22,840][106226] Updated weights for policy 0, policy_version 1875239 (0.0006) [2023-12-28 08:44:23,058][106225] Updated weights for policy 1, policy_version 1879141 (0.0007) [2023-12-28 08:44:23,115][106225] Updated weights for policy 1, policy_version 1879151 (0.0005) [2023-12-28 08:44:23,167][106225] Updated weights for policy 1, policy_version 1879161 (0.0006) [2023-12-28 08:44:23,480][106226] Updated weights for policy 0, policy_version 1875249 (0.0008) [2023-12-28 08:44:23,543][106226] Updated weights for policy 0, policy_version 1875259 (0.0009) [2023-12-28 08:44:23,597][106226] Updated weights for policy 0, policy_version 1875269 (0.0009) [2023-12-28 08:44:23,814][106225] Updated weights for policy 1, policy_version 1879171 (0.0007) [2023-12-28 08:44:23,867][106225] Updated weights for policy 1, policy_version 1879181 (0.0009) [2023-12-28 08:44:23,922][106225] Updated weights for policy 1, policy_version 1879191 (0.0008) [2023-12-28 08:44:24,343][106226] Updated weights for policy 0, policy_version 1875279 (0.0009) [2023-12-28 08:44:24,400][106226] Updated weights for policy 0, policy_version 1875289 (0.0008) [2023-12-28 08:44:24,453][106226] Updated weights for policy 0, policy_version 1875299 (0.0008) [2023-12-28 08:44:24,618][106225] Updated weights for policy 1, policy_version 1879201 (0.0007) [2023-12-28 08:44:24,663][106225] Updated weights for policy 1, policy_version 1879211 (0.0005) [2023-12-28 08:44:24,721][106225] Updated weights for policy 1, policy_version 1879221 (0.0005) [2023-12-28 08:44:24,772][106225] Updated weights for policy 1, policy_version 1879231 (0.0005) [2023-12-28 08:44:25,242][106226] Updated weights for policy 0, policy_version 1875309 (0.0008) [2023-12-28 08:44:25,308][106226] Updated weights for policy 0, policy_version 1875319 (0.0009) [2023-12-28 08:44:25,356][106225] Updated weights for policy 1, policy_version 1879241 (0.0005) [2023-12-28 08:44:25,365][106226] Updated weights for policy 0, policy_version 1875329 (0.0008) [2023-12-28 08:44:25,414][106225] Updated weights for policy 1, policy_version 1879251 (0.0007) [2023-12-28 08:44:25,467][106225] Updated weights for policy 1, policy_version 1879261 (0.0009) [2023-12-28 08:44:26,112][106225] Updated weights for policy 1, policy_version 1879271 (0.0007) [2023-12-28 08:44:26,125][106226] Updated weights for policy 0, policy_version 1875339 (0.0008) [2023-12-28 08:44:26,162][106225] Updated weights for policy 1, policy_version 1879281 (0.0006) [2023-12-28 08:44:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 961314816. Throughput: 0: 9839.4, 1: 9926.5. Samples: 961290496. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:26,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-4.870')] [2023-12-28 08:44:26,183][106226] Updated weights for policy 0, policy_version 1875349 (0.0008) [2023-12-28 08:44:26,218][106225] Updated weights for policy 1, policy_version 1879291 (0.0006) [2023-12-28 08:44:26,243][106226] Updated weights for policy 0, policy_version 1875359 (0.0007) [2023-12-28 08:44:26,247][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001879296_481157120.pth... [2023-12-28 08:44:26,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001878112_480854016.pth [2023-12-28 08:44:26,299][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001875368_480174080.pth... [2023-12-28 08:44:26,303][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001874184_479870976.pth [2023-12-28 08:44:26,895][106225] Updated weights for policy 1, policy_version 1879301 (0.0008) [2023-12-28 08:44:26,947][106225] Updated weights for policy 1, policy_version 1879311 (0.0009) [2023-12-28 08:44:26,983][106226] Updated weights for policy 0, policy_version 1875369 (0.0008) [2023-12-28 08:44:27,001][106225] Updated weights for policy 1, policy_version 1879321 (0.0008) [2023-12-28 08:44:27,047][106226] Updated weights for policy 0, policy_version 1875379 (0.0007) [2023-12-28 08:44:27,107][106226] Updated weights for policy 0, policy_version 1875389 (0.0009) [2023-12-28 08:44:27,164][106226] Updated weights for policy 0, policy_version 1875399 (0.0008) [2023-12-28 08:44:27,702][106225] Updated weights for policy 1, policy_version 1879331 (0.0008) [2023-12-28 08:44:27,751][106225] Updated weights for policy 1, policy_version 1879341 (0.0008) [2023-12-28 08:44:27,795][106225] Updated weights for policy 1, policy_version 1879351 (0.0008) [2023-12-28 08:44:27,912][106226] Updated weights for policy 0, policy_version 1875409 (0.0009) [2023-12-28 08:44:27,973][106226] Updated weights for policy 0, policy_version 1875419 (0.0008) [2023-12-28 08:44:28,034][106226] Updated weights for policy 0, policy_version 1875429 (0.0008) [2023-12-28 08:44:28,507][106225] Updated weights for policy 1, policy_version 1879361 (0.0008) [2023-12-28 08:44:28,571][106225] Updated weights for policy 1, policy_version 1879371 (0.0006) [2023-12-28 08:44:28,637][106225] Updated weights for policy 1, policy_version 1879381 (0.0006) [2023-12-28 08:44:28,703][106225] Updated weights for policy 1, policy_version 1879391 (0.0007) [2023-12-28 08:44:28,807][106226] Updated weights for policy 0, policy_version 1875439 (0.0006) [2023-12-28 08:44:28,876][106226] Updated weights for policy 0, policy_version 1875449 (0.0008) [2023-12-28 08:44:28,933][106226] Updated weights for policy 0, policy_version 1875459 (0.0008) [2023-12-28 08:44:29,391][106225] Updated weights for policy 1, policy_version 1879401 (0.0007) [2023-12-28 08:44:29,456][106225] Updated weights for policy 1, policy_version 1879411 (0.0007) [2023-12-28 08:44:29,506][106225] Updated weights for policy 1, policy_version 1879421 (0.0009) [2023-12-28 08:44:29,582][106226] Updated weights for policy 0, policy_version 1875469 (0.0009) [2023-12-28 08:44:29,646][106226] Updated weights for policy 0, policy_version 1875479 (0.0009) [2023-12-28 08:44:29,710][106226] Updated weights for policy 0, policy_version 1875489 (0.0008) [2023-12-28 08:44:30,152][106225] Updated weights for policy 1, policy_version 1879431 (0.0006) [2023-12-28 08:44:30,204][106225] Updated weights for policy 1, policy_version 1879441 (0.0007) [2023-12-28 08:44:30,257][106225] Updated weights for policy 1, policy_version 1879451 (0.0009) [2023-12-28 08:44:30,508][106226] Updated weights for policy 0, policy_version 1875499 (0.0008) [2023-12-28 08:44:30,570][106226] Updated weights for policy 0, policy_version 1875509 (0.0008) [2023-12-28 08:44:30,625][106226] Updated weights for policy 0, policy_version 1875519 (0.0008) [2023-12-28 08:44:30,851][106225] Updated weights for policy 1, policy_version 1879461 (0.0007) [2023-12-28 08:44:30,897][106225] Updated weights for policy 1, policy_version 1879471 (0.0005) [2023-12-28 08:44:30,947][106225] Updated weights for policy 1, policy_version 1879481 (0.0005) [2023-12-28 08:44:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 961421312. Throughput: 0: 9869.9, 1: 9982.3. Samples: 961407916. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:31,175][105115] Avg episode reward: [(0, '-4.381'), (1, '-4.703')] [2023-12-28 08:44:31,254][106226] Updated weights for policy 0, policy_version 1875529 (0.0005) [2023-12-28 08:44:31,317][106226] Updated weights for policy 0, policy_version 1875539 (0.0007) [2023-12-28 08:44:31,400][106226] Updated weights for policy 0, policy_version 1875549 (0.0008) [2023-12-28 08:44:31,464][106226] Updated weights for policy 0, policy_version 1875559 (0.0008) [2023-12-28 08:44:31,643][106225] Updated weights for policy 1, policy_version 1879491 (0.0006) [2023-12-28 08:44:31,704][106225] Updated weights for policy 1, policy_version 1879501 (0.0007) [2023-12-28 08:44:31,774][106225] Updated weights for policy 1, policy_version 1879511 (0.0007) [2023-12-28 08:44:32,092][106226] Updated weights for policy 0, policy_version 1875569 (0.0007) [2023-12-28 08:44:32,141][106226] Updated weights for policy 0, policy_version 1875579 (0.0008) [2023-12-28 08:44:32,191][106226] Updated weights for policy 0, policy_version 1875589 (0.0009) [2023-12-28 08:44:32,478][106225] Updated weights for policy 1, policy_version 1879521 (0.0008) [2023-12-28 08:44:32,534][106225] Updated weights for policy 1, policy_version 1879531 (0.0009) [2023-12-28 08:44:32,595][106225] Updated weights for policy 1, policy_version 1879541 (0.0008) [2023-12-28 08:44:32,656][106225] Updated weights for policy 1, policy_version 1879551 (0.0008) [2023-12-28 08:44:32,981][106226] Updated weights for policy 0, policy_version 1875599 (0.0009) [2023-12-28 08:44:33,054][106226] Updated weights for policy 0, policy_version 1875609 (0.0008) [2023-12-28 08:44:33,117][106226] Updated weights for policy 0, policy_version 1875619 (0.0009) [2023-12-28 08:44:33,335][106225] Updated weights for policy 1, policy_version 1879561 (0.0009) [2023-12-28 08:44:33,392][106225] Updated weights for policy 1, policy_version 1879571 (0.0008) [2023-12-28 08:44:33,445][106225] Updated weights for policy 1, policy_version 1879581 (0.0008) [2023-12-28 08:44:33,782][106226] Updated weights for policy 0, policy_version 1875629 (0.0008) [2023-12-28 08:44:33,845][106226] Updated weights for policy 0, policy_version 1875639 (0.0009) [2023-12-28 08:44:33,909][106226] Updated weights for policy 0, policy_version 1875649 (0.0008) [2023-12-28 08:44:34,156][106225] Updated weights for policy 1, policy_version 1879591 (0.0008) [2023-12-28 08:44:34,212][106225] Updated weights for policy 1, policy_version 1879601 (0.0008) [2023-12-28 08:44:34,269][106225] Updated weights for policy 1, policy_version 1879611 (0.0010) [2023-12-28 08:44:34,510][106226] Updated weights for policy 0, policy_version 1875659 (0.0007) [2023-12-28 08:44:34,571][106226] Updated weights for policy 0, policy_version 1875669 (0.0009) [2023-12-28 08:44:34,635][106226] Updated weights for policy 0, policy_version 1875679 (0.0009) [2023-12-28 08:44:34,966][106225] Updated weights for policy 1, policy_version 1879621 (0.0008) [2023-12-28 08:44:35,020][106225] Updated weights for policy 1, policy_version 1879631 (0.0006) [2023-12-28 08:44:35,070][106225] Updated weights for policy 1, policy_version 1879641 (0.0006) [2023-12-28 08:44:35,334][106226] Updated weights for policy 0, policy_version 1875689 (0.0009) [2023-12-28 08:44:35,400][106226] Updated weights for policy 0, policy_version 1875699 (0.0008) [2023-12-28 08:44:35,458][106226] Updated weights for policy 0, policy_version 1875709 (0.0008) [2023-12-28 08:44:35,508][106226] Updated weights for policy 0, policy_version 1875719 (0.0008) [2023-12-28 08:44:35,721][106225] Updated weights for policy 1, policy_version 1879651 (0.0005) [2023-12-28 08:44:35,767][106225] Updated weights for policy 1, policy_version 1879661 (0.0005) [2023-12-28 08:44:35,810][106225] Updated weights for policy 1, policy_version 1879671 (0.0005) [2023-12-28 08:44:36,175][105115] Fps is (10 sec: 20480.3, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 961519616. Throughput: 0: 9931.0, 1: 10066.3. Samples: 961531084. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-28 08:44:36,175][105115] Avg episode reward: [(0, '-4.205'), (1, '-4.728')] [2023-12-28 08:44:36,184][106226] Updated weights for policy 0, policy_version 1875729 (0.0010) [2023-12-28 08:44:36,248][106226] Updated weights for policy 0, policy_version 1875739 (0.0010) [2023-12-28 08:44:36,312][106226] Updated weights for policy 0, policy_version 1875749 (0.0008) [2023-12-28 08:44:36,496][106225] Updated weights for policy 1, policy_version 1879681 (0.0011) [2023-12-28 08:44:36,561][106225] Updated weights for policy 1, policy_version 1879691 (0.0011) [2023-12-28 08:44:36,624][106225] Updated weights for policy 1, policy_version 1879701 (0.0010) [2023-12-28 08:44:36,690][106225] Updated weights for policy 1, policy_version 1879711 (0.0010) [2023-12-28 08:44:37,039][106226] Updated weights for policy 0, policy_version 1875759 (0.0010) [2023-12-28 08:44:37,087][106226] Updated weights for policy 0, policy_version 1875769 (0.0010) [2023-12-28 08:44:37,140][106226] Updated weights for policy 0, policy_version 1875779 (0.0009) [2023-12-28 08:44:37,337][106225] Updated weights for policy 1, policy_version 1879721 (0.0010) [2023-12-28 08:44:37,388][106225] Updated weights for policy 1, policy_version 1879731 (0.0010) [2023-12-28 08:44:37,446][106225] Updated weights for policy 1, policy_version 1879741 (0.0010) [2023-12-28 08:44:37,739][106226] Updated weights for policy 0, policy_version 1875789 (0.0008) [2023-12-28 08:44:37,802][106226] Updated weights for policy 0, policy_version 1875799 (0.0011) [2023-12-28 08:44:37,871][106226] Updated weights for policy 0, policy_version 1875809 (0.0010) [2023-12-28 08:44:38,142][106225] Updated weights for policy 1, policy_version 1879751 (0.0007) [2023-12-28 08:44:38,201][106225] Updated weights for policy 1, policy_version 1879761 (0.0005) [2023-12-28 08:44:38,257][106225] Updated weights for policy 1, policy_version 1879771 (0.0005) [2023-12-28 08:44:38,574][106226] Updated weights for policy 0, policy_version 1875819 (0.0010) [2023-12-28 08:44:38,624][106226] Updated weights for policy 0, policy_version 1875829 (0.0010) [2023-12-28 08:44:38,671][106226] Updated weights for policy 0, policy_version 1875839 (0.0010) [2023-12-28 08:44:38,849][106225] Updated weights for policy 1, policy_version 1879781 (0.0007) [2023-12-28 08:44:38,914][106225] Updated weights for policy 1, policy_version 1879791 (0.0008) [2023-12-28 08:44:38,969][106225] Updated weights for policy 1, policy_version 1879801 (0.0008) [2023-12-28 08:44:39,424][106226] Updated weights for policy 0, policy_version 1875849 (0.0010) [2023-12-28 08:44:39,488][106226] Updated weights for policy 0, policy_version 1875859 (0.0008) [2023-12-28 08:44:39,550][106226] Updated weights for policy 0, policy_version 1875869 (0.0009) [2023-12-28 08:44:39,612][106226] Updated weights for policy 0, policy_version 1875879 (0.0008) [2023-12-28 08:44:39,708][106225] Updated weights for policy 1, policy_version 1879811 (0.0008) [2023-12-28 08:44:39,766][106225] Updated weights for policy 1, policy_version 1879821 (0.0007) [2023-12-28 08:44:39,834][106225] Updated weights for policy 1, policy_version 1879831 (0.0007) [2023-12-28 08:44:40,362][106226] Updated weights for policy 0, policy_version 1875889 (0.0008) [2023-12-28 08:44:40,424][106226] Updated weights for policy 0, policy_version 1875899 (0.0009) [2023-12-28 08:44:40,485][106226] Updated weights for policy 0, policy_version 1875909 (0.0008) [2023-12-28 08:44:40,487][106225] Updated weights for policy 1, policy_version 1879841 (0.0010) [2023-12-28 08:44:40,545][106225] Updated weights for policy 1, policy_version 1879851 (0.0008) [2023-12-28 08:44:40,604][106225] Updated weights for policy 1, policy_version 1879861 (0.0006) [2023-12-28 08:44:40,661][106225] Updated weights for policy 1, policy_version 1879871 (0.0010) [2023-12-28 08:44:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 961617920. Throughput: 0: 9922.9, 1: 10092.7. Samples: 961592160. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:44:41,175][105115] Avg episode reward: [(0, '-4.269'), (1, '-4.588')] [2023-12-28 08:44:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001875912_480313344.pth... [2023-12-28 08:44:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001879872_481304576.pth... [2023-12-28 08:44:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001878720_481009664.pth [2023-12-28 08:44:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001874792_480026624.pth [2023-12-28 08:44:41,273][106226] Updated weights for policy 0, policy_version 1875919 (0.0008) [2023-12-28 08:44:41,337][106226] Updated weights for policy 0, policy_version 1875929 (0.0008) [2023-12-28 08:44:41,358][106225] Updated weights for policy 1, policy_version 1879881 (0.0007) [2023-12-28 08:44:41,406][106226] Updated weights for policy 0, policy_version 1875939 (0.0008) [2023-12-28 08:44:41,422][106225] Updated weights for policy 1, policy_version 1879891 (0.0007) [2023-12-28 08:44:41,486][106225] Updated weights for policy 1, policy_version 1879901 (0.0008) [2023-12-28 08:44:42,118][106226] Updated weights for policy 0, policy_version 1875949 (0.0009) [2023-12-28 08:44:42,191][106226] Updated weights for policy 0, policy_version 1875959 (0.0008) [2023-12-28 08:44:42,254][106226] Updated weights for policy 0, policy_version 1875969 (0.0010) [2023-12-28 08:44:42,276][106225] Updated weights for policy 1, policy_version 1879911 (0.0010) [2023-12-28 08:44:42,344][106225] Updated weights for policy 1, policy_version 1879921 (0.0013) [2023-12-28 08:44:42,411][106225] Updated weights for policy 1, policy_version 1879931 (0.0008) [2023-12-28 08:44:42,919][106226] Updated weights for policy 0, policy_version 1875979 (0.0010) [2023-12-28 08:44:42,976][106226] Updated weights for policy 0, policy_version 1875989 (0.0010) [2023-12-28 08:44:43,034][106226] Updated weights for policy 0, policy_version 1875999 (0.0011) [2023-12-28 08:44:43,142][106225] Updated weights for policy 1, policy_version 1879941 (0.0009) [2023-12-28 08:44:43,188][106225] Updated weights for policy 1, policy_version 1879951 (0.0008) [2023-12-28 08:44:43,234][106225] Updated weights for policy 1, policy_version 1879961 (0.0007) [2023-12-28 08:44:43,678][106226] Updated weights for policy 0, policy_version 1876009 (0.0010) [2023-12-28 08:44:43,747][106226] Updated weights for policy 0, policy_version 1876019 (0.0005) [2023-12-28 08:44:43,810][106226] Updated weights for policy 0, policy_version 1876029 (0.0005) [2023-12-28 08:44:43,853][106225] Updated weights for policy 1, policy_version 1879971 (0.0006) [2023-12-28 08:44:43,867][106226] Updated weights for policy 0, policy_version 1876039 (0.0006) [2023-12-28 08:44:43,906][106225] Updated weights for policy 1, policy_version 1879981 (0.0007) [2023-12-28 08:44:43,964][106225] Updated weights for policy 1, policy_version 1879991 (0.0009) [2023-12-28 08:44:44,467][106226] Updated weights for policy 0, policy_version 1876049 (0.0010) [2023-12-28 08:44:44,527][106226] Updated weights for policy 0, policy_version 1876059 (0.0010) [2023-12-28 08:44:44,596][106226] Updated weights for policy 0, policy_version 1876069 (0.0010) [2023-12-28 08:44:44,655][106225] Updated weights for policy 1, policy_version 1880001 (0.0010) [2023-12-28 08:44:44,709][106225] Updated weights for policy 1, policy_version 1880011 (0.0007) [2023-12-28 08:44:44,765][106225] Updated weights for policy 1, policy_version 1880021 (0.0008) [2023-12-28 08:44:44,827][106225] Updated weights for policy 1, policy_version 1880031 (0.0006) [2023-12-28 08:44:45,307][106226] Updated weights for policy 0, policy_version 1876079 (0.0010) [2023-12-28 08:44:45,371][106226] Updated weights for policy 0, policy_version 1876089 (0.0011) [2023-12-28 08:44:45,427][106226] Updated weights for policy 0, policy_version 1876099 (0.0010) [2023-12-28 08:44:45,481][106225] Updated weights for policy 1, policy_version 1880041 (0.0006) [2023-12-28 08:44:45,537][106225] Updated weights for policy 1, policy_version 1880051 (0.0005) [2023-12-28 08:44:45,587][106225] Updated weights for policy 1, policy_version 1880061 (0.0008) [2023-12-28 08:44:46,125][106226] Updated weights for policy 0, policy_version 1876109 (0.0011) [2023-12-28 08:44:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 961716224. Throughput: 0: 9905.9, 1: 10001.4. Samples: 961710012. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:44:46,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.563')] [2023-12-28 08:44:46,185][106226] Updated weights for policy 0, policy_version 1876119 (0.0009) [2023-12-28 08:44:46,192][106225] Updated weights for policy 1, policy_version 1880071 (0.0006) [2023-12-28 08:44:46,236][106226] Updated weights for policy 0, policy_version 1876129 (0.0008) [2023-12-28 08:44:46,240][106225] Updated weights for policy 1, policy_version 1880081 (0.0005) [2023-12-28 08:44:46,293][106225] Updated weights for policy 1, policy_version 1880091 (0.0005) [2023-12-28 08:44:46,847][106225] Updated weights for policy 1, policy_version 1880101 (0.0008) [2023-12-28 08:44:46,910][106225] Updated weights for policy 1, policy_version 1880111 (0.0010) [2023-12-28 08:44:46,976][106225] Updated weights for policy 1, policy_version 1880121 (0.0009) [2023-12-28 08:44:46,996][106226] Updated weights for policy 0, policy_version 1876139 (0.0009) [2023-12-28 08:44:47,064][106226] Updated weights for policy 0, policy_version 1876149 (0.0009) [2023-12-28 08:44:47,126][106226] Updated weights for policy 0, policy_version 1876159 (0.0010) [2023-12-28 08:44:47,636][106225] Updated weights for policy 1, policy_version 1880131 (0.0006) [2023-12-28 08:44:47,697][106225] Updated weights for policy 1, policy_version 1880141 (0.0008) [2023-12-28 08:44:47,750][106226] Updated weights for policy 0, policy_version 1876169 (0.0010) [2023-12-28 08:44:47,758][106225] Updated weights for policy 1, policy_version 1880151 (0.0009) [2023-12-28 08:44:47,809][106226] Updated weights for policy 0, policy_version 1876179 (0.0006) [2023-12-28 08:44:47,871][106226] Updated weights for policy 0, policy_version 1876189 (0.0006) [2023-12-28 08:44:47,927][106226] Updated weights for policy 0, policy_version 1876199 (0.0006) [2023-12-28 08:44:48,488][106225] Updated weights for policy 1, policy_version 1880161 (0.0007) [2023-12-28 08:44:48,545][106225] Updated weights for policy 1, policy_version 1880171 (0.0008) [2023-12-28 08:44:48,596][106225] Updated weights for policy 1, policy_version 1880181 (0.0009) [2023-12-28 08:44:48,653][106225] Updated weights for policy 1, policy_version 1880191 (0.0007) [2023-12-28 08:44:48,674][106226] Updated weights for policy 0, policy_version 1876209 (0.0009) [2023-12-28 08:44:48,734][106226] Updated weights for policy 0, policy_version 1876219 (0.0007) [2023-12-28 08:44:48,786][106226] Updated weights for policy 0, policy_version 1876229 (0.0011) [2023-12-28 08:44:49,292][106225] Updated weights for policy 1, policy_version 1880201 (0.0008) [2023-12-28 08:44:49,352][106225] Updated weights for policy 1, policy_version 1880211 (0.0007) [2023-12-28 08:44:49,414][106225] Updated weights for policy 1, policy_version 1880221 (0.0006) [2023-12-28 08:44:49,467][106226] Updated weights for policy 0, policy_version 1876239 (0.0009) [2023-12-28 08:44:49,529][106226] Updated weights for policy 0, policy_version 1876249 (0.0008) [2023-12-28 08:44:49,586][106226] Updated weights for policy 0, policy_version 1876259 (0.0010) [2023-12-28 08:44:50,058][106225] Updated weights for policy 1, policy_version 1880231 (0.0007) [2023-12-28 08:44:50,104][106225] Updated weights for policy 1, policy_version 1880241 (0.0009) [2023-12-28 08:44:50,158][106225] Updated weights for policy 1, policy_version 1880251 (0.0008) [2023-12-28 08:44:50,322][106226] Updated weights for policy 0, policy_version 1876269 (0.0008) [2023-12-28 08:44:50,373][106226] Updated weights for policy 0, policy_version 1876279 (0.0008) [2023-12-28 08:44:50,430][106226] Updated weights for policy 0, policy_version 1876289 (0.0008) [2023-12-28 08:44:50,916][106225] Updated weights for policy 1, policy_version 1880261 (0.0007) [2023-12-28 08:44:50,979][106225] Updated weights for policy 1, policy_version 1880271 (0.0009) [2023-12-28 08:44:51,046][106225] Updated weights for policy 1, policy_version 1880281 (0.0011) [2023-12-28 08:44:51,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 961822720. Throughput: 0: 9794.7, 1: 10103.0. Samples: 961831048. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:44:51,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.421')] [2023-12-28 08:44:51,218][106226] Updated weights for policy 0, policy_version 1876299 (0.0009) [2023-12-28 08:44:51,291][106226] Updated weights for policy 0, policy_version 1876309 (0.0009) [2023-12-28 08:44:51,358][106226] Updated weights for policy 0, policy_version 1876319 (0.0008) [2023-12-28 08:44:51,811][106225] Updated weights for policy 1, policy_version 1880291 (0.0009) [2023-12-28 08:44:51,875][106225] Updated weights for policy 1, policy_version 1880301 (0.0007) [2023-12-28 08:44:51,936][106225] Updated weights for policy 1, policy_version 1880311 (0.0007) [2023-12-28 08:44:52,088][106226] Updated weights for policy 0, policy_version 1876329 (0.0008) [2023-12-28 08:44:52,151][106226] Updated weights for policy 0, policy_version 1876339 (0.0009) [2023-12-28 08:44:52,209][106226] Updated weights for policy 0, policy_version 1876349 (0.0008) [2023-12-28 08:44:52,272][106226] Updated weights for policy 0, policy_version 1876359 (0.0007) [2023-12-28 08:44:52,661][106225] Updated weights for policy 1, policy_version 1880321 (0.0007) [2023-12-28 08:44:52,719][106225] Updated weights for policy 1, policy_version 1880331 (0.0009) [2023-12-28 08:44:52,777][106225] Updated weights for policy 1, policy_version 1880341 (0.0008) [2023-12-28 08:44:52,831][106225] Updated weights for policy 1, policy_version 1880351 (0.0010) [2023-12-28 08:44:52,991][106226] Updated weights for policy 0, policy_version 1876369 (0.0010) [2023-12-28 08:44:53,044][106226] Updated weights for policy 0, policy_version 1876379 (0.0008) [2023-12-28 08:44:53,097][106226] Updated weights for policy 0, policy_version 1876389 (0.0005) [2023-12-28 08:44:53,567][106225] Updated weights for policy 1, policy_version 1880361 (0.0008) [2023-12-28 08:44:53,621][106225] Updated weights for policy 1, policy_version 1880371 (0.0009) [2023-12-28 08:44:53,670][106225] Updated weights for policy 1, policy_version 1880381 (0.0008) [2023-12-28 08:44:53,716][106226] Updated weights for policy 0, policy_version 1876399 (0.0005) [2023-12-28 08:44:53,764][106226] Updated weights for policy 0, policy_version 1876409 (0.0006) [2023-12-28 08:44:53,820][106226] Updated weights for policy 0, policy_version 1876419 (0.0008) [2023-12-28 08:44:54,412][106225] Updated weights for policy 1, policy_version 1880391 (0.0008) [2023-12-28 08:44:54,464][106225] Updated weights for policy 1, policy_version 1880401 (0.0008) [2023-12-28 08:44:54,516][106225] Updated weights for policy 1, policy_version 1880411 (0.0009) [2023-12-28 08:44:54,535][106226] Updated weights for policy 0, policy_version 1876429 (0.0008) [2023-12-28 08:44:54,590][106226] Updated weights for policy 0, policy_version 1876439 (0.0006) [2023-12-28 08:44:54,651][106226] Updated weights for policy 0, policy_version 1876449 (0.0005) [2023-12-28 08:44:55,198][106225] Updated weights for policy 1, policy_version 1880421 (0.0006) [2023-12-28 08:44:55,232][106226] Updated weights for policy 0, policy_version 1876459 (0.0007) [2023-12-28 08:44:55,265][106225] Updated weights for policy 1, policy_version 1880431 (0.0009) [2023-12-28 08:44:55,284][106226] Updated weights for policy 0, policy_version 1876469 (0.0008) [2023-12-28 08:44:55,325][106225] Updated weights for policy 1, policy_version 1880441 (0.0010) [2023-12-28 08:44:55,339][106226] Updated weights for policy 0, policy_version 1876479 (0.0006) [2023-12-28 08:44:55,977][106226] Updated weights for policy 0, policy_version 1876489 (0.0008) [2023-12-28 08:44:56,001][106225] Updated weights for policy 1, policy_version 1880451 (0.0009) [2023-12-28 08:44:56,038][106226] Updated weights for policy 0, policy_version 1876499 (0.0006) [2023-12-28 08:44:56,056][106225] Updated weights for policy 1, policy_version 1880461 (0.0008) [2023-12-28 08:44:56,093][106226] Updated weights for policy 0, policy_version 1876509 (0.0006) [2023-12-28 08:44:56,104][106225] Updated weights for policy 1, policy_version 1880471 (0.0010) [2023-12-28 08:44:56,145][106226] Updated weights for policy 0, policy_version 1876519 (0.0005) [2023-12-28 08:44:56,174][105115] Fps is (10 sec: 21299.3, 60 sec: 20070.5, 300 sec: 19855.2). Total num frames: 961929216. Throughput: 0: 9790.5, 1: 10024.4. Samples: 961889432. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:44:56,175][105115] Avg episode reward: [(0, '-4.253'), (1, '-4.762')] [2023-12-28 08:44:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001876520_480468992.pth... [2023-12-28 08:44:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001880480_481460224.pth... [2023-12-28 08:44:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001875368_480174080.pth [2023-12-28 08:44:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001879296_481157120.pth [2023-12-28 08:44:56,655][106226] Updated weights for policy 0, policy_version 1876529 (0.0005) [2023-12-28 08:44:56,717][106226] Updated weights for policy 0, policy_version 1876539 (0.0005) [2023-12-28 08:44:56,775][106226] Updated weights for policy 0, policy_version 1876549 (0.0005) [2023-12-28 08:44:56,832][106225] Updated weights for policy 1, policy_version 1880481 (0.0010) [2023-12-28 08:44:56,881][106225] Updated weights for policy 1, policy_version 1880491 (0.0006) [2023-12-28 08:44:56,934][106225] Updated weights for policy 1, policy_version 1880501 (0.0005) [2023-12-28 08:44:56,994][106225] Updated weights for policy 1, policy_version 1880511 (0.0005) [2023-12-28 08:44:57,393][106226] Updated weights for policy 0, policy_version 1876559 (0.0009) [2023-12-28 08:44:57,442][106226] Updated weights for policy 0, policy_version 1876569 (0.0010) [2023-12-28 08:44:57,495][106226] Updated weights for policy 0, policy_version 1876579 (0.0010) [2023-12-28 08:44:57,658][106225] Updated weights for policy 1, policy_version 1880521 (0.0010) [2023-12-28 08:44:57,711][106225] Updated weights for policy 1, policy_version 1880531 (0.0010) [2023-12-28 08:44:57,761][106225] Updated weights for policy 1, policy_version 1880541 (0.0010) [2023-12-28 08:44:58,095][106226] Updated weights for policy 0, policy_version 1876589 (0.0010) [2023-12-28 08:44:58,153][106226] Updated weights for policy 0, policy_version 1876599 (0.0011) [2023-12-28 08:44:58,220][106226] Updated weights for policy 0, policy_version 1876609 (0.0010) [2023-12-28 08:44:58,519][106225] Updated weights for policy 1, policy_version 1880551 (0.0011) [2023-12-28 08:44:58,589][106225] Updated weights for policy 1, policy_version 1880561 (0.0009) [2023-12-28 08:44:58,657][106225] Updated weights for policy 1, policy_version 1880571 (0.0008) [2023-12-28 08:44:59,028][106226] Updated weights for policy 0, policy_version 1876619 (0.0008) [2023-12-28 08:44:59,083][106226] Updated weights for policy 0, policy_version 1876629 (0.0008) [2023-12-28 08:44:59,141][106226] Updated weights for policy 0, policy_version 1876639 (0.0008) [2023-12-28 08:44:59,504][106225] Updated weights for policy 1, policy_version 1880581 (0.0009) [2023-12-28 08:44:59,549][106225] Updated weights for policy 1, policy_version 1880591 (0.0007) [2023-12-28 08:44:59,595][106225] Updated weights for policy 1, policy_version 1880601 (0.0007) [2023-12-28 08:44:59,988][106226] Updated weights for policy 0, policy_version 1876649 (0.0008) [2023-12-28 08:45:00,047][106226] Updated weights for policy 0, policy_version 1876659 (0.0007) [2023-12-28 08:45:00,101][106226] Updated weights for policy 0, policy_version 1876669 (0.0007) [2023-12-28 08:45:00,164][106226] Updated weights for policy 0, policy_version 1876679 (0.0009) [2023-12-28 08:45:00,391][106225] Updated weights for policy 1, policy_version 1880611 (0.0008) [2023-12-28 08:45:00,440][106225] Updated weights for policy 1, policy_version 1880621 (0.0008) [2023-12-28 08:45:00,493][106225] Updated weights for policy 1, policy_version 1880631 (0.0008) [2023-12-28 08:45:00,787][106226] Updated weights for policy 0, policy_version 1876689 (0.0006) [2023-12-28 08:45:00,840][106226] Updated weights for policy 0, policy_version 1876699 (0.0005) [2023-12-28 08:45:00,893][106226] Updated weights for policy 0, policy_version 1876709 (0.0005) [2023-12-28 08:45:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 962019328. Throughput: 0: 9880.8, 1: 10036.2. Samples: 962009600. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:01,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.547')] [2023-12-28 08:45:01,208][106225] Updated weights for policy 1, policy_version 1880641 (0.0010) [2023-12-28 08:45:01,273][106225] Updated weights for policy 1, policy_version 1880651 (0.0008) [2023-12-28 08:45:01,332][106225] Updated weights for policy 1, policy_version 1880661 (0.0008) [2023-12-28 08:45:01,400][106225] Updated weights for policy 1, policy_version 1880671 (0.0009) [2023-12-28 08:45:01,559][106226] Updated weights for policy 0, policy_version 1876719 (0.0007) [2023-12-28 08:45:01,623][106226] Updated weights for policy 0, policy_version 1876729 (0.0009) [2023-12-28 08:45:01,692][106226] Updated weights for policy 0, policy_version 1876739 (0.0008) [2023-12-28 08:45:02,106][106225] Updated weights for policy 1, policy_version 1880681 (0.0005) [2023-12-28 08:45:02,156][106225] Updated weights for policy 1, policy_version 1880691 (0.0008) [2023-12-28 08:45:02,205][106225] Updated weights for policy 1, policy_version 1880701 (0.0007) [2023-12-28 08:45:02,417][106226] Updated weights for policy 0, policy_version 1876749 (0.0007) [2023-12-28 08:45:02,476][106226] Updated weights for policy 0, policy_version 1876759 (0.0005) [2023-12-28 08:45:02,534][106226] Updated weights for policy 0, policy_version 1876769 (0.0008) [2023-12-28 08:45:02,941][106225] Updated weights for policy 1, policy_version 1880711 (0.0008) [2023-12-28 08:45:02,994][106225] Updated weights for policy 1, policy_version 1880721 (0.0008) [2023-12-28 08:45:03,047][106225] Updated weights for policy 1, policy_version 1880731 (0.0008) [2023-12-28 08:45:03,174][106226] Updated weights for policy 0, policy_version 1876779 (0.0008) [2023-12-28 08:45:03,229][106226] Updated weights for policy 0, policy_version 1876789 (0.0008) [2023-12-28 08:45:03,285][106226] Updated weights for policy 0, policy_version 1876799 (0.0008) [2023-12-28 08:45:03,770][106225] Updated weights for policy 1, policy_version 1880741 (0.0007) [2023-12-28 08:45:03,825][106225] Updated weights for policy 1, policy_version 1880751 (0.0005) [2023-12-28 08:45:03,891][106225] Updated weights for policy 1, policy_version 1880761 (0.0007) [2023-12-28 08:45:03,920][106226] Updated weights for policy 0, policy_version 1876809 (0.0008) [2023-12-28 08:45:03,985][106226] Updated weights for policy 0, policy_version 1876819 (0.0008) [2023-12-28 08:45:04,046][106226] Updated weights for policy 0, policy_version 1876829 (0.0009) [2023-12-28 08:45:04,106][106226] Updated weights for policy 0, policy_version 1876839 (0.0011) [2023-12-28 08:45:04,663][106225] Updated weights for policy 1, policy_version 1880771 (0.0009) [2023-12-28 08:45:04,717][106225] Updated weights for policy 1, policy_version 1880781 (0.0008) [2023-12-28 08:45:04,771][106226] Updated weights for policy 0, policy_version 1876849 (0.0010) [2023-12-28 08:45:04,771][106225] Updated weights for policy 1, policy_version 1880791 (0.0006) [2023-12-28 08:45:04,834][106226] Updated weights for policy 0, policy_version 1876859 (0.0006) [2023-12-28 08:45:04,891][106226] Updated weights for policy 0, policy_version 1876869 (0.0005) [2023-12-28 08:45:05,441][106225] Updated weights for policy 1, policy_version 1880801 (0.0006) [2023-12-28 08:45:05,498][106225] Updated weights for policy 1, policy_version 1880811 (0.0008) [2023-12-28 08:45:05,551][106225] Updated weights for policy 1, policy_version 1880821 (0.0007) [2023-12-28 08:45:05,557][106226] Updated weights for policy 0, policy_version 1876879 (0.0005) [2023-12-28 08:45:05,605][106225] Updated weights for policy 1, policy_version 1880831 (0.0006) [2023-12-28 08:45:05,611][106226] Updated weights for policy 0, policy_version 1876889 (0.0006) [2023-12-28 08:45:05,668][106226] Updated weights for policy 0, policy_version 1876899 (0.0009) [2023-12-28 08:45:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 962117632. Throughput: 0: 9938.0, 1: 10001.3. Samples: 962130412. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:06,175][105115] Avg episode reward: [(0, '-4.195'), (1, '-4.810')] [2023-12-28 08:45:06,316][106226] Updated weights for policy 0, policy_version 1876909 (0.0008) [2023-12-28 08:45:06,372][106226] Updated weights for policy 0, policy_version 1876919 (0.0008) [2023-12-28 08:45:06,401][106225] Updated weights for policy 1, policy_version 1880841 (0.0007) [2023-12-28 08:45:06,434][106226] Updated weights for policy 0, policy_version 1876929 (0.0007) [2023-12-28 08:45:06,464][106225] Updated weights for policy 1, policy_version 1880851 (0.0006) [2023-12-28 08:45:06,522][106225] Updated weights for policy 1, policy_version 1880861 (0.0008) [2023-12-28 08:45:07,150][106226] Updated weights for policy 0, policy_version 1876939 (0.0008) [2023-12-28 08:45:07,205][106226] Updated weights for policy 0, policy_version 1876949 (0.0011) [2023-12-28 08:45:07,267][106226] Updated weights for policy 0, policy_version 1876959 (0.0011) [2023-12-28 08:45:07,268][106225] Updated weights for policy 1, policy_version 1880871 (0.0008) [2023-12-28 08:45:07,323][106225] Updated weights for policy 1, policy_version 1880881 (0.0006) [2023-12-28 08:45:07,391][106225] Updated weights for policy 1, policy_version 1880891 (0.0008) [2023-12-28 08:45:07,951][106226] Updated weights for policy 0, policy_version 1876969 (0.0011) [2023-12-28 08:45:08,008][106226] Updated weights for policy 0, policy_version 1876979 (0.0010) [2023-12-28 08:45:08,071][106226] Updated weights for policy 0, policy_version 1876989 (0.0010) [2023-12-28 08:45:08,131][106225] Updated weights for policy 1, policy_version 1880901 (0.0006) [2023-12-28 08:45:08,134][106226] Updated weights for policy 0, policy_version 1876999 (0.0011) [2023-12-28 08:45:08,182][106225] Updated weights for policy 1, policy_version 1880911 (0.0007) [2023-12-28 08:45:08,232][106225] Updated weights for policy 1, policy_version 1880921 (0.0007) [2023-12-28 08:45:08,836][106226] Updated weights for policy 0, policy_version 1877009 (0.0009) [2023-12-28 08:45:08,890][106226] Updated weights for policy 0, policy_version 1877019 (0.0007) [2023-12-28 08:45:08,949][106226] Updated weights for policy 0, policy_version 1877029 (0.0007) [2023-12-28 08:45:08,962][106225] Updated weights for policy 1, policy_version 1880931 (0.0007) [2023-12-28 08:45:09,021][106225] Updated weights for policy 1, policy_version 1880941 (0.0005) [2023-12-28 08:45:09,084][106225] Updated weights for policy 1, policy_version 1880951 (0.0006) [2023-12-28 08:45:09,641][106226] Updated weights for policy 0, policy_version 1877039 (0.0008) [2023-12-28 08:45:09,706][106226] Updated weights for policy 0, policy_version 1877049 (0.0007) [2023-12-28 08:45:09,767][106226] Updated weights for policy 0, policy_version 1877059 (0.0009) [2023-12-28 08:45:09,788][106225] Updated weights for policy 1, policy_version 1880961 (0.0006) [2023-12-28 08:45:09,856][106225] Updated weights for policy 1, policy_version 1880971 (0.0008) [2023-12-28 08:45:09,925][106225] Updated weights for policy 1, policy_version 1880981 (0.0007) [2023-12-28 08:45:09,987][106225] Updated weights for policy 1, policy_version 1880991 (0.0008) [2023-12-28 08:45:10,541][106226] Updated weights for policy 0, policy_version 1877069 (0.0006) [2023-12-28 08:45:10,614][106226] Updated weights for policy 0, policy_version 1877079 (0.0005) [2023-12-28 08:45:10,663][106225] Updated weights for policy 1, policy_version 1881001 (0.0007) [2023-12-28 08:45:10,691][106226] Updated weights for policy 0, policy_version 1877089 (0.0007) [2023-12-28 08:45:10,723][106225] Updated weights for policy 1, policy_version 1881011 (0.0006) [2023-12-28 08:45:10,785][106225] Updated weights for policy 1, policy_version 1881021 (0.0005) [2023-12-28 08:45:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 962215936. Throughput: 0: 9941.4, 1: 9992.7. Samples: 962187528. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:11,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.744')] [2023-12-28 08:45:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001881024_481599488.pth... [2023-12-28 08:45:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001877096_480616448.pth... [2023-12-28 08:45:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001879872_481304576.pth [2023-12-28 08:45:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001875912_480313344.pth [2023-12-28 08:45:11,361][106226] Updated weights for policy 0, policy_version 1877099 (0.0011) [2023-12-28 08:45:11,443][106226] Updated weights for policy 0, policy_version 1877109 (0.0007) [2023-12-28 08:45:11,503][106226] Updated weights for policy 0, policy_version 1877119 (0.0009) [2023-12-28 08:45:11,520][106225] Updated weights for policy 1, policy_version 1881031 (0.0007) [2023-12-28 08:45:11,581][106225] Updated weights for policy 1, policy_version 1881041 (0.0007) [2023-12-28 08:45:11,648][106225] Updated weights for policy 1, policy_version 1881051 (0.0008) [2023-12-28 08:45:12,199][106226] Updated weights for policy 0, policy_version 1877129 (0.0006) [2023-12-28 08:45:12,256][106226] Updated weights for policy 0, policy_version 1877139 (0.0008) [2023-12-28 08:45:12,317][106226] Updated weights for policy 0, policy_version 1877149 (0.0006) [2023-12-28 08:45:12,387][106226] Updated weights for policy 0, policy_version 1877159 (0.0009) [2023-12-28 08:45:12,408][106225] Updated weights for policy 1, policy_version 1881061 (0.0009) [2023-12-28 08:45:12,465][106225] Updated weights for policy 1, policy_version 1881071 (0.0009) [2023-12-28 08:45:12,521][106225] Updated weights for policy 1, policy_version 1881081 (0.0007) [2023-12-28 08:45:13,113][106226] Updated weights for policy 0, policy_version 1877169 (0.0007) [2023-12-28 08:45:13,169][106226] Updated weights for policy 0, policy_version 1877179 (0.0008) [2023-12-28 08:45:13,235][106226] Updated weights for policy 0, policy_version 1877189 (0.0009) [2023-12-28 08:45:13,321][106225] Updated weights for policy 1, policy_version 1881091 (0.0008) [2023-12-28 08:45:13,377][106225] Updated weights for policy 1, policy_version 1881101 (0.0010) [2023-12-28 08:45:13,434][106225] Updated weights for policy 1, policy_version 1881111 (0.0010) [2023-12-28 08:45:13,875][106226] Updated weights for policy 0, policy_version 1877199 (0.0006) [2023-12-28 08:45:13,925][106226] Updated weights for policy 0, policy_version 1877209 (0.0006) [2023-12-28 08:45:13,975][106226] Updated weights for policy 0, policy_version 1877219 (0.0005) [2023-12-28 08:45:14,162][106225] Updated weights for policy 1, policy_version 1881121 (0.0008) [2023-12-28 08:45:14,225][106225] Updated weights for policy 1, policy_version 1881131 (0.0007) [2023-12-28 08:45:14,274][106225] Updated weights for policy 1, policy_version 1881141 (0.0007) [2023-12-28 08:45:14,319][106225] Updated weights for policy 1, policy_version 1881151 (0.0007) [2023-12-28 08:45:14,673][106226] Updated weights for policy 0, policy_version 1877229 (0.0008) [2023-12-28 08:45:14,730][106226] Updated weights for policy 0, policy_version 1877239 (0.0011) [2023-12-28 08:45:14,791][106226] Updated weights for policy 0, policy_version 1877249 (0.0011) [2023-12-28 08:45:15,073][106225] Updated weights for policy 1, policy_version 1881161 (0.0008) [2023-12-28 08:45:15,136][106225] Updated weights for policy 1, policy_version 1881171 (0.0008) [2023-12-28 08:45:15,200][106225] Updated weights for policy 1, policy_version 1881181 (0.0008) [2023-12-28 08:45:15,510][106226] Updated weights for policy 0, policy_version 1877259 (0.0008) [2023-12-28 08:45:15,577][106226] Updated weights for policy 0, policy_version 1877269 (0.0011) [2023-12-28 08:45:15,640][106226] Updated weights for policy 0, policy_version 1877279 (0.0010) [2023-12-28 08:45:15,877][106225] Updated weights for policy 1, policy_version 1881191 (0.0008) [2023-12-28 08:45:15,931][106225] Updated weights for policy 1, policy_version 1881201 (0.0008) [2023-12-28 08:45:15,983][106225] Updated weights for policy 1, policy_version 1881211 (0.0008) [2023-12-28 08:45:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 962314240. Throughput: 0: 10009.5, 1: 9880.4. Samples: 962302964. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:16,176][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.624')] [2023-12-28 08:45:16,348][106226] Updated weights for policy 0, policy_version 1877289 (0.0010) [2023-12-28 08:45:16,410][106226] Updated weights for policy 0, policy_version 1877299 (0.0011) [2023-12-28 08:45:16,463][106226] Updated weights for policy 0, policy_version 1877309 (0.0011) [2023-12-28 08:45:16,527][106226] Updated weights for policy 0, policy_version 1877319 (0.0011) [2023-12-28 08:45:16,725][106225] Updated weights for policy 1, policy_version 1881221 (0.0008) [2023-12-28 08:45:16,790][106225] Updated weights for policy 1, policy_version 1881231 (0.0008) [2023-12-28 08:45:16,846][106225] Updated weights for policy 1, policy_version 1881241 (0.0007) [2023-12-28 08:45:17,253][106226] Updated weights for policy 0, policy_version 1877329 (0.0011) [2023-12-28 08:45:17,316][106226] Updated weights for policy 0, policy_version 1877339 (0.0010) [2023-12-28 08:45:17,366][106226] Updated weights for policy 0, policy_version 1877349 (0.0010) [2023-12-28 08:45:17,469][106225] Updated weights for policy 1, policy_version 1881251 (0.0006) [2023-12-28 08:45:17,529][106225] Updated weights for policy 1, policy_version 1881261 (0.0007) [2023-12-28 08:45:17,594][106225] Updated weights for policy 1, policy_version 1881271 (0.0008) [2023-12-28 08:45:18,077][106226] Updated weights for policy 0, policy_version 1877359 (0.0010) [2023-12-28 08:45:18,142][106226] Updated weights for policy 0, policy_version 1877369 (0.0010) [2023-12-28 08:45:18,210][106226] Updated weights for policy 0, policy_version 1877379 (0.0011) [2023-12-28 08:45:18,303][106225] Updated weights for policy 1, policy_version 1881281 (0.0008) [2023-12-28 08:45:18,370][106225] Updated weights for policy 1, policy_version 1881291 (0.0008) [2023-12-28 08:45:18,429][106225] Updated weights for policy 1, policy_version 1881301 (0.0008) [2023-12-28 08:45:18,483][106225] Updated weights for policy 1, policy_version 1881311 (0.0008) [2023-12-28 08:45:18,926][106226] Updated weights for policy 0, policy_version 1877389 (0.0008) [2023-12-28 08:45:18,986][106226] Updated weights for policy 0, policy_version 1877399 (0.0006) [2023-12-28 08:45:19,045][106226] Updated weights for policy 0, policy_version 1877409 (0.0006) [2023-12-28 08:45:19,191][106225] Updated weights for policy 1, policy_version 1881321 (0.0007) [2023-12-28 08:45:19,257][106225] Updated weights for policy 1, policy_version 1881331 (0.0009) [2023-12-28 08:45:19,317][106225] Updated weights for policy 1, policy_version 1881341 (0.0008) [2023-12-28 08:45:19,883][106226] Updated weights for policy 0, policy_version 1877419 (0.0010) [2023-12-28 08:45:19,950][106226] Updated weights for policy 0, policy_version 1877429 (0.0009) [2023-12-28 08:45:20,004][106225] Updated weights for policy 1, policy_version 1881351 (0.0010) [2023-12-28 08:45:20,014][106226] Updated weights for policy 0, policy_version 1877439 (0.0008) [2023-12-28 08:45:20,068][106225] Updated weights for policy 1, policy_version 1881362 (0.0010) [2023-12-28 08:45:20,130][106225] Updated weights for policy 1, policy_version 1881372 (0.0009) [2023-12-28 08:45:20,858][106226] Updated weights for policy 0, policy_version 1877449 (0.0009) [2023-12-28 08:45:20,926][106226] Updated weights for policy 0, policy_version 1877459 (0.0009) [2023-12-28 08:45:20,940][106225] Updated weights for policy 1, policy_version 1881382 (0.0008) [2023-12-28 08:45:20,990][106226] Updated weights for policy 0, policy_version 1877469 (0.0006) [2023-12-28 08:45:21,004][106225] Updated weights for policy 1, policy_version 1881392 (0.0008) [2023-12-28 08:45:21,064][106226] Updated weights for policy 0, policy_version 1877479 (0.0007) [2023-12-28 08:45:21,074][106225] Updated weights for policy 1, policy_version 1881402 (0.0007) [2023-12-28 08:45:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 962412544. Throughput: 0: 9883.3, 1: 9805.6. Samples: 962417084. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:21,175][105115] Avg episode reward: [(0, '-4.146'), (1, '-4.643')] [2023-12-28 08:45:21,909][106225] Updated weights for policy 1, policy_version 1881412 (0.0008) [2023-12-28 08:45:21,913][106226] Updated weights for policy 0, policy_version 1877489 (0.0006) [2023-12-28 08:45:21,970][106225] Updated weights for policy 1, policy_version 1881422 (0.0008) [2023-12-28 08:45:21,974][106226] Updated weights for policy 0, policy_version 1877499 (0.0006) [2023-12-28 08:45:22,040][106226] Updated weights for policy 0, policy_version 1877509 (0.0008) [2023-12-28 08:45:22,042][106225] Updated weights for policy 1, policy_version 1881432 (0.0006) [2023-12-28 08:45:22,751][106226] Updated weights for policy 0, policy_version 1877519 (0.0009) [2023-12-28 08:45:22,798][106225] Updated weights for policy 1, policy_version 1881442 (0.0008) [2023-12-28 08:45:22,814][106226] Updated weights for policy 0, policy_version 1877529 (0.0009) [2023-12-28 08:45:22,867][106225] Updated weights for policy 1, policy_version 1881452 (0.0008) [2023-12-28 08:45:22,874][106226] Updated weights for policy 0, policy_version 1877539 (0.0007) [2023-12-28 08:45:22,935][106225] Updated weights for policy 1, policy_version 1881462 (0.0009) [2023-12-28 08:45:23,002][106225] Updated weights for policy 1, policy_version 1881472 (0.0007) [2023-12-28 08:45:23,621][106226] Updated weights for policy 0, policy_version 1877549 (0.0009) [2023-12-28 08:45:23,680][106226] Updated weights for policy 0, policy_version 1877559 (0.0007) [2023-12-28 08:45:23,682][106225] Updated weights for policy 1, policy_version 1881482 (0.0007) [2023-12-28 08:45:23,735][106226] Updated weights for policy 0, policy_version 1877569 (0.0007) [2023-12-28 08:45:23,741][106225] Updated weights for policy 1, policy_version 1881492 (0.0006) [2023-12-28 08:45:23,798][106225] Updated weights for policy 1, policy_version 1881502 (0.0007) [2023-12-28 08:45:24,418][106226] Updated weights for policy 0, policy_version 1877579 (0.0008) [2023-12-28 08:45:24,478][106226] Updated weights for policy 0, policy_version 1877589 (0.0009) [2023-12-28 08:45:24,538][106226] Updated weights for policy 0, policy_version 1877599 (0.0009) [2023-12-28 08:45:24,567][106225] Updated weights for policy 1, policy_version 1881512 (0.0007) [2023-12-28 08:45:24,627][106225] Updated weights for policy 1, policy_version 1881522 (0.0007) [2023-12-28 08:45:24,680][106225] Updated weights for policy 1, policy_version 1881532 (0.0009) [2023-12-28 08:45:25,199][106226] Updated weights for policy 0, policy_version 1877609 (0.0008) [2023-12-28 08:45:25,259][106226] Updated weights for policy 0, policy_version 1877619 (0.0011) [2023-12-28 08:45:25,319][106226] Updated weights for policy 0, policy_version 1877629 (0.0010) [2023-12-28 08:45:25,374][106226] Updated weights for policy 0, policy_version 1877639 (0.0010) [2023-12-28 08:45:25,475][106225] Updated weights for policy 1, policy_version 1881542 (0.0008) [2023-12-28 08:45:25,533][106225] Updated weights for policy 1, policy_version 1881552 (0.0009) [2023-12-28 08:45:25,585][106225] Updated weights for policy 1, policy_version 1881562 (0.0008) [2023-12-28 08:45:26,027][106226] Updated weights for policy 0, policy_version 1877649 (0.0010) [2023-12-28 08:45:26,085][106226] Updated weights for policy 0, policy_version 1877659 (0.0011) [2023-12-28 08:45:26,143][106226] Updated weights for policy 0, policy_version 1877669 (0.0010) [2023-12-28 08:45:26,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 962502656. Throughput: 0: 9832.2, 1: 9711.9. Samples: 962471644. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:26,175][105115] Avg episode reward: [(0, '-4.428'), (1, '-4.726')] [2023-12-28 08:45:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001881568_481738752.pth... [2023-12-28 08:45:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001877672_480763904.pth... [2023-12-28 08:45:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001876520_480468992.pth [2023-12-28 08:45:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001880480_481460224.pth [2023-12-28 08:45:26,258][106225] Updated weights for policy 1, policy_version 1881572 (0.0007) [2023-12-28 08:45:26,312][106225] Updated weights for policy 1, policy_version 1881582 (0.0008) [2023-12-28 08:45:26,368][106225] Updated weights for policy 1, policy_version 1881592 (0.0007) [2023-12-28 08:45:26,824][106226] Updated weights for policy 0, policy_version 1877679 (0.0007) [2023-12-28 08:45:26,878][106226] Updated weights for policy 0, policy_version 1877689 (0.0005) [2023-12-28 08:45:26,933][106226] Updated weights for policy 0, policy_version 1877699 (0.0006) [2023-12-28 08:45:26,945][106225] Updated weights for policy 1, policy_version 1881602 (0.0007) [2023-12-28 08:45:27,013][106225] Updated weights for policy 1, policy_version 1881612 (0.0005) [2023-12-28 08:45:27,065][106225] Updated weights for policy 1, policy_version 1881622 (0.0006) [2023-12-28 08:45:27,118][106225] Updated weights for policy 1, policy_version 1881632 (0.0008) [2023-12-28 08:45:27,530][106226] Updated weights for policy 0, policy_version 1877709 (0.0008) [2023-12-28 08:45:27,583][106226] Updated weights for policy 0, policy_version 1877719 (0.0008) [2023-12-28 08:45:27,636][106226] Updated weights for policy 0, policy_version 1877729 (0.0005) [2023-12-28 08:45:27,806][106225] Updated weights for policy 1, policy_version 1881642 (0.0006) [2023-12-28 08:45:27,867][106225] Updated weights for policy 1, policy_version 1881652 (0.0005) [2023-12-28 08:45:27,930][106225] Updated weights for policy 1, policy_version 1881662 (0.0007) [2023-12-28 08:45:28,211][106226] Updated weights for policy 0, policy_version 1877739 (0.0006) [2023-12-28 08:45:28,269][106226] Updated weights for policy 0, policy_version 1877749 (0.0005) [2023-12-28 08:45:28,335][106226] Updated weights for policy 0, policy_version 1877759 (0.0009) [2023-12-28 08:45:28,623][106225] Updated weights for policy 1, policy_version 1881672 (0.0006) [2023-12-28 08:45:28,676][106225] Updated weights for policy 1, policy_version 1881682 (0.0007) [2023-12-28 08:45:28,736][106225] Updated weights for policy 1, policy_version 1881692 (0.0008) [2023-12-28 08:45:29,089][106226] Updated weights for policy 0, policy_version 1877769 (0.0011) [2023-12-28 08:45:29,154][106226] Updated weights for policy 0, policy_version 1877779 (0.0009) [2023-12-28 08:45:29,209][106226] Updated weights for policy 0, policy_version 1877789 (0.0008) [2023-12-28 08:45:29,281][106226] Updated weights for policy 0, policy_version 1877799 (0.0009) [2023-12-28 08:45:29,348][106225] Updated weights for policy 1, policy_version 1881702 (0.0008) [2023-12-28 08:45:29,408][106225] Updated weights for policy 1, policy_version 1881712 (0.0008) [2023-12-28 08:45:29,464][106225] Updated weights for policy 1, policy_version 1881722 (0.0008) [2023-12-28 08:45:30,091][106226] Updated weights for policy 0, policy_version 1877809 (0.0009) [2023-12-28 08:45:30,154][106226] Updated weights for policy 0, policy_version 1877819 (0.0009) [2023-12-28 08:45:30,201][106225] Updated weights for policy 1, policy_version 1881732 (0.0007) [2023-12-28 08:45:30,211][106226] Updated weights for policy 0, policy_version 1877829 (0.0008) [2023-12-28 08:45:30,259][106225] Updated weights for policy 1, policy_version 1881742 (0.0006) [2023-12-28 08:45:30,318][106225] Updated weights for policy 1, policy_version 1881752 (0.0008) [2023-12-28 08:45:30,971][106226] Updated weights for policy 0, policy_version 1877839 (0.0007) [2023-12-28 08:45:31,038][106226] Updated weights for policy 0, policy_version 1877849 (0.0008) [2023-12-28 08:45:31,040][106225] Updated weights for policy 1, policy_version 1881762 (0.0009) [2023-12-28 08:45:31,095][106226] Updated weights for policy 0, policy_version 1877859 (0.0008) [2023-12-28 08:45:31,110][106225] Updated weights for policy 1, policy_version 1881772 (0.0011) [2023-12-28 08:45:31,167][106225] Updated weights for policy 1, policy_version 1881782 (0.0008) [2023-12-28 08:45:31,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 962600960. Throughput: 0: 9873.6, 1: 9740.4. Samples: 962592640. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:31,175][105115] Avg episode reward: [(0, '-4.470'), (1, '-4.464')] [2023-12-28 08:45:31,221][106225] Updated weights for policy 1, policy_version 1881792 (0.0005) [2023-12-28 08:45:31,857][106226] Updated weights for policy 0, policy_version 1877869 (0.0008) [2023-12-28 08:45:31,914][106226] Updated weights for policy 0, policy_version 1877879 (0.0008) [2023-12-28 08:45:31,934][106225] Updated weights for policy 1, policy_version 1881802 (0.0006) [2023-12-28 08:45:31,966][106226] Updated weights for policy 0, policy_version 1877889 (0.0008) [2023-12-28 08:45:31,995][106225] Updated weights for policy 1, policy_version 1881812 (0.0006) [2023-12-28 08:45:32,049][106225] Updated weights for policy 1, policy_version 1881822 (0.0009) [2023-12-28 08:45:32,698][106226] Updated weights for policy 0, policy_version 1877899 (0.0006) [2023-12-28 08:45:32,722][106225] Updated weights for policy 1, policy_version 1881832 (0.0006) [2023-12-28 08:45:32,761][106226] Updated weights for policy 0, policy_version 1877909 (0.0008) [2023-12-28 08:45:32,785][106225] Updated weights for policy 1, policy_version 1881842 (0.0006) [2023-12-28 08:45:32,816][106226] Updated weights for policy 0, policy_version 1877919 (0.0006) [2023-12-28 08:45:32,847][106225] Updated weights for policy 1, policy_version 1881852 (0.0007) [2023-12-28 08:45:33,460][106225] Updated weights for policy 1, policy_version 1881862 (0.0007) [2023-12-28 08:45:33,515][106226] Updated weights for policy 0, policy_version 1877929 (0.0006) [2023-12-28 08:45:33,519][106225] Updated weights for policy 1, policy_version 1881872 (0.0006) [2023-12-28 08:45:33,578][106225] Updated weights for policy 1, policy_version 1881882 (0.0006) [2023-12-28 08:45:33,588][106226] Updated weights for policy 0, policy_version 1877939 (0.0007) [2023-12-28 08:45:33,647][106226] Updated weights for policy 0, policy_version 1877949 (0.0008) [2023-12-28 08:45:33,710][106226] Updated weights for policy 0, policy_version 1877959 (0.0008) [2023-12-28 08:45:34,216][106225] Updated weights for policy 1, policy_version 1881892 (0.0005) [2023-12-28 08:45:34,280][106225] Updated weights for policy 1, policy_version 1881902 (0.0009) [2023-12-28 08:45:34,351][106225] Updated weights for policy 1, policy_version 1881912 (0.0009) [2023-12-28 08:45:34,447][106226] Updated weights for policy 0, policy_version 1877969 (0.0006) [2023-12-28 08:45:34,516][106226] Updated weights for policy 0, policy_version 1877979 (0.0007) [2023-12-28 08:45:34,587][106226] Updated weights for policy 0, policy_version 1877989 (0.0007) [2023-12-28 08:45:35,072][106225] Updated weights for policy 1, policy_version 1881922 (0.0009) [2023-12-28 08:45:35,138][106225] Updated weights for policy 1, policy_version 1881932 (0.0005) [2023-12-28 08:45:35,202][106225] Updated weights for policy 1, policy_version 1881942 (0.0007) [2023-12-28 08:45:35,242][106226] Updated weights for policy 0, policy_version 1877999 (0.0007) [2023-12-28 08:45:35,263][106225] Updated weights for policy 1, policy_version 1881952 (0.0008) [2023-12-28 08:45:35,291][106226] Updated weights for policy 0, policy_version 1878009 (0.0007) [2023-12-28 08:45:35,339][106226] Updated weights for policy 0, policy_version 1878019 (0.0008) [2023-12-28 08:45:35,818][106225] Updated weights for policy 1, policy_version 1881962 (0.0008) [2023-12-28 08:45:35,874][106225] Updated weights for policy 1, policy_version 1881972 (0.0008) [2023-12-28 08:45:35,929][106225] Updated weights for policy 1, policy_version 1881982 (0.0008) [2023-12-28 08:45:36,146][106226] Updated weights for policy 0, policy_version 1878029 (0.0008) [2023-12-28 08:45:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 962699264. Throughput: 0: 9841.0, 1: 9710.2. Samples: 962710852. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:36,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.456')] [2023-12-28 08:45:36,209][106226] Updated weights for policy 0, policy_version 1878039 (0.0008) [2023-12-28 08:45:36,271][106226] Updated weights for policy 0, policy_version 1878049 (0.0009) [2023-12-28 08:45:36,589][106225] Updated weights for policy 1, policy_version 1881992 (0.0006) [2023-12-28 08:45:36,648][106225] Updated weights for policy 1, policy_version 1882002 (0.0008) [2023-12-28 08:45:36,706][106225] Updated weights for policy 1, policy_version 1882012 (0.0009) [2023-12-28 08:45:36,960][106226] Updated weights for policy 0, policy_version 1878059 (0.0009) [2023-12-28 08:45:37,028][106226] Updated weights for policy 0, policy_version 1878069 (0.0007) [2023-12-28 08:45:37,090][106226] Updated weights for policy 0, policy_version 1878079 (0.0010) [2023-12-28 08:45:37,308][106225] Updated weights for policy 1, policy_version 1882022 (0.0008) [2023-12-28 08:45:37,367][106225] Updated weights for policy 1, policy_version 1882032 (0.0005) [2023-12-28 08:45:37,423][106225] Updated weights for policy 1, policy_version 1882042 (0.0005) [2023-12-28 08:45:37,861][106226] Updated weights for policy 0, policy_version 1878089 (0.0008) [2023-12-28 08:45:37,927][106226] Updated weights for policy 0, policy_version 1878099 (0.0006) [2023-12-28 08:45:37,987][106226] Updated weights for policy 0, policy_version 1878109 (0.0005) [2023-12-28 08:45:38,046][106226] Updated weights for policy 0, policy_version 1878119 (0.0008) [2023-12-28 08:45:38,107][106225] Updated weights for policy 1, policy_version 1882052 (0.0007) [2023-12-28 08:45:38,166][106225] Updated weights for policy 1, policy_version 1882062 (0.0009) [2023-12-28 08:45:38,231][106225] Updated weights for policy 1, policy_version 1882072 (0.0006) [2023-12-28 08:45:38,772][106226] Updated weights for policy 0, policy_version 1878129 (0.0008) [2023-12-28 08:45:38,830][106226] Updated weights for policy 0, policy_version 1878139 (0.0009) [2023-12-28 08:45:38,892][106226] Updated weights for policy 0, policy_version 1878149 (0.0008) [2023-12-28 08:45:38,937][106225] Updated weights for policy 1, policy_version 1882082 (0.0006) [2023-12-28 08:45:39,004][106225] Updated weights for policy 1, policy_version 1882092 (0.0008) [2023-12-28 08:45:39,068][106225] Updated weights for policy 1, policy_version 1882102 (0.0008) [2023-12-28 08:45:39,134][106225] Updated weights for policy 1, policy_version 1882112 (0.0009) [2023-12-28 08:45:39,703][106226] Updated weights for policy 0, policy_version 1878159 (0.0007) [2023-12-28 08:45:39,768][106226] Updated weights for policy 0, policy_version 1878169 (0.0007) [2023-12-28 08:45:39,829][106225] Updated weights for policy 1, policy_version 1882122 (0.0006) [2023-12-28 08:45:39,841][106226] Updated weights for policy 0, policy_version 1878179 (0.0009) [2023-12-28 08:45:39,893][106225] Updated weights for policy 1, policy_version 1882132 (0.0007) [2023-12-28 08:45:39,957][106225] Updated weights for policy 1, policy_version 1882142 (0.0009) [2023-12-28 08:45:40,557][106226] Updated weights for policy 0, policy_version 1878189 (0.0009) [2023-12-28 08:45:40,627][106226] Updated weights for policy 0, policy_version 1878199 (0.0010) [2023-12-28 08:45:40,670][106225] Updated weights for policy 1, policy_version 1882152 (0.0006) [2023-12-28 08:45:40,695][106226] Updated weights for policy 0, policy_version 1878209 (0.0008) [2023-12-28 08:45:40,725][106225] Updated weights for policy 1, policy_version 1882162 (0.0006) [2023-12-28 08:45:40,786][106225] Updated weights for policy 1, policy_version 1882172 (0.0008) [2023-12-28 08:45:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 962797568. Throughput: 0: 9801.0, 1: 9765.0. Samples: 962769908. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:41,175][105115] Avg episode reward: [(0, '-4.107'), (1, '-4.773')] [2023-12-28 08:45:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001882176_481894400.pth... [2023-12-28 08:45:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001878216_480903168.pth... [2023-12-28 08:45:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001877096_480616448.pth [2023-12-28 08:45:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001881024_481599488.pth [2023-12-28 08:45:41,415][106226] Updated weights for policy 0, policy_version 1878219 (0.0009) [2023-12-28 08:45:41,477][106226] Updated weights for policy 0, policy_version 1878229 (0.0006) [2023-12-28 08:45:41,531][106225] Updated weights for policy 1, policy_version 1882182 (0.0009) [2023-12-28 08:45:41,535][106226] Updated weights for policy 0, policy_version 1878239 (0.0006) [2023-12-28 08:45:41,595][106225] Updated weights for policy 1, policy_version 1882192 (0.0007) [2023-12-28 08:45:41,660][106225] Updated weights for policy 1, policy_version 1882202 (0.0008) [2023-12-28 08:45:42,297][106226] Updated weights for policy 0, policy_version 1878249 (0.0006) [2023-12-28 08:45:42,366][106226] Updated weights for policy 0, policy_version 1878259 (0.0009) [2023-12-28 08:45:42,418][106225] Updated weights for policy 1, policy_version 1882212 (0.0009) [2023-12-28 08:45:42,428][106226] Updated weights for policy 0, policy_version 1878269 (0.0009) [2023-12-28 08:45:42,480][106225] Updated weights for policy 1, policy_version 1882222 (0.0010) [2023-12-28 08:45:42,483][106226] Updated weights for policy 0, policy_version 1878279 (0.0006) [2023-12-28 08:45:42,542][106225] Updated weights for policy 1, policy_version 1882232 (0.0011) [2023-12-28 08:45:43,115][106226] Updated weights for policy 0, policy_version 1878289 (0.0009) [2023-12-28 08:45:43,172][106226] Updated weights for policy 0, policy_version 1878299 (0.0007) [2023-12-28 08:45:43,229][106226] Updated weights for policy 0, policy_version 1878309 (0.0005) [2023-12-28 08:45:43,284][106225] Updated weights for policy 1, policy_version 1882242 (0.0007) [2023-12-28 08:45:43,341][106225] Updated weights for policy 1, policy_version 1882252 (0.0009) [2023-12-28 08:45:43,396][106225] Updated weights for policy 1, policy_version 1882262 (0.0008) [2023-12-28 08:45:43,455][106225] Updated weights for policy 1, policy_version 1882272 (0.0008) [2023-12-28 08:45:43,877][106226] Updated weights for policy 0, policy_version 1878319 (0.0007) [2023-12-28 08:45:43,926][106226] Updated weights for policy 0, policy_version 1878329 (0.0008) [2023-12-28 08:45:43,977][106226] Updated weights for policy 0, policy_version 1878339 (0.0008) [2023-12-28 08:45:44,163][106225] Updated weights for policy 1, policy_version 1882282 (0.0008) [2023-12-28 08:45:44,217][106225] Updated weights for policy 1, policy_version 1882292 (0.0008) [2023-12-28 08:45:44,266][106225] Updated weights for policy 1, policy_version 1882302 (0.0008) [2023-12-28 08:45:44,672][106226] Updated weights for policy 0, policy_version 1878349 (0.0007) [2023-12-28 08:45:44,743][106226] Updated weights for policy 0, policy_version 1878359 (0.0005) [2023-12-28 08:45:44,811][106226] Updated weights for policy 0, policy_version 1878369 (0.0009) [2023-12-28 08:45:44,991][106225] Updated weights for policy 1, policy_version 1882312 (0.0008) [2023-12-28 08:45:45,055][106225] Updated weights for policy 1, policy_version 1882322 (0.0008) [2023-12-28 08:45:45,119][106225] Updated weights for policy 1, policy_version 1882332 (0.0009) [2023-12-28 08:45:45,460][106226] Updated weights for policy 0, policy_version 1878379 (0.0008) [2023-12-28 08:45:45,510][106226] Updated weights for policy 0, policy_version 1878389 (0.0006) [2023-12-28 08:45:45,557][106226] Updated weights for policy 0, policy_version 1878399 (0.0008) [2023-12-28 08:45:45,932][106225] Updated weights for policy 1, policy_version 1882342 (0.0009) [2023-12-28 08:45:45,985][106225] Updated weights for policy 1, policy_version 1882352 (0.0009) [2023-12-28 08:45:46,039][106225] Updated weights for policy 1, policy_version 1882362 (0.0008) [2023-12-28 08:45:46,117][106226] Updated weights for policy 0, policy_version 1878409 (0.0006) [2023-12-28 08:45:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 962895872. Throughput: 0: 9710.2, 1: 9758.6. Samples: 962885696. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:46,175][105115] Avg episode reward: [(0, '-4.378'), (1, '-4.826')] [2023-12-28 08:45:46,180][106226] Updated weights for policy 0, policy_version 1878419 (0.0009) [2023-12-28 08:45:46,247][106226] Updated weights for policy 0, policy_version 1878429 (0.0008) [2023-12-28 08:45:46,307][106226] Updated weights for policy 0, policy_version 1878439 (0.0008) [2023-12-28 08:45:46,808][106225] Updated weights for policy 1, policy_version 1882372 (0.0009) [2023-12-28 08:45:46,873][106225] Updated weights for policy 1, policy_version 1882382 (0.0008) [2023-12-28 08:45:46,926][106225] Updated weights for policy 1, policy_version 1882392 (0.0007) [2023-12-28 08:45:46,962][106226] Updated weights for policy 0, policy_version 1878449 (0.0009) [2023-12-28 08:45:47,008][106226] Updated weights for policy 0, policy_version 1878459 (0.0007) [2023-12-28 08:45:47,063][106226] Updated weights for policy 0, policy_version 1878469 (0.0009) [2023-12-28 08:45:47,645][106225] Updated weights for policy 1, policy_version 1882402 (0.0007) [2023-12-28 08:45:47,693][106225] Updated weights for policy 1, policy_version 1882412 (0.0008) [2023-12-28 08:45:47,744][106225] Updated weights for policy 1, policy_version 1882422 (0.0008) [2023-12-28 08:45:47,797][106226] Updated weights for policy 0, policy_version 1878479 (0.0009) [2023-12-28 08:45:47,802][106225] Updated weights for policy 1, policy_version 1882432 (0.0006) [2023-12-28 08:45:47,854][106226] Updated weights for policy 0, policy_version 1878489 (0.0009) [2023-12-28 08:45:47,906][106226] Updated weights for policy 0, policy_version 1878499 (0.0009) [2023-12-28 08:45:48,525][106225] Updated weights for policy 1, policy_version 1882442 (0.0008) [2023-12-28 08:45:48,593][106225] Updated weights for policy 1, policy_version 1882452 (0.0008) [2023-12-28 08:45:48,655][106225] Updated weights for policy 1, policy_version 1882462 (0.0007) [2023-12-28 08:45:48,689][106226] Updated weights for policy 0, policy_version 1878509 (0.0008) [2023-12-28 08:45:48,748][106226] Updated weights for policy 0, policy_version 1878519 (0.0008) [2023-12-28 08:45:48,820][106226] Updated weights for policy 0, policy_version 1878529 (0.0008) [2023-12-28 08:45:49,298][106225] Updated weights for policy 1, policy_version 1882472 (0.0006) [2023-12-28 08:45:49,363][106225] Updated weights for policy 1, policy_version 1882482 (0.0009) [2023-12-28 08:45:49,416][106225] Updated weights for policy 1, policy_version 1882492 (0.0008) [2023-12-28 08:45:49,523][106226] Updated weights for policy 0, policy_version 1878539 (0.0008) [2023-12-28 08:45:49,593][106226] Updated weights for policy 0, policy_version 1878549 (0.0009) [2023-12-28 08:45:49,656][106226] Updated weights for policy 0, policy_version 1878559 (0.0009) [2023-12-28 08:45:50,156][106225] Updated weights for policy 1, policy_version 1882502 (0.0008) [2023-12-28 08:45:50,211][106225] Updated weights for policy 1, policy_version 1882512 (0.0008) [2023-12-28 08:45:50,271][106225] Updated weights for policy 1, policy_version 1882522 (0.0009) [2023-12-28 08:45:50,365][106226] Updated weights for policy 0, policy_version 1878569 (0.0009) [2023-12-28 08:45:50,432][106226] Updated weights for policy 0, policy_version 1878579 (0.0009) [2023-12-28 08:45:50,485][106226] Updated weights for policy 0, policy_version 1878589 (0.0008) [2023-12-28 08:45:50,538][106226] Updated weights for policy 0, policy_version 1878599 (0.0008) [2023-12-28 08:45:51,120][106225] Updated weights for policy 1, policy_version 1882532 (0.0008) [2023-12-28 08:45:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19387.7, 300 sec: 19744.1). Total num frames: 962985984. Throughput: 0: 9669.0, 1: 9711.5. Samples: 963002536. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:51,175][105115] Avg episode reward: [(0, '-4.235'), (1, '-4.413')] [2023-12-28 08:45:51,188][106225] Updated weights for policy 1, policy_version 1882542 (0.0008) [2023-12-28 08:45:51,193][106226] Updated weights for policy 0, policy_version 1878609 (0.0007) [2023-12-28 08:45:51,244][106225] Updated weights for policy 1, policy_version 1882552 (0.0008) [2023-12-28 08:45:51,254][106226] Updated weights for policy 0, policy_version 1878619 (0.0007) [2023-12-28 08:45:51,310][106226] Updated weights for policy 0, policy_version 1878629 (0.0008) [2023-12-28 08:45:51,939][106225] Updated weights for policy 1, policy_version 1882562 (0.0007) [2023-12-28 08:45:52,005][106225] Updated weights for policy 1, policy_version 1882572 (0.0008) [2023-12-28 08:45:52,064][106225] Updated weights for policy 1, policy_version 1882582 (0.0009) [2023-12-28 08:45:52,120][106226] Updated weights for policy 0, policy_version 1878639 (0.0006) [2023-12-28 08:45:52,127][106225] Updated weights for policy 1, policy_version 1882592 (0.0008) [2023-12-28 08:45:52,176][106226] Updated weights for policy 0, policy_version 1878649 (0.0005) [2023-12-28 08:45:52,230][106226] Updated weights for policy 0, policy_version 1878659 (0.0007) [2023-12-28 08:45:52,885][106225] Updated weights for policy 1, policy_version 1882602 (0.0008) [2023-12-28 08:45:52,915][106226] Updated weights for policy 0, policy_version 1878669 (0.0007) [2023-12-28 08:45:52,940][106225] Updated weights for policy 1, policy_version 1882612 (0.0008) [2023-12-28 08:45:52,976][106226] Updated weights for policy 0, policy_version 1878679 (0.0008) [2023-12-28 08:45:53,000][106225] Updated weights for policy 1, policy_version 1882622 (0.0006) [2023-12-28 08:45:53,026][106226] Updated weights for policy 0, policy_version 1878689 (0.0007) [2023-12-28 08:45:53,580][106225] Updated weights for policy 1, policy_version 1882632 (0.0007) [2023-12-28 08:45:53,631][106225] Updated weights for policy 1, policy_version 1882642 (0.0007) [2023-12-28 08:45:53,677][106225] Updated weights for policy 1, policy_version 1882652 (0.0005) [2023-12-28 08:45:53,838][106226] Updated weights for policy 0, policy_version 1878699 (0.0008) [2023-12-28 08:45:53,894][106226] Updated weights for policy 0, policy_version 1878709 (0.0006) [2023-12-28 08:45:53,953][106226] Updated weights for policy 0, policy_version 1878719 (0.0008) [2023-12-28 08:45:54,239][106225] Updated weights for policy 1, policy_version 1882662 (0.0006) [2023-12-28 08:45:54,304][106225] Updated weights for policy 1, policy_version 1882672 (0.0005) [2023-12-28 08:45:54,360][106225] Updated weights for policy 1, policy_version 1882682 (0.0005) [2023-12-28 08:45:54,606][106226] Updated weights for policy 0, policy_version 1878729 (0.0009) [2023-12-28 08:45:54,656][106226] Updated weights for policy 0, policy_version 1878739 (0.0010) [2023-12-28 08:45:54,706][106226] Updated weights for policy 0, policy_version 1878749 (0.0010) [2023-12-28 08:45:54,752][106226] Updated weights for policy 0, policy_version 1878759 (0.0010) [2023-12-28 08:45:54,927][106225] Updated weights for policy 1, policy_version 1882692 (0.0007) [2023-12-28 08:45:54,978][106225] Updated weights for policy 1, policy_version 1882702 (0.0007) [2023-12-28 08:45:55,037][106225] Updated weights for policy 1, policy_version 1882712 (0.0010) [2023-12-28 08:45:55,430][106226] Updated weights for policy 0, policy_version 1878769 (0.0010) [2023-12-28 08:45:55,489][106226] Updated weights for policy 0, policy_version 1878779 (0.0010) [2023-12-28 08:45:55,549][106226] Updated weights for policy 0, policy_version 1878789 (0.0010) [2023-12-28 08:45:55,755][106225] Updated weights for policy 1, policy_version 1882722 (0.0008) [2023-12-28 08:45:55,807][106225] Updated weights for policy 1, policy_version 1882732 (0.0008) [2023-12-28 08:45:55,856][106225] Updated weights for policy 1, policy_version 1882742 (0.0008) [2023-12-28 08:45:55,908][106225] Updated weights for policy 1, policy_version 1882752 (0.0008) [2023-12-28 08:45:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19771.9). Total num frames: 963092480. Throughput: 0: 9655.7, 1: 9748.9. Samples: 963060736. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:45:56,175][105115] Avg episode reward: [(0, '-4.186'), (1, '-4.684')] [2023-12-28 08:45:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001882752_482041856.pth... [2023-12-28 08:45:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001878792_481050624.pth... [2023-12-28 08:45:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001881568_481738752.pth [2023-12-28 08:45:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001877672_480763904.pth [2023-12-28 08:45:56,258][106226] Updated weights for policy 0, policy_version 1878799 (0.0011) [2023-12-28 08:45:56,311][106226] Updated weights for policy 0, policy_version 1878809 (0.0010) [2023-12-28 08:45:56,364][106226] Updated weights for policy 0, policy_version 1878819 (0.0010) [2023-12-28 08:45:56,589][106225] Updated weights for policy 1, policy_version 1882762 (0.0005) [2023-12-28 08:45:56,648][106225] Updated weights for policy 1, policy_version 1882772 (0.0006) [2023-12-28 08:45:56,696][106225] Updated weights for policy 1, policy_version 1882782 (0.0009) [2023-12-28 08:45:56,999][106226] Updated weights for policy 0, policy_version 1878829 (0.0008) [2023-12-28 08:45:57,052][106226] Updated weights for policy 0, policy_version 1878839 (0.0005) [2023-12-28 08:45:57,105][106226] Updated weights for policy 0, policy_version 1878849 (0.0005) [2023-12-28 08:45:57,221][106225] Updated weights for policy 1, policy_version 1882792 (0.0006) [2023-12-28 08:45:57,270][106225] Updated weights for policy 1, policy_version 1882802 (0.0005) [2023-12-28 08:45:57,334][106225] Updated weights for policy 1, policy_version 1882812 (0.0006) [2023-12-28 08:45:57,620][106226] Updated weights for policy 0, policy_version 1878859 (0.0006) [2023-12-28 08:45:57,673][106226] Updated weights for policy 0, policy_version 1878869 (0.0007) [2023-12-28 08:45:57,734][106226] Updated weights for policy 0, policy_version 1878879 (0.0005) [2023-12-28 08:45:57,920][106225] Updated weights for policy 1, policy_version 1882822 (0.0009) [2023-12-28 08:45:57,976][106225] Updated weights for policy 1, policy_version 1882832 (0.0010) [2023-12-28 08:45:58,030][106225] Updated weights for policy 1, policy_version 1882842 (0.0010) [2023-12-28 08:45:58,302][106226] Updated weights for policy 0, policy_version 1878889 (0.0005) [2023-12-28 08:45:58,378][106226] Updated weights for policy 0, policy_version 1878900 (0.0010) [2023-12-28 08:45:58,437][106226] Updated weights for policy 0, policy_version 1878910 (0.0008) [2023-12-28 08:45:58,503][106226] Updated weights for policy 0, policy_version 1878920 (0.0008) [2023-12-28 08:45:58,855][106225] Updated weights for policy 1, policy_version 1882852 (0.0009) [2023-12-28 08:45:58,923][106225] Updated weights for policy 1, policy_version 1882862 (0.0008) [2023-12-28 08:45:58,985][106225] Updated weights for policy 1, policy_version 1882872 (0.0008) [2023-12-28 08:45:59,273][106226] Updated weights for policy 0, policy_version 1878930 (0.0008) [2023-12-28 08:45:59,341][106226] Updated weights for policy 0, policy_version 1878940 (0.0008) [2023-12-28 08:45:59,407][106226] Updated weights for policy 0, policy_version 1878950 (0.0008) [2023-12-28 08:45:59,728][106225] Updated weights for policy 1, policy_version 1882882 (0.0009) [2023-12-28 08:45:59,780][106225] Updated weights for policy 1, policy_version 1882892 (0.0010) [2023-12-28 08:45:59,840][106225] Updated weights for policy 1, policy_version 1882902 (0.0010) [2023-12-28 08:45:59,900][106225] Updated weights for policy 1, policy_version 1882912 (0.0010) [2023-12-28 08:46:00,075][106226] Updated weights for policy 0, policy_version 1878960 (0.0008) [2023-12-28 08:46:00,137][106226] Updated weights for policy 0, policy_version 1878970 (0.0008) [2023-12-28 08:46:00,188][106226] Updated weights for policy 0, policy_version 1878980 (0.0008) [2023-12-28 08:46:00,605][106225] Updated weights for policy 1, policy_version 1882922 (0.0006) [2023-12-28 08:46:00,653][106225] Updated weights for policy 1, policy_version 1882932 (0.0007) [2023-12-28 08:46:00,704][106225] Updated weights for policy 1, policy_version 1882942 (0.0005) [2023-12-28 08:46:00,945][106226] Updated weights for policy 0, policy_version 1878990 (0.0010) [2023-12-28 08:46:01,007][106226] Updated weights for policy 0, policy_version 1879000 (0.0009) [2023-12-28 08:46:01,080][106226] Updated weights for policy 0, policy_version 1879010 (0.0008) [2023-12-28 08:46:01,175][105115] Fps is (10 sec: 21299.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 963198976. Throughput: 0: 9752.1, 1: 9907.9. Samples: 963187664. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:01,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.777')] [2023-12-28 08:46:01,385][106225] Updated weights for policy 1, policy_version 1882952 (0.0008) [2023-12-28 08:46:01,446][106225] Updated weights for policy 1, policy_version 1882962 (0.0010) [2023-12-28 08:46:01,499][106225] Updated weights for policy 1, policy_version 1882972 (0.0010) [2023-12-28 08:46:01,807][106226] Updated weights for policy 0, policy_version 1879020 (0.0007) [2023-12-28 08:46:01,862][106226] Updated weights for policy 0, policy_version 1879030 (0.0005) [2023-12-28 08:46:01,920][106226] Updated weights for policy 0, policy_version 1879040 (0.0005) [2023-12-28 08:46:02,249][106225] Updated weights for policy 1, policy_version 1882982 (0.0008) [2023-12-28 08:46:02,307][106225] Updated weights for policy 1, policy_version 1882992 (0.0008) [2023-12-28 08:46:02,363][106225] Updated weights for policy 1, policy_version 1883002 (0.0008) [2023-12-28 08:46:02,522][106226] Updated weights for policy 0, policy_version 1879050 (0.0006) [2023-12-28 08:46:02,572][106226] Updated weights for policy 0, policy_version 1879060 (0.0008) [2023-12-28 08:46:02,632][106226] Updated weights for policy 0, policy_version 1879070 (0.0007) [2023-12-28 08:46:02,692][106226] Updated weights for policy 0, policy_version 1879080 (0.0009) [2023-12-28 08:46:03,066][106225] Updated weights for policy 1, policy_version 1883012 (0.0008) [2023-12-28 08:46:03,114][106225] Updated weights for policy 1, policy_version 1883022 (0.0008) [2023-12-28 08:46:03,169][106225] Updated weights for policy 1, policy_version 1883032 (0.0008) [2023-12-28 08:46:03,413][106226] Updated weights for policy 0, policy_version 1879090 (0.0009) [2023-12-28 08:46:03,475][106226] Updated weights for policy 0, policy_version 1879100 (0.0006) [2023-12-28 08:46:03,536][106226] Updated weights for policy 0, policy_version 1879110 (0.0008) [2023-12-28 08:46:03,899][106225] Updated weights for policy 1, policy_version 1883042 (0.0008) [2023-12-28 08:46:03,966][106225] Updated weights for policy 1, policy_version 1883052 (0.0007) [2023-12-28 08:46:04,032][106225] Updated weights for policy 1, policy_version 1883062 (0.0008) [2023-12-28 08:46:04,097][106225] Updated weights for policy 1, policy_version 1883072 (0.0008) [2023-12-28 08:46:04,241][106226] Updated weights for policy 0, policy_version 1879120 (0.0008) [2023-12-28 08:46:04,302][106226] Updated weights for policy 0, policy_version 1879130 (0.0009) [2023-12-28 08:46:04,363][106226] Updated weights for policy 0, policy_version 1879140 (0.0009) [2023-12-28 08:46:04,780][106225] Updated weights for policy 1, policy_version 1883082 (0.0008) [2023-12-28 08:46:04,832][106225] Updated weights for policy 1, policy_version 1883092 (0.0008) [2023-12-28 08:46:04,876][106225] Updated weights for policy 1, policy_version 1883102 (0.0008) [2023-12-28 08:46:05,056][106226] Updated weights for policy 0, policy_version 1879150 (0.0008) [2023-12-28 08:46:05,116][106226] Updated weights for policy 0, policy_version 1879160 (0.0009) [2023-12-28 08:46:05,173][106226] Updated weights for policy 0, policy_version 1879170 (0.0008) [2023-12-28 08:46:05,653][106225] Updated weights for policy 1, policy_version 1883112 (0.0008) [2023-12-28 08:46:05,718][106225] Updated weights for policy 1, policy_version 1883122 (0.0008) [2023-12-28 08:46:05,773][106225] Updated weights for policy 1, policy_version 1883132 (0.0008) [2023-12-28 08:46:05,827][106226] Updated weights for policy 0, policy_version 1879180 (0.0008) [2023-12-28 08:46:05,888][106226] Updated weights for policy 0, policy_version 1879190 (0.0007) [2023-12-28 08:46:05,946][106226] Updated weights for policy 0, policy_version 1879200 (0.0008) [2023-12-28 08:46:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 963297280. Throughput: 0: 9841.3, 1: 9879.1. Samples: 963304504. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:06,175][105115] Avg episode reward: [(0, '-4.161'), (1, '-4.487')] [2023-12-28 08:46:06,465][106225] Updated weights for policy 1, policy_version 1883142 (0.0009) [2023-12-28 08:46:06,521][106225] Updated weights for policy 1, policy_version 1883152 (0.0009) [2023-12-28 08:46:06,585][106225] Updated weights for policy 1, policy_version 1883162 (0.0008) [2023-12-28 08:46:06,659][106226] Updated weights for policy 0, policy_version 1879210 (0.0008) [2023-12-28 08:46:06,719][106226] Updated weights for policy 0, policy_version 1879220 (0.0008) [2023-12-28 08:46:06,772][106226] Updated weights for policy 0, policy_version 1879230 (0.0007) [2023-12-28 08:46:06,832][106226] Updated weights for policy 0, policy_version 1879240 (0.0006) [2023-12-28 08:46:07,336][106225] Updated weights for policy 1, policy_version 1883172 (0.0007) [2023-12-28 08:46:07,385][106225] Updated weights for policy 1, policy_version 1883182 (0.0007) [2023-12-28 08:46:07,418][106226] Updated weights for policy 0, policy_version 1879250 (0.0008) [2023-12-28 08:46:07,446][106225] Updated weights for policy 1, policy_version 1883192 (0.0005) [2023-12-28 08:46:07,468][106226] Updated weights for policy 0, policy_version 1879260 (0.0008) [2023-12-28 08:46:07,523][106226] Updated weights for policy 0, policy_version 1879270 (0.0008) [2023-12-28 08:46:07,976][106225] Updated weights for policy 1, policy_version 1883202 (0.0006) [2023-12-28 08:46:08,043][106225] Updated weights for policy 1, policy_version 1883212 (0.0011) [2023-12-28 08:46:08,106][106225] Updated weights for policy 1, policy_version 1883222 (0.0010) [2023-12-28 08:46:08,173][106225] Updated weights for policy 1, policy_version 1883232 (0.0010) [2023-12-28 08:46:08,266][106226] Updated weights for policy 0, policy_version 1879280 (0.0008) [2023-12-28 08:46:08,325][106226] Updated weights for policy 0, policy_version 1879290 (0.0007) [2023-12-28 08:46:08,383][106226] Updated weights for policy 0, policy_version 1879300 (0.0008) [2023-12-28 08:46:08,919][106225] Updated weights for policy 1, policy_version 1883242 (0.0007) [2023-12-28 08:46:08,979][106225] Updated weights for policy 1, policy_version 1883252 (0.0008) [2023-12-28 08:46:09,033][106225] Updated weights for policy 1, policy_version 1883262 (0.0009) [2023-12-28 08:46:09,118][106226] Updated weights for policy 0, policy_version 1879310 (0.0007) [2023-12-28 08:46:09,168][106226] Updated weights for policy 0, policy_version 1879320 (0.0009) [2023-12-28 08:46:09,222][106226] Updated weights for policy 0, policy_version 1879330 (0.0010) [2023-12-28 08:46:09,784][106225] Updated weights for policy 1, policy_version 1883272 (0.0009) [2023-12-28 08:46:09,860][106225] Updated weights for policy 1, policy_version 1883282 (0.0007) [2023-12-28 08:46:09,922][106225] Updated weights for policy 1, policy_version 1883292 (0.0008) [2023-12-28 08:46:09,924][106226] Updated weights for policy 0, policy_version 1879340 (0.0008) [2023-12-28 08:46:09,990][106226] Updated weights for policy 0, policy_version 1879350 (0.0011) [2023-12-28 08:46:10,059][106226] Updated weights for policy 0, policy_version 1879360 (0.0011) [2023-12-28 08:46:10,547][106225] Updated weights for policy 1, policy_version 1883302 (0.0006) [2023-12-28 08:46:10,602][106225] Updated weights for policy 1, policy_version 1883312 (0.0005) [2023-12-28 08:46:10,658][106225] Updated weights for policy 1, policy_version 1883322 (0.0005) [2023-12-28 08:46:10,732][106226] Updated weights for policy 0, policy_version 1879370 (0.0010) [2023-12-28 08:46:10,802][106226] Updated weights for policy 0, policy_version 1879380 (0.0006) [2023-12-28 08:46:10,859][106226] Updated weights for policy 0, policy_version 1879390 (0.0006) [2023-12-28 08:46:10,920][106226] Updated weights for policy 0, policy_version 1879400 (0.0007) [2023-12-28 08:46:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 963395584. Throughput: 0: 9905.0, 1: 9961.1. Samples: 963365616. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:11,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.934')] [2023-12-28 08:46:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001883328_482189312.pth... [2023-12-28 08:46:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001879400_481206272.pth... [2023-12-28 08:46:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001878216_480903168.pth [2023-12-28 08:46:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001882176_481894400.pth [2023-12-28 08:46:11,428][106225] Updated weights for policy 1, policy_version 1883332 (0.0007) [2023-12-28 08:46:11,488][106225] Updated weights for policy 1, policy_version 1883342 (0.0009) [2023-12-28 08:46:11,552][106225] Updated weights for policy 1, policy_version 1883352 (0.0009) [2023-12-28 08:46:11,587][106226] Updated weights for policy 0, policy_version 1879410 (0.0007) [2023-12-28 08:46:11,659][106226] Updated weights for policy 0, policy_version 1879420 (0.0008) [2023-12-28 08:46:11,717][106226] Updated weights for policy 0, policy_version 1879430 (0.0009) [2023-12-28 08:46:12,316][106225] Updated weights for policy 1, policy_version 1883362 (0.0008) [2023-12-28 08:46:12,386][106225] Updated weights for policy 1, policy_version 1883372 (0.0007) [2023-12-28 08:46:12,413][106226] Updated weights for policy 0, policy_version 1879440 (0.0008) [2023-12-28 08:46:12,436][106225] Updated weights for policy 1, policy_version 1883382 (0.0005) [2023-12-28 08:46:12,467][106226] Updated weights for policy 0, policy_version 1879450 (0.0008) [2023-12-28 08:46:12,486][106225] Updated weights for policy 1, policy_version 1883392 (0.0005) [2023-12-28 08:46:12,526][106226] Updated weights for policy 0, policy_version 1879460 (0.0008) [2023-12-28 08:46:13,067][106225] Updated weights for policy 1, policy_version 1883402 (0.0007) [2023-12-28 08:46:13,124][106225] Updated weights for policy 1, policy_version 1883412 (0.0008) [2023-12-28 08:46:13,176][106225] Updated weights for policy 1, policy_version 1883422 (0.0007) [2023-12-28 08:46:13,278][106226] Updated weights for policy 0, policy_version 1879470 (0.0010) [2023-12-28 08:46:13,333][106226] Updated weights for policy 0, policy_version 1879480 (0.0010) [2023-12-28 08:46:13,386][106226] Updated weights for policy 0, policy_version 1879490 (0.0010) [2023-12-28 08:46:13,901][106225] Updated weights for policy 1, policy_version 1883432 (0.0008) [2023-12-28 08:46:13,951][106225] Updated weights for policy 1, policy_version 1883442 (0.0008) [2023-12-28 08:46:14,004][106225] Updated weights for policy 1, policy_version 1883452 (0.0008) [2023-12-28 08:46:14,109][106226] Updated weights for policy 0, policy_version 1879500 (0.0011) [2023-12-28 08:46:14,171][106226] Updated weights for policy 0, policy_version 1879510 (0.0011) [2023-12-28 08:46:14,232][106226] Updated weights for policy 0, policy_version 1879520 (0.0011) [2023-12-28 08:46:14,647][106225] Updated weights for policy 1, policy_version 1883462 (0.0007) [2023-12-28 08:46:14,705][106225] Updated weights for policy 1, policy_version 1883472 (0.0006) [2023-12-28 08:46:14,766][106225] Updated weights for policy 1, policy_version 1883482 (0.0006) [2023-12-28 08:46:14,820][106226] Updated weights for policy 0, policy_version 1879530 (0.0010) [2023-12-28 08:46:14,880][106226] Updated weights for policy 0, policy_version 1879540 (0.0009) [2023-12-28 08:46:14,944][106226] Updated weights for policy 0, policy_version 1879550 (0.0009) [2023-12-28 08:46:15,001][106226] Updated weights for policy 0, policy_version 1879560 (0.0008) [2023-12-28 08:46:15,479][106225] Updated weights for policy 1, policy_version 1883492 (0.0008) [2023-12-28 08:46:15,536][106225] Updated weights for policy 1, policy_version 1883502 (0.0008) [2023-12-28 08:46:15,586][106225] Updated weights for policy 1, policy_version 1883512 (0.0009) [2023-12-28 08:46:15,649][106226] Updated weights for policy 0, policy_version 1879570 (0.0008) [2023-12-28 08:46:15,701][106226] Updated weights for policy 0, policy_version 1879580 (0.0007) [2023-12-28 08:46:15,763][106226] Updated weights for policy 0, policy_version 1879590 (0.0006) [2023-12-28 08:46:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 963493888. Throughput: 0: 9867.3, 1: 9950.9. Samples: 963484460. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:16,175][105115] Avg episode reward: [(0, '-4.497'), (1, '-4.556')] [2023-12-28 08:46:16,362][106225] Updated weights for policy 1, policy_version 1883523 (0.0009) [2023-12-28 08:46:16,419][106225] Updated weights for policy 1, policy_version 1883533 (0.0008) [2023-12-28 08:46:16,438][106226] Updated weights for policy 0, policy_version 1879600 (0.0005) [2023-12-28 08:46:16,477][106225] Updated weights for policy 1, policy_version 1883543 (0.0009) [2023-12-28 08:46:16,501][106226] Updated weights for policy 0, policy_version 1879610 (0.0006) [2023-12-28 08:46:16,559][106226] Updated weights for policy 0, policy_version 1879620 (0.0006) [2023-12-28 08:46:17,171][106226] Updated weights for policy 0, policy_version 1879630 (0.0008) [2023-12-28 08:46:17,225][106226] Updated weights for policy 0, policy_version 1879640 (0.0009) [2023-12-28 08:46:17,247][106225] Updated weights for policy 1, policy_version 1883553 (0.0007) [2023-12-28 08:46:17,283][106226] Updated weights for policy 0, policy_version 1879650 (0.0010) [2023-12-28 08:46:17,312][106225] Updated weights for policy 1, policy_version 1883563 (0.0005) [2023-12-28 08:46:17,383][106225] Updated weights for policy 1, policy_version 1883573 (0.0005) [2023-12-28 08:46:17,449][106225] Updated weights for policy 1, policy_version 1883583 (0.0005) [2023-12-28 08:46:17,907][106226] Updated weights for policy 0, policy_version 1879660 (0.0007) [2023-12-28 08:46:17,971][106226] Updated weights for policy 0, policy_version 1879670 (0.0008) [2023-12-28 08:46:18,035][106226] Updated weights for policy 0, policy_version 1879680 (0.0007) [2023-12-28 08:46:18,141][106225] Updated weights for policy 1, policy_version 1883593 (0.0009) [2023-12-28 08:46:18,201][106225] Updated weights for policy 1, policy_version 1883603 (0.0007) [2023-12-28 08:46:18,261][106225] Updated weights for policy 1, policy_version 1883613 (0.0009) [2023-12-28 08:46:18,727][106226] Updated weights for policy 0, policy_version 1879690 (0.0008) [2023-12-28 08:46:18,792][106226] Updated weights for policy 0, policy_version 1879700 (0.0009) [2023-12-28 08:46:18,856][106226] Updated weights for policy 0, policy_version 1879710 (0.0008) [2023-12-28 08:46:18,919][106226] Updated weights for policy 0, policy_version 1879720 (0.0008) [2023-12-28 08:46:19,065][106225] Updated weights for policy 1, policy_version 1883623 (0.0008) [2023-12-28 08:46:19,129][106225] Updated weights for policy 1, policy_version 1883633 (0.0008) [2023-12-28 08:46:19,192][106225] Updated weights for policy 1, policy_version 1883643 (0.0009) [2023-12-28 08:46:19,673][106226] Updated weights for policy 0, policy_version 1879730 (0.0010) [2023-12-28 08:46:19,744][106226] Updated weights for policy 0, policy_version 1879740 (0.0009) [2023-12-28 08:46:19,804][106226] Updated weights for policy 0, policy_version 1879750 (0.0011) [2023-12-28 08:46:19,951][106225] Updated weights for policy 1, policy_version 1883653 (0.0008) [2023-12-28 08:46:20,014][106225] Updated weights for policy 1, policy_version 1883663 (0.0009) [2023-12-28 08:46:20,074][106225] Updated weights for policy 1, policy_version 1883673 (0.0007) [2023-12-28 08:46:20,543][106226] Updated weights for policy 0, policy_version 1879760 (0.0009) [2023-12-28 08:46:20,605][106226] Updated weights for policy 0, policy_version 1879770 (0.0008) [2023-12-28 08:46:20,669][106226] Updated weights for policy 0, policy_version 1879780 (0.0006) [2023-12-28 08:46:20,757][106225] Updated weights for policy 1, policy_version 1883683 (0.0007) [2023-12-28 08:46:20,819][106225] Updated weights for policy 1, policy_version 1883693 (0.0008) [2023-12-28 08:46:20,882][106225] Updated weights for policy 1, policy_version 1883703 (0.0005) [2023-12-28 08:46:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 963592192. Throughput: 0: 9954.2, 1: 9830.0. Samples: 963601140. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:21,175][105115] Avg episode reward: [(0, '-4.337'), (1, '-4.944')] [2023-12-28 08:46:21,396][106226] Updated weights for policy 0, policy_version 1879790 (0.0008) [2023-12-28 08:46:21,464][106226] Updated weights for policy 0, policy_version 1879800 (0.0006) [2023-12-28 08:46:21,522][106226] Updated weights for policy 0, policy_version 1879810 (0.0007) [2023-12-28 08:46:21,633][106225] Updated weights for policy 1, policy_version 1883713 (0.0006) [2023-12-28 08:46:21,701][106225] Updated weights for policy 1, policy_version 1883723 (0.0010) [2023-12-28 08:46:21,777][106225] Updated weights for policy 1, policy_version 1883733 (0.0011) [2023-12-28 08:46:21,843][106225] Updated weights for policy 1, policy_version 1883743 (0.0010) [2023-12-28 08:46:22,208][106226] Updated weights for policy 0, policy_version 1879820 (0.0008) [2023-12-28 08:46:22,269][106226] Updated weights for policy 0, policy_version 1879830 (0.0006) [2023-12-28 08:46:22,342][106226] Updated weights for policy 0, policy_version 1879840 (0.0007) [2023-12-28 08:46:22,599][106225] Updated weights for policy 1, policy_version 1883753 (0.0010) [2023-12-28 08:46:22,651][106225] Updated weights for policy 1, policy_version 1883763 (0.0010) [2023-12-28 08:46:22,716][106225] Updated weights for policy 1, policy_version 1883773 (0.0010) [2023-12-28 08:46:22,983][106226] Updated weights for policy 0, policy_version 1879850 (0.0009) [2023-12-28 08:46:23,039][106226] Updated weights for policy 0, policy_version 1879860 (0.0008) [2023-12-28 08:46:23,103][106226] Updated weights for policy 0, policy_version 1879870 (0.0008) [2023-12-28 08:46:23,153][106226] Updated weights for policy 0, policy_version 1879880 (0.0009) [2023-12-28 08:46:23,474][106225] Updated weights for policy 1, policy_version 1883783 (0.0009) [2023-12-28 08:46:23,538][106225] Updated weights for policy 1, policy_version 1883793 (0.0009) [2023-12-28 08:46:23,600][106225] Updated weights for policy 1, policy_version 1883803 (0.0009) [2023-12-28 08:46:23,739][106226] Updated weights for policy 0, policy_version 1879890 (0.0005) [2023-12-28 08:46:23,787][106226] Updated weights for policy 0, policy_version 1879900 (0.0005) [2023-12-28 08:46:23,854][106226] Updated weights for policy 0, policy_version 1879910 (0.0008) [2023-12-28 08:46:24,340][106225] Updated weights for policy 1, policy_version 1883813 (0.0009) [2023-12-28 08:46:24,396][106225] Updated weights for policy 1, policy_version 1883823 (0.0009) [2023-12-28 08:46:24,455][106225] Updated weights for policy 1, policy_version 1883833 (0.0009) [2023-12-28 08:46:24,479][106226] Updated weights for policy 0, policy_version 1879920 (0.0006) [2023-12-28 08:46:24,540][106226] Updated weights for policy 0, policy_version 1879930 (0.0008) [2023-12-28 08:46:24,604][106226] Updated weights for policy 0, policy_version 1879940 (0.0007) [2023-12-28 08:46:25,034][106225] Updated weights for policy 1, policy_version 1883843 (0.0007) [2023-12-28 08:46:25,084][106225] Updated weights for policy 1, policy_version 1883853 (0.0008) [2023-12-28 08:46:25,128][106225] Updated weights for policy 1, policy_version 1883863 (0.0008) [2023-12-28 08:46:25,214][106226] Updated weights for policy 0, policy_version 1879950 (0.0005) [2023-12-28 08:46:25,265][106226] Updated weights for policy 0, policy_version 1879960 (0.0005) [2023-12-28 08:46:25,315][106226] Updated weights for policy 0, policy_version 1879970 (0.0005) [2023-12-28 08:46:25,844][106225] Updated weights for policy 1, policy_version 1883873 (0.0009) [2023-12-28 08:46:25,875][106226] Updated weights for policy 0, policy_version 1879980 (0.0007) [2023-12-28 08:46:25,908][106225] Updated weights for policy 1, policy_version 1883883 (0.0005) [2023-12-28 08:46:25,939][106226] Updated weights for policy 0, policy_version 1879990 (0.0009) [2023-12-28 08:46:25,962][106225] Updated weights for policy 1, policy_version 1883893 (0.0005) [2023-12-28 08:46:25,992][106226] Updated weights for policy 0, policy_version 1880000 (0.0008) [2023-12-28 08:46:26,015][106225] Updated weights for policy 1, policy_version 1883903 (0.0005) [2023-12-28 08:46:26,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 963698688. Throughput: 0: 10028.0, 1: 9742.7. Samples: 963659588. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:26,175][105115] Avg episode reward: [(0, '-4.483'), (1, '-4.576')] [2023-12-28 08:46:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001883904_482336768.pth... [2023-12-28 08:46:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001880008_481361920.pth... [2023-12-28 08:46:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001882752_482041856.pth [2023-12-28 08:46:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001878792_481050624.pth [2023-12-28 08:46:26,542][106225] Updated weights for policy 1, policy_version 1883913 (0.0005) [2023-12-28 08:46:26,605][106225] Updated weights for policy 1, policy_version 1883923 (0.0007) [2023-12-28 08:46:26,662][106225] Updated weights for policy 1, policy_version 1883933 (0.0008) [2023-12-28 08:46:26,804][106226] Updated weights for policy 0, policy_version 1880010 (0.0008) [2023-12-28 08:46:26,852][106226] Updated weights for policy 0, policy_version 1880020 (0.0008) [2023-12-28 08:46:26,907][106226] Updated weights for policy 0, policy_version 1880030 (0.0008) [2023-12-28 08:46:26,966][106226] Updated weights for policy 0, policy_version 1880040 (0.0008) [2023-12-28 08:46:27,254][106225] Updated weights for policy 1, policy_version 1883943 (0.0008) [2023-12-28 08:46:27,298][106225] Updated weights for policy 1, policy_version 1883953 (0.0008) [2023-12-28 08:46:27,355][106225] Updated weights for policy 1, policy_version 1883963 (0.0008) [2023-12-28 08:46:27,732][106226] Updated weights for policy 0, policy_version 1880050 (0.0009) [2023-12-28 08:46:27,785][106226] Updated weights for policy 0, policy_version 1880060 (0.0008) [2023-12-28 08:46:27,849][106226] Updated weights for policy 0, policy_version 1880070 (0.0007) [2023-12-28 08:46:28,021][106225] Updated weights for policy 1, policy_version 1883973 (0.0007) [2023-12-28 08:46:28,070][106225] Updated weights for policy 1, policy_version 1883983 (0.0007) [2023-12-28 08:46:28,139][106225] Updated weights for policy 1, policy_version 1883993 (0.0008) [2023-12-28 08:46:28,558][106226] Updated weights for policy 0, policy_version 1880080 (0.0008) [2023-12-28 08:46:28,617][106226] Updated weights for policy 0, policy_version 1880090 (0.0009) [2023-12-28 08:46:28,673][106226] Updated weights for policy 0, policy_version 1880100 (0.0008) [2023-12-28 08:46:28,885][106225] Updated weights for policy 1, policy_version 1884003 (0.0009) [2023-12-28 08:46:28,943][106225] Updated weights for policy 1, policy_version 1884013 (0.0008) [2023-12-28 08:46:28,997][106225] Updated weights for policy 1, policy_version 1884023 (0.0008) [2023-12-28 08:46:29,307][106226] Updated weights for policy 0, policy_version 1880110 (0.0007) [2023-12-28 08:46:29,373][106226] Updated weights for policy 0, policy_version 1880120 (0.0008) [2023-12-28 08:46:29,432][106226] Updated weights for policy 0, policy_version 1880130 (0.0009) [2023-12-28 08:46:29,781][106225] Updated weights for policy 1, policy_version 1884033 (0.0007) [2023-12-28 08:46:29,845][106225] Updated weights for policy 1, policy_version 1884043 (0.0007) [2023-12-28 08:46:29,917][106225] Updated weights for policy 1, policy_version 1884053 (0.0008) [2023-12-28 08:46:29,978][106225] Updated weights for policy 1, policy_version 1884063 (0.0009) [2023-12-28 08:46:30,208][106226] Updated weights for policy 0, policy_version 1880140 (0.0009) [2023-12-28 08:46:30,268][106226] Updated weights for policy 0, policy_version 1880150 (0.0008) [2023-12-28 08:46:30,320][106226] Updated weights for policy 0, policy_version 1880160 (0.0008) [2023-12-28 08:46:30,734][106225] Updated weights for policy 1, policy_version 1884073 (0.0009) [2023-12-28 08:46:30,788][106225] Updated weights for policy 1, policy_version 1884083 (0.0009) [2023-12-28 08:46:30,840][106225] Updated weights for policy 1, policy_version 1884093 (0.0008) [2023-12-28 08:46:31,008][106226] Updated weights for policy 0, policy_version 1880170 (0.0008) [2023-12-28 08:46:31,100][106226] Updated weights for policy 0, policy_version 1880180 (0.0008) [2023-12-28 08:46:31,169][106226] Updated weights for policy 0, policy_version 1880190 (0.0008) [2023-12-28 08:46:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 963788800. Throughput: 0: 10071.0, 1: 9862.6. Samples: 963782708. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:31,175][105115] Avg episode reward: [(0, '-4.211'), (1, '-4.723')] [2023-12-28 08:46:31,223][106226] Updated weights for policy 0, policy_version 1880200 (0.0008) [2023-12-28 08:46:31,601][106225] Updated weights for policy 1, policy_version 1884103 (0.0009) [2023-12-28 08:46:31,671][106225] Updated weights for policy 1, policy_version 1884113 (0.0007) [2023-12-28 08:46:31,737][106225] Updated weights for policy 1, policy_version 1884123 (0.0008) [2023-12-28 08:46:31,883][106226] Updated weights for policy 0, policy_version 1880210 (0.0008) [2023-12-28 08:46:31,933][106226] Updated weights for policy 0, policy_version 1880220 (0.0009) [2023-12-28 08:46:31,986][106226] Updated weights for policy 0, policy_version 1880230 (0.0008) [2023-12-28 08:46:32,425][106225] Updated weights for policy 1, policy_version 1884133 (0.0007) [2023-12-28 08:46:32,474][106225] Updated weights for policy 1, policy_version 1884143 (0.0008) [2023-12-28 08:46:32,526][106225] Updated weights for policy 1, policy_version 1884153 (0.0008) [2023-12-28 08:46:32,748][106226] Updated weights for policy 0, policy_version 1880240 (0.0009) [2023-12-28 08:46:32,794][106226] Updated weights for policy 0, policy_version 1880250 (0.0008) [2023-12-28 08:46:32,848][106226] Updated weights for policy 0, policy_version 1880260 (0.0009) [2023-12-28 08:46:33,262][106225] Updated weights for policy 1, policy_version 1884163 (0.0009) [2023-12-28 08:46:33,316][106225] Updated weights for policy 1, policy_version 1884173 (0.0008) [2023-12-28 08:46:33,371][106225] Updated weights for policy 1, policy_version 1884183 (0.0008) [2023-12-28 08:46:33,630][106226] Updated weights for policy 0, policy_version 1880270 (0.0009) [2023-12-28 08:46:33,675][106226] Updated weights for policy 0, policy_version 1880280 (0.0008) [2023-12-28 08:46:33,737][106226] Updated weights for policy 0, policy_version 1880290 (0.0006) [2023-12-28 08:46:34,041][106225] Updated weights for policy 1, policy_version 1884193 (0.0008) [2023-12-28 08:46:34,107][106225] Updated weights for policy 1, policy_version 1884203 (0.0009) [2023-12-28 08:46:34,176][106225] Updated weights for policy 1, policy_version 1884213 (0.0009) [2023-12-28 08:46:34,235][106225] Updated weights for policy 1, policy_version 1884223 (0.0008) [2023-12-28 08:46:34,403][106226] Updated weights for policy 0, policy_version 1880300 (0.0008) [2023-12-28 08:46:34,460][106226] Updated weights for policy 0, policy_version 1880310 (0.0006) [2023-12-28 08:46:34,522][106226] Updated weights for policy 0, policy_version 1880320 (0.0006) [2023-12-28 08:46:34,895][106225] Updated weights for policy 1, policy_version 1884233 (0.0005) [2023-12-28 08:46:34,962][106225] Updated weights for policy 1, policy_version 1884243 (0.0006) [2023-12-28 08:46:35,021][106225] Updated weights for policy 1, policy_version 1884253 (0.0009) [2023-12-28 08:46:35,083][106226] Updated weights for policy 0, policy_version 1880330 (0.0006) [2023-12-28 08:46:35,145][106226] Updated weights for policy 0, policy_version 1880340 (0.0008) [2023-12-28 08:46:35,204][106226] Updated weights for policy 0, policy_version 1880350 (0.0006) [2023-12-28 08:46:35,263][106226] Updated weights for policy 0, policy_version 1880360 (0.0005) [2023-12-28 08:46:35,750][106225] Updated weights for policy 1, policy_version 1884263 (0.0007) [2023-12-28 08:46:35,804][106225] Updated weights for policy 1, policy_version 1884273 (0.0005) [2023-12-28 08:46:35,842][106226] Updated weights for policy 0, policy_version 1880370 (0.0008) [2023-12-28 08:46:35,858][106225] Updated weights for policy 1, policy_version 1884283 (0.0005) [2023-12-28 08:46:35,903][106226] Updated weights for policy 0, policy_version 1880380 (0.0009) [2023-12-28 08:46:35,961][106226] Updated weights for policy 0, policy_version 1880390 (0.0008) [2023-12-28 08:46:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 963895296. Throughput: 0: 10086.9, 1: 9889.7. Samples: 963901484. Policy #0 lag: (min: 21.0, avg: 35.4, max: 53.0) [2023-12-28 08:46:36,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.601')] [2023-12-28 08:46:36,498][106225] Updated weights for policy 1, policy_version 1884293 (0.0008) [2023-12-28 08:46:36,553][106225] Updated weights for policy 1, policy_version 1884303 (0.0010) [2023-12-28 08:46:36,607][106225] Updated weights for policy 1, policy_version 1884313 (0.0010) [2023-12-28 08:46:36,669][106226] Updated weights for policy 0, policy_version 1880400 (0.0008) [2023-12-28 08:46:36,717][106226] Updated weights for policy 0, policy_version 1880410 (0.0008) [2023-12-28 08:46:36,765][106226] Updated weights for policy 0, policy_version 1880420 (0.0008) [2023-12-28 08:46:37,332][106225] Updated weights for policy 1, policy_version 1884323 (0.0011) [2023-12-28 08:46:37,395][106225] Updated weights for policy 1, policy_version 1884333 (0.0010) [2023-12-28 08:46:37,452][106225] Updated weights for policy 1, policy_version 1884343 (0.0009) [2023-12-28 08:46:37,536][106226] Updated weights for policy 0, policy_version 1880430 (0.0008) [2023-12-28 08:46:37,583][106226] Updated weights for policy 0, policy_version 1880440 (0.0007) [2023-12-28 08:46:37,633][106226] Updated weights for policy 0, policy_version 1880450 (0.0008) [2023-12-28 08:46:38,157][106225] Updated weights for policy 1, policy_version 1884353 (0.0010) [2023-12-28 08:46:38,221][106225] Updated weights for policy 1, policy_version 1884363 (0.0009) [2023-12-28 08:46:38,285][106225] Updated weights for policy 1, policy_version 1884373 (0.0008) [2023-12-28 08:46:38,353][106225] Updated weights for policy 1, policy_version 1884383 (0.0011) [2023-12-28 08:46:38,376][106226] Updated weights for policy 0, policy_version 1880460 (0.0008) [2023-12-28 08:46:38,435][106226] Updated weights for policy 0, policy_version 1880470 (0.0007) [2023-12-28 08:46:38,491][106226] Updated weights for policy 0, policy_version 1880480 (0.0008) [2023-12-28 08:46:39,062][106225] Updated weights for policy 1, policy_version 1884393 (0.0010) [2023-12-28 08:46:39,120][106225] Updated weights for policy 1, policy_version 1884403 (0.0010) [2023-12-28 08:46:39,179][106225] Updated weights for policy 1, policy_version 1884413 (0.0008) [2023-12-28 08:46:39,211][106226] Updated weights for policy 0, policy_version 1880490 (0.0008) [2023-12-28 08:46:39,284][106226] Updated weights for policy 0, policy_version 1880500 (0.0008) [2023-12-28 08:46:39,370][106226] Updated weights for policy 0, policy_version 1880510 (0.0008) [2023-12-28 08:46:39,445][106226] Updated weights for policy 0, policy_version 1880520 (0.0008) [2023-12-28 08:46:39,986][106225] Updated weights for policy 1, policy_version 1884423 (0.0008) [2023-12-28 08:46:40,045][106225] Updated weights for policy 1, policy_version 1884433 (0.0008) [2023-12-28 08:46:40,095][106226] Updated weights for policy 0, policy_version 1880530 (0.0006) [2023-12-28 08:46:40,109][106225] Updated weights for policy 1, policy_version 1884443 (0.0008) [2023-12-28 08:46:40,154][106226] Updated weights for policy 0, policy_version 1880540 (0.0006) [2023-12-28 08:46:40,211][106226] Updated weights for policy 0, policy_version 1880550 (0.0006) [2023-12-28 08:46:40,865][106225] Updated weights for policy 1, policy_version 1884453 (0.0008) [2023-12-28 08:46:40,875][106226] Updated weights for policy 0, policy_version 1880560 (0.0008) [2023-12-28 08:46:40,919][106225] Updated weights for policy 1, policy_version 1884463 (0.0008) [2023-12-28 08:46:40,923][106226] Updated weights for policy 0, policy_version 1880570 (0.0008) [2023-12-28 08:46:40,972][106226] Updated weights for policy 0, policy_version 1880580 (0.0008) [2023-12-28 08:46:40,975][106225] Updated weights for policy 1, policy_version 1884473 (0.0007) [2023-12-28 08:46:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 963993600. Throughput: 0: 10089.9, 1: 9900.9. Samples: 963960320. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:46:41,175][105115] Avg episode reward: [(0, '-4.170'), (1, '-4.506')] [2023-12-28 08:46:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001884480_482484224.pth... [2023-12-28 08:46:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001880584_481509376.pth... [2023-12-28 08:46:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001883328_482189312.pth [2023-12-28 08:46:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001879400_481206272.pth [2023-12-28 08:46:41,821][106225] Updated weights for policy 1, policy_version 1884483 (0.0008) [2023-12-28 08:46:41,834][106226] Updated weights for policy 0, policy_version 1880590 (0.0006) [2023-12-28 08:46:41,885][106225] Updated weights for policy 1, policy_version 1884493 (0.0008) [2023-12-28 08:46:41,897][106226] Updated weights for policy 0, policy_version 1880600 (0.0007) [2023-12-28 08:46:41,945][106225] Updated weights for policy 1, policy_version 1884503 (0.0008) [2023-12-28 08:46:41,956][106226] Updated weights for policy 0, policy_version 1880610 (0.0007) [2023-12-28 08:46:42,697][106226] Updated weights for policy 0, policy_version 1880620 (0.0008) [2023-12-28 08:46:42,741][106225] Updated weights for policy 1, policy_version 1884513 (0.0008) [2023-12-28 08:46:42,751][106226] Updated weights for policy 0, policy_version 1880630 (0.0007) [2023-12-28 08:46:42,800][106225] Updated weights for policy 1, policy_version 1884523 (0.0007) [2023-12-28 08:46:42,811][106226] Updated weights for policy 0, policy_version 1880640 (0.0008) [2023-12-28 08:46:42,849][106225] Updated weights for policy 1, policy_version 1884533 (0.0008) [2023-12-28 08:46:42,902][106225] Updated weights for policy 1, policy_version 1884543 (0.0009) [2023-12-28 08:46:43,489][106226] Updated weights for policy 0, policy_version 1880650 (0.0007) [2023-12-28 08:46:43,553][106226] Updated weights for policy 0, policy_version 1880660 (0.0011) [2023-12-28 08:46:43,608][106225] Updated weights for policy 1, policy_version 1884553 (0.0008) [2023-12-28 08:46:43,615][106226] Updated weights for policy 0, policy_version 1880670 (0.0009) [2023-12-28 08:46:43,669][106225] Updated weights for policy 1, policy_version 1884563 (0.0008) [2023-12-28 08:46:43,678][106226] Updated weights for policy 0, policy_version 1880680 (0.0005) [2023-12-28 08:46:43,729][106225] Updated weights for policy 1, policy_version 1884573 (0.0008) [2023-12-28 08:46:44,360][106226] Updated weights for policy 0, policy_version 1880690 (0.0009) [2023-12-28 08:46:44,419][106226] Updated weights for policy 0, policy_version 1880700 (0.0008) [2023-12-28 08:46:44,446][106225] Updated weights for policy 1, policy_version 1884583 (0.0007) [2023-12-28 08:46:44,471][106226] Updated weights for policy 0, policy_version 1880710 (0.0008) [2023-12-28 08:46:44,503][106225] Updated weights for policy 1, policy_version 1884593 (0.0007) [2023-12-28 08:46:44,561][106225] Updated weights for policy 1, policy_version 1884603 (0.0008) [2023-12-28 08:46:45,178][106226] Updated weights for policy 0, policy_version 1880720 (0.0006) [2023-12-28 08:46:45,213][106225] Updated weights for policy 1, policy_version 1884613 (0.0007) [2023-12-28 08:46:45,236][106226] Updated weights for policy 0, policy_version 1880730 (0.0006) [2023-12-28 08:46:45,271][106225] Updated weights for policy 1, policy_version 1884623 (0.0007) [2023-12-28 08:46:45,306][106226] Updated weights for policy 0, policy_version 1880740 (0.0008) [2023-12-28 08:46:45,334][106225] Updated weights for policy 1, policy_version 1884633 (0.0007) [2023-12-28 08:46:45,938][106225] Updated weights for policy 1, policy_version 1884643 (0.0008) [2023-12-28 08:46:45,990][106225] Updated weights for policy 1, policy_version 1884653 (0.0007) [2023-12-28 08:46:46,003][106226] Updated weights for policy 0, policy_version 1880750 (0.0007) [2023-12-28 08:46:46,044][106225] Updated weights for policy 1, policy_version 1884663 (0.0006) [2023-12-28 08:46:46,057][106226] Updated weights for policy 0, policy_version 1880760 (0.0006) [2023-12-28 08:46:46,117][106226] Updated weights for policy 0, policy_version 1880770 (0.0007) [2023-12-28 08:46:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 964091904. Throughput: 0: 9975.5, 1: 9711.7. Samples: 964073592. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:46:46,176][105115] Avg episode reward: [(0, '-4.427'), (1, '-4.726')] [2023-12-28 08:46:46,686][106225] Updated weights for policy 1, policy_version 1884673 (0.0008) [2023-12-28 08:46:46,753][106225] Updated weights for policy 1, policy_version 1884683 (0.0010) [2023-12-28 08:46:46,803][106225] Updated weights for policy 1, policy_version 1884693 (0.0010) [2023-12-28 08:46:46,853][106225] Updated weights for policy 1, policy_version 1884703 (0.0010) [2023-12-28 08:46:46,861][106226] Updated weights for policy 0, policy_version 1880780 (0.0010) [2023-12-28 08:46:46,919][106226] Updated weights for policy 0, policy_version 1880790 (0.0007) [2023-12-28 08:46:46,990][106226] Updated weights for policy 0, policy_version 1880800 (0.0008) [2023-12-28 08:46:47,463][106225] Updated weights for policy 1, policy_version 1884713 (0.0009) [2023-12-28 08:46:47,516][106225] Updated weights for policy 1, policy_version 1884723 (0.0007) [2023-12-28 08:46:47,567][106225] Updated weights for policy 1, policy_version 1884733 (0.0008) [2023-12-28 08:46:47,777][106226] Updated weights for policy 0, policy_version 1880810 (0.0008) [2023-12-28 08:46:47,831][106226] Updated weights for policy 0, policy_version 1880820 (0.0008) [2023-12-28 08:46:47,876][106226] Updated weights for policy 0, policy_version 1880830 (0.0008) [2023-12-28 08:46:47,929][106226] Updated weights for policy 0, policy_version 1880840 (0.0009) [2023-12-28 08:46:48,208][106225] Updated weights for policy 1, policy_version 1884743 (0.0008) [2023-12-28 08:46:48,264][106225] Updated weights for policy 1, policy_version 1884753 (0.0006) [2023-12-28 08:46:48,339][106225] Updated weights for policy 1, policy_version 1884763 (0.0008) [2023-12-28 08:46:48,752][106226] Updated weights for policy 0, policy_version 1880850 (0.0008) [2023-12-28 08:46:48,816][106226] Updated weights for policy 0, policy_version 1880860 (0.0008) [2023-12-28 08:46:48,879][106226] Updated weights for policy 0, policy_version 1880870 (0.0008) [2023-12-28 08:46:48,999][106225] Updated weights for policy 1, policy_version 1884773 (0.0008) [2023-12-28 08:46:49,059][106225] Updated weights for policy 1, policy_version 1884783 (0.0009) [2023-12-28 08:46:49,125][106225] Updated weights for policy 1, policy_version 1884793 (0.0007) [2023-12-28 08:46:49,721][106226] Updated weights for policy 0, policy_version 1880880 (0.0009) [2023-12-28 08:46:49,782][106226] Updated weights for policy 0, policy_version 1880890 (0.0009) [2023-12-28 08:46:49,816][106225] Updated weights for policy 1, policy_version 1884803 (0.0007) [2023-12-28 08:46:49,856][106226] Updated weights for policy 0, policy_version 1880900 (0.0008) [2023-12-28 08:46:49,882][106225] Updated weights for policy 1, policy_version 1884813 (0.0008) [2023-12-28 08:46:49,951][106225] Updated weights for policy 1, policy_version 1884823 (0.0007) [2023-12-28 08:46:50,616][106225] Updated weights for policy 1, policy_version 1884833 (0.0008) [2023-12-28 08:46:50,620][106226] Updated weights for policy 0, policy_version 1880910 (0.0008) [2023-12-28 08:46:50,672][106225] Updated weights for policy 1, policy_version 1884843 (0.0006) [2023-12-28 08:46:50,678][106226] Updated weights for policy 0, policy_version 1880920 (0.0008) [2023-12-28 08:46:50,726][106225] Updated weights for policy 1, policy_version 1884853 (0.0006) [2023-12-28 08:46:50,740][106226] Updated weights for policy 0, policy_version 1880930 (0.0008) [2023-12-28 08:46:50,786][106225] Updated weights for policy 1, policy_version 1884863 (0.0008) [2023-12-28 08:46:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19716.3). Total num frames: 964182016. Throughput: 0: 9883.0, 1: 9838.2. Samples: 964191960. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:46:51,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.453')] [2023-12-28 08:46:51,459][106226] Updated weights for policy 0, policy_version 1880940 (0.0008) [2023-12-28 08:46:51,518][106226] Updated weights for policy 0, policy_version 1880950 (0.0006) [2023-12-28 08:46:51,524][106225] Updated weights for policy 1, policy_version 1884873 (0.0008) [2023-12-28 08:46:51,572][106226] Updated weights for policy 0, policy_version 1880960 (0.0006) [2023-12-28 08:46:51,583][106225] Updated weights for policy 1, policy_version 1884883 (0.0008) [2023-12-28 08:46:51,650][106225] Updated weights for policy 1, policy_version 1884893 (0.0007) [2023-12-28 08:46:52,247][106226] Updated weights for policy 0, policy_version 1880970 (0.0008) [2023-12-28 08:46:52,320][106226] Updated weights for policy 0, policy_version 1880980 (0.0007) [2023-12-28 08:46:52,326][106225] Updated weights for policy 1, policy_version 1884903 (0.0007) [2023-12-28 08:46:52,390][106226] Updated weights for policy 0, policy_version 1880990 (0.0008) [2023-12-28 08:46:52,393][106225] Updated weights for policy 1, policy_version 1884913 (0.0007) [2023-12-28 08:46:52,455][106226] Updated weights for policy 0, policy_version 1881000 (0.0007) [2023-12-28 08:46:52,464][106225] Updated weights for policy 1, policy_version 1884923 (0.0009) [2023-12-28 08:46:53,137][106225] Updated weights for policy 1, policy_version 1884933 (0.0007) [2023-12-28 08:46:53,182][106226] Updated weights for policy 0, policy_version 1881010 (0.0008) [2023-12-28 08:46:53,183][106225] Updated weights for policy 1, policy_version 1884943 (0.0005) [2023-12-28 08:46:53,227][106225] Updated weights for policy 1, policy_version 1884953 (0.0005) [2023-12-28 08:46:53,242][106226] Updated weights for policy 0, policy_version 1881020 (0.0008) [2023-12-28 08:46:53,294][106226] Updated weights for policy 0, policy_version 1881030 (0.0009) [2023-12-28 08:46:53,856][106225] Updated weights for policy 1, policy_version 1884963 (0.0006) [2023-12-28 08:46:53,909][106225] Updated weights for policy 1, policy_version 1884973 (0.0008) [2023-12-28 08:46:53,957][106225] Updated weights for policy 1, policy_version 1884983 (0.0008) [2023-12-28 08:46:54,068][106226] Updated weights for policy 0, policy_version 1881040 (0.0008) [2023-12-28 08:46:54,120][106226] Updated weights for policy 0, policy_version 1881050 (0.0008) [2023-12-28 08:46:54,177][106226] Updated weights for policy 0, policy_version 1881060 (0.0009) [2023-12-28 08:46:54,646][106225] Updated weights for policy 1, policy_version 1884993 (0.0008) [2023-12-28 08:46:54,697][106225] Updated weights for policy 1, policy_version 1885003 (0.0008) [2023-12-28 08:46:54,757][106225] Updated weights for policy 1, policy_version 1885013 (0.0008) [2023-12-28 08:46:54,805][106225] Updated weights for policy 1, policy_version 1885023 (0.0008) [2023-12-28 08:46:54,942][106226] Updated weights for policy 0, policy_version 1881070 (0.0009) [2023-12-28 08:46:55,009][106226] Updated weights for policy 0, policy_version 1881080 (0.0009) [2023-12-28 08:46:55,063][106226] Updated weights for policy 0, policy_version 1881090 (0.0009) [2023-12-28 08:46:55,469][106225] Updated weights for policy 1, policy_version 1885033 (0.0010) [2023-12-28 08:46:55,528][106225] Updated weights for policy 1, policy_version 1885043 (0.0006) [2023-12-28 08:46:55,586][106225] Updated weights for policy 1, policy_version 1885053 (0.0005) [2023-12-28 08:46:55,857][106226] Updated weights for policy 0, policy_version 1881100 (0.0009) [2023-12-28 08:46:55,914][106226] Updated weights for policy 0, policy_version 1881110 (0.0009) [2023-12-28 08:46:55,968][106226] Updated weights for policy 0, policy_version 1881120 (0.0008) [2023-12-28 08:46:56,175][105115] Fps is (10 sec: 18841.9, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 964280320. Throughput: 0: 9843.8, 1: 9835.0. Samples: 964251156. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:46:56,175][105115] Avg episode reward: [(0, '-4.114'), (1, '-4.507')] [2023-12-28 08:46:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001881128_481648640.pth... [2023-12-28 08:46:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001880008_481361920.pth [2023-12-28 08:46:56,188][106225] Updated weights for policy 1, policy_version 1885063 (0.0009) [2023-12-28 08:46:56,236][106225] Updated weights for policy 1, policy_version 1885073 (0.0010) [2023-12-28 08:46:56,287][106225] Updated weights for policy 1, policy_version 1885083 (0.0005) [2023-12-28 08:46:56,307][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001885088_482639872.pth... [2023-12-28 08:46:56,310][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001883904_482336768.pth [2023-12-28 08:46:56,731][106226] Updated weights for policy 0, policy_version 1881130 (0.0008) [2023-12-28 08:46:56,787][106226] Updated weights for policy 0, policy_version 1881140 (0.0009) [2023-12-28 08:46:56,841][106226] Updated weights for policy 0, policy_version 1881150 (0.0009) [2023-12-28 08:46:56,904][106226] Updated weights for policy 0, policy_version 1881160 (0.0009) [2023-12-28 08:46:56,931][106225] Updated weights for policy 1, policy_version 1885093 (0.0005) [2023-12-28 08:46:56,976][106225] Updated weights for policy 1, policy_version 1885103 (0.0007) [2023-12-28 08:46:57,030][106225] Updated weights for policy 1, policy_version 1885113 (0.0008) [2023-12-28 08:46:57,622][106225] Updated weights for policy 1, policy_version 1885123 (0.0009) [2023-12-28 08:46:57,678][106225] Updated weights for policy 1, policy_version 1885133 (0.0006) [2023-12-28 08:46:57,691][106226] Updated weights for policy 0, policy_version 1881170 (0.0006) [2023-12-28 08:46:57,732][106225] Updated weights for policy 1, policy_version 1885143 (0.0006) [2023-12-28 08:46:57,745][106226] Updated weights for policy 0, policy_version 1881180 (0.0008) [2023-12-28 08:46:57,798][106226] Updated weights for policy 0, policy_version 1881190 (0.0007) [2023-12-28 08:46:58,366][106225] Updated weights for policy 1, policy_version 1885153 (0.0006) [2023-12-28 08:46:58,431][106225] Updated weights for policy 1, policy_version 1885163 (0.0009) [2023-12-28 08:46:58,497][106225] Updated weights for policy 1, policy_version 1885173 (0.0007) [2023-12-28 08:46:58,563][106225] Updated weights for policy 1, policy_version 1885183 (0.0007) [2023-12-28 08:46:58,599][106226] Updated weights for policy 0, policy_version 1881200 (0.0008) [2023-12-28 08:46:58,657][106226] Updated weights for policy 0, policy_version 1881210 (0.0008) [2023-12-28 08:46:58,719][106226] Updated weights for policy 0, policy_version 1881220 (0.0008) [2023-12-28 08:46:59,393][106225] Updated weights for policy 1, policy_version 1885193 (0.0009) [2023-12-28 08:46:59,452][106225] Updated weights for policy 1, policy_version 1885203 (0.0007) [2023-12-28 08:46:59,511][106225] Updated weights for policy 1, policy_version 1885213 (0.0005) [2023-12-28 08:46:59,616][106226] Updated weights for policy 0, policy_version 1881230 (0.0008) [2023-12-28 08:46:59,665][106226] Updated weights for policy 0, policy_version 1881240 (0.0008) [2023-12-28 08:46:59,712][106226] Updated weights for policy 0, policy_version 1881250 (0.0009) [2023-12-28 08:47:00,195][106225] Updated weights for policy 1, policy_version 1885223 (0.0008) [2023-12-28 08:47:00,254][106225] Updated weights for policy 1, policy_version 1885233 (0.0007) [2023-12-28 08:47:00,321][106225] Updated weights for policy 1, policy_version 1885243 (0.0006) [2023-12-28 08:47:00,496][106226] Updated weights for policy 0, policy_version 1881260 (0.0008) [2023-12-28 08:47:00,560][106226] Updated weights for policy 0, policy_version 1881270 (0.0008) [2023-12-28 08:47:00,627][106226] Updated weights for policy 0, policy_version 1881280 (0.0009) [2023-12-28 08:47:00,966][106225] Updated weights for policy 1, policy_version 1885253 (0.0006) [2023-12-28 08:47:01,015][106225] Updated weights for policy 1, policy_version 1885263 (0.0007) [2023-12-28 08:47:01,076][106225] Updated weights for policy 1, policy_version 1885273 (0.0008) [2023-12-28 08:47:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 964378624. Throughput: 0: 9700.6, 1: 9892.8. Samples: 964366164. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:01,175][105115] Avg episode reward: [(0, '-4.271'), (1, '-4.967')] [2023-12-28 08:47:01,373][106226] Updated weights for policy 0, policy_version 1881290 (0.0009) [2023-12-28 08:47:01,440][106226] Updated weights for policy 0, policy_version 1881300 (0.0009) [2023-12-28 08:47:01,500][106226] Updated weights for policy 0, policy_version 1881310 (0.0008) [2023-12-28 08:47:01,562][106226] Updated weights for policy 0, policy_version 1881320 (0.0009) [2023-12-28 08:47:01,811][106225] Updated weights for policy 1, policy_version 1885283 (0.0008) [2023-12-28 08:47:01,872][106225] Updated weights for policy 1, policy_version 1885293 (0.0006) [2023-12-28 08:47:01,928][106225] Updated weights for policy 1, policy_version 1885303 (0.0007) [2023-12-28 08:47:02,324][106226] Updated weights for policy 0, policy_version 1881330 (0.0007) [2023-12-28 08:47:02,386][106226] Updated weights for policy 0, policy_version 1881340 (0.0008) [2023-12-28 08:47:02,439][106226] Updated weights for policy 0, policy_version 1881350 (0.0008) [2023-12-28 08:47:02,651][106225] Updated weights for policy 1, policy_version 1885313 (0.0007) [2023-12-28 08:47:02,710][106225] Updated weights for policy 1, policy_version 1885323 (0.0007) [2023-12-28 08:47:02,779][106225] Updated weights for policy 1, policy_version 1885333 (0.0009) [2023-12-28 08:47:02,849][106225] Updated weights for policy 1, policy_version 1885343 (0.0010) [2023-12-28 08:47:03,018][106226] Updated weights for policy 0, policy_version 1881360 (0.0006) [2023-12-28 08:47:03,070][106226] Updated weights for policy 0, policy_version 1881370 (0.0005) [2023-12-28 08:47:03,117][106226] Updated weights for policy 0, policy_version 1881380 (0.0005) [2023-12-28 08:47:03,570][106225] Updated weights for policy 1, policy_version 1885353 (0.0005) [2023-12-28 08:47:03,638][106225] Updated weights for policy 1, policy_version 1885363 (0.0006) [2023-12-28 08:47:03,662][106226] Updated weights for policy 0, policy_version 1881390 (0.0005) [2023-12-28 08:47:03,689][106225] Updated weights for policy 1, policy_version 1885373 (0.0005) [2023-12-28 08:47:03,721][106226] Updated weights for policy 0, policy_version 1881400 (0.0005) [2023-12-28 08:47:03,777][106226] Updated weights for policy 0, policy_version 1881410 (0.0005) [2023-12-28 08:47:04,367][106225] Updated weights for policy 1, policy_version 1885383 (0.0008) [2023-12-28 08:47:04,430][106225] Updated weights for policy 1, policy_version 1885393 (0.0008) [2023-12-28 08:47:04,449][106226] Updated weights for policy 0, policy_version 1881420 (0.0007) [2023-12-28 08:47:04,487][106225] Updated weights for policy 1, policy_version 1885403 (0.0006) [2023-12-28 08:47:04,509][106226] Updated weights for policy 0, policy_version 1881430 (0.0007) [2023-12-28 08:47:04,567][106226] Updated weights for policy 0, policy_version 1881440 (0.0008) [2023-12-28 08:47:05,230][106225] Updated weights for policy 1, policy_version 1885413 (0.0007) [2023-12-28 08:47:05,277][106226] Updated weights for policy 0, policy_version 1881450 (0.0008) [2023-12-28 08:47:05,278][106225] Updated weights for policy 1, policy_version 1885423 (0.0009) [2023-12-28 08:47:05,328][106225] Updated weights for policy 1, policy_version 1885433 (0.0008) [2023-12-28 08:47:05,339][106226] Updated weights for policy 0, policy_version 1881460 (0.0005) [2023-12-28 08:47:05,395][106226] Updated weights for policy 0, policy_version 1881470 (0.0007) [2023-12-28 08:47:05,458][106226] Updated weights for policy 0, policy_version 1881480 (0.0008) [2023-12-28 08:47:05,999][106225] Updated weights for policy 1, policy_version 1885443 (0.0007) [2023-12-28 08:47:06,002][106226] Updated weights for policy 0, policy_version 1881490 (0.0007) [2023-12-28 08:47:06,052][106225] Updated weights for policy 1, policy_version 1885453 (0.0010) [2023-12-28 08:47:06,060][106226] Updated weights for policy 0, policy_version 1881500 (0.0006) [2023-12-28 08:47:06,103][106225] Updated weights for policy 1, policy_version 1885463 (0.0010) [2023-12-28 08:47:06,110][106226] Updated weights for policy 0, policy_version 1881510 (0.0009) [2023-12-28 08:47:06,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 964485120. Throughput: 0: 9734.8, 1: 9961.9. Samples: 964487488. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:06,175][105115] Avg episode reward: [(0, '-4.052'), (1, '-4.578')] [2023-12-28 08:47:06,866][106226] Updated weights for policy 0, policy_version 1881520 (0.0008) [2023-12-28 08:47:06,869][106225] Updated weights for policy 1, policy_version 1885473 (0.0009) [2023-12-28 08:47:06,915][106226] Updated weights for policy 0, policy_version 1881530 (0.0005) [2023-12-28 08:47:06,917][106225] Updated weights for policy 1, policy_version 1885483 (0.0010) [2023-12-28 08:47:06,972][106225] Updated weights for policy 1, policy_version 1885493 (0.0010) [2023-12-28 08:47:06,973][106226] Updated weights for policy 0, policy_version 1881540 (0.0006) [2023-12-28 08:47:07,029][106225] Updated weights for policy 1, policy_version 1885503 (0.0010) [2023-12-28 08:47:07,719][106226] Updated weights for policy 0, policy_version 1881550 (0.0007) [2023-12-28 08:47:07,763][106226] Updated weights for policy 0, policy_version 1881560 (0.0006) [2023-12-28 08:47:07,767][106225] Updated weights for policy 1, policy_version 1885513 (0.0009) [2023-12-28 08:47:07,821][106226] Updated weights for policy 0, policy_version 1881570 (0.0008) [2023-12-28 08:47:07,825][106225] Updated weights for policy 1, policy_version 1885523 (0.0006) [2023-12-28 08:47:07,877][106225] Updated weights for policy 1, policy_version 1885533 (0.0005) [2023-12-28 08:47:08,501][106225] Updated weights for policy 1, policy_version 1885543 (0.0005) [2023-12-28 08:47:08,562][106225] Updated weights for policy 1, policy_version 1885553 (0.0007) [2023-12-28 08:47:08,633][106225] Updated weights for policy 1, policy_version 1885563 (0.0007) [2023-12-28 08:47:08,661][106226] Updated weights for policy 0, policy_version 1881580 (0.0009) [2023-12-28 08:47:08,719][106226] Updated weights for policy 0, policy_version 1881590 (0.0009) [2023-12-28 08:47:08,775][106226] Updated weights for policy 0, policy_version 1881600 (0.0009) [2023-12-28 08:47:09,309][106225] Updated weights for policy 1, policy_version 1885573 (0.0009) [2023-12-28 08:47:09,376][106225] Updated weights for policy 1, policy_version 1885583 (0.0008) [2023-12-28 08:47:09,448][106225] Updated weights for policy 1, policy_version 1885593 (0.0009) [2023-12-28 08:47:09,518][106226] Updated weights for policy 0, policy_version 1881610 (0.0008) [2023-12-28 08:47:09,572][106226] Updated weights for policy 0, policy_version 1881620 (0.0006) [2023-12-28 08:47:09,625][106226] Updated weights for policy 0, policy_version 1881630 (0.0009) [2023-12-28 08:47:09,693][106226] Updated weights for policy 0, policy_version 1881640 (0.0009) [2023-12-28 08:47:10,231][106225] Updated weights for policy 1, policy_version 1885603 (0.0010) [2023-12-28 08:47:10,296][106225] Updated weights for policy 1, policy_version 1885613 (0.0009) [2023-12-28 08:47:10,358][106225] Updated weights for policy 1, policy_version 1885623 (0.0008) [2023-12-28 08:47:10,461][106226] Updated weights for policy 0, policy_version 1881650 (0.0009) [2023-12-28 08:47:10,514][106226] Updated weights for policy 0, policy_version 1881660 (0.0009) [2023-12-28 08:47:10,570][106226] Updated weights for policy 0, policy_version 1881670 (0.0008) [2023-12-28 08:47:11,102][106225] Updated weights for policy 1, policy_version 1885633 (0.0009) [2023-12-28 08:47:11,172][106225] Updated weights for policy 1, policy_version 1885643 (0.0008) [2023-12-28 08:47:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 964567040. Throughput: 0: 9648.8, 1: 10021.0. Samples: 964544732. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:11,175][105115] Avg episode reward: [(0, '-4.439'), (1, '-4.642')] [2023-12-28 08:47:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001881672_481787904.pth... [2023-12-28 08:47:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001880584_481509376.pth [2023-12-28 08:47:11,238][106225] Updated weights for policy 1, policy_version 1885653 (0.0006) [2023-12-28 08:47:11,307][106225] Updated weights for policy 1, policy_version 1885663 (0.0009) [2023-12-28 08:47:11,314][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001885664_482787328.pth... [2023-12-28 08:47:11,318][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001884480_482484224.pth [2023-12-28 08:47:11,347][106226] Updated weights for policy 0, policy_version 1881680 (0.0007) [2023-12-28 08:47:11,426][106226] Updated weights for policy 0, policy_version 1881690 (0.0008) [2023-12-28 08:47:11,494][106226] Updated weights for policy 0, policy_version 1881700 (0.0006) [2023-12-28 08:47:11,987][106225] Updated weights for policy 1, policy_version 1885673 (0.0008) [2023-12-28 08:47:12,037][106225] Updated weights for policy 1, policy_version 1885683 (0.0008) [2023-12-28 08:47:12,101][106225] Updated weights for policy 1, policy_version 1885693 (0.0009) [2023-12-28 08:47:12,146][106226] Updated weights for policy 0, policy_version 1881710 (0.0008) [2023-12-28 08:47:12,206][106226] Updated weights for policy 0, policy_version 1881720 (0.0009) [2023-12-28 08:47:12,274][106226] Updated weights for policy 0, policy_version 1881730 (0.0008) [2023-12-28 08:47:12,849][106225] Updated weights for policy 1, policy_version 1885703 (0.0007) [2023-12-28 08:47:12,919][106225] Updated weights for policy 1, policy_version 1885713 (0.0005) [2023-12-28 08:47:12,980][106225] Updated weights for policy 1, policy_version 1885723 (0.0005) [2023-12-28 08:47:13,043][106226] Updated weights for policy 0, policy_version 1881740 (0.0009) [2023-12-28 08:47:13,098][106226] Updated weights for policy 0, policy_version 1881750 (0.0008) [2023-12-28 08:47:13,142][106226] Updated weights for policy 0, policy_version 1881760 (0.0007) [2023-12-28 08:47:13,587][106225] Updated weights for policy 1, policy_version 1885733 (0.0006) [2023-12-28 08:47:13,639][106225] Updated weights for policy 1, policy_version 1885743 (0.0006) [2023-12-28 08:47:13,693][106225] Updated weights for policy 1, policy_version 1885753 (0.0005) [2023-12-28 08:47:13,743][106226] Updated weights for policy 0, policy_version 1881770 (0.0005) [2023-12-28 08:47:13,792][106226] Updated weights for policy 0, policy_version 1881780 (0.0005) [2023-12-28 08:47:13,841][106226] Updated weights for policy 0, policy_version 1881790 (0.0005) [2023-12-28 08:47:13,908][106226] Updated weights for policy 0, policy_version 1881800 (0.0009) [2023-12-28 08:47:14,342][106225] Updated weights for policy 1, policy_version 1885763 (0.0007) [2023-12-28 08:47:14,408][106225] Updated weights for policy 1, policy_version 1885773 (0.0009) [2023-12-28 08:47:14,463][106225] Updated weights for policy 1, policy_version 1885783 (0.0008) [2023-12-28 08:47:14,593][106226] Updated weights for policy 0, policy_version 1881810 (0.0009) [2023-12-28 08:47:14,638][106226] Updated weights for policy 0, policy_version 1881820 (0.0008) [2023-12-28 08:47:14,686][106226] Updated weights for policy 0, policy_version 1881830 (0.0008) [2023-12-28 08:47:15,170][106225] Updated weights for policy 1, policy_version 1885793 (0.0007) [2023-12-28 08:47:15,224][106225] Updated weights for policy 1, policy_version 1885803 (0.0009) [2023-12-28 08:47:15,295][106225] Updated weights for policy 1, policy_version 1885813 (0.0009) [2023-12-28 08:47:15,364][106225] Updated weights for policy 1, policy_version 1885823 (0.0009) [2023-12-28 08:47:15,465][106226] Updated weights for policy 0, policy_version 1881840 (0.0008) [2023-12-28 08:47:15,517][106226] Updated weights for policy 0, policy_version 1881850 (0.0008) [2023-12-28 08:47:15,566][106226] Updated weights for policy 0, policy_version 1881860 (0.0008) [2023-12-28 08:47:16,062][106225] Updated weights for policy 1, policy_version 1885833 (0.0010) [2023-12-28 08:47:16,112][106225] Updated weights for policy 1, policy_version 1885843 (0.0009) [2023-12-28 08:47:16,175][105115] Fps is (10 sec: 18022.2, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 964665344. Throughput: 0: 9596.4, 1: 9918.9. Samples: 964660900. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:16,175][105115] Avg episode reward: [(0, '-4.084'), (1, '-4.736')] [2023-12-28 08:47:16,176][106225] Updated weights for policy 1, policy_version 1885853 (0.0006) [2023-12-28 08:47:16,206][106226] Updated weights for policy 0, policy_version 1881870 (0.0007) [2023-12-28 08:47:16,267][106226] Updated weights for policy 0, policy_version 1881880 (0.0005) [2023-12-28 08:47:16,327][106226] Updated weights for policy 0, policy_version 1881890 (0.0005) [2023-12-28 08:47:16,832][106226] Updated weights for policy 0, policy_version 1881900 (0.0006) [2023-12-28 08:47:16,887][106226] Updated weights for policy 0, policy_version 1881910 (0.0006) [2023-12-28 08:47:16,887][106225] Updated weights for policy 1, policy_version 1885863 (0.0009) [2023-12-28 08:47:16,941][106225] Updated weights for policy 1, policy_version 1885873 (0.0007) [2023-12-28 08:47:16,943][106226] Updated weights for policy 0, policy_version 1881920 (0.0008) [2023-12-28 08:47:17,002][106225] Updated weights for policy 1, policy_version 1885883 (0.0005) [2023-12-28 08:47:17,534][106225] Updated weights for policy 1, policy_version 1885893 (0.0005) [2023-12-28 08:47:17,560][106226] Updated weights for policy 0, policy_version 1881930 (0.0010) [2023-12-28 08:47:17,590][106225] Updated weights for policy 1, policy_version 1885903 (0.0005) [2023-12-28 08:47:17,622][106226] Updated weights for policy 0, policy_version 1881940 (0.0009) [2023-12-28 08:47:17,642][106225] Updated weights for policy 1, policy_version 1885913 (0.0008) [2023-12-28 08:47:17,688][106226] Updated weights for policy 0, policy_version 1881950 (0.0005) [2023-12-28 08:47:17,751][106226] Updated weights for policy 0, policy_version 1881960 (0.0008) [2023-12-28 08:47:18,207][106225] Updated weights for policy 1, policy_version 1885923 (0.0007) [2023-12-28 08:47:18,260][106225] Updated weights for policy 1, policy_version 1885933 (0.0006) [2023-12-28 08:47:18,301][106226] Updated weights for policy 0, policy_version 1881970 (0.0006) [2023-12-28 08:47:18,313][106225] Updated weights for policy 1, policy_version 1885943 (0.0008) [2023-12-28 08:47:18,366][106226] Updated weights for policy 0, policy_version 1881980 (0.0008) [2023-12-28 08:47:18,423][106226] Updated weights for policy 0, policy_version 1881990 (0.0007) [2023-12-28 08:47:18,942][106225] Updated weights for policy 1, policy_version 1885953 (0.0007) [2023-12-28 08:47:19,005][106225] Updated weights for policy 1, policy_version 1885963 (0.0006) [2023-12-28 08:47:19,066][106225] Updated weights for policy 1, policy_version 1885973 (0.0005) [2023-12-28 08:47:19,118][106225] Updated weights for policy 1, policy_version 1885983 (0.0006) [2023-12-28 08:47:19,184][106226] Updated weights for policy 0, policy_version 1882000 (0.0007) [2023-12-28 08:47:19,246][106226] Updated weights for policy 0, policy_version 1882010 (0.0009) [2023-12-28 08:47:19,313][106226] Updated weights for policy 0, policy_version 1882020 (0.0009) [2023-12-28 08:47:19,845][106225] Updated weights for policy 1, policy_version 1885993 (0.0010) [2023-12-28 08:47:19,906][106225] Updated weights for policy 1, policy_version 1886003 (0.0011) [2023-12-28 08:47:19,976][106225] Updated weights for policy 1, policy_version 1886013 (0.0010) [2023-12-28 08:47:20,066][106226] Updated weights for policy 0, policy_version 1882030 (0.0009) [2023-12-28 08:47:20,129][106226] Updated weights for policy 0, policy_version 1882040 (0.0008) [2023-12-28 08:47:20,191][106226] Updated weights for policy 0, policy_version 1882050 (0.0005) [2023-12-28 08:47:20,762][106225] Updated weights for policy 1, policy_version 1886023 (0.0011) [2023-12-28 08:47:20,831][106225] Updated weights for policy 1, policy_version 1886033 (0.0011) [2023-12-28 08:47:20,864][106226] Updated weights for policy 0, policy_version 1882060 (0.0006) [2023-12-28 08:47:20,895][106225] Updated weights for policy 1, policy_version 1886043 (0.0012) [2023-12-28 08:47:20,924][106226] Updated weights for policy 0, policy_version 1882070 (0.0006) [2023-12-28 08:47:20,986][106226] Updated weights for policy 0, policy_version 1882080 (0.0007) [2023-12-28 08:47:21,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 964780032. Throughput: 0: 9628.5, 1: 10020.7. Samples: 964785692. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:21,175][105115] Avg episode reward: [(0, '-4.060'), (1, '-4.707')] [2023-12-28 08:47:21,667][106225] Updated weights for policy 1, policy_version 1886053 (0.0011) [2023-12-28 08:47:21,736][106225] Updated weights for policy 1, policy_version 1886063 (0.0008) [2023-12-28 08:47:21,797][106225] Updated weights for policy 1, policy_version 1886073 (0.0008) [2023-12-28 08:47:21,822][106226] Updated weights for policy 0, policy_version 1882090 (0.0007) [2023-12-28 08:47:21,881][106226] Updated weights for policy 0, policy_version 1882100 (0.0007) [2023-12-28 08:47:21,946][106226] Updated weights for policy 0, policy_version 1882110 (0.0007) [2023-12-28 08:47:22,009][106226] Updated weights for policy 0, policy_version 1882120 (0.0008) [2023-12-28 08:47:22,504][106225] Updated weights for policy 1, policy_version 1886083 (0.0006) [2023-12-28 08:47:22,562][106225] Updated weights for policy 1, policy_version 1886093 (0.0009) [2023-12-28 08:47:22,625][106225] Updated weights for policy 1, policy_version 1886103 (0.0011) [2023-12-28 08:47:22,643][106226] Updated weights for policy 0, policy_version 1882130 (0.0006) [2023-12-28 08:47:22,702][106226] Updated weights for policy 0, policy_version 1882140 (0.0008) [2023-12-28 08:47:22,751][106226] Updated weights for policy 0, policy_version 1882150 (0.0009) [2023-12-28 08:47:23,227][106225] Updated weights for policy 1, policy_version 1886113 (0.0007) [2023-12-28 08:47:23,286][106225] Updated weights for policy 1, policy_version 1886123 (0.0005) [2023-12-28 08:47:23,345][106225] Updated weights for policy 1, policy_version 1886133 (0.0005) [2023-12-28 08:47:23,392][106225] Updated weights for policy 1, policy_version 1886143 (0.0005) [2023-12-28 08:47:23,443][106226] Updated weights for policy 0, policy_version 1882160 (0.0006) [2023-12-28 08:47:23,512][106226] Updated weights for policy 0, policy_version 1882170 (0.0009) [2023-12-28 08:47:23,558][106226] Updated weights for policy 0, policy_version 1882180 (0.0009) [2023-12-28 08:47:24,019][106225] Updated weights for policy 1, policy_version 1886153 (0.0008) [2023-12-28 08:47:24,075][106225] Updated weights for policy 1, policy_version 1886163 (0.0007) [2023-12-28 08:47:24,134][106225] Updated weights for policy 1, policy_version 1886173 (0.0006) [2023-12-28 08:47:24,268][106226] Updated weights for policy 0, policy_version 1882190 (0.0008) [2023-12-28 08:47:24,314][106226] Updated weights for policy 0, policy_version 1882200 (0.0008) [2023-12-28 08:47:24,364][106226] Updated weights for policy 0, policy_version 1882210 (0.0006) [2023-12-28 08:47:24,846][106225] Updated weights for policy 1, policy_version 1886183 (0.0009) [2023-12-28 08:47:24,905][106225] Updated weights for policy 1, policy_version 1886193 (0.0008) [2023-12-28 08:47:24,960][106225] Updated weights for policy 1, policy_version 1886203 (0.0007) [2023-12-28 08:47:25,024][106226] Updated weights for policy 0, policy_version 1882220 (0.0007) [2023-12-28 08:47:25,078][106226] Updated weights for policy 0, policy_version 1882230 (0.0008) [2023-12-28 08:47:25,126][106226] Updated weights for policy 0, policy_version 1882240 (0.0008) [2023-12-28 08:47:25,633][106225] Updated weights for policy 1, policy_version 1886213 (0.0009) [2023-12-28 08:47:25,688][106225] Updated weights for policy 1, policy_version 1886223 (0.0007) [2023-12-28 08:47:25,742][106225] Updated weights for policy 1, policy_version 1886233 (0.0005) [2023-12-28 08:47:25,865][106226] Updated weights for policy 0, policy_version 1882250 (0.0009) [2023-12-28 08:47:25,922][106226] Updated weights for policy 0, policy_version 1882260 (0.0009) [2023-12-28 08:47:25,982][106226] Updated weights for policy 0, policy_version 1882270 (0.0009) [2023-12-28 08:47:26,042][106226] Updated weights for policy 0, policy_version 1882280 (0.0008) [2023-12-28 08:47:26,174][105115] Fps is (10 sec: 21299.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 964878336. Throughput: 0: 9652.0, 1: 10023.0. Samples: 964845692. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:26,175][105115] Avg episode reward: [(0, '-3.929'), (1, '-4.602')] [2023-12-28 08:47:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001882280_481943552.pth... [2023-12-28 08:47:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001886240_482934784.pth... [2023-12-28 08:47:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001881128_481648640.pth [2023-12-28 08:47:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001885088_482639872.pth [2023-12-28 08:47:26,344][106225] Updated weights for policy 1, policy_version 1886243 (0.0005) [2023-12-28 08:47:26,393][106225] Updated weights for policy 1, policy_version 1886253 (0.0009) [2023-12-28 08:47:26,439][106225] Updated weights for policy 1, policy_version 1886264 (0.0007) [2023-12-28 08:47:26,650][106226] Updated weights for policy 0, policy_version 1882290 (0.0006) [2023-12-28 08:47:26,713][106226] Updated weights for policy 0, policy_version 1882300 (0.0006) [2023-12-28 08:47:26,762][106226] Updated weights for policy 0, policy_version 1882310 (0.0008) [2023-12-28 08:47:27,202][106225] Updated weights for policy 1, policy_version 1886274 (0.0005) [2023-12-28 08:47:27,255][106225] Updated weights for policy 1, policy_version 1886284 (0.0005) [2023-12-28 08:47:27,315][106225] Updated weights for policy 1, policy_version 1886294 (0.0007) [2023-12-28 08:47:27,318][106226] Updated weights for policy 0, policy_version 1882320 (0.0006) [2023-12-28 08:47:27,370][106225] Updated weights for policy 1, policy_version 1886304 (0.0006) [2023-12-28 08:47:27,372][106226] Updated weights for policy 0, policy_version 1882330 (0.0007) [2023-12-28 08:47:27,425][106226] Updated weights for policy 0, policy_version 1882340 (0.0006) [2023-12-28 08:47:28,037][106225] Updated weights for policy 1, policy_version 1886314 (0.0008) [2023-12-28 08:47:28,088][106225] Updated weights for policy 1, policy_version 1886324 (0.0008) [2023-12-28 08:47:28,117][106226] Updated weights for policy 0, policy_version 1882350 (0.0006) [2023-12-28 08:47:28,132][106225] Updated weights for policy 1, policy_version 1886334 (0.0006) [2023-12-28 08:47:28,164][106226] Updated weights for policy 0, policy_version 1882360 (0.0008) [2023-12-28 08:47:28,209][106226] Updated weights for policy 0, policy_version 1882370 (0.0008) [2023-12-28 08:47:28,825][106225] Updated weights for policy 1, policy_version 1886344 (0.0008) [2023-12-28 08:47:28,881][106225] Updated weights for policy 1, policy_version 1886354 (0.0008) [2023-12-28 08:47:28,933][106226] Updated weights for policy 0, policy_version 1882380 (0.0008) [2023-12-28 08:47:28,935][106225] Updated weights for policy 1, policy_version 1886364 (0.0008) [2023-12-28 08:47:28,997][106226] Updated weights for policy 0, policy_version 1882390 (0.0007) [2023-12-28 08:47:29,048][106226] Updated weights for policy 0, policy_version 1882400 (0.0008) [2023-12-28 08:47:29,725][106225] Updated weights for policy 1, policy_version 1886374 (0.0007) [2023-12-28 08:47:29,739][106226] Updated weights for policy 0, policy_version 1882410 (0.0007) [2023-12-28 08:47:29,787][106225] Updated weights for policy 1, policy_version 1886384 (0.0008) [2023-12-28 08:47:29,789][106226] Updated weights for policy 0, policy_version 1882420 (0.0006) [2023-12-28 08:47:29,843][106225] Updated weights for policy 1, policy_version 1886394 (0.0007) [2023-12-28 08:47:29,850][106226] Updated weights for policy 0, policy_version 1882430 (0.0007) [2023-12-28 08:47:29,912][106226] Updated weights for policy 0, policy_version 1882440 (0.0007) [2023-12-28 08:47:30,549][106226] Updated weights for policy 0, policy_version 1882450 (0.0009) [2023-12-28 08:47:30,557][106225] Updated weights for policy 1, policy_version 1886404 (0.0006) [2023-12-28 08:47:30,604][106225] Updated weights for policy 1, policy_version 1886414 (0.0006) [2023-12-28 08:47:30,608][106226] Updated weights for policy 0, policy_version 1882460 (0.0008) [2023-12-28 08:47:30,657][106225] Updated weights for policy 1, policy_version 1886424 (0.0008) [2023-12-28 08:47:30,663][106226] Updated weights for policy 0, policy_version 1882470 (0.0006) [2023-12-28 08:47:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 964976640. Throughput: 0: 9748.8, 1: 10130.0. Samples: 964968136. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:31,175][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.608')] [2023-12-28 08:47:31,380][106225] Updated weights for policy 1, policy_version 1886434 (0.0007) [2023-12-28 08:47:31,434][106226] Updated weights for policy 0, policy_version 1882480 (0.0008) [2023-12-28 08:47:31,448][106225] Updated weights for policy 1, policy_version 1886444 (0.0007) [2023-12-28 08:47:31,496][106226] Updated weights for policy 0, policy_version 1882490 (0.0008) [2023-12-28 08:47:31,502][106225] Updated weights for policy 1, policy_version 1886454 (0.0006) [2023-12-28 08:47:31,552][106226] Updated weights for policy 0, policy_version 1882500 (0.0007) [2023-12-28 08:47:31,557][106225] Updated weights for policy 1, policy_version 1886464 (0.0006) [2023-12-28 08:47:32,227][106225] Updated weights for policy 1, policy_version 1886474 (0.0005) [2023-12-28 08:47:32,294][106225] Updated weights for policy 1, policy_version 1886484 (0.0006) [2023-12-28 08:47:32,334][106226] Updated weights for policy 0, policy_version 1882510 (0.0009) [2023-12-28 08:47:32,352][106225] Updated weights for policy 1, policy_version 1886494 (0.0006) [2023-12-28 08:47:32,403][106226] Updated weights for policy 0, policy_version 1882520 (0.0009) [2023-12-28 08:47:32,460][106226] Updated weights for policy 0, policy_version 1882530 (0.0008) [2023-12-28 08:47:33,059][106225] Updated weights for policy 1, policy_version 1886504 (0.0008) [2023-12-28 08:47:33,109][106225] Updated weights for policy 1, policy_version 1886514 (0.0009) [2023-12-28 08:47:33,158][106225] Updated weights for policy 1, policy_version 1886524 (0.0008) [2023-12-28 08:47:33,201][106226] Updated weights for policy 0, policy_version 1882540 (0.0009) [2023-12-28 08:47:33,260][106226] Updated weights for policy 0, policy_version 1882550 (0.0009) [2023-12-28 08:47:33,318][106226] Updated weights for policy 0, policy_version 1882560 (0.0008) [2023-12-28 08:47:33,871][106225] Updated weights for policy 1, policy_version 1886534 (0.0008) [2023-12-28 08:47:33,915][106225] Updated weights for policy 1, policy_version 1886544 (0.0008) [2023-12-28 08:47:33,964][106225] Updated weights for policy 1, policy_version 1886554 (0.0009) [2023-12-28 08:47:34,015][106226] Updated weights for policy 0, policy_version 1882570 (0.0007) [2023-12-28 08:47:34,068][106226] Updated weights for policy 0, policy_version 1882580 (0.0005) [2023-12-28 08:47:34,126][106226] Updated weights for policy 0, policy_version 1882590 (0.0007) [2023-12-28 08:47:34,195][106226] Updated weights for policy 0, policy_version 1882600 (0.0007) [2023-12-28 08:47:34,644][106225] Updated weights for policy 1, policy_version 1886564 (0.0008) [2023-12-28 08:47:34,708][106225] Updated weights for policy 1, policy_version 1886574 (0.0009) [2023-12-28 08:47:34,771][106225] Updated weights for policy 1, policy_version 1886584 (0.0006) [2023-12-28 08:47:34,933][106226] Updated weights for policy 0, policy_version 1882610 (0.0008) [2023-12-28 08:47:34,982][106226] Updated weights for policy 0, policy_version 1882620 (0.0009) [2023-12-28 08:47:35,038][106226] Updated weights for policy 0, policy_version 1882630 (0.0008) [2023-12-28 08:47:35,350][106225] Updated weights for policy 1, policy_version 1886594 (0.0007) [2023-12-28 08:47:35,411][106225] Updated weights for policy 1, policy_version 1886604 (0.0008) [2023-12-28 08:47:35,471][106225] Updated weights for policy 1, policy_version 1886614 (0.0009) [2023-12-28 08:47:35,520][106225] Updated weights for policy 1, policy_version 1886624 (0.0009) [2023-12-28 08:47:35,822][106226] Updated weights for policy 0, policy_version 1882640 (0.0008) [2023-12-28 08:47:35,886][106226] Updated weights for policy 0, policy_version 1882650 (0.0008) [2023-12-28 08:47:35,941][106226] Updated weights for policy 0, policy_version 1882660 (0.0007) [2023-12-28 08:47:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 965074944. Throughput: 0: 9781.8, 1: 10068.0. Samples: 965085204. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:36,175][105115] Avg episode reward: [(0, '-4.369'), (1, '-4.503')] [2023-12-28 08:47:36,271][106225] Updated weights for policy 1, policy_version 1886634 (0.0011) [2023-12-28 08:47:36,337][106225] Updated weights for policy 1, policy_version 1886644 (0.0011) [2023-12-28 08:47:36,401][106225] Updated weights for policy 1, policy_version 1886654 (0.0011) [2023-12-28 08:47:36,646][106226] Updated weights for policy 0, policy_version 1882670 (0.0009) [2023-12-28 08:47:36,716][106226] Updated weights for policy 0, policy_version 1882680 (0.0008) [2023-12-28 08:47:36,783][106226] Updated weights for policy 0, policy_version 1882690 (0.0007) [2023-12-28 08:47:37,056][106225] Updated weights for policy 1, policy_version 1886664 (0.0006) [2023-12-28 08:47:37,119][106225] Updated weights for policy 1, policy_version 1886674 (0.0007) [2023-12-28 08:47:37,166][106225] Updated weights for policy 1, policy_version 1886684 (0.0010) [2023-12-28 08:47:37,511][106226] Updated weights for policy 0, policy_version 1882700 (0.0009) [2023-12-28 08:47:37,570][106226] Updated weights for policy 0, policy_version 1882710 (0.0009) [2023-12-28 08:47:37,629][106226] Updated weights for policy 0, policy_version 1882720 (0.0009) [2023-12-28 08:47:37,787][106225] Updated weights for policy 1, policy_version 1886694 (0.0009) [2023-12-28 08:47:37,845][106225] Updated weights for policy 1, policy_version 1886704 (0.0007) [2023-12-28 08:47:37,891][106225] Updated weights for policy 1, policy_version 1886714 (0.0005) [2023-12-28 08:47:38,385][106226] Updated weights for policy 0, policy_version 1882730 (0.0009) [2023-12-28 08:47:38,452][106226] Updated weights for policy 0, policy_version 1882740 (0.0007) [2023-12-28 08:47:38,515][106226] Updated weights for policy 0, policy_version 1882750 (0.0009) [2023-12-28 08:47:38,562][106225] Updated weights for policy 1, policy_version 1886724 (0.0007) [2023-12-28 08:47:38,574][106226] Updated weights for policy 0, policy_version 1882760 (0.0006) [2023-12-28 08:47:38,624][106225] Updated weights for policy 1, policy_version 1886734 (0.0009) [2023-12-28 08:47:38,689][106225] Updated weights for policy 1, policy_version 1886744 (0.0007) [2023-12-28 08:47:39,291][106226] Updated weights for policy 0, policy_version 1882770 (0.0008) [2023-12-28 08:47:39,365][106226] Updated weights for policy 0, policy_version 1882780 (0.0008) [2023-12-28 08:47:39,436][106226] Updated weights for policy 0, policy_version 1882790 (0.0008) [2023-12-28 08:47:39,475][106225] Updated weights for policy 1, policy_version 1886754 (0.0007) [2023-12-28 08:47:39,536][106225] Updated weights for policy 1, policy_version 1886764 (0.0008) [2023-12-28 08:47:39,593][106225] Updated weights for policy 1, policy_version 1886774 (0.0008) [2023-12-28 08:47:39,643][106225] Updated weights for policy 1, policy_version 1886784 (0.0009) [2023-12-28 08:47:40,188][106226] Updated weights for policy 0, policy_version 1882800 (0.0009) [2023-12-28 08:47:40,250][106226] Updated weights for policy 0, policy_version 1882810 (0.0008) [2023-12-28 08:47:40,320][106226] Updated weights for policy 0, policy_version 1882820 (0.0007) [2023-12-28 08:47:40,425][106225] Updated weights for policy 1, policy_version 1886794 (0.0008) [2023-12-28 08:47:40,491][106225] Updated weights for policy 1, policy_version 1886804 (0.0008) [2023-12-28 08:47:40,566][106225] Updated weights for policy 1, policy_version 1886814 (0.0008) [2023-12-28 08:47:41,035][106226] Updated weights for policy 0, policy_version 1882830 (0.0009) [2023-12-28 08:47:41,097][106226] Updated weights for policy 0, policy_version 1882840 (0.0006) [2023-12-28 08:47:41,172][106226] Updated weights for policy 0, policy_version 1882850 (0.0009) [2023-12-28 08:47:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 965165056. Throughput: 0: 9778.0, 1: 10069.4. Samples: 965144292. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:41,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.701')] [2023-12-28 08:47:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001886816_483082240.pth... [2023-12-28 08:47:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001885664_482787328.pth [2023-12-28 08:47:41,215][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001882856_482091008.pth... [2023-12-28 08:47:41,220][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001881672_481787904.pth [2023-12-28 08:47:41,269][106225] Updated weights for policy 1, policy_version 1886824 (0.0009) [2023-12-28 08:47:41,327][106225] Updated weights for policy 1, policy_version 1886834 (0.0009) [2023-12-28 08:47:41,404][106225] Updated weights for policy 1, policy_version 1886844 (0.0009) [2023-12-28 08:47:41,985][106226] Updated weights for policy 0, policy_version 1882860 (0.0007) [2023-12-28 08:47:42,056][106226] Updated weights for policy 0, policy_version 1882870 (0.0008) [2023-12-28 08:47:42,095][106225] Updated weights for policy 1, policy_version 1886854 (0.0008) [2023-12-28 08:47:42,113][106226] Updated weights for policy 0, policy_version 1882880 (0.0006) [2023-12-28 08:47:42,164][106225] Updated weights for policy 1, policy_version 1886864 (0.0009) [2023-12-28 08:47:42,229][106225] Updated weights for policy 1, policy_version 1886874 (0.0009) [2023-12-28 08:47:42,851][106226] Updated weights for policy 0, policy_version 1882890 (0.0007) [2023-12-28 08:47:42,907][106226] Updated weights for policy 0, policy_version 1882900 (0.0008) [2023-12-28 08:47:42,944][106225] Updated weights for policy 1, policy_version 1886884 (0.0008) [2023-12-28 08:47:42,970][106226] Updated weights for policy 0, policy_version 1882910 (0.0008) [2023-12-28 08:47:43,006][106225] Updated weights for policy 1, policy_version 1886894 (0.0008) [2023-12-28 08:47:43,025][106226] Updated weights for policy 0, policy_version 1882920 (0.0005) [2023-12-28 08:47:43,069][106225] Updated weights for policy 1, policy_version 1886904 (0.0009) [2023-12-28 08:47:43,751][106225] Updated weights for policy 1, policy_version 1886914 (0.0007) [2023-12-28 08:47:43,762][106226] Updated weights for policy 0, policy_version 1882930 (0.0009) [2023-12-28 08:47:43,815][106225] Updated weights for policy 1, policy_version 1886924 (0.0008) [2023-12-28 08:47:43,822][106226] Updated weights for policy 0, policy_version 1882940 (0.0007) [2023-12-28 08:47:43,871][106226] Updated weights for policy 0, policy_version 1882950 (0.0008) [2023-12-28 08:47:43,873][106225] Updated weights for policy 1, policy_version 1886934 (0.0008) [2023-12-28 08:47:43,924][106225] Updated weights for policy 1, policy_version 1886944 (0.0008) [2023-12-28 08:47:44,554][106226] Updated weights for policy 0, policy_version 1882960 (0.0008) [2023-12-28 08:47:44,618][106226] Updated weights for policy 0, policy_version 1882970 (0.0008) [2023-12-28 08:47:44,662][106225] Updated weights for policy 1, policy_version 1886954 (0.0008) [2023-12-28 08:47:44,676][106226] Updated weights for policy 0, policy_version 1882980 (0.0006) [2023-12-28 08:47:44,711][106225] Updated weights for policy 1, policy_version 1886964 (0.0007) [2023-12-28 08:47:44,755][106225] Updated weights for policy 1, policy_version 1886974 (0.0008) [2023-12-28 08:47:45,427][106226] Updated weights for policy 0, policy_version 1882990 (0.0007) [2023-12-28 08:47:45,477][106226] Updated weights for policy 0, policy_version 1883000 (0.0008) [2023-12-28 08:47:45,526][106226] Updated weights for policy 0, policy_version 1883010 (0.0008) [2023-12-28 08:47:45,532][106225] Updated weights for policy 1, policy_version 1886984 (0.0006) [2023-12-28 08:47:45,582][106225] Updated weights for policy 1, policy_version 1886994 (0.0007) [2023-12-28 08:47:45,635][106225] Updated weights for policy 1, policy_version 1887004 (0.0005) [2023-12-28 08:47:46,163][106225] Updated weights for policy 1, policy_version 1887014 (0.0008) [2023-12-28 08:47:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 965263360. Throughput: 0: 9840.7, 1: 9951.6. Samples: 965256816. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:46,175][105115] Avg episode reward: [(0, '-4.137'), (1, '-4.838')] [2023-12-28 08:47:46,216][106225] Updated weights for policy 1, policy_version 1887024 (0.0010) [2023-12-28 08:47:46,273][106225] Updated weights for policy 1, policy_version 1887034 (0.0008) [2023-12-28 08:47:46,300][106226] Updated weights for policy 0, policy_version 1883020 (0.0008) [2023-12-28 08:47:46,346][106226] Updated weights for policy 0, policy_version 1883030 (0.0010) [2023-12-28 08:47:46,402][106226] Updated weights for policy 0, policy_version 1883040 (0.0008) [2023-12-28 08:47:46,945][106225] Updated weights for policy 1, policy_version 1887044 (0.0007) [2023-12-28 08:47:47,002][106225] Updated weights for policy 1, policy_version 1887054 (0.0010) [2023-12-28 08:47:47,061][106225] Updated weights for policy 1, policy_version 1887064 (0.0010) [2023-12-28 08:47:47,132][106226] Updated weights for policy 0, policy_version 1883050 (0.0008) [2023-12-28 08:47:47,187][106226] Updated weights for policy 0, policy_version 1883060 (0.0010) [2023-12-28 08:47:47,236][106226] Updated weights for policy 0, policy_version 1883070 (0.0009) [2023-12-28 08:47:47,290][106226] Updated weights for policy 0, policy_version 1883080 (0.0008) [2023-12-28 08:47:47,700][106225] Updated weights for policy 1, policy_version 1887074 (0.0010) [2023-12-28 08:47:47,755][106225] Updated weights for policy 1, policy_version 1887084 (0.0009) [2023-12-28 08:47:47,800][106225] Updated weights for policy 1, policy_version 1887094 (0.0008) [2023-12-28 08:47:47,849][106225] Updated weights for policy 1, policy_version 1887104 (0.0007) [2023-12-28 08:47:47,940][106226] Updated weights for policy 0, policy_version 1883090 (0.0011) [2023-12-28 08:47:48,004][106226] Updated weights for policy 0, policy_version 1883100 (0.0011) [2023-12-28 08:47:48,058][106226] Updated weights for policy 0, policy_version 1883110 (0.0010) [2023-12-28 08:47:48,468][106225] Updated weights for policy 1, policy_version 1887114 (0.0008) [2023-12-28 08:47:48,523][106225] Updated weights for policy 1, policy_version 1887124 (0.0008) [2023-12-28 08:47:48,580][106225] Updated weights for policy 1, policy_version 1887134 (0.0008) [2023-12-28 08:47:48,812][106226] Updated weights for policy 0, policy_version 1883120 (0.0011) [2023-12-28 08:47:48,874][106226] Updated weights for policy 0, policy_version 1883130 (0.0011) [2023-12-28 08:47:48,931][106226] Updated weights for policy 0, policy_version 1883140 (0.0010) [2023-12-28 08:47:49,285][106225] Updated weights for policy 1, policy_version 1887144 (0.0008) [2023-12-28 08:47:49,349][106225] Updated weights for policy 1, policy_version 1887154 (0.0008) [2023-12-28 08:47:49,419][106225] Updated weights for policy 1, policy_version 1887164 (0.0008) [2023-12-28 08:47:49,581][106226] Updated weights for policy 0, policy_version 1883150 (0.0008) [2023-12-28 08:47:49,648][106226] Updated weights for policy 0, policy_version 1883160 (0.0009) [2023-12-28 08:47:49,701][106226] Updated weights for policy 0, policy_version 1883170 (0.0008) [2023-12-28 08:47:50,156][106225] Updated weights for policy 1, policy_version 1887174 (0.0008) [2023-12-28 08:47:50,205][106225] Updated weights for policy 1, policy_version 1887184 (0.0008) [2023-12-28 08:47:50,258][106225] Updated weights for policy 1, policy_version 1887194 (0.0008) [2023-12-28 08:47:50,458][106226] Updated weights for policy 0, policy_version 1883180 (0.0008) [2023-12-28 08:47:50,518][106226] Updated weights for policy 0, policy_version 1883190 (0.0009) [2023-12-28 08:47:50,583][106226] Updated weights for policy 0, policy_version 1883200 (0.0010) [2023-12-28 08:47:51,023][106225] Updated weights for policy 1, policy_version 1887204 (0.0009) [2023-12-28 08:47:51,087][106225] Updated weights for policy 1, policy_version 1887214 (0.0008) [2023-12-28 08:47:51,160][106225] Updated weights for policy 1, policy_version 1887224 (0.0009) [2023-12-28 08:47:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 965361664. Throughput: 0: 9742.1, 1: 10020.7. Samples: 965376816. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:51,175][105115] Avg episode reward: [(0, '-4.242'), (1, '-4.763')] [2023-12-28 08:47:51,355][106226] Updated weights for policy 0, policy_version 1883210 (0.0008) [2023-12-28 08:47:51,424][106226] Updated weights for policy 0, policy_version 1883220 (0.0009) [2023-12-28 08:47:51,482][106226] Updated weights for policy 0, policy_version 1883230 (0.0006) [2023-12-28 08:47:51,543][106226] Updated weights for policy 0, policy_version 1883240 (0.0005) [2023-12-28 08:47:51,937][106225] Updated weights for policy 1, policy_version 1887234 (0.0008) [2023-12-28 08:47:52,003][106225] Updated weights for policy 1, policy_version 1887244 (0.0007) [2023-12-28 08:47:52,075][106225] Updated weights for policy 1, policy_version 1887254 (0.0006) [2023-12-28 08:47:52,144][106225] Updated weights for policy 1, policy_version 1887264 (0.0005) [2023-12-28 08:47:52,244][106226] Updated weights for policy 0, policy_version 1883250 (0.0010) [2023-12-28 08:47:52,307][106226] Updated weights for policy 0, policy_version 1883260 (0.0008) [2023-12-28 08:47:52,387][106226] Updated weights for policy 0, policy_version 1883270 (0.0009) [2023-12-28 08:47:52,836][106225] Updated weights for policy 1, policy_version 1887274 (0.0007) [2023-12-28 08:47:52,896][106225] Updated weights for policy 1, policy_version 1887284 (0.0008) [2023-12-28 08:47:52,952][106225] Updated weights for policy 1, policy_version 1887294 (0.0008) [2023-12-28 08:47:53,068][106226] Updated weights for policy 0, policy_version 1883280 (0.0007) [2023-12-28 08:47:53,117][106226] Updated weights for policy 0, policy_version 1883290 (0.0009) [2023-12-28 08:47:53,175][106226] Updated weights for policy 0, policy_version 1883300 (0.0008) [2023-12-28 08:47:53,621][106225] Updated weights for policy 1, policy_version 1887304 (0.0007) [2023-12-28 08:47:53,676][106225] Updated weights for policy 1, policy_version 1887314 (0.0006) [2023-12-28 08:47:53,737][106225] Updated weights for policy 1, policy_version 1887324 (0.0007) [2023-12-28 08:47:53,808][106226] Updated weights for policy 0, policy_version 1883310 (0.0009) [2023-12-28 08:47:53,863][106226] Updated weights for policy 0, policy_version 1883320 (0.0005) [2023-12-28 08:47:53,913][106226] Updated weights for policy 0, policy_version 1883330 (0.0005) [2023-12-28 08:47:54,433][106225] Updated weights for policy 1, policy_version 1887334 (0.0008) [2023-12-28 08:47:54,470][106226] Updated weights for policy 0, policy_version 1883340 (0.0007) [2023-12-28 08:47:54,489][106225] Updated weights for policy 1, policy_version 1887344 (0.0007) [2023-12-28 08:47:54,529][106226] Updated weights for policy 0, policy_version 1883350 (0.0009) [2023-12-28 08:47:54,543][106225] Updated weights for policy 1, policy_version 1887354 (0.0005) [2023-12-28 08:47:54,584][106226] Updated weights for policy 0, policy_version 1883360 (0.0009) [2023-12-28 08:47:55,173][106226] Updated weights for policy 0, policy_version 1883370 (0.0009) [2023-12-28 08:47:55,203][106225] Updated weights for policy 1, policy_version 1887364 (0.0006) [2023-12-28 08:47:55,235][106226] Updated weights for policy 0, policy_version 1883380 (0.0006) [2023-12-28 08:47:55,251][106225] Updated weights for policy 1, policy_version 1887374 (0.0008) [2023-12-28 08:47:55,291][106226] Updated weights for policy 0, policy_version 1883390 (0.0005) [2023-12-28 08:47:55,299][106225] Updated weights for policy 1, policy_version 1887384 (0.0008) [2023-12-28 08:47:55,342][106226] Updated weights for policy 0, policy_version 1883400 (0.0005) [2023-12-28 08:47:55,935][106226] Updated weights for policy 0, policy_version 1883410 (0.0005) [2023-12-28 08:47:55,985][106226] Updated weights for policy 0, policy_version 1883420 (0.0007) [2023-12-28 08:47:56,023][106225] Updated weights for policy 1, policy_version 1887394 (0.0007) [2023-12-28 08:47:56,037][106226] Updated weights for policy 0, policy_version 1883430 (0.0006) [2023-12-28 08:47:56,082][106225] Updated weights for policy 1, policy_version 1887404 (0.0008) [2023-12-28 08:47:56,139][106225] Updated weights for policy 1, policy_version 1887414 (0.0008) [2023-12-28 08:47:56,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 965468160. Throughput: 0: 9817.1, 1: 9987.8. Samples: 965435948. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:47:56,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.610')] [2023-12-28 08:47:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001883432_482238464.pth... [2023-12-28 08:47:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001882280_481943552.pth [2023-12-28 08:47:56,199][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001887424_483237888.pth... [2023-12-28 08:47:56,201][106225] Updated weights for policy 1, policy_version 1887424 (0.0008) [2023-12-28 08:47:56,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001886240_482934784.pth [2023-12-28 08:47:56,727][106226] Updated weights for policy 0, policy_version 1883440 (0.0005) [2023-12-28 08:47:56,775][106226] Updated weights for policy 0, policy_version 1883450 (0.0006) [2023-12-28 08:47:56,822][106226] Updated weights for policy 0, policy_version 1883460 (0.0006) [2023-12-28 08:47:56,874][106225] Updated weights for policy 1, policy_version 1887434 (0.0009) [2023-12-28 08:47:56,932][106225] Updated weights for policy 1, policy_version 1887444 (0.0008) [2023-12-28 08:47:56,983][106225] Updated weights for policy 1, policy_version 1887454 (0.0008) [2023-12-28 08:47:57,487][106226] Updated weights for policy 0, policy_version 1883470 (0.0005) [2023-12-28 08:47:57,535][106226] Updated weights for policy 0, policy_version 1883480 (0.0005) [2023-12-28 08:47:57,592][106226] Updated weights for policy 0, policy_version 1883490 (0.0005) [2023-12-28 08:47:57,739][106225] Updated weights for policy 1, policy_version 1887464 (0.0009) [2023-12-28 08:47:57,791][106225] Updated weights for policy 1, policy_version 1887474 (0.0007) [2023-12-28 08:47:57,844][106225] Updated weights for policy 1, policy_version 1887484 (0.0009) [2023-12-28 08:47:58,110][106226] Updated weights for policy 0, policy_version 1883500 (0.0006) [2023-12-28 08:47:58,167][106226] Updated weights for policy 0, policy_version 1883510 (0.0005) [2023-12-28 08:47:58,227][106226] Updated weights for policy 0, policy_version 1883520 (0.0007) [2023-12-28 08:47:58,665][106225] Updated weights for policy 1, policy_version 1887494 (0.0008) [2023-12-28 08:47:58,732][106225] Updated weights for policy 1, policy_version 1887505 (0.0007) [2023-12-28 08:47:58,804][106225] Updated weights for policy 1, policy_version 1887515 (0.0007) [2023-12-28 08:47:58,984][106226] Updated weights for policy 0, policy_version 1883530 (0.0008) [2023-12-28 08:47:59,046][106226] Updated weights for policy 0, policy_version 1883540 (0.0008) [2023-12-28 08:47:59,098][106226] Updated weights for policy 0, policy_version 1883550 (0.0008) [2023-12-28 08:47:59,162][106226] Updated weights for policy 0, policy_version 1883560 (0.0008) [2023-12-28 08:47:59,586][106225] Updated weights for policy 1, policy_version 1887525 (0.0006) [2023-12-28 08:47:59,644][106225] Updated weights for policy 1, policy_version 1887535 (0.0005) [2023-12-28 08:47:59,710][106225] Updated weights for policy 1, policy_version 1887545 (0.0007) [2023-12-28 08:47:59,900][106226] Updated weights for policy 0, policy_version 1883570 (0.0008) [2023-12-28 08:47:59,967][106226] Updated weights for policy 0, policy_version 1883580 (0.0008) [2023-12-28 08:48:00,020][106226] Updated weights for policy 0, policy_version 1883590 (0.0008) [2023-12-28 08:48:00,394][106225] Updated weights for policy 1, policy_version 1887555 (0.0010) [2023-12-28 08:48:00,449][106225] Updated weights for policy 1, policy_version 1887565 (0.0008) [2023-12-28 08:48:00,506][106225] Updated weights for policy 1, policy_version 1887575 (0.0009) [2023-12-28 08:48:00,736][106226] Updated weights for policy 0, policy_version 1883600 (0.0008) [2023-12-28 08:48:00,801][106226] Updated weights for policy 0, policy_version 1883610 (0.0007) [2023-12-28 08:48:00,860][106226] Updated weights for policy 0, policy_version 1883620 (0.0006) [2023-12-28 08:48:01,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 965566464. Throughput: 0: 9946.4, 1: 9970.2. Samples: 965557144. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:01,175][105115] Avg episode reward: [(0, '-4.342'), (1, '-4.520')] [2023-12-28 08:48:01,317][106225] Updated weights for policy 1, policy_version 1887585 (0.0008) [2023-12-28 08:48:01,386][106225] Updated weights for policy 1, policy_version 1887595 (0.0008) [2023-12-28 08:48:01,444][106225] Updated weights for policy 1, policy_version 1887605 (0.0008) [2023-12-28 08:48:01,492][106225] Updated weights for policy 1, policy_version 1887615 (0.0008) [2023-12-28 08:48:01,540][106226] Updated weights for policy 0, policy_version 1883630 (0.0005) [2023-12-28 08:48:01,606][106226] Updated weights for policy 0, policy_version 1883640 (0.0005) [2023-12-28 08:48:01,682][106226] Updated weights for policy 0, policy_version 1883650 (0.0009) [2023-12-28 08:48:02,188][106225] Updated weights for policy 1, policy_version 1887625 (0.0006) [2023-12-28 08:48:02,245][106225] Updated weights for policy 1, policy_version 1887635 (0.0006) [2023-12-28 08:48:02,306][106225] Updated weights for policy 1, policy_version 1887645 (0.0008) [2023-12-28 08:48:02,360][106226] Updated weights for policy 0, policy_version 1883660 (0.0010) [2023-12-28 08:48:02,416][106226] Updated weights for policy 0, policy_version 1883670 (0.0007) [2023-12-28 08:48:02,468][106226] Updated weights for policy 0, policy_version 1883680 (0.0008) [2023-12-28 08:48:02,923][106225] Updated weights for policy 1, policy_version 1887655 (0.0006) [2023-12-28 08:48:02,980][106225] Updated weights for policy 1, policy_version 1887665 (0.0005) [2023-12-28 08:48:03,037][106225] Updated weights for policy 1, policy_version 1887675 (0.0006) [2023-12-28 08:48:03,145][106226] Updated weights for policy 0, policy_version 1883690 (0.0008) [2023-12-28 08:48:03,209][106226] Updated weights for policy 0, policy_version 1883700 (0.0009) [2023-12-28 08:48:03,274][106226] Updated weights for policy 0, policy_version 1883710 (0.0008) [2023-12-28 08:48:03,324][106226] Updated weights for policy 0, policy_version 1883720 (0.0008) [2023-12-28 08:48:03,579][106225] Updated weights for policy 1, policy_version 1887685 (0.0006) [2023-12-28 08:48:03,639][106225] Updated weights for policy 1, policy_version 1887695 (0.0008) [2023-12-28 08:48:03,700][106225] Updated weights for policy 1, policy_version 1887705 (0.0010) [2023-12-28 08:48:04,045][106226] Updated weights for policy 0, policy_version 1883730 (0.0008) [2023-12-28 08:48:04,104][106226] Updated weights for policy 0, policy_version 1883740 (0.0008) [2023-12-28 08:48:04,164][106226] Updated weights for policy 0, policy_version 1883750 (0.0009) [2023-12-28 08:48:04,435][106225] Updated weights for policy 1, policy_version 1887715 (0.0010) [2023-12-28 08:48:04,500][106225] Updated weights for policy 1, policy_version 1887725 (0.0010) [2023-12-28 08:48:04,563][106225] Updated weights for policy 1, policy_version 1887735 (0.0010) [2023-12-28 08:48:04,860][106226] Updated weights for policy 0, policy_version 1883760 (0.0007) [2023-12-28 08:48:04,927][106226] Updated weights for policy 0, policy_version 1883770 (0.0006) [2023-12-28 08:48:04,984][106226] Updated weights for policy 0, policy_version 1883780 (0.0005) [2023-12-28 08:48:05,199][106225] Updated weights for policy 1, policy_version 1887745 (0.0009) [2023-12-28 08:48:05,260][106225] Updated weights for policy 1, policy_version 1887755 (0.0008) [2023-12-28 08:48:05,320][106225] Updated weights for policy 1, policy_version 1887765 (0.0008) [2023-12-28 08:48:05,381][106225] Updated weights for policy 1, policy_version 1887775 (0.0008) [2023-12-28 08:48:05,571][106226] Updated weights for policy 0, policy_version 1883790 (0.0007) [2023-12-28 08:48:05,620][106226] Updated weights for policy 0, policy_version 1883800 (0.0008) [2023-12-28 08:48:05,673][106226] Updated weights for policy 0, policy_version 1883810 (0.0008) [2023-12-28 08:48:06,095][106225] Updated weights for policy 1, policy_version 1887785 (0.0009) [2023-12-28 08:48:06,164][106225] Updated weights for policy 1, policy_version 1887795 (0.0009) [2023-12-28 08:48:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 965664768. Throughput: 0: 9902.9, 1: 9926.4. Samples: 965678012. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:06,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.801')] [2023-12-28 08:48:06,221][106225] Updated weights for policy 1, policy_version 1887805 (0.0008) [2023-12-28 08:48:06,413][106226] Updated weights for policy 0, policy_version 1883820 (0.0007) [2023-12-28 08:48:06,480][106226] Updated weights for policy 0, policy_version 1883830 (0.0009) [2023-12-28 08:48:06,553][106226] Updated weights for policy 0, policy_version 1883840 (0.0009) [2023-12-28 08:48:06,892][106225] Updated weights for policy 1, policy_version 1887815 (0.0007) [2023-12-28 08:48:06,954][106225] Updated weights for policy 1, policy_version 1887825 (0.0010) [2023-12-28 08:48:07,015][106225] Updated weights for policy 1, policy_version 1887835 (0.0009) [2023-12-28 08:48:07,225][106226] Updated weights for policy 0, policy_version 1883850 (0.0009) [2023-12-28 08:48:07,284][106226] Updated weights for policy 0, policy_version 1883860 (0.0007) [2023-12-28 08:48:07,343][106226] Updated weights for policy 0, policy_version 1883870 (0.0005) [2023-12-28 08:48:07,405][106226] Updated weights for policy 0, policy_version 1883880 (0.0005) [2023-12-28 08:48:07,750][106225] Updated weights for policy 1, policy_version 1887845 (0.0009) [2023-12-28 08:48:07,807][106225] Updated weights for policy 1, policy_version 1887855 (0.0009) [2023-12-28 08:48:07,866][106225] Updated weights for policy 1, policy_version 1887865 (0.0007) [2023-12-28 08:48:07,987][106226] Updated weights for policy 0, policy_version 1883890 (0.0005) [2023-12-28 08:48:08,040][106226] Updated weights for policy 0, policy_version 1883900 (0.0008) [2023-12-28 08:48:08,086][106226] Updated weights for policy 0, policy_version 1883910 (0.0006) [2023-12-28 08:48:08,463][106225] Updated weights for policy 1, policy_version 1887875 (0.0009) [2023-12-28 08:48:08,527][106225] Updated weights for policy 1, policy_version 1887885 (0.0008) [2023-12-28 08:48:08,588][106225] Updated weights for policy 1, policy_version 1887895 (0.0010) [2023-12-28 08:48:08,880][106226] Updated weights for policy 0, policy_version 1883920 (0.0009) [2023-12-28 08:48:08,937][106226] Updated weights for policy 0, policy_version 1883930 (0.0006) [2023-12-28 08:48:08,992][106226] Updated weights for policy 0, policy_version 1883940 (0.0007) [2023-12-28 08:48:09,242][106225] Updated weights for policy 1, policy_version 1887905 (0.0010) [2023-12-28 08:48:09,306][106225] Updated weights for policy 1, policy_version 1887915 (0.0011) [2023-12-28 08:48:09,376][106225] Updated weights for policy 1, policy_version 1887925 (0.0009) [2023-12-28 08:48:09,445][106225] Updated weights for policy 1, policy_version 1887935 (0.0008) [2023-12-28 08:48:09,676][106226] Updated weights for policy 0, policy_version 1883950 (0.0009) [2023-12-28 08:48:09,740][106226] Updated weights for policy 0, policy_version 1883960 (0.0009) [2023-12-28 08:48:09,804][106226] Updated weights for policy 0, policy_version 1883970 (0.0009) [2023-12-28 08:48:10,236][106225] Updated weights for policy 1, policy_version 1887945 (0.0008) [2023-12-28 08:48:10,300][106225] Updated weights for policy 1, policy_version 1887955 (0.0009) [2023-12-28 08:48:10,363][106225] Updated weights for policy 1, policy_version 1887965 (0.0008) [2023-12-28 08:48:10,605][106226] Updated weights for policy 0, policy_version 1883980 (0.0009) [2023-12-28 08:48:10,663][106226] Updated weights for policy 0, policy_version 1883990 (0.0008) [2023-12-28 08:48:10,716][106226] Updated weights for policy 0, policy_version 1884000 (0.0008) [2023-12-28 08:48:11,070][106225] Updated weights for policy 1, policy_version 1887975 (0.0008) [2023-12-28 08:48:11,130][106225] Updated weights for policy 1, policy_version 1887985 (0.0007) [2023-12-28 08:48:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 965763072. Throughput: 0: 9912.5, 1: 9928.7. Samples: 965738548. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:11,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.320')] [2023-12-28 08:48:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001884008_482385920.pth... [2023-12-28 08:48:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001882856_482091008.pth [2023-12-28 08:48:11,197][106225] Updated weights for policy 1, policy_version 1887995 (0.0007) [2023-12-28 08:48:11,225][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001888000_483385344.pth... [2023-12-28 08:48:11,229][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001886816_483082240.pth [2023-12-28 08:48:11,502][106226] Updated weights for policy 0, policy_version 1884010 (0.0008) [2023-12-28 08:48:11,567][106226] Updated weights for policy 0, policy_version 1884020 (0.0009) [2023-12-28 08:48:11,636][106226] Updated weights for policy 0, policy_version 1884030 (0.0009) [2023-12-28 08:48:11,704][106226] Updated weights for policy 0, policy_version 1884040 (0.0009) [2023-12-28 08:48:12,017][106225] Updated weights for policy 1, policy_version 1888005 (0.0008) [2023-12-28 08:48:12,084][106225] Updated weights for policy 1, policy_version 1888015 (0.0008) [2023-12-28 08:48:12,147][106225] Updated weights for policy 1, policy_version 1888025 (0.0008) [2023-12-28 08:48:12,471][106226] Updated weights for policy 0, policy_version 1884050 (0.0006) [2023-12-28 08:48:12,535][106226] Updated weights for policy 0, policy_version 1884060 (0.0008) [2023-12-28 08:48:12,599][106226] Updated weights for policy 0, policy_version 1884070 (0.0009) [2023-12-28 08:48:12,939][106225] Updated weights for policy 1, policy_version 1888035 (0.0008) [2023-12-28 08:48:12,999][106225] Updated weights for policy 1, policy_version 1888045 (0.0007) [2023-12-28 08:48:13,052][106225] Updated weights for policy 1, policy_version 1888055 (0.0007) [2023-12-28 08:48:13,252][106226] Updated weights for policy 0, policy_version 1884080 (0.0009) [2023-12-28 08:48:13,309][106226] Updated weights for policy 0, policy_version 1884090 (0.0008) [2023-12-28 08:48:13,362][106226] Updated weights for policy 0, policy_version 1884100 (0.0009) [2023-12-28 08:48:13,689][106225] Updated weights for policy 1, policy_version 1888065 (0.0007) [2023-12-28 08:48:13,743][106225] Updated weights for policy 1, policy_version 1888075 (0.0005) [2023-12-28 08:48:13,806][106225] Updated weights for policy 1, policy_version 1888085 (0.0005) [2023-12-28 08:48:13,865][106225] Updated weights for policy 1, policy_version 1888095 (0.0005) [2023-12-28 08:48:14,067][106226] Updated weights for policy 0, policy_version 1884110 (0.0007) [2023-12-28 08:48:14,127][106226] Updated weights for policy 0, policy_version 1884120 (0.0005) [2023-12-28 08:48:14,179][106226] Updated weights for policy 0, policy_version 1884130 (0.0010) [2023-12-28 08:48:14,383][106225] Updated weights for policy 1, policy_version 1888105 (0.0007) [2023-12-28 08:48:14,443][106225] Updated weights for policy 1, policy_version 1888115 (0.0008) [2023-12-28 08:48:14,491][106225] Updated weights for policy 1, policy_version 1888125 (0.0008) [2023-12-28 08:48:14,826][106226] Updated weights for policy 0, policy_version 1884140 (0.0009) [2023-12-28 08:48:14,889][106226] Updated weights for policy 0, policy_version 1884150 (0.0008) [2023-12-28 08:48:14,960][106226] Updated weights for policy 0, policy_version 1884160 (0.0009) [2023-12-28 08:48:15,256][106225] Updated weights for policy 1, policy_version 1888135 (0.0008) [2023-12-28 08:48:15,316][106225] Updated weights for policy 1, policy_version 1888145 (0.0008) [2023-12-28 08:48:15,377][106225] Updated weights for policy 1, policy_version 1888155 (0.0009) [2023-12-28 08:48:15,661][106226] Updated weights for policy 0, policy_version 1884170 (0.0009) [2023-12-28 08:48:15,723][106226] Updated weights for policy 0, policy_version 1884180 (0.0008) [2023-12-28 08:48:15,770][106226] Updated weights for policy 0, policy_version 1884190 (0.0008) [2023-12-28 08:48:15,823][106226] Updated weights for policy 0, policy_version 1884200 (0.0008) [2023-12-28 08:48:16,012][106225] Updated weights for policy 1, policy_version 1888165 (0.0008) [2023-12-28 08:48:16,078][106225] Updated weights for policy 1, policy_version 1888175 (0.0010) [2023-12-28 08:48:16,139][106225] Updated weights for policy 1, policy_version 1888185 (0.0009) [2023-12-28 08:48:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 965869568. Throughput: 0: 9803.5, 1: 9897.2. Samples: 965854664. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:16,175][105115] Avg episode reward: [(0, '-4.414'), (1, '-4.271')] [2023-12-28 08:48:16,504][106226] Updated weights for policy 0, policy_version 1884210 (0.0009) [2023-12-28 08:48:16,552][106226] Updated weights for policy 0, policy_version 1884220 (0.0010) [2023-12-28 08:48:16,600][106226] Updated weights for policy 0, policy_version 1884230 (0.0006) [2023-12-28 08:48:16,835][106225] Updated weights for policy 1, policy_version 1888195 (0.0009) [2023-12-28 08:48:16,879][106225] Updated weights for policy 1, policy_version 1888205 (0.0010) [2023-12-28 08:48:16,933][106225] Updated weights for policy 1, policy_version 1888215 (0.0009) [2023-12-28 08:48:17,297][106226] Updated weights for policy 0, policy_version 1884240 (0.0009) [2023-12-28 08:48:17,363][106226] Updated weights for policy 0, policy_version 1884250 (0.0010) [2023-12-28 08:48:17,427][106226] Updated weights for policy 0, policy_version 1884260 (0.0010) [2023-12-28 08:48:17,556][106225] Updated weights for policy 1, policy_version 1888225 (0.0005) [2023-12-28 08:48:17,614][106225] Updated weights for policy 1, policy_version 1888235 (0.0005) [2023-12-28 08:48:17,662][106225] Updated weights for policy 1, policy_version 1888245 (0.0007) [2023-12-28 08:48:17,723][106225] Updated weights for policy 1, policy_version 1888255 (0.0008) [2023-12-28 08:48:18,053][106226] Updated weights for policy 0, policy_version 1884270 (0.0010) [2023-12-28 08:48:18,112][106226] Updated weights for policy 0, policy_version 1884280 (0.0010) [2023-12-28 08:48:18,172][106226] Updated weights for policy 0, policy_version 1884290 (0.0010) [2023-12-28 08:48:18,463][106225] Updated weights for policy 1, policy_version 1888265 (0.0008) [2023-12-28 08:48:18,510][106225] Updated weights for policy 1, policy_version 1888275 (0.0008) [2023-12-28 08:48:18,563][106225] Updated weights for policy 1, policy_version 1888285 (0.0007) [2023-12-28 08:48:18,915][106226] Updated weights for policy 0, policy_version 1884300 (0.0009) [2023-12-28 08:48:18,973][106226] Updated weights for policy 0, policy_version 1884310 (0.0009) [2023-12-28 08:48:19,027][106226] Updated weights for policy 0, policy_version 1884320 (0.0010) [2023-12-28 08:48:19,282][106225] Updated weights for policy 1, policy_version 1888295 (0.0008) [2023-12-28 08:48:19,354][106225] Updated weights for policy 1, policy_version 1888305 (0.0008) [2023-12-28 08:48:19,414][106225] Updated weights for policy 1, policy_version 1888315 (0.0008) [2023-12-28 08:48:19,753][106226] Updated weights for policy 0, policy_version 1884330 (0.0010) [2023-12-28 08:48:19,814][106226] Updated weights for policy 0, policy_version 1884340 (0.0009) [2023-12-28 08:48:19,882][106226] Updated weights for policy 0, policy_version 1884350 (0.0009) [2023-12-28 08:48:19,952][106226] Updated weights for policy 0, policy_version 1884360 (0.0011) [2023-12-28 08:48:20,163][106225] Updated weights for policy 1, policy_version 1888325 (0.0009) [2023-12-28 08:48:20,235][106225] Updated weights for policy 1, policy_version 1888335 (0.0011) [2023-12-28 08:48:20,298][106225] Updated weights for policy 1, policy_version 1888345 (0.0006) [2023-12-28 08:48:20,617][106226] Updated weights for policy 0, policy_version 1884370 (0.0008) [2023-12-28 08:48:20,683][106226] Updated weights for policy 0, policy_version 1884380 (0.0007) [2023-12-28 08:48:20,749][106226] Updated weights for policy 0, policy_version 1884390 (0.0009) [2023-12-28 08:48:21,013][106225] Updated weights for policy 1, policy_version 1888355 (0.0007) [2023-12-28 08:48:21,073][106225] Updated weights for policy 1, policy_version 1888365 (0.0008) [2023-12-28 08:48:21,142][106225] Updated weights for policy 1, policy_version 1888375 (0.0007) [2023-12-28 08:48:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 965959680. Throughput: 0: 9865.1, 1: 9869.7. Samples: 965973268. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:21,175][105115] Avg episode reward: [(0, '-4.491'), (1, '-4.574')] [2023-12-28 08:48:21,461][106226] Updated weights for policy 0, policy_version 1884400 (0.0009) [2023-12-28 08:48:21,522][106226] Updated weights for policy 0, policy_version 1884410 (0.0009) [2023-12-28 08:48:21,581][106226] Updated weights for policy 0, policy_version 1884420 (0.0008) [2023-12-28 08:48:21,853][106225] Updated weights for policy 1, policy_version 1888385 (0.0010) [2023-12-28 08:48:21,918][106225] Updated weights for policy 1, policy_version 1888395 (0.0009) [2023-12-28 08:48:21,989][106225] Updated weights for policy 1, policy_version 1888405 (0.0010) [2023-12-28 08:48:22,053][106225] Updated weights for policy 1, policy_version 1888415 (0.0008) [2023-12-28 08:48:22,293][106226] Updated weights for policy 0, policy_version 1884430 (0.0008) [2023-12-28 08:48:22,362][106226] Updated weights for policy 0, policy_version 1884440 (0.0009) [2023-12-28 08:48:22,423][106226] Updated weights for policy 0, policy_version 1884450 (0.0009) [2023-12-28 08:48:22,822][106225] Updated weights for policy 1, policy_version 1888425 (0.0011) [2023-12-28 08:48:22,887][106225] Updated weights for policy 1, policy_version 1888435 (0.0011) [2023-12-28 08:48:22,949][106225] Updated weights for policy 1, policy_version 1888445 (0.0010) [2023-12-28 08:48:23,174][106226] Updated weights for policy 0, policy_version 1884460 (0.0008) [2023-12-28 08:48:23,239][106226] Updated weights for policy 0, policy_version 1884470 (0.0008) [2023-12-28 08:48:23,303][106226] Updated weights for policy 0, policy_version 1884480 (0.0008) [2023-12-28 08:48:23,668][106225] Updated weights for policy 1, policy_version 1888455 (0.0010) [2023-12-28 08:48:23,725][106225] Updated weights for policy 1, policy_version 1888465 (0.0009) [2023-12-28 08:48:23,779][106225] Updated weights for policy 1, policy_version 1888475 (0.0010) [2023-12-28 08:48:24,040][106226] Updated weights for policy 0, policy_version 1884490 (0.0008) [2023-12-28 08:48:24,101][106226] Updated weights for policy 0, policy_version 1884500 (0.0009) [2023-12-28 08:48:24,157][106226] Updated weights for policy 0, policy_version 1884510 (0.0009) [2023-12-28 08:48:24,213][106226] Updated weights for policy 0, policy_version 1884520 (0.0008) [2023-12-28 08:48:24,486][106225] Updated weights for policy 1, policy_version 1888485 (0.0010) [2023-12-28 08:48:24,549][106225] Updated weights for policy 1, policy_version 1888495 (0.0005) [2023-12-28 08:48:24,605][106225] Updated weights for policy 1, policy_version 1888505 (0.0005) [2023-12-28 08:48:24,959][106226] Updated weights for policy 0, policy_version 1884530 (0.0009) [2023-12-28 08:48:25,025][106226] Updated weights for policy 0, policy_version 1884540 (0.0008) [2023-12-28 08:48:25,088][106226] Updated weights for policy 0, policy_version 1884550 (0.0005) [2023-12-28 08:48:25,128][106225] Updated weights for policy 1, policy_version 1888515 (0.0006) [2023-12-28 08:48:25,191][106225] Updated weights for policy 1, policy_version 1888525 (0.0008) [2023-12-28 08:48:25,244][106225] Updated weights for policy 1, policy_version 1888535 (0.0010) [2023-12-28 08:48:25,678][106226] Updated weights for policy 0, policy_version 1884560 (0.0005) [2023-12-28 08:48:25,741][106226] Updated weights for policy 0, policy_version 1884570 (0.0008) [2023-12-28 08:48:25,803][106226] Updated weights for policy 0, policy_version 1884580 (0.0008) [2023-12-28 08:48:25,803][106225] Updated weights for policy 1, policy_version 1888545 (0.0010) [2023-12-28 08:48:25,864][106225] Updated weights for policy 1, policy_version 1888555 (0.0011) [2023-12-28 08:48:25,923][106225] Updated weights for policy 1, policy_version 1888565 (0.0010) [2023-12-28 08:48:25,980][106225] Updated weights for policy 1, policy_version 1888575 (0.0010) [2023-12-28 08:48:26,175][105115] Fps is (10 sec: 19660.2, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 966066176. Throughput: 0: 9866.1, 1: 9806.8. Samples: 966029576. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:26,176][105115] Avg episode reward: [(0, '-4.536'), (1, '-4.531')] [2023-12-28 08:48:26,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001888576_483532800.pth... [2023-12-28 08:48:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001884584_482533376.pth... [2023-12-28 08:48:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001887424_483237888.pth [2023-12-28 08:48:26,198][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001883432_482238464.pth [2023-12-28 08:48:26,442][106226] Updated weights for policy 0, policy_version 1884590 (0.0005) [2023-12-28 08:48:26,490][106226] Updated weights for policy 0, policy_version 1884600 (0.0005) [2023-12-28 08:48:26,546][106226] Updated weights for policy 0, policy_version 1884610 (0.0008) [2023-12-28 08:48:26,712][106225] Updated weights for policy 1, policy_version 1888585 (0.0007) [2023-12-28 08:48:26,761][106225] Updated weights for policy 1, policy_version 1888595 (0.0005) [2023-12-28 08:48:26,827][106225] Updated weights for policy 1, policy_version 1888605 (0.0007) [2023-12-28 08:48:27,263][106226] Updated weights for policy 0, policy_version 1884620 (0.0008) [2023-12-28 08:48:27,316][106226] Updated weights for policy 0, policy_version 1884630 (0.0009) [2023-12-28 08:48:27,370][106226] Updated weights for policy 0, policy_version 1884640 (0.0008) [2023-12-28 08:48:27,476][106225] Updated weights for policy 1, policy_version 1888615 (0.0008) [2023-12-28 08:48:27,535][106225] Updated weights for policy 1, policy_version 1888625 (0.0008) [2023-12-28 08:48:27,589][106225] Updated weights for policy 1, policy_version 1888635 (0.0008) [2023-12-28 08:48:28,151][106226] Updated weights for policy 0, policy_version 1884650 (0.0008) [2023-12-28 08:48:28,168][106225] Updated weights for policy 1, policy_version 1888645 (0.0006) [2023-12-28 08:48:28,209][106226] Updated weights for policy 0, policy_version 1884660 (0.0006) [2023-12-28 08:48:28,226][106225] Updated weights for policy 1, policy_version 1888655 (0.0007) [2023-12-28 08:48:28,260][106226] Updated weights for policy 0, policy_version 1884670 (0.0007) [2023-12-28 08:48:28,284][106225] Updated weights for policy 1, policy_version 1888665 (0.0006) [2023-12-28 08:48:28,319][106226] Updated weights for policy 0, policy_version 1884680 (0.0008) [2023-12-28 08:48:28,946][106225] Updated weights for policy 1, policy_version 1888675 (0.0006) [2023-12-28 08:48:29,009][106225] Updated weights for policy 1, policy_version 1888685 (0.0007) [2023-12-28 08:48:29,065][106225] Updated weights for policy 1, policy_version 1888695 (0.0007) [2023-12-28 08:48:29,090][106226] Updated weights for policy 0, policy_version 1884690 (0.0009) [2023-12-28 08:48:29,139][106226] Updated weights for policy 0, policy_version 1884700 (0.0008) [2023-12-28 08:48:29,195][106226] Updated weights for policy 0, policy_version 1884710 (0.0007) [2023-12-28 08:48:29,797][106225] Updated weights for policy 1, policy_version 1888705 (0.0007) [2023-12-28 08:48:29,867][106225] Updated weights for policy 1, policy_version 1888715 (0.0008) [2023-12-28 08:48:29,895][106226] Updated weights for policy 0, policy_version 1884720 (0.0008) [2023-12-28 08:48:29,932][106225] Updated weights for policy 1, policy_version 1888725 (0.0008) [2023-12-28 08:48:29,961][106226] Updated weights for policy 0, policy_version 1884730 (0.0009) [2023-12-28 08:48:29,993][106225] Updated weights for policy 1, policy_version 1888735 (0.0007) [2023-12-28 08:48:30,016][106226] Updated weights for policy 0, policy_version 1884740 (0.0007) [2023-12-28 08:48:30,738][106225] Updated weights for policy 1, policy_version 1888745 (0.0007) [2023-12-28 08:48:30,740][106226] Updated weights for policy 0, policy_version 1884750 (0.0007) [2023-12-28 08:48:30,781][106225] Updated weights for policy 1, policy_version 1888755 (0.0005) [2023-12-28 08:48:30,790][106226] Updated weights for policy 0, policy_version 1884760 (0.0008) [2023-12-28 08:48:30,826][106225] Updated weights for policy 1, policy_version 1888765 (0.0009) [2023-12-28 08:48:30,836][106226] Updated weights for policy 0, policy_version 1884770 (0.0006) [2023-12-28 08:48:31,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 966164480. Throughput: 0: 9931.7, 1: 9968.4. Samples: 966152320. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:31,175][105115] Avg episode reward: [(0, '-4.071'), (1, '-4.680')] [2023-12-28 08:48:31,536][106226] Updated weights for policy 0, policy_version 1884780 (0.0006) [2023-12-28 08:48:31,600][106226] Updated weights for policy 0, policy_version 1884790 (0.0008) [2023-12-28 08:48:31,631][106225] Updated weights for policy 1, policy_version 1888775 (0.0008) [2023-12-28 08:48:31,671][106226] Updated weights for policy 0, policy_version 1884800 (0.0008) [2023-12-28 08:48:31,696][106225] Updated weights for policy 1, policy_version 1888785 (0.0007) [2023-12-28 08:48:31,758][106225] Updated weights for policy 1, policy_version 1888795 (0.0007) [2023-12-28 08:48:32,354][106226] Updated weights for policy 0, policy_version 1884810 (0.0007) [2023-12-28 08:48:32,375][106225] Updated weights for policy 1, policy_version 1888805 (0.0007) [2023-12-28 08:48:32,419][106226] Updated weights for policy 0, policy_version 1884820 (0.0007) [2023-12-28 08:48:32,430][106225] Updated weights for policy 1, policy_version 1888815 (0.0008) [2023-12-28 08:48:32,479][106226] Updated weights for policy 0, policy_version 1884830 (0.0007) [2023-12-28 08:48:32,481][106225] Updated weights for policy 1, policy_version 1888825 (0.0008) [2023-12-28 08:48:32,540][106226] Updated weights for policy 0, policy_version 1884840 (0.0008) [2023-12-28 08:48:33,204][106226] Updated weights for policy 0, policy_version 1884850 (0.0008) [2023-12-28 08:48:33,245][106225] Updated weights for policy 1, policy_version 1888835 (0.0008) [2023-12-28 08:48:33,255][106226] Updated weights for policy 0, policy_version 1884860 (0.0008) [2023-12-28 08:48:33,305][106225] Updated weights for policy 1, policy_version 1888845 (0.0007) [2023-12-28 08:48:33,315][106226] Updated weights for policy 0, policy_version 1884870 (0.0005) [2023-12-28 08:48:33,359][106225] Updated weights for policy 1, policy_version 1888855 (0.0010) [2023-12-28 08:48:33,861][106226] Updated weights for policy 0, policy_version 1884880 (0.0005) [2023-12-28 08:48:33,909][106226] Updated weights for policy 0, policy_version 1884890 (0.0005) [2023-12-28 08:48:33,958][106226] Updated weights for policy 0, policy_version 1884900 (0.0005) [2023-12-28 08:48:34,143][106225] Updated weights for policy 1, policy_version 1888865 (0.0009) [2023-12-28 08:48:34,216][106225] Updated weights for policy 1, policy_version 1888875 (0.0008) [2023-12-28 08:48:34,274][106225] Updated weights for policy 1, policy_version 1888885 (0.0008) [2023-12-28 08:48:34,338][106225] Updated weights for policy 1, policy_version 1888895 (0.0009) [2023-12-28 08:48:34,621][106226] Updated weights for policy 0, policy_version 1884910 (0.0007) [2023-12-28 08:48:34,697][106226] Updated weights for policy 0, policy_version 1884920 (0.0006) [2023-12-28 08:48:34,768][106226] Updated weights for policy 0, policy_version 1884930 (0.0009) [2023-12-28 08:48:35,086][106225] Updated weights for policy 1, policy_version 1888905 (0.0011) [2023-12-28 08:48:35,153][106225] Updated weights for policy 1, policy_version 1888915 (0.0006) [2023-12-28 08:48:35,212][106225] Updated weights for policy 1, policy_version 1888925 (0.0009) [2023-12-28 08:48:35,516][106226] Updated weights for policy 0, policy_version 1884940 (0.0008) [2023-12-28 08:48:35,571][106226] Updated weights for policy 0, policy_version 1884950 (0.0008) [2023-12-28 08:48:35,629][106226] Updated weights for policy 0, policy_version 1884960 (0.0009) [2023-12-28 08:48:35,803][106225] Updated weights for policy 1, policy_version 1888935 (0.0011) [2023-12-28 08:48:35,853][106225] Updated weights for policy 1, policy_version 1888945 (0.0010) [2023-12-28 08:48:35,905][106225] Updated weights for policy 1, policy_version 1888955 (0.0006) [2023-12-28 08:48:36,174][105115] Fps is (10 sec: 19661.4, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 966262784. Throughput: 0: 9990.6, 1: 9868.8. Samples: 966270488. Policy #0 lag: (min: 27.0, avg: 40.1, max: 59.0) [2023-12-28 08:48:36,175][105115] Avg episode reward: [(0, '-4.140'), (1, '-4.809')] [2023-12-28 08:48:36,433][106226] Updated weights for policy 0, policy_version 1884970 (0.0009) [2023-12-28 08:48:36,489][106226] Updated weights for policy 0, policy_version 1884980 (0.0010) [2023-12-28 08:48:36,531][106225] Updated weights for policy 1, policy_version 1888965 (0.0008) [2023-12-28 08:48:36,546][106226] Updated weights for policy 0, policy_version 1884990 (0.0007) [2023-12-28 08:48:36,593][106225] Updated weights for policy 1, policy_version 1888975 (0.0011) [2023-12-28 08:48:36,604][106226] Updated weights for policy 0, policy_version 1885000 (0.0007) [2023-12-28 08:48:36,652][106225] Updated weights for policy 1, policy_version 1888985 (0.0011) [2023-12-28 08:48:37,328][106225] Updated weights for policy 1, policy_version 1888995 (0.0010) [2023-12-28 08:48:37,376][106226] Updated weights for policy 0, policy_version 1885010 (0.0006) [2023-12-28 08:48:37,386][106225] Updated weights for policy 1, policy_version 1889005 (0.0010) [2023-12-28 08:48:37,434][106226] Updated weights for policy 0, policy_version 1885020 (0.0005) [2023-12-28 08:48:37,447][106225] Updated weights for policy 1, policy_version 1889015 (0.0010) [2023-12-28 08:48:37,495][106226] Updated weights for policy 0, policy_version 1885030 (0.0006) [2023-12-28 08:48:38,158][106225] Updated weights for policy 1, policy_version 1889025 (0.0011) [2023-12-28 08:48:38,227][106225] Updated weights for policy 1, policy_version 1889035 (0.0010) [2023-12-28 08:48:38,242][106226] Updated weights for policy 0, policy_version 1885040 (0.0006) [2023-12-28 08:48:38,278][106225] Updated weights for policy 1, policy_version 1889045 (0.0010) [2023-12-28 08:48:38,295][106226] Updated weights for policy 0, policy_version 1885050 (0.0005) [2023-12-28 08:48:38,334][106225] Updated weights for policy 1, policy_version 1889055 (0.0010) [2023-12-28 08:48:38,358][106226] Updated weights for policy 0, policy_version 1885060 (0.0008) [2023-12-28 08:48:39,051][106225] Updated weights for policy 1, policy_version 1889065 (0.0010) [2023-12-28 08:48:39,084][106226] Updated weights for policy 0, policy_version 1885070 (0.0006) [2023-12-28 08:48:39,101][106225] Updated weights for policy 1, policy_version 1889075 (0.0010) [2023-12-28 08:48:39,137][106226] Updated weights for policy 0, policy_version 1885080 (0.0005) [2023-12-28 08:48:39,154][106225] Updated weights for policy 1, policy_version 1889085 (0.0010) [2023-12-28 08:48:39,192][106226] Updated weights for policy 0, policy_version 1885090 (0.0006) [2023-12-28 08:48:39,904][106225] Updated weights for policy 1, policy_version 1889095 (0.0009) [2023-12-28 08:48:39,973][106225] Updated weights for policy 1, policy_version 1889105 (0.0009) [2023-12-28 08:48:39,996][106226] Updated weights for policy 0, policy_version 1885100 (0.0009) [2023-12-28 08:48:40,035][106225] Updated weights for policy 1, policy_version 1889115 (0.0007) [2023-12-28 08:48:40,066][106226] Updated weights for policy 0, policy_version 1885110 (0.0008) [2023-12-28 08:48:40,128][106226] Updated weights for policy 0, policy_version 1885120 (0.0009) [2023-12-28 08:48:40,733][106225] Updated weights for policy 1, policy_version 1889125 (0.0008) [2023-12-28 08:48:40,798][106225] Updated weights for policy 1, policy_version 1889135 (0.0006) [2023-12-28 08:48:40,864][106225] Updated weights for policy 1, policy_version 1889145 (0.0008) [2023-12-28 08:48:40,870][106226] Updated weights for policy 0, policy_version 1885130 (0.0008) [2023-12-28 08:48:40,927][106226] Updated weights for policy 0, policy_version 1885140 (0.0007) [2023-12-28 08:48:40,987][106226] Updated weights for policy 0, policy_version 1885150 (0.0009) [2023-12-28 08:48:41,059][106226] Updated weights for policy 0, policy_version 1885160 (0.0009) [2023-12-28 08:48:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 966361088. Throughput: 0: 9925.4, 1: 9913.8. Samples: 966328716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:48:41,175][105115] Avg episode reward: [(0, '-4.530'), (1, '-4.885')] [2023-12-28 08:48:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001889152_483680256.pth... [2023-12-28 08:48:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001885160_482680832.pth... [2023-12-28 08:48:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001888000_483385344.pth [2023-12-28 08:48:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001884008_482385920.pth [2023-12-28 08:48:41,630][106225] Updated weights for policy 1, policy_version 1889155 (0.0007) [2023-12-28 08:48:41,696][106225] Updated weights for policy 1, policy_version 1889165 (0.0009) [2023-12-28 08:48:41,756][106225] Updated weights for policy 1, policy_version 1889175 (0.0009) [2023-12-28 08:48:41,827][106226] Updated weights for policy 0, policy_version 1885170 (0.0009) [2023-12-28 08:48:41,893][106226] Updated weights for policy 0, policy_version 1885180 (0.0009) [2023-12-28 08:48:41,964][106226] Updated weights for policy 0, policy_version 1885190 (0.0009) [2023-12-28 08:48:42,541][106225] Updated weights for policy 1, policy_version 1889185 (0.0010) [2023-12-28 08:48:42,605][106225] Updated weights for policy 1, policy_version 1889195 (0.0010) [2023-12-28 08:48:42,665][106225] Updated weights for policy 1, policy_version 1889205 (0.0010) [2023-12-28 08:48:42,675][106226] Updated weights for policy 0, policy_version 1885200 (0.0006) [2023-12-28 08:48:42,731][106225] Updated weights for policy 1, policy_version 1889215 (0.0011) [2023-12-28 08:48:42,739][106226] Updated weights for policy 0, policy_version 1885210 (0.0009) [2023-12-28 08:48:42,805][106226] Updated weights for policy 0, policy_version 1885220 (0.0008) [2023-12-28 08:48:43,339][106225] Updated weights for policy 1, policy_version 1889225 (0.0008) [2023-12-28 08:48:43,406][106225] Updated weights for policy 1, policy_version 1889235 (0.0010) [2023-12-28 08:48:43,468][106225] Updated weights for policy 1, policy_version 1889245 (0.0010) [2023-12-28 08:48:43,511][106226] Updated weights for policy 0, policy_version 1885230 (0.0008) [2023-12-28 08:48:43,568][106226] Updated weights for policy 0, policy_version 1885240 (0.0008) [2023-12-28 08:48:43,631][106226] Updated weights for policy 0, policy_version 1885250 (0.0009) [2023-12-28 08:48:44,007][106225] Updated weights for policy 1, policy_version 1889255 (0.0007) [2023-12-28 08:48:44,058][106225] Updated weights for policy 1, policy_version 1889265 (0.0005) [2023-12-28 08:48:44,118][106225] Updated weights for policy 1, policy_version 1889275 (0.0005) [2023-12-28 08:48:44,280][106226] Updated weights for policy 0, policy_version 1885260 (0.0009) [2023-12-28 08:48:44,338][106226] Updated weights for policy 0, policy_version 1885270 (0.0009) [2023-12-28 08:48:44,383][106226] Updated weights for policy 0, policy_version 1885280 (0.0009) [2023-12-28 08:48:44,762][106225] Updated weights for policy 1, policy_version 1889285 (0.0007) [2023-12-28 08:48:44,823][106225] Updated weights for policy 1, policy_version 1889295 (0.0008) [2023-12-28 08:48:44,879][106225] Updated weights for policy 1, policy_version 1889305 (0.0008) [2023-12-28 08:48:45,158][106226] Updated weights for policy 0, policy_version 1885290 (0.0009) [2023-12-28 08:48:45,221][106226] Updated weights for policy 0, policy_version 1885300 (0.0011) [2023-12-28 08:48:45,284][106226] Updated weights for policy 0, policy_version 1885310 (0.0011) [2023-12-28 08:48:45,339][106226] Updated weights for policy 0, policy_version 1885320 (0.0011) [2023-12-28 08:48:45,613][106225] Updated weights for policy 1, policy_version 1889315 (0.0007) [2023-12-28 08:48:45,673][106225] Updated weights for policy 1, policy_version 1889325 (0.0006) [2023-12-28 08:48:45,737][106225] Updated weights for policy 1, policy_version 1889335 (0.0006) [2023-12-28 08:48:45,966][106226] Updated weights for policy 0, policy_version 1885330 (0.0011) [2023-12-28 08:48:46,033][106226] Updated weights for policy 0, policy_version 1885340 (0.0011) [2023-12-28 08:48:46,089][106226] Updated weights for policy 0, policy_version 1885350 (0.0010) [2023-12-28 08:48:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 966459392. Throughput: 0: 9764.5, 1: 9972.3. Samples: 966445296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:48:46,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.670')] [2023-12-28 08:48:46,409][106225] Updated weights for policy 1, policy_version 1889345 (0.0008) [2023-12-28 08:48:46,467][106225] Updated weights for policy 1, policy_version 1889355 (0.0008) [2023-12-28 08:48:46,511][106225] Updated weights for policy 1, policy_version 1889365 (0.0008) [2023-12-28 08:48:46,559][106225] Updated weights for policy 1, policy_version 1889375 (0.0008) [2023-12-28 08:48:46,709][106226] Updated weights for policy 0, policy_version 1885360 (0.0006) [2023-12-28 08:48:46,764][106226] Updated weights for policy 0, policy_version 1885370 (0.0005) [2023-12-28 08:48:46,818][106226] Updated weights for policy 0, policy_version 1885380 (0.0005) [2023-12-28 08:48:47,327][106226] Updated weights for policy 0, policy_version 1885390 (0.0005) [2023-12-28 08:48:47,357][106225] Updated weights for policy 1, policy_version 1889385 (0.0005) [2023-12-28 08:48:47,375][106226] Updated weights for policy 0, policy_version 1885400 (0.0005) [2023-12-28 08:48:47,411][106225] Updated weights for policy 1, policy_version 1889395 (0.0005) [2023-12-28 08:48:47,431][106226] Updated weights for policy 0, policy_version 1885410 (0.0005) [2023-12-28 08:48:47,467][106225] Updated weights for policy 1, policy_version 1889405 (0.0006) [2023-12-28 08:48:48,013][106225] Updated weights for policy 1, policy_version 1889415 (0.0007) [2023-12-28 08:48:48,060][106225] Updated weights for policy 1, policy_version 1889425 (0.0010) [2023-12-28 08:48:48,064][106226] Updated weights for policy 0, policy_version 1885420 (0.0007) [2023-12-28 08:48:48,112][106226] Updated weights for policy 0, policy_version 1885430 (0.0006) [2023-12-28 08:48:48,116][106225] Updated weights for policy 1, policy_version 1889435 (0.0010) [2023-12-28 08:48:48,170][106226] Updated weights for policy 0, policy_version 1885440 (0.0007) [2023-12-28 08:48:48,768][106225] Updated weights for policy 1, policy_version 1889445 (0.0008) [2023-12-28 08:48:48,825][106225] Updated weights for policy 1, policy_version 1889455 (0.0005) [2023-12-28 08:48:48,884][106225] Updated weights for policy 1, policy_version 1889465 (0.0005) [2023-12-28 08:48:48,991][106226] Updated weights for policy 0, policy_version 1885450 (0.0008) [2023-12-28 08:48:49,034][106226] Updated weights for policy 0, policy_version 1885460 (0.0007) [2023-12-28 08:48:49,082][106226] Updated weights for policy 0, policy_version 1885470 (0.0008) [2023-12-28 08:48:49,139][106226] Updated weights for policy 0, policy_version 1885480 (0.0009) [2023-12-28 08:48:49,597][106225] Updated weights for policy 1, policy_version 1889475 (0.0010) [2023-12-28 08:48:49,660][106225] Updated weights for policy 1, policy_version 1889485 (0.0008) [2023-12-28 08:48:49,714][106225] Updated weights for policy 1, policy_version 1889495 (0.0008) [2023-12-28 08:48:49,895][106226] Updated weights for policy 0, policy_version 1885490 (0.0007) [2023-12-28 08:48:49,966][106226] Updated weights for policy 0, policy_version 1885500 (0.0007) [2023-12-28 08:48:50,026][106226] Updated weights for policy 0, policy_version 1885510 (0.0008) [2023-12-28 08:48:50,490][106225] Updated weights for policy 1, policy_version 1889505 (0.0007) [2023-12-28 08:48:50,539][106225] Updated weights for policy 1, policy_version 1889515 (0.0010) [2023-12-28 08:48:50,615][106225] Updated weights for policy 1, policy_version 1889525 (0.0010) [2023-12-28 08:48:50,676][106225] Updated weights for policy 1, policy_version 1889535 (0.0010) [2023-12-28 08:48:50,703][106226] Updated weights for policy 0, policy_version 1885520 (0.0006) [2023-12-28 08:48:50,758][106226] Updated weights for policy 0, policy_version 1885530 (0.0008) [2023-12-28 08:48:50,815][106226] Updated weights for policy 0, policy_version 1885540 (0.0008) [2023-12-28 08:48:51,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 966557696. Throughput: 0: 9789.0, 1: 9953.7. Samples: 966566432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:48:51,175][105115] Avg episode reward: [(0, '-4.324'), (1, '-4.536')] [2023-12-28 08:48:51,409][106225] Updated weights for policy 1, policy_version 1889545 (0.0009) [2023-12-28 08:48:51,464][106225] Updated weights for policy 1, policy_version 1889555 (0.0005) [2023-12-28 08:48:51,516][106225] Updated weights for policy 1, policy_version 1889565 (0.0005) [2023-12-28 08:48:51,586][106226] Updated weights for policy 0, policy_version 1885550 (0.0008) [2023-12-28 08:48:51,659][106226] Updated weights for policy 0, policy_version 1885560 (0.0007) [2023-12-28 08:48:51,727][106226] Updated weights for policy 0, policy_version 1885570 (0.0008) [2023-12-28 08:48:52,253][106225] Updated weights for policy 1, policy_version 1889575 (0.0008) [2023-12-28 08:48:52,319][106225] Updated weights for policy 1, policy_version 1889585 (0.0012) [2023-12-28 08:48:52,396][106225] Updated weights for policy 1, policy_version 1889595 (0.0010) [2023-12-28 08:48:52,504][106226] Updated weights for policy 0, policy_version 1885580 (0.0007) [2023-12-28 08:48:52,568][106226] Updated weights for policy 0, policy_version 1885590 (0.0005) [2023-12-28 08:48:52,633][106226] Updated weights for policy 0, policy_version 1885600 (0.0007) [2023-12-28 08:48:53,112][106225] Updated weights for policy 1, policy_version 1889605 (0.0008) [2023-12-28 08:48:53,173][106225] Updated weights for policy 1, policy_version 1889615 (0.0007) [2023-12-28 08:48:53,226][106225] Updated weights for policy 1, policy_version 1889625 (0.0007) [2023-12-28 08:48:53,322][106226] Updated weights for policy 0, policy_version 1885610 (0.0008) [2023-12-28 08:48:53,369][106226] Updated weights for policy 0, policy_version 1885620 (0.0007) [2023-12-28 08:48:53,419][106226] Updated weights for policy 0, policy_version 1885630 (0.0008) [2023-12-28 08:48:53,463][106226] Updated weights for policy 0, policy_version 1885640 (0.0008) [2023-12-28 08:48:53,869][106225] Updated weights for policy 1, policy_version 1889635 (0.0006) [2023-12-28 08:48:53,923][106225] Updated weights for policy 1, policy_version 1889645 (0.0005) [2023-12-28 08:48:53,977][106225] Updated weights for policy 1, policy_version 1889655 (0.0005) [2023-12-28 08:48:54,077][106226] Updated weights for policy 0, policy_version 1885650 (0.0005) [2023-12-28 08:48:54,131][106226] Updated weights for policy 0, policy_version 1885660 (0.0006) [2023-12-28 08:48:54,194][106226] Updated weights for policy 0, policy_version 1885670 (0.0006) [2023-12-28 08:48:54,654][106225] Updated weights for policy 1, policy_version 1889665 (0.0009) [2023-12-28 08:48:54,714][106225] Updated weights for policy 1, policy_version 1889675 (0.0006) [2023-12-28 08:48:54,766][106225] Updated weights for policy 1, policy_version 1889685 (0.0006) [2023-12-28 08:48:54,831][106225] Updated weights for policy 1, policy_version 1889695 (0.0005) [2023-12-28 08:48:54,882][106226] Updated weights for policy 0, policy_version 1885680 (0.0008) [2023-12-28 08:48:54,940][106226] Updated weights for policy 0, policy_version 1885690 (0.0008) [2023-12-28 08:48:55,004][106226] Updated weights for policy 0, policy_version 1885700 (0.0009) [2023-12-28 08:48:55,449][106225] Updated weights for policy 1, policy_version 1889705 (0.0010) [2023-12-28 08:48:55,510][106225] Updated weights for policy 1, policy_version 1889715 (0.0010) [2023-12-28 08:48:55,570][106225] Updated weights for policy 1, policy_version 1889725 (0.0010) [2023-12-28 08:48:55,758][106226] Updated weights for policy 0, policy_version 1885710 (0.0009) [2023-12-28 08:48:55,816][106226] Updated weights for policy 0, policy_version 1885720 (0.0007) [2023-12-28 08:48:55,871][106226] Updated weights for policy 0, policy_version 1885730 (0.0007) [2023-12-28 08:48:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 966656000. Throughput: 0: 9784.2, 1: 9935.3. Samples: 966625924. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:48:56,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.735')] [2023-12-28 08:48:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001889728_483827712.pth... [2023-12-28 08:48:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001885736_482828288.pth... [2023-12-28 08:48:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001888576_483532800.pth [2023-12-28 08:48:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001884584_482533376.pth [2023-12-28 08:48:56,295][106225] Updated weights for policy 1, policy_version 1889735 (0.0009) [2023-12-28 08:48:56,348][106225] Updated weights for policy 1, policy_version 1889745 (0.0008) [2023-12-28 08:48:56,413][106225] Updated weights for policy 1, policy_version 1889755 (0.0008) [2023-12-28 08:48:56,520][106226] Updated weights for policy 0, policy_version 1885740 (0.0006) [2023-12-28 08:48:56,568][106226] Updated weights for policy 0, policy_version 1885750 (0.0005) [2023-12-28 08:48:56,618][106226] Updated weights for policy 0, policy_version 1885760 (0.0005) [2023-12-28 08:48:57,156][106225] Updated weights for policy 1, policy_version 1889765 (0.0008) [2023-12-28 08:48:57,208][106225] Updated weights for policy 1, policy_version 1889775 (0.0010) [2023-12-28 08:48:57,249][106226] Updated weights for policy 0, policy_version 1885770 (0.0010) [2023-12-28 08:48:57,264][106225] Updated weights for policy 1, policy_version 1889785 (0.0010) [2023-12-28 08:48:57,305][106226] Updated weights for policy 0, policy_version 1885780 (0.0010) [2023-12-28 08:48:57,365][106226] Updated weights for policy 0, policy_version 1885790 (0.0010) [2023-12-28 08:48:57,413][106226] Updated weights for policy 0, policy_version 1885800 (0.0010) [2023-12-28 08:48:57,981][106225] Updated weights for policy 1, policy_version 1889795 (0.0010) [2023-12-28 08:48:58,035][106225] Updated weights for policy 1, policy_version 1889805 (0.0010) [2023-12-28 08:48:58,054][106226] Updated weights for policy 0, policy_version 1885810 (0.0007) [2023-12-28 08:48:58,090][106225] Updated weights for policy 1, policy_version 1889815 (0.0010) [2023-12-28 08:48:58,108][106226] Updated weights for policy 0, policy_version 1885820 (0.0005) [2023-12-28 08:48:58,158][106226] Updated weights for policy 0, policy_version 1885830 (0.0006) [2023-12-28 08:48:58,948][106226] Updated weights for policy 0, policy_version 1885840 (0.0009) [2023-12-28 08:48:58,951][106225] Updated weights for policy 1, policy_version 1889825 (0.0010) [2023-12-28 08:48:59,006][106226] Updated weights for policy 0, policy_version 1885850 (0.0011) [2023-12-28 08:48:59,013][106225] Updated weights for policy 1, policy_version 1889835 (0.0008) [2023-12-28 08:48:59,061][106226] Updated weights for policy 0, policy_version 1885860 (0.0008) [2023-12-28 08:48:59,074][106225] Updated weights for policy 1, policy_version 1889845 (0.0008) [2023-12-28 08:48:59,139][106225] Updated weights for policy 1, policy_version 1889855 (0.0006) [2023-12-28 08:48:59,792][106226] Updated weights for policy 0, policy_version 1885870 (0.0008) [2023-12-28 08:48:59,826][106225] Updated weights for policy 1, policy_version 1889865 (0.0006) [2023-12-28 08:48:59,857][106226] Updated weights for policy 0, policy_version 1885880 (0.0008) [2023-12-28 08:48:59,892][106225] Updated weights for policy 1, policy_version 1889875 (0.0008) [2023-12-28 08:48:59,915][106226] Updated weights for policy 0, policy_version 1885890 (0.0007) [2023-12-28 08:48:59,959][106225] Updated weights for policy 1, policy_version 1889885 (0.0009) [2023-12-28 08:49:00,587][106225] Updated weights for policy 1, policy_version 1889895 (0.0007) [2023-12-28 08:49:00,642][106225] Updated weights for policy 1, policy_version 1889905 (0.0005) [2023-12-28 08:49:00,688][106226] Updated weights for policy 0, policy_version 1885900 (0.0007) [2023-12-28 08:49:00,695][106225] Updated weights for policy 1, policy_version 1889915 (0.0006) [2023-12-28 08:49:00,742][106226] Updated weights for policy 0, policy_version 1885910 (0.0007) [2023-12-28 08:49:00,797][106226] Updated weights for policy 0, policy_version 1885920 (0.0008) [2023-12-28 08:49:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 966754304. Throughput: 0: 9829.3, 1: 9926.3. Samples: 966743668. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:01,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.747')] [2023-12-28 08:49:01,324][106225] Updated weights for policy 1, policy_version 1889925 (0.0007) [2023-12-28 08:49:01,398][106225] Updated weights for policy 1, policy_version 1889935 (0.0008) [2023-12-28 08:49:01,457][106225] Updated weights for policy 1, policy_version 1889945 (0.0008) [2023-12-28 08:49:01,585][106226] Updated weights for policy 0, policy_version 1885930 (0.0008) [2023-12-28 08:49:01,646][106226] Updated weights for policy 0, policy_version 1885940 (0.0008) [2023-12-28 08:49:01,712][106226] Updated weights for policy 0, policy_version 1885950 (0.0007) [2023-12-28 08:49:01,779][106226] Updated weights for policy 0, policy_version 1885960 (0.0008) [2023-12-28 08:49:02,174][106225] Updated weights for policy 1, policy_version 1889955 (0.0007) [2023-12-28 08:49:02,221][106225] Updated weights for policy 1, policy_version 1889965 (0.0005) [2023-12-28 08:49:02,283][106225] Updated weights for policy 1, policy_version 1889975 (0.0009) [2023-12-28 08:49:02,467][106226] Updated weights for policy 0, policy_version 1885970 (0.0009) [2023-12-28 08:49:02,529][106226] Updated weights for policy 0, policy_version 1885980 (0.0008) [2023-12-28 08:49:02,582][106226] Updated weights for policy 0, policy_version 1885990 (0.0008) [2023-12-28 08:49:02,869][106225] Updated weights for policy 1, policy_version 1889985 (0.0008) [2023-12-28 08:49:02,926][106225] Updated weights for policy 1, policy_version 1889995 (0.0005) [2023-12-28 08:49:02,980][106225] Updated weights for policy 1, policy_version 1890005 (0.0007) [2023-12-28 08:49:03,031][106225] Updated weights for policy 1, policy_version 1890015 (0.0009) [2023-12-28 08:49:03,390][106226] Updated weights for policy 0, policy_version 1886000 (0.0008) [2023-12-28 08:49:03,449][106226] Updated weights for policy 0, policy_version 1886010 (0.0005) [2023-12-28 08:49:03,499][106226] Updated weights for policy 0, policy_version 1886020 (0.0006) [2023-12-28 08:49:03,638][106225] Updated weights for policy 1, policy_version 1890025 (0.0008) [2023-12-28 08:49:03,681][106225] Updated weights for policy 1, policy_version 1890035 (0.0007) [2023-12-28 08:49:03,732][106225] Updated weights for policy 1, policy_version 1890045 (0.0008) [2023-12-28 08:49:04,148][106226] Updated weights for policy 0, policy_version 1886030 (0.0006) [2023-12-28 08:49:04,213][106226] Updated weights for policy 0, policy_version 1886040 (0.0008) [2023-12-28 08:49:04,284][106226] Updated weights for policy 0, policy_version 1886050 (0.0009) [2023-12-28 08:49:04,387][106225] Updated weights for policy 1, policy_version 1890055 (0.0009) [2023-12-28 08:49:04,449][106225] Updated weights for policy 1, policy_version 1890065 (0.0007) [2023-12-28 08:49:04,502][106225] Updated weights for policy 1, policy_version 1890075 (0.0009) [2023-12-28 08:49:04,984][106226] Updated weights for policy 0, policy_version 1886060 (0.0010) [2023-12-28 08:49:05,035][106226] Updated weights for policy 0, policy_version 1886070 (0.0008) [2023-12-28 08:49:05,080][106226] Updated weights for policy 0, policy_version 1886080 (0.0007) [2023-12-28 08:49:05,137][106225] Updated weights for policy 1, policy_version 1890085 (0.0008) [2023-12-28 08:49:05,197][106225] Updated weights for policy 1, policy_version 1890095 (0.0005) [2023-12-28 08:49:05,259][106225] Updated weights for policy 1, policy_version 1890105 (0.0005) [2023-12-28 08:49:05,823][106226] Updated weights for policy 0, policy_version 1886090 (0.0007) [2023-12-28 08:49:05,848][106225] Updated weights for policy 1, policy_version 1890115 (0.0007) [2023-12-28 08:49:05,882][106226] Updated weights for policy 0, policy_version 1886100 (0.0008) [2023-12-28 08:49:05,913][106225] Updated weights for policy 1, policy_version 1890125 (0.0008) [2023-12-28 08:49:05,934][106226] Updated weights for policy 0, policy_version 1886110 (0.0007) [2023-12-28 08:49:05,977][106225] Updated weights for policy 1, policy_version 1890135 (0.0010) [2023-12-28 08:49:05,994][106226] Updated weights for policy 0, policy_version 1886120 (0.0007) [2023-12-28 08:49:06,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 966860800. Throughput: 0: 9769.4, 1: 10049.9. Samples: 966865132. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:06,175][105115] Avg episode reward: [(0, '-4.060'), (1, '-4.711')] [2023-12-28 08:49:06,695][106225] Updated weights for policy 1, policy_version 1890145 (0.0010) [2023-12-28 08:49:06,731][106226] Updated weights for policy 0, policy_version 1886130 (0.0011) [2023-12-28 08:49:06,752][106225] Updated weights for policy 1, policy_version 1890155 (0.0010) [2023-12-28 08:49:06,794][106226] Updated weights for policy 0, policy_version 1886140 (0.0010) [2023-12-28 08:49:06,816][106225] Updated weights for policy 1, policy_version 1890165 (0.0010) [2023-12-28 08:49:06,841][106226] Updated weights for policy 0, policy_version 1886150 (0.0010) [2023-12-28 08:49:06,870][106225] Updated weights for policy 1, policy_version 1890175 (0.0010) [2023-12-28 08:49:07,498][106225] Updated weights for policy 1, policy_version 1890185 (0.0007) [2023-12-28 08:49:07,549][106225] Updated weights for policy 1, policy_version 1890195 (0.0010) [2023-12-28 08:49:07,567][106226] Updated weights for policy 0, policy_version 1886160 (0.0011) [2023-12-28 08:49:07,611][106225] Updated weights for policy 1, policy_version 1890205 (0.0010) [2023-12-28 08:49:07,627][106226] Updated weights for policy 0, policy_version 1886170 (0.0011) [2023-12-28 08:49:07,691][106226] Updated weights for policy 0, policy_version 1886180 (0.0010) [2023-12-28 08:49:08,173][106225] Updated weights for policy 1, policy_version 1890215 (0.0007) [2023-12-28 08:49:08,223][106225] Updated weights for policy 1, policy_version 1890225 (0.0005) [2023-12-28 08:49:08,277][106225] Updated weights for policy 1, policy_version 1890235 (0.0006) [2023-12-28 08:49:08,355][106226] Updated weights for policy 0, policy_version 1886190 (0.0009) [2023-12-28 08:49:08,406][106226] Updated weights for policy 0, policy_version 1886200 (0.0009) [2023-12-28 08:49:08,463][106226] Updated weights for policy 0, policy_version 1886210 (0.0010) [2023-12-28 08:49:08,916][106225] Updated weights for policy 1, policy_version 1890245 (0.0007) [2023-12-28 08:49:08,981][106225] Updated weights for policy 1, policy_version 1890255 (0.0008) [2023-12-28 08:49:09,043][106225] Updated weights for policy 1, policy_version 1890265 (0.0008) [2023-12-28 08:49:09,217][106226] Updated weights for policy 0, policy_version 1886220 (0.0011) [2023-12-28 08:49:09,285][106226] Updated weights for policy 0, policy_version 1886230 (0.0011) [2023-12-28 08:49:09,346][106226] Updated weights for policy 0, policy_version 1886240 (0.0011) [2023-12-28 08:49:09,808][106225] Updated weights for policy 1, policy_version 1890275 (0.0008) [2023-12-28 08:49:09,879][106225] Updated weights for policy 1, policy_version 1890285 (0.0010) [2023-12-28 08:49:09,945][106225] Updated weights for policy 1, policy_version 1890295 (0.0008) [2023-12-28 08:49:10,137][106226] Updated weights for policy 0, policy_version 1886250 (0.0009) [2023-12-28 08:49:10,191][106226] Updated weights for policy 0, policy_version 1886260 (0.0008) [2023-12-28 08:49:10,243][106226] Updated weights for policy 0, policy_version 1886270 (0.0009) [2023-12-28 08:49:10,297][106226] Updated weights for policy 0, policy_version 1886280 (0.0007) [2023-12-28 08:49:10,670][106225] Updated weights for policy 1, policy_version 1890305 (0.0008) [2023-12-28 08:49:10,726][106225] Updated weights for policy 1, policy_version 1890315 (0.0008) [2023-12-28 08:49:10,777][106225] Updated weights for policy 1, policy_version 1890325 (0.0005) [2023-12-28 08:49:10,833][106225] Updated weights for policy 1, policy_version 1890335 (0.0005) [2023-12-28 08:49:11,049][106226] Updated weights for policy 0, policy_version 1886290 (0.0008) [2023-12-28 08:49:11,114][106226] Updated weights for policy 0, policy_version 1886300 (0.0009) [2023-12-28 08:49:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 966950912. Throughput: 0: 9801.5, 1: 10136.6. Samples: 966926784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:11,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.972')] [2023-12-28 08:49:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001890336_483983360.pth... [2023-12-28 08:49:11,186][106226] Updated weights for policy 0, policy_version 1886310 (0.0008) [2023-12-28 08:49:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001889152_483680256.pth [2023-12-28 08:49:11,198][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001886312_482975744.pth... [2023-12-28 08:49:11,201][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001885160_482680832.pth [2023-12-28 08:49:11,583][106225] Updated weights for policy 1, policy_version 1890345 (0.0009) [2023-12-28 08:49:11,656][106225] Updated weights for policy 1, policy_version 1890355 (0.0008) [2023-12-28 08:49:11,718][106225] Updated weights for policy 1, policy_version 1890365 (0.0008) [2023-12-28 08:49:11,921][106226] Updated weights for policy 0, policy_version 1886320 (0.0009) [2023-12-28 08:49:11,984][106226] Updated weights for policy 0, policy_version 1886330 (0.0009) [2023-12-28 08:49:12,044][106226] Updated weights for policy 0, policy_version 1886340 (0.0008) [2023-12-28 08:49:12,456][106225] Updated weights for policy 1, policy_version 1890375 (0.0009) [2023-12-28 08:49:12,520][106225] Updated weights for policy 1, policy_version 1890385 (0.0008) [2023-12-28 08:49:12,576][106225] Updated weights for policy 1, policy_version 1890395 (0.0008) [2023-12-28 08:49:12,811][106226] Updated weights for policy 0, policy_version 1886350 (0.0009) [2023-12-28 08:49:12,877][106226] Updated weights for policy 0, policy_version 1886360 (0.0008) [2023-12-28 08:49:12,934][106226] Updated weights for policy 0, policy_version 1886370 (0.0006) [2023-12-28 08:49:13,351][106225] Updated weights for policy 1, policy_version 1890405 (0.0009) [2023-12-28 08:49:13,411][106225] Updated weights for policy 1, policy_version 1890415 (0.0010) [2023-12-28 08:49:13,464][106225] Updated weights for policy 1, policy_version 1890425 (0.0009) [2023-12-28 08:49:13,630][106226] Updated weights for policy 0, policy_version 1886380 (0.0006) [2023-12-28 08:49:13,685][106226] Updated weights for policy 0, policy_version 1886390 (0.0008) [2023-12-28 08:49:13,731][106226] Updated weights for policy 0, policy_version 1886400 (0.0007) [2023-12-28 08:49:14,183][106225] Updated weights for policy 1, policy_version 1890435 (0.0008) [2023-12-28 08:49:14,243][106225] Updated weights for policy 1, policy_version 1890445 (0.0010) [2023-12-28 08:49:14,301][106225] Updated weights for policy 1, policy_version 1890455 (0.0010) [2023-12-28 08:49:14,493][106226] Updated weights for policy 0, policy_version 1886410 (0.0008) [2023-12-28 08:49:14,547][106226] Updated weights for policy 0, policy_version 1886420 (0.0007) [2023-12-28 08:49:14,609][106226] Updated weights for policy 0, policy_version 1886430 (0.0008) [2023-12-28 08:49:14,664][106226] Updated weights for policy 0, policy_version 1886440 (0.0007) [2023-12-28 08:49:15,022][106225] Updated weights for policy 1, policy_version 1890465 (0.0010) [2023-12-28 08:49:15,089][106225] Updated weights for policy 1, policy_version 1890475 (0.0006) [2023-12-28 08:49:15,154][106225] Updated weights for policy 1, policy_version 1890485 (0.0009) [2023-12-28 08:49:15,218][106225] Updated weights for policy 1, policy_version 1890495 (0.0009) [2023-12-28 08:49:15,461][106226] Updated weights for policy 0, policy_version 1886450 (0.0006) [2023-12-28 08:49:15,512][106226] Updated weights for policy 0, policy_version 1886460 (0.0005) [2023-12-28 08:49:15,570][106226] Updated weights for policy 0, policy_version 1886470 (0.0006) [2023-12-28 08:49:15,775][106225] Updated weights for policy 1, policy_version 1890505 (0.0006) [2023-12-28 08:49:15,837][106225] Updated weights for policy 1, policy_version 1890515 (0.0005) [2023-12-28 08:49:15,885][106225] Updated weights for policy 1, policy_version 1890525 (0.0005) [2023-12-28 08:49:16,117][106226] Updated weights for policy 0, policy_version 1886480 (0.0006) [2023-12-28 08:49:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 967049216. Throughput: 0: 9729.6, 1: 9966.6. Samples: 967038648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:16,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-4.492')] [2023-12-28 08:49:16,184][106226] Updated weights for policy 0, policy_version 1886490 (0.0006) [2023-12-28 08:49:16,244][106226] Updated weights for policy 0, policy_version 1886500 (0.0006) [2023-12-28 08:49:16,479][106225] Updated weights for policy 1, policy_version 1890535 (0.0008) [2023-12-28 08:49:16,539][106225] Updated weights for policy 1, policy_version 1890545 (0.0007) [2023-12-28 08:49:16,598][106225] Updated weights for policy 1, policy_version 1890555 (0.0008) [2023-12-28 08:49:16,835][106226] Updated weights for policy 0, policy_version 1886510 (0.0007) [2023-12-28 08:49:16,886][106226] Updated weights for policy 0, policy_version 1886520 (0.0011) [2023-12-28 08:49:16,941][106226] Updated weights for policy 0, policy_version 1886530 (0.0008) [2023-12-28 08:49:17,331][106225] Updated weights for policy 1, policy_version 1890565 (0.0008) [2023-12-28 08:49:17,388][106225] Updated weights for policy 1, policy_version 1890575 (0.0010) [2023-12-28 08:49:17,437][106225] Updated weights for policy 1, policy_version 1890585 (0.0008) [2023-12-28 08:49:17,539][106226] Updated weights for policy 0, policy_version 1886540 (0.0005) [2023-12-28 08:49:17,604][106226] Updated weights for policy 0, policy_version 1886550 (0.0006) [2023-12-28 08:49:17,657][106226] Updated weights for policy 0, policy_version 1886560 (0.0010) [2023-12-28 08:49:18,182][106225] Updated weights for policy 1, policy_version 1890595 (0.0008) [2023-12-28 08:49:18,242][106226] Updated weights for policy 0, policy_version 1886570 (0.0010) [2023-12-28 08:49:18,244][106225] Updated weights for policy 1, policy_version 1890605 (0.0007) [2023-12-28 08:49:18,300][106225] Updated weights for policy 1, policy_version 1890615 (0.0010) [2023-12-28 08:49:18,302][106226] Updated weights for policy 0, policy_version 1886580 (0.0010) [2023-12-28 08:49:18,381][106226] Updated weights for policy 0, policy_version 1886590 (0.0010) [2023-12-28 08:49:18,449][106226] Updated weights for policy 0, policy_version 1886600 (0.0009) [2023-12-28 08:49:18,962][106225] Updated weights for policy 1, policy_version 1890625 (0.0011) [2023-12-28 08:49:19,029][106225] Updated weights for policy 1, policy_version 1890635 (0.0009) [2023-12-28 08:49:19,087][106226] Updated weights for policy 0, policy_version 1886610 (0.0005) [2023-12-28 08:49:19,096][106225] Updated weights for policy 1, policy_version 1890645 (0.0005) [2023-12-28 08:49:19,136][106226] Updated weights for policy 0, policy_version 1886620 (0.0008) [2023-12-28 08:49:19,152][106225] Updated weights for policy 1, policy_version 1890655 (0.0008) [2023-12-28 08:49:19,180][106226] Updated weights for policy 0, policy_version 1886630 (0.0008) [2023-12-28 08:49:19,860][106225] Updated weights for policy 1, policy_version 1890665 (0.0008) [2023-12-28 08:49:19,906][106226] Updated weights for policy 0, policy_version 1886640 (0.0008) [2023-12-28 08:49:19,922][106225] Updated weights for policy 1, policy_version 1890675 (0.0008) [2023-12-28 08:49:19,977][106226] Updated weights for policy 0, policy_version 1886650 (0.0009) [2023-12-28 08:49:19,979][106225] Updated weights for policy 1, policy_version 1890685 (0.0007) [2023-12-28 08:49:20,045][106226] Updated weights for policy 0, policy_version 1886660 (0.0007) [2023-12-28 08:49:20,736][106225] Updated weights for policy 1, policy_version 1890695 (0.0007) [2023-12-28 08:49:20,790][106225] Updated weights for policy 1, policy_version 1890705 (0.0008) [2023-12-28 08:49:20,813][106226] Updated weights for policy 0, policy_version 1886670 (0.0008) [2023-12-28 08:49:20,847][106225] Updated weights for policy 1, policy_version 1890715 (0.0006) [2023-12-28 08:49:20,869][106226] Updated weights for policy 0, policy_version 1886680 (0.0008) [2023-12-28 08:49:20,929][106226] Updated weights for policy 0, policy_version 1886690 (0.0008) [2023-12-28 08:49:21,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 967155712. Throughput: 0: 9783.0, 1: 10019.3. Samples: 967161592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:21,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.409')] [2023-12-28 08:49:21,631][106225] Updated weights for policy 1, policy_version 1890725 (0.0008) [2023-12-28 08:49:21,689][106226] Updated weights for policy 0, policy_version 1886700 (0.0008) [2023-12-28 08:49:21,691][106225] Updated weights for policy 1, policy_version 1890735 (0.0007) [2023-12-28 08:49:21,754][106226] Updated weights for policy 0, policy_version 1886710 (0.0008) [2023-12-28 08:49:21,762][106225] Updated weights for policy 1, policy_version 1890745 (0.0009) [2023-12-28 08:49:21,821][106226] Updated weights for policy 0, policy_version 1886720 (0.0007) [2023-12-28 08:49:22,447][106225] Updated weights for policy 1, policy_version 1890755 (0.0008) [2023-12-28 08:49:22,514][106225] Updated weights for policy 1, policy_version 1890765 (0.0008) [2023-12-28 08:49:22,606][106225] Updated weights for policy 1, policy_version 1890775 (0.0008) [2023-12-28 08:49:22,649][106226] Updated weights for policy 0, policy_version 1886730 (0.0008) [2023-12-28 08:49:22,714][106226] Updated weights for policy 0, policy_version 1886740 (0.0009) [2023-12-28 08:49:22,777][106226] Updated weights for policy 0, policy_version 1886750 (0.0008) [2023-12-28 08:49:22,836][106226] Updated weights for policy 0, policy_version 1886760 (0.0008) [2023-12-28 08:49:23,261][106225] Updated weights for policy 1, policy_version 1890785 (0.0006) [2023-12-28 08:49:23,314][106225] Updated weights for policy 1, policy_version 1890795 (0.0006) [2023-12-28 08:49:23,366][106225] Updated weights for policy 1, policy_version 1890805 (0.0008) [2023-12-28 08:49:23,420][106225] Updated weights for policy 1, policy_version 1890815 (0.0008) [2023-12-28 08:49:23,591][106226] Updated weights for policy 0, policy_version 1886770 (0.0010) [2023-12-28 08:49:23,641][106226] Updated weights for policy 0, policy_version 1886780 (0.0008) [2023-12-28 08:49:23,697][106226] Updated weights for policy 0, policy_version 1886790 (0.0008) [2023-12-28 08:49:24,127][106225] Updated weights for policy 1, policy_version 1890825 (0.0010) [2023-12-28 08:49:24,192][106225] Updated weights for policy 1, policy_version 1890835 (0.0010) [2023-12-28 08:49:24,262][106225] Updated weights for policy 1, policy_version 1890845 (0.0010) [2023-12-28 08:49:24,426][106226] Updated weights for policy 0, policy_version 1886800 (0.0010) [2023-12-28 08:49:24,473][106226] Updated weights for policy 0, policy_version 1886810 (0.0010) [2023-12-28 08:49:24,519][106226] Updated weights for policy 0, policy_version 1886820 (0.0010) [2023-12-28 08:49:24,934][106225] Updated weights for policy 1, policy_version 1890855 (0.0010) [2023-12-28 08:49:24,990][106225] Updated weights for policy 1, policy_version 1890865 (0.0010) [2023-12-28 08:49:25,049][106225] Updated weights for policy 1, policy_version 1890875 (0.0010) [2023-12-28 08:49:25,202][106226] Updated weights for policy 0, policy_version 1886830 (0.0007) [2023-12-28 08:49:25,252][106226] Updated weights for policy 0, policy_version 1886840 (0.0005) [2023-12-28 08:49:25,302][106226] Updated weights for policy 0, policy_version 1886850 (0.0005) [2023-12-28 08:49:25,632][106225] Updated weights for policy 1, policy_version 1890885 (0.0006) [2023-12-28 08:49:25,703][106225] Updated weights for policy 1, policy_version 1890895 (0.0005) [2023-12-28 08:49:25,764][106225] Updated weights for policy 1, policy_version 1890905 (0.0005) [2023-12-28 08:49:25,881][106226] Updated weights for policy 0, policy_version 1886860 (0.0007) [2023-12-28 08:49:25,943][106226] Updated weights for policy 0, policy_version 1886870 (0.0010) [2023-12-28 08:49:26,010][106226] Updated weights for policy 0, policy_version 1886880 (0.0011) [2023-12-28 08:49:26,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 967254016. Throughput: 0: 9769.2, 1: 9990.9. Samples: 967217916. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:26,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.596')] [2023-12-28 08:49:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001890912_484130816.pth... [2023-12-28 08:49:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001886888_483123200.pth... [2023-12-28 08:49:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001889728_483827712.pth [2023-12-28 08:49:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001885736_482828288.pth [2023-12-28 08:49:26,370][106225] Updated weights for policy 1, policy_version 1890915 (0.0007) [2023-12-28 08:49:26,427][106225] Updated weights for policy 1, policy_version 1890925 (0.0010) [2023-12-28 08:49:26,488][106225] Updated weights for policy 1, policy_version 1890935 (0.0010) [2023-12-28 08:49:26,560][106226] Updated weights for policy 0, policy_version 1886890 (0.0007) [2023-12-28 08:49:26,620][106226] Updated weights for policy 0, policy_version 1886900 (0.0010) [2023-12-28 08:49:26,690][106226] Updated weights for policy 0, policy_version 1886910 (0.0011) [2023-12-28 08:49:26,761][106226] Updated weights for policy 0, policy_version 1886920 (0.0007) [2023-12-28 08:49:27,125][106225] Updated weights for policy 1, policy_version 1890945 (0.0010) [2023-12-28 08:49:27,190][106225] Updated weights for policy 1, policy_version 1890955 (0.0008) [2023-12-28 08:49:27,251][106225] Updated weights for policy 1, policy_version 1890965 (0.0007) [2023-12-28 08:49:27,314][106225] Updated weights for policy 1, policy_version 1890975 (0.0009) [2023-12-28 08:49:27,356][106226] Updated weights for policy 0, policy_version 1886930 (0.0007) [2023-12-28 08:49:27,405][106226] Updated weights for policy 0, policy_version 1886940 (0.0007) [2023-12-28 08:49:27,450][106226] Updated weights for policy 0, policy_version 1886950 (0.0008) [2023-12-28 08:49:27,902][106225] Updated weights for policy 1, policy_version 1890985 (0.0006) [2023-12-28 08:49:27,959][106225] Updated weights for policy 1, policy_version 1890995 (0.0005) [2023-12-28 08:49:28,015][106225] Updated weights for policy 1, policy_version 1891005 (0.0005) [2023-12-28 08:49:28,303][106226] Updated weights for policy 0, policy_version 1886960 (0.0006) [2023-12-28 08:49:28,371][106226] Updated weights for policy 0, policy_version 1886970 (0.0007) [2023-12-28 08:49:28,433][106226] Updated weights for policy 0, policy_version 1886980 (0.0006) [2023-12-28 08:49:28,584][106225] Updated weights for policy 1, policy_version 1891015 (0.0007) [2023-12-28 08:49:28,650][106225] Updated weights for policy 1, policy_version 1891025 (0.0009) [2023-12-28 08:49:28,719][106225] Updated weights for policy 1, policy_version 1891035 (0.0010) [2023-12-28 08:49:29,004][106226] Updated weights for policy 0, policy_version 1886990 (0.0006) [2023-12-28 08:49:29,050][106226] Updated weights for policy 0, policy_version 1887000 (0.0005) [2023-12-28 08:49:29,100][106226] Updated weights for policy 0, policy_version 1887010 (0.0005) [2023-12-28 08:49:29,463][106225] Updated weights for policy 1, policy_version 1891045 (0.0009) [2023-12-28 08:49:29,525][106225] Updated weights for policy 1, policy_version 1891055 (0.0009) [2023-12-28 08:49:29,584][106225] Updated weights for policy 1, policy_version 1891065 (0.0008) [2023-12-28 08:49:29,717][106226] Updated weights for policy 0, policy_version 1887020 (0.0007) [2023-12-28 08:49:29,778][106226] Updated weights for policy 0, policy_version 1887030 (0.0008) [2023-12-28 08:49:29,841][106226] Updated weights for policy 0, policy_version 1887040 (0.0009) [2023-12-28 08:49:30,349][106225] Updated weights for policy 1, policy_version 1891075 (0.0008) [2023-12-28 08:49:30,414][106225] Updated weights for policy 1, policy_version 1891085 (0.0009) [2023-12-28 08:49:30,468][106225] Updated weights for policy 1, policy_version 1891095 (0.0009) [2023-12-28 08:49:30,528][106226] Updated weights for policy 0, policy_version 1887050 (0.0007) [2023-12-28 08:49:30,595][106226] Updated weights for policy 0, policy_version 1887060 (0.0011) [2023-12-28 08:49:30,648][106226] Updated weights for policy 0, policy_version 1887070 (0.0009) [2023-12-28 08:49:30,699][106226] Updated weights for policy 0, policy_version 1887080 (0.0008) [2023-12-28 08:49:31,094][106225] Updated weights for policy 1, policy_version 1891105 (0.0007) [2023-12-28 08:49:31,163][106225] Updated weights for policy 1, policy_version 1891115 (0.0007) [2023-12-28 08:49:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 967352320. Throughput: 0: 9940.1, 1: 10057.6. Samples: 967345196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:31,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.967')] [2023-12-28 08:49:31,219][106225] Updated weights for policy 1, policy_version 1891125 (0.0006) [2023-12-28 08:49:31,281][106225] Updated weights for policy 1, policy_version 1891135 (0.0007) [2023-12-28 08:49:31,499][106226] Updated weights for policy 0, policy_version 1887090 (0.0005) [2023-12-28 08:49:31,562][106226] Updated weights for policy 0, policy_version 1887100 (0.0006) [2023-12-28 08:49:31,622][106226] Updated weights for policy 0, policy_version 1887110 (0.0009) [2023-12-28 08:49:31,953][106225] Updated weights for policy 1, policy_version 1891145 (0.0008) [2023-12-28 08:49:31,999][106225] Updated weights for policy 1, policy_version 1891155 (0.0007) [2023-12-28 08:49:32,057][106225] Updated weights for policy 1, policy_version 1891165 (0.0005) [2023-12-28 08:49:32,286][106226] Updated weights for policy 0, policy_version 1887120 (0.0010) [2023-12-28 08:49:32,342][106226] Updated weights for policy 0, policy_version 1887130 (0.0011) [2023-12-28 08:49:32,411][106226] Updated weights for policy 0, policy_version 1887140 (0.0011) [2023-12-28 08:49:32,724][106225] Updated weights for policy 1, policy_version 1891175 (0.0006) [2023-12-28 08:49:32,777][106225] Updated weights for policy 1, policy_version 1891185 (0.0007) [2023-12-28 08:49:32,831][106225] Updated weights for policy 1, policy_version 1891195 (0.0008) [2023-12-28 08:49:33,090][106226] Updated weights for policy 0, policy_version 1887150 (0.0007) [2023-12-28 08:49:33,145][106226] Updated weights for policy 0, policy_version 1887160 (0.0005) [2023-12-28 08:49:33,211][106226] Updated weights for policy 0, policy_version 1887170 (0.0005) [2023-12-28 08:49:33,540][106225] Updated weights for policy 1, policy_version 1891205 (0.0007) [2023-12-28 08:49:33,594][106225] Updated weights for policy 1, policy_version 1891215 (0.0009) [2023-12-28 08:49:33,648][106225] Updated weights for policy 1, policy_version 1891225 (0.0008) [2023-12-28 08:49:33,718][106226] Updated weights for policy 0, policy_version 1887180 (0.0005) [2023-12-28 08:49:33,768][106226] Updated weights for policy 0, policy_version 1887190 (0.0007) [2023-12-28 08:49:33,818][106226] Updated weights for policy 0, policy_version 1887200 (0.0008) [2023-12-28 08:49:34,304][106225] Updated weights for policy 1, policy_version 1891235 (0.0009) [2023-12-28 08:49:34,371][106225] Updated weights for policy 1, policy_version 1891245 (0.0008) [2023-12-28 08:49:34,431][106225] Updated weights for policy 1, policy_version 1891255 (0.0008) [2023-12-28 08:49:34,594][106226] Updated weights for policy 0, policy_version 1887210 (0.0009) [2023-12-28 08:49:34,656][106226] Updated weights for policy 0, policy_version 1887220 (0.0006) [2023-12-28 08:49:34,710][106226] Updated weights for policy 0, policy_version 1887230 (0.0008) [2023-12-28 08:49:34,767][106226] Updated weights for policy 0, policy_version 1887240 (0.0007) [2023-12-28 08:49:35,178][106225] Updated weights for policy 1, policy_version 1891265 (0.0009) [2023-12-28 08:49:35,243][106225] Updated weights for policy 1, policy_version 1891275 (0.0008) [2023-12-28 08:49:35,308][106225] Updated weights for policy 1, policy_version 1891285 (0.0009) [2023-12-28 08:49:35,370][106225] Updated weights for policy 1, policy_version 1891295 (0.0009) [2023-12-28 08:49:35,389][106226] Updated weights for policy 0, policy_version 1887250 (0.0005) [2023-12-28 08:49:35,456][106226] Updated weights for policy 0, policy_version 1887260 (0.0006) [2023-12-28 08:49:35,515][106226] Updated weights for policy 0, policy_version 1887270 (0.0006) [2023-12-28 08:49:36,096][106225] Updated weights for policy 1, policy_version 1891305 (0.0006) [2023-12-28 08:49:36,167][106225] Updated weights for policy 1, policy_version 1891315 (0.0006) [2023-12-28 08:49:36,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 967450624. Throughput: 0: 9936.4, 1: 10078.4. Samples: 967467100. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:36,175][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.492')] [2023-12-28 08:49:36,204][106226] Updated weights for policy 0, policy_version 1887280 (0.0008) [2023-12-28 08:49:36,229][106225] Updated weights for policy 1, policy_version 1891325 (0.0008) [2023-12-28 08:49:36,260][106226] Updated weights for policy 0, policy_version 1887290 (0.0006) [2023-12-28 08:49:36,322][106226] Updated weights for policy 0, policy_version 1887300 (0.0010) [2023-12-28 08:49:36,929][106226] Updated weights for policy 0, policy_version 1887310 (0.0011) [2023-12-28 08:49:36,982][106225] Updated weights for policy 1, policy_version 1891335 (0.0008) [2023-12-28 08:49:36,990][106226] Updated weights for policy 0, policy_version 1887320 (0.0010) [2023-12-28 08:49:37,039][106225] Updated weights for policy 1, policy_version 1891345 (0.0007) [2023-12-28 08:49:37,061][106226] Updated weights for policy 0, policy_version 1887330 (0.0008) [2023-12-28 08:49:37,094][106225] Updated weights for policy 1, policy_version 1891355 (0.0006) [2023-12-28 08:49:37,663][106226] Updated weights for policy 0, policy_version 1887340 (0.0008) [2023-12-28 08:49:37,721][106226] Updated weights for policy 0, policy_version 1887350 (0.0007) [2023-12-28 08:49:37,779][106226] Updated weights for policy 0, policy_version 1887360 (0.0009) [2023-12-28 08:49:37,815][106225] Updated weights for policy 1, policy_version 1891365 (0.0006) [2023-12-28 08:49:37,873][106225] Updated weights for policy 1, policy_version 1891375 (0.0009) [2023-12-28 08:49:37,924][106225] Updated weights for policy 1, policy_version 1891385 (0.0009) [2023-12-28 08:49:38,363][106226] Updated weights for policy 0, policy_version 1887370 (0.0009) [2023-12-28 08:49:38,421][106226] Updated weights for policy 0, policy_version 1887380 (0.0011) [2023-12-28 08:49:38,478][106226] Updated weights for policy 0, policy_version 1887390 (0.0011) [2023-12-28 08:49:38,526][106226] Updated weights for policy 0, policy_version 1887400 (0.0011) [2023-12-28 08:49:38,648][106225] Updated weights for policy 1, policy_version 1891395 (0.0006) [2023-12-28 08:49:38,707][106225] Updated weights for policy 1, policy_version 1891405 (0.0007) [2023-12-28 08:49:38,761][106225] Updated weights for policy 1, policy_version 1891415 (0.0008) [2023-12-28 08:49:39,263][106226] Updated weights for policy 0, policy_version 1887410 (0.0009) [2023-12-28 08:49:39,334][106226] Updated weights for policy 0, policy_version 1887420 (0.0010) [2023-12-28 08:49:39,438][106226] Updated weights for policy 0, policy_version 1887430 (0.0009) [2023-12-28 08:49:39,541][106225] Updated weights for policy 1, policy_version 1891425 (0.0008) [2023-12-28 08:49:39,604][106225] Updated weights for policy 1, policy_version 1891435 (0.0008) [2023-12-28 08:49:39,667][106225] Updated weights for policy 1, policy_version 1891445 (0.0008) [2023-12-28 08:49:39,715][106225] Updated weights for policy 1, policy_version 1891455 (0.0008) [2023-12-28 08:49:40,164][106226] Updated weights for policy 0, policy_version 1887440 (0.0010) [2023-12-28 08:49:40,230][106226] Updated weights for policy 0, policy_version 1887450 (0.0011) [2023-12-28 08:49:40,288][106226] Updated weights for policy 0, policy_version 1887460 (0.0011) [2023-12-28 08:49:40,495][106225] Updated weights for policy 1, policy_version 1891465 (0.0009) [2023-12-28 08:49:40,552][106225] Updated weights for policy 1, policy_version 1891475 (0.0009) [2023-12-28 08:49:40,605][106225] Updated weights for policy 1, policy_version 1891485 (0.0009) [2023-12-28 08:49:40,899][106226] Updated weights for policy 0, policy_version 1887470 (0.0008) [2023-12-28 08:49:40,963][106226] Updated weights for policy 0, policy_version 1887480 (0.0005) [2023-12-28 08:49:41,017][106226] Updated weights for policy 0, policy_version 1887490 (0.0007) [2023-12-28 08:49:41,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 967557120. Throughput: 0: 9986.9, 1: 10050.0. Samples: 967527584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:41,175][105115] Avg episode reward: [(0, '-4.434'), (1, '-4.555')] [2023-12-28 08:49:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001891488_484278272.pth... [2023-12-28 08:49:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001887496_483278848.pth... [2023-12-28 08:49:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001890336_483983360.pth [2023-12-28 08:49:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001886312_482975744.pth [2023-12-28 08:49:41,391][106225] Updated weights for policy 1, policy_version 1891495 (0.0009) [2023-12-28 08:49:41,458][106225] Updated weights for policy 1, policy_version 1891505 (0.0010) [2023-12-28 08:49:41,514][106225] Updated weights for policy 1, policy_version 1891515 (0.0010) [2023-12-28 08:49:41,818][106226] Updated weights for policy 0, policy_version 1887500 (0.0007) [2023-12-28 08:49:41,883][106226] Updated weights for policy 0, policy_version 1887510 (0.0008) [2023-12-28 08:49:41,941][106226] Updated weights for policy 0, policy_version 1887520 (0.0011) [2023-12-28 08:49:42,232][106225] Updated weights for policy 1, policy_version 1891525 (0.0011) [2023-12-28 08:49:42,297][106225] Updated weights for policy 1, policy_version 1891535 (0.0009) [2023-12-28 08:49:42,360][106225] Updated weights for policy 1, policy_version 1891545 (0.0008) [2023-12-28 08:49:42,676][106226] Updated weights for policy 0, policy_version 1887530 (0.0010) [2023-12-28 08:49:42,738][106226] Updated weights for policy 0, policy_version 1887540 (0.0008) [2023-12-28 08:49:42,802][106226] Updated weights for policy 0, policy_version 1887550 (0.0006) [2023-12-28 08:49:42,865][106226] Updated weights for policy 0, policy_version 1887560 (0.0005) [2023-12-28 08:49:43,069][106225] Updated weights for policy 1, policy_version 1891555 (0.0008) [2023-12-28 08:49:43,122][106225] Updated weights for policy 1, policy_version 1891565 (0.0010) [2023-12-28 08:49:43,176][106225] Updated weights for policy 1, policy_version 1891575 (0.0010) [2023-12-28 08:49:43,562][106226] Updated weights for policy 0, policy_version 1887570 (0.0011) [2023-12-28 08:49:43,617][106226] Updated weights for policy 0, policy_version 1887580 (0.0010) [2023-12-28 08:49:43,677][106226] Updated weights for policy 0, policy_version 1887590 (0.0010) [2023-12-28 08:49:43,893][106225] Updated weights for policy 1, policy_version 1891585 (0.0010) [2023-12-28 08:49:43,942][106225] Updated weights for policy 1, policy_version 1891595 (0.0010) [2023-12-28 08:49:44,002][106225] Updated weights for policy 1, policy_version 1891605 (0.0010) [2023-12-28 08:49:44,057][106225] Updated weights for policy 1, policy_version 1891615 (0.0008) [2023-12-28 08:49:44,327][106226] Updated weights for policy 0, policy_version 1887600 (0.0010) [2023-12-28 08:49:44,383][106226] Updated weights for policy 0, policy_version 1887610 (0.0010) [2023-12-28 08:49:44,449][106226] Updated weights for policy 0, policy_version 1887620 (0.0009) [2023-12-28 08:49:44,723][106225] Updated weights for policy 1, policy_version 1891625 (0.0005) [2023-12-28 08:49:44,786][106225] Updated weights for policy 1, policy_version 1891635 (0.0007) [2023-12-28 08:49:44,847][106225] Updated weights for policy 1, policy_version 1891645 (0.0008) [2023-12-28 08:49:45,132][106226] Updated weights for policy 0, policy_version 1887630 (0.0009) [2023-12-28 08:49:45,197][106226] Updated weights for policy 0, policy_version 1887640 (0.0007) [2023-12-28 08:49:45,262][106226] Updated weights for policy 0, policy_version 1887650 (0.0006) [2023-12-28 08:49:45,524][106225] Updated weights for policy 1, policy_version 1891655 (0.0009) [2023-12-28 08:49:45,587][106225] Updated weights for policy 1, policy_version 1891665 (0.0008) [2023-12-28 08:49:45,662][106225] Updated weights for policy 1, policy_version 1891675 (0.0008) [2023-12-28 08:49:45,953][106226] Updated weights for policy 0, policy_version 1887660 (0.0008) [2023-12-28 08:49:46,011][106226] Updated weights for policy 0, policy_version 1887670 (0.0010) [2023-12-28 08:49:46,073][106226] Updated weights for policy 0, policy_version 1887680 (0.0009) [2023-12-28 08:49:46,175][105115] Fps is (10 sec: 20479.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 967655424. Throughput: 0: 9968.1, 1: 10025.7. Samples: 967643388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:46,176][105115] Avg episode reward: [(0, '-4.583'), (1, '-4.550')] [2023-12-28 08:49:46,340][106225] Updated weights for policy 1, policy_version 1891685 (0.0006) [2023-12-28 08:49:46,388][106225] Updated weights for policy 1, policy_version 1891695 (0.0008) [2023-12-28 08:49:46,437][106225] Updated weights for policy 1, policy_version 1891705 (0.0008) [2023-12-28 08:49:46,786][106226] Updated weights for policy 0, policy_version 1887690 (0.0008) [2023-12-28 08:49:46,851][106226] Updated weights for policy 0, policy_version 1887700 (0.0009) [2023-12-28 08:49:46,907][106226] Updated weights for policy 0, policy_version 1887710 (0.0009) [2023-12-28 08:49:46,972][106226] Updated weights for policy 0, policy_version 1887720 (0.0007) [2023-12-28 08:49:47,134][106225] Updated weights for policy 1, policy_version 1891715 (0.0007) [2023-12-28 08:49:47,190][106225] Updated weights for policy 1, policy_version 1891725 (0.0008) [2023-12-28 08:49:47,252][106225] Updated weights for policy 1, policy_version 1891735 (0.0008) [2023-12-28 08:49:47,709][106226] Updated weights for policy 0, policy_version 1887730 (0.0005) [2023-12-28 08:49:47,772][106226] Updated weights for policy 0, policy_version 1887740 (0.0007) [2023-12-28 08:49:47,822][106226] Updated weights for policy 0, policy_version 1887750 (0.0005) [2023-12-28 08:49:47,827][106225] Updated weights for policy 1, policy_version 1891745 (0.0006) [2023-12-28 08:49:47,893][106225] Updated weights for policy 1, policy_version 1891755 (0.0009) [2023-12-28 08:49:47,951][106225] Updated weights for policy 1, policy_version 1891765 (0.0005) [2023-12-28 08:49:48,009][106225] Updated weights for policy 1, policy_version 1891775 (0.0005) [2023-12-28 08:49:48,429][106226] Updated weights for policy 0, policy_version 1887760 (0.0007) [2023-12-28 08:49:48,490][106226] Updated weights for policy 0, policy_version 1887770 (0.0009) [2023-12-28 08:49:48,549][106226] Updated weights for policy 0, policy_version 1887780 (0.0008) [2023-12-28 08:49:48,663][106225] Updated weights for policy 1, policy_version 1891785 (0.0008) [2023-12-28 08:49:48,723][106225] Updated weights for policy 1, policy_version 1891795 (0.0009) [2023-12-28 08:49:48,787][106225] Updated weights for policy 1, policy_version 1891805 (0.0008) [2023-12-28 08:49:49,290][106226] Updated weights for policy 0, policy_version 1887790 (0.0010) [2023-12-28 08:49:49,356][106226] Updated weights for policy 0, policy_version 1887800 (0.0011) [2023-12-28 08:49:49,419][106226] Updated weights for policy 0, policy_version 1887810 (0.0009) [2023-12-28 08:49:49,541][106225] Updated weights for policy 1, policy_version 1891815 (0.0007) [2023-12-28 08:49:49,598][106225] Updated weights for policy 1, policy_version 1891825 (0.0006) [2023-12-28 08:49:49,646][106225] Updated weights for policy 1, policy_version 1891835 (0.0006) [2023-12-28 08:49:50,230][106226] Updated weights for policy 0, policy_version 1887820 (0.0010) [2023-12-28 08:49:50,291][106226] Updated weights for policy 0, policy_version 1887830 (0.0011) [2023-12-28 08:49:50,354][106226] Updated weights for policy 0, policy_version 1887840 (0.0011) [2023-12-28 08:49:50,366][106225] Updated weights for policy 1, policy_version 1891845 (0.0006) [2023-12-28 08:49:50,418][106225] Updated weights for policy 1, policy_version 1891855 (0.0006) [2023-12-28 08:49:50,478][106225] Updated weights for policy 1, policy_version 1891865 (0.0009) [2023-12-28 08:49:51,053][106226] Updated weights for policy 0, policy_version 1887850 (0.0010) [2023-12-28 08:49:51,112][106226] Updated weights for policy 0, policy_version 1887860 (0.0008) [2023-12-28 08:49:51,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19797.3, 300 sec: 19716.3). Total num frames: 967745536. Throughput: 0: 9998.5, 1: 9923.7. Samples: 967761632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:51,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-5.174')] [2023-12-28 08:49:51,178][106226] Updated weights for policy 0, policy_version 1887870 (0.0006) [2023-12-28 08:49:51,229][106225] Updated weights for policy 1, policy_version 1891875 (0.0010) [2023-12-28 08:49:51,243][106226] Updated weights for policy 0, policy_version 1887880 (0.0006) [2023-12-28 08:49:51,295][106225] Updated weights for policy 1, policy_version 1891885 (0.0011) [2023-12-28 08:49:51,377][106225] Updated weights for policy 1, policy_version 1891895 (0.0010) [2023-12-28 08:49:51,889][106226] Updated weights for policy 0, policy_version 1887890 (0.0006) [2023-12-28 08:49:51,945][106226] Updated weights for policy 0, policy_version 1887900 (0.0009) [2023-12-28 08:49:52,003][106226] Updated weights for policy 0, policy_version 1887910 (0.0008) [2023-12-28 08:49:52,058][106225] Updated weights for policy 1, policy_version 1891905 (0.0010) [2023-12-28 08:49:52,124][106225] Updated weights for policy 1, policy_version 1891915 (0.0009) [2023-12-28 08:49:52,183][106225] Updated weights for policy 1, policy_version 1891925 (0.0008) [2023-12-28 08:49:52,252][106225] Updated weights for policy 1, policy_version 1891935 (0.0006) [2023-12-28 08:49:52,723][106226] Updated weights for policy 0, policy_version 1887920 (0.0008) [2023-12-28 08:49:52,775][106226] Updated weights for policy 0, policy_version 1887930 (0.0008) [2023-12-28 08:49:52,824][106226] Updated weights for policy 0, policy_version 1887940 (0.0008) [2023-12-28 08:49:52,957][106225] Updated weights for policy 1, policy_version 1891945 (0.0009) [2023-12-28 08:49:53,008][106225] Updated weights for policy 1, policy_version 1891956 (0.0009) [2023-12-28 08:49:53,058][106225] Updated weights for policy 1, policy_version 1891966 (0.0010) [2023-12-28 08:49:53,495][106226] Updated weights for policy 0, policy_version 1887950 (0.0006) [2023-12-28 08:49:53,559][106226] Updated weights for policy 0, policy_version 1887960 (0.0005) [2023-12-28 08:49:53,624][106226] Updated weights for policy 0, policy_version 1887970 (0.0005) [2023-12-28 08:49:53,863][106225] Updated weights for policy 1, policy_version 1891976 (0.0006) [2023-12-28 08:49:53,919][106225] Updated weights for policy 1, policy_version 1891986 (0.0005) [2023-12-28 08:49:53,969][106225] Updated weights for policy 1, policy_version 1891996 (0.0007) [2023-12-28 08:49:54,174][106226] Updated weights for policy 0, policy_version 1887980 (0.0007) [2023-12-28 08:49:54,230][106226] Updated weights for policy 0, policy_version 1887990 (0.0008) [2023-12-28 08:49:54,297][106226] Updated weights for policy 0, policy_version 1888000 (0.0006) [2023-12-28 08:49:54,571][106225] Updated weights for policy 1, policy_version 1892006 (0.0007) [2023-12-28 08:49:54,625][106225] Updated weights for policy 1, policy_version 1892016 (0.0007) [2023-12-28 08:49:54,682][106225] Updated weights for policy 1, policy_version 1892026 (0.0008) [2023-12-28 08:49:54,941][106226] Updated weights for policy 0, policy_version 1888010 (0.0007) [2023-12-28 08:49:55,005][106226] Updated weights for policy 0, policy_version 1888020 (0.0008) [2023-12-28 08:49:55,068][106226] Updated weights for policy 0, policy_version 1888030 (0.0005) [2023-12-28 08:49:55,124][106226] Updated weights for policy 0, policy_version 1888040 (0.0005) [2023-12-28 08:49:55,316][106225] Updated weights for policy 1, policy_version 1892036 (0.0007) [2023-12-28 08:49:55,379][106225] Updated weights for policy 1, policy_version 1892046 (0.0005) [2023-12-28 08:49:55,438][106225] Updated weights for policy 1, policy_version 1892056 (0.0005) [2023-12-28 08:49:55,685][106226] Updated weights for policy 0, policy_version 1888050 (0.0005) [2023-12-28 08:49:55,747][106226] Updated weights for policy 0, policy_version 1888060 (0.0008) [2023-12-28 08:49:55,811][106226] Updated weights for policy 0, policy_version 1888070 (0.0008) [2023-12-28 08:49:56,081][106225] Updated weights for policy 1, policy_version 1892066 (0.0009) [2023-12-28 08:49:56,137][106225] Updated weights for policy 1, policy_version 1892076 (0.0010) [2023-12-28 08:49:56,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 967852032. Throughput: 0: 10030.1, 1: 9849.1. Samples: 967821348. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:49:56,175][105115] Avg episode reward: [(0, '-4.399'), (1, '-4.483')] [2023-12-28 08:49:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001888072_483426304.pth... [2023-12-28 08:49:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001886888_483123200.pth [2023-12-28 08:49:56,201][106225] Updated weights for policy 1, policy_version 1892086 (0.0010) [2023-12-28 08:49:56,254][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001892096_484433920.pth... [2023-12-28 08:49:56,255][106225] Updated weights for policy 1, policy_version 1892096 (0.0005) [2023-12-28 08:49:56,257][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001890912_484130816.pth [2023-12-28 08:49:56,410][106226] Updated weights for policy 0, policy_version 1888080 (0.0010) [2023-12-28 08:49:56,476][106226] Updated weights for policy 0, policy_version 1888090 (0.0008) [2023-12-28 08:49:56,540][106226] Updated weights for policy 0, policy_version 1888100 (0.0005) [2023-12-28 08:49:56,854][106225] Updated weights for policy 1, policy_version 1892106 (0.0006) [2023-12-28 08:49:56,910][106225] Updated weights for policy 1, policy_version 1892116 (0.0010) [2023-12-28 08:49:56,975][106225] Updated weights for policy 1, policy_version 1892126 (0.0010) [2023-12-28 08:49:57,058][106226] Updated weights for policy 0, policy_version 1888110 (0.0005) [2023-12-28 08:49:57,119][106226] Updated weights for policy 0, policy_version 1888120 (0.0007) [2023-12-28 08:49:57,181][106226] Updated weights for policy 0, policy_version 1888130 (0.0006) [2023-12-28 08:49:57,668][106225] Updated weights for policy 1, policy_version 1892136 (0.0010) [2023-12-28 08:49:57,731][106225] Updated weights for policy 1, policy_version 1892146 (0.0010) [2023-12-28 08:49:57,789][106225] Updated weights for policy 1, policy_version 1892156 (0.0010) [2023-12-28 08:49:57,802][106226] Updated weights for policy 0, policy_version 1888140 (0.0006) [2023-12-28 08:49:57,847][106226] Updated weights for policy 0, policy_version 1888150 (0.0007) [2023-12-28 08:49:57,893][106226] Updated weights for policy 0, policy_version 1888160 (0.0007) [2023-12-28 08:49:58,530][106225] Updated weights for policy 1, policy_version 1892166 (0.0011) [2023-12-28 08:49:58,596][106225] Updated weights for policy 1, policy_version 1892176 (0.0011) [2023-12-28 08:49:58,666][106225] Updated weights for policy 1, policy_version 1892186 (0.0010) [2023-12-28 08:49:58,703][106226] Updated weights for policy 0, policy_version 1888170 (0.0007) [2023-12-28 08:49:58,770][106226] Updated weights for policy 0, policy_version 1888180 (0.0009) [2023-12-28 08:49:58,838][106226] Updated weights for policy 0, policy_version 1888190 (0.0011) [2023-12-28 08:49:58,904][106226] Updated weights for policy 0, policy_version 1888200 (0.0012) [2023-12-28 08:49:59,509][106225] Updated weights for policy 1, policy_version 1892196 (0.0008) [2023-12-28 08:49:59,572][106225] Updated weights for policy 1, policy_version 1892206 (0.0006) [2023-12-28 08:49:59,623][106225] Updated weights for policy 1, policy_version 1892216 (0.0007) [2023-12-28 08:49:59,661][106226] Updated weights for policy 0, policy_version 1888210 (0.0007) [2023-12-28 08:49:59,714][106226] Updated weights for policy 0, policy_version 1888220 (0.0007) [2023-12-28 08:49:59,774][106226] Updated weights for policy 0, policy_version 1888230 (0.0009) [2023-12-28 08:50:00,400][106225] Updated weights for policy 1, policy_version 1892226 (0.0008) [2023-12-28 08:50:00,460][106225] Updated weights for policy 1, policy_version 1892236 (0.0009) [2023-12-28 08:50:00,466][106226] Updated weights for policy 0, policy_version 1888240 (0.0007) [2023-12-28 08:50:00,519][106225] Updated weights for policy 1, policy_version 1892246 (0.0007) [2023-12-28 08:50:00,527][106226] Updated weights for policy 0, policy_version 1888250 (0.0008) [2023-12-28 08:50:00,574][106226] Updated weights for policy 0, policy_version 1888260 (0.0007) [2023-12-28 08:50:00,576][106225] Updated weights for policy 1, policy_version 1892256 (0.0008) [2023-12-28 08:50:01,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 967950336. Throughput: 0: 10194.3, 1: 9946.9. Samples: 967945004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:01,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.706')] [2023-12-28 08:50:01,185][106225] Updated weights for policy 1, policy_version 1892266 (0.0009) [2023-12-28 08:50:01,239][106226] Updated weights for policy 0, policy_version 1888270 (0.0006) [2023-12-28 08:50:01,246][106225] Updated weights for policy 1, policy_version 1892276 (0.0007) [2023-12-28 08:50:01,309][106225] Updated weights for policy 1, policy_version 1892286 (0.0008) [2023-12-28 08:50:01,324][106226] Updated weights for policy 0, policy_version 1888280 (0.0008) [2023-12-28 08:50:01,399][106226] Updated weights for policy 0, policy_version 1888290 (0.0008) [2023-12-28 08:50:02,014][106225] Updated weights for policy 1, policy_version 1892296 (0.0007) [2023-12-28 08:50:02,060][106225] Updated weights for policy 1, policy_version 1892306 (0.0008) [2023-12-28 08:50:02,115][106225] Updated weights for policy 1, policy_version 1892316 (0.0008) [2023-12-28 08:50:02,137][106226] Updated weights for policy 0, policy_version 1888300 (0.0008) [2023-12-28 08:50:02,195][106226] Updated weights for policy 0, policy_version 1888310 (0.0008) [2023-12-28 08:50:02,258][106226] Updated weights for policy 0, policy_version 1888320 (0.0011) [2023-12-28 08:50:02,799][106225] Updated weights for policy 1, policy_version 1892326 (0.0005) [2023-12-28 08:50:02,851][106225] Updated weights for policy 1, policy_version 1892336 (0.0005) [2023-12-28 08:50:02,917][106225] Updated weights for policy 1, policy_version 1892346 (0.0008) [2023-12-28 08:50:02,965][106226] Updated weights for policy 0, policy_version 1888330 (0.0006) [2023-12-28 08:50:03,017][106226] Updated weights for policy 0, policy_version 1888340 (0.0005) [2023-12-28 08:50:03,076][106226] Updated weights for policy 0, policy_version 1888350 (0.0008) [2023-12-28 08:50:03,130][106226] Updated weights for policy 0, policy_version 1888360 (0.0008) [2023-12-28 08:50:03,560][106225] Updated weights for policy 1, policy_version 1892356 (0.0008) [2023-12-28 08:50:03,615][106225] Updated weights for policy 1, policy_version 1892366 (0.0008) [2023-12-28 08:50:03,665][106225] Updated weights for policy 1, policy_version 1892376 (0.0009) [2023-12-28 08:50:03,874][106226] Updated weights for policy 0, policy_version 1888370 (0.0007) [2023-12-28 08:50:03,934][106226] Updated weights for policy 0, policy_version 1888380 (0.0007) [2023-12-28 08:50:03,993][106226] Updated weights for policy 0, policy_version 1888390 (0.0008) [2023-12-28 08:50:04,374][106225] Updated weights for policy 1, policy_version 1892386 (0.0007) [2023-12-28 08:50:04,432][106225] Updated weights for policy 1, policy_version 1892396 (0.0009) [2023-12-28 08:50:04,493][106225] Updated weights for policy 1, policy_version 1892406 (0.0009) [2023-12-28 08:50:04,556][106225] Updated weights for policy 1, policy_version 1892416 (0.0008) [2023-12-28 08:50:04,675][106226] Updated weights for policy 0, policy_version 1888400 (0.0009) [2023-12-28 08:50:04,733][106226] Updated weights for policy 0, policy_version 1888410 (0.0008) [2023-12-28 08:50:04,792][106226] Updated weights for policy 0, policy_version 1888420 (0.0007) [2023-12-28 08:50:05,304][106225] Updated weights for policy 1, policy_version 1892426 (0.0006) [2023-12-28 08:50:05,373][106225] Updated weights for policy 1, policy_version 1892436 (0.0006) [2023-12-28 08:50:05,439][106225] Updated weights for policy 1, policy_version 1892446 (0.0006) [2023-12-28 08:50:05,482][106226] Updated weights for policy 0, policy_version 1888430 (0.0007) [2023-12-28 08:50:05,539][106226] Updated weights for policy 0, policy_version 1888440 (0.0009) [2023-12-28 08:50:05,601][106226] Updated weights for policy 0, policy_version 1888450 (0.0008) [2023-12-28 08:50:06,017][106225] Updated weights for policy 1, policy_version 1892456 (0.0006) [2023-12-28 08:50:06,085][106225] Updated weights for policy 1, policy_version 1892466 (0.0008) [2023-12-28 08:50:06,170][106225] Updated weights for policy 1, policy_version 1892477 (0.0007) [2023-12-28 08:50:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 968048640. Throughput: 0: 10089.3, 1: 9953.7. Samples: 968063528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:06,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-4.686')] [2023-12-28 08:50:06,389][106226] Updated weights for policy 0, policy_version 1888460 (0.0008) [2023-12-28 08:50:06,455][106226] Updated weights for policy 0, policy_version 1888470 (0.0008) [2023-12-28 08:50:06,507][106226] Updated weights for policy 0, policy_version 1888480 (0.0008) [2023-12-28 08:50:06,834][106225] Updated weights for policy 1, policy_version 1892487 (0.0009) [2023-12-28 08:50:06,891][106225] Updated weights for policy 1, policy_version 1892497 (0.0010) [2023-12-28 08:50:06,954][106225] Updated weights for policy 1, policy_version 1892507 (0.0010) [2023-12-28 08:50:07,249][106226] Updated weights for policy 0, policy_version 1888490 (0.0008) [2023-12-28 08:50:07,300][106226] Updated weights for policy 0, policy_version 1888500 (0.0009) [2023-12-28 08:50:07,359][106226] Updated weights for policy 0, policy_version 1888510 (0.0008) [2023-12-28 08:50:07,418][106226] Updated weights for policy 0, policy_version 1888520 (0.0008) [2023-12-28 08:50:07,654][106225] Updated weights for policy 1, policy_version 1892517 (0.0010) [2023-12-28 08:50:07,712][106225] Updated weights for policy 1, policy_version 1892527 (0.0010) [2023-12-28 08:50:07,765][106225] Updated weights for policy 1, policy_version 1892537 (0.0006) [2023-12-28 08:50:08,262][106226] Updated weights for policy 0, policy_version 1888530 (0.0008) [2023-12-28 08:50:08,309][106225] Updated weights for policy 1, policy_version 1892547 (0.0007) [2023-12-28 08:50:08,316][106226] Updated weights for policy 0, policy_version 1888540 (0.0007) [2023-12-28 08:50:08,377][106226] Updated weights for policy 0, policy_version 1888550 (0.0009) [2023-12-28 08:50:08,388][106225] Updated weights for policy 1, policy_version 1892557 (0.0008) [2023-12-28 08:50:08,442][106225] Updated weights for policy 1, policy_version 1892567 (0.0009) [2023-12-28 08:50:09,095][106226] Updated weights for policy 0, policy_version 1888560 (0.0008) [2023-12-28 08:50:09,148][106226] Updated weights for policy 0, policy_version 1888570 (0.0008) [2023-12-28 08:50:09,155][106225] Updated weights for policy 1, policy_version 1892577 (0.0010) [2023-12-28 08:50:09,205][106226] Updated weights for policy 0, policy_version 1888580 (0.0005) [2023-12-28 08:50:09,222][106225] Updated weights for policy 1, policy_version 1892587 (0.0010) [2023-12-28 08:50:09,288][106225] Updated weights for policy 1, policy_version 1892597 (0.0010) [2023-12-28 08:50:09,350][106225] Updated weights for policy 1, policy_version 1892607 (0.0010) [2023-12-28 08:50:09,988][106226] Updated weights for policy 0, policy_version 1888590 (0.0009) [2023-12-28 08:50:10,053][106226] Updated weights for policy 0, policy_version 1888600 (0.0009) [2023-12-28 08:50:10,071][106225] Updated weights for policy 1, policy_version 1892617 (0.0006) [2023-12-28 08:50:10,113][106226] Updated weights for policy 0, policy_version 1888610 (0.0007) [2023-12-28 08:50:10,131][106225] Updated weights for policy 1, policy_version 1892627 (0.0006) [2023-12-28 08:50:10,190][106225] Updated weights for policy 1, policy_version 1892637 (0.0009) [2023-12-28 08:50:10,792][106226] Updated weights for policy 0, policy_version 1888620 (0.0008) [2023-12-28 08:50:10,843][106226] Updated weights for policy 0, policy_version 1888630 (0.0007) [2023-12-28 08:50:10,892][106226] Updated weights for policy 0, policy_version 1888640 (0.0006) [2023-12-28 08:50:10,934][106225] Updated weights for policy 1, policy_version 1892647 (0.0005) [2023-12-28 08:50:11,002][106225] Updated weights for policy 1, policy_version 1892657 (0.0005) [2023-12-28 08:50:11,077][106225] Updated weights for policy 1, policy_version 1892667 (0.0007) [2023-12-28 08:50:11,175][105115] Fps is (10 sec: 20479.7, 60 sec: 20070.4, 300 sec: 19799.6). Total num frames: 968155136. Throughput: 0: 10094.7, 1: 10000.6. Samples: 968122208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:11,175][105115] Avg episode reward: [(0, '-4.214'), (1, '-4.606')] [2023-12-28 08:50:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001892672_484581376.pth... [2023-12-28 08:50:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001888648_483573760.pth... [2023-12-28 08:50:11,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001891488_484278272.pth [2023-12-28 08:50:11,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001887496_483278848.pth [2023-12-28 08:50:11,578][106226] Updated weights for policy 0, policy_version 1888650 (0.0006) [2023-12-28 08:50:11,648][106226] Updated weights for policy 0, policy_version 1888660 (0.0007) [2023-12-28 08:50:11,708][106226] Updated weights for policy 0, policy_version 1888670 (0.0008) [2023-12-28 08:50:11,778][106226] Updated weights for policy 0, policy_version 1888680 (0.0008) [2023-12-28 08:50:11,813][106225] Updated weights for policy 1, policy_version 1892677 (0.0008) [2023-12-28 08:50:11,863][106225] Updated weights for policy 1, policy_version 1892687 (0.0008) [2023-12-28 08:50:11,927][106225] Updated weights for policy 1, policy_version 1892697 (0.0009) [2023-12-28 08:50:12,540][106226] Updated weights for policy 0, policy_version 1888690 (0.0007) [2023-12-28 08:50:12,605][106226] Updated weights for policy 0, policy_version 1888700 (0.0006) [2023-12-28 08:50:12,667][106225] Updated weights for policy 1, policy_version 1892707 (0.0009) [2023-12-28 08:50:12,671][106226] Updated weights for policy 0, policy_version 1888710 (0.0007) [2023-12-28 08:50:12,725][106225] Updated weights for policy 1, policy_version 1892717 (0.0008) [2023-12-28 08:50:12,794][106225] Updated weights for policy 1, policy_version 1892727 (0.0008) [2023-12-28 08:50:13,344][106226] Updated weights for policy 0, policy_version 1888720 (0.0009) [2023-12-28 08:50:13,400][106226] Updated weights for policy 0, policy_version 1888730 (0.0007) [2023-12-28 08:50:13,457][106226] Updated weights for policy 0, policy_version 1888740 (0.0009) [2023-12-28 08:50:13,465][106225] Updated weights for policy 1, policy_version 1892737 (0.0008) [2023-12-28 08:50:13,524][106225] Updated weights for policy 1, policy_version 1892747 (0.0005) [2023-12-28 08:50:13,588][106225] Updated weights for policy 1, policy_version 1892757 (0.0006) [2023-12-28 08:50:13,654][106225] Updated weights for policy 1, policy_version 1892767 (0.0005) [2023-12-28 08:50:14,184][106225] Updated weights for policy 1, policy_version 1892777 (0.0006) [2023-12-28 08:50:14,190][106226] Updated weights for policy 0, policy_version 1888750 (0.0007) [2023-12-28 08:50:14,243][106225] Updated weights for policy 1, policy_version 1892787 (0.0006) [2023-12-28 08:50:14,258][106226] Updated weights for policy 0, policy_version 1888760 (0.0007) [2023-12-28 08:50:14,297][106225] Updated weights for policy 1, policy_version 1892797 (0.0007) [2023-12-28 08:50:14,318][106226] Updated weights for policy 0, policy_version 1888770 (0.0008) [2023-12-28 08:50:14,940][106225] Updated weights for policy 1, policy_version 1892807 (0.0009) [2023-12-28 08:50:14,999][106225] Updated weights for policy 1, policy_version 1892817 (0.0011) [2023-12-28 08:50:15,021][106226] Updated weights for policy 0, policy_version 1888780 (0.0008) [2023-12-28 08:50:15,063][106225] Updated weights for policy 1, policy_version 1892827 (0.0011) [2023-12-28 08:50:15,075][106226] Updated weights for policy 0, policy_version 1888790 (0.0008) [2023-12-28 08:50:15,138][106226] Updated weights for policy 0, policy_version 1888800 (0.0007) [2023-12-28 08:50:15,738][106225] Updated weights for policy 1, policy_version 1892837 (0.0010) [2023-12-28 08:50:15,791][106225] Updated weights for policy 1, policy_version 1892847 (0.0009) [2023-12-28 08:50:15,840][106225] Updated weights for policy 1, policy_version 1892857 (0.0008) [2023-12-28 08:50:15,862][106226] Updated weights for policy 0, policy_version 1888810 (0.0006) [2023-12-28 08:50:15,916][106226] Updated weights for policy 0, policy_version 1888820 (0.0007) [2023-12-28 08:50:15,968][106226] Updated weights for policy 0, policy_version 1888830 (0.0008) [2023-12-28 08:50:16,031][106226] Updated weights for policy 0, policy_version 1888840 (0.0008) [2023-12-28 08:50:16,175][105115] Fps is (10 sec: 20479.8, 60 sec: 20070.3, 300 sec: 19799.6). Total num frames: 968253440. Throughput: 0: 9953.3, 1: 9942.5. Samples: 968240508. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:16,176][105115] Avg episode reward: [(0, '-4.283'), (1, '-4.477')] [2023-12-28 08:50:16,484][106225] Updated weights for policy 1, policy_version 1892867 (0.0007) [2023-12-28 08:50:16,540][106225] Updated weights for policy 1, policy_version 1892877 (0.0005) [2023-12-28 08:50:16,597][106225] Updated weights for policy 1, policy_version 1892887 (0.0006) [2023-12-28 08:50:16,883][106226] Updated weights for policy 0, policy_version 1888850 (0.0009) [2023-12-28 08:50:16,937][106226] Updated weights for policy 0, policy_version 1888860 (0.0008) [2023-12-28 08:50:16,996][106226] Updated weights for policy 0, policy_version 1888870 (0.0009) [2023-12-28 08:50:17,158][106225] Updated weights for policy 1, policy_version 1892897 (0.0006) [2023-12-28 08:50:17,218][106225] Updated weights for policy 1, policy_version 1892907 (0.0010) [2023-12-28 08:50:17,270][106225] Updated weights for policy 1, policy_version 1892917 (0.0006) [2023-12-28 08:50:17,331][106225] Updated weights for policy 1, policy_version 1892927 (0.0008) [2023-12-28 08:50:17,795][106226] Updated weights for policy 0, policy_version 1888880 (0.0010) [2023-12-28 08:50:17,849][106226] Updated weights for policy 0, policy_version 1888890 (0.0008) [2023-12-28 08:50:17,908][106226] Updated weights for policy 0, policy_version 1888900 (0.0009) [2023-12-28 08:50:17,911][106225] Updated weights for policy 1, policy_version 1892937 (0.0010) [2023-12-28 08:50:17,968][106225] Updated weights for policy 1, policy_version 1892947 (0.0010) [2023-12-28 08:50:18,026][106225] Updated weights for policy 1, policy_version 1892957 (0.0010) [2023-12-28 08:50:18,626][106226] Updated weights for policy 0, policy_version 1888910 (0.0006) [2023-12-28 08:50:18,681][106226] Updated weights for policy 0, policy_version 1888920 (0.0005) [2023-12-28 08:50:18,740][106226] Updated weights for policy 0, policy_version 1888930 (0.0009) [2023-12-28 08:50:18,758][106225] Updated weights for policy 1, policy_version 1892967 (0.0010) [2023-12-28 08:50:18,810][106225] Updated weights for policy 1, policy_version 1892977 (0.0006) [2023-12-28 08:50:18,865][106225] Updated weights for policy 1, policy_version 1892987 (0.0005) [2023-12-28 08:50:19,416][106226] Updated weights for policy 0, policy_version 1888940 (0.0008) [2023-12-28 08:50:19,468][106226] Updated weights for policy 0, policy_version 1888950 (0.0008) [2023-12-28 08:50:19,536][106226] Updated weights for policy 0, policy_version 1888960 (0.0008) [2023-12-28 08:50:19,602][106225] Updated weights for policy 1, policy_version 1892997 (0.0008) [2023-12-28 08:50:19,666][106225] Updated weights for policy 1, policy_version 1893007 (0.0009) [2023-12-28 08:50:19,732][106225] Updated weights for policy 1, policy_version 1893017 (0.0007) [2023-12-28 08:50:20,320][106226] Updated weights for policy 0, policy_version 1888970 (0.0008) [2023-12-28 08:50:20,382][106226] Updated weights for policy 0, policy_version 1888980 (0.0009) [2023-12-28 08:50:20,437][106226] Updated weights for policy 0, policy_version 1888990 (0.0008) [2023-12-28 08:50:20,483][106225] Updated weights for policy 1, policy_version 1893027 (0.0009) [2023-12-28 08:50:20,499][106226] Updated weights for policy 0, policy_version 1889000 (0.0007) [2023-12-28 08:50:20,538][106225] Updated weights for policy 1, policy_version 1893037 (0.0008) [2023-12-28 08:50:20,604][106225] Updated weights for policy 1, policy_version 1893047 (0.0007) [2023-12-28 08:50:21,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 968343552. Throughput: 0: 9807.2, 1: 9965.2. Samples: 968356856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:21,175][105115] Avg episode reward: [(0, '-4.298'), (1, '-4.548')] [2023-12-28 08:50:21,310][106226] Updated weights for policy 0, policy_version 1889010 (0.0008) [2023-12-28 08:50:21,378][106226] Updated weights for policy 0, policy_version 1889020 (0.0008) [2023-12-28 08:50:21,384][106225] Updated weights for policy 1, policy_version 1893057 (0.0008) [2023-12-28 08:50:21,434][106225] Updated weights for policy 1, policy_version 1893067 (0.0007) [2023-12-28 08:50:21,439][106226] Updated weights for policy 0, policy_version 1889030 (0.0006) [2023-12-28 08:50:21,480][106225] Updated weights for policy 1, policy_version 1893077 (0.0008) [2023-12-28 08:50:21,536][106225] Updated weights for policy 1, policy_version 1893087 (0.0005) [2023-12-28 08:50:22,080][106226] Updated weights for policy 0, policy_version 1889040 (0.0008) [2023-12-28 08:50:22,143][106226] Updated weights for policy 0, policy_version 1889050 (0.0007) [2023-12-28 08:50:22,198][106226] Updated weights for policy 0, policy_version 1889060 (0.0006) [2023-12-28 08:50:22,336][106225] Updated weights for policy 1, policy_version 1893097 (0.0006) [2023-12-28 08:50:22,409][106225] Updated weights for policy 1, policy_version 1893107 (0.0009) [2023-12-28 08:50:22,472][106225] Updated weights for policy 1, policy_version 1893117 (0.0010) [2023-12-28 08:50:22,861][106226] Updated weights for policy 0, policy_version 1889070 (0.0009) [2023-12-28 08:50:22,918][106226] Updated weights for policy 0, policy_version 1889080 (0.0008) [2023-12-28 08:50:22,978][106226] Updated weights for policy 0, policy_version 1889090 (0.0009) [2023-12-28 08:50:23,201][106225] Updated weights for policy 1, policy_version 1893127 (0.0009) [2023-12-28 08:50:23,259][106225] Updated weights for policy 1, policy_version 1893137 (0.0009) [2023-12-28 08:50:23,319][106225] Updated weights for policy 1, policy_version 1893147 (0.0008) [2023-12-28 08:50:23,709][106226] Updated weights for policy 0, policy_version 1889100 (0.0008) [2023-12-28 08:50:23,770][106226] Updated weights for policy 0, policy_version 1889110 (0.0009) [2023-12-28 08:50:23,830][106226] Updated weights for policy 0, policy_version 1889120 (0.0007) [2023-12-28 08:50:23,982][106225] Updated weights for policy 1, policy_version 1893157 (0.0008) [2023-12-28 08:50:24,038][106225] Updated weights for policy 1, policy_version 1893167 (0.0008) [2023-12-28 08:50:24,097][106225] Updated weights for policy 1, policy_version 1893177 (0.0009) [2023-12-28 08:50:24,483][106226] Updated weights for policy 0, policy_version 1889130 (0.0006) [2023-12-28 08:50:24,546][106226] Updated weights for policy 0, policy_version 1889140 (0.0008) [2023-12-28 08:50:24,612][106226] Updated weights for policy 0, policy_version 1889150 (0.0008) [2023-12-28 08:50:24,672][106226] Updated weights for policy 0, policy_version 1889160 (0.0009) [2023-12-28 08:50:24,834][106225] Updated weights for policy 1, policy_version 1893187 (0.0008) [2023-12-28 08:50:24,885][106225] Updated weights for policy 1, policy_version 1893197 (0.0008) [2023-12-28 08:50:24,932][106225] Updated weights for policy 1, policy_version 1893207 (0.0008) [2023-12-28 08:50:25,399][106226] Updated weights for policy 0, policy_version 1889170 (0.0007) [2023-12-28 08:50:25,451][106226] Updated weights for policy 0, policy_version 1889180 (0.0009) [2023-12-28 08:50:25,515][106226] Updated weights for policy 0, policy_version 1889190 (0.0009) [2023-12-28 08:50:25,601][106225] Updated weights for policy 1, policy_version 1893217 (0.0006) [2023-12-28 08:50:25,660][106225] Updated weights for policy 1, policy_version 1893227 (0.0008) [2023-12-28 08:50:25,720][106225] Updated weights for policy 1, policy_version 1893237 (0.0008) [2023-12-28 08:50:25,779][106225] Updated weights for policy 1, policy_version 1893247 (0.0008) [2023-12-28 08:50:26,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 968441856. Throughput: 0: 9767.1, 1: 9959.7. Samples: 968415292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:26,175][105115] Avg episode reward: [(0, '-4.445'), (1, '-4.796')] [2023-12-28 08:50:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001893248_484728832.pth... [2023-12-28 08:50:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001889192_483713024.pth... [2023-12-28 08:50:26,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001888072_483426304.pth [2023-12-28 08:50:26,196][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001892096_484433920.pth [2023-12-28 08:50:26,306][106226] Updated weights for policy 0, policy_version 1889200 (0.0009) [2023-12-28 08:50:26,356][106225] Updated weights for policy 1, policy_version 1893257 (0.0008) [2023-12-28 08:50:26,363][106226] Updated weights for policy 0, policy_version 1889210 (0.0007) [2023-12-28 08:50:26,411][106225] Updated weights for policy 1, policy_version 1893267 (0.0006) [2023-12-28 08:50:26,425][106226] Updated weights for policy 0, policy_version 1889220 (0.0006) [2023-12-28 08:50:26,472][106225] Updated weights for policy 1, policy_version 1893277 (0.0007) [2023-12-28 08:50:27,107][106225] Updated weights for policy 1, policy_version 1893287 (0.0007) [2023-12-28 08:50:27,153][106225] Updated weights for policy 1, policy_version 1893297 (0.0008) [2023-12-28 08:50:27,171][106226] Updated weights for policy 0, policy_version 1889230 (0.0006) [2023-12-28 08:50:27,200][106225] Updated weights for policy 1, policy_version 1893307 (0.0006) [2023-12-28 08:50:27,231][106226] Updated weights for policy 0, policy_version 1889240 (0.0008) [2023-12-28 08:50:27,294][106226] Updated weights for policy 0, policy_version 1889250 (0.0009) [2023-12-28 08:50:27,838][106225] Updated weights for policy 1, policy_version 1893317 (0.0005) [2023-12-28 08:50:27,894][106225] Updated weights for policy 1, policy_version 1893327 (0.0005) [2023-12-28 08:50:27,954][106225] Updated weights for policy 1, policy_version 1893337 (0.0005) [2023-12-28 08:50:28,094][106226] Updated weights for policy 0, policy_version 1889260 (0.0008) [2023-12-28 08:50:28,145][106226] Updated weights for policy 0, policy_version 1889270 (0.0008) [2023-12-28 08:50:28,199][106226] Updated weights for policy 0, policy_version 1889280 (0.0008) [2023-12-28 08:50:28,599][106225] Updated weights for policy 1, policy_version 1893347 (0.0007) [2023-12-28 08:50:28,652][106225] Updated weights for policy 1, policy_version 1893357 (0.0009) [2023-12-28 08:50:28,713][106225] Updated weights for policy 1, policy_version 1893367 (0.0010) [2023-12-28 08:50:28,962][106226] Updated weights for policy 0, policy_version 1889290 (0.0007) [2023-12-28 08:50:29,009][106226] Updated weights for policy 0, policy_version 1889300 (0.0008) [2023-12-28 08:50:29,062][106226] Updated weights for policy 0, policy_version 1889310 (0.0007) [2023-12-28 08:50:29,122][106226] Updated weights for policy 0, policy_version 1889320 (0.0008) [2023-12-28 08:50:29,453][106225] Updated weights for policy 1, policy_version 1893377 (0.0010) [2023-12-28 08:50:29,513][106225] Updated weights for policy 1, policy_version 1893387 (0.0008) [2023-12-28 08:50:29,565][106225] Updated weights for policy 1, policy_version 1893397 (0.0008) [2023-12-28 08:50:29,620][106225] Updated weights for policy 1, policy_version 1893407 (0.0008) [2023-12-28 08:50:29,907][106226] Updated weights for policy 0, policy_version 1889330 (0.0009) [2023-12-28 08:50:29,973][106226] Updated weights for policy 0, policy_version 1889340 (0.0008) [2023-12-28 08:50:30,041][106226] Updated weights for policy 0, policy_version 1889350 (0.0007) [2023-12-28 08:50:30,376][106225] Updated weights for policy 1, policy_version 1893417 (0.0009) [2023-12-28 08:50:30,433][106225] Updated weights for policy 1, policy_version 1893427 (0.0008) [2023-12-28 08:50:30,478][106225] Updated weights for policy 1, policy_version 1893437 (0.0008) [2023-12-28 08:50:30,740][106226] Updated weights for policy 0, policy_version 1889360 (0.0009) [2023-12-28 08:50:30,803][106226] Updated weights for policy 0, policy_version 1889370 (0.0009) [2023-12-28 08:50:30,862][106226] Updated weights for policy 0, policy_version 1889380 (0.0008) [2023-12-28 08:50:31,173][106225] Updated weights for policy 1, policy_version 1893447 (0.0008) [2023-12-28 08:50:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 968540160. Throughput: 0: 9687.7, 1: 10076.7. Samples: 968532784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:31,175][105115] Avg episode reward: [(0, '-4.130'), (1, '-4.523')] [2023-12-28 08:50:31,232][106225] Updated weights for policy 1, policy_version 1893457 (0.0006) [2023-12-28 08:50:31,298][106225] Updated weights for policy 1, policy_version 1893467 (0.0007) [2023-12-28 08:50:31,674][106226] Updated weights for policy 0, policy_version 1889390 (0.0009) [2023-12-28 08:50:31,742][106226] Updated weights for policy 0, policy_version 1889400 (0.0008) [2023-12-28 08:50:31,802][106226] Updated weights for policy 0, policy_version 1889410 (0.0009) [2023-12-28 08:50:31,942][106225] Updated weights for policy 1, policy_version 1893477 (0.0007) [2023-12-28 08:50:31,993][106225] Updated weights for policy 1, policy_version 1893487 (0.0008) [2023-12-28 08:50:32,043][106225] Updated weights for policy 1, policy_version 1893497 (0.0007) [2023-12-28 08:50:32,602][106226] Updated weights for policy 0, policy_version 1889420 (0.0009) [2023-12-28 08:50:32,659][106226] Updated weights for policy 0, policy_version 1889430 (0.0009) [2023-12-28 08:50:32,721][106225] Updated weights for policy 1, policy_version 1893507 (0.0008) [2023-12-28 08:50:32,723][106226] Updated weights for policy 0, policy_version 1889440 (0.0008) [2023-12-28 08:50:32,780][106225] Updated weights for policy 1, policy_version 1893517 (0.0006) [2023-12-28 08:50:32,842][106225] Updated weights for policy 1, policy_version 1893527 (0.0008) [2023-12-28 08:50:33,446][106226] Updated weights for policy 0, policy_version 1889450 (0.0007) [2023-12-28 08:50:33,491][106226] Updated weights for policy 0, policy_version 1889460 (0.0008) [2023-12-28 08:50:33,538][106225] Updated weights for policy 1, policy_version 1893537 (0.0009) [2023-12-28 08:50:33,544][106226] Updated weights for policy 0, policy_version 1889470 (0.0007) [2023-12-28 08:50:33,587][106225] Updated weights for policy 1, policy_version 1893547 (0.0010) [2023-12-28 08:50:33,604][106226] Updated weights for policy 0, policy_version 1889480 (0.0006) [2023-12-28 08:50:33,634][106225] Updated weights for policy 1, policy_version 1893557 (0.0010) [2023-12-28 08:50:33,686][106225] Updated weights for policy 1, policy_version 1893567 (0.0010) [2023-12-28 08:50:34,371][106225] Updated weights for policy 1, policy_version 1893577 (0.0007) [2023-12-28 08:50:34,397][106226] Updated weights for policy 0, policy_version 1889490 (0.0007) [2023-12-28 08:50:34,427][106225] Updated weights for policy 1, policy_version 1893587 (0.0006) [2023-12-28 08:50:34,453][106226] Updated weights for policy 0, policy_version 1889500 (0.0008) [2023-12-28 08:50:34,488][106225] Updated weights for policy 1, policy_version 1893597 (0.0007) [2023-12-28 08:50:34,521][106226] Updated weights for policy 0, policy_version 1889510 (0.0008) [2023-12-28 08:50:35,198][106225] Updated weights for policy 1, policy_version 1893607 (0.0009) [2023-12-28 08:50:35,251][106225] Updated weights for policy 1, policy_version 1893617 (0.0009) [2023-12-28 08:50:35,288][106226] Updated weights for policy 0, policy_version 1889520 (0.0008) [2023-12-28 08:50:35,305][106225] Updated weights for policy 1, policy_version 1893627 (0.0008) [2023-12-28 08:50:35,343][106226] Updated weights for policy 0, policy_version 1889530 (0.0006) [2023-12-28 08:50:35,404][106226] Updated weights for policy 0, policy_version 1889540 (0.0009) [2023-12-28 08:50:36,024][106225] Updated weights for policy 1, policy_version 1893637 (0.0007) [2023-12-28 08:50:36,105][106225] Updated weights for policy 1, policy_version 1893647 (0.0008) [2023-12-28 08:50:36,140][106226] Updated weights for policy 0, policy_version 1889550 (0.0008) [2023-12-28 08:50:36,174][106225] Updated weights for policy 1, policy_version 1893657 (0.0007) [2023-12-28 08:50:36,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 968630272. Throughput: 0: 9625.4, 1: 10080.1. Samples: 968648380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-28 08:50:36,175][105115] Avg episode reward: [(0, '-4.433'), (1, '-4.690')] [2023-12-28 08:50:36,210][106226] Updated weights for policy 0, policy_version 1889560 (0.0007) [2023-12-28 08:50:36,275][106226] Updated weights for policy 0, policy_version 1889570 (0.0007) [2023-12-28 08:50:36,791][106225] Updated weights for policy 1, policy_version 1893667 (0.0008) [2023-12-28 08:50:36,854][106225] Updated weights for policy 1, policy_version 1893677 (0.0009) [2023-12-28 08:50:36,916][106225] Updated weights for policy 1, policy_version 1893687 (0.0008) [2023-12-28 08:50:37,071][106226] Updated weights for policy 0, policy_version 1889580 (0.0008) [2023-12-28 08:50:37,127][106226] Updated weights for policy 0, policy_version 1889590 (0.0009) [2023-12-28 08:50:37,192][106226] Updated weights for policy 0, policy_version 1889600 (0.0009) [2023-12-28 08:50:37,517][106225] Updated weights for policy 1, policy_version 1893697 (0.0008) [2023-12-28 08:50:37,568][106225] Updated weights for policy 1, policy_version 1893707 (0.0005) [2023-12-28 08:50:37,614][106225] Updated weights for policy 1, policy_version 1893717 (0.0005) [2023-12-28 08:50:37,666][106225] Updated weights for policy 1, policy_version 1893727 (0.0005) [2023-12-28 08:50:38,052][106226] Updated weights for policy 0, policy_version 1889610 (0.0008) [2023-12-28 08:50:38,111][106226] Updated weights for policy 0, policy_version 1889620 (0.0009) [2023-12-28 08:50:38,166][106226] Updated weights for policy 0, policy_version 1889630 (0.0008) [2023-12-28 08:50:38,216][106225] Updated weights for policy 1, policy_version 1893737 (0.0010) [2023-12-28 08:50:38,227][106226] Updated weights for policy 0, policy_version 1889640 (0.0007) [2023-12-28 08:50:38,279][106225] Updated weights for policy 1, policy_version 1893747 (0.0006) [2023-12-28 08:50:38,339][106225] Updated weights for policy 1, policy_version 1893757 (0.0006) [2023-12-28 08:50:38,985][106225] Updated weights for policy 1, policy_version 1893767 (0.0008) [2023-12-28 08:50:39,055][106225] Updated weights for policy 1, policy_version 1893777 (0.0007) [2023-12-28 08:50:39,073][106226] Updated weights for policy 0, policy_version 1889650 (0.0007) [2023-12-28 08:50:39,111][106225] Updated weights for policy 1, policy_version 1893787 (0.0010) [2023-12-28 08:50:39,136][106226] Updated weights for policy 0, policy_version 1889660 (0.0006) [2023-12-28 08:50:39,195][106226] Updated weights for policy 0, policy_version 1889670 (0.0008) [2023-12-28 08:50:39,843][106225] Updated weights for policy 1, policy_version 1893797 (0.0010) [2023-12-28 08:50:39,904][106225] Updated weights for policy 1, policy_version 1893807 (0.0010) [2023-12-28 08:50:39,965][106226] Updated weights for policy 0, policy_version 1889680 (0.0007) [2023-12-28 08:50:39,968][106225] Updated weights for policy 1, policy_version 1893817 (0.0010) [2023-12-28 08:50:40,023][106226] Updated weights for policy 0, policy_version 1889690 (0.0007) [2023-12-28 08:50:40,080][106226] Updated weights for policy 0, policy_version 1889700 (0.0008) [2023-12-28 08:50:40,701][106225] Updated weights for policy 1, policy_version 1893827 (0.0010) [2023-12-28 08:50:40,764][106225] Updated weights for policy 1, policy_version 1893837 (0.0010) [2023-12-28 08:50:40,770][106226] Updated weights for policy 0, policy_version 1889710 (0.0010) [2023-12-28 08:50:40,818][106225] Updated weights for policy 1, policy_version 1893847 (0.0010) [2023-12-28 08:50:40,829][106226] Updated weights for policy 0, policy_version 1889720 (0.0007) [2023-12-28 08:50:40,881][106226] Updated weights for policy 0, policy_version 1889730 (0.0008) [2023-12-28 08:50:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 968736768. Throughput: 0: 9501.9, 1: 10183.6. Samples: 968707192. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:50:41,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.707')] [2023-12-28 08:50:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001889736_483852288.pth... [2023-12-28 08:50:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001893856_484884480.pth... [2023-12-28 08:50:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001888648_483573760.pth [2023-12-28 08:50:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001892672_484581376.pth [2023-12-28 08:50:41,615][106225] Updated weights for policy 1, policy_version 1893857 (0.0010) [2023-12-28 08:50:41,671][106226] Updated weights for policy 0, policy_version 1889740 (0.0008) [2023-12-28 08:50:41,699][106225] Updated weights for policy 1, policy_version 1893867 (0.0009) [2023-12-28 08:50:41,748][106226] Updated weights for policy 0, policy_version 1889750 (0.0008) [2023-12-28 08:50:41,767][106225] Updated weights for policy 1, policy_version 1893877 (0.0008) [2023-12-28 08:50:41,815][106226] Updated weights for policy 0, policy_version 1889760 (0.0007) [2023-12-28 08:50:41,831][106225] Updated weights for policy 1, policy_version 1893887 (0.0006) [2023-12-28 08:50:42,521][106226] Updated weights for policy 0, policy_version 1889770 (0.0006) [2023-12-28 08:50:42,538][106225] Updated weights for policy 1, policy_version 1893897 (0.0009) [2023-12-28 08:50:42,575][106226] Updated weights for policy 0, policy_version 1889780 (0.0006) [2023-12-28 08:50:42,598][106225] Updated weights for policy 1, policy_version 1893907 (0.0010) [2023-12-28 08:50:42,641][106226] Updated weights for policy 0, policy_version 1889790 (0.0006) [2023-12-28 08:50:42,663][106225] Updated weights for policy 1, policy_version 1893917 (0.0011) [2023-12-28 08:50:42,697][106226] Updated weights for policy 0, policy_version 1889800 (0.0006) [2023-12-28 08:50:43,369][106226] Updated weights for policy 0, policy_version 1889810 (0.0007) [2023-12-28 08:50:43,375][106225] Updated weights for policy 1, policy_version 1893927 (0.0010) [2023-12-28 08:50:43,425][106225] Updated weights for policy 1, policy_version 1893937 (0.0010) [2023-12-28 08:50:43,430][106226] Updated weights for policy 0, policy_version 1889820 (0.0006) [2023-12-28 08:50:43,482][106225] Updated weights for policy 1, policy_version 1893947 (0.0010) [2023-12-28 08:50:43,484][106226] Updated weights for policy 0, policy_version 1889830 (0.0006) [2023-12-28 08:50:44,112][106226] Updated weights for policy 0, policy_version 1889840 (0.0008) [2023-12-28 08:50:44,176][106226] Updated weights for policy 0, policy_version 1889850 (0.0007) [2023-12-28 08:50:44,196][106225] Updated weights for policy 1, policy_version 1893957 (0.0010) [2023-12-28 08:50:44,234][106226] Updated weights for policy 0, policy_version 1889860 (0.0006) [2023-12-28 08:50:44,250][106225] Updated weights for policy 1, policy_version 1893967 (0.0010) [2023-12-28 08:50:44,300][106225] Updated weights for policy 1, policy_version 1893977 (0.0010) [2023-12-28 08:50:44,871][106226] Updated weights for policy 0, policy_version 1889870 (0.0007) [2023-12-28 08:50:44,938][106226] Updated weights for policy 0, policy_version 1889880 (0.0008) [2023-12-28 08:50:45,003][106226] Updated weights for policy 0, policy_version 1889890 (0.0008) [2023-12-28 08:50:45,007][106225] Updated weights for policy 1, policy_version 1893987 (0.0008) [2023-12-28 08:50:45,073][106225] Updated weights for policy 1, policy_version 1893997 (0.0010) [2023-12-28 08:50:45,142][106225] Updated weights for policy 1, policy_version 1894007 (0.0011) [2023-12-28 08:50:45,631][106226] Updated weights for policy 0, policy_version 1889900 (0.0006) [2023-12-28 08:50:45,682][106226] Updated weights for policy 0, policy_version 1889910 (0.0007) [2023-12-28 08:50:45,725][106226] Updated weights for policy 0, policy_version 1889920 (0.0007) [2023-12-28 08:50:45,858][106225] Updated weights for policy 1, policy_version 1894017 (0.0010) [2023-12-28 08:50:45,925][106225] Updated weights for policy 1, policy_version 1894027 (0.0007) [2023-12-28 08:50:45,984][106225] Updated weights for policy 1, policy_version 1894037 (0.0010) [2023-12-28 08:50:46,047][106225] Updated weights for policy 1, policy_version 1894047 (0.0010) [2023-12-28 08:50:46,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 968835072. Throughput: 0: 9408.2, 1: 10096.6. Samples: 968822724. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:50:46,176][105115] Avg episode reward: [(0, '-4.226'), (1, '-4.538')] [2023-12-28 08:50:46,510][106226] Updated weights for policy 0, policy_version 1889930 (0.0007) [2023-12-28 08:50:46,569][106226] Updated weights for policy 0, policy_version 1889940 (0.0005) [2023-12-28 08:50:46,571][106225] Updated weights for policy 1, policy_version 1894057 (0.0006) [2023-12-28 08:50:46,619][106226] Updated weights for policy 0, policy_version 1889950 (0.0008) [2023-12-28 08:50:46,625][106225] Updated weights for policy 1, policy_version 1894067 (0.0005) [2023-12-28 08:50:46,668][106226] Updated weights for policy 0, policy_version 1889960 (0.0008) [2023-12-28 08:50:46,685][106225] Updated weights for policy 1, policy_version 1894077 (0.0005) [2023-12-28 08:50:47,365][106226] Updated weights for policy 0, policy_version 1889970 (0.0007) [2023-12-28 08:50:47,385][106225] Updated weights for policy 1, policy_version 1894087 (0.0010) [2023-12-28 08:50:47,426][106226] Updated weights for policy 0, policy_version 1889980 (0.0008) [2023-12-28 08:50:47,441][106225] Updated weights for policy 1, policy_version 1894097 (0.0010) [2023-12-28 08:50:47,485][106226] Updated weights for policy 0, policy_version 1889990 (0.0010) [2023-12-28 08:50:47,492][106225] Updated weights for policy 1, policy_version 1894107 (0.0010) [2023-12-28 08:50:48,086][106225] Updated weights for policy 1, policy_version 1894117 (0.0008) [2023-12-28 08:50:48,146][106225] Updated weights for policy 1, policy_version 1894127 (0.0009) [2023-12-28 08:50:48,194][106225] Updated weights for policy 1, policy_version 1894137 (0.0007) [2023-12-28 08:50:48,205][106226] Updated weights for policy 0, policy_version 1890000 (0.0009) [2023-12-28 08:50:48,264][106226] Updated weights for policy 0, policy_version 1890010 (0.0007) [2023-12-28 08:50:48,325][106226] Updated weights for policy 0, policy_version 1890020 (0.0006) [2023-12-28 08:50:48,914][106225] Updated weights for policy 1, policy_version 1894147 (0.0007) [2023-12-28 08:50:48,979][106225] Updated weights for policy 1, policy_version 1894157 (0.0010) [2023-12-28 08:50:49,044][106225] Updated weights for policy 1, policy_version 1894167 (0.0010) [2023-12-28 08:50:49,106][106226] Updated weights for policy 0, policy_version 1890030 (0.0014) [2023-12-28 08:50:49,170][106226] Updated weights for policy 0, policy_version 1890040 (0.0011) [2023-12-28 08:50:49,233][106226] Updated weights for policy 0, policy_version 1890050 (0.0011) [2023-12-28 08:50:49,781][106225] Updated weights for policy 1, policy_version 1894177 (0.0010) [2023-12-28 08:50:49,856][106225] Updated weights for policy 1, policy_version 1894187 (0.0007) [2023-12-28 08:50:49,915][106225] Updated weights for policy 1, policy_version 1894197 (0.0008) [2023-12-28 08:50:49,973][106226] Updated weights for policy 0, policy_version 1890060 (0.0011) [2023-12-28 08:50:49,984][106225] Updated weights for policy 1, policy_version 1894207 (0.0007) [2023-12-28 08:50:50,035][106226] Updated weights for policy 0, policy_version 1890070 (0.0010) [2023-12-28 08:50:50,090][106226] Updated weights for policy 0, policy_version 1890080 (0.0006) [2023-12-28 08:50:50,654][106225] Updated weights for policy 1, policy_version 1894217 (0.0007) [2023-12-28 08:50:50,716][106225] Updated weights for policy 1, policy_version 1894227 (0.0006) [2023-12-28 08:50:50,773][106225] Updated weights for policy 1, policy_version 1894237 (0.0006) [2023-12-28 08:50:50,795][106226] Updated weights for policy 0, policy_version 1890090 (0.0009) [2023-12-28 08:50:50,867][106226] Updated weights for policy 0, policy_version 1890100 (0.0008) [2023-12-28 08:50:50,940][106226] Updated weights for policy 0, policy_version 1890110 (0.0008) [2023-12-28 08:50:51,008][106226] Updated weights for policy 0, policy_version 1890120 (0.0007) [2023-12-28 08:50:51,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 968933376. Throughput: 0: 9396.6, 1: 10105.2. Samples: 968941108. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:50:51,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.699')] [2023-12-28 08:50:51,497][106225] Updated weights for policy 1, policy_version 1894247 (0.0008) [2023-12-28 08:50:51,557][106225] Updated weights for policy 1, policy_version 1894257 (0.0009) [2023-12-28 08:50:51,607][106225] Updated weights for policy 1, policy_version 1894267 (0.0008) [2023-12-28 08:50:51,754][106226] Updated weights for policy 0, policy_version 1890130 (0.0009) [2023-12-28 08:50:51,811][106226] Updated weights for policy 0, policy_version 1890140 (0.0009) [2023-12-28 08:50:51,874][106226] Updated weights for policy 0, policy_version 1890150 (0.0008) [2023-12-28 08:50:52,375][106225] Updated weights for policy 1, policy_version 1894277 (0.0008) [2023-12-28 08:50:52,437][106225] Updated weights for policy 1, policy_version 1894287 (0.0007) [2023-12-28 08:50:52,501][106225] Updated weights for policy 1, policy_version 1894297 (0.0008) [2023-12-28 08:50:52,650][106226] Updated weights for policy 0, policy_version 1890160 (0.0009) [2023-12-28 08:50:52,712][106226] Updated weights for policy 0, policy_version 1890170 (0.0009) [2023-12-28 08:50:52,776][106226] Updated weights for policy 0, policy_version 1890180 (0.0008) [2023-12-28 08:50:53,239][106225] Updated weights for policy 1, policy_version 1894307 (0.0009) [2023-12-28 08:50:53,292][106225] Updated weights for policy 1, policy_version 1894317 (0.0010) [2023-12-28 08:50:53,351][106225] Updated weights for policy 1, policy_version 1894327 (0.0010) [2023-12-28 08:50:53,460][106226] Updated weights for policy 0, policy_version 1890190 (0.0008) [2023-12-28 08:50:53,522][106226] Updated weights for policy 0, policy_version 1890200 (0.0008) [2023-12-28 08:50:53,580][106226] Updated weights for policy 0, policy_version 1890210 (0.0008) [2023-12-28 08:50:54,022][106225] Updated weights for policy 1, policy_version 1894337 (0.0010) [2023-12-28 08:50:54,096][106225] Updated weights for policy 1, policy_version 1894347 (0.0009) [2023-12-28 08:50:54,154][106225] Updated weights for policy 1, policy_version 1894357 (0.0007) [2023-12-28 08:50:54,201][106225] Updated weights for policy 1, policy_version 1894367 (0.0008) [2023-12-28 08:50:54,252][106226] Updated weights for policy 0, policy_version 1890220 (0.0008) [2023-12-28 08:50:54,304][106226] Updated weights for policy 0, policy_version 1890230 (0.0009) [2023-12-28 08:50:54,353][106226] Updated weights for policy 0, policy_version 1890240 (0.0008) [2023-12-28 08:50:54,923][106225] Updated weights for policy 1, policy_version 1894377 (0.0008) [2023-12-28 08:50:54,972][106225] Updated weights for policy 1, policy_version 1894387 (0.0008) [2023-12-28 08:50:55,030][106225] Updated weights for policy 1, policy_version 1894397 (0.0008) [2023-12-28 08:50:55,081][106226] Updated weights for policy 0, policy_version 1890250 (0.0009) [2023-12-28 08:50:55,142][106226] Updated weights for policy 0, policy_version 1890260 (0.0009) [2023-12-28 08:50:55,202][106226] Updated weights for policy 0, policy_version 1890270 (0.0008) [2023-12-28 08:50:55,250][106226] Updated weights for policy 0, policy_version 1890280 (0.0008) [2023-12-28 08:50:55,758][106225] Updated weights for policy 1, policy_version 1894407 (0.0009) [2023-12-28 08:50:55,804][106225] Updated weights for policy 1, policy_version 1894417 (0.0008) [2023-12-28 08:50:55,852][106225] Updated weights for policy 1, policy_version 1894427 (0.0008) [2023-12-28 08:50:55,951][106226] Updated weights for policy 0, policy_version 1890290 (0.0008) [2023-12-28 08:50:55,999][106226] Updated weights for policy 0, policy_version 1890300 (0.0009) [2023-12-28 08:50:56,058][106226] Updated weights for policy 0, policy_version 1890310 (0.0009) [2023-12-28 08:50:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 969031680. Throughput: 0: 9424.1, 1: 10037.5. Samples: 968997980. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:50:56,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.726')] [2023-12-28 08:50:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001890312_483999744.pth... [2023-12-28 08:50:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001894432_485031936.pth... [2023-12-28 08:50:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001889192_483713024.pth [2023-12-28 08:50:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001893248_484728832.pth [2023-12-28 08:50:56,517][106225] Updated weights for policy 1, policy_version 1894437 (0.0008) [2023-12-28 08:50:56,568][106225] Updated weights for policy 1, policy_version 1894447 (0.0009) [2023-12-28 08:50:56,622][106225] Updated weights for policy 1, policy_version 1894457 (0.0009) [2023-12-28 08:50:56,830][106226] Updated weights for policy 0, policy_version 1890320 (0.0008) [2023-12-28 08:50:56,894][106226] Updated weights for policy 0, policy_version 1890330 (0.0009) [2023-12-28 08:50:56,949][106226] Updated weights for policy 0, policy_version 1890340 (0.0008) [2023-12-28 08:50:57,413][106225] Updated weights for policy 1, policy_version 1894467 (0.0008) [2023-12-28 08:50:57,461][106225] Updated weights for policy 1, policy_version 1894477 (0.0008) [2023-12-28 08:50:57,517][106225] Updated weights for policy 1, policy_version 1894487 (0.0009) [2023-12-28 08:50:57,524][106226] Updated weights for policy 0, policy_version 1890350 (0.0008) [2023-12-28 08:50:57,579][106226] Updated weights for policy 0, policy_version 1890360 (0.0006) [2023-12-28 08:50:57,627][106226] Updated weights for policy 0, policy_version 1890370 (0.0005) [2023-12-28 08:50:58,155][106226] Updated weights for policy 0, policy_version 1890380 (0.0005) [2023-12-28 08:50:58,210][106226] Updated weights for policy 0, policy_version 1890390 (0.0006) [2023-12-28 08:50:58,271][106226] Updated weights for policy 0, policy_version 1890400 (0.0009) [2023-12-28 08:50:58,336][106225] Updated weights for policy 1, policy_version 1894497 (0.0008) [2023-12-28 08:50:58,404][106225] Updated weights for policy 1, policy_version 1894507 (0.0008) [2023-12-28 08:50:58,469][106225] Updated weights for policy 1, policy_version 1894517 (0.0007) [2023-12-28 08:50:58,530][106225] Updated weights for policy 1, policy_version 1894527 (0.0009) [2023-12-28 08:50:59,012][106226] Updated weights for policy 0, policy_version 1890410 (0.0009) [2023-12-28 08:50:59,073][106226] Updated weights for policy 0, policy_version 1890420 (0.0008) [2023-12-28 08:50:59,137][106226] Updated weights for policy 0, policy_version 1890430 (0.0008) [2023-12-28 08:50:59,194][106226] Updated weights for policy 0, policy_version 1890440 (0.0008) [2023-12-28 08:50:59,290][106225] Updated weights for policy 1, policy_version 1894537 (0.0008) [2023-12-28 08:50:59,358][106225] Updated weights for policy 1, policy_version 1894547 (0.0009) [2023-12-28 08:50:59,418][106225] Updated weights for policy 1, policy_version 1894557 (0.0006) [2023-12-28 08:50:59,912][106226] Updated weights for policy 0, policy_version 1890450 (0.0009) [2023-12-28 08:50:59,976][106226] Updated weights for policy 0, policy_version 1890460 (0.0009) [2023-12-28 08:51:00,039][106226] Updated weights for policy 0, policy_version 1890470 (0.0007) [2023-12-28 08:51:00,149][106225] Updated weights for policy 1, policy_version 1894567 (0.0007) [2023-12-28 08:51:00,208][106225] Updated weights for policy 1, policy_version 1894577 (0.0005) [2023-12-28 08:51:00,264][106225] Updated weights for policy 1, policy_version 1894587 (0.0008) [2023-12-28 08:51:00,782][106226] Updated weights for policy 0, policy_version 1890480 (0.0008) [2023-12-28 08:51:00,836][106226] Updated weights for policy 0, policy_version 1890490 (0.0008) [2023-12-28 08:51:00,896][106226] Updated weights for policy 0, policy_version 1890500 (0.0006) [2023-12-28 08:51:00,923][106225] Updated weights for policy 1, policy_version 1894597 (0.0007) [2023-12-28 08:51:00,984][106225] Updated weights for policy 1, policy_version 1894607 (0.0008) [2023-12-28 08:51:01,049][106225] Updated weights for policy 1, policy_version 1894617 (0.0011) [2023-12-28 08:51:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 969129984. Throughput: 0: 9485.0, 1: 9946.5. Samples: 969114920. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:01,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.721')] [2023-12-28 08:51:01,678][106226] Updated weights for policy 0, policy_version 1890510 (0.0009) [2023-12-28 08:51:01,746][106226] Updated weights for policy 0, policy_version 1890520 (0.0008) [2023-12-28 08:51:01,802][106226] Updated weights for policy 0, policy_version 1890530 (0.0008) [2023-12-28 08:51:01,835][106225] Updated weights for policy 1, policy_version 1894627 (0.0009) [2023-12-28 08:51:01,896][106225] Updated weights for policy 1, policy_version 1894637 (0.0008) [2023-12-28 08:51:01,957][106225] Updated weights for policy 1, policy_version 1894647 (0.0008) [2023-12-28 08:51:02,526][106226] Updated weights for policy 0, policy_version 1890540 (0.0009) [2023-12-28 08:51:02,593][106226] Updated weights for policy 0, policy_version 1890550 (0.0009) [2023-12-28 08:51:02,645][106225] Updated weights for policy 1, policy_version 1894657 (0.0008) [2023-12-28 08:51:02,655][106226] Updated weights for policy 0, policy_version 1890560 (0.0009) [2023-12-28 08:51:02,702][106225] Updated weights for policy 1, policy_version 1894667 (0.0007) [2023-12-28 08:51:02,764][106225] Updated weights for policy 1, policy_version 1894677 (0.0009) [2023-12-28 08:51:02,824][106225] Updated weights for policy 1, policy_version 1894687 (0.0007) [2023-12-28 08:51:03,411][106226] Updated weights for policy 0, policy_version 1890570 (0.0007) [2023-12-28 08:51:03,453][106225] Updated weights for policy 1, policy_version 1894697 (0.0006) [2023-12-28 08:51:03,466][106226] Updated weights for policy 0, policy_version 1890580 (0.0008) [2023-12-28 08:51:03,508][106225] Updated weights for policy 1, policy_version 1894707 (0.0005) [2023-12-28 08:51:03,525][106226] Updated weights for policy 0, policy_version 1890590 (0.0007) [2023-12-28 08:51:03,566][106225] Updated weights for policy 1, policy_version 1894717 (0.0005) [2023-12-28 08:51:03,582][106226] Updated weights for policy 0, policy_version 1890600 (0.0008) [2023-12-28 08:51:04,280][106225] Updated weights for policy 1, policy_version 1894727 (0.0009) [2023-12-28 08:51:04,291][106226] Updated weights for policy 0, policy_version 1890610 (0.0011) [2023-12-28 08:51:04,344][106225] Updated weights for policy 1, policy_version 1894737 (0.0006) [2023-12-28 08:51:04,346][106226] Updated weights for policy 0, policy_version 1890620 (0.0011) [2023-12-28 08:51:04,406][106226] Updated weights for policy 0, policy_version 1890630 (0.0011) [2023-12-28 08:51:04,408][106225] Updated weights for policy 1, policy_version 1894747 (0.0006) [2023-12-28 08:51:05,082][106225] Updated weights for policy 1, policy_version 1894757 (0.0007) [2023-12-28 08:51:05,092][106226] Updated weights for policy 0, policy_version 1890640 (0.0011) [2023-12-28 08:51:05,140][106225] Updated weights for policy 1, policy_version 1894767 (0.0007) [2023-12-28 08:51:05,154][106226] Updated weights for policy 0, policy_version 1890650 (0.0010) [2023-12-28 08:51:05,199][106225] Updated weights for policy 1, policy_version 1894777 (0.0008) [2023-12-28 08:51:05,211][106226] Updated weights for policy 0, policy_version 1890660 (0.0011) [2023-12-28 08:51:05,854][106226] Updated weights for policy 0, policy_version 1890670 (0.0011) [2023-12-28 08:51:05,913][106226] Updated weights for policy 0, policy_version 1890680 (0.0005) [2023-12-28 08:51:05,923][106225] Updated weights for policy 1, policy_version 1894787 (0.0008) [2023-12-28 08:51:05,963][106226] Updated weights for policy 0, policy_version 1890690 (0.0006) [2023-12-28 08:51:05,975][106225] Updated weights for policy 1, policy_version 1894797 (0.0009) [2023-12-28 08:51:06,032][106225] Updated weights for policy 1, policy_version 1894807 (0.0009) [2023-12-28 08:51:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 969228288. Throughput: 0: 9561.7, 1: 9908.6. Samples: 969233020. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:06,175][105115] Avg episode reward: [(0, '-4.322'), (1, '-4.569')] [2023-12-28 08:51:06,637][106226] Updated weights for policy 0, policy_version 1890700 (0.0007) [2023-12-28 08:51:06,702][106226] Updated weights for policy 0, policy_version 1890710 (0.0011) [2023-12-28 08:51:06,763][106226] Updated weights for policy 0, policy_version 1890720 (0.0011) [2023-12-28 08:51:06,787][106225] Updated weights for policy 1, policy_version 1894817 (0.0009) [2023-12-28 08:51:06,848][106225] Updated weights for policy 1, policy_version 1894827 (0.0007) [2023-12-28 08:51:06,909][106225] Updated weights for policy 1, policy_version 1894837 (0.0008) [2023-12-28 08:51:06,969][106225] Updated weights for policy 1, policy_version 1894848 (0.0007) [2023-12-28 08:51:07,450][106226] Updated weights for policy 0, policy_version 1890730 (0.0011) [2023-12-28 08:51:07,507][106226] Updated weights for policy 0, policy_version 1890740 (0.0011) [2023-12-28 08:51:07,558][106226] Updated weights for policy 0, policy_version 1890750 (0.0010) [2023-12-28 08:51:07,563][106225] Updated weights for policy 1, policy_version 1894858 (0.0007) [2023-12-28 08:51:07,614][106226] Updated weights for policy 0, policy_version 1890760 (0.0010) [2023-12-28 08:51:07,618][106225] Updated weights for policy 1, policy_version 1894868 (0.0008) [2023-12-28 08:51:07,674][106225] Updated weights for policy 1, policy_version 1894878 (0.0010) [2023-12-28 08:51:08,321][106226] Updated weights for policy 0, policy_version 1890770 (0.0011) [2023-12-28 08:51:08,333][106225] Updated weights for policy 1, policy_version 1894888 (0.0006) [2023-12-28 08:51:08,381][106226] Updated weights for policy 0, policy_version 1890780 (0.0011) [2023-12-28 08:51:08,394][106225] Updated weights for policy 1, policy_version 1894898 (0.0006) [2023-12-28 08:51:08,441][106226] Updated weights for policy 0, policy_version 1890790 (0.0011) [2023-12-28 08:51:08,449][106225] Updated weights for policy 1, policy_version 1894908 (0.0009) [2023-12-28 08:51:09,130][106226] Updated weights for policy 0, policy_version 1890800 (0.0008) [2023-12-28 08:51:09,162][106225] Updated weights for policy 1, policy_version 1894918 (0.0009) [2023-12-28 08:51:09,186][106226] Updated weights for policy 0, policy_version 1890810 (0.0010) [2023-12-28 08:51:09,217][106225] Updated weights for policy 1, policy_version 1894928 (0.0010) [2023-12-28 08:51:09,251][106226] Updated weights for policy 0, policy_version 1890820 (0.0009) [2023-12-28 08:51:09,290][106225] Updated weights for policy 1, policy_version 1894938 (0.0010) [2023-12-28 08:51:10,029][106226] Updated weights for policy 0, policy_version 1890830 (0.0007) [2023-12-28 08:51:10,097][106226] Updated weights for policy 0, policy_version 1890840 (0.0007) [2023-12-28 08:51:10,123][106225] Updated weights for policy 1, policy_version 1894948 (0.0009) [2023-12-28 08:51:10,163][106226] Updated weights for policy 0, policy_version 1890850 (0.0011) [2023-12-28 08:51:10,189][106225] Updated weights for policy 1, policy_version 1894958 (0.0008) [2023-12-28 08:51:10,252][106225] Updated weights for policy 1, policy_version 1894968 (0.0007) [2023-12-28 08:51:10,851][106226] Updated weights for policy 0, policy_version 1890860 (0.0011) [2023-12-28 08:51:10,881][106225] Updated weights for policy 1, policy_version 1894978 (0.0006) [2023-12-28 08:51:10,915][106226] Updated weights for policy 0, policy_version 1890870 (0.0009) [2023-12-28 08:51:10,943][106225] Updated weights for policy 1, policy_version 1894988 (0.0007) [2023-12-28 08:51:10,967][106226] Updated weights for policy 0, policy_version 1890880 (0.0008) [2023-12-28 08:51:11,005][106225] Updated weights for policy 1, policy_version 1894998 (0.0006) [2023-12-28 08:51:11,075][106225] Updated weights for policy 1, policy_version 1895008 (0.0010) [2023-12-28 08:51:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 969326592. Throughput: 0: 9547.9, 1: 9964.3. Samples: 969293340. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:11,175][105115] Avg episode reward: [(0, '-4.266'), (1, '-4.410')] [2023-12-28 08:51:11,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001895008_485179392.pth... [2023-12-28 08:51:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001890888_484147200.pth... [2023-12-28 08:51:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001893856_484884480.pth [2023-12-28 08:51:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001889736_483852288.pth [2023-12-28 08:51:11,685][106226] Updated weights for policy 0, policy_version 1890890 (0.0010) [2023-12-28 08:51:11,752][106226] Updated weights for policy 0, policy_version 1890900 (0.0009) [2023-12-28 08:51:11,812][106226] Updated weights for policy 0, policy_version 1890910 (0.0008) [2023-12-28 08:51:11,823][106225] Updated weights for policy 1, policy_version 1895018 (0.0006) [2023-12-28 08:51:11,870][106226] Updated weights for policy 0, policy_version 1890920 (0.0006) [2023-12-28 08:51:11,876][106225] Updated weights for policy 1, policy_version 1895028 (0.0008) [2023-12-28 08:51:11,936][106225] Updated weights for policy 1, policy_version 1895038 (0.0008) [2023-12-28 08:51:12,640][106226] Updated weights for policy 0, policy_version 1890930 (0.0006) [2023-12-28 08:51:12,701][106225] Updated weights for policy 1, policy_version 1895048 (0.0007) [2023-12-28 08:51:12,703][106226] Updated weights for policy 0, policy_version 1890940 (0.0006) [2023-12-28 08:51:12,760][106226] Updated weights for policy 0, policy_version 1890950 (0.0007) [2023-12-28 08:51:12,763][106225] Updated weights for policy 1, policy_version 1895058 (0.0007) [2023-12-28 08:51:12,815][106225] Updated weights for policy 1, policy_version 1895068 (0.0008) [2023-12-28 08:51:13,445][106226] Updated weights for policy 0, policy_version 1890960 (0.0009) [2023-12-28 08:51:13,460][106225] Updated weights for policy 1, policy_version 1895078 (0.0007) [2023-12-28 08:51:13,493][106226] Updated weights for policy 0, policy_version 1890970 (0.0006) [2023-12-28 08:51:13,506][106225] Updated weights for policy 1, policy_version 1895088 (0.0010) [2023-12-28 08:51:13,547][106226] Updated weights for policy 0, policy_version 1890980 (0.0005) [2023-12-28 08:51:13,560][106225] Updated weights for policy 1, policy_version 1895098 (0.0010) [2023-12-28 08:51:14,284][106225] Updated weights for policy 1, policy_version 1895108 (0.0010) [2023-12-28 08:51:14,304][106226] Updated weights for policy 0, policy_version 1890990 (0.0006) [2023-12-28 08:51:14,342][106225] Updated weights for policy 1, policy_version 1895118 (0.0007) [2023-12-28 08:51:14,353][106226] Updated weights for policy 0, policy_version 1891000 (0.0006) [2023-12-28 08:51:14,402][106225] Updated weights for policy 1, policy_version 1895128 (0.0007) [2023-12-28 08:51:14,405][106226] Updated weights for policy 0, policy_version 1891010 (0.0006) [2023-12-28 08:51:15,129][106226] Updated weights for policy 0, policy_version 1891020 (0.0006) [2023-12-28 08:51:15,136][106225] Updated weights for policy 1, policy_version 1895138 (0.0007) [2023-12-28 08:51:15,186][106226] Updated weights for policy 0, policy_version 1891030 (0.0008) [2023-12-28 08:51:15,191][106225] Updated weights for policy 1, policy_version 1895148 (0.0007) [2023-12-28 08:51:15,249][106226] Updated weights for policy 0, policy_version 1891040 (0.0007) [2023-12-28 08:51:15,256][106225] Updated weights for policy 1, policy_version 1895158 (0.0007) [2023-12-28 08:51:15,318][106225] Updated weights for policy 1, policy_version 1895168 (0.0007) [2023-12-28 08:51:15,937][106226] Updated weights for policy 0, policy_version 1891050 (0.0007) [2023-12-28 08:51:15,974][106225] Updated weights for policy 1, policy_version 1895178 (0.0009) [2023-12-28 08:51:15,990][106226] Updated weights for policy 0, policy_version 1891060 (0.0005) [2023-12-28 08:51:16,025][106225] Updated weights for policy 1, policy_version 1895188 (0.0007) [2023-12-28 08:51:16,048][106226] Updated weights for policy 0, policy_version 1891070 (0.0005) [2023-12-28 08:51:16,078][106225] Updated weights for policy 1, policy_version 1895198 (0.0008) [2023-12-28 08:51:16,107][106226] Updated weights for policy 0, policy_version 1891080 (0.0005) [2023-12-28 08:51:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 969424896. Throughput: 0: 9593.8, 1: 9858.2. Samples: 969408124. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:16,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.783')] [2023-12-28 08:51:16,730][106226] Updated weights for policy 0, policy_version 1891090 (0.0011) [2023-12-28 08:51:16,776][106226] Updated weights for policy 0, policy_version 1891100 (0.0010) [2023-12-28 08:51:16,832][106226] Updated weights for policy 0, policy_version 1891110 (0.0010) [2023-12-28 08:51:16,858][106225] Updated weights for policy 1, policy_version 1895208 (0.0007) [2023-12-28 08:51:16,918][106225] Updated weights for policy 1, policy_version 1895218 (0.0007) [2023-12-28 08:51:16,971][106225] Updated weights for policy 1, policy_version 1895228 (0.0009) [2023-12-28 08:51:17,550][106226] Updated weights for policy 0, policy_version 1891120 (0.0009) [2023-12-28 08:51:17,606][106226] Updated weights for policy 0, policy_version 1891130 (0.0010) [2023-12-28 08:51:17,670][106226] Updated weights for policy 0, policy_version 1891140 (0.0007) [2023-12-28 08:51:17,684][106225] Updated weights for policy 1, policy_version 1895238 (0.0007) [2023-12-28 08:51:17,746][106225] Updated weights for policy 1, policy_version 1895248 (0.0009) [2023-12-28 08:51:17,793][106225] Updated weights for policy 1, policy_version 1895258 (0.0010) [2023-12-28 08:51:18,311][106226] Updated weights for policy 0, policy_version 1891150 (0.0009) [2023-12-28 08:51:18,387][106226] Updated weights for policy 0, policy_version 1891160 (0.0010) [2023-12-28 08:51:18,454][106226] Updated weights for policy 0, policy_version 1891170 (0.0010) [2023-12-28 08:51:18,486][106225] Updated weights for policy 1, policy_version 1895268 (0.0011) [2023-12-28 08:51:18,553][106225] Updated weights for policy 1, policy_version 1895278 (0.0011) [2023-12-28 08:51:18,611][106225] Updated weights for policy 1, policy_version 1895288 (0.0010) [2023-12-28 08:51:19,172][106226] Updated weights for policy 0, policy_version 1891180 (0.0011) [2023-12-28 08:51:19,204][106225] Updated weights for policy 1, policy_version 1895298 (0.0010) [2023-12-28 08:51:19,236][106226] Updated weights for policy 0, policy_version 1891190 (0.0011) [2023-12-28 08:51:19,276][106225] Updated weights for policy 1, policy_version 1895308 (0.0009) [2023-12-28 08:51:19,295][106226] Updated weights for policy 0, policy_version 1891200 (0.0009) [2023-12-28 08:51:19,329][106225] Updated weights for policy 1, policy_version 1895318 (0.0009) [2023-12-28 08:51:19,390][106225] Updated weights for policy 1, policy_version 1895328 (0.0009) [2023-12-28 08:51:20,016][106226] Updated weights for policy 0, policy_version 1891210 (0.0009) [2023-12-28 08:51:20,072][106226] Updated weights for policy 0, policy_version 1891220 (0.0011) [2023-12-28 08:51:20,137][106226] Updated weights for policy 0, policy_version 1891230 (0.0011) [2023-12-28 08:51:20,182][106225] Updated weights for policy 1, policy_version 1895338 (0.0011) [2023-12-28 08:51:20,199][106226] Updated weights for policy 0, policy_version 1891240 (0.0008) [2023-12-28 08:51:20,240][106225] Updated weights for policy 1, policy_version 1895348 (0.0010) [2023-12-28 08:51:20,313][106225] Updated weights for policy 1, policy_version 1895358 (0.0006) [2023-12-28 08:51:20,855][106226] Updated weights for policy 0, policy_version 1891250 (0.0011) [2023-12-28 08:51:20,923][106226] Updated weights for policy 0, policy_version 1891260 (0.0009) [2023-12-28 08:51:20,980][106226] Updated weights for policy 0, policy_version 1891270 (0.0011) [2023-12-28 08:51:21,039][106225] Updated weights for policy 1, policy_version 1895368 (0.0010) [2023-12-28 08:51:21,106][106225] Updated weights for policy 1, policy_version 1895378 (0.0011) [2023-12-28 08:51:21,172][106225] Updated weights for policy 1, policy_version 1895388 (0.0011) [2023-12-28 08:51:21,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 969515008. Throughput: 0: 9697.1, 1: 9822.9. Samples: 969526784. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:21,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.668')] [2023-12-28 08:51:21,762][106226] Updated weights for policy 0, policy_version 1891280 (0.0008) [2023-12-28 08:51:21,815][106226] Updated weights for policy 0, policy_version 1891290 (0.0008) [2023-12-28 08:51:21,880][106226] Updated weights for policy 0, policy_version 1891300 (0.0009) [2023-12-28 08:51:21,911][106225] Updated weights for policy 1, policy_version 1895398 (0.0008) [2023-12-28 08:51:21,976][106225] Updated weights for policy 1, policy_version 1895408 (0.0005) [2023-12-28 08:51:22,047][106225] Updated weights for policy 1, policy_version 1895418 (0.0007) [2023-12-28 08:51:22,548][106226] Updated weights for policy 0, policy_version 1891310 (0.0008) [2023-12-28 08:51:22,612][106226] Updated weights for policy 0, policy_version 1891320 (0.0009) [2023-12-28 08:51:22,672][106226] Updated weights for policy 0, policy_version 1891330 (0.0009) [2023-12-28 08:51:22,683][106225] Updated weights for policy 1, policy_version 1895428 (0.0006) [2023-12-28 08:51:22,746][106225] Updated weights for policy 1, policy_version 1895438 (0.0008) [2023-12-28 08:51:22,809][106225] Updated weights for policy 1, policy_version 1895448 (0.0009) [2023-12-28 08:51:23,390][106226] Updated weights for policy 0, policy_version 1891340 (0.0008) [2023-12-28 08:51:23,444][106226] Updated weights for policy 0, policy_version 1891350 (0.0008) [2023-12-28 08:51:23,509][106225] Updated weights for policy 1, policy_version 1895458 (0.0009) [2023-12-28 08:51:23,515][106226] Updated weights for policy 0, policy_version 1891360 (0.0007) [2023-12-28 08:51:23,562][106225] Updated weights for policy 1, policy_version 1895468 (0.0008) [2023-12-28 08:51:23,620][106225] Updated weights for policy 1, policy_version 1895478 (0.0008) [2023-12-28 08:51:23,679][106225] Updated weights for policy 1, policy_version 1895488 (0.0008) [2023-12-28 08:51:24,179][106226] Updated weights for policy 0, policy_version 1891370 (0.0007) [2023-12-28 08:51:24,245][106226] Updated weights for policy 0, policy_version 1891380 (0.0008) [2023-12-28 08:51:24,300][106226] Updated weights for policy 0, policy_version 1891390 (0.0008) [2023-12-28 08:51:24,345][106226] Updated weights for policy 0, policy_version 1891400 (0.0008) [2023-12-28 08:51:24,429][106225] Updated weights for policy 1, policy_version 1895498 (0.0008) [2023-12-28 08:51:24,496][106225] Updated weights for policy 1, policy_version 1895508 (0.0009) [2023-12-28 08:51:24,556][106225] Updated weights for policy 1, policy_version 1895518 (0.0010) [2023-12-28 08:51:24,994][106226] Updated weights for policy 0, policy_version 1891410 (0.0006) [2023-12-28 08:51:25,052][106226] Updated weights for policy 0, policy_version 1891420 (0.0006) [2023-12-28 08:51:25,107][106226] Updated weights for policy 0, policy_version 1891430 (0.0005) [2023-12-28 08:51:25,248][106225] Updated weights for policy 1, policy_version 1895528 (0.0010) [2023-12-28 08:51:25,309][106225] Updated weights for policy 1, policy_version 1895538 (0.0010) [2023-12-28 08:51:25,371][106225] Updated weights for policy 1, policy_version 1895548 (0.0010) [2023-12-28 08:51:25,694][106226] Updated weights for policy 0, policy_version 1891440 (0.0007) [2023-12-28 08:51:25,757][106226] Updated weights for policy 0, policy_version 1891450 (0.0007) [2023-12-28 08:51:25,822][106226] Updated weights for policy 0, policy_version 1891460 (0.0007) [2023-12-28 08:51:26,047][106225] Updated weights for policy 1, policy_version 1895558 (0.0008) [2023-12-28 08:51:26,110][106225] Updated weights for policy 1, policy_version 1895568 (0.0010) [2023-12-28 08:51:26,160][106225] Updated weights for policy 1, policy_version 1895578 (0.0010) [2023-12-28 08:51:26,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 969613312. Throughput: 0: 9777.7, 1: 9727.5. Samples: 969584928. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:26,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.526')] [2023-12-28 08:51:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001891464_484294656.pth... [2023-12-28 08:51:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001890312_483999744.pth [2023-12-28 08:51:26,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001895584_485326848.pth... [2023-12-28 08:51:26,202][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001894432_485031936.pth [2023-12-28 08:51:26,488][106226] Updated weights for policy 0, policy_version 1891470 (0.0008) [2023-12-28 08:51:26,551][106226] Updated weights for policy 0, policy_version 1891480 (0.0008) [2023-12-28 08:51:26,607][106226] Updated weights for policy 0, policy_version 1891490 (0.0007) [2023-12-28 08:51:26,863][106225] Updated weights for policy 1, policy_version 1895588 (0.0011) [2023-12-28 08:51:26,923][106225] Updated weights for policy 1, policy_version 1895598 (0.0009) [2023-12-28 08:51:26,969][106225] Updated weights for policy 1, policy_version 1895608 (0.0010) [2023-12-28 08:51:27,159][106226] Updated weights for policy 0, policy_version 1891500 (0.0006) [2023-12-28 08:51:27,210][106226] Updated weights for policy 0, policy_version 1891510 (0.0006) [2023-12-28 08:51:27,269][106226] Updated weights for policy 0, policy_version 1891520 (0.0006) [2023-12-28 08:51:27,587][106225] Updated weights for policy 1, policy_version 1895618 (0.0009) [2023-12-28 08:51:27,639][106225] Updated weights for policy 1, policy_version 1895628 (0.0005) [2023-12-28 08:51:27,692][106225] Updated weights for policy 1, policy_version 1895638 (0.0005) [2023-12-28 08:51:27,756][106225] Updated weights for policy 1, policy_version 1895648 (0.0005) [2023-12-28 08:51:27,785][106226] Updated weights for policy 0, policy_version 1891530 (0.0005) [2023-12-28 08:51:27,844][106226] Updated weights for policy 0, policy_version 1891540 (0.0005) [2023-12-28 08:51:27,909][106226] Updated weights for policy 0, policy_version 1891550 (0.0005) [2023-12-28 08:51:27,963][106226] Updated weights for policy 0, policy_version 1891560 (0.0008) [2023-12-28 08:51:28,333][106225] Updated weights for policy 1, policy_version 1895658 (0.0010) [2023-12-28 08:51:28,387][106225] Updated weights for policy 1, policy_version 1895668 (0.0007) [2023-12-28 08:51:28,446][106225] Updated weights for policy 1, policy_version 1895678 (0.0006) [2023-12-28 08:51:28,597][106226] Updated weights for policy 0, policy_version 1891570 (0.0005) [2023-12-28 08:51:28,651][106226] Updated weights for policy 0, policy_version 1891580 (0.0005) [2023-12-28 08:51:28,714][106226] Updated weights for policy 0, policy_version 1891590 (0.0005) [2023-12-28 08:51:29,088][106225] Updated weights for policy 1, policy_version 1895688 (0.0009) [2023-12-28 08:51:29,148][106225] Updated weights for policy 1, policy_version 1895698 (0.0009) [2023-12-28 08:51:29,207][106225] Updated weights for policy 1, policy_version 1895708 (0.0007) [2023-12-28 08:51:29,355][106226] Updated weights for policy 0, policy_version 1891600 (0.0008) [2023-12-28 08:51:29,428][106226] Updated weights for policy 0, policy_version 1891610 (0.0009) [2023-12-28 08:51:29,492][106226] Updated weights for policy 0, policy_version 1891620 (0.0009) [2023-12-28 08:51:29,866][106225] Updated weights for policy 1, policy_version 1895718 (0.0009) [2023-12-28 08:51:29,910][106225] Updated weights for policy 1, policy_version 1895728 (0.0006) [2023-12-28 08:51:29,976][106225] Updated weights for policy 1, policy_version 1895738 (0.0008) [2023-12-28 08:51:30,272][106226] Updated weights for policy 0, policy_version 1891630 (0.0010) [2023-12-28 08:51:30,342][106226] Updated weights for policy 0, policy_version 1891640 (0.0011) [2023-12-28 08:51:30,402][106226] Updated weights for policy 0, policy_version 1891650 (0.0011) [2023-12-28 08:51:30,639][106225] Updated weights for policy 1, policy_version 1895748 (0.0007) [2023-12-28 08:51:30,696][106225] Updated weights for policy 1, policy_version 1895758 (0.0008) [2023-12-28 08:51:30,751][106225] Updated weights for policy 1, policy_version 1895768 (0.0010) [2023-12-28 08:51:31,017][106226] Updated weights for policy 0, policy_version 1891660 (0.0009) [2023-12-28 08:51:31,081][106226] Updated weights for policy 0, policy_version 1891670 (0.0008) [2023-12-28 08:51:31,152][106226] Updated weights for policy 0, policy_version 1891680 (0.0008) [2023-12-28 08:51:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 969719808. Throughput: 0: 9921.0, 1: 9853.8. Samples: 969712588. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:31,175][105115] Avg episode reward: [(0, '-4.116'), (1, '-4.566')] [2023-12-28 08:51:31,480][106225] Updated weights for policy 1, policy_version 1895778 (0.0010) [2023-12-28 08:51:31,544][106225] Updated weights for policy 1, policy_version 1895788 (0.0010) [2023-12-28 08:51:31,607][106225] Updated weights for policy 1, policy_version 1895798 (0.0010) [2023-12-28 08:51:31,674][106225] Updated weights for policy 1, policy_version 1895808 (0.0009) [2023-12-28 08:51:31,895][106226] Updated weights for policy 0, policy_version 1891690 (0.0007) [2023-12-28 08:51:31,944][106226] Updated weights for policy 0, policy_version 1891700 (0.0008) [2023-12-28 08:51:32,002][106226] Updated weights for policy 0, policy_version 1891710 (0.0008) [2023-12-28 08:51:32,065][106226] Updated weights for policy 0, policy_version 1891720 (0.0008) [2023-12-28 08:51:32,396][106225] Updated weights for policy 1, policy_version 1895818 (0.0011) [2023-12-28 08:51:32,457][106225] Updated weights for policy 1, policy_version 1895828 (0.0005) [2023-12-28 08:51:32,520][106225] Updated weights for policy 1, policy_version 1895838 (0.0007) [2023-12-28 08:51:32,817][106226] Updated weights for policy 0, policy_version 1891730 (0.0009) [2023-12-28 08:51:32,885][106226] Updated weights for policy 0, policy_version 1891740 (0.0008) [2023-12-28 08:51:32,931][106226] Updated weights for policy 0, policy_version 1891750 (0.0009) [2023-12-28 08:51:33,187][106225] Updated weights for policy 1, policy_version 1895848 (0.0007) [2023-12-28 08:51:33,243][106225] Updated weights for policy 1, policy_version 1895858 (0.0009) [2023-12-28 08:51:33,310][106225] Updated weights for policy 1, policy_version 1895868 (0.0007) [2023-12-28 08:51:33,645][106226] Updated weights for policy 0, policy_version 1891760 (0.0007) [2023-12-28 08:51:33,708][106226] Updated weights for policy 0, policy_version 1891770 (0.0008) [2023-12-28 08:51:33,773][106226] Updated weights for policy 0, policy_version 1891780 (0.0008) [2023-12-28 08:51:33,940][106225] Updated weights for policy 1, policy_version 1895878 (0.0006) [2023-12-28 08:51:34,001][106225] Updated weights for policy 1, policy_version 1895888 (0.0008) [2023-12-28 08:51:34,054][106225] Updated weights for policy 1, policy_version 1895898 (0.0007) [2023-12-28 08:51:34,562][106226] Updated weights for policy 0, policy_version 1891790 (0.0008) [2023-12-28 08:51:34,623][106226] Updated weights for policy 0, policy_version 1891800 (0.0008) [2023-12-28 08:51:34,683][106225] Updated weights for policy 1, policy_version 1895908 (0.0006) [2023-12-28 08:51:34,687][106226] Updated weights for policy 0, policy_version 1891810 (0.0008) [2023-12-28 08:51:34,741][106225] Updated weights for policy 1, policy_version 1895918 (0.0010) [2023-12-28 08:51:34,794][106225] Updated weights for policy 1, policy_version 1895928 (0.0010) [2023-12-28 08:51:35,315][106226] Updated weights for policy 0, policy_version 1891820 (0.0005) [2023-12-28 08:51:35,373][106226] Updated weights for policy 0, policy_version 1891830 (0.0005) [2023-12-28 08:51:35,429][106226] Updated weights for policy 0, policy_version 1891840 (0.0005) [2023-12-28 08:51:35,485][106225] Updated weights for policy 1, policy_version 1895938 (0.0010) [2023-12-28 08:51:35,548][106225] Updated weights for policy 1, policy_version 1895948 (0.0006) [2023-12-28 08:51:35,603][106225] Updated weights for policy 1, policy_version 1895958 (0.0009) [2023-12-28 08:51:35,653][106225] Updated weights for policy 1, policy_version 1895968 (0.0008) [2023-12-28 08:51:36,014][106226] Updated weights for policy 0, policy_version 1891850 (0.0006) [2023-12-28 08:51:36,077][106226] Updated weights for policy 0, policy_version 1891860 (0.0005) [2023-12-28 08:51:36,140][106226] Updated weights for policy 0, policy_version 1891870 (0.0007) [2023-12-28 08:51:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 969818112. Throughput: 0: 9968.4, 1: 9848.3. Samples: 969832864. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:36,175][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.794')] [2023-12-28 08:51:36,211][106226] Updated weights for policy 0, policy_version 1891880 (0.0009) [2023-12-28 08:51:36,319][106225] Updated weights for policy 1, policy_version 1895978 (0.0009) [2023-12-28 08:51:36,380][106225] Updated weights for policy 1, policy_version 1895988 (0.0009) [2023-12-28 08:51:36,442][106225] Updated weights for policy 1, policy_version 1895998 (0.0008) [2023-12-28 08:51:36,904][106226] Updated weights for policy 0, policy_version 1891890 (0.0008) [2023-12-28 08:51:36,968][106226] Updated weights for policy 0, policy_version 1891900 (0.0007) [2023-12-28 08:51:37,034][106226] Updated weights for policy 0, policy_version 1891910 (0.0009) [2023-12-28 08:51:37,130][106225] Updated weights for policy 1, policy_version 1896008 (0.0006) [2023-12-28 08:51:37,191][106225] Updated weights for policy 1, policy_version 1896018 (0.0005) [2023-12-28 08:51:37,249][106225] Updated weights for policy 1, policy_version 1896028 (0.0005) [2023-12-28 08:51:37,791][106225] Updated weights for policy 1, policy_version 1896038 (0.0006) [2023-12-28 08:51:37,808][106226] Updated weights for policy 0, policy_version 1891920 (0.0008) [2023-12-28 08:51:37,847][106225] Updated weights for policy 1, policy_version 1896048 (0.0006) [2023-12-28 08:51:37,858][106226] Updated weights for policy 0, policy_version 1891930 (0.0007) [2023-12-28 08:51:37,898][106225] Updated weights for policy 1, policy_version 1896058 (0.0006) [2023-12-28 08:51:37,906][106226] Updated weights for policy 0, policy_version 1891940 (0.0008) [2023-12-28 08:51:38,543][106225] Updated weights for policy 1, policy_version 1896068 (0.0006) [2023-12-28 08:51:38,600][106225] Updated weights for policy 1, policy_version 1896078 (0.0008) [2023-12-28 08:51:38,659][106225] Updated weights for policy 1, policy_version 1896088 (0.0008) [2023-12-28 08:51:38,715][106226] Updated weights for policy 0, policy_version 1891950 (0.0008) [2023-12-28 08:51:38,768][106226] Updated weights for policy 0, policy_version 1891960 (0.0009) [2023-12-28 08:51:38,826][106226] Updated weights for policy 0, policy_version 1891970 (0.0009) [2023-12-28 08:51:39,414][106225] Updated weights for policy 1, policy_version 1896098 (0.0008) [2023-12-28 08:51:39,477][106225] Updated weights for policy 1, policy_version 1896108 (0.0007) [2023-12-28 08:51:39,539][106225] Updated weights for policy 1, policy_version 1896118 (0.0005) [2023-12-28 08:51:39,607][106225] Updated weights for policy 1, policy_version 1896128 (0.0006) [2023-12-28 08:51:39,645][106226] Updated weights for policy 0, policy_version 1891980 (0.0009) [2023-12-28 08:51:39,702][106226] Updated weights for policy 0, policy_version 1891990 (0.0009) [2023-12-28 08:51:39,760][106226] Updated weights for policy 0, policy_version 1892000 (0.0009) [2023-12-28 08:51:40,304][106225] Updated weights for policy 1, policy_version 1896138 (0.0008) [2023-12-28 08:51:40,372][106225] Updated weights for policy 1, policy_version 1896148 (0.0008) [2023-12-28 08:51:40,436][106225] Updated weights for policy 1, policy_version 1896158 (0.0008) [2023-12-28 08:51:40,536][106226] Updated weights for policy 0, policy_version 1892010 (0.0009) [2023-12-28 08:51:40,592][106226] Updated weights for policy 0, policy_version 1892020 (0.0008) [2023-12-28 08:51:40,653][106226] Updated weights for policy 0, policy_version 1892030 (0.0010) [2023-12-28 08:51:40,719][106226] Updated weights for policy 0, policy_version 1892040 (0.0008) [2023-12-28 08:51:41,101][106225] Updated weights for policy 1, policy_version 1896168 (0.0007) [2023-12-28 08:51:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.7, 300 sec: 19744.1). Total num frames: 969916416. Throughput: 0: 9932.2, 1: 9939.7. Samples: 969892216. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:41,175][105115] Avg episode reward: [(0, '-4.136'), (1, '-4.701')] [2023-12-28 08:51:41,177][106225] Updated weights for policy 1, policy_version 1896178 (0.0008) [2023-12-28 08:51:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001892040_484442112.pth... [2023-12-28 08:51:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001890888_484147200.pth [2023-12-28 08:51:41,248][106225] Updated weights for policy 1, policy_version 1896188 (0.0007) [2023-12-28 08:51:41,273][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001896192_485482496.pth... [2023-12-28 08:51:41,278][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001895008_485179392.pth [2023-12-28 08:51:41,569][106226] Updated weights for policy 0, policy_version 1892050 (0.0009) [2023-12-28 08:51:41,643][106226] Updated weights for policy 0, policy_version 1892060 (0.0008) [2023-12-28 08:51:41,713][106226] Updated weights for policy 0, policy_version 1892070 (0.0009) [2023-12-28 08:51:42,026][106225] Updated weights for policy 1, policy_version 1896198 (0.0008) [2023-12-28 08:51:42,083][106225] Updated weights for policy 1, policy_version 1896208 (0.0008) [2023-12-28 08:51:42,139][106225] Updated weights for policy 1, policy_version 1896218 (0.0008) [2023-12-28 08:51:42,406][106226] Updated weights for policy 0, policy_version 1892080 (0.0009) [2023-12-28 08:51:42,468][106226] Updated weights for policy 0, policy_version 1892090 (0.0009) [2023-12-28 08:51:42,528][106226] Updated weights for policy 0, policy_version 1892100 (0.0009) [2023-12-28 08:51:42,877][106225] Updated weights for policy 1, policy_version 1896228 (0.0009) [2023-12-28 08:51:42,938][106225] Updated weights for policy 1, policy_version 1896238 (0.0008) [2023-12-28 08:51:42,991][106225] Updated weights for policy 1, policy_version 1896248 (0.0008) [2023-12-28 08:51:43,304][106226] Updated weights for policy 0, policy_version 1892110 (0.0009) [2023-12-28 08:51:43,351][106226] Updated weights for policy 0, policy_version 1892120 (0.0008) [2023-12-28 08:51:43,399][106226] Updated weights for policy 0, policy_version 1892130 (0.0008) [2023-12-28 08:51:43,656][106225] Updated weights for policy 1, policy_version 1896258 (0.0008) [2023-12-28 08:51:43,712][106225] Updated weights for policy 1, policy_version 1896268 (0.0008) [2023-12-28 08:51:43,759][106225] Updated weights for policy 1, policy_version 1896278 (0.0008) [2023-12-28 08:51:43,815][106225] Updated weights for policy 1, policy_version 1896288 (0.0008) [2023-12-28 08:51:44,076][106226] Updated weights for policy 0, policy_version 1892140 (0.0006) [2023-12-28 08:51:44,130][106226] Updated weights for policy 0, policy_version 1892150 (0.0009) [2023-12-28 08:51:44,178][106226] Updated weights for policy 0, policy_version 1892160 (0.0008) [2023-12-28 08:51:44,606][106225] Updated weights for policy 1, policy_version 1896298 (0.0009) [2023-12-28 08:51:44,666][106225] Updated weights for policy 1, policy_version 1896308 (0.0008) [2023-12-28 08:51:44,728][106225] Updated weights for policy 1, policy_version 1896318 (0.0007) [2023-12-28 08:51:44,746][106226] Updated weights for policy 0, policy_version 1892170 (0.0009) [2023-12-28 08:51:44,811][106226] Updated weights for policy 0, policy_version 1892180 (0.0008) [2023-12-28 08:51:44,873][106226] Updated weights for policy 0, policy_version 1892190 (0.0008) [2023-12-28 08:51:44,938][106226] Updated weights for policy 0, policy_version 1892200 (0.0009) [2023-12-28 08:51:45,547][106225] Updated weights for policy 1, policy_version 1896328 (0.0009) [2023-12-28 08:51:45,604][106225] Updated weights for policy 1, policy_version 1896338 (0.0008) [2023-12-28 08:51:45,608][106226] Updated weights for policy 0, policy_version 1892210 (0.0005) [2023-12-28 08:51:45,657][106226] Updated weights for policy 0, policy_version 1892220 (0.0005) [2023-12-28 08:51:45,663][106225] Updated weights for policy 1, policy_version 1896348 (0.0008) [2023-12-28 08:51:45,712][106226] Updated weights for policy 0, policy_version 1892230 (0.0005) [2023-12-28 08:51:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 970014720. Throughput: 0: 9849.7, 1: 9951.6. Samples: 970005976. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:46,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.849')] [2023-12-28 08:51:46,370][106225] Updated weights for policy 1, policy_version 1896358 (0.0008) [2023-12-28 08:51:46,403][106226] Updated weights for policy 0, policy_version 1892240 (0.0009) [2023-12-28 08:51:46,428][106225] Updated weights for policy 1, policy_version 1896368 (0.0005) [2023-12-28 08:51:46,454][106226] Updated weights for policy 0, policy_version 1892250 (0.0010) [2023-12-28 08:51:46,479][106225] Updated weights for policy 1, policy_version 1896378 (0.0005) [2023-12-28 08:51:46,508][106226] Updated weights for policy 0, policy_version 1892260 (0.0010) [2023-12-28 08:51:47,184][106226] Updated weights for policy 0, policy_version 1892270 (0.0010) [2023-12-28 08:51:47,224][106225] Updated weights for policy 1, policy_version 1896388 (0.0007) [2023-12-28 08:51:47,234][106226] Updated weights for policy 0, policy_version 1892280 (0.0008) [2023-12-28 08:51:47,271][106225] Updated weights for policy 1, policy_version 1896398 (0.0005) [2023-12-28 08:51:47,281][106226] Updated weights for policy 0, policy_version 1892290 (0.0008) [2023-12-28 08:51:47,332][106225] Updated weights for policy 1, policy_version 1896408 (0.0007) [2023-12-28 08:51:47,969][106225] Updated weights for policy 1, policy_version 1896418 (0.0008) [2023-12-28 08:51:48,029][106226] Updated weights for policy 0, policy_version 1892300 (0.0009) [2023-12-28 08:51:48,034][106225] Updated weights for policy 1, policy_version 1896428 (0.0007) [2023-12-28 08:51:48,076][106226] Updated weights for policy 0, policy_version 1892310 (0.0006) [2023-12-28 08:51:48,082][106225] Updated weights for policy 1, policy_version 1896438 (0.0007) [2023-12-28 08:51:48,125][106226] Updated weights for policy 0, policy_version 1892320 (0.0007) [2023-12-28 08:51:48,144][106225] Updated weights for policy 1, policy_version 1896448 (0.0006) [2023-12-28 08:51:48,705][106225] Updated weights for policy 1, policy_version 1896458 (0.0006) [2023-12-28 08:51:48,767][106225] Updated weights for policy 1, policy_version 1896468 (0.0007) [2023-12-28 08:51:48,822][106225] Updated weights for policy 1, policy_version 1896478 (0.0009) [2023-12-28 08:51:48,966][106226] Updated weights for policy 0, policy_version 1892330 (0.0008) [2023-12-28 08:51:49,025][106226] Updated weights for policy 0, policy_version 1892340 (0.0009) [2023-12-28 08:51:49,086][106226] Updated weights for policy 0, policy_version 1892350 (0.0007) [2023-12-28 08:51:49,148][106226] Updated weights for policy 0, policy_version 1892360 (0.0009) [2023-12-28 08:51:49,450][106225] Updated weights for policy 1, policy_version 1896488 (0.0007) [2023-12-28 08:51:49,512][106225] Updated weights for policy 1, policy_version 1896498 (0.0010) [2023-12-28 08:51:49,576][106225] Updated weights for policy 1, policy_version 1896508 (0.0010) [2023-12-28 08:51:49,918][106226] Updated weights for policy 0, policy_version 1892370 (0.0008) [2023-12-28 08:51:49,987][106226] Updated weights for policy 0, policy_version 1892380 (0.0009) [2023-12-28 08:51:50,045][106226] Updated weights for policy 0, policy_version 1892390 (0.0008) [2023-12-28 08:51:50,339][106225] Updated weights for policy 1, policy_version 1896518 (0.0010) [2023-12-28 08:51:50,400][106225] Updated weights for policy 1, policy_version 1896528 (0.0011) [2023-12-28 08:51:50,457][106225] Updated weights for policy 1, policy_version 1896538 (0.0010) [2023-12-28 08:51:50,758][106226] Updated weights for policy 0, policy_version 1892400 (0.0008) [2023-12-28 08:51:50,816][106226] Updated weights for policy 0, policy_version 1892410 (0.0008) [2023-12-28 08:51:50,875][106226] Updated weights for policy 0, policy_version 1892420 (0.0007) [2023-12-28 08:51:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 970113024. Throughput: 0: 9842.8, 1: 9960.9. Samples: 970124188. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:51,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.527')] [2023-12-28 08:51:51,196][106225] Updated weights for policy 1, policy_version 1896548 (0.0010) [2023-12-28 08:51:51,255][106225] Updated weights for policy 1, policy_version 1896558 (0.0012) [2023-12-28 08:51:51,321][106225] Updated weights for policy 1, policy_version 1896568 (0.0009) [2023-12-28 08:51:51,594][106226] Updated weights for policy 0, policy_version 1892430 (0.0009) [2023-12-28 08:51:51,666][106226] Updated weights for policy 0, policy_version 1892440 (0.0008) [2023-12-28 08:51:51,734][106226] Updated weights for policy 0, policy_version 1892450 (0.0008) [2023-12-28 08:51:52,129][106225] Updated weights for policy 1, policy_version 1896578 (0.0010) [2023-12-28 08:51:52,185][106225] Updated weights for policy 1, policy_version 1896588 (0.0008) [2023-12-28 08:51:52,238][106225] Updated weights for policy 1, policy_version 1896598 (0.0010) [2023-12-28 08:51:52,294][106225] Updated weights for policy 1, policy_version 1896608 (0.0011) [2023-12-28 08:51:52,497][106226] Updated weights for policy 0, policy_version 1892460 (0.0008) [2023-12-28 08:51:52,558][106226] Updated weights for policy 0, policy_version 1892470 (0.0008) [2023-12-28 08:51:52,620][106226] Updated weights for policy 0, policy_version 1892480 (0.0008) [2023-12-28 08:51:53,048][106225] Updated weights for policy 1, policy_version 1896618 (0.0010) [2023-12-28 08:51:53,107][106225] Updated weights for policy 1, policy_version 1896628 (0.0010) [2023-12-28 08:51:53,169][106225] Updated weights for policy 1, policy_version 1896638 (0.0010) [2023-12-28 08:51:53,344][106226] Updated weights for policy 0, policy_version 1892490 (0.0008) [2023-12-28 08:51:53,392][106226] Updated weights for policy 0, policy_version 1892500 (0.0009) [2023-12-28 08:51:53,439][106226] Updated weights for policy 0, policy_version 1892510 (0.0008) [2023-12-28 08:51:53,484][106226] Updated weights for policy 0, policy_version 1892520 (0.0009) [2023-12-28 08:51:53,844][106225] Updated weights for policy 1, policy_version 1896648 (0.0008) [2023-12-28 08:51:53,896][106225] Updated weights for policy 1, policy_version 1896658 (0.0008) [2023-12-28 08:51:53,945][106225] Updated weights for policy 1, policy_version 1896668 (0.0008) [2023-12-28 08:51:54,194][106226] Updated weights for policy 0, policy_version 1892530 (0.0009) [2023-12-28 08:51:54,249][106226] Updated weights for policy 0, policy_version 1892540 (0.0008) [2023-12-28 08:51:54,298][106226] Updated weights for policy 0, policy_version 1892550 (0.0008) [2023-12-28 08:51:54,673][106225] Updated weights for policy 1, policy_version 1896678 (0.0007) [2023-12-28 08:51:54,746][106225] Updated weights for policy 1, policy_version 1896688 (0.0005) [2023-12-28 08:51:54,805][106225] Updated weights for policy 1, policy_version 1896698 (0.0005) [2023-12-28 08:51:55,000][106226] Updated weights for policy 0, policy_version 1892560 (0.0006) [2023-12-28 08:51:55,062][106226] Updated weights for policy 0, policy_version 1892570 (0.0008) [2023-12-28 08:51:55,120][106226] Updated weights for policy 0, policy_version 1892580 (0.0008) [2023-12-28 08:51:55,446][106225] Updated weights for policy 1, policy_version 1896708 (0.0007) [2023-12-28 08:51:55,504][106225] Updated weights for policy 1, policy_version 1896718 (0.0007) [2023-12-28 08:51:55,554][106225] Updated weights for policy 1, policy_version 1896728 (0.0008) [2023-12-28 08:51:55,723][106226] Updated weights for policy 0, policy_version 1892590 (0.0009) [2023-12-28 08:51:55,774][106226] Updated weights for policy 0, policy_version 1892600 (0.0010) [2023-12-28 08:51:55,838][106226] Updated weights for policy 0, policy_version 1892610 (0.0011) [2023-12-28 08:51:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 970211328. Throughput: 0: 9823.0, 1: 9909.5. Samples: 970181304. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:51:56,175][105115] Avg episode reward: [(0, '-4.097'), (1, '-4.600')] [2023-12-28 08:51:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001892616_484589568.pth... [2023-12-28 08:51:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001891464_484294656.pth [2023-12-28 08:51:56,196][106225] Updated weights for policy 1, policy_version 1896738 (0.0009) [2023-12-28 08:51:56,260][106225] Updated weights for policy 1, policy_version 1896748 (0.0008) [2023-12-28 08:51:56,321][106225] Updated weights for policy 1, policy_version 1896758 (0.0008) [2023-12-28 08:51:56,382][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001896768_485629952.pth... [2023-12-28 08:51:56,383][106225] Updated weights for policy 1, policy_version 1896768 (0.0005) [2023-12-28 08:51:56,386][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001895584_485326848.pth [2023-12-28 08:51:56,556][106226] Updated weights for policy 0, policy_version 1892620 (0.0010) [2023-12-28 08:51:56,606][106226] Updated weights for policy 0, policy_version 1892630 (0.0005) [2023-12-28 08:51:56,661][106226] Updated weights for policy 0, policy_version 1892640 (0.0005) [2023-12-28 08:51:57,083][106225] Updated weights for policy 1, policy_version 1896778 (0.0009) [2023-12-28 08:51:57,136][106225] Updated weights for policy 1, policy_version 1896788 (0.0008) [2023-12-28 08:51:57,189][106225] Updated weights for policy 1, policy_version 1896798 (0.0009) [2023-12-28 08:51:57,242][106226] Updated weights for policy 0, policy_version 1892650 (0.0007) [2023-12-28 08:51:57,293][106226] Updated weights for policy 0, policy_version 1892660 (0.0008) [2023-12-28 08:51:57,342][106226] Updated weights for policy 0, policy_version 1892670 (0.0007) [2023-12-28 08:51:57,396][106226] Updated weights for policy 0, policy_version 1892680 (0.0005) [2023-12-28 08:51:57,795][106225] Updated weights for policy 1, policy_version 1896808 (0.0008) [2023-12-28 08:51:57,862][106225] Updated weights for policy 1, policy_version 1896818 (0.0010) [2023-12-28 08:51:57,919][106225] Updated weights for policy 1, policy_version 1896828 (0.0010) [2023-12-28 08:51:58,024][106226] Updated weights for policy 0, policy_version 1892690 (0.0007) [2023-12-28 08:51:58,088][106226] Updated weights for policy 0, policy_version 1892700 (0.0007) [2023-12-28 08:51:58,151][106226] Updated weights for policy 0, policy_version 1892710 (0.0008) [2023-12-28 08:51:58,638][106225] Updated weights for policy 1, policy_version 1896839 (0.0009) [2023-12-28 08:51:58,708][106225] Updated weights for policy 1, policy_version 1896849 (0.0009) [2023-12-28 08:51:58,773][106225] Updated weights for policy 1, policy_version 1896859 (0.0008) [2023-12-28 08:51:58,913][106226] Updated weights for policy 0, policy_version 1892720 (0.0007) [2023-12-28 08:51:58,977][106226] Updated weights for policy 0, policy_version 1892730 (0.0006) [2023-12-28 08:51:59,038][106226] Updated weights for policy 0, policy_version 1892740 (0.0009) [2023-12-28 08:51:59,629][106225] Updated weights for policy 1, policy_version 1896869 (0.0009) [2023-12-28 08:51:59,685][106225] Updated weights for policy 1, policy_version 1896879 (0.0007) [2023-12-28 08:51:59,738][106225] Updated weights for policy 1, policy_version 1896889 (0.0008) [2023-12-28 08:51:59,744][106226] Updated weights for policy 0, policy_version 1892750 (0.0008) [2023-12-28 08:51:59,807][106226] Updated weights for policy 0, policy_version 1892760 (0.0008) [2023-12-28 08:51:59,873][106226] Updated weights for policy 0, policy_version 1892770 (0.0008) [2023-12-28 08:52:00,468][106226] Updated weights for policy 0, policy_version 1892780 (0.0007) [2023-12-28 08:52:00,525][106226] Updated weights for policy 0, policy_version 1892790 (0.0005) [2023-12-28 08:52:00,570][106225] Updated weights for policy 1, policy_version 1896899 (0.0006) [2023-12-28 08:52:00,580][106226] Updated weights for policy 0, policy_version 1892800 (0.0007) [2023-12-28 08:52:00,621][106225] Updated weights for policy 1, policy_version 1896909 (0.0007) [2023-12-28 08:52:00,674][106225] Updated weights for policy 1, policy_version 1896919 (0.0008) [2023-12-28 08:52:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 970309632. Throughput: 0: 9918.6, 1: 9933.9. Samples: 970301492. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:01,175][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.598')] [2023-12-28 08:52:01,240][106226] Updated weights for policy 0, policy_version 1892810 (0.0006) [2023-12-28 08:52:01,302][106226] Updated weights for policy 0, policy_version 1892820 (0.0008) [2023-12-28 08:52:01,363][106226] Updated weights for policy 0, policy_version 1892830 (0.0008) [2023-12-28 08:52:01,379][106225] Updated weights for policy 1, policy_version 1896929 (0.0008) [2023-12-28 08:52:01,432][106226] Updated weights for policy 0, policy_version 1892840 (0.0008) [2023-12-28 08:52:01,444][106225] Updated weights for policy 1, policy_version 1896939 (0.0007) [2023-12-28 08:52:01,500][106225] Updated weights for policy 1, policy_version 1896949 (0.0007) [2023-12-28 08:52:01,546][106225] Updated weights for policy 1, policy_version 1896959 (0.0008) [2023-12-28 08:52:02,132][106226] Updated weights for policy 0, policy_version 1892850 (0.0009) [2023-12-28 08:52:02,185][106226] Updated weights for policy 0, policy_version 1892860 (0.0007) [2023-12-28 08:52:02,208][106225] Updated weights for policy 1, policy_version 1896969 (0.0008) [2023-12-28 08:52:02,245][106226] Updated weights for policy 0, policy_version 1892870 (0.0007) [2023-12-28 08:52:02,270][106225] Updated weights for policy 1, policy_version 1896979 (0.0008) [2023-12-28 08:52:02,326][106225] Updated weights for policy 1, policy_version 1896989 (0.0006) [2023-12-28 08:52:02,945][106225] Updated weights for policy 1, policy_version 1896999 (0.0008) [2023-12-28 08:52:02,963][106226] Updated weights for policy 0, policy_version 1892880 (0.0006) [2023-12-28 08:52:03,003][106225] Updated weights for policy 1, policy_version 1897009 (0.0007) [2023-12-28 08:52:03,021][106226] Updated weights for policy 0, policy_version 1892890 (0.0007) [2023-12-28 08:52:03,062][106225] Updated weights for policy 1, policy_version 1897019 (0.0008) [2023-12-28 08:52:03,084][106226] Updated weights for policy 0, policy_version 1892900 (0.0006) [2023-12-28 08:52:03,790][106226] Updated weights for policy 0, policy_version 1892910 (0.0006) [2023-12-28 08:52:03,791][106225] Updated weights for policy 1, policy_version 1897029 (0.0007) [2023-12-28 08:52:03,845][106225] Updated weights for policy 1, policy_version 1897039 (0.0007) [2023-12-28 08:52:03,851][106226] Updated weights for policy 0, policy_version 1892920 (0.0007) [2023-12-28 08:52:03,911][106225] Updated weights for policy 1, policy_version 1897049 (0.0009) [2023-12-28 08:52:03,918][106226] Updated weights for policy 0, policy_version 1892930 (0.0007) [2023-12-28 08:52:04,609][106226] Updated weights for policy 0, policy_version 1892940 (0.0007) [2023-12-28 08:52:04,652][106225] Updated weights for policy 1, policy_version 1897059 (0.0008) [2023-12-28 08:52:04,662][106226] Updated weights for policy 0, policy_version 1892950 (0.0007) [2023-12-28 08:52:04,707][106226] Updated weights for policy 0, policy_version 1892960 (0.0007) [2023-12-28 08:52:04,717][106225] Updated weights for policy 1, policy_version 1897069 (0.0008) [2023-12-28 08:52:04,778][106225] Updated weights for policy 1, policy_version 1897079 (0.0008) [2023-12-28 08:52:05,422][106226] Updated weights for policy 0, policy_version 1892970 (0.0007) [2023-12-28 08:52:05,483][106226] Updated weights for policy 0, policy_version 1892980 (0.0008) [2023-12-28 08:52:05,502][106225] Updated weights for policy 1, policy_version 1897089 (0.0009) [2023-12-28 08:52:05,542][106226] Updated weights for policy 0, policy_version 1892990 (0.0008) [2023-12-28 08:52:05,559][106225] Updated weights for policy 1, policy_version 1897099 (0.0006) [2023-12-28 08:52:05,599][106226] Updated weights for policy 0, policy_version 1893000 (0.0006) [2023-12-28 08:52:05,615][106225] Updated weights for policy 1, policy_version 1897109 (0.0007) [2023-12-28 08:52:05,677][106225] Updated weights for policy 1, policy_version 1897119 (0.0008) [2023-12-28 08:52:06,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 970407936. Throughput: 0: 9929.0, 1: 9927.1. Samples: 970420308. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:06,175][105115] Avg episode reward: [(0, '-4.013'), (1, '-4.701')] [2023-12-28 08:52:06,319][106226] Updated weights for policy 0, policy_version 1893010 (0.0009) [2023-12-28 08:52:06,374][106226] Updated weights for policy 0, policy_version 1893020 (0.0008) [2023-12-28 08:52:06,413][106225] Updated weights for policy 1, policy_version 1897129 (0.0009) [2023-12-28 08:52:06,432][106226] Updated weights for policy 0, policy_version 1893030 (0.0006) [2023-12-28 08:52:06,473][106225] Updated weights for policy 1, policy_version 1897139 (0.0008) [2023-12-28 08:52:06,526][106225] Updated weights for policy 1, policy_version 1897149 (0.0008) [2023-12-28 08:52:07,195][106226] Updated weights for policy 0, policy_version 1893040 (0.0008) [2023-12-28 08:52:07,244][106225] Updated weights for policy 1, policy_version 1897159 (0.0008) [2023-12-28 08:52:07,262][106226] Updated weights for policy 0, policy_version 1893050 (0.0007) [2023-12-28 08:52:07,305][106225] Updated weights for policy 1, policy_version 1897169 (0.0008) [2023-12-28 08:52:07,329][106226] Updated weights for policy 0, policy_version 1893060 (0.0006) [2023-12-28 08:52:07,367][106225] Updated weights for policy 1, policy_version 1897179 (0.0008) [2023-12-28 08:52:07,959][106226] Updated weights for policy 0, policy_version 1893070 (0.0006) [2023-12-28 08:52:08,016][106226] Updated weights for policy 0, policy_version 1893080 (0.0005) [2023-12-28 08:52:08,076][106226] Updated weights for policy 0, policy_version 1893090 (0.0008) [2023-12-28 08:52:08,125][106225] Updated weights for policy 1, policy_version 1897189 (0.0007) [2023-12-28 08:52:08,183][106225] Updated weights for policy 1, policy_version 1897199 (0.0008) [2023-12-28 08:52:08,248][106225] Updated weights for policy 1, policy_version 1897209 (0.0009) [2023-12-28 08:52:08,790][106226] Updated weights for policy 0, policy_version 1893100 (0.0008) [2023-12-28 08:52:08,848][106226] Updated weights for policy 0, policy_version 1893110 (0.0009) [2023-12-28 08:52:08,908][106226] Updated weights for policy 0, policy_version 1893120 (0.0009) [2023-12-28 08:52:09,014][106225] Updated weights for policy 1, policy_version 1897219 (0.0008) [2023-12-28 08:52:09,075][106225] Updated weights for policy 1, policy_version 1897229 (0.0009) [2023-12-28 08:52:09,139][106225] Updated weights for policy 1, policy_version 1897239 (0.0008) [2023-12-28 08:52:09,677][106226] Updated weights for policy 0, policy_version 1893130 (0.0008) [2023-12-28 08:52:09,739][106226] Updated weights for policy 0, policy_version 1893140 (0.0008) [2023-12-28 08:52:09,793][106226] Updated weights for policy 0, policy_version 1893150 (0.0008) [2023-12-28 08:52:09,859][106226] Updated weights for policy 0, policy_version 1893160 (0.0008) [2023-12-28 08:52:09,886][106225] Updated weights for policy 1, policy_version 1897249 (0.0008) [2023-12-28 08:52:09,955][106225] Updated weights for policy 1, policy_version 1897259 (0.0007) [2023-12-28 08:52:10,019][106225] Updated weights for policy 1, policy_version 1897269 (0.0006) [2023-12-28 08:52:10,084][106225] Updated weights for policy 1, policy_version 1897279 (0.0007) [2023-12-28 08:52:10,628][106226] Updated weights for policy 0, policy_version 1893170 (0.0005) [2023-12-28 08:52:10,695][106226] Updated weights for policy 0, policy_version 1893180 (0.0005) [2023-12-28 08:52:10,718][106225] Updated weights for policy 1, policy_version 1897289 (0.0006) [2023-12-28 08:52:10,753][106226] Updated weights for policy 0, policy_version 1893190 (0.0008) [2023-12-28 08:52:10,774][106225] Updated weights for policy 1, policy_version 1897299 (0.0006) [2023-12-28 08:52:10,834][106225] Updated weights for policy 1, policy_version 1897309 (0.0008) [2023-12-28 08:52:11,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 970506240. Throughput: 0: 9924.1, 1: 9916.0. Samples: 970477732. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:11,175][105115] Avg episode reward: [(0, '-4.252'), (1, '-4.603')] [2023-12-28 08:52:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001897312_485769216.pth... [2023-12-28 08:52:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001893192_484737024.pth... [2023-12-28 08:52:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001896192_485482496.pth [2023-12-28 08:52:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001892040_484442112.pth [2023-12-28 08:52:11,389][106226] Updated weights for policy 0, policy_version 1893200 (0.0009) [2023-12-28 08:52:11,454][106226] Updated weights for policy 0, policy_version 1893210 (0.0009) [2023-12-28 08:52:11,515][106226] Updated weights for policy 0, policy_version 1893220 (0.0009) [2023-12-28 08:52:11,607][106225] Updated weights for policy 1, policy_version 1897319 (0.0007) [2023-12-28 08:52:11,676][106225] Updated weights for policy 1, policy_version 1897329 (0.0007) [2023-12-28 08:52:11,748][106225] Updated weights for policy 1, policy_version 1897339 (0.0008) [2023-12-28 08:52:12,298][106226] Updated weights for policy 0, policy_version 1893230 (0.0009) [2023-12-28 08:52:12,370][106226] Updated weights for policy 0, policy_version 1893240 (0.0008) [2023-12-28 08:52:12,405][106225] Updated weights for policy 1, policy_version 1897349 (0.0008) [2023-12-28 08:52:12,440][106226] Updated weights for policy 0, policy_version 1893250 (0.0007) [2023-12-28 08:52:12,474][106225] Updated weights for policy 1, policy_version 1897359 (0.0006) [2023-12-28 08:52:12,543][106225] Updated weights for policy 1, policy_version 1897369 (0.0009) [2023-12-28 08:52:13,116][106226] Updated weights for policy 0, policy_version 1893260 (0.0009) [2023-12-28 08:52:13,121][106225] Updated weights for policy 1, policy_version 1897379 (0.0007) [2023-12-28 08:52:13,168][106225] Updated weights for policy 1, policy_version 1897389 (0.0006) [2023-12-28 08:52:13,176][106226] Updated weights for policy 0, policy_version 1893270 (0.0010) [2023-12-28 08:52:13,220][106225] Updated weights for policy 1, policy_version 1897399 (0.0007) [2023-12-28 08:52:13,232][106226] Updated weights for policy 0, policy_version 1893280 (0.0010) [2023-12-28 08:52:13,805][106225] Updated weights for policy 1, policy_version 1897409 (0.0005) [2023-12-28 08:52:13,853][106225] Updated weights for policy 1, policy_version 1897419 (0.0005) [2023-12-28 08:52:13,903][106225] Updated weights for policy 1, policy_version 1897429 (0.0005) [2023-12-28 08:52:13,962][106226] Updated weights for policy 0, policy_version 1893290 (0.0010) [2023-12-28 08:52:13,971][106225] Updated weights for policy 1, policy_version 1897439 (0.0007) [2023-12-28 08:52:14,024][106226] Updated weights for policy 0, policy_version 1893300 (0.0005) [2023-12-28 08:52:14,075][106226] Updated weights for policy 0, policy_version 1893310 (0.0008) [2023-12-28 08:52:14,124][106226] Updated weights for policy 0, policy_version 1893320 (0.0007) [2023-12-28 08:52:14,546][106225] Updated weights for policy 1, policy_version 1897449 (0.0009) [2023-12-28 08:52:14,596][106225] Updated weights for policy 1, policy_version 1897459 (0.0008) [2023-12-28 08:52:14,645][106225] Updated weights for policy 1, policy_version 1897469 (0.0008) [2023-12-28 08:52:14,779][106226] Updated weights for policy 0, policy_version 1893330 (0.0006) [2023-12-28 08:52:14,841][106226] Updated weights for policy 0, policy_version 1893340 (0.0007) [2023-12-28 08:52:14,901][106226] Updated weights for policy 0, policy_version 1893350 (0.0008) [2023-12-28 08:52:15,472][106225] Updated weights for policy 1, policy_version 1897479 (0.0008) [2023-12-28 08:52:15,519][106226] Updated weights for policy 0, policy_version 1893360 (0.0009) [2023-12-28 08:52:15,526][106225] Updated weights for policy 1, policy_version 1897489 (0.0009) [2023-12-28 08:52:15,573][106226] Updated weights for policy 0, policy_version 1893370 (0.0008) [2023-12-28 08:52:15,581][106225] Updated weights for policy 1, policy_version 1897499 (0.0010) [2023-12-28 08:52:15,621][106226] Updated weights for policy 0, policy_version 1893380 (0.0008) [2023-12-28 08:52:16,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 970604544. Throughput: 0: 9759.9, 1: 9897.4. Samples: 970597164. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:16,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.658')] [2023-12-28 08:52:16,225][106225] Updated weights for policy 1, policy_version 1897509 (0.0008) [2023-12-28 08:52:16,287][106225] Updated weights for policy 1, policy_version 1897519 (0.0008) [2023-12-28 08:52:16,291][106226] Updated weights for policy 0, policy_version 1893390 (0.0008) [2023-12-28 08:52:16,344][106225] Updated weights for policy 1, policy_version 1897529 (0.0006) [2023-12-28 08:52:16,346][106226] Updated weights for policy 0, policy_version 1893400 (0.0007) [2023-12-28 08:52:16,427][106226] Updated weights for policy 0, policy_version 1893410 (0.0008) [2023-12-28 08:52:16,950][106225] Updated weights for policy 1, policy_version 1897539 (0.0005) [2023-12-28 08:52:17,001][106225] Updated weights for policy 1, policy_version 1897549 (0.0008) [2023-12-28 08:52:17,056][106225] Updated weights for policy 1, policy_version 1897559 (0.0009) [2023-12-28 08:52:17,156][106226] Updated weights for policy 0, policy_version 1893420 (0.0008) [2023-12-28 08:52:17,223][106226] Updated weights for policy 0, policy_version 1893430 (0.0010) [2023-12-28 08:52:17,280][106226] Updated weights for policy 0, policy_version 1893440 (0.0010) [2023-12-28 08:52:17,811][106225] Updated weights for policy 1, policy_version 1897569 (0.0008) [2023-12-28 08:52:17,869][106225] Updated weights for policy 1, policy_version 1897579 (0.0008) [2023-12-28 08:52:17,924][106225] Updated weights for policy 1, policy_version 1897589 (0.0008) [2023-12-28 08:52:17,978][106225] Updated weights for policy 1, policy_version 1897599 (0.0008) [2023-12-28 08:52:17,979][106226] Updated weights for policy 0, policy_version 1893450 (0.0010) [2023-12-28 08:52:18,041][106226] Updated weights for policy 0, policy_version 1893460 (0.0009) [2023-12-28 08:52:18,101][106226] Updated weights for policy 0, policy_version 1893470 (0.0008) [2023-12-28 08:52:18,158][106226] Updated weights for policy 0, policy_version 1893480 (0.0005) [2023-12-28 08:52:18,766][106225] Updated weights for policy 1, policy_version 1897609 (0.0008) [2023-12-28 08:52:18,829][106225] Updated weights for policy 1, policy_version 1897619 (0.0006) [2023-12-28 08:52:18,837][106226] Updated weights for policy 0, policy_version 1893490 (0.0011) [2023-12-28 08:52:18,894][106226] Updated weights for policy 0, policy_version 1893500 (0.0010) [2023-12-28 08:52:18,896][106225] Updated weights for policy 1, policy_version 1897629 (0.0005) [2023-12-28 08:52:18,952][106226] Updated weights for policy 0, policy_version 1893510 (0.0010) [2023-12-28 08:52:19,547][106225] Updated weights for policy 1, policy_version 1897639 (0.0009) [2023-12-28 08:52:19,610][106225] Updated weights for policy 1, policy_version 1897649 (0.0009) [2023-12-28 08:52:19,679][106225] Updated weights for policy 1, policy_version 1897659 (0.0011) [2023-12-28 08:52:19,734][106226] Updated weights for policy 0, policy_version 1893520 (0.0011) [2023-12-28 08:52:19,789][106226] Updated weights for policy 0, policy_version 1893530 (0.0011) [2023-12-28 08:52:19,855][106226] Updated weights for policy 0, policy_version 1893540 (0.0009) [2023-12-28 08:52:20,400][106225] Updated weights for policy 1, policy_version 1897669 (0.0010) [2023-12-28 08:52:20,459][106225] Updated weights for policy 1, policy_version 1897679 (0.0011) [2023-12-28 08:52:20,513][106225] Updated weights for policy 1, policy_version 1897689 (0.0008) [2023-12-28 08:52:20,594][106226] Updated weights for policy 0, policy_version 1893550 (0.0011) [2023-12-28 08:52:20,656][106226] Updated weights for policy 0, policy_version 1893560 (0.0010) [2023-12-28 08:52:20,714][106226] Updated weights for policy 0, policy_version 1893570 (0.0011) [2023-12-28 08:52:21,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 970702848. Throughput: 0: 9748.6, 1: 9853.5. Samples: 970714960. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:21,176][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.549')] [2023-12-28 08:52:21,288][106225] Updated weights for policy 1, policy_version 1897699 (0.0007) [2023-12-28 08:52:21,367][106225] Updated weights for policy 1, policy_version 1897709 (0.0008) [2023-12-28 08:52:21,444][106225] Updated weights for policy 1, policy_version 1897719 (0.0008) [2023-12-28 08:52:21,488][106226] Updated weights for policy 0, policy_version 1893580 (0.0010) [2023-12-28 08:52:21,558][106226] Updated weights for policy 0, policy_version 1893590 (0.0009) [2023-12-28 08:52:21,625][106226] Updated weights for policy 0, policy_version 1893600 (0.0009) [2023-12-28 08:52:22,141][106225] Updated weights for policy 1, policy_version 1897729 (0.0006) [2023-12-28 08:52:22,205][106225] Updated weights for policy 1, policy_version 1897739 (0.0007) [2023-12-28 08:52:22,276][106225] Updated weights for policy 1, policy_version 1897749 (0.0007) [2023-12-28 08:52:22,345][106225] Updated weights for policy 1, policy_version 1897759 (0.0006) [2023-12-28 08:52:22,415][106226] Updated weights for policy 0, policy_version 1893610 (0.0013) [2023-12-28 08:52:22,481][106226] Updated weights for policy 0, policy_version 1893620 (0.0008) [2023-12-28 08:52:22,535][106226] Updated weights for policy 0, policy_version 1893630 (0.0006) [2023-12-28 08:52:22,595][106226] Updated weights for policy 0, policy_version 1893640 (0.0009) [2023-12-28 08:52:23,061][106225] Updated weights for policy 1, policy_version 1897769 (0.0008) [2023-12-28 08:52:23,125][106225] Updated weights for policy 1, policy_version 1897779 (0.0009) [2023-12-28 08:52:23,193][106225] Updated weights for policy 1, policy_version 1897789 (0.0010) [2023-12-28 08:52:23,242][106226] Updated weights for policy 0, policy_version 1893650 (0.0010) [2023-12-28 08:52:23,297][106226] Updated weights for policy 0, policy_version 1893660 (0.0010) [2023-12-28 08:52:23,358][106226] Updated weights for policy 0, policy_version 1893670 (0.0011) [2023-12-28 08:52:23,926][106225] Updated weights for policy 1, policy_version 1897799 (0.0009) [2023-12-28 08:52:24,010][106225] Updated weights for policy 1, policy_version 1897809 (0.0010) [2023-12-28 08:52:24,043][106226] Updated weights for policy 0, policy_version 1893680 (0.0007) [2023-12-28 08:52:24,067][106225] Updated weights for policy 1, policy_version 1897819 (0.0010) [2023-12-28 08:52:24,089][106226] Updated weights for policy 0, policy_version 1893690 (0.0007) [2023-12-28 08:52:24,145][106226] Updated weights for policy 0, policy_version 1893700 (0.0008) [2023-12-28 08:52:24,757][106225] Updated weights for policy 1, policy_version 1897829 (0.0008) [2023-12-28 08:52:24,820][106225] Updated weights for policy 1, policy_version 1897839 (0.0008) [2023-12-28 08:52:24,881][106225] Updated weights for policy 1, policy_version 1897849 (0.0008) [2023-12-28 08:52:24,901][106226] Updated weights for policy 0, policy_version 1893710 (0.0008) [2023-12-28 08:52:24,961][106226] Updated weights for policy 0, policy_version 1893720 (0.0009) [2023-12-28 08:52:25,015][106226] Updated weights for policy 0, policy_version 1893730 (0.0009) [2023-12-28 08:52:25,427][106225] Updated weights for policy 1, policy_version 1897859 (0.0006) [2023-12-28 08:52:25,493][106225] Updated weights for policy 1, policy_version 1897869 (0.0006) [2023-12-28 08:52:25,551][106225] Updated weights for policy 1, policy_version 1897879 (0.0005) [2023-12-28 08:52:25,847][106226] Updated weights for policy 0, policy_version 1893740 (0.0009) [2023-12-28 08:52:25,898][106226] Updated weights for policy 0, policy_version 1893750 (0.0009) [2023-12-28 08:52:25,955][106226] Updated weights for policy 0, policy_version 1893760 (0.0008) [2023-12-28 08:52:26,088][106225] Updated weights for policy 1, policy_version 1897889 (0.0005) [2023-12-28 08:52:26,142][106225] Updated weights for policy 1, policy_version 1897899 (0.0010) [2023-12-28 08:52:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 970801152. Throughput: 0: 9778.0, 1: 9765.4. Samples: 970771664. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:26,175][105115] Avg episode reward: [(0, '-4.613'), (1, '-4.671')] [2023-12-28 08:52:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001893768_484884480.pth... [2023-12-28 08:52:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001892616_484589568.pth [2023-12-28 08:52:26,194][106225] Updated weights for policy 1, policy_version 1897909 (0.0010) [2023-12-28 08:52:26,248][106225] Updated weights for policy 1, policy_version 1897919 (0.0010) [2023-12-28 08:52:26,252][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001897920_485924864.pth... [2023-12-28 08:52:26,255][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001896768_485629952.pth [2023-12-28 08:52:26,728][106226] Updated weights for policy 0, policy_version 1893770 (0.0008) [2023-12-28 08:52:26,794][106226] Updated weights for policy 0, policy_version 1893780 (0.0007) [2023-12-28 08:52:26,859][106226] Updated weights for policy 0, policy_version 1893790 (0.0006) [2023-12-28 08:52:26,861][106225] Updated weights for policy 1, policy_version 1897929 (0.0008) [2023-12-28 08:52:26,913][106225] Updated weights for policy 1, policy_version 1897939 (0.0007) [2023-12-28 08:52:26,922][106226] Updated weights for policy 0, policy_version 1893800 (0.0007) [2023-12-28 08:52:26,961][106225] Updated weights for policy 1, policy_version 1897949 (0.0010) [2023-12-28 08:52:27,626][106226] Updated weights for policy 0, policy_version 1893810 (0.0008) [2023-12-28 08:52:27,692][106226] Updated weights for policy 0, policy_version 1893820 (0.0007) [2023-12-28 08:52:27,698][106225] Updated weights for policy 1, policy_version 1897959 (0.0010) [2023-12-28 08:52:27,750][106226] Updated weights for policy 0, policy_version 1893830 (0.0006) [2023-12-28 08:52:27,752][106225] Updated weights for policy 1, policy_version 1897969 (0.0010) [2023-12-28 08:52:27,808][106225] Updated weights for policy 1, policy_version 1897979 (0.0010) [2023-12-28 08:52:28,481][106225] Updated weights for policy 1, policy_version 1897989 (0.0009) [2023-12-28 08:52:28,507][106226] Updated weights for policy 0, policy_version 1893840 (0.0006) [2023-12-28 08:52:28,537][106225] Updated weights for policy 1, policy_version 1897999 (0.0008) [2023-12-28 08:52:28,556][106226] Updated weights for policy 0, policy_version 1893850 (0.0006) [2023-12-28 08:52:28,599][106225] Updated weights for policy 1, policy_version 1898009 (0.0007) [2023-12-28 08:52:28,612][106226] Updated weights for policy 0, policy_version 1893860 (0.0005) [2023-12-28 08:52:29,203][106226] Updated weights for policy 0, policy_version 1893870 (0.0007) [2023-12-28 08:52:29,273][106226] Updated weights for policy 0, policy_version 1893880 (0.0008) [2023-12-28 08:52:29,323][106226] Updated weights for policy 0, policy_version 1893890 (0.0008) [2023-12-28 08:52:29,345][106225] Updated weights for policy 1, policy_version 1898019 (0.0007) [2023-12-28 08:52:29,412][106225] Updated weights for policy 1, policy_version 1898029 (0.0008) [2023-12-28 08:52:29,482][106225] Updated weights for policy 1, policy_version 1898039 (0.0008) [2023-12-28 08:52:30,006][106226] Updated weights for policy 0, policy_version 1893900 (0.0008) [2023-12-28 08:52:30,059][106226] Updated weights for policy 0, policy_version 1893910 (0.0008) [2023-12-28 08:52:30,106][106225] Updated weights for policy 1, policy_version 1898049 (0.0007) [2023-12-28 08:52:30,113][106226] Updated weights for policy 0, policy_version 1893920 (0.0008) [2023-12-28 08:52:30,166][106225] Updated weights for policy 1, policy_version 1898059 (0.0008) [2023-12-28 08:52:30,214][106225] Updated weights for policy 1, policy_version 1898069 (0.0008) [2023-12-28 08:52:30,266][106225] Updated weights for policy 1, policy_version 1898079 (0.0008) [2023-12-28 08:52:30,866][106226] Updated weights for policy 0, policy_version 1893930 (0.0007) [2023-12-28 08:52:30,888][106225] Updated weights for policy 1, policy_version 1898089 (0.0006) [2023-12-28 08:52:30,916][106226] Updated weights for policy 0, policy_version 1893940 (0.0005) [2023-12-28 08:52:30,939][106225] Updated weights for policy 1, policy_version 1898099 (0.0005) [2023-12-28 08:52:30,970][106226] Updated weights for policy 0, policy_version 1893950 (0.0008) [2023-12-28 08:52:30,997][106225] Updated weights for policy 1, policy_version 1898109 (0.0007) [2023-12-28 08:52:31,021][106226] Updated weights for policy 0, policy_version 1893960 (0.0010) [2023-12-28 08:52:31,174][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 970907648. Throughput: 0: 9794.4, 1: 9899.7. Samples: 970892208. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:31,175][105115] Avg episode reward: [(0, '-4.306'), (1, '-4.488')] [2023-12-28 08:52:31,682][106225] Updated weights for policy 1, policy_version 1898119 (0.0008) [2023-12-28 08:52:31,744][106225] Updated weights for policy 1, policy_version 1898129 (0.0008) [2023-12-28 08:52:31,780][106226] Updated weights for policy 0, policy_version 1893970 (0.0011) [2023-12-28 08:52:31,795][106225] Updated weights for policy 1, policy_version 1898139 (0.0008) [2023-12-28 08:52:31,829][106226] Updated weights for policy 0, policy_version 1893980 (0.0011) [2023-12-28 08:52:31,879][106226] Updated weights for policy 0, policy_version 1893990 (0.0010) [2023-12-28 08:52:32,516][106225] Updated weights for policy 1, policy_version 1898149 (0.0009) [2023-12-28 08:52:32,570][106225] Updated weights for policy 1, policy_version 1898159 (0.0010) [2023-12-28 08:52:32,627][106226] Updated weights for policy 0, policy_version 1894000 (0.0008) [2023-12-28 08:52:32,635][106225] Updated weights for policy 1, policy_version 1898169 (0.0011) [2023-12-28 08:52:32,686][106226] Updated weights for policy 0, policy_version 1894010 (0.0007) [2023-12-28 08:52:32,749][106226] Updated weights for policy 0, policy_version 1894020 (0.0007) [2023-12-28 08:52:33,294][106225] Updated weights for policy 1, policy_version 1898179 (0.0009) [2023-12-28 08:52:33,359][106225] Updated weights for policy 1, policy_version 1898189 (0.0005) [2023-12-28 08:52:33,394][106226] Updated weights for policy 0, policy_version 1894030 (0.0008) [2023-12-28 08:52:33,423][106225] Updated weights for policy 1, policy_version 1898199 (0.0005) [2023-12-28 08:52:33,445][106226] Updated weights for policy 0, policy_version 1894040 (0.0007) [2023-12-28 08:52:33,508][106226] Updated weights for policy 0, policy_version 1894050 (0.0008) [2023-12-28 08:52:34,019][106225] Updated weights for policy 1, policy_version 1898209 (0.0005) [2023-12-28 08:52:34,080][106225] Updated weights for policy 1, policy_version 1898219 (0.0009) [2023-12-28 08:52:34,137][106225] Updated weights for policy 1, policy_version 1898229 (0.0010) [2023-12-28 08:52:34,158][106226] Updated weights for policy 0, policy_version 1894060 (0.0007) [2023-12-28 08:52:34,202][106225] Updated weights for policy 1, policy_version 1898239 (0.0009) [2023-12-28 08:52:34,218][106226] Updated weights for policy 0, policy_version 1894070 (0.0007) [2023-12-28 08:52:34,280][106226] Updated weights for policy 0, policy_version 1894080 (0.0010) [2023-12-28 08:52:34,892][106225] Updated weights for policy 1, policy_version 1898249 (0.0006) [2023-12-28 08:52:34,954][106225] Updated weights for policy 1, policy_version 1898259 (0.0007) [2023-12-28 08:52:34,998][106226] Updated weights for policy 0, policy_version 1894090 (0.0008) [2023-12-28 08:52:35,012][106225] Updated weights for policy 1, policy_version 1898269 (0.0010) [2023-12-28 08:52:35,050][106226] Updated weights for policy 0, policy_version 1894100 (0.0010) [2023-12-28 08:52:35,100][106226] Updated weights for policy 0, policy_version 1894110 (0.0010) [2023-12-28 08:52:35,153][106226] Updated weights for policy 0, policy_version 1894120 (0.0011) [2023-12-28 08:52:35,555][106225] Updated weights for policy 1, policy_version 1898279 (0.0008) [2023-12-28 08:52:35,612][106225] Updated weights for policy 1, policy_version 1898289 (0.0010) [2023-12-28 08:52:35,662][106225] Updated weights for policy 1, policy_version 1898299 (0.0007) [2023-12-28 08:52:35,902][106226] Updated weights for policy 0, policy_version 1894130 (0.0008) [2023-12-28 08:52:35,969][106226] Updated weights for policy 0, policy_version 1894140 (0.0011) [2023-12-28 08:52:36,035][106226] Updated weights for policy 0, policy_version 1894150 (0.0011) [2023-12-28 08:52:36,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 971005952. Throughput: 0: 9811.5, 1: 9961.4. Samples: 971013968. Policy #0 lag: (min: 36.0, avg: 47.6, max: 48.0) [2023-12-28 08:52:36,175][105115] Avg episode reward: [(0, '-4.535'), (1, '-4.595')] [2023-12-28 08:52:36,384][106225] Updated weights for policy 1, policy_version 1898309 (0.0010) [2023-12-28 08:52:36,456][106225] Updated weights for policy 1, policy_version 1898319 (0.0010) [2023-12-28 08:52:36,525][106225] Updated weights for policy 1, policy_version 1898329 (0.0007) [2023-12-28 08:52:36,713][106226] Updated weights for policy 0, policy_version 1894160 (0.0010) [2023-12-28 08:52:36,765][106226] Updated weights for policy 0, policy_version 1894170 (0.0009) [2023-12-28 08:52:36,820][106226] Updated weights for policy 0, policy_version 1894180 (0.0006) [2023-12-28 08:52:37,239][106225] Updated weights for policy 1, policy_version 1898339 (0.0008) [2023-12-28 08:52:37,299][106225] Updated weights for policy 1, policy_version 1898349 (0.0007) [2023-12-28 08:52:37,369][106225] Updated weights for policy 1, policy_version 1898359 (0.0006) [2023-12-28 08:52:37,519][106226] Updated weights for policy 0, policy_version 1894190 (0.0008) [2023-12-28 08:52:37,584][106226] Updated weights for policy 0, policy_version 1894200 (0.0009) [2023-12-28 08:52:37,647][106226] Updated weights for policy 0, policy_version 1894210 (0.0006) [2023-12-28 08:52:37,984][106225] Updated weights for policy 1, policy_version 1898369 (0.0005) [2023-12-28 08:52:38,044][106225] Updated weights for policy 1, policy_version 1898379 (0.0009) [2023-12-28 08:52:38,091][106225] Updated weights for policy 1, policy_version 1898389 (0.0008) [2023-12-28 08:52:38,143][106225] Updated weights for policy 1, policy_version 1898399 (0.0008) [2023-12-28 08:52:38,384][106226] Updated weights for policy 0, policy_version 1894220 (0.0009) [2023-12-28 08:52:38,457][106226] Updated weights for policy 0, policy_version 1894230 (0.0011) [2023-12-28 08:52:38,537][106226] Updated weights for policy 0, policy_version 1894240 (0.0011) [2023-12-28 08:52:38,796][106225] Updated weights for policy 1, policy_version 1898409 (0.0008) [2023-12-28 08:52:38,850][106225] Updated weights for policy 1, policy_version 1898419 (0.0008) [2023-12-28 08:52:38,907][106225] Updated weights for policy 1, policy_version 1898429 (0.0008) [2023-12-28 08:52:39,262][106226] Updated weights for policy 0, policy_version 1894250 (0.0011) [2023-12-28 08:52:39,323][106226] Updated weights for policy 0, policy_version 1894260 (0.0010) [2023-12-28 08:52:39,392][106226] Updated weights for policy 0, policy_version 1894270 (0.0011) [2023-12-28 08:52:39,465][106226] Updated weights for policy 0, policy_version 1894280 (0.0010) [2023-12-28 08:52:39,609][106225] Updated weights for policy 1, policy_version 1898439 (0.0008) [2023-12-28 08:52:39,666][106225] Updated weights for policy 1, policy_version 1898449 (0.0008) [2023-12-28 08:52:39,721][106225] Updated weights for policy 1, policy_version 1898459 (0.0008) [2023-12-28 08:52:40,159][106226] Updated weights for policy 0, policy_version 1894290 (0.0008) [2023-12-28 08:52:40,222][106226] Updated weights for policy 0, policy_version 1894300 (0.0007) [2023-12-28 08:52:40,278][106226] Updated weights for policy 0, policy_version 1894310 (0.0005) [2023-12-28 08:52:40,485][106225] Updated weights for policy 1, policy_version 1898469 (0.0009) [2023-12-28 08:52:40,537][106225] Updated weights for policy 1, policy_version 1898479 (0.0008) [2023-12-28 08:52:40,597][106225] Updated weights for policy 1, policy_version 1898489 (0.0008) [2023-12-28 08:52:40,914][106226] Updated weights for policy 0, policy_version 1894320 (0.0005) [2023-12-28 08:52:40,970][106226] Updated weights for policy 0, policy_version 1894330 (0.0005) [2023-12-28 08:52:41,055][106226] Updated weights for policy 0, policy_version 1894343 (0.0007) [2023-12-28 08:52:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 971104256. Throughput: 0: 9816.4, 1: 10015.3. Samples: 971073732. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:52:41,175][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.672')] [2023-12-28 08:52:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001898496_486072320.pth... [2023-12-28 08:52:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001894344_485031936.pth... [2023-12-28 08:52:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001897312_485769216.pth [2023-12-28 08:52:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001893192_484737024.pth [2023-12-28 08:52:41,432][106225] Updated weights for policy 1, policy_version 1898499 (0.0008) [2023-12-28 08:52:41,480][106225] Updated weights for policy 1, policy_version 1898509 (0.0009) [2023-12-28 08:52:41,538][106225] Updated weights for policy 1, policy_version 1898519 (0.0008) [2023-12-28 08:52:41,779][106226] Updated weights for policy 0, policy_version 1894353 (0.0008) [2023-12-28 08:52:41,841][106226] Updated weights for policy 0, policy_version 1894363 (0.0006) [2023-12-28 08:52:41,907][106226] Updated weights for policy 0, policy_version 1894373 (0.0007) [2023-12-28 08:52:42,294][106225] Updated weights for policy 1, policy_version 1898529 (0.0009) [2023-12-28 08:52:42,360][106225] Updated weights for policy 1, policy_version 1898539 (0.0008) [2023-12-28 08:52:42,426][106225] Updated weights for policy 1, policy_version 1898549 (0.0009) [2023-12-28 08:52:42,484][106225] Updated weights for policy 1, policy_version 1898559 (0.0010) [2023-12-28 08:52:42,609][106226] Updated weights for policy 0, policy_version 1894383 (0.0011) [2023-12-28 08:52:42,671][106226] Updated weights for policy 0, policy_version 1894393 (0.0009) [2023-12-28 08:52:42,729][106226] Updated weights for policy 0, policy_version 1894403 (0.0008) [2023-12-28 08:52:43,188][106225] Updated weights for policy 1, policy_version 1898569 (0.0008) [2023-12-28 08:52:43,252][106225] Updated weights for policy 1, policy_version 1898579 (0.0005) [2023-12-28 08:52:43,321][106225] Updated weights for policy 1, policy_version 1898589 (0.0006) [2023-12-28 08:52:43,390][106226] Updated weights for policy 0, policy_version 1894413 (0.0010) [2023-12-28 08:52:43,444][106226] Updated weights for policy 0, policy_version 1894423 (0.0007) [2023-12-28 08:52:43,509][106226] Updated weights for policy 0, policy_version 1894433 (0.0006) [2023-12-28 08:52:43,836][106225] Updated weights for policy 1, policy_version 1898599 (0.0008) [2023-12-28 08:52:43,896][106225] Updated weights for policy 1, policy_version 1898609 (0.0010) [2023-12-28 08:52:43,952][106225] Updated weights for policy 1, policy_version 1898619 (0.0010) [2023-12-28 08:52:44,100][106226] Updated weights for policy 0, policy_version 1894443 (0.0008) [2023-12-28 08:52:44,155][106226] Updated weights for policy 0, policy_version 1894453 (0.0008) [2023-12-28 08:52:44,211][106226] Updated weights for policy 0, policy_version 1894463 (0.0008) [2023-12-28 08:52:44,667][106225] Updated weights for policy 1, policy_version 1898629 (0.0010) [2023-12-28 08:52:44,718][106225] Updated weights for policy 1, policy_version 1898639 (0.0009) [2023-12-28 08:52:44,782][106225] Updated weights for policy 1, policy_version 1898649 (0.0007) [2023-12-28 08:52:44,958][106226] Updated weights for policy 0, policy_version 1894473 (0.0007) [2023-12-28 08:52:45,017][106226] Updated weights for policy 0, policy_version 1894483 (0.0007) [2023-12-28 08:52:45,073][106226] Updated weights for policy 0, policy_version 1894493 (0.0010) [2023-12-28 08:52:45,134][106226] Updated weights for policy 0, policy_version 1894503 (0.0009) [2023-12-28 08:52:45,479][106225] Updated weights for policy 1, policy_version 1898659 (0.0006) [2023-12-28 08:52:45,537][106225] Updated weights for policy 1, policy_version 1898669 (0.0008) [2023-12-28 08:52:45,592][106225] Updated weights for policy 1, policy_version 1898679 (0.0008) [2023-12-28 08:52:45,810][106226] Updated weights for policy 0, policy_version 1894513 (0.0007) [2023-12-28 08:52:45,872][106226] Updated weights for policy 0, policy_version 1894523 (0.0009) [2023-12-28 08:52:45,928][106226] Updated weights for policy 0, policy_version 1894533 (0.0005) [2023-12-28 08:52:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 971202560. Throughput: 0: 9776.8, 1: 9999.8. Samples: 971191440. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:52:46,176][105115] Avg episode reward: [(0, '-4.067'), (1, '-5.004')] [2023-12-28 08:52:46,365][106225] Updated weights for policy 1, policy_version 1898689 (0.0008) [2023-12-28 08:52:46,418][106225] Updated weights for policy 1, policy_version 1898699 (0.0008) [2023-12-28 08:52:46,469][106225] Updated weights for policy 1, policy_version 1898709 (0.0008) [2023-12-28 08:52:46,501][106226] Updated weights for policy 0, policy_version 1894543 (0.0007) [2023-12-28 08:52:46,522][106225] Updated weights for policy 1, policy_version 1898719 (0.0007) [2023-12-28 08:52:46,550][106226] Updated weights for policy 0, policy_version 1894553 (0.0008) [2023-12-28 08:52:46,599][106226] Updated weights for policy 0, policy_version 1894563 (0.0009) [2023-12-28 08:52:47,232][106225] Updated weights for policy 1, policy_version 1898729 (0.0007) [2023-12-28 08:52:47,295][106225] Updated weights for policy 1, policy_version 1898739 (0.0006) [2023-12-28 08:52:47,339][106225] Updated weights for policy 1, policy_version 1898749 (0.0008) [2023-12-28 08:52:47,356][106226] Updated weights for policy 0, policy_version 1894573 (0.0008) [2023-12-28 08:52:47,405][106226] Updated weights for policy 0, policy_version 1894583 (0.0009) [2023-12-28 08:52:47,453][106226] Updated weights for policy 0, policy_version 1894593 (0.0008) [2023-12-28 08:52:47,980][106225] Updated weights for policy 1, policy_version 1898759 (0.0005) [2023-12-28 08:52:48,042][106225] Updated weights for policy 1, policy_version 1898769 (0.0005) [2023-12-28 08:52:48,101][106225] Updated weights for policy 1, policy_version 1898779 (0.0005) [2023-12-28 08:52:48,112][106226] Updated weights for policy 0, policy_version 1894603 (0.0009) [2023-12-28 08:52:48,165][106226] Updated weights for policy 0, policy_version 1894613 (0.0010) [2023-12-28 08:52:48,223][106226] Updated weights for policy 0, policy_version 1894623 (0.0011) [2023-12-28 08:52:48,688][106225] Updated weights for policy 1, policy_version 1898789 (0.0008) [2023-12-28 08:52:48,752][106225] Updated weights for policy 1, policy_version 1898799 (0.0010) [2023-12-28 08:52:48,816][106225] Updated weights for policy 1, policy_version 1898809 (0.0010) [2023-12-28 08:52:48,932][106226] Updated weights for policy 0, policy_version 1894633 (0.0010) [2023-12-28 08:52:48,981][106226] Updated weights for policy 0, policy_version 1894643 (0.0010) [2023-12-28 08:52:49,037][106226] Updated weights for policy 0, policy_version 1894653 (0.0010) [2023-12-28 08:52:49,084][106226] Updated weights for policy 0, policy_version 1894663 (0.0010) [2023-12-28 08:52:49,587][106225] Updated weights for policy 1, policy_version 1898819 (0.0010) [2023-12-28 08:52:49,650][106225] Updated weights for policy 1, policy_version 1898829 (0.0008) [2023-12-28 08:52:49,711][106225] Updated weights for policy 1, policy_version 1898839 (0.0010) [2023-12-28 08:52:49,828][106226] Updated weights for policy 0, policy_version 1894673 (0.0009) [2023-12-28 08:52:49,899][106226] Updated weights for policy 0, policy_version 1894683 (0.0011) [2023-12-28 08:52:49,971][106226] Updated weights for policy 0, policy_version 1894693 (0.0009) [2023-12-28 08:52:50,543][106225] Updated weights for policy 1, policy_version 1898849 (0.0008) [2023-12-28 08:52:50,596][106226] Updated weights for policy 0, policy_version 1894703 (0.0008) [2023-12-28 08:52:50,606][106225] Updated weights for policy 1, policy_version 1898859 (0.0009) [2023-12-28 08:52:50,655][106226] Updated weights for policy 0, policy_version 1894713 (0.0010) [2023-12-28 08:52:50,668][106225] Updated weights for policy 1, policy_version 1898869 (0.0010) [2023-12-28 08:52:50,716][106226] Updated weights for policy 0, policy_version 1894723 (0.0008) [2023-12-28 08:52:50,730][106225] Updated weights for policy 1, policy_version 1898879 (0.0010) [2023-12-28 08:52:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 971300864. Throughput: 0: 9797.5, 1: 9984.6. Samples: 971310504. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:52:51,175][105115] Avg episode reward: [(0, '-4.149'), (1, '-4.647')] [2023-12-28 08:52:51,478][106226] Updated weights for policy 0, policy_version 1894733 (0.0007) [2023-12-28 08:52:51,530][106225] Updated weights for policy 1, policy_version 1898889 (0.0008) [2023-12-28 08:52:51,540][106226] Updated weights for policy 0, policy_version 1894743 (0.0006) [2023-12-28 08:52:51,590][106225] Updated weights for policy 1, policy_version 1898899 (0.0008) [2023-12-28 08:52:51,604][106226] Updated weights for policy 0, policy_version 1894753 (0.0006) [2023-12-28 08:52:51,653][106225] Updated weights for policy 1, policy_version 1898909 (0.0008) [2023-12-28 08:52:52,338][106226] Updated weights for policy 0, policy_version 1894763 (0.0010) [2023-12-28 08:52:52,408][106226] Updated weights for policy 0, policy_version 1894773 (0.0011) [2023-12-28 08:52:52,420][106225] Updated weights for policy 1, policy_version 1898919 (0.0006) [2023-12-28 08:52:52,469][106226] Updated weights for policy 0, policy_version 1894783 (0.0011) [2023-12-28 08:52:52,481][106225] Updated weights for policy 1, policy_version 1898929 (0.0010) [2023-12-28 08:52:52,545][106225] Updated weights for policy 1, policy_version 1898939 (0.0010) [2023-12-28 08:52:53,145][106226] Updated weights for policy 0, policy_version 1894793 (0.0010) [2023-12-28 08:52:53,203][106226] Updated weights for policy 0, policy_version 1894803 (0.0005) [2023-12-28 08:52:53,254][106226] Updated weights for policy 0, policy_version 1894813 (0.0005) [2023-12-28 08:52:53,258][106225] Updated weights for policy 1, policy_version 1898949 (0.0010) [2023-12-28 08:52:53,308][106225] Updated weights for policy 1, policy_version 1898959 (0.0010) [2023-12-28 08:52:53,316][106226] Updated weights for policy 0, policy_version 1894823 (0.0008) [2023-12-28 08:52:53,363][106225] Updated weights for policy 1, policy_version 1898969 (0.0010) [2023-12-28 08:52:53,879][106226] Updated weights for policy 0, policy_version 1894833 (0.0010) [2023-12-28 08:52:53,931][106226] Updated weights for policy 0, policy_version 1894843 (0.0011) [2023-12-28 08:52:53,985][106226] Updated weights for policy 0, policy_version 1894853 (0.0010) [2023-12-28 08:52:54,057][106225] Updated weights for policy 1, policy_version 1898979 (0.0009) [2023-12-28 08:52:54,113][106225] Updated weights for policy 1, policy_version 1898989 (0.0005) [2023-12-28 08:52:54,182][106225] Updated weights for policy 1, policy_version 1898999 (0.0005) [2023-12-28 08:52:54,569][106226] Updated weights for policy 0, policy_version 1894863 (0.0010) [2023-12-28 08:52:54,629][106226] Updated weights for policy 0, policy_version 1894873 (0.0011) [2023-12-28 08:52:54,679][106226] Updated weights for policy 0, policy_version 1894883 (0.0010) [2023-12-28 08:52:54,725][106225] Updated weights for policy 1, policy_version 1899009 (0.0005) [2023-12-28 08:52:54,781][106225] Updated weights for policy 1, policy_version 1899019 (0.0006) [2023-12-28 08:52:54,832][106225] Updated weights for policy 1, policy_version 1899029 (0.0007) [2023-12-28 08:52:54,883][106225] Updated weights for policy 1, policy_version 1899039 (0.0008) [2023-12-28 08:52:55,382][106226] Updated weights for policy 0, policy_version 1894893 (0.0011) [2023-12-28 08:52:55,439][106226] Updated weights for policy 0, policy_version 1894903 (0.0007) [2023-12-28 08:52:55,492][106226] Updated weights for policy 0, policy_version 1894913 (0.0005) [2023-12-28 08:52:55,525][106225] Updated weights for policy 1, policy_version 1899049 (0.0006) [2023-12-28 08:52:55,585][106225] Updated weights for policy 1, policy_version 1899059 (0.0005) [2023-12-28 08:52:55,652][106225] Updated weights for policy 1, policy_version 1899069 (0.0007) [2023-12-28 08:52:56,126][106226] Updated weights for policy 0, policy_version 1894923 (0.0005) [2023-12-28 08:52:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 971399168. Throughput: 0: 9831.8, 1: 9981.6. Samples: 971369340. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:52:56,175][105115] Avg episode reward: [(0, '-4.136'), (1, '-4.848')] [2023-12-28 08:52:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001899072_486219776.pth... [2023-12-28 08:52:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001897920_485924864.pth [2023-12-28 08:52:56,186][106226] Updated weights for policy 0, policy_version 1894933 (0.0006) [2023-12-28 08:52:56,243][106226] Updated weights for policy 0, policy_version 1894943 (0.0005) [2023-12-28 08:52:56,284][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001894952_485187584.pth... [2023-12-28 08:52:56,287][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001893768_484884480.pth [2023-12-28 08:52:56,315][106225] Updated weights for policy 1, policy_version 1899079 (0.0010) [2023-12-28 08:52:56,377][106225] Updated weights for policy 1, policy_version 1899089 (0.0010) [2023-12-28 08:52:56,430][106225] Updated weights for policy 1, policy_version 1899099 (0.0010) [2023-12-28 08:52:56,897][106226] Updated weights for policy 0, policy_version 1894953 (0.0006) [2023-12-28 08:52:56,962][106226] Updated weights for policy 0, policy_version 1894963 (0.0006) [2023-12-28 08:52:57,035][106226] Updated weights for policy 0, policy_version 1894973 (0.0005) [2023-12-28 08:52:57,074][106225] Updated weights for policy 1, policy_version 1899109 (0.0008) [2023-12-28 08:52:57,093][106226] Updated weights for policy 0, policy_version 1894983 (0.0009) [2023-12-28 08:52:57,132][106225] Updated weights for policy 1, policy_version 1899119 (0.0005) [2023-12-28 08:52:57,192][106225] Updated weights for policy 1, policy_version 1899129 (0.0005) [2023-12-28 08:52:57,738][106226] Updated weights for policy 0, policy_version 1894993 (0.0008) [2023-12-28 08:52:57,795][106226] Updated weights for policy 0, policy_version 1895003 (0.0005) [2023-12-28 08:52:57,842][106225] Updated weights for policy 1, policy_version 1899139 (0.0008) [2023-12-28 08:52:57,843][106226] Updated weights for policy 0, policy_version 1895013 (0.0008) [2023-12-28 08:52:57,891][106225] Updated weights for policy 1, policy_version 1899149 (0.0010) [2023-12-28 08:52:57,941][106225] Updated weights for policy 1, policy_version 1899159 (0.0010) [2023-12-28 08:52:58,580][106226] Updated weights for policy 0, policy_version 1895023 (0.0007) [2023-12-28 08:52:58,638][106226] Updated weights for policy 0, policy_version 1895033 (0.0008) [2023-12-28 08:52:58,685][106225] Updated weights for policy 1, policy_version 1899169 (0.0014) [2023-12-28 08:52:58,707][106226] Updated weights for policy 0, policy_version 1895043 (0.0007) [2023-12-28 08:52:58,752][106225] Updated weights for policy 1, policy_version 1899179 (0.0009) [2023-12-28 08:52:58,823][106225] Updated weights for policy 1, policy_version 1899189 (0.0008) [2023-12-28 08:52:58,898][106225] Updated weights for policy 1, policy_version 1899199 (0.0008) [2023-12-28 08:52:59,549][106226] Updated weights for policy 0, policy_version 1895053 (0.0008) [2023-12-28 08:52:59,610][106226] Updated weights for policy 0, policy_version 1895063 (0.0008) [2023-12-28 08:52:59,674][106226] Updated weights for policy 0, policy_version 1895073 (0.0007) [2023-12-28 08:52:59,692][106225] Updated weights for policy 1, policy_version 1899209 (0.0009) [2023-12-28 08:52:59,747][106225] Updated weights for policy 1, policy_version 1899219 (0.0010) [2023-12-28 08:52:59,813][106225] Updated weights for policy 1, policy_version 1899229 (0.0010) [2023-12-28 08:53:00,472][106225] Updated weights for policy 1, policy_version 1899239 (0.0007) [2023-12-28 08:53:00,484][106226] Updated weights for policy 0, policy_version 1895083 (0.0008) [2023-12-28 08:53:00,530][106226] Updated weights for policy 0, policy_version 1895093 (0.0009) [2023-12-28 08:53:00,531][106225] Updated weights for policy 1, policy_version 1899249 (0.0005) [2023-12-28 08:53:00,576][106226] Updated weights for policy 0, policy_version 1895103 (0.0008) [2023-12-28 08:53:00,590][106225] Updated weights for policy 1, policy_version 1899259 (0.0005) [2023-12-28 08:53:01,169][106225] Updated weights for policy 1, policy_version 1899269 (0.0007) [2023-12-28 08:53:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 971497472. Throughput: 0: 9876.2, 1: 9977.4. Samples: 971490576. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:01,175][105115] Avg episode reward: [(0, '-4.095'), (1, '-4.512')] [2023-12-28 08:53:01,231][106225] Updated weights for policy 1, policy_version 1899279 (0.0006) [2023-12-28 08:53:01,297][106226] Updated weights for policy 0, policy_version 1895113 (0.0008) [2023-12-28 08:53:01,298][106225] Updated weights for policy 1, policy_version 1899289 (0.0007) [2023-12-28 08:53:01,354][106226] Updated weights for policy 0, policy_version 1895123 (0.0008) [2023-12-28 08:53:01,420][106226] Updated weights for policy 0, policy_version 1895133 (0.0008) [2023-12-28 08:53:01,481][106226] Updated weights for policy 0, policy_version 1895143 (0.0005) [2023-12-28 08:53:01,984][106225] Updated weights for policy 1, policy_version 1899299 (0.0008) [2023-12-28 08:53:02,039][106225] Updated weights for policy 1, policy_version 1899309 (0.0010) [2023-12-28 08:53:02,098][106225] Updated weights for policy 1, policy_version 1899319 (0.0011) [2023-12-28 08:53:02,123][106226] Updated weights for policy 0, policy_version 1895153 (0.0006) [2023-12-28 08:53:02,175][106226] Updated weights for policy 0, policy_version 1895163 (0.0008) [2023-12-28 08:53:02,232][106226] Updated weights for policy 0, policy_version 1895173 (0.0006) [2023-12-28 08:53:02,809][106225] Updated weights for policy 1, policy_version 1899329 (0.0010) [2023-12-28 08:53:02,861][106225] Updated weights for policy 1, policy_version 1899339 (0.0005) [2023-12-28 08:53:02,915][106225] Updated weights for policy 1, policy_version 1899349 (0.0005) [2023-12-28 08:53:02,955][106226] Updated weights for policy 0, policy_version 1895183 (0.0007) [2023-12-28 08:53:02,971][106225] Updated weights for policy 1, policy_version 1899359 (0.0005) [2023-12-28 08:53:03,010][106226] Updated weights for policy 0, policy_version 1895193 (0.0008) [2023-12-28 08:53:03,065][106226] Updated weights for policy 0, policy_version 1895203 (0.0008) [2023-12-28 08:53:03,548][106225] Updated weights for policy 1, policy_version 1899369 (0.0005) [2023-12-28 08:53:03,607][106225] Updated weights for policy 1, policy_version 1899379 (0.0005) [2023-12-28 08:53:03,667][106225] Updated weights for policy 1, policy_version 1899389 (0.0005) [2023-12-28 08:53:03,901][106226] Updated weights for policy 0, policy_version 1895213 (0.0008) [2023-12-28 08:53:03,973][106226] Updated weights for policy 0, policy_version 1895223 (0.0008) [2023-12-28 08:53:04,037][106226] Updated weights for policy 0, policy_version 1895233 (0.0009) [2023-12-28 08:53:04,267][106225] Updated weights for policy 1, policy_version 1899399 (0.0007) [2023-12-28 08:53:04,316][106225] Updated weights for policy 1, policy_version 1899409 (0.0007) [2023-12-28 08:53:04,366][106225] Updated weights for policy 1, policy_version 1899419 (0.0007) [2023-12-28 08:53:04,775][106226] Updated weights for policy 0, policy_version 1895243 (0.0009) [2023-12-28 08:53:04,832][106226] Updated weights for policy 0, policy_version 1895253 (0.0009) [2023-12-28 08:53:04,888][106226] Updated weights for policy 0, policy_version 1895263 (0.0008) [2023-12-28 08:53:05,077][106225] Updated weights for policy 1, policy_version 1899429 (0.0009) [2023-12-28 08:53:05,137][106225] Updated weights for policy 1, policy_version 1899439 (0.0008) [2023-12-28 08:53:05,197][106225] Updated weights for policy 1, policy_version 1899449 (0.0007) [2023-12-28 08:53:05,601][106226] Updated weights for policy 0, policy_version 1895273 (0.0009) [2023-12-28 08:53:05,668][106226] Updated weights for policy 0, policy_version 1895283 (0.0009) [2023-12-28 08:53:05,721][106226] Updated weights for policy 0, policy_version 1895293 (0.0005) [2023-12-28 08:53:05,778][106226] Updated weights for policy 0, policy_version 1895303 (0.0006) [2023-12-28 08:53:05,922][106225] Updated weights for policy 1, policy_version 1899459 (0.0008) [2023-12-28 08:53:05,978][106225] Updated weights for policy 1, policy_version 1899469 (0.0007) [2023-12-28 08:53:06,042][106225] Updated weights for policy 1, policy_version 1899479 (0.0008) [2023-12-28 08:53:06,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 971603968. Throughput: 0: 9843.1, 1: 10074.3. Samples: 971611244. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:06,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.619')] [2023-12-28 08:53:06,401][106226] Updated weights for policy 0, policy_version 1895313 (0.0011) [2023-12-28 08:53:06,474][106226] Updated weights for policy 0, policy_version 1895323 (0.0011) [2023-12-28 08:53:06,549][106226] Updated weights for policy 0, policy_version 1895333 (0.0008) [2023-12-28 08:53:06,781][106225] Updated weights for policy 1, policy_version 1899489 (0.0009) [2023-12-28 08:53:06,846][106225] Updated weights for policy 1, policy_version 1899499 (0.0009) [2023-12-28 08:53:06,913][106225] Updated weights for policy 1, policy_version 1899509 (0.0009) [2023-12-28 08:53:06,975][106225] Updated weights for policy 1, policy_version 1899519 (0.0008) [2023-12-28 08:53:07,127][106226] Updated weights for policy 0, policy_version 1895343 (0.0010) [2023-12-28 08:53:07,184][106226] Updated weights for policy 0, policy_version 1895353 (0.0010) [2023-12-28 08:53:07,248][106226] Updated weights for policy 0, policy_version 1895363 (0.0011) [2023-12-28 08:53:07,737][106225] Updated weights for policy 1, policy_version 1899529 (0.0007) [2023-12-28 08:53:07,795][106225] Updated weights for policy 1, policy_version 1899539 (0.0008) [2023-12-28 08:53:07,852][106225] Updated weights for policy 1, policy_version 1899549 (0.0008) [2023-12-28 08:53:08,007][106226] Updated weights for policy 0, policy_version 1895373 (0.0011) [2023-12-28 08:53:08,064][106226] Updated weights for policy 0, policy_version 1895383 (0.0011) [2023-12-28 08:53:08,127][106226] Updated weights for policy 0, policy_version 1895393 (0.0009) [2023-12-28 08:53:08,596][106225] Updated weights for policy 1, policy_version 1899559 (0.0006) [2023-12-28 08:53:08,653][106225] Updated weights for policy 1, policy_version 1899569 (0.0005) [2023-12-28 08:53:08,707][106225] Updated weights for policy 1, policy_version 1899579 (0.0005) [2023-12-28 08:53:08,808][106226] Updated weights for policy 0, policy_version 1895403 (0.0009) [2023-12-28 08:53:08,866][106226] Updated weights for policy 0, policy_version 1895413 (0.0006) [2023-12-28 08:53:08,928][106226] Updated weights for policy 0, policy_version 1895423 (0.0006) [2023-12-28 08:53:09,348][106225] Updated weights for policy 1, policy_version 1899589 (0.0009) [2023-12-28 08:53:09,410][106225] Updated weights for policy 1, policy_version 1899599 (0.0010) [2023-12-28 08:53:09,468][106225] Updated weights for policy 1, policy_version 1899609 (0.0008) [2023-12-28 08:53:09,544][106226] Updated weights for policy 0, policy_version 1895433 (0.0006) [2023-12-28 08:53:09,592][106226] Updated weights for policy 0, policy_version 1895443 (0.0008) [2023-12-28 08:53:09,644][106226] Updated weights for policy 0, policy_version 1895453 (0.0009) [2023-12-28 08:53:09,697][106226] Updated weights for policy 0, policy_version 1895463 (0.0009) [2023-12-28 08:53:10,178][106225] Updated weights for policy 1, policy_version 1899619 (0.0007) [2023-12-28 08:53:10,241][106225] Updated weights for policy 1, policy_version 1899629 (0.0008) [2023-12-28 08:53:10,301][106225] Updated weights for policy 1, policy_version 1899639 (0.0008) [2023-12-28 08:53:10,465][106226] Updated weights for policy 0, policy_version 1895473 (0.0009) [2023-12-28 08:53:10,513][106226] Updated weights for policy 0, policy_version 1895483 (0.0009) [2023-12-28 08:53:10,568][106226] Updated weights for policy 0, policy_version 1895493 (0.0009) [2023-12-28 08:53:10,893][106225] Updated weights for policy 1, policy_version 1899649 (0.0008) [2023-12-28 08:53:10,939][106225] Updated weights for policy 1, policy_version 1899659 (0.0007) [2023-12-28 08:53:11,000][106225] Updated weights for policy 1, policy_version 1899669 (0.0008) [2023-12-28 08:53:11,055][106225] Updated weights for policy 1, policy_version 1899679 (0.0007) [2023-12-28 08:53:11,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 971702272. Throughput: 0: 9898.2, 1: 10092.9. Samples: 971671260. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:11,175][105115] Avg episode reward: [(0, '-4.515'), (1, '-4.780')] [2023-12-28 08:53:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001899680_486375424.pth... [2023-12-28 08:53:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001895496_485326848.pth... [2023-12-28 08:53:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001894344_485031936.pth [2023-12-28 08:53:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001898496_486072320.pth [2023-12-28 08:53:11,393][106226] Updated weights for policy 0, policy_version 1895503 (0.0008) [2023-12-28 08:53:11,461][106226] Updated weights for policy 0, policy_version 1895513 (0.0007) [2023-12-28 08:53:11,527][106226] Updated weights for policy 0, policy_version 1895523 (0.0008) [2023-12-28 08:53:11,880][106225] Updated weights for policy 1, policy_version 1899689 (0.0008) [2023-12-28 08:53:11,942][106225] Updated weights for policy 1, policy_version 1899699 (0.0008) [2023-12-28 08:53:12,000][106225] Updated weights for policy 1, policy_version 1899709 (0.0008) [2023-12-28 08:53:12,200][106226] Updated weights for policy 0, policy_version 1895533 (0.0008) [2023-12-28 08:53:12,274][106226] Updated weights for policy 0, policy_version 1895543 (0.0007) [2023-12-28 08:53:12,343][106226] Updated weights for policy 0, policy_version 1895553 (0.0007) [2023-12-28 08:53:12,674][106225] Updated weights for policy 1, policy_version 1899719 (0.0009) [2023-12-28 08:53:12,734][106225] Updated weights for policy 1, policy_version 1899729 (0.0008) [2023-12-28 08:53:12,794][106225] Updated weights for policy 1, policy_version 1899739 (0.0009) [2023-12-28 08:53:13,041][106226] Updated weights for policy 0, policy_version 1895563 (0.0009) [2023-12-28 08:53:13,098][106226] Updated weights for policy 0, policy_version 1895573 (0.0008) [2023-12-28 08:53:13,156][106226] Updated weights for policy 0, policy_version 1895583 (0.0009) [2023-12-28 08:53:13,539][106225] Updated weights for policy 1, policy_version 1899749 (0.0008) [2023-12-28 08:53:13,592][106225] Updated weights for policy 1, policy_version 1899759 (0.0008) [2023-12-28 08:53:13,641][106225] Updated weights for policy 1, policy_version 1899769 (0.0008) [2023-12-28 08:53:13,869][106226] Updated weights for policy 0, policy_version 1895593 (0.0009) [2023-12-28 08:53:13,923][106226] Updated weights for policy 0, policy_version 1895603 (0.0011) [2023-12-28 08:53:13,976][106226] Updated weights for policy 0, policy_version 1895613 (0.0010) [2023-12-28 08:53:14,025][106226] Updated weights for policy 0, policy_version 1895623 (0.0010) [2023-12-28 08:53:14,364][106225] Updated weights for policy 1, policy_version 1899779 (0.0008) [2023-12-28 08:53:14,413][106225] Updated weights for policy 1, policy_version 1899789 (0.0007) [2023-12-28 08:53:14,470][106225] Updated weights for policy 1, policy_version 1899799 (0.0006) [2023-12-28 08:53:14,735][106226] Updated weights for policy 0, policy_version 1895633 (0.0010) [2023-12-28 08:53:14,800][106226] Updated weights for policy 0, policy_version 1895643 (0.0008) [2023-12-28 08:53:14,852][106226] Updated weights for policy 0, policy_version 1895653 (0.0009) [2023-12-28 08:53:15,076][106225] Updated weights for policy 1, policy_version 1899809 (0.0008) [2023-12-28 08:53:15,132][106225] Updated weights for policy 1, policy_version 1899819 (0.0008) [2023-12-28 08:53:15,192][106225] Updated weights for policy 1, policy_version 1899829 (0.0009) [2023-12-28 08:53:15,249][106225] Updated weights for policy 1, policy_version 1899839 (0.0009) [2023-12-28 08:53:15,531][106226] Updated weights for policy 0, policy_version 1895663 (0.0007) [2023-12-28 08:53:15,579][106226] Updated weights for policy 0, policy_version 1895673 (0.0006) [2023-12-28 08:53:15,633][106226] Updated weights for policy 0, policy_version 1895683 (0.0008) [2023-12-28 08:53:16,022][106225] Updated weights for policy 1, policy_version 1899849 (0.0008) [2023-12-28 08:53:16,080][106225] Updated weights for policy 1, policy_version 1899859 (0.0008) [2023-12-28 08:53:16,143][106225] Updated weights for policy 1, policy_version 1899869 (0.0009) [2023-12-28 08:53:16,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 971800576. Throughput: 0: 9899.1, 1: 10002.7. Samples: 971787796. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:16,176][105115] Avg episode reward: [(0, '-4.268'), (1, '-4.547')] [2023-12-28 08:53:16,234][106226] Updated weights for policy 0, policy_version 1895693 (0.0007) [2023-12-28 08:53:16,289][106226] Updated weights for policy 0, policy_version 1895703 (0.0005) [2023-12-28 08:53:16,349][106226] Updated weights for policy 0, policy_version 1895713 (0.0006) [2023-12-28 08:53:16,842][106225] Updated weights for policy 1, policy_version 1899879 (0.0008) [2023-12-28 08:53:16,897][106225] Updated weights for policy 1, policy_version 1899889 (0.0008) [2023-12-28 08:53:16,960][106225] Updated weights for policy 1, policy_version 1899899 (0.0009) [2023-12-28 08:53:17,040][106226] Updated weights for policy 0, policy_version 1895723 (0.0010) [2023-12-28 08:53:17,098][106226] Updated weights for policy 0, policy_version 1895733 (0.0008) [2023-12-28 08:53:17,143][106226] Updated weights for policy 0, policy_version 1895743 (0.0008) [2023-12-28 08:53:17,686][106225] Updated weights for policy 1, policy_version 1899909 (0.0008) [2023-12-28 08:53:17,746][106225] Updated weights for policy 1, policy_version 1899919 (0.0009) [2023-12-28 08:53:17,815][106226] Updated weights for policy 0, policy_version 1895753 (0.0008) [2023-12-28 08:53:17,816][106225] Updated weights for policy 1, policy_version 1899929 (0.0010) [2023-12-28 08:53:17,871][106226] Updated weights for policy 0, policy_version 1895763 (0.0007) [2023-12-28 08:53:17,928][106226] Updated weights for policy 0, policy_version 1895773 (0.0008) [2023-12-28 08:53:17,987][106226] Updated weights for policy 0, policy_version 1895783 (0.0008) [2023-12-28 08:53:18,522][106225] Updated weights for policy 1, policy_version 1899939 (0.0007) [2023-12-28 08:53:18,582][106225] Updated weights for policy 1, policy_version 1899949 (0.0007) [2023-12-28 08:53:18,639][106225] Updated weights for policy 1, policy_version 1899959 (0.0007) [2023-12-28 08:53:18,694][106226] Updated weights for policy 0, policy_version 1895793 (0.0006) [2023-12-28 08:53:18,752][106226] Updated weights for policy 0, policy_version 1895803 (0.0009) [2023-12-28 08:53:18,811][106226] Updated weights for policy 0, policy_version 1895813 (0.0010) [2023-12-28 08:53:19,322][106225] Updated weights for policy 1, policy_version 1899969 (0.0006) [2023-12-28 08:53:19,394][106225] Updated weights for policy 1, policy_version 1899979 (0.0009) [2023-12-28 08:53:19,439][106225] Updated weights for policy 1, policy_version 1899989 (0.0007) [2023-12-28 08:53:19,504][106225] Updated weights for policy 1, policy_version 1899999 (0.0008) [2023-12-28 08:53:19,602][106226] Updated weights for policy 0, policy_version 1895823 (0.0010) [2023-12-28 08:53:19,663][106226] Updated weights for policy 0, policy_version 1895833 (0.0007) [2023-12-28 08:53:19,719][106226] Updated weights for policy 0, policy_version 1895843 (0.0007) [2023-12-28 08:53:20,275][106225] Updated weights for policy 1, policy_version 1900009 (0.0006) [2023-12-28 08:53:20,331][106225] Updated weights for policy 1, policy_version 1900019 (0.0006) [2023-12-28 08:53:20,390][106225] Updated weights for policy 1, policy_version 1900029 (0.0006) [2023-12-28 08:53:20,417][106226] Updated weights for policy 0, policy_version 1895853 (0.0008) [2023-12-28 08:53:20,487][106226] Updated weights for policy 0, policy_version 1895863 (0.0009) [2023-12-28 08:53:20,542][106226] Updated weights for policy 0, policy_version 1895873 (0.0006) [2023-12-28 08:53:21,122][106225] Updated weights for policy 1, policy_version 1900039 (0.0008) [2023-12-28 08:53:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 971890688. Throughput: 0: 9928.4, 1: 9901.4. Samples: 971906304. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:21,175][105115] Avg episode reward: [(0, '-4.233'), (1, '-4.805')] [2023-12-28 08:53:21,192][106225] Updated weights for policy 1, policy_version 1900049 (0.0008) [2023-12-28 08:53:21,259][106225] Updated weights for policy 1, policy_version 1900059 (0.0008) [2023-12-28 08:53:21,263][106226] Updated weights for policy 0, policy_version 1895883 (0.0008) [2023-12-28 08:53:21,332][106226] Updated weights for policy 0, policy_version 1895893 (0.0008) [2023-12-28 08:53:21,407][106226] Updated weights for policy 0, policy_version 1895903 (0.0008) [2023-12-28 08:53:22,074][106226] Updated weights for policy 0, policy_version 1895913 (0.0007) [2023-12-28 08:53:22,080][106225] Updated weights for policy 1, policy_version 1900069 (0.0008) [2023-12-28 08:53:22,136][106226] Updated weights for policy 0, policy_version 1895923 (0.0007) [2023-12-28 08:53:22,141][106225] Updated weights for policy 1, policy_version 1900079 (0.0009) [2023-12-28 08:53:22,194][106225] Updated weights for policy 1, policy_version 1900089 (0.0009) [2023-12-28 08:53:22,196][106226] Updated weights for policy 0, policy_version 1895933 (0.0007) [2023-12-28 08:53:22,261][106226] Updated weights for policy 0, policy_version 1895943 (0.0008) [2023-12-28 08:53:22,968][106225] Updated weights for policy 1, policy_version 1900099 (0.0008) [2023-12-28 08:53:22,986][106226] Updated weights for policy 0, policy_version 1895953 (0.0006) [2023-12-28 08:53:23,031][106225] Updated weights for policy 1, policy_version 1900109 (0.0011) [2023-12-28 08:53:23,038][106226] Updated weights for policy 0, policy_version 1895963 (0.0008) [2023-12-28 08:53:23,089][106225] Updated weights for policy 1, policy_version 1900119 (0.0011) [2023-12-28 08:53:23,103][106226] Updated weights for policy 0, policy_version 1895973 (0.0006) [2023-12-28 08:53:23,712][106226] Updated weights for policy 0, policy_version 1895983 (0.0005) [2023-12-28 08:53:23,720][106225] Updated weights for policy 1, policy_version 1900129 (0.0010) [2023-12-28 08:53:23,768][106225] Updated weights for policy 1, policy_version 1900139 (0.0005) [2023-12-28 08:53:23,777][106226] Updated weights for policy 0, policy_version 1895993 (0.0005) [2023-12-28 08:53:23,826][106225] Updated weights for policy 1, policy_version 1900149 (0.0005) [2023-12-28 08:53:23,837][106226] Updated weights for policy 0, policy_version 1896003 (0.0010) [2023-12-28 08:53:23,887][106225] Updated weights for policy 1, policy_version 1900159 (0.0005) [2023-12-28 08:53:24,449][106226] Updated weights for policy 0, policy_version 1896013 (0.0008) [2023-12-28 08:53:24,492][106225] Updated weights for policy 1, policy_version 1900169 (0.0010) [2023-12-28 08:53:24,504][106226] Updated weights for policy 0, policy_version 1896023 (0.0006) [2023-12-28 08:53:24,543][106225] Updated weights for policy 1, policy_version 1900179 (0.0010) [2023-12-28 08:53:24,556][106226] Updated weights for policy 0, policy_version 1896033 (0.0005) [2023-12-28 08:53:24,593][106225] Updated weights for policy 1, policy_version 1900189 (0.0010) [2023-12-28 08:53:25,135][106226] Updated weights for policy 0, policy_version 1896043 (0.0007) [2023-12-28 08:53:25,199][106226] Updated weights for policy 0, policy_version 1896053 (0.0005) [2023-12-28 08:53:25,252][106226] Updated weights for policy 0, policy_version 1896063 (0.0006) [2023-12-28 08:53:25,295][106225] Updated weights for policy 1, policy_version 1900199 (0.0009) [2023-12-28 08:53:25,359][106225] Updated weights for policy 1, policy_version 1900209 (0.0008) [2023-12-28 08:53:25,417][106225] Updated weights for policy 1, policy_version 1900219 (0.0010) [2023-12-28 08:53:25,868][106226] Updated weights for policy 0, policy_version 1896073 (0.0006) [2023-12-28 08:53:25,930][106226] Updated weights for policy 0, policy_version 1896083 (0.0010) [2023-12-28 08:53:25,980][106226] Updated weights for policy 0, policy_version 1896093 (0.0010) [2023-12-28 08:53:26,036][106226] Updated weights for policy 0, policy_version 1896103 (0.0010) [2023-12-28 08:53:26,107][106225] Updated weights for policy 1, policy_version 1900229 (0.0009) [2023-12-28 08:53:26,164][106225] Updated weights for policy 1, policy_version 1900239 (0.0006) [2023-12-28 08:53:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 971997184. Throughput: 0: 9950.1, 1: 9835.8. Samples: 971964096. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:26,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.650')] [2023-12-28 08:53:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001896104_485482496.pth... [2023-12-28 08:53:26,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001894952_485187584.pth [2023-12-28 08:53:26,219][106225] Updated weights for policy 1, policy_version 1900249 (0.0005) [2023-12-28 08:53:26,253][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001900256_486522880.pth... [2023-12-28 08:53:26,256][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001899072_486219776.pth [2023-12-28 08:53:26,714][106226] Updated weights for policy 0, policy_version 1896113 (0.0010) [2023-12-28 08:53:26,762][106226] Updated weights for policy 0, policy_version 1896123 (0.0010) [2023-12-28 08:53:26,818][106226] Updated weights for policy 0, policy_version 1896133 (0.0010) [2023-12-28 08:53:26,878][106225] Updated weights for policy 1, policy_version 1900259 (0.0005) [2023-12-28 08:53:26,940][106225] Updated weights for policy 1, policy_version 1900269 (0.0005) [2023-12-28 08:53:26,998][106225] Updated weights for policy 1, policy_version 1900279 (0.0005) [2023-12-28 08:53:27,494][106225] Updated weights for policy 1, policy_version 1900289 (0.0006) [2023-12-28 08:53:27,549][106226] Updated weights for policy 0, policy_version 1896143 (0.0010) [2023-12-28 08:53:27,550][106225] Updated weights for policy 1, policy_version 1900299 (0.0010) [2023-12-28 08:53:27,598][106225] Updated weights for policy 1, policy_version 1900309 (0.0006) [2023-12-28 08:53:27,598][106226] Updated weights for policy 0, policy_version 1896153 (0.0010) [2023-12-28 08:53:27,646][106226] Updated weights for policy 0, policy_version 1896163 (0.0007) [2023-12-28 08:53:27,653][106225] Updated weights for policy 1, policy_version 1900319 (0.0009) [2023-12-28 08:53:28,296][106226] Updated weights for policy 0, policy_version 1896173 (0.0010) [2023-12-28 08:53:28,319][106225] Updated weights for policy 1, policy_version 1900329 (0.0006) [2023-12-28 08:53:28,357][106226] Updated weights for policy 0, policy_version 1896183 (0.0010) [2023-12-28 08:53:28,386][106225] Updated weights for policy 1, policy_version 1900339 (0.0006) [2023-12-28 08:53:28,417][106226] Updated weights for policy 0, policy_version 1896193 (0.0011) [2023-12-28 08:53:28,447][106225] Updated weights for policy 1, policy_version 1900349 (0.0005) [2023-12-28 08:53:29,114][106226] Updated weights for policy 0, policy_version 1896203 (0.0009) [2023-12-28 08:53:29,146][106225] Updated weights for policy 1, policy_version 1900359 (0.0006) [2023-12-28 08:53:29,167][106226] Updated weights for policy 0, policy_version 1896213 (0.0005) [2023-12-28 08:53:29,194][106225] Updated weights for policy 1, policy_version 1900369 (0.0005) [2023-12-28 08:53:29,218][106226] Updated weights for policy 0, policy_version 1896223 (0.0006) [2023-12-28 08:53:29,252][106225] Updated weights for policy 1, policy_version 1900379 (0.0008) [2023-12-28 08:53:29,889][106226] Updated weights for policy 0, policy_version 1896233 (0.0013) [2023-12-28 08:53:29,956][106226] Updated weights for policy 0, policy_version 1896243 (0.0011) [2023-12-28 08:53:29,979][106225] Updated weights for policy 1, policy_version 1900389 (0.0007) [2023-12-28 08:53:30,021][106226] Updated weights for policy 0, policy_version 1896253 (0.0011) [2023-12-28 08:53:30,035][106225] Updated weights for policy 1, policy_version 1900399 (0.0005) [2023-12-28 08:53:30,085][106226] Updated weights for policy 0, policy_version 1896263 (0.0011) [2023-12-28 08:53:30,101][106225] Updated weights for policy 1, policy_version 1900409 (0.0007) [2023-12-28 08:53:30,747][106225] Updated weights for policy 1, policy_version 1900419 (0.0007) [2023-12-28 08:53:30,790][106226] Updated weights for policy 0, policy_version 1896273 (0.0010) [2023-12-28 08:53:30,790][106225] Updated weights for policy 1, policy_version 1900429 (0.0008) [2023-12-28 08:53:30,842][106226] Updated weights for policy 0, policy_version 1896283 (0.0010) [2023-12-28 08:53:30,848][106225] Updated weights for policy 1, policy_version 1900439 (0.0006) [2023-12-28 08:53:30,901][106226] Updated weights for policy 0, policy_version 1896293 (0.0010) [2023-12-28 08:53:31,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 972103680. Throughput: 0: 10025.0, 1: 9952.6. Samples: 972090428. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:31,175][105115] Avg episode reward: [(0, '-4.410'), (1, '-4.654')] [2023-12-28 08:53:31,593][106225] Updated weights for policy 1, policy_version 1900449 (0.0005) [2023-12-28 08:53:31,661][106225] Updated weights for policy 1, policy_version 1900459 (0.0008) [2023-12-28 08:53:31,674][106226] Updated weights for policy 0, policy_version 1896303 (0.0011) [2023-12-28 08:53:31,723][106225] Updated weights for policy 1, policy_version 1900469 (0.0006) [2023-12-28 08:53:31,734][106226] Updated weights for policy 0, policy_version 1896313 (0.0009) [2023-12-28 08:53:31,785][106225] Updated weights for policy 1, policy_version 1900479 (0.0009) [2023-12-28 08:53:31,797][106226] Updated weights for policy 0, policy_version 1896323 (0.0011) [2023-12-28 08:53:32,509][106226] Updated weights for policy 0, policy_version 1896333 (0.0010) [2023-12-28 08:53:32,519][106225] Updated weights for policy 1, policy_version 1900489 (0.0007) [2023-12-28 08:53:32,573][106226] Updated weights for policy 0, policy_version 1896343 (0.0010) [2023-12-28 08:53:32,579][106225] Updated weights for policy 1, policy_version 1900499 (0.0007) [2023-12-28 08:53:32,625][106226] Updated weights for policy 0, policy_version 1896353 (0.0006) [2023-12-28 08:53:32,637][106225] Updated weights for policy 1, policy_version 1900509 (0.0007) [2023-12-28 08:53:33,205][106225] Updated weights for policy 1, policy_version 1900519 (0.0005) [2023-12-28 08:53:33,261][106225] Updated weights for policy 1, policy_version 1900529 (0.0005) [2023-12-28 08:53:33,311][106225] Updated weights for policy 1, policy_version 1900539 (0.0005) [2023-12-28 08:53:33,391][106226] Updated weights for policy 0, policy_version 1896363 (0.0007) [2023-12-28 08:53:33,456][106226] Updated weights for policy 0, policy_version 1896373 (0.0009) [2023-12-28 08:53:33,515][106226] Updated weights for policy 0, policy_version 1896383 (0.0010) [2023-12-28 08:53:33,954][106225] Updated weights for policy 1, policy_version 1900549 (0.0007) [2023-12-28 08:53:34,002][106225] Updated weights for policy 1, policy_version 1900559 (0.0008) [2023-12-28 08:53:34,051][106225] Updated weights for policy 1, policy_version 1900569 (0.0008) [2023-12-28 08:53:34,206][106226] Updated weights for policy 0, policy_version 1896393 (0.0010) [2023-12-28 08:53:34,270][106226] Updated weights for policy 0, policy_version 1896403 (0.0011) [2023-12-28 08:53:34,338][106226] Updated weights for policy 0, policy_version 1896413 (0.0011) [2023-12-28 08:53:34,405][106226] Updated weights for policy 0, policy_version 1896423 (0.0011) [2023-12-28 08:53:34,827][106225] Updated weights for policy 1, policy_version 1900579 (0.0008) [2023-12-28 08:53:34,888][106225] Updated weights for policy 1, policy_version 1900589 (0.0008) [2023-12-28 08:53:34,939][106225] Updated weights for policy 1, policy_version 1900599 (0.0007) [2023-12-28 08:53:35,096][106226] Updated weights for policy 0, policy_version 1896433 (0.0010) [2023-12-28 08:53:35,153][106226] Updated weights for policy 0, policy_version 1896443 (0.0010) [2023-12-28 08:53:35,212][106226] Updated weights for policy 0, policy_version 1896453 (0.0010) [2023-12-28 08:53:35,680][106225] Updated weights for policy 1, policy_version 1900609 (0.0008) [2023-12-28 08:53:35,738][106225] Updated weights for policy 1, policy_version 1900619 (0.0009) [2023-12-28 08:53:35,796][106225] Updated weights for policy 1, policy_version 1900629 (0.0008) [2023-12-28 08:53:35,850][106225] Updated weights for policy 1, policy_version 1900639 (0.0008) [2023-12-28 08:53:35,925][106226] Updated weights for policy 0, policy_version 1896463 (0.0010) [2023-12-28 08:53:35,986][106226] Updated weights for policy 0, policy_version 1896473 (0.0010) [2023-12-28 08:53:36,045][106226] Updated weights for policy 0, policy_version 1896483 (0.0010) [2023-12-28 08:53:36,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 972201984. Throughput: 0: 9935.0, 1: 10001.5. Samples: 972207648. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:36,175][105115] Avg episode reward: [(0, '-4.217'), (1, '-4.604')] [2023-12-28 08:53:36,606][106225] Updated weights for policy 1, policy_version 1900649 (0.0008) [2023-12-28 08:53:36,673][106225] Updated weights for policy 1, policy_version 1900659 (0.0008) [2023-12-28 08:53:36,733][106225] Updated weights for policy 1, policy_version 1900669 (0.0008) [2023-12-28 08:53:36,791][106226] Updated weights for policy 0, policy_version 1896493 (0.0011) [2023-12-28 08:53:36,848][106226] Updated weights for policy 0, policy_version 1896503 (0.0011) [2023-12-28 08:53:36,902][106226] Updated weights for policy 0, policy_version 1896513 (0.0010) [2023-12-28 08:53:37,475][106225] Updated weights for policy 1, policy_version 1900679 (0.0008) [2023-12-28 08:53:37,534][106225] Updated weights for policy 1, policy_version 1900689 (0.0008) [2023-12-28 08:53:37,588][106225] Updated weights for policy 1, policy_version 1900699 (0.0008) [2023-12-28 08:53:37,629][106226] Updated weights for policy 0, policy_version 1896523 (0.0010) [2023-12-28 08:53:37,689][106226] Updated weights for policy 0, policy_version 1896533 (0.0010) [2023-12-28 08:53:37,754][106226] Updated weights for policy 0, policy_version 1896543 (0.0011) [2023-12-28 08:53:38,375][106225] Updated weights for policy 1, policy_version 1900709 (0.0007) [2023-12-28 08:53:38,445][106225] Updated weights for policy 1, policy_version 1900719 (0.0007) [2023-12-28 08:53:38,473][106226] Updated weights for policy 0, policy_version 1896553 (0.0011) [2023-12-28 08:53:38,514][106225] Updated weights for policy 1, policy_version 1900729 (0.0009) [2023-12-28 08:53:38,537][106226] Updated weights for policy 0, policy_version 1896563 (0.0010) [2023-12-28 08:53:38,603][106226] Updated weights for policy 0, policy_version 1896573 (0.0010) [2023-12-28 08:53:38,667][106226] Updated weights for policy 0, policy_version 1896583 (0.0009) [2023-12-28 08:53:39,201][106225] Updated weights for policy 1, policy_version 1900739 (0.0011) [2023-12-28 08:53:39,272][106225] Updated weights for policy 1, policy_version 1900749 (0.0010) [2023-12-28 08:53:39,336][106225] Updated weights for policy 1, policy_version 1900759 (0.0012) [2023-12-28 08:53:39,437][106226] Updated weights for policy 0, policy_version 1896593 (0.0008) [2023-12-28 08:53:39,490][106226] Updated weights for policy 0, policy_version 1896603 (0.0009) [2023-12-28 08:53:39,554][106226] Updated weights for policy 0, policy_version 1896613 (0.0010) [2023-12-28 08:53:40,071][106225] Updated weights for policy 1, policy_version 1900769 (0.0009) [2023-12-28 08:53:40,130][106225] Updated weights for policy 1, policy_version 1900779 (0.0008) [2023-12-28 08:53:40,182][106225] Updated weights for policy 1, policy_version 1900789 (0.0008) [2023-12-28 08:53:40,242][106225] Updated weights for policy 1, policy_version 1900799 (0.0009) [2023-12-28 08:53:40,378][106226] Updated weights for policy 0, policy_version 1896623 (0.0008) [2023-12-28 08:53:40,441][106226] Updated weights for policy 0, policy_version 1896633 (0.0008) [2023-12-28 08:53:40,501][106226] Updated weights for policy 0, policy_version 1896643 (0.0009) [2023-12-28 08:53:40,909][106225] Updated weights for policy 1, policy_version 1900809 (0.0008) [2023-12-28 08:53:40,963][106225] Updated weights for policy 1, policy_version 1900820 (0.0010) [2023-12-28 08:53:41,029][106225] Updated weights for policy 1, policy_version 1900830 (0.0008) [2023-12-28 08:53:41,162][106226] Updated weights for policy 0, policy_version 1896653 (0.0009) [2023-12-28 08:53:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 972292096. Throughput: 0: 9889.7, 1: 9985.4. Samples: 972263720. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:41,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.598')] [2023-12-28 08:53:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001900832_486670336.pth... [2023-12-28 08:53:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001899680_486375424.pth [2023-12-28 08:53:41,189][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001900832_486670336.pth [2023-12-28 08:53:41,224][106226] Updated weights for policy 0, policy_version 1896663 (0.0009) [2023-12-28 08:53:41,296][106226] Updated weights for policy 0, policy_version 1896673 (0.0008) [2023-12-28 08:53:41,339][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001896680_485629952.pth... [2023-12-28 08:53:41,343][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001895496_485326848.pth [2023-12-28 08:53:41,344][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001896680_485629952.pth [2023-12-28 08:53:41,930][106225] Updated weights for policy 1, policy_version 1900840 (0.0011) [2023-12-28 08:53:41,979][106226] Updated weights for policy 0, policy_version 1896683 (0.0010) [2023-12-28 08:53:41,987][106225] Updated weights for policy 1, policy_version 1900850 (0.0010) [2023-12-28 08:53:42,037][106226] Updated weights for policy 0, policy_version 1896693 (0.0009) [2023-12-28 08:53:42,041][106225] Updated weights for policy 1, policy_version 1900860 (0.0008) [2023-12-28 08:53:42,096][106226] Updated weights for policy 0, policy_version 1896703 (0.0007) [2023-12-28 08:53:42,788][106225] Updated weights for policy 1, policy_version 1900870 (0.0009) [2023-12-28 08:53:42,844][106226] Updated weights for policy 0, policy_version 1896713 (0.0008) [2023-12-28 08:53:42,846][106225] Updated weights for policy 1, policy_version 1900880 (0.0008) [2023-12-28 08:53:42,904][106226] Updated weights for policy 0, policy_version 1896723 (0.0006) [2023-12-28 08:53:42,906][106225] Updated weights for policy 1, policy_version 1900890 (0.0006) [2023-12-28 08:53:42,951][106226] Updated weights for policy 0, policy_version 1896733 (0.0007) [2023-12-28 08:53:42,999][106226] Updated weights for policy 0, policy_version 1896743 (0.0008) [2023-12-28 08:53:43,653][106225] Updated weights for policy 1, policy_version 1900900 (0.0009) [2023-12-28 08:53:43,685][106226] Updated weights for policy 0, policy_version 1896753 (0.0009) [2023-12-28 08:53:43,709][106225] Updated weights for policy 1, policy_version 1900910 (0.0008) [2023-12-28 08:53:43,744][106226] Updated weights for policy 0, policy_version 1896763 (0.0009) [2023-12-28 08:53:43,769][106225] Updated weights for policy 1, policy_version 1900920 (0.0006) [2023-12-28 08:53:43,806][106226] Updated weights for policy 0, policy_version 1896773 (0.0007) [2023-12-28 08:53:44,486][106225] Updated weights for policy 1, policy_version 1900930 (0.0008) [2023-12-28 08:53:44,519][106226] Updated weights for policy 0, policy_version 1896783 (0.0008) [2023-12-28 08:53:44,539][106225] Updated weights for policy 1, policy_version 1900940 (0.0008) [2023-12-28 08:53:44,584][106226] Updated weights for policy 0, policy_version 1896793 (0.0007) [2023-12-28 08:53:44,600][106225] Updated weights for policy 1, policy_version 1900950 (0.0009) [2023-12-28 08:53:44,642][106226] Updated weights for policy 0, policy_version 1896803 (0.0006) [2023-12-28 08:53:44,660][106225] Updated weights for policy 1, policy_version 1900960 (0.0011) [2023-12-28 08:53:45,252][106226] Updated weights for policy 0, policy_version 1896813 (0.0006) [2023-12-28 08:53:45,318][106226] Updated weights for policy 0, policy_version 1896823 (0.0006) [2023-12-28 08:53:45,349][106225] Updated weights for policy 1, policy_version 1900970 (0.0011) [2023-12-28 08:53:45,378][106226] Updated weights for policy 0, policy_version 1896833 (0.0005) [2023-12-28 08:53:45,412][106225] Updated weights for policy 1, policy_version 1900980 (0.0010) [2023-12-28 08:53:45,468][106225] Updated weights for policy 1, policy_version 1900990 (0.0010) [2023-12-28 08:53:45,886][106226] Updated weights for policy 0, policy_version 1896843 (0.0006) [2023-12-28 08:53:45,945][106226] Updated weights for policy 0, policy_version 1896853 (0.0006) [2023-12-28 08:53:45,996][106226] Updated weights for policy 0, policy_version 1896863 (0.0010) [2023-12-28 08:53:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 972390400. Throughput: 0: 9860.6, 1: 9861.4. Samples: 972378068. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:46,175][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.552')] [2023-12-28 08:53:46,201][106225] Updated weights for policy 1, policy_version 1901000 (0.0009) [2023-12-28 08:53:46,256][106225] Updated weights for policy 1, policy_version 1901010 (0.0010) [2023-12-28 08:53:46,317][106225] Updated weights for policy 1, policy_version 1901020 (0.0008) [2023-12-28 08:53:46,583][106226] Updated weights for policy 0, policy_version 1896873 (0.0006) [2023-12-28 08:53:46,639][106226] Updated weights for policy 0, policy_version 1896883 (0.0010) [2023-12-28 08:53:46,702][106226] Updated weights for policy 0, policy_version 1896893 (0.0010) [2023-12-28 08:53:46,771][106226] Updated weights for policy 0, policy_version 1896903 (0.0010) [2023-12-28 08:53:46,942][106225] Updated weights for policy 1, policy_version 1901030 (0.0007) [2023-12-28 08:53:46,994][106225] Updated weights for policy 1, policy_version 1901040 (0.0005) [2023-12-28 08:53:47,052][106225] Updated weights for policy 1, policy_version 1901050 (0.0005) [2023-12-28 08:53:47,407][106226] Updated weights for policy 0, policy_version 1896913 (0.0010) [2023-12-28 08:53:47,470][106226] Updated weights for policy 0, policy_version 1896923 (0.0011) [2023-12-28 08:53:47,533][106226] Updated weights for policy 0, policy_version 1896933 (0.0011) [2023-12-28 08:53:47,698][106225] Updated weights for policy 1, policy_version 1901060 (0.0007) [2023-12-28 08:53:47,756][106225] Updated weights for policy 1, policy_version 1901070 (0.0010) [2023-12-28 08:53:47,819][106225] Updated weights for policy 1, policy_version 1901080 (0.0010) [2023-12-28 08:53:48,213][106226] Updated weights for policy 0, policy_version 1896943 (0.0009) [2023-12-28 08:53:48,272][106226] Updated weights for policy 0, policy_version 1896953 (0.0009) [2023-12-28 08:53:48,322][106226] Updated weights for policy 0, policy_version 1896963 (0.0010) [2023-12-28 08:53:48,520][106225] Updated weights for policy 1, policy_version 1901090 (0.0010) [2023-12-28 08:53:48,570][106225] Updated weights for policy 1, policy_version 1901100 (0.0010) [2023-12-28 08:53:48,630][106225] Updated weights for policy 1, policy_version 1901110 (0.0010) [2023-12-28 08:53:48,687][106225] Updated weights for policy 1, policy_version 1901120 (0.0006) [2023-12-28 08:53:49,005][106226] Updated weights for policy 0, policy_version 1896973 (0.0008) [2023-12-28 08:53:49,063][106226] Updated weights for policy 0, policy_version 1896983 (0.0009) [2023-12-28 08:53:49,113][106226] Updated weights for policy 0, policy_version 1896993 (0.0008) [2023-12-28 08:53:49,260][106225] Updated weights for policy 1, policy_version 1901130 (0.0009) [2023-12-28 08:53:49,320][106225] Updated weights for policy 1, policy_version 1901140 (0.0008) [2023-12-28 08:53:49,409][106225] Updated weights for policy 1, policy_version 1901150 (0.0009) [2023-12-28 08:53:49,796][106226] Updated weights for policy 0, policy_version 1897003 (0.0009) [2023-12-28 08:53:49,863][106226] Updated weights for policy 0, policy_version 1897013 (0.0008) [2023-12-28 08:53:49,937][106226] Updated weights for policy 0, policy_version 1897023 (0.0008) [2023-12-28 08:53:50,030][106225] Updated weights for policy 1, policy_version 1901160 (0.0007) [2023-12-28 08:53:50,085][106225] Updated weights for policy 1, policy_version 1901170 (0.0008) [2023-12-28 08:53:50,149][106225] Updated weights for policy 1, policy_version 1901180 (0.0007) [2023-12-28 08:53:50,721][106226] Updated weights for policy 0, policy_version 1897033 (0.0008) [2023-12-28 08:53:50,786][106226] Updated weights for policy 0, policy_version 1897043 (0.0009) [2023-12-28 08:53:50,826][106225] Updated weights for policy 1, policy_version 1901190 (0.0009) [2023-12-28 08:53:50,849][106226] Updated weights for policy 0, policy_version 1897053 (0.0009) [2023-12-28 08:53:50,886][106225] Updated weights for policy 1, policy_version 1901200 (0.0006) [2023-12-28 08:53:50,911][106226] Updated weights for policy 0, policy_version 1897063 (0.0011) [2023-12-28 08:53:50,943][106225] Updated weights for policy 1, policy_version 1901210 (0.0007) [2023-12-28 08:53:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 972496896. Throughput: 0: 9963.4, 1: 9848.9. Samples: 972502796. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:51,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.666')] [2023-12-28 08:53:51,617][106226] Updated weights for policy 0, policy_version 1897073 (0.0007) [2023-12-28 08:53:51,689][106226] Updated weights for policy 0, policy_version 1897083 (0.0008) [2023-12-28 08:53:51,722][106225] Updated weights for policy 1, policy_version 1901220 (0.0008) [2023-12-28 08:53:51,761][106226] Updated weights for policy 0, policy_version 1897093 (0.0009) [2023-12-28 08:53:51,796][106225] Updated weights for policy 1, policy_version 1901230 (0.0007) [2023-12-28 08:53:51,862][106225] Updated weights for policy 1, policy_version 1901240 (0.0006) [2023-12-28 08:53:52,473][106226] Updated weights for policy 0, policy_version 1897103 (0.0007) [2023-12-28 08:53:52,539][106226] Updated weights for policy 0, policy_version 1897113 (0.0009) [2023-12-28 08:53:52,602][106226] Updated weights for policy 0, policy_version 1897123 (0.0009) [2023-12-28 08:53:52,615][106225] Updated weights for policy 1, policy_version 1901250 (0.0007) [2023-12-28 08:53:52,672][106225] Updated weights for policy 1, policy_version 1901260 (0.0009) [2023-12-28 08:53:52,741][106225] Updated weights for policy 1, policy_version 1901271 (0.0009) [2023-12-28 08:53:53,319][106226] Updated weights for policy 0, policy_version 1897133 (0.0008) [2023-12-28 08:53:53,365][106226] Updated weights for policy 0, policy_version 1897143 (0.0010) [2023-12-28 08:53:53,424][106226] Updated weights for policy 0, policy_version 1897153 (0.0010) [2023-12-28 08:53:53,484][106225] Updated weights for policy 1, policy_version 1901281 (0.0008) [2023-12-28 08:53:53,549][106225] Updated weights for policy 1, policy_version 1901291 (0.0005) [2023-12-28 08:53:53,615][106225] Updated weights for policy 1, policy_version 1901301 (0.0005) [2023-12-28 08:53:53,673][106225] Updated weights for policy 1, policy_version 1901311 (0.0006) [2023-12-28 08:53:54,146][106226] Updated weights for policy 0, policy_version 1897163 (0.0011) [2023-12-28 08:53:54,205][106226] Updated weights for policy 0, policy_version 1897173 (0.0010) [2023-12-28 08:53:54,261][106226] Updated weights for policy 0, policy_version 1897183 (0.0010) [2023-12-28 08:53:54,271][106225] Updated weights for policy 1, policy_version 1901322 (0.0009) [2023-12-28 08:53:54,329][106225] Updated weights for policy 1, policy_version 1901332 (0.0006) [2023-12-28 08:53:54,390][106225] Updated weights for policy 1, policy_version 1901342 (0.0006) [2023-12-28 08:53:54,968][106226] Updated weights for policy 0, policy_version 1897193 (0.0010) [2023-12-28 08:53:54,999][106225] Updated weights for policy 1, policy_version 1901352 (0.0008) [2023-12-28 08:53:55,024][106226] Updated weights for policy 0, policy_version 1897203 (0.0011) [2023-12-28 08:53:55,059][106225] Updated weights for policy 1, policy_version 1901362 (0.0007) [2023-12-28 08:53:55,084][106226] Updated weights for policy 0, policy_version 1897213 (0.0011) [2023-12-28 08:53:55,109][106225] Updated weights for policy 1, policy_version 1901372 (0.0010) [2023-12-28 08:53:55,135][106226] Updated weights for policy 0, policy_version 1897223 (0.0010) [2023-12-28 08:53:55,788][106225] Updated weights for policy 1, policy_version 1901382 (0.0010) [2023-12-28 08:53:55,838][106225] Updated weights for policy 1, policy_version 1901392 (0.0010) [2023-12-28 08:53:55,848][106226] Updated weights for policy 0, policy_version 1897233 (0.0010) [2023-12-28 08:53:55,895][106225] Updated weights for policy 1, policy_version 1901402 (0.0010) [2023-12-28 08:53:55,898][106226] Updated weights for policy 0, policy_version 1897243 (0.0010) [2023-12-28 08:53:55,942][106226] Updated weights for policy 0, policy_version 1897253 (0.0008) [2023-12-28 08:53:56,174][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 972595200. Throughput: 0: 9919.6, 1: 9824.8. Samples: 972559760. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:53:56,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.485')] [2023-12-28 08:53:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001901408_486817792.pth... [2023-12-28 08:53:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001897256_485777408.pth... [2023-12-28 08:53:56,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001900256_486522880.pth [2023-12-28 08:53:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001896104_485482496.pth [2023-12-28 08:53:56,592][106225] Updated weights for policy 1, policy_version 1901412 (0.0010) [2023-12-28 08:53:56,647][106225] Updated weights for policy 1, policy_version 1901422 (0.0010) [2023-12-28 08:53:56,670][106226] Updated weights for policy 0, policy_version 1897263 (0.0010) [2023-12-28 08:53:56,697][106225] Updated weights for policy 1, policy_version 1901432 (0.0010) [2023-12-28 08:53:56,726][106226] Updated weights for policy 0, policy_version 1897273 (0.0010) [2023-12-28 08:53:56,782][106226] Updated weights for policy 0, policy_version 1897283 (0.0010) [2023-12-28 08:53:57,400][106225] Updated weights for policy 1, policy_version 1901442 (0.0009) [2023-12-28 08:53:57,422][106226] Updated weights for policy 0, policy_version 1897293 (0.0011) [2023-12-28 08:53:57,459][106225] Updated weights for policy 1, policy_version 1901452 (0.0005) [2023-12-28 08:53:57,481][106226] Updated weights for policy 0, policy_version 1897303 (0.0010) [2023-12-28 08:53:57,515][106225] Updated weights for policy 1, policy_version 1901462 (0.0005) [2023-12-28 08:53:57,547][106226] Updated weights for policy 0, policy_version 1897313 (0.0010) [2023-12-28 08:53:57,565][106225] Updated weights for policy 1, policy_version 1901472 (0.0005) [2023-12-28 08:53:58,063][106225] Updated weights for policy 1, policy_version 1901482 (0.0005) [2023-12-28 08:53:58,109][106225] Updated weights for policy 1, policy_version 1901492 (0.0005) [2023-12-28 08:53:58,152][106226] Updated weights for policy 0, policy_version 1897323 (0.0008) [2023-12-28 08:53:58,156][106225] Updated weights for policy 1, policy_version 1901502 (0.0005) [2023-12-28 08:53:58,206][106226] Updated weights for policy 0, policy_version 1897333 (0.0005) [2023-12-28 08:53:58,272][106226] Updated weights for policy 0, policy_version 1897343 (0.0010) [2023-12-28 08:53:58,890][106225] Updated weights for policy 1, policy_version 1901512 (0.0008) [2023-12-28 08:53:58,958][106225] Updated weights for policy 1, policy_version 1901522 (0.0007) [2023-12-28 08:53:59,024][106225] Updated weights for policy 1, policy_version 1901532 (0.0008) [2023-12-28 08:53:59,093][106226] Updated weights for policy 0, policy_version 1897353 (0.0008) [2023-12-28 08:53:59,158][106226] Updated weights for policy 0, policy_version 1897363 (0.0011) [2023-12-28 08:53:59,214][106226] Updated weights for policy 0, policy_version 1897373 (0.0009) [2023-12-28 08:53:59,292][106226] Updated weights for policy 0, policy_version 1897383 (0.0007) [2023-12-28 08:53:59,744][106225] Updated weights for policy 1, policy_version 1901542 (0.0010) [2023-12-28 08:53:59,799][106225] Updated weights for policy 1, policy_version 1901552 (0.0008) [2023-12-28 08:53:59,864][106225] Updated weights for policy 1, policy_version 1901562 (0.0009) [2023-12-28 08:54:00,002][106226] Updated weights for policy 0, policy_version 1897393 (0.0009) [2023-12-28 08:54:00,068][106226] Updated weights for policy 0, policy_version 1897403 (0.0009) [2023-12-28 08:54:00,136][106226] Updated weights for policy 0, policy_version 1897413 (0.0008) [2023-12-28 08:54:00,553][106225] Updated weights for policy 1, policy_version 1901572 (0.0007) [2023-12-28 08:54:00,608][106225] Updated weights for policy 1, policy_version 1901582 (0.0010) [2023-12-28 08:54:00,665][106225] Updated weights for policy 1, policy_version 1901592 (0.0010) [2023-12-28 08:54:00,901][106226] Updated weights for policy 0, policy_version 1897423 (0.0007) [2023-12-28 08:54:00,949][106226] Updated weights for policy 0, policy_version 1897433 (0.0007) [2023-12-28 08:54:00,996][106226] Updated weights for policy 0, policy_version 1897443 (0.0008) [2023-12-28 08:54:01,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 972693504. Throughput: 0: 9942.8, 1: 9914.0. Samples: 972681348. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:01,175][105115] Avg episode reward: [(0, '-4.139'), (1, '-4.584')] [2023-12-28 08:54:01,375][106225] Updated weights for policy 1, policy_version 1901602 (0.0010) [2023-12-28 08:54:01,436][106225] Updated weights for policy 1, policy_version 1901612 (0.0005) [2023-12-28 08:54:01,496][106225] Updated weights for policy 1, policy_version 1901622 (0.0007) [2023-12-28 08:54:01,553][106225] Updated weights for policy 1, policy_version 1901632 (0.0007) [2023-12-28 08:54:01,777][106226] Updated weights for policy 0, policy_version 1897453 (0.0009) [2023-12-28 08:54:01,832][106226] Updated weights for policy 0, policy_version 1897463 (0.0010) [2023-12-28 08:54:01,888][106226] Updated weights for policy 0, policy_version 1897473 (0.0008) [2023-12-28 08:54:02,191][106225] Updated weights for policy 1, policy_version 1901642 (0.0007) [2023-12-28 08:54:02,253][106225] Updated weights for policy 1, policy_version 1901652 (0.0009) [2023-12-28 08:54:02,318][106225] Updated weights for policy 1, policy_version 1901662 (0.0008) [2023-12-28 08:54:02,625][106226] Updated weights for policy 0, policy_version 1897483 (0.0007) [2023-12-28 08:54:02,680][106226] Updated weights for policy 0, policy_version 1897493 (0.0005) [2023-12-28 08:54:02,731][106226] Updated weights for policy 0, policy_version 1897503 (0.0005) [2023-12-28 08:54:03,090][106225] Updated weights for policy 1, policy_version 1901672 (0.0008) [2023-12-28 08:54:03,143][106225] Updated weights for policy 1, policy_version 1901682 (0.0009) [2023-12-28 08:54:03,196][106225] Updated weights for policy 1, policy_version 1901692 (0.0009) [2023-12-28 08:54:03,285][106226] Updated weights for policy 0, policy_version 1897513 (0.0007) [2023-12-28 08:54:03,345][106226] Updated weights for policy 0, policy_version 1897523 (0.0010) [2023-12-28 08:54:03,404][106226] Updated weights for policy 0, policy_version 1897533 (0.0010) [2023-12-28 08:54:03,463][106226] Updated weights for policy 0, policy_version 1897543 (0.0008) [2023-12-28 08:54:03,861][106225] Updated weights for policy 1, policy_version 1901702 (0.0008) [2023-12-28 08:54:03,915][106225] Updated weights for policy 1, policy_version 1901712 (0.0006) [2023-12-28 08:54:03,962][106225] Updated weights for policy 1, policy_version 1901722 (0.0007) [2023-12-28 08:54:04,172][106226] Updated weights for policy 0, policy_version 1897553 (0.0009) [2023-12-28 08:54:04,225][106226] Updated weights for policy 0, policy_version 1897563 (0.0009) [2023-12-28 08:54:04,280][106226] Updated weights for policy 0, policy_version 1897573 (0.0009) [2023-12-28 08:54:04,597][106225] Updated weights for policy 1, policy_version 1901732 (0.0006) [2023-12-28 08:54:04,658][106225] Updated weights for policy 1, policy_version 1901742 (0.0005) [2023-12-28 08:54:04,725][106225] Updated weights for policy 1, policy_version 1901752 (0.0006) [2023-12-28 08:54:05,020][106226] Updated weights for policy 0, policy_version 1897583 (0.0006) [2023-12-28 08:54:05,075][106226] Updated weights for policy 0, policy_version 1897593 (0.0010) [2023-12-28 08:54:05,131][106226] Updated weights for policy 0, policy_version 1897603 (0.0010) [2023-12-28 08:54:05,270][106225] Updated weights for policy 1, policy_version 1901762 (0.0006) [2023-12-28 08:54:05,340][106225] Updated weights for policy 1, policy_version 1901772 (0.0010) [2023-12-28 08:54:05,397][106225] Updated weights for policy 1, policy_version 1901782 (0.0009) [2023-12-28 08:54:05,460][106225] Updated weights for policy 1, policy_version 1901792 (0.0006) [2023-12-28 08:54:05,682][106226] Updated weights for policy 0, policy_version 1897613 (0.0009) [2023-12-28 08:54:05,733][106226] Updated weights for policy 0, policy_version 1897623 (0.0010) [2023-12-28 08:54:05,786][106226] Updated weights for policy 0, policy_version 1897633 (0.0010) [2023-12-28 08:54:06,090][106225] Updated weights for policy 1, policy_version 1901802 (0.0008) [2023-12-28 08:54:06,159][106225] Updated weights for policy 1, policy_version 1901812 (0.0008) [2023-12-28 08:54:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 972791808. Throughput: 0: 9957.4, 1: 9995.7. Samples: 972804196. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:06,175][105115] Avg episode reward: [(0, '-4.269'), (1, '-4.512')] [2023-12-28 08:54:06,220][106225] Updated weights for policy 1, policy_version 1901822 (0.0008) [2023-12-28 08:54:06,466][106226] Updated weights for policy 0, policy_version 1897643 (0.0009) [2023-12-28 08:54:06,523][106226] Updated weights for policy 0, policy_version 1897653 (0.0009) [2023-12-28 08:54:06,580][106226] Updated weights for policy 0, policy_version 1897663 (0.0009) [2023-12-28 08:54:06,962][106225] Updated weights for policy 1, policy_version 1901832 (0.0009) [2023-12-28 08:54:07,020][106225] Updated weights for policy 1, policy_version 1901842 (0.0008) [2023-12-28 08:54:07,075][106225] Updated weights for policy 1, policy_version 1901852 (0.0008) [2023-12-28 08:54:07,411][106226] Updated weights for policy 0, policy_version 1897673 (0.0009) [2023-12-28 08:54:07,464][106226] Updated weights for policy 0, policy_version 1897683 (0.0008) [2023-12-28 08:54:07,518][106226] Updated weights for policy 0, policy_version 1897693 (0.0009) [2023-12-28 08:54:07,574][106226] Updated weights for policy 0, policy_version 1897703 (0.0009) [2023-12-28 08:54:07,699][106225] Updated weights for policy 1, policy_version 1901862 (0.0007) [2023-12-28 08:54:07,759][106225] Updated weights for policy 1, policy_version 1901872 (0.0007) [2023-12-28 08:54:07,821][106225] Updated weights for policy 1, policy_version 1901882 (0.0008) [2023-12-28 08:54:08,331][106226] Updated weights for policy 0, policy_version 1897713 (0.0007) [2023-12-28 08:54:08,393][106226] Updated weights for policy 0, policy_version 1897723 (0.0009) [2023-12-28 08:54:08,452][106226] Updated weights for policy 0, policy_version 1897733 (0.0010) [2023-12-28 08:54:08,543][106225] Updated weights for policy 1, policy_version 1901892 (0.0007) [2023-12-28 08:54:08,599][106225] Updated weights for policy 1, policy_version 1901902 (0.0008) [2023-12-28 08:54:08,648][106225] Updated weights for policy 1, policy_version 1901912 (0.0008) [2023-12-28 08:54:09,094][106226] Updated weights for policy 0, policy_version 1897743 (0.0007) [2023-12-28 08:54:09,152][106226] Updated weights for policy 0, policy_version 1897753 (0.0006) [2023-12-28 08:54:09,208][106226] Updated weights for policy 0, policy_version 1897763 (0.0009) [2023-12-28 08:54:09,358][106225] Updated weights for policy 1, policy_version 1901922 (0.0010) [2023-12-28 08:54:09,426][106225] Updated weights for policy 1, policy_version 1901932 (0.0007) [2023-12-28 08:54:09,489][106225] Updated weights for policy 1, policy_version 1901942 (0.0009) [2023-12-28 08:54:09,561][106225] Updated weights for policy 1, policy_version 1901952 (0.0009) [2023-12-28 08:54:09,930][106226] Updated weights for policy 0, policy_version 1897773 (0.0008) [2023-12-28 08:54:09,996][106226] Updated weights for policy 0, policy_version 1897783 (0.0008) [2023-12-28 08:54:10,061][106226] Updated weights for policy 0, policy_version 1897793 (0.0007) [2023-12-28 08:54:10,318][106225] Updated weights for policy 1, policy_version 1901962 (0.0008) [2023-12-28 08:54:10,378][106225] Updated weights for policy 1, policy_version 1901972 (0.0009) [2023-12-28 08:54:10,439][106225] Updated weights for policy 1, policy_version 1901982 (0.0009) [2023-12-28 08:54:10,810][106226] Updated weights for policy 0, policy_version 1897803 (0.0008) [2023-12-28 08:54:10,873][106226] Updated weights for policy 0, policy_version 1897813 (0.0009) [2023-12-28 08:54:10,931][106226] Updated weights for policy 0, policy_version 1897823 (0.0008) [2023-12-28 08:54:11,021][106225] Updated weights for policy 1, policy_version 1901992 (0.0008) [2023-12-28 08:54:11,106][106225] Updated weights for policy 1, policy_version 1902002 (0.0008) [2023-12-28 08:54:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 972890112. Throughput: 0: 9926.1, 1: 10043.4. Samples: 972862724. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:11,175][105115] Avg episode reward: [(0, '-4.501'), (1, '-4.513')] [2023-12-28 08:54:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001897832_485924864.pth... [2023-12-28 08:54:11,183][106225] Updated weights for policy 1, policy_version 1902012 (0.0008) [2023-12-28 08:54:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001896680_485629952.pth [2023-12-28 08:54:11,207][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001902016_486973440.pth... [2023-12-28 08:54:11,211][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001900832_486670336.pth [2023-12-28 08:54:11,733][106226] Updated weights for policy 0, policy_version 1897833 (0.0006) [2023-12-28 08:54:11,791][106226] Updated weights for policy 0, policy_version 1897843 (0.0009) [2023-12-28 08:54:11,839][106226] Updated weights for policy 0, policy_version 1897853 (0.0009) [2023-12-28 08:54:11,898][106226] Updated weights for policy 0, policy_version 1897863 (0.0010) [2023-12-28 08:54:11,920][106225] Updated weights for policy 1, policy_version 1902022 (0.0006) [2023-12-28 08:54:11,976][106225] Updated weights for policy 1, policy_version 1902032 (0.0006) [2023-12-28 08:54:12,032][106225] Updated weights for policy 1, policy_version 1902042 (0.0007) [2023-12-28 08:54:12,644][106226] Updated weights for policy 0, policy_version 1897873 (0.0009) [2023-12-28 08:54:12,703][106226] Updated weights for policy 0, policy_version 1897883 (0.0010) [2023-12-28 08:54:12,738][106225] Updated weights for policy 1, policy_version 1902052 (0.0007) [2023-12-28 08:54:12,761][106226] Updated weights for policy 0, policy_version 1897893 (0.0009) [2023-12-28 08:54:12,789][106225] Updated weights for policy 1, policy_version 1902062 (0.0007) [2023-12-28 08:54:12,839][106225] Updated weights for policy 1, policy_version 1902072 (0.0008) [2023-12-28 08:54:13,500][106225] Updated weights for policy 1, policy_version 1902082 (0.0008) [2023-12-28 08:54:13,535][106226] Updated weights for policy 0, policy_version 1897903 (0.0007) [2023-12-28 08:54:13,556][106225] Updated weights for policy 1, policy_version 1902092 (0.0007) [2023-12-28 08:54:13,592][106226] Updated weights for policy 0, policy_version 1897913 (0.0008) [2023-12-28 08:54:13,617][106225] Updated weights for policy 1, policy_version 1902102 (0.0006) [2023-12-28 08:54:13,652][106226] Updated weights for policy 0, policy_version 1897923 (0.0008) [2023-12-28 08:54:13,678][106225] Updated weights for policy 1, policy_version 1902112 (0.0005) [2023-12-28 08:54:14,333][106226] Updated weights for policy 0, policy_version 1897933 (0.0007) [2023-12-28 08:54:14,363][106225] Updated weights for policy 1, policy_version 1902122 (0.0008) [2023-12-28 08:54:14,395][106226] Updated weights for policy 0, policy_version 1897943 (0.0009) [2023-12-28 08:54:14,423][106225] Updated weights for policy 1, policy_version 1902132 (0.0008) [2023-12-28 08:54:14,452][106226] Updated weights for policy 0, policy_version 1897953 (0.0011) [2023-12-28 08:54:14,472][106225] Updated weights for policy 1, policy_version 1902142 (0.0007) [2023-12-28 08:54:15,180][106226] Updated weights for policy 0, policy_version 1897963 (0.0011) [2023-12-28 08:54:15,216][106225] Updated weights for policy 1, policy_version 1902152 (0.0008) [2023-12-28 08:54:15,250][106226] Updated weights for policy 0, policy_version 1897973 (0.0011) [2023-12-28 08:54:15,284][106225] Updated weights for policy 1, policy_version 1902162 (0.0006) [2023-12-28 08:54:15,313][106226] Updated weights for policy 0, policy_version 1897983 (0.0011) [2023-12-28 08:54:15,351][106225] Updated weights for policy 1, policy_version 1902172 (0.0007) [2023-12-28 08:54:16,026][106226] Updated weights for policy 0, policy_version 1897993 (0.0011) [2023-12-28 08:54:16,082][106225] Updated weights for policy 1, policy_version 1902182 (0.0007) [2023-12-28 08:54:16,083][106226] Updated weights for policy 0, policy_version 1898003 (0.0010) [2023-12-28 08:54:16,128][106225] Updated weights for policy 1, policy_version 1902192 (0.0007) [2023-12-28 08:54:16,138][106226] Updated weights for policy 0, policy_version 1898013 (0.0011) [2023-12-28 08:54:16,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.9, 300 sec: 19744.1). Total num frames: 972980224. Throughput: 0: 9772.5, 1: 9977.1. Samples: 972979160. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:16,175][106225] Updated weights for policy 1, policy_version 1902202 (0.0005) [2023-12-28 08:54:16,175][105115] Avg episode reward: [(0, '-4.425'), (1, '-4.084')] [2023-12-28 08:54:16,186][106226] Updated weights for policy 0, policy_version 1898023 (0.0011) [2023-12-28 08:54:16,202][106141] Saving new best policy, reward=-4.084! [2023-12-28 08:54:16,916][106226] Updated weights for policy 0, policy_version 1898033 (0.0011) [2023-12-28 08:54:16,941][106225] Updated weights for policy 1, policy_version 1902212 (0.0006) [2023-12-28 08:54:16,972][106226] Updated weights for policy 0, policy_version 1898043 (0.0010) [2023-12-28 08:54:16,989][106225] Updated weights for policy 1, policy_version 1902222 (0.0007) [2023-12-28 08:54:17,018][106226] Updated weights for policy 0, policy_version 1898053 (0.0010) [2023-12-28 08:54:17,040][106225] Updated weights for policy 1, policy_version 1902232 (0.0005) [2023-12-28 08:54:17,630][106226] Updated weights for policy 0, policy_version 1898063 (0.0007) [2023-12-28 08:54:17,681][106226] Updated weights for policy 0, policy_version 1898073 (0.0005) [2023-12-28 08:54:17,734][106226] Updated weights for policy 0, policy_version 1898083 (0.0009) [2023-12-28 08:54:17,858][106225] Updated weights for policy 1, policy_version 1902242 (0.0007) [2023-12-28 08:54:17,908][106225] Updated weights for policy 1, policy_version 1902252 (0.0005) [2023-12-28 08:54:17,963][106225] Updated weights for policy 1, policy_version 1902262 (0.0009) [2023-12-28 08:54:18,015][106225] Updated weights for policy 1, policy_version 1902272 (0.0008) [2023-12-28 08:54:18,325][106226] Updated weights for policy 0, policy_version 1898093 (0.0009) [2023-12-28 08:54:18,394][106226] Updated weights for policy 0, policy_version 1898103 (0.0011) [2023-12-28 08:54:18,461][106226] Updated weights for policy 0, policy_version 1898113 (0.0011) [2023-12-28 08:54:18,708][106225] Updated weights for policy 1, policy_version 1902282 (0.0008) [2023-12-28 08:54:18,759][106225] Updated weights for policy 1, policy_version 1902292 (0.0008) [2023-12-28 08:54:18,810][106225] Updated weights for policy 1, policy_version 1902302 (0.0007) [2023-12-28 08:54:19,141][106226] Updated weights for policy 0, policy_version 1898123 (0.0011) [2023-12-28 08:54:19,201][106226] Updated weights for policy 0, policy_version 1898133 (0.0011) [2023-12-28 08:54:19,266][106226] Updated weights for policy 0, policy_version 1898143 (0.0009) [2023-12-28 08:54:19,465][106225] Updated weights for policy 1, policy_version 1902312 (0.0006) [2023-12-28 08:54:19,533][106225] Updated weights for policy 1, policy_version 1902322 (0.0007) [2023-12-28 08:54:19,589][106225] Updated weights for policy 1, policy_version 1902332 (0.0005) [2023-12-28 08:54:20,074][106226] Updated weights for policy 0, policy_version 1898153 (0.0008) [2023-12-28 08:54:20,128][106226] Updated weights for policy 0, policy_version 1898163 (0.0008) [2023-12-28 08:54:20,185][106226] Updated weights for policy 0, policy_version 1898173 (0.0007) [2023-12-28 08:54:20,233][106225] Updated weights for policy 1, policy_version 1902342 (0.0007) [2023-12-28 08:54:20,246][106226] Updated weights for policy 0, policy_version 1898183 (0.0008) [2023-12-28 08:54:20,297][106225] Updated weights for policy 1, policy_version 1902352 (0.0008) [2023-12-28 08:54:20,360][106225] Updated weights for policy 1, policy_version 1902362 (0.0008) [2023-12-28 08:54:20,976][106226] Updated weights for policy 0, policy_version 1898193 (0.0006) [2023-12-28 08:54:21,044][106226] Updated weights for policy 0, policy_version 1898203 (0.0006) [2023-12-28 08:54:21,108][106226] Updated weights for policy 0, policy_version 1898213 (0.0008) [2023-12-28 08:54:21,168][106225] Updated weights for policy 1, policy_version 1902372 (0.0009) [2023-12-28 08:54:21,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 973086720. Throughput: 0: 9821.8, 1: 9919.5. Samples: 973096004. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:21,175][105115] Avg episode reward: [(0, '-4.079'), (1, '-4.727')] [2023-12-28 08:54:21,231][106225] Updated weights for policy 1, policy_version 1902382 (0.0008) [2023-12-28 08:54:21,297][106225] Updated weights for policy 1, policy_version 1902392 (0.0006) [2023-12-28 08:54:21,814][106226] Updated weights for policy 0, policy_version 1898223 (0.0009) [2023-12-28 08:54:21,866][106226] Updated weights for policy 0, policy_version 1898233 (0.0008) [2023-12-28 08:54:21,915][106226] Updated weights for policy 0, policy_version 1898243 (0.0008) [2023-12-28 08:54:22,042][106225] Updated weights for policy 1, policy_version 1902402 (0.0007) [2023-12-28 08:54:22,100][106225] Updated weights for policy 1, policy_version 1902412 (0.0008) [2023-12-28 08:54:22,157][106225] Updated weights for policy 1, policy_version 1902422 (0.0007) [2023-12-28 08:54:22,218][106225] Updated weights for policy 1, policy_version 1902432 (0.0008) [2023-12-28 08:54:22,731][106226] Updated weights for policy 0, policy_version 1898253 (0.0009) [2023-12-28 08:54:22,794][106226] Updated weights for policy 0, policy_version 1898263 (0.0011) [2023-12-28 08:54:22,860][106226] Updated weights for policy 0, policy_version 1898273 (0.0011) [2023-12-28 08:54:22,992][106225] Updated weights for policy 1, policy_version 1902442 (0.0008) [2023-12-28 08:54:23,057][106225] Updated weights for policy 1, policy_version 1902452 (0.0008) [2023-12-28 08:54:23,127][106225] Updated weights for policy 1, policy_version 1902462 (0.0008) [2023-12-28 08:54:23,597][106226] Updated weights for policy 0, policy_version 1898283 (0.0011) [2023-12-28 08:54:23,661][106226] Updated weights for policy 0, policy_version 1898293 (0.0010) [2023-12-28 08:54:23,727][106226] Updated weights for policy 0, policy_version 1898303 (0.0011) [2023-12-28 08:54:23,872][106225] Updated weights for policy 1, policy_version 1902472 (0.0008) [2023-12-28 08:54:23,928][106225] Updated weights for policy 1, policy_version 1902482 (0.0007) [2023-12-28 08:54:23,993][106225] Updated weights for policy 1, policy_version 1902492 (0.0008) [2023-12-28 08:54:24,457][106226] Updated weights for policy 0, policy_version 1898313 (0.0011) [2023-12-28 08:54:24,514][106226] Updated weights for policy 0, policy_version 1898323 (0.0010) [2023-12-28 08:54:24,573][106226] Updated weights for policy 0, policy_version 1898333 (0.0010) [2023-12-28 08:54:24,629][106226] Updated weights for policy 0, policy_version 1898343 (0.0010) [2023-12-28 08:54:24,744][106225] Updated weights for policy 1, policy_version 1902502 (0.0008) [2023-12-28 08:54:24,798][106225] Updated weights for policy 1, policy_version 1902512 (0.0008) [2023-12-28 08:54:24,844][106225] Updated weights for policy 1, policy_version 1902522 (0.0007) [2023-12-28 08:54:25,290][106226] Updated weights for policy 0, policy_version 1898353 (0.0010) [2023-12-28 08:54:25,346][106226] Updated weights for policy 0, policy_version 1898363 (0.0010) [2023-12-28 08:54:25,403][106226] Updated weights for policy 0, policy_version 1898373 (0.0011) [2023-12-28 08:54:25,590][106225] Updated weights for policy 1, policy_version 1902532 (0.0007) [2023-12-28 08:54:25,645][106225] Updated weights for policy 1, policy_version 1902542 (0.0005) [2023-12-28 08:54:25,710][106225] Updated weights for policy 1, policy_version 1902552 (0.0007) [2023-12-28 08:54:26,107][106226] Updated weights for policy 0, policy_version 1898383 (0.0010) [2023-12-28 08:54:26,155][106226] Updated weights for policy 0, policy_version 1898393 (0.0010) [2023-12-28 08:54:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 973176832. Throughput: 0: 9797.6, 1: 9908.5. Samples: 973150492. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:26,175][105115] Avg episode reward: [(0, '-4.277'), (1, '-4.556')] [2023-12-28 08:54:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001902560_487112704.pth... [2023-12-28 08:54:26,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001901408_486817792.pth [2023-12-28 08:54:26,209][106226] Updated weights for policy 0, policy_version 1898403 (0.0011) [2023-12-28 08:54:26,235][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001898408_486072320.pth... [2023-12-28 08:54:26,239][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001897256_485777408.pth [2023-12-28 08:54:26,331][106225] Updated weights for policy 1, policy_version 1902562 (0.0009) [2023-12-28 08:54:26,390][106225] Updated weights for policy 1, policy_version 1902572 (0.0010) [2023-12-28 08:54:26,454][106225] Updated weights for policy 1, policy_version 1902582 (0.0010) [2023-12-28 08:54:26,507][106225] Updated weights for policy 1, policy_version 1902592 (0.0010) [2023-12-28 08:54:26,867][106226] Updated weights for policy 0, policy_version 1898413 (0.0010) [2023-12-28 08:54:26,923][106226] Updated weights for policy 0, policy_version 1898423 (0.0010) [2023-12-28 08:54:26,982][106226] Updated weights for policy 0, policy_version 1898433 (0.0010) [2023-12-28 08:54:27,168][106225] Updated weights for policy 1, policy_version 1902602 (0.0008) [2023-12-28 08:54:27,215][106225] Updated weights for policy 1, policy_version 1902612 (0.0010) [2023-12-28 08:54:27,267][106225] Updated weights for policy 1, policy_version 1902622 (0.0010) [2023-12-28 08:54:27,644][106226] Updated weights for policy 0, policy_version 1898443 (0.0009) [2023-12-28 08:54:27,697][106226] Updated weights for policy 0, policy_version 1898453 (0.0005) [2023-12-28 08:54:27,747][106226] Updated weights for policy 0, policy_version 1898463 (0.0005) [2023-12-28 08:54:27,963][106225] Updated weights for policy 1, policy_version 1902632 (0.0006) [2023-12-28 08:54:28,028][106225] Updated weights for policy 1, policy_version 1902642 (0.0006) [2023-12-28 08:54:28,091][106225] Updated weights for policy 1, policy_version 1902652 (0.0006) [2023-12-28 08:54:28,322][106226] Updated weights for policy 0, policy_version 1898473 (0.0005) [2023-12-28 08:54:28,392][106226] Updated weights for policy 0, policy_version 1898483 (0.0007) [2023-12-28 08:54:28,459][106226] Updated weights for policy 0, policy_version 1898493 (0.0005) [2023-12-28 08:54:28,526][106226] Updated weights for policy 0, policy_version 1898503 (0.0006) [2023-12-28 08:54:28,714][106225] Updated weights for policy 1, policy_version 1902662 (0.0010) [2023-12-28 08:54:28,773][106225] Updated weights for policy 1, policy_version 1902672 (0.0010) [2023-12-28 08:54:28,834][106225] Updated weights for policy 1, policy_version 1902682 (0.0010) [2023-12-28 08:54:29,143][106226] Updated weights for policy 0, policy_version 1898513 (0.0005) [2023-12-28 08:54:29,194][106226] Updated weights for policy 0, policy_version 1898523 (0.0005) [2023-12-28 08:54:29,266][106226] Updated weights for policy 0, policy_version 1898533 (0.0008) [2023-12-28 08:54:29,502][106225] Updated weights for policy 1, policy_version 1902692 (0.0008) [2023-12-28 08:54:29,556][106225] Updated weights for policy 1, policy_version 1902702 (0.0005) [2023-12-28 08:54:29,608][106225] Updated weights for policy 1, policy_version 1902712 (0.0006) [2023-12-28 08:54:29,946][106226] Updated weights for policy 0, policy_version 1898543 (0.0008) [2023-12-28 08:54:30,005][106226] Updated weights for policy 0, policy_version 1898553 (0.0006) [2023-12-28 08:54:30,067][106226] Updated weights for policy 0, policy_version 1898563 (0.0006) [2023-12-28 08:54:30,292][106225] Updated weights for policy 1, policy_version 1902722 (0.0008) [2023-12-28 08:54:30,353][106225] Updated weights for policy 1, policy_version 1902732 (0.0005) [2023-12-28 08:54:30,417][106225] Updated weights for policy 1, policy_version 1902742 (0.0006) [2023-12-28 08:54:30,488][106225] Updated weights for policy 1, policy_version 1902752 (0.0005) [2023-12-28 08:54:30,613][106226] Updated weights for policy 0, policy_version 1898573 (0.0007) [2023-12-28 08:54:30,676][106226] Updated weights for policy 0, policy_version 1898583 (0.0005) [2023-12-28 08:54:30,737][106226] Updated weights for policy 0, policy_version 1898593 (0.0005) [2023-12-28 08:54:31,116][106225] Updated weights for policy 1, policy_version 1902762 (0.0009) [2023-12-28 08:54:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 973283328. Throughput: 0: 9895.4, 1: 10017.0. Samples: 973274124. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:31,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.308')] [2023-12-28 08:54:31,190][106225] Updated weights for policy 1, policy_version 1902772 (0.0008) [2023-12-28 08:54:31,255][106225] Updated weights for policy 1, policy_version 1902782 (0.0008) [2023-12-28 08:54:31,416][106226] Updated weights for policy 0, policy_version 1898603 (0.0008) [2023-12-28 08:54:31,479][106226] Updated weights for policy 0, policy_version 1898613 (0.0008) [2023-12-28 08:54:31,546][106226] Updated weights for policy 0, policy_version 1898623 (0.0009) [2023-12-28 08:54:31,963][106225] Updated weights for policy 1, policy_version 1902792 (0.0009) [2023-12-28 08:54:32,024][106225] Updated weights for policy 1, policy_version 1902802 (0.0008) [2023-12-28 08:54:32,083][106225] Updated weights for policy 1, policy_version 1902812 (0.0008) [2023-12-28 08:54:32,193][106226] Updated weights for policy 0, policy_version 1898633 (0.0007) [2023-12-28 08:54:32,256][106226] Updated weights for policy 0, policy_version 1898643 (0.0008) [2023-12-28 08:54:32,313][106226] Updated weights for policy 0, policy_version 1898653 (0.0008) [2023-12-28 08:54:32,370][106226] Updated weights for policy 0, policy_version 1898663 (0.0009) [2023-12-28 08:54:32,813][106225] Updated weights for policy 1, policy_version 1902822 (0.0008) [2023-12-28 08:54:32,867][106225] Updated weights for policy 1, policy_version 1902832 (0.0008) [2023-12-28 08:54:32,917][106225] Updated weights for policy 1, policy_version 1902842 (0.0007) [2023-12-28 08:54:33,087][106226] Updated weights for policy 0, policy_version 1898673 (0.0009) [2023-12-28 08:54:33,144][106226] Updated weights for policy 0, policy_version 1898683 (0.0008) [2023-12-28 08:54:33,199][106226] Updated weights for policy 0, policy_version 1898693 (0.0010) [2023-12-28 08:54:33,557][106225] Updated weights for policy 1, policy_version 1902852 (0.0007) [2023-12-28 08:54:33,612][106225] Updated weights for policy 1, policy_version 1902862 (0.0005) [2023-12-28 08:54:33,672][106225] Updated weights for policy 1, policy_version 1902872 (0.0005) [2023-12-28 08:54:33,903][106226] Updated weights for policy 0, policy_version 1898703 (0.0007) [2023-12-28 08:54:33,960][106226] Updated weights for policy 0, policy_version 1898713 (0.0005) [2023-12-28 08:54:34,023][106226] Updated weights for policy 0, policy_version 1898723 (0.0009) [2023-12-28 08:54:34,219][106225] Updated weights for policy 1, policy_version 1902882 (0.0006) [2023-12-28 08:54:34,286][106225] Updated weights for policy 1, policy_version 1902892 (0.0009) [2023-12-28 08:54:34,353][106225] Updated weights for policy 1, policy_version 1902902 (0.0006) [2023-12-28 08:54:34,419][106225] Updated weights for policy 1, policy_version 1902912 (0.0007) [2023-12-28 08:54:34,667][106226] Updated weights for policy 0, policy_version 1898733 (0.0007) [2023-12-28 08:54:34,729][106226] Updated weights for policy 0, policy_version 1898743 (0.0007) [2023-12-28 08:54:34,796][106226] Updated weights for policy 0, policy_version 1898753 (0.0005) [2023-12-28 08:54:35,079][106225] Updated weights for policy 1, policy_version 1902922 (0.0010) [2023-12-28 08:54:35,125][106225] Updated weights for policy 1, policy_version 1902932 (0.0010) [2023-12-28 08:54:35,168][106225] Updated weights for policy 1, policy_version 1902942 (0.0010) [2023-12-28 08:54:35,415][106226] Updated weights for policy 0, policy_version 1898763 (0.0008) [2023-12-28 08:54:35,465][106226] Updated weights for policy 0, policy_version 1898773 (0.0010) [2023-12-28 08:54:35,527][106226] Updated weights for policy 0, policy_version 1898783 (0.0007) [2023-12-28 08:54:35,842][106225] Updated weights for policy 1, policy_version 1902952 (0.0009) [2023-12-28 08:54:35,899][106225] Updated weights for policy 1, policy_version 1902962 (0.0008) [2023-12-28 08:54:35,957][106225] Updated weights for policy 1, policy_version 1902972 (0.0008) [2023-12-28 08:54:36,116][106226] Updated weights for policy 0, policy_version 1898793 (0.0006) [2023-12-28 08:54:36,174][105115] Fps is (10 sec: 21299.2, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 973389824. Throughput: 0: 9921.6, 1: 10007.5. Samples: 973399604. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:36,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.707')] [2023-12-28 08:54:36,184][106226] Updated weights for policy 0, policy_version 1898803 (0.0009) [2023-12-28 08:54:36,246][106226] Updated weights for policy 0, policy_version 1898813 (0.0010) [2023-12-28 08:54:36,309][106226] Updated weights for policy 0, policy_version 1898823 (0.0007) [2023-12-28 08:54:36,660][106225] Updated weights for policy 1, policy_version 1902982 (0.0009) [2023-12-28 08:54:36,714][106225] Updated weights for policy 1, policy_version 1902992 (0.0007) [2023-12-28 08:54:36,777][106225] Updated weights for policy 1, policy_version 1903002 (0.0008) [2023-12-28 08:54:36,932][106226] Updated weights for policy 0, policy_version 1898833 (0.0009) [2023-12-28 08:54:37,000][106226] Updated weights for policy 0, policy_version 1898843 (0.0007) [2023-12-28 08:54:37,061][106226] Updated weights for policy 0, policy_version 1898853 (0.0010) [2023-12-28 08:54:37,510][106225] Updated weights for policy 1, policy_version 1903012 (0.0006) [2023-12-28 08:54:37,561][106225] Updated weights for policy 1, policy_version 1903022 (0.0005) [2023-12-28 08:54:37,607][106225] Updated weights for policy 1, policy_version 1903032 (0.0007) [2023-12-28 08:54:37,753][106226] Updated weights for policy 0, policy_version 1898863 (0.0010) [2023-12-28 08:54:37,803][106226] Updated weights for policy 0, policy_version 1898873 (0.0010) [2023-12-28 08:54:37,854][106226] Updated weights for policy 0, policy_version 1898883 (0.0010) [2023-12-28 08:54:38,341][106225] Updated weights for policy 1, policy_version 1903042 (0.0008) [2023-12-28 08:54:38,408][106225] Updated weights for policy 1, policy_version 1903052 (0.0007) [2023-12-28 08:54:38,474][106225] Updated weights for policy 1, policy_version 1903062 (0.0007) [2023-12-28 08:54:38,538][106225] Updated weights for policy 1, policy_version 1903072 (0.0007) [2023-12-28 08:54:38,547][106226] Updated weights for policy 0, policy_version 1898893 (0.0011) [2023-12-28 08:54:38,613][106226] Updated weights for policy 0, policy_version 1898903 (0.0009) [2023-12-28 08:54:38,670][106226] Updated weights for policy 0, policy_version 1898913 (0.0006) [2023-12-28 08:54:39,199][106225] Updated weights for policy 1, policy_version 1903082 (0.0010) [2023-12-28 08:54:39,266][106225] Updated weights for policy 1, policy_version 1903092 (0.0010) [2023-12-28 08:54:39,325][106225] Updated weights for policy 1, policy_version 1903102 (0.0009) [2023-12-28 08:54:39,368][106226] Updated weights for policy 0, policy_version 1898923 (0.0009) [2023-12-28 08:54:39,439][106226] Updated weights for policy 0, policy_version 1898933 (0.0008) [2023-12-28 08:54:39,494][106226] Updated weights for policy 0, policy_version 1898943 (0.0008) [2023-12-28 08:54:40,088][106225] Updated weights for policy 1, policy_version 1903112 (0.0008) [2023-12-28 08:54:40,137][106225] Updated weights for policy 1, policy_version 1903122 (0.0008) [2023-12-28 08:54:40,188][106225] Updated weights for policy 1, policy_version 1903132 (0.0008) [2023-12-28 08:54:40,278][106226] Updated weights for policy 0, policy_version 1898953 (0.0009) [2023-12-28 08:54:40,344][106226] Updated weights for policy 0, policy_version 1898963 (0.0009) [2023-12-28 08:54:40,409][106226] Updated weights for policy 0, policy_version 1898973 (0.0008) [2023-12-28 08:54:40,473][106226] Updated weights for policy 0, policy_version 1898983 (0.0009) [2023-12-28 08:54:40,841][106225] Updated weights for policy 1, policy_version 1903142 (0.0005) [2023-12-28 08:54:40,899][106225] Updated weights for policy 1, policy_version 1903152 (0.0006) [2023-12-28 08:54:40,962][106225] Updated weights for policy 1, policy_version 1903162 (0.0005) [2023-12-28 08:54:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 973488128. Throughput: 0: 9957.9, 1: 10031.5. Samples: 973459288. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-28 08:54:41,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.536')] [2023-12-28 08:54:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001903168_487268352.pth... [2023-12-28 08:54:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001898984_486219776.pth... [2023-12-28 08:54:41,183][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001902016_486973440.pth [2023-12-28 08:54:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001897832_485924864.pth [2023-12-28 08:54:41,292][106226] Updated weights for policy 0, policy_version 1898993 (0.0008) [2023-12-28 08:54:41,357][106226] Updated weights for policy 0, policy_version 1899003 (0.0008) [2023-12-28 08:54:41,430][106226] Updated weights for policy 0, policy_version 1899013 (0.0011) [2023-12-28 08:54:41,670][106225] Updated weights for policy 1, policy_version 1903172 (0.0007) [2023-12-28 08:54:41,735][106225] Updated weights for policy 1, policy_version 1903182 (0.0008) [2023-12-28 08:54:41,799][106225] Updated weights for policy 1, policy_version 1903192 (0.0006) [2023-12-28 08:54:42,254][106226] Updated weights for policy 0, policy_version 1899023 (0.0009) [2023-12-28 08:54:42,316][106226] Updated weights for policy 0, policy_version 1899033 (0.0010) [2023-12-28 08:54:42,396][106226] Updated weights for policy 0, policy_version 1899043 (0.0008) [2023-12-28 08:54:42,586][106225] Updated weights for policy 1, policy_version 1903202 (0.0008) [2023-12-28 08:54:42,649][106225] Updated weights for policy 1, policy_version 1903212 (0.0007) [2023-12-28 08:54:42,703][106225] Updated weights for policy 1, policy_version 1903222 (0.0005) [2023-12-28 08:54:42,766][106225] Updated weights for policy 1, policy_version 1903232 (0.0010) [2023-12-28 08:54:43,161][106226] Updated weights for policy 0, policy_version 1899053 (0.0010) [2023-12-28 08:54:43,220][106226] Updated weights for policy 0, policy_version 1899063 (0.0010) [2023-12-28 08:54:43,270][106226] Updated weights for policy 0, policy_version 1899073 (0.0010) [2023-12-28 08:54:43,417][106225] Updated weights for policy 1, policy_version 1903242 (0.0005) [2023-12-28 08:54:43,471][106225] Updated weights for policy 1, policy_version 1903252 (0.0005) [2023-12-28 08:54:43,523][106225] Updated weights for policy 1, policy_version 1903262 (0.0006) [2023-12-28 08:54:43,957][106226] Updated weights for policy 0, policy_version 1899083 (0.0011) [2023-12-28 08:54:44,007][106226] Updated weights for policy 0, policy_version 1899093 (0.0010) [2023-12-28 08:54:44,062][106226] Updated weights for policy 0, policy_version 1899103 (0.0010) [2023-12-28 08:54:44,155][106225] Updated weights for policy 1, policy_version 1903272 (0.0006) [2023-12-28 08:54:44,222][106225] Updated weights for policy 1, policy_version 1903282 (0.0005) [2023-12-28 08:54:44,279][106225] Updated weights for policy 1, policy_version 1903292 (0.0005) [2023-12-28 08:54:44,734][106226] Updated weights for policy 0, policy_version 1899113 (0.0010) [2023-12-28 08:54:44,807][106226] Updated weights for policy 0, policy_version 1899123 (0.0008) [2023-12-28 08:54:44,838][106225] Updated weights for policy 1, policy_version 1903302 (0.0006) [2023-12-28 08:54:44,867][106226] Updated weights for policy 0, policy_version 1899133 (0.0008) [2023-12-28 08:54:44,892][106225] Updated weights for policy 1, policy_version 1903312 (0.0006) [2023-12-28 08:54:44,934][106226] Updated weights for policy 0, policy_version 1899143 (0.0008) [2023-12-28 08:54:44,940][106225] Updated weights for policy 1, policy_version 1903322 (0.0006) [2023-12-28 08:54:45,638][106226] Updated weights for policy 0, policy_version 1899153 (0.0006) [2023-12-28 08:54:45,692][106226] Updated weights for policy 0, policy_version 1899163 (0.0005) [2023-12-28 08:54:45,718][106225] Updated weights for policy 1, policy_version 1903332 (0.0008) [2023-12-28 08:54:45,748][106226] Updated weights for policy 0, policy_version 1899173 (0.0005) [2023-12-28 08:54:45,768][106225] Updated weights for policy 1, policy_version 1903342 (0.0008) [2023-12-28 08:54:45,820][106225] Updated weights for policy 1, policy_version 1903352 (0.0008) [2023-12-28 08:54:46,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 973586432. Throughput: 0: 9868.6, 1: 10007.6. Samples: 973575776. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:54:46,175][105115] Avg episode reward: [(0, '-4.145'), (1, '-4.642')] [2023-12-28 08:54:46,381][106226] Updated weights for policy 0, policy_version 1899183 (0.0009) [2023-12-28 08:54:46,445][106226] Updated weights for policy 0, policy_version 1899193 (0.0008) [2023-12-28 08:54:46,507][106226] Updated weights for policy 0, policy_version 1899203 (0.0008) [2023-12-28 08:54:46,576][106225] Updated weights for policy 1, policy_version 1903362 (0.0008) [2023-12-28 08:54:46,630][106225] Updated weights for policy 1, policy_version 1903372 (0.0008) [2023-12-28 08:54:46,688][106225] Updated weights for policy 1, policy_version 1903382 (0.0008) [2023-12-28 08:54:46,747][106225] Updated weights for policy 1, policy_version 1903392 (0.0006) [2023-12-28 08:54:47,143][106226] Updated weights for policy 0, policy_version 1899213 (0.0008) [2023-12-28 08:54:47,204][106226] Updated weights for policy 0, policy_version 1899223 (0.0005) [2023-12-28 08:54:47,251][106226] Updated weights for policy 0, policy_version 1899233 (0.0005) [2023-12-28 08:54:47,495][106225] Updated weights for policy 1, policy_version 1903402 (0.0009) [2023-12-28 08:54:47,552][106225] Updated weights for policy 1, policy_version 1903412 (0.0008) [2023-12-28 08:54:47,600][106225] Updated weights for policy 1, policy_version 1903422 (0.0008) [2023-12-28 08:54:47,872][106226] Updated weights for policy 0, policy_version 1899243 (0.0005) [2023-12-28 08:54:47,937][106226] Updated weights for policy 0, policy_version 1899253 (0.0005) [2023-12-28 08:54:47,983][106226] Updated weights for policy 0, policy_version 1899263 (0.0006) [2023-12-28 08:54:48,371][106225] Updated weights for policy 1, policy_version 1903432 (0.0009) [2023-12-28 08:54:48,431][106225] Updated weights for policy 1, policy_version 1903442 (0.0010) [2023-12-28 08:54:48,498][106225] Updated weights for policy 1, policy_version 1903452 (0.0011) [2023-12-28 08:54:48,668][106226] Updated weights for policy 0, policy_version 1899273 (0.0009) [2023-12-28 08:54:48,726][106226] Updated weights for policy 0, policy_version 1899283 (0.0008) [2023-12-28 08:54:48,784][106226] Updated weights for policy 0, policy_version 1899293 (0.0008) [2023-12-28 08:54:48,846][106226] Updated weights for policy 0, policy_version 1899303 (0.0009) [2023-12-28 08:54:49,143][106225] Updated weights for policy 1, policy_version 1903462 (0.0009) [2023-12-28 08:54:49,208][106225] Updated weights for policy 1, policy_version 1903472 (0.0006) [2023-12-28 08:54:49,278][106225] Updated weights for policy 1, policy_version 1903482 (0.0008) [2023-12-28 08:54:49,560][106226] Updated weights for policy 0, policy_version 1899313 (0.0007) [2023-12-28 08:54:49,630][106226] Updated weights for policy 0, policy_version 1899323 (0.0008) [2023-12-28 08:54:49,690][106226] Updated weights for policy 0, policy_version 1899333 (0.0008) [2023-12-28 08:54:49,960][106225] Updated weights for policy 1, policy_version 1903492 (0.0007) [2023-12-28 08:54:50,022][106225] Updated weights for policy 1, policy_version 1903502 (0.0007) [2023-12-28 08:54:50,078][106225] Updated weights for policy 1, policy_version 1903512 (0.0006) [2023-12-28 08:54:50,436][106226] Updated weights for policy 0, policy_version 1899343 (0.0009) [2023-12-28 08:54:50,493][106226] Updated weights for policy 0, policy_version 1899353 (0.0006) [2023-12-28 08:54:50,552][106226] Updated weights for policy 0, policy_version 1899363 (0.0006) [2023-12-28 08:54:50,800][106225] Updated weights for policy 1, policy_version 1903522 (0.0006) [2023-12-28 08:54:50,860][106225] Updated weights for policy 1, policy_version 1903532 (0.0007) [2023-12-28 08:54:50,921][106225] Updated weights for policy 1, policy_version 1903542 (0.0005) [2023-12-28 08:54:50,977][106225] Updated weights for policy 1, policy_version 1903552 (0.0005) [2023-12-28 08:54:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 973684736. Throughput: 0: 9868.3, 1: 9908.8. Samples: 973694168. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:54:51,175][105115] Avg episode reward: [(0, '-4.282'), (1, '-4.703')] [2023-12-28 08:54:51,313][106226] Updated weights for policy 0, policy_version 1899373 (0.0008) [2023-12-28 08:54:51,411][106226] Updated weights for policy 0, policy_version 1899383 (0.0008) [2023-12-28 08:54:51,465][106226] Updated weights for policy 0, policy_version 1899393 (0.0008) [2023-12-28 08:54:51,652][106225] Updated weights for policy 1, policy_version 1903562 (0.0007) [2023-12-28 08:54:51,717][106225] Updated weights for policy 1, policy_version 1903572 (0.0009) [2023-12-28 08:54:51,782][106225] Updated weights for policy 1, policy_version 1903582 (0.0008) [2023-12-28 08:54:52,256][106226] Updated weights for policy 0, policy_version 1899403 (0.0009) [2023-12-28 08:54:52,319][106226] Updated weights for policy 0, policy_version 1899413 (0.0009) [2023-12-28 08:54:52,387][106226] Updated weights for policy 0, policy_version 1899423 (0.0009) [2023-12-28 08:54:52,456][106225] Updated weights for policy 1, policy_version 1903592 (0.0006) [2023-12-28 08:54:52,518][106225] Updated weights for policy 1, policy_version 1903602 (0.0008) [2023-12-28 08:54:52,580][106225] Updated weights for policy 1, policy_version 1903612 (0.0008) [2023-12-28 08:54:53,176][106226] Updated weights for policy 0, policy_version 1899433 (0.0009) [2023-12-28 08:54:53,225][106226] Updated weights for policy 0, policy_version 1899443 (0.0008) [2023-12-28 08:54:53,232][106225] Updated weights for policy 1, policy_version 1903622 (0.0009) [2023-12-28 08:54:53,274][106226] Updated weights for policy 0, policy_version 1899453 (0.0007) [2023-12-28 08:54:53,284][106225] Updated weights for policy 1, policy_version 1903632 (0.0006) [2023-12-28 08:54:53,322][106226] Updated weights for policy 0, policy_version 1899463 (0.0006) [2023-12-28 08:54:53,332][106225] Updated weights for policy 1, policy_version 1903642 (0.0006) [2023-12-28 08:54:54,011][106225] Updated weights for policy 1, policy_version 1903652 (0.0009) [2023-12-28 08:54:54,070][106225] Updated weights for policy 1, policy_version 1903662 (0.0008) [2023-12-28 08:54:54,107][106226] Updated weights for policy 0, policy_version 1899473 (0.0008) [2023-12-28 08:54:54,132][106225] Updated weights for policy 1, policy_version 1903672 (0.0007) [2023-12-28 08:54:54,162][106226] Updated weights for policy 0, policy_version 1899483 (0.0006) [2023-12-28 08:54:54,215][106226] Updated weights for policy 0, policy_version 1899493 (0.0008) [2023-12-28 08:54:54,851][106225] Updated weights for policy 1, policy_version 1903682 (0.0008) [2023-12-28 08:54:54,916][106225] Updated weights for policy 1, policy_version 1903692 (0.0007) [2023-12-28 08:54:54,959][106226] Updated weights for policy 0, policy_version 1899503 (0.0006) [2023-12-28 08:54:54,984][106225] Updated weights for policy 1, policy_version 1903702 (0.0008) [2023-12-28 08:54:55,026][106226] Updated weights for policy 0, policy_version 1899513 (0.0006) [2023-12-28 08:54:55,040][106225] Updated weights for policy 1, policy_version 1903712 (0.0008) [2023-12-28 08:54:55,088][106226] Updated weights for policy 0, policy_version 1899523 (0.0006) [2023-12-28 08:54:55,621][106226] Updated weights for policy 0, policy_version 1899533 (0.0005) [2023-12-28 08:54:55,675][106226] Updated weights for policy 0, policy_version 1899543 (0.0005) [2023-12-28 08:54:55,744][106226] Updated weights for policy 0, policy_version 1899553 (0.0006) [2023-12-28 08:54:55,755][106225] Updated weights for policy 1, policy_version 1903722 (0.0006) [2023-12-28 08:54:55,800][106225] Updated weights for policy 1, policy_version 1903732 (0.0007) [2023-12-28 08:54:55,851][106225] Updated weights for policy 1, policy_version 1903742 (0.0005) [2023-12-28 08:54:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 973783040. Throughput: 0: 9824.3, 1: 9929.9. Samples: 973751664. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:54:56,175][105115] Avg episode reward: [(0, '-4.198'), (1, '-4.476')] [2023-12-28 08:54:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001899560_486367232.pth... [2023-12-28 08:54:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001903744_487415808.pth... [2023-12-28 08:54:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001898408_486072320.pth [2023-12-28 08:54:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001902560_487112704.pth [2023-12-28 08:54:56,361][106226] Updated weights for policy 0, policy_version 1899563 (0.0008) [2023-12-28 08:54:56,430][106226] Updated weights for policy 0, policy_version 1899573 (0.0010) [2023-12-28 08:54:56,449][106225] Updated weights for policy 1, policy_version 1903752 (0.0009) [2023-12-28 08:54:56,489][106226] Updated weights for policy 0, policy_version 1899583 (0.0010) [2023-12-28 08:54:56,499][106225] Updated weights for policy 1, policy_version 1903762 (0.0010) [2023-12-28 08:54:56,546][106225] Updated weights for policy 1, policy_version 1903772 (0.0010) [2023-12-28 08:54:57,180][106226] Updated weights for policy 0, policy_version 1899593 (0.0010) [2023-12-28 08:54:57,220][106225] Updated weights for policy 1, policy_version 1903782 (0.0010) [2023-12-28 08:54:57,239][106226] Updated weights for policy 0, policy_version 1899603 (0.0010) [2023-12-28 08:54:57,266][106225] Updated weights for policy 1, policy_version 1903792 (0.0010) [2023-12-28 08:54:57,296][106226] Updated weights for policy 0, policy_version 1899613 (0.0010) [2023-12-28 08:54:57,313][106225] Updated weights for policy 1, policy_version 1903802 (0.0010) [2023-12-28 08:54:57,352][106226] Updated weights for policy 0, policy_version 1899623 (0.0010) [2023-12-28 08:54:57,975][106226] Updated weights for policy 0, policy_version 1899633 (0.0006) [2023-12-28 08:54:58,035][106226] Updated weights for policy 0, policy_version 1899643 (0.0005) [2023-12-28 08:54:58,072][106225] Updated weights for policy 1, policy_version 1903812 (0.0010) [2023-12-28 08:54:58,093][106226] Updated weights for policy 0, policy_version 1899653 (0.0005) [2023-12-28 08:54:58,126][106225] Updated weights for policy 1, policy_version 1903822 (0.0009) [2023-12-28 08:54:58,176][106225] Updated weights for policy 1, policy_version 1903832 (0.0009) [2023-12-28 08:54:58,766][106226] Updated weights for policy 0, policy_version 1899663 (0.0007) [2023-12-28 08:54:58,844][106226] Updated weights for policy 0, policy_version 1899673 (0.0008) [2023-12-28 08:54:58,917][106226] Updated weights for policy 0, policy_version 1899683 (0.0010) [2023-12-28 08:54:59,015][106225] Updated weights for policy 1, policy_version 1903842 (0.0008) [2023-12-28 08:54:59,080][106225] Updated weights for policy 1, policy_version 1903852 (0.0008) [2023-12-28 08:54:59,142][106225] Updated weights for policy 1, policy_version 1903862 (0.0008) [2023-12-28 08:54:59,205][106225] Updated weights for policy 1, policy_version 1903872 (0.0008) [2023-12-28 08:54:59,643][106226] Updated weights for policy 0, policy_version 1899693 (0.0009) [2023-12-28 08:54:59,710][106226] Updated weights for policy 0, policy_version 1899703 (0.0008) [2023-12-28 08:54:59,770][106226] Updated weights for policy 0, policy_version 1899713 (0.0008) [2023-12-28 08:54:59,949][106225] Updated weights for policy 1, policy_version 1903882 (0.0009) [2023-12-28 08:55:00,004][106225] Updated weights for policy 1, policy_version 1903892 (0.0007) [2023-12-28 08:55:00,062][106225] Updated weights for policy 1, policy_version 1903902 (0.0009) [2023-12-28 08:55:00,491][106226] Updated weights for policy 0, policy_version 1899723 (0.0008) [2023-12-28 08:55:00,549][106226] Updated weights for policy 0, policy_version 1899733 (0.0008) [2023-12-28 08:55:00,618][106226] Updated weights for policy 0, policy_version 1899743 (0.0007) [2023-12-28 08:55:00,768][106225] Updated weights for policy 1, policy_version 1903912 (0.0006) [2023-12-28 08:55:00,821][106225] Updated weights for policy 1, policy_version 1903922 (0.0005) [2023-12-28 08:55:00,876][106225] Updated weights for policy 1, policy_version 1903932 (0.0005) [2023-12-28 08:55:01,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 973881344. Throughput: 0: 9936.1, 1: 9882.7. Samples: 973871008. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:01,175][105115] Avg episode reward: [(0, '-4.165'), (1, '-4.458')] [2023-12-28 08:55:01,332][106226] Updated weights for policy 0, policy_version 1899753 (0.0006) [2023-12-28 08:55:01,407][106226] Updated weights for policy 0, policy_version 1899763 (0.0008) [2023-12-28 08:55:01,468][106226] Updated weights for policy 0, policy_version 1899773 (0.0009) [2023-12-28 08:55:01,533][106226] Updated weights for policy 0, policy_version 1899783 (0.0009) [2023-12-28 08:55:01,556][106225] Updated weights for policy 1, policy_version 1903942 (0.0007) [2023-12-28 08:55:01,616][106225] Updated weights for policy 1, policy_version 1903952 (0.0008) [2023-12-28 08:55:01,681][106225] Updated weights for policy 1, policy_version 1903962 (0.0007) [2023-12-28 08:55:02,188][106226] Updated weights for policy 0, policy_version 1899793 (0.0010) [2023-12-28 08:55:02,246][106226] Updated weights for policy 0, policy_version 1899803 (0.0010) [2023-12-28 08:55:02,311][106226] Updated weights for policy 0, policy_version 1899813 (0.0011) [2023-12-28 08:55:02,376][106225] Updated weights for policy 1, policy_version 1903972 (0.0008) [2023-12-28 08:55:02,430][106225] Updated weights for policy 1, policy_version 1903982 (0.0010) [2023-12-28 08:55:02,483][106225] Updated weights for policy 1, policy_version 1903992 (0.0010) [2023-12-28 08:55:03,008][106226] Updated weights for policy 0, policy_version 1899823 (0.0010) [2023-12-28 08:55:03,061][106226] Updated weights for policy 0, policy_version 1899833 (0.0010) [2023-12-28 08:55:03,116][106226] Updated weights for policy 0, policy_version 1899843 (0.0010) [2023-12-28 08:55:03,156][106225] Updated weights for policy 1, policy_version 1904002 (0.0010) [2023-12-28 08:55:03,202][106225] Updated weights for policy 1, policy_version 1904012 (0.0010) [2023-12-28 08:55:03,250][106225] Updated weights for policy 1, policy_version 1904022 (0.0009) [2023-12-28 08:55:03,301][106225] Updated weights for policy 1, policy_version 1904032 (0.0005) [2023-12-28 08:55:03,833][106226] Updated weights for policy 0, policy_version 1899853 (0.0011) [2023-12-28 08:55:03,894][106226] Updated weights for policy 0, policy_version 1899863 (0.0010) [2023-12-28 08:55:03,918][106225] Updated weights for policy 1, policy_version 1904042 (0.0009) [2023-12-28 08:55:03,959][106226] Updated weights for policy 0, policy_version 1899873 (0.0011) [2023-12-28 08:55:03,981][106225] Updated weights for policy 1, policy_version 1904052 (0.0007) [2023-12-28 08:55:04,047][106225] Updated weights for policy 1, policy_version 1904062 (0.0005) [2023-12-28 08:55:04,663][106225] Updated weights for policy 1, policy_version 1904072 (0.0009) [2023-12-28 08:55:04,673][106226] Updated weights for policy 0, policy_version 1899883 (0.0011) [2023-12-28 08:55:04,723][106226] Updated weights for policy 0, policy_version 1899893 (0.0010) [2023-12-28 08:55:04,723][106225] Updated weights for policy 1, policy_version 1904082 (0.0010) [2023-12-28 08:55:04,777][106225] Updated weights for policy 1, policy_version 1904092 (0.0010) [2023-12-28 08:55:04,780][106226] Updated weights for policy 0, policy_version 1899903 (0.0010) [2023-12-28 08:55:05,481][106226] Updated weights for policy 0, policy_version 1899913 (0.0010) [2023-12-28 08:55:05,499][106225] Updated weights for policy 1, policy_version 1904102 (0.0010) [2023-12-28 08:55:05,526][106226] Updated weights for policy 0, policy_version 1899923 (0.0005) [2023-12-28 08:55:05,562][106225] Updated weights for policy 1, policy_version 1904112 (0.0010) [2023-12-28 08:55:05,580][106226] Updated weights for policy 0, policy_version 1899933 (0.0009) [2023-12-28 08:55:05,617][106225] Updated weights for policy 1, policy_version 1904122 (0.0010) [2023-12-28 08:55:05,627][106226] Updated weights for policy 0, policy_version 1899943 (0.0010) [2023-12-28 08:55:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 973979648. Throughput: 0: 9931.7, 1: 9963.4. Samples: 973991284. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:06,175][105115] Avg episode reward: [(0, '-4.230'), (1, '-4.520')] [2023-12-28 08:55:06,352][106225] Updated weights for policy 1, policy_version 1904132 (0.0010) [2023-12-28 08:55:06,356][106226] Updated weights for policy 0, policy_version 1899953 (0.0011) [2023-12-28 08:55:06,409][106225] Updated weights for policy 1, policy_version 1904142 (0.0008) [2023-12-28 08:55:06,411][106226] Updated weights for policy 0, policy_version 1899963 (0.0009) [2023-12-28 08:55:06,458][106225] Updated weights for policy 1, policy_version 1904152 (0.0006) [2023-12-28 08:55:06,474][106226] Updated weights for policy 0, policy_version 1899973 (0.0009) [2023-12-28 08:55:07,194][106226] Updated weights for policy 0, policy_version 1899983 (0.0006) [2023-12-28 08:55:07,218][106225] Updated weights for policy 1, policy_version 1904162 (0.0007) [2023-12-28 08:55:07,258][106226] Updated weights for policy 0, policy_version 1899993 (0.0005) [2023-12-28 08:55:07,278][106225] Updated weights for policy 1, policy_version 1904172 (0.0009) [2023-12-28 08:55:07,314][106226] Updated weights for policy 0, policy_version 1900003 (0.0005) [2023-12-28 08:55:07,328][106225] Updated weights for policy 1, policy_version 1904182 (0.0008) [2023-12-28 08:55:07,387][106225] Updated weights for policy 1, policy_version 1904192 (0.0008) [2023-12-28 08:55:07,827][106226] Updated weights for policy 0, policy_version 1900013 (0.0005) [2023-12-28 08:55:07,880][106226] Updated weights for policy 0, policy_version 1900023 (0.0007) [2023-12-28 08:55:07,936][106226] Updated weights for policy 0, policy_version 1900033 (0.0010) [2023-12-28 08:55:08,202][106225] Updated weights for policy 1, policy_version 1904202 (0.0008) [2023-12-28 08:55:08,260][106225] Updated weights for policy 1, policy_version 1904212 (0.0008) [2023-12-28 08:55:08,327][106225] Updated weights for policy 1, policy_version 1904222 (0.0008) [2023-12-28 08:55:08,660][106226] Updated weights for policy 0, policy_version 1900043 (0.0010) [2023-12-28 08:55:08,714][106226] Updated weights for policy 0, policy_version 1900053 (0.0007) [2023-12-28 08:55:08,767][106226] Updated weights for policy 0, policy_version 1900063 (0.0010) [2023-12-28 08:55:09,054][106225] Updated weights for policy 1, policy_version 1904232 (0.0010) [2023-12-28 08:55:09,121][106225] Updated weights for policy 1, policy_version 1904242 (0.0011) [2023-12-28 08:55:09,186][106225] Updated weights for policy 1, policy_version 1904252 (0.0010) [2023-12-28 08:55:09,469][106226] Updated weights for policy 0, policy_version 1900073 (0.0010) [2023-12-28 08:55:09,535][106226] Updated weights for policy 0, policy_version 1900083 (0.0009) [2023-12-28 08:55:09,594][106226] Updated weights for policy 0, policy_version 1900093 (0.0009) [2023-12-28 08:55:09,650][106226] Updated weights for policy 0, policy_version 1900103 (0.0008) [2023-12-28 08:55:09,937][106225] Updated weights for policy 1, policy_version 1904262 (0.0009) [2023-12-28 08:55:10,006][106225] Updated weights for policy 1, policy_version 1904272 (0.0009) [2023-12-28 08:55:10,068][106225] Updated weights for policy 1, policy_version 1904282 (0.0009) [2023-12-28 08:55:10,424][106226] Updated weights for policy 0, policy_version 1900113 (0.0009) [2023-12-28 08:55:10,475][106226] Updated weights for policy 0, policy_version 1900123 (0.0008) [2023-12-28 08:55:10,530][106226] Updated weights for policy 0, policy_version 1900133 (0.0009) [2023-12-28 08:55:10,786][106225] Updated weights for policy 1, policy_version 1904292 (0.0008) [2023-12-28 08:55:10,837][106225] Updated weights for policy 1, policy_version 1904302 (0.0005) [2023-12-28 08:55:10,895][106225] Updated weights for policy 1, policy_version 1904312 (0.0005) [2023-12-28 08:55:11,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 974077952. Throughput: 0: 10009.5, 1: 9975.7. Samples: 974049828. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:11,175][105115] Avg episode reward: [(0, '-4.218'), (1, '-4.484')] [2023-12-28 08:55:11,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001904320_487563264.pth... [2023-12-28 08:55:11,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001900136_486514688.pth... [2023-12-28 08:55:11,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001903168_487268352.pth [2023-12-28 08:55:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001898984_486219776.pth [2023-12-28 08:55:11,312][106226] Updated weights for policy 0, policy_version 1900143 (0.0008) [2023-12-28 08:55:11,377][106226] Updated weights for policy 0, policy_version 1900153 (0.0009) [2023-12-28 08:55:11,445][106226] Updated weights for policy 0, policy_version 1900163 (0.0009) [2023-12-28 08:55:11,653][106225] Updated weights for policy 1, policy_version 1904322 (0.0006) [2023-12-28 08:55:11,719][106225] Updated weights for policy 1, policy_version 1904332 (0.0007) [2023-12-28 08:55:11,787][106225] Updated weights for policy 1, policy_version 1904342 (0.0009) [2023-12-28 08:55:11,849][106225] Updated weights for policy 1, policy_version 1904352 (0.0009) [2023-12-28 08:55:12,156][106226] Updated weights for policy 0, policy_version 1900173 (0.0008) [2023-12-28 08:55:12,212][106226] Updated weights for policy 0, policy_version 1900183 (0.0010) [2023-12-28 08:55:12,273][106226] Updated weights for policy 0, policy_version 1900193 (0.0008) [2023-12-28 08:55:12,543][106225] Updated weights for policy 1, policy_version 1904362 (0.0009) [2023-12-28 08:55:12,600][106225] Updated weights for policy 1, policy_version 1904372 (0.0008) [2023-12-28 08:55:12,664][106225] Updated weights for policy 1, policy_version 1904382 (0.0008) [2023-12-28 08:55:13,016][106226] Updated weights for policy 0, policy_version 1900203 (0.0008) [2023-12-28 08:55:13,073][106226] Updated weights for policy 0, policy_version 1900213 (0.0008) [2023-12-28 08:55:13,135][106226] Updated weights for policy 0, policy_version 1900223 (0.0009) [2023-12-28 08:55:13,393][106225] Updated weights for policy 1, policy_version 1904392 (0.0009) [2023-12-28 08:55:13,452][106225] Updated weights for policy 1, policy_version 1904402 (0.0008) [2023-12-28 08:55:13,498][106225] Updated weights for policy 1, policy_version 1904412 (0.0008) [2023-12-28 08:55:13,815][106226] Updated weights for policy 0, policy_version 1900233 (0.0007) [2023-12-28 08:55:13,865][106226] Updated weights for policy 0, policy_version 1900243 (0.0008) [2023-12-28 08:55:13,917][106226] Updated weights for policy 0, policy_version 1900253 (0.0008) [2023-12-28 08:55:13,971][106226] Updated weights for policy 0, policy_version 1900263 (0.0008) [2023-12-28 08:55:14,280][106225] Updated weights for policy 1, policy_version 1904422 (0.0007) [2023-12-28 08:55:14,351][106225] Updated weights for policy 1, policy_version 1904432 (0.0008) [2023-12-28 08:55:14,418][106225] Updated weights for policy 1, policy_version 1904442 (0.0008) [2023-12-28 08:55:14,696][106226] Updated weights for policy 0, policy_version 1900273 (0.0011) [2023-12-28 08:55:14,745][106226] Updated weights for policy 0, policy_version 1900283 (0.0010) [2023-12-28 08:55:14,821][106226] Updated weights for policy 0, policy_version 1900293 (0.0011) [2023-12-28 08:55:15,085][106225] Updated weights for policy 1, policy_version 1904452 (0.0008) [2023-12-28 08:55:15,146][106225] Updated weights for policy 1, policy_version 1904462 (0.0008) [2023-12-28 08:55:15,210][106225] Updated weights for policy 1, policy_version 1904472 (0.0007) [2023-12-28 08:55:15,536][106226] Updated weights for policy 0, policy_version 1900303 (0.0007) [2023-12-28 08:55:15,592][106226] Updated weights for policy 0, policy_version 1900313 (0.0006) [2023-12-28 08:55:15,642][106226] Updated weights for policy 0, policy_version 1900323 (0.0010) [2023-12-28 08:55:15,907][106225] Updated weights for policy 1, policy_version 1904482 (0.0007) [2023-12-28 08:55:15,976][106225] Updated weights for policy 1, policy_version 1904493 (0.0007) [2023-12-28 08:55:16,033][106225] Updated weights for policy 1, policy_version 1904503 (0.0005) [2023-12-28 08:55:16,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 974176256. Throughput: 0: 9882.8, 1: 9896.1. Samples: 974164172. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:16,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.403')] [2023-12-28 08:55:16,256][106226] Updated weights for policy 0, policy_version 1900333 (0.0008) [2023-12-28 08:55:16,308][106226] Updated weights for policy 0, policy_version 1900343 (0.0007) [2023-12-28 08:55:16,371][106226] Updated weights for policy 0, policy_version 1900353 (0.0008) [2023-12-28 08:55:16,702][106225] Updated weights for policy 1, policy_version 1904513 (0.0005) [2023-12-28 08:55:16,767][106225] Updated weights for policy 1, policy_version 1904523 (0.0009) [2023-12-28 08:55:16,827][106225] Updated weights for policy 1, policy_version 1904533 (0.0010) [2023-12-28 08:55:16,886][106225] Updated weights for policy 1, policy_version 1904543 (0.0010) [2023-12-28 08:55:17,028][106226] Updated weights for policy 0, policy_version 1900363 (0.0009) [2023-12-28 08:55:17,081][106226] Updated weights for policy 0, policy_version 1900373 (0.0008) [2023-12-28 08:55:17,138][106226] Updated weights for policy 0, policy_version 1900383 (0.0007) [2023-12-28 08:55:17,592][106225] Updated weights for policy 1, policy_version 1904553 (0.0010) [2023-12-28 08:55:17,645][106225] Updated weights for policy 1, policy_version 1904563 (0.0010) [2023-12-28 08:55:17,698][106225] Updated weights for policy 1, policy_version 1904573 (0.0010) [2023-12-28 08:55:17,860][106226] Updated weights for policy 0, policy_version 1900393 (0.0007) [2023-12-28 08:55:17,923][106226] Updated weights for policy 0, policy_version 1900403 (0.0006) [2023-12-28 08:55:17,986][106226] Updated weights for policy 0, policy_version 1900413 (0.0005) [2023-12-28 08:55:18,053][106226] Updated weights for policy 0, policy_version 1900423 (0.0007) [2023-12-28 08:55:18,378][106225] Updated weights for policy 1, policy_version 1904583 (0.0010) [2023-12-28 08:55:18,430][106225] Updated weights for policy 1, policy_version 1904593 (0.0008) [2023-12-28 08:55:18,481][106225] Updated weights for policy 1, policy_version 1904603 (0.0005) [2023-12-28 08:55:18,721][106226] Updated weights for policy 0, policy_version 1900433 (0.0008) [2023-12-28 08:55:18,780][106226] Updated weights for policy 0, policy_version 1900443 (0.0007) [2023-12-28 08:55:18,840][106226] Updated weights for policy 0, policy_version 1900453 (0.0008) [2023-12-28 08:55:19,125][106225] Updated weights for policy 1, policy_version 1904613 (0.0006) [2023-12-28 08:55:19,185][106225] Updated weights for policy 1, policy_version 1904623 (0.0010) [2023-12-28 08:55:19,252][106225] Updated weights for policy 1, policy_version 1904633 (0.0009) [2023-12-28 08:55:19,514][106226] Updated weights for policy 0, policy_version 1900463 (0.0008) [2023-12-28 08:55:19,571][106226] Updated weights for policy 0, policy_version 1900473 (0.0008) [2023-12-28 08:55:19,633][106226] Updated weights for policy 0, policy_version 1900483 (0.0009) [2023-12-28 08:55:19,943][106225] Updated weights for policy 1, policy_version 1904643 (0.0007) [2023-12-28 08:55:19,991][106225] Updated weights for policy 1, policy_version 1904653 (0.0009) [2023-12-28 08:55:20,048][106225] Updated weights for policy 1, policy_version 1904663 (0.0006) [2023-12-28 08:55:20,425][106226] Updated weights for policy 0, policy_version 1900493 (0.0007) [2023-12-28 08:55:20,484][106226] Updated weights for policy 0, policy_version 1900503 (0.0009) [2023-12-28 08:55:20,540][106226] Updated weights for policy 0, policy_version 1900513 (0.0007) [2023-12-28 08:55:20,776][106225] Updated weights for policy 1, policy_version 1904673 (0.0010) [2023-12-28 08:55:20,834][106225] Updated weights for policy 1, policy_version 1904683 (0.0009) [2023-12-28 08:55:20,898][106225] Updated weights for policy 1, policy_version 1904693 (0.0009) [2023-12-28 08:55:20,960][106225] Updated weights for policy 1, policy_version 1904703 (0.0008) [2023-12-28 08:55:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 974274560. Throughput: 0: 9801.8, 1: 9852.3. Samples: 974284036. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:21,175][105115] Avg episode reward: [(0, '-4.198'), (1, '-4.650')] [2023-12-28 08:55:21,289][106226] Updated weights for policy 0, policy_version 1900523 (0.0008) [2023-12-28 08:55:21,348][106226] Updated weights for policy 0, policy_version 1900533 (0.0008) [2023-12-28 08:55:21,417][106226] Updated weights for policy 0, policy_version 1900543 (0.0007) [2023-12-28 08:55:21,748][106225] Updated weights for policy 1, policy_version 1904713 (0.0008) [2023-12-28 08:55:21,808][106225] Updated weights for policy 1, policy_version 1904723 (0.0008) [2023-12-28 08:55:21,866][106225] Updated weights for policy 1, policy_version 1904733 (0.0008) [2023-12-28 08:55:22,126][106226] Updated weights for policy 0, policy_version 1900553 (0.0007) [2023-12-28 08:55:22,182][106226] Updated weights for policy 0, policy_version 1900563 (0.0008) [2023-12-28 08:55:22,247][106226] Updated weights for policy 0, policy_version 1900573 (0.0008) [2023-12-28 08:55:22,308][106226] Updated weights for policy 0, policy_version 1900583 (0.0009) [2023-12-28 08:55:22,554][106225] Updated weights for policy 1, policy_version 1904743 (0.0006) [2023-12-28 08:55:22,609][106225] Updated weights for policy 1, policy_version 1904753 (0.0007) [2023-12-28 08:55:22,666][106225] Updated weights for policy 1, policy_version 1904763 (0.0009) [2023-12-28 08:55:23,131][106226] Updated weights for policy 0, policy_version 1900593 (0.0010) [2023-12-28 08:55:23,188][106226] Updated weights for policy 0, policy_version 1900603 (0.0010) [2023-12-28 08:55:23,244][106226] Updated weights for policy 0, policy_version 1900613 (0.0010) [2023-12-28 08:55:23,338][106225] Updated weights for policy 1, policy_version 1904773 (0.0007) [2023-12-28 08:55:23,394][106225] Updated weights for policy 1, policy_version 1904783 (0.0008) [2023-12-28 08:55:23,443][106225] Updated weights for policy 1, policy_version 1904793 (0.0007) [2023-12-28 08:55:23,933][106226] Updated weights for policy 0, policy_version 1900623 (0.0011) [2023-12-28 08:55:23,992][106226] Updated weights for policy 0, policy_version 1900633 (0.0011) [2023-12-28 08:55:24,053][106226] Updated weights for policy 0, policy_version 1900643 (0.0010) [2023-12-28 08:55:24,180][106225] Updated weights for policy 1, policy_version 1904803 (0.0008) [2023-12-28 08:55:24,242][106225] Updated weights for policy 1, policy_version 1904813 (0.0010) [2023-12-28 08:55:24,302][106225] Updated weights for policy 1, policy_version 1904823 (0.0008) [2023-12-28 08:55:24,773][106226] Updated weights for policy 0, policy_version 1900653 (0.0011) [2023-12-28 08:55:24,827][106226] Updated weights for policy 0, policy_version 1900663 (0.0011) [2023-12-28 08:55:24,882][106226] Updated weights for policy 0, policy_version 1900673 (0.0011) [2023-12-28 08:55:25,009][106225] Updated weights for policy 1, policy_version 1904833 (0.0008) [2023-12-28 08:55:25,074][106225] Updated weights for policy 1, policy_version 1904843 (0.0007) [2023-12-28 08:55:25,128][106225] Updated weights for policy 1, policy_version 1904853 (0.0008) [2023-12-28 08:55:25,193][106225] Updated weights for policy 1, policy_version 1904863 (0.0007) [2023-12-28 08:55:25,577][106226] Updated weights for policy 0, policy_version 1900683 (0.0009) [2023-12-28 08:55:25,624][106226] Updated weights for policy 0, policy_version 1900693 (0.0006) [2023-12-28 08:55:25,678][106226] Updated weights for policy 0, policy_version 1900703 (0.0010) [2023-12-28 08:55:25,842][106225] Updated weights for policy 1, policy_version 1904873 (0.0008) [2023-12-28 08:55:25,902][106225] Updated weights for policy 1, policy_version 1904883 (0.0006) [2023-12-28 08:55:25,967][106225] Updated weights for policy 1, policy_version 1904893 (0.0005) [2023-12-28 08:55:26,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 974372864. Throughput: 0: 9741.1, 1: 9838.2. Samples: 974340360. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:26,176][105115] Avg episode reward: [(0, '-4.201'), (1, '-4.467')] [2023-12-28 08:55:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001904896_487710720.pth... [2023-12-28 08:55:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001900712_486662144.pth... [2023-12-28 08:55:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001903744_487415808.pth [2023-12-28 08:55:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001899560_486367232.pth [2023-12-28 08:55:26,285][106226] Updated weights for policy 0, policy_version 1900713 (0.0010) [2023-12-28 08:55:26,348][106226] Updated weights for policy 0, policy_version 1900723 (0.0011) [2023-12-28 08:55:26,402][106226] Updated weights for policy 0, policy_version 1900733 (0.0010) [2023-12-28 08:55:26,465][106226] Updated weights for policy 0, policy_version 1900743 (0.0009) [2023-12-28 08:55:26,597][106225] Updated weights for policy 1, policy_version 1904903 (0.0009) [2023-12-28 08:55:26,653][106225] Updated weights for policy 1, policy_version 1904913 (0.0010) [2023-12-28 08:55:26,719][106225] Updated weights for policy 1, policy_version 1904923 (0.0010) [2023-12-28 08:55:26,999][106226] Updated weights for policy 0, policy_version 1900753 (0.0006) [2023-12-28 08:55:27,051][106226] Updated weights for policy 0, policy_version 1900763 (0.0005) [2023-12-28 08:55:27,098][106226] Updated weights for policy 0, policy_version 1900773 (0.0006) [2023-12-28 08:55:27,421][106225] Updated weights for policy 1, policy_version 1904933 (0.0010) [2023-12-28 08:55:27,468][106225] Updated weights for policy 1, policy_version 1904943 (0.0010) [2023-12-28 08:55:27,514][106225] Updated weights for policy 1, policy_version 1904953 (0.0010) [2023-12-28 08:55:27,772][106226] Updated weights for policy 0, policy_version 1900783 (0.0010) [2023-12-28 08:55:27,828][106226] Updated weights for policy 0, policy_version 1900793 (0.0010) [2023-12-28 08:55:27,876][106226] Updated weights for policy 0, policy_version 1900803 (0.0010) [2023-12-28 08:55:28,252][106225] Updated weights for policy 1, policy_version 1904963 (0.0010) [2023-12-28 08:55:28,305][106225] Updated weights for policy 1, policy_version 1904973 (0.0009) [2023-12-28 08:55:28,388][106225] Updated weights for policy 1, policy_version 1904983 (0.0007) [2023-12-28 08:55:28,529][106226] Updated weights for policy 0, policy_version 1900813 (0.0008) [2023-12-28 08:55:28,593][106226] Updated weights for policy 0, policy_version 1900823 (0.0005) [2023-12-28 08:55:28,658][106226] Updated weights for policy 0, policy_version 1900833 (0.0005) [2023-12-28 08:55:29,108][106225] Updated weights for policy 1, policy_version 1904993 (0.0006) [2023-12-28 08:55:29,163][106225] Updated weights for policy 1, policy_version 1905003 (0.0008) [2023-12-28 08:55:29,197][106226] Updated weights for policy 0, policy_version 1900843 (0.0006) [2023-12-28 08:55:29,213][106225] Updated weights for policy 1, policy_version 1905013 (0.0007) [2023-12-28 08:55:29,265][106226] Updated weights for policy 0, policy_version 1900853 (0.0008) [2023-12-28 08:55:29,277][106225] Updated weights for policy 1, policy_version 1905023 (0.0008) [2023-12-28 08:55:29,321][106226] Updated weights for policy 0, policy_version 1900863 (0.0008) [2023-12-28 08:55:30,082][106226] Updated weights for policy 0, policy_version 1900873 (0.0009) [2023-12-28 08:55:30,089][106225] Updated weights for policy 1, policy_version 1905033 (0.0008) [2023-12-28 08:55:30,143][106226] Updated weights for policy 0, policy_version 1900883 (0.0008) [2023-12-28 08:55:30,146][106225] Updated weights for policy 1, policy_version 1905043 (0.0009) [2023-12-28 08:55:30,197][106226] Updated weights for policy 0, policy_version 1900893 (0.0007) [2023-12-28 08:55:30,201][106225] Updated weights for policy 1, policy_version 1905053 (0.0011) [2023-12-28 08:55:30,256][106226] Updated weights for policy 0, policy_version 1900903 (0.0007) [2023-12-28 08:55:30,889][106225] Updated weights for policy 1, policy_version 1905063 (0.0007) [2023-12-28 08:55:30,942][106225] Updated weights for policy 1, policy_version 1905073 (0.0005) [2023-12-28 08:55:30,990][106225] Updated weights for policy 1, policy_version 1905083 (0.0005) [2023-12-28 08:55:30,990][106226] Updated weights for policy 0, policy_version 1900913 (0.0006) [2023-12-28 08:55:31,058][106226] Updated weights for policy 0, policy_version 1900923 (0.0009) [2023-12-28 08:55:31,115][106226] Updated weights for policy 0, policy_version 1900933 (0.0009) [2023-12-28 08:55:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 974479360. Throughput: 0: 9947.3, 1: 9780.4. Samples: 974463524. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:31,175][105115] Avg episode reward: [(0, '-4.426'), (1, '-4.675')] [2023-12-28 08:55:31,709][106225] Updated weights for policy 1, policy_version 1905093 (0.0007) [2023-12-28 08:55:31,784][106225] Updated weights for policy 1, policy_version 1905103 (0.0009) [2023-12-28 08:55:31,842][106225] Updated weights for policy 1, policy_version 1905113 (0.0009) [2023-12-28 08:55:31,872][106226] Updated weights for policy 0, policy_version 1900943 (0.0007) [2023-12-28 08:55:31,922][106226] Updated weights for policy 0, policy_version 1900953 (0.0006) [2023-12-28 08:55:31,980][106226] Updated weights for policy 0, policy_version 1900963 (0.0008) [2023-12-28 08:55:32,570][106225] Updated weights for policy 1, policy_version 1905123 (0.0008) [2023-12-28 08:55:32,629][106225] Updated weights for policy 1, policy_version 1905133 (0.0007) [2023-12-28 08:55:32,632][106226] Updated weights for policy 0, policy_version 1900973 (0.0007) [2023-12-28 08:55:32,692][106225] Updated weights for policy 1, policy_version 1905143 (0.0007) [2023-12-28 08:55:32,698][106226] Updated weights for policy 0, policy_version 1900983 (0.0005) [2023-12-28 08:55:32,758][106226] Updated weights for policy 0, policy_version 1900993 (0.0007) [2023-12-28 08:55:33,396][106226] Updated weights for policy 0, policy_version 1901003 (0.0008) [2023-12-28 08:55:33,421][106225] Updated weights for policy 1, policy_version 1905153 (0.0007) [2023-12-28 08:55:33,455][106226] Updated weights for policy 0, policy_version 1901013 (0.0009) [2023-12-28 08:55:33,482][106225] Updated weights for policy 1, policy_version 1905163 (0.0005) [2023-12-28 08:55:33,518][106226] Updated weights for policy 0, policy_version 1901023 (0.0008) [2023-12-28 08:55:33,529][106225] Updated weights for policy 1, policy_version 1905173 (0.0005) [2023-12-28 08:55:33,585][106225] Updated weights for policy 1, policy_version 1905183 (0.0005) [2023-12-28 08:55:34,133][106226] Updated weights for policy 0, policy_version 1901033 (0.0007) [2023-12-28 08:55:34,191][106225] Updated weights for policy 1, policy_version 1905193 (0.0007) [2023-12-28 08:55:34,204][106226] Updated weights for policy 0, policy_version 1901043 (0.0008) [2023-12-28 08:55:34,250][106225] Updated weights for policy 1, policy_version 1905203 (0.0007) [2023-12-28 08:55:34,270][106226] Updated weights for policy 0, policy_version 1901053 (0.0008) [2023-12-28 08:55:34,303][106225] Updated weights for policy 1, policy_version 1905213 (0.0006) [2023-12-28 08:55:34,333][106226] Updated weights for policy 0, policy_version 1901063 (0.0008) [2023-12-28 08:55:35,021][106226] Updated weights for policy 0, policy_version 1901073 (0.0006) [2023-12-28 08:55:35,061][106225] Updated weights for policy 1, policy_version 1905223 (0.0009) [2023-12-28 08:55:35,080][106226] Updated weights for policy 0, policy_version 1901083 (0.0006) [2023-12-28 08:55:35,110][106225] Updated weights for policy 1, policy_version 1905233 (0.0007) [2023-12-28 08:55:35,133][106226] Updated weights for policy 0, policy_version 1901093 (0.0007) [2023-12-28 08:55:35,158][106225] Updated weights for policy 1, policy_version 1905243 (0.0007) [2023-12-28 08:55:35,759][106226] Updated weights for policy 0, policy_version 1901103 (0.0008) [2023-12-28 08:55:35,808][106226] Updated weights for policy 0, policy_version 1901113 (0.0009) [2023-12-28 08:55:35,865][106226] Updated weights for policy 0, policy_version 1901123 (0.0009) [2023-12-28 08:55:35,867][106225] Updated weights for policy 1, policy_version 1905253 (0.0010) [2023-12-28 08:55:35,917][106225] Updated weights for policy 1, policy_version 1905263 (0.0010) [2023-12-28 08:55:35,959][106225] Updated weights for policy 1, policy_version 1905273 (0.0010) [2023-12-28 08:55:36,174][105115] Fps is (10 sec: 20480.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 974577664. Throughput: 0: 9940.2, 1: 9804.8. Samples: 974582688. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:36,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.661')] [2023-12-28 08:55:36,629][106225] Updated weights for policy 1, policy_version 1905283 (0.0009) [2023-12-28 08:55:36,643][106226] Updated weights for policy 0, policy_version 1901133 (0.0007) [2023-12-28 08:55:36,689][106225] Updated weights for policy 1, policy_version 1905293 (0.0007) [2023-12-28 08:55:36,698][106226] Updated weights for policy 0, policy_version 1901143 (0.0007) [2023-12-28 08:55:36,744][106225] Updated weights for policy 1, policy_version 1905303 (0.0009) [2023-12-28 08:55:36,759][106226] Updated weights for policy 0, policy_version 1901153 (0.0009) [2023-12-28 08:55:37,471][106225] Updated weights for policy 1, policy_version 1905313 (0.0008) [2023-12-28 08:55:37,501][106226] Updated weights for policy 0, policy_version 1901163 (0.0008) [2023-12-28 08:55:37,531][106225] Updated weights for policy 1, policy_version 1905323 (0.0007) [2023-12-28 08:55:37,556][106226] Updated weights for policy 0, policy_version 1901173 (0.0007) [2023-12-28 08:55:37,591][106225] Updated weights for policy 1, policy_version 1905333 (0.0007) [2023-12-28 08:55:37,617][106226] Updated weights for policy 0, policy_version 1901183 (0.0006) [2023-12-28 08:55:37,652][106225] Updated weights for policy 1, policy_version 1905343 (0.0006) [2023-12-28 08:55:38,347][106226] Updated weights for policy 0, policy_version 1901193 (0.0008) [2023-12-28 08:55:38,381][106225] Updated weights for policy 1, policy_version 1905353 (0.0008) [2023-12-28 08:55:38,403][106226] Updated weights for policy 0, policy_version 1901203 (0.0008) [2023-12-28 08:55:38,434][106225] Updated weights for policy 1, policy_version 1905363 (0.0007) [2023-12-28 08:55:38,452][106226] Updated weights for policy 0, policy_version 1901213 (0.0007) [2023-12-28 08:55:38,482][106225] Updated weights for policy 1, policy_version 1905373 (0.0007) [2023-12-28 08:55:38,502][106226] Updated weights for policy 0, policy_version 1901223 (0.0007) [2023-12-28 08:55:39,246][106226] Updated weights for policy 0, policy_version 1901233 (0.0008) [2023-12-28 08:55:39,249][106225] Updated weights for policy 1, policy_version 1905383 (0.0007) [2023-12-28 08:55:39,308][106225] Updated weights for policy 1, policy_version 1905393 (0.0006) [2023-12-28 08:55:39,314][106226] Updated weights for policy 0, policy_version 1901243 (0.0007) [2023-12-28 08:55:39,374][106225] Updated weights for policy 1, policy_version 1905403 (0.0006) [2023-12-28 08:55:39,378][106226] Updated weights for policy 0, policy_version 1901253 (0.0008) [2023-12-28 08:55:40,093][106225] Updated weights for policy 1, policy_version 1905413 (0.0008) [2023-12-28 08:55:40,141][106226] Updated weights for policy 0, policy_version 1901263 (0.0008) [2023-12-28 08:55:40,159][106225] Updated weights for policy 1, policy_version 1905423 (0.0006) [2023-12-28 08:55:40,197][106226] Updated weights for policy 0, policy_version 1901273 (0.0008) [2023-12-28 08:55:40,223][106225] Updated weights for policy 1, policy_version 1905433 (0.0006) [2023-12-28 08:55:40,266][106226] Updated weights for policy 0, policy_version 1901283 (0.0008) [2023-12-28 08:55:40,867][106225] Updated weights for policy 1, policy_version 1905443 (0.0006) [2023-12-28 08:55:40,928][106225] Updated weights for policy 1, policy_version 1905453 (0.0007) [2023-12-28 08:55:40,955][106226] Updated weights for policy 0, policy_version 1901293 (0.0009) [2023-12-28 08:55:40,986][106225] Updated weights for policy 1, policy_version 1905463 (0.0009) [2023-12-28 08:55:41,009][106226] Updated weights for policy 0, policy_version 1901303 (0.0011) [2023-12-28 08:55:41,074][106226] Updated weights for policy 0, policy_version 1901313 (0.0008) [2023-12-28 08:55:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 974675968. Throughput: 0: 9983.5, 1: 9783.4. Samples: 974641172. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:41,175][105115] Avg episode reward: [(0, '-4.169'), (1, '-4.377')] [2023-12-28 08:55:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001905472_487858176.pth... [2023-12-28 08:55:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001901320_486817792.pth... [2023-12-28 08:55:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001904320_487563264.pth [2023-12-28 08:55:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001900136_486514688.pth [2023-12-28 08:55:41,811][106225] Updated weights for policy 1, policy_version 1905473 (0.0007) [2023-12-28 08:55:41,841][106226] Updated weights for policy 0, policy_version 1901323 (0.0008) [2023-12-28 08:55:41,871][106225] Updated weights for policy 1, policy_version 1905483 (0.0006) [2023-12-28 08:55:41,897][106226] Updated weights for policy 0, policy_version 1901333 (0.0007) [2023-12-28 08:55:41,932][106225] Updated weights for policy 1, policy_version 1905493 (0.0007) [2023-12-28 08:55:41,951][106226] Updated weights for policy 0, policy_version 1901343 (0.0006) [2023-12-28 08:55:41,985][106225] Updated weights for policy 1, policy_version 1905503 (0.0006) [2023-12-28 08:55:42,715][106226] Updated weights for policy 0, policy_version 1901353 (0.0007) [2023-12-28 08:55:42,752][106225] Updated weights for policy 1, policy_version 1905513 (0.0007) [2023-12-28 08:55:42,774][106226] Updated weights for policy 0, policy_version 1901363 (0.0007) [2023-12-28 08:55:42,804][106225] Updated weights for policy 1, policy_version 1905523 (0.0008) [2023-12-28 08:55:42,837][106226] Updated weights for policy 0, policy_version 1901373 (0.0006) [2023-12-28 08:55:42,862][106225] Updated weights for policy 1, policy_version 1905533 (0.0008) [2023-12-28 08:55:42,901][106226] Updated weights for policy 0, policy_version 1901383 (0.0007) [2023-12-28 08:55:43,458][106225] Updated weights for policy 1, policy_version 1905543 (0.0008) [2023-12-28 08:55:43,523][106225] Updated weights for policy 1, policy_version 1905553 (0.0008) [2023-12-28 08:55:43,580][106225] Updated weights for policy 1, policy_version 1905563 (0.0008) [2023-12-28 08:55:43,588][106226] Updated weights for policy 0, policy_version 1901393 (0.0006) [2023-12-28 08:55:43,649][106226] Updated weights for policy 0, policy_version 1901403 (0.0009) [2023-12-28 08:55:43,706][106226] Updated weights for policy 0, policy_version 1901413 (0.0010) [2023-12-28 08:55:44,198][106225] Updated weights for policy 1, policy_version 1905573 (0.0006) [2023-12-28 08:55:44,263][106225] Updated weights for policy 1, policy_version 1905583 (0.0005) [2023-12-28 08:55:44,285][106226] Updated weights for policy 0, policy_version 1901423 (0.0008) [2023-12-28 08:55:44,334][106226] Updated weights for policy 0, policy_version 1901433 (0.0006) [2023-12-28 08:55:44,337][106225] Updated weights for policy 1, policy_version 1905593 (0.0005) [2023-12-28 08:55:44,399][106226] Updated weights for policy 0, policy_version 1901443 (0.0008) [2023-12-28 08:55:44,974][106225] Updated weights for policy 1, policy_version 1905603 (0.0007) [2023-12-28 08:55:45,038][106225] Updated weights for policy 1, policy_version 1905613 (0.0008) [2023-12-28 08:55:45,103][106225] Updated weights for policy 1, policy_version 1905623 (0.0008) [2023-12-28 08:55:45,149][106226] Updated weights for policy 0, policy_version 1901453 (0.0009) [2023-12-28 08:55:45,221][106226] Updated weights for policy 0, policy_version 1901463 (0.0011) [2023-12-28 08:55:45,292][106226] Updated weights for policy 0, policy_version 1901473 (0.0011) [2023-12-28 08:55:45,720][106225] Updated weights for policy 1, policy_version 1905633 (0.0008) [2023-12-28 08:55:45,775][106225] Updated weights for policy 1, policy_version 1905643 (0.0006) [2023-12-28 08:55:45,833][106225] Updated weights for policy 1, policy_version 1905653 (0.0005) [2023-12-28 08:55:45,888][106225] Updated weights for policy 1, policy_version 1905663 (0.0005) [2023-12-28 08:55:45,978][106226] Updated weights for policy 0, policy_version 1901483 (0.0011) [2023-12-28 08:55:46,031][106226] Updated weights for policy 0, policy_version 1901493 (0.0010) [2023-12-28 08:55:46,092][106226] Updated weights for policy 0, policy_version 1901503 (0.0011) [2023-12-28 08:55:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 974774272. Throughput: 0: 9914.1, 1: 9817.1. Samples: 974758916. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:46,176][105115] Avg episode reward: [(0, '-3.996'), (1, '-4.487')] [2023-12-28 08:55:46,531][106225] Updated weights for policy 1, policy_version 1905673 (0.0008) [2023-12-28 08:55:46,583][106225] Updated weights for policy 1, policy_version 1905683 (0.0008) [2023-12-28 08:55:46,643][106225] Updated weights for policy 1, policy_version 1905693 (0.0006) [2023-12-28 08:55:46,789][106226] Updated weights for policy 0, policy_version 1901513 (0.0010) [2023-12-28 08:55:46,860][106226] Updated weights for policy 0, policy_version 1901523 (0.0005) [2023-12-28 08:55:46,907][106226] Updated weights for policy 0, policy_version 1901533 (0.0005) [2023-12-28 08:55:46,956][106226] Updated weights for policy 0, policy_version 1901543 (0.0005) [2023-12-28 08:55:47,229][106225] Updated weights for policy 1, policy_version 1905703 (0.0010) [2023-12-28 08:55:47,272][106225] Updated weights for policy 1, policy_version 1905713 (0.0010) [2023-12-28 08:55:47,327][106225] Updated weights for policy 1, policy_version 1905723 (0.0007) [2023-12-28 08:55:47,469][106226] Updated weights for policy 0, policy_version 1901553 (0.0010) [2023-12-28 08:55:47,530][106226] Updated weights for policy 0, policy_version 1901563 (0.0011) [2023-12-28 08:55:47,588][106226] Updated weights for policy 0, policy_version 1901573 (0.0010) [2023-12-28 08:55:47,931][106225] Updated weights for policy 1, policy_version 1905733 (0.0008) [2023-12-28 08:55:47,989][106225] Updated weights for policy 1, policy_version 1905743 (0.0009) [2023-12-28 08:55:48,055][106225] Updated weights for policy 1, policy_version 1905753 (0.0008) [2023-12-28 08:55:48,241][106226] Updated weights for policy 0, policy_version 1901583 (0.0009) [2023-12-28 08:55:48,292][106226] Updated weights for policy 0, policy_version 1901593 (0.0011) [2023-12-28 08:55:48,357][106226] Updated weights for policy 0, policy_version 1901603 (0.0007) [2023-12-28 08:55:48,732][106225] Updated weights for policy 1, policy_version 1905763 (0.0008) [2023-12-28 08:55:48,795][106225] Updated weights for policy 1, policy_version 1905773 (0.0008) [2023-12-28 08:55:48,853][106225] Updated weights for policy 1, policy_version 1905783 (0.0008) [2023-12-28 08:55:49,099][106226] Updated weights for policy 0, policy_version 1901613 (0.0009) [2023-12-28 08:55:49,157][106226] Updated weights for policy 0, policy_version 1901623 (0.0008) [2023-12-28 08:55:49,207][106226] Updated weights for policy 0, policy_version 1901633 (0.0007) [2023-12-28 08:55:49,565][106225] Updated weights for policy 1, policy_version 1905793 (0.0008) [2023-12-28 08:55:49,632][106225] Updated weights for policy 1, policy_version 1905803 (0.0009) [2023-12-28 08:55:49,699][106225] Updated weights for policy 1, policy_version 1905813 (0.0008) [2023-12-28 08:55:49,764][106225] Updated weights for policy 1, policy_version 1905823 (0.0008) [2023-12-28 08:55:49,982][106226] Updated weights for policy 0, policy_version 1901643 (0.0008) [2023-12-28 08:55:50,045][106226] Updated weights for policy 0, policy_version 1901653 (0.0009) [2023-12-28 08:55:50,111][106226] Updated weights for policy 0, policy_version 1901663 (0.0007) [2023-12-28 08:55:50,416][106225] Updated weights for policy 1, policy_version 1905833 (0.0006) [2023-12-28 08:55:50,484][106225] Updated weights for policy 1, policy_version 1905843 (0.0006) [2023-12-28 08:55:50,549][106225] Updated weights for policy 1, policy_version 1905853 (0.0008) [2023-12-28 08:55:50,686][106226] Updated weights for policy 0, policy_version 1901673 (0.0005) [2023-12-28 08:55:50,755][106226] Updated weights for policy 0, policy_version 1901683 (0.0007) [2023-12-28 08:55:50,823][106226] Updated weights for policy 0, policy_version 1901693 (0.0009) [2023-12-28 08:55:50,884][106226] Updated weights for policy 0, policy_version 1901703 (0.0009) [2023-12-28 08:55:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 974872576. Throughput: 0: 9948.1, 1: 9854.7. Samples: 974882408. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:51,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.604')] [2023-12-28 08:55:51,214][106225] Updated weights for policy 1, policy_version 1905863 (0.0008) [2023-12-28 08:55:51,274][106225] Updated weights for policy 1, policy_version 1905873 (0.0007) [2023-12-28 08:55:51,336][106225] Updated weights for policy 1, policy_version 1905883 (0.0008) [2023-12-28 08:55:51,620][106226] Updated weights for policy 0, policy_version 1901713 (0.0007) [2023-12-28 08:55:51,687][106226] Updated weights for policy 0, policy_version 1901723 (0.0006) [2023-12-28 08:55:51,761][106226] Updated weights for policy 0, policy_version 1901733 (0.0008) [2023-12-28 08:55:52,140][106225] Updated weights for policy 1, policy_version 1905893 (0.0010) [2023-12-28 08:55:52,185][106225] Updated weights for policy 1, policy_version 1905903 (0.0008) [2023-12-28 08:55:52,238][106225] Updated weights for policy 1, policy_version 1905913 (0.0008) [2023-12-28 08:55:52,433][106226] Updated weights for policy 0, policy_version 1901743 (0.0008) [2023-12-28 08:55:52,489][106226] Updated weights for policy 0, policy_version 1901753 (0.0009) [2023-12-28 08:55:52,550][106226] Updated weights for policy 0, policy_version 1901763 (0.0008) [2023-12-28 08:55:53,001][106225] Updated weights for policy 1, policy_version 1905923 (0.0008) [2023-12-28 08:55:53,055][106225] Updated weights for policy 1, policy_version 1905933 (0.0008) [2023-12-28 08:55:53,109][106225] Updated weights for policy 1, policy_version 1905943 (0.0008) [2023-12-28 08:55:53,306][106226] Updated weights for policy 0, policy_version 1901773 (0.0008) [2023-12-28 08:55:53,363][106226] Updated weights for policy 0, policy_version 1901783 (0.0009) [2023-12-28 08:55:53,424][106226] Updated weights for policy 0, policy_version 1901793 (0.0009) [2023-12-28 08:55:53,833][106225] Updated weights for policy 1, policy_version 1905953 (0.0008) [2023-12-28 08:55:53,888][106225] Updated weights for policy 1, policy_version 1905963 (0.0006) [2023-12-28 08:55:53,935][106225] Updated weights for policy 1, policy_version 1905973 (0.0005) [2023-12-28 08:55:53,996][106225] Updated weights for policy 1, policy_version 1905983 (0.0008) [2023-12-28 08:55:54,175][106226] Updated weights for policy 0, policy_version 1901803 (0.0008) [2023-12-28 08:55:54,236][106226] Updated weights for policy 0, policy_version 1901813 (0.0008) [2023-12-28 08:55:54,298][106226] Updated weights for policy 0, policy_version 1901823 (0.0008) [2023-12-28 08:55:54,719][106225] Updated weights for policy 1, policy_version 1905993 (0.0010) [2023-12-28 08:55:54,773][106225] Updated weights for policy 1, policy_version 1906003 (0.0010) [2023-12-28 08:55:54,823][106225] Updated weights for policy 1, policy_version 1906013 (0.0010) [2023-12-28 08:55:54,985][106226] Updated weights for policy 0, policy_version 1901833 (0.0008) [2023-12-28 08:55:55,052][106226] Updated weights for policy 0, policy_version 1901843 (0.0007) [2023-12-28 08:55:55,119][106226] Updated weights for policy 0, policy_version 1901853 (0.0008) [2023-12-28 08:55:55,191][106226] Updated weights for policy 0, policy_version 1901863 (0.0008) [2023-12-28 08:55:55,551][106225] Updated weights for policy 1, policy_version 1906023 (0.0010) [2023-12-28 08:55:55,603][106225] Updated weights for policy 1, policy_version 1906033 (0.0010) [2023-12-28 08:55:55,657][106225] Updated weights for policy 1, policy_version 1906043 (0.0010) [2023-12-28 08:55:55,806][106226] Updated weights for policy 0, policy_version 1901873 (0.0008) [2023-12-28 08:55:55,860][106226] Updated weights for policy 0, policy_version 1901883 (0.0008) [2023-12-28 08:55:55,916][106226] Updated weights for policy 0, policy_version 1901893 (0.0008) [2023-12-28 08:55:56,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 974970880. Throughput: 0: 9896.5, 1: 9871.9. Samples: 974939404. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:55:56,175][105115] Avg episode reward: [(0, '-4.129'), (1, '-4.411')] [2023-12-28 08:55:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001906048_488005632.pth... [2023-12-28 08:55:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001901896_486965248.pth... [2023-12-28 08:55:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001900712_486662144.pth [2023-12-28 08:55:56,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001904896_487710720.pth [2023-12-28 08:55:56,383][106225] Updated weights for policy 1, policy_version 1906053 (0.0009) [2023-12-28 08:55:56,446][106225] Updated weights for policy 1, policy_version 1906063 (0.0007) [2023-12-28 08:55:56,499][106225] Updated weights for policy 1, policy_version 1906073 (0.0009) [2023-12-28 08:55:56,675][106226] Updated weights for policy 0, policy_version 1901903 (0.0008) [2023-12-28 08:55:56,724][106226] Updated weights for policy 0, policy_version 1901913 (0.0009) [2023-12-28 08:55:56,775][106226] Updated weights for policy 0, policy_version 1901923 (0.0008) [2023-12-28 08:55:57,133][106225] Updated weights for policy 1, policy_version 1906083 (0.0007) [2023-12-28 08:55:57,197][106225] Updated weights for policy 1, policy_version 1906093 (0.0006) [2023-12-28 08:55:57,256][106225] Updated weights for policy 1, policy_version 1906103 (0.0005) [2023-12-28 08:55:57,379][106226] Updated weights for policy 0, policy_version 1901933 (0.0007) [2023-12-28 08:55:57,447][106226] Updated weights for policy 0, policy_version 1901943 (0.0005) [2023-12-28 08:55:57,511][106226] Updated weights for policy 0, policy_version 1901953 (0.0005) [2023-12-28 08:55:57,897][106225] Updated weights for policy 1, policy_version 1906113 (0.0007) [2023-12-28 08:55:57,950][106225] Updated weights for policy 1, policy_version 1906123 (0.0008) [2023-12-28 08:55:57,997][106225] Updated weights for policy 1, policy_version 1906133 (0.0008) [2023-12-28 08:55:58,044][106225] Updated weights for policy 1, policy_version 1906143 (0.0008) [2023-12-28 08:55:58,061][106226] Updated weights for policy 0, policy_version 1901963 (0.0007) [2023-12-28 08:55:58,110][106226] Updated weights for policy 0, policy_version 1901973 (0.0010) [2023-12-28 08:55:58,167][106226] Updated weights for policy 0, policy_version 1901983 (0.0011) [2023-12-28 08:55:58,878][106225] Updated weights for policy 1, policy_version 1906153 (0.0007) [2023-12-28 08:55:58,955][106225] Updated weights for policy 1, policy_version 1906163 (0.0009) [2023-12-28 08:55:59,010][106226] Updated weights for policy 0, policy_version 1901993 (0.0010) [2023-12-28 08:55:59,019][106225] Updated weights for policy 1, policy_version 1906173 (0.0007) [2023-12-28 08:55:59,070][106226] Updated weights for policy 0, policy_version 1902003 (0.0008) [2023-12-28 08:55:59,128][106226] Updated weights for policy 0, policy_version 1902013 (0.0008) [2023-12-28 08:55:59,192][106226] Updated weights for policy 0, policy_version 1902023 (0.0008) [2023-12-28 08:55:59,631][106225] Updated weights for policy 1, policy_version 1906183 (0.0007) [2023-12-28 08:55:59,687][106225] Updated weights for policy 1, policy_version 1906193 (0.0006) [2023-12-28 08:55:59,747][106225] Updated weights for policy 1, policy_version 1906203 (0.0007) [2023-12-28 08:56:00,028][106226] Updated weights for policy 0, policy_version 1902033 (0.0007) [2023-12-28 08:56:00,083][106226] Updated weights for policy 0, policy_version 1902043 (0.0005) [2023-12-28 08:56:00,141][106226] Updated weights for policy 0, policy_version 1902053 (0.0006) [2023-12-28 08:56:00,463][106225] Updated weights for policy 1, policy_version 1906213 (0.0007) [2023-12-28 08:56:00,514][106225] Updated weights for policy 1, policy_version 1906223 (0.0005) [2023-12-28 08:56:00,559][106225] Updated weights for policy 1, policy_version 1906233 (0.0005) [2023-12-28 08:56:00,795][106226] Updated weights for policy 0, policy_version 1902063 (0.0010) [2023-12-28 08:56:00,840][106226] Updated weights for policy 0, policy_version 1902073 (0.0009) [2023-12-28 08:56:00,888][106226] Updated weights for policy 0, policy_version 1902083 (0.0010) [2023-12-28 08:56:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 975069184. Throughput: 0: 9949.8, 1: 9925.4. Samples: 975058556. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:01,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-4.529')] [2023-12-28 08:56:01,215][106225] Updated weights for policy 1, policy_version 1906243 (0.0006) [2023-12-28 08:56:01,279][106225] Updated weights for policy 1, policy_version 1906253 (0.0009) [2023-12-28 08:56:01,342][106225] Updated weights for policy 1, policy_version 1906263 (0.0007) [2023-12-28 08:56:01,614][106226] Updated weights for policy 0, policy_version 1902093 (0.0010) [2023-12-28 08:56:01,682][106226] Updated weights for policy 0, policy_version 1902103 (0.0011) [2023-12-28 08:56:01,756][106226] Updated weights for policy 0, policy_version 1902113 (0.0011) [2023-12-28 08:56:02,059][106225] Updated weights for policy 1, policy_version 1906273 (0.0008) [2023-12-28 08:56:02,111][106225] Updated weights for policy 1, policy_version 1906283 (0.0009) [2023-12-28 08:56:02,170][106225] Updated weights for policy 1, policy_version 1906293 (0.0009) [2023-12-28 08:56:02,231][106225] Updated weights for policy 1, policy_version 1906303 (0.0007) [2023-12-28 08:56:02,487][106226] Updated weights for policy 0, policy_version 1902123 (0.0011) [2023-12-28 08:56:02,545][106226] Updated weights for policy 0, policy_version 1902133 (0.0011) [2023-12-28 08:56:02,605][106226] Updated weights for policy 0, policy_version 1902143 (0.0010) [2023-12-28 08:56:02,904][106225] Updated weights for policy 1, policy_version 1906313 (0.0010) [2023-12-28 08:56:02,961][106225] Updated weights for policy 1, policy_version 1906323 (0.0010) [2023-12-28 08:56:03,018][106225] Updated weights for policy 1, policy_version 1906333 (0.0006) [2023-12-28 08:56:03,230][106226] Updated weights for policy 0, policy_version 1902153 (0.0008) [2023-12-28 08:56:03,291][106226] Updated weights for policy 0, policy_version 1902163 (0.0005) [2023-12-28 08:56:03,349][106226] Updated weights for policy 0, policy_version 1902173 (0.0005) [2023-12-28 08:56:03,399][106226] Updated weights for policy 0, policy_version 1902183 (0.0008) [2023-12-28 08:56:03,721][106225] Updated weights for policy 1, policy_version 1906343 (0.0009) [2023-12-28 08:56:03,774][106225] Updated weights for policy 1, policy_version 1906353 (0.0010) [2023-12-28 08:56:03,825][106225] Updated weights for policy 1, policy_version 1906363 (0.0009) [2023-12-28 08:56:04,074][106226] Updated weights for policy 0, policy_version 1902193 (0.0008) [2023-12-28 08:56:04,140][106226] Updated weights for policy 0, policy_version 1902203 (0.0008) [2023-12-28 08:56:04,204][106226] Updated weights for policy 0, policy_version 1902213 (0.0010) [2023-12-28 08:56:04,547][106225] Updated weights for policy 1, policy_version 1906373 (0.0009) [2023-12-28 08:56:04,607][106225] Updated weights for policy 1, policy_version 1906383 (0.0010) [2023-12-28 08:56:04,675][106225] Updated weights for policy 1, policy_version 1906393 (0.0010) [2023-12-28 08:56:04,914][106226] Updated weights for policy 0, policy_version 1902223 (0.0009) [2023-12-28 08:56:04,961][106226] Updated weights for policy 0, policy_version 1902233 (0.0007) [2023-12-28 08:56:05,008][106226] Updated weights for policy 0, policy_version 1902243 (0.0008) [2023-12-28 08:56:05,386][106225] Updated weights for policy 1, policy_version 1906403 (0.0010) [2023-12-28 08:56:05,438][106225] Updated weights for policy 1, policy_version 1906413 (0.0010) [2023-12-28 08:56:05,485][106225] Updated weights for policy 1, policy_version 1906423 (0.0010) [2023-12-28 08:56:05,589][106226] Updated weights for policy 0, policy_version 1902253 (0.0006) [2023-12-28 08:56:05,633][106226] Updated weights for policy 0, policy_version 1902263 (0.0008) [2023-12-28 08:56:05,682][106226] Updated weights for policy 0, policy_version 1902273 (0.0008) [2023-12-28 08:56:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 975167488. Throughput: 0: 9982.5, 1: 9907.9. Samples: 975179104. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:06,175][105115] Avg episode reward: [(0, '-4.594'), (1, '-4.427')] [2023-12-28 08:56:06,213][106225] Updated weights for policy 1, policy_version 1906433 (0.0010) [2023-12-28 08:56:06,275][106225] Updated weights for policy 1, policy_version 1906443 (0.0011) [2023-12-28 08:56:06,340][106225] Updated weights for policy 1, policy_version 1906453 (0.0011) [2023-12-28 08:56:06,405][106225] Updated weights for policy 1, policy_version 1906463 (0.0011) [2023-12-28 08:56:06,422][106226] Updated weights for policy 0, policy_version 1902283 (0.0007) [2023-12-28 08:56:06,488][106226] Updated weights for policy 0, policy_version 1902293 (0.0008) [2023-12-28 08:56:06,546][106226] Updated weights for policy 0, policy_version 1902303 (0.0011) [2023-12-28 08:56:07,069][106225] Updated weights for policy 1, policy_version 1906473 (0.0010) [2023-12-28 08:56:07,129][106225] Updated weights for policy 1, policy_version 1906483 (0.0010) [2023-12-28 08:56:07,181][106225] Updated weights for policy 1, policy_version 1906493 (0.0010) [2023-12-28 08:56:07,215][106226] Updated weights for policy 0, policy_version 1902313 (0.0010) [2023-12-28 08:56:07,283][106226] Updated weights for policy 0, policy_version 1902323 (0.0011) [2023-12-28 08:56:07,349][106226] Updated weights for policy 0, policy_version 1902333 (0.0011) [2023-12-28 08:56:07,401][106226] Updated weights for policy 0, policy_version 1902343 (0.0007) [2023-12-28 08:56:07,853][106225] Updated weights for policy 1, policy_version 1906503 (0.0010) [2023-12-28 08:56:07,912][106225] Updated weights for policy 1, policy_version 1906513 (0.0006) [2023-12-28 08:56:07,963][106225] Updated weights for policy 1, policy_version 1906523 (0.0005) [2023-12-28 08:56:08,054][106226] Updated weights for policy 0, policy_version 1902353 (0.0008) [2023-12-28 08:56:08,107][106226] Updated weights for policy 0, policy_version 1902363 (0.0006) [2023-12-28 08:56:08,154][106226] Updated weights for policy 0, policy_version 1902373 (0.0007) [2023-12-28 08:56:08,597][106225] Updated weights for policy 1, policy_version 1906533 (0.0007) [2023-12-28 08:56:08,650][106225] Updated weights for policy 1, policy_version 1906543 (0.0007) [2023-12-28 08:56:08,703][106225] Updated weights for policy 1, policy_version 1906553 (0.0005) [2023-12-28 08:56:08,920][106226] Updated weights for policy 0, policy_version 1902383 (0.0008) [2023-12-28 08:56:08,984][106226] Updated weights for policy 0, policy_version 1902393 (0.0007) [2023-12-28 08:56:09,047][106226] Updated weights for policy 0, policy_version 1902403 (0.0006) [2023-12-28 08:56:09,417][106225] Updated weights for policy 1, policy_version 1906563 (0.0007) [2023-12-28 08:56:09,483][106225] Updated weights for policy 1, policy_version 1906573 (0.0010) [2023-12-28 08:56:09,544][106225] Updated weights for policy 1, policy_version 1906583 (0.0010) [2023-12-28 08:56:09,795][106226] Updated weights for policy 0, policy_version 1902413 (0.0009) [2023-12-28 08:56:09,864][106226] Updated weights for policy 0, policy_version 1902423 (0.0009) [2023-12-28 08:56:09,931][106226] Updated weights for policy 0, policy_version 1902433 (0.0009) [2023-12-28 08:56:10,268][106225] Updated weights for policy 1, policy_version 1906593 (0.0010) [2023-12-28 08:56:10,335][106225] Updated weights for policy 1, policy_version 1906603 (0.0010) [2023-12-28 08:56:10,397][106225] Updated weights for policy 1, policy_version 1906613 (0.0011) [2023-12-28 08:56:10,462][106225] Updated weights for policy 1, policy_version 1906623 (0.0010) [2023-12-28 08:56:10,621][106226] Updated weights for policy 0, policy_version 1902443 (0.0009) [2023-12-28 08:56:10,676][106226] Updated weights for policy 0, policy_version 1902453 (0.0011) [2023-12-28 08:56:10,732][106226] Updated weights for policy 0, policy_version 1902463 (0.0011) [2023-12-28 08:56:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 975265792. Throughput: 0: 10015.7, 1: 9974.8. Samples: 975239928. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:11,175][105115] Avg episode reward: [(0, '-4.560'), (1, '-4.729')] [2023-12-28 08:56:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001902472_487112704.pth... [2023-12-28 08:56:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001906624_488153088.pth... [2023-12-28 08:56:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001901320_486817792.pth [2023-12-28 08:56:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001905472_487858176.pth [2023-12-28 08:56:11,243][106225] Updated weights for policy 1, policy_version 1906633 (0.0009) [2023-12-28 08:56:11,315][106225] Updated weights for policy 1, policy_version 1906643 (0.0010) [2023-12-28 08:56:11,379][106225] Updated weights for policy 1, policy_version 1906653 (0.0010) [2023-12-28 08:56:11,470][106226] Updated weights for policy 0, policy_version 1902473 (0.0010) [2023-12-28 08:56:11,531][106226] Updated weights for policy 0, policy_version 1902483 (0.0011) [2023-12-28 08:56:11,593][106226] Updated weights for policy 0, policy_version 1902493 (0.0011) [2023-12-28 08:56:11,665][106226] Updated weights for policy 0, policy_version 1902503 (0.0012) [2023-12-28 08:56:12,161][106225] Updated weights for policy 1, policy_version 1906663 (0.0011) [2023-12-28 08:56:12,215][106225] Updated weights for policy 1, policy_version 1906673 (0.0010) [2023-12-28 08:56:12,279][106225] Updated weights for policy 1, policy_version 1906683 (0.0010) [2023-12-28 08:56:12,324][106226] Updated weights for policy 0, policy_version 1902513 (0.0010) [2023-12-28 08:56:12,395][106226] Updated weights for policy 0, policy_version 1902523 (0.0009) [2023-12-28 08:56:12,459][106226] Updated weights for policy 0, policy_version 1902533 (0.0008) [2023-12-28 08:56:13,048][106225] Updated weights for policy 1, policy_version 1906693 (0.0007) [2023-12-28 08:56:13,095][106226] Updated weights for policy 0, policy_version 1902543 (0.0006) [2023-12-28 08:56:13,113][106225] Updated weights for policy 1, policy_version 1906703 (0.0009) [2023-12-28 08:56:13,158][106226] Updated weights for policy 0, policy_version 1902553 (0.0009) [2023-12-28 08:56:13,161][106225] Updated weights for policy 1, policy_version 1906713 (0.0008) [2023-12-28 08:56:13,224][106226] Updated weights for policy 0, policy_version 1902563 (0.0010) [2023-12-28 08:56:13,784][106225] Updated weights for policy 1, policy_version 1906723 (0.0007) [2023-12-28 08:56:13,834][106225] Updated weights for policy 1, policy_version 1906733 (0.0006) [2023-12-28 08:56:13,886][106225] Updated weights for policy 1, policy_version 1906743 (0.0005) [2023-12-28 08:56:13,897][106226] Updated weights for policy 0, policy_version 1902573 (0.0010) [2023-12-28 08:56:13,949][106226] Updated weights for policy 0, policy_version 1902583 (0.0009) [2023-12-28 08:56:14,004][106226] Updated weights for policy 0, policy_version 1902593 (0.0007) [2023-12-28 08:56:14,510][106225] Updated weights for policy 1, policy_version 1906753 (0.0005) [2023-12-28 08:56:14,564][106225] Updated weights for policy 1, policy_version 1906763 (0.0008) [2023-12-28 08:56:14,615][106225] Updated weights for policy 1, policy_version 1906773 (0.0008) [2023-12-28 08:56:14,619][106226] Updated weights for policy 0, policy_version 1902603 (0.0006) [2023-12-28 08:56:14,664][106225] Updated weights for policy 1, policy_version 1906783 (0.0008) [2023-12-28 08:56:14,674][106226] Updated weights for policy 0, policy_version 1902613 (0.0006) [2023-12-28 08:56:14,733][106226] Updated weights for policy 0, policy_version 1902623 (0.0009) [2023-12-28 08:56:15,411][106225] Updated weights for policy 1, policy_version 1906793 (0.0008) [2023-12-28 08:56:15,466][106225] Updated weights for policy 1, policy_version 1906803 (0.0008) [2023-12-28 08:56:15,467][106226] Updated weights for policy 0, policy_version 1902633 (0.0008) [2023-12-28 08:56:15,520][106225] Updated weights for policy 1, policy_version 1906813 (0.0007) [2023-12-28 08:56:15,533][106226] Updated weights for policy 0, policy_version 1902643 (0.0005) [2023-12-28 08:56:15,600][106226] Updated weights for policy 0, policy_version 1902653 (0.0005) [2023-12-28 08:56:15,660][106226] Updated weights for policy 0, policy_version 1902663 (0.0006) [2023-12-28 08:56:16,163][106225] Updated weights for policy 1, policy_version 1906823 (0.0008) [2023-12-28 08:56:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 975364096. Throughput: 0: 9923.8, 1: 9939.1. Samples: 975357352. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:16,175][105115] Avg episode reward: [(0, '-4.120'), (1, '-4.759')] [2023-12-28 08:56:16,216][106225] Updated weights for policy 1, policy_version 1906833 (0.0008) [2023-12-28 08:56:16,274][106225] Updated weights for policy 1, policy_version 1906843 (0.0008) [2023-12-28 08:56:16,384][106226] Updated weights for policy 0, policy_version 1902673 (0.0007) [2023-12-28 08:56:16,438][106226] Updated weights for policy 0, policy_version 1902683 (0.0006) [2023-12-28 08:56:16,497][106226] Updated weights for policy 0, policy_version 1902693 (0.0006) [2023-12-28 08:56:16,993][106225] Updated weights for policy 1, policy_version 1906853 (0.0009) [2023-12-28 08:56:17,036][106225] Updated weights for policy 1, policy_version 1906863 (0.0010) [2023-12-28 08:56:17,091][106225] Updated weights for policy 1, policy_version 1906873 (0.0010) [2023-12-28 08:56:17,220][106226] Updated weights for policy 0, policy_version 1902703 (0.0005) [2023-12-28 08:56:17,279][106226] Updated weights for policy 0, policy_version 1902713 (0.0008) [2023-12-28 08:56:17,331][106226] Updated weights for policy 0, policy_version 1902723 (0.0009) [2023-12-28 08:56:17,682][106225] Updated weights for policy 1, policy_version 1906883 (0.0006) [2023-12-28 08:56:17,739][106225] Updated weights for policy 1, policy_version 1906893 (0.0005) [2023-12-28 08:56:17,793][106225] Updated weights for policy 1, policy_version 1906903 (0.0005) [2023-12-28 08:56:18,094][106226] Updated weights for policy 0, policy_version 1902733 (0.0009) [2023-12-28 08:56:18,150][106226] Updated weights for policy 0, policy_version 1902743 (0.0008) [2023-12-28 08:56:18,198][106226] Updated weights for policy 0, policy_version 1902753 (0.0008) [2023-12-28 08:56:18,487][106225] Updated weights for policy 1, policy_version 1906913 (0.0008) [2023-12-28 08:56:18,549][106225] Updated weights for policy 1, policy_version 1906923 (0.0011) [2023-12-28 08:56:18,607][106225] Updated weights for policy 1, policy_version 1906933 (0.0010) [2023-12-28 08:56:18,665][106225] Updated weights for policy 1, policy_version 1906943 (0.0010) [2023-12-28 08:56:18,991][106226] Updated weights for policy 0, policy_version 1902763 (0.0008) [2023-12-28 08:56:19,054][106226] Updated weights for policy 0, policy_version 1902773 (0.0008) [2023-12-28 08:56:19,116][106226] Updated weights for policy 0, policy_version 1902783 (0.0010) [2023-12-28 08:56:19,354][106225] Updated weights for policy 1, policy_version 1906953 (0.0007) [2023-12-28 08:56:19,409][106225] Updated weights for policy 1, policy_version 1906963 (0.0006) [2023-12-28 08:56:19,468][106225] Updated weights for policy 1, policy_version 1906973 (0.0007) [2023-12-28 08:56:19,926][106226] Updated weights for policy 0, policy_version 1902793 (0.0009) [2023-12-28 08:56:19,996][106226] Updated weights for policy 0, policy_version 1902803 (0.0009) [2023-12-28 08:56:20,050][106226] Updated weights for policy 0, policy_version 1902813 (0.0009) [2023-12-28 08:56:20,108][106226] Updated weights for policy 0, policy_version 1902823 (0.0009) [2023-12-28 08:56:20,256][106225] Updated weights for policy 1, policy_version 1906983 (0.0009) [2023-12-28 08:56:20,315][106225] Updated weights for policy 1, policy_version 1906993 (0.0008) [2023-12-28 08:56:20,374][106225] Updated weights for policy 1, policy_version 1907003 (0.0008) [2023-12-28 08:56:20,844][106226] Updated weights for policy 0, policy_version 1902833 (0.0008) [2023-12-28 08:56:20,902][106226] Updated weights for policy 0, policy_version 1902843 (0.0009) [2023-12-28 08:56:20,957][106226] Updated weights for policy 0, policy_version 1902853 (0.0008) [2023-12-28 08:56:21,055][106225] Updated weights for policy 1, policy_version 1907013 (0.0008) [2023-12-28 08:56:21,121][106225] Updated weights for policy 1, policy_version 1907023 (0.0006) [2023-12-28 08:56:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 975462400. Throughput: 0: 9808.5, 1: 9979.8. Samples: 975473164. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:21,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.536')] [2023-12-28 08:56:21,189][106225] Updated weights for policy 1, policy_version 1907033 (0.0006) [2023-12-28 08:56:21,757][106226] Updated weights for policy 0, policy_version 1902863 (0.0009) [2023-12-28 08:56:21,821][106226] Updated weights for policy 0, policy_version 1902873 (0.0008) [2023-12-28 08:56:21,884][106226] Updated weights for policy 0, policy_version 1902883 (0.0008) [2023-12-28 08:56:21,949][106225] Updated weights for policy 1, policy_version 1907043 (0.0007) [2023-12-28 08:56:22,009][106225] Updated weights for policy 1, policy_version 1907053 (0.0007) [2023-12-28 08:56:22,073][106225] Updated weights for policy 1, policy_version 1907063 (0.0007) [2023-12-28 08:56:22,628][106226] Updated weights for policy 0, policy_version 1902893 (0.0008) [2023-12-28 08:56:22,689][106226] Updated weights for policy 0, policy_version 1902903 (0.0009) [2023-12-28 08:56:22,753][106226] Updated weights for policy 0, policy_version 1902913 (0.0007) [2023-12-28 08:56:22,797][106225] Updated weights for policy 1, policy_version 1907073 (0.0007) [2023-12-28 08:56:22,855][106225] Updated weights for policy 1, policy_version 1907083 (0.0007) [2023-12-28 08:56:22,919][106225] Updated weights for policy 1, policy_version 1907093 (0.0008) [2023-12-28 08:56:22,980][106225] Updated weights for policy 1, policy_version 1907103 (0.0008) [2023-12-28 08:56:23,460][106226] Updated weights for policy 0, policy_version 1902923 (0.0008) [2023-12-28 08:56:23,506][106226] Updated weights for policy 0, policy_version 1902933 (0.0010) [2023-12-28 08:56:23,553][106226] Updated weights for policy 0, policy_version 1902943 (0.0010) [2023-12-28 08:56:23,701][106225] Updated weights for policy 1, policy_version 1907113 (0.0007) [2023-12-28 08:56:23,747][106225] Updated weights for policy 1, policy_version 1907123 (0.0007) [2023-12-28 08:56:23,794][106225] Updated weights for policy 1, policy_version 1907133 (0.0008) [2023-12-28 08:56:24,331][106226] Updated weights for policy 0, policy_version 1902953 (0.0010) [2023-12-28 08:56:24,395][106226] Updated weights for policy 0, policy_version 1902963 (0.0008) [2023-12-28 08:56:24,463][106226] Updated weights for policy 0, policy_version 1902973 (0.0008) [2023-12-28 08:56:24,528][106226] Updated weights for policy 0, policy_version 1902983 (0.0009) [2023-12-28 08:56:24,584][106225] Updated weights for policy 1, policy_version 1907143 (0.0009) [2023-12-28 08:56:24,646][106225] Updated weights for policy 1, policy_version 1907153 (0.0008) [2023-12-28 08:56:24,710][106225] Updated weights for policy 1, policy_version 1907163 (0.0008) [2023-12-28 08:56:25,217][106226] Updated weights for policy 0, policy_version 1902993 (0.0007) [2023-12-28 08:56:25,285][106226] Updated weights for policy 0, policy_version 1903003 (0.0008) [2023-12-28 08:56:25,349][106226] Updated weights for policy 0, policy_version 1903013 (0.0008) [2023-12-28 08:56:25,434][106225] Updated weights for policy 1, policy_version 1907173 (0.0007) [2023-12-28 08:56:25,485][106225] Updated weights for policy 1, policy_version 1907183 (0.0005) [2023-12-28 08:56:25,537][106225] Updated weights for policy 1, policy_version 1907193 (0.0005) [2023-12-28 08:56:26,058][106225] Updated weights for policy 1, policy_version 1907203 (0.0005) [2023-12-28 08:56:26,075][106226] Updated weights for policy 0, policy_version 1903023 (0.0008) [2023-12-28 08:56:26,113][106225] Updated weights for policy 1, policy_version 1907213 (0.0005) [2023-12-28 08:56:26,129][106226] Updated weights for policy 0, policy_version 1903033 (0.0008) [2023-12-28 08:56:26,161][106225] Updated weights for policy 1, policy_version 1907223 (0.0006) [2023-12-28 08:56:26,175][105115] Fps is (10 sec: 18841.2, 60 sec: 19660.9, 300 sec: 19771.9). Total num frames: 975552512. Throughput: 0: 9804.8, 1: 9955.6. Samples: 975530388. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:26,175][105115] Avg episode reward: [(0, '-4.273'), (1, '-4.623')] [2023-12-28 08:56:26,184][106226] Updated weights for policy 0, policy_version 1903043 (0.0008) [2023-12-28 08:56:26,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001903048_487260160.pth... [2023-12-28 08:56:26,207][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001907232_488308736.pth... [2023-12-28 08:56:26,210][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001901896_486965248.pth [2023-12-28 08:56:26,212][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001906048_488005632.pth [2023-12-28 08:56:26,765][106225] Updated weights for policy 1, policy_version 1907233 (0.0006) [2023-12-28 08:56:26,818][106225] Updated weights for policy 1, policy_version 1907243 (0.0007) [2023-12-28 08:56:26,869][106225] Updated weights for policy 1, policy_version 1907253 (0.0006) [2023-12-28 08:56:26,898][106226] Updated weights for policy 0, policy_version 1903053 (0.0007) [2023-12-28 08:56:26,922][106225] Updated weights for policy 1, policy_version 1907263 (0.0008) [2023-12-28 08:56:26,950][106226] Updated weights for policy 0, policy_version 1903063 (0.0005) [2023-12-28 08:56:27,012][106226] Updated weights for policy 0, policy_version 1903073 (0.0009) [2023-12-28 08:56:27,634][106226] Updated weights for policy 0, policy_version 1903083 (0.0006) [2023-12-28 08:56:27,647][106225] Updated weights for policy 1, policy_version 1907273 (0.0005) [2023-12-28 08:56:27,681][106226] Updated weights for policy 0, policy_version 1903093 (0.0005) [2023-12-28 08:56:27,692][106225] Updated weights for policy 1, policy_version 1907283 (0.0005) [2023-12-28 08:56:27,742][106226] Updated weights for policy 0, policy_version 1903103 (0.0006) [2023-12-28 08:56:27,744][106225] Updated weights for policy 1, policy_version 1907293 (0.0005) [2023-12-28 08:56:28,264][106226] Updated weights for policy 0, policy_version 1903113 (0.0006) [2023-12-28 08:56:28,323][106226] Updated weights for policy 0, policy_version 1903123 (0.0008) [2023-12-28 08:56:28,387][106226] Updated weights for policy 0, policy_version 1903133 (0.0007) [2023-12-28 08:56:28,412][106225] Updated weights for policy 1, policy_version 1907303 (0.0006) [2023-12-28 08:56:28,446][106226] Updated weights for policy 0, policy_version 1903143 (0.0008) [2023-12-28 08:56:28,478][106225] Updated weights for policy 1, policy_version 1907313 (0.0007) [2023-12-28 08:56:28,543][106225] Updated weights for policy 1, policy_version 1907323 (0.0008) [2023-12-28 08:56:29,070][106226] Updated weights for policy 0, policy_version 1903153 (0.0007) [2023-12-28 08:56:29,126][106226] Updated weights for policy 0, policy_version 1903163 (0.0010) [2023-12-28 08:56:29,161][106225] Updated weights for policy 1, policy_version 1907333 (0.0007) [2023-12-28 08:56:29,179][106226] Updated weights for policy 0, policy_version 1903173 (0.0010) [2023-12-28 08:56:29,218][106225] Updated weights for policy 1, policy_version 1907343 (0.0007) [2023-12-28 08:56:29,277][106225] Updated weights for policy 1, policy_version 1907353 (0.0008) [2023-12-28 08:56:29,923][106226] Updated weights for policy 0, policy_version 1903183 (0.0009) [2023-12-28 08:56:29,985][106225] Updated weights for policy 1, policy_version 1907363 (0.0007) [2023-12-28 08:56:29,991][106226] Updated weights for policy 0, policy_version 1903193 (0.0007) [2023-12-28 08:56:30,047][106225] Updated weights for policy 1, policy_version 1907373 (0.0010) [2023-12-28 08:56:30,050][106226] Updated weights for policy 0, policy_version 1903203 (0.0008) [2023-12-28 08:56:30,105][106225] Updated weights for policy 1, policy_version 1907383 (0.0010) [2023-12-28 08:56:30,807][106226] Updated weights for policy 0, policy_version 1903213 (0.0009) [2023-12-28 08:56:30,838][106225] Updated weights for policy 1, policy_version 1907393 (0.0010) [2023-12-28 08:56:30,852][106226] Updated weights for policy 0, policy_version 1903223 (0.0007) [2023-12-28 08:56:30,891][106225] Updated weights for policy 1, policy_version 1907403 (0.0008) [2023-12-28 08:56:30,901][106226] Updated weights for policy 0, policy_version 1903233 (0.0007) [2023-12-28 08:56:30,953][106225] Updated weights for policy 1, policy_version 1907413 (0.0007) [2023-12-28 08:56:31,011][106225] Updated weights for policy 1, policy_version 1907423 (0.0008) [2023-12-28 08:56:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 975667200. Throughput: 0: 9883.9, 1: 10019.9. Samples: 975654588. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:31,175][105115] Avg episode reward: [(0, '-4.469'), (1, '-4.346')] [2023-12-28 08:56:31,713][106226] Updated weights for policy 0, policy_version 1903243 (0.0007) [2023-12-28 08:56:31,736][106225] Updated weights for policy 1, policy_version 1907433 (0.0007) [2023-12-28 08:56:31,778][106226] Updated weights for policy 0, policy_version 1903253 (0.0008) [2023-12-28 08:56:31,797][106225] Updated weights for policy 1, policy_version 1907443 (0.0008) [2023-12-28 08:56:31,836][106226] Updated weights for policy 0, policy_version 1903263 (0.0007) [2023-12-28 08:56:31,851][106225] Updated weights for policy 1, policy_version 1907453 (0.0008) [2023-12-28 08:56:32,549][106226] Updated weights for policy 0, policy_version 1903273 (0.0006) [2023-12-28 08:56:32,578][106225] Updated weights for policy 1, policy_version 1907463 (0.0008) [2023-12-28 08:56:32,607][106226] Updated weights for policy 0, policy_version 1903283 (0.0005) [2023-12-28 08:56:32,640][106225] Updated weights for policy 1, policy_version 1907473 (0.0008) [2023-12-28 08:56:32,658][106226] Updated weights for policy 0, policy_version 1903293 (0.0007) [2023-12-28 08:56:32,702][106225] Updated weights for policy 1, policy_version 1907483 (0.0007) [2023-12-28 08:56:32,712][106226] Updated weights for policy 0, policy_version 1903303 (0.0008) [2023-12-28 08:56:33,379][106226] Updated weights for policy 0, policy_version 1903313 (0.0005) [2023-12-28 08:56:33,393][106225] Updated weights for policy 1, policy_version 1907493 (0.0008) [2023-12-28 08:56:33,437][106226] Updated weights for policy 0, policy_version 1903323 (0.0006) [2023-12-28 08:56:33,445][106225] Updated weights for policy 1, policy_version 1907503 (0.0008) [2023-12-28 08:56:33,495][106225] Updated weights for policy 1, policy_version 1907513 (0.0008) [2023-12-28 08:56:33,498][106226] Updated weights for policy 0, policy_version 1903333 (0.0005) [2023-12-28 08:56:34,095][106226] Updated weights for policy 0, policy_version 1903343 (0.0007) [2023-12-28 08:56:34,162][106226] Updated weights for policy 0, policy_version 1903353 (0.0009) [2023-12-28 08:56:34,216][106226] Updated weights for policy 0, policy_version 1903363 (0.0008) [2023-12-28 08:56:34,259][106225] Updated weights for policy 1, policy_version 1907524 (0.0008) [2023-12-28 08:56:34,323][106225] Updated weights for policy 1, policy_version 1907534 (0.0008) [2023-12-28 08:56:34,382][106225] Updated weights for policy 1, policy_version 1907544 (0.0008) [2023-12-28 08:56:34,953][106226] Updated weights for policy 0, policy_version 1903373 (0.0008) [2023-12-28 08:56:35,000][106226] Updated weights for policy 0, policy_version 1903383 (0.0005) [2023-12-28 08:56:35,062][106226] Updated weights for policy 0, policy_version 1903393 (0.0006) [2023-12-28 08:56:35,144][106225] Updated weights for policy 1, policy_version 1907554 (0.0008) [2023-12-28 08:56:35,215][106225] Updated weights for policy 1, policy_version 1907564 (0.0010) [2023-12-28 08:56:35,279][106225] Updated weights for policy 1, policy_version 1907574 (0.0009) [2023-12-28 08:56:35,340][106225] Updated weights for policy 1, policy_version 1907584 (0.0007) [2023-12-28 08:56:35,599][106226] Updated weights for policy 0, policy_version 1903403 (0.0007) [2023-12-28 08:56:35,656][106226] Updated weights for policy 0, policy_version 1903413 (0.0010) [2023-12-28 08:56:35,715][106226] Updated weights for policy 0, policy_version 1903423 (0.0005) [2023-12-28 08:56:36,145][106225] Updated weights for policy 1, policy_version 1907594 (0.0009) [2023-12-28 08:56:36,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 975757312. Throughput: 0: 9904.4, 1: 9881.5. Samples: 975772776. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:36,175][105115] Avg episode reward: [(0, '-4.319'), (1, '-4.798')] [2023-12-28 08:56:36,207][106225] Updated weights for policy 1, policy_version 1907604 (0.0009) [2023-12-28 08:56:36,267][106225] Updated weights for policy 1, policy_version 1907614 (0.0008) [2023-12-28 08:56:36,316][106226] Updated weights for policy 0, policy_version 1903433 (0.0006) [2023-12-28 08:56:36,376][106226] Updated weights for policy 0, policy_version 1903443 (0.0009) [2023-12-28 08:56:36,440][106226] Updated weights for policy 0, policy_version 1903453 (0.0009) [2023-12-28 08:56:36,506][106226] Updated weights for policy 0, policy_version 1903463 (0.0009) [2023-12-28 08:56:37,014][106225] Updated weights for policy 1, policy_version 1907624 (0.0006) [2023-12-28 08:56:37,080][106225] Updated weights for policy 1, policy_version 1907634 (0.0006) [2023-12-28 08:56:37,140][106226] Updated weights for policy 0, policy_version 1903473 (0.0007) [2023-12-28 08:56:37,146][106225] Updated weights for policy 1, policy_version 1907644 (0.0006) [2023-12-28 08:56:37,195][106226] Updated weights for policy 0, policy_version 1903483 (0.0007) [2023-12-28 08:56:37,251][106226] Updated weights for policy 0, policy_version 1903493 (0.0008) [2023-12-28 08:56:37,845][106225] Updated weights for policy 1, policy_version 1907654 (0.0009) [2023-12-28 08:56:37,904][106225] Updated weights for policy 1, policy_version 1907664 (0.0007) [2023-12-28 08:56:37,955][106226] Updated weights for policy 0, policy_version 1903503 (0.0006) [2023-12-28 08:56:37,960][106225] Updated weights for policy 1, policy_version 1907674 (0.0008) [2023-12-28 08:56:38,016][106226] Updated weights for policy 0, policy_version 1903513 (0.0008) [2023-12-28 08:56:38,077][106226] Updated weights for policy 0, policy_version 1903523 (0.0005) [2023-12-28 08:56:38,642][106225] Updated weights for policy 1, policy_version 1907684 (0.0008) [2023-12-28 08:56:38,700][106225] Updated weights for policy 1, policy_version 1907694 (0.0006) [2023-12-28 08:56:38,759][106225] Updated weights for policy 1, policy_version 1907704 (0.0008) [2023-12-28 08:56:38,769][106226] Updated weights for policy 0, policy_version 1903533 (0.0006) [2023-12-28 08:56:38,830][106226] Updated weights for policy 0, policy_version 1903543 (0.0007) [2023-12-28 08:56:38,891][106226] Updated weights for policy 0, policy_version 1903553 (0.0009) [2023-12-28 08:56:39,485][106225] Updated weights for policy 1, policy_version 1907714 (0.0006) [2023-12-28 08:56:39,553][106225] Updated weights for policy 1, policy_version 1907724 (0.0006) [2023-12-28 08:56:39,616][106225] Updated weights for policy 1, policy_version 1907734 (0.0008) [2023-12-28 08:56:39,622][106226] Updated weights for policy 0, policy_version 1903563 (0.0007) [2023-12-28 08:56:39,672][106225] Updated weights for policy 1, policy_version 1907744 (0.0007) [2023-12-28 08:56:39,681][106226] Updated weights for policy 0, policy_version 1903573 (0.0007) [2023-12-28 08:56:39,732][106226] Updated weights for policy 0, policy_version 1903583 (0.0007) [2023-12-28 08:56:40,440][106225] Updated weights for policy 1, policy_version 1907754 (0.0011) [2023-12-28 08:56:40,487][106226] Updated weights for policy 0, policy_version 1903593 (0.0008) [2023-12-28 08:56:40,502][106225] Updated weights for policy 1, policy_version 1907764 (0.0010) [2023-12-28 08:56:40,539][106226] Updated weights for policy 0, policy_version 1903603 (0.0006) [2023-12-28 08:56:40,557][106225] Updated weights for policy 1, policy_version 1907774 (0.0010) [2023-12-28 08:56:40,591][106226] Updated weights for policy 0, policy_version 1903613 (0.0007) [2023-12-28 08:56:40,649][106226] Updated weights for policy 0, policy_version 1903623 (0.0008) [2023-12-28 08:56:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 975855616. Throughput: 0: 9933.3, 1: 9887.5. Samples: 975831344. Policy #0 lag: (min: 30.0, avg: 31.0, max: 55.0) [2023-12-28 08:56:41,175][105115] Avg episode reward: [(0, '-4.424'), (1, '-4.676')] [2023-12-28 08:56:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001907776_488448000.pth... [2023-12-28 08:56:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001903624_487407616.pth... [2023-12-28 08:56:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001902472_487112704.pth [2023-12-28 08:56:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001906624_488153088.pth [2023-12-28 08:56:41,338][106225] Updated weights for policy 1, policy_version 1907784 (0.0010) [2023-12-28 08:56:41,408][106226] Updated weights for policy 0, policy_version 1903633 (0.0007) [2023-12-28 08:56:41,412][106225] Updated weights for policy 1, policy_version 1907794 (0.0012) [2023-12-28 08:56:41,472][106226] Updated weights for policy 0, policy_version 1903643 (0.0008) [2023-12-28 08:56:41,473][106225] Updated weights for policy 1, policy_version 1907804 (0.0009) [2023-12-28 08:56:41,539][106226] Updated weights for policy 0, policy_version 1903653 (0.0007) [2023-12-28 08:56:42,148][106225] Updated weights for policy 1, policy_version 1907814 (0.0010) [2023-12-28 08:56:42,207][106225] Updated weights for policy 1, policy_version 1907824 (0.0010) [2023-12-28 08:56:42,270][106225] Updated weights for policy 1, policy_version 1907834 (0.0010) [2023-12-28 08:56:42,276][106226] Updated weights for policy 0, policy_version 1903663 (0.0007) [2023-12-28 08:56:42,340][106226] Updated weights for policy 0, policy_version 1903673 (0.0008) [2023-12-28 08:56:42,404][106226] Updated weights for policy 0, policy_version 1903683 (0.0009) [2023-12-28 08:56:42,983][106225] Updated weights for policy 1, policy_version 1907844 (0.0007) [2023-12-28 08:56:43,039][106225] Updated weights for policy 1, policy_version 1907854 (0.0005) [2023-12-28 08:56:43,095][106225] Updated weights for policy 1, policy_version 1907864 (0.0005) [2023-12-28 08:56:43,165][106226] Updated weights for policy 0, policy_version 1903693 (0.0010) [2023-12-28 08:56:43,221][106226] Updated weights for policy 0, policy_version 1903703 (0.0011) [2023-12-28 08:56:43,284][106226] Updated weights for policy 0, policy_version 1903713 (0.0010) [2023-12-28 08:56:43,717][106225] Updated weights for policy 1, policy_version 1907874 (0.0006) [2023-12-28 08:56:43,773][106225] Updated weights for policy 1, policy_version 1907884 (0.0005) [2023-12-28 08:56:43,823][106225] Updated weights for policy 1, policy_version 1907894 (0.0005) [2023-12-28 08:56:43,876][106225] Updated weights for policy 1, policy_version 1907904 (0.0005) [2023-12-28 08:56:43,973][106226] Updated weights for policy 0, policy_version 1903723 (0.0010) [2023-12-28 08:56:44,043][106226] Updated weights for policy 0, policy_version 1903733 (0.0006) [2023-12-28 08:56:44,112][106226] Updated weights for policy 0, policy_version 1903743 (0.0005) [2023-12-28 08:56:44,500][106225] Updated weights for policy 1, policy_version 1907914 (0.0008) [2023-12-28 08:56:44,551][106225] Updated weights for policy 1, policy_version 1907924 (0.0008) [2023-12-28 08:56:44,604][106225] Updated weights for policy 1, policy_version 1907934 (0.0008) [2023-12-28 08:56:44,683][106226] Updated weights for policy 0, policy_version 1903753 (0.0006) [2023-12-28 08:56:44,733][106226] Updated weights for policy 0, policy_version 1903763 (0.0010) [2023-12-28 08:56:44,794][106226] Updated weights for policy 0, policy_version 1903773 (0.0011) [2023-12-28 08:56:44,851][106226] Updated weights for policy 0, policy_version 1903783 (0.0011) [2023-12-28 08:56:45,366][106225] Updated weights for policy 1, policy_version 1907944 (0.0009) [2023-12-28 08:56:45,423][106225] Updated weights for policy 1, policy_version 1907954 (0.0009) [2023-12-28 08:56:45,485][106225] Updated weights for policy 1, policy_version 1907964 (0.0009) [2023-12-28 08:56:45,606][106226] Updated weights for policy 0, policy_version 1903793 (0.0006) [2023-12-28 08:56:45,673][106226] Updated weights for policy 0, policy_version 1903803 (0.0005) [2023-12-28 08:56:45,738][106226] Updated weights for policy 0, policy_version 1903813 (0.0005) [2023-12-28 08:56:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 975953920. Throughput: 0: 9880.7, 1: 9873.2. Samples: 975947480. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:56:46,175][105115] Avg episode reward: [(0, '-4.208'), (1, '-4.799')] [2023-12-28 08:56:46,238][106226] Updated weights for policy 0, policy_version 1903823 (0.0007) [2023-12-28 08:56:46,252][106225] Updated weights for policy 1, policy_version 1907974 (0.0008) [2023-12-28 08:56:46,294][106226] Updated weights for policy 0, policy_version 1903833 (0.0008) [2023-12-28 08:56:46,308][106225] Updated weights for policy 1, policy_version 1907984 (0.0006) [2023-12-28 08:56:46,353][106226] Updated weights for policy 0, policy_version 1903843 (0.0008) [2023-12-28 08:56:46,360][106225] Updated weights for policy 1, policy_version 1907994 (0.0006) [2023-12-28 08:56:47,078][106226] Updated weights for policy 0, policy_version 1903853 (0.0008) [2023-12-28 08:56:47,097][106225] Updated weights for policy 1, policy_version 1908004 (0.0008) [2023-12-28 08:56:47,137][106226] Updated weights for policy 0, policy_version 1903863 (0.0009) [2023-12-28 08:56:47,154][106225] Updated weights for policy 1, policy_version 1908014 (0.0007) [2023-12-28 08:56:47,195][106226] Updated weights for policy 0, policy_version 1903873 (0.0005) [2023-12-28 08:56:47,218][106225] Updated weights for policy 1, policy_version 1908024 (0.0008) [2023-12-28 08:56:47,880][106226] Updated weights for policy 0, policy_version 1903883 (0.0007) [2023-12-28 08:56:47,929][106226] Updated weights for policy 0, policy_version 1903893 (0.0008) [2023-12-28 08:56:47,969][106225] Updated weights for policy 1, policy_version 1908034 (0.0008) [2023-12-28 08:56:47,979][106226] Updated weights for policy 0, policy_version 1903903 (0.0008) [2023-12-28 08:56:48,025][106225] Updated weights for policy 1, policy_version 1908044 (0.0006) [2023-12-28 08:56:48,077][106225] Updated weights for policy 1, policy_version 1908054 (0.0007) [2023-12-28 08:56:48,123][106225] Updated weights for policy 1, policy_version 1908064 (0.0008) [2023-12-28 08:56:48,755][106226] Updated weights for policy 0, policy_version 1903913 (0.0006) [2023-12-28 08:56:48,814][106226] Updated weights for policy 0, policy_version 1903923 (0.0008) [2023-12-28 08:56:48,876][106226] Updated weights for policy 0, policy_version 1903933 (0.0009) [2023-12-28 08:56:48,902][106225] Updated weights for policy 1, policy_version 1908074 (0.0007) [2023-12-28 08:56:48,934][106226] Updated weights for policy 0, policy_version 1903943 (0.0009) [2023-12-28 08:56:48,962][106225] Updated weights for policy 1, policy_version 1908084 (0.0006) [2023-12-28 08:56:49,021][106225] Updated weights for policy 1, policy_version 1908094 (0.0009) [2023-12-28 08:56:49,711][106225] Updated weights for policy 1, policy_version 1908104 (0.0008) [2023-12-28 08:56:49,715][106226] Updated weights for policy 0, policy_version 1903953 (0.0007) [2023-12-28 08:56:49,770][106226] Updated weights for policy 0, policy_version 1903963 (0.0008) [2023-12-28 08:56:49,772][106225] Updated weights for policy 1, policy_version 1908114 (0.0007) [2023-12-28 08:56:49,835][106225] Updated weights for policy 1, policy_version 1908124 (0.0006) [2023-12-28 08:56:49,836][106226] Updated weights for policy 0, policy_version 1903973 (0.0007) [2023-12-28 08:56:50,533][106225] Updated weights for policy 1, policy_version 1908134 (0.0008) [2023-12-28 08:56:50,605][106225] Updated weights for policy 1, policy_version 1908144 (0.0006) [2023-12-28 08:56:50,650][106226] Updated weights for policy 0, policy_version 1903983 (0.0010) [2023-12-28 08:56:50,666][106225] Updated weights for policy 1, policy_version 1908154 (0.0007) [2023-12-28 08:56:50,714][106226] Updated weights for policy 0, policy_version 1903993 (0.0006) [2023-12-28 08:56:50,773][106226] Updated weights for policy 0, policy_version 1904003 (0.0006) [2023-12-28 08:56:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 976052224. Throughput: 0: 9820.2, 1: 9810.6. Samples: 976062488. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:56:51,175][105115] Avg episode reward: [(0, '-4.344'), (1, '-4.911')] [2023-12-28 08:56:51,368][106225] Updated weights for policy 1, policy_version 1908164 (0.0008) [2023-12-28 08:56:51,417][106225] Updated weights for policy 1, policy_version 1908174 (0.0008) [2023-12-28 08:56:51,468][106225] Updated weights for policy 1, policy_version 1908184 (0.0007) [2023-12-28 08:56:51,541][106226] Updated weights for policy 0, policy_version 1904013 (0.0007) [2023-12-28 08:56:51,597][106226] Updated weights for policy 0, policy_version 1904023 (0.0008) [2023-12-28 08:56:51,664][106226] Updated weights for policy 0, policy_version 1904033 (0.0008) [2023-12-28 08:56:52,296][106225] Updated weights for policy 1, policy_version 1908194 (0.0008) [2023-12-28 08:56:52,361][106225] Updated weights for policy 1, policy_version 1908204 (0.0008) [2023-12-28 08:56:52,380][106226] Updated weights for policy 0, policy_version 1904043 (0.0009) [2023-12-28 08:56:52,433][106225] Updated weights for policy 1, policy_version 1908214 (0.0006) [2023-12-28 08:56:52,441][106226] Updated weights for policy 0, policy_version 1904053 (0.0009) [2023-12-28 08:56:52,493][106225] Updated weights for policy 1, policy_version 1908224 (0.0006) [2023-12-28 08:56:52,502][106226] Updated weights for policy 0, policy_version 1904063 (0.0011) [2023-12-28 08:56:53,226][106225] Updated weights for policy 1, policy_version 1908234 (0.0008) [2023-12-28 08:56:53,238][106226] Updated weights for policy 0, policy_version 1904073 (0.0010) [2023-12-28 08:56:53,279][106225] Updated weights for policy 1, policy_version 1908244 (0.0007) [2023-12-28 08:56:53,285][106226] Updated weights for policy 0, policy_version 1904083 (0.0006) [2023-12-28 08:56:53,326][106225] Updated weights for policy 1, policy_version 1908254 (0.0005) [2023-12-28 08:56:53,336][106226] Updated weights for policy 0, policy_version 1904093 (0.0006) [2023-12-28 08:56:53,384][106226] Updated weights for policy 0, policy_version 1904103 (0.0008) [2023-12-28 08:56:54,070][106225] Updated weights for policy 1, policy_version 1908264 (0.0007) [2023-12-28 08:56:54,113][106226] Updated weights for policy 0, policy_version 1904113 (0.0009) [2023-12-28 08:56:54,124][106225] Updated weights for policy 1, policy_version 1908274 (0.0007) [2023-12-28 08:56:54,173][106226] Updated weights for policy 0, policy_version 1904123 (0.0009) [2023-12-28 08:56:54,181][106225] Updated weights for policy 1, policy_version 1908284 (0.0007) [2023-12-28 08:56:54,229][106226] Updated weights for policy 0, policy_version 1904133 (0.0008) [2023-12-28 08:56:54,941][106225] Updated weights for policy 1, policy_version 1908294 (0.0008) [2023-12-28 08:56:54,967][106226] Updated weights for policy 0, policy_version 1904143 (0.0007) [2023-12-28 08:56:55,001][106225] Updated weights for policy 1, policy_version 1908304 (0.0009) [2023-12-28 08:56:55,030][106226] Updated weights for policy 0, policy_version 1904153 (0.0008) [2023-12-28 08:56:55,050][106225] Updated weights for policy 1, policy_version 1908314 (0.0008) [2023-12-28 08:56:55,084][106226] Updated weights for policy 0, policy_version 1904163 (0.0008) [2023-12-28 08:56:55,725][106225] Updated weights for policy 1, policy_version 1908324 (0.0006) [2023-12-28 08:56:55,763][106226] Updated weights for policy 0, policy_version 1904173 (0.0007) [2023-12-28 08:56:55,781][106225] Updated weights for policy 1, policy_version 1908334 (0.0005) [2023-12-28 08:56:55,819][106226] Updated weights for policy 0, policy_version 1904183 (0.0005) [2023-12-28 08:56:55,844][106225] Updated weights for policy 1, policy_version 1908344 (0.0005) [2023-12-28 08:56:55,880][106226] Updated weights for policy 0, policy_version 1904193 (0.0005) [2023-12-28 08:56:56,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 976150528. Throughput: 0: 9814.0, 1: 9734.4. Samples: 976119608. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:56:56,175][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.483')] [2023-12-28 08:56:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001908352_488595456.pth... [2023-12-28 08:56:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001904200_487555072.pth... [2023-12-28 08:56:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001903048_487260160.pth [2023-12-28 08:56:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001907232_488308736.pth [2023-12-28 08:56:56,357][106225] Updated weights for policy 1, policy_version 1908354 (0.0005) [2023-12-28 08:56:56,405][106225] Updated weights for policy 1, policy_version 1908364 (0.0008) [2023-12-28 08:56:56,457][106225] Updated weights for policy 1, policy_version 1908374 (0.0010) [2023-12-28 08:56:56,518][106225] Updated weights for policy 1, policy_version 1908384 (0.0010) [2023-12-28 08:56:56,556][106226] Updated weights for policy 0, policy_version 1904203 (0.0006) [2023-12-28 08:56:56,620][106226] Updated weights for policy 0, policy_version 1904213 (0.0008) [2023-12-28 08:56:56,670][106226] Updated weights for policy 0, policy_version 1904223 (0.0005) [2023-12-28 08:56:57,202][106225] Updated weights for policy 1, policy_version 1908394 (0.0005) [2023-12-28 08:56:57,265][106225] Updated weights for policy 1, policy_version 1908404 (0.0005) [2023-12-28 08:56:57,325][106225] Updated weights for policy 1, policy_version 1908414 (0.0007) [2023-12-28 08:56:57,429][106226] Updated weights for policy 0, policy_version 1904233 (0.0005) [2023-12-28 08:56:57,489][106226] Updated weights for policy 0, policy_version 1904243 (0.0010) [2023-12-28 08:56:57,548][106226] Updated weights for policy 0, policy_version 1904253 (0.0007) [2023-12-28 08:56:57,614][106226] Updated weights for policy 0, policy_version 1904263 (0.0008) [2023-12-28 08:56:57,873][106225] Updated weights for policy 1, policy_version 1908424 (0.0010) [2023-12-28 08:56:57,922][106225] Updated weights for policy 1, policy_version 1908434 (0.0010) [2023-12-28 08:56:57,968][106225] Updated weights for policy 1, policy_version 1908444 (0.0010) [2023-12-28 08:56:58,238][106226] Updated weights for policy 0, policy_version 1904273 (0.0008) [2023-12-28 08:56:58,302][106226] Updated weights for policy 0, policy_version 1904283 (0.0009) [2023-12-28 08:56:58,385][106226] Updated weights for policy 0, policy_version 1904293 (0.0014) [2023-12-28 08:56:58,784][106225] Updated weights for policy 1, policy_version 1908454 (0.0008) [2023-12-28 08:56:58,853][106225] Updated weights for policy 1, policy_version 1908464 (0.0008) [2023-12-28 08:56:58,924][106225] Updated weights for policy 1, policy_version 1908474 (0.0008) [2023-12-28 08:56:59,120][106226] Updated weights for policy 0, policy_version 1904303 (0.0008) [2023-12-28 08:56:59,181][106226] Updated weights for policy 0, policy_version 1904313 (0.0011) [2023-12-28 08:56:59,247][106226] Updated weights for policy 0, policy_version 1904323 (0.0008) [2023-12-28 08:56:59,668][106225] Updated weights for policy 1, policy_version 1908484 (0.0007) [2023-12-28 08:56:59,726][106225] Updated weights for policy 1, policy_version 1908494 (0.0007) [2023-12-28 08:56:59,785][106225] Updated weights for policy 1, policy_version 1908504 (0.0006) [2023-12-28 08:56:59,938][106226] Updated weights for policy 0, policy_version 1904333 (0.0010) [2023-12-28 08:56:59,994][106226] Updated weights for policy 0, policy_version 1904343 (0.0008) [2023-12-28 08:57:00,052][106226] Updated weights for policy 0, policy_version 1904353 (0.0009) [2023-12-28 08:57:00,456][106225] Updated weights for policy 1, policy_version 1908514 (0.0008) [2023-12-28 08:57:00,517][106225] Updated weights for policy 1, policy_version 1908524 (0.0008) [2023-12-28 08:57:00,576][106225] Updated weights for policy 1, policy_version 1908534 (0.0009) [2023-12-28 08:57:00,635][106225] Updated weights for policy 1, policy_version 1908544 (0.0008) [2023-12-28 08:57:00,792][106226] Updated weights for policy 0, policy_version 1904363 (0.0009) [2023-12-28 08:57:00,849][106226] Updated weights for policy 0, policy_version 1904373 (0.0008) [2023-12-28 08:57:00,910][106226] Updated weights for policy 0, policy_version 1904383 (0.0008) [2023-12-28 08:57:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 976248832. Throughput: 0: 9772.6, 1: 9813.8. Samples: 976238740. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:01,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.733')] [2023-12-28 08:57:01,355][106225] Updated weights for policy 1, policy_version 1908554 (0.0009) [2023-12-28 08:57:01,421][106225] Updated weights for policy 1, policy_version 1908564 (0.0008) [2023-12-28 08:57:01,485][106225] Updated weights for policy 1, policy_version 1908574 (0.0008) [2023-12-28 08:57:01,684][106226] Updated weights for policy 0, policy_version 1904393 (0.0009) [2023-12-28 08:57:01,755][106226] Updated weights for policy 0, policy_version 1904403 (0.0008) [2023-12-28 08:57:01,815][106226] Updated weights for policy 0, policy_version 1904413 (0.0006) [2023-12-28 08:57:01,874][106226] Updated weights for policy 0, policy_version 1904423 (0.0009) [2023-12-28 08:57:02,210][106225] Updated weights for policy 1, policy_version 1908584 (0.0006) [2023-12-28 08:57:02,268][106225] Updated weights for policy 1, policy_version 1908594 (0.0007) [2023-12-28 08:57:02,327][106225] Updated weights for policy 1, policy_version 1908604 (0.0008) [2023-12-28 08:57:02,604][106226] Updated weights for policy 0, policy_version 1904433 (0.0009) [2023-12-28 08:57:02,654][106226] Updated weights for policy 0, policy_version 1904443 (0.0009) [2023-12-28 08:57:02,707][106226] Updated weights for policy 0, policy_version 1904453 (0.0009) [2023-12-28 08:57:03,011][106225] Updated weights for policy 1, policy_version 1908614 (0.0009) [2023-12-28 08:57:03,060][106225] Updated weights for policy 1, policy_version 1908624 (0.0008) [2023-12-28 08:57:03,120][106225] Updated weights for policy 1, policy_version 1908634 (0.0007) [2023-12-28 08:57:03,344][106226] Updated weights for policy 0, policy_version 1904463 (0.0010) [2023-12-28 08:57:03,405][106226] Updated weights for policy 0, policy_version 1904473 (0.0010) [2023-12-28 08:57:03,469][106226] Updated weights for policy 0, policy_version 1904483 (0.0009) [2023-12-28 08:57:03,863][106225] Updated weights for policy 1, policy_version 1908644 (0.0008) [2023-12-28 08:57:03,918][106225] Updated weights for policy 1, policy_version 1908654 (0.0008) [2023-12-28 08:57:03,977][106225] Updated weights for policy 1, policy_version 1908664 (0.0009) [2023-12-28 08:57:04,051][106226] Updated weights for policy 0, policy_version 1904493 (0.0007) [2023-12-28 08:57:04,116][106226] Updated weights for policy 0, policy_version 1904503 (0.0007) [2023-12-28 08:57:04,186][106226] Updated weights for policy 0, policy_version 1904513 (0.0009) [2023-12-28 08:57:04,717][106225] Updated weights for policy 1, policy_version 1908674 (0.0008) [2023-12-28 08:57:04,730][106226] Updated weights for policy 0, policy_version 1904523 (0.0011) [2023-12-28 08:57:04,781][106225] Updated weights for policy 1, policy_version 1908684 (0.0005) [2023-12-28 08:57:04,784][106226] Updated weights for policy 0, policy_version 1904533 (0.0011) [2023-12-28 08:57:04,833][106226] Updated weights for policy 0, policy_version 1904543 (0.0008) [2023-12-28 08:57:04,850][106225] Updated weights for policy 1, policy_version 1908694 (0.0005) [2023-12-28 08:57:04,899][106225] Updated weights for policy 1, policy_version 1908704 (0.0007) [2023-12-28 08:57:05,533][106226] Updated weights for policy 0, policy_version 1904553 (0.0009) [2023-12-28 08:57:05,570][106225] Updated weights for policy 1, policy_version 1908714 (0.0007) [2023-12-28 08:57:05,593][106226] Updated weights for policy 0, policy_version 1904563 (0.0010) [2023-12-28 08:57:05,630][106225] Updated weights for policy 1, policy_version 1908724 (0.0006) [2023-12-28 08:57:05,646][106226] Updated weights for policy 0, policy_version 1904573 (0.0010) [2023-12-28 08:57:05,682][106225] Updated weights for policy 1, policy_version 1908734 (0.0008) [2023-12-28 08:57:05,700][106226] Updated weights for policy 0, policy_version 1904583 (0.0010) [2023-12-28 08:57:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 976347136. Throughput: 0: 9900.1, 1: 9762.0. Samples: 976357956. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:06,175][105115] Avg episode reward: [(0, '-4.284'), (1, '-4.468')] [2023-12-28 08:57:06,409][106225] Updated weights for policy 1, policy_version 1908744 (0.0009) [2023-12-28 08:57:06,433][106226] Updated weights for policy 0, policy_version 1904593 (0.0011) [2023-12-28 08:57:06,469][106225] Updated weights for policy 1, policy_version 1908754 (0.0007) [2023-12-28 08:57:06,490][106226] Updated weights for policy 0, policy_version 1904603 (0.0011) [2023-12-28 08:57:06,524][106225] Updated weights for policy 1, policy_version 1908764 (0.0007) [2023-12-28 08:57:06,547][106226] Updated weights for policy 0, policy_version 1904613 (0.0011) [2023-12-28 08:57:07,247][106225] Updated weights for policy 1, policy_version 1908774 (0.0007) [2023-12-28 08:57:07,271][106226] Updated weights for policy 0, policy_version 1904623 (0.0011) [2023-12-28 08:57:07,297][106225] Updated weights for policy 1, policy_version 1908784 (0.0007) [2023-12-28 08:57:07,335][106226] Updated weights for policy 0, policy_version 1904633 (0.0011) [2023-12-28 08:57:07,358][106225] Updated weights for policy 1, policy_version 1908794 (0.0009) [2023-12-28 08:57:07,392][106226] Updated weights for policy 0, policy_version 1904643 (0.0011) [2023-12-28 08:57:08,071][106225] Updated weights for policy 1, policy_version 1908804 (0.0007) [2023-12-28 08:57:08,091][106226] Updated weights for policy 0, policy_version 1904653 (0.0009) [2023-12-28 08:57:08,134][106225] Updated weights for policy 1, policy_version 1908814 (0.0006) [2023-12-28 08:57:08,155][106226] Updated weights for policy 0, policy_version 1904663 (0.0011) [2023-12-28 08:57:08,198][106225] Updated weights for policy 1, policy_version 1908824 (0.0006) [2023-12-28 08:57:08,218][106226] Updated weights for policy 0, policy_version 1904673 (0.0010) [2023-12-28 08:57:08,802][106225] Updated weights for policy 1, policy_version 1908834 (0.0006) [2023-12-28 08:57:08,864][106225] Updated weights for policy 1, policy_version 1908844 (0.0009) [2023-12-28 08:57:08,925][106225] Updated weights for policy 1, policy_version 1908854 (0.0006) [2023-12-28 08:57:08,981][106225] Updated weights for policy 1, policy_version 1908864 (0.0005) [2023-12-28 08:57:09,028][106226] Updated weights for policy 0, policy_version 1904683 (0.0010) [2023-12-28 08:57:09,079][106226] Updated weights for policy 0, policy_version 1904693 (0.0006) [2023-12-28 08:57:09,142][106226] Updated weights for policy 0, policy_version 1904703 (0.0005) [2023-12-28 08:57:09,733][106225] Updated weights for policy 1, policy_version 1908874 (0.0009) [2023-12-28 08:57:09,796][106225] Updated weights for policy 1, policy_version 1908884 (0.0008) [2023-12-28 08:57:09,832][106226] Updated weights for policy 0, policy_version 1904713 (0.0006) [2023-12-28 08:57:09,862][106225] Updated weights for policy 1, policy_version 1908894 (0.0008) [2023-12-28 08:57:09,896][106226] Updated weights for policy 0, policy_version 1904723 (0.0007) [2023-12-28 08:57:09,961][106226] Updated weights for policy 0, policy_version 1904733 (0.0010) [2023-12-28 08:57:10,021][106226] Updated weights for policy 0, policy_version 1904743 (0.0011) [2023-12-28 08:57:10,583][106225] Updated weights for policy 1, policy_version 1908904 (0.0006) [2023-12-28 08:57:10,641][106225] Updated weights for policy 1, policy_version 1908914 (0.0005) [2023-12-28 08:57:10,704][106225] Updated weights for policy 1, policy_version 1908924 (0.0007) [2023-12-28 08:57:10,717][106226] Updated weights for policy 0, policy_version 1904753 (0.0008) [2023-12-28 08:57:10,777][106226] Updated weights for policy 0, policy_version 1904763 (0.0007) [2023-12-28 08:57:10,843][106226] Updated weights for policy 0, policy_version 1904773 (0.0005) [2023-12-28 08:57:11,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 976445440. Throughput: 0: 9903.0, 1: 9792.4. Samples: 976416676. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:11,175][105115] Avg episode reward: [(0, '-4.052'), (1, '-4.938')] [2023-12-28 08:57:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001908928_488742912.pth... [2023-12-28 08:57:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001904776_487702528.pth... [2023-12-28 08:57:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001903624_487407616.pth [2023-12-28 08:57:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001907776_488448000.pth [2023-12-28 08:57:11,301][106225] Updated weights for policy 1, policy_version 1908934 (0.0009) [2023-12-28 08:57:11,353][106225] Updated weights for policy 1, policy_version 1908944 (0.0010) [2023-12-28 08:57:11,426][106225] Updated weights for policy 1, policy_version 1908954 (0.0009) [2023-12-28 08:57:11,527][106226] Updated weights for policy 0, policy_version 1904783 (0.0006) [2023-12-28 08:57:11,590][106226] Updated weights for policy 0, policy_version 1904793 (0.0007) [2023-12-28 08:57:11,658][106226] Updated weights for policy 0, policy_version 1904803 (0.0008) [2023-12-28 08:57:12,221][106225] Updated weights for policy 1, policy_version 1908964 (0.0009) [2023-12-28 08:57:12,285][106225] Updated weights for policy 1, policy_version 1908974 (0.0010) [2023-12-28 08:57:12,316][106226] Updated weights for policy 0, policy_version 1904813 (0.0007) [2023-12-28 08:57:12,346][106225] Updated weights for policy 1, policy_version 1908984 (0.0011) [2023-12-28 08:57:12,388][106226] Updated weights for policy 0, policy_version 1904823 (0.0007) [2023-12-28 08:57:12,446][106226] Updated weights for policy 0, policy_version 1904833 (0.0008) [2023-12-28 08:57:13,000][106225] Updated weights for policy 1, policy_version 1908994 (0.0010) [2023-12-28 08:57:13,065][106225] Updated weights for policy 1, policy_version 1909004 (0.0007) [2023-12-28 08:57:13,113][106226] Updated weights for policy 0, policy_version 1904843 (0.0007) [2023-12-28 08:57:13,134][106225] Updated weights for policy 1, policy_version 1909014 (0.0008) [2023-12-28 08:57:13,180][106226] Updated weights for policy 0, policy_version 1904853 (0.0005) [2023-12-28 08:57:13,198][106225] Updated weights for policy 1, policy_version 1909024 (0.0009) [2023-12-28 08:57:13,234][106226] Updated weights for policy 0, policy_version 1904863 (0.0005) [2023-12-28 08:57:13,805][106226] Updated weights for policy 0, policy_version 1904873 (0.0006) [2023-12-28 08:57:13,865][106226] Updated weights for policy 0, policy_version 1904883 (0.0011) [2023-12-28 08:57:13,902][106225] Updated weights for policy 1, policy_version 1909034 (0.0005) [2023-12-28 08:57:13,927][106226] Updated weights for policy 0, policy_version 1904893 (0.0009) [2023-12-28 08:57:13,964][106225] Updated weights for policy 1, policy_version 1909044 (0.0006) [2023-12-28 08:57:13,990][106226] Updated weights for policy 0, policy_version 1904903 (0.0005) [2023-12-28 08:57:14,023][106225] Updated weights for policy 1, policy_version 1909054 (0.0009) [2023-12-28 08:57:14,627][106226] Updated weights for policy 0, policy_version 1904913 (0.0008) [2023-12-28 08:57:14,693][106226] Updated weights for policy 0, policy_version 1904923 (0.0005) [2023-12-28 08:57:14,695][106225] Updated weights for policy 1, policy_version 1909064 (0.0008) [2023-12-28 08:57:14,752][106226] Updated weights for policy 0, policy_version 1904933 (0.0005) [2023-12-28 08:57:14,753][106225] Updated weights for policy 1, policy_version 1909074 (0.0009) [2023-12-28 08:57:14,816][106225] Updated weights for policy 1, policy_version 1909084 (0.0008) [2023-12-28 08:57:15,335][106226] Updated weights for policy 0, policy_version 1904943 (0.0010) [2023-12-28 08:57:15,396][106226] Updated weights for policy 0, policy_version 1904953 (0.0011) [2023-12-28 08:57:15,459][106226] Updated weights for policy 0, policy_version 1904963 (0.0011) [2023-12-28 08:57:15,598][106225] Updated weights for policy 1, policy_version 1909094 (0.0007) [2023-12-28 08:57:15,653][106225] Updated weights for policy 1, policy_version 1909104 (0.0006) [2023-12-28 08:57:15,704][106225] Updated weights for policy 1, policy_version 1909114 (0.0007) [2023-12-28 08:57:16,174][106226] Updated weights for policy 0, policy_version 1904973 (0.0010) [2023-12-28 08:57:16,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 976543744. Throughput: 0: 9923.0, 1: 9709.1. Samples: 976538036. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:16,176][105115] Avg episode reward: [(0, '-4.359'), (1, '-4.799')] [2023-12-28 08:57:16,241][106226] Updated weights for policy 0, policy_version 1904983 (0.0009) [2023-12-28 08:57:16,261][106225] Updated weights for policy 1, policy_version 1909124 (0.0006) [2023-12-28 08:57:16,304][106226] Updated weights for policy 0, policy_version 1904993 (0.0010) [2023-12-28 08:57:16,318][106225] Updated weights for policy 1, policy_version 1909134 (0.0005) [2023-12-28 08:57:16,383][106225] Updated weights for policy 1, policy_version 1909144 (0.0008) [2023-12-28 08:57:16,963][106225] Updated weights for policy 1, policy_version 1909154 (0.0010) [2023-12-28 08:57:16,982][106226] Updated weights for policy 0, policy_version 1905003 (0.0009) [2023-12-28 08:57:17,019][106225] Updated weights for policy 1, policy_version 1909164 (0.0006) [2023-12-28 08:57:17,032][106226] Updated weights for policy 0, policy_version 1905013 (0.0010) [2023-12-28 08:57:17,072][106225] Updated weights for policy 1, policy_version 1909174 (0.0006) [2023-12-28 08:57:17,089][106226] Updated weights for policy 0, policy_version 1905023 (0.0009) [2023-12-28 08:57:17,122][106225] Updated weights for policy 1, policy_version 1909184 (0.0006) [2023-12-28 08:57:17,802][106226] Updated weights for policy 0, policy_version 1905033 (0.0010) [2023-12-28 08:57:17,861][106225] Updated weights for policy 1, policy_version 1909194 (0.0010) [2023-12-28 08:57:17,866][106226] Updated weights for policy 0, policy_version 1905043 (0.0007) [2023-12-28 08:57:17,922][106225] Updated weights for policy 1, policy_version 1909204 (0.0010) [2023-12-28 08:57:17,928][106226] Updated weights for policy 0, policy_version 1905053 (0.0006) [2023-12-28 08:57:17,982][106225] Updated weights for policy 1, policy_version 1909214 (0.0009) [2023-12-28 08:57:17,988][106226] Updated weights for policy 0, policy_version 1905063 (0.0006) [2023-12-28 08:57:18,618][106226] Updated weights for policy 0, policy_version 1905073 (0.0010) [2023-12-28 08:57:18,683][106226] Updated weights for policy 0, policy_version 1905083 (0.0009) [2023-12-28 08:57:18,742][106225] Updated weights for policy 1, policy_version 1909224 (0.0007) [2023-12-28 08:57:18,747][106226] Updated weights for policy 0, policy_version 1905093 (0.0007) [2023-12-28 08:57:18,796][106225] Updated weights for policy 1, policy_version 1909234 (0.0007) [2023-12-28 08:57:18,861][106225] Updated weights for policy 1, policy_version 1909244 (0.0009) [2023-12-28 08:57:19,478][106226] Updated weights for policy 0, policy_version 1905103 (0.0008) [2023-12-28 08:57:19,539][106226] Updated weights for policy 0, policy_version 1905113 (0.0009) [2023-12-28 08:57:19,598][106226] Updated weights for policy 0, policy_version 1905123 (0.0007) [2023-12-28 08:57:19,604][106225] Updated weights for policy 1, policy_version 1909254 (0.0008) [2023-12-28 08:57:19,665][106225] Updated weights for policy 1, policy_version 1909264 (0.0006) [2023-12-28 08:57:19,725][106225] Updated weights for policy 1, policy_version 1909274 (0.0007) [2023-12-28 08:57:20,336][106226] Updated weights for policy 0, policy_version 1905133 (0.0008) [2023-12-28 08:57:20,399][106226] Updated weights for policy 0, policy_version 1905143 (0.0007) [2023-12-28 08:57:20,463][106226] Updated weights for policy 0, policy_version 1905153 (0.0006) [2023-12-28 08:57:20,490][106225] Updated weights for policy 1, policy_version 1909284 (0.0008) [2023-12-28 08:57:20,555][106225] Updated weights for policy 1, policy_version 1909294 (0.0007) [2023-12-28 08:57:20,623][106225] Updated weights for policy 1, policy_version 1909304 (0.0008) [2023-12-28 08:57:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 976642048. Throughput: 0: 9862.8, 1: 9757.7. Samples: 976655696. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:21,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.691')] [2023-12-28 08:57:21,188][106226] Updated weights for policy 0, policy_version 1905163 (0.0009) [2023-12-28 08:57:21,251][106226] Updated weights for policy 0, policy_version 1905173 (0.0009) [2023-12-28 08:57:21,320][106226] Updated weights for policy 0, policy_version 1905183 (0.0008) [2023-12-28 08:57:21,458][106225] Updated weights for policy 1, policy_version 1909314 (0.0009) [2023-12-28 08:57:21,519][106225] Updated weights for policy 1, policy_version 1909324 (0.0008) [2023-12-28 08:57:21,582][106225] Updated weights for policy 1, policy_version 1909334 (0.0008) [2023-12-28 08:57:21,655][106225] Updated weights for policy 1, policy_version 1909344 (0.0008) [2023-12-28 08:57:22,174][106226] Updated weights for policy 0, policy_version 1905193 (0.0009) [2023-12-28 08:57:22,241][106226] Updated weights for policy 0, policy_version 1905203 (0.0009) [2023-12-28 08:57:22,300][106226] Updated weights for policy 0, policy_version 1905213 (0.0008) [2023-12-28 08:57:22,365][106226] Updated weights for policy 0, policy_version 1905223 (0.0008) [2023-12-28 08:57:22,388][106225] Updated weights for policy 1, policy_version 1909354 (0.0009) [2023-12-28 08:57:22,454][106225] Updated weights for policy 1, policy_version 1909364 (0.0008) [2023-12-28 08:57:22,508][106225] Updated weights for policy 1, policy_version 1909374 (0.0008) [2023-12-28 08:57:23,054][106226] Updated weights for policy 0, policy_version 1905233 (0.0006) [2023-12-28 08:57:23,123][106226] Updated weights for policy 0, policy_version 1905243 (0.0005) [2023-12-28 08:57:23,190][106226] Updated weights for policy 0, policy_version 1905253 (0.0006) [2023-12-28 08:57:23,292][106225] Updated weights for policy 1, policy_version 1909384 (0.0009) [2023-12-28 08:57:23,344][106225] Updated weights for policy 1, policy_version 1909394 (0.0006) [2023-12-28 08:57:23,397][106225] Updated weights for policy 1, policy_version 1909404 (0.0005) [2023-12-28 08:57:23,871][106226] Updated weights for policy 0, policy_version 1905263 (0.0009) [2023-12-28 08:57:23,928][106226] Updated weights for policy 0, policy_version 1905273 (0.0011) [2023-12-28 08:57:23,957][106225] Updated weights for policy 1, policy_version 1909414 (0.0007) [2023-12-28 08:57:23,979][106226] Updated weights for policy 0, policy_version 1905283 (0.0010) [2023-12-28 08:57:24,007][106225] Updated weights for policy 1, policy_version 1909424 (0.0007) [2023-12-28 08:57:24,059][106225] Updated weights for policy 1, policy_version 1909434 (0.0008) [2023-12-28 08:57:24,707][106226] Updated weights for policy 0, policy_version 1905293 (0.0008) [2023-12-28 08:57:24,773][106225] Updated weights for policy 1, policy_version 1909444 (0.0008) [2023-12-28 08:57:24,774][106226] Updated weights for policy 0, policy_version 1905303 (0.0008) [2023-12-28 08:57:24,834][106225] Updated weights for policy 1, policy_version 1909454 (0.0007) [2023-12-28 08:57:24,836][106226] Updated weights for policy 0, policy_version 1905313 (0.0010) [2023-12-28 08:57:24,894][106225] Updated weights for policy 1, policy_version 1909464 (0.0010) [2023-12-28 08:57:25,484][106225] Updated weights for policy 1, policy_version 1909474 (0.0008) [2023-12-28 08:57:25,535][106225] Updated weights for policy 1, policy_version 1909484 (0.0008) [2023-12-28 08:57:25,566][106226] Updated weights for policy 0, policy_version 1905323 (0.0006) [2023-12-28 08:57:25,594][106225] Updated weights for policy 1, policy_version 1909494 (0.0008) [2023-12-28 08:57:25,618][106226] Updated weights for policy 0, policy_version 1905333 (0.0006) [2023-12-28 08:57:25,658][106225] Updated weights for policy 1, policy_version 1909504 (0.0005) [2023-12-28 08:57:25,672][106226] Updated weights for policy 0, policy_version 1905343 (0.0008) [2023-12-28 08:57:26,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 976740352. Throughput: 0: 9808.3, 1: 9757.3. Samples: 976711792. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:26,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.562')] [2023-12-28 08:57:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001905352_487849984.pth... [2023-12-28 08:57:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001904200_487555072.pth [2023-12-28 08:57:26,229][106225] Updated weights for policy 1, policy_version 1909514 (0.0005) [2023-12-28 08:57:26,290][106225] Updated weights for policy 1, policy_version 1909524 (0.0008) [2023-12-28 08:57:26,352][106225] Updated weights for policy 1, policy_version 1909534 (0.0006) [2023-12-28 08:57:26,365][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001909536_488898560.pth... [2023-12-28 08:57:26,369][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001908352_488595456.pth [2023-12-28 08:57:26,494][106226] Updated weights for policy 0, policy_version 1905353 (0.0009) [2023-12-28 08:57:26,571][106226] Updated weights for policy 0, policy_version 1905363 (0.0009) [2023-12-28 08:57:26,632][106226] Updated weights for policy 0, policy_version 1905373 (0.0009) [2023-12-28 08:57:26,679][106226] Updated weights for policy 0, policy_version 1905383 (0.0007) [2023-12-28 08:57:26,898][106225] Updated weights for policy 1, policy_version 1909544 (0.0005) [2023-12-28 08:57:26,954][106225] Updated weights for policy 1, policy_version 1909554 (0.0005) [2023-12-28 08:57:27,019][106225] Updated weights for policy 1, policy_version 1909564 (0.0005) [2023-12-28 08:57:27,422][106226] Updated weights for policy 0, policy_version 1905393 (0.0007) [2023-12-28 08:57:27,475][106226] Updated weights for policy 0, policy_version 1905403 (0.0008) [2023-12-28 08:57:27,523][106226] Updated weights for policy 0, policy_version 1905413 (0.0009) [2023-12-28 08:57:27,561][106225] Updated weights for policy 1, policy_version 1909574 (0.0006) [2023-12-28 08:57:27,617][106225] Updated weights for policy 1, policy_version 1909584 (0.0005) [2023-12-28 08:57:27,667][106225] Updated weights for policy 1, policy_version 1909594 (0.0006) [2023-12-28 08:57:28,238][106225] Updated weights for policy 1, policy_version 1909604 (0.0007) [2023-12-28 08:57:28,291][106225] Updated weights for policy 1, policy_version 1909614 (0.0005) [2023-12-28 08:57:28,338][106226] Updated weights for policy 0, policy_version 1905423 (0.0008) [2023-12-28 08:57:28,355][106225] Updated weights for policy 1, policy_version 1909624 (0.0007) [2023-12-28 08:57:28,401][106226] Updated weights for policy 0, policy_version 1905433 (0.0006) [2023-12-28 08:57:28,464][106226] Updated weights for policy 0, policy_version 1905443 (0.0007) [2023-12-28 08:57:29,092][106225] Updated weights for policy 1, policy_version 1909634 (0.0008) [2023-12-28 08:57:29,142][106225] Updated weights for policy 1, policy_version 1909644 (0.0005) [2023-12-28 08:57:29,190][106226] Updated weights for policy 0, policy_version 1905453 (0.0009) [2023-12-28 08:57:29,194][106225] Updated weights for policy 1, policy_version 1909654 (0.0005) [2023-12-28 08:57:29,261][106226] Updated weights for policy 0, policy_version 1905463 (0.0008) [2023-12-28 08:57:29,263][106225] Updated weights for policy 1, policy_version 1909664 (0.0007) [2023-12-28 08:57:29,328][106226] Updated weights for policy 0, policy_version 1905473 (0.0008) [2023-12-28 08:57:30,020][106225] Updated weights for policy 1, policy_version 1909674 (0.0008) [2023-12-28 08:57:30,049][106226] Updated weights for policy 0, policy_version 1905483 (0.0008) [2023-12-28 08:57:30,077][106225] Updated weights for policy 1, policy_version 1909684 (0.0010) [2023-12-28 08:57:30,103][106226] Updated weights for policy 0, policy_version 1905493 (0.0007) [2023-12-28 08:57:30,131][106225] Updated weights for policy 1, policy_version 1909694 (0.0010) [2023-12-28 08:57:30,153][106226] Updated weights for policy 0, policy_version 1905503 (0.0006) [2023-12-28 08:57:30,867][106225] Updated weights for policy 1, policy_version 1909704 (0.0010) [2023-12-28 08:57:30,902][106226] Updated weights for policy 0, policy_version 1905513 (0.0008) [2023-12-28 08:57:30,916][106225] Updated weights for policy 1, policy_version 1909714 (0.0010) [2023-12-28 08:57:30,964][106226] Updated weights for policy 0, policy_version 1905523 (0.0007) [2023-12-28 08:57:30,966][106225] Updated weights for policy 1, policy_version 1909724 (0.0010) [2023-12-28 08:57:31,025][106226] Updated weights for policy 0, policy_version 1905533 (0.0007) [2023-12-28 08:57:31,082][106226] Updated weights for policy 0, policy_version 1905543 (0.0009) [2023-12-28 08:57:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 976846848. Throughput: 0: 9773.0, 1: 9909.0. Samples: 976833176. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:31,175][105115] Avg episode reward: [(0, '-4.184'), (1, '-4.603')] [2023-12-28 08:57:31,769][106225] Updated weights for policy 1, policy_version 1909734 (0.0008) [2023-12-28 08:57:31,832][106225] Updated weights for policy 1, policy_version 1909744 (0.0009) [2023-12-28 08:57:31,842][106226] Updated weights for policy 0, policy_version 1905553 (0.0009) [2023-12-28 08:57:31,904][106226] Updated weights for policy 0, policy_version 1905563 (0.0009) [2023-12-28 08:57:31,917][106225] Updated weights for policy 1, policy_version 1909754 (0.0007) [2023-12-28 08:57:31,972][106226] Updated weights for policy 0, policy_version 1905573 (0.0010) [2023-12-28 08:57:32,532][106225] Updated weights for policy 1, policy_version 1909764 (0.0010) [2023-12-28 08:57:32,578][106225] Updated weights for policy 1, policy_version 1909774 (0.0010) [2023-12-28 08:57:32,633][106225] Updated weights for policy 1, policy_version 1909784 (0.0010) [2023-12-28 08:57:32,642][106226] Updated weights for policy 0, policy_version 1905583 (0.0010) [2023-12-28 08:57:32,705][106226] Updated weights for policy 0, policy_version 1905593 (0.0010) [2023-12-28 08:57:32,755][106226] Updated weights for policy 0, policy_version 1905603 (0.0010) [2023-12-28 08:57:33,202][106225] Updated weights for policy 1, policy_version 1909794 (0.0009) [2023-12-28 08:57:33,256][106225] Updated weights for policy 1, policy_version 1909804 (0.0008) [2023-12-28 08:57:33,302][106225] Updated weights for policy 1, policy_version 1909814 (0.0010) [2023-12-28 08:57:33,351][106225] Updated weights for policy 1, policy_version 1909824 (0.0009) [2023-12-28 08:57:33,460][106226] Updated weights for policy 0, policy_version 1905613 (0.0010) [2023-12-28 08:57:33,518][106226] Updated weights for policy 0, policy_version 1905623 (0.0007) [2023-12-28 08:57:33,564][106226] Updated weights for policy 0, policy_version 1905633 (0.0005) [2023-12-28 08:57:33,912][106225] Updated weights for policy 1, policy_version 1909834 (0.0005) [2023-12-28 08:57:33,961][106225] Updated weights for policy 1, policy_version 1909844 (0.0006) [2023-12-28 08:57:34,011][106225] Updated weights for policy 1, policy_version 1909854 (0.0006) [2023-12-28 08:57:34,256][106226] Updated weights for policy 0, policy_version 1905643 (0.0010) [2023-12-28 08:57:34,324][106226] Updated weights for policy 0, policy_version 1905653 (0.0011) [2023-12-28 08:57:34,382][106226] Updated weights for policy 0, policy_version 1905663 (0.0011) [2023-12-28 08:57:34,730][106225] Updated weights for policy 1, policy_version 1909864 (0.0009) [2023-12-28 08:57:34,782][106225] Updated weights for policy 1, policy_version 1909874 (0.0010) [2023-12-28 08:57:34,839][106225] Updated weights for policy 1, policy_version 1909884 (0.0010) [2023-12-28 08:57:35,011][106226] Updated weights for policy 0, policy_version 1905673 (0.0011) [2023-12-28 08:57:35,067][106226] Updated weights for policy 0, policy_version 1905683 (0.0010) [2023-12-28 08:57:35,124][106226] Updated weights for policy 0, policy_version 1905693 (0.0011) [2023-12-28 08:57:35,174][106226] Updated weights for policy 0, policy_version 1905703 (0.0010) [2023-12-28 08:57:35,540][106225] Updated weights for policy 1, policy_version 1909894 (0.0010) [2023-12-28 08:57:35,586][106225] Updated weights for policy 1, policy_version 1909904 (0.0010) [2023-12-28 08:57:35,631][106225] Updated weights for policy 1, policy_version 1909914 (0.0006) [2023-12-28 08:57:35,901][106226] Updated weights for policy 0, policy_version 1905713 (0.0008) [2023-12-28 08:57:35,957][106226] Updated weights for policy 0, policy_version 1905723 (0.0010) [2023-12-28 08:57:36,016][106226] Updated weights for policy 0, policy_version 1905733 (0.0010) [2023-12-28 08:57:36,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 976945152. Throughput: 0: 9788.1, 1: 10032.1. Samples: 976954396. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:36,175][105115] Avg episode reward: [(0, '-4.461'), (1, '-4.740')] [2023-12-28 08:57:36,271][106225] Updated weights for policy 1, policy_version 1909924 (0.0007) [2023-12-28 08:57:36,335][106225] Updated weights for policy 1, policy_version 1909934 (0.0011) [2023-12-28 08:57:36,401][106225] Updated weights for policy 1, policy_version 1909944 (0.0010) [2023-12-28 08:57:36,701][106226] Updated weights for policy 0, policy_version 1905743 (0.0011) [2023-12-28 08:57:36,758][106226] Updated weights for policy 0, policy_version 1905753 (0.0011) [2023-12-28 08:57:36,818][106226] Updated weights for policy 0, policy_version 1905763 (0.0010) [2023-12-28 08:57:37,118][106225] Updated weights for policy 1, policy_version 1909954 (0.0011) [2023-12-28 08:57:37,168][106225] Updated weights for policy 1, policy_version 1909964 (0.0010) [2023-12-28 08:57:37,223][106225] Updated weights for policy 1, policy_version 1909974 (0.0008) [2023-12-28 08:57:37,284][106225] Updated weights for policy 1, policy_version 1909984 (0.0006) [2023-12-28 08:57:37,543][106226] Updated weights for policy 0, policy_version 1905773 (0.0010) [2023-12-28 08:57:37,606][106226] Updated weights for policy 0, policy_version 1905783 (0.0011) [2023-12-28 08:57:37,670][106226] Updated weights for policy 0, policy_version 1905793 (0.0011) [2023-12-28 08:57:37,907][106225] Updated weights for policy 1, policy_version 1909994 (0.0008) [2023-12-28 08:57:37,962][106225] Updated weights for policy 1, policy_version 1910004 (0.0006) [2023-12-28 08:57:38,021][106225] Updated weights for policy 1, policy_version 1910014 (0.0009) [2023-12-28 08:57:38,365][106226] Updated weights for policy 0, policy_version 1905803 (0.0011) [2023-12-28 08:57:38,424][106226] Updated weights for policy 0, policy_version 1905813 (0.0011) [2023-12-28 08:57:38,479][106226] Updated weights for policy 0, policy_version 1905823 (0.0011) [2023-12-28 08:57:38,760][106225] Updated weights for policy 1, policy_version 1910024 (0.0010) [2023-12-28 08:57:38,817][106225] Updated weights for policy 1, policy_version 1910034 (0.0010) [2023-12-28 08:57:38,874][106225] Updated weights for policy 1, policy_version 1910044 (0.0010) [2023-12-28 08:57:39,174][106226] Updated weights for policy 0, policy_version 1905833 (0.0011) [2023-12-28 08:57:39,231][106226] Updated weights for policy 0, policy_version 1905843 (0.0010) [2023-12-28 08:57:39,294][106226] Updated weights for policy 0, policy_version 1905853 (0.0009) [2023-12-28 08:57:39,374][106226] Updated weights for policy 0, policy_version 1905863 (0.0010) [2023-12-28 08:57:39,586][106225] Updated weights for policy 1, policy_version 1910054 (0.0009) [2023-12-28 08:57:39,644][106225] Updated weights for policy 1, policy_version 1910064 (0.0008) [2023-12-28 08:57:39,702][106225] Updated weights for policy 1, policy_version 1910074 (0.0008) [2023-12-28 08:57:40,138][106226] Updated weights for policy 0, policy_version 1905873 (0.0008) [2023-12-28 08:57:40,203][106226] Updated weights for policy 0, policy_version 1905883 (0.0008) [2023-12-28 08:57:40,270][106226] Updated weights for policy 0, policy_version 1905893 (0.0011) [2023-12-28 08:57:40,547][106225] Updated weights for policy 1, policy_version 1910084 (0.0008) [2023-12-28 08:57:40,604][106225] Updated weights for policy 1, policy_version 1910094 (0.0008) [2023-12-28 08:57:40,655][106225] Updated weights for policy 1, policy_version 1910104 (0.0010) [2023-12-28 08:57:40,940][106226] Updated weights for policy 0, policy_version 1905903 (0.0010) [2023-12-28 08:57:40,987][106226] Updated weights for policy 0, policy_version 1905913 (0.0010) [2023-12-28 08:57:41,046][106226] Updated weights for policy 0, policy_version 1905923 (0.0009) [2023-12-28 08:57:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 977043456. Throughput: 0: 9785.9, 1: 10085.4. Samples: 977013820. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:41,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.707')] [2023-12-28 08:57:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001910112_489046016.pth... [2023-12-28 08:57:41,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001905928_487997440.pth... [2023-12-28 08:57:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001908928_488742912.pth [2023-12-28 08:57:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001904776_487702528.pth [2023-12-28 08:57:41,399][106225] Updated weights for policy 1, policy_version 1910114 (0.0010) [2023-12-28 08:57:41,464][106225] Updated weights for policy 1, policy_version 1910124 (0.0011) [2023-12-28 08:57:41,529][106225] Updated weights for policy 1, policy_version 1910134 (0.0010) [2023-12-28 08:57:41,591][106225] Updated weights for policy 1, policy_version 1910144 (0.0009) [2023-12-28 08:57:41,850][106226] Updated weights for policy 0, policy_version 1905933 (0.0009) [2023-12-28 08:57:41,906][106226] Updated weights for policy 0, policy_version 1905943 (0.0008) [2023-12-28 08:57:41,971][106226] Updated weights for policy 0, policy_version 1905953 (0.0008) [2023-12-28 08:57:42,266][106225] Updated weights for policy 1, policy_version 1910154 (0.0010) [2023-12-28 08:57:42,329][106225] Updated weights for policy 1, policy_version 1910164 (0.0008) [2023-12-28 08:57:42,392][106225] Updated weights for policy 1, policy_version 1910174 (0.0008) [2023-12-28 08:57:42,676][106226] Updated weights for policy 0, policy_version 1905963 (0.0008) [2023-12-28 08:57:42,743][106226] Updated weights for policy 0, policy_version 1905973 (0.0006) [2023-12-28 08:57:42,801][106226] Updated weights for policy 0, policy_version 1905983 (0.0005) [2023-12-28 08:57:43,159][106225] Updated weights for policy 1, policy_version 1910184 (0.0008) [2023-12-28 08:57:43,213][106225] Updated weights for policy 1, policy_version 1910194 (0.0008) [2023-12-28 08:57:43,286][106225] Updated weights for policy 1, policy_version 1910204 (0.0005) [2023-12-28 08:57:43,453][106226] Updated weights for policy 0, policy_version 1905993 (0.0005) [2023-12-28 08:57:43,505][106226] Updated weights for policy 0, policy_version 1906003 (0.0009) [2023-12-28 08:57:43,549][106226] Updated weights for policy 0, policy_version 1906013 (0.0008) [2023-12-28 08:57:43,604][106226] Updated weights for policy 0, policy_version 1906023 (0.0008) [2023-12-28 08:57:43,944][106225] Updated weights for policy 1, policy_version 1910214 (0.0007) [2023-12-28 08:57:43,991][106225] Updated weights for policy 1, policy_version 1910224 (0.0008) [2023-12-28 08:57:44,040][106225] Updated weights for policy 1, policy_version 1910234 (0.0008) [2023-12-28 08:57:44,325][106226] Updated weights for policy 0, policy_version 1906033 (0.0008) [2023-12-28 08:57:44,381][106226] Updated weights for policy 0, policy_version 1906043 (0.0008) [2023-12-28 08:57:44,441][106226] Updated weights for policy 0, policy_version 1906053 (0.0010) [2023-12-28 08:57:44,729][106225] Updated weights for policy 1, policy_version 1910244 (0.0008) [2023-12-28 08:57:44,795][106225] Updated weights for policy 1, policy_version 1910254 (0.0009) [2023-12-28 08:57:44,859][106225] Updated weights for policy 1, policy_version 1910264 (0.0006) [2023-12-28 08:57:45,216][106226] Updated weights for policy 0, policy_version 1906063 (0.0009) [2023-12-28 08:57:45,283][106226] Updated weights for policy 0, policy_version 1906073 (0.0008) [2023-12-28 08:57:45,342][106226] Updated weights for policy 0, policy_version 1906083 (0.0007) [2023-12-28 08:57:45,573][106225] Updated weights for policy 1, policy_version 1910274 (0.0008) [2023-12-28 08:57:45,622][106225] Updated weights for policy 1, policy_version 1910284 (0.0009) [2023-12-28 08:57:45,680][106225] Updated weights for policy 1, policy_version 1910294 (0.0010) [2023-12-28 08:57:45,733][106225] Updated weights for policy 1, policy_version 1910304 (0.0010) [2023-12-28 08:57:45,925][106226] Updated weights for policy 0, policy_version 1906093 (0.0007) [2023-12-28 08:57:45,980][106226] Updated weights for policy 0, policy_version 1906103 (0.0005) [2023-12-28 08:57:46,034][106226] Updated weights for policy 0, policy_version 1906113 (0.0006) [2023-12-28 08:57:46,175][105115] Fps is (10 sec: 19660.1, 60 sec: 19797.2, 300 sec: 19799.6). Total num frames: 977141760. Throughput: 0: 9785.2, 1: 10000.6. Samples: 977129112. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:46,176][105115] Avg episode reward: [(0, '-4.168'), (1, '-4.717')] [2023-12-28 08:57:46,412][106225] Updated weights for policy 1, policy_version 1910314 (0.0005) [2023-12-28 08:57:46,469][106225] Updated weights for policy 1, policy_version 1910324 (0.0005) [2023-12-28 08:57:46,520][106225] Updated weights for policy 1, policy_version 1910334 (0.0006) [2023-12-28 08:57:46,646][106226] Updated weights for policy 0, policy_version 1906123 (0.0006) [2023-12-28 08:57:46,701][106226] Updated weights for policy 0, policy_version 1906133 (0.0009) [2023-12-28 08:57:46,755][106226] Updated weights for policy 0, policy_version 1906143 (0.0009) [2023-12-28 08:57:47,064][106225] Updated weights for policy 1, policy_version 1910344 (0.0005) [2023-12-28 08:57:47,131][106225] Updated weights for policy 1, policy_version 1910354 (0.0005) [2023-12-28 08:57:47,199][106225] Updated weights for policy 1, policy_version 1910364 (0.0005) [2023-12-28 08:57:47,538][106226] Updated weights for policy 0, policy_version 1906153 (0.0009) [2023-12-28 08:57:47,587][106226] Updated weights for policy 0, policy_version 1906163 (0.0008) [2023-12-28 08:57:47,642][106226] Updated weights for policy 0, policy_version 1906173 (0.0009) [2023-12-28 08:57:47,695][106226] Updated weights for policy 0, policy_version 1906183 (0.0006) [2023-12-28 08:57:47,761][106225] Updated weights for policy 1, policy_version 1910374 (0.0007) [2023-12-28 08:57:47,820][106225] Updated weights for policy 1, policy_version 1910384 (0.0009) [2023-12-28 08:57:47,882][106225] Updated weights for policy 1, policy_version 1910394 (0.0008) [2023-12-28 08:57:48,437][106226] Updated weights for policy 0, policy_version 1906193 (0.0009) [2023-12-28 08:57:48,490][106226] Updated weights for policy 0, policy_version 1906203 (0.0008) [2023-12-28 08:57:48,547][106226] Updated weights for policy 0, policy_version 1906213 (0.0009) [2023-12-28 08:57:48,579][106225] Updated weights for policy 1, policy_version 1910404 (0.0008) [2023-12-28 08:57:48,641][106225] Updated weights for policy 1, policy_version 1910414 (0.0009) [2023-12-28 08:57:48,704][106225] Updated weights for policy 1, policy_version 1910424 (0.0009) [2023-12-28 08:57:49,162][106226] Updated weights for policy 0, policy_version 1906223 (0.0006) [2023-12-28 08:57:49,235][106226] Updated weights for policy 0, policy_version 1906233 (0.0007) [2023-12-28 08:57:49,294][106226] Updated weights for policy 0, policy_version 1906243 (0.0007) [2023-12-28 08:57:49,394][106225] Updated weights for policy 1, policy_version 1910434 (0.0006) [2023-12-28 08:57:49,447][106225] Updated weights for policy 1, policy_version 1910444 (0.0006) [2023-12-28 08:57:49,504][106225] Updated weights for policy 1, policy_version 1910454 (0.0007) [2023-12-28 08:57:49,560][106225] Updated weights for policy 1, policy_version 1910464 (0.0008) [2023-12-28 08:57:50,026][106226] Updated weights for policy 0, policy_version 1906253 (0.0006) [2023-12-28 08:57:50,085][106226] Updated weights for policy 0, policy_version 1906263 (0.0008) [2023-12-28 08:57:50,145][106226] Updated weights for policy 0, policy_version 1906273 (0.0006) [2023-12-28 08:57:50,371][106225] Updated weights for policy 1, policy_version 1910474 (0.0009) [2023-12-28 08:57:50,434][106225] Updated weights for policy 1, policy_version 1910484 (0.0009) [2023-12-28 08:57:50,499][106225] Updated weights for policy 1, policy_version 1910494 (0.0010) [2023-12-28 08:57:50,765][106226] Updated weights for policy 0, policy_version 1906283 (0.0007) [2023-12-28 08:57:50,830][106226] Updated weights for policy 0, policy_version 1906293 (0.0011) [2023-12-28 08:57:50,897][106226] Updated weights for policy 0, policy_version 1906303 (0.0010) [2023-12-28 08:57:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 977240064. Throughput: 0: 9786.9, 1: 10054.8. Samples: 977250836. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:51,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.614')] [2023-12-28 08:57:51,217][106225] Updated weights for policy 1, policy_version 1910504 (0.0008) [2023-12-28 08:57:51,283][106225] Updated weights for policy 1, policy_version 1910514 (0.0008) [2023-12-28 08:57:51,346][106225] Updated weights for policy 1, policy_version 1910524 (0.0008) [2023-12-28 08:57:51,676][106226] Updated weights for policy 0, policy_version 1906313 (0.0009) [2023-12-28 08:57:51,749][106226] Updated weights for policy 0, policy_version 1906323 (0.0008) [2023-12-28 08:57:51,816][106226] Updated weights for policy 0, policy_version 1906333 (0.0008) [2023-12-28 08:57:51,880][106226] Updated weights for policy 0, policy_version 1906343 (0.0008) [2023-12-28 08:57:52,121][106225] Updated weights for policy 1, policy_version 1910534 (0.0008) [2023-12-28 08:57:52,171][106225] Updated weights for policy 1, policy_version 1910544 (0.0008) [2023-12-28 08:57:52,232][106225] Updated weights for policy 1, policy_version 1910554 (0.0008) [2023-12-28 08:57:52,623][106226] Updated weights for policy 0, policy_version 1906353 (0.0011) [2023-12-28 08:57:52,688][106226] Updated weights for policy 0, policy_version 1906363 (0.0008) [2023-12-28 08:57:52,757][106226] Updated weights for policy 0, policy_version 1906373 (0.0011) [2023-12-28 08:57:52,920][106225] Updated weights for policy 1, policy_version 1910564 (0.0008) [2023-12-28 08:57:52,974][106225] Updated weights for policy 1, policy_version 1910574 (0.0007) [2023-12-28 08:57:53,030][106225] Updated weights for policy 1, policy_version 1910584 (0.0008) [2023-12-28 08:57:53,354][106226] Updated weights for policy 0, policy_version 1906383 (0.0007) [2023-12-28 08:57:53,408][106226] Updated weights for policy 0, policy_version 1906393 (0.0005) [2023-12-28 08:57:53,467][106226] Updated weights for policy 0, policy_version 1906403 (0.0005) [2023-12-28 08:57:53,795][106225] Updated weights for policy 1, policy_version 1910594 (0.0008) [2023-12-28 08:57:53,860][106225] Updated weights for policy 1, policy_version 1910604 (0.0008) [2023-12-28 08:57:53,913][106225] Updated weights for policy 1, policy_version 1910614 (0.0007) [2023-12-28 08:57:53,967][106225] Updated weights for policy 1, policy_version 1910624 (0.0007) [2023-12-28 08:57:54,120][106226] Updated weights for policy 0, policy_version 1906413 (0.0008) [2023-12-28 08:57:54,180][106226] Updated weights for policy 0, policy_version 1906423 (0.0010) [2023-12-28 08:57:54,240][106226] Updated weights for policy 0, policy_version 1906433 (0.0010) [2023-12-28 08:57:54,662][106225] Updated weights for policy 1, policy_version 1910634 (0.0005) [2023-12-28 08:57:54,730][106225] Updated weights for policy 1, policy_version 1910644 (0.0005) [2023-12-28 08:57:54,797][106225] Updated weights for policy 1, policy_version 1910654 (0.0008) [2023-12-28 08:57:54,870][106226] Updated weights for policy 0, policy_version 1906443 (0.0009) [2023-12-28 08:57:54,931][106226] Updated weights for policy 0, policy_version 1906453 (0.0005) [2023-12-28 08:57:55,017][106226] Updated weights for policy 0, policy_version 1906463 (0.0007) [2023-12-28 08:57:55,455][106225] Updated weights for policy 1, policy_version 1910664 (0.0008) [2023-12-28 08:57:55,511][106225] Updated weights for policy 1, policy_version 1910674 (0.0005) [2023-12-28 08:57:55,571][106225] Updated weights for policy 1, policy_version 1910684 (0.0005) [2023-12-28 08:57:55,685][106226] Updated weights for policy 0, policy_version 1906473 (0.0008) [2023-12-28 08:57:55,734][106226] Updated weights for policy 0, policy_version 1906483 (0.0009) [2023-12-28 08:57:55,787][106226] Updated weights for policy 0, policy_version 1906493 (0.0006) [2023-12-28 08:57:55,845][106226] Updated weights for policy 0, policy_version 1906503 (0.0006) [2023-12-28 08:57:56,175][105115] Fps is (10 sec: 19661.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 977338368. Throughput: 0: 9820.0, 1: 10011.2. Samples: 977309080. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:57:56,175][105115] Avg episode reward: [(0, '-4.368'), (1, '-4.734')] [2023-12-28 08:57:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001906504_488144896.pth... [2023-12-28 08:57:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001905352_487849984.pth [2023-12-28 08:57:56,210][106225] Updated weights for policy 1, policy_version 1910694 (0.0008) [2023-12-28 08:57:56,262][106225] Updated weights for policy 1, policy_version 1910704 (0.0008) [2023-12-28 08:57:56,325][106225] Updated weights for policy 1, policy_version 1910714 (0.0005) [2023-12-28 08:57:56,368][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001910720_489201664.pth... [2023-12-28 08:57:56,371][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001909536_488898560.pth [2023-12-28 08:57:56,490][106226] Updated weights for policy 0, policy_version 1906513 (0.0010) [2023-12-28 08:57:56,546][106226] Updated weights for policy 0, policy_version 1906523 (0.0010) [2023-12-28 08:57:56,607][106226] Updated weights for policy 0, policy_version 1906533 (0.0009) [2023-12-28 08:57:56,856][106225] Updated weights for policy 1, policy_version 1910724 (0.0007) [2023-12-28 08:57:56,914][106225] Updated weights for policy 1, policy_version 1910734 (0.0010) [2023-12-28 08:57:56,970][106225] Updated weights for policy 1, policy_version 1910744 (0.0010) [2023-12-28 08:57:57,358][106226] Updated weights for policy 0, policy_version 1906543 (0.0008) [2023-12-28 08:57:57,411][106226] Updated weights for policy 0, policy_version 1906553 (0.0008) [2023-12-28 08:57:57,459][106226] Updated weights for policy 0, policy_version 1906563 (0.0006) [2023-12-28 08:57:57,633][106225] Updated weights for policy 1, policy_version 1910754 (0.0009) [2023-12-28 08:57:57,689][106225] Updated weights for policy 1, policy_version 1910764 (0.0005) [2023-12-28 08:57:57,745][106225] Updated weights for policy 1, policy_version 1910774 (0.0010) [2023-12-28 08:57:57,794][106225] Updated weights for policy 1, policy_version 1910784 (0.0010) [2023-12-28 08:57:58,154][106226] Updated weights for policy 0, policy_version 1906573 (0.0006) [2023-12-28 08:57:58,197][106226] Updated weights for policy 0, policy_version 1906583 (0.0005) [2023-12-28 08:57:58,258][106226] Updated weights for policy 0, policy_version 1906593 (0.0007) [2023-12-28 08:57:58,410][106225] Updated weights for policy 1, policy_version 1910794 (0.0009) [2023-12-28 08:57:58,475][106225] Updated weights for policy 1, policy_version 1910804 (0.0007) [2023-12-28 08:57:58,537][106225] Updated weights for policy 1, policy_version 1910814 (0.0008) [2023-12-28 08:57:59,077][106226] Updated weights for policy 0, policy_version 1906603 (0.0009) [2023-12-28 08:57:59,140][106226] Updated weights for policy 0, policy_version 1906613 (0.0008) [2023-12-28 08:57:59,198][106226] Updated weights for policy 0, policy_version 1906623 (0.0007) [2023-12-28 08:57:59,422][106225] Updated weights for policy 1, policy_version 1910824 (0.0008) [2023-12-28 08:57:59,481][106225] Updated weights for policy 1, policy_version 1910834 (0.0006) [2023-12-28 08:57:59,538][106225] Updated weights for policy 1, policy_version 1910844 (0.0005) [2023-12-28 08:57:59,993][106226] Updated weights for policy 0, policy_version 1906636 (0.0009) [2023-12-28 08:58:00,058][106226] Updated weights for policy 0, policy_version 1906646 (0.0008) [2023-12-28 08:58:00,127][106226] Updated weights for policy 0, policy_version 1906656 (0.0007) [2023-12-28 08:58:00,212][106225] Updated weights for policy 1, policy_version 1910854 (0.0006) [2023-12-28 08:58:00,266][106225] Updated weights for policy 1, policy_version 1910864 (0.0009) [2023-12-28 08:58:00,315][106225] Updated weights for policy 1, policy_version 1910874 (0.0010) [2023-12-28 08:58:00,741][106226] Updated weights for policy 0, policy_version 1906666 (0.0007) [2023-12-28 08:58:00,804][106226] Updated weights for policy 0, policy_version 1906676 (0.0011) [2023-12-28 08:58:00,866][106226] Updated weights for policy 0, policy_version 1906686 (0.0006) [2023-12-28 08:58:00,912][106226] Updated weights for policy 0, policy_version 1906696 (0.0005) [2023-12-28 08:58:01,005][106225] Updated weights for policy 1, policy_version 1910884 (0.0009) [2023-12-28 08:58:01,064][106225] Updated weights for policy 1, policy_version 1910894 (0.0008) [2023-12-28 08:58:01,109][106225] Updated weights for policy 1, policy_version 1910904 (0.0006) [2023-12-28 08:58:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 977444864. Throughput: 0: 9719.5, 1: 10075.3. Samples: 977428800. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:01,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.489')] [2023-12-28 08:58:01,587][106226] Updated weights for policy 0, policy_version 1906706 (0.0005) [2023-12-28 08:58:01,654][106226] Updated weights for policy 0, policy_version 1906716 (0.0008) [2023-12-28 08:58:01,713][106226] Updated weights for policy 0, policy_version 1906726 (0.0009) [2023-12-28 08:58:01,876][106225] Updated weights for policy 1, policy_version 1910914 (0.0007) [2023-12-28 08:58:01,923][106225] Updated weights for policy 1, policy_version 1910924 (0.0008) [2023-12-28 08:58:01,981][106225] Updated weights for policy 1, policy_version 1910934 (0.0008) [2023-12-28 08:58:02,039][106225] Updated weights for policy 1, policy_version 1910944 (0.0008) [2023-12-28 08:58:02,442][106226] Updated weights for policy 0, policy_version 1906736 (0.0011) [2023-12-28 08:58:02,507][106226] Updated weights for policy 0, policy_version 1906746 (0.0011) [2023-12-28 08:58:02,575][106226] Updated weights for policy 0, policy_version 1906756 (0.0011) [2023-12-28 08:58:02,713][106225] Updated weights for policy 1, policy_version 1910954 (0.0005) [2023-12-28 08:58:02,774][106225] Updated weights for policy 1, policy_version 1910964 (0.0005) [2023-12-28 08:58:02,828][106225] Updated weights for policy 1, policy_version 1910974 (0.0007) [2023-12-28 08:58:03,186][106226] Updated weights for policy 0, policy_version 1906766 (0.0008) [2023-12-28 08:58:03,243][106226] Updated weights for policy 0, policy_version 1906776 (0.0009) [2023-12-28 08:58:03,290][106226] Updated weights for policy 0, policy_version 1906786 (0.0010) [2023-12-28 08:58:03,416][106225] Updated weights for policy 1, policy_version 1910984 (0.0006) [2023-12-28 08:58:03,476][106225] Updated weights for policy 1, policy_version 1910994 (0.0006) [2023-12-28 08:58:03,527][106225] Updated weights for policy 1, policy_version 1911004 (0.0007) [2023-12-28 08:58:03,879][106226] Updated weights for policy 0, policy_version 1906796 (0.0010) [2023-12-28 08:58:03,939][106226] Updated weights for policy 0, policy_version 1906806 (0.0011) [2023-12-28 08:58:04,003][106226] Updated weights for policy 0, policy_version 1906816 (0.0011) [2023-12-28 08:58:04,152][106225] Updated weights for policy 1, policy_version 1911014 (0.0007) [2023-12-28 08:58:04,218][106225] Updated weights for policy 1, policy_version 1911024 (0.0009) [2023-12-28 08:58:04,283][106225] Updated weights for policy 1, policy_version 1911034 (0.0008) [2023-12-28 08:58:04,673][106226] Updated weights for policy 0, policy_version 1906826 (0.0011) [2023-12-28 08:58:04,726][106226] Updated weights for policy 0, policy_version 1906836 (0.0010) [2023-12-28 08:58:04,792][106226] Updated weights for policy 0, policy_version 1906846 (0.0011) [2023-12-28 08:58:04,851][106226] Updated weights for policy 0, policy_version 1906856 (0.0010) [2023-12-28 08:58:04,946][106225] Updated weights for policy 1, policy_version 1911044 (0.0007) [2023-12-28 08:58:05,002][106225] Updated weights for policy 1, policy_version 1911054 (0.0007) [2023-12-28 08:58:05,060][106225] Updated weights for policy 1, policy_version 1911064 (0.0008) [2023-12-28 08:58:05,481][106226] Updated weights for policy 0, policy_version 1906866 (0.0011) [2023-12-28 08:58:05,532][106226] Updated weights for policy 0, policy_version 1906876 (0.0010) [2023-12-28 08:58:05,586][106226] Updated weights for policy 0, policy_version 1906886 (0.0010) [2023-12-28 08:58:05,764][106225] Updated weights for policy 1, policy_version 1911074 (0.0007) [2023-12-28 08:58:05,824][106225] Updated weights for policy 1, policy_version 1911084 (0.0007) [2023-12-28 08:58:05,887][106225] Updated weights for policy 1, policy_version 1911094 (0.0008) [2023-12-28 08:58:05,947][106225] Updated weights for policy 1, policy_version 1911104 (0.0008) [2023-12-28 08:58:06,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 977543168. Throughput: 0: 9803.4, 1: 10147.0. Samples: 977553464. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:06,175][105115] Avg episode reward: [(0, '-4.304'), (1, '-4.905')] [2023-12-28 08:58:06,288][106226] Updated weights for policy 0, policy_version 1906896 (0.0009) [2023-12-28 08:58:06,358][106226] Updated weights for policy 0, policy_version 1906906 (0.0009) [2023-12-28 08:58:06,430][106226] Updated weights for policy 0, policy_version 1906916 (0.0009) [2023-12-28 08:58:06,692][106225] Updated weights for policy 1, policy_version 1911114 (0.0010) [2023-12-28 08:58:06,746][106225] Updated weights for policy 1, policy_version 1911124 (0.0008) [2023-12-28 08:58:06,803][106225] Updated weights for policy 1, policy_version 1911134 (0.0005) [2023-12-28 08:58:07,060][106226] Updated weights for policy 0, policy_version 1906926 (0.0011) [2023-12-28 08:58:07,108][106226] Updated weights for policy 0, policy_version 1906936 (0.0010) [2023-12-28 08:58:07,154][106226] Updated weights for policy 0, policy_version 1906946 (0.0010) [2023-12-28 08:58:07,389][106225] Updated weights for policy 1, policy_version 1911144 (0.0007) [2023-12-28 08:58:07,440][106225] Updated weights for policy 1, policy_version 1911154 (0.0009) [2023-12-28 08:58:07,491][106225] Updated weights for policy 1, policy_version 1911165 (0.0009) [2023-12-28 08:58:07,779][106226] Updated weights for policy 0, policy_version 1906956 (0.0008) [2023-12-28 08:58:07,834][106226] Updated weights for policy 0, policy_version 1906966 (0.0005) [2023-12-28 08:58:07,903][106226] Updated weights for policy 0, policy_version 1906976 (0.0010) [2023-12-28 08:58:08,253][106225] Updated weights for policy 1, policy_version 1911175 (0.0008) [2023-12-28 08:58:08,314][106225] Updated weights for policy 1, policy_version 1911185 (0.0008) [2023-12-28 08:58:08,380][106225] Updated weights for policy 1, policy_version 1911195 (0.0009) [2023-12-28 08:58:08,574][106226] Updated weights for policy 0, policy_version 1906986 (0.0010) [2023-12-28 08:58:08,638][106226] Updated weights for policy 0, policy_version 1906996 (0.0008) [2023-12-28 08:58:08,697][106226] Updated weights for policy 0, policy_version 1907006 (0.0008) [2023-12-28 08:58:08,759][106226] Updated weights for policy 0, policy_version 1907016 (0.0009) [2023-12-28 08:58:09,143][106225] Updated weights for policy 1, policy_version 1911205 (0.0009) [2023-12-28 08:58:09,202][106225] Updated weights for policy 1, policy_version 1911215 (0.0009) [2023-12-28 08:58:09,268][106225] Updated weights for policy 1, policy_version 1911225 (0.0008) [2023-12-28 08:58:09,406][106226] Updated weights for policy 0, policy_version 1907026 (0.0008) [2023-12-28 08:58:09,473][106226] Updated weights for policy 0, policy_version 1907036 (0.0007) [2023-12-28 08:58:09,546][106226] Updated weights for policy 0, policy_version 1907046 (0.0006) [2023-12-28 08:58:10,039][106225] Updated weights for policy 1, policy_version 1911235 (0.0008) [2023-12-28 08:58:10,093][106225] Updated weights for policy 1, policy_version 1911245 (0.0008) [2023-12-28 08:58:10,157][106225] Updated weights for policy 1, policy_version 1911255 (0.0007) [2023-12-28 08:58:10,168][106226] Updated weights for policy 0, policy_version 1907056 (0.0008) [2023-12-28 08:58:10,235][106226] Updated weights for policy 0, policy_version 1907066 (0.0008) [2023-12-28 08:58:10,297][106226] Updated weights for policy 0, policy_version 1907076 (0.0008) [2023-12-28 08:58:10,895][106225] Updated weights for policy 1, policy_version 1911265 (0.0008) [2023-12-28 08:58:10,945][106225] Updated weights for policy 1, policy_version 1911275 (0.0008) [2023-12-28 08:58:10,995][106225] Updated weights for policy 1, policy_version 1911285 (0.0009) [2023-12-28 08:58:11,004][106226] Updated weights for policy 0, policy_version 1907086 (0.0007) [2023-12-28 08:58:11,071][106225] Updated weights for policy 1, policy_version 1911295 (0.0008) [2023-12-28 08:58:11,072][106226] Updated weights for policy 0, policy_version 1907096 (0.0008) [2023-12-28 08:58:11,133][106226] Updated weights for policy 0, policy_version 1907106 (0.0010) [2023-12-28 08:58:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 977649664. Throughput: 0: 9896.9, 1: 10168.3. Samples: 977614724. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:11,175][105115] Avg episode reward: [(0, '-4.312'), (1, '-4.238')] [2023-12-28 08:58:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001911296_489349120.pth... [2023-12-28 08:58:11,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001907112_488300544.pth... [2023-12-28 08:58:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001905928_487997440.pth [2023-12-28 08:58:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001910112_489046016.pth [2023-12-28 08:58:11,909][106226] Updated weights for policy 0, policy_version 1907116 (0.0009) [2023-12-28 08:58:11,927][106225] Updated weights for policy 1, policy_version 1911305 (0.0006) [2023-12-28 08:58:11,971][106226] Updated weights for policy 0, policy_version 1907126 (0.0011) [2023-12-28 08:58:11,982][106225] Updated weights for policy 1, policy_version 1911315 (0.0007) [2023-12-28 08:58:12,034][106226] Updated weights for policy 0, policy_version 1907136 (0.0011) [2023-12-28 08:58:12,039][106225] Updated weights for policy 1, policy_version 1911325 (0.0007) [2023-12-28 08:58:12,680][106225] Updated weights for policy 1, policy_version 1911335 (0.0006) [2023-12-28 08:58:12,743][106225] Updated weights for policy 1, policy_version 1911345 (0.0007) [2023-12-28 08:58:12,748][106226] Updated weights for policy 0, policy_version 1907146 (0.0011) [2023-12-28 08:58:12,798][106226] Updated weights for policy 0, policy_version 1907156 (0.0009) [2023-12-28 08:58:12,799][106225] Updated weights for policy 1, policy_version 1911355 (0.0008) [2023-12-28 08:58:12,856][106226] Updated weights for policy 0, policy_version 1907166 (0.0007) [2023-12-28 08:58:12,920][106226] Updated weights for policy 0, policy_version 1907176 (0.0009) [2023-12-28 08:58:13,502][106225] Updated weights for policy 1, policy_version 1911365 (0.0007) [2023-12-28 08:58:13,553][106225] Updated weights for policy 1, policy_version 1911375 (0.0008) [2023-12-28 08:58:13,573][106226] Updated weights for policy 0, policy_version 1907186 (0.0005) [2023-12-28 08:58:13,609][106225] Updated weights for policy 1, policy_version 1911385 (0.0008) [2023-12-28 08:58:13,626][106226] Updated weights for policy 0, policy_version 1907196 (0.0007) [2023-12-28 08:58:13,687][106226] Updated weights for policy 0, policy_version 1907206 (0.0009) [2023-12-28 08:58:14,308][106226] Updated weights for policy 0, policy_version 1907216 (0.0010) [2023-12-28 08:58:14,329][106225] Updated weights for policy 1, policy_version 1911395 (0.0008) [2023-12-28 08:58:14,364][106226] Updated weights for policy 0, policy_version 1907226 (0.0010) [2023-12-28 08:58:14,386][106225] Updated weights for policy 1, policy_version 1911405 (0.0006) [2023-12-28 08:58:14,420][106226] Updated weights for policy 0, policy_version 1907236 (0.0010) [2023-12-28 08:58:14,445][106225] Updated weights for policy 1, policy_version 1911415 (0.0006) [2023-12-28 08:58:15,097][106226] Updated weights for policy 0, policy_version 1907246 (0.0010) [2023-12-28 08:58:15,152][106226] Updated weights for policy 0, policy_version 1907256 (0.0011) [2023-12-28 08:58:15,185][106225] Updated weights for policy 1, policy_version 1911425 (0.0008) [2023-12-28 08:58:15,217][106226] Updated weights for policy 0, policy_version 1907266 (0.0011) [2023-12-28 08:58:15,249][106225] Updated weights for policy 1, policy_version 1911435 (0.0011) [2023-12-28 08:58:15,308][106225] Updated weights for policy 1, policy_version 1911445 (0.0010) [2023-12-28 08:58:15,376][106225] Updated weights for policy 1, policy_version 1911455 (0.0010) [2023-12-28 08:58:15,936][106226] Updated weights for policy 0, policy_version 1907276 (0.0011) [2023-12-28 08:58:15,993][106226] Updated weights for policy 0, policy_version 1907286 (0.0011) [2023-12-28 08:58:16,016][106225] Updated weights for policy 1, policy_version 1911465 (0.0007) [2023-12-28 08:58:16,054][106226] Updated weights for policy 0, policy_version 1907296 (0.0011) [2023-12-28 08:58:16,067][106225] Updated weights for policy 1, policy_version 1911475 (0.0005) [2023-12-28 08:58:16,127][106225] Updated weights for policy 1, policy_version 1911485 (0.0007) [2023-12-28 08:58:16,175][105115] Fps is (10 sec: 20479.6, 60 sec: 20070.4, 300 sec: 19855.2). Total num frames: 977747968. Throughput: 0: 10008.7, 1: 9961.1. Samples: 977731816. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:16,176][105115] Avg episode reward: [(0, '-4.141'), (1, '-5.020')] [2023-12-28 08:58:16,752][106225] Updated weights for policy 1, policy_version 1911495 (0.0006) [2023-12-28 08:58:16,800][106226] Updated weights for policy 0, policy_version 1907306 (0.0010) [2023-12-28 08:58:16,816][106225] Updated weights for policy 1, policy_version 1911505 (0.0005) [2023-12-28 08:58:16,858][106226] Updated weights for policy 0, policy_version 1907316 (0.0009) [2023-12-28 08:58:16,875][106225] Updated weights for policy 1, policy_version 1911515 (0.0005) [2023-12-28 08:58:16,917][106226] Updated weights for policy 0, policy_version 1907326 (0.0007) [2023-12-28 08:58:16,971][106226] Updated weights for policy 0, policy_version 1907336 (0.0009) [2023-12-28 08:58:17,399][106225] Updated weights for policy 1, policy_version 1911525 (0.0005) [2023-12-28 08:58:17,463][106225] Updated weights for policy 1, policy_version 1911535 (0.0005) [2023-12-28 08:58:17,511][106225] Updated weights for policy 1, policy_version 1911545 (0.0005) [2023-12-28 08:58:17,728][106226] Updated weights for policy 0, policy_version 1907346 (0.0006) [2023-12-28 08:58:17,775][106226] Updated weights for policy 0, policy_version 1907356 (0.0008) [2023-12-28 08:58:17,829][106226] Updated weights for policy 0, policy_version 1907366 (0.0005) [2023-12-28 08:58:18,037][106225] Updated weights for policy 1, policy_version 1911555 (0.0005) [2023-12-28 08:58:18,085][106225] Updated weights for policy 1, policy_version 1911565 (0.0005) [2023-12-28 08:58:18,137][106225] Updated weights for policy 1, policy_version 1911575 (0.0008) [2023-12-28 08:58:18,479][106226] Updated weights for policy 0, policy_version 1907376 (0.0008) [2023-12-28 08:58:18,541][106226] Updated weights for policy 0, policy_version 1907386 (0.0007) [2023-12-28 08:58:18,606][106226] Updated weights for policy 0, policy_version 1907396 (0.0007) [2023-12-28 08:58:18,831][106225] Updated weights for policy 1, policy_version 1911585 (0.0008) [2023-12-28 08:58:18,896][106225] Updated weights for policy 1, policy_version 1911595 (0.0008) [2023-12-28 08:58:18,950][106225] Updated weights for policy 1, policy_version 1911605 (0.0007) [2023-12-28 08:58:18,999][106225] Updated weights for policy 1, policy_version 1911615 (0.0008) [2023-12-28 08:58:19,352][106226] Updated weights for policy 0, policy_version 1907406 (0.0011) [2023-12-28 08:58:19,422][106226] Updated weights for policy 0, policy_version 1907416 (0.0010) [2023-12-28 08:58:19,490][106226] Updated weights for policy 0, policy_version 1907426 (0.0010) [2023-12-28 08:58:19,780][106225] Updated weights for policy 1, policy_version 1911625 (0.0008) [2023-12-28 08:58:19,845][106225] Updated weights for policy 1, policy_version 1911635 (0.0011) [2023-12-28 08:58:19,915][106225] Updated weights for policy 1, policy_version 1911645 (0.0008) [2023-12-28 08:58:20,199][106226] Updated weights for policy 0, policy_version 1907436 (0.0010) [2023-12-28 08:58:20,256][106226] Updated weights for policy 0, policy_version 1907446 (0.0011) [2023-12-28 08:58:20,312][106226] Updated weights for policy 0, policy_version 1907456 (0.0011) [2023-12-28 08:58:20,679][106225] Updated weights for policy 1, policy_version 1911655 (0.0008) [2023-12-28 08:58:20,727][106225] Updated weights for policy 1, policy_version 1911665 (0.0007) [2023-12-28 08:58:20,776][106225] Updated weights for policy 1, policy_version 1911675 (0.0008) [2023-12-28 08:58:21,027][106226] Updated weights for policy 0, policy_version 1907466 (0.0009) [2023-12-28 08:58:21,096][106226] Updated weights for policy 0, policy_version 1907476 (0.0007) [2023-12-28 08:58:21,169][106226] Updated weights for policy 0, policy_version 1907486 (0.0008) [2023-12-28 08:58:21,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 977838080. Throughput: 0: 9970.5, 1: 9961.9. Samples: 977851352. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:21,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.767')] [2023-12-28 08:58:21,230][106226] Updated weights for policy 0, policy_version 1907496 (0.0009) [2023-12-28 08:58:21,569][106225] Updated weights for policy 1, policy_version 1911685 (0.0008) [2023-12-28 08:58:21,633][106225] Updated weights for policy 1, policy_version 1911695 (0.0009) [2023-12-28 08:58:21,689][106225] Updated weights for policy 1, policy_version 1911705 (0.0009) [2023-12-28 08:58:22,008][106226] Updated weights for policy 0, policy_version 1907506 (0.0008) [2023-12-28 08:58:22,066][106226] Updated weights for policy 0, policy_version 1907516 (0.0009) [2023-12-28 08:58:22,128][106226] Updated weights for policy 0, policy_version 1907526 (0.0009) [2023-12-28 08:58:22,504][106225] Updated weights for policy 1, policy_version 1911715 (0.0009) [2023-12-28 08:58:22,571][106225] Updated weights for policy 1, policy_version 1911725 (0.0008) [2023-12-28 08:58:22,631][106225] Updated weights for policy 1, policy_version 1911735 (0.0008) [2023-12-28 08:58:22,855][106226] Updated weights for policy 0, policy_version 1907536 (0.0008) [2023-12-28 08:58:22,923][106226] Updated weights for policy 0, policy_version 1907546 (0.0008) [2023-12-28 08:58:22,990][106226] Updated weights for policy 0, policy_version 1907556 (0.0008) [2023-12-28 08:58:23,383][106225] Updated weights for policy 1, policy_version 1911745 (0.0008) [2023-12-28 08:58:23,435][106225] Updated weights for policy 1, policy_version 1911755 (0.0009) [2023-12-28 08:58:23,488][106225] Updated weights for policy 1, policy_version 1911765 (0.0009) [2023-12-28 08:58:23,544][106225] Updated weights for policy 1, policy_version 1911775 (0.0008) [2023-12-28 08:58:23,660][106226] Updated weights for policy 0, policy_version 1907566 (0.0008) [2023-12-28 08:58:23,715][106226] Updated weights for policy 0, policy_version 1907576 (0.0005) [2023-12-28 08:58:23,763][106226] Updated weights for policy 0, policy_version 1907586 (0.0005) [2023-12-28 08:58:24,224][106225] Updated weights for policy 1, policy_version 1911785 (0.0006) [2023-12-28 08:58:24,287][106225] Updated weights for policy 1, policy_version 1911795 (0.0005) [2023-12-28 08:58:24,342][106225] Updated weights for policy 1, policy_version 1911805 (0.0007) [2023-12-28 08:58:24,504][106226] Updated weights for policy 0, policy_version 1907596 (0.0007) [2023-12-28 08:58:24,562][106226] Updated weights for policy 0, policy_version 1907606 (0.0008) [2023-12-28 08:58:24,612][106226] Updated weights for policy 0, policy_version 1907616 (0.0008) [2023-12-28 08:58:25,056][106225] Updated weights for policy 1, policy_version 1911815 (0.0006) [2023-12-28 08:58:25,120][106225] Updated weights for policy 1, policy_version 1911825 (0.0005) [2023-12-28 08:58:25,185][106225] Updated weights for policy 1, policy_version 1911835 (0.0005) [2023-12-28 08:58:25,307][106226] Updated weights for policy 0, policy_version 1907626 (0.0009) [2023-12-28 08:58:25,365][106226] Updated weights for policy 0, policy_version 1907636 (0.0009) [2023-12-28 08:58:25,421][106226] Updated weights for policy 0, policy_version 1907646 (0.0009) [2023-12-28 08:58:25,482][106226] Updated weights for policy 0, policy_version 1907656 (0.0009) [2023-12-28 08:58:25,856][106225] Updated weights for policy 1, policy_version 1911845 (0.0008) [2023-12-28 08:58:25,914][106225] Updated weights for policy 1, policy_version 1911855 (0.0009) [2023-12-28 08:58:25,971][106225] Updated weights for policy 1, policy_version 1911865 (0.0008) [2023-12-28 08:58:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 977936384. Throughput: 0: 9966.3, 1: 9871.4. Samples: 977906516. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:26,175][105115] Avg episode reward: [(0, '-4.108'), (1, '-4.572')] [2023-12-28 08:58:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001911872_489496576.pth... [2023-12-28 08:58:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001910720_489201664.pth [2023-12-28 08:58:26,208][106226] Updated weights for policy 0, policy_version 1907666 (0.0008) [2023-12-28 08:58:26,267][106226] Updated weights for policy 0, policy_version 1907676 (0.0009) [2023-12-28 08:58:26,324][106226] Updated weights for policy 0, policy_version 1907686 (0.0008) [2023-12-28 08:58:26,333][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001907688_488448000.pth... [2023-12-28 08:58:26,337][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001906504_488144896.pth [2023-12-28 08:58:26,684][106225] Updated weights for policy 1, policy_version 1911875 (0.0008) [2023-12-28 08:58:26,742][106225] Updated weights for policy 1, policy_version 1911885 (0.0008) [2023-12-28 08:58:26,799][106225] Updated weights for policy 1, policy_version 1911896 (0.0009) [2023-12-28 08:58:27,069][106226] Updated weights for policy 0, policy_version 1907696 (0.0010) [2023-12-28 08:58:27,140][106226] Updated weights for policy 0, policy_version 1907706 (0.0008) [2023-12-28 08:58:27,213][106226] Updated weights for policy 0, policy_version 1907716 (0.0009) [2023-12-28 08:58:27,439][106225] Updated weights for policy 1, policy_version 1911906 (0.0009) [2023-12-28 08:58:27,505][106225] Updated weights for policy 1, policy_version 1911916 (0.0009) [2023-12-28 08:58:27,561][106225] Updated weights for policy 1, policy_version 1911926 (0.0009) [2023-12-28 08:58:27,607][106225] Updated weights for policy 1, policy_version 1911936 (0.0007) [2023-12-28 08:58:27,826][106226] Updated weights for policy 0, policy_version 1907726 (0.0008) [2023-12-28 08:58:27,872][106226] Updated weights for policy 0, policy_version 1907736 (0.0009) [2023-12-28 08:58:27,933][106226] Updated weights for policy 0, policy_version 1907746 (0.0009) [2023-12-28 08:58:28,313][106225] Updated weights for policy 1, policy_version 1911946 (0.0006) [2023-12-28 08:58:28,379][106225] Updated weights for policy 1, policy_version 1911956 (0.0008) [2023-12-28 08:58:28,441][106225] Updated weights for policy 1, policy_version 1911966 (0.0007) [2023-12-28 08:58:28,612][106226] Updated weights for policy 0, policy_version 1907756 (0.0009) [2023-12-28 08:58:28,671][106226] Updated weights for policy 0, policy_version 1907766 (0.0009) [2023-12-28 08:58:28,726][106226] Updated weights for policy 0, policy_version 1907776 (0.0009) [2023-12-28 08:58:29,049][106225] Updated weights for policy 1, policy_version 1911976 (0.0008) [2023-12-28 08:58:29,107][106225] Updated weights for policy 1, policy_version 1911986 (0.0008) [2023-12-28 08:58:29,150][106225] Updated weights for policy 1, policy_version 1911996 (0.0008) [2023-12-28 08:58:29,470][106226] Updated weights for policy 0, policy_version 1907786 (0.0008) [2023-12-28 08:58:29,525][106226] Updated weights for policy 0, policy_version 1907796 (0.0006) [2023-12-28 08:58:29,591][106226] Updated weights for policy 0, policy_version 1907806 (0.0007) [2023-12-28 08:58:29,657][106226] Updated weights for policy 0, policy_version 1907816 (0.0008) [2023-12-28 08:58:29,843][106225] Updated weights for policy 1, policy_version 1912006 (0.0008) [2023-12-28 08:58:29,903][106225] Updated weights for policy 1, policy_version 1912016 (0.0009) [2023-12-28 08:58:29,978][106225] Updated weights for policy 1, policy_version 1912026 (0.0008) [2023-12-28 08:58:30,341][106226] Updated weights for policy 0, policy_version 1907826 (0.0011) [2023-12-28 08:58:30,394][106226] Updated weights for policy 0, policy_version 1907836 (0.0009) [2023-12-28 08:58:30,459][106226] Updated weights for policy 0, policy_version 1907846 (0.0005) [2023-12-28 08:58:30,753][106225] Updated weights for policy 1, policy_version 1912036 (0.0009) [2023-12-28 08:58:30,806][106225] Updated weights for policy 1, policy_version 1912046 (0.0008) [2023-12-28 08:58:30,862][106225] Updated weights for policy 1, policy_version 1912056 (0.0008) [2023-12-28 08:58:31,015][106226] Updated weights for policy 0, policy_version 1907856 (0.0009) [2023-12-28 08:58:31,085][106226] Updated weights for policy 0, policy_version 1907866 (0.0008) [2023-12-28 08:58:31,159][106226] Updated weights for policy 0, policy_version 1907876 (0.0010) [2023-12-28 08:58:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 978034688. Throughput: 0: 9984.2, 1: 9972.9. Samples: 978027172. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:31,175][105115] Avg episode reward: [(0, '-4.354'), (1, '-4.773')] [2023-12-28 08:58:31,729][106225] Updated weights for policy 1, policy_version 1912066 (0.0009) [2023-12-28 08:58:31,790][106225] Updated weights for policy 1, policy_version 1912076 (0.0008) [2023-12-28 08:58:31,845][106225] Updated weights for policy 1, policy_version 1912086 (0.0007) [2023-12-28 08:58:31,891][106226] Updated weights for policy 0, policy_version 1907886 (0.0010) [2023-12-28 08:58:31,897][106225] Updated weights for policy 1, policy_version 1912096 (0.0006) [2023-12-28 08:58:31,947][106226] Updated weights for policy 0, policy_version 1907896 (0.0007) [2023-12-28 08:58:32,022][106226] Updated weights for policy 0, policy_version 1907906 (0.0009) [2023-12-28 08:58:32,638][106226] Updated weights for policy 0, policy_version 1907916 (0.0007) [2023-12-28 08:58:32,695][106226] Updated weights for policy 0, policy_version 1907926 (0.0006) [2023-12-28 08:58:32,721][106225] Updated weights for policy 1, policy_version 1912106 (0.0007) [2023-12-28 08:58:32,750][106226] Updated weights for policy 0, policy_version 1907936 (0.0007) [2023-12-28 08:58:32,781][106225] Updated weights for policy 1, policy_version 1912116 (0.0007) [2023-12-28 08:58:32,849][106225] Updated weights for policy 1, policy_version 1912126 (0.0009) [2023-12-28 08:58:33,389][106226] Updated weights for policy 0, policy_version 1907946 (0.0007) [2023-12-28 08:58:33,445][106226] Updated weights for policy 0, policy_version 1907956 (0.0005) [2023-12-28 08:58:33,478][106225] Updated weights for policy 1, policy_version 1912136 (0.0009) [2023-12-28 08:58:33,503][106226] Updated weights for policy 0, policy_version 1907966 (0.0005) [2023-12-28 08:58:33,524][106225] Updated weights for policy 1, policy_version 1912146 (0.0008) [2023-12-28 08:58:33,563][106226] Updated weights for policy 0, policy_version 1907976 (0.0007) [2023-12-28 08:58:33,574][106225] Updated weights for policy 1, policy_version 1912156 (0.0007) [2023-12-28 08:58:34,201][106226] Updated weights for policy 0, policy_version 1907986 (0.0011) [2023-12-28 08:58:34,262][106226] Updated weights for policy 0, policy_version 1907996 (0.0008) [2023-12-28 08:58:34,324][106226] Updated weights for policy 0, policy_version 1908006 (0.0011) [2023-12-28 08:58:34,344][106225] Updated weights for policy 1, policy_version 1912166 (0.0007) [2023-12-28 08:58:34,403][106225] Updated weights for policy 1, policy_version 1912176 (0.0008) [2023-12-28 08:58:34,463][106225] Updated weights for policy 1, policy_version 1912186 (0.0008) [2023-12-28 08:58:34,956][106226] Updated weights for policy 0, policy_version 1908016 (0.0006) [2023-12-28 08:58:35,005][106226] Updated weights for policy 0, policy_version 1908026 (0.0005) [2023-12-28 08:58:35,080][106226] Updated weights for policy 0, policy_version 1908036 (0.0005) [2023-12-28 08:58:35,134][106225] Updated weights for policy 1, policy_version 1912196 (0.0007) [2023-12-28 08:58:35,193][106225] Updated weights for policy 1, policy_version 1912206 (0.0005) [2023-12-28 08:58:35,252][106225] Updated weights for policy 1, policy_version 1912216 (0.0007) [2023-12-28 08:58:35,674][106226] Updated weights for policy 0, policy_version 1908046 (0.0005) [2023-12-28 08:58:35,740][106226] Updated weights for policy 0, policy_version 1908056 (0.0005) [2023-12-28 08:58:35,769][106225] Updated weights for policy 1, policy_version 1912226 (0.0009) [2023-12-28 08:58:35,805][106226] Updated weights for policy 0, policy_version 1908066 (0.0008) [2023-12-28 08:58:35,826][106225] Updated weights for policy 1, policy_version 1912236 (0.0005) [2023-12-28 08:58:35,873][106225] Updated weights for policy 1, policy_version 1912246 (0.0005) [2023-12-28 08:58:35,922][106225] Updated weights for policy 1, policy_version 1912256 (0.0005) [2023-12-28 08:58:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 978141184. Throughput: 0: 10056.3, 1: 9916.4. Samples: 978149604. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:36,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.708')] [2023-12-28 08:58:36,392][106226] Updated weights for policy 0, policy_version 1908076 (0.0011) [2023-12-28 08:58:36,450][106226] Updated weights for policy 0, policy_version 1908086 (0.0011) [2023-12-28 08:58:36,512][106226] Updated weights for policy 0, policy_version 1908096 (0.0011) [2023-12-28 08:58:36,590][106225] Updated weights for policy 1, policy_version 1912266 (0.0010) [2023-12-28 08:58:36,652][106225] Updated weights for policy 1, policy_version 1912276 (0.0008) [2023-12-28 08:58:36,721][106225] Updated weights for policy 1, policy_version 1912286 (0.0006) [2023-12-28 08:58:37,250][106226] Updated weights for policy 0, policy_version 1908106 (0.0010) [2023-12-28 08:58:37,315][106226] Updated weights for policy 0, policy_version 1908116 (0.0010) [2023-12-28 08:58:37,369][106225] Updated weights for policy 1, policy_version 1912296 (0.0009) [2023-12-28 08:58:37,369][106226] Updated weights for policy 0, policy_version 1908126 (0.0010) [2023-12-28 08:58:37,425][106225] Updated weights for policy 1, policy_version 1912306 (0.0007) [2023-12-28 08:58:37,430][106226] Updated weights for policy 0, policy_version 1908136 (0.0011) [2023-12-28 08:58:37,483][106225] Updated weights for policy 1, policy_version 1912316 (0.0005) [2023-12-28 08:58:38,110][106225] Updated weights for policy 1, policy_version 1912326 (0.0008) [2023-12-28 08:58:38,124][106226] Updated weights for policy 0, policy_version 1908146 (0.0010) [2023-12-28 08:58:38,158][106225] Updated weights for policy 1, policy_version 1912336 (0.0007) [2023-12-28 08:58:38,171][106226] Updated weights for policy 0, policy_version 1908156 (0.0010) [2023-12-28 08:58:38,211][106225] Updated weights for policy 1, policy_version 1912346 (0.0006) [2023-12-28 08:58:38,228][106226] Updated weights for policy 0, policy_version 1908166 (0.0011) [2023-12-28 08:58:38,965][106225] Updated weights for policy 1, policy_version 1912356 (0.0008) [2023-12-28 08:58:38,972][106226] Updated weights for policy 0, policy_version 1908176 (0.0007) [2023-12-28 08:58:39,014][106225] Updated weights for policy 1, policy_version 1912366 (0.0007) [2023-12-28 08:58:39,028][106226] Updated weights for policy 0, policy_version 1908186 (0.0006) [2023-12-28 08:58:39,072][106225] Updated weights for policy 1, policy_version 1912376 (0.0006) [2023-12-28 08:58:39,081][106226] Updated weights for policy 0, policy_version 1908196 (0.0007) [2023-12-28 08:58:39,789][106226] Updated weights for policy 0, policy_version 1908206 (0.0008) [2023-12-28 08:58:39,853][106226] Updated weights for policy 0, policy_version 1908216 (0.0008) [2023-12-28 08:58:39,867][106225] Updated weights for policy 1, policy_version 1912386 (0.0006) [2023-12-28 08:58:39,917][106226] Updated weights for policy 0, policy_version 1908226 (0.0008) [2023-12-28 08:58:39,937][106225] Updated weights for policy 1, policy_version 1912396 (0.0008) [2023-12-28 08:58:40,003][106225] Updated weights for policy 1, policy_version 1912406 (0.0008) [2023-12-28 08:58:40,065][106225] Updated weights for policy 1, policy_version 1912416 (0.0008) [2023-12-28 08:58:40,660][106226] Updated weights for policy 0, policy_version 1908236 (0.0008) [2023-12-28 08:58:40,679][106225] Updated weights for policy 1, policy_version 1912426 (0.0007) [2023-12-28 08:58:40,733][106226] Updated weights for policy 0, policy_version 1908246 (0.0006) [2023-12-28 08:58:40,743][106225] Updated weights for policy 1, policy_version 1912436 (0.0008) [2023-12-28 08:58:40,793][106226] Updated weights for policy 0, policy_version 1908256 (0.0006) [2023-12-28 08:58:40,809][106225] Updated weights for policy 1, policy_version 1912446 (0.0009) [2023-12-28 08:58:41,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 978239488. Throughput: 0: 10031.3, 1: 9982.6. Samples: 978209704. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-28 08:58:41,175][105115] Avg episode reward: [(0, '-4.380'), (1, '-4.857')] [2023-12-28 08:58:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001912448_489644032.pth... [2023-12-28 08:58:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001908264_488595456.pth... [2023-12-28 08:58:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001907112_488300544.pth [2023-12-28 08:58:41,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001911296_489349120.pth [2023-12-28 08:58:41,449][106225] Updated weights for policy 1, policy_version 1912456 (0.0009) [2023-12-28 08:58:41,513][106225] Updated weights for policy 1, policy_version 1912466 (0.0009) [2023-12-28 08:58:41,561][106226] Updated weights for policy 0, policy_version 1908266 (0.0008) [2023-12-28 08:58:41,568][106225] Updated weights for policy 1, policy_version 1912476 (0.0008) [2023-12-28 08:58:41,621][106226] Updated weights for policy 0, policy_version 1908276 (0.0008) [2023-12-28 08:58:41,686][106226] Updated weights for policy 0, policy_version 1908286 (0.0008) [2023-12-28 08:58:41,759][106226] Updated weights for policy 0, policy_version 1908296 (0.0009) [2023-12-28 08:58:42,355][106225] Updated weights for policy 1, policy_version 1912486 (0.0009) [2023-12-28 08:58:42,424][106225] Updated weights for policy 1, policy_version 1912496 (0.0008) [2023-12-28 08:58:42,482][106225] Updated weights for policy 1, policy_version 1912506 (0.0008) [2023-12-28 08:58:42,522][106226] Updated weights for policy 0, policy_version 1908306 (0.0008) [2023-12-28 08:58:42,588][106226] Updated weights for policy 0, policy_version 1908316 (0.0008) [2023-12-28 08:58:42,647][106226] Updated weights for policy 0, policy_version 1908326 (0.0008) [2023-12-28 08:58:43,190][106225] Updated weights for policy 1, policy_version 1912516 (0.0007) [2023-12-28 08:58:43,245][106225] Updated weights for policy 1, policy_version 1912526 (0.0005) [2023-12-28 08:58:43,307][106225] Updated weights for policy 1, policy_version 1912536 (0.0006) [2023-12-28 08:58:43,370][106226] Updated weights for policy 0, policy_version 1908336 (0.0007) [2023-12-28 08:58:43,421][106226] Updated weights for policy 0, policy_version 1908346 (0.0005) [2023-12-28 08:58:43,482][106226] Updated weights for policy 0, policy_version 1908356 (0.0005) [2023-12-28 08:58:43,932][106225] Updated weights for policy 1, policy_version 1912546 (0.0007) [2023-12-28 08:58:44,000][106225] Updated weights for policy 1, policy_version 1912556 (0.0008) [2023-12-28 08:58:44,012][106226] Updated weights for policy 0, policy_version 1908366 (0.0005) [2023-12-28 08:58:44,062][106225] Updated weights for policy 1, policy_version 1912566 (0.0008) [2023-12-28 08:58:44,067][106226] Updated weights for policy 0, policy_version 1908376 (0.0005) [2023-12-28 08:58:44,117][106226] Updated weights for policy 0, policy_version 1908386 (0.0006) [2023-12-28 08:58:44,123][106225] Updated weights for policy 1, policy_version 1912576 (0.0007) [2023-12-28 08:58:44,806][106226] Updated weights for policy 0, policy_version 1908396 (0.0007) [2023-12-28 08:58:44,819][106225] Updated weights for policy 1, policy_version 1912586 (0.0009) [2023-12-28 08:58:44,859][106226] Updated weights for policy 0, policy_version 1908406 (0.0006) [2023-12-28 08:58:44,878][106225] Updated weights for policy 1, policy_version 1912596 (0.0008) [2023-12-28 08:58:44,921][106226] Updated weights for policy 0, policy_version 1908416 (0.0006) [2023-12-28 08:58:44,937][106225] Updated weights for policy 1, policy_version 1912606 (0.0008) [2023-12-28 08:58:45,580][106226] Updated weights for policy 0, policy_version 1908426 (0.0006) [2023-12-28 08:58:45,642][106226] Updated weights for policy 0, policy_version 1908436 (0.0008) [2023-12-28 08:58:45,676][106225] Updated weights for policy 1, policy_version 1912616 (0.0006) [2023-12-28 08:58:45,701][106226] Updated weights for policy 0, policy_version 1908446 (0.0008) [2023-12-28 08:58:45,737][106225] Updated weights for policy 1, policy_version 1912626 (0.0007) [2023-12-28 08:58:45,755][106226] Updated weights for policy 0, policy_version 1908456 (0.0006) [2023-12-28 08:58:45,793][106225] Updated weights for policy 1, policy_version 1912636 (0.0008) [2023-12-28 08:58:46,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19934.0, 300 sec: 19799.7). Total num frames: 978337792. Throughput: 0: 10054.0, 1: 9917.8. Samples: 978327528. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:58:46,175][105115] Avg episode reward: [(0, '-4.096'), (1, '-4.351')] [2023-12-28 08:58:46,386][106225] Updated weights for policy 1, policy_version 1912646 (0.0006) [2023-12-28 08:58:46,437][106226] Updated weights for policy 0, policy_version 1908466 (0.0009) [2023-12-28 08:58:46,449][106225] Updated weights for policy 1, policy_version 1912656 (0.0006) [2023-12-28 08:58:46,500][106226] Updated weights for policy 0, policy_version 1908476 (0.0008) [2023-12-28 08:58:46,511][106225] Updated weights for policy 1, policy_version 1912666 (0.0006) [2023-12-28 08:58:46,562][106226] Updated weights for policy 0, policy_version 1908486 (0.0009) [2023-12-28 08:58:47,053][106225] Updated weights for policy 1, policy_version 1912676 (0.0006) [2023-12-28 08:58:47,113][106225] Updated weights for policy 1, policy_version 1912686 (0.0006) [2023-12-28 08:58:47,162][106225] Updated weights for policy 1, policy_version 1912696 (0.0005) [2023-12-28 08:58:47,306][106226] Updated weights for policy 0, policy_version 1908496 (0.0009) [2023-12-28 08:58:47,368][106226] Updated weights for policy 0, policy_version 1908506 (0.0008) [2023-12-28 08:58:47,428][106226] Updated weights for policy 0, policy_version 1908516 (0.0008) [2023-12-28 08:58:47,828][106225] Updated weights for policy 1, policy_version 1912706 (0.0010) [2023-12-28 08:58:47,879][106225] Updated weights for policy 1, policy_version 1912716 (0.0010) [2023-12-28 08:58:47,925][106225] Updated weights for policy 1, policy_version 1912726 (0.0010) [2023-12-28 08:58:47,971][106225] Updated weights for policy 1, policy_version 1912736 (0.0010) [2023-12-28 08:58:48,166][106226] Updated weights for policy 0, policy_version 1908526 (0.0008) [2023-12-28 08:58:48,224][106226] Updated weights for policy 0, policy_version 1908536 (0.0008) [2023-12-28 08:58:48,281][106226] Updated weights for policy 0, policy_version 1908546 (0.0008) [2023-12-28 08:58:48,684][106225] Updated weights for policy 1, policy_version 1912746 (0.0005) [2023-12-28 08:58:48,752][106225] Updated weights for policy 1, policy_version 1912756 (0.0009) [2023-12-28 08:58:48,810][106225] Updated weights for policy 1, policy_version 1912766 (0.0010) [2023-12-28 08:58:49,040][106226] Updated weights for policy 0, policy_version 1908556 (0.0007) [2023-12-28 08:58:49,101][106226] Updated weights for policy 0, policy_version 1908566 (0.0006) [2023-12-28 08:58:49,150][106226] Updated weights for policy 0, policy_version 1908576 (0.0007) [2023-12-28 08:58:49,528][106225] Updated weights for policy 1, policy_version 1912777 (0.0006) [2023-12-28 08:58:49,587][106225] Updated weights for policy 1, policy_version 1912787 (0.0007) [2023-12-28 08:58:49,646][106225] Updated weights for policy 1, policy_version 1912797 (0.0010) [2023-12-28 08:58:49,925][106226] Updated weights for policy 0, policy_version 1908586 (0.0007) [2023-12-28 08:58:50,001][106226] Updated weights for policy 0, policy_version 1908596 (0.0009) [2023-12-28 08:58:50,064][106226] Updated weights for policy 0, policy_version 1908606 (0.0008) [2023-12-28 08:58:50,123][106226] Updated weights for policy 0, policy_version 1908616 (0.0008) [2023-12-28 08:58:50,315][106225] Updated weights for policy 1, policy_version 1912807 (0.0006) [2023-12-28 08:58:50,383][106225] Updated weights for policy 1, policy_version 1912817 (0.0008) [2023-12-28 08:58:50,445][106225] Updated weights for policy 1, policy_version 1912827 (0.0010) [2023-12-28 08:58:50,787][106226] Updated weights for policy 0, policy_version 1908626 (0.0009) [2023-12-28 08:58:50,850][106226] Updated weights for policy 0, policy_version 1908636 (0.0009) [2023-12-28 08:58:50,919][106226] Updated weights for policy 0, policy_version 1908646 (0.0008) [2023-12-28 08:58:51,156][106225] Updated weights for policy 1, policy_version 1912837 (0.0009) [2023-12-28 08:58:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 978436096. Throughput: 0: 9926.0, 1: 9922.1. Samples: 978446628. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:58:51,175][105115] Avg episode reward: [(0, '-4.350'), (1, '-4.311')] [2023-12-28 08:58:51,217][106225] Updated weights for policy 1, policy_version 1912847 (0.0008) [2023-12-28 08:58:51,284][106225] Updated weights for policy 1, policy_version 1912857 (0.0007) [2023-12-28 08:58:51,680][106226] Updated weights for policy 0, policy_version 1908656 (0.0010) [2023-12-28 08:58:51,746][106226] Updated weights for policy 0, policy_version 1908666 (0.0010) [2023-12-28 08:58:51,809][106226] Updated weights for policy 0, policy_version 1908676 (0.0010) [2023-12-28 08:58:52,028][106225] Updated weights for policy 1, policy_version 1912867 (0.0005) [2023-12-28 08:58:52,095][106225] Updated weights for policy 1, policy_version 1912877 (0.0007) [2023-12-28 08:58:52,157][106225] Updated weights for policy 1, policy_version 1912887 (0.0008) [2023-12-28 08:58:52,550][106226] Updated weights for policy 0, policy_version 1908686 (0.0008) [2023-12-28 08:58:52,618][106226] Updated weights for policy 0, policy_version 1908696 (0.0007) [2023-12-28 08:58:52,683][106226] Updated weights for policy 0, policy_version 1908706 (0.0006) [2023-12-28 08:58:52,904][106225] Updated weights for policy 1, policy_version 1912897 (0.0008) [2023-12-28 08:58:52,955][106225] Updated weights for policy 1, policy_version 1912907 (0.0007) [2023-12-28 08:58:53,007][106225] Updated weights for policy 1, policy_version 1912917 (0.0008) [2023-12-28 08:58:53,061][106225] Updated weights for policy 1, policy_version 1912927 (0.0007) [2023-12-28 08:58:53,351][106226] Updated weights for policy 0, policy_version 1908716 (0.0009) [2023-12-28 08:58:53,416][106226] Updated weights for policy 0, policy_version 1908726 (0.0005) [2023-12-28 08:58:53,482][106226] Updated weights for policy 0, policy_version 1908736 (0.0009) [2023-12-28 08:58:53,751][106225] Updated weights for policy 1, policy_version 1912937 (0.0006) [2023-12-28 08:58:53,815][106225] Updated weights for policy 1, policy_version 1912947 (0.0009) [2023-12-28 08:58:53,877][106225] Updated weights for policy 1, policy_version 1912957 (0.0008) [2023-12-28 08:58:54,112][106226] Updated weights for policy 0, policy_version 1908746 (0.0008) [2023-12-28 08:58:54,183][106226] Updated weights for policy 0, policy_version 1908756 (0.0008) [2023-12-28 08:58:54,249][106226] Updated weights for policy 0, policy_version 1908766 (0.0008) [2023-12-28 08:58:54,316][106226] Updated weights for policy 0, policy_version 1908776 (0.0010) [2023-12-28 08:58:54,579][106225] Updated weights for policy 1, policy_version 1912967 (0.0008) [2023-12-28 08:58:54,628][106225] Updated weights for policy 1, policy_version 1912977 (0.0008) [2023-12-28 08:58:54,678][106225] Updated weights for policy 1, policy_version 1912987 (0.0008) [2023-12-28 08:58:55,034][106226] Updated weights for policy 0, policy_version 1908786 (0.0011) [2023-12-28 08:58:55,095][106226] Updated weights for policy 0, policy_version 1908796 (0.0011) [2023-12-28 08:58:55,155][106226] Updated weights for policy 0, policy_version 1908806 (0.0010) [2023-12-28 08:58:55,453][106225] Updated weights for policy 1, policy_version 1912997 (0.0008) [2023-12-28 08:58:55,510][106225] Updated weights for policy 1, policy_version 1913007 (0.0010) [2023-12-28 08:58:55,564][106225] Updated weights for policy 1, policy_version 1913017 (0.0009) [2023-12-28 08:58:55,806][106226] Updated weights for policy 0, policy_version 1908816 (0.0011) [2023-12-28 08:58:55,860][106226] Updated weights for policy 0, policy_version 1908826 (0.0010) [2023-12-28 08:58:55,920][106226] Updated weights for policy 0, policy_version 1908836 (0.0011) [2023-12-28 08:58:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 978534400. Throughput: 0: 9879.3, 1: 9903.5. Samples: 978504952. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:58:56,175][105115] Avg episode reward: [(0, '-4.356'), (1, '-4.419')] [2023-12-28 08:58:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001913024_489791488.pth... [2023-12-28 08:58:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001908840_488742912.pth... [2023-12-28 08:58:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001907688_488448000.pth [2023-12-28 08:58:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001911872_489496576.pth [2023-12-28 08:58:56,262][106225] Updated weights for policy 1, policy_version 1913027 (0.0007) [2023-12-28 08:58:56,316][106225] Updated weights for policy 1, policy_version 1913037 (0.0005) [2023-12-28 08:58:56,366][106225] Updated weights for policy 1, policy_version 1913047 (0.0007) [2023-12-28 08:58:56,588][106226] Updated weights for policy 0, policy_version 1908846 (0.0010) [2023-12-28 08:58:56,638][106226] Updated weights for policy 0, policy_version 1908856 (0.0010) [2023-12-28 08:58:56,685][106226] Updated weights for policy 0, policy_version 1908866 (0.0005) [2023-12-28 08:58:57,077][106225] Updated weights for policy 1, policy_version 1913057 (0.0007) [2023-12-28 08:58:57,137][106225] Updated weights for policy 1, policy_version 1913067 (0.0008) [2023-12-28 08:58:57,182][106225] Updated weights for policy 1, policy_version 1913077 (0.0005) [2023-12-28 08:58:57,231][106225] Updated weights for policy 1, policy_version 1913087 (0.0005) [2023-12-28 08:58:57,325][106226] Updated weights for policy 0, policy_version 1908876 (0.0007) [2023-12-28 08:58:57,378][106226] Updated weights for policy 0, policy_version 1908886 (0.0008) [2023-12-28 08:58:57,429][106226] Updated weights for policy 0, policy_version 1908896 (0.0008) [2023-12-28 08:58:57,867][106225] Updated weights for policy 1, policy_version 1913097 (0.0007) [2023-12-28 08:58:57,923][106225] Updated weights for policy 1, policy_version 1913107 (0.0008) [2023-12-28 08:58:57,970][106225] Updated weights for policy 1, policy_version 1913117 (0.0007) [2023-12-28 08:58:58,146][106226] Updated weights for policy 0, policy_version 1908906 (0.0008) [2023-12-28 08:58:58,207][106226] Updated weights for policy 0, policy_version 1908916 (0.0009) [2023-12-28 08:58:58,275][106226] Updated weights for policy 0, policy_version 1908926 (0.0009) [2023-12-28 08:58:58,343][106226] Updated weights for policy 0, policy_version 1908936 (0.0008) [2023-12-28 08:58:58,730][106225] Updated weights for policy 1, policy_version 1913127 (0.0008) [2023-12-28 08:58:58,792][106225] Updated weights for policy 1, policy_version 1913137 (0.0008) [2023-12-28 08:58:58,856][106225] Updated weights for policy 1, policy_version 1913147 (0.0009) [2023-12-28 08:58:59,157][106226] Updated weights for policy 0, policy_version 1908946 (0.0008) [2023-12-28 08:58:59,211][106226] Updated weights for policy 0, policy_version 1908956 (0.0008) [2023-12-28 08:58:59,287][106226] Updated weights for policy 0, policy_version 1908966 (0.0008) [2023-12-28 08:58:59,659][106225] Updated weights for policy 1, policy_version 1913157 (0.0007) [2023-12-28 08:58:59,711][106225] Updated weights for policy 1, policy_version 1913167 (0.0005) [2023-12-28 08:58:59,771][106225] Updated weights for policy 1, policy_version 1913177 (0.0010) [2023-12-28 08:58:59,960][106226] Updated weights for policy 0, policy_version 1908976 (0.0008) [2023-12-28 08:59:00,028][106226] Updated weights for policy 0, policy_version 1908986 (0.0005) [2023-12-28 08:59:00,095][106226] Updated weights for policy 0, policy_version 1908996 (0.0006) [2023-12-28 08:59:00,507][106225] Updated weights for policy 1, policy_version 1913187 (0.0009) [2023-12-28 08:59:00,568][106225] Updated weights for policy 1, policy_version 1913197 (0.0007) [2023-12-28 08:59:00,631][106225] Updated weights for policy 1, policy_version 1913207 (0.0010) [2023-12-28 08:59:00,692][106226] Updated weights for policy 0, policy_version 1909006 (0.0007) [2023-12-28 08:59:00,747][106226] Updated weights for policy 0, policy_version 1909016 (0.0005) [2023-12-28 08:59:00,804][106226] Updated weights for policy 0, policy_version 1909026 (0.0007) [2023-12-28 08:59:01,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 978632704. Throughput: 0: 9850.7, 1: 9928.8. Samples: 978621892. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:01,175][105115] Avg episode reward: [(0, '-4.484'), (1, '-4.393')] [2023-12-28 08:59:01,449][106225] Updated weights for policy 1, policy_version 1913217 (0.0009) [2023-12-28 08:59:01,499][106225] Updated weights for policy 1, policy_version 1913227 (0.0007) [2023-12-28 08:59:01,501][106226] Updated weights for policy 0, policy_version 1909036 (0.0007) [2023-12-28 08:59:01,551][106225] Updated weights for policy 1, policy_version 1913237 (0.0006) [2023-12-28 08:59:01,565][106226] Updated weights for policy 0, policy_version 1909046 (0.0006) [2023-12-28 08:59:01,604][106225] Updated weights for policy 1, policy_version 1913247 (0.0007) [2023-12-28 08:59:01,632][106226] Updated weights for policy 0, policy_version 1909056 (0.0008) [2023-12-28 08:59:02,242][106225] Updated weights for policy 1, policy_version 1913257 (0.0009) [2023-12-28 08:59:02,308][106225] Updated weights for policy 1, policy_version 1913267 (0.0007) [2023-12-28 08:59:02,365][106225] Updated weights for policy 1, policy_version 1913277 (0.0008) [2023-12-28 08:59:02,442][106226] Updated weights for policy 0, policy_version 1909066 (0.0009) [2023-12-28 08:59:02,504][106226] Updated weights for policy 0, policy_version 1909076 (0.0008) [2023-12-28 08:59:02,565][106226] Updated weights for policy 0, policy_version 1909086 (0.0008) [2023-12-28 08:59:02,621][106226] Updated weights for policy 0, policy_version 1909096 (0.0007) [2023-12-28 08:59:03,064][106225] Updated weights for policy 1, policy_version 1913287 (0.0010) [2023-12-28 08:59:03,120][106225] Updated weights for policy 1, policy_version 1913297 (0.0008) [2023-12-28 08:59:03,183][106225] Updated weights for policy 1, policy_version 1913307 (0.0005) [2023-12-28 08:59:03,212][106226] Updated weights for policy 0, policy_version 1909106 (0.0005) [2023-12-28 08:59:03,261][106226] Updated weights for policy 0, policy_version 1909116 (0.0005) [2023-12-28 08:59:03,314][106226] Updated weights for policy 0, policy_version 1909126 (0.0005) [2023-12-28 08:59:03,779][106225] Updated weights for policy 1, policy_version 1913317 (0.0007) [2023-12-28 08:59:03,859][106225] Updated weights for policy 1, policy_version 1913327 (0.0007) [2023-12-28 08:59:03,924][106225] Updated weights for policy 1, policy_version 1913337 (0.0008) [2023-12-28 08:59:03,972][106226] Updated weights for policy 0, policy_version 1909136 (0.0005) [2023-12-28 08:59:04,035][106226] Updated weights for policy 0, policy_version 1909146 (0.0005) [2023-12-28 08:59:04,098][106226] Updated weights for policy 0, policy_version 1909156 (0.0006) [2023-12-28 08:59:04,586][106225] Updated weights for policy 1, policy_version 1913347 (0.0007) [2023-12-28 08:59:04,622][106226] Updated weights for policy 0, policy_version 1909166 (0.0007) [2023-12-28 08:59:04,643][106225] Updated weights for policy 1, policy_version 1913357 (0.0006) [2023-12-28 08:59:04,678][106226] Updated weights for policy 0, policy_version 1909176 (0.0008) [2023-12-28 08:59:04,702][106225] Updated weights for policy 1, policy_version 1913367 (0.0006) [2023-12-28 08:59:04,737][106226] Updated weights for policy 0, policy_version 1909186 (0.0008) [2023-12-28 08:59:05,236][106225] Updated weights for policy 1, policy_version 1913377 (0.0006) [2023-12-28 08:59:05,292][106225] Updated weights for policy 1, policy_version 1913387 (0.0009) [2023-12-28 08:59:05,353][106225] Updated weights for policy 1, policy_version 1913397 (0.0009) [2023-12-28 08:59:05,411][106225] Updated weights for policy 1, policy_version 1913407 (0.0009) [2023-12-28 08:59:05,549][106226] Updated weights for policy 0, policy_version 1909196 (0.0008) [2023-12-28 08:59:05,621][106226] Updated weights for policy 0, policy_version 1909206 (0.0007) [2023-12-28 08:59:05,682][106226] Updated weights for policy 0, policy_version 1909216 (0.0008) [2023-12-28 08:59:05,973][106225] Updated weights for policy 1, policy_version 1913417 (0.0005) [2023-12-28 08:59:06,029][106225] Updated weights for policy 1, policy_version 1913427 (0.0005) [2023-12-28 08:59:06,086][106225] Updated weights for policy 1, policy_version 1913437 (0.0008) [2023-12-28 08:59:06,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 978739200. Throughput: 0: 9925.2, 1: 9923.1. Samples: 978744524. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:06,175][105115] Avg episode reward: [(0, '-4.250'), (1, '-4.302')] [2023-12-28 08:59:06,428][106226] Updated weights for policy 0, policy_version 1909226 (0.0009) [2023-12-28 08:59:06,502][106226] Updated weights for policy 0, policy_version 1909236 (0.0009) [2023-12-28 08:59:06,568][106226] Updated weights for policy 0, policy_version 1909246 (0.0009) [2023-12-28 08:59:06,625][106226] Updated weights for policy 0, policy_version 1909256 (0.0008) [2023-12-28 08:59:06,733][106225] Updated weights for policy 1, policy_version 1913447 (0.0008) [2023-12-28 08:59:06,785][106225] Updated weights for policy 1, policy_version 1913457 (0.0008) [2023-12-28 08:59:06,842][106225] Updated weights for policy 1, policy_version 1913467 (0.0008) [2023-12-28 08:59:07,340][106226] Updated weights for policy 0, policy_version 1909266 (0.0009) [2023-12-28 08:59:07,397][106226] Updated weights for policy 0, policy_version 1909276 (0.0009) [2023-12-28 08:59:07,465][106226] Updated weights for policy 0, policy_version 1909286 (0.0009) [2023-12-28 08:59:07,549][106225] Updated weights for policy 1, policy_version 1913477 (0.0007) [2023-12-28 08:59:07,614][106225] Updated weights for policy 1, policy_version 1913487 (0.0007) [2023-12-28 08:59:07,668][106225] Updated weights for policy 1, policy_version 1913497 (0.0008) [2023-12-28 08:59:08,218][106226] Updated weights for policy 0, policy_version 1909296 (0.0009) [2023-12-28 08:59:08,266][106226] Updated weights for policy 0, policy_version 1909306 (0.0009) [2023-12-28 08:59:08,309][106226] Updated weights for policy 0, policy_version 1909316 (0.0008) [2023-12-28 08:59:08,341][106225] Updated weights for policy 1, policy_version 1913507 (0.0008) [2023-12-28 08:59:08,406][106225] Updated weights for policy 1, policy_version 1913517 (0.0008) [2023-12-28 08:59:08,473][106225] Updated weights for policy 1, policy_version 1913527 (0.0008) [2023-12-28 08:59:09,105][106225] Updated weights for policy 1, policy_version 1913537 (0.0009) [2023-12-28 08:59:09,116][106226] Updated weights for policy 0, policy_version 1909326 (0.0008) [2023-12-28 08:59:09,156][106225] Updated weights for policy 1, policy_version 1913547 (0.0008) [2023-12-28 08:59:09,167][106226] Updated weights for policy 0, policy_version 1909336 (0.0006) [2023-12-28 08:59:09,203][106225] Updated weights for policy 1, policy_version 1913557 (0.0006) [2023-12-28 08:59:09,225][106226] Updated weights for policy 0, policy_version 1909346 (0.0009) [2023-12-28 08:59:09,268][106225] Updated weights for policy 1, policy_version 1913567 (0.0008) [2023-12-28 08:59:09,952][106226] Updated weights for policy 0, policy_version 1909356 (0.0008) [2023-12-28 08:59:10,014][106225] Updated weights for policy 1, policy_version 1913577 (0.0007) [2023-12-28 08:59:10,020][106226] Updated weights for policy 0, policy_version 1909366 (0.0007) [2023-12-28 08:59:10,078][106225] Updated weights for policy 1, policy_version 1913587 (0.0006) [2023-12-28 08:59:10,080][106226] Updated weights for policy 0, policy_version 1909376 (0.0009) [2023-12-28 08:59:10,135][106225] Updated weights for policy 1, policy_version 1913597 (0.0006) [2023-12-28 08:59:10,686][106226] Updated weights for policy 0, policy_version 1909386 (0.0008) [2023-12-28 08:59:10,751][106226] Updated weights for policy 0, policy_version 1909396 (0.0008) [2023-12-28 08:59:10,810][106226] Updated weights for policy 0, policy_version 1909406 (0.0009) [2023-12-28 08:59:10,873][106226] Updated weights for policy 0, policy_version 1909416 (0.0008) [2023-12-28 08:59:10,930][106225] Updated weights for policy 1, policy_version 1913607 (0.0009) [2023-12-28 08:59:10,995][106225] Updated weights for policy 1, policy_version 1913617 (0.0010) [2023-12-28 08:59:11,063][106225] Updated weights for policy 1, policy_version 1913627 (0.0009) [2023-12-28 08:59:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19855.2). Total num frames: 978837504. Throughput: 0: 9897.7, 1: 10020.1. Samples: 978802816. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:11,175][105115] Avg episode reward: [(0, '-4.435'), (1, '-4.714')] [2023-12-28 08:59:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001913632_489947136.pth... [2023-12-28 08:59:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001909416_488890368.pth... [2023-12-28 08:59:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001912448_489644032.pth [2023-12-28 08:59:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001908264_488595456.pth [2023-12-28 08:59:11,631][106226] Updated weights for policy 0, policy_version 1909426 (0.0008) [2023-12-28 08:59:11,686][106226] Updated weights for policy 0, policy_version 1909436 (0.0009) [2023-12-28 08:59:11,762][106226] Updated weights for policy 0, policy_version 1909446 (0.0009) [2023-12-28 08:59:11,860][106225] Updated weights for policy 1, policy_version 1913637 (0.0009) [2023-12-28 08:59:11,922][106225] Updated weights for policy 1, policy_version 1913647 (0.0011) [2023-12-28 08:59:11,980][106225] Updated weights for policy 1, policy_version 1913657 (0.0010) [2023-12-28 08:59:12,548][106226] Updated weights for policy 0, policy_version 1909456 (0.0010) [2023-12-28 08:59:12,596][106225] Updated weights for policy 1, policy_version 1913667 (0.0008) [2023-12-28 08:59:12,613][106226] Updated weights for policy 0, policy_version 1909466 (0.0007) [2023-12-28 08:59:12,658][106225] Updated weights for policy 1, policy_version 1913677 (0.0008) [2023-12-28 08:59:12,675][106226] Updated weights for policy 0, policy_version 1909476 (0.0007) [2023-12-28 08:59:12,720][106225] Updated weights for policy 1, policy_version 1913687 (0.0006) [2023-12-28 08:59:13,392][106226] Updated weights for policy 0, policy_version 1909486 (0.0008) [2023-12-28 08:59:13,434][106225] Updated weights for policy 1, policy_version 1913697 (0.0006) [2023-12-28 08:59:13,448][106226] Updated weights for policy 0, policy_version 1909496 (0.0008) [2023-12-28 08:59:13,485][106225] Updated weights for policy 1, policy_version 1913707 (0.0006) [2023-12-28 08:59:13,502][106226] Updated weights for policy 0, policy_version 1909506 (0.0007) [2023-12-28 08:59:13,541][106225] Updated weights for policy 1, policy_version 1913717 (0.0006) [2023-12-28 08:59:13,594][106225] Updated weights for policy 1, policy_version 1913728 (0.0009) [2023-12-28 08:59:14,100][106226] Updated weights for policy 0, policy_version 1909516 (0.0007) [2023-12-28 08:59:14,152][106226] Updated weights for policy 0, policy_version 1909526 (0.0006) [2023-12-28 08:59:14,210][106226] Updated weights for policy 0, policy_version 1909536 (0.0006) [2023-12-28 08:59:14,394][106225] Updated weights for policy 1, policy_version 1913738 (0.0008) [2023-12-28 08:59:14,451][106225] Updated weights for policy 1, policy_version 1913748 (0.0009) [2023-12-28 08:59:14,513][106225] Updated weights for policy 1, policy_version 1913758 (0.0010) [2023-12-28 08:59:14,846][106226] Updated weights for policy 0, policy_version 1909546 (0.0007) [2023-12-28 08:59:14,904][106226] Updated weights for policy 0, policy_version 1909556 (0.0008) [2023-12-28 08:59:14,964][106226] Updated weights for policy 0, policy_version 1909566 (0.0009) [2023-12-28 08:59:15,025][106226] Updated weights for policy 0, policy_version 1909576 (0.0009) [2023-12-28 08:59:15,276][106225] Updated weights for policy 1, policy_version 1913768 (0.0008) [2023-12-28 08:59:15,338][106225] Updated weights for policy 1, policy_version 1913778 (0.0006) [2023-12-28 08:59:15,391][106225] Updated weights for policy 1, policy_version 1913788 (0.0005) [2023-12-28 08:59:15,796][106226] Updated weights for policy 0, policy_version 1909586 (0.0008) [2023-12-28 08:59:15,845][106226] Updated weights for policy 0, policy_version 1909596 (0.0009) [2023-12-28 08:59:15,901][106226] Updated weights for policy 0, policy_version 1909606 (0.0009) [2023-12-28 08:59:16,014][106225] Updated weights for policy 1, policy_version 1913798 (0.0007) [2023-12-28 08:59:16,065][106225] Updated weights for policy 1, policy_version 1913808 (0.0008) [2023-12-28 08:59:16,126][106225] Updated weights for policy 1, policy_version 1913818 (0.0007) [2023-12-28 08:59:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 978935808. Throughput: 0: 9904.3, 1: 9900.8. Samples: 978918400. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:16,175][105115] Avg episode reward: [(0, '-4.290'), (1, '-4.561')] [2023-12-28 08:59:16,712][106225] Updated weights for policy 1, policy_version 1913828 (0.0007) [2023-12-28 08:59:16,731][106226] Updated weights for policy 0, policy_version 1909616 (0.0007) [2023-12-28 08:59:16,760][106225] Updated weights for policy 1, policy_version 1913838 (0.0007) [2023-12-28 08:59:16,782][106226] Updated weights for policy 0, policy_version 1909626 (0.0006) [2023-12-28 08:59:16,813][106225] Updated weights for policy 1, policy_version 1913848 (0.0007) [2023-12-28 08:59:16,831][106226] Updated weights for policy 0, policy_version 1909636 (0.0008) [2023-12-28 08:59:17,512][106225] Updated weights for policy 1, policy_version 1913858 (0.0008) [2023-12-28 08:59:17,573][106225] Updated weights for policy 1, policy_version 1913868 (0.0009) [2023-12-28 08:59:17,583][106226] Updated weights for policy 0, policy_version 1909646 (0.0007) [2023-12-28 08:59:17,630][106225] Updated weights for policy 1, policy_version 1913878 (0.0007) [2023-12-28 08:59:17,632][106226] Updated weights for policy 0, policy_version 1909656 (0.0007) [2023-12-28 08:59:17,685][106226] Updated weights for policy 0, policy_version 1909666 (0.0007) [2023-12-28 08:59:17,688][106225] Updated weights for policy 1, policy_version 1913888 (0.0007) [2023-12-28 08:59:18,421][106225] Updated weights for policy 1, policy_version 1913898 (0.0007) [2023-12-28 08:59:18,443][106226] Updated weights for policy 0, policy_version 1909676 (0.0008) [2023-12-28 08:59:18,478][106225] Updated weights for policy 1, policy_version 1913908 (0.0008) [2023-12-28 08:59:18,498][106226] Updated weights for policy 0, policy_version 1909686 (0.0008) [2023-12-28 08:59:18,539][106225] Updated weights for policy 1, policy_version 1913918 (0.0005) [2023-12-28 08:59:18,557][106226] Updated weights for policy 0, policy_version 1909696 (0.0008) [2023-12-28 08:59:19,257][106225] Updated weights for policy 1, policy_version 1913928 (0.0007) [2023-12-28 08:59:19,309][106226] Updated weights for policy 0, policy_version 1909706 (0.0008) [2023-12-28 08:59:19,319][106225] Updated weights for policy 1, policy_version 1913938 (0.0008) [2023-12-28 08:59:19,372][106226] Updated weights for policy 0, policy_version 1909716 (0.0006) [2023-12-28 08:59:19,379][106225] Updated weights for policy 1, policy_version 1913948 (0.0009) [2023-12-28 08:59:19,434][106226] Updated weights for policy 0, policy_version 1909726 (0.0008) [2023-12-28 08:59:19,501][106226] Updated weights for policy 0, policy_version 1909736 (0.0008) [2023-12-28 08:59:20,156][106225] Updated weights for policy 1, policy_version 1913958 (0.0008) [2023-12-28 08:59:20,222][106225] Updated weights for policy 1, policy_version 1913968 (0.0008) [2023-12-28 08:59:20,272][106226] Updated weights for policy 0, policy_version 1909746 (0.0008) [2023-12-28 08:59:20,285][106225] Updated weights for policy 1, policy_version 1913978 (0.0008) [2023-12-28 08:59:20,323][106226] Updated weights for policy 0, policy_version 1909756 (0.0007) [2023-12-28 08:59:20,383][106226] Updated weights for policy 0, policy_version 1909766 (0.0008) [2023-12-28 08:59:20,962][106225] Updated weights for policy 1, policy_version 1913988 (0.0009) [2023-12-28 08:59:21,024][106225] Updated weights for policy 1, policy_version 1913998 (0.0010) [2023-12-28 08:59:21,102][106225] Updated weights for policy 1, policy_version 1914010 (0.0007) [2023-12-28 08:59:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 979025920. Throughput: 0: 9697.2, 1: 9960.3. Samples: 979034188. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:21,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.703')] [2023-12-28 08:59:21,175][106226] Updated weights for policy 0, policy_version 1909776 (0.0011) [2023-12-28 08:59:21,245][106226] Updated weights for policy 0, policy_version 1909786 (0.0011) [2023-12-28 08:59:21,315][106226] Updated weights for policy 0, policy_version 1909796 (0.0011) [2023-12-28 08:59:21,911][106225] Updated weights for policy 1, policy_version 1914020 (0.0008) [2023-12-28 08:59:21,967][106225] Updated weights for policy 1, policy_version 1914030 (0.0009) [2023-12-28 08:59:22,032][106225] Updated weights for policy 1, policy_version 1914040 (0.0008) [2023-12-28 08:59:22,082][106226] Updated weights for policy 0, policy_version 1909806 (0.0009) [2023-12-28 08:59:22,150][106226] Updated weights for policy 0, policy_version 1909816 (0.0009) [2023-12-28 08:59:22,214][106226] Updated weights for policy 0, policy_version 1909826 (0.0008) [2023-12-28 08:59:22,710][106225] Updated weights for policy 1, policy_version 1914050 (0.0006) [2023-12-28 08:59:22,770][106225] Updated weights for policy 1, policy_version 1914060 (0.0008) [2023-12-28 08:59:22,834][106225] Updated weights for policy 1, policy_version 1914070 (0.0008) [2023-12-28 08:59:22,886][106225] Updated weights for policy 1, policy_version 1914080 (0.0008) [2023-12-28 08:59:22,914][106226] Updated weights for policy 0, policy_version 1909836 (0.0007) [2023-12-28 08:59:22,979][106226] Updated weights for policy 0, policy_version 1909846 (0.0006) [2023-12-28 08:59:23,052][106226] Updated weights for policy 0, policy_version 1909856 (0.0006) [2023-12-28 08:59:23,558][106225] Updated weights for policy 1, policy_version 1914090 (0.0008) [2023-12-28 08:59:23,624][106225] Updated weights for policy 1, policy_version 1914100 (0.0010) [2023-12-28 08:59:23,674][106226] Updated weights for policy 0, policy_version 1909866 (0.0007) [2023-12-28 08:59:23,684][106225] Updated weights for policy 1, policy_version 1914110 (0.0009) [2023-12-28 08:59:23,730][106226] Updated weights for policy 0, policy_version 1909876 (0.0007) [2023-12-28 08:59:23,781][106226] Updated weights for policy 0, policy_version 1909886 (0.0010) [2023-12-28 08:59:23,847][106226] Updated weights for policy 0, policy_version 1909896 (0.0006) [2023-12-28 08:59:24,376][106225] Updated weights for policy 1, policy_version 1914120 (0.0008) [2023-12-28 08:59:24,433][106225] Updated weights for policy 1, policy_version 1914130 (0.0006) [2023-12-28 08:59:24,478][106226] Updated weights for policy 0, policy_version 1909906 (0.0010) [2023-12-28 08:59:24,490][106225] Updated weights for policy 1, policy_version 1914140 (0.0006) [2023-12-28 08:59:24,532][106226] Updated weights for policy 0, policy_version 1909916 (0.0006) [2023-12-28 08:59:24,583][106226] Updated weights for policy 0, policy_version 1909926 (0.0006) [2023-12-28 08:59:25,115][106225] Updated weights for policy 1, policy_version 1914150 (0.0008) [2023-12-28 08:59:25,181][106225] Updated weights for policy 1, policy_version 1914160 (0.0009) [2023-12-28 08:59:25,223][106226] Updated weights for policy 0, policy_version 1909936 (0.0007) [2023-12-28 08:59:25,243][106225] Updated weights for policy 1, policy_version 1914170 (0.0009) [2023-12-28 08:59:25,278][106226] Updated weights for policy 0, policy_version 1909946 (0.0011) [2023-12-28 08:59:25,332][106226] Updated weights for policy 0, policy_version 1909956 (0.0010) [2023-12-28 08:59:26,028][106225] Updated weights for policy 1, policy_version 1914180 (0.0010) [2023-12-28 08:59:26,046][106226] Updated weights for policy 0, policy_version 1909966 (0.0011) [2023-12-28 08:59:26,084][106225] Updated weights for policy 1, policy_version 1914190 (0.0010) [2023-12-28 08:59:26,105][106226] Updated weights for policy 0, policy_version 1909976 (0.0011) [2023-12-28 08:59:26,141][106225] Updated weights for policy 1, policy_version 1914200 (0.0010) [2023-12-28 08:59:26,168][106226] Updated weights for policy 0, policy_version 1909986 (0.0011) [2023-12-28 08:59:26,175][105115] Fps is (10 sec: 18022.4, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 979116032. Throughput: 0: 9719.5, 1: 9899.3. Samples: 979092548. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:26,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.535')] [2023-12-28 08:59:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001914208_490094592.pth... [2023-12-28 08:59:26,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001913024_489791488.pth [2023-12-28 08:59:26,203][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001909992_489037824.pth... [2023-12-28 08:59:26,206][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001908840_488742912.pth [2023-12-28 08:59:26,758][106226] Updated weights for policy 0, policy_version 1909996 (0.0009) [2023-12-28 08:59:26,811][106226] Updated weights for policy 0, policy_version 1910006 (0.0006) [2023-12-28 08:59:26,816][106225] Updated weights for policy 1, policy_version 1914210 (0.0009) [2023-12-28 08:59:26,872][106226] Updated weights for policy 0, policy_version 1910016 (0.0007) [2023-12-28 08:59:26,877][106225] Updated weights for policy 1, policy_version 1914220 (0.0006) [2023-12-28 08:59:26,925][106225] Updated weights for policy 1, policy_version 1914230 (0.0009) [2023-12-28 08:59:26,971][106225] Updated weights for policy 1, policy_version 1914240 (0.0010) [2023-12-28 08:59:27,501][106226] Updated weights for policy 0, policy_version 1910026 (0.0006) [2023-12-28 08:59:27,555][106226] Updated weights for policy 0, policy_version 1910036 (0.0006) [2023-12-28 08:59:27,602][106226] Updated weights for policy 0, policy_version 1910046 (0.0005) [2023-12-28 08:59:27,619][106225] Updated weights for policy 1, policy_version 1914250 (0.0008) [2023-12-28 08:59:27,654][106226] Updated weights for policy 0, policy_version 1910056 (0.0006) [2023-12-28 08:59:27,678][106225] Updated weights for policy 1, policy_version 1914260 (0.0009) [2023-12-28 08:59:27,726][106225] Updated weights for policy 1, policy_version 1914270 (0.0008) [2023-12-28 08:59:28,204][106226] Updated weights for policy 0, policy_version 1910066 (0.0005) [2023-12-28 08:59:28,260][106226] Updated weights for policy 0, policy_version 1910076 (0.0006) [2023-12-28 08:59:28,327][106226] Updated weights for policy 0, policy_version 1910086 (0.0007) [2023-12-28 08:59:28,444][106225] Updated weights for policy 1, policy_version 1914280 (0.0008) [2023-12-28 08:59:28,500][106225] Updated weights for policy 1, policy_version 1914290 (0.0010) [2023-12-28 08:59:28,561][106225] Updated weights for policy 1, policy_version 1914300 (0.0010) [2023-12-28 08:59:28,887][106226] Updated weights for policy 0, policy_version 1910096 (0.0008) [2023-12-28 08:59:28,946][106226] Updated weights for policy 0, policy_version 1910106 (0.0009) [2023-12-28 08:59:29,008][106226] Updated weights for policy 0, policy_version 1910116 (0.0008) [2023-12-28 08:59:29,306][106225] Updated weights for policy 1, policy_version 1914310 (0.0008) [2023-12-28 08:59:29,377][106225] Updated weights for policy 1, policy_version 1914320 (0.0008) [2023-12-28 08:59:29,440][106225] Updated weights for policy 1, policy_version 1914330 (0.0006) [2023-12-28 08:59:29,848][106226] Updated weights for policy 0, policy_version 1910126 (0.0008) [2023-12-28 08:59:29,912][106226] Updated weights for policy 0, policy_version 1910136 (0.0008) [2023-12-28 08:59:29,976][106226] Updated weights for policy 0, policy_version 1910146 (0.0008) [2023-12-28 08:59:30,048][106225] Updated weights for policy 1, policy_version 1914340 (0.0007) [2023-12-28 08:59:30,104][106225] Updated weights for policy 1, policy_version 1914350 (0.0008) [2023-12-28 08:59:30,168][106225] Updated weights for policy 1, policy_version 1914360 (0.0008) [2023-12-28 08:59:30,741][106226] Updated weights for policy 0, policy_version 1910156 (0.0008) [2023-12-28 08:59:30,795][106226] Updated weights for policy 0, policy_version 1910166 (0.0008) [2023-12-28 08:59:30,812][106225] Updated weights for policy 1, policy_version 1914370 (0.0008) [2023-12-28 08:59:30,853][106226] Updated weights for policy 0, policy_version 1910176 (0.0006) [2023-12-28 08:59:30,866][106225] Updated weights for policy 1, policy_version 1914380 (0.0008) [2023-12-28 08:59:30,925][106225] Updated weights for policy 1, policy_version 1914390 (0.0008) [2023-12-28 08:59:30,979][106225] Updated weights for policy 1, policy_version 1914400 (0.0009) [2023-12-28 08:59:31,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 979230720. Throughput: 0: 9814.2, 1: 9948.6. Samples: 979216856. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:31,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.730')] [2023-12-28 08:59:31,550][106226] Updated weights for policy 0, policy_version 1910186 (0.0006) [2023-12-28 08:59:31,609][106226] Updated weights for policy 0, policy_version 1910196 (0.0008) [2023-12-28 08:59:31,675][106226] Updated weights for policy 0, policy_version 1910206 (0.0009) [2023-12-28 08:59:31,738][106226] Updated weights for policy 0, policy_version 1910216 (0.0008) [2023-12-28 08:59:31,780][106225] Updated weights for policy 1, policy_version 1914410 (0.0007) [2023-12-28 08:59:31,844][106225] Updated weights for policy 1, policy_version 1914420 (0.0008) [2023-12-28 08:59:31,905][106225] Updated weights for policy 1, policy_version 1914430 (0.0009) [2023-12-28 08:59:32,426][106226] Updated weights for policy 0, policy_version 1910226 (0.0010) [2023-12-28 08:59:32,483][106226] Updated weights for policy 0, policy_version 1910236 (0.0010) [2023-12-28 08:59:32,545][106226] Updated weights for policy 0, policy_version 1910246 (0.0010) [2023-12-28 08:59:32,670][106225] Updated weights for policy 1, policy_version 1914440 (0.0010) [2023-12-28 08:59:32,727][106225] Updated weights for policy 1, policy_version 1914450 (0.0009) [2023-12-28 08:59:32,791][106225] Updated weights for policy 1, policy_version 1914460 (0.0006) [2023-12-28 08:59:33,220][106226] Updated weights for policy 0, policy_version 1910256 (0.0011) [2023-12-28 08:59:33,284][106226] Updated weights for policy 0, policy_version 1910266 (0.0006) [2023-12-28 08:59:33,350][106226] Updated weights for policy 0, policy_version 1910276 (0.0006) [2023-12-28 08:59:33,370][106225] Updated weights for policy 1, policy_version 1914470 (0.0006) [2023-12-28 08:59:33,434][106225] Updated weights for policy 1, policy_version 1914480 (0.0006) [2023-12-28 08:59:33,482][106225] Updated weights for policy 1, policy_version 1914490 (0.0005) [2023-12-28 08:59:34,031][106225] Updated weights for policy 1, policy_version 1914500 (0.0008) [2023-12-28 08:59:34,032][106226] Updated weights for policy 0, policy_version 1910286 (0.0007) [2023-12-28 08:59:34,081][106226] Updated weights for policy 0, policy_version 1910296 (0.0009) [2023-12-28 08:59:34,098][106225] Updated weights for policy 1, policy_version 1914510 (0.0005) [2023-12-28 08:59:34,140][106226] Updated weights for policy 0, policy_version 1910306 (0.0008) [2023-12-28 08:59:34,161][106225] Updated weights for policy 1, policy_version 1914520 (0.0007) [2023-12-28 08:59:34,747][106225] Updated weights for policy 1, policy_version 1914530 (0.0010) [2023-12-28 08:59:34,798][106225] Updated weights for policy 1, policy_version 1914540 (0.0010) [2023-12-28 08:59:34,852][106225] Updated weights for policy 1, policy_version 1914550 (0.0010) [2023-12-28 08:59:34,903][106226] Updated weights for policy 0, policy_version 1910316 (0.0009) [2023-12-28 08:59:34,911][106225] Updated weights for policy 1, policy_version 1914560 (0.0010) [2023-12-28 08:59:34,963][106226] Updated weights for policy 0, policy_version 1910326 (0.0011) [2023-12-28 08:59:35,028][106226] Updated weights for policy 0, policy_version 1910336 (0.0011) [2023-12-28 08:59:35,648][106225] Updated weights for policy 1, policy_version 1914570 (0.0009) [2023-12-28 08:59:35,709][106225] Updated weights for policy 1, policy_version 1914580 (0.0008) [2023-12-28 08:59:35,753][106226] Updated weights for policy 0, policy_version 1910346 (0.0010) [2023-12-28 08:59:35,765][106225] Updated weights for policy 1, policy_version 1914590 (0.0008) [2023-12-28 08:59:35,800][106226] Updated weights for policy 0, policy_version 1910356 (0.0005) [2023-12-28 08:59:35,865][106226] Updated weights for policy 0, policy_version 1910366 (0.0005) [2023-12-28 08:59:35,933][106226] Updated weights for policy 0, policy_version 1910376 (0.0008) [2023-12-28 08:59:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 979329024. Throughput: 0: 9841.1, 1: 9933.5. Samples: 979336488. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:36,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.480')] [2023-12-28 08:59:36,470][106225] Updated weights for policy 1, policy_version 1914600 (0.0009) [2023-12-28 08:59:36,527][106225] Updated weights for policy 1, policy_version 1914610 (0.0008) [2023-12-28 08:59:36,582][106225] Updated weights for policy 1, policy_version 1914620 (0.0007) [2023-12-28 08:59:36,611][106226] Updated weights for policy 0, policy_version 1910386 (0.0007) [2023-12-28 08:59:36,676][106226] Updated weights for policy 0, policy_version 1910396 (0.0008) [2023-12-28 08:59:36,738][106226] Updated weights for policy 0, policy_version 1910406 (0.0006) [2023-12-28 08:59:37,299][106225] Updated weights for policy 1, policy_version 1914630 (0.0008) [2023-12-28 08:59:37,361][106225] Updated weights for policy 1, policy_version 1914640 (0.0010) [2023-12-28 08:59:37,431][106225] Updated weights for policy 1, policy_version 1914650 (0.0010) [2023-12-28 08:59:37,438][106226] Updated weights for policy 0, policy_version 1910416 (0.0006) [2023-12-28 08:59:37,500][106226] Updated weights for policy 0, policy_version 1910426 (0.0010) [2023-12-28 08:59:37,556][106226] Updated weights for policy 0, policy_version 1910436 (0.0009) [2023-12-28 08:59:37,994][106225] Updated weights for policy 1, policy_version 1914660 (0.0011) [2023-12-28 08:59:38,049][106225] Updated weights for policy 1, policy_version 1914670 (0.0011) [2023-12-28 08:59:38,097][106225] Updated weights for policy 1, policy_version 1914680 (0.0010) [2023-12-28 08:59:38,207][106226] Updated weights for policy 0, policy_version 1910446 (0.0007) [2023-12-28 08:59:38,262][106226] Updated weights for policy 0, policy_version 1910456 (0.0008) [2023-12-28 08:59:38,320][106226] Updated weights for policy 0, policy_version 1910466 (0.0008) [2023-12-28 08:59:38,823][106225] Updated weights for policy 1, policy_version 1914690 (0.0010) [2023-12-28 08:59:38,878][106225] Updated weights for policy 1, policy_version 1914700 (0.0010) [2023-12-28 08:59:38,941][106225] Updated weights for policy 1, policy_version 1914710 (0.0011) [2023-12-28 08:59:39,004][106225] Updated weights for policy 1, policy_version 1914720 (0.0010) [2023-12-28 08:59:39,046][106226] Updated weights for policy 0, policy_version 1910476 (0.0008) [2023-12-28 08:59:39,098][106226] Updated weights for policy 0, policy_version 1910486 (0.0008) [2023-12-28 08:59:39,153][106226] Updated weights for policy 0, policy_version 1910496 (0.0008) [2023-12-28 08:59:39,708][106225] Updated weights for policy 1, policy_version 1914730 (0.0006) [2023-12-28 08:59:39,772][106225] Updated weights for policy 1, policy_version 1914740 (0.0006) [2023-12-28 08:59:39,841][106225] Updated weights for policy 1, policy_version 1914750 (0.0007) [2023-12-28 08:59:39,890][106226] Updated weights for policy 0, policy_version 1910506 (0.0009) [2023-12-28 08:59:39,959][106226] Updated weights for policy 0, policy_version 1910516 (0.0011) [2023-12-28 08:59:40,030][106226] Updated weights for policy 0, policy_version 1910526 (0.0006) [2023-12-28 08:59:40,088][106226] Updated weights for policy 0, policy_version 1910536 (0.0007) [2023-12-28 08:59:40,453][106225] Updated weights for policy 1, policy_version 1914760 (0.0009) [2023-12-28 08:59:40,510][106225] Updated weights for policy 1, policy_version 1914770 (0.0008) [2023-12-28 08:59:40,573][106225] Updated weights for policy 1, policy_version 1914780 (0.0006) [2023-12-28 08:59:40,718][106226] Updated weights for policy 0, policy_version 1910546 (0.0005) [2023-12-28 08:59:40,772][106226] Updated weights for policy 0, policy_version 1910556 (0.0006) [2023-12-28 08:59:40,829][106226] Updated weights for policy 0, policy_version 1910566 (0.0006) [2023-12-28 08:59:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 979427328. Throughput: 0: 9848.8, 1: 9976.7. Samples: 979397100. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:41,175][105115] Avg episode reward: [(0, '-4.256'), (1, '-4.411')] [2023-12-28 08:59:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001910568_489185280.pth... [2023-12-28 08:59:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001914784_490242048.pth... [2023-12-28 08:59:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001909416_488890368.pth [2023-12-28 08:59:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001913632_489947136.pth [2023-12-28 08:59:41,236][106225] Updated weights for policy 1, policy_version 1914790 (0.0007) [2023-12-28 08:59:41,296][106225] Updated weights for policy 1, policy_version 1914800 (0.0009) [2023-12-28 08:59:41,344][106225] Updated weights for policy 1, policy_version 1914810 (0.0008) [2023-12-28 08:59:41,587][106226] Updated weights for policy 0, policy_version 1910576 (0.0010) [2023-12-28 08:59:41,654][106226] Updated weights for policy 0, policy_version 1910586 (0.0011) [2023-12-28 08:59:41,714][106226] Updated weights for policy 0, policy_version 1910596 (0.0009) [2023-12-28 08:59:42,063][106225] Updated weights for policy 1, policy_version 1914820 (0.0007) [2023-12-28 08:59:42,126][106225] Updated weights for policy 1, policy_version 1914830 (0.0008) [2023-12-28 08:59:42,190][106225] Updated weights for policy 1, policy_version 1914840 (0.0009) [2023-12-28 08:59:42,463][106226] Updated weights for policy 0, policy_version 1910606 (0.0008) [2023-12-28 08:59:42,515][106226] Updated weights for policy 0, policy_version 1910616 (0.0009) [2023-12-28 08:59:42,573][106226] Updated weights for policy 0, policy_version 1910626 (0.0009) [2023-12-28 08:59:42,815][106225] Updated weights for policy 1, policy_version 1914850 (0.0008) [2023-12-28 08:59:42,865][106225] Updated weights for policy 1, policy_version 1914860 (0.0007) [2023-12-28 08:59:42,912][106225] Updated weights for policy 1, policy_version 1914870 (0.0007) [2023-12-28 08:59:42,964][106225] Updated weights for policy 1, policy_version 1914880 (0.0005) [2023-12-28 08:59:43,443][106226] Updated weights for policy 0, policy_version 1910636 (0.0009) [2023-12-28 08:59:43,498][106226] Updated weights for policy 0, policy_version 1910646 (0.0008) [2023-12-28 08:59:43,535][106225] Updated weights for policy 1, policy_version 1914890 (0.0005) [2023-12-28 08:59:43,548][106226] Updated weights for policy 0, policy_version 1910656 (0.0008) [2023-12-28 08:59:43,591][106225] Updated weights for policy 1, policy_version 1914900 (0.0005) [2023-12-28 08:59:43,651][106225] Updated weights for policy 1, policy_version 1914910 (0.0005) [2023-12-28 08:59:44,151][106225] Updated weights for policy 1, policy_version 1914920 (0.0008) [2023-12-28 08:59:44,206][106225] Updated weights for policy 1, policy_version 1914930 (0.0008) [2023-12-28 08:59:44,266][106225] Updated weights for policy 1, policy_version 1914940 (0.0008) [2023-12-28 08:59:44,336][106226] Updated weights for policy 0, policy_version 1910666 (0.0009) [2023-12-28 08:59:44,405][106226] Updated weights for policy 0, policy_version 1910676 (0.0008) [2023-12-28 08:59:44,479][106226] Updated weights for policy 0, policy_version 1910686 (0.0007) [2023-12-28 08:59:44,549][106226] Updated weights for policy 0, policy_version 1910696 (0.0005) [2023-12-28 08:59:45,027][106225] Updated weights for policy 1, policy_version 1914950 (0.0008) [2023-12-28 08:59:45,098][106225] Updated weights for policy 1, policy_version 1914960 (0.0008) [2023-12-28 08:59:45,168][106225] Updated weights for policy 1, policy_version 1914970 (0.0008) [2023-12-28 08:59:45,207][106226] Updated weights for policy 0, policy_version 1910706 (0.0008) [2023-12-28 08:59:45,271][106226] Updated weights for policy 0, policy_version 1910716 (0.0008) [2023-12-28 08:59:45,331][106226] Updated weights for policy 0, policy_version 1910726 (0.0009) [2023-12-28 08:59:45,760][106225] Updated weights for policy 1, policy_version 1914980 (0.0008) [2023-12-28 08:59:45,825][106225] Updated weights for policy 1, policy_version 1914990 (0.0006) [2023-12-28 08:59:45,895][106225] Updated weights for policy 1, policy_version 1915000 (0.0005) [2023-12-28 08:59:46,147][106226] Updated weights for policy 0, policy_version 1910736 (0.0010) [2023-12-28 08:59:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 979525632. Throughput: 0: 9783.1, 1: 10107.4. Samples: 979516964. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:46,177][105115] Avg episode reward: [(0, '-4.472'), (1, '-4.500')] [2023-12-28 08:59:46,201][106226] Updated weights for policy 0, policy_version 1910746 (0.0008) [2023-12-28 08:59:46,252][106226] Updated weights for policy 0, policy_version 1910756 (0.0009) [2023-12-28 08:59:46,420][106225] Updated weights for policy 1, policy_version 1915010 (0.0005) [2023-12-28 08:59:46,468][106225] Updated weights for policy 1, policy_version 1915020 (0.0005) [2023-12-28 08:59:46,520][106225] Updated weights for policy 1, policy_version 1915030 (0.0006) [2023-12-28 08:59:46,564][106225] Updated weights for policy 1, policy_version 1915040 (0.0008) [2023-12-28 08:59:47,041][106226] Updated weights for policy 0, policy_version 1910766 (0.0010) [2023-12-28 08:59:47,091][106226] Updated weights for policy 0, policy_version 1910776 (0.0008) [2023-12-28 08:59:47,141][106226] Updated weights for policy 0, policy_version 1910786 (0.0008) [2023-12-28 08:59:47,261][106225] Updated weights for policy 1, policy_version 1915050 (0.0007) [2023-12-28 08:59:47,309][106225] Updated weights for policy 1, policy_version 1915060 (0.0005) [2023-12-28 08:59:47,363][106225] Updated weights for policy 1, policy_version 1915070 (0.0005) [2023-12-28 08:59:47,921][106226] Updated weights for policy 0, policy_version 1910796 (0.0008) [2023-12-28 08:59:47,976][106226] Updated weights for policy 0, policy_version 1910806 (0.0010) [2023-12-28 08:59:48,020][106225] Updated weights for policy 1, policy_version 1915080 (0.0007) [2023-12-28 08:59:48,033][106226] Updated weights for policy 0, policy_version 1910816 (0.0007) [2023-12-28 08:59:48,080][106225] Updated weights for policy 1, policy_version 1915090 (0.0008) [2023-12-28 08:59:48,145][106225] Updated weights for policy 1, policy_version 1915100 (0.0009) [2023-12-28 08:59:48,768][106226] Updated weights for policy 0, policy_version 1910826 (0.0008) [2023-12-28 08:59:48,821][106225] Updated weights for policy 1, policy_version 1915110 (0.0009) [2023-12-28 08:59:48,832][106226] Updated weights for policy 0, policy_version 1910836 (0.0007) [2023-12-28 08:59:48,881][106225] Updated weights for policy 1, policy_version 1915120 (0.0007) [2023-12-28 08:59:48,898][106226] Updated weights for policy 0, policy_version 1910846 (0.0007) [2023-12-28 08:59:48,937][106225] Updated weights for policy 1, policy_version 1915130 (0.0006) [2023-12-28 08:59:48,950][106226] Updated weights for policy 0, policy_version 1910856 (0.0006) [2023-12-28 08:59:49,629][106225] Updated weights for policy 1, policy_version 1915140 (0.0007) [2023-12-28 08:59:49,688][106226] Updated weights for policy 0, policy_version 1910866 (0.0006) [2023-12-28 08:59:49,693][106225] Updated weights for policy 1, policy_version 1915150 (0.0008) [2023-12-28 08:59:49,747][106226] Updated weights for policy 0, policy_version 1910876 (0.0006) [2023-12-28 08:59:49,753][106225] Updated weights for policy 1, policy_version 1915160 (0.0007) [2023-12-28 08:59:49,799][106226] Updated weights for policy 0, policy_version 1910886 (0.0006) [2023-12-28 08:59:50,529][106225] Updated weights for policy 1, policy_version 1915170 (0.0007) [2023-12-28 08:59:50,546][106226] Updated weights for policy 0, policy_version 1910896 (0.0005) [2023-12-28 08:59:50,591][106225] Updated weights for policy 1, policy_version 1915180 (0.0007) [2023-12-28 08:59:50,610][106226] Updated weights for policy 0, policy_version 1910906 (0.0008) [2023-12-28 08:59:50,648][106225] Updated weights for policy 1, policy_version 1915190 (0.0008) [2023-12-28 08:59:50,671][106226] Updated weights for policy 0, policy_version 1910916 (0.0006) [2023-12-28 08:59:50,711][106225] Updated weights for policy 1, policy_version 1915200 (0.0009) [2023-12-28 08:59:51,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 979623936. Throughput: 0: 9667.5, 1: 10100.5. Samples: 979634088. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:51,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-4.939')] [2023-12-28 08:59:51,342][106226] Updated weights for policy 0, policy_version 1910926 (0.0007) [2023-12-28 08:59:51,413][106226] Updated weights for policy 0, policy_version 1910936 (0.0008) [2023-12-28 08:59:51,465][106226] Updated weights for policy 0, policy_version 1910946 (0.0008) [2023-12-28 08:59:51,543][106225] Updated weights for policy 1, policy_version 1915210 (0.0006) [2023-12-28 08:59:51,608][106225] Updated weights for policy 1, policy_version 1915220 (0.0006) [2023-12-28 08:59:51,672][106225] Updated weights for policy 1, policy_version 1915230 (0.0008) [2023-12-28 08:59:52,227][106226] Updated weights for policy 0, policy_version 1910956 (0.0009) [2023-12-28 08:59:52,288][106226] Updated weights for policy 0, policy_version 1910966 (0.0011) [2023-12-28 08:59:52,350][106226] Updated weights for policy 0, policy_version 1910976 (0.0011) [2023-12-28 08:59:52,360][106225] Updated weights for policy 1, policy_version 1915240 (0.0006) [2023-12-28 08:59:52,426][106225] Updated weights for policy 1, policy_version 1915250 (0.0008) [2023-12-28 08:59:52,490][106225] Updated weights for policy 1, policy_version 1915260 (0.0007) [2023-12-28 08:59:53,013][106226] Updated weights for policy 0, policy_version 1910986 (0.0010) [2023-12-28 08:59:53,075][106226] Updated weights for policy 0, policy_version 1910996 (0.0010) [2023-12-28 08:59:53,132][106225] Updated weights for policy 1, policy_version 1915270 (0.0007) [2023-12-28 08:59:53,135][106226] Updated weights for policy 0, policy_version 1911006 (0.0010) [2023-12-28 08:59:53,177][106225] Updated weights for policy 1, policy_version 1915280 (0.0008) [2023-12-28 08:59:53,199][106226] Updated weights for policy 0, policy_version 1911016 (0.0010) [2023-12-28 08:59:53,227][106225] Updated weights for policy 1, policy_version 1915290 (0.0007) [2023-12-28 08:59:53,898][106226] Updated weights for policy 0, policy_version 1911026 (0.0011) [2023-12-28 08:59:53,961][106226] Updated weights for policy 0, policy_version 1911036 (0.0011) [2023-12-28 08:59:53,979][106225] Updated weights for policy 1, policy_version 1915300 (0.0008) [2023-12-28 08:59:54,010][106226] Updated weights for policy 0, policy_version 1911046 (0.0010) [2023-12-28 08:59:54,031][106225] Updated weights for policy 1, policy_version 1915310 (0.0008) [2023-12-28 08:59:54,088][106225] Updated weights for policy 1, policy_version 1915320 (0.0008) [2023-12-28 08:59:54,711][106226] Updated weights for policy 0, policy_version 1911056 (0.0011) [2023-12-28 08:59:54,761][106226] Updated weights for policy 0, policy_version 1911066 (0.0010) [2023-12-28 08:59:54,782][106225] Updated weights for policy 1, policy_version 1915330 (0.0007) [2023-12-28 08:59:54,816][106226] Updated weights for policy 0, policy_version 1911076 (0.0010) [2023-12-28 08:59:54,838][106225] Updated weights for policy 1, policy_version 1915340 (0.0009) [2023-12-28 08:59:54,880][106225] Updated weights for policy 1, policy_version 1915350 (0.0008) [2023-12-28 08:59:54,938][106225] Updated weights for policy 1, policy_version 1915360 (0.0008) [2023-12-28 08:59:55,412][106226] Updated weights for policy 0, policy_version 1911086 (0.0007) [2023-12-28 08:59:55,473][106226] Updated weights for policy 0, policy_version 1911096 (0.0005) [2023-12-28 08:59:55,526][106226] Updated weights for policy 0, policy_version 1911106 (0.0005) [2023-12-28 08:59:55,698][106225] Updated weights for policy 1, policy_version 1915370 (0.0006) [2023-12-28 08:59:55,766][106225] Updated weights for policy 1, policy_version 1915380 (0.0005) [2023-12-28 08:59:55,833][106225] Updated weights for policy 1, policy_version 1915390 (0.0006) [2023-12-28 08:59:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 979722240. Throughput: 0: 9693.8, 1: 10064.2. Samples: 979691924. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 08:59:56,175][105115] Avg episode reward: [(0, '-4.239'), (1, '-4.890')] [2023-12-28 08:59:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001915392_490397696.pth... [2023-12-28 08:59:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001914208_490094592.pth [2023-12-28 08:59:56,185][106226] Updated weights for policy 0, policy_version 1911116 (0.0007) [2023-12-28 08:59:56,258][106226] Updated weights for policy 0, policy_version 1911126 (0.0009) [2023-12-28 08:59:56,328][106226] Updated weights for policy 0, policy_version 1911136 (0.0008) [2023-12-28 08:59:56,378][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001911144_489332736.pth... [2023-12-28 08:59:56,384][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001909992_489037824.pth [2023-12-28 08:59:56,488][106225] Updated weights for policy 1, policy_version 1915400 (0.0008) [2023-12-28 08:59:56,549][106225] Updated weights for policy 1, policy_version 1915410 (0.0009) [2023-12-28 08:59:56,612][106225] Updated weights for policy 1, policy_version 1915420 (0.0009) [2023-12-28 08:59:57,053][106226] Updated weights for policy 0, policy_version 1911146 (0.0009) [2023-12-28 08:59:57,102][106226] Updated weights for policy 0, policy_version 1911156 (0.0009) [2023-12-28 08:59:57,151][106226] Updated weights for policy 0, policy_version 1911166 (0.0009) [2023-12-28 08:59:57,199][106226] Updated weights for policy 0, policy_version 1911176 (0.0008) [2023-12-28 08:59:57,354][106225] Updated weights for policy 1, policy_version 1915430 (0.0008) [2023-12-28 08:59:57,406][106225] Updated weights for policy 1, policy_version 1915440 (0.0008) [2023-12-28 08:59:57,465][106225] Updated weights for policy 1, policy_version 1915450 (0.0009) [2023-12-28 08:59:57,937][106226] Updated weights for policy 0, policy_version 1911186 (0.0009) [2023-12-28 08:59:57,996][106226] Updated weights for policy 0, policy_version 1911196 (0.0009) [2023-12-28 08:59:58,050][106226] Updated weights for policy 0, policy_version 1911206 (0.0009) [2023-12-28 08:59:58,197][106225] Updated weights for policy 1, policy_version 1915460 (0.0009) [2023-12-28 08:59:58,258][106225] Updated weights for policy 1, policy_version 1915470 (0.0009) [2023-12-28 08:59:58,324][106225] Updated weights for policy 1, policy_version 1915480 (0.0009) [2023-12-28 08:59:58,788][106226] Updated weights for policy 0, policy_version 1911216 (0.0008) [2023-12-28 08:59:58,855][106226] Updated weights for policy 0, policy_version 1911226 (0.0008) [2023-12-28 08:59:58,927][106226] Updated weights for policy 0, policy_version 1911236 (0.0009) [2023-12-28 08:59:59,124][106225] Updated weights for policy 1, policy_version 1915490 (0.0008) [2023-12-28 08:59:59,187][106225] Updated weights for policy 1, policy_version 1915500 (0.0006) [2023-12-28 08:59:59,265][106225] Updated weights for policy 1, policy_version 1915510 (0.0008) [2023-12-28 08:59:59,334][106225] Updated weights for policy 1, policy_version 1915520 (0.0009) [2023-12-28 08:59:59,781][106226] Updated weights for policy 0, policy_version 1911246 (0.0008) [2023-12-28 08:59:59,845][106226] Updated weights for policy 0, policy_version 1911256 (0.0009) [2023-12-28 08:59:59,905][106226] Updated weights for policy 0, policy_version 1911266 (0.0009) [2023-12-28 08:59:59,987][106225] Updated weights for policy 1, policy_version 1915530 (0.0006) [2023-12-28 09:00:00,049][106225] Updated weights for policy 1, policy_version 1915540 (0.0007) [2023-12-28 09:00:00,115][106225] Updated weights for policy 1, policy_version 1915550 (0.0005) [2023-12-28 09:00:00,695][106226] Updated weights for policy 0, policy_version 1911276 (0.0008) [2023-12-28 09:00:00,752][106226] Updated weights for policy 0, policy_version 1911286 (0.0008) [2023-12-28 09:00:00,754][106225] Updated weights for policy 1, policy_version 1915560 (0.0010) [2023-12-28 09:00:00,807][106225] Updated weights for policy 1, policy_version 1915570 (0.0010) [2023-12-28 09:00:00,809][106226] Updated weights for policy 0, policy_version 1911296 (0.0006) [2023-12-28 09:00:00,856][106225] Updated weights for policy 1, policy_version 1915580 (0.0010) [2023-12-28 09:00:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 979820544. Throughput: 0: 9671.1, 1: 10079.5. Samples: 979807176. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:01,175][105115] Avg episode reward: [(0, '-4.648'), (1, '-4.843')] [2023-12-28 09:00:01,563][106226] Updated weights for policy 0, policy_version 1911306 (0.0006) [2023-12-28 09:00:01,587][106225] Updated weights for policy 1, policy_version 1915590 (0.0008) [2023-12-28 09:00:01,629][106226] Updated weights for policy 0, policy_version 1911316 (0.0008) [2023-12-28 09:00:01,651][106225] Updated weights for policy 1, policy_version 1915600 (0.0008) [2023-12-28 09:00:01,689][106226] Updated weights for policy 0, policy_version 1911326 (0.0006) [2023-12-28 09:00:01,715][106225] Updated weights for policy 1, policy_version 1915610 (0.0009) [2023-12-28 09:00:01,760][106226] Updated weights for policy 0, policy_version 1911336 (0.0007) [2023-12-28 09:00:02,420][106225] Updated weights for policy 1, policy_version 1915620 (0.0010) [2023-12-28 09:00:02,484][106225] Updated weights for policy 1, policy_version 1915630 (0.0008) [2023-12-28 09:00:02,531][106226] Updated weights for policy 0, policy_version 1911346 (0.0007) [2023-12-28 09:00:02,550][106225] Updated weights for policy 1, policy_version 1915640 (0.0007) [2023-12-28 09:00:02,591][106226] Updated weights for policy 0, policy_version 1911356 (0.0006) [2023-12-28 09:00:02,652][106226] Updated weights for policy 0, policy_version 1911366 (0.0008) [2023-12-28 09:00:03,149][106225] Updated weights for policy 1, policy_version 1915650 (0.0009) [2023-12-28 09:00:03,203][106225] Updated weights for policy 1, policy_version 1915660 (0.0005) [2023-12-28 09:00:03,256][106225] Updated weights for policy 1, policy_version 1915670 (0.0005) [2023-12-28 09:00:03,307][106225] Updated weights for policy 1, policy_version 1915680 (0.0007) [2023-12-28 09:00:03,409][106226] Updated weights for policy 0, policy_version 1911376 (0.0008) [2023-12-28 09:00:03,453][106226] Updated weights for policy 0, policy_version 1911386 (0.0008) [2023-12-28 09:00:03,499][106226] Updated weights for policy 0, policy_version 1911396 (0.0008) [2023-12-28 09:00:03,932][106225] Updated weights for policy 1, policy_version 1915690 (0.0007) [2023-12-28 09:00:03,997][106225] Updated weights for policy 1, policy_version 1915700 (0.0010) [2023-12-28 09:00:04,059][106225] Updated weights for policy 1, policy_version 1915710 (0.0010) [2023-12-28 09:00:04,236][106226] Updated weights for policy 0, policy_version 1911406 (0.0009) [2023-12-28 09:00:04,301][106226] Updated weights for policy 0, policy_version 1911416 (0.0007) [2023-12-28 09:00:04,364][106226] Updated weights for policy 0, policy_version 1911426 (0.0008) [2023-12-28 09:00:04,766][106225] Updated weights for policy 1, policy_version 1915720 (0.0010) [2023-12-28 09:00:04,832][106225] Updated weights for policy 1, policy_version 1915730 (0.0010) [2023-12-28 09:00:04,881][106225] Updated weights for policy 1, policy_version 1915740 (0.0008) [2023-12-28 09:00:05,110][106226] Updated weights for policy 0, policy_version 1911436 (0.0007) [2023-12-28 09:00:05,167][106226] Updated weights for policy 0, policy_version 1911446 (0.0008) [2023-12-28 09:00:05,221][106226] Updated weights for policy 0, policy_version 1911456 (0.0008) [2023-12-28 09:00:05,604][106225] Updated weights for policy 1, policy_version 1915750 (0.0010) [2023-12-28 09:00:05,663][106225] Updated weights for policy 1, policy_version 1915760 (0.0010) [2023-12-28 09:00:05,721][106225] Updated weights for policy 1, policy_version 1915770 (0.0010) [2023-12-28 09:00:05,947][106226] Updated weights for policy 0, policy_version 1911466 (0.0008) [2023-12-28 09:00:06,001][106226] Updated weights for policy 0, policy_version 1911476 (0.0008) [2023-12-28 09:00:06,054][106226] Updated weights for policy 0, policy_version 1911486 (0.0008) [2023-12-28 09:00:06,116][106226] Updated weights for policy 0, policy_version 1911496 (0.0008) [2023-12-28 09:00:06,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 979918848. Throughput: 0: 9685.2, 1: 10081.6. Samples: 979923692. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:06,175][105115] Avg episode reward: [(0, '-4.544'), (1, '-4.621')] [2023-12-28 09:00:06,455][106225] Updated weights for policy 1, policy_version 1915780 (0.0009) [2023-12-28 09:00:06,517][106225] Updated weights for policy 1, policy_version 1915790 (0.0008) [2023-12-28 09:00:06,580][106225] Updated weights for policy 1, policy_version 1915800 (0.0008) [2023-12-28 09:00:06,864][106226] Updated weights for policy 0, policy_version 1911506 (0.0010) [2023-12-28 09:00:06,925][106226] Updated weights for policy 0, policy_version 1911516 (0.0009) [2023-12-28 09:00:06,972][106226] Updated weights for policy 0, policy_version 1911526 (0.0008) [2023-12-28 09:00:07,258][106225] Updated weights for policy 1, policy_version 1915810 (0.0008) [2023-12-28 09:00:07,308][106225] Updated weights for policy 1, policy_version 1915820 (0.0005) [2023-12-28 09:00:07,355][106225] Updated weights for policy 1, policy_version 1915830 (0.0005) [2023-12-28 09:00:07,411][106225] Updated weights for policy 1, policy_version 1915840 (0.0007) [2023-12-28 09:00:07,820][106226] Updated weights for policy 0, policy_version 1911536 (0.0010) [2023-12-28 09:00:07,870][106226] Updated weights for policy 0, policy_version 1911547 (0.0008) [2023-12-28 09:00:07,918][106226] Updated weights for policy 0, policy_version 1911557 (0.0010) [2023-12-28 09:00:07,959][106225] Updated weights for policy 1, policy_version 1915850 (0.0005) [2023-12-28 09:00:08,009][106225] Updated weights for policy 1, policy_version 1915860 (0.0007) [2023-12-28 09:00:08,066][106225] Updated weights for policy 1, policy_version 1915870 (0.0010) [2023-12-28 09:00:08,693][106226] Updated weights for policy 0, policy_version 1911567 (0.0007) [2023-12-28 09:00:08,747][106226] Updated weights for policy 0, policy_version 1911577 (0.0008) [2023-12-28 09:00:08,763][106225] Updated weights for policy 1, policy_version 1915880 (0.0007) [2023-12-28 09:00:08,800][106226] Updated weights for policy 0, policy_version 1911587 (0.0006) [2023-12-28 09:00:08,817][106225] Updated weights for policy 1, policy_version 1915890 (0.0010) [2023-12-28 09:00:08,880][106225] Updated weights for policy 1, policy_version 1915900 (0.0010) [2023-12-28 09:00:09,522][106226] Updated weights for policy 0, policy_version 1911597 (0.0007) [2023-12-28 09:00:09,580][106226] Updated weights for policy 0, policy_version 1911607 (0.0009) [2023-12-28 09:00:09,613][106225] Updated weights for policy 1, policy_version 1915910 (0.0009) [2023-12-28 09:00:09,643][106226] Updated weights for policy 0, policy_version 1911617 (0.0006) [2023-12-28 09:00:09,672][106225] Updated weights for policy 1, policy_version 1915920 (0.0007) [2023-12-28 09:00:09,746][106225] Updated weights for policy 1, policy_version 1915930 (0.0006) [2023-12-28 09:00:10,470][106226] Updated weights for policy 0, policy_version 1911627 (0.0008) [2023-12-28 09:00:10,517][106226] Updated weights for policy 0, policy_version 1911637 (0.0010) [2023-12-28 09:00:10,518][106225] Updated weights for policy 1, policy_version 1915940 (0.0009) [2023-12-28 09:00:10,564][106226] Updated weights for policy 0, policy_version 1911647 (0.0010) [2023-12-28 09:00:10,578][106225] Updated weights for policy 1, policy_version 1915950 (0.0010) [2023-12-28 09:00:10,625][106225] Updated weights for policy 1, policy_version 1915960 (0.0010) [2023-12-28 09:00:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 980008960. Throughput: 0: 9623.7, 1: 10151.4. Samples: 979982432. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:11,175][105115] Avg episode reward: [(0, '-4.039'), (1, '-4.493')] [2023-12-28 09:00:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001911656_489463808.pth... [2023-12-28 09:00:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001915968_490545152.pth... [2023-12-28 09:00:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001910568_489185280.pth [2023-12-28 09:00:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001914784_490242048.pth [2023-12-28 09:00:11,329][106226] Updated weights for policy 0, policy_version 1911657 (0.0010) [2023-12-28 09:00:11,408][106226] Updated weights for policy 0, policy_version 1911667 (0.0010) [2023-12-28 09:00:11,428][106225] Updated weights for policy 1, policy_version 1915970 (0.0010) [2023-12-28 09:00:11,468][106226] Updated weights for policy 0, policy_version 1911677 (0.0009) [2023-12-28 09:00:11,482][106225] Updated weights for policy 1, policy_version 1915980 (0.0009) [2023-12-28 09:00:11,526][106226] Updated weights for policy 0, policy_version 1911687 (0.0009) [2023-12-28 09:00:11,539][106225] Updated weights for policy 1, policy_version 1915990 (0.0009) [2023-12-28 09:00:11,601][106225] Updated weights for policy 1, policy_version 1916000 (0.0009) [2023-12-28 09:00:12,262][106226] Updated weights for policy 0, policy_version 1911697 (0.0009) [2023-12-28 09:00:12,329][106226] Updated weights for policy 0, policy_version 1911707 (0.0007) [2023-12-28 09:00:12,395][106226] Updated weights for policy 0, policy_version 1911717 (0.0007) [2023-12-28 09:00:12,422][106225] Updated weights for policy 1, policy_version 1916010 (0.0008) [2023-12-28 09:00:12,493][106225] Updated weights for policy 1, policy_version 1916020 (0.0009) [2023-12-28 09:00:12,552][106225] Updated weights for policy 1, policy_version 1916030 (0.0008) [2023-12-28 09:00:13,058][106226] Updated weights for policy 0, policy_version 1911727 (0.0007) [2023-12-28 09:00:13,117][106226] Updated weights for policy 0, policy_version 1911737 (0.0009) [2023-12-28 09:00:13,177][106226] Updated weights for policy 0, policy_version 1911747 (0.0009) [2023-12-28 09:00:13,288][106225] Updated weights for policy 1, policy_version 1916040 (0.0010) [2023-12-28 09:00:13,339][106225] Updated weights for policy 1, policy_version 1916050 (0.0007) [2023-12-28 09:00:13,400][106225] Updated weights for policy 1, policy_version 1916060 (0.0008) [2023-12-28 09:00:13,769][106226] Updated weights for policy 0, policy_version 1911757 (0.0006) [2023-12-28 09:00:13,816][106226] Updated weights for policy 0, policy_version 1911767 (0.0006) [2023-12-28 09:00:13,868][106226] Updated weights for policy 0, policy_version 1911777 (0.0005) [2023-12-28 09:00:14,055][106225] Updated weights for policy 1, policy_version 1916070 (0.0009) [2023-12-28 09:00:14,115][106225] Updated weights for policy 1, policy_version 1916080 (0.0010) [2023-12-28 09:00:14,178][106225] Updated weights for policy 1, policy_version 1916090 (0.0010) [2023-12-28 09:00:14,432][106226] Updated weights for policy 0, policy_version 1911787 (0.0006) [2023-12-28 09:00:14,491][106226] Updated weights for policy 0, policy_version 1911797 (0.0009) [2023-12-28 09:00:14,551][106226] Updated weights for policy 0, policy_version 1911807 (0.0009) [2023-12-28 09:00:14,791][106225] Updated weights for policy 1, policy_version 1916100 (0.0009) [2023-12-28 09:00:14,850][106225] Updated weights for policy 1, policy_version 1916110 (0.0006) [2023-12-28 09:00:14,912][106225] Updated weights for policy 1, policy_version 1916120 (0.0007) [2023-12-28 09:00:15,260][106226] Updated weights for policy 0, policy_version 1911817 (0.0008) [2023-12-28 09:00:15,324][106226] Updated weights for policy 0, policy_version 1911827 (0.0011) [2023-12-28 09:00:15,391][106226] Updated weights for policy 0, policy_version 1911837 (0.0011) [2023-12-28 09:00:15,448][106226] Updated weights for policy 0, policy_version 1911847 (0.0011) [2023-12-28 09:00:15,596][106225] Updated weights for policy 1, policy_version 1916130 (0.0009) [2023-12-28 09:00:15,660][106225] Updated weights for policy 1, policy_version 1916140 (0.0005) [2023-12-28 09:00:15,728][106225] Updated weights for policy 1, policy_version 1916150 (0.0006) [2023-12-28 09:00:15,780][106225] Updated weights for policy 1, policy_version 1916160 (0.0005) [2023-12-28 09:00:16,171][106226] Updated weights for policy 0, policy_version 1911857 (0.0011) [2023-12-28 09:00:16,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 980107264. Throughput: 0: 9546.8, 1: 10057.4. Samples: 980099040. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:16,175][105115] Avg episode reward: [(0, '-4.493'), (1, '-4.401')] [2023-12-28 09:00:16,229][106226] Updated weights for policy 0, policy_version 1911867 (0.0011) [2023-12-28 09:00:16,291][106226] Updated weights for policy 0, policy_version 1911877 (0.0009) [2023-12-28 09:00:16,301][106225] Updated weights for policy 1, policy_version 1916170 (0.0007) [2023-12-28 09:00:16,359][106225] Updated weights for policy 1, policy_version 1916180 (0.0006) [2023-12-28 09:00:16,416][106225] Updated weights for policy 1, policy_version 1916190 (0.0005) [2023-12-28 09:00:16,967][106226] Updated weights for policy 0, policy_version 1911887 (0.0009) [2023-12-28 09:00:17,030][106226] Updated weights for policy 0, policy_version 1911897 (0.0009) [2023-12-28 09:00:17,090][106226] Updated weights for policy 0, policy_version 1911907 (0.0007) [2023-12-28 09:00:17,100][106225] Updated weights for policy 1, policy_version 1916200 (0.0007) [2023-12-28 09:00:17,168][106225] Updated weights for policy 1, policy_version 1916210 (0.0008) [2023-12-28 09:00:17,232][106225] Updated weights for policy 1, policy_version 1916220 (0.0008) [2023-12-28 09:00:17,772][106226] Updated weights for policy 0, policy_version 1911917 (0.0007) [2023-12-28 09:00:17,845][106226] Updated weights for policy 0, policy_version 1911927 (0.0007) [2023-12-28 09:00:17,872][106225] Updated weights for policy 1, policy_version 1916230 (0.0008) [2023-12-28 09:00:17,914][106226] Updated weights for policy 0, policy_version 1911937 (0.0008) [2023-12-28 09:00:17,924][106225] Updated weights for policy 1, policy_version 1916240 (0.0008) [2023-12-28 09:00:17,980][106225] Updated weights for policy 1, policy_version 1916250 (0.0010) [2023-12-28 09:00:18,597][106226] Updated weights for policy 0, policy_version 1911947 (0.0009) [2023-12-28 09:00:18,667][106226] Updated weights for policy 0, policy_version 1911957 (0.0008) [2023-12-28 09:00:18,722][106225] Updated weights for policy 1, policy_version 1916260 (0.0011) [2023-12-28 09:00:18,732][106226] Updated weights for policy 0, policy_version 1911967 (0.0007) [2023-12-28 09:00:18,770][106225] Updated weights for policy 1, policy_version 1916270 (0.0011) [2023-12-28 09:00:18,815][106225] Updated weights for policy 1, policy_version 1916280 (0.0010) [2023-12-28 09:00:19,442][106226] Updated weights for policy 0, policy_version 1911977 (0.0006) [2023-12-28 09:00:19,515][106226] Updated weights for policy 0, policy_version 1911987 (0.0009) [2023-12-28 09:00:19,573][106226] Updated weights for policy 0, policy_version 1911997 (0.0008) [2023-12-28 09:00:19,596][106225] Updated weights for policy 1, policy_version 1916290 (0.0010) [2023-12-28 09:00:19,637][106226] Updated weights for policy 0, policy_version 1912007 (0.0009) [2023-12-28 09:00:19,662][106225] Updated weights for policy 1, policy_version 1916300 (0.0010) [2023-12-28 09:00:19,730][106225] Updated weights for policy 1, policy_version 1916310 (0.0010) [2023-12-28 09:00:19,797][106225] Updated weights for policy 1, policy_version 1916320 (0.0011) [2023-12-28 09:00:20,428][106226] Updated weights for policy 0, policy_version 1912017 (0.0007) [2023-12-28 09:00:20,487][106226] Updated weights for policy 0, policy_version 1912027 (0.0006) [2023-12-28 09:00:20,504][106225] Updated weights for policy 1, policy_version 1916330 (0.0010) [2023-12-28 09:00:20,548][106226] Updated weights for policy 0, policy_version 1912037 (0.0006) [2023-12-28 09:00:20,562][106225] Updated weights for policy 1, policy_version 1916340 (0.0010) [2023-12-28 09:00:20,637][106225] Updated weights for policy 1, policy_version 1916350 (0.0010) [2023-12-28 09:00:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 980205568. Throughput: 0: 9516.1, 1: 10041.1. Samples: 980216560. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:21,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.471')] [2023-12-28 09:00:21,384][106225] Updated weights for policy 1, policy_version 1916360 (0.0011) [2023-12-28 09:00:21,450][106225] Updated weights for policy 1, policy_version 1916370 (0.0011) [2023-12-28 09:00:21,456][106226] Updated weights for policy 0, policy_version 1912047 (0.0006) [2023-12-28 09:00:21,504][106226] Updated weights for policy 0, policy_version 1912057 (0.0005) [2023-12-28 09:00:21,509][106225] Updated weights for policy 1, policy_version 1916380 (0.0011) [2023-12-28 09:00:21,556][106226] Updated weights for policy 0, policy_version 1912067 (0.0008) [2023-12-28 09:00:22,219][106225] Updated weights for policy 1, policy_version 1916390 (0.0010) [2023-12-28 09:00:22,273][106226] Updated weights for policy 0, policy_version 1912077 (0.0008) [2023-12-28 09:00:22,289][106225] Updated weights for policy 1, policy_version 1916400 (0.0010) [2023-12-28 09:00:22,338][106226] Updated weights for policy 0, policy_version 1912087 (0.0008) [2023-12-28 09:00:22,351][106225] Updated weights for policy 1, policy_version 1916410 (0.0010) [2023-12-28 09:00:22,412][106226] Updated weights for policy 0, policy_version 1912097 (0.0010) [2023-12-28 09:00:23,098][106226] Updated weights for policy 0, policy_version 1912107 (0.0009) [2023-12-28 09:00:23,155][106226] Updated weights for policy 0, policy_version 1912117 (0.0006) [2023-12-28 09:00:23,165][106225] Updated weights for policy 1, policy_version 1916420 (0.0009) [2023-12-28 09:00:23,217][106226] Updated weights for policy 0, policy_version 1912127 (0.0010) [2023-12-28 09:00:23,224][106225] Updated weights for policy 1, policy_version 1916430 (0.0006) [2023-12-28 09:00:23,284][106225] Updated weights for policy 1, policy_version 1916440 (0.0007) [2023-12-28 09:00:23,865][106226] Updated weights for policy 0, policy_version 1912137 (0.0007) [2023-12-28 09:00:23,913][106226] Updated weights for policy 0, policy_version 1912147 (0.0009) [2023-12-28 09:00:23,976][106226] Updated weights for policy 0, policy_version 1912157 (0.0009) [2023-12-28 09:00:24,000][106225] Updated weights for policy 1, policy_version 1916450 (0.0007) [2023-12-28 09:00:24,038][106226] Updated weights for policy 0, policy_version 1912167 (0.0009) [2023-12-28 09:00:24,056][106225] Updated weights for policy 1, policy_version 1916460 (0.0006) [2023-12-28 09:00:24,114][106225] Updated weights for policy 1, policy_version 1916470 (0.0008) [2023-12-28 09:00:24,176][106225] Updated weights for policy 1, policy_version 1916480 (0.0008) [2023-12-28 09:00:24,773][106226] Updated weights for policy 0, policy_version 1912177 (0.0007) [2023-12-28 09:00:24,784][106225] Updated weights for policy 1, policy_version 1916490 (0.0005) [2023-12-28 09:00:24,821][106226] Updated weights for policy 0, policy_version 1912187 (0.0006) [2023-12-28 09:00:24,838][106225] Updated weights for policy 1, policy_version 1916500 (0.0008) [2023-12-28 09:00:24,876][106226] Updated weights for policy 0, policy_version 1912197 (0.0006) [2023-12-28 09:00:24,903][106225] Updated weights for policy 1, policy_version 1916510 (0.0008) [2023-12-28 09:00:25,584][106226] Updated weights for policy 0, policy_version 1912207 (0.0010) [2023-12-28 09:00:25,607][106225] Updated weights for policy 1, policy_version 1916520 (0.0009) [2023-12-28 09:00:25,634][106226] Updated weights for policy 0, policy_version 1912217 (0.0010) [2023-12-28 09:00:25,661][106225] Updated weights for policy 1, policy_version 1916530 (0.0006) [2023-12-28 09:00:25,693][106226] Updated weights for policy 0, policy_version 1912227 (0.0011) [2023-12-28 09:00:25,719][106225] Updated weights for policy 1, policy_version 1916540 (0.0005) [2023-12-28 09:00:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 980303872. Throughput: 0: 9485.0, 1: 9982.1. Samples: 980273116. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:26,175][105115] Avg episode reward: [(0, '-4.287'), (1, '-4.502')] [2023-12-28 09:00:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001912232_489611264.pth... [2023-12-28 09:00:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001916544_490692608.pth... [2023-12-28 09:00:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001911144_489332736.pth [2023-12-28 09:00:26,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001915392_490397696.pth [2023-12-28 09:00:26,432][106226] Updated weights for policy 0, policy_version 1912237 (0.0010) [2023-12-28 09:00:26,462][106225] Updated weights for policy 1, policy_version 1916550 (0.0008) [2023-12-28 09:00:26,497][106226] Updated weights for policy 0, policy_version 1912247 (0.0010) [2023-12-28 09:00:26,524][106225] Updated weights for policy 1, policy_version 1916560 (0.0010) [2023-12-28 09:00:26,568][106226] Updated weights for policy 0, policy_version 1912257 (0.0008) [2023-12-28 09:00:26,585][106225] Updated weights for policy 1, policy_version 1916570 (0.0010) [2023-12-28 09:00:27,285][106226] Updated weights for policy 0, policy_version 1912267 (0.0011) [2023-12-28 09:00:27,321][106225] Updated weights for policy 1, policy_version 1916580 (0.0011) [2023-12-28 09:00:27,346][106226] Updated weights for policy 0, policy_version 1912277 (0.0010) [2023-12-28 09:00:27,379][106225] Updated weights for policy 1, policy_version 1916590 (0.0005) [2023-12-28 09:00:27,412][106226] Updated weights for policy 0, policy_version 1912287 (0.0011) [2023-12-28 09:00:27,436][106225] Updated weights for policy 1, policy_version 1916600 (0.0005) [2023-12-28 09:00:28,082][106226] Updated weights for policy 0, policy_version 1912297 (0.0011) [2023-12-28 09:00:28,104][106225] Updated weights for policy 1, policy_version 1916610 (0.0009) [2023-12-28 09:00:28,137][106226] Updated weights for policy 0, policy_version 1912307 (0.0007) [2023-12-28 09:00:28,170][106225] Updated weights for policy 1, policy_version 1916620 (0.0011) [2023-12-28 09:00:28,198][106226] Updated weights for policy 0, policy_version 1912317 (0.0009) [2023-12-28 09:00:28,229][106225] Updated weights for policy 1, policy_version 1916630 (0.0011) [2023-12-28 09:00:28,257][106226] Updated weights for policy 0, policy_version 1912327 (0.0006) [2023-12-28 09:00:28,280][106225] Updated weights for policy 1, policy_version 1916640 (0.0010) [2023-12-28 09:00:28,913][106226] Updated weights for policy 0, policy_version 1912337 (0.0006) [2023-12-28 09:00:28,977][106226] Updated weights for policy 0, policy_version 1912347 (0.0008) [2023-12-28 09:00:29,005][106225] Updated weights for policy 1, policy_version 1916650 (0.0011) [2023-12-28 09:00:29,039][106226] Updated weights for policy 0, policy_version 1912357 (0.0006) [2023-12-28 09:00:29,061][106225] Updated weights for policy 1, policy_version 1916660 (0.0010) [2023-12-28 09:00:29,120][106225] Updated weights for policy 1, policy_version 1916670 (0.0010) [2023-12-28 09:00:29,795][106226] Updated weights for policy 0, policy_version 1912367 (0.0007) [2023-12-28 09:00:29,862][106226] Updated weights for policy 0, policy_version 1912377 (0.0009) [2023-12-28 09:00:29,920][106226] Updated weights for policy 0, policy_version 1912387 (0.0006) [2023-12-28 09:00:29,932][106225] Updated weights for policy 1, policy_version 1916680 (0.0010) [2023-12-28 09:00:29,990][106225] Updated weights for policy 1, policy_version 1916690 (0.0009) [2023-12-28 09:00:30,053][106225] Updated weights for policy 1, policy_version 1916700 (0.0010) [2023-12-28 09:00:30,584][106226] Updated weights for policy 0, policy_version 1912397 (0.0010) [2023-12-28 09:00:30,645][106226] Updated weights for policy 0, policy_version 1912407 (0.0011) [2023-12-28 09:00:30,713][106226] Updated weights for policy 0, policy_version 1912417 (0.0011) [2023-12-28 09:00:30,785][106225] Updated weights for policy 1, policy_version 1916710 (0.0011) [2023-12-28 09:00:30,843][106225] Updated weights for policy 1, policy_version 1916720 (0.0010) [2023-12-28 09:00:30,902][106225] Updated weights for policy 1, policy_version 1916730 (0.0010) [2023-12-28 09:00:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 980402176. Throughput: 0: 9521.4, 1: 9875.9. Samples: 980389844. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:31,175][105115] Avg episode reward: [(0, '-4.237'), (1, '-4.553')] [2023-12-28 09:00:31,328][106226] Updated weights for policy 0, policy_version 1912427 (0.0009) [2023-12-28 09:00:31,401][106226] Updated weights for policy 0, policy_version 1912437 (0.0010) [2023-12-28 09:00:31,468][106226] Updated weights for policy 0, policy_version 1912447 (0.0008) [2023-12-28 09:00:31,669][106225] Updated weights for policy 1, policy_version 1916740 (0.0011) [2023-12-28 09:00:31,736][106225] Updated weights for policy 1, policy_version 1916750 (0.0010) [2023-12-28 09:00:31,812][106225] Updated weights for policy 1, policy_version 1916760 (0.0010) [2023-12-28 09:00:32,278][106226] Updated weights for policy 0, policy_version 1912457 (0.0008) [2023-12-28 09:00:32,328][106226] Updated weights for policy 0, policy_version 1912467 (0.0010) [2023-12-28 09:00:32,399][106226] Updated weights for policy 0, policy_version 1912477 (0.0009) [2023-12-28 09:00:32,463][106226] Updated weights for policy 0, policy_version 1912487 (0.0010) [2023-12-28 09:00:32,536][106225] Updated weights for policy 1, policy_version 1916770 (0.0011) [2023-12-28 09:00:32,601][106225] Updated weights for policy 1, policy_version 1916780 (0.0010) [2023-12-28 09:00:32,660][106225] Updated weights for policy 1, policy_version 1916790 (0.0009) [2023-12-28 09:00:32,725][106225] Updated weights for policy 1, policy_version 1916800 (0.0010) [2023-12-28 09:00:33,171][106226] Updated weights for policy 0, policy_version 1912497 (0.0010) [2023-12-28 09:00:33,244][106226] Updated weights for policy 0, policy_version 1912507 (0.0011) [2023-12-28 09:00:33,290][106225] Updated weights for policy 1, policy_version 1916810 (0.0010) [2023-12-28 09:00:33,300][106226] Updated weights for policy 0, policy_version 1912517 (0.0010) [2023-12-28 09:00:33,347][106225] Updated weights for policy 1, policy_version 1916820 (0.0010) [2023-12-28 09:00:33,403][106225] Updated weights for policy 1, policy_version 1916830 (0.0010) [2023-12-28 09:00:33,996][106226] Updated weights for policy 0, policy_version 1912527 (0.0007) [2023-12-28 09:00:34,001][106225] Updated weights for policy 1, policy_version 1916840 (0.0010) [2023-12-28 09:00:34,044][106226] Updated weights for policy 0, policy_version 1912537 (0.0005) [2023-12-28 09:00:34,051][106225] Updated weights for policy 1, policy_version 1916850 (0.0010) [2023-12-28 09:00:34,094][106226] Updated weights for policy 0, policy_version 1912547 (0.0005) [2023-12-28 09:00:34,107][106225] Updated weights for policy 1, policy_version 1916860 (0.0010) [2023-12-28 09:00:34,754][106226] Updated weights for policy 0, policy_version 1912557 (0.0008) [2023-12-28 09:00:34,789][106225] Updated weights for policy 1, policy_version 1916870 (0.0010) [2023-12-28 09:00:34,805][106226] Updated weights for policy 0, policy_version 1912567 (0.0010) [2023-12-28 09:00:34,840][106225] Updated weights for policy 1, policy_version 1916880 (0.0010) [2023-12-28 09:00:34,855][106226] Updated weights for policy 0, policy_version 1912577 (0.0010) [2023-12-28 09:00:34,894][106225] Updated weights for policy 1, policy_version 1916890 (0.0010) [2023-12-28 09:00:35,516][106226] Updated weights for policy 0, policy_version 1912587 (0.0009) [2023-12-28 09:00:35,570][106226] Updated weights for policy 0, policy_version 1912597 (0.0010) [2023-12-28 09:00:35,628][106225] Updated weights for policy 1, policy_version 1916900 (0.0008) [2023-12-28 09:00:35,629][106226] Updated weights for policy 0, policy_version 1912607 (0.0009) [2023-12-28 09:00:35,688][106225] Updated weights for policy 1, policy_version 1916910 (0.0005) [2023-12-28 09:00:35,742][106225] Updated weights for policy 1, policy_version 1916920 (0.0009) [2023-12-28 09:00:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 980500480. Throughput: 0: 9633.4, 1: 9841.4. Samples: 980510448. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:36,175][105115] Avg episode reward: [(0, '-4.246'), (1, '-4.695')] [2023-12-28 09:00:36,301][106226] Updated weights for policy 0, policy_version 1912617 (0.0006) [2023-12-28 09:00:36,371][106226] Updated weights for policy 0, policy_version 1912627 (0.0006) [2023-12-28 09:00:36,440][106226] Updated weights for policy 0, policy_version 1912637 (0.0006) [2023-12-28 09:00:36,453][106225] Updated weights for policy 1, policy_version 1916930 (0.0010) [2023-12-28 09:00:36,500][106226] Updated weights for policy 0, policy_version 1912647 (0.0008) [2023-12-28 09:00:36,514][106225] Updated weights for policy 1, policy_version 1916940 (0.0010) [2023-12-28 09:00:36,577][106225] Updated weights for policy 1, policy_version 1916950 (0.0011) [2023-12-28 09:00:36,643][106225] Updated weights for policy 1, policy_version 1916960 (0.0011) [2023-12-28 09:00:37,068][106226] Updated weights for policy 0, policy_version 1912657 (0.0006) [2023-12-28 09:00:37,132][106226] Updated weights for policy 0, policy_version 1912667 (0.0005) [2023-12-28 09:00:37,198][106226] Updated weights for policy 0, policy_version 1912677 (0.0008) [2023-12-28 09:00:37,355][106225] Updated weights for policy 1, policy_version 1916970 (0.0010) [2023-12-28 09:00:37,409][106225] Updated weights for policy 1, policy_version 1916980 (0.0010) [2023-12-28 09:00:37,473][106225] Updated weights for policy 1, policy_version 1916990 (0.0011) [2023-12-28 09:00:37,777][106226] Updated weights for policy 0, policy_version 1912687 (0.0009) [2023-12-28 09:00:37,827][106226] Updated weights for policy 0, policy_version 1912697 (0.0010) [2023-12-28 09:00:37,884][106226] Updated weights for policy 0, policy_version 1912707 (0.0011) [2023-12-28 09:00:38,179][106225] Updated weights for policy 1, policy_version 1917000 (0.0009) [2023-12-28 09:00:38,235][106225] Updated weights for policy 1, policy_version 1917010 (0.0010) [2023-12-28 09:00:38,300][106225] Updated weights for policy 1, policy_version 1917020 (0.0011) [2023-12-28 09:00:38,627][106226] Updated weights for policy 0, policy_version 1912717 (0.0010) [2023-12-28 09:00:38,680][106226] Updated weights for policy 0, policy_version 1912727 (0.0010) [2023-12-28 09:00:38,731][106226] Updated weights for policy 0, policy_version 1912737 (0.0010) [2023-12-28 09:00:39,016][106225] Updated weights for policy 1, policy_version 1917030 (0.0010) [2023-12-28 09:00:39,066][106225] Updated weights for policy 1, policy_version 1917040 (0.0010) [2023-12-28 09:00:39,126][106225] Updated weights for policy 1, policy_version 1917050 (0.0010) [2023-12-28 09:00:39,495][106226] Updated weights for policy 0, policy_version 1912747 (0.0012) [2023-12-28 09:00:39,564][106226] Updated weights for policy 0, policy_version 1912757 (0.0010) [2023-12-28 09:00:39,622][106226] Updated weights for policy 0, policy_version 1912767 (0.0010) [2023-12-28 09:00:39,923][106225] Updated weights for policy 1, policy_version 1917060 (0.0010) [2023-12-28 09:00:39,995][106225] Updated weights for policy 1, policy_version 1917070 (0.0007) [2023-12-28 09:00:40,058][106225] Updated weights for policy 1, policy_version 1917080 (0.0008) [2023-12-28 09:00:40,351][106226] Updated weights for policy 0, policy_version 1912777 (0.0010) [2023-12-28 09:00:40,422][106226] Updated weights for policy 0, policy_version 1912787 (0.0009) [2023-12-28 09:00:40,483][106226] Updated weights for policy 0, policy_version 1912797 (0.0009) [2023-12-28 09:00:40,542][106226] Updated weights for policy 0, policy_version 1912807 (0.0009) [2023-12-28 09:00:40,787][106225] Updated weights for policy 1, policy_version 1917090 (0.0008) [2023-12-28 09:00:40,847][106225] Updated weights for policy 1, policy_version 1917100 (0.0008) [2023-12-28 09:00:40,900][106225] Updated weights for policy 1, policy_version 1917110 (0.0008) [2023-12-28 09:00:40,955][106225] Updated weights for policy 1, policy_version 1917120 (0.0008) [2023-12-28 09:00:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 980598784. Throughput: 0: 9688.3, 1: 9835.7. Samples: 980570504. Policy #0 lag: (min: 3.0, avg: 14.0, max: 35.0) [2023-12-28 09:00:41,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.566')] [2023-12-28 09:00:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001912808_489758720.pth... [2023-12-28 09:00:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001917120_490840064.pth... [2023-12-28 09:00:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001911656_489463808.pth [2023-12-28 09:00:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001915968_490545152.pth [2023-12-28 09:00:41,280][106226] Updated weights for policy 0, policy_version 1912817 (0.0008) [2023-12-28 09:00:41,334][106226] Updated weights for policy 0, policy_version 1912827 (0.0008) [2023-12-28 09:00:41,403][106226] Updated weights for policy 0, policy_version 1912837 (0.0008) [2023-12-28 09:00:41,768][106225] Updated weights for policy 1, policy_version 1917130 (0.0008) [2023-12-28 09:00:41,825][106225] Updated weights for policy 1, policy_version 1917140 (0.0009) [2023-12-28 09:00:41,886][106225] Updated weights for policy 1, policy_version 1917150 (0.0009) [2023-12-28 09:00:42,204][106226] Updated weights for policy 0, policy_version 1912847 (0.0010) [2023-12-28 09:00:42,258][106226] Updated weights for policy 0, policy_version 1912857 (0.0009) [2023-12-28 09:00:42,317][106226] Updated weights for policy 0, policy_version 1912867 (0.0009) [2023-12-28 09:00:42,639][106225] Updated weights for policy 1, policy_version 1917160 (0.0008) [2023-12-28 09:00:42,700][106225] Updated weights for policy 1, policy_version 1917170 (0.0008) [2023-12-28 09:00:42,754][106225] Updated weights for policy 1, policy_version 1917180 (0.0008) [2023-12-28 09:00:42,955][106226] Updated weights for policy 0, policy_version 1912877 (0.0006) [2023-12-28 09:00:43,012][106226] Updated weights for policy 0, policy_version 1912887 (0.0005) [2023-12-28 09:00:43,067][106226] Updated weights for policy 0, policy_version 1912897 (0.0005) [2023-12-28 09:00:43,391][106225] Updated weights for policy 1, policy_version 1917190 (0.0007) [2023-12-28 09:00:43,449][106225] Updated weights for policy 1, policy_version 1917201 (0.0008) [2023-12-28 09:00:43,512][106225] Updated weights for policy 1, policy_version 1917211 (0.0010) [2023-12-28 09:00:43,716][106226] Updated weights for policy 0, policy_version 1912907 (0.0007) [2023-12-28 09:00:43,770][106226] Updated weights for policy 0, policy_version 1912917 (0.0008) [2023-12-28 09:00:43,823][106226] Updated weights for policy 0, policy_version 1912927 (0.0009) [2023-12-28 09:00:44,083][106225] Updated weights for policy 1, policy_version 1917221 (0.0010) [2023-12-28 09:00:44,133][106225] Updated weights for policy 1, policy_version 1917231 (0.0010) [2023-12-28 09:00:44,186][106225] Updated weights for policy 1, policy_version 1917241 (0.0010) [2023-12-28 09:00:44,527][106226] Updated weights for policy 0, policy_version 1912937 (0.0008) [2023-12-28 09:00:44,594][106226] Updated weights for policy 0, policy_version 1912947 (0.0007) [2023-12-28 09:00:44,650][106226] Updated weights for policy 0, policy_version 1912957 (0.0008) [2023-12-28 09:00:44,707][106226] Updated weights for policy 0, policy_version 1912967 (0.0008) [2023-12-28 09:00:44,940][106225] Updated weights for policy 1, policy_version 1917251 (0.0010) [2023-12-28 09:00:45,014][106225] Updated weights for policy 1, policy_version 1917261 (0.0010) [2023-12-28 09:00:45,077][106225] Updated weights for policy 1, policy_version 1917271 (0.0011) [2023-12-28 09:00:45,476][106226] Updated weights for policy 0, policy_version 1912977 (0.0007) [2023-12-28 09:00:45,543][106226] Updated weights for policy 0, policy_version 1912987 (0.0008) [2023-12-28 09:00:45,598][106226] Updated weights for policy 0, policy_version 1912997 (0.0008) [2023-12-28 09:00:45,797][106225] Updated weights for policy 1, policy_version 1917281 (0.0011) [2023-12-28 09:00:45,844][106225] Updated weights for policy 1, policy_version 1917291 (0.0010) [2023-12-28 09:00:45,893][106225] Updated weights for policy 1, policy_version 1917301 (0.0010) [2023-12-28 09:00:45,949][106225] Updated weights for policy 1, policy_version 1917311 (0.0008) [2023-12-28 09:00:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 980697088. Throughput: 0: 9688.3, 1: 9851.3. Samples: 980686460. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:00:46,175][105115] Avg episode reward: [(0, '-4.301'), (1, '-4.502')] [2023-12-28 09:00:46,256][106226] Updated weights for policy 0, policy_version 1913007 (0.0010) [2023-12-28 09:00:46,316][106226] Updated weights for policy 0, policy_version 1913017 (0.0010) [2023-12-28 09:00:46,379][106226] Updated weights for policy 0, policy_version 1913027 (0.0010) [2023-12-28 09:00:46,622][106225] Updated weights for policy 1, policy_version 1917321 (0.0010) [2023-12-28 09:00:46,675][106225] Updated weights for policy 1, policy_version 1917331 (0.0010) [2023-12-28 09:00:46,722][106225] Updated weights for policy 1, policy_version 1917341 (0.0010) [2023-12-28 09:00:47,013][106226] Updated weights for policy 0, policy_version 1913037 (0.0008) [2023-12-28 09:00:47,070][106226] Updated weights for policy 0, policy_version 1913047 (0.0005) [2023-12-28 09:00:47,127][106226] Updated weights for policy 0, policy_version 1913057 (0.0005) [2023-12-28 09:00:47,379][106225] Updated weights for policy 1, policy_version 1917351 (0.0007) [2023-12-28 09:00:47,427][106225] Updated weights for policy 1, policy_version 1917361 (0.0010) [2023-12-28 09:00:47,472][106225] Updated weights for policy 1, policy_version 1917371 (0.0008) [2023-12-28 09:00:47,694][106226] Updated weights for policy 0, policy_version 1913067 (0.0006) [2023-12-28 09:00:47,761][106226] Updated weights for policy 0, policy_version 1913077 (0.0008) [2023-12-28 09:00:47,829][106226] Updated weights for policy 0, policy_version 1913087 (0.0007) [2023-12-28 09:00:48,152][106225] Updated weights for policy 1, policy_version 1917381 (0.0005) [2023-12-28 09:00:48,201][106225] Updated weights for policy 1, policy_version 1917391 (0.0007) [2023-12-28 09:00:48,259][106225] Updated weights for policy 1, policy_version 1917401 (0.0008) [2023-12-28 09:00:48,459][106226] Updated weights for policy 0, policy_version 1913097 (0.0008) [2023-12-28 09:00:48,520][106226] Updated weights for policy 0, policy_version 1913107 (0.0009) [2023-12-28 09:00:48,579][106226] Updated weights for policy 0, policy_version 1913117 (0.0009) [2023-12-28 09:00:48,643][106226] Updated weights for policy 0, policy_version 1913127 (0.0009) [2023-12-28 09:00:48,828][106225] Updated weights for policy 1, policy_version 1917411 (0.0007) [2023-12-28 09:00:48,883][106225] Updated weights for policy 1, policy_version 1917421 (0.0005) [2023-12-28 09:00:48,946][106225] Updated weights for policy 1, policy_version 1917431 (0.0006) [2023-12-28 09:00:49,442][106226] Updated weights for policy 0, policy_version 1913137 (0.0008) [2023-12-28 09:00:49,501][106226] Updated weights for policy 0, policy_version 1913147 (0.0009) [2023-12-28 09:00:49,558][106226] Updated weights for policy 0, policy_version 1913157 (0.0009) [2023-12-28 09:00:49,642][106225] Updated weights for policy 1, policy_version 1917441 (0.0007) [2023-12-28 09:00:49,696][106225] Updated weights for policy 1, policy_version 1917451 (0.0007) [2023-12-28 09:00:49,751][106225] Updated weights for policy 1, policy_version 1917461 (0.0008) [2023-12-28 09:00:49,802][106225] Updated weights for policy 1, policy_version 1917471 (0.0008) [2023-12-28 09:00:50,272][106226] Updated weights for policy 0, policy_version 1913167 (0.0008) [2023-12-28 09:00:50,330][106226] Updated weights for policy 0, policy_version 1913177 (0.0007) [2023-12-28 09:00:50,396][106226] Updated weights for policy 0, policy_version 1913187 (0.0008) [2023-12-28 09:00:50,609][106225] Updated weights for policy 1, policy_version 1917481 (0.0009) [2023-12-28 09:00:50,666][106225] Updated weights for policy 1, policy_version 1917491 (0.0007) [2023-12-28 09:00:50,721][106225] Updated weights for policy 1, policy_version 1917501 (0.0008) [2023-12-28 09:00:51,095][106226] Updated weights for policy 0, policy_version 1913197 (0.0009) [2023-12-28 09:00:51,163][106226] Updated weights for policy 0, policy_version 1913207 (0.0011) [2023-12-28 09:00:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 980795392. Throughput: 0: 9792.1, 1: 9842.4. Samples: 980807244. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:00:51,175][105115] Avg episode reward: [(0, '-4.281'), (1, '-4.739')] [2023-12-28 09:00:51,220][106226] Updated weights for policy 0, policy_version 1913217 (0.0010) [2023-12-28 09:00:51,525][106225] Updated weights for policy 1, policy_version 1917511 (0.0006) [2023-12-28 09:00:51,587][106225] Updated weights for policy 1, policy_version 1917521 (0.0005) [2023-12-28 09:00:51,655][106225] Updated weights for policy 1, policy_version 1917531 (0.0006) [2023-12-28 09:00:51,996][106226] Updated weights for policy 0, policy_version 1913227 (0.0011) [2023-12-28 09:00:52,058][106226] Updated weights for policy 0, policy_version 1913237 (0.0009) [2023-12-28 09:00:52,114][106226] Updated weights for policy 0, policy_version 1913247 (0.0008) [2023-12-28 09:00:52,310][106225] Updated weights for policy 1, policy_version 1917541 (0.0006) [2023-12-28 09:00:52,378][106225] Updated weights for policy 1, policy_version 1917551 (0.0007) [2023-12-28 09:00:52,432][106225] Updated weights for policy 1, policy_version 1917561 (0.0008) [2023-12-28 09:00:52,862][106226] Updated weights for policy 0, policy_version 1913257 (0.0009) [2023-12-28 09:00:52,909][106226] Updated weights for policy 0, policy_version 1913267 (0.0010) [2023-12-28 09:00:52,955][106226] Updated weights for policy 0, policy_version 1913277 (0.0010) [2023-12-28 09:00:53,005][106226] Updated weights for policy 0, policy_version 1913287 (0.0010) [2023-12-28 09:00:53,134][106225] Updated weights for policy 1, policy_version 1917571 (0.0008) [2023-12-28 09:00:53,197][106225] Updated weights for policy 1, policy_version 1917581 (0.0008) [2023-12-28 09:00:53,247][106225] Updated weights for policy 1, policy_version 1917591 (0.0008) [2023-12-28 09:00:53,747][106226] Updated weights for policy 0, policy_version 1913297 (0.0011) [2023-12-28 09:00:53,801][106226] Updated weights for policy 0, policy_version 1913307 (0.0010) [2023-12-28 09:00:53,850][106226] Updated weights for policy 0, policy_version 1913317 (0.0010) [2023-12-28 09:00:53,959][106225] Updated weights for policy 1, policy_version 1917601 (0.0008) [2023-12-28 09:00:54,011][106225] Updated weights for policy 1, policy_version 1917611 (0.0007) [2023-12-28 09:00:54,058][106225] Updated weights for policy 1, policy_version 1917621 (0.0008) [2023-12-28 09:00:54,108][106225] Updated weights for policy 1, policy_version 1917631 (0.0008) [2023-12-28 09:00:54,582][106226] Updated weights for policy 0, policy_version 1913327 (0.0010) [2023-12-28 09:00:54,635][106226] Updated weights for policy 0, policy_version 1913337 (0.0010) [2023-12-28 09:00:54,689][106226] Updated weights for policy 0, policy_version 1913347 (0.0011) [2023-12-28 09:00:54,741][106225] Updated weights for policy 1, policy_version 1917641 (0.0008) [2023-12-28 09:00:54,801][106225] Updated weights for policy 1, policy_version 1917651 (0.0008) [2023-12-28 09:00:54,852][106225] Updated weights for policy 1, policy_version 1917661 (0.0008) [2023-12-28 09:00:55,417][106226] Updated weights for policy 0, policy_version 1913357 (0.0011) [2023-12-28 09:00:55,463][106226] Updated weights for policy 0, policy_version 1913367 (0.0010) [2023-12-28 09:00:55,488][106225] Updated weights for policy 1, policy_version 1917671 (0.0006) [2023-12-28 09:00:55,523][106226] Updated weights for policy 0, policy_version 1913377 (0.0010) [2023-12-28 09:00:55,545][106225] Updated weights for policy 1, policy_version 1917681 (0.0009) [2023-12-28 09:00:55,600][106225] Updated weights for policy 1, policy_version 1917691 (0.0008) [2023-12-28 09:00:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 980893696. Throughput: 0: 9811.6, 1: 9799.1. Samples: 980864912. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:00:56,175][105115] Avg episode reward: [(0, '-4.587'), (1, '-4.394')] [2023-12-28 09:00:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001917696_490987520.pth... [2023-12-28 09:00:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001913384_489906176.pth... [2023-12-28 09:00:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001916544_490692608.pth [2023-12-28 09:00:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001912232_489611264.pth [2023-12-28 09:00:56,243][106226] Updated weights for policy 0, policy_version 1913387 (0.0010) [2023-12-28 09:00:56,296][106226] Updated weights for policy 0, policy_version 1913397 (0.0010) [2023-12-28 09:00:56,327][106225] Updated weights for policy 1, policy_version 1917701 (0.0006) [2023-12-28 09:00:56,352][106226] Updated weights for policy 0, policy_version 1913407 (0.0010) [2023-12-28 09:00:56,381][106225] Updated weights for policy 1, policy_version 1917711 (0.0006) [2023-12-28 09:00:56,434][106225] Updated weights for policy 1, policy_version 1917721 (0.0007) [2023-12-28 09:00:57,088][106226] Updated weights for policy 0, policy_version 1913417 (0.0010) [2023-12-28 09:00:57,148][106226] Updated weights for policy 0, policy_version 1913427 (0.0011) [2023-12-28 09:00:57,162][106225] Updated weights for policy 1, policy_version 1917731 (0.0007) [2023-12-28 09:00:57,202][106226] Updated weights for policy 0, policy_version 1913437 (0.0010) [2023-12-28 09:00:57,219][106225] Updated weights for policy 1, policy_version 1917741 (0.0005) [2023-12-28 09:00:57,257][106226] Updated weights for policy 0, policy_version 1913447 (0.0008) [2023-12-28 09:00:57,273][106225] Updated weights for policy 1, policy_version 1917751 (0.0008) [2023-12-28 09:00:57,980][106226] Updated weights for policy 0, policy_version 1913457 (0.0008) [2023-12-28 09:00:58,009][106225] Updated weights for policy 1, policy_version 1917761 (0.0008) [2023-12-28 09:00:58,036][106226] Updated weights for policy 0, policy_version 1913467 (0.0007) [2023-12-28 09:00:58,057][106225] Updated weights for policy 1, policy_version 1917771 (0.0007) [2023-12-28 09:00:58,097][106226] Updated weights for policy 0, policy_version 1913477 (0.0009) [2023-12-28 09:00:58,110][106225] Updated weights for policy 1, policy_version 1917781 (0.0007) [2023-12-28 09:00:58,161][106225] Updated weights for policy 1, policy_version 1917791 (0.0008) [2023-12-28 09:00:58,965][106226] Updated weights for policy 0, policy_version 1913487 (0.0009) [2023-12-28 09:00:58,981][106225] Updated weights for policy 1, policy_version 1917801 (0.0008) [2023-12-28 09:00:59,024][106226] Updated weights for policy 0, policy_version 1913497 (0.0008) [2023-12-28 09:00:59,039][106225] Updated weights for policy 1, policy_version 1917811 (0.0007) [2023-12-28 09:00:59,088][106226] Updated weights for policy 0, policy_version 1913507 (0.0007) [2023-12-28 09:00:59,098][106225] Updated weights for policy 1, policy_version 1917821 (0.0008) [2023-12-28 09:00:59,839][106226] Updated weights for policy 0, policy_version 1913517 (0.0008) [2023-12-28 09:00:59,844][106225] Updated weights for policy 1, policy_version 1917831 (0.0007) [2023-12-28 09:00:59,905][106226] Updated weights for policy 0, policy_version 1913527 (0.0007) [2023-12-28 09:00:59,912][106225] Updated weights for policy 1, policy_version 1917841 (0.0006) [2023-12-28 09:00:59,971][106226] Updated weights for policy 0, policy_version 1913537 (0.0008) [2023-12-28 09:00:59,979][106225] Updated weights for policy 1, policy_version 1917851 (0.0007) [2023-12-28 09:01:00,635][106225] Updated weights for policy 1, policy_version 1917861 (0.0008) [2023-12-28 09:01:00,683][106225] Updated weights for policy 1, policy_version 1917871 (0.0008) [2023-12-28 09:01:00,735][106226] Updated weights for policy 0, policy_version 1913547 (0.0008) [2023-12-28 09:01:00,735][106225] Updated weights for policy 1, policy_version 1917881 (0.0008) [2023-12-28 09:01:00,790][106226] Updated weights for policy 0, policy_version 1913557 (0.0007) [2023-12-28 09:01:00,835][106226] Updated weights for policy 0, policy_version 1913567 (0.0008) [2023-12-28 09:01:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.2, 300 sec: 19744.1). Total num frames: 980992000. Throughput: 0: 9732.8, 1: 9847.8. Samples: 980980168. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:01,175][105115] Avg episode reward: [(0, '-4.144'), (1, '-4.724')] [2023-12-28 09:01:01,492][106225] Updated weights for policy 1, policy_version 1917891 (0.0008) [2023-12-28 09:01:01,553][106225] Updated weights for policy 1, policy_version 1917901 (0.0009) [2023-12-28 09:01:01,618][106225] Updated weights for policy 1, policy_version 1917911 (0.0010) [2023-12-28 09:01:01,632][106226] Updated weights for policy 0, policy_version 1913577 (0.0008) [2023-12-28 09:01:01,690][106226] Updated weights for policy 0, policy_version 1913587 (0.0008) [2023-12-28 09:01:01,755][106226] Updated weights for policy 0, policy_version 1913597 (0.0008) [2023-12-28 09:01:01,820][106226] Updated weights for policy 0, policy_version 1913607 (0.0008) [2023-12-28 09:01:02,280][106225] Updated weights for policy 1, policy_version 1917921 (0.0009) [2023-12-28 09:01:02,344][106225] Updated weights for policy 1, policy_version 1917931 (0.0006) [2023-12-28 09:01:02,411][106225] Updated weights for policy 1, policy_version 1917941 (0.0009) [2023-12-28 09:01:02,475][106225] Updated weights for policy 1, policy_version 1917951 (0.0008) [2023-12-28 09:01:02,598][106226] Updated weights for policy 0, policy_version 1913617 (0.0009) [2023-12-28 09:01:02,655][106226] Updated weights for policy 0, policy_version 1913627 (0.0009) [2023-12-28 09:01:02,712][106226] Updated weights for policy 0, policy_version 1913637 (0.0009) [2023-12-28 09:01:03,126][106225] Updated weights for policy 1, policy_version 1917961 (0.0008) [2023-12-28 09:01:03,173][106225] Updated weights for policy 1, policy_version 1917971 (0.0008) [2023-12-28 09:01:03,228][106225] Updated weights for policy 1, policy_version 1917981 (0.0009) [2023-12-28 09:01:03,469][106226] Updated weights for policy 0, policy_version 1913647 (0.0009) [2023-12-28 09:01:03,524][106226] Updated weights for policy 0, policy_version 1913657 (0.0008) [2023-12-28 09:01:03,571][106226] Updated weights for policy 0, policy_version 1913667 (0.0007) [2023-12-28 09:01:03,994][106225] Updated weights for policy 1, policy_version 1917991 (0.0008) [2023-12-28 09:01:04,056][106225] Updated weights for policy 1, policy_version 1918001 (0.0008) [2023-12-28 09:01:04,120][106225] Updated weights for policy 1, policy_version 1918011 (0.0007) [2023-12-28 09:01:04,277][106226] Updated weights for policy 0, policy_version 1913677 (0.0007) [2023-12-28 09:01:04,338][106226] Updated weights for policy 0, policy_version 1913687 (0.0009) [2023-12-28 09:01:04,395][106226] Updated weights for policy 0, policy_version 1913697 (0.0009) [2023-12-28 09:01:04,807][106225] Updated weights for policy 1, policy_version 1918021 (0.0007) [2023-12-28 09:01:04,862][106225] Updated weights for policy 1, policy_version 1918031 (0.0008) [2023-12-28 09:01:04,910][106225] Updated weights for policy 1, policy_version 1918041 (0.0008) [2023-12-28 09:01:05,173][106226] Updated weights for policy 0, policy_version 1913707 (0.0009) [2023-12-28 09:01:05,233][106226] Updated weights for policy 0, policy_version 1913717 (0.0009) [2023-12-28 09:01:05,290][106226] Updated weights for policy 0, policy_version 1913727 (0.0008) [2023-12-28 09:01:05,609][106225] Updated weights for policy 1, policy_version 1918051 (0.0008) [2023-12-28 09:01:05,670][106225] Updated weights for policy 1, policy_version 1918061 (0.0009) [2023-12-28 09:01:05,717][106225] Updated weights for policy 1, policy_version 1918071 (0.0008) [2023-12-28 09:01:06,023][106226] Updated weights for policy 0, policy_version 1913737 (0.0009) [2023-12-28 09:01:06,073][106226] Updated weights for policy 0, policy_version 1913747 (0.0009) [2023-12-28 09:01:06,143][106226] Updated weights for policy 0, policy_version 1913757 (0.0009) [2023-12-28 09:01:06,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19387.7, 300 sec: 19716.3). Total num frames: 981082112. Throughput: 0: 9719.6, 1: 9812.3. Samples: 981095496. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:06,175][105115] Avg episode reward: [(0, '-4.496'), (1, '-4.347')] [2023-12-28 09:01:06,201][106226] Updated weights for policy 0, policy_version 1913767 (0.0010) [2023-12-28 09:01:06,419][106225] Updated weights for policy 1, policy_version 1918081 (0.0008) [2023-12-28 09:01:06,486][106225] Updated weights for policy 1, policy_version 1918091 (0.0007) [2023-12-28 09:01:06,556][106225] Updated weights for policy 1, policy_version 1918101 (0.0006) [2023-12-28 09:01:06,625][106225] Updated weights for policy 1, policy_version 1918111 (0.0006) [2023-12-28 09:01:06,983][106226] Updated weights for policy 0, policy_version 1913777 (0.0006) [2023-12-28 09:01:07,045][106226] Updated weights for policy 0, policy_version 1913787 (0.0005) [2023-12-28 09:01:07,107][106226] Updated weights for policy 0, policy_version 1913797 (0.0008) [2023-12-28 09:01:07,265][106225] Updated weights for policy 1, policy_version 1918121 (0.0006) [2023-12-28 09:01:07,314][106225] Updated weights for policy 1, policy_version 1918131 (0.0008) [2023-12-28 09:01:07,377][106225] Updated weights for policy 1, policy_version 1918141 (0.0008) [2023-12-28 09:01:07,830][106226] Updated weights for policy 0, policy_version 1913807 (0.0009) [2023-12-28 09:01:07,891][106226] Updated weights for policy 0, policy_version 1913817 (0.0009) [2023-12-28 09:01:07,940][106226] Updated weights for policy 0, policy_version 1913827 (0.0007) [2023-12-28 09:01:07,973][106225] Updated weights for policy 1, policy_version 1918151 (0.0008) [2023-12-28 09:01:08,035][106225] Updated weights for policy 1, policy_version 1918161 (0.0010) [2023-12-28 09:01:08,084][106225] Updated weights for policy 1, policy_version 1918171 (0.0009) [2023-12-28 09:01:08,645][106226] Updated weights for policy 0, policy_version 1913837 (0.0008) [2023-12-28 09:01:08,705][106226] Updated weights for policy 0, policy_version 1913847 (0.0011) [2023-12-28 09:01:08,769][106226] Updated weights for policy 0, policy_version 1913857 (0.0011) [2023-12-28 09:01:08,847][106225] Updated weights for policy 1, policy_version 1918181 (0.0008) [2023-12-28 09:01:08,914][106225] Updated weights for policy 1, policy_version 1918191 (0.0008) [2023-12-28 09:01:08,970][106225] Updated weights for policy 1, policy_version 1918201 (0.0009) [2023-12-28 09:01:09,507][106226] Updated weights for policy 0, policy_version 1913867 (0.0011) [2023-12-28 09:01:09,558][106226] Updated weights for policy 0, policy_version 1913877 (0.0009) [2023-12-28 09:01:09,614][106226] Updated weights for policy 0, policy_version 1913887 (0.0008) [2023-12-28 09:01:09,698][106225] Updated weights for policy 1, policy_version 1918211 (0.0008) [2023-12-28 09:01:09,757][106225] Updated weights for policy 1, policy_version 1918221 (0.0008) [2023-12-28 09:01:09,832][106225] Updated weights for policy 1, policy_version 1918231 (0.0008) [2023-12-28 09:01:10,371][106226] Updated weights for policy 0, policy_version 1913897 (0.0009) [2023-12-28 09:01:10,434][106226] Updated weights for policy 0, policy_version 1913907 (0.0009) [2023-12-28 09:01:10,494][106226] Updated weights for policy 0, policy_version 1913917 (0.0009) [2023-12-28 09:01:10,555][106226] Updated weights for policy 0, policy_version 1913927 (0.0008) [2023-12-28 09:01:10,624][106225] Updated weights for policy 1, policy_version 1918241 (0.0008) [2023-12-28 09:01:10,682][106225] Updated weights for policy 1, policy_version 1918251 (0.0010) [2023-12-28 09:01:10,727][106225] Updated weights for policy 1, policy_version 1918261 (0.0008) [2023-12-28 09:01:10,775][106225] Updated weights for policy 1, policy_version 1918271 (0.0008) [2023-12-28 09:01:11,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 981180416. Throughput: 0: 9723.8, 1: 9874.2. Samples: 981155028. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:11,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.838')] [2023-12-28 09:01:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001918272_491134976.pth... [2023-12-28 09:01:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001913928_490045440.pth... [2023-12-28 09:01:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001912808_489758720.pth [2023-12-28 09:01:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001917120_490840064.pth [2023-12-28 09:01:11,304][106226] Updated weights for policy 0, policy_version 1913937 (0.0008) [2023-12-28 09:01:11,361][106226] Updated weights for policy 0, policy_version 1913947 (0.0008) [2023-12-28 09:01:11,430][106226] Updated weights for policy 0, policy_version 1913957 (0.0008) [2023-12-28 09:01:11,535][106225] Updated weights for policy 1, policy_version 1918281 (0.0008) [2023-12-28 09:01:11,600][106225] Updated weights for policy 1, policy_version 1918291 (0.0009) [2023-12-28 09:01:11,666][106225] Updated weights for policy 1, policy_version 1918301 (0.0009) [2023-12-28 09:01:12,111][106226] Updated weights for policy 0, policy_version 1913967 (0.0009) [2023-12-28 09:01:12,162][106226] Updated weights for policy 0, policy_version 1913977 (0.0008) [2023-12-28 09:01:12,220][106226] Updated weights for policy 0, policy_version 1913987 (0.0008) [2023-12-28 09:01:12,464][106225] Updated weights for policy 1, policy_version 1918311 (0.0010) [2023-12-28 09:01:12,524][106225] Updated weights for policy 1, policy_version 1918321 (0.0010) [2023-12-28 09:01:12,585][106225] Updated weights for policy 1, policy_version 1918331 (0.0008) [2023-12-28 09:01:12,981][106226] Updated weights for policy 0, policy_version 1913997 (0.0009) [2023-12-28 09:01:13,031][106226] Updated weights for policy 0, policy_version 1914007 (0.0009) [2023-12-28 09:01:13,081][106226] Updated weights for policy 0, policy_version 1914017 (0.0007) [2023-12-28 09:01:13,243][106225] Updated weights for policy 1, policy_version 1918341 (0.0005) [2023-12-28 09:01:13,310][106225] Updated weights for policy 1, policy_version 1918351 (0.0009) [2023-12-28 09:01:13,374][106225] Updated weights for policy 1, policy_version 1918361 (0.0010) [2023-12-28 09:01:13,748][106226] Updated weights for policy 0, policy_version 1914027 (0.0007) [2023-12-28 09:01:13,802][106226] Updated weights for policy 0, policy_version 1914037 (0.0005) [2023-12-28 09:01:13,853][106226] Updated weights for policy 0, policy_version 1914047 (0.0005) [2023-12-28 09:01:13,939][106225] Updated weights for policy 1, policy_version 1918371 (0.0009) [2023-12-28 09:01:14,002][106225] Updated weights for policy 1, policy_version 1918381 (0.0005) [2023-12-28 09:01:14,057][106225] Updated weights for policy 1, policy_version 1918391 (0.0006) [2023-12-28 09:01:14,409][106226] Updated weights for policy 0, policy_version 1914057 (0.0006) [2023-12-28 09:01:14,456][106226] Updated weights for policy 0, policy_version 1914067 (0.0010) [2023-12-28 09:01:14,506][106226] Updated weights for policy 0, policy_version 1914077 (0.0010) [2023-12-28 09:01:14,558][106226] Updated weights for policy 0, policy_version 1914087 (0.0010) [2023-12-28 09:01:14,668][106225] Updated weights for policy 1, policy_version 1918401 (0.0006) [2023-12-28 09:01:14,738][106225] Updated weights for policy 1, policy_version 1918411 (0.0006) [2023-12-28 09:01:14,807][106225] Updated weights for policy 1, policy_version 1918421 (0.0014) [2023-12-28 09:01:14,871][106225] Updated weights for policy 1, policy_version 1918431 (0.0010) [2023-12-28 09:01:15,280][106226] Updated weights for policy 0, policy_version 1914097 (0.0008) [2023-12-28 09:01:15,342][106226] Updated weights for policy 0, policy_version 1914107 (0.0008) [2023-12-28 09:01:15,400][106226] Updated weights for policy 0, policy_version 1914117 (0.0008) [2023-12-28 09:01:15,555][106225] Updated weights for policy 1, policy_version 1918441 (0.0010) [2023-12-28 09:01:15,613][106225] Updated weights for policy 1, policy_version 1918451 (0.0010) [2023-12-28 09:01:15,671][106225] Updated weights for policy 1, policy_version 1918461 (0.0008) [2023-12-28 09:01:16,073][106226] Updated weights for policy 0, policy_version 1914127 (0.0008) [2023-12-28 09:01:16,122][106226] Updated weights for policy 0, policy_version 1914137 (0.0010) [2023-12-28 09:01:16,172][106226] Updated weights for policy 0, policy_version 1914147 (0.0010) [2023-12-28 09:01:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19524.2, 300 sec: 19716.3). Total num frames: 981278720. Throughput: 0: 9760.4, 1: 9877.9. Samples: 981273572. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:16,176][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.685')] [2023-12-28 09:01:16,392][106225] Updated weights for policy 1, policy_version 1918471 (0.0006) [2023-12-28 09:01:16,456][106225] Updated weights for policy 1, policy_version 1918481 (0.0008) [2023-12-28 09:01:16,521][106225] Updated weights for policy 1, policy_version 1918491 (0.0008) [2023-12-28 09:01:16,812][106226] Updated weights for policy 0, policy_version 1914157 (0.0008) [2023-12-28 09:01:16,870][106226] Updated weights for policy 0, policy_version 1914167 (0.0009) [2023-12-28 09:01:16,924][106226] Updated weights for policy 0, policy_version 1914177 (0.0011) [2023-12-28 09:01:17,071][106225] Updated weights for policy 1, policy_version 1918501 (0.0007) [2023-12-28 09:01:17,138][106225] Updated weights for policy 1, policy_version 1918511 (0.0007) [2023-12-28 09:01:17,202][106225] Updated weights for policy 1, policy_version 1918521 (0.0008) [2023-12-28 09:01:17,500][106226] Updated weights for policy 0, policy_version 1914187 (0.0007) [2023-12-28 09:01:17,551][106226] Updated weights for policy 0, policy_version 1914197 (0.0005) [2023-12-28 09:01:17,597][106226] Updated weights for policy 0, policy_version 1914207 (0.0005) [2023-12-28 09:01:17,832][106225] Updated weights for policy 1, policy_version 1918531 (0.0009) [2023-12-28 09:01:17,890][106225] Updated weights for policy 1, policy_version 1918541 (0.0009) [2023-12-28 09:01:17,947][106225] Updated weights for policy 1, policy_version 1918551 (0.0010) [2023-12-28 09:01:18,218][106226] Updated weights for policy 0, policy_version 1914217 (0.0007) [2023-12-28 09:01:18,284][106226] Updated weights for policy 0, policy_version 1914227 (0.0006) [2023-12-28 09:01:18,342][106226] Updated weights for policy 0, policy_version 1914237 (0.0010) [2023-12-28 09:01:18,410][106226] Updated weights for policy 0, policy_version 1914247 (0.0009) [2023-12-28 09:01:18,657][106225] Updated weights for policy 1, policy_version 1918561 (0.0011) [2023-12-28 09:01:18,722][106225] Updated weights for policy 1, policy_version 1918571 (0.0010) [2023-12-28 09:01:18,793][106225] Updated weights for policy 1, policy_version 1918581 (0.0011) [2023-12-28 09:01:18,862][106225] Updated weights for policy 1, policy_version 1918591 (0.0011) [2023-12-28 09:01:18,962][106226] Updated weights for policy 0, policy_version 1914257 (0.0008) [2023-12-28 09:01:19,023][106226] Updated weights for policy 0, policy_version 1914267 (0.0008) [2023-12-28 09:01:19,082][106226] Updated weights for policy 0, policy_version 1914277 (0.0007) [2023-12-28 09:01:19,582][106225] Updated weights for policy 1, policy_version 1918601 (0.0007) [2023-12-28 09:01:19,648][106225] Updated weights for policy 1, policy_version 1918611 (0.0007) [2023-12-28 09:01:19,717][106225] Updated weights for policy 1, policy_version 1918621 (0.0006) [2023-12-28 09:01:19,812][106226] Updated weights for policy 0, policy_version 1914287 (0.0006) [2023-12-28 09:01:19,888][106226] Updated weights for policy 0, policy_version 1914297 (0.0007) [2023-12-28 09:01:19,955][106226] Updated weights for policy 0, policy_version 1914307 (0.0007) [2023-12-28 09:01:20,410][106225] Updated weights for policy 1, policy_version 1918631 (0.0008) [2023-12-28 09:01:20,479][106225] Updated weights for policy 1, policy_version 1918641 (0.0008) [2023-12-28 09:01:20,527][106226] Updated weights for policy 0, policy_version 1914317 (0.0008) [2023-12-28 09:01:20,542][106225] Updated weights for policy 1, policy_version 1918651 (0.0007) [2023-12-28 09:01:20,599][106226] Updated weights for policy 0, policy_version 1914327 (0.0008) [2023-12-28 09:01:20,652][106226] Updated weights for policy 0, policy_version 1914337 (0.0008) [2023-12-28 09:01:21,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 981385216. Throughput: 0: 9826.6, 1: 9882.9. Samples: 981397380. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:21,175][105115] Avg episode reward: [(0, '-4.016'), (1, '-4.588')] [2023-12-28 09:01:21,239][106225] Updated weights for policy 1, policy_version 1918661 (0.0009) [2023-12-28 09:01:21,306][106225] Updated weights for policy 1, policy_version 1918671 (0.0011) [2023-12-28 09:01:21,383][106225] Updated weights for policy 1, policy_version 1918681 (0.0011) [2023-12-28 09:01:21,408][106226] Updated weights for policy 0, policy_version 1914347 (0.0008) [2023-12-28 09:01:21,464][106226] Updated weights for policy 0, policy_version 1914357 (0.0008) [2023-12-28 09:01:21,517][106226] Updated weights for policy 0, policy_version 1914367 (0.0008) [2023-12-28 09:01:22,036][106225] Updated weights for policy 1, policy_version 1918691 (0.0008) [2023-12-28 09:01:22,103][106225] Updated weights for policy 1, policy_version 1918701 (0.0008) [2023-12-28 09:01:22,168][106225] Updated weights for policy 1, policy_version 1918711 (0.0009) [2023-12-28 09:01:22,357][106226] Updated weights for policy 0, policy_version 1914377 (0.0008) [2023-12-28 09:01:22,427][106226] Updated weights for policy 0, policy_version 1914387 (0.0010) [2023-12-28 09:01:22,493][106226] Updated weights for policy 0, policy_version 1914397 (0.0010) [2023-12-28 09:01:22,555][106226] Updated weights for policy 0, policy_version 1914407 (0.0009) [2023-12-28 09:01:22,815][106225] Updated weights for policy 1, policy_version 1918721 (0.0007) [2023-12-28 09:01:22,874][106225] Updated weights for policy 1, policy_version 1918731 (0.0008) [2023-12-28 09:01:22,922][106225] Updated weights for policy 1, policy_version 1918741 (0.0008) [2023-12-28 09:01:22,983][106225] Updated weights for policy 1, policy_version 1918751 (0.0008) [2023-12-28 09:01:23,346][106226] Updated weights for policy 0, policy_version 1914417 (0.0009) [2023-12-28 09:01:23,409][106226] Updated weights for policy 0, policy_version 1914427 (0.0007) [2023-12-28 09:01:23,470][106226] Updated weights for policy 0, policy_version 1914437 (0.0006) [2023-12-28 09:01:23,620][106225] Updated weights for policy 1, policy_version 1918761 (0.0008) [2023-12-28 09:01:23,681][106225] Updated weights for policy 1, policy_version 1918771 (0.0008) [2023-12-28 09:01:23,745][106225] Updated weights for policy 1, policy_version 1918781 (0.0006) [2023-12-28 09:01:24,202][106226] Updated weights for policy 0, policy_version 1914447 (0.0010) [2023-12-28 09:01:24,266][106226] Updated weights for policy 0, policy_version 1914457 (0.0008) [2023-12-28 09:01:24,297][106225] Updated weights for policy 1, policy_version 1918791 (0.0007) [2023-12-28 09:01:24,327][106226] Updated weights for policy 0, policy_version 1914467 (0.0006) [2023-12-28 09:01:24,356][106225] Updated weights for policy 1, policy_version 1918801 (0.0006) [2023-12-28 09:01:24,413][106225] Updated weights for policy 1, policy_version 1918811 (0.0005) [2023-12-28 09:01:25,003][106226] Updated weights for policy 0, policy_version 1914477 (0.0007) [2023-12-28 09:01:25,041][106225] Updated weights for policy 1, policy_version 1918821 (0.0005) [2023-12-28 09:01:25,060][106226] Updated weights for policy 0, policy_version 1914487 (0.0007) [2023-12-28 09:01:25,093][106225] Updated weights for policy 1, policy_version 1918831 (0.0007) [2023-12-28 09:01:25,116][106226] Updated weights for policy 0, policy_version 1914497 (0.0005) [2023-12-28 09:01:25,149][106225] Updated weights for policy 1, policy_version 1918841 (0.0008) [2023-12-28 09:01:25,732][106226] Updated weights for policy 0, policy_version 1914507 (0.0005) [2023-12-28 09:01:25,796][106226] Updated weights for policy 0, policy_version 1914517 (0.0006) [2023-12-28 09:01:25,841][106226] Updated weights for policy 0, policy_version 1914527 (0.0008) [2023-12-28 09:01:25,901][106225] Updated weights for policy 1, policy_version 1918851 (0.0008) [2023-12-28 09:01:25,963][106225] Updated weights for policy 1, policy_version 1918861 (0.0009) [2023-12-28 09:01:26,027][106225] Updated weights for policy 1, policy_version 1918871 (0.0009) [2023-12-28 09:01:26,175][105115] Fps is (10 sec: 21299.5, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 981491712. Throughput: 0: 9723.9, 1: 9918.6. Samples: 981454416. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:26,175][105115] Avg episode reward: [(0, '-4.474'), (1, '-4.754')] [2023-12-28 09:01:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001918880_491290624.pth... [2023-12-28 09:01:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001914536_490201088.pth... [2023-12-28 09:01:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001917696_490987520.pth [2023-12-28 09:01:26,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001913384_489906176.pth [2023-12-28 09:01:26,584][106226] Updated weights for policy 0, policy_version 1914537 (0.0009) [2023-12-28 09:01:26,634][106225] Updated weights for policy 1, policy_version 1918881 (0.0009) [2023-12-28 09:01:26,636][106226] Updated weights for policy 0, policy_version 1914547 (0.0007) [2023-12-28 09:01:26,685][106225] Updated weights for policy 1, policy_version 1918891 (0.0006) [2023-12-28 09:01:26,691][106226] Updated weights for policy 0, policy_version 1914557 (0.0008) [2023-12-28 09:01:26,733][106225] Updated weights for policy 1, policy_version 1918901 (0.0007) [2023-12-28 09:01:26,739][106226] Updated weights for policy 0, policy_version 1914567 (0.0006) [2023-12-28 09:01:26,787][106225] Updated weights for policy 1, policy_version 1918911 (0.0007) [2023-12-28 09:01:27,444][106226] Updated weights for policy 0, policy_version 1914577 (0.0006) [2023-12-28 09:01:27,510][106226] Updated weights for policy 0, policy_version 1914587 (0.0006) [2023-12-28 09:01:27,533][106225] Updated weights for policy 1, policy_version 1918921 (0.0005) [2023-12-28 09:01:27,576][106226] Updated weights for policy 0, policy_version 1914597 (0.0006) [2023-12-28 09:01:27,597][106225] Updated weights for policy 1, policy_version 1918931 (0.0008) [2023-12-28 09:01:27,657][106225] Updated weights for policy 1, policy_version 1918941 (0.0009) [2023-12-28 09:01:28,103][106226] Updated weights for policy 0, policy_version 1914607 (0.0005) [2023-12-28 09:01:28,155][106226] Updated weights for policy 0, policy_version 1914617 (0.0005) [2023-12-28 09:01:28,218][106226] Updated weights for policy 0, policy_version 1914627 (0.0005) [2023-12-28 09:01:28,364][106225] Updated weights for policy 1, policy_version 1918951 (0.0009) [2023-12-28 09:01:28,413][106225] Updated weights for policy 1, policy_version 1918961 (0.0009) [2023-12-28 09:01:28,471][106225] Updated weights for policy 1, policy_version 1918971 (0.0006) [2023-12-28 09:01:28,923][106226] Updated weights for policy 0, policy_version 1914637 (0.0007) [2023-12-28 09:01:28,981][106226] Updated weights for policy 0, policy_version 1914647 (0.0008) [2023-12-28 09:01:29,039][106226] Updated weights for policy 0, policy_version 1914657 (0.0008) [2023-12-28 09:01:29,150][106225] Updated weights for policy 1, policy_version 1918981 (0.0006) [2023-12-28 09:01:29,205][106225] Updated weights for policy 1, policy_version 1918991 (0.0007) [2023-12-28 09:01:29,272][106225] Updated weights for policy 1, policy_version 1919001 (0.0011) [2023-12-28 09:01:29,834][106226] Updated weights for policy 0, policy_version 1914667 (0.0009) [2023-12-28 09:01:29,897][106226] Updated weights for policy 0, policy_version 1914677 (0.0008) [2023-12-28 09:01:29,959][106226] Updated weights for policy 0, policy_version 1914687 (0.0008) [2023-12-28 09:01:29,985][106225] Updated weights for policy 1, policy_version 1919011 (0.0009) [2023-12-28 09:01:30,037][106225] Updated weights for policy 1, policy_version 1919021 (0.0007) [2023-12-28 09:01:30,084][106225] Updated weights for policy 1, policy_version 1919031 (0.0007) [2023-12-28 09:01:30,592][106226] Updated weights for policy 0, policy_version 1914697 (0.0008) [2023-12-28 09:01:30,641][106226] Updated weights for policy 0, policy_version 1914707 (0.0008) [2023-12-28 09:01:30,692][106226] Updated weights for policy 0, policy_version 1914717 (0.0005) [2023-12-28 09:01:30,741][106226] Updated weights for policy 0, policy_version 1914727 (0.0005) [2023-12-28 09:01:30,860][106225] Updated weights for policy 1, policy_version 1919041 (0.0006) [2023-12-28 09:01:30,913][106225] Updated weights for policy 1, policy_version 1919051 (0.0005) [2023-12-28 09:01:30,963][106225] Updated weights for policy 1, policy_version 1919061 (0.0006) [2023-12-28 09:01:31,011][106225] Updated weights for policy 1, policy_version 1919071 (0.0006) [2023-12-28 09:01:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 981590016. Throughput: 0: 9781.3, 1: 10017.5. Samples: 981577408. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:31,175][105115] Avg episode reward: [(0, '-4.357'), (1, '-4.641')] [2023-12-28 09:01:31,474][106226] Updated weights for policy 0, policy_version 1914737 (0.0006) [2023-12-28 09:01:31,533][106226] Updated weights for policy 0, policy_version 1914747 (0.0006) [2023-12-28 09:01:31,589][106226] Updated weights for policy 0, policy_version 1914757 (0.0006) [2023-12-28 09:01:31,703][106225] Updated weights for policy 1, policy_version 1919081 (0.0007) [2023-12-28 09:01:31,776][106225] Updated weights for policy 1, policy_version 1919091 (0.0007) [2023-12-28 09:01:31,833][106225] Updated weights for policy 1, policy_version 1919101 (0.0006) [2023-12-28 09:01:32,207][106226] Updated weights for policy 0, policy_version 1914767 (0.0009) [2023-12-28 09:01:32,271][106226] Updated weights for policy 0, policy_version 1914777 (0.0008) [2023-12-28 09:01:32,327][106226] Updated weights for policy 0, policy_version 1914787 (0.0008) [2023-12-28 09:01:32,434][106225] Updated weights for policy 1, policy_version 1919111 (0.0007) [2023-12-28 09:01:32,485][106225] Updated weights for policy 1, policy_version 1919121 (0.0007) [2023-12-28 09:01:32,543][106225] Updated weights for policy 1, policy_version 1919131 (0.0006) [2023-12-28 09:01:33,108][106225] Updated weights for policy 1, policy_version 1919141 (0.0006) [2023-12-28 09:01:33,146][106226] Updated weights for policy 0, policy_version 1914797 (0.0008) [2023-12-28 09:01:33,168][106225] Updated weights for policy 1, policy_version 1919151 (0.0006) [2023-12-28 09:01:33,202][106226] Updated weights for policy 0, policy_version 1914807 (0.0007) [2023-12-28 09:01:33,228][106225] Updated weights for policy 1, policy_version 1919161 (0.0005) [2023-12-28 09:01:33,262][106226] Updated weights for policy 0, policy_version 1914817 (0.0008) [2023-12-28 09:01:33,778][106225] Updated weights for policy 1, policy_version 1919171 (0.0005) [2023-12-28 09:01:33,843][106225] Updated weights for policy 1, policy_version 1919181 (0.0005) [2023-12-28 09:01:33,900][106225] Updated weights for policy 1, policy_version 1919191 (0.0006) [2023-12-28 09:01:34,036][106226] Updated weights for policy 0, policy_version 1914827 (0.0009) [2023-12-28 09:01:34,087][106226] Updated weights for policy 0, policy_version 1914837 (0.0010) [2023-12-28 09:01:34,144][106226] Updated weights for policy 0, policy_version 1914847 (0.0006) [2023-12-28 09:01:34,538][106225] Updated weights for policy 1, policy_version 1919201 (0.0008) [2023-12-28 09:01:34,589][106225] Updated weights for policy 1, policy_version 1919211 (0.0008) [2023-12-28 09:01:34,649][106225] Updated weights for policy 1, policy_version 1919221 (0.0008) [2023-12-28 09:01:34,705][106225] Updated weights for policy 1, policy_version 1919231 (0.0008) [2023-12-28 09:01:34,856][106226] Updated weights for policy 0, policy_version 1914857 (0.0010) [2023-12-28 09:01:34,916][106226] Updated weights for policy 0, policy_version 1914867 (0.0011) [2023-12-28 09:01:34,976][106226] Updated weights for policy 0, policy_version 1914877 (0.0010) [2023-12-28 09:01:35,038][106226] Updated weights for policy 0, policy_version 1914887 (0.0009) [2023-12-28 09:01:35,457][106225] Updated weights for policy 1, policy_version 1919241 (0.0008) [2023-12-28 09:01:35,520][106225] Updated weights for policy 1, policy_version 1919251 (0.0007) [2023-12-28 09:01:35,575][106225] Updated weights for policy 1, policy_version 1919261 (0.0008) [2023-12-28 09:01:35,743][106226] Updated weights for policy 0, policy_version 1914897 (0.0011) [2023-12-28 09:01:35,793][106226] Updated weights for policy 0, policy_version 1914907 (0.0010) [2023-12-28 09:01:35,853][106226] Updated weights for policy 0, policy_version 1914917 (0.0010) [2023-12-28 09:01:36,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 981688320. Throughput: 0: 9734.5, 1: 10059.5. Samples: 981697972. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:36,175][105115] Avg episode reward: [(0, '-4.297'), (1, '-4.720')] [2023-12-28 09:01:36,211][106225] Updated weights for policy 1, policy_version 1919271 (0.0008) [2023-12-28 09:01:36,270][106225] Updated weights for policy 1, policy_version 1919281 (0.0008) [2023-12-28 09:01:36,327][106225] Updated weights for policy 1, policy_version 1919291 (0.0009) [2023-12-28 09:01:36,620][106226] Updated weights for policy 0, policy_version 1914927 (0.0011) [2023-12-28 09:01:36,680][106226] Updated weights for policy 0, policy_version 1914937 (0.0010) [2023-12-28 09:01:36,741][106226] Updated weights for policy 0, policy_version 1914947 (0.0011) [2023-12-28 09:01:37,039][106225] Updated weights for policy 1, policy_version 1919301 (0.0007) [2023-12-28 09:01:37,103][106225] Updated weights for policy 1, policy_version 1919311 (0.0007) [2023-12-28 09:01:37,166][106225] Updated weights for policy 1, policy_version 1919321 (0.0011) [2023-12-28 09:01:37,454][106226] Updated weights for policy 0, policy_version 1914957 (0.0010) [2023-12-28 09:01:37,515][106226] Updated weights for policy 0, policy_version 1914967 (0.0010) [2023-12-28 09:01:37,579][106226] Updated weights for policy 0, policy_version 1914977 (0.0010) [2023-12-28 09:01:37,881][106225] Updated weights for policy 1, policy_version 1919331 (0.0009) [2023-12-28 09:01:37,926][106225] Updated weights for policy 1, policy_version 1919341 (0.0008) [2023-12-28 09:01:37,985][106225] Updated weights for policy 1, policy_version 1919351 (0.0008) [2023-12-28 09:01:38,282][106226] Updated weights for policy 0, policy_version 1914987 (0.0008) [2023-12-28 09:01:38,337][106226] Updated weights for policy 0, policy_version 1914997 (0.0008) [2023-12-28 09:01:38,397][106226] Updated weights for policy 0, policy_version 1915007 (0.0008) [2023-12-28 09:01:38,743][106225] Updated weights for policy 1, policy_version 1919361 (0.0009) [2023-12-28 09:01:38,804][106225] Updated weights for policy 1, policy_version 1919371 (0.0008) [2023-12-28 09:01:38,861][106225] Updated weights for policy 1, policy_version 1919381 (0.0009) [2023-12-28 09:01:38,916][106225] Updated weights for policy 1, policy_version 1919391 (0.0009) [2023-12-28 09:01:39,087][106226] Updated weights for policy 0, policy_version 1915017 (0.0006) [2023-12-28 09:01:39,150][106226] Updated weights for policy 0, policy_version 1915027 (0.0009) [2023-12-28 09:01:39,220][106226] Updated weights for policy 0, policy_version 1915037 (0.0008) [2023-12-28 09:01:39,285][106226] Updated weights for policy 0, policy_version 1915047 (0.0009) [2023-12-28 09:01:39,640][106225] Updated weights for policy 1, policy_version 1919401 (0.0008) [2023-12-28 09:01:39,703][106225] Updated weights for policy 1, policy_version 1919411 (0.0009) [2023-12-28 09:01:39,771][106225] Updated weights for policy 1, policy_version 1919421 (0.0008) [2023-12-28 09:01:39,978][106226] Updated weights for policy 0, policy_version 1915057 (0.0007) [2023-12-28 09:01:40,044][106226] Updated weights for policy 0, policy_version 1915067 (0.0007) [2023-12-28 09:01:40,111][106226] Updated weights for policy 0, policy_version 1915077 (0.0006) [2023-12-28 09:01:40,505][106225] Updated weights for policy 1, policy_version 1919431 (0.0007) [2023-12-28 09:01:40,552][106225] Updated weights for policy 1, policy_version 1919441 (0.0005) [2023-12-28 09:01:40,600][106225] Updated weights for policy 1, policy_version 1919451 (0.0005) [2023-12-28 09:01:40,810][106226] Updated weights for policy 0, policy_version 1915087 (0.0009) [2023-12-28 09:01:40,857][106226] Updated weights for policy 0, policy_version 1915097 (0.0009) [2023-12-28 09:01:40,902][106226] Updated weights for policy 0, policy_version 1915107 (0.0008) [2023-12-28 09:01:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 981786624. Throughput: 0: 9769.3, 1: 10057.0. Samples: 981757092. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:41,175][105115] Avg episode reward: [(0, '-4.672'), (1, '-4.609')] [2023-12-28 09:01:41,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001919456_491438080.pth... [2023-12-28 09:01:41,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001915112_490348544.pth... [2023-12-28 09:01:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001918272_491134976.pth [2023-12-28 09:01:41,208][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001913928_490045440.pth [2023-12-28 09:01:41,265][106225] Updated weights for policy 1, policy_version 1919461 (0.0007) [2023-12-28 09:01:41,334][106225] Updated weights for policy 1, policy_version 1919471 (0.0007) [2023-12-28 09:01:41,406][106225] Updated weights for policy 1, policy_version 1919481 (0.0008) [2023-12-28 09:01:41,764][106226] Updated weights for policy 0, policy_version 1915117 (0.0010) [2023-12-28 09:01:41,835][106226] Updated weights for policy 0, policy_version 1915127 (0.0009) [2023-12-28 09:01:41,897][106226] Updated weights for policy 0, policy_version 1915137 (0.0011) [2023-12-28 09:01:42,105][106225] Updated weights for policy 1, policy_version 1919491 (0.0006) [2023-12-28 09:01:42,172][106225] Updated weights for policy 1, policy_version 1919501 (0.0007) [2023-12-28 09:01:42,219][106225] Updated weights for policy 1, policy_version 1919511 (0.0007) [2023-12-28 09:01:42,605][106226] Updated weights for policy 0, policy_version 1915147 (0.0009) [2023-12-28 09:01:42,667][106226] Updated weights for policy 0, policy_version 1915157 (0.0006) [2023-12-28 09:01:42,732][106226] Updated weights for policy 0, policy_version 1915167 (0.0008) [2023-12-28 09:01:42,942][106225] Updated weights for policy 1, policy_version 1919521 (0.0007) [2023-12-28 09:01:43,001][106225] Updated weights for policy 1, policy_version 1919531 (0.0009) [2023-12-28 09:01:43,054][106225] Updated weights for policy 1, policy_version 1919541 (0.0007) [2023-12-28 09:01:43,107][106225] Updated weights for policy 1, policy_version 1919551 (0.0006) [2023-12-28 09:01:43,318][106226] Updated weights for policy 0, policy_version 1915177 (0.0011) [2023-12-28 09:01:43,377][106226] Updated weights for policy 0, policy_version 1915187 (0.0011) [2023-12-28 09:01:43,423][106226] Updated weights for policy 0, policy_version 1915197 (0.0010) [2023-12-28 09:01:43,478][106226] Updated weights for policy 0, policy_version 1915207 (0.0010) [2023-12-28 09:01:43,790][106225] Updated weights for policy 1, policy_version 1919561 (0.0008) [2023-12-28 09:01:43,851][106225] Updated weights for policy 1, policy_version 1919571 (0.0006) [2023-12-28 09:01:43,908][106225] Updated weights for policy 1, policy_version 1919581 (0.0008) [2023-12-28 09:01:44,109][106226] Updated weights for policy 0, policy_version 1915217 (0.0006) [2023-12-28 09:01:44,158][106226] Updated weights for policy 0, policy_version 1915227 (0.0006) [2023-12-28 09:01:44,213][106226] Updated weights for policy 0, policy_version 1915237 (0.0008) [2023-12-28 09:01:44,601][106225] Updated weights for policy 1, policy_version 1919591 (0.0007) [2023-12-28 09:01:44,655][106225] Updated weights for policy 1, policy_version 1919601 (0.0009) [2023-12-28 09:01:44,702][106225] Updated weights for policy 1, policy_version 1919611 (0.0008) [2023-12-28 09:01:44,853][106226] Updated weights for policy 0, policy_version 1915247 (0.0009) [2023-12-28 09:01:44,911][106226] Updated weights for policy 0, policy_version 1915257 (0.0009) [2023-12-28 09:01:44,964][106226] Updated weights for policy 0, policy_version 1915267 (0.0008) [2023-12-28 09:01:45,428][106225] Updated weights for policy 1, policy_version 1919621 (0.0009) [2023-12-28 09:01:45,487][106225] Updated weights for policy 1, policy_version 1919631 (0.0008) [2023-12-28 09:01:45,536][106225] Updated weights for policy 1, policy_version 1919641 (0.0008) [2023-12-28 09:01:45,696][106226] Updated weights for policy 0, policy_version 1915277 (0.0009) [2023-12-28 09:01:45,745][106226] Updated weights for policy 0, policy_version 1915287 (0.0008) [2023-12-28 09:01:45,798][106226] Updated weights for policy 0, policy_version 1915297 (0.0009) [2023-12-28 09:01:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 981884928. Throughput: 0: 9840.3, 1: 10056.4. Samples: 981875516. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:46,175][105115] Avg episode reward: [(0, '-4.126'), (1, '-4.564')] [2023-12-28 09:01:46,179][106225] Updated weights for policy 1, policy_version 1919651 (0.0008) [2023-12-28 09:01:46,230][106225] Updated weights for policy 1, policy_version 1919661 (0.0008) [2023-12-28 09:01:46,279][106225] Updated weights for policy 1, policy_version 1919671 (0.0009) [2023-12-28 09:01:46,639][106226] Updated weights for policy 0, policy_version 1915307 (0.0009) [2023-12-28 09:01:46,705][106226] Updated weights for policy 0, policy_version 1915317 (0.0009) [2023-12-28 09:01:46,760][106226] Updated weights for policy 0, policy_version 1915327 (0.0009) [2023-12-28 09:01:46,854][106225] Updated weights for policy 1, policy_version 1919682 (0.0008) [2023-12-28 09:01:46,899][106225] Updated weights for policy 1, policy_version 1919692 (0.0008) [2023-12-28 09:01:46,947][106225] Updated weights for policy 1, policy_version 1919702 (0.0008) [2023-12-28 09:01:47,002][106225] Updated weights for policy 1, policy_version 1919712 (0.0009) [2023-12-28 09:01:47,434][106226] Updated weights for policy 0, policy_version 1915337 (0.0009) [2023-12-28 09:01:47,491][106226] Updated weights for policy 0, policy_version 1915347 (0.0009) [2023-12-28 09:01:47,540][106226] Updated weights for policy 0, policy_version 1915357 (0.0008) [2023-12-28 09:01:47,594][106226] Updated weights for policy 0, policy_version 1915367 (0.0009) [2023-12-28 09:01:47,766][106225] Updated weights for policy 1, policy_version 1919722 (0.0007) [2023-12-28 09:01:47,821][106225] Updated weights for policy 1, policy_version 1919732 (0.0008) [2023-12-28 09:01:47,865][106225] Updated weights for policy 1, policy_version 1919742 (0.0008) [2023-12-28 09:01:48,287][106226] Updated weights for policy 0, policy_version 1915377 (0.0008) [2023-12-28 09:01:48,360][106226] Updated weights for policy 0, policy_version 1915387 (0.0009) [2023-12-28 09:01:48,421][106226] Updated weights for policy 0, policy_version 1915397 (0.0008) [2023-12-28 09:01:48,641][106225] Updated weights for policy 1, policy_version 1919752 (0.0010) [2023-12-28 09:01:48,696][106225] Updated weights for policy 1, policy_version 1919762 (0.0010) [2023-12-28 09:01:48,747][106225] Updated weights for policy 1, policy_version 1919772 (0.0008) [2023-12-28 09:01:49,033][106226] Updated weights for policy 0, policy_version 1915407 (0.0008) [2023-12-28 09:01:49,092][106226] Updated weights for policy 0, policy_version 1915417 (0.0007) [2023-12-28 09:01:49,145][106226] Updated weights for policy 0, policy_version 1915427 (0.0007) [2023-12-28 09:01:49,548][106225] Updated weights for policy 1, policy_version 1919782 (0.0008) [2023-12-28 09:01:49,604][106225] Updated weights for policy 1, policy_version 1919792 (0.0009) [2023-12-28 09:01:49,660][106225] Updated weights for policy 1, policy_version 1919802 (0.0008) [2023-12-28 09:01:49,949][106226] Updated weights for policy 0, policy_version 1915437 (0.0008) [2023-12-28 09:01:50,010][106226] Updated weights for policy 0, policy_version 1915447 (0.0010) [2023-12-28 09:01:50,073][106226] Updated weights for policy 0, policy_version 1915457 (0.0008) [2023-12-28 09:01:50,345][106225] Updated weights for policy 1, policy_version 1919812 (0.0008) [2023-12-28 09:01:50,399][106225] Updated weights for policy 1, policy_version 1919822 (0.0008) [2023-12-28 09:01:50,456][106225] Updated weights for policy 1, policy_version 1919832 (0.0008) [2023-12-28 09:01:50,766][106226] Updated weights for policy 0, policy_version 1915467 (0.0007) [2023-12-28 09:01:50,830][106226] Updated weights for policy 0, policy_version 1915477 (0.0011) [2023-12-28 09:01:50,895][106226] Updated weights for policy 0, policy_version 1915487 (0.0011) [2023-12-28 09:01:51,112][106225] Updated weights for policy 1, policy_version 1919842 (0.0007) [2023-12-28 09:01:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 981983232. Throughput: 0: 9885.9, 1: 10071.6. Samples: 981993580. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:51,175][106225] Updated weights for policy 1, policy_version 1919852 (0.0008) [2023-12-28 09:01:51,175][105115] Avg episode reward: [(0, '-4.516'), (1, '-4.468')] [2023-12-28 09:01:51,237][106225] Updated weights for policy 1, policy_version 1919862 (0.0006) [2023-12-28 09:01:51,300][106225] Updated weights for policy 1, policy_version 1919872 (0.0007) [2023-12-28 09:01:51,608][106226] Updated weights for policy 0, policy_version 1915497 (0.0011) [2023-12-28 09:01:51,676][106226] Updated weights for policy 0, policy_version 1915507 (0.0009) [2023-12-28 09:01:51,746][106226] Updated weights for policy 0, policy_version 1915517 (0.0008) [2023-12-28 09:01:51,803][106226] Updated weights for policy 0, policy_version 1915527 (0.0008) [2023-12-28 09:01:52,044][106225] Updated weights for policy 1, policy_version 1919882 (0.0011) [2023-12-28 09:01:52,108][106225] Updated weights for policy 1, policy_version 1919892 (0.0010) [2023-12-28 09:01:52,173][106225] Updated weights for policy 1, policy_version 1919902 (0.0010) [2023-12-28 09:01:52,431][106226] Updated weights for policy 0, policy_version 1915537 (0.0008) [2023-12-28 09:01:52,487][106226] Updated weights for policy 0, policy_version 1915547 (0.0009) [2023-12-28 09:01:52,545][106226] Updated weights for policy 0, policy_version 1915557 (0.0009) [2023-12-28 09:01:52,856][106225] Updated weights for policy 1, policy_version 1919912 (0.0007) [2023-12-28 09:01:52,912][106225] Updated weights for policy 1, policy_version 1919922 (0.0005) [2023-12-28 09:01:52,965][106225] Updated weights for policy 1, policy_version 1919932 (0.0007) [2023-12-28 09:01:53,342][106226] Updated weights for policy 0, policy_version 1915567 (0.0007) [2023-12-28 09:01:53,389][106226] Updated weights for policy 0, policy_version 1915577 (0.0008) [2023-12-28 09:01:53,445][106226] Updated weights for policy 0, policy_version 1915587 (0.0008) [2023-12-28 09:01:53,584][106225] Updated weights for policy 1, policy_version 1919942 (0.0006) [2023-12-28 09:01:53,643][106225] Updated weights for policy 1, policy_version 1919952 (0.0005) [2023-12-28 09:01:53,700][106225] Updated weights for policy 1, policy_version 1919962 (0.0005) [2023-12-28 09:01:54,223][106226] Updated weights for policy 0, policy_version 1915597 (0.0009) [2023-12-28 09:01:54,276][106226] Updated weights for policy 0, policy_version 1915607 (0.0009) [2023-12-28 09:01:54,325][106226] Updated weights for policy 0, policy_version 1915617 (0.0008) [2023-12-28 09:01:54,353][106225] Updated weights for policy 1, policy_version 1919972 (0.0006) [2023-12-28 09:01:54,402][106225] Updated weights for policy 1, policy_version 1919982 (0.0008) [2023-12-28 09:01:54,454][106225] Updated weights for policy 1, policy_version 1919992 (0.0006) [2023-12-28 09:01:55,063][106225] Updated weights for policy 1, policy_version 1920002 (0.0005) [2023-12-28 09:01:55,124][106225] Updated weights for policy 1, policy_version 1920012 (0.0005) [2023-12-28 09:01:55,145][106226] Updated weights for policy 0, policy_version 1915627 (0.0008) [2023-12-28 09:01:55,181][106225] Updated weights for policy 1, policy_version 1920022 (0.0005) [2023-12-28 09:01:55,209][106226] Updated weights for policy 0, policy_version 1915637 (0.0008) [2023-12-28 09:01:55,232][106225] Updated weights for policy 1, policy_version 1920032 (0.0006) [2023-12-28 09:01:55,257][106226] Updated weights for policy 0, policy_version 1915647 (0.0008) [2023-12-28 09:01:55,769][106225] Updated weights for policy 1, policy_version 1920042 (0.0007) [2023-12-28 09:01:55,820][106225] Updated weights for policy 1, policy_version 1920052 (0.0008) [2023-12-28 09:01:55,883][106225] Updated weights for policy 1, policy_version 1920062 (0.0005) [2023-12-28 09:01:55,966][106226] Updated weights for policy 0, policy_version 1915657 (0.0009) [2023-12-28 09:01:56,021][106226] Updated weights for policy 0, policy_version 1915667 (0.0006) [2023-12-28 09:01:56,082][106226] Updated weights for policy 0, policy_version 1915677 (0.0009) [2023-12-28 09:01:56,144][106226] Updated weights for policy 0, policy_version 1915687 (0.0008) [2023-12-28 09:01:56,175][105115] Fps is (10 sec: 20478.8, 60 sec: 19933.7, 300 sec: 19799.6). Total num frames: 982089728. Throughput: 0: 9880.7, 1: 10073.5. Samples: 982052976. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:01:56,177][105115] Avg episode reward: [(0, '-4.329'), (1, '-4.463')] [2023-12-28 09:01:56,186][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001920064_491593728.pth... [2023-12-28 09:01:56,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001915688_490496000.pth... [2023-12-28 09:01:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001914536_490201088.pth [2023-12-28 09:01:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001918880_491290624.pth [2023-12-28 09:01:56,459][106225] Updated weights for policy 1, policy_version 1920072 (0.0005) [2023-12-28 09:01:56,510][106225] Updated weights for policy 1, policy_version 1920082 (0.0005) [2023-12-28 09:01:56,566][106225] Updated weights for policy 1, policy_version 1920092 (0.0006) [2023-12-28 09:01:56,965][106226] Updated weights for policy 0, policy_version 1915697 (0.0008) [2023-12-28 09:01:57,020][106226] Updated weights for policy 0, policy_version 1915707 (0.0010) [2023-12-28 09:01:57,073][106226] Updated weights for policy 0, policy_version 1915718 (0.0008) [2023-12-28 09:01:57,106][106225] Updated weights for policy 1, policy_version 1920102 (0.0006) [2023-12-28 09:01:57,150][106225] Updated weights for policy 1, policy_version 1920112 (0.0005) [2023-12-28 09:01:57,193][106225] Updated weights for policy 1, policy_version 1920122 (0.0005) [2023-12-28 09:01:57,814][106225] Updated weights for policy 1, policy_version 1920132 (0.0006) [2023-12-28 09:01:57,862][106225] Updated weights for policy 1, policy_version 1920142 (0.0008) [2023-12-28 09:01:57,891][106226] Updated weights for policy 0, policy_version 1915728 (0.0008) [2023-12-28 09:01:57,913][106225] Updated weights for policy 1, policy_version 1920152 (0.0006) [2023-12-28 09:01:57,950][106226] Updated weights for policy 0, policy_version 1915738 (0.0008) [2023-12-28 09:01:58,016][106226] Updated weights for policy 0, policy_version 1915748 (0.0008) [2023-12-28 09:01:58,644][106225] Updated weights for policy 1, policy_version 1920162 (0.0008) [2023-12-28 09:01:58,714][106225] Updated weights for policy 1, policy_version 1920172 (0.0008) [2023-12-28 09:01:58,789][106225] Updated weights for policy 1, policy_version 1920182 (0.0008) [2023-12-28 09:01:58,822][106226] Updated weights for policy 0, policy_version 1915758 (0.0008) [2023-12-28 09:01:58,853][106225] Updated weights for policy 1, policy_version 1920192 (0.0008) [2023-12-28 09:01:58,891][106226] Updated weights for policy 0, policy_version 1915768 (0.0007) [2023-12-28 09:01:58,959][106226] Updated weights for policy 0, policy_version 1915778 (0.0007) [2023-12-28 09:01:59,602][106225] Updated weights for policy 1, policy_version 1920202 (0.0006) [2023-12-28 09:01:59,651][106226] Updated weights for policy 0, policy_version 1915788 (0.0009) [2023-12-28 09:01:59,667][106225] Updated weights for policy 1, policy_version 1920212 (0.0006) [2023-12-28 09:01:59,724][106225] Updated weights for policy 1, policy_version 1920222 (0.0008) [2023-12-28 09:01:59,727][106226] Updated weights for policy 0, policy_version 1915798 (0.0009) [2023-12-28 09:01:59,798][106226] Updated weights for policy 0, policy_version 1915808 (0.0006) [2023-12-28 09:02:00,461][106225] Updated weights for policy 1, policy_version 1920232 (0.0008) [2023-12-28 09:02:00,514][106226] Updated weights for policy 0, policy_version 1915818 (0.0008) [2023-12-28 09:02:00,516][106225] Updated weights for policy 1, policy_version 1920242 (0.0008) [2023-12-28 09:02:00,572][106225] Updated weights for policy 1, policy_version 1920252 (0.0008) [2023-12-28 09:02:00,574][106226] Updated weights for policy 0, policy_version 1915828 (0.0007) [2023-12-28 09:02:00,633][106226] Updated weights for policy 0, policy_version 1915838 (0.0007) [2023-12-28 09:02:00,693][106226] Updated weights for policy 0, policy_version 1915848 (0.0005) [2023-12-28 09:02:01,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 982179840. Throughput: 0: 9765.2, 1: 10215.2. Samples: 982172688. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:01,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.364')] [2023-12-28 09:02:01,226][106225] Updated weights for policy 1, policy_version 1920262 (0.0008) [2023-12-28 09:02:01,265][106226] Updated weights for policy 0, policy_version 1915858 (0.0007) [2023-12-28 09:02:01,285][106225] Updated weights for policy 1, policy_version 1920272 (0.0010) [2023-12-28 09:02:01,326][106226] Updated weights for policy 0, policy_version 1915868 (0.0008) [2023-12-28 09:02:01,342][106225] Updated weights for policy 1, policy_version 1920282 (0.0010) [2023-12-28 09:02:01,389][106226] Updated weights for policy 0, policy_version 1915878 (0.0009) [2023-12-28 09:02:02,043][106225] Updated weights for policy 1, policy_version 1920292 (0.0008) [2023-12-28 09:02:02,106][106225] Updated weights for policy 1, policy_version 1920302 (0.0009) [2023-12-28 09:02:02,144][106226] Updated weights for policy 0, policy_version 1915888 (0.0006) [2023-12-28 09:02:02,161][106225] Updated weights for policy 1, policy_version 1920312 (0.0010) [2023-12-28 09:02:02,191][106226] Updated weights for policy 0, policy_version 1915898 (0.0005) [2023-12-28 09:02:02,244][106226] Updated weights for policy 0, policy_version 1915908 (0.0008) [2023-12-28 09:02:02,879][106225] Updated weights for policy 1, policy_version 1920322 (0.0009) [2023-12-28 09:02:02,934][106225] Updated weights for policy 1, policy_version 1920332 (0.0005) [2023-12-28 09:02:02,987][106225] Updated weights for policy 1, policy_version 1920342 (0.0005) [2023-12-28 09:02:03,028][106226] Updated weights for policy 0, policy_version 1915918 (0.0008) [2023-12-28 09:02:03,040][106225] Updated weights for policy 1, policy_version 1920352 (0.0005) [2023-12-28 09:02:03,078][106226] Updated weights for policy 0, policy_version 1915929 (0.0009) [2023-12-28 09:02:03,129][106226] Updated weights for policy 0, policy_version 1915939 (0.0009) [2023-12-28 09:02:03,633][106225] Updated weights for policy 1, policy_version 1920362 (0.0005) [2023-12-28 09:02:03,700][106225] Updated weights for policy 1, policy_version 1920372 (0.0007) [2023-12-28 09:02:03,762][106225] Updated weights for policy 1, policy_version 1920382 (0.0008) [2023-12-28 09:02:03,948][106226] Updated weights for policy 0, policy_version 1915949 (0.0008) [2023-12-28 09:02:04,008][106226] Updated weights for policy 0, policy_version 1915959 (0.0008) [2023-12-28 09:02:04,068][106226] Updated weights for policy 0, policy_version 1915969 (0.0007) [2023-12-28 09:02:04,445][106225] Updated weights for policy 1, policy_version 1920392 (0.0010) [2023-12-28 09:02:04,513][106225] Updated weights for policy 1, policy_version 1920402 (0.0011) [2023-12-28 09:02:04,573][106225] Updated weights for policy 1, policy_version 1920412 (0.0010) [2023-12-28 09:02:04,814][106226] Updated weights for policy 0, policy_version 1915979 (0.0009) [2023-12-28 09:02:04,865][106226] Updated weights for policy 0, policy_version 1915989 (0.0008) [2023-12-28 09:02:04,927][106226] Updated weights for policy 0, policy_version 1915999 (0.0010) [2023-12-28 09:02:05,276][106225] Updated weights for policy 1, policy_version 1920422 (0.0010) [2023-12-28 09:02:05,326][106225] Updated weights for policy 1, policy_version 1920432 (0.0010) [2023-12-28 09:02:05,373][106225] Updated weights for policy 1, policy_version 1920442 (0.0010) [2023-12-28 09:02:05,595][106226] Updated weights for policy 0, policy_version 1916009 (0.0010) [2023-12-28 09:02:05,650][106226] Updated weights for policy 0, policy_version 1916019 (0.0005) [2023-12-28 09:02:05,706][106226] Updated weights for policy 0, policy_version 1916029 (0.0006) [2023-12-28 09:02:05,760][106226] Updated weights for policy 0, policy_version 1916039 (0.0008) [2023-12-28 09:02:06,067][106225] Updated weights for policy 1, policy_version 1920452 (0.0008) [2023-12-28 09:02:06,139][106225] Updated weights for policy 1, policy_version 1920462 (0.0007) [2023-12-28 09:02:06,174][105115] Fps is (10 sec: 18842.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 982278144. Throughput: 0: 9653.3, 1: 10214.9. Samples: 982291452. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:06,175][105115] Avg episode reward: [(0, '-4.374'), (1, '-4.471')] [2023-12-28 09:02:06,205][106225] Updated weights for policy 1, policy_version 1920472 (0.0008) [2023-12-28 09:02:06,376][106226] Updated weights for policy 0, policy_version 1916049 (0.0006) [2023-12-28 09:02:06,447][106226] Updated weights for policy 0, policy_version 1916059 (0.0006) [2023-12-28 09:02:06,516][106226] Updated weights for policy 0, policy_version 1916069 (0.0006) [2023-12-28 09:02:06,955][106225] Updated weights for policy 1, policy_version 1920482 (0.0008) [2023-12-28 09:02:07,018][106225] Updated weights for policy 1, policy_version 1920492 (0.0008) [2023-12-28 09:02:07,075][106225] Updated weights for policy 1, policy_version 1920502 (0.0009) [2023-12-28 09:02:07,126][106225] Updated weights for policy 1, policy_version 1920512 (0.0009) [2023-12-28 09:02:07,134][106226] Updated weights for policy 0, policy_version 1916079 (0.0009) [2023-12-28 09:02:07,202][106226] Updated weights for policy 0, policy_version 1916089 (0.0009) [2023-12-28 09:02:07,263][106226] Updated weights for policy 0, policy_version 1916099 (0.0010) [2023-12-28 09:02:07,793][106225] Updated weights for policy 1, policy_version 1920522 (0.0008) [2023-12-28 09:02:07,844][106225] Updated weights for policy 1, policy_version 1920532 (0.0009) [2023-12-28 09:02:07,911][106225] Updated weights for policy 1, policy_version 1920542 (0.0008) [2023-12-28 09:02:07,975][106226] Updated weights for policy 0, policy_version 1916109 (0.0008) [2023-12-28 09:02:08,031][106226] Updated weights for policy 0, policy_version 1916119 (0.0009) [2023-12-28 09:02:08,088][106226] Updated weights for policy 0, policy_version 1916129 (0.0009) [2023-12-28 09:02:08,651][106225] Updated weights for policy 1, policy_version 1920552 (0.0010) [2023-12-28 09:02:08,726][106225] Updated weights for policy 1, policy_version 1920562 (0.0009) [2023-12-28 09:02:08,790][106225] Updated weights for policy 1, policy_version 1920572 (0.0009) [2023-12-28 09:02:08,815][106226] Updated weights for policy 0, policy_version 1916139 (0.0008) [2023-12-28 09:02:08,885][106226] Updated weights for policy 0, policy_version 1916149 (0.0009) [2023-12-28 09:02:08,947][106226] Updated weights for policy 0, policy_version 1916159 (0.0009) [2023-12-28 09:02:09,492][106225] Updated weights for policy 1, policy_version 1920582 (0.0007) [2023-12-28 09:02:09,544][106225] Updated weights for policy 1, policy_version 1920592 (0.0008) [2023-12-28 09:02:09,590][106225] Updated weights for policy 1, policy_version 1920602 (0.0007) [2023-12-28 09:02:09,736][106226] Updated weights for policy 0, policy_version 1916169 (0.0008) [2023-12-28 09:02:09,796][106226] Updated weights for policy 0, policy_version 1916179 (0.0009) [2023-12-28 09:02:09,870][106226] Updated weights for policy 0, policy_version 1916189 (0.0008) [2023-12-28 09:02:09,937][106226] Updated weights for policy 0, policy_version 1916199 (0.0010) [2023-12-28 09:02:10,416][106225] Updated weights for policy 1, policy_version 1920612 (0.0008) [2023-12-28 09:02:10,482][106225] Updated weights for policy 1, policy_version 1920622 (0.0008) [2023-12-28 09:02:10,540][106225] Updated weights for policy 1, policy_version 1920632 (0.0007) [2023-12-28 09:02:10,557][106226] Updated weights for policy 0, policy_version 1916209 (0.0008) [2023-12-28 09:02:10,606][106226] Updated weights for policy 0, policy_version 1916219 (0.0007) [2023-12-28 09:02:10,659][106226] Updated weights for policy 0, policy_version 1916229 (0.0008) [2023-12-28 09:02:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 982376448. Throughput: 0: 9717.3, 1: 10183.9. Samples: 982349972. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:11,175][105115] Avg episode reward: [(0, '-4.585'), (1, '-4.635')] [2023-12-28 09:02:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001920640_491741184.pth... [2023-12-28 09:02:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001916232_490635264.pth... [2023-12-28 09:02:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001919456_491438080.pth [2023-12-28 09:02:11,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001915112_490348544.pth [2023-12-28 09:02:11,393][106225] Updated weights for policy 1, policy_version 1920642 (0.0007) [2023-12-28 09:02:11,451][106225] Updated weights for policy 1, policy_version 1920652 (0.0008) [2023-12-28 09:02:11,453][106226] Updated weights for policy 0, policy_version 1916239 (0.0007) [2023-12-28 09:02:11,506][106225] Updated weights for policy 1, policy_version 1920662 (0.0007) [2023-12-28 09:02:11,508][106226] Updated weights for policy 0, policy_version 1916249 (0.0007) [2023-12-28 09:02:11,561][106226] Updated weights for policy 0, policy_version 1916259 (0.0007) [2023-12-28 09:02:11,570][106225] Updated weights for policy 1, policy_version 1920672 (0.0008) [2023-12-28 09:02:12,289][106226] Updated weights for policy 0, policy_version 1916269 (0.0009) [2023-12-28 09:02:12,350][106226] Updated weights for policy 0, policy_version 1916279 (0.0007) [2023-12-28 09:02:12,369][106225] Updated weights for policy 1, policy_version 1920682 (0.0008) [2023-12-28 09:02:12,413][106226] Updated weights for policy 0, policy_version 1916289 (0.0007) [2023-12-28 09:02:12,436][106225] Updated weights for policy 1, policy_version 1920692 (0.0008) [2023-12-28 09:02:12,502][106225] Updated weights for policy 1, policy_version 1920702 (0.0008) [2023-12-28 09:02:13,161][106226] Updated weights for policy 0, policy_version 1916299 (0.0008) [2023-12-28 09:02:13,208][106225] Updated weights for policy 1, policy_version 1920712 (0.0009) [2023-12-28 09:02:13,219][106226] Updated weights for policy 0, policy_version 1916309 (0.0008) [2023-12-28 09:02:13,259][106225] Updated weights for policy 1, policy_version 1920722 (0.0010) [2023-12-28 09:02:13,274][106226] Updated weights for policy 0, policy_version 1916319 (0.0006) [2023-12-28 09:02:13,306][106225] Updated weights for policy 1, policy_version 1920732 (0.0010) [2023-12-28 09:02:13,798][106226] Updated weights for policy 0, policy_version 1916329 (0.0005) [2023-12-28 09:02:13,863][106226] Updated weights for policy 0, policy_version 1916339 (0.0005) [2023-12-28 09:02:13,923][106226] Updated weights for policy 0, policy_version 1916349 (0.0006) [2023-12-28 09:02:13,978][106226] Updated weights for policy 0, policy_version 1916359 (0.0005) [2023-12-28 09:02:14,013][106225] Updated weights for policy 1, policy_version 1920742 (0.0009) [2023-12-28 09:02:14,073][106225] Updated weights for policy 1, policy_version 1920752 (0.0008) [2023-12-28 09:02:14,137][106225] Updated weights for policy 1, policy_version 1920762 (0.0008) [2023-12-28 09:02:14,570][106226] Updated weights for policy 0, policy_version 1916369 (0.0007) [2023-12-28 09:02:14,619][106226] Updated weights for policy 0, policy_version 1916379 (0.0007) [2023-12-28 09:02:14,680][106226] Updated weights for policy 0, policy_version 1916389 (0.0005) [2023-12-28 09:02:14,829][106225] Updated weights for policy 1, policy_version 1920772 (0.0007) [2023-12-28 09:02:14,896][106225] Updated weights for policy 1, policy_version 1920782 (0.0007) [2023-12-28 09:02:14,959][106225] Updated weights for policy 1, policy_version 1920792 (0.0007) [2023-12-28 09:02:15,306][106226] Updated weights for policy 0, policy_version 1916399 (0.0009) [2023-12-28 09:02:15,371][106226] Updated weights for policy 0, policy_version 1916409 (0.0011) [2023-12-28 09:02:15,433][106226] Updated weights for policy 0, policy_version 1916419 (0.0009) [2023-12-28 09:02:15,704][106225] Updated weights for policy 1, policy_version 1920802 (0.0009) [2023-12-28 09:02:15,758][106225] Updated weights for policy 1, policy_version 1920812 (0.0010) [2023-12-28 09:02:15,810][106225] Updated weights for policy 1, policy_version 1920822 (0.0010) [2023-12-28 09:02:15,862][106225] Updated weights for policy 1, policy_version 1920832 (0.0009) [2023-12-28 09:02:15,998][106226] Updated weights for policy 0, policy_version 1916429 (0.0008) [2023-12-28 09:02:16,047][106226] Updated weights for policy 0, policy_version 1916439 (0.0005) [2023-12-28 09:02:16,095][106226] Updated weights for policy 0, policy_version 1916449 (0.0009) [2023-12-28 09:02:16,174][105115] Fps is (10 sec: 20480.0, 60 sec: 20070.5, 300 sec: 19799.7). Total num frames: 982482944. Throughput: 0: 9722.2, 1: 10053.4. Samples: 982467312. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:16,175][105115] Avg episode reward: [(0, '-4.396'), (1, '-4.762')] [2023-12-28 09:02:16,645][106225] Updated weights for policy 1, policy_version 1920842 (0.0010) [2023-12-28 09:02:16,674][106226] Updated weights for policy 0, policy_version 1916459 (0.0007) [2023-12-28 09:02:16,697][106225] Updated weights for policy 1, policy_version 1920852 (0.0009) [2023-12-28 09:02:16,722][106226] Updated weights for policy 0, policy_version 1916469 (0.0010) [2023-12-28 09:02:16,753][106225] Updated weights for policy 1, policy_version 1920862 (0.0007) [2023-12-28 09:02:16,772][106226] Updated weights for policy 0, policy_version 1916479 (0.0010) [2023-12-28 09:02:17,438][106225] Updated weights for policy 1, policy_version 1920872 (0.0006) [2023-12-28 09:02:17,484][106225] Updated weights for policy 1, policy_version 1920882 (0.0005) [2023-12-28 09:02:17,489][106226] Updated weights for policy 0, policy_version 1916489 (0.0010) [2023-12-28 09:02:17,535][106225] Updated weights for policy 1, policy_version 1920892 (0.0005) [2023-12-28 09:02:17,546][106226] Updated weights for policy 0, policy_version 1916499 (0.0010) [2023-12-28 09:02:17,603][106226] Updated weights for policy 0, policy_version 1916509 (0.0010) [2023-12-28 09:02:17,653][106226] Updated weights for policy 0, policy_version 1916519 (0.0010) [2023-12-28 09:02:18,069][106225] Updated weights for policy 1, policy_version 1920902 (0.0007) [2023-12-28 09:02:18,135][106225] Updated weights for policy 1, policy_version 1920912 (0.0009) [2023-12-28 09:02:18,201][106225] Updated weights for policy 1, policy_version 1920922 (0.0008) [2023-12-28 09:02:18,210][106226] Updated weights for policy 0, policy_version 1916529 (0.0006) [2023-12-28 09:02:18,270][106226] Updated weights for policy 0, policy_version 1916539 (0.0005) [2023-12-28 09:02:18,331][106226] Updated weights for policy 0, policy_version 1916549 (0.0010) [2023-12-28 09:02:18,926][106225] Updated weights for policy 1, policy_version 1920932 (0.0007) [2023-12-28 09:02:18,947][106226] Updated weights for policy 0, policy_version 1916559 (0.0010) [2023-12-28 09:02:18,984][106225] Updated weights for policy 1, policy_version 1920942 (0.0005) [2023-12-28 09:02:18,998][106226] Updated weights for policy 0, policy_version 1916569 (0.0011) [2023-12-28 09:02:19,046][106225] Updated weights for policy 1, policy_version 1920952 (0.0006) [2023-12-28 09:02:19,049][106226] Updated weights for policy 0, policy_version 1916579 (0.0011) [2023-12-28 09:02:19,786][106226] Updated weights for policy 0, policy_version 1916589 (0.0011) [2023-12-28 09:02:19,816][106225] Updated weights for policy 1, policy_version 1920962 (0.0006) [2023-12-28 09:02:19,851][106226] Updated weights for policy 0, policy_version 1916599 (0.0011) [2023-12-28 09:02:19,885][106225] Updated weights for policy 1, policy_version 1920972 (0.0006) [2023-12-28 09:02:19,909][106226] Updated weights for policy 0, policy_version 1916609 (0.0008) [2023-12-28 09:02:19,944][106225] Updated weights for policy 1, policy_version 1920982 (0.0008) [2023-12-28 09:02:20,004][106225] Updated weights for policy 1, policy_version 1920992 (0.0009) [2023-12-28 09:02:20,700][106226] Updated weights for policy 0, policy_version 1916619 (0.0012) [2023-12-28 09:02:20,760][106226] Updated weights for policy 0, policy_version 1916629 (0.0006) [2023-12-28 09:02:20,765][106225] Updated weights for policy 1, policy_version 1921002 (0.0010) [2023-12-28 09:02:20,819][106226] Updated weights for policy 0, policy_version 1916639 (0.0007) [2023-12-28 09:02:20,822][106225] Updated weights for policy 1, policy_version 1921012 (0.0009) [2023-12-28 09:02:20,878][106225] Updated weights for policy 1, policy_version 1921022 (0.0009) [2023-12-28 09:02:21,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 982581248. Throughput: 0: 9827.9, 1: 9966.4. Samples: 982588716. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:21,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.642')] [2023-12-28 09:02:21,624][106226] Updated weights for policy 0, policy_version 1916649 (0.0009) [2023-12-28 09:02:21,633][106225] Updated weights for policy 1, policy_version 1921032 (0.0010) [2023-12-28 09:02:21,692][106226] Updated weights for policy 0, policy_version 1916659 (0.0007) [2023-12-28 09:02:21,697][106225] Updated weights for policy 1, policy_version 1921042 (0.0010) [2023-12-28 09:02:21,760][106226] Updated weights for policy 0, policy_version 1916669 (0.0007) [2023-12-28 09:02:21,761][106225] Updated weights for policy 1, policy_version 1921052 (0.0008) [2023-12-28 09:02:21,827][106226] Updated weights for policy 0, policy_version 1916679 (0.0006) [2023-12-28 09:02:22,491][106226] Updated weights for policy 0, policy_version 1916689 (0.0008) [2023-12-28 09:02:22,538][106225] Updated weights for policy 1, policy_version 1921062 (0.0006) [2023-12-28 09:02:22,547][106226] Updated weights for policy 0, policy_version 1916699 (0.0008) [2023-12-28 09:02:22,605][106225] Updated weights for policy 1, policy_version 1921072 (0.0006) [2023-12-28 09:02:22,606][106226] Updated weights for policy 0, policy_version 1916709 (0.0006) [2023-12-28 09:02:22,672][106225] Updated weights for policy 1, policy_version 1921082 (0.0009) [2023-12-28 09:02:23,278][106226] Updated weights for policy 0, policy_version 1916719 (0.0007) [2023-12-28 09:02:23,329][106226] Updated weights for policy 0, policy_version 1916729 (0.0007) [2023-12-28 09:02:23,331][106225] Updated weights for policy 1, policy_version 1921092 (0.0006) [2023-12-28 09:02:23,384][106226] Updated weights for policy 0, policy_version 1916739 (0.0006) [2023-12-28 09:02:23,391][106225] Updated weights for policy 1, policy_version 1921102 (0.0008) [2023-12-28 09:02:23,437][106225] Updated weights for policy 1, policy_version 1921112 (0.0007) [2023-12-28 09:02:23,970][106226] Updated weights for policy 0, policy_version 1916749 (0.0006) [2023-12-28 09:02:24,026][106226] Updated weights for policy 0, policy_version 1916759 (0.0008) [2023-12-28 09:02:24,071][106225] Updated weights for policy 1, policy_version 1921122 (0.0006) [2023-12-28 09:02:24,079][106226] Updated weights for policy 0, policy_version 1916769 (0.0009) [2023-12-28 09:02:24,134][106225] Updated weights for policy 1, policy_version 1921132 (0.0005) [2023-12-28 09:02:24,190][106225] Updated weights for policy 1, policy_version 1921142 (0.0006) [2023-12-28 09:02:24,233][106225] Updated weights for policy 1, policy_version 1921152 (0.0007) [2023-12-28 09:02:24,764][106226] Updated weights for policy 0, policy_version 1916779 (0.0009) [2023-12-28 09:02:24,798][106225] Updated weights for policy 1, policy_version 1921162 (0.0010) [2023-12-28 09:02:24,825][106226] Updated weights for policy 0, policy_version 1916789 (0.0011) [2023-12-28 09:02:24,853][106225] Updated weights for policy 1, policy_version 1921172 (0.0006) [2023-12-28 09:02:24,879][106226] Updated weights for policy 0, policy_version 1916799 (0.0011) [2023-12-28 09:02:24,907][106225] Updated weights for policy 1, policy_version 1921182 (0.0005) [2023-12-28 09:02:25,479][106225] Updated weights for policy 1, policy_version 1921192 (0.0007) [2023-12-28 09:02:25,541][106225] Updated weights for policy 1, policy_version 1921202 (0.0005) [2023-12-28 09:02:25,594][106226] Updated weights for policy 0, policy_version 1916809 (0.0010) [2023-12-28 09:02:25,601][106225] Updated weights for policy 1, policy_version 1921212 (0.0005) [2023-12-28 09:02:25,650][106226] Updated weights for policy 0, policy_version 1916819 (0.0006) [2023-12-28 09:02:25,696][106226] Updated weights for policy 0, policy_version 1916829 (0.0005) [2023-12-28 09:02:25,749][106226] Updated weights for policy 0, policy_version 1916839 (0.0005) [2023-12-28 09:02:26,118][106225] Updated weights for policy 1, policy_version 1921222 (0.0005) [2023-12-28 09:02:26,172][106225] Updated weights for policy 1, policy_version 1921232 (0.0006) [2023-12-28 09:02:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 982679552. Throughput: 0: 9849.3, 1: 9951.3. Samples: 982648120. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:26,175][105115] Avg episode reward: [(0, '-4.309'), (1, '-4.636')] [2023-12-28 09:02:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001916840_490790912.pth... [2023-12-28 09:02:26,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001915688_490496000.pth [2023-12-28 09:02:26,222][106225] Updated weights for policy 1, policy_version 1921242 (0.0008) [2023-12-28 09:02:26,247][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001921248_491896832.pth... [2023-12-28 09:02:26,251][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001920064_491593728.pth [2023-12-28 09:02:26,403][106226] Updated weights for policy 0, policy_version 1916849 (0.0009) [2023-12-28 09:02:26,458][106226] Updated weights for policy 0, policy_version 1916859 (0.0010) [2023-12-28 09:02:26,509][106226] Updated weights for policy 0, policy_version 1916869 (0.0011) [2023-12-28 09:02:26,785][106225] Updated weights for policy 1, policy_version 1921252 (0.0006) [2023-12-28 09:02:26,842][106225] Updated weights for policy 1, policy_version 1921262 (0.0005) [2023-12-28 09:02:26,886][106225] Updated weights for policy 1, policy_version 1921272 (0.0005) [2023-12-28 09:02:27,251][106226] Updated weights for policy 0, policy_version 1916879 (0.0009) [2023-12-28 09:02:27,308][106226] Updated weights for policy 0, policy_version 1916889 (0.0008) [2023-12-28 09:02:27,370][106226] Updated weights for policy 0, policy_version 1916899 (0.0005) [2023-12-28 09:02:27,555][106225] Updated weights for policy 1, policy_version 1921282 (0.0006) [2023-12-28 09:02:27,615][106225] Updated weights for policy 1, policy_version 1921292 (0.0007) [2023-12-28 09:02:27,672][106225] Updated weights for policy 1, policy_version 1921302 (0.0006) [2023-12-28 09:02:27,737][106225] Updated weights for policy 1, policy_version 1921312 (0.0006) [2023-12-28 09:02:28,064][106226] Updated weights for policy 0, policy_version 1916909 (0.0007) [2023-12-28 09:02:28,128][106226] Updated weights for policy 0, policy_version 1916919 (0.0005) [2023-12-28 09:02:28,183][106226] Updated weights for policy 0, policy_version 1916929 (0.0005) [2023-12-28 09:02:28,384][106225] Updated weights for policy 1, policy_version 1921322 (0.0009) [2023-12-28 09:02:28,442][106225] Updated weights for policy 1, policy_version 1921332 (0.0009) [2023-12-28 09:02:28,495][106225] Updated weights for policy 1, policy_version 1921342 (0.0008) [2023-12-28 09:02:28,724][106226] Updated weights for policy 0, policy_version 1916939 (0.0006) [2023-12-28 09:02:28,773][106226] Updated weights for policy 0, policy_version 1916949 (0.0008) [2023-12-28 09:02:28,822][106226] Updated weights for policy 0, policy_version 1916959 (0.0009) [2023-12-28 09:02:29,291][106225] Updated weights for policy 1, policy_version 1921352 (0.0009) [2023-12-28 09:02:29,350][106225] Updated weights for policy 1, policy_version 1921362 (0.0008) [2023-12-28 09:02:29,414][106225] Updated weights for policy 1, policy_version 1921372 (0.0007) [2023-12-28 09:02:29,445][106226] Updated weights for policy 0, policy_version 1916969 (0.0007) [2023-12-28 09:02:29,498][106226] Updated weights for policy 0, policy_version 1916979 (0.0008) [2023-12-28 09:02:29,547][106226] Updated weights for policy 0, policy_version 1916989 (0.0009) [2023-12-28 09:02:29,596][106226] Updated weights for policy 0, policy_version 1916999 (0.0008) [2023-12-28 09:02:30,109][106225] Updated weights for policy 1, policy_version 1921382 (0.0007) [2023-12-28 09:02:30,173][106225] Updated weights for policy 1, policy_version 1921392 (0.0008) [2023-12-28 09:02:30,236][106225] Updated weights for policy 1, policy_version 1921402 (0.0008) [2023-12-28 09:02:30,328][106226] Updated weights for policy 0, policy_version 1917009 (0.0007) [2023-12-28 09:02:30,380][106226] Updated weights for policy 0, policy_version 1917019 (0.0009) [2023-12-28 09:02:30,435][106226] Updated weights for policy 0, policy_version 1917029 (0.0008) [2023-12-28 09:02:30,973][106225] Updated weights for policy 1, policy_version 1921412 (0.0010) [2023-12-28 09:02:31,038][106225] Updated weights for policy 1, policy_version 1921422 (0.0008) [2023-12-28 09:02:31,093][106225] Updated weights for policy 1, policy_version 1921432 (0.0008) [2023-12-28 09:02:31,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 982786048. Throughput: 0: 9907.0, 1: 10086.7. Samples: 982775236. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:31,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.630')] [2023-12-28 09:02:31,190][106226] Updated weights for policy 0, policy_version 1917039 (0.0010) [2023-12-28 09:02:31,261][106226] Updated weights for policy 0, policy_version 1917049 (0.0010) [2023-12-28 09:02:31,329][106226] Updated weights for policy 0, policy_version 1917059 (0.0011) [2023-12-28 09:02:31,863][106225] Updated weights for policy 1, policy_version 1921442 (0.0008) [2023-12-28 09:02:31,922][106225] Updated weights for policy 1, policy_version 1921452 (0.0008) [2023-12-28 09:02:31,987][106225] Updated weights for policy 1, policy_version 1921462 (0.0005) [2023-12-28 09:02:32,054][106225] Updated weights for policy 1, policy_version 1921472 (0.0007) [2023-12-28 09:02:32,081][106226] Updated weights for policy 0, policy_version 1917070 (0.0010) [2023-12-28 09:02:32,149][106226] Updated weights for policy 0, policy_version 1917080 (0.0010) [2023-12-28 09:02:32,217][106226] Updated weights for policy 0, policy_version 1917090 (0.0011) [2023-12-28 09:02:32,657][106225] Updated weights for policy 1, policy_version 1921482 (0.0010) [2023-12-28 09:02:32,714][106225] Updated weights for policy 1, policy_version 1921492 (0.0010) [2023-12-28 09:02:32,778][106225] Updated weights for policy 1, policy_version 1921502 (0.0008) [2023-12-28 09:02:32,898][106226] Updated weights for policy 0, policy_version 1917100 (0.0010) [2023-12-28 09:02:32,959][106226] Updated weights for policy 0, policy_version 1917110 (0.0008) [2023-12-28 09:02:33,015][106226] Updated weights for policy 0, policy_version 1917120 (0.0005) [2023-12-28 09:02:33,411][106225] Updated weights for policy 1, policy_version 1921512 (0.0007) [2023-12-28 09:02:33,468][106225] Updated weights for policy 1, policy_version 1921522 (0.0007) [2023-12-28 09:02:33,520][106225] Updated weights for policy 1, policy_version 1921532 (0.0007) [2023-12-28 09:02:33,688][106226] Updated weights for policy 0, policy_version 1917130 (0.0005) [2023-12-28 09:02:33,747][106226] Updated weights for policy 0, policy_version 1917140 (0.0005) [2023-12-28 09:02:33,807][106226] Updated weights for policy 0, policy_version 1917150 (0.0009) [2023-12-28 09:02:33,856][106226] Updated weights for policy 0, policy_version 1917160 (0.0008) [2023-12-28 09:02:34,104][106225] Updated weights for policy 1, policy_version 1921542 (0.0007) [2023-12-28 09:02:34,156][106225] Updated weights for policy 1, policy_version 1921552 (0.0006) [2023-12-28 09:02:34,227][106225] Updated weights for policy 1, policy_version 1921562 (0.0008) [2023-12-28 09:02:34,534][106226] Updated weights for policy 0, policy_version 1917170 (0.0008) [2023-12-28 09:02:34,596][106226] Updated weights for policy 0, policy_version 1917180 (0.0008) [2023-12-28 09:02:34,666][106226] Updated weights for policy 0, policy_version 1917190 (0.0009) [2023-12-28 09:02:34,991][106225] Updated weights for policy 1, policy_version 1921572 (0.0009) [2023-12-28 09:02:35,052][106225] Updated weights for policy 1, policy_version 1921582 (0.0008) [2023-12-28 09:02:35,111][106225] Updated weights for policy 1, policy_version 1921592 (0.0008) [2023-12-28 09:02:35,374][106226] Updated weights for policy 0, policy_version 1917200 (0.0008) [2023-12-28 09:02:35,433][106226] Updated weights for policy 0, policy_version 1917210 (0.0008) [2023-12-28 09:02:35,490][106226] Updated weights for policy 0, policy_version 1917220 (0.0009) [2023-12-28 09:02:35,855][106225] Updated weights for policy 1, policy_version 1921602 (0.0008) [2023-12-28 09:02:35,913][106225] Updated weights for policy 1, policy_version 1921612 (0.0008) [2023-12-28 09:02:35,968][106225] Updated weights for policy 1, policy_version 1921622 (0.0008) [2023-12-28 09:02:36,013][106225] Updated weights for policy 1, policy_version 1921632 (0.0008) [2023-12-28 09:02:36,174][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 982884352. Throughput: 0: 9913.3, 1: 10082.6. Samples: 982893396. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:36,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.613')] [2023-12-28 09:02:36,236][106226] Updated weights for policy 0, policy_version 1917230 (0.0008) [2023-12-28 09:02:36,306][106226] Updated weights for policy 0, policy_version 1917240 (0.0008) [2023-12-28 09:02:36,373][106226] Updated weights for policy 0, policy_version 1917250 (0.0008) [2023-12-28 09:02:36,778][106225] Updated weights for policy 1, policy_version 1921642 (0.0008) [2023-12-28 09:02:36,832][106225] Updated weights for policy 1, policy_version 1921652 (0.0008) [2023-12-28 09:02:36,886][106225] Updated weights for policy 1, policy_version 1921662 (0.0009) [2023-12-28 09:02:37,032][106226] Updated weights for policy 0, policy_version 1917260 (0.0009) [2023-12-28 09:02:37,088][106226] Updated weights for policy 0, policy_version 1917270 (0.0008) [2023-12-28 09:02:37,145][106226] Updated weights for policy 0, policy_version 1917280 (0.0009) [2023-12-28 09:02:37,687][106225] Updated weights for policy 1, policy_version 1921672 (0.0009) [2023-12-28 09:02:37,743][106225] Updated weights for policy 1, policy_version 1921682 (0.0009) [2023-12-28 09:02:37,791][106225] Updated weights for policy 1, policy_version 1921692 (0.0009) [2023-12-28 09:02:37,797][106226] Updated weights for policy 0, policy_version 1917290 (0.0008) [2023-12-28 09:02:37,861][106226] Updated weights for policy 0, policy_version 1917300 (0.0006) [2023-12-28 09:02:37,923][106226] Updated weights for policy 0, policy_version 1917310 (0.0006) [2023-12-28 09:02:37,968][106226] Updated weights for policy 0, policy_version 1917320 (0.0007) [2023-12-28 09:02:38,562][106226] Updated weights for policy 0, policy_version 1917330 (0.0011) [2023-12-28 09:02:38,568][106225] Updated weights for policy 1, policy_version 1921702 (0.0006) [2023-12-28 09:02:38,616][106226] Updated weights for policy 0, policy_version 1917340 (0.0011) [2023-12-28 09:02:38,652][106225] Updated weights for policy 1, policy_version 1921712 (0.0005) [2023-12-28 09:02:38,670][106226] Updated weights for policy 0, policy_version 1917350 (0.0010) [2023-12-28 09:02:38,712][106225] Updated weights for policy 1, policy_version 1921722 (0.0006) [2023-12-28 09:02:39,392][106226] Updated weights for policy 0, policy_version 1917360 (0.0009) [2023-12-28 09:02:39,422][106225] Updated weights for policy 1, policy_version 1921732 (0.0007) [2023-12-28 09:02:39,454][106226] Updated weights for policy 0, policy_version 1917370 (0.0008) [2023-12-28 09:02:39,486][106225] Updated weights for policy 1, policy_version 1921742 (0.0008) [2023-12-28 09:02:39,505][106226] Updated weights for policy 0, policy_version 1917380 (0.0008) [2023-12-28 09:02:39,554][106225] Updated weights for policy 1, policy_version 1921752 (0.0008) [2023-12-28 09:02:40,252][106226] Updated weights for policy 0, policy_version 1917390 (0.0008) [2023-12-28 09:02:40,308][106225] Updated weights for policy 1, policy_version 1921762 (0.0010) [2023-12-28 09:02:40,311][106226] Updated weights for policy 0, policy_version 1917400 (0.0007) [2023-12-28 09:02:40,369][106225] Updated weights for policy 1, policy_version 1921772 (0.0009) [2023-12-28 09:02:40,372][106226] Updated weights for policy 0, policy_version 1917410 (0.0007) [2023-12-28 09:02:40,427][106225] Updated weights for policy 1, policy_version 1921782 (0.0008) [2023-12-28 09:02:40,490][106225] Updated weights for policy 1, policy_version 1921792 (0.0008) [2023-12-28 09:02:41,072][106226] Updated weights for policy 0, policy_version 1917420 (0.0008) [2023-12-28 09:02:41,135][106226] Updated weights for policy 0, policy_version 1917430 (0.0009) [2023-12-28 09:02:41,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 982974464. Throughput: 0: 9974.4, 1: 10009.0. Samples: 982952220. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-28 09:02:41,175][105115] Avg episode reward: [(0, '-4.384'), (1, '-4.583')] [2023-12-28 09:02:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001921792_492036096.pth... [2023-12-28 09:02:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001920640_491741184.pth [2023-12-28 09:02:41,199][106226] Updated weights for policy 0, policy_version 1917440 (0.0008) [2023-12-28 09:02:41,247][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001917448_490946560.pth... [2023-12-28 09:02:41,253][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001916232_490635264.pth [2023-12-28 09:02:41,260][106225] Updated weights for policy 1, policy_version 1921802 (0.0009) [2023-12-28 09:02:41,329][106225] Updated weights for policy 1, policy_version 1921812 (0.0009) [2023-12-28 09:02:41,403][106225] Updated weights for policy 1, policy_version 1921822 (0.0009) [2023-12-28 09:02:41,963][106226] Updated weights for policy 0, policy_version 1917450 (0.0008) [2023-12-28 09:02:42,030][106226] Updated weights for policy 0, policy_version 1917460 (0.0007) [2023-12-28 09:02:42,091][106226] Updated weights for policy 0, policy_version 1917470 (0.0008) [2023-12-28 09:02:42,137][106225] Updated weights for policy 1, policy_version 1921832 (0.0006) [2023-12-28 09:02:42,162][106226] Updated weights for policy 0, policy_version 1917480 (0.0007) [2023-12-28 09:02:42,200][106225] Updated weights for policy 1, policy_version 1921842 (0.0006) [2023-12-28 09:02:42,263][106225] Updated weights for policy 1, policy_version 1921852 (0.0008) [2023-12-28 09:02:42,922][106225] Updated weights for policy 1, policy_version 1921862 (0.0007) [2023-12-28 09:02:42,945][106226] Updated weights for policy 0, policy_version 1917490 (0.0008) [2023-12-28 09:02:42,985][106225] Updated weights for policy 1, policy_version 1921872 (0.0005) [2023-12-28 09:02:43,002][106226] Updated weights for policy 0, policy_version 1917500 (0.0009) [2023-12-28 09:02:43,045][106225] Updated weights for policy 1, policy_version 1921882 (0.0006) [2023-12-28 09:02:43,063][106226] Updated weights for policy 0, policy_version 1917510 (0.0008) [2023-12-28 09:02:43,698][106225] Updated weights for policy 1, policy_version 1921892 (0.0007) [2023-12-28 09:02:43,742][106225] Updated weights for policy 1, policy_version 1921902 (0.0008) [2023-12-28 09:02:43,787][106225] Updated weights for policy 1, policy_version 1921912 (0.0008) [2023-12-28 09:02:43,809][106226] Updated weights for policy 0, policy_version 1917520 (0.0005) [2023-12-28 09:02:43,859][106226] Updated weights for policy 0, policy_version 1917530 (0.0005) [2023-12-28 09:02:43,905][106226] Updated weights for policy 0, policy_version 1917540 (0.0005) [2023-12-28 09:02:44,499][106226] Updated weights for policy 0, policy_version 1917550 (0.0008) [2023-12-28 09:02:44,532][106225] Updated weights for policy 1, policy_version 1921922 (0.0009) [2023-12-28 09:02:44,551][106226] Updated weights for policy 0, policy_version 1917560 (0.0008) [2023-12-28 09:02:44,589][106225] Updated weights for policy 1, policy_version 1921932 (0.0010) [2023-12-28 09:02:44,602][106226] Updated weights for policy 0, policy_version 1917570 (0.0009) [2023-12-28 09:02:44,645][106225] Updated weights for policy 1, policy_version 1921942 (0.0010) [2023-12-28 09:02:44,699][106225] Updated weights for policy 1, policy_version 1921952 (0.0010) [2023-12-28 09:02:45,340][106226] Updated weights for policy 0, policy_version 1917580 (0.0007) [2023-12-28 09:02:45,403][106226] Updated weights for policy 0, policy_version 1917590 (0.0007) [2023-12-28 09:02:45,446][106225] Updated weights for policy 1, policy_version 1921962 (0.0007) [2023-12-28 09:02:45,471][106226] Updated weights for policy 0, policy_version 1917600 (0.0006) [2023-12-28 09:02:45,507][106225] Updated weights for policy 1, policy_version 1921972 (0.0006) [2023-12-28 09:02:45,568][106225] Updated weights for policy 1, policy_version 1921982 (0.0005) [2023-12-28 09:02:46,128][106226] Updated weights for policy 0, policy_version 1917610 (0.0006) [2023-12-28 09:02:46,152][106225] Updated weights for policy 1, policy_version 1921992 (0.0006) [2023-12-28 09:02:46,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 983072768. Throughput: 0: 10044.8, 1: 9818.3. Samples: 983066524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:02:46,175][105115] Avg episode reward: [(0, '-4.417'), (1, '-4.614')] [2023-12-28 09:02:46,193][106226] Updated weights for policy 0, policy_version 1917620 (0.0008) [2023-12-28 09:02:46,199][106225] Updated weights for policy 1, policy_version 1922002 (0.0005) [2023-12-28 09:02:46,247][106225] Updated weights for policy 1, policy_version 1922012 (0.0007) [2023-12-28 09:02:46,257][106226] Updated weights for policy 0, policy_version 1917630 (0.0008) [2023-12-28 09:02:46,309][106226] Updated weights for policy 0, policy_version 1917640 (0.0005) [2023-12-28 09:02:46,906][106225] Updated weights for policy 1, policy_version 1922022 (0.0007) [2023-12-28 09:02:46,928][106226] Updated weights for policy 0, policy_version 1917650 (0.0010) [2023-12-28 09:02:46,960][106225] Updated weights for policy 1, policy_version 1922032 (0.0005) [2023-12-28 09:02:46,989][106226] Updated weights for policy 0, policy_version 1917660 (0.0007) [2023-12-28 09:02:47,021][106225] Updated weights for policy 1, policy_version 1922042 (0.0007) [2023-12-28 09:02:47,047][106226] Updated weights for policy 0, policy_version 1917670 (0.0006) [2023-12-28 09:02:47,537][106225] Updated weights for policy 1, policy_version 1922052 (0.0005) [2023-12-28 09:02:47,577][106226] Updated weights for policy 0, policy_version 1917680 (0.0005) [2023-12-28 09:02:47,582][106225] Updated weights for policy 1, policy_version 1922062 (0.0006) [2023-12-28 09:02:47,634][106226] Updated weights for policy 0, policy_version 1917690 (0.0006) [2023-12-28 09:02:47,639][106225] Updated weights for policy 1, policy_version 1922072 (0.0008) [2023-12-28 09:02:47,680][106226] Updated weights for policy 0, policy_version 1917700 (0.0005) [2023-12-28 09:02:48,342][106226] Updated weights for policy 0, policy_version 1917710 (0.0008) [2023-12-28 09:02:48,373][106225] Updated weights for policy 1, policy_version 1922082 (0.0008) [2023-12-28 09:02:48,396][106226] Updated weights for policy 0, policy_version 1917720 (0.0008) [2023-12-28 09:02:48,432][106225] Updated weights for policy 1, policy_version 1922092 (0.0008) [2023-12-28 09:02:48,455][106226] Updated weights for policy 0, policy_version 1917730 (0.0010) [2023-12-28 09:02:48,481][106225] Updated weights for policy 1, policy_version 1922102 (0.0008) [2023-12-28 09:02:48,528][106225] Updated weights for policy 1, policy_version 1922112 (0.0010) [2023-12-28 09:02:49,172][106226] Updated weights for policy 0, policy_version 1917740 (0.0010) [2023-12-28 09:02:49,237][106226] Updated weights for policy 0, policy_version 1917750 (0.0007) [2023-12-28 09:02:49,285][106225] Updated weights for policy 1, policy_version 1922122 (0.0007) [2023-12-28 09:02:49,300][106226] Updated weights for policy 0, policy_version 1917760 (0.0006) [2023-12-28 09:02:49,347][106225] Updated weights for policy 1, policy_version 1922132 (0.0009) [2023-12-28 09:02:49,417][106225] Updated weights for policy 1, policy_version 1922142 (0.0008) [2023-12-28 09:02:49,990][106226] Updated weights for policy 0, policy_version 1917770 (0.0007) [2023-12-28 09:02:50,050][106226] Updated weights for policy 0, policy_version 1917780 (0.0009) [2023-12-28 09:02:50,114][106226] Updated weights for policy 0, policy_version 1917790 (0.0009) [2023-12-28 09:02:50,159][106226] Updated weights for policy 0, policy_version 1917800 (0.0008) [2023-12-28 09:02:50,196][106225] Updated weights for policy 1, policy_version 1922152 (0.0009) [2023-12-28 09:02:50,253][106225] Updated weights for policy 1, policy_version 1922162 (0.0009) [2023-12-28 09:02:50,312][106225] Updated weights for policy 1, policy_version 1922172 (0.0008) [2023-12-28 09:02:50,903][106226] Updated weights for policy 0, policy_version 1917810 (0.0010) [2023-12-28 09:02:50,965][106226] Updated weights for policy 0, policy_version 1917820 (0.0011) [2023-12-28 09:02:51,033][106226] Updated weights for policy 0, policy_version 1917830 (0.0010) [2023-12-28 09:02:51,074][106225] Updated weights for policy 1, policy_version 1922182 (0.0008) [2023-12-28 09:02:51,141][106225] Updated weights for policy 1, policy_version 1922192 (0.0008) [2023-12-28 09:02:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 983179264. Throughput: 0: 10125.6, 1: 9840.2. Samples: 983189912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:02:51,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-4.492')] [2023-12-28 09:02:51,208][106225] Updated weights for policy 1, policy_version 1922202 (0.0008) [2023-12-28 09:02:51,798][106226] Updated weights for policy 0, policy_version 1917840 (0.0008) [2023-12-28 09:02:51,849][106226] Updated weights for policy 0, policy_version 1917850 (0.0007) [2023-12-28 09:02:51,904][106226] Updated weights for policy 0, policy_version 1917860 (0.0007) [2023-12-28 09:02:51,984][106225] Updated weights for policy 1, policy_version 1922212 (0.0008) [2023-12-28 09:02:52,043][106225] Updated weights for policy 1, policy_version 1922222 (0.0007) [2023-12-28 09:02:52,111][106225] Updated weights for policy 1, policy_version 1922232 (0.0008) [2023-12-28 09:02:52,611][106226] Updated weights for policy 0, policy_version 1917870 (0.0010) [2023-12-28 09:02:52,661][106226] Updated weights for policy 0, policy_version 1917880 (0.0010) [2023-12-28 09:02:52,713][106226] Updated weights for policy 0, policy_version 1917890 (0.0008) [2023-12-28 09:02:52,901][106225] Updated weights for policy 1, policy_version 1922242 (0.0008) [2023-12-28 09:02:52,957][106225] Updated weights for policy 1, policy_version 1922252 (0.0007) [2023-12-28 09:02:53,012][106225] Updated weights for policy 1, policy_version 1922262 (0.0008) [2023-12-28 09:02:53,059][106225] Updated weights for policy 1, policy_version 1922272 (0.0007) [2023-12-28 09:02:53,437][106226] Updated weights for policy 0, policy_version 1917900 (0.0010) [2023-12-28 09:02:53,490][106226] Updated weights for policy 0, policy_version 1917910 (0.0010) [2023-12-28 09:02:53,539][106226] Updated weights for policy 0, policy_version 1917920 (0.0010) [2023-12-28 09:02:53,805][106225] Updated weights for policy 1, policy_version 1922282 (0.0007) [2023-12-28 09:02:53,858][106225] Updated weights for policy 1, policy_version 1922292 (0.0007) [2023-12-28 09:02:53,921][106225] Updated weights for policy 1, policy_version 1922302 (0.0008) [2023-12-28 09:02:54,240][106226] Updated weights for policy 0, policy_version 1917930 (0.0010) [2023-12-28 09:02:54,298][106226] Updated weights for policy 0, policy_version 1917940 (0.0006) [2023-12-28 09:02:54,356][106226] Updated weights for policy 0, policy_version 1917950 (0.0008) [2023-12-28 09:02:54,413][106226] Updated weights for policy 0, policy_version 1917960 (0.0009) [2023-12-28 09:02:54,664][106225] Updated weights for policy 1, policy_version 1922312 (0.0008) [2023-12-28 09:02:54,712][106225] Updated weights for policy 1, policy_version 1922322 (0.0008) [2023-12-28 09:02:54,756][106225] Updated weights for policy 1, policy_version 1922332 (0.0008) [2023-12-28 09:02:55,051][106226] Updated weights for policy 0, policy_version 1917970 (0.0007) [2023-12-28 09:02:55,116][106226] Updated weights for policy 0, policy_version 1917980 (0.0006) [2023-12-28 09:02:55,175][106226] Updated weights for policy 0, policy_version 1917990 (0.0006) [2023-12-28 09:02:55,556][106225] Updated weights for policy 1, policy_version 1922342 (0.0008) [2023-12-28 09:02:55,600][106225] Updated weights for policy 1, policy_version 1922352 (0.0008) [2023-12-28 09:02:55,654][106225] Updated weights for policy 1, policy_version 1922362 (0.0009) [2023-12-28 09:02:55,795][106226] Updated weights for policy 0, policy_version 1918000 (0.0008) [2023-12-28 09:02:55,839][106226] Updated weights for policy 0, policy_version 1918010 (0.0008) [2023-12-28 09:02:55,896][106226] Updated weights for policy 0, policy_version 1918020 (0.0009) [2023-12-28 09:02:56,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.5, 300 sec: 19771.9). Total num frames: 983277568. Throughput: 0: 10117.0, 1: 9807.6. Samples: 983246576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:02:56,175][105115] Avg episode reward: [(0, '-4.488'), (1, '-4.660')] [2023-12-28 09:02:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001922368_492183552.pth... [2023-12-28 09:02:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001918024_491094016.pth... [2023-12-28 09:02:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001921248_491896832.pth [2023-12-28 09:02:56,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001916840_490790912.pth [2023-12-28 09:02:56,387][106225] Updated weights for policy 1, policy_version 1922372 (0.0008) [2023-12-28 09:02:56,441][106225] Updated weights for policy 1, policy_version 1922382 (0.0009) [2023-12-28 09:02:56,486][106225] Updated weights for policy 1, policy_version 1922392 (0.0006) [2023-12-28 09:02:56,598][106226] Updated weights for policy 0, policy_version 1918030 (0.0007) [2023-12-28 09:02:56,654][106226] Updated weights for policy 0, policy_version 1918040 (0.0010) [2023-12-28 09:02:56,709][106226] Updated weights for policy 0, policy_version 1918050 (0.0010) [2023-12-28 09:02:57,225][106225] Updated weights for policy 1, policy_version 1922402 (0.0009) [2023-12-28 09:02:57,280][106225] Updated weights for policy 1, policy_version 1922412 (0.0007) [2023-12-28 09:02:57,349][106225] Updated weights for policy 1, policy_version 1922422 (0.0008) [2023-12-28 09:02:57,399][106225] Updated weights for policy 1, policy_version 1922432 (0.0008) [2023-12-28 09:02:57,402][106226] Updated weights for policy 0, policy_version 1918060 (0.0008) [2023-12-28 09:02:57,458][106226] Updated weights for policy 0, policy_version 1918070 (0.0009) [2023-12-28 09:02:57,513][106226] Updated weights for policy 0, policy_version 1918080 (0.0010) [2023-12-28 09:02:58,093][106225] Updated weights for policy 1, policy_version 1922442 (0.0007) [2023-12-28 09:02:58,154][106225] Updated weights for policy 1, policy_version 1922452 (0.0006) [2023-12-28 09:02:58,203][106225] Updated weights for policy 1, policy_version 1922462 (0.0007) [2023-12-28 09:02:58,214][106226] Updated weights for policy 0, policy_version 1918090 (0.0010) [2023-12-28 09:02:58,289][106226] Updated weights for policy 0, policy_version 1918100 (0.0011) [2023-12-28 09:02:58,363][106226] Updated weights for policy 0, policy_version 1918110 (0.0010) [2023-12-28 09:02:58,427][106226] Updated weights for policy 0, policy_version 1918120 (0.0010) [2023-12-28 09:02:58,957][106225] Updated weights for policy 1, policy_version 1922472 (0.0006) [2023-12-28 09:02:59,012][106225] Updated weights for policy 1, policy_version 1922482 (0.0008) [2023-12-28 09:02:59,075][106225] Updated weights for policy 1, policy_version 1922492 (0.0008) [2023-12-28 09:02:59,263][106226] Updated weights for policy 0, policy_version 1918130 (0.0007) [2023-12-28 09:02:59,334][106226] Updated weights for policy 0, policy_version 1918140 (0.0009) [2023-12-28 09:02:59,403][106226] Updated weights for policy 0, policy_version 1918150 (0.0007) [2023-12-28 09:02:59,809][106225] Updated weights for policy 1, policy_version 1922502 (0.0007) [2023-12-28 09:02:59,876][106225] Updated weights for policy 1, policy_version 1922512 (0.0008) [2023-12-28 09:02:59,939][106225] Updated weights for policy 1, policy_version 1922522 (0.0009) [2023-12-28 09:03:00,007][106226] Updated weights for policy 0, policy_version 1918160 (0.0006) [2023-12-28 09:03:00,063][106226] Updated weights for policy 0, policy_version 1918170 (0.0007) [2023-12-28 09:03:00,125][106226] Updated weights for policy 0, policy_version 1918180 (0.0007) [2023-12-28 09:03:00,593][106225] Updated weights for policy 1, policy_version 1922532 (0.0007) [2023-12-28 09:03:00,658][106225] Updated weights for policy 1, policy_version 1922542 (0.0005) [2023-12-28 09:03:00,718][106225] Updated weights for policy 1, policy_version 1922552 (0.0005) [2023-12-28 09:03:00,764][106226] Updated weights for policy 0, policy_version 1918190 (0.0009) [2023-12-28 09:03:00,821][106226] Updated weights for policy 0, policy_version 1918200 (0.0007) [2023-12-28 09:03:00,883][106226] Updated weights for policy 0, policy_version 1918210 (0.0008) [2023-12-28 09:03:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 983375872. Throughput: 0: 10103.1, 1: 9816.4. Samples: 983363692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:01,175][105115] Avg episode reward: [(0, '-4.436'), (1, '-4.530')] [2023-12-28 09:03:01,398][106225] Updated weights for policy 1, policy_version 1922562 (0.0006) [2023-12-28 09:03:01,461][106225] Updated weights for policy 1, policy_version 1922572 (0.0008) [2023-12-28 09:03:01,524][106225] Updated weights for policy 1, policy_version 1922582 (0.0008) [2023-12-28 09:03:01,590][106225] Updated weights for policy 1, policy_version 1922592 (0.0007) [2023-12-28 09:03:01,621][106226] Updated weights for policy 0, policy_version 1918220 (0.0009) [2023-12-28 09:03:01,688][106226] Updated weights for policy 0, policy_version 1918230 (0.0008) [2023-12-28 09:03:01,756][106226] Updated weights for policy 0, policy_version 1918240 (0.0008) [2023-12-28 09:03:02,365][106225] Updated weights for policy 1, policy_version 1922602 (0.0008) [2023-12-28 09:03:02,432][106225] Updated weights for policy 1, policy_version 1922612 (0.0008) [2023-12-28 09:03:02,474][106226] Updated weights for policy 0, policy_version 1918250 (0.0008) [2023-12-28 09:03:02,503][106225] Updated weights for policy 1, policy_version 1922622 (0.0009) [2023-12-28 09:03:02,537][106226] Updated weights for policy 0, policy_version 1918260 (0.0006) [2023-12-28 09:03:02,594][106226] Updated weights for policy 0, policy_version 1918270 (0.0006) [2023-12-28 09:03:02,663][106226] Updated weights for policy 0, policy_version 1918280 (0.0010) [2023-12-28 09:03:03,094][106225] Updated weights for policy 1, policy_version 1922632 (0.0009) [2023-12-28 09:03:03,141][106225] Updated weights for policy 1, policy_version 1922642 (0.0005) [2023-12-28 09:03:03,190][106225] Updated weights for policy 1, policy_version 1922652 (0.0008) [2023-12-28 09:03:03,334][106226] Updated weights for policy 0, policy_version 1918290 (0.0005) [2023-12-28 09:03:03,377][106226] Updated weights for policy 0, policy_version 1918300 (0.0005) [2023-12-28 09:03:03,427][106226] Updated weights for policy 0, policy_version 1918310 (0.0005) [2023-12-28 09:03:03,848][106225] Updated weights for policy 1, policy_version 1922662 (0.0008) [2023-12-28 09:03:03,911][106225] Updated weights for policy 1, policy_version 1922672 (0.0007) [2023-12-28 09:03:03,979][106226] Updated weights for policy 0, policy_version 1918320 (0.0006) [2023-12-28 09:03:03,981][106225] Updated weights for policy 1, policy_version 1922682 (0.0007) [2023-12-28 09:03:04,036][106226] Updated weights for policy 0, policy_version 1918330 (0.0005) [2023-12-28 09:03:04,103][106226] Updated weights for policy 0, policy_version 1918340 (0.0008) [2023-12-28 09:03:04,608][106225] Updated weights for policy 1, policy_version 1922692 (0.0008) [2023-12-28 09:03:04,669][106225] Updated weights for policy 1, policy_version 1922702 (0.0010) [2023-12-28 09:03:04,731][106225] Updated weights for policy 1, policy_version 1922712 (0.0009) [2023-12-28 09:03:04,769][106226] Updated weights for policy 0, policy_version 1918350 (0.0008) [2023-12-28 09:03:04,817][106226] Updated weights for policy 0, policy_version 1918360 (0.0007) [2023-12-28 09:03:04,869][106226] Updated weights for policy 0, policy_version 1918370 (0.0007) [2023-12-28 09:03:05,445][106225] Updated weights for policy 1, policy_version 1922722 (0.0007) [2023-12-28 09:03:05,492][106225] Updated weights for policy 1, policy_version 1922732 (0.0010) [2023-12-28 09:03:05,526][106226] Updated weights for policy 0, policy_version 1918380 (0.0007) [2023-12-28 09:03:05,536][106225] Updated weights for policy 1, policy_version 1922742 (0.0010) [2023-12-28 09:03:05,583][106225] Updated weights for policy 1, policy_version 1922752 (0.0010) [2023-12-28 09:03:05,585][106226] Updated weights for policy 0, policy_version 1918390 (0.0006) [2023-12-28 09:03:05,650][106226] Updated weights for policy 0, policy_version 1918400 (0.0007) [2023-12-28 09:03:06,174][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 983474176. Throughput: 0: 10073.9, 1: 9870.5. Samples: 983486212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:06,175][105115] Avg episode reward: [(0, '-4.241'), (1, '-4.318')] [2023-12-28 09:03:06,315][106225] Updated weights for policy 1, policy_version 1922762 (0.0011) [2023-12-28 09:03:06,377][106225] Updated weights for policy 1, policy_version 1922772 (0.0011) [2023-12-28 09:03:06,399][106226] Updated weights for policy 0, policy_version 1918410 (0.0007) [2023-12-28 09:03:06,436][106225] Updated weights for policy 1, policy_version 1922782 (0.0010) [2023-12-28 09:03:06,454][106226] Updated weights for policy 0, policy_version 1918420 (0.0006) [2023-12-28 09:03:06,516][106226] Updated weights for policy 0, policy_version 1918430 (0.0008) [2023-12-28 09:03:06,575][106226] Updated weights for policy 0, policy_version 1918440 (0.0008) [2023-12-28 09:03:07,178][106225] Updated weights for policy 1, policy_version 1922792 (0.0011) [2023-12-28 09:03:07,240][106225] Updated weights for policy 1, policy_version 1922802 (0.0011) [2023-12-28 09:03:07,244][106226] Updated weights for policy 0, policy_version 1918450 (0.0005) [2023-12-28 09:03:07,298][106226] Updated weights for policy 0, policy_version 1918460 (0.0005) [2023-12-28 09:03:07,301][106225] Updated weights for policy 1, policy_version 1922812 (0.0011) [2023-12-28 09:03:07,356][106226] Updated weights for policy 0, policy_version 1918470 (0.0008) [2023-12-28 09:03:07,910][106226] Updated weights for policy 0, policy_version 1918480 (0.0005) [2023-12-28 09:03:07,925][106225] Updated weights for policy 1, policy_version 1922822 (0.0009) [2023-12-28 09:03:07,966][106226] Updated weights for policy 0, policy_version 1918490 (0.0005) [2023-12-28 09:03:07,985][106225] Updated weights for policy 1, policy_version 1922832 (0.0008) [2023-12-28 09:03:08,028][106226] Updated weights for policy 0, policy_version 1918500 (0.0005) [2023-12-28 09:03:08,046][106225] Updated weights for policy 1, policy_version 1922842 (0.0009) [2023-12-28 09:03:08,615][106226] Updated weights for policy 0, policy_version 1918510 (0.0009) [2023-12-28 09:03:08,675][106226] Updated weights for policy 0, policy_version 1918520 (0.0010) [2023-12-28 09:03:08,729][106226] Updated weights for policy 0, policy_version 1918530 (0.0010) [2023-12-28 09:03:08,825][106225] Updated weights for policy 1, policy_version 1922852 (0.0009) [2023-12-28 09:03:08,883][106225] Updated weights for policy 1, policy_version 1922862 (0.0010) [2023-12-28 09:03:08,936][106225] Updated weights for policy 1, policy_version 1922872 (0.0009) [2023-12-28 09:03:09,306][106226] Updated weights for policy 0, policy_version 1918540 (0.0009) [2023-12-28 09:03:09,378][106226] Updated weights for policy 0, policy_version 1918550 (0.0010) [2023-12-28 09:03:09,442][106226] Updated weights for policy 0, policy_version 1918560 (0.0008) [2023-12-28 09:03:09,791][106225] Updated weights for policy 1, policy_version 1922882 (0.0008) [2023-12-28 09:03:09,860][106225] Updated weights for policy 1, policy_version 1922892 (0.0008) [2023-12-28 09:03:09,930][106225] Updated weights for policy 1, policy_version 1922902 (0.0007) [2023-12-28 09:03:10,000][106225] Updated weights for policy 1, policy_version 1922912 (0.0008) [2023-12-28 09:03:10,193][106226] Updated weights for policy 0, policy_version 1918570 (0.0010) [2023-12-28 09:03:10,260][106226] Updated weights for policy 0, policy_version 1918580 (0.0011) [2023-12-28 09:03:10,321][106226] Updated weights for policy 0, policy_version 1918590 (0.0011) [2023-12-28 09:03:10,386][106226] Updated weights for policy 0, policy_version 1918600 (0.0011) [2023-12-28 09:03:10,739][106225] Updated weights for policy 1, policy_version 1922922 (0.0008) [2023-12-28 09:03:10,788][106225] Updated weights for policy 1, policy_version 1922932 (0.0007) [2023-12-28 09:03:10,836][106225] Updated weights for policy 1, policy_version 1922942 (0.0009) [2023-12-28 09:03:11,121][106226] Updated weights for policy 0, policy_version 1918610 (0.0011) [2023-12-28 09:03:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 983572480. Throughput: 0: 10132.6, 1: 9876.2. Samples: 983548516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:11,175][105115] Avg episode reward: [(0, '-4.389'), (1, '-4.643')] [2023-12-28 09:03:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001922944_492331008.pth... [2023-12-28 09:03:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001921792_492036096.pth [2023-12-28 09:03:11,192][106226] Updated weights for policy 0, policy_version 1918620 (0.0010) [2023-12-28 09:03:11,253][106226] Updated weights for policy 0, policy_version 1918630 (0.0008) [2023-12-28 09:03:11,266][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001918632_491249664.pth... [2023-12-28 09:03:11,270][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001917448_490946560.pth [2023-12-28 09:03:11,684][106225] Updated weights for policy 1, policy_version 1922952 (0.0008) [2023-12-28 09:03:11,746][106225] Updated weights for policy 1, policy_version 1922962 (0.0009) [2023-12-28 09:03:11,807][106225] Updated weights for policy 1, policy_version 1922972 (0.0008) [2023-12-28 09:03:12,012][106226] Updated weights for policy 0, policy_version 1918640 (0.0008) [2023-12-28 09:03:12,068][106226] Updated weights for policy 0, policy_version 1918650 (0.0008) [2023-12-28 09:03:12,131][106226] Updated weights for policy 0, policy_version 1918660 (0.0010) [2023-12-28 09:03:12,598][106225] Updated weights for policy 1, policy_version 1922982 (0.0007) [2023-12-28 09:03:12,658][106225] Updated weights for policy 1, policy_version 1922992 (0.0006) [2023-12-28 09:03:12,717][106225] Updated weights for policy 1, policy_version 1923002 (0.0006) [2023-12-28 09:03:12,945][106226] Updated weights for policy 0, policy_version 1918670 (0.0010) [2023-12-28 09:03:13,005][106226] Updated weights for policy 0, policy_version 1918680 (0.0008) [2023-12-28 09:03:13,070][106226] Updated weights for policy 0, policy_version 1918690 (0.0009) [2023-12-28 09:03:13,385][106225] Updated weights for policy 1, policy_version 1923012 (0.0006) [2023-12-28 09:03:13,446][106225] Updated weights for policy 1, policy_version 1923022 (0.0007) [2023-12-28 09:03:13,505][106225] Updated weights for policy 1, policy_version 1923032 (0.0008) [2023-12-28 09:03:13,834][106226] Updated weights for policy 0, policy_version 1918700 (0.0008) [2023-12-28 09:03:13,892][106226] Updated weights for policy 0, policy_version 1918710 (0.0009) [2023-12-28 09:03:13,952][106226] Updated weights for policy 0, policy_version 1918720 (0.0008) [2023-12-28 09:03:14,183][106225] Updated weights for policy 1, policy_version 1923042 (0.0008) [2023-12-28 09:03:14,236][106225] Updated weights for policy 1, policy_version 1923052 (0.0008) [2023-12-28 09:03:14,299][106225] Updated weights for policy 1, policy_version 1923062 (0.0009) [2023-12-28 09:03:14,357][106225] Updated weights for policy 1, policy_version 1923072 (0.0009) [2023-12-28 09:03:14,603][106226] Updated weights for policy 0, policy_version 1918730 (0.0008) [2023-12-28 09:03:14,656][106226] Updated weights for policy 0, policy_version 1918740 (0.0008) [2023-12-28 09:03:14,716][106226] Updated weights for policy 0, policy_version 1918750 (0.0009) [2023-12-28 09:03:14,779][106226] Updated weights for policy 0, policy_version 1918760 (0.0010) [2023-12-28 09:03:15,088][106225] Updated weights for policy 1, policy_version 1923082 (0.0009) [2023-12-28 09:03:15,149][106225] Updated weights for policy 1, policy_version 1923092 (0.0006) [2023-12-28 09:03:15,213][106225] Updated weights for policy 1, policy_version 1923102 (0.0007) [2023-12-28 09:03:15,583][106226] Updated weights for policy 0, policy_version 1918770 (0.0008) [2023-12-28 09:03:15,652][106226] Updated weights for policy 0, policy_version 1918780 (0.0005) [2023-12-28 09:03:15,715][106226] Updated weights for policy 0, policy_version 1918790 (0.0009) [2023-12-28 09:03:15,807][106225] Updated weights for policy 1, policy_version 1923112 (0.0008) [2023-12-28 09:03:15,852][106225] Updated weights for policy 1, policy_version 1923122 (0.0008) [2023-12-28 09:03:15,915][106225] Updated weights for policy 1, policy_version 1923132 (0.0009) [2023-12-28 09:03:16,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 983670784. Throughput: 0: 9996.2, 1: 9654.9. Samples: 983659540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:16,176][105115] Avg episode reward: [(0, '-4.218'), (1, '-4.591')] [2023-12-28 09:03:16,397][106226] Updated weights for policy 0, policy_version 1918800 (0.0008) [2023-12-28 09:03:16,452][106226] Updated weights for policy 0, policy_version 1918810 (0.0009) [2023-12-28 09:03:16,517][106226] Updated weights for policy 0, policy_version 1918820 (0.0010) [2023-12-28 09:03:16,616][106225] Updated weights for policy 1, policy_version 1923142 (0.0006) [2023-12-28 09:03:16,672][106225] Updated weights for policy 1, policy_version 1923152 (0.0005) [2023-12-28 09:03:16,721][106225] Updated weights for policy 1, policy_version 1923162 (0.0005) [2023-12-28 09:03:17,102][106226] Updated weights for policy 0, policy_version 1918830 (0.0007) [2023-12-28 09:03:17,165][106226] Updated weights for policy 0, policy_version 1918840 (0.0009) [2023-12-28 09:03:17,220][106226] Updated weights for policy 0, policy_version 1918850 (0.0009) [2023-12-28 09:03:17,393][106225] Updated weights for policy 1, policy_version 1923172 (0.0005) [2023-12-28 09:03:17,451][106225] Updated weights for policy 1, policy_version 1923182 (0.0005) [2023-12-28 09:03:17,516][106225] Updated weights for policy 1, policy_version 1923192 (0.0005) [2023-12-28 09:03:18,003][106226] Updated weights for policy 0, policy_version 1918860 (0.0009) [2023-12-28 09:03:18,063][106226] Updated weights for policy 0, policy_version 1918870 (0.0008) [2023-12-28 09:03:18,113][106226] Updated weights for policy 0, policy_version 1918880 (0.0008) [2023-12-28 09:03:18,122][106225] Updated weights for policy 1, policy_version 1923202 (0.0006) [2023-12-28 09:03:18,176][106225] Updated weights for policy 1, policy_version 1923212 (0.0010) [2023-12-28 09:03:18,226][106225] Updated weights for policy 1, policy_version 1923222 (0.0010) [2023-12-28 09:03:18,287][106225] Updated weights for policy 1, policy_version 1923232 (0.0010) [2023-12-28 09:03:18,875][106226] Updated weights for policy 0, policy_version 1918890 (0.0007) [2023-12-28 09:03:18,933][106226] Updated weights for policy 0, policy_version 1918900 (0.0006) [2023-12-28 09:03:18,985][106226] Updated weights for policy 0, policy_version 1918910 (0.0006) [2023-12-28 09:03:19,032][106226] Updated weights for policy 0, policy_version 1918920 (0.0005) [2023-12-28 09:03:19,067][106225] Updated weights for policy 1, policy_version 1923242 (0.0009) [2023-12-28 09:03:19,116][106225] Updated weights for policy 1, policy_version 1923252 (0.0009) [2023-12-28 09:03:19,178][106225] Updated weights for policy 1, policy_version 1923262 (0.0008) [2023-12-28 09:03:19,712][106226] Updated weights for policy 0, policy_version 1918930 (0.0008) [2023-12-28 09:03:19,773][106226] Updated weights for policy 0, policy_version 1918940 (0.0007) [2023-12-28 09:03:19,842][106226] Updated weights for policy 0, policy_version 1918950 (0.0007) [2023-12-28 09:03:20,013][106225] Updated weights for policy 1, policy_version 1923272 (0.0006) [2023-12-28 09:03:20,077][106225] Updated weights for policy 1, policy_version 1923282 (0.0006) [2023-12-28 09:03:20,139][106225] Updated weights for policy 1, policy_version 1923292 (0.0008) [2023-12-28 09:03:20,574][106226] Updated weights for policy 0, policy_version 1918960 (0.0009) [2023-12-28 09:03:20,632][106226] Updated weights for policy 0, policy_version 1918970 (0.0009) [2023-12-28 09:03:20,693][106226] Updated weights for policy 0, policy_version 1918980 (0.0009) [2023-12-28 09:03:20,836][106225] Updated weights for policy 1, policy_version 1923302 (0.0008) [2023-12-28 09:03:20,902][106225] Updated weights for policy 1, policy_version 1923312 (0.0008) [2023-12-28 09:03:20,969][106225] Updated weights for policy 1, policy_version 1923322 (0.0009) [2023-12-28 09:03:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 983769088. Throughput: 0: 9979.4, 1: 9672.0. Samples: 983777712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:21,175][105115] Avg episode reward: [(0, '-4.112'), (1, '-4.503')] [2023-12-28 09:03:21,468][106226] Updated weights for policy 0, policy_version 1918990 (0.0009) [2023-12-28 09:03:21,528][106226] Updated weights for policy 0, policy_version 1919000 (0.0008) [2023-12-28 09:03:21,589][106226] Updated weights for policy 0, policy_version 1919010 (0.0006) [2023-12-28 09:03:21,642][106225] Updated weights for policy 1, policy_version 1923332 (0.0009) [2023-12-28 09:03:21,704][106225] Updated weights for policy 1, policy_version 1923342 (0.0008) [2023-12-28 09:03:21,774][106225] Updated weights for policy 1, policy_version 1923352 (0.0008) [2023-12-28 09:03:22,402][106226] Updated weights for policy 0, policy_version 1919020 (0.0008) [2023-12-28 09:03:22,420][106225] Updated weights for policy 1, policy_version 1923362 (0.0008) [2023-12-28 09:03:22,461][106226] Updated weights for policy 0, policy_version 1919030 (0.0008) [2023-12-28 09:03:22,488][106225] Updated weights for policy 1, policy_version 1923372 (0.0008) [2023-12-28 09:03:22,521][106226] Updated weights for policy 0, policy_version 1919040 (0.0009) [2023-12-28 09:03:22,548][106225] Updated weights for policy 1, policy_version 1923382 (0.0006) [2023-12-28 09:03:22,610][106225] Updated weights for policy 1, policy_version 1923392 (0.0008) [2023-12-28 09:03:23,217][106226] Updated weights for policy 0, policy_version 1919050 (0.0008) [2023-12-28 09:03:23,278][106226] Updated weights for policy 0, policy_version 1919060 (0.0010) [2023-12-28 09:03:23,338][106226] Updated weights for policy 0, policy_version 1919070 (0.0010) [2023-12-28 09:03:23,348][106225] Updated weights for policy 1, policy_version 1923402 (0.0005) [2023-12-28 09:03:23,394][106225] Updated weights for policy 1, policy_version 1923412 (0.0006) [2023-12-28 09:03:23,399][106226] Updated weights for policy 0, policy_version 1919080 (0.0011) [2023-12-28 09:03:23,444][106225] Updated weights for policy 1, policy_version 1923422 (0.0008) [2023-12-28 09:03:24,109][106226] Updated weights for policy 0, policy_version 1919090 (0.0009) [2023-12-28 09:03:24,159][106226] Updated weights for policy 0, policy_version 1919100 (0.0007) [2023-12-28 09:03:24,177][106225] Updated weights for policy 1, policy_version 1923432 (0.0006) [2023-12-28 09:03:24,218][106226] Updated weights for policy 0, policy_version 1919110 (0.0007) [2023-12-28 09:03:24,235][106225] Updated weights for policy 1, policy_version 1923442 (0.0006) [2023-12-28 09:03:24,298][106225] Updated weights for policy 1, policy_version 1923452 (0.0009) [2023-12-28 09:03:24,963][106226] Updated weights for policy 0, policy_version 1919120 (0.0008) [2023-12-28 09:03:25,009][106225] Updated weights for policy 1, policy_version 1923462 (0.0008) [2023-12-28 09:03:25,019][106226] Updated weights for policy 0, policy_version 1919130 (0.0006) [2023-12-28 09:03:25,063][106225] Updated weights for policy 1, policy_version 1923472 (0.0007) [2023-12-28 09:03:25,069][106226] Updated weights for policy 0, policy_version 1919140 (0.0005) [2023-12-28 09:03:25,113][106225] Updated weights for policy 1, policy_version 1923482 (0.0008) [2023-12-28 09:03:25,794][106226] Updated weights for policy 0, policy_version 1919150 (0.0007) [2023-12-28 09:03:25,834][106225] Updated weights for policy 1, policy_version 1923492 (0.0008) [2023-12-28 09:03:25,855][106226] Updated weights for policy 0, policy_version 1919160 (0.0006) [2023-12-28 09:03:25,891][106225] Updated weights for policy 1, policy_version 1923502 (0.0008) [2023-12-28 09:03:25,916][106226] Updated weights for policy 0, policy_version 1919170 (0.0007) [2023-12-28 09:03:25,943][106225] Updated weights for policy 1, policy_version 1923512 (0.0006) [2023-12-28 09:03:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 983867392. Throughput: 0: 9908.3, 1: 9707.7. Samples: 983834936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:26,175][105115] Avg episode reward: [(0, '-4.055'), (1, '-4.660')] [2023-12-28 09:03:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001923520_492478464.pth... [2023-12-28 09:03:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001919176_491388928.pth... [2023-12-28 09:03:26,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001922368_492183552.pth [2023-12-28 09:03:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001918024_491094016.pth [2023-12-28 09:03:26,621][106226] Updated weights for policy 0, policy_version 1919180 (0.0009) [2023-12-28 09:03:26,680][106225] Updated weights for policy 1, policy_version 1923522 (0.0008) [2023-12-28 09:03:26,682][106226] Updated weights for policy 0, policy_version 1919190 (0.0008) [2023-12-28 09:03:26,740][106225] Updated weights for policy 1, policy_version 1923532 (0.0007) [2023-12-28 09:03:26,741][106226] Updated weights for policy 0, policy_version 1919200 (0.0006) [2023-12-28 09:03:26,798][106225] Updated weights for policy 1, policy_version 1923542 (0.0008) [2023-12-28 09:03:26,851][106225] Updated weights for policy 1, policy_version 1923552 (0.0010) [2023-12-28 09:03:27,320][106226] Updated weights for policy 0, policy_version 1919210 (0.0007) [2023-12-28 09:03:27,373][106226] Updated weights for policy 0, policy_version 1919220 (0.0008) [2023-12-28 09:03:27,422][106226] Updated weights for policy 0, policy_version 1919230 (0.0008) [2023-12-28 09:03:27,469][106226] Updated weights for policy 0, policy_version 1919240 (0.0008) [2023-12-28 09:03:27,616][106225] Updated weights for policy 1, policy_version 1923562 (0.0008) [2023-12-28 09:03:27,666][106225] Updated weights for policy 1, policy_version 1923572 (0.0008) [2023-12-28 09:03:27,716][106225] Updated weights for policy 1, policy_version 1923582 (0.0008) [2023-12-28 09:03:28,162][106226] Updated weights for policy 0, policy_version 1919250 (0.0006) [2023-12-28 09:03:28,232][106226] Updated weights for policy 0, policy_version 1919260 (0.0007) [2023-12-28 09:03:28,292][106226] Updated weights for policy 0, policy_version 1919270 (0.0009) [2023-12-28 09:03:28,498][106225] Updated weights for policy 1, policy_version 1923592 (0.0008) [2023-12-28 09:03:28,549][106225] Updated weights for policy 1, policy_version 1923602 (0.0008) [2023-12-28 09:03:28,608][106225] Updated weights for policy 1, policy_version 1923612 (0.0009) [2023-12-28 09:03:28,905][106226] Updated weights for policy 0, policy_version 1919280 (0.0006) [2023-12-28 09:03:28,962][106226] Updated weights for policy 0, policy_version 1919290 (0.0005) [2023-12-28 09:03:29,016][106226] Updated weights for policy 0, policy_version 1919300 (0.0005) [2023-12-28 09:03:29,394][106225] Updated weights for policy 1, policy_version 1923622 (0.0007) [2023-12-28 09:03:29,442][106225] Updated weights for policy 1, policy_version 1923632 (0.0005) [2023-12-28 09:03:29,507][106225] Updated weights for policy 1, policy_version 1923642 (0.0007) [2023-12-28 09:03:29,620][106226] Updated weights for policy 0, policy_version 1919310 (0.0005) [2023-12-28 09:03:29,682][106226] Updated weights for policy 0, policy_version 1919320 (0.0009) [2023-12-28 09:03:29,734][106226] Updated weights for policy 0, policy_version 1919330 (0.0010) [2023-12-28 09:03:30,288][106225] Updated weights for policy 1, policy_version 1923652 (0.0010) [2023-12-28 09:03:30,334][106226] Updated weights for policy 0, policy_version 1919340 (0.0010) [2023-12-28 09:03:30,344][106225] Updated weights for policy 1, policy_version 1923662 (0.0008) [2023-12-28 09:03:30,395][106225] Updated weights for policy 1, policy_version 1923672 (0.0008) [2023-12-28 09:03:30,398][106226] Updated weights for policy 0, policy_version 1919350 (0.0010) [2023-12-28 09:03:30,454][106226] Updated weights for policy 0, policy_version 1919360 (0.0010) [2023-12-28 09:03:31,053][106226] Updated weights for policy 0, policy_version 1919370 (0.0010) [2023-12-28 09:03:31,114][106226] Updated weights for policy 0, policy_version 1919380 (0.0008) [2023-12-28 09:03:31,175][105115] Fps is (10 sec: 18841.7, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 983957504. Throughput: 0: 10012.6, 1: 9714.6. Samples: 983954248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:31,175][105115] Avg episode reward: [(0, '-4.193'), (1, '-4.633')] [2023-12-28 09:03:31,176][106225] Updated weights for policy 1, policy_version 1923682 (0.0006) [2023-12-28 09:03:31,183][106226] Updated weights for policy 0, policy_version 1919390 (0.0008) [2023-12-28 09:03:31,247][106225] Updated weights for policy 1, policy_version 1923692 (0.0008) [2023-12-28 09:03:31,249][106226] Updated weights for policy 0, policy_version 1919400 (0.0009) [2023-12-28 09:03:31,317][106225] Updated weights for policy 1, policy_version 1923702 (0.0007) [2023-12-28 09:03:31,392][106225] Updated weights for policy 1, policy_version 1923712 (0.0009) [2023-12-28 09:03:31,989][106226] Updated weights for policy 0, policy_version 1919410 (0.0009) [2023-12-28 09:03:32,043][106226] Updated weights for policy 0, policy_version 1919420 (0.0005) [2023-12-28 09:03:32,105][106226] Updated weights for policy 0, policy_version 1919430 (0.0008) [2023-12-28 09:03:32,175][106225] Updated weights for policy 1, policy_version 1923722 (0.0009) [2023-12-28 09:03:32,226][106225] Updated weights for policy 1, policy_version 1923732 (0.0009) [2023-12-28 09:03:32,284][106225] Updated weights for policy 1, policy_version 1923742 (0.0008) [2023-12-28 09:03:32,780][106226] Updated weights for policy 0, policy_version 1919440 (0.0007) [2023-12-28 09:03:32,832][106226] Updated weights for policy 0, policy_version 1919450 (0.0006) [2023-12-28 09:03:32,888][106226] Updated weights for policy 0, policy_version 1919460 (0.0006) [2023-12-28 09:03:32,970][106225] Updated weights for policy 1, policy_version 1923752 (0.0007) [2023-12-28 09:03:33,034][106225] Updated weights for policy 1, policy_version 1923762 (0.0007) [2023-12-28 09:03:33,091][106225] Updated weights for policy 1, policy_version 1923772 (0.0007) [2023-12-28 09:03:33,473][106226] Updated weights for policy 0, policy_version 1919470 (0.0006) [2023-12-28 09:03:33,528][106226] Updated weights for policy 0, policy_version 1919480 (0.0006) [2023-12-28 09:03:33,588][106226] Updated weights for policy 0, policy_version 1919490 (0.0009) [2023-12-28 09:03:33,764][106225] Updated weights for policy 1, policy_version 1923782 (0.0007) [2023-12-28 09:03:33,820][106225] Updated weights for policy 1, policy_version 1923792 (0.0006) [2023-12-28 09:03:33,882][106225] Updated weights for policy 1, policy_version 1923802 (0.0010) [2023-12-28 09:03:34,198][106226] Updated weights for policy 0, policy_version 1919500 (0.0008) [2023-12-28 09:03:34,255][106226] Updated weights for policy 0, policy_version 1919510 (0.0006) [2023-12-28 09:03:34,316][106226] Updated weights for policy 0, policy_version 1919520 (0.0005) [2023-12-28 09:03:34,587][106225] Updated weights for policy 1, policy_version 1923812 (0.0007) [2023-12-28 09:03:34,651][106225] Updated weights for policy 1, policy_version 1923822 (0.0008) [2023-12-28 09:03:34,712][106225] Updated weights for policy 1, policy_version 1923832 (0.0008) [2023-12-28 09:03:34,999][106226] Updated weights for policy 0, policy_version 1919530 (0.0007) [2023-12-28 09:03:35,070][106226] Updated weights for policy 0, policy_version 1919540 (0.0010) [2023-12-28 09:03:35,132][106226] Updated weights for policy 0, policy_version 1919550 (0.0008) [2023-12-28 09:03:35,186][106226] Updated weights for policy 0, policy_version 1919560 (0.0008) [2023-12-28 09:03:35,384][106225] Updated weights for policy 1, policy_version 1923842 (0.0007) [2023-12-28 09:03:35,436][106225] Updated weights for policy 1, policy_version 1923852 (0.0005) [2023-12-28 09:03:35,488][106225] Updated weights for policy 1, policy_version 1923862 (0.0007) [2023-12-28 09:03:35,534][106225] Updated weights for policy 1, policy_version 1923872 (0.0005) [2023-12-28 09:03:35,860][106226] Updated weights for policy 0, policy_version 1919570 (0.0005) [2023-12-28 09:03:35,916][106226] Updated weights for policy 0, policy_version 1919580 (0.0005) [2023-12-28 09:03:35,975][106226] Updated weights for policy 0, policy_version 1919590 (0.0005) [2023-12-28 09:03:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 984064000. Throughput: 0: 10041.0, 1: 9637.7. Samples: 984075452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:36,175][105115] Avg episode reward: [(0, '-4.372'), (1, '-4.490')] [2023-12-28 09:03:36,258][106225] Updated weights for policy 1, policy_version 1923882 (0.0006) [2023-12-28 09:03:36,329][106225] Updated weights for policy 1, policy_version 1923892 (0.0006) [2023-12-28 09:03:36,385][106225] Updated weights for policy 1, policy_version 1923902 (0.0005) [2023-12-28 09:03:36,649][106226] Updated weights for policy 0, policy_version 1919600 (0.0008) [2023-12-28 09:03:36,716][106226] Updated weights for policy 0, policy_version 1919610 (0.0008) [2023-12-28 09:03:36,773][106226] Updated weights for policy 0, policy_version 1919620 (0.0009) [2023-12-28 09:03:37,055][106225] Updated weights for policy 1, policy_version 1923912 (0.0008) [2023-12-28 09:03:37,116][106225] Updated weights for policy 1, policy_version 1923922 (0.0008) [2023-12-28 09:03:37,180][106225] Updated weights for policy 1, policy_version 1923932 (0.0010) [2023-12-28 09:03:37,387][106226] Updated weights for policy 0, policy_version 1919630 (0.0007) [2023-12-28 09:03:37,438][106226] Updated weights for policy 0, policy_version 1919640 (0.0005) [2023-12-28 09:03:37,504][106226] Updated weights for policy 0, policy_version 1919650 (0.0006) [2023-12-28 09:03:37,880][106225] Updated weights for policy 1, policy_version 1923942 (0.0007) [2023-12-28 09:03:37,939][106225] Updated weights for policy 1, policy_version 1923952 (0.0006) [2023-12-28 09:03:37,992][106225] Updated weights for policy 1, policy_version 1923962 (0.0005) [2023-12-28 09:03:38,256][106226] Updated weights for policy 0, policy_version 1919660 (0.0008) [2023-12-28 09:03:38,327][106226] Updated weights for policy 0, policy_version 1919670 (0.0008) [2023-12-28 09:03:38,397][106226] Updated weights for policy 0, policy_version 1919680 (0.0010) [2023-12-28 09:03:38,568][106225] Updated weights for policy 1, policy_version 1923972 (0.0006) [2023-12-28 09:03:38,632][106225] Updated weights for policy 1, policy_version 1923982 (0.0005) [2023-12-28 09:03:38,694][106225] Updated weights for policy 1, policy_version 1923992 (0.0007) [2023-12-28 09:03:39,149][106226] Updated weights for policy 0, policy_version 1919690 (0.0010) [2023-12-28 09:03:39,209][106226] Updated weights for policy 0, policy_version 1919700 (0.0009) [2023-12-28 09:03:39,277][106226] Updated weights for policy 0, policy_version 1919710 (0.0008) [2023-12-28 09:03:39,328][106225] Updated weights for policy 1, policy_version 1924002 (0.0006) [2023-12-28 09:03:39,340][106226] Updated weights for policy 0, policy_version 1919720 (0.0008) [2023-12-28 09:03:39,403][106225] Updated weights for policy 1, policy_version 1924012 (0.0008) [2023-12-28 09:03:39,470][106225] Updated weights for policy 1, policy_version 1924022 (0.0008) [2023-12-28 09:03:39,539][106225] Updated weights for policy 1, policy_version 1924032 (0.0009) [2023-12-28 09:03:40,109][106226] Updated weights for policy 0, policy_version 1919730 (0.0008) [2023-12-28 09:03:40,175][106226] Updated weights for policy 0, policy_version 1919740 (0.0009) [2023-12-28 09:03:40,229][106225] Updated weights for policy 1, policy_version 1924042 (0.0007) [2023-12-28 09:03:40,238][106226] Updated weights for policy 0, policy_version 1919750 (0.0006) [2023-12-28 09:03:40,290][106225] Updated weights for policy 1, policy_version 1924052 (0.0006) [2023-12-28 09:03:40,352][106225] Updated weights for policy 1, policy_version 1924062 (0.0006) [2023-12-28 09:03:40,914][106225] Updated weights for policy 1, policy_version 1924072 (0.0007) [2023-12-28 09:03:40,969][106225] Updated weights for policy 1, policy_version 1924082 (0.0007) [2023-12-28 09:03:41,033][106226] Updated weights for policy 0, policy_version 1919760 (0.0007) [2023-12-28 09:03:41,036][106225] Updated weights for policy 1, policy_version 1924092 (0.0007) [2023-12-28 09:03:41,099][106226] Updated weights for policy 0, policy_version 1919770 (0.0008) [2023-12-28 09:03:41,170][106226] Updated weights for policy 0, policy_version 1919780 (0.0008) [2023-12-28 09:03:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 984162304. Throughput: 0: 10040.2, 1: 9708.7. Samples: 984135276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:41,175][105115] Avg episode reward: [(0, '-4.412'), (1, '-4.793')] [2023-12-28 09:03:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001924096_492625920.pth... [2023-12-28 09:03:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001922944_492331008.pth [2023-12-28 09:03:41,195][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001919784_491544576.pth... [2023-12-28 09:03:41,199][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001918632_491249664.pth [2023-12-28 09:03:41,821][106225] Updated weights for policy 1, policy_version 1924102 (0.0009) [2023-12-28 09:03:41,878][106225] Updated weights for policy 1, policy_version 1924112 (0.0009) [2023-12-28 09:03:41,937][106225] Updated weights for policy 1, policy_version 1924122 (0.0008) [2023-12-28 09:03:41,995][106226] Updated weights for policy 0, policy_version 1919790 (0.0008) [2023-12-28 09:03:42,055][106226] Updated weights for policy 0, policy_version 1919800 (0.0009) [2023-12-28 09:03:42,114][106226] Updated weights for policy 0, policy_version 1919810 (0.0008) [2023-12-28 09:03:42,691][106225] Updated weights for policy 1, policy_version 1924132 (0.0008) [2023-12-28 09:03:42,747][106225] Updated weights for policy 1, policy_version 1924142 (0.0008) [2023-12-28 09:03:42,803][106225] Updated weights for policy 1, policy_version 1924152 (0.0009) [2023-12-28 09:03:42,847][106226] Updated weights for policy 0, policy_version 1919820 (0.0006) [2023-12-28 09:03:42,895][106226] Updated weights for policy 0, policy_version 1919830 (0.0005) [2023-12-28 09:03:42,963][106226] Updated weights for policy 0, policy_version 1919840 (0.0010) [2023-12-28 09:03:43,546][106225] Updated weights for policy 1, policy_version 1924162 (0.0008) [2023-12-28 09:03:43,597][106225] Updated weights for policy 1, policy_version 1924172 (0.0008) [2023-12-28 09:03:43,643][106225] Updated weights for policy 1, policy_version 1924182 (0.0009) [2023-12-28 09:03:43,688][106225] Updated weights for policy 1, policy_version 1924192 (0.0008) [2023-12-28 09:03:43,707][106226] Updated weights for policy 0, policy_version 1919850 (0.0011) [2023-12-28 09:03:43,770][106226] Updated weights for policy 0, policy_version 1919860 (0.0011) [2023-12-28 09:03:43,832][106226] Updated weights for policy 0, policy_version 1919870 (0.0011) [2023-12-28 09:03:43,886][106226] Updated weights for policy 0, policy_version 1919880 (0.0007) [2023-12-28 09:03:44,455][106225] Updated weights for policy 1, policy_version 1924202 (0.0008) [2023-12-28 09:03:44,516][106225] Updated weights for policy 1, policy_version 1924212 (0.0008) [2023-12-28 09:03:44,579][106225] Updated weights for policy 1, policy_version 1924222 (0.0008) [2023-12-28 09:03:44,615][106226] Updated weights for policy 0, policy_version 1919890 (0.0007) [2023-12-28 09:03:44,666][106226] Updated weights for policy 0, policy_version 1919900 (0.0005) [2023-12-28 09:03:44,723][106226] Updated weights for policy 0, policy_version 1919910 (0.0005) [2023-12-28 09:03:45,347][106226] Updated weights for policy 0, policy_version 1919920 (0.0008) [2023-12-28 09:03:45,366][106225] Updated weights for policy 1, policy_version 1924232 (0.0005) [2023-12-28 09:03:45,415][106226] Updated weights for policy 0, policy_version 1919930 (0.0008) [2023-12-28 09:03:45,421][106225] Updated weights for policy 1, policy_version 1924242 (0.0007) [2023-12-28 09:03:45,475][106225] Updated weights for policy 1, policy_version 1924252 (0.0006) [2023-12-28 09:03:45,477][106226] Updated weights for policy 0, policy_version 1919940 (0.0008) [2023-12-28 09:03:46,108][106226] Updated weights for policy 0, policy_version 1919950 (0.0006) [2023-12-28 09:03:46,164][106226] Updated weights for policy 0, policy_version 1919960 (0.0005) [2023-12-28 09:03:46,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.7, 300 sec: 19716.3). Total num frames: 984252416. Throughput: 0: 9946.3, 1: 9734.6. Samples: 984249336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:46,176][105115] Avg episode reward: [(0, '-4.542'), (1, '-4.718')] [2023-12-28 09:03:46,227][106226] Updated weights for policy 0, policy_version 1919970 (0.0005) [2023-12-28 09:03:46,243][106225] Updated weights for policy 1, policy_version 1924262 (0.0007) [2023-12-28 09:03:46,300][106225] Updated weights for policy 1, policy_version 1924272 (0.0006) [2023-12-28 09:03:46,359][106225] Updated weights for policy 1, policy_version 1924282 (0.0006) [2023-12-28 09:03:46,891][106226] Updated weights for policy 0, policy_version 1919980 (0.0006) [2023-12-28 09:03:46,962][106226] Updated weights for policy 0, policy_version 1919990 (0.0007) [2023-12-28 09:03:46,984][106225] Updated weights for policy 1, policy_version 1924292 (0.0006) [2023-12-28 09:03:47,021][106226] Updated weights for policy 0, policy_version 1920000 (0.0008) [2023-12-28 09:03:47,044][106225] Updated weights for policy 1, policy_version 1924302 (0.0008) [2023-12-28 09:03:47,103][106225] Updated weights for policy 1, policy_version 1924312 (0.0009) [2023-12-28 09:03:47,618][106226] Updated weights for policy 0, policy_version 1920010 (0.0008) [2023-12-28 09:03:47,681][106226] Updated weights for policy 0, policy_version 1920020 (0.0007) [2023-12-28 09:03:47,744][106226] Updated weights for policy 0, policy_version 1920030 (0.0005) [2023-12-28 09:03:47,790][106225] Updated weights for policy 1, policy_version 1924322 (0.0009) [2023-12-28 09:03:47,795][106226] Updated weights for policy 0, policy_version 1920040 (0.0005) [2023-12-28 09:03:47,840][106225] Updated weights for policy 1, policy_version 1924332 (0.0010) [2023-12-28 09:03:47,897][106225] Updated weights for policy 1, policy_version 1924342 (0.0010) [2023-12-28 09:03:47,966][106225] Updated weights for policy 1, policy_version 1924352 (0.0010) [2023-12-28 09:03:48,368][106226] Updated weights for policy 0, policy_version 1920050 (0.0008) [2023-12-28 09:03:48,431][106226] Updated weights for policy 0, policy_version 1920060 (0.0006) [2023-12-28 09:03:48,498][106226] Updated weights for policy 0, policy_version 1920070 (0.0009) [2023-12-28 09:03:48,710][106225] Updated weights for policy 1, policy_version 1924362 (0.0009) [2023-12-28 09:03:48,773][106225] Updated weights for policy 1, policy_version 1924372 (0.0009) [2023-12-28 09:03:48,828][106225] Updated weights for policy 1, policy_version 1924382 (0.0008) [2023-12-28 09:03:49,162][106226] Updated weights for policy 0, policy_version 1920080 (0.0007) [2023-12-28 09:03:49,221][106226] Updated weights for policy 0, policy_version 1920090 (0.0010) [2023-12-28 09:03:49,283][106226] Updated weights for policy 0, policy_version 1920100 (0.0007) [2023-12-28 09:03:49,627][106225] Updated weights for policy 1, policy_version 1924392 (0.0008) [2023-12-28 09:03:49,684][106225] Updated weights for policy 1, policy_version 1924402 (0.0009) [2023-12-28 09:03:49,736][106225] Updated weights for policy 1, policy_version 1924412 (0.0009) [2023-12-28 09:03:49,938][106226] Updated weights for policy 0, policy_version 1920110 (0.0011) [2023-12-28 09:03:49,998][106226] Updated weights for policy 0, policy_version 1920120 (0.0007) [2023-12-28 09:03:50,060][106226] Updated weights for policy 0, policy_version 1920130 (0.0006) [2023-12-28 09:03:50,606][106226] Updated weights for policy 0, policy_version 1920140 (0.0007) [2023-12-28 09:03:50,613][106225] Updated weights for policy 1, policy_version 1924422 (0.0008) [2023-12-28 09:03:50,674][106226] Updated weights for policy 0, policy_version 1920150 (0.0012) [2023-12-28 09:03:50,675][106225] Updated weights for policy 1, policy_version 1924432 (0.0008) [2023-12-28 09:03:50,736][106225] Updated weights for policy 1, policy_version 1924442 (0.0009) [2023-12-28 09:03:50,739][106226] Updated weights for policy 0, policy_version 1920160 (0.0006) [2023-12-28 09:03:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 984358912. Throughput: 0: 10009.9, 1: 9620.5. Samples: 984369584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:51,175][105115] Avg episode reward: [(0, '-4.579'), (1, '-4.951')] [2023-12-28 09:03:51,375][106226] Updated weights for policy 0, policy_version 1920170 (0.0008) [2023-12-28 09:03:51,437][106226] Updated weights for policy 0, policy_version 1920180 (0.0008) [2023-12-28 09:03:51,479][106225] Updated weights for policy 1, policy_version 1924452 (0.0009) [2023-12-28 09:03:51,497][106226] Updated weights for policy 0, policy_version 1920190 (0.0006) [2023-12-28 09:03:51,530][106225] Updated weights for policy 1, policy_version 1924462 (0.0008) [2023-12-28 09:03:51,557][106226] Updated weights for policy 0, policy_version 1920200 (0.0007) [2023-12-28 09:03:51,582][106225] Updated weights for policy 1, policy_version 1924472 (0.0008) [2023-12-28 09:03:52,319][106226] Updated weights for policy 0, policy_version 1920210 (0.0007) [2023-12-28 09:03:52,354][106225] Updated weights for policy 1, policy_version 1924482 (0.0008) [2023-12-28 09:03:52,388][106226] Updated weights for policy 0, policy_version 1920220 (0.0010) [2023-12-28 09:03:52,419][106225] Updated weights for policy 1, policy_version 1924492 (0.0007) [2023-12-28 09:03:52,447][106226] Updated weights for policy 0, policy_version 1920230 (0.0007) [2023-12-28 09:03:52,474][106225] Updated weights for policy 1, policy_version 1924502 (0.0007) [2023-12-28 09:03:52,536][106225] Updated weights for policy 1, policy_version 1924512 (0.0008) [2023-12-28 09:03:53,140][106226] Updated weights for policy 0, policy_version 1920240 (0.0005) [2023-12-28 09:03:53,209][106226] Updated weights for policy 0, policy_version 1920250 (0.0005) [2023-12-28 09:03:53,263][106226] Updated weights for policy 0, policy_version 1920260 (0.0005) [2023-12-28 09:03:53,283][106225] Updated weights for policy 1, policy_version 1924522 (0.0009) [2023-12-28 09:03:53,333][106225] Updated weights for policy 1, policy_version 1924532 (0.0009) [2023-12-28 09:03:53,392][106225] Updated weights for policy 1, policy_version 1924542 (0.0009) [2023-12-28 09:03:53,786][106226] Updated weights for policy 0, policy_version 1920270 (0.0005) [2023-12-28 09:03:53,847][106226] Updated weights for policy 0, policy_version 1920280 (0.0005) [2023-12-28 09:03:53,903][106226] Updated weights for policy 0, policy_version 1920290 (0.0008) [2023-12-28 09:03:54,243][106225] Updated weights for policy 1, policy_version 1924552 (0.0009) [2023-12-28 09:03:54,309][106225] Updated weights for policy 1, policy_version 1924562 (0.0009) [2023-12-28 09:03:54,372][106225] Updated weights for policy 1, policy_version 1924572 (0.0008) [2023-12-28 09:03:54,441][106226] Updated weights for policy 0, policy_version 1920300 (0.0007) [2023-12-28 09:03:54,502][106226] Updated weights for policy 0, policy_version 1920310 (0.0011) [2023-12-28 09:03:54,570][106226] Updated weights for policy 0, policy_version 1920320 (0.0011) [2023-12-28 09:03:55,092][106225] Updated weights for policy 1, policy_version 1924582 (0.0007) [2023-12-28 09:03:55,162][106225] Updated weights for policy 1, policy_version 1924592 (0.0006) [2023-12-28 09:03:55,227][106225] Updated weights for policy 1, policy_version 1924602 (0.0006) [2023-12-28 09:03:55,233][106226] Updated weights for policy 0, policy_version 1920330 (0.0010) [2023-12-28 09:03:55,280][106226] Updated weights for policy 0, policy_version 1920340 (0.0007) [2023-12-28 09:03:55,327][106226] Updated weights for policy 0, policy_version 1920350 (0.0007) [2023-12-28 09:03:55,375][106226] Updated weights for policy 0, policy_version 1920360 (0.0008) [2023-12-28 09:03:55,777][106225] Updated weights for policy 1, policy_version 1924612 (0.0009) [2023-12-28 09:03:55,822][106225] Updated weights for policy 1, policy_version 1924622 (0.0009) [2023-12-28 09:03:55,878][106225] Updated weights for policy 1, policy_version 1924632 (0.0008) [2023-12-28 09:03:56,117][106226] Updated weights for policy 0, policy_version 1920370 (0.0008) [2023-12-28 09:03:56,168][106226] Updated weights for policy 0, policy_version 1920380 (0.0007) [2023-12-28 09:03:56,175][105115] Fps is (10 sec: 20479.1, 60 sec: 19660.6, 300 sec: 19744.1). Total num frames: 984457216. Throughput: 0: 9972.4, 1: 9579.3. Samples: 984428352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:03:56,177][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.398')] [2023-12-28 09:03:56,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001924640_492765184.pth... [2023-12-28 09:03:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001923520_492478464.pth [2023-12-28 09:03:56,229][106226] Updated weights for policy 0, policy_version 1920390 (0.0008) [2023-12-28 09:03:56,236][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001920392_491700224.pth... [2023-12-28 09:03:56,239][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001919176_491388928.pth [2023-12-28 09:03:56,531][106225] Updated weights for policy 1, policy_version 1924642 (0.0008) [2023-12-28 09:03:56,582][106225] Updated weights for policy 1, policy_version 1924652 (0.0005) [2023-12-28 09:03:56,637][106225] Updated weights for policy 1, policy_version 1924662 (0.0005) [2023-12-28 09:03:56,690][106225] Updated weights for policy 1, policy_version 1924672 (0.0005) [2023-12-28 09:03:56,842][106226] Updated weights for policy 0, policy_version 1920400 (0.0011) [2023-12-28 09:03:56,898][106226] Updated weights for policy 0, policy_version 1920410 (0.0010) [2023-12-28 09:03:56,950][106226] Updated weights for policy 0, policy_version 1920420 (0.0010) [2023-12-28 09:03:57,328][106225] Updated weights for policy 1, policy_version 1924682 (0.0006) [2023-12-28 09:03:57,378][106225] Updated weights for policy 1, policy_version 1924692 (0.0006) [2023-12-28 09:03:57,432][106225] Updated weights for policy 1, policy_version 1924702 (0.0009) [2023-12-28 09:03:57,603][106226] Updated weights for policy 0, policy_version 1920430 (0.0008) [2023-12-28 09:03:57,656][106226] Updated weights for policy 0, policy_version 1920440 (0.0008) [2023-12-28 09:03:57,706][106226] Updated weights for policy 0, policy_version 1920450 (0.0008) [2023-12-28 09:03:58,088][106225] Updated weights for policy 1, policy_version 1924712 (0.0008) [2023-12-28 09:03:58,136][106225] Updated weights for policy 1, policy_version 1924722 (0.0008) [2023-12-28 09:03:58,191][106225] Updated weights for policy 1, policy_version 1924732 (0.0008) [2023-12-28 09:03:58,413][106226] Updated weights for policy 0, policy_version 1920460 (0.0008) [2023-12-28 09:03:58,482][106226] Updated weights for policy 0, policy_version 1920470 (0.0008) [2023-12-28 09:03:58,550][106226] Updated weights for policy 0, policy_version 1920480 (0.0008) [2023-12-28 09:03:59,073][106225] Updated weights for policy 1, policy_version 1924742 (0.0009) [2023-12-28 09:03:59,131][106225] Updated weights for policy 1, policy_version 1924752 (0.0007) [2023-12-28 09:03:59,197][106225] Updated weights for policy 1, policy_version 1924762 (0.0007) [2023-12-28 09:03:59,364][106226] Updated weights for policy 0, policy_version 1920490 (0.0008) [2023-12-28 09:03:59,428][106226] Updated weights for policy 0, policy_version 1920500 (0.0007) [2023-12-28 09:03:59,483][106226] Updated weights for policy 0, policy_version 1920510 (0.0005) [2023-12-28 09:03:59,537][106226] Updated weights for policy 0, policy_version 1920520 (0.0007) [2023-12-28 09:03:59,892][106225] Updated weights for policy 1, policy_version 1924772 (0.0007) [2023-12-28 09:03:59,961][106225] Updated weights for policy 1, policy_version 1924782 (0.0008) [2023-12-28 09:04:00,021][106225] Updated weights for policy 1, policy_version 1924792 (0.0010) [2023-12-28 09:04:00,256][106226] Updated weights for policy 0, policy_version 1920530 (0.0005) [2023-12-28 09:04:00,323][106226] Updated weights for policy 0, policy_version 1920540 (0.0006) [2023-12-28 09:04:00,381][106226] Updated weights for policy 0, policy_version 1920550 (0.0009) [2023-12-28 09:04:00,603][106225] Updated weights for policy 1, policy_version 1924802 (0.0007) [2023-12-28 09:04:00,650][106225] Updated weights for policy 1, policy_version 1924812 (0.0005) [2023-12-28 09:04:00,701][106225] Updated weights for policy 1, policy_version 1924822 (0.0005) [2023-12-28 09:04:00,755][106225] Updated weights for policy 1, policy_version 1924832 (0.0005) [2023-12-28 09:04:01,125][106226] Updated weights for policy 0, policy_version 1920560 (0.0008) [2023-12-28 09:04:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 984555520. Throughput: 0: 10067.4, 1: 9679.6. Samples: 984548152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:01,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.706')] [2023-12-28 09:04:01,193][106226] Updated weights for policy 0, policy_version 1920570 (0.0009) [2023-12-28 09:04:01,254][106226] Updated weights for policy 0, policy_version 1920580 (0.0007) [2023-12-28 09:04:01,386][106225] Updated weights for policy 1, policy_version 1924842 (0.0011) [2023-12-28 09:04:01,435][106225] Updated weights for policy 1, policy_version 1924852 (0.0006) [2023-12-28 09:04:01,498][106225] Updated weights for policy 1, policy_version 1924862 (0.0007) [2023-12-28 09:04:02,047][106226] Updated weights for policy 0, policy_version 1920590 (0.0009) [2023-12-28 09:04:02,102][106226] Updated weights for policy 0, policy_version 1920600 (0.0008) [2023-12-28 09:04:02,158][106226] Updated weights for policy 0, policy_version 1920610 (0.0006) [2023-12-28 09:04:02,163][106225] Updated weights for policy 1, policy_version 1924872 (0.0008) [2023-12-28 09:04:02,224][106225] Updated weights for policy 1, policy_version 1924882 (0.0008) [2023-12-28 09:04:02,287][106225] Updated weights for policy 1, policy_version 1924892 (0.0008) [2023-12-28 09:04:02,820][106226] Updated weights for policy 0, policy_version 1920620 (0.0007) [2023-12-28 09:04:02,874][106226] Updated weights for policy 0, policy_version 1920630 (0.0008) [2023-12-28 09:04:02,922][106225] Updated weights for policy 1, policy_version 1924902 (0.0009) [2023-12-28 09:04:02,928][106226] Updated weights for policy 0, policy_version 1920640 (0.0008) [2023-12-28 09:04:02,976][106225] Updated weights for policy 1, policy_version 1924912 (0.0007) [2023-12-28 09:04:03,030][106225] Updated weights for policy 1, policy_version 1924922 (0.0008) [2023-12-28 09:04:03,624][106226] Updated weights for policy 0, policy_version 1920650 (0.0007) [2023-12-28 09:04:03,677][106226] Updated weights for policy 0, policy_version 1920660 (0.0006) [2023-12-28 09:04:03,708][106225] Updated weights for policy 1, policy_version 1924932 (0.0006) [2023-12-28 09:04:03,729][106226] Updated weights for policy 0, policy_version 1920670 (0.0005) [2023-12-28 09:04:03,759][106225] Updated weights for policy 1, policy_version 1924942 (0.0008) [2023-12-28 09:04:03,773][106226] Updated weights for policy 0, policy_version 1920680 (0.0005) [2023-12-28 09:04:03,814][106225] Updated weights for policy 1, policy_version 1924952 (0.0009) [2023-12-28 09:04:04,470][106226] Updated weights for policy 0, policy_version 1920690 (0.0006) [2023-12-28 09:04:04,522][106226] Updated weights for policy 0, policy_version 1920700 (0.0005) [2023-12-28 09:04:04,535][106225] Updated weights for policy 1, policy_version 1924963 (0.0009) [2023-12-28 09:04:04,580][106226] Updated weights for policy 0, policy_version 1920710 (0.0008) [2023-12-28 09:04:04,592][106225] Updated weights for policy 1, policy_version 1924973 (0.0010) [2023-12-28 09:04:04,649][106225] Updated weights for policy 1, policy_version 1924983 (0.0010) [2023-12-28 09:04:05,243][106225] Updated weights for policy 1, policy_version 1924993 (0.0007) [2023-12-28 09:04:05,298][106225] Updated weights for policy 1, policy_version 1925003 (0.0005) [2023-12-28 09:04:05,340][106226] Updated weights for policy 0, policy_version 1920720 (0.0007) [2023-12-28 09:04:05,350][106225] Updated weights for policy 1, policy_version 1925013 (0.0005) [2023-12-28 09:04:05,401][106226] Updated weights for policy 0, policy_version 1920730 (0.0009) [2023-12-28 09:04:05,407][106225] Updated weights for policy 1, policy_version 1925023 (0.0006) [2023-12-28 09:04:05,454][106226] Updated weights for policy 0, policy_version 1920740 (0.0008) [2023-12-28 09:04:06,039][106225] Updated weights for policy 1, policy_version 1925033 (0.0007) [2023-12-28 09:04:06,096][106225] Updated weights for policy 1, policy_version 1925043 (0.0009) [2023-12-28 09:04:06,164][106225] Updated weights for policy 1, policy_version 1925053 (0.0007) [2023-12-28 09:04:06,175][105115] Fps is (10 sec: 19661.8, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 984653824. Throughput: 0: 10072.5, 1: 9771.1. Samples: 984670676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:06,175][105115] Avg episode reward: [(0, '-4.335'), (1, '-4.712')] [2023-12-28 09:04:06,180][106226] Updated weights for policy 0, policy_version 1920750 (0.0007) [2023-12-28 09:04:06,244][106226] Updated weights for policy 0, policy_version 1920760 (0.0008) [2023-12-28 09:04:06,311][106226] Updated weights for policy 0, policy_version 1920770 (0.0009) [2023-12-28 09:04:06,893][106225] Updated weights for policy 1, policy_version 1925063 (0.0006) [2023-12-28 09:04:06,946][106225] Updated weights for policy 1, policy_version 1925073 (0.0006) [2023-12-28 09:04:07,001][106225] Updated weights for policy 1, policy_version 1925083 (0.0008) [2023-12-28 09:04:07,037][106226] Updated weights for policy 0, policy_version 1920780 (0.0009) [2023-12-28 09:04:07,093][106226] Updated weights for policy 0, policy_version 1920790 (0.0009) [2023-12-28 09:04:07,146][106226] Updated weights for policy 0, policy_version 1920800 (0.0009) [2023-12-28 09:04:07,620][106225] Updated weights for policy 1, policy_version 1925093 (0.0007) [2023-12-28 09:04:07,677][106225] Updated weights for policy 1, policy_version 1925103 (0.0005) [2023-12-28 09:04:07,735][106225] Updated weights for policy 1, policy_version 1925113 (0.0006) [2023-12-28 09:04:07,853][106226] Updated weights for policy 0, policy_version 1920810 (0.0007) [2023-12-28 09:04:07,920][106226] Updated weights for policy 0, policy_version 1920820 (0.0011) [2023-12-28 09:04:07,982][106226] Updated weights for policy 0, policy_version 1920830 (0.0011) [2023-12-28 09:04:08,033][106226] Updated weights for policy 0, policy_version 1920840 (0.0010) [2023-12-28 09:04:08,343][106225] Updated weights for policy 1, policy_version 1925123 (0.0006) [2023-12-28 09:04:08,391][106225] Updated weights for policy 1, policy_version 1925133 (0.0006) [2023-12-28 09:04:08,443][106225] Updated weights for policy 1, policy_version 1925143 (0.0005) [2023-12-28 09:04:08,735][106226] Updated weights for policy 0, policy_version 1920850 (0.0011) [2023-12-28 09:04:08,800][106226] Updated weights for policy 0, policy_version 1920860 (0.0011) [2023-12-28 09:04:08,866][106226] Updated weights for policy 0, policy_version 1920870 (0.0011) [2023-12-28 09:04:09,051][106225] Updated weights for policy 1, policy_version 1925153 (0.0007) [2023-12-28 09:04:09,112][106225] Updated weights for policy 1, policy_version 1925163 (0.0007) [2023-12-28 09:04:09,165][106225] Updated weights for policy 1, policy_version 1925173 (0.0009) [2023-12-28 09:04:09,232][106225] Updated weights for policy 1, policy_version 1925183 (0.0010) [2023-12-28 09:04:09,545][106226] Updated weights for policy 0, policy_version 1920880 (0.0009) [2023-12-28 09:04:09,611][106226] Updated weights for policy 0, policy_version 1920890 (0.0007) [2023-12-28 09:04:09,677][106226] Updated weights for policy 0, policy_version 1920900 (0.0006) [2023-12-28 09:04:10,086][106225] Updated weights for policy 1, policy_version 1925193 (0.0009) [2023-12-28 09:04:10,154][106225] Updated weights for policy 1, policy_version 1925203 (0.0008) [2023-12-28 09:04:10,210][106225] Updated weights for policy 1, policy_version 1925213 (0.0008) [2023-12-28 09:04:10,362][106226] Updated weights for policy 0, policy_version 1920910 (0.0008) [2023-12-28 09:04:10,422][106226] Updated weights for policy 0, policy_version 1920920 (0.0008) [2023-12-28 09:04:10,490][106226] Updated weights for policy 0, policy_version 1920930 (0.0009) [2023-12-28 09:04:10,987][106225] Updated weights for policy 1, policy_version 1925223 (0.0010) [2023-12-28 09:04:11,060][106225] Updated weights for policy 1, policy_version 1925233 (0.0010) [2023-12-28 09:04:11,121][106225] Updated weights for policy 1, policy_version 1925243 (0.0010) [2023-12-28 09:04:11,144][106226] Updated weights for policy 0, policy_version 1920940 (0.0009) [2023-12-28 09:04:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 984760320. Throughput: 0: 10097.0, 1: 9841.3. Samples: 984732164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:11,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.602')] [2023-12-28 09:04:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001925248_492920832.pth... [2023-12-28 09:04:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001924096_492625920.pth [2023-12-28 09:04:11,214][106226] Updated weights for policy 0, policy_version 1920950 (0.0007) [2023-12-28 09:04:11,291][106226] Updated weights for policy 0, policy_version 1920960 (0.0007) [2023-12-28 09:04:11,346][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001920968_491847680.pth... [2023-12-28 09:04:11,353][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001919784_491544576.pth [2023-12-28 09:04:11,907][106225] Updated weights for policy 1, policy_version 1925253 (0.0009) [2023-12-28 09:04:11,976][106225] Updated weights for policy 1, policy_version 1925263 (0.0006) [2023-12-28 09:04:12,021][106226] Updated weights for policy 0, policy_version 1920970 (0.0008) [2023-12-28 09:04:12,047][106225] Updated weights for policy 1, policy_version 1925273 (0.0007) [2023-12-28 09:04:12,086][106226] Updated weights for policy 0, policy_version 1920980 (0.0006) [2023-12-28 09:04:12,149][106226] Updated weights for policy 0, policy_version 1920990 (0.0007) [2023-12-28 09:04:12,215][106226] Updated weights for policy 0, policy_version 1921000 (0.0007) [2023-12-28 09:04:12,766][106225] Updated weights for policy 1, policy_version 1925283 (0.0007) [2023-12-28 09:04:12,830][106226] Updated weights for policy 0, policy_version 1921010 (0.0007) [2023-12-28 09:04:12,835][106225] Updated weights for policy 1, policy_version 1925293 (0.0008) [2023-12-28 09:04:12,886][106226] Updated weights for policy 0, policy_version 1921020 (0.0007) [2023-12-28 09:04:12,894][106225] Updated weights for policy 1, policy_version 1925303 (0.0009) [2023-12-28 09:04:12,949][106226] Updated weights for policy 0, policy_version 1921030 (0.0009) [2023-12-28 09:04:13,595][106226] Updated weights for policy 0, policy_version 1921040 (0.0006) [2023-12-28 09:04:13,624][106225] Updated weights for policy 1, policy_version 1925313 (0.0009) [2023-12-28 09:04:13,650][106226] Updated weights for policy 0, policy_version 1921050 (0.0007) [2023-12-28 09:04:13,679][106225] Updated weights for policy 1, policy_version 1925323 (0.0010) [2023-12-28 09:04:13,705][106226] Updated weights for policy 0, policy_version 1921060 (0.0006) [2023-12-28 09:04:13,731][106225] Updated weights for policy 1, policy_version 1925333 (0.0010) [2023-12-28 09:04:13,778][106225] Updated weights for policy 1, policy_version 1925343 (0.0010) [2023-12-28 09:04:14,357][106226] Updated weights for policy 0, policy_version 1921070 (0.0007) [2023-12-28 09:04:14,408][106226] Updated weights for policy 0, policy_version 1921080 (0.0008) [2023-12-28 09:04:14,463][106226] Updated weights for policy 0, policy_version 1921090 (0.0009) [2023-12-28 09:04:14,512][106225] Updated weights for policy 1, policy_version 1925353 (0.0009) [2023-12-28 09:04:14,565][106225] Updated weights for policy 1, policy_version 1925363 (0.0007) [2023-12-28 09:04:14,617][106225] Updated weights for policy 1, policy_version 1925373 (0.0008) [2023-12-28 09:04:15,198][106226] Updated weights for policy 0, policy_version 1921100 (0.0006) [2023-12-28 09:04:15,262][106226] Updated weights for policy 0, policy_version 1921110 (0.0009) [2023-12-28 09:04:15,322][106226] Updated weights for policy 0, policy_version 1921120 (0.0008) [2023-12-28 09:04:15,359][106225] Updated weights for policy 1, policy_version 1925383 (0.0009) [2023-12-28 09:04:15,417][106225] Updated weights for policy 1, policy_version 1925393 (0.0008) [2023-12-28 09:04:15,477][106225] Updated weights for policy 1, policy_version 1925403 (0.0009) [2023-12-28 09:04:15,946][106226] Updated weights for policy 0, policy_version 1921130 (0.0007) [2023-12-28 09:04:16,007][106226] Updated weights for policy 0, policy_version 1921140 (0.0009) [2023-12-28 09:04:16,067][106226] Updated weights for policy 0, policy_version 1921150 (0.0009) [2023-12-28 09:04:16,095][106225] Updated weights for policy 1, policy_version 1925413 (0.0007) [2023-12-28 09:04:16,122][106226] Updated weights for policy 0, policy_version 1921160 (0.0008) [2023-12-28 09:04:16,153][106225] Updated weights for policy 1, policy_version 1925423 (0.0007) [2023-12-28 09:04:16,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19771.9). Total num frames: 984858624. Throughput: 0: 10041.7, 1: 9813.3. Samples: 984847720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:16,175][105115] Avg episode reward: [(0, '-4.447'), (1, '-4.353')] [2023-12-28 09:04:16,203][106225] Updated weights for policy 1, policy_version 1925433 (0.0006) [2023-12-28 09:04:16,843][106226] Updated weights for policy 0, policy_version 1921170 (0.0010) [2023-12-28 09:04:16,847][106225] Updated weights for policy 1, policy_version 1925443 (0.0007) [2023-12-28 09:04:16,891][106226] Updated weights for policy 0, policy_version 1921180 (0.0005) [2023-12-28 09:04:16,900][106225] Updated weights for policy 1, policy_version 1925453 (0.0010) [2023-12-28 09:04:16,941][106226] Updated weights for policy 0, policy_version 1921190 (0.0005) [2023-12-28 09:04:16,954][106225] Updated weights for policy 1, policy_version 1925463 (0.0010) [2023-12-28 09:04:17,550][106226] Updated weights for policy 0, policy_version 1921200 (0.0010) [2023-12-28 09:04:17,616][106226] Updated weights for policy 0, policy_version 1921210 (0.0011) [2023-12-28 09:04:17,671][106226] Updated weights for policy 0, policy_version 1921220 (0.0008) [2023-12-28 09:04:17,708][106225] Updated weights for policy 1, policy_version 1925473 (0.0010) [2023-12-28 09:04:17,757][106225] Updated weights for policy 1, policy_version 1925483 (0.0008) [2023-12-28 09:04:17,805][106225] Updated weights for policy 1, policy_version 1925493 (0.0007) [2023-12-28 09:04:17,862][106225] Updated weights for policy 1, policy_version 1925503 (0.0008) [2023-12-28 09:04:18,374][106226] Updated weights for policy 0, policy_version 1921230 (0.0011) [2023-12-28 09:04:18,432][106226] Updated weights for policy 0, policy_version 1921240 (0.0011) [2023-12-28 09:04:18,490][106226] Updated weights for policy 0, policy_version 1921250 (0.0011) [2023-12-28 09:04:18,612][106225] Updated weights for policy 1, policy_version 1925513 (0.0008) [2023-12-28 09:04:18,666][106225] Updated weights for policy 1, policy_version 1925523 (0.0007) [2023-12-28 09:04:18,728][106225] Updated weights for policy 1, policy_version 1925533 (0.0006) [2023-12-28 09:04:19,215][106226] Updated weights for policy 0, policy_version 1921260 (0.0010) [2023-12-28 09:04:19,283][106226] Updated weights for policy 0, policy_version 1921270 (0.0010) [2023-12-28 09:04:19,348][106226] Updated weights for policy 0, policy_version 1921280 (0.0010) [2023-12-28 09:04:19,364][106225] Updated weights for policy 1, policy_version 1925543 (0.0008) [2023-12-28 09:04:19,419][106225] Updated weights for policy 1, policy_version 1925553 (0.0006) [2023-12-28 09:04:19,472][106225] Updated weights for policy 1, policy_version 1925563 (0.0007) [2023-12-28 09:04:20,128][106226] Updated weights for policy 0, policy_version 1921290 (0.0009) [2023-12-28 09:04:20,184][106226] Updated weights for policy 0, policy_version 1921300 (0.0008) [2023-12-28 09:04:20,247][106226] Updated weights for policy 0, policy_version 1921310 (0.0009) [2023-12-28 09:04:20,255][106225] Updated weights for policy 1, policy_version 1925573 (0.0008) [2023-12-28 09:04:20,298][106226] Updated weights for policy 0, policy_version 1921320 (0.0007) [2023-12-28 09:04:20,313][106225] Updated weights for policy 1, policy_version 1925583 (0.0008) [2023-12-28 09:04:20,379][106225] Updated weights for policy 1, policy_version 1925593 (0.0008) [2023-12-28 09:04:21,038][106226] Updated weights for policy 0, policy_version 1921330 (0.0008) [2023-12-28 09:04:21,101][106225] Updated weights for policy 1, policy_version 1925603 (0.0008) [2023-12-28 09:04:21,108][106226] Updated weights for policy 0, policy_version 1921340 (0.0009) [2023-12-28 09:04:21,168][106225] Updated weights for policy 1, policy_version 1925613 (0.0011) [2023-12-28 09:04:21,173][106226] Updated weights for policy 0, policy_version 1921350 (0.0007) [2023-12-28 09:04:21,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 984948736. Throughput: 0: 9940.3, 1: 9857.6. Samples: 984966360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:21,175][105115] Avg episode reward: [(0, '-4.245'), (1, '-4.470')] [2023-12-28 09:04:21,233][106225] Updated weights for policy 1, policy_version 1925623 (0.0009) [2023-12-28 09:04:21,963][106226] Updated weights for policy 0, policy_version 1921360 (0.0008) [2023-12-28 09:04:22,004][106225] Updated weights for policy 1, policy_version 1925633 (0.0008) [2023-12-28 09:04:22,022][106226] Updated weights for policy 0, policy_version 1921370 (0.0008) [2023-12-28 09:04:22,057][106225] Updated weights for policy 1, policy_version 1925643 (0.0006) [2023-12-28 09:04:22,078][106226] Updated weights for policy 0, policy_version 1921380 (0.0007) [2023-12-28 09:04:22,113][106225] Updated weights for policy 1, policy_version 1925653 (0.0007) [2023-12-28 09:04:22,173][106225] Updated weights for policy 1, policy_version 1925663 (0.0009) [2023-12-28 09:04:22,851][106225] Updated weights for policy 1, policy_version 1925673 (0.0009) [2023-12-28 09:04:22,861][106226] Updated weights for policy 0, policy_version 1921390 (0.0007) [2023-12-28 09:04:22,906][106225] Updated weights for policy 1, policy_version 1925683 (0.0008) [2023-12-28 09:04:22,915][106226] Updated weights for policy 0, policy_version 1921400 (0.0006) [2023-12-28 09:04:22,970][106225] Updated weights for policy 1, policy_version 1925693 (0.0008) [2023-12-28 09:04:22,976][106226] Updated weights for policy 0, policy_version 1921410 (0.0006) [2023-12-28 09:04:23,606][106225] Updated weights for policy 1, policy_version 1925703 (0.0008) [2023-12-28 09:04:23,654][106225] Updated weights for policy 1, policy_version 1925713 (0.0007) [2023-12-28 09:04:23,712][106225] Updated weights for policy 1, policy_version 1925723 (0.0006) [2023-12-28 09:04:23,717][106226] Updated weights for policy 0, policy_version 1921420 (0.0008) [2023-12-28 09:04:23,779][106226] Updated weights for policy 0, policy_version 1921430 (0.0008) [2023-12-28 09:04:23,839][106226] Updated weights for policy 0, policy_version 1921440 (0.0009) [2023-12-28 09:04:24,354][106225] Updated weights for policy 1, policy_version 1925733 (0.0007) [2023-12-28 09:04:24,413][106225] Updated weights for policy 1, policy_version 1925743 (0.0008) [2023-12-28 09:04:24,476][106225] Updated weights for policy 1, policy_version 1925753 (0.0006) [2023-12-28 09:04:24,587][106226] Updated weights for policy 0, policy_version 1921450 (0.0009) [2023-12-28 09:04:24,651][106226] Updated weights for policy 0, policy_version 1921460 (0.0011) [2023-12-28 09:04:24,707][106226] Updated weights for policy 0, policy_version 1921470 (0.0010) [2023-12-28 09:04:24,763][106226] Updated weights for policy 0, policy_version 1921480 (0.0010) [2023-12-28 09:04:25,198][106225] Updated weights for policy 1, policy_version 1925763 (0.0007) [2023-12-28 09:04:25,245][106225] Updated weights for policy 1, policy_version 1925773 (0.0008) [2023-12-28 09:04:25,305][106225] Updated weights for policy 1, policy_version 1925783 (0.0008) [2023-12-28 09:04:25,406][106226] Updated weights for policy 0, policy_version 1921490 (0.0005) [2023-12-28 09:04:25,462][106226] Updated weights for policy 0, policy_version 1921500 (0.0005) [2023-12-28 09:04:25,530][106226] Updated weights for policy 0, policy_version 1921510 (0.0005) [2023-12-28 09:04:26,032][106225] Updated weights for policy 1, policy_version 1925793 (0.0008) [2023-12-28 09:04:26,083][106225] Updated weights for policy 1, policy_version 1925803 (0.0008) [2023-12-28 09:04:26,112][106226] Updated weights for policy 0, policy_version 1921520 (0.0006) [2023-12-28 09:04:26,134][106225] Updated weights for policy 1, policy_version 1925813 (0.0006) [2023-12-28 09:04:26,161][106226] Updated weights for policy 0, policy_version 1921530 (0.0006) [2023-12-28 09:04:26,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 985047040. Throughput: 0: 9895.6, 1: 9816.1. Samples: 985022304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:26,175][105115] Avg episode reward: [(0, '-4.211'), (1, '-4.579')] [2023-12-28 09:04:26,184][106225] Updated weights for policy 1, policy_version 1925823 (0.0006) [2023-12-28 09:04:26,189][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001925824_493068288.pth... [2023-12-28 09:04:26,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001924640_492765184.pth [2023-12-28 09:04:26,222][106226] Updated weights for policy 0, policy_version 1921540 (0.0009) [2023-12-28 09:04:26,244][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001921544_491995136.pth... [2023-12-28 09:04:26,248][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001920392_491700224.pth [2023-12-28 09:04:26,880][106226] Updated weights for policy 0, policy_version 1921550 (0.0008) [2023-12-28 09:04:26,926][106226] Updated weights for policy 0, policy_version 1921560 (0.0006) [2023-12-28 09:04:26,942][106225] Updated weights for policy 1, policy_version 1925833 (0.0008) [2023-12-28 09:04:26,976][106226] Updated weights for policy 0, policy_version 1921570 (0.0005) [2023-12-28 09:04:26,989][106225] Updated weights for policy 1, policy_version 1925843 (0.0008) [2023-12-28 09:04:27,046][106225] Updated weights for policy 1, policy_version 1925853 (0.0009) [2023-12-28 09:04:27,564][106226] Updated weights for policy 0, policy_version 1921580 (0.0009) [2023-12-28 09:04:27,629][106226] Updated weights for policy 0, policy_version 1921590 (0.0010) [2023-12-28 09:04:27,693][106226] Updated weights for policy 0, policy_version 1921600 (0.0011) [2023-12-28 09:04:27,709][106225] Updated weights for policy 1, policy_version 1925863 (0.0005) [2023-12-28 09:04:27,767][106225] Updated weights for policy 1, policy_version 1925873 (0.0005) [2023-12-28 09:04:27,812][106225] Updated weights for policy 1, policy_version 1925883 (0.0005) [2023-12-28 09:04:28,335][106225] Updated weights for policy 1, policy_version 1925893 (0.0006) [2023-12-28 09:04:28,392][106226] Updated weights for policy 0, policy_version 1921610 (0.0010) [2023-12-28 09:04:28,398][106225] Updated weights for policy 1, policy_version 1925903 (0.0008) [2023-12-28 09:04:28,447][106226] Updated weights for policy 0, policy_version 1921620 (0.0008) [2023-12-28 09:04:28,459][106225] Updated weights for policy 1, policy_version 1925913 (0.0007) [2023-12-28 09:04:28,506][106226] Updated weights for policy 0, policy_version 1921630 (0.0008) [2023-12-28 09:04:28,557][106226] Updated weights for policy 0, policy_version 1921640 (0.0008) [2023-12-28 09:04:29,184][106225] Updated weights for policy 1, policy_version 1925923 (0.0008) [2023-12-28 09:04:29,249][106225] Updated weights for policy 1, policy_version 1925933 (0.0008) [2023-12-28 09:04:29,315][106225] Updated weights for policy 1, policy_version 1925943 (0.0008) [2023-12-28 09:04:29,322][106226] Updated weights for policy 0, policy_version 1921650 (0.0008) [2023-12-28 09:04:29,388][106226] Updated weights for policy 0, policy_version 1921660 (0.0007) [2023-12-28 09:04:29,454][106226] Updated weights for policy 0, policy_version 1921670 (0.0008) [2023-12-28 09:04:29,929][106225] Updated weights for policy 1, policy_version 1925953 (0.0007) [2023-12-28 09:04:29,997][106225] Updated weights for policy 1, policy_version 1925963 (0.0007) [2023-12-28 09:04:30,055][106225] Updated weights for policy 1, policy_version 1925973 (0.0009) [2023-12-28 09:04:30,112][106225] Updated weights for policy 1, policy_version 1925983 (0.0008) [2023-12-28 09:04:30,145][106226] Updated weights for policy 0, policy_version 1921680 (0.0009) [2023-12-28 09:04:30,210][106226] Updated weights for policy 0, policy_version 1921690 (0.0007) [2023-12-28 09:04:30,265][106226] Updated weights for policy 0, policy_version 1921700 (0.0005) [2023-12-28 09:04:30,848][106226] Updated weights for policy 0, policy_version 1921710 (0.0006) [2023-12-28 09:04:30,882][106225] Updated weights for policy 1, policy_version 1925993 (0.0008) [2023-12-28 09:04:30,895][106226] Updated weights for policy 0, policy_version 1921720 (0.0008) [2023-12-28 09:04:30,937][106225] Updated weights for policy 1, policy_version 1926003 (0.0008) [2023-12-28 09:04:30,938][106226] Updated weights for policy 0, policy_version 1921730 (0.0008) [2023-12-28 09:04:30,989][106225] Updated weights for policy 1, policy_version 1926013 (0.0007) [2023-12-28 09:04:31,174][105115] Fps is (10 sec: 21299.5, 60 sec: 20070.4, 300 sec: 19771.9). Total num frames: 985161728. Throughput: 0: 10038.3, 1: 9901.4. Samples: 985146620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:31,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.232')] [2023-12-28 09:04:31,667][106225] Updated weights for policy 1, policy_version 1926023 (0.0008) [2023-12-28 09:04:31,731][106225] Updated weights for policy 1, policy_version 1926033 (0.0009) [2023-12-28 09:04:31,758][106226] Updated weights for policy 0, policy_version 1921740 (0.0007) [2023-12-28 09:04:31,802][106225] Updated weights for policy 1, policy_version 1926043 (0.0009) [2023-12-28 09:04:31,819][106226] Updated weights for policy 0, policy_version 1921750 (0.0007) [2023-12-28 09:04:31,884][106226] Updated weights for policy 0, policy_version 1921760 (0.0008) [2023-12-28 09:04:32,411][106225] Updated weights for policy 1, policy_version 1926053 (0.0006) [2023-12-28 09:04:32,474][106225] Updated weights for policy 1, policy_version 1926063 (0.0007) [2023-12-28 09:04:32,533][106225] Updated weights for policy 1, policy_version 1926073 (0.0009) [2023-12-28 09:04:32,621][106226] Updated weights for policy 0, policy_version 1921770 (0.0008) [2023-12-28 09:04:32,683][106226] Updated weights for policy 0, policy_version 1921780 (0.0008) [2023-12-28 09:04:32,749][106226] Updated weights for policy 0, policy_version 1921790 (0.0008) [2023-12-28 09:04:32,805][106226] Updated weights for policy 0, policy_version 1921800 (0.0009) [2023-12-28 09:04:33,208][106225] Updated weights for policy 1, policy_version 1926083 (0.0009) [2023-12-28 09:04:33,255][106225] Updated weights for policy 1, policy_version 1926093 (0.0008) [2023-12-28 09:04:33,305][106225] Updated weights for policy 1, policy_version 1926103 (0.0008) [2023-12-28 09:04:33,479][106226] Updated weights for policy 0, policy_version 1921810 (0.0005) [2023-12-28 09:04:33,533][106226] Updated weights for policy 0, policy_version 1921820 (0.0005) [2023-12-28 09:04:33,595][106226] Updated weights for policy 0, policy_version 1921830 (0.0005) [2023-12-28 09:04:34,102][106225] Updated weights for policy 1, policy_version 1926113 (0.0008) [2023-12-28 09:04:34,167][106225] Updated weights for policy 1, policy_version 1926123 (0.0007) [2023-12-28 09:04:34,181][106226] Updated weights for policy 0, policy_version 1921840 (0.0008) [2023-12-28 09:04:34,229][106225] Updated weights for policy 1, policy_version 1926133 (0.0009) [2023-12-28 09:04:34,249][106226] Updated weights for policy 0, policy_version 1921850 (0.0009) [2023-12-28 09:04:34,286][106225] Updated weights for policy 1, policy_version 1926143 (0.0006) [2023-12-28 09:04:34,319][106226] Updated weights for policy 0, policy_version 1921860 (0.0010) [2023-12-28 09:04:35,030][106226] Updated weights for policy 0, policy_version 1921870 (0.0009) [2023-12-28 09:04:35,040][106225] Updated weights for policy 1, policy_version 1926153 (0.0007) [2023-12-28 09:04:35,089][106226] Updated weights for policy 0, policy_version 1921880 (0.0005) [2023-12-28 09:04:35,093][106225] Updated weights for policy 1, policy_version 1926163 (0.0008) [2023-12-28 09:04:35,146][106225] Updated weights for policy 1, policy_version 1926173 (0.0005) [2023-12-28 09:04:35,151][106226] Updated weights for policy 0, policy_version 1921890 (0.0010) [2023-12-28 09:04:35,743][106226] Updated weights for policy 0, policy_version 1921900 (0.0009) [2023-12-28 09:04:35,793][106226] Updated weights for policy 0, policy_version 1921910 (0.0006) [2023-12-28 09:04:35,843][106226] Updated weights for policy 0, policy_version 1921920 (0.0010) [2023-12-28 09:04:35,861][106225] Updated weights for policy 1, policy_version 1926183 (0.0006) [2023-12-28 09:04:35,914][106225] Updated weights for policy 1, policy_version 1926193 (0.0008) [2023-12-28 09:04:35,980][106225] Updated weights for policy 1, policy_version 1926203 (0.0008) [2023-12-28 09:04:36,175][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.8, 300 sec: 19771.9). Total num frames: 985260032. Throughput: 0: 9966.1, 1: 9964.8. Samples: 985266476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:36,175][105115] Avg episode reward: [(0, '-4.255'), (1, '-4.512')] [2023-12-28 09:04:36,532][106226] Updated weights for policy 0, policy_version 1921930 (0.0007) [2023-12-28 09:04:36,594][106226] Updated weights for policy 0, policy_version 1921940 (0.0009) [2023-12-28 09:04:36,658][106226] Updated weights for policy 0, policy_version 1921950 (0.0011) [2023-12-28 09:04:36,716][106226] Updated weights for policy 0, policy_version 1921960 (0.0011) [2023-12-28 09:04:36,751][106225] Updated weights for policy 1, policy_version 1926213 (0.0010) [2023-12-28 09:04:36,814][106225] Updated weights for policy 1, policy_version 1926223 (0.0009) [2023-12-28 09:04:36,878][106225] Updated weights for policy 1, policy_version 1926233 (0.0008) [2023-12-28 09:04:37,428][106226] Updated weights for policy 0, policy_version 1921970 (0.0008) [2023-12-28 09:04:37,489][106226] Updated weights for policy 0, policy_version 1921980 (0.0010) [2023-12-28 09:04:37,549][106226] Updated weights for policy 0, policy_version 1921990 (0.0010) [2023-12-28 09:04:37,572][106225] Updated weights for policy 1, policy_version 1926243 (0.0009) [2023-12-28 09:04:37,629][106225] Updated weights for policy 1, policy_version 1926253 (0.0008) [2023-12-28 09:04:37,687][106225] Updated weights for policy 1, policy_version 1926263 (0.0007) [2023-12-28 09:04:38,164][106226] Updated weights for policy 0, policy_version 1922000 (0.0011) [2023-12-28 09:04:38,220][106226] Updated weights for policy 0, policy_version 1922010 (0.0010) [2023-12-28 09:04:38,265][106226] Updated weights for policy 0, policy_version 1922020 (0.0010) [2023-12-28 09:04:38,368][106225] Updated weights for policy 1, policy_version 1926273 (0.0007) [2023-12-28 09:04:38,431][106225] Updated weights for policy 1, policy_version 1926283 (0.0008) [2023-12-28 09:04:38,490][106225] Updated weights for policy 1, policy_version 1926293 (0.0010) [2023-12-28 09:04:38,552][106225] Updated weights for policy 1, policy_version 1926303 (0.0009) [2023-12-28 09:04:38,977][106226] Updated weights for policy 0, policy_version 1922030 (0.0008) [2023-12-28 09:04:39,030][106226] Updated weights for policy 0, policy_version 1922040 (0.0010) [2023-12-28 09:04:39,077][106226] Updated weights for policy 0, policy_version 1922050 (0.0010) [2023-12-28 09:04:39,267][106225] Updated weights for policy 1, policy_version 1926313 (0.0008) [2023-12-28 09:04:39,316][106225] Updated weights for policy 1, policy_version 1926323 (0.0007) [2023-12-28 09:04:39,369][106225] Updated weights for policy 1, policy_version 1926333 (0.0007) [2023-12-28 09:04:39,913][106226] Updated weights for policy 0, policy_version 1922060 (0.0010) [2023-12-28 09:04:39,977][106226] Updated weights for policy 0, policy_version 1922070 (0.0009) [2023-12-28 09:04:40,045][106226] Updated weights for policy 0, policy_version 1922080 (0.0008) [2023-12-28 09:04:40,156][106225] Updated weights for policy 1, policy_version 1926343 (0.0009) [2023-12-28 09:04:40,210][106225] Updated weights for policy 1, policy_version 1926353 (0.0009) [2023-12-28 09:04:40,265][106225] Updated weights for policy 1, policy_version 1926363 (0.0008) [2023-12-28 09:04:40,789][106226] Updated weights for policy 0, policy_version 1922090 (0.0009) [2023-12-28 09:04:40,860][106226] Updated weights for policy 0, policy_version 1922100 (0.0006) [2023-12-28 09:04:40,923][106226] Updated weights for policy 0, policy_version 1922110 (0.0006) [2023-12-28 09:04:40,954][106225] Updated weights for policy 1, policy_version 1926373 (0.0008) [2023-12-28 09:04:40,985][106226] Updated weights for policy 0, policy_version 1922120 (0.0008) [2023-12-28 09:04:41,010][106225] Updated weights for policy 1, policy_version 1926383 (0.0008) [2023-12-28 09:04:41,083][106225] Updated weights for policy 1, policy_version 1926393 (0.0009) [2023-12-28 09:04:41,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 985358336. Throughput: 0: 9932.3, 1: 9995.2. Samples: 985325080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-28 09:04:41,175][105115] Avg episode reward: [(0, '-4.177'), (1, '-4.635')] [2023-12-28 09:04:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001922120_492142592.pth... [2023-12-28 09:04:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001926400_493215744.pth... [2023-12-28 09:04:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001925248_492920832.pth [2023-12-28 09:04:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001920968_491847680.pth [2023-12-28 09:04:41,664][106226] Updated weights for policy 0, policy_version 1922130 (0.0008) [2023-12-28 09:04:41,727][106226] Updated weights for policy 0, policy_version 1922140 (0.0009) [2023-12-28 09:04:41,802][106226] Updated weights for policy 0, policy_version 1922150 (0.0008) [2023-12-28 09:04:41,932][106225] Updated weights for policy 1, policy_version 1926403 (0.0008) [2023-12-28 09:04:41,991][106225] Updated weights for policy 1, policy_version 1926413 (0.0008) [2023-12-28 09:04:42,053][106225] Updated weights for policy 1, policy_version 1926423 (0.0006) [2023-12-28 09:04:42,602][106226] Updated weights for policy 0, policy_version 1922160 (0.0010) [2023-12-28 09:04:42,673][106226] Updated weights for policy 0, policy_version 1922170 (0.0010) [2023-12-28 09:04:42,687][106225] Updated weights for policy 1, policy_version 1926433 (0.0007) [2023-12-28 09:04:42,737][106226] Updated weights for policy 0, policy_version 1922180 (0.0007) [2023-12-28 09:04:42,753][106225] Updated weights for policy 1, policy_version 1926443 (0.0008) [2023-12-28 09:04:42,821][106225] Updated weights for policy 1, policy_version 1926453 (0.0008) [2023-12-28 09:04:42,878][106225] Updated weights for policy 1, policy_version 1926463 (0.0008) [2023-12-28 09:04:43,446][106226] Updated weights for policy 0, policy_version 1922190 (0.0009) [2023-12-28 09:04:43,510][106226] Updated weights for policy 0, policy_version 1922200 (0.0011) [2023-12-28 09:04:43,572][106226] Updated weights for policy 0, policy_version 1922210 (0.0006) [2023-12-28 09:04:43,577][106225] Updated weights for policy 1, policy_version 1926473 (0.0008) [2023-12-28 09:04:43,630][106225] Updated weights for policy 1, policy_version 1926483 (0.0007) [2023-12-28 09:04:43,693][106225] Updated weights for policy 1, policy_version 1926493 (0.0009) [2023-12-28 09:04:44,257][106226] Updated weights for policy 0, policy_version 1922220 (0.0008) [2023-12-28 09:04:44,315][106226] Updated weights for policy 0, policy_version 1922230 (0.0011) [2023-12-28 09:04:44,369][106226] Updated weights for policy 0, policy_version 1922240 (0.0011) [2023-12-28 09:04:44,461][106225] Updated weights for policy 1, policy_version 1926503 (0.0008) [2023-12-28 09:04:44,515][106225] Updated weights for policy 1, policy_version 1926513 (0.0008) [2023-12-28 09:04:44,569][106225] Updated weights for policy 1, policy_version 1926523 (0.0009) [2023-12-28 09:04:45,061][106226] Updated weights for policy 0, policy_version 1922250 (0.0010) [2023-12-28 09:04:45,138][106226] Updated weights for policy 0, policy_version 1922260 (0.0008) [2023-12-28 09:04:45,199][106226] Updated weights for policy 0, policy_version 1922270 (0.0008) [2023-12-28 09:04:45,249][106226] Updated weights for policy 0, policy_version 1922280 (0.0009) [2023-12-28 09:04:45,374][106225] Updated weights for policy 1, policy_version 1926533 (0.0009) [2023-12-28 09:04:45,438][106225] Updated weights for policy 1, policy_version 1926543 (0.0007) [2023-12-28 09:04:45,499][106225] Updated weights for policy 1, policy_version 1926553 (0.0006) [2023-12-28 09:04:45,984][106226] Updated weights for policy 0, policy_version 1922290 (0.0009) [2023-12-28 09:04:46,040][106226] Updated weights for policy 0, policy_version 1922300 (0.0008) [2023-12-28 09:04:46,103][106226] Updated weights for policy 0, policy_version 1922310 (0.0008) [2023-12-28 09:04:46,174][105115] Fps is (10 sec: 18841.8, 60 sec: 19933.9, 300 sec: 19744.1). Total num frames: 985448448. Throughput: 0: 9843.8, 1: 9917.3. Samples: 985437400. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:04:46,175][105115] Avg episode reward: [(0, '-4.418'), (1, '-4.822')] [2023-12-28 09:04:46,179][106225] Updated weights for policy 1, policy_version 1926563 (0.0007) [2023-12-28 09:04:46,235][106225] Updated weights for policy 1, policy_version 1926573 (0.0005) [2023-12-28 09:04:46,284][106225] Updated weights for policy 1, policy_version 1926583 (0.0005) [2023-12-28 09:04:46,857][106226] Updated weights for policy 0, policy_version 1922320 (0.0008) [2023-12-28 09:04:46,895][106225] Updated weights for policy 1, policy_version 1926593 (0.0005) [2023-12-28 09:04:46,922][106226] Updated weights for policy 0, policy_version 1922330 (0.0010) [2023-12-28 09:04:46,950][106225] Updated weights for policy 1, policy_version 1926603 (0.0005) [2023-12-28 09:04:46,987][106226] Updated weights for policy 0, policy_version 1922340 (0.0008) [2023-12-28 09:04:47,012][106225] Updated weights for policy 1, policy_version 1926613 (0.0005) [2023-12-28 09:04:47,069][106225] Updated weights for policy 1, policy_version 1926623 (0.0008) [2023-12-28 09:04:47,590][106226] Updated weights for policy 0, policy_version 1922350 (0.0007) [2023-12-28 09:04:47,641][106226] Updated weights for policy 0, policy_version 1922360 (0.0005) [2023-12-28 09:04:47,657][106225] Updated weights for policy 1, policy_version 1926633 (0.0008) [2023-12-28 09:04:47,703][106225] Updated weights for policy 1, policy_version 1926643 (0.0008) [2023-12-28 09:04:47,708][106226] Updated weights for policy 0, policy_version 1922370 (0.0006) [2023-12-28 09:04:47,750][106225] Updated weights for policy 1, policy_version 1926653 (0.0007) [2023-12-28 09:04:48,358][106226] Updated weights for policy 0, policy_version 1922382 (0.0007) [2023-12-28 09:04:48,377][106225] Updated weights for policy 1, policy_version 1926663 (0.0007) [2023-12-28 09:04:48,423][106226] Updated weights for policy 0, policy_version 1922392 (0.0006) [2023-12-28 09:04:48,440][106225] Updated weights for policy 1, policy_version 1926673 (0.0008) [2023-12-28 09:04:48,484][106226] Updated weights for policy 0, policy_version 1922402 (0.0005) [2023-12-28 09:04:48,501][106225] Updated weights for policy 1, policy_version 1926683 (0.0008) [2023-12-28 09:04:49,083][106226] Updated weights for policy 0, policy_version 1922412 (0.0007) [2023-12-28 09:04:49,132][106226] Updated weights for policy 0, policy_version 1922422 (0.0008) [2023-12-28 09:04:49,187][106226] Updated weights for policy 0, policy_version 1922432 (0.0009) [2023-12-28 09:04:49,290][106225] Updated weights for policy 1, policy_version 1926693 (0.0008) [2023-12-28 09:04:49,348][106225] Updated weights for policy 1, policy_version 1926703 (0.0009) [2023-12-28 09:04:49,416][106225] Updated weights for policy 1, policy_version 1926713 (0.0008) [2023-12-28 09:04:49,939][106226] Updated weights for policy 0, policy_version 1922442 (0.0008) [2023-12-28 09:04:50,001][106226] Updated weights for policy 0, policy_version 1922452 (0.0007) [2023-12-28 09:04:50,059][106226] Updated weights for policy 0, policy_version 1922462 (0.0008) [2023-12-28 09:04:50,120][106226] Updated weights for policy 0, policy_version 1922472 (0.0008) [2023-12-28 09:04:50,154][106225] Updated weights for policy 1, policy_version 1926723 (0.0007) [2023-12-28 09:04:50,218][106225] Updated weights for policy 1, policy_version 1926733 (0.0006) [2023-12-28 09:04:50,277][106225] Updated weights for policy 1, policy_version 1926743 (0.0006) [2023-12-28 09:04:50,743][106226] Updated weights for policy 0, policy_version 1922482 (0.0006) [2023-12-28 09:04:50,800][106226] Updated weights for policy 0, policy_version 1922492 (0.0008) [2023-12-28 09:04:50,852][106226] Updated weights for policy 0, policy_version 1922502 (0.0008) [2023-12-28 09:04:51,007][106225] Updated weights for policy 1, policy_version 1926753 (0.0007) [2023-12-28 09:04:51,072][106225] Updated weights for policy 1, policy_version 1926763 (0.0007) [2023-12-28 09:04:51,134][106225] Updated weights for policy 1, policy_version 1926773 (0.0008) [2023-12-28 09:04:51,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19797.4, 300 sec: 19744.1). Total num frames: 985546752. Throughput: 0: 9906.1, 1: 9815.9. Samples: 985558164. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:04:51,175][105115] Avg episode reward: [(0, '-4.163'), (1, '-4.603')] [2023-12-28 09:04:51,194][106225] Updated weights for policy 1, policy_version 1926783 (0.0009) [2023-12-28 09:04:51,641][106226] Updated weights for policy 0, policy_version 1922512 (0.0008) [2023-12-28 09:04:51,703][106226] Updated weights for policy 0, policy_version 1922522 (0.0007) [2023-12-28 09:04:51,770][106226] Updated weights for policy 0, policy_version 1922532 (0.0007) [2023-12-28 09:04:51,914][106225] Updated weights for policy 1, policy_version 1926793 (0.0007) [2023-12-28 09:04:51,972][106225] Updated weights for policy 1, policy_version 1926803 (0.0005) [2023-12-28 09:04:52,032][106225] Updated weights for policy 1, policy_version 1926813 (0.0006) [2023-12-28 09:04:52,427][106226] Updated weights for policy 0, policy_version 1922542 (0.0010) [2023-12-28 09:04:52,488][106226] Updated weights for policy 0, policy_version 1922552 (0.0010) [2023-12-28 09:04:52,548][106226] Updated weights for policy 0, policy_version 1922562 (0.0011) [2023-12-28 09:04:52,729][106225] Updated weights for policy 1, policy_version 1926823 (0.0006) [2023-12-28 09:04:52,791][106225] Updated weights for policy 1, policy_version 1926833 (0.0011) [2023-12-28 09:04:52,849][106225] Updated weights for policy 1, policy_version 1926843 (0.0011) [2023-12-28 09:04:53,228][106226] Updated weights for policy 0, policy_version 1922572 (0.0010) [2023-12-28 09:04:53,274][106226] Updated weights for policy 0, policy_version 1922582 (0.0010) [2023-12-28 09:04:53,330][106226] Updated weights for policy 0, policy_version 1922592 (0.0010) [2023-12-28 09:04:53,498][106225] Updated weights for policy 1, policy_version 1926853 (0.0008) [2023-12-28 09:04:53,556][106225] Updated weights for policy 1, policy_version 1926863 (0.0005) [2023-12-28 09:04:53,614][106225] Updated weights for policy 1, policy_version 1926873 (0.0005) [2023-12-28 09:04:54,040][106226] Updated weights for policy 0, policy_version 1922602 (0.0010) [2023-12-28 09:04:54,098][106226] Updated weights for policy 0, policy_version 1922612 (0.0010) [2023-12-28 09:04:54,122][106225] Updated weights for policy 1, policy_version 1926883 (0.0005) [2023-12-28 09:04:54,162][106226] Updated weights for policy 0, policy_version 1922622 (0.0011) [2023-12-28 09:04:54,182][106225] Updated weights for policy 1, policy_version 1926893 (0.0006) [2023-12-28 09:04:54,225][106226] Updated weights for policy 0, policy_version 1922632 (0.0010) [2023-12-28 09:04:54,236][106225] Updated weights for policy 1, policy_version 1926903 (0.0005) [2023-12-28 09:04:54,812][106225] Updated weights for policy 1, policy_version 1926913 (0.0009) [2023-12-28 09:04:54,870][106225] Updated weights for policy 1, policy_version 1926923 (0.0005) [2023-12-28 09:04:54,918][106225] Updated weights for policy 1, policy_version 1926933 (0.0008) [2023-12-28 09:04:54,945][106226] Updated weights for policy 0, policy_version 1922642 (0.0008) [2023-12-28 09:04:54,972][106225] Updated weights for policy 1, policy_version 1926943 (0.0010) [2023-12-28 09:04:55,003][106226] Updated weights for policy 0, policy_version 1922652 (0.0011) [2023-12-28 09:04:55,060][106226] Updated weights for policy 0, policy_version 1922662 (0.0011) [2023-12-28 09:04:55,551][106225] Updated weights for policy 1, policy_version 1926953 (0.0010) [2023-12-28 09:04:55,604][106225] Updated weights for policy 1, policy_version 1926963 (0.0010) [2023-12-28 09:04:55,660][106225] Updated weights for policy 1, policy_version 1926973 (0.0010) [2023-12-28 09:04:55,699][106226] Updated weights for policy 0, policy_version 1922672 (0.0010) [2023-12-28 09:04:55,748][106226] Updated weights for policy 0, policy_version 1922682 (0.0010) [2023-12-28 09:04:55,795][106226] Updated weights for policy 0, policy_version 1922692 (0.0010) [2023-12-28 09:04:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19934.0, 300 sec: 19771.9). Total num frames: 985653248. Throughput: 0: 9913.4, 1: 9783.8. Samples: 985618536. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:04:56,175][105115] Avg episode reward: [(0, '-4.642'), (1, '-4.640')] [2023-12-28 09:04:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001926976_493363200.pth... [2023-12-28 09:04:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001922696_492290048.pth... [2023-12-28 09:04:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001925824_493068288.pth [2023-12-28 09:04:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001921544_491995136.pth [2023-12-28 09:04:56,259][106225] Updated weights for policy 1, policy_version 1926983 (0.0008) [2023-12-28 09:04:56,310][106225] Updated weights for policy 1, policy_version 1926993 (0.0010) [2023-12-28 09:04:56,357][106225] Updated weights for policy 1, policy_version 1927003 (0.0010) [2023-12-28 09:04:56,452][106226] Updated weights for policy 0, policy_version 1922702 (0.0007) [2023-12-28 09:04:56,498][106226] Updated weights for policy 0, policy_version 1922712 (0.0005) [2023-12-28 09:04:56,544][106226] Updated weights for policy 0, policy_version 1922722 (0.0005) [2023-12-28 09:04:57,032][106225] Updated weights for policy 1, policy_version 1927013 (0.0010) [2023-12-28 09:04:57,078][106225] Updated weights for policy 1, policy_version 1927023 (0.0010) [2023-12-28 09:04:57,097][106226] Updated weights for policy 0, policy_version 1922732 (0.0005) [2023-12-28 09:04:57,128][106225] Updated weights for policy 1, policy_version 1927033 (0.0010) [2023-12-28 09:04:57,148][106226] Updated weights for policy 0, policy_version 1922742 (0.0005) [2023-12-28 09:04:57,198][106226] Updated weights for policy 0, policy_version 1922752 (0.0005) [2023-12-28 09:04:57,721][106226] Updated weights for policy 0, policy_version 1922762 (0.0005) [2023-12-28 09:04:57,726][106225] Updated weights for policy 1, policy_version 1927043 (0.0008) [2023-12-28 09:04:57,773][106226] Updated weights for policy 0, policy_version 1922772 (0.0009) [2023-12-28 09:04:57,781][106225] Updated weights for policy 1, policy_version 1927053 (0.0005) [2023-12-28 09:04:57,824][106226] Updated weights for policy 0, policy_version 1922782 (0.0010) [2023-12-28 09:04:57,839][106225] Updated weights for policy 1, policy_version 1927063 (0.0005) [2023-12-28 09:04:57,890][106226] Updated weights for policy 0, policy_version 1922792 (0.0010) [2023-12-28 09:04:58,461][106225] Updated weights for policy 1, policy_version 1927073 (0.0006) [2023-12-28 09:04:58,523][106225] Updated weights for policy 1, policy_version 1927083 (0.0009) [2023-12-28 09:04:58,585][106225] Updated weights for policy 1, policy_version 1927093 (0.0010) [2023-12-28 09:04:58,611][106226] Updated weights for policy 0, policy_version 1922802 (0.0007) [2023-12-28 09:04:58,646][106225] Updated weights for policy 1, policy_version 1927103 (0.0009) [2023-12-28 09:04:58,685][106226] Updated weights for policy 0, policy_version 1922813 (0.0008) [2023-12-28 09:04:58,751][106226] Updated weights for policy 0, policy_version 1922823 (0.0008) [2023-12-28 09:04:59,521][106225] Updated weights for policy 1, policy_version 1927113 (0.0008) [2023-12-28 09:04:59,565][106226] Updated weights for policy 0, policy_version 1922833 (0.0009) [2023-12-28 09:04:59,575][106225] Updated weights for policy 1, policy_version 1927123 (0.0005) [2023-12-28 09:04:59,625][106225] Updated weights for policy 1, policy_version 1927133 (0.0006) [2023-12-28 09:04:59,626][106226] Updated weights for policy 0, policy_version 1922843 (0.0009) [2023-12-28 09:04:59,692][106226] Updated weights for policy 0, policy_version 1922853 (0.0010) [2023-12-28 09:05:00,326][106226] Updated weights for policy 0, policy_version 1922863 (0.0007) [2023-12-28 09:05:00,380][106226] Updated weights for policy 0, policy_version 1922873 (0.0007) [2023-12-28 09:05:00,387][106225] Updated weights for policy 1, policy_version 1927143 (0.0007) [2023-12-28 09:05:00,436][106226] Updated weights for policy 0, policy_version 1922883 (0.0008) [2023-12-28 09:05:00,445][106225] Updated weights for policy 1, policy_version 1927153 (0.0006) [2023-12-28 09:05:00,508][106225] Updated weights for policy 1, policy_version 1927163 (0.0007) [2023-12-28 09:05:01,025][106226] Updated weights for policy 0, policy_version 1922893 (0.0007) [2023-12-28 09:05:01,088][106226] Updated weights for policy 0, policy_version 1922903 (0.0008) [2023-12-28 09:05:01,167][106226] Updated weights for policy 0, policy_version 1922913 (0.0008) [2023-12-28 09:05:01,174][106225] Updated weights for policy 1, policy_version 1927173 (0.0008) [2023-12-28 09:05:01,174][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19771.9). Total num frames: 985751552. Throughput: 0: 9969.5, 1: 9996.5. Samples: 985746192. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:01,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.787')] [2023-12-28 09:05:01,225][106225] Updated weights for policy 1, policy_version 1927183 (0.0008) [2023-12-28 09:05:01,283][106225] Updated weights for policy 1, policy_version 1927193 (0.0011) [2023-12-28 09:05:01,847][106226] Updated weights for policy 0, policy_version 1922923 (0.0007) [2023-12-28 09:05:01,902][106226] Updated weights for policy 0, policy_version 1922933 (0.0005) [2023-12-28 09:05:01,957][106226] Updated weights for policy 0, policy_version 1922943 (0.0008) [2023-12-28 09:05:01,994][106225] Updated weights for policy 1, policy_version 1927203 (0.0007) [2023-12-28 09:05:02,048][106225] Updated weights for policy 1, policy_version 1927213 (0.0010) [2023-12-28 09:05:02,098][106225] Updated weights for policy 1, policy_version 1927223 (0.0010) [2023-12-28 09:05:02,626][106226] Updated weights for policy 0, policy_version 1922953 (0.0011) [2023-12-28 09:05:02,689][106226] Updated weights for policy 0, policy_version 1922963 (0.0010) [2023-12-28 09:05:02,749][106226] Updated weights for policy 0, policy_version 1922973 (0.0010) [2023-12-28 09:05:02,780][106225] Updated weights for policy 1, policy_version 1927233 (0.0010) [2023-12-28 09:05:02,808][106226] Updated weights for policy 0, policy_version 1922983 (0.0011) [2023-12-28 09:05:02,838][106225] Updated weights for policy 1, policy_version 1927243 (0.0007) [2023-12-28 09:05:02,890][106225] Updated weights for policy 1, policy_version 1927253 (0.0008) [2023-12-28 09:05:02,945][106225] Updated weights for policy 1, policy_version 1927263 (0.0006) [2023-12-28 09:05:03,453][106226] Updated weights for policy 0, policy_version 1922993 (0.0009) [2023-12-28 09:05:03,509][106226] Updated weights for policy 0, policy_version 1923003 (0.0006) [2023-12-28 09:05:03,562][106226] Updated weights for policy 0, policy_version 1923013 (0.0010) [2023-12-28 09:05:03,562][106225] Updated weights for policy 1, policy_version 1927273 (0.0008) [2023-12-28 09:05:03,621][106225] Updated weights for policy 1, policy_version 1927283 (0.0008) [2023-12-28 09:05:03,670][106225] Updated weights for policy 1, policy_version 1927293 (0.0008) [2023-12-28 09:05:04,113][106226] Updated weights for policy 0, policy_version 1923023 (0.0005) [2023-12-28 09:05:04,172][106226] Updated weights for policy 0, policy_version 1923033 (0.0006) [2023-12-28 09:05:04,238][106226] Updated weights for policy 0, policy_version 1923043 (0.0010) [2023-12-28 09:05:04,541][106225] Updated weights for policy 1, policy_version 1927304 (0.0007) [2023-12-28 09:05:04,594][106225] Updated weights for policy 1, policy_version 1927314 (0.0007) [2023-12-28 09:05:04,641][106225] Updated weights for policy 1, policy_version 1927324 (0.0007) [2023-12-28 09:05:04,889][106226] Updated weights for policy 0, policy_version 1923053 (0.0011) [2023-12-28 09:05:04,940][106226] Updated weights for policy 0, policy_version 1923063 (0.0010) [2023-12-28 09:05:05,001][106226] Updated weights for policy 0, policy_version 1923073 (0.0006) [2023-12-28 09:05:05,329][106225] Updated weights for policy 1, policy_version 1927334 (0.0007) [2023-12-28 09:05:05,387][106225] Updated weights for policy 1, policy_version 1927344 (0.0008) [2023-12-28 09:05:05,451][106225] Updated weights for policy 1, policy_version 1927354 (0.0010) [2023-12-28 09:05:05,702][106226] Updated weights for policy 0, policy_version 1923083 (0.0009) [2023-12-28 09:05:05,763][106226] Updated weights for policy 0, policy_version 1923093 (0.0009) [2023-12-28 09:05:05,830][106226] Updated weights for policy 0, policy_version 1923103 (0.0005) [2023-12-28 09:05:06,107][106225] Updated weights for policy 1, policy_version 1927364 (0.0011) [2023-12-28 09:05:06,175][105115] Fps is (10 sec: 20479.4, 60 sec: 20070.3, 300 sec: 19827.4). Total num frames: 985858048. Throughput: 0: 10084.0, 1: 9989.5. Samples: 985869668. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:06,176][106225] Updated weights for policy 1, policy_version 1927374 (0.0009) [2023-12-28 09:05:06,176][105115] Avg episode reward: [(0, '-4.295'), (1, '-4.433')] [2023-12-28 09:05:06,237][106225] Updated weights for policy 1, policy_version 1927384 (0.0007) [2023-12-28 09:05:06,507][106226] Updated weights for policy 0, policy_version 1923113 (0.0008) [2023-12-28 09:05:06,568][106226] Updated weights for policy 0, policy_version 1923123 (0.0011) [2023-12-28 09:05:06,631][106226] Updated weights for policy 0, policy_version 1923133 (0.0011) [2023-12-28 09:05:06,696][106226] Updated weights for policy 0, policy_version 1923143 (0.0011) [2023-12-28 09:05:06,931][106225] Updated weights for policy 1, policy_version 1927394 (0.0011) [2023-12-28 09:05:06,994][106225] Updated weights for policy 1, policy_version 1927404 (0.0010) [2023-12-28 09:05:07,060][106225] Updated weights for policy 1, policy_version 1927414 (0.0011) [2023-12-28 09:05:07,118][106225] Updated weights for policy 1, policy_version 1927424 (0.0010) [2023-12-28 09:05:07,386][106226] Updated weights for policy 0, policy_version 1923153 (0.0006) [2023-12-28 09:05:07,448][106226] Updated weights for policy 0, policy_version 1923163 (0.0009) [2023-12-28 09:05:07,517][106226] Updated weights for policy 0, policy_version 1923173 (0.0010) [2023-12-28 09:05:07,830][106225] Updated weights for policy 1, policy_version 1927434 (0.0006) [2023-12-28 09:05:07,892][106225] Updated weights for policy 1, policy_version 1927444 (0.0005) [2023-12-28 09:05:07,951][106225] Updated weights for policy 1, policy_version 1927454 (0.0005) [2023-12-28 09:05:08,093][106226] Updated weights for policy 0, policy_version 1923183 (0.0008) [2023-12-28 09:05:08,153][106226] Updated weights for policy 0, policy_version 1923193 (0.0007) [2023-12-28 09:05:08,204][106226] Updated weights for policy 0, policy_version 1923203 (0.0008) [2023-12-28 09:05:08,594][106225] Updated weights for policy 1, policy_version 1927464 (0.0008) [2023-12-28 09:05:08,664][106225] Updated weights for policy 1, policy_version 1927474 (0.0010) [2023-12-28 09:05:08,728][106225] Updated weights for policy 1, policy_version 1927484 (0.0008) [2023-12-28 09:05:08,927][106226] Updated weights for policy 0, policy_version 1923213 (0.0008) [2023-12-28 09:05:08,981][106226] Updated weights for policy 0, policy_version 1923223 (0.0009) [2023-12-28 09:05:09,033][106226] Updated weights for policy 0, policy_version 1923233 (0.0008) [2023-12-28 09:05:09,429][106225] Updated weights for policy 1, policy_version 1927494 (0.0009) [2023-12-28 09:05:09,493][106225] Updated weights for policy 1, policy_version 1927504 (0.0006) [2023-12-28 09:05:09,555][106225] Updated weights for policy 1, policy_version 1927514 (0.0006) [2023-12-28 09:05:09,871][106226] Updated weights for policy 0, policy_version 1923243 (0.0009) [2023-12-28 09:05:09,933][106226] Updated weights for policy 0, policy_version 1923253 (0.0009) [2023-12-28 09:05:10,004][106226] Updated weights for policy 0, policy_version 1923263 (0.0006) [2023-12-28 09:05:10,268][106225] Updated weights for policy 1, policy_version 1927524 (0.0008) [2023-12-28 09:05:10,332][106225] Updated weights for policy 1, policy_version 1927534 (0.0009) [2023-12-28 09:05:10,390][106225] Updated weights for policy 1, policy_version 1927544 (0.0008) [2023-12-28 09:05:10,685][106226] Updated weights for policy 0, policy_version 1923273 (0.0007) [2023-12-28 09:05:10,757][106226] Updated weights for policy 0, policy_version 1923283 (0.0008) [2023-12-28 09:05:10,823][106226] Updated weights for policy 0, policy_version 1923293 (0.0009) [2023-12-28 09:05:10,885][106226] Updated weights for policy 0, policy_version 1923303 (0.0009) [2023-12-28 09:05:11,119][106225] Updated weights for policy 1, policy_version 1927554 (0.0009) [2023-12-28 09:05:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 985956352. Throughput: 0: 10148.3, 1: 9999.0. Samples: 985928928. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:11,175][105115] Avg episode reward: [(0, '-4.213'), (1, '-4.645')] [2023-12-28 09:05:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001923304_492445696.pth... [2023-12-28 09:05:11,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001922120_492142592.pth [2023-12-28 09:05:11,191][106225] Updated weights for policy 1, policy_version 1927564 (0.0008) [2023-12-28 09:05:11,254][106225] Updated weights for policy 1, policy_version 1927574 (0.0008) [2023-12-28 09:05:11,316][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001927584_493518848.pth... [2023-12-28 09:05:11,319][106225] Updated weights for policy 1, policy_version 1927584 (0.0009) [2023-12-28 09:05:11,320][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001926400_493215744.pth [2023-12-28 09:05:11,614][106226] Updated weights for policy 0, policy_version 1923313 (0.0007) [2023-12-28 09:05:11,693][106226] Updated weights for policy 0, policy_version 1923323 (0.0009) [2023-12-28 09:05:11,760][106226] Updated weights for policy 0, policy_version 1923333 (0.0008) [2023-12-28 09:05:12,097][106225] Updated weights for policy 1, policy_version 1927594 (0.0009) [2023-12-28 09:05:12,163][106225] Updated weights for policy 1, policy_version 1927604 (0.0008) [2023-12-28 09:05:12,227][106225] Updated weights for policy 1, policy_version 1927614 (0.0008) [2023-12-28 09:05:12,531][106226] Updated weights for policy 0, policy_version 1923343 (0.0009) [2023-12-28 09:05:12,594][106226] Updated weights for policy 0, policy_version 1923353 (0.0007) [2023-12-28 09:05:12,662][106226] Updated weights for policy 0, policy_version 1923363 (0.0006) [2023-12-28 09:05:12,993][106225] Updated weights for policy 1, policy_version 1927624 (0.0008) [2023-12-28 09:05:13,050][106225] Updated weights for policy 1, policy_version 1927634 (0.0010) [2023-12-28 09:05:13,103][106225] Updated weights for policy 1, policy_version 1927644 (0.0007) [2023-12-28 09:05:13,269][106226] Updated weights for policy 0, policy_version 1923373 (0.0006) [2023-12-28 09:05:13,320][106226] Updated weights for policy 0, policy_version 1923383 (0.0006) [2023-12-28 09:05:13,372][106226] Updated weights for policy 0, policy_version 1923393 (0.0005) [2023-12-28 09:05:13,929][106226] Updated weights for policy 0, policy_version 1923403 (0.0007) [2023-12-28 09:05:13,954][106225] Updated weights for policy 1, policy_version 1927654 (0.0007) [2023-12-28 09:05:13,988][106226] Updated weights for policy 0, policy_version 1923413 (0.0010) [2023-12-28 09:05:14,009][106225] Updated weights for policy 1, policy_version 1927664 (0.0006) [2023-12-28 09:05:14,045][106226] Updated weights for policy 0, policy_version 1923423 (0.0010) [2023-12-28 09:05:14,066][106225] Updated weights for policy 1, policy_version 1927674 (0.0005) [2023-12-28 09:05:14,807][106226] Updated weights for policy 0, policy_version 1923433 (0.0011) [2023-12-28 09:05:14,871][106226] Updated weights for policy 0, policy_version 1923443 (0.0008) [2023-12-28 09:05:14,876][106225] Updated weights for policy 1, policy_version 1927684 (0.0008) [2023-12-28 09:05:14,936][106226] Updated weights for policy 0, policy_version 1923453 (0.0008) [2023-12-28 09:05:14,946][106225] Updated weights for policy 1, policy_version 1927694 (0.0007) [2023-12-28 09:05:14,999][106226] Updated weights for policy 0, policy_version 1923463 (0.0008) [2023-12-28 09:05:15,013][106225] Updated weights for policy 1, policy_version 1927704 (0.0008) [2023-12-28 09:05:15,714][106226] Updated weights for policy 0, policy_version 1923473 (0.0005) [2023-12-28 09:05:15,716][106225] Updated weights for policy 1, policy_version 1927714 (0.0007) [2023-12-28 09:05:15,768][106226] Updated weights for policy 0, policy_version 1923483 (0.0006) [2023-12-28 09:05:15,770][106225] Updated weights for policy 1, policy_version 1927724 (0.0006) [2023-12-28 09:05:15,824][106226] Updated weights for policy 0, policy_version 1923493 (0.0005) [2023-12-28 09:05:15,830][106225] Updated weights for policy 1, policy_version 1927734 (0.0009) [2023-12-28 09:05:15,889][106225] Updated weights for policy 1, policy_version 1927744 (0.0008) [2023-12-28 09:05:16,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 986054656. Throughput: 0: 10077.9, 1: 9843.9. Samples: 986043104. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:16,176][105115] Avg episode reward: [(0, '-4.231'), (1, '-4.464')] [2023-12-28 09:05:16,468][106226] Updated weights for policy 0, policy_version 1923503 (0.0006) [2023-12-28 09:05:16,525][106226] Updated weights for policy 0, policy_version 1923513 (0.0005) [2023-12-28 09:05:16,591][106226] Updated weights for policy 0, policy_version 1923523 (0.0005) [2023-12-28 09:05:16,649][106225] Updated weights for policy 1, policy_version 1927754 (0.0008) [2023-12-28 09:05:16,719][106225] Updated weights for policy 1, policy_version 1927764 (0.0008) [2023-12-28 09:05:16,790][106225] Updated weights for policy 1, policy_version 1927774 (0.0006) [2023-12-28 09:05:17,126][106226] Updated weights for policy 0, policy_version 1923533 (0.0006) [2023-12-28 09:05:17,196][106226] Updated weights for policy 0, policy_version 1923543 (0.0005) [2023-12-28 09:05:17,247][106226] Updated weights for policy 0, policy_version 1923553 (0.0006) [2023-12-28 09:05:17,502][106225] Updated weights for policy 1, policy_version 1927784 (0.0007) [2023-12-28 09:05:17,562][106225] Updated weights for policy 1, policy_version 1927794 (0.0009) [2023-12-28 09:05:17,620][106225] Updated weights for policy 1, policy_version 1927804 (0.0008) [2023-12-28 09:05:17,912][106226] Updated weights for policy 0, policy_version 1923563 (0.0007) [2023-12-28 09:05:17,977][106226] Updated weights for policy 0, policy_version 1923573 (0.0005) [2023-12-28 09:05:18,025][106226] Updated weights for policy 0, policy_version 1923583 (0.0006) [2023-12-28 09:05:18,363][106225] Updated weights for policy 1, policy_version 1927814 (0.0009) [2023-12-28 09:05:18,427][106225] Updated weights for policy 1, policy_version 1927824 (0.0009) [2023-12-28 09:05:18,489][106225] Updated weights for policy 1, policy_version 1927834 (0.0009) [2023-12-28 09:05:18,639][106226] Updated weights for policy 0, policy_version 1923593 (0.0006) [2023-12-28 09:05:18,702][106226] Updated weights for policy 0, policy_version 1923603 (0.0008) [2023-12-28 09:05:18,761][106226] Updated weights for policy 0, policy_version 1923613 (0.0006) [2023-12-28 09:05:18,815][106226] Updated weights for policy 0, policy_version 1923623 (0.0007) [2023-12-28 09:05:19,234][106225] Updated weights for policy 1, policy_version 1927844 (0.0009) [2023-12-28 09:05:19,299][106225] Updated weights for policy 1, policy_version 1927854 (0.0008) [2023-12-28 09:05:19,370][106225] Updated weights for policy 1, policy_version 1927864 (0.0008) [2023-12-28 09:05:19,540][106226] Updated weights for policy 0, policy_version 1923633 (0.0008) [2023-12-28 09:05:19,602][106226] Updated weights for policy 0, policy_version 1923643 (0.0009) [2023-12-28 09:05:19,659][106226] Updated weights for policy 0, policy_version 1923653 (0.0009) [2023-12-28 09:05:20,146][106225] Updated weights for policy 1, policy_version 1927874 (0.0010) [2023-12-28 09:05:20,209][106225] Updated weights for policy 1, policy_version 1927884 (0.0008) [2023-12-28 09:05:20,262][106225] Updated weights for policy 1, policy_version 1927894 (0.0009) [2023-12-28 09:05:20,314][106225] Updated weights for policy 1, policy_version 1927904 (0.0008) [2023-12-28 09:05:20,399][106226] Updated weights for policy 0, policy_version 1923663 (0.0008) [2023-12-28 09:05:20,454][106226] Updated weights for policy 0, policy_version 1923673 (0.0007) [2023-12-28 09:05:20,517][106226] Updated weights for policy 0, policy_version 1923683 (0.0009) [2023-12-28 09:05:21,099][106225] Updated weights for policy 1, policy_version 1927914 (0.0009) [2023-12-28 09:05:21,160][106225] Updated weights for policy 1, policy_version 1927924 (0.0008) [2023-12-28 09:05:21,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 986144768. Throughput: 0: 10082.8, 1: 9773.2. Samples: 986159992. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:21,175][105115] Avg episode reward: [(0, '-4.204'), (1, '-4.797')] [2023-12-28 09:05:21,225][106225] Updated weights for policy 1, policy_version 1927934 (0.0009) [2023-12-28 09:05:21,287][106226] Updated weights for policy 0, policy_version 1923693 (0.0009) [2023-12-28 09:05:21,355][106226] Updated weights for policy 0, policy_version 1923703 (0.0009) [2023-12-28 09:05:21,431][106226] Updated weights for policy 0, policy_version 1923713 (0.0009) [2023-12-28 09:05:21,981][106225] Updated weights for policy 1, policy_version 1927944 (0.0006) [2023-12-28 09:05:22,046][106225] Updated weights for policy 1, policy_version 1927954 (0.0007) [2023-12-28 09:05:22,112][106225] Updated weights for policy 1, policy_version 1927964 (0.0008) [2023-12-28 09:05:22,230][106226] Updated weights for policy 0, policy_version 1923723 (0.0009) [2023-12-28 09:05:22,295][106226] Updated weights for policy 0, policy_version 1923733 (0.0012) [2023-12-28 09:05:22,364][106226] Updated weights for policy 0, policy_version 1923743 (0.0010) [2023-12-28 09:05:22,750][106225] Updated weights for policy 1, policy_version 1927974 (0.0008) [2023-12-28 09:05:22,805][106225] Updated weights for policy 1, policy_version 1927984 (0.0006) [2023-12-28 09:05:22,867][106225] Updated weights for policy 1, policy_version 1927994 (0.0006) [2023-12-28 09:05:23,112][106226] Updated weights for policy 0, policy_version 1923753 (0.0010) [2023-12-28 09:05:23,159][106226] Updated weights for policy 0, policy_version 1923763 (0.0011) [2023-12-28 09:05:23,217][106226] Updated weights for policy 0, policy_version 1923773 (0.0011) [2023-12-28 09:05:23,267][106226] Updated weights for policy 0, policy_version 1923783 (0.0010) [2023-12-28 09:05:23,597][106225] Updated weights for policy 1, policy_version 1928004 (0.0008) [2023-12-28 09:05:23,650][106225] Updated weights for policy 1, policy_version 1928014 (0.0009) [2023-12-28 09:05:23,699][106225] Updated weights for policy 1, policy_version 1928024 (0.0008) [2023-12-28 09:05:23,866][106226] Updated weights for policy 0, policy_version 1923793 (0.0006) [2023-12-28 09:05:23,913][106226] Updated weights for policy 0, policy_version 1923803 (0.0005) [2023-12-28 09:05:23,974][106226] Updated weights for policy 0, policy_version 1923813 (0.0005) [2023-12-28 09:05:24,492][106225] Updated weights for policy 1, policy_version 1928035 (0.0007) [2023-12-28 09:05:24,548][106225] Updated weights for policy 1, policy_version 1928045 (0.0009) [2023-12-28 09:05:24,572][106226] Updated weights for policy 0, policy_version 1923823 (0.0009) [2023-12-28 09:05:24,598][106225] Updated weights for policy 1, policy_version 1928055 (0.0010) [2023-12-28 09:05:24,628][106226] Updated weights for policy 0, policy_version 1923833 (0.0009) [2023-12-28 09:05:24,686][106226] Updated weights for policy 0, policy_version 1923843 (0.0005) [2023-12-28 09:05:25,249][106225] Updated weights for policy 1, policy_version 1928065 (0.0008) [2023-12-28 09:05:25,265][106226] Updated weights for policy 0, policy_version 1923853 (0.0005) [2023-12-28 09:05:25,301][106225] Updated weights for policy 1, policy_version 1928075 (0.0005) [2023-12-28 09:05:25,322][106226] Updated weights for policy 0, policy_version 1923863 (0.0005) [2023-12-28 09:05:25,353][106225] Updated weights for policy 1, policy_version 1928085 (0.0005) [2023-12-28 09:05:25,378][106226] Updated weights for policy 0, policy_version 1923873 (0.0007) [2023-12-28 09:05:25,404][106225] Updated weights for policy 1, policy_version 1928095 (0.0005) [2023-12-28 09:05:25,909][106226] Updated weights for policy 0, policy_version 1923883 (0.0007) [2023-12-28 09:05:25,954][106226] Updated weights for policy 0, policy_version 1923893 (0.0007) [2023-12-28 09:05:26,007][106226] Updated weights for policy 0, policy_version 1923903 (0.0008) [2023-12-28 09:05:26,066][106225] Updated weights for policy 1, policy_version 1928105 (0.0010) [2023-12-28 09:05:26,126][106225] Updated weights for policy 1, policy_version 1928115 (0.0010) [2023-12-28 09:05:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 986251264. Throughput: 0: 10073.3, 1: 9774.6. Samples: 986218236. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:26,175][105115] Avg episode reward: [(0, '-4.303'), (1, '-4.490')] [2023-12-28 09:05:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001923912_492601344.pth... [2023-12-28 09:05:26,182][106225] Updated weights for policy 1, policy_version 1928125 (0.0008) [2023-12-28 09:05:26,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001922696_492290048.pth [2023-12-28 09:05:26,202][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001928128_493658112.pth... [2023-12-28 09:05:26,206][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001926976_493363200.pth [2023-12-28 09:05:26,746][106226] Updated weights for policy 0, policy_version 1923913 (0.0007) [2023-12-28 09:05:26,798][106226] Updated weights for policy 0, policy_version 1923923 (0.0008) [2023-12-28 09:05:26,852][106226] Updated weights for policy 0, policy_version 1923933 (0.0008) [2023-12-28 09:05:26,893][106225] Updated weights for policy 1, policy_version 1928135 (0.0010) [2023-12-28 09:05:26,907][106226] Updated weights for policy 0, policy_version 1923943 (0.0006) [2023-12-28 09:05:26,942][106225] Updated weights for policy 1, policy_version 1928145 (0.0010) [2023-12-28 09:05:26,985][106225] Updated weights for policy 1, policy_version 1928155 (0.0010) [2023-12-28 09:05:27,596][106225] Updated weights for policy 1, policy_version 1928165 (0.0009) [2023-12-28 09:05:27,644][106225] Updated weights for policy 1, policy_version 1928175 (0.0008) [2023-12-28 09:05:27,699][106226] Updated weights for policy 0, policy_version 1923953 (0.0008) [2023-12-28 09:05:27,700][106225] Updated weights for policy 1, policy_version 1928185 (0.0005) [2023-12-28 09:05:27,750][106226] Updated weights for policy 0, policy_version 1923963 (0.0007) [2023-12-28 09:05:27,798][106226] Updated weights for policy 0, policy_version 1923973 (0.0008) [2023-12-28 09:05:28,314][106225] Updated weights for policy 1, policy_version 1928195 (0.0007) [2023-12-28 09:05:28,374][106225] Updated weights for policy 1, policy_version 1928205 (0.0008) [2023-12-28 09:05:28,433][106225] Updated weights for policy 1, policy_version 1928215 (0.0005) [2023-12-28 09:05:28,527][106226] Updated weights for policy 0, policy_version 1923983 (0.0008) [2023-12-28 09:05:28,587][106226] Updated weights for policy 0, policy_version 1923993 (0.0009) [2023-12-28 09:05:28,650][106226] Updated weights for policy 0, policy_version 1924003 (0.0009) [2023-12-28 09:05:29,112][106225] Updated weights for policy 1, policy_version 1928225 (0.0006) [2023-12-28 09:05:29,173][106225] Updated weights for policy 1, policy_version 1928235 (0.0008) [2023-12-28 09:05:29,232][106225] Updated weights for policy 1, policy_version 1928245 (0.0008) [2023-12-28 09:05:29,293][106225] Updated weights for policy 1, policy_version 1928255 (0.0010) [2023-12-28 09:05:29,362][106226] Updated weights for policy 0, policy_version 1924013 (0.0008) [2023-12-28 09:05:29,427][106226] Updated weights for policy 0, policy_version 1924023 (0.0008) [2023-12-28 09:05:29,482][106226] Updated weights for policy 0, policy_version 1924033 (0.0008) [2023-12-28 09:05:30,054][106225] Updated weights for policy 1, policy_version 1928265 (0.0009) [2023-12-28 09:05:30,109][106225] Updated weights for policy 1, policy_version 1928275 (0.0009) [2023-12-28 09:05:30,166][106225] Updated weights for policy 1, policy_version 1928285 (0.0007) [2023-12-28 09:05:30,192][106226] Updated weights for policy 0, policy_version 1924043 (0.0008) [2023-12-28 09:05:30,249][106226] Updated weights for policy 0, policy_version 1924053 (0.0006) [2023-12-28 09:05:30,303][106226] Updated weights for policy 0, policy_version 1924063 (0.0009) [2023-12-28 09:05:30,866][106225] Updated weights for policy 1, policy_version 1928295 (0.0007) [2023-12-28 09:05:30,912][106225] Updated weights for policy 1, policy_version 1928305 (0.0008) [2023-12-28 09:05:30,959][106225] Updated weights for policy 1, policy_version 1928315 (0.0009) [2023-12-28 09:05:30,990][106226] Updated weights for policy 0, policy_version 1924073 (0.0008) [2023-12-28 09:05:31,052][106226] Updated weights for policy 0, policy_version 1924083 (0.0009) [2023-12-28 09:05:31,126][106226] Updated weights for policy 0, policy_version 1924093 (0.0008) [2023-12-28 09:05:31,175][105115] Fps is (10 sec: 20479.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 986349568. Throughput: 0: 10183.3, 1: 9902.6. Samples: 986341272. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:31,175][105115] Avg episode reward: [(0, '-4.343'), (1, '-4.925')] [2023-12-28 09:05:31,190][106226] Updated weights for policy 0, policy_version 1924103 (0.0007) [2023-12-28 09:05:31,793][106225] Updated weights for policy 1, policy_version 1928325 (0.0009) [2023-12-28 09:05:31,836][106226] Updated weights for policy 0, policy_version 1924113 (0.0006) [2023-12-28 09:05:31,850][106225] Updated weights for policy 1, policy_version 1928335 (0.0008) [2023-12-28 09:05:31,883][106226] Updated weights for policy 0, policy_version 1924123 (0.0005) [2023-12-28 09:05:31,913][106225] Updated weights for policy 1, policy_version 1928345 (0.0008) [2023-12-28 09:05:31,930][106226] Updated weights for policy 0, policy_version 1924133 (0.0005) [2023-12-28 09:05:32,532][106226] Updated weights for policy 0, policy_version 1924143 (0.0006) [2023-12-28 09:05:32,590][106226] Updated weights for policy 0, policy_version 1924153 (0.0009) [2023-12-28 09:05:32,652][106226] Updated weights for policy 0, policy_version 1924163 (0.0007) [2023-12-28 09:05:32,659][106225] Updated weights for policy 1, policy_version 1928355 (0.0008) [2023-12-28 09:05:32,714][106225] Updated weights for policy 1, policy_version 1928365 (0.0008) [2023-12-28 09:05:32,779][106225] Updated weights for policy 1, policy_version 1928375 (0.0008) [2023-12-28 09:05:33,306][106226] Updated weights for policy 0, policy_version 1924173 (0.0007) [2023-12-28 09:05:33,370][106226] Updated weights for policy 0, policy_version 1924183 (0.0005) [2023-12-28 09:05:33,437][106226] Updated weights for policy 0, policy_version 1924193 (0.0005) [2023-12-28 09:05:33,555][106225] Updated weights for policy 1, policy_version 1928385 (0.0008) [2023-12-28 09:05:33,603][106225] Updated weights for policy 1, policy_version 1928395 (0.0008) [2023-12-28 09:05:33,655][106225] Updated weights for policy 1, policy_version 1928405 (0.0007) [2023-12-28 09:05:33,708][106225] Updated weights for policy 1, policy_version 1928415 (0.0008) [2023-12-28 09:05:33,946][106226] Updated weights for policy 0, policy_version 1924203 (0.0006) [2023-12-28 09:05:34,009][106226] Updated weights for policy 0, policy_version 1924213 (0.0005) [2023-12-28 09:05:34,064][106226] Updated weights for policy 0, policy_version 1924223 (0.0005) [2023-12-28 09:05:34,561][106225] Updated weights for policy 1, policy_version 1928425 (0.0009) [2023-12-28 09:05:34,619][106225] Updated weights for policy 1, policy_version 1928435 (0.0009) [2023-12-28 09:05:34,672][106226] Updated weights for policy 0, policy_version 1924233 (0.0005) [2023-12-28 09:05:34,682][106225] Updated weights for policy 1, policy_version 1928445 (0.0008) [2023-12-28 09:05:34,727][106226] Updated weights for policy 0, policy_version 1924243 (0.0007) [2023-12-28 09:05:34,788][106226] Updated weights for policy 0, policy_version 1924253 (0.0008) [2023-12-28 09:05:34,844][106226] Updated weights for policy 0, policy_version 1924263 (0.0009) [2023-12-28 09:05:35,430][106225] Updated weights for policy 1, policy_version 1928455 (0.0007) [2023-12-28 09:05:35,502][106225] Updated weights for policy 1, policy_version 1928466 (0.0010) [2023-12-28 09:05:35,528][106226] Updated weights for policy 0, policy_version 1924273 (0.0007) [2023-12-28 09:05:35,568][106225] Updated weights for policy 1, policy_version 1928476 (0.0009) [2023-12-28 09:05:35,584][106226] Updated weights for policy 0, policy_version 1924283 (0.0005) [2023-12-28 09:05:35,639][106226] Updated weights for policy 0, policy_version 1924293 (0.0005) [2023-12-28 09:05:36,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 986447872. Throughput: 0: 10283.0, 1: 9794.0. Samples: 986461632. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:36,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.686')] [2023-12-28 09:05:36,195][106226] Updated weights for policy 0, policy_version 1924303 (0.0008) [2023-12-28 09:05:36,202][106225] Updated weights for policy 1, policy_version 1928486 (0.0009) [2023-12-28 09:05:36,261][106226] Updated weights for policy 0, policy_version 1924313 (0.0008) [2023-12-28 09:05:36,266][106225] Updated weights for policy 1, policy_version 1928496 (0.0010) [2023-12-28 09:05:36,324][106226] Updated weights for policy 0, policy_version 1924323 (0.0009) [2023-12-28 09:05:36,333][106225] Updated weights for policy 1, policy_version 1928506 (0.0009) [2023-12-28 09:05:37,035][106226] Updated weights for policy 0, policy_version 1924333 (0.0006) [2023-12-28 09:05:37,101][106225] Updated weights for policy 1, policy_version 1928516 (0.0008) [2023-12-28 09:05:37,103][106226] Updated weights for policy 0, policy_version 1924343 (0.0006) [2023-12-28 09:05:37,155][106225] Updated weights for policy 1, policy_version 1928526 (0.0005) [2023-12-28 09:05:37,157][106226] Updated weights for policy 0, policy_version 1924353 (0.0008) [2023-12-28 09:05:37,209][106225] Updated weights for policy 1, policy_version 1928536 (0.0005) [2023-12-28 09:05:37,712][106226] Updated weights for policy 0, policy_version 1924363 (0.0007) [2023-12-28 09:05:37,772][106226] Updated weights for policy 0, policy_version 1924373 (0.0008) [2023-12-28 09:05:37,832][106226] Updated weights for policy 0, policy_version 1924383 (0.0008) [2023-12-28 09:05:37,946][106225] Updated weights for policy 1, policy_version 1928547 (0.0010) [2023-12-28 09:05:38,005][106225] Updated weights for policy 1, policy_version 1928557 (0.0008) [2023-12-28 09:05:38,057][106225] Updated weights for policy 1, policy_version 1928567 (0.0008) [2023-12-28 09:05:38,567][106226] Updated weights for policy 0, policy_version 1924393 (0.0007) [2023-12-28 09:05:38,617][106226] Updated weights for policy 0, policy_version 1924403 (0.0009) [2023-12-28 09:05:38,663][106226] Updated weights for policy 0, policy_version 1924413 (0.0008) [2023-12-28 09:05:38,709][106226] Updated weights for policy 0, policy_version 1924423 (0.0008) [2023-12-28 09:05:38,814][106225] Updated weights for policy 1, policy_version 1928577 (0.0008) [2023-12-28 09:05:38,869][106225] Updated weights for policy 1, policy_version 1928587 (0.0008) [2023-12-28 09:05:38,921][106225] Updated weights for policy 1, policy_version 1928597 (0.0008) [2023-12-28 09:05:38,980][106225] Updated weights for policy 1, policy_version 1928607 (0.0009) [2023-12-28 09:05:39,487][106226] Updated weights for policy 0, policy_version 1924433 (0.0009) [2023-12-28 09:05:39,543][106226] Updated weights for policy 0, policy_version 1924443 (0.0008) [2023-12-28 09:05:39,605][106226] Updated weights for policy 0, policy_version 1924453 (0.0008) [2023-12-28 09:05:39,792][106225] Updated weights for policy 1, policy_version 1928617 (0.0008) [2023-12-28 09:05:39,862][106225] Updated weights for policy 1, policy_version 1928627 (0.0007) [2023-12-28 09:05:39,936][106225] Updated weights for policy 1, policy_version 1928637 (0.0008) [2023-12-28 09:05:40,429][106226] Updated weights for policy 0, policy_version 1924463 (0.0009) [2023-12-28 09:05:40,490][106226] Updated weights for policy 0, policy_version 1924473 (0.0008) [2023-12-28 09:05:40,544][106226] Updated weights for policy 0, policy_version 1924483 (0.0008) [2023-12-28 09:05:40,573][106225] Updated weights for policy 1, policy_version 1928647 (0.0010) [2023-12-28 09:05:40,627][106225] Updated weights for policy 1, policy_version 1928657 (0.0010) [2023-12-28 09:05:40,677][106225] Updated weights for policy 1, policy_version 1928667 (0.0010) [2023-12-28 09:05:41,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 986546176. Throughput: 0: 10308.5, 1: 9753.1. Samples: 986521304. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:41,175][105115] Avg episode reward: [(0, '-4.462'), (1, '-4.526')] [2023-12-28 09:05:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001924488_492748800.pth... [2023-12-28 09:05:41,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001928672_493797376.pth... [2023-12-28 09:05:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001923304_492445696.pth [2023-12-28 09:05:41,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001927584_493518848.pth [2023-12-28 09:05:41,266][106226] Updated weights for policy 0, policy_version 1924493 (0.0007) [2023-12-28 09:05:41,331][106226] Updated weights for policy 0, policy_version 1924503 (0.0008) [2023-12-28 09:05:41,405][106226] Updated weights for policy 0, policy_version 1924513 (0.0009) [2023-12-28 09:05:41,413][106225] Updated weights for policy 1, policy_version 1928677 (0.0010) [2023-12-28 09:05:41,478][106225] Updated weights for policy 1, policy_version 1928687 (0.0010) [2023-12-28 09:05:41,536][106225] Updated weights for policy 1, policy_version 1928697 (0.0009) [2023-12-28 09:05:42,200][106226] Updated weights for policy 0, policy_version 1924523 (0.0009) [2023-12-28 09:05:42,261][106226] Updated weights for policy 0, policy_version 1924533 (0.0008) [2023-12-28 09:05:42,286][106225] Updated weights for policy 1, policy_version 1928707 (0.0007) [2023-12-28 09:05:42,331][106226] Updated weights for policy 0, policy_version 1924543 (0.0007) [2023-12-28 09:05:42,345][106225] Updated weights for policy 1, policy_version 1928717 (0.0009) [2023-12-28 09:05:42,414][106225] Updated weights for policy 1, policy_version 1928727 (0.0010) [2023-12-28 09:05:42,995][106226] Updated weights for policy 0, policy_version 1924553 (0.0009) [2023-12-28 09:05:43,053][106226] Updated weights for policy 0, policy_version 1924563 (0.0011) [2023-12-28 09:05:43,105][106226] Updated weights for policy 0, policy_version 1924573 (0.0011) [2023-12-28 09:05:43,151][106225] Updated weights for policy 1, policy_version 1928737 (0.0010) [2023-12-28 09:05:43,161][106226] Updated weights for policy 0, policy_version 1924583 (0.0011) [2023-12-28 09:05:43,208][106225] Updated weights for policy 1, policy_version 1928747 (0.0010) [2023-12-28 09:05:43,275][106225] Updated weights for policy 1, policy_version 1928757 (0.0009) [2023-12-28 09:05:43,349][106225] Updated weights for policy 1, policy_version 1928767 (0.0006) [2023-12-28 09:05:43,776][106226] Updated weights for policy 0, policy_version 1924593 (0.0006) [2023-12-28 09:05:43,826][106226] Updated weights for policy 0, policy_version 1924603 (0.0005) [2023-12-28 09:05:43,885][106226] Updated weights for policy 0, policy_version 1924613 (0.0005) [2023-12-28 09:05:43,991][106225] Updated weights for policy 1, policy_version 1928777 (0.0008) [2023-12-28 09:05:44,045][106225] Updated weights for policy 1, policy_version 1928787 (0.0008) [2023-12-28 09:05:44,106][106225] Updated weights for policy 1, policy_version 1928797 (0.0008) [2023-12-28 09:05:44,577][106226] Updated weights for policy 0, policy_version 1924623 (0.0011) [2023-12-28 09:05:44,638][106226] Updated weights for policy 0, policy_version 1924633 (0.0009) [2023-12-28 09:05:44,694][106226] Updated weights for policy 0, policy_version 1924643 (0.0008) [2023-12-28 09:05:44,843][106225] Updated weights for policy 1, policy_version 1928807 (0.0007) [2023-12-28 09:05:44,907][106225] Updated weights for policy 1, policy_version 1928817 (0.0009) [2023-12-28 09:05:44,969][106225] Updated weights for policy 1, policy_version 1928827 (0.0009) [2023-12-28 09:05:45,430][106226] Updated weights for policy 0, policy_version 1924653 (0.0009) [2023-12-28 09:05:45,489][106226] Updated weights for policy 0, policy_version 1924663 (0.0010) [2023-12-28 09:05:45,556][106226] Updated weights for policy 0, policy_version 1924673 (0.0010) [2023-12-28 09:05:45,687][106225] Updated weights for policy 1, policy_version 1928837 (0.0006) [2023-12-28 09:05:45,752][106225] Updated weights for policy 1, policy_version 1928847 (0.0006) [2023-12-28 09:05:45,821][106225] Updated weights for policy 1, policy_version 1928857 (0.0006) [2023-12-28 09:05:46,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 986644480. Throughput: 0: 10202.6, 1: 9574.8. Samples: 986636176. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:46,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.334')] [2023-12-28 09:05:46,203][106226] Updated weights for policy 0, policy_version 1924683 (0.0009) [2023-12-28 09:05:46,267][106226] Updated weights for policy 0, policy_version 1924693 (0.0011) [2023-12-28 09:05:46,323][106226] Updated weights for policy 0, policy_version 1924703 (0.0010) [2023-12-28 09:05:46,378][106225] Updated weights for policy 1, policy_version 1928867 (0.0006) [2023-12-28 09:05:46,441][106225] Updated weights for policy 1, policy_version 1928877 (0.0008) [2023-12-28 09:05:46,491][106225] Updated weights for policy 1, policy_version 1928887 (0.0008) [2023-12-28 09:05:47,081][106226] Updated weights for policy 0, policy_version 1924713 (0.0010) [2023-12-28 09:05:47,118][106225] Updated weights for policy 1, policy_version 1928897 (0.0008) [2023-12-28 09:05:47,139][106226] Updated weights for policy 0, policy_version 1924723 (0.0006) [2023-12-28 09:05:47,174][106225] Updated weights for policy 1, policy_version 1928907 (0.0008) [2023-12-28 09:05:47,192][106226] Updated weights for policy 0, policy_version 1924733 (0.0005) [2023-12-28 09:05:47,230][106225] Updated weights for policy 1, policy_version 1928917 (0.0007) [2023-12-28 09:05:47,245][106226] Updated weights for policy 0, policy_version 1924743 (0.0008) [2023-12-28 09:05:47,295][106225] Updated weights for policy 1, policy_version 1928927 (0.0006) [2023-12-28 09:05:47,948][106226] Updated weights for policy 0, policy_version 1924753 (0.0008) [2023-12-28 09:05:47,964][106225] Updated weights for policy 1, policy_version 1928937 (0.0006) [2023-12-28 09:05:48,010][106226] Updated weights for policy 0, policy_version 1924763 (0.0008) [2023-12-28 09:05:48,020][106225] Updated weights for policy 1, policy_version 1928947 (0.0006) [2023-12-28 09:05:48,067][106225] Updated weights for policy 1, policy_version 1928957 (0.0005) [2023-12-28 09:05:48,067][106226] Updated weights for policy 0, policy_version 1924773 (0.0008) [2023-12-28 09:05:48,773][106225] Updated weights for policy 1, policy_version 1928967 (0.0005) [2023-12-28 09:05:48,774][106226] Updated weights for policy 0, policy_version 1924783 (0.0009) [2023-12-28 09:05:48,831][106225] Updated weights for policy 1, policy_version 1928977 (0.0005) [2023-12-28 09:05:48,837][106226] Updated weights for policy 0, policy_version 1924793 (0.0009) [2023-12-28 09:05:48,890][106225] Updated weights for policy 1, policy_version 1928987 (0.0006) [2023-12-28 09:05:48,900][106226] Updated weights for policy 0, policy_version 1924803 (0.0006) [2023-12-28 09:05:49,573][106225] Updated weights for policy 1, policy_version 1928997 (0.0007) [2023-12-28 09:05:49,634][106225] Updated weights for policy 1, policy_version 1929007 (0.0007) [2023-12-28 09:05:49,641][106226] Updated weights for policy 0, policy_version 1924813 (0.0007) [2023-12-28 09:05:49,692][106225] Updated weights for policy 1, policy_version 1929017 (0.0007) [2023-12-28 09:05:49,706][106226] Updated weights for policy 0, policy_version 1924823 (0.0007) [2023-12-28 09:05:49,771][106226] Updated weights for policy 0, policy_version 1924833 (0.0007) [2023-12-28 09:05:50,426][106225] Updated weights for policy 1, policy_version 1929027 (0.0006) [2023-12-28 09:05:50,465][106226] Updated weights for policy 0, policy_version 1924843 (0.0009) [2023-12-28 09:05:50,480][106225] Updated weights for policy 1, policy_version 1929037 (0.0005) [2023-12-28 09:05:50,518][106226] Updated weights for policy 0, policy_version 1924853 (0.0011) [2023-12-28 09:05:50,537][106225] Updated weights for policy 1, policy_version 1929047 (0.0006) [2023-12-28 09:05:50,582][106226] Updated weights for policy 0, policy_version 1924863 (0.0012) [2023-12-28 09:05:51,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 986742784. Throughput: 0: 10091.6, 1: 9612.0. Samples: 986756324. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:51,175][105115] Avg episode reward: [(0, '-4.244'), (1, '-4.239')] [2023-12-28 09:05:51,227][106226] Updated weights for policy 0, policy_version 1924873 (0.0010) [2023-12-28 09:05:51,296][106226] Updated weights for policy 0, policy_version 1924883 (0.0008) [2023-12-28 09:05:51,307][106225] Updated weights for policy 1, policy_version 1929057 (0.0008) [2023-12-28 09:05:51,363][106226] Updated weights for policy 0, policy_version 1924893 (0.0008) [2023-12-28 09:05:51,375][106225] Updated weights for policy 1, policy_version 1929067 (0.0006) [2023-12-28 09:05:51,423][106226] Updated weights for policy 0, policy_version 1924903 (0.0009) [2023-12-28 09:05:51,441][106225] Updated weights for policy 1, policy_version 1929077 (0.0006) [2023-12-28 09:05:51,490][106225] Updated weights for policy 1, policy_version 1929087 (0.0006) [2023-12-28 09:05:52,111][106226] Updated weights for policy 0, policy_version 1924913 (0.0007) [2023-12-28 09:05:52,157][106226] Updated weights for policy 0, policy_version 1924923 (0.0007) [2023-12-28 09:05:52,183][106225] Updated weights for policy 1, policy_version 1929097 (0.0007) [2023-12-28 09:05:52,218][106226] Updated weights for policy 0, policy_version 1924933 (0.0007) [2023-12-28 09:05:52,242][106225] Updated weights for policy 1, policy_version 1929107 (0.0009) [2023-12-28 09:05:52,305][106225] Updated weights for policy 1, policy_version 1929117 (0.0007) [2023-12-28 09:05:52,911][106226] Updated weights for policy 0, policy_version 1924943 (0.0008) [2023-12-28 09:05:52,962][106226] Updated weights for policy 0, policy_version 1924953 (0.0008) [2023-12-28 09:05:53,016][106225] Updated weights for policy 1, policy_version 1929127 (0.0007) [2023-12-28 09:05:53,022][106226] Updated weights for policy 0, policy_version 1924963 (0.0006) [2023-12-28 09:05:53,075][106225] Updated weights for policy 1, policy_version 1929137 (0.0007) [2023-12-28 09:05:53,139][106225] Updated weights for policy 1, policy_version 1929147 (0.0009) [2023-12-28 09:05:53,700][106226] Updated weights for policy 0, policy_version 1924973 (0.0007) [2023-12-28 09:05:53,749][106226] Updated weights for policy 0, policy_version 1924983 (0.0008) [2023-12-28 09:05:53,797][106226] Updated weights for policy 0, policy_version 1924993 (0.0008) [2023-12-28 09:05:53,876][106225] Updated weights for policy 1, policy_version 1929157 (0.0009) [2023-12-28 09:05:53,920][106225] Updated weights for policy 1, policy_version 1929167 (0.0008) [2023-12-28 09:05:53,976][106225] Updated weights for policy 1, policy_version 1929177 (0.0007) [2023-12-28 09:05:54,574][106226] Updated weights for policy 0, policy_version 1925003 (0.0009) [2023-12-28 09:05:54,625][106225] Updated weights for policy 1, policy_version 1929187 (0.0009) [2023-12-28 09:05:54,634][106226] Updated weights for policy 0, policy_version 1925013 (0.0009) [2023-12-28 09:05:54,680][106225] Updated weights for policy 1, policy_version 1929197 (0.0010) [2023-12-28 09:05:54,698][106226] Updated weights for policy 0, policy_version 1925023 (0.0009) [2023-12-28 09:05:54,733][106225] Updated weights for policy 1, policy_version 1929207 (0.0010) [2023-12-28 09:05:55,395][106226] Updated weights for policy 0, policy_version 1925033 (0.0007) [2023-12-28 09:05:55,420][106225] Updated weights for policy 1, policy_version 1929217 (0.0010) [2023-12-28 09:05:55,450][106226] Updated weights for policy 0, policy_version 1925043 (0.0006) [2023-12-28 09:05:55,477][106225] Updated weights for policy 1, policy_version 1929227 (0.0010) [2023-12-28 09:05:55,498][106226] Updated weights for policy 0, policy_version 1925053 (0.0007) [2023-12-28 09:05:55,533][106225] Updated weights for policy 1, policy_version 1929237 (0.0010) [2023-12-28 09:05:55,559][106226] Updated weights for policy 0, policy_version 1925063 (0.0006) [2023-12-28 09:05:55,582][106225] Updated weights for policy 1, policy_version 1929247 (0.0010) [2023-12-28 09:05:56,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 986841088. Throughput: 0: 10085.1, 1: 9597.1. Samples: 986814632. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:05:56,175][105115] Avg episode reward: [(0, '-4.127'), (1, '-4.594')] [2023-12-28 09:05:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001925064_492896256.pth... [2023-12-28 09:05:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001929248_493944832.pth... [2023-12-28 09:05:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001923912_492601344.pth [2023-12-28 09:05:56,192][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001928128_493658112.pth [2023-12-28 09:05:56,258][106226] Updated weights for policy 0, policy_version 1925073 (0.0005) [2023-12-28 09:05:56,307][106225] Updated weights for policy 1, policy_version 1929257 (0.0010) [2023-12-28 09:05:56,320][106226] Updated weights for policy 0, policy_version 1925083 (0.0005) [2023-12-28 09:05:56,357][106225] Updated weights for policy 1, policy_version 1929267 (0.0010) [2023-12-28 09:05:56,376][106226] Updated weights for policy 0, policy_version 1925093 (0.0005) [2023-12-28 09:05:56,409][106225] Updated weights for policy 1, policy_version 1929277 (0.0010) [2023-12-28 09:05:56,877][106226] Updated weights for policy 0, policy_version 1925103 (0.0005) [2023-12-28 09:05:56,938][106226] Updated weights for policy 0, policy_version 1925113 (0.0005) [2023-12-28 09:05:56,998][106226] Updated weights for policy 0, policy_version 1925123 (0.0005) [2023-12-28 09:05:57,137][106225] Updated weights for policy 1, policy_version 1929287 (0.0010) [2023-12-28 09:05:57,186][106225] Updated weights for policy 1, policy_version 1929297 (0.0010) [2023-12-28 09:05:57,234][106225] Updated weights for policy 1, policy_version 1929307 (0.0010) [2023-12-28 09:05:57,573][106226] Updated weights for policy 0, policy_version 1925133 (0.0006) [2023-12-28 09:05:57,639][106226] Updated weights for policy 0, policy_version 1925143 (0.0006) [2023-12-28 09:05:57,701][106226] Updated weights for policy 0, policy_version 1925153 (0.0005) [2023-12-28 09:05:57,954][106225] Updated weights for policy 1, policy_version 1929317 (0.0010) [2023-12-28 09:05:57,999][106225] Updated weights for policy 1, policy_version 1929327 (0.0010) [2023-12-28 09:05:58,055][106225] Updated weights for policy 1, policy_version 1929337 (0.0010) [2023-12-28 09:05:58,311][106226] Updated weights for policy 0, policy_version 1925163 (0.0010) [2023-12-28 09:05:58,380][106226] Updated weights for policy 0, policy_version 1925173 (0.0009) [2023-12-28 09:05:58,446][106226] Updated weights for policy 0, policy_version 1925183 (0.0010) [2023-12-28 09:05:58,878][106225] Updated weights for policy 1, policy_version 1929347 (0.0010) [2023-12-28 09:05:58,951][106225] Updated weights for policy 1, policy_version 1929357 (0.0008) [2023-12-28 09:05:59,012][106225] Updated weights for policy 1, policy_version 1929367 (0.0010) [2023-12-28 09:05:59,290][106226] Updated weights for policy 0, policy_version 1925193 (0.0009) [2023-12-28 09:05:59,357][106226] Updated weights for policy 0, policy_version 1925203 (0.0010) [2023-12-28 09:05:59,424][106226] Updated weights for policy 0, policy_version 1925213 (0.0011) [2023-12-28 09:05:59,488][106226] Updated weights for policy 0, policy_version 1925223 (0.0010) [2023-12-28 09:05:59,721][106225] Updated weights for policy 1, policy_version 1929377 (0.0006) [2023-12-28 09:05:59,775][106225] Updated weights for policy 1, policy_version 1929387 (0.0010) [2023-12-28 09:05:59,838][106225] Updated weights for policy 1, policy_version 1929397 (0.0009) [2023-12-28 09:05:59,903][106225] Updated weights for policy 1, policy_version 1929407 (0.0009) [2023-12-28 09:06:00,141][106226] Updated weights for policy 0, policy_version 1925233 (0.0006) [2023-12-28 09:06:00,207][106226] Updated weights for policy 0, policy_version 1925243 (0.0005) [2023-12-28 09:06:00,272][106226] Updated weights for policy 0, policy_version 1925253 (0.0009) [2023-12-28 09:06:00,502][106225] Updated weights for policy 1, policy_version 1929417 (0.0006) [2023-12-28 09:06:00,568][106225] Updated weights for policy 1, policy_version 1929427 (0.0008) [2023-12-28 09:06:00,626][106225] Updated weights for policy 1, policy_version 1929437 (0.0010) [2023-12-28 09:06:00,860][106226] Updated weights for policy 0, policy_version 1925263 (0.0007) [2023-12-28 09:06:00,915][106226] Updated weights for policy 0, policy_version 1925273 (0.0005) [2023-12-28 09:06:00,962][106226] Updated weights for policy 0, policy_version 1925283 (0.0005) [2023-12-28 09:06:01,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19883.0). Total num frames: 986947584. Throughput: 0: 10150.1, 1: 9673.8. Samples: 986935176. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:01,175][105115] Avg episode reward: [(0, '-4.655'), (1, '-4.463')] [2023-12-28 09:06:01,343][106225] Updated weights for policy 1, policy_version 1929447 (0.0010) [2023-12-28 09:06:01,414][106225] Updated weights for policy 1, policy_version 1929457 (0.0007) [2023-12-28 09:06:01,471][106225] Updated weights for policy 1, policy_version 1929467 (0.0008) [2023-12-28 09:06:01,650][106226] Updated weights for policy 0, policy_version 1925293 (0.0006) [2023-12-28 09:06:01,712][106226] Updated weights for policy 0, policy_version 1925303 (0.0009) [2023-12-28 09:06:01,778][106226] Updated weights for policy 0, policy_version 1925313 (0.0009) [2023-12-28 09:06:02,170][106225] Updated weights for policy 1, policy_version 1929477 (0.0007) [2023-12-28 09:06:02,221][106225] Updated weights for policy 1, policy_version 1929487 (0.0007) [2023-12-28 09:06:02,282][106225] Updated weights for policy 1, policy_version 1929497 (0.0007) [2023-12-28 09:06:02,571][106226] Updated weights for policy 0, policy_version 1925323 (0.0010) [2023-12-28 09:06:02,626][106226] Updated weights for policy 0, policy_version 1925333 (0.0009) [2023-12-28 09:06:02,674][106226] Updated weights for policy 0, policy_version 1925343 (0.0008) [2023-12-28 09:06:02,993][106225] Updated weights for policy 1, policy_version 1929507 (0.0007) [2023-12-28 09:06:03,042][106225] Updated weights for policy 1, policy_version 1929517 (0.0008) [2023-12-28 09:06:03,097][106225] Updated weights for policy 1, policy_version 1929527 (0.0009) [2023-12-28 09:06:03,370][106226] Updated weights for policy 0, policy_version 1925353 (0.0007) [2023-12-28 09:06:03,417][106226] Updated weights for policy 0, policy_version 1925363 (0.0008) [2023-12-28 09:06:03,466][106226] Updated weights for policy 0, policy_version 1925373 (0.0007) [2023-12-28 09:06:03,513][106226] Updated weights for policy 0, policy_version 1925383 (0.0005) [2023-12-28 09:06:03,820][106225] Updated weights for policy 1, policy_version 1929537 (0.0009) [2023-12-28 09:06:03,888][106225] Updated weights for policy 1, policy_version 1929547 (0.0007) [2023-12-28 09:06:03,949][106225] Updated weights for policy 1, policy_version 1929557 (0.0007) [2023-12-28 09:06:04,019][106225] Updated weights for policy 1, policy_version 1929567 (0.0008) [2023-12-28 09:06:04,140][106226] Updated weights for policy 0, policy_version 1925393 (0.0007) [2023-12-28 09:06:04,202][106226] Updated weights for policy 0, policy_version 1925403 (0.0011) [2023-12-28 09:06:04,270][106226] Updated weights for policy 0, policy_version 1925413 (0.0011) [2023-12-28 09:06:04,734][106225] Updated weights for policy 1, policy_version 1929577 (0.0010) [2023-12-28 09:06:04,792][106225] Updated weights for policy 1, policy_version 1929587 (0.0010) [2023-12-28 09:06:04,846][106225] Updated weights for policy 1, policy_version 1929597 (0.0010) [2023-12-28 09:06:04,958][106226] Updated weights for policy 0, policy_version 1925423 (0.0007) [2023-12-28 09:06:05,025][106226] Updated weights for policy 0, policy_version 1925433 (0.0005) [2023-12-28 09:06:05,092][106226] Updated weights for policy 0, policy_version 1925443 (0.0005) [2023-12-28 09:06:05,572][106225] Updated weights for policy 1, policy_version 1929607 (0.0010) [2023-12-28 09:06:05,631][106225] Updated weights for policy 1, policy_version 1929617 (0.0006) [2023-12-28 09:06:05,690][106225] Updated weights for policy 1, policy_version 1929627 (0.0009) [2023-12-28 09:06:05,725][106226] Updated weights for policy 0, policy_version 1925453 (0.0007) [2023-12-28 09:06:05,783][106226] Updated weights for policy 0, policy_version 1925463 (0.0005) [2023-12-28 09:06:05,836][106226] Updated weights for policy 0, policy_version 1925473 (0.0008) [2023-12-28 09:06:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19797.4, 300 sec: 19883.0). Total num frames: 987045888. Throughput: 0: 10138.1, 1: 9766.7. Samples: 987055712. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:06,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.591')] [2023-12-28 09:06:06,348][106225] Updated weights for policy 1, policy_version 1929637 (0.0010) [2023-12-28 09:06:06,412][106225] Updated weights for policy 1, policy_version 1929647 (0.0007) [2023-12-28 09:06:06,476][106225] Updated weights for policy 1, policy_version 1929657 (0.0010) [2023-12-28 09:06:06,510][106226] Updated weights for policy 0, policy_version 1925483 (0.0009) [2023-12-28 09:06:06,573][106226] Updated weights for policy 0, policy_version 1925493 (0.0008) [2023-12-28 09:06:06,631][106226] Updated weights for policy 0, policy_version 1925503 (0.0008) [2023-12-28 09:06:07,163][106225] Updated weights for policy 1, policy_version 1929667 (0.0009) [2023-12-28 09:06:07,226][106225] Updated weights for policy 1, policy_version 1929677 (0.0006) [2023-12-28 09:06:07,292][106225] Updated weights for policy 1, policy_version 1929687 (0.0005) [2023-12-28 09:06:07,370][106226] Updated weights for policy 0, policy_version 1925513 (0.0008) [2023-12-28 09:06:07,444][106226] Updated weights for policy 0, policy_version 1925523 (0.0005) [2023-12-28 09:06:07,512][106226] Updated weights for policy 0, policy_version 1925533 (0.0009) [2023-12-28 09:06:07,579][106226] Updated weights for policy 0, policy_version 1925543 (0.0009) [2023-12-28 09:06:07,874][106225] Updated weights for policy 1, policy_version 1929697 (0.0007) [2023-12-28 09:06:07,926][106225] Updated weights for policy 1, policy_version 1929707 (0.0006) [2023-12-28 09:06:07,973][106225] Updated weights for policy 1, policy_version 1929717 (0.0009) [2023-12-28 09:06:08,027][106225] Updated weights for policy 1, policy_version 1929727 (0.0007) [2023-12-28 09:06:08,266][106226] Updated weights for policy 0, policy_version 1925553 (0.0010) [2023-12-28 09:06:08,314][106226] Updated weights for policy 0, policy_version 1925563 (0.0009) [2023-12-28 09:06:08,380][106226] Updated weights for policy 0, policy_version 1925573 (0.0011) [2023-12-28 09:06:08,649][106225] Updated weights for policy 1, policy_version 1929737 (0.0010) [2023-12-28 09:06:08,709][106225] Updated weights for policy 1, policy_version 1929747 (0.0009) [2023-12-28 09:06:08,767][106225] Updated weights for policy 1, policy_version 1929757 (0.0010) [2023-12-28 09:06:09,082][106226] Updated weights for policy 0, policy_version 1925583 (0.0008) [2023-12-28 09:06:09,146][106226] Updated weights for policy 0, policy_version 1925593 (0.0008) [2023-12-28 09:06:09,212][106226] Updated weights for policy 0, policy_version 1925603 (0.0007) [2023-12-28 09:06:09,539][106225] Updated weights for policy 1, policy_version 1929767 (0.0010) [2023-12-28 09:06:09,586][106225] Updated weights for policy 1, policy_version 1929777 (0.0010) [2023-12-28 09:06:09,642][106225] Updated weights for policy 1, policy_version 1929787 (0.0008) [2023-12-28 09:06:09,942][106226] Updated weights for policy 0, policy_version 1925613 (0.0009) [2023-12-28 09:06:10,009][106226] Updated weights for policy 0, policy_version 1925623 (0.0008) [2023-12-28 09:06:10,075][106226] Updated weights for policy 0, policy_version 1925633 (0.0008) [2023-12-28 09:06:10,389][106225] Updated weights for policy 1, policy_version 1929797 (0.0008) [2023-12-28 09:06:10,456][106225] Updated weights for policy 1, policy_version 1929807 (0.0007) [2023-12-28 09:06:10,520][106225] Updated weights for policy 1, policy_version 1929817 (0.0008) [2023-12-28 09:06:10,773][106226] Updated weights for policy 0, policy_version 1925643 (0.0009) [2023-12-28 09:06:10,829][106226] Updated weights for policy 0, policy_version 1925653 (0.0010) [2023-12-28 09:06:10,891][106226] Updated weights for policy 0, policy_version 1925663 (0.0010) [2023-12-28 09:06:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19883.0). Total num frames: 987144192. Throughput: 0: 10123.4, 1: 9833.1. Samples: 987116276. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:11,175][105115] Avg episode reward: [(0, '-4.361'), (1, '-4.777')] [2023-12-28 09:06:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001929824_494092288.pth... [2023-12-28 09:06:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001925672_493051904.pth... [2023-12-28 09:06:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001924488_492748800.pth [2023-12-28 09:06:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001928672_493797376.pth [2023-12-28 09:06:11,295][106225] Updated weights for policy 1, policy_version 1929827 (0.0009) [2023-12-28 09:06:11,358][106225] Updated weights for policy 1, policy_version 1929837 (0.0008) [2023-12-28 09:06:11,423][106225] Updated weights for policy 1, policy_version 1929847 (0.0008) [2023-12-28 09:06:11,659][106226] Updated weights for policy 0, policy_version 1925673 (0.0010) [2023-12-28 09:06:11,728][106226] Updated weights for policy 0, policy_version 1925683 (0.0008) [2023-12-28 09:06:11,798][106226] Updated weights for policy 0, policy_version 1925693 (0.0007) [2023-12-28 09:06:11,868][106226] Updated weights for policy 0, policy_version 1925703 (0.0006) [2023-12-28 09:06:12,203][106225] Updated weights for policy 1, policy_version 1929857 (0.0008) [2023-12-28 09:06:12,269][106225] Updated weights for policy 1, policy_version 1929867 (0.0008) [2023-12-28 09:06:12,338][106225] Updated weights for policy 1, policy_version 1929877 (0.0007) [2023-12-28 09:06:12,401][106225] Updated weights for policy 1, policy_version 1929887 (0.0008) [2023-12-28 09:06:12,512][106226] Updated weights for policy 0, policy_version 1925713 (0.0008) [2023-12-28 09:06:12,575][106226] Updated weights for policy 0, policy_version 1925723 (0.0008) [2023-12-28 09:06:12,645][106226] Updated weights for policy 0, policy_version 1925733 (0.0009) [2023-12-28 09:06:13,030][106225] Updated weights for policy 1, policy_version 1929897 (0.0007) [2023-12-28 09:06:13,087][106225] Updated weights for policy 1, policy_version 1929907 (0.0009) [2023-12-28 09:06:13,143][106225] Updated weights for policy 1, policy_version 1929917 (0.0008) [2023-12-28 09:06:13,368][106226] Updated weights for policy 0, policy_version 1925743 (0.0009) [2023-12-28 09:06:13,424][106226] Updated weights for policy 0, policy_version 1925753 (0.0008) [2023-12-28 09:06:13,475][106226] Updated weights for policy 0, policy_version 1925763 (0.0008) [2023-12-28 09:06:13,866][106225] Updated weights for policy 1, policy_version 1929927 (0.0008) [2023-12-28 09:06:13,920][106225] Updated weights for policy 1, policy_version 1929937 (0.0009) [2023-12-28 09:06:13,970][106225] Updated weights for policy 1, policy_version 1929947 (0.0008) [2023-12-28 09:06:14,118][106226] Updated weights for policy 0, policy_version 1925773 (0.0008) [2023-12-28 09:06:14,188][106226] Updated weights for policy 0, policy_version 1925783 (0.0006) [2023-12-28 09:06:14,253][106226] Updated weights for policy 0, policy_version 1925793 (0.0006) [2023-12-28 09:06:14,675][106225] Updated weights for policy 1, policy_version 1929957 (0.0009) [2023-12-28 09:06:14,738][106225] Updated weights for policy 1, policy_version 1929967 (0.0008) [2023-12-28 09:06:14,801][106225] Updated weights for policy 1, policy_version 1929977 (0.0008) [2023-12-28 09:06:14,852][106226] Updated weights for policy 0, policy_version 1925803 (0.0007) [2023-12-28 09:06:14,916][106226] Updated weights for policy 0, policy_version 1925813 (0.0007) [2023-12-28 09:06:14,975][106226] Updated weights for policy 0, policy_version 1925823 (0.0009) [2023-12-28 09:06:15,556][106225] Updated weights for policy 1, policy_version 1929987 (0.0009) [2023-12-28 09:06:15,613][106225] Updated weights for policy 1, policy_version 1929997 (0.0010) [2023-12-28 09:06:15,647][106226] Updated weights for policy 0, policy_version 1925833 (0.0008) [2023-12-28 09:06:15,673][106225] Updated weights for policy 1, policy_version 1930007 (0.0010) [2023-12-28 09:06:15,708][106226] Updated weights for policy 0, policy_version 1925843 (0.0005) [2023-12-28 09:06:15,767][106226] Updated weights for policy 0, policy_version 1925853 (0.0008) [2023-12-28 09:06:15,826][106226] Updated weights for policy 0, policy_version 1925863 (0.0008) [2023-12-28 09:06:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 987242496. Throughput: 0: 10070.0, 1: 9710.9. Samples: 987231408. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:16,175][105115] Avg episode reward: [(0, '-4.141'), (1, '-4.411')] [2023-12-28 09:06:16,325][106225] Updated weights for policy 1, policy_version 1930017 (0.0010) [2023-12-28 09:06:16,372][106225] Updated weights for policy 1, policy_version 1930027 (0.0010) [2023-12-28 09:06:16,419][106225] Updated weights for policy 1, policy_version 1930037 (0.0010) [2023-12-28 09:06:16,476][106225] Updated weights for policy 1, policy_version 1930047 (0.0010) [2023-12-28 09:06:16,533][106226] Updated weights for policy 0, policy_version 1925873 (0.0008) [2023-12-28 09:06:16,586][106226] Updated weights for policy 0, policy_version 1925883 (0.0008) [2023-12-28 09:06:16,646][106226] Updated weights for policy 0, policy_version 1925893 (0.0006) [2023-12-28 09:06:17,222][106225] Updated weights for policy 1, policy_version 1930057 (0.0011) [2023-12-28 09:06:17,282][106225] Updated weights for policy 1, policy_version 1930067 (0.0010) [2023-12-28 09:06:17,298][106226] Updated weights for policy 0, policy_version 1925903 (0.0010) [2023-12-28 09:06:17,333][106225] Updated weights for policy 1, policy_version 1930077 (0.0010) [2023-12-28 09:06:17,345][106226] Updated weights for policy 0, policy_version 1925913 (0.0010) [2023-12-28 09:06:17,392][106226] Updated weights for policy 0, policy_version 1925923 (0.0010) [2023-12-28 09:06:17,937][106225] Updated weights for policy 1, policy_version 1930087 (0.0007) [2023-12-28 09:06:17,993][106225] Updated weights for policy 1, policy_version 1930097 (0.0007) [2023-12-28 09:06:18,052][106225] Updated weights for policy 1, policy_version 1930107 (0.0008) [2023-12-28 09:06:18,064][106226] Updated weights for policy 0, policy_version 1925933 (0.0009) [2023-12-28 09:06:18,126][106226] Updated weights for policy 0, policy_version 1925943 (0.0011) [2023-12-28 09:06:18,176][106226] Updated weights for policy 0, policy_version 1925953 (0.0010) [2023-12-28 09:06:18,799][106225] Updated weights for policy 1, policy_version 1930117 (0.0006) [2023-12-28 09:06:18,870][106225] Updated weights for policy 1, policy_version 1930127 (0.0006) [2023-12-28 09:06:18,875][106226] Updated weights for policy 0, policy_version 1925963 (0.0008) [2023-12-28 09:06:18,932][106226] Updated weights for policy 0, policy_version 1925973 (0.0010) [2023-12-28 09:06:18,935][106225] Updated weights for policy 1, policy_version 1930137 (0.0006) [2023-12-28 09:06:18,992][106226] Updated weights for policy 0, policy_version 1925983 (0.0008) [2023-12-28 09:06:19,626][106225] Updated weights for policy 1, policy_version 1930147 (0.0007) [2023-12-28 09:06:19,686][106225] Updated weights for policy 1, policy_version 1930157 (0.0008) [2023-12-28 09:06:19,749][106225] Updated weights for policy 1, policy_version 1930167 (0.0008) [2023-12-28 09:06:19,751][106226] Updated weights for policy 0, policy_version 1925993 (0.0008) [2023-12-28 09:06:19,812][106226] Updated weights for policy 0, policy_version 1926003 (0.0006) [2023-12-28 09:06:19,883][106226] Updated weights for policy 0, policy_version 1926013 (0.0007) [2023-12-28 09:06:19,946][106226] Updated weights for policy 0, policy_version 1926023 (0.0008) [2023-12-28 09:06:20,469][106225] Updated weights for policy 1, policy_version 1930177 (0.0007) [2023-12-28 09:06:20,521][106225] Updated weights for policy 1, policy_version 1930187 (0.0008) [2023-12-28 09:06:20,579][106225] Updated weights for policy 1, policy_version 1930197 (0.0008) [2023-12-28 09:06:20,643][106225] Updated weights for policy 1, policy_version 1930207 (0.0008) [2023-12-28 09:06:20,696][106226] Updated weights for policy 0, policy_version 1926033 (0.0006) [2023-12-28 09:06:20,764][106226] Updated weights for policy 0, policy_version 1926043 (0.0006) [2023-12-28 09:06:20,836][106226] Updated weights for policy 0, policy_version 1926053 (0.0009) [2023-12-28 09:06:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 987340800. Throughput: 0: 9937.2, 1: 9790.7. Samples: 987349384. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:21,175][105115] Avg episode reward: [(0, '-4.251'), (1, '-4.572')] [2023-12-28 09:06:21,367][106225] Updated weights for policy 1, policy_version 1930217 (0.0008) [2023-12-28 09:06:21,432][106225] Updated weights for policy 1, policy_version 1930227 (0.0006) [2023-12-28 09:06:21,490][106225] Updated weights for policy 1, policy_version 1930237 (0.0006) [2023-12-28 09:06:21,569][106226] Updated weights for policy 0, policy_version 1926063 (0.0008) [2023-12-28 09:06:21,641][106226] Updated weights for policy 0, policy_version 1926073 (0.0008) [2023-12-28 09:06:21,698][106226] Updated weights for policy 0, policy_version 1926083 (0.0010) [2023-12-28 09:06:22,233][106225] Updated weights for policy 1, policy_version 1930247 (0.0007) [2023-12-28 09:06:22,292][106225] Updated weights for policy 1, policy_version 1930257 (0.0009) [2023-12-28 09:06:22,357][106225] Updated weights for policy 1, policy_version 1930267 (0.0009) [2023-12-28 09:06:22,475][106226] Updated weights for policy 0, policy_version 1926093 (0.0011) [2023-12-28 09:06:22,534][106226] Updated weights for policy 0, policy_version 1926103 (0.0011) [2023-12-28 09:06:22,598][106226] Updated weights for policy 0, policy_version 1926113 (0.0010) [2023-12-28 09:06:23,124][106225] Updated weights for policy 1, policy_version 1930277 (0.0009) [2023-12-28 09:06:23,185][106225] Updated weights for policy 1, policy_version 1930287 (0.0008) [2023-12-28 09:06:23,239][106225] Updated weights for policy 1, policy_version 1930297 (0.0008) [2023-12-28 09:06:23,301][106226] Updated weights for policy 0, policy_version 1926123 (0.0009) [2023-12-28 09:06:23,361][106226] Updated weights for policy 0, policy_version 1926133 (0.0010) [2023-12-28 09:06:23,424][106226] Updated weights for policy 0, policy_version 1926143 (0.0010) [2023-12-28 09:06:23,938][106225] Updated weights for policy 1, policy_version 1930307 (0.0007) [2023-12-28 09:06:24,007][106225] Updated weights for policy 1, policy_version 1930317 (0.0005) [2023-12-28 09:06:24,040][106226] Updated weights for policy 0, policy_version 1926153 (0.0010) [2023-12-28 09:06:24,065][106225] Updated weights for policy 1, policy_version 1930327 (0.0005) [2023-12-28 09:06:24,105][106226] Updated weights for policy 0, policy_version 1926163 (0.0006) [2023-12-28 09:06:24,169][106226] Updated weights for policy 0, policy_version 1926173 (0.0008) [2023-12-28 09:06:24,227][106226] Updated weights for policy 0, policy_version 1926183 (0.0010) [2023-12-28 09:06:24,712][106225] Updated weights for policy 1, policy_version 1930337 (0.0006) [2023-12-28 09:06:24,774][106225] Updated weights for policy 1, policy_version 1930347 (0.0008) [2023-12-28 09:06:24,828][106225] Updated weights for policy 1, policy_version 1930357 (0.0007) [2023-12-28 09:06:24,887][106225] Updated weights for policy 1, policy_version 1930367 (0.0006) [2023-12-28 09:06:24,901][106226] Updated weights for policy 0, policy_version 1926193 (0.0010) [2023-12-28 09:06:24,958][106226] Updated weights for policy 0, policy_version 1926203 (0.0010) [2023-12-28 09:06:25,021][106226] Updated weights for policy 0, policy_version 1926213 (0.0011) [2023-12-28 09:06:25,610][106225] Updated weights for policy 1, policy_version 1930377 (0.0008) [2023-12-28 09:06:25,664][106225] Updated weights for policy 1, policy_version 1930387 (0.0008) [2023-12-28 09:06:25,715][106225] Updated weights for policy 1, policy_version 1930397 (0.0010) [2023-12-28 09:06:25,729][106226] Updated weights for policy 0, policy_version 1926223 (0.0007) [2023-12-28 09:06:25,774][106226] Updated weights for policy 0, policy_version 1926233 (0.0005) [2023-12-28 09:06:25,822][106226] Updated weights for policy 0, policy_version 1926243 (0.0005) [2023-12-28 09:06:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 987439104. Throughput: 0: 9901.9, 1: 9774.4. Samples: 987406736. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:26,175][105115] Avg episode reward: [(0, '-4.070'), (1, '-4.630')] [2023-12-28 09:06:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001930400_494239744.pth... [2023-12-28 09:06:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001926248_493199360.pth... [2023-12-28 09:06:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001929248_493944832.pth [2023-12-28 09:06:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001925064_492896256.pth [2023-12-28 09:06:26,330][106225] Updated weights for policy 1, policy_version 1930407 (0.0007) [2023-12-28 09:06:26,386][106225] Updated weights for policy 1, policy_version 1930417 (0.0008) [2023-12-28 09:06:26,423][106226] Updated weights for policy 0, policy_version 1926253 (0.0009) [2023-12-28 09:06:26,444][106225] Updated weights for policy 1, policy_version 1930427 (0.0010) [2023-12-28 09:06:26,474][106226] Updated weights for policy 0, policy_version 1926263 (0.0011) [2023-12-28 09:06:26,527][106226] Updated weights for policy 0, policy_version 1926273 (0.0010) [2023-12-28 09:06:27,036][106225] Updated weights for policy 1, policy_version 1930437 (0.0008) [2023-12-28 09:06:27,081][106225] Updated weights for policy 1, policy_version 1930447 (0.0005) [2023-12-28 09:06:27,132][106225] Updated weights for policy 1, policy_version 1930457 (0.0005) [2023-12-28 09:06:27,251][106226] Updated weights for policy 0, policy_version 1926283 (0.0010) [2023-12-28 09:06:27,310][106226] Updated weights for policy 0, policy_version 1926293 (0.0007) [2023-12-28 09:06:27,372][106226] Updated weights for policy 0, policy_version 1926303 (0.0010) [2023-12-28 09:06:27,751][106225] Updated weights for policy 1, policy_version 1930467 (0.0006) [2023-12-28 09:06:27,799][106225] Updated weights for policy 1, policy_version 1930477 (0.0008) [2023-12-28 09:06:27,844][106225] Updated weights for policy 1, policy_version 1930487 (0.0008) [2023-12-28 09:06:28,010][106226] Updated weights for policy 0, policy_version 1926313 (0.0006) [2023-12-28 09:06:28,055][106226] Updated weights for policy 0, policy_version 1926323 (0.0005) [2023-12-28 09:06:28,103][106226] Updated weights for policy 0, policy_version 1926333 (0.0005) [2023-12-28 09:06:28,156][106226] Updated weights for policy 0, policy_version 1926343 (0.0005) [2023-12-28 09:06:28,446][106225] Updated weights for policy 1, policy_version 1930497 (0.0008) [2023-12-28 09:06:28,501][106225] Updated weights for policy 1, policy_version 1930507 (0.0009) [2023-12-28 09:06:28,555][106225] Updated weights for policy 1, policy_version 1930517 (0.0006) [2023-12-28 09:06:28,609][106225] Updated weights for policy 1, policy_version 1930527 (0.0011) [2023-12-28 09:06:28,718][106226] Updated weights for policy 0, policy_version 1926353 (0.0006) [2023-12-28 09:06:28,778][106226] Updated weights for policy 0, policy_version 1926363 (0.0011) [2023-12-28 09:06:28,836][106226] Updated weights for policy 0, policy_version 1926373 (0.0011) [2023-12-28 09:06:29,322][106225] Updated weights for policy 1, policy_version 1930537 (0.0010) [2023-12-28 09:06:29,389][106225] Updated weights for policy 1, policy_version 1930547 (0.0007) [2023-12-28 09:06:29,450][106225] Updated weights for policy 1, policy_version 1930557 (0.0006) [2023-12-28 09:06:29,537][106226] Updated weights for policy 0, policy_version 1926383 (0.0011) [2023-12-28 09:06:29,611][106226] Updated weights for policy 0, policy_version 1926393 (0.0011) [2023-12-28 09:06:29,678][106226] Updated weights for policy 0, policy_version 1926403 (0.0011) [2023-12-28 09:06:30,147][106225] Updated weights for policy 1, policy_version 1930567 (0.0007) [2023-12-28 09:06:30,196][106225] Updated weights for policy 1, policy_version 1930577 (0.0008) [2023-12-28 09:06:30,253][106225] Updated weights for policy 1, policy_version 1930587 (0.0009) [2023-12-28 09:06:30,318][106226] Updated weights for policy 0, policy_version 1926413 (0.0011) [2023-12-28 09:06:30,383][106226] Updated weights for policy 0, policy_version 1926423 (0.0007) [2023-12-28 09:06:30,446][106226] Updated weights for policy 0, policy_version 1926433 (0.0010) [2023-12-28 09:06:30,945][106225] Updated weights for policy 1, policy_version 1930597 (0.0006) [2023-12-28 09:06:31,005][106225] Updated weights for policy 1, policy_version 1930607 (0.0005) [2023-12-28 09:06:31,035][106226] Updated weights for policy 0, policy_version 1926443 (0.0010) [2023-12-28 09:06:31,076][106225] Updated weights for policy 1, policy_version 1930617 (0.0010) [2023-12-28 09:06:31,099][106226] Updated weights for policy 0, policy_version 1926453 (0.0007) [2023-12-28 09:06:31,166][106226] Updated weights for policy 0, policy_version 1926463 (0.0007) [2023-12-28 09:06:31,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 987545600. Throughput: 0: 10013.2, 1: 9932.9. Samples: 987533748. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:31,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.549')] [2023-12-28 09:06:31,768][106225] Updated weights for policy 1, policy_version 1930627 (0.0009) [2023-12-28 09:06:31,819][106225] Updated weights for policy 1, policy_version 1930637 (0.0005) [2023-12-28 09:06:31,876][106225] Updated weights for policy 1, policy_version 1930647 (0.0005) [2023-12-28 09:06:31,892][106226] Updated weights for policy 0, policy_version 1926473 (0.0006) [2023-12-28 09:06:31,960][106226] Updated weights for policy 0, policy_version 1926483 (0.0011) [2023-12-28 09:06:32,021][106226] Updated weights for policy 0, policy_version 1926493 (0.0011) [2023-12-28 09:06:32,068][106226] Updated weights for policy 0, policy_version 1926503 (0.0010) [2023-12-28 09:06:32,568][106225] Updated weights for policy 1, policy_version 1930657 (0.0005) [2023-12-28 09:06:32,627][106225] Updated weights for policy 1, policy_version 1930667 (0.0006) [2023-12-28 09:06:32,697][106225] Updated weights for policy 1, policy_version 1930677 (0.0006) [2023-12-28 09:06:32,762][106225] Updated weights for policy 1, policy_version 1930687 (0.0006) [2023-12-28 09:06:32,769][106226] Updated weights for policy 0, policy_version 1926513 (0.0009) [2023-12-28 09:06:32,834][106226] Updated weights for policy 0, policy_version 1926523 (0.0008) [2023-12-28 09:06:32,887][106226] Updated weights for policy 0, policy_version 1926533 (0.0009) [2023-12-28 09:06:33,418][106225] Updated weights for policy 1, policy_version 1930697 (0.0005) [2023-12-28 09:06:33,470][106225] Updated weights for policy 1, policy_version 1930707 (0.0005) [2023-12-28 09:06:33,525][106225] Updated weights for policy 1, policy_version 1930717 (0.0010) [2023-12-28 09:06:33,527][106226] Updated weights for policy 0, policy_version 1926543 (0.0007) [2023-12-28 09:06:33,582][106226] Updated weights for policy 0, policy_version 1926553 (0.0005) [2023-12-28 09:06:33,630][106226] Updated weights for policy 0, policy_version 1926563 (0.0005) [2023-12-28 09:06:34,206][106225] Updated weights for policy 1, policy_version 1930727 (0.0009) [2023-12-28 09:06:34,270][106225] Updated weights for policy 1, policy_version 1930737 (0.0009) [2023-12-28 09:06:34,306][106226] Updated weights for policy 0, policy_version 1926573 (0.0005) [2023-12-28 09:06:34,328][106225] Updated weights for policy 1, policy_version 1930747 (0.0008) [2023-12-28 09:06:34,371][106226] Updated weights for policy 0, policy_version 1926583 (0.0007) [2023-12-28 09:06:34,432][106226] Updated weights for policy 0, policy_version 1926593 (0.0009) [2023-12-28 09:06:35,013][106225] Updated weights for policy 1, policy_version 1930757 (0.0007) [2023-12-28 09:06:35,072][106225] Updated weights for policy 1, policy_version 1930767 (0.0005) [2023-12-28 09:06:35,102][106226] Updated weights for policy 0, policy_version 1926603 (0.0007) [2023-12-28 09:06:35,134][106225] Updated weights for policy 1, policy_version 1930777 (0.0006) [2023-12-28 09:06:35,162][106226] Updated weights for policy 0, policy_version 1926613 (0.0006) [2023-12-28 09:06:35,209][106226] Updated weights for policy 0, policy_version 1926623 (0.0006) [2023-12-28 09:06:35,815][106226] Updated weights for policy 0, policy_version 1926633 (0.0006) [2023-12-28 09:06:35,820][106225] Updated weights for policy 1, policy_version 1930787 (0.0006) [2023-12-28 09:06:35,866][106226] Updated weights for policy 0, policy_version 1926643 (0.0006) [2023-12-28 09:06:35,879][106225] Updated weights for policy 1, policy_version 1930797 (0.0006) [2023-12-28 09:06:35,923][106226] Updated weights for policy 0, policy_version 1926653 (0.0007) [2023-12-28 09:06:35,936][106225] Updated weights for policy 1, policy_version 1930807 (0.0006) [2023-12-28 09:06:35,982][106226] Updated weights for policy 0, policy_version 1926663 (0.0008) [2023-12-28 09:06:36,175][105115] Fps is (10 sec: 21299.1, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 987652096. Throughput: 0: 10080.0, 1: 9907.1. Samples: 987655744. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:36,175][105115] Avg episode reward: [(0, '-4.248'), (1, '-4.420')] [2023-12-28 09:06:36,666][106226] Updated weights for policy 0, policy_version 1926673 (0.0008) [2023-12-28 09:06:36,686][106225] Updated weights for policy 1, policy_version 1930817 (0.0006) [2023-12-28 09:06:36,716][106226] Updated weights for policy 0, policy_version 1926683 (0.0008) [2023-12-28 09:06:36,759][106225] Updated weights for policy 1, policy_version 1930827 (0.0007) [2023-12-28 09:06:36,768][106226] Updated weights for policy 0, policy_version 1926693 (0.0007) [2023-12-28 09:06:36,816][106225] Updated weights for policy 1, policy_version 1930837 (0.0007) [2023-12-28 09:06:36,868][106225] Updated weights for policy 1, policy_version 1930847 (0.0008) [2023-12-28 09:06:37,397][106226] Updated weights for policy 0, policy_version 1926703 (0.0006) [2023-12-28 09:06:37,461][106226] Updated weights for policy 0, policy_version 1926713 (0.0005) [2023-12-28 09:06:37,530][106226] Updated weights for policy 0, policy_version 1926723 (0.0006) [2023-12-28 09:06:37,624][106225] Updated weights for policy 1, policy_version 1930857 (0.0007) [2023-12-28 09:06:37,676][106225] Updated weights for policy 1, policy_version 1930867 (0.0008) [2023-12-28 09:06:37,731][106225] Updated weights for policy 1, policy_version 1930877 (0.0009) [2023-12-28 09:06:38,133][106226] Updated weights for policy 0, policy_version 1926733 (0.0011) [2023-12-28 09:06:38,192][106226] Updated weights for policy 0, policy_version 1926743 (0.0011) [2023-12-28 09:06:38,248][106226] Updated weights for policy 0, policy_version 1926753 (0.0011) [2023-12-28 09:06:38,541][106225] Updated weights for policy 1, policy_version 1930887 (0.0008) [2023-12-28 09:06:38,603][106225] Updated weights for policy 1, policy_version 1930897 (0.0008) [2023-12-28 09:06:38,655][106225] Updated weights for policy 1, policy_version 1930907 (0.0009) [2023-12-28 09:06:39,023][106226] Updated weights for policy 0, policy_version 1926763 (0.0010) [2023-12-28 09:06:39,077][106226] Updated weights for policy 0, policy_version 1926773 (0.0008) [2023-12-28 09:06:39,139][106226] Updated weights for policy 0, policy_version 1926783 (0.0008) [2023-12-28 09:06:39,430][106225] Updated weights for policy 1, policy_version 1930917 (0.0009) [2023-12-28 09:06:39,490][106225] Updated weights for policy 1, policy_version 1930927 (0.0009) [2023-12-28 09:06:39,544][106225] Updated weights for policy 1, policy_version 1930937 (0.0008) [2023-12-28 09:06:39,913][106226] Updated weights for policy 0, policy_version 1926793 (0.0009) [2023-12-28 09:06:39,999][106226] Updated weights for policy 0, policy_version 1926806 (0.0008) [2023-12-28 09:06:40,069][106226] Updated weights for policy 0, policy_version 1926816 (0.0007) [2023-12-28 09:06:40,353][106225] Updated weights for policy 1, policy_version 1930947 (0.0009) [2023-12-28 09:06:40,406][106225] Updated weights for policy 1, policy_version 1930957 (0.0007) [2023-12-28 09:06:40,468][106225] Updated weights for policy 1, policy_version 1930967 (0.0008) [2023-12-28 09:06:40,775][106226] Updated weights for policy 0, policy_version 1926826 (0.0008) [2023-12-28 09:06:40,832][106226] Updated weights for policy 0, policy_version 1926836 (0.0007) [2023-12-28 09:06:40,886][106226] Updated weights for policy 0, policy_version 1926846 (0.0007) [2023-12-28 09:06:40,947][106226] Updated weights for policy 0, policy_version 1926856 (0.0008) [2023-12-28 09:06:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 987742208. Throughput: 0: 10112.4, 1: 9876.6. Samples: 987714140. Policy #0 lag: (min: 11.0, avg: 15.2, max: 43.0) [2023-12-28 09:06:41,175][105115] Avg episode reward: [(0, '-4.339'), (1, '-4.289')] [2023-12-28 09:06:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001926856_493355008.pth... [2023-12-28 09:06:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001930976_494387200.pth... [2023-12-28 09:06:41,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001925672_493051904.pth [2023-12-28 09:06:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001929824_494092288.pth [2023-12-28 09:06:41,242][106225] Updated weights for policy 1, policy_version 1930977 (0.0008) [2023-12-28 09:06:41,319][106225] Updated weights for policy 1, policy_version 1930987 (0.0008) [2023-12-28 09:06:41,390][106225] Updated weights for policy 1, policy_version 1930997 (0.0008) [2023-12-28 09:06:41,458][106225] Updated weights for policy 1, policy_version 1931007 (0.0009) [2023-12-28 09:06:41,666][106226] Updated weights for policy 0, policy_version 1926866 (0.0010) [2023-12-28 09:06:41,743][106226] Updated weights for policy 0, policy_version 1926876 (0.0008) [2023-12-28 09:06:41,806][106226] Updated weights for policy 0, policy_version 1926886 (0.0006) [2023-12-28 09:06:42,156][106225] Updated weights for policy 1, policy_version 1931017 (0.0006) [2023-12-28 09:06:42,211][106225] Updated weights for policy 1, policy_version 1931027 (0.0005) [2023-12-28 09:06:42,276][106225] Updated weights for policy 1, policy_version 1931037 (0.0007) [2023-12-28 09:06:42,589][106226] Updated weights for policy 0, policy_version 1926896 (0.0009) [2023-12-28 09:06:42,643][106226] Updated weights for policy 0, policy_version 1926906 (0.0010) [2023-12-28 09:06:42,702][106226] Updated weights for policy 0, policy_version 1926916 (0.0009) [2023-12-28 09:06:42,878][106225] Updated weights for policy 1, policy_version 1931047 (0.0008) [2023-12-28 09:06:42,935][106225] Updated weights for policy 1, policy_version 1931057 (0.0009) [2023-12-28 09:06:42,986][106225] Updated weights for policy 1, policy_version 1931067 (0.0010) [2023-12-28 09:06:43,492][106226] Updated weights for policy 0, policy_version 1926926 (0.0007) [2023-12-28 09:06:43,553][106226] Updated weights for policy 0, policy_version 1926936 (0.0007) [2023-12-28 09:06:43,603][106226] Updated weights for policy 0, policy_version 1926946 (0.0005) [2023-12-28 09:06:43,686][106225] Updated weights for policy 1, policy_version 1931077 (0.0009) [2023-12-28 09:06:43,746][106225] Updated weights for policy 1, policy_version 1931087 (0.0009) [2023-12-28 09:06:43,801][106225] Updated weights for policy 1, policy_version 1931097 (0.0010) [2023-12-28 09:06:44,154][106226] Updated weights for policy 0, policy_version 1926956 (0.0007) [2023-12-28 09:06:44,205][106226] Updated weights for policy 0, policy_version 1926966 (0.0005) [2023-12-28 09:06:44,266][106226] Updated weights for policy 0, policy_version 1926976 (0.0006) [2023-12-28 09:06:44,612][106225] Updated weights for policy 1, policy_version 1931107 (0.0008) [2023-12-28 09:06:44,661][106225] Updated weights for policy 1, policy_version 1931117 (0.0008) [2023-12-28 09:06:44,710][106225] Updated weights for policy 1, policy_version 1931127 (0.0008) [2023-12-28 09:06:44,948][106226] Updated weights for policy 0, policy_version 1926986 (0.0006) [2023-12-28 09:06:45,015][106226] Updated weights for policy 0, policy_version 1926996 (0.0010) [2023-12-28 09:06:45,077][106226] Updated weights for policy 0, policy_version 1927006 (0.0008) [2023-12-28 09:06:45,138][106226] Updated weights for policy 0, policy_version 1927016 (0.0009) [2023-12-28 09:06:45,472][106225] Updated weights for policy 1, policy_version 1931137 (0.0008) [2023-12-28 09:06:45,538][106225] Updated weights for policy 1, policy_version 1931147 (0.0005) [2023-12-28 09:06:45,601][106225] Updated weights for policy 1, policy_version 1931157 (0.0006) [2023-12-28 09:06:45,663][106225] Updated weights for policy 1, policy_version 1931167 (0.0008) [2023-12-28 09:06:45,895][106226] Updated weights for policy 0, policy_version 1927026 (0.0008) [2023-12-28 09:06:45,947][106226] Updated weights for policy 0, policy_version 1927036 (0.0008) [2023-12-28 09:06:46,005][106226] Updated weights for policy 0, policy_version 1927046 (0.0008) [2023-12-28 09:06:46,175][105115] Fps is (10 sec: 18841.0, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 987840512. Throughput: 0: 10018.8, 1: 9847.4. Samples: 987829160. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:06:46,177][105115] Avg episode reward: [(0, '-4.398'), (1, '-4.548')] [2023-12-28 09:06:46,253][106225] Updated weights for policy 1, policy_version 1931177 (0.0006) [2023-12-28 09:06:46,308][106225] Updated weights for policy 1, policy_version 1931187 (0.0006) [2023-12-28 09:06:46,371][106225] Updated weights for policy 1, policy_version 1931197 (0.0006) [2023-12-28 09:06:46,773][106226] Updated weights for policy 0, policy_version 1927056 (0.0010) [2023-12-28 09:06:46,836][106226] Updated weights for policy 0, policy_version 1927066 (0.0010) [2023-12-28 09:06:46,929][106226] Updated weights for policy 0, policy_version 1927076 (0.0011) [2023-12-28 09:06:47,001][106225] Updated weights for policy 1, policy_version 1931207 (0.0006) [2023-12-28 09:06:47,067][106225] Updated weights for policy 1, policy_version 1931217 (0.0005) [2023-12-28 09:06:47,134][106225] Updated weights for policy 1, policy_version 1931227 (0.0005) [2023-12-28 09:06:47,605][106226] Updated weights for policy 0, policy_version 1927086 (0.0011) [2023-12-28 09:06:47,656][106226] Updated weights for policy 0, policy_version 1927096 (0.0010) [2023-12-28 09:06:47,718][106226] Updated weights for policy 0, policy_version 1927106 (0.0011) [2023-12-28 09:06:47,770][106225] Updated weights for policy 1, policy_version 1931237 (0.0007) [2023-12-28 09:06:47,828][106225] Updated weights for policy 1, policy_version 1931247 (0.0008) [2023-12-28 09:06:47,885][106225] Updated weights for policy 1, policy_version 1931257 (0.0008) [2023-12-28 09:06:48,467][106226] Updated weights for policy 0, policy_version 1927116 (0.0011) [2023-12-28 09:06:48,531][106226] Updated weights for policy 0, policy_version 1927126 (0.0009) [2023-12-28 09:06:48,592][106226] Updated weights for policy 0, policy_version 1927136 (0.0011) [2023-12-28 09:06:48,637][106225] Updated weights for policy 1, policy_version 1931267 (0.0008) [2023-12-28 09:06:48,694][106225] Updated weights for policy 1, policy_version 1931277 (0.0009) [2023-12-28 09:06:48,759][106225] Updated weights for policy 1, policy_version 1931287 (0.0008) [2023-12-28 09:06:49,213][106226] Updated weights for policy 0, policy_version 1927146 (0.0010) [2023-12-28 09:06:49,283][106226] Updated weights for policy 0, policy_version 1927156 (0.0007) [2023-12-28 09:06:49,353][106226] Updated weights for policy 0, policy_version 1927166 (0.0009) [2023-12-28 09:06:49,422][106226] Updated weights for policy 0, policy_version 1927176 (0.0010) [2023-12-28 09:06:49,580][106225] Updated weights for policy 1, policy_version 1931297 (0.0009) [2023-12-28 09:06:49,643][106225] Updated weights for policy 1, policy_version 1931307 (0.0010) [2023-12-28 09:06:49,702][106225] Updated weights for policy 1, policy_version 1931317 (0.0007) [2023-12-28 09:06:49,764][106225] Updated weights for policy 1, policy_version 1931327 (0.0007) [2023-12-28 09:06:50,070][106226] Updated weights for policy 0, policy_version 1927186 (0.0008) [2023-12-28 09:06:50,137][106226] Updated weights for policy 0, policy_version 1927196 (0.0011) [2023-12-28 09:06:50,201][106226] Updated weights for policy 0, policy_version 1927206 (0.0011) [2023-12-28 09:06:50,517][106225] Updated weights for policy 1, policy_version 1931337 (0.0007) [2023-12-28 09:06:50,583][106225] Updated weights for policy 1, policy_version 1931347 (0.0007) [2023-12-28 09:06:50,643][106225] Updated weights for policy 1, policy_version 1931357 (0.0006) [2023-12-28 09:06:50,942][106226] Updated weights for policy 0, policy_version 1927216 (0.0011) [2023-12-28 09:06:51,009][106226] Updated weights for policy 0, policy_version 1927226 (0.0010) [2023-12-28 09:06:51,081][106226] Updated weights for policy 0, policy_version 1927236 (0.0008) [2023-12-28 09:06:51,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19827.5). Total num frames: 987938816. Throughput: 0: 9949.3, 1: 9841.5. Samples: 987946292. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:06:51,175][105115] Avg episode reward: [(0, '-4.122'), (1, '-4.571')] [2023-12-28 09:06:51,313][106225] Updated weights for policy 1, policy_version 1931367 (0.0007) [2023-12-28 09:06:51,380][106225] Updated weights for policy 1, policy_version 1931377 (0.0008) [2023-12-28 09:06:51,442][106225] Updated weights for policy 1, policy_version 1931387 (0.0008) [2023-12-28 09:06:51,854][106226] Updated weights for policy 0, policy_version 1927246 (0.0008) [2023-12-28 09:06:51,913][106226] Updated weights for policy 0, policy_version 1927256 (0.0006) [2023-12-28 09:06:51,973][106226] Updated weights for policy 0, policy_version 1927266 (0.0008) [2023-12-28 09:06:52,210][106225] Updated weights for policy 1, policy_version 1931397 (0.0009) [2023-12-28 09:06:52,274][106225] Updated weights for policy 1, policy_version 1931407 (0.0008) [2023-12-28 09:06:52,338][106225] Updated weights for policy 1, policy_version 1931417 (0.0006) [2023-12-28 09:06:52,743][106226] Updated weights for policy 0, policy_version 1927276 (0.0008) [2023-12-28 09:06:52,818][106226] Updated weights for policy 0, policy_version 1927286 (0.0009) [2023-12-28 09:06:52,886][106226] Updated weights for policy 0, policy_version 1927296 (0.0009) [2023-12-28 09:06:52,977][106225] Updated weights for policy 1, policy_version 1931427 (0.0008) [2023-12-28 09:06:53,032][106225] Updated weights for policy 1, policy_version 1931437 (0.0009) [2023-12-28 09:06:53,087][106225] Updated weights for policy 1, policy_version 1931447 (0.0009) [2023-12-28 09:06:53,589][106226] Updated weights for policy 0, policy_version 1927306 (0.0008) [2023-12-28 09:06:53,651][106226] Updated weights for policy 0, policy_version 1927316 (0.0009) [2023-12-28 09:06:53,721][106226] Updated weights for policy 0, policy_version 1927326 (0.0009) [2023-12-28 09:06:53,781][106225] Updated weights for policy 1, policy_version 1931457 (0.0008) [2023-12-28 09:06:53,787][106226] Updated weights for policy 0, policy_version 1927336 (0.0011) [2023-12-28 09:06:53,832][106225] Updated weights for policy 1, policy_version 1931467 (0.0005) [2023-12-28 09:06:53,880][106225] Updated weights for policy 1, policy_version 1931477 (0.0005) [2023-12-28 09:06:53,932][106225] Updated weights for policy 1, policy_version 1931487 (0.0008) [2023-12-28 09:06:54,512][106226] Updated weights for policy 0, policy_version 1927346 (0.0009) [2023-12-28 09:06:54,565][106225] Updated weights for policy 1, policy_version 1931497 (0.0005) [2023-12-28 09:06:54,572][106226] Updated weights for policy 0, policy_version 1927356 (0.0009) [2023-12-28 09:06:54,620][106226] Updated weights for policy 0, policy_version 1927366 (0.0005) [2023-12-28 09:06:54,620][106225] Updated weights for policy 1, policy_version 1931507 (0.0009) [2023-12-28 09:06:54,669][106225] Updated weights for policy 1, policy_version 1931517 (0.0009) [2023-12-28 09:06:55,210][106226] Updated weights for policy 0, policy_version 1927376 (0.0006) [2023-12-28 09:06:55,268][106226] Updated weights for policy 0, policy_version 1927386 (0.0006) [2023-12-28 09:06:55,334][106226] Updated weights for policy 0, policy_version 1927396 (0.0005) [2023-12-28 09:06:55,468][106225] Updated weights for policy 1, policy_version 1931527 (0.0007) [2023-12-28 09:06:55,524][106225] Updated weights for policy 1, policy_version 1931537 (0.0005) [2023-12-28 09:06:55,580][106225] Updated weights for policy 1, policy_version 1931547 (0.0006) [2023-12-28 09:06:56,024][106226] Updated weights for policy 0, policy_version 1927406 (0.0008) [2023-12-28 09:06:56,077][106226] Updated weights for policy 0, policy_version 1927416 (0.0010) [2023-12-28 09:06:56,131][106226] Updated weights for policy 0, policy_version 1927426 (0.0010) [2023-12-28 09:06:56,175][105115] Fps is (10 sec: 19661.4, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 988037120. Throughput: 0: 9925.1, 1: 9807.2. Samples: 988004232. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:06:56,175][105115] Avg episode reward: [(0, '-4.346'), (1, '-4.621')] [2023-12-28 09:06:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001927432_493502464.pth... [2023-12-28 09:06:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001931552_494534656.pth... [2023-12-28 09:06:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001926248_493199360.pth [2023-12-28 09:06:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001930400_494239744.pth [2023-12-28 09:06:56,238][106225] Updated weights for policy 1, policy_version 1931557 (0.0007) [2023-12-28 09:06:56,301][106225] Updated weights for policy 1, policy_version 1931567 (0.0006) [2023-12-28 09:06:56,362][106225] Updated weights for policy 1, policy_version 1931577 (0.0008) [2023-12-28 09:06:56,692][106226] Updated weights for policy 0, policy_version 1927436 (0.0009) [2023-12-28 09:06:56,756][106226] Updated weights for policy 0, policy_version 1927446 (0.0008) [2023-12-28 09:06:56,809][106226] Updated weights for policy 0, policy_version 1927456 (0.0010) [2023-12-28 09:06:57,100][106225] Updated weights for policy 1, policy_version 1931587 (0.0009) [2023-12-28 09:06:57,149][106225] Updated weights for policy 1, policy_version 1931597 (0.0008) [2023-12-28 09:06:57,194][106225] Updated weights for policy 1, policy_version 1931607 (0.0007) [2023-12-28 09:06:57,441][106226] Updated weights for policy 0, policy_version 1927466 (0.0010) [2023-12-28 09:06:57,494][106226] Updated weights for policy 0, policy_version 1927476 (0.0005) [2023-12-28 09:06:57,551][106226] Updated weights for policy 0, policy_version 1927486 (0.0005) [2023-12-28 09:06:57,618][106226] Updated weights for policy 0, policy_version 1927496 (0.0005) [2023-12-28 09:06:57,990][106225] Updated weights for policy 1, policy_version 1931617 (0.0009) [2023-12-28 09:06:58,052][106225] Updated weights for policy 1, policy_version 1931627 (0.0007) [2023-12-28 09:06:58,106][106225] Updated weights for policy 1, policy_version 1931637 (0.0008) [2023-12-28 09:06:58,130][106226] Updated weights for policy 0, policy_version 1927506 (0.0005) [2023-12-28 09:06:58,155][106225] Updated weights for policy 1, policy_version 1931647 (0.0008) [2023-12-28 09:06:58,192][106226] Updated weights for policy 0, policy_version 1927516 (0.0005) [2023-12-28 09:06:58,261][106226] Updated weights for policy 0, policy_version 1927526 (0.0008) [2023-12-28 09:06:58,967][106225] Updated weights for policy 1, policy_version 1931657 (0.0009) [2023-12-28 09:06:58,993][106226] Updated weights for policy 0, policy_version 1927536 (0.0009) [2023-12-28 09:06:59,029][106225] Updated weights for policy 1, policy_version 1931667 (0.0006) [2023-12-28 09:06:59,045][106226] Updated weights for policy 0, policy_version 1927546 (0.0010) [2023-12-28 09:06:59,089][106225] Updated weights for policy 1, policy_version 1931677 (0.0006) [2023-12-28 09:06:59,101][106226] Updated weights for policy 0, policy_version 1927556 (0.0008) [2023-12-28 09:06:59,853][106225] Updated weights for policy 1, policy_version 1931687 (0.0008) [2023-12-28 09:06:59,877][106226] Updated weights for policy 0, policy_version 1927566 (0.0010) [2023-12-28 09:06:59,920][106225] Updated weights for policy 1, policy_version 1931697 (0.0007) [2023-12-28 09:06:59,942][106226] Updated weights for policy 0, policy_version 1927576 (0.0008) [2023-12-28 09:06:59,987][106225] Updated weights for policy 1, policy_version 1931707 (0.0007) [2023-12-28 09:07:00,006][106226] Updated weights for policy 0, policy_version 1927586 (0.0008) [2023-12-28 09:07:00,630][106225] Updated weights for policy 1, policy_version 1931717 (0.0006) [2023-12-28 09:07:00,674][106225] Updated weights for policy 1, policy_version 1931727 (0.0008) [2023-12-28 09:07:00,725][106225] Updated weights for policy 1, policy_version 1931737 (0.0008) [2023-12-28 09:07:00,733][106226] Updated weights for policy 0, policy_version 1927596 (0.0008) [2023-12-28 09:07:00,790][106226] Updated weights for policy 0, policy_version 1927606 (0.0010) [2023-12-28 09:07:00,843][106226] Updated weights for policy 0, policy_version 1927616 (0.0010) [2023-12-28 09:07:01,174][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 988135424. Throughput: 0: 10016.2, 1: 9810.4. Samples: 988123604. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:01,175][105115] Avg episode reward: [(0, '-4.182'), (1, '-4.796')] [2023-12-28 09:07:01,455][106225] Updated weights for policy 1, policy_version 1931747 (0.0007) [2023-12-28 09:07:01,512][106225] Updated weights for policy 1, policy_version 1931757 (0.0008) [2023-12-28 09:07:01,565][106226] Updated weights for policy 0, policy_version 1927626 (0.0010) [2023-12-28 09:07:01,568][106225] Updated weights for policy 1, policy_version 1931767 (0.0007) [2023-12-28 09:07:01,631][106226] Updated weights for policy 0, policy_version 1927636 (0.0010) [2023-12-28 09:07:01,693][106226] Updated weights for policy 0, policy_version 1927646 (0.0008) [2023-12-28 09:07:01,763][106226] Updated weights for policy 0, policy_version 1927656 (0.0007) [2023-12-28 09:07:02,375][106225] Updated weights for policy 1, policy_version 1931777 (0.0009) [2023-12-28 09:07:02,442][106226] Updated weights for policy 0, policy_version 1927666 (0.0006) [2023-12-28 09:07:02,443][106225] Updated weights for policy 1, policy_version 1931787 (0.0009) [2023-12-28 09:07:02,501][106226] Updated weights for policy 0, policy_version 1927676 (0.0007) [2023-12-28 09:07:02,504][106225] Updated weights for policy 1, policy_version 1931797 (0.0007) [2023-12-28 09:07:02,557][106226] Updated weights for policy 0, policy_version 1927686 (0.0006) [2023-12-28 09:07:02,566][106225] Updated weights for policy 1, policy_version 1931807 (0.0008) [2023-12-28 09:07:03,202][106226] Updated weights for policy 0, policy_version 1927696 (0.0009) [2023-12-28 09:07:03,252][106226] Updated weights for policy 0, policy_version 1927706 (0.0010) [2023-12-28 09:07:03,304][106226] Updated weights for policy 0, policy_version 1927716 (0.0010) [2023-12-28 09:07:03,309][106225] Updated weights for policy 1, policy_version 1931817 (0.0010) [2023-12-28 09:07:03,362][106225] Updated weights for policy 1, policy_version 1931827 (0.0010) [2023-12-28 09:07:03,412][106225] Updated weights for policy 1, policy_version 1931837 (0.0007) [2023-12-28 09:07:03,963][106226] Updated weights for policy 0, policy_version 1927726 (0.0009) [2023-12-28 09:07:04,021][106226] Updated weights for policy 0, policy_version 1927736 (0.0008) [2023-12-28 09:07:04,080][106226] Updated weights for policy 0, policy_version 1927746 (0.0008) [2023-12-28 09:07:04,091][106225] Updated weights for policy 1, policy_version 1931847 (0.0006) [2023-12-28 09:07:04,154][106225] Updated weights for policy 1, policy_version 1931857 (0.0007) [2023-12-28 09:07:04,218][106225] Updated weights for policy 1, policy_version 1931867 (0.0008) [2023-12-28 09:07:04,808][106226] Updated weights for policy 0, policy_version 1927756 (0.0009) [2023-12-28 09:07:04,865][106226] Updated weights for policy 0, policy_version 1927766 (0.0011) [2023-12-28 09:07:04,925][106226] Updated weights for policy 0, policy_version 1927776 (0.0007) [2023-12-28 09:07:04,973][106225] Updated weights for policy 1, policy_version 1931877 (0.0008) [2023-12-28 09:07:05,035][106225] Updated weights for policy 1, policy_version 1931887 (0.0008) [2023-12-28 09:07:05,083][106225] Updated weights for policy 1, policy_version 1931897 (0.0008) [2023-12-28 09:07:05,523][106226] Updated weights for policy 0, policy_version 1927786 (0.0006) [2023-12-28 09:07:05,578][106226] Updated weights for policy 0, policy_version 1927796 (0.0010) [2023-12-28 09:07:05,642][106226] Updated weights for policy 0, policy_version 1927806 (0.0008) [2023-12-28 09:07:05,709][106226] Updated weights for policy 0, policy_version 1927816 (0.0005) [2023-12-28 09:07:05,902][106225] Updated weights for policy 1, policy_version 1931907 (0.0008) [2023-12-28 09:07:05,968][106225] Updated weights for policy 1, policy_version 1931917 (0.0010) [2023-12-28 09:07:06,041][106225] Updated weights for policy 1, policy_version 1931927 (0.0008) [2023-12-28 09:07:06,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 988233728. Throughput: 0: 10081.6, 1: 9784.8. Samples: 988243372. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:06,175][105115] Avg episode reward: [(0, '-4.562'), (1, '-4.627')] [2023-12-28 09:07:06,241][106226] Updated weights for policy 0, policy_version 1927826 (0.0010) [2023-12-28 09:07:06,303][106226] Updated weights for policy 0, policy_version 1927836 (0.0010) [2023-12-28 09:07:06,371][106226] Updated weights for policy 0, policy_version 1927846 (0.0006) [2023-12-28 09:07:06,836][106225] Updated weights for policy 1, policy_version 1931937 (0.0009) [2023-12-28 09:07:06,899][106225] Updated weights for policy 1, policy_version 1931947 (0.0009) [2023-12-28 09:07:06,946][106225] Updated weights for policy 1, policy_version 1931957 (0.0008) [2023-12-28 09:07:06,962][106226] Updated weights for policy 0, policy_version 1927856 (0.0009) [2023-12-28 09:07:07,002][106225] Updated weights for policy 1, policy_version 1931967 (0.0008) [2023-12-28 09:07:07,015][106226] Updated weights for policy 0, policy_version 1927866 (0.0011) [2023-12-28 09:07:07,072][106226] Updated weights for policy 0, policy_version 1927876 (0.0010) [2023-12-28 09:07:07,754][106225] Updated weights for policy 1, policy_version 1931977 (0.0008) [2023-12-28 09:07:07,776][106226] Updated weights for policy 0, policy_version 1927886 (0.0010) [2023-12-28 09:07:07,804][106225] Updated weights for policy 1, policy_version 1931987 (0.0008) [2023-12-28 09:07:07,826][106226] Updated weights for policy 0, policy_version 1927896 (0.0010) [2023-12-28 09:07:07,856][106225] Updated weights for policy 1, policy_version 1931997 (0.0007) [2023-12-28 09:07:07,883][106226] Updated weights for policy 0, policy_version 1927906 (0.0011) [2023-12-28 09:07:08,554][106226] Updated weights for policy 0, policy_version 1927916 (0.0010) [2023-12-28 09:07:08,609][106226] Updated weights for policy 0, policy_version 1927926 (0.0009) [2023-12-28 09:07:08,629][106225] Updated weights for policy 1, policy_version 1932007 (0.0007) [2023-12-28 09:07:08,659][106226] Updated weights for policy 0, policy_version 1927936 (0.0007) [2023-12-28 09:07:08,688][106225] Updated weights for policy 1, policy_version 1932017 (0.0008) [2023-12-28 09:07:08,748][106225] Updated weights for policy 1, policy_version 1932027 (0.0006) [2023-12-28 09:07:09,474][106225] Updated weights for policy 1, policy_version 1932037 (0.0006) [2023-12-28 09:07:09,508][106226] Updated weights for policy 0, policy_version 1927946 (0.0008) [2023-12-28 09:07:09,534][106225] Updated weights for policy 1, policy_version 1932047 (0.0008) [2023-12-28 09:07:09,564][106226] Updated weights for policy 0, policy_version 1927956 (0.0007) [2023-12-28 09:07:09,591][106225] Updated weights for policy 1, policy_version 1932057 (0.0007) [2023-12-28 09:07:09,626][106226] Updated weights for policy 0, policy_version 1927966 (0.0008) [2023-12-28 09:07:09,693][106226] Updated weights for policy 0, policy_version 1927976 (0.0010) [2023-12-28 09:07:10,304][106225] Updated weights for policy 1, policy_version 1932067 (0.0007) [2023-12-28 09:07:10,363][106225] Updated weights for policy 1, policy_version 1932077 (0.0008) [2023-12-28 09:07:10,429][106225] Updated weights for policy 1, policy_version 1932087 (0.0007) [2023-12-28 09:07:10,500][106226] Updated weights for policy 0, policy_version 1927986 (0.0008) [2023-12-28 09:07:10,564][106226] Updated weights for policy 0, policy_version 1927996 (0.0009) [2023-12-28 09:07:10,621][106226] Updated weights for policy 0, policy_version 1928006 (0.0009) [2023-12-28 09:07:11,048][106225] Updated weights for policy 1, policy_version 1932097 (0.0006) [2023-12-28 09:07:11,115][106225] Updated weights for policy 1, policy_version 1932107 (0.0008) [2023-12-28 09:07:11,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 988323840. Throughput: 0: 10112.3, 1: 9755.6. Samples: 988300796. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:11,175][105115] Avg episode reward: [(0, '-4.565'), (1, '-4.704')] [2023-12-28 09:07:11,179][106225] Updated weights for policy 1, policy_version 1932117 (0.0008) [2023-12-28 09:07:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001928008_493649920.pth... [2023-12-28 09:07:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001926856_493355008.pth [2023-12-28 09:07:11,248][106225] Updated weights for policy 1, policy_version 1932127 (0.0008) [2023-12-28 09:07:11,255][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001932128_494682112.pth... [2023-12-28 09:07:11,260][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001930976_494387200.pth [2023-12-28 09:07:11,384][106226] Updated weights for policy 0, policy_version 1928016 (0.0008) [2023-12-28 09:07:11,446][106226] Updated weights for policy 0, policy_version 1928026 (0.0008) [2023-12-28 09:07:11,504][106226] Updated weights for policy 0, policy_version 1928036 (0.0008) [2023-12-28 09:07:12,026][106225] Updated weights for policy 1, policy_version 1932137 (0.0008) [2023-12-28 09:07:12,094][106225] Updated weights for policy 1, policy_version 1932147 (0.0010) [2023-12-28 09:07:12,149][106225] Updated weights for policy 1, policy_version 1932157 (0.0008) [2023-12-28 09:07:12,282][106226] Updated weights for policy 0, policy_version 1928046 (0.0009) [2023-12-28 09:07:12,342][106226] Updated weights for policy 0, policy_version 1928056 (0.0008) [2023-12-28 09:07:12,406][106226] Updated weights for policy 0, policy_version 1928066 (0.0008) [2023-12-28 09:07:12,904][106225] Updated weights for policy 1, policy_version 1932167 (0.0009) [2023-12-28 09:07:12,967][106225] Updated weights for policy 1, policy_version 1932177 (0.0008) [2023-12-28 09:07:13,030][106225] Updated weights for policy 1, policy_version 1932187 (0.0009) [2023-12-28 09:07:13,115][106226] Updated weights for policy 0, policy_version 1928076 (0.0010) [2023-12-28 09:07:13,175][106226] Updated weights for policy 0, policy_version 1928086 (0.0009) [2023-12-28 09:07:13,229][106226] Updated weights for policy 0, policy_version 1928096 (0.0008) [2023-12-28 09:07:13,761][106225] Updated weights for policy 1, policy_version 1932197 (0.0008) [2023-12-28 09:07:13,821][106225] Updated weights for policy 1, policy_version 1932207 (0.0008) [2023-12-28 09:07:13,878][106225] Updated weights for policy 1, policy_version 1932217 (0.0008) [2023-12-28 09:07:13,943][106226] Updated weights for policy 0, policy_version 1928106 (0.0009) [2023-12-28 09:07:13,993][106226] Updated weights for policy 0, policy_version 1928116 (0.0006) [2023-12-28 09:07:14,047][106226] Updated weights for policy 0, policy_version 1928126 (0.0005) [2023-12-28 09:07:14,100][106226] Updated weights for policy 0, policy_version 1928136 (0.0008) [2023-12-28 09:07:14,653][106225] Updated weights for policy 1, policy_version 1932227 (0.0008) [2023-12-28 09:07:14,711][106225] Updated weights for policy 1, policy_version 1932237 (0.0007) [2023-12-28 09:07:14,726][106226] Updated weights for policy 0, policy_version 1928146 (0.0007) [2023-12-28 09:07:14,773][106225] Updated weights for policy 1, policy_version 1932247 (0.0006) [2023-12-28 09:07:14,784][106226] Updated weights for policy 0, policy_version 1928156 (0.0007) [2023-12-28 09:07:14,844][106226] Updated weights for policy 0, policy_version 1928166 (0.0008) [2023-12-28 09:07:15,557][106225] Updated weights for policy 1, policy_version 1932257 (0.0009) [2023-12-28 09:07:15,621][106225] Updated weights for policy 1, policy_version 1932267 (0.0007) [2023-12-28 09:07:15,642][106226] Updated weights for policy 0, policy_version 1928176 (0.0008) [2023-12-28 09:07:15,688][106225] Updated weights for policy 1, policy_version 1932277 (0.0007) [2023-12-28 09:07:15,705][106226] Updated weights for policy 0, policy_version 1928186 (0.0008) [2023-12-28 09:07:15,742][106225] Updated weights for policy 1, policy_version 1932287 (0.0006) [2023-12-28 09:07:15,764][106226] Updated weights for policy 0, policy_version 1928196 (0.0008) [2023-12-28 09:07:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 988422144. Throughput: 0: 9979.1, 1: 9588.1. Samples: 988414272. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:16,175][105115] Avg episode reward: [(0, '-4.140'), (1, '-4.688')] [2023-12-28 09:07:16,460][106225] Updated weights for policy 1, policy_version 1932297 (0.0008) [2023-12-28 09:07:16,478][106226] Updated weights for policy 0, policy_version 1928206 (0.0006) [2023-12-28 09:07:16,517][106225] Updated weights for policy 1, policy_version 1932307 (0.0008) [2023-12-28 09:07:16,531][106226] Updated weights for policy 0, policy_version 1928216 (0.0005) [2023-12-28 09:07:16,571][106225] Updated weights for policy 1, policy_version 1932317 (0.0007) [2023-12-28 09:07:16,587][106226] Updated weights for policy 0, policy_version 1928226 (0.0007) [2023-12-28 09:07:17,139][106226] Updated weights for policy 0, policy_version 1928236 (0.0005) [2023-12-28 09:07:17,197][106226] Updated weights for policy 0, policy_version 1928246 (0.0006) [2023-12-28 09:07:17,255][106226] Updated weights for policy 0, policy_version 1928256 (0.0008) [2023-12-28 09:07:17,383][106225] Updated weights for policy 1, policy_version 1932327 (0.0009) [2023-12-28 09:07:17,434][106225] Updated weights for policy 1, policy_version 1932337 (0.0008) [2023-12-28 09:07:17,491][106225] Updated weights for policy 1, policy_version 1932347 (0.0005) [2023-12-28 09:07:17,938][106226] Updated weights for policy 0, policy_version 1928266 (0.0008) [2023-12-28 09:07:18,007][106226] Updated weights for policy 0, policy_version 1928276 (0.0005) [2023-12-28 09:07:18,064][106226] Updated weights for policy 0, policy_version 1928286 (0.0005) [2023-12-28 09:07:18,129][106226] Updated weights for policy 0, policy_version 1928296 (0.0007) [2023-12-28 09:07:18,179][106225] Updated weights for policy 1, policy_version 1932357 (0.0007) [2023-12-28 09:07:18,239][106225] Updated weights for policy 1, policy_version 1932367 (0.0009) [2023-12-28 09:07:18,296][106225] Updated weights for policy 1, policy_version 1932377 (0.0008) [2023-12-28 09:07:18,775][106226] Updated weights for policy 0, policy_version 1928306 (0.0011) [2023-12-28 09:07:18,849][106226] Updated weights for policy 0, policy_version 1928316 (0.0011) [2023-12-28 09:07:18,914][106226] Updated weights for policy 0, policy_version 1928326 (0.0011) [2023-12-28 09:07:19,030][106225] Updated weights for policy 1, policy_version 1932387 (0.0008) [2023-12-28 09:07:19,089][106225] Updated weights for policy 1, policy_version 1932397 (0.0006) [2023-12-28 09:07:19,145][106225] Updated weights for policy 1, policy_version 1932407 (0.0005) [2023-12-28 09:07:19,669][106226] Updated weights for policy 0, policy_version 1928336 (0.0011) [2023-12-28 09:07:19,736][106226] Updated weights for policy 0, policy_version 1928346 (0.0011) [2023-12-28 09:07:19,795][106226] Updated weights for policy 0, policy_version 1928356 (0.0011) [2023-12-28 09:07:19,903][106225] Updated weights for policy 1, policy_version 1932417 (0.0008) [2023-12-28 09:07:19,965][106225] Updated weights for policy 1, policy_version 1932427 (0.0011) [2023-12-28 09:07:20,027][106225] Updated weights for policy 1, policy_version 1932437 (0.0010) [2023-12-28 09:07:20,085][106225] Updated weights for policy 1, policy_version 1932447 (0.0011) [2023-12-28 09:07:20,538][106226] Updated weights for policy 0, policy_version 1928366 (0.0010) [2023-12-28 09:07:20,605][106226] Updated weights for policy 0, policy_version 1928376 (0.0013) [2023-12-28 09:07:20,675][106226] Updated weights for policy 0, policy_version 1928386 (0.0007) [2023-12-28 09:07:20,799][106225] Updated weights for policy 1, policy_version 1932457 (0.0009) [2023-12-28 09:07:20,866][106225] Updated weights for policy 1, policy_version 1932467 (0.0008) [2023-12-28 09:07:20,925][106225] Updated weights for policy 1, policy_version 1932477 (0.0009) [2023-12-28 09:07:21,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 988520448. Throughput: 0: 9907.5, 1: 9516.1. Samples: 988529804. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:21,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.588')] [2023-12-28 09:07:21,405][106226] Updated weights for policy 0, policy_version 1928396 (0.0008) [2023-12-28 09:07:21,462][106226] Updated weights for policy 0, policy_version 1928406 (0.0005) [2023-12-28 09:07:21,524][106226] Updated weights for policy 0, policy_version 1928416 (0.0008) [2023-12-28 09:07:21,716][106225] Updated weights for policy 1, policy_version 1932487 (0.0010) [2023-12-28 09:07:21,782][106225] Updated weights for policy 1, policy_version 1932497 (0.0007) [2023-12-28 09:07:21,849][106225] Updated weights for policy 1, policy_version 1932507 (0.0007) [2023-12-28 09:07:22,220][106226] Updated weights for policy 0, policy_version 1928426 (0.0008) [2023-12-28 09:07:22,282][106226] Updated weights for policy 0, policy_version 1928436 (0.0007) [2023-12-28 09:07:22,347][106226] Updated weights for policy 0, policy_version 1928446 (0.0007) [2023-12-28 09:07:22,416][106226] Updated weights for policy 0, policy_version 1928456 (0.0008) [2023-12-28 09:07:22,559][106225] Updated weights for policy 1, policy_version 1932517 (0.0008) [2023-12-28 09:07:22,618][106225] Updated weights for policy 1, policy_version 1932527 (0.0011) [2023-12-28 09:07:22,677][106225] Updated weights for policy 1, policy_version 1932537 (0.0010) [2023-12-28 09:07:23,121][106226] Updated weights for policy 0, policy_version 1928466 (0.0007) [2023-12-28 09:07:23,187][106226] Updated weights for policy 0, policy_version 1928476 (0.0006) [2023-12-28 09:07:23,262][106226] Updated weights for policy 0, policy_version 1928486 (0.0006) [2023-12-28 09:07:23,406][106225] Updated weights for policy 1, policy_version 1932547 (0.0011) [2023-12-28 09:07:23,457][106225] Updated weights for policy 1, policy_version 1932557 (0.0010) [2023-12-28 09:07:23,505][106225] Updated weights for policy 1, policy_version 1932567 (0.0009) [2023-12-28 09:07:23,832][106226] Updated weights for policy 0, policy_version 1928496 (0.0009) [2023-12-28 09:07:23,878][106226] Updated weights for policy 0, policy_version 1928506 (0.0010) [2023-12-28 09:07:23,931][106226] Updated weights for policy 0, policy_version 1928516 (0.0010) [2023-12-28 09:07:24,159][106225] Updated weights for policy 1, policy_version 1932577 (0.0010) [2023-12-28 09:07:24,206][106225] Updated weights for policy 1, policy_version 1932587 (0.0005) [2023-12-28 09:07:24,253][106225] Updated weights for policy 1, policy_version 1932597 (0.0005) [2023-12-28 09:07:24,310][106225] Updated weights for policy 1, policy_version 1932607 (0.0005) [2023-12-28 09:07:24,698][106226] Updated weights for policy 0, policy_version 1928526 (0.0011) [2023-12-28 09:07:24,744][106226] Updated weights for policy 0, policy_version 1928536 (0.0010) [2023-12-28 09:07:24,799][106226] Updated weights for policy 0, policy_version 1928546 (0.0010) [2023-12-28 09:07:24,875][106225] Updated weights for policy 1, policy_version 1932617 (0.0010) [2023-12-28 09:07:24,924][106225] Updated weights for policy 1, policy_version 1932627 (0.0010) [2023-12-28 09:07:24,982][106225] Updated weights for policy 1, policy_version 1932637 (0.0010) [2023-12-28 09:07:25,541][106226] Updated weights for policy 0, policy_version 1928556 (0.0008) [2023-12-28 09:07:25,586][106226] Updated weights for policy 0, policy_version 1928566 (0.0007) [2023-12-28 09:07:25,636][106226] Updated weights for policy 0, policy_version 1928576 (0.0008) [2023-12-28 09:07:25,718][106225] Updated weights for policy 1, policy_version 1932647 (0.0010) [2023-12-28 09:07:25,779][106225] Updated weights for policy 1, policy_version 1932657 (0.0010) [2023-12-28 09:07:25,839][106225] Updated weights for policy 1, policy_version 1932667 (0.0010) [2023-12-28 09:07:26,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 988618752. Throughput: 0: 9886.3, 1: 9537.0. Samples: 988588188. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:26,176][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.526')] [2023-12-28 09:07:26,185][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001932672_494821376.pth... [2023-12-28 09:07:26,186][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001928584_493797376.pth... [2023-12-28 09:07:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001931552_494534656.pth [2023-12-28 09:07:26,192][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001927432_493502464.pth [2023-12-28 09:07:26,341][106226] Updated weights for policy 0, policy_version 1928586 (0.0010) [2023-12-28 09:07:26,394][106226] Updated weights for policy 0, policy_version 1928596 (0.0006) [2023-12-28 09:07:26,460][106226] Updated weights for policy 0, policy_version 1928606 (0.0006) [2023-12-28 09:07:26,469][106225] Updated weights for policy 1, policy_version 1932677 (0.0009) [2023-12-28 09:07:26,515][106226] Updated weights for policy 0, policy_version 1928616 (0.0006) [2023-12-28 09:07:26,526][106225] Updated weights for policy 1, policy_version 1932687 (0.0010) [2023-12-28 09:07:26,585][106225] Updated weights for policy 1, policy_version 1932697 (0.0010) [2023-12-28 09:07:27,066][106226] Updated weights for policy 0, policy_version 1928626 (0.0008) [2023-12-28 09:07:27,119][106226] Updated weights for policy 0, policy_version 1928636 (0.0008) [2023-12-28 09:07:27,165][106226] Updated weights for policy 0, policy_version 1928646 (0.0007) [2023-12-28 09:07:27,295][106225] Updated weights for policy 1, policy_version 1932707 (0.0009) [2023-12-28 09:07:27,363][106225] Updated weights for policy 1, policy_version 1932717 (0.0009) [2023-12-28 09:07:27,412][106225] Updated weights for policy 1, policy_version 1932727 (0.0010) [2023-12-28 09:07:27,877][106226] Updated weights for policy 0, policy_version 1928656 (0.0008) [2023-12-28 09:07:27,928][106226] Updated weights for policy 0, policy_version 1928666 (0.0007) [2023-12-28 09:07:27,981][106226] Updated weights for policy 0, policy_version 1928676 (0.0008) [2023-12-28 09:07:28,120][106225] Updated weights for policy 1, policy_version 1932737 (0.0010) [2023-12-28 09:07:28,183][106225] Updated weights for policy 1, policy_version 1932747 (0.0010) [2023-12-28 09:07:28,238][106225] Updated weights for policy 1, policy_version 1932757 (0.0010) [2023-12-28 09:07:28,293][106225] Updated weights for policy 1, policy_version 1932767 (0.0010) [2023-12-28 09:07:28,657][106226] Updated weights for policy 0, policy_version 1928686 (0.0007) [2023-12-28 09:07:28,702][106226] Updated weights for policy 0, policy_version 1928696 (0.0008) [2023-12-28 09:07:28,751][106226] Updated weights for policy 0, policy_version 1928706 (0.0008) [2023-12-28 09:07:29,008][106225] Updated weights for policy 1, policy_version 1932777 (0.0010) [2023-12-28 09:07:29,065][106225] Updated weights for policy 1, policy_version 1932787 (0.0010) [2023-12-28 09:07:29,119][106225] Updated weights for policy 1, policy_version 1932797 (0.0010) [2023-12-28 09:07:29,371][106226] Updated weights for policy 0, policy_version 1928716 (0.0007) [2023-12-28 09:07:29,433][106226] Updated weights for policy 0, policy_version 1928726 (0.0007) [2023-12-28 09:07:29,499][106226] Updated weights for policy 0, policy_version 1928736 (0.0005) [2023-12-28 09:07:29,882][106225] Updated weights for policy 1, policy_version 1932807 (0.0009) [2023-12-28 09:07:29,951][106225] Updated weights for policy 1, policy_version 1932817 (0.0008) [2023-12-28 09:07:30,015][106225] Updated weights for policy 1, policy_version 1932827 (0.0008) [2023-12-28 09:07:30,106][106226] Updated weights for policy 0, policy_version 1928746 (0.0006) [2023-12-28 09:07:30,159][106226] Updated weights for policy 0, policy_version 1928756 (0.0008) [2023-12-28 09:07:30,217][106226] Updated weights for policy 0, policy_version 1928766 (0.0005) [2023-12-28 09:07:30,280][106226] Updated weights for policy 0, policy_version 1928776 (0.0005) [2023-12-28 09:07:30,668][106225] Updated weights for policy 1, policy_version 1932837 (0.0007) [2023-12-28 09:07:30,722][106225] Updated weights for policy 1, policy_version 1932847 (0.0007) [2023-12-28 09:07:30,781][106225] Updated weights for policy 1, policy_version 1932857 (0.0005) [2023-12-28 09:07:31,032][106226] Updated weights for policy 0, policy_version 1928786 (0.0006) [2023-12-28 09:07:31,094][106226] Updated weights for policy 0, policy_version 1928796 (0.0009) [2023-12-28 09:07:31,161][106226] Updated weights for policy 0, policy_version 1928806 (0.0007) [2023-12-28 09:07:31,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 988717056. Throughput: 0: 9998.0, 1: 9621.9. Samples: 988712044. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:31,175][105115] Avg episode reward: [(0, '-4.545'), (1, '-4.672')] [2023-12-28 09:07:31,383][106225] Updated weights for policy 1, policy_version 1932867 (0.0006) [2023-12-28 09:07:31,442][106225] Updated weights for policy 1, policy_version 1932877 (0.0007) [2023-12-28 09:07:31,490][106225] Updated weights for policy 1, policy_version 1932887 (0.0005) [2023-12-28 09:07:31,934][106226] Updated weights for policy 0, policy_version 1928816 (0.0009) [2023-12-28 09:07:31,995][106226] Updated weights for policy 0, policy_version 1928826 (0.0006) [2023-12-28 09:07:32,058][106226] Updated weights for policy 0, policy_version 1928836 (0.0005) [2023-12-28 09:07:32,167][106225] Updated weights for policy 1, policy_version 1932897 (0.0006) [2023-12-28 09:07:32,222][106225] Updated weights for policy 1, policy_version 1932907 (0.0010) [2023-12-28 09:07:32,279][106225] Updated weights for policy 1, policy_version 1932917 (0.0010) [2023-12-28 09:07:32,342][106225] Updated weights for policy 1, policy_version 1932927 (0.0010) [2023-12-28 09:07:32,650][106226] Updated weights for policy 0, policy_version 1928846 (0.0006) [2023-12-28 09:07:32,708][106226] Updated weights for policy 0, policy_version 1928856 (0.0006) [2023-12-28 09:07:32,765][106226] Updated weights for policy 0, policy_version 1928866 (0.0005) [2023-12-28 09:07:33,000][106225] Updated weights for policy 1, policy_version 1932937 (0.0010) [2023-12-28 09:07:33,050][106225] Updated weights for policy 1, policy_version 1932947 (0.0010) [2023-12-28 09:07:33,103][106225] Updated weights for policy 1, policy_version 1932957 (0.0006) [2023-12-28 09:07:33,403][106226] Updated weights for policy 0, policy_version 1928876 (0.0007) [2023-12-28 09:07:33,462][106226] Updated weights for policy 0, policy_version 1928886 (0.0007) [2023-12-28 09:07:33,521][106226] Updated weights for policy 0, policy_version 1928896 (0.0008) [2023-12-28 09:07:33,799][106225] Updated weights for policy 1, policy_version 1932967 (0.0009) [2023-12-28 09:07:33,859][106225] Updated weights for policy 1, policy_version 1932977 (0.0010) [2023-12-28 09:07:33,914][106225] Updated weights for policy 1, policy_version 1932987 (0.0010) [2023-12-28 09:07:34,149][106226] Updated weights for policy 0, policy_version 1928906 (0.0008) [2023-12-28 09:07:34,215][106226] Updated weights for policy 0, policy_version 1928916 (0.0009) [2023-12-28 09:07:34,277][106226] Updated weights for policy 0, policy_version 1928926 (0.0011) [2023-12-28 09:07:34,339][106226] Updated weights for policy 0, policy_version 1928936 (0.0011) [2023-12-28 09:07:34,579][106225] Updated weights for policy 1, policy_version 1932997 (0.0008) [2023-12-28 09:07:34,645][106225] Updated weights for policy 1, policy_version 1933007 (0.0008) [2023-12-28 09:07:34,711][106225] Updated weights for policy 1, policy_version 1933017 (0.0008) [2023-12-28 09:07:35,004][106226] Updated weights for policy 0, policy_version 1928946 (0.0010) [2023-12-28 09:07:35,064][106226] Updated weights for policy 0, policy_version 1928956 (0.0010) [2023-12-28 09:07:35,124][106226] Updated weights for policy 0, policy_version 1928966 (0.0010) [2023-12-28 09:07:35,319][106225] Updated weights for policy 1, policy_version 1933027 (0.0007) [2023-12-28 09:07:35,380][106225] Updated weights for policy 1, policy_version 1933037 (0.0007) [2023-12-28 09:07:35,436][106225] Updated weights for policy 1, policy_version 1933047 (0.0010) [2023-12-28 09:07:35,832][106226] Updated weights for policy 0, policy_version 1928976 (0.0010) [2023-12-28 09:07:35,896][106226] Updated weights for policy 0, policy_version 1928986 (0.0010) [2023-12-28 09:07:35,951][106226] Updated weights for policy 0, policy_version 1928996 (0.0009) [2023-12-28 09:07:36,104][106225] Updated weights for policy 1, policy_version 1933057 (0.0010) [2023-12-28 09:07:36,172][106225] Updated weights for policy 1, policy_version 1933067 (0.0008) [2023-12-28 09:07:36,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19524.3, 300 sec: 19827.4). Total num frames: 988823552. Throughput: 0: 10046.6, 1: 9691.4. Samples: 988834508. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:36,175][105115] Avg episode reward: [(0, '-4.468'), (1, '-4.473')] [2023-12-28 09:07:36,238][106225] Updated weights for policy 1, policy_version 1933077 (0.0008) [2023-12-28 09:07:36,304][106225] Updated weights for policy 1, policy_version 1933087 (0.0008) [2023-12-28 09:07:36,662][106226] Updated weights for policy 0, policy_version 1929006 (0.0010) [2023-12-28 09:07:36,727][106226] Updated weights for policy 0, policy_version 1929016 (0.0011) [2023-12-28 09:07:36,773][106226] Updated weights for policy 0, policy_version 1929026 (0.0010) [2023-12-28 09:07:37,064][106225] Updated weights for policy 1, policy_version 1933097 (0.0009) [2023-12-28 09:07:37,114][106225] Updated weights for policy 1, policy_version 1933107 (0.0008) [2023-12-28 09:07:37,163][106225] Updated weights for policy 1, policy_version 1933117 (0.0008) [2023-12-28 09:07:37,458][106226] Updated weights for policy 0, policy_version 1929037 (0.0010) [2023-12-28 09:07:37,507][106226] Updated weights for policy 0, policy_version 1929047 (0.0006) [2023-12-28 09:07:37,567][106226] Updated weights for policy 0, policy_version 1929057 (0.0009) [2023-12-28 09:07:37,947][106225] Updated weights for policy 1, policy_version 1933127 (0.0008) [2023-12-28 09:07:38,012][106225] Updated weights for policy 1, policy_version 1933137 (0.0009) [2023-12-28 09:07:38,071][106225] Updated weights for policy 1, policy_version 1933147 (0.0008) [2023-12-28 09:07:38,262][106226] Updated weights for policy 0, policy_version 1929067 (0.0008) [2023-12-28 09:07:38,323][106226] Updated weights for policy 0, policy_version 1929077 (0.0008) [2023-12-28 09:07:38,391][106226] Updated weights for policy 0, policy_version 1929087 (0.0008) [2023-12-28 09:07:38,825][106225] Updated weights for policy 1, policy_version 1933157 (0.0008) [2023-12-28 09:07:38,887][106225] Updated weights for policy 1, policy_version 1933167 (0.0008) [2023-12-28 09:07:38,945][106225] Updated weights for policy 1, policy_version 1933177 (0.0008) [2023-12-28 09:07:39,105][106226] Updated weights for policy 0, policy_version 1929097 (0.0008) [2023-12-28 09:07:39,164][106226] Updated weights for policy 0, policy_version 1929107 (0.0009) [2023-12-28 09:07:39,216][106226] Updated weights for policy 0, policy_version 1929117 (0.0008) [2023-12-28 09:07:39,282][106226] Updated weights for policy 0, policy_version 1929127 (0.0008) [2023-12-28 09:07:39,689][106225] Updated weights for policy 1, policy_version 1933187 (0.0009) [2023-12-28 09:07:39,745][106225] Updated weights for policy 1, policy_version 1933197 (0.0008) [2023-12-28 09:07:39,799][106225] Updated weights for policy 1, policy_version 1933207 (0.0009) [2023-12-28 09:07:40,102][106226] Updated weights for policy 0, policy_version 1929137 (0.0007) [2023-12-28 09:07:40,174][106226] Updated weights for policy 0, policy_version 1929147 (0.0008) [2023-12-28 09:07:40,239][106226] Updated weights for policy 0, policy_version 1929157 (0.0009) [2023-12-28 09:07:40,586][106225] Updated weights for policy 1, policy_version 1933217 (0.0008) [2023-12-28 09:07:40,644][106225] Updated weights for policy 1, policy_version 1933228 (0.0009) [2023-12-28 09:07:40,691][106225] Updated weights for policy 1, policy_version 1933238 (0.0008) [2023-12-28 09:07:40,740][106225] Updated weights for policy 1, policy_version 1933248 (0.0008) [2023-12-28 09:07:40,877][106226] Updated weights for policy 0, policy_version 1929167 (0.0008) [2023-12-28 09:07:40,926][106226] Updated weights for policy 0, policy_version 1929177 (0.0008) [2023-12-28 09:07:40,976][106226] Updated weights for policy 0, policy_version 1929187 (0.0009) [2023-12-28 09:07:41,175][105115] Fps is (10 sec: 20479.4, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 988921856. Throughput: 0: 10092.0, 1: 9639.2. Samples: 988892136. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:41,175][105115] Avg episode reward: [(0, '-4.278'), (1, '-4.354')] [2023-12-28 09:07:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001933248_494968832.pth... [2023-12-28 09:07:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001929192_493953024.pth... [2023-12-28 09:07:41,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001932128_494682112.pth [2023-12-28 09:07:41,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001928008_493649920.pth [2023-12-28 09:07:41,505][106225] Updated weights for policy 1, policy_version 1933258 (0.0008) [2023-12-28 09:07:41,561][106225] Updated weights for policy 1, policy_version 1933268 (0.0008) [2023-12-28 09:07:41,627][106225] Updated weights for policy 1, policy_version 1933278 (0.0009) [2023-12-28 09:07:41,802][106226] Updated weights for policy 0, policy_version 1929197 (0.0010) [2023-12-28 09:07:41,865][106226] Updated weights for policy 0, policy_version 1929207 (0.0011) [2023-12-28 09:07:41,935][106226] Updated weights for policy 0, policy_version 1929217 (0.0011) [2023-12-28 09:07:42,369][106225] Updated weights for policy 1, policy_version 1933288 (0.0008) [2023-12-28 09:07:42,429][106225] Updated weights for policy 1, policy_version 1933298 (0.0007) [2023-12-28 09:07:42,490][106225] Updated weights for policy 1, policy_version 1933308 (0.0005) [2023-12-28 09:07:42,677][106226] Updated weights for policy 0, policy_version 1929227 (0.0009) [2023-12-28 09:07:42,741][106226] Updated weights for policy 0, policy_version 1929237 (0.0006) [2023-12-28 09:07:42,809][106226] Updated weights for policy 0, policy_version 1929247 (0.0006) [2023-12-28 09:07:43,187][106225] Updated weights for policy 1, policy_version 1933318 (0.0007) [2023-12-28 09:07:43,246][106225] Updated weights for policy 1, policy_version 1933328 (0.0009) [2023-12-28 09:07:43,295][106225] Updated weights for policy 1, policy_version 1933338 (0.0008) [2023-12-28 09:07:43,482][106226] Updated weights for policy 0, policy_version 1929257 (0.0006) [2023-12-28 09:07:43,545][106226] Updated weights for policy 0, policy_version 1929267 (0.0009) [2023-12-28 09:07:43,608][106226] Updated weights for policy 0, policy_version 1929277 (0.0009) [2023-12-28 09:07:43,672][106226] Updated weights for policy 0, policy_version 1929287 (0.0008) [2023-12-28 09:07:44,017][106225] Updated weights for policy 1, policy_version 1933348 (0.0009) [2023-12-28 09:07:44,073][106225] Updated weights for policy 1, policy_version 1933358 (0.0009) [2023-12-28 09:07:44,135][106225] Updated weights for policy 1, policy_version 1933368 (0.0009) [2023-12-28 09:07:44,353][106226] Updated weights for policy 0, policy_version 1929297 (0.0011) [2023-12-28 09:07:44,416][106226] Updated weights for policy 0, policy_version 1929307 (0.0010) [2023-12-28 09:07:44,472][106226] Updated weights for policy 0, policy_version 1929317 (0.0010) [2023-12-28 09:07:44,819][106225] Updated weights for policy 1, policy_version 1933378 (0.0007) [2023-12-28 09:07:44,887][106225] Updated weights for policy 1, policy_version 1933388 (0.0008) [2023-12-28 09:07:44,956][106225] Updated weights for policy 1, policy_version 1933398 (0.0008) [2023-12-28 09:07:45,026][106225] Updated weights for policy 1, policy_version 1933408 (0.0008) [2023-12-28 09:07:45,183][106226] Updated weights for policy 0, policy_version 1929327 (0.0007) [2023-12-28 09:07:45,243][106226] Updated weights for policy 0, policy_version 1929337 (0.0006) [2023-12-28 09:07:45,311][106226] Updated weights for policy 0, policy_version 1929347 (0.0007) [2023-12-28 09:07:45,727][106225] Updated weights for policy 1, policy_version 1933418 (0.0008) [2023-12-28 09:07:45,780][106225] Updated weights for policy 1, policy_version 1933428 (0.0006) [2023-12-28 09:07:45,830][106225] Updated weights for policy 1, policy_version 1933438 (0.0008) [2023-12-28 09:07:45,987][106226] Updated weights for policy 0, policy_version 1929357 (0.0007) [2023-12-28 09:07:46,049][106226] Updated weights for policy 0, policy_version 1929367 (0.0008) [2023-12-28 09:07:46,102][106226] Updated weights for policy 0, policy_version 1929377 (0.0007) [2023-12-28 09:07:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.9, 300 sec: 19799.6). Total num frames: 989020160. Throughput: 0: 9967.1, 1: 9651.5. Samples: 989006444. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:46,176][105115] Avg episode reward: [(0, '-4.586'), (1, '-4.439')] [2023-12-28 09:07:46,607][106225] Updated weights for policy 1, policy_version 1933448 (0.0006) [2023-12-28 09:07:46,669][106225] Updated weights for policy 1, policy_version 1933458 (0.0006) [2023-12-28 09:07:46,724][106225] Updated weights for policy 1, policy_version 1933468 (0.0010) [2023-12-28 09:07:46,781][106226] Updated weights for policy 0, policy_version 1929387 (0.0006) [2023-12-28 09:07:46,837][106226] Updated weights for policy 0, policy_version 1929397 (0.0009) [2023-12-28 09:07:46,906][106226] Updated weights for policy 0, policy_version 1929407 (0.0008) [2023-12-28 09:07:47,346][106225] Updated weights for policy 1, policy_version 1933478 (0.0008) [2023-12-28 09:07:47,397][106225] Updated weights for policy 1, policy_version 1933488 (0.0008) [2023-12-28 09:07:47,452][106225] Updated weights for policy 1, policy_version 1933498 (0.0008) [2023-12-28 09:07:47,668][106226] Updated weights for policy 0, policy_version 1929417 (0.0008) [2023-12-28 09:07:47,720][106226] Updated weights for policy 0, policy_version 1929427 (0.0007) [2023-12-28 09:07:47,766][106226] Updated weights for policy 0, policy_version 1929437 (0.0006) [2023-12-28 09:07:47,819][106226] Updated weights for policy 0, policy_version 1929447 (0.0010) [2023-12-28 09:07:48,100][106225] Updated weights for policy 1, policy_version 1933508 (0.0007) [2023-12-28 09:07:48,168][106225] Updated weights for policy 1, policy_version 1933518 (0.0007) [2023-12-28 09:07:48,230][106225] Updated weights for policy 1, policy_version 1933528 (0.0006) [2023-12-28 09:07:48,556][106226] Updated weights for policy 0, policy_version 1929457 (0.0010) [2023-12-28 09:07:48,619][106226] Updated weights for policy 0, policy_version 1929467 (0.0010) [2023-12-28 09:07:48,673][106226] Updated weights for policy 0, policy_version 1929477 (0.0007) [2023-12-28 09:07:48,913][106225] Updated weights for policy 1, policy_version 1933538 (0.0007) [2023-12-28 09:07:48,970][106225] Updated weights for policy 1, policy_version 1933548 (0.0010) [2023-12-28 09:07:49,034][106225] Updated weights for policy 1, policy_version 1933558 (0.0010) [2023-12-28 09:07:49,087][106225] Updated weights for policy 1, policy_version 1933568 (0.0010) [2023-12-28 09:07:49,425][106226] Updated weights for policy 0, policy_version 1929487 (0.0008) [2023-12-28 09:07:49,480][106226] Updated weights for policy 0, policy_version 1929497 (0.0008) [2023-12-28 09:07:49,531][106226] Updated weights for policy 0, policy_version 1929507 (0.0008) [2023-12-28 09:07:49,816][106225] Updated weights for policy 1, policy_version 1933578 (0.0010) [2023-12-28 09:07:49,887][106225] Updated weights for policy 1, policy_version 1933588 (0.0009) [2023-12-28 09:07:49,963][106225] Updated weights for policy 1, policy_version 1933598 (0.0009) [2023-12-28 09:07:50,309][106226] Updated weights for policy 0, policy_version 1929517 (0.0008) [2023-12-28 09:07:50,372][106226] Updated weights for policy 0, policy_version 1929527 (0.0008) [2023-12-28 09:07:50,438][106226] Updated weights for policy 0, policy_version 1929537 (0.0008) [2023-12-28 09:07:50,737][106225] Updated weights for policy 1, policy_version 1933608 (0.0010) [2023-12-28 09:07:50,802][106225] Updated weights for policy 1, policy_version 1933618 (0.0010) [2023-12-28 09:07:50,860][106225] Updated weights for policy 1, policy_version 1933628 (0.0010) [2023-12-28 09:07:51,144][106226] Updated weights for policy 0, policy_version 1929547 (0.0006) [2023-12-28 09:07:51,175][105115] Fps is (10 sec: 18842.0, 60 sec: 19524.2, 300 sec: 19771.9). Total num frames: 989110272. Throughput: 0: 9857.2, 1: 9677.7. Samples: 989122440. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:51,175][105115] Avg episode reward: [(0, '-4.010'), (1, '-4.556')] [2023-12-28 09:07:51,210][106226] Updated weights for policy 0, policy_version 1929557 (0.0007) [2023-12-28 09:07:51,276][106226] Updated weights for policy 0, policy_version 1929567 (0.0009) [2023-12-28 09:07:51,625][106225] Updated weights for policy 1, policy_version 1933638 (0.0009) [2023-12-28 09:07:51,690][106225] Updated weights for policy 1, policy_version 1933648 (0.0008) [2023-12-28 09:07:51,765][106225] Updated weights for policy 1, policy_version 1933658 (0.0009) [2023-12-28 09:07:52,028][106226] Updated weights for policy 0, policy_version 1929577 (0.0009) [2023-12-28 09:07:52,084][106226] Updated weights for policy 0, policy_version 1929587 (0.0009) [2023-12-28 09:07:52,147][106226] Updated weights for policy 0, policy_version 1929597 (0.0008) [2023-12-28 09:07:52,209][106226] Updated weights for policy 0, policy_version 1929607 (0.0009) [2023-12-28 09:07:52,524][106225] Updated weights for policy 1, policy_version 1933668 (0.0009) [2023-12-28 09:07:52,588][106225] Updated weights for policy 1, policy_version 1933678 (0.0009) [2023-12-28 09:07:52,650][106225] Updated weights for policy 1, policy_version 1933688 (0.0008) [2023-12-28 09:07:52,937][106226] Updated weights for policy 0, policy_version 1929617 (0.0006) [2023-12-28 09:07:52,983][106226] Updated weights for policy 0, policy_version 1929627 (0.0005) [2023-12-28 09:07:53,031][106226] Updated weights for policy 0, policy_version 1929637 (0.0005) [2023-12-28 09:07:53,347][106225] Updated weights for policy 1, policy_version 1933698 (0.0008) [2023-12-28 09:07:53,414][106225] Updated weights for policy 1, policy_version 1933708 (0.0005) [2023-12-28 09:07:53,477][106225] Updated weights for policy 1, policy_version 1933718 (0.0005) [2023-12-28 09:07:53,540][106225] Updated weights for policy 1, policy_version 1933728 (0.0006) [2023-12-28 09:07:53,651][106226] Updated weights for policy 0, policy_version 1929647 (0.0007) [2023-12-28 09:07:53,711][106226] Updated weights for policy 0, policy_version 1929657 (0.0005) [2023-12-28 09:07:53,768][106226] Updated weights for policy 0, policy_version 1929667 (0.0005) [2023-12-28 09:07:54,167][106225] Updated weights for policy 1, policy_version 1933738 (0.0005) [2023-12-28 09:07:54,224][106225] Updated weights for policy 1, policy_version 1933748 (0.0008) [2023-12-28 09:07:54,282][106225] Updated weights for policy 1, policy_version 1933758 (0.0008) [2023-12-28 09:07:54,346][106226] Updated weights for policy 0, policy_version 1929677 (0.0005) [2023-12-28 09:07:54,406][106226] Updated weights for policy 0, policy_version 1929687 (0.0010) [2023-12-28 09:07:54,463][106226] Updated weights for policy 0, policy_version 1929697 (0.0009) [2023-12-28 09:07:54,981][106225] Updated weights for policy 1, policy_version 1933768 (0.0008) [2023-12-28 09:07:55,039][106225] Updated weights for policy 1, policy_version 1933778 (0.0008) [2023-12-28 09:07:55,098][106225] Updated weights for policy 1, policy_version 1933788 (0.0008) [2023-12-28 09:07:55,154][106226] Updated weights for policy 0, policy_version 1929707 (0.0008) [2023-12-28 09:07:55,219][106226] Updated weights for policy 0, policy_version 1929717 (0.0009) [2023-12-28 09:07:55,283][106226] Updated weights for policy 0, policy_version 1929727 (0.0008) [2023-12-28 09:07:55,802][106225] Updated weights for policy 1, policy_version 1933798 (0.0008) [2023-12-28 09:07:55,862][106225] Updated weights for policy 1, policy_version 1933808 (0.0008) [2023-12-28 09:07:55,918][106225] Updated weights for policy 1, policy_version 1933818 (0.0009) [2023-12-28 09:07:55,997][106226] Updated weights for policy 0, policy_version 1929737 (0.0009) [2023-12-28 09:07:56,057][106226] Updated weights for policy 0, policy_version 1929747 (0.0008) [2023-12-28 09:07:56,109][106226] Updated weights for policy 0, policy_version 1929757 (0.0008) [2023-12-28 09:07:56,161][106226] Updated weights for policy 0, policy_version 1929767 (0.0009) [2023-12-28 09:07:56,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 989216768. Throughput: 0: 9856.5, 1: 9727.3. Samples: 989182072. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:07:56,176][105115] Avg episode reward: [(0, '-4.195'), (1, '-4.363')] [2023-12-28 09:07:56,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001933824_495116288.pth... [2023-12-28 09:07:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001929768_494100480.pth... [2023-12-28 09:07:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001928584_493797376.pth [2023-12-28 09:07:56,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001932672_494821376.pth [2023-12-28 09:07:56,636][106225] Updated weights for policy 1, policy_version 1933828 (0.0008) [2023-12-28 09:07:56,690][106225] Updated weights for policy 1, policy_version 1933838 (0.0008) [2023-12-28 09:07:56,741][106225] Updated weights for policy 1, policy_version 1933848 (0.0007) [2023-12-28 09:07:56,884][106226] Updated weights for policy 0, policy_version 1929777 (0.0008) [2023-12-28 09:07:56,942][106226] Updated weights for policy 0, policy_version 1929787 (0.0009) [2023-12-28 09:07:57,007][106226] Updated weights for policy 0, policy_version 1929797 (0.0009) [2023-12-28 09:07:57,444][106225] Updated weights for policy 1, policy_version 1933858 (0.0009) [2023-12-28 09:07:57,489][106225] Updated weights for policy 1, policy_version 1933868 (0.0008) [2023-12-28 09:07:57,550][106225] Updated weights for policy 1, policy_version 1933878 (0.0008) [2023-12-28 09:07:57,613][106225] Updated weights for policy 1, policy_version 1933888 (0.0009) [2023-12-28 09:07:57,661][106226] Updated weights for policy 0, policy_version 1929807 (0.0009) [2023-12-28 09:07:57,718][106226] Updated weights for policy 0, policy_version 1929817 (0.0009) [2023-12-28 09:07:57,766][106226] Updated weights for policy 0, policy_version 1929827 (0.0009) [2023-12-28 09:07:58,311][106225] Updated weights for policy 1, policy_version 1933898 (0.0009) [2023-12-28 09:07:58,375][106225] Updated weights for policy 1, policy_version 1933908 (0.0009) [2023-12-28 09:07:58,438][106225] Updated weights for policy 1, policy_version 1933918 (0.0010) [2023-12-28 09:07:58,590][106226] Updated weights for policy 0, policy_version 1929837 (0.0009) [2023-12-28 09:07:58,658][106226] Updated weights for policy 0, policy_version 1929847 (0.0007) [2023-12-28 09:07:58,725][106226] Updated weights for policy 0, policy_version 1929857 (0.0008) [2023-12-28 09:07:59,231][106225] Updated weights for policy 1, policy_version 1933928 (0.0010) [2023-12-28 09:07:59,302][106225] Updated weights for policy 1, policy_version 1933938 (0.0008) [2023-12-28 09:07:59,375][106225] Updated weights for policy 1, policy_version 1933948 (0.0008) [2023-12-28 09:07:59,557][106226] Updated weights for policy 0, policy_version 1929867 (0.0007) [2023-12-28 09:07:59,617][106226] Updated weights for policy 0, policy_version 1929877 (0.0009) [2023-12-28 09:07:59,675][106226] Updated weights for policy 0, policy_version 1929887 (0.0010) [2023-12-28 09:08:00,011][106225] Updated weights for policy 1, policy_version 1933958 (0.0006) [2023-12-28 09:08:00,061][106225] Updated weights for policy 1, policy_version 1933968 (0.0005) [2023-12-28 09:08:00,116][106225] Updated weights for policy 1, policy_version 1933978 (0.0005) [2023-12-28 09:08:00,368][106226] Updated weights for policy 0, policy_version 1929897 (0.0011) [2023-12-28 09:08:00,434][106226] Updated weights for policy 0, policy_version 1929907 (0.0010) [2023-12-28 09:08:00,501][106226] Updated weights for policy 0, policy_version 1929917 (0.0011) [2023-12-28 09:08:00,564][106226] Updated weights for policy 0, policy_version 1929927 (0.0010) [2023-12-28 09:08:00,728][106225] Updated weights for policy 1, policy_version 1933988 (0.0007) [2023-12-28 09:08:00,789][106225] Updated weights for policy 1, policy_version 1933998 (0.0010) [2023-12-28 09:08:00,838][106225] Updated weights for policy 1, policy_version 1934008 (0.0010) [2023-12-28 09:08:01,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 989306880. Throughput: 0: 9877.4, 1: 9741.1. Samples: 989297100. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:01,175][105115] Avg episode reward: [(0, '-4.182'), (1, '-4.636')] [2023-12-28 09:08:01,211][106226] Updated weights for policy 0, policy_version 1929937 (0.0011) [2023-12-28 09:08:01,276][106226] Updated weights for policy 0, policy_version 1929947 (0.0008) [2023-12-28 09:08:01,339][106226] Updated weights for policy 0, policy_version 1929957 (0.0007) [2023-12-28 09:08:01,575][106225] Updated weights for policy 1, policy_version 1934018 (0.0010) [2023-12-28 09:08:01,645][106225] Updated weights for policy 1, policy_version 1934028 (0.0009) [2023-12-28 09:08:01,707][106225] Updated weights for policy 1, policy_version 1934038 (0.0009) [2023-12-28 09:08:01,778][106225] Updated weights for policy 1, policy_version 1934048 (0.0009) [2023-12-28 09:08:02,006][106226] Updated weights for policy 0, policy_version 1929967 (0.0008) [2023-12-28 09:08:02,065][106226] Updated weights for policy 0, policy_version 1929977 (0.0009) [2023-12-28 09:08:02,119][106226] Updated weights for policy 0, policy_version 1929987 (0.0008) [2023-12-28 09:08:02,360][106225] Updated weights for policy 1, policy_version 1934058 (0.0010) [2023-12-28 09:08:02,426][106225] Updated weights for policy 1, policy_version 1934068 (0.0010) [2023-12-28 09:08:02,486][106225] Updated weights for policy 1, policy_version 1934078 (0.0010) [2023-12-28 09:08:02,954][106226] Updated weights for policy 0, policy_version 1929997 (0.0007) [2023-12-28 09:08:03,005][106226] Updated weights for policy 0, policy_version 1930007 (0.0005) [2023-12-28 09:08:03,057][106226] Updated weights for policy 0, policy_version 1930017 (0.0006) [2023-12-28 09:08:03,089][106225] Updated weights for policy 1, policy_version 1934088 (0.0007) [2023-12-28 09:08:03,149][106225] Updated weights for policy 1, policy_version 1934098 (0.0005) [2023-12-28 09:08:03,201][106225] Updated weights for policy 1, policy_version 1934108 (0.0006) [2023-12-28 09:08:03,680][106226] Updated weights for policy 0, policy_version 1930027 (0.0007) [2023-12-28 09:08:03,745][106226] Updated weights for policy 0, policy_version 1930037 (0.0009) [2023-12-28 09:08:03,806][106226] Updated weights for policy 0, policy_version 1930047 (0.0009) [2023-12-28 09:08:03,840][106225] Updated weights for policy 1, policy_version 1934118 (0.0007) [2023-12-28 09:08:03,902][106225] Updated weights for policy 1, policy_version 1934128 (0.0006) [2023-12-28 09:08:03,962][106225] Updated weights for policy 1, policy_version 1934138 (0.0005) [2023-12-28 09:08:04,531][106225] Updated weights for policy 1, policy_version 1934148 (0.0005) [2023-12-28 09:08:04,546][106226] Updated weights for policy 0, policy_version 1930057 (0.0008) [2023-12-28 09:08:04,582][106225] Updated weights for policy 1, policy_version 1934158 (0.0005) [2023-12-28 09:08:04,603][106226] Updated weights for policy 0, policy_version 1930067 (0.0008) [2023-12-28 09:08:04,636][106225] Updated weights for policy 1, policy_version 1934168 (0.0005) [2023-12-28 09:08:04,663][106226] Updated weights for policy 0, policy_version 1930077 (0.0005) [2023-12-28 09:08:04,718][106226] Updated weights for policy 0, policy_version 1930087 (0.0005) [2023-12-28 09:08:05,272][106225] Updated weights for policy 1, policy_version 1934178 (0.0005) [2023-12-28 09:08:05,310][106226] Updated weights for policy 0, policy_version 1930097 (0.0010) [2023-12-28 09:08:05,335][106225] Updated weights for policy 1, policy_version 1934188 (0.0005) [2023-12-28 09:08:05,360][106226] Updated weights for policy 0, policy_version 1930107 (0.0010) [2023-12-28 09:08:05,397][106225] Updated weights for policy 1, policy_version 1934198 (0.0005) [2023-12-28 09:08:05,407][106226] Updated weights for policy 0, policy_version 1930117 (0.0008) [2023-12-28 09:08:05,450][106225] Updated weights for policy 1, policy_version 1934208 (0.0005) [2023-12-28 09:08:05,973][106226] Updated weights for policy 0, policy_version 1930128 (0.0009) [2023-12-28 09:08:06,022][106225] Updated weights for policy 1, policy_version 1934218 (0.0008) [2023-12-28 09:08:06,027][106226] Updated weights for policy 0, policy_version 1930138 (0.0009) [2023-12-28 09:08:06,072][106226] Updated weights for policy 0, policy_version 1930148 (0.0005) [2023-12-28 09:08:06,083][106225] Updated weights for policy 1, policy_version 1934228 (0.0010) [2023-12-28 09:08:06,151][106225] Updated weights for policy 1, policy_version 1934238 (0.0008) [2023-12-28 09:08:06,174][105115] Fps is (10 sec: 20480.6, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 989421568. Throughput: 0: 9928.6, 1: 9938.2. Samples: 989423804. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:06,175][105115] Avg episode reward: [(0, '-4.263'), (1, '-4.553')] [2023-12-28 09:08:06,820][106226] Updated weights for policy 0, policy_version 1930158 (0.0007) [2023-12-28 09:08:06,876][106225] Updated weights for policy 1, policy_version 1934248 (0.0010) [2023-12-28 09:08:06,876][106226] Updated weights for policy 0, policy_version 1930168 (0.0008) [2023-12-28 09:08:06,933][106225] Updated weights for policy 1, policy_version 1934258 (0.0010) [2023-12-28 09:08:06,935][106226] Updated weights for policy 0, policy_version 1930178 (0.0006) [2023-12-28 09:08:06,986][106225] Updated weights for policy 1, policy_version 1934268 (0.0010) [2023-12-28 09:08:07,626][106226] Updated weights for policy 0, policy_version 1930188 (0.0005) [2023-12-28 09:08:07,680][106226] Updated weights for policy 0, policy_version 1930198 (0.0006) [2023-12-28 09:08:07,702][106225] Updated weights for policy 1, policy_version 1934278 (0.0009) [2023-12-28 09:08:07,735][106226] Updated weights for policy 0, policy_version 1930208 (0.0005) [2023-12-28 09:08:07,759][106225] Updated weights for policy 1, policy_version 1934288 (0.0006) [2023-12-28 09:08:07,811][106225] Updated weights for policy 1, policy_version 1934298 (0.0005) [2023-12-28 09:08:08,437][106226] Updated weights for policy 0, policy_version 1930218 (0.0008) [2023-12-28 09:08:08,495][106226] Updated weights for policy 0, policy_version 1930228 (0.0008) [2023-12-28 09:08:08,531][106225] Updated weights for policy 1, policy_version 1934308 (0.0007) [2023-12-28 09:08:08,554][106226] Updated weights for policy 0, policy_version 1930238 (0.0009) [2023-12-28 09:08:08,599][106225] Updated weights for policy 1, policy_version 1934318 (0.0008) [2023-12-28 09:08:08,613][106226] Updated weights for policy 0, policy_version 1930248 (0.0006) [2023-12-28 09:08:08,664][106225] Updated weights for policy 1, policy_version 1934328 (0.0010) [2023-12-28 09:08:09,316][106225] Updated weights for policy 1, policy_version 1934338 (0.0008) [2023-12-28 09:08:09,322][106226] Updated weights for policy 0, policy_version 1930258 (0.0007) [2023-12-28 09:08:09,382][106225] Updated weights for policy 1, policy_version 1934348 (0.0009) [2023-12-28 09:08:09,392][106226] Updated weights for policy 0, policy_version 1930268 (0.0008) [2023-12-28 09:08:09,447][106225] Updated weights for policy 1, policy_version 1934358 (0.0009) [2023-12-28 09:08:09,458][106226] Updated weights for policy 0, policy_version 1930278 (0.0007) [2023-12-28 09:08:09,506][106225] Updated weights for policy 1, policy_version 1934368 (0.0008) [2023-12-28 09:08:10,146][106226] Updated weights for policy 0, policy_version 1930288 (0.0007) [2023-12-28 09:08:10,208][106226] Updated weights for policy 0, policy_version 1930298 (0.0006) [2023-12-28 09:08:10,232][106225] Updated weights for policy 1, policy_version 1934378 (0.0011) [2023-12-28 09:08:10,276][106226] Updated weights for policy 0, policy_version 1930308 (0.0008) [2023-12-28 09:08:10,292][106225] Updated weights for policy 1, policy_version 1934388 (0.0010) [2023-12-28 09:08:10,357][106225] Updated weights for policy 1, policy_version 1934398 (0.0011) [2023-12-28 09:08:10,952][106225] Updated weights for policy 1, policy_version 1934408 (0.0009) [2023-12-28 09:08:10,986][106226] Updated weights for policy 0, policy_version 1930318 (0.0007) [2023-12-28 09:08:11,005][106225] Updated weights for policy 1, policy_version 1934418 (0.0007) [2023-12-28 09:08:11,053][106226] Updated weights for policy 0, policy_version 1930328 (0.0008) [2023-12-28 09:08:11,070][106225] Updated weights for policy 1, policy_version 1934428 (0.0008) [2023-12-28 09:08:11,119][106226] Updated weights for policy 0, policy_version 1930338 (0.0007) [2023-12-28 09:08:11,174][105115] Fps is (10 sec: 21299.3, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 989519872. Throughput: 0: 9923.8, 1: 9965.0. Samples: 989483180. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:11,175][105115] Avg episode reward: [(0, '-4.333'), (1, '-4.804')] [2023-12-28 09:08:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001934432_495271936.pth... [2023-12-28 09:08:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001930344_494247936.pth... [2023-12-28 09:08:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001933248_494968832.pth [2023-12-28 09:08:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001929192_493953024.pth [2023-12-28 09:08:11,871][106225] Updated weights for policy 1, policy_version 1934438 (0.0008) [2023-12-28 09:08:11,895][106226] Updated weights for policy 0, policy_version 1930348 (0.0008) [2023-12-28 09:08:11,936][106225] Updated weights for policy 1, policy_version 1934448 (0.0005) [2023-12-28 09:08:11,955][106226] Updated weights for policy 0, policy_version 1930358 (0.0008) [2023-12-28 09:08:11,993][106225] Updated weights for policy 1, policy_version 1934458 (0.0008) [2023-12-28 09:08:12,022][106226] Updated weights for policy 0, policy_version 1930368 (0.0008) [2023-12-28 09:08:12,665][106225] Updated weights for policy 1, policy_version 1934468 (0.0007) [2023-12-28 09:08:12,726][106226] Updated weights for policy 0, policy_version 1930378 (0.0009) [2023-12-28 09:08:12,736][106225] Updated weights for policy 1, policy_version 1934478 (0.0008) [2023-12-28 09:08:12,788][106226] Updated weights for policy 0, policy_version 1930388 (0.0007) [2023-12-28 09:08:12,795][106225] Updated weights for policy 1, policy_version 1934488 (0.0007) [2023-12-28 09:08:12,852][106226] Updated weights for policy 0, policy_version 1930398 (0.0007) [2023-12-28 09:08:12,910][106226] Updated weights for policy 0, policy_version 1930408 (0.0009) [2023-12-28 09:08:13,403][106225] Updated weights for policy 1, policy_version 1934498 (0.0007) [2023-12-28 09:08:13,453][106225] Updated weights for policy 1, policy_version 1934508 (0.0009) [2023-12-28 09:08:13,513][106225] Updated weights for policy 1, policy_version 1934518 (0.0008) [2023-12-28 09:08:13,570][106225] Updated weights for policy 1, policy_version 1934528 (0.0009) [2023-12-28 09:08:13,664][106226] Updated weights for policy 0, policy_version 1930418 (0.0008) [2023-12-28 09:08:13,714][106226] Updated weights for policy 0, policy_version 1930428 (0.0009) [2023-12-28 09:08:13,763][106226] Updated weights for policy 0, policy_version 1930438 (0.0009) [2023-12-28 09:08:14,257][106225] Updated weights for policy 1, policy_version 1934538 (0.0007) [2023-12-28 09:08:14,322][106225] Updated weights for policy 1, policy_version 1934548 (0.0008) [2023-12-28 09:08:14,377][106225] Updated weights for policy 1, policy_version 1934558 (0.0007) [2023-12-28 09:08:14,507][106226] Updated weights for policy 0, policy_version 1930448 (0.0006) [2023-12-28 09:08:14,566][106226] Updated weights for policy 0, policy_version 1930458 (0.0005) [2023-12-28 09:08:14,618][106226] Updated weights for policy 0, policy_version 1930468 (0.0006) [2023-12-28 09:08:15,103][106225] Updated weights for policy 1, policy_version 1934568 (0.0007) [2023-12-28 09:08:15,164][106225] Updated weights for policy 1, policy_version 1934578 (0.0009) [2023-12-28 09:08:15,236][106225] Updated weights for policy 1, policy_version 1934588 (0.0009) [2023-12-28 09:08:15,315][106226] Updated weights for policy 0, policy_version 1930478 (0.0008) [2023-12-28 09:08:15,371][106226] Updated weights for policy 0, policy_version 1930488 (0.0008) [2023-12-28 09:08:15,433][106226] Updated weights for policy 0, policy_version 1930498 (0.0008) [2023-12-28 09:08:15,831][106225] Updated weights for policy 1, policy_version 1934598 (0.0007) [2023-12-28 09:08:15,893][106225] Updated weights for policy 1, policy_version 1934608 (0.0006) [2023-12-28 09:08:15,947][106225] Updated weights for policy 1, policy_version 1934618 (0.0006) [2023-12-28 09:08:16,161][106226] Updated weights for policy 0, policy_version 1930508 (0.0009) [2023-12-28 09:08:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 989609984. Throughput: 0: 9784.1, 1: 9939.0. Samples: 989599584. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:16,175][105115] Avg episode reward: [(0, '-4.452'), (1, '-4.704')] [2023-12-28 09:08:16,231][106226] Updated weights for policy 0, policy_version 1930518 (0.0010) [2023-12-28 09:08:16,301][106226] Updated weights for policy 0, policy_version 1930528 (0.0010) [2023-12-28 09:08:16,545][106225] Updated weights for policy 1, policy_version 1934628 (0.0006) [2023-12-28 09:08:16,598][106225] Updated weights for policy 1, policy_version 1934638 (0.0007) [2023-12-28 09:08:16,652][106225] Updated weights for policy 1, policy_version 1934648 (0.0008) [2023-12-28 09:08:16,929][106226] Updated weights for policy 0, policy_version 1930538 (0.0010) [2023-12-28 09:08:16,990][106226] Updated weights for policy 0, policy_version 1930548 (0.0006) [2023-12-28 09:08:17,038][106226] Updated weights for policy 0, policy_version 1930558 (0.0005) [2023-12-28 09:08:17,088][106226] Updated weights for policy 0, policy_version 1930568 (0.0005) [2023-12-28 09:08:17,497][106225] Updated weights for policy 1, policy_version 1934658 (0.0008) [2023-12-28 09:08:17,550][106225] Updated weights for policy 1, policy_version 1934668 (0.0009) [2023-12-28 09:08:17,602][106226] Updated weights for policy 0, policy_version 1930578 (0.0007) [2023-12-28 09:08:17,603][106225] Updated weights for policy 1, policy_version 1934678 (0.0008) [2023-12-28 09:08:17,655][106225] Updated weights for policy 1, policy_version 1934688 (0.0007) [2023-12-28 09:08:17,660][106226] Updated weights for policy 0, policy_version 1930588 (0.0010) [2023-12-28 09:08:17,725][106226] Updated weights for policy 0, policy_version 1930598 (0.0011) [2023-12-28 09:08:18,299][106225] Updated weights for policy 1, policy_version 1934698 (0.0008) [2023-12-28 09:08:18,368][106225] Updated weights for policy 1, policy_version 1934708 (0.0008) [2023-12-28 09:08:18,426][106225] Updated weights for policy 1, policy_version 1934718 (0.0010) [2023-12-28 09:08:18,453][106226] Updated weights for policy 0, policy_version 1930608 (0.0007) [2023-12-28 09:08:18,521][106226] Updated weights for policy 0, policy_version 1930618 (0.0006) [2023-12-28 09:08:18,572][106226] Updated weights for policy 0, policy_version 1930628 (0.0008) [2023-12-28 09:08:19,141][106225] Updated weights for policy 1, policy_version 1934728 (0.0009) [2023-12-28 09:08:19,200][106225] Updated weights for policy 1, policy_version 1934738 (0.0009) [2023-12-28 09:08:19,268][106225] Updated weights for policy 1, policy_version 1934748 (0.0009) [2023-12-28 09:08:19,295][106226] Updated weights for policy 0, policy_version 1930638 (0.0006) [2023-12-28 09:08:19,367][106226] Updated weights for policy 0, policy_version 1930648 (0.0008) [2023-12-28 09:08:19,422][106226] Updated weights for policy 0, policy_version 1930658 (0.0007) [2023-12-28 09:08:19,995][106225] Updated weights for policy 1, policy_version 1934758 (0.0009) [2023-12-28 09:08:20,062][106225] Updated weights for policy 1, policy_version 1934768 (0.0008) [2023-12-28 09:08:20,127][106225] Updated weights for policy 1, policy_version 1934778 (0.0007) [2023-12-28 09:08:20,128][106226] Updated weights for policy 0, policy_version 1930668 (0.0009) [2023-12-28 09:08:20,196][106226] Updated weights for policy 0, policy_version 1930678 (0.0009) [2023-12-28 09:08:20,266][106226] Updated weights for policy 0, policy_version 1930688 (0.0009) [2023-12-28 09:08:20,820][106225] Updated weights for policy 1, policy_version 1934788 (0.0007) [2023-12-28 09:08:20,879][106225] Updated weights for policy 1, policy_version 1934798 (0.0009) [2023-12-28 09:08:20,936][106225] Updated weights for policy 1, policy_version 1934808 (0.0008) [2023-12-28 09:08:20,999][106226] Updated weights for policy 0, policy_version 1930698 (0.0008) [2023-12-28 09:08:21,067][106226] Updated weights for policy 0, policy_version 1930708 (0.0009) [2023-12-28 09:08:21,128][106226] Updated weights for policy 0, policy_version 1930718 (0.0009) [2023-12-28 09:08:21,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 989708288. Throughput: 0: 9778.5, 1: 9895.3. Samples: 989719828. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:21,175][105115] Avg episode reward: [(0, '-4.138'), (1, '-4.776')] [2023-12-28 09:08:21,193][106226] Updated weights for policy 0, policy_version 1930728 (0.0008) [2023-12-28 09:08:21,771][106225] Updated weights for policy 1, policy_version 1934818 (0.0009) [2023-12-28 09:08:21,831][106225] Updated weights for policy 1, policy_version 1934828 (0.0008) [2023-12-28 09:08:21,899][106225] Updated weights for policy 1, policy_version 1934838 (0.0009) [2023-12-28 09:08:21,965][106225] Updated weights for policy 1, policy_version 1934848 (0.0008) [2023-12-28 09:08:22,036][106226] Updated weights for policy 0, policy_version 1930738 (0.0011) [2023-12-28 09:08:22,098][106226] Updated weights for policy 0, policy_version 1930748 (0.0010) [2023-12-28 09:08:22,168][106226] Updated weights for policy 0, policy_version 1930758 (0.0007) [2023-12-28 09:08:22,769][106225] Updated weights for policy 1, policy_version 1934858 (0.0009) [2023-12-28 09:08:22,830][106225] Updated weights for policy 1, policy_version 1934868 (0.0007) [2023-12-28 09:08:22,832][106226] Updated weights for policy 0, policy_version 1930768 (0.0008) [2023-12-28 09:08:22,890][106225] Updated weights for policy 1, policy_version 1934878 (0.0009) [2023-12-28 09:08:22,893][106226] Updated weights for policy 0, policy_version 1930778 (0.0008) [2023-12-28 09:08:22,959][106226] Updated weights for policy 0, policy_version 1930788 (0.0008) [2023-12-28 09:08:23,627][106226] Updated weights for policy 0, policy_version 1930798 (0.0010) [2023-12-28 09:08:23,666][106225] Updated weights for policy 1, policy_version 1934888 (0.0006) [2023-12-28 09:08:23,691][106226] Updated weights for policy 0, policy_version 1930808 (0.0010) [2023-12-28 09:08:23,724][106225] Updated weights for policy 1, policy_version 1934898 (0.0005) [2023-12-28 09:08:23,750][106226] Updated weights for policy 0, policy_version 1930818 (0.0005) [2023-12-28 09:08:23,793][106225] Updated weights for policy 1, policy_version 1934908 (0.0005) [2023-12-28 09:08:24,324][106225] Updated weights for policy 1, policy_version 1934918 (0.0006) [2023-12-28 09:08:24,379][106225] Updated weights for policy 1, policy_version 1934928 (0.0008) [2023-12-28 09:08:24,394][106226] Updated weights for policy 0, policy_version 1930828 (0.0009) [2023-12-28 09:08:24,440][106225] Updated weights for policy 1, policy_version 1934938 (0.0010) [2023-12-28 09:08:24,448][106226] Updated weights for policy 0, policy_version 1930838 (0.0007) [2023-12-28 09:08:24,495][106226] Updated weights for policy 0, policy_version 1930848 (0.0010) [2023-12-28 09:08:24,996][106225] Updated weights for policy 1, policy_version 1934948 (0.0008) [2023-12-28 09:08:25,053][106225] Updated weights for policy 1, policy_version 1934958 (0.0006) [2023-12-28 09:08:25,109][106225] Updated weights for policy 1, policy_version 1934968 (0.0005) [2023-12-28 09:08:25,220][106226] Updated weights for policy 0, policy_version 1930858 (0.0010) [2023-12-28 09:08:25,285][106226] Updated weights for policy 0, policy_version 1930868 (0.0008) [2023-12-28 09:08:25,342][106226] Updated weights for policy 0, policy_version 1930878 (0.0009) [2023-12-28 09:08:25,394][106226] Updated weights for policy 0, policy_version 1930888 (0.0008) [2023-12-28 09:08:25,723][106225] Updated weights for policy 1, policy_version 1934978 (0.0006) [2023-12-28 09:08:25,781][106225] Updated weights for policy 1, policy_version 1934988 (0.0008) [2023-12-28 09:08:25,843][106225] Updated weights for policy 1, policy_version 1934998 (0.0008) [2023-12-28 09:08:25,908][106225] Updated weights for policy 1, policy_version 1935008 (0.0008) [2023-12-28 09:08:26,061][106226] Updated weights for policy 0, policy_version 1930898 (0.0009) [2023-12-28 09:08:26,114][106226] Updated weights for policy 0, policy_version 1930908 (0.0008) [2023-12-28 09:08:26,165][106226] Updated weights for policy 0, policy_version 1930918 (0.0006) [2023-12-28 09:08:26,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 989814784. Throughput: 0: 9761.1, 1: 9858.8. Samples: 989775028. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:26,175][105115] Avg episode reward: [(0, '-4.391'), (1, '-4.465')] [2023-12-28 09:08:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001930920_494395392.pth... [2023-12-28 09:08:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001935008_495419392.pth... [2023-12-28 09:08:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001929768_494100480.pth [2023-12-28 09:08:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001933824_495116288.pth [2023-12-28 09:08:26,641][106225] Updated weights for policy 1, policy_version 1935018 (0.0008) [2023-12-28 09:08:26,697][106225] Updated weights for policy 1, policy_version 1935028 (0.0008) [2023-12-28 09:08:26,757][106225] Updated weights for policy 1, policy_version 1935038 (0.0008) [2023-12-28 09:08:26,824][106226] Updated weights for policy 0, policy_version 1930928 (0.0006) [2023-12-28 09:08:26,880][106226] Updated weights for policy 0, policy_version 1930938 (0.0007) [2023-12-28 09:08:26,938][106226] Updated weights for policy 0, policy_version 1930948 (0.0008) [2023-12-28 09:08:27,349][106225] Updated weights for policy 1, policy_version 1935048 (0.0006) [2023-12-28 09:08:27,402][106225] Updated weights for policy 1, policy_version 1935058 (0.0006) [2023-12-28 09:08:27,462][106225] Updated weights for policy 1, policy_version 1935068 (0.0010) [2023-12-28 09:08:27,563][106226] Updated weights for policy 0, policy_version 1930958 (0.0006) [2023-12-28 09:08:27,618][106226] Updated weights for policy 0, policy_version 1930968 (0.0007) [2023-12-28 09:08:27,679][106226] Updated weights for policy 0, policy_version 1930978 (0.0005) [2023-12-28 09:08:28,034][106225] Updated weights for policy 1, policy_version 1935078 (0.0006) [2023-12-28 09:08:28,118][106225] Updated weights for policy 1, policy_version 1935088 (0.0005) [2023-12-28 09:08:28,178][106225] Updated weights for policy 1, policy_version 1935098 (0.0006) [2023-12-28 09:08:28,221][106226] Updated weights for policy 0, policy_version 1930988 (0.0007) [2023-12-28 09:08:28,266][106226] Updated weights for policy 0, policy_version 1930998 (0.0010) [2023-12-28 09:08:28,319][106226] Updated weights for policy 0, policy_version 1931008 (0.0010) [2023-12-28 09:08:28,852][106225] Updated weights for policy 1, policy_version 1935108 (0.0008) [2023-12-28 09:08:28,910][106225] Updated weights for policy 1, policy_version 1935118 (0.0008) [2023-12-28 09:08:28,971][106225] Updated weights for policy 1, policy_version 1935128 (0.0009) [2023-12-28 09:08:28,972][106226] Updated weights for policy 0, policy_version 1931018 (0.0009) [2023-12-28 09:08:29,035][106226] Updated weights for policy 0, policy_version 1931028 (0.0006) [2023-12-28 09:08:29,102][106226] Updated weights for policy 0, policy_version 1931038 (0.0006) [2023-12-28 09:08:29,168][106226] Updated weights for policy 0, policy_version 1931048 (0.0006) [2023-12-28 09:08:29,686][106225] Updated weights for policy 1, policy_version 1935138 (0.0007) [2023-12-28 09:08:29,745][106225] Updated weights for policy 1, policy_version 1935148 (0.0005) [2023-12-28 09:08:29,805][106225] Updated weights for policy 1, policy_version 1935158 (0.0007) [2023-12-28 09:08:29,869][106225] Updated weights for policy 1, policy_version 1935168 (0.0015) [2023-12-28 09:08:29,897][106226] Updated weights for policy 0, policy_version 1931058 (0.0007) [2023-12-28 09:08:29,965][106226] Updated weights for policy 0, policy_version 1931068 (0.0008) [2023-12-28 09:08:30,033][106226] Updated weights for policy 0, policy_version 1931078 (0.0007) [2023-12-28 09:08:30,501][106225] Updated weights for policy 1, policy_version 1935178 (0.0010) [2023-12-28 09:08:30,564][106225] Updated weights for policy 1, policy_version 1935188 (0.0010) [2023-12-28 09:08:30,613][106225] Updated weights for policy 1, policy_version 1935198 (0.0010) [2023-12-28 09:08:30,802][106226] Updated weights for policy 0, policy_version 1931088 (0.0008) [2023-12-28 09:08:30,858][106226] Updated weights for policy 0, policy_version 1931098 (0.0007) [2023-12-28 09:08:30,914][106226] Updated weights for policy 0, policy_version 1931108 (0.0009) [2023-12-28 09:08:31,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 989913088. Throughput: 0: 9878.8, 1: 10028.8. Samples: 989902284. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:31,175][105115] Avg episode reward: [(0, '-4.173'), (1, '-4.631')] [2023-12-28 09:08:31,330][106225] Updated weights for policy 1, policy_version 1935208 (0.0010) [2023-12-28 09:08:31,396][106225] Updated weights for policy 1, policy_version 1935218 (0.0013) [2023-12-28 09:08:31,444][106225] Updated weights for policy 1, policy_version 1935228 (0.0010) [2023-12-28 09:08:31,683][106226] Updated weights for policy 0, policy_version 1931118 (0.0007) [2023-12-28 09:08:31,749][106226] Updated weights for policy 0, policy_version 1931128 (0.0007) [2023-12-28 09:08:31,808][106226] Updated weights for policy 0, policy_version 1931138 (0.0005) [2023-12-28 09:08:32,249][106225] Updated weights for policy 1, policy_version 1935238 (0.0010) [2023-12-28 09:08:32,301][106225] Updated weights for policy 1, policy_version 1935248 (0.0010) [2023-12-28 09:08:32,357][106225] Updated weights for policy 1, policy_version 1935258 (0.0009) [2023-12-28 09:08:32,529][106226] Updated weights for policy 0, policy_version 1931148 (0.0008) [2023-12-28 09:08:32,584][106226] Updated weights for policy 0, policy_version 1931158 (0.0007) [2023-12-28 09:08:32,639][106226] Updated weights for policy 0, policy_version 1931168 (0.0010) [2023-12-28 09:08:32,973][106225] Updated weights for policy 1, policy_version 1935268 (0.0009) [2023-12-28 09:08:33,026][106225] Updated weights for policy 1, policy_version 1935278 (0.0010) [2023-12-28 09:08:33,079][106225] Updated weights for policy 1, policy_version 1935288 (0.0010) [2023-12-28 09:08:33,446][106226] Updated weights for policy 0, policy_version 1931178 (0.0009) [2023-12-28 09:08:33,496][106226] Updated weights for policy 0, policy_version 1931188 (0.0009) [2023-12-28 09:08:33,550][106226] Updated weights for policy 0, policy_version 1931198 (0.0009) [2023-12-28 09:08:33,604][106226] Updated weights for policy 0, policy_version 1931208 (0.0008) [2023-12-28 09:08:33,684][106225] Updated weights for policy 1, policy_version 1935298 (0.0009) [2023-12-28 09:08:33,743][106225] Updated weights for policy 1, policy_version 1935308 (0.0005) [2023-12-28 09:08:33,798][106225] Updated weights for policy 1, policy_version 1935318 (0.0009) [2023-12-28 09:08:33,853][106225] Updated weights for policy 1, policy_version 1935328 (0.0010) [2023-12-28 09:08:34,404][106226] Updated weights for policy 0, policy_version 1931218 (0.0008) [2023-12-28 09:08:34,471][106226] Updated weights for policy 0, policy_version 1931228 (0.0008) [2023-12-28 09:08:34,513][106225] Updated weights for policy 1, policy_version 1935338 (0.0011) [2023-12-28 09:08:34,539][106226] Updated weights for policy 0, policy_version 1931238 (0.0006) [2023-12-28 09:08:34,568][106225] Updated weights for policy 1, policy_version 1935348 (0.0010) [2023-12-28 09:08:34,630][106225] Updated weights for policy 1, policy_version 1935358 (0.0011) [2023-12-28 09:08:35,200][106226] Updated weights for policy 0, policy_version 1931248 (0.0005) [2023-12-28 09:08:35,246][106226] Updated weights for policy 0, policy_version 1931258 (0.0006) [2023-12-28 09:08:35,301][106226] Updated weights for policy 0, policy_version 1931268 (0.0007) [2023-12-28 09:08:35,362][106225] Updated weights for policy 1, policy_version 1935368 (0.0010) [2023-12-28 09:08:35,421][106225] Updated weights for policy 1, policy_version 1935378 (0.0010) [2023-12-28 09:08:35,481][106225] Updated weights for policy 1, policy_version 1935388 (0.0010) [2023-12-28 09:08:35,861][106226] Updated weights for policy 0, policy_version 1931278 (0.0009) [2023-12-28 09:08:35,914][106226] Updated weights for policy 0, policy_version 1931288 (0.0010) [2023-12-28 09:08:35,963][106226] Updated weights for policy 0, policy_version 1931298 (0.0010) [2023-12-28 09:08:36,096][106225] Updated weights for policy 1, policy_version 1935398 (0.0010) [2023-12-28 09:08:36,166][106225] Updated weights for policy 1, policy_version 1935408 (0.0010) [2023-12-28 09:08:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 990011392. Throughput: 0: 9896.5, 1: 10076.1. Samples: 990021204. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:36,175][105115] Avg episode reward: [(0, '-4.275'), (1, '-4.690')] [2023-12-28 09:08:36,224][106225] Updated weights for policy 1, policy_version 1935418 (0.0010) [2023-12-28 09:08:36,626][106226] Updated weights for policy 0, policy_version 1931308 (0.0006) [2023-12-28 09:08:36,689][106226] Updated weights for policy 0, policy_version 1931318 (0.0007) [2023-12-28 09:08:36,750][106226] Updated weights for policy 0, policy_version 1931328 (0.0008) [2023-12-28 09:08:37,002][106225] Updated weights for policy 1, policy_version 1935428 (0.0010) [2023-12-28 09:08:37,054][106225] Updated weights for policy 1, policy_version 1935438 (0.0010) [2023-12-28 09:08:37,105][106225] Updated weights for policy 1, policy_version 1935448 (0.0010) [2023-12-28 09:08:37,472][106226] Updated weights for policy 0, policy_version 1931338 (0.0006) [2023-12-28 09:08:37,536][106226] Updated weights for policy 0, policy_version 1931348 (0.0008) [2023-12-28 09:08:37,602][106226] Updated weights for policy 0, policy_version 1931358 (0.0005) [2023-12-28 09:08:37,672][106226] Updated weights for policy 0, policy_version 1931368 (0.0005) [2023-12-28 09:08:37,819][106225] Updated weights for policy 1, policy_version 1935458 (0.0009) [2023-12-28 09:08:37,869][106225] Updated weights for policy 1, policy_version 1935468 (0.0005) [2023-12-28 09:08:37,927][106225] Updated weights for policy 1, policy_version 1935478 (0.0005) [2023-12-28 09:08:37,979][106225] Updated weights for policy 1, policy_version 1935488 (0.0005) [2023-12-28 09:08:38,249][106226] Updated weights for policy 0, policy_version 1931378 (0.0008) [2023-12-28 09:08:38,301][106226] Updated weights for policy 0, policy_version 1931388 (0.0007) [2023-12-28 09:08:38,355][106226] Updated weights for policy 0, policy_version 1931398 (0.0008) [2023-12-28 09:08:38,702][106225] Updated weights for policy 1, policy_version 1935498 (0.0008) [2023-12-28 09:08:38,754][106225] Updated weights for policy 1, policy_version 1935508 (0.0008) [2023-12-28 09:08:38,806][106225] Updated weights for policy 1, policy_version 1935518 (0.0007) [2023-12-28 09:08:39,119][106226] Updated weights for policy 0, policy_version 1931408 (0.0008) [2023-12-28 09:08:39,176][106226] Updated weights for policy 0, policy_version 1931418 (0.0009) [2023-12-28 09:08:39,236][106226] Updated weights for policy 0, policy_version 1931428 (0.0008) [2023-12-28 09:08:39,598][106225] Updated weights for policy 1, policy_version 1935528 (0.0006) [2023-12-28 09:08:39,668][106225] Updated weights for policy 1, policy_version 1935538 (0.0006) [2023-12-28 09:08:39,732][106225] Updated weights for policy 1, policy_version 1935548 (0.0008) [2023-12-28 09:08:40,078][106226] Updated weights for policy 0, policy_version 1931438 (0.0009) [2023-12-28 09:08:40,142][106226] Updated weights for policy 0, policy_version 1931448 (0.0009) [2023-12-28 09:08:40,210][106226] Updated weights for policy 0, policy_version 1931458 (0.0008) [2023-12-28 09:08:40,393][106225] Updated weights for policy 1, policy_version 1935558 (0.0009) [2023-12-28 09:08:40,463][106225] Updated weights for policy 1, policy_version 1935568 (0.0009) [2023-12-28 09:08:40,524][106225] Updated weights for policy 1, policy_version 1935578 (0.0008) [2023-12-28 09:08:40,940][106226] Updated weights for policy 0, policy_version 1931468 (0.0007) [2023-12-28 09:08:40,991][106226] Updated weights for policy 0, policy_version 1931478 (0.0005) [2023-12-28 09:08:41,054][106226] Updated weights for policy 0, policy_version 1931488 (0.0007) [2023-12-28 09:08:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 990109696. Throughput: 0: 9890.1, 1: 10105.5. Samples: 990081868. Policy #0 lag: (min: 6.0, avg: 9.3, max: 38.0) [2023-12-28 09:08:41,175][105115] Avg episode reward: [(0, '-4.325'), (1, '-4.630')] [2023-12-28 09:08:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001935584_495566848.pth... [2023-12-28 09:08:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001931496_494542848.pth... [2023-12-28 09:08:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001930344_494247936.pth [2023-12-28 09:08:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001934432_495271936.pth [2023-12-28 09:08:41,260][106225] Updated weights for policy 1, policy_version 1935588 (0.0008) [2023-12-28 09:08:41,326][106225] Updated weights for policy 1, policy_version 1935598 (0.0007) [2023-12-28 09:08:41,400][106225] Updated weights for policy 1, policy_version 1935608 (0.0007) [2023-12-28 09:08:41,824][106226] Updated weights for policy 0, policy_version 1931498 (0.0007) [2023-12-28 09:08:41,885][106226] Updated weights for policy 0, policy_version 1931508 (0.0008) [2023-12-28 09:08:41,955][106226] Updated weights for policy 0, policy_version 1931518 (0.0006) [2023-12-28 09:08:42,022][106226] Updated weights for policy 0, policy_version 1931528 (0.0009) [2023-12-28 09:08:42,132][106225] Updated weights for policy 1, policy_version 1935618 (0.0007) [2023-12-28 09:08:42,190][106225] Updated weights for policy 1, policy_version 1935628 (0.0011) [2023-12-28 09:08:42,253][106225] Updated weights for policy 1, policy_version 1935638 (0.0009) [2023-12-28 09:08:42,324][106225] Updated weights for policy 1, policy_version 1935648 (0.0008) [2023-12-28 09:08:42,702][106226] Updated weights for policy 0, policy_version 1931538 (0.0009) [2023-12-28 09:08:42,758][106226] Updated weights for policy 0, policy_version 1931548 (0.0009) [2023-12-28 09:08:42,814][106226] Updated weights for policy 0, policy_version 1931558 (0.0008) [2023-12-28 09:08:43,044][106225] Updated weights for policy 1, policy_version 1935658 (0.0007) [2023-12-28 09:08:43,115][106225] Updated weights for policy 1, policy_version 1935668 (0.0006) [2023-12-28 09:08:43,175][106225] Updated weights for policy 1, policy_version 1935678 (0.0008) [2023-12-28 09:08:43,507][106226] Updated weights for policy 0, policy_version 1931568 (0.0006) [2023-12-28 09:08:43,566][106226] Updated weights for policy 0, policy_version 1931578 (0.0005) [2023-12-28 09:08:43,617][106226] Updated weights for policy 0, policy_version 1931588 (0.0006) [2023-12-28 09:08:43,852][106225] Updated weights for policy 1, policy_version 1935688 (0.0005) [2023-12-28 09:08:43,903][106225] Updated weights for policy 1, policy_version 1935698 (0.0005) [2023-12-28 09:08:43,966][106225] Updated weights for policy 1, policy_version 1935708 (0.0009) [2023-12-28 09:08:44,186][106226] Updated weights for policy 0, policy_version 1931598 (0.0007) [2023-12-28 09:08:44,244][106226] Updated weights for policy 0, policy_version 1931608 (0.0009) [2023-12-28 09:08:44,298][106226] Updated weights for policy 0, policy_version 1931618 (0.0008) [2023-12-28 09:08:44,637][106225] Updated weights for policy 1, policy_version 1935718 (0.0008) [2023-12-28 09:08:44,698][106225] Updated weights for policy 1, policy_version 1935728 (0.0009) [2023-12-28 09:08:44,766][106225] Updated weights for policy 1, policy_version 1935738 (0.0009) [2023-12-28 09:08:45,046][106226] Updated weights for policy 0, policy_version 1931628 (0.0009) [2023-12-28 09:08:45,108][106226] Updated weights for policy 0, policy_version 1931638 (0.0009) [2023-12-28 09:08:45,173][106226] Updated weights for policy 0, policy_version 1931648 (0.0010) [2023-12-28 09:08:45,528][106225] Updated weights for policy 1, policy_version 1935748 (0.0010) [2023-12-28 09:08:45,584][106225] Updated weights for policy 1, policy_version 1935758 (0.0009) [2023-12-28 09:08:45,639][106225] Updated weights for policy 1, policy_version 1935768 (0.0008) [2023-12-28 09:08:45,826][106226] Updated weights for policy 0, policy_version 1931658 (0.0009) [2023-12-28 09:08:45,883][106226] Updated weights for policy 0, policy_version 1931668 (0.0009) [2023-12-28 09:08:45,943][106226] Updated weights for policy 0, policy_version 1931678 (0.0009) [2023-12-28 09:08:46,006][106226] Updated weights for policy 0, policy_version 1931688 (0.0008) [2023-12-28 09:08:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 990208000. Throughput: 0: 9915.3, 1: 10097.5. Samples: 990197676. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:08:46,175][105115] Avg episode reward: [(0, '-4.550'), (1, '-4.753')] [2023-12-28 09:08:46,364][106225] Updated weights for policy 1, policy_version 1935778 (0.0008) [2023-12-28 09:08:46,429][106225] Updated weights for policy 1, policy_version 1935788 (0.0007) [2023-12-28 09:08:46,489][106225] Updated weights for policy 1, policy_version 1935798 (0.0008) [2023-12-28 09:08:46,540][106225] Updated weights for policy 1, policy_version 1935808 (0.0008) [2023-12-28 09:08:46,733][106226] Updated weights for policy 0, policy_version 1931698 (0.0010) [2023-12-28 09:08:46,779][106226] Updated weights for policy 0, policy_version 1931708 (0.0010) [2023-12-28 09:08:46,825][106226] Updated weights for policy 0, policy_version 1931718 (0.0006) [2023-12-28 09:08:47,218][106225] Updated weights for policy 1, policy_version 1935818 (0.0009) [2023-12-28 09:08:47,268][106225] Updated weights for policy 1, policy_version 1935828 (0.0008) [2023-12-28 09:08:47,329][106225] Updated weights for policy 1, policy_version 1935838 (0.0007) [2023-12-28 09:08:47,476][106226] Updated weights for policy 0, policy_version 1931728 (0.0011) [2023-12-28 09:08:47,530][106226] Updated weights for policy 0, policy_version 1931738 (0.0010) [2023-12-28 09:08:47,583][106226] Updated weights for policy 0, policy_version 1931748 (0.0010) [2023-12-28 09:08:47,973][106225] Updated weights for policy 1, policy_version 1935848 (0.0005) [2023-12-28 09:08:48,031][106225] Updated weights for policy 1, policy_version 1935858 (0.0007) [2023-12-28 09:08:48,077][106225] Updated weights for policy 1, policy_version 1935868 (0.0007) [2023-12-28 09:08:48,282][106226] Updated weights for policy 0, policy_version 1931758 (0.0011) [2023-12-28 09:08:48,346][106226] Updated weights for policy 0, policy_version 1931768 (0.0010) [2023-12-28 09:08:48,410][106226] Updated weights for policy 0, policy_version 1931778 (0.0010) [2023-12-28 09:08:48,659][106225] Updated weights for policy 1, policy_version 1935878 (0.0008) [2023-12-28 09:08:48,721][106225] Updated weights for policy 1, policy_version 1935888 (0.0010) [2023-12-28 09:08:48,775][106225] Updated weights for policy 1, policy_version 1935898 (0.0010) [2023-12-28 09:08:49,050][106226] Updated weights for policy 0, policy_version 1931788 (0.0008) [2023-12-28 09:08:49,101][106226] Updated weights for policy 0, policy_version 1931798 (0.0010) [2023-12-28 09:08:49,162][106226] Updated weights for policy 0, policy_version 1931808 (0.0010) [2023-12-28 09:08:49,396][106225] Updated weights for policy 1, policy_version 1935908 (0.0008) [2023-12-28 09:08:49,448][106225] Updated weights for policy 1, policy_version 1935918 (0.0007) [2023-12-28 09:08:49,502][106225] Updated weights for policy 1, policy_version 1935928 (0.0010) [2023-12-28 09:08:49,883][106226] Updated weights for policy 0, policy_version 1931818 (0.0010) [2023-12-28 09:08:49,951][106226] Updated weights for policy 0, policy_version 1931828 (0.0011) [2023-12-28 09:08:50,017][106226] Updated weights for policy 0, policy_version 1931838 (0.0011) [2023-12-28 09:08:50,084][106226] Updated weights for policy 0, policy_version 1931848 (0.0011) [2023-12-28 09:08:50,243][106225] Updated weights for policy 1, policy_version 1935938 (0.0010) [2023-12-28 09:08:50,302][106225] Updated weights for policy 1, policy_version 1935948 (0.0008) [2023-12-28 09:08:50,365][106225] Updated weights for policy 1, policy_version 1935958 (0.0007) [2023-12-28 09:08:50,429][106225] Updated weights for policy 1, policy_version 1935968 (0.0008) [2023-12-28 09:08:50,757][106226] Updated weights for policy 0, policy_version 1931858 (0.0009) [2023-12-28 09:08:50,816][106226] Updated weights for policy 0, policy_version 1931868 (0.0009) [2023-12-28 09:08:50,878][106226] Updated weights for policy 0, policy_version 1931878 (0.0008) [2023-12-28 09:08:51,080][106225] Updated weights for policy 1, policy_version 1935978 (0.0008) [2023-12-28 09:08:51,138][106225] Updated weights for policy 1, policy_version 1935988 (0.0008) [2023-12-28 09:08:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.8, 300 sec: 19827.5). Total num frames: 990306304. Throughput: 0: 9881.4, 1: 9987.4. Samples: 990317904. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:08:51,175][105115] Avg episode reward: [(0, '-4.712'), (1, '-4.849')] [2023-12-28 09:08:51,208][106225] Updated weights for policy 1, policy_version 1935998 (0.0009) [2023-12-28 09:08:51,683][106226] Updated weights for policy 0, policy_version 1931888 (0.0006) [2023-12-28 09:08:51,763][106226] Updated weights for policy 0, policy_version 1931898 (0.0009) [2023-12-28 09:08:51,825][106226] Updated weights for policy 0, policy_version 1931908 (0.0009) [2023-12-28 09:08:51,955][106225] Updated weights for policy 1, policy_version 1936008 (0.0006) [2023-12-28 09:08:52,020][106225] Updated weights for policy 1, policy_version 1936018 (0.0006) [2023-12-28 09:08:52,088][106225] Updated weights for policy 1, policy_version 1936028 (0.0006) [2023-12-28 09:08:52,555][106226] Updated weights for policy 0, policy_version 1931918 (0.0009) [2023-12-28 09:08:52,619][106226] Updated weights for policy 0, policy_version 1931928 (0.0007) [2023-12-28 09:08:52,685][106226] Updated weights for policy 0, policy_version 1931938 (0.0008) [2023-12-28 09:08:52,771][106225] Updated weights for policy 1, policy_version 1936038 (0.0009) [2023-12-28 09:08:52,839][106225] Updated weights for policy 1, policy_version 1936048 (0.0010) [2023-12-28 09:08:52,901][106225] Updated weights for policy 1, policy_version 1936058 (0.0011) [2023-12-28 09:08:53,288][106226] Updated weights for policy 0, policy_version 1931948 (0.0010) [2023-12-28 09:08:53,335][106226] Updated weights for policy 0, policy_version 1931958 (0.0008) [2023-12-28 09:08:53,388][106226] Updated weights for policy 0, policy_version 1931968 (0.0008) [2023-12-28 09:08:53,604][106225] Updated weights for policy 1, policy_version 1936068 (0.0010) [2023-12-28 09:08:53,662][106225] Updated weights for policy 1, policy_version 1936078 (0.0010) [2023-12-28 09:08:53,723][106225] Updated weights for policy 1, policy_version 1936088 (0.0010) [2023-12-28 09:08:54,163][106226] Updated weights for policy 0, policy_version 1931978 (0.0008) [2023-12-28 09:08:54,220][106226] Updated weights for policy 0, policy_version 1931988 (0.0005) [2023-12-28 09:08:54,279][106226] Updated weights for policy 0, policy_version 1931998 (0.0007) [2023-12-28 09:08:54,345][106226] Updated weights for policy 0, policy_version 1932008 (0.0007) [2023-12-28 09:08:54,407][106225] Updated weights for policy 1, policy_version 1936098 (0.0010) [2023-12-28 09:08:54,465][106225] Updated weights for policy 1, policy_version 1936108 (0.0010) [2023-12-28 09:08:54,518][106225] Updated weights for policy 1, policy_version 1936118 (0.0010) [2023-12-28 09:08:54,568][106225] Updated weights for policy 1, policy_version 1936128 (0.0010) [2023-12-28 09:08:55,029][106226] Updated weights for policy 0, policy_version 1932018 (0.0008) [2023-12-28 09:08:55,074][106226] Updated weights for policy 0, policy_version 1932028 (0.0007) [2023-12-28 09:08:55,124][106226] Updated weights for policy 0, policy_version 1932038 (0.0007) [2023-12-28 09:08:55,267][106225] Updated weights for policy 1, policy_version 1936138 (0.0008) [2023-12-28 09:08:55,312][106225] Updated weights for policy 1, policy_version 1936148 (0.0009) [2023-12-28 09:08:55,363][106225] Updated weights for policy 1, policy_version 1936158 (0.0008) [2023-12-28 09:08:55,745][106226] Updated weights for policy 0, policy_version 1932048 (0.0006) [2023-12-28 09:08:55,808][106226] Updated weights for policy 0, policy_version 1932058 (0.0006) [2023-12-28 09:08:55,871][106226] Updated weights for policy 0, policy_version 1932068 (0.0006) [2023-12-28 09:08:56,085][106225] Updated weights for policy 1, policy_version 1936168 (0.0010) [2023-12-28 09:08:56,152][106225] Updated weights for policy 1, policy_version 1936178 (0.0008) [2023-12-28 09:08:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 990404608. Throughput: 0: 9856.7, 1: 9991.7. Samples: 990376364. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:08:56,175][105115] Avg episode reward: [(0, '-4.442'), (1, '-4.534')] [2023-12-28 09:08:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001932072_494690304.pth... [2023-12-28 09:08:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001930920_494395392.pth [2023-12-28 09:08:56,205][106225] Updated weights for policy 1, policy_version 1936188 (0.0008) [2023-12-28 09:08:56,226][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001936192_495722496.pth... [2023-12-28 09:08:56,229][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001935008_495419392.pth [2023-12-28 09:08:56,422][106226] Updated weights for policy 0, policy_version 1932078 (0.0006) [2023-12-28 09:08:56,476][106226] Updated weights for policy 0, policy_version 1932088 (0.0008) [2023-12-28 09:08:56,527][106226] Updated weights for policy 0, policy_version 1932098 (0.0008) [2023-12-28 09:08:56,865][106225] Updated weights for policy 1, policy_version 1936198 (0.0008) [2023-12-28 09:08:56,921][106225] Updated weights for policy 1, policy_version 1936208 (0.0008) [2023-12-28 09:08:56,966][106225] Updated weights for policy 1, policy_version 1936218 (0.0008) [2023-12-28 09:08:57,287][106226] Updated weights for policy 0, policy_version 1932108 (0.0009) [2023-12-28 09:08:57,351][106226] Updated weights for policy 0, policy_version 1932118 (0.0010) [2023-12-28 09:08:57,410][106226] Updated weights for policy 0, policy_version 1932128 (0.0010) [2023-12-28 09:08:57,731][106225] Updated weights for policy 1, policy_version 1936228 (0.0008) [2023-12-28 09:08:57,781][106225] Updated weights for policy 1, policy_version 1936238 (0.0008) [2023-12-28 09:08:57,830][106225] Updated weights for policy 1, policy_version 1936248 (0.0009) [2023-12-28 09:08:57,974][106226] Updated weights for policy 0, policy_version 1932138 (0.0007) [2023-12-28 09:08:58,029][106226] Updated weights for policy 0, policy_version 1932148 (0.0006) [2023-12-28 09:08:58,088][106226] Updated weights for policy 0, policy_version 1932158 (0.0009) [2023-12-28 09:08:58,138][106226] Updated weights for policy 0, policy_version 1932168 (0.0009) [2023-12-28 09:08:58,621][106225] Updated weights for policy 1, policy_version 1936258 (0.0009) [2023-12-28 09:08:58,686][106225] Updated weights for policy 1, policy_version 1936268 (0.0008) [2023-12-28 09:08:58,748][106225] Updated weights for policy 1, policy_version 1936278 (0.0009) [2023-12-28 09:08:58,813][106225] Updated weights for policy 1, policy_version 1936288 (0.0010) [2023-12-28 09:08:58,914][106226] Updated weights for policy 0, policy_version 1932178 (0.0008) [2023-12-28 09:08:58,980][106226] Updated weights for policy 0, policy_version 1932188 (0.0006) [2023-12-28 09:08:59,042][106226] Updated weights for policy 0, policy_version 1932198 (0.0006) [2023-12-28 09:08:59,626][106225] Updated weights for policy 1, policy_version 1936298 (0.0009) [2023-12-28 09:08:59,675][106225] Updated weights for policy 1, policy_version 1936308 (0.0008) [2023-12-28 09:08:59,729][106225] Updated weights for policy 1, policy_version 1936318 (0.0009) [2023-12-28 09:08:59,787][106226] Updated weights for policy 0, policy_version 1932208 (0.0007) [2023-12-28 09:08:59,851][106226] Updated weights for policy 0, policy_version 1932218 (0.0009) [2023-12-28 09:08:59,915][106226] Updated weights for policy 0, policy_version 1932228 (0.0008) [2023-12-28 09:09:00,496][106225] Updated weights for policy 1, policy_version 1936328 (0.0006) [2023-12-28 09:09:00,553][106225] Updated weights for policy 1, policy_version 1936338 (0.0006) [2023-12-28 09:09:00,578][106226] Updated weights for policy 0, policy_version 1932238 (0.0009) [2023-12-28 09:09:00,611][106225] Updated weights for policy 1, policy_version 1936348 (0.0007) [2023-12-28 09:09:00,630][106226] Updated weights for policy 0, policy_version 1932248 (0.0010) [2023-12-28 09:09:00,683][106226] Updated weights for policy 0, policy_version 1932258 (0.0010) [2023-12-28 09:09:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 990502912. Throughput: 0: 9960.4, 1: 9930.0. Samples: 990494648. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:01,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.836')] [2023-12-28 09:09:01,220][106225] Updated weights for policy 1, policy_version 1936358 (0.0008) [2023-12-28 09:09:01,285][106225] Updated weights for policy 1, policy_version 1936368 (0.0008) [2023-12-28 09:09:01,305][106226] Updated weights for policy 0, policy_version 1932268 (0.0009) [2023-12-28 09:09:01,341][106225] Updated weights for policy 1, policy_version 1936378 (0.0008) [2023-12-28 09:09:01,370][106226] Updated weights for policy 0, policy_version 1932278 (0.0007) [2023-12-28 09:09:01,433][106226] Updated weights for policy 0, policy_version 1932288 (0.0007) [2023-12-28 09:09:02,131][106225] Updated weights for policy 1, policy_version 1936388 (0.0008) [2023-12-28 09:09:02,150][106226] Updated weights for policy 0, policy_version 1932298 (0.0007) [2023-12-28 09:09:02,188][106225] Updated weights for policy 1, policy_version 1936398 (0.0008) [2023-12-28 09:09:02,211][106226] Updated weights for policy 0, policy_version 1932308 (0.0006) [2023-12-28 09:09:02,237][106225] Updated weights for policy 1, policy_version 1936408 (0.0006) [2023-12-28 09:09:02,273][106226] Updated weights for policy 0, policy_version 1932318 (0.0007) [2023-12-28 09:09:02,339][106226] Updated weights for policy 0, policy_version 1932328 (0.0008) [2023-12-28 09:09:03,014][106225] Updated weights for policy 1, policy_version 1936418 (0.0008) [2023-12-28 09:09:03,037][106226] Updated weights for policy 0, policy_version 1932338 (0.0008) [2023-12-28 09:09:03,072][106225] Updated weights for policy 1, policy_version 1936428 (0.0005) [2023-12-28 09:09:03,088][106226] Updated weights for policy 0, policy_version 1932348 (0.0008) [2023-12-28 09:09:03,128][106225] Updated weights for policy 1, policy_version 1936438 (0.0005) [2023-12-28 09:09:03,146][106226] Updated weights for policy 0, policy_version 1932358 (0.0008) [2023-12-28 09:09:03,187][106225] Updated weights for policy 1, policy_version 1936448 (0.0006) [2023-12-28 09:09:03,840][106225] Updated weights for policy 1, policy_version 1936458 (0.0008) [2023-12-28 09:09:03,876][106226] Updated weights for policy 0, policy_version 1932368 (0.0009) [2023-12-28 09:09:03,906][106225] Updated weights for policy 1, policy_version 1936468 (0.0007) [2023-12-28 09:09:03,935][106226] Updated weights for policy 0, policy_version 1932378 (0.0008) [2023-12-28 09:09:03,959][106225] Updated weights for policy 1, policy_version 1936478 (0.0008) [2023-12-28 09:09:03,999][106226] Updated weights for policy 0, policy_version 1932388 (0.0009) [2023-12-28 09:09:04,689][106225] Updated weights for policy 1, policy_version 1936488 (0.0008) [2023-12-28 09:09:04,729][106226] Updated weights for policy 0, policy_version 1932398 (0.0009) [2023-12-28 09:09:04,738][106225] Updated weights for policy 1, policy_version 1936498 (0.0007) [2023-12-28 09:09:04,780][106226] Updated weights for policy 0, policy_version 1932408 (0.0006) [2023-12-28 09:09:04,794][106225] Updated weights for policy 1, policy_version 1936508 (0.0009) [2023-12-28 09:09:04,842][106226] Updated weights for policy 0, policy_version 1932418 (0.0006) [2023-12-28 09:09:05,516][106225] Updated weights for policy 1, policy_version 1936518 (0.0008) [2023-12-28 09:09:05,543][106226] Updated weights for policy 0, policy_version 1932428 (0.0007) [2023-12-28 09:09:05,570][106225] Updated weights for policy 1, policy_version 1936528 (0.0006) [2023-12-28 09:09:05,592][106226] Updated weights for policy 0, policy_version 1932438 (0.0007) [2023-12-28 09:09:05,622][106225] Updated weights for policy 1, policy_version 1936538 (0.0006) [2023-12-28 09:09:05,638][106226] Updated weights for policy 0, policy_version 1932448 (0.0005) [2023-12-28 09:09:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 990601216. Throughput: 0: 9985.5, 1: 9895.0. Samples: 990614452. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:06,175][105115] Avg episode reward: [(0, '-4.260'), (1, '-4.721')] [2023-12-28 09:09:06,280][106226] Updated weights for policy 0, policy_version 1932458 (0.0006) [2023-12-28 09:09:06,313][106225] Updated weights for policy 1, policy_version 1936548 (0.0007) [2023-12-28 09:09:06,343][106226] Updated weights for policy 0, policy_version 1932468 (0.0008) [2023-12-28 09:09:06,384][106225] Updated weights for policy 1, policy_version 1936558 (0.0007) [2023-12-28 09:09:06,401][106226] Updated weights for policy 0, policy_version 1932478 (0.0008) [2023-12-28 09:09:06,447][106225] Updated weights for policy 1, policy_version 1936568 (0.0007) [2023-12-28 09:09:06,462][106226] Updated weights for policy 0, policy_version 1932488 (0.0008) [2023-12-28 09:09:07,129][106226] Updated weights for policy 0, policy_version 1932498 (0.0005) [2023-12-28 09:09:07,170][106225] Updated weights for policy 1, policy_version 1936578 (0.0007) [2023-12-28 09:09:07,188][106226] Updated weights for policy 0, policy_version 1932508 (0.0005) [2023-12-28 09:09:07,225][106225] Updated weights for policy 1, policy_version 1936588 (0.0007) [2023-12-28 09:09:07,251][106226] Updated weights for policy 0, policy_version 1932518 (0.0010) [2023-12-28 09:09:07,273][106225] Updated weights for policy 1, policy_version 1936598 (0.0006) [2023-12-28 09:09:07,321][106225] Updated weights for policy 1, policy_version 1936608 (0.0008) [2023-12-28 09:09:07,886][106226] Updated weights for policy 0, policy_version 1932528 (0.0007) [2023-12-28 09:09:07,947][106226] Updated weights for policy 0, policy_version 1932538 (0.0005) [2023-12-28 09:09:08,008][106226] Updated weights for policy 0, policy_version 1932548 (0.0005) [2023-12-28 09:09:08,096][106225] Updated weights for policy 1, policy_version 1936618 (0.0009) [2023-12-28 09:09:08,155][106225] Updated weights for policy 1, policy_version 1936628 (0.0009) [2023-12-28 09:09:08,216][106225] Updated weights for policy 1, policy_version 1936638 (0.0008) [2023-12-28 09:09:08,699][106226] Updated weights for policy 0, policy_version 1932558 (0.0005) [2023-12-28 09:09:08,753][106226] Updated weights for policy 0, policy_version 1932568 (0.0006) [2023-12-28 09:09:08,814][106226] Updated weights for policy 0, policy_version 1932578 (0.0008) [2023-12-28 09:09:08,909][106225] Updated weights for policy 1, policy_version 1936648 (0.0008) [2023-12-28 09:09:08,969][106225] Updated weights for policy 1, policy_version 1936658 (0.0008) [2023-12-28 09:09:09,026][106225] Updated weights for policy 1, policy_version 1936668 (0.0008) [2023-12-28 09:09:09,554][106226] Updated weights for policy 0, policy_version 1932588 (0.0008) [2023-12-28 09:09:09,620][106226] Updated weights for policy 0, policy_version 1932598 (0.0007) [2023-12-28 09:09:09,687][106226] Updated weights for policy 0, policy_version 1932608 (0.0006) [2023-12-28 09:09:09,810][106225] Updated weights for policy 1, policy_version 1936678 (0.0009) [2023-12-28 09:09:09,883][106225] Updated weights for policy 1, policy_version 1936688 (0.0008) [2023-12-28 09:09:09,949][106225] Updated weights for policy 1, policy_version 1936698 (0.0006) [2023-12-28 09:09:10,447][106226] Updated weights for policy 0, policy_version 1932618 (0.0007) [2023-12-28 09:09:10,510][106226] Updated weights for policy 0, policy_version 1932628 (0.0009) [2023-12-28 09:09:10,562][106226] Updated weights for policy 0, policy_version 1932638 (0.0009) [2023-12-28 09:09:10,586][106225] Updated weights for policy 1, policy_version 1936708 (0.0008) [2023-12-28 09:09:10,618][106226] Updated weights for policy 0, policy_version 1932648 (0.0008) [2023-12-28 09:09:10,646][106225] Updated weights for policy 1, policy_version 1936718 (0.0009) [2023-12-28 09:09:10,705][106225] Updated weights for policy 1, policy_version 1936728 (0.0008) [2023-12-28 09:09:11,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 990699520. Throughput: 0: 10013.7, 1: 9966.5. Samples: 990674136. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:11,175][105115] Avg episode reward: [(0, '-4.163'), (1, '-4.925')] [2023-12-28 09:09:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001936736_495861760.pth... [2023-12-28 09:09:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001932648_494837760.pth... [2023-12-28 09:09:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001931496_494542848.pth [2023-12-28 09:09:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001935584_495566848.pth [2023-12-28 09:09:11,328][106226] Updated weights for policy 0, policy_version 1932658 (0.0008) [2023-12-28 09:09:11,399][106226] Updated weights for policy 0, policy_version 1932668 (0.0009) [2023-12-28 09:09:11,456][106225] Updated weights for policy 1, policy_version 1936738 (0.0008) [2023-12-28 09:09:11,459][106226] Updated weights for policy 0, policy_version 1932678 (0.0009) [2023-12-28 09:09:11,518][106225] Updated weights for policy 1, policy_version 1936748 (0.0008) [2023-12-28 09:09:11,587][106225] Updated weights for policy 1, policy_version 1936758 (0.0009) [2023-12-28 09:09:11,659][106225] Updated weights for policy 1, policy_version 1936768 (0.0009) [2023-12-28 09:09:12,157][106226] Updated weights for policy 0, policy_version 1932688 (0.0008) [2023-12-28 09:09:12,213][106226] Updated weights for policy 0, policy_version 1932698 (0.0009) [2023-12-28 09:09:12,273][106226] Updated weights for policy 0, policy_version 1932708 (0.0009) [2023-12-28 09:09:12,396][106225] Updated weights for policy 1, policy_version 1936778 (0.0009) [2023-12-28 09:09:12,453][106225] Updated weights for policy 1, policy_version 1936788 (0.0008) [2023-12-28 09:09:12,513][106225] Updated weights for policy 1, policy_version 1936798 (0.0009) [2023-12-28 09:09:13,031][106226] Updated weights for policy 0, policy_version 1932718 (0.0009) [2023-12-28 09:09:13,082][106226] Updated weights for policy 0, policy_version 1932728 (0.0009) [2023-12-28 09:09:13,138][106226] Updated weights for policy 0, policy_version 1932738 (0.0008) [2023-12-28 09:09:13,225][106225] Updated weights for policy 1, policy_version 1936808 (0.0009) [2023-12-28 09:09:13,294][106225] Updated weights for policy 1, policy_version 1936818 (0.0008) [2023-12-28 09:09:13,359][106225] Updated weights for policy 1, policy_version 1936828 (0.0008) [2023-12-28 09:09:13,822][106226] Updated weights for policy 0, policy_version 1932748 (0.0010) [2023-12-28 09:09:13,888][106226] Updated weights for policy 0, policy_version 1932758 (0.0008) [2023-12-28 09:09:13,945][106226] Updated weights for policy 0, policy_version 1932768 (0.0010) [2023-12-28 09:09:14,095][106225] Updated weights for policy 1, policy_version 1936838 (0.0007) [2023-12-28 09:09:14,143][106225] Updated weights for policy 1, policy_version 1936848 (0.0008) [2023-12-28 09:09:14,204][106225] Updated weights for policy 1, policy_version 1936858 (0.0007) [2023-12-28 09:09:14,612][106226] Updated weights for policy 0, policy_version 1932778 (0.0008) [2023-12-28 09:09:14,665][106226] Updated weights for policy 0, policy_version 1932788 (0.0010) [2023-12-28 09:09:14,718][106226] Updated weights for policy 0, policy_version 1932798 (0.0010) [2023-12-28 09:09:14,771][106226] Updated weights for policy 0, policy_version 1932808 (0.0010) [2023-12-28 09:09:14,935][106225] Updated weights for policy 1, policy_version 1936868 (0.0009) [2023-12-28 09:09:14,987][106225] Updated weights for policy 1, policy_version 1936878 (0.0008) [2023-12-28 09:09:15,044][106225] Updated weights for policy 1, policy_version 1936888 (0.0008) [2023-12-28 09:09:15,560][106226] Updated weights for policy 0, policy_version 1932818 (0.0008) [2023-12-28 09:09:15,622][106226] Updated weights for policy 0, policy_version 1932828 (0.0007) [2023-12-28 09:09:15,687][106225] Updated weights for policy 1, policy_version 1936898 (0.0007) [2023-12-28 09:09:15,688][106226] Updated weights for policy 0, policy_version 1932838 (0.0006) [2023-12-28 09:09:15,751][106225] Updated weights for policy 1, policy_version 1936908 (0.0009) [2023-12-28 09:09:15,805][106225] Updated weights for policy 1, policy_version 1936918 (0.0008) [2023-12-28 09:09:15,849][106225] Updated weights for policy 1, policy_version 1936928 (0.0008) [2023-12-28 09:09:16,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 990797824. Throughput: 0: 9917.4, 1: 9779.1. Samples: 990788624. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:16,175][105115] Avg episode reward: [(0, '-4.334'), (1, '-4.754')] [2023-12-28 09:09:16,322][106226] Updated weights for policy 0, policy_version 1932848 (0.0006) [2023-12-28 09:09:16,392][106226] Updated weights for policy 0, policy_version 1932858 (0.0009) [2023-12-28 09:09:16,461][106226] Updated weights for policy 0, policy_version 1932868 (0.0010) [2023-12-28 09:09:16,613][106225] Updated weights for policy 1, policy_version 1936938 (0.0008) [2023-12-28 09:09:16,672][106225] Updated weights for policy 1, policy_version 1936948 (0.0008) [2023-12-28 09:09:16,729][106225] Updated weights for policy 1, policy_version 1936958 (0.0007) [2023-12-28 09:09:17,173][106226] Updated weights for policy 0, policy_version 1932878 (0.0010) [2023-12-28 09:09:17,230][106226] Updated weights for policy 0, policy_version 1932888 (0.0008) [2023-12-28 09:09:17,283][106226] Updated weights for policy 0, policy_version 1932898 (0.0008) [2023-12-28 09:09:17,394][106225] Updated weights for policy 1, policy_version 1936968 (0.0006) [2023-12-28 09:09:17,449][106225] Updated weights for policy 1, policy_version 1936978 (0.0008) [2023-12-28 09:09:17,508][106225] Updated weights for policy 1, policy_version 1936988 (0.0009) [2023-12-28 09:09:17,987][106226] Updated weights for policy 0, policy_version 1932908 (0.0007) [2023-12-28 09:09:18,048][106226] Updated weights for policy 0, policy_version 1932918 (0.0006) [2023-12-28 09:09:18,112][106226] Updated weights for policy 0, policy_version 1932928 (0.0008) [2023-12-28 09:09:18,200][106225] Updated weights for policy 1, policy_version 1936998 (0.0006) [2023-12-28 09:09:18,260][106225] Updated weights for policy 1, policy_version 1937008 (0.0005) [2023-12-28 09:09:18,344][106225] Updated weights for policy 1, policy_version 1937018 (0.0007) [2023-12-28 09:09:18,843][106226] Updated weights for policy 0, policy_version 1932938 (0.0010) [2023-12-28 09:09:18,901][106226] Updated weights for policy 0, policy_version 1932948 (0.0008) [2023-12-28 09:09:18,958][106226] Updated weights for policy 0, policy_version 1932958 (0.0009) [2023-12-28 09:09:19,003][106225] Updated weights for policy 1, policy_version 1937028 (0.0008) [2023-12-28 09:09:19,021][106226] Updated weights for policy 0, policy_version 1932968 (0.0007) [2023-12-28 09:09:19,067][106225] Updated weights for policy 1, policy_version 1937038 (0.0010) [2023-12-28 09:09:19,133][106225] Updated weights for policy 1, policy_version 1937048 (0.0009) [2023-12-28 09:09:19,715][106226] Updated weights for policy 0, policy_version 1932978 (0.0011) [2023-12-28 09:09:19,786][106226] Updated weights for policy 0, policy_version 1932988 (0.0011) [2023-12-28 09:09:19,860][106226] Updated weights for policy 0, policy_version 1932998 (0.0010) [2023-12-28 09:09:19,863][106225] Updated weights for policy 1, policy_version 1937058 (0.0008) [2023-12-28 09:09:19,926][106225] Updated weights for policy 1, policy_version 1937068 (0.0008) [2023-12-28 09:09:19,986][106225] Updated weights for policy 1, policy_version 1937078 (0.0008) [2023-12-28 09:09:20,052][106225] Updated weights for policy 1, policy_version 1937088 (0.0008) [2023-12-28 09:09:20,504][106226] Updated weights for policy 0, policy_version 1933008 (0.0007) [2023-12-28 09:09:20,555][106226] Updated weights for policy 0, policy_version 1933018 (0.0011) [2023-12-28 09:09:20,618][106226] Updated weights for policy 0, policy_version 1933028 (0.0009) [2023-12-28 09:09:20,816][106225] Updated weights for policy 1, policy_version 1937098 (0.0008) [2023-12-28 09:09:20,873][106225] Updated weights for policy 1, policy_version 1937108 (0.0009) [2023-12-28 09:09:20,933][106225] Updated weights for policy 1, policy_version 1937118 (0.0009) [2023-12-28 09:09:21,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 990896128. Throughput: 0: 9927.2, 1: 9734.3. Samples: 990905972. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:21,176][105115] Avg episode reward: [(0, '-4.393'), (1, '-4.543')] [2023-12-28 09:09:21,314][106226] Updated weights for policy 0, policy_version 1933038 (0.0008) [2023-12-28 09:09:21,386][106226] Updated weights for policy 0, policy_version 1933048 (0.0009) [2023-12-28 09:09:21,478][106226] Updated weights for policy 0, policy_version 1933058 (0.0009) [2023-12-28 09:09:21,754][106225] Updated weights for policy 1, policy_version 1937128 (0.0008) [2023-12-28 09:09:21,804][106225] Updated weights for policy 1, policy_version 1937138 (0.0008) [2023-12-28 09:09:21,859][106225] Updated weights for policy 1, policy_version 1937148 (0.0009) [2023-12-28 09:09:22,200][106226] Updated weights for policy 0, policy_version 1933068 (0.0009) [2023-12-28 09:09:22,252][106226] Updated weights for policy 0, policy_version 1933078 (0.0011) [2023-12-28 09:09:22,322][106226] Updated weights for policy 0, policy_version 1933088 (0.0011) [2023-12-28 09:09:22,639][106225] Updated weights for policy 1, policy_version 1937158 (0.0008) [2023-12-28 09:09:22,703][106225] Updated weights for policy 1, policy_version 1937168 (0.0008) [2023-12-28 09:09:22,767][106225] Updated weights for policy 1, policy_version 1937178 (0.0006) [2023-12-28 09:09:23,087][106226] Updated weights for policy 0, policy_version 1933098 (0.0010) [2023-12-28 09:09:23,134][106226] Updated weights for policy 0, policy_version 1933108 (0.0010) [2023-12-28 09:09:23,190][106226] Updated weights for policy 0, policy_version 1933118 (0.0010) [2023-12-28 09:09:23,244][106226] Updated weights for policy 0, policy_version 1933128 (0.0010) [2023-12-28 09:09:23,518][106225] Updated weights for policy 1, policy_version 1937188 (0.0009) [2023-12-28 09:09:23,562][106225] Updated weights for policy 1, policy_version 1937198 (0.0007) [2023-12-28 09:09:23,614][106225] Updated weights for policy 1, policy_version 1937208 (0.0005) [2023-12-28 09:09:23,946][106226] Updated weights for policy 0, policy_version 1933138 (0.0008) [2023-12-28 09:09:24,017][106226] Updated weights for policy 0, policy_version 1933148 (0.0009) [2023-12-28 09:09:24,083][106226] Updated weights for policy 0, policy_version 1933158 (0.0010) [2023-12-28 09:09:24,219][106225] Updated weights for policy 1, policy_version 1937218 (0.0006) [2023-12-28 09:09:24,277][106225] Updated weights for policy 1, policy_version 1937228 (0.0010) [2023-12-28 09:09:24,337][106225] Updated weights for policy 1, policy_version 1937238 (0.0010) [2023-12-28 09:09:24,388][106225] Updated weights for policy 1, policy_version 1937248 (0.0010) [2023-12-28 09:09:24,761][106226] Updated weights for policy 0, policy_version 1933168 (0.0007) [2023-12-28 09:09:24,813][106226] Updated weights for policy 0, policy_version 1933178 (0.0005) [2023-12-28 09:09:24,868][106226] Updated weights for policy 0, policy_version 1933188 (0.0011) [2023-12-28 09:09:25,116][106225] Updated weights for policy 1, policy_version 1937258 (0.0010) [2023-12-28 09:09:25,166][106225] Updated weights for policy 1, policy_version 1937268 (0.0010) [2023-12-28 09:09:25,216][106225] Updated weights for policy 1, policy_version 1937278 (0.0010) [2023-12-28 09:09:25,497][106226] Updated weights for policy 0, policy_version 1933198 (0.0008) [2023-12-28 09:09:25,548][106226] Updated weights for policy 0, policy_version 1933208 (0.0005) [2023-12-28 09:09:25,595][106226] Updated weights for policy 0, policy_version 1933218 (0.0005) [2023-12-28 09:09:25,862][106225] Updated weights for policy 1, policy_version 1937288 (0.0008) [2023-12-28 09:09:25,919][106225] Updated weights for policy 1, policy_version 1937298 (0.0008) [2023-12-28 09:09:25,965][106225] Updated weights for policy 1, policy_version 1937308 (0.0008) [2023-12-28 09:09:26,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 990994432. Throughput: 0: 9903.1, 1: 9663.0. Samples: 990962344. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:26,175][105115] Avg episode reward: [(0, '-4.526'), (1, '-4.705')] [2023-12-28 09:09:26,184][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001937312_496009216.pth... [2023-12-28 09:09:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001933224_494985216.pth... [2023-12-28 09:09:26,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001936192_495722496.pth [2023-12-28 09:09:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001932072_494690304.pth [2023-12-28 09:09:26,254][106226] Updated weights for policy 0, policy_version 1933228 (0.0007) [2023-12-28 09:09:26,313][106226] Updated weights for policy 0, policy_version 1933238 (0.0010) [2023-12-28 09:09:26,371][106226] Updated weights for policy 0, policy_version 1933248 (0.0009) [2023-12-28 09:09:26,664][106225] Updated weights for policy 1, policy_version 1937318 (0.0008) [2023-12-28 09:09:26,721][106225] Updated weights for policy 1, policy_version 1937328 (0.0008) [2023-12-28 09:09:26,783][106225] Updated weights for policy 1, policy_version 1937338 (0.0007) [2023-12-28 09:09:27,020][106226] Updated weights for policy 0, policy_version 1933258 (0.0008) [2023-12-28 09:09:27,073][106226] Updated weights for policy 0, policy_version 1933268 (0.0008) [2023-12-28 09:09:27,131][106226] Updated weights for policy 0, policy_version 1933278 (0.0009) [2023-12-28 09:09:27,184][106226] Updated weights for policy 0, policy_version 1933288 (0.0008) [2023-12-28 09:09:27,384][106225] Updated weights for policy 1, policy_version 1937348 (0.0005) [2023-12-28 09:09:27,441][106225] Updated weights for policy 1, policy_version 1937358 (0.0010) [2023-12-28 09:09:27,494][106225] Updated weights for policy 1, policy_version 1937368 (0.0010) [2023-12-28 09:09:27,880][106226] Updated weights for policy 0, policy_version 1933298 (0.0005) [2023-12-28 09:09:27,942][106226] Updated weights for policy 0, policy_version 1933308 (0.0005) [2023-12-28 09:09:28,002][106226] Updated weights for policy 0, policy_version 1933318 (0.0006) [2023-12-28 09:09:28,161][106225] Updated weights for policy 1, policy_version 1937378 (0.0010) [2023-12-28 09:09:28,223][106225] Updated weights for policy 1, policy_version 1937388 (0.0010) [2023-12-28 09:09:28,289][106225] Updated weights for policy 1, policy_version 1937398 (0.0008) [2023-12-28 09:09:28,358][106225] Updated weights for policy 1, policy_version 1937408 (0.0008) [2023-12-28 09:09:28,531][106226] Updated weights for policy 0, policy_version 1933328 (0.0009) [2023-12-28 09:09:28,580][106226] Updated weights for policy 0, policy_version 1933338 (0.0010) [2023-12-28 09:09:28,627][106226] Updated weights for policy 0, policy_version 1933348 (0.0010) [2023-12-28 09:09:29,027][106225] Updated weights for policy 1, policy_version 1937418 (0.0010) [2023-12-28 09:09:29,072][106225] Updated weights for policy 1, policy_version 1937428 (0.0010) [2023-12-28 09:09:29,118][106225] Updated weights for policy 1, policy_version 1937438 (0.0005) [2023-12-28 09:09:29,338][106226] Updated weights for policy 0, policy_version 1933358 (0.0008) [2023-12-28 09:09:29,407][106226] Updated weights for policy 0, policy_version 1933368 (0.0009) [2023-12-28 09:09:29,471][106226] Updated weights for policy 0, policy_version 1933378 (0.0009) [2023-12-28 09:09:29,783][106225] Updated weights for policy 1, policy_version 1937448 (0.0009) [2023-12-28 09:09:29,848][106225] Updated weights for policy 1, policy_version 1937458 (0.0010) [2023-12-28 09:09:29,901][106225] Updated weights for policy 1, policy_version 1937468 (0.0010) [2023-12-28 09:09:30,178][106226] Updated weights for policy 0, policy_version 1933388 (0.0009) [2023-12-28 09:09:30,229][106226] Updated weights for policy 0, policy_version 1933398 (0.0008) [2023-12-28 09:09:30,282][106226] Updated weights for policy 0, policy_version 1933408 (0.0009) [2023-12-28 09:09:30,538][106225] Updated weights for policy 1, policy_version 1937478 (0.0008) [2023-12-28 09:09:30,605][106225] Updated weights for policy 1, policy_version 1937488 (0.0006) [2023-12-28 09:09:30,664][106225] Updated weights for policy 1, policy_version 1937498 (0.0008) [2023-12-28 09:09:30,900][106226] Updated weights for policy 0, policy_version 1933418 (0.0009) [2023-12-28 09:09:30,958][106226] Updated weights for policy 0, policy_version 1933428 (0.0008) [2023-12-28 09:09:31,019][106226] Updated weights for policy 0, policy_version 1933438 (0.0009) [2023-12-28 09:09:31,082][106226] Updated weights for policy 0, policy_version 1933448 (0.0008) [2023-12-28 09:09:31,175][105115] Fps is (10 sec: 20480.4, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 991100928. Throughput: 0: 9994.2, 1: 9796.3. Samples: 991088244. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:31,175][105115] Avg episode reward: [(0, '-4.370'), (1, '-4.898')] [2023-12-28 09:09:31,342][106225] Updated weights for policy 1, policy_version 1937508 (0.0008) [2023-12-28 09:09:31,415][106225] Updated weights for policy 1, policy_version 1937518 (0.0008) [2023-12-28 09:09:31,471][106225] Updated weights for policy 1, policy_version 1937528 (0.0009) [2023-12-28 09:09:31,793][106226] Updated weights for policy 0, policy_version 1933458 (0.0009) [2023-12-28 09:09:31,853][106226] Updated weights for policy 0, policy_version 1933468 (0.0009) [2023-12-28 09:09:31,913][106226] Updated weights for policy 0, policy_version 1933478 (0.0009) [2023-12-28 09:09:32,190][106225] Updated weights for policy 1, policy_version 1937538 (0.0008) [2023-12-28 09:09:32,246][106225] Updated weights for policy 1, policy_version 1937548 (0.0008) [2023-12-28 09:09:32,299][106225] Updated weights for policy 1, policy_version 1937558 (0.0008) [2023-12-28 09:09:32,355][106225] Updated weights for policy 1, policy_version 1937568 (0.0008) [2023-12-28 09:09:32,638][106226] Updated weights for policy 0, policy_version 1933488 (0.0008) [2023-12-28 09:09:32,702][106226] Updated weights for policy 0, policy_version 1933498 (0.0009) [2023-12-28 09:09:32,760][106226] Updated weights for policy 0, policy_version 1933508 (0.0005) [2023-12-28 09:09:33,047][106225] Updated weights for policy 1, policy_version 1937578 (0.0008) [2023-12-28 09:09:33,095][106225] Updated weights for policy 1, policy_version 1937588 (0.0008) [2023-12-28 09:09:33,148][106225] Updated weights for policy 1, policy_version 1937598 (0.0008) [2023-12-28 09:09:33,332][106226] Updated weights for policy 0, policy_version 1933518 (0.0007) [2023-12-28 09:09:33,385][106226] Updated weights for policy 0, policy_version 1933528 (0.0008) [2023-12-28 09:09:33,438][106226] Updated weights for policy 0, policy_version 1933538 (0.0008) [2023-12-28 09:09:33,833][106225] Updated weights for policy 1, policy_version 1937608 (0.0005) [2023-12-28 09:09:33,885][106225] Updated weights for policy 1, policy_version 1937618 (0.0005) [2023-12-28 09:09:33,951][106225] Updated weights for policy 1, policy_version 1937628 (0.0005) [2023-12-28 09:09:34,135][106226] Updated weights for policy 0, policy_version 1933548 (0.0008) [2023-12-28 09:09:34,196][106226] Updated weights for policy 0, policy_version 1933558 (0.0011) [2023-12-28 09:09:34,261][106226] Updated weights for policy 0, policy_version 1933568 (0.0011) [2023-12-28 09:09:34,567][106225] Updated weights for policy 1, policy_version 1937638 (0.0006) [2023-12-28 09:09:34,629][106225] Updated weights for policy 1, policy_version 1937648 (0.0006) [2023-12-28 09:09:34,685][106225] Updated weights for policy 1, policy_version 1937658 (0.0006) [2023-12-28 09:09:34,983][106226] Updated weights for policy 0, policy_version 1933578 (0.0011) [2023-12-28 09:09:35,047][106226] Updated weights for policy 0, policy_version 1933588 (0.0011) [2023-12-28 09:09:35,105][106226] Updated weights for policy 0, policy_version 1933598 (0.0011) [2023-12-28 09:09:35,162][106226] Updated weights for policy 0, policy_version 1933608 (0.0010) [2023-12-28 09:09:35,366][106225] Updated weights for policy 1, policy_version 1937668 (0.0007) [2023-12-28 09:09:35,422][106225] Updated weights for policy 1, policy_version 1937678 (0.0005) [2023-12-28 09:09:35,472][106225] Updated weights for policy 1, policy_version 1937688 (0.0006) [2023-12-28 09:09:35,854][106226] Updated weights for policy 0, policy_version 1933618 (0.0008) [2023-12-28 09:09:35,915][106226] Updated weights for policy 0, policy_version 1933628 (0.0007) [2023-12-28 09:09:35,983][106226] Updated weights for policy 0, policy_version 1933638 (0.0005) [2023-12-28 09:09:36,157][106225] Updated weights for policy 1, policy_version 1937698 (0.0007) [2023-12-28 09:09:36,174][105115] Fps is (10 sec: 20480.3, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 991199232. Throughput: 0: 10009.9, 1: 9817.7. Samples: 991210144. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:36,178][105115] Avg episode reward: [(0, '-4.411'), (1, '-4.794')] [2023-12-28 09:09:36,221][106225] Updated weights for policy 1, policy_version 1937708 (0.0006) [2023-12-28 09:09:36,288][106225] Updated weights for policy 1, policy_version 1937718 (0.0006) [2023-12-28 09:09:36,357][106225] Updated weights for policy 1, policy_version 1937728 (0.0005) [2023-12-28 09:09:36,675][106226] Updated weights for policy 0, policy_version 1933648 (0.0007) [2023-12-28 09:09:36,735][106226] Updated weights for policy 0, policy_version 1933658 (0.0006) [2023-12-28 09:09:36,794][106226] Updated weights for policy 0, policy_version 1933668 (0.0006) [2023-12-28 09:09:37,023][106225] Updated weights for policy 1, policy_version 1937738 (0.0009) [2023-12-28 09:09:37,072][106225] Updated weights for policy 1, policy_version 1937748 (0.0007) [2023-12-28 09:09:37,135][106225] Updated weights for policy 1, policy_version 1937758 (0.0008) [2023-12-28 09:09:37,414][106226] Updated weights for policy 0, policy_version 1933678 (0.0008) [2023-12-28 09:09:37,473][106226] Updated weights for policy 0, policy_version 1933688 (0.0011) [2023-12-28 09:09:37,534][106226] Updated weights for policy 0, policy_version 1933698 (0.0011) [2023-12-28 09:09:37,757][106225] Updated weights for policy 1, policy_version 1937768 (0.0008) [2023-12-28 09:09:37,804][106225] Updated weights for policy 1, policy_version 1937778 (0.0008) [2023-12-28 09:09:37,850][106225] Updated weights for policy 1, policy_version 1937788 (0.0007) [2023-12-28 09:09:38,271][106226] Updated weights for policy 0, policy_version 1933708 (0.0011) [2023-12-28 09:09:38,340][106226] Updated weights for policy 0, policy_version 1933718 (0.0009) [2023-12-28 09:09:38,400][106226] Updated weights for policy 0, policy_version 1933728 (0.0010) [2023-12-28 09:09:38,576][106225] Updated weights for policy 1, policy_version 1937798 (0.0007) [2023-12-28 09:09:38,639][106225] Updated weights for policy 1, policy_version 1937808 (0.0007) [2023-12-28 09:09:38,706][106225] Updated weights for policy 1, policy_version 1937818 (0.0007) [2023-12-28 09:09:39,102][106226] Updated weights for policy 0, policy_version 1933738 (0.0011) [2023-12-28 09:09:39,162][106226] Updated weights for policy 0, policy_version 1933748 (0.0010) [2023-12-28 09:09:39,231][106226] Updated weights for policy 0, policy_version 1933758 (0.0010) [2023-12-28 09:09:39,301][106226] Updated weights for policy 0, policy_version 1933768 (0.0007) [2023-12-28 09:09:39,402][106225] Updated weights for policy 1, policy_version 1937828 (0.0008) [2023-12-28 09:09:39,460][106225] Updated weights for policy 1, policy_version 1937838 (0.0006) [2023-12-28 09:09:39,520][106225] Updated weights for policy 1, policy_version 1937848 (0.0008) [2023-12-28 09:09:40,017][106226] Updated weights for policy 0, policy_version 1933778 (0.0009) [2023-12-28 09:09:40,064][106226] Updated weights for policy 0, policy_version 1933788 (0.0009) [2023-12-28 09:09:40,115][106226] Updated weights for policy 0, policy_version 1933798 (0.0009) [2023-12-28 09:09:40,243][106225] Updated weights for policy 1, policy_version 1937858 (0.0008) [2023-12-28 09:09:40,303][106225] Updated weights for policy 1, policy_version 1937868 (0.0008) [2023-12-28 09:09:40,365][106225] Updated weights for policy 1, policy_version 1937878 (0.0007) [2023-12-28 09:09:40,428][106225] Updated weights for policy 1, policy_version 1937888 (0.0007) [2023-12-28 09:09:40,886][106226] Updated weights for policy 0, policy_version 1933808 (0.0010) [2023-12-28 09:09:40,942][106226] Updated weights for policy 0, policy_version 1933818 (0.0010) [2023-12-28 09:09:41,002][106226] Updated weights for policy 0, policy_version 1933828 (0.0010) [2023-12-28 09:09:41,146][106225] Updated weights for policy 1, policy_version 1937898 (0.0007) [2023-12-28 09:09:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 991297536. Throughput: 0: 10034.4, 1: 9832.3. Samples: 991270364. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:41,175][105115] Avg episode reward: [(0, '-4.276'), (1, '-4.681')] [2023-12-28 09:09:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001933832_495140864.pth... [2023-12-28 09:09:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001932648_494837760.pth [2023-12-28 09:09:41,211][106225] Updated weights for policy 1, policy_version 1937908 (0.0008) [2023-12-28 09:09:41,282][106225] Updated weights for policy 1, policy_version 1937918 (0.0008) [2023-12-28 09:09:41,293][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001937920_496164864.pth... [2023-12-28 09:09:41,297][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001936736_495861760.pth [2023-12-28 09:09:41,850][106226] Updated weights for policy 0, policy_version 1933838 (0.0011) [2023-12-28 09:09:41,915][106226] Updated weights for policy 0, policy_version 1933848 (0.0011) [2023-12-28 09:09:41,981][106226] Updated weights for policy 0, policy_version 1933858 (0.0011) [2023-12-28 09:09:42,013][106225] Updated weights for policy 1, policy_version 1937928 (0.0006) [2023-12-28 09:09:42,071][106225] Updated weights for policy 1, policy_version 1937938 (0.0006) [2023-12-28 09:09:42,123][106225] Updated weights for policy 1, policy_version 1937948 (0.0008) [2023-12-28 09:09:42,742][106226] Updated weights for policy 0, policy_version 1933868 (0.0011) [2023-12-28 09:09:42,799][106226] Updated weights for policy 0, policy_version 1933878 (0.0011) [2023-12-28 09:09:42,813][106225] Updated weights for policy 1, policy_version 1937958 (0.0007) [2023-12-28 09:09:42,854][106226] Updated weights for policy 0, policy_version 1933888 (0.0010) [2023-12-28 09:09:42,866][106225] Updated weights for policy 1, policy_version 1937968 (0.0007) [2023-12-28 09:09:42,918][106225] Updated weights for policy 1, policy_version 1937978 (0.0008) [2023-12-28 09:09:43,562][106226] Updated weights for policy 0, policy_version 1933898 (0.0010) [2023-12-28 09:09:43,612][106226] Updated weights for policy 0, policy_version 1933908 (0.0010) [2023-12-28 09:09:43,656][106225] Updated weights for policy 1, policy_version 1937988 (0.0007) [2023-12-28 09:09:43,662][106226] Updated weights for policy 0, policy_version 1933918 (0.0010) [2023-12-28 09:09:43,709][106226] Updated weights for policy 0, policy_version 1933928 (0.0010) [2023-12-28 09:09:43,710][106225] Updated weights for policy 1, policy_version 1937998 (0.0005) [2023-12-28 09:09:43,774][106225] Updated weights for policy 1, policy_version 1938008 (0.0008) [2023-12-28 09:09:44,460][106226] Updated weights for policy 0, policy_version 1933938 (0.0011) [2023-12-28 09:09:44,506][106225] Updated weights for policy 1, policy_version 1938018 (0.0008) [2023-12-28 09:09:44,522][106226] Updated weights for policy 0, policy_version 1933948 (0.0011) [2023-12-28 09:09:44,573][106225] Updated weights for policy 1, policy_version 1938028 (0.0008) [2023-12-28 09:09:44,588][106226] Updated weights for policy 0, policy_version 1933958 (0.0008) [2023-12-28 09:09:44,635][106225] Updated weights for policy 1, policy_version 1938038 (0.0009) [2023-12-28 09:09:44,695][106225] Updated weights for policy 1, policy_version 1938048 (0.0007) [2023-12-28 09:09:45,367][106226] Updated weights for policy 0, policy_version 1933968 (0.0010) [2023-12-28 09:09:45,418][106226] Updated weights for policy 0, policy_version 1933978 (0.0011) [2023-12-28 09:09:45,426][106225] Updated weights for policy 1, policy_version 1938058 (0.0011) [2023-12-28 09:09:45,469][106226] Updated weights for policy 0, policy_version 1933988 (0.0010) [2023-12-28 09:09:45,486][106225] Updated weights for policy 1, policy_version 1938068 (0.0010) [2023-12-28 09:09:45,540][106225] Updated weights for policy 1, policy_version 1938078 (0.0010) [2023-12-28 09:09:46,150][106226] Updated weights for policy 0, policy_version 1933998 (0.0011) [2023-12-28 09:09:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 991387648. Throughput: 0: 9899.2, 1: 9836.5. Samples: 991382752. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:46,175][105115] Avg episode reward: [(0, '-4.379'), (1, '-4.620')] [2023-12-28 09:09:46,217][106226] Updated weights for policy 0, policy_version 1934008 (0.0007) [2023-12-28 09:09:46,229][106225] Updated weights for policy 1, policy_version 1938088 (0.0009) [2023-12-28 09:09:46,282][106225] Updated weights for policy 1, policy_version 1938098 (0.0008) [2023-12-28 09:09:46,283][106226] Updated weights for policy 0, policy_version 1934018 (0.0006) [2023-12-28 09:09:46,333][106225] Updated weights for policy 1, policy_version 1938108 (0.0008) [2023-12-28 09:09:46,979][106226] Updated weights for policy 0, policy_version 1934028 (0.0009) [2023-12-28 09:09:47,044][106225] Updated weights for policy 1, policy_version 1938118 (0.0008) [2023-12-28 09:09:47,044][106226] Updated weights for policy 0, policy_version 1934038 (0.0006) [2023-12-28 09:09:47,103][106225] Updated weights for policy 1, policy_version 1938128 (0.0011) [2023-12-28 09:09:47,106][106226] Updated weights for policy 0, policy_version 1934048 (0.0006) [2023-12-28 09:09:47,151][106225] Updated weights for policy 1, policy_version 1938138 (0.0010) [2023-12-28 09:09:47,700][106226] Updated weights for policy 0, policy_version 1934058 (0.0007) [2023-12-28 09:09:47,763][106226] Updated weights for policy 0, policy_version 1934068 (0.0011) [2023-12-28 09:09:47,765][106225] Updated weights for policy 1, policy_version 1938148 (0.0008) [2023-12-28 09:09:47,822][106226] Updated weights for policy 0, policy_version 1934078 (0.0010) [2023-12-28 09:09:47,822][106225] Updated weights for policy 1, policy_version 1938158 (0.0006) [2023-12-28 09:09:47,886][106225] Updated weights for policy 1, policy_version 1938168 (0.0007) [2023-12-28 09:09:47,890][106226] Updated weights for policy 0, policy_version 1934088 (0.0008) [2023-12-28 09:09:48,446][106226] Updated weights for policy 0, policy_version 1934098 (0.0008) [2023-12-28 09:09:48,500][106226] Updated weights for policy 0, policy_version 1934108 (0.0007) [2023-12-28 09:09:48,557][106226] Updated weights for policy 0, policy_version 1934118 (0.0008) [2023-12-28 09:09:48,572][106225] Updated weights for policy 1, policy_version 1938178 (0.0010) [2023-12-28 09:09:48,627][106225] Updated weights for policy 1, policy_version 1938188 (0.0011) [2023-12-28 09:09:48,681][106225] Updated weights for policy 1, policy_version 1938198 (0.0010) [2023-12-28 09:09:48,741][106225] Updated weights for policy 1, policy_version 1938208 (0.0009) [2023-12-28 09:09:49,332][106226] Updated weights for policy 0, policy_version 1934128 (0.0007) [2023-12-28 09:09:49,401][106226] Updated weights for policy 0, policy_version 1934138 (0.0008) [2023-12-28 09:09:49,427][106225] Updated weights for policy 1, policy_version 1938218 (0.0007) [2023-12-28 09:09:49,463][106226] Updated weights for policy 0, policy_version 1934148 (0.0009) [2023-12-28 09:09:49,480][106225] Updated weights for policy 1, policy_version 1938228 (0.0005) [2023-12-28 09:09:49,532][106225] Updated weights for policy 1, policy_version 1938238 (0.0005) [2023-12-28 09:09:50,142][106225] Updated weights for policy 1, policy_version 1938248 (0.0005) [2023-12-28 09:09:50,206][106225] Updated weights for policy 1, policy_version 1938258 (0.0006) [2023-12-28 09:09:50,237][106226] Updated weights for policy 0, policy_version 1934158 (0.0007) [2023-12-28 09:09:50,267][106225] Updated weights for policy 1, policy_version 1938268 (0.0007) [2023-12-28 09:09:50,294][106226] Updated weights for policy 0, policy_version 1934168 (0.0006) [2023-12-28 09:09:50,362][106226] Updated weights for policy 0, policy_version 1934178 (0.0008) [2023-12-28 09:09:50,904][106225] Updated weights for policy 1, policy_version 1938278 (0.0007) [2023-12-28 09:09:50,967][106225] Updated weights for policy 1, policy_version 1938288 (0.0006) [2023-12-28 09:09:51,042][106225] Updated weights for policy 1, policy_version 1938298 (0.0008) [2023-12-28 09:09:51,167][106226] Updated weights for policy 0, policy_version 1934188 (0.0010) [2023-12-28 09:09:51,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 991494144. Throughput: 0: 9844.2, 1: 9907.7. Samples: 991503292. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:51,175][105115] Avg episode reward: [(0, '-4.264'), (1, '-4.262')] [2023-12-28 09:09:51,232][106226] Updated weights for policy 0, policy_version 1934198 (0.0009) [2023-12-28 09:09:51,297][106226] Updated weights for policy 0, policy_version 1934208 (0.0008) [2023-12-28 09:09:51,699][106225] Updated weights for policy 1, policy_version 1938308 (0.0007) [2023-12-28 09:09:51,765][106225] Updated weights for policy 1, policy_version 1938318 (0.0008) [2023-12-28 09:09:51,829][106225] Updated weights for policy 1, policy_version 1938328 (0.0006) [2023-12-28 09:09:52,056][106226] Updated weights for policy 0, policy_version 1934218 (0.0008) [2023-12-28 09:09:52,114][106226] Updated weights for policy 0, policy_version 1934228 (0.0007) [2023-12-28 09:09:52,169][106226] Updated weights for policy 0, policy_version 1934238 (0.0009) [2023-12-28 09:09:52,219][106226] Updated weights for policy 0, policy_version 1934248 (0.0008) [2023-12-28 09:09:52,510][106225] Updated weights for policy 1, policy_version 1938338 (0.0009) [2023-12-28 09:09:52,565][106225] Updated weights for policy 1, policy_version 1938348 (0.0009) [2023-12-28 09:09:52,626][106225] Updated weights for policy 1, policy_version 1938358 (0.0009) [2023-12-28 09:09:52,684][106225] Updated weights for policy 1, policy_version 1938368 (0.0009) [2023-12-28 09:09:52,923][106226] Updated weights for policy 0, policy_version 1934258 (0.0005) [2023-12-28 09:09:52,979][106226] Updated weights for policy 0, policy_version 1934268 (0.0007) [2023-12-28 09:09:53,037][106226] Updated weights for policy 0, policy_version 1934278 (0.0006) [2023-12-28 09:09:53,366][106225] Updated weights for policy 1, policy_version 1938378 (0.0008) [2023-12-28 09:09:53,424][106225] Updated weights for policy 1, policy_version 1938388 (0.0010) [2023-12-28 09:09:53,473][106225] Updated weights for policy 1, policy_version 1938398 (0.0009) [2023-12-28 09:09:53,607][106226] Updated weights for policy 0, policy_version 1934288 (0.0006) [2023-12-28 09:09:53,656][106226] Updated weights for policy 0, policy_version 1934298 (0.0005) [2023-12-28 09:09:53,714][106226] Updated weights for policy 0, policy_version 1934308 (0.0008) [2023-12-28 09:09:54,200][106225] Updated weights for policy 1, policy_version 1938408 (0.0008) [2023-12-28 09:09:54,256][106225] Updated weights for policy 1, policy_version 1938418 (0.0008) [2023-12-28 09:09:54,313][106225] Updated weights for policy 1, policy_version 1938428 (0.0008) [2023-12-28 09:09:54,415][106226] Updated weights for policy 0, policy_version 1934318 (0.0007) [2023-12-28 09:09:54,471][106226] Updated weights for policy 0, policy_version 1934328 (0.0008) [2023-12-28 09:09:54,523][106226] Updated weights for policy 0, policy_version 1934338 (0.0008) [2023-12-28 09:09:54,941][106225] Updated weights for policy 1, policy_version 1938438 (0.0009) [2023-12-28 09:09:55,002][106225] Updated weights for policy 1, policy_version 1938448 (0.0009) [2023-12-28 09:09:55,067][106225] Updated weights for policy 1, policy_version 1938458 (0.0008) [2023-12-28 09:09:55,321][106226] Updated weights for policy 0, policy_version 1934348 (0.0008) [2023-12-28 09:09:55,382][106226] Updated weights for policy 0, policy_version 1934358 (0.0008) [2023-12-28 09:09:55,442][106226] Updated weights for policy 0, policy_version 1934368 (0.0008) [2023-12-28 09:09:55,771][106225] Updated weights for policy 1, policy_version 1938468 (0.0009) [2023-12-28 09:09:55,833][106225] Updated weights for policy 1, policy_version 1938478 (0.0006) [2023-12-28 09:09:55,899][106225] Updated weights for policy 1, policy_version 1938488 (0.0005) [2023-12-28 09:09:56,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 991592448. Throughput: 0: 9838.7, 1: 9910.9. Samples: 991562864. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:09:56,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.602')] [2023-12-28 09:09:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001938496_496312320.pth... [2023-12-28 09:09:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001937312_496009216.pth [2023-12-28 09:09:56,195][106226] Updated weights for policy 0, policy_version 1934378 (0.0008) [2023-12-28 09:09:56,251][106226] Updated weights for policy 0, policy_version 1934388 (0.0009) [2023-12-28 09:09:56,301][106226] Updated weights for policy 0, policy_version 1934398 (0.0009) [2023-12-28 09:09:56,358][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001934408_495288320.pth... [2023-12-28 09:09:56,360][106226] Updated weights for policy 0, policy_version 1934408 (0.0008) [2023-12-28 09:09:56,362][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001933224_494985216.pth [2023-12-28 09:09:56,475][106225] Updated weights for policy 1, policy_version 1938498 (0.0006) [2023-12-28 09:09:56,534][106225] Updated weights for policy 1, policy_version 1938508 (0.0008) [2023-12-28 09:09:56,582][106225] Updated weights for policy 1, policy_version 1938518 (0.0009) [2023-12-28 09:09:56,632][106225] Updated weights for policy 1, policy_version 1938528 (0.0005) [2023-12-28 09:09:57,142][106226] Updated weights for policy 0, policy_version 1934418 (0.0007) [2023-12-28 09:09:57,197][106226] Updated weights for policy 0, policy_version 1934428 (0.0005) [2023-12-28 09:09:57,245][106225] Updated weights for policy 1, policy_version 1938538 (0.0006) [2023-12-28 09:09:57,252][106226] Updated weights for policy 0, policy_version 1934438 (0.0005) [2023-12-28 09:09:57,289][106225] Updated weights for policy 1, policy_version 1938548 (0.0005) [2023-12-28 09:09:57,344][106225] Updated weights for policy 1, policy_version 1938558 (0.0007) [2023-12-28 09:09:57,949][106226] Updated weights for policy 0, policy_version 1934448 (0.0007) [2023-12-28 09:09:58,009][106225] Updated weights for policy 1, policy_version 1938568 (0.0007) [2023-12-28 09:09:58,014][106226] Updated weights for policy 0, policy_version 1934458 (0.0006) [2023-12-28 09:09:58,064][106225] Updated weights for policy 1, policy_version 1938578 (0.0007) [2023-12-28 09:09:58,070][106226] Updated weights for policy 0, policy_version 1934468 (0.0007) [2023-12-28 09:09:58,115][106225] Updated weights for policy 1, policy_version 1938588 (0.0008) [2023-12-28 09:09:58,814][106226] Updated weights for policy 0, policy_version 1934478 (0.0008) [2023-12-28 09:09:58,881][106226] Updated weights for policy 0, policy_version 1934488 (0.0009) [2023-12-28 09:09:58,951][106226] Updated weights for policy 0, policy_version 1934498 (0.0009) [2023-12-28 09:09:58,999][106225] Updated weights for policy 1, policy_version 1938598 (0.0008) [2023-12-28 09:09:59,062][106225] Updated weights for policy 1, policy_version 1938608 (0.0009) [2023-12-28 09:09:59,126][106225] Updated weights for policy 1, policy_version 1938618 (0.0008) [2023-12-28 09:09:59,748][106226] Updated weights for policy 0, policy_version 1934508 (0.0009) [2023-12-28 09:09:59,812][106226] Updated weights for policy 0, policy_version 1934518 (0.0009) [2023-12-28 09:09:59,822][106225] Updated weights for policy 1, policy_version 1938628 (0.0007) [2023-12-28 09:09:59,877][106226] Updated weights for policy 0, policy_version 1934528 (0.0010) [2023-12-28 09:09:59,880][106225] Updated weights for policy 1, policy_version 1938638 (0.0008) [2023-12-28 09:09:59,942][106225] Updated weights for policy 1, policy_version 1938648 (0.0008) [2023-12-28 09:10:00,447][106226] Updated weights for policy 0, policy_version 1934538 (0.0006) [2023-12-28 09:10:00,503][106226] Updated weights for policy 0, policy_version 1934548 (0.0005) [2023-12-28 09:10:00,571][106226] Updated weights for policy 0, policy_version 1934558 (0.0006) [2023-12-28 09:10:00,633][106226] Updated weights for policy 0, policy_version 1934568 (0.0005) [2023-12-28 09:10:00,770][106225] Updated weights for policy 1, policy_version 1938658 (0.0010) [2023-12-28 09:10:00,818][106225] Updated weights for policy 1, policy_version 1938668 (0.0008) [2023-12-28 09:10:00,873][106225] Updated weights for policy 1, policy_version 1938678 (0.0007) [2023-12-28 09:10:00,928][106225] Updated weights for policy 1, policy_version 1938688 (0.0008) [2023-12-28 09:10:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 991690752. Throughput: 0: 9780.4, 1: 10028.7. Samples: 991680036. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:01,175][105115] Avg episode reward: [(0, '-4.481'), (1, '-4.755')] [2023-12-28 09:10:01,250][106226] Updated weights for policy 0, policy_version 1934578 (0.0009) [2023-12-28 09:10:01,307][106226] Updated weights for policy 0, policy_version 1934588 (0.0007) [2023-12-28 09:10:01,377][106226] Updated weights for policy 0, policy_version 1934598 (0.0008) [2023-12-28 09:10:01,667][106225] Updated weights for policy 1, policy_version 1938698 (0.0008) [2023-12-28 09:10:01,731][106225] Updated weights for policy 1, policy_version 1938708 (0.0007) [2023-12-28 09:10:01,799][106225] Updated weights for policy 1, policy_version 1938718 (0.0008) [2023-12-28 09:10:02,123][106226] Updated weights for policy 0, policy_version 1934608 (0.0009) [2023-12-28 09:10:02,182][106226] Updated weights for policy 0, policy_version 1934618 (0.0008) [2023-12-28 09:10:02,229][106226] Updated weights for policy 0, policy_version 1934628 (0.0008) [2023-12-28 09:10:02,548][106225] Updated weights for policy 1, policy_version 1938728 (0.0009) [2023-12-28 09:10:02,603][106225] Updated weights for policy 1, policy_version 1938738 (0.0008) [2023-12-28 09:10:02,660][106225] Updated weights for policy 1, policy_version 1938748 (0.0009) [2023-12-28 09:10:02,932][106226] Updated weights for policy 0, policy_version 1934638 (0.0008) [2023-12-28 09:10:02,993][106226] Updated weights for policy 0, policy_version 1934648 (0.0009) [2023-12-28 09:10:03,055][106226] Updated weights for policy 0, policy_version 1934658 (0.0010) [2023-12-28 09:10:03,283][106225] Updated weights for policy 1, policy_version 1938758 (0.0007) [2023-12-28 09:10:03,333][106225] Updated weights for policy 1, policy_version 1938768 (0.0009) [2023-12-28 09:10:03,396][106225] Updated weights for policy 1, policy_version 1938778 (0.0009) [2023-12-28 09:10:03,644][106226] Updated weights for policy 0, policy_version 1934668 (0.0008) [2023-12-28 09:10:03,699][106226] Updated weights for policy 0, policy_version 1934678 (0.0005) [2023-12-28 09:10:03,761][106226] Updated weights for policy 0, policy_version 1934688 (0.0008) [2023-12-28 09:10:04,224][106225] Updated weights for policy 1, policy_version 1938788 (0.0008) [2023-12-28 09:10:04,281][106225] Updated weights for policy 1, policy_version 1938798 (0.0007) [2023-12-28 09:10:04,342][106225] Updated weights for policy 1, policy_version 1938808 (0.0009) [2023-12-28 09:10:04,425][106226] Updated weights for policy 0, policy_version 1934698 (0.0008) [2023-12-28 09:10:04,492][106226] Updated weights for policy 0, policy_version 1934708 (0.0009) [2023-12-28 09:10:04,556][106226] Updated weights for policy 0, policy_version 1934718 (0.0009) [2023-12-28 09:10:04,614][106226] Updated weights for policy 0, policy_version 1934728 (0.0008) [2023-12-28 09:10:04,945][106225] Updated weights for policy 1, policy_version 1938818 (0.0008) [2023-12-28 09:10:05,004][106225] Updated weights for policy 1, policy_version 1938828 (0.0008) [2023-12-28 09:10:05,063][106225] Updated weights for policy 1, policy_version 1938838 (0.0009) [2023-12-28 09:10:05,118][106225] Updated weights for policy 1, policy_version 1938848 (0.0009) [2023-12-28 09:10:05,393][106226] Updated weights for policy 0, policy_version 1934738 (0.0007) [2023-12-28 09:10:05,441][106226] Updated weights for policy 0, policy_version 1934748 (0.0005) [2023-12-28 09:10:05,487][106226] Updated weights for policy 0, policy_version 1934758 (0.0005) [2023-12-28 09:10:05,864][106225] Updated weights for policy 1, policy_version 1938858 (0.0009) [2023-12-28 09:10:05,912][106225] Updated weights for policy 1, policy_version 1938868 (0.0009) [2023-12-28 09:10:05,957][106225] Updated weights for policy 1, policy_version 1938878 (0.0008) [2023-12-28 09:10:06,067][106226] Updated weights for policy 0, policy_version 1934768 (0.0008) [2023-12-28 09:10:06,128][106226] Updated weights for policy 0, policy_version 1934778 (0.0008) [2023-12-28 09:10:06,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19771.9). Total num frames: 991789056. Throughput: 0: 9866.5, 1: 10012.0. Samples: 991800504. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:06,175][105115] Avg episode reward: [(0, '-4.056'), (1, '-4.536')] [2023-12-28 09:10:06,184][106226] Updated weights for policy 0, policy_version 1934788 (0.0009) [2023-12-28 09:10:06,748][106225] Updated weights for policy 1, policy_version 1938888 (0.0009) [2023-12-28 09:10:06,806][106225] Updated weights for policy 1, policy_version 1938898 (0.0009) [2023-12-28 09:10:06,865][106225] Updated weights for policy 1, policy_version 1938908 (0.0008) [2023-12-28 09:10:06,913][106226] Updated weights for policy 0, policy_version 1934798 (0.0008) [2023-12-28 09:10:06,973][106226] Updated weights for policy 0, policy_version 1934808 (0.0009) [2023-12-28 09:10:07,030][106226] Updated weights for policy 0, policy_version 1934818 (0.0009) [2023-12-28 09:10:07,547][106225] Updated weights for policy 1, policy_version 1938918 (0.0008) [2023-12-28 09:10:07,607][106225] Updated weights for policy 1, policy_version 1938928 (0.0008) [2023-12-28 09:10:07,663][106225] Updated weights for policy 1, policy_version 1938938 (0.0008) [2023-12-28 09:10:07,716][106226] Updated weights for policy 0, policy_version 1934828 (0.0008) [2023-12-28 09:10:07,785][106226] Updated weights for policy 0, policy_version 1934838 (0.0006) [2023-12-28 09:10:07,840][106226] Updated weights for policy 0, policy_version 1934848 (0.0009) [2023-12-28 09:10:08,354][106225] Updated weights for policy 1, policy_version 1938948 (0.0010) [2023-12-28 09:10:08,417][106225] Updated weights for policy 1, policy_version 1938958 (0.0009) [2023-12-28 09:10:08,425][106226] Updated weights for policy 0, policy_version 1934858 (0.0010) [2023-12-28 09:10:08,476][106225] Updated weights for policy 1, policy_version 1938968 (0.0009) [2023-12-28 09:10:08,486][106226] Updated weights for policy 0, policy_version 1934868 (0.0010) [2023-12-28 09:10:08,544][106226] Updated weights for policy 0, policy_version 1934878 (0.0010) [2023-12-28 09:10:08,601][106226] Updated weights for policy 0, policy_version 1934888 (0.0011) [2023-12-28 09:10:09,171][106225] Updated weights for policy 1, policy_version 1938978 (0.0009) [2023-12-28 09:10:09,239][106225] Updated weights for policy 1, policy_version 1938988 (0.0007) [2023-12-28 09:10:09,292][106226] Updated weights for policy 0, policy_version 1934898 (0.0009) [2023-12-28 09:10:09,308][106225] Updated weights for policy 1, policy_version 1938998 (0.0010) [2023-12-28 09:10:09,363][106226] Updated weights for policy 0, policy_version 1934908 (0.0008) [2023-12-28 09:10:09,382][106225] Updated weights for policy 1, policy_version 1939008 (0.0011) [2023-12-28 09:10:09,438][106226] Updated weights for policy 0, policy_version 1934919 (0.0008) [2023-12-28 09:10:10,133][106225] Updated weights for policy 1, policy_version 1939018 (0.0008) [2023-12-28 09:10:10,164][106226] Updated weights for policy 0, policy_version 1934929 (0.0008) [2023-12-28 09:10:10,198][106225] Updated weights for policy 1, policy_version 1939028 (0.0006) [2023-12-28 09:10:10,225][106226] Updated weights for policy 0, policy_version 1934939 (0.0009) [2023-12-28 09:10:10,255][106225] Updated weights for policy 1, policy_version 1939038 (0.0007) [2023-12-28 09:10:10,280][106226] Updated weights for policy 0, policy_version 1934949 (0.0011) [2023-12-28 09:10:10,964][106226] Updated weights for policy 0, policy_version 1934959 (0.0008) [2023-12-28 09:10:10,998][106225] Updated weights for policy 1, policy_version 1939048 (0.0007) [2023-12-28 09:10:11,018][106226] Updated weights for policy 0, policy_version 1934969 (0.0008) [2023-12-28 09:10:11,060][106225] Updated weights for policy 1, policy_version 1939058 (0.0008) [2023-12-28 09:10:11,090][106226] Updated weights for policy 0, policy_version 1934979 (0.0009) [2023-12-28 09:10:11,126][106225] Updated weights for policy 1, policy_version 1939068 (0.0007) [2023-12-28 09:10:11,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 991895552. Throughput: 0: 9905.1, 1: 10044.7. Samples: 991860080. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:11,175][105115] Avg episode reward: [(0, '-4.432'), (1, '-4.530')] [2023-12-28 09:10:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001939072_496459776.pth... [2023-12-28 09:10:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001934984_495435776.pth... [2023-12-28 09:10:11,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001933832_495140864.pth [2023-12-28 09:10:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001937920_496164864.pth [2023-12-28 09:10:11,883][106225] Updated weights for policy 1, policy_version 1939078 (0.0006) [2023-12-28 09:10:11,936][106226] Updated weights for policy 0, policy_version 1934989 (0.0006) [2023-12-28 09:10:11,945][106225] Updated weights for policy 1, policy_version 1939088 (0.0009) [2023-12-28 09:10:11,991][106226] Updated weights for policy 0, policy_version 1934999 (0.0006) [2023-12-28 09:10:12,003][106225] Updated weights for policy 1, policy_version 1939098 (0.0008) [2023-12-28 09:10:12,049][106226] Updated weights for policy 0, policy_version 1935009 (0.0005) [2023-12-28 09:10:12,705][106225] Updated weights for policy 1, policy_version 1939108 (0.0007) [2023-12-28 09:10:12,726][106226] Updated weights for policy 0, policy_version 1935019 (0.0006) [2023-12-28 09:10:12,757][106225] Updated weights for policy 1, policy_version 1939118 (0.0006) [2023-12-28 09:10:12,783][106226] Updated weights for policy 0, policy_version 1935029 (0.0007) [2023-12-28 09:10:12,806][106225] Updated weights for policy 1, policy_version 1939128 (0.0007) [2023-12-28 09:10:12,837][106226] Updated weights for policy 0, policy_version 1935039 (0.0007) [2023-12-28 09:10:13,412][106226] Updated weights for policy 0, policy_version 1935049 (0.0006) [2023-12-28 09:10:13,445][106225] Updated weights for policy 1, policy_version 1939138 (0.0009) [2023-12-28 09:10:13,474][106226] Updated weights for policy 0, policy_version 1935059 (0.0007) [2023-12-28 09:10:13,496][106225] Updated weights for policy 1, policy_version 1939148 (0.0006) [2023-12-28 09:10:13,532][106226] Updated weights for policy 0, policy_version 1935069 (0.0007) [2023-12-28 09:10:13,544][106225] Updated weights for policy 1, policy_version 1939158 (0.0008) [2023-12-28 09:10:13,594][106226] Updated weights for policy 0, policy_version 1935079 (0.0006) [2023-12-28 09:10:13,598][106225] Updated weights for policy 1, policy_version 1939168 (0.0005) [2023-12-28 09:10:14,122][106226] Updated weights for policy 0, policy_version 1935089 (0.0008) [2023-12-28 09:10:14,180][106226] Updated weights for policy 0, policy_version 1935099 (0.0008) [2023-12-28 09:10:14,217][106225] Updated weights for policy 1, policy_version 1939178 (0.0010) [2023-12-28 09:10:14,227][106226] Updated weights for policy 0, policy_version 1935109 (0.0005) [2023-12-28 09:10:14,275][106225] Updated weights for policy 1, policy_version 1939188 (0.0010) [2023-12-28 09:10:14,337][106225] Updated weights for policy 1, policy_version 1939198 (0.0007) [2023-12-28 09:10:14,914][106225] Updated weights for policy 1, policy_version 1939208 (0.0008) [2023-12-28 09:10:14,978][106225] Updated weights for policy 1, policy_version 1939218 (0.0009) [2023-12-28 09:10:15,022][106226] Updated weights for policy 0, policy_version 1935119 (0.0006) [2023-12-28 09:10:15,046][106225] Updated weights for policy 1, policy_version 1939228 (0.0010) [2023-12-28 09:10:15,087][106226] Updated weights for policy 0, policy_version 1935129 (0.0007) [2023-12-28 09:10:15,150][106226] Updated weights for policy 0, policy_version 1935139 (0.0008) [2023-12-28 09:10:15,706][106225] Updated weights for policy 1, policy_version 1939238 (0.0007) [2023-12-28 09:10:15,760][106225] Updated weights for policy 1, policy_version 1939248 (0.0005) [2023-12-28 09:10:15,824][106225] Updated weights for policy 1, policy_version 1939258 (0.0006) [2023-12-28 09:10:15,898][106226] Updated weights for policy 0, policy_version 1935149 (0.0009) [2023-12-28 09:10:15,955][106226] Updated weights for policy 0, policy_version 1935159 (0.0008) [2023-12-28 09:10:16,021][106226] Updated weights for policy 0, policy_version 1935169 (0.0008) [2023-12-28 09:10:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 991993856. Throughput: 0: 9843.3, 1: 9989.7. Samples: 991980728. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:16,175][105115] Avg episode reward: [(0, '-4.221'), (1, '-4.511')] [2023-12-28 09:10:16,476][106225] Updated weights for policy 1, policy_version 1939268 (0.0011) [2023-12-28 09:10:16,533][106225] Updated weights for policy 1, policy_version 1939278 (0.0007) [2023-12-28 09:10:16,596][106225] Updated weights for policy 1, policy_version 1939288 (0.0010) [2023-12-28 09:10:16,724][106226] Updated weights for policy 0, policy_version 1935179 (0.0007) [2023-12-28 09:10:16,784][106226] Updated weights for policy 0, policy_version 1935189 (0.0006) [2023-12-28 09:10:16,850][106226] Updated weights for policy 0, policy_version 1935199 (0.0006) [2023-12-28 09:10:17,253][106225] Updated weights for policy 1, policy_version 1939298 (0.0010) [2023-12-28 09:10:17,316][106225] Updated weights for policy 1, policy_version 1939308 (0.0011) [2023-12-28 09:10:17,377][106225] Updated weights for policy 1, policy_version 1939318 (0.0009) [2023-12-28 09:10:17,429][106225] Updated weights for policy 1, policy_version 1939328 (0.0009) [2023-12-28 09:10:17,490][106226] Updated weights for policy 0, policy_version 1935209 (0.0006) [2023-12-28 09:10:17,541][106226] Updated weights for policy 0, policy_version 1935219 (0.0008) [2023-12-28 09:10:17,591][106226] Updated weights for policy 0, policy_version 1935229 (0.0007) [2023-12-28 09:10:17,641][106226] Updated weights for policy 0, policy_version 1935239 (0.0008) [2023-12-28 09:10:18,091][106225] Updated weights for policy 1, policy_version 1939338 (0.0006) [2023-12-28 09:10:18,150][106225] Updated weights for policy 1, policy_version 1939348 (0.0006) [2023-12-28 09:10:18,211][106225] Updated weights for policy 1, policy_version 1939358 (0.0005) [2023-12-28 09:10:18,276][106226] Updated weights for policy 0, policy_version 1935249 (0.0010) [2023-12-28 09:10:18,325][106226] Updated weights for policy 0, policy_version 1935259 (0.0010) [2023-12-28 09:10:18,395][106226] Updated weights for policy 0, policy_version 1935269 (0.0011) [2023-12-28 09:10:18,796][106225] Updated weights for policy 1, policy_version 1939368 (0.0005) [2023-12-28 09:10:18,847][106225] Updated weights for policy 1, policy_version 1939378 (0.0005) [2023-12-28 09:10:18,909][106225] Updated weights for policy 1, policy_version 1939388 (0.0008) [2023-12-28 09:10:19,048][106226] Updated weights for policy 0, policy_version 1935279 (0.0011) [2023-12-28 09:10:19,111][106226] Updated weights for policy 0, policy_version 1935289 (0.0011) [2023-12-28 09:10:19,170][106226] Updated weights for policy 0, policy_version 1935299 (0.0010) [2023-12-28 09:10:19,600][106225] Updated weights for policy 1, policy_version 1939398 (0.0008) [2023-12-28 09:10:19,658][106225] Updated weights for policy 1, policy_version 1939408 (0.0009) [2023-12-28 09:10:19,718][106225] Updated weights for policy 1, policy_version 1939418 (0.0011) [2023-12-28 09:10:19,915][106226] Updated weights for policy 0, policy_version 1935309 (0.0009) [2023-12-28 09:10:19,988][106226] Updated weights for policy 0, policy_version 1935319 (0.0008) [2023-12-28 09:10:20,055][106226] Updated weights for policy 0, policy_version 1935329 (0.0008) [2023-12-28 09:10:20,461][106225] Updated weights for policy 1, policy_version 1939428 (0.0011) [2023-12-28 09:10:20,525][106225] Updated weights for policy 1, policy_version 1939438 (0.0010) [2023-12-28 09:10:20,593][106225] Updated weights for policy 1, policy_version 1939448 (0.0010) [2023-12-28 09:10:20,754][106226] Updated weights for policy 0, policy_version 1935339 (0.0007) [2023-12-28 09:10:20,824][106226] Updated weights for policy 0, policy_version 1935349 (0.0005) [2023-12-28 09:10:20,893][106226] Updated weights for policy 0, policy_version 1935359 (0.0010) [2023-12-28 09:10:21,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19799.6). Total num frames: 992092160. Throughput: 0: 9804.1, 1: 9989.7. Samples: 992100864. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:21,175][105115] Avg episode reward: [(0, '-4.267'), (1, '-4.461')] [2023-12-28 09:10:21,316][106225] Updated weights for policy 1, policy_version 1939458 (0.0013) [2023-12-28 09:10:21,391][106225] Updated weights for policy 1, policy_version 1939468 (0.0008) [2023-12-28 09:10:21,463][106225] Updated weights for policy 1, policy_version 1939478 (0.0008) [2023-12-28 09:10:21,526][106225] Updated weights for policy 1, policy_version 1939488 (0.0008) [2023-12-28 09:10:21,664][106226] Updated weights for policy 0, policy_version 1935369 (0.0010) [2023-12-28 09:10:21,725][106226] Updated weights for policy 0, policy_version 1935379 (0.0011) [2023-12-28 09:10:21,797][106226] Updated weights for policy 0, policy_version 1935389 (0.0015) [2023-12-28 09:10:21,854][106226] Updated weights for policy 0, policy_version 1935399 (0.0010) [2023-12-28 09:10:22,265][106225] Updated weights for policy 1, policy_version 1939498 (0.0007) [2023-12-28 09:10:22,331][106225] Updated weights for policy 1, policy_version 1939508 (0.0008) [2023-12-28 09:10:22,402][106225] Updated weights for policy 1, policy_version 1939518 (0.0009) [2023-12-28 09:10:22,571][106226] Updated weights for policy 0, policy_version 1935409 (0.0008) [2023-12-28 09:10:22,619][106226] Updated weights for policy 0, policy_version 1935419 (0.0008) [2023-12-28 09:10:22,667][106226] Updated weights for policy 0, policy_version 1935429 (0.0005) [2023-12-28 09:10:23,113][106225] Updated weights for policy 1, policy_version 1939528 (0.0009) [2023-12-28 09:10:23,171][106225] Updated weights for policy 1, policy_version 1939538 (0.0007) [2023-12-28 09:10:23,228][106225] Updated weights for policy 1, policy_version 1939548 (0.0009) [2023-12-28 09:10:23,316][106226] Updated weights for policy 0, policy_version 1935439 (0.0006) [2023-12-28 09:10:23,375][106226] Updated weights for policy 0, policy_version 1935449 (0.0005) [2023-12-28 09:10:23,434][106226] Updated weights for policy 0, policy_version 1935459 (0.0005) [2023-12-28 09:10:23,886][106225] Updated weights for policy 1, policy_version 1939558 (0.0009) [2023-12-28 09:10:23,942][106225] Updated weights for policy 1, policy_version 1939568 (0.0007) [2023-12-28 09:10:23,991][106225] Updated weights for policy 1, policy_version 1939578 (0.0005) [2023-12-28 09:10:24,048][106226] Updated weights for policy 0, policy_version 1935469 (0.0006) [2023-12-28 09:10:24,101][106226] Updated weights for policy 0, policy_version 1935479 (0.0007) [2023-12-28 09:10:24,163][106226] Updated weights for policy 0, policy_version 1935489 (0.0008) [2023-12-28 09:10:24,543][106225] Updated weights for policy 1, policy_version 1939588 (0.0006) [2023-12-28 09:10:24,595][106225] Updated weights for policy 1, policy_version 1939598 (0.0006) [2023-12-28 09:10:24,652][106225] Updated weights for policy 1, policy_version 1939608 (0.0011) [2023-12-28 09:10:24,859][106226] Updated weights for policy 0, policy_version 1935499 (0.0009) [2023-12-28 09:10:24,912][106226] Updated weights for policy 0, policy_version 1935509 (0.0010) [2023-12-28 09:10:24,955][106226] Updated weights for policy 0, policy_version 1935519 (0.0010) [2023-12-28 09:10:25,373][106225] Updated weights for policy 1, policy_version 1939618 (0.0010) [2023-12-28 09:10:25,426][106225] Updated weights for policy 1, policy_version 1939628 (0.0009) [2023-12-28 09:10:25,480][106225] Updated weights for policy 1, policy_version 1939638 (0.0009) [2023-12-28 09:10:25,542][106225] Updated weights for policy 1, policy_version 1939648 (0.0008) [2023-12-28 09:10:25,574][106226] Updated weights for policy 0, policy_version 1935529 (0.0010) [2023-12-28 09:10:25,641][106226] Updated weights for policy 0, policy_version 1935539 (0.0010) [2023-12-28 09:10:25,707][106226] Updated weights for policy 0, policy_version 1935549 (0.0011) [2023-12-28 09:10:25,774][106226] Updated weights for policy 0, policy_version 1935559 (0.0011) [2023-12-28 09:10:26,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 992190464. Throughput: 0: 9808.2, 1: 9953.5. Samples: 992159636. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:26,175][105115] Avg episode reward: [(0, '-4.385'), (1, '-4.682')] [2023-12-28 09:10:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001935560_495583232.pth... [2023-12-28 09:10:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001934408_495288320.pth [2023-12-28 09:10:26,215][106225] Updated weights for policy 1, policy_version 1939658 (0.0008) [2023-12-28 09:10:26,271][106225] Updated weights for policy 1, policy_version 1939668 (0.0008) [2023-12-28 09:10:26,323][106225] Updated weights for policy 1, policy_version 1939678 (0.0009) [2023-12-28 09:10:26,330][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001939680_496615424.pth... [2023-12-28 09:10:26,333][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001938496_496312320.pth [2023-12-28 09:10:26,443][106226] Updated weights for policy 0, policy_version 1935569 (0.0006) [2023-12-28 09:10:26,497][106226] Updated weights for policy 0, policy_version 1935579 (0.0005) [2023-12-28 09:10:26,545][106226] Updated weights for policy 0, policy_version 1935589 (0.0006) [2023-12-28 09:10:27,017][106225] Updated weights for policy 1, policy_version 1939688 (0.0006) [2023-12-28 09:10:27,068][106225] Updated weights for policy 1, policy_version 1939698 (0.0005) [2023-12-28 09:10:27,120][106226] Updated weights for policy 0, policy_version 1935599 (0.0007) [2023-12-28 09:10:27,120][106225] Updated weights for policy 1, policy_version 1939708 (0.0005) [2023-12-28 09:10:27,177][106226] Updated weights for policy 0, policy_version 1935609 (0.0007) [2023-12-28 09:10:27,221][106226] Updated weights for policy 0, policy_version 1935619 (0.0008) [2023-12-28 09:10:27,797][106226] Updated weights for policy 0, policy_version 1935629 (0.0007) [2023-12-28 09:10:27,834][106225] Updated weights for policy 1, policy_version 1939718 (0.0008) [2023-12-28 09:10:27,863][106226] Updated weights for policy 0, policy_version 1935639 (0.0005) [2023-12-28 09:10:27,884][106225] Updated weights for policy 1, policy_version 1939728 (0.0008) [2023-12-28 09:10:27,925][106226] Updated weights for policy 0, policy_version 1935649 (0.0006) [2023-12-28 09:10:27,937][106225] Updated weights for policy 1, policy_version 1939738 (0.0008) [2023-12-28 09:10:28,524][106226] Updated weights for policy 0, policy_version 1935659 (0.0007) [2023-12-28 09:10:28,584][106226] Updated weights for policy 0, policy_version 1935669 (0.0011) [2023-12-28 09:10:28,647][106226] Updated weights for policy 0, policy_version 1935679 (0.0007) [2023-12-28 09:10:28,657][106225] Updated weights for policy 1, policy_version 1939748 (0.0008) [2023-12-28 09:10:28,718][106225] Updated weights for policy 1, policy_version 1939758 (0.0008) [2023-12-28 09:10:28,778][106225] Updated weights for policy 1, policy_version 1939768 (0.0006) [2023-12-28 09:10:29,308][106226] Updated weights for policy 0, policy_version 1935689 (0.0007) [2023-12-28 09:10:29,374][106226] Updated weights for policy 0, policy_version 1935699 (0.0011) [2023-12-28 09:10:29,430][106226] Updated weights for policy 0, policy_version 1935709 (0.0010) [2023-12-28 09:10:29,466][106225] Updated weights for policy 1, policy_version 1939778 (0.0005) [2023-12-28 09:10:29,494][106226] Updated weights for policy 0, policy_version 1935719 (0.0011) [2023-12-28 09:10:29,528][106225] Updated weights for policy 1, policy_version 1939788 (0.0007) [2023-12-28 09:10:29,585][106225] Updated weights for policy 1, policy_version 1939798 (0.0008) [2023-12-28 09:10:29,645][106225] Updated weights for policy 1, policy_version 1939808 (0.0007) [2023-12-28 09:10:30,238][106226] Updated weights for policy 0, policy_version 1935729 (0.0011) [2023-12-28 09:10:30,291][106226] Updated weights for policy 0, policy_version 1935739 (0.0010) [2023-12-28 09:10:30,345][106226] Updated weights for policy 0, policy_version 1935749 (0.0011) [2023-12-28 09:10:30,367][106225] Updated weights for policy 1, policy_version 1939818 (0.0010) [2023-12-28 09:10:30,425][106225] Updated weights for policy 1, policy_version 1939828 (0.0008) [2023-12-28 09:10:30,479][106225] Updated weights for policy 1, policy_version 1939838 (0.0007) [2023-12-28 09:10:31,068][106226] Updated weights for policy 0, policy_version 1935759 (0.0009) [2023-12-28 09:10:31,124][106226] Updated weights for policy 0, policy_version 1935769 (0.0011) [2023-12-28 09:10:31,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 992288768. Throughput: 0: 10002.8, 1: 10042.0. Samples: 992284772. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:31,175][105115] Avg episode reward: [(0, '-4.034'), (1, '-4.638')] [2023-12-28 09:10:31,197][106226] Updated weights for policy 0, policy_version 1935779 (0.0010) [2023-12-28 09:10:31,226][106225] Updated weights for policy 1, policy_version 1939848 (0.0006) [2023-12-28 09:10:31,288][106225] Updated weights for policy 1, policy_version 1939858 (0.0007) [2023-12-28 09:10:31,340][106225] Updated weights for policy 1, policy_version 1939868 (0.0006) [2023-12-28 09:10:31,959][106226] Updated weights for policy 0, policy_version 1935789 (0.0008) [2023-12-28 09:10:32,014][106226] Updated weights for policy 0, policy_version 1935799 (0.0005) [2023-12-28 09:10:32,043][106225] Updated weights for policy 1, policy_version 1939878 (0.0008) [2023-12-28 09:10:32,076][106226] Updated weights for policy 0, policy_version 1935809 (0.0006) [2023-12-28 09:10:32,102][106225] Updated weights for policy 1, policy_version 1939888 (0.0008) [2023-12-28 09:10:32,160][106225] Updated weights for policy 1, policy_version 1939898 (0.0008) [2023-12-28 09:10:32,782][106226] Updated weights for policy 0, policy_version 1935819 (0.0007) [2023-12-28 09:10:32,850][106226] Updated weights for policy 0, policy_version 1935829 (0.0010) [2023-12-28 09:10:32,897][106226] Updated weights for policy 0, policy_version 1935839 (0.0011) [2023-12-28 09:10:32,911][106225] Updated weights for policy 1, policy_version 1939908 (0.0008) [2023-12-28 09:10:32,970][106225] Updated weights for policy 1, policy_version 1939918 (0.0006) [2023-12-28 09:10:33,012][106225] Updated weights for policy 1, policy_version 1939928 (0.0007) [2023-12-28 09:10:33,624][106226] Updated weights for policy 0, policy_version 1935849 (0.0010) [2023-12-28 09:10:33,687][106226] Updated weights for policy 0, policy_version 1935859 (0.0011) [2023-12-28 09:10:33,737][106226] Updated weights for policy 0, policy_version 1935869 (0.0010) [2023-12-28 09:10:33,760][106225] Updated weights for policy 1, policy_version 1939938 (0.0007) [2023-12-28 09:10:33,784][106226] Updated weights for policy 0, policy_version 1935879 (0.0010) [2023-12-28 09:10:33,814][106225] Updated weights for policy 1, policy_version 1939948 (0.0008) [2023-12-28 09:10:33,868][106225] Updated weights for policy 1, policy_version 1939958 (0.0008) [2023-12-28 09:10:33,925][106225] Updated weights for policy 1, policy_version 1939968 (0.0008) [2023-12-28 09:10:34,512][106226] Updated weights for policy 0, policy_version 1935889 (0.0009) [2023-12-28 09:10:34,566][106226] Updated weights for policy 0, policy_version 1935899 (0.0011) [2023-12-28 09:10:34,626][106226] Updated weights for policy 0, policy_version 1935909 (0.0011) [2023-12-28 09:10:34,699][106225] Updated weights for policy 1, policy_version 1939978 (0.0008) [2023-12-28 09:10:34,756][106225] Updated weights for policy 1, policy_version 1939988 (0.0008) [2023-12-28 09:10:34,813][106225] Updated weights for policy 1, policy_version 1939998 (0.0008) [2023-12-28 09:10:35,385][106226] Updated weights for policy 0, policy_version 1935919 (0.0009) [2023-12-28 09:10:35,422][106225] Updated weights for policy 1, policy_version 1940008 (0.0006) [2023-12-28 09:10:35,443][106226] Updated weights for policy 0, policy_version 1935929 (0.0006) [2023-12-28 09:10:35,486][106225] Updated weights for policy 1, policy_version 1940018 (0.0005) [2023-12-28 09:10:35,494][106226] Updated weights for policy 0, policy_version 1935939 (0.0005) [2023-12-28 09:10:35,540][106225] Updated weights for policy 1, policy_version 1940028 (0.0005) [2023-12-28 09:10:36,026][106226] Updated weights for policy 0, policy_version 1935949 (0.0005) [2023-12-28 09:10:36,062][106225] Updated weights for policy 1, policy_version 1940038 (0.0006) [2023-12-28 09:10:36,084][106226] Updated weights for policy 0, policy_version 1935959 (0.0007) [2023-12-28 09:10:36,130][106225] Updated weights for policy 1, policy_version 1940048 (0.0008) [2023-12-28 09:10:36,153][106226] Updated weights for policy 0, policy_version 1935969 (0.0007) [2023-12-28 09:10:36,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 992387072. Throughput: 0: 10025.5, 1: 9991.5. Samples: 992404056. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:36,177][105115] Avg episode reward: [(0, '-4.387'), (1, '-4.493')] [2023-12-28 09:10:36,192][106225] Updated weights for policy 1, policy_version 1940058 (0.0007) [2023-12-28 09:10:36,878][106225] Updated weights for policy 1, policy_version 1940068 (0.0008) [2023-12-28 09:10:36,904][106226] Updated weights for policy 0, policy_version 1935979 (0.0008) [2023-12-28 09:10:36,939][106225] Updated weights for policy 1, policy_version 1940078 (0.0010) [2023-12-28 09:10:36,965][106226] Updated weights for policy 0, policy_version 1935989 (0.0009) [2023-12-28 09:10:37,000][106225] Updated weights for policy 1, policy_version 1940088 (0.0011) [2023-12-28 09:10:37,025][106226] Updated weights for policy 0, policy_version 1935999 (0.0008) [2023-12-28 09:10:37,724][106225] Updated weights for policy 1, policy_version 1940098 (0.0010) [2023-12-28 09:10:37,734][106226] Updated weights for policy 0, policy_version 1936009 (0.0006) [2023-12-28 09:10:37,782][106225] Updated weights for policy 1, policy_version 1940108 (0.0010) [2023-12-28 09:10:37,783][106226] Updated weights for policy 0, policy_version 1936019 (0.0006) [2023-12-28 09:10:37,835][106226] Updated weights for policy 0, policy_version 1936029 (0.0007) [2023-12-28 09:10:37,843][106225] Updated weights for policy 1, policy_version 1940118 (0.0010) [2023-12-28 09:10:37,891][106226] Updated weights for policy 0, policy_version 1936039 (0.0009) [2023-12-28 09:10:37,894][106225] Updated weights for policy 1, policy_version 1940128 (0.0010) [2023-12-28 09:10:38,561][106225] Updated weights for policy 1, policy_version 1940138 (0.0006) [2023-12-28 09:10:38,600][106226] Updated weights for policy 0, policy_version 1936049 (0.0008) [2023-12-28 09:10:38,627][106225] Updated weights for policy 1, policy_version 1940148 (0.0009) [2023-12-28 09:10:38,660][106226] Updated weights for policy 0, policy_version 1936059 (0.0007) [2023-12-28 09:10:38,684][106225] Updated weights for policy 1, policy_version 1940158 (0.0010) [2023-12-28 09:10:38,718][106226] Updated weights for policy 0, policy_version 1936069 (0.0007) [2023-12-28 09:10:39,286][106225] Updated weights for policy 1, policy_version 1940168 (0.0009) [2023-12-28 09:10:39,347][106225] Updated weights for policy 1, policy_version 1940178 (0.0006) [2023-12-28 09:10:39,419][106225] Updated weights for policy 1, policy_version 1940188 (0.0013) [2023-12-28 09:10:39,542][106226] Updated weights for policy 0, policy_version 1936079 (0.0009) [2023-12-28 09:10:39,605][106226] Updated weights for policy 0, policy_version 1936089 (0.0009) [2023-12-28 09:10:39,668][106226] Updated weights for policy 0, policy_version 1936099 (0.0009) [2023-12-28 09:10:40,192][106225] Updated weights for policy 1, policy_version 1940198 (0.0008) [2023-12-28 09:10:40,252][106225] Updated weights for policy 1, policy_version 1940208 (0.0009) [2023-12-28 09:10:40,314][106225] Updated weights for policy 1, policy_version 1940218 (0.0008) [2023-12-28 09:10:40,422][106226] Updated weights for policy 0, policy_version 1936109 (0.0008) [2023-12-28 09:10:40,489][106226] Updated weights for policy 0, policy_version 1936119 (0.0011) [2023-12-28 09:10:40,553][106226] Updated weights for policy 0, policy_version 1936129 (0.0011) [2023-12-28 09:10:40,999][106225] Updated weights for policy 1, policy_version 1940228 (0.0008) [2023-12-28 09:10:41,070][106225] Updated weights for policy 1, policy_version 1940238 (0.0007) [2023-12-28 09:10:41,159][106225] Updated weights for policy 1, policy_version 1940248 (0.0008) [2023-12-28 09:10:41,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 992485376. Throughput: 0: 9990.6, 1: 10013.7. Samples: 992463056. Policy #0 lag: (min: 18.0, avg: 31.5, max: 32.0) [2023-12-28 09:10:41,175][105115] Avg episode reward: [(0, '-4.365'), (1, '-4.516')] [2023-12-28 09:10:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001936136_495730688.pth... [2023-12-28 09:10:41,183][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001934984_495435776.pth [2023-12-28 09:10:41,210][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001940256_496762880.pth... [2023-12-28 09:10:41,215][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001939072_496459776.pth [2023-12-28 09:10:41,332][106226] Updated weights for policy 0, policy_version 1936139 (0.0010) [2023-12-28 09:10:41,409][106226] Updated weights for policy 0, policy_version 1936149 (0.0009) [2023-12-28 09:10:41,475][106226] Updated weights for policy 0, policy_version 1936159 (0.0009) [2023-12-28 09:10:41,906][106225] Updated weights for policy 1, policy_version 1940258 (0.0008) [2023-12-28 09:10:41,963][106225] Updated weights for policy 1, policy_version 1940268 (0.0007) [2023-12-28 09:10:42,018][106225] Updated weights for policy 1, policy_version 1940278 (0.0008) [2023-12-28 09:10:42,072][106225] Updated weights for policy 1, policy_version 1940288 (0.0008) [2023-12-28 09:10:42,224][106226] Updated weights for policy 0, policy_version 1936169 (0.0008) [2023-12-28 09:10:42,292][106226] Updated weights for policy 0, policy_version 1936179 (0.0007) [2023-12-28 09:10:42,358][106226] Updated weights for policy 0, policy_version 1936189 (0.0007) [2023-12-28 09:10:42,430][106226] Updated weights for policy 0, policy_version 1936199 (0.0009) [2023-12-28 09:10:42,747][106225] Updated weights for policy 1, policy_version 1940298 (0.0010) [2023-12-28 09:10:42,800][106225] Updated weights for policy 1, policy_version 1940308 (0.0010) [2023-12-28 09:10:42,851][106225] Updated weights for policy 1, policy_version 1940318 (0.0010) [2023-12-28 09:10:43,160][106226] Updated weights for policy 0, policy_version 1936209 (0.0006) [2023-12-28 09:10:43,227][106226] Updated weights for policy 0, policy_version 1936219 (0.0005) [2023-12-28 09:10:43,288][106226] Updated weights for policy 0, policy_version 1936229 (0.0005) [2023-12-28 09:10:43,554][106225] Updated weights for policy 1, policy_version 1940328 (0.0010) [2023-12-28 09:10:43,604][106225] Updated weights for policy 1, policy_version 1940338 (0.0010) [2023-12-28 09:10:43,657][106225] Updated weights for policy 1, policy_version 1940348 (0.0010) [2023-12-28 09:10:43,919][106226] Updated weights for policy 0, policy_version 1936239 (0.0009) [2023-12-28 09:10:43,976][106226] Updated weights for policy 0, policy_version 1936249 (0.0010) [2023-12-28 09:10:44,029][106226] Updated weights for policy 0, policy_version 1936259 (0.0010) [2023-12-28 09:10:44,287][106225] Updated weights for policy 1, policy_version 1940358 (0.0007) [2023-12-28 09:10:44,352][106225] Updated weights for policy 1, policy_version 1940368 (0.0006) [2023-12-28 09:10:44,420][106225] Updated weights for policy 1, policy_version 1940378 (0.0006) [2023-12-28 09:10:44,610][106226] Updated weights for policy 0, policy_version 1936269 (0.0010) [2023-12-28 09:10:44,673][106226] Updated weights for policy 0, policy_version 1936279 (0.0010) [2023-12-28 09:10:44,737][106226] Updated weights for policy 0, policy_version 1936289 (0.0009) [2023-12-28 09:10:44,988][106225] Updated weights for policy 1, policy_version 1940388 (0.0007) [2023-12-28 09:10:45,041][106225] Updated weights for policy 1, policy_version 1940398 (0.0008) [2023-12-28 09:10:45,105][106225] Updated weights for policy 1, policy_version 1940408 (0.0008) [2023-12-28 09:10:45,458][106226] Updated weights for policy 0, policy_version 1936299 (0.0009) [2023-12-28 09:10:45,528][106226] Updated weights for policy 0, policy_version 1936309 (0.0008) [2023-12-28 09:10:45,580][106226] Updated weights for policy 0, policy_version 1936319 (0.0007) [2023-12-28 09:10:45,708][106225] Updated weights for policy 1, policy_version 1940418 (0.0008) [2023-12-28 09:10:45,764][106225] Updated weights for policy 1, policy_version 1940428 (0.0009) [2023-12-28 09:10:45,823][106225] Updated weights for policy 1, policy_version 1940438 (0.0008) [2023-12-28 09:10:45,875][106225] Updated weights for policy 1, policy_version 1940448 (0.0006) [2023-12-28 09:10:46,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19827.4). Total num frames: 992591872. Throughput: 0: 10032.1, 1: 9995.9. Samples: 992581296. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:10:46,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.795')] [2023-12-28 09:10:46,292][106226] Updated weights for policy 0, policy_version 1936329 (0.0008) [2023-12-28 09:10:46,355][106226] Updated weights for policy 0, policy_version 1936339 (0.0010) [2023-12-28 09:10:46,417][106226] Updated weights for policy 0, policy_version 1936349 (0.0009) [2023-12-28 09:10:46,474][106226] Updated weights for policy 0, policy_version 1936359 (0.0006) [2023-12-28 09:10:46,477][106225] Updated weights for policy 1, policy_version 1940458 (0.0010) [2023-12-28 09:10:46,538][106225] Updated weights for policy 1, policy_version 1940468 (0.0010) [2023-12-28 09:10:46,600][106225] Updated weights for policy 1, policy_version 1940478 (0.0008) [2023-12-28 09:10:47,171][106226] Updated weights for policy 0, policy_version 1936369 (0.0009) [2023-12-28 09:10:47,229][106226] Updated weights for policy 0, policy_version 1936379 (0.0011) [2023-12-28 09:10:47,290][106226] Updated weights for policy 0, policy_version 1936389 (0.0010) [2023-12-28 09:10:47,320][106225] Updated weights for policy 1, policy_version 1940488 (0.0006) [2023-12-28 09:10:47,376][106225] Updated weights for policy 1, policy_version 1940498 (0.0007) [2023-12-28 09:10:47,445][106225] Updated weights for policy 1, policy_version 1940508 (0.0005) [2023-12-28 09:10:47,998][106226] Updated weights for policy 0, policy_version 1936399 (0.0011) [2023-12-28 09:10:48,065][106226] Updated weights for policy 0, policy_version 1936409 (0.0010) [2023-12-28 09:10:48,102][106225] Updated weights for policy 1, policy_version 1940518 (0.0005) [2023-12-28 09:10:48,126][106226] Updated weights for policy 0, policy_version 1936419 (0.0011) [2023-12-28 09:10:48,153][106225] Updated weights for policy 1, policy_version 1940528 (0.0007) [2023-12-28 09:10:48,206][106225] Updated weights for policy 1, policy_version 1940538 (0.0008) [2023-12-28 09:10:48,875][106226] Updated weights for policy 0, policy_version 1936429 (0.0011) [2023-12-28 09:10:48,932][106226] Updated weights for policy 0, policy_version 1936439 (0.0009) [2023-12-28 09:10:48,954][106225] Updated weights for policy 1, policy_version 1940548 (0.0008) [2023-12-28 09:10:48,988][106226] Updated weights for policy 0, policy_version 1936449 (0.0006) [2023-12-28 09:10:49,012][106225] Updated weights for policy 1, policy_version 1940558 (0.0007) [2023-12-28 09:10:49,066][106225] Updated weights for policy 1, policy_version 1940568 (0.0008) [2023-12-28 09:10:49,671][106226] Updated weights for policy 0, policy_version 1936459 (0.0006) [2023-12-28 09:10:49,733][106226] Updated weights for policy 0, policy_version 1936469 (0.0006) [2023-12-28 09:10:49,783][106226] Updated weights for policy 0, policy_version 1936479 (0.0006) [2023-12-28 09:10:49,802][106225] Updated weights for policy 1, policy_version 1940578 (0.0009) [2023-12-28 09:10:49,870][106225] Updated weights for policy 1, policy_version 1940588 (0.0010) [2023-12-28 09:10:49,926][106225] Updated weights for policy 1, policy_version 1940598 (0.0006) [2023-12-28 09:10:49,999][106225] Updated weights for policy 1, policy_version 1940608 (0.0009) [2023-12-28 09:10:50,504][106226] Updated weights for policy 0, policy_version 1936489 (0.0007) [2023-12-28 09:10:50,565][106226] Updated weights for policy 0, policy_version 1936499 (0.0009) [2023-12-28 09:10:50,627][106226] Updated weights for policy 0, policy_version 1936509 (0.0008) [2023-12-28 09:10:50,657][106225] Updated weights for policy 1, policy_version 1940618 (0.0009) [2023-12-28 09:10:50,690][106226] Updated weights for policy 0, policy_version 1936519 (0.0008) [2023-12-28 09:10:50,717][106225] Updated weights for policy 1, policy_version 1940628 (0.0010) [2023-12-28 09:10:50,782][106225] Updated weights for policy 1, policy_version 1940638 (0.0010) [2023-12-28 09:10:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 992690176. Throughput: 0: 9930.0, 1: 10062.0. Samples: 992700140. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:10:51,175][105115] Avg episode reward: [(0, '-4.576'), (1, '-4.866')] [2023-12-28 09:10:51,419][106226] Updated weights for policy 0, policy_version 1936529 (0.0008) [2023-12-28 09:10:51,469][106226] Updated weights for policy 0, policy_version 1936539 (0.0008) [2023-12-28 09:10:51,516][106226] Updated weights for policy 0, policy_version 1936549 (0.0005) [2023-12-28 09:10:51,549][106225] Updated weights for policy 1, policy_version 1940648 (0.0008) [2023-12-28 09:10:51,607][106225] Updated weights for policy 1, policy_version 1940658 (0.0007) [2023-12-28 09:10:51,673][106225] Updated weights for policy 1, policy_version 1940668 (0.0010) [2023-12-28 09:10:52,295][106226] Updated weights for policy 0, policy_version 1936559 (0.0011) [2023-12-28 09:10:52,356][106226] Updated weights for policy 0, policy_version 1936569 (0.0011) [2023-12-28 09:10:52,420][106226] Updated weights for policy 0, policy_version 1936579 (0.0009) [2023-12-28 09:10:52,467][106225] Updated weights for policy 1, policy_version 1940678 (0.0008) [2023-12-28 09:10:52,530][106225] Updated weights for policy 1, policy_version 1940688 (0.0009) [2023-12-28 09:10:52,583][106225] Updated weights for policy 1, policy_version 1940698 (0.0008) [2023-12-28 09:10:53,085][106226] Updated weights for policy 0, policy_version 1936589 (0.0006) [2023-12-28 09:10:53,154][106226] Updated weights for policy 0, policy_version 1936599 (0.0005) [2023-12-28 09:10:53,206][106226] Updated weights for policy 0, policy_version 1936609 (0.0005) [2023-12-28 09:10:53,340][106225] Updated weights for policy 1, policy_version 1940708 (0.0008) [2023-12-28 09:10:53,399][106225] Updated weights for policy 1, policy_version 1940718 (0.0005) [2023-12-28 09:10:53,453][106225] Updated weights for policy 1, policy_version 1940728 (0.0006) [2023-12-28 09:10:53,814][106226] Updated weights for policy 0, policy_version 1936619 (0.0007) [2023-12-28 09:10:53,882][106226] Updated weights for policy 0, policy_version 1936629 (0.0005) [2023-12-28 09:10:53,930][106226] Updated weights for policy 0, policy_version 1936639 (0.0005) [2023-12-28 09:10:54,056][106225] Updated weights for policy 1, policy_version 1940738 (0.0008) [2023-12-28 09:10:54,112][106225] Updated weights for policy 1, policy_version 1940748 (0.0009) [2023-12-28 09:10:54,169][106225] Updated weights for policy 1, policy_version 1940758 (0.0009) [2023-12-28 09:10:54,219][106225] Updated weights for policy 1, policy_version 1940768 (0.0009) [2023-12-28 09:10:54,521][106226] Updated weights for policy 0, policy_version 1936649 (0.0006) [2023-12-28 09:10:54,581][106226] Updated weights for policy 0, policy_version 1936659 (0.0008) [2023-12-28 09:10:54,637][106226] Updated weights for policy 0, policy_version 1936669 (0.0009) [2023-12-28 09:10:54,690][106226] Updated weights for policy 0, policy_version 1936679 (0.0009) [2023-12-28 09:10:54,930][106225] Updated weights for policy 1, policy_version 1940778 (0.0007) [2023-12-28 09:10:54,977][106225] Updated weights for policy 1, policy_version 1940788 (0.0005) [2023-12-28 09:10:55,032][106225] Updated weights for policy 1, policy_version 1940798 (0.0006) [2023-12-28 09:10:55,488][106226] Updated weights for policy 0, policy_version 1936689 (0.0008) [2023-12-28 09:10:55,548][106226] Updated weights for policy 0, policy_version 1936699 (0.0009) [2023-12-28 09:10:55,593][106225] Updated weights for policy 1, policy_version 1940808 (0.0006) [2023-12-28 09:10:55,607][106226] Updated weights for policy 0, policy_version 1936709 (0.0008) [2023-12-28 09:10:55,646][106225] Updated weights for policy 1, policy_version 1940818 (0.0008) [2023-12-28 09:10:55,704][106225] Updated weights for policy 1, policy_version 1940828 (0.0008) [2023-12-28 09:10:56,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 992788480. Throughput: 0: 9930.4, 1: 10050.8. Samples: 992759236. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:10:56,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-4.841')] [2023-12-28 09:10:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001936712_495878144.pth... [2023-12-28 09:10:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001940832_496910336.pth... [2023-12-28 09:10:56,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001935560_495583232.pth [2023-12-28 09:10:56,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001939680_496615424.pth [2023-12-28 09:10:56,360][106225] Updated weights for policy 1, policy_version 1940838 (0.0006) [2023-12-28 09:10:56,361][106226] Updated weights for policy 0, policy_version 1936719 (0.0009) [2023-12-28 09:10:56,412][106226] Updated weights for policy 0, policy_version 1936729 (0.0008) [2023-12-28 09:10:56,416][106225] Updated weights for policy 1, policy_version 1940848 (0.0005) [2023-12-28 09:10:56,470][106226] Updated weights for policy 0, policy_version 1936739 (0.0009) [2023-12-28 09:10:56,471][106225] Updated weights for policy 1, policy_version 1940858 (0.0006) [2023-12-28 09:10:57,141][106226] Updated weights for policy 0, policy_version 1936749 (0.0008) [2023-12-28 09:10:57,198][106226] Updated weights for policy 0, policy_version 1936759 (0.0008) [2023-12-28 09:10:57,211][106225] Updated weights for policy 1, policy_version 1940868 (0.0008) [2023-12-28 09:10:57,256][106226] Updated weights for policy 0, policy_version 1936769 (0.0007) [2023-12-28 09:10:57,269][106225] Updated weights for policy 1, policy_version 1940878 (0.0007) [2023-12-28 09:10:57,335][106225] Updated weights for policy 1, policy_version 1940888 (0.0007) [2023-12-28 09:10:57,908][106225] Updated weights for policy 1, policy_version 1940898 (0.0007) [2023-12-28 09:10:57,968][106225] Updated weights for policy 1, policy_version 1940908 (0.0009) [2023-12-28 09:10:58,011][106226] Updated weights for policy 0, policy_version 1936779 (0.0007) [2023-12-28 09:10:58,030][106225] Updated weights for policy 1, policy_version 1940918 (0.0008) [2023-12-28 09:10:58,063][106226] Updated weights for policy 0, policy_version 1936789 (0.0005) [2023-12-28 09:10:58,093][106225] Updated weights for policy 1, policy_version 1940928 (0.0008) [2023-12-28 09:10:58,125][106226] Updated weights for policy 0, policy_version 1936799 (0.0006) [2023-12-28 09:10:58,809][106226] Updated weights for policy 0, policy_version 1936809 (0.0006) [2023-12-28 09:10:58,863][106225] Updated weights for policy 1, policy_version 1940938 (0.0007) [2023-12-28 09:10:58,890][106226] Updated weights for policy 0, policy_version 1936819 (0.0008) [2023-12-28 09:10:58,942][106225] Updated weights for policy 1, policy_version 1940948 (0.0008) [2023-12-28 09:10:58,958][106226] Updated weights for policy 0, policy_version 1936829 (0.0007) [2023-12-28 09:10:59,004][106225] Updated weights for policy 1, policy_version 1940958 (0.0009) [2023-12-28 09:10:59,010][106226] Updated weights for policy 0, policy_version 1936839 (0.0006) [2023-12-28 09:10:59,734][106225] Updated weights for policy 1, policy_version 1940968 (0.0008) [2023-12-28 09:10:59,782][106225] Updated weights for policy 1, policy_version 1940978 (0.0006) [2023-12-28 09:10:59,815][106226] Updated weights for policy 0, policy_version 1936849 (0.0009) [2023-12-28 09:10:59,847][106225] Updated weights for policy 1, policy_version 1940988 (0.0008) [2023-12-28 09:10:59,876][106226] Updated weights for policy 0, policy_version 1936859 (0.0008) [2023-12-28 09:10:59,942][106226] Updated weights for policy 0, policy_version 1936869 (0.0008) [2023-12-28 09:11:00,553][106225] Updated weights for policy 1, policy_version 1940998 (0.0008) [2023-12-28 09:11:00,608][106225] Updated weights for policy 1, policy_version 1941008 (0.0006) [2023-12-28 09:11:00,621][106226] Updated weights for policy 0, policy_version 1936879 (0.0008) [2023-12-28 09:11:00,661][106225] Updated weights for policy 1, policy_version 1941018 (0.0006) [2023-12-28 09:11:00,681][106226] Updated weights for policy 0, policy_version 1936889 (0.0007) [2023-12-28 09:11:00,730][106226] Updated weights for policy 0, policy_version 1936899 (0.0009) [2023-12-28 09:11:01,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 992886784. Throughput: 0: 9853.5, 1: 10056.3. Samples: 992876668. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:01,175][105115] Avg episode reward: [(0, '-4.101'), (1, '-4.573')] [2023-12-28 09:11:01,403][106226] Updated weights for policy 0, policy_version 1936909 (0.0010) [2023-12-28 09:11:01,417][106225] Updated weights for policy 1, policy_version 1941028 (0.0007) [2023-12-28 09:11:01,463][106226] Updated weights for policy 0, policy_version 1936919 (0.0006) [2023-12-28 09:11:01,474][106225] Updated weights for policy 1, policy_version 1941038 (0.0008) [2023-12-28 09:11:01,532][106226] Updated weights for policy 0, policy_version 1936929 (0.0005) [2023-12-28 09:11:01,538][106225] Updated weights for policy 1, policy_version 1941048 (0.0008) [2023-12-28 09:11:02,241][106226] Updated weights for policy 0, policy_version 1936939 (0.0008) [2023-12-28 09:11:02,275][106225] Updated weights for policy 1, policy_version 1941058 (0.0006) [2023-12-28 09:11:02,313][106226] Updated weights for policy 0, policy_version 1936949 (0.0008) [2023-12-28 09:11:02,346][106225] Updated weights for policy 1, policy_version 1941068 (0.0008) [2023-12-28 09:11:02,380][106226] Updated weights for policy 0, policy_version 1936959 (0.0009) [2023-12-28 09:11:02,435][106225] Updated weights for policy 1, policy_version 1941078 (0.0008) [2023-12-28 09:11:02,492][106225] Updated weights for policy 1, policy_version 1941088 (0.0008) [2023-12-28 09:11:03,071][106226] Updated weights for policy 0, policy_version 1936969 (0.0007) [2023-12-28 09:11:03,122][106226] Updated weights for policy 0, policy_version 1936979 (0.0008) [2023-12-28 09:11:03,181][106226] Updated weights for policy 0, policy_version 1936989 (0.0007) [2023-12-28 09:11:03,187][106225] Updated weights for policy 1, policy_version 1941098 (0.0006) [2023-12-28 09:11:03,229][106226] Updated weights for policy 0, policy_version 1936999 (0.0007) [2023-12-28 09:11:03,236][106225] Updated weights for policy 1, policy_version 1941108 (0.0006) [2023-12-28 09:11:03,287][106225] Updated weights for policy 1, policy_version 1941118 (0.0008) [2023-12-28 09:11:03,918][106226] Updated weights for policy 0, policy_version 1937009 (0.0009) [2023-12-28 09:11:03,979][106226] Updated weights for policy 0, policy_version 1937019 (0.0009) [2023-12-28 09:11:03,996][106225] Updated weights for policy 1, policy_version 1941128 (0.0006) [2023-12-28 09:11:04,041][106226] Updated weights for policy 0, policy_version 1937029 (0.0006) [2023-12-28 09:11:04,057][106225] Updated weights for policy 1, policy_version 1941138 (0.0007) [2023-12-28 09:11:04,118][106225] Updated weights for policy 1, policy_version 1941148 (0.0007) [2023-12-28 09:11:04,747][106226] Updated weights for policy 0, policy_version 1937039 (0.0009) [2023-12-28 09:11:04,803][106225] Updated weights for policy 1, policy_version 1941158 (0.0007) [2023-12-28 09:11:04,810][106226] Updated weights for policy 0, policy_version 1937049 (0.0009) [2023-12-28 09:11:04,850][106225] Updated weights for policy 1, policy_version 1941168 (0.0007) [2023-12-28 09:11:04,868][106226] Updated weights for policy 0, policy_version 1937059 (0.0006) [2023-12-28 09:11:04,910][106225] Updated weights for policy 1, policy_version 1941178 (0.0008) [2023-12-28 09:11:05,555][106226] Updated weights for policy 0, policy_version 1937069 (0.0007) [2023-12-28 09:11:05,610][106226] Updated weights for policy 0, policy_version 1937079 (0.0008) [2023-12-28 09:11:05,620][106225] Updated weights for policy 1, policy_version 1941188 (0.0008) [2023-12-28 09:11:05,659][106226] Updated weights for policy 0, policy_version 1937089 (0.0008) [2023-12-28 09:11:05,690][106225] Updated weights for policy 1, policy_version 1941198 (0.0005) [2023-12-28 09:11:05,740][106225] Updated weights for policy 1, policy_version 1941208 (0.0005) [2023-12-28 09:11:06,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.8, 300 sec: 19799.6). Total num frames: 992985088. Throughput: 0: 9890.9, 1: 9985.4. Samples: 992995300. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:06,175][105115] Avg episode reward: [(0, '-4.091'), (1, '-4.597')] [2023-12-28 09:11:06,318][106226] Updated weights for policy 0, policy_version 1937099 (0.0009) [2023-12-28 09:11:06,376][106226] Updated weights for policy 0, policy_version 1937109 (0.0011) [2023-12-28 09:11:06,434][106226] Updated weights for policy 0, policy_version 1937119 (0.0011) [2023-12-28 09:11:06,448][106225] Updated weights for policy 1, policy_version 1941218 (0.0007) [2023-12-28 09:11:06,508][106225] Updated weights for policy 1, policy_version 1941228 (0.0006) [2023-12-28 09:11:06,574][106225] Updated weights for policy 1, policy_version 1941238 (0.0008) [2023-12-28 09:11:06,631][106225] Updated weights for policy 1, policy_version 1941248 (0.0008) [2023-12-28 09:11:07,157][106226] Updated weights for policy 0, policy_version 1937129 (0.0011) [2023-12-28 09:11:07,222][106226] Updated weights for policy 0, policy_version 1937139 (0.0011) [2023-12-28 09:11:07,284][106226] Updated weights for policy 0, policy_version 1937149 (0.0011) [2023-12-28 09:11:07,298][106225] Updated weights for policy 1, policy_version 1941258 (0.0006) [2023-12-28 09:11:07,342][106226] Updated weights for policy 0, policy_version 1937159 (0.0011) [2023-12-28 09:11:07,345][106225] Updated weights for policy 1, policy_version 1941268 (0.0006) [2023-12-28 09:11:07,406][106225] Updated weights for policy 1, policy_version 1941278 (0.0007) [2023-12-28 09:11:08,039][106226] Updated weights for policy 0, policy_version 1937169 (0.0006) [2023-12-28 09:11:08,042][106225] Updated weights for policy 1, policy_version 1941288 (0.0006) [2023-12-28 09:11:08,098][106226] Updated weights for policy 0, policy_version 1937179 (0.0005) [2023-12-28 09:11:08,099][106225] Updated weights for policy 1, policy_version 1941298 (0.0008) [2023-12-28 09:11:08,156][106225] Updated weights for policy 1, policy_version 1941308 (0.0008) [2023-12-28 09:11:08,157][106226] Updated weights for policy 0, policy_version 1937189 (0.0005) [2023-12-28 09:11:08,694][106226] Updated weights for policy 0, policy_version 1937199 (0.0009) [2023-12-28 09:11:08,751][106226] Updated weights for policy 0, policy_version 1937209 (0.0011) [2023-12-28 09:11:08,805][106226] Updated weights for policy 0, policy_version 1937219 (0.0010) [2023-12-28 09:11:08,881][106225] Updated weights for policy 1, policy_version 1941318 (0.0007) [2023-12-28 09:11:08,941][106225] Updated weights for policy 1, policy_version 1941328 (0.0005) [2023-12-28 09:11:08,990][106225] Updated weights for policy 1, policy_version 1941338 (0.0005) [2023-12-28 09:11:09,537][106226] Updated weights for policy 0, policy_version 1937229 (0.0008) [2023-12-28 09:11:09,596][106226] Updated weights for policy 0, policy_version 1937239 (0.0008) [2023-12-28 09:11:09,649][106226] Updated weights for policy 0, policy_version 1937249 (0.0008) [2023-12-28 09:11:09,773][106225] Updated weights for policy 1, policy_version 1941348 (0.0007) [2023-12-28 09:11:09,830][106225] Updated weights for policy 1, policy_version 1941358 (0.0009) [2023-12-28 09:11:09,894][106225] Updated weights for policy 1, policy_version 1941368 (0.0009) [2023-12-28 09:11:10,385][106226] Updated weights for policy 0, policy_version 1937259 (0.0008) [2023-12-28 09:11:10,454][106226] Updated weights for policy 0, policy_version 1937269 (0.0008) [2023-12-28 09:11:10,515][106226] Updated weights for policy 0, policy_version 1937279 (0.0009) [2023-12-28 09:11:10,679][106225] Updated weights for policy 1, policy_version 1941378 (0.0007) [2023-12-28 09:11:10,742][106225] Updated weights for policy 1, policy_version 1941388 (0.0007) [2023-12-28 09:11:10,810][106225] Updated weights for policy 1, policy_version 1941398 (0.0007) [2023-12-28 09:11:10,872][106225] Updated weights for policy 1, policy_version 1941408 (0.0006) [2023-12-28 09:11:11,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 993083392. Throughput: 0: 9911.2, 1: 10010.7. Samples: 993056124. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:11,175][105115] Avg episode reward: [(0, '-4.274'), (1, '-4.226')] [2023-12-28 09:11:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001941408_497057792.pth... [2023-12-28 09:11:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001937288_496025600.pth... [2023-12-28 09:11:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001940256_496762880.pth [2023-12-28 09:11:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001936136_495730688.pth [2023-12-28 09:11:11,262][106226] Updated weights for policy 0, policy_version 1937289 (0.0008) [2023-12-28 09:11:11,326][106226] Updated weights for policy 0, policy_version 1937299 (0.0007) [2023-12-28 09:11:11,392][106226] Updated weights for policy 0, policy_version 1937309 (0.0008) [2023-12-28 09:11:11,454][106226] Updated weights for policy 0, policy_version 1937319 (0.0008) [2023-12-28 09:11:11,580][106225] Updated weights for policy 1, policy_version 1941418 (0.0009) [2023-12-28 09:11:11,640][106225] Updated weights for policy 1, policy_version 1941428 (0.0009) [2023-12-28 09:11:11,709][106225] Updated weights for policy 1, policy_version 1941438 (0.0009) [2023-12-28 09:11:12,226][106226] Updated weights for policy 0, policy_version 1937329 (0.0010) [2023-12-28 09:11:12,284][106226] Updated weights for policy 0, policy_version 1937339 (0.0009) [2023-12-28 09:11:12,348][106226] Updated weights for policy 0, policy_version 1937349 (0.0009) [2023-12-28 09:11:12,491][106225] Updated weights for policy 1, policy_version 1941448 (0.0008) [2023-12-28 09:11:12,550][106225] Updated weights for policy 1, policy_version 1941458 (0.0008) [2023-12-28 09:11:12,614][106225] Updated weights for policy 1, policy_version 1941468 (0.0009) [2023-12-28 09:11:13,098][106226] Updated weights for policy 0, policy_version 1937359 (0.0009) [2023-12-28 09:11:13,159][106226] Updated weights for policy 0, policy_version 1937369 (0.0009) [2023-12-28 09:11:13,225][106226] Updated weights for policy 0, policy_version 1937379 (0.0008) [2023-12-28 09:11:13,341][106225] Updated weights for policy 1, policy_version 1941478 (0.0008) [2023-12-28 09:11:13,388][106225] Updated weights for policy 1, policy_version 1941488 (0.0009) [2023-12-28 09:11:13,437][106225] Updated weights for policy 1, policy_version 1941498 (0.0008) [2023-12-28 09:11:13,901][106226] Updated weights for policy 0, policy_version 1937389 (0.0007) [2023-12-28 09:11:13,956][106226] Updated weights for policy 0, policy_version 1937399 (0.0008) [2023-12-28 09:11:14,014][106226] Updated weights for policy 0, policy_version 1937409 (0.0008) [2023-12-28 09:11:14,180][106225] Updated weights for policy 1, policy_version 1941508 (0.0008) [2023-12-28 09:11:14,235][106225] Updated weights for policy 1, policy_version 1941518 (0.0008) [2023-12-28 09:11:14,285][106225] Updated weights for policy 1, policy_version 1941528 (0.0006) [2023-12-28 09:11:14,732][106226] Updated weights for policy 0, policy_version 1937419 (0.0008) [2023-12-28 09:11:14,798][106226] Updated weights for policy 0, policy_version 1937429 (0.0008) [2023-12-28 09:11:14,857][106226] Updated weights for policy 0, policy_version 1937439 (0.0008) [2023-12-28 09:11:14,999][106225] Updated weights for policy 1, policy_version 1941538 (0.0008) [2023-12-28 09:11:15,059][106225] Updated weights for policy 1, policy_version 1941548 (0.0006) [2023-12-28 09:11:15,121][106225] Updated weights for policy 1, policy_version 1941558 (0.0007) [2023-12-28 09:11:15,186][106225] Updated weights for policy 1, policy_version 1941568 (0.0006) [2023-12-28 09:11:15,697][106226] Updated weights for policy 0, policy_version 1937449 (0.0009) [2023-12-28 09:11:15,736][106225] Updated weights for policy 1, policy_version 1941578 (0.0006) [2023-12-28 09:11:15,753][106226] Updated weights for policy 0, policy_version 1937459 (0.0008) [2023-12-28 09:11:15,783][106225] Updated weights for policy 1, policy_version 1941588 (0.0007) [2023-12-28 09:11:15,809][106226] Updated weights for policy 0, policy_version 1937469 (0.0008) [2023-12-28 09:11:15,827][106225] Updated weights for policy 1, policy_version 1941598 (0.0007) [2023-12-28 09:11:15,858][106226] Updated weights for policy 0, policy_version 1937479 (0.0006) [2023-12-28 09:11:16,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.4, 300 sec: 19799.7). Total num frames: 993181696. Throughput: 0: 9745.8, 1: 9902.1. Samples: 993168924. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:16,175][105115] Avg episode reward: [(0, '-4.280'), (1, '-4.599')] [2023-12-28 09:11:16,547][106225] Updated weights for policy 1, policy_version 1941608 (0.0009) [2023-12-28 09:11:16,592][106226] Updated weights for policy 0, policy_version 1937489 (0.0005) [2023-12-28 09:11:16,600][106225] Updated weights for policy 1, policy_version 1941618 (0.0010) [2023-12-28 09:11:16,646][106226] Updated weights for policy 0, policy_version 1937499 (0.0007) [2023-12-28 09:11:16,652][106225] Updated weights for policy 1, policy_version 1941628 (0.0006) [2023-12-28 09:11:16,703][106226] Updated weights for policy 0, policy_version 1937509 (0.0006) [2023-12-28 09:11:17,287][106226] Updated weights for policy 0, policy_version 1937519 (0.0011) [2023-12-28 09:11:17,357][106226] Updated weights for policy 0, policy_version 1937529 (0.0009) [2023-12-28 09:11:17,430][106226] Updated weights for policy 0, policy_version 1937539 (0.0008) [2023-12-28 09:11:17,435][106225] Updated weights for policy 1, policy_version 1941638 (0.0008) [2023-12-28 09:11:17,505][106225] Updated weights for policy 1, policy_version 1941648 (0.0009) [2023-12-28 09:11:17,567][106225] Updated weights for policy 1, policy_version 1941658 (0.0008) [2023-12-28 09:11:18,165][106226] Updated weights for policy 0, policy_version 1937549 (0.0008) [2023-12-28 09:11:18,224][106226] Updated weights for policy 0, policy_version 1937559 (0.0009) [2023-12-28 09:11:18,258][106225] Updated weights for policy 1, policy_version 1941668 (0.0007) [2023-12-28 09:11:18,280][106226] Updated weights for policy 0, policy_version 1937569 (0.0008) [2023-12-28 09:11:18,315][106225] Updated weights for policy 1, policy_version 1941678 (0.0008) [2023-12-28 09:11:18,381][106225] Updated weights for policy 1, policy_version 1941688 (0.0009) [2023-12-28 09:11:19,035][106225] Updated weights for policy 1, policy_version 1941698 (0.0009) [2023-12-28 09:11:19,093][106225] Updated weights for policy 1, policy_version 1941708 (0.0008) [2023-12-28 09:11:19,099][106226] Updated weights for policy 0, policy_version 1937579 (0.0006) [2023-12-28 09:11:19,155][106225] Updated weights for policy 1, policy_version 1941718 (0.0008) [2023-12-28 09:11:19,158][106226] Updated weights for policy 0, policy_version 1937589 (0.0005) [2023-12-28 09:11:19,214][106226] Updated weights for policy 0, policy_version 1937599 (0.0006) [2023-12-28 09:11:19,215][106225] Updated weights for policy 1, policy_version 1941728 (0.0008) [2023-12-28 09:11:19,928][106226] Updated weights for policy 0, policy_version 1937609 (0.0008) [2023-12-28 09:11:19,997][106226] Updated weights for policy 0, policy_version 1937619 (0.0007) [2023-12-28 09:11:20,013][106225] Updated weights for policy 1, policy_version 1941738 (0.0009) [2023-12-28 09:11:20,064][106225] Updated weights for policy 1, policy_version 1941748 (0.0010) [2023-12-28 09:11:20,065][106226] Updated weights for policy 0, policy_version 1937629 (0.0006) [2023-12-28 09:11:20,120][106225] Updated weights for policy 1, policy_version 1941758 (0.0010) [2023-12-28 09:11:20,131][106226] Updated weights for policy 0, policy_version 1937639 (0.0009) [2023-12-28 09:11:20,752][106226] Updated weights for policy 0, policy_version 1937649 (0.0009) [2023-12-28 09:11:20,825][106226] Updated weights for policy 0, policy_version 1937659 (0.0010) [2023-12-28 09:11:20,888][106225] Updated weights for policy 1, policy_version 1941768 (0.0010) [2023-12-28 09:11:20,890][106226] Updated weights for policy 0, policy_version 1937669 (0.0011) [2023-12-28 09:11:20,952][106225] Updated weights for policy 1, policy_version 1941778 (0.0010) [2023-12-28 09:11:21,014][106225] Updated weights for policy 1, policy_version 1941788 (0.0007) [2023-12-28 09:11:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 993280000. Throughput: 0: 9710.9, 1: 9895.2. Samples: 993286328. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:21,175][105115] Avg episode reward: [(0, '-4.049'), (1, '-4.749')] [2023-12-28 09:11:21,667][106226] Updated weights for policy 0, policy_version 1937679 (0.0009) [2023-12-28 09:11:21,730][106226] Updated weights for policy 0, policy_version 1937689 (0.0009) [2023-12-28 09:11:21,741][106225] Updated weights for policy 1, policy_version 1941798 (0.0010) [2023-12-28 09:11:21,792][106226] Updated weights for policy 0, policy_version 1937699 (0.0009) [2023-12-28 09:11:21,793][106225] Updated weights for policy 1, policy_version 1941808 (0.0009) [2023-12-28 09:11:21,846][106225] Updated weights for policy 1, policy_version 1941818 (0.0009) [2023-12-28 09:11:22,573][106226] Updated weights for policy 0, policy_version 1937709 (0.0010) [2023-12-28 09:11:22,602][106225] Updated weights for policy 1, policy_version 1941828 (0.0008) [2023-12-28 09:11:22,631][106226] Updated weights for policy 0, policy_version 1937719 (0.0011) [2023-12-28 09:11:22,666][106225] Updated weights for policy 1, policy_version 1941838 (0.0007) [2023-12-28 09:11:22,693][106226] Updated weights for policy 0, policy_version 1937729 (0.0011) [2023-12-28 09:11:22,732][106225] Updated weights for policy 1, policy_version 1941848 (0.0007) [2023-12-28 09:11:23,355][106225] Updated weights for policy 1, policy_version 1941858 (0.0006) [2023-12-28 09:11:23,363][106226] Updated weights for policy 0, policy_version 1937739 (0.0011) [2023-12-28 09:11:23,414][106226] Updated weights for policy 0, policy_version 1937749 (0.0010) [2023-12-28 09:11:23,418][106225] Updated weights for policy 1, policy_version 1941868 (0.0007) [2023-12-28 09:11:23,471][106226] Updated weights for policy 0, policy_version 1937759 (0.0006) [2023-12-28 09:11:23,478][106225] Updated weights for policy 1, policy_version 1941878 (0.0008) [2023-12-28 09:11:23,545][106225] Updated weights for policy 1, policy_version 1941888 (0.0007) [2023-12-28 09:11:24,100][106226] Updated weights for policy 0, policy_version 1937769 (0.0010) [2023-12-28 09:11:24,158][106226] Updated weights for policy 0, policy_version 1937779 (0.0007) [2023-12-28 09:11:24,204][106226] Updated weights for policy 0, policy_version 1937789 (0.0006) [2023-12-28 09:11:24,261][106225] Updated weights for policy 1, policy_version 1941898 (0.0010) [2023-12-28 09:11:24,263][106226] Updated weights for policy 0, policy_version 1937799 (0.0006) [2023-12-28 09:11:24,309][106225] Updated weights for policy 1, policy_version 1941908 (0.0010) [2023-12-28 09:11:24,355][106225] Updated weights for policy 1, policy_version 1941918 (0.0010) [2023-12-28 09:11:24,889][106226] Updated weights for policy 0, policy_version 1937809 (0.0006) [2023-12-28 09:11:24,934][106226] Updated weights for policy 0, policy_version 1937819 (0.0009) [2023-12-28 09:11:24,983][106226] Updated weights for policy 0, policy_version 1937829 (0.0010) [2023-12-28 09:11:25,092][106225] Updated weights for policy 1, policy_version 1941928 (0.0010) [2023-12-28 09:11:25,138][106225] Updated weights for policy 1, policy_version 1941938 (0.0010) [2023-12-28 09:11:25,184][106225] Updated weights for policy 1, policy_version 1941948 (0.0010) [2023-12-28 09:11:25,670][106226] Updated weights for policy 0, policy_version 1937839 (0.0010) [2023-12-28 09:11:25,723][106226] Updated weights for policy 0, policy_version 1937849 (0.0010) [2023-12-28 09:11:25,775][106226] Updated weights for policy 0, policy_version 1937859 (0.0010) [2023-12-28 09:11:25,874][106225] Updated weights for policy 1, policy_version 1941958 (0.0010) [2023-12-28 09:11:25,931][106225] Updated weights for policy 1, policy_version 1941968 (0.0010) [2023-12-28 09:11:25,993][106225] Updated weights for policy 1, policy_version 1941978 (0.0006) [2023-12-28 09:11:26,175][105115] Fps is (10 sec: 19660.0, 60 sec: 19797.2, 300 sec: 19771.9). Total num frames: 993378304. Throughput: 0: 9727.0, 1: 9856.6. Samples: 993344324. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:26,176][105115] Avg episode reward: [(0, '-4.403'), (1, '-4.523')] [2023-12-28 09:11:26,187][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001937864_496173056.pth... [2023-12-28 09:11:26,187][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001941984_497205248.pth... [2023-12-28 09:11:26,190][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001940832_496910336.pth [2023-12-28 09:11:26,191][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001936712_495878144.pth [2023-12-28 09:11:26,458][106226] Updated weights for policy 0, policy_version 1937869 (0.0010) [2023-12-28 09:11:26,517][106226] Updated weights for policy 0, policy_version 1937879 (0.0010) [2023-12-28 09:11:26,576][106226] Updated weights for policy 0, policy_version 1937889 (0.0010) [2023-12-28 09:11:26,674][106225] Updated weights for policy 1, policy_version 1941988 (0.0006) [2023-12-28 09:11:26,737][106225] Updated weights for policy 1, policy_version 1941998 (0.0008) [2023-12-28 09:11:26,792][106225] Updated weights for policy 1, policy_version 1942008 (0.0007) [2023-12-28 09:11:27,131][106226] Updated weights for policy 0, policy_version 1937899 (0.0009) [2023-12-28 09:11:27,187][106226] Updated weights for policy 0, policy_version 1937909 (0.0005) [2023-12-28 09:11:27,237][106226] Updated weights for policy 0, policy_version 1937919 (0.0005) [2023-12-28 09:11:27,453][106225] Updated weights for policy 1, policy_version 1942018 (0.0006) [2023-12-28 09:11:27,520][106225] Updated weights for policy 1, policy_version 1942028 (0.0006) [2023-12-28 09:11:27,586][106225] Updated weights for policy 1, policy_version 1942038 (0.0006) [2023-12-28 09:11:27,653][106225] Updated weights for policy 1, policy_version 1942048 (0.0005) [2023-12-28 09:11:27,892][106226] Updated weights for policy 0, policy_version 1937929 (0.0006) [2023-12-28 09:11:27,939][106226] Updated weights for policy 0, policy_version 1937939 (0.0010) [2023-12-28 09:11:27,990][106226] Updated weights for policy 0, policy_version 1937949 (0.0011) [2023-12-28 09:11:28,046][106226] Updated weights for policy 0, policy_version 1937959 (0.0011) [2023-12-28 09:11:28,227][106225] Updated weights for policy 1, policy_version 1942058 (0.0008) [2023-12-28 09:11:28,291][106225] Updated weights for policy 1, policy_version 1942068 (0.0006) [2023-12-28 09:11:28,369][106225] Updated weights for policy 1, policy_version 1942078 (0.0008) [2023-12-28 09:11:28,738][106226] Updated weights for policy 0, policy_version 1937969 (0.0008) [2023-12-28 09:11:28,804][106226] Updated weights for policy 0, policy_version 1937979 (0.0011) [2023-12-28 09:11:28,864][106226] Updated weights for policy 0, policy_version 1937989 (0.0010) [2023-12-28 09:11:28,977][106225] Updated weights for policy 1, policy_version 1942088 (0.0008) [2023-12-28 09:11:29,039][106225] Updated weights for policy 1, policy_version 1942098 (0.0007) [2023-12-28 09:11:29,091][106225] Updated weights for policy 1, policy_version 1942108 (0.0005) [2023-12-28 09:11:29,569][106226] Updated weights for policy 0, policy_version 1937999 (0.0010) [2023-12-28 09:11:29,616][106226] Updated weights for policy 0, policy_version 1938009 (0.0011) [2023-12-28 09:11:29,669][106226] Updated weights for policy 0, policy_version 1938019 (0.0010) [2023-12-28 09:11:29,793][106225] Updated weights for policy 1, policy_version 1942118 (0.0007) [2023-12-28 09:11:29,862][106225] Updated weights for policy 1, policy_version 1942128 (0.0008) [2023-12-28 09:11:29,917][106225] Updated weights for policy 1, policy_version 1942138 (0.0006) [2023-12-28 09:11:30,357][106226] Updated weights for policy 0, policy_version 1938029 (0.0009) [2023-12-28 09:11:30,414][106226] Updated weights for policy 0, policy_version 1938039 (0.0008) [2023-12-28 09:11:30,471][106226] Updated weights for policy 0, policy_version 1938049 (0.0009) [2023-12-28 09:11:30,565][106225] Updated weights for policy 1, policy_version 1942148 (0.0008) [2023-12-28 09:11:30,626][106225] Updated weights for policy 1, policy_version 1942158 (0.0009) [2023-12-28 09:11:30,677][106225] Updated weights for policy 1, policy_version 1942168 (0.0008) [2023-12-28 09:11:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19744.1). Total num frames: 993476608. Throughput: 0: 9846.7, 1: 9876.4. Samples: 993468840. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:31,175][105115] Avg episode reward: [(0, '-4.076'), (1, '-4.414')] [2023-12-28 09:11:31,206][106226] Updated weights for policy 0, policy_version 1938059 (0.0008) [2023-12-28 09:11:31,269][106226] Updated weights for policy 0, policy_version 1938069 (0.0006) [2023-12-28 09:11:31,336][106226] Updated weights for policy 0, policy_version 1938079 (0.0006) [2023-12-28 09:11:31,468][106225] Updated weights for policy 1, policy_version 1942178 (0.0008) [2023-12-28 09:11:31,523][106225] Updated weights for policy 1, policy_version 1942188 (0.0008) [2023-12-28 09:11:31,575][106225] Updated weights for policy 1, policy_version 1942198 (0.0006) [2023-12-28 09:11:31,639][106225] Updated weights for policy 1, policy_version 1942208 (0.0007) [2023-12-28 09:11:32,033][106226] Updated weights for policy 0, policy_version 1938089 (0.0008) [2023-12-28 09:11:32,087][106226] Updated weights for policy 0, policy_version 1938099 (0.0009) [2023-12-28 09:11:32,143][106226] Updated weights for policy 0, policy_version 1938109 (0.0006) [2023-12-28 09:11:32,207][106226] Updated weights for policy 0, policy_version 1938119 (0.0008) [2023-12-28 09:11:32,293][106225] Updated weights for policy 1, policy_version 1942218 (0.0007) [2023-12-28 09:11:32,360][106225] Updated weights for policy 1, policy_version 1942228 (0.0007) [2023-12-28 09:11:32,418][106225] Updated weights for policy 1, policy_version 1942238 (0.0008) [2023-12-28 09:11:32,930][106226] Updated weights for policy 0, policy_version 1938129 (0.0008) [2023-12-28 09:11:32,985][106226] Updated weights for policy 0, policy_version 1938139 (0.0007) [2023-12-28 09:11:33,045][106226] Updated weights for policy 0, policy_version 1938149 (0.0006) [2023-12-28 09:11:33,102][106225] Updated weights for policy 1, policy_version 1942248 (0.0010) [2023-12-28 09:11:33,153][106225] Updated weights for policy 1, policy_version 1942258 (0.0006) [2023-12-28 09:11:33,200][106225] Updated weights for policy 1, policy_version 1942268 (0.0010) [2023-12-28 09:11:33,664][106226] Updated weights for policy 0, policy_version 1938159 (0.0007) [2023-12-28 09:11:33,713][106226] Updated weights for policy 0, policy_version 1938169 (0.0009) [2023-12-28 09:11:33,764][106226] Updated weights for policy 0, policy_version 1938179 (0.0008) [2023-12-28 09:11:33,811][106225] Updated weights for policy 1, policy_version 1942278 (0.0008) [2023-12-28 09:11:33,860][106225] Updated weights for policy 1, policy_version 1942288 (0.0005) [2023-12-28 09:11:33,912][106225] Updated weights for policy 1, policy_version 1942298 (0.0006) [2023-12-28 09:11:34,432][106226] Updated weights for policy 0, policy_version 1938189 (0.0007) [2023-12-28 09:11:34,494][106226] Updated weights for policy 0, policy_version 1938199 (0.0009) [2023-12-28 09:11:34,527][106225] Updated weights for policy 1, policy_version 1942308 (0.0007) [2023-12-28 09:11:34,558][106226] Updated weights for policy 0, policy_version 1938209 (0.0006) [2023-12-28 09:11:34,593][106225] Updated weights for policy 1, policy_version 1942318 (0.0008) [2023-12-28 09:11:34,658][106225] Updated weights for policy 1, policy_version 1942328 (0.0009) [2023-12-28 09:11:35,157][106226] Updated weights for policy 0, policy_version 1938219 (0.0005) [2023-12-28 09:11:35,219][106226] Updated weights for policy 0, policy_version 1938229 (0.0006) [2023-12-28 09:11:35,280][106226] Updated weights for policy 0, policy_version 1938239 (0.0005) [2023-12-28 09:11:35,319][106225] Updated weights for policy 1, policy_version 1942338 (0.0008) [2023-12-28 09:11:35,386][106225] Updated weights for policy 1, policy_version 1942348 (0.0010) [2023-12-28 09:11:35,434][106225] Updated weights for policy 1, policy_version 1942358 (0.0008) [2023-12-28 09:11:35,483][106225] Updated weights for policy 1, policy_version 1942368 (0.0009) [2023-12-28 09:11:35,779][106226] Updated weights for policy 0, policy_version 1938249 (0.0006) [2023-12-28 09:11:35,842][106226] Updated weights for policy 0, policy_version 1938259 (0.0008) [2023-12-28 09:11:35,909][106226] Updated weights for policy 0, policy_version 1938269 (0.0006) [2023-12-28 09:11:35,972][106226] Updated weights for policy 0, policy_version 1938279 (0.0009) [2023-12-28 09:11:36,175][105115] Fps is (10 sec: 20480.7, 60 sec: 19933.9, 300 sec: 19799.7). Total num frames: 993583104. Throughput: 0: 9966.9, 1: 9877.9. Samples: 993593156. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:36,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.786')] [2023-12-28 09:11:36,283][106225] Updated weights for policy 1, policy_version 1942378 (0.0006) [2023-12-28 09:11:36,346][106225] Updated weights for policy 1, policy_version 1942388 (0.0005) [2023-12-28 09:11:36,405][106225] Updated weights for policy 1, policy_version 1942398 (0.0008) [2023-12-28 09:11:36,635][106226] Updated weights for policy 0, policy_version 1938289 (0.0007) [2023-12-28 09:11:36,702][106226] Updated weights for policy 0, policy_version 1938299 (0.0007) [2023-12-28 09:11:36,764][106226] Updated weights for policy 0, policy_version 1938309 (0.0009) [2023-12-28 09:11:37,078][106225] Updated weights for policy 1, policy_version 1942408 (0.0009) [2023-12-28 09:11:37,150][106225] Updated weights for policy 1, policy_version 1942418 (0.0009) [2023-12-28 09:11:37,213][106225] Updated weights for policy 1, policy_version 1942428 (0.0009) [2023-12-28 09:11:37,348][106226] Updated weights for policy 0, policy_version 1938319 (0.0008) [2023-12-28 09:11:37,411][106226] Updated weights for policy 0, policy_version 1938329 (0.0008) [2023-12-28 09:11:37,474][106226] Updated weights for policy 0, policy_version 1938339 (0.0008) [2023-12-28 09:11:37,959][106225] Updated weights for policy 1, policy_version 1942438 (0.0008) [2023-12-28 09:11:38,018][106225] Updated weights for policy 1, policy_version 1942448 (0.0008) [2023-12-28 09:11:38,069][106225] Updated weights for policy 1, policy_version 1942458 (0.0005) [2023-12-28 09:11:38,177][106226] Updated weights for policy 0, policy_version 1938349 (0.0009) [2023-12-28 09:11:38,235][106226] Updated weights for policy 0, policy_version 1938359 (0.0007) [2023-12-28 09:11:38,300][106226] Updated weights for policy 0, policy_version 1938369 (0.0005) [2023-12-28 09:11:38,705][106225] Updated weights for policy 1, policy_version 1942468 (0.0008) [2023-12-28 09:11:38,768][106225] Updated weights for policy 1, policy_version 1942478 (0.0011) [2023-12-28 09:11:38,832][106225] Updated weights for policy 1, policy_version 1942488 (0.0010) [2023-12-28 09:11:38,994][106226] Updated weights for policy 0, policy_version 1938379 (0.0007) [2023-12-28 09:11:39,050][106226] Updated weights for policy 0, policy_version 1938389 (0.0005) [2023-12-28 09:11:39,103][106226] Updated weights for policy 0, policy_version 1938399 (0.0006) [2023-12-28 09:11:39,563][106225] Updated weights for policy 1, policy_version 1942498 (0.0010) [2023-12-28 09:11:39,630][106225] Updated weights for policy 1, policy_version 1942508 (0.0010) [2023-12-28 09:11:39,692][106225] Updated weights for policy 1, policy_version 1942518 (0.0010) [2023-12-28 09:11:39,759][106225] Updated weights for policy 1, policy_version 1942528 (0.0009) [2023-12-28 09:11:39,852][106226] Updated weights for policy 0, policy_version 1938409 (0.0008) [2023-12-28 09:11:39,916][106226] Updated weights for policy 0, policy_version 1938419 (0.0008) [2023-12-28 09:11:39,983][106226] Updated weights for policy 0, policy_version 1938429 (0.0008) [2023-12-28 09:11:40,044][106226] Updated weights for policy 0, policy_version 1938439 (0.0006) [2023-12-28 09:11:40,494][106225] Updated weights for policy 1, policy_version 1942538 (0.0011) [2023-12-28 09:11:40,557][106225] Updated weights for policy 1, policy_version 1942548 (0.0011) [2023-12-28 09:11:40,621][106225] Updated weights for policy 1, policy_version 1942558 (0.0010) [2023-12-28 09:11:40,659][106226] Updated weights for policy 0, policy_version 1938449 (0.0007) [2023-12-28 09:11:40,721][106226] Updated weights for policy 0, policy_version 1938459 (0.0008) [2023-12-28 09:11:40,786][106226] Updated weights for policy 0, policy_version 1938469 (0.0008) [2023-12-28 09:11:41,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.8, 300 sec: 19799.7). Total num frames: 993681408. Throughput: 0: 9975.1, 1: 9910.6. Samples: 993654096. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:41,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.678')] [2023-12-28 09:11:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001942560_497352704.pth... [2023-12-28 09:11:41,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001938472_496328704.pth... [2023-12-28 09:11:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001941408_497057792.pth [2023-12-28 09:11:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001937288_496025600.pth [2023-12-28 09:11:41,344][106225] Updated weights for policy 1, policy_version 1942568 (0.0008) [2023-12-28 09:11:41,410][106225] Updated weights for policy 1, policy_version 1942578 (0.0009) [2023-12-28 09:11:41,466][106225] Updated weights for policy 1, policy_version 1942588 (0.0008) [2023-12-28 09:11:41,482][106226] Updated weights for policy 0, policy_version 1938479 (0.0007) [2023-12-28 09:11:41,547][106226] Updated weights for policy 0, policy_version 1938489 (0.0007) [2023-12-28 09:11:41,606][106226] Updated weights for policy 0, policy_version 1938499 (0.0007) [2023-12-28 09:11:42,270][106225] Updated weights for policy 1, policy_version 1942598 (0.0008) [2023-12-28 09:11:42,301][106226] Updated weights for policy 0, policy_version 1938509 (0.0010) [2023-12-28 09:11:42,325][106225] Updated weights for policy 1, policy_version 1942608 (0.0007) [2023-12-28 09:11:42,367][106226] Updated weights for policy 0, policy_version 1938519 (0.0010) [2023-12-28 09:11:42,389][106225] Updated weights for policy 1, policy_version 1942618 (0.0008) [2023-12-28 09:11:42,433][106226] Updated weights for policy 0, policy_version 1938529 (0.0008) [2023-12-28 09:11:43,090][106225] Updated weights for policy 1, policy_version 1942628 (0.0007) [2023-12-28 09:11:43,150][106225] Updated weights for policy 1, policy_version 1942638 (0.0007) [2023-12-28 09:11:43,154][106226] Updated weights for policy 0, policy_version 1938539 (0.0009) [2023-12-28 09:11:43,214][106226] Updated weights for policy 0, policy_version 1938549 (0.0010) [2023-12-28 09:11:43,219][106225] Updated weights for policy 1, policy_version 1942648 (0.0006) [2023-12-28 09:11:43,278][106226] Updated weights for policy 0, policy_version 1938559 (0.0010) [2023-12-28 09:11:43,929][106225] Updated weights for policy 1, policy_version 1942658 (0.0006) [2023-12-28 09:11:43,931][106226] Updated weights for policy 0, policy_version 1938569 (0.0010) [2023-12-28 09:11:43,982][106225] Updated weights for policy 1, policy_version 1942668 (0.0008) [2023-12-28 09:11:43,987][106226] Updated weights for policy 0, policy_version 1938579 (0.0005) [2023-12-28 09:11:44,041][106226] Updated weights for policy 0, policy_version 1938589 (0.0005) [2023-12-28 09:11:44,042][106225] Updated weights for policy 1, policy_version 1942678 (0.0008) [2023-12-28 09:11:44,093][106226] Updated weights for policy 0, policy_version 1938599 (0.0005) [2023-12-28 09:11:44,094][106225] Updated weights for policy 1, policy_version 1942688 (0.0008) [2023-12-28 09:11:44,751][106226] Updated weights for policy 0, policy_version 1938609 (0.0010) [2023-12-28 09:11:44,827][106226] Updated weights for policy 0, policy_version 1938619 (0.0010) [2023-12-28 09:11:44,830][106225] Updated weights for policy 1, policy_version 1942698 (0.0007) [2023-12-28 09:11:44,888][106225] Updated weights for policy 1, policy_version 1942708 (0.0007) [2023-12-28 09:11:44,894][106226] Updated weights for policy 0, policy_version 1938629 (0.0010) [2023-12-28 09:11:44,949][106225] Updated weights for policy 1, policy_version 1942718 (0.0007) [2023-12-28 09:11:45,649][106226] Updated weights for policy 0, policy_version 1938639 (0.0010) [2023-12-28 09:11:45,678][106225] Updated weights for policy 1, policy_version 1942728 (0.0010) [2023-12-28 09:11:45,705][106226] Updated weights for policy 0, policy_version 1938649 (0.0010) [2023-12-28 09:11:45,737][106225] Updated weights for policy 1, policy_version 1942738 (0.0008) [2023-12-28 09:11:45,760][106226] Updated weights for policy 0, policy_version 1938659 (0.0010) [2023-12-28 09:11:45,800][106225] Updated weights for policy 1, policy_version 1942748 (0.0005) [2023-12-28 09:11:46,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19799.6). Total num frames: 993779712. Throughput: 0: 10026.8, 1: 9819.6. Samples: 993769760. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:46,176][105115] Avg episode reward: [(0, '-4.383'), (1, '-4.616')] [2023-12-28 09:11:46,317][106226] Updated weights for policy 0, policy_version 1938669 (0.0009) [2023-12-28 09:11:46,366][106226] Updated weights for policy 0, policy_version 1938679 (0.0010) [2023-12-28 09:11:46,419][106226] Updated weights for policy 0, policy_version 1938689 (0.0010) [2023-12-28 09:11:46,435][106225] Updated weights for policy 1, policy_version 1942758 (0.0008) [2023-12-28 09:11:46,498][106225] Updated weights for policy 1, policy_version 1942768 (0.0010) [2023-12-28 09:11:46,547][106225] Updated weights for policy 1, policy_version 1942778 (0.0010) [2023-12-28 09:11:47,086][106226] Updated weights for policy 0, policy_version 1938699 (0.0009) [2023-12-28 09:11:47,143][106226] Updated weights for policy 0, policy_version 1938709 (0.0005) [2023-12-28 09:11:47,194][106226] Updated weights for policy 0, policy_version 1938719 (0.0005) [2023-12-28 09:11:47,294][106225] Updated weights for policy 1, policy_version 1942788 (0.0009) [2023-12-28 09:11:47,343][106225] Updated weights for policy 1, policy_version 1942798 (0.0005) [2023-12-28 09:11:47,406][106225] Updated weights for policy 1, policy_version 1942808 (0.0005) [2023-12-28 09:11:47,787][106226] Updated weights for policy 0, policy_version 1938729 (0.0005) [2023-12-28 09:11:47,854][106226] Updated weights for policy 0, policy_version 1938739 (0.0007) [2023-12-28 09:11:47,918][106226] Updated weights for policy 0, policy_version 1938749 (0.0008) [2023-12-28 09:11:47,978][106226] Updated weights for policy 0, policy_version 1938759 (0.0005) [2023-12-28 09:11:48,047][106225] Updated weights for policy 1, policy_version 1942818 (0.0005) [2023-12-28 09:11:48,110][106225] Updated weights for policy 1, policy_version 1942828 (0.0006) [2023-12-28 09:11:48,168][106225] Updated weights for policy 1, policy_version 1942838 (0.0010) [2023-12-28 09:11:48,223][106225] Updated weights for policy 1, policy_version 1942848 (0.0005) [2023-12-28 09:11:48,621][106226] Updated weights for policy 0, policy_version 1938769 (0.0008) [2023-12-28 09:11:48,680][106226] Updated weights for policy 0, policy_version 1938779 (0.0011) [2023-12-28 09:11:48,743][106226] Updated weights for policy 0, policy_version 1938789 (0.0011) [2023-12-28 09:11:48,904][106225] Updated weights for policy 1, policy_version 1942858 (0.0011) [2023-12-28 09:11:48,963][106225] Updated weights for policy 1, policy_version 1942868 (0.0010) [2023-12-28 09:11:49,025][106225] Updated weights for policy 1, policy_version 1942878 (0.0010) [2023-12-28 09:11:49,490][106226] Updated weights for policy 0, policy_version 1938799 (0.0007) [2023-12-28 09:11:49,544][106226] Updated weights for policy 0, policy_version 1938809 (0.0005) [2023-12-28 09:11:49,606][106226] Updated weights for policy 0, policy_version 1938819 (0.0008) [2023-12-28 09:11:49,703][106225] Updated weights for policy 1, policy_version 1942888 (0.0010) [2023-12-28 09:11:49,755][106225] Updated weights for policy 1, policy_version 1942898 (0.0010) [2023-12-28 09:11:49,809][106225] Updated weights for policy 1, policy_version 1942908 (0.0010) [2023-12-28 09:11:50,299][106226] Updated weights for policy 0, policy_version 1938829 (0.0011) [2023-12-28 09:11:50,349][106226] Updated weights for policy 0, policy_version 1938839 (0.0010) [2023-12-28 09:11:50,398][106226] Updated weights for policy 0, policy_version 1938849 (0.0010) [2023-12-28 09:11:50,561][106225] Updated weights for policy 1, policy_version 1942918 (0.0008) [2023-12-28 09:11:50,627][106225] Updated weights for policy 1, policy_version 1942928 (0.0008) [2023-12-28 09:11:50,686][106225] Updated weights for policy 1, policy_version 1942938 (0.0008) [2023-12-28 09:11:51,175][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19799.7). Total num frames: 993878016. Throughput: 0: 10066.5, 1: 9844.9. Samples: 993891312. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:51,175][105115] Avg episode reward: [(0, '-4.290'), (1, '-4.844')] [2023-12-28 09:11:51,176][106226] Updated weights for policy 0, policy_version 1938859 (0.0010) [2023-12-28 09:11:51,239][106226] Updated weights for policy 0, policy_version 1938869 (0.0008) [2023-12-28 09:11:51,305][106226] Updated weights for policy 0, policy_version 1938879 (0.0010) [2023-12-28 09:11:51,470][106225] Updated weights for policy 1, policy_version 1942948 (0.0008) [2023-12-28 09:11:51,533][106225] Updated weights for policy 1, policy_version 1942958 (0.0008) [2023-12-28 09:11:51,591][106225] Updated weights for policy 1, policy_version 1942968 (0.0009) [2023-12-28 09:11:51,974][106226] Updated weights for policy 0, policy_version 1938889 (0.0008) [2023-12-28 09:11:52,031][106226] Updated weights for policy 0, policy_version 1938899 (0.0005) [2023-12-28 09:11:52,088][106226] Updated weights for policy 0, policy_version 1938909 (0.0007) [2023-12-28 09:11:52,155][106226] Updated weights for policy 0, policy_version 1938919 (0.0006) [2023-12-28 09:11:52,423][106225] Updated weights for policy 1, policy_version 1942978 (0.0008) [2023-12-28 09:11:52,485][106225] Updated weights for policy 1, policy_version 1942988 (0.0007) [2023-12-28 09:11:52,547][106225] Updated weights for policy 1, policy_version 1942998 (0.0010) [2023-12-28 09:11:52,607][106225] Updated weights for policy 1, policy_version 1943008 (0.0010) [2023-12-28 09:11:52,806][106226] Updated weights for policy 0, policy_version 1938929 (0.0007) [2023-12-28 09:11:52,874][106226] Updated weights for policy 0, policy_version 1938939 (0.0008) [2023-12-28 09:11:52,939][106226] Updated weights for policy 0, policy_version 1938949 (0.0007) [2023-12-28 09:11:53,280][106225] Updated weights for policy 1, policy_version 1943018 (0.0010) [2023-12-28 09:11:53,342][106225] Updated weights for policy 1, policy_version 1943028 (0.0010) [2023-12-28 09:11:53,399][106225] Updated weights for policy 1, policy_version 1943038 (0.0009) [2023-12-28 09:11:53,601][106226] Updated weights for policy 0, policy_version 1938959 (0.0007) [2023-12-28 09:11:53,659][106226] Updated weights for policy 0, policy_version 1938969 (0.0008) [2023-12-28 09:11:53,709][106226] Updated weights for policy 0, policy_version 1938979 (0.0008) [2023-12-28 09:11:54,088][106225] Updated weights for policy 1, policy_version 1943048 (0.0008) [2023-12-28 09:11:54,152][106225] Updated weights for policy 1, policy_version 1943058 (0.0008) [2023-12-28 09:11:54,220][106225] Updated weights for policy 1, policy_version 1943068 (0.0006) [2023-12-28 09:11:54,379][106226] Updated weights for policy 0, policy_version 1938989 (0.0008) [2023-12-28 09:11:54,436][106226] Updated weights for policy 0, policy_version 1938999 (0.0008) [2023-12-28 09:11:54,489][106226] Updated weights for policy 0, policy_version 1939009 (0.0007) [2023-12-28 09:11:54,909][106225] Updated weights for policy 1, policy_version 1943078 (0.0010) [2023-12-28 09:11:54,966][106225] Updated weights for policy 1, policy_version 1943088 (0.0010) [2023-12-28 09:11:55,032][106225] Updated weights for policy 1, policy_version 1943098 (0.0009) [2023-12-28 09:11:55,112][106226] Updated weights for policy 0, policy_version 1939019 (0.0008) [2023-12-28 09:11:55,169][106226] Updated weights for policy 0, policy_version 1939029 (0.0007) [2023-12-28 09:11:55,253][106226] Updated weights for policy 0, policy_version 1939039 (0.0007) [2023-12-28 09:11:55,650][106225] Updated weights for policy 1, policy_version 1943108 (0.0008) [2023-12-28 09:11:55,705][106225] Updated weights for policy 1, policy_version 1943118 (0.0005) [2023-12-28 09:11:55,760][106225] Updated weights for policy 1, policy_version 1943128 (0.0005) [2023-12-28 09:11:55,961][106226] Updated weights for policy 0, policy_version 1939049 (0.0006) [2023-12-28 09:11:56,014][106226] Updated weights for policy 0, policy_version 1939059 (0.0007) [2023-12-28 09:11:56,077][106226] Updated weights for policy 0, policy_version 1939069 (0.0008) [2023-12-28 09:11:56,137][106226] Updated weights for policy 0, policy_version 1939079 (0.0008) [2023-12-28 09:11:56,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.8, 300 sec: 19827.4). Total num frames: 993984512. Throughput: 0: 10046.8, 1: 9804.9. Samples: 993949452. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:11:56,175][105115] Avg episode reward: [(0, '-4.270'), (1, '-4.480')] [2023-12-28 09:11:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001939080_496484352.pth... [2023-12-28 09:11:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001943136_497500160.pth... [2023-12-28 09:11:56,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001937864_496173056.pth [2023-12-28 09:11:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001941984_497205248.pth [2023-12-28 09:11:56,390][106225] Updated weights for policy 1, policy_version 1943138 (0.0006) [2023-12-28 09:11:56,443][106225] Updated weights for policy 1, policy_version 1943148 (0.0010) [2023-12-28 09:11:56,498][106225] Updated weights for policy 1, policy_version 1943158 (0.0010) [2023-12-28 09:11:56,559][106225] Updated weights for policy 1, policy_version 1943168 (0.0009) [2023-12-28 09:11:56,873][106226] Updated weights for policy 0, policy_version 1939089 (0.0006) [2023-12-28 09:11:56,919][106226] Updated weights for policy 0, policy_version 1939099 (0.0010) [2023-12-28 09:11:56,979][106226] Updated weights for policy 0, policy_version 1939109 (0.0010) [2023-12-28 09:11:57,134][106225] Updated weights for policy 1, policy_version 1943178 (0.0006) [2023-12-28 09:11:57,199][106225] Updated weights for policy 1, policy_version 1943188 (0.0005) [2023-12-28 09:11:57,255][106225] Updated weights for policy 1, policy_version 1943198 (0.0008) [2023-12-28 09:11:57,668][106226] Updated weights for policy 0, policy_version 1939119 (0.0010) [2023-12-28 09:11:57,717][106226] Updated weights for policy 0, policy_version 1939129 (0.0010) [2023-12-28 09:11:57,769][106226] Updated weights for policy 0, policy_version 1939139 (0.0010) [2023-12-28 09:11:57,831][106225] Updated weights for policy 1, policy_version 1943208 (0.0006) [2023-12-28 09:11:57,882][106225] Updated weights for policy 1, policy_version 1943218 (0.0006) [2023-12-28 09:11:57,931][106225] Updated weights for policy 1, policy_version 1943228 (0.0006) [2023-12-28 09:11:58,524][106226] Updated weights for policy 0, policy_version 1939149 (0.0011) [2023-12-28 09:11:58,588][106226] Updated weights for policy 0, policy_version 1939159 (0.0011) [2023-12-28 09:11:58,636][106225] Updated weights for policy 1, policy_version 1943238 (0.0007) [2023-12-28 09:11:58,654][106226] Updated weights for policy 0, policy_version 1939169 (0.0011) [2023-12-28 09:11:58,709][106225] Updated weights for policy 1, policy_version 1943248 (0.0008) [2023-12-28 09:11:58,786][106225] Updated weights for policy 1, policy_version 1943258 (0.0008) [2023-12-28 09:11:59,473][106226] Updated weights for policy 0, policy_version 1939179 (0.0008) [2023-12-28 09:11:59,539][106226] Updated weights for policy 0, policy_version 1939189 (0.0009) [2023-12-28 09:11:59,553][106225] Updated weights for policy 1, policy_version 1943268 (0.0008) [2023-12-28 09:11:59,604][106226] Updated weights for policy 0, policy_version 1939199 (0.0008) [2023-12-28 09:11:59,613][106225] Updated weights for policy 1, policy_version 1943278 (0.0010) [2023-12-28 09:11:59,678][106225] Updated weights for policy 1, policy_version 1943288 (0.0006) [2023-12-28 09:12:00,293][106225] Updated weights for policy 1, policy_version 1943298 (0.0006) [2023-12-28 09:12:00,353][106226] Updated weights for policy 0, policy_version 1939209 (0.0007) [2023-12-28 09:12:00,358][106225] Updated weights for policy 1, policy_version 1943308 (0.0005) [2023-12-28 09:12:00,413][106226] Updated weights for policy 0, policy_version 1939219 (0.0008) [2023-12-28 09:12:00,417][106225] Updated weights for policy 1, policy_version 1943318 (0.0005) [2023-12-28 09:12:00,469][106226] Updated weights for policy 0, policy_version 1939229 (0.0008) [2023-12-28 09:12:00,471][106225] Updated weights for policy 1, policy_version 1943328 (0.0005) [2023-12-28 09:12:00,527][106226] Updated weights for policy 0, policy_version 1939239 (0.0008) [2023-12-28 09:12:01,024][106225] Updated weights for policy 1, policy_version 1943338 (0.0010) [2023-12-28 09:12:01,087][106225] Updated weights for policy 1, policy_version 1943348 (0.0009) [2023-12-28 09:12:01,156][106225] Updated weights for policy 1, policy_version 1943358 (0.0009) [2023-12-28 09:12:01,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 994082816. Throughput: 0: 10092.3, 1: 9926.8. Samples: 994069788. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:01,175][105115] Avg episode reward: [(0, '-4.313'), (1, '-4.937')] [2023-12-28 09:12:01,219][106226] Updated weights for policy 0, policy_version 1939249 (0.0010) [2023-12-28 09:12:01,283][106226] Updated weights for policy 0, policy_version 1939259 (0.0008) [2023-12-28 09:12:01,339][106226] Updated weights for policy 0, policy_version 1939269 (0.0008) [2023-12-28 09:12:01,865][106225] Updated weights for policy 1, policy_version 1943368 (0.0005) [2023-12-28 09:12:01,930][106225] Updated weights for policy 1, policy_version 1943378 (0.0006) [2023-12-28 09:12:01,993][106225] Updated weights for policy 1, policy_version 1943388 (0.0006) [2023-12-28 09:12:02,051][106226] Updated weights for policy 0, policy_version 1939279 (0.0008) [2023-12-28 09:12:02,122][106226] Updated weights for policy 0, policy_version 1939289 (0.0011) [2023-12-28 09:12:02,192][106226] Updated weights for policy 0, policy_version 1939299 (0.0011) [2023-12-28 09:12:02,622][106225] Updated weights for policy 1, policy_version 1943398 (0.0009) [2023-12-28 09:12:02,680][106225] Updated weights for policy 1, policy_version 1943408 (0.0010) [2023-12-28 09:12:02,745][106225] Updated weights for policy 1, policy_version 1943418 (0.0008) [2023-12-28 09:12:02,889][106226] Updated weights for policy 0, policy_version 1939309 (0.0008) [2023-12-28 09:12:02,960][106226] Updated weights for policy 0, policy_version 1939319 (0.0006) [2023-12-28 09:12:03,031][106226] Updated weights for policy 0, policy_version 1939329 (0.0005) [2023-12-28 09:12:03,440][106225] Updated weights for policy 1, policy_version 1943428 (0.0009) [2023-12-28 09:12:03,497][106225] Updated weights for policy 1, policy_version 1943438 (0.0010) [2023-12-28 09:12:03,543][106225] Updated weights for policy 1, policy_version 1943448 (0.0007) [2023-12-28 09:12:03,670][106226] Updated weights for policy 0, policy_version 1939339 (0.0009) [2023-12-28 09:12:03,726][106226] Updated weights for policy 0, policy_version 1939349 (0.0005) [2023-12-28 09:12:03,775][106226] Updated weights for policy 0, policy_version 1939359 (0.0007) [2023-12-28 09:12:04,284][106225] Updated weights for policy 1, policy_version 1943458 (0.0008) [2023-12-28 09:12:04,352][106225] Updated weights for policy 1, policy_version 1943468 (0.0006) [2023-12-28 09:12:04,413][106225] Updated weights for policy 1, policy_version 1943478 (0.0006) [2023-12-28 09:12:04,419][106226] Updated weights for policy 0, policy_version 1939369 (0.0007) [2023-12-28 09:12:04,480][106226] Updated weights for policy 0, policy_version 1939379 (0.0007) [2023-12-28 09:12:04,483][106225] Updated weights for policy 1, policy_version 1943488 (0.0005) [2023-12-28 09:12:04,529][106226] Updated weights for policy 0, policy_version 1939389 (0.0005) [2023-12-28 09:12:04,583][106226] Updated weights for policy 0, policy_version 1939399 (0.0006) [2023-12-28 09:12:05,128][106225] Updated weights for policy 1, policy_version 1943498 (0.0005) [2023-12-28 09:12:05,194][106225] Updated weights for policy 1, policy_version 1943508 (0.0005) [2023-12-28 09:12:05,220][106226] Updated weights for policy 0, policy_version 1939409 (0.0009) [2023-12-28 09:12:05,250][106225] Updated weights for policy 1, policy_version 1943518 (0.0006) [2023-12-28 09:12:05,270][106226] Updated weights for policy 0, policy_version 1939419 (0.0008) [2023-12-28 09:12:05,328][106226] Updated weights for policy 0, policy_version 1939429 (0.0006) [2023-12-28 09:12:05,837][106225] Updated weights for policy 1, policy_version 1943528 (0.0006) [2023-12-28 09:12:05,897][106225] Updated weights for policy 1, policy_version 1943538 (0.0006) [2023-12-28 09:12:05,957][106225] Updated weights for policy 1, policy_version 1943548 (0.0007) [2023-12-28 09:12:05,963][106226] Updated weights for policy 0, policy_version 1939439 (0.0006) [2023-12-28 09:12:06,017][106226] Updated weights for policy 0, policy_version 1939449 (0.0005) [2023-12-28 09:12:06,074][106226] Updated weights for policy 0, policy_version 1939459 (0.0005) [2023-12-28 09:12:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 20070.4, 300 sec: 19883.0). Total num frames: 994189312. Throughput: 0: 10172.0, 1: 10002.7. Samples: 994194192. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:06,175][105115] Avg episode reward: [(0, '-3.971'), (1, '-4.480')] [2023-12-28 09:12:06,585][106225] Updated weights for policy 1, policy_version 1943558 (0.0010) [2023-12-28 09:12:06,653][106225] Updated weights for policy 1, policy_version 1943568 (0.0010) [2023-12-28 09:12:06,711][106225] Updated weights for policy 1, policy_version 1943578 (0.0010) [2023-12-28 09:12:06,767][106226] Updated weights for policy 0, policy_version 1939469 (0.0007) [2023-12-28 09:12:06,825][106226] Updated weights for policy 0, policy_version 1939479 (0.0006) [2023-12-28 09:12:06,872][106226] Updated weights for policy 0, policy_version 1939489 (0.0006) [2023-12-28 09:12:07,416][106225] Updated weights for policy 1, policy_version 1943588 (0.0010) [2023-12-28 09:12:07,468][106225] Updated weights for policy 1, policy_version 1943598 (0.0010) [2023-12-28 09:12:07,524][106225] Updated weights for policy 1, policy_version 1943608 (0.0010) [2023-12-28 09:12:07,574][106226] Updated weights for policy 0, policy_version 1939499 (0.0008) [2023-12-28 09:12:07,628][106226] Updated weights for policy 0, policy_version 1939509 (0.0008) [2023-12-28 09:12:07,688][106226] Updated weights for policy 0, policy_version 1939519 (0.0008) [2023-12-28 09:12:08,244][106225] Updated weights for policy 1, policy_version 1943618 (0.0010) [2023-12-28 09:12:08,291][106225] Updated weights for policy 1, policy_version 1943628 (0.0010) [2023-12-28 09:12:08,350][106225] Updated weights for policy 1, policy_version 1943638 (0.0008) [2023-12-28 09:12:08,412][106225] Updated weights for policy 1, policy_version 1943648 (0.0010) [2023-12-28 09:12:08,423][106226] Updated weights for policy 0, policy_version 1939529 (0.0007) [2023-12-28 09:12:08,485][106226] Updated weights for policy 0, policy_version 1939539 (0.0008) [2023-12-28 09:12:08,546][106226] Updated weights for policy 0, policy_version 1939549 (0.0008) [2023-12-28 09:12:08,597][106226] Updated weights for policy 0, policy_version 1939559 (0.0008) [2023-12-28 09:12:09,153][106225] Updated weights for policy 1, policy_version 1943658 (0.0010) [2023-12-28 09:12:09,207][106225] Updated weights for policy 1, policy_version 1943668 (0.0007) [2023-12-28 09:12:09,275][106225] Updated weights for policy 1, policy_version 1943678 (0.0008) [2023-12-28 09:12:09,366][106226] Updated weights for policy 0, policy_version 1939569 (0.0008) [2023-12-28 09:12:09,436][106226] Updated weights for policy 0, policy_version 1939579 (0.0008) [2023-12-28 09:12:09,505][106226] Updated weights for policy 0, policy_version 1939589 (0.0011) [2023-12-28 09:12:10,097][106225] Updated weights for policy 1, policy_version 1943688 (0.0010) [2023-12-28 09:12:10,156][106225] Updated weights for policy 1, policy_version 1943698 (0.0011) [2023-12-28 09:12:10,222][106225] Updated weights for policy 1, policy_version 1943708 (0.0011) [2023-12-28 09:12:10,262][106226] Updated weights for policy 0, policy_version 1939599 (0.0008) [2023-12-28 09:12:10,321][106226] Updated weights for policy 0, policy_version 1939609 (0.0007) [2023-12-28 09:12:10,376][106226] Updated weights for policy 0, policy_version 1939619 (0.0008) [2023-12-28 09:12:10,837][106225] Updated weights for policy 1, policy_version 1943718 (0.0008) [2023-12-28 09:12:10,898][106225] Updated weights for policy 1, policy_version 1943728 (0.0008) [2023-12-28 09:12:10,960][106225] Updated weights for policy 1, policy_version 1943738 (0.0009) [2023-12-28 09:12:11,153][106226] Updated weights for policy 0, policy_version 1939629 (0.0012) [2023-12-28 09:12:11,175][105115] Fps is (10 sec: 19660.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 994279424. Throughput: 0: 10165.6, 1: 10022.8. Samples: 994252800. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:11,175][105115] Avg episode reward: [(0, '-4.332'), (1, '-4.745')] [2023-12-28 09:12:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001943744_497655808.pth... [2023-12-28 09:12:11,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001942560_497352704.pth [2023-12-28 09:12:11,218][106226] Updated weights for policy 0, policy_version 1939639 (0.0011) [2023-12-28 09:12:11,291][106226] Updated weights for policy 0, policy_version 1939649 (0.0009) [2023-12-28 09:12:11,331][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001939656_496631808.pth... [2023-12-28 09:12:11,335][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001938472_496328704.pth [2023-12-28 09:12:11,757][106225] Updated weights for policy 1, policy_version 1943748 (0.0009) [2023-12-28 09:12:11,810][106225] Updated weights for policy 1, policy_version 1943758 (0.0005) [2023-12-28 09:12:11,871][106225] Updated weights for policy 1, policy_version 1943768 (0.0008) [2023-12-28 09:12:12,103][106226] Updated weights for policy 0, policy_version 1939659 (0.0010) [2023-12-28 09:12:12,163][106226] Updated weights for policy 0, policy_version 1939669 (0.0009) [2023-12-28 09:12:12,225][106226] Updated weights for policy 0, policy_version 1939679 (0.0008) [2023-12-28 09:12:12,542][106225] Updated weights for policy 1, policy_version 1943778 (0.0008) [2023-12-28 09:12:12,606][106225] Updated weights for policy 1, policy_version 1943788 (0.0007) [2023-12-28 09:12:12,674][106225] Updated weights for policy 1, policy_version 1943798 (0.0008) [2023-12-28 09:12:12,733][106225] Updated weights for policy 1, policy_version 1943808 (0.0008) [2023-12-28 09:12:13,007][106226] Updated weights for policy 0, policy_version 1939689 (0.0009) [2023-12-28 09:12:13,059][106226] Updated weights for policy 0, policy_version 1939699 (0.0009) [2023-12-28 09:12:13,129][106226] Updated weights for policy 0, policy_version 1939709 (0.0008) [2023-12-28 09:12:13,182][106226] Updated weights for policy 0, policy_version 1939719 (0.0008) [2023-12-28 09:12:13,391][106225] Updated weights for policy 1, policy_version 1943818 (0.0005) [2023-12-28 09:12:13,445][106225] Updated weights for policy 1, policy_version 1943828 (0.0005) [2023-12-28 09:12:13,492][106225] Updated weights for policy 1, policy_version 1943838 (0.0005) [2023-12-28 09:12:14,006][106226] Updated weights for policy 0, policy_version 1939729 (0.0009) [2023-12-28 09:12:14,021][106225] Updated weights for policy 1, policy_version 1943848 (0.0005) [2023-12-28 09:12:14,072][106225] Updated weights for policy 1, policy_version 1943858 (0.0005) [2023-12-28 09:12:14,075][106226] Updated weights for policy 0, policy_version 1939739 (0.0008) [2023-12-28 09:12:14,121][106225] Updated weights for policy 1, policy_version 1943868 (0.0006) [2023-12-28 09:12:14,127][106226] Updated weights for policy 0, policy_version 1939749 (0.0007) [2023-12-28 09:12:14,794][106226] Updated weights for policy 0, policy_version 1939759 (0.0008) [2023-12-28 09:12:14,855][106226] Updated weights for policy 0, policy_version 1939769 (0.0008) [2023-12-28 09:12:14,882][106225] Updated weights for policy 1, policy_version 1943878 (0.0006) [2023-12-28 09:12:14,915][106226] Updated weights for policy 0, policy_version 1939779 (0.0009) [2023-12-28 09:12:14,937][106225] Updated weights for policy 1, policy_version 1943888 (0.0007) [2023-12-28 09:12:14,989][106225] Updated weights for policy 1, policy_version 1943898 (0.0008) [2023-12-28 09:12:15,651][106226] Updated weights for policy 0, policy_version 1939789 (0.0007) [2023-12-28 09:12:15,665][106225] Updated weights for policy 1, policy_version 1943908 (0.0007) [2023-12-28 09:12:15,709][106226] Updated weights for policy 0, policy_version 1939799 (0.0008) [2023-12-28 09:12:15,715][106225] Updated weights for policy 1, policy_version 1943918 (0.0006) [2023-12-28 09:12:15,767][106226] Updated weights for policy 0, policy_version 1939809 (0.0007) [2023-12-28 09:12:15,769][106225] Updated weights for policy 1, policy_version 1943928 (0.0007) [2023-12-28 09:12:16,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19933.8, 300 sec: 19855.2). Total num frames: 994377728. Throughput: 0: 9974.1, 1: 10000.8. Samples: 994367712. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:16,176][105115] Avg episode reward: [(0, '-4.569'), (1, '-4.598')] [2023-12-28 09:12:16,465][106226] Updated weights for policy 0, policy_version 1939819 (0.0008) [2023-12-28 09:12:16,506][106225] Updated weights for policy 1, policy_version 1943938 (0.0008) [2023-12-28 09:12:16,529][106226] Updated weights for policy 0, policy_version 1939829 (0.0008) [2023-12-28 09:12:16,562][106225] Updated weights for policy 1, policy_version 1943948 (0.0007) [2023-12-28 09:12:16,584][106226] Updated weights for policy 0, policy_version 1939839 (0.0006) [2023-12-28 09:12:16,626][106225] Updated weights for policy 1, policy_version 1943958 (0.0006) [2023-12-28 09:12:16,682][106225] Updated weights for policy 1, policy_version 1943968 (0.0008) [2023-12-28 09:12:17,301][106226] Updated weights for policy 0, policy_version 1939849 (0.0009) [2023-12-28 09:12:17,351][106225] Updated weights for policy 1, policy_version 1943978 (0.0008) [2023-12-28 09:12:17,355][106226] Updated weights for policy 0, policy_version 1939859 (0.0005) [2023-12-28 09:12:17,406][106226] Updated weights for policy 0, policy_version 1939869 (0.0005) [2023-12-28 09:12:17,408][106225] Updated weights for policy 1, policy_version 1943988 (0.0008) [2023-12-28 09:12:17,469][106226] Updated weights for policy 0, policy_version 1939879 (0.0005) [2023-12-28 09:12:17,469][106225] Updated weights for policy 1, policy_version 1943998 (0.0009) [2023-12-28 09:12:18,080][106226] Updated weights for policy 0, policy_version 1939889 (0.0008) [2023-12-28 09:12:18,150][106226] Updated weights for policy 0, policy_version 1939899 (0.0009) [2023-12-28 09:12:18,215][106226] Updated weights for policy 0, policy_version 1939909 (0.0008) [2023-12-28 09:12:18,252][106225] Updated weights for policy 1, policy_version 1944008 (0.0008) [2023-12-28 09:12:18,319][106225] Updated weights for policy 1, policy_version 1944018 (0.0008) [2023-12-28 09:12:18,382][106225] Updated weights for policy 1, policy_version 1944028 (0.0008) [2023-12-28 09:12:18,861][106226] Updated weights for policy 0, policy_version 1939919 (0.0005) [2023-12-28 09:12:18,915][106226] Updated weights for policy 0, policy_version 1939929 (0.0008) [2023-12-28 09:12:18,972][106226] Updated weights for policy 0, policy_version 1939939 (0.0006) [2023-12-28 09:12:19,171][106225] Updated weights for policy 1, policy_version 1944038 (0.0006) [2023-12-28 09:12:19,236][106225] Updated weights for policy 1, policy_version 1944048 (0.0006) [2023-12-28 09:12:19,285][106225] Updated weights for policy 1, policy_version 1944058 (0.0006) [2023-12-28 09:12:19,641][106226] Updated weights for policy 0, policy_version 1939949 (0.0008) [2023-12-28 09:12:19,695][106226] Updated weights for policy 0, policy_version 1939959 (0.0007) [2023-12-28 09:12:19,750][106226] Updated weights for policy 0, policy_version 1939969 (0.0008) [2023-12-28 09:12:20,022][106225] Updated weights for policy 1, policy_version 1944068 (0.0008) [2023-12-28 09:12:20,088][106225] Updated weights for policy 1, policy_version 1944078 (0.0009) [2023-12-28 09:12:20,154][106225] Updated weights for policy 1, policy_version 1944088 (0.0007) [2023-12-28 09:12:20,529][106226] Updated weights for policy 0, policy_version 1939979 (0.0012) [2023-12-28 09:12:20,592][106226] Updated weights for policy 0, policy_version 1939989 (0.0009) [2023-12-28 09:12:20,648][106226] Updated weights for policy 0, policy_version 1939999 (0.0009) [2023-12-28 09:12:20,855][106225] Updated weights for policy 1, policy_version 1944098 (0.0006) [2023-12-28 09:12:20,913][106225] Updated weights for policy 1, policy_version 1944108 (0.0008) [2023-12-28 09:12:20,967][106225] Updated weights for policy 1, policy_version 1944118 (0.0010) [2023-12-28 09:12:21,024][106225] Updated weights for policy 1, policy_version 1944128 (0.0009) [2023-12-28 09:12:21,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 994476032. Throughput: 0: 9882.3, 1: 9924.8. Samples: 994484476. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:21,175][105115] Avg episode reward: [(0, '-4.360'), (1, '-4.636')] [2023-12-28 09:12:21,471][106226] Updated weights for policy 0, policy_version 1940009 (0.0009) [2023-12-28 09:12:21,538][106226] Updated weights for policy 0, policy_version 1940019 (0.0008) [2023-12-28 09:12:21,606][106226] Updated weights for policy 0, policy_version 1940029 (0.0008) [2023-12-28 09:12:21,671][106226] Updated weights for policy 0, policy_version 1940039 (0.0009) [2023-12-28 09:12:21,768][106225] Updated weights for policy 1, policy_version 1944138 (0.0008) [2023-12-28 09:12:21,833][106225] Updated weights for policy 1, policy_version 1944148 (0.0009) [2023-12-28 09:12:21,899][106225] Updated weights for policy 1, policy_version 1944158 (0.0008) [2023-12-28 09:12:22,467][106226] Updated weights for policy 0, policy_version 1940049 (0.0009) [2023-12-28 09:12:22,531][106226] Updated weights for policy 0, policy_version 1940059 (0.0007) [2023-12-28 09:12:22,592][106226] Updated weights for policy 0, policy_version 1940069 (0.0008) [2023-12-28 09:12:22,747][106225] Updated weights for policy 1, policy_version 1944168 (0.0007) [2023-12-28 09:12:22,813][106225] Updated weights for policy 1, policy_version 1944178 (0.0007) [2023-12-28 09:12:22,879][106225] Updated weights for policy 1, policy_version 1944188 (0.0006) [2023-12-28 09:12:23,200][106226] Updated weights for policy 0, policy_version 1940079 (0.0006) [2023-12-28 09:12:23,254][106226] Updated weights for policy 0, policy_version 1940089 (0.0005) [2023-12-28 09:12:23,316][106226] Updated weights for policy 0, policy_version 1940099 (0.0007) [2023-12-28 09:12:23,563][106225] Updated weights for policy 1, policy_version 1944198 (0.0006) [2023-12-28 09:12:23,617][106225] Updated weights for policy 1, policy_version 1944208 (0.0009) [2023-12-28 09:12:23,663][106225] Updated weights for policy 1, policy_version 1944218 (0.0010) [2023-12-28 09:12:23,949][106226] Updated weights for policy 0, policy_version 1940109 (0.0008) [2023-12-28 09:12:23,998][106226] Updated weights for policy 0, policy_version 1940119 (0.0010) [2023-12-28 09:12:24,047][106226] Updated weights for policy 0, policy_version 1940129 (0.0010) [2023-12-28 09:12:24,293][106225] Updated weights for policy 1, policy_version 1944228 (0.0010) [2023-12-28 09:12:24,354][106225] Updated weights for policy 1, policy_version 1944238 (0.0006) [2023-12-28 09:12:24,416][106225] Updated weights for policy 1, policy_version 1944248 (0.0006) [2023-12-28 09:12:24,868][106226] Updated weights for policy 0, policy_version 1940140 (0.0010) [2023-12-28 09:12:24,923][106226] Updated weights for policy 0, policy_version 1940150 (0.0008) [2023-12-28 09:12:24,956][106225] Updated weights for policy 1, policy_version 1944258 (0.0007) [2023-12-28 09:12:24,974][106226] Updated weights for policy 0, policy_version 1940160 (0.0006) [2023-12-28 09:12:25,004][106225] Updated weights for policy 1, policy_version 1944268 (0.0010) [2023-12-28 09:12:25,068][106225] Updated weights for policy 1, policy_version 1944278 (0.0010) [2023-12-28 09:12:25,135][106225] Updated weights for policy 1, policy_version 1944288 (0.0010) [2023-12-28 09:12:25,740][106226] Updated weights for policy 0, policy_version 1940170 (0.0007) [2023-12-28 09:12:25,793][106226] Updated weights for policy 0, policy_version 1940180 (0.0006) [2023-12-28 09:12:25,813][106225] Updated weights for policy 1, policy_version 1944298 (0.0009) [2023-12-28 09:12:25,855][106226] Updated weights for policy 0, policy_version 1940190 (0.0009) [2023-12-28 09:12:25,866][106225] Updated weights for policy 1, policy_version 1944308 (0.0010) [2023-12-28 09:12:25,911][106226] Updated weights for policy 0, policy_version 1940200 (0.0007) [2023-12-28 09:12:25,917][106225] Updated weights for policy 1, policy_version 1944318 (0.0010) [2023-12-28 09:12:26,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19933.9, 300 sec: 19855.2). Total num frames: 994574336. Throughput: 0: 9837.0, 1: 9875.7. Samples: 994541168. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:26,175][105115] Avg episode reward: [(0, '-4.116'), (1, '-4.432')] [2023-12-28 09:12:26,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001944320_497803264.pth... [2023-12-28 09:12:26,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001940200_496771072.pth... [2023-12-28 09:12:26,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001943136_497500160.pth [2023-12-28 09:12:26,194][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001939080_496484352.pth [2023-12-28 09:12:26,482][106225] Updated weights for policy 1, policy_version 1944328 (0.0010) [2023-12-28 09:12:26,531][106225] Updated weights for policy 1, policy_version 1944338 (0.0010) [2023-12-28 09:12:26,584][106225] Updated weights for policy 1, policy_version 1944348 (0.0010) [2023-12-28 09:12:26,606][106226] Updated weights for policy 0, policy_version 1940210 (0.0007) [2023-12-28 09:12:26,662][106226] Updated weights for policy 0, policy_version 1940220 (0.0008) [2023-12-28 09:12:26,717][106226] Updated weights for policy 0, policy_version 1940230 (0.0007) [2023-12-28 09:12:27,231][106225] Updated weights for policy 1, policy_version 1944358 (0.0007) [2023-12-28 09:12:27,277][106225] Updated weights for policy 1, policy_version 1944368 (0.0005) [2023-12-28 09:12:27,322][106226] Updated weights for policy 0, policy_version 1940240 (0.0007) [2023-12-28 09:12:27,329][106225] Updated weights for policy 1, policy_version 1944378 (0.0005) [2023-12-28 09:12:27,386][106226] Updated weights for policy 0, policy_version 1940250 (0.0006) [2023-12-28 09:12:27,447][106226] Updated weights for policy 0, policy_version 1940260 (0.0005) [2023-12-28 09:12:27,962][106225] Updated weights for policy 1, policy_version 1944388 (0.0008) [2023-12-28 09:12:28,011][106226] Updated weights for policy 0, policy_version 1940270 (0.0006) [2023-12-28 09:12:28,019][106225] Updated weights for policy 1, policy_version 1944398 (0.0006) [2023-12-28 09:12:28,064][106226] Updated weights for policy 0, policy_version 1940280 (0.0005) [2023-12-28 09:12:28,068][106225] Updated weights for policy 1, policy_version 1944408 (0.0009) [2023-12-28 09:12:28,114][106226] Updated weights for policy 0, policy_version 1940290 (0.0005) [2023-12-28 09:12:28,671][106226] Updated weights for policy 0, policy_version 1940300 (0.0006) [2023-12-28 09:12:28,718][106226] Updated weights for policy 0, policy_version 1940310 (0.0007) [2023-12-28 09:12:28,770][106226] Updated weights for policy 0, policy_version 1940320 (0.0006) [2023-12-28 09:12:28,833][106225] Updated weights for policy 1, policy_version 1944418 (0.0009) [2023-12-28 09:12:28,896][106225] Updated weights for policy 1, policy_version 1944428 (0.0009) [2023-12-28 09:12:28,949][106225] Updated weights for policy 1, policy_version 1944438 (0.0009) [2023-12-28 09:12:29,007][106225] Updated weights for policy 1, policy_version 1944448 (0.0006) [2023-12-28 09:12:29,480][106226] Updated weights for policy 0, policy_version 1940330 (0.0006) [2023-12-28 09:12:29,552][106226] Updated weights for policy 0, policy_version 1940340 (0.0008) [2023-12-28 09:12:29,619][106226] Updated weights for policy 0, policy_version 1940350 (0.0009) [2023-12-28 09:12:29,687][106226] Updated weights for policy 0, policy_version 1940360 (0.0008) [2023-12-28 09:12:29,718][106225] Updated weights for policy 1, policy_version 1944458 (0.0009) [2023-12-28 09:12:29,778][106225] Updated weights for policy 1, policy_version 1944468 (0.0010) [2023-12-28 09:12:29,847][106225] Updated weights for policy 1, policy_version 1944478 (0.0008) [2023-12-28 09:12:30,323][106226] Updated weights for policy 0, policy_version 1940370 (0.0007) [2023-12-28 09:12:30,392][106226] Updated weights for policy 0, policy_version 1940380 (0.0007) [2023-12-28 09:12:30,458][106226] Updated weights for policy 0, policy_version 1940390 (0.0006) [2023-12-28 09:12:30,506][106225] Updated weights for policy 1, policy_version 1944488 (0.0008) [2023-12-28 09:12:30,562][106225] Updated weights for policy 1, policy_version 1944498 (0.0009) [2023-12-28 09:12:30,623][106225] Updated weights for policy 1, policy_version 1944508 (0.0009) [2023-12-28 09:12:31,093][106226] Updated weights for policy 0, policy_version 1940400 (0.0008) [2023-12-28 09:12:31,164][106226] Updated weights for policy 0, policy_version 1940410 (0.0009) [2023-12-28 09:12:31,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19933.9, 300 sec: 19827.4). Total num frames: 994672640. Throughput: 0: 9916.4, 1: 10042.2. Samples: 994667896. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:31,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.570')] [2023-12-28 09:12:31,226][106226] Updated weights for policy 0, policy_version 1940420 (0.0005) [2023-12-28 09:12:31,369][106225] Updated weights for policy 1, policy_version 1944518 (0.0009) [2023-12-28 09:12:31,433][106225] Updated weights for policy 1, policy_version 1944528 (0.0009) [2023-12-28 09:12:31,482][106225] Updated weights for policy 1, policy_version 1944538 (0.0009) [2023-12-28 09:12:31,886][106226] Updated weights for policy 0, policy_version 1940430 (0.0008) [2023-12-28 09:12:31,942][106226] Updated weights for policy 0, policy_version 1940440 (0.0007) [2023-12-28 09:12:31,994][106226] Updated weights for policy 0, policy_version 1940450 (0.0008) [2023-12-28 09:12:32,202][106225] Updated weights for policy 1, policy_version 1944548 (0.0007) [2023-12-28 09:12:32,265][106225] Updated weights for policy 1, policy_version 1944558 (0.0007) [2023-12-28 09:12:32,319][106225] Updated weights for policy 1, policy_version 1944568 (0.0009) [2023-12-28 09:12:32,751][106226] Updated weights for policy 0, policy_version 1940460 (0.0007) [2023-12-28 09:12:32,813][106226] Updated weights for policy 0, policy_version 1940470 (0.0010) [2023-12-28 09:12:32,882][106226] Updated weights for policy 0, policy_version 1940480 (0.0010) [2023-12-28 09:12:33,020][106225] Updated weights for policy 1, policy_version 1944578 (0.0008) [2023-12-28 09:12:33,083][106225] Updated weights for policy 1, policy_version 1944588 (0.0009) [2023-12-28 09:12:33,141][106225] Updated weights for policy 1, policy_version 1944598 (0.0008) [2023-12-28 09:12:33,199][106225] Updated weights for policy 1, policy_version 1944608 (0.0008) [2023-12-28 09:12:33,595][106226] Updated weights for policy 0, policy_version 1940490 (0.0009) [2023-12-28 09:12:33,650][106226] Updated weights for policy 0, policy_version 1940500 (0.0008) [2023-12-28 09:12:33,704][106226] Updated weights for policy 0, policy_version 1940510 (0.0007) [2023-12-28 09:12:33,755][106226] Updated weights for policy 0, policy_version 1940520 (0.0007) [2023-12-28 09:12:33,943][106225] Updated weights for policy 1, policy_version 1944618 (0.0009) [2023-12-28 09:12:34,002][106225] Updated weights for policy 1, policy_version 1944628 (0.0008) [2023-12-28 09:12:34,060][106225] Updated weights for policy 1, policy_version 1944638 (0.0008) [2023-12-28 09:12:34,491][106226] Updated weights for policy 0, policy_version 1940530 (0.0009) [2023-12-28 09:12:34,563][106226] Updated weights for policy 0, policy_version 1940540 (0.0009) [2023-12-28 09:12:34,633][106226] Updated weights for policy 0, policy_version 1940550 (0.0008) [2023-12-28 09:12:34,780][106225] Updated weights for policy 1, policy_version 1944648 (0.0008) [2023-12-28 09:12:34,840][106225] Updated weights for policy 1, policy_version 1944658 (0.0009) [2023-12-28 09:12:34,894][106225] Updated weights for policy 1, policy_version 1944668 (0.0008) [2023-12-28 09:12:35,420][106226] Updated weights for policy 0, policy_version 1940560 (0.0006) [2023-12-28 09:12:35,484][106226] Updated weights for policy 0, policy_version 1940570 (0.0007) [2023-12-28 09:12:35,526][106225] Updated weights for policy 1, policy_version 1944678 (0.0006) [2023-12-28 09:12:35,544][106226] Updated weights for policy 0, policy_version 1940580 (0.0008) [2023-12-28 09:12:35,578][106225] Updated weights for policy 1, policy_version 1944688 (0.0007) [2023-12-28 09:12:35,628][106225] Updated weights for policy 1, policy_version 1944698 (0.0008) [2023-12-28 09:12:36,149][106226] Updated weights for policy 0, policy_version 1940590 (0.0007) [2023-12-28 09:12:36,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 994770944. Throughput: 0: 9828.9, 1: 10030.3. Samples: 994784976. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:36,175][105115] Avg episode reward: [(0, '-4.341'), (1, '-4.670')] [2023-12-28 09:12:36,213][106226] Updated weights for policy 0, policy_version 1940600 (0.0006) [2023-12-28 09:12:36,283][106226] Updated weights for policy 0, policy_version 1940610 (0.0007) [2023-12-28 09:12:36,353][106225] Updated weights for policy 1, policy_version 1944708 (0.0008) [2023-12-28 09:12:36,413][106225] Updated weights for policy 1, policy_version 1944718 (0.0011) [2023-12-28 09:12:36,462][106225] Updated weights for policy 1, policy_version 1944728 (0.0011) [2023-12-28 09:12:36,994][106226] Updated weights for policy 0, policy_version 1940620 (0.0009) [2023-12-28 09:12:37,056][106226] Updated weights for policy 0, policy_version 1940630 (0.0008) [2023-12-28 09:12:37,116][106226] Updated weights for policy 0, policy_version 1940640 (0.0007) [2023-12-28 09:12:37,169][106225] Updated weights for policy 1, policy_version 1944738 (0.0010) [2023-12-28 09:12:37,228][106225] Updated weights for policy 1, policy_version 1944748 (0.0010) [2023-12-28 09:12:37,296][106225] Updated weights for policy 1, policy_version 1944758 (0.0010) [2023-12-28 09:12:37,345][106225] Updated weights for policy 1, policy_version 1944768 (0.0008) [2023-12-28 09:12:37,908][106226] Updated weights for policy 0, policy_version 1940650 (0.0008) [2023-12-28 09:12:37,939][106225] Updated weights for policy 1, policy_version 1944778 (0.0005) [2023-12-28 09:12:37,970][106226] Updated weights for policy 0, policy_version 1940660 (0.0008) [2023-12-28 09:12:37,985][106225] Updated weights for policy 1, policy_version 1944788 (0.0005) [2023-12-28 09:12:38,026][106226] Updated weights for policy 0, policy_version 1940670 (0.0006) [2023-12-28 09:12:38,032][106225] Updated weights for policy 1, policy_version 1944798 (0.0010) [2023-12-28 09:12:38,086][106226] Updated weights for policy 0, policy_version 1940680 (0.0007) [2023-12-28 09:12:38,762][106225] Updated weights for policy 1, policy_version 1944808 (0.0007) [2023-12-28 09:12:38,773][106226] Updated weights for policy 0, policy_version 1940690 (0.0011) [2023-12-28 09:12:38,828][106225] Updated weights for policy 1, policy_version 1944818 (0.0005) [2023-12-28 09:12:38,834][106226] Updated weights for policy 0, policy_version 1940700 (0.0011) [2023-12-28 09:12:38,895][106226] Updated weights for policy 0, policy_version 1940710 (0.0010) [2023-12-28 09:12:38,897][106225] Updated weights for policy 1, policy_version 1944828 (0.0007) [2023-12-28 09:12:39,549][106225] Updated weights for policy 1, policy_version 1944838 (0.0007) [2023-12-28 09:12:39,606][106225] Updated weights for policy 1, policy_version 1944848 (0.0008) [2023-12-28 09:12:39,637][106226] Updated weights for policy 0, policy_version 1940720 (0.0008) [2023-12-28 09:12:39,673][106225] Updated weights for policy 1, policy_version 1944858 (0.0006) [2023-12-28 09:12:39,702][106226] Updated weights for policy 0, policy_version 1940730 (0.0008) [2023-12-28 09:12:39,771][106226] Updated weights for policy 0, policy_version 1940740 (0.0009) [2023-12-28 09:12:40,328][106225] Updated weights for policy 1, policy_version 1944868 (0.0008) [2023-12-28 09:12:40,392][106225] Updated weights for policy 1, policy_version 1944878 (0.0008) [2023-12-28 09:12:40,443][106226] Updated weights for policy 0, policy_version 1940750 (0.0011) [2023-12-28 09:12:40,452][106225] Updated weights for policy 1, policy_version 1944888 (0.0006) [2023-12-28 09:12:40,498][106226] Updated weights for policy 0, policy_version 1940760 (0.0011) [2023-12-28 09:12:40,551][106226] Updated weights for policy 0, policy_version 1940770 (0.0010) [2023-12-28 09:12:41,137][106225] Updated weights for policy 1, policy_version 1944898 (0.0006) [2023-12-28 09:12:41,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 994869248. Throughput: 0: 9791.4, 1: 10092.3. Samples: 994844220. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:41,176][105115] Avg episode reward: [(0, '-4.062'), (1, '-4.788')] [2023-12-28 09:12:41,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001940776_496918528.pth... [2023-12-28 09:12:41,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001939656_496631808.pth [2023-12-28 09:12:41,200][106225] Updated weights for policy 1, policy_version 1944908 (0.0008) [2023-12-28 09:12:41,269][106225] Updated weights for policy 1, policy_version 1944918 (0.0008) [2023-12-28 09:12:41,295][106226] Updated weights for policy 0, policy_version 1940780 (0.0010) [2023-12-28 09:12:41,332][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001944928_497958912.pth... [2023-12-28 09:12:41,332][106225] Updated weights for policy 1, policy_version 1944928 (0.0006) [2023-12-28 09:12:41,336][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001943744_497655808.pth [2023-12-28 09:12:41,361][106226] Updated weights for policy 0, policy_version 1940790 (0.0011) [2023-12-28 09:12:41,426][106226] Updated weights for policy 0, policy_version 1940800 (0.0013) [2023-12-28 09:12:42,141][106225] Updated weights for policy 1, policy_version 1944938 (0.0008) [2023-12-28 09:12:42,195][106225] Updated weights for policy 1, policy_version 1944948 (0.0009) [2023-12-28 09:12:42,203][106226] Updated weights for policy 0, policy_version 1940810 (0.0010) [2023-12-28 09:12:42,251][106225] Updated weights for policy 1, policy_version 1944958 (0.0008) [2023-12-28 09:12:42,268][106226] Updated weights for policy 0, policy_version 1940820 (0.0006) [2023-12-28 09:12:42,332][106226] Updated weights for policy 0, policy_version 1940830 (0.0007) [2023-12-28 09:12:42,401][106226] Updated weights for policy 0, policy_version 1940840 (0.0009) [2023-12-28 09:12:43,058][106225] Updated weights for policy 1, policy_version 1944968 (0.0006) [2023-12-28 09:12:43,118][106226] Updated weights for policy 0, policy_version 1940850 (0.0006) [2023-12-28 09:12:43,124][106225] Updated weights for policy 1, policy_version 1944978 (0.0007) [2023-12-28 09:12:43,176][106226] Updated weights for policy 0, policy_version 1940860 (0.0006) [2023-12-28 09:12:43,178][106225] Updated weights for policy 1, policy_version 1944988 (0.0005) [2023-12-28 09:12:43,233][106226] Updated weights for policy 0, policy_version 1940870 (0.0008) [2023-12-28 09:12:43,904][106225] Updated weights for policy 1, policy_version 1944998 (0.0007) [2023-12-28 09:12:43,918][106226] Updated weights for policy 0, policy_version 1940880 (0.0007) [2023-12-28 09:12:43,957][106225] Updated weights for policy 1, policy_version 1945008 (0.0007) [2023-12-28 09:12:43,974][106226] Updated weights for policy 0, policy_version 1940890 (0.0006) [2023-12-28 09:12:44,015][106225] Updated weights for policy 1, policy_version 1945018 (0.0007) [2023-12-28 09:12:44,032][106226] Updated weights for policy 0, policy_version 1940900 (0.0006) [2023-12-28 09:12:44,704][106226] Updated weights for policy 0, policy_version 1940910 (0.0005) [2023-12-28 09:12:44,754][106226] Updated weights for policy 0, policy_version 1940920 (0.0006) [2023-12-28 09:12:44,781][106225] Updated weights for policy 1, policy_version 1945028 (0.0007) [2023-12-28 09:12:44,823][106226] Updated weights for policy 0, policy_version 1940930 (0.0008) [2023-12-28 09:12:44,832][106225] Updated weights for policy 1, policy_version 1945038 (0.0007) [2023-12-28 09:12:44,894][106225] Updated weights for policy 1, policy_version 1945048 (0.0010) [2023-12-28 09:12:45,471][106226] Updated weights for policy 0, policy_version 1940940 (0.0008) [2023-12-28 09:12:45,519][106226] Updated weights for policy 0, policy_version 1940950 (0.0010) [2023-12-28 09:12:45,580][106226] Updated weights for policy 0, policy_version 1940960 (0.0010) [2023-12-28 09:12:45,592][106225] Updated weights for policy 1, policy_version 1945058 (0.0010) [2023-12-28 09:12:45,641][106225] Updated weights for policy 1, policy_version 1945068 (0.0006) [2023-12-28 09:12:45,694][106225] Updated weights for policy 1, policy_version 1945078 (0.0007) [2023-12-28 09:12:45,756][106225] Updated weights for policy 1, policy_version 1945088 (0.0007) [2023-12-28 09:12:46,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 994967552. Throughput: 0: 9786.6, 1: 9982.9. Samples: 994959412. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-28 09:12:46,175][105115] Avg episode reward: [(0, '-4.304'), (1, '-4.555')] [2023-12-28 09:12:46,334][106226] Updated weights for policy 0, policy_version 1940970 (0.0010) [2023-12-28 09:12:46,387][106226] Updated weights for policy 0, policy_version 1940980 (0.0009) [2023-12-28 09:12:46,440][106226] Updated weights for policy 0, policy_version 1940990 (0.0008) [2023-12-28 09:12:46,458][106225] Updated weights for policy 1, policy_version 1945098 (0.0008) [2023-12-28 09:12:46,496][106226] Updated weights for policy 0, policy_version 1941000 (0.0008) [2023-12-28 09:12:46,509][106225] Updated weights for policy 1, policy_version 1945108 (0.0005) [2023-12-28 09:12:46,564][106225] Updated weights for policy 1, policy_version 1945118 (0.0005) [2023-12-28 09:12:47,206][106225] Updated weights for policy 1, policy_version 1945128 (0.0007) [2023-12-28 09:12:47,223][106226] Updated weights for policy 0, policy_version 1941010 (0.0007) [2023-12-28 09:12:47,255][106225] Updated weights for policy 1, policy_version 1945138 (0.0005) [2023-12-28 09:12:47,284][106226] Updated weights for policy 0, policy_version 1941020 (0.0007) [2023-12-28 09:12:47,320][106225] Updated weights for policy 1, policy_version 1945148 (0.0008) [2023-12-28 09:12:47,342][106226] Updated weights for policy 0, policy_version 1941030 (0.0008) [2023-12-28 09:12:48,012][106225] Updated weights for policy 1, policy_version 1945158 (0.0008) [2023-12-28 09:12:48,061][106226] Updated weights for policy 0, policy_version 1941040 (0.0008) [2023-12-28 09:12:48,070][106225] Updated weights for policy 1, policy_version 1945168 (0.0007) [2023-12-28 09:12:48,114][106226] Updated weights for policy 0, policy_version 1941050 (0.0008) [2023-12-28 09:12:48,128][106225] Updated weights for policy 1, policy_version 1945178 (0.0006) [2023-12-28 09:12:48,177][106226] Updated weights for policy 0, policy_version 1941060 (0.0007) [2023-12-28 09:12:48,859][106225] Updated weights for policy 1, policy_version 1945188 (0.0007) [2023-12-28 09:12:48,912][106225] Updated weights for policy 1, policy_version 1945198 (0.0008) [2023-12-28 09:12:48,926][106226] Updated weights for policy 0, policy_version 1941070 (0.0008) [2023-12-28 09:12:48,963][106225] Updated weights for policy 1, policy_version 1945208 (0.0005) [2023-12-28 09:12:48,985][106226] Updated weights for policy 0, policy_version 1941080 (0.0008) [2023-12-28 09:12:49,040][106226] Updated weights for policy 0, policy_version 1941090 (0.0006) [2023-12-28 09:12:49,692][106225] Updated weights for policy 1, policy_version 1945218 (0.0006) [2023-12-28 09:12:49,761][106225] Updated weights for policy 1, policy_version 1945228 (0.0008) [2023-12-28 09:12:49,775][106226] Updated weights for policy 0, policy_version 1941100 (0.0008) [2023-12-28 09:12:49,830][106225] Updated weights for policy 1, policy_version 1945238 (0.0009) [2023-12-28 09:12:49,838][106226] Updated weights for policy 0, policy_version 1941110 (0.0007) [2023-12-28 09:12:49,895][106226] Updated weights for policy 0, policy_version 1941120 (0.0006) [2023-12-28 09:12:49,897][106225] Updated weights for policy 1, policy_version 1945248 (0.0008) [2023-12-28 09:12:50,631][106225] Updated weights for policy 1, policy_version 1945258 (0.0008) [2023-12-28 09:12:50,643][106226] Updated weights for policy 0, policy_version 1941130 (0.0007) [2023-12-28 09:12:50,694][106225] Updated weights for policy 1, policy_version 1945268 (0.0008) [2023-12-28 09:12:50,700][106226] Updated weights for policy 0, policy_version 1941140 (0.0007) [2023-12-28 09:12:50,754][106225] Updated weights for policy 1, policy_version 1945278 (0.0008) [2023-12-28 09:12:50,760][106226] Updated weights for policy 0, policy_version 1941150 (0.0007) [2023-12-28 09:12:50,830][106226] Updated weights for policy 0, policy_version 1941160 (0.0008) [2023-12-28 09:12:51,174][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 995065856. Throughput: 0: 9676.8, 1: 9886.9. Samples: 995074560. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:12:51,175][105115] Avg episode reward: [(0, '-4.431'), (1, '-4.728')] [2023-12-28 09:12:51,518][106225] Updated weights for policy 1, policy_version 1945288 (0.0008) [2023-12-28 09:12:51,583][106225] Updated weights for policy 1, policy_version 1945298 (0.0007) [2023-12-28 09:12:51,617][106226] Updated weights for policy 0, policy_version 1941170 (0.0006) [2023-12-28 09:12:51,654][106225] Updated weights for policy 1, policy_version 1945308 (0.0008) [2023-12-28 09:12:51,686][106226] Updated weights for policy 0, policy_version 1941180 (0.0007) [2023-12-28 09:12:51,754][106226] Updated weights for policy 0, policy_version 1941190 (0.0009) [2023-12-28 09:12:52,408][106225] Updated weights for policy 1, policy_version 1945318 (0.0009) [2023-12-28 09:12:52,448][106226] Updated weights for policy 0, policy_version 1941200 (0.0008) [2023-12-28 09:12:52,472][106225] Updated weights for policy 1, policy_version 1945328 (0.0007) [2023-12-28 09:12:52,508][106226] Updated weights for policy 0, policy_version 1941210 (0.0008) [2023-12-28 09:12:52,537][106225] Updated weights for policy 1, policy_version 1945338 (0.0008) [2023-12-28 09:12:52,563][106226] Updated weights for policy 0, policy_version 1941220 (0.0008) [2023-12-28 09:12:53,159][106225] Updated weights for policy 1, policy_version 1945348 (0.0007) [2023-12-28 09:12:53,211][106225] Updated weights for policy 1, policy_version 1945358 (0.0006) [2023-12-28 09:12:53,268][106225] Updated weights for policy 1, policy_version 1945368 (0.0005) [2023-12-28 09:12:53,339][106226] Updated weights for policy 0, policy_version 1941230 (0.0009) [2023-12-28 09:12:53,391][106226] Updated weights for policy 0, policy_version 1941240 (0.0007) [2023-12-28 09:12:53,444][106226] Updated weights for policy 0, policy_version 1941250 (0.0009) [2023-12-28 09:12:53,869][106225] Updated weights for policy 1, policy_version 1945378 (0.0006) [2023-12-28 09:12:53,919][106225] Updated weights for policy 1, policy_version 1945388 (0.0008) [2023-12-28 09:12:53,969][106225] Updated weights for policy 1, policy_version 1945398 (0.0009) [2023-12-28 09:12:54,024][106225] Updated weights for policy 1, policy_version 1945408 (0.0009) [2023-12-28 09:12:54,125][106226] Updated weights for policy 0, policy_version 1941260 (0.0007) [2023-12-28 09:12:54,183][106226] Updated weights for policy 0, policy_version 1941270 (0.0008) [2023-12-28 09:12:54,236][106226] Updated weights for policy 0, policy_version 1941280 (0.0008) [2023-12-28 09:12:54,807][106225] Updated weights for policy 1, policy_version 1945418 (0.0009) [2023-12-28 09:12:54,855][106225] Updated weights for policy 1, policy_version 1945428 (0.0005) [2023-12-28 09:12:54,904][106225] Updated weights for policy 1, policy_version 1945438 (0.0005) [2023-12-28 09:12:54,954][106226] Updated weights for policy 0, policy_version 1941290 (0.0007) [2023-12-28 09:12:55,020][106226] Updated weights for policy 0, policy_version 1941300 (0.0008) [2023-12-28 09:12:55,083][106226] Updated weights for policy 0, policy_version 1941310 (0.0009) [2023-12-28 09:12:55,135][106226] Updated weights for policy 0, policy_version 1941320 (0.0005) [2023-12-28 09:12:55,474][106225] Updated weights for policy 1, policy_version 1945448 (0.0008) [2023-12-28 09:12:55,538][106225] Updated weights for policy 1, policy_version 1945458 (0.0008) [2023-12-28 09:12:55,603][106225] Updated weights for policy 1, policy_version 1945468 (0.0008) [2023-12-28 09:12:55,745][106226] Updated weights for policy 0, policy_version 1941330 (0.0010) [2023-12-28 09:12:55,804][106226] Updated weights for policy 0, policy_version 1941340 (0.0009) [2023-12-28 09:12:55,868][106226] Updated weights for policy 0, policy_version 1941350 (0.0005) [2023-12-28 09:12:56,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.9, 300 sec: 19855.2). Total num frames: 995164160. Throughput: 0: 9670.0, 1: 9892.9. Samples: 995133128. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:12:56,175][105115] Avg episode reward: [(0, '-4.407'), (1, '-4.722')] [2023-12-28 09:12:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001945472_498098176.pth... [2023-12-28 09:12:56,184][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001941352_497065984.pth... [2023-12-28 09:12:56,189][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001944320_497803264.pth [2023-12-28 09:12:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001940200_496771072.pth [2023-12-28 09:12:56,251][106225] Updated weights for policy 1, policy_version 1945478 (0.0006) [2023-12-28 09:12:56,317][106225] Updated weights for policy 1, policy_version 1945488 (0.0005) [2023-12-28 09:12:56,383][106225] Updated weights for policy 1, policy_version 1945498 (0.0006) [2023-12-28 09:12:56,442][106226] Updated weights for policy 0, policy_version 1941360 (0.0009) [2023-12-28 09:12:56,508][106226] Updated weights for policy 0, policy_version 1941370 (0.0009) [2023-12-28 09:12:56,568][106226] Updated weights for policy 0, policy_version 1941380 (0.0008) [2023-12-28 09:12:56,983][106225] Updated weights for policy 1, policy_version 1945508 (0.0006) [2023-12-28 09:12:57,041][106225] Updated weights for policy 1, policy_version 1945518 (0.0009) [2023-12-28 09:12:57,089][106225] Updated weights for policy 1, policy_version 1945528 (0.0008) [2023-12-28 09:12:57,217][106226] Updated weights for policy 0, policy_version 1941390 (0.0006) [2023-12-28 09:12:57,277][106226] Updated weights for policy 0, policy_version 1941400 (0.0005) [2023-12-28 09:12:57,335][106226] Updated weights for policy 0, policy_version 1941410 (0.0007) [2023-12-28 09:12:57,725][106225] Updated weights for policy 1, policy_version 1945538 (0.0008) [2023-12-28 09:12:57,786][106225] Updated weights for policy 1, policy_version 1945548 (0.0008) [2023-12-28 09:12:57,842][106225] Updated weights for policy 1, policy_version 1945558 (0.0009) [2023-12-28 09:12:57,847][106226] Updated weights for policy 0, policy_version 1941420 (0.0005) [2023-12-28 09:12:57,890][106225] Updated weights for policy 1, policy_version 1945568 (0.0008) [2023-12-28 09:12:57,905][106226] Updated weights for policy 0, policy_version 1941430 (0.0005) [2023-12-28 09:12:57,961][106226] Updated weights for policy 0, policy_version 1941440 (0.0006) [2023-12-28 09:12:58,660][106225] Updated weights for policy 1, policy_version 1945578 (0.0010) [2023-12-28 09:12:58,712][106226] Updated weights for policy 0, policy_version 1941450 (0.0008) [2023-12-28 09:12:58,726][106225] Updated weights for policy 1, policy_version 1945588 (0.0008) [2023-12-28 09:12:58,777][106226] Updated weights for policy 0, policy_version 1941460 (0.0007) [2023-12-28 09:12:58,795][106225] Updated weights for policy 1, policy_version 1945598 (0.0011) [2023-12-28 09:12:58,844][106226] Updated weights for policy 0, policy_version 1941470 (0.0008) [2023-12-28 09:12:58,915][106226] Updated weights for policy 0, policy_version 1941480 (0.0008) [2023-12-28 09:12:59,636][106225] Updated weights for policy 1, policy_version 1945608 (0.0009) [2023-12-28 09:12:59,697][106225] Updated weights for policy 1, policy_version 1945618 (0.0009) [2023-12-28 09:12:59,756][106225] Updated weights for policy 1, policy_version 1945628 (0.0006) [2023-12-28 09:12:59,769][106226] Updated weights for policy 0, policy_version 1941490 (0.0008) [2023-12-28 09:12:59,832][106226] Updated weights for policy 0, policy_version 1941500 (0.0008) [2023-12-28 09:12:59,891][106226] Updated weights for policy 0, policy_version 1941510 (0.0008) [2023-12-28 09:13:00,504][106225] Updated weights for policy 1, policy_version 1945638 (0.0008) [2023-12-28 09:13:00,567][106225] Updated weights for policy 1, policy_version 1945648 (0.0008) [2023-12-28 09:13:00,608][106226] Updated weights for policy 0, policy_version 1941520 (0.0007) [2023-12-28 09:13:00,621][106225] Updated weights for policy 1, policy_version 1945658 (0.0006) [2023-12-28 09:13:00,661][106226] Updated weights for policy 0, policy_version 1941530 (0.0007) [2023-12-28 09:13:00,718][106226] Updated weights for policy 0, policy_version 1941540 (0.0009) [2023-12-28 09:13:01,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 995262464. Throughput: 0: 9825.6, 1: 9874.6. Samples: 995254220. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:01,175][105115] Avg episode reward: [(0, '-4.349'), (1, '-4.667')] [2023-12-28 09:13:01,213][106225] Updated weights for policy 1, policy_version 1945668 (0.0008) [2023-12-28 09:13:01,284][106225] Updated weights for policy 1, policy_version 1945678 (0.0009) [2023-12-28 09:13:01,340][106225] Updated weights for policy 1, policy_version 1945688 (0.0008) [2023-12-28 09:13:01,565][106226] Updated weights for policy 0, policy_version 1941550 (0.0009) [2023-12-28 09:13:01,632][106226] Updated weights for policy 0, policy_version 1941560 (0.0008) [2023-12-28 09:13:01,696][106226] Updated weights for policy 0, policy_version 1941570 (0.0008) [2023-12-28 09:13:02,081][106225] Updated weights for policy 1, policy_version 1945698 (0.0008) [2023-12-28 09:13:02,137][106225] Updated weights for policy 1, policy_version 1945708 (0.0007) [2023-12-28 09:13:02,188][106225] Updated weights for policy 1, policy_version 1945718 (0.0009) [2023-12-28 09:13:02,242][106225] Updated weights for policy 1, policy_version 1945728 (0.0009) [2023-12-28 09:13:02,407][106226] Updated weights for policy 0, policy_version 1941580 (0.0010) [2023-12-28 09:13:02,469][106226] Updated weights for policy 0, policy_version 1941590 (0.0011) [2023-12-28 09:13:02,532][106226] Updated weights for policy 0, policy_version 1941600 (0.0011) [2023-12-28 09:13:02,971][106225] Updated weights for policy 1, policy_version 1945738 (0.0010) [2023-12-28 09:13:03,031][106225] Updated weights for policy 1, policy_version 1945748 (0.0010) [2023-12-28 09:13:03,088][106225] Updated weights for policy 1, policy_version 1945758 (0.0010) [2023-12-28 09:13:03,149][106226] Updated weights for policy 0, policy_version 1941610 (0.0009) [2023-12-28 09:13:03,215][106226] Updated weights for policy 0, policy_version 1941620 (0.0008) [2023-12-28 09:13:03,272][106226] Updated weights for policy 0, policy_version 1941630 (0.0008) [2023-12-28 09:13:03,340][106226] Updated weights for policy 0, policy_version 1941640 (0.0007) [2023-12-28 09:13:03,806][106225] Updated weights for policy 1, policy_version 1945768 (0.0010) [2023-12-28 09:13:03,863][106225] Updated weights for policy 1, policy_version 1945778 (0.0010) [2023-12-28 09:13:03,922][106225] Updated weights for policy 1, policy_version 1945788 (0.0010) [2023-12-28 09:13:04,051][106226] Updated weights for policy 0, policy_version 1941650 (0.0008) [2023-12-28 09:13:04,118][106226] Updated weights for policy 0, policy_version 1941660 (0.0008) [2023-12-28 09:13:04,182][106226] Updated weights for policy 0, policy_version 1941670 (0.0006) [2023-12-28 09:13:04,573][106225] Updated weights for policy 1, policy_version 1945798 (0.0010) [2023-12-28 09:13:04,627][106225] Updated weights for policy 1, policy_version 1945809 (0.0008) [2023-12-28 09:13:04,677][106225] Updated weights for policy 1, policy_version 1945819 (0.0009) [2023-12-28 09:13:04,761][106226] Updated weights for policy 0, policy_version 1941680 (0.0006) [2023-12-28 09:13:04,829][106226] Updated weights for policy 0, policy_version 1941690 (0.0005) [2023-12-28 09:13:04,894][106226] Updated weights for policy 0, policy_version 1941700 (0.0005) [2023-12-28 09:13:05,343][106225] Updated weights for policy 1, policy_version 1945829 (0.0006) [2023-12-28 09:13:05,412][106225] Updated weights for policy 1, policy_version 1945839 (0.0005) [2023-12-28 09:13:05,466][106226] Updated weights for policy 0, policy_version 1941710 (0.0009) [2023-12-28 09:13:05,478][106225] Updated weights for policy 1, policy_version 1945849 (0.0007) [2023-12-28 09:13:05,516][106226] Updated weights for policy 0, policy_version 1941720 (0.0010) [2023-12-28 09:13:05,569][106226] Updated weights for policy 0, policy_version 1941730 (0.0010) [2023-12-28 09:13:06,049][106225] Updated weights for policy 1, policy_version 1945859 (0.0006) [2023-12-28 09:13:06,108][106225] Updated weights for policy 1, policy_version 1945869 (0.0006) [2023-12-28 09:13:06,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 995360768. Throughput: 0: 9840.6, 1: 9943.1. Samples: 995374744. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:06,175][105115] Avg episode reward: [(0, '-4.125'), (1, '-4.585')] [2023-12-28 09:13:06,176][106225] Updated weights for policy 1, policy_version 1945879 (0.0007) [2023-12-28 09:13:06,332][106226] Updated weights for policy 0, policy_version 1941740 (0.0010) [2023-12-28 09:13:06,388][106226] Updated weights for policy 0, policy_version 1941750 (0.0007) [2023-12-28 09:13:06,456][106226] Updated weights for policy 0, policy_version 1941760 (0.0008) [2023-12-28 09:13:06,879][106225] Updated weights for policy 1, policy_version 1945889 (0.0007) [2023-12-28 09:13:06,941][106225] Updated weights for policy 1, policy_version 1945899 (0.0006) [2023-12-28 09:13:06,999][106225] Updated weights for policy 1, policy_version 1945909 (0.0005) [2023-12-28 09:13:07,056][106225] Updated weights for policy 1, policy_version 1945919 (0.0005) [2023-12-28 09:13:07,133][106226] Updated weights for policy 0, policy_version 1941770 (0.0008) [2023-12-28 09:13:07,188][106226] Updated weights for policy 0, policy_version 1941780 (0.0006) [2023-12-28 09:13:07,250][106226] Updated weights for policy 0, policy_version 1941790 (0.0006) [2023-12-28 09:13:07,301][106226] Updated weights for policy 0, policy_version 1941800 (0.0011) [2023-12-28 09:13:07,672][106225] Updated weights for policy 1, policy_version 1945929 (0.0005) [2023-12-28 09:13:07,725][106225] Updated weights for policy 1, policy_version 1945939 (0.0005) [2023-12-28 09:13:07,772][106225] Updated weights for policy 1, policy_version 1945949 (0.0005) [2023-12-28 09:13:07,855][106226] Updated weights for policy 0, policy_version 1941810 (0.0005) [2023-12-28 09:13:07,911][106226] Updated weights for policy 0, policy_version 1941820 (0.0005) [2023-12-28 09:13:07,968][106226] Updated weights for policy 0, policy_version 1941830 (0.0005) [2023-12-28 09:13:08,387][106225] Updated weights for policy 1, policy_version 1945959 (0.0009) [2023-12-28 09:13:08,444][106225] Updated weights for policy 1, policy_version 1945969 (0.0010) [2023-12-28 09:13:08,501][106225] Updated weights for policy 1, policy_version 1945979 (0.0010) [2023-12-28 09:13:08,542][106226] Updated weights for policy 0, policy_version 1941840 (0.0008) [2023-12-28 09:13:08,607][106226] Updated weights for policy 0, policy_version 1941850 (0.0008) [2023-12-28 09:13:08,661][106226] Updated weights for policy 0, policy_version 1941860 (0.0011) [2023-12-28 09:13:09,183][106225] Updated weights for policy 1, policy_version 1945989 (0.0008) [2023-12-28 09:13:09,255][106225] Updated weights for policy 1, policy_version 1945999 (0.0007) [2023-12-28 09:13:09,320][106225] Updated weights for policy 1, policy_version 1946009 (0.0007) [2023-12-28 09:13:09,436][106226] Updated weights for policy 0, policy_version 1941870 (0.0009) [2023-12-28 09:13:09,492][106226] Updated weights for policy 0, policy_version 1941880 (0.0011) [2023-12-28 09:13:09,547][106226] Updated weights for policy 0, policy_version 1941890 (0.0011) [2023-12-28 09:13:10,038][106225] Updated weights for policy 1, policy_version 1946019 (0.0010) [2023-12-28 09:13:10,103][106225] Updated weights for policy 1, policy_version 1946029 (0.0007) [2023-12-28 09:13:10,167][106225] Updated weights for policy 1, policy_version 1946039 (0.0009) [2023-12-28 09:13:10,334][106226] Updated weights for policy 0, policy_version 1941900 (0.0011) [2023-12-28 09:13:10,404][106226] Updated weights for policy 0, policy_version 1941910 (0.0011) [2023-12-28 09:13:10,472][106226] Updated weights for policy 0, policy_version 1941920 (0.0011) [2023-12-28 09:13:10,774][106225] Updated weights for policy 1, policy_version 1946049 (0.0006) [2023-12-28 09:13:10,829][106225] Updated weights for policy 1, policy_version 1946059 (0.0008) [2023-12-28 09:13:10,884][106225] Updated weights for policy 1, policy_version 1946069 (0.0006) [2023-12-28 09:13:10,931][106225] Updated weights for policy 1, policy_version 1946079 (0.0009) [2023-12-28 09:13:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 995467264. Throughput: 0: 9907.0, 1: 10038.5. Samples: 995438712. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:11,175][105115] Avg episode reward: [(0, '-4.471'), (1, '-4.708')] [2023-12-28 09:13:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001946080_498253824.pth... [2023-12-28 09:13:11,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001941928_497213440.pth... [2023-12-28 09:13:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001944928_497958912.pth [2023-12-28 09:13:11,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001940776_496918528.pth [2023-12-28 09:13:11,238][106226] Updated weights for policy 0, policy_version 1941930 (0.0011) [2023-12-28 09:13:11,296][106226] Updated weights for policy 0, policy_version 1941940 (0.0010) [2023-12-28 09:13:11,373][106226] Updated weights for policy 0, policy_version 1941950 (0.0010) [2023-12-28 09:13:11,432][106226] Updated weights for policy 0, policy_version 1941960 (0.0011) [2023-12-28 09:13:11,659][106225] Updated weights for policy 1, policy_version 1946089 (0.0009) [2023-12-28 09:13:11,709][106225] Updated weights for policy 1, policy_version 1946099 (0.0009) [2023-12-28 09:13:11,778][106225] Updated weights for policy 1, policy_version 1946109 (0.0009) [2023-12-28 09:13:12,170][106226] Updated weights for policy 0, policy_version 1941970 (0.0008) [2023-12-28 09:13:12,225][106226] Updated weights for policy 0, policy_version 1941980 (0.0009) [2023-12-28 09:13:12,292][106226] Updated weights for policy 0, policy_version 1941990 (0.0008) [2023-12-28 09:13:12,573][106225] Updated weights for policy 1, policy_version 1946119 (0.0009) [2023-12-28 09:13:12,629][106225] Updated weights for policy 1, policy_version 1946129 (0.0009) [2023-12-28 09:13:12,677][106225] Updated weights for policy 1, policy_version 1946139 (0.0007) [2023-12-28 09:13:12,977][106226] Updated weights for policy 0, policy_version 1942000 (0.0009) [2023-12-28 09:13:13,035][106226] Updated weights for policy 0, policy_version 1942010 (0.0008) [2023-12-28 09:13:13,097][106226] Updated weights for policy 0, policy_version 1942020 (0.0009) [2023-12-28 09:13:13,400][106225] Updated weights for policy 1, policy_version 1946149 (0.0007) [2023-12-28 09:13:13,459][106225] Updated weights for policy 1, policy_version 1946159 (0.0009) [2023-12-28 09:13:13,522][106225] Updated weights for policy 1, policy_version 1946169 (0.0008) [2023-12-28 09:13:13,827][106226] Updated weights for policy 0, policy_version 1942030 (0.0008) [2023-12-28 09:13:13,879][106226] Updated weights for policy 0, policy_version 1942040 (0.0008) [2023-12-28 09:13:13,938][106226] Updated weights for policy 0, policy_version 1942050 (0.0009) [2023-12-28 09:13:14,181][106225] Updated weights for policy 1, policy_version 1946179 (0.0008) [2023-12-28 09:13:14,226][106225] Updated weights for policy 1, policy_version 1946189 (0.0008) [2023-12-28 09:13:14,282][106225] Updated weights for policy 1, policy_version 1946199 (0.0008) [2023-12-28 09:13:14,654][106226] Updated weights for policy 0, policy_version 1942060 (0.0009) [2023-12-28 09:13:14,707][106226] Updated weights for policy 0, policy_version 1942070 (0.0008) [2023-12-28 09:13:14,775][106226] Updated weights for policy 0, policy_version 1942080 (0.0006) [2023-12-28 09:13:15,070][106225] Updated weights for policy 1, policy_version 1946209 (0.0008) [2023-12-28 09:13:15,127][106225] Updated weights for policy 1, policy_version 1946219 (0.0009) [2023-12-28 09:13:15,190][106225] Updated weights for policy 1, policy_version 1946229 (0.0007) [2023-12-28 09:13:15,260][106225] Updated weights for policy 1, policy_version 1946239 (0.0008) [2023-12-28 09:13:15,514][106226] Updated weights for policy 0, policy_version 1942090 (0.0008) [2023-12-28 09:13:15,574][106226] Updated weights for policy 0, policy_version 1942100 (0.0008) [2023-12-28 09:13:15,621][106226] Updated weights for policy 0, policy_version 1942110 (0.0009) [2023-12-28 09:13:15,666][106226] Updated weights for policy 0, policy_version 1942120 (0.0008) [2023-12-28 09:13:15,942][106225] Updated weights for policy 1, policy_version 1946249 (0.0009) [2023-12-28 09:13:15,994][106225] Updated weights for policy 1, policy_version 1946259 (0.0009) [2023-12-28 09:13:16,048][106225] Updated weights for policy 1, policy_version 1946269 (0.0008) [2023-12-28 09:13:16,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19797.4, 300 sec: 19855.2). Total num frames: 995565568. Throughput: 0: 9777.1, 1: 9911.7. Samples: 995553888. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:16,175][105115] Avg episode reward: [(0, '-4.326'), (1, '-4.434')] [2023-12-28 09:13:16,414][106226] Updated weights for policy 0, policy_version 1942130 (0.0009) [2023-12-28 09:13:16,465][106226] Updated weights for policy 0, policy_version 1942140 (0.0006) [2023-12-28 09:13:16,520][106226] Updated weights for policy 0, policy_version 1942150 (0.0006) [2023-12-28 09:13:16,786][106225] Updated weights for policy 1, policy_version 1946279 (0.0008) [2023-12-28 09:13:16,836][106225] Updated weights for policy 1, policy_version 1946289 (0.0005) [2023-12-28 09:13:16,889][106225] Updated weights for policy 1, policy_version 1946299 (0.0005) [2023-12-28 09:13:17,177][106226] Updated weights for policy 0, policy_version 1942160 (0.0008) [2023-12-28 09:13:17,241][106226] Updated weights for policy 0, policy_version 1942170 (0.0009) [2023-12-28 09:13:17,293][106226] Updated weights for policy 0, policy_version 1942180 (0.0008) [2023-12-28 09:13:17,570][106225] Updated weights for policy 1, policy_version 1946309 (0.0005) [2023-12-28 09:13:17,625][106225] Updated weights for policy 1, policy_version 1946319 (0.0008) [2023-12-28 09:13:17,688][106225] Updated weights for policy 1, policy_version 1946329 (0.0008) [2023-12-28 09:13:18,065][106226] Updated weights for policy 0, policy_version 1942190 (0.0009) [2023-12-28 09:13:18,119][106226] Updated weights for policy 0, policy_version 1942200 (0.0008) [2023-12-28 09:13:18,173][106226] Updated weights for policy 0, policy_version 1942210 (0.0007) [2023-12-28 09:13:18,351][106225] Updated weights for policy 1, policy_version 1946339 (0.0009) [2023-12-28 09:13:18,409][106225] Updated weights for policy 1, policy_version 1946349 (0.0009) [2023-12-28 09:13:18,474][106225] Updated weights for policy 1, policy_version 1946359 (0.0009) [2023-12-28 09:13:18,942][106226] Updated weights for policy 0, policy_version 1942220 (0.0009) [2023-12-28 09:13:18,998][106226] Updated weights for policy 0, policy_version 1942230 (0.0008) [2023-12-28 09:13:19,045][106226] Updated weights for policy 0, policy_version 1942240 (0.0009) [2023-12-28 09:13:19,115][106225] Updated weights for policy 1, policy_version 1946369 (0.0008) [2023-12-28 09:13:19,174][106225] Updated weights for policy 1, policy_version 1946379 (0.0006) [2023-12-28 09:13:19,238][106225] Updated weights for policy 1, policy_version 1946389 (0.0009) [2023-12-28 09:13:19,294][106225] Updated weights for policy 1, policy_version 1946399 (0.0009) [2023-12-28 09:13:19,716][106226] Updated weights for policy 0, policy_version 1942250 (0.0006) [2023-12-28 09:13:19,777][106226] Updated weights for policy 0, policy_version 1942260 (0.0007) [2023-12-28 09:13:19,854][106226] Updated weights for policy 0, policy_version 1942270 (0.0008) [2023-12-28 09:13:19,920][106226] Updated weights for policy 0, policy_version 1942280 (0.0009) [2023-12-28 09:13:20,084][106225] Updated weights for policy 1, policy_version 1946409 (0.0008) [2023-12-28 09:13:20,146][106225] Updated weights for policy 1, policy_version 1946419 (0.0007) [2023-12-28 09:13:20,207][106225] Updated weights for policy 1, policy_version 1946429 (0.0007) [2023-12-28 09:13:20,654][106226] Updated weights for policy 0, policy_version 1942290 (0.0007) [2023-12-28 09:13:20,725][106226] Updated weights for policy 0, policy_version 1942300 (0.0006) [2023-12-28 09:13:20,790][106226] Updated weights for policy 0, policy_version 1942310 (0.0006) [2023-12-28 09:13:20,902][106225] Updated weights for policy 1, policy_version 1946439 (0.0006) [2023-12-28 09:13:20,971][106225] Updated weights for policy 1, policy_version 1946449 (0.0006) [2023-12-28 09:13:21,057][106225] Updated weights for policy 1, policy_version 1946459 (0.0006) [2023-12-28 09:13:21,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 995663872. Throughput: 0: 9765.3, 1: 9918.9. Samples: 995670764. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:21,175][105115] Avg episode reward: [(0, '-4.455'), (1, '-4.544')] [2023-12-28 09:13:21,548][106226] Updated weights for policy 0, policy_version 1942320 (0.0008) [2023-12-28 09:13:21,614][106226] Updated weights for policy 0, policy_version 1942330 (0.0008) [2023-12-28 09:13:21,685][106226] Updated weights for policy 0, policy_version 1942340 (0.0007) [2023-12-28 09:13:21,690][106225] Updated weights for policy 1, policy_version 1946469 (0.0007) [2023-12-28 09:13:21,768][106225] Updated weights for policy 1, policy_version 1946479 (0.0009) [2023-12-28 09:13:21,833][106225] Updated weights for policy 1, policy_version 1946489 (0.0008) [2023-12-28 09:13:22,486][106226] Updated weights for policy 0, policy_version 1942350 (0.0008) [2023-12-28 09:13:22,548][106225] Updated weights for policy 1, policy_version 1946499 (0.0008) [2023-12-28 09:13:22,551][106226] Updated weights for policy 0, policy_version 1942360 (0.0009) [2023-12-28 09:13:22,611][106226] Updated weights for policy 0, policy_version 1942370 (0.0010) [2023-12-28 09:13:22,614][106225] Updated weights for policy 1, policy_version 1946509 (0.0009) [2023-12-28 09:13:22,678][106225] Updated weights for policy 1, policy_version 1946519 (0.0008) [2023-12-28 09:13:23,196][106226] Updated weights for policy 0, policy_version 1942380 (0.0006) [2023-12-28 09:13:23,252][106226] Updated weights for policy 0, policy_version 1942390 (0.0007) [2023-12-28 09:13:23,310][106226] Updated weights for policy 0, policy_version 1942400 (0.0009) [2023-12-28 09:13:23,498][106225] Updated weights for policy 1, policy_version 1946529 (0.0010) [2023-12-28 09:13:23,546][106225] Updated weights for policy 1, policy_version 1946539 (0.0008) [2023-12-28 09:13:23,604][106225] Updated weights for policy 1, policy_version 1946549 (0.0008) [2023-12-28 09:13:23,663][106225] Updated weights for policy 1, policy_version 1946559 (0.0008) [2023-12-28 09:13:24,012][106226] Updated weights for policy 0, policy_version 1942410 (0.0008) [2023-12-28 09:13:24,071][106226] Updated weights for policy 0, policy_version 1942420 (0.0008) [2023-12-28 09:13:24,127][106226] Updated weights for policy 0, policy_version 1942430 (0.0007) [2023-12-28 09:13:24,177][106226] Updated weights for policy 0, policy_version 1942440 (0.0006) [2023-12-28 09:13:24,401][106225] Updated weights for policy 1, policy_version 1946569 (0.0008) [2023-12-28 09:13:24,464][106225] Updated weights for policy 1, policy_version 1946579 (0.0009) [2023-12-28 09:13:24,525][106225] Updated weights for policy 1, policy_version 1946589 (0.0007) [2023-12-28 09:13:24,826][106226] Updated weights for policy 0, policy_version 1942450 (0.0005) [2023-12-28 09:13:24,877][106226] Updated weights for policy 0, policy_version 1942460 (0.0006) [2023-12-28 09:13:24,926][106226] Updated weights for policy 0, policy_version 1942470 (0.0005) [2023-12-28 09:13:25,292][106225] Updated weights for policy 1, policy_version 1946599 (0.0008) [2023-12-28 09:13:25,341][106225] Updated weights for policy 1, policy_version 1946609 (0.0008) [2023-12-28 09:13:25,396][106225] Updated weights for policy 1, policy_version 1946619 (0.0008) [2023-12-28 09:13:25,555][106226] Updated weights for policy 0, policy_version 1942480 (0.0008) [2023-12-28 09:13:25,615][106226] Updated weights for policy 0, policy_version 1942490 (0.0009) [2023-12-28 09:13:25,669][106226] Updated weights for policy 0, policy_version 1942500 (0.0008) [2023-12-28 09:13:26,169][106225] Updated weights for policy 1, policy_version 1946629 (0.0009) [2023-12-28 09:13:26,175][105115] Fps is (10 sec: 18841.1, 60 sec: 19660.7, 300 sec: 19799.6). Total num frames: 995753984. Throughput: 0: 9780.3, 1: 9852.3. Samples: 995727684. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:26,176][105115] Avg episode reward: [(0, '-4.358'), (1, '-4.393')] [2023-12-28 09:13:26,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001942504_497360896.pth... [2023-12-28 09:13:26,190][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001941352_497065984.pth [2023-12-28 09:13:26,222][106225] Updated weights for policy 1, policy_version 1946639 (0.0007) [2023-12-28 09:13:26,280][106226] Updated weights for policy 0, policy_version 1942510 (0.0008) [2023-12-28 09:13:26,286][106225] Updated weights for policy 1, policy_version 1946649 (0.0007) [2023-12-28 09:13:26,320][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001946656_498401280.pth... [2023-12-28 09:13:26,323][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001945472_498098176.pth [2023-12-28 09:13:26,328][106226] Updated weights for policy 0, policy_version 1942520 (0.0006) [2023-12-28 09:13:26,381][106226] Updated weights for policy 0, policy_version 1942530 (0.0005) [2023-12-28 09:13:27,032][106225] Updated weights for policy 1, policy_version 1946659 (0.0008) [2023-12-28 09:13:27,067][106226] Updated weights for policy 0, policy_version 1942540 (0.0006) [2023-12-28 09:13:27,087][106225] Updated weights for policy 1, policy_version 1946669 (0.0008) [2023-12-28 09:13:27,123][106226] Updated weights for policy 0, policy_version 1942550 (0.0007) [2023-12-28 09:13:27,150][106225] Updated weights for policy 1, policy_version 1946679 (0.0009) [2023-12-28 09:13:27,179][106226] Updated weights for policy 0, policy_version 1942560 (0.0005) [2023-12-28 09:13:27,747][106225] Updated weights for policy 1, policy_version 1946689 (0.0008) [2023-12-28 09:13:27,788][106226] Updated weights for policy 0, policy_version 1942570 (0.0005) [2023-12-28 09:13:27,800][106225] Updated weights for policy 1, policy_version 1946699 (0.0006) [2023-12-28 09:13:27,851][106226] Updated weights for policy 0, policy_version 1942580 (0.0005) [2023-12-28 09:13:27,857][106225] Updated weights for policy 1, policy_version 1946709 (0.0006) [2023-12-28 09:13:27,903][106226] Updated weights for policy 0, policy_version 1942590 (0.0005) [2023-12-28 09:13:27,918][106225] Updated weights for policy 1, policy_version 1946719 (0.0006) [2023-12-28 09:13:27,966][106226] Updated weights for policy 0, policy_version 1942600 (0.0005) [2023-12-28 09:13:28,441][106225] Updated weights for policy 1, policy_version 1946729 (0.0008) [2023-12-28 09:13:28,494][106225] Updated weights for policy 1, policy_version 1946739 (0.0007) [2023-12-28 09:13:28,551][106225] Updated weights for policy 1, policy_version 1946749 (0.0005) [2023-12-28 09:13:28,646][106226] Updated weights for policy 0, policy_version 1942610 (0.0008) [2023-12-28 09:13:28,704][106226] Updated weights for policy 0, policy_version 1942620 (0.0007) [2023-12-28 09:13:28,764][106226] Updated weights for policy 0, policy_version 1942630 (0.0009) [2023-12-28 09:13:29,142][106225] Updated weights for policy 1, policy_version 1946759 (0.0007) [2023-12-28 09:13:29,186][106225] Updated weights for policy 1, policy_version 1946769 (0.0007) [2023-12-28 09:13:29,238][106225] Updated weights for policy 1, policy_version 1946779 (0.0007) [2023-12-28 09:13:29,488][106226] Updated weights for policy 0, policy_version 1942640 (0.0008) [2023-12-28 09:13:29,538][106226] Updated weights for policy 0, policy_version 1942650 (0.0008) [2023-12-28 09:13:29,597][106226] Updated weights for policy 0, policy_version 1942660 (0.0007) [2023-12-28 09:13:30,019][106225] Updated weights for policy 1, policy_version 1946789 (0.0009) [2023-12-28 09:13:30,067][106225] Updated weights for policy 1, policy_version 1946799 (0.0009) [2023-12-28 09:13:30,124][106225] Updated weights for policy 1, policy_version 1946809 (0.0008) [2023-12-28 09:13:30,383][106226] Updated weights for policy 0, policy_version 1942670 (0.0007) [2023-12-28 09:13:30,440][106226] Updated weights for policy 0, policy_version 1942680 (0.0008) [2023-12-28 09:13:30,507][106226] Updated weights for policy 0, policy_version 1942690 (0.0006) [2023-12-28 09:13:30,878][106225] Updated weights for policy 1, policy_version 1946819 (0.0009) [2023-12-28 09:13:30,933][106225] Updated weights for policy 1, policy_version 1946829 (0.0007) [2023-12-28 09:13:30,991][106225] Updated weights for policy 1, policy_version 1946839 (0.0005) [2023-12-28 09:13:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 995860480. Throughput: 0: 9873.2, 1: 9940.7. Samples: 995851040. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:31,175][105115] Avg episode reward: [(0, '-4.259'), (1, '-4.723')] [2023-12-28 09:13:31,209][106226] Updated weights for policy 0, policy_version 1942700 (0.0008) [2023-12-28 09:13:31,273][106226] Updated weights for policy 0, policy_version 1942710 (0.0009) [2023-12-28 09:13:31,337][106226] Updated weights for policy 0, policy_version 1942720 (0.0009) [2023-12-28 09:13:31,695][106225] Updated weights for policy 1, policy_version 1946849 (0.0007) [2023-12-28 09:13:31,772][106225] Updated weights for policy 1, policy_version 1946859 (0.0008) [2023-12-28 09:13:31,839][106225] Updated weights for policy 1, policy_version 1946869 (0.0006) [2023-12-28 09:13:31,904][106225] Updated weights for policy 1, policy_version 1946879 (0.0006) [2023-12-28 09:13:32,104][106226] Updated weights for policy 0, policy_version 1942730 (0.0009) [2023-12-28 09:13:32,159][106226] Updated weights for policy 0, policy_version 1942740 (0.0009) [2023-12-28 09:13:32,225][106226] Updated weights for policy 0, policy_version 1942750 (0.0008) [2023-12-28 09:13:32,293][106226] Updated weights for policy 0, policy_version 1942760 (0.0007) [2023-12-28 09:13:32,588][106225] Updated weights for policy 1, policy_version 1946889 (0.0005) [2023-12-28 09:13:32,639][106225] Updated weights for policy 1, policy_version 1946899 (0.0007) [2023-12-28 09:13:32,700][106225] Updated weights for policy 1, policy_version 1946909 (0.0008) [2023-12-28 09:13:33,038][106226] Updated weights for policy 0, policy_version 1942771 (0.0008) [2023-12-28 09:13:33,089][106226] Updated weights for policy 0, policy_version 1942782 (0.0009) [2023-12-28 09:13:33,263][106225] Updated weights for policy 1, policy_version 1946919 (0.0006) [2023-12-28 09:13:33,327][106225] Updated weights for policy 1, policy_version 1946929 (0.0005) [2023-12-28 09:13:33,384][106225] Updated weights for policy 1, policy_version 1946939 (0.0005) [2023-12-28 09:13:33,906][106226] Updated weights for policy 0, policy_version 1942793 (0.0009) [2023-12-28 09:13:33,972][106226] Updated weights for policy 0, policy_version 1942803 (0.0009) [2023-12-28 09:13:34,013][106225] Updated weights for policy 1, policy_version 1946949 (0.0007) [2023-12-28 09:13:34,032][106226] Updated weights for policy 0, policy_version 1942813 (0.0006) [2023-12-28 09:13:34,072][106225] Updated weights for policy 1, policy_version 1946959 (0.0007) [2023-12-28 09:13:34,092][106226] Updated weights for policy 0, policy_version 1942823 (0.0006) [2023-12-28 09:13:34,141][106225] Updated weights for policy 1, policy_version 1946969 (0.0008) [2023-12-28 09:13:34,801][106225] Updated weights for policy 1, policy_version 1946979 (0.0007) [2023-12-28 09:13:34,854][106225] Updated weights for policy 1, policy_version 1946989 (0.0005) [2023-12-28 09:13:34,863][106226] Updated weights for policy 0, policy_version 1942833 (0.0007) [2023-12-28 09:13:34,903][106225] Updated weights for policy 1, policy_version 1946999 (0.0005) [2023-12-28 09:13:34,923][106226] Updated weights for policy 0, policy_version 1942843 (0.0008) [2023-12-28 09:13:34,974][106226] Updated weights for policy 0, policy_version 1942853 (0.0009) [2023-12-28 09:13:35,422][106225] Updated weights for policy 1, policy_version 1947009 (0.0005) [2023-12-28 09:13:35,481][106225] Updated weights for policy 1, policy_version 1947019 (0.0005) [2023-12-28 09:13:35,548][106225] Updated weights for policy 1, policy_version 1947029 (0.0006) [2023-12-28 09:13:35,603][106225] Updated weights for policy 1, policy_version 1947039 (0.0005) [2023-12-28 09:13:35,773][106226] Updated weights for policy 0, policy_version 1942863 (0.0010) [2023-12-28 09:13:35,828][106226] Updated weights for policy 0, policy_version 1942873 (0.0011) [2023-12-28 09:13:35,884][106226] Updated weights for policy 0, policy_version 1942883 (0.0010) [2023-12-28 09:13:36,175][105115] Fps is (10 sec: 20480.5, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 995958784. Throughput: 0: 9826.8, 1: 10055.2. Samples: 995969252. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:36,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.613')] [2023-12-28 09:13:36,292][106225] Updated weights for policy 1, policy_version 1947049 (0.0010) [2023-12-28 09:13:36,364][106225] Updated weights for policy 1, policy_version 1947059 (0.0011) [2023-12-28 09:13:36,428][106225] Updated weights for policy 1, policy_version 1947069 (0.0011) [2023-12-28 09:13:36,571][106226] Updated weights for policy 0, policy_version 1942893 (0.0010) [2023-12-28 09:13:36,638][106226] Updated weights for policy 0, policy_version 1942903 (0.0011) [2023-12-28 09:13:36,704][106226] Updated weights for policy 0, policy_version 1942913 (0.0011) [2023-12-28 09:13:37,112][106225] Updated weights for policy 1, policy_version 1947079 (0.0010) [2023-12-28 09:13:37,170][106225] Updated weights for policy 1, policy_version 1947089 (0.0010) [2023-12-28 09:13:37,233][106225] Updated weights for policy 1, policy_version 1947099 (0.0011) [2023-12-28 09:13:37,390][106226] Updated weights for policy 0, policy_version 1942923 (0.0009) [2023-12-28 09:13:37,450][106226] Updated weights for policy 0, policy_version 1942933 (0.0005) [2023-12-28 09:13:37,502][106226] Updated weights for policy 0, policy_version 1942943 (0.0005) [2023-12-28 09:13:37,961][106225] Updated weights for policy 1, policy_version 1947109 (0.0011) [2023-12-28 09:13:38,021][106225] Updated weights for policy 1, policy_version 1947119 (0.0008) [2023-12-28 09:13:38,074][106225] Updated weights for policy 1, policy_version 1947129 (0.0010) [2023-12-28 09:13:38,113][106226] Updated weights for policy 0, policy_version 1942953 (0.0009) [2023-12-28 09:13:38,173][106226] Updated weights for policy 0, policy_version 1942963 (0.0010) [2023-12-28 09:13:38,228][106226] Updated weights for policy 0, policy_version 1942973 (0.0010) [2023-12-28 09:13:38,271][106226] Updated weights for policy 0, policy_version 1942983 (0.0010) [2023-12-28 09:13:38,810][106225] Updated weights for policy 1, policy_version 1947139 (0.0010) [2023-12-28 09:13:38,870][106225] Updated weights for policy 1, policy_version 1947149 (0.0008) [2023-12-28 09:13:38,935][106225] Updated weights for policy 1, policy_version 1947159 (0.0008) [2023-12-28 09:13:38,977][106226] Updated weights for policy 0, policy_version 1942993 (0.0011) [2023-12-28 09:13:39,031][106226] Updated weights for policy 0, policy_version 1943003 (0.0010) [2023-12-28 09:13:39,091][106226] Updated weights for policy 0, policy_version 1943013 (0.0010) [2023-12-28 09:13:39,636][106225] Updated weights for policy 1, policy_version 1947169 (0.0009) [2023-12-28 09:13:39,697][106225] Updated weights for policy 1, policy_version 1947179 (0.0007) [2023-12-28 09:13:39,768][106225] Updated weights for policy 1, policy_version 1947189 (0.0009) [2023-12-28 09:13:39,832][106225] Updated weights for policy 1, policy_version 1947199 (0.0008) [2023-12-28 09:13:39,836][106226] Updated weights for policy 0, policy_version 1943023 (0.0009) [2023-12-28 09:13:39,902][106226] Updated weights for policy 0, policy_version 1943033 (0.0008) [2023-12-28 09:13:39,970][106226] Updated weights for policy 0, policy_version 1943043 (0.0008) [2023-12-28 09:13:40,545][106225] Updated weights for policy 1, policy_version 1947209 (0.0009) [2023-12-28 09:13:40,607][106225] Updated weights for policy 1, policy_version 1947219 (0.0010) [2023-12-28 09:13:40,675][106225] Updated weights for policy 1, policy_version 1947229 (0.0011) [2023-12-28 09:13:40,716][106226] Updated weights for policy 0, policy_version 1943053 (0.0009) [2023-12-28 09:13:40,763][106226] Updated weights for policy 0, policy_version 1943063 (0.0008) [2023-12-28 09:13:40,831][106226] Updated weights for policy 0, policy_version 1943073 (0.0008) [2023-12-28 09:13:41,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.4, 300 sec: 19827.4). Total num frames: 996057088. Throughput: 0: 9873.9, 1: 10032.1. Samples: 996028896. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:41,175][105115] Avg episode reward: [(0, '-4.330'), (1, '-4.482')] [2023-12-28 09:13:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001943080_497508352.pth... [2023-12-28 09:13:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001947232_498548736.pth... [2023-12-28 09:13:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001941928_497213440.pth [2023-12-28 09:13:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001946080_498253824.pth [2023-12-28 09:13:41,186][106140] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/milestones/checkpoint_001943080_497508352.pth [2023-12-28 09:13:41,187][106141] Saving a milestone ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/milestones/checkpoint_001947232_498548736.pth [2023-12-28 09:13:41,388][106225] Updated weights for policy 1, policy_version 1947239 (0.0008) [2023-12-28 09:13:41,447][106225] Updated weights for policy 1, policy_version 1947249 (0.0008) [2023-12-28 09:13:41,510][106225] Updated weights for policy 1, policy_version 1947259 (0.0008) [2023-12-28 09:13:41,639][106226] Updated weights for policy 0, policy_version 1943083 (0.0006) [2023-12-28 09:13:41,702][106226] Updated weights for policy 0, policy_version 1943093 (0.0008) [2023-12-28 09:13:41,775][106226] Updated weights for policy 0, policy_version 1943103 (0.0008) [2023-12-28 09:13:42,279][106225] Updated weights for policy 1, policy_version 1947269 (0.0008) [2023-12-28 09:13:42,343][106225] Updated weights for policy 1, policy_version 1947279 (0.0009) [2023-12-28 09:13:42,409][106225] Updated weights for policy 1, policy_version 1947289 (0.0008) [2023-12-28 09:13:42,544][106226] Updated weights for policy 0, policy_version 1943113 (0.0008) [2023-12-28 09:13:42,611][106226] Updated weights for policy 0, policy_version 1943123 (0.0009) [2023-12-28 09:13:42,673][106226] Updated weights for policy 0, policy_version 1943133 (0.0009) [2023-12-28 09:13:42,730][106226] Updated weights for policy 0, policy_version 1943143 (0.0008) [2023-12-28 09:13:43,133][106225] Updated weights for policy 1, policy_version 1947299 (0.0008) [2023-12-28 09:13:43,182][106225] Updated weights for policy 1, policy_version 1947309 (0.0008) [2023-12-28 09:13:43,233][106225] Updated weights for policy 1, policy_version 1947319 (0.0008) [2023-12-28 09:13:43,439][106226] Updated weights for policy 0, policy_version 1943153 (0.0007) [2023-12-28 09:13:43,502][106226] Updated weights for policy 0, policy_version 1943163 (0.0005) [2023-12-28 09:13:43,567][106226] Updated weights for policy 0, policy_version 1943173 (0.0008) [2023-12-28 09:13:44,026][106225] Updated weights for policy 1, policy_version 1947329 (0.0008) [2023-12-28 09:13:44,095][106225] Updated weights for policy 1, policy_version 1947339 (0.0009) [2023-12-28 09:13:44,114][106226] Updated weights for policy 0, policy_version 1943183 (0.0006) [2023-12-28 09:13:44,157][106225] Updated weights for policy 1, policy_version 1947349 (0.0007) [2023-12-28 09:13:44,172][106226] Updated weights for policy 0, policy_version 1943193 (0.0009) [2023-12-28 09:13:44,213][106225] Updated weights for policy 1, policy_version 1947359 (0.0010) [2023-12-28 09:13:44,227][106226] Updated weights for policy 0, policy_version 1943203 (0.0007) [2023-12-28 09:13:44,809][106225] Updated weights for policy 1, policy_version 1947369 (0.0009) [2023-12-28 09:13:44,866][106225] Updated weights for policy 1, policy_version 1947379 (0.0007) [2023-12-28 09:13:44,925][106225] Updated weights for policy 1, policy_version 1947389 (0.0007) [2023-12-28 09:13:44,927][106226] Updated weights for policy 0, policy_version 1943213 (0.0006) [2023-12-28 09:13:44,988][106226] Updated weights for policy 0, policy_version 1943223 (0.0007) [2023-12-28 09:13:45,048][106226] Updated weights for policy 0, policy_version 1943233 (0.0007) [2023-12-28 09:13:45,639][106225] Updated weights for policy 1, policy_version 1947399 (0.0006) [2023-12-28 09:13:45,686][106225] Updated weights for policy 1, policy_version 1947409 (0.0005) [2023-12-28 09:13:45,736][106225] Updated weights for policy 1, policy_version 1947419 (0.0009) [2023-12-28 09:13:45,778][106226] Updated weights for policy 0, policy_version 1943243 (0.0009) [2023-12-28 09:13:45,833][106226] Updated weights for policy 0, policy_version 1943253 (0.0010) [2023-12-28 09:13:45,881][106226] Updated weights for policy 0, policy_version 1943263 (0.0010) [2023-12-28 09:13:46,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 996155392. Throughput: 0: 9797.1, 1: 9986.0. Samples: 996144464. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:46,175][105115] Avg episode reward: [(0, '-4.246'), (1, '-4.687')] [2023-12-28 09:13:46,442][106225] Updated weights for policy 1, policy_version 1947429 (0.0008) [2023-12-28 09:13:46,454][106226] Updated weights for policy 0, policy_version 1943273 (0.0008) [2023-12-28 09:13:46,505][106225] Updated weights for policy 1, policy_version 1947439 (0.0006) [2023-12-28 09:13:46,509][106226] Updated weights for policy 0, policy_version 1943283 (0.0008) [2023-12-28 09:13:46,560][106225] Updated weights for policy 1, policy_version 1947449 (0.0005) [2023-12-28 09:13:46,574][106226] Updated weights for policy 0, policy_version 1943293 (0.0011) [2023-12-28 09:13:46,634][106226] Updated weights for policy 0, policy_version 1943303 (0.0008) [2023-12-28 09:13:47,242][106225] Updated weights for policy 1, policy_version 1947459 (0.0009) [2023-12-28 09:13:47,289][106225] Updated weights for policy 1, policy_version 1947469 (0.0010) [2023-12-28 09:13:47,318][106226] Updated weights for policy 0, policy_version 1943313 (0.0010) [2023-12-28 09:13:47,337][106225] Updated weights for policy 1, policy_version 1947479 (0.0010) [2023-12-28 09:13:47,371][106226] Updated weights for policy 0, policy_version 1943323 (0.0010) [2023-12-28 09:13:47,421][106226] Updated weights for policy 0, policy_version 1943333 (0.0010) [2023-12-28 09:13:47,980][106225] Updated weights for policy 1, policy_version 1947489 (0.0010) [2023-12-28 09:13:48,043][106225] Updated weights for policy 1, policy_version 1947499 (0.0006) [2023-12-28 09:13:48,100][106225] Updated weights for policy 1, policy_version 1947509 (0.0005) [2023-12-28 09:13:48,105][106226] Updated weights for policy 0, policy_version 1943343 (0.0011) [2023-12-28 09:13:48,156][106225] Updated weights for policy 1, policy_version 1947519 (0.0005) [2023-12-28 09:13:48,164][106226] Updated weights for policy 0, policy_version 1943353 (0.0010) [2023-12-28 09:13:48,218][106226] Updated weights for policy 0, policy_version 1943363 (0.0010) [2023-12-28 09:13:48,816][106225] Updated weights for policy 1, policy_version 1947529 (0.0008) [2023-12-28 09:13:48,876][106225] Updated weights for policy 1, policy_version 1947539 (0.0008) [2023-12-28 09:13:48,922][106226] Updated weights for policy 0, policy_version 1943373 (0.0010) [2023-12-28 09:13:48,929][106225] Updated weights for policy 1, policy_version 1947549 (0.0009) [2023-12-28 09:13:48,974][106226] Updated weights for policy 0, policy_version 1943383 (0.0009) [2023-12-28 09:13:49,035][106226] Updated weights for policy 0, policy_version 1943393 (0.0008) [2023-12-28 09:13:49,627][106225] Updated weights for policy 1, policy_version 1947559 (0.0008) [2023-12-28 09:13:49,689][106225] Updated weights for policy 1, policy_version 1947569 (0.0008) [2023-12-28 09:13:49,752][106225] Updated weights for policy 1, policy_version 1947579 (0.0008) [2023-12-28 09:13:49,772][106226] Updated weights for policy 0, policy_version 1943403 (0.0009) [2023-12-28 09:13:49,833][106226] Updated weights for policy 0, policy_version 1943413 (0.0010) [2023-12-28 09:13:49,897][106226] Updated weights for policy 0, policy_version 1943423 (0.0008) [2023-12-28 09:13:50,473][106225] Updated weights for policy 1, policy_version 1947589 (0.0008) [2023-12-28 09:13:50,531][106225] Updated weights for policy 1, policy_version 1947599 (0.0008) [2023-12-28 09:13:50,591][106225] Updated weights for policy 1, policy_version 1947609 (0.0008) [2023-12-28 09:13:50,630][106226] Updated weights for policy 0, policy_version 1943433 (0.0009) [2023-12-28 09:13:50,688][106226] Updated weights for policy 0, policy_version 1943443 (0.0007) [2023-12-28 09:13:50,757][106226] Updated weights for policy 0, policy_version 1943453 (0.0010) [2023-12-28 09:13:50,816][106226] Updated weights for policy 0, policy_version 1943463 (0.0009) [2023-12-28 09:13:51,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 996253696. Throughput: 0: 9789.7, 1: 9978.7. Samples: 996264320. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:51,175][105115] Avg episode reward: [(0, '-4.279'), (1, '-4.673')] [2023-12-28 09:13:51,232][106225] Updated weights for policy 1, policy_version 1947619 (0.0008) [2023-12-28 09:13:51,300][106225] Updated weights for policy 1, policy_version 1947629 (0.0007) [2023-12-28 09:13:51,373][106225] Updated weights for policy 1, policy_version 1947639 (0.0008) [2023-12-28 09:13:51,511][106226] Updated weights for policy 0, policy_version 1943473 (0.0006) [2023-12-28 09:13:51,564][106226] Updated weights for policy 0, policy_version 1943483 (0.0006) [2023-12-28 09:13:51,625][106226] Updated weights for policy 0, policy_version 1943493 (0.0008) [2023-12-28 09:13:52,106][106225] Updated weights for policy 1, policy_version 1947649 (0.0008) [2023-12-28 09:13:52,166][106225] Updated weights for policy 1, policy_version 1947659 (0.0009) [2023-12-28 09:13:52,224][106225] Updated weights for policy 1, policy_version 1947669 (0.0008) [2023-12-28 09:13:52,285][106225] Updated weights for policy 1, policy_version 1947679 (0.0007) [2023-12-28 09:13:52,317][106226] Updated weights for policy 0, policy_version 1943503 (0.0008) [2023-12-28 09:13:52,390][106226] Updated weights for policy 0, policy_version 1943513 (0.0008) [2023-12-28 09:13:52,460][106226] Updated weights for policy 0, policy_version 1943523 (0.0007) [2023-12-28 09:13:53,005][106225] Updated weights for policy 1, policy_version 1947689 (0.0009) [2023-12-28 09:13:53,058][106225] Updated weights for policy 1, policy_version 1947699 (0.0009) [2023-12-28 09:13:53,117][106225] Updated weights for policy 1, policy_version 1947709 (0.0009) [2023-12-28 09:13:53,184][106226] Updated weights for policy 0, policy_version 1943533 (0.0009) [2023-12-28 09:13:53,231][106226] Updated weights for policy 0, policy_version 1943543 (0.0009) [2023-12-28 09:13:53,276][106226] Updated weights for policy 0, policy_version 1943553 (0.0008) [2023-12-28 09:13:53,851][106225] Updated weights for policy 1, policy_version 1947719 (0.0008) [2023-12-28 09:13:53,902][106225] Updated weights for policy 1, policy_version 1947729 (0.0008) [2023-12-28 09:13:53,950][106225] Updated weights for policy 1, policy_version 1947739 (0.0008) [2023-12-28 09:13:54,027][106226] Updated weights for policy 0, policy_version 1943563 (0.0009) [2023-12-28 09:13:54,080][106226] Updated weights for policy 0, policy_version 1943574 (0.0009) [2023-12-28 09:13:54,143][106226] Updated weights for policy 0, policy_version 1943584 (0.0009) [2023-12-28 09:13:54,733][106225] Updated weights for policy 1, policy_version 1947749 (0.0007) [2023-12-28 09:13:54,777][106226] Updated weights for policy 0, policy_version 1943594 (0.0007) [2023-12-28 09:13:54,783][106225] Updated weights for policy 1, policy_version 1947759 (0.0007) [2023-12-28 09:13:54,831][106225] Updated weights for policy 1, policy_version 1947769 (0.0006) [2023-12-28 09:13:54,835][106226] Updated weights for policy 0, policy_version 1943604 (0.0007) [2023-12-28 09:13:54,885][106226] Updated weights for policy 0, policy_version 1943614 (0.0007) [2023-12-28 09:13:54,934][106226] Updated weights for policy 0, policy_version 1943624 (0.0008) [2023-12-28 09:13:55,556][106225] Updated weights for policy 1, policy_version 1947779 (0.0007) [2023-12-28 09:13:55,613][106225] Updated weights for policy 1, policy_version 1947789 (0.0009) [2023-12-28 09:13:55,672][106225] Updated weights for policy 1, policy_version 1947799 (0.0008) [2023-12-28 09:13:55,674][106226] Updated weights for policy 0, policy_version 1943634 (0.0009) [2023-12-28 09:13:55,723][106226] Updated weights for policy 0, policy_version 1943644 (0.0007) [2023-12-28 09:13:55,771][106226] Updated weights for policy 0, policy_version 1943654 (0.0009) [2023-12-28 09:13:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19797.2, 300 sec: 19827.4). Total num frames: 996352000. Throughput: 0: 9717.8, 1: 9916.0. Samples: 996322240. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:13:56,176][105115] Avg episode reward: [(0, '-4.362'), (1, '-4.536')] [2023-12-28 09:13:56,183][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001943656_497655808.pth... [2023-12-28 09:13:56,183][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001947808_498696192.pth... [2023-12-28 09:13:56,188][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001942504_497360896.pth [2023-12-28 09:13:56,191][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001946656_498401280.pth [2023-12-28 09:13:56,419][106226] Updated weights for policy 0, policy_version 1943664 (0.0007) [2023-12-28 09:13:56,436][106225] Updated weights for policy 1, policy_version 1947809 (0.0007) [2023-12-28 09:13:56,476][106226] Updated weights for policy 0, policy_version 1943674 (0.0010) [2023-12-28 09:13:56,488][106225] Updated weights for policy 1, policy_version 1947819 (0.0006) [2023-12-28 09:13:56,540][106225] Updated weights for policy 1, policy_version 1947829 (0.0006) [2023-12-28 09:13:56,540][106226] Updated weights for policy 0, policy_version 1943684 (0.0009) [2023-12-28 09:13:56,601][106225] Updated weights for policy 1, policy_version 1947839 (0.0006) [2023-12-28 09:13:57,164][106226] Updated weights for policy 0, policy_version 1943694 (0.0007) [2023-12-28 09:13:57,182][106225] Updated weights for policy 1, policy_version 1947849 (0.0006) [2023-12-28 09:13:57,214][106226] Updated weights for policy 0, policy_version 1943704 (0.0008) [2023-12-28 09:13:57,230][106225] Updated weights for policy 1, policy_version 1947859 (0.0005) [2023-12-28 09:13:57,259][106226] Updated weights for policy 0, policy_version 1943714 (0.0007) [2023-12-28 09:13:57,283][106225] Updated weights for policy 1, policy_version 1947869 (0.0005) [2023-12-28 09:13:57,796][106225] Updated weights for policy 1, policy_version 1947879 (0.0008) [2023-12-28 09:13:57,855][106225] Updated weights for policy 1, policy_version 1947889 (0.0007) [2023-12-28 09:13:57,915][106225] Updated weights for policy 1, policy_version 1947899 (0.0008) [2023-12-28 09:13:58,088][106226] Updated weights for policy 0, policy_version 1943724 (0.0008) [2023-12-28 09:13:58,140][106226] Updated weights for policy 0, policy_version 1943734 (0.0009) [2023-12-28 09:13:58,190][106226] Updated weights for policy 0, policy_version 1943744 (0.0008) [2023-12-28 09:13:58,633][106225] Updated weights for policy 1, policy_version 1947909 (0.0007) [2023-12-28 09:13:58,698][106225] Updated weights for policy 1, policy_version 1947919 (0.0008) [2023-12-28 09:13:58,774][106225] Updated weights for policy 1, policy_version 1947929 (0.0009) [2023-12-28 09:13:59,090][106226] Updated weights for policy 0, policy_version 1943754 (0.0009) [2023-12-28 09:13:59,151][106226] Updated weights for policy 0, policy_version 1943764 (0.0008) [2023-12-28 09:13:59,210][106226] Updated weights for policy 0, policy_version 1943774 (0.0008) [2023-12-28 09:13:59,280][106226] Updated weights for policy 0, policy_version 1943784 (0.0008) [2023-12-28 09:13:59,562][106225] Updated weights for policy 1, policy_version 1947939 (0.0008) [2023-12-28 09:13:59,630][106225] Updated weights for policy 1, policy_version 1947949 (0.0005) [2023-12-28 09:13:59,689][106225] Updated weights for policy 1, policy_version 1947959 (0.0005) [2023-12-28 09:14:00,068][106226] Updated weights for policy 0, policy_version 1943794 (0.0008) [2023-12-28 09:14:00,128][106226] Updated weights for policy 0, policy_version 1943804 (0.0009) [2023-12-28 09:14:00,193][106226] Updated weights for policy 0, policy_version 1943814 (0.0007) [2023-12-28 09:14:00,387][106225] Updated weights for policy 1, policy_version 1947969 (0.0006) [2023-12-28 09:14:00,452][106225] Updated weights for policy 1, policy_version 1947979 (0.0006) [2023-12-28 09:14:00,501][106225] Updated weights for policy 1, policy_version 1947989 (0.0007) [2023-12-28 09:14:00,554][106225] Updated weights for policy 1, policy_version 1947999 (0.0008) [2023-12-28 09:14:00,837][106226] Updated weights for policy 0, policy_version 1943824 (0.0006) [2023-12-28 09:14:00,889][106226] Updated weights for policy 0, policy_version 1943834 (0.0005) [2023-12-28 09:14:00,937][106226] Updated weights for policy 0, policy_version 1943844 (0.0010) [2023-12-28 09:14:01,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 996450304. Throughput: 0: 9748.3, 1: 9948.3. Samples: 996440232. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:01,175][105115] Avg episode reward: [(0, '-4.223'), (1, '-5.008')] [2023-12-28 09:14:01,298][106225] Updated weights for policy 1, policy_version 1948009 (0.0010) [2023-12-28 09:14:01,361][106225] Updated weights for policy 1, policy_version 1948019 (0.0010) [2023-12-28 09:14:01,425][106225] Updated weights for policy 1, policy_version 1948029 (0.0006) [2023-12-28 09:14:01,593][106226] Updated weights for policy 0, policy_version 1943854 (0.0010) [2023-12-28 09:14:01,662][106226] Updated weights for policy 0, policy_version 1943864 (0.0008) [2023-12-28 09:14:01,724][106226] Updated weights for policy 0, policy_version 1943874 (0.0007) [2023-12-28 09:14:02,051][106225] Updated weights for policy 1, policy_version 1948039 (0.0008) [2023-12-28 09:14:02,114][106225] Updated weights for policy 1, policy_version 1948049 (0.0006) [2023-12-28 09:14:02,176][106225] Updated weights for policy 1, policy_version 1948059 (0.0007) [2023-12-28 09:14:02,403][106226] Updated weights for policy 0, policy_version 1943884 (0.0010) [2023-12-28 09:14:02,453][106226] Updated weights for policy 0, policy_version 1943894 (0.0008) [2023-12-28 09:14:02,519][106226] Updated weights for policy 0, policy_version 1943904 (0.0008) [2023-12-28 09:14:02,885][106225] Updated weights for policy 1, policy_version 1948069 (0.0008) [2023-12-28 09:14:02,958][106225] Updated weights for policy 1, policy_version 1948079 (0.0007) [2023-12-28 09:14:03,016][106225] Updated weights for policy 1, policy_version 1948089 (0.0006) [2023-12-28 09:14:03,240][106226] Updated weights for policy 0, policy_version 1943914 (0.0007) [2023-12-28 09:14:03,306][106226] Updated weights for policy 0, policy_version 1943924 (0.0007) [2023-12-28 09:14:03,370][106226] Updated weights for policy 0, policy_version 1943934 (0.0008) [2023-12-28 09:14:03,417][106226] Updated weights for policy 0, policy_version 1943944 (0.0007) [2023-12-28 09:14:03,697][106225] Updated weights for policy 1, policy_version 1948099 (0.0008) [2023-12-28 09:14:03,740][106225] Updated weights for policy 1, policy_version 1948109 (0.0008) [2023-12-28 09:14:03,797][106225] Updated weights for policy 1, policy_version 1948119 (0.0008) [2023-12-28 09:14:04,106][106226] Updated weights for policy 0, policy_version 1943954 (0.0007) [2023-12-28 09:14:04,167][106226] Updated weights for policy 0, policy_version 1943964 (0.0009) [2023-12-28 09:14:04,232][106226] Updated weights for policy 0, policy_version 1943974 (0.0008) [2023-12-28 09:14:04,605][106225] Updated weights for policy 1, policy_version 1948129 (0.0008) [2023-12-28 09:14:04,661][106225] Updated weights for policy 1, policy_version 1948139 (0.0009) [2023-12-28 09:14:04,714][106225] Updated weights for policy 1, policy_version 1948149 (0.0009) [2023-12-28 09:14:04,770][106225] Updated weights for policy 1, policy_version 1948159 (0.0008) [2023-12-28 09:14:04,881][106226] Updated weights for policy 0, policy_version 1943984 (0.0008) [2023-12-28 09:14:04,949][106226] Updated weights for policy 0, policy_version 1943994 (0.0006) [2023-12-28 09:14:05,017][106226] Updated weights for policy 0, policy_version 1944004 (0.0005) [2023-12-28 09:14:05,413][106225] Updated weights for policy 1, policy_version 1948169 (0.0006) [2023-12-28 09:14:05,469][106225] Updated weights for policy 1, policy_version 1948179 (0.0005) [2023-12-28 09:14:05,516][106225] Updated weights for policy 1, policy_version 1948189 (0.0005) [2023-12-28 09:14:05,643][106226] Updated weights for policy 0, policy_version 1944014 (0.0008) [2023-12-28 09:14:05,693][106226] Updated weights for policy 0, policy_version 1944024 (0.0010) [2023-12-28 09:14:05,746][106226] Updated weights for policy 0, policy_version 1944034 (0.0010) [2023-12-28 09:14:06,113][106225] Updated weights for policy 1, policy_version 1948199 (0.0007) [2023-12-28 09:14:06,175][105115] Fps is (10 sec: 19661.2, 60 sec: 19797.3, 300 sec: 19827.4). Total num frames: 996548608. Throughput: 0: 9816.7, 1: 9945.7. Samples: 996560072. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:06,175][105115] Avg episode reward: [(0, '-4.307'), (1, '-4.630')] [2023-12-28 09:14:06,177][106225] Updated weights for policy 1, policy_version 1948209 (0.0007) [2023-12-28 09:14:06,236][106225] Updated weights for policy 1, policy_version 1948219 (0.0008) [2023-12-28 09:14:06,475][106226] Updated weights for policy 0, policy_version 1944044 (0.0011) [2023-12-28 09:14:06,539][106226] Updated weights for policy 0, policy_version 1944054 (0.0011) [2023-12-28 09:14:06,604][106226] Updated weights for policy 0, policy_version 1944064 (0.0011) [2023-12-28 09:14:06,939][106225] Updated weights for policy 1, policy_version 1948229 (0.0008) [2023-12-28 09:14:07,006][106225] Updated weights for policy 1, policy_version 1948239 (0.0009) [2023-12-28 09:14:07,069][106225] Updated weights for policy 1, policy_version 1948249 (0.0008) [2023-12-28 09:14:07,267][106226] Updated weights for policy 0, policy_version 1944074 (0.0010) [2023-12-28 09:14:07,313][106226] Updated weights for policy 0, policy_version 1944084 (0.0005) [2023-12-28 09:14:07,374][106226] Updated weights for policy 0, policy_version 1944094 (0.0005) [2023-12-28 09:14:07,426][106226] Updated weights for policy 0, policy_version 1944104 (0.0006) [2023-12-28 09:14:07,778][106225] Updated weights for policy 1, policy_version 1948259 (0.0008) [2023-12-28 09:14:07,830][106225] Updated weights for policy 1, policy_version 1948269 (0.0008) [2023-12-28 09:14:07,890][106225] Updated weights for policy 1, policy_version 1948279 (0.0008) [2023-12-28 09:14:08,041][106226] Updated weights for policy 0, policy_version 1944114 (0.0006) [2023-12-28 09:14:08,104][106226] Updated weights for policy 0, policy_version 1944124 (0.0007) [2023-12-28 09:14:08,165][106226] Updated weights for policy 0, policy_version 1944134 (0.0009) [2023-12-28 09:14:08,654][106225] Updated weights for policy 1, policy_version 1948289 (0.0008) [2023-12-28 09:14:08,715][106225] Updated weights for policy 1, policy_version 1948299 (0.0009) [2023-12-28 09:14:08,774][106225] Updated weights for policy 1, policy_version 1948309 (0.0008) [2023-12-28 09:14:08,835][106225] Updated weights for policy 1, policy_version 1948319 (0.0008) [2023-12-28 09:14:08,858][106226] Updated weights for policy 0, policy_version 1944144 (0.0008) [2023-12-28 09:14:08,916][106226] Updated weights for policy 0, policy_version 1944154 (0.0009) [2023-12-28 09:14:08,971][106226] Updated weights for policy 0, policy_version 1944164 (0.0009) [2023-12-28 09:14:09,668][106226] Updated weights for policy 0, policy_version 1944174 (0.0007) [2023-12-28 09:14:09,670][106225] Updated weights for policy 1, policy_version 1948329 (0.0007) [2023-12-28 09:14:09,729][106225] Updated weights for policy 1, policy_version 1948339 (0.0006) [2023-12-28 09:14:09,731][106226] Updated weights for policy 0, policy_version 1944184 (0.0007) [2023-12-28 09:14:09,788][106225] Updated weights for policy 1, policy_version 1948349 (0.0006) [2023-12-28 09:14:09,790][106226] Updated weights for policy 0, policy_version 1944194 (0.0008) [2023-12-28 09:14:10,495][106225] Updated weights for policy 1, policy_version 1948359 (0.0008) [2023-12-28 09:14:10,545][106225] Updated weights for policy 1, policy_version 1948369 (0.0006) [2023-12-28 09:14:10,593][106225] Updated weights for policy 1, policy_version 1948379 (0.0005) [2023-12-28 09:14:10,602][106226] Updated weights for policy 0, policy_version 1944204 (0.0008) [2023-12-28 09:14:10,671][106226] Updated weights for policy 0, policy_version 1944214 (0.0009) [2023-12-28 09:14:10,736][106226] Updated weights for policy 0, policy_version 1944224 (0.0011) [2023-12-28 09:14:11,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 996646912. Throughput: 0: 9845.8, 1: 9982.7. Samples: 996619964. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:11,175][105115] Avg episode reward: [(0, '-4.605'), (1, '-4.645')] [2023-12-28 09:14:11,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001944232_497803264.pth... [2023-12-28 09:14:11,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001948384_498843648.pth... [2023-12-28 09:14:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001943080_497508352.pth [2023-12-28 09:14:11,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001947232_498548736.pth [2023-12-28 09:14:11,294][106225] Updated weights for policy 1, policy_version 1948389 (0.0008) [2023-12-28 09:14:11,358][106225] Updated weights for policy 1, policy_version 1948399 (0.0008) [2023-12-28 09:14:11,430][106225] Updated weights for policy 1, policy_version 1948409 (0.0008) [2023-12-28 09:14:11,454][106226] Updated weights for policy 0, policy_version 1944234 (0.0011) [2023-12-28 09:14:11,516][106226] Updated weights for policy 0, policy_version 1944244 (0.0011) [2023-12-28 09:14:11,580][106226] Updated weights for policy 0, policy_version 1944254 (0.0011) [2023-12-28 09:14:11,649][106226] Updated weights for policy 0, policy_version 1944264 (0.0011) [2023-12-28 09:14:12,125][106225] Updated weights for policy 1, policy_version 1948419 (0.0007) [2023-12-28 09:14:12,184][106225] Updated weights for policy 1, policy_version 1948429 (0.0005) [2023-12-28 09:14:12,238][106225] Updated weights for policy 1, policy_version 1948439 (0.0008) [2023-12-28 09:14:12,402][106226] Updated weights for policy 0, policy_version 1944274 (0.0008) [2023-12-28 09:14:12,453][106226] Updated weights for policy 0, policy_version 1944284 (0.0009) [2023-12-28 09:14:12,507][106226] Updated weights for policy 0, policy_version 1944294 (0.0008) [2023-12-28 09:14:12,898][106225] Updated weights for policy 1, policy_version 1948449 (0.0009) [2023-12-28 09:14:12,966][106225] Updated weights for policy 1, policy_version 1948459 (0.0007) [2023-12-28 09:14:13,027][106225] Updated weights for policy 1, policy_version 1948469 (0.0006) [2023-12-28 09:14:13,085][106225] Updated weights for policy 1, policy_version 1948479 (0.0006) [2023-12-28 09:14:13,295][106226] Updated weights for policy 0, policy_version 1944304 (0.0005) [2023-12-28 09:14:13,349][106226] Updated weights for policy 0, policy_version 1944314 (0.0005) [2023-12-28 09:14:13,419][106226] Updated weights for policy 0, policy_version 1944324 (0.0005) [2023-12-28 09:14:13,715][106225] Updated weights for policy 1, policy_version 1948489 (0.0005) [2023-12-28 09:14:13,773][106225] Updated weights for policy 1, policy_version 1948499 (0.0005) [2023-12-28 09:14:13,834][106225] Updated weights for policy 1, policy_version 1948509 (0.0005) [2023-12-28 09:14:14,069][106226] Updated weights for policy 0, policy_version 1944334 (0.0007) [2023-12-28 09:14:14,121][106226] Updated weights for policy 0, policy_version 1944344 (0.0008) [2023-12-28 09:14:14,181][106226] Updated weights for policy 0, policy_version 1944354 (0.0008) [2023-12-28 09:14:14,467][106225] Updated weights for policy 1, policy_version 1948519 (0.0006) [2023-12-28 09:14:14,520][106225] Updated weights for policy 1, policy_version 1948529 (0.0005) [2023-12-28 09:14:14,571][106225] Updated weights for policy 1, policy_version 1948539 (0.0007) [2023-12-28 09:14:14,913][106226] Updated weights for policy 0, policy_version 1944364 (0.0007) [2023-12-28 09:14:14,977][106226] Updated weights for policy 0, policy_version 1944374 (0.0006) [2023-12-28 09:14:15,046][106226] Updated weights for policy 0, policy_version 1944384 (0.0008) [2023-12-28 09:14:15,296][106225] Updated weights for policy 1, policy_version 1948549 (0.0009) [2023-12-28 09:14:15,356][106225] Updated weights for policy 1, policy_version 1948559 (0.0008) [2023-12-28 09:14:15,405][106225] Updated weights for policy 1, policy_version 1948569 (0.0009) [2023-12-28 09:14:15,667][106226] Updated weights for policy 0, policy_version 1944394 (0.0007) [2023-12-28 09:14:15,721][106226] Updated weights for policy 0, policy_version 1944404 (0.0006) [2023-12-28 09:14:15,779][106226] Updated weights for policy 0, policy_version 1944414 (0.0009) [2023-12-28 09:14:15,840][106226] Updated weights for policy 0, policy_version 1944424 (0.0009) [2023-12-28 09:14:16,156][106225] Updated weights for policy 1, policy_version 1948579 (0.0008) [2023-12-28 09:14:16,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 996745216. Throughput: 0: 9723.5, 1: 9970.8. Samples: 996737280. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:16,175][105115] Avg episode reward: [(0, '-4.376'), (1, '-4.502')] [2023-12-28 09:14:16,215][106225] Updated weights for policy 1, policy_version 1948589 (0.0008) [2023-12-28 09:14:16,269][106225] Updated weights for policy 1, policy_version 1948599 (0.0008) [2023-12-28 09:14:16,556][106226] Updated weights for policy 0, policy_version 1944434 (0.0008) [2023-12-28 09:14:16,617][106226] Updated weights for policy 0, policy_version 1944444 (0.0009) [2023-12-28 09:14:16,677][106226] Updated weights for policy 0, policy_version 1944454 (0.0008) [2023-12-28 09:14:16,972][106225] Updated weights for policy 1, policy_version 1948609 (0.0008) [2023-12-28 09:14:17,030][106225] Updated weights for policy 1, policy_version 1948619 (0.0008) [2023-12-28 09:14:17,082][106225] Updated weights for policy 1, policy_version 1948629 (0.0008) [2023-12-28 09:14:17,131][106225] Updated weights for policy 1, policy_version 1948639 (0.0008) [2023-12-28 09:14:17,387][106226] Updated weights for policy 0, policy_version 1944464 (0.0009) [2023-12-28 09:14:17,450][106226] Updated weights for policy 0, policy_version 1944474 (0.0008) [2023-12-28 09:14:17,509][106226] Updated weights for policy 0, policy_version 1944484 (0.0007) [2023-12-28 09:14:17,929][106225] Updated weights for policy 1, policy_version 1948649 (0.0009) [2023-12-28 09:14:17,991][106225] Updated weights for policy 1, policy_version 1948659 (0.0008) [2023-12-28 09:14:18,043][106225] Updated weights for policy 1, policy_version 1948669 (0.0008) [2023-12-28 09:14:18,086][106226] Updated weights for policy 0, policy_version 1944494 (0.0007) [2023-12-28 09:14:18,145][106226] Updated weights for policy 0, policy_version 1944504 (0.0008) [2023-12-28 09:14:18,209][106226] Updated weights for policy 0, policy_version 1944514 (0.0009) [2023-12-28 09:14:18,785][106225] Updated weights for policy 1, policy_version 1948679 (0.0008) [2023-12-28 09:14:18,844][106225] Updated weights for policy 1, policy_version 1948689 (0.0008) [2023-12-28 09:14:18,900][106225] Updated weights for policy 1, policy_version 1948699 (0.0009) [2023-12-28 09:14:18,957][106226] Updated weights for policy 0, policy_version 1944524 (0.0007) [2023-12-28 09:14:19,021][106226] Updated weights for policy 0, policy_version 1944534 (0.0008) [2023-12-28 09:14:19,085][106226] Updated weights for policy 0, policy_version 1944544 (0.0009) [2023-12-28 09:14:19,596][106225] Updated weights for policy 1, policy_version 1948709 (0.0008) [2023-12-28 09:14:19,653][106225] Updated weights for policy 1, policy_version 1948719 (0.0008) [2023-12-28 09:14:19,708][106225] Updated weights for policy 1, policy_version 1948729 (0.0008) [2023-12-28 09:14:19,886][106226] Updated weights for policy 0, policy_version 1944554 (0.0008) [2023-12-28 09:14:19,957][106226] Updated weights for policy 0, policy_version 1944564 (0.0007) [2023-12-28 09:14:20,024][106226] Updated weights for policy 0, policy_version 1944574 (0.0009) [2023-12-28 09:14:20,086][106226] Updated weights for policy 0, policy_version 1944584 (0.0011) [2023-12-28 09:14:20,502][106225] Updated weights for policy 1, policy_version 1948739 (0.0008) [2023-12-28 09:14:20,556][106225] Updated weights for policy 1, policy_version 1948749 (0.0008) [2023-12-28 09:14:20,623][106225] Updated weights for policy 1, policy_version 1948759 (0.0009) [2023-12-28 09:14:20,765][106226] Updated weights for policy 0, policy_version 1944594 (0.0011) [2023-12-28 09:14:20,826][106226] Updated weights for policy 0, policy_version 1944604 (0.0010) [2023-12-28 09:14:20,890][106226] Updated weights for policy 0, policy_version 1944614 (0.0008) [2023-12-28 09:14:21,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19827.4). Total num frames: 996843520. Throughput: 0: 9834.9, 1: 9795.7. Samples: 996852632. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:21,175][105115] Avg episode reward: [(0, '-4.158'), (1, '-4.369')] [2023-12-28 09:14:21,362][106225] Updated weights for policy 1, policy_version 1948769 (0.0009) [2023-12-28 09:14:21,434][106225] Updated weights for policy 1, policy_version 1948779 (0.0008) [2023-12-28 09:14:21,492][106225] Updated weights for policy 1, policy_version 1948789 (0.0008) [2023-12-28 09:14:21,547][106225] Updated weights for policy 1, policy_version 1948799 (0.0008) [2023-12-28 09:14:21,629][106226] Updated weights for policy 0, policy_version 1944624 (0.0007) [2023-12-28 09:14:21,697][106226] Updated weights for policy 0, policy_version 1944634 (0.0008) [2023-12-28 09:14:21,762][106226] Updated weights for policy 0, policy_version 1944644 (0.0008) [2023-12-28 09:14:22,306][106225] Updated weights for policy 1, policy_version 1948809 (0.0008) [2023-12-28 09:14:22,370][106225] Updated weights for policy 1, policy_version 1948819 (0.0007) [2023-12-28 09:14:22,431][106225] Updated weights for policy 1, policy_version 1948829 (0.0008) [2023-12-28 09:14:22,573][106226] Updated weights for policy 0, policy_version 1944654 (0.0008) [2023-12-28 09:14:22,633][106226] Updated weights for policy 0, policy_version 1944664 (0.0008) [2023-12-28 09:14:22,694][106226] Updated weights for policy 0, policy_version 1944674 (0.0009) [2023-12-28 09:14:23,137][106225] Updated weights for policy 1, policy_version 1948839 (0.0008) [2023-12-28 09:14:23,190][106225] Updated weights for policy 1, policy_version 1948849 (0.0009) [2023-12-28 09:14:23,240][106225] Updated weights for policy 1, policy_version 1948859 (0.0006) [2023-12-28 09:14:23,480][106226] Updated weights for policy 0, policy_version 1944684 (0.0008) [2023-12-28 09:14:23,536][106226] Updated weights for policy 0, policy_version 1944694 (0.0009) [2023-12-28 09:14:23,595][106226] Updated weights for policy 0, policy_version 1944704 (0.0008) [2023-12-28 09:14:23,865][106225] Updated weights for policy 1, policy_version 1948869 (0.0007) [2023-12-28 09:14:23,925][106225] Updated weights for policy 1, policy_version 1948879 (0.0008) [2023-12-28 09:14:23,993][106225] Updated weights for policy 1, policy_version 1948889 (0.0008) [2023-12-28 09:14:24,384][106226] Updated weights for policy 0, policy_version 1944714 (0.0009) [2023-12-28 09:14:24,437][106226] Updated weights for policy 0, policy_version 1944724 (0.0007) [2023-12-28 09:14:24,498][106226] Updated weights for policy 0, policy_version 1944734 (0.0005) [2023-12-28 09:14:24,560][106226] Updated weights for policy 0, policy_version 1944744 (0.0005) [2023-12-28 09:14:24,727][106225] Updated weights for policy 1, policy_version 1948899 (0.0007) [2023-12-28 09:14:24,777][106225] Updated weights for policy 1, policy_version 1948909 (0.0008) [2023-12-28 09:14:24,829][106225] Updated weights for policy 1, policy_version 1948919 (0.0008) [2023-12-28 09:14:25,187][106226] Updated weights for policy 0, policy_version 1944754 (0.0009) [2023-12-28 09:14:25,246][106226] Updated weights for policy 0, policy_version 1944764 (0.0008) [2023-12-28 09:14:25,308][106226] Updated weights for policy 0, policy_version 1944774 (0.0008) [2023-12-28 09:14:25,610][106225] Updated weights for policy 1, policy_version 1948929 (0.0009) [2023-12-28 09:14:25,676][106225] Updated weights for policy 1, policy_version 1948939 (0.0009) [2023-12-28 09:14:25,744][106225] Updated weights for policy 1, policy_version 1948949 (0.0009) [2023-12-28 09:14:25,799][106225] Updated weights for policy 1, policy_version 1948959 (0.0008) [2023-12-28 09:14:25,930][106226] Updated weights for policy 0, policy_version 1944784 (0.0009) [2023-12-28 09:14:25,979][106226] Updated weights for policy 0, policy_version 1944794 (0.0008) [2023-12-28 09:14:26,028][106226] Updated weights for policy 0, policy_version 1944804 (0.0008) [2023-12-28 09:14:26,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.4, 300 sec: 19799.6). Total num frames: 996941824. Throughput: 0: 9748.3, 1: 9816.2. Samples: 996909296. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:26,175][105115] Avg episode reward: [(0, '-4.457'), (1, '-4.559')] [2023-12-28 09:14:26,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001944808_497950720.pth... [2023-12-28 09:14:26,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001948960_498991104.pth... [2023-12-28 09:14:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001943656_497655808.pth [2023-12-28 09:14:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001947808_498696192.pth [2023-12-28 09:14:26,471][106225] Updated weights for policy 1, policy_version 1948969 (0.0009) [2023-12-28 09:14:26,523][106225] Updated weights for policy 1, policy_version 1948979 (0.0008) [2023-12-28 09:14:26,574][106225] Updated weights for policy 1, policy_version 1948989 (0.0008) [2023-12-28 09:14:26,784][106226] Updated weights for policy 0, policy_version 1944814 (0.0008) [2023-12-28 09:14:26,832][106226] Updated weights for policy 0, policy_version 1944824 (0.0008) [2023-12-28 09:14:26,882][106226] Updated weights for policy 0, policy_version 1944834 (0.0008) [2023-12-28 09:14:27,299][106225] Updated weights for policy 1, policy_version 1948999 (0.0008) [2023-12-28 09:14:27,348][106225] Updated weights for policy 1, policy_version 1949009 (0.0007) [2023-12-28 09:14:27,395][106225] Updated weights for policy 1, policy_version 1949019 (0.0008) [2023-12-28 09:14:27,628][106226] Updated weights for policy 0, policy_version 1944844 (0.0009) [2023-12-28 09:14:27,683][106226] Updated weights for policy 0, policy_version 1944854 (0.0008) [2023-12-28 09:14:27,738][106226] Updated weights for policy 0, policy_version 1944864 (0.0008) [2023-12-28 09:14:28,131][106225] Updated weights for policy 1, policy_version 1949029 (0.0009) [2023-12-28 09:14:28,190][106225] Updated weights for policy 1, policy_version 1949039 (0.0008) [2023-12-28 09:14:28,245][106225] Updated weights for policy 1, policy_version 1949049 (0.0009) [2023-12-28 09:14:28,465][106226] Updated weights for policy 0, policy_version 1944874 (0.0008) [2023-12-28 09:14:28,524][106226] Updated weights for policy 0, policy_version 1944884 (0.0009) [2023-12-28 09:14:28,587][106226] Updated weights for policy 0, policy_version 1944894 (0.0009) [2023-12-28 09:14:28,646][106226] Updated weights for policy 0, policy_version 1944904 (0.0008) [2023-12-28 09:14:28,985][106225] Updated weights for policy 1, policy_version 1949059 (0.0009) [2023-12-28 09:14:29,035][106225] Updated weights for policy 1, policy_version 1949069 (0.0008) [2023-12-28 09:14:29,085][106225] Updated weights for policy 1, policy_version 1949079 (0.0008) [2023-12-28 09:14:29,403][106226] Updated weights for policy 0, policy_version 1944914 (0.0008) [2023-12-28 09:14:29,454][106226] Updated weights for policy 0, policy_version 1944924 (0.0008) [2023-12-28 09:14:29,513][106226] Updated weights for policy 0, policy_version 1944934 (0.0006) [2023-12-28 09:14:29,898][106225] Updated weights for policy 1, policy_version 1949089 (0.0009) [2023-12-28 09:14:29,969][106225] Updated weights for policy 1, policy_version 1949099 (0.0009) [2023-12-28 09:14:30,033][106225] Updated weights for policy 1, policy_version 1949109 (0.0008) [2023-12-28 09:14:30,093][106225] Updated weights for policy 1, policy_version 1949119 (0.0009) [2023-12-28 09:14:30,228][106226] Updated weights for policy 0, policy_version 1944944 (0.0007) [2023-12-28 09:14:30,295][106226] Updated weights for policy 0, policy_version 1944954 (0.0008) [2023-12-28 09:14:30,351][106226] Updated weights for policy 0, policy_version 1944964 (0.0007) [2023-12-28 09:14:30,767][106225] Updated weights for policy 1, policy_version 1949129 (0.0007) [2023-12-28 09:14:30,820][106225] Updated weights for policy 1, policy_version 1949139 (0.0006) [2023-12-28 09:14:30,876][106225] Updated weights for policy 1, policy_version 1949149 (0.0005) [2023-12-28 09:14:31,081][106226] Updated weights for policy 0, policy_version 1944974 (0.0008) [2023-12-28 09:14:31,141][106226] Updated weights for policy 0, policy_version 1944984 (0.0007) [2023-12-28 09:14:31,174][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 997031936. Throughput: 0: 9774.6, 1: 9795.1. Samples: 997025100. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:31,175][105115] Avg episode reward: [(0, '-4.422'), (1, '-4.205')] [2023-12-28 09:14:31,206][106226] Updated weights for policy 0, policy_version 1944994 (0.0008) [2023-12-28 09:14:31,514][106225] Updated weights for policy 1, policy_version 1949159 (0.0007) [2023-12-28 09:14:31,570][106225] Updated weights for policy 1, policy_version 1949169 (0.0008) [2023-12-28 09:14:31,629][106225] Updated weights for policy 1, policy_version 1949179 (0.0008) [2023-12-28 09:14:31,958][106226] Updated weights for policy 0, policy_version 1945004 (0.0009) [2023-12-28 09:14:32,017][106226] Updated weights for policy 0, policy_version 1945014 (0.0010) [2023-12-28 09:14:32,080][106226] Updated weights for policy 0, policy_version 1945024 (0.0010) [2023-12-28 09:14:32,367][106225] Updated weights for policy 1, policy_version 1949189 (0.0008) [2023-12-28 09:14:32,425][106225] Updated weights for policy 1, policy_version 1949199 (0.0006) [2023-12-28 09:14:32,480][106225] Updated weights for policy 1, policy_version 1949209 (0.0006) [2023-12-28 09:14:32,722][106226] Updated weights for policy 0, policy_version 1945034 (0.0009) [2023-12-28 09:14:32,777][106226] Updated weights for policy 0, policy_version 1945044 (0.0006) [2023-12-28 09:14:32,843][106226] Updated weights for policy 0, policy_version 1945054 (0.0005) [2023-12-28 09:14:32,908][106226] Updated weights for policy 0, policy_version 1945064 (0.0005) [2023-12-28 09:14:33,156][106225] Updated weights for policy 1, policy_version 1949219 (0.0006) [2023-12-28 09:14:33,204][106225] Updated weights for policy 1, policy_version 1949229 (0.0007) [2023-12-28 09:14:33,256][106225] Updated weights for policy 1, policy_version 1949239 (0.0007) [2023-12-28 09:14:33,505][106226] Updated weights for policy 0, policy_version 1945074 (0.0010) [2023-12-28 09:14:33,552][106226] Updated weights for policy 0, policy_version 1945084 (0.0010) [2023-12-28 09:14:33,609][106226] Updated weights for policy 0, policy_version 1945094 (0.0010) [2023-12-28 09:14:33,982][106225] Updated weights for policy 1, policy_version 1949249 (0.0009) [2023-12-28 09:14:34,037][106225] Updated weights for policy 1, policy_version 1949259 (0.0008) [2023-12-28 09:14:34,095][106225] Updated weights for policy 1, policy_version 1949269 (0.0008) [2023-12-28 09:14:34,181][106225] Updated weights for policy 1, policy_version 1949280 (0.0008) [2023-12-28 09:14:34,365][106226] Updated weights for policy 0, policy_version 1945104 (0.0009) [2023-12-28 09:14:34,431][106226] Updated weights for policy 0, policy_version 1945114 (0.0009) [2023-12-28 09:14:34,494][106226] Updated weights for policy 0, policy_version 1945124 (0.0010) [2023-12-28 09:14:34,943][106225] Updated weights for policy 1, policy_version 1949290 (0.0005) [2023-12-28 09:14:35,014][106225] Updated weights for policy 1, policy_version 1949300 (0.0006) [2023-12-28 09:14:35,083][106225] Updated weights for policy 1, policy_version 1949310 (0.0006) [2023-12-28 09:14:35,191][106226] Updated weights for policy 0, policy_version 1945134 (0.0009) [2023-12-28 09:14:35,244][106226] Updated weights for policy 0, policy_version 1945144 (0.0009) [2023-12-28 09:14:35,309][106226] Updated weights for policy 0, policy_version 1945154 (0.0008) [2023-12-28 09:14:35,595][106225] Updated weights for policy 1, policy_version 1949320 (0.0006) [2023-12-28 09:14:35,644][106225] Updated weights for policy 1, policy_version 1949330 (0.0005) [2023-12-28 09:14:35,691][106225] Updated weights for policy 1, policy_version 1949340 (0.0006) [2023-12-28 09:14:35,964][106226] Updated weights for policy 0, policy_version 1945164 (0.0008) [2023-12-28 09:14:36,020][106226] Updated weights for policy 0, policy_version 1945174 (0.0008) [2023-12-28 09:14:36,083][106226] Updated weights for policy 0, policy_version 1945184 (0.0005) [2023-12-28 09:14:36,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19660.8, 300 sec: 19799.7). Total num frames: 997138432. Throughput: 0: 9771.3, 1: 9803.4. Samples: 997145180. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:36,175][105115] Avg episode reward: [(0, '-4.504'), (1, '-4.459')] [2023-12-28 09:14:36,386][106225] Updated weights for policy 1, policy_version 1949350 (0.0009) [2023-12-28 09:14:36,440][106225] Updated weights for policy 1, policy_version 1949360 (0.0008) [2023-12-28 09:14:36,486][106225] Updated weights for policy 1, policy_version 1949370 (0.0008) [2023-12-28 09:14:36,796][106226] Updated weights for policy 0, policy_version 1945194 (0.0008) [2023-12-28 09:14:36,857][106226] Updated weights for policy 0, policy_version 1945204 (0.0005) [2023-12-28 09:14:36,909][106226] Updated weights for policy 0, policy_version 1945214 (0.0007) [2023-12-28 09:14:36,957][106226] Updated weights for policy 0, policy_version 1945224 (0.0008) [2023-12-28 09:14:37,273][106225] Updated weights for policy 1, policy_version 1949380 (0.0009) [2023-12-28 09:14:37,322][106225] Updated weights for policy 1, policy_version 1949390 (0.0008) [2023-12-28 09:14:37,371][106225] Updated weights for policy 1, policy_version 1949400 (0.0008) [2023-12-28 09:14:37,651][106226] Updated weights for policy 0, policy_version 1945234 (0.0008) [2023-12-28 09:14:37,709][106226] Updated weights for policy 0, policy_version 1945244 (0.0008) [2023-12-28 09:14:37,766][106226] Updated weights for policy 0, policy_version 1945254 (0.0009) [2023-12-28 09:14:38,140][106225] Updated weights for policy 1, policy_version 1949410 (0.0009) [2023-12-28 09:14:38,195][106225] Updated weights for policy 1, policy_version 1949420 (0.0009) [2023-12-28 09:14:38,253][106225] Updated weights for policy 1, policy_version 1949430 (0.0009) [2023-12-28 09:14:38,307][106225] Updated weights for policy 1, policy_version 1949440 (0.0009) [2023-12-28 09:14:38,380][106226] Updated weights for policy 0, policy_version 1945264 (0.0009) [2023-12-28 09:14:38,436][106226] Updated weights for policy 0, policy_version 1945274 (0.0010) [2023-12-28 09:14:38,485][106226] Updated weights for policy 0, policy_version 1945284 (0.0008) [2023-12-28 09:14:39,107][106225] Updated weights for policy 1, policy_version 1949450 (0.0008) [2023-12-28 09:14:39,166][106225] Updated weights for policy 1, policy_version 1949460 (0.0008) [2023-12-28 09:14:39,209][106226] Updated weights for policy 0, policy_version 1945294 (0.0007) [2023-12-28 09:14:39,227][106225] Updated weights for policy 1, policy_version 1949470 (0.0007) [2023-12-28 09:14:39,277][106226] Updated weights for policy 0, policy_version 1945304 (0.0008) [2023-12-28 09:14:39,340][106226] Updated weights for policy 0, policy_version 1945314 (0.0009) [2023-12-28 09:14:40,015][106225] Updated weights for policy 1, policy_version 1949480 (0.0008) [2023-12-28 09:14:40,070][106225] Updated weights for policy 1, policy_version 1949490 (0.0008) [2023-12-28 09:14:40,121][106225] Updated weights for policy 1, policy_version 1949500 (0.0008) [2023-12-28 09:14:40,156][106226] Updated weights for policy 0, policy_version 1945324 (0.0010) [2023-12-28 09:14:40,218][106226] Updated weights for policy 0, policy_version 1945334 (0.0011) [2023-12-28 09:14:40,280][106226] Updated weights for policy 0, policy_version 1945344 (0.0011) [2023-12-28 09:14:40,883][106225] Updated weights for policy 1, policy_version 1949510 (0.0007) [2023-12-28 09:14:40,940][106225] Updated weights for policy 1, policy_version 1949520 (0.0008) [2023-12-28 09:14:40,994][106225] Updated weights for policy 1, policy_version 1949530 (0.0007) [2023-12-28 09:14:41,014][106226] Updated weights for policy 0, policy_version 1945354 (0.0011) [2023-12-28 09:14:41,079][106226] Updated weights for policy 0, policy_version 1945364 (0.0009) [2023-12-28 09:14:41,145][106226] Updated weights for policy 0, policy_version 1945374 (0.0009) [2023-12-28 09:14:41,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19799.6). Total num frames: 997228544. Throughput: 0: 9811.4, 1: 9779.7. Samples: 997203836. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:41,175][105115] Avg episode reward: [(0, '-4.331'), (1, '-4.520')] [2023-12-28 09:14:41,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001949536_499138560.pth... [2023-12-28 09:14:41,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001948384_498843648.pth [2023-12-28 09:14:41,206][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001945384_498098176.pth... [2023-12-28 09:14:41,209][106226] Updated weights for policy 0, policy_version 1945384 (0.0011) [2023-12-28 09:14:41,211][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001944232_497803264.pth [2023-12-28 09:14:41,850][106225] Updated weights for policy 1, policy_version 1949540 (0.0008) [2023-12-28 09:14:41,917][106225] Updated weights for policy 1, policy_version 1949550 (0.0007) [2023-12-28 09:14:41,959][106226] Updated weights for policy 0, policy_version 1945394 (0.0009) [2023-12-28 09:14:41,981][106225] Updated weights for policy 1, policy_version 1949560 (0.0006) [2023-12-28 09:14:42,018][106226] Updated weights for policy 0, policy_version 1945404 (0.0011) [2023-12-28 09:14:42,080][106226] Updated weights for policy 0, policy_version 1945414 (0.0010) [2023-12-28 09:14:42,719][106225] Updated weights for policy 1, policy_version 1949570 (0.0007) [2023-12-28 09:14:42,785][106226] Updated weights for policy 0, policy_version 1945424 (0.0007) [2023-12-28 09:14:42,787][106225] Updated weights for policy 1, policy_version 1949580 (0.0005) [2023-12-28 09:14:42,842][106226] Updated weights for policy 0, policy_version 1945434 (0.0006) [2023-12-28 09:14:42,845][106225] Updated weights for policy 1, policy_version 1949590 (0.0008) [2023-12-28 09:14:42,905][106226] Updated weights for policy 0, policy_version 1945444 (0.0005) [2023-12-28 09:14:42,907][106225] Updated weights for policy 1, policy_version 1949600 (0.0008) [2023-12-28 09:14:43,456][106226] Updated weights for policy 0, policy_version 1945454 (0.0007) [2023-12-28 09:14:43,511][106226] Updated weights for policy 0, policy_version 1945464 (0.0007) [2023-12-28 09:14:43,559][106226] Updated weights for policy 0, policy_version 1945474 (0.0010) [2023-12-28 09:14:43,579][106225] Updated weights for policy 1, policy_version 1949610 (0.0009) [2023-12-28 09:14:43,630][106225] Updated weights for policy 1, policy_version 1949620 (0.0010) [2023-12-28 09:14:43,676][106225] Updated weights for policy 1, policy_version 1949630 (0.0010) [2023-12-28 09:14:44,157][106226] Updated weights for policy 0, policy_version 1945484 (0.0010) [2023-12-28 09:14:44,209][106226] Updated weights for policy 0, policy_version 1945494 (0.0010) [2023-12-28 09:14:44,266][106226] Updated weights for policy 0, policy_version 1945504 (0.0010) [2023-12-28 09:14:44,413][106225] Updated weights for policy 1, policy_version 1949640 (0.0010) [2023-12-28 09:14:44,473][106225] Updated weights for policy 1, policy_version 1949650 (0.0010) [2023-12-28 09:14:44,540][106225] Updated weights for policy 1, policy_version 1949660 (0.0010) [2023-12-28 09:14:45,005][106226] Updated weights for policy 0, policy_version 1945514 (0.0010) [2023-12-28 09:14:45,072][106226] Updated weights for policy 0, policy_version 1945524 (0.0010) [2023-12-28 09:14:45,138][106226] Updated weights for policy 0, policy_version 1945534 (0.0011) [2023-12-28 09:14:45,201][106225] Updated weights for policy 1, policy_version 1949670 (0.0011) [2023-12-28 09:14:45,203][106226] Updated weights for policy 0, policy_version 1945544 (0.0011) [2023-12-28 09:14:45,264][106225] Updated weights for policy 1, policy_version 1949680 (0.0011) [2023-12-28 09:14:45,326][106225] Updated weights for policy 1, policy_version 1949690 (0.0010) [2023-12-28 09:14:45,867][106226] Updated weights for policy 0, policy_version 1945554 (0.0007) [2023-12-28 09:14:45,916][106226] Updated weights for policy 0, policy_version 1945564 (0.0008) [2023-12-28 09:14:45,976][106226] Updated weights for policy 0, policy_version 1945574 (0.0006) [2023-12-28 09:14:46,014][106225] Updated weights for policy 1, policy_version 1949700 (0.0008) [2023-12-28 09:14:46,076][106225] Updated weights for policy 1, policy_version 1949710 (0.0010) [2023-12-28 09:14:46,129][106225] Updated weights for policy 1, policy_version 1949720 (0.0010) [2023-12-28 09:14:46,174][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 997326848. Throughput: 0: 9838.2, 1: 9688.2. Samples: 997318920. Policy #0 lag: (min: 3.0, avg: 5.4, max: 35.0) [2023-12-28 09:14:46,175][105115] Avg episode reward: [(0, '-4.338'), (1, '-4.629')] [2023-12-28 09:14:46,631][106226] Updated weights for policy 0, policy_version 1945584 (0.0007) [2023-12-28 09:14:46,693][106226] Updated weights for policy 0, policy_version 1945594 (0.0008) [2023-12-28 09:14:46,748][106226] Updated weights for policy 0, policy_version 1945604 (0.0009) [2023-12-28 09:14:46,793][106225] Updated weights for policy 1, policy_version 1949730 (0.0010) [2023-12-28 09:14:46,850][106225] Updated weights for policy 1, policy_version 1949740 (0.0010) [2023-12-28 09:14:46,899][106225] Updated weights for policy 1, policy_version 1949750 (0.0010) [2023-12-28 09:14:46,954][106225] Updated weights for policy 1, policy_version 1949760 (0.0009) [2023-12-28 09:14:47,477][106226] Updated weights for policy 0, policy_version 1945614 (0.0008) [2023-12-28 09:14:47,524][106226] Updated weights for policy 0, policy_version 1945624 (0.0008) [2023-12-28 09:14:47,576][106226] Updated weights for policy 0, policy_version 1945634 (0.0007) [2023-12-28 09:14:47,661][106225] Updated weights for policy 1, policy_version 1949770 (0.0008) [2023-12-28 09:14:47,728][106225] Updated weights for policy 1, policy_version 1949780 (0.0007) [2023-12-28 09:14:47,794][106225] Updated weights for policy 1, policy_version 1949790 (0.0005) [2023-12-28 09:14:48,245][106226] Updated weights for policy 0, policy_version 1945644 (0.0007) [2023-12-28 09:14:48,314][106226] Updated weights for policy 0, policy_version 1945654 (0.0006) [2023-12-28 09:14:48,382][106226] Updated weights for policy 0, policy_version 1945664 (0.0008) [2023-12-28 09:14:48,470][106225] Updated weights for policy 1, policy_version 1949800 (0.0008) [2023-12-28 09:14:48,521][106225] Updated weights for policy 1, policy_version 1949810 (0.0009) [2023-12-28 09:14:48,588][106225] Updated weights for policy 1, policy_version 1949820 (0.0010) [2023-12-28 09:14:48,934][106226] Updated weights for policy 0, policy_version 1945674 (0.0008) [2023-12-28 09:14:48,999][106226] Updated weights for policy 0, policy_version 1945684 (0.0009) [2023-12-28 09:14:49,050][106226] Updated weights for policy 0, policy_version 1945694 (0.0010) [2023-12-28 09:14:49,110][106226] Updated weights for policy 0, policy_version 1945704 (0.0011) [2023-12-28 09:14:49,360][106225] Updated weights for policy 1, policy_version 1949830 (0.0009) [2023-12-28 09:14:49,421][106225] Updated weights for policy 1, policy_version 1949840 (0.0009) [2023-12-28 09:14:49,476][106225] Updated weights for policy 1, policy_version 1949850 (0.0010) [2023-12-28 09:14:49,813][106226] Updated weights for policy 0, policy_version 1945714 (0.0007) [2023-12-28 09:14:49,882][106226] Updated weights for policy 0, policy_version 1945724 (0.0007) [2023-12-28 09:14:49,947][106226] Updated weights for policy 0, policy_version 1945734 (0.0008) [2023-12-28 09:14:50,145][106225] Updated weights for policy 1, policy_version 1949860 (0.0011) [2023-12-28 09:14:50,210][106225] Updated weights for policy 1, policy_version 1949870 (0.0011) [2023-12-28 09:14:50,270][106225] Updated weights for policy 1, policy_version 1949880 (0.0009) [2023-12-28 09:14:50,720][106226] Updated weights for policy 0, policy_version 1945744 (0.0008) [2023-12-28 09:14:50,778][106226] Updated weights for policy 0, policy_version 1945754 (0.0008) [2023-12-28 09:14:50,832][106226] Updated weights for policy 0, policy_version 1945764 (0.0007) [2023-12-28 09:14:50,950][106225] Updated weights for policy 1, policy_version 1949890 (0.0008) [2023-12-28 09:14:51,016][106225] Updated weights for policy 1, policy_version 1949900 (0.0011) [2023-12-28 09:14:51,087][106225] Updated weights for policy 1, policy_version 1949910 (0.0009) [2023-12-28 09:14:51,156][106225] Updated weights for policy 1, policy_version 1949920 (0.0011) [2023-12-28 09:14:51,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19799.6). Total num frames: 997433344. Throughput: 0: 9814.7, 1: 9711.7. Samples: 997438760. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:14:51,175][105115] Avg episode reward: [(0, '-4.402'), (1, '-4.508')] [2023-12-28 09:14:51,622][106226] Updated weights for policy 0, policy_version 1945774 (0.0008) [2023-12-28 09:14:51,692][106226] Updated weights for policy 0, policy_version 1945784 (0.0010) [2023-12-28 09:14:51,764][106226] Updated weights for policy 0, policy_version 1945794 (0.0008) [2023-12-28 09:14:51,880][106225] Updated weights for policy 1, policy_version 1949930 (0.0005) [2023-12-28 09:14:51,943][106225] Updated weights for policy 1, policy_version 1949940 (0.0007) [2023-12-28 09:14:52,004][106225] Updated weights for policy 1, policy_version 1949950 (0.0007) [2023-12-28 09:14:52,503][106226] Updated weights for policy 0, policy_version 1945804 (0.0008) [2023-12-28 09:14:52,557][106226] Updated weights for policy 0, policy_version 1945814 (0.0008) [2023-12-28 09:14:52,620][106226] Updated weights for policy 0, policy_version 1945824 (0.0007) [2023-12-28 09:14:52,629][106225] Updated weights for policy 1, policy_version 1949960 (0.0010) [2023-12-28 09:14:52,683][106225] Updated weights for policy 1, policy_version 1949970 (0.0010) [2023-12-28 09:14:52,747][106225] Updated weights for policy 1, policy_version 1949980 (0.0010) [2023-12-28 09:14:53,312][106226] Updated weights for policy 0, policy_version 1945834 (0.0006) [2023-12-28 09:14:53,358][106226] Updated weights for policy 0, policy_version 1945844 (0.0008) [2023-12-28 09:14:53,404][106226] Updated weights for policy 0, policy_version 1945854 (0.0007) [2023-12-28 09:14:53,452][106226] Updated weights for policy 0, policy_version 1945864 (0.0007) [2023-12-28 09:14:53,469][106225] Updated weights for policy 1, policy_version 1949990 (0.0010) [2023-12-28 09:14:53,526][106225] Updated weights for policy 1, policy_version 1950000 (0.0010) [2023-12-28 09:14:53,585][106225] Updated weights for policy 1, policy_version 1950010 (0.0010) [2023-12-28 09:14:54,072][106226] Updated weights for policy 0, policy_version 1945874 (0.0007) [2023-12-28 09:14:54,126][106226] Updated weights for policy 0, policy_version 1945884 (0.0005) [2023-12-28 09:14:54,183][106226] Updated weights for policy 0, policy_version 1945894 (0.0008) [2023-12-28 09:14:54,309][106225] Updated weights for policy 1, policy_version 1950020 (0.0010) [2023-12-28 09:14:54,369][106225] Updated weights for policy 1, policy_version 1950030 (0.0010) [2023-12-28 09:14:54,422][106225] Updated weights for policy 1, policy_version 1950040 (0.0010) [2023-12-28 09:14:54,867][106226] Updated weights for policy 0, policy_version 1945904 (0.0008) [2023-12-28 09:14:54,922][106226] Updated weights for policy 0, policy_version 1945914 (0.0007) [2023-12-28 09:14:54,979][106226] Updated weights for policy 0, policy_version 1945924 (0.0008) [2023-12-28 09:14:55,152][106225] Updated weights for policy 1, policy_version 1950050 (0.0011) [2023-12-28 09:14:55,209][106225] Updated weights for policy 1, policy_version 1950060 (0.0010) [2023-12-28 09:14:55,265][106225] Updated weights for policy 1, policy_version 1950070 (0.0010) [2023-12-28 09:14:55,316][106225] Updated weights for policy 1, policy_version 1950080 (0.0009) [2023-12-28 09:14:55,721][106226] Updated weights for policy 0, policy_version 1945934 (0.0008) [2023-12-28 09:14:55,779][106226] Updated weights for policy 0, policy_version 1945944 (0.0008) [2023-12-28 09:14:55,830][106226] Updated weights for policy 0, policy_version 1945954 (0.0008) [2023-12-28 09:14:56,052][106225] Updated weights for policy 1, policy_version 1950090 (0.0010) [2023-12-28 09:14:56,106][106225] Updated weights for policy 1, policy_version 1950100 (0.0010) [2023-12-28 09:14:56,166][106225] Updated weights for policy 1, policy_version 1950110 (0.0010) [2023-12-28 09:14:56,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 997523456. Throughput: 0: 9800.9, 1: 9702.0. Samples: 997497600. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:14:56,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.515')] [2023-12-28 09:14:56,180][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001945960_498245632.pth... [2023-12-28 09:14:56,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001950112_499286016.pth... [2023-12-28 09:14:56,184][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001948960_498991104.pth [2023-12-28 09:14:56,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001944808_497950720.pth [2023-12-28 09:14:56,519][106226] Updated weights for policy 0, policy_version 1945964 (0.0008) [2023-12-28 09:14:56,572][106226] Updated weights for policy 0, policy_version 1945974 (0.0007) [2023-12-28 09:14:56,625][106226] Updated weights for policy 0, policy_version 1945984 (0.0008) [2023-12-28 09:14:56,835][106225] Updated weights for policy 1, policy_version 1950120 (0.0009) [2023-12-28 09:14:56,888][106225] Updated weights for policy 1, policy_version 1950130 (0.0009) [2023-12-28 09:14:56,948][106225] Updated weights for policy 1, policy_version 1950140 (0.0006) [2023-12-28 09:14:57,235][106226] Updated weights for policy 0, policy_version 1945994 (0.0008) [2023-12-28 09:14:57,300][106226] Updated weights for policy 0, policy_version 1946004 (0.0006) [2023-12-28 09:14:57,358][106226] Updated weights for policy 0, policy_version 1946014 (0.0008) [2023-12-28 09:14:57,410][106226] Updated weights for policy 0, policy_version 1946024 (0.0008) [2023-12-28 09:14:57,729][106225] Updated weights for policy 1, policy_version 1950150 (0.0007) [2023-12-28 09:14:57,782][106225] Updated weights for policy 1, policy_version 1950160 (0.0005) [2023-12-28 09:14:57,832][106225] Updated weights for policy 1, policy_version 1950170 (0.0005) [2023-12-28 09:14:57,962][106226] Updated weights for policy 0, policy_version 1946034 (0.0006) [2023-12-28 09:14:58,020][106226] Updated weights for policy 0, policy_version 1946044 (0.0008) [2023-12-28 09:14:58,080][106226] Updated weights for policy 0, policy_version 1946054 (0.0008) [2023-12-28 09:14:58,538][106225] Updated weights for policy 1, policy_version 1950180 (0.0006) [2023-12-28 09:14:58,602][106225] Updated weights for policy 1, policy_version 1950190 (0.0008) [2023-12-28 09:14:58,676][106225] Updated weights for policy 1, policy_version 1950200 (0.0008) [2023-12-28 09:14:58,754][106226] Updated weights for policy 0, policy_version 1946064 (0.0008) [2023-12-28 09:14:58,819][106226] Updated weights for policy 0, policy_version 1946074 (0.0008) [2023-12-28 09:14:58,895][106226] Updated weights for policy 0, policy_version 1946084 (0.0008) [2023-12-28 09:14:59,493][106225] Updated weights for policy 1, policy_version 1950210 (0.0008) [2023-12-28 09:14:59,552][106225] Updated weights for policy 1, policy_version 1950220 (0.0008) [2023-12-28 09:14:59,611][106225] Updated weights for policy 1, policy_version 1950230 (0.0008) [2023-12-28 09:14:59,676][106225] Updated weights for policy 1, policy_version 1950240 (0.0008) [2023-12-28 09:14:59,681][106226] Updated weights for policy 0, policy_version 1946094 (0.0009) [2023-12-28 09:14:59,729][106226] Updated weights for policy 0, policy_version 1946104 (0.0009) [2023-12-28 09:14:59,782][106226] Updated weights for policy 0, policy_version 1946114 (0.0009) [2023-12-28 09:15:00,370][106225] Updated weights for policy 1, policy_version 1950250 (0.0006) [2023-12-28 09:15:00,430][106225] Updated weights for policy 1, policy_version 1950260 (0.0008) [2023-12-28 09:15:00,489][106225] Updated weights for policy 1, policy_version 1950270 (0.0008) [2023-12-28 09:15:00,509][106226] Updated weights for policy 0, policy_version 1946124 (0.0010) [2023-12-28 09:15:00,570][106226] Updated weights for policy 0, policy_version 1946134 (0.0009) [2023-12-28 09:15:00,627][106226] Updated weights for policy 0, policy_version 1946144 (0.0008) [2023-12-28 09:15:01,175][105115] Fps is (10 sec: 18841.5, 60 sec: 19524.3, 300 sec: 19771.9). Total num frames: 997621760. Throughput: 0: 9876.4, 1: 9617.1. Samples: 997614492. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:01,175][105115] Avg episode reward: [(0, '-4.511'), (1, '-4.391')] [2023-12-28 09:15:01,189][106225] Updated weights for policy 1, policy_version 1950280 (0.0008) [2023-12-28 09:15:01,251][106225] Updated weights for policy 1, policy_version 1950290 (0.0007) [2023-12-28 09:15:01,305][106225] Updated weights for policy 1, policy_version 1950300 (0.0008) [2023-12-28 09:15:01,336][106226] Updated weights for policy 0, policy_version 1946154 (0.0009) [2023-12-28 09:15:01,404][106226] Updated weights for policy 0, policy_version 1946164 (0.0008) [2023-12-28 09:15:01,464][106226] Updated weights for policy 0, policy_version 1946174 (0.0010) [2023-12-28 09:15:01,523][106226] Updated weights for policy 0, policy_version 1946184 (0.0008) [2023-12-28 09:15:01,977][106225] Updated weights for policy 1, policy_version 1950310 (0.0008) [2023-12-28 09:15:02,030][106225] Updated weights for policy 1, policy_version 1950320 (0.0008) [2023-12-28 09:15:02,084][106225] Updated weights for policy 1, policy_version 1950330 (0.0008) [2023-12-28 09:15:02,306][106226] Updated weights for policy 0, policy_version 1946194 (0.0010) [2023-12-28 09:15:02,360][106226] Updated weights for policy 0, policy_version 1946204 (0.0008) [2023-12-28 09:15:02,429][106226] Updated weights for policy 0, policy_version 1946214 (0.0006) [2023-12-28 09:15:02,796][106225] Updated weights for policy 1, policy_version 1950340 (0.0008) [2023-12-28 09:15:02,861][106225] Updated weights for policy 1, policy_version 1950350 (0.0008) [2023-12-28 09:15:02,925][106225] Updated weights for policy 1, policy_version 1950360 (0.0008) [2023-12-28 09:15:03,149][106226] Updated weights for policy 0, policy_version 1946224 (0.0010) [2023-12-28 09:15:03,209][106226] Updated weights for policy 0, policy_version 1946234 (0.0010) [2023-12-28 09:15:03,259][106226] Updated weights for policy 0, policy_version 1946244 (0.0007) [2023-12-28 09:15:03,464][106225] Updated weights for policy 1, policy_version 1950370 (0.0007) [2023-12-28 09:15:03,512][106225] Updated weights for policy 1, policy_version 1950380 (0.0005) [2023-12-28 09:15:03,555][106225] Updated weights for policy 1, policy_version 1950390 (0.0005) [2023-12-28 09:15:03,610][106225] Updated weights for policy 1, policy_version 1950400 (0.0005) [2023-12-28 09:15:03,889][106226] Updated weights for policy 0, policy_version 1946254 (0.0008) [2023-12-28 09:15:03,952][106226] Updated weights for policy 0, policy_version 1946264 (0.0009) [2023-12-28 09:15:04,005][106226] Updated weights for policy 0, policy_version 1946274 (0.0010) [2023-12-28 09:15:04,198][106225] Updated weights for policy 1, policy_version 1950410 (0.0008) [2023-12-28 09:15:04,251][106225] Updated weights for policy 1, policy_version 1950420 (0.0008) [2023-12-28 09:15:04,306][106225] Updated weights for policy 1, policy_version 1950430 (0.0008) [2023-12-28 09:15:04,793][106226] Updated weights for policy 0, policy_version 1946284 (0.0008) [2023-12-28 09:15:04,843][106226] Updated weights for policy 0, policy_version 1946294 (0.0010) [2023-12-28 09:15:04,905][106226] Updated weights for policy 0, policy_version 1946304 (0.0008) [2023-12-28 09:15:04,984][106225] Updated weights for policy 1, policy_version 1950440 (0.0006) [2023-12-28 09:15:05,045][106225] Updated weights for policy 1, policy_version 1950450 (0.0009) [2023-12-28 09:15:05,102][106225] Updated weights for policy 1, policy_version 1950460 (0.0009) [2023-12-28 09:15:05,659][106226] Updated weights for policy 0, policy_version 1946314 (0.0009) [2023-12-28 09:15:05,717][106226] Updated weights for policy 0, policy_version 1946324 (0.0008) [2023-12-28 09:15:05,785][106226] Updated weights for policy 0, policy_version 1946334 (0.0008) [2023-12-28 09:15:05,836][106225] Updated weights for policy 1, policy_version 1950470 (0.0008) [2023-12-28 09:15:05,839][106226] Updated weights for policy 0, policy_version 1946344 (0.0008) [2023-12-28 09:15:05,887][106225] Updated weights for policy 1, policy_version 1950480 (0.0008) [2023-12-28 09:15:05,936][106225] Updated weights for policy 1, policy_version 1950490 (0.0008) [2023-12-28 09:15:06,175][105115] Fps is (10 sec: 20480.2, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 997728256. Throughput: 0: 9829.3, 1: 9765.9. Samples: 997734420. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:06,175][105115] Avg episode reward: [(0, '-4.409'), (1, '-4.706')] [2023-12-28 09:15:06,597][106226] Updated weights for policy 0, policy_version 1946354 (0.0009) [2023-12-28 09:15:06,652][106226] Updated weights for policy 0, policy_version 1946364 (0.0008) [2023-12-28 09:15:06,711][106225] Updated weights for policy 1, policy_version 1950500 (0.0006) [2023-12-28 09:15:06,722][106226] Updated weights for policy 0, policy_version 1946374 (0.0008) [2023-12-28 09:15:06,764][106225] Updated weights for policy 1, policy_version 1950510 (0.0008) [2023-12-28 09:15:06,824][106225] Updated weights for policy 1, policy_version 1950520 (0.0009) [2023-12-28 09:15:07,415][106226] Updated weights for policy 0, policy_version 1946384 (0.0009) [2023-12-28 09:15:07,460][106225] Updated weights for policy 1, policy_version 1950530 (0.0008) [2023-12-28 09:15:07,465][106226] Updated weights for policy 0, policy_version 1946394 (0.0010) [2023-12-28 09:15:07,515][106226] Updated weights for policy 0, policy_version 1946404 (0.0010) [2023-12-28 09:15:07,516][106225] Updated weights for policy 1, policy_version 1950540 (0.0005) [2023-12-28 09:15:07,580][106225] Updated weights for policy 1, policy_version 1950550 (0.0005) [2023-12-28 09:15:07,632][106225] Updated weights for policy 1, policy_version 1950560 (0.0005) [2023-12-28 09:15:08,255][106226] Updated weights for policy 0, policy_version 1946414 (0.0011) [2023-12-28 09:15:08,263][106225] Updated weights for policy 1, policy_version 1950570 (0.0007) [2023-12-28 09:15:08,315][106226] Updated weights for policy 0, policy_version 1946424 (0.0010) [2023-12-28 09:15:08,346][106225] Updated weights for policy 1, policy_version 1950580 (0.0007) [2023-12-28 09:15:08,377][106226] Updated weights for policy 0, policy_version 1946434 (0.0009) [2023-12-28 09:15:08,411][106225] Updated weights for policy 1, policy_version 1950590 (0.0008) [2023-12-28 09:15:09,067][106226] Updated weights for policy 0, policy_version 1946444 (0.0008) [2023-12-28 09:15:09,085][106225] Updated weights for policy 1, policy_version 1950600 (0.0009) [2023-12-28 09:15:09,127][106226] Updated weights for policy 0, policy_version 1946454 (0.0005) [2023-12-28 09:15:09,143][106225] Updated weights for policy 1, policy_version 1950610 (0.0009) [2023-12-28 09:15:09,187][106226] Updated weights for policy 0, policy_version 1946464 (0.0005) [2023-12-28 09:15:09,207][106225] Updated weights for policy 1, policy_version 1950620 (0.0008) [2023-12-28 09:15:09,921][106226] Updated weights for policy 0, policy_version 1946474 (0.0008) [2023-12-28 09:15:09,983][106226] Updated weights for policy 0, policy_version 1946484 (0.0011) [2023-12-28 09:15:10,015][106225] Updated weights for policy 1, policy_version 1950630 (0.0007) [2023-12-28 09:15:10,046][106226] Updated weights for policy 0, policy_version 1946494 (0.0013) [2023-12-28 09:15:10,078][106225] Updated weights for policy 1, policy_version 1950640 (0.0005) [2023-12-28 09:15:10,110][106226] Updated weights for policy 0, policy_version 1946504 (0.0011) [2023-12-28 09:15:10,144][106225] Updated weights for policy 1, policy_version 1950650 (0.0008) [2023-12-28 09:15:10,813][106226] Updated weights for policy 0, policy_version 1946514 (0.0010) [2023-12-28 09:15:10,826][106225] Updated weights for policy 1, policy_version 1950660 (0.0006) [2023-12-28 09:15:10,870][106226] Updated weights for policy 0, policy_version 1946524 (0.0010) [2023-12-28 09:15:10,888][106225] Updated weights for policy 1, policy_version 1950670 (0.0005) [2023-12-28 09:15:10,920][106226] Updated weights for policy 0, policy_version 1946534 (0.0011) [2023-12-28 09:15:10,944][106225] Updated weights for policy 1, policy_version 1950680 (0.0006) [2023-12-28 09:15:11,175][105115] Fps is (10 sec: 20479.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 997826560. Throughput: 0: 9884.2, 1: 9785.0. Samples: 997794408. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:11,175][105115] Avg episode reward: [(0, '-4.444'), (1, '-4.655')] [2023-12-28 09:15:11,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001950688_499433472.pth... [2023-12-28 09:15:11,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001946536_498393088.pth... [2023-12-28 09:15:11,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001945384_498098176.pth [2023-12-28 09:15:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001949536_499138560.pth [2023-12-28 09:15:11,712][106226] Updated weights for policy 0, policy_version 1946544 (0.0011) [2023-12-28 09:15:11,731][106225] Updated weights for policy 1, policy_version 1950690 (0.0008) [2023-12-28 09:15:11,777][106226] Updated weights for policy 0, policy_version 1946554 (0.0011) [2023-12-28 09:15:11,797][106225] Updated weights for policy 1, policy_version 1950700 (0.0009) [2023-12-28 09:15:11,840][106226] Updated weights for policy 0, policy_version 1946564 (0.0011) [2023-12-28 09:15:11,860][106225] Updated weights for policy 1, policy_version 1950710 (0.0010) [2023-12-28 09:15:11,922][106225] Updated weights for policy 1, policy_version 1950720 (0.0010) [2023-12-28 09:15:12,605][106226] Updated weights for policy 0, policy_version 1946574 (0.0008) [2023-12-28 09:15:12,633][106225] Updated weights for policy 1, policy_version 1950730 (0.0008) [2023-12-28 09:15:12,671][106226] Updated weights for policy 0, policy_version 1946584 (0.0006) [2023-12-28 09:15:12,696][106225] Updated weights for policy 1, policy_version 1950740 (0.0007) [2023-12-28 09:15:12,732][106226] Updated weights for policy 0, policy_version 1946594 (0.0006) [2023-12-28 09:15:12,760][106225] Updated weights for policy 1, policy_version 1950750 (0.0008) [2023-12-28 09:15:13,325][106226] Updated weights for policy 0, policy_version 1946604 (0.0008) [2023-12-28 09:15:13,378][106226] Updated weights for policy 0, policy_version 1946614 (0.0010) [2023-12-28 09:15:13,441][106226] Updated weights for policy 0, policy_version 1946624 (0.0011) [2023-12-28 09:15:13,506][106225] Updated weights for policy 1, policy_version 1950760 (0.0005) [2023-12-28 09:15:13,563][106225] Updated weights for policy 1, policy_version 1950770 (0.0005) [2023-12-28 09:15:13,624][106225] Updated weights for policy 1, policy_version 1950780 (0.0010) [2023-12-28 09:15:14,131][106226] Updated weights for policy 0, policy_version 1946634 (0.0010) [2023-12-28 09:15:14,190][106226] Updated weights for policy 0, policy_version 1946644 (0.0007) [2023-12-28 09:15:14,237][106225] Updated weights for policy 1, policy_version 1950790 (0.0010) [2023-12-28 09:15:14,249][106226] Updated weights for policy 0, policy_version 1946654 (0.0009) [2023-12-28 09:15:14,304][106225] Updated weights for policy 1, policy_version 1950800 (0.0010) [2023-12-28 09:15:14,307][106226] Updated weights for policy 0, policy_version 1946664 (0.0006) [2023-12-28 09:15:14,363][106225] Updated weights for policy 1, policy_version 1950810 (0.0007) [2023-12-28 09:15:15,046][106226] Updated weights for policy 0, policy_version 1946674 (0.0011) [2023-12-28 09:15:15,073][106225] Updated weights for policy 1, policy_version 1950820 (0.0010) [2023-12-28 09:15:15,113][106226] Updated weights for policy 0, policy_version 1946684 (0.0010) [2023-12-28 09:15:15,133][106225] Updated weights for policy 1, policy_version 1950830 (0.0010) [2023-12-28 09:15:15,176][106226] Updated weights for policy 0, policy_version 1946694 (0.0011) [2023-12-28 09:15:15,195][106225] Updated weights for policy 1, policy_version 1950840 (0.0010) [2023-12-28 09:15:15,904][106226] Updated weights for policy 0, policy_version 1946704 (0.0011) [2023-12-28 09:15:15,937][106225] Updated weights for policy 1, policy_version 1950850 (0.0011) [2023-12-28 09:15:15,958][106226] Updated weights for policy 0, policy_version 1946714 (0.0010) [2023-12-28 09:15:15,988][106225] Updated weights for policy 1, policy_version 1950860 (0.0010) [2023-12-28 09:15:16,011][106226] Updated weights for policy 0, policy_version 1946724 (0.0010) [2023-12-28 09:15:16,043][106225] Updated weights for policy 1, policy_version 1950870 (0.0010) [2023-12-28 09:15:16,100][106225] Updated weights for policy 1, policy_version 1950880 (0.0010) [2023-12-28 09:15:16,175][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19771.9). Total num frames: 997924864. Throughput: 0: 9870.6, 1: 9794.7. Samples: 997910036. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:16,175][105115] Avg episode reward: [(0, '-4.413'), (1, '-4.644')] [2023-12-28 09:15:16,751][106226] Updated weights for policy 0, policy_version 1946734 (0.0009) [2023-12-28 09:15:16,802][106225] Updated weights for policy 1, policy_version 1950890 (0.0006) [2023-12-28 09:15:16,815][106226] Updated weights for policy 0, policy_version 1946744 (0.0011) [2023-12-28 09:15:16,854][106225] Updated weights for policy 1, policy_version 1950900 (0.0006) [2023-12-28 09:15:16,880][106226] Updated weights for policy 0, policy_version 1946754 (0.0011) [2023-12-28 09:15:16,914][106225] Updated weights for policy 1, policy_version 1950910 (0.0005) [2023-12-28 09:15:17,553][106225] Updated weights for policy 1, policy_version 1950920 (0.0008) [2023-12-28 09:15:17,579][106226] Updated weights for policy 0, policy_version 1946764 (0.0011) [2023-12-28 09:15:17,612][106225] Updated weights for policy 1, policy_version 1950930 (0.0006) [2023-12-28 09:15:17,633][106226] Updated weights for policy 0, policy_version 1946774 (0.0010) [2023-12-28 09:15:17,667][106225] Updated weights for policy 1, policy_version 1950940 (0.0006) [2023-12-28 09:15:17,688][106226] Updated weights for policy 0, policy_version 1946784 (0.0011) [2023-12-28 09:15:18,347][106226] Updated weights for policy 0, policy_version 1946794 (0.0010) [2023-12-28 09:15:18,409][106226] Updated weights for policy 0, policy_version 1946804 (0.0013) [2023-12-28 09:15:18,429][106225] Updated weights for policy 1, policy_version 1950950 (0.0008) [2023-12-28 09:15:18,472][106226] Updated weights for policy 0, policy_version 1946814 (0.0009) [2023-12-28 09:15:18,489][106225] Updated weights for policy 1, policy_version 1950960 (0.0007) [2023-12-28 09:15:18,534][106226] Updated weights for policy 0, policy_version 1946824 (0.0011) [2023-12-28 09:15:18,550][106225] Updated weights for policy 1, policy_version 1950970 (0.0006) [2023-12-28 09:15:19,256][106226] Updated weights for policy 0, policy_version 1946834 (0.0010) [2023-12-28 09:15:19,297][106225] Updated weights for policy 1, policy_version 1950980 (0.0006) [2023-12-28 09:15:19,323][106226] Updated weights for policy 0, policy_version 1946844 (0.0008) [2023-12-28 09:15:19,367][106225] Updated weights for policy 1, policy_version 1950990 (0.0007) [2023-12-28 09:15:19,406][106226] Updated weights for policy 0, policy_version 1946854 (0.0009) [2023-12-28 09:15:19,434][106225] Updated weights for policy 1, policy_version 1951000 (0.0006) [2023-12-28 09:15:20,073][106226] Updated weights for policy 0, policy_version 1946864 (0.0009) [2023-12-28 09:15:20,142][106226] Updated weights for policy 0, policy_version 1946874 (0.0009) [2023-12-28 09:15:20,176][106225] Updated weights for policy 1, policy_version 1951010 (0.0007) [2023-12-28 09:15:20,198][106226] Updated weights for policy 0, policy_version 1946884 (0.0008) [2023-12-28 09:15:20,244][106225] Updated weights for policy 1, policy_version 1951020 (0.0006) [2023-12-28 09:15:20,313][106225] Updated weights for policy 1, policy_version 1951030 (0.0006) [2023-12-28 09:15:20,382][106225] Updated weights for policy 1, policy_version 1951040 (0.0006) [2023-12-28 09:15:21,010][106225] Updated weights for policy 1, policy_version 1951050 (0.0009) [2023-12-28 09:15:21,024][106226] Updated weights for policy 0, policy_version 1946894 (0.0007) [2023-12-28 09:15:21,080][106225] Updated weights for policy 1, policy_version 1951060 (0.0012) [2023-12-28 09:15:21,096][106226] Updated weights for policy 0, policy_version 1946904 (0.0008) [2023-12-28 09:15:21,152][106225] Updated weights for policy 1, policy_version 1951070 (0.0010) [2023-12-28 09:15:21,165][106226] Updated weights for policy 0, policy_version 1946914 (0.0008) [2023-12-28 09:15:21,174][105115] Fps is (10 sec: 18841.9, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 998014976. Throughput: 0: 9812.0, 1: 9736.7. Samples: 998024872. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:21,175][105115] Avg episode reward: [(0, '-4.480'), (1, '-4.734')] [2023-12-28 09:15:21,994][106226] Updated weights for policy 0, policy_version 1946924 (0.0008) [2023-12-28 09:15:21,994][106225] Updated weights for policy 1, policy_version 1951080 (0.0008) [2023-12-28 09:15:22,056][106225] Updated weights for policy 1, policy_version 1951090 (0.0007) [2023-12-28 09:15:22,062][106226] Updated weights for policy 0, policy_version 1946934 (0.0009) [2023-12-28 09:15:22,117][106225] Updated weights for policy 1, policy_version 1951100 (0.0007) [2023-12-28 09:15:22,130][106226] Updated weights for policy 0, policy_version 1946944 (0.0008) [2023-12-28 09:15:22,816][106226] Updated weights for policy 0, policy_version 1946954 (0.0006) [2023-12-28 09:15:22,869][106225] Updated weights for policy 1, policy_version 1951110 (0.0010) [2023-12-28 09:15:22,876][106226] Updated weights for policy 0, policy_version 1946964 (0.0009) [2023-12-28 09:15:22,928][106225] Updated weights for policy 1, policy_version 1951120 (0.0011) [2023-12-28 09:15:22,936][106226] Updated weights for policy 0, policy_version 1946974 (0.0008) [2023-12-28 09:15:22,983][106225] Updated weights for policy 1, policy_version 1951130 (0.0011) [2023-12-28 09:15:22,997][106226] Updated weights for policy 0, policy_version 1946984 (0.0006) [2023-12-28 09:15:23,661][106226] Updated weights for policy 0, policy_version 1946994 (0.0005) [2023-12-28 09:15:23,719][106225] Updated weights for policy 1, policy_version 1951140 (0.0010) [2023-12-28 09:15:23,719][106226] Updated weights for policy 0, policy_version 1947004 (0.0006) [2023-12-28 09:15:23,772][106225] Updated weights for policy 1, policy_version 1951150 (0.0008) [2023-12-28 09:15:23,777][106226] Updated weights for policy 0, policy_version 1947014 (0.0007) [2023-12-28 09:15:23,838][106225] Updated weights for policy 1, policy_version 1951160 (0.0006) [2023-12-28 09:15:24,455][106226] Updated weights for policy 0, policy_version 1947024 (0.0008) [2023-12-28 09:15:24,496][106225] Updated weights for policy 1, policy_version 1951170 (0.0009) [2023-12-28 09:15:24,522][106226] Updated weights for policy 0, policy_version 1947034 (0.0007) [2023-12-28 09:15:24,561][106225] Updated weights for policy 1, policy_version 1951180 (0.0009) [2023-12-28 09:15:24,585][106226] Updated weights for policy 0, policy_version 1947044 (0.0009) [2023-12-28 09:15:24,621][106225] Updated weights for policy 1, policy_version 1951190 (0.0011) [2023-12-28 09:15:24,683][106225] Updated weights for policy 1, policy_version 1951200 (0.0010) [2023-12-28 09:15:25,314][106225] Updated weights for policy 1, policy_version 1951210 (0.0010) [2023-12-28 09:15:25,342][106226] Updated weights for policy 0, policy_version 1947054 (0.0006) [2023-12-28 09:15:25,360][106225] Updated weights for policy 1, policy_version 1951220 (0.0010) [2023-12-28 09:15:25,398][106226] Updated weights for policy 0, policy_version 1947064 (0.0008) [2023-12-28 09:15:25,411][106225] Updated weights for policy 1, policy_version 1951230 (0.0010) [2023-12-28 09:15:25,452][106226] Updated weights for policy 0, policy_version 1947074 (0.0007) [2023-12-28 09:15:26,018][106225] Updated weights for policy 1, policy_version 1951240 (0.0009) [2023-12-28 09:15:26,074][106225] Updated weights for policy 1, policy_version 1951250 (0.0008) [2023-12-28 09:15:26,127][106225] Updated weights for policy 1, policy_version 1951260 (0.0009) [2023-12-28 09:15:26,175][105115] Fps is (10 sec: 18841.6, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 998113280. Throughput: 0: 9772.3, 1: 9717.8. Samples: 998080888. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:26,175][105115] Avg episode reward: [(0, '-3.973'), (1, '-4.713')] [2023-12-28 09:15:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001947080_498532352.pth... [2023-12-28 09:15:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001951264_499580928.pth... [2023-12-28 09:15:26,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001945960_498245632.pth [2023-12-28 09:15:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001950112_499286016.pth [2023-12-28 09:15:26,251][106226] Updated weights for policy 0, policy_version 1947084 (0.0008) [2023-12-28 09:15:26,306][106226] Updated weights for policy 0, policy_version 1947094 (0.0008) [2023-12-28 09:15:26,371][106226] Updated weights for policy 0, policy_version 1947104 (0.0009) [2023-12-28 09:15:26,866][106225] Updated weights for policy 1, policy_version 1951270 (0.0009) [2023-12-28 09:15:26,932][106225] Updated weights for policy 1, policy_version 1951280 (0.0008) [2023-12-28 09:15:26,992][106225] Updated weights for policy 1, policy_version 1951290 (0.0008) [2023-12-28 09:15:27,096][106226] Updated weights for policy 0, policy_version 1947114 (0.0009) [2023-12-28 09:15:27,156][106226] Updated weights for policy 0, policy_version 1947124 (0.0008) [2023-12-28 09:15:27,223][106226] Updated weights for policy 0, policy_version 1947134 (0.0009) [2023-12-28 09:15:27,279][106226] Updated weights for policy 0, policy_version 1947144 (0.0009) [2023-12-28 09:15:27,703][106225] Updated weights for policy 1, policy_version 1951300 (0.0009) [2023-12-28 09:15:27,755][106225] Updated weights for policy 1, policy_version 1951310 (0.0008) [2023-12-28 09:15:27,800][106225] Updated weights for policy 1, policy_version 1951320 (0.0008) [2023-12-28 09:15:28,010][106226] Updated weights for policy 0, policy_version 1947154 (0.0008) [2023-12-28 09:15:28,061][106226] Updated weights for policy 0, policy_version 1947164 (0.0008) [2023-12-28 09:15:28,120][106226] Updated weights for policy 0, policy_version 1947174 (0.0009) [2023-12-28 09:15:28,424][106225] Updated weights for policy 1, policy_version 1951330 (0.0008) [2023-12-28 09:15:28,486][106225] Updated weights for policy 1, policy_version 1951340 (0.0005) [2023-12-28 09:15:28,544][106225] Updated weights for policy 1, policy_version 1951350 (0.0005) [2023-12-28 09:15:28,605][106225] Updated weights for policy 1, policy_version 1951360 (0.0005) [2023-12-28 09:15:28,939][106226] Updated weights for policy 0, policy_version 1947184 (0.0010) [2023-12-28 09:15:28,988][106226] Updated weights for policy 0, policy_version 1947194 (0.0009) [2023-12-28 09:15:29,043][106226] Updated weights for policy 0, policy_version 1947204 (0.0007) [2023-12-28 09:15:29,151][106225] Updated weights for policy 1, policy_version 1951370 (0.0009) [2023-12-28 09:15:29,196][106225] Updated weights for policy 1, policy_version 1951380 (0.0009) [2023-12-28 09:15:29,262][106225] Updated weights for policy 1, policy_version 1951390 (0.0007) [2023-12-28 09:15:29,818][106226] Updated weights for policy 0, policy_version 1947214 (0.0007) [2023-12-28 09:15:29,880][106226] Updated weights for policy 0, policy_version 1947224 (0.0008) [2023-12-28 09:15:29,938][106226] Updated weights for policy 0, policy_version 1947234 (0.0008) [2023-12-28 09:15:29,969][106225] Updated weights for policy 1, policy_version 1951400 (0.0009) [2023-12-28 09:15:30,021][106225] Updated weights for policy 1, policy_version 1951410 (0.0006) [2023-12-28 09:15:30,081][106225] Updated weights for policy 1, policy_version 1951420 (0.0005) [2023-12-28 09:15:30,594][106226] Updated weights for policy 0, policy_version 1947244 (0.0007) [2023-12-28 09:15:30,650][106226] Updated weights for policy 0, policy_version 1947254 (0.0008) [2023-12-28 09:15:30,701][106226] Updated weights for policy 0, policy_version 1947264 (0.0008) [2023-12-28 09:15:30,769][106225] Updated weights for policy 1, policy_version 1951430 (0.0006) [2023-12-28 09:15:30,824][106225] Updated weights for policy 1, policy_version 1951440 (0.0008) [2023-12-28 09:15:30,869][106225] Updated weights for policy 1, policy_version 1951450 (0.0008) [2023-12-28 09:15:31,174][105115] Fps is (10 sec: 19660.8, 60 sec: 19660.8, 300 sec: 19744.1). Total num frames: 998211584. Throughput: 0: 9678.1, 1: 9887.6. Samples: 998199376. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:31,175][105115] Avg episode reward: [(0, '-3.877'), (1, '-4.672')] [2023-12-28 09:15:31,389][106226] Updated weights for policy 0, policy_version 1947274 (0.0008) [2023-12-28 09:15:31,453][106226] Updated weights for policy 0, policy_version 1947284 (0.0007) [2023-12-28 09:15:31,514][106226] Updated weights for policy 0, policy_version 1947294 (0.0008) [2023-12-28 09:15:31,575][106226] Updated weights for policy 0, policy_version 1947304 (0.0009) [2023-12-28 09:15:31,673][106225] Updated weights for policy 1, policy_version 1951460 (0.0008) [2023-12-28 09:15:31,729][106225] Updated weights for policy 1, policy_version 1951470 (0.0008) [2023-12-28 09:15:31,794][106225] Updated weights for policy 1, policy_version 1951480 (0.0008) [2023-12-28 09:15:32,364][106226] Updated weights for policy 0, policy_version 1947314 (0.0009) [2023-12-28 09:15:32,431][106226] Updated weights for policy 0, policy_version 1947324 (0.0009) [2023-12-28 09:15:32,494][106226] Updated weights for policy 0, policy_version 1947334 (0.0011) [2023-12-28 09:15:32,562][106225] Updated weights for policy 1, policy_version 1951490 (0.0008) [2023-12-28 09:15:32,619][106225] Updated weights for policy 1, policy_version 1951500 (0.0008) [2023-12-28 09:15:32,675][106225] Updated weights for policy 1, policy_version 1951510 (0.0007) [2023-12-28 09:15:32,724][106225] Updated weights for policy 1, policy_version 1951520 (0.0008) [2023-12-28 09:15:33,227][106226] Updated weights for policy 0, policy_version 1947344 (0.0011) [2023-12-28 09:15:33,280][106226] Updated weights for policy 0, policy_version 1947354 (0.0006) [2023-12-28 09:15:33,349][106226] Updated weights for policy 0, policy_version 1947364 (0.0010) [2023-12-28 09:15:33,456][106225] Updated weights for policy 1, policy_version 1951530 (0.0005) [2023-12-28 09:15:33,512][106225] Updated weights for policy 1, policy_version 1951540 (0.0007) [2023-12-28 09:15:33,565][106225] Updated weights for policy 1, policy_version 1951550 (0.0009) [2023-12-28 09:15:34,004][106226] Updated weights for policy 0, policy_version 1947374 (0.0009) [2023-12-28 09:15:34,059][106226] Updated weights for policy 0, policy_version 1947384 (0.0010) [2023-12-28 09:15:34,124][106226] Updated weights for policy 0, policy_version 1947394 (0.0010) [2023-12-28 09:15:34,202][106225] Updated weights for policy 1, policy_version 1951560 (0.0009) [2023-12-28 09:15:34,269][106225] Updated weights for policy 1, policy_version 1951570 (0.0011) [2023-12-28 09:15:34,331][106225] Updated weights for policy 1, policy_version 1951580 (0.0010) [2023-12-28 09:15:34,887][106226] Updated weights for policy 0, policy_version 1947404 (0.0009) [2023-12-28 09:15:34,938][106226] Updated weights for policy 0, policy_version 1947414 (0.0007) [2023-12-28 09:15:34,999][106226] Updated weights for policy 0, policy_version 1947424 (0.0008) [2023-12-28 09:15:35,042][106225] Updated weights for policy 1, policy_version 1951590 (0.0010) [2023-12-28 09:15:35,102][106225] Updated weights for policy 1, policy_version 1951600 (0.0010) [2023-12-28 09:15:35,152][106225] Updated weights for policy 1, policy_version 1951610 (0.0010) [2023-12-28 09:15:35,680][106226] Updated weights for policy 0, policy_version 1947434 (0.0008) [2023-12-28 09:15:35,739][106226] Updated weights for policy 0, policy_version 1947444 (0.0005) [2023-12-28 09:15:35,800][106226] Updated weights for policy 0, policy_version 1947454 (0.0008) [2023-12-28 09:15:35,801][106225] Updated weights for policy 1, policy_version 1951620 (0.0010) [2023-12-28 09:15:35,854][106226] Updated weights for policy 0, policy_version 1947464 (0.0010) [2023-12-28 09:15:35,856][106225] Updated weights for policy 1, policy_version 1951630 (0.0010) [2023-12-28 09:15:35,910][106225] Updated weights for policy 1, policy_version 1951640 (0.0010) [2023-12-28 09:15:36,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19524.3, 300 sec: 19744.1). Total num frames: 998309888. Throughput: 0: 9672.4, 1: 9853.6. Samples: 998317432. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:36,175][105115] Avg episode reward: [(0, '-4.513'), (1, '-4.668')] [2023-12-28 09:15:36,516][106226] Updated weights for policy 0, policy_version 1947474 (0.0009) [2023-12-28 09:15:36,583][106226] Updated weights for policy 0, policy_version 1947484 (0.0011) [2023-12-28 09:15:36,653][106226] Updated weights for policy 0, policy_version 1947494 (0.0008) [2023-12-28 09:15:36,670][106225] Updated weights for policy 1, policy_version 1951650 (0.0010) [2023-12-28 09:15:36,725][106225] Updated weights for policy 1, policy_version 1951660 (0.0010) [2023-12-28 09:15:36,779][106225] Updated weights for policy 1, policy_version 1951670 (0.0010) [2023-12-28 09:15:36,833][106225] Updated weights for policy 1, policy_version 1951680 (0.0010) [2023-12-28 09:15:37,260][106226] Updated weights for policy 0, policy_version 1947504 (0.0007) [2023-12-28 09:15:37,323][106226] Updated weights for policy 0, policy_version 1947514 (0.0005) [2023-12-28 09:15:37,386][106226] Updated weights for policy 0, policy_version 1947524 (0.0005) [2023-12-28 09:15:37,514][106225] Updated weights for policy 1, policy_version 1951690 (0.0007) [2023-12-28 09:15:37,573][106225] Updated weights for policy 1, policy_version 1951700 (0.0008) [2023-12-28 09:15:37,632][106225] Updated weights for policy 1, policy_version 1951710 (0.0008) [2023-12-28 09:15:38,075][106226] Updated weights for policy 0, policy_version 1947534 (0.0009) [2023-12-28 09:15:38,138][106226] Updated weights for policy 0, policy_version 1947544 (0.0008) [2023-12-28 09:15:38,195][106226] Updated weights for policy 0, policy_version 1947554 (0.0007) [2023-12-28 09:15:38,222][106225] Updated weights for policy 1, policy_version 1951720 (0.0006) [2023-12-28 09:15:38,285][106225] Updated weights for policy 1, policy_version 1951730 (0.0005) [2023-12-28 09:15:38,344][106225] Updated weights for policy 1, policy_version 1951740 (0.0008) [2023-12-28 09:15:38,901][106226] Updated weights for policy 0, policy_version 1947564 (0.0006) [2023-12-28 09:15:38,951][106226] Updated weights for policy 0, policy_version 1947574 (0.0005) [2023-12-28 09:15:38,957][106225] Updated weights for policy 1, policy_version 1951750 (0.0010) [2023-12-28 09:15:39,007][106226] Updated weights for policy 0, policy_version 1947584 (0.0005) [2023-12-28 09:15:39,017][106225] Updated weights for policy 1, policy_version 1951760 (0.0009) [2023-12-28 09:15:39,082][106225] Updated weights for policy 1, policy_version 1951770 (0.0005) [2023-12-28 09:15:39,624][106226] Updated weights for policy 0, policy_version 1947594 (0.0007) [2023-12-28 09:15:39,685][106226] Updated weights for policy 0, policy_version 1947604 (0.0006) [2023-12-28 09:15:39,751][106226] Updated weights for policy 0, policy_version 1947614 (0.0007) [2023-12-28 09:15:39,801][106225] Updated weights for policy 1, policy_version 1951780 (0.0007) [2023-12-28 09:15:39,816][106226] Updated weights for policy 0, policy_version 1947624 (0.0011) [2023-12-28 09:15:39,870][106225] Updated weights for policy 1, policy_version 1951790 (0.0007) [2023-12-28 09:15:39,938][106225] Updated weights for policy 1, policy_version 1951800 (0.0007) [2023-12-28 09:15:40,508][106226] Updated weights for policy 0, policy_version 1947634 (0.0011) [2023-12-28 09:15:40,569][106226] Updated weights for policy 0, policy_version 1947644 (0.0010) [2023-12-28 09:15:40,625][106226] Updated weights for policy 0, policy_version 1947654 (0.0010) [2023-12-28 09:15:40,661][106225] Updated weights for policy 1, policy_version 1951810 (0.0008) [2023-12-28 09:15:40,720][106225] Updated weights for policy 1, policy_version 1951820 (0.0008) [2023-12-28 09:15:40,778][106225] Updated weights for policy 1, policy_version 1951830 (0.0008) [2023-12-28 09:15:40,838][106225] Updated weights for policy 1, policy_version 1951840 (0.0008) [2023-12-28 09:15:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 998408192. Throughput: 0: 9676.1, 1: 9893.9. Samples: 998378248. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:41,175][105115] Avg episode reward: [(0, '-4.549'), (1, '-4.636')] [2023-12-28 09:15:41,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001951840_499728384.pth... [2023-12-28 09:15:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001947656_498679808.pth... [2023-12-28 09:15:41,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001950688_499433472.pth [2023-12-28 09:15:41,187][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001946536_498393088.pth [2023-12-28 09:15:41,391][106226] Updated weights for policy 0, policy_version 1947664 (0.0008) [2023-12-28 09:15:41,454][106226] Updated weights for policy 0, policy_version 1947674 (0.0009) [2023-12-28 09:15:41,516][106226] Updated weights for policy 0, policy_version 1947684 (0.0010) [2023-12-28 09:15:41,581][106225] Updated weights for policy 1, policy_version 1951850 (0.0009) [2023-12-28 09:15:41,643][106225] Updated weights for policy 1, policy_version 1951860 (0.0010) [2023-12-28 09:15:41,702][106225] Updated weights for policy 1, policy_version 1951870 (0.0009) [2023-12-28 09:15:42,204][106226] Updated weights for policy 0, policy_version 1947694 (0.0006) [2023-12-28 09:15:42,272][106226] Updated weights for policy 0, policy_version 1947704 (0.0007) [2023-12-28 09:15:42,332][106226] Updated weights for policy 0, policy_version 1947714 (0.0009) [2023-12-28 09:15:42,541][106225] Updated weights for policy 1, policy_version 1951880 (0.0008) [2023-12-28 09:15:42,602][106225] Updated weights for policy 1, policy_version 1951890 (0.0009) [2023-12-28 09:15:42,654][106225] Updated weights for policy 1, policy_version 1951900 (0.0010) [2023-12-28 09:15:42,991][106226] Updated weights for policy 0, policy_version 1947724 (0.0010) [2023-12-28 09:15:43,052][106226] Updated weights for policy 0, policy_version 1947734 (0.0008) [2023-12-28 09:15:43,110][106226] Updated weights for policy 0, policy_version 1947744 (0.0008) [2023-12-28 09:15:43,388][106225] Updated weights for policy 1, policy_version 1951910 (0.0011) [2023-12-28 09:15:43,441][106225] Updated weights for policy 1, policy_version 1951920 (0.0010) [2023-12-28 09:15:43,498][106225] Updated weights for policy 1, policy_version 1951930 (0.0010) [2023-12-28 09:15:43,834][106226] Updated weights for policy 0, policy_version 1947754 (0.0008) [2023-12-28 09:15:43,893][106226] Updated weights for policy 0, policy_version 1947764 (0.0010) [2023-12-28 09:15:43,947][106226] Updated weights for policy 0, policy_version 1947774 (0.0009) [2023-12-28 09:15:44,011][106226] Updated weights for policy 0, policy_version 1947784 (0.0009) [2023-12-28 09:15:44,130][106225] Updated weights for policy 1, policy_version 1951940 (0.0010) [2023-12-28 09:15:44,193][106225] Updated weights for policy 1, policy_version 1951950 (0.0009) [2023-12-28 09:15:44,255][106225] Updated weights for policy 1, policy_version 1951960 (0.0005) [2023-12-28 09:15:44,753][106226] Updated weights for policy 0, policy_version 1947794 (0.0008) [2023-12-28 09:15:44,817][106226] Updated weights for policy 0, policy_version 1947804 (0.0009) [2023-12-28 09:15:44,872][106226] Updated weights for policy 0, policy_version 1947814 (0.0006) [2023-12-28 09:15:44,900][106225] Updated weights for policy 1, policy_version 1951970 (0.0007) [2023-12-28 09:15:44,962][106225] Updated weights for policy 1, policy_version 1951980 (0.0008) [2023-12-28 09:15:45,019][106225] Updated weights for policy 1, policy_version 1951990 (0.0009) [2023-12-28 09:15:45,073][106225] Updated weights for policy 1, policy_version 1952000 (0.0006) [2023-12-28 09:15:45,622][106226] Updated weights for policy 0, policy_version 1947824 (0.0006) [2023-12-28 09:15:45,673][106226] Updated weights for policy 0, policy_version 1947834 (0.0005) [2023-12-28 09:15:45,730][106226] Updated weights for policy 0, policy_version 1947844 (0.0006) [2023-12-28 09:15:45,752][106225] Updated weights for policy 1, policy_version 1952010 (0.0006) [2023-12-28 09:15:45,808][106225] Updated weights for policy 1, policy_version 1952020 (0.0008) [2023-12-28 09:15:45,858][106225] Updated weights for policy 1, policy_version 1952030 (0.0008) [2023-12-28 09:15:46,174][105115] Fps is (10 sec: 19660.9, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 998506496. Throughput: 0: 9640.7, 1: 9931.8. Samples: 998495256. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:46,175][105115] Avg episode reward: [(0, '-4.404'), (1, '-4.620')] [2023-12-28 09:15:46,279][106226] Updated weights for policy 0, policy_version 1947854 (0.0008) [2023-12-28 09:15:46,332][106226] Updated weights for policy 0, policy_version 1947864 (0.0005) [2023-12-28 09:15:46,380][106226] Updated weights for policy 0, policy_version 1947874 (0.0005) [2023-12-28 09:15:46,675][106225] Updated weights for policy 1, policy_version 1952040 (0.0009) [2023-12-28 09:15:46,732][106225] Updated weights for policy 1, policy_version 1952050 (0.0009) [2023-12-28 09:15:46,780][106225] Updated weights for policy 1, policy_version 1952060 (0.0008) [2023-12-28 09:15:47,071][106226] Updated weights for policy 0, policy_version 1947884 (0.0006) [2023-12-28 09:15:47,127][106226] Updated weights for policy 0, policy_version 1947894 (0.0007) [2023-12-28 09:15:47,180][106226] Updated weights for policy 0, policy_version 1947904 (0.0007) [2023-12-28 09:15:47,455][106225] Updated weights for policy 1, policy_version 1952070 (0.0009) [2023-12-28 09:15:47,512][106225] Updated weights for policy 1, policy_version 1952080 (0.0010) [2023-12-28 09:15:47,573][106225] Updated weights for policy 1, policy_version 1952090 (0.0011) [2023-12-28 09:15:47,907][106226] Updated weights for policy 0, policy_version 1947914 (0.0007) [2023-12-28 09:15:47,961][106226] Updated weights for policy 0, policy_version 1947924 (0.0008) [2023-12-28 09:15:48,015][106226] Updated weights for policy 0, policy_version 1947934 (0.0008) [2023-12-28 09:15:48,066][106226] Updated weights for policy 0, policy_version 1947944 (0.0008) [2023-12-28 09:15:48,284][106225] Updated weights for policy 1, policy_version 1952100 (0.0010) [2023-12-28 09:15:48,346][106225] Updated weights for policy 1, policy_version 1952110 (0.0010) [2023-12-28 09:15:48,410][106225] Updated weights for policy 1, policy_version 1952120 (0.0010) [2023-12-28 09:15:48,833][106226] Updated weights for policy 0, policy_version 1947954 (0.0007) [2023-12-28 09:15:48,894][106226] Updated weights for policy 0, policy_version 1947964 (0.0007) [2023-12-28 09:15:48,944][106226] Updated weights for policy 0, policy_version 1947974 (0.0008) [2023-12-28 09:15:49,140][106225] Updated weights for policy 1, policy_version 1952130 (0.0011) [2023-12-28 09:15:49,186][106225] Updated weights for policy 1, policy_version 1952140 (0.0010) [2023-12-28 09:15:49,249][106225] Updated weights for policy 1, policy_version 1952150 (0.0010) [2023-12-28 09:15:49,308][106225] Updated weights for policy 1, policy_version 1952160 (0.0010) [2023-12-28 09:15:49,738][106226] Updated weights for policy 0, policy_version 1947984 (0.0009) [2023-12-28 09:15:49,811][106226] Updated weights for policy 0, policy_version 1947994 (0.0009) [2023-12-28 09:15:49,878][106226] Updated weights for policy 0, policy_version 1948004 (0.0008) [2023-12-28 09:15:50,075][106225] Updated weights for policy 1, policy_version 1952170 (0.0010) [2023-12-28 09:15:50,132][106225] Updated weights for policy 1, policy_version 1952180 (0.0010) [2023-12-28 09:15:50,193][106225] Updated weights for policy 1, policy_version 1952190 (0.0011) [2023-12-28 09:15:50,663][106226] Updated weights for policy 0, policy_version 1948014 (0.0008) [2023-12-28 09:15:50,721][106226] Updated weights for policy 0, policy_version 1948024 (0.0008) [2023-12-28 09:15:50,783][106226] Updated weights for policy 0, policy_version 1948034 (0.0008) [2023-12-28 09:15:50,922][106225] Updated weights for policy 1, policy_version 1952200 (0.0010) [2023-12-28 09:15:50,983][106225] Updated weights for policy 1, policy_version 1952210 (0.0010) [2023-12-28 09:15:51,045][106225] Updated weights for policy 1, policy_version 1952220 (0.0010) [2023-12-28 09:15:51,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19524.3, 300 sec: 19716.3). Total num frames: 998604800. Throughput: 0: 9656.6, 1: 9823.8. Samples: 998611036. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:51,175][105115] Avg episode reward: [(0, '-4.575'), (1, '-4.642')] [2023-12-28 09:15:51,556][106226] Updated weights for policy 0, policy_version 1948044 (0.0008) [2023-12-28 09:15:51,623][106226] Updated weights for policy 0, policy_version 1948054 (0.0008) [2023-12-28 09:15:51,691][106226] Updated weights for policy 0, policy_version 1948064 (0.0008) [2023-12-28 09:15:51,799][106225] Updated weights for policy 1, policy_version 1952230 (0.0010) [2023-12-28 09:15:51,860][106225] Updated weights for policy 1, policy_version 1952240 (0.0011) [2023-12-28 09:15:51,918][106225] Updated weights for policy 1, policy_version 1952250 (0.0010) [2023-12-28 09:15:52,427][106226] Updated weights for policy 0, policy_version 1948074 (0.0008) [2023-12-28 09:15:52,474][106226] Updated weights for policy 0, policy_version 1948084 (0.0008) [2023-12-28 09:15:52,521][106226] Updated weights for policy 0, policy_version 1948094 (0.0008) [2023-12-28 09:15:52,566][106226] Updated weights for policy 0, policy_version 1948104 (0.0008) [2023-12-28 09:15:52,648][106225] Updated weights for policy 1, policy_version 1952260 (0.0011) [2023-12-28 09:15:52,709][106225] Updated weights for policy 1, policy_version 1952270 (0.0010) [2023-12-28 09:15:52,769][106225] Updated weights for policy 1, policy_version 1952280 (0.0010) [2023-12-28 09:15:53,352][106226] Updated weights for policy 0, policy_version 1948114 (0.0008) [2023-12-28 09:15:53,415][106226] Updated weights for policy 0, policy_version 1948124 (0.0008) [2023-12-28 09:15:53,470][106226] Updated weights for policy 0, policy_version 1948134 (0.0008) [2023-12-28 09:15:53,476][106225] Updated weights for policy 1, policy_version 1952290 (0.0010) [2023-12-28 09:15:53,540][106225] Updated weights for policy 1, policy_version 1952300 (0.0008) [2023-12-28 09:15:53,597][106225] Updated weights for policy 1, policy_version 1952310 (0.0010) [2023-12-28 09:15:53,654][106225] Updated weights for policy 1, policy_version 1952320 (0.0010) [2023-12-28 09:15:54,194][106226] Updated weights for policy 0, policy_version 1948144 (0.0007) [2023-12-28 09:15:54,259][106226] Updated weights for policy 0, policy_version 1948154 (0.0008) [2023-12-28 09:15:54,318][106226] Updated weights for policy 0, policy_version 1948164 (0.0007) [2023-12-28 09:15:54,366][106225] Updated weights for policy 1, policy_version 1952330 (0.0010) [2023-12-28 09:15:54,419][106225] Updated weights for policy 1, policy_version 1952340 (0.0010) [2023-12-28 09:15:54,469][106225] Updated weights for policy 1, policy_version 1952350 (0.0010) [2023-12-28 09:15:55,040][106226] Updated weights for policy 0, policy_version 1948174 (0.0007) [2023-12-28 09:15:55,098][106226] Updated weights for policy 0, policy_version 1948184 (0.0008) [2023-12-28 09:15:55,159][106226] Updated weights for policy 0, policy_version 1948194 (0.0007) [2023-12-28 09:15:55,192][106225] Updated weights for policy 1, policy_version 1952360 (0.0010) [2023-12-28 09:15:55,235][106225] Updated weights for policy 1, policy_version 1952370 (0.0010) [2023-12-28 09:15:55,284][106225] Updated weights for policy 1, policy_version 1952380 (0.0010) [2023-12-28 09:15:55,890][106226] Updated weights for policy 0, policy_version 1948204 (0.0007) [2023-12-28 09:15:55,939][106226] Updated weights for policy 0, policy_version 1948214 (0.0008) [2023-12-28 09:15:55,999][106226] Updated weights for policy 0, policy_version 1948224 (0.0007) [2023-12-28 09:15:56,020][106225] Updated weights for policy 1, policy_version 1952390 (0.0010) [2023-12-28 09:15:56,076][106225] Updated weights for policy 1, policy_version 1952400 (0.0010) [2023-12-28 09:15:56,125][106225] Updated weights for policy 1, policy_version 1952410 (0.0010) [2023-12-28 09:15:56,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19660.8, 300 sec: 19716.3). Total num frames: 998703104. Throughput: 0: 9623.2, 1: 9763.9. Samples: 998666828. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:15:56,175][105115] Avg episode reward: [(0, '-4.321'), (1, '-4.727')] [2023-12-28 09:15:56,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001952416_499875840.pth... [2023-12-28 09:15:56,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001948232_498827264.pth... [2023-12-28 09:15:56,187][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001951264_499580928.pth [2023-12-28 09:15:56,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001947080_498532352.pth [2023-12-28 09:15:56,741][106226] Updated weights for policy 0, policy_version 1948234 (0.0006) [2023-12-28 09:15:56,795][106226] Updated weights for policy 0, policy_version 1948244 (0.0008) [2023-12-28 09:15:56,844][106225] Updated weights for policy 1, policy_version 1952420 (0.0010) [2023-12-28 09:15:56,854][106226] Updated weights for policy 0, policy_version 1948254 (0.0007) [2023-12-28 09:15:56,905][106225] Updated weights for policy 1, policy_version 1952430 (0.0010) [2023-12-28 09:15:56,908][106226] Updated weights for policy 0, policy_version 1948264 (0.0007) [2023-12-28 09:15:56,959][106225] Updated weights for policy 1, policy_version 1952440 (0.0010) [2023-12-28 09:15:57,638][106226] Updated weights for policy 0, policy_version 1948274 (0.0008) [2023-12-28 09:15:57,684][106225] Updated weights for policy 1, policy_version 1952450 (0.0011) [2023-12-28 09:15:57,687][106226] Updated weights for policy 0, policy_version 1948284 (0.0007) [2023-12-28 09:15:57,734][106226] Updated weights for policy 0, policy_version 1948294 (0.0007) [2023-12-28 09:15:57,744][106225] Updated weights for policy 1, policy_version 1952460 (0.0010) [2023-12-28 09:15:57,790][106225] Updated weights for policy 1, policy_version 1952470 (0.0010) [2023-12-28 09:15:57,837][106225] Updated weights for policy 1, policy_version 1952480 (0.0010) [2023-12-28 09:15:58,595][106226] Updated weights for policy 0, policy_version 1948304 (0.0008) [2023-12-28 09:15:58,610][106225] Updated weights for policy 1, policy_version 1952490 (0.0009) [2023-12-28 09:15:58,654][106226] Updated weights for policy 0, policy_version 1948314 (0.0009) [2023-12-28 09:15:58,671][106225] Updated weights for policy 1, policy_version 1952500 (0.0009) [2023-12-28 09:15:58,715][106226] Updated weights for policy 0, policy_version 1948324 (0.0009) [2023-12-28 09:15:58,734][106225] Updated weights for policy 1, policy_version 1952510 (0.0008) [2023-12-28 09:15:59,553][106226] Updated weights for policy 0, policy_version 1948334 (0.0009) [2023-12-28 09:15:59,591][106225] Updated weights for policy 1, policy_version 1952520 (0.0006) [2023-12-28 09:15:59,614][106226] Updated weights for policy 0, policy_version 1948344 (0.0007) [2023-12-28 09:15:59,646][106225] Updated weights for policy 1, policy_version 1952530 (0.0006) [2023-12-28 09:15:59,674][106226] Updated weights for policy 0, policy_version 1948354 (0.0008) [2023-12-28 09:15:59,695][106225] Updated weights for policy 1, policy_version 1952540 (0.0007) [2023-12-28 09:16:00,391][106226] Updated weights for policy 0, policy_version 1948364 (0.0006) [2023-12-28 09:16:00,449][106226] Updated weights for policy 0, policy_version 1948374 (0.0005) [2023-12-28 09:16:00,450][106225] Updated weights for policy 1, policy_version 1952550 (0.0008) [2023-12-28 09:16:00,496][106226] Updated weights for policy 0, policy_version 1948384 (0.0006) [2023-12-28 09:16:00,510][106225] Updated weights for policy 1, policy_version 1952560 (0.0008) [2023-12-28 09:16:00,573][106225] Updated weights for policy 1, policy_version 1952570 (0.0008) [2023-12-28 09:16:01,096][106226] Updated weights for policy 0, policy_version 1948394 (0.0006) [2023-12-28 09:16:01,165][106226] Updated weights for policy 0, policy_version 1948404 (0.0011) [2023-12-28 09:16:01,174][105115] Fps is (10 sec: 18022.5, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 998785024. Throughput: 0: 9548.1, 1: 9748.3. Samples: 998778372. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:01,175][105115] Avg episode reward: [(0, '-4.348'), (1, '-4.656')] [2023-12-28 09:16:01,237][106226] Updated weights for policy 0, policy_version 1948414 (0.0011) [2023-12-28 09:16:01,249][106225] Updated weights for policy 1, policy_version 1952580 (0.0008) [2023-12-28 09:16:01,308][106225] Updated weights for policy 1, policy_version 1952590 (0.0007) [2023-12-28 09:16:01,310][106226] Updated weights for policy 0, policy_version 1948424 (0.0007) [2023-12-28 09:16:01,375][106225] Updated weights for policy 1, policy_version 1952600 (0.0008) [2023-12-28 09:16:01,983][106226] Updated weights for policy 0, policy_version 1948434 (0.0009) [2023-12-28 09:16:02,043][106226] Updated weights for policy 0, policy_version 1948444 (0.0009) [2023-12-28 09:16:02,062][106225] Updated weights for policy 1, policy_version 1952610 (0.0006) [2023-12-28 09:16:02,103][106226] Updated weights for policy 0, policy_version 1948454 (0.0007) [2023-12-28 09:16:02,120][106225] Updated weights for policy 1, policy_version 1952620 (0.0006) [2023-12-28 09:16:02,180][106225] Updated weights for policy 1, policy_version 1952630 (0.0008) [2023-12-28 09:16:02,232][106225] Updated weights for policy 1, policy_version 1952640 (0.0008) [2023-12-28 09:16:02,787][106226] Updated weights for policy 0, policy_version 1948464 (0.0008) [2023-12-28 09:16:02,852][106226] Updated weights for policy 0, policy_version 1948474 (0.0009) [2023-12-28 09:16:02,900][106226] Updated weights for policy 0, policy_version 1948484 (0.0007) [2023-12-28 09:16:02,930][106225] Updated weights for policy 1, policy_version 1952650 (0.0007) [2023-12-28 09:16:02,981][106225] Updated weights for policy 1, policy_version 1952660 (0.0009) [2023-12-28 09:16:03,041][106225] Updated weights for policy 1, policy_version 1952670 (0.0008) [2023-12-28 09:16:03,588][106226] Updated weights for policy 0, policy_version 1948494 (0.0005) [2023-12-28 09:16:03,654][106226] Updated weights for policy 0, policy_version 1948504 (0.0009) [2023-12-28 09:16:03,720][106226] Updated weights for policy 0, policy_version 1948514 (0.0008) [2023-12-28 09:16:03,798][106225] Updated weights for policy 1, policy_version 1952680 (0.0007) [2023-12-28 09:16:03,853][106225] Updated weights for policy 1, policy_version 1952690 (0.0008) [2023-12-28 09:16:03,920][106225] Updated weights for policy 1, policy_version 1952700 (0.0006) [2023-12-28 09:16:04,350][106226] Updated weights for policy 0, policy_version 1948524 (0.0007) [2023-12-28 09:16:04,407][106226] Updated weights for policy 0, policy_version 1948534 (0.0006) [2023-12-28 09:16:04,464][106226] Updated weights for policy 0, policy_version 1948544 (0.0005) [2023-12-28 09:16:04,727][106225] Updated weights for policy 1, policy_version 1952710 (0.0008) [2023-12-28 09:16:04,776][106225] Updated weights for policy 1, policy_version 1952720 (0.0009) [2023-12-28 09:16:04,825][106225] Updated weights for policy 1, policy_version 1952730 (0.0008) [2023-12-28 09:16:05,076][106226] Updated weights for policy 0, policy_version 1948554 (0.0006) [2023-12-28 09:16:05,133][106226] Updated weights for policy 0, policy_version 1948564 (0.0009) [2023-12-28 09:16:05,194][106226] Updated weights for policy 0, policy_version 1948574 (0.0009) [2023-12-28 09:16:05,251][106226] Updated weights for policy 0, policy_version 1948584 (0.0009) [2023-12-28 09:16:05,646][106225] Updated weights for policy 1, policy_version 1952740 (0.0008) [2023-12-28 09:16:05,714][106225] Updated weights for policy 1, policy_version 1952750 (0.0008) [2023-12-28 09:16:05,765][106225] Updated weights for policy 1, policy_version 1952760 (0.0009) [2023-12-28 09:16:05,930][106226] Updated weights for policy 0, policy_version 1948594 (0.0005) [2023-12-28 09:16:05,983][106226] Updated weights for policy 0, policy_version 1948604 (0.0005) [2023-12-28 09:16:06,045][106226] Updated weights for policy 0, policy_version 1948614 (0.0009) [2023-12-28 09:16:06,174][105115] Fps is (10 sec: 18841.7, 60 sec: 19387.8, 300 sec: 19688.6). Total num frames: 998891520. Throughput: 0: 9674.1, 1: 9714.3. Samples: 998897352. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:06,175][105115] Avg episode reward: [(0, '-4.371'), (1, '-4.592')] [2023-12-28 09:16:06,541][106225] Updated weights for policy 1, policy_version 1952770 (0.0009) [2023-12-28 09:16:06,594][106225] Updated weights for policy 1, policy_version 1952780 (0.0008) [2023-12-28 09:16:06,651][106225] Updated weights for policy 1, policy_version 1952790 (0.0008) [2023-12-28 09:16:06,718][106225] Updated weights for policy 1, policy_version 1952800 (0.0008) [2023-12-28 09:16:06,774][106226] Updated weights for policy 0, policy_version 1948624 (0.0011) [2023-12-28 09:16:06,832][106226] Updated weights for policy 0, policy_version 1948634 (0.0008) [2023-12-28 09:16:06,889][106226] Updated weights for policy 0, policy_version 1948644 (0.0005) [2023-12-28 09:16:07,510][106225] Updated weights for policy 1, policy_version 1952810 (0.0008) [2023-12-28 09:16:07,554][106226] Updated weights for policy 0, policy_version 1948654 (0.0009) [2023-12-28 09:16:07,571][106225] Updated weights for policy 1, policy_version 1952820 (0.0008) [2023-12-28 09:16:07,601][106226] Updated weights for policy 0, policy_version 1948664 (0.0010) [2023-12-28 09:16:07,619][106225] Updated weights for policy 1, policy_version 1952830 (0.0007) [2023-12-28 09:16:07,651][106226] Updated weights for policy 0, policy_version 1948674 (0.0010) [2023-12-28 09:16:08,342][106225] Updated weights for policy 1, policy_version 1952840 (0.0008) [2023-12-28 09:16:08,390][106226] Updated weights for policy 0, policy_version 1948684 (0.0010) [2023-12-28 09:16:08,400][106225] Updated weights for policy 1, policy_version 1952850 (0.0008) [2023-12-28 09:16:08,451][106226] Updated weights for policy 0, policy_version 1948694 (0.0011) [2023-12-28 09:16:08,452][106225] Updated weights for policy 1, policy_version 1952860 (0.0007) [2023-12-28 09:16:08,515][106226] Updated weights for policy 0, policy_version 1948704 (0.0011) [2023-12-28 09:16:09,208][106225] Updated weights for policy 1, policy_version 1952870 (0.0007) [2023-12-28 09:16:09,229][106226] Updated weights for policy 0, policy_version 1948714 (0.0010) [2023-12-28 09:16:09,274][106225] Updated weights for policy 1, policy_version 1952880 (0.0007) [2023-12-28 09:16:09,298][106226] Updated weights for policy 0, policy_version 1948724 (0.0008) [2023-12-28 09:16:09,338][106225] Updated weights for policy 1, policy_version 1952890 (0.0008) [2023-12-28 09:16:09,364][106226] Updated weights for policy 0, policy_version 1948734 (0.0010) [2023-12-28 09:16:09,436][106226] Updated weights for policy 0, policy_version 1948744 (0.0010) [2023-12-28 09:16:10,123][106225] Updated weights for policy 1, policy_version 1952900 (0.0008) [2023-12-28 09:16:10,179][106225] Updated weights for policy 1, policy_version 1952910 (0.0008) [2023-12-28 09:16:10,229][106226] Updated weights for policy 0, policy_version 1948754 (0.0007) [2023-12-28 09:16:10,235][106225] Updated weights for policy 1, policy_version 1952920 (0.0007) [2023-12-28 09:16:10,288][106226] Updated weights for policy 0, policy_version 1948764 (0.0006) [2023-12-28 09:16:10,341][106226] Updated weights for policy 0, policy_version 1948774 (0.0006) [2023-12-28 09:16:11,000][106225] Updated weights for policy 1, policy_version 1952930 (0.0008) [2023-12-28 09:16:11,061][106225] Updated weights for policy 1, policy_version 1952940 (0.0008) [2023-12-28 09:16:11,064][106226] Updated weights for policy 0, policy_version 1948784 (0.0008) [2023-12-28 09:16:11,118][106225] Updated weights for policy 1, policy_version 1952950 (0.0007) [2023-12-28 09:16:11,129][106226] Updated weights for policy 0, policy_version 1948794 (0.0008) [2023-12-28 09:16:11,175][105115] Fps is (10 sec: 18841.3, 60 sec: 19114.7, 300 sec: 19633.0). Total num frames: 998973440. Throughput: 0: 9682.6, 1: 9728.9. Samples: 998954404. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:11,175][105115] Avg episode reward: [(0, '-3.980'), (1, '-4.463')] [2023-12-28 09:16:11,196][106226] Updated weights for policy 0, policy_version 1948804 (0.0007) [2023-12-28 09:16:11,198][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001952960_500015104.pth... [2023-12-28 09:16:11,199][106225] Updated weights for policy 1, policy_version 1952960 (0.0008) [2023-12-28 09:16:11,203][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001951840_499728384.pth [2023-12-28 09:16:11,222][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001948808_498974720.pth... [2023-12-28 09:16:11,227][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001947656_498679808.pth [2023-12-28 09:16:11,978][106225] Updated weights for policy 1, policy_version 1952970 (0.0008) [2023-12-28 09:16:11,983][106226] Updated weights for policy 0, policy_version 1948814 (0.0007) [2023-12-28 09:16:12,037][106225] Updated weights for policy 1, policy_version 1952980 (0.0005) [2023-12-28 09:16:12,044][106226] Updated weights for policy 0, policy_version 1948824 (0.0008) [2023-12-28 09:16:12,094][106225] Updated weights for policy 1, policy_version 1952990 (0.0006) [2023-12-28 09:16:12,102][106226] Updated weights for policy 0, policy_version 1948834 (0.0009) [2023-12-28 09:16:12,827][106226] Updated weights for policy 0, policy_version 1948844 (0.0008) [2023-12-28 09:16:12,835][106225] Updated weights for policy 1, policy_version 1953000 (0.0008) [2023-12-28 09:16:12,886][106225] Updated weights for policy 1, policy_version 1953010 (0.0007) [2023-12-28 09:16:12,886][106226] Updated weights for policy 0, policy_version 1948854 (0.0008) [2023-12-28 09:16:12,941][106225] Updated weights for policy 1, policy_version 1953020 (0.0007) [2023-12-28 09:16:12,942][106226] Updated weights for policy 0, policy_version 1948864 (0.0009) [2023-12-28 09:16:13,570][106226] Updated weights for policy 0, policy_version 1948874 (0.0006) [2023-12-28 09:16:13,610][106225] Updated weights for policy 1, policy_version 1953030 (0.0007) [2023-12-28 09:16:13,625][106226] Updated weights for policy 0, policy_version 1948884 (0.0005) [2023-12-28 09:16:13,663][106225] Updated weights for policy 1, policy_version 1953040 (0.0009) [2023-12-28 09:16:13,674][106226] Updated weights for policy 0, policy_version 1948894 (0.0005) [2023-12-28 09:16:13,709][106225] Updated weights for policy 1, policy_version 1953050 (0.0008) [2023-12-28 09:16:13,725][106226] Updated weights for policy 0, policy_version 1948904 (0.0005) [2023-12-28 09:16:14,359][106226] Updated weights for policy 0, policy_version 1948914 (0.0006) [2023-12-28 09:16:14,362][106225] Updated weights for policy 1, policy_version 1953060 (0.0009) [2023-12-28 09:16:14,420][106226] Updated weights for policy 0, policy_version 1948924 (0.0005) [2023-12-28 09:16:14,421][106225] Updated weights for policy 1, policy_version 1953070 (0.0008) [2023-12-28 09:16:14,479][106226] Updated weights for policy 0, policy_version 1948934 (0.0006) [2023-12-28 09:16:14,483][106225] Updated weights for policy 1, policy_version 1953080 (0.0008) [2023-12-28 09:16:15,161][106225] Updated weights for policy 1, policy_version 1953090 (0.0008) [2023-12-28 09:16:15,221][106226] Updated weights for policy 0, policy_version 1948944 (0.0007) [2023-12-28 09:16:15,231][106225] Updated weights for policy 1, policy_version 1953100 (0.0011) [2023-12-28 09:16:15,284][106226] Updated weights for policy 0, policy_version 1948954 (0.0006) [2023-12-28 09:16:15,297][106225] Updated weights for policy 1, policy_version 1953110 (0.0011) [2023-12-28 09:16:15,347][106226] Updated weights for policy 0, policy_version 1948964 (0.0006) [2023-12-28 09:16:15,357][106225] Updated weights for policy 1, policy_version 1953120 (0.0011) [2023-12-28 09:16:15,916][106225] Updated weights for policy 1, policy_version 1953130 (0.0010) [2023-12-28 09:16:15,951][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:16,100][106226] Updated weights for policy 0, policy_version 1948974 (0.0008) [2023-12-28 09:16:16,157][106226] Updated weights for policy 0, policy_version 1948984 (0.0007) [2023-12-28 09:16:16,175][105115] Fps is (10 sec: 18841.4, 60 sec: 19251.2, 300 sec: 19660.8). Total num frames: 999079936. Throughput: 0: 9753.8, 1: 9597.1. Samples: 999070168. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:16,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.522')] [2023-12-28 09:16:16,204][106226] Updated weights for policy 0, policy_version 1948994 (0.0008) [2023-12-28 09:16:16,587][106225] Updated weights for policy 1, policy_version 1953140 (0.0008) [2023-12-28 09:16:16,638][106225] Updated weights for policy 1, policy_version 1953150 (0.0005) [2023-12-28 09:16:16,646][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:17,061][106226] Updated weights for policy 0, policy_version 1949004 (0.0008) [2023-12-28 09:16:17,109][106226] Updated weights for policy 0, policy_version 1949014 (0.0007) [2023-12-28 09:16:17,162][106226] Updated weights for policy 0, policy_version 1949024 (0.0008) [2023-12-28 09:16:17,247][106225] Updated weights for policy 1, policy_version 1953160 (0.0009) [2023-12-28 09:16:17,294][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:17,932][106226] Updated weights for policy 0, policy_version 1949034 (0.0008) [2023-12-28 09:16:17,985][106226] Updated weights for policy 0, policy_version 1949044 (0.0007) [2023-12-28 09:16:18,015][106225] Updated weights for policy 1, policy_version 1953170 (0.0010) [2023-12-28 09:16:18,044][106226] Updated weights for policy 0, policy_version 1949054 (0.0007) [2023-12-28 09:16:18,065][106225] Updated weights for policy 1, policy_version 1953180 (0.0010) [2023-12-28 09:16:18,082][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:18,089][106226] Updated weights for policy 0, policy_version 1949064 (0.0009) [2023-12-28 09:16:18,807][106226] Updated weights for policy 0, policy_version 1949074 (0.0009) [2023-12-28 09:16:18,871][106226] Updated weights for policy 0, policy_version 1949084 (0.0011) [2023-12-28 09:16:18,918][106225] Updated weights for policy 1, policy_version 1953190 (0.0009) [2023-12-28 09:16:18,931][106226] Updated weights for policy 0, policy_version 1949094 (0.0008) [2023-12-28 09:16:18,974][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:18,976][106225] Updated weights for policy 1, policy_version 1953200 (0.0009) [2023-12-28 09:16:19,612][106226] Updated weights for policy 0, policy_version 1949104 (0.0006) [2023-12-28 09:16:19,683][106226] Updated weights for policy 0, policy_version 1949114 (0.0005) [2023-12-28 09:16:19,749][106226] Updated weights for policy 0, policy_version 1949124 (0.0010) [2023-12-28 09:16:19,796][106225] Updated weights for policy 1, policy_version 1953210 (0.0007) [2023-12-28 09:16:19,830][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:20,484][106226] Updated weights for policy 0, policy_version 1949134 (0.0011) [2023-12-28 09:16:20,537][106226] Updated weights for policy 0, policy_version 1949144 (0.0010) [2023-12-28 09:16:20,604][106226] Updated weights for policy 0, policy_version 1949154 (0.0011) [2023-12-28 09:16:20,671][106225] Updated weights for policy 1, policy_version 1953220 (0.0008) [2023-12-28 09:16:20,736][106225] Updated weights for policy 1, policy_version 1953230 (0.0008) [2023-12-28 09:16:20,747][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:21,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19387.7, 300 sec: 19660.8). Total num frames: 999178240. Throughput: 0: 9671.2, 1: 9682.8. Samples: 999188360. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:21,175][105115] Avg episode reward: [(0, '-4.049'), (1, '-4.508')] [2023-12-28 09:16:21,398][106226] Updated weights for policy 0, policy_version 1949164 (0.0008) [2023-12-28 09:16:21,462][106226] Updated weights for policy 0, policy_version 1949174 (0.0008) [2023-12-28 09:16:21,526][106226] Updated weights for policy 0, policy_version 1949184 (0.0007) [2023-12-28 09:16:21,564][106225] Updated weights for policy 1, policy_version 1953240 (0.0010) [2023-12-28 09:16:21,611][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:22,294][106226] Updated weights for policy 0, policy_version 1949194 (0.0010) [2023-12-28 09:16:22,358][106226] Updated weights for policy 0, policy_version 1949204 (0.0009) [2023-12-28 09:16:22,398][106225] Updated weights for policy 1, policy_version 1953250 (0.0009) [2023-12-28 09:16:22,424][106226] Updated weights for policy 0, policy_version 1949214 (0.0008) [2023-12-28 09:16:22,463][106225] Updated weights for policy 1, policy_version 1953260 (0.0006) [2023-12-28 09:16:22,485][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:22,490][106226] Updated weights for policy 0, policy_version 1949224 (0.0009) [2023-12-28 09:16:23,176][106225] Updated weights for policy 1, policy_version 1953270 (0.0009) [2023-12-28 09:16:23,235][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:23,237][106225] Updated weights for policy 1, policy_version 1953280 (0.0007) [2023-12-28 09:16:23,249][106226] Updated weights for policy 0, policy_version 1949234 (0.0006) [2023-12-28 09:16:23,301][106226] Updated weights for policy 0, policy_version 1949244 (0.0009) [2023-12-28 09:16:23,359][106226] Updated weights for policy 0, policy_version 1949254 (0.0008) [2023-12-28 09:16:24,017][106225] Updated weights for policy 1, policy_version 1953290 (0.0008) [2023-12-28 09:16:24,047][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:24,094][106226] Updated weights for policy 0, policy_version 1949264 (0.0008) [2023-12-28 09:16:24,146][106226] Updated weights for policy 0, policy_version 1949274 (0.0009) [2023-12-28 09:16:24,194][106226] Updated weights for policy 0, policy_version 1949284 (0.0009) [2023-12-28 09:16:24,742][106225] Updated weights for policy 1, policy_version 1953300 (0.0008) [2023-12-28 09:16:24,803][106225] Updated weights for policy 1, policy_version 1953310 (0.0009) [2023-12-28 09:16:24,811][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:24,961][106226] Updated weights for policy 0, policy_version 1949294 (0.0006) [2023-12-28 09:16:25,019][106226] Updated weights for policy 0, policy_version 1949304 (0.0005) [2023-12-28 09:16:25,070][106226] Updated weights for policy 0, policy_version 1949314 (0.0005) [2023-12-28 09:16:25,507][106225] Updated weights for policy 1, policy_version 1953320 (0.0008) [2023-12-28 09:16:25,554][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:25,650][106226] Updated weights for policy 0, policy_version 1949324 (0.0007) [2023-12-28 09:16:25,705][106226] Updated weights for policy 0, policy_version 1949334 (0.0008) [2023-12-28 09:16:25,755][106226] Updated weights for policy 0, policy_version 1949344 (0.0008) [2023-12-28 09:16:26,174][105115] Fps is (10 sec: 19661.0, 60 sec: 19387.8, 300 sec: 19660.8). Total num frames: 999276544. Throughput: 0: 9620.4, 1: 9653.0. Samples: 999245548. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:26,175][105115] Avg episode reward: [(0, '-4.176'), (1, '-4.580')] [2023-12-28 09:16:26,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953328_500162560.pth... [2023-12-28 09:16:26,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001949352_499113984.pth... [2023-12-28 09:16:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001948232_498827264.pth [2023-12-28 09:16:26,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001952416_499875840.pth [2023-12-28 09:16:26,313][106225] Updated weights for policy 1, policy_version 1953330 (0.0009) [2023-12-28 09:16:26,373][106225] Updated weights for policy 1, policy_version 1953340 (0.0007) [2023-12-28 09:16:26,395][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:26,450][106226] Updated weights for policy 0, policy_version 1949354 (0.0009) [2023-12-28 09:16:26,504][106226] Updated weights for policy 0, policy_version 1949364 (0.0008) [2023-12-28 09:16:26,561][106226] Updated weights for policy 0, policy_version 1949374 (0.0008) [2023-12-28 09:16:26,624][106226] Updated weights for policy 0, policy_version 1949384 (0.0008) [2023-12-28 09:16:27,143][106225] Updated weights for policy 1, policy_version 1953350 (0.0008) [2023-12-28 09:16:27,190][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:27,192][106225] Updated weights for policy 1, policy_version 1953360 (0.0008) [2023-12-28 09:16:27,338][106226] Updated weights for policy 0, policy_version 1949394 (0.0006) [2023-12-28 09:16:27,402][106226] Updated weights for policy 0, policy_version 1949404 (0.0007) [2023-12-28 09:16:27,461][106226] Updated weights for policy 0, policy_version 1949414 (0.0008) [2023-12-28 09:16:28,009][106225] Updated weights for policy 1, policy_version 1953370 (0.0009) [2023-12-28 09:16:28,038][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:28,174][106226] Updated weights for policy 0, policy_version 1949424 (0.0009) [2023-12-28 09:16:28,234][106226] Updated weights for policy 0, policy_version 1949434 (0.0006) [2023-12-28 09:16:28,295][106226] Updated weights for policy 0, policy_version 1949444 (0.0005) [2023-12-28 09:16:28,851][106225] Updated weights for policy 1, policy_version 1953380 (0.0009) [2023-12-28 09:16:28,910][106225] Updated weights for policy 1, policy_version 1953390 (0.0009) [2023-12-28 09:16:28,920][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:29,008][106226] Updated weights for policy 0, policy_version 1949454 (0.0008) [2023-12-28 09:16:29,064][106226] Updated weights for policy 0, policy_version 1949464 (0.0008) [2023-12-28 09:16:29,119][106226] Updated weights for policy 0, policy_version 1949474 (0.0008) [2023-12-28 09:16:29,719][106225] Updated weights for policy 1, policy_version 1953400 (0.0008) [2023-12-28 09:16:29,761][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:29,847][106226] Updated weights for policy 0, policy_version 1949484 (0.0008) [2023-12-28 09:16:29,913][106226] Updated weights for policy 0, policy_version 1949494 (0.0007) [2023-12-28 09:16:29,972][106226] Updated weights for policy 0, policy_version 1949504 (0.0007) [2023-12-28 09:16:30,549][106226] Updated weights for policy 0, policy_version 1949514 (0.0008) [2023-12-28 09:16:30,604][106226] Updated weights for policy 0, policy_version 1949524 (0.0008) [2023-12-28 09:16:30,613][106225] Updated weights for policy 1, policy_version 1953410 (0.0008) [2023-12-28 09:16:30,656][106226] Updated weights for policy 0, policy_version 1949534 (0.0005) [2023-12-28 09:16:30,672][106225] Updated weights for policy 1, policy_version 1953420 (0.0008) [2023-12-28 09:16:30,696][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:30,709][106226] Updated weights for policy 0, policy_version 1949544 (0.0005) [2023-12-28 09:16:31,175][105115] Fps is (10 sec: 19660.7, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 999374848. Throughput: 0: 9641.3, 1: 9687.9. Samples: 999365072. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:31,175][105115] Avg episode reward: [(0, '-4.559'), (1, '-4.841')] [2023-12-28 09:16:31,416][106226] Updated weights for policy 0, policy_version 1949554 (0.0009) [2023-12-28 09:16:31,477][106226] Updated weights for policy 0, policy_version 1949564 (0.0007) [2023-12-28 09:16:31,493][106225] Updated weights for policy 1, policy_version 1953430 (0.0008) [2023-12-28 09:16:31,534][106226] Updated weights for policy 0, policy_version 1949574 (0.0007) [2023-12-28 09:16:31,546][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:31,548][106225] Updated weights for policy 1, policy_version 1953440 (0.0008) [2023-12-28 09:16:32,250][106226] Updated weights for policy 0, policy_version 1949584 (0.0008) [2023-12-28 09:16:32,313][106226] Updated weights for policy 0, policy_version 1949594 (0.0008) [2023-12-28 09:16:32,313][106225] Updated weights for policy 1, policy_version 1953450 (0.0011) [2023-12-28 09:16:32,342][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:32,373][106226] Updated weights for policy 0, policy_version 1949604 (0.0008) [2023-12-28 09:16:33,066][106226] Updated weights for policy 0, policy_version 1949614 (0.0009) [2023-12-28 09:16:33,116][106226] Updated weights for policy 0, policy_version 1949624 (0.0010) [2023-12-28 09:16:33,160][106225] Updated weights for policy 1, policy_version 1953460 (0.0008) [2023-12-28 09:16:33,173][106226] Updated weights for policy 0, policy_version 1949634 (0.0010) [2023-12-28 09:16:33,222][106225] Updated weights for policy 1, policy_version 1953470 (0.0008) [2023-12-28 09:16:33,229][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:33,804][106226] Updated weights for policy 0, policy_version 1949644 (0.0008) [2023-12-28 09:16:33,875][106226] Updated weights for policy 0, policy_version 1949654 (0.0006) [2023-12-28 09:16:33,939][106226] Updated weights for policy 0, policy_version 1949664 (0.0006) [2023-12-28 09:16:33,986][106225] Updated weights for policy 1, policy_version 1953480 (0.0008) [2023-12-28 09:16:34,027][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:34,558][106226] Updated weights for policy 0, policy_version 1949674 (0.0006) [2023-12-28 09:16:34,625][106226] Updated weights for policy 0, policy_version 1949684 (0.0008) [2023-12-28 09:16:34,695][106226] Updated weights for policy 0, policy_version 1949694 (0.0008) [2023-12-28 09:16:34,741][106225] Updated weights for policy 1, policy_version 1953490 (0.0008) [2023-12-28 09:16:34,763][106226] Updated weights for policy 0, policy_version 1949704 (0.0008) [2023-12-28 09:16:34,800][106225] Updated weights for policy 1, policy_version 1953500 (0.0006) [2023-12-28 09:16:34,824][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:35,557][106226] Updated weights for policy 0, policy_version 1949714 (0.0007) [2023-12-28 09:16:35,566][106225] Updated weights for policy 1, policy_version 1953510 (0.0008) [2023-12-28 09:16:35,617][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:35,619][106226] Updated weights for policy 0, policy_version 1949724 (0.0007) [2023-12-28 09:16:35,619][106225] Updated weights for policy 1, policy_version 1953520 (0.0010) [2023-12-28 09:16:35,676][106226] Updated weights for policy 0, policy_version 1949734 (0.0008) [2023-12-28 09:16:36,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 999473152. Throughput: 0: 9683.3, 1: 9717.4. Samples: 999484068. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:36,175][105115] Avg episode reward: [(0, '-4.467'), (1, '-4.658')] [2023-12-28 09:16:36,358][106226] Updated weights for policy 0, policy_version 1949744 (0.0006) [2023-12-28 09:16:36,397][106225] Updated weights for policy 1, policy_version 1953530 (0.0010) [2023-12-28 09:16:36,423][106226] Updated weights for policy 0, policy_version 1949754 (0.0006) [2023-12-28 09:16:36,430][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:36,485][106226] Updated weights for policy 0, policy_version 1949764 (0.0008) [2023-12-28 09:16:37,074][106226] Updated weights for policy 0, policy_version 1949774 (0.0008) [2023-12-28 09:16:37,130][106226] Updated weights for policy 0, policy_version 1949784 (0.0008) [2023-12-28 09:16:37,191][106226] Updated weights for policy 0, policy_version 1949794 (0.0008) [2023-12-28 09:16:37,206][106225] Updated weights for policy 1, policy_version 1953540 (0.0010) [2023-12-28 09:16:37,266][106225] Updated weights for policy 1, policy_version 1953550 (0.0010) [2023-12-28 09:16:37,280][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:37,923][106226] Updated weights for policy 0, policy_version 1949804 (0.0005) [2023-12-28 09:16:37,983][106226] Updated weights for policy 0, policy_version 1949814 (0.0005) [2023-12-28 09:16:38,048][106226] Updated weights for policy 0, policy_version 1949824 (0.0005) [2023-12-28 09:16:38,119][106225] Updated weights for policy 1, policy_version 1953560 (0.0011) [2023-12-28 09:16:38,174][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:38,727][106226] Updated weights for policy 0, policy_version 1949834 (0.0008) [2023-12-28 09:16:38,780][106226] Updated weights for policy 0, policy_version 1949844 (0.0009) [2023-12-28 09:16:38,836][106226] Updated weights for policy 0, policy_version 1949854 (0.0008) [2023-12-28 09:16:38,900][106226] Updated weights for policy 0, policy_version 1949864 (0.0008) [2023-12-28 09:16:38,933][106225] Updated weights for policy 1, policy_version 1953570 (0.0010) [2023-12-28 09:16:38,982][106225] Updated weights for policy 1, policy_version 1953580 (0.0008) [2023-12-28 09:16:38,998][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:39,724][106226] Updated weights for policy 0, policy_version 1949874 (0.0010) [2023-12-28 09:16:39,766][106225] Updated weights for policy 1, policy_version 1953590 (0.0008) [2023-12-28 09:16:39,776][106226] Updated weights for policy 0, policy_version 1949884 (0.0006) [2023-12-28 09:16:39,819][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:39,820][106225] Updated weights for policy 1, policy_version 1953600 (0.0007) [2023-12-28 09:16:39,831][106226] Updated weights for policy 0, policy_version 1949894 (0.0007) [2023-12-28 09:16:40,567][106225] Updated weights for policy 1, policy_version 1953610 (0.0010) [2023-12-28 09:16:40,595][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:40,638][106226] Updated weights for policy 0, policy_version 1949904 (0.0010) [2023-12-28 09:16:40,705][106226] Updated weights for policy 0, policy_version 1949914 (0.0011) [2023-12-28 09:16:40,763][106226] Updated weights for policy 0, policy_version 1949924 (0.0010) [2023-12-28 09:16:41,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 999571456. Throughput: 0: 9734.5, 1: 9747.1. Samples: 999543500. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:41,175][105115] Avg episode reward: [(0, '-4.489'), (1, '-4.929')] [2023-12-28 09:16:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953616_500310016.pth... [2023-12-28 09:16:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001949928_499261440.pth... [2023-12-28 09:16:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001952960_500015104.pth [2023-12-28 09:16:41,189][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001948808_498974720.pth [2023-12-28 09:16:41,361][106225] Updated weights for policy 1, policy_version 1953620 (0.0008) [2023-12-28 09:16:41,425][106225] Updated weights for policy 1, policy_version 1953630 (0.0009) [2023-12-28 09:16:41,434][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:41,525][106226] Updated weights for policy 0, policy_version 1949934 (0.0011) [2023-12-28 09:16:41,581][106226] Updated weights for policy 0, policy_version 1949944 (0.0011) [2023-12-28 09:16:41,640][106226] Updated weights for policy 0, policy_version 1949954 (0.0010) [2023-12-28 09:16:42,319][106225] Updated weights for policy 1, policy_version 1953640 (0.0008) [2023-12-28 09:16:42,374][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:42,434][106226] Updated weights for policy 0, policy_version 1949964 (0.0010) [2023-12-28 09:16:42,488][106226] Updated weights for policy 0, policy_version 1949974 (0.0011) [2023-12-28 09:16:42,542][106226] Updated weights for policy 0, policy_version 1949984 (0.0010) [2023-12-28 09:16:43,139][106225] Updated weights for policy 1, policy_version 1953650 (0.0009) [2023-12-28 09:16:43,188][106225] Updated weights for policy 1, policy_version 1953660 (0.0008) [2023-12-28 09:16:43,211][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:43,272][106226] Updated weights for policy 0, policy_version 1949994 (0.0011) [2023-12-28 09:16:43,328][106226] Updated weights for policy 0, policy_version 1950004 (0.0011) [2023-12-28 09:16:43,379][106226] Updated weights for policy 0, policy_version 1950014 (0.0010) [2023-12-28 09:16:43,433][106226] Updated weights for policy 0, policy_version 1950024 (0.0006) [2023-12-28 09:16:43,911][106225] Updated weights for policy 1, policy_version 1953670 (0.0008) [2023-12-28 09:16:43,962][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:43,964][106225] Updated weights for policy 1, policy_version 1953680 (0.0010) [2023-12-28 09:16:44,059][106226] Updated weights for policy 0, policy_version 1950034 (0.0011) [2023-12-28 09:16:44,105][106226] Updated weights for policy 0, policy_version 1950044 (0.0011) [2023-12-28 09:16:44,157][106226] Updated weights for policy 0, policy_version 1950054 (0.0010) [2023-12-28 09:16:44,696][106225] Updated weights for policy 1, policy_version 1953690 (0.0008) [2023-12-28 09:16:44,730][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:44,801][106226] Updated weights for policy 0, policy_version 1950064 (0.0010) [2023-12-28 09:16:44,859][106226] Updated weights for policy 0, policy_version 1950074 (0.0008) [2023-12-28 09:16:44,918][106226] Updated weights for policy 0, policy_version 1950084 (0.0008) [2023-12-28 09:16:45,516][106225] Updated weights for policy 1, policy_version 1953700 (0.0007) [2023-12-28 09:16:45,535][106226] Updated weights for policy 0, policy_version 1950094 (0.0006) [2023-12-28 09:16:45,572][106225] Updated weights for policy 1, policy_version 1953710 (0.0005) [2023-12-28 09:16:45,582][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:45,585][106226] Updated weights for policy 0, policy_version 1950104 (0.0005) [2023-12-28 09:16:45,645][106226] Updated weights for policy 0, policy_version 1950114 (0.0005) [2023-12-28 09:16:46,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19387.7, 300 sec: 19633.0). Total num frames: 999669760. Throughput: 0: 9779.0, 1: 9831.9. Samples: 999660864. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-28 09:16:46,176][105115] Avg episode reward: [(0, '-4.316'), (1, '-4.701')] [2023-12-28 09:16:46,212][106226] Updated weights for policy 0, policy_version 1950124 (0.0007) [2023-12-28 09:16:46,262][106226] Updated weights for policy 0, policy_version 1950134 (0.0010) [2023-12-28 09:16:46,310][106226] Updated weights for policy 0, policy_version 1950144 (0.0011) [2023-12-28 09:16:46,369][106225] Updated weights for policy 1, policy_version 1953720 (0.0007) [2023-12-28 09:16:46,406][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:46,971][106226] Updated weights for policy 0, policy_version 1950154 (0.0011) [2023-12-28 09:16:47,021][106226] Updated weights for policy 0, policy_version 1950164 (0.0011) [2023-12-28 09:16:47,075][106226] Updated weights for policy 0, policy_version 1950174 (0.0010) [2023-12-28 09:16:47,129][106226] Updated weights for policy 0, policy_version 1950184 (0.0010) [2023-12-28 09:16:47,207][106225] Updated weights for policy 1, policy_version 1953730 (0.0008) [2023-12-28 09:16:47,260][106225] Updated weights for policy 1, policy_version 1953740 (0.0008) [2023-12-28 09:16:47,277][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:47,778][106226] Updated weights for policy 0, policy_version 1950194 (0.0011) [2023-12-28 09:16:47,841][106226] Updated weights for policy 0, policy_version 1950204 (0.0010) [2023-12-28 09:16:47,897][106226] Updated weights for policy 0, policy_version 1950214 (0.0010) [2023-12-28 09:16:48,064][106225] Updated weights for policy 1, policy_version 1953750 (0.0006) [2023-12-28 09:16:48,117][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:48,117][106225] Updated weights for policy 1, policy_version 1953760 (0.0007) [2023-12-28 09:16:48,611][106226] Updated weights for policy 0, policy_version 1950224 (0.0009) [2023-12-28 09:16:48,670][106226] Updated weights for policy 0, policy_version 1950234 (0.0008) [2023-12-28 09:16:48,731][106226] Updated weights for policy 0, policy_version 1950244 (0.0008) [2023-12-28 09:16:48,821][106225] Updated weights for policy 1, policy_version 1953770 (0.0005) [2023-12-28 09:16:48,854][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:49,585][106225] Updated weights for policy 1, policy_version 1953780 (0.0007) [2023-12-28 09:16:49,596][106226] Updated weights for policy 0, policy_version 1950254 (0.0008) [2023-12-28 09:16:49,643][106225] Updated weights for policy 1, policy_version 1953790 (0.0007) [2023-12-28 09:16:49,651][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:49,657][106226] Updated weights for policy 0, policy_version 1950264 (0.0006) [2023-12-28 09:16:49,720][106226] Updated weights for policy 0, policy_version 1950274 (0.0007) [2023-12-28 09:16:50,408][106225] Updated weights for policy 1, policy_version 1953800 (0.0006) [2023-12-28 09:16:50,449][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:50,463][106226] Updated weights for policy 0, policy_version 1950284 (0.0006) [2023-12-28 09:16:50,516][106226] Updated weights for policy 0, policy_version 1950294 (0.0009) [2023-12-28 09:16:50,582][106226] Updated weights for policy 0, policy_version 1950304 (0.0008) [2023-12-28 09:16:51,087][106225] Updated weights for policy 1, policy_version 1953810 (0.0008) [2023-12-28 09:16:51,141][106225] Updated weights for policy 1, policy_version 1953820 (0.0009) [2023-12-28 09:16:51,164][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:51,175][105115] Fps is (10 sec: 20480.1, 60 sec: 19524.2, 300 sec: 19633.0). Total num frames: 999776256. Throughput: 0: 9726.4, 1: 9911.0. Samples: 999781036. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:16:51,175][105115] Avg episode reward: [(0, '-4.340'), (1, '-4.552')] [2023-12-28 09:16:51,460][106226] Updated weights for policy 0, policy_version 1950314 (0.0008) [2023-12-28 09:16:51,520][106226] Updated weights for policy 0, policy_version 1950324 (0.0009) [2023-12-28 09:16:51,587][106226] Updated weights for policy 0, policy_version 1950334 (0.0009) [2023-12-28 09:16:51,658][106226] Updated weights for policy 0, policy_version 1950344 (0.0009) [2023-12-28 09:16:52,026][106225] Updated weights for policy 1, policy_version 1953830 (0.0007) [2023-12-28 09:16:52,085][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:52,086][106225] Updated weights for policy 1, policy_version 1953840 (0.0007) [2023-12-28 09:16:52,464][106226] Updated weights for policy 0, policy_version 1950354 (0.0008) [2023-12-28 09:16:52,521][106226] Updated weights for policy 0, policy_version 1950364 (0.0007) [2023-12-28 09:16:52,577][106226] Updated weights for policy 0, policy_version 1950374 (0.0007) [2023-12-28 09:16:52,878][106225] Updated weights for policy 1, policy_version 1953850 (0.0008) [2023-12-28 09:16:52,912][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:53,267][106226] Updated weights for policy 0, policy_version 1950384 (0.0007) [2023-12-28 09:16:53,330][106226] Updated weights for policy 0, policy_version 1950394 (0.0007) [2023-12-28 09:16:53,389][106226] Updated weights for policy 0, policy_version 1950404 (0.0009) [2023-12-28 09:16:53,593][106225] Updated weights for policy 1, policy_version 1953860 (0.0006) [2023-12-28 09:16:53,649][106225] Updated weights for policy 1, policy_version 1953870 (0.0008) [2023-12-28 09:16:53,657][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:54,024][106226] Updated weights for policy 0, policy_version 1950414 (0.0009) [2023-12-28 09:16:54,073][106226] Updated weights for policy 0, policy_version 1950424 (0.0007) [2023-12-28 09:16:54,128][106226] Updated weights for policy 0, policy_version 1950434 (0.0005) [2023-12-28 09:16:54,422][106225] Updated weights for policy 1, policy_version 1953880 (0.0009) [2023-12-28 09:16:54,464][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:54,823][106226] Updated weights for policy 0, policy_version 1950444 (0.0006) [2023-12-28 09:16:54,883][106226] Updated weights for policy 0, policy_version 1950454 (0.0005) [2023-12-28 09:16:54,944][106226] Updated weights for policy 0, policy_version 1950464 (0.0006) [2023-12-28 09:16:55,229][106225] Updated weights for policy 1, policy_version 1953890 (0.0009) [2023-12-28 09:16:55,287][106225] Updated weights for policy 1, policy_version 1953900 (0.0008) [2023-12-28 09:16:55,309][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:55,613][106226] Updated weights for policy 0, policy_version 1950474 (0.0008) [2023-12-28 09:16:55,665][106226] Updated weights for policy 0, policy_version 1950484 (0.0009) [2023-12-28 09:16:55,711][106226] Updated weights for policy 0, policy_version 1950494 (0.0009) [2023-12-28 09:16:55,757][106226] Updated weights for policy 0, policy_version 1950504 (0.0010) [2023-12-28 09:16:56,122][106225] Updated weights for policy 1, policy_version 1953910 (0.0008) [2023-12-28 09:16:56,174][105115] Fps is (10 sec: 19661.3, 60 sec: 19387.8, 300 sec: 19605.3). Total num frames: 999866368. Throughput: 0: 9721.8, 1: 9973.5. Samples: 999840688. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:16:56,175][105115] Avg episode reward: [(0, '-4.437'), (1, '-4.725')] [2023-12-28 09:16:56,179][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:56,180][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953920_500465664.pth... [2023-12-28 09:16:56,181][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001950504_499408896.pth... [2023-12-28 09:16:56,182][106225] Updated weights for policy 1, policy_version 1953920 (0.0006) [2023-12-28 09:16:56,184][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001949352_499113984.pth [2023-12-28 09:16:56,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953328_500162560.pth [2023-12-28 09:16:56,430][106226] Updated weights for policy 0, policy_version 1950514 (0.0005) [2023-12-28 09:16:56,484][106226] Updated weights for policy 0, policy_version 1950524 (0.0005) [2023-12-28 09:16:56,532][106226] Updated weights for policy 0, policy_version 1950534 (0.0005) [2023-12-28 09:16:56,810][106225] Updated weights for policy 1, policy_version 1953930 (0.0010) [2023-12-28 09:16:56,832][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:57,160][106226] Updated weights for policy 0, policy_version 1950544 (0.0010) [2023-12-28 09:16:57,206][106226] Updated weights for policy 0, policy_version 1950554 (0.0010) [2023-12-28 09:16:57,252][106226] Updated weights for policy 0, policy_version 1950564 (0.0010) [2023-12-28 09:16:57,564][106225] Updated weights for policy 1, policy_version 1953940 (0.0010) [2023-12-28 09:16:57,616][106225] Updated weights for policy 1, policy_version 1953950 (0.0010) [2023-12-28 09:16:57,623][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:57,828][106226] Updated weights for policy 0, policy_version 1950574 (0.0008) [2023-12-28 09:16:57,884][106226] Updated weights for policy 0, policy_version 1950584 (0.0010) [2023-12-28 09:16:57,933][106226] Updated weights for policy 0, policy_version 1950594 (0.0010) [2023-12-28 09:16:58,456][106225] Updated weights for policy 1, policy_version 1953960 (0.0009) [2023-12-28 09:16:58,498][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:58,755][106226] Updated weights for policy 0, policy_version 1950604 (0.0014) [2023-12-28 09:16:58,825][106226] Updated weights for policy 0, policy_version 1950614 (0.0009) [2023-12-28 09:16:58,898][106226] Updated weights for policy 0, policy_version 1950624 (0.0008) [2023-12-28 09:16:59,437][106225] Updated weights for policy 1, policy_version 1953970 (0.0009) [2023-12-28 09:16:59,504][106225] Updated weights for policy 1, policy_version 1953980 (0.0008) [2023-12-28 09:16:59,533][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:16:59,607][106226] Updated weights for policy 0, policy_version 1950634 (0.0008) [2023-12-28 09:16:59,668][106226] Updated weights for policy 0, policy_version 1950644 (0.0005) [2023-12-28 09:16:59,730][106226] Updated weights for policy 0, policy_version 1950654 (0.0009) [2023-12-28 09:16:59,790][106226] Updated weights for policy 0, policy_version 1950664 (0.0008) [2023-12-28 09:17:00,385][106225] Updated weights for policy 1, policy_version 1953990 (0.0009) [2023-12-28 09:17:00,442][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:00,445][106225] Updated weights for policy 1, policy_version 1954000 (0.0008) [2023-12-28 09:17:00,524][106226] Updated weights for policy 0, policy_version 1950674 (0.0010) [2023-12-28 09:17:00,585][106226] Updated weights for policy 0, policy_version 1950684 (0.0010) [2023-12-28 09:17:00,652][106226] Updated weights for policy 0, policy_version 1950694 (0.0009) [2023-12-28 09:17:01,125][106225] Updated weights for policy 1, policy_version 1954010 (0.0007) [2023-12-28 09:17:01,168][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:01,174][105115] Fps is (10 sec: 19661.1, 60 sec: 19797.3, 300 sec: 19605.3). Total num frames: 999972864. Throughput: 0: 9784.1, 1: 9981.4. Samples: 999959616. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:01,175][105115] Avg episode reward: [(0, '-4.305'), (1, '-4.887')] [2023-12-28 09:17:01,358][106226] Updated weights for policy 0, policy_version 1950704 (0.0011) [2023-12-28 09:17:01,420][106226] Updated weights for policy 0, policy_version 1950714 (0.0007) [2023-12-28 09:17:01,481][106226] Updated weights for policy 0, policy_version 1950724 (0.0007) [2023-12-28 09:17:01,956][106225] Updated weights for policy 1, policy_version 1954020 (0.0009) [2023-12-28 09:17:02,014][106225] Updated weights for policy 1, policy_version 1954030 (0.0007) [2023-12-28 09:17:02,023][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:02,085][106226] Updated weights for policy 0, policy_version 1950734 (0.0010) [2023-12-28 09:17:02,145][106226] Updated weights for policy 0, policy_version 1950744 (0.0010) [2023-12-28 09:17:02,210][106226] Updated weights for policy 0, policy_version 1950754 (0.0011) [2023-12-28 09:17:02,845][106225] Updated weights for policy 1, policy_version 1954040 (0.0009) [2023-12-28 09:17:02,887][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:02,919][106226] Updated weights for policy 0, policy_version 1950764 (0.0012) [2023-12-28 09:17:02,971][106226] Updated weights for policy 0, policy_version 1950774 (0.0010) [2023-12-28 09:17:03,030][106226] Updated weights for policy 0, policy_version 1950784 (0.0010) [2023-12-28 09:17:03,584][106225] Updated weights for policy 1, policy_version 1954050 (0.0010) [2023-12-28 09:17:03,646][106226] Updated weights for policy 0, policy_version 1950794 (0.0009) [2023-12-28 09:17:03,647][106225] Updated weights for policy 1, policy_version 1954060 (0.0010) [2023-12-28 09:17:03,667][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:03,699][106226] Updated weights for policy 0, policy_version 1950804 (0.0009) [2023-12-28 09:17:03,745][106226] Updated weights for policy 0, policy_version 1950814 (0.0010) [2023-12-28 09:17:03,795][106226] Updated weights for policy 0, policy_version 1950824 (0.0010) [2023-12-28 09:17:04,462][106225] Updated weights for policy 1, policy_version 1954070 (0.0010) [2023-12-28 09:17:04,517][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:04,520][106225] Updated weights for policy 1, policy_version 1954080 (0.0010) [2023-12-28 09:17:04,552][106226] Updated weights for policy 0, policy_version 1950834 (0.0010) [2023-12-28 09:17:04,612][106226] Updated weights for policy 0, policy_version 1950844 (0.0011) [2023-12-28 09:17:04,663][106226] Updated weights for policy 0, policy_version 1950854 (0.0010) [2023-12-28 09:17:05,297][106225] Updated weights for policy 1, policy_version 1954090 (0.0005) [2023-12-28 09:17:05,333][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:05,360][106226] Updated weights for policy 0, policy_version 1950864 (0.0010) [2023-12-28 09:17:05,410][106226] Updated weights for policy 0, policy_version 1950874 (0.0010) [2023-12-28 09:17:05,473][106226] Updated weights for policy 0, policy_version 1950884 (0.0010) [2023-12-28 09:17:06,069][106225] Updated weights for policy 1, policy_version 1954100 (0.0007) [2023-12-28 09:17:06,130][106225] Updated weights for policy 1, policy_version 1954110 (0.0010) [2023-12-28 09:17:06,141][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:06,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19660.8, 300 sec: 19633.0). Total num frames: 1000071168. Throughput: 0: 9878.5, 1: 9931.6. Samples: 1000079816. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:06,175][105115] Avg episode reward: [(0, '-4.291'), (1, '-4.756')] [2023-12-28 09:17:06,192][106226] Updated weights for policy 0, policy_version 1950894 (0.0011) [2023-12-28 09:17:06,257][106226] Updated weights for policy 0, policy_version 1950904 (0.0011) [2023-12-28 09:17:06,315][106226] Updated weights for policy 0, policy_version 1950914 (0.0010) [2023-12-28 09:17:06,921][106225] Updated weights for policy 1, policy_version 1954120 (0.0010) [2023-12-28 09:17:06,967][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:06,979][106226] Updated weights for policy 0, policy_version 1950924 (0.0010) [2023-12-28 09:17:07,032][106226] Updated weights for policy 0, policy_version 1950934 (0.0010) [2023-12-28 09:17:07,079][106226] Updated weights for policy 0, policy_version 1950944 (0.0010) [2023-12-28 09:17:07,672][106225] Updated weights for policy 1, policy_version 1954130 (0.0009) [2023-12-28 09:17:07,730][106225] Updated weights for policy 1, policy_version 1954140 (0.0006) [2023-12-28 09:17:07,751][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:07,823][106226] Updated weights for policy 0, policy_version 1950954 (0.0010) [2023-12-28 09:17:07,869][106226] Updated weights for policy 0, policy_version 1950964 (0.0010) [2023-12-28 09:17:07,929][106226] Updated weights for policy 0, policy_version 1950974 (0.0011) [2023-12-28 09:17:07,985][106226] Updated weights for policy 0, policy_version 1950984 (0.0010) [2023-12-28 09:17:08,454][106225] Updated weights for policy 1, policy_version 1954150 (0.0007) [2023-12-28 09:17:08,505][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:08,506][106225] Updated weights for policy 1, policy_version 1954160 (0.0007) [2023-12-28 09:17:08,739][106226] Updated weights for policy 0, policy_version 1950994 (0.0010) [2023-12-28 09:17:08,807][106226] Updated weights for policy 0, policy_version 1951004 (0.0011) [2023-12-28 09:17:08,866][106226] Updated weights for policy 0, policy_version 1951014 (0.0009) [2023-12-28 09:17:09,349][106225] Updated weights for policy 1, policy_version 1954170 (0.0008) [2023-12-28 09:17:09,392][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:09,543][106226] Updated weights for policy 0, policy_version 1951024 (0.0009) [2023-12-28 09:17:09,606][106226] Updated weights for policy 0, policy_version 1951034 (0.0008) [2023-12-28 09:17:09,674][106226] Updated weights for policy 0, policy_version 1951044 (0.0009) [2023-12-28 09:17:10,238][106225] Updated weights for policy 1, policy_version 1954180 (0.0008) [2023-12-28 09:17:10,300][106225] Updated weights for policy 1, policy_version 1954190 (0.0008) [2023-12-28 09:17:10,312][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:10,370][106226] Updated weights for policy 0, policy_version 1951054 (0.0007) [2023-12-28 09:17:10,427][106226] Updated weights for policy 0, policy_version 1951064 (0.0005) [2023-12-28 09:17:10,485][106226] Updated weights for policy 0, policy_version 1951074 (0.0005) [2023-12-28 09:17:11,075][106225] Updated weights for policy 1, policy_version 1954200 (0.0010) [2023-12-28 09:17:11,128][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:11,143][106226] Updated weights for policy 0, policy_version 1951084 (0.0007) [2023-12-28 09:17:11,175][105115] Fps is (10 sec: 19660.5, 60 sec: 19933.9, 300 sec: 19633.0). Total num frames: 1000169472. Throughput: 0: 9908.1, 1: 9962.5. Samples: 1000139728. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:11,175][105115] Avg episode reward: [(0, '-4.454'), (1, '-4.415')] [2023-12-28 09:17:11,181][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001954208_500613120.pth... [2023-12-28 09:17:11,186][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953616_500310016.pth [2023-12-28 09:17:11,211][106226] Updated weights for policy 0, policy_version 1951094 (0.0008) [2023-12-28 09:17:11,275][106226] Updated weights for policy 0, policy_version 1951104 (0.0009) [2023-12-28 09:17:11,328][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001951112_499564544.pth... [2023-12-28 09:17:11,332][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001949928_499261440.pth [2023-12-28 09:17:11,919][106225] Updated weights for policy 1, policy_version 1954210 (0.0008) [2023-12-28 09:17:11,973][106225] Updated weights for policy 1, policy_version 1954220 (0.0008) [2023-12-28 09:17:11,997][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:12,018][106226] Updated weights for policy 0, policy_version 1951114 (0.0008) [2023-12-28 09:17:12,084][106226] Updated weights for policy 0, policy_version 1951124 (0.0008) [2023-12-28 09:17:12,147][106226] Updated weights for policy 0, policy_version 1951134 (0.0008) [2023-12-28 09:17:12,204][106226] Updated weights for policy 0, policy_version 1951144 (0.0007) [2023-12-28 09:17:12,815][106225] Updated weights for policy 1, policy_version 1954230 (0.0009) [2023-12-28 09:17:12,879][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:12,881][106225] Updated weights for policy 1, policy_version 1954240 (0.0008) [2023-12-28 09:17:12,954][106226] Updated weights for policy 0, policy_version 1951154 (0.0009) [2023-12-28 09:17:13,016][106226] Updated weights for policy 0, policy_version 1951164 (0.0009) [2023-12-28 09:17:13,082][106226] Updated weights for policy 0, policy_version 1951174 (0.0008) [2023-12-28 09:17:13,602][106225] Updated weights for policy 1, policy_version 1954250 (0.0008) [2023-12-28 09:17:13,634][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:13,844][106226] Updated weights for policy 0, policy_version 1951184 (0.0008) [2023-12-28 09:17:13,894][106226] Updated weights for policy 0, policy_version 1951194 (0.0008) [2023-12-28 09:17:13,950][106226] Updated weights for policy 0, policy_version 1951204 (0.0006) [2023-12-28 09:17:14,324][106225] Updated weights for policy 1, policy_version 1954260 (0.0007) [2023-12-28 09:17:14,375][106225] Updated weights for policy 1, policy_version 1954270 (0.0010) [2023-12-28 09:17:14,383][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:14,638][106226] Updated weights for policy 0, policy_version 1951214 (0.0005) [2023-12-28 09:17:14,698][106226] Updated weights for policy 0, policy_version 1951224 (0.0005) [2023-12-28 09:17:14,752][106226] Updated weights for policy 0, policy_version 1951234 (0.0006) [2023-12-28 09:17:15,115][106225] Updated weights for policy 1, policy_version 1954280 (0.0007) [2023-12-28 09:17:15,162][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:15,463][106226] Updated weights for policy 0, policy_version 1951244 (0.0008) [2023-12-28 09:17:15,521][106226] Updated weights for policy 0, policy_version 1951254 (0.0008) [2023-12-28 09:17:15,584][106226] Updated weights for policy 0, policy_version 1951264 (0.0007) [2023-12-28 09:17:15,797][106225] Updated weights for policy 1, policy_version 1954290 (0.0006) [2023-12-28 09:17:15,852][106225] Updated weights for policy 1, policy_version 1954300 (0.0005) [2023-12-28 09:17:15,869][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:16,175][105115] Fps is (10 sec: 19660.6, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 1000267776. Throughput: 0: 9876.6, 1: 9941.9. Samples: 1000256908. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:16,176][105115] Avg episode reward: [(0, '-4.351'), (1, '-4.737')] [2023-12-28 09:17:16,205][106226] Updated weights for policy 0, policy_version 1951274 (0.0008) [2023-12-28 09:17:16,258][106226] Updated weights for policy 0, policy_version 1951284 (0.0008) [2023-12-28 09:17:16,317][106226] Updated weights for policy 0, policy_version 1951294 (0.0009) [2023-12-28 09:17:16,379][106226] Updated weights for policy 0, policy_version 1951304 (0.0009) [2023-12-28 09:17:16,532][106225] Updated weights for policy 1, policy_version 1954310 (0.0007) [2023-12-28 09:17:16,587][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:16,589][106225] Updated weights for policy 1, policy_version 1954320 (0.0007) [2023-12-28 09:17:17,116][106226] Updated weights for policy 0, policy_version 1951314 (0.0008) [2023-12-28 09:17:17,177][106226] Updated weights for policy 0, policy_version 1951324 (0.0008) [2023-12-28 09:17:17,229][106226] Updated weights for policy 0, policy_version 1951334 (0.0008) [2023-12-28 09:17:17,306][106225] Updated weights for policy 1, policy_version 1954330 (0.0008) [2023-12-28 09:17:17,334][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:17,985][106226] Updated weights for policy 0, policy_version 1951344 (0.0008) [2023-12-28 09:17:18,043][106226] Updated weights for policy 0, policy_version 1951354 (0.0009) [2023-12-28 09:17:18,093][106226] Updated weights for policy 0, policy_version 1951364 (0.0007) [2023-12-28 09:17:18,095][106225] Updated weights for policy 1, policy_version 1954340 (0.0007) [2023-12-28 09:17:18,158][106225] Updated weights for policy 1, policy_version 1954350 (0.0008) [2023-12-28 09:17:18,168][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:18,893][106226] Updated weights for policy 0, policy_version 1951374 (0.0010) [2023-12-28 09:17:18,949][106226] Updated weights for policy 0, policy_version 1951384 (0.0011) [2023-12-28 09:17:18,998][106226] Updated weights for policy 0, policy_version 1951394 (0.0007) [2023-12-28 09:17:19,040][106225] Updated weights for policy 1, policy_version 1954360 (0.0009) [2023-12-28 09:17:19,088][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:19,647][106226] Updated weights for policy 0, policy_version 1951404 (0.0007) [2023-12-28 09:17:19,710][106226] Updated weights for policy 0, policy_version 1951414 (0.0008) [2023-12-28 09:17:19,774][106226] Updated weights for policy 0, policy_version 1951424 (0.0009) [2023-12-28 09:17:19,935][106225] Updated weights for policy 1, policy_version 1954370 (0.0008) [2023-12-28 09:17:20,002][106225] Updated weights for policy 1, policy_version 1954380 (0.0008) [2023-12-28 09:17:20,028][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:20,544][106226] Updated weights for policy 0, policy_version 1951434 (0.0007) [2023-12-28 09:17:20,617][106226] Updated weights for policy 0, policy_version 1951444 (0.0008) [2023-12-28 09:17:20,680][106226] Updated weights for policy 0, policy_version 1951454 (0.0010) [2023-12-28 09:17:20,743][106226] Updated weights for policy 0, policy_version 1951464 (0.0011) [2023-12-28 09:17:20,771][106225] Updated weights for policy 1, policy_version 1954390 (0.0007) [2023-12-28 09:17:20,835][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:20,838][106225] Updated weights for policy 1, policy_version 1954400 (0.0006) [2023-12-28 09:17:21,175][105115] Fps is (10 sec: 19661.0, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 1000366080. Throughput: 0: 9825.4, 1: 9987.3. Samples: 1000375636. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:21,175][105115] Avg episode reward: [(0, '-4.175'), (1, '-4.402')] [2023-12-28 09:17:21,463][106226] Updated weights for policy 0, policy_version 1951474 (0.0006) [2023-12-28 09:17:21,523][106226] Updated weights for policy 0, policy_version 1951484 (0.0006) [2023-12-28 09:17:21,582][106226] Updated weights for policy 0, policy_version 1951494 (0.0008) [2023-12-28 09:17:21,662][106225] Updated weights for policy 1, policy_version 1954410 (0.0009) [2023-12-28 09:17:21,700][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:22,344][106226] Updated weights for policy 0, policy_version 1951504 (0.0007) [2023-12-28 09:17:22,412][106226] Updated weights for policy 0, policy_version 1951514 (0.0008) [2023-12-28 09:17:22,482][106226] Updated weights for policy 0, policy_version 1951524 (0.0006) [2023-12-28 09:17:22,491][106225] Updated weights for policy 1, policy_version 1954420 (0.0010) [2023-12-28 09:17:22,552][106225] Updated weights for policy 1, policy_version 1954430 (0.0008) [2023-12-28 09:17:22,561][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:23,241][106226] Updated weights for policy 0, policy_version 1951534 (0.0007) [2023-12-28 09:17:23,244][106225] Updated weights for policy 1, policy_version 1954440 (0.0007) [2023-12-28 09:17:23,286][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:23,304][106226] Updated weights for policy 0, policy_version 1951544 (0.0008) [2023-12-28 09:17:23,353][106226] Updated weights for policy 0, policy_version 1951554 (0.0007) [2023-12-28 09:17:24,017][106225] Updated weights for policy 1, policy_version 1954450 (0.0006) [2023-12-28 09:17:24,029][106226] Updated weights for policy 0, policy_version 1951564 (0.0007) [2023-12-28 09:17:24,066][106225] Updated weights for policy 1, policy_version 1954460 (0.0010) [2023-12-28 09:17:24,077][106226] Updated weights for policy 0, policy_version 1951574 (0.0005) [2023-12-28 09:17:24,083][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:24,122][106226] Updated weights for policy 0, policy_version 1951584 (0.0007) [2023-12-28 09:17:24,831][106226] Updated weights for policy 0, policy_version 1951594 (0.0007) [2023-12-28 09:17:24,879][106226] Updated weights for policy 0, policy_version 1951604 (0.0006) [2023-12-28 09:17:24,885][106225] Updated weights for policy 1, policy_version 1954470 (0.0010) [2023-12-28 09:17:24,929][106226] Updated weights for policy 0, policy_version 1951614 (0.0005) [2023-12-28 09:17:24,951][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:24,954][106225] Updated weights for policy 1, policy_version 1954480 (0.0010) [2023-12-28 09:17:24,981][106226] Updated weights for policy 0, policy_version 1951624 (0.0008) [2023-12-28 09:17:25,615][106226] Updated weights for policy 0, policy_version 1951634 (0.0009) [2023-12-28 09:17:25,676][106226] Updated weights for policy 0, policy_version 1951644 (0.0007) [2023-12-28 09:17:25,677][106225] Updated weights for policy 1, policy_version 1954490 (0.0005) [2023-12-28 09:17:25,713][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:25,730][106226] Updated weights for policy 0, policy_version 1951654 (0.0005) [2023-12-28 09:17:26,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 1000464384. Throughput: 0: 9790.5, 1: 9998.5. Samples: 1000434004. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:26,175][105115] Avg episode reward: [(0, '-4.406'), (1, '-4.572')] [2023-12-28 09:17:26,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001951656_499703808.pth... [2023-12-28 09:17:26,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001954496_500760576.pth... [2023-12-28 09:17:26,185][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001950504_499408896.pth [2023-12-28 09:17:26,188][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001953920_500465664.pth [2023-12-28 09:17:26,307][106225] Updated weights for policy 1, policy_version 1954500 (0.0006) [2023-12-28 09:17:26,363][106225] Updated weights for policy 1, policy_version 1954510 (0.0006) [2023-12-28 09:17:26,372][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:26,388][106226] Updated weights for policy 0, policy_version 1951664 (0.0007) [2023-12-28 09:17:26,439][106226] Updated weights for policy 0, policy_version 1951674 (0.0009) [2023-12-28 09:17:26,487][106226] Updated weights for policy 0, policy_version 1951684 (0.0007) [2023-12-28 09:17:27,119][106225] Updated weights for policy 1, policy_version 1954520 (0.0007) [2023-12-28 09:17:27,162][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:27,178][106226] Updated weights for policy 0, policy_version 1951694 (0.0009) [2023-12-28 09:17:27,232][106226] Updated weights for policy 0, policy_version 1951704 (0.0006) [2023-12-28 09:17:27,293][106226] Updated weights for policy 0, policy_version 1951714 (0.0006) [2023-12-28 09:17:27,823][106225] Updated weights for policy 1, policy_version 1954530 (0.0008) [2023-12-28 09:17:27,870][106225] Updated weights for policy 1, policy_version 1954540 (0.0010) [2023-12-28 09:17:27,885][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:27,934][106226] Updated weights for policy 0, policy_version 1951724 (0.0008) [2023-12-28 09:17:27,980][106226] Updated weights for policy 0, policy_version 1951734 (0.0008) [2023-12-28 09:17:28,026][106226] Updated weights for policy 0, policy_version 1951744 (0.0008) [2023-12-28 09:17:28,675][106225] Updated weights for policy 1, policy_version 1954550 (0.0010) [2023-12-28 09:17:28,731][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:28,734][106225] Updated weights for policy 1, policy_version 1954560 (0.0010) [2023-12-28 09:17:28,787][106226] Updated weights for policy 0, policy_version 1951754 (0.0008) [2023-12-28 09:17:28,845][106226] Updated weights for policy 0, policy_version 1951764 (0.0008) [2023-12-28 09:17:28,905][106226] Updated weights for policy 0, policy_version 1951774 (0.0008) [2023-12-28 09:17:28,962][106226] Updated weights for policy 0, policy_version 1951784 (0.0008) [2023-12-28 09:17:29,516][106225] Updated weights for policy 1, policy_version 1954570 (0.0010) [2023-12-28 09:17:29,542][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:29,674][106226] Updated weights for policy 0, policy_version 1951794 (0.0011) [2023-12-28 09:17:29,731][106226] Updated weights for policy 0, policy_version 1951804 (0.0010) [2023-12-28 09:17:29,789][106226] Updated weights for policy 0, policy_version 1951814 (0.0011) [2023-12-28 09:17:30,317][106225] Updated weights for policy 1, policy_version 1954580 (0.0010) [2023-12-28 09:17:30,384][106225] Updated weights for policy 1, policy_version 1954590 (0.0010) [2023-12-28 09:17:30,392][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:30,503][106226] Updated weights for policy 0, policy_version 1951824 (0.0010) [2023-12-28 09:17:30,558][106226] Updated weights for policy 0, policy_version 1951834 (0.0010) [2023-12-28 09:17:30,616][106226] Updated weights for policy 0, policy_version 1951844 (0.0010) [2023-12-28 09:17:31,175][105115] Fps is (10 sec: 19660.8, 60 sec: 19797.3, 300 sec: 19633.0). Total num frames: 1000562688. Throughput: 0: 9882.8, 1: 10038.1. Samples: 1000557300. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:31,175][105115] Avg episode reward: [(0, '-4.440'), (1, '-4.805')] [2023-12-28 09:17:31,183][106225] Updated weights for policy 1, policy_version 1954600 (0.0009) [2023-12-28 09:17:31,234][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:31,391][106226] Updated weights for policy 0, policy_version 1951854 (0.0007) [2023-12-28 09:17:31,463][106226] Updated weights for policy 0, policy_version 1951864 (0.0007) [2023-12-28 09:17:31,524][106226] Updated weights for policy 0, policy_version 1951874 (0.0010) [2023-12-28 09:17:31,940][106225] Updated weights for policy 1, policy_version 1954610 (0.0006) [2023-12-28 09:17:32,006][106225] Updated weights for policy 1, policy_version 1954620 (0.0009) [2023-12-28 09:17:32,025][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:32,114][106226] Updated weights for policy 0, policy_version 1951884 (0.0008) [2023-12-28 09:17:32,164][106226] Updated weights for policy 0, policy_version 1951894 (0.0008) [2023-12-28 09:17:32,221][106226] Updated weights for policy 0, policy_version 1951904 (0.0007) [2023-12-28 09:17:32,747][106225] Updated weights for policy 1, policy_version 1954630 (0.0010) [2023-12-28 09:17:32,802][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:32,806][106225] Updated weights for policy 1, policy_version 1954640 (0.0010) [2023-12-28 09:17:32,931][106226] Updated weights for policy 0, policy_version 1951914 (0.0008) [2023-12-28 09:17:32,993][106226] Updated weights for policy 0, policy_version 1951924 (0.0006) [2023-12-28 09:17:33,039][106226] Updated weights for policy 0, policy_version 1951934 (0.0008) [2023-12-28 09:17:33,090][106226] Updated weights for policy 0, policy_version 1951944 (0.0007) [2023-12-28 09:17:33,552][106225] Updated weights for policy 1, policy_version 1954650 (0.0010) [2023-12-28 09:17:33,584][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:33,772][106226] Updated weights for policy 0, policy_version 1951954 (0.0010) [2023-12-28 09:17:33,825][106226] Updated weights for policy 0, policy_version 1951964 (0.0009) [2023-12-28 09:17:33,876][106226] Updated weights for policy 0, policy_version 1951974 (0.0006) [2023-12-28 09:17:34,286][106225] Updated weights for policy 1, policy_version 1954660 (0.0009) [2023-12-28 09:17:34,334][106225] Updated weights for policy 1, policy_version 1954670 (0.0009) [2023-12-28 09:17:34,344][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:34,510][106226] Updated weights for policy 0, policy_version 1951984 (0.0007) [2023-12-28 09:17:34,575][106226] Updated weights for policy 0, policy_version 1951994 (0.0008) [2023-12-28 09:17:34,642][106226] Updated weights for policy 0, policy_version 1952004 (0.0006) [2023-12-28 09:17:35,225][106226] Updated weights for policy 0, policy_version 1952014 (0.0006) [2023-12-28 09:17:35,236][106225] Updated weights for policy 1, policy_version 1954680 (0.0009) [2023-12-28 09:17:35,273][106226] Updated weights for policy 0, policy_version 1952024 (0.0005) [2023-12-28 09:17:35,277][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:35,327][106226] Updated weights for policy 0, policy_version 1952034 (0.0005) [2023-12-28 09:17:35,897][106226] Updated weights for policy 0, policy_version 1952044 (0.0005) [2023-12-28 09:17:35,950][106226] Updated weights for policy 0, policy_version 1952054 (0.0006) [2023-12-28 09:17:36,009][106226] Updated weights for policy 0, policy_version 1952064 (0.0006) [2023-12-28 09:17:36,118][106225] Updated weights for policy 1, policy_version 1954690 (0.0009) [2023-12-28 09:17:36,174][105115] Fps is (10 sec: 20480.2, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 1000669184. Throughput: 0: 9953.2, 1: 10031.1. Samples: 1000680328. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:36,175][105115] Avg episode reward: [(0, '-3.993'), (1, '-4.470')] [2023-12-28 09:17:36,186][106225] Updated weights for policy 1, policy_version 1954700 (0.0009) [2023-12-28 09:17:36,208][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:36,664][106226] Updated weights for policy 0, policy_version 1952074 (0.0006) [2023-12-28 09:17:36,715][106226] Updated weights for policy 0, policy_version 1952084 (0.0010) [2023-12-28 09:17:36,766][106226] Updated weights for policy 0, policy_version 1952094 (0.0010) [2023-12-28 09:17:36,819][106226] Updated weights for policy 0, policy_version 1952104 (0.0010) [2023-12-28 09:17:37,044][106225] Updated weights for policy 1, policy_version 1954710 (0.0008) [2023-12-28 09:17:37,092][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:37,095][106225] Updated weights for policy 1, policy_version 1954720 (0.0008) [2023-12-28 09:17:37,477][106226] Updated weights for policy 0, policy_version 1952114 (0.0010) [2023-12-28 09:17:37,536][106226] Updated weights for policy 0, policy_version 1952124 (0.0008) [2023-12-28 09:17:37,597][106226] Updated weights for policy 0, policy_version 1952134 (0.0009) [2023-12-28 09:17:37,992][106225] Updated weights for policy 1, policy_version 1954730 (0.0008) [2023-12-28 09:17:38,027][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:38,211][106226] Updated weights for policy 0, policy_version 1952144 (0.0006) [2023-12-28 09:17:38,275][106226] Updated weights for policy 0, policy_version 1952154 (0.0005) [2023-12-28 09:17:38,343][106226] Updated weights for policy 0, policy_version 1952164 (0.0007) [2023-12-28 09:17:38,837][106225] Updated weights for policy 1, policy_version 1954740 (0.0007) [2023-12-28 09:17:38,903][106225] Updated weights for policy 1, policy_version 1954751 (0.0008) [2023-12-28 09:17:38,907][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:39,014][106226] Updated weights for policy 0, policy_version 1952174 (0.0010) [2023-12-28 09:17:39,076][106226] Updated weights for policy 0, policy_version 1952184 (0.0010) [2023-12-28 09:17:39,137][106226] Updated weights for policy 0, policy_version 1952194 (0.0011) [2023-12-28 09:17:39,704][106225] Updated weights for policy 1, policy_version 1954761 (0.0010) [2023-12-28 09:17:39,743][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:39,940][106226] Updated weights for policy 0, policy_version 1952204 (0.0008) [2023-12-28 09:17:39,999][106226] Updated weights for policy 0, policy_version 1952214 (0.0010) [2023-12-28 09:17:40,062][106226] Updated weights for policy 0, policy_version 1952224 (0.0006) [2023-12-28 09:17:40,516][106225] Updated weights for policy 1, policy_version 1954771 (0.0011) [2023-12-28 09:17:40,573][106225] Updated weights for policy 1, policy_version 1954781 (0.0010) [2023-12-28 09:17:40,590][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:40,728][106226] Updated weights for policy 0, policy_version 1952234 (0.0010) [2023-12-28 09:17:40,788][106226] Updated weights for policy 0, policy_version 1952244 (0.0011) [2023-12-28 09:17:40,844][106226] Updated weights for policy 0, policy_version 1952254 (0.0011) [2023-12-28 09:17:40,899][106226] Updated weights for policy 0, policy_version 1952264 (0.0010) [2023-12-28 09:17:41,175][105115] Fps is (10 sec: 20480.0, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 1000767488. Throughput: 0: 10000.5, 1: 9949.0. Samples: 1000738416. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:41,175][105115] Avg episode reward: [(0, '-4.323'), (1, '-4.519')] [2023-12-28 09:17:41,182][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001954784_500908032.pth... [2023-12-28 09:17:41,182][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001952264_499859456.pth... [2023-12-28 09:17:41,185][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001954208_500613120.pth [2023-12-28 09:17:41,186][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001951112_499564544.pth [2023-12-28 09:17:41,385][106225] Updated weights for policy 1, policy_version 1954791 (0.0009) [2023-12-28 09:17:41,436][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:41,645][106226] Updated weights for policy 0, policy_version 1952274 (0.0009) [2023-12-28 09:17:41,707][106226] Updated weights for policy 0, policy_version 1952284 (0.0008) [2023-12-28 09:17:41,785][106226] Updated weights for policy 0, policy_version 1952294 (0.0008) [2023-12-28 09:17:42,264][106225] Updated weights for policy 1, policy_version 1954801 (0.0008) [2023-12-28 09:17:42,326][106225] Updated weights for policy 1, policy_version 1954811 (0.0007) [2023-12-28 09:17:42,366][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:42,508][106226] Updated weights for policy 0, policy_version 1952304 (0.0009) [2023-12-28 09:17:42,556][106226] Updated weights for policy 0, policy_version 1952314 (0.0008) [2023-12-28 09:17:42,608][106226] Updated weights for policy 0, policy_version 1952324 (0.0006) [2023-12-28 09:17:43,036][106225] Updated weights for policy 1, policy_version 1954821 (0.0006) [2023-12-28 09:17:43,093][106225] Updated weights for policy 1, policy_version 1954831 (0.0005) [2023-12-28 09:17:43,096][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:43,289][106226] Updated weights for policy 0, policy_version 1952334 (0.0007) [2023-12-28 09:17:43,339][106226] Updated weights for policy 0, policy_version 1952344 (0.0005) [2023-12-28 09:17:43,404][106226] Updated weights for policy 0, policy_version 1952354 (0.0006) [2023-12-28 09:17:43,750][106225] Updated weights for policy 1, policy_version 1954841 (0.0008) [2023-12-28 09:17:43,785][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:44,001][106226] Updated weights for policy 0, policy_version 1952364 (0.0007) [2023-12-28 09:17:44,056][106226] Updated weights for policy 0, policy_version 1952374 (0.0008) [2023-12-28 09:17:44,112][106226] Updated weights for policy 0, policy_version 1952384 (0.0007) [2023-12-28 09:17:44,550][106225] Updated weights for policy 1, policy_version 1954851 (0.0008) [2023-12-28 09:17:44,604][106225] Updated weights for policy 1, policy_version 1954861 (0.0008) [2023-12-28 09:17:44,619][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:44,783][106226] Updated weights for policy 0, policy_version 1952394 (0.0008) [2023-12-28 09:17:44,847][106226] Updated weights for policy 0, policy_version 1952404 (0.0008) [2023-12-28 09:17:44,913][106226] Updated weights for policy 0, policy_version 1952414 (0.0009) [2023-12-28 09:17:44,972][106226] Updated weights for policy 0, policy_version 1952424 (0.0008) [2023-12-28 09:17:45,454][106225] Updated weights for policy 1, policy_version 1954871 (0.0008) [2023-12-28 09:17:45,494][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:45,575][106226] Updated weights for policy 0, policy_version 1952434 (0.0009) [2023-12-28 09:17:45,632][106226] Updated weights for policy 0, policy_version 1952444 (0.0010) [2023-12-28 09:17:45,689][106226] Updated weights for policy 0, policy_version 1952454 (0.0006) [2023-12-28 09:17:46,175][105115] Fps is (10 sec: 19660.4, 60 sec: 19933.9, 300 sec: 19660.8). Total num frames: 1000865792. Throughput: 0: 9974.5, 1: 9982.4. Samples: 1000857684. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:46,176][105115] Avg episode reward: [(0, '-4.067'), (1, '-4.450')] [2023-12-28 09:17:46,224][106225] Updated weights for policy 1, policy_version 1954881 (0.0008) [2023-12-28 09:17:46,268][106225] Updated weights for policy 1, policy_version 1954891 (0.0007) [2023-12-28 09:17:46,299][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:46,353][106226] Updated weights for policy 0, policy_version 1952464 (0.0009) [2023-12-28 09:17:46,410][106226] Updated weights for policy 0, policy_version 1952474 (0.0008) [2023-12-28 09:17:46,460][106226] Updated weights for policy 0, policy_version 1952484 (0.0005) [2023-12-28 09:17:47,050][106225] Updated weights for policy 1, policy_version 1954901 (0.0010) [2023-12-28 09:17:47,085][106226] Updated weights for policy 0, policy_version 1952494 (0.0007) [2023-12-28 09:17:47,109][106225] Updated weights for policy 1, policy_version 1954911 (0.0010) [2023-12-28 09:17:47,112][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:47,147][106226] Updated weights for policy 0, policy_version 1952504 (0.0006) [2023-12-28 09:17:47,214][106226] Updated weights for policy 0, policy_version 1952514 (0.0008) [2023-12-28 09:17:47,747][106226] Updated weights for policy 0, policy_version 1952524 (0.0008) [2023-12-28 09:17:47,761][106225] Updated weights for policy 1, policy_version 1954921 (0.0008) [2023-12-28 09:17:47,798][106226] Updated weights for policy 0, policy_version 1952534 (0.0010) [2023-12-28 09:17:47,806][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:47,844][106226] Updated weights for policy 0, policy_version 1952544 (0.0010) [2023-12-28 09:17:48,493][106225] Updated weights for policy 1, policy_version 1954931 (0.0006) [2023-12-28 09:17:48,556][106225] Updated weights for policy 1, policy_version 1954941 (0.0008) [2023-12-28 09:17:48,564][106226] Updated weights for policy 0, policy_version 1952554 (0.0010) [2023-12-28 09:17:48,571][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:48,620][106226] Updated weights for policy 0, policy_version 1952564 (0.0009) [2023-12-28 09:17:48,674][106226] Updated weights for policy 0, policy_version 1952574 (0.0009) [2023-12-28 09:17:48,735][106226] Updated weights for policy 0, policy_version 1952584 (0.0009) [2023-12-28 09:17:49,389][106225] Updated weights for policy 1, policy_version 1954951 (0.0008) [2023-12-28 09:17:49,434][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:49,525][106226] Updated weights for policy 0, policy_version 1952594 (0.0008) [2023-12-28 09:17:49,581][106226] Updated weights for policy 0, policy_version 1952604 (0.0008) [2023-12-28 09:17:49,637][106226] Updated weights for policy 0, policy_version 1952614 (0.0009) [2023-12-28 09:17:50,208][106225] Updated weights for policy 1, policy_version 1954961 (0.0008) [2023-12-28 09:17:50,267][106225] Updated weights for policy 1, policy_version 1954971 (0.0007) [2023-12-28 09:17:50,299][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:50,438][106226] Updated weights for policy 0, policy_version 1952624 (0.0009) [2023-12-28 09:17:50,493][106226] Updated weights for policy 0, policy_version 1952634 (0.0010) [2023-12-28 09:17:50,557][106226] Updated weights for policy 0, policy_version 1952644 (0.0008) [2023-12-28 09:17:51,029][106225] Updated weights for policy 1, policy_version 1954981 (0.0007) [2023-12-28 09:17:51,094][106225] Updated weights for policy 1, policy_version 1954991 (0.0007) [2023-12-28 09:17:51,099][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:51,175][105115] Fps is (10 sec: 20479.8, 60 sec: 19933.9, 300 sec: 19688.6). Total num frames: 1000972288. Throughput: 0: 9970.1, 1: 9999.4. Samples: 1000978444. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-28 09:17:51,175][105115] Avg episode reward: [(0, '-4.207'), (1, '-4.857')] [2023-12-28 09:17:51,383][106226] Updated weights for policy 0, policy_version 1952654 (0.0009) [2023-12-28 09:17:51,444][106226] Updated weights for policy 0, policy_version 1952664 (0.0009) [2023-12-28 09:17:51,507][106226] Updated weights for policy 0, policy_version 1952674 (0.0009) [2023-12-28 09:17:51,896][106225] Updated weights for policy 1, policy_version 1955001 (0.0009) [2023-12-28 09:17:51,938][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:52,210][106226] Updated weights for policy 0, policy_version 1952684 (0.0008) [2023-12-28 09:17:52,261][106226] Updated weights for policy 0, policy_version 1952694 (0.0008) [2023-12-28 09:17:52,326][106226] Updated weights for policy 0, policy_version 1952704 (0.0009) [2023-12-28 09:17:52,749][106225] Updated weights for policy 1, policy_version 1955011 (0.0008) [2023-12-28 09:17:52,813][106225] Updated weights for policy 1, policy_version 1955021 (0.0007) [2023-12-28 09:17:52,824][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:53,062][106226] Updated weights for policy 0, policy_version 1952714 (0.0009) [2023-12-28 09:17:53,126][106226] Updated weights for policy 0, policy_version 1952724 (0.0006) [2023-12-28 09:17:53,191][106226] Updated weights for policy 0, policy_version 1952734 (0.0007) [2023-12-28 09:17:53,241][106226] Updated weights for policy 0, policy_version 1952744 (0.0008) [2023-12-28 09:17:53,532][106225] Updated weights for policy 1, policy_version 1955031 (0.0006) [2023-12-28 09:17:53,578][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:53,937][106226] Updated weights for policy 0, policy_version 1952754 (0.0008) [2023-12-28 09:17:54,001][106226] Updated weights for policy 0, policy_version 1952764 (0.0007) [2023-12-28 09:17:54,053][106226] Updated weights for policy 0, policy_version 1952774 (0.0005) [2023-12-28 09:17:54,291][106225] Updated weights for policy 1, policy_version 1955041 (0.0005) [2023-12-28 09:17:54,358][106225] Updated weights for policy 1, policy_version 1955051 (0.0009) [2023-12-28 09:17:54,386][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:54,712][106226] Updated weights for policy 0, policy_version 1952784 (0.0008) [2023-12-28 09:17:54,760][106226] Updated weights for policy 0, policy_version 1952794 (0.0010) [2023-12-28 09:17:54,813][106226] Updated weights for policy 0, policy_version 1952804 (0.0005) [2023-12-28 09:17:55,066][106225] Updated weights for policy 1, policy_version 1955061 (0.0009) [2023-12-28 09:17:55,127][106225] Updated weights for policy 1, policy_version 1955071 (0.0011) [2023-12-28 09:17:55,130][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:55,500][106226] Updated weights for policy 0, policy_version 1952814 (0.0008) [2023-12-28 09:17:55,550][106226] Updated weights for policy 0, policy_version 1952824 (0.0010) [2023-12-28 09:17:55,606][106226] Updated weights for policy 0, policy_version 1952834 (0.0010) [2023-12-28 09:17:55,950][106225] Updated weights for policy 1, policy_version 1955081 (0.0006) [2023-12-28 09:17:55,991][106141] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-28 09:17:55,992][106239] Stopping RolloutWorker_w9... [2023-12-28 09:17:55,992][106244] Stopping RolloutWorker_w13... [2023-12-28 09:17:55,992][106241] Stopping RolloutWorker_w11... [2023-12-28 09:17:55,992][106233] Stopping RolloutWorker_w5... [2023-12-28 09:17:55,992][106246] Stopping RolloutWorker_w15... [2023-12-28 09:17:55,992][106238] Stopping RolloutWorker_w7... [2023-12-28 09:17:55,992][106228] Stopping RolloutWorker_w1... [2023-12-28 09:17:55,992][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001955088_501063680.pth... [2023-12-28 09:17:55,992][105115] Component RolloutWorker_w9 stopped! [2023-12-28 09:17:55,992][106239] Loop rollout_proc9_evt_loop terminating... [2023-12-28 09:17:55,993][106244] Loop rollout_proc13_evt_loop terminating... [2023-12-28 09:17:55,993][106241] Loop rollout_proc11_evt_loop terminating... [2023-12-28 09:17:55,993][106233] Loop rollout_proc5_evt_loop terminating... [2023-12-28 09:17:55,993][106246] Loop rollout_proc15_evt_loop terminating... [2023-12-28 09:17:55,992][106140] Stopping Batcher_0... [2023-12-28 09:17:55,993][106238] Loop rollout_proc7_evt_loop terminating... [2023-12-28 09:17:55,993][106228] Loop rollout_proc1_evt_loop terminating... [2023-12-28 09:17:55,993][106232] Stopping RolloutWorker_w3... [2023-12-28 09:17:55,993][105115] Component RolloutWorker_w13 stopped! [2023-12-28 09:17:55,993][106232] Loop rollout_proc3_evt_loop terminating... [2023-12-28 09:17:55,993][106140] Loop batcher_evt_loop terminating... [2023-12-28 09:17:55,993][105115] Component RolloutWorker_w5 stopped! [2023-12-28 09:17:55,993][106230] Stopping RolloutWorker_w4... [2023-12-28 09:17:55,994][105115] Component RolloutWorker_w11 stopped! [2023-12-28 09:17:55,994][106230] Loop rollout_proc4_evt_loop terminating... [2023-12-28 09:17:55,994][105115] Component RolloutWorker_w15 stopped! [2023-12-28 09:17:55,994][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001952840_500006912.pth... [2023-12-28 09:17:55,994][106240] Stopping RolloutWorker_w8... [2023-12-28 09:17:55,994][106242] Stopping RolloutWorker_w10... [2023-12-28 09:17:55,994][106229] Stopping RolloutWorker_w2... [2023-12-28 09:17:55,994][106245] Stopping RolloutWorker_w14... [2023-12-28 09:17:55,994][106237] Stopping RolloutWorker_w6... [2023-12-28 09:17:55,994][106227] Stopping RolloutWorker_w0... [2023-12-28 09:17:55,994][106243] Stopping RolloutWorker_w12... [2023-12-28 09:17:55,994][105115] Component RolloutWorker_w7 stopped! [2023-12-28 09:17:55,994][106240] Loop rollout_proc8_evt_loop terminating... [2023-12-28 09:17:55,994][106242] Loop rollout_proc10_evt_loop terminating... [2023-12-28 09:17:55,994][106229] Loop rollout_proc2_evt_loop terminating... [2023-12-28 09:17:55,994][106237] Loop rollout_proc6_evt_loop terminating... [2023-12-28 09:17:55,994][106245] Loop rollout_proc14_evt_loop terminating... [2023-12-28 09:17:55,994][106227] Loop rollout_proc0_evt_loop terminating... [2023-12-28 09:17:55,994][105115] Component RolloutWorker_w1 stopped! [2023-12-28 09:17:55,994][106243] Loop rollout_proc12_evt_loop terminating... [2023-12-28 09:17:55,995][105115] Component Batcher_0 stopped! [2023-12-28 09:17:55,995][105115] Component Batcher_1 stopped! [2023-12-28 09:17:55,995][105115] Component RolloutWorker_w3 stopped! [2023-12-28 09:17:55,996][105115] Component RolloutWorker_w4 stopped! [2023-12-28 09:17:55,992][106141] Stopping Batcher_1... [2023-12-28 09:17:55,996][105115] Component RolloutWorker_w10 stopped! [2023-12-28 09:17:55,996][106141] Loop batcher_evt_loop terminating... [2023-12-28 09:17:55,996][105115] Component RolloutWorker_w8 stopped! [2023-12-28 09:17:55,996][105115] Component RolloutWorker_w2 stopped! [2023-12-28 09:17:55,996][106141] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001954496_500760576.pth [2023-12-28 09:17:55,997][105115] Component RolloutWorker_w14 stopped! [2023-12-28 09:17:55,997][105115] Component RolloutWorker_w6 stopped! [2023-12-28 09:17:55,997][105115] Component RolloutWorker_w0 stopped! [2023-12-28 09:17:55,997][105115] Component RolloutWorker_w12 stopped! [2023-12-28 09:17:55,997][106141] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p1/checkpoint_001955088_501063680.pth... [2023-12-28 09:17:56,001][106141] Stopping LearnerWorker_p1... [2023-12-28 09:17:56,001][105115] Component LearnerWorker_p1 stopped! [2023-12-28 09:17:56,001][106141] Loop learner_proc1_evt_loop terminating... [2023-12-28 09:17:56,003][106140] Removing ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001951656_499703808.pth [2023-12-28 09:17:56,005][106140] Saving ./train_mujoco/mujoco_reacher_APPO/checkpoint_p0/checkpoint_001952840_500006912.pth... [2023-12-28 09:17:56,008][106140] Stopping LearnerWorker_p0... [2023-12-28 09:17:56,009][106140] Loop learner_proc0_evt_loop terminating... [2023-12-28 09:17:56,009][105115] Component LearnerWorker_p0 stopped! [2023-12-28 09:17:56,012][106225] Weights refcount: 2 0 [2023-12-28 09:17:56,013][106225] Stopping InferenceWorker_p1-w0... [2023-12-28 09:17:56,014][106225] Loop inference_proc1-0_evt_loop terminating... [2023-12-28 09:17:56,014][105115] Component InferenceWorker_p1-w0 stopped! [2023-12-28 09:17:56,020][106226] Weights refcount: 2 0 [2023-12-28 09:17:56,021][106226] Stopping InferenceWorker_p0-w0... [2023-12-28 09:17:56,022][106226] Loop inference_proc0-0_evt_loop terminating... [2023-12-28 09:17:56,022][105115] Component InferenceWorker_p0-w0 stopped! [2023-12-28 09:17:56,023][105115] Waiting for process learner_proc0 to stop... [2023-12-28 09:17:56,809][105115] Waiting for process learner_proc1 to stop... [2023-12-28 09:17:56,810][105115] Waiting for process inference_proc0-0 to join... [2023-12-28 09:17:56,837][105115] Waiting for process inference_proc1-0 to join... [2023-12-28 09:17:56,838][105115] Waiting for process rollout_proc0 to join... [2023-12-28 09:17:56,838][105115] Waiting for process rollout_proc1 to join... [2023-12-28 09:17:56,839][105115] Waiting for process rollout_proc2 to join... [2023-12-28 09:17:56,839][105115] Waiting for process rollout_proc3 to join... [2023-12-28 09:17:56,840][105115] Waiting for process rollout_proc4 to join... [2023-12-28 09:17:56,841][105115] Waiting for process rollout_proc5 to join... [2023-12-28 09:17:56,841][105115] Waiting for process rollout_proc6 to join... [2023-12-28 09:17:56,842][105115] Waiting for process rollout_proc7 to join... [2023-12-28 09:17:56,843][105115] Waiting for process rollout_proc8 to join... [2023-12-28 09:17:56,844][105115] Waiting for process rollout_proc9 to join... [2023-12-28 09:17:56,844][105115] Waiting for process rollout_proc10 to join... [2023-12-28 09:17:56,845][105115] Waiting for process rollout_proc11 to join... [2023-12-28 09:17:56,845][105115] Waiting for process rollout_proc12 to join... [2023-12-28 09:17:56,846][105115] Waiting for process rollout_proc13 to join... [2023-12-28 09:17:56,846][105115] Waiting for process rollout_proc14 to join... [2023-12-28 09:17:56,847][105115] Waiting for process rollout_proc15 to join... [2023-12-28 09:17:56,847][105115] Batcher 0 profile tree view: batching: 742.3149, releasing_batches: 1.2563 [2023-12-28 09:17:56,847][105115] Batcher 1 profile tree view: batching: 731.8586, releasing_batches: 1.1617 [2023-12-28 09:17:56,848][105115] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 1064.1332 update_model: 2048.1850 weight_update: 0.0011 one_step: 0.0034 handle_policy_step: 45223.5431 deserialize: 435.8599, stack: 522.5305, obs_to_device_normalize: 6587.6695, forward: 16044.0944, prepare_outputs: 16750.4108, send_messages: 3082.5459 [2023-12-28 09:17:56,848][105115] InferenceWorker_p1-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 1063.2393 update_model: 2025.4116 weight_update: 0.0006 one_step: 0.0029 handle_policy_step: 45265.0965 deserialize: 443.5346, stack: 511.0395, obs_to_device_normalize: 6586.2434, forward: 16055.3255, prepare_outputs: 16884.7312, send_messages: 3032.0468 [2023-12-28 09:17:56,848][105115] Learner 0 profile tree view: misc: 0.3123, prepare_batch: 398.3967 train: 11672.5331 epoch_init: 3.9711, minibatch_init: 219.1619, losses_postprocess: 427.7130, kl_divergence: 234.9220, update: 6109.0252, after_optimizer: 162.4351 calculate_losses: 4279.0272 losses_init: 7.5957, forward_head: 473.1792, bptt_initial: 25.0419, bptt: 31.2336, tail: 1478.1656, advantages_returns: 207.7316, losses: 1801.6251 [2023-12-28 09:17:56,849][105115] Learner 1 profile tree view: misc: 0.2996, prepare_batch: 402.3921 train: 11537.3119 epoch_init: 4.0749, minibatch_init: 216.6550, losses_postprocess: 423.3645, kl_divergence: 234.2478, update: 6017.2729, after_optimizer: 162.2877 calculate_losses: 4243.5193 losses_init: 7.7738, forward_head: 468.9380, bptt_initial: 25.0704, bptt: 28.4198, tail: 1467.7167, advantages_returns: 206.4522, losses: 1786.4234 [2023-12-28 09:17:56,849][105115] RolloutWorker_w0 profile tree view: wait_for_trajectories: 24.4164, enqueue_policy_requests: 4035.8758, process_policy_outputs: 1423.8555, env_step: 16510.3151, finalize_trajectories: 57.3636, complete_rollouts: 47.8089 post_env_step: 4040.0276 process_env_step: 990.6048 [2023-12-28 09:17:56,850][105115] RolloutWorker_w15 profile tree view: wait_for_trajectories: 23.7682, enqueue_policy_requests: 3964.3349, process_policy_outputs: 1399.7640, env_step: 16355.5209, finalize_trajectories: 57.6248, complete_rollouts: 47.3715 post_env_step: 3996.1618 process_env_step: 995.8554 [2023-12-28 09:17:56,850][105115] Loop Runner_EvtLoop terminating... [2023-12-28 09:17:56,851][105115] Runner profile tree view: main_loop: 50650.3631 [2023-12-28 09:17:56,851][105115] Collected {1: 501063680, 0: 500006912}, FPS: 19764.3